[2024-08-05 21:04:30,492][52567] Saving configuration to /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/config.json... [2024-08-05 21:04:30,493][52567] Rollout worker 0 uses device cpu [2024-08-05 21:04:30,493][52567] Rollout worker 1 uses device cpu [2024-08-05 21:04:30,493][52567] Rollout worker 2 uses device cpu [2024-08-05 21:04:30,493][52567] Rollout worker 3 uses device cpu [2024-08-05 21:04:30,493][52567] Rollout worker 4 uses device cpu [2024-08-05 21:04:30,493][52567] Rollout worker 5 uses device cpu [2024-08-05 21:04:30,493][52567] Rollout worker 6 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 7 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 8 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 9 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 10 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 11 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 12 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 13 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 14 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 15 uses device cpu [2024-08-05 21:04:30,494][52567] Rollout worker 16 uses device cpu [2024-08-05 21:04:30,495][52567] Rollout worker 17 uses device cpu [2024-08-05 21:04:30,495][52567] Rollout worker 18 uses device cpu [2024-08-05 21:04:30,495][52567] Rollout worker 19 uses device cpu [2024-08-05 21:04:30,932][52567] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 21:04:30,933][52567] InferenceWorker_p0-w0: min num requests: 6 [2024-08-05 21:04:30,981][52567] Starting all processes... [2024-08-05 21:04:30,981][52567] Starting process learner_proc0 [2024-08-05 21:04:32,358][52567] Starting all processes... [2024-08-05 21:04:32,362][52614] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 21:04:32,362][52614] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for learning process 0 [2024-08-05 21:04:32,362][52567] Starting process inference_proc0-0 [2024-08-05 21:04:32,365][52567] Starting process rollout_proc0 [2024-08-05 21:04:32,366][52567] Starting process rollout_proc1 [2024-08-05 21:04:32,367][52567] Starting process rollout_proc2 [2024-08-05 21:04:32,379][52567] Starting process rollout_proc3 [2024-08-05 21:04:32,380][52567] Starting process rollout_proc4 [2024-08-05 21:04:32,385][52614] Num visible devices: 1 [2024-08-05 21:04:32,380][52567] Starting process rollout_proc5 [2024-08-05 21:04:32,380][52567] Starting process rollout_proc6 [2024-08-05 21:04:32,380][52567] Starting process rollout_proc7 [2024-08-05 21:04:32,418][52614] Starting seed is not provided [2024-08-05 21:04:32,419][52614] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 21:04:32,420][52614] Initializing actor-critic model on device cuda:0 [2024-08-05 21:04:32,421][52614] RunningMeanStd input shape: (23,) [2024-08-05 21:04:32,421][52614] RunningMeanStd input shape: (3, 72, 128) [2024-08-05 21:04:32,422][52614] RunningMeanStd input shape: (1,) [2024-08-05 21:04:32,381][52567] Starting process rollout_proc8 [2024-08-05 21:04:32,383][52567] Starting process rollout_proc9 [2024-08-05 21:04:32,385][52567] Starting process rollout_proc10 [2024-08-05 21:04:32,435][52614] ConvEncoder: input_channels=3 [2024-08-05 21:04:32,385][52567] Starting process rollout_proc11 [2024-08-05 21:04:32,385][52567] Starting process rollout_proc12 [2024-08-05 21:04:32,387][52567] Starting process rollout_proc13 [2024-08-05 21:04:32,392][52567] Starting process rollout_proc14 [2024-08-05 21:04:32,693][52614] Conv encoder output size: 512 [2024-08-05 21:04:32,694][52614] Policy head output size: 640 [2024-08-05 21:04:32,726][52614] Created Actor Critic model with architecture: [2024-08-05 21:04:32,726][52614] ActorCriticSharedWeights( (obs_normalizer): ObservationNormalizer( (running_mean_std): RunningMeanStdDictInPlace( (running_mean_std): ModuleDict( (measurements): RunningMeanStdInPlace() (obs): RunningMeanStdInPlace() ) ) ) (returns_normalizer): RecursiveScriptModule(original_name=RunningMeanStdInPlace) (encoder): VizdoomEncoder( (basic_encoder): ConvEncoder( (enc): RecursiveScriptModule( original_name=ConvEncoderImpl (conv_head): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Conv2d) (1): RecursiveScriptModule(original_name=ELU) (2): RecursiveScriptModule(original_name=Conv2d) (3): RecursiveScriptModule(original_name=ELU) (4): RecursiveScriptModule(original_name=Conv2d) (5): RecursiveScriptModule(original_name=ELU) ) (mlp_layers): RecursiveScriptModule( original_name=Sequential (0): RecursiveScriptModule(original_name=Linear) (1): RecursiveScriptModule(original_name=ELU) ) ) ) (measurements_head): Sequential( (0): Linear(in_features=23, out_features=128, bias=True) (1): ELU(alpha=1.0) (2): Linear(in_features=128, out_features=128, bias=True) (3): ELU(alpha=1.0) ) ) (core): ModelCoreRNN( (core): GRU(640, 512) ) (decoder): MlpDecoder( (mlp): Identity() ) (critic_linear): Linear(in_features=512, out_features=1, bias=True) (action_parameterization): ActionParameterizationDefault( (distribution_linear): Linear(in_features=512, out_features=39, bias=True) ) ) [2024-08-05 21:04:33,529][52614] Using optimizer [2024-08-05 21:04:35,247][52567] Starting process rollout_proc15 [2024-08-05 21:04:35,252][52665] Worker 9 uses CPU cores [1] [2024-08-05 21:04:35,258][52567] Starting process rollout_proc16 [2024-08-05 21:04:35,274][52647] Worker 0 uses CPU cores [0] [2024-08-05 21:04:35,305][52614] No checkpoints found [2024-08-05 21:04:35,305][52614] Did not load from checkpoint, starting from scratch! [2024-08-05 21:04:35,306][52614] Initialized policy 0 weights for model version 0 [2024-08-05 21:04:35,309][52614] LearnerWorker_p0 finished initialization! [2024-08-05 21:04:35,309][52614] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 21:04:35,392][52567] Starting process rollout_proc17 [2024-08-05 21:04:35,401][52659] Worker 3 uses CPU cores [3] [2024-08-05 21:04:35,437][52567] Starting process rollout_proc18 [2024-08-05 21:04:35,449][52669] Worker 12 uses CPU cores [4] [2024-08-05 21:04:35,584][52567] Starting process rollout_proc19 [2024-08-05 21:04:35,607][52649] Worker 1 uses CPU cores [1] [2024-08-05 21:04:35,634][52668] Worker 13 uses CPU cores [5] [2024-08-05 21:04:35,732][52650] Using GPUs [0] for process 0 (actually maps to GPUs [0]) [2024-08-05 21:04:35,732][52650] Set environment var CUDA_VISIBLE_DEVICES to '0' (GPU indices [0]) for inference process 0 [2024-08-05 21:04:35,815][52650] Num visible devices: 1 [2024-08-05 21:04:36,032][52660] Worker 5 uses CPU cores [5] [2024-08-05 21:04:36,117][52663] Worker 4 uses CPU cores [4] [2024-08-05 21:04:36,129][52667] Worker 10 uses CPU cores [2] [2024-08-05 21:04:36,140][52670] Worker 14 uses CPU cores [6] [2024-08-05 21:04:36,143][52658] Worker 2 uses CPU cores [2] [2024-08-05 21:04:36,176][52662] Worker 7 uses CPU cores [7] [2024-08-05 21:04:36,251][52664] Worker 8 uses CPU cores [0] [2024-08-05 21:04:36,403][52650] RunningMeanStd input shape: (23,) [2024-08-05 21:04:36,404][52650] RunningMeanStd input shape: (3, 72, 128) [2024-08-05 21:04:36,404][52650] RunningMeanStd input shape: (1,) [2024-08-05 21:04:36,415][52650] ConvEncoder: input_channels=3 [2024-08-05 21:04:36,476][52671] Worker 11 uses CPU cores [3] [2024-08-05 21:04:36,482][52666] Worker 6 uses CPU cores [6] [2024-08-05 21:04:36,611][52650] Conv encoder output size: 512 [2024-08-05 21:04:36,612][52650] Policy head output size: 640 [2024-08-05 21:04:37,286][52820] Worker 19 uses CPU cores [6, 7] [2024-08-05 21:04:37,327][52794] Worker 15 uses CPU cores [7] [2024-08-05 21:04:37,344][52803] Worker 17 uses CPU cores [2, 3] [2024-08-05 21:04:37,345][52795] Worker 16 uses CPU cores [0, 1] [2024-08-05 21:04:37,423][52567] Inference worker 0-0 is ready! [2024-08-05 21:04:37,423][52567] All inference workers are ready! Signal rollout workers to start! [2024-08-05 21:04:37,424][52567] Fps is (10 sec: nan, 60 sec: nan, 300 sec: nan). Total num frames: 0. Throughput: 0: nan. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:04:37,430][52811] Worker 18 uses CPU cores [4, 5] [2024-08-05 21:04:37,483][52647] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,485][52658] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,486][52658] Port 40500 is available [2024-08-05 21:04:37,487][52658] Using port 40500 [2024-08-05 21:04:37,487][52667] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,489][52667] Port 41300 is available [2024-08-05 21:04:37,489][52664] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,491][52664] Port 41100 is available [2024-08-05 21:04:37,489][52667] Using port 41300 [2024-08-05 21:04:37,491][52664] Using port 41100 [2024-08-05 21:04:37,490][52647] Port 40300 is available [2024-08-05 21:04:37,494][52647] Using port 40300 [2024-08-05 21:04:37,503][52665] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,503][52662] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,505][52660] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,507][52649] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,506][52660] Port 40800 is available [2024-08-05 21:04:37,513][52660] Using port 40800 [2024-08-05 21:04:37,514][52659] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,509][52665] Port 41200 is available [2024-08-05 21:04:37,514][52665] Using port 41200 [2024-08-05 21:04:37,500][52671] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,510][52795] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,519][52803] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,520][52649] Port 40400 is available [2024-08-05 21:04:37,521][52649] Using port 40400 [2024-08-05 21:04:37,521][52820] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,506][52663] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,513][52668] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,522][52671] Port 41400 is available [2024-08-05 21:04:37,522][52671] Using port 41400 [2024-08-05 21:04:37,510][52669] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,523][52795] Port 41900 is available [2024-08-05 21:04:37,523][52795] Using port 41900 [2024-08-05 21:04:37,523][52659] Port 40600 is available [2024-08-05 21:04:37,524][52659] Using port 40600 [2024-08-05 21:04:37,524][52669] Port 41500 is available [2024-08-05 21:04:37,528][52669] Using port 41500 [2024-08-05 21:04:37,529][52662] Port 41000 is available [2024-08-05 21:04:37,529][52662] Using port 41000 [2024-08-05 21:04:37,524][52668] Port 41600 is available [2024-08-05 21:04:37,525][52663] Port 40700 is available [2024-08-05 21:04:37,527][52820] Port 42200 is available [2024-08-05 21:04:37,531][52668] Using port 41600 [2024-08-05 21:04:37,531][52820] Using port 42200 [2024-08-05 21:04:37,531][52663] Using port 40700 [2024-08-05 21:04:37,521][52803] Port 42000 is available [2024-08-05 21:04:37,532][52803] Using port 42000 [2024-08-05 21:04:37,542][52670] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,542][52794] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,543][52670] Port 41700 is available [2024-08-05 21:04:37,545][52666] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,547][52666] Port 40900 is available [2024-08-05 21:04:37,547][52666] Using port 40900 [2024-08-05 21:04:37,548][52658] Port 40501 is available [2024-08-05 21:04:37,548][52658] Using port 40501 [2024-08-05 21:04:37,544][52670] Using port 41700 [2024-08-05 21:04:37,543][52794] Port 41800 is available [2024-08-05 21:04:37,560][52794] Using port 41800 [2024-08-05 21:04:37,563][52647] Port 40301 is available [2024-08-05 21:04:37,568][52647] Using port 40301 [2024-08-05 21:04:37,576][52664] Port 41101 is available [2024-08-05 21:04:37,577][52664] Using port 41101 [2024-08-05 21:04:37,595][52667] Port 41301 is available [2024-08-05 21:04:37,599][52667] Using port 41301 [2024-08-05 21:04:37,617][52668] Port 41601 is available [2024-08-05 21:04:37,618][52668] Using port 41601 [2024-08-05 21:04:37,613][52811] Doom resolution: 160x120, resize resolution: (128, 72) [2024-08-05 21:04:37,620][52649] Port 40401 is available [2024-08-05 21:04:37,622][52665] Port 41201 is available [2024-08-05 21:04:37,622][52665] Using port 41201 [2024-08-05 21:04:37,621][52649] Using port 40401 [2024-08-05 21:04:37,632][52811] Port 42100 is available [2024-08-05 21:04:37,632][52811] Using port 42100 [2024-08-05 21:04:37,632][52660] Port 40801 is available [2024-08-05 21:04:37,632][52660] Using port 40801 [2024-08-05 21:04:37,632][52803] Port 42001 is available [2024-08-05 21:04:37,637][52803] Using port 42001 [2024-08-05 21:04:37,650][52669] Port 41501 is available [2024-08-05 21:04:37,650][52669] Using port 41501 [2024-08-05 21:04:37,668][52671] Port 41401 is available [2024-08-05 21:04:37,669][52666] Port 40901 is available [2024-08-05 21:04:37,667][52662] Port 41001 is available [2024-08-05 21:04:37,677][52671] Using port 41401 [2024-08-05 21:04:37,677][52662] Using port 41001 [2024-08-05 21:04:37,677][52666] Using port 40901 [2024-08-05 21:04:37,685][52663] Port 40701 is available [2024-08-05 21:04:37,685][52795] Port 41901 is available [2024-08-05 21:04:37,685][52658] Port 40502 is available [2024-08-05 21:04:37,685][52663] Using port 40701 [2024-08-05 21:04:37,685][52795] Using port 41901 [2024-08-05 21:04:37,685][52658] Using port 40502 [2024-08-05 21:04:37,686][52794] Port 41801 is available [2024-08-05 21:04:37,688][52670] Port 41701 is available [2024-08-05 21:04:37,688][52659] Port 40601 is available [2024-08-05 21:04:37,688][52820] Port 42201 is available [2024-08-05 21:04:37,689][52664] Port 41102 is available [2024-08-05 21:04:37,691][52667] Port 41302 is available [2024-08-05 21:04:37,703][52668] Port 41602 is available [2024-08-05 21:04:37,708][52668] Using port 41602 [2024-08-05 21:04:37,703][52670] Using port 41701 [2024-08-05 21:04:37,710][52649] Port 40402 is available [2024-08-05 21:04:37,710][52649] Using port 40402 [2024-08-05 21:04:37,703][52659] Using port 40601 [2024-08-05 21:04:37,712][52662] Port 41002 is available [2024-08-05 21:04:37,712][52662] Using port 41002 [2024-08-05 21:04:37,713][52647] Port 40302 is available [2024-08-05 21:04:37,713][52647] Using port 40302 [2024-08-05 21:04:37,704][52820] Using port 42201 [2024-08-05 21:04:37,704][52664] Using port 41102 [2024-08-05 21:04:37,704][52667] Using port 41302 [2024-08-05 21:04:37,718][52660] Port 40802 is available [2024-08-05 21:04:37,718][52660] Using port 40802 [2024-08-05 21:04:37,703][52794] Using port 41801 [2024-08-05 21:04:37,706][52665] Port 41202 is available [2024-08-05 21:04:37,720][52665] Using port 41202 [2024-08-05 21:04:37,720][52666] Port 40902 is available [2024-08-05 21:04:37,720][52666] Using port 40902 [2024-08-05 21:04:37,721][52803] Port 42002 is available [2024-08-05 21:04:37,721][52803] Using port 42002 [2024-08-05 21:04:37,723][52671] Port 41402 is available [2024-08-05 21:04:37,724][52671] Using port 41402 [2024-08-05 21:04:37,721][52669] Port 41502 is available [2024-08-05 21:04:37,733][52669] Using port 41502 [2024-08-05 21:04:37,740][52811] Port 42101 is available [2024-08-05 21:04:37,740][52811] Using port 42101 [2024-08-05 21:04:37,749][52795] Port 41902 is available [2024-08-05 21:04:37,756][52795] Using port 41902 [2024-08-05 21:04:37,759][52670] Port 41702 is available [2024-08-05 21:04:37,752][52663] Port 40702 is available [2024-08-05 21:04:37,765][52663] Using port 40702 [2024-08-05 21:04:37,754][52668] Port 41603 is available [2024-08-05 21:04:37,768][52668] Using port 41603 [2024-08-05 21:04:37,769][52666] Port 40903 is available [2024-08-05 21:04:37,770][52666] Using port 40903 [2024-08-05 21:04:37,759][52649] Port 40403 is available [2024-08-05 21:04:37,772][52649] Using port 40403 [2024-08-05 21:04:37,759][52658] Port 40503 is available [2024-08-05 21:04:37,774][52658] Using port 40503 [2024-08-05 21:04:37,760][52660] Port 40803 is available [2024-08-05 21:04:37,776][52660] Using port 40803 [2024-08-05 21:04:37,761][52659] Port 40602 is available [2024-08-05 21:04:37,779][52647] Port 40303 is available [2024-08-05 21:04:37,762][52665] Port 41203 is available [2024-08-05 21:04:37,784][52665] Using port 41203 [2024-08-05 21:04:37,785][52669] Port 41503 is available [2024-08-05 21:04:37,785][52669] Using port 41503 [2024-08-05 21:04:37,787][52795] Port 41903 is available [2024-08-05 21:04:37,787][52795] Using port 41903 [2024-08-05 21:04:37,764][52670] Using port 41702 [2024-08-05 21:04:37,779][52659] Using port 40602 [2024-08-05 21:04:37,782][52671] Port 41403 is available [2024-08-05 21:04:37,783][52647] Using port 40303 [2024-08-05 21:04:37,788][52671] Using port 41403 [2024-08-05 21:04:37,782][52664] Port 41103 is available [2024-08-05 21:04:37,789][52664] Using port 41103 [2024-08-05 21:04:37,792][52667] Port 41303 is available [2024-08-05 21:04:37,792][52667] Using port 41303 [2024-08-05 21:04:37,793][52662] Port 41003 is available [2024-08-05 21:04:37,794][52662] Using port 41003 [2024-08-05 21:04:37,794][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:04:37,798][52820] Port 42202 is available [2024-08-05 21:04:37,799][52820] Using port 42202 [2024-08-05 21:04:37,804][52803] Port 42003 is available [2024-08-05 21:04:37,804][52803] Using port 42003 [2024-08-05 21:04:37,804][52794] Port 41802 is available [2024-08-05 21:04:37,805][52794] Using port 41802 [2024-08-05 21:04:37,804][52811] Port 42102 is available [2024-08-05 21:04:37,805][52811] Using port 42102 [2024-08-05 21:04:37,819][52666] Port 40904 is available [2024-08-05 21:04:37,819][52666] Using port 40904 [2024-08-05 21:04:37,824][52663] Port 40703 is available [2024-08-05 21:04:37,824][52663] Using port 40703 [2024-08-05 21:04:37,825][52649] Port 40404 is available [2024-08-05 21:04:37,825][52649] Using port 40404 [2024-08-05 21:04:37,838][52668] Port 41604 is available [2024-08-05 21:04:37,839][52670] Port 41703 is available [2024-08-05 21:04:37,846][52668] Using port 41604 [2024-08-05 21:04:37,846][52670] Using port 41703 [2024-08-05 21:04:37,839][52665] Port 41204 is available [2024-08-05 21:04:37,848][52665] Using port 41204 [2024-08-05 21:04:37,848][52667] Port 41304 is available [2024-08-05 21:04:37,848][52667] Using port 41304 [2024-08-05 21:04:37,846][52658] Port 40504 is available [2024-08-05 21:04:37,849][52658] Using port 40504 [2024-08-05 21:04:37,849][52669] Port 41504 is available [2024-08-05 21:04:37,852][52669] Using port 41504 [2024-08-05 21:04:37,846][52660] Port 40804 is available [2024-08-05 21:04:37,860][52660] Using port 40804 [2024-08-05 21:04:37,866][52647] Port 40304 is available [2024-08-05 21:04:37,872][52647] Using port 40304 [2024-08-05 21:04:37,874][52820] Port 42203 is available [2024-08-05 21:04:37,873][52664] Port 41104 is available [2024-08-05 21:04:37,875][52820] Using port 42203 [2024-08-05 21:04:37,875][52664] Using port 41104 [2024-08-05 21:04:37,878][52649] Port 40405 is available [2024-08-05 21:04:37,878][52649] Using port 40405 [2024-08-05 21:04:37,879][52666] Port 40905 is available [2024-08-05 21:04:37,879][52666] Using port 40905 [2024-08-05 21:04:37,879][52662] Port 41004 is available [2024-08-05 21:04:37,879][52662] Using port 41004 [2024-08-05 21:04:37,883][52671] Port 41404 is available [2024-08-05 21:04:37,883][52671] Using port 41404 [2024-08-05 21:04:37,886][52659] Port 40603 is available [2024-08-05 21:04:37,886][52659] Using port 40603 [2024-08-05 21:04:37,892][52663] Port 40704 is available [2024-08-05 21:04:37,892][52663] Using port 40704 [2024-08-05 21:04:37,893][52795] Port 41904 is available [2024-08-05 21:04:37,900][52795] Using port 41904 [2024-08-05 21:04:37,898][52811] Port 42103 is available [2024-08-05 21:04:37,905][52811] Using port 42103 [2024-08-05 21:04:37,899][52794] Port 41803 is available [2024-08-05 21:04:37,907][52794] Using port 41803 [2024-08-05 21:04:37,908][52803] Port 42004 is available [2024-08-05 21:04:37,908][52803] Using port 42004 [2024-08-05 21:04:37,912][52665] Port 41205 is available [2024-08-05 21:04:37,912][52665] Using port 41205 [2024-08-05 21:04:37,914][52670] Port 41704 is available [2024-08-05 21:04:37,914][52670] Using port 41704 [2024-08-05 21:04:37,916][52658] Port 40505 is available [2024-08-05 21:04:37,917][52658] Using port 40505 [2024-08-05 21:04:37,922][52667] Port 41305 is available [2024-08-05 21:04:37,923][52667] Using port 41305 [2024-08-05 21:04:37,926][52669] Port 41505 is available [2024-08-05 21:04:37,927][52669] Using port 41505 [2024-08-05 21:04:37,931][52668] Port 41605 is available [2024-08-05 21:04:37,931][52668] Using port 41605 [2024-08-05 21:04:37,937][52649] Port 40406 is available [2024-08-05 21:04:37,937][52649] Using port 40406 [2024-08-05 21:04:37,943][52666] Port 40906 is available [2024-08-05 21:04:37,943][52666] Using port 40906 [2024-08-05 21:04:37,946][52664] Port 41105 is available [2024-08-05 21:04:37,955][52664] Using port 41105 [2024-08-05 21:04:37,946][52794] Port 41804 is available [2024-08-05 21:04:37,956][52794] Using port 41804 [2024-08-05 21:04:37,956][52647] Port 40305 is available [2024-08-05 21:04:37,956][52663] Port 40705 is available [2024-08-05 21:04:37,957][52663] Using port 40705 [2024-08-05 21:04:37,957][52647] Using port 40305 [2024-08-05 21:04:37,968][52659] Port 40604 is available [2024-08-05 21:04:37,968][52659] Using port 40604 [2024-08-05 21:04:37,969][52820] Port 42204 is available [2024-08-05 21:04:37,970][52820] Using port 42204 [2024-08-05 21:04:37,970][52795] Port 41905 is available [2024-08-05 21:04:37,970][52662] Port 41005 is available [2024-08-05 21:04:37,970][52795] Using port 41905 [2024-08-05 21:04:37,970][52662] Using port 41005 [2024-08-05 21:04:37,975][52665] Port 41206 is available [2024-08-05 21:04:37,975][52665] Using port 41206 [2024-08-05 21:04:37,978][52671] Port 41405 is available [2024-08-05 21:04:37,978][52671] Using port 41405 [2024-08-05 21:04:37,986][52811] Port 42104 is available [2024-08-05 21:04:37,986][52811] Using port 42104 [2024-08-05 21:04:37,995][52803] Port 42005 is available [2024-08-05 21:04:38,007][52803] Using port 42005 [2024-08-05 21:04:37,999][52660] Port 40805 is available [2024-08-05 21:04:38,008][52660] Using port 40805 [2024-08-05 21:04:38,009][52794] Port 41805 is available [2024-08-05 21:04:38,009][52794] Using port 41805 [2024-08-05 21:04:38,010][52647] Port 40306 is available [2024-08-05 21:04:38,000][52649] Port 40407 is available [2024-08-05 21:04:38,016][52649] Using port 40407 [2024-08-05 21:04:38,004][52666] Port 40907 is available [2024-08-05 21:04:38,020][52666] Using port 40907 [2024-08-05 21:04:38,022][52668] Port 41606 is available [2024-08-05 21:04:38,023][52668] Using port 41606 [2024-08-05 21:04:38,010][52670] Port 41705 is available [2024-08-05 21:04:38,012][52664] Port 41106 is available [2024-08-05 21:04:38,024][52670] Using port 41705 [2024-08-05 21:04:38,024][52664] Using port 41106 [2024-08-05 21:04:38,026][52658] Port 40506 is available [2024-08-05 21:04:38,026][52658] Using port 40506 [2024-08-05 21:04:38,026][52669] Port 41506 is available [2024-08-05 21:04:38,026][52669] Using port 41506 [2024-08-05 21:04:38,012][52647] Using port 40306 [2024-08-05 21:04:38,029][52667] Port 41306 is available [2024-08-05 21:04:38,030][52667] Using port 41306 [2024-08-05 21:04:38,015][52662] Port 41006 is available [2024-08-05 21:04:38,030][52662] Using port 41006 [2024-08-05 21:04:38,031][52659] Port 40605 is available [2024-08-05 21:04:38,031][52659] Using port 40605 [2024-08-05 21:04:38,033][52795] Port 41906 is available [2024-08-05 21:04:38,033][52795] Using port 41906 [2024-08-05 21:04:38,041][52671] Port 41406 is available [2024-08-05 21:04:38,041][52671] Using port 41406 [2024-08-05 21:04:38,042][52665] Port 41207 is available [2024-08-05 21:04:38,043][52665] Using port 41207 [2024-08-05 21:04:38,048][52663] Port 40706 is available [2024-08-05 21:04:38,049][52663] Using port 40706 [2024-08-05 21:04:38,055][52820] Port 42205 is available [2024-08-05 21:04:38,055][52820] Using port 42205 [2024-08-05 21:04:38,057][52794] Port 41806 is available [2024-08-05 21:04:38,057][52794] Using port 41806 [2024-08-05 21:04:38,061][52660] Port 40806 is available [2024-08-05 21:04:38,061][52660] Using port 40806 [2024-08-05 21:04:38,066][52811] Port 42105 is available [2024-08-05 21:04:38,066][52811] Using port 42105 [2024-08-05 21:04:38,071][52662] Port 41007 is available [2024-08-05 21:04:38,071][52662] Using port 41007 [2024-08-05 21:04:38,074][52668] Port 41607 is available [2024-08-05 21:04:38,074][52668] Using port 41607 [2024-08-05 21:04:38,075][52803] Port 42006 is available [2024-08-05 21:04:38,075][52803] Using port 42006 [2024-08-05 21:04:38,078][52649] Port 40408 is available [2024-08-05 21:04:38,084][52649] Using port 40408 [2024-08-05 21:04:38,096][52795] Port 41907 is available [2024-08-05 21:04:38,096][52795] Using port 41907 [2024-08-05 21:04:38,099][52666] Port 40908 is available [2024-08-05 21:04:38,099][52666] Using port 40908 [2024-08-05 21:04:38,149][52647] Port 40307 is available [2024-08-05 21:04:38,149][52794] Port 41807 is available [2024-08-05 21:04:38,150][52647] Using port 40307 [2024-08-05 21:04:38,150][52794] Using port 41807 [2024-08-05 21:04:38,149][52670] Port 41706 is available [2024-08-05 21:04:38,151][52670] Using port 41706 [2024-08-05 21:04:38,149][52664] Port 41107 is available [2024-08-05 21:04:38,101][52659] Port 40606 is available [2024-08-05 21:04:38,152][52664] Using port 41107 [2024-08-05 21:04:38,152][52659] Using port 40606 [2024-08-05 21:04:38,152][52660] Port 40807 is available [2024-08-05 21:04:38,153][52660] Using port 40807 [2024-08-05 21:04:38,149][52658] Port 40507 is available [2024-08-05 21:04:38,153][52658] Using port 40507 [2024-08-05 21:04:38,154][52663] Port 40707 is available [2024-08-05 21:04:38,155][52663] Using port 40707 [2024-08-05 21:04:38,158][52665] Port 41208 is available [2024-08-05 21:04:38,159][52671] Port 41407 is available [2024-08-05 21:04:38,159][52669] Port 41507 is available [2024-08-05 21:04:38,159][52668] Port 41608 is available [2024-08-05 21:04:38,159][52665] Using port 41208 [2024-08-05 21:04:38,159][52671] Using port 41407 [2024-08-05 21:04:38,158][52649] Port 40409 is available [2024-08-05 21:04:38,159][52669] Using port 41507 [2024-08-05 21:04:38,163][52667] Port 41307 is available [2024-08-05 21:04:38,165][52667] Using port 41307 [2024-08-05 21:04:38,175][52662] Port 41008 is available [2024-08-05 21:04:38,176][52662] Using port 41008 [2024-08-05 21:04:38,159][52668] Using port 41608 [2024-08-05 21:04:38,161][52649] Using port 40409 [2024-08-05 21:04:38,181][52649] Using port 40400 on host... [2024-08-05 21:04:38,190][52666] Port 40909 is available [2024-08-05 21:04:38,190][52666] Using port 40909 [2024-08-05 21:04:38,191][52666] Using port 40900 on host... [2024-08-05 21:04:38,192][52811] Port 42106 is available [2024-08-05 21:04:38,192][52795] Port 41908 is available [2024-08-05 21:04:38,192][52811] Using port 42106 [2024-08-05 21:04:38,192][52795] Using port 41908 [2024-08-05 21:04:38,193][52820] Port 42206 is available [2024-08-05 21:04:38,193][52820] Using port 42206 [2024-08-05 21:04:38,196][52658] Port 40508 is available [2024-08-05 21:04:38,197][52665] Port 41209 is available [2024-08-05 21:04:38,204][52658] Using port 40508 [2024-08-05 21:04:38,204][52665] Using port 41209 [2024-08-05 21:04:38,205][52803] Port 42007 is available [2024-08-05 21:04:38,205][52803] Using port 42007 [2024-08-05 21:04:38,205][52665] Using port 41200 on host... [2024-08-05 21:04:38,208][52794] Port 41808 is available [2024-08-05 21:04:38,208][52794] Using port 41808 [2024-08-05 21:04:38,213][52660] Port 40808 is available [2024-08-05 21:04:38,213][52660] Using port 40808 [2024-08-05 21:04:38,218][52647] Port 40308 is available [2024-08-05 21:04:38,226][52647] Using port 40308 [2024-08-05 21:04:38,226][52662] Port 41009 is available [2024-08-05 21:04:38,227][52662] Using port 41009 [2024-08-05 21:04:38,227][52664] Port 41108 is available [2024-08-05 21:04:38,222][52668] Port 41609 is available [2024-08-05 21:04:38,234][52658] Port 40509 is available [2024-08-05 21:04:38,234][52668] Using port 41609 [2024-08-05 21:04:38,234][52658] Using port 40509 [2024-08-05 21:04:38,235][52658] Using port 40500 on host... [2024-08-05 21:04:38,235][52668] Using port 41600 on host... [2024-08-05 21:04:38,223][52667] Port 41308 is available [2024-08-05 21:04:38,235][52667] Using port 41308 [2024-08-05 21:04:38,228][52662] Using port 41000 on host... [2024-08-05 21:04:38,232][52664] Using port 41108 [2024-08-05 21:04:38,232][52671] Port 41408 is available [2024-08-05 21:04:38,236][52671] Using port 41408 [2024-08-05 21:04:38,238][52660] Port 40809 is available [2024-08-05 21:04:38,236][52669] Port 41508 is available [2024-08-05 21:04:38,238][52660] Using port 40809 [2024-08-05 21:04:38,239][52669] Using port 41508 [2024-08-05 21:04:38,236][52659] Port 40607 is available [2024-08-05 21:04:38,240][52659] Using port 40607 [2024-08-05 21:04:38,242][52663] Port 40708 is available [2024-08-05 21:04:38,242][52795] Port 41909 is available [2024-08-05 21:04:38,252][52795] Using port 41909 [2024-08-05 21:04:38,243][52794] Port 41809 is available [2024-08-05 21:04:38,253][52794] Using port 41809 [2024-08-05 21:04:38,254][52795] Using port 41900 on host... [2024-08-05 21:04:38,244][52663] Using port 40708 [2024-08-05 21:04:38,256][52794] Using port 41800 on host... [2024-08-05 21:04:38,259][52820] Port 42207 is available [2024-08-05 21:04:38,259][52803] Port 42008 is available [2024-08-05 21:04:38,244][52660] Using port 40800 on host... [2024-08-05 21:04:38,268][52803] Using port 42008 [2024-08-05 21:04:38,270][52667] Port 41309 is available [2024-08-05 21:04:38,270][52667] Using port 41309 [2024-08-05 21:04:38,249][52670] Port 41707 is available [2024-08-05 21:04:38,272][52670] Using port 41707 [2024-08-05 21:04:38,274][52647] Port 40309 is available [2024-08-05 21:04:38,271][52667] Using port 41300 on host... [2024-08-05 21:04:38,274][52647] Using port 40309 [2024-08-05 21:04:38,259][52820] Using port 42207 [2024-08-05 21:04:38,265][52811] Port 42107 is available [2024-08-05 21:04:38,275][52811] Using port 42107 [2024-08-05 21:04:38,284][52647] Using port 40300 on host... [2024-08-05 21:04:38,288][52664] Port 41109 is available [2024-08-05 21:04:38,288][52664] Using port 41109 [2024-08-05 21:04:38,289][52664] Using port 41100 on host... [2024-08-05 21:04:38,293][52671] Port 41409 is available [2024-08-05 21:04:38,300][52671] Using port 41409 [2024-08-05 21:04:38,295][52659] Port 40608 is available [2024-08-05 21:04:38,301][52671] Using port 41400 on host... [2024-08-05 21:04:38,301][52659] Using port 40608 [2024-08-05 21:04:38,296][52663] Port 40709 is available [2024-08-05 21:04:38,308][52663] Using port 40709 [2024-08-05 21:04:38,304][52669] Port 41509 is available [2024-08-05 21:04:38,310][52669] Using port 41509 [2024-08-05 21:04:38,309][52663] Using port 40700 on host... [2024-08-05 21:04:38,311][52669] Using port 41500 on host... [2024-08-05 21:04:38,311][52803] Port 42009 is available [2024-08-05 21:04:38,317][52803] Using port 42009 [2024-08-05 21:04:38,317][52811] Port 42108 is available [2024-08-05 21:04:38,318][52811] Using port 42108 [2024-08-05 21:04:38,318][52803] Using port 42000 on host... [2024-08-05 21:04:38,323][52670] Port 41708 is available [2024-08-05 21:04:38,323][52670] Using port 41708 [2024-08-05 21:04:38,326][52820] Port 42208 is available [2024-08-05 21:04:38,328][52820] Using port 42208 [2024-08-05 21:04:38,346][52659] Port 40609 is available [2024-08-05 21:04:38,346][52659] Using port 40609 [2024-08-05 21:04:38,347][52659] Using port 40600 on host... [2024-08-05 21:04:38,381][52811] Port 42109 is available [2024-08-05 21:04:38,381][52811] Using port 42109 [2024-08-05 21:04:38,383][52811] Using port 42100 on host... [2024-08-05 21:04:38,387][52670] Port 41709 is available [2024-08-05 21:04:38,392][52670] Using port 41709 [2024-08-05 21:04:38,391][52820] Port 42209 is available [2024-08-05 21:04:38,397][52820] Using port 42209 [2024-08-05 21:04:38,397][52670] Using port 41700 on host... [2024-08-05 21:04:38,399][52820] Using port 42200 on host... [2024-08-05 21:04:38,746][52795] Initialized w:16 v:0 player:0 [2024-08-05 21:04:38,747][52795] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,748][52795] Using port 41901 on host... [2024-08-05 21:04:38,790][52660] Initialized w:5 v:0 player:0 [2024-08-05 21:04:38,791][52660] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,792][52668] Initialized w:13 v:0 player:0 [2024-08-05 21:04:38,793][52668] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,791][52660] Using port 40801 on host... [2024-08-05 21:04:38,794][52668] Using port 41601 on host... [2024-08-05 21:04:38,796][52665] Initialized w:9 v:0 player:0 [2024-08-05 21:04:38,797][52665] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,797][52667] Initialized w:10 v:0 player:0 [2024-08-05 21:04:38,798][52665] Using port 41201 on host... [2024-08-05 21:04:38,798][52667] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,798][52649] Initialized w:1 v:0 player:0 [2024-08-05 21:04:38,799][52794] Initialized w:15 v:0 player:0 [2024-08-05 21:04:38,799][52649] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,799][52794] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,799][52649] Using port 40401 on host... [2024-08-05 21:04:38,800][52658] Initialized w:2 v:0 player:0 [2024-08-05 21:04:38,800][52794] Using port 41801 on host... [2024-08-05 21:04:38,800][52658] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,799][52667] Using port 41301 on host... [2024-08-05 21:04:38,801][52662] Initialized w:7 v:0 player:0 [2024-08-05 21:04:38,801][52658] Using port 40501 on host... [2024-08-05 21:04:38,802][52662] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,803][52662] Using port 41001 on host... [2024-08-05 21:04:38,830][52671] Initialized w:11 v:0 player:0 [2024-08-05 21:04:38,831][52671] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,832][52666] Initialized w:6 v:0 player:0 [2024-08-05 21:04:38,833][52803] Initialized w:17 v:0 player:0 [2024-08-05 21:04:38,833][52666] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,834][52803] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,834][52666] Using port 40901 on host... [2024-08-05 21:04:38,834][52671] Using port 41401 on host... [2024-08-05 21:04:38,835][52803] Using port 42001 on host... [2024-08-05 21:04:38,836][52811] Initialized w:18 v:0 player:0 [2024-08-05 21:04:38,837][52811] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,838][52811] Using port 42101 on host... [2024-08-05 21:04:38,846][52664] Initialized w:8 v:0 player:0 [2024-08-05 21:04:38,847][52664] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,849][52664] Using port 41101 on host... [2024-08-05 21:04:38,852][52663] Initialized w:4 v:0 player:0 [2024-08-05 21:04:38,853][52663] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,855][52669] Initialized w:12 v:0 player:0 [2024-08-05 21:04:38,854][52663] Using port 40701 on host... [2024-08-05 21:04:38,857][52669] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,859][52669] Using port 41501 on host... [2024-08-05 21:04:38,867][52647] Initialized w:0 v:0 player:0 [2024-08-05 21:04:38,868][52647] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,871][52647] Using port 40301 on host... [2024-08-05 21:04:38,892][52659] Initialized w:3 v:0 player:0 [2024-08-05 21:04:38,893][52659] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,894][52659] Using port 40601 on host... [2024-08-05 21:04:38,978][52820] Initialized w:19 v:0 player:0 [2024-08-05 21:04:38,978][52670] Initialized w:14 v:0 player:0 [2024-08-05 21:04:38,980][52670] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,979][52820] Decorrelating experience for 0 frames... [2024-08-05 21:04:38,981][52820] Using port 42201 on host... [2024-08-05 21:04:38,980][52670] Using port 41701 on host... [2024-08-05 21:04:39,340][52671] Initialized w:11 v:1 player:0 [2024-08-05 21:04:39,341][52671] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,355][52665] Initialized w:9 v:1 player:0 [2024-08-05 21:04:39,356][52665] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,361][52668] Initialized w:13 v:1 player:0 [2024-08-05 21:04:39,363][52663] Initialized w:4 v:1 player:0 [2024-08-05 21:04:39,361][52668] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,362][52669] Initialized w:12 v:1 player:0 [2024-08-05 21:04:39,364][52663] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,365][52660] Initialized w:5 v:1 player:0 [2024-08-05 21:04:39,365][52669] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,367][52660] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,376][52659] Initialized w:3 v:1 player:0 [2024-08-05 21:04:39,384][52666] Initialized w:6 v:1 player:0 [2024-08-05 21:04:39,387][52666] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,389][52670] Initialized w:14 v:1 player:0 [2024-08-05 21:04:39,388][52659] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,390][52670] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,398][52667] Initialized w:10 v:1 player:0 [2024-08-05 21:04:39,399][52667] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,403][52658] Initialized w:2 v:1 player:0 [2024-08-05 21:04:39,404][52658] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,408][52803] Initialized w:17 v:1 player:0 [2024-08-05 21:04:39,409][52803] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,418][52811] Initialized w:18 v:1 player:0 [2024-08-05 21:04:39,419][52811] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,420][52649] Initialized w:1 v:1 player:0 [2024-08-05 21:04:39,421][52649] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,433][52664] Initialized w:8 v:1 player:0 [2024-08-05 21:04:39,434][52664] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,435][52795] Initialized w:16 v:1 player:0 [2024-08-05 21:04:39,436][52795] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,439][52647] Initialized w:0 v:1 player:0 [2024-08-05 21:04:39,441][52647] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,467][52794] Initialized w:15 v:1 player:0 [2024-08-05 21:04:39,468][52794] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,469][52671] Using port 41402 on host... [2024-08-05 21:04:39,479][52662] Initialized w:7 v:1 player:0 [2024-08-05 21:04:39,480][52662] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,494][52666] Using port 40902 on host... [2024-08-05 21:04:39,502][52670] Using port 41702 on host... [2024-08-05 21:04:39,510][52667] Using port 41302 on host... [2024-08-05 21:04:39,512][52658] Using port 40502 on host... [2024-08-05 21:04:39,536][52663] Using port 40702 on host... [2024-08-05 21:04:39,546][52669] Using port 41502 on host... [2024-08-05 21:04:39,548][52664] Using port 41102 on host... [2024-08-05 21:04:39,552][52660] Using port 40802 on host... [2024-08-05 21:04:39,554][52647] Using port 40302 on host... [2024-08-05 21:04:39,557][52668] Using port 41602 on host... [2024-08-05 21:04:39,586][52659] Using port 40602 on host... [2024-08-05 21:04:39,592][52811] Using port 42102 on host... [2024-08-05 21:04:39,623][52794] Using port 41802 on host... [2024-08-05 21:04:39,629][52662] Using port 41002 on host... [2024-08-05 21:04:39,668][52803] Using port 42002 on host... [2024-08-05 21:04:39,692][52665] Using port 41202 on host... [2024-08-05 21:04:39,704][52820] Initialized w:19 v:1 player:0 [2024-08-05 21:04:39,705][52820] Decorrelating experience for 32 frames... [2024-08-05 21:04:39,742][52649] Using port 40402 on host... [2024-08-05 21:04:39,751][52795] Using port 41902 on host... [2024-08-05 21:04:39,812][52820] Using port 42202 on host... [2024-08-05 21:04:40,061][52663] Initialized w:4 v:2 player:0 [2024-08-05 21:04:40,061][52663] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,063][52658] Initialized w:2 v:2 player:0 [2024-08-05 21:04:40,063][52658] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,065][52662] Initialized w:7 v:2 player:0 [2024-08-05 21:04:40,064][52669] Initialized w:12 v:2 player:0 [2024-08-05 21:04:40,066][52662] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,066][52669] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,087][52667] Initialized w:10 v:2 player:0 [2024-08-05 21:04:40,088][52667] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,094][52794] Initialized w:15 v:2 player:0 [2024-08-05 21:04:40,095][52794] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,128][52671] Initialized w:11 v:2 player:0 [2024-08-05 21:04:40,130][52671] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,138][52660] Initialized w:5 v:2 player:0 [2024-08-05 21:04:40,139][52660] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,141][52668] Initialized w:13 v:2 player:0 [2024-08-05 21:04:40,142][52668] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,148][52666] Initialized w:6 v:2 player:0 [2024-08-05 21:04:40,149][52666] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,153][52670] Initialized w:14 v:2 player:0 [2024-08-05 21:04:40,157][52670] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,208][52665] Initialized w:9 v:2 player:0 [2024-08-05 21:04:40,209][52665] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,215][52649] Initialized w:1 v:2 player:0 [2024-08-05 21:04:40,216][52649] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,222][52662] Using port 41003 on host... [2024-08-05 21:04:40,243][52659] Initialized w:3 v:2 player:0 [2024-08-05 21:04:40,243][52659] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,246][52794] Using port 41803 on host... [2024-08-05 21:04:40,251][52647] Initialized w:0 v:2 player:0 [2024-08-05 21:04:40,252][52647] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,261][52664] Initialized w:8 v:2 player:0 [2024-08-05 21:04:40,261][52664] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,268][52658] Using port 40503 on host... [2024-08-05 21:04:40,287][52667] Using port 41303 on host... [2024-08-05 21:04:40,295][52669] Using port 41503 on host... [2024-08-05 21:04:40,297][52663] Using port 40703 on host... [2024-08-05 21:04:40,315][52668] Using port 41603 on host... [2024-08-05 21:04:40,319][52660] Using port 40803 on host... [2024-08-05 21:04:40,339][52671] Using port 41403 on host... [2024-08-05 21:04:40,385][52665] Using port 41203 on host... [2024-08-05 21:04:40,386][52659] Using port 40603 on host... [2024-08-05 21:04:40,390][52649] Using port 40403 on host... [2024-08-05 21:04:40,391][52811] Initialized w:18 v:2 player:0 [2024-08-05 21:04:40,391][52811] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,402][52666] Using port 40903 on host... [2024-08-05 21:04:40,404][52670] Using port 41703 on host... [2024-08-05 21:04:40,416][52803] Initialized w:17 v:2 player:0 [2024-08-05 21:04:40,417][52803] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,444][52647] Using port 40303 on host... [2024-08-05 21:04:40,466][52664] Using port 41103 on host... [2024-08-05 21:04:40,522][52820] Initialized w:19 v:2 player:0 [2024-08-05 21:04:40,523][52820] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,572][52795] Initialized w:16 v:2 player:0 [2024-08-05 21:04:40,572][52803] Using port 42003 on host... [2024-08-05 21:04:40,573][52795] Decorrelating experience for 64 frames... [2024-08-05 21:04:40,581][52811] Using port 42103 on host... [2024-08-05 21:04:40,651][52662] Initialized w:7 v:3 player:0 [2024-08-05 21:04:40,652][52662] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,683][52794] Initialized w:15 v:3 player:0 [2024-08-05 21:04:40,684][52794] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,705][52820] Using port 42203 on host... [2024-08-05 21:04:40,718][52795] Using port 41903 on host... [2024-08-05 21:04:40,753][52660] Initialized w:5 v:3 player:0 [2024-08-05 21:04:40,754][52668] Initialized w:13 v:3 player:0 [2024-08-05 21:04:40,755][52668] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,754][52660] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,821][52671] Initialized w:11 v:3 player:0 [2024-08-05 21:04:40,822][52671] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,853][52659] Initialized w:3 v:3 player:0 [2024-08-05 21:04:40,854][52659] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,877][52662] Using port 41004 on host... [2024-08-05 21:04:40,887][52794] Using port 41804 on host... [2024-08-05 21:04:40,888][52663] Initialized w:4 v:3 player:0 [2024-08-05 21:04:40,889][52663] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,902][52669] Initialized w:12 v:3 player:0 [2024-08-05 21:04:40,903][52669] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,923][52658] Initialized w:2 v:3 player:0 [2024-08-05 21:04:40,923][52658] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,949][52647] Initialized w:0 v:3 player:0 [2024-08-05 21:04:40,950][52647] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,959][52667] Initialized w:10 v:3 player:0 [2024-08-05 21:04:40,960][52667] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,992][52664] Initialized w:8 v:3 player:0 [2024-08-05 21:04:40,992][52665] Initialized w:9 v:3 player:0 [2024-08-05 21:04:40,992][52664] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,993][52665] Decorrelating experience for 96 frames... [2024-08-05 21:04:40,996][52649] Initialized w:1 v:3 player:0 [2024-08-05 21:04:40,997][52649] Decorrelating experience for 96 frames... [2024-08-05 21:04:41,015][52671] Using port 41404 on host... [2024-08-05 21:04:41,051][52660] Using port 40804 on host... [2024-08-05 21:04:41,058][52659] Using port 40604 on host... [2024-08-05 21:04:41,065][52668] Using port 41604 on host... [2024-08-05 21:04:41,118][52670] Initialized w:14 v:3 player:0 [2024-08-05 21:04:41,119][52670] Decorrelating experience for 96 frames... [2024-08-05 21:04:41,119][52666] Initialized w:6 v:3 player:0 [2024-08-05 21:04:41,120][52666] Decorrelating experience for 96 frames... [2024-08-05 21:04:41,158][52663] Using port 40704 on host... [2024-08-05 21:04:41,174][52669] Using port 41504 on host... [2024-08-05 21:04:41,209][52658] Using port 40504 on host... [2024-08-05 21:04:41,210][52647] Using port 40304 on host... [2024-08-05 21:04:41,239][52667] Using port 41304 on host... [2024-08-05 21:04:41,255][52664] Using port 41104 on host... [2024-08-05 21:04:41,280][52665] Using port 41204 on host... [2024-08-05 21:04:41,280][52803] Initialized w:17 v:3 player:0 [2024-08-05 21:04:41,281][52803] Decorrelating experience for 96 frames... [2024-08-05 21:04:41,284][52649] Using port 40404 on host... [2024-08-05 21:04:41,294][52662] Initialized w:7 v:4 player:0 [2024-08-05 21:04:41,295][52662] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,311][52794] Initialized w:15 v:4 player:0 [2024-08-05 21:04:41,312][52794] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,321][52811] Initialized w:18 v:3 player:0 [2024-08-05 21:04:41,322][52811] Decorrelating experience for 96 frames... [2024-08-05 21:04:41,385][52795] Initialized w:16 v:3 player:0 [2024-08-05 21:04:41,385][52795] Decorrelating experience for 96 frames... [2024-08-05 21:04:41,419][52670] Using port 41704 on host... [2024-08-05 21:04:41,424][52666] Using port 40904 on host... [2024-08-05 21:04:41,484][52820] Initialized w:19 v:3 player:0 [2024-08-05 21:04:41,485][52820] Decorrelating experience for 96 frames... [2024-08-05 21:04:41,493][52671] Initialized w:11 v:4 player:0 [2024-08-05 21:04:41,493][52671] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,534][52803] Using port 42004 on host... [2024-08-05 21:04:41,536][52659] Initialized w:3 v:4 player:0 [2024-08-05 21:04:41,537][52659] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,556][52660] Initialized w:5 v:4 player:0 [2024-08-05 21:04:41,557][52660] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,569][52662] Using port 41005 on host... [2024-08-05 21:04:41,574][52668] Initialized w:13 v:4 player:0 [2024-08-05 21:04:41,575][52668] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,585][52811] Using port 42104 on host... [2024-08-05 21:04:41,593][52794] Using port 41805 on host... [2024-08-05 21:04:41,658][52795] Using port 41904 on host... [2024-08-05 21:04:41,668][52647] Initialized w:0 v:4 player:0 [2024-08-05 21:04:41,669][52647] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,707][52664] Initialized w:8 v:4 player:0 [2024-08-05 21:04:41,708][52664] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,744][52820] Using port 42204 on host... [2024-08-05 21:04:41,746][52663] Initialized w:4 v:4 player:0 [2024-08-05 21:04:41,746][52663] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,787][52669] Initialized w:12 v:4 player:0 [2024-08-05 21:04:41,788][52669] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,790][52658] Initialized w:2 v:4 player:0 [2024-08-05 21:04:41,791][52658] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,821][52667] Initialized w:10 v:4 player:0 [2024-08-05 21:04:41,822][52667] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,823][52671] Using port 41405 on host... [2024-08-05 21:04:41,884][52659] Using port 40605 on host... [2024-08-05 21:04:41,926][52665] Initialized w:9 v:4 player:0 [2024-08-05 21:04:41,926][52665] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,966][52660] Using port 40805 on host... [2024-08-05 21:04:41,972][52649] Initialized w:1 v:4 player:0 [2024-08-05 21:04:41,973][52649] Decorrelating experience for 128 frames... [2024-08-05 21:04:41,987][52668] Using port 41605 on host... [2024-08-05 21:04:41,990][52647] Using port 40305 on host... [2024-08-05 21:04:42,017][52662] Initialized w:7 v:5 player:0 [2024-08-05 21:04:42,018][52662] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,027][52664] Using port 41105 on host... [2024-08-05 21:04:42,038][52794] Initialized w:15 v:5 player:0 [2024-08-05 21:04:42,039][52794] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,065][52670] Initialized w:14 v:4 player:0 [2024-08-05 21:04:42,066][52670] Decorrelating experience for 128 frames... [2024-08-05 21:04:42,075][52663] Using port 40705 on host... [2024-08-05 21:04:42,081][52666] Initialized w:6 v:4 player:0 [2024-08-05 21:04:42,082][52666] Decorrelating experience for 128 frames... [2024-08-05 21:04:42,132][52669] Using port 41505 on host... [2024-08-05 21:04:42,133][52658] Using port 40505 on host... [2024-08-05 21:04:42,153][52667] Using port 41305 on host... [2024-08-05 21:04:42,269][52671] Initialized w:11 v:5 player:0 [2024-08-05 21:04:42,269][52671] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,323][52659] Initialized w:3 v:5 player:0 [2024-08-05 21:04:42,324][52659] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,344][52803] Initialized w:17 v:4 player:0 [2024-08-05 21:04:42,345][52803] Decorrelating experience for 128 frames... [2024-08-05 21:04:42,365][52665] Using port 41205 on host... [2024-08-05 21:04:42,367][52670] Using port 41705 on host... [2024-08-05 21:04:42,380][52666] Using port 40905 on host... [2024-08-05 21:04:42,389][52649] Using port 40405 on host... [2024-08-05 21:04:42,408][52660] Initialized w:5 v:5 player:0 [2024-08-05 21:04:42,409][52660] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,410][52668] Initialized w:13 v:5 player:0 [2024-08-05 21:04:42,410][52668] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,414][52811] Initialized w:18 v:4 player:0 [2024-08-05 21:04:42,415][52811] Decorrelating experience for 128 frames... [2024-08-05 21:04:42,448][52647] Initialized w:0 v:5 player:0 [2024-08-05 21:04:42,449][52647] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,456][52795] Initialized w:16 v:4 player:0 [2024-08-05 21:04:42,457][52795] Decorrelating experience for 128 frames... [2024-08-05 21:04:42,483][52664] Initialized w:8 v:5 player:0 [2024-08-05 21:04:42,484][52664] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,508][52662] Using port 41006 on host... [2024-08-05 21:04:42,510][52794] Using port 41806 on host... [2024-08-05 21:04:42,562][52820] Initialized w:19 v:4 player:0 [2024-08-05 21:04:42,563][52820] Decorrelating experience for 128 frames... [2024-08-05 21:04:42,627][52663] Initialized w:4 v:5 player:0 [2024-08-05 21:04:42,627][52663] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,652][52671] Using port 41406 on host... [2024-08-05 21:04:42,657][52669] Initialized w:12 v:5 player:0 [2024-08-05 21:04:42,658][52669] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,683][52803] Using port 42005 on host... [2024-08-05 21:04:42,726][52659] Using port 40606 on host... [2024-08-05 21:04:42,794][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:04:42,795][52658] Initialized w:2 v:5 player:0 [2024-08-05 21:04:42,796][52658] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,796][52667] Initialized w:10 v:5 player:0 [2024-08-05 21:04:42,797][52667] Decorrelating experience for 160 frames... [2024-08-05 21:04:42,815][52647] Using port 40306 on host... [2024-08-05 21:04:42,833][52795] Using port 41905 on host... [2024-08-05 21:04:42,840][52664] Using port 41106 on host... [2024-08-05 21:04:42,868][52811] Using port 42105 on host... [2024-08-05 21:04:42,923][52820] Using port 42205 on host... [2024-08-05 21:04:42,928][52662] Initialized w:7 v:6 player:0 [2024-08-05 21:04:42,929][52662] Decorrelating experience for 192 frames... [2024-08-05 21:04:42,934][52794] Initialized w:15 v:6 player:0 [2024-08-05 21:04:42,935][52794] Decorrelating experience for 192 frames... [2024-08-05 21:04:42,952][52660] Using port 40806 on host... [2024-08-05 21:04:42,955][52668] Using port 41606 on host... [2024-08-05 21:04:43,037][52663] Using port 40706 on host... [2024-08-05 21:04:43,040][52669] Using port 41506 on host... [2024-08-05 21:04:43,054][52666] Initialized w:6 v:5 player:0 [2024-08-05 21:04:43,055][52666] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,058][52670] Initialized w:14 v:5 player:0 [2024-08-05 21:04:43,059][52670] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,097][52649] Initialized w:1 v:5 player:0 [2024-08-05 21:04:43,098][52649] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,100][52665] Initialized w:9 v:5 player:0 [2024-08-05 21:04:43,101][52665] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,109][52671] Initialized w:11 v:6 player:0 [2024-08-05 21:04:43,109][52671] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,147][52659] Initialized w:3 v:6 player:0 [2024-08-05 21:04:43,148][52659] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,256][52658] Using port 40506 on host... [2024-08-05 21:04:43,257][52667] Using port 41306 on host... [2024-08-05 21:04:43,269][52647] Initialized w:0 v:6 player:0 [2024-08-05 21:04:43,270][52647] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,301][52664] Initialized w:8 v:6 player:0 [2024-08-05 21:04:43,301][52664] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,349][52662] Using port 41007 on host... [2024-08-05 21:04:43,361][52794] Using port 41807 on host... [2024-08-05 21:04:43,470][52803] Initialized w:17 v:5 player:0 [2024-08-05 21:04:43,471][52803] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,472][52663] Initialized w:4 v:6 player:0 [2024-08-05 21:04:43,473][52663] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,513][52669] Initialized w:12 v:6 player:0 [2024-08-05 21:04:43,515][52669] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,576][52660] Initialized w:5 v:6 player:0 [2024-08-05 21:04:43,576][52660] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,579][52811] Initialized w:18 v:5 player:0 [2024-08-05 21:04:43,580][52811] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,595][52671] Using port 41407 on host... [2024-08-05 21:04:43,597][52659] Using port 40607 on host... [2024-08-05 21:04:43,611][52666] Using port 40906 on host... [2024-08-05 21:04:43,611][52668] Initialized w:13 v:6 player:0 [2024-08-05 21:04:43,612][52668] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,613][52670] Using port 41706 on host... [2024-08-05 21:04:43,659][52795] Initialized w:16 v:5 player:0 [2024-08-05 21:04:43,660][52795] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,667][52649] Using port 40406 on host... [2024-08-05 21:04:43,706][52665] Using port 41206 on host... [2024-08-05 21:04:43,729][52647] Using port 40307 on host... [2024-08-05 21:04:43,737][52664] Using port 41107 on host... [2024-08-05 21:04:43,765][52820] Initialized w:19 v:5 player:0 [2024-08-05 21:04:43,767][52820] Decorrelating experience for 160 frames... [2024-08-05 21:04:43,788][52662] Initialized w:7 v:7 player:0 [2024-08-05 21:04:43,789][52662] Decorrelating experience for 224 frames... [2024-08-05 21:04:43,794][52794] Initialized w:15 v:7 player:0 [2024-08-05 21:04:43,795][52794] Decorrelating experience for 224 frames... [2024-08-05 21:04:43,932][52803] Using port 42006 on host... [2024-08-05 21:04:43,967][52663] Using port 40707 on host... [2024-08-05 21:04:43,973][52658] Initialized w:2 v:6 player:0 [2024-08-05 21:04:43,974][52658] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,977][52667] Initialized w:10 v:6 player:0 [2024-08-05 21:04:43,977][52667] Decorrelating experience for 192 frames... [2024-08-05 21:04:43,988][52669] Using port 41507 on host... [2024-08-05 21:04:43,997][52671] Initialized w:11 v:7 player:0 [2024-08-05 21:04:43,997][52671] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,012][52659] Initialized w:3 v:7 player:0 [2024-08-05 21:04:44,013][52659] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,102][52795] Using port 41906 on host... [2024-08-05 21:04:44,170][52811] Using port 42106 on host... [2024-08-05 21:04:44,217][52649] Initialized w:1 v:6 player:0 [2024-08-05 21:04:44,218][52649] Decorrelating experience for 192 frames... [2024-08-05 21:04:44,219][52820] Using port 42206 on host... [2024-08-05 21:04:44,237][52660] Using port 40807 on host... [2024-08-05 21:04:44,243][52665] Initialized w:9 v:6 player:0 [2024-08-05 21:04:44,243][52665] Decorrelating experience for 192 frames... [2024-08-05 21:04:44,249][52668] Using port 41607 on host... [2024-08-05 21:04:44,317][52662] Using port 41008 on host... [2024-08-05 21:04:44,320][52666] Initialized w:6 v:6 player:0 [2024-08-05 21:04:44,321][52794] Using port 41808 on host... [2024-08-05 21:04:44,321][52666] Decorrelating experience for 192 frames... [2024-08-05 21:04:44,323][52670] Initialized w:14 v:6 player:0 [2024-08-05 21:04:44,323][52670] Decorrelating experience for 192 frames... [2024-08-05 21:04:44,327][52664] Initialized w:8 v:7 player:0 [2024-08-05 21:04:44,327][52664] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,330][52647] Initialized w:0 v:7 player:0 [2024-08-05 21:04:44,331][52647] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,436][52663] Initialized w:4 v:7 player:0 [2024-08-05 21:04:44,437][52663] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,437][52671] Using port 41408 on host... [2024-08-05 21:04:44,441][52669] Initialized w:12 v:7 player:0 [2024-08-05 21:04:44,441][52669] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,473][52659] Using port 40608 on host... [2024-08-05 21:04:44,518][52658] Using port 40507 on host... [2024-08-05 21:04:44,548][52667] Using port 41307 on host... [2024-08-05 21:04:44,740][52662] Initialized w:7 v:8 player:0 [2024-08-05 21:04:44,741][52662] Decorrelating experience for 256 frames... [2024-08-05 21:04:44,741][52794] Initialized w:15 v:8 player:0 [2024-08-05 21:04:44,742][52794] Decorrelating experience for 256 frames... [2024-08-05 21:04:44,756][52803] Initialized w:17 v:6 player:0 [2024-08-05 21:04:44,757][52803] Decorrelating experience for 192 frames... [2024-08-05 21:04:44,821][52811] Initialized w:18 v:6 player:0 [2024-08-05 21:04:44,821][52811] Decorrelating experience for 192 frames... [2024-08-05 21:04:44,822][52647] Using port 40308 on host... [2024-08-05 21:04:44,825][52664] Using port 41108 on host... [2024-08-05 21:04:44,851][52660] Initialized w:5 v:7 player:0 [2024-08-05 21:04:44,852][52660] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,856][52668] Initialized w:13 v:7 player:0 [2024-08-05 21:04:44,857][52668] Decorrelating experience for 224 frames... [2024-08-05 21:04:44,892][52649] Using port 40407 on host... [2024-08-05 21:04:44,940][52665] Using port 41207 on host... [2024-08-05 21:04:44,941][52671] Initialized w:11 v:8 player:0 [2024-08-05 21:04:44,941][52671] Decorrelating experience for 256 frames... [2024-08-05 21:04:44,963][52659] Initialized w:3 v:8 player:0 [2024-08-05 21:04:44,964][52659] Decorrelating experience for 256 frames... [2024-08-05 21:04:44,969][52666] Using port 40907 on host... [2024-08-05 21:04:44,984][52669] Using port 41508 on host... [2024-08-05 21:04:44,985][52670] Using port 41707 on host... [2024-08-05 21:04:45,000][52663] Using port 40708 on host... [2024-08-05 21:04:45,029][52795] Initialized w:16 v:6 player:0 [2024-08-05 21:04:45,029][52795] Decorrelating experience for 192 frames... [2024-08-05 21:04:45,134][52820] Initialized w:19 v:6 player:0 [2024-08-05 21:04:45,135][52820] Decorrelating experience for 192 frames... [2024-08-05 21:04:45,205][52803] Using port 42007 on host... [2024-08-05 21:04:45,213][52658] Initialized w:2 v:7 player:0 [2024-08-05 21:04:45,213][52658] Decorrelating experience for 224 frames... [2024-08-05 21:04:45,225][52667] Initialized w:10 v:7 player:0 [2024-08-05 21:04:45,226][52667] Decorrelating experience for 224 frames... [2024-08-05 21:04:45,263][52647] Initialized w:0 v:8 player:0 [2024-08-05 21:04:45,264][52647] Decorrelating experience for 256 frames... [2024-08-05 21:04:45,266][52664] Initialized w:8 v:8 player:0 [2024-08-05 21:04:45,267][52664] Decorrelating experience for 256 frames... [2024-08-05 21:04:45,312][52662] Using port 41009 on host... [2024-08-05 21:04:45,331][52794] Using port 41809 on host... [2024-08-05 21:04:45,428][52669] Initialized w:12 v:8 player:0 [2024-08-05 21:04:45,429][52669] Decorrelating experience for 256 frames... [2024-08-05 21:04:45,442][52663] Initialized w:4 v:8 player:0 [2024-08-05 21:04:45,443][52663] Decorrelating experience for 256 frames... [2024-08-05 21:04:45,498][52671] Using port 41409 on host... [2024-08-05 21:04:45,536][52795] Using port 41907 on host... [2024-08-05 21:04:45,541][52659] Using port 40609 on host... [2024-08-05 21:04:45,574][52811] Using port 42107 on host... [2024-08-05 21:04:45,632][52649] Initialized w:1 v:7 player:0 [2024-08-05 21:04:45,634][52649] Decorrelating experience for 224 frames... [2024-08-05 21:04:45,637][52820] Using port 42207 on host... [2024-08-05 21:04:45,645][52668] Using port 41608 on host... [2024-08-05 21:04:45,651][52660] Using port 40808 on host... [2024-08-05 21:04:45,657][52665] Initialized w:9 v:7 player:0 [2024-08-05 21:04:45,658][52665] Decorrelating experience for 224 frames... [2024-08-05 21:04:45,703][52666] Initialized w:6 v:7 player:0 [2024-08-05 21:04:45,704][52666] Decorrelating experience for 224 frames... [2024-08-05 21:04:45,752][52670] Initialized w:14 v:7 player:0 [2024-08-05 21:04:45,753][52670] Decorrelating experience for 224 frames... [2024-08-05 21:04:45,767][52662] Initialized w:7 v:9 player:0 [2024-08-05 21:04:45,768][52662] Decorrelating experience for 288 frames... [2024-08-05 21:04:45,806][52794] Initialized w:15 v:9 player:0 [2024-08-05 21:04:45,807][52794] Decorrelating experience for 288 frames... [2024-08-05 21:04:45,845][52647] Using port 40309 on host... [2024-08-05 21:04:45,854][52664] Using port 41109 on host... [2024-08-05 21:04:45,855][52658] Using port 40508 on host... [2024-08-05 21:04:45,882][52667] Using port 41308 on host... [2024-08-05 21:04:45,965][52669] Using port 41509 on host... [2024-08-05 21:04:45,983][52663] Using port 40709 on host... [2024-08-05 21:04:46,022][52671] Initialized w:11 v:9 player:0 [2024-08-05 21:04:46,023][52671] Decorrelating experience for 288 frames... [2024-08-05 21:04:46,056][52803] Initialized w:17 v:7 player:0 [2024-08-05 21:04:46,057][52803] Decorrelating experience for 224 frames... [2024-08-05 21:04:46,059][52659] Initialized w:3 v:9 player:0 [2024-08-05 21:04:46,060][52659] Decorrelating experience for 288 frames... [2024-08-05 21:04:46,249][52649] Using port 40408 on host... [2024-08-05 21:04:46,274][52660] Initialized w:5 v:8 player:0 [2024-08-05 21:04:46,275][52665] Using port 41208 on host... [2024-08-05 21:04:46,275][52660] Decorrelating experience for 256 frames... [2024-08-05 21:04:46,281][52668] Initialized w:13 v:8 player:0 [2024-08-05 21:04:46,282][52668] Decorrelating experience for 256 frames... [2024-08-05 21:04:46,293][52811] Initialized w:18 v:7 player:0 [2024-08-05 21:04:46,294][52811] Decorrelating experience for 224 frames... [2024-08-05 21:04:46,336][52795] Initialized w:16 v:7 player:0 [2024-08-05 21:04:46,337][52795] Decorrelating experience for 224 frames... [2024-08-05 21:04:46,409][52664] Initialized w:8 v:9 player:0 [2024-08-05 21:04:46,410][52664] Decorrelating experience for 288 frames... [2024-08-05 21:04:46,413][52647] Initialized w:0 v:9 player:0 [2024-08-05 21:04:46,414][52647] Decorrelating experience for 288 frames... [2024-08-05 21:04:46,420][52669] Initialized w:12 v:9 player:0 [2024-08-05 21:04:46,421][52669] Decorrelating experience for 288 frames... [2024-08-05 21:04:46,431][52663] Initialized w:4 v:9 player:0 [2024-08-05 21:04:46,432][52663] Decorrelating experience for 288 frames... [2024-08-05 21:04:46,452][52666] Using port 40908 on host... [2024-08-05 21:04:46,467][52662] Port 41010 is available [2024-08-05 21:04:46,467][52662] Using port 41010 [2024-08-05 21:04:46,479][52670] Using port 41708 on host... [2024-08-05 21:04:46,499][52662] Port 41011 is available [2024-08-05 21:04:46,499][52662] Using port 41011 [2024-08-05 21:04:46,510][52794] Port 41810 is available [2024-08-05 21:04:46,510][52794] Using port 41810 [2024-08-05 21:04:46,545][52820] Initialized w:19 v:7 player:0 [2024-08-05 21:04:46,545][52820] Decorrelating experience for 224 frames... [2024-08-05 21:04:46,546][52662] Port 41012 is available [2024-08-05 21:04:46,547][52662] Using port 41012 [2024-08-05 21:04:46,548][52794] Port 41811 is available [2024-08-05 21:04:46,548][52794] Using port 41811 [2024-08-05 21:04:46,555][52658] Initialized w:2 v:8 player:0 [2024-08-05 21:04:46,556][52658] Decorrelating experience for 256 frames... [2024-08-05 21:04:46,571][52803] Using port 42008 on host... [2024-08-05 21:04:46,583][52662] Port 41013 is available [2024-08-05 21:04:46,583][52662] Using port 41013 [2024-08-05 21:04:46,584][52794] Port 41812 is available [2024-08-05 21:04:46,584][52794] Using port 41812 [2024-08-05 21:04:46,589][52667] Initialized w:10 v:8 player:0 [2024-08-05 21:04:46,590][52667] Decorrelating experience for 256 frames... [2024-08-05 21:04:46,622][52662] Port 41014 is available [2024-08-05 21:04:46,622][52662] Using port 41014 [2024-08-05 21:04:46,628][52794] Port 41813 is available [2024-08-05 21:04:46,628][52794] Using port 41813 [2024-08-05 21:04:46,667][52662] Port 41015 is available [2024-08-05 21:04:46,667][52662] Using port 41015 [2024-08-05 21:04:46,672][52794] Port 41814 is available [2024-08-05 21:04:46,672][52794] Using port 41814 [2024-08-05 21:04:46,706][52662] Port 41016 is available [2024-08-05 21:04:46,706][52662] Using port 41016 [2024-08-05 21:04:46,709][52794] Port 41815 is available [2024-08-05 21:04:46,709][52794] Using port 41815 [2024-08-05 21:04:46,743][52662] Port 41017 is available [2024-08-05 21:04:46,743][52662] Using port 41017 [2024-08-05 21:04:46,746][52794] Port 41816 is available [2024-08-05 21:04:46,746][52794] Using port 41816 [2024-08-05 21:04:46,781][52662] Port 41018 is available [2024-08-05 21:04:46,781][52662] Using port 41018 [2024-08-05 21:04:46,783][52794] Port 41817 is available [2024-08-05 21:04:46,784][52794] Using port 41817 [2024-08-05 21:04:46,802][52671] Port 41410 is available [2024-08-05 21:04:46,802][52671] Using port 41410 [2024-08-05 21:04:46,812][52659] Port 40610 is available [2024-08-05 21:04:46,812][52659] Using port 40610 [2024-08-05 21:04:46,816][52662] Port 41019 is available [2024-08-05 21:04:46,816][52662] Using port 41019 [2024-08-05 21:04:46,817][52662] Using port 41010 on host... [2024-08-05 21:04:46,821][52794] Port 41818 is available [2024-08-05 21:04:46,821][52794] Using port 41818 [2024-08-05 21:04:46,842][52794] Port 41819 is available [2024-08-05 21:04:46,847][52794] Using port 41819 [2024-08-05 21:04:46,850][52794] Using port 41810 on host... [2024-08-05 21:04:46,903][52671] Port 41411 is available [2024-08-05 21:04:46,903][52671] Using port 41411 [2024-08-05 21:04:46,911][52659] Port 40611 is available [2024-08-05 21:04:46,912][52659] Using port 40611 [2024-08-05 21:04:46,943][52671] Port 41412 is available [2024-08-05 21:04:46,943][52671] Using port 41412 [2024-08-05 21:04:46,950][52659] Port 40612 is available [2024-08-05 21:04:46,950][52659] Using port 40612 [2024-08-05 21:04:46,977][52671] Port 41413 is available [2024-08-05 21:04:46,977][52671] Using port 41413 [2024-08-05 21:04:46,984][52659] Port 40613 is available [2024-08-05 21:04:46,985][52659] Using port 40613 [2024-08-05 21:04:47,007][52649] Initialized w:1 v:8 player:0 [2024-08-05 21:04:47,008][52649] Decorrelating experience for 256 frames... [2024-08-05 21:04:47,010][52671] Port 41414 is available [2024-08-05 21:04:47,010][52671] Using port 41414 [2024-08-05 21:04:47,011][52665] Initialized w:9 v:8 player:0 [2024-08-05 21:04:47,011][52665] Decorrelating experience for 256 frames... [2024-08-05 21:04:47,018][52659] Port 40614 is available [2024-08-05 21:04:47,018][52659] Using port 40614 [2024-08-05 21:04:47,043][52671] Port 41415 is available [2024-08-05 21:04:47,052][52671] Using port 41415 [2024-08-05 21:04:47,061][52659] Port 40615 is available [2024-08-05 21:04:47,061][52659] Using port 40615 [2024-08-05 21:04:47,082][52671] Port 41416 is available [2024-08-05 21:04:47,087][52671] Using port 41416 [2024-08-05 21:04:47,094][52669] Port 41510 is available [2024-08-05 21:04:47,096][52669] Using port 41510 [2024-08-05 21:04:47,104][52659] Port 40616 is available [2024-08-05 21:04:47,104][52659] Using port 40616 [2024-08-05 21:04:47,125][52671] Port 41417 is available [2024-08-05 21:04:47,132][52671] Using port 41417 [2024-08-05 21:04:47,143][52659] Port 40617 is available [2024-08-05 21:04:47,143][52659] Using port 40617 [2024-08-05 21:04:47,143][52669] Port 41511 is available [2024-08-05 21:04:47,149][52669] Using port 41511 [2024-08-05 21:04:47,164][52663] Port 40710 is available [2024-08-05 21:04:47,169][52663] Using port 40710 [2024-08-05 21:04:47,169][52671] Port 41418 is available [2024-08-05 21:04:47,169][52671] Using port 41418 [2024-08-05 21:04:47,182][52659] Port 40618 is available [2024-08-05 21:04:47,182][52659] Using port 40618 [2024-08-05 21:04:47,208][52820] Using port 42208 on host... [2024-08-05 21:04:47,213][52671] Port 41419 is available [2024-08-05 21:04:47,213][52671] Using port 41419 [2024-08-05 21:04:47,214][52671] Using port 41410 on host... [2024-08-05 21:04:47,215][52795] Using port 41908 on host... [2024-08-05 21:04:47,215][52669] Port 41512 is available [2024-08-05 21:04:47,223][52669] Using port 41512 [2024-08-05 21:04:47,225][52659] Port 40619 is available [2024-08-05 21:04:47,229][52659] Using port 40619 [2024-08-05 21:04:47,231][52659] Using port 40610 on host... [2024-08-05 21:04:47,244][52811] Using port 42108 on host... [2024-08-05 21:04:47,244][52647] Port 40310 is available [2024-08-05 21:04:47,250][52647] Using port 40310 [2024-08-05 21:04:47,251][52663] Port 40711 is available [2024-08-05 21:04:47,259][52666] Initialized w:6 v:8 player:0 [2024-08-05 21:04:47,259][52663] Using port 40711 [2024-08-05 21:04:47,260][52666] Decorrelating experience for 256 frames... [2024-08-05 21:04:47,265][52662] Initialized w:7 v:10 player:0 [2024-08-05 21:04:47,266][52662] Decorrelating experience for 320 frames... [2024-08-05 21:04:47,268][52664] Port 41110 is available [2024-08-05 21:04:47,268][52664] Using port 41110 [2024-08-05 21:04:47,271][52660] Using port 40809 on host... [2024-08-05 21:04:47,280][52669] Port 41513 is available [2024-08-05 21:04:47,281][52669] Using port 41513 [2024-08-05 21:04:47,290][52668] Using port 41609 on host... [2024-08-05 21:04:47,296][52647] Port 40311 is available [2024-08-05 21:04:47,296][52647] Using port 40311 [2024-08-05 21:04:47,302][52663] Port 40712 is available [2024-08-05 21:04:47,313][52663] Using port 40712 [2024-08-05 21:04:47,305][52670] Initialized w:14 v:8 player:0 [2024-08-05 21:04:47,307][52794] Initialized w:15 v:10 player:0 [2024-08-05 21:04:47,319][52670] Decorrelating experience for 256 frames... [2024-08-05 21:04:47,311][52664] Port 41111 is available [2024-08-05 21:04:47,319][52794] Decorrelating experience for 320 frames... [2024-08-05 21:04:47,322][52664] Using port 41111 [2024-08-05 21:04:47,322][52647] Port 40312 is available [2024-08-05 21:04:47,328][52647] Using port 40312 [2024-08-05 21:04:47,339][52669] Port 41514 is available [2024-08-05 21:04:47,339][52669] Using port 41514 [2024-08-05 21:04:47,355][52664] Port 41112 is available [2024-08-05 21:04:47,355][52664] Using port 41112 [2024-08-05 21:04:47,362][52647] Port 40313 is available [2024-08-05 21:04:47,365][52663] Port 40713 is available [2024-08-05 21:04:47,362][52647] Using port 40313 [2024-08-05 21:04:47,365][52663] Using port 40713 [2024-08-05 21:04:47,397][52658] Using port 40509 on host... [2024-08-05 21:04:47,399][52669] Port 41515 is available [2024-08-05 21:04:47,401][52667] Using port 41309 on host... [2024-08-05 21:04:47,409][52669] Using port 41515 [2024-08-05 21:04:47,415][52663] Port 40714 is available [2024-08-05 21:04:47,428][52663] Using port 40714 [2024-08-05 21:04:47,453][52664] Port 41113 is available [2024-08-05 21:04:47,453][52664] Using port 41113 [2024-08-05 21:04:47,461][52647] Port 40314 is available [2024-08-05 21:04:47,461][52647] Using port 40314 [2024-08-05 21:04:47,479][52669] Port 41516 is available [2024-08-05 21:04:47,483][52669] Using port 41516 [2024-08-05 21:04:47,493][52664] Port 41114 is available [2024-08-05 21:04:47,493][52664] Using port 41114 [2024-08-05 21:04:47,483][52663] Port 40715 is available [2024-08-05 21:04:47,493][52663] Using port 40715 [2024-08-05 21:04:47,500][52647] Port 40315 is available [2024-08-05 21:04:47,504][52647] Using port 40315 [2024-08-05 21:04:47,518][52803] Initialized w:17 v:8 player:0 [2024-08-05 21:04:47,519][52803] Decorrelating experience for 256 frames... [2024-08-05 21:04:47,527][52664] Port 41115 is available [2024-08-05 21:04:47,527][52664] Using port 41115 [2024-08-05 21:04:47,538][52647] Port 40316 is available [2024-08-05 21:04:47,538][52647] Using port 40316 [2024-08-05 21:04:47,542][52669] Port 41517 is available [2024-08-05 21:04:47,543][52669] Using port 41517 [2024-08-05 21:04:47,550][52663] Port 40716 is available [2024-08-05 21:04:47,550][52663] Using port 40716 [2024-08-05 21:04:47,565][52664] Port 41116 is available [2024-08-05 21:04:47,570][52664] Using port 41116 [2024-08-05 21:04:47,569][52647] Port 40317 is available [2024-08-05 21:04:47,576][52647] Using port 40317 [2024-08-05 21:04:47,586][52669] Port 41518 is available [2024-08-05 21:04:47,596][52669] Using port 41518 [2024-08-05 21:04:47,599][52664] Port 41117 is available [2024-08-05 21:04:47,604][52664] Using port 41117 [2024-08-05 21:04:47,607][52647] Port 40318 is available [2024-08-05 21:04:47,606][52663] Port 40717 is available [2024-08-05 21:04:47,612][52647] Using port 40318 [2024-08-05 21:04:47,612][52663] Using port 40717 [2024-08-05 21:04:47,647][52664] Port 41118 is available [2024-08-05 21:04:47,647][52664] Using port 41118 [2024-08-05 21:04:47,649][52669] Port 41519 is available [2024-08-05 21:04:47,660][52669] Using port 41519 [2024-08-05 21:04:47,661][52669] Using port 41510 on host... [2024-08-05 21:04:47,661][52647] Port 40319 is available [2024-08-05 21:04:47,662][52647] Using port 40319 [2024-08-05 21:04:47,663][52647] Using port 40310 on host... [2024-08-05 21:04:47,671][52663] Port 40718 is available [2024-08-05 21:04:47,673][52663] Using port 40718 [2024-08-05 21:04:47,677][52671] Initialized w:11 v:10 player:0 [2024-08-05 21:04:47,680][52659] Initialized w:3 v:10 player:0 [2024-08-05 21:04:47,678][52671] Decorrelating experience for 320 frames... [2024-08-05 21:04:47,681][52659] Decorrelating experience for 320 frames... [2024-08-05 21:04:47,693][52664] Port 41119 is available [2024-08-05 21:04:47,693][52664] Using port 41119 [2024-08-05 21:04:47,696][52664] Using port 41110 on host... [2024-08-05 21:04:47,728][52660] Initialized w:5 v:9 player:0 [2024-08-05 21:04:47,729][52660] Decorrelating experience for 288 frames... [2024-08-05 21:04:47,734][52668] Initialized w:13 v:9 player:0 [2024-08-05 21:04:47,735][52668] Decorrelating experience for 288 frames... [2024-08-05 21:04:47,748][52663] Port 40719 is available [2024-08-05 21:04:47,749][52663] Using port 40719 [2024-08-05 21:04:47,750][52663] Using port 40710 on host... [2024-08-05 21:04:47,794][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:04:47,860][52649] Using port 40409 on host... [2024-08-05 21:04:47,865][52665] Using port 41209 on host... [2024-08-05 21:04:47,898][52658] Initialized w:2 v:9 player:0 [2024-08-05 21:04:47,899][52658] Decorrelating experience for 288 frames... [2024-08-05 21:04:47,922][52667] Initialized w:10 v:9 player:0 [2024-08-05 21:04:47,923][52667] Decorrelating experience for 288 frames... [2024-08-05 21:04:47,982][52662] Using port 41011 on host... [2024-08-05 21:04:47,992][52811] Initialized w:18 v:8 player:0 [2024-08-05 21:04:47,993][52811] Decorrelating experience for 256 frames... [2024-08-05 21:04:48,036][52794] Using port 41811 on host... [2024-08-05 21:04:48,109][52795] Initialized w:16 v:8 player:0 [2024-08-05 21:04:48,110][52795] Decorrelating experience for 256 frames... [2024-08-05 21:04:48,114][52666] Using port 40909 on host... [2024-08-05 21:04:48,116][52647] Initialized w:0 v:10 player:0 [2024-08-05 21:04:48,117][52647] Decorrelating experience for 320 frames... [2024-08-05 21:04:48,179][52670] Using port 41709 on host... [2024-08-05 21:04:48,184][52820] Initialized w:19 v:8 player:0 [2024-08-05 21:04:48,184][52820] Decorrelating experience for 256 frames... [2024-08-05 21:04:48,238][52664] Initialized w:8 v:10 player:0 [2024-08-05 21:04:48,239][52664] Decorrelating experience for 320 frames... [2024-08-05 21:04:48,324][52669] Initialized w:12 v:10 player:0 [2024-08-05 21:04:48,325][52669] Decorrelating experience for 320 frames... [2024-08-05 21:04:48,433][52663] Initialized w:4 v:10 player:0 [2024-08-05 21:04:48,433][52663] Decorrelating experience for 320 frames... [2024-08-05 21:04:48,441][52662] Initialized w:7 v:11 player:0 [2024-08-05 21:04:48,443][52662] Decorrelating experience for 352 frames... [2024-08-05 21:04:48,453][52803] Using port 42009 on host... [2024-08-05 21:04:48,470][52668] Port 41610 is available [2024-08-05 21:04:48,475][52668] Using port 41610 [2024-08-05 21:04:48,481][52660] Port 40810 is available [2024-08-05 21:04:48,481][52660] Using port 40810 [2024-08-05 21:04:48,496][52794] Initialized w:15 v:11 player:0 [2024-08-05 21:04:48,498][52794] Decorrelating experience for 352 frames... [2024-08-05 21:04:48,515][52668] Port 41611 is available [2024-08-05 21:04:48,515][52668] Using port 41611 [2024-08-05 21:04:48,522][52660] Port 40811 is available [2024-08-05 21:04:48,522][52660] Using port 40811 [2024-08-05 21:04:48,538][52649] Initialized w:1 v:9 player:0 [2024-08-05 21:04:48,539][52649] Decorrelating experience for 288 frames... [2024-08-05 21:04:48,551][52665] Initialized w:9 v:9 player:0 [2024-08-05 21:04:48,553][52665] Decorrelating experience for 288 frames... [2024-08-05 21:04:48,557][52668] Port 41612 is available [2024-08-05 21:04:48,557][52668] Using port 41612 [2024-08-05 21:04:48,562][52660] Port 40812 is available [2024-08-05 21:04:48,564][52660] Using port 40812 [2024-08-05 21:04:48,563][52667] Port 41310 is available [2024-08-05 21:04:48,568][52667] Using port 41310 [2024-08-05 21:04:48,580][52658] Port 40510 is available [2024-08-05 21:04:48,584][52658] Using port 40510 [2024-08-05 21:04:48,602][52668] Port 41613 is available [2024-08-05 21:04:48,602][52668] Using port 41613 [2024-08-05 21:04:48,608][52667] Port 41311 is available [2024-08-05 21:04:48,608][52667] Using port 41311 [2024-08-05 21:04:48,609][52660] Port 40813 is available [2024-08-05 21:04:48,614][52660] Using port 40813 [2024-08-05 21:04:48,623][52658] Port 40511 is available [2024-08-05 21:04:48,623][52658] Using port 40511 [2024-08-05 21:04:48,645][52667] Port 41312 is available [2024-08-05 21:04:48,645][52667] Using port 41312 [2024-08-05 21:04:48,648][52668] Port 41614 is available [2024-08-05 21:04:48,648][52668] Using port 41614 [2024-08-05 21:04:48,656][52660] Port 40814 is available [2024-08-05 21:04:48,659][52660] Using port 40814 [2024-08-05 21:04:48,664][52658] Port 40512 is available [2024-08-05 21:04:48,665][52658] Using port 40512 [2024-08-05 21:04:48,685][52667] Port 41313 is available [2024-08-05 21:04:48,692][52667] Using port 41313 [2024-08-05 21:04:48,704][52658] Port 40513 is available [2024-08-05 21:04:48,708][52658] Using port 40513 [2024-08-05 21:04:48,713][52668] Port 41615 is available [2024-08-05 21:04:48,714][52668] Using port 41615 [2024-08-05 21:04:48,733][52667] Port 41314 is available [2024-08-05 21:04:48,733][52667] Using port 41314 [2024-08-05 21:04:48,735][52660] Port 40815 is available [2024-08-05 21:04:48,735][52660] Using port 40815 [2024-08-05 21:04:48,757][52658] Port 40514 is available [2024-08-05 21:04:48,757][52658] Using port 40514 [2024-08-05 21:04:48,762][52668] Port 41616 is available [2024-08-05 21:04:48,768][52811] Using port 42109 on host... [2024-08-05 21:04:48,765][52668] Using port 41616 [2024-08-05 21:04:48,776][52660] Port 40816 is available [2024-08-05 21:04:48,776][52660] Using port 40816 [2024-08-05 21:04:48,782][52667] Port 41315 is available [2024-08-05 21:04:48,782][52667] Using port 41315 [2024-08-05 21:04:48,789][52659] Using port 40611 on host... [2024-08-05 21:04:48,796][52658] Port 40515 is available [2024-08-05 21:04:48,796][52658] Using port 40515 [2024-08-05 21:04:48,798][52671] Using port 41411 on host... [2024-08-05 21:04:48,812][52668] Port 41617 is available [2024-08-05 21:04:48,812][52668] Using port 41617 [2024-08-05 21:04:48,818][52660] Port 40817 is available [2024-08-05 21:04:48,818][52660] Using port 40817 [2024-08-05 21:04:48,823][52667] Port 41316 is available [2024-08-05 21:04:48,823][52667] Using port 41316 [2024-08-05 21:04:48,829][52658] Port 40516 is available [2024-08-05 21:04:48,829][52658] Using port 40516 [2024-08-05 21:04:48,839][52795] Using port 41909 on host... [2024-08-05 21:04:48,855][52668] Port 41618 is available [2024-08-05 21:04:48,855][52668] Using port 41618 [2024-08-05 21:04:48,859][52667] Port 41317 is available [2024-08-05 21:04:48,859][52667] Using port 41317 [2024-08-05 21:04:48,860][52660] Port 40818 is available [2024-08-05 21:04:48,865][52660] Using port 40818 [2024-08-05 21:04:48,869][52658] Port 40517 is available [2024-08-05 21:04:48,870][52658] Using port 40517 [2024-08-05 21:04:48,890][52668] Port 41619 is available [2024-08-05 21:04:48,900][52668] Using port 41619 [2024-08-05 21:04:48,901][52668] Using port 41610 on host... [2024-08-05 21:04:48,902][52660] Port 40819 is available [2024-08-05 21:04:48,903][52660] Using port 40819 [2024-08-05 21:04:48,895][52667] Port 41318 is available [2024-08-05 21:04:48,904][52667] Using port 41318 [2024-08-05 21:04:48,904][52660] Using port 40810 on host... [2024-08-05 21:04:48,902][52820] Using port 42209 on host... [2024-08-05 21:04:48,912][52658] Port 40518 is available [2024-08-05 21:04:48,912][52658] Using port 40518 [2024-08-05 21:04:48,939][52667] Port 41319 is available [2024-08-05 21:04:48,940][52667] Using port 41319 [2024-08-05 21:04:48,941][52667] Using port 41310 on host... [2024-08-05 21:04:48,946][52658] Port 40519 is available [2024-08-05 21:04:48,946][52658] Using port 40519 [2024-08-05 21:04:48,947][52658] Using port 40510 on host... [2024-08-05 21:04:48,949][52666] Initialized w:6 v:9 player:0 [2024-08-05 21:04:48,954][52666] Decorrelating experience for 288 frames... [2024-08-05 21:04:48,974][52647] Using port 40311 on host... [2024-08-05 21:04:48,991][52670] Initialized w:14 v:9 player:0 [2024-08-05 21:04:48,992][52670] Decorrelating experience for 288 frames... [2024-08-05 21:04:49,105][52664] Using port 41111 on host... [2024-08-05 21:04:49,288][52803] Initialized w:17 v:9 player:0 [2024-08-05 21:04:49,289][52803] Decorrelating experience for 288 frames... [2024-08-05 21:04:49,321][52668] Initialized w:13 v:10 player:0 [2024-08-05 21:04:49,322][52668] Decorrelating experience for 320 frames... [2024-08-05 21:04:49,326][52662] Using port 41012 on host... [2024-08-05 21:04:49,337][52660] Initialized w:5 v:10 player:0 [2024-08-05 21:04:49,338][52660] Decorrelating experience for 320 frames... [2024-08-05 21:04:49,350][52669] Using port 41511 on host... [2024-08-05 21:04:49,361][52794] Using port 41812 on host... [2024-08-05 21:04:49,392][52667] Initialized w:10 v:10 player:0 [2024-08-05 21:04:49,393][52667] Decorrelating experience for 320 frames... [2024-08-05 21:04:49,394][52658] Initialized w:2 v:10 player:0 [2024-08-05 21:04:49,395][52658] Decorrelating experience for 320 frames... [2024-08-05 21:04:49,441][52663] Using port 40711 on host... [2024-08-05 21:04:49,456][52671] Initialized w:11 v:11 player:0 [2024-08-05 21:04:49,456][52671] Decorrelating experience for 352 frames... [2024-08-05 21:04:49,460][52659] Initialized w:3 v:11 player:0 [2024-08-05 21:04:49,461][52659] Decorrelating experience for 352 frames... [2024-08-05 21:04:49,512][52647] Initialized w:0 v:11 player:0 [2024-08-05 21:04:49,513][52647] Decorrelating experience for 352 frames... [2024-08-05 21:04:49,527][52665] Port 41210 is available [2024-08-05 21:04:49,533][52649] Port 40410 is available [2024-08-05 21:04:49,533][52649] Using port 40410 [2024-08-05 21:04:49,544][52665] Using port 41210 [2024-08-05 21:04:49,584][52649] Port 40411 is available [2024-08-05 21:04:49,585][52649] Using port 40411 [2024-08-05 21:04:49,595][52664] Initialized w:8 v:11 player:0 [2024-08-05 21:04:49,596][52664] Decorrelating experience for 352 frames... [2024-08-05 21:04:49,600][52665] Port 41211 is available [2024-08-05 21:04:49,600][52665] Using port 41211 [2024-08-05 21:04:49,625][52811] Initialized w:18 v:9 player:0 [2024-08-05 21:04:49,626][52811] Decorrelating experience for 288 frames... [2024-08-05 21:04:49,638][52649] Port 40412 is available [2024-08-05 21:04:49,638][52649] Using port 40412 [2024-08-05 21:04:49,660][52665] Port 41212 is available [2024-08-05 21:04:49,660][52665] Using port 41212 [2024-08-05 21:04:49,692][52649] Port 40413 is available [2024-08-05 21:04:49,692][52649] Using port 40413 [2024-08-05 21:04:49,701][52665] Port 41213 is available [2024-08-05 21:04:49,703][52665] Using port 41213 [2024-08-05 21:04:49,748][52649] Port 40414 is available [2024-08-05 21:04:49,749][52649] Using port 40414 [2024-08-05 21:04:49,773][52665] Port 41214 is available [2024-08-05 21:04:49,776][52795] Initialized w:16 v:9 player:0 [2024-08-05 21:04:49,777][52795] Decorrelating experience for 288 frames... [2024-08-05 21:04:49,775][52665] Using port 41214 [2024-08-05 21:04:49,811][52662] Initialized w:7 v:12 player:0 [2024-08-05 21:04:49,812][52662] Decorrelating experience for 384 frames... [2024-08-05 21:04:49,818][52649] Port 40415 is available [2024-08-05 21:04:49,820][52649] Using port 40415 [2024-08-05 21:04:49,821][52820] Initialized w:19 v:9 player:0 [2024-08-05 21:04:49,822][52820] Decorrelating experience for 288 frames... [2024-08-05 21:04:49,855][52665] Port 41215 is available [2024-08-05 21:04:49,855][52665] Using port 41215 [2024-08-05 21:04:49,863][52666] Port 40910 is available [2024-08-05 21:04:49,864][52666] Using port 40910 [2024-08-05 21:04:49,864][52794] Initialized w:15 v:12 player:0 [2024-08-05 21:04:49,866][52794] Decorrelating experience for 384 frames... [2024-08-05 21:04:49,870][52669] Initialized w:12 v:11 player:0 [2024-08-05 21:04:49,871][52669] Decorrelating experience for 352 frames... [2024-08-05 21:04:49,887][52649] Port 40416 is available [2024-08-05 21:04:49,887][52649] Using port 40416 [2024-08-05 21:04:49,923][52663] Initialized w:4 v:11 player:0 [2024-08-05 21:04:49,924][52663] Decorrelating experience for 352 frames... [2024-08-05 21:04:49,921][52665] Port 41216 is available [2024-08-05 21:04:49,929][52665] Using port 41216 [2024-08-05 21:04:49,936][52666] Port 40911 is available [2024-08-05 21:04:49,940][52666] Using port 40911 [2024-08-05 21:04:49,970][52649] Port 40417 is available [2024-08-05 21:04:49,970][52649] Using port 40417 [2024-08-05 21:04:49,997][52665] Port 41217 is available [2024-08-05 21:04:49,997][52665] Using port 41217 [2024-08-05 21:04:49,989][52670] Port 41710 is available [2024-08-05 21:04:50,001][52670] Using port 41710 [2024-08-05 21:04:50,014][52666] Port 40912 is available [2024-08-05 21:04:50,015][52666] Using port 40912 [2024-08-05 21:04:50,042][52649] Port 40418 is available [2024-08-05 21:04:50,042][52649] Using port 40418 [2024-08-05 21:04:50,075][52670] Port 41711 is available [2024-08-05 21:04:50,076][52670] Using port 41711 [2024-08-05 21:04:50,081][52665] Port 41218 is available [2024-08-05 21:04:50,081][52665] Using port 41218 [2024-08-05 21:04:50,086][52666] Port 40913 is available [2024-08-05 21:04:50,092][52666] Using port 40913 [2024-08-05 21:04:50,114][52649] Port 40419 is available [2024-08-05 21:04:50,123][52649] Using port 40419 [2024-08-05 21:04:50,125][52649] Using port 40410 on host... [2024-08-05 21:04:50,137][52670] Port 41712 is available [2024-08-05 21:04:50,142][52670] Using port 41712 [2024-08-05 21:04:50,156][52666] Port 40914 is available [2024-08-05 21:04:50,161][52665] Port 41219 is available [2024-08-05 21:04:50,161][52665] Using port 41219 [2024-08-05 21:04:50,161][52666] Using port 40914 [2024-08-05 21:04:50,163][52665] Using port 41210 on host... [2024-08-05 21:04:50,212][52670] Port 41713 is available [2024-08-05 21:04:50,218][52670] Using port 41713 [2024-08-05 21:04:50,226][52666] Port 40915 is available [2024-08-05 21:04:50,226][52658] Using port 40511 on host... [2024-08-05 21:04:50,236][52666] Using port 40915 [2024-08-05 21:04:50,244][52667] Using port 41311 on host... [2024-08-05 21:04:50,299][52670] Port 41714 is available [2024-08-05 21:04:50,302][52670] Using port 41714 [2024-08-05 21:04:50,314][52666] Port 40916 is available [2024-08-05 21:04:50,317][52666] Using port 40916 [2024-08-05 21:04:50,336][52668] Using port 41611 on host... [2024-08-05 21:04:50,367][52647] Using port 40312 on host... [2024-08-05 21:04:50,370][52670] Port 41715 is available [2024-08-05 21:04:50,375][52670] Using port 41715 [2024-08-05 21:04:50,378][52666] Port 40917 is available [2024-08-05 21:04:50,389][52666] Using port 40917 [2024-08-05 21:04:50,411][52660] Using port 40811 on host... [2024-08-05 21:04:50,431][52803] Port 42010 is available [2024-08-05 21:04:50,442][52803] Using port 42010 [2024-08-05 21:04:50,444][52670] Port 41716 is available [2024-08-05 21:04:50,452][52670] Using port 41716 [2024-08-05 21:04:50,455][52666] Port 40918 is available [2024-08-05 21:04:50,465][52666] Using port 40918 [2024-08-05 21:04:50,516][52803] Port 42011 is available [2024-08-05 21:04:50,522][52664] Using port 41112 on host... [2024-08-05 21:04:50,522][52803] Using port 42011 [2024-08-05 21:04:50,521][52670] Port 41717 is available [2024-08-05 21:04:50,532][52670] Using port 41717 [2024-08-05 21:04:50,539][52666] Port 40919 is available [2024-08-05 21:04:50,539][52666] Using port 40919 [2024-08-05 21:04:50,549][52666] Using port 40910 on host... [2024-08-05 21:04:50,581][52795] Port 41910 is available [2024-08-05 21:04:50,588][52795] Using port 41910 [2024-08-05 21:04:50,596][52670] Port 41718 is available [2024-08-05 21:04:50,597][52670] Using port 41718 [2024-08-05 21:04:50,587][52803] Port 42012 is available [2024-08-05 21:04:50,601][52803] Using port 42012 [2024-08-05 21:04:50,640][52795] Port 41911 is available [2024-08-05 21:04:50,640][52795] Using port 41911 [2024-08-05 21:04:50,653][52670] Port 41719 is available [2024-08-05 21:04:50,660][52670] Using port 41719 [2024-08-05 21:04:50,661][52670] Using port 41710 on host... [2024-08-05 21:04:50,674][52820] Port 42210 is available [2024-08-05 21:04:50,659][52803] Port 42013 is available [2024-08-05 21:04:50,676][52820] Using port 42210 [2024-08-05 21:04:50,676][52803] Using port 42013 [2024-08-05 21:04:50,683][52795] Port 41912 is available [2024-08-05 21:04:50,684][52795] Using port 41912 [2024-08-05 21:04:50,695][52662] Using port 41013 on host... [2024-08-05 21:04:50,704][52658] Initialized w:2 v:11 player:0 [2024-08-05 21:04:50,705][52658] Decorrelating experience for 352 frames... [2024-08-05 21:04:50,708][52669] Using port 41512 on host... [2024-08-05 21:04:50,715][52811] Port 42110 is available [2024-08-05 21:04:50,729][52811] Using port 42110 [2024-08-05 21:04:50,717][52820] Port 42211 is available [2024-08-05 21:04:50,734][52820] Using port 42211 [2024-08-05 21:04:50,735][52794] Using port 41813 on host... [2024-08-05 21:04:50,743][52667] Initialized w:10 v:11 player:0 [2024-08-05 21:04:50,744][52667] Decorrelating experience for 352 frames... [2024-08-05 21:04:50,746][52795] Port 41913 is available [2024-08-05 21:04:50,746][52795] Using port 41913 [2024-08-05 21:04:50,749][52803] Port 42014 is available [2024-08-05 21:04:50,749][52803] Using port 42014 [2024-08-05 21:04:50,753][52671] Using port 41412 on host... [2024-08-05 21:04:50,772][52659] Using port 40612 on host... [2024-08-05 21:04:50,791][52820] Port 42212 is available [2024-08-05 21:04:50,796][52820] Using port 42212 [2024-08-05 21:04:50,799][52803] Port 42015 is available [2024-08-05 21:04:50,801][52663] Using port 40712 on host... [2024-08-05 21:04:50,806][52811] Port 42111 is available [2024-08-05 21:04:50,816][52811] Using port 42111 [2024-08-05 21:04:50,812][52803] Using port 42015 [2024-08-05 21:04:50,821][52795] Port 41914 is available [2024-08-05 21:04:50,821][52795] Using port 41914 [2024-08-05 21:04:50,846][52820] Port 42213 is available [2024-08-05 21:04:50,852][52820] Using port 42213 [2024-08-05 21:04:50,861][52811] Port 42112 is available [2024-08-05 21:04:50,868][52811] Using port 42112 [2024-08-05 21:04:50,873][52795] Port 41915 is available [2024-08-05 21:04:50,873][52795] Using port 41915 [2024-08-05 21:04:50,873][52803] Port 42016 is available [2024-08-05 21:04:50,876][52803] Using port 42016 [2024-08-05 21:04:50,888][52649] Initialized w:1 v:10 player:0 [2024-08-05 21:04:50,889][52649] Decorrelating experience for 320 frames... [2024-08-05 21:04:50,908][52668] Initialized w:13 v:11 player:0 [2024-08-05 21:04:50,909][52668] Decorrelating experience for 352 frames... [2024-08-05 21:04:50,910][52820] Port 42214 is available [2024-08-05 21:04:50,910][52820] Using port 42214 [2024-08-05 21:04:50,917][52811] Port 42113 is available [2024-08-05 21:04:50,920][52665] Initialized w:9 v:10 player:0 [2024-08-05 21:04:50,924][52811] Using port 42113 [2024-08-05 21:04:50,924][52665] Decorrelating experience for 320 frames... [2024-08-05 21:04:50,927][52567] Heartbeat connected on Batcher_0 [2024-08-05 21:04:50,930][52567] Heartbeat connected on LearnerWorker_p0 [2024-08-05 21:04:50,933][52803] Port 42017 is available [2024-08-05 21:04:50,933][52803] Using port 42017 [2024-08-05 21:04:50,936][52647] Initialized w:0 v:12 player:0 [2024-08-05 21:04:50,937][52647] Decorrelating experience for 384 frames... [2024-08-05 21:04:50,938][52795] Port 41916 is available [2024-08-05 21:04:50,939][52795] Using port 41916 [2024-08-05 21:04:50,944][52660] Initialized w:5 v:11 player:0 [2024-08-05 21:04:50,945][52660] Decorrelating experience for 352 frames... [2024-08-05 21:04:50,962][52820] Port 42215 is available [2024-08-05 21:04:50,962][52820] Using port 42215 [2024-08-05 21:04:50,963][52567] Heartbeat connected on InferenceWorker_p0-w0 [2024-08-05 21:04:50,969][52811] Port 42114 is available [2024-08-05 21:04:50,976][52811] Using port 42114 [2024-08-05 21:04:50,989][52803] Port 42018 is available [2024-08-05 21:04:50,989][52803] Using port 42018 [2024-08-05 21:04:51,012][52795] Port 41917 is available [2024-08-05 21:04:51,019][52795] Using port 41917 [2024-08-05 21:04:51,020][52820] Port 42216 is available [2024-08-05 21:04:51,020][52820] Using port 42216 [2024-08-05 21:04:51,026][52811] Port 42115 is available [2024-08-05 21:04:51,032][52811] Using port 42115 [2024-08-05 21:04:51,042][52803] Port 42019 is available [2024-08-05 21:04:51,046][52803] Using port 42019 [2024-08-05 21:04:51,047][52803] Using port 42010 on host... [2024-08-05 21:04:51,056][52664] Initialized w:8 v:12 player:0 [2024-08-05 21:04:51,057][52664] Decorrelating experience for 384 frames... [2024-08-05 21:04:51,071][52820] Port 42217 is available [2024-08-05 21:04:51,071][52820] Using port 42217 [2024-08-05 21:04:51,084][52811] Port 42116 is available [2024-08-05 21:04:51,084][52811] Using port 42116 [2024-08-05 21:04:51,091][52795] Port 41918 is available [2024-08-05 21:04:51,091][52795] Using port 41918 [2024-08-05 21:04:51,120][52820] Port 42218 is available [2024-08-05 21:04:51,120][52820] Using port 42218 [2024-08-05 21:04:51,139][52811] Port 42117 is available [2024-08-05 21:04:51,148][52811] Using port 42117 [2024-08-05 21:04:51,164][52662] Initialized w:7 v:13 player:0 [2024-08-05 21:04:51,165][52662] Decorrelating experience for 416 frames... [2024-08-05 21:04:51,171][52820] Port 42219 is available [2024-08-05 21:04:51,171][52820] Using port 42219 [2024-08-05 21:04:51,177][52820] Using port 42210 on host... [2024-08-05 21:04:51,177][52795] Port 41919 is available [2024-08-05 21:04:51,180][52795] Using port 41919 [2024-08-05 21:04:51,182][52795] Using port 41910 on host... [2024-08-05 21:04:51,187][52794] Initialized w:15 v:13 player:0 [2024-08-05 21:04:51,188][52794] Decorrelating experience for 416 frames... [2024-08-05 21:04:51,205][52811] Port 42118 is available [2024-08-05 21:04:51,205][52811] Using port 42118 [2024-08-05 21:04:51,213][52666] Initialized w:6 v:10 player:0 [2024-08-05 21:04:51,214][52666] Decorrelating experience for 320 frames... [2024-08-05 21:04:51,257][52811] Port 42119 is available [2024-08-05 21:04:51,257][52811] Using port 42119 [2024-08-05 21:04:51,259][52811] Using port 42110 on host... [2024-08-05 21:04:51,300][52670] Initialized w:14 v:10 player:0 [2024-08-05 21:04:51,301][52670] Decorrelating experience for 320 frames... [2024-08-05 21:04:51,361][52669] Initialized w:12 v:12 player:0 [2024-08-05 21:04:51,362][52669] Decorrelating experience for 384 frames... [2024-08-05 21:04:51,376][52671] Initialized w:11 v:12 player:0 [2024-08-05 21:04:51,377][52671] Decorrelating experience for 384 frames... [2024-08-05 21:04:51,382][52659] Initialized w:3 v:12 player:0 [2024-08-05 21:04:51,383][52659] Decorrelating experience for 384 frames... [2024-08-05 21:04:51,408][52663] Initialized w:4 v:12 player:0 [2024-08-05 21:04:51,409][52663] Decorrelating experience for 384 frames... [2024-08-05 21:04:51,705][52658] Using port 40512 on host... [2024-08-05 21:04:51,762][52667] Using port 41312 on host... [2024-08-05 21:04:51,784][52647] Using port 40313 on host... [2024-08-05 21:04:51,871][52649] Using port 40411 on host... [2024-08-05 21:04:51,922][52665] Using port 41211 on host... [2024-08-05 21:04:51,929][52664] Using port 41113 on host... [2024-08-05 21:04:51,940][52668] Using port 41612 on host... [2024-08-05 21:04:51,942][52803] Initialized w:17 v:10 player:0 [2024-08-05 21:04:51,943][52803] Decorrelating experience for 320 frames... [2024-08-05 21:04:51,949][52666] Using port 40911 on host... [2024-08-05 21:04:51,981][52660] Using port 40812 on host... [2024-08-05 21:04:52,012][52670] Using port 41711 on host... [2024-08-05 21:04:52,088][52795] Initialized w:16 v:10 player:0 [2024-08-05 21:04:52,089][52795] Decorrelating experience for 320 frames... [2024-08-05 21:04:52,147][52820] Initialized w:19 v:10 player:0 [2024-08-05 21:04:52,148][52820] Decorrelating experience for 320 frames... [2024-08-05 21:04:52,185][52811] Initialized w:18 v:10 player:0 [2024-08-05 21:04:52,185][52811] Decorrelating experience for 320 frames... [2024-08-05 21:04:52,188][52658] Initialized w:2 v:12 player:0 [2024-08-05 21:04:52,189][52658] Decorrelating experience for 384 frames... [2024-08-05 21:04:52,218][52667] Initialized w:10 v:12 player:0 [2024-08-05 21:04:52,219][52667] Decorrelating experience for 384 frames... [2024-08-05 21:04:52,233][52669] Using port 41513 on host... [2024-08-05 21:04:52,278][52647] Initialized w:0 v:13 player:0 [2024-08-05 21:04:52,279][52647] Decorrelating experience for 416 frames... [2024-08-05 21:04:52,300][52663] Using port 40713 on host... [2024-08-05 21:04:52,403][52659] Using port 40613 on host... [2024-08-05 21:04:52,430][52666] Initialized w:6 v:11 player:0 [2024-08-05 21:04:52,431][52666] Decorrelating experience for 352 frames... [2024-08-05 21:04:52,448][52670] Initialized w:14 v:11 player:0 [2024-08-05 21:04:52,448][52670] Decorrelating experience for 352 frames... [2024-08-05 21:04:52,449][52671] Using port 41413 on host... [2024-08-05 21:04:52,455][52668] Initialized w:13 v:12 player:0 [2024-08-05 21:04:52,456][52668] Decorrelating experience for 384 frames... [2024-08-05 21:04:52,463][52664] Initialized w:8 v:13 player:0 [2024-08-05 21:04:52,464][52664] Decorrelating experience for 416 frames... [2024-08-05 21:04:52,466][52660] Initialized w:5 v:12 player:0 [2024-08-05 21:04:52,467][52660] Decorrelating experience for 384 frames... [2024-08-05 21:04:52,547][52662] Using port 41014 on host... [2024-08-05 21:04:52,583][52649] Initialized w:1 v:11 player:0 [2024-08-05 21:04:52,585][52649] Decorrelating experience for 352 frames... [2024-08-05 21:04:52,602][52794] Using port 41814 on host... [2024-08-05 21:04:52,656][52665] Initialized w:9 v:11 player:0 [2024-08-05 21:04:52,657][52665] Decorrelating experience for 352 frames... [2024-08-05 21:04:52,794][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:04:52,900][52659] Initialized w:3 v:13 player:0 [2024-08-05 21:04:52,901][52659] Decorrelating experience for 416 frames... [2024-08-05 21:04:52,920][52671] Initialized w:11 v:13 player:0 [2024-08-05 21:04:52,921][52671] Decorrelating experience for 416 frames... [2024-08-05 21:04:52,980][52811] Using port 42111 on host... [2024-08-05 21:04:52,996][52669] Initialized w:12 v:13 player:0 [2024-08-05 21:04:52,997][52669] Decorrelating experience for 416 frames... [2024-08-05 21:04:53,025][52795] Using port 41911 on host... [2024-08-05 21:04:53,031][52663] Initialized w:4 v:13 player:0 [2024-08-05 21:04:53,032][52663] Decorrelating experience for 416 frames... [2024-08-05 21:04:53,077][52820] Using port 42211 on host... [2024-08-05 21:04:53,097][52803] Using port 42011 on host... [2024-08-05 21:04:53,240][52658] Using port 40513 on host... [2024-08-05 21:04:53,249][52662] Initialized w:7 v:14 player:0 [2024-08-05 21:04:53,249][52662] Decorrelating experience for 448 frames... [2024-08-05 21:04:53,262][52666] Using port 40912 on host... [2024-08-05 21:04:53,271][52667] Using port 41313 on host... [2024-08-05 21:04:53,273][52647] Using port 40314 on host... [2024-08-05 21:04:53,291][52794] Initialized w:15 v:14 player:0 [2024-08-05 21:04:53,292][52794] Decorrelating experience for 448 frames... [2024-08-05 21:04:53,296][52670] Using port 41712 on host... [2024-08-05 21:04:53,487][52664] Using port 41114 on host... [2024-08-05 21:04:53,528][52660] Using port 40813 on host... [2024-08-05 21:04:53,555][52668] Using port 41613 on host... [2024-08-05 21:04:53,613][52649] Using port 40412 on host... [2024-08-05 21:04:53,673][52658] Initialized w:2 v:13 player:0 [2024-08-05 21:04:53,674][52658] Decorrelating experience for 416 frames... [2024-08-05 21:04:53,697][52665] Using port 41212 on host... [2024-08-05 21:04:53,704][52667] Initialized w:10 v:13 player:0 [2024-08-05 21:04:53,705][52667] Decorrelating experience for 416 frames... [2024-08-05 21:04:53,816][52666] Initialized w:6 v:12 player:0 [2024-08-05 21:04:53,817][52666] Decorrelating experience for 384 frames... [2024-08-05 21:04:53,830][52820] Initialized w:19 v:11 player:0 [2024-08-05 21:04:53,831][52820] Decorrelating experience for 352 frames... [2024-08-05 21:04:53,842][52647] Initialized w:0 v:14 player:0 [2024-08-05 21:04:53,843][52647] Decorrelating experience for 448 frames... [2024-08-05 21:04:53,848][52670] Initialized w:14 v:12 player:0 [2024-08-05 21:04:53,849][52670] Decorrelating experience for 384 frames... [2024-08-05 21:04:53,894][52811] Initialized w:18 v:11 player:0 [2024-08-05 21:04:53,895][52811] Decorrelating experience for 352 frames... [2024-08-05 21:04:53,924][52795] Initialized w:16 v:11 player:0 [2024-08-05 21:04:53,925][52795] Decorrelating experience for 352 frames... [2024-08-05 21:04:53,950][52669] Using port 41514 on host... [2024-08-05 21:04:53,970][52664] Initialized w:8 v:14 player:0 [2024-08-05 21:04:53,971][52664] Decorrelating experience for 448 frames... [2024-08-05 21:04:54,006][52663] Using port 40714 on host... [2024-08-05 21:04:54,073][52803] Initialized w:17 v:11 player:0 [2024-08-05 21:04:54,074][52803] Decorrelating experience for 352 frames... [2024-08-05 21:04:54,087][52660] Initialized w:5 v:13 player:0 [2024-08-05 21:04:54,088][52660] Decorrelating experience for 416 frames... [2024-08-05 21:04:54,091][52668] Initialized w:13 v:13 player:0 [2024-08-05 21:04:54,092][52668] Decorrelating experience for 416 frames... [2024-08-05 21:04:54,109][52671] Using port 41414 on host... [2024-08-05 21:04:54,112][52659] Using port 40614 on host... [2024-08-05 21:04:54,370][52649] Initialized w:1 v:12 player:0 [2024-08-05 21:04:54,372][52649] Decorrelating experience for 384 frames... [2024-08-05 21:04:54,437][52665] Initialized w:9 v:12 player:0 [2024-08-05 21:04:54,438][52665] Decorrelating experience for 384 frames... [2024-08-05 21:04:54,445][52662] Using port 41015 on host... [2024-08-05 21:04:54,456][52794] Using port 41815 on host... [2024-08-05 21:04:54,583][52658] Using port 40514 on host... [2024-08-05 21:04:54,610][52667] Using port 41314 on host... [2024-08-05 21:04:54,742][52669] Initialized w:12 v:14 player:0 [2024-08-05 21:04:54,742][52669] Decorrelating experience for 448 frames... [2024-08-05 21:04:54,744][52811] Using port 42112 on host... [2024-08-05 21:04:54,795][52663] Initialized w:4 v:14 player:0 [2024-08-05 21:04:54,796][52663] Decorrelating experience for 448 frames... [2024-08-05 21:04:54,877][52647] Using port 40315 on host... [2024-08-05 21:04:54,884][52794] Initialized w:15 v:15 player:0 [2024-08-05 21:04:54,887][52794] Decorrelating experience for 480 frames... [2024-08-05 21:04:54,902][52662] Initialized w:7 v:15 player:0 [2024-08-05 21:04:54,905][52662] Decorrelating experience for 480 frames... [2024-08-05 21:04:54,949][52671] Initialized w:11 v:14 player:0 [2024-08-05 21:04:54,950][52671] Decorrelating experience for 448 frames... [2024-08-05 21:04:54,957][52659] Initialized w:3 v:14 player:0 [2024-08-05 21:04:54,958][52659] Decorrelating experience for 448 frames... [2024-08-05 21:04:54,988][52666] Using port 40913 on host... [2024-08-05 21:04:54,997][52664] Using port 41115 on host... [2024-08-05 21:04:55,012][52795] Using port 41912 on host... [2024-08-05 21:04:55,020][52803] Using port 42012 on host... [2024-08-05 21:04:55,026][52658] Initialized w:2 v:14 player:0 [2024-08-05 21:04:55,027][52658] Decorrelating experience for 448 frames... [2024-08-05 21:04:55,066][52820] Using port 42212 on host... [2024-08-05 21:04:55,068][52667] Initialized w:10 v:14 player:0 [2024-08-05 21:04:55,069][52667] Decorrelating experience for 448 frames... [2024-08-05 21:04:55,081][52670] Using port 41713 on host... [2024-08-05 21:04:55,111][52660] Using port 40814 on host... [2024-08-05 21:04:55,120][52668] Using port 41614 on host... [2024-08-05 21:04:55,467][52666] Initialized w:6 v:13 player:0 [2024-08-05 21:04:55,467][52666] Decorrelating experience for 416 frames... [2024-08-05 21:04:55,501][52649] Using port 40413 on host... [2024-08-05 21:04:55,509][52670] Initialized w:14 v:13 player:0 [2024-08-05 21:04:55,510][52670] Decorrelating experience for 416 frames... [2024-08-05 21:04:55,531][52665] Using port 41213 on host... [2024-08-05 21:04:55,556][52660] Initialized w:5 v:14 player:0 [2024-08-05 21:04:55,557][52660] Decorrelating experience for 448 frames... [2024-08-05 21:04:55,560][52668] Initialized w:13 v:14 player:0 [2024-08-05 21:04:55,561][52668] Decorrelating experience for 448 frames... [2024-08-05 21:04:55,574][52647] Initialized w:0 v:15 player:0 [2024-08-05 21:04:55,575][52647] Decorrelating experience for 480 frames... [2024-08-05 21:04:55,635][52664] Initialized w:8 v:15 player:0 [2024-08-05 21:04:55,636][52664] Decorrelating experience for 480 frames... [2024-08-05 21:04:55,663][52811] Initialized w:18 v:12 player:0 [2024-08-05 21:04:55,664][52811] Decorrelating experience for 384 frames... [2024-08-05 21:04:55,874][52795] Initialized w:16 v:12 player:0 [2024-08-05 21:04:55,875][52795] Decorrelating experience for 384 frames... [2024-08-05 21:04:55,945][52803] Initialized w:17 v:12 player:0 [2024-08-05 21:04:55,946][52803] Decorrelating experience for 384 frames... [2024-08-05 21:04:56,000][52820] Initialized w:19 v:12 player:0 [2024-08-05 21:04:56,001][52820] Decorrelating experience for 384 frames... [2024-08-05 21:04:56,006][52671] Using port 41415 on host... [2024-08-05 21:04:56,010][52669] Using port 41515 on host... [2024-08-05 21:04:56,010][52659] Using port 40615 on host... [2024-08-05 21:04:56,077][52649] Initialized w:1 v:13 player:0 [2024-08-05 21:04:56,078][52649] Decorrelating experience for 416 frames... [2024-08-05 21:04:56,086][52663] Using port 40715 on host... [2024-08-05 21:04:56,109][52665] Initialized w:9 v:13 player:0 [2024-08-05 21:04:56,110][52665] Decorrelating experience for 416 frames... [2024-08-05 21:04:56,172][52662] Using port 41016 on host... [2024-08-05 21:04:56,176][52794] Using port 41816 on host... [2024-08-05 21:04:56,370][52658] Using port 40515 on host... [2024-08-05 21:04:56,438][52667] Using port 41315 on host... [2024-08-05 21:04:56,468][52671] Initialized w:11 v:15 player:0 [2024-08-05 21:04:56,468][52671] Decorrelating experience for 480 frames... [2024-08-05 21:04:56,473][52659] Initialized w:3 v:15 player:0 [2024-08-05 21:04:56,474][52659] Decorrelating experience for 480 frames... [2024-08-05 21:04:56,509][52669] Initialized w:12 v:15 player:0 [2024-08-05 21:04:56,510][52669] Decorrelating experience for 480 frames... [2024-08-05 21:04:56,576][52663] Initialized w:4 v:15 player:0 [2024-08-05 21:04:56,577][52663] Decorrelating experience for 480 frames... [2024-08-05 21:04:56,626][52794] Initialized w:15 v:16 player:0 [2024-08-05 21:04:56,627][52794] Decorrelating experience for 512 frames... [2024-08-05 21:04:56,627][52662] Initialized w:7 v:16 player:0 [2024-08-05 21:04:56,628][52662] Decorrelating experience for 512 frames... [2024-08-05 21:04:56,700][52666] Using port 40914 on host... [2024-08-05 21:04:56,853][52658] Initialized w:2 v:15 player:0 [2024-08-05 21:04:56,854][52658] Decorrelating experience for 480 frames... [2024-08-05 21:04:56,870][52647] Using port 40316 on host... [2024-08-05 21:04:56,877][52670] Using port 41714 on host... [2024-08-05 21:04:56,903][52667] Initialized w:10 v:15 player:0 [2024-08-05 21:04:56,904][52667] Decorrelating experience for 480 frames... [2024-08-05 21:04:56,918][52664] Using port 41116 on host... [2024-08-05 21:04:57,080][52811] Using port 42113 on host... [2024-08-05 21:04:57,111][52660] Using port 40815 on host... [2024-08-05 21:04:57,125][52668] Using port 41615 on host... [2024-08-05 21:04:57,207][52820] Using port 42213 on host... [2024-08-05 21:04:57,308][52795] Using port 41913 on host... [2024-08-05 21:04:57,374][52803] Using port 42013 on host... [2024-08-05 21:04:57,407][52666] Initialized w:6 v:14 player:0 [2024-08-05 21:04:57,407][52666] Decorrelating experience for 448 frames... [2024-08-05 21:04:57,453][52670] Initialized w:14 v:14 player:0 [2024-08-05 21:04:57,454][52670] Decorrelating experience for 448 frames... [2024-08-05 21:04:57,539][52660] Initialized w:5 v:15 player:0 [2024-08-05 21:04:57,544][52660] Decorrelating experience for 480 frames... [2024-08-05 21:04:57,579][52668] Initialized w:13 v:15 player:0 [2024-08-05 21:04:57,581][52668] Decorrelating experience for 480 frames... [2024-08-05 21:04:57,685][52647] Initialized w:0 v:16 player:0 [2024-08-05 21:04:57,686][52647] Decorrelating experience for 512 frames... [2024-08-05 21:04:57,773][52664] Initialized w:8 v:16 player:0 [2024-08-05 21:04:57,773][52664] Decorrelating experience for 512 frames... [2024-08-05 21:04:57,785][52649] Using port 40414 on host... [2024-08-05 21:04:57,794][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:04:57,820][52665] Using port 41214 on host... [2024-08-05 21:04:58,003][52669] Using port 41516 on host... [2024-08-05 21:04:58,030][52659] Using port 40616 on host... [2024-08-05 21:04:58,082][52662] Using port 41017 on host... [2024-08-05 21:04:58,094][52663] Using port 40716 on host... [2024-08-05 21:04:58,101][52811] Initialized w:18 v:13 player:0 [2024-08-05 21:04:58,102][52811] Decorrelating experience for 416 frames... [2024-08-05 21:04:58,117][52794] Using port 41817 on host... [2024-08-05 21:04:58,147][52671] Using port 41416 on host... [2024-08-05 21:04:58,202][52820] Initialized w:19 v:13 player:0 [2024-08-05 21:04:58,203][52820] Decorrelating experience for 416 frames... [2024-08-05 21:04:58,422][52649] Initialized w:1 v:14 player:0 [2024-08-05 21:04:58,423][52649] Decorrelating experience for 448 frames... [2024-08-05 21:04:58,430][52665] Initialized w:9 v:14 player:0 [2024-08-05 21:04:58,431][52665] Decorrelating experience for 448 frames... [2024-08-05 21:04:58,539][52658] Using port 40516 on host... [2024-08-05 21:04:58,562][52662] Initialized w:7 v:17 player:0 [2024-08-05 21:04:58,563][52662] Decorrelating experience for 544 frames... [2024-08-05 21:04:58,578][52794] Initialized w:15 v:17 player:0 [2024-08-05 21:04:58,579][52794] Decorrelating experience for 544 frames... [2024-08-05 21:04:58,588][52795] Initialized w:16 v:13 player:0 [2024-08-05 21:04:58,589][52795] Decorrelating experience for 416 frames... [2024-08-05 21:04:58,597][52667] Using port 41316 on host... [2024-08-05 21:04:58,609][52659] Initialized w:3 v:16 player:0 [2024-08-05 21:04:58,610][52659] Decorrelating experience for 512 frames... [2024-08-05 21:04:58,654][52803] Initialized w:17 v:13 player:0 [2024-08-05 21:04:58,655][52803] Decorrelating experience for 416 frames... [2024-08-05 21:04:58,709][52671] Initialized w:11 v:16 player:0 [2024-08-05 21:04:58,710][52671] Decorrelating experience for 512 frames... [2024-08-05 21:04:58,742][52669] Initialized w:12 v:16 player:0 [2024-08-05 21:04:58,743][52669] Decorrelating experience for 512 frames... [2024-08-05 21:04:58,854][52663] Initialized w:4 v:16 player:0 [2024-08-05 21:04:58,855][52663] Decorrelating experience for 512 frames... [2024-08-05 21:04:58,958][52666] Using port 40915 on host... [2024-08-05 21:04:59,031][52670] Using port 41715 on host... [2024-08-05 21:04:59,151][52658] Initialized w:2 v:16 player:0 [2024-08-05 21:04:59,152][52658] Decorrelating experience for 512 frames... [2024-08-05 21:04:59,155][52647] Using port 40317 on host... [2024-08-05 21:04:59,190][52667] Initialized w:10 v:16 player:0 [2024-08-05 21:04:59,190][52667] Decorrelating experience for 512 frames... [2024-08-05 21:04:59,278][52664] Using port 41117 on host... [2024-08-05 21:04:59,366][52668] Using port 41616 on host... [2024-08-05 21:04:59,390][52660] Using port 40816 on host... [2024-08-05 21:04:59,609][52820] Using port 42214 on host... [2024-08-05 21:04:59,740][52647] Initialized w:0 v:17 player:0 [2024-08-05 21:04:59,741][52647] Decorrelating experience for 544 frames... [2024-08-05 21:04:59,761][52811] Using port 42114 on host... [2024-08-05 21:04:59,824][52664] Initialized w:8 v:17 player:0 [2024-08-05 21:04:59,825][52664] Decorrelating experience for 544 frames... [2024-08-05 21:04:59,826][52666] Initialized w:6 v:15 player:0 [2024-08-05 21:04:59,827][52666] Decorrelating experience for 480 frames... [2024-08-05 21:04:59,884][52670] Initialized w:14 v:15 player:0 [2024-08-05 21:04:59,885][52670] Decorrelating experience for 480 frames... [2024-08-05 21:04:59,957][52794] Using port 41818 on host... [2024-08-05 21:04:59,965][52662] Using port 41018 on host... [2024-08-05 21:05:00,001][52668] Initialized w:13 v:16 player:0 [2024-08-05 21:05:00,001][52668] Decorrelating experience for 512 frames... [2024-08-05 21:05:00,004][52660] Initialized w:5 v:16 player:0 [2024-08-05 21:05:00,005][52660] Decorrelating experience for 512 frames... [2024-08-05 21:05:00,268][52649] Using port 40415 on host... [2024-08-05 21:05:00,300][52669] Using port 41517 on host... [2024-08-05 21:05:00,332][52665] Using port 41215 on host... [2024-08-05 21:05:00,420][52663] Using port 40717 on host... [2024-08-05 21:05:00,427][52820] Initialized w:19 v:14 player:0 [2024-08-05 21:05:00,428][52820] Decorrelating experience for 448 frames... [2024-08-05 21:05:00,440][52794] Initialized w:15 v:18 player:0 [2024-08-05 21:05:00,442][52794] Decorrelating experience for 576 frames... [2024-08-05 21:05:00,448][52659] Using port 40617 on host... [2024-08-05 21:05:00,462][52662] Initialized w:7 v:18 player:0 [2024-08-05 21:05:00,462][52662] Decorrelating experience for 576 frames... [2024-08-05 21:05:00,466][52795] Using port 41914 on host... [2024-08-05 21:05:00,481][52671] Using port 41417 on host... [2024-08-05 21:05:00,530][52803] Using port 42014 on host... [2024-08-05 21:05:00,733][52811] Initialized w:18 v:14 player:0 [2024-08-05 21:05:00,734][52811] Decorrelating experience for 448 frames... [2024-08-05 21:05:00,807][52669] Initialized w:12 v:17 player:0 [2024-08-05 21:05:00,807][52669] Decorrelating experience for 544 frames... [2024-08-05 21:05:00,871][52663] Initialized w:4 v:17 player:0 [2024-08-05 21:05:00,872][52663] Decorrelating experience for 544 frames... [2024-08-05 21:05:00,892][52649] Initialized w:1 v:15 player:0 [2024-08-05 21:05:00,893][52649] Decorrelating experience for 480 frames... [2024-08-05 21:05:00,903][52665] Initialized w:9 v:15 player:0 [2024-08-05 21:05:00,903][52665] Decorrelating experience for 480 frames... [2024-08-05 21:05:00,965][52658] Using port 40517 on host... [2024-08-05 21:05:00,977][52667] Using port 41317 on host... [2024-08-05 21:05:01,173][52659] Initialized w:3 v:17 player:0 [2024-08-05 21:05:01,173][52659] Decorrelating experience for 544 frames... [2024-08-05 21:05:01,208][52671] Initialized w:11 v:17 player:0 [2024-08-05 21:05:01,209][52671] Decorrelating experience for 544 frames... [2024-08-05 21:05:01,220][52647] Using port 40318 on host... [2024-08-05 21:05:01,246][52670] Using port 41716 on host... [2024-08-05 21:05:01,252][52666] Using port 40916 on host... [2024-08-05 21:05:01,296][52803] Initialized w:17 v:14 player:0 [2024-08-05 21:05:01,297][52803] Decorrelating experience for 448 frames... [2024-08-05 21:05:01,386][52795] Initialized w:16 v:14 player:0 [2024-08-05 21:05:01,387][52795] Decorrelating experience for 448 frames... [2024-08-05 21:05:01,450][52658] Initialized w:2 v:17 player:0 [2024-08-05 21:05:01,450][52658] Decorrelating experience for 544 frames... [2024-08-05 21:05:01,476][52664] Using port 41118 on host... [2024-08-05 21:05:01,477][52667] Initialized w:10 v:17 player:0 [2024-08-05 21:05:01,478][52667] Decorrelating experience for 544 frames... [2024-08-05 21:05:01,944][52647] Initialized w:0 v:18 player:0 [2024-08-05 21:05:01,946][52647] Decorrelating experience for 576 frames... [2024-08-05 21:05:01,993][52820] Using port 42215 on host... [2024-08-05 21:05:02,055][52660] Using port 40817 on host... [2024-08-05 21:05:02,151][52664] Initialized w:8 v:18 player:0 [2024-08-05 21:05:02,152][52664] Decorrelating experience for 576 frames... [2024-08-05 21:05:02,200][52670] Initialized w:14 v:16 player:0 [2024-08-05 21:05:02,201][52670] Decorrelating experience for 512 frames... [2024-08-05 21:05:02,209][52668] Using port 41617 on host... [2024-08-05 21:05:02,219][52666] Initialized w:6 v:16 player:0 [2024-08-05 21:05:02,220][52666] Decorrelating experience for 512 frames... [2024-08-05 21:05:02,321][52669] Using port 41518 on host... [2024-08-05 21:05:02,368][52663] Using port 40718 on host... [2024-08-05 21:05:02,470][52794] Using port 41819 on host... [2024-08-05 21:05:02,503][52662] Using port 41019 on host... [2024-08-05 21:05:02,794][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 0.0. Samples: 0. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:02,814][52649] Using port 40416 on host... [2024-08-05 21:05:02,833][52811] Using port 42115 on host... [2024-08-05 21:05:02,838][52665] Using port 41216 on host... [2024-08-05 21:05:02,880][52669] Initialized w:12 v:18 player:0 [2024-08-05 21:05:02,881][52669] Decorrelating experience for 576 frames... [2024-08-05 21:05:02,962][52663] Initialized w:4 v:18 player:0 [2024-08-05 21:05:02,964][52663] Decorrelating experience for 576 frames... [2024-08-05 21:05:02,990][52794] Initialized w:15 v:19 player:0 [2024-08-05 21:05:02,991][52794] Decorrelating experience for 608 frames... [2024-08-05 21:05:03,029][52662] Initialized w:7 v:19 player:0 [2024-08-05 21:05:03,030][52662] Decorrelating experience for 608 frames... [2024-08-05 21:05:03,043][52671] Using port 41418 on host... [2024-08-05 21:05:03,056][52659] Using port 40618 on host... [2024-08-05 21:05:03,065][52660] Initialized w:5 v:17 player:0 [2024-08-05 21:05:03,066][52660] Decorrelating experience for 544 frames... [2024-08-05 21:05:03,074][52820] Initialized w:19 v:15 player:0 [2024-08-05 21:05:03,076][52820] Decorrelating experience for 480 frames... [2024-08-05 21:05:03,112][52668] Initialized w:13 v:17 player:0 [2024-08-05 21:05:03,113][52668] Decorrelating experience for 544 frames... [2024-08-05 21:05:03,235][52795] Using port 41915 on host... [2024-08-05 21:05:03,572][52803] Using port 42015 on host... [2024-08-05 21:05:03,667][52665] Initialized w:9 v:16 player:0 [2024-08-05 21:05:03,668][52665] Decorrelating experience for 512 frames... [2024-08-05 21:05:03,671][52649] Initialized w:1 v:16 player:0 [2024-08-05 21:05:03,672][52649] Decorrelating experience for 512 frames... [2024-08-05 21:05:03,703][52671] Initialized w:11 v:18 player:0 [2024-08-05 21:05:03,704][52671] Decorrelating experience for 576 frames... [2024-08-05 21:05:03,706][52659] Initialized w:3 v:18 player:0 [2024-08-05 21:05:03,707][52659] Decorrelating experience for 576 frames... [2024-08-05 21:05:03,840][52811] Initialized w:18 v:15 player:0 [2024-08-05 21:05:03,841][52811] Decorrelating experience for 480 frames... [2024-08-05 21:05:03,916][52658] Using port 40518 on host... [2024-08-05 21:05:03,944][52667] Using port 41318 on host... [2024-08-05 21:05:04,012][52647] Using port 40319 on host... [2024-08-05 21:05:04,079][52664] Using port 41119 on host... [2024-08-05 21:05:04,204][52795] Initialized w:16 v:15 player:0 [2024-08-05 21:05:04,206][52795] Decorrelating experience for 480 frames... [2024-08-05 21:05:04,375][52666] Using port 40917 on host... [2024-08-05 21:05:04,433][52670] Using port 41717 on host... [2024-08-05 21:05:04,454][52667] Initialized w:10 v:18 player:0 [2024-08-05 21:05:04,455][52667] Decorrelating experience for 576 frames... [2024-08-05 21:05:04,461][52658] Initialized w:2 v:18 player:0 [2024-08-05 21:05:04,463][52658] Decorrelating experience for 576 frames... [2024-08-05 21:05:04,485][52647] Initialized w:0 v:19 player:0 [2024-08-05 21:05:04,487][52647] Decorrelating experience for 608 frames... [2024-08-05 21:05:04,516][52803] Initialized w:17 v:15 player:0 [2024-08-05 21:05:04,517][52803] Decorrelating experience for 480 frames... [2024-08-05 21:05:04,529][52664] Initialized w:8 v:19 player:0 [2024-08-05 21:05:04,530][52664] Decorrelating experience for 608 frames... [2024-08-05 21:05:04,627][52567] Heartbeat connected on RolloutWorker_w15 [2024-08-05 21:05:04,631][52669] Using port 41519 on host... [2024-08-05 21:05:04,659][52663] Using port 40719 on host... [2024-08-05 21:05:04,660][52567] Heartbeat connected on RolloutWorker_w7 [2024-08-05 21:05:04,819][52660] Using port 40818 on host... [2024-08-05 21:05:04,836][52820] Using port 42216 on host... [2024-08-05 21:05:04,866][52668] Using port 41618 on host... [2024-08-05 21:05:05,000][52666] Initialized w:6 v:17 player:0 [2024-08-05 21:05:05,001][52666] Decorrelating experience for 544 frames... [2024-08-05 21:05:05,005][52670] Initialized w:14 v:17 player:0 [2024-08-05 21:05:05,006][52670] Decorrelating experience for 544 frames... [2024-08-05 21:05:05,163][52669] Initialized w:12 v:19 player:0 [2024-08-05 21:05:05,164][52669] Decorrelating experience for 608 frames... [2024-08-05 21:05:05,194][52663] Initialized w:4 v:19 player:0 [2024-08-05 21:05:05,195][52663] Decorrelating experience for 608 frames... [2024-08-05 21:05:05,372][52811] Using port 42116 on host... [2024-08-05 21:05:05,579][52820] Initialized w:19 v:16 player:0 [2024-08-05 21:05:05,580][52820] Decorrelating experience for 512 frames... [2024-08-05 21:05:05,693][52649] Using port 40417 on host... [2024-08-05 21:05:05,750][52659] Using port 40619 on host... [2024-08-05 21:05:05,762][52671] Using port 41419 on host... [2024-08-05 21:05:05,825][52665] Using port 41217 on host... [2024-08-05 21:05:05,937][52567] Heartbeat connected on RolloutWorker_w0 [2024-08-05 21:05:05,972][52567] Heartbeat connected on RolloutWorker_w8 [2024-08-05 21:05:06,175][52658] Using port 40519 on host... [2024-08-05 21:05:06,175][52667] Using port 41319 on host... [2024-08-05 21:05:06,280][52795] Using port 41916 on host... [2024-08-05 21:05:06,342][52803] Using port 42016 on host... [2024-08-05 21:05:06,346][52668] Initialized w:13 v:18 player:0 [2024-08-05 21:05:06,347][52668] Decorrelating experience for 576 frames... [2024-08-05 21:05:06,348][52660] Initialized w:5 v:18 player:0 [2024-08-05 21:05:06,349][52660] Decorrelating experience for 576 frames... [2024-08-05 21:05:06,350][52811] Initialized w:18 v:16 player:0 [2024-08-05 21:05:06,350][52811] Decorrelating experience for 512 frames... [2024-08-05 21:05:07,002][52671] Initialized w:11 v:19 player:0 [2024-08-05 21:05:07,003][52795] Initialized w:16 v:16 player:0 [2024-08-05 21:05:07,001][52659] Initialized w:3 v:19 player:0 [2024-08-05 21:05:07,006][52665] Initialized w:9 v:17 player:0 [2024-08-05 21:05:07,012][52659] Decorrelating experience for 608 frames... [2024-08-05 21:05:07,014][52795] Decorrelating experience for 512 frames... [2024-08-05 21:05:07,014][52665] Decorrelating experience for 544 frames... [2024-08-05 21:05:07,008][52649] Initialized w:1 v:17 player:0 [2024-08-05 21:05:07,011][52671] Decorrelating experience for 608 frames... [2024-08-05 21:05:07,018][52649] Decorrelating experience for 544 frames... [2024-08-05 21:05:07,019][52670] Using port 41718 on host... [2024-08-05 21:05:07,057][52803] Initialized w:17 v:16 player:0 [2024-08-05 21:05:07,058][52803] Decorrelating experience for 512 frames... [2024-08-05 21:05:07,209][52658] Initialized w:2 v:19 player:0 [2024-08-05 21:05:07,209][52667] Initialized w:10 v:19 player:0 [2024-08-05 21:05:07,219][52667] Decorrelating experience for 608 frames... [2024-08-05 21:05:07,219][52658] Decorrelating experience for 608 frames... [2024-08-05 21:05:07,441][52567] Heartbeat connected on RolloutWorker_w12 [2024-08-05 21:05:07,450][52666] Using port 40918 on host... [2024-08-05 21:05:07,527][52567] Heartbeat connected on RolloutWorker_w4 [2024-08-05 21:05:07,795][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 17.1. Samples: 520. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:07,968][52820] Using port 42217 on host... [2024-08-05 21:05:08,238][52795] Using port 41917 on host... [2024-08-05 21:05:08,369][52811] Using port 42117 on host... [2024-08-05 21:05:08,375][52660] Using port 40819 on host... [2024-08-05 21:05:08,376][52668] Using port 41619 on host... [2024-08-05 21:05:09,218][52665] Using port 41218 on host... [2024-08-05 21:05:09,219][52649] Using port 40418 on host... [2024-08-05 21:05:09,539][52567] Heartbeat connected on RolloutWorker_w11 [2024-08-05 21:05:09,549][52567] Heartbeat connected on RolloutWorker_w3 [2024-08-05 21:05:10,852][52820] Initialized w:19 v:17 player:0 [2024-08-05 21:05:10,856][52666] Initialized w:6 v:18 player:0 [2024-08-05 21:05:10,852][52670] Initialized w:14 v:18 player:0 [2024-08-05 21:05:10,887][52666] Decorrelating experience for 576 frames... [2024-08-05 21:05:10,887][52670] Decorrelating experience for 576 frames... [2024-08-05 21:05:10,888][52820] Decorrelating experience for 544 frames... [2024-08-05 21:05:12,810][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 14.7. Samples: 520. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:17,863][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 12.9. Samples: 520. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:22,959][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 11.5. Samples: 520. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:23,071][52811] Initialized w:18 v:17 player:0 [2024-08-05 21:05:23,178][52811] Decorrelating experience for 544 frames... [2024-08-05 21:05:23,176][52795] Initialized w:16 v:17 player:0 [2024-08-05 21:05:23,392][52795] Decorrelating experience for 544 frames... [2024-08-05 21:05:26,385][52660] Initialized w:5 v:19 player:0 [2024-08-05 21:05:27,194][52660] Decorrelating experience for 608 frames... [2024-08-05 21:05:27,612][52668] Initialized w:13 v:19 player:0 [2024-08-05 21:05:27,852][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 11.5. Samples: 520. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:27,810][52668] Decorrelating experience for 608 frames... [2024-08-05 21:05:35,642][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 10.9. Samples: 520. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:35,840][52803] Using port 42017 on host... [2024-08-05 21:05:35,968][52649] Initialized w:1 v:18 player:0 [2024-08-05 21:05:35,970][52649] Decorrelating experience for 576 frames... [2024-08-05 21:05:35,971][52665] Initialized w:9 v:18 player:0 [2024-08-05 21:05:35,972][52665] Decorrelating experience for 576 frames... [2024-08-05 21:05:36,823][52567] Heartbeat connected on RolloutWorker_w2 [2024-08-05 21:05:36,878][52567] Heartbeat connected on RolloutWorker_w10 [2024-08-05 21:05:37,131][52803] Initialized w:17 v:17 player:0 [2024-08-05 21:05:37,132][52803] Decorrelating experience for 544 frames... [2024-08-05 21:05:37,795][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 47.3. Samples: 2130. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:37,862][52820] Using port 42218 on host... [2024-08-05 21:05:38,080][52567] Heartbeat connected on RolloutWorker_w5 [2024-08-05 21:05:38,105][52666] Using port 40919 on host... [2024-08-05 21:05:38,153][52670] Using port 41719 on host... [2024-08-05 21:05:38,370][52567] Heartbeat connected on RolloutWorker_w13 [2024-08-05 21:05:38,525][52649] Using port 40419 on host... [2024-08-05 21:05:38,549][52665] Using port 41219 on host... [2024-08-05 21:05:38,860][52811] Using port 42118 on host... [2024-08-05 21:05:39,153][52666] Initialized w:6 v:19 player:0 [2024-08-05 21:05:39,153][52670] Initialized w:14 v:19 player:0 [2024-08-05 21:05:39,157][52666] Decorrelating experience for 608 frames... [2024-08-05 21:05:39,167][52795] Using port 41918 on host... [2024-08-05 21:05:39,168][52820] Initialized w:19 v:18 player:0 [2024-08-05 21:05:39,169][52820] Decorrelating experience for 576 frames... [2024-08-05 21:05:39,158][52670] Decorrelating experience for 608 frames... [2024-08-05 21:05:39,617][52614] Signal inference workers to stop experience collection... [2024-08-05 21:05:39,666][52650] InferenceWorker_p0-w0: stopping experience collection [2024-08-05 21:05:39,817][52803] Using port 42018 on host... [2024-08-05 21:05:39,996][52649] Initialized w:1 v:19 player:0 [2024-08-05 21:05:39,997][52665] Initialized w:9 v:19 player:0 [2024-08-05 21:05:39,998][52665] Decorrelating experience for 608 frames... [2024-08-05 21:05:39,999][52649] Decorrelating experience for 608 frames... [2024-08-05 21:05:40,259][52795] Initialized w:16 v:18 player:0 [2024-08-05 21:05:40,268][52795] Decorrelating experience for 576 frames... [2024-08-05 21:05:40,282][52811] Initialized w:18 v:18 player:0 [2024-08-05 21:05:40,282][52811] Decorrelating experience for 576 frames... [2024-08-05 21:05:40,492][52820] Using port 42219 on host... [2024-08-05 21:05:41,128][52567] Heartbeat connected on RolloutWorker_w6 [2024-08-05 21:05:41,147][52803] Initialized w:17 v:18 player:0 [2024-08-05 21:05:41,148][52803] Decorrelating experience for 576 frames... [2024-08-05 21:05:41,274][52567] Heartbeat connected on RolloutWorker_w14 [2024-08-05 21:05:42,437][52795] Using port 41919 on host... [2024-08-05 21:05:42,654][52811] Using port 42119 on host... [2024-08-05 21:05:42,670][52567] Heartbeat connected on RolloutWorker_w9 [2024-08-05 21:05:42,804][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 182.9. Samples: 8230. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:45,936][52820] Initialized w:19 v:19 player:0 [2024-08-05 21:05:46,024][52820] Decorrelating experience for 608 frames... [2024-08-05 21:05:47,838][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 182.8. Samples: 8230. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:48,220][52811] Initialized w:18 v:19 player:0 [2024-08-05 21:05:48,188][52795] Initialized w:16 v:19 player:0 [2024-08-05 21:05:48,789][52811] Decorrelating experience for 608 frames... [2024-08-05 21:05:48,792][52795] Decorrelating experience for 608 frames... [2024-08-05 21:05:52,810][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 171.3. Samples: 8230. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:05:56,757][52567] Heartbeat connected on RolloutWorker_w1 [2024-08-05 21:05:57,460][52803] Using port 42019 on host... [2024-08-05 21:05:57,838][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 171.2. Samples: 8230. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:06:04,568][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 0.0). Total num frames: 0. Throughput: 0: 165.1. Samples: 8230. Policy #0 lag: (min: -1.0, avg: -1.0, max: -1.0) [2024-08-05 21:06:04,747][52567] Heartbeat connected on RolloutWorker_w16 [2024-08-05 21:06:04,811][52567] Heartbeat connected on RolloutWorker_w18 [2024-08-05 21:06:04,868][52567] Heartbeat connected on RolloutWorker_w19 [2024-08-05 21:06:04,969][52803] Initialized w:17 v:19 player:0 [2024-08-05 21:06:04,970][52803] Decorrelating experience for 608 frames... [2024-08-05 21:06:05,700][52567] Heartbeat connected on RolloutWorker_w17 [2024-08-05 21:06:07,453][52614] Signal inference workers to resume experience collection... [2024-08-05 21:06:07,453][52650] InferenceWorker_p0-w0: resuming experience collection [2024-08-05 21:06:07,794][52567] Fps is (10 sec: 822.7, 60 sec: 136.5, 300 sec: 90.6). Total num frames: 8192. Throughput: 0: 171.5. Samples: 8230. Policy #0 lag: (min: 0.0, avg: 0.0, max: 0.0) [2024-08-05 21:06:12,421][52650] Updated weights for policy 0, policy_version 10 (0.0026) [2024-08-05 21:06:12,794][52567] Fps is (10 sec: 9958.3, 60 sec: 1365.7, 300 sec: 859.0). Total num frames: 81920. Throughput: 0: 556.6. Samples: 25540. Policy #0 lag: (min: 1.0, avg: 5.0, max: 8.0) [2024-08-05 21:06:17,797][52567] Fps is (10 sec: 13104.8, 60 sec: 2323.5, 300 sec: 1387.5). Total num frames: 139264. Throughput: 0: 862.7. Samples: 36890. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:06:19,346][52650] Updated weights for policy 0, policy_version 21 (0.0043) [2024-08-05 21:06:22,796][52567] Fps is (10 sec: 13107.3, 60 sec: 3552.7, 300 sec: 2021.4). Total num frames: 212992. Throughput: 0: 1233.8. Samples: 57650. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 21:06:25,470][52650] Updated weights for policy 0, policy_version 31 (0.0036) [2024-08-05 21:06:27,795][52567] Fps is (10 sec: 13928.2, 60 sec: 4646.1, 300 sec: 2523.6). Total num frames: 278528. Throughput: 0: 1538.9. Samples: 77470. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-05 21:06:27,804][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000034_278528.pth... [2024-08-05 21:06:32,796][52567] Fps is (10 sec: 10648.4, 60 sec: 5589.8, 300 sec: 2769.2). Total num frames: 319488. Throughput: 0: 1662.2. Samples: 83000. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 21:06:36,053][52650] Updated weights for policy 0, policy_version 41 (0.0108) [2024-08-05 21:06:37,812][52567] Fps is (10 sec: 6552.4, 60 sec: 5734.2, 300 sec: 2858.3). Total num frames: 344064. Throughput: 0: 1896.6. Samples: 93550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:06:42,814][52567] Fps is (10 sec: 5730.2, 60 sec: 6280.4, 300 sec: 3005.6). Total num frames: 376832. Throughput: 0: 1970.8. Samples: 96850. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:06:49,794][52567] Fps is (10 sec: 2738.5, 60 sec: 6082.8, 300 sec: 2847.5). Total num frames: 376832. Throughput: 0: 1960.9. Samples: 96850. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:06:57,864][52567] Fps is (10 sec: 0.0, 60 sec: 5792.6, 300 sec: 2683.2). Total num frames: 376832. Throughput: 0: 1769.9. Samples: 96850. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:06:57,868][52567] Fps is (10 sec: 0.0, 60 sec: 6277.3, 300 sec: 2683.2). Total num frames: 376832. Throughput: 0: 1582.1. Samples: 96850. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:07:01,763][52650] Updated weights for policy 0, policy_version 51 (0.0078) [2024-08-05 21:07:02,799][52567] Fps is (10 sec: 9967.7, 60 sec: 7315.9, 300 sec: 2930.3). Total num frames: 425984. Throughput: 0: 1581.2. Samples: 108040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:07:07,796][52567] Fps is (10 sec: 10727.8, 60 sec: 7918.8, 300 sec: 3214.2). Total num frames: 483328. Throughput: 0: 1557.8. Samples: 127750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:07:08,411][52650] Updated weights for policy 0, policy_version 61 (0.0057) [2024-08-05 21:07:12,794][52567] Fps is (10 sec: 14746.4, 60 sec: 8192.0, 300 sec: 3690.8). Total num frames: 573440. Throughput: 0: 1610.2. Samples: 149930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 21:07:13,207][52650] Updated weights for policy 0, policy_version 71 (0.0032) [2024-08-05 21:07:17,794][52567] Fps is (10 sec: 17204.5, 60 sec: 8601.9, 300 sec: 4086.5). Total num frames: 655360. Throughput: 0: 1758.3. Samples: 162120. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:07:18,364][52650] Updated weights for policy 0, policy_version 81 (0.0019) [2024-08-05 21:07:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 8738.1, 300 sec: 4458.4). Total num frames: 737280. Throughput: 0: 2108.8. Samples: 188440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 21:07:22,851][52650] Updated weights for policy 0, policy_version 91 (0.0011) [2024-08-05 21:07:26,120][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:07:27,593][52650] Updated weights for policy 0, policy_version 101 (0.0013) [2024-08-05 21:07:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 9147.8, 300 sec: 4856.4). Total num frames: 827392. Throughput: 0: 2635.8. Samples: 215440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:07:31,902][52650] Updated weights for policy 0, policy_version 111 (0.0018) [2024-08-05 21:07:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 9967.1, 300 sec: 5231.8). Total num frames: 917504. Throughput: 0: 3076.5. Samples: 229240. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 21:07:36,565][52650] Updated weights for policy 0, policy_version 121 (0.0019) [2024-08-05 21:07:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 11059.6, 300 sec: 5586.4). Total num frames: 1007616. Throughput: 0: 4001.9. Samples: 256650. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:07:40,991][52650] Updated weights for policy 0, policy_version 131 (0.0012) [2024-08-05 21:07:42,794][52567] Fps is (10 sec: 18841.5, 60 sec: 12153.2, 300 sec: 5966.0). Total num frames: 1105920. Throughput: 0: 4176.4. Samples: 284480. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:07:45,215][52650] Updated weights for policy 0, policy_version 141 (0.0027) [2024-08-05 21:07:47,794][52567] Fps is (10 sec: 18841.9, 60 sec: 14116.4, 300 sec: 6282.7). Total num frames: 1196032. Throughput: 0: 4226.7. Samples: 298240. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-05 21:07:49,893][52650] Updated weights for policy 0, policy_version 151 (0.0022) [2024-08-05 21:07:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 16553.8, 300 sec: 6583.1). Total num frames: 1286144. Throughput: 0: 4395.6. Samples: 325550. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:07:52,826][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:07:54,420][52650] Updated weights for policy 0, policy_version 161 (0.0013) [2024-08-05 21:07:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16677.5, 300 sec: 6868.6). Total num frames: 1376256. Throughput: 0: 4502.5. Samples: 352540. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 21:07:58,757][52650] Updated weights for policy 0, policy_version 171 (0.0012) [2024-08-05 21:08:02,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17339.9, 300 sec: 7140.1). Total num frames: 1466368. Throughput: 0: 4550.7. Samples: 366900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:08:03,351][52650] Updated weights for policy 0, policy_version 181 (0.0011) [2024-08-05 21:08:07,482][52650] Updated weights for policy 0, policy_version 191 (0.0012) [2024-08-05 21:08:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 18022.6, 300 sec: 7437.7). Total num frames: 1564672. Throughput: 0: 4571.6. Samples: 394160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:08:12,377][52650] Updated weights for policy 0, policy_version 201 (0.0017) [2024-08-05 21:08:12,794][52567] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 7683.4). Total num frames: 1654784. Throughput: 0: 4572.0. Samples: 421180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:08:16,892][52650] Updated weights for policy 0, policy_version 211 (0.0013) [2024-08-05 21:08:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 18158.9, 300 sec: 7918.0). Total num frames: 1744896. Throughput: 0: 4574.4. Samples: 435090. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 21:08:21,569][52650] Updated weights for policy 0, policy_version 221 (0.0020) [2024-08-05 21:08:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 18295.5, 300 sec: 8142.2). Total num frames: 1835008. Throughput: 0: 4547.1. Samples: 461270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:08:26,373][52650] Updated weights for policy 0, policy_version 231 (0.0031) [2024-08-05 21:08:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 18022.4, 300 sec: 8285.5). Total num frames: 1908736. Throughput: 0: 4471.3. Samples: 485690. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 21:08:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000233_1908736.pth... [2024-08-05 21:08:31,442][52650] Updated weights for policy 0, policy_version 241 (0.0030) [2024-08-05 21:08:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 18022.4, 300 sec: 8492.4). Total num frames: 1998848. Throughput: 0: 4442.7. Samples: 498160. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:08:36,276][52650] Updated weights for policy 0, policy_version 251 (0.0022) [2024-08-05 21:08:37,795][52567] Fps is (10 sec: 15564.8, 60 sec: 17612.8, 300 sec: 8588.4). Total num frames: 2064384. Throughput: 0: 4369.1. Samples: 522160. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:08:42,794][52567] Fps is (10 sec: 13107.2, 60 sec: 17066.7, 300 sec: 8680.4). Total num frames: 2129920. Throughput: 0: 4192.4. Samples: 541200. Policy #0 lag: (min: 0.0, avg: 2.3, max: 8.0) [2024-08-05 21:08:43,359][52650] Updated weights for policy 0, policy_version 261 (0.0068) [2024-08-05 21:08:47,795][52567] Fps is (10 sec: 13106.8, 60 sec: 16657.0, 300 sec: 8768.8). Total num frames: 2195456. Throughput: 0: 4127.5. Samples: 552640. Policy #0 lag: (min: 0.0, avg: 3.6, max: 6.0) [2024-08-05 21:08:49,695][52650] Updated weights for policy 0, policy_version 271 (0.0045) [2024-08-05 21:08:49,837][52794] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:08:49,845][52794] Sum rewards: -7.998, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.604', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.012', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.090', 'AMMO3': '0.144', 'WEAPON3': '0.750', 'weapon2': '0.860', 'weapon3': '1.178'} [2024-08-05 21:08:50,722][52662] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:08:52,795][52567] Fps is (10 sec: 11468.4, 60 sec: 15974.4, 300 sec: 8789.6). Total num frames: 2244608. Throughput: 0: 3825.1. Samples: 566290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:08:52,802][52567] Avg episode reward: [(0, '-5.985')] [2024-08-05 21:08:52,804][52614] Saving new best policy, reward=-5.985! [2024-08-05 21:08:53,969][52665] DAMAGECOUNT value on done: 34.0 [2024-08-05 21:08:53,998][52794] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:08:54,794][52662] DAMAGECOUNT value on done: 34.0 [2024-08-05 21:08:54,805][52662] Sum rewards: -14.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.892', 'FRAGCOUNT': '-1.500', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.010', 'HITCOUNT': '0.030', 'AMMO4': '0.052', 'weapon4': '0.088', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon3': '0.420', 'ARMOR': '0.512', 'WEAPON3': '0.900', 'weapon2': '1.366'} [2024-08-05 21:08:55,259][52649] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:08:55,261][52649] Sum rewards: -10.823, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.239', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.015', 'ARMOR': '0.020', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'DAMAGECOUNT': '0.075', 'weapon4': '0.080', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon3': '0.690', 'WEAPON3': '0.950', 'weapon2': '1.030'} [2024-08-05 21:08:55,300][52647] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:08:56,742][52668] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:08:56,756][52668] Sum rewards: -7.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.568', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon5': '0.018', 'ARMOR': '0.028', 'HITCOUNT': '0.040', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.150', 'AMMO3': '0.174', 'weapon3': '0.870', 'WEAPON3': '0.950', 'weapon2': '0.952', 'FRAGCOUNT': '1.000'} [2024-08-05 21:08:57,795][52567] Fps is (10 sec: 9830.4, 60 sec: 15291.6, 300 sec: 8809.6). Total num frames: 2293760. Throughput: 0: 3535.5. Samples: 580280. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:08:57,796][52567] Avg episode reward: [(0, '-6.197')] [2024-08-05 21:08:57,873][52660] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:08:58,222][52665] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:08:58,483][52667] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:08:59,125][52650] Updated weights for policy 0, policy_version 281 (0.0033) [2024-08-05 21:08:59,397][52649] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:08:59,408][52649] Sum rewards: -7.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.482', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.027', 'HITCOUNT': '0.040', 'ARMOR': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'weapon4': '0.158', 'AMMO3': '0.179', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.300', 'weapon3': '0.702', 'WEAPON3': '0.900', 'weapon2': '0.978', 'FRAGCOUNT': '1.000'} [2024-08-05 21:08:59,600][52658] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:08:59,601][52658] Sum rewards: -6.831, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.732', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.069', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.650', 'weapon3': '0.926', 'FRAGCOUNT': '1.000', 'weapon2': '1.138'} [2024-08-05 21:09:00,152][52794] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:09:00,668][52664] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:09:01,037][52662] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:01,270][52647] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:09:01,946][52665] DAMAGECOUNT value on done: 14.0 [2024-08-05 21:09:02,380][52668] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:02,389][52667] DAMAGECOUNT value on done: 94.0 [2024-08-05 21:09:02,525][52669] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:02,527][52669] Sum rewards: -4.498, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.012', 'AMMO2': '0.016', 'HITCOUNT': '0.050', 'AMMO3': '0.062', 'AMMO4': '0.079', 'ARMOR': '0.096', 'DAMAGECOUNT': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.254', 'WEAPON3': '0.350', 'weapon3': '0.454', 'FRAGCOUNT': '1.000', 'weapon2': '1.094'} [2024-08-05 21:09:02,794][52567] Fps is (10 sec: 9011.5, 60 sec: 14472.5, 300 sec: 8798.0). Total num frames: 2334720. Throughput: 0: 3367.6. Samples: 586630. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:09:02,794][52567] Avg episode reward: [(0, '-5.639')] [2024-08-05 21:09:02,795][52614] Saving new best policy, reward=-5.639! [2024-08-05 21:09:02,935][52658] DAMAGECOUNT value on done: 17.0 [2024-08-05 21:09:02,945][52649] DAMAGECOUNT value on done: 29.0 [2024-08-05 21:09:04,008][52671] DAMAGECOUNT value on done: 109.0 [2024-08-05 21:09:04,016][52663] DAMAGECOUNT value on done: 290.0 [2024-08-05 21:09:04,029][52663] Sum rewards: -3.570, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.124', 'AMMO3': '0.145', 'HITCOUNT': '0.190', 'WEAPON3': '0.800', 'weapon3': '0.808', 'DAMAGECOUNT': '0.870', 'weapon2': '0.946', 'FRAGCOUNT': '4.000'} [2024-08-05 21:09:04,396][52659] DAMAGECOUNT value on done: 14.0 [2024-08-05 21:09:04,668][52794] DAMAGECOUNT value on done: 85.0 [2024-08-05 21:09:05,166][52660] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:05,569][52662] DAMAGECOUNT value on done: 17.0 [2024-08-05 21:09:06,077][52664] DAMAGECOUNT value on done: 57.0 [2024-08-05 21:09:06,090][52664] Sum rewards: -6.234, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.288', 'AMMO2': '0.010', 'weapon4': '0.026', 'HITCOUNT': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.171', 'weapon3': '0.498', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.304'} [2024-08-05 21:09:06,778][52665] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:06,780][52667] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:06,785][52667] Sum rewards: -4.079, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.570', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'HITCOUNT': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.056', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.101', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon3': '0.960', 'FRAGCOUNT': '1.000', 'weapon2': '1.004'} [2024-08-05 21:09:07,781][52650] Updated weights for policy 0, policy_version 291 (0.0028) [2024-08-05 21:09:07,794][52658] DAMAGECOUNT value on done: 94.0 [2024-08-05 21:09:07,797][52567] Fps is (10 sec: 9009.5, 60 sec: 13652.8, 300 sec: 8817.0). Total num frames: 2383872. Throughput: 0: 3111.6. Samples: 601300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 21:09:07,797][52567] Avg episode reward: [(0, '-5.202')] [2024-08-05 21:09:07,804][52614] Saving new best policy, reward=-5.202! [2024-08-05 21:09:07,991][52649] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:09:08,162][52647] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:09:08,166][52647] Sum rewards: -8.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO2': '0.016', 'HITCOUNT': '0.070', 'AMMO4': '0.081', 'AMMO3': '0.144', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.750', 'weapon3': '0.910', 'FRAGCOUNT': '1.000', 'weapon2': '1.006'} [2024-08-05 21:09:08,802][52669] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:09,480][52671] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:09,623][52659] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:09,896][52668] DAMAGECOUNT value on done: 85.0 [2024-08-05 21:09:09,905][52668] Sum rewards: -5.171, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.222', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.052', 'HITCOUNT': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.119', 'DAMAGECOUNT': '0.255', 'weapon3': '0.638', 'WEAPON3': '0.650', 'weapon2': '1.134', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:10,177][52794] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:10,838][52663] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:11,269][52660] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:11,459][52665] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:11,466][52665] Sum rewards: -4.942, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.814', 'WEAPON1': '0.020', 'HITCOUNT': '0.030', 'AMMO2': '0.033', 'AMMO3': '0.094', 'DAMAGECOUNT': '0.105', 'weapon4': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon3': '0.864', 'FRAGCOUNT': '1.000', 'weapon2': '1.060'} [2024-08-05 21:09:11,873][52662] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:11,925][52666] DAMAGECOUNT value on done: 4.0 [2024-08-05 21:09:12,256][52670] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:12,427][52649] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:12,428][52649] Sum rewards: -8.199, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO4': '0.012', 'weapon5': '0.016', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON3': '0.800', 'weapon3': '0.842', 'FRAGCOUNT': '1.000', 'weapon2': '1.068'} [2024-08-05 21:09:12,499][52664] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:12,795][52567] Fps is (10 sec: 9011.2, 60 sec: 12834.1, 300 sec: 8805.7). Total num frames: 2424832. Throughput: 0: 2849.6. Samples: 613920. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 21:09:12,795][52567] Avg episode reward: [(0, '-5.161')] [2024-08-05 21:09:12,796][52614] Saving new best policy, reward=-5.161! [2024-08-05 21:09:13,394][52667] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:13,574][52647] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:09:13,579][52647] Sum rewards: -7.907, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'ARMOR': '0.024', 'AMMO2': '0.026', 'weapon5': '0.038', 'HITCOUNT': '0.040', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.144', 'weapon4': '0.166', 'WEAPON4': '0.300', 'weapon3': '0.602', 'WEAPON3': '0.650', 'weapon2': '1.180'} [2024-08-05 21:09:13,789][52669] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:09:13,953][52658] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:09:13,954][52658] Sum rewards: -6.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.658', 'AMMO5': '0.010', 'AMMO2': '0.021', 'HITCOUNT': '0.050', 'weapon5': '0.058', 'AMMO4': '0.107', 'AMMO3': '0.108', 'weapon4': '0.142', 'DAMAGECOUNT': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon3': '0.656', 'ARMOR': '0.864', 'FRAGCOUNT': '1.000', 'weapon2': '1.086'} [2024-08-05 21:09:14,668][52665] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:14,838][52663] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:09:14,839][52663] Sum rewards: -3.906, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.024', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.119', 'AMMO3': '0.141', 'weapon4': '0.182', 'DAMAGECOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon3': '0.814', 'weapon2': '0.988', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:14,977][52668] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:15,065][52794] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:15,208][52671] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:09:15,209][52671] Sum rewards: -6.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.140', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon5': '0.020', 'weapon4': '0.020', 'WEAPON1': '0.040', 'ARMOR': '0.044', 'AMMO3': '0.082', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.350', 'weapon3': '0.694', 'FRAGCOUNT': '1.000', 'weapon2': '1.272'} [2024-08-05 21:09:15,278][52649] DAMAGECOUNT value on done: 74.0 [2024-08-05 21:09:15,279][52649] Sum rewards: -6.027, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.930', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'ARMOR': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.194', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.500', 'weapon3': '0.830', 'weapon2': '1.026'} [2024-08-05 21:09:15,311][52659] DAMAGECOUNT value on done: 39.0 [2024-08-05 21:09:15,808][52662] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:15,821][52660] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:09:15,821][52660] Sum rewards: -3.206, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HEALTH': '0.025', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO4': '0.085', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'weapon3': '0.792', 'weapon2': '0.956', 'FRAGCOUNT': '1.000'} [2024-08-05 21:09:15,934][52650] Updated weights for policy 0, policy_version 301 (0.0049) [2024-08-05 21:09:16,151][52666] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:16,361][52670] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:16,521][52664] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:16,766][52667] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:09:16,934][52647] DAMAGECOUNT value on done: 27.0 [2024-08-05 21:09:17,073][52658] DAMAGECOUNT value on done: 153.0 [2024-08-05 21:09:17,073][52658] Sum rewards: -5.106, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.398', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.052', 'AMMO4': '0.067', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.459', 'WEAPON3': '0.700', 'weapon2': '0.884', 'weapon3': '0.982', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:17,125][52669] DAMAGECOUNT value on done: 245.0 [2024-08-05 21:09:17,125][52669] Sum rewards: -9.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.728', 'AMMO2': '0.019', 'ARMOR': '0.032', 'weapon4': '0.076', 'AMMO4': '0.095', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon3': '0.666', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.008'} [2024-08-05 21:09:17,460][52665] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:17,794][52567] Fps is (10 sec: 11471.3, 60 sec: 12561.1, 300 sec: 8911.6). Total num frames: 2498560. Throughput: 0: 2799.6. Samples: 624140. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:09:17,795][52567] Avg episode reward: [(0, '-5.077')] [2024-08-05 21:09:17,798][52614] Saving new best policy, reward=-5.077! [2024-08-05 21:09:18,011][52649] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:18,081][52671] DAMAGECOUNT value on done: 334.0 [2024-08-05 21:09:18,081][52671] Sum rewards: -4.330, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.220', 'AMMO2': '0.005', 'AMMO5': '0.008', 'weapon5': '0.018', 'AMMO4': '0.022', 'ARMOR': '0.052', 'weapon4': '0.054', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon3': '0.570', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.002', 'weapon2': '1.060', 'FRAGCOUNT': '3.000'} [2024-08-05 21:09:18,117][52659] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:18,118][52659] Sum rewards: -8.545, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.508', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.024', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.087', 'DAMAGECOUNT': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'ARMOR': '0.544', 'weapon3': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.086'} [2024-08-05 21:09:18,141][52668] DAMAGECOUNT value on done: 102.0 [2024-08-05 21:09:18,145][52668] Sum rewards: -6.145, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.573', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.022', 'weapon5': '0.024', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon4': '0.174', 'DAMAGECOUNT': '0.306', 'WEAPON3': '0.700', 'weapon2': '0.832', 'weapon3': '0.934'} [2024-08-05 21:09:18,170][52663] DAMAGECOUNT value on done: 213.0 [2024-08-05 21:09:18,171][52663] Sum rewards: -2.797, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.330', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.190', 'ARMOR': '0.505', 'DAMAGECOUNT': '0.639', 'WEAPON3': '0.700', 'weapon2': '0.940', 'weapon3': '1.016', 'FRAGCOUNT': '3.000'} [2024-08-05 21:09:18,284][52794] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:18,776][52662] DAMAGECOUNT value on done: 38.0 [2024-08-05 21:09:18,946][52660] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:09:18,946][52660] Sum rewards: -6.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.465', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.020', 'AMMO4': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.070', 'AMMO3': '0.127', 'DAMAGECOUNT': '0.225', 'weapon3': '0.638', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.086'} [2024-08-05 21:09:19,076][52666] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:09:19,076][52666] Sum rewards: -8.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.020', 'weapon4': '0.038', 'ARMOR': '0.060', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.570', 'weapon3': '0.884', 'WEAPON3': '0.900', 'weapon2': '0.962'} [2024-08-05 21:09:19,268][52670] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:09:19,269][52670] Sum rewards: -2.367, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.560', 'ARMOR': '0.018', 'AMMO2': '0.026', 'HITCOUNT': '0.070', 'AMMO3': '0.098', 'AMMO4': '0.130', 'weapon4': '0.162', 'DAMAGECOUNT': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon3': '0.706', 'FRAGCOUNT': '1.000', 'weapon2': '1.082'} [2024-08-05 21:09:19,289][52664] DAMAGECOUNT value on done: 72.0 [2024-08-05 21:09:19,289][52664] Sum rewards: -7.820, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.361', 'AMMO5': '0.012', 'ARMOR': '0.012', 'HITCOUNT': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.068', 'weapon3': '0.080', 'weapon5': '0.138', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.216', 'WEAPON3': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.672', 'weapon2': '0.926'} [2024-08-05 21:09:19,586][52647] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:19,827][52667] DAMAGECOUNT value on done: 149.0 [2024-08-05 21:09:19,827][52667] Sum rewards: -6.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.865', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HITCOUNT': '0.030', 'weapon5': '0.034', 'AMMO4': '0.073', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.450', 'weapon3': '0.516', 'FRAGCOUNT': '1.000', 'weapon2': '1.128'} [2024-08-05 21:09:19,992][52658] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:20,171][52665] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:20,358][52650] Updated weights for policy 0, policy_version 311 (0.0038) [2024-08-05 21:09:20,586][52669] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:09:20,586][52669] Sum rewards: -4.845, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.028', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.085', 'ARMOR': '0.092', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon3': '0.424', 'DAMAGECOUNT': '0.435', 'FRAGCOUNT': '1.000', 'weapon2': '1.206'} [2024-08-05 21:09:20,716][52649] DAMAGECOUNT value on done: 52.0 [2024-08-05 21:09:21,033][52668] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:09:21,033][52668] Sum rewards: -6.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.176', 'ARMOR': '0.016', 'AMMO2': '0.019', 'HITCOUNT': '0.060', 'weapon4': '0.088', 'AMMO4': '0.096', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.550', 'weapon3': '0.584', 'FRAGCOUNT': '1.000', 'weapon2': '1.192'} [2024-08-05 21:09:21,068][52794] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:21,068][52794] Sum rewards: -10.228, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'HITCOUNT': '0.010', 'AMMO2': '0.011', 'weapon5': '0.012', 'DAMAGECOUNT': '0.045', 'AMMO4': '0.052', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.147', 'WEAPON3': '0.800', 'weapon3': '0.830', 'weapon2': '1.012'} [2024-08-05 21:09:21,186][52671] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:09:21,246][52659] DAMAGECOUNT value on done: 21.0 [2024-08-05 21:09:21,252][52811] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:21,311][52663] DAMAGECOUNT value on done: 140.0 [2024-08-05 21:09:21,318][52663] Sum rewards: -3.645, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.122', 'AMMO3': '0.133', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'weapon2': '0.908', 'FRAGCOUNT': '1.000', 'weapon3': '1.094'} [2024-08-05 21:09:21,347][52795] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:09:21,528][52662] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:21,610][52660] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:21,701][52666] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:21,991][52670] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:09:21,992][52670] Sum rewards: -10.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.092', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'weapon4': '0.074', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.547', 'weapon3': '0.790', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.182'} [2024-08-05 21:09:22,134][52664] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:22,137][52664] Sum rewards: -8.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.674', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'ARMOR': '0.040', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'weapon4': '0.130', 'AMMO3': '0.230', 'weapon3': '0.850', 'weapon2': '0.876', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.200'} [2024-08-05 21:09:22,346][52647] DAMAGECOUNT value on done: 117.0 [2024-08-05 21:09:22,348][52647] Sum rewards: -8.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO2': '0.011', 'ARMOR': '0.028', 'weapon4': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.198', 'DAMAGECOUNT': '0.351', 'weapon2': '0.846', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.300'} [2024-08-05 21:09:22,537][52665] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:22,602][52614] Signal inference workers to stop experience collection... (50 times) [2024-08-05 21:09:22,603][52614] Signal inference workers to resume experience collection... (50 times) [2024-08-05 21:09:22,689][52650] InferenceWorker_p0-w0: stopping experience collection (50 times) [2024-08-05 21:09:22,689][52650] InferenceWorker_p0-w0: resuming experience collection (50 times) [2024-08-05 21:09:22,691][52667] DAMAGECOUNT value on done: 29.0 [2024-08-05 21:09:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 12561.1, 300 sec: 9071.3). Total num frames: 2588672. Throughput: 0: 2844.9. Samples: 650180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:09:22,795][52567] Avg episode reward: [(0, '-5.117')] [2024-08-05 21:09:22,998][52658] DAMAGECOUNT value on done: 27.0 [2024-08-05 21:09:23,177][52649] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:23,721][52669] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:23,770][52803] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:09:24,185][52671] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:24,206][52659] DAMAGECOUNT value on done: 22.0 [2024-08-05 21:09:24,246][52794] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:24,318][52668] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:24,664][52662] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:24,720][52663] DAMAGECOUNT value on done: 129.0 [2024-08-05 21:09:24,726][52663] Sum rewards: -7.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'weapon5': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.500', 'weapon3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.144'} [2024-08-05 21:09:24,812][52820] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:24,822][52795] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:24,948][52660] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:24,948][52660] Sum rewards: -5.516, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.958', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.067', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon2': '0.760', 'weapon3': '0.914'} [2024-08-05 21:09:24,969][52811] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:25,086][52666] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:09:25,327][52665] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:25,428][52664] DAMAGECOUNT value on done: 80.0 [2024-08-05 21:09:25,433][52664] Sum rewards: -6.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.618', 'AMMO2': '0.019', 'HITCOUNT': '0.050', 'AMMO4': '0.095', 'weapon4': '0.102', 'AMMO3': '0.150', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.250', 'weapon3': '0.566', 'WEAPON3': '0.600', 'ARMOR': '0.884', 'FRAGCOUNT': '1.000', 'weapon2': '1.250'} [2024-08-05 21:09:25,469][52670] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:25,580][52647] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:25,738][52650] Updated weights for policy 0, policy_version 321 (0.0028) [2024-08-05 21:09:26,082][52667] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:09:26,083][52667] Sum rewards: -4.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.244', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'HITCOUNT': '0.100', 'AMMO3': '0.139', 'DAMAGECOUNT': '0.510', 'ARMOR': '0.521', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.020', 'weapon3': '1.056'} [2024-08-05 21:09:26,160][52649] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:26,162][52649] Sum rewards: -1.893, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.011', 'HITCOUNT': '0.040', 'AMMO4': '0.056', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON3': '0.500', 'weapon2': '0.914', 'FRAGCOUNT': '1.000', 'weapon3': '1.196'} [2024-08-05 21:09:26,379][52658] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:26,761][52794] DAMAGECOUNT value on done: 211.0 [2024-08-05 21:09:26,761][52794] Sum rewards: -9.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'DAMAGECOUNT': '0.633', 'weapon3': '0.656', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.176'} [2024-08-05 21:09:27,356][52803] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:09:27,356][52803] Sum rewards: -3.006, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.626', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.060', 'HITCOUNT': '0.060', 'AMMO3': '0.116', 'weapon4': '0.116', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'weapon3': '0.722', 'FRAGCOUNT': '1.000', 'weapon2': '1.064'} [2024-08-05 21:09:27,390][52668] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:27,450][52662] DAMAGECOUNT value on done: 32.0 [2024-08-05 21:09:27,503][52669] DAMAGECOUNT value on done: 200.0 [2024-08-05 21:09:27,511][52669] Sum rewards: -4.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO2': '0.016', 'AMMO4': '0.080', 'HITCOUNT': '0.110', 'ARMOR': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.270', 'DAMAGECOUNT': '0.600', 'weapon3': '0.770', 'WEAPON3': '0.800', 'weapon2': '0.828', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:27,595][52671] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:27,602][52659] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:09:27,604][52659] Sum rewards: -4.276, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.060', 'HITCOUNT': '0.080', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.164', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'weapon3': '0.710', 'FRAGCOUNT': '1.000', 'weapon2': '1.016'} [2024-08-05 21:09:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 12561.1, 300 sec: 9169.0). Total num frames: 2662400. Throughput: 0: 2937.6. Samples: 673390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:09:27,795][52567] Avg episode reward: [(0, '-5.145')] [2024-08-05 21:09:28,052][52660] DAMAGECOUNT value on done: 32.0 [2024-08-05 21:09:28,052][52660] Sum rewards: -5.008, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.028', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.151', 'WEAPON3': '0.750', 'weapon3': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.014'} [2024-08-05 21:09:28,223][52664] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:09:28,323][52795] DAMAGECOUNT value on done: 205.0 [2024-08-05 21:09:28,323][52795] Sum rewards: -4.780, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.570', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'WEAPON1': '0.020', 'AMMO3': '0.074', 'weapon5': '0.078', 'HITCOUNT': '0.080', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.615', 'weapon3': '0.806', 'FRAGCOUNT': '1.000', 'weapon2': '1.098'} [2024-08-05 21:09:28,326][52647] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:28,426][52663] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:28,427][52820] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:09:28,427][52820] Sum rewards: -6.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.263', 'AMMO2': '0.004', 'ARMOR': '0.016', 'AMMO4': '0.020', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.150', 'DAMAGECOUNT': '0.210', 'weapon3': '0.616', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.240'} [2024-08-05 21:09:28,539][52665] DAMAGECOUNT value on done: 36.0 [2024-08-05 21:09:28,541][52665] Sum rewards: -3.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.178', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO4': '0.022', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.050', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.108', 'weapon3': '0.424', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.412'} [2024-08-05 21:09:28,670][52666] DAMAGECOUNT value on done: 68.0 [2024-08-05 21:09:28,670][52666] Sum rewards: -8.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.614', 'AMMO5': '0.005', 'AMMO2': '0.019', 'HITCOUNT': '0.070', 'ARMOR': '0.072', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.204', 'weapon4': '0.208', 'weapon3': '0.596', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.072'} [2024-08-05 21:09:28,883][52811] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:29,197][52649] DAMAGECOUNT value on done: 76.0 [2024-08-05 21:09:29,228][52670] DAMAGECOUNT value on done: 31.0 [2024-08-05 21:09:29,340][52667] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:29,675][52658] DAMAGECOUNT value on done: 78.0 [2024-08-05 21:09:30,121][52668] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:09:30,121][52668] Sum rewards: -6.677, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.058', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'weapon3': '0.818', 'FRAGCOUNT': '1.000', 'weapon2': '1.208'} [2024-08-05 21:09:30,181][52794] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:30,182][52794] Sum rewards: -9.690, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.066', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon5': '0.040', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.165', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon3': '0.684', 'weapon2': '1.144'} [2024-08-05 21:09:30,528][52659] DAMAGECOUNT value on done: 155.0 [2024-08-05 21:09:30,529][52659] Sum rewards: -4.881, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.678', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.020', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.493', 'WEAPON3': '0.650', 'weapon3': '0.904', 'FRAGCOUNT': '1.000', 'weapon2': '1.138'} [2024-08-05 21:09:30,539][52671] DAMAGECOUNT value on done: 91.0 [2024-08-05 21:09:30,582][52650] Updated weights for policy 0, policy_version 331 (0.0027) [2024-08-05 21:09:30,630][52662] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:30,740][52803] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:30,740][52803] Sum rewards: -10.243, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.198', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.028', 'HITCOUNT': '0.030', 'ARMOR': '0.048', 'AMMO4': '0.076', 'DAMAGECOUNT': '0.090', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon3': '0.508', 'WEAPON3': '0.550', 'weapon2': '1.172'} [2024-08-05 21:09:30,758][52669] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:30,772][52660] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:31,179][52664] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:09:31,179][52664] Sum rewards: -8.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.638', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.058', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.390', 'weapon2': '0.696', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.314'} [2024-08-05 21:09:31,275][52647] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:09:31,397][52665] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:31,398][52665] Sum rewards: -2.647, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.013', 'HITCOUNT': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.072', 'ARMOR': '0.090', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.450', 'weapon3': '0.926', 'FRAGCOUNT': '1.000', 'weapon2': '1.056'} [2024-08-05 21:09:31,531][52663] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:31,532][52663] Sum rewards: -4.659, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.460', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO5': '0.017', 'HITCOUNT': '0.040', 'AMMO4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon3': '0.902', 'weapon2': '0.920'} [2024-08-05 21:09:31,688][52795] DAMAGECOUNT value on done: 120.0 [2024-08-05 21:09:31,689][52795] Sum rewards: -7.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.662', 'AMMO2': '0.022', 'weapon4': '0.024', 'HITCOUNT': '0.060', 'AMMO4': '0.108', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.444', 'weapon3': '0.718', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.042'} [2024-08-05 21:09:31,918][52666] DAMAGECOUNT value on done: 49.0 [2024-08-05 21:09:32,163][52649] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:09:32,279][52811] DAMAGECOUNT value on done: 215.0 [2024-08-05 21:09:32,279][52811] Sum rewards: -4.208, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.635', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'ARMOR': '0.064', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.170', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'weapon3': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.224'} [2024-08-05 21:09:32,308][52667] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:32,312][52820] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:32,463][52670] DAMAGECOUNT value on done: 29.0 [2024-08-05 21:09:32,763][52658] DAMAGECOUNT value on done: 76.0 [2024-08-05 21:09:32,798][52567] Fps is (10 sec: 15558.9, 60 sec: 12423.7, 300 sec: 9302.7). Total num frames: 2744320. Throughput: 0: 2954.0. Samples: 685580. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:09:32,804][52567] Avg episode reward: [(0, '-5.457')] [2024-08-05 21:09:33,084][52668] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:09:33,632][52660] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:33,687][52794] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:33,986][52671] DAMAGECOUNT value on done: 201.0 [2024-08-05 21:09:34,005][52671] Sum rewards: -1.213, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.442', 'AMMO2': '0.011', 'ARMOR': '0.044', 'AMMO4': '0.053', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.138', 'HITCOUNT': '0.160', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.603', 'weapon2': '0.960', 'weapon3': '0.978', 'FRAGCOUNT': '1.000'} [2024-08-05 21:09:34,099][52659] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:09:34,311][52803] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:09:34,313][52803] Sum rewards: -8.450, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.756', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.044', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.074', 'AMMO3': '0.079', 'AMMO4': '0.109', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon3': '0.546', 'weapon2': '1.298'} [2024-08-05 21:09:34,391][52665] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:09:34,392][52665] Sum rewards: -5.873, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.075', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'HITCOUNT': '0.080', 'AMMO3': '0.113', 'AMMO4': '0.129', 'weapon4': '0.168', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.600', 'weapon3': '0.806', 'FRAGCOUNT': '1.000', 'weapon2': '1.148'} [2024-08-05 21:09:34,397][52662] DAMAGECOUNT value on done: 139.0 [2024-08-05 21:09:34,407][52662] Sum rewards: -8.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.252', 'weapon5': '0.004', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.018', 'ARMOR': '0.052', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'DAMAGECOUNT': '0.417', 'weapon2': '0.834', 'FRAGCOUNT': '1.000', 'weapon3': '1.084', 'WEAPON3': '1.200'} [2024-08-05 21:09:34,419][52669] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:34,624][52664] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:34,752][52647] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:09:34,753][52647] Sum rewards: -6.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.928', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.074', 'AMMO4': '0.110', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.428', 'WEAPON3': '0.750', 'weapon3': '0.908', 'FRAGCOUNT': '1.000', 'weapon2': '1.118'} [2024-08-05 21:09:35,409][52649] DAMAGECOUNT value on done: 280.0 [2024-08-05 21:09:35,415][52649] Sum rewards: -3.711, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.114', 'HITCOUNT': '0.170', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.840', 'weapon3': '1.000', 'weapon2': '1.106', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:35,423][52663] DAMAGECOUNT value on done: 90.0 [2024-08-05 21:09:35,427][52663] Sum rewards: -6.014, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.877', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.076', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.123', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.503', 'WEAPON3': '0.650', 'weapon3': '0.732', 'FRAGCOUNT': '1.000', 'weapon2': '1.142'} [2024-08-05 21:09:35,567][52795] DAMAGECOUNT value on done: 137.0 [2024-08-05 21:09:35,583][52795] Sum rewards: -6.337, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO2': '0.016', 'weapon4': '0.076', 'AMMO4': '0.080', 'AMMO3': '0.125', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.650', 'weapon2': '0.894', 'weapon3': '1.140', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:35,873][52667] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:36,210][52666] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:36,278][52650] Updated weights for policy 0, policy_version 341 (0.0042) [2024-08-05 21:09:36,392][52658] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:09:36,396][52658] Sum rewards: -6.945, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.238', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.034', 'ARMOR': '0.052', 'AMMO4': '0.052', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.144', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.700', 'weapon3': '0.830', 'weapon2': '0.970'} [2024-08-05 21:09:36,803][52670] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:36,808][52670] Sum rewards: -8.504, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.292', 'HITCOUNT': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.013', 'DAMAGECOUNT': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.032', 'AMMO4': '0.060', 'ARMOR': '0.067', 'weapon5': '0.076', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'weapon2': '0.766', 'weapon3': '1.102'} [2024-08-05 21:09:36,877][52820] DAMAGECOUNT value on done: 128.0 [2024-08-05 21:09:36,878][52820] Sum rewards: -6.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.309', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.057', 'ARMOR': '0.064', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.100', 'weapon4': '0.168', 'WEAPON3': '0.200', 'WEAPON4': '0.300', 'weapon3': '0.304', 'DAMAGECOUNT': '0.384', 'weapon2': '1.444', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:37,080][52811] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:37,081][52811] Sum rewards: -5.996, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.165', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.036', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'ARMOR': '0.132', 'AMMO3': '0.159', 'DAMAGECOUNT': '0.195', 'weapon3': '0.636', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.320'} [2024-08-05 21:09:37,132][52668] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:37,360][52665] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:37,442][52794] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:37,602][52669] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:37,794][52567] Fps is (10 sec: 14745.4, 60 sec: 12424.5, 300 sec: 9524.9). Total num frames: 2809856. Throughput: 0: 3120.0. Samples: 706690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:09:37,795][52567] Avg episode reward: [(0, '-5.532')] [2024-08-05 21:09:37,991][52649] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:38,026][52660] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:38,016][52671] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:38,035][52659] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:38,220][52662] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:38,366][52803] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:39,113][52664] DAMAGECOUNT value on done: 215.0 [2024-08-05 21:09:39,118][52664] Sum rewards: -10.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.444', 'AMMO2': '0.008', 'weapon4': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.179', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.850', 'weapon3': '0.888', 'FRAGCOUNT': '1.000', 'weapon2': '1.302'} [2024-08-05 21:09:39,196][52647] DAMAGECOUNT value on done: 117.0 [2024-08-05 21:09:39,199][52647] Sum rewards: -5.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.610', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'ARMOR': '0.020', 'weapon4': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.056', 'HITCOUNT': '0.080', 'AMMO3': '0.147', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.351', 'WEAPON3': '0.700', 'weapon3': '0.998', 'FRAGCOUNT': '1.000', 'weapon2': '1.008'} [2024-08-05 21:09:39,512][52795] DAMAGECOUNT value on done: 28.0 [2024-08-05 21:09:39,695][52667] DAMAGECOUNT value on done: 79.0 [2024-08-05 21:09:39,810][52663] DAMAGECOUNT value on done: 112.0 [2024-08-05 21:09:39,814][52663] Sum rewards: -6.390, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.875', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'HITCOUNT': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.073', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.350', 'weapon4': '0.356', 'weapon3': '0.472', 'weapon2': '1.094'} [2024-08-05 21:09:39,870][52666] DAMAGECOUNT value on done: 146.0 [2024-08-05 21:09:39,873][52666] Sum rewards: -4.683, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.172', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.145', 'DAMAGECOUNT': '0.438', 'ARMOR': '0.493', 'WEAPON3': '0.750', 'weapon3': '0.994', 'weapon2': '1.070', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:40,247][52658] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:40,255][52658] Sum rewards: -10.486, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.600', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.027', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.060', 'ARMOR': '0.080', 'AMMO3': '0.105', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.350', 'weapon3': '0.554', 'WEAPON3': '0.600', 'weapon2': '1.054'} [2024-08-05 21:09:40,480][52665] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:09:40,481][52665] Sum rewards: -7.466, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.988', 'AMMO2': '0.005', 'AMMO4': '0.026', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.139', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.750', 'weapon2': '0.856', 'FRAGCOUNT': '1.000', 'weapon3': '1.096'} [2024-08-05 21:09:40,486][52670] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:40,636][52668] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:09:40,637][52668] Sum rewards: -4.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.886', 'AMMO2': '0.029', 'HITCOUNT': '0.040', 'AMMO3': '0.089', 'ARMOR': '0.105', 'DAMAGECOUNT': '0.120', 'weapon4': '0.128', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon3': '0.572', 'weapon2': '1.196', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:41,160][52660] DAMAGECOUNT value on done: 14.0 [2024-08-05 21:09:41,376][52811] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:41,394][52649] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:41,540][52820] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:09:41,547][52820] Sum rewards: -6.102, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.832', 'AMMO2': '0.013', 'ARMOR': '0.024', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.098', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.500', 'weapon3': '0.626', 'FRAGCOUNT': '1.000', 'weapon2': '1.096'} [2024-08-05 21:09:41,886][52794] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:09:41,898][52659] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:09:41,902][52659] Sum rewards: -10.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.930', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'HITCOUNT': '0.060', 'ARMOR': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.650', 'weapon3': '0.712', 'FRAGCOUNT': '1.000', 'weapon2': '1.342'} [2024-08-05 21:09:41,917][52671] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:09:42,122][52669] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:42,129][52669] Sum rewards: -4.985, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'HITCOUNT': '0.010', 'weapon5': '0.016', 'WEAPON1': '0.030', 'DAMAGECOUNT': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON3': '0.500', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '1.020'} [2024-08-05 21:09:42,671][52666] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:09:42,680][52666] Sum rewards: -6.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.013', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.510', 'weapon2': '0.730', 'WEAPON3': '0.950', 'weapon3': '1.328', 'FRAGCOUNT': '3.000'} [2024-08-05 21:09:42,701][52662] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:42,702][52650] Updated weights for policy 0, policy_version 351 (0.0047) [2024-08-05 21:09:42,795][52567] Fps is (10 sec: 13110.9, 60 sec: 12424.3, 300 sec: 9747.1). Total num frames: 2875392. Throughput: 0: 3252.0. Samples: 726620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:09:42,795][52567] Avg episode reward: [(0, '-5.687')] [2024-08-05 21:09:42,822][52803] DAMAGECOUNT value on done: 111.0 [2024-08-05 21:09:42,822][52803] Sum rewards: -8.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.092', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.058', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.333', 'weapon3': '0.770', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.044'} [2024-08-05 21:09:43,140][52670] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:43,338][52663] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:43,342][52663] Sum rewards: -7.489, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.023', 'weapon4': '0.024', 'ARMOR': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON3': '0.500', 'weapon3': '0.878', 'weapon2': '1.246'} [2024-08-05 21:09:43,420][52664] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:43,538][52647] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:43,543][52647] Sum rewards: -8.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.090', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.165', 'AMMO3': '0.193', 'weapon3': '0.802', 'WEAPON3': '0.950', 'weapon2': '0.956', 'FRAGCOUNT': '1.000'} [2024-08-05 21:09:43,722][52665] DAMAGECOUNT value on done: 129.0 [2024-08-05 21:09:43,723][52665] Sum rewards: -4.022, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.021', 'ARMOR': '0.052', 'AMMO3': '0.097', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.250', 'weapon4': '0.260', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.550', 'weapon2': '0.876', 'weapon3': '0.946', 'FRAGCOUNT': '1.000'} [2024-08-05 21:09:43,765][52667] DAMAGECOUNT value on done: 194.0 [2024-08-05 21:09:43,767][52667] Sum rewards: -2.138, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.024', 'ARMOR': '0.065', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'HITCOUNT': '0.130', 'weapon4': '0.134', 'AMMO3': '0.141', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.582', 'weapon2': '0.744', 'WEAPON3': '0.800', 'weapon3': '1.128', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:44,154][52795] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:44,295][52668] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:44,448][52658] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:44,970][52660] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:44,984][52660] Sum rewards: -9.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.429', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon7': '0.024', 'AMMO4': '0.043', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.898', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.114'} [2024-08-05 21:09:45,014][52794] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:09:45,016][52794] Sum rewards: -1.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.770', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon5': '0.020', 'AMMO4': '0.053', 'AMMO3': '0.115', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '0.670', 'weapon3': '1.212', 'FRAGCOUNT': '3.000'} [2024-08-05 21:09:45,043][52649] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:45,043][52649] Sum rewards: -4.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.684', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.038', 'HITCOUNT': '0.070', 'AMMO4': '0.076', 'weapon4': '0.076', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.195', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.750', 'weapon2': '0.856', 'weapon3': '0.980', 'FRAGCOUNT': '1.000'} [2024-08-05 21:09:45,048][52811] DAMAGECOUNT value on done: 37.0 [2024-08-05 21:09:45,166][52820] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:45,480][52666] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:09:45,694][52662] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:45,816][52670] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:46,020][52669] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:46,437][52671] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:09:46,448][52671] Sum rewards: -1.830, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.120', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.072', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.400', 'weapon2': '0.854', 'weapon3': '1.234', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:46,464][52659] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:09:46,861][52663] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:47,454][52664] DAMAGECOUNT value on done: 49.0 [2024-08-05 21:09:47,465][52803] DAMAGECOUNT value on done: 80.0 [2024-08-05 21:09:47,501][52647] DAMAGECOUNT value on done: 82.0 [2024-08-05 21:09:47,766][52665] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:09:47,795][52567] Fps is (10 sec: 13926.2, 60 sec: 12561.1, 300 sec: 9997.0). Total num frames: 2949120. Throughput: 0: 3338.2. Samples: 736850. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:09:47,795][52567] Avg episode reward: [(0, '-5.826')] [2024-08-05 21:09:47,875][52667] DAMAGECOUNT value on done: 4.0 [2024-08-05 21:09:47,872][52666] DAMAGECOUNT value on done: 21.0 [2024-08-05 21:09:48,033][52668] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:48,120][52795] DAMAGECOUNT value on done: 102.0 [2024-08-05 21:09:48,122][52795] Sum rewards: -7.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.848', 'AMMO2': '0.016', 'AMMO4': '0.077', 'HITCOUNT': '0.080', 'AMMO3': '0.113', 'weapon4': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.306', 'WEAPON3': '0.550', 'weapon3': '0.756', 'FRAGCOUNT': '1.000', 'weapon2': '1.076'} [2024-08-05 21:09:48,277][52670] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:48,449][52649] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:09:48,479][52658] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:48,745][52660] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:48,753][52660] Sum rewards: -8.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.332', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.012', 'HITCOUNT': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.099', 'ARMOR': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.180', 'DAMAGECOUNT': '0.195', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'weapon3': '0.684', 'weapon2': '1.124'} [2024-08-05 21:09:48,786][52794] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:48,794][52811] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:48,869][52820] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:09:48,873][52820] Sum rewards: -8.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'weapon5': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO4': '0.042', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.555', 'weapon3': '0.826', 'FRAGCOUNT': '1.000', 'weapon2': '1.172'} [2024-08-05 21:09:48,970][52650] Updated weights for policy 0, policy_version 361 (0.0058) [2024-08-05 21:09:49,009][52669] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:09:49,436][52662] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:50,300][52665] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:50,596][52663] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:09:50,604][52663] Sum rewards: -1.477, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.122', 'AMMO2': '0.010', 'weapon7': '0.026', 'weapon4': '0.026', 'ARMOR': '0.040', 'HITCOUNT': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.450', 'weapon2': '0.926', 'FRAGCOUNT': '1.000', 'weapon3': '1.254'} [2024-08-05 21:09:50,696][52671] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:09:50,724][52659] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:09:50,724][52659] Sum rewards: -8.090, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.806', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.017', 'HITCOUNT': '0.070', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.800', 'ARMOR': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.038', 'weapon3': '1.136'} [2024-08-05 21:09:51,147][52666] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:51,152][52666] Sum rewards: -7.992, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.634', 'AMMO2': '0.002', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'weapon5': '0.012', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'ARMOR': '0.448', 'WEAPON3': '0.800', 'weapon2': '0.990', 'weapon3': '1.260'} [2024-08-05 21:09:51,261][52649] DAMAGECOUNT value on done: 80.0 [2024-08-05 21:09:51,261][52649] Sum rewards: -4.692, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'weapon5': '0.042', 'HITCOUNT': '0.060', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.240', 'HEALTH': '0.326', 'WEAPON3': '0.500', 'weapon2': '0.784', 'weapon3': '1.372'} [2024-08-05 21:09:51,263][52647] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:09:51,269][52664] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:51,270][52664] Sum rewards: -3.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.380', 'AMMO2': '0.012', 'HITCOUNT': '0.040', 'AMMO4': '0.058', 'AMMO3': '0.096', 'DAMAGECOUNT': '0.105', 'ARMOR': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.204', 'WEAPON3': '0.400', 'weapon3': '0.588', 'FRAGCOUNT': '1.000', 'weapon2': '1.222'} [2024-08-05 21:09:51,333][52668] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:09:51,364][52803] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:09:51,364][52803] Sum rewards: -10.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.736', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.040', 'AMMO4': '0.042', 'HITCOUNT': '0.050', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'DAMAGECOUNT': '0.150', 'weapon3': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.362'} [2024-08-05 21:09:51,657][52667] DAMAGECOUNT value on done: 27.0 [2024-08-05 21:09:51,661][52667] Sum rewards: -5.060, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.374', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'HITCOUNT': '0.030', 'AMMO3': '0.081', 'DAMAGECOUNT': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.117', 'weapon4': '0.154', 'WEAPON3': '0.450', 'weapon3': '0.484', 'FRAGCOUNT': '1.000', 'weapon2': '1.190'} [2024-08-05 21:09:51,837][52670] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:09:51,838][52670] Sum rewards: -7.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.873', 'AMMO2': '0.014', 'weapon4': '0.036', 'ARMOR': '0.040', 'AMMO4': '0.070', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'DAMAGECOUNT': '0.285', 'weapon2': '0.898', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.184'} [2024-08-05 21:09:51,961][52660] DAMAGECOUNT value on done: 109.0 [2024-08-05 21:09:51,982][52660] Sum rewards: -5.447, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.072', 'AMMO2': '0.019', 'weapon4': '0.022', 'ARMOR': '0.042', 'HITCOUNT': '0.090', 'AMMO4': '0.094', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.327', 'WEAPON3': '0.600', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.162'} [2024-08-05 21:09:51,987][52795] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:52,441][52658] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:52,510][52811] DAMAGECOUNT value on done: 22.0 [2024-08-05 21:09:52,795][52567] Fps is (10 sec: 13108.5, 60 sec: 12697.7, 300 sec: 10191.4). Total num frames: 3006464. Throughput: 0: 3486.4. Samples: 758180. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 21:09:52,795][52567] Avg episode reward: [(0, '-5.852')] [2024-08-05 21:09:52,894][52794] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:53,099][52820] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:09:53,145][52669] DAMAGECOUNT value on done: 14.0 [2024-08-05 21:09:53,440][52665] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:09:53,448][52665] Sum rewards: -5.798, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.711', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.087', 'HITCOUNT': '0.100', 'weapon4': '0.120', 'ARMOR': '0.132', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'weapon3': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.338'} [2024-08-05 21:09:53,782][52662] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:54,167][52671] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:54,190][52659] DAMAGECOUNT value on done: 227.0 [2024-08-05 21:09:54,198][52659] Sum rewards: -3.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.098', 'weapon4': '0.108', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.681', 'weapon2': '0.884', 'weapon3': '0.954', 'FRAGCOUNT': '1.000'} [2024-08-05 21:09:54,244][52649] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:09:54,338][52647] DAMAGECOUNT value on done: 217.0 [2024-08-05 21:09:54,341][52647] Sum rewards: -4.422, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.101', 'weapon4': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.081', 'HITCOUNT': '0.130', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'ARMOR': '0.494', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.651', 'weapon3': '1.046', 'weapon2': '1.058', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:54,518][52664] DAMAGECOUNT value on done: 76.0 [2024-08-05 21:09:54,734][52650] Updated weights for policy 0, policy_version 371 (0.0048) [2024-08-05 21:09:54,870][52666] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:54,873][52666] Sum rewards: -2.091, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.751', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'weapon4': '0.036', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.055', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.350', 'weapon3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.360'} [2024-08-05 21:09:55,024][52663] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:09:55,027][52663] Sum rewards: -8.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.011', 'HITCOUNT': '0.020', 'AMMO4': '0.055', 'DAMAGECOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON3': '0.800', 'weapon3': '0.828', 'FRAGCOUNT': '1.000', 'weapon2': '1.482'} [2024-08-05 21:09:55,289][52667] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:55,418][52668] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:55,725][52670] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:55,841][52803] DAMAGECOUNT value on done: 225.0 [2024-08-05 21:09:55,845][52803] Sum rewards: -2.050, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.107', 'HITCOUNT': '0.110', 'weapon4': '0.124', 'WEAPON4': '0.150', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon3': '0.600', 'HEALTH': '0.660', 'DAMAGECOUNT': '0.675', 'weapon2': '1.350', 'FRAGCOUNT': '2.000'} [2024-08-05 21:09:55,908][52795] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:09:55,919][52658] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:09:55,920][52658] Sum rewards: -13.212, reward structure: {'DEATHCOUNT': '-13.500', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.908', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon4': '0.042', 'HITCOUNT': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.850', 'weapon3': '0.860', 'weapon2': '1.378'} [2024-08-05 21:09:56,019][52665] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:56,020][52665] Sum rewards: -4.089, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.676', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.105', 'weapon4': '0.122', 'WEAPON3': '0.250', 'ARMOR': '0.466', 'weapon3': '0.538', 'FRAGCOUNT': '1.000', 'weapon2': '1.282'} [2024-08-05 21:09:56,369][52660] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:09:56,370][52660] Sum rewards: -6.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.536', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.036', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.136', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon3': '0.372', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.208'} [2024-08-05 21:09:56,493][52794] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:09:56,769][52649] DAMAGECOUNT value on done: 52.0 [2024-08-05 21:09:56,779][52669] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:57,088][52662] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:09:57,165][52811] DAMAGECOUNT value on done: 84.0 [2024-08-05 21:09:57,245][52820] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:09:57,259][52820] Sum rewards: -5.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.762', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.040', 'weapon4': '0.044', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'ARMOR': '0.120', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.650', 'weapon2': '0.832', 'weapon3': '1.048'} [2024-08-05 21:09:57,795][52567] Fps is (10 sec: 12288.4, 60 sec: 12970.7, 300 sec: 10413.6). Total num frames: 3072000. Throughput: 0: 3661.3. Samples: 778680. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:09:57,796][52567] Avg episode reward: [(0, '-5.958')] [2024-08-05 21:09:58,274][52663] DAMAGECOUNT value on done: 21.0 [2024-08-05 21:09:58,489][52671] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:58,514][52659] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:09:58,690][52647] DAMAGECOUNT value on done: 107.0 [2024-08-05 21:09:58,697][52647] Sum rewards: -5.885, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.082', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon5': '0.004', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'ARMOR': '0.124', 'weapon4': '0.158', 'DAMAGECOUNT': '0.321', 'weapon3': '0.548', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.320'} [2024-08-05 21:09:58,798][52664] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:09:58,821][52666] DAMAGECOUNT value on done: 54.0 [2024-08-05 21:09:58,825][52666] Sum rewards: -11.674, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.614', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.118', 'AMMO4': '0.158', 'DAMAGECOUNT': '0.162', 'weapon4': '0.170', 'WEAPON4': '0.350', 'ARMOR': '0.416', 'WEAPON3': '0.600', 'weapon3': '0.682', 'weapon2': '1.132'} [2024-08-05 21:09:59,125][52668] DAMAGECOUNT value on done: 87.0 [2024-08-05 21:09:59,392][52667] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:09:59,481][52667] Sum rewards: -3.952, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.790', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.174', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.850', 'weapon3': '0.954', 'weapon2': '1.014', 'FRAGCOUNT': '5.000'} [2024-08-05 21:09:59,520][52670] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:09:59,775][52660] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:09:59,828][52795] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:09:59,993][52658] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:10:00,051][52803] DAMAGECOUNT value on done: 26.0 [2024-08-05 21:10:00,061][52794] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:00,076][52803] Sum rewards: -4.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.958', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'HITCOUNT': '0.040', 'weapon5': '0.070', 'AMMO3': '0.077', 'DAMAGECOUNT': '0.078', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'ARMOR': '0.440', 'weapon3': '0.818', 'weapon2': '0.958', 'FRAGCOUNT': '1.000'} [2024-08-05 21:10:00,500][52650] Updated weights for policy 0, policy_version 381 (0.0027) [2024-08-05 21:10:00,827][52662] DAMAGECOUNT value on done: 317.0 [2024-08-05 21:10:00,867][52662] Sum rewards: -4.342, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.470', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.182', 'weapon4': '0.204', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon3': '0.644', 'DAMAGECOUNT': '0.951', 'weapon2': '1.384', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:00,930][52669] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:01,552][52811] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:10:01,560][52811] Sum rewards: -4.915, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.092', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.016', 'HITCOUNT': '0.030', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.156', 'weapon2': '0.794', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.046'} [2024-08-05 21:10:01,572][52820] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:10:01,573][52820] Sum rewards: -2.500, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.012', 'AMMO3': '0.092', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.010', 'weapon3': '1.122'} [2024-08-05 21:10:01,883][52647] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:10:01,975][52664] DAMAGECOUNT value on done: 132.0 [2024-08-05 21:10:01,980][52664] Sum rewards: -2.983, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.310', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.650', 'weapon2': '0.926', 'FRAGCOUNT': '1.000', 'weapon3': '1.356'} [2024-08-05 21:10:01,985][52671] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:10:01,985][52671] Sum rewards: -8.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.652', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'HITCOUNT': '0.030', 'weapon4': '0.036', 'ARMOR': '0.052', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.750', 'weapon3': '0.750', 'weapon2': '1.324'} [2024-08-05 21:10:01,999][52659] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:10:02,000][52659] Sum rewards: -4.074, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.072', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.076', 'ARMOR': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.550', 'weapon3': '0.944', 'FRAGCOUNT': '1.000', 'weapon2': '1.258'} [2024-08-05 21:10:02,357][52668] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:10:02,358][52668] Sum rewards: -4.302, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.818', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.050', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.650', 'weapon3': '0.994', 'weapon2': '1.290', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:02,413][52663] DAMAGECOUNT value on done: 136.0 [2024-08-05 21:10:02,423][52663] Sum rewards: -9.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO2': '0.019', 'weapon4': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.408', 'WEAPON3': '0.700', 'weapon3': '0.862', 'FRAGCOUNT': '1.000', 'weapon2': '1.142'} [2024-08-05 21:10:02,702][52666] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:10:02,794][52567] Fps is (10 sec: 13926.0, 60 sec: 13516.7, 300 sec: 10663.5). Total num frames: 3145728. Throughput: 0: 3649.8. Samples: 788380. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 21:10:02,795][52567] Avg episode reward: [(0, '-6.088')] [2024-08-05 21:10:02,930][52667] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:10:02,980][52795] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:02,995][52660] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:10:02,997][52660] Sum rewards: -2.007, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.936', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon5': '0.028', 'HITCOUNT': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.067', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.062', 'weapon3': '1.156'} [2024-08-05 21:10:03,496][52658] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:03,650][52803] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:10:03,716][52670] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:10:04,008][52794] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:10:04,017][52794] Sum rewards: -4.908, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'weapon2': '1.038', 'weapon3': '1.066', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:04,810][52662] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:10:05,051][52669] DAMAGECOUNT value on done: 34.0 [2024-08-05 21:10:05,937][52647] DAMAGECOUNT value on done: 117.0 [2024-08-05 21:10:06,046][52647] Sum rewards: -4.121, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.777', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.030', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.133', 'DAMAGECOUNT': '0.351', 'ARMOR': '0.483', 'WEAPON3': '0.700', 'weapon3': '0.980', 'FRAGCOUNT': '1.000', 'weapon2': '1.086'} [2024-08-05 21:10:06,102][52820] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:10:06,458][52664] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:10:07,108][52811] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:10:07,795][52567] Fps is (10 sec: 12287.7, 60 sec: 13517.2, 300 sec: 10830.6). Total num frames: 3194880. Throughput: 0: 3452.9. Samples: 805560. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:10:07,799][52567] Avg episode reward: [(0, '-6.005')] [2024-08-05 21:10:08,238][52671] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:10:08,265][52671] Sum rewards: -0.876, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.845', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.032', 'HITCOUNT': '0.060', 'AMMO4': '0.064', 'ARMOR': '0.065', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.500', 'weapon2': '0.858', 'FRAGCOUNT': '1.000', 'weapon3': '1.298'} [2024-08-05 21:10:08,530][52659] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:08,543][52668] DAMAGECOUNT value on done: 254.0 [2024-08-05 21:10:08,551][52668] Sum rewards: -2.463, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.688', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon5': '0.040', 'AMMO3': '0.107', 'AMMO4': '0.148', 'weapon4': '0.162', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.762', 'weapon3': '0.780', 'weapon2': '0.822', 'FRAGCOUNT': '4.000'} [2024-08-05 21:10:08,775][52667] DAMAGECOUNT value on done: 222.0 [2024-08-05 21:10:08,786][52667] Sum rewards: -5.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.886', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.034', 'WEAPON5': '0.050', 'HITCOUNT': '0.150', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.800', 'ARMOR': '0.850', 'weapon3': '1.048', 'weapon2': '1.330', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:09,233][52663] DAMAGECOUNT value on done: 49.0 [2024-08-05 21:10:09,628][52666] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:10:09,629][52658] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:10:10,453][52650] Updated weights for policy 0, policy_version 391 (0.0055) [2024-08-05 21:10:10,466][52795] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:10:10,583][52660] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:10:11,632][52803] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:10:11,665][52803] Sum rewards: -5.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.856', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.016', 'WEAPON1': '0.030', 'weapon4': '0.030', 'AMMO4': '0.031', 'ARMOR': '0.036', 'HITCOUNT': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'weapon3': '0.710', 'weapon2': '1.102'} [2024-08-05 21:10:12,596][52670] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:10:12,795][52567] Fps is (10 sec: 7372.7, 60 sec: 13243.7, 300 sec: 10915.8). Total num frames: 3219456. Throughput: 0: 3088.9. Samples: 812390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:10:12,799][52567] Avg episode reward: [(0, '-5.913')] [2024-08-05 21:10:13,951][52669] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:10:14,023][52669] Sum rewards: -6.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.801', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.032', 'HITCOUNT': '0.110', 'AMMO3': '0.190', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.900', 'weapon3': '0.964', 'FRAGCOUNT': '1.000', 'weapon2': '1.202'} [2024-08-05 21:10:15,175][52671] DAMAGECOUNT value on done: 230.0 [2024-08-05 21:10:15,181][52671] Sum rewards: 0.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.908', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'ARMOR': '0.104', 'AMMO3': '0.125', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.700', 'weapon3': '0.990', 'weapon2': '1.000', 'FRAGCOUNT': '4.000'} [2024-08-05 21:10:15,224][52811] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:10:15,251][52659] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:10:15,252][52659] Sum rewards: -6.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'AMMO2': '0.015', 'ARMOR': '0.049', 'HITCOUNT': '0.060', 'AMMO4': '0.074', 'AMMO3': '0.081', 'WEAPON4': '0.200', 'weapon4': '0.212', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'weapon3': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.200'} [2024-08-05 21:10:15,373][52647] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:10:15,374][52647] Sum rewards: -7.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.466', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.700', 'weapon3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.044'} [2024-08-05 21:10:15,406][52820] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:15,407][52820] Sum rewards: -7.029, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.070', 'AMMO5': '0.003', 'HITCOUNT': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.023', 'DAMAGECOUNT': '0.045', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.083', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.240', 'WEAPON3': '0.450', 'weapon3': '0.656', 'weapon2': '0.896'} [2024-08-05 21:10:15,533][52664] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:15,709][52663] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:15,960][52667] DAMAGECOUNT value on done: 99.0 [2024-08-05 21:10:15,968][52668] DAMAGECOUNT value on done: 67.0 [2024-08-05 21:10:15,969][52668] Sum rewards: -6.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.522', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.054', 'HITCOUNT': '0.080', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.201', 'ARMOR': '0.504', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.044', 'weapon3': '1.068'} [2024-08-05 21:10:16,431][52666] DAMAGECOUNT value on done: 108.0 [2024-08-05 21:10:16,435][52660] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:10:16,436][52666] Sum rewards: -7.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.673', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.068', 'HITCOUNT': '0.110', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.324', 'ARMOR': '0.494', 'WEAPON3': '0.800', 'weapon2': '0.980', 'FRAGCOUNT': '1.000', 'weapon3': '1.110'} [2024-08-05 21:10:16,465][52658] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:10:16,465][52658] Sum rewards: -2.994, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.748', 'ARMOR': '0.004', 'weapon5': '0.004', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.116', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'weapon3': '0.708', 'weapon2': '1.110', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:16,862][52803] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:16,971][52795] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:10:16,979][52795] Sum rewards: -2.154, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '0.652', 'FRAGCOUNT': '1.000', 'weapon3': '1.286'} [2024-08-05 21:10:17,288][52670] DAMAGECOUNT value on done: 33.0 [2024-08-05 21:10:17,795][52567] Fps is (10 sec: 8192.1, 60 sec: 12970.7, 300 sec: 11109.6). Total num frames: 3276800. Throughput: 0: 2985.8. Samples: 819930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 21:10:17,798][52567] Avg episode reward: [(0, '-5.911')] [2024-08-05 21:10:17,833][52669] DAMAGECOUNT value on done: 87.0 [2024-08-05 21:10:18,084][52650] Updated weights for policy 0, policy_version 401 (0.0062) [2024-08-05 21:10:19,009][52811] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:10:19,327][52671] DAMAGECOUNT value on done: 159.0 [2024-08-05 21:10:19,331][52671] Sum rewards: -5.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.072', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.088', 'HITCOUNT': '0.150', 'AMMO3': '0.165', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.800', 'weapon3': '0.876', 'weapon2': '1.200', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:19,388][52663] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:10:19,394][52659] DAMAGECOUNT value on done: 142.0 [2024-08-05 21:10:19,391][52663] Sum rewards: -2.396, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.465', 'AMMO2': '0.012', 'HITCOUNT': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.062', 'ARMOR': '0.100', 'weapon4': '0.146', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.350', 'weapon3': '0.504', 'weapon2': '1.454', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:19,571][52664] DAMAGECOUNT value on done: 152.0 [2024-08-05 21:10:19,579][52664] Sum rewards: -5.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.988', 'AMMO2': '0.023', 'ARMOR': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.138', 'HITCOUNT': '0.160', 'weapon4': '0.228', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.456', 'WEAPON3': '0.750', 'weapon3': '0.814', 'FRAGCOUNT': '1.000', 'weapon2': '1.070'} [2024-08-05 21:10:20,165][52820] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:10:20,193][52820] Sum rewards: -10.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.284', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.025', 'ARMOR': '0.028', 'HITCOUNT': '0.030', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.157', 'weapon3': '0.778', 'WEAPON3': '0.850', 'weapon2': '1.118'} [2024-08-05 21:10:20,510][52666] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:10:20,641][52795] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:21,126][52803] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:21,500][52670] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:10:21,986][52669] DAMAGECOUNT value on done: 90.0 [2024-08-05 21:10:21,999][52669] Sum rewards: -6.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.590', 'AMMO2': '0.009', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO4': '0.043', 'ARMOR': '0.048', 'HITCOUNT': '0.070', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.700', 'weapon3': '0.804', 'weapon2': '0.978', 'FRAGCOUNT': '1.000'} [2024-08-05 21:10:22,795][52567] Fps is (10 sec: 13107.6, 60 sec: 12697.6, 300 sec: 11359.7). Total num frames: 3350528. Throughput: 0: 2968.2. Samples: 840260. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:10:22,797][52567] Avg episode reward: [(0, '-5.856')] [2024-08-05 21:10:23,279][52811] DAMAGECOUNT value on done: 27.0 [2024-08-05 21:10:23,296][52811] Sum rewards: -5.395, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.903', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.008', 'WEAPON1': '0.010', 'HITCOUNT': '0.030', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'weapon4': '0.078', 'AMMO3': '0.079', 'DAMAGECOUNT': '0.081', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'weapon3': '0.990', 'weapon2': '1.024'} [2024-08-05 21:10:23,603][52663] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:10:23,826][52671] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:10:23,956][52659] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:10:23,956][52659] Sum rewards: -3.346, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.052', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.180', 'weapon4': '0.250', 'WEAPON3': '0.500', 'weapon3': '0.784', 'FRAGCOUNT': '1.000', 'weapon2': '1.080'} [2024-08-05 21:10:24,026][52666] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:24,034][52820] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:24,034][52820] Sum rewards: -9.973, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.016', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.155', 'WEAPON3': '0.700', 'weapon3': '0.880', 'weapon2': '1.320'} [2024-08-05 21:10:24,282][52795] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:10:24,820][52650] Updated weights for policy 0, policy_version 411 (0.0055) [2024-08-05 21:10:24,839][52670] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:10:25,276][52803] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:10:27,209][52811] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:10:27,794][52567] Fps is (10 sec: 13926.4, 60 sec: 12561.1, 300 sec: 11692.6). Total num frames: 3416064. Throughput: 0: 3004.5. Samples: 861820. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 21:10:27,795][52567] Avg episode reward: [(0, '-5.973')] [2024-08-05 21:10:27,800][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000417_3416064.pth... [2024-08-05 21:10:27,868][52795] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:10:27,894][52820] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:10:27,897][52820] Sum rewards: -6.036, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.174', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.016', 'weapon4': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.112', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.600', 'weapon3': '0.940', 'weapon2': '0.944', 'FRAGCOUNT': '1.000'} [2024-08-05 21:10:27,956][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000034_278528.pth [2024-08-05 21:10:29,327][52803] DAMAGECOUNT value on done: 54.0 [2024-08-05 21:10:30,153][52650] Updated weights for policy 0, policy_version 421 (0.0051) [2024-08-05 21:10:31,180][52811] DAMAGECOUNT value on done: 51.0 [2024-08-05 21:10:31,190][52811] Sum rewards: -8.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.222', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon5': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.048', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.153', 'AMMO3': '0.166', 'WEAPON3': '0.800', 'weapon3': '0.840', 'weapon2': '1.158'} [2024-08-05 21:10:31,733][52820] DAMAGECOUNT value on done: 85.0 [2024-08-05 21:10:31,914][52795] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:10:32,795][52567] Fps is (10 sec: 13107.4, 60 sec: 12288.8, 300 sec: 11802.1). Total num frames: 3481600. Throughput: 0: 3012.0. Samples: 872390. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:10:32,799][52567] Avg episode reward: [(0, '-5.881')] [2024-08-05 21:10:33,360][52803] DAMAGECOUNT value on done: 377.0 [2024-08-05 21:10:33,372][52803] Sum rewards: -2.253, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.046', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.138', 'HITCOUNT': '0.170', 'WEAPON3': '0.500', 'weapon3': '0.814', 'weapon2': '1.088', 'DAMAGECOUNT': '1.131', 'FRAGCOUNT': '2.000'} [2024-08-05 21:10:35,403][52820] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:10:35,416][52820] Sum rewards: -5.507, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.612', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'HITCOUNT': '0.070', 'weapon4': '0.096', 'DAMAGECOUNT': '0.150', 'AMMO3': '0.151', 'WEAPON3': '0.850', 'weapon3': '0.952', 'weapon2': '0.970', 'FRAGCOUNT': '1.000'} [2024-08-05 21:10:35,705][52811] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:10:35,782][52650] Updated weights for policy 0, policy_version 431 (0.0046) [2024-08-05 21:10:36,278][52795] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:37,645][52803] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:37,796][52567] Fps is (10 sec: 14745.5, 60 sec: 12561.1, 300 sec: 12080.0). Total num frames: 3563520. Throughput: 0: 3043.1. Samples: 895120. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:10:37,800][52567] Avg episode reward: [(0, '-5.830')] [2024-08-05 21:10:39,544][52820] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:10:40,618][52811] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:10:40,634][52811] Sum rewards: -6.194, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.021', 'HITCOUNT': '0.070', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'DAMAGECOUNT': '0.375', 'weapon2': '0.688', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.156'} [2024-08-05 21:10:41,298][52795] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:10:41,677][52650] Updated weights for policy 0, policy_version 441 (0.0057) [2024-08-05 21:10:42,331][52803] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:10:42,358][52803] Sum rewards: -5.413, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.166', 'AMMO5': '0.003', 'AMMO2': '0.023', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'weapon4': '0.080', 'AMMO4': '0.113', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.750', 'weapon2': '0.970', 'FRAGCOUNT': '1.000', 'weapon3': '1.172'} [2024-08-05 21:10:42,794][52567] Fps is (10 sec: 13926.3, 60 sec: 12424.7, 300 sec: 12274.8). Total num frames: 3620864. Throughput: 0: 3029.8. Samples: 915020. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:10:42,796][52567] Avg episode reward: [(0, '-5.813')] [2024-08-05 21:10:47,834][52567] Fps is (10 sec: 5714.7, 60 sec: 11189.3, 300 sec: 12273.3). Total num frames: 3620864. Throughput: 0: 2812.1. Samples: 915020. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:10:47,971][52567] Avg episode reward: [(0, '-5.813')] [2024-08-05 21:10:52,773][52820] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:10:52,794][52567] Fps is (10 sec: 1638.4, 60 sec: 10513.1, 300 sec: 12331.4). Total num frames: 3637248. Throughput: 0: 2482.9. Samples: 917290. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:10:52,795][52567] Avg episode reward: [(0, '-5.813')] [2024-08-05 21:10:54,198][52811] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:10:55,173][52803] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:10:55,950][52650] Updated weights for policy 0, policy_version 451 (0.0171) [2024-08-05 21:10:56,789][52820] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:10:57,794][52567] Fps is (10 sec: 9864.3, 60 sec: 10786.1, 300 sec: 12683.6). Total num frames: 3719168. Throughput: 0: 2782.5. Samples: 937600. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:10:57,795][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:01,731][52650] Updated weights for policy 0, policy_version 461 (0.0016) [2024-08-05 21:11:02,796][52567] Fps is (10 sec: 14742.9, 60 sec: 10649.3, 300 sec: 12801.7). Total num frames: 3784704. Throughput: 0: 2855.7. Samples: 948440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:11:02,798][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:07,796][52567] Fps is (10 sec: 13107.3, 60 sec: 10922.7, 300 sec: 12774.0). Total num frames: 3850240. Throughput: 0: 2840.0. Samples: 968060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:11:07,800][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:08,087][52650] Updated weights for policy 0, policy_version 471 (0.0037) [2024-08-05 21:11:12,796][52567] Fps is (10 sec: 12288.1, 60 sec: 11468.5, 300 sec: 12774.0). Total num frames: 3907584. Throughput: 0: 2756.8. Samples: 985880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:11:12,798][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:15,140][52650] Updated weights for policy 0, policy_version 481 (0.0060) [2024-08-05 21:11:17,797][52567] Fps is (10 sec: 12285.8, 60 sec: 11605.0, 300 sec: 12746.1). Total num frames: 3973120. Throughput: 0: 2724.3. Samples: 994990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-05 21:11:17,818][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:21,941][52650] Updated weights for policy 0, policy_version 491 (0.0080) [2024-08-05 21:11:22,795][52567] Fps is (10 sec: 12290.3, 60 sec: 11332.3, 300 sec: 12718.4). Total num frames: 4030464. Throughput: 0: 2615.3. Samples: 1012810. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:11:22,804][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:27,794][52567] Fps is (10 sec: 11470.8, 60 sec: 11195.7, 300 sec: 12774.0). Total num frames: 4087808. Throughput: 0: 2571.1. Samples: 1030720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:11:27,796][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:28,749][52650] Updated weights for policy 0, policy_version 501 (0.0053) [2024-08-05 21:11:32,797][52567] Fps is (10 sec: 11468.3, 60 sec: 11059.1, 300 sec: 12885.1). Total num frames: 4145152. Throughput: 0: 2759.9. Samples: 1039120. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 21:11:32,807][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:35,820][52650] Updated weights for policy 0, policy_version 511 (0.0055) [2024-08-05 21:11:37,795][52567] Fps is (10 sec: 10649.7, 60 sec: 10513.1, 300 sec: 12940.9). Total num frames: 4194304. Throughput: 0: 3097.1. Samples: 1056660. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 21:11:37,798][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:42,794][52567] Fps is (10 sec: 8192.4, 60 sec: 10103.5, 300 sec: 13139.3). Total num frames: 4227072. Throughput: 0: 2840.2. Samples: 1065410. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 21:11:42,795][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:45,006][52650] Updated weights for policy 0, policy_version 521 (0.0058) [2024-08-05 21:11:47,797][52567] Fps is (10 sec: 11465.3, 60 sec: 11474.8, 300 sec: 13562.3). Total num frames: 4308992. Throughput: 0: 2879.7. Samples: 1078030. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-05 21:11:47,798][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:49,943][52650] Updated weights for policy 0, policy_version 531 (0.0013) [2024-08-05 21:11:52,796][52567] Fps is (10 sec: 15564.7, 60 sec: 12424.5, 300 sec: 13582.7). Total num frames: 4382720. Throughput: 0: 2940.0. Samples: 1100360. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:11:52,799][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:11:57,812][52567] Fps is (10 sec: 10636.1, 60 sec: 11602.3, 300 sec: 13523.0). Total num frames: 4415488. Throughput: 0: 2745.4. Samples: 1109460. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:11:57,821][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:00,927][52650] Updated weights for policy 0, policy_version 541 (0.0062) [2024-08-05 21:12:02,795][52567] Fps is (10 sec: 8192.0, 60 sec: 11332.6, 300 sec: 13496.0). Total num frames: 4464640. Throughput: 0: 2709.2. Samples: 1116900. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 21:12:02,799][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:06,355][52650] Updated weights for policy 0, policy_version 551 (0.0045) [2024-08-05 21:12:07,795][52567] Fps is (10 sec: 10666.4, 60 sec: 11195.7, 300 sec: 13384.9). Total num frames: 4521984. Throughput: 0: 2736.2. Samples: 1135940. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-05 21:12:07,800][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:12,794][52567] Fps is (10 sec: 11468.6, 60 sec: 11196.0, 300 sec: 13301.6). Total num frames: 4579328. Throughput: 0: 2734.4. Samples: 1153770. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:12:12,796][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:13,954][52650] Updated weights for policy 0, policy_version 561 (0.0048) [2024-08-05 21:12:17,796][52567] Fps is (10 sec: 11468.8, 60 sec: 11059.5, 300 sec: 13218.3). Total num frames: 4636672. Throughput: 0: 2742.9. Samples: 1162550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:12:17,800][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:20,403][52650] Updated weights for policy 0, policy_version 571 (0.0058) [2024-08-05 21:12:22,795][52567] Fps is (10 sec: 11468.9, 60 sec: 11059.2, 300 sec: 13107.2). Total num frames: 4694016. Throughput: 0: 2748.7. Samples: 1180350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:12:22,797][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:27,795][52567] Fps is (10 sec: 11468.8, 60 sec: 11059.2, 300 sec: 12996.1). Total num frames: 4751360. Throughput: 0: 2929.1. Samples: 1197220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:12:27,796][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:27,919][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000581_4759552.pth... [2024-08-05 21:12:27,962][52650] Updated weights for policy 0, policy_version 581 (0.0095) [2024-08-05 21:12:28,059][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000233_1908736.pth [2024-08-05 21:12:32,754][52659] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:12:32,794][52567] Fps is (10 sec: 9011.1, 60 sec: 10649.7, 300 sec: 12801.7). Total num frames: 4784128. Throughput: 0: 2731.7. Samples: 1200950. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-05 21:12:32,796][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:37,796][52567] Fps is (10 sec: 5734.4, 60 sec: 10240.0, 300 sec: 12551.8). Total num frames: 4808704. Throughput: 0: 2402.2. Samples: 1208460. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:12:37,801][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:42,800][52567] Fps is (10 sec: 4913.3, 60 sec: 10102.8, 300 sec: 12329.5). Total num frames: 4833280. Throughput: 0: 2305.9. Samples: 1213200. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 21:12:42,812][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:46,992][52650] Updated weights for policy 0, policy_version 591 (0.0057) [2024-08-05 21:12:47,796][52567] Fps is (10 sec: 4095.9, 60 sec: 9011.6, 300 sec: 12079.7). Total num frames: 4849664. Throughput: 0: 2269.1. Samples: 1219010. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 21:12:47,805][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:52,649][52614] Signal inference workers to stop experience collection... (100 times) [2024-08-05 21:12:52,673][52650] InferenceWorker_p0-w0: stopping experience collection (100 times) [2024-08-05 21:12:52,796][52567] Fps is (10 sec: 5736.6, 60 sec: 8465.1, 300 sec: 11913.1). Total num frames: 4890624. Throughput: 0: 2135.1. Samples: 1232020. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-05 21:12:52,804][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:12:52,858][52614] Signal inference workers to resume experience collection... (100 times) [2024-08-05 21:12:52,866][52650] InferenceWorker_p0-w0: resuming experience collection (100 times) [2024-08-05 21:12:54,242][52650] Updated weights for policy 0, policy_version 601 (0.0067) [2024-08-05 21:12:57,796][52567] Fps is (10 sec: 10649.7, 60 sec: 9013.5, 300 sec: 11829.8). Total num frames: 4956160. Throughput: 0: 1905.8. Samples: 1239530. Policy #0 lag: (min: 0.0, avg: 4.3, max: 10.0) [2024-08-05 21:12:57,801][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:02,367][52650] Updated weights for policy 0, policy_version 611 (0.0048) [2024-08-05 21:13:02,796][52567] Fps is (10 sec: 11467.0, 60 sec: 9011.0, 300 sec: 11663.1). Total num frames: 5005312. Throughput: 0: 2044.6. Samples: 1254560. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:13:02,800][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:07,796][52567] Fps is (10 sec: 7372.3, 60 sec: 8465.0, 300 sec: 11441.0). Total num frames: 5029888. Throughput: 0: 1875.7. Samples: 1264760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:13:07,805][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:12,796][52567] Fps is (10 sec: 4915.8, 60 sec: 7918.9, 300 sec: 11218.9). Total num frames: 5054464. Throughput: 0: 1580.4. Samples: 1268340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:13:12,805][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:17,795][52567] Fps is (10 sec: 3276.9, 60 sec: 7099.7, 300 sec: 10941.2). Total num frames: 5062656. Throughput: 0: 1608.7. Samples: 1273340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:13:17,796][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:22,794][52567] Fps is (10 sec: 2457.7, 60 sec: 6417.1, 300 sec: 10746.8). Total num frames: 5079040. Throughput: 0: 1526.2. Samples: 1277140. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:13:22,798][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:25,415][52650] Updated weights for policy 0, policy_version 621 (0.0199) [2024-08-05 21:13:27,797][52567] Fps is (10 sec: 2457.2, 60 sec: 5597.7, 300 sec: 10469.0). Total num frames: 5087232. Throughput: 0: 1456.5. Samples: 1278740. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:13:27,818][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:32,800][52567] Fps is (10 sec: 1637.7, 60 sec: 5187.9, 300 sec: 10274.6). Total num frames: 5095424. Throughput: 0: 1411.7. Samples: 1282540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:13:32,808][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:37,794][52567] Fps is (10 sec: 2458.0, 60 sec: 5051.7, 300 sec: 10108.1). Total num frames: 5111808. Throughput: 0: 1211.6. Samples: 1286540. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:13:37,800][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:42,813][52567] Fps is (10 sec: 2454.4, 60 sec: 4777.6, 300 sec: 9913.1). Total num frames: 5120000. Throughput: 0: 1088.7. Samples: 1288540. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:13:42,826][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:47,811][52567] Fps is (10 sec: 2453.9, 60 sec: 4777.5, 300 sec: 9802.1). Total num frames: 5136384. Throughput: 0: 812.6. Samples: 1291140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:13:47,829][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:52,795][52567] Fps is (10 sec: 2461.6, 60 sec: 4232.5, 300 sec: 9663.8). Total num frames: 5144576. Throughput: 0: 657.3. Samples: 1294340. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:13:52,798][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:13:57,796][52567] Fps is (10 sec: 1640.7, 60 sec: 3276.8, 300 sec: 9552.7). Total num frames: 5152768. Throughput: 0: 617.8. Samples: 1296140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:13:57,802][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:02,799][52567] Fps is (10 sec: 1637.8, 60 sec: 2594.0, 300 sec: 9413.8). Total num frames: 5160960. Throughput: 0: 577.7. Samples: 1299340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:14:02,808][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:03,065][52650] Updated weights for policy 0, policy_version 631 (0.0204) [2024-08-05 21:14:07,796][52567] Fps is (10 sec: 3276.8, 60 sec: 2594.1, 300 sec: 9358.3). Total num frames: 5185536. Throughput: 0: 573.3. Samples: 1302940. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:14:07,800][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:12,798][52567] Fps is (10 sec: 3277.9, 60 sec: 2321.0, 300 sec: 9136.1). Total num frames: 5193728. Throughput: 0: 582.2. Samples: 1304940. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:14:12,803][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:17,806][52567] Fps is (10 sec: 1636.8, 60 sec: 2320.7, 300 sec: 8858.1). Total num frames: 5201920. Throughput: 0: 586.6. Samples: 1308940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:14:17,812][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:22,799][52567] Fps is (10 sec: 2456.6, 60 sec: 2320.9, 300 sec: 8663.9). Total num frames: 5218304. Throughput: 0: 577.7. Samples: 1312540. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 21:14:22,813][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:27,795][52567] Fps is (10 sec: 3280.3, 60 sec: 2457.7, 300 sec: 8442.0). Total num frames: 5234688. Throughput: 0: 578.0. Samples: 1314540. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:14:27,799][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:27,823][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000639_5234688.pth... [2024-08-05 21:14:28,146][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000417_3416064.pth [2024-08-05 21:14:32,812][52567] Fps is (10 sec: 2454.5, 60 sec: 2457.1, 300 sec: 8247.1). Total num frames: 5242880. Throughput: 0: 582.2. Samples: 1317340. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:14:32,827][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:37,799][52567] Fps is (10 sec: 818.9, 60 sec: 2184.4, 300 sec: 8025.3). Total num frames: 5242880. Throughput: 0: 542.2. Samples: 1318740. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:14:37,837][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:42,805][52567] Fps is (10 sec: 0.0, 60 sec: 2048.3, 300 sec: 7775.2). Total num frames: 5242880. Throughput: 0: 528.8. Samples: 1319940. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:14:42,838][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:46,740][52650] Updated weights for policy 0, policy_version 641 (0.0247) [2024-08-05 21:14:47,800][52567] Fps is (10 sec: 819.4, 60 sec: 1911.9, 300 sec: 7608.8). Total num frames: 5251072. Throughput: 0: 493.4. Samples: 1321540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:14:47,809][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:52,798][52567] Fps is (10 sec: 2459.0, 60 sec: 2047.9, 300 sec: 7442.1). Total num frames: 5267456. Throughput: 0: 440.0. Samples: 1322740. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:14:52,808][52567] Avg episode reward: [(0, '-5.731')] [2024-08-05 21:14:53,000][52665] DAMAGECOUNT value on done: 48.0 [2024-08-05 21:14:57,794][52567] Fps is (10 sec: 1638.8, 60 sec: 1911.5, 300 sec: 7192.3). Total num frames: 5267456. Throughput: 0: 431.1. Samples: 1324340. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:14:57,797][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:02,796][52567] Fps is (10 sec: 0.0, 60 sec: 1775.0, 300 sec: 7025.6). Total num frames: 5267456. Throughput: 0: 369.0. Samples: 1325540. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:15:02,810][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:07,807][52567] Fps is (10 sec: 0.0, 60 sec: 1365.1, 300 sec: 6942.1). Total num frames: 5267456. Throughput: 0: 297.7. Samples: 1325940. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:15:07,829][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:12,808][52567] Fps is (10 sec: 0.0, 60 sec: 1228.6, 300 sec: 6747.8). Total num frames: 5267456. Throughput: 0: 271.1. Samples: 1326740. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:15:12,905][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:17,806][52567] Fps is (10 sec: 819.5, 60 sec: 1228.9, 300 sec: 6525.7). Total num frames: 5275648. Throughput: 0: 226.7. Samples: 1327540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:15:17,880][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:22,802][52567] Fps is (10 sec: 1638.8, 60 sec: 1092.2, 300 sec: 6331.3). Total num frames: 5283840. Throughput: 0: 213.3. Samples: 1328340. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 21:15:22,814][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:27,804][52567] Fps is (10 sec: 819.4, 60 sec: 819.1, 300 sec: 6109.2). Total num frames: 5283840. Throughput: 0: 200.0. Samples: 1328940. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 21:15:27,815][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:32,810][52567] Fps is (10 sec: 818.7, 60 sec: 819.3, 300 sec: 5859.1). Total num frames: 5292032. Throughput: 0: 186.6. Samples: 1329940. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:15:32,819][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:37,799][52567] Fps is (10 sec: 819.4, 60 sec: 819.2, 300 sec: 5664.9). Total num frames: 5292032. Throughput: 0: 168.9. Samples: 1330340. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:15:37,804][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:42,801][52567] Fps is (10 sec: 0.0, 60 sec: 819.2, 300 sec: 5665.5). Total num frames: 5292032. Throughput: 0: 164.4. Samples: 1331740. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:15:42,839][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:47,809][52567] Fps is (10 sec: 0.0, 60 sec: 682.5, 300 sec: 5609.2). Total num frames: 5292032. Throughput: 0: 155.5. Samples: 1332540. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:15:47,835][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:51,453][52649] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:15:51,464][52649] Sum rewards: -10.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO2': '0.017', 'HITCOUNT': '0.050', 'weapon4': '0.082', 'AMMO4': '0.082', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.160', 'weapon2': '1.450'} [2024-08-05 21:15:52,887][52567] Fps is (10 sec: 0.0, 60 sec: 409.0, 300 sec: 5330.1). Total num frames: 5292032. Throughput: 0: 150.8. Samples: 1332740. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:15:53,054][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:15:57,795][52567] Fps is (10 sec: 820.3, 60 sec: 546.1, 300 sec: 5137.4). Total num frames: 5300224. Throughput: 0: 146.7. Samples: 1333340. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:15:57,797][52567] Avg episode reward: [(0, '-5.818')] [2024-08-05 21:16:02,809][52567] Fps is (10 sec: 1651.2, 60 sec: 682.5, 300 sec: 4942.7). Total num frames: 5308416. Throughput: 0: 168.9. Samples: 1335140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:16:02,830][52567] Avg episode reward: [(0, '-5.818')] [2024-08-05 21:16:03,970][52665] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:16:03,979][52665] Sum rewards: -5.729, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.138', 'AMMO5': '0.007', 'AMMO2': '0.025', 'ARMOR': '0.048', 'HITCOUNT': '0.080', 'AMMO4': '0.122', 'AMMO3': '0.134', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.650', 'weapon3': '0.994', 'FRAGCOUNT': '1.000', 'weapon2': '1.386'} [2024-08-05 21:16:07,767][52650] Updated weights for policy 0, policy_version 651 (0.0590) [2024-08-05 21:16:07,807][52567] Fps is (10 sec: 3273.6, 60 sec: 1092.3, 300 sec: 4831.8). Total num frames: 5332992. Throughput: 0: 260.0. Samples: 1340040. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:16:07,870][52567] Avg episode reward: [(0, '-5.833')] [2024-08-05 21:16:12,797][52567] Fps is (10 sec: 3280.9, 60 sec: 1229.0, 300 sec: 4637.5). Total num frames: 5341184. Throughput: 0: 278.0. Samples: 1341450. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:16:12,816][52567] Avg episode reward: [(0, '-5.833')] [2024-08-05 21:16:15,772][52649] DAMAGECOUNT value on done: 448.0 [2024-08-05 21:16:15,781][52649] Sum rewards: -5.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.644', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.020', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.164', 'weapon2': '1.258', 'weapon3': '1.530'} [2024-08-05 21:16:17,797][52567] Fps is (10 sec: 1639.7, 60 sec: 1228.9, 300 sec: 4470.9). Total num frames: 5349376. Throughput: 0: 344.7. Samples: 1345450. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:16:17,805][52567] Avg episode reward: [(0, '-5.834')] [2024-08-05 21:16:20,994][52665] DAMAGECOUNT value on done: 222.0 [2024-08-05 21:16:21,001][52665] Sum rewards: -5.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.366', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.072', 'AMMO4': '0.089', 'weapon4': '0.092', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.850', 'weapon2': '0.908', 'weapon3': '1.490', 'FRAGCOUNT': '2.000'} [2024-08-05 21:16:22,795][52567] Fps is (10 sec: 2457.7, 60 sec: 1365.5, 300 sec: 4332.0). Total num frames: 5365760. Throughput: 0: 440.9. Samples: 1350180. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:16:22,805][52567] Avg episode reward: [(0, '-5.840')] [2024-08-05 21:16:27,798][52567] Fps is (10 sec: 3277.1, 60 sec: 1638.5, 300 sec: 4193.2). Total num frames: 5382144. Throughput: 0: 463.2. Samples: 1352580. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:16:27,802][52567] Avg episode reward: [(0, '-5.840')] [2024-08-05 21:16:27,983][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000658_5390336.pth... [2024-08-05 21:16:28,175][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000581_4759552.pth [2024-08-05 21:16:32,796][52567] Fps is (10 sec: 3276.5, 60 sec: 1775.2, 300 sec: 4082.1). Total num frames: 5398528. Throughput: 0: 534.4. Samples: 1356580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:16:32,805][52567] Avg episode reward: [(0, '-5.840')] [2024-08-05 21:16:33,823][52649] DAMAGECOUNT value on done: 209.0 [2024-08-05 21:16:33,931][52649] Sum rewards: -4.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.988', 'AMMO5': '0.005', 'AMMO2': '0.008', 'HITCOUNT': '0.040', 'weapon5': '0.040', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'ARMOR': '0.535', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.068', 'weapon2': '1.606'} [2024-08-05 21:16:37,797][52567] Fps is (10 sec: 2457.6, 60 sec: 1911.5, 300 sec: 3998.8). Total num frames: 5406720. Throughput: 0: 613.5. Samples: 1360290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:16:37,804][52567] Avg episode reward: [(0, '-5.800')] [2024-08-05 21:16:38,327][52650] Updated weights for policy 0, policy_version 661 (0.0120) [2024-08-05 21:16:39,737][52665] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:16:42,797][52567] Fps is (10 sec: 2457.4, 60 sec: 2184.6, 300 sec: 3776.7). Total num frames: 5423104. Throughput: 0: 643.3. Samples: 1362290. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:16:42,805][52567] Avg episode reward: [(0, '-5.847')] [2024-08-05 21:16:47,795][52567] Fps is (10 sec: 4096.4, 60 sec: 2594.7, 300 sec: 3610.0). Total num frames: 5447680. Throughput: 0: 719.1. Samples: 1367490. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:16:47,799][52567] Avg episode reward: [(0, '-5.847')] [2024-08-05 21:16:50,578][52649] DAMAGECOUNT value on done: 234.0 [2024-08-05 21:16:50,581][52649] Sum rewards: -2.583, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.836', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.069', 'ARMOR': '0.128', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.464', 'DAMAGECOUNT': '0.522', 'weapon3': '0.804', 'FRAGCOUNT': '1.000', 'weapon2': '1.202'} [2024-08-05 21:16:52,799][52567] Fps is (10 sec: 3276.7, 60 sec: 2734.7, 300 sec: 3526.9). Total num frames: 5455872. Throughput: 0: 707.9. Samples: 1371890. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:16:52,803][52567] Avg episode reward: [(0, '-5.834')] [2024-08-05 21:16:55,021][52665] DAMAGECOUNT value on done: 275.0 [2024-08-05 21:16:55,032][52665] Sum rewards: -3.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.238', 'weapon4': '0.002', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'HITCOUNT': '0.190', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.900', 'weapon2': '1.296', 'weapon3': '1.510', 'FRAGCOUNT': '3.000'} [2024-08-05 21:16:56,837][52794] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:16:56,849][52794] Sum rewards: -2.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.444', 'AMMO2': '0.019', 'HITCOUNT': '0.020', 'DAMAGECOUNT': '0.060', 'ARMOR': '0.072', 'AMMO3': '0.082', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.164', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.220', 'weapon2': '1.266'} [2024-08-05 21:16:57,801][52567] Fps is (10 sec: 2456.3, 60 sec: 2866.9, 300 sec: 3415.6). Total num frames: 5472256. Throughput: 0: 744.6. Samples: 1374960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:16:57,813][52567] Avg episode reward: [(0, '-5.788')] [2024-08-05 21:17:02,137][52662] DAMAGECOUNT value on done: 114.0 [2024-08-05 21:17:02,795][52567] Fps is (10 sec: 3277.8, 60 sec: 3004.4, 300 sec: 3276.8). Total num frames: 5488640. Throughput: 0: 744.3. Samples: 1378940. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:17:02,797][52567] Avg episode reward: [(0, '-5.812')] [2024-08-05 21:17:03,495][52650] Updated weights for policy 0, policy_version 671 (0.0174) [2024-08-05 21:17:06,652][52649] DAMAGECOUNT value on done: 117.0 [2024-08-05 21:17:07,798][52567] Fps is (10 sec: 3277.6, 60 sec: 2867.5, 300 sec: 3137.9). Total num frames: 5505024. Throughput: 0: 754.6. Samples: 1384140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:17:07,806][52567] Avg episode reward: [(0, '-5.859')] [2024-08-05 21:17:11,813][52665] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:17:11,817][52665] Sum rewards: -1.351, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'HITCOUNT': '0.060', 'AMMO3': '0.083', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'DAMAGECOUNT': '0.150', 'weapon4': '0.278', 'WEAPON3': '0.450', 'HEALTH': '0.778', 'weapon3': '0.998', 'FRAGCOUNT': '1.000', 'weapon2': '1.294'} [2024-08-05 21:17:12,801][52567] Fps is (10 sec: 3275.0, 60 sec: 3003.5, 300 sec: 2999.0). Total num frames: 5521408. Throughput: 0: 749.0. Samples: 1386290. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:17:12,809][52567] Avg episode reward: [(0, '-5.814')] [2024-08-05 21:17:13,807][52794] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:17:17,796][52567] Fps is (10 sec: 3277.4, 60 sec: 3140.3, 300 sec: 2860.2). Total num frames: 5537792. Throughput: 0: 754.7. Samples: 1390540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:17:17,801][52567] Avg episode reward: [(0, '-5.847')] [2024-08-05 21:17:18,651][52662] DAMAGECOUNT value on done: 49.0 [2024-08-05 21:17:22,796][52567] Fps is (10 sec: 2458.8, 60 sec: 3003.7, 300 sec: 2693.6). Total num frames: 5545984. Throughput: 0: 769.8. Samples: 1394930. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:17:22,803][52567] Avg episode reward: [(0, '-5.802')] [2024-08-05 21:17:24,959][52649] DAMAGECOUNT value on done: 85.0 [2024-08-05 21:17:27,797][52567] Fps is (10 sec: 1638.2, 60 sec: 2867.1, 300 sec: 2610.3). Total num frames: 5554176. Throughput: 0: 764.4. Samples: 1396690. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:17:27,806][52567] Avg episode reward: [(0, '-5.841')] [2024-08-05 21:17:28,867][52667] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:17:28,876][52667] Sum rewards: 1.307, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.007', 'ARMOR': '0.015', 'weapon4': '0.030', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'HEALTH': '0.056', 'HITCOUNT': '0.060', 'AMMO3': '0.069', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.350', 'weapon3': '1.100', 'weapon2': '1.460', 'FRAGCOUNT': '2.000'} [2024-08-05 21:17:30,960][52665] DAMAGECOUNT value on done: 67.0 [2024-08-05 21:17:32,578][52794] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:17:32,588][52794] Sum rewards: -6.531, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.074', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.028', 'HITCOUNT': '0.050', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.800', 'weapon3': '1.222', 'weapon2': '1.464'} [2024-08-05 21:17:32,795][52567] Fps is (10 sec: 2457.8, 60 sec: 2867.3, 300 sec: 2582.6). Total num frames: 5570560. Throughput: 0: 734.2. Samples: 1400530. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:17:32,798][52567] Avg episode reward: [(0, '-5.760')] [2024-08-05 21:17:32,827][52658] DAMAGECOUNT value on done: 310.0 [2024-08-05 21:17:32,832][52658] Sum rewards: -3.122, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.072', 'weapon4': '0.084', 'AMMO3': '0.154', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.750', 'weapon3': '1.358', 'weapon2': '1.498', 'FRAGCOUNT': '2.000'} [2024-08-05 21:17:34,108][52650] Updated weights for policy 0, policy_version 681 (0.0141) [2024-08-05 21:17:36,211][52662] DAMAGECOUNT value on done: 172.0 [2024-08-05 21:17:36,226][52662] Sum rewards: -7.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.118', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.073', 'AMMO3': '0.146', 'HITCOUNT': '0.160', 'weapon4': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.208', 'weapon2': '1.212'} [2024-08-05 21:17:37,801][52567] Fps is (10 sec: 4094.6, 60 sec: 3140.0, 300 sec: 2582.5). Total num frames: 5595136. Throughput: 0: 762.6. Samples: 1406210. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:17:37,817][52567] Avg episode reward: [(0, '-5.773')] [2024-08-05 21:17:41,215][52649] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:17:41,224][52649] Sum rewards: -3.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.072', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.120', 'ARMOR': '0.496', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.210', 'weapon3': '1.316'} [2024-08-05 21:17:42,795][52567] Fps is (10 sec: 3276.7, 60 sec: 3003.8, 300 sec: 2554.8). Total num frames: 5603328. Throughput: 0: 745.2. Samples: 1408490. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:17:42,799][52567] Avg episode reward: [(0, '-5.757')] [2024-08-05 21:17:43,846][52667] DAMAGECOUNT value on done: 134.0 [2024-08-05 21:17:45,615][52665] DAMAGECOUNT value on done: 155.0 [2024-08-05 21:17:45,635][52647] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:17:45,639][52665] Sum rewards: -7.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.068', 'AMMO2': '0.034', 'ARMOR': '0.056', 'weapon4': '0.082', 'HITCOUNT': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.168', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.600', 'weapon3': '0.922', 'FRAGCOUNT': '1.000', 'weapon2': '1.722'} [2024-08-05 21:17:47,127][52658] DAMAGECOUNT value on done: 32.0 [2024-08-05 21:17:47,458][52794] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:17:47,795][52567] Fps is (10 sec: 3278.9, 60 sec: 3003.8, 300 sec: 2499.3). Total num frames: 5627904. Throughput: 0: 770.7. Samples: 1413620. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:17:47,799][52567] Avg episode reward: [(0, '-5.714')] [2024-08-05 21:17:48,930][52668] DAMAGECOUNT value on done: 217.0 [2024-08-05 21:17:48,938][52668] Sum rewards: -7.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'weapon4': '0.080', 'HITCOUNT': '0.130', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.501', 'ARMOR': '0.503', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.362', 'weapon2': '1.392'} [2024-08-05 21:17:52,794][52567] Fps is (10 sec: 4096.2, 60 sec: 3140.4, 300 sec: 2332.6). Total num frames: 5644288. Throughput: 0: 757.2. Samples: 1418210. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:17:52,796][52567] Avg episode reward: [(0, '-5.745')] [2024-08-05 21:17:52,811][52662] DAMAGECOUNT value on done: 187.0 [2024-08-05 21:17:52,822][52662] Sum rewards: -2.169, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.037', 'HEALTH': '0.044', 'AMMO4': '0.080', 'AMMO3': '0.097', 'weapon4': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.118', 'weapon3': '1.366'} [2024-08-05 21:17:54,093][52660] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:17:55,650][52669] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:17:57,119][52649] DAMAGECOUNT value on done: 132.0 [2024-08-05 21:17:57,796][52567] Fps is (10 sec: 2457.4, 60 sec: 3004.0, 300 sec: 2193.8). Total num frames: 5652480. Throughput: 0: 762.7. Samples: 1420610. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:17:57,802][52567] Avg episode reward: [(0, '-5.718')] [2024-08-05 21:17:59,048][52650] Updated weights for policy 0, policy_version 691 (0.0129) [2024-08-05 21:17:59,699][52667] DAMAGECOUNT value on done: 175.0 [2024-08-05 21:17:59,708][52667] Sum rewards: -7.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.147', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '0.968', 'FRAGCOUNT': '1.000', 'weapon3': '1.880'} [2024-08-05 21:18:02,400][52665] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:18:02,429][52665] Sum rewards: -5.501, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.535', 'AMMO2': '0.019', 'AMMO4': '0.092', 'HITCOUNT': '0.110', 'AMMO3': '0.116', 'DAMAGECOUNT': '0.285', 'weapon4': '0.306', 'WEAPON4': '0.400', 'ARMOR': '0.476', 'WEAPON3': '0.650', 'weapon3': '0.734', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'} [2024-08-05 21:18:02,458][52647] DAMAGECOUNT value on done: 216.0 [2024-08-05 21:18:02,460][52647] Sum rewards: -6.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO2': '0.016', 'ARMOR': '0.035', 'AMMO4': '0.077', 'AMMO3': '0.095', 'HITCOUNT': '0.140', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'weapon4': '0.436', 'DAMAGECOUNT': '0.438', 'weapon3': '0.834', 'FRAGCOUNT': '1.000', 'weapon2': '1.346'} [2024-08-05 21:18:02,795][52567] Fps is (10 sec: 3276.7, 60 sec: 3140.2, 300 sec: 2193.8). Total num frames: 5677056. Throughput: 0: 766.0. Samples: 1425010. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:18:02,799][52567] Avg episode reward: [(0, '-5.808')] [2024-08-05 21:18:04,043][52666] DAMAGECOUNT value on done: 84.0 [2024-08-05 21:18:04,043][52658] DAMAGECOUNT value on done: 128.0 [2024-08-05 21:18:04,341][52794] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:18:04,350][52794] Sum rewards: -4.080, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO2': '0.010', 'HITCOUNT': '0.030', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.056', 'DAMAGECOUNT': '0.090', 'ARMOR': '0.128', 'AMMO3': '0.141', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.170', 'weapon3': '1.446'} [2024-08-05 21:18:05,713][52663] DAMAGECOUNT value on done: 305.0 [2024-08-05 21:18:06,088][52668] DAMAGECOUNT value on done: 147.0 [2024-08-05 21:18:07,794][52567] Fps is (10 sec: 3277.0, 60 sec: 3003.9, 300 sec: 2138.3). Total num frames: 5685248. Throughput: 0: 761.8. Samples: 1429210. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:18:07,801][52567] Avg episode reward: [(0, '-5.706')] [2024-08-05 21:18:10,450][52662] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:18:11,724][52670] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:18:12,106][52664] DAMAGECOUNT value on done: 134.0 [2024-08-05 21:18:12,113][52664] Sum rewards: -4.260, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.060', 'HITCOUNT': '0.070', 'weapon4': '0.074', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'HEALTH': '0.162', 'DAMAGECOUNT': '0.282', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.354', 'weapon2': '1.354'} [2024-08-05 21:18:12,418][52660] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:18:12,796][52567] Fps is (10 sec: 2457.5, 60 sec: 3004.0, 300 sec: 2166.0). Total num frames: 5701632. Throughput: 0: 762.7. Samples: 1431010. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:18:12,801][52567] Avg episode reward: [(0, '-5.678')] [2024-08-05 21:18:14,357][52669] DAMAGECOUNT value on done: 241.0 [2024-08-05 21:18:14,395][52669] Sum rewards: -2.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.372', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'ARMOR': '0.072', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.558', 'weapon3': '1.212', 'weapon2': '1.394', 'FRAGCOUNT': '3.000'} [2024-08-05 21:18:16,388][52649] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:18:16,394][52649] Sum rewards: -7.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.356', 'AMMO5': '0.005', 'AMMO2': '0.025', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.145', 'weapon4': '0.184', 'DAMAGECOUNT': '0.285', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'WEAPON3': '0.850', 'weapon3': '0.886', 'weapon2': '1.796', 'FRAGCOUNT': '2.000'} [2024-08-05 21:18:17,794][52567] Fps is (10 sec: 2457.6, 60 sec: 2867.3, 300 sec: 2138.2). Total num frames: 5709824. Throughput: 0: 761.8. Samples: 1434810. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:18:17,797][52567] Avg episode reward: [(0, '-5.710')] [2024-08-05 21:18:20,254][52667] DAMAGECOUNT value on done: 92.0 [2024-08-05 21:18:20,280][52667] Sum rewards: -9.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.058', 'HITCOUNT': '0.080', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.246', 'weapon4': '0.268', 'weapon3': '0.718', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.700'} [2024-08-05 21:18:22,800][52567] Fps is (10 sec: 1637.9, 60 sec: 2867.0, 300 sec: 2138.2). Total num frames: 5718016. Throughput: 0: 697.8. Samples: 1437610. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:18:22,817][52567] Avg episode reward: [(0, '-5.740')] [2024-08-05 21:18:24,226][52665] DAMAGECOUNT value on done: 84.0 [2024-08-05 21:18:24,297][52647] DAMAGECOUNT value on done: 233.0 [2024-08-05 21:18:24,320][52647] Sum rewards: -6.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.816', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.028', 'weapon4': '0.030', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'DAMAGECOUNT': '0.384', 'WEAPON3': '0.700', 'weapon3': '1.042', 'weapon2': '1.696'} [2024-08-05 21:18:26,825][52666] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:18:26,836][52658] DAMAGECOUNT value on done: 162.0 [2024-08-05 21:18:26,838][52658] Sum rewards: -2.059, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.603', 'AMMO2': '0.006', 'AMMO4': '0.027', 'HITCOUNT': '0.090', 'weapon4': '0.090', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.336', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'weapon2': '1.188', 'weapon3': '1.286', 'FRAGCOUNT': '2.000'} [2024-08-05 21:18:27,661][52794] DAMAGECOUNT value on done: 286.0 [2024-08-05 21:18:27,721][52794] Sum rewards: -4.142, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.482', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.723', 'weapon3': '0.736', 'ARMOR': '0.907', 'weapon2': '1.756', 'FRAGCOUNT': '2.000'} [2024-08-05 21:18:27,809][52567] Fps is (10 sec: 1637.0, 60 sec: 2866.9, 300 sec: 2138.2). Total num frames: 5726208. Throughput: 0: 682.3. Samples: 1439200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:18:27,813][52567] Avg episode reward: [(0, '-5.693')] [2024-08-05 21:18:27,905][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000699_5726208.pth... [2024-08-05 21:18:29,061][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000639_5234688.pth [2024-08-05 21:18:30,438][52668] DAMAGECOUNT value on done: 360.0 [2024-08-05 21:18:30,435][52663] DAMAGECOUNT value on done: 97.0 [2024-08-05 21:18:30,451][52668] Sum rewards: -3.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.894', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'HITCOUNT': '0.180', 'ARMOR': '0.449', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon2': '1.094', 'weapon3': '1.610'} [2024-08-05 21:18:32,801][52567] Fps is (10 sec: 1638.3, 60 sec: 2730.5, 300 sec: 2110.4). Total num frames: 5734400. Throughput: 0: 621.5. Samples: 1441590. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:18:32,818][52567] Avg episode reward: [(0, '-5.628')] [2024-08-05 21:18:35,597][52650] Updated weights for policy 0, policy_version 701 (0.0338) [2024-08-05 21:18:36,950][52671] DAMAGECOUNT value on done: 114.0 [2024-08-05 21:18:37,794][52567] Fps is (10 sec: 1639.8, 60 sec: 2457.9, 300 sec: 2110.6). Total num frames: 5742592. Throughput: 0: 573.8. Samples: 1444030. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:18:37,797][52567] Avg episode reward: [(0, '-5.617')] [2024-08-05 21:18:37,859][52662] DAMAGECOUNT value on done: 205.0 [2024-08-05 21:18:37,892][52662] Sum rewards: -1.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.550', 'AMMO2': '0.016', 'ARMOR': '0.072', 'AMMO4': '0.080', 'AMMO3': '0.092', 'HITCOUNT': '0.120', 'weapon4': '0.178', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.540', 'weapon3': '1.246', 'weapon2': '1.316', 'FRAGCOUNT': '2.000'} [2024-08-05 21:18:40,422][52670] DAMAGECOUNT value on done: 106.0 [2024-08-05 21:18:40,438][52670] Sum rewards: -3.108, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.372', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.028', 'HITCOUNT': '0.080', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.243', 'weapon4': '0.370', 'WEAPON3': '0.550', 'weapon3': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '1.252'} [2024-08-05 21:18:40,453][52664] DAMAGECOUNT value on done: 127.0 [2024-08-05 21:18:41,234][52660] DAMAGECOUNT value on done: 120.0 [2024-08-05 21:18:42,798][52567] Fps is (10 sec: 1638.6, 60 sec: 2457.5, 300 sec: 2082.8). Total num frames: 5750784. Throughput: 0: 546.0. Samples: 1445180. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:18:42,807][52567] Avg episode reward: [(0, '-5.577')] [2024-08-05 21:18:44,468][52659] DAMAGECOUNT value on done: 269.0 [2024-08-05 21:18:44,494][52659] Sum rewards: -2.700, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.168', 'AMMO2': '0.012', 'weapon4': '0.016', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.108', 'HITCOUNT': '0.150', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'weapon2': '1.176', 'weapon3': '1.492', 'FRAGCOUNT': '2.000'} [2024-08-05 21:18:44,508][52669] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:18:44,510][52669] Sum rewards: -7.831, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.167', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.280', 'weapon3': '1.468'} [2024-08-05 21:18:46,454][52649] DAMAGECOUNT value on done: 85.0 [2024-08-05 21:18:47,798][52567] Fps is (10 sec: 1637.9, 60 sec: 2184.4, 300 sec: 2082.7). Total num frames: 5758976. Throughput: 0: 501.5. Samples: 1447580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:18:47,804][52567] Avg episode reward: [(0, '-5.595')] [2024-08-05 21:18:52,800][52567] Fps is (10 sec: 1638.2, 60 sec: 2047.8, 300 sec: 2082.7). Total num frames: 5767168. Throughput: 0: 453.7. Samples: 1449630. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:18:52,810][52567] Avg episode reward: [(0, '-5.595')] [2024-08-05 21:18:53,151][52667] DAMAGECOUNT value on done: 280.0 [2024-08-05 21:18:53,176][52667] Sum rewards: -3.740, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.130', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.096', 'weapon4': '0.104', 'HITCOUNT': '0.110', 'AMMO3': '0.115', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.218', 'weapon3': '1.290'} [2024-08-05 21:18:57,273][52647] DAMAGECOUNT value on done: 137.0 [2024-08-05 21:18:57,268][52665] DAMAGECOUNT value on done: 231.0 [2024-08-05 21:18:57,275][52647] Sum rewards: -5.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.398', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.024', 'HITCOUNT': '0.110', 'AMMO3': '0.153', 'DAMAGECOUNT': '0.291', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.102', 'weapon3': '1.580'} [2024-08-05 21:18:57,277][52665] Sum rewards: -1.495, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.215', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.019', 'weapon4': '0.048', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.700', 'weapon2': '1.032', 'weapon3': '1.510', 'FRAGCOUNT': '2.000'} [2024-08-05 21:18:57,799][52567] Fps is (10 sec: 1638.3, 60 sec: 2047.9, 300 sec: 2082.7). Total num frames: 5775360. Throughput: 0: 430.2. Samples: 1450370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:18:57,821][52567] Avg episode reward: [(0, '-5.539')] [2024-08-05 21:18:59,626][52666] DAMAGECOUNT value on done: 254.0 [2024-08-05 21:18:59,644][52666] Sum rewards: -3.154, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.814', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.112', 'DAMAGECOUNT': '0.192', 'ARMOR': '0.502', 'WEAPON3': '0.550', 'weapon3': '0.806', 'FRAGCOUNT': '1.000', 'weapon2': '1.654'} [2024-08-05 21:18:59,678][52658] DAMAGECOUNT value on done: 263.0 [2024-08-05 21:19:00,477][52794] DAMAGECOUNT value on done: 112.0 [2024-08-05 21:19:01,760][52663] DAMAGECOUNT value on done: 352.0 [2024-08-05 21:19:01,792][52663] Sum rewards: -0.863, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.082', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'ARMOR': '0.054', 'AMMO3': '0.100', 'weapon4': '0.112', 'HITCOUNT': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.846', 'weapon2': '1.300', 'weapon3': '1.354', 'FRAGCOUNT': '2.000'} [2024-08-05 21:19:01,825][52668] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:19:01,861][52668] Sum rewards: -2.636, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.922', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'HITCOUNT': '0.050', 'AMMO3': '0.051', 'AMMO4': '0.058', 'DAMAGECOUNT': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON3': '0.250', 'ARMOR': '0.509', 'weapon3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.680'} [2024-08-05 21:19:02,801][52567] Fps is (10 sec: 819.1, 60 sec: 1638.3, 300 sec: 1999.4). Total num frames: 5775360. Throughput: 0: 416.8. Samples: 1453570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:19:02,811][52567] Avg episode reward: [(0, '-5.334')] [2024-08-05 21:19:06,234][52671] DAMAGECOUNT value on done: 77.0 [2024-08-05 21:19:07,039][52662] DAMAGECOUNT value on done: 117.0 [2024-08-05 21:19:07,049][52662] Sum rewards: -5.317, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.016', 'HITCOUNT': '0.060', 'AMMO4': '0.080', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.237', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.168', 'weapon3': '1.446'} [2024-08-05 21:19:07,796][52567] Fps is (10 sec: 2458.2, 60 sec: 1911.4, 300 sec: 2054.9). Total num frames: 5799936. Throughput: 0: 436.0. Samples: 1457230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:19:07,801][52567] Avg episode reward: [(0, '-5.310')] [2024-08-05 21:19:08,862][52670] DAMAGECOUNT value on done: 140.0 [2024-08-05 21:19:09,616][52660] DAMAGECOUNT value on done: 292.0 [2024-08-05 21:19:09,619][52664] DAMAGECOUNT value on done: 175.0 [2024-08-05 21:19:09,629][52664] Sum rewards: -8.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.528', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.170', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.492', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.380', 'weapon2': '1.420'} [2024-08-05 21:19:09,644][52660] Sum rewards: -9.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.165', 'HITCOUNT': '0.180', 'weapon4': '0.232', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.850', 'ARMOR': '0.911', 'FRAGCOUNT': '1.000', 'weapon3': '1.240', 'weapon2': '1.310'} [2024-08-05 21:19:12,199][52659] DAMAGECOUNT value on done: 35.0 [2024-08-05 21:19:12,186][52669] DAMAGECOUNT value on done: 245.0 [2024-08-05 21:19:12,823][52567] Fps is (10 sec: 3269.6, 60 sec: 1774.1, 300 sec: 2054.8). Total num frames: 5808128. Throughput: 0: 427.2. Samples: 1458430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:19:12,834][52567] Avg episode reward: [(0, '-5.283')] [2024-08-05 21:19:13,813][52649] DAMAGECOUNT value on done: 121.0 [2024-08-05 21:19:17,798][52567] Fps is (10 sec: 819.0, 60 sec: 1638.3, 300 sec: 1999.4). Total num frames: 5808128. Throughput: 0: 441.6. Samples: 1461460. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:19:17,810][52567] Avg episode reward: [(0, '-5.304')] [2024-08-05 21:19:18,924][52667] DAMAGECOUNT value on done: 219.0 [2024-08-05 21:19:20,732][52650] Updated weights for policy 0, policy_version 711 (0.0346) [2024-08-05 21:19:22,552][52665] DAMAGECOUNT value on done: 175.0 [2024-08-05 21:19:22,559][52665] Sum rewards: -0.253, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.622', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'HITCOUNT': '0.050', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.162', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'weapon2': '1.358'} [2024-08-05 21:19:22,805][52567] Fps is (10 sec: 1641.5, 60 sec: 1774.8, 300 sec: 1999.3). Total num frames: 5824512. Throughput: 0: 444.4. Samples: 1464030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:19:22,811][52567] Avg episode reward: [(0, '-5.245')] [2024-08-05 21:19:23,095][52647] DAMAGECOUNT value on done: 57.0 [2024-08-05 21:19:24,753][52666] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:19:24,777][52666] Sum rewards: -3.232, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.375', 'AMMO2': '0.019', 'HITCOUNT': '0.070', 'AMMO4': '0.096', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.270', 'weapon4': '0.342', 'ARMOR': '0.485', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.010', 'weapon3': '1.250'} [2024-08-05 21:19:25,601][52658] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:19:25,608][52658] Sum rewards: -5.251, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.010', 'weapon5': '0.010', 'AMMO4': '0.046', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'ARMOR': '0.170', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.600', 'weapon3': '0.714', 'FRAGCOUNT': '1.000', 'weapon2': '2.030'} [2024-08-05 21:19:26,342][52794] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:19:26,363][52794] Sum rewards: -4.442, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.691', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO4': '0.032', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'HITCOUNT': '0.140', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'weapon3': '1.196', 'weapon2': '1.774'} [2024-08-05 21:19:27,800][52567] Fps is (10 sec: 2457.0, 60 sec: 1775.0, 300 sec: 1999.5). Total num frames: 5832704. Throughput: 0: 454.4. Samples: 1465630. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:19:27,808][52567] Avg episode reward: [(0, '-5.110')] [2024-08-05 21:19:28,333][52668] DAMAGECOUNT value on done: 159.0 [2024-08-05 21:19:28,332][52663] DAMAGECOUNT value on done: 318.0 [2024-08-05 21:19:28,341][52663] Sum rewards: -4.276, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.593', 'weapon4': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon5': '0.066', 'HITCOUNT': '0.080', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.550', 'weapon3': '0.694', 'FRAGCOUNT': '1.000', 'weapon2': '1.736'} [2024-08-05 21:19:32,799][52567] Fps is (10 sec: 1639.2, 60 sec: 1775.0, 300 sec: 2027.2). Total num frames: 5840896. Throughput: 0: 459.5. Samples: 1468260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:19:32,812][52567] Avg episode reward: [(0, '-5.115')] [2024-08-05 21:19:33,883][52671] DAMAGECOUNT value on done: 198.0 [2024-08-05 21:19:35,036][52662] DAMAGECOUNT value on done: 178.0 [2024-08-05 21:19:35,050][52662] Sum rewards: -3.508, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.860', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.080', 'weapon4': '0.118', 'HITCOUNT': '0.130', 'AMMO3': '0.165', 'DAMAGECOUNT': '0.519', 'weapon2': '0.748', 'WEAPON3': '0.900', 'weapon3': '1.832', 'FRAGCOUNT': '2.000'} [2024-08-05 21:19:36,938][52670] DAMAGECOUNT value on done: 139.0 [2024-08-05 21:19:37,622][52664] DAMAGECOUNT value on done: 219.0 [2024-08-05 21:19:37,622][52660] DAMAGECOUNT value on done: 80.0 [2024-08-05 21:19:37,630][52664] Sum rewards: -1.915, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.665', 'AMMO5': '0.008', 'AMMO2': '0.013', 'ARMOR': '0.016', 'weapon5': '0.028', 'AMMO4': '0.065', 'HITCOUNT': '0.090', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.627', 'weapon2': '0.836', 'FRAGCOUNT': '1.000', 'weapon3': '1.392'} [2024-08-05 21:19:37,630][52660] Sum rewards: -13.872, reward structure: {'DEATHCOUNT': '-12.750', 'FRAGCOUNT': '-3.000', 'HEALTH': '-1.996', 'AMMO5': '0.007', 'AMMO2': '0.010', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.015', 'weapon5': '0.030', 'AMMO4': '0.048', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.117', 'WEAPON3': '0.650', 'weapon3': '0.838', 'weapon2': '1.758'} [2024-08-05 21:19:37,800][52567] Fps is (10 sec: 1638.5, 60 sec: 1774.8, 300 sec: 2055.0). Total num frames: 5849088. Throughput: 0: 470.9. Samples: 1470820. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:19:37,818][52567] Avg episode reward: [(0, '-5.229')] [2024-08-05 21:19:41,057][52669] DAMAGECOUNT value on done: 242.0 [2024-08-05 21:19:41,043][52659] DAMAGECOUNT value on done: 226.0 [2024-08-05 21:19:41,070][52659] Sum rewards: -5.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'HITCOUNT': '0.170', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.296', 'weapon2': '1.422'} [2024-08-05 21:19:41,071][52669] Sum rewards: 0.095, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.736', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.022', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.057', 'AMMO3': '0.084', 'weapon4': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.291', 'WEAPON3': '0.450', 'weapon3': '1.310', 'weapon2': '1.440', 'FRAGCOUNT': '2.000'} [2024-08-05 21:19:42,635][52649] DAMAGECOUNT value on done: 149.0 [2024-08-05 21:19:42,645][52649] Sum rewards: -4.207, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.023', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.113', 'DAMAGECOUNT': '0.147', 'WEAPON3': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.508', 'weapon3': '0.672', 'FRAGCOUNT': '1.000', 'weapon2': '1.622'} [2024-08-05 21:19:42,802][52567] Fps is (10 sec: 1638.0, 60 sec: 1774.8, 300 sec: 2054.9). Total num frames: 5857280. Throughput: 0: 477.5. Samples: 1471860. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:19:42,811][52567] Avg episode reward: [(0, '-5.104')] [2024-08-05 21:19:47,803][52567] Fps is (10 sec: 1637.7, 60 sec: 1774.8, 300 sec: 2027.1). Total num frames: 5865472. Throughput: 0: 468.6. Samples: 1474660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:19:47,824][52567] Avg episode reward: [(0, '-5.104')] [2024-08-05 21:19:48,267][52667] DAMAGECOUNT value on done: 113.0 [2024-08-05 21:19:48,294][52667] Sum rewards: -3.042, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.552', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.032', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.082', 'weapon3': '1.790'} [2024-08-05 21:19:52,443][52665] DAMAGECOUNT value on done: 165.0 [2024-08-05 21:19:52,802][52567] Fps is (10 sec: 1638.8, 60 sec: 1775.0, 300 sec: 2054.9). Total num frames: 5873664. Throughput: 0: 440.6. Samples: 1477060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:19:52,808][52567] Avg episode reward: [(0, '-5.082')] [2024-08-05 21:19:53,135][52647] DAMAGECOUNT value on done: 60.0 [2024-08-05 21:19:55,951][52666] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:19:56,870][52658] DAMAGECOUNT value on done: 107.0 [2024-08-05 21:19:57,382][52794] DAMAGECOUNT value on done: 70.0 [2024-08-05 21:19:57,803][52567] Fps is (10 sec: 1638.6, 60 sec: 1774.8, 300 sec: 2082.7). Total num frames: 5881856. Throughput: 0: 435.5. Samples: 1478020. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:19:57,814][52567] Avg episode reward: [(0, '-5.088')] [2024-08-05 21:20:00,317][52663] DAMAGECOUNT value on done: 230.0 [2024-08-05 21:20:00,344][52668] DAMAGECOUNT value on done: 230.0 [2024-08-05 21:20:00,406][52668] Sum rewards: -5.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.092', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.036', 'AMMO4': '0.065', 'HITCOUNT': '0.130', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.200', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.700', 'weapon2': '1.072', 'weapon3': '1.486', 'FRAGCOUNT': '2.000'} [2024-08-05 21:20:02,795][52567] Fps is (10 sec: 819.5, 60 sec: 1775.1, 300 sec: 2082.8). Total num frames: 5881856. Throughput: 0: 408.7. Samples: 1479850. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:20:02,797][52567] Avg episode reward: [(0, '-4.944')] [2024-08-05 21:20:04,288][52614] Saving new best policy, reward=-4.944! [2024-08-05 21:20:07,801][52567] Fps is (10 sec: 819.3, 60 sec: 1501.7, 300 sec: 2110.5). Total num frames: 5890048. Throughput: 0: 390.9. Samples: 1481620. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:20:07,810][52567] Avg episode reward: [(0, '-4.944')] [2024-08-05 21:20:10,015][52671] DAMAGECOUNT value on done: 474.0 [2024-08-05 21:20:10,031][52671] Sum rewards: -0.619, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.055', 'ARMOR': '0.064', 'HITCOUNT': '0.080', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.220', 'WEAPON3': '0.300', 'weapon4': '0.374', 'DAMAGECOUNT': '0.420', 'weapon3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.638'} [2024-08-05 21:20:12,174][52662] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:20:12,796][52567] Fps is (10 sec: 1638.1, 60 sec: 1502.5, 300 sec: 2110.5). Total num frames: 5898240. Throughput: 0: 373.1. Samples: 1482420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:20:12,801][52567] Avg episode reward: [(0, '-4.887')] [2024-08-05 21:20:12,913][52670] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:20:13,233][52660] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:20:13,237][52660] Sum rewards: -4.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.269', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon4': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.157', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.900', 'weapon2': '0.960', 'weapon3': '1.566', 'FRAGCOUNT': '2.000'} [2024-08-05 21:20:13,250][52664] DAMAGECOUNT value on done: 206.0 [2024-08-05 21:20:13,250][52664] Sum rewards: -6.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.450', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'weapon4': '0.100', 'AMMO3': '0.181', 'DAMAGECOUNT': '0.402', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.098', 'weapon2': '1.664'} [2024-08-05 21:20:13,522][52614] Saving new best policy, reward=-4.887! [2024-08-05 21:20:13,526][52650] Updated weights for policy 0, policy_version 721 (0.1185) [2024-08-05 21:20:14,852][52659] DAMAGECOUNT value on done: 275.0 [2024-08-05 21:20:14,863][52659] Sum rewards: -3.980, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.334', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.074', 'weapon4': '0.128', 'HITCOUNT': '0.180', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.900', 'weapon2': '1.112', 'weapon3': '1.440', 'FRAGCOUNT': '2.000'} [2024-08-05 21:20:14,877][52669] DAMAGECOUNT value on done: 206.0 [2024-08-05 21:20:14,880][52669] Sum rewards: 0.120, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.072', 'AMMO3': '0.075', 'HITCOUNT': '0.080', 'weapon7': '0.080', 'AMMO4': '0.090', 'weapon4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.618', 'weapon3': '0.686', 'weapon2': '1.258', 'FRAGCOUNT': '2.000'} [2024-08-05 21:20:15,656][52649] DAMAGECOUNT value on done: 510.0 [2024-08-05 21:20:15,663][52649] Sum rewards: -3.157, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.568', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.350', 'weapon3': '0.564', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '2.000', 'weapon2': '2.364'} [2024-08-05 21:20:16,373][52667] DAMAGECOUNT value on done: 205.0 [2024-08-05 21:20:17,526][52647] DAMAGECOUNT value on done: 316.0 [2024-08-05 21:20:17,537][52647] Sum rewards: -2.407, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.130', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.028', 'AMMO4': '0.057', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon4': '0.212', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.597', 'weapon3': '0.934', 'FRAGCOUNT': '1.000', 'weapon2': '1.676'} [2024-08-05 21:20:17,798][52567] Fps is (10 sec: 3277.9, 60 sec: 1911.5, 300 sec: 2166.1). Total num frames: 5922816. Throughput: 0: 399.3. Samples: 1486230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:20:17,799][52567] Avg episode reward: [(0, '-4.843')] [2024-08-05 21:20:18,177][52614] Saving new best policy, reward=-4.843! [2024-08-05 21:20:18,916][52665] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:20:18,920][52665] Sum rewards: -3.769, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.176', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.166', 'weapon2': '1.346'} [2024-08-05 21:20:19,877][52794] DAMAGECOUNT value on done: 220.0 [2024-08-05 21:20:19,891][52666] DAMAGECOUNT value on done: 78.0 [2024-08-05 21:20:20,199][52658] DAMAGECOUNT value on done: 240.0 [2024-08-05 21:20:20,228][52668] DAMAGECOUNT value on done: 155.0 [2024-08-05 21:20:20,241][52668] Sum rewards: -3.414, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.069', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'AMMO3': '0.136', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.168', 'weapon3': '1.386'} [2024-08-05 21:20:20,229][52658] Sum rewards: -4.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.297', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.132', 'weapon4': '0.186', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.314', 'weapon2': '1.450'} [2024-08-05 21:20:21,346][52663] DAMAGECOUNT value on done: 213.0 [2024-08-05 21:20:22,798][52567] Fps is (10 sec: 4095.4, 60 sec: 1911.7, 300 sec: 2221.6). Total num frames: 5939200. Throughput: 0: 494.2. Samples: 1493060. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 21:20:22,806][52567] Avg episode reward: [(0, '-4.841')] [2024-08-05 21:20:23,107][52614] Saving new best policy, reward=-4.841! [2024-08-05 21:20:23,203][52671] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:20:24,512][52662] DAMAGECOUNT value on done: 198.0 [2024-08-05 21:20:24,521][52662] Sum rewards: -6.363, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.791', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.284', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.192', 'weapon3': '1.424'} [2024-08-05 21:20:25,402][52660] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:20:26,365][52664] DAMAGECOUNT value on done: 205.0 [2024-08-05 21:20:27,088][52670] DAMAGECOUNT value on done: 206.0 [2024-08-05 21:20:27,093][52670] Sum rewards: -1.685, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.818', 'AMMO2': '0.007', 'AMMO5': '0.009', 'weapon5': '0.018', 'weapon4': '0.024', 'AMMO4': '0.036', 'ARMOR': '0.044', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.650', 'weapon2': '1.336', 'weapon3': '1.434', 'FRAGCOUNT': '3.000'} [2024-08-05 21:20:27,795][52567] Fps is (10 sec: 3277.4, 60 sec: 2048.2, 300 sec: 2249.4). Total num frames: 5955584. Throughput: 0: 524.5. Samples: 1495460. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:20:27,797][52567] Avg episode reward: [(0, '-4.813')] [2024-08-05 21:20:27,823][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000727_5955584.pth... [2024-08-05 21:20:28,138][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000658_5390336.pth [2024-08-05 21:20:28,146][52614] Saving new best policy, reward=-4.813! [2024-08-05 21:20:28,623][52659] DAMAGECOUNT value on done: 262.0 [2024-08-05 21:20:28,635][52659] Sum rewards: -1.677, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.728', 'weapon4': '0.004', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.073', 'ARMOR': '0.084', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.723', 'weapon3': '1.164', 'weapon2': '1.708', 'FRAGCOUNT': '2.000'} [2024-08-05 21:20:32,078][52669] DAMAGECOUNT value on done: 250.0 [2024-08-05 21:20:32,819][52567] Fps is (10 sec: 1635.4, 60 sec: 1910.9, 300 sec: 2249.2). Total num frames: 5955584. Throughput: 0: 522.3. Samples: 1498170. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:20:32,834][52567] Avg episode reward: [(0, '-4.723')] [2024-08-05 21:20:33,683][52614] Saving new best policy, reward=-4.723! [2024-08-05 21:20:34,505][52649] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:20:34,525][52649] Sum rewards: -3.428, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.730', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'weapon4': '0.220', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.120', 'weapon3': '1.336'} [2024-08-05 21:20:37,457][52667] DAMAGECOUNT value on done: 79.0 [2024-08-05 21:20:37,553][52667] Sum rewards: -5.577, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'HITCOUNT': '0.080', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'HEALTH': '0.154', 'DAMAGECOUNT': '0.237', 'weapon4': '0.340', 'WEAPON3': '0.500', 'weapon3': '0.694', 'weapon2': '1.480'} [2024-08-05 21:20:37,803][52567] Fps is (10 sec: 1637.2, 60 sec: 2047.9, 300 sec: 2304.8). Total num frames: 5971968. Throughput: 0: 533.3. Samples: 1501060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:20:37,809][52567] Avg episode reward: [(0, '-4.731')] [2024-08-05 21:20:39,252][52647] DAMAGECOUNT value on done: 345.0 [2024-08-05 21:20:39,282][52647] Sum rewards: -2.352, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.148', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.096', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.020', 'weapon2': '1.236', 'weapon3': '1.484', 'FRAGCOUNT': '2.000'} [2024-08-05 21:20:40,824][52665] DAMAGECOUNT value on done: 216.0 [2024-08-05 21:20:40,833][52665] Sum rewards: -6.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.658', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'ARMOR': '0.056', 'AMMO3': '0.138', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.322', 'weapon3': '1.536'} [2024-08-05 21:20:41,916][52794] DAMAGECOUNT value on done: 187.0 [2024-08-05 21:20:42,246][52666] DAMAGECOUNT value on done: 74.0 [2024-08-05 21:20:42,796][52567] Fps is (10 sec: 2463.0, 60 sec: 2048.2, 300 sec: 2332.7). Total num frames: 5980160. Throughput: 0: 545.6. Samples: 1502570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:20:42,799][52567] Avg episode reward: [(0, '-4.736')] [2024-08-05 21:20:42,917][52668] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:20:43,635][52650] Updated weights for policy 0, policy_version 731 (0.0075) [2024-08-05 21:20:43,664][52658] DAMAGECOUNT value on done: 131.0 [2024-08-05 21:20:45,525][52663] DAMAGECOUNT value on done: 5.0 [2024-08-05 21:20:47,727][52671] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:20:47,796][52567] Fps is (10 sec: 2459.3, 60 sec: 2184.8, 300 sec: 2388.9). Total num frames: 5996544. Throughput: 0: 576.0. Samples: 1505770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:20:47,812][52567] Avg episode reward: [(0, '-4.722')] [2024-08-05 21:20:47,822][52614] Saving new best policy, reward=-4.722! [2024-08-05 21:20:49,132][52662] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:20:50,348][52660] DAMAGECOUNT value on done: 64.0 [2024-08-05 21:20:50,362][52660] Sum rewards: -3.398, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.684', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.017', 'HITCOUNT': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.084', 'DAMAGECOUNT': '0.096', 'ARMOR': '0.152', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.480', 'weapon3': '0.808', 'weapon2': '1.346'} [2024-08-05 21:20:51,073][52664] DAMAGECOUNT value on done: 183.0 [2024-08-05 21:20:51,680][52670] DAMAGECOUNT value on done: 154.0 [2024-08-05 21:20:51,699][52670] Sum rewards: -8.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.154', 'AMMO2': '0.001', 'AMMO4': '0.003', 'HITCOUNT': '0.100', 'AMMO3': '0.195', 'DAMAGECOUNT': '0.375', 'FRAGCOUNT': '1.000', 'weapon2': '1.044', 'WEAPON3': '1.100', 'weapon3': '1.666'} [2024-08-05 21:20:52,798][52567] Fps is (10 sec: 2457.0, 60 sec: 2184.6, 300 sec: 2388.2). Total num frames: 6004736. Throughput: 0: 618.7. Samples: 1509460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:20:52,806][52567] Avg episode reward: [(0, '-4.736')] [2024-08-05 21:20:52,992][52659] DAMAGECOUNT value on done: 97.0 [2024-08-05 21:20:53,063][52659] Sum rewards: -3.657, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.034', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.108', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.064', 'weapon3': '1.678'} [2024-08-05 21:20:55,237][52669] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:20:55,239][52669] Sum rewards: 0.465, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.345', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon5': '0.058', 'ARMOR': '0.060', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.274', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.500', 'weapon2': '1.128', 'weapon3': '1.214', 'FRAGCOUNT': '2.000'} [2024-08-05 21:20:56,449][52649] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:20:57,795][52567] Fps is (10 sec: 2457.8, 60 sec: 2321.3, 300 sec: 2416.1). Total num frames: 6021120. Throughput: 0: 636.5. Samples: 1511060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:20:57,798][52567] Avg episode reward: [(0, '-4.723')] [2024-08-05 21:20:59,320][52667] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:21:01,128][52647] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:21:02,796][52567] Fps is (10 sec: 2458.0, 60 sec: 2457.6, 300 sec: 2360.5). Total num frames: 6029312. Throughput: 0: 640.7. Samples: 1515060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:21:02,802][52567] Avg episode reward: [(0, '-4.675')] [2024-08-05 21:21:02,913][52665] DAMAGECOUNT value on done: 176.0 [2024-08-05 21:21:02,926][52665] Sum rewards: -3.488, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.686', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.015', 'weapon5': '0.042', 'AMMO4': '0.050', 'HITCOUNT': '0.050', 'weapon4': '0.060', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.141', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.158', 'weapon2': '1.322'} [2024-08-05 21:21:03,415][52614] Saving new best policy, reward=-4.675! [2024-08-05 21:21:04,237][52794] DAMAGECOUNT value on done: 90.0 [2024-08-05 21:21:04,863][52666] DAMAGECOUNT value on done: 132.0 [2024-08-05 21:21:04,872][52666] Sum rewards: -5.373, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.602', 'AMMO2': '0.001', 'AMMO4': '0.002', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.120', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '1.362'} [2024-08-05 21:21:06,173][52668] DAMAGECOUNT value on done: 224.0 [2024-08-05 21:21:07,541][52658] DAMAGECOUNT value on done: 101.0 [2024-08-05 21:21:07,552][52658] Sum rewards: -3.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.092', 'AMMO2': '0.014', 'HITCOUNT': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'DAMAGECOUNT': '0.075', 'ARMOR': '0.094', 'AMMO3': '0.117', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon2': '0.910', 'FRAGCOUNT': '1.000', 'weapon3': '1.592'} [2024-08-05 21:21:07,801][52567] Fps is (10 sec: 1637.5, 60 sec: 2457.6, 300 sec: 2360.4). Total num frames: 6037504. Throughput: 0: 522.4. Samples: 1516570. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:21:07,814][52567] Avg episode reward: [(0, '-4.584')] [2024-08-05 21:21:07,828][52614] Saving new best policy, reward=-4.584! [2024-08-05 21:21:10,148][52663] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:21:10,188][52663] Sum rewards: -5.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.080', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'HITCOUNT': '0.100', 'weapon4': '0.112', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.034', 'weapon3': '1.596'} [2024-08-05 21:21:12,800][52567] Fps is (10 sec: 818.8, 60 sec: 2320.9, 300 sec: 2332.6). Total num frames: 6037504. Throughput: 0: 506.6. Samples: 1518260. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:21:12,802][52567] Avg episode reward: [(0, '-4.574')] [2024-08-05 21:21:14,381][52614] Saving new best policy, reward=-4.574! [2024-08-05 21:21:16,517][52671] DAMAGECOUNT value on done: 137.0 [2024-08-05 21:21:16,547][52671] Sum rewards: -1.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.208', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'AMMO4': '0.078', 'AMMO3': '0.080', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.210', 'DAMAGECOUNT': '0.351', 'WEAPON3': '0.450', 'weapon3': '1.170', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'} [2024-08-05 21:21:17,800][52567] Fps is (10 sec: 819.2, 60 sec: 2047.9, 300 sec: 2304.8). Total num frames: 6045696. Throughput: 0: 462.4. Samples: 1518970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:21:17,808][52567] Avg episode reward: [(0, '-4.566')] [2024-08-05 21:21:19,137][52614] Saving new best policy, reward=-4.566! [2024-08-05 21:21:19,468][52662] DAMAGECOUNT value on done: 254.0 [2024-08-05 21:21:19,484][52662] Sum rewards: -4.328, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.132', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.288', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'weapon2': '1.294'} [2024-08-05 21:21:20,975][52660] DAMAGECOUNT value on done: 221.0 [2024-08-05 21:21:20,978][52660] Sum rewards: -3.086, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.470', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.024', 'ARMOR': '0.040', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.160', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.663', 'weapon3': '1.336', 'weapon2': '1.440', 'FRAGCOUNT': '2.000'} [2024-08-05 21:21:21,770][52664] DAMAGECOUNT value on done: 283.0 [2024-08-05 21:21:21,808][52664] Sum rewards: -5.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.850', 'weapon2': '1.072', 'weapon3': '1.742', 'FRAGCOUNT': '3.000'} [2024-08-05 21:21:22,211][52670] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:21:22,223][52670] Sum rewards: -4.104, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.753', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon5': '0.020', 'AMMO4': '0.034', 'ARMOR': '0.064', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'weapon4': '0.206', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.500', 'weapon3': '0.756', 'FRAGCOUNT': '1.500', 'weapon2': '1.956'} [2024-08-05 21:21:22,800][52567] Fps is (10 sec: 1638.6, 60 sec: 1911.4, 300 sec: 2277.1). Total num frames: 6053888. Throughput: 0: 462.3. Samples: 1521860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:21:22,809][52567] Avg episode reward: [(0, '-4.510')] [2024-08-05 21:21:23,779][52659] DAMAGECOUNT value on done: 250.0 [2024-08-05 21:21:24,544][52614] Saving new best policy, reward=-4.510! [2024-08-05 21:21:25,980][52669] DAMAGECOUNT value on done: 209.0 [2024-08-05 21:21:25,984][52669] Sum rewards: -2.292, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.662', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.012', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.070', 'weapon4': '0.090', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.324', 'weapon3': '1.324'} [2024-08-05 21:21:27,392][52649] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:21:27,799][52567] Fps is (10 sec: 1638.8, 60 sec: 1774.9, 300 sec: 2249.3). Total num frames: 6062080. Throughput: 0: 461.7. Samples: 1523350. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:21:27,808][52567] Avg episode reward: [(0, '-4.573')] [2024-08-05 21:21:29,245][52650] Updated weights for policy 0, policy_version 741 (0.0371) [2024-08-05 21:21:30,650][52667] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:21:32,269][52647] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:21:32,277][52647] Sum rewards: -1.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.034', 'AMMO2': '0.007', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO4': '0.036', 'HITCOUNT': '0.040', 'weapon5': '0.078', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.114', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.274', 'weapon3': '1.350', 'FRAGCOUNT': '2.000'} [2024-08-05 21:21:32,798][52567] Fps is (10 sec: 2458.0, 60 sec: 2048.7, 300 sec: 2277.1). Total num frames: 6078464. Throughput: 0: 473.1. Samples: 1527060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:21:32,806][52567] Avg episode reward: [(0, '-4.567')] [2024-08-05 21:21:34,000][52665] DAMAGECOUNT value on done: 220.0 [2024-08-05 21:21:34,025][52665] Sum rewards: -3.778, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'ARMOR': '0.040', 'weapon4': '0.060', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'weapon2': '1.324', 'weapon3': '1.400', 'FRAGCOUNT': '2.000'} [2024-08-05 21:21:35,070][52794] DAMAGECOUNT value on done: 10.0 [2024-08-05 21:21:35,406][52666] DAMAGECOUNT value on done: 206.0 [2024-08-05 21:21:35,828][52658] DAMAGECOUNT value on done: 154.0 [2024-08-05 21:21:35,833][52658] Sum rewards: -1.569, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO2': '0.017', 'HITCOUNT': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.105', 'DAMAGECOUNT': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.228', 'ARMOR': '0.477', 'WEAPON3': '0.650', 'weapon2': '0.826', 'weapon3': '1.538', 'FRAGCOUNT': '2.000'} [2024-08-05 21:21:36,209][52668] DAMAGECOUNT value on done: 260.0 [2024-08-05 21:21:37,796][52567] Fps is (10 sec: 2458.0, 60 sec: 1911.7, 300 sec: 2249.3). Total num frames: 6086656. Throughput: 0: 466.9. Samples: 1530470. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:21:37,800][52567] Avg episode reward: [(0, '-4.504')] [2024-08-05 21:21:37,848][52663] DAMAGECOUNT value on done: 157.0 [2024-08-05 21:21:38,578][52614] Saving new best policy, reward=-4.504! [2024-08-05 21:21:39,923][52671] DAMAGECOUNT value on done: 171.0 [2024-08-05 21:21:41,225][52662] DAMAGECOUNT value on done: 155.0 [2024-08-05 21:21:42,242][52660] DAMAGECOUNT value on done: 195.0 [2024-08-05 21:21:42,258][52660] Sum rewards: -4.417, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.316', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.102', 'HITCOUNT': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.296', 'weapon2': '1.532'} [2024-08-05 21:21:42,800][52567] Fps is (10 sec: 2457.3, 60 sec: 2047.9, 300 sec: 2221.5). Total num frames: 6103040. Throughput: 0: 475.7. Samples: 1532470. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:21:42,808][52567] Avg episode reward: [(0, '-4.626')] [2024-08-05 21:21:43,291][52664] DAMAGECOUNT value on done: 240.0 [2024-08-05 21:21:43,302][52664] Sum rewards: -5.202, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.246', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.850', 'weapon2': '0.864', 'FRAGCOUNT': '1.000', 'weapon3': '1.564'} [2024-08-05 21:21:43,954][52670] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:21:45,323][52659] DAMAGECOUNT value on done: 327.0 [2024-08-05 21:21:45,337][52659] Sum rewards: -1.775, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.628', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.129', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.400', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.750', 'weapon3': '1.132', 'weapon2': '1.238', 'FRAGCOUNT': '5.000'} [2024-08-05 21:21:47,797][52567] Fps is (10 sec: 2457.5, 60 sec: 1911.4, 300 sec: 2221.6). Total num frames: 6111232. Throughput: 0: 462.2. Samples: 1535860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:21:47,801][52567] Avg episode reward: [(0, '-4.641')] [2024-08-05 21:21:47,899][52669] DAMAGECOUNT value on done: 260.0 [2024-08-05 21:21:47,914][52669] Sum rewards: -4.879, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.624', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.115', 'HITCOUNT': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon2': '1.444', 'weapon3': '1.478'} [2024-08-05 21:21:50,541][52649] DAMAGECOUNT value on done: 140.0 [2024-08-05 21:21:52,798][52567] Fps is (10 sec: 1638.5, 60 sec: 1911.4, 300 sec: 2193.8). Total num frames: 6119424. Throughput: 0: 490.7. Samples: 1538650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:21:52,805][52567] Avg episode reward: [(0, '-4.608')] [2024-08-05 21:21:54,456][52667] DAMAGECOUNT value on done: 390.0 [2024-08-05 21:21:54,477][52667] Sum rewards: -0.258, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.952', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.024', 'weapon7': '0.064', 'AMMO4': '0.077', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.933', 'weapon2': '1.254', 'weapon3': '1.274', 'FRAGCOUNT': '2.000'} [2024-08-05 21:21:56,327][52647] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:21:57,810][52567] Fps is (10 sec: 2454.5, 60 sec: 1911.0, 300 sec: 2193.7). Total num frames: 6135808. Throughput: 0: 479.7. Samples: 1539850. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:21:57,825][52567] Avg episode reward: [(0, '-4.526')] [2024-08-05 21:21:58,071][52665] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:21:59,300][52794] DAMAGECOUNT value on done: 218.0 [2024-08-05 21:21:59,303][52794] Sum rewards: -3.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.948', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.052', 'weapon4': '0.086', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.133', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.650', 'weapon2': '1.304', 'weapon3': '1.586', 'FRAGCOUNT': '3.000'} [2024-08-05 21:21:59,834][52666] DAMAGECOUNT value on done: 255.0 [2024-08-05 21:21:59,843][52666] Sum rewards: -4.127, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.325', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.048', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'DAMAGECOUNT': '0.255', 'weapon4': '0.256', 'WEAPON3': '0.450', 'weapon3': '0.920', 'FRAGCOUNT': '1.000', 'weapon2': '1.520'} [2024-08-05 21:22:00,399][52668] DAMAGECOUNT value on done: 25.0 [2024-08-05 21:22:00,456][52658] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:22:02,797][52567] Fps is (10 sec: 2457.9, 60 sec: 1911.4, 300 sec: 2166.0). Total num frames: 6144000. Throughput: 0: 531.2. Samples: 1542870. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:22:02,806][52567] Avg episode reward: [(0, '-4.519')] [2024-08-05 21:22:02,857][52663] DAMAGECOUNT value on done: 247.0 [2024-08-05 21:22:02,877][52663] Sum rewards: -5.655, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.116', 'AMMO2': '0.017', 'ARMOR': '0.032', 'AMMO4': '0.082', 'weapon4': '0.122', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.250', 'weapon2': '1.626'} [2024-08-05 21:22:04,788][52650] Updated weights for policy 0, policy_version 751 (0.0394) [2024-08-05 21:22:04,804][52671] DAMAGECOUNT value on done: 352.0 [2024-08-05 21:22:05,944][52662] DAMAGECOUNT value on done: 265.0 [2024-08-05 21:22:05,957][52662] Sum rewards: -3.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.376', 'AMMO2': '0.012', 'ARMOR': '0.018', 'AMMO4': '0.059', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.194', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.720', 'weapon3': '0.968', 'weapon2': '1.664', 'FRAGCOUNT': '4.000'} [2024-08-05 21:22:06,919][52660] DAMAGECOUNT value on done: 44.0 [2024-08-05 21:22:07,598][52664] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:22:07,614][52664] Sum rewards: -2.027, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.021', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'ARMOR': '0.110', 'weapon4': '0.114', 'HITCOUNT': '0.120', 'HEALTH': '0.236', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.500', 'weapon3': '0.712', 'FRAGCOUNT': '1.000', 'weapon2': '1.940'} [2024-08-05 21:22:07,802][52567] Fps is (10 sec: 2459.5, 60 sec: 2048.0, 300 sec: 2166.0). Total num frames: 6160384. Throughput: 0: 555.7. Samples: 1546870. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:22:07,810][52567] Avg episode reward: [(0, '-4.467')] [2024-08-05 21:22:07,817][52614] Saving new best policy, reward=-4.467! [2024-08-05 21:22:08,117][52670] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:22:08,127][52670] Sum rewards: -4.337, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.945', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'HITCOUNT': '0.090', 'AMMO3': '0.135', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.296', 'weapon3': '1.722'} [2024-08-05 21:22:09,305][52659] DAMAGECOUNT value on done: 189.0 [2024-08-05 21:22:09,311][52659] Sum rewards: -4.675, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.027', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.200', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.216', 'weapon2': '1.264'} [2024-08-05 21:22:11,225][52669] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:22:12,720][52649] DAMAGECOUNT value on done: 265.0 [2024-08-05 21:22:12,724][52649] Sum rewards: 1.302, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.067', 'weapon4': '0.102', 'HITCOUNT': '0.150', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.555', 'HEALTH': '0.680', 'FRAGCOUNT': '1.000', 'weapon2': '1.100', 'weapon3': '1.678'} [2024-08-05 21:22:12,748][52795] DAMAGECOUNT value on done: 140.0 [2024-08-05 21:22:12,780][52795] Sum rewards: -5.010, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.254', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.022', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.056', 'ARMOR': '0.084', 'AMMO4': '0.104', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.256', 'weapon3': '0.792', 'weapon2': '1.496'} [2024-08-05 21:22:12,796][52567] Fps is (10 sec: 2457.8, 60 sec: 2184.7, 300 sec: 2138.2). Total num frames: 6168576. Throughput: 0: 567.1. Samples: 1548870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:22:12,799][52567] Avg episode reward: [(0, '-4.429')] [2024-08-05 21:22:12,802][52614] Saving new best policy, reward=-4.429! [2024-08-05 21:22:15,771][52667] DAMAGECOUNT value on done: 271.0 [2024-08-05 21:22:17,582][52647] DAMAGECOUNT value on done: 177.0 [2024-08-05 21:22:17,809][52567] Fps is (10 sec: 1637.2, 60 sec: 2184.2, 300 sec: 2138.2). Total num frames: 6176768. Throughput: 0: 564.5. Samples: 1552470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:22:17,814][52567] Avg episode reward: [(0, '-4.375')] [2024-08-05 21:22:18,355][52614] Saving new best policy, reward=-4.375! [2024-08-05 21:22:19,960][52665] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:22:21,010][52794] DAMAGECOUNT value on done: 514.0 [2024-08-05 21:22:21,020][52794] Sum rewards: -5.721, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.700', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.021', 'weapon5': '0.022', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.310', 'ARMOR': '0.470', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.972', 'FRAGCOUNT': '1.000', 'weapon3': '1.214', 'weapon2': '1.314'} [2024-08-05 21:22:21,075][52666] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:22:21,972][52658] DAMAGECOUNT value on done: 85.0 [2024-08-05 21:22:21,988][52668] DAMAGECOUNT value on done: 337.0 [2024-08-05 21:22:21,991][52668] Sum rewards: 2.830, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.836', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'ARMOR': '0.108', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'weapon4': '0.396', 'weapon3': '0.824', 'DAMAGECOUNT': '0.891', 'weapon2': '1.694', 'FRAGCOUNT': '5.000'} [2024-08-05 21:22:22,799][52567] Fps is (10 sec: 1638.2, 60 sec: 2184.6, 300 sec: 2138.2). Total num frames: 6184960. Throughput: 0: 554.6. Samples: 1555430. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:22:22,807][52567] Avg episode reward: [(0, '-4.254')] [2024-08-05 21:22:23,410][52811] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:22:23,430][52811] Sum rewards: -3.494, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.735', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'FRAGCOUNT': '1.000', 'weapon3': '1.336', 'weapon2': '1.496'} [2024-08-05 21:22:23,953][52614] Saving new best policy, reward=-4.254! [2024-08-05 21:22:27,810][52567] Fps is (10 sec: 1639.1, 60 sec: 2184.3, 300 sec: 2110.4). Total num frames: 6193152. Throughput: 0: 510.2. Samples: 1555430. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:22:27,834][52567] Avg episode reward: [(0, '-4.234')] [2024-08-05 21:22:27,935][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000756_6193152.pth... [2024-08-05 21:22:28,366][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000699_5726208.pth [2024-08-05 21:22:28,387][52614] Saving new best policy, reward=-4.234! [2024-08-05 21:22:29,516][52663] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:22:32,802][52567] Fps is (10 sec: 818.9, 60 sec: 1911.3, 300 sec: 2027.2). Total num frames: 6193152. Throughput: 0: 470.4. Samples: 1557030. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:22:32,814][52567] Avg episode reward: [(0, '-4.303')] [2024-08-05 21:22:34,663][52671] DAMAGECOUNT value on done: 103.0 [2024-08-05 21:22:36,410][52662] DAMAGECOUNT value on done: 85.0 [2024-08-05 21:22:36,434][52662] Sum rewards: -4.880, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.266', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.032', 'weapon5': '0.032', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'DAMAGECOUNT': '0.195', 'weapon4': '0.254', 'WEAPON3': '0.750', 'weapon3': '0.998', 'FRAGCOUNT': '1.000', 'weapon2': '1.698'} [2024-08-05 21:22:37,455][52660] DAMAGECOUNT value on done: 63.0 [2024-08-05 21:22:37,805][52567] Fps is (10 sec: 819.2, 60 sec: 1911.2, 300 sec: 2027.1). Total num frames: 6201344. Throughput: 0: 458.2. Samples: 1559270. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:22:37,819][52567] Avg episode reward: [(0, '-4.314')] [2024-08-05 21:22:38,575][52664] DAMAGECOUNT value on done: 240.0 [2024-08-05 21:22:39,125][52670] DAMAGECOUNT value on done: 136.0 [2024-08-05 21:22:39,136][52670] Sum rewards: -1.973, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.011', 'HEALTH': '0.052', 'AMMO4': '0.053', 'AMMO3': '0.078', 'HITCOUNT': '0.080', 'ARMOR': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.298', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.363', 'weapon3': '0.702', 'FRAGCOUNT': '1.000', 'weapon2': '1.556'} [2024-08-05 21:22:40,803][52659] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:22:40,827][52659] Sum rewards: -5.797, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.037', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.017', 'AMMO3': '0.036', 'ARMOR': '0.036', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.076', 'DAMAGECOUNT': '0.120', 'WEAPON3': '0.200', 'WEAPON5': '0.200', 'weapon3': '0.528', 'weapon2': '2.150'} [2024-08-05 21:22:42,529][52669] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:22:42,799][52567] Fps is (10 sec: 2458.1, 60 sec: 1911.5, 300 sec: 1999.4). Total num frames: 6217728. Throughput: 0: 461.9. Samples: 1560630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:22:42,807][52567] Avg episode reward: [(0, '-4.272')] [2024-08-05 21:22:44,365][52649] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:22:44,374][52649] Sum rewards: -4.279, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.119', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.170', 'weapon4': '0.248', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.358', 'weapon3': '1.362'} [2024-08-05 21:22:44,420][52795] DAMAGECOUNT value on done: 56.0 [2024-08-05 21:22:46,906][52803] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:22:47,242][52667] DAMAGECOUNT value on done: 66.0 [2024-08-05 21:22:47,810][52567] Fps is (10 sec: 2459.3, 60 sec: 1911.4, 300 sec: 1971.6). Total num frames: 6225920. Throughput: 0: 474.7. Samples: 1564230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:22:47,826][52567] Avg episode reward: [(0, '-4.341')] [2024-08-05 21:22:49,117][52650] Updated weights for policy 0, policy_version 761 (0.0585) [2024-08-05 21:22:49,143][52647] DAMAGECOUNT value on done: 80.0 [2024-08-05 21:22:50,668][52665] DAMAGECOUNT value on done: 189.0 [2024-08-05 21:22:50,677][52665] Sum rewards: -6.247, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.563', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.032', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.070', 'HITCOUNT': '0.110', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.462', 'WEAPON3': '0.750', 'weapon3': '1.124', 'weapon2': '1.810'} [2024-08-05 21:22:51,216][52794] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:22:51,231][52794] Sum rewards: -6.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.432', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.168', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.428', 'weapon3': '1.584'} [2024-08-05 21:22:51,256][52666] DAMAGECOUNT value on done: 191.0 [2024-08-05 21:22:51,257][52666] Sum rewards: -4.014, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.469', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.134', 'weapon4': '0.162', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.850', 'ARMOR': '0.957', 'FRAGCOUNT': '1.000', 'weapon2': '1.406', 'weapon3': '1.496'} [2024-08-05 21:22:51,898][52658] DAMAGECOUNT value on done: 178.0 [2024-08-05 21:22:51,909][52658] Sum rewards: -5.141, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.968', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.204', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.800', 'weapon3': '1.200', 'weapon2': '1.330', 'FRAGCOUNT': '2.000'} [2024-08-05 21:22:51,919][52668] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:22:52,800][52567] Fps is (10 sec: 2457.6, 60 sec: 2048.0, 300 sec: 1999.4). Total num frames: 6242304. Throughput: 0: 474.7. Samples: 1568230. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:22:52,807][52567] Avg episode reward: [(0, '-4.415')] [2024-08-05 21:22:53,117][52811] DAMAGECOUNT value on done: 58.0 [2024-08-05 21:22:54,296][52663] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:22:56,052][52671] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:22:56,058][52671] Sum rewards: -0.071, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.168', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.032', 'ARMOR': '0.072', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.934', 'weapon3': '1.838', 'FRAGCOUNT': '2.000'} [2024-08-05 21:22:57,483][52662] DAMAGECOUNT value on done: 212.0 [2024-08-05 21:22:57,495][52662] Sum rewards: -3.837, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.072', 'AMMO3': '0.116', 'HEALTH': '0.152', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.316', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.636', 'weapon3': '1.104', 'weapon2': '1.346', 'FRAGCOUNT': '2.000'} [2024-08-05 21:22:57,798][52567] Fps is (10 sec: 3276.9, 60 sec: 2048.4, 300 sec: 1971.6). Total num frames: 6258688. Throughput: 0: 470.7. Samples: 1570050. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:22:57,806][52567] Avg episode reward: [(0, '-4.339')] [2024-08-05 21:22:58,708][52660] DAMAGECOUNT value on done: 154.0 [2024-08-05 21:22:59,509][52664] DAMAGECOUNT value on done: 112.0 [2024-08-05 21:22:59,513][52664] Sum rewards: -4.298, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.599', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.014', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.246', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.236', 'weapon3': '1.708'} [2024-08-05 21:22:59,773][52670] DAMAGECOUNT value on done: 433.0 [2024-08-05 21:22:59,780][52670] Sum rewards: -1.608, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.759', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon4': '0.108', 'AMMO3': '0.110', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.164', 'weapon3': '1.266', 'weapon2': '1.486', 'FRAGCOUNT': '2.000'} [2024-08-05 21:23:00,727][52659] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:23:02,161][52820] DAMAGECOUNT value on done: 177.0 [2024-08-05 21:23:02,171][52820] Sum rewards: -1.809, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.003', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.056', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon4': '0.116', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.531', 'weapon3': '1.188', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 21:23:02,437][52669] DAMAGECOUNT value on done: 120.0 [2024-08-05 21:23:02,799][52567] Fps is (10 sec: 2457.7, 60 sec: 2048.0, 300 sec: 1971.6). Total num frames: 6266880. Throughput: 0: 479.7. Samples: 1574050. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:23:02,805][52567] Avg episode reward: [(0, '-4.421')] [2024-08-05 21:23:03,637][52649] DAMAGECOUNT value on done: 152.0 [2024-08-05 21:23:03,647][52649] Sum rewards: -3.565, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.530', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'weapon5': '0.010', 'weapon4': '0.048', 'HITCOUNT': '0.060', 'AMMO3': '0.089', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.675', 'weapon3': '0.744', 'FRAGCOUNT': '1.000', 'weapon2': '1.768'} [2024-08-05 21:23:03,675][52795] DAMAGECOUNT value on done: 260.0 [2024-08-05 21:23:05,219][52803] DAMAGECOUNT value on done: 286.0 [2024-08-05 21:23:05,227][52803] Sum rewards: -5.133, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.116', 'HITCOUNT': '0.160', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.513', 'WEAPON3': '1.100', 'weapon2': '1.192', 'weapon3': '1.380', 'FRAGCOUNT': '2.000'} [2024-08-05 21:23:05,457][52667] DAMAGECOUNT value on done: 117.0 [2024-08-05 21:23:05,464][52667] Sum rewards: -3.528, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'weapon5': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.008', 'weapon3': '1.800'} [2024-08-05 21:23:06,701][52647] DAMAGECOUNT value on done: 137.0 [2024-08-05 21:23:07,797][52567] Fps is (10 sec: 3277.3, 60 sec: 2184.7, 300 sec: 1999.4). Total num frames: 6291456. Throughput: 0: 529.1. Samples: 1579240. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:23:07,803][52567] Avg episode reward: [(0, '-4.328')] [2024-08-05 21:23:08,427][52794] DAMAGECOUNT value on done: 210.0 [2024-08-05 21:23:08,430][52794] Sum rewards: -5.186, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.474', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.394', 'weapon3': '1.438'} [2024-08-05 21:23:08,478][52666] DAMAGECOUNT value on done: 261.0 [2024-08-05 21:23:08,493][52666] Sum rewards: -3.513, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.794', 'AMMO2': '0.003', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.180', 'weapon4': '0.196', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.422'} [2024-08-05 21:23:09,037][52658] DAMAGECOUNT value on done: 149.0 [2024-08-05 21:23:09,053][52658] Sum rewards: -3.776, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.578', 'ARMOR': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.088', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.357', 'WEAPON3': '0.500', 'weapon3': '0.876', 'FRAGCOUNT': '1.000', 'weapon2': '1.818'} [2024-08-05 21:23:09,075][52668] DAMAGECOUNT value on done: 134.0 [2024-08-05 21:23:09,076][52668] Sum rewards: -6.994, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.964', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.105', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.267', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.134', 'weapon2': '1.296'} [2024-08-05 21:23:09,802][52811] DAMAGECOUNT value on done: 0.0 [2024-08-05 21:23:10,720][52663] DAMAGECOUNT value on done: 225.0 [2024-08-05 21:23:10,730][52663] Sum rewards: -3.594, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.433', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'ARMOR': '0.080', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'WEAPON4': '0.250', 'weapon4': '0.292', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.550', 'weapon3': '0.980', 'FRAGCOUNT': '1.000', 'weapon2': '1.434'} [2024-08-05 21:23:11,812][52671] DAMAGECOUNT value on done: 205.0 [2024-08-05 21:23:12,799][52567] Fps is (10 sec: 4095.9, 60 sec: 2321.0, 300 sec: 2027.1). Total num frames: 6307840. Throughput: 0: 582.5. Samples: 1581640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:23:12,801][52567] Avg episode reward: [(0, '-4.224')] [2024-08-05 21:23:12,801][52614] Saving new best policy, reward=-4.224! [2024-08-05 21:23:13,113][52662] DAMAGECOUNT value on done: 89.0 [2024-08-05 21:23:14,194][52660] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:23:14,204][52660] Sum rewards: -3.106, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'AMMO2': '0.000', 'AMMO4': '0.000', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.110', 'weapon4': '0.172', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.513', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.370', 'weapon3': '1.420'} [2024-08-05 21:23:15,052][52664] DAMAGECOUNT value on done: 136.0 [2024-08-05 21:23:15,437][52670] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:23:15,468][52670] Sum rewards: -4.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO2': '0.025', 'ARMOR': '0.080', 'AMMO3': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.123', 'weapon4': '0.144', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.512'} [2024-08-05 21:23:16,864][52650] Updated weights for policy 0, policy_version 771 (0.0123) [2024-08-05 21:23:16,941][52659] DAMAGECOUNT value on done: 315.0 [2024-08-05 21:23:16,951][52659] Sum rewards: -8.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.932', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.244', 'weapon3': '1.854'} [2024-08-05 21:23:17,804][52567] Fps is (10 sec: 2456.2, 60 sec: 2321.4, 300 sec: 2027.2). Total num frames: 6316032. Throughput: 0: 644.7. Samples: 1586040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:23:17,850][52567] Avg episode reward: [(0, '-4.305')] [2024-08-05 21:23:19,483][52820] DAMAGECOUNT value on done: 367.0 [2024-08-05 21:23:19,491][52820] Sum rewards: -1.726, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.716', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.891', 'weapon3': '1.436', 'weapon2': '1.472', 'FRAGCOUNT': '4.000'} [2024-08-05 21:23:20,132][52669] DAMAGECOUNT value on done: 261.0 [2024-08-05 21:23:21,746][52795] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:23:22,799][52567] Fps is (10 sec: 1638.7, 60 sec: 2321.1, 300 sec: 2027.2). Total num frames: 6324224. Throughput: 0: 661.4. Samples: 1589030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:23:22,819][52567] Avg episode reward: [(0, '-4.280')] [2024-08-05 21:23:24,339][52803] DAMAGECOUNT value on done: 74.0 [2024-08-05 21:23:24,668][52667] DAMAGECOUNT value on done: 135.0 [2024-08-05 21:23:26,775][52647] DAMAGECOUNT value on done: 74.0 [2024-08-05 21:23:27,794][52567] Fps is (10 sec: 2459.3, 60 sec: 2458.0, 300 sec: 2055.0). Total num frames: 6340608. Throughput: 0: 675.6. Samples: 1591030. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:23:27,796][52567] Avg episode reward: [(0, '-4.239')] [2024-08-05 21:23:29,154][52794] DAMAGECOUNT value on done: 341.0 [2024-08-05 21:23:29,176][52794] Sum rewards: -4.405, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.960', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'HITCOUNT': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.206', 'DAMAGECOUNT': '0.453', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.050', 'weapon2': '1.630'} [2024-08-05 21:23:29,207][52666] DAMAGECOUNT value on done: 165.0 [2024-08-05 21:23:29,944][52668] DAMAGECOUNT value on done: 244.0 [2024-08-05 21:23:29,956][52668] Sum rewards: -1.859, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.638', 'AMMO2': '0.007', 'AMMO4': '0.035', 'HITCOUNT': '0.050', 'ARMOR': '0.056', 'weapon7': '0.070', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.248', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.272', 'weapon2': '1.298'} [2024-08-05 21:23:29,946][52658] DAMAGECOUNT value on done: 309.0 [2024-08-05 21:23:29,972][52658] Sum rewards: -3.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.363', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'weapon4': '0.038', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'AMMO3': '0.164', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.800', 'weapon2': '1.252', 'weapon3': '1.790', 'FRAGCOUNT': '2.000'} [2024-08-05 21:23:30,978][52811] DAMAGECOUNT value on done: 330.0 [2024-08-05 21:23:30,985][52811] Sum rewards: -1.257, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.774', 'AMMO2': '0.008', 'AMMO4': '0.042', 'ARMOR': '0.058', 'AMMO3': '0.080', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.345', 'weapon4': '0.378', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon2': '1.126', 'weapon3': '1.150'} [2024-08-05 21:23:32,383][52663] DAMAGECOUNT value on done: 284.0 [2024-08-05 21:23:32,390][52663] Sum rewards: -5.049, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.096', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.115', 'HITCOUNT': '0.170', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '1.000', 'weapon3': '1.034', 'weapon2': '1.520'} [2024-08-05 21:23:32,800][52567] Fps is (10 sec: 2456.9, 60 sec: 2594.2, 300 sec: 2054.9). Total num frames: 6348800. Throughput: 0: 671.3. Samples: 1594440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:23:32,808][52567] Avg episode reward: [(0, '-4.255')] [2024-08-05 21:23:34,473][52671] DAMAGECOUNT value on done: 135.0 [2024-08-05 21:23:36,227][52662] DAMAGECOUNT value on done: 90.0 [2024-08-05 21:23:37,265][52660] DAMAGECOUNT value on done: 124.0 [2024-08-05 21:23:37,803][52567] Fps is (10 sec: 1637.2, 60 sec: 2594.2, 300 sec: 2054.9). Total num frames: 6356992. Throughput: 0: 657.3. Samples: 1597810. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:23:37,813][52567] Avg episode reward: [(0, '-4.285')] [2024-08-05 21:23:38,591][52664] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:23:38,629][52664] Sum rewards: -1.827, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.088', 'HITCOUNT': '0.100', 'AMMO3': '0.116', 'HEALTH': '0.182', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.364', 'weapon3': '1.624'} [2024-08-05 21:23:39,404][52670] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:23:39,418][52670] Sum rewards: -6.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.598', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'ARMOR': '0.528', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.304', 'weapon3': '1.544', 'FRAGCOUNT': '2.000'} [2024-08-05 21:23:41,848][52659] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:23:41,866][52659] Sum rewards: -9.558, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.824', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.010', 'weapon5': '0.016', 'AMMO5': '0.025', 'ARMOR': '0.040', 'AMMO4': '0.048', 'HITCOUNT': '0.050', 'DAMAGECOUNT': '0.120', 'AMMO3': '0.152', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'weapon3': '1.214', 'weapon2': '1.418'} [2024-08-05 21:23:42,799][52567] Fps is (10 sec: 1638.7, 60 sec: 2457.7, 300 sec: 2054.9). Total num frames: 6365184. Throughput: 0: 639.8. Samples: 1598840. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:23:42,801][52567] Avg episode reward: [(0, '-4.359')] [2024-08-05 21:23:44,885][52820] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:23:45,616][52669] DAMAGECOUNT value on done: 133.0 [2024-08-05 21:23:45,673][52669] Sum rewards: -4.819, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.341', 'AMMO2': '0.014', 'ARMOR': '0.024', 'HITCOUNT': '0.070', 'weapon4': '0.070', 'AMMO4': '0.072', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.399', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.240', 'weapon2': '1.536'} [2024-08-05 21:23:47,802][52567] Fps is (10 sec: 819.2, 60 sec: 2320.9, 300 sec: 2027.2). Total num frames: 6365184. Throughput: 0: 599.1. Samples: 1601010. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:23:47,820][52567] Avg episode reward: [(0, '-4.450')] [2024-08-05 21:23:49,057][52795] DAMAGECOUNT value on done: 279.0 [2024-08-05 21:23:49,072][52795] Sum rewards: -5.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO2': '0.029', 'ARMOR': '0.040', 'HITCOUNT': '0.130', 'AMMO3': '0.133', 'AMMO4': '0.147', 'DAMAGECOUNT': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.704', 'weapon2': '0.886', 'FRAGCOUNT': '1.000', 'weapon3': '1.104'} [2024-08-05 21:23:52,795][52567] Fps is (10 sec: 819.4, 60 sec: 2184.7, 300 sec: 2027.2). Total num frames: 6373376. Throughput: 0: 524.5. Samples: 1602840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:23:52,802][52567] Avg episode reward: [(0, '-4.484')] [2024-08-05 21:23:53,812][52803] DAMAGECOUNT value on done: 320.0 [2024-08-05 21:23:53,836][52803] Sum rewards: -2.360, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.189', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.032', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.840', 'weapon3': '1.254', 'weapon2': '1.664', 'FRAGCOUNT': '2.000'} [2024-08-05 21:23:55,151][52667] DAMAGECOUNT value on done: 373.0 [2024-08-05 21:23:55,180][52667] Sum rewards: -6.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.878', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.116', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.232', 'DAMAGECOUNT': '0.564', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.134', 'weapon2': '1.556'} [2024-08-05 21:23:57,796][52567] Fps is (10 sec: 1639.4, 60 sec: 2048.1, 300 sec: 2055.0). Total num frames: 6381568. Throughput: 0: 501.6. Samples: 1604210. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:23:57,802][52567] Avg episode reward: [(0, '-4.441')] [2024-08-05 21:24:00,304][52647] DAMAGECOUNT value on done: 332.0 [2024-08-05 21:24:00,316][52647] Sum rewards: -2.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'HITCOUNT': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'weapon2': '0.916', 'FRAGCOUNT': '1.000', 'weapon3': '1.866'} [2024-08-05 21:24:02,808][52567] Fps is (10 sec: 1637.7, 60 sec: 2048.0, 300 sec: 1999.4). Total num frames: 6389760. Throughput: 0: 430.5. Samples: 1605410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:24:02,828][52567] Avg episode reward: [(0, '-4.387')] [2024-08-05 21:24:03,120][52794] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:24:03,796][52666] DAMAGECOUNT value on done: 99.0 [2024-08-05 21:24:05,302][52658] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:24:05,321][52658] Sum rewards: -2.912, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.875', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.010', 'ARMOR': '0.020', 'weapon4': '0.030', 'HITCOUNT': '0.080', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.650', 'weapon3': '1.256', 'weapon2': '1.728', 'FRAGCOUNT': '2.000'} [2024-08-05 21:24:06,476][52668] DAMAGECOUNT value on done: 169.0 [2024-08-05 21:24:07,809][52567] Fps is (10 sec: 818.1, 60 sec: 1638.1, 300 sec: 1971.7). Total num frames: 6389760. Throughput: 0: 390.3. Samples: 1606600. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:24:07,816][52567] Avg episode reward: [(0, '-4.358')] [2024-08-05 21:24:08,367][52811] DAMAGECOUNT value on done: 175.0 [2024-08-05 21:24:09,304][52650] Updated weights for policy 0, policy_version 781 (0.0308) [2024-08-05 21:24:10,749][52663] DAMAGECOUNT value on done: 146.0 [2024-08-05 21:24:12,802][52567] Fps is (10 sec: 819.0, 60 sec: 1501.8, 300 sec: 1999.4). Total num frames: 6397952. Throughput: 0: 365.1. Samples: 1607460. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:24:12,812][52567] Avg episode reward: [(0, '-4.359')] [2024-08-05 21:24:13,697][52671] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:24:16,205][52662] DAMAGECOUNT value on done: 327.0 [2024-08-05 21:24:17,799][52660] DAMAGECOUNT value on done: 213.0 [2024-08-05 21:24:17,796][52567] Fps is (10 sec: 1640.5, 60 sec: 1502.0, 300 sec: 1971.7). Total num frames: 6406144. Throughput: 0: 349.8. Samples: 1610180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:24:17,812][52567] Avg episode reward: [(0, '-4.424')] [2024-08-05 21:24:19,430][52664] DAMAGECOUNT value on done: 151.0 [2024-08-05 21:24:19,660][52664] Sum rewards: -4.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.054', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon4': '0.146', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.074', 'weapon2': '1.788'} [2024-08-05 21:24:22,235][52670] DAMAGECOUNT value on done: 84.0 [2024-08-05 21:24:22,800][52567] Fps is (10 sec: 1638.6, 60 sec: 1501.8, 300 sec: 1971.6). Total num frames: 6414336. Throughput: 0: 294.5. Samples: 1611060. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:24:22,807][52567] Avg episode reward: [(0, '-4.453')] [2024-08-05 21:24:26,007][52659] DAMAGECOUNT value on done: 527.0 [2024-08-05 21:24:26,033][52659] Sum rewards: -1.952, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.855', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.036', 'weapon4': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.900', 'weapon3': '1.458', 'weapon2': '1.548', 'FRAGCOUNT': '2.000'} [2024-08-05 21:24:27,801][52567] Fps is (10 sec: 818.9, 60 sec: 1228.7, 300 sec: 1943.9). Total num frames: 6414336. Throughput: 0: 287.3. Samples: 1611770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:24:27,809][52567] Avg episode reward: [(0, '-4.426')] [2024-08-05 21:24:28,468][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000784_6422528.pth... [2024-08-05 21:24:29,267][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000727_5955584.pth [2024-08-05 21:24:31,577][52820] DAMAGECOUNT value on done: 135.0 [2024-08-05 21:24:31,609][52669] DAMAGECOUNT value on done: 30.0 [2024-08-05 21:24:32,797][52567] Fps is (10 sec: 819.6, 60 sec: 1228.9, 300 sec: 1943.9). Total num frames: 6422528. Throughput: 0: 274.7. Samples: 1613370. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:24:32,811][52567] Avg episode reward: [(0, '-4.437')] [2024-08-05 21:24:35,232][52795] DAMAGECOUNT value on done: 83.0 [2024-08-05 21:24:35,285][52795] Sum rewards: -7.744, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.020', 'weapon4': '0.028', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'ARMOR': '0.098', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.165', 'WEAPON3': '0.600', 'weapon2': '1.312', 'weapon3': '1.564'} [2024-08-05 21:24:37,801][52567] Fps is (10 sec: 819.1, 60 sec: 1092.3, 300 sec: 1916.1). Total num frames: 6422528. Throughput: 0: 269.5. Samples: 1614970. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:24:37,803][52567] Avg episode reward: [(0, '-4.491')] [2024-08-05 21:24:40,469][52803] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:24:41,618][52667] DAMAGECOUNT value on done: 335.0 [2024-08-05 21:24:42,802][52567] Fps is (10 sec: 818.9, 60 sec: 1092.2, 300 sec: 1916.1). Total num frames: 6430720. Throughput: 0: 258.9. Samples: 1615860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:24:42,817][52567] Avg episode reward: [(0, '-4.518')] [2024-08-05 21:24:46,946][52647] DAMAGECOUNT value on done: 266.0 [2024-08-05 21:24:46,989][52647] Sum rewards: -5.204, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.679', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.140', 'weapon4': '0.194', 'DAMAGECOUNT': '0.477', 'ARMOR': '0.530', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.282', 'weapon3': '1.428'} [2024-08-05 21:24:47,803][52567] Fps is (10 sec: 1638.3, 60 sec: 1228.8, 300 sec: 1916.1). Total num frames: 6438912. Throughput: 0: 267.8. Samples: 1617460. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:24:47,806][52567] Avg episode reward: [(0, '-4.518')] [2024-08-05 21:24:52,679][52794] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:24:52,796][52567] Fps is (10 sec: 1639.0, 60 sec: 1228.8, 300 sec: 1916.1). Total num frames: 6447104. Throughput: 0: 274.7. Samples: 1618960. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:24:52,781][52666] DAMAGECOUNT value on done: 101.0 [2024-08-05 21:24:52,797][52567] Avg episode reward: [(0, '-4.550')] [2024-08-05 21:24:53,993][52658] DAMAGECOUNT value on done: 48.0 [2024-08-05 21:24:55,656][52668] DAMAGECOUNT value on done: 212.0 [2024-08-05 21:24:55,670][52668] Sum rewards: -0.922, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.962', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.032', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'HITCOUNT': '0.100', 'AMMO3': '0.102', 'weapon4': '0.168', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.650', 'weapon2': '0.854', 'weapon3': '1.510', 'FRAGCOUNT': '2.000'} [2024-08-05 21:24:57,801][52567] Fps is (10 sec: 819.2, 60 sec: 1092.2, 300 sec: 1916.1). Total num frames: 6447104. Throughput: 0: 266.7. Samples: 1619460. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:24:57,811][52567] Avg episode reward: [(0, '-4.549')] [2024-08-05 21:24:59,377][52811] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:24:59,387][52811] Sum rewards: -3.924, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'HITCOUNT': '0.050', 'weapon5': '0.060', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'FRAGCOUNT': '1.000', 'weapon3': '1.246', 'weapon2': '1.490'} [2024-08-05 21:25:02,808][52567] Fps is (10 sec: 0.0, 60 sec: 955.6, 300 sec: 1888.3). Total num frames: 6447104. Throughput: 0: 221.7. Samples: 1620160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:25:02,832][52567] Avg episode reward: [(0, '-4.538')] [2024-08-05 21:25:05,042][52663] DAMAGECOUNT value on done: 251.0 [2024-08-05 21:25:05,094][52663] Sum rewards: -6.075, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO2': '0.018', 'HITCOUNT': '0.080', 'AMMO4': '0.088', 'AMMO3': '0.088', 'ARMOR': '0.132', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.345', 'weapon4': '0.346', 'WEAPON3': '0.500', 'weapon3': '0.918', 'FRAGCOUNT': '1.000', 'weapon2': '1.450'} [2024-08-05 21:25:07,815][52567] Fps is (10 sec: 0.0, 60 sec: 955.7, 300 sec: 1860.5). Total num frames: 6447104. Throughput: 0: 202.2. Samples: 1620160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:25:07,953][52567] Avg episode reward: [(0, '-4.538')] [2024-08-05 21:25:12,807][52567] Fps is (10 sec: 0.0, 60 sec: 819.1, 300 sec: 1777.2). Total num frames: 6447104. Throughput: 0: 204.2. Samples: 1620960. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:25:12,812][52567] Avg episode reward: [(0, '-4.532')] [2024-08-05 21:25:17,390][52671] DAMAGECOUNT value on done: 143.0 [2024-08-05 21:25:17,418][52671] Sum rewards: -4.992, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.524', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.022', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.102', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.429', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.464', 'weapon3': '1.512'} [2024-08-05 21:25:17,805][52567] Fps is (10 sec: 819.9, 60 sec: 819.1, 300 sec: 1749.4). Total num frames: 6455296. Throughput: 0: 181.5. Samples: 1621540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:25:17,832][52567] Avg episode reward: [(0, '-4.532')] [2024-08-05 21:25:20,394][52662] DAMAGECOUNT value on done: 265.0 [2024-08-05 21:25:20,419][52662] Sum rewards: -4.221, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.146', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'weapon4': '0.096', 'AMMO3': '0.122', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.036', 'weapon2': '1.674'} [2024-08-05 21:25:22,547][52660] DAMAGECOUNT value on done: 210.0 [2024-08-05 21:25:22,563][52660] Sum rewards: -3.450, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.780', 'AMMO2': '0.001', 'AMMO4': '0.002', 'ARMOR': '0.020', 'AMMO3': '0.129', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.850', 'weapon2': '0.976', 'FRAGCOUNT': '1.000', 'weapon3': '2.042'} [2024-08-05 21:25:22,798][52567] Fps is (10 sec: 1639.8, 60 sec: 819.2, 300 sec: 1721.7). Total num frames: 6463488. Throughput: 0: 186.5. Samples: 1623360. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:25:22,806][52567] Avg episode reward: [(0, '-4.551')] [2024-08-05 21:25:25,616][52664] DAMAGECOUNT value on done: 20.0 [2024-08-05 21:25:26,379][52670] DAMAGECOUNT value on done: 80.0 [2024-08-05 21:25:27,816][52567] Fps is (10 sec: 819.7, 60 sec: 819.2, 300 sec: 1721.8). Total num frames: 6463488. Throughput: 0: 179.3. Samples: 1623930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:25:27,826][52567] Avg episode reward: [(0, '-4.516')] [2024-08-05 21:25:27,954][52659] DAMAGECOUNT value on done: 90.0 [2024-08-05 21:25:27,992][52659] Sum rewards: -5.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'HITCOUNT': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.115', 'DAMAGECOUNT': '0.165', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon3': '0.832', 'FRAGCOUNT': '2.000', 'weapon2': '2.040'} [2024-08-05 21:25:29,747][52669] DAMAGECOUNT value on done: 69.0 [2024-08-05 21:25:29,766][52820] DAMAGECOUNT value on done: 245.0 [2024-08-05 21:25:30,921][52795] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:25:30,940][52795] Sum rewards: -1.415, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.978', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'weapon4': '0.030', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.264', 'weapon2': '1.398'} [2024-08-05 21:25:31,423][52650] Updated weights for policy 0, policy_version 791 (0.1226) [2024-08-05 21:25:31,729][52803] DAMAGECOUNT value on done: 200.0 [2024-08-05 21:25:31,736][52667] DAMAGECOUNT value on done: 311.0 [2024-08-05 21:25:32,381][52647] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:25:32,657][52666] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:25:32,796][52567] Fps is (10 sec: 3277.8, 60 sec: 1228.8, 300 sec: 1777.3). Total num frames: 6496256. Throughput: 0: 220.0. Samples: 1627360. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:25:32,802][52567] Avg episode reward: [(0, '-4.566')] [2024-08-05 21:25:32,966][52658] DAMAGECOUNT value on done: 300.0 [2024-08-05 21:25:32,969][52658] Sum rewards: -2.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.596', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.038', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'HITCOUNT': '0.180', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'weapon2': '1.312', 'weapon3': '1.616', 'FRAGCOUNT': '3.000'} [2024-08-05 21:25:32,985][52668] DAMAGECOUNT value on done: 155.0 [2024-08-05 21:25:33,008][52668] Sum rewards: -1.138, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'ARMOR': '0.080', 'AMMO3': '0.092', 'AMMO4': '0.095', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.255', 'weapon4': '0.392', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.090', 'weapon2': '1.296'} [2024-08-05 21:25:33,504][52811] DAMAGECOUNT value on done: 84.0 [2024-08-05 21:25:33,830][52663] DAMAGECOUNT value on done: 99.0 [2024-08-05 21:25:34,027][52671] DAMAGECOUNT value on done: 200.0 [2024-08-05 21:25:34,035][52671] Sum rewards: -3.902, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.787', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.043', 'HITCOUNT': '0.080', 'weapon4': '0.090', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'weapon3': '0.932', 'FRAGCOUNT': '1.000', 'weapon2': '1.914'} [2024-08-05 21:25:34,058][52660] DAMAGECOUNT value on done: 220.0 [2024-08-05 21:25:34,059][52660] Sum rewards: -3.401, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.712', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.094', 'ARMOR': '0.116', 'weapon4': '0.140', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.078', 'weapon2': '1.686'} [2024-08-05 21:25:34,431][52670] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:25:34,577][52664] DAMAGECOUNT value on done: 207.0 [2024-08-05 21:25:34,602][52664] Sum rewards: -1.991, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO2': '0.011', 'HITCOUNT': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.058', 'ARMOR': '0.113', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.225', 'weapon4': '0.238', 'WEAPON3': '0.400', 'weapon3': '0.876', 'FRAGCOUNT': '1.000', 'weapon2': '1.554'} [2024-08-05 21:25:34,882][52659] DAMAGECOUNT value on done: 310.0 [2024-08-05 21:25:34,914][52659] Sum rewards: -4.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.126', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.650', 'weapon3': '1.142', 'weapon2': '1.956', 'FRAGCOUNT': '2.000'} [2024-08-05 21:25:35,482][52820] DAMAGECOUNT value on done: 94.0 [2024-08-05 21:25:35,870][52669] DAMAGECOUNT value on done: 279.0 [2024-08-05 21:25:36,283][52666] DAMAGECOUNT value on done: 194.0 [2024-08-05 21:25:36,291][52666] Sum rewards: -4.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.708', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.050', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.164', 'DAMAGECOUNT': '0.258', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.254', 'weapon3': '1.556'} [2024-08-05 21:25:36,294][52795] DAMAGECOUNT value on done: 300.0 [2024-08-05 21:25:36,295][52795] Sum rewards: -1.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.492', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.042', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.594', 'weapon3': '0.896', 'FRAGCOUNT': '1.000', 'weapon2': '1.688'} [2024-08-05 21:25:36,760][52667] DAMAGECOUNT value on done: 149.0 [2024-08-05 21:25:36,763][52667] Sum rewards: -2.539, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.801', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'HITCOUNT': '0.060', 'AMMO3': '0.071', 'weapon4': '0.082', 'ARMOR': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.150', 'WEAPON3': '0.400', 'weapon3': '0.982', 'FRAGCOUNT': '1.000', 'weapon2': '1.608'} [2024-08-05 21:25:36,766][52668] DAMAGECOUNT value on done: 399.0 [2024-08-05 21:25:36,766][52668] Sum rewards: -2.837, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.214', 'AMMO5': '0.003', 'AMMO2': '0.024', 'HITCOUNT': '0.080', 'weapon4': '0.092', 'AMMO4': '0.118', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.750', 'ARMOR': '0.959', 'FRAGCOUNT': '1.000', 'weapon3': '1.246', 'weapon2': '1.648'} [2024-08-05 21:25:37,126][52803] DAMAGECOUNT value on done: 215.0 [2024-08-05 21:25:37,137][52803] Sum rewards: -3.914, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.039', 'HITCOUNT': '0.080', 'ARMOR': '0.087', 'AMMO3': '0.092', 'AMMO4': '0.193', 'weapon4': '0.398', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.500', 'weapon3': '0.758', 'FRAGCOUNT': '1.000', 'weapon2': '1.422'} [2024-08-05 21:25:37,570][52658] DAMAGECOUNT value on done: 272.0 [2024-08-05 21:25:37,576][52658] Sum rewards: -2.674, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.148', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.022', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.111', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.256', 'weapon2': '1.760'} [2024-08-05 21:25:37,761][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 21:25:37,785][52670] DAMAGECOUNT value on done: 168.0 [2024-08-05 21:25:37,794][52670] Sum rewards: -7.291, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.394', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.020', 'weapon5': '0.022', 'HITCOUNT': '0.140', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.850', 'weapon2': '1.150', 'weapon3': '1.656'} [2024-08-05 21:25:37,794][52567] Fps is (10 sec: 9012.9, 60 sec: 2184.7, 300 sec: 1943.9). Total num frames: 6553600. Throughput: 0: 531.6. Samples: 1642880. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:25:37,795][52567] Avg episode reward: [(0, '-4.424')] [2024-08-05 21:25:37,875][52647] DAMAGECOUNT value on done: 312.0 [2024-08-05 21:25:37,876][52647] Sum rewards: -2.533, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.950', 'AMMO2': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.061', 'AMMO3': '0.157', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.850', 'weapon2': '1.132', 'weapon3': '1.668', 'FRAGCOUNT': '2.000'} [2024-08-05 21:25:38,008][52671] DAMAGECOUNT value on done: 233.0 [2024-08-05 21:25:38,220][52660] DAMAGECOUNT value on done: 120.0 [2024-08-05 21:25:38,242][52660] Sum rewards: -5.777, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.665', 'AMMO2': '0.001', 'weapon5': '0.002', 'AMMO4': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon4': '0.224', 'DAMAGECOUNT': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.014', 'weapon3': '1.648', 'FRAGCOUNT': '2.000'} [2024-08-05 21:25:38,378][52811] DAMAGECOUNT value on done: 40.0 [2024-08-05 21:25:38,380][52811] Sum rewards: -3.873, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'HITCOUNT': '0.040', 'AMMO4': '0.077', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.154', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.278', 'weapon2': '1.318'} [2024-08-05 21:25:38,401][52650] Updated weights for policy 0, policy_version 801 (0.0053) [2024-08-05 21:25:38,615][52663] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:25:39,848][52669] DAMAGECOUNT value on done: 137.0 [2024-08-05 21:25:39,928][52659] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:25:39,922][52666] DAMAGECOUNT value on done: 300.0 [2024-08-05 21:25:39,936][52659] Sum rewards: -6.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.074', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.248', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.326', 'weapon2': '1.406'} [2024-08-05 21:25:39,936][52666] Sum rewards: -3.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.826', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon4': '0.024', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.700', 'weapon3': '1.438', 'weapon2': '1.464', 'FRAGCOUNT': '2.000'} [2024-08-05 21:25:40,337][52664] DAMAGECOUNT value on done: 305.0 [2024-08-05 21:25:40,347][52664] Sum rewards: -1.752, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.642', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.222', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.900', 'weapon2': '1.144', 'weapon3': '1.764', 'FRAGCOUNT': '2.000'} [2024-08-05 21:25:40,954][52820] DAMAGECOUNT value on done: 245.0 [2024-08-05 21:25:40,959][52820] Sum rewards: -2.661, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.306', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon5': '0.004', 'AMMO5': '0.007', 'HITCOUNT': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.750', 'weapon2': '0.956', 'FRAGCOUNT': '1.000', 'weapon3': '1.844'} [2024-08-05 21:25:42,797][52567] Fps is (10 sec: 9009.3, 60 sec: 2594.2, 300 sec: 1999.4). Total num frames: 6586368. Throughput: 0: 705.6. Samples: 1651210. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:25:42,800][52567] Avg episode reward: [(0, '-4.464')] [2024-08-05 21:25:42,807][52668] DAMAGECOUNT value on done: 176.0 [2024-08-05 21:25:43,714][52795] DAMAGECOUNT value on done: 210.0 [2024-08-05 21:25:44,143][52670] DAMAGECOUNT value on done: 148.0 [2024-08-05 21:25:44,146][52670] Sum rewards: -5.679, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.042', 'WEAPON4': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.169', 'DAMAGECOUNT': '0.369', 'ARMOR': '0.457', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.132', 'weapon2': '1.644'} [2024-08-05 21:25:45,075][52803] DAMAGECOUNT value on done: 343.0 [2024-08-05 21:25:45,080][52663] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:25:45,087][52803] Sum rewards: -3.429, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.252', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.084', 'weapon4': '0.098', 'HITCOUNT': '0.140', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.428', 'weapon3': '0.722', 'DAMAGECOUNT': '0.879', 'weapon2': '1.904'} [2024-08-05 21:25:45,124][52647] DAMAGECOUNT value on done: 187.0 [2024-08-05 21:25:45,307][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:25:45,581][52660] DAMAGECOUNT value on done: 289.0 [2024-08-05 21:25:46,206][52811] DAMAGECOUNT value on done: 62.0 [2024-08-05 21:25:46,241][52671] DAMAGECOUNT value on done: 342.0 [2024-08-05 21:25:47,748][52669] DAMAGECOUNT value on done: 140.0 [2024-08-05 21:25:47,795][52567] Fps is (10 sec: 6553.7, 60 sec: 3004.1, 300 sec: 2082.7). Total num frames: 6619136. Throughput: 0: 898.2. Samples: 1660570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:25:47,796][52567] Avg episode reward: [(0, '-4.668')] [2024-08-05 21:25:48,604][52659] DAMAGECOUNT value on done: 175.0 [2024-08-05 21:25:49,662][52664] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:25:50,158][52666] DAMAGECOUNT value on done: 387.0 [2024-08-05 21:25:50,173][52666] Sum rewards: -3.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.626', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.191', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.340', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.116', 'weapon3': '1.208', 'weapon2': '1.520', 'FRAGCOUNT': '5.000'} [2024-08-05 21:25:52,685][52820] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:25:52,714][52820] Sum rewards: -4.720, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.020', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'HITCOUNT': '0.070', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.246', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.226', 'weapon3': '1.402'} [2024-08-05 21:25:52,797][52567] Fps is (10 sec: 4915.4, 60 sec: 3140.2, 300 sec: 2082.7). Total num frames: 6635520. Throughput: 0: 1046.6. Samples: 1667240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:25:52,801][52567] Avg episode reward: [(0, '-4.699')] [2024-08-05 21:25:53,522][52650] Updated weights for policy 0, policy_version 811 (0.0124) [2024-08-05 21:25:53,926][52795] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:25:53,937][52795] Sum rewards: -5.036, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.465', 'AMMO2': '0.021', 'ARMOR': '0.032', 'weapon4': '0.066', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.153', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.482'} [2024-08-05 21:25:54,229][52663] DAMAGECOUNT value on done: 100.0 [2024-08-05 21:25:54,209][52670] DAMAGECOUNT value on done: 134.0 [2024-08-05 21:25:55,297][52803] DAMAGECOUNT value on done: 294.0 [2024-08-05 21:25:56,457][52671] DAMAGECOUNT value on done: 294.0 [2024-08-05 21:25:56,475][52671] Sum rewards: -3.287, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.810', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.089', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.220', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'weapon3': '0.690', 'weapon2': '1.966', 'FRAGCOUNT': '2.000'} [2024-08-05 21:25:56,497][52811] DAMAGECOUNT value on done: 273.0 [2024-08-05 21:25:56,502][52811] Sum rewards: -4.235, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.935', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.141', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.850', 'weapon2': '0.908', 'FRAGCOUNT': '1.000', 'weapon3': '1.968'} [2024-08-05 21:25:57,794][52567] Fps is (10 sec: 4915.1, 60 sec: 3686.8, 300 sec: 2166.0). Total num frames: 6668288. Throughput: 0: 1210.1. Samples: 1675400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:25:57,797][52567] Avg episode reward: [(0, '-4.778')] [2024-08-05 21:25:57,983][52659] DAMAGECOUNT value on done: 191.0 [2024-08-05 21:25:58,804][52664] DAMAGECOUNT value on done: 192.0 [2024-08-05 21:25:59,922][52820] DAMAGECOUNT value on done: 133.0 [2024-08-05 21:26:00,455][52795] DAMAGECOUNT value on done: 103.0 [2024-08-05 21:26:02,813][52567] Fps is (10 sec: 7360.9, 60 sec: 4368.6, 300 sec: 2277.0). Total num frames: 6709248. Throughput: 0: 1378.6. Samples: 1683590. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 21:26:02,821][52567] Avg episode reward: [(0, '-4.841')] [2024-08-05 21:26:04,024][52671] DAMAGECOUNT value on done: 209.0 [2024-08-05 21:26:04,026][52671] Sum rewards: -3.885, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.695', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.104', 'HITCOUNT': '0.140', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.372', 'weapon3': '1.632'} [2024-08-05 21:26:04,559][52803] DAMAGECOUNT value on done: 96.0 [2024-08-05 21:26:04,580][52803] Sum rewards: -5.587, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.960', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.087', 'weapon4': '0.098', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.400', 'weapon3': '0.852', 'FRAGCOUNT': '1.000', 'weapon2': '2.220'} [2024-08-05 21:26:06,645][52811] DAMAGECOUNT value on done: 128.0 [2024-08-05 21:26:06,664][52811] Sum rewards: -2.529, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.022', 'AMMO3': '0.050', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.279', 'WEAPON3': '0.300', 'ARMOR': '0.491', 'HEALTH': '0.854', 'weapon3': '0.878', 'FRAGCOUNT': '1.000', 'weapon2': '1.830'} [2024-08-05 21:26:07,798][52567] Fps is (10 sec: 4914.5, 60 sec: 4506.7, 300 sec: 2304.9). Total num frames: 6717440. Throughput: 0: 1427.2. Samples: 1687580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:26:07,806][52567] Avg episode reward: [(0, '-4.845')] [2024-08-05 21:26:09,490][52659] DAMAGECOUNT value on done: 325.0 [2024-08-05 21:26:09,497][52659] Sum rewards: -1.407, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.170', 'weapon4': '0.238', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'weapon2': '1.248', 'weapon3': '1.398', 'FRAGCOUNT': '2.000'} [2024-08-05 21:26:10,239][52650] Updated weights for policy 0, policy_version 821 (0.0142) [2024-08-05 21:26:12,798][52567] Fps is (10 sec: 1640.9, 60 sec: 4642.8, 300 sec: 2304.9). Total num frames: 6725632. Throughput: 0: 1450.0. Samples: 1689180. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-05 21:26:12,813][52567] Avg episode reward: [(0, '-4.791')] [2024-08-05 21:26:17,797][52567] Fps is (10 sec: 2457.4, 60 sec: 4779.1, 300 sec: 2332.7). Total num frames: 6742016. Throughput: 0: 1453.7. Samples: 1692780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:26:17,805][52567] Avg episode reward: [(0, '-4.791')] [2024-08-05 21:26:22,800][52567] Fps is (10 sec: 2457.3, 60 sec: 4778.6, 300 sec: 2332.6). Total num frames: 6750208. Throughput: 0: 1171.7. Samples: 1695610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 10.0) [2024-08-05 21:26:22,808][52567] Avg episode reward: [(0, '-4.791')] [2024-08-05 21:26:23,044][52820] DAMAGECOUNT value on done: 325.0 [2024-08-05 21:26:23,055][52820] Sum rewards: -6.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.254', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.058', 'AMMO4': '0.083', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.192', 'DAMAGECOUNT': '0.675', 'WEAPON3': '1.050', 'weapon2': '1.430', 'weapon3': '1.438', 'FRAGCOUNT': '2.000'} [2024-08-05 21:26:23,572][52795] DAMAGECOUNT value on done: 180.0 [2024-08-05 21:26:23,819][52795] Sum rewards: -4.012, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.178', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.122', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.272', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.050', 'weapon3': '1.366'} [2024-08-05 21:26:27,799][52567] Fps is (10 sec: 1638.1, 60 sec: 4915.0, 300 sec: 2304.9). Total num frames: 6758400. Throughput: 0: 1004.4. Samples: 1696410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 10.0) [2024-08-05 21:26:27,809][52567] Avg episode reward: [(0, '-4.716')] [2024-08-05 21:26:27,826][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000825_6758400.pth... [2024-08-05 21:26:28,191][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000756_6193152.pth [2024-08-05 21:26:32,803][52567] Fps is (10 sec: 818.9, 60 sec: 4368.5, 300 sec: 2277.1). Total num frames: 6758400. Throughput: 0: 831.9. Samples: 1698010. Policy #0 lag: (min: 0.0, avg: 3.8, max: 10.0) [2024-08-05 21:26:32,814][52567] Avg episode reward: [(0, '-4.716')] [2024-08-05 21:26:33,457][52803] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:26:33,467][52803] Sum rewards: -9.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.292', 'AMMO2': '0.023', 'ARMOR': '0.048', 'HITCOUNT': '0.080', 'AMMO3': '0.112', 'AMMO4': '0.113', 'DAMAGECOUNT': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '0.600', 'weapon3': '0.958', 'FRAGCOUNT': '1.000', 'weapon2': '1.738'} [2024-08-05 21:26:37,802][52567] Fps is (10 sec: 0.0, 60 sec: 3413.0, 300 sec: 2221.5). Total num frames: 6758400. Throughput: 0: 701.5. Samples: 1698810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 10.0) [2024-08-05 21:26:37,818][52567] Avg episode reward: [(0, '-4.761')] [2024-08-05 21:26:40,024][52811] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:26:40,074][52811] Sum rewards: -2.960, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.640', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon7': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.080', 'weapon3': '1.550'} [2024-08-05 21:26:42,803][52567] Fps is (10 sec: 819.2, 60 sec: 3003.5, 300 sec: 2221.5). Total num frames: 6766592. Throughput: 0: 548.1. Samples: 1700070. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:26:42,827][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:26:47,803][52567] Fps is (10 sec: 1638.2, 60 sec: 2593.8, 300 sec: 2221.5). Total num frames: 6774784. Throughput: 0: 384.1. Samples: 1700870. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 21:26:47,812][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:26:52,803][52567] Fps is (10 sec: 819.3, 60 sec: 2320.9, 300 sec: 2166.1). Total num frames: 6774784. Throughput: 0: 338.4. Samples: 1702810. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 21:26:52,815][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:26:57,810][52567] Fps is (10 sec: 0.0, 60 sec: 1774.6, 300 sec: 2138.2). Total num frames: 6774784. Throughput: 0: 320.6. Samples: 1703610. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 21:26:57,818][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:27:02,797][52567] Fps is (10 sec: 819.5, 60 sec: 1229.1, 300 sec: 2110.5). Total num frames: 6782976. Throughput: 0: 267.3. Samples: 1704810. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:27:02,802][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:27:07,803][52567] Fps is (10 sec: 1639.6, 60 sec: 1228.7, 300 sec: 2110.5). Total num frames: 6791168. Throughput: 0: 232.4. Samples: 1706070. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:27:07,833][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:27:12,805][52567] Fps is (10 sec: 818.7, 60 sec: 1092.2, 300 sec: 2082.8). Total num frames: 6791168. Throughput: 0: 223.5. Samples: 1706470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:27:12,827][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:27:17,802][52567] Fps is (10 sec: 819.1, 60 sec: 955.7, 300 sec: 2082.7). Total num frames: 6799360. Throughput: 0: 205.8. Samples: 1707270. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:27:17,812][52567] Avg episode reward: [(0, '-4.735')] [2024-08-05 21:27:20,509][52820] DAMAGECOUNT value on done: 380.0 [2024-08-05 21:27:20,526][52820] Sum rewards: 0.947, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.606', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon5': '0.006', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.530', 'DAMAGECOUNT': '1.020', 'weapon2': '1.330', 'weapon3': '1.564', 'FRAGCOUNT': '3.000'} [2024-08-05 21:27:22,398][52795] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:27:22,408][52795] Sum rewards: -4.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.350', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'weapon4': '0.090', 'AMMO3': '0.139', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.494', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.370', 'weapon2': '1.582'} [2024-08-05 21:27:22,810][52567] Fps is (10 sec: 818.8, 60 sec: 819.1, 300 sec: 2054.9). Total num frames: 6799360. Throughput: 0: 213.3. Samples: 1708410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:27:22,816][52567] Avg episode reward: [(0, '-4.702')] [2024-08-05 21:27:24,396][52650] Updated weights for policy 0, policy_version 831 (0.0675) [2024-08-05 21:27:27,798][52567] Fps is (10 sec: 819.5, 60 sec: 819.2, 300 sec: 2082.7). Total num frames: 6807552. Throughput: 0: 212.0. Samples: 1709610. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:27:27,806][52567] Avg episode reward: [(0, '-4.684')] [2024-08-05 21:27:30,849][52803] DAMAGECOUNT value on done: 270.0 [2024-08-05 21:27:30,861][52803] Sum rewards: -2.052, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.416', 'AMMO2': '0.019', 'ARMOR': '0.028', 'AMMO4': '0.093', 'AMMO3': '0.114', 'HITCOUNT': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.462', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.034', 'weapon2': '1.224'} [2024-08-05 21:27:32,801][52567] Fps is (10 sec: 1639.9, 60 sec: 955.8, 300 sec: 2082.7). Total num frames: 6815744. Throughput: 0: 231.1. Samples: 1711270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:27:32,814][52567] Avg episode reward: [(0, '-4.680')] [2024-08-05 21:27:37,803][52567] Fps is (10 sec: 818.9, 60 sec: 955.7, 300 sec: 2027.2). Total num frames: 6815744. Throughput: 0: 205.8. Samples: 1712070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:27:37,811][52567] Avg episode reward: [(0, '-4.680')] [2024-08-05 21:27:37,816][52811] DAMAGECOUNT value on done: 96.0 [2024-08-05 21:27:37,818][52811] Sum rewards: -7.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.049', 'weapon4': '0.086', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'DAMAGECOUNT': '0.258', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.260', 'weapon3': '1.674'} [2024-08-05 21:27:42,798][52567] Fps is (10 sec: 819.4, 60 sec: 955.8, 300 sec: 2027.2). Total num frames: 6823936. Throughput: 0: 214.7. Samples: 1713270. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:27:42,808][52567] Avg episode reward: [(0, '-4.692')] [2024-08-05 21:27:47,802][52567] Fps is (10 sec: 819.2, 60 sec: 819.2, 300 sec: 1971.6). Total num frames: 6823936. Throughput: 0: 230.6. Samples: 1715190. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:27:47,816][52567] Avg episode reward: [(0, '-4.692')] [2024-08-05 21:27:52,801][52567] Fps is (10 sec: 1638.1, 60 sec: 1092.3, 300 sec: 1971.6). Total num frames: 6840320. Throughput: 0: 248.9. Samples: 1717270. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:27:52,808][52567] Avg episode reward: [(0, '-4.692')] [2024-08-05 21:27:57,800][52567] Fps is (10 sec: 1638.7, 60 sec: 1092.4, 300 sec: 1943.9). Total num frames: 6840320. Throughput: 0: 257.8. Samples: 1718070. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:27:57,810][52567] Avg episode reward: [(0, '-4.692')] [2024-08-05 21:28:02,832][52567] Fps is (10 sec: 816.6, 60 sec: 1091.7, 300 sec: 1888.1). Total num frames: 6848512. Throughput: 0: 300.2. Samples: 1720790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:28:02,848][52567] Avg episode reward: [(0, '-4.692')] [2024-08-05 21:28:02,938][52820] DAMAGECOUNT value on done: 15.0 [2024-08-05 21:28:05,290][52795] DAMAGECOUNT value on done: 231.0 [2024-08-05 21:28:07,805][52567] Fps is (10 sec: 1638.3, 60 sec: 1092.3, 300 sec: 1860.5). Total num frames: 6856704. Throughput: 0: 303.6. Samples: 1722070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:28:07,809][52567] Avg episode reward: [(0, '-4.746')] [2024-08-05 21:28:12,799][52567] Fps is (10 sec: 1643.7, 60 sec: 1228.9, 300 sec: 1860.6). Total num frames: 6864896. Throughput: 0: 294.7. Samples: 1722870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:28:12,809][52567] Avg episode reward: [(0, '-4.746')] [2024-08-05 21:28:14,455][52803] DAMAGECOUNT value on done: 138.0 [2024-08-05 21:28:14,472][52803] Sum rewards: -3.961, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.988', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.022', 'WEAPON1': '0.030', 'ARMOR': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.500', 'weapon3': '0.992', 'weapon2': '1.638'} [2024-08-05 21:28:17,799][52567] Fps is (10 sec: 819.3, 60 sec: 1092.3, 300 sec: 1832.8). Total num frames: 6864896. Throughput: 0: 282.7. Samples: 1723990. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:28:17,833][52567] Avg episode reward: [(0, '-4.761')] [2024-08-05 21:28:22,805][52567] Fps is (10 sec: 0.0, 60 sec: 1092.4, 300 sec: 1777.2). Total num frames: 6864896. Throughput: 0: 275.5. Samples: 1724470. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:28:22,826][52567] Avg episode reward: [(0, '-4.761')] [2024-08-05 21:28:25,381][52811] DAMAGECOUNT value on done: 45.0 [2024-08-05 21:28:27,806][52567] Fps is (10 sec: 819.5, 60 sec: 1092.3, 300 sec: 1777.3). Total num frames: 6873088. Throughput: 0: 264.9. Samples: 1725190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:28:27,813][52567] Avg episode reward: [(0, '-4.816')] [2024-08-05 21:28:27,821][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000840_6881280.pth... [2024-08-05 21:28:28,041][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000784_6422528.pth [2024-08-05 21:28:32,801][52567] Fps is (10 sec: 1639.1, 60 sec: 1092.3, 300 sec: 1777.3). Total num frames: 6881280. Throughput: 0: 311.1. Samples: 1729190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:28:32,808][52567] Avg episode reward: [(0, '-4.816')] [2024-08-05 21:28:33,032][52650] Updated weights for policy 0, policy_version 841 (0.0877) [2024-08-05 21:28:37,807][52567] Fps is (10 sec: 2455.2, 60 sec: 1365.3, 300 sec: 1805.0). Total num frames: 6897664. Throughput: 0: 353.7. Samples: 1733190. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:28:37,814][52567] Avg episode reward: [(0, '-4.816')] [2024-08-05 21:28:38,593][52820] DAMAGECOUNT value on done: 119.0 [2024-08-05 21:28:38,600][52820] Sum rewards: -3.218, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.612', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.032', 'ARMOR': '0.060', 'HITCOUNT': '0.090', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.252', 'WEAPON3': '0.500', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'weapon2': '2.100'} [2024-08-05 21:28:39,224][52795] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:28:42,801][52567] Fps is (10 sec: 3276.5, 60 sec: 1501.8, 300 sec: 1860.6). Total num frames: 6914048. Throughput: 0: 364.4. Samples: 1734470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:28:42,810][52567] Avg episode reward: [(0, '-4.755')] [2024-08-05 21:28:44,604][52803] DAMAGECOUNT value on done: 168.0 [2024-08-05 21:28:44,616][52803] Sum rewards: -7.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO2': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.099', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.200', 'DAMAGECOUNT': '0.459', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.336', 'weapon2': '1.596'} [2024-08-05 21:28:47,797][52567] Fps is (10 sec: 1639.8, 60 sec: 1502.0, 300 sec: 1832.8). Total num frames: 6914048. Throughput: 0: 366.5. Samples: 1737270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:28:47,800][52567] Avg episode reward: [(0, '-4.762')] [2024-08-05 21:28:52,753][52811] DAMAGECOUNT value on done: 182.0 [2024-08-05 21:28:52,795][52567] Fps is (10 sec: 0.0, 60 sec: 1228.9, 300 sec: 1805.0). Total num frames: 6914048. Throughput: 0: 348.0. Samples: 1737730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:28:52,798][52567] Avg episode reward: [(0, '-4.762')] [2024-08-05 21:28:52,801][52811] Sum rewards: -3.169, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.152', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.128', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.506', 'weapon2': '1.534'} [2024-08-05 21:28:57,803][52567] Fps is (10 sec: 818.8, 60 sec: 1365.3, 300 sec: 1805.0). Total num frames: 6922240. Throughput: 0: 346.6. Samples: 1738470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:28:57,822][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:02,802][52567] Fps is (10 sec: 818.7, 60 sec: 1229.4, 300 sec: 1805.1). Total num frames: 6922240. Throughput: 0: 348.4. Samples: 1739670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:29:02,822][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:07,801][52567] Fps is (10 sec: 819.4, 60 sec: 1228.8, 300 sec: 1805.0). Total num frames: 6930432. Throughput: 0: 348.0. Samples: 1740130. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:29:07,810][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:12,809][52567] Fps is (10 sec: 818.6, 60 sec: 1092.1, 300 sec: 1777.2). Total num frames: 6930432. Throughput: 0: 348.4. Samples: 1740870. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:29:12,837][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:17,798][52567] Fps is (10 sec: 0.0, 60 sec: 1092.3, 300 sec: 1749.5). Total num frames: 6930432. Throughput: 0: 287.6. Samples: 1742130. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:29:17,802][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:22,796][52567] Fps is (10 sec: 820.2, 60 sec: 1229.0, 300 sec: 1777.3). Total num frames: 6938624. Throughput: 0: 224.0. Samples: 1743270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:29:22,816][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:27,801][52567] Fps is (10 sec: 818.9, 60 sec: 1092.2, 300 sec: 1749.4). Total num frames: 6938624. Throughput: 0: 205.8. Samples: 1743730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:29:27,814][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:32,800][52567] Fps is (10 sec: 818.8, 60 sec: 1092.3, 300 sec: 1777.3). Total num frames: 6946816. Throughput: 0: 177.8. Samples: 1745270. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:29:32,811][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:37,800][52567] Fps is (10 sec: 819.3, 60 sec: 819.3, 300 sec: 1749.5). Total num frames: 6946816. Throughput: 0: 176.4. Samples: 1745670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:29:37,814][52567] Avg episode reward: [(0, '-4.721')] [2024-08-05 21:29:41,494][52820] DAMAGECOUNT value on done: 92.0 [2024-08-05 21:29:42,807][52567] Fps is (10 sec: 0.0, 60 sec: 546.2, 300 sec: 1721.7). Total num frames: 6946816. Throughput: 0: 186.7. Samples: 1746870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:29:42,928][52567] Avg episode reward: [(0, '-4.759')] [2024-08-05 21:29:46,557][52795] DAMAGECOUNT value on done: 65.0 [2024-08-05 21:29:47,802][52567] Fps is (10 sec: 819.1, 60 sec: 682.6, 300 sec: 1721.7). Total num frames: 6955008. Throughput: 0: 161.3. Samples: 1746930. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:29:47,814][52567] Avg episode reward: [(0, '-4.759')] [2024-08-05 21:29:52,798][52567] Fps is (10 sec: 1638.4, 60 sec: 819.2, 300 sec: 1749.5). Total num frames: 6963200. Throughput: 0: 177.6. Samples: 1748120. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:29:52,803][52567] Avg episode reward: [(0, '-4.741')] [2024-08-05 21:29:57,798][52567] Fps is (10 sec: 819.5, 60 sec: 682.7, 300 sec: 1749.5). Total num frames: 6963200. Throughput: 0: 171.2. Samples: 1748570. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:29:57,808][52567] Avg episode reward: [(0, '-4.741')] [2024-08-05 21:30:02,803][52567] Fps is (10 sec: 0.0, 60 sec: 682.6, 300 sec: 1749.5). Total num frames: 6963200. Throughput: 0: 159.8. Samples: 1749320. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:30:02,817][52567] Avg episode reward: [(0, '-4.741')] [2024-08-05 21:30:04,751][52803] DAMAGECOUNT value on done: 120.0 [2024-08-05 21:30:04,931][52803] Sum rewards: -3.287, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.005', 'AMMO2': '0.018', 'HITCOUNT': '0.070', 'AMMO3': '0.078', 'AMMO4': '0.091', 'DAMAGECOUNT': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'ARMOR': '0.491', 'weapon4': '0.610', 'weapon3': '0.708', 'FRAGCOUNT': '1.000', 'weapon2': '1.492'} [2024-08-05 21:30:07,810][52567] Fps is (10 sec: 0.0, 60 sec: 546.1, 300 sec: 1749.5). Total num frames: 6963200. Throughput: 0: 143.3. Samples: 1749720. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:30:07,861][52567] Avg episode reward: [(0, '-4.754')] [2024-08-05 21:30:12,857][52567] Fps is (10 sec: 0.0, 60 sec: 545.7, 300 sec: 1721.4). Total num frames: 6963200. Throughput: 0: 141.8. Samples: 1750120. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:30:12,873][52567] Avg episode reward: [(0, '-4.754')] [2024-08-05 21:30:17,814][52567] Fps is (10 sec: 0.0, 60 sec: 546.0, 300 sec: 1693.9). Total num frames: 6963200. Throughput: 0: 117.7. Samples: 1750570. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 21:30:17,832][52567] Avg episode reward: [(0, '-4.754')] [2024-08-05 21:30:22,347][52650] Updated weights for policy 0, policy_version 851 (0.0490) [2024-08-05 21:30:22,347][52811] DAMAGECOUNT value on done: 251.0 [2024-08-05 21:30:22,352][52811] Sum rewards: -4.713, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.606', 'AMMO5': '0.005', 'AMMO2': '0.017', 'HITCOUNT': '0.070', 'weapon4': '0.072', 'ARMOR': '0.080', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.363', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.304', 'weapon2': '1.720'} [2024-08-05 21:30:22,845][52567] Fps is (10 sec: 822.4, 60 sec: 546.0, 300 sec: 1721.6). Total num frames: 6971392. Throughput: 0: 108.9. Samples: 1750570. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:30:22,881][52567] Avg episode reward: [(0, '-4.754')] [2024-08-05 21:30:27,798][52567] Fps is (10 sec: 820.4, 60 sec: 546.2, 300 sec: 1610.6). Total num frames: 6971392. Throughput: 0: 98.9. Samples: 1751320. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:30:27,806][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:30:32,798][52567] Fps is (10 sec: 0.0, 60 sec: 409.6, 300 sec: 1416.2). Total num frames: 6971392. Throughput: 0: 107.6. Samples: 1751770. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:30:32,807][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:30:36,604][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000852_6979584.pth... [2024-08-05 21:30:37,806][52567] Fps is (10 sec: 818.6, 60 sec: 546.1, 300 sec: 1332.9). Total num frames: 6979584. Throughput: 0: 81.1. Samples: 1751770. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:30:37,869][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:30:40,874][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000825_6758400.pth [2024-08-05 21:30:42,801][52567] Fps is (10 sec: 819.0, 60 sec: 546.1, 300 sec: 1221.8). Total num frames: 6979584. Throughput: 0: 88.9. Samples: 1752570. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:30:42,811][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:30:47,800][52567] Fps is (10 sec: 0.0, 60 sec: 409.6, 300 sec: 1166.3). Total num frames: 6979584. Throughput: 0: 81.1. Samples: 1752970. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:30:47,812][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:30:52,800][52567] Fps is (10 sec: 0.0, 60 sec: 273.1, 300 sec: 1055.2). Total num frames: 6979584. Throughput: 0: 97.8. Samples: 1754120. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:30:52,810][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:30:57,796][52567] Fps is (10 sec: 0.0, 60 sec: 273.1, 300 sec: 916.4). Total num frames: 6979584. Throughput: 0: 106.8. Samples: 1754920. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:30:57,802][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:02,800][52567] Fps is (10 sec: 0.0, 60 sec: 273.1, 300 sec: 888.6). Total num frames: 6979584. Throughput: 0: 106.7. Samples: 1755370. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 21:31:02,805][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:07,804][52567] Fps is (10 sec: 818.8, 60 sec: 409.6, 300 sec: 888.6). Total num frames: 6987776. Throughput: 0: 123.4. Samples: 1756120. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:31:07,827][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:12,795][52567] Fps is (10 sec: 1639.2, 60 sec: 546.7, 300 sec: 860.9). Total num frames: 6995968. Throughput: 0: 124.2. Samples: 1756910. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:31:12,797][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:17,806][52567] Fps is (10 sec: 818.9, 60 sec: 546.2, 300 sec: 833.1). Total num frames: 6995968. Throughput: 0: 124.4. Samples: 1757370. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:31:17,832][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:22,799][52567] Fps is (10 sec: 818.9, 60 sec: 546.3, 300 sec: 833.1). Total num frames: 7004160. Throughput: 0: 142.2. Samples: 1758170. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:31:22,808][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:27,802][52567] Fps is (10 sec: 819.5, 60 sec: 546.1, 300 sec: 833.1). Total num frames: 7004160. Throughput: 0: 140.7. Samples: 1758900. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:31:27,929][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:32,811][52567] Fps is (10 sec: 0.0, 60 sec: 546.0, 300 sec: 833.1). Total num frames: 7004160. Throughput: 0: 142.2. Samples: 1759370. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:31:32,843][52567] Avg episode reward: [(0, '-4.758')] [2024-08-05 21:31:35,433][52820] DAMAGECOUNT value on done: 395.0 [2024-08-05 21:31:35,484][52820] Sum rewards: -3.706, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.340', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.180', 'HITCOUNT': '0.220', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.900', 'weapon3': '1.400', 'weapon2': '1.580', 'FRAGCOUNT': '3.000'} [2024-08-05 21:31:37,796][52567] Fps is (10 sec: 0.0, 60 sec: 409.7, 300 sec: 805.3). Total num frames: 7004160. Throughput: 0: 125.6. Samples: 1759770. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:31:37,802][52567] Avg episode reward: [(0, '-4.746')] [2024-08-05 21:31:37,957][52795] DAMAGECOUNT value on done: 153.0 [2024-08-05 21:31:38,018][52795] Sum rewards: -4.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.725', 'AMMO2': '0.003', 'AMMO4': '0.012', 'HITCOUNT': '0.090', 'ARMOR': '0.106', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon4': '0.252', 'DAMAGECOUNT': '0.354', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.250', 'weapon2': '1.720'} [2024-08-05 21:31:40,472][52803] DAMAGECOUNT value on done: 273.0 [2024-08-05 21:31:40,493][52803] Sum rewards: -1.928, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.905', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.009', 'ARMOR': '0.036', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.278', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.700', 'weapon2': '1.086', 'weapon3': '1.320', 'FRAGCOUNT': '2.000'} [2024-08-05 21:31:40,774][52811] DAMAGECOUNT value on done: 138.0 [2024-08-05 21:31:42,795][52567] Fps is (10 sec: 4102.5, 60 sec: 1092.3, 300 sec: 916.4). Total num frames: 7045120. Throughput: 0: 299.8. Samples: 1768410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:31:42,797][52567] Avg episode reward: [(0, '-4.684')] [2024-08-05 21:31:43,878][52650] Updated weights for policy 0, policy_version 861 (0.0425) [2024-08-05 21:31:44,303][52820] DAMAGECOUNT value on done: 220.0 [2024-08-05 21:31:47,810][52567] Fps is (10 sec: 5729.3, 60 sec: 1365.2, 300 sec: 971.9). Total num frames: 7061504. Throughput: 0: 402.4. Samples: 1773480. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:31:47,814][52567] Avg episode reward: [(0, '-4.668')] [2024-08-05 21:31:47,891][52795] DAMAGECOUNT value on done: 271.0 [2024-08-05 21:31:48,053][52795] Sum rewards: -1.390, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon5': '0.084', 'HEALTH': '0.096', 'HITCOUNT': '0.100', 'AMMO3': '0.108', 'weapon4': '0.196', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon3': '1.122', 'weapon2': '1.518'} [2024-08-05 21:31:52,800][52567] Fps is (10 sec: 1637.8, 60 sec: 1365.3, 300 sec: 972.0). Total num frames: 7061504. Throughput: 0: 403.6. Samples: 1774280. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:31:52,817][52567] Avg episode reward: [(0, '-4.630')] [2024-08-05 21:31:57,796][52567] Fps is (10 sec: 819.9, 60 sec: 1501.9, 300 sec: 971.9). Total num frames: 7069696. Throughput: 0: 403.8. Samples: 1775080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:31:57,802][52567] Avg episode reward: [(0, '-4.630')] [2024-08-05 21:32:02,804][52567] Fps is (10 sec: 818.8, 60 sec: 1501.8, 300 sec: 944.1). Total num frames: 7069696. Throughput: 0: 411.3. Samples: 1775880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:32:02,822][52567] Avg episode reward: [(0, '-4.630')] [2024-08-05 21:32:07,809][52567] Fps is (10 sec: 0.0, 60 sec: 1365.2, 300 sec: 944.1). Total num frames: 7069696. Throughput: 0: 411.2. Samples: 1776680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:32:07,820][52567] Avg episode reward: [(0, '-4.630')] [2024-08-05 21:32:09,017][52811] DAMAGECOUNT value on done: 99.0 [2024-08-05 21:32:12,799][52567] Fps is (10 sec: 819.6, 60 sec: 1365.2, 300 sec: 944.2). Total num frames: 7077888. Throughput: 0: 412.9. Samples: 1777480. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:32:12,810][52567] Avg episode reward: [(0, '-4.617')] [2024-08-05 21:32:14,211][52803] DAMAGECOUNT value on done: 422.0 [2024-08-05 21:32:14,218][52803] Sum rewards: -2.264, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.324', 'AMMO2': '0.002', 'weapon4': '0.008', 'AMMO4': '0.012', 'ARMOR': '0.028', 'HITCOUNT': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.135', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.586', 'weapon2': '1.596'} [2024-08-05 21:32:17,802][52567] Fps is (10 sec: 1640.1, 60 sec: 1502.0, 300 sec: 972.0). Total num frames: 7086080. Throughput: 0: 455.9. Samples: 1779880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:32:17,807][52567] Avg episode reward: [(0, '-4.624')] [2024-08-05 21:32:22,822][52567] Fps is (10 sec: 1637.7, 60 sec: 1501.8, 300 sec: 971.9). Total num frames: 7094272. Throughput: 0: 482.4. Samples: 1781480. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:32:22,833][52567] Avg episode reward: [(0, '-4.624')] [2024-08-05 21:32:24,388][52820] DAMAGECOUNT value on done: 55.0 [2024-08-05 21:32:24,801][52795] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:32:26,037][52650] Updated weights for policy 0, policy_version 871 (0.0201) [2024-08-05 21:32:26,116][52811] DAMAGECOUNT value on done: 174.0 [2024-08-05 21:32:26,118][52811] Sum rewards: -4.480, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO2': '0.017', 'HITCOUNT': '0.050', 'ARMOR': '0.080', 'AMMO4': '0.082', 'AMMO3': '0.120', 'DAMAGECOUNT': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.550', 'weapon3': '1.142', 'weapon2': '1.706', 'FRAGCOUNT': '2.000'} [2024-08-05 21:32:26,646][52803] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:32:26,647][52803] Sum rewards: -7.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.586', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.087', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.112', 'weapon3': '1.890'} [2024-08-05 21:32:27,670][52820] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:32:27,671][52820] Sum rewards: -1.680, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.648', 'AMMO2': '0.008', 'AMMO4': '0.040', 'HITCOUNT': '0.050', 'weapon4': '0.070', 'ARMOR': '0.096', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.550', 'weapon2': '1.338', 'weapon3': '1.686', 'FRAGCOUNT': '3.000'} [2024-08-05 21:32:27,794][52567] Fps is (10 sec: 8195.0, 60 sec: 2731.0, 300 sec: 1194.1). Total num frames: 7168000. Throughput: 0: 670.0. Samples: 1798560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:32:27,795][52567] Avg episode reward: [(0, '-4.638')] [2024-08-05 21:32:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000875_7168000.pth... [2024-08-05 21:32:27,938][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000840_6881280.pth [2024-08-05 21:32:28,035][52795] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:32:29,443][52811] DAMAGECOUNT value on done: 50.0 [2024-08-05 21:32:29,941][52803] DAMAGECOUNT value on done: 135.0 [2024-08-05 21:32:30,459][52820] DAMAGECOUNT value on done: 135.0 [2024-08-05 21:32:30,464][52820] Sum rewards: -1.410, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.227', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.055', 'HITCOUNT': '0.080', 'WEAPON4': '0.300', 'weapon4': '0.330', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.350', 'ARMOR': '0.565', 'FRAGCOUNT': '1.000', 'weapon3': '1.052', 'weapon2': '1.640'} [2024-08-05 21:32:30,508][52650] Updated weights for policy 0, policy_version 881 (0.0021) [2024-08-05 21:32:32,794][52567] Fps is (10 sec: 16397.9, 60 sec: 4233.7, 300 sec: 1499.6). Total num frames: 7258112. Throughput: 0: 866.4. Samples: 1812460. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:32:32,794][52567] Avg episode reward: [(0, '-4.650')] [2024-08-05 21:32:32,814][52803] DAMAGECOUNT value on done: 212.0 [2024-08-05 21:32:32,815][52803] Sum rewards: -7.993, reward structure: {'DEATHCOUNT': '-10.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.302', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.800', 'weapon2': '1.212', 'weapon3': '1.404'} [2024-08-05 21:32:33,365][52820] DAMAGECOUNT value on done: 501.0 [2024-08-05 21:32:33,372][52820] Sum rewards: -3.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.333', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.158', 'HITCOUNT': '0.360', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.293', 'weapon2': '1.452', 'weapon3': '1.602', 'FRAGCOUNT': '4.000'} [2024-08-05 21:32:35,134][52650] Updated weights for policy 0, policy_version 891 (0.0015) [2024-08-05 21:32:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 5734.5, 300 sec: 1777.3). Total num frames: 7348224. Throughput: 0: 1480.6. Samples: 1840900. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:32:37,794][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:32:39,427][52650] Updated weights for policy 0, policy_version 901 (0.0031) [2024-08-05 21:32:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 6553.7, 300 sec: 2082.8). Total num frames: 7438336. Throughput: 0: 2073.4. Samples: 1868380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:32:42,802][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:32:43,776][52650] Updated weights for policy 0, policy_version 911 (0.0010) [2024-08-05 21:32:47,795][52567] Fps is (10 sec: 18021.3, 60 sec: 7783.6, 300 sec: 2332.7). Total num frames: 7528448. Throughput: 0: 2368.0. Samples: 1882420. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:32:47,803][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:32:48,146][52650] Updated weights for policy 0, policy_version 921 (0.0018) [2024-08-05 21:32:52,727][52650] Updated weights for policy 0, policy_version 931 (0.0013) [2024-08-05 21:32:52,794][52567] Fps is (10 sec: 18841.8, 60 sec: 9421.6, 300 sec: 2665.9). Total num frames: 7626752. Throughput: 0: 2957.6. Samples: 1909730. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 21:32:52,794][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:32:57,247][52650] Updated weights for policy 0, policy_version 941 (0.0021) [2024-08-05 21:32:57,794][52567] Fps is (10 sec: 18842.7, 60 sec: 10786.3, 300 sec: 2943.9). Total num frames: 7716864. Throughput: 0: 3551.2. Samples: 1937270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:32:57,794][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:01,730][52650] Updated weights for policy 0, policy_version 951 (0.0019) [2024-08-05 21:33:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 12289.9, 300 sec: 3221.3). Total num frames: 7806976. Throughput: 0: 3805.2. Samples: 1951100. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:33:02,794][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:03,820][52614] Signal inference workers to stop experience collection... (150 times) [2024-08-05 21:33:03,820][52614] Signal inference workers to resume experience collection... (150 times) [2024-08-05 21:33:03,870][52650] InferenceWorker_p0-w0: stopping experience collection (150 times) [2024-08-05 21:33:03,870][52650] InferenceWorker_p0-w0: resuming experience collection (150 times) [2024-08-05 21:33:06,204][52650] Updated weights for policy 0, policy_version 961 (0.0022) [2024-08-05 21:33:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 13793.1, 300 sec: 3499.0). Total num frames: 7897088. Throughput: 0: 4370.8. Samples: 1978130. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:33:07,794][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:10,055][52665] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:33:10,859][52650] Updated weights for policy 0, policy_version 971 (0.0015) [2024-08-05 21:33:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 15156.2, 300 sec: 3804.5). Total num frames: 7987200. Throughput: 0: 4595.6. Samples: 2005360. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:33:12,794][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:15,501][52650] Updated weights for policy 0, policy_version 981 (0.0012) [2024-08-05 21:33:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16521.6, 300 sec: 4110.0). Total num frames: 8077312. Throughput: 0: 4582.9. Samples: 2018690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:33:17,802][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:19,969][52650] Updated weights for policy 0, policy_version 991 (0.0014) [2024-08-05 21:33:22,795][52567] Fps is (10 sec: 18022.1, 60 sec: 17888.3, 300 sec: 4387.6). Total num frames: 8167424. Throughput: 0: 4533.8. Samples: 2044920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:33:22,796][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:24,720][52650] Updated weights for policy 0, policy_version 1001 (0.0018) [2024-08-05 21:33:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 18022.4, 300 sec: 4637.6). Total num frames: 8249344. Throughput: 0: 4506.5. Samples: 2071170. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:33:27,802][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:29,573][52650] Updated weights for policy 0, policy_version 1011 (0.0018) [2024-08-05 21:33:32,795][52567] Fps is (10 sec: 16382.1, 60 sec: 17885.5, 300 sec: 4859.8). Total num frames: 8331264. Throughput: 0: 4487.0. Samples: 2084340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 21:33:32,803][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:34,082][52650] Updated weights for policy 0, policy_version 1021 (0.0013) [2024-08-05 21:33:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 5137.5). Total num frames: 8429568. Throughput: 0: 4463.6. Samples: 2110590. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:33:37,802][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:39,021][52650] Updated weights for policy 0, policy_version 1031 (0.0011) [2024-08-05 21:33:42,794][52567] Fps is (10 sec: 18844.1, 60 sec: 18022.4, 300 sec: 5442.9). Total num frames: 8519680. Throughput: 0: 4429.8. Samples: 2136610. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 21:33:42,802][52567] Avg episode reward: [(0, '-4.683')] [2024-08-05 21:33:43,224][52650] Updated weights for policy 0, policy_version 1041 (0.0011) [2024-08-05 21:33:44,513][52665] DAMAGECOUNT value on done: 332.0 [2024-08-05 21:33:44,516][52665] Sum rewards: -1.200, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.044', 'ARMOR': '0.048', 'AMMO4': '0.055', 'weapon5': '0.082', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.852', 'weapon2': '1.232', 'weapon3': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 21:33:47,288][52665] DAMAGECOUNT value on done: 315.0 [2024-08-05 21:33:47,585][52649] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:33:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17886.0, 300 sec: 5720.5). Total num frames: 8601600. Throughput: 0: 4422.7. Samples: 2150120. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:33:47,794][52567] Avg episode reward: [(0, '-4.681')] [2024-08-05 21:33:47,979][52650] Updated weights for policy 0, policy_version 1051 (0.0012) [2024-08-05 21:33:50,151][52665] DAMAGECOUNT value on done: 349.0 [2024-08-05 21:33:50,151][52665] Sum rewards: -4.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.062', 'AMMO5': '0.009', 'weapon4': '0.010', 'weapon5': '0.012', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.061', 'HITCOUNT': '0.120', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.381', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.364', 'weapon2': '1.700'} [2024-08-05 21:33:50,478][52794] DAMAGECOUNT value on done: 235.0 [2024-08-05 21:33:50,478][52794] Sum rewards: -3.538, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.858', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.172', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'weapon3': '1.068', 'weapon2': '1.672', 'FRAGCOUNT': '2.000'} [2024-08-05 21:33:50,502][52649] DAMAGECOUNT value on done: 548.0 [2024-08-05 21:33:50,502][52649] Sum rewards: -5.891, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.349', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.047', 'HITCOUNT': '0.090', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.300', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.174', 'weapon3': '2.280'} [2024-08-05 21:33:51,613][52662] DAMAGECOUNT value on done: 454.0 [2024-08-05 21:33:51,623][52662] Sum rewards: -5.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.010', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'HITCOUNT': '0.290', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.020', 'weapon2': '1.336', 'weapon3': '2.236', 'FRAGCOUNT': '4.000'} [2024-08-05 21:33:52,586][52650] Updated weights for policy 0, policy_version 1061 (0.0011) [2024-08-05 21:33:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 5998.4). Total num frames: 8691712. Throughput: 0: 4407.1. Samples: 2176450. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:33:52,795][52567] Avg episode reward: [(0, '-4.747')] [2024-08-05 21:33:52,855][52794] DAMAGECOUNT value on done: 210.0 [2024-08-05 21:33:53,266][52665] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:33:53,267][52665] Sum rewards: -8.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.165', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.072', 'HITCOUNT': '0.090', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.550', 'ARMOR': '0.997', 'FRAGCOUNT': '1.000', 'weapon3': '1.142', 'weapon2': '2.182'} [2024-08-05 21:33:53,643][52649] DAMAGECOUNT value on done: 257.0 [2024-08-05 21:33:54,169][52662] DAMAGECOUNT value on done: 224.0 [2024-08-05 21:33:55,303][52794] DAMAGECOUNT value on done: 275.0 [2024-08-05 21:33:55,312][52794] Sum rewards: -1.378, reward structure: {'DEATHCOUNT': '-7.500', 'weapon5': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.099', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.500', 'HEALTH': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.462', 'weapon2': '1.558'} [2024-08-05 21:33:56,275][52665] DAMAGECOUNT value on done: 484.0 [2024-08-05 21:33:56,276][52665] Sum rewards: -1.461, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.582', 'AMMO2': '0.020', 'ARMOR': '0.076', 'AMMO4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.272', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.650', 'weapon3': '1.584', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'} [2024-08-05 21:33:56,523][52662] DAMAGECOUNT value on done: 257.0 [2024-08-05 21:33:56,523][52662] Sum rewards: -6.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.014', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'DAMAGECOUNT': '0.255', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.450', 'weapon3': '1.806'} [2024-08-05 21:33:56,659][52649] DAMAGECOUNT value on done: 256.0 [2024-08-05 21:33:57,268][52650] Updated weights for policy 0, policy_version 1071 (0.0012) [2024-08-05 21:33:57,528][52794] DAMAGECOUNT value on done: 177.0 [2024-08-05 21:33:57,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17612.6, 300 sec: 6276.0). Total num frames: 8773632. Throughput: 0: 4403.1. Samples: 2203500. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:33:57,795][52567] Avg episode reward: [(0, '-4.726')] [2024-08-05 21:33:58,441][52660] Large shaping reward -2.529 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('WEAPON1', 0.02, 1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:33:58,750][52662] DAMAGECOUNT value on done: 317.0 [2024-08-05 21:33:58,751][52662] Sum rewards: -5.167, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.556', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.026', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.104', 'AMMO4': '0.130', 'DAMAGECOUNT': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon4': '0.616', 'FRAGCOUNT': '1.000', 'weapon2': '1.142', 'weapon3': '1.554'} [2024-08-05 21:33:58,938][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 21:33:59,116][52665] DAMAGECOUNT value on done: 105.0 [2024-08-05 21:33:59,675][52649] DAMAGECOUNT value on done: 172.0 [2024-08-05 21:33:59,982][52794] DAMAGECOUNT value on done: 165.0 [2024-08-05 21:33:59,982][52794] Sum rewards: -3.091, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.230', 'weapon2': '1.380'} [2024-08-05 21:34:01,112][52662] DAMAGECOUNT value on done: 219.0 [2024-08-05 21:34:01,113][52662] Sum rewards: -6.248, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.255', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.156', 'weapon4': '0.164', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.900', 'weapon2': '1.478', 'weapon3': '1.694', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:01,751][52650] Updated weights for policy 0, policy_version 1081 (0.0011) [2024-08-05 21:34:01,787][52665] DAMAGECOUNT value on done: 147.0 [2024-08-05 21:34:01,788][52665] Sum rewards: -3.954, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.270', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.113', 'weapon4': '0.138', 'DAMAGECOUNT': '0.240', 'ARMOR': '0.516', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.092', 'weapon3': '2.086'} [2024-08-05 21:34:02,205][52649] DAMAGECOUNT value on done: 205.0 [2024-08-05 21:34:02,206][52649] Sum rewards: -3.689, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.644', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.052', 'ARMOR': '0.060', 'HITCOUNT': '0.090', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.452', 'weapon3': '1.922'} [2024-08-05 21:34:02,241][52794] DAMAGECOUNT value on done: 366.0 [2024-08-05 21:34:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 6581.5). Total num frames: 8871936. Throughput: 0: 4399.1. Samples: 2216650. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:34:02,794][52567] Avg episode reward: [(0, '-4.819')] [2024-08-05 21:34:03,209][52667] DAMAGECOUNT value on done: 156.0 [2024-08-05 21:34:03,428][52662] DAMAGECOUNT value on done: 295.0 [2024-08-05 21:34:04,040][52658] DAMAGECOUNT value on done: 475.0 [2024-08-05 21:34:04,042][52658] Sum rewards: -2.050, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.110', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.330', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '0.500', 'weapon3': '1.168', 'weapon2': '1.700'} [2024-08-05 21:34:04,592][52794] DAMAGECOUNT value on done: 217.0 [2024-08-05 21:34:04,593][52794] Sum rewards: -4.204, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO2': '0.018', 'ARMOR': '0.048', 'HITCOUNT': '0.070', 'AMMO4': '0.089', 'AMMO3': '0.092', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.315', 'weapon4': '0.506', 'WEAPON3': '0.600', 'weapon2': '0.952', 'FRAGCOUNT': '1.000', 'weapon3': '1.196'} [2024-08-05 21:34:04,812][52665] DAMAGECOUNT value on done: 387.0 [2024-08-05 21:34:04,814][52665] Sum rewards: -3.561, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.995', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'ARMOR': '0.012', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.254', 'DAMAGECOUNT': '0.696', 'WEAPON3': '0.850', 'weapon2': '1.322', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:05,155][52649] DAMAGECOUNT value on done: 255.0 [2024-08-05 21:34:05,155][52649] Sum rewards: -6.399, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.931', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.042', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.668', 'weapon3': '1.742'} [2024-08-05 21:34:05,525][52667] DAMAGECOUNT value on done: 252.0 [2024-08-05 21:34:06,216][52662] DAMAGECOUNT value on done: 322.0 [2024-08-05 21:34:06,491][52650] Updated weights for policy 0, policy_version 1091 (0.0013) [2024-08-05 21:34:06,521][52658] DAMAGECOUNT value on done: 326.0 [2024-08-05 21:34:06,523][52658] Sum rewards: 1.248, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'ARMOR': '0.062', 'AMMO4': '0.080', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.194', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.882', 'weapon2': '0.980', 'HEALTH': '1.151', 'weapon3': '1.984', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:06,663][52647] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:34:06,663][52647] Sum rewards: -2.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.324', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'ARMOR': '0.068', 'AMMO3': '0.088', 'HITCOUNT': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.345', 'weapon4': '0.426', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.764'} [2024-08-05 21:34:07,405][52794] DAMAGECOUNT value on done: 270.0 [2024-08-05 21:34:07,406][52794] Sum rewards: -4.807, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.101', 'FRAGCOUNT': '-0.500', 'weapon5': '0.008', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon4': '0.016', 'AMMO4': '0.047', 'HITCOUNT': '0.090', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.600', 'ARMOR': '0.948', 'weapon3': '1.300', 'weapon2': '2.148'} [2024-08-05 21:34:07,679][52665] DAMAGECOUNT value on done: 288.0 [2024-08-05 21:34:07,680][52665] Sum rewards: -6.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.326', 'weapon5': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.031', 'ARMOR': '0.096', 'AMMO3': '0.131', 'HITCOUNT': '0.150', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.402', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.564', 'WEAPON3': '0.750', 'weapon3': '1.172', 'weapon2': '1.762'} [2024-08-05 21:34:07,794][52567] Fps is (10 sec: 18842.5, 60 sec: 17749.3, 300 sec: 6887.1). Total num frames: 8962048. Throughput: 0: 4409.8. Samples: 2243360. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-05 21:34:07,795][52567] Avg episode reward: [(0, '-4.611')] [2024-08-05 21:34:08,165][52667] DAMAGECOUNT value on done: 296.0 [2024-08-05 21:34:08,250][52649] DAMAGECOUNT value on done: 264.0 [2024-08-05 21:34:08,259][52649] Sum rewards: -0.833, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.082', 'ARMOR': '0.090', 'AMMO3': '0.100', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.188', 'weapon3': '1.956'} [2024-08-05 21:34:08,707][52662] DAMAGECOUNT value on done: 411.0 [2024-08-05 21:34:08,708][52662] Sum rewards: -1.898, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.496', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.190', 'weapon4': '0.268', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.750', 'weapon3': '1.352', 'weapon2': '1.556', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:09,245][52647] DAMAGECOUNT value on done: 261.0 [2024-08-05 21:34:09,494][52658] DAMAGECOUNT value on done: 257.0 [2024-08-05 21:34:09,494][52658] Sum rewards: -2.167, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.055', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.387', 'weapon3': '0.872', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:09,619][52794] DAMAGECOUNT value on done: 95.0 [2024-08-05 21:34:09,800][52668] DAMAGECOUNT value on done: 297.0 [2024-08-05 21:34:09,882][52669] DAMAGECOUNT value on done: 135.0 [2024-08-05 21:34:10,703][52650] Updated weights for policy 0, policy_version 1101 (0.0012) [2024-08-05 21:34:10,847][52665] DAMAGECOUNT value on done: 430.0 [2024-08-05 21:34:10,849][52665] Sum rewards: -2.391, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.298', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.068', 'AMMO4': '0.079', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.444', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.038', 'weapon2': '1.342', 'weapon3': '1.704'} [2024-08-05 21:34:11,183][52662] DAMAGECOUNT value on done: 238.0 [2024-08-05 21:34:11,183][52662] Sum rewards: -2.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.036', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.088', 'HITCOUNT': '0.130', 'weapon4': '0.166', 'DAMAGECOUNT': '0.414', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.412', 'weapon3': '1.442'} [2024-08-05 21:34:11,359][52667] DAMAGECOUNT value on done: 157.0 [2024-08-05 21:34:11,359][52667] Sum rewards: -2.336, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.505', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.073', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.452', 'weapon2': '1.100', 'weapon3': '1.236'} [2024-08-05 21:34:11,458][52649] DAMAGECOUNT value on done: 285.0 [2024-08-05 21:34:11,460][52649] Sum rewards: -5.211, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO2': '0.017', 'AMMO3': '0.069', 'AMMO4': '0.084', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.180', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.176', 'weapon2': '2.018'} [2024-08-05 21:34:11,652][52647] DAMAGECOUNT value on done: 418.0 [2024-08-05 21:34:11,660][52647] Sum rewards: -3.477, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.268', 'AMMO2': '0.005', 'AMMO4': '0.023', 'ARMOR': '0.056', 'AMMO3': '0.084', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.272', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.555', 'weapon3': '1.026', 'weapon2': '1.970', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:11,795][52664] DAMAGECOUNT value on done: 474.0 [2024-08-05 21:34:11,796][52664] Sum rewards: -0.377, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'HITCOUNT': '0.190', 'HEALTH': '0.206', 'weapon4': '0.290', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.020', 'weapon2': '1.098', 'weapon3': '1.224'} [2024-08-05 21:34:11,816][52660] DAMAGECOUNT value on done: 290.0 [2024-08-05 21:34:11,816][52660] Sum rewards: -2.884, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.730', 'AMMO2': '0.024', 'ARMOR': '0.048', 'AMMO4': '0.117', 'HITCOUNT': '0.120', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.292', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.336', 'weapon3': '1.598', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:12,064][52663] DAMAGECOUNT value on done: 612.0 [2024-08-05 21:34:12,066][52663] Sum rewards: 1.627, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.360', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.248', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.921', 'weapon2': '1.110', 'weapon3': '1.644', 'FRAGCOUNT': '4.000'} [2024-08-05 21:34:12,228][52794] DAMAGECOUNT value on done: 310.0 [2024-08-05 21:34:12,229][52794] Sum rewards: -6.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.764', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.040', 'AMMO3': '0.080', 'AMMO4': '0.080', 'HITCOUNT': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.242', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'weapon3': '1.052', 'weapon2': '2.152'} [2024-08-05 21:34:12,465][52658] DAMAGECOUNT value on done: 214.0 [2024-08-05 21:34:12,647][52669] DAMAGECOUNT value on done: 464.0 [2024-08-05 21:34:12,648][52669] Sum rewards: 0.403, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'ARMOR': '0.068', 'AMMO4': '0.099', 'HITCOUNT': '0.140', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.420', 'DAMAGECOUNT': '0.669', 'weapon3': '1.044', 'weapon2': '1.326', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 7192.4). Total num frames: 9052160. Throughput: 0: 4415.1. Samples: 2269850. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:34:12,795][52567] Avg episode reward: [(0, '-4.003')] [2024-08-05 21:34:12,795][52614] Saving new best policy, reward=-4.003! [2024-08-05 21:34:13,030][52668] DAMAGECOUNT value on done: 280.0 [2024-08-05 21:34:13,939][52665] DAMAGECOUNT value on done: 480.0 [2024-08-05 21:34:13,941][52665] Sum rewards: -3.389, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO2': '0.019', 'ARMOR': '0.036', 'AMMO3': '0.068', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.288', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000', 'weapon3': '1.142', 'weapon2': '1.826'} [2024-08-05 21:34:14,015][52662] DAMAGECOUNT value on done: 320.0 [2024-08-05 21:34:14,025][52667] DAMAGECOUNT value on done: 435.0 [2024-08-05 21:34:14,026][52667] Sum rewards: -0.443, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.003', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon4': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.150', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'HEALTH': '0.508', 'weapon3': '1.460', 'weapon2': '1.526', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:14,198][52647] DAMAGECOUNT value on done: 197.0 [2024-08-05 21:34:14,198][52647] Sum rewards: -6.681, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.024', 'ARMOR': '0.061', 'HITCOUNT': '0.070', 'AMMO3': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.180', 'HEALTH': '0.267', 'weapon4': '0.482', 'WEAPON3': '0.500', 'weapon3': '0.764', 'FRAGCOUNT': '1.000', 'weapon2': '1.604'} [2024-08-05 21:34:14,355][52664] DAMAGECOUNT value on done: 317.0 [2024-08-05 21:34:14,355][52664] Sum rewards: -2.555, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.950', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.180', 'weapon4': '0.272', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.570', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'weapon2': '1.388'} [2024-08-05 21:34:14,770][52649] DAMAGECOUNT value on done: 211.0 [2024-08-05 21:34:14,771][52649] Sum rewards: -0.132, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.788', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.016', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.194', 'DAMAGECOUNT': '0.378', 'WEAPON3': '0.400', 'weapon3': '0.822', 'FRAGCOUNT': '1.000', 'weapon2': '1.992'} [2024-08-05 21:34:14,917][52660] DAMAGECOUNT value on done: 254.0 [2024-08-05 21:34:14,920][52660] Sum rewards: -1.734, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.720', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon5': '0.030', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.234', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.600', 'weapon3': '1.176', 'weapon2': '1.714', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:15,028][52663] DAMAGECOUNT value on done: 189.0 [2024-08-05 21:34:15,028][52663] Sum rewards: -6.336, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.628', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO3': '0.107', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.380', 'weapon2': '1.912'} [2024-08-05 21:34:15,114][52658] DAMAGECOUNT value on done: 298.0 [2024-08-05 21:34:15,280][52794] DAMAGECOUNT value on done: 230.0 [2024-08-05 21:34:15,280][52794] Sum rewards: -4.594, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.965', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'HITCOUNT': '0.070', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.129', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.184', 'weapon2': '2.198'} [2024-08-05 21:34:15,392][52669] DAMAGECOUNT value on done: 154.0 [2024-08-05 21:34:15,621][52650] Updated weights for policy 0, policy_version 1111 (0.0026) [2024-08-05 21:34:15,740][52666] DAMAGECOUNT value on done: 168.0 [2024-08-05 21:34:16,104][52668] DAMAGECOUNT value on done: 572.0 [2024-08-05 21:34:16,105][52668] Sum rewards: -0.580, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO4': '0.036', 'AMMO3': '0.086', 'ARMOR': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.282', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.636', 'FRAGCOUNT': '1.000', 'weapon2': '1.476', 'weapon3': '1.558'} [2024-08-05 21:34:16,708][52647] DAMAGECOUNT value on done: 140.0 [2024-08-05 21:34:16,710][52647] Sum rewards: -5.751, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.038', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.009', 'HITCOUNT': '0.010', 'weapon5': '0.024', 'ARMOR': '0.072', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.249', 'weapon4': '0.274', 'WEAPON3': '0.500', 'weapon2': '1.404', 'weapon3': '1.416'} [2024-08-05 21:34:16,761][52662] DAMAGECOUNT value on done: 250.0 [2024-08-05 21:34:16,762][52662] Sum rewards: -2.384, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.188', 'AMMO2': '0.013', 'AMMO5': '0.013', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.064', 'AMMO3': '0.110', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.254', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.700', 'weapon2': '1.326', 'weapon3': '1.600', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:16,836][52667] DAMAGECOUNT value on done: 331.0 [2024-08-05 21:34:16,836][52667] Sum rewards: -4.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.192', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.296', 'DAMAGECOUNT': '0.336', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.256', 'weapon2': '1.474'} [2024-08-05 21:34:16,837][52664] DAMAGECOUNT value on done: 400.0 [2024-08-05 21:34:16,837][52664] Sum rewards: -3.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.308', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.014', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.146', 'HITCOUNT': '0.200', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.900', 'weapon2': '1.028', 'weapon3': '2.418'} [2024-08-05 21:34:17,188][52665] DAMAGECOUNT value on done: 338.0 [2024-08-05 21:34:17,188][52665] Sum rewards: -6.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.908', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'weapon5': '0.006', 'weapon4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.114', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.489', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.668', 'weapon2': '1.764'} [2024-08-05 21:34:17,370][52670] DAMAGECOUNT value on done: 294.0 [2024-08-05 21:34:17,372][52670] Sum rewards: -6.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'ARMOR': '0.030', 'AMMO3': '0.192', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.124', 'weapon3': '2.332'} [2024-08-05 21:34:17,652][52649] DAMAGECOUNT value on done: 166.0 [2024-08-05 21:34:17,653][52649] Sum rewards: -2.545, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.200', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.048', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.126', 'DAMAGECOUNT': '0.135', 'AMMO3': '0.136', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.254', 'weapon3': '1.858'} [2024-08-05 21:34:17,773][52794] DAMAGECOUNT value on done: 233.0 [2024-08-05 21:34:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 7442.2). Total num frames: 9134080. Throughput: 0: 4407.9. Samples: 2282690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:34:17,794][52567] Avg episode reward: [(0, '-3.855')] [2024-08-05 21:34:17,797][52614] Saving new best policy, reward=-3.855! [2024-08-05 21:34:17,839][52660] DAMAGECOUNT value on done: 310.0 [2024-08-05 21:34:17,840][52660] Sum rewards: -2.834, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.602', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.060', 'AMMO3': '0.117', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.700', 'weapon3': '1.700'} [2024-08-05 21:34:17,939][52671] DAMAGECOUNT value on done: 189.0 [2024-08-05 21:34:17,940][52671] Sum rewards: -0.478, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'AMMO2': '0.022', 'HITCOUNT': '0.070', 'AMMO3': '0.085', 'AMMO4': '0.110', 'DAMAGECOUNT': '0.225', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'weapon4': '0.680', 'FRAGCOUNT': '1.000', 'weapon2': '1.170', 'weapon3': '1.210'} [2024-08-05 21:34:17,961][52663] DAMAGECOUNT value on done: 482.0 [2024-08-05 21:34:17,964][52663] Sum rewards: -2.676, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.131', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'HITCOUNT': '0.070', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.260', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.502', 'weapon2': '1.546'} [2024-08-05 21:34:18,023][52658] DAMAGECOUNT value on done: 285.0 [2024-08-05 21:34:18,023][52658] Sum rewards: -0.541, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.546', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.088', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.630', 'weapon3': '1.266', 'weapon2': '1.746', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:18,332][52669] DAMAGECOUNT value on done: 626.0 [2024-08-05 21:34:18,334][52669] Sum rewards: -0.254, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.932', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'ARMOR': '0.052', 'AMMO3': '0.130', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.143', 'weapon2': '1.694', 'weapon3': '1.780', 'FRAGCOUNT': '4.000'} [2024-08-05 21:34:19,016][52668] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:34:19,016][52668] Sum rewards: -4.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.066', 'HITCOUNT': '0.080', 'AMMO3': '0.146', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.700', 'weapon3': '1.500', 'weapon2': '1.982', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:19,091][52666] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:34:19,092][52666] Sum rewards: -4.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.648', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.104', 'ARMOR': '0.108', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.338', 'weapon3': '1.932'} [2024-08-05 21:34:19,174][52662] DAMAGECOUNT value on done: 589.0 [2024-08-05 21:34:19,175][52662] Sum rewards: -3.228, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.785', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.280', 'ARMOR': '0.440', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.005', 'weapon2': '1.460', 'weapon3': '1.838'} [2024-08-05 21:34:19,389][52647] DAMAGECOUNT value on done: 99.0 [2024-08-05 21:34:19,471][52659] DAMAGECOUNT value on done: 414.0 [2024-08-05 21:34:19,547][52664] DAMAGECOUNT value on done: 259.0 [2024-08-05 21:34:19,729][52665] DAMAGECOUNT value on done: 270.0 [2024-08-05 21:34:19,773][52667] DAMAGECOUNT value on done: 390.0 [2024-08-05 21:34:19,773][52667] Sum rewards: -2.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.891', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon4': '0.294', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.831', 'weapon3': '1.136', 'weapon2': '2.106', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:20,416][52650] Updated weights for policy 0, policy_version 1121 (0.0022) [2024-08-05 21:34:20,447][52660] DAMAGECOUNT value on done: 362.0 [2024-08-05 21:34:20,477][52794] DAMAGECOUNT value on done: 120.0 [2024-08-05 21:34:20,525][52649] DAMAGECOUNT value on done: 304.0 [2024-08-05 21:34:20,527][52649] Sum rewards: 2.081, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.016', 'AMMO3': '0.070', 'AMMO4': '0.080', 'ARMOR': '0.099', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON3': '0.300', 'HEALTH': '0.372', 'DAMAGECOUNT': '0.465', 'FRAGCOUNT': '1.000', 'weapon3': '1.328', 'weapon2': '1.784'} [2024-08-05 21:34:20,890][52670] DAMAGECOUNT value on done: 499.0 [2024-08-05 21:34:20,890][52670] Sum rewards: -1.187, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.177', 'HITCOUNT': '0.320', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.179', 'weapon2': '1.304', 'weapon3': '2.088', 'FRAGCOUNT': '4.000'} [2024-08-05 21:34:21,047][52658] DAMAGECOUNT value on done: 387.0 [2024-08-05 21:34:21,048][52658] Sum rewards: -3.969, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.559', 'AMMO2': '0.005', 'AMMO5': '0.017', 'AMMO4': '0.025', 'ARMOR': '0.028', 'weapon5': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.152', 'AMMO3': '0.170', 'HITCOUNT': '0.220', 'WEAPON5': '0.350', 'weapon2': '0.834', 'DAMAGECOUNT': '0.840', 'WEAPON3': '1.100', 'FRAGCOUNT': '2.000', 'weapon3': '2.270'} [2024-08-05 21:34:21,115][52671] DAMAGECOUNT value on done: 227.0 [2024-08-05 21:34:21,117][52671] Sum rewards: -3.860, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.522', 'weapon2': '1.568'} [2024-08-05 21:34:21,166][52663] DAMAGECOUNT value on done: 473.0 [2024-08-05 21:34:21,166][52663] Sum rewards: 0.482, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'HEALTH': '0.078', 'AMMO3': '0.082', 'HITCOUNT': '0.180', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'weapon2': '1.238', 'weapon3': '1.856', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:21,545][52669] DAMAGECOUNT value on done: 262.0 [2024-08-05 21:34:21,546][52669] Sum rewards: -3.002, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.934', 'AMMO5': '0.007', 'AMMO2': '0.019', 'HITCOUNT': '0.020', 'ARMOR': '0.036', 'DAMAGECOUNT': '0.060', 'AMMO4': '0.095', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.404', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.328', 'weapon2': '1.516'} [2024-08-05 21:34:21,584][52668] DAMAGECOUNT value on done: 224.0 [2024-08-05 21:34:22,071][52662] DAMAGECOUNT value on done: 311.0 [2024-08-05 21:34:22,071][52662] Sum rewards: -0.074, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.017', 'WEAPON1': '0.030', 'HEALTH': '0.073', 'AMMO4': '0.082', 'AMMO3': '0.104', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.288', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.468', 'WEAPON3': '0.600', 'weapon2': '1.112', 'weapon3': '1.722', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:22,157][52647] DAMAGECOUNT value on done: 446.0 [2024-08-05 21:34:22,163][52647] Sum rewards: -6.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.090', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.162', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.412', 'weapon2': '1.850'} [2024-08-05 21:34:22,305][52666] DAMAGECOUNT value on done: 308.0 [2024-08-05 21:34:22,419][52667] DAMAGECOUNT value on done: 512.0 [2024-08-05 21:34:22,419][52667] Sum rewards: -4.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.745', 'AMMO2': '0.004', 'weapon5': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.018', 'ARMOR': '0.048', 'AMMO3': '0.090', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '1.000', 'weapon3': '1.222', 'weapon2': '1.826'} [2024-08-05 21:34:22,468][52659] DAMAGECOUNT value on done: 250.0 [2024-08-05 21:34:22,469][52659] Sum rewards: -1.342, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'ARMOR': '0.067', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.130', 'weapon4': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'weapon3': '1.300', 'weapon2': '1.664'} [2024-08-05 21:34:22,525][52664] DAMAGECOUNT value on done: 521.0 [2024-08-05 21:34:22,525][52664] Sum rewards: -4.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.630', 'AMMO2': '0.013', 'ARMOR': '0.024', 'weapon7': '0.064', 'AMMO4': '0.066', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.000', 'weapon3': '1.372', 'weapon2': '1.874'} [2024-08-05 21:34:22,557][52665] DAMAGECOUNT value on done: 414.0 [2024-08-05 21:34:22,557][52665] Sum rewards: 1.550, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.360', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'HITCOUNT': '0.180', 'WEAPON3': '0.300', 'ARMOR': '0.540', 'DAMAGECOUNT': '0.807', 'weapon3': '1.390', 'weapon2': '1.714', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:22,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17476.3, 300 sec: 7720.1). Total num frames: 9216000. Throughput: 0: 4410.9. Samples: 2309080. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:34:22,794][52567] Avg episode reward: [(0, '-3.465')] [2024-08-05 21:34:22,795][52614] Saving new best policy, reward=-3.465! [2024-08-05 21:34:22,938][52660] DAMAGECOUNT value on done: 275.0 [2024-08-05 21:34:22,939][52660] Sum rewards: -5.480, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO2': '0.017', 'ARMOR': '0.028', 'AMMO4': '0.084', 'AMMO3': '0.138', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.280', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.526', 'weapon2': '1.558'} [2024-08-05 21:34:23,063][52794] DAMAGECOUNT value on done: 398.0 [2024-08-05 21:34:23,063][52794] Sum rewards: -6.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.438', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.256', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.388', 'weapon3': '1.738'} [2024-08-05 21:34:23,614][52649] DAMAGECOUNT value on done: 638.0 [2024-08-05 21:34:23,614][52649] Sum rewards: -2.659, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.166', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'AMMO3': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.202', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.384', 'ARMOR': '0.855', 'weapon3': '0.914', 'weapon2': '2.286'} [2024-08-05 21:34:23,772][52658] DAMAGECOUNT value on done: 259.0 [2024-08-05 21:34:23,774][52658] Sum rewards: -4.190, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.007', 'ARMOR': '0.020', 'weapon5': '0.030', 'AMMO4': '0.035', 'HITCOUNT': '0.040', 'DAMAGECOUNT': '0.057', 'weapon7': '0.086', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.448', 'WEAPON3': '0.500', 'weapon3': '1.058', 'weapon2': '1.110'} [2024-08-05 21:34:24,174][52670] DAMAGECOUNT value on done: 229.0 [2024-08-05 21:34:24,181][52670] Sum rewards: -2.627, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.458', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.083', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.267', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.482', 'weapon2': '1.752'} [2024-08-05 21:34:24,214][52663] DAMAGECOUNT value on done: 264.0 [2024-08-05 21:34:24,215][52668] DAMAGECOUNT value on done: 410.0 [2024-08-05 21:34:24,217][52668] Sum rewards: -4.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.105', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'ARMOR': '0.416', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.540', 'weapon3': '0.782', 'FRAGCOUNT': '2.000', 'weapon2': '2.176'} [2024-08-05 21:34:24,470][52669] DAMAGECOUNT value on done: 286.0 [2024-08-05 21:34:24,481][52671] DAMAGECOUNT value on done: 228.0 [2024-08-05 21:34:24,763][52662] DAMAGECOUNT value on done: 365.0 [2024-08-05 21:34:25,198][52647] DAMAGECOUNT value on done: 385.0 [2024-08-05 21:34:25,201][52650] Updated weights for policy 0, policy_version 1131 (0.0013) [2024-08-05 21:34:25,223][52667] DAMAGECOUNT value on done: 231.0 [2024-08-05 21:34:25,332][52665] DAMAGECOUNT value on done: 454.0 [2024-08-05 21:34:25,333][52665] Sum rewards: 1.272, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.362', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.022', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.095', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.714', 'weapon3': '1.466', 'weapon2': '1.646', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:25,479][52666] DAMAGECOUNT value on done: 180.0 [2024-08-05 21:34:25,481][52666] Sum rewards: -7.190, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.876', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'ARMOR': '0.080', 'HITCOUNT': '0.100', 'AMMO3': '0.149', 'DAMAGECOUNT': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.384', 'weapon2': '1.692'} [2024-08-05 21:34:25,587][52664] DAMAGECOUNT value on done: 249.0 [2024-08-05 21:34:25,735][52794] DAMAGECOUNT value on done: 723.0 [2024-08-05 21:34:25,736][52794] Sum rewards: -0.871, reward structure: {'DEATHCOUNT': '-6.750', 'weapon5': '0.002', 'AMMO5': '0.003', 'HEALTH': '0.004', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.128', 'ARMOR': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'weapon4': '0.280', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.627', 'FRAGCOUNT': '1.000', 'weapon3': '1.024', 'weapon2': '1.848'} [2024-08-05 21:34:25,780][52659] DAMAGECOUNT value on done: 550.0 [2024-08-05 21:34:25,781][52659] Sum rewards: -6.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.762', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.057', 'AMMO3': '0.141', 'HITCOUNT': '0.170', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.972', 'weapon3': '1.466', 'weapon2': '1.902', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:25,997][52649] DAMAGECOUNT value on done: 382.0 [2024-08-05 21:34:25,999][52649] Sum rewards: -1.698, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.295', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO4': '0.094', 'AMMO3': '0.109', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.801', 'FRAGCOUNT': '1.000', 'weapon2': '1.508', 'weapon3': '1.590'} [2024-08-05 21:34:26,056][52660] DAMAGECOUNT value on done: 215.0 [2024-08-05 21:34:26,657][52658] DAMAGECOUNT value on done: 236.0 [2024-08-05 21:34:26,972][52663] DAMAGECOUNT value on done: 388.0 [2024-08-05 21:34:26,974][52663] Sum rewards: -7.608, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.054', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.170', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.700', 'weapon3': '1.192', 'weapon2': '1.770'} [2024-08-05 21:34:27,157][52662] DAMAGECOUNT value on done: 147.0 [2024-08-05 21:34:27,232][52668] DAMAGECOUNT value on done: 391.0 [2024-08-05 21:34:27,233][52668] Sum rewards: 0.201, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.973', 'AMMO2': '0.008', 'AMMO4': '0.041', 'ARMOR': '0.080', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.170', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.708', 'WEAPON3': '0.800', 'weapon2': '1.134', 'weapon3': '2.226', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:27,289][52670] DAMAGECOUNT value on done: 180.0 [2024-08-05 21:34:27,334][52669] DAMAGECOUNT value on done: 335.0 [2024-08-05 21:34:27,556][52671] DAMAGECOUNT value on done: 629.0 [2024-08-05 21:34:27,556][52671] Sum rewards: -6.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.211', 'AMMO2': '0.016', 'ARMOR': '0.076', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'HITCOUNT': '0.180', 'weapon4': '0.290', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.194', 'weapon2': '1.858'} [2024-08-05 21:34:27,715][52647] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:34:27,715][52647] Sum rewards: -4.223, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.980', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'weapon5': '0.020', 'AMMO4': '0.030', 'HITCOUNT': '0.110', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.508', 'weapon2': '1.734'} [2024-08-05 21:34:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 7997.8). Total num frames: 9306112. Throughput: 0: 4413.8. Samples: 2335230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:34:27,794][52567] Avg episode reward: [(0, '-3.445')] [2024-08-05 21:34:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001136_9306112.pth... [2024-08-05 21:34:27,929][52667] DAMAGECOUNT value on done: 325.0 [2024-08-05 21:34:27,929][52667] Sum rewards: -5.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.024', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.159', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.236', 'DAMAGECOUNT': '0.750', 'WEAPON3': '0.900', 'weapon3': '1.532', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000852_6979584.pth [2024-08-05 21:34:27,957][52614] Saving new best policy, reward=-3.445! [2024-08-05 21:34:28,229][52664] DAMAGECOUNT value on done: 198.0 [2024-08-05 21:34:28,274][52794] DAMAGECOUNT value on done: 280.0 [2024-08-05 21:34:28,280][52794] Sum rewards: -6.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.398', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.190', 'DAMAGECOUNT': '0.405', 'weapon2': '0.906', 'WEAPON3': '1.200', 'FRAGCOUNT': '2.000', 'weapon3': '2.380'} [2024-08-05 21:34:28,541][52665] DAMAGECOUNT value on done: 261.0 [2024-08-05 21:34:28,542][52665] Sum rewards: -2.514, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.748', 'AMMO2': '0.011', 'AMMO4': '0.056', 'HITCOUNT': '0.080', 'AMMO3': '0.083', 'ARMOR': '0.097', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.255', 'weapon4': '0.414', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.518', 'weapon2': '1.520'} [2024-08-05 21:34:28,649][52666] DAMAGECOUNT value on done: 229.0 [2024-08-05 21:34:28,649][52666] Sum rewards: -0.853, reward structure: {'DEATHCOUNT': '-1.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.260', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'ARMOR': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'HITCOUNT': '0.090', 'DAMAGECOUNT': '0.177', 'WEAPON3': '0.250', 'weapon2': '0.748', 'weapon3': '0.972'} [2024-08-05 21:34:29,060][52659] DAMAGECOUNT value on done: 304.0 [2024-08-05 21:34:29,063][52659] Sum rewards: -1.148, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.822', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'HITCOUNT': '0.050', 'weapon4': '0.064', 'AMMO3': '0.080', 'DAMAGECOUNT': '0.087', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'ARMOR': '0.563', 'FRAGCOUNT': '1.000', 'weapon3': '1.480', 'weapon2': '1.802'} [2024-08-05 21:34:29,108][52658] DAMAGECOUNT value on done: 161.0 [2024-08-05 21:34:29,110][52658] Sum rewards: -7.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO2': '0.008', 'AMMO4': '0.038', 'HITCOUNT': '0.060', 'ARMOR': '0.084', 'AMMO3': '0.103', 'DAMAGECOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.300', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '1.876'} [2024-08-05 21:34:29,158][52660] DAMAGECOUNT value on done: 75.0 [2024-08-05 21:34:29,165][52649] DAMAGECOUNT value on done: 120.0 [2024-08-05 21:34:29,165][52649] Sum rewards: -1.395, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.365', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'HITCOUNT': '0.040', 'AMMO3': '0.087', 'DAMAGECOUNT': '0.135', 'ARMOR': '0.523', 'WEAPON3': '0.550', 'weapon2': '0.836', 'FRAGCOUNT': '1.000', 'weapon3': '1.352'} [2024-08-05 21:34:29,638][52662] DAMAGECOUNT value on done: 343.0 [2024-08-05 21:34:29,639][52662] Sum rewards: -1.693, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.485', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO3': '0.094', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.393', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.506', 'weapon3': '1.886'} [2024-08-05 21:34:29,799][52650] Updated weights for policy 0, policy_version 1141 (0.0011) [2024-08-05 21:34:30,262][52663] DAMAGECOUNT value on done: 76.0 [2024-08-05 21:34:30,470][52794] DAMAGECOUNT value on done: 456.0 [2024-08-05 21:34:30,470][52794] Sum rewards: -3.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.302', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.032', 'ARMOR': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.157', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.738', 'weapon3': '1.382', 'weapon2': '1.658'} [2024-08-05 21:34:30,498][52668] DAMAGECOUNT value on done: 353.0 [2024-08-05 21:34:30,498][52668] Sum rewards: -1.061, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.507', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'HITCOUNT': '0.150', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.014', 'weapon3': '1.226', 'weapon2': '1.432', 'FRAGCOUNT': '1.500'} [2024-08-05 21:34:30,617][52671] DAMAGECOUNT value on done: 114.0 [2024-08-05 21:34:30,626][52670] DAMAGECOUNT value on done: 395.0 [2024-08-05 21:34:30,628][52670] Sum rewards: -3.842, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.472', 'AMMO2': '0.003', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon4': '0.034', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.990', 'WEAPON3': '1.000', 'weapon2': '1.524', 'weapon3': '1.902', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:30,664][52667] DAMAGECOUNT value on done: 115.0 [2024-08-05 21:34:30,667][52667] Sum rewards: -3.394, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.802', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.028', 'HITCOUNT': '0.060', 'ARMOR': '0.068', 'AMMO4': '0.069', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.150', 'weapon2': '2.142'} [2024-08-05 21:34:30,736][52665] DAMAGECOUNT value on done: 410.0 [2024-08-05 21:34:30,808][52647] DAMAGECOUNT value on done: 188.0 [2024-08-05 21:34:30,817][52669] DAMAGECOUNT value on done: 278.0 [2024-08-05 21:34:30,818][52669] Sum rewards: -3.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.340', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.096', 'HITCOUNT': '0.130', 'weapon4': '0.224', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.026', 'weapon2': '2.022'} [2024-08-05 21:34:31,378][52664] DAMAGECOUNT value on done: 338.0 [2024-08-05 21:34:31,482][52649] DAMAGECOUNT value on done: 259.0 [2024-08-05 21:34:31,482][52649] Sum rewards: -3.141, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.130', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'AMMO3': '0.106', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.432', 'WEAPON3': '0.600', 'weapon3': '0.886', 'weapon2': '1.334', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:31,839][52659] DAMAGECOUNT value on done: 312.0 [2024-08-05 21:34:31,902][52662] DAMAGECOUNT value on done: 171.0 [2024-08-05 21:34:31,904][52662] Sum rewards: -2.808, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.717', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.004', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'weapon4': '0.230', 'DAMAGECOUNT': '0.246', 'WEAPON3': '0.750', 'weapon2': '0.756', 'FRAGCOUNT': '1.000', 'weapon3': '2.324'} [2024-08-05 21:34:31,938][52666] DAMAGECOUNT value on done: 131.0 [2024-08-05 21:34:31,941][52666] Sum rewards: -4.028, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.300', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.012', 'WEAPON1': '0.040', 'HITCOUNT': '0.050', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.159', 'weapon4': '0.244', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.040', 'weapon3': '2.110'} [2024-08-05 21:34:32,357][52660] DAMAGECOUNT value on done: 218.0 [2024-08-05 21:34:32,360][52660] Sum rewards: -2.714, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.471', 'AMMO5': '0.015', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.077', 'HITCOUNT': '0.100', 'ARMOR': '0.100', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.462', 'FRAGCOUNT': '1.000', 'weapon3': '1.370', 'weapon2': '1.558'} [2024-08-05 21:34:32,389][52658] DAMAGECOUNT value on done: 278.0 [2024-08-05 21:34:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17749.7, 300 sec: 8303.2). Total num frames: 9396224. Throughput: 0: 4398.0. Samples: 2348030. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-05 21:34:32,794][52567] Avg episode reward: [(0, '-3.548')] [2024-08-05 21:34:32,826][52794] DAMAGECOUNT value on done: 606.0 [2024-08-05 21:34:32,826][52794] Sum rewards: -2.274, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.446', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.087', 'AMMO3': '0.112', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon3': '1.432', 'weapon2': '1.496'} [2024-08-05 21:34:33,205][52663] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:34:33,206][52663] Sum rewards: -1.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.624', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'HITCOUNT': '0.090', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'ARMOR': '0.103', 'weapon4': '0.148', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.056', 'weapon2': '2.180'} [2024-08-05 21:34:33,356][52665] DAMAGECOUNT value on done: 161.0 [2024-08-05 21:34:33,357][52665] Sum rewards: -3.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'AMMO2': '0.026', 'ARMOR': '0.064', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.130', 'WEAPON4': '0.300', 'weapon4': '0.310', 'DAMAGECOUNT': '0.393', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.568', 'weapon2': '1.684'} [2024-08-05 21:34:33,458][52668] DAMAGECOUNT value on done: 329.0 [2024-08-05 21:34:33,612][52669] DAMAGECOUNT value on done: 249.0 [2024-08-05 21:34:33,659][52671] DAMAGECOUNT value on done: 250.0 [2024-08-05 21:34:33,659][52671] Sum rewards: -2.852, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.194', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'ARMOR': '0.062', 'AMMO3': '0.087', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.284', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.600', 'weapon3': '1.004', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:33,868][52670] DAMAGECOUNT value on done: 312.0 [2024-08-05 21:34:33,871][52670] Sum rewards: -5.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.925', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'DAMAGECOUNT': '0.318', 'ARMOR': '0.463', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.480', 'weapon3': '1.852'} [2024-08-05 21:34:33,954][52647] DAMAGECOUNT value on done: 355.0 [2024-08-05 21:34:34,007][52667] DAMAGECOUNT value on done: 719.0 [2024-08-05 21:34:34,007][52667] Sum rewards: -1.496, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.546', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.220', 'ARMOR': '0.518', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.987', 'weapon3': '1.456', 'weapon2': '1.868', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:34,072][52649] DAMAGECOUNT value on done: 311.0 [2024-08-05 21:34:34,395][52662] DAMAGECOUNT value on done: 225.0 [2024-08-05 21:34:34,395][52662] Sum rewards: -4.068, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.515', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'weapon7': '0.074', 'HITCOUNT': '0.110', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.418', 'weapon2': '1.480'} [2024-08-05 21:34:34,618][52664] DAMAGECOUNT value on done: 370.0 [2024-08-05 21:34:34,619][52664] Sum rewards: -3.149, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.862', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'ARMOR': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.700', 'weapon3': '1.662', 'weapon2': '1.742', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:34,631][52650] Updated weights for policy 0, policy_version 1151 (0.0021) [2024-08-05 21:34:34,907][52666] DAMAGECOUNT value on done: 114.0 [2024-08-05 21:34:35,030][52659] DAMAGECOUNT value on done: 217.0 [2024-08-05 21:34:35,160][52660] DAMAGECOUNT value on done: 581.0 [2024-08-05 21:34:35,160][52660] Sum rewards: -3.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.040', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.080', 'weapon3': '1.366', 'FRAGCOUNT': '1.500', 'weapon2': '1.634'} [2024-08-05 21:34:35,345][52794] DAMAGECOUNT value on done: 432.0 [2024-08-05 21:34:35,345][52794] Sum rewards: -5.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.752', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.141', 'AMMO3': '0.177', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.951', 'WEAPON3': '1.100', 'weapon2': '1.474', 'weapon3': '1.862', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:35,442][52658] DAMAGECOUNT value on done: 357.0 [2024-08-05 21:34:35,463][52658] Sum rewards: -3.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.718', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.200', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.981', 'weapon2': '1.284', 'weapon3': '1.988', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:36,242][52668] DAMAGECOUNT value on done: 580.0 [2024-08-05 21:34:36,252][52668] Sum rewards: -1.447, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.211', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'ARMOR': '0.073', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.360', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.960', 'weapon2': '1.400', 'weapon3': '1.494', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:36,266][52663] DAMAGECOUNT value on done: 157.0 [2024-08-05 21:34:36,324][52665] DAMAGECOUNT value on done: 235.0 [2024-08-05 21:34:36,325][52665] Sum rewards: -1.327, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.684', 'AMMO5': '0.003', 'AMMO2': '0.010', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'ARMOR': '0.083', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.195', 'weapon4': '0.420', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.024', 'weapon3': '1.572'} [2024-08-05 21:34:36,627][52669] DAMAGECOUNT value on done: 519.0 [2024-08-05 21:34:36,631][52669] Sum rewards: -2.241, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.213', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'weapon2': '1.334', 'FRAGCOUNT': '2.000', 'weapon3': '2.026'} [2024-08-05 21:34:36,648][52671] DAMAGECOUNT value on done: 366.0 [2024-08-05 21:34:36,648][52671] Sum rewards: -5.537, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'ARMOR': '0.040', 'AMMO3': '0.113', 'HITCOUNT': '0.220', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.687', 'FRAGCOUNT': '1.000', 'weapon3': '1.310', 'weapon2': '2.214'} [2024-08-05 21:34:36,653][52647] DAMAGECOUNT value on done: 277.0 [2024-08-05 21:34:36,821][52662] DAMAGECOUNT value on done: 462.0 [2024-08-05 21:34:36,821][52662] Sum rewards: 0.052, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.620', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'weapon7': '0.010', 'AMMO3': '0.052', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.405', 'FRAGCOUNT': '1.000', 'weapon2': '1.178', 'weapon3': '1.360'} [2024-08-05 21:34:36,841][52670] DAMAGECOUNT value on done: 256.0 [2024-08-05 21:34:36,996][52667] DAMAGECOUNT value on done: 426.0 [2024-08-05 21:34:37,114][52649] DAMAGECOUNT value on done: 390.0 [2024-08-05 21:34:37,116][52649] Sum rewards: -0.782, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.106', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.626', 'weapon3': '1.700'} [2024-08-05 21:34:37,240][52664] DAMAGECOUNT value on done: 302.0 [2024-08-05 21:34:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 8608.6). Total num frames: 9486336. Throughput: 0: 4388.2. Samples: 2373920. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:34:37,794][52567] Avg episode reward: [(0, '-3.662')] [2024-08-05 21:34:37,823][52794] DAMAGECOUNT value on done: 210.0 [2024-08-05 21:34:38,035][52659] DAMAGECOUNT value on done: 370.0 [2024-08-05 21:34:38,164][52666] DAMAGECOUNT value on done: 272.0 [2024-08-05 21:34:38,165][52666] Sum rewards: -4.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO2': '0.018', 'ARMOR': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'HITCOUNT': '0.110', 'AMMO3': '0.131', 'weapon4': '0.150', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.498', 'weapon2': '1.862'} [2024-08-05 21:34:38,179][52660] DAMAGECOUNT value on done: 280.0 [2024-08-05 21:34:38,181][52660] Sum rewards: -5.984, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.850', 'AMMO2': '0.007', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO4': '0.036', 'weapon5': '0.058', 'HITCOUNT': '0.080', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.650', 'weapon2': '1.532', 'weapon3': '1.702'} [2024-08-05 21:34:38,725][52658] DAMAGECOUNT value on done: 180.0 [2024-08-05 21:34:38,726][52658] Sum rewards: -2.543, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.827', 'AMMO2': '0.041', 'AMMO3': '0.051', 'ARMOR': '0.052', 'HITCOUNT': '0.080', 'AMMO4': '0.205', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.564', 'weapon3': '0.754', 'weapon2': '1.852', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:38,983][52663] DAMAGECOUNT value on done: 454.0 [2024-08-05 21:34:38,984][52663] Sum rewards: -0.351, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.004', 'AMMO5': '0.010', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'ARMOR': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.621', 'FRAGCOUNT': '1.000', 'weapon2': '1.364', 'weapon3': '1.612'} [2024-08-05 21:34:39,024][52647] DAMAGECOUNT value on done: 200.0 [2024-08-05 21:34:39,025][52647] Sum rewards: -2.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.094', 'HITCOUNT': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.360', 'weapon4': '0.438', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.322', 'weapon3': '1.782'} [2024-08-05 21:34:39,113][52662] DAMAGECOUNT value on done: 565.0 [2024-08-05 21:34:39,113][52662] Sum rewards: -4.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.125', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.025', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.199', 'HITCOUNT': '0.220', 'weapon4': '0.312', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.900', 'WEAPON3': '1.100', 'weapon2': '1.430', 'weapon3': '1.648', 'FRAGCOUNT': '2.500'} [2024-08-05 21:34:39,253][52669] DAMAGECOUNT value on done: 175.0 [2024-08-05 21:34:39,256][52669] Sum rewards: -1.442, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'ARMOR': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.110', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.330', 'weapon4': '0.420', 'WEAPON3': '0.600', 'weapon2': '1.220', 'weapon3': '1.276', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:39,274][52665] DAMAGECOUNT value on done: 418.0 [2024-08-05 21:34:39,274][52665] Sum rewards: 1.285, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.022', 'AMMO3': '0.038', 'weapon7': '0.046', 'ARMOR': '0.072', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.250', 'HEALTH': '0.464', 'weapon4': '0.562', 'weapon3': '0.642', 'DAMAGECOUNT': '0.687', 'FRAGCOUNT': '1.000', 'weapon2': '1.160'} [2024-08-05 21:34:39,449][52664] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:34:39,451][52664] Sum rewards: 0.337, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.110', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.038', 'weapon3': '1.862', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:39,541][52668] DAMAGECOUNT value on done: 220.0 [2024-08-05 21:34:39,544][52671] DAMAGECOUNT value on done: 382.0 [2024-08-05 21:34:39,552][52671] Sum rewards: -2.513, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.728', 'AMMO2': '0.016', 'ARMOR': '0.056', 'AMMO4': '0.078', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.150', 'HITCOUNT': '0.190', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.633', 'weapon3': '1.464', 'weapon2': '1.832', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:39,609][52650] Updated weights for policy 0, policy_version 1161 (0.0028) [2024-08-05 21:34:40,396][52670] DAMAGECOUNT value on done: 365.0 [2024-08-05 21:34:40,403][52670] Sum rewards: -2.464, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.202', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'HITCOUNT': '0.100', 'weapon4': '0.132', 'AMMO3': '0.139', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.850', 'weapon2': '1.146', 'weapon3': '1.844', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:40,676][52667] DAMAGECOUNT value on done: 576.0 [2024-08-05 21:34:40,677][52667] Sum rewards: 2.088, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.012', 'AMMO4': '0.061', 'ARMOR': '0.076', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.238', 'HITCOUNT': '0.250', 'HEALTH': '0.372', 'WEAPON3': '0.450', 'weapon2': '1.338', 'DAMAGECOUNT': '1.530', 'weapon3': '1.764', 'FRAGCOUNT': '4.000'} [2024-08-05 21:34:40,759][52649] DAMAGECOUNT value on done: 425.0 [2024-08-05 21:34:40,760][52649] Sum rewards: -5.133, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.814', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.500', 'weapon3': '1.900'} [2024-08-05 21:34:41,518][52659] DAMAGECOUNT value on done: 432.0 [2024-08-05 21:34:41,520][52659] Sum rewards: -2.001, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.136', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '1.954'} [2024-08-05 21:34:42,021][52647] DAMAGECOUNT value on done: 312.0 [2024-08-05 21:34:42,023][52647] Sum rewards: -1.400, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.006', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.083', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.348', 'WEAPON3': '0.350', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.525', 'FRAGCOUNT': '1.000', 'weapon3': '1.314', 'weapon2': '1.920'} [2024-08-05 21:34:42,509][52666] DAMAGECOUNT value on done: 231.0 [2024-08-05 21:34:42,730][52664] DAMAGECOUNT value on done: 287.0 [2024-08-05 21:34:42,734][52664] Sum rewards: -4.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.932', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO5': '0.020', 'AMMO4': '0.033', 'ARMOR': '0.044', 'AMMO3': '0.106', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'weapon3': '1.428', 'weapon2': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:42,795][52567] Fps is (10 sec: 14745.1, 60 sec: 17066.6, 300 sec: 8775.3). Total num frames: 9543680. Throughput: 0: 4273.8. Samples: 2395820. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:34:42,795][52567] Avg episode reward: [(0, '-3.538')] [2024-08-05 21:34:42,876][52658] DAMAGECOUNT value on done: 339.0 [2024-08-05 21:34:42,879][52658] Sum rewards: -3.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.146', 'ARMOR': '0.012', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.143', 'HITCOUNT': '0.150', 'weapon4': '0.224', 'DAMAGECOUNT': '0.483', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.298', 'weapon3': '1.798'} [2024-08-05 21:34:43,009][52660] DAMAGECOUNT value on done: 392.0 [2024-08-05 21:34:43,010][52660] Sum rewards: -2.332, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.670', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.128', 'HITCOUNT': '0.320', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.044', 'weapon2': '1.472', 'weapon3': '1.936', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:43,249][52663] DAMAGECOUNT value on done: 290.0 [2024-08-05 21:34:43,250][52663] Sum rewards: -2.409, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.992', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.079', 'HITCOUNT': '0.140', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon3': '1.378', 'weapon2': '1.966'} [2024-08-05 21:34:43,250][52671] DAMAGECOUNT value on done: 627.0 [2024-08-05 21:34:43,255][52671] Sum rewards: -0.846, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.813', 'AMMO2': '0.023', 'AMMO3': '0.058', 'ARMOR': '0.082', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.350', 'weapon4': '0.470', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.072', 'weapon2': '1.552'} [2024-08-05 21:34:43,709][52669] DAMAGECOUNT value on done: 265.0 [2024-08-05 21:34:43,709][52669] Sum rewards: -1.563, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'HEALTH': '0.018', 'weapon5': '0.022', 'AMMO2': '0.022', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.110', 'HITCOUNT': '0.180', 'weapon4': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.675', 'weapon2': '1.178', 'weapon3': '1.556'} [2024-08-05 21:34:44,743][52659] DAMAGECOUNT value on done: 201.0 [2024-08-05 21:34:44,917][52668] DAMAGECOUNT value on done: 406.0 [2024-08-05 21:34:44,919][52668] Sum rewards: -5.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.884', 'AMMO5': '0.005', 'AMMO2': '0.018', 'HITCOUNT': '0.070', 'ARMOR': '0.088', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'DAMAGECOUNT': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.538', 'weapon3': '1.630'} [2024-08-05 21:34:45,050][52670] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:34:45,051][52670] Sum rewards: -3.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.110', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.139', 'DAMAGECOUNT': '0.495', 'ARMOR': '0.537', 'WEAPON3': '0.650', 'weapon3': '1.560', 'weapon2': '1.636', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:45,305][52649] DAMAGECOUNT value on done: 315.0 [2024-08-05 21:34:45,307][52649] Sum rewards: -1.841, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.178', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.073', 'ARMOR': '0.108', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.234', 'DAMAGECOUNT': '0.489', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.458'} [2024-08-05 21:34:45,330][52647] DAMAGECOUNT value on done: 318.0 [2024-08-05 21:34:45,332][52647] Sum rewards: -4.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.194', 'WEAPON3': '0.450', 'ARMOR': '0.487', 'DAMAGECOUNT': '0.732', 'weapon3': '0.794', 'FRAGCOUNT': '2.000', 'weapon2': '2.038'} [2024-08-05 21:34:45,399][52667] DAMAGECOUNT value on done: 257.0 [2024-08-05 21:34:45,908][52650] Updated weights for policy 0, policy_version 1171 (0.0030) [2024-08-05 21:34:46,348][52664] DAMAGECOUNT value on done: 211.0 [2024-08-05 21:34:46,350][52664] Sum rewards: -1.012, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.080', 'AMMO2': '0.025', 'HITCOUNT': '0.070', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO4': '0.124', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.400', 'ARMOR': '0.523', 'FRAGCOUNT': '1.000', 'weapon3': '1.208', 'weapon2': '1.930'} [2024-08-05 21:34:46,512][52666] DAMAGECOUNT value on done: 475.0 [2024-08-05 21:34:46,514][52666] Sum rewards: -2.850, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.240', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'WEAPON1': '0.040', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.660', 'FRAGCOUNT': '1.000', 'weapon3': '1.390', 'weapon2': '2.036'} [2024-08-05 21:34:46,674][52658] DAMAGECOUNT value on done: 224.0 [2024-08-05 21:34:46,674][52658] Sum rewards: -1.319, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'HITCOUNT': '0.070', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon4': '0.218', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.454', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.332', 'weapon2': '1.568'} [2024-08-05 21:34:46,729][52671] DAMAGECOUNT value on done: 180.0 [2024-08-05 21:34:46,730][52660] DAMAGECOUNT value on done: 173.0 [2024-08-05 21:34:46,732][52660] Sum rewards: -3.271, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.895', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.065', 'ARMOR': '0.077', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'weapon4': '0.352', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.132', 'weapon2': '1.400'} [2024-08-05 21:34:46,735][52671] Sum rewards: -1.690, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.038', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.139', 'DAMAGECOUNT': '0.231', 'WEAPON3': '0.550', 'HEALTH': '0.898', 'FRAGCOUNT': '1.000', 'weapon3': '1.320', 'weapon2': '1.878'} [2024-08-05 21:34:46,877][52663] DAMAGECOUNT value on done: 257.0 [2024-08-05 21:34:46,877][52663] Sum rewards: -0.562, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-1.500', 'weapon4': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO3': '0.040', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.068', 'HITCOUNT': '0.070', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.321', 'HEALTH': '0.525', 'weapon3': '0.890', 'weapon2': '1.806'} [2024-08-05 21:34:47,315][52669] DAMAGECOUNT value on done: 305.0 [2024-08-05 21:34:47,316][52669] Sum rewards: -7.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'HITCOUNT': '0.140', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.900', 'weapon2': '1.316', 'weapon3': '1.918'} [2024-08-05 21:34:47,794][52567] Fps is (10 sec: 13926.3, 60 sec: 17066.7, 300 sec: 9025.1). Total num frames: 9625600. Throughput: 0: 4194.7. Samples: 2405410. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:34:47,794][52567] Avg episode reward: [(0, '-3.385')] [2024-08-05 21:34:47,797][52614] Saving new best policy, reward=-3.385! [2024-08-05 21:34:47,967][52668] DAMAGECOUNT value on done: 210.0 [2024-08-05 21:34:47,967][52668] Sum rewards: -6.412, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.053', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.034', 'ARMOR': '0.096', 'HITCOUNT': '0.110', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.636', 'weapon3': '1.710'} [2024-08-05 21:34:48,236][52667] DAMAGECOUNT value on done: 265.0 [2024-08-05 21:34:48,237][52667] Sum rewards: -5.489, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.464', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon4': '0.008', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.500', 'weapon2': '1.814'} [2024-08-05 21:34:48,317][52647] DAMAGECOUNT value on done: 418.0 [2024-08-05 21:34:48,399][52670] DAMAGECOUNT value on done: 390.0 [2024-08-05 21:34:48,400][52670] Sum rewards: -4.698, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.040', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.130', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.586', 'weapon3': '1.680'} [2024-08-05 21:34:48,517][52659] DAMAGECOUNT value on done: 160.0 [2024-08-05 21:34:48,518][52659] Sum rewards: -1.674, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.306', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.008', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'DAMAGECOUNT': '0.330', 'ARMOR': '0.487', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.194', 'weapon3': '1.540'} [2024-08-05 21:34:49,261][52664] DAMAGECOUNT value on done: 264.0 [2024-08-05 21:34:49,591][52660] DAMAGECOUNT value on done: 251.0 [2024-08-05 21:34:49,594][52660] Sum rewards: -7.074, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.335', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.013', 'weapon5': '0.042', 'HITCOUNT': '0.110', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.291', 'weapon4': '0.322', 'WEAPON3': '0.700', 'weapon3': '1.268', 'weapon2': '1.590'} [2024-08-05 21:34:49,807][52658] DAMAGECOUNT value on done: 364.0 [2024-08-05 21:34:49,820][52666] DAMAGECOUNT value on done: 280.0 [2024-08-05 21:34:49,999][52663] DAMAGECOUNT value on done: 390.0 [2024-08-05 21:34:49,999][52663] Sum rewards: -2.072, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.775', 'weapon5': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.095', 'ARMOR': '0.096', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.495', 'weapon4': '0.558', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.288', 'weapon3': '1.398'} [2024-08-05 21:34:50,030][52671] DAMAGECOUNT value on done: 417.0 [2024-08-05 21:34:50,032][52671] Sum rewards: -5.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.801', 'WEAPON3': '0.850', 'weapon2': '1.362', 'weapon3': '1.954', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:50,311][52669] DAMAGECOUNT value on done: 606.0 [2024-08-05 21:34:50,311][52669] Sum rewards: 0.240, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.574', 'AMMO2': '0.007', 'weapon4': '0.026', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'ARMOR': '0.088', 'AMMO3': '0.141', 'HITCOUNT': '0.220', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.035', 'weapon2': '1.562', 'weapon3': '1.848', 'FRAGCOUNT': '4.000'} [2024-08-05 21:34:50,623][52650] Updated weights for policy 0, policy_version 1181 (0.0017) [2024-08-05 21:34:50,789][52668] DAMAGECOUNT value on done: 326.0 [2024-08-05 21:34:50,870][52647] DAMAGECOUNT value on done: 494.0 [2024-08-05 21:34:51,128][52667] DAMAGECOUNT value on done: 514.0 [2024-08-05 21:34:51,130][52667] Sum rewards: -0.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.453', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.060', 'ARMOR': '0.068', 'HITCOUNT': '0.090', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.234', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.423', 'weapon3': '1.088', 'weapon2': '1.826', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:51,462][52659] DAMAGECOUNT value on done: 470.0 [2024-08-05 21:34:51,463][52659] Sum rewards: -5.796, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.118', 'weapon4': '0.172', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon3': '1.256', 'weapon2': '1.894'} [2024-08-05 21:34:51,645][52670] DAMAGECOUNT value on done: 281.0 [2024-08-05 21:34:51,880][52664] DAMAGECOUNT value on done: 368.0 [2024-08-05 21:34:51,881][52664] Sum rewards: -1.930, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.052', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.118', 'HITCOUNT': '0.210', 'WEAPON4': '0.400', 'weapon4': '0.412', 'ARMOR': '0.522', 'DAMAGECOUNT': '0.651', 'WEAPON3': '0.750', 'weapon2': '0.950', 'weapon3': '1.914', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:52,459][52658] DAMAGECOUNT value on done: 343.0 [2024-08-05 21:34:52,461][52658] Sum rewards: -6.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.622', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.506', 'DAMAGECOUNT': '0.594', 'FRAGCOUNT': '1.000', 'weapon2': '1.058', 'WEAPON3': '1.150', 'weapon3': '1.830'} [2024-08-05 21:34:52,764][52795] DAMAGECOUNT value on done: 325.0 [2024-08-05 21:34:52,764][52795] Sum rewards: -1.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.667', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'AMMO3': '0.143', 'HITCOUNT': '0.150', 'weapon4': '0.230', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.800', 'weapon2': '1.408', 'weapon3': '1.698', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:52,794][52567] Fps is (10 sec: 16384.6, 60 sec: 16930.1, 300 sec: 9302.9). Total num frames: 9707520. Throughput: 0: 4172.0. Samples: 2431100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:34:52,795][52567] Avg episode reward: [(0, '-3.505')] [2024-08-05 21:34:52,851][52660] DAMAGECOUNT value on done: 345.0 [2024-08-05 21:34:52,852][52660] Sum rewards: -1.181, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.014', 'weapon4': '0.066', 'AMMO4': '0.070', 'HITCOUNT': '0.120', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.464', 'weapon3': '1.922'} [2024-08-05 21:34:52,970][52663] DAMAGECOUNT value on done: 408.0 [2024-08-05 21:34:52,972][52663] Sum rewards: -4.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.690', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '1.946'} [2024-08-05 21:34:52,976][52666] DAMAGECOUNT value on done: 256.0 [2024-08-05 21:34:52,976][52666] Sum rewards: -1.522, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.290', 'AMMO2': '0.015', 'AMMO3': '0.073', 'ARMOR': '0.073', 'AMMO4': '0.076', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.195', 'weapon4': '0.220', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.094', 'weapon2': '2.092'} [2024-08-05 21:34:53,122][52671] DAMAGECOUNT value on done: 902.0 [2024-08-05 21:34:53,122][52671] Sum rewards: -0.528, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.187', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'weapon7': '0.048', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.800', 'weapon2': '1.306', 'DAMAGECOUNT': '1.491', 'weapon3': '1.828', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:53,245][52669] DAMAGECOUNT value on done: 288.0 [2024-08-05 21:34:53,245][52669] Sum rewards: -1.989, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.070', 'AMMO5': '0.005', 'ARMOR': '0.014', 'weapon5': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.110', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.465', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '1.876'} [2024-08-05 21:34:53,433][52811] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:34:53,433][52811] Sum rewards: -0.313, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.935', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.069', 'AMMO3': '0.112', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.615', 'weapon2': '1.438', 'weapon3': '1.626', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:53,720][52667] DAMAGECOUNT value on done: 465.0 [2024-08-05 21:34:53,796][52647] DAMAGECOUNT value on done: 315.0 [2024-08-05 21:34:53,797][52647] Sum rewards: -4.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.766', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.156', 'weapon4': '0.212', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.810', 'weapon3': '1.472', 'weapon2': '1.592', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:54,094][52668] DAMAGECOUNT value on done: 376.0 [2024-08-05 21:34:54,097][52668] Sum rewards: -0.452, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.687', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'weapon4': '0.144', 'DAMAGECOUNT': '0.396', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.378', 'weapon3': '1.866'} [2024-08-05 21:34:54,343][52664] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:34:54,774][52670] DAMAGECOUNT value on done: 543.0 [2024-08-05 21:34:54,777][52670] Sum rewards: -4.584, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.600', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.027', 'AMMO3': '0.070', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.234', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.330', 'weapon3': '1.268', 'weapon2': '1.658'} [2024-08-05 21:34:54,803][52659] DAMAGECOUNT value on done: 590.0 [2024-08-05 21:34:54,804][52659] Sum rewards: -2.310, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.004', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.147', 'weapon4': '0.186', 'HITCOUNT': '0.220', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.825', 'weapon2': '1.492', 'weapon3': '1.768', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:54,869][52664] DAMAGECOUNT value on done: 290.0 [2024-08-05 21:34:54,869][52664] Sum rewards: -2.995, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.151', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO3': '0.083', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.124', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon3': '1.236', 'weapon2': '2.044'} [2024-08-05 21:34:55,470][52650] Updated weights for policy 0, policy_version 1191 (0.0012) [2024-08-05 21:34:55,511][52658] DAMAGECOUNT value on done: 108.0 [2024-08-05 21:34:55,623][52663] DAMAGECOUNT value on done: 312.0 [2024-08-05 21:34:55,623][52663] Sum rewards: -4.077, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.370', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.130', 'weapon4': '0.192', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.438', 'weapon3': '1.718'} [2024-08-05 21:34:55,705][52660] DAMAGECOUNT value on done: 148.0 [2024-08-05 21:34:55,707][52660] Sum rewards: -6.221, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.540', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.032', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'DAMAGECOUNT': '0.072', 'ARMOR': '0.072', 'AMMO4': '0.102', 'AMMO3': '0.120', 'weapon4': '0.198', 'WEAPON3': '0.650', 'weapon3': '1.384', 'weapon2': '1.776'} [2024-08-05 21:34:55,800][52669] DAMAGECOUNT value on done: 187.0 [2024-08-05 21:34:55,801][52669] Sum rewards: -1.885, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.140', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.071', 'weapon4': '0.094', 'HITCOUNT': '0.140', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.471', 'FRAGCOUNT': '1.000', 'weapon3': '1.296', 'weapon2': '2.098'} [2024-08-05 21:34:55,853][52671] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:34:55,854][52671] Sum rewards: -2.818, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.526', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.645', 'weapon3': '1.160', 'FRAGCOUNT': '2.000', 'weapon2': '2.048'} [2024-08-05 21:34:55,870][52795] DAMAGECOUNT value on done: 204.0 [2024-08-05 21:34:56,035][52666] DAMAGECOUNT value on done: 386.0 [2024-08-05 21:34:56,037][52666] Sum rewards: -1.326, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.648', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'ARMOR': '0.158', 'weapon4': '0.170', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.400', 'weapon3': '1.072', 'weapon2': '1.794'} [2024-08-05 21:34:56,544][52811] DAMAGECOUNT value on done: 107.0 [2024-08-05 21:34:56,544][52811] Sum rewards: -9.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.834', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO4': '0.037', 'HITCOUNT': '0.060', 'ARMOR': '0.100', 'DAMAGECOUNT': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.850', 'weapon3': '1.442', 'weapon2': '1.794'} [2024-08-05 21:34:56,948][52647] DAMAGECOUNT value on done: 520.0 [2024-08-05 21:34:56,949][52647] Sum rewards: -4.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.245', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'ARMOR': '0.040', 'AMMO3': '0.093', 'HITCOUNT': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.624', 'weapon4': '0.628', 'weapon3': '0.722', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:56,957][52667] DAMAGECOUNT value on done: 471.0 [2024-08-05 21:34:56,957][52667] Sum rewards: -3.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.026', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.430', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.372', 'weapon3': '1.628'} [2024-08-05 21:34:56,982][52668] DAMAGECOUNT value on done: 295.0 [2024-08-05 21:34:56,984][52668] Sum rewards: -3.035, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.148', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO3': '0.105', 'HITCOUNT': '0.110', 'ARMOR': '0.132', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.378', 'WEAPON3': '0.500', 'weapon4': '0.500', 'weapon3': '0.950', 'weapon2': '1.422', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:57,080][52659] DAMAGECOUNT value on done: 505.0 [2024-08-05 21:34:57,081][52659] Sum rewards: -6.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.388', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'HITCOUNT': '0.250', 'weapon4': '0.456', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.080', 'weapon2': '1.390', 'weapon3': '1.624'} [2024-08-05 21:34:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.8, 300 sec: 9608.5). Total num frames: 9797632. Throughput: 0: 4160.7. Samples: 2457080. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:34:57,794][52567] Avg episode reward: [(0, '-3.408')] [2024-08-05 21:34:58,019][52803] DAMAGECOUNT value on done: 225.0 [2024-08-05 21:34:58,022][52803] Sum rewards: -4.630, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.700', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.148', 'weapon4': '0.260', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.146', 'weapon2': '2.022'} [2024-08-05 21:34:58,050][52670] DAMAGECOUNT value on done: 229.0 [2024-08-05 21:34:58,119][52664] DAMAGECOUNT value on done: 306.0 [2024-08-05 21:34:58,419][52658] DAMAGECOUNT value on done: 540.0 [2024-08-05 21:34:58,428][52658] Sum rewards: 0.050, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.139', 'AMMO2': '0.014', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.071', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.720', 'ARMOR': '0.923', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.904'} [2024-08-05 21:34:58,418][52671] DAMAGECOUNT value on done: 335.0 [2024-08-05 21:34:58,429][52671] Sum rewards: -6.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.016', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.150', 'weapon4': '0.188', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'weapon2': '1.972'} [2024-08-05 21:34:58,619][52663] DAMAGECOUNT value on done: 532.0 [2024-08-05 21:34:58,619][52663] Sum rewards: -4.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.328', 'AMMO2': '0.016', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'HITCOUNT': '0.160', 'AMMO3': '0.184', 'weapon4': '0.224', 'DAMAGECOUNT': '0.843', 'WEAPON3': '0.900', 'weapon2': '1.412', 'weapon3': '1.818', 'FRAGCOUNT': '2.000'} [2024-08-05 21:34:58,780][52669] DAMAGECOUNT value on done: 577.0 [2024-08-05 21:34:58,781][52669] Sum rewards: -1.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.013', 'AMMO2': '0.016', 'ARMOR': '0.072', 'AMMO4': '0.078', 'AMMO3': '0.117', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.524', 'weapon3': '1.648', 'weapon2': '1.856', 'FRAGCOUNT': '4.000'} [2024-08-05 21:34:58,829][52660] DAMAGECOUNT value on done: 243.0 [2024-08-05 21:34:58,833][52660] Sum rewards: -5.819, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.940', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO5': '0.008', 'HITCOUNT': '0.030', 'WEAPON1': '0.040', 'DAMAGECOUNT': '0.090', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.194', 'WEAPON3': '0.750', 'weapon3': '1.352', 'ARMOR': '1.372', 'weapon2': '1.720'} [2024-08-05 21:34:59,067][52795] DAMAGECOUNT value on done: 419.0 [2024-08-05 21:34:59,067][52795] Sum rewards: -3.561, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.911', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'AMMO3': '0.084', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.408', 'DAMAGECOUNT': '0.477', 'ARMOR': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.094', 'weapon2': '1.988'} [2024-08-05 21:34:59,461][52820] DAMAGECOUNT value on done: 237.0 [2024-08-05 21:34:59,461][52820] Sum rewards: -3.182, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.734', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'HITCOUNT': '0.050', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'DAMAGECOUNT': '0.180', 'weapon4': '0.272', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.130', 'weapon3': '1.526'} [2024-08-05 21:34:59,479][52666] DAMAGECOUNT value on done: 566.0 [2024-08-05 21:34:59,479][52666] Sum rewards: 3.119, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO3': '0.077', 'AMMO4': '0.087', 'weapon7': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.218', 'AMMO6': '0.300', 'AMMO7': '0.300', 'WEAPON7': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.203', 'weapon3': '1.206', 'weapon2': '1.436', 'FRAGCOUNT': '3.000'} [2024-08-05 21:34:59,654][52659] DAMAGECOUNT value on done: 656.0 [2024-08-05 21:34:59,656][52659] Sum rewards: -6.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.133', 'DAMAGECOUNT': '0.387', 'ARMOR': '0.504', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.224', 'weapon2': '1.840'} [2024-08-05 21:34:59,845][52667] DAMAGECOUNT value on done: 289.0 [2024-08-05 21:34:59,845][52667] Sum rewards: -1.060, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.636', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.018', 'weapon7': '0.068', 'AMMO3': '0.090', 'HITCOUNT': '0.100', 'WEAPON5': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.405', 'weapon3': '0.824', 'FRAGCOUNT': '1.000', 'weapon2': '2.558'} [2024-08-05 21:34:59,995][52668] DAMAGECOUNT value on done: 307.0 [2024-08-05 21:34:59,997][52668] Sum rewards: -6.641, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.905', 'FRAGCOUNT': '-0.500', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.018', 'weapon4': '0.028', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.153', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.800', 'weapon3': '1.462', 'weapon2': '1.790'} [2024-08-05 21:35:00,051][52811] DAMAGECOUNT value on done: 465.0 [2024-08-05 21:35:00,052][52811] Sum rewards: -4.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.185', 'weapon4': '0.190', 'HITCOUNT': '0.300', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.395', 'weapon3': '1.514', 'weapon2': '1.744', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:00,055][52647] DAMAGECOUNT value on done: 337.0 [2024-08-05 21:35:00,093][52650] Updated weights for policy 0, policy_version 1201 (0.0017) [2024-08-05 21:35:01,146][52671] DAMAGECOUNT value on done: 233.0 [2024-08-05 21:35:01,147][52671] Sum rewards: -10.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.495', 'AMMO2': '0.007', 'AMMO4': '0.035', 'ARMOR': '0.036', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.154', 'AMMO3': '0.256', 'DAMAGECOUNT': '0.270', 'FRAGCOUNT': '1.000', 'weapon2': '1.122', 'WEAPON3': '1.400', 'weapon3': '2.108'} [2024-08-05 21:35:01,158][52803] DAMAGECOUNT value on done: 401.0 [2024-08-05 21:35:01,159][52803] Sum rewards: -4.660, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.953', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.017', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'HITCOUNT': '0.110', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.300', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.750', 'weapon2': '1.294', 'weapon3': '1.756'} [2024-08-05 21:35:01,293][52664] DAMAGECOUNT value on done: 450.0 [2024-08-05 21:35:01,296][52664] Sum rewards: -3.743, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.392', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'weapon5': '0.064', 'AMMO3': '0.089', 'HITCOUNT': '0.090', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'weapon2': '1.506', 'weapon3': '1.574'} [2024-08-05 21:35:01,297][52670] DAMAGECOUNT value on done: 439.0 [2024-08-05 21:35:01,299][52670] Sum rewards: -3.263, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.473', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.028', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.240', 'DAMAGECOUNT': '0.747', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.524', 'weapon2': '1.630'} [2024-08-05 21:35:01,510][52663] DAMAGECOUNT value on done: 147.0 [2024-08-05 21:35:01,538][52658] DAMAGECOUNT value on done: 352.0 [2024-08-05 21:35:01,601][52669] DAMAGECOUNT value on done: 650.0 [2024-08-05 21:35:01,601][52669] Sum rewards: -1.867, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.088', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'HITCOUNT': '0.280', 'weapon4': '0.310', 'ARMOR': '0.540', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.113', 'weapon3': '1.390', 'weapon2': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 21:35:01,995][52660] DAMAGECOUNT value on done: 410.0 [2024-08-05 21:35:01,996][52660] Sum rewards: -6.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.998', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.500', 'ARMOR': '0.524', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.416', 'weapon2': '1.492'} [2024-08-05 21:35:02,261][52614] Signal inference workers to stop experience collection... (200 times) [2024-08-05 21:35:02,262][52614] Signal inference workers to resume experience collection... (200 times) [2024-08-05 21:35:02,339][52650] InferenceWorker_p0-w0: stopping experience collection (200 times) [2024-08-05 21:35:02,339][52650] InferenceWorker_p0-w0: resuming experience collection (200 times) [2024-08-05 21:35:02,369][52795] DAMAGECOUNT value on done: 320.0 [2024-08-05 21:35:02,370][52795] Sum rewards: -4.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.498', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.019', 'weapon4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.145', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.122', 'weapon3': '2.226'} [2024-08-05 21:35:02,505][52659] DAMAGECOUNT value on done: 315.0 [2024-08-05 21:35:02,507][52659] Sum rewards: 1.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.460', 'AMMO2': '0.015', 'AMMO3': '0.055', 'AMMO4': '0.076', 'ARMOR': '0.130', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.354', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.675', 'weapon3': '1.176', 'weapon2': '1.718', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:02,779][52666] DAMAGECOUNT value on done: 389.0 [2024-08-05 21:35:02,781][52666] Sum rewards: -4.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.659', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.055', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.870', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.466', 'weapon2': '1.916'} [2024-08-05 21:35:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 9886.4). Total num frames: 9879552. Throughput: 0: 4162.4. Samples: 2470000. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:35:02,794][52567] Avg episode reward: [(0, '-3.490')] [2024-08-05 21:35:02,823][52820] DAMAGECOUNT value on done: 472.0 [2024-08-05 21:35:02,825][52820] Sum rewards: -2.043, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.344', 'AMMO2': '0.006', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'HITCOUNT': '0.120', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'weapon4': '0.256', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.600', 'weapon3': '1.398', 'weapon2': '1.708', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:03,164][52668] DAMAGECOUNT value on done: 345.0 [2024-08-05 21:35:03,164][52668] Sum rewards: -3.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.214', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.570', 'FRAGCOUNT': '1.000', 'weapon3': '1.350', 'weapon2': '1.862'} [2024-08-05 21:35:03,182][52811] DAMAGECOUNT value on done: 440.0 [2024-08-05 21:35:03,182][52811] Sum rewards: -2.383, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.222', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.038', 'AMMO3': '0.041', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'ARMOR': '0.188', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.400', 'weapon4': '0.460', 'weapon3': '1.024', 'weapon2': '1.332'} [2024-08-05 21:35:04,085][52671] DAMAGECOUNT value on done: 347.0 [2024-08-05 21:35:04,178][52669] DAMAGECOUNT value on done: 247.0 [2024-08-05 21:35:04,185][52663] DAMAGECOUNT value on done: 283.0 [2024-08-05 21:35:04,185][52663] Sum rewards: -2.609, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.031', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.111', 'weapon4': '0.112', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.564', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.578', 'weapon3': '1.586'} [2024-08-05 21:35:04,213][52664] DAMAGECOUNT value on done: 322.0 [2024-08-05 21:35:04,213][52664] Sum rewards: -4.809, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.151', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.078', 'HITCOUNT': '0.110', 'AMMO3': '0.154', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.496', 'weapon3': '1.830'} [2024-08-05 21:35:04,338][52803] DAMAGECOUNT value on done: 286.0 [2024-08-05 21:35:04,339][52803] Sum rewards: -0.769, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.262', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.053', 'weapon5': '0.054', 'ARMOR': '0.080', 'weapon4': '0.116', 'AMMO4': '0.119', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.636', 'weapon3': '1.404', 'weapon2': '1.672'} [2024-08-05 21:35:04,751][52650] Updated weights for policy 0, policy_version 1211 (0.0025) [2024-08-05 21:35:04,897][52670] DAMAGECOUNT value on done: 124.0 [2024-08-05 21:35:04,982][52660] DAMAGECOUNT value on done: 500.0 [2024-08-05 21:35:04,983][52660] Sum rewards: -3.469, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.841', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.066', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.150', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '1.920'} [2024-08-05 21:35:05,331][52659] DAMAGECOUNT value on done: 552.0 [2024-08-05 21:35:05,331][52659] Sum rewards: 1.151, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.750', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.112', 'HITCOUNT': '0.170', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.726', 'weapon3': '1.298', 'weapon2': '1.392', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:05,507][52795] DAMAGECOUNT value on done: 478.0 [2024-08-05 21:35:05,511][52795] Sum rewards: -1.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.644', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.120', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.426', 'ARMOR': '0.492', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.222', 'weapon2': '1.784'} [2024-08-05 21:35:06,114][52668] DAMAGECOUNT value on done: 584.0 [2024-08-05 21:35:06,114][52668] Sum rewards: -1.646, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.638', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.044', 'AMMO3': '0.070', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon2': '1.642', 'weapon3': '1.660'} [2024-08-05 21:35:06,127][52820] DAMAGECOUNT value on done: 235.0 [2024-08-05 21:35:06,128][52820] Sum rewards: -5.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.046', 'ARMOR': '0.056', 'AMMO4': '0.106', 'weapon4': '0.110', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.386', 'weapon3': '1.858'} [2024-08-05 21:35:06,214][52666] DAMAGECOUNT value on done: 266.0 [2024-08-05 21:35:06,446][52811] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:35:06,650][52669] DAMAGECOUNT value on done: 460.0 [2024-08-05 21:35:06,650][52669] Sum rewards: -5.351, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.532', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.960', 'weapon3': '1.678', 'weapon2': '1.720'} [2024-08-05 21:35:06,678][52663] DAMAGECOUNT value on done: 255.0 [2024-08-05 21:35:06,681][52663] Sum rewards: -0.809, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.358', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'AMMO4': '0.058', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.570', 'weapon3': '1.446', 'weapon2': '1.972', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:06,975][52664] DAMAGECOUNT value on done: 565.0 [2024-08-05 21:35:06,977][52664] Sum rewards: -1.753, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.280', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.119', 'weapon2': '1.662', 'weapon3': '1.894', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:07,069][52671] DAMAGECOUNT value on done: 341.0 [2024-08-05 21:35:07,069][52671] Sum rewards: -8.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.104', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'ARMOR': '0.070', 'AMMO3': '0.127', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.324', 'weapon4': '0.440', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.336', 'weapon2': '1.414'} [2024-08-05 21:35:07,435][52803] DAMAGECOUNT value on done: 420.0 [2024-08-05 21:35:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 10193.4). Total num frames: 9969664. Throughput: 0: 4162.4. Samples: 2496390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:35:07,794][52567] Avg episode reward: [(0, '-3.672')] [2024-08-05 21:35:08,075][52670] DAMAGECOUNT value on done: 242.0 [2024-08-05 21:35:08,077][52670] Sum rewards: -4.347, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.252', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.558', 'weapon3': '1.692'} [2024-08-05 21:35:08,220][52660] DAMAGECOUNT value on done: 250.0 [2024-08-05 21:35:08,222][52660] Sum rewards: -4.242, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'ARMOR': '0.028', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.380', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.184', 'weapon3': '1.440'} [2024-08-05 21:35:08,367][52659] DAMAGECOUNT value on done: 223.0 [2024-08-05 21:35:08,369][52659] Sum rewards: -6.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO2': '0.003', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.014', 'ARMOR': '0.060', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'DAMAGECOUNT': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.108', 'weapon2': '1.964'} [2024-08-05 21:35:08,727][52795] DAMAGECOUNT value on done: 355.0 [2024-08-05 21:35:08,728][52795] Sum rewards: -2.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.457', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.088', 'AMMO4': '0.089', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon3': '1.354', 'weapon2': '1.550'} [2024-08-05 21:35:09,282][52668] DAMAGECOUNT value on done: 274.0 [2024-08-05 21:35:09,300][52663] DAMAGECOUNT value on done: 156.0 [2024-08-05 21:35:09,304][52663] Sum rewards: 0.953, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.685', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'HITCOUNT': '0.010', 'AMMO3': '0.022', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'DAMAGECOUNT': '0.168', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon3': '0.556', 'weapon2': '0.712', 'FRAGCOUNT': '1.000'} [2024-08-05 21:35:09,404][52820] DAMAGECOUNT value on done: 241.0 [2024-08-05 21:35:09,455][52650] Updated weights for policy 0, policy_version 1221 (0.0025) [2024-08-05 21:35:09,535][52666] DAMAGECOUNT value on done: 312.0 [2024-08-05 21:35:09,731][52811] DAMAGECOUNT value on done: 312.0 [2024-08-05 21:35:09,731][52811] Sum rewards: -4.069, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'weapon5': '0.002', 'AMMO5': '0.010', 'ARMOR': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.801', 'FRAGCOUNT': '1.000', 'weapon3': '1.292', 'weapon2': '1.862'} [2024-08-05 21:35:10,002][52671] DAMAGECOUNT value on done: 820.0 [2024-08-05 21:35:10,002][52671] Sum rewards: -5.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.072', 'weapon4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.188', 'HITCOUNT': '0.220', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.434', 'weapon2': '1.446', 'weapon3': '1.856', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:10,519][52803] DAMAGECOUNT value on done: 170.0 [2024-08-05 21:35:10,520][52803] Sum rewards: -2.644, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'HITCOUNT': '0.090', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.242', 'DAMAGECOUNT': '0.375', 'HEALTH': '0.459', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '1.864'} [2024-08-05 21:35:10,969][52660] DAMAGECOUNT value on done: 300.0 [2024-08-05 21:35:11,220][52659] DAMAGECOUNT value on done: 465.0 [2024-08-05 21:35:11,221][52659] Sum rewards: -5.165, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.455', 'AMMO2': '0.004', 'AMMO4': '0.022', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.182', 'HITCOUNT': '0.210', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.870', 'weapon3': '1.228', 'weapon2': '2.046', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:11,332][52670] DAMAGECOUNT value on done: 300.0 [2024-08-05 21:35:11,336][52670] Sum rewards: -3.409, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.198', 'AMMO2': '0.016', 'AMMO4': '0.079', 'ARMOR': '0.084', 'HITCOUNT': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'weapon4': '0.492', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.312', 'weapon2': '1.668'} [2024-08-05 21:35:11,832][52795] DAMAGECOUNT value on done: 240.0 [2024-08-05 21:35:12,554][52820] DAMAGECOUNT value on done: 281.0 [2024-08-05 21:35:12,749][52666] DAMAGECOUNT value on done: 334.0 [2024-08-05 21:35:12,750][52666] Sum rewards: -1.678, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.560', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.086', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.352', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.492', 'WEAPON3': '0.550', 'weapon3': '1.392', 'weapon2': '1.540', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 16793.6, 300 sec: 10497.5). Total num frames: 10059776. Throughput: 0: 4159.3. Samples: 2522400. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 21:35:12,795][52567] Avg episode reward: [(0, '-3.666')] [2024-08-05 21:35:12,833][52671] DAMAGECOUNT value on done: 309.0 [2024-08-05 21:35:12,883][52811] DAMAGECOUNT value on done: 415.0 [2024-08-05 21:35:12,883][52811] Sum rewards: 0.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.979', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.168', 'HITCOUNT': '0.270', 'ARMOR': '0.521', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.993', 'weapon3': '1.358', 'weapon2': '1.980', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:13,696][52803] DAMAGECOUNT value on done: 230.0 [2024-08-05 21:35:13,987][52659] DAMAGECOUNT value on done: 527.0 [2024-08-05 21:35:13,989][52659] Sum rewards: 1.057, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'ARMOR': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.240', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.008', 'weapon2': '1.202', 'weapon3': '1.802', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:14,314][52650] Updated weights for policy 0, policy_version 1231 (0.0033) [2024-08-05 21:35:14,489][52670] DAMAGECOUNT value on done: 413.0 [2024-08-05 21:35:14,491][52670] Sum rewards: -2.480, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.084', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.083', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.374', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'ARMOR': '0.885', 'weapon3': '1.334', 'weapon2': '1.482', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:14,987][52795] DAMAGECOUNT value on done: 635.0 [2024-08-05 21:35:14,988][52795] Sum rewards: -0.693, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.360', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.080', 'weapon4': '0.162', 'HITCOUNT': '0.280', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.005', 'weapon3': '1.620', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:15,481][52671] DAMAGECOUNT value on done: 333.0 [2024-08-05 21:35:15,599][52820] DAMAGECOUNT value on done: 226.0 [2024-08-05 21:35:15,601][52820] Sum rewards: -2.017, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.826', 'AMMO2': '0.018', 'ARMOR': '0.060', 'AMMO3': '0.081', 'AMMO4': '0.088', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.278', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.400', 'weapon3': '0.668', 'FRAGCOUNT': '1.000', 'weapon2': '2.280'} [2024-08-05 21:35:15,657][52666] DAMAGECOUNT value on done: 440.0 [2024-08-05 21:35:15,664][52666] Sum rewards: -1.399, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.138', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.028', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.117', 'HITCOUNT': '0.120', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.420', 'weapon4': '0.510', 'weapon3': '0.644', 'weapon2': '1.810', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:15,903][52811] DAMAGECOUNT value on done: 130.0 [2024-08-05 21:35:15,903][52811] Sum rewards: -3.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'HITCOUNT': '0.080', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.476', 'weapon2': '1.798'} [2024-08-05 21:35:16,585][52659] DAMAGECOUNT value on done: 442.0 [2024-08-05 21:35:16,970][52803] DAMAGECOUNT value on done: 310.0 [2024-08-05 21:35:17,612][52670] DAMAGECOUNT value on done: 353.0 [2024-08-05 21:35:17,612][52670] Sum rewards: -0.677, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.018', 'AMMO3': '0.106', 'HITCOUNT': '0.170', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.615', 'weapon2': '1.462', 'weapon3': '2.074', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 10747.5). Total num frames: 10141696. Throughput: 0: 4171.3. Samples: 2535740. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:35:17,795][52567] Avg episode reward: [(0, '-3.623')] [2024-08-05 21:35:18,143][52795] DAMAGECOUNT value on done: 315.0 [2024-08-05 21:35:18,145][52795] Sum rewards: -3.012, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.018', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.109', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.700', 'weapon3': '1.388', 'weapon2': '1.898', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:18,552][52666] DAMAGECOUNT value on done: 524.0 [2024-08-05 21:35:18,552][52666] Sum rewards: -3.365, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.580', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'HITCOUNT': '0.150', 'weapon4': '0.354', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.450', 'ARMOR': '0.520', 'weapon3': '0.620', 'FRAGCOUNT': '2.000', 'weapon2': '2.042'} [2024-08-05 21:35:18,806][52650] Updated weights for policy 0, policy_version 1241 (0.0012) [2024-08-05 21:35:18,876][52820] DAMAGECOUNT value on done: 292.0 [2024-08-05 21:35:19,023][52811] DAMAGECOUNT value on done: 232.0 [2024-08-05 21:35:20,017][52803] DAMAGECOUNT value on done: 423.0 [2024-08-05 21:35:20,274][52670] DAMAGECOUNT value on done: 501.0 [2024-08-05 21:35:20,275][52670] Sum rewards: -1.087, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.597', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon4': '0.214', 'HITCOUNT': '0.310', 'ARMOR': '0.455', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.101', 'weapon2': '1.424', 'weapon3': '1.944', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:21,306][52795] DAMAGECOUNT value on done: 310.0 [2024-08-05 21:35:21,306][52795] Sum rewards: -0.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.777', 'AMMO2': '0.030', 'ARMOR': '0.072', 'AMMO3': '0.101', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon4': '0.156', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.450', 'weapon3': '1.222', 'weapon2': '2.016', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:22,070][52820] DAMAGECOUNT value on done: 340.0 [2024-08-05 21:35:22,071][52820] Sum rewards: -2.851, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.700', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.133', 'weapon4': '0.194', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.220', 'weapon3': '2.042'} [2024-08-05 21:35:22,156][52811] DAMAGECOUNT value on done: 335.0 [2024-08-05 21:35:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16930.0, 300 sec: 11052.4). Total num frames: 10231808. Throughput: 0: 4181.1. Samples: 2562070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:35:22,795][52567] Avg episode reward: [(0, '-3.772')] [2024-08-05 21:35:23,139][52803] DAMAGECOUNT value on done: 418.0 [2024-08-05 21:35:23,140][52803] Sum rewards: -2.818, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.087', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'weapon4': '0.024', 'AMMO4': '0.044', 'ARMOR': '0.056', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.600', 'weapon3': '1.264', 'FRAGCOUNT': '1.500', 'weapon2': '2.218'} [2024-08-05 21:35:23,638][52650] Updated weights for policy 0, policy_version 1251 (0.0013) [2024-08-05 21:35:24,475][52795] DAMAGECOUNT value on done: 113.0 [2024-08-05 21:35:25,130][52811] DAMAGECOUNT value on done: 293.0 [2024-08-05 21:35:25,130][52811] Sum rewards: -4.310, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.080', 'AMMO2': '0.006', 'weapon4': '0.010', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.143', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.340', 'weapon3': '1.664'} [2024-08-05 21:35:25,236][52820] DAMAGECOUNT value on done: 343.0 [2024-08-05 21:35:25,237][52820] Sum rewards: -2.809, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.271', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'ARMOR': '0.116', 'AMMO3': '0.125', 'HITCOUNT': '0.150', 'weapon4': '0.220', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.400', 'weapon3': '1.934'} [2024-08-05 21:35:26,318][52803] DAMAGECOUNT value on done: 363.0 [2024-08-05 21:35:26,321][52803] Sum rewards: 0.841, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.887', 'AMMO2': '0.007', 'AMMO5': '0.014', 'weapon5': '0.026', 'AMMO4': '0.035', 'AMMO3': '0.076', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.320', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.801', 'weapon3': '1.452', 'weapon2': '1.586', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:27,554][52795] DAMAGECOUNT value on done: 386.0 [2024-08-05 21:35:27,556][52795] Sum rewards: 2.129, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.102', 'HITCOUNT': '0.130', 'weapon4': '0.160', 'HEALTH': '0.424', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.618', 'weapon3': '1.182', 'weapon2': '1.550', 'FRAGCOUNT': '4.000'} [2024-08-05 21:35:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16930.1, 300 sec: 11357.8). Total num frames: 10321920. Throughput: 0: 4284.0. Samples: 2588600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:35:27,794][52567] Avg episode reward: [(0, '-3.677')] [2024-08-05 21:35:28,204][52811] DAMAGECOUNT value on done: 490.0 [2024-08-05 21:35:28,206][52811] Sum rewards: -1.950, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.024', 'WEAPON4': '0.050', 'ARMOR': '0.051', 'AMMO4': '0.073', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HEALTH': '0.112', 'HITCOUNT': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.035', 'weapon3': '1.556', 'weapon2': '1.792', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:28,294][52650] Updated weights for policy 0, policy_version 1261 (0.0033) [2024-08-05 21:35:28,537][52820] DAMAGECOUNT value on done: 505.0 [2024-08-05 21:35:28,538][52820] Sum rewards: -5.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.696', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon5': '0.004', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.220', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.950', 'weapon2': '1.114', 'weapon3': '1.998'} [2024-08-05 21:35:29,622][52803] DAMAGECOUNT value on done: 241.0 [2024-08-05 21:35:29,622][52803] Sum rewards: 0.056, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.033', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.120', 'weapon4': '0.146', 'DAMAGECOUNT': '0.333', 'WEAPON3': '0.400', 'ARMOR': '0.567', 'FRAGCOUNT': '1.000', 'weapon3': '1.108', 'weapon2': '1.840'} [2024-08-05 21:35:30,606][52795] DAMAGECOUNT value on done: 174.0 [2024-08-05 21:35:30,606][52795] Sum rewards: -3.431, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.714', 'AMMO2': '0.016', 'HITCOUNT': '0.030', 'AMMO3': '0.071', 'DAMAGECOUNT': '0.072', 'AMMO4': '0.081', 'ARMOR': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.342', 'WEAPON3': '0.350', 'weapon3': '0.730', 'FRAGCOUNT': '1.000', 'weapon2': '1.798'} [2024-08-05 21:35:31,334][52811] DAMAGECOUNT value on done: 276.0 [2024-08-05 21:35:31,336][52811] Sum rewards: -4.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.112', 'AMMO2': '0.007', 'AMMO4': '0.037', 'ARMOR': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.140', 'HITCOUNT': '0.140', 'weapon4': '0.152', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.530', 'weapon3': '1.862'} [2024-08-05 21:35:31,847][52820] DAMAGECOUNT value on done: 420.0 [2024-08-05 21:35:32,605][52650] Updated weights for policy 0, policy_version 1271 (0.0023) [2024-08-05 21:35:32,659][52803] DAMAGECOUNT value on done: 494.0 [2024-08-05 21:35:32,659][52803] Sum rewards: -0.799, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.157', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.111', 'weapon4': '0.204', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.672', 'FRAGCOUNT': '1.000', 'weapon3': '1.432', 'weapon2': '1.590'} [2024-08-05 21:35:32,794][52567] Fps is (10 sec: 18022.9, 60 sec: 16930.2, 300 sec: 11635.8). Total num frames: 10412032. Throughput: 0: 4362.0. Samples: 2601700. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:35:32,794][52567] Avg episode reward: [(0, '-3.515')] [2024-08-05 21:35:33,681][52795] DAMAGECOUNT value on done: 511.0 [2024-08-05 21:35:33,683][52795] Sum rewards: -4.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.518', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.068', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'HITCOUNT': '0.220', 'weapon4': '0.236', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.338', 'weapon3': '1.774'} [2024-08-05 21:35:34,350][52811] DAMAGECOUNT value on done: 245.0 [2024-08-05 21:35:34,350][52811] Sum rewards: -4.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.610', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.080', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.546', 'weapon3': '1.592'} [2024-08-05 21:35:35,169][52820] DAMAGECOUNT value on done: 276.0 [2024-08-05 21:35:35,170][52820] Sum rewards: -3.619, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.145', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.008', 'AMMO5': '0.013', 'AMMO3': '0.128', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.783', 'weapon2': '1.282', 'weapon3': '1.846', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:35,613][52803] DAMAGECOUNT value on done: 343.0 [2024-08-05 21:35:35,614][52803] Sum rewards: -3.437, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.006', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.094', 'AMMO3': '0.130', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.356', 'weapon3': '2.180'} [2024-08-05 21:35:36,664][52795] DAMAGECOUNT value on done: 260.0 [2024-08-05 21:35:36,666][52795] Sum rewards: -4.697, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'weapon4': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.120', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.700', 'weapon2': '1.302', 'weapon3': '1.788', 'FRAGCOUNT': '2.000'} [2024-08-05 21:35:37,300][52811] DAMAGECOUNT value on done: 442.0 [2024-08-05 21:35:37,452][52650] Updated weights for policy 0, policy_version 1281 (0.0011) [2024-08-05 21:35:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 11913.3). Total num frames: 10493952. Throughput: 0: 4384.4. Samples: 2628400. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:35:37,794][52567] Avg episode reward: [(0, '-3.477')] [2024-08-05 21:35:38,618][52820] DAMAGECOUNT value on done: 173.0 [2024-08-05 21:35:38,736][52803] DAMAGECOUNT value on done: 248.0 [2024-08-05 21:35:39,750][52795] DAMAGECOUNT value on done: 336.0 [2024-08-05 21:35:39,751][52795] Sum rewards: 0.156, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.862', 'AMMO2': '0.003', 'ARMOR': '0.008', 'weapon4': '0.012', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'HITCOUNT': '0.240', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.813', 'weapon2': '1.356', 'weapon3': '2.162', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:40,558][52811] DAMAGECOUNT value on done: 698.0 [2024-08-05 21:35:40,564][52811] Sum rewards: -2.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.167', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.341', 'weapon2': '1.610', 'weapon3': '2.044', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:41,815][52820] DAMAGECOUNT value on done: 204.0 [2024-08-05 21:35:41,914][52803] DAMAGECOUNT value on done: 174.0 [2024-08-05 21:35:42,250][52650] Updated weights for policy 0, policy_version 1291 (0.0012) [2024-08-05 21:35:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.9, 300 sec: 12218.8). Total num frames: 10584064. Throughput: 0: 4396.9. Samples: 2654940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 21:35:42,794][52567] Avg episode reward: [(0, '-3.466')] [2024-08-05 21:35:42,798][52795] DAMAGECOUNT value on done: 343.0 [2024-08-05 21:35:42,800][52795] Sum rewards: -5.159, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.015', 'ARMOR': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.254', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.022', 'weapon3': '1.724'} [2024-08-05 21:35:43,730][52811] DAMAGECOUNT value on done: 276.0 [2024-08-05 21:35:44,968][52803] DAMAGECOUNT value on done: 335.0 [2024-08-05 21:35:44,971][52803] Sum rewards: -1.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.058', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.024', 'weapon4': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.186', 'ARMOR': '0.564', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.468', 'weapon2': '1.562'} [2024-08-05 21:35:45,176][52820] DAMAGECOUNT value on done: 533.0 [2024-08-05 21:35:45,177][52820] Sum rewards: -3.713, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.968', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.114', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.630', 'weapon3': '1.964'} [2024-08-05 21:35:45,876][52795] DAMAGECOUNT value on done: 396.0 [2024-08-05 21:35:45,884][52795] Sum rewards: -0.852, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.024', 'HEALTH': '0.029', 'AMMO4': '0.078', 'HITCOUNT': '0.080', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.230', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.468', 'weapon2': '1.528'} [2024-08-05 21:35:46,753][52811] DAMAGECOUNT value on done: 184.0 [2024-08-05 21:35:46,773][52650] Updated weights for policy 0, policy_version 1301 (0.0011) [2024-08-05 21:35:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 12524.3). Total num frames: 10674176. Throughput: 0: 4410.4. Samples: 2668470. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:35:47,795][52567] Avg episode reward: [(0, '-3.396')] [2024-08-05 21:35:47,994][52803] DAMAGECOUNT value on done: 483.0 [2024-08-05 21:35:48,638][52820] DAMAGECOUNT value on done: 300.0 [2024-08-05 21:35:48,640][52820] Sum rewards: -2.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.552', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.008', 'AMMO4': '0.027', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '1.614'} [2024-08-05 21:35:48,874][52795] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:35:49,814][52811] DAMAGECOUNT value on done: 414.0 [2024-08-05 21:35:49,816][52811] Sum rewards: -5.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.434', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.720', 'ARMOR': '0.922', 'weapon3': '0.974', 'FRAGCOUNT': '1.000', 'weapon2': '1.966'} [2024-08-05 21:35:50,994][52803] DAMAGECOUNT value on done: 270.0 [2024-08-05 21:35:51,002][52803] Sum rewards: 0.272, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.034', 'AMMO4': '0.054', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.156', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'ARMOR': '0.500', 'HEALTH': '0.826', 'FRAGCOUNT': '1.000', 'weapon3': '1.528', 'weapon2': '1.638'} [2024-08-05 21:35:51,224][52650] Updated weights for policy 0, policy_version 1311 (0.0019) [2024-08-05 21:35:51,871][52820] DAMAGECOUNT value on done: 314.0 [2024-08-05 21:35:51,871][52820] Sum rewards: -3.477, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.152', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.179', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.777', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.440', 'weapon3': '2.022'} [2024-08-05 21:35:52,085][52795] DAMAGECOUNT value on done: 505.0 [2024-08-05 21:35:52,086][52795] Sum rewards: 2.835, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.052', 'AMMO4': '0.080', 'AMMO3': '0.091', 'HITCOUNT': '0.250', 'HEALTH': '0.296', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.125', 'weapon2': '1.738', 'weapon3': '1.784', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:52,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 12829.6). Total num frames: 10764288. Throughput: 0: 4410.2. Samples: 2694850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:35:52,795][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:35:52,795][52614] Saving new best policy, reward=-3.218! [2024-08-05 21:35:52,943][52811] DAMAGECOUNT value on done: 110.0 [2024-08-05 21:35:52,945][52811] Sum rewards: -1.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.025', 'weapon4': '0.052', 'HITCOUNT': '0.060', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.414', 'weapon2': '1.910'} [2024-08-05 21:35:54,289][52803] DAMAGECOUNT value on done: 255.0 [2024-08-05 21:35:55,055][52820] DAMAGECOUNT value on done: 320.0 [2024-08-05 21:35:55,055][52820] Sum rewards: 1.244, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.757', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.061', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon3': '1.290', 'weapon2': '1.298'} [2024-08-05 21:35:55,877][52650] Updated weights for policy 0, policy_version 1321 (0.0024) [2024-08-05 21:35:57,334][52803] DAMAGECOUNT value on done: 664.0 [2024-08-05 21:35:57,337][52803] Sum rewards: -0.749, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.428', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'ARMOR': '0.052', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.334', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.356', 'weapon2': '1.588', 'weapon3': '1.688', 'FRAGCOUNT': '3.000'} [2024-08-05 21:35:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 13135.2). Total num frames: 10854400. Throughput: 0: 4409.1. Samples: 2720810. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:35:57,794][52567] Avg episode reward: [(0, '-3.201')] [2024-08-05 21:35:57,797][52614] Saving new best policy, reward=-3.201! [2024-08-05 21:35:58,144][52820] DAMAGECOUNT value on done: 414.0 [2024-08-05 21:35:58,149][52820] Sum rewards: -3.649, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.887', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.008', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.126', 'HITCOUNT': '0.290', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.837', 'weapon2': '1.108', 'weapon3': '2.170'} [2024-08-05 21:36:00,597][52650] Updated weights for policy 0, policy_version 1331 (0.0016) [2024-08-05 21:36:01,496][52820] DAMAGECOUNT value on done: 641.0 [2024-08-05 21:36:01,496][52820] Sum rewards: -4.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'weapon5': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.037', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.196', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.475', 'WEAPON3': '0.650', 'weapon2': '1.410', 'weapon3': '1.818', 'FRAGCOUNT': '2.000'} [2024-08-05 21:36:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 13385.2). Total num frames: 10936320. Throughput: 0: 4403.1. Samples: 2733880. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:36:02,794][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:05,375][52650] Updated weights for policy 0, policy_version 1341 (0.0012) [2024-08-05 21:36:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 13634.8). Total num frames: 11018240. Throughput: 0: 4391.3. Samples: 2759680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:36:07,802][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:10,120][52650] Updated weights for policy 0, policy_version 1351 (0.0024) [2024-08-05 21:36:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 13940.8). Total num frames: 11108352. Throughput: 0: 4376.0. Samples: 2785520. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:36:12,795][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:14,969][52650] Updated weights for policy 0, policy_version 1361 (0.0012) [2024-08-05 21:36:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 14190.4). Total num frames: 11190272. Throughput: 0: 4366.9. Samples: 2798210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:36:17,795][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:19,910][52650] Updated weights for policy 0, policy_version 1371 (0.0013) [2024-08-05 21:36:22,795][52567] Fps is (10 sec: 16383.4, 60 sec: 17339.7, 300 sec: 14468.2). Total num frames: 11272192. Throughput: 0: 4337.3. Samples: 2823580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:36:22,796][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:24,918][52650] Updated weights for policy 0, policy_version 1381 (0.0027) [2024-08-05 21:36:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 14746.5). Total num frames: 11354112. Throughput: 0: 4315.8. Samples: 2849150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:36:27,795][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001386_11354112.pth... [2024-08-05 21:36:27,961][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000000875_7168000.pth [2024-08-05 21:36:29,644][52650] Updated weights for policy 0, policy_version 1391 (0.0029) [2024-08-05 21:36:32,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17203.2, 300 sec: 15051.1). Total num frames: 11444224. Throughput: 0: 4297.1. Samples: 2861840. Policy #0 lag: (min: 1.0, avg: 3.0, max: 8.0) [2024-08-05 21:36:32,802][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:34,283][52650] Updated weights for policy 0, policy_version 1401 (0.0013) [2024-08-05 21:36:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.1, 300 sec: 15190.0). Total num frames: 11526144. Throughput: 0: 4279.3. Samples: 2887420. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:36:37,802][52567] Avg episode reward: [(0, '-3.218')] [2024-08-05 21:36:37,819][52794] DAMAGECOUNT value on done: 392.0 [2024-08-05 21:36:37,820][52794] Sum rewards: -1.235, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.746', 'weapon5': '0.002', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.151', 'WEAPON4': '0.400', 'weapon4': '0.408', 'DAMAGECOUNT': '0.471', 'ARMOR': '0.529', 'WEAPON3': '0.850', 'weapon2': '1.060', 'weapon3': '1.834', 'FRAGCOUNT': '2.000'} [2024-08-05 21:36:38,989][52650] Updated weights for policy 0, policy_version 1411 (0.0016) [2024-08-05 21:36:40,121][52662] DAMAGECOUNT value on done: 504.0 [2024-08-05 21:36:40,389][52794] DAMAGECOUNT value on done: 323.0 [2024-08-05 21:36:42,791][52662] DAMAGECOUNT value on done: 512.0 [2024-08-05 21:36:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 15468.1). Total num frames: 11624448. Throughput: 0: 4278.2. Samples: 2913330. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:36:42,794][52567] Avg episode reward: [(0, '-3.194')] [2024-08-05 21:36:42,795][52614] Saving new best policy, reward=-3.194! [2024-08-05 21:36:43,057][52794] DAMAGECOUNT value on done: 665.0 [2024-08-05 21:36:43,058][52794] Sum rewards: 1.060, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.063', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'HEALTH': '0.480', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.170', 'weapon2': '1.626', 'weapon3': '1.658', 'FRAGCOUNT': '2.500'} [2024-08-05 21:36:44,031][52650] Updated weights for policy 0, policy_version 1421 (0.0018) [2024-08-05 21:36:45,260][52662] DAMAGECOUNT value on done: 341.0 [2024-08-05 21:36:45,657][52794] DAMAGECOUNT value on done: 287.0 [2024-08-05 21:36:45,659][52794] Sum rewards: -2.919, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.836', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.012', 'HITCOUNT': '0.100', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.750', 'weapon3': '1.682', 'weapon2': '1.898', 'FRAGCOUNT': '2.000'} [2024-08-05 21:36:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17203.2, 300 sec: 15745.6). Total num frames: 11706368. Throughput: 0: 4272.9. Samples: 2926160. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:36:47,794][52567] Avg episode reward: [(0, '-3.149')] [2024-08-05 21:36:47,826][52614] Saving new best policy, reward=-3.149! [2024-08-05 21:36:47,864][52662] DAMAGECOUNT value on done: 507.0 [2024-08-05 21:36:47,866][52662] Sum rewards: -1.771, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.521', 'AMMO4': '-0.068', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.120', 'WEAPON3': '0.400', 'ARMOR': '0.481', 'DAMAGECOUNT': '0.570', 'weapon3': '0.964', 'weapon2': '2.050', 'FRAGCOUNT': '4.000'} [2024-08-05 21:36:48,187][52794] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:36:48,595][52650] Updated weights for policy 0, policy_version 1431 (0.0021) [2024-08-05 21:36:50,112][52662] DAMAGECOUNT value on done: 533.0 [2024-08-05 21:36:50,113][52662] Sum rewards: -6.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.942', 'weapon3': '1.310', 'FRAGCOUNT': '2.000', 'weapon2': '2.098'} [2024-08-05 21:36:50,407][52794] DAMAGECOUNT value on done: 426.0 [2024-08-05 21:36:52,700][52662] DAMAGECOUNT value on done: 575.0 [2024-08-05 21:36:52,703][52662] Sum rewards: -1.424, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.864', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.032', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.298', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'ARMOR': '0.890', 'weapon3': '1.244', 'weapon2': '1.984'} [2024-08-05 21:36:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.3, 300 sec: 16023.1). Total num frames: 11796480. Throughput: 0: 4279.8. Samples: 2952270. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:36:52,794][52567] Avg episode reward: [(0, '-3.147')] [2024-08-05 21:36:52,795][52614] Saving new best policy, reward=-3.147! [2024-08-05 21:36:53,044][52794] DAMAGECOUNT value on done: 262.0 [2024-08-05 21:36:53,539][52650] Updated weights for policy 0, policy_version 1441 (0.0025) [2024-08-05 21:36:55,438][52662] DAMAGECOUNT value on done: 467.0 [2024-08-05 21:36:55,439][52662] Sum rewards: -3.332, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.768', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.324', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.350'} [2024-08-05 21:36:55,762][52794] DAMAGECOUNT value on done: 376.0 [2024-08-05 21:36:55,763][52794] Sum rewards: -4.860, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.420', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.009', 'weapon5': '0.018', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.186', 'DAMAGECOUNT': '0.318', 'WEAPON3': '0.800', 'weapon2': '1.382', 'weapon3': '1.478'} [2024-08-05 21:36:56,972][52665] DAMAGECOUNT value on done: 500.0 [2024-08-05 21:36:56,972][52665] Sum rewards: -0.242, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.205', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.266', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.504', 'WEAPON3': '0.700', 'weapon3': '1.510', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'} [2024-08-05 21:36:57,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17066.6, 300 sec: 16301.2). Total num frames: 11878400. Throughput: 0: 4280.2. Samples: 2978130. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:36:57,796][52567] Avg episode reward: [(0, '-3.083')] [2024-08-05 21:36:57,850][52614] Saving new best policy, reward=-3.083! [2024-08-05 21:36:57,860][52650] Updated weights for policy 0, policy_version 1451 (0.0016) [2024-08-05 21:36:58,027][52662] DAMAGECOUNT value on done: 657.0 [2024-08-05 21:36:58,027][52662] Sum rewards: -3.347, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.484', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.055', 'AMMO4': '0.058', 'weapon5': '0.072', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.460', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.738', 'weapon3': '1.166', 'weapon2': '1.612'} [2024-08-05 21:36:58,279][52794] DAMAGECOUNT value on done: 180.0 [2024-08-05 21:36:58,279][52794] Sum rewards: -2.999, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.931', 'AMMO2': '0.018', 'HITCOUNT': '0.060', 'AMMO4': '0.090', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.255', 'weapon4': '0.322', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.368', 'weapon2': '1.642'} [2024-08-05 21:37:00,327][52665] DAMAGECOUNT value on done: 476.0 [2024-08-05 21:37:00,329][52665] Sum rewards: -2.968, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.252', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.145', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.483', 'WEAPON3': '0.750', 'weapon3': '1.440', 'FRAGCOUNT': '2.000', 'weapon2': '2.144'} [2024-08-05 21:37:00,617][52662] DAMAGECOUNT value on done: 436.0 [2024-08-05 21:37:00,617][52662] Sum rewards: -5.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.592', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.170', 'HITCOUNT': '0.200', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.594', 'WEAPON3': '0.700', 'weapon3': '1.422', 'FRAGCOUNT': '2.000', 'weapon2': '2.106'} [2024-08-05 21:37:00,845][52794] DAMAGECOUNT value on done: 354.0 [2024-08-05 21:37:02,567][52650] Updated weights for policy 0, policy_version 1461 (0.0022) [2024-08-05 21:37:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 16606.9). Total num frames: 11968512. Throughput: 0: 4285.6. Samples: 2991060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:37:02,794][52567] Avg episode reward: [(0, '-3.044')] [2024-08-05 21:37:02,795][52614] Saving new best policy, reward=-3.044! [2024-08-05 21:37:03,099][52649] DAMAGECOUNT value on done: 380.0 [2024-08-05 21:37:03,102][52649] Sum rewards: 0.338, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.233', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'ARMOR': '0.129', 'AMMO4': '0.139', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.410', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.600', 'weapon2': '1.214', 'weapon3': '1.548', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:03,171][52662] DAMAGECOUNT value on done: 635.0 [2024-08-05 21:37:03,171][52662] Sum rewards: -4.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.232', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.032', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.181', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.945', 'WEAPON3': '1.000', 'weapon2': '1.402', 'FRAGCOUNT': '2.000', 'weapon3': '2.222'} [2024-08-05 21:37:03,385][52665] DAMAGECOUNT value on done: 407.0 [2024-08-05 21:37:03,414][52794] DAMAGECOUNT value on done: 430.0 [2024-08-05 21:37:05,623][52662] DAMAGECOUNT value on done: 495.0 [2024-08-05 21:37:05,623][52662] Sum rewards: 0.761, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.070', 'ARMOR': '0.078', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'HITCOUNT': '0.170', 'HEALTH': '0.186', 'WEAPON3': '0.450', 'weapon4': '0.466', 'DAMAGECOUNT': '0.735', 'weapon3': '1.248', 'weapon2': '1.424', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:05,919][52794] DAMAGECOUNT value on done: 403.0 [2024-08-05 21:37:05,923][52794] Sum rewards: -9.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.256', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.145', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.506', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.214', 'weapon2': '1.562'} [2024-08-05 21:37:06,063][52649] DAMAGECOUNT value on done: 652.0 [2024-08-05 21:37:06,064][52649] Sum rewards: -1.674, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.087', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.312', 'WEAPON3': '0.500', 'weapon4': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.224', 'weapon2': '1.390'} [2024-08-05 21:37:06,213][52665] DAMAGECOUNT value on done: 125.0 [2024-08-05 21:37:07,640][52650] Updated weights for policy 0, policy_version 1471 (0.0012) [2024-08-05 21:37:07,795][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.1, 300 sec: 16856.3). Total num frames: 12050432. Throughput: 0: 4304.2. Samples: 3017270. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 21:37:07,796][52567] Avg episode reward: [(0, '-2.967')] [2024-08-05 21:37:07,893][52614] Saving new best policy, reward=-2.967! [2024-08-05 21:37:08,066][52614] Signal inference workers to stop experience collection... (250 times) [2024-08-05 21:37:08,066][52614] Signal inference workers to resume experience collection... (250 times) [2024-08-05 21:37:08,161][52650] InferenceWorker_p0-w0: stopping experience collection (250 times) [2024-08-05 21:37:08,161][52650] InferenceWorker_p0-w0: resuming experience collection (250 times) [2024-08-05 21:37:08,193][52662] DAMAGECOUNT value on done: 799.0 [2024-08-05 21:37:08,194][52662] Sum rewards: -5.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.160', 'weapon4': '0.194', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.900', 'weapon3': '1.602', 'weapon2': '1.752', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:08,422][52794] DAMAGECOUNT value on done: 269.0 [2024-08-05 21:37:09,279][52649] DAMAGECOUNT value on done: 327.0 [2024-08-05 21:37:09,529][52665] DAMAGECOUNT value on done: 554.0 [2024-08-05 21:37:09,540][52665] Sum rewards: -3.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.185', 'AMMO2': '0.015', 'HITCOUNT': '0.060', 'AMMO4': '0.076', 'ARMOR': '0.080', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.210', 'weapon4': '0.344', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.336', 'weapon3': '1.808'} [2024-08-05 21:37:10,368][52662] DAMAGECOUNT value on done: 431.0 [2024-08-05 21:37:10,623][52794] DAMAGECOUNT value on done: 528.0 [2024-08-05 21:37:10,624][52794] Sum rewards: -2.909, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.245', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon7': '0.076', 'ARMOR': '0.084', 'weapon4': '0.094', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.474', 'weapon3': '1.872'} [2024-08-05 21:37:11,858][52650] Updated weights for policy 0, policy_version 1481 (0.0019) [2024-08-05 21:37:11,859][52649] DAMAGECOUNT value on done: 401.0 [2024-08-05 21:37:11,861][52649] Sum rewards: -6.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.929', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.184', 'DAMAGECOUNT': '0.435', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.200', 'weapon2': '1.476', 'weapon3': '2.090'} [2024-08-05 21:37:11,949][52665] DAMAGECOUNT value on done: 304.0 [2024-08-05 21:37:11,949][52665] Sum rewards: -1.255, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'HEALTH': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'ARMOR': '0.084', 'AMMO3': '0.103', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.597', 'FRAGCOUNT': '1.000', 'weapon2': '1.414', 'weapon3': '1.684'} [2024-08-05 21:37:12,652][52662] DAMAGECOUNT value on done: 375.0 [2024-08-05 21:37:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17134.0). Total num frames: 12140544. Throughput: 0: 4318.7. Samples: 3043490. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 21:37:12,794][52567] Avg episode reward: [(0, '-2.994')] [2024-08-05 21:37:12,856][52794] DAMAGECOUNT value on done: 753.0 [2024-08-05 21:37:14,742][52649] DAMAGECOUNT value on done: 237.0 [2024-08-05 21:37:14,849][52665] DAMAGECOUNT value on done: 237.0 [2024-08-05 21:37:15,117][52662] DAMAGECOUNT value on done: 234.0 [2024-08-05 21:37:15,119][52662] Sum rewards: -3.930, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.018', 'ARMOR': '0.028', 'HEALTH': '0.038', 'WEAPON5': '0.050', 'weapon7': '0.076', 'AMMO3': '0.083', 'AMMO4': '0.088', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.236', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.550', 'weapon2': '1.358', 'weapon3': '1.624'} [2024-08-05 21:37:15,384][52794] DAMAGECOUNT value on done: 317.0 [2024-08-05 21:37:15,385][52794] Sum rewards: -1.660, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.290', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.020', 'HITCOUNT': '0.040', 'AMMO3': '0.054', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.111', 'weapon4': '0.144', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.064', 'weapon2': '1.728'} [2024-08-05 21:37:15,462][52647] DAMAGECOUNT value on done: 189.0 [2024-08-05 21:37:15,941][52667] DAMAGECOUNT value on done: 195.0 [2024-08-05 21:37:16,999][52650] Updated weights for policy 0, policy_version 1491 (0.0017) [2024-08-05 21:37:17,517][52669] DAMAGECOUNT value on done: 185.0 [2024-08-05 21:37:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17339.7, 300 sec: 17412.0). Total num frames: 12230656. Throughput: 0: 4329.3. Samples: 3056660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:37:17,794][52567] Avg episode reward: [(0, '-3.151')] [2024-08-05 21:37:17,847][52662] DAMAGECOUNT value on done: 598.0 [2024-08-05 21:37:17,847][52662] Sum rewards: -4.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.606', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'HITCOUNT': '0.260', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.950', 'weapon3': '1.324', 'weapon2': '2.178', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:18,127][52649] DAMAGECOUNT value on done: 260.0 [2024-08-05 21:37:18,183][52794] DAMAGECOUNT value on done: 547.0 [2024-08-05 21:37:18,243][52665] DAMAGECOUNT value on done: 517.0 [2024-08-05 21:37:18,244][52665] Sum rewards: -3.540, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.392', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'ARMOR': '0.060', 'HITCOUNT': '0.090', 'AMMO3': '0.136', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.580', 'weapon3': '2.060'} [2024-08-05 21:37:18,245][52647] DAMAGECOUNT value on done: 738.0 [2024-08-05 21:37:18,245][52647] Sum rewards: -2.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.856', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.020', 'WEAPON4': '0.100', 'weapon4': '0.194', 'AMMO3': '0.229', 'HITCOUNT': '0.410', 'weapon2': '0.870', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.431', 'weapon3': '2.220', 'FRAGCOUNT': '6.000'} [2024-08-05 21:37:18,582][52658] DAMAGECOUNT value on done: 607.0 [2024-08-05 21:37:18,583][52658] Sum rewards: -2.950, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.312', 'AMMO2': '0.013', 'ARMOR': '0.056', 'AMMO3': '0.063', 'AMMO4': '0.065', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.606', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '1.574'} [2024-08-05 21:37:19,404][52667] DAMAGECOUNT value on done: 452.0 [2024-08-05 21:37:19,410][52667] Sum rewards: -0.674, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.152', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO3': '0.066', 'AMMO4': '0.083', 'ARMOR': '0.091', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.180', 'weapon2': '1.424'} [2024-08-05 21:37:20,160][52662] DAMAGECOUNT value on done: 256.0 [2024-08-05 21:37:20,161][52662] Sum rewards: 0.095, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO2': '0.010', 'AMMO4': '0.048', 'HITCOUNT': '0.070', 'ARMOR': '0.072', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon7': '0.168', 'AMMO6': '0.220', 'AMMO7': '0.220', 'DAMAGECOUNT': '0.255', 'WEAPON7': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.074', 'weapon3': '1.412'} [2024-08-05 21:37:20,493][52794] DAMAGECOUNT value on done: 776.0 [2024-08-05 21:37:20,494][52794] Sum rewards: -4.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.345', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.104', 'HITCOUNT': '0.140', 'AMMO3': '0.143', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.950', 'weapon3': '1.644', 'weapon2': '1.786', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:20,709][52669] DAMAGECOUNT value on done: 650.0 [2024-08-05 21:37:20,709][52669] Sum rewards: 0.102, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.512', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.210', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.558', 'WEAPON3': '0.750', 'weapon2': '1.426', 'weapon3': '1.750', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:21,248][52658] DAMAGECOUNT value on done: 535.0 [2024-08-05 21:37:21,248][52658] Sum rewards: -2.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.554', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon7': '0.032', 'weapon4': '0.036', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.200', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.448', 'weapon2': '2.114'} [2024-08-05 21:37:21,473][52647] DAMAGECOUNT value on done: 553.0 [2024-08-05 21:37:21,475][52647] Sum rewards: -0.773, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.346', 'AMMO2': '0.011', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'ARMOR': '0.068', 'AMMO3': '0.104', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.500', 'weapon3': '1.256', 'weapon2': '1.722', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:21,533][52649] DAMAGECOUNT value on done: 514.0 [2024-08-05 21:37:21,533][52649] Sum rewards: -4.197, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.365', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.190', 'weapon4': '0.240', 'ARMOR': '0.546', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon2': '1.538', 'weapon3': '1.574'} [2024-08-05 21:37:21,547][52665] DAMAGECOUNT value on done: 507.0 [2024-08-05 21:37:21,548][52665] Sum rewards: -0.796, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.720', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon7': '0.052', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.232', 'ARMOR': '0.497', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.657', 'weapon3': '1.022', 'weapon2': '1.442', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:21,561][52663] DAMAGECOUNT value on done: 687.0 [2024-08-05 21:37:21,561][52663] Sum rewards: -3.032, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO2': '0.005', 'AMMO4': '0.023', 'ARMOR': '0.040', 'HITCOUNT': '0.080', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.225', 'weapon4': '0.392', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.406', 'weapon3': '1.668'} [2024-08-05 21:37:21,700][52667] DAMAGECOUNT value on done: 611.0 [2024-08-05 21:37:21,702][52667] Sum rewards: -3.180, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.612', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.000', 'weapon3': '1.416', 'weapon2': '1.726'} [2024-08-05 21:37:21,833][52650] Updated weights for policy 0, policy_version 1501 (0.0025) [2024-08-05 21:37:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.9, 300 sec: 17439.2). Total num frames: 12312576. Throughput: 0: 4336.2. Samples: 3082550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:37:22,794][52567] Avg episode reward: [(0, '-3.039')] [2024-08-05 21:37:23,127][52662] DAMAGECOUNT value on done: 325.0 [2024-08-05 21:37:23,485][52794] DAMAGECOUNT value on done: 702.0 [2024-08-05 21:37:23,486][52794] Sum rewards: -3.169, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.114', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.294', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon2': '1.300', 'weapon3': '1.562', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:23,859][52669] DAMAGECOUNT value on done: 429.0 [2024-08-05 21:37:23,860][52669] Sum rewards: -1.574, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.234', 'weapon5': '0.008', 'AMMO2': '0.021', 'AMMO5': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.120', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.316', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'weapon3': '1.586', 'weapon2': '1.696', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:23,910][52658] DAMAGECOUNT value on done: 392.0 [2024-08-05 21:37:23,912][52658] Sum rewards: -1.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.018', 'AMMO2': '0.001', 'AMMO4': '0.006', 'weapon4': '0.032', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'HITCOUNT': '0.090', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.468', 'weapon3': '1.974'} [2024-08-05 21:37:24,157][52665] DAMAGECOUNT value on done: 795.0 [2024-08-05 21:37:24,158][52665] Sum rewards: -1.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.070', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'ARMOR': '0.044', 'AMMO3': '0.125', 'HITCOUNT': '0.240', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.095', 'weapon2': '1.330', 'weapon3': '2.304', 'FRAGCOUNT': '4.000'} [2024-08-05 21:37:24,182][52649] DAMAGECOUNT value on done: 319.0 [2024-08-05 21:37:24,361][52667] DAMAGECOUNT value on done: 222.0 [2024-08-05 21:37:24,782][52647] DAMAGECOUNT value on done: 364.0 [2024-08-05 21:37:24,782][52647] Sum rewards: -2.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.088', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.105', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'ARMOR': '0.177', 'weapon4': '0.244', 'DAMAGECOUNT': '0.501', 'WEAPON3': '0.650', 'weapon2': '1.468', 'weapon3': '1.484', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:24,790][52663] DAMAGECOUNT value on done: 254.0 [2024-08-05 21:37:24,791][52663] Sum rewards: -6.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO2': '0.008', 'AMMO4': '0.037', 'HITCOUNT': '0.080', 'AMMO3': '0.144', 'DAMAGECOUNT': '0.195', 'ARMOR': '0.452', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.682', 'weapon3': '1.864'} [2024-08-05 21:37:25,081][52664] DAMAGECOUNT value on done: 572.0 [2024-08-05 21:37:25,081][52664] Sum rewards: -2.497, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.454', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon7': '0.012', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.096', 'HITCOUNT': '0.110', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.254', 'DAMAGECOUNT': '0.294', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.326', 'weapon2': '1.658'} [2024-08-05 21:37:25,540][52662] DAMAGECOUNT value on done: 687.0 [2024-08-05 21:37:25,541][52662] Sum rewards: -2.717, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.994', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.016', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'AMMO3': '0.177', 'weapon4': '0.442', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.750', 'weapon3': '1.364', 'weapon2': '1.584', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:26,031][52794] DAMAGECOUNT value on done: 510.0 [2024-08-05 21:37:26,032][52794] Sum rewards: -3.054, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.360', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.180', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.900', 'weapon3': '1.312', 'weapon2': '1.662', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:26,314][52650] Updated weights for policy 0, policy_version 1511 (0.0011) [2024-08-05 21:37:26,876][52658] DAMAGECOUNT value on done: 258.0 [2024-08-05 21:37:26,877][52658] Sum rewards: -4.952, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'HITCOUNT': '0.040', 'weapon4': '0.040', 'WEAPON4': '0.100', 'ARMOR': '0.120', 'AMMO3': '0.122', 'DAMAGECOUNT': '0.132', 'WEAPON3': '0.700', 'weapon3': '0.752', 'FRAGCOUNT': '1.000', 'weapon2': '1.460'} [2024-08-05 21:37:26,932][52669] DAMAGECOUNT value on done: 762.0 [2024-08-05 21:37:26,933][52669] Sum rewards: -1.704, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon4': '0.160', 'DAMAGECOUNT': '0.408', 'ARMOR': '0.485', 'WEAPON3': '0.850', 'weapon2': '1.292', 'weapon3': '2.130', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:26,965][52665] DAMAGECOUNT value on done: 665.0 [2024-08-05 21:37:26,966][52665] Sum rewards: -3.691, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.051', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.036', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.132', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.950', 'weapon2': '1.220', 'FRAGCOUNT': '2.000', 'weapon3': '2.186'} [2024-08-05 21:37:27,025][52649] DAMAGECOUNT value on done: 615.0 [2024-08-05 21:37:27,027][52649] Sum rewards: -0.764, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.608', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.125', 'weapon4': '0.212', 'HITCOUNT': '0.220', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.990', 'weapon3': '1.642', 'weapon2': '1.794', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:27,414][52647] DAMAGECOUNT value on done: 285.0 [2024-08-05 21:37:27,540][52668] DAMAGECOUNT value on done: 362.0 [2024-08-05 21:37:27,540][52668] Sum rewards: -4.062, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.043', 'AMMO2': '0.029', 'HITCOUNT': '0.060', 'AMMO4': '0.143', 'AMMO3': '0.151', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.388', 'ARMOR': '0.589', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.354', 'weapon2': '1.772'} [2024-08-05 21:37:27,594][52663] DAMAGECOUNT value on done: 517.0 [2024-08-05 21:37:27,745][52667] DAMAGECOUNT value on done: 515.0 [2024-08-05 21:37:27,746][52667] Sum rewards: -2.476, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.260', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.850', 'ARMOR': '0.892', 'FRAGCOUNT': '1.000', 'weapon3': '1.456', 'weapon2': '1.552'} [2024-08-05 21:37:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 12402688. Throughput: 0: 4320.9. Samples: 3107770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:37:27,795][52567] Avg episode reward: [(0, '-3.087')] [2024-08-05 21:37:27,917][52664] DAMAGECOUNT value on done: 442.0 [2024-08-05 21:37:28,309][52662] DAMAGECOUNT value on done: 595.0 [2024-08-05 21:37:29,463][52669] DAMAGECOUNT value on done: 410.0 [2024-08-05 21:37:29,463][52669] Sum rewards: 0.177, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.506', 'AMMO2': '0.017', 'ARMOR': '0.072', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.133', 'weapon4': '0.192', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.750', 'weapon3': '1.592', 'weapon2': '1.666', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:29,629][52658] DAMAGECOUNT value on done: 411.0 [2024-08-05 21:37:29,655][52665] DAMAGECOUNT value on done: 678.0 [2024-08-05 21:37:29,655][52665] Sum rewards: -2.492, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.182', 'HITCOUNT': '0.220', 'ARMOR': '0.503', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.020', 'weapon3': '1.508', 'weapon2': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:29,786][52649] DAMAGECOUNT value on done: 466.0 [2024-08-05 21:37:29,786][52649] Sum rewards: -1.956, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO2': '0.004', 'AMMO4': '0.022', 'ARMOR': '0.060', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.360', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.765', 'weapon3': '1.472', 'weapon2': '1.600', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:29,891][52660] DAMAGECOUNT value on done: 520.0 [2024-08-05 21:37:30,168][52667] DAMAGECOUNT value on done: 373.0 [2024-08-05 21:37:30,420][52663] DAMAGECOUNT value on done: 788.0 [2024-08-05 21:37:30,422][52663] Sum rewards: -2.278, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.096', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.945', 'weapon3': '1.498', 'weapon2': '1.928', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:30,652][52647] DAMAGECOUNT value on done: 353.0 [2024-08-05 21:37:30,819][52668] DAMAGECOUNT value on done: 705.0 [2024-08-05 21:37:30,819][52668] Sum rewards: -0.236, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.282', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'ARMOR': '0.130', 'AMMO3': '0.132', 'weapon4': '0.184', 'HITCOUNT': '0.340', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.275', 'weapon2': '1.518', 'weapon3': '1.794', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:31,320][52650] Updated weights for policy 0, policy_version 1521 (0.0024) [2024-08-05 21:37:31,329][52664] DAMAGECOUNT value on done: 445.0 [2024-08-05 21:37:32,189][52658] DAMAGECOUNT value on done: 378.0 [2024-08-05 21:37:32,480][52669] DAMAGECOUNT value on done: 346.0 [2024-08-05 21:37:32,481][52669] Sum rewards: -0.216, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.351', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON1': '0.020', 'HITCOUNT': '0.060', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.180', 'weapon4': '0.250', 'ARMOR': '0.532', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.236', 'weapon3': '2.006'} [2024-08-05 21:37:32,560][52665] DAMAGECOUNT value on done: 420.0 [2024-08-05 21:37:32,560][52665] Sum rewards: -3.017, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.745', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.109', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.366', 'weapon3': '1.664'} [2024-08-05 21:37:32,605][52649] DAMAGECOUNT value on done: 301.0 [2024-08-05 21:37:32,606][52649] Sum rewards: -1.112, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.344', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon7': '0.046', 'HITCOUNT': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.086', 'weapon3': '1.568'} [2024-08-05 21:37:32,721][52667] DAMAGECOUNT value on done: 780.0 [2024-08-05 21:37:32,723][52667] Sum rewards: -2.222, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.938', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.158', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.170', 'weapon2': '1.634', 'weapon3': '1.712', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 12484608. Throughput: 0: 4318.2. Samples: 3120480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:37:32,794][52567] Avg episode reward: [(0, '-3.045')] [2024-08-05 21:37:32,831][52660] DAMAGECOUNT value on done: 380.0 [2024-08-05 21:37:32,831][52660] Sum rewards: -4.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.466', 'AMMO5': '0.005', 'AMMO2': '0.032', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.140', 'AMMO4': '0.161', 'weapon4': '0.316', 'DAMAGECOUNT': '0.378', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.040', 'weapon3': '1.880'} [2024-08-05 21:37:33,289][52663] DAMAGECOUNT value on done: 264.0 [2024-08-05 21:37:33,627][52647] DAMAGECOUNT value on done: 516.0 [2024-08-05 21:37:34,047][52664] DAMAGECOUNT value on done: 309.0 [2024-08-05 21:37:34,058][52668] DAMAGECOUNT value on done: 772.0 [2024-08-05 21:37:34,058][52668] Sum rewards: -2.158, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.277', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.074', 'FRAGCOUNT': '2.000', 'weapon3': '2.454'} [2024-08-05 21:37:34,126][52671] DAMAGECOUNT value on done: 304.0 [2024-08-05 21:37:34,636][52658] DAMAGECOUNT value on done: 424.0 [2024-08-05 21:37:35,164][52667] DAMAGECOUNT value on done: 569.0 [2024-08-05 21:37:35,177][52669] DAMAGECOUNT value on done: 582.0 [2024-08-05 21:37:35,179][52669] Sum rewards: -3.859, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.614', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'weapon5': '0.034', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'weapon4': '0.152', 'HITCOUNT': '0.210', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.741', 'WEAPON3': '0.750', 'weapon3': '1.466', 'weapon2': '1.758'} [2024-08-05 21:37:35,488][52659] DAMAGECOUNT value on done: 436.0 [2024-08-05 21:37:35,940][52650] Updated weights for policy 0, policy_version 1531 (0.0013) [2024-08-05 21:37:36,007][52660] DAMAGECOUNT value on done: 380.0 [2024-08-05 21:37:36,009][52660] Sum rewards: -5.009, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'HITCOUNT': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.210', 'weapon4': '0.360', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.458', 'weapon3': '1.536'} [2024-08-05 21:37:36,023][52665] DAMAGECOUNT value on done: 564.0 [2024-08-05 21:37:36,024][52665] Sum rewards: -4.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.130', 'AMMO3': '0.165', 'ARMOR': '0.180', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.950', 'weapon3': '1.622', 'weapon2': '1.948', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:36,101][52663] DAMAGECOUNT value on done: 437.0 [2024-08-05 21:37:36,102][52663] Sum rewards: 0.497, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.235', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON1': '0.040', 'HITCOUNT': '0.050', 'AMMO3': '0.080', 'DAMAGECOUNT': '0.147', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.670', 'weapon3': '1.714'} [2024-08-05 21:37:36,104][52647] DAMAGECOUNT value on done: 720.0 [2024-08-05 21:37:36,106][52647] Sum rewards: -2.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.396', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'ARMOR': '0.020', 'AMMO3': '0.125', 'HITCOUNT': '0.270', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '1.168', 'weapon3': '2.184'} [2024-08-05 21:37:36,120][52649] DAMAGECOUNT value on done: 354.0 [2024-08-05 21:37:36,742][52664] DAMAGECOUNT value on done: 775.0 [2024-08-05 21:37:36,742][52664] Sum rewards: -4.957, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.414', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.120', 'HITCOUNT': '0.210', 'ARMOR': '0.517', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '1.000', 'weapon3': '1.452', 'weapon2': '2.042'} [2024-08-05 21:37:36,809][52668] DAMAGECOUNT value on done: 150.0 [2024-08-05 21:37:37,252][52671] DAMAGECOUNT value on done: 487.0 [2024-08-05 21:37:37,253][52671] Sum rewards: -2.325, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.256', 'AMMO2': '0.027', 'ARMOR': '0.036', 'AMMO3': '0.123', 'AMMO4': '0.133', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.404', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.326', 'weapon3': '1.902', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:37,718][52658] DAMAGECOUNT value on done: 374.0 [2024-08-05 21:37:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 12574720. Throughput: 0: 4317.3. Samples: 3146550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:37:37,794][52567] Avg episode reward: [(0, '-3.187')] [2024-08-05 21:37:38,287][52669] DAMAGECOUNT value on done: 328.0 [2024-08-05 21:37:38,452][52667] DAMAGECOUNT value on done: 354.0 [2024-08-05 21:37:38,460][52659] DAMAGECOUNT value on done: 395.0 [2024-08-05 21:37:38,461][52659] Sum rewards: -1.756, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.262', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'weapon7': '0.058', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'weapon3': '1.488', 'weapon2': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:38,652][52660] DAMAGECOUNT value on done: 604.0 [2024-08-05 21:37:38,654][52660] Sum rewards: -3.139, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.047', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.120', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.526', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.750', 'weapon2': '1.156', 'weapon3': '1.520', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:38,657][52665] DAMAGECOUNT value on done: 568.0 [2024-08-05 21:37:38,721][52649] DAMAGECOUNT value on done: 753.0 [2024-08-05 21:37:38,721][52649] Sum rewards: -3.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.798', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon5': '0.024', 'AMMO4': '0.052', 'AMMO3': '0.077', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.345', 'weapon4': '0.356', 'ARMOR': '0.454', 'WEAPON3': '0.550', 'weapon3': '1.240', 'weapon2': '1.830', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:39,096][52663] DAMAGECOUNT value on done: 250.0 [2024-08-05 21:37:39,231][52647] DAMAGECOUNT value on done: 416.0 [2024-08-05 21:37:39,235][52647] Sum rewards: -2.247, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.448', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.858', 'weapon2': '1.312', 'FRAGCOUNT': '2.000', 'weapon3': '2.058'} [2024-08-05 21:37:39,554][52668] DAMAGECOUNT value on done: 299.0 [2024-08-05 21:37:39,554][52668] Sum rewards: -4.255, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.168', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'HITCOUNT': '0.060', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'DAMAGECOUNT': '0.225', 'ARMOR': '0.490', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.124', 'weapon3': '2.018'} [2024-08-05 21:37:39,867][52664] DAMAGECOUNT value on done: 369.0 [2024-08-05 21:37:39,868][52664] Sum rewards: -4.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.792', 'AMMO2': '0.002', 'AMMO4': '0.009', 'HITCOUNT': '0.130', 'AMMO3': '0.137', 'DAMAGECOUNT': '0.360', 'ARMOR': '0.461', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.754', 'weapon2': '1.826'} [2024-08-05 21:37:39,943][52671] DAMAGECOUNT value on done: 405.0 [2024-08-05 21:37:39,944][52671] Sum rewards: -3.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.586', 'AMMO2': '0.026', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.150', 'HITCOUNT': '0.150', 'weapon4': '0.168', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.614', 'weapon2': '1.790'} [2024-08-05 21:37:40,547][52650] Updated weights for policy 0, policy_version 1541 (0.0020) [2024-08-05 21:37:40,832][52658] DAMAGECOUNT value on done: 342.0 [2024-08-05 21:37:40,834][52658] Sum rewards: -3.961, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.028', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.318', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.670', 'weapon3': '1.884'} [2024-08-05 21:37:41,137][52665] DAMAGECOUNT value on done: 326.0 [2024-08-05 21:37:41,212][52649] DAMAGECOUNT value on done: 417.0 [2024-08-05 21:37:41,223][52669] DAMAGECOUNT value on done: 311.0 [2024-08-05 21:37:41,315][52659] DAMAGECOUNT value on done: 715.0 [2024-08-05 21:37:41,315][52659] Sum rewards: 1.987, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.380', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon5': '0.004', 'AMMO5': '0.010', 'weapon7': '0.034', 'ARMOR': '0.040', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.140', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.495', 'weapon2': '0.766', 'weapon3': '1.504', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:41,457][52667] DAMAGECOUNT value on done: 505.0 [2024-08-05 21:37:41,459][52667] Sum rewards: -2.699, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.786', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'HITCOUNT': '0.160', 'weapon4': '0.310', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.514', 'weapon3': '1.826'} [2024-08-05 21:37:41,720][52660] DAMAGECOUNT value on done: 580.0 [2024-08-05 21:37:41,721][52660] Sum rewards: -6.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.628', 'AMMO2': '0.007', 'AMMO4': '0.034', 'ARMOR': '0.040', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.190', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.915', 'weapon3': '1.604', 'FRAGCOUNT': '2.000', 'weapon2': '2.004'} [2024-08-05 21:37:42,018][52663] DAMAGECOUNT value on done: 493.0 [2024-08-05 21:37:42,020][52663] Sum rewards: -1.362, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.899', 'AMMO2': '0.028', 'AMMO3': '0.093', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.318', 'DAMAGECOUNT': '0.429', 'ARMOR': '0.508', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.370', 'weapon3': '1.484'} [2024-08-05 21:37:42,344][52647] DAMAGECOUNT value on done: 341.0 [2024-08-05 21:37:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 12656640. Throughput: 0: 4318.0. Samples: 3172440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:37:42,795][52567] Avg episode reward: [(0, '-3.193')] [2024-08-05 21:37:42,885][52668] DAMAGECOUNT value on done: 505.0 [2024-08-05 21:37:42,886][52668] Sum rewards: -3.679, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'HITCOUNT': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.132', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.628', 'weapon3': '1.694'} [2024-08-05 21:37:43,052][52664] DAMAGECOUNT value on done: 340.0 [2024-08-05 21:37:43,056][52664] Sum rewards: -8.819, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.314', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.017', 'ARMOR': '0.048', 'AMMO4': '0.085', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.358', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.850', 'weapon3': '1.226', 'weapon2': '1.584'} [2024-08-05 21:37:43,279][52671] DAMAGECOUNT value on done: 986.0 [2024-08-05 21:37:43,281][52671] Sum rewards: -3.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'weapon4': '0.178', 'AMMO3': '0.186', 'HITCOUNT': '0.250', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.071', 'weapon2': '1.122', 'weapon3': '2.156', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:43,330][52665] DAMAGECOUNT value on done: 613.0 [2024-08-05 21:37:43,332][52665] Sum rewards: -1.516, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'weapon7': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'ARMOR': '0.079', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.162', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.650', 'weapon3': '1.650', 'weapon2': '1.796', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:43,494][52649] DAMAGECOUNT value on done: 163.0 [2024-08-05 21:37:44,037][52658] DAMAGECOUNT value on done: 251.0 [2024-08-05 21:37:44,276][52669] DAMAGECOUNT value on done: 851.0 [2024-08-05 21:37:44,277][52669] Sum rewards: 0.181, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO2': '0.042', 'weapon4': '0.066', 'ARMOR': '0.088', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.124', 'WEAPON4': '0.150', 'AMMO4': '0.210', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.996', 'weapon3': '1.254', 'weapon2': '1.804'} [2024-08-05 21:37:44,558][52667] DAMAGECOUNT value on done: 445.0 [2024-08-05 21:37:44,560][52667] Sum rewards: -4.618, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.916', 'AMMO5': '0.003', 'weapon5': '0.004', 'ARMOR': '0.015', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.300', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.090', 'weapon3': '2.014'} [2024-08-05 21:37:44,738][52659] DAMAGECOUNT value on done: 417.0 [2024-08-05 21:37:44,739][52659] Sum rewards: -3.423, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.588', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.138', 'weapon4': '0.148', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.339', 'WEAPON3': '0.800', 'ARMOR': '0.881', 'FRAGCOUNT': '1.000', 'weapon2': '1.298', 'weapon3': '2.058'} [2024-08-05 21:37:44,947][52663] DAMAGECOUNT value on done: 177.0 [2024-08-05 21:37:44,949][52663] Sum rewards: -1.499, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.734', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.013', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'DAMAGECOUNT': '0.060', 'ARMOR': '0.068', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.120', 'weapon3': '1.142'} [2024-08-05 21:37:44,961][52660] DAMAGECOUNT value on done: 688.0 [2024-08-05 21:37:44,968][52660] Sum rewards: -0.899, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.570', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'ARMOR': '0.004', 'AMMO3': '0.145', 'HITCOUNT': '0.330', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.419', 'weapon2': '1.444', 'weapon3': '2.172', 'FRAGCOUNT': '4.000'} [2024-08-05 21:37:45,266][52650] Updated weights for policy 0, policy_version 1551 (0.0012) [2024-08-05 21:37:45,586][52647] DAMAGECOUNT value on done: 429.0 [2024-08-05 21:37:45,650][52666] DAMAGECOUNT value on done: 268.0 [2024-08-05 21:37:45,842][52668] DAMAGECOUNT value on done: 549.0 [2024-08-05 21:37:46,137][52664] DAMAGECOUNT value on done: 550.0 [2024-08-05 21:37:46,139][52664] Sum rewards: -2.647, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.040', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.126', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.800', 'weapon3': '1.556', 'weapon2': '1.584', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:46,146][52665] DAMAGECOUNT value on done: 356.0 [2024-08-05 21:37:46,416][52649] DAMAGECOUNT value on done: 306.0 [2024-08-05 21:37:46,515][52671] DAMAGECOUNT value on done: 179.0 [2024-08-05 21:37:46,812][52658] DAMAGECOUNT value on done: 558.0 [2024-08-05 21:37:46,812][52658] Sum rewards: 0.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.044', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.840', 'weapon2': '1.314', 'weapon3': '2.086', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:47,120][52669] DAMAGECOUNT value on done: 197.0 [2024-08-05 21:37:47,130][52667] DAMAGECOUNT value on done: 914.0 [2024-08-05 21:37:47,130][52667] Sum rewards: -0.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.852', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.080', 'ARMOR': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.394', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'weapon2': '1.166', 'weapon3': '1.368', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:47,586][52670] DAMAGECOUNT value on done: 433.0 [2024-08-05 21:37:47,586][52670] Sum rewards: -5.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.504', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.138', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.264', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.514', 'weapon2': '1.630'} [2024-08-05 21:37:47,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 17328.2). Total num frames: 12738560. Throughput: 0: 4319.3. Samples: 3185430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:37:47,794][52567] Avg episode reward: [(0, '-3.196')] [2024-08-05 21:37:47,988][52659] DAMAGECOUNT value on done: 447.0 [2024-08-05 21:37:48,009][52663] DAMAGECOUNT value on done: 528.0 [2024-08-05 21:37:48,010][52663] Sum rewards: -2.547, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.815', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.072', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.222', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.218', 'weapon2': '1.708'} [2024-08-05 21:37:48,034][52660] DAMAGECOUNT value on done: 385.0 [2024-08-05 21:37:48,035][52660] Sum rewards: -3.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.292', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.394', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.930', 'weapon3': '1.324', 'weapon2': '1.634', 'FRAGCOUNT': '4.000'} [2024-08-05 21:37:48,070][52647] DAMAGECOUNT value on done: 347.0 [2024-08-05 21:37:48,071][52647] Sum rewards: -3.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'AMMO2': '0.011', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.067', 'ARMOR': '0.088', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.210', 'weapon4': '0.358', 'WEAPON3': '0.450', 'weapon3': '1.116', 'weapon2': '1.660', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:48,725][52664] DAMAGECOUNT value on done: 681.0 [2024-08-05 21:37:48,726][52664] Sum rewards: -2.061, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.766', 'AMMO2': '0.015', 'AMMO5': '0.020', 'AMMO4': '0.074', 'ARMOR': '0.075', 'AMMO3': '0.112', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.933', 'FRAGCOUNT': '1.000', 'weapon2': '1.358', 'weapon3': '1.676'} [2024-08-05 21:37:49,082][52666] DAMAGECOUNT value on done: 143.0 [2024-08-05 21:37:49,223][52658] DAMAGECOUNT value on done: 587.0 [2024-08-05 21:37:49,225][52658] Sum rewards: -2.487, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.139', 'HITCOUNT': '0.160', 'HEALTH': '0.470', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon3': '1.616', 'weapon2': '1.674'} [2024-08-05 21:37:49,252][52665] DAMAGECOUNT value on done: 423.0 [2024-08-05 21:37:49,253][52665] Sum rewards: -1.104, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.858', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'weapon7': '0.056', 'HITCOUNT': '0.090', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.564', 'FRAGCOUNT': '1.000', 'weapon3': '1.374', 'weapon2': '1.690'} [2024-08-05 21:37:49,309][52668] DAMAGECOUNT value on done: 543.0 [2024-08-05 21:37:49,311][52668] Sum rewards: -4.860, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.564', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'ARMOR': '0.076', 'AMMO3': '0.154', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.570', 'WEAPON3': '1.050', 'weapon2': '1.316', 'FRAGCOUNT': '2.000', 'weapon3': '2.192'} [2024-08-05 21:37:49,503][52667] DAMAGECOUNT value on done: 576.0 [2024-08-05 21:37:49,504][52667] Sum rewards: -2.391, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.300', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'HITCOUNT': '0.110', 'AMMO3': '0.136', 'weapon4': '0.210', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.414', 'weapon3': '1.806', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:49,603][52649] DAMAGECOUNT value on done: 506.0 [2024-08-05 21:37:49,604][52649] Sum rewards: -2.424, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.916', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.160', 'weapon4': '0.228', 'ARMOR': '0.568', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.800', 'weapon2': '1.484', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:49,786][52669] DAMAGECOUNT value on done: 360.0 [2024-08-05 21:37:49,787][52669] Sum rewards: 1.593, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.034', 'HITCOUNT': '0.060', 'weapon7': '0.062', 'AMMO3': '0.084', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.264', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.306', 'weapon3': '1.638'} [2024-08-05 21:37:49,831][52671] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:37:50,262][52650] Updated weights for policy 0, policy_version 1561 (0.0044) [2024-08-05 21:37:50,580][52663] DAMAGECOUNT value on done: 399.0 [2024-08-05 21:37:50,581][52663] Sum rewards: -5.402, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.975', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'weapon4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.145', 'DAMAGECOUNT': '0.327', 'ARMOR': '0.469', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.616', 'weapon3': '1.768'} [2024-08-05 21:37:50,849][52670] DAMAGECOUNT value on done: 524.0 [2024-08-05 21:37:51,169][52647] DAMAGECOUNT value on done: 329.0 [2024-08-05 21:37:51,230][52660] DAMAGECOUNT value on done: 568.0 [2024-08-05 21:37:51,231][52660] Sum rewards: 0.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.778', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'weapon4': '0.208', 'HITCOUNT': '0.250', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.050', 'weapon3': '1.340', 'weapon2': '1.934', 'FRAGCOUNT': '4.000'} [2024-08-05 21:37:51,388][52659] DAMAGECOUNT value on done: 317.0 [2024-08-05 21:37:51,388][52659] Sum rewards: -2.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.932', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.040', 'AMMO3': '0.090', 'HITCOUNT': '0.090', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.300', 'weapon4': '0.376', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.296', 'weapon3': '1.638'} [2024-08-05 21:37:51,943][52664] DAMAGECOUNT value on done: 314.0 [2024-08-05 21:37:51,987][52658] DAMAGECOUNT value on done: 229.0 [2024-08-05 21:37:52,160][52666] DAMAGECOUNT value on done: 439.0 [2024-08-05 21:37:52,162][52666] Sum rewards: -0.696, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.030', 'AMMO3': '0.062', 'weapon7': '0.068', 'AMMO4': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.108', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.393', 'weapon4': '0.394', 'WEAPON3': '0.400', 'weapon3': '0.940', 'FRAGCOUNT': '1.000', 'weapon2': '1.654'} [2024-08-05 21:37:52,353][52667] DAMAGECOUNT value on done: 703.0 [2024-08-05 21:37:52,356][52667] Sum rewards: -2.481, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.760', 'AMMO2': '0.024', 'AMMO3': '0.091', 'AMMO4': '0.119', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.358', 'DAMAGECOUNT': '0.381', 'WEAPON3': '0.500', 'weapon3': '1.044', 'weapon2': '1.682', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:52,415][52668] DAMAGECOUNT value on done: 649.0 [2024-08-05 21:37:52,419][52668] Sum rewards: -2.028, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.159', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'HITCOUNT': '0.240', 'weapon4': '0.266', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.960', 'weapon2': '1.332', 'weapon3': '1.718', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:52,418][52669] DAMAGECOUNT value on done: 495.0 [2024-08-05 21:37:52,422][52669] Sum rewards: -4.442, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'weapon4': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.614', 'weapon2': '1.748'} [2024-08-05 21:37:52,618][52671] DAMAGECOUNT value on done: 425.0 [2024-08-05 21:37:52,619][52671] Sum rewards: -3.407, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.040', 'AMMO2': '0.011', 'ARMOR': '0.040', 'AMMO4': '0.054', 'HITCOUNT': '0.070', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.177', 'weapon4': '0.180', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.168', 'weapon3': '2.152'} [2024-08-05 21:37:52,648][52665] DAMAGECOUNT value on done: 688.0 [2024-08-05 21:37:52,648][52665] Sum rewards: -3.098, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.452', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon3': '1.296', 'weapon2': '1.356'} [2024-08-05 21:37:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17328.2). Total num frames: 12828672. Throughput: 0: 4307.6. Samples: 3211110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:37:52,794][52567] Avg episode reward: [(0, '-3.197')] [2024-08-05 21:37:52,917][52649] DAMAGECOUNT value on done: 610.0 [2024-08-05 21:37:52,917][52649] Sum rewards: -6.522, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon4': '0.150', 'HITCOUNT': '0.180', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.478', 'weapon3': '1.626'} [2024-08-05 21:37:53,192][52663] DAMAGECOUNT value on done: 361.0 [2024-08-05 21:37:54,044][52670] DAMAGECOUNT value on done: 438.0 [2024-08-05 21:37:54,045][52670] Sum rewards: -0.095, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.159', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.025', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.627', 'weapon3': '1.078', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:54,217][52659] DAMAGECOUNT value on done: 935.0 [2024-08-05 21:37:54,218][52659] Sum rewards: 4.739, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.646', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'weapon2': '1.252', 'DAMAGECOUNT': '1.695', 'weapon3': '1.842', 'FRAGCOUNT': '5.000'} [2024-08-05 21:37:54,237][52660] DAMAGECOUNT value on done: 615.0 [2024-08-05 21:37:54,430][52647] DAMAGECOUNT value on done: 497.0 [2024-08-05 21:37:54,430][52647] Sum rewards: -2.870, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.188', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.166', 'HITCOUNT': '0.170', 'weapon4': '0.180', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.900', 'weapon2': '1.316', 'weapon3': '1.772', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:54,809][52650] Updated weights for policy 0, policy_version 1571 (0.0015) [2024-08-05 21:37:55,007][52658] DAMAGECOUNT value on done: 504.0 [2024-08-05 21:37:55,010][52658] Sum rewards: -3.839, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.238', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.017', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.130', 'weapon4': '0.156', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.850', 'weapon2': '1.428', 'weapon3': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:55,050][52664] DAMAGECOUNT value on done: 510.0 [2024-08-05 21:37:55,050][52664] Sum rewards: -0.273, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.960', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'weapon7': '0.078', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.204', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.480', 'FRAGCOUNT': '1.000', 'weapon3': '1.092', 'weapon2': '1.216'} [2024-08-05 21:37:55,089][52669] DAMAGECOUNT value on done: 716.0 [2024-08-05 21:37:55,090][52669] Sum rewards: -4.223, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.309', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.165', 'weapon4': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.800', 'ARMOR': '1.374', 'weapon3': '1.374', 'FRAGCOUNT': '2.000', 'weapon2': '2.048'} [2024-08-05 21:37:55,206][52668] DAMAGECOUNT value on done: 643.0 [2024-08-05 21:37:55,234][52667] DAMAGECOUNT value on done: 547.0 [2024-08-05 21:37:55,236][52667] Sum rewards: -1.966, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.088', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.414', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.372', 'weapon3': '1.476'} [2024-08-05 21:37:55,357][52666] DAMAGECOUNT value on done: 325.0 [2024-08-05 21:37:55,359][52666] Sum rewards: -5.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.353', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.142', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.304', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.440', 'weapon3': '1.768'} [2024-08-05 21:37:55,974][52671] DAMAGECOUNT value on done: 417.0 [2024-08-05 21:37:56,020][52649] DAMAGECOUNT value on done: 450.0 [2024-08-05 21:37:56,060][52663] DAMAGECOUNT value on done: 623.0 [2024-08-05 21:37:56,060][52663] Sum rewards: -3.412, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.149', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO5': '0.020', 'AMMO4': '0.041', 'AMMO3': '0.106', 'HITCOUNT': '0.110', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.699', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.602', 'weapon2': '1.978'} [2024-08-05 21:37:57,138][52647] DAMAGECOUNT value on done: 538.0 [2024-08-05 21:37:57,138][52647] Sum rewards: -2.836, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.592', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.072', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.138', 'HITCOUNT': '0.180', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.660', 'FRAGCOUNT': '1.000', 'weapon3': '1.396', 'weapon2': '2.148'} [2024-08-05 21:37:57,199][52659] DAMAGECOUNT value on done: 487.0 [2024-08-05 21:37:57,250][52660] DAMAGECOUNT value on done: 320.0 [2024-08-05 21:37:57,252][52670] DAMAGECOUNT value on done: 315.0 [2024-08-05 21:37:57,256][52670] Sum rewards: -1.584, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.021', 'weapon4': '0.064', 'HITCOUNT': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'HEALTH': '0.218', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.478', 'weapon3': '1.622', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.9, 300 sec: 17328.2). Total num frames: 12918784. Throughput: 0: 4300.4. Samples: 3237010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:37:57,794][52567] Avg episode reward: [(0, '-3.379')] [2024-08-05 21:37:57,899][52658] DAMAGECOUNT value on done: 269.0 [2024-08-05 21:37:57,977][52664] DAMAGECOUNT value on done: 783.0 [2024-08-05 21:37:57,977][52664] Sum rewards: -4.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.158', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'weapon3': '1.292', 'DAMAGECOUNT': '1.488', 'weapon2': '1.688', 'FRAGCOUNT': '3.000'} [2024-08-05 21:37:58,064][52669] DAMAGECOUNT value on done: 438.0 [2024-08-05 21:37:58,249][52667] DAMAGECOUNT value on done: 275.0 [2024-08-05 21:37:58,514][52668] DAMAGECOUNT value on done: 249.0 [2024-08-05 21:37:58,516][52668] Sum rewards: -5.058, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.334', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'HITCOUNT': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.076', 'DAMAGECOUNT': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON3': '0.650', 'weapon2': '1.442', 'weapon3': '1.694'} [2024-08-05 21:37:58,566][52666] DAMAGECOUNT value on done: 446.0 [2024-08-05 21:37:58,570][52666] Sum rewards: -1.595, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.040', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.651', 'FRAGCOUNT': '1.000', 'weapon2': '1.344', 'weapon3': '2.018'} [2024-08-05 21:37:58,681][52663] DAMAGECOUNT value on done: 503.0 [2024-08-05 21:37:58,681][52663] Sum rewards: -0.897, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.088', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.285', 'weapon4': '0.326', 'WEAPON3': '0.550', 'ARMOR': '0.949', 'FRAGCOUNT': '1.000', 'weapon3': '1.410', 'weapon2': '1.664'} [2024-08-05 21:37:58,728][52671] DAMAGECOUNT value on done: 957.0 [2024-08-05 21:37:58,740][52671] Sum rewards: -0.946, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.060', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.057', 'AMMO3': '0.081', 'weapon4': '0.170', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.990', 'weapon3': '1.596', 'weapon2': '1.668', 'FRAGCOUNT': '2.000'} [2024-08-05 21:37:58,796][52649] DAMAGECOUNT value on done: 836.0 [2024-08-05 21:37:58,799][52649] Sum rewards: -3.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.220', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.164', 'AMMO3': '0.173', 'HITCOUNT': '0.420', 'weapon2': '0.882', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.563', 'weapon3': '2.616', 'FRAGCOUNT': '4.000'} [2024-08-05 21:37:59,813][52647] DAMAGECOUNT value on done: 583.0 [2024-08-05 21:37:59,814][52647] Sum rewards: -0.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.748', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'ARMOR': '0.136', 'HITCOUNT': '0.140', 'weapon4': '0.176', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'weapon3': '1.182', 'FRAGCOUNT': '2.000', 'weapon2': '2.240'} [2024-08-05 21:37:59,856][52650] Updated weights for policy 0, policy_version 1581 (0.0022) [2024-08-05 21:38:00,153][52659] DAMAGECOUNT value on done: 271.0 [2024-08-05 21:38:00,505][52670] DAMAGECOUNT value on done: 520.0 [2024-08-05 21:38:00,506][52670] Sum rewards: -3.443, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.180', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.020', 'AMMO3': '0.052', 'AMMO4': '0.099', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.300', 'weapon4': '0.302', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.440', 'weapon3': '1.072', 'weapon2': '2.218'} [2024-08-05 21:38:00,549][52660] DAMAGECOUNT value on done: 456.0 [2024-08-05 21:38:00,655][52664] DAMAGECOUNT value on done: 401.0 [2024-08-05 21:38:00,656][52664] Sum rewards: -5.714, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.107', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'HITCOUNT': '0.130', 'AMMO3': '0.154', 'weapon4': '0.164', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.366', 'weapon3': '1.892'} [2024-08-05 21:38:00,855][52669] DAMAGECOUNT value on done: 411.0 [2024-08-05 21:38:00,858][52669] Sum rewards: -3.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.642', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'ARMOR': '0.081', 'AMMO4': '0.105', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.244', 'DAMAGECOUNT': '0.672', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.552', 'weapon2': '1.672'} [2024-08-05 21:38:01,189][52658] DAMAGECOUNT value on done: 662.0 [2024-08-05 21:38:01,197][52658] Sum rewards: -1.736, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.128', 'AMMO2': '0.009', 'AMMO4': '0.047', 'ARMOR': '0.124', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.428', 'WEAPON3': '0.700', 'weapon2': '0.772', 'DAMAGECOUNT': '0.894', 'weapon3': '1.432', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:01,505][52667] DAMAGECOUNT value on done: 689.0 [2024-08-05 21:38:01,506][52667] Sum rewards: -4.033, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.576', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.020', 'HITCOUNT': '0.120', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.702', 'weapon3': '1.934'} [2024-08-05 21:38:01,619][52663] DAMAGECOUNT value on done: 598.0 [2024-08-05 21:38:01,620][52663] Sum rewards: -1.843, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.246', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO4': '0.053', 'ARMOR': '0.072', 'AMMO3': '0.090', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.358', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.858', 'weapon3': '1.182', 'weapon2': '1.862'} [2024-08-05 21:38:01,672][52668] DAMAGECOUNT value on done: 491.0 [2024-08-05 21:38:01,897][52671] DAMAGECOUNT value on done: 465.0 [2024-08-05 21:38:01,898][52671] Sum rewards: -5.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.062', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.855', 'WEAPON3': '1.100', 'weapon2': '1.226', 'FRAGCOUNT': '2.000', 'weapon3': '2.314'} [2024-08-05 21:38:01,921][52666] DAMAGECOUNT value on done: 251.0 [2024-08-05 21:38:02,556][52647] DAMAGECOUNT value on done: 559.0 [2024-08-05 21:38:02,556][52647] Sum rewards: -2.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO2': '0.020', 'HITCOUNT': '0.050', 'ARMOR': '0.056', 'weapon4': '0.062', 'AMMO3': '0.080', 'AMMO4': '0.101', 'DAMAGECOUNT': '0.195', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '2.170'} [2024-08-05 21:38:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17300.4). Total num frames: 13000704. Throughput: 0: 4294.9. Samples: 3249930. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:38:02,794][52567] Avg episode reward: [(0, '-3.263')] [2024-08-05 21:38:03,303][52669] DAMAGECOUNT value on done: 649.0 [2024-08-05 21:38:03,305][52669] Sum rewards: -4.369, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.862', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.186', 'DAMAGECOUNT': '0.216', 'ARMOR': '0.444', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.400', 'weapon2': '1.806'} [2024-08-05 21:38:03,361][52659] DAMAGECOUNT value on done: 494.0 [2024-08-05 21:38:03,364][52659] Sum rewards: 1.009, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.284', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.432', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.002', 'weapon3': '1.314', 'weapon2': '1.324', 'FRAGCOUNT': '4.000'} [2024-08-05 21:38:03,586][52660] DAMAGECOUNT value on done: 203.0 [2024-08-05 21:38:03,588][52660] Sum rewards: -3.745, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.354', 'AMMO2': '0.006', 'AMMO4': '0.030', 'HITCOUNT': '0.030', 'DAMAGECOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.250', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.922'} [2024-08-05 21:38:03,719][52658] DAMAGECOUNT value on done: 483.0 [2024-08-05 21:38:03,720][52658] Sum rewards: -3.993, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.440', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.356', 'weapon2': '1.824'} [2024-08-05 21:38:03,750][52664] DAMAGECOUNT value on done: 309.0 [2024-08-05 21:38:03,855][52670] DAMAGECOUNT value on done: 460.0 [2024-08-05 21:38:03,855][52670] Sum rewards: -3.745, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'ARMOR': '0.435', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.750', 'weapon3': '1.526', 'weapon2': '1.672'} [2024-08-05 21:38:04,071][52663] DAMAGECOUNT value on done: 768.0 [2024-08-05 21:38:04,072][52663] Sum rewards: -4.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.120', 'FRAGCOUNT': '0.000', 'AMMO2': '0.006', 'AMMO5': '0.017', 'AMMO4': '0.031', 'weapon5': '0.046', 'AMMO3': '0.159', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.708', 'WEAPON3': '0.750', 'weapon2': '1.358', 'weapon3': '1.680'} [2024-08-05 21:38:04,080][52667] DAMAGECOUNT value on done: 662.0 [2024-08-05 21:38:04,419][52650] Updated weights for policy 0, policy_version 1591 (0.0016) [2024-08-05 21:38:04,529][52668] DAMAGECOUNT value on done: 330.0 [2024-08-05 21:38:04,531][52668] Sum rewards: -2.490, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.630', 'AMMO2': '0.001', 'AMMO4': '0.002', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.123', 'weapon4': '0.232', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.038', 'weapon3': '2.074'} [2024-08-05 21:38:05,254][52666] DAMAGECOUNT value on done: 274.0 [2024-08-05 21:38:05,259][52666] Sum rewards: -5.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO2': '0.001', 'AMMO4': '0.005', 'ARMOR': '0.040', 'AMMO3': '0.163', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.480', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '2.164'} [2024-08-05 21:38:05,351][52671] DAMAGECOUNT value on done: 527.0 [2024-08-05 21:38:05,395][52647] DAMAGECOUNT value on done: 360.0 [2024-08-05 21:38:06,161][52669] DAMAGECOUNT value on done: 839.0 [2024-08-05 21:38:06,352][52660] DAMAGECOUNT value on done: 305.0 [2024-08-05 21:38:06,355][52660] Sum rewards: -4.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.433', 'AMMO2': '0.024', 'HITCOUNT': '0.070', 'ARMOR': '0.104', 'weapon4': '0.104', 'AMMO4': '0.117', 'AMMO3': '0.141', 'DAMAGECOUNT': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.380', 'weapon3': '2.124'} [2024-08-05 21:38:06,392][52664] DAMAGECOUNT value on done: 528.0 [2024-08-05 21:38:06,591][52659] DAMAGECOUNT value on done: 605.0 [2024-08-05 21:38:06,595][52659] Sum rewards: -4.516, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.498', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.096', 'HITCOUNT': '0.130', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.534', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.684', 'weapon3': '1.838'} [2024-08-05 21:38:06,770][52658] DAMAGECOUNT value on done: 145.0 [2024-08-05 21:38:06,950][52663] DAMAGECOUNT value on done: 267.0 [2024-08-05 21:38:06,954][52670] DAMAGECOUNT value on done: 410.0 [2024-08-05 21:38:06,954][52670] Sum rewards: -3.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.211', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon4': '0.080', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.447', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'weapon3': '1.402', 'FRAGCOUNT': '2.000', 'weapon2': '2.206'} [2024-08-05 21:38:07,079][52667] DAMAGECOUNT value on done: 606.0 [2024-08-05 21:38:07,082][52667] Sum rewards: -3.542, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.840', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.038', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'weapon4': '0.226', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.550', 'weapon2': '1.444', 'weapon3': '1.732'} [2024-08-05 21:38:07,610][52668] DAMAGECOUNT value on done: 361.0 [2024-08-05 21:38:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17300.4). Total num frames: 13090816. Throughput: 0: 4303.6. Samples: 3276210. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:38:07,794][52567] Avg episode reward: [(0, '-3.323')] [2024-08-05 21:38:08,130][52666] DAMAGECOUNT value on done: 554.0 [2024-08-05 21:38:08,130][52666] Sum rewards: -0.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.126', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'ARMOR': '0.116', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.336', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.846', 'weapon2': '1.044', 'weapon3': '1.382', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:08,292][52671] DAMAGECOUNT value on done: 1302.0 [2024-08-05 21:38:08,295][52671] Sum rewards: 1.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.322', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.143', 'HITCOUNT': '0.290', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.200', 'weapon2': '1.862', 'weapon3': '1.944', 'FRAGCOUNT': '5.000'} [2024-08-05 21:38:08,463][52647] DAMAGECOUNT value on done: 641.0 [2024-08-05 21:38:08,910][52669] DAMAGECOUNT value on done: 342.0 [2024-08-05 21:38:08,910][52669] Sum rewards: -3.702, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.493', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.008', 'weapon4': '0.010', 'weapon5': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.526', 'weapon2': '1.966'} [2024-08-05 21:38:09,279][52664] DAMAGECOUNT value on done: 458.0 [2024-08-05 21:38:09,280][52664] Sum rewards: -2.539, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.770', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'HITCOUNT': '0.160', 'AMMO3': '0.168', 'DAMAGECOUNT': '0.504', 'WEAPON3': '0.950', 'weapon3': '1.712', 'weapon2': '1.830', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:09,415][52658] DAMAGECOUNT value on done: 862.0 [2024-08-05 21:38:09,416][52658] Sum rewards: 0.875, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.512', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.016', 'ARMOR': '0.032', 'WEAPON1': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.065', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.150', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.966', 'weapon3': '1.272', 'weapon2': '1.798'} [2024-08-05 21:38:09,427][52650] Updated weights for policy 0, policy_version 1601 (0.0012) [2024-08-05 21:38:09,510][52660] DAMAGECOUNT value on done: 591.0 [2024-08-05 21:38:09,511][52660] Sum rewards: -2.761, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.575', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.160', 'HITCOUNT': '0.200', 'weapon4': '0.202', 'DAMAGECOUNT': '0.738', 'WEAPON3': '1.100', 'weapon2': '1.674', 'weapon3': '1.686', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:09,795][52659] DAMAGECOUNT value on done: 650.0 [2024-08-05 21:38:09,798][52659] Sum rewards: -4.093, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.054', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.028', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.125', 'DAMAGECOUNT': '0.180', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.552', 'weapon2': '1.822'} [2024-08-05 21:38:09,842][52667] DAMAGECOUNT value on done: 514.0 [2024-08-05 21:38:09,845][52667] Sum rewards: 0.672, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.307', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.129', 'HITCOUNT': '0.170', 'weapon4': '0.238', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.700', 'weapon2': '1.264', 'weapon3': '1.798', 'FRAGCOUNT': '4.000'} [2024-08-05 21:38:09,996][52670] DAMAGECOUNT value on done: 435.0 [2024-08-05 21:38:10,034][52663] DAMAGECOUNT value on done: 498.0 [2024-08-05 21:38:10,553][52668] DAMAGECOUNT value on done: 421.0 [2024-08-05 21:38:10,905][52647] DAMAGECOUNT value on done: 457.0 [2024-08-05 21:38:10,906][52647] Sum rewards: -6.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.684', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.014', 'ARMOR': '0.017', 'AMMO2': '0.018', 'AMMO4': '0.089', 'HITCOUNT': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.360', 'weapon2': '0.644', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.250', 'weapon3': '2.556'} [2024-08-05 21:38:11,225][52666] DAMAGECOUNT value on done: 346.0 [2024-08-05 21:38:11,227][52666] Sum rewards: -1.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.418', 'AMMO2': '0.006', 'AMMO5': '0.015', 'weapon5': '0.018', 'AMMO4': '0.032', 'HITCOUNT': '0.060', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.345', 'ARMOR': '0.481', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.640', 'weapon2': '1.692'} [2024-08-05 21:38:11,486][52671] DAMAGECOUNT value on done: 557.0 [2024-08-05 21:38:11,795][52664] DAMAGECOUNT value on done: 640.0 [2024-08-05 21:38:11,796][52664] Sum rewards: -2.472, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO2': '0.016', 'ARMOR': '0.056', 'AMMO4': '0.078', 'AMMO3': '0.144', 'weapon4': '0.222', 'HITCOUNT': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.002', 'weapon3': '1.520', 'weapon2': '1.530', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:12,116][52660] DAMAGECOUNT value on done: 340.0 [2024-08-05 21:38:12,118][52660] Sum rewards: -1.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.813', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.028', 'weapon5': '0.044', 'AMMO4': '0.080', 'AMMO3': '0.091', 'weapon4': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.576', 'weapon2': '1.524', 'weapon3': '1.576', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:12,223][52669] DAMAGECOUNT value on done: 684.0 [2024-08-05 21:38:12,226][52669] Sum rewards: -2.542, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.496', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.131', 'HITCOUNT': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.274', 'ARMOR': '0.484', 'DAMAGECOUNT': '0.672', 'WEAPON3': '0.700', 'weapon2': '1.524', 'weapon3': '1.658', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:12,547][52658] DAMAGECOUNT value on done: 447.0 [2024-08-05 21:38:12,727][52659] DAMAGECOUNT value on done: 695.0 [2024-08-05 21:38:12,729][52659] Sum rewards: -2.967, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.162', 'AMMO2': '0.007', 'weapon4': '0.012', 'ARMOR': '0.022', 'AMMO4': '0.034', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.640', 'weapon3': '1.968'} [2024-08-05 21:38:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.1, 300 sec: 17272.6). Total num frames: 13172736. Throughput: 0: 4316.2. Samples: 3302000. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 21:38:12,795][52567] Avg episode reward: [(0, '-3.221')] [2024-08-05 21:38:13,039][52663] DAMAGECOUNT value on done: 331.0 [2024-08-05 21:38:13,114][52668] DAMAGECOUNT value on done: 500.0 [2024-08-05 21:38:13,296][52670] DAMAGECOUNT value on done: 215.0 [2024-08-05 21:38:13,297][52670] Sum rewards: -0.895, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.686', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'weapon5': '0.002', 'AMMO5': '0.003', 'HITCOUNT': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon7': '0.062', 'DAMAGECOUNT': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.402', 'weapon2': '1.516'} [2024-08-05 21:38:13,710][52650] Updated weights for policy 0, policy_version 1611 (0.0019) [2024-08-05 21:38:14,141][52671] DAMAGECOUNT value on done: 586.0 [2024-08-05 21:38:14,143][52671] Sum rewards: -3.003, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.249', 'AMMO2': '0.015', 'AMMO4': '0.074', 'ARMOR': '0.088', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.448', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'weapon3': '1.340', 'weapon2': '1.546'} [2024-08-05 21:38:14,582][52666] DAMAGECOUNT value on done: 602.0 [2024-08-05 21:38:14,583][52666] Sum rewards: 0.615, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.036', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.284', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.381', 'ARMOR': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.018', 'weapon2': '1.370'} [2024-08-05 21:38:14,904][52664] DAMAGECOUNT value on done: 474.0 [2024-08-05 21:38:15,189][52660] DAMAGECOUNT value on done: 510.0 [2024-08-05 21:38:15,189][52660] Sum rewards: -4.916, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.522', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO5': '0.003', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.240', 'ARMOR': '0.478', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.801', 'weapon3': '1.694', 'weapon2': '1.864'} [2024-08-05 21:38:15,280][52659] DAMAGECOUNT value on done: 735.0 [2024-08-05 21:38:16,163][52663] DAMAGECOUNT value on done: 298.0 [2024-08-05 21:38:16,165][52663] Sum rewards: -1.376, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.634', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.076', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'HITCOUNT': '0.150', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.500', 'weapon4': '0.618', 'weapon3': '1.104', 'weapon2': '1.310', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:16,304][52668] DAMAGECOUNT value on done: 497.0 [2024-08-05 21:38:16,304][52668] Sum rewards: -2.764, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.107', 'weapon4': '0.112', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.634', 'weapon3': '1.642'} [2024-08-05 21:38:16,531][52670] DAMAGECOUNT value on done: 649.0 [2024-08-05 21:38:16,532][52670] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.594', 'AMMO2': '0.023', 'ARMOR': '0.044', 'AMMO4': '0.112', 'weapon4': '0.114', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.777', 'weapon2': '1.386', 'FRAGCOUNT': '2.000', 'weapon3': '2.078'} [2024-08-05 21:38:16,556][52671] DAMAGECOUNT value on done: 298.0 [2024-08-05 21:38:16,557][52671] Sum rewards: -2.658, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.106', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.044', 'HITCOUNT': '0.050', 'weapon5': '0.090', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.550', 'weapon3': '1.656', 'weapon2': '1.814'} [2024-08-05 21:38:17,754][52660] DAMAGECOUNT value on done: 589.0 [2024-08-05 21:38:17,755][52660] Sum rewards: -5.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.284', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon4': '0.014', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.602', 'weapon3': '1.938'} [2024-08-05 21:38:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17203.2, 300 sec: 17272.6). Total num frames: 13262848. Throughput: 0: 4318.6. Samples: 3314820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:38:17,795][52567] Avg episode reward: [(0, '-3.104')] [2024-08-05 21:38:17,870][52666] DAMAGECOUNT value on done: 530.0 [2024-08-05 21:38:17,922][52664] DAMAGECOUNT value on done: 406.0 [2024-08-05 21:38:17,922][52664] Sum rewards: -6.219, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.184', 'DAMAGECOUNT': '0.252', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.360', 'weapon3': '1.962'} [2024-08-05 21:38:18,165][52659] DAMAGECOUNT value on done: 575.0 [2024-08-05 21:38:18,167][52659] Sum rewards: -0.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.022', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.091', 'AMMO3': '0.098', 'weapon4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.780', 'weapon3': '1.504', 'weapon2': '1.870', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:18,503][52650] Updated weights for policy 0, policy_version 1621 (0.0020) [2024-08-05 21:38:18,942][52668] DAMAGECOUNT value on done: 381.0 [2024-08-05 21:38:19,460][52671] DAMAGECOUNT value on done: 427.0 [2024-08-05 21:38:19,881][52670] DAMAGECOUNT value on done: 551.0 [2024-08-05 21:38:19,881][52670] Sum rewards: -1.038, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.484', 'AMMO2': '0.000', 'AMMO4': '0.000', 'ARMOR': '0.032', 'AMMO3': '0.187', 'HITCOUNT': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.810', 'weapon2': '1.588', 'weapon3': '2.078', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:20,657][52795] DAMAGECOUNT value on done: 552.0 [2024-08-05 21:38:20,657][52795] Sum rewards: -3.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.840', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'weapon5': '0.002', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.214', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.681', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.650', 'weapon3': '1.748'} [2024-08-05 21:38:20,909][52664] DAMAGECOUNT value on done: 580.0 [2024-08-05 21:38:20,963][52660] DAMAGECOUNT value on done: 607.0 [2024-08-05 21:38:20,963][52660] Sum rewards: -5.443, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.026', 'AMMO2': '0.024', 'HITCOUNT': '0.080', 'AMMO4': '0.117', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.321', 'weapon4': '0.332', 'ARMOR': '0.516', 'FRAGCOUNT': '1.000', 'weapon2': '1.036', 'WEAPON3': '1.050', 'weapon3': '2.192'} [2024-08-05 21:38:21,005][52666] DAMAGECOUNT value on done: 435.0 [2024-08-05 21:38:21,005][52666] Sum rewards: -3.109, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon5': '0.028', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'HITCOUNT': '0.130', 'weapon4': '0.158', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.136', 'weapon2': '1.864'} [2024-08-05 21:38:21,189][52659] DAMAGECOUNT value on done: 655.0 [2024-08-05 21:38:21,891][52811] DAMAGECOUNT value on done: 617.0 [2024-08-05 21:38:21,892][52811] Sum rewards: -2.358, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.746', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.146', 'HITCOUNT': '0.190', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.801', 'ARMOR': '0.855', 'weapon2': '1.672', 'weapon3': '1.692', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:21,973][52668] DAMAGECOUNT value on done: 616.0 [2024-08-05 21:38:21,974][52668] Sum rewards: -0.883, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.306', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.010', 'AMMO4': '0.032', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'DAMAGECOUNT': '0.096', 'AMMO3': '0.106', 'ARMOR': '0.532', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.010', 'weapon3': '2.030'} [2024-08-05 21:38:22,502][52671] DAMAGECOUNT value on done: 470.0 [2024-08-05 21:38:22,503][52671] Sum rewards: -1.314, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.024', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.387', 'HEALTH': '0.424', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'weapon3': '1.436', 'FRAGCOUNT': '2.000', 'weapon2': '2.064'} [2024-08-05 21:38:22,676][52670] DAMAGECOUNT value on done: 776.0 [2024-08-05 21:38:22,677][52670] Sum rewards: -3.505, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.856', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.017', 'AMMO3': '0.130', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.296', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.356', 'weapon3': '1.880'} [2024-08-05 21:38:22,804][52567] Fps is (10 sec: 17186.6, 60 sec: 17200.4, 300 sec: 17272.0). Total num frames: 13344768. Throughput: 0: 4318.0. Samples: 3340900. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:38:22,804][52567] Avg episode reward: [(0, '-3.152')] [2024-08-05 21:38:23,102][52650] Updated weights for policy 0, policy_version 1631 (0.0012) [2024-08-05 21:38:23,666][52660] DAMAGECOUNT value on done: 580.0 [2024-08-05 21:38:23,668][52660] Sum rewards: -3.224, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.630', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.240', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.990', 'weapon2': '1.568', 'weapon3': '1.886', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:23,769][52795] DAMAGECOUNT value on done: 421.0 [2024-08-05 21:38:23,770][52795] Sum rewards: 0.075, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.608', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.070', 'AMMO3': '0.116', 'HITCOUNT': '0.170', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.651', 'weapon2': '1.532', 'weapon3': '1.606', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:24,009][52666] DAMAGECOUNT value on done: 496.0 [2024-08-05 21:38:24,012][52666] Sum rewards: -3.295, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.535', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'ARMOR': '0.088', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.162', 'AMMO3': '0.163', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.548', 'weapon3': '1.844'} [2024-08-05 21:38:24,170][52803] DAMAGECOUNT value on done: 360.0 [2024-08-05 21:38:24,171][52803] Sum rewards: -5.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO2': '0.006', 'weapon7': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.160', 'weapon4': '0.234', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.106', 'weapon3': '2.026'} [2024-08-05 21:38:24,212][52659] DAMAGECOUNT value on done: 421.0 [2024-08-05 21:38:24,975][52811] DAMAGECOUNT value on done: 217.0 [2024-08-05 21:38:24,976][52811] Sum rewards: -4.587, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.602', 'AMMO2': '0.015', 'AMMO4': '0.075', 'ARMOR': '0.077', 'AMMO3': '0.093', 'HITCOUNT': '0.100', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.330', 'weapon4': '0.420', 'WEAPON3': '0.450', 'weapon3': '0.952', 'FRAGCOUNT': '1.000', 'weapon2': '2.002'} [2024-08-05 21:38:25,102][52668] DAMAGECOUNT value on done: 354.0 [2024-08-05 21:38:25,267][52671] DAMAGECOUNT value on done: 1130.0 [2024-08-05 21:38:25,268][52671] Sum rewards: -0.417, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.538', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.800', 'ARMOR': '0.816', 'DAMAGECOUNT': '0.930', 'weapon3': '1.702', 'weapon2': '1.884', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:25,906][52670] DAMAGECOUNT value on done: 409.0 [2024-08-05 21:38:26,625][52659] DAMAGECOUNT value on done: 602.0 [2024-08-05 21:38:26,627][52659] Sum rewards: -5.170, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.303', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.072', 'AMMO4': '0.084', 'HITCOUNT': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.096', 'weapon2': '1.810'} [2024-08-05 21:38:26,920][52795] DAMAGECOUNT value on done: 499.0 [2024-08-05 21:38:26,923][52795] Sum rewards: -1.074, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.565', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.049', 'AMMO3': '0.080', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.240', 'weapon4': '0.324', 'WEAPON3': '0.400', 'weapon3': '1.396', 'weapon2': '1.472', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:27,253][52803] DAMAGECOUNT value on done: 436.0 [2024-08-05 21:38:27,254][52803] Sum rewards: -4.661, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.840', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon5': '0.008', 'AMMO5': '0.017', 'HITCOUNT': '0.030', 'ARMOR': '0.044', 'AMMO3': '0.093', 'DAMAGECOUNT': '0.105', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon3': '1.434', 'weapon2': '1.946'} [2024-08-05 21:38:27,316][52660] DAMAGECOUNT value on done: 410.0 [2024-08-05 21:38:27,318][52660] Sum rewards: 1.185, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.286', 'ARMOR': '0.004', 'AMMO2': '0.020', 'HITCOUNT': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'weapon7': '0.136', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.330', 'weapon4': '0.488', 'WEAPON3': '0.550', 'weapon2': '1.238', 'weapon3': '1.264', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:27,408][52666] DAMAGECOUNT value on done: 717.0 [2024-08-05 21:38:27,410][52666] Sum rewards: -5.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'AMMO2': '0.034', 'HITCOUNT': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.360', 'DAMAGECOUNT': '0.453', 'ARMOR': '0.481', 'WEAPON3': '0.650', 'weapon3': '1.270', 'weapon2': '1.864', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17300.5). Total num frames: 13434880. Throughput: 0: 4328.6. Samples: 3367230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:38:27,795][52567] Avg episode reward: [(0, '-3.017')] [2024-08-05 21:38:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001640_13434880.pth... [2024-08-05 21:38:27,835][52671] DAMAGECOUNT value on done: 419.0 [2024-08-05 21:38:27,966][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001136_9306112.pth [2024-08-05 21:38:28,082][52650] Updated weights for policy 0, policy_version 1641 (0.0025) [2024-08-05 21:38:28,391][52811] DAMAGECOUNT value on done: 803.0 [2024-08-05 21:38:28,392][52811] Sum rewards: -0.831, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.730', 'ARMOR': '0.012', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.014', 'weapon2': '1.668', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:29,360][52670] DAMAGECOUNT value on done: 539.0 [2024-08-05 21:38:29,366][52670] Sum rewards: -4.034, reward structure: {'DEATHCOUNT': '-10.500', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'HITCOUNT': '0.060', 'AMMO4': '0.075', 'AMMO3': '0.122', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.600', 'HEALTH': '0.696', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '2.094'} [2024-08-05 21:38:29,452][52659] DAMAGECOUNT value on done: 561.0 [2024-08-05 21:38:30,388][52795] DAMAGECOUNT value on done: 569.0 [2024-08-05 21:38:30,388][52795] Sum rewards: -5.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.702', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.206', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.747', 'WEAPON3': '1.300', 'weapon2': '1.718', 'weapon3': '1.806', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:30,502][52803] DAMAGECOUNT value on done: 301.0 [2024-08-05 21:38:30,696][52666] DAMAGECOUNT value on done: 554.0 [2024-08-05 21:38:30,697][52666] Sum rewards: -1.135, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO3': '0.100', 'ARMOR': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.700', 'weapon2': '1.538', 'weapon3': '1.736', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:30,896][52671] DAMAGECOUNT value on done: 498.0 [2024-08-05 21:38:31,672][52811] DAMAGECOUNT value on done: 570.0 [2024-08-05 21:38:31,674][52811] Sum rewards: -1.697, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.314', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.390', 'weapon4': '0.420', 'ARMOR': '0.473', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.084', 'weapon3': '1.702'} [2024-08-05 21:38:32,590][52650] Updated weights for policy 0, policy_version 1651 (0.0029) [2024-08-05 21:38:32,608][52659] DAMAGECOUNT value on done: 602.0 [2024-08-05 21:38:32,664][52670] DAMAGECOUNT value on done: 517.0 [2024-08-05 21:38:32,666][52670] Sum rewards: -0.652, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.058', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.230', 'HITCOUNT': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.179', 'weapon2': '1.440', 'weapon3': '1.758', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:32,794][52567] Fps is (10 sec: 18039.9, 60 sec: 17339.7, 300 sec: 17272.6). Total num frames: 13524992. Throughput: 0: 4320.2. Samples: 3379840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:38:32,795][52567] Avg episode reward: [(0, '-3.085')] [2024-08-05 21:38:33,323][52820] DAMAGECOUNT value on done: 327.0 [2024-08-05 21:38:33,326][52820] Sum rewards: -3.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon4': '0.048', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.070', 'ARMOR': '0.077', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.332', 'weapon2': '1.566'} [2024-08-05 21:38:33,590][52795] DAMAGECOUNT value on done: 517.0 [2024-08-05 21:38:33,590][52795] Sum rewards: 0.022, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.428', 'AMMO2': '0.002', 'AMMO4': '0.010', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.076', 'DAMAGECOUNT': '0.117', 'WEAPON3': '0.300', 'ARMOR': '0.580', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'weapon2': '1.096'} [2024-08-05 21:38:33,686][52803] DAMAGECOUNT value on done: 560.0 [2024-08-05 21:38:33,688][52803] Sum rewards: -6.737, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.750', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.064', 'HITCOUNT': '0.110', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.200', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.950', 'weapon2': '1.560', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:33,759][52666] DAMAGECOUNT value on done: 295.0 [2024-08-05 21:38:33,759][52666] Sum rewards: -0.339, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.084', 'DAMAGECOUNT': '0.087', 'HEALTH': '0.146', 'weapon4': '0.148', 'WEAPON3': '0.500', 'ARMOR': '0.910', 'FRAGCOUNT': '1.000', 'weapon3': '1.584', 'weapon2': '1.762'} [2024-08-05 21:38:34,772][52811] DAMAGECOUNT value on done: 721.0 [2024-08-05 21:38:34,776][52811] Sum rewards: -3.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.686', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'ARMOR': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.219', 'HITCOUNT': '0.230', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.113', 'weapon2': '1.644', 'weapon3': '1.938', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:35,477][52670] DAMAGECOUNT value on done: 313.0 [2024-08-05 21:38:36,528][52820] DAMAGECOUNT value on done: 682.0 [2024-08-05 21:38:36,529][52820] Sum rewards: -1.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.582', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.090', 'ARMOR': '0.104', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.630', 'weapon3': '0.964', 'weapon2': '2.114', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:36,665][52666] DAMAGECOUNT value on done: 429.0 [2024-08-05 21:38:36,667][52666] Sum rewards: -2.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.937', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.018', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.130', 'weapon4': '0.168', 'DAMAGECOUNT': '0.351', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.416', 'weapon3': '2.032'} [2024-08-05 21:38:36,752][52803] DAMAGECOUNT value on done: 284.0 [2024-08-05 21:38:36,753][52803] Sum rewards: -10.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.734', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'weapon4': '0.074', 'ARMOR': '0.088', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.225', 'DAMAGECOUNT': '0.342', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'weapon3': '1.714', 'weapon2': '1.904'} [2024-08-05 21:38:36,904][52795] DAMAGECOUNT value on done: 455.0 [2024-08-05 21:38:36,905][52795] Sum rewards: -5.785, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.380', 'AMMO4': '-0.092', 'AMMO2': '-0.018', 'AMMO5': '0.010', 'ARMOR': '0.038', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.544', 'weapon2': '1.746'} [2024-08-05 21:38:37,365][52650] Updated weights for policy 0, policy_version 1661 (0.0014) [2024-08-05 21:38:37,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17203.2, 300 sec: 17244.9). Total num frames: 13606912. Throughput: 0: 4333.3. Samples: 3406110. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 21:38:37,794][52567] Avg episode reward: [(0, '-3.159')] [2024-08-05 21:38:37,972][52811] DAMAGECOUNT value on done: 552.0 [2024-08-05 21:38:38,486][52670] DAMAGECOUNT value on done: 599.0 [2024-08-05 21:38:38,494][52670] Sum rewards: -0.476, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.800', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON5': '0.050', 'AMMO3': '0.143', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.897', 'WEAPON3': '0.950', 'weapon2': '1.468', 'weapon3': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 21:38:39,571][52820] DAMAGECOUNT value on done: 305.0 [2024-08-05 21:38:39,635][52666] DAMAGECOUNT value on done: 470.0 [2024-08-05 21:38:39,635][52666] Sum rewards: -2.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.040', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.408', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'weapon2': '1.514'} [2024-08-05 21:38:39,799][52803] DAMAGECOUNT value on done: 360.0 [2024-08-05 21:38:39,800][52803] Sum rewards: -0.351, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'HITCOUNT': '0.080', 'ARMOR': '0.081', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.346', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.700', 'weapon2': '0.898', 'weapon3': '1.414', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:40,052][52795] DAMAGECOUNT value on done: 550.0 [2024-08-05 21:38:40,055][52795] Sum rewards: -3.092, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.388', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.144', 'weapon4': '0.160', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.930', 'weapon2': '1.372', 'weapon3': '2.030', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:41,245][52811] DAMAGECOUNT value on done: 445.0 [2024-08-05 21:38:41,389][52670] DAMAGECOUNT value on done: 597.0 [2024-08-05 21:38:41,389][52670] Sum rewards: 0.911, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.184', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.072', 'weapon4': '0.128', 'HITCOUNT': '0.130', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.552', 'FRAGCOUNT': '1.000', 'weapon2': '1.288', 'weapon3': '1.742'} [2024-08-05 21:38:42,142][52650] Updated weights for policy 0, policy_version 1671 (0.0024) [2024-08-05 21:38:42,405][52666] DAMAGECOUNT value on done: 964.0 [2024-08-05 21:38:42,406][52666] Sum rewards: 2.187, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'weapon4': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'weapon2': '1.344', 'DAMAGECOUNT': '1.572', 'weapon3': '2.010', 'FRAGCOUNT': '5.000'} [2024-08-05 21:38:42,718][52820] DAMAGECOUNT value on done: 541.0 [2024-08-05 21:38:42,720][52820] Sum rewards: -0.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.026', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'HITCOUNT': '0.220', 'ARMOR': '0.576', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.900', 'weapon3': '1.354', 'weapon2': '1.800', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17272.6). Total num frames: 13697024. Throughput: 0: 4334.0. Samples: 3432040. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:38:42,795][52567] Avg episode reward: [(0, '-2.909')] [2024-08-05 21:38:42,795][52614] Saving new best policy, reward=-2.909! [2024-08-05 21:38:42,998][52803] DAMAGECOUNT value on done: 490.0 [2024-08-05 21:38:42,998][52803] Sum rewards: -3.255, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.270', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'weapon5': '0.090', 'HITCOUNT': '0.160', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.540', 'weapon2': '1.442', 'weapon3': '1.524'} [2024-08-05 21:38:43,831][52795] DAMAGECOUNT value on done: 774.0 [2024-08-05 21:38:43,834][52795] Sum rewards: -4.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'AMMO5': '0.008', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.109', 'HITCOUNT': '0.150', 'AMMO3': '0.167', 'weapon4': '0.270', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.500', 'weapon2': '1.506', 'weapon3': '1.730'} [2024-08-05 21:38:44,483][52670] DAMAGECOUNT value on done: 639.0 [2024-08-05 21:38:44,484][52670] Sum rewards: 0.675, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.399', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.230', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.858', 'weapon3': '1.762', 'weapon2': '1.766', 'FRAGCOUNT': '4.000'} [2024-08-05 21:38:44,871][52811] DAMAGECOUNT value on done: 228.0 [2024-08-05 21:38:44,871][52811] Sum rewards: -1.309, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.148', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.020', 'HITCOUNT': '0.080', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.294', 'ARMOR': '0.483', 'WEAPON3': '0.550', 'weapon3': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.636'} [2024-08-05 21:38:45,639][52666] DAMAGECOUNT value on done: 599.0 [2024-08-05 21:38:45,639][52666] Sum rewards: -2.684, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.380', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'HITCOUNT': '0.070', 'AMMO3': '0.121', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.642', 'weapon3': '2.060'} [2024-08-05 21:38:45,924][52820] DAMAGECOUNT value on done: 423.0 [2024-08-05 21:38:45,926][52820] Sum rewards: -1.197, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.616', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.110', 'ARMOR': '0.116', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.378', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.550', 'weapon3': '1.140', 'weapon2': '1.888', 'FRAGCOUNT': '3.000'} [2024-08-05 21:38:46,330][52803] DAMAGECOUNT value on done: 576.0 [2024-08-05 21:38:46,331][52803] Sum rewards: -6.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'weapon4': '0.096', 'HITCOUNT': '0.150', 'AMMO3': '0.153', 'DAMAGECOUNT': '0.459', 'ARMOR': '0.856', 'WEAPON3': '0.950', 'weapon2': '1.584', 'weapon3': '1.774', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:47,044][52795] DAMAGECOUNT value on done: 399.0 [2024-08-05 21:38:47,136][52650] Updated weights for policy 0, policy_version 1681 (0.0022) [2024-08-05 21:38:47,747][52670] DAMAGECOUNT value on done: 591.0 [2024-08-05 21:38:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17272.6). Total num frames: 13787136. Throughput: 0: 4331.8. Samples: 3444860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:38:47,794][52567] Avg episode reward: [(0, '-2.848')] [2024-08-05 21:38:47,797][52614] Saving new best policy, reward=-2.848! [2024-08-05 21:38:48,062][52811] DAMAGECOUNT value on done: 338.0 [2024-08-05 21:38:49,071][52820] DAMAGECOUNT value on done: 334.0 [2024-08-05 21:38:49,779][52803] DAMAGECOUNT value on done: 547.0 [2024-08-05 21:38:49,779][52803] Sum rewards: -7.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.994', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'HITCOUNT': '0.080', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon4': '0.250', 'DAMAGECOUNT': '0.387', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.534', 'weapon3': '1.694'} [2024-08-05 21:38:50,167][52795] DAMAGECOUNT value on done: 630.0 [2024-08-05 21:38:50,169][52795] Sum rewards: -0.481, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.117', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.488', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.960', 'weapon2': '1.244', 'weapon3': '1.316', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:51,294][52811] DAMAGECOUNT value on done: 435.0 [2024-08-05 21:38:51,294][52811] Sum rewards: -1.672, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.766', 'weapon5': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.037', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'weapon4': '0.228', 'DAMAGECOUNT': '0.300', 'ARMOR': '0.531', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.612', 'weapon2': '1.708'} [2024-08-05 21:38:51,722][52650] Updated weights for policy 0, policy_version 1691 (0.0016) [2024-08-05 21:38:52,402][52820] DAMAGECOUNT value on done: 382.0 [2024-08-05 21:38:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17203.2, 300 sec: 17244.9). Total num frames: 13860864. Throughput: 0: 4322.7. Samples: 3470730. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:38:52,794][52567] Avg episode reward: [(0, '-3.017')] [2024-08-05 21:38:52,951][52803] DAMAGECOUNT value on done: 408.0 [2024-08-05 21:38:53,203][52795] DAMAGECOUNT value on done: 268.0 [2024-08-05 21:38:53,214][52795] Sum rewards: -4.424, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.744', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'HITCOUNT': '0.130', 'AMMO3': '0.140', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.338', 'weapon3': '2.056'} [2024-08-05 21:38:54,353][52811] DAMAGECOUNT value on done: 368.0 [2024-08-05 21:38:55,615][52820] DAMAGECOUNT value on done: 467.0 [2024-08-05 21:38:55,615][52820] Sum rewards: -3.360, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.683', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'weapon5': '0.008', 'AMMO4': '0.008', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.088', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon4': '0.166', 'DAMAGECOUNT': '0.381', 'WEAPON3': '0.650', 'weapon2': '1.360', 'weapon3': '1.512'} [2024-08-05 21:38:56,230][52803] DAMAGECOUNT value on done: 383.0 [2024-08-05 21:38:56,230][52803] Sum rewards: -1.404, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.792', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.276', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.650', 'weapon2': '1.108', 'weapon3': '1.914', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:56,330][52650] Updated weights for policy 0, policy_version 1701 (0.0013) [2024-08-05 21:38:56,434][52795] DAMAGECOUNT value on done: 666.0 [2024-08-05 21:38:56,436][52795] Sum rewards: -5.214, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.218', 'AMMO5': '0.008', 'weapon5': '0.016', 'AMMO2': '0.022', 'ARMOR': '0.056', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'weapon3': '1.254', 'weapon2': '2.336'} [2024-08-05 21:38:57,544][52811] DAMAGECOUNT value on done: 725.0 [2024-08-05 21:38:57,545][52811] Sum rewards: -3.924, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.732', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.210', 'weapon4': '0.278', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.430', 'weapon2': '1.494'} [2024-08-05 21:38:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17244.9). Total num frames: 13959168. Throughput: 0: 4330.5. Samples: 3496870. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:38:57,794][52567] Avg episode reward: [(0, '-3.023')] [2024-08-05 21:38:58,906][52820] DAMAGECOUNT value on done: 517.0 [2024-08-05 21:38:58,908][52820] Sum rewards: -1.667, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.775', 'AMMO2': '0.017', 'weapon7': '0.072', 'AMMO4': '0.085', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.332', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.700', 'weapon2': '1.362', 'weapon3': '1.838', 'FRAGCOUNT': '2.000'} [2024-08-05 21:38:59,354][52803] DAMAGECOUNT value on done: 544.0 [2024-08-05 21:38:59,710][52795] DAMAGECOUNT value on done: 384.0 [2024-08-05 21:38:59,710][52795] Sum rewards: -5.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.760', 'AMMO2': '0.018', 'ARMOR': '0.052', 'AMMO4': '0.090', 'AMMO3': '0.130', 'HITCOUNT': '0.160', 'weapon4': '0.186', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'FRAGCOUNT': '1.000', 'weapon2': '1.652', 'weapon3': '1.792'} [2024-08-05 21:39:00,628][52811] DAMAGECOUNT value on done: 369.0 [2024-08-05 21:39:00,629][52811] Sum rewards: -3.253, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.940', 'AMMO2': '0.020', 'ARMOR': '0.036', 'HITCOUNT': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.123', 'DAMAGECOUNT': '0.279', 'WEAPON4': '0.350', 'weapon4': '0.696', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.356', 'weapon3': '1.440'} [2024-08-05 21:39:01,240][52650] Updated weights for policy 0, policy_version 1711 (0.0032) [2024-08-05 21:39:02,141][52820] DAMAGECOUNT value on done: 702.0 [2024-08-05 21:39:02,142][52820] Sum rewards: -1.292, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.654', 'AMMO2': '0.004', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.120', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.566', 'weapon2': '1.808'} [2024-08-05 21:39:02,528][52803] DAMAGECOUNT value on done: 508.0 [2024-08-05 21:39:02,531][52803] Sum rewards: -3.566, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.028', 'HEALTH': '0.070', 'AMMO3': '0.112', 'HITCOUNT': '0.120', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'weapon4': '0.218', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.556', 'weapon3': '1.884'} [2024-08-05 21:39:02,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17476.2, 300 sec: 17244.9). Total num frames: 14049280. Throughput: 0: 4332.7. Samples: 3509790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:39:02,794][52567] Avg episode reward: [(0, '-3.040')] [2024-08-05 21:39:02,989][52795] DAMAGECOUNT value on done: 631.0 [2024-08-05 21:39:03,830][52811] DAMAGECOUNT value on done: 471.0 [2024-08-05 21:39:03,836][52811] Sum rewards: 0.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.712', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.678', 'WEAPON3': '0.850', 'weapon2': '1.178', 'weapon3': '2.144', 'FRAGCOUNT': '3.000'} [2024-08-05 21:39:05,359][52820] DAMAGECOUNT value on done: 667.0 [2024-08-05 21:39:05,359][52820] Sum rewards: -0.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.492', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.032', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'HITCOUNT': '0.110', 'weapon4': '0.214', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.741', 'weapon3': '1.498', 'weapon2': '1.660', 'FRAGCOUNT': '2.000'} [2024-08-05 21:39:05,735][52650] Updated weights for policy 0, policy_version 1721 (0.0019) [2024-08-05 21:39:05,877][52803] DAMAGECOUNT value on done: 317.0 [2024-08-05 21:39:05,878][52803] Sum rewards: -8.034, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.338', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.072', 'HITCOUNT': '0.080', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.207', 'weapon4': '0.310', 'ARMOR': '0.489', 'WEAPON3': '0.850', 'weapon3': '1.518', 'weapon2': '1.544'} [2024-08-05 21:39:06,044][52795] DAMAGECOUNT value on done: 344.0 [2024-08-05 21:39:07,051][52811] DAMAGECOUNT value on done: 571.0 [2024-08-05 21:39:07,051][52811] Sum rewards: -3.522, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.764', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.472', 'weapon3': '1.808'} [2024-08-05 21:39:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17217.1). Total num frames: 14131200. Throughput: 0: 4342.9. Samples: 3536290. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:39:07,794][52567] Avg episode reward: [(0, '-3.114')] [2024-08-05 21:39:08,461][52820] DAMAGECOUNT value on done: 576.0 [2024-08-05 21:39:08,465][52820] Sum rewards: -2.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.850', 'AMMO2': '0.003', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.013', 'AMMO3': '0.140', 'HITCOUNT': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.268', 'ARMOR': '0.534', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.900', 'weapon2': '1.364', 'weapon3': '1.884', 'FRAGCOUNT': '3.000'} [2024-08-05 21:39:09,124][52795] DAMAGECOUNT value on done: 396.0 [2024-08-05 21:39:09,278][52803] DAMAGECOUNT value on done: 254.0 [2024-08-05 21:39:09,281][52803] Sum rewards: -3.493, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.229', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'HITCOUNT': '0.080', 'AMMO4': '0.086', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.288', 'ARMOR': '0.494', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.634', 'weapon3': '1.676'} [2024-08-05 21:39:10,146][52811] DAMAGECOUNT value on done: 922.0 [2024-08-05 21:39:10,148][52811] Sum rewards: -0.519, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.507', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.160', 'weapon4': '0.204', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.672', 'FRAGCOUNT': '1.000', 'weapon2': '1.472', 'weapon3': '1.720'} [2024-08-05 21:39:10,583][52650] Updated weights for policy 0, policy_version 1731 (0.0040) [2024-08-05 21:39:11,862][52820] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:39:12,121][52614] Signal inference workers to stop experience collection... (300 times) [2024-08-05 21:39:12,122][52614] Signal inference workers to resume experience collection... (300 times) [2024-08-05 21:39:12,168][52650] InferenceWorker_p0-w0: stopping experience collection (300 times) [2024-08-05 21:39:12,174][52650] InferenceWorker_p0-w0: resuming experience collection (300 times) [2024-08-05 21:39:12,332][52795] DAMAGECOUNT value on done: 642.0 [2024-08-05 21:39:12,336][52795] Sum rewards: -0.506, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.412', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'ARMOR': '0.132', 'HITCOUNT': '0.190', 'weapon4': '0.234', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.897', 'weapon2': '1.396', 'weapon3': '1.864', 'FRAGCOUNT': '2.000'} [2024-08-05 21:39:12,392][52803] DAMAGECOUNT value on done: 400.0 [2024-08-05 21:39:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17217.1). Total num frames: 14213120. Throughput: 0: 4335.6. Samples: 3562330. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:39:12,795][52567] Avg episode reward: [(0, '-3.179')] [2024-08-05 21:39:13,318][52811] DAMAGECOUNT value on done: 428.0 [2024-08-05 21:39:13,318][52811] Sum rewards: -0.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.303', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.103', 'HITCOUNT': '0.150', 'weapon4': '0.242', 'WEAPON3': '0.400', 'ARMOR': '0.449', 'DAMAGECOUNT': '0.456', 'weapon3': '1.062', 'weapon2': '1.904', 'FRAGCOUNT': '2.000'} [2024-08-05 21:39:14,950][52820] DAMAGECOUNT value on done: 368.0 [2024-08-05 21:39:14,953][52820] Sum rewards: -5.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.864', 'AMMO2': '0.044', 'AMMO3': '0.136', 'HITCOUNT': '0.160', 'weapon4': '0.200', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.492', 'ARMOR': '0.547', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.496', 'weapon3': '2.014'} [2024-08-05 21:39:15,077][52650] Updated weights for policy 0, policy_version 1741 (0.0026) [2024-08-05 21:39:15,474][52803] DAMAGECOUNT value on done: 530.0 [2024-08-05 21:39:15,504][52795] DAMAGECOUNT value on done: 518.0 [2024-08-05 21:39:16,511][52811] DAMAGECOUNT value on done: 321.0 [2024-08-05 21:39:17,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17339.7, 300 sec: 17244.8). Total num frames: 14303232. Throughput: 0: 4342.6. Samples: 3575260. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:39:17,796][52567] Avg episode reward: [(0, '-3.162')] [2024-08-05 21:39:18,267][52820] DAMAGECOUNT value on done: 635.0 [2024-08-05 21:39:18,535][52803] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:39:18,537][52803] Sum rewards: -3.760, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.982', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.028', 'HITCOUNT': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.130', 'AMMO3': '0.131', 'weapon4': '0.166', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.422', 'weapon3': '1.842'} [2024-08-05 21:39:18,776][52795] DAMAGECOUNT value on done: 290.0 [2024-08-05 21:39:19,725][52811] DAMAGECOUNT value on done: 639.0 [2024-08-05 21:39:19,727][52811] Sum rewards: -3.158, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.465', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.137', 'HITCOUNT': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon2': '1.690', 'weapon3': '1.884'} [2024-08-05 21:39:19,768][52650] Updated weights for policy 0, policy_version 1751 (0.0011) [2024-08-05 21:39:21,393][52820] DAMAGECOUNT value on done: 536.0 [2024-08-05 21:39:21,393][52820] Sum rewards: -0.257, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.722', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'weapon4': '0.146', 'HITCOUNT': '0.180', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.708', 'weapon3': '1.476', 'weapon2': '1.500', 'FRAGCOUNT': '2.000'} [2024-08-05 21:39:21,573][52794] DAMAGECOUNT value on done: 487.0 [2024-08-05 21:39:21,573][52794] Sum rewards: -3.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.984', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.025', 'ARMOR': '0.092', 'AMMO3': '0.095', 'HITCOUNT': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.274', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.166', 'weapon2': '1.790'} [2024-08-05 21:39:21,608][52803] DAMAGECOUNT value on done: 580.0 [2024-08-05 21:39:21,612][52803] Sum rewards: 1.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.111', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.975', 'weapon2': '1.628', 'weapon3': '1.678', 'FRAGCOUNT': '3.000'} [2024-08-05 21:39:21,993][52795] DAMAGECOUNT value on done: 693.0 [2024-08-05 21:39:21,993][52795] Sum rewards: 0.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.455', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.076', 'HITCOUNT': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.564', 'weapon2': '1.204', 'FRAGCOUNT': '1.500', 'weapon3': '1.648'} [2024-08-05 21:39:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17479.1, 300 sec: 17244.9). Total num frames: 14393344. Throughput: 0: 4344.2. Samples: 3601600. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:39:22,794][52567] Avg episode reward: [(0, '-3.161')] [2024-08-05 21:39:22,801][52811] DAMAGECOUNT value on done: 235.0 [2024-08-05 21:39:22,802][52811] Sum rewards: -0.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.262', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.230', 'weapon2': '1.482'} [2024-08-05 21:39:24,037][52794] DAMAGECOUNT value on done: 575.0 [2024-08-05 21:39:24,041][52794] Sum rewards: -2.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'AMMO3': '0.143', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.756', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.656', 'weapon2': '1.772'} [2024-08-05 21:39:24,361][52662] DAMAGECOUNT value on done: 558.0 [2024-08-05 21:39:24,665][52650] Updated weights for policy 0, policy_version 1761 (0.0034) [2024-08-05 21:39:24,678][52820] DAMAGECOUNT value on done: 676.0 [2024-08-05 21:39:24,682][52820] Sum rewards: -0.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.091', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.440', 'ARMOR': '0.503', 'WEAPON3': '0.600', 'weapon3': '0.922', 'DAMAGECOUNT': '1.086', 'weapon2': '1.542', 'FRAGCOUNT': '3.000'} [2024-08-05 21:39:24,707][52803] DAMAGECOUNT value on done: 771.0 [2024-08-05 21:39:24,710][52803] Sum rewards: -6.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.032', 'HITCOUNT': '0.070', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.321', 'weapon4': '0.486', 'WEAPON3': '0.650', 'weapon2': '1.318', 'weapon3': '1.608'} [2024-08-05 21:39:26,642][52794] DAMAGECOUNT value on done: 775.0 [2024-08-05 21:39:26,650][52794] Sum rewards: -1.001, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.943', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.061', 'AMMO3': '0.080', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.330', 'weapon4': '0.356', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.126', 'weapon3': '1.410'} [2024-08-05 21:39:27,146][52662] DAMAGECOUNT value on done: 867.0 [2024-08-05 21:39:27,146][52662] Sum rewards: -3.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.818', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'weapon5': '0.008', 'AMMO5': '0.020', 'ARMOR': '0.036', 'AMMO3': '0.165', 'HITCOUNT': '0.230', 'WEAPON5': '0.250', 'DAMAGECOUNT': '1.065', 'WEAPON3': '1.100', 'weapon2': '1.176', 'FRAGCOUNT': '2.000', 'weapon3': '2.392'} [2024-08-05 21:39:27,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17476.3, 300 sec: 17244.9). Total num frames: 14483456. Throughput: 0: 4348.0. Samples: 3627700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:39:27,794][52567] Avg episode reward: [(0, '-3.173')] [2024-08-05 21:39:27,842][52820] DAMAGECOUNT value on done: 471.0 [2024-08-05 21:39:27,846][52820] Sum rewards: -3.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.830', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.016', 'weapon7': '0.058', 'weapon5': '0.070', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.288', 'DAMAGECOUNT': '0.453', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.240', 'weapon3': '1.686'} [2024-08-05 21:39:29,077][52794] DAMAGECOUNT value on done: 514.0 [2024-08-05 21:39:29,171][52650] Updated weights for policy 0, policy_version 1771 (0.0013) [2024-08-05 21:39:29,448][52662] DAMAGECOUNT value on done: 523.0 [2024-08-05 21:39:29,448][52662] Sum rewards: -4.562, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.006', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.015', 'weapon5': '0.022', 'AMMO4': '0.026', 'HITCOUNT': '0.120', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.610', 'weapon2': '1.938'} [2024-08-05 21:39:31,008][52820] DAMAGECOUNT value on done: 604.0 [2024-08-05 21:39:31,350][52794] DAMAGECOUNT value on done: 425.0 [2024-08-05 21:39:31,350][52794] Sum rewards: -1.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.653', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.230', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.370', 'weapon3': '1.768'} [2024-08-05 21:39:31,777][52662] DAMAGECOUNT value on done: 563.0 [2024-08-05 21:39:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17203.2, 300 sec: 17189.3). Total num frames: 14557184. Throughput: 0: 4353.3. Samples: 3640760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:39:32,794][52567] Avg episode reward: [(0, '-3.227')] [2024-08-05 21:39:33,640][52794] DAMAGECOUNT value on done: 746.0 [2024-08-05 21:39:33,919][52650] Updated weights for policy 0, policy_version 1781 (0.0042) [2024-08-05 21:39:34,103][52820] DAMAGECOUNT value on done: 664.0 [2024-08-05 21:39:34,125][52662] DAMAGECOUNT value on done: 583.0 [2024-08-05 21:39:34,127][52662] Sum rewards: -1.434, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.806', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.022', 'HITCOUNT': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'ARMOR': '0.127', 'DAMAGECOUNT': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.506', 'weapon2': '1.172', 'weapon3': '1.586'} [2024-08-05 21:39:36,375][52794] DAMAGECOUNT value on done: 421.0 [2024-08-05 21:39:36,376][52794] Sum rewards: -1.354, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'weapon4': '0.084', 'HITCOUNT': '0.100', 'AMMO4': '0.120', 'WEAPON3': '0.400', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.477', 'FRAGCOUNT': '1.000', 'weapon3': '1.402', 'weapon2': '1.862'} [2024-08-05 21:39:36,883][52662] DAMAGECOUNT value on done: 645.0 [2024-08-05 21:39:37,795][52567] Fps is (10 sec: 17202.0, 60 sec: 17476.1, 300 sec: 17328.1). Total num frames: 14655488. Throughput: 0: 4361.0. Samples: 3666980. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 21:39:37,795][52567] Avg episode reward: [(0, '-3.229')] [2024-08-05 21:39:38,889][52794] DAMAGECOUNT value on done: 656.0 [2024-08-05 21:39:38,890][52794] Sum rewards: -2.673, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.444', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.032', 'weapon5': '0.034', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.184', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'weapon2': '1.454', 'weapon3': '1.718', 'FRAGCOUNT': '3.000'} [2024-08-05 21:39:39,081][52650] Updated weights for policy 0, policy_version 1791 (0.0014) [2024-08-05 21:39:39,274][52662] DAMAGECOUNT value on done: 904.0 [2024-08-05 21:39:39,275][52662] Sum rewards: -0.104, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.206', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.026', 'weapon5': '0.062', 'AMMO4': '0.095', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.446', 'WEAPON3': '0.600', 'weapon2': '1.248', 'DAMAGECOUNT': '1.311', 'FRAGCOUNT': '1.500', 'weapon3': '1.644'} [2024-08-05 21:39:41,182][52794] DAMAGECOUNT value on done: 415.0 [2024-08-05 21:39:41,182][52794] Sum rewards: -2.110, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.982', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.086', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.192', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon3': '1.376', 'weapon2': '1.988'} [2024-08-05 21:39:41,493][52662] DAMAGECOUNT value on done: 782.0 [2024-08-05 21:39:41,493][52662] Sum rewards: -5.121, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.706', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO4': '0.104', 'HITCOUNT': '0.120', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.274', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.448', 'weapon3': '1.570'} [2024-08-05 21:39:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17328.2). Total num frames: 14737408. Throughput: 0: 4364.7. Samples: 3693280. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:39:42,794][52567] Avg episode reward: [(0, '-3.190')] [2024-08-05 21:39:43,150][52650] Updated weights for policy 0, policy_version 1801 (0.0012) [2024-08-05 21:39:43,887][52794] DAMAGECOUNT value on done: 605.0 [2024-08-05 21:39:43,889][52794] Sum rewards: 2.583, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.100', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.044', 'AMMO3': '0.061', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.753', 'weapon3': '1.404', 'weapon2': '1.464', 'FRAGCOUNT': '4.000'} [2024-08-05 21:39:44,232][52662] DAMAGECOUNT value on done: 496.0 [2024-08-05 21:39:46,093][52794] DAMAGECOUNT value on done: 701.0 [2024-08-05 21:39:46,093][52794] Sum rewards: 2.669, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.074', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.108', 'AMMO3': '0.109', 'AMMO4': '0.125', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.272', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.813', 'weapon2': '1.330', 'weapon3': '1.580', 'FRAGCOUNT': '5.000'} [2024-08-05 21:39:46,464][52662] DAMAGECOUNT value on done: 820.0 [2024-08-05 21:39:46,465][52662] Sum rewards: -2.594, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.450', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.150', 'weapon4': '0.192', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.650', 'weapon3': '1.560', 'weapon2': '1.644', 'FRAGCOUNT': '2.000'} [2024-08-05 21:39:47,794][52567] Fps is (10 sec: 17204.5, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 14827520. Throughput: 0: 4368.9. Samples: 3706390. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-05 21:39:47,794][52567] Avg episode reward: [(0, '-3.108')] [2024-08-05 21:39:48,297][52650] Updated weights for policy 0, policy_version 1811 (0.0028) [2024-08-05 21:39:49,083][52794] DAMAGECOUNT value on done: 423.0 [2024-08-05 21:39:49,440][52662] DAMAGECOUNT value on done: 655.0 [2024-08-05 21:39:51,506][52794] DAMAGECOUNT value on done: 519.0 [2024-08-05 21:39:51,506][52794] Sum rewards: -0.911, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.710', 'AMMO2': '0.006', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.029', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.320', 'DAMAGECOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.408', 'weapon3': '1.932', 'FRAGCOUNT': '3.000'} [2024-08-05 21:39:51,947][52662] DAMAGECOUNT value on done: 874.0 [2024-08-05 21:39:52,412][52650] Updated weights for policy 0, policy_version 1821 (0.0031) [2024-08-05 21:39:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17355.9). Total num frames: 14917632. Throughput: 0: 4365.8. Samples: 3732750. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 21:39:52,794][52567] Avg episode reward: [(0, '-3.204')] [2024-08-05 21:39:53,923][52794] DAMAGECOUNT value on done: 853.0 [2024-08-05 21:39:53,925][52794] Sum rewards: -0.140, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.812', 'AMMO2': '0.021', 'weapon7': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.104', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.270', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.975', 'weapon2': '1.556', 'weapon3': '1.886', 'FRAGCOUNT': '2.000'} [2024-08-05 21:39:54,412][52662] DAMAGECOUNT value on done: 500.0 [2024-08-05 21:39:56,884][52794] DAMAGECOUNT value on done: 918.0 [2024-08-05 21:39:56,884][52794] Sum rewards: -4.722, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO2': '0.026', 'AMMO3': '0.118', 'AMMO4': '0.129', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.238', 'DAMAGECOUNT': '0.495', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.404', 'weapon3': '1.918'} [2024-08-05 21:39:57,317][52662] DAMAGECOUNT value on done: 440.0 [2024-08-05 21:39:57,525][52650] Updated weights for policy 0, policy_version 1831 (0.0017) [2024-08-05 21:39:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 14999552. Throughput: 0: 4362.2. Samples: 3758630. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-05 21:39:57,794][52567] Avg episode reward: [(0, '-3.222')] [2024-08-05 21:39:59,570][52794] DAMAGECOUNT value on done: 417.0 [2024-08-05 21:39:59,578][52794] Sum rewards: -3.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.554', 'AMMO2': '0.017', 'AMMO5': '0.019', 'weapon5': '0.032', 'weapon4': '0.064', 'AMMO4': '0.082', 'HITCOUNT': '0.110', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.300', 'ARMOR': '0.416', 'WEAPON3': '0.850', 'weapon2': '1.316', 'weapon3': '1.828', 'FRAGCOUNT': '2.000'} [2024-08-05 21:39:59,819][52662] DAMAGECOUNT value on done: 400.0 [2024-08-05 21:40:02,016][52794] DAMAGECOUNT value on done: 657.0 [2024-08-05 21:40:02,018][52794] Sum rewards: -4.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.020', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'ARMOR': '0.005', 'WEAPON1': '0.010', 'HITCOUNT': '0.130', 'AMMO3': '0.131', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.270', 'weapon2': '1.980'} [2024-08-05 21:40:02,024][52650] Updated weights for policy 0, policy_version 1841 (0.0013) [2024-08-05 21:40:02,419][52662] DAMAGECOUNT value on done: 757.0 [2024-08-05 21:40:02,419][52662] Sum rewards: 1.611, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon7': '0.074', 'HITCOUNT': '0.090', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.344', 'WEAPON3': '0.400', 'HEALTH': '0.406', 'DAMAGECOUNT': '0.477', 'weapon2': '0.914', 'weapon3': '1.374', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17355.9). Total num frames: 15089664. Throughput: 0: 4360.0. Samples: 3771460. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 21:40:02,794][52567] Avg episode reward: [(0, '-3.121')] [2024-08-05 21:40:04,326][52794] DAMAGECOUNT value on done: 1115.0 [2024-08-05 21:40:04,326][52794] Sum rewards: -1.439, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.246', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.017', 'weapon2': '1.478', 'weapon3': '1.792'} [2024-08-05 21:40:04,567][52662] DAMAGECOUNT value on done: 396.0 [2024-08-05 21:40:04,568][52662] Sum rewards: -4.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.912', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.167', 'weapon4': '0.226', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.262', 'weapon3': '1.710'} [2024-08-05 21:40:06,789][52794] DAMAGECOUNT value on done: 802.0 [2024-08-05 21:40:06,789][52794] Sum rewards: -3.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.322', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'ARMOR': '0.024', 'weapon7': '0.066', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.222', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.256', 'weapon3': '2.060'} [2024-08-05 21:40:06,871][52650] Updated weights for policy 0, policy_version 1851 (0.0013) [2024-08-05 21:40:07,129][52662] DAMAGECOUNT value on done: 483.0 [2024-08-05 21:40:07,131][52662] Sum rewards: -3.071, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.634', 'AMMO2': '0.014', 'ARMOR': '0.032', 'AMMO4': '0.070', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.270', 'weapon3': '2.362'} [2024-08-05 21:40:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17355.9). Total num frames: 15179776. Throughput: 0: 4361.3. Samples: 3797860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:40:07,795][52567] Avg episode reward: [(0, '-3.159')] [2024-08-05 21:40:09,426][52794] DAMAGECOUNT value on done: 590.0 [2024-08-05 21:40:09,545][52665] DAMAGECOUNT value on done: 830.0 [2024-08-05 21:40:09,545][52665] Sum rewards: -1.237, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon4': '0.162', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.990', 'weapon3': '1.486', 'weapon2': '1.918', 'FRAGCOUNT': '3.000'} [2024-08-05 21:40:09,760][52662] DAMAGECOUNT value on done: 729.0 [2024-08-05 21:40:11,510][52650] Updated weights for policy 0, policy_version 1861 (0.0019) [2024-08-05 21:40:12,021][52662] DAMAGECOUNT value on done: 785.0 [2024-08-05 21:40:12,022][52662] Sum rewards: -1.645, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.476', 'AMMO2': '0.007', 'AMMO5': '0.020', 'AMMO4': '0.032', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'WEAPON5': '0.300', 'ARMOR': '0.412', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.380', 'weapon2': '1.498'} [2024-08-05 21:40:12,191][52665] DAMAGECOUNT value on done: 596.0 [2024-08-05 21:40:12,193][52665] Sum rewards: -5.357, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.700', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'HITCOUNT': '0.070', 'weapon4': '0.074', 'AMMO4': '0.096', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.006', 'weapon3': '2.306'} [2024-08-05 21:40:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17355.9). Total num frames: 15261696. Throughput: 0: 4366.2. Samples: 3824180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:40:12,795][52567] Avg episode reward: [(0, '-3.348')] [2024-08-05 21:40:14,686][52665] DAMAGECOUNT value on done: 512.0 [2024-08-05 21:40:14,689][52665] Sum rewards: -2.363, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.182', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'weapon7': '0.064', 'HITCOUNT': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.612', 'weapon2': '1.744'} [2024-08-05 21:40:16,254][52650] Updated weights for policy 0, policy_version 1871 (0.0025) [2024-08-05 21:40:16,292][52649] DAMAGECOUNT value on done: 554.0 [2024-08-05 21:40:16,293][52649] Sum rewards: -5.069, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.736', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon5': '0.020', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'HITCOUNT': '0.190', 'weapon4': '0.304', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.626', 'weapon3': '1.654'} [2024-08-05 21:40:17,224][52665] DAMAGECOUNT value on done: 366.0 [2024-08-05 21:40:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 15351808. Throughput: 0: 4371.1. Samples: 3837460. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 21:40:17,795][52567] Avg episode reward: [(0, '-3.393')] [2024-08-05 21:40:18,903][52649] DAMAGECOUNT value on done: 786.0 [2024-08-05 21:40:18,904][52649] Sum rewards: -3.208, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.563', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.162', 'DAMAGECOUNT': '0.402', 'ARMOR': '0.521', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.462', 'weapon3': '1.836'} [2024-08-05 21:40:19,823][52665] DAMAGECOUNT value on done: 714.0 [2024-08-05 21:40:19,824][52665] Sum rewards: -0.368, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.017', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.076', 'HITCOUNT': '0.130', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'ARMOR': '0.529', 'weapon2': '1.334', 'weapon3': '1.428'} [2024-08-05 21:40:20,800][52650] Updated weights for policy 0, policy_version 1881 (0.0020) [2024-08-05 21:40:21,937][52649] DAMAGECOUNT value on done: 372.0 [2024-08-05 21:40:21,938][52649] Sum rewards: -4.173, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.144', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'ARMOR': '0.032', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'DAMAGECOUNT': '0.135', 'weapon4': '0.248', 'WEAPON3': '0.450', 'weapon2': '1.390', 'weapon3': '1.424'} [2024-08-05 21:40:22,758][52665] DAMAGECOUNT value on done: 529.0 [2024-08-05 21:40:22,759][52665] Sum rewards: -0.529, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.172', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.121', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.480', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.700', 'weapon2': '1.162', 'weapon3': '1.860', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17355.9). Total num frames: 15441920. Throughput: 0: 4371.2. Samples: 3863680. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:40:22,795][52567] Avg episode reward: [(0, '-3.368')] [2024-08-05 21:40:24,873][52649] DAMAGECOUNT value on done: 590.0 [2024-08-05 21:40:25,546][52650] Updated weights for policy 0, policy_version 1891 (0.0027) [2024-08-05 21:40:25,587][52665] DAMAGECOUNT value on done: 406.0 [2024-08-05 21:40:25,589][52665] Sum rewards: -2.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.074', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.099', 'HITCOUNT': '0.170', 'weapon4': '0.208', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.650', 'ARMOR': '0.931', 'weapon2': '1.488', 'weapon3': '1.570', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:27,068][52647] DAMAGECOUNT value on done: 419.0 [2024-08-05 21:40:27,068][52647] Sum rewards: -2.449, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.805', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON1': '0.030', 'ARMOR': '0.049', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.376', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.386', 'weapon3': '1.702'} [2024-08-05 21:40:27,768][52649] DAMAGECOUNT value on done: 247.0 [2024-08-05 21:40:27,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 15532032. Throughput: 0: 4365.1. Samples: 3889710. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:40:27,794][52567] Avg episode reward: [(0, '-3.297')] [2024-08-05 21:40:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001896_15532032.pth... [2024-08-05 21:40:27,796][52669] DAMAGECOUNT value on done: 260.0 [2024-08-05 21:40:27,799][52669] Sum rewards: -4.158, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO2': '0.006', 'ARMOR': '0.028', 'AMMO4': '0.031', 'HITCOUNT': '0.080', 'AMMO3': '0.171', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.192', 'weapon3': '2.338'} [2024-08-05 21:40:27,924][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001386_11354112.pth [2024-08-05 21:40:27,934][52667] DAMAGECOUNT value on done: 515.0 [2024-08-05 21:40:27,934][52667] Sum rewards: -2.713, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.176', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.264', 'ARMOR': '0.549', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.960', 'weapon3': '1.534', 'weapon2': '1.780', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:28,772][52665] DAMAGECOUNT value on done: 777.0 [2024-08-05 21:40:29,773][52647] DAMAGECOUNT value on done: 943.0 [2024-08-05 21:40:29,773][52647] Sum rewards: -0.383, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.468', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.140', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon2': '1.558', 'weapon3': '1.734'} [2024-08-05 21:40:30,341][52650] Updated weights for policy 0, policy_version 1901 (0.0019) [2024-08-05 21:40:30,554][52667] DAMAGECOUNT value on done: 559.0 [2024-08-05 21:40:30,725][52658] DAMAGECOUNT value on done: 627.0 [2024-08-05 21:40:30,887][52669] DAMAGECOUNT value on done: 865.0 [2024-08-05 21:40:30,889][52669] Sum rewards: 0.035, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.404', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.142', 'weapon4': '0.184', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'ARMOR': '0.552', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon2': '1.330', 'weapon3': '1.902', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:31,171][52649] DAMAGECOUNT value on done: 534.0 [2024-08-05 21:40:31,172][52649] Sum rewards: -0.159, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.620', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.042', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.822', 'weapon2': '1.658', 'weapon3': '1.706'} [2024-08-05 21:40:32,074][52647] DAMAGECOUNT value on done: 764.0 [2024-08-05 21:40:32,075][52647] Sum rewards: -6.475, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-2.000', 'HEALTH': '-1.300', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.111', 'weapon5': '0.154', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.633', 'WEAPON3': '0.650', 'weapon3': '1.378', 'weapon2': '1.804'} [2024-08-05 21:40:32,170][52665] DAMAGECOUNT value on done: 588.0 [2024-08-05 21:40:32,301][52663] DAMAGECOUNT value on done: 760.0 [2024-08-05 21:40:32,303][52663] Sum rewards: -4.516, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.780', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.008', 'AMMO5': '0.015', 'weapon5': '0.036', 'AMMO4': '0.041', 'ARMOR': '0.052', 'HITCOUNT': '0.080', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.219', 'weapon4': '0.490', 'WEAPON3': '0.750', 'weapon2': '0.946', 'weapon3': '1.916'} [2024-08-05 21:40:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17355.9). Total num frames: 15613952. Throughput: 0: 4357.8. Samples: 3902490. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-05 21:40:32,794][52567] Avg episode reward: [(0, '-3.233')] [2024-08-05 21:40:33,263][52669] DAMAGECOUNT value on done: 489.0 [2024-08-05 21:40:33,441][52667] DAMAGECOUNT value on done: 1006.0 [2024-08-05 21:40:33,441][52667] Sum rewards: -4.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.082', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'ARMOR': '0.040', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '1.185', 'WEAPON3': '1.200', 'weapon2': '1.246', 'FRAGCOUNT': '2.000', 'weapon3': '2.190'} [2024-08-05 21:40:33,627][52658] DAMAGECOUNT value on done: 610.0 [2024-08-05 21:40:34,349][52649] DAMAGECOUNT value on done: 714.0 [2024-08-05 21:40:34,353][52649] Sum rewards: -0.927, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.314', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.102', 'AMMO3': '0.129', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.128', 'weapon3': '2.378'} [2024-08-05 21:40:34,428][52663] DAMAGECOUNT value on done: 454.0 [2024-08-05 21:40:34,429][52663] Sum rewards: -2.556, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.545', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.008', 'weapon4': '0.030', 'weapon5': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.586', 'weapon3': '1.646'} [2024-08-05 21:40:34,603][52647] DAMAGECOUNT value on done: 524.0 [2024-08-05 21:40:34,899][52650] Updated weights for policy 0, policy_version 1911 (0.0023) [2024-08-05 21:40:35,227][52665] DAMAGECOUNT value on done: 1290.0 [2024-08-05 21:40:35,228][52665] Sum rewards: -0.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.042', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'HITCOUNT': '0.310', 'weapon2': '1.144', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.485', 'weapon3': '2.060', 'FRAGCOUNT': '5.000'} [2024-08-05 21:40:35,629][52669] DAMAGECOUNT value on done: 1105.0 [2024-08-05 21:40:35,629][52669] Sum rewards: -4.842, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.220', 'HITCOUNT': '0.260', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.029', 'weapon2': '1.360', 'weapon3': '2.062'} [2024-08-05 21:40:36,337][52667] DAMAGECOUNT value on done: 361.0 [2024-08-05 21:40:36,665][52658] DAMAGECOUNT value on done: 472.0 [2024-08-05 21:40:36,666][52658] Sum rewards: -5.491, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.126', 'weapon4': '0.132', 'DAMAGECOUNT': '0.240', 'ARMOR': '0.464', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.308', 'weapon3': '2.182'} [2024-08-05 21:40:36,966][52649] DAMAGECOUNT value on done: 424.0 [2024-08-05 21:40:36,999][52663] DAMAGECOUNT value on done: 662.0 [2024-08-05 21:40:37,000][52663] Sum rewards: -2.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.090', 'AMMO3': '0.094', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.688', 'weapon3': '1.790'} [2024-08-05 21:40:37,497][52664] DAMAGECOUNT value on done: 692.0 [2024-08-05 21:40:37,497][52664] Sum rewards: -2.006, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.560', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon7': '0.052', 'ARMOR': '0.076', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.600', 'weapon2': '1.378', 'weapon3': '1.426', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:37,544][52647] DAMAGECOUNT value on done: 444.0 [2024-08-05 21:40:37,546][52647] Sum rewards: -1.388, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.342', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.140', 'weapon4': '0.316', 'DAMAGECOUNT': '0.477', 'ARMOR': '0.563', 'WEAPON3': '0.750', 'weapon2': '1.364', 'weapon3': '1.550', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.5, 300 sec: 17355.9). Total num frames: 15704064. Throughput: 0: 4362.0. Samples: 3929040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:40:37,795][52567] Avg episode reward: [(0, '-3.139')] [2024-08-05 21:40:37,955][52665] DAMAGECOUNT value on done: 730.0 [2024-08-05 21:40:38,260][52669] DAMAGECOUNT value on done: 470.0 [2024-08-05 21:40:38,268][52669] Sum rewards: -5.206, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.024', 'AMMO4': '-0.112', 'AMMO2': '-0.022', 'weapon5': '0.012', 'AMMO5': '0.015', 'HITCOUNT': '0.040', 'AMMO3': '0.138', 'DAMAGECOUNT': '0.180', 'WEAPON5': '0.300', 'ARMOR': '0.479', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.678', 'weapon2': '2.060'} [2024-08-05 21:40:39,520][52663] DAMAGECOUNT value on done: 1080.0 [2024-08-05 21:40:39,522][52663] Sum rewards: -4.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.404', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.157', 'HITCOUNT': '0.240', 'ARMOR': '0.404', 'DAMAGECOUNT': '0.876', 'WEAPON3': '1.000', 'weapon2': '1.516', 'FRAGCOUNT': '2.000', 'weapon3': '2.046'} [2024-08-05 21:40:39,677][52667] DAMAGECOUNT value on done: 550.0 [2024-08-05 21:40:39,789][52650] Updated weights for policy 0, policy_version 1921 (0.0014) [2024-08-05 21:40:40,018][52658] DAMAGECOUNT value on done: 445.0 [2024-08-05 21:40:40,021][52658] Sum rewards: 0.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.628', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.078', 'ARMOR': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.118', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.524', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.561', 'weapon2': '1.088', 'weapon3': '1.528', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:40,200][52649] DAMAGECOUNT value on done: 745.0 [2024-08-05 21:40:40,213][52664] DAMAGECOUNT value on done: 537.0 [2024-08-05 21:40:40,229][52647] DAMAGECOUNT value on done: 563.0 [2024-08-05 21:40:40,233][52647] Sum rewards: -1.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.782', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.077', 'HITCOUNT': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.630', 'weapon3': '1.272', 'weapon2': '2.018'} [2024-08-05 21:40:40,903][52665] DAMAGECOUNT value on done: 778.0 [2024-08-05 21:40:40,925][52669] DAMAGECOUNT value on done: 441.0 [2024-08-05 21:40:41,330][52668] DAMAGECOUNT value on done: 507.0 [2024-08-05 21:40:41,330][52668] Sum rewards: -2.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.797', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon5': '0.044', 'AMMO3': '0.120', 'HITCOUNT': '0.130', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.274', 'weapon3': '1.872'} [2024-08-05 21:40:42,177][52667] DAMAGECOUNT value on done: 388.0 [2024-08-05 21:40:42,390][52660] DAMAGECOUNT value on done: 655.0 [2024-08-05 21:40:42,390][52660] Sum rewards: -2.446, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.440', 'weapon5': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.111', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.392', 'weapon3': '2.088'} [2024-08-05 21:40:42,682][52663] DAMAGECOUNT value on done: 408.0 [2024-08-05 21:40:42,682][52663] Sum rewards: -1.809, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'weapon4': '0.274', 'DAMAGECOUNT': '0.432', 'ARMOR': '0.494', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.186', 'weapon3': '1.630'} [2024-08-05 21:40:42,685][52658] DAMAGECOUNT value on done: 525.0 [2024-08-05 21:40:42,686][52658] Sum rewards: -3.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.595', 'AMMO2': '0.008', 'AMMO4': '0.037', 'ARMOR': '0.080', 'AMMO3': '0.098', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.342', 'weapon4': '0.428', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.082', 'weapon2': '1.342'} [2024-08-05 21:40:42,698][52649] DAMAGECOUNT value on done: 590.0 [2024-08-05 21:40:42,699][52649] Sum rewards: -4.619, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.795', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'HITCOUNT': '0.130', 'weapon4': '0.134', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.950', 'weapon2': '1.548', 'weapon3': '1.906', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17328.2). Total num frames: 15785984. Throughput: 0: 4359.8. Samples: 3954820. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:40:42,794][52567] Avg episode reward: [(0, '-3.222')] [2024-08-05 21:40:43,341][52647] DAMAGECOUNT value on done: 708.0 [2024-08-05 21:40:43,343][52647] Sum rewards: -3.629, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.102', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.030', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.104', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.160', 'DAMAGECOUNT': '0.576', 'WEAPON3': '0.750', 'weapon2': '1.544', 'weapon3': '1.840'} [2024-08-05 21:40:43,361][52664] DAMAGECOUNT value on done: 710.0 [2024-08-05 21:40:43,366][52664] Sum rewards: -4.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.920', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO5': '0.020', 'ARMOR': '0.024', 'weapon4': '0.032', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.758', 'weapon3': '1.768'} [2024-08-05 21:40:43,808][52668] DAMAGECOUNT value on done: 1071.0 [2024-08-05 21:40:43,808][52668] Sum rewards: 0.252, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'ARMOR': '0.024', 'WEAPON1': '0.040', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.098', 'weapon3': '1.102', 'weapon2': '2.010', 'FRAGCOUNT': '3.000'} [2024-08-05 21:40:43,830][52665] DAMAGECOUNT value on done: 540.0 [2024-08-05 21:40:44,066][52669] DAMAGECOUNT value on done: 676.0 [2024-08-05 21:40:44,478][52650] Updated weights for policy 0, policy_version 1931 (0.0014) [2024-08-05 21:40:45,025][52660] DAMAGECOUNT value on done: 526.0 [2024-08-05 21:40:45,025][52660] Sum rewards: 0.712, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.298', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO3': '0.111', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.220', 'DAMAGECOUNT': '0.438', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'weapon2': '0.736', 'weapon3': '1.998', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:45,051][52667] DAMAGECOUNT value on done: 1024.0 [2024-08-05 21:40:45,051][52667] Sum rewards: -0.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.500', 'AMMO2': '0.023', 'ARMOR': '0.024', 'AMMO3': '0.109', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.732', 'weapon2': '1.562', 'weapon3': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:45,524][52658] DAMAGECOUNT value on done: 624.0 [2024-08-05 21:40:45,524][52658] Sum rewards: -0.838, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.061', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.094', 'weapon4': '0.110', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.738', 'weapon2': '1.544', 'weapon3': '1.712', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:45,663][52649] DAMAGECOUNT value on done: 430.0 [2024-08-05 21:40:45,664][52649] Sum rewards: -0.422, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.794', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.083', 'ARMOR': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.148', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.622', 'weapon3': '1.902'} [2024-08-05 21:40:45,762][52663] DAMAGECOUNT value on done: 591.0 [2024-08-05 21:40:45,762][52663] Sum rewards: -4.017, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.986', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.119', 'HITCOUNT': '0.150', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.462', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.552', 'weapon3': '2.026'} [2024-08-05 21:40:46,393][52665] DAMAGECOUNT value on done: 918.0 [2024-08-05 21:40:46,394][52665] Sum rewards: 0.625, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.066', 'AMMO2': '0.034', 'AMMO3': '0.111', 'ARMOR': '0.156', 'AMMO4': '0.172', 'HITCOUNT': '0.310', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.062', 'weapon3': '1.414', 'weapon2': '1.544', 'FRAGCOUNT': '3.000'} [2024-08-05 21:40:46,511][52668] DAMAGECOUNT value on done: 851.0 [2024-08-05 21:40:46,513][52668] Sum rewards: -4.189, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.114', 'AMMO2': '0.015', 'ARMOR': '0.068', 'AMMO4': '0.077', 'AMMO3': '0.094', 'HITCOUNT': '0.100', 'DAMAGECOUNT': '0.237', 'WEAPON4': '0.350', 'weapon4': '0.600', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.206', 'weapon3': '1.678'} [2024-08-05 21:40:46,552][52647] DAMAGECOUNT value on done: 800.0 [2024-08-05 21:40:46,553][52647] Sum rewards: -8.516, reward structure: {'DEATHCOUNT': '-11.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.076', 'weapon5': '0.076', 'HITCOUNT': '0.080', 'weapon4': '0.112', 'AMMO3': '0.168', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.950', 'weapon2': '1.544', 'weapon3': '1.836'} [2024-08-05 21:40:46,599][52664] DAMAGECOUNT value on done: 394.0 [2024-08-05 21:40:46,806][52669] DAMAGECOUNT value on done: 463.0 [2024-08-05 21:40:46,806][52669] Sum rewards: -2.883, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.242', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.420', 'weapon3': '2.028'} [2024-08-05 21:40:47,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17300.4). Total num frames: 15867904. Throughput: 0: 4364.9. Samples: 3967880. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:40:47,794][52567] Avg episode reward: [(0, '-3.051')] [2024-08-05 21:40:47,867][52667] DAMAGECOUNT value on done: 849.0 [2024-08-05 21:40:47,870][52667] Sum rewards: -4.577, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.542', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.036', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.382', 'weapon3': '2.388'} [2024-08-05 21:40:48,083][52660] DAMAGECOUNT value on done: 404.0 [2024-08-05 21:40:48,141][52663] DAMAGECOUNT value on done: 515.0 [2024-08-05 21:40:48,144][52663] Sum rewards: -2.851, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.425', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.226', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.800', 'weapon2': '1.314', 'weapon3': '1.740', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:48,299][52658] DAMAGECOUNT value on done: 599.0 [2024-08-05 21:40:48,506][52649] DAMAGECOUNT value on done: 378.0 [2024-08-05 21:40:49,100][52650] Updated weights for policy 0, policy_version 1941 (0.0011) [2024-08-05 21:40:49,160][52665] DAMAGECOUNT value on done: 905.0 [2024-08-05 21:40:49,162][52665] Sum rewards: 0.863, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.321', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.230', 'HITCOUNT': '0.240', 'ARMOR': '0.512', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.011', 'weapon2': '1.210', 'weapon3': '1.996', 'FRAGCOUNT': '3.000'} [2024-08-05 21:40:49,335][52669] DAMAGECOUNT value on done: 615.0 [2024-08-05 21:40:49,336][52669] Sum rewards: -1.855, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.790', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO3': '0.089', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon3': '1.360', 'weapon2': '1.600'} [2024-08-05 21:40:49,459][52647] DAMAGECOUNT value on done: 731.0 [2024-08-05 21:40:49,461][52647] Sum rewards: -2.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.474', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.013', 'weapon5': '0.070', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.945', 'weapon3': '1.464', 'weapon2': '1.552', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:49,587][52664] DAMAGECOUNT value on done: 956.0 [2024-08-05 21:40:49,587][52664] Sum rewards: -0.679, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'weapon4': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.543', 'FRAGCOUNT': '1.000', 'weapon3': '1.180', 'weapon2': '1.612'} [2024-08-05 21:40:49,718][52668] DAMAGECOUNT value on done: 295.0 [2024-08-05 21:40:49,722][52668] Sum rewards: -0.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.396', 'AMMO2': '0.023', 'AMMO3': '0.062', 'ARMOR': '0.092', 'AMMO4': '0.116', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.228', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.474', 'weapon2': '1.626'} [2024-08-05 21:40:51,080][52660] DAMAGECOUNT value on done: 874.0 [2024-08-05 21:40:51,083][52660] Sum rewards: 3.289, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.065', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'HEALTH': '0.178', 'HITCOUNT': '0.180', 'weapon4': '0.228', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.810', 'weapon3': '1.408', 'weapon2': '1.890', 'FRAGCOUNT': '3.000'} [2024-08-05 21:40:51,141][52663] DAMAGECOUNT value on done: 729.0 [2024-08-05 21:40:51,141][52663] Sum rewards: -5.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.104', 'AMMO3': '0.115', 'AMMO4': '0.141', 'HITCOUNT': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.490', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.478', 'weapon2': '1.570'} [2024-08-05 21:40:51,155][52667] DAMAGECOUNT value on done: 499.0 [2024-08-05 21:40:51,256][52671] DAMAGECOUNT value on done: 397.0 [2024-08-05 21:40:51,582][52649] DAMAGECOUNT value on done: 1113.0 [2024-08-05 21:40:51,585][52649] Sum rewards: -3.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.246', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.069', 'AMMO4': '0.072', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.254', 'DAMAGECOUNT': '1.080', 'WEAPON3': '1.100', 'weapon2': '1.184', 'weapon3': '2.094', 'FRAGCOUNT': '4.000'} [2024-08-05 21:40:51,611][52658] DAMAGECOUNT value on done: 579.0 [2024-08-05 21:40:51,612][52658] Sum rewards: 1.291, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.419', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.036', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.077', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.432', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.615', 'weapon2': '1.118', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:51,856][52647] DAMAGECOUNT value on done: 491.0 [2024-08-05 21:40:51,862][52647] Sum rewards: -2.938, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.205', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon4': '0.026', 'ARMOR': '0.028', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.600', 'weapon3': '1.846'} [2024-08-05 21:40:52,078][52664] DAMAGECOUNT value on done: 444.0 [2024-08-05 21:40:52,081][52664] Sum rewards: -2.805, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.852', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO3': '0.115', 'DAMAGECOUNT': '0.225', 'weapon4': '0.260', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.490', 'weapon3': '1.500'} [2024-08-05 21:40:52,361][52665] DAMAGECOUNT value on done: 910.0 [2024-08-05 21:40:52,361][52665] Sum rewards: 3.826, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.460', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'weapon7': '0.078', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'weapon3': '1.196', 'DAMAGECOUNT': '1.752', 'weapon2': '1.958', 'FRAGCOUNT': '5.000'} [2024-08-05 21:40:52,563][52669] DAMAGECOUNT value on done: 921.0 [2024-08-05 21:40:52,657][52668] DAMAGECOUNT value on done: 409.0 [2024-08-05 21:40:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17300.4). Total num frames: 15958016. Throughput: 0: 4356.7. Samples: 3993910. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:40:52,794][52567] Avg episode reward: [(0, '-2.994')] [2024-08-05 21:40:53,200][52659] DAMAGECOUNT value on done: 476.0 [2024-08-05 21:40:53,770][52650] Updated weights for policy 0, policy_version 1951 (0.0013) [2024-08-05 21:40:53,866][52660] DAMAGECOUNT value on done: 848.0 [2024-08-05 21:40:53,867][52660] Sum rewards: -6.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.974', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.058', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.258', 'FRAGCOUNT': '0.500', 'ARMOR': '0.549', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.804', 'weapon3': '1.528', 'weapon2': '1.856'} [2024-08-05 21:40:53,940][52671] DAMAGECOUNT value on done: 698.0 [2024-08-05 21:40:53,952][52671] Sum rewards: -1.533, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.426', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.089', 'ARMOR': '0.113', 'HITCOUNT': '0.190', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.633', 'weapon4': '0.706', 'FRAGCOUNT': '1.000', 'weapon3': '1.040', 'weapon2': '1.866'} [2024-08-05 21:40:54,241][52667] DAMAGECOUNT value on done: 535.0 [2024-08-05 21:40:54,273][52663] DAMAGECOUNT value on done: 392.0 [2024-08-05 21:40:54,274][52663] Sum rewards: -1.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.846', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.154', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.850', 'weapon2': '1.514', 'weapon3': '1.842', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:54,557][52647] DAMAGECOUNT value on done: 586.0 [2024-08-05 21:40:54,761][52658] DAMAGECOUNT value on done: 432.0 [2024-08-05 21:40:54,764][52658] Sum rewards: -5.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.105', 'AMMO2': '0.012', 'AMMO4': '0.061', 'HITCOUNT': '0.090', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.270', 'weapon4': '0.284', 'ARMOR': '0.532', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.650', 'weapon3': '1.722'} [2024-08-05 21:40:54,811][52649] DAMAGECOUNT value on done: 583.0 [2024-08-05 21:40:54,851][52664] DAMAGECOUNT value on done: 650.0 [2024-08-05 21:40:54,853][52664] Sum rewards: -0.573, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.772', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.450', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.930', 'weapon2': '1.250', 'FRAGCOUNT': '2.000', 'weapon3': '2.214'} [2024-08-05 21:40:54,967][52668] DAMAGECOUNT value on done: 743.0 [2024-08-05 21:40:54,968][52668] Sum rewards: 1.498, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO2': '0.007', 'AMMO4': '0.036', 'ARMOR': '0.040', 'AMMO3': '0.114', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.714', 'weapon2': '1.418', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'} [2024-08-05 21:40:55,644][52665] DAMAGECOUNT value on done: 727.0 [2024-08-05 21:40:55,652][52665] Sum rewards: -1.862, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.932', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO4': '0.112', 'weapon4': '0.142', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.342', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.462', 'weapon3': '1.874'} [2024-08-05 21:40:55,668][52669] DAMAGECOUNT value on done: 402.0 [2024-08-05 21:40:55,668][52669] Sum rewards: -3.023, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'weapon4': '0.038', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.900', 'weapon2': '1.552', 'weapon3': '1.814', 'FRAGCOUNT': '3.000'} [2024-08-05 21:40:56,161][52660] DAMAGECOUNT value on done: 1078.0 [2024-08-05 21:40:56,163][52660] Sum rewards: 0.135, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.798', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.290', 'ARMOR': '0.496', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.170', 'weapon3': '1.418', 'weapon2': '2.082', 'FRAGCOUNT': '5.000'} [2024-08-05 21:40:56,532][52659] DAMAGECOUNT value on done: 743.0 [2024-08-05 21:40:56,532][52659] Sum rewards: -2.057, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.268', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon4': '0.248', 'HITCOUNT': '0.280', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.044', 'weapon2': '1.426', 'FRAGCOUNT': '2.000', 'weapon3': '2.002'} [2024-08-05 21:40:56,939][52667] DAMAGECOUNT value on done: 546.0 [2024-08-05 21:40:57,144][52671] DAMAGECOUNT value on done: 440.0 [2024-08-05 21:40:57,144][52671] Sum rewards: -2.375, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.742', 'AMMO5': '0.004', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.025', 'HITCOUNT': '0.040', 'weapon7': '0.048', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.105', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.406', 'weapon2': '1.766'} [2024-08-05 21:40:57,419][52668] DAMAGECOUNT value on done: 762.0 [2024-08-05 21:40:57,419][52668] Sum rewards: 0.141, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.444', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.120', 'HITCOUNT': '0.170', 'WEAPON3': '0.400', 'ARMOR': '0.535', 'DAMAGECOUNT': '0.639', 'weapon3': '1.526', 'weapon2': '1.634', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:57,480][52647] DAMAGECOUNT value on done: 657.0 [2024-08-05 21:40:57,481][52647] Sum rewards: -0.070, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.786', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.054', 'ARMOR': '0.096', 'AMMO3': '0.134', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.930', 'weapon2': '1.414', 'weapon3': '1.994', 'FRAGCOUNT': '4.000'} [2024-08-05 21:40:57,526][52658] DAMAGECOUNT value on done: 301.0 [2024-08-05 21:40:57,534][52663] DAMAGECOUNT value on done: 743.0 [2024-08-05 21:40:57,540][52663] Sum rewards: 0.505, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.128', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.414', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.645', 'weapon3': '0.978', 'weapon2': '1.128', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:57,751][52664] DAMAGECOUNT value on done: 615.0 [2024-08-05 21:40:57,751][52664] Sum rewards: 0.350, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.279', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.074', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'weapon2': '1.246', 'weapon3': '1.356', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17328.2). Total num frames: 16048128. Throughput: 0: 4341.1. Samples: 4019530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:40:57,794][52567] Avg episode reward: [(0, '-2.725')] [2024-08-05 21:40:57,797][52614] Saving new best policy, reward=-2.725! [2024-08-05 21:40:58,262][52649] DAMAGECOUNT value on done: 188.0 [2024-08-05 21:40:58,680][52650] Updated weights for policy 0, policy_version 1961 (0.0028) [2024-08-05 21:40:58,811][52660] DAMAGECOUNT value on done: 575.0 [2024-08-05 21:40:58,813][52660] Sum rewards: -4.198, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.382', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'HITCOUNT': '0.140', 'AMMO3': '0.157', 'weapon4': '0.226', 'ARMOR': '0.472', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.688', 'weapon2': '1.732'} [2024-08-05 21:40:58,845][52669] DAMAGECOUNT value on done: 665.0 [2024-08-05 21:40:58,846][52669] Sum rewards: -0.302, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.022', 'weapon4': '0.032', 'HEALTH': '0.036', 'ARMOR': '0.036', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.915', 'weapon2': '1.656', 'weapon3': '1.942', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:58,915][52665] DAMAGECOUNT value on done: 743.0 [2024-08-05 21:40:58,915][52665] Sum rewards: -0.878, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.059', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'weapon4': '0.486', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.161', 'weapon2': '1.550', 'weapon3': '1.724', 'FRAGCOUNT': '2.000'} [2024-08-05 21:40:59,661][52659] DAMAGECOUNT value on done: 1039.0 [2024-08-05 21:40:59,661][52659] Sum rewards: -2.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO2': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.099', 'AMMO3': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.472', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.972', 'weapon3': '1.446', 'weapon2': '1.808', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:00,242][52647] DAMAGECOUNT value on done: 384.0 [2024-08-05 21:41:00,266][52667] DAMAGECOUNT value on done: 1079.0 [2024-08-05 21:41:00,266][52667] Sum rewards: -0.526, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.548', 'AMMO2': '0.004', 'ARMOR': '0.016', 'AMMO4': '0.019', 'AMMO3': '0.094', 'HITCOUNT': '0.130', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '1.000', 'weapon3': '1.632', 'weapon2': '2.182'} [2024-08-05 21:41:00,302][52671] DAMAGECOUNT value on done: 1066.0 [2024-08-05 21:41:00,316][52668] DAMAGECOUNT value on done: 743.0 [2024-08-05 21:41:00,317][52668] Sum rewards: -4.366, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.455', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon7': '0.086', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.230', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.546', 'weapon2': '1.752'} [2024-08-05 21:41:00,619][52663] DAMAGECOUNT value on done: 419.0 [2024-08-05 21:41:00,786][52664] DAMAGECOUNT value on done: 951.0 [2024-08-05 21:41:00,788][52664] Sum rewards: -6.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.185', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.108', 'WEAPON3': '1.150', 'weapon3': '2.634'} [2024-08-05 21:41:00,839][52658] DAMAGECOUNT value on done: 798.0 [2024-08-05 21:41:00,839][52658] Sum rewards: 0.637, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.736', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.720', 'weapon2': '1.500', 'weapon3': '1.856', 'FRAGCOUNT': '4.000'} [2024-08-05 21:41:01,261][52649] DAMAGECOUNT value on done: 401.0 [2024-08-05 21:41:01,709][52665] DAMAGECOUNT value on done: 813.0 [2024-08-05 21:41:01,709][52665] Sum rewards: 0.215, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.015', 'weapon5': '0.016', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.270', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.170', 'weapon2': '1.254', 'FRAGCOUNT': '2.000', 'weapon3': '2.328'} [2024-08-05 21:41:02,002][52660] DAMAGECOUNT value on done: 578.0 [2024-08-05 21:41:02,025][52669] DAMAGECOUNT value on done: 582.0 [2024-08-05 21:41:02,025][52669] Sum rewards: -3.629, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.070', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'HITCOUNT': '0.070', 'weapon4': '0.080', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.514', 'weapon3': '2.128'} [2024-08-05 21:41:02,562][52659] DAMAGECOUNT value on done: 562.0 [2024-08-05 21:41:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17328.2). Total num frames: 16130048. Throughput: 0: 4327.8. Samples: 4032210. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 21:41:02,794][52567] Avg episode reward: [(0, '-2.737')] [2024-08-05 21:41:03,058][52671] DAMAGECOUNT value on done: 374.0 [2024-08-05 21:41:03,059][52671] Sum rewards: -2.147, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.240', 'ARMOR': '0.028', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.147', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.504', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.700', 'weapon3': '1.086', 'weapon2': '1.770', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:03,342][52667] DAMAGECOUNT value on done: 786.0 [2024-08-05 21:41:03,344][52667] Sum rewards: -0.088, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.936', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.140', 'weapon4': '0.152', 'ARMOR': '0.404', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.202', 'weapon3': '2.384'} [2024-08-05 21:41:03,356][52647] DAMAGECOUNT value on done: 547.0 [2024-08-05 21:41:03,482][52650] Updated weights for policy 0, policy_version 1971 (0.0021) [2024-08-05 21:41:03,506][52668] DAMAGECOUNT value on done: 764.0 [2024-08-05 21:41:03,510][52668] Sum rewards: -4.074, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.282', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'HITCOUNT': '0.110', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.196', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.128', 'weapon2': '2.124'} [2024-08-05 21:41:03,556][52649] DAMAGECOUNT value on done: 646.0 [2024-08-05 21:41:03,556][52649] Sum rewards: -2.881, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.009', 'ARMOR': '0.015', 'HEALTH': '0.020', 'AMMO4': '0.043', 'HITCOUNT': '0.130', 'AMMO3': '0.148', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.232', 'weapon3': '2.352'} [2024-08-05 21:41:03,823][52664] DAMAGECOUNT value on done: 459.0 [2024-08-05 21:41:03,826][52664] Sum rewards: -6.510, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.409', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.012', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.130', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.435', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon3': '1.326', 'weapon2': '1.964'} [2024-08-05 21:41:03,875][52658] DAMAGECOUNT value on done: 802.0 [2024-08-05 21:41:03,875][52658] Sum rewards: -3.556, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.350', 'ARMOR': '0.484', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.268', 'weapon2': '1.954'} [2024-08-05 21:41:04,229][52665] DAMAGECOUNT value on done: 688.0 [2024-08-05 21:41:04,316][52663] DAMAGECOUNT value on done: 490.0 [2024-08-05 21:41:04,317][52663] Sum rewards: -4.434, reward structure: {'DEATHCOUNT': '-9.750', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.036', 'ARMOR': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.114', 'AMMO3': '0.127', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'HEALTH': '0.222', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.750', 'weapon2': '1.530', 'weapon3': '2.020'} [2024-08-05 21:41:05,196][52660] DAMAGECOUNT value on done: 860.0 [2024-08-05 21:41:05,197][52660] Sum rewards: -1.076, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.212', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.164', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.735', 'WEAPON3': '0.850', 'weapon2': '1.000', 'weapon3': '1.974', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:05,620][52659] DAMAGECOUNT value on done: 535.0 [2024-08-05 21:41:05,620][52659] Sum rewards: -1.775, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.082', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.135', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.250', 'DAMAGECOUNT': '0.264', 'ARMOR': '0.513', 'WEAPON3': '0.750', 'weapon3': '1.532', 'weapon2': '1.956', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:05,732][52669] DAMAGECOUNT value on done: 816.0 [2024-08-05 21:41:05,733][52669] Sum rewards: -3.065, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.711', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.084', 'ARMOR': '0.092', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'weapon4': '0.238', 'DAMAGECOUNT': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.332', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:05,958][52667] DAMAGECOUNT value on done: 988.0 [2024-08-05 21:41:05,958][52667] Sum rewards: -2.655, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.864', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.084', 'AMMO3': '0.119', 'weapon4': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.855', 'weapon2': '1.578', 'weapon3': '1.982', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:06,284][52649] DAMAGECOUNT value on done: 782.0 [2024-08-05 21:41:06,286][52649] Sum rewards: -1.803, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.774', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.170', 'weapon4': '0.186', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.476', 'weapon3': '1.560'} [2024-08-05 21:41:06,313][52671] DAMAGECOUNT value on done: 550.0 [2024-08-05 21:41:06,315][52671] Sum rewards: -0.281, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.328', 'weapon3': '1.520'} [2024-08-05 21:41:06,343][52647] DAMAGECOUNT value on done: 796.0 [2024-08-05 21:41:06,345][52647] Sum rewards: -0.705, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.572', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.514', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.774', 'FRAGCOUNT': '1.000', 'weapon2': '1.182', 'weapon3': '1.704'} [2024-08-05 21:41:06,586][52658] DAMAGECOUNT value on done: 453.0 [2024-08-05 21:41:06,587][52658] Sum rewards: -4.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.732', 'AMMO2': '0.003', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'HITCOUNT': '0.200', 'weapon4': '0.212', 'DAMAGECOUNT': '0.672', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.346', 'weapon3': '2.102'} [2024-08-05 21:41:06,642][52668] DAMAGECOUNT value on done: 803.0 [2024-08-05 21:41:06,646][52668] Sum rewards: -1.467, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'weapon4': '0.044', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.130', 'ARMOR': '0.139', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.772', 'weapon3': '1.774'} [2024-08-05 21:41:07,074][52664] DAMAGECOUNT value on done: 695.0 [2024-08-05 21:41:07,076][52664] Sum rewards: -3.988, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'ARMOR': '0.520', 'weapon4': '0.528', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.750', 'weapon2': '0.864', 'weapon3': '1.954'} [2024-08-05 21:41:07,416][52663] DAMAGECOUNT value on done: 627.0 [2024-08-05 21:41:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17328.2). Total num frames: 16220160. Throughput: 0: 4317.8. Samples: 4057980. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-05 21:41:07,794][52567] Avg episode reward: [(0, '-2.588')] [2024-08-05 21:41:07,797][52614] Saving new best policy, reward=-2.588! [2024-08-05 21:41:08,233][52660] DAMAGECOUNT value on done: 442.0 [2024-08-05 21:41:08,233][52660] Sum rewards: -0.650, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.785', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.030', 'HITCOUNT': '0.090', 'AMMO3': '0.110', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.276', 'weapon3': '1.898'} [2024-08-05 21:41:08,349][52650] Updated weights for policy 0, policy_version 1981 (0.0031) [2024-08-05 21:41:08,363][52669] DAMAGECOUNT value on done: 543.0 [2024-08-05 21:41:08,363][52669] Sum rewards: 0.644, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.038', 'HITCOUNT': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'DAMAGECOUNT': '0.315', 'weapon4': '0.340', 'WEAPON3': '0.350', 'HEALTH': '0.395', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'weapon2': '1.230'} [2024-08-05 21:41:08,712][52659] DAMAGECOUNT value on done: 419.0 [2024-08-05 21:41:08,885][52649] DAMAGECOUNT value on done: 780.0 [2024-08-05 21:41:08,885][52649] Sum rewards: -2.211, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.824', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.240', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.990', 'ARMOR': '1.009', 'weapon2': '1.320', 'weapon3': '1.606', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:08,941][52667] DAMAGECOUNT value on done: 667.0 [2024-08-05 21:41:08,945][52667] Sum rewards: -4.437, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.122', 'weapon4': '0.200', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.534', 'weapon2': '1.616'} [2024-08-05 21:41:09,316][52671] DAMAGECOUNT value on done: 580.0 [2024-08-05 21:41:09,507][52658] DAMAGECOUNT value on done: 671.0 [2024-08-05 21:41:09,509][52658] Sum rewards: -0.430, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO2': '0.017', 'ARMOR': '0.072', 'AMMO4': '0.082', 'AMMO3': '0.086', 'HITCOUNT': '0.160', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.501', 'weapon4': '0.644', 'WEAPON3': '0.650', 'weapon2': '1.318', 'weapon3': '1.440', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:09,688][52647] DAMAGECOUNT value on done: 888.0 [2024-08-05 21:41:09,690][52647] Sum rewards: -3.732, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.144', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.160', 'weapon4': '0.240', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.010', 'weapon3': '2.080'} [2024-08-05 21:41:09,752][52668] DAMAGECOUNT value on done: 504.0 [2024-08-05 21:41:09,753][52668] Sum rewards: -3.778, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.368', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'ARMOR': '0.024', 'weapon5': '0.030', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.800', 'weapon3': '1.612', 'weapon2': '1.808', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:10,168][52663] DAMAGECOUNT value on done: 933.0 [2024-08-05 21:41:10,170][52663] Sum rewards: 2.492, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.913', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.136', 'WEAPON4': '0.300', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.542', 'DAMAGECOUNT': '1.290', 'weapon2': '1.382', 'weapon3': '1.558', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:10,204][52664] DAMAGECOUNT value on done: 1028.0 [2024-08-05 21:41:10,206][52664] Sum rewards: -0.891, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.060', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.080', 'AMMO3': '0.123', 'HITCOUNT': '0.180', 'weapon4': '0.246', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'weapon2': '1.540', 'weapon3': '1.630', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:11,388][52666] DAMAGECOUNT value on done: 564.0 [2024-08-05 21:41:11,389][52666] Sum rewards: -2.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.443', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.888', 'weapon2': '1.560', 'weapon3': '1.990', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:11,407][52669] DAMAGECOUNT value on done: 546.0 [2024-08-05 21:41:11,528][52660] DAMAGECOUNT value on done: 736.0 [2024-08-05 21:41:11,529][52660] Sum rewards: -4.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'weapon5': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'ARMOR': '0.040', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'AMMO3': '0.222', 'DAMAGECOUNT': '0.840', 'weapon2': '1.200', 'WEAPON3': '1.350', 'weapon3': '2.432', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:11,648][52667] DAMAGECOUNT value on done: 439.0 [2024-08-05 21:41:11,649][52667] Sum rewards: -4.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.008', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'ARMOR': '0.072', 'AMMO3': '0.119', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.644', 'weapon3': '1.864'} [2024-08-05 21:41:11,957][52649] DAMAGECOUNT value on done: 1000.0 [2024-08-05 21:41:12,059][52647] DAMAGECOUNT value on done: 719.0 [2024-08-05 21:41:12,060][52647] Sum rewards: -2.058, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.364', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.080', 'HITCOUNT': '0.100', 'ARMOR': '0.116', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.480', 'weapon4': '0.484', 'WEAPON3': '0.550', 'weapon3': '1.338', 'weapon2': '1.420', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:12,101][52658] DAMAGECOUNT value on done: 599.0 [2024-08-05 21:41:12,101][52658] Sum rewards: -4.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO2': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.180', 'HITCOUNT': '0.280', 'DAMAGECOUNT': '0.990', 'weapon2': '1.010', 'WEAPON3': '1.050', 'weapon3': '2.626', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:12,280][52659] DAMAGECOUNT value on done: 1033.0 [2024-08-05 21:41:12,281][52659] Sum rewards: -0.468, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.431', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.060', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.294', 'WEAPON3': '0.300', 'ARMOR': '0.519', 'weapon4': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.114', 'weapon3': '1.246'} [2024-08-05 21:41:12,721][52664] DAMAGECOUNT value on done: 445.0 [2024-08-05 21:41:12,721][52664] Sum rewards: -3.359, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.856', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.056', 'HITCOUNT': '0.060', 'AMMO3': '0.113', 'DAMAGECOUNT': '0.132', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.514', 'weapon2': '1.636'} [2024-08-05 21:41:12,735][52650] Updated weights for policy 0, policy_version 1991 (0.0012) [2024-08-05 21:41:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 16310272. Throughput: 0: 4316.9. Samples: 4083970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:41:12,795][52567] Avg episode reward: [(0, '-2.549')] [2024-08-05 21:41:12,795][52614] Saving new best policy, reward=-2.549! [2024-08-05 21:41:12,953][52671] DAMAGECOUNT value on done: 527.0 [2024-08-05 21:41:12,953][52671] Sum rewards: -0.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.244', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.008', 'weapon5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO3': '0.097', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.238', 'weapon3': '1.922'} [2024-08-05 21:41:13,205][52668] DAMAGECOUNT value on done: 640.0 [2024-08-05 21:41:13,206][52668] Sum rewards: -7.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.746', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'HITCOUNT': '0.090', 'ARMOR': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.186', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.458', 'weapon2': '1.888'} [2024-08-05 21:41:13,445][52663] DAMAGECOUNT value on done: 703.0 [2024-08-05 21:41:13,445][52663] Sum rewards: -6.528, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.294', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.086', 'HITCOUNT': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.315', 'weapon4': '0.514', 'WEAPON3': '0.850', 'weapon3': '1.368', 'weapon2': '1.382'} [2024-08-05 21:41:13,492][52670] DAMAGECOUNT value on done: 542.0 [2024-08-05 21:41:14,183][52667] DAMAGECOUNT value on done: 905.0 [2024-08-05 21:41:14,184][52667] Sum rewards: -1.286, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.158', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.648', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.332', 'weapon3': '1.958'} [2024-08-05 21:41:14,609][52669] DAMAGECOUNT value on done: 803.0 [2024-08-05 21:41:14,609][52669] Sum rewards: 3.699, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.282', 'AMMO2': '0.009', 'AMMO3': '0.030', 'AMMO4': '0.043', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'weapon4': '0.300', 'DAMAGECOUNT': '0.462', 'ARMOR': '0.527', 'weapon3': '0.778', 'weapon2': '0.832', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:14,626][52666] DAMAGECOUNT value on done: 411.0 [2024-08-05 21:41:14,626][52666] Sum rewards: -1.879, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.262', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.048', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.124', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.804', 'FRAGCOUNT': '1.000', 'weapon3': '1.610', 'weapon2': '2.128'} [2024-08-05 21:41:14,661][52658] DAMAGECOUNT value on done: 1088.0 [2024-08-05 21:41:14,661][52658] Sum rewards: -0.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.612', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.041', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.174', 'WEAPON5': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.278', 'weapon3': '1.286', 'weapon2': '1.974', 'FRAGCOUNT': '6.000'} [2024-08-05 21:41:14,843][52660] DAMAGECOUNT value on done: 418.0 [2024-08-05 21:41:14,845][52660] Sum rewards: -1.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.935', 'AMMO2': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.035', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.286', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.900', 'weapon2': '1.486', 'weapon3': '1.796', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:15,039][52647] DAMAGECOUNT value on done: 370.0 [2024-08-05 21:41:15,522][52659] DAMAGECOUNT value on done: 582.0 [2024-08-05 21:41:15,525][52659] Sum rewards: -5.857, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.732', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.034', 'weapon4': '0.058', 'AMMO4': '0.060', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.584', 'weapon3': '2.092'} [2024-08-05 21:41:15,821][52664] DAMAGECOUNT value on done: 400.0 [2024-08-05 21:41:16,293][52663] DAMAGECOUNT value on done: 927.0 [2024-08-05 21:41:16,294][52663] Sum rewards: -0.224, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.024', 'AMMO2': '0.013', 'AMMO4': '0.066', 'ARMOR': '0.068', 'HITCOUNT': '0.110', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.262', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.650', 'weapon3': '1.430', 'weapon2': '1.452', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:16,298][52671] DAMAGECOUNT value on done: 1152.0 [2024-08-05 21:41:16,298][52671] Sum rewards: -4.203, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.120', 'AMMO2': '0.011', 'AMMO4': '0.054', 'ARMOR': '0.108', 'AMMO3': '0.135', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.404', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.512', 'weapon3': '1.678'} [2024-08-05 21:41:16,396][52668] DAMAGECOUNT value on done: 633.0 [2024-08-05 21:41:16,396][52668] Sum rewards: 0.721, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.504', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.909', 'weapon2': '1.084', 'weapon3': '1.398', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:16,464][52670] DAMAGECOUNT value on done: 672.0 [2024-08-05 21:41:16,466][52670] Sum rewards: -1.020, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.054', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'ARMOR': '0.104', 'AMMO4': '0.116', 'HITCOUNT': '0.130', 'weapon4': '0.186', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.710', 'weapon2': '1.830'} [2024-08-05 21:41:16,866][52667] DAMAGECOUNT value on done: 835.0 [2024-08-05 21:41:17,305][52669] DAMAGECOUNT value on done: 939.0 [2024-08-05 21:41:17,305][52669] Sum rewards: -0.789, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.056', 'AMMO2': '0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'weapon4': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.442', 'FRAGCOUNT': '2.000', 'weapon3': '2.134'} [2024-08-05 21:41:17,485][52658] DAMAGECOUNT value on done: 598.0 [2024-08-05 21:41:17,486][52658] Sum rewards: -4.416, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.995', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.064', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'HITCOUNT': '0.110', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.270', 'DAMAGECOUNT': '0.345', 'weapon2': '0.634', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '2.210'} [2024-08-05 21:41:17,694][52666] DAMAGECOUNT value on done: 519.0 [2024-08-05 21:41:17,696][52666] Sum rewards: 1.080, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.194', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.070', 'weapon4': '0.150', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.350', 'FRAGCOUNT': '1.000', 'weapon3': '1.146', 'weapon2': '1.160'} [2024-08-05 21:41:17,762][52650] Updated weights for policy 0, policy_version 2001 (0.0014) [2024-08-05 21:41:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17356.0). Total num frames: 16392192. Throughput: 0: 4315.3. Samples: 4096680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:41:17,794][52567] Avg episode reward: [(0, '-2.504')] [2024-08-05 21:41:17,797][52614] Saving new best policy, reward=-2.504! [2024-08-05 21:41:17,962][52647] DAMAGECOUNT value on done: 891.0 [2024-08-05 21:41:17,970][52647] Sum rewards: -5.285, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.561', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'ARMOR': '0.016', 'AMMO3': '0.162', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.400', 'weapon3': '2.260'} [2024-08-05 21:41:18,041][52660] DAMAGECOUNT value on done: 482.0 [2024-08-05 21:41:18,043][52660] Sum rewards: -3.014, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.720', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.414', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.176', 'weapon3': '1.800'} [2024-08-05 21:41:18,615][52664] DAMAGECOUNT value on done: 688.0 [2024-08-05 21:41:18,615][52664] Sum rewards: -4.490, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.608', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.145', 'weapon4': '0.212', 'DAMAGECOUNT': '0.480', 'ARMOR': '0.563', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.398', 'weapon3': '1.944'} [2024-08-05 21:41:18,975][52659] DAMAGECOUNT value on done: 431.0 [2024-08-05 21:41:18,977][52659] Sum rewards: -5.990, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.060', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'weapon5': '0.066', 'HITCOUNT': '0.130', 'AMMO3': '0.160', 'weapon4': '0.174', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.800', 'weapon2': '1.616', 'weapon3': '1.814'} [2024-08-05 21:41:19,136][52663] DAMAGECOUNT value on done: 492.0 [2024-08-05 21:41:19,137][52663] Sum rewards: 0.167, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.184', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.022', 'AMMO3': '0.112', 'HITCOUNT': '0.180', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.675', 'weapon2': '1.734', 'weapon3': '1.914', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:19,288][52667] DAMAGECOUNT value on done: 686.0 [2024-08-05 21:41:19,467][52668] DAMAGECOUNT value on done: 471.0 [2024-08-05 21:41:19,475][52668] Sum rewards: -3.638, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.255', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.330', 'weapon4': '0.458', 'ARMOR': '0.475', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '1.622'} [2024-08-05 21:41:19,588][52671] DAMAGECOUNT value on done: 869.0 [2024-08-05 21:41:19,765][52670] DAMAGECOUNT value on done: 758.0 [2024-08-05 21:41:19,768][52670] Sum rewards: 0.729, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'ARMOR': '0.088', 'weapon4': '0.138', 'AMMO3': '0.144', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.960', 'weapon2': '1.274', 'weapon3': '2.160', 'FRAGCOUNT': '4.000'} [2024-08-05 21:41:20,036][52658] DAMAGECOUNT value on done: 190.0 [2024-08-05 21:41:20,176][52669] DAMAGECOUNT value on done: 407.0 [2024-08-05 21:41:20,967][52666] DAMAGECOUNT value on done: 519.0 [2024-08-05 21:41:20,970][52666] Sum rewards: -0.417, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.111', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'ARMOR': '0.542', 'DAMAGECOUNT': '0.582', 'WEAPON3': '0.750', 'weapon2': '1.464', 'FRAGCOUNT': '2.000', 'weapon3': '2.106'} [2024-08-05 21:41:20,989][52660] DAMAGECOUNT value on done: 851.0 [2024-08-05 21:41:20,992][52660] Sum rewards: -7.664, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.192', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.172', 'AMMO3': '0.184', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.780', 'WEAPON3': '1.200', 'weapon2': '1.460', 'FRAGCOUNT': '2.000', 'weapon3': '2.056'} [2024-08-05 21:41:21,011][52647] DAMAGECOUNT value on done: 562.0 [2024-08-05 21:41:21,716][52663] DAMAGECOUNT value on done: 679.0 [2024-08-05 21:41:21,717][52663] Sum rewards: -2.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.517', 'AMMO2': '0.013', 'ARMOR': '0.044', 'AMMO4': '0.065', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.360', 'DAMAGECOUNT': '0.543', 'WEAPON3': '0.600', 'weapon2': '1.370', 'weapon3': '1.542', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:21,731][52664] DAMAGECOUNT value on done: 610.0 [2024-08-05 21:41:21,734][52664] Sum rewards: -6.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.235', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.179', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.456', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.328', 'weapon3': '1.768'} [2024-08-05 21:41:21,891][52667] DAMAGECOUNT value on done: 838.0 [2024-08-05 21:41:21,891][52667] Sum rewards: -0.784, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.025', 'AMMO4': '-0.112', 'AMMO2': '-0.022', 'AMMO5': '0.009', 'weapon5': '0.010', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.972', 'weapon3': '1.590', 'weapon2': '1.882', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:21,965][52659] DAMAGECOUNT value on done: 939.0 [2024-08-05 21:41:21,966][52659] Sum rewards: -3.012, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.204', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.360', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.335', 'weapon2': '1.676', 'FRAGCOUNT': '2.000', 'weapon3': '2.050'} [2024-08-05 21:41:22,337][52671] DAMAGECOUNT value on done: 791.0 [2024-08-05 21:41:22,337][52671] Sum rewards: -2.404, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.688', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.022', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.792', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.644', 'weapon3': '1.962'} [2024-08-05 21:41:22,465][52650] Updated weights for policy 0, policy_version 2011 (0.0025) [2024-08-05 21:41:22,635][52658] DAMAGECOUNT value on done: 1069.0 [2024-08-05 21:41:22,637][52658] Sum rewards: -1.800, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.156', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.014', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.072', 'weapon5': '0.078', 'HITCOUNT': '0.100', 'weapon4': '0.112', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.432', 'weapon2': '1.794'} [2024-08-05 21:41:22,686][52668] DAMAGECOUNT value on done: 711.0 [2024-08-05 21:41:22,686][52668] Sum rewards: -0.393, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.520', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon4': '0.264', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.250', 'weapon3': '1.854'} [2024-08-05 21:41:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17383.7). Total num frames: 16482304. Throughput: 0: 4304.2. Samples: 4122730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:41:22,794][52567] Avg episode reward: [(0, '-2.640')] [2024-08-05 21:41:23,061][52669] DAMAGECOUNT value on done: 879.0 [2024-08-05 21:41:23,069][52669] Sum rewards: -1.822, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.374', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'ARMOR': '0.076', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.356', 'weapon3': '1.480'} [2024-08-05 21:41:23,078][52670] DAMAGECOUNT value on done: 555.0 [2024-08-05 21:41:23,079][52670] Sum rewards: -1.979, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.957', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'HITCOUNT': '0.190', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.720', 'WEAPON3': '0.850', 'weapon2': '1.448', 'FRAGCOUNT': '2.000', 'weapon3': '2.098'} [2024-08-05 21:41:23,998][52666] DAMAGECOUNT value on done: 701.0 [2024-08-05 21:41:23,998][52666] Sum rewards: -1.630, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.074', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.354', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.765', 'ARMOR': '0.905', 'weapon3': '1.252', 'weapon2': '1.654', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:24,296][52664] DAMAGECOUNT value on done: 742.0 [2024-08-05 21:41:24,297][52664] Sum rewards: -4.956, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.058', 'HITCOUNT': '0.100', 'AMMO4': '0.121', 'weapon4': '0.122', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.306', 'WEAPON3': '0.750', 'weapon3': '1.524', 'weapon2': '1.852'} [2024-08-05 21:41:24,322][52660] DAMAGECOUNT value on done: 632.0 [2024-08-05 21:41:24,325][52660] Sum rewards: -4.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.290', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon4': '0.006', 'weapon7': '0.058', 'ARMOR': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.160', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.876', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '1.602'} [2024-08-05 21:41:24,842][52659] DAMAGECOUNT value on done: 831.0 [2024-08-05 21:41:24,842][52659] Sum rewards: -2.190, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.220', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon4': '0.128', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.678', 'WEAPON3': '0.750', 'ARMOR': '0.926', 'weapon2': '1.540', 'weapon3': '1.590'} [2024-08-05 21:41:24,869][52663] DAMAGECOUNT value on done: 432.0 [2024-08-05 21:41:24,870][52663] Sum rewards: -5.929, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'DAMAGECOUNT': '0.303', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'weapon2': '1.540', 'weapon3': '2.146'} [2024-08-05 21:41:25,236][52671] DAMAGECOUNT value on done: 1441.0 [2024-08-05 21:41:25,238][52671] Sum rewards: -3.829, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.646', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.005', 'AMMO5': '0.011', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'weapon5': '0.130', 'HITCOUNT': '0.140', 'weapon4': '0.152', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.417', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.172', 'weapon3': '1.952'} [2024-08-05 21:41:25,956][52668] DAMAGECOUNT value on done: 610.0 [2024-08-05 21:41:25,973][52658] DAMAGECOUNT value on done: 867.0 [2024-08-05 21:41:25,975][52658] Sum rewards: -2.046, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'AMMO2': '0.011', 'AMMO4': '0.053', 'ARMOR': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'HITCOUNT': '0.270', 'weapon4': '0.354', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.260', 'weapon2': '1.276', 'weapon3': '1.768', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:26,047][52670] DAMAGECOUNT value on done: 770.0 [2024-08-05 21:41:26,048][52670] Sum rewards: -2.628, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.425', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.160', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.750', 'weapon2': '1.634', 'weapon3': '1.710', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:27,067][52666] DAMAGECOUNT value on done: 608.0 [2024-08-05 21:41:27,069][52666] Sum rewards: -2.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.428', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'ARMOR': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'HITCOUNT': '0.240', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.071', 'weapon2': '1.342', 'weapon3': '2.196', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:27,377][52650] Updated weights for policy 0, policy_version 2021 (0.0026) [2024-08-05 21:41:27,459][52664] DAMAGECOUNT value on done: 644.0 [2024-08-05 21:41:27,460][52664] Sum rewards: 0.706, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.392', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.172', 'ARMOR': '0.413', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.510', 'weapon2': '1.440', 'weapon3': '1.690', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:27,511][52663] DAMAGECOUNT value on done: 501.0 [2024-08-05 21:41:27,620][52660] DAMAGECOUNT value on done: 736.0 [2024-08-05 21:41:27,620][52660] Sum rewards: -0.696, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.088', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'HITCOUNT': '0.120', 'weapon4': '0.158', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.678', 'FRAGCOUNT': '1.000', 'weapon3': '1.522', 'weapon2': '1.738'} [2024-08-05 21:41:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 16564224. Throughput: 0: 4305.3. Samples: 4148560. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 21:41:27,794][52567] Avg episode reward: [(0, '-2.672')] [2024-08-05 21:41:27,946][52659] DAMAGECOUNT value on done: 820.0 [2024-08-05 21:41:28,469][52671] DAMAGECOUNT value on done: 802.0 [2024-08-05 21:41:28,470][52671] Sum rewards: -1.201, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.577', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon7': '0.064', 'weapon4': '0.086', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '1.246', 'weapon3': '1.586'} [2024-08-05 21:41:29,121][52670] DAMAGECOUNT value on done: 624.0 [2024-08-05 21:41:29,121][52670] Sum rewards: -3.505, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.206', 'AMMO2': '0.008', 'weapon4': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.143', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.572', 'weapon3': '2.074'} [2024-08-05 21:41:29,207][52668] DAMAGECOUNT value on done: 675.0 [2024-08-05 21:41:29,210][52668] Sum rewards: -3.920, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.784', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.076', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.180', 'WEAPON4': '0.400', 'weapon4': '0.446', 'DAMAGECOUNT': '0.534', 'WEAPON3': '0.550', 'weapon3': '1.120', 'weapon2': '1.994', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:30,053][52666] DAMAGECOUNT value on done: 804.0 [2024-08-05 21:41:30,053][52666] Sum rewards: 1.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.530', 'AMMO2': '0.011', 'AMMO5': '0.014', 'AMMO4': '0.055', 'weapon5': '0.060', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.376', 'DAMAGECOUNT': '1.590', 'weapon3': '1.960', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:30,100][52664] DAMAGECOUNT value on done: 746.0 [2024-08-05 21:41:30,102][52664] Sum rewards: -1.096, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.026', 'ARMOR': '0.036', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.020', 'weapon2': '1.394', 'weapon3': '2.210', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:30,585][52659] DAMAGECOUNT value on done: 1090.0 [2024-08-05 21:41:30,586][52659] Sum rewards: -1.987, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.106', 'weapon4': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.185', 'weapon2': '1.658', 'weapon3': '1.760', 'FRAGCOUNT': '2.500'} [2024-08-05 21:41:30,759][52660] DAMAGECOUNT value on done: 929.0 [2024-08-05 21:41:30,760][52660] Sum rewards: -1.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.308', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.272', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon2': '1.448', 'weapon3': '1.852'} [2024-08-05 21:41:30,897][52671] DAMAGECOUNT value on done: 736.0 [2024-08-05 21:41:30,898][52671] Sum rewards: -0.316, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.735', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO3': '0.046', 'weapon7': '0.060', 'HITCOUNT': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.455', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'weapon2': '1.196'} [2024-08-05 21:41:32,023][52650] Updated weights for policy 0, policy_version 2031 (0.0012) [2024-08-05 21:41:32,224][52668] DAMAGECOUNT value on done: 554.0 [2024-08-05 21:41:32,226][52668] Sum rewards: -0.838, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.224', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.127', 'weapon4': '0.138', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.519', 'WEAPON3': '0.800', 'weapon3': '1.488', 'weapon2': '1.744', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:32,327][52670] DAMAGECOUNT value on done: 600.0 [2024-08-05 21:41:32,330][52670] Sum rewards: -3.159, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.742', 'weapon3': '2.016'} [2024-08-05 21:41:32,706][52659] DAMAGECOUNT value on done: 1754.0 [2024-08-05 21:41:32,707][52659] Sum rewards: 4.945, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.032', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'weapon7': '0.050', 'ARMOR': '0.084', 'AMMO3': '0.103', 'weapon4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'weapon2': '1.332', 'weapon3': '1.774', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '6.000'} [2024-08-05 21:41:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 16646144. Throughput: 0: 4300.2. Samples: 4161390. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:41:32,794][52567] Avg episode reward: [(0, '-2.444')] [2024-08-05 21:41:32,795][52614] Saving new best policy, reward=-2.444! [2024-08-05 21:41:33,016][52671] DAMAGECOUNT value on done: 696.0 [2024-08-05 21:41:33,017][52671] Sum rewards: -0.233, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.033', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.194', 'weapon3': '1.712', 'weapon2': '1.764'} [2024-08-05 21:41:33,164][52664] DAMAGECOUNT value on done: 1073.0 [2024-08-05 21:41:33,166][52664] Sum rewards: 1.546, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.050', 'ARMOR': '0.052', 'HEALTH': '0.076', 'AMMO3': '0.082', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.479', 'weapon2': '1.530', 'weapon3': '1.880', 'FRAGCOUNT': '2.500'} [2024-08-05 21:41:33,501][52666] DAMAGECOUNT value on done: 728.0 [2024-08-05 21:41:33,501][52666] Sum rewards: -0.991, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.958', 'AMMO2': '0.018', 'ARMOR': '0.051', 'weapon7': '0.076', 'AMMO3': '0.084', 'AMMO4': '0.092', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.358', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.550', 'weapon3': '0.674', 'weapon2': '0.942', 'FRAGCOUNT': '1.000'} [2024-08-05 21:41:33,576][52614] Signal inference workers to stop experience collection... (350 times) [2024-08-05 21:41:33,576][52614] Signal inference workers to resume experience collection... (350 times) [2024-08-05 21:41:33,661][52650] InferenceWorker_p0-w0: stopping experience collection (350 times) [2024-08-05 21:41:33,661][52650] InferenceWorker_p0-w0: resuming experience collection (350 times) [2024-08-05 21:41:33,672][52660] DAMAGECOUNT value on done: 702.0 [2024-08-05 21:41:33,672][52660] Sum rewards: -3.421, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.317', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon4': '0.090', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.542', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.204', 'weapon3': '2.418'} [2024-08-05 21:41:35,128][52668] DAMAGECOUNT value on done: 656.0 [2024-08-05 21:41:35,130][52668] Sum rewards: -6.662, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.980', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'HITCOUNT': '0.030', 'ARMOR': '0.040', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'DAMAGECOUNT': '0.120', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon3': '1.068', 'weapon2': '1.880'} [2024-08-05 21:41:35,259][52659] DAMAGECOUNT value on done: 785.0 [2024-08-05 21:41:35,260][52659] Sum rewards: -2.357, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.944', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.040', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.598', 'weapon3': '1.850', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:35,516][52671] DAMAGECOUNT value on done: 517.0 [2024-08-05 21:41:35,516][52671] Sum rewards: -5.737, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.466', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.021', 'HITCOUNT': '0.080', 'AMMO3': '0.095', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.270', 'weapon4': '0.340', 'ARMOR': '0.501', 'WEAPON3': '0.600', 'weapon3': '1.500', 'weapon2': '1.550'} [2024-08-05 21:41:35,690][52670] DAMAGECOUNT value on done: 600.0 [2024-08-05 21:41:35,693][52670] Sum rewards: -1.610, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.018', 'ARMOR': '0.024', 'AMMO2': '0.026', 'weapon4': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.131', 'HITCOUNT': '0.150', 'HEALTH': '0.388', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.550', 'weapon2': '1.578', 'weapon3': '1.854'} [2024-08-05 21:41:36,518][52660] DAMAGECOUNT value on done: 655.0 [2024-08-05 21:41:36,566][52666] DAMAGECOUNT value on done: 711.0 [2024-08-05 21:41:36,569][52666] Sum rewards: -0.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.980', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.016', 'ARMOR': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.095', 'weapon2': '1.602', 'weapon3': '1.632', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:36,882][52650] Updated weights for policy 0, policy_version 2041 (0.0014) [2024-08-05 21:41:37,705][52659] DAMAGECOUNT value on done: 977.0 [2024-08-05 21:41:37,706][52659] Sum rewards: -0.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.046', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.280', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.966', 'weapon3': '1.508', 'weapon2': '1.588'} [2024-08-05 21:41:37,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17066.6, 300 sec: 17300.4). Total num frames: 16728064. Throughput: 0: 4294.2. Samples: 4187150. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 21:41:37,795][52567] Avg episode reward: [(0, '-2.419')] [2024-08-05 21:41:37,891][52614] Saving new best policy, reward=-2.419! [2024-08-05 21:41:37,983][52671] DAMAGECOUNT value on done: 612.0 [2024-08-05 21:41:38,006][52668] DAMAGECOUNT value on done: 613.0 [2024-08-05 21:41:38,007][52668] Sum rewards: -2.414, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.241', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.120', 'HITCOUNT': '0.210', 'weapon4': '0.234', 'ARMOR': '0.512', 'DAMAGECOUNT': '0.777', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.586', 'weapon2': '1.720'} [2024-08-05 21:41:38,525][52670] DAMAGECOUNT value on done: 405.0 [2024-08-05 21:41:38,527][52670] Sum rewards: -2.084, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.690', 'AMMO2': '0.014', 'ARMOR': '0.024', 'AMMO4': '0.069', 'weapon4': '0.114', 'AMMO3': '0.123', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.408', 'weapon2': '1.824'} [2024-08-05 21:41:39,267][52660] DAMAGECOUNT value on done: 880.0 [2024-08-05 21:41:39,268][52660] Sum rewards: 3.985, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.017', 'AMMO2': '0.038', 'AMMO3': '0.111', 'weapon4': '0.176', 'AMMO4': '0.191', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.466', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.410', 'weapon2': '1.650', 'weapon3': '1.920', 'FRAGCOUNT': '5.000'} [2024-08-05 21:41:39,481][52666] DAMAGECOUNT value on done: 792.0 [2024-08-05 21:41:39,481][52666] Sum rewards: 0.786, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'ARMOR': '0.063', 'AMMO4': '0.075', 'AMMO3': '0.124', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'HEALTH': '0.812', 'weapon2': '1.900', 'weapon3': '1.946', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:40,944][52659] DAMAGECOUNT value on done: 451.0 [2024-08-05 21:41:41,352][52671] DAMAGECOUNT value on done: 1350.0 [2024-08-05 21:41:41,353][52671] Sum rewards: -3.398, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.630', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'ARMOR': '0.096', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.448', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.404', 'weapon3': '1.818', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:41,407][52650] Updated weights for policy 0, policy_version 2051 (0.0011) [2024-08-05 21:41:41,543][52670] DAMAGECOUNT value on done: 674.0 [2024-08-05 21:41:41,544][52670] Sum rewards: -1.310, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.470', 'AMMO2': '0.005', 'AMMO4': '0.025', 'HITCOUNT': '0.030', 'ARMOR': '0.068', 'DAMAGECOUNT': '0.075', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.220', 'weapon3': '1.552'} [2024-08-05 21:41:42,580][52666] DAMAGECOUNT value on done: 881.0 [2024-08-05 21:41:42,580][52666] Sum rewards: -0.547, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.273', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'HITCOUNT': '0.280', 'ARMOR': '0.465', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.053', 'weapon2': '1.504', 'weapon3': '2.216', 'FRAGCOUNT': '4.000'} [2024-08-05 21:41:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17203.2, 300 sec: 17328.2). Total num frames: 16818176. Throughput: 0: 4297.8. Samples: 4212930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:41:42,794][52567] Avg episode reward: [(0, '-2.365')] [2024-08-05 21:41:42,795][52614] Saving new best policy, reward=-2.365! [2024-08-05 21:41:43,900][52659] DAMAGECOUNT value on done: 704.0 [2024-08-05 21:41:44,183][52671] DAMAGECOUNT value on done: 554.0 [2024-08-05 21:41:44,872][52670] DAMAGECOUNT value on done: 795.0 [2024-08-05 21:41:44,874][52670] Sum rewards: -3.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'ARMOR': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.732', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.518', 'weapon3': '2.094'} [2024-08-05 21:41:45,894][52666] DAMAGECOUNT value on done: 545.0 [2024-08-05 21:41:45,894][52666] Sum rewards: -3.833, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon7': '0.034', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.488', 'weapon2': '1.858'} [2024-08-05 21:41:46,485][52650] Updated weights for policy 0, policy_version 2061 (0.0013) [2024-08-05 21:41:46,641][52659] DAMAGECOUNT value on done: 761.0 [2024-08-05 21:41:46,656][52659] Sum rewards: -0.094, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.018', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'HITCOUNT': '0.130', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.338', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.154', 'weapon3': '1.910', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:46,938][52671] DAMAGECOUNT value on done: 928.0 [2024-08-05 21:41:46,939][52671] Sum rewards: -1.288, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.080', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.308', 'HITCOUNT': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.064', 'DAMAGECOUNT': '1.290', 'weapon3': '2.072', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:47,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17203.1, 300 sec: 17300.4). Total num frames: 16900096. Throughput: 0: 4300.6. Samples: 4225740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:41:47,795][52567] Avg episode reward: [(0, '-2.364')] [2024-08-05 21:41:48,020][52670] DAMAGECOUNT value on done: 868.0 [2024-08-05 21:41:48,028][52670] Sum rewards: -2.337, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.040', 'AMMO4': '0.057', 'weapon4': '0.058', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.276', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.230', 'weapon3': '2.148'} [2024-08-05 21:41:48,690][52811] DAMAGECOUNT value on done: 756.0 [2024-08-05 21:41:48,893][52666] DAMAGECOUNT value on done: 661.0 [2024-08-05 21:41:48,893][52666] Sum rewards: -3.923, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.748', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.370', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.116', 'weapon3': '1.554'} [2024-08-05 21:41:49,567][52659] DAMAGECOUNT value on done: 827.0 [2024-08-05 21:41:49,568][52659] Sum rewards: -4.890, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'AMMO3': '0.192', 'DAMAGECOUNT': '0.675', 'weapon2': '0.940', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'weapon3': '2.664'} [2024-08-05 21:41:50,770][52803] DAMAGECOUNT value on done: 768.0 [2024-08-05 21:41:50,771][52803] Sum rewards: -5.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.657', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.084', 'AMMO4': '0.092', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.214', 'DAMAGECOUNT': '1.224', 'weapon3': '2.316', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:51,087][52795] DAMAGECOUNT value on done: 681.0 [2024-08-05 21:41:51,193][52650] Updated weights for policy 0, policy_version 2071 (0.0018) [2024-08-05 21:41:51,221][52670] DAMAGECOUNT value on done: 422.0 [2024-08-05 21:41:51,819][52811] DAMAGECOUNT value on done: 404.0 [2024-08-05 21:41:51,819][52811] Sum rewards: -0.074, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.126', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'ARMOR': '0.053', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.172', 'HITCOUNT': '0.180', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.561', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '2.066'} [2024-08-05 21:41:52,167][52666] DAMAGECOUNT value on done: 822.0 [2024-08-05 21:41:52,170][52666] Sum rewards: -4.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-3.030', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.139', 'weapon4': '0.238', 'DAMAGECOUNT': '0.315', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.344', 'weapon3': '2.138'} [2024-08-05 21:41:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17356.0). Total num frames: 16998400. Throughput: 0: 4306.7. Samples: 4251780. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 21:41:52,794][52567] Avg episode reward: [(0, '-2.396')] [2024-08-05 21:41:53,979][52803] DAMAGECOUNT value on done: 1021.0 [2024-08-05 21:41:53,979][52803] Sum rewards: 0.707, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.196', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon7': '0.066', 'AMMO4': '0.068', 'weapon5': '0.082', 'weapon4': '0.086', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.462', 'weapon3': '1.722', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '2.500'} [2024-08-05 21:41:54,306][52795] DAMAGECOUNT value on done: 756.0 [2024-08-05 21:41:54,308][52795] Sum rewards: -2.089, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.676', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.520', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.005', 'weapon3': '1.262', 'weapon2': '1.916', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:54,395][52670] DAMAGECOUNT value on done: 874.0 [2024-08-05 21:41:54,397][52670] Sum rewards: -1.648, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.064', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.165', 'HITCOUNT': '0.250', 'ARMOR': '0.487', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.005', 'weapon2': '1.348', 'weapon3': '2.234', 'FRAGCOUNT': '2.500'} [2024-08-05 21:41:54,947][52811] DAMAGECOUNT value on done: 932.0 [2024-08-05 21:41:54,947][52811] Sum rewards: -2.425, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.379', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.071', 'AMMO3': '0.122', 'weapon4': '0.122', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.387', 'ARMOR': '0.459', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.456', 'weapon3': '1.712'} [2024-08-05 21:41:55,397][52666] DAMAGECOUNT value on done: 639.0 [2024-08-05 21:41:55,621][52650] Updated weights for policy 0, policy_version 2081 (0.0021) [2024-08-05 21:41:57,081][52803] DAMAGECOUNT value on done: 576.0 [2024-08-05 21:41:57,082][52803] Sum rewards: -3.254, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.965', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon5': '0.040', 'AMMO3': '0.086', 'ARMOR': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.636', 'DAMAGECOUNT': '0.825', 'weapon2': '1.184', 'weapon3': '1.544'} [2024-08-05 21:41:57,371][52795] DAMAGECOUNT value on done: 839.0 [2024-08-05 21:41:57,372][52795] Sum rewards: -4.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.018', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'HITCOUNT': '0.280', 'DAMAGECOUNT': '1.020', 'WEAPON3': '1.050', 'weapon2': '1.552', 'weapon3': '1.974', 'FRAGCOUNT': '2.000'} [2024-08-05 21:41:57,746][52670] DAMAGECOUNT value on done: 974.0 [2024-08-05 21:41:57,746][52670] Sum rewards: 1.849, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.146', 'HEALTH': '0.180', 'HITCOUNT': '0.310', 'ARMOR': '0.448', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.371', 'weapon2': '1.568', 'weapon3': '2.100', 'FRAGCOUNT': '3.000'} [2024-08-05 21:41:57,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17203.2, 300 sec: 17328.2). Total num frames: 17080320. Throughput: 0: 4308.7. Samples: 4277860. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-05 21:41:57,794][52567] Avg episode reward: [(0, '-2.497')] [2024-08-05 21:41:58,164][52811] DAMAGECOUNT value on done: 744.0 [2024-08-05 21:41:58,165][52811] Sum rewards: -1.552, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.255', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.550', 'weapon2': '1.600', 'weapon3': '1.876'} [2024-08-05 21:41:58,783][52666] DAMAGECOUNT value on done: 510.0 [2024-08-05 21:41:58,784][52666] Sum rewards: 1.103, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.083', 'AMMO4': '0.110', 'weapon4': '0.126', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'weapon2': '1.354', 'weapon3': '1.492', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:00,200][52803] DAMAGECOUNT value on done: 913.0 [2024-08-05 21:42:00,201][52803] Sum rewards: -0.411, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.871', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon7': '0.086', 'AMMO3': '0.090', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.428', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.059', 'weapon2': '1.188', 'weapon3': '1.930', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:00,613][52795] DAMAGECOUNT value on done: 1622.0 [2024-08-05 21:42:00,614][52795] Sum rewards: 3.733, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.438', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.032', 'weapon7': '0.072', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'HITCOUNT': '0.130', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.294', 'ARMOR': '0.472', 'WEAPON3': '0.500', 'weapon2': '1.300', 'DAMAGECOUNT': '1.389', 'weapon3': '1.674', 'FRAGCOUNT': '2.500'} [2024-08-05 21:42:00,723][52650] Updated weights for policy 0, policy_version 2091 (0.0013) [2024-08-05 21:42:00,907][52670] DAMAGECOUNT value on done: 458.0 [2024-08-05 21:42:00,908][52670] Sum rewards: -4.548, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.067', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.108', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.392', 'DAMAGECOUNT': '0.435', 'ARMOR': '0.496', 'WEAPON3': '0.700', 'weapon3': '1.340', 'weapon2': '1.428', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:01,276][52811] DAMAGECOUNT value on done: 844.0 [2024-08-05 21:42:01,279][52811] Sum rewards: -4.789, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.022', 'AMMO2': '0.009', 'AMMO4': '0.044', 'ARMOR': '0.056', 'HITCOUNT': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.152', 'DAMAGECOUNT': '0.369', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.314', 'weapon3': '1.908'} [2024-08-05 21:42:01,936][52666] DAMAGECOUNT value on done: 645.0 [2024-08-05 21:42:01,937][52666] Sum rewards: -0.453, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.845', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.006', 'ARMOR': '0.028', 'weapon5': '0.050', 'AMMO3': '0.066', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.416', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.648', 'weapon2': '1.078', 'weapon3': '1.364'} [2024-08-05 21:42:02,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17203.1, 300 sec: 17328.2). Total num frames: 17162240. Throughput: 0: 4318.7. Samples: 4291020. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:42:02,795][52567] Avg episode reward: [(0, '-2.365')] [2024-08-05 21:42:03,161][52803] DAMAGECOUNT value on done: 596.0 [2024-08-05 21:42:03,164][52803] Sum rewards: 0.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.965', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon5': '0.038', 'ARMOR': '0.044', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.136', 'HITCOUNT': '0.180', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.936', 'weapon2': '1.418', 'weapon3': '2.136', 'FRAGCOUNT': '4.000'} [2024-08-05 21:42:03,854][52820] DAMAGECOUNT value on done: 487.0 [2024-08-05 21:42:03,854][52820] Sum rewards: -2.908, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.260', 'AMMO2': '0.015', 'AMMO4': '0.073', 'HITCOUNT': '0.120', 'AMMO3': '0.128', 'weapon4': '0.238', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.480', 'ARMOR': '0.488', 'WEAPON3': '0.750', 'weapon3': '1.758', 'weapon2': '1.802', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:04,023][52795] DAMAGECOUNT value on done: 639.0 [2024-08-05 21:42:04,025][52795] Sum rewards: -3.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'ARMOR': '0.055', 'HITCOUNT': '0.110', 'AMMO3': '0.123', 'weapon4': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.650', 'weapon3': '1.408', 'weapon2': '1.860', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:04,243][52670] DAMAGECOUNT value on done: 778.0 [2024-08-05 21:42:04,245][52670] Sum rewards: -0.327, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.652', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.210', 'WEAPON3': '0.450', 'ARMOR': '0.499', 'DAMAGECOUNT': '0.537', 'FRAGCOUNT': '1.000', 'weapon2': '1.198', 'weapon3': '1.308'} [2024-08-05 21:42:04,375][52811] DAMAGECOUNT value on done: 672.0 [2024-08-05 21:42:04,375][52811] Sum rewards: -4.765, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO2': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO4': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.068', 'HITCOUNT': '0.120', 'AMMO3': '0.158', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.288', 'weapon3': '2.400'} [2024-08-05 21:42:05,178][52650] Updated weights for policy 0, policy_version 2101 (0.0012) [2024-08-05 21:42:05,283][52666] DAMAGECOUNT value on done: 739.0 [2024-08-05 21:42:05,291][52666] Sum rewards: -2.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.106', 'weapon4': '0.186', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.807', 'FRAGCOUNT': '1.000', 'weapon2': '1.396', 'weapon3': '1.914'} [2024-08-05 21:42:06,231][52803] DAMAGECOUNT value on done: 665.0 [2024-08-05 21:42:06,234][52803] Sum rewards: -6.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.674', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.166', 'weapon4': '0.186', 'HITCOUNT': '0.200', 'ARMOR': '0.492', 'DAMAGECOUNT': '0.915', 'WEAPON3': '0.950', 'weapon2': '1.398', 'FRAGCOUNT': '2.000', 'weapon3': '2.080'} [2024-08-05 21:42:07,034][52820] DAMAGECOUNT value on done: 855.0 [2024-08-05 21:42:07,034][52820] Sum rewards: 0.323, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.094', 'AMMO2': '0.016', 'ARMOR': '0.044', 'AMMO4': '0.077', 'AMMO3': '0.113', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.519', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.888', 'weapon3': '1.950'} [2024-08-05 21:42:07,194][52795] DAMAGECOUNT value on done: 840.0 [2024-08-05 21:42:07,197][52795] Sum rewards: 0.621, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.018', 'weapon7': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.126', 'weapon4': '0.192', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.155', 'weapon2': '1.202', 'weapon3': '2.088', 'FRAGCOUNT': '5.000'} [2024-08-05 21:42:07,259][52660] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:42:07,549][52670] DAMAGECOUNT value on done: 1077.0 [2024-08-05 21:42:07,549][52670] Sum rewards: -0.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.144', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'weapon2': '1.360', 'DAMAGECOUNT': '1.440', 'weapon3': '2.264', 'FRAGCOUNT': '5.000'} [2024-08-05 21:42:07,613][52811] DAMAGECOUNT value on done: 499.0 [2024-08-05 21:42:07,615][52811] Sum rewards: -3.055, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.030', 'HEALTH': '0.040', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'DAMAGECOUNT': '0.162', 'weapon4': '0.364', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.436', 'weapon2': '1.738'} [2024-08-05 21:42:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17328.2). Total num frames: 17252352. Throughput: 0: 4321.5. Samples: 4317200. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 21:42:07,795][52567] Avg episode reward: [(0, '-2.302')] [2024-08-05 21:42:07,797][52614] Saving new best policy, reward=-2.302! [2024-08-05 21:42:07,820][52794] DAMAGECOUNT value on done: 530.0 [2024-08-05 21:42:08,732][52666] DAMAGECOUNT value on done: 1159.0 [2024-08-05 21:42:08,736][52666] Sum rewards: -2.827, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.469', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.270', 'DAMAGECOUNT': '0.585', 'ARMOR': '0.884', 'WEAPON3': '0.950', 'weapon3': '1.486', 'weapon2': '1.854', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:09,571][52803] DAMAGECOUNT value on done: 1116.0 [2024-08-05 21:42:09,572][52803] Sum rewards: 3.551, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.750', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.162', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.440', 'weapon3': '1.642', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '7.000'} [2024-08-05 21:42:09,964][52794] DAMAGECOUNT value on done: 869.0 [2024-08-05 21:42:09,965][52794] Sum rewards: -5.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.735', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'weapon5': '0.024', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon3': '1.692', 'weapon2': '1.794'} [2024-08-05 21:42:10,024][52650] Updated weights for policy 0, policy_version 2111 (0.0014) [2024-08-05 21:42:10,407][52662] DAMAGECOUNT value on done: 605.0 [2024-08-05 21:42:10,427][52820] DAMAGECOUNT value on done: 654.0 [2024-08-05 21:42:10,430][52820] Sum rewards: -2.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.159', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'weapon5': '0.074', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.800', 'ARMOR': '0.946', 'DAMAGECOUNT': '1.047', 'weapon3': '1.544', 'weapon2': '1.688', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:10,520][52795] DAMAGECOUNT value on done: 810.0 [2024-08-05 21:42:10,523][52795] Sum rewards: -6.348, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.491', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.024', 'ARMOR': '0.028', 'weapon4': '0.066', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.900', 'weapon2': '1.478', 'weapon3': '2.128'} [2024-08-05 21:42:10,882][52670] DAMAGECOUNT value on done: 776.0 [2024-08-05 21:42:10,882][52670] Sum rewards: -5.923, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.966', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.021', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'HITCOUNT': '0.150', 'AMMO3': '0.163', 'DAMAGECOUNT': '0.411', 'WEAPON3': '0.850', 'weapon2': '1.652', 'weapon3': '1.946'} [2024-08-05 21:42:11,113][52811] DAMAGECOUNT value on done: 497.0 [2024-08-05 21:42:11,117][52811] Sum rewards: 0.993, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'HEALTH': '0.044', 'AMMO3': '0.087', 'AMMO4': '0.153', 'weapon4': '0.194', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.555', 'DAMAGECOUNT': '0.807', 'FRAGCOUNT': '1.000', 'weapon3': '1.600', 'weapon2': '1.662'} [2024-08-05 21:42:11,989][52666] DAMAGECOUNT value on done: 884.0 [2024-08-05 21:42:11,992][52666] Sum rewards: -1.907, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.176', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon5': '0.110', 'weapon4': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'weapon3': '1.554', 'weapon2': '1.812', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:12,355][52794] DAMAGECOUNT value on done: 860.0 [2024-08-05 21:42:12,356][52794] Sum rewards: -5.654, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.790', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.131', 'DAMAGECOUNT': '0.255', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.578', 'weapon3': '1.980'} [2024-08-05 21:42:12,648][52803] DAMAGECOUNT value on done: 581.0 [2024-08-05 21:42:12,649][52803] Sum rewards: -5.158, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.950', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.008', 'HITCOUNT': '0.010', 'DAMAGECOUNT': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.040', 'ARMOR': '0.056', 'AMMO3': '0.069', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'weapon3': '1.324', 'weapon2': '1.892'} [2024-08-05 21:42:12,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17066.7, 300 sec: 17300.4). Total num frames: 17334272. Throughput: 0: 4313.6. Samples: 4342670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 21:42:12,794][52567] Avg episode reward: [(0, '-2.316')] [2024-08-05 21:42:12,845][52662] DAMAGECOUNT value on done: 987.0 [2024-08-05 21:42:13,561][52795] DAMAGECOUNT value on done: 892.0 [2024-08-05 21:42:13,562][52795] Sum rewards: -1.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.874', 'AMMO2': '0.006', 'ARMOR': '0.028', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'HITCOUNT': '0.130', 'weapon4': '0.252', 'DAMAGECOUNT': '0.354', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.482', 'weapon2': '1.542'} [2024-08-05 21:42:13,572][52670] DAMAGECOUNT value on done: 902.0 [2024-08-05 21:42:13,573][52670] Sum rewards: -2.953, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.748', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.040', 'weapon5': '0.044', 'AMMO3': '0.094', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'WEAPON4': '0.400', 'weapon4': '0.496', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.933', 'FRAGCOUNT': '1.000', 'weapon2': '1.282', 'weapon3': '1.576'} [2024-08-05 21:42:13,637][52820] DAMAGECOUNT value on done: 665.0 [2024-08-05 21:42:14,391][52811] DAMAGECOUNT value on done: 783.0 [2024-08-05 21:42:14,393][52811] Sum rewards: -2.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.082', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.161', 'HITCOUNT': '0.340', 'ARMOR': '0.405', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.335', 'weapon2': '1.800', 'weapon3': '1.844', 'FRAGCOUNT': '5.000'} [2024-08-05 21:42:14,840][52650] Updated weights for policy 0, policy_version 2121 (0.0031) [2024-08-05 21:42:15,003][52794] DAMAGECOUNT value on done: 529.0 [2024-08-05 21:42:15,419][52662] DAMAGECOUNT value on done: 793.0 [2024-08-05 21:42:15,420][52662] Sum rewards: -2.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.075', 'AMMO3': '0.134', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.810', 'weapon2': '1.312', 'FRAGCOUNT': '1.500', 'weapon3': '1.860'} [2024-08-05 21:42:15,708][52803] DAMAGECOUNT value on done: 947.0 [2024-08-05 21:42:15,708][52803] Sum rewards: -1.506, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.675', 'AMMO2': '0.005', 'AMMO4': '0.022', 'ARMOR': '0.032', 'weapon4': '0.080', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.200', 'weapon2': '1.388', 'weapon3': '1.990', 'FRAGCOUNT': '3.000'} [2024-08-05 21:42:16,780][52795] DAMAGECOUNT value on done: 654.0 [2024-08-05 21:42:16,780][52795] Sum rewards: -1.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.329', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.500', 'weapon2': '1.564', 'weapon3': '1.806'} [2024-08-05 21:42:17,081][52820] DAMAGECOUNT value on done: 508.0 [2024-08-05 21:42:17,081][52820] Sum rewards: -2.337, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'ARMOR': '0.040', 'weapon5': '0.040', 'weapon7': '0.056', 'HITCOUNT': '0.080', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.540', 'weapon2': '2.082'} [2024-08-05 21:42:17,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17203.1, 300 sec: 17328.1). Total num frames: 17424384. Throughput: 0: 4317.3. Samples: 4355670. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:42:17,795][52567] Avg episode reward: [(0, '-2.220')] [2024-08-05 21:42:17,798][52614] Saving new best policy, reward=-2.220! [2024-08-05 21:42:17,855][52811] DAMAGECOUNT value on done: 575.0 [2024-08-05 21:42:17,856][52811] Sum rewards: -4.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO2': '0.020', 'ARMOR': '0.040', 'weapon4': '0.096', 'AMMO4': '0.098', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.370', 'weapon3': '2.242'} [2024-08-05 21:42:18,464][52794] DAMAGECOUNT value on done: 735.0 [2024-08-05 21:42:18,466][52794] Sum rewards: 0.477, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.892', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO3': '0.075', 'HITCOUNT': '0.240', 'ARMOR': '0.504', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.930', 'weapon2': '0.996', 'weapon3': '1.090', 'FRAGCOUNT': '4.000'} [2024-08-05 21:42:18,877][52662] DAMAGECOUNT value on done: 683.0 [2024-08-05 21:42:18,878][52662] Sum rewards: -1.540, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'HITCOUNT': '0.100', 'AMMO3': '0.105', 'weapon4': '0.266', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.500', 'weapon2': '0.768', 'FRAGCOUNT': '1.000', 'weapon3': '1.766'} [2024-08-05 21:42:19,871][52803] DAMAGECOUNT value on done: 508.0 [2024-08-05 21:42:20,747][52650] Updated weights for policy 0, policy_version 2131 (0.0020) [2024-08-05 21:42:21,666][52820] DAMAGECOUNT value on done: 416.0 [2024-08-05 21:42:21,734][52795] DAMAGECOUNT value on done: 881.0 [2024-08-05 21:42:21,740][52795] Sum rewards: -0.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.420', 'AMMO2': '0.008', 'weapon7': '0.014', 'AMMO4': '0.038', 'ARMOR': '0.047', 'AMMO3': '0.114', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'weapon2': '1.696', 'weapon3': '1.788'} [2024-08-05 21:42:22,162][52794] DAMAGECOUNT value on done: 1085.0 [2024-08-05 21:42:22,162][52794] Sum rewards: 0.162, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.370', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'weapon4': '0.132', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.017', 'weapon2': '1.536', 'FRAGCOUNT': '2.000', 'weapon3': '2.134'} [2024-08-05 21:42:22,461][52662] DAMAGECOUNT value on done: 799.0 [2024-08-05 21:42:22,462][52662] Sum rewards: -3.169, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.678', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'HITCOUNT': '0.200', 'weapon4': '0.218', 'DAMAGECOUNT': '0.648', 'weapon2': '0.940', 'WEAPON3': '1.050', 'FRAGCOUNT': '2.000', 'weapon3': '2.558'} [2024-08-05 21:42:22,611][52811] DAMAGECOUNT value on done: 659.0 [2024-08-05 21:42:22,612][52811] Sum rewards: -4.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.112', 'AMMO4': '0.156', 'AMMO3': '0.182', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.873', 'WEAPON3': '1.000', 'weapon2': '1.448', 'weapon3': '1.984'} [2024-08-05 21:42:22,794][52567] Fps is (10 sec: 14745.5, 60 sec: 16657.0, 300 sec: 17217.1). Total num frames: 17481728. Throughput: 0: 4176.7. Samples: 4375100. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:42:22,794][52567] Avg episode reward: [(0, '-2.257')] [2024-08-05 21:42:24,891][52803] DAMAGECOUNT value on done: 558.0 [2024-08-05 21:42:24,896][52803] Sum rewards: 0.662, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.034', 'ARMOR': '0.040', 'weapon7': '0.070', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.452', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.525', 'weapon2': '1.226', 'weapon3': '1.322', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:25,609][52794] DAMAGECOUNT value on done: 556.0 [2024-08-05 21:42:25,613][52794] Sum rewards: -3.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.185', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.021', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.140', 'weapon4': '0.290', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.405', 'FRAGCOUNT': '1.000', 'weapon3': '1.088', 'weapon2': '1.808'} [2024-08-05 21:42:25,828][52662] DAMAGECOUNT value on done: 845.0 [2024-08-05 21:42:25,828][52662] Sum rewards: -3.814, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.646', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.390', 'weapon3': '2.272'} [2024-08-05 21:42:26,055][52820] DAMAGECOUNT value on done: 547.0 [2024-08-05 21:42:26,057][52820] Sum rewards: -2.111, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.425', 'weapon5': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'ARMOR': '0.040', 'HITCOUNT': '0.140', 'AMMO3': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.236', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.750', 'weapon2': '1.498', 'weapon3': '1.808', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:26,154][52795] DAMAGECOUNT value on done: 388.0 [2024-08-05 21:42:26,158][52795] Sum rewards: -4.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'HITCOUNT': '0.120', 'AMMO3': '0.131', 'AMMO4': '0.138', 'weapon4': '0.284', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.800', 'weapon3': '1.362', 'weapon2': '1.866', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:26,814][52650] Updated weights for policy 0, policy_version 2141 (0.0014) [2024-08-05 21:42:26,835][52811] DAMAGECOUNT value on done: 745.0 [2024-08-05 21:42:27,794][52567] Fps is (10 sec: 12288.3, 60 sec: 16384.0, 300 sec: 17161.5). Total num frames: 17547264. Throughput: 0: 4054.9. Samples: 4395400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 21:42:27,794][52567] Avg episode reward: [(0, '-2.367')] [2024-08-05 21:42:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002142_17547264.pth... [2024-08-05 21:42:27,953][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001640_13434880.pth [2024-08-05 21:42:28,272][52794] DAMAGECOUNT value on done: 861.0 [2024-08-05 21:42:28,272][52794] Sum rewards: -2.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.784', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.056', 'weapon4': '0.080', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.850', 'weapon2': '1.484', 'FRAGCOUNT': '2.000', 'weapon3': '2.188'} [2024-08-05 21:42:28,440][52803] DAMAGECOUNT value on done: 909.0 [2024-08-05 21:42:28,441][52803] Sum rewards: -0.980, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.118', 'HEALTH': '0.168', 'HITCOUNT': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.095', 'weapon2': '1.724', 'weapon3': '1.728'} [2024-08-05 21:42:28,661][52662] DAMAGECOUNT value on done: 1014.0 [2024-08-05 21:42:28,663][52662] Sum rewards: -4.368, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON1': '0.020', 'HITCOUNT': '0.100', 'AMMO3': '0.110', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.732', 'weapon3': '1.940'} [2024-08-05 21:42:29,183][52820] DAMAGECOUNT value on done: 507.0 [2024-08-05 21:42:29,183][52820] Sum rewards: -5.231, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.519', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.048', 'HITCOUNT': '0.050', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.484', 'weapon2': '1.816'} [2024-08-05 21:42:29,400][52795] DAMAGECOUNT value on done: 701.0 [2024-08-05 21:42:29,934][52811] DAMAGECOUNT value on done: 539.0 [2024-08-05 21:42:29,935][52811] Sum rewards: -8.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.974', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'HITCOUNT': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'ARMOR': '0.444', 'DAMAGECOUNT': '0.510', 'WEAPON3': '1.150', 'weapon2': '1.746', 'weapon3': '2.046'} [2024-08-05 21:42:30,976][52794] DAMAGECOUNT value on done: 815.0 [2024-08-05 21:42:30,977][52794] Sum rewards: 0.765, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.226', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.894', 'DAMAGECOUNT': '1.200', 'weapon3': '1.472', 'weapon2': '1.686', 'FRAGCOUNT': '3.000'} [2024-08-05 21:42:31,308][52662] DAMAGECOUNT value on done: 921.0 [2024-08-05 21:42:31,309][52662] Sum rewards: -1.101, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.240', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'ARMOR': '0.072', 'AMMO4': '0.076', 'AMMO3': '0.078', 'HITCOUNT': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.350', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.372', 'weapon2': '1.564'} [2024-08-05 21:42:31,361][52803] DAMAGECOUNT value on done: 688.0 [2024-08-05 21:42:31,775][52650] Updated weights for policy 0, policy_version 2151 (0.0031) [2024-08-05 21:42:32,133][52820] DAMAGECOUNT value on done: 695.0 [2024-08-05 21:42:32,140][52820] Sum rewards: -0.009, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.546', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.016', 'ARMOR': '0.032', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.284', 'DAMAGECOUNT': '0.534', 'WEAPON3': '0.600', 'weapon3': '1.544', 'weapon2': '1.672', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:32,464][52795] DAMAGECOUNT value on done: 635.0 [2024-08-05 21:42:32,466][52795] Sum rewards: -4.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.060', 'AMMO2': '0.009', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.159', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.753', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.312', 'weapon3': '2.162'} [2024-08-05 21:42:32,794][52567] Fps is (10 sec: 15564.9, 60 sec: 16520.5, 300 sec: 17161.6). Total num frames: 17637376. Throughput: 0: 4065.2. Samples: 4408670. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:42:32,794][52567] Avg episode reward: [(0, '-2.477')] [2024-08-05 21:42:32,984][52811] DAMAGECOUNT value on done: 877.0 [2024-08-05 21:42:32,984][52811] Sum rewards: 1.505, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.117', 'HITCOUNT': '0.380', 'HEALTH': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.218', 'FRAGCOUNT': '1.500', 'weapon2': '1.822', 'weapon3': '1.864'} [2024-08-05 21:42:33,809][52794] DAMAGECOUNT value on done: 735.0 [2024-08-05 21:42:33,810][52794] Sum rewards: -0.233, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.475', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'AMMO4': '0.067', 'HITCOUNT': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.250', 'weapon4': '0.312', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'weapon2': '1.334', 'weapon3': '1.706', 'FRAGCOUNT': '3.000'} [2024-08-05 21:42:34,031][52662] DAMAGECOUNT value on done: 791.0 [2024-08-05 21:42:34,031][52662] Sum rewards: -2.400, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.330', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.210', 'weapon4': '0.240', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon2': '1.384', 'weapon3': '1.664'} [2024-08-05 21:42:34,266][52803] DAMAGECOUNT value on done: 617.0 [2024-08-05 21:42:34,267][52803] Sum rewards: -3.480, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.955', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.095', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.900', 'ARMOR': '1.393', 'weapon3': '1.460', 'weapon2': '1.582', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:35,070][52820] DAMAGECOUNT value on done: 823.0 [2024-08-05 21:42:35,071][52820] Sum rewards: -6.537, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.589', 'AMMO2': '0.007', 'AMMO4': '0.035', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.184', 'DAMAGECOUNT': '0.363', 'FRAGCOUNT': '1.000', 'weapon2': '1.136', 'WEAPON3': '1.150', 'weapon3': '2.400'} [2024-08-05 21:42:35,601][52795] DAMAGECOUNT value on done: 970.0 [2024-08-05 21:42:35,603][52795] Sum rewards: -1.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.971', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.362', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.017', 'weapon2': '1.092', 'weapon3': '1.760', 'FRAGCOUNT': '3.000'} [2024-08-05 21:42:36,106][52811] DAMAGECOUNT value on done: 798.0 [2024-08-05 21:42:36,107][52811] Sum rewards: -0.045, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.543', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.067', 'AMMO4': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.400', 'ARMOR': '0.532', 'DAMAGECOUNT': '0.681', 'FRAGCOUNT': '1.000', 'weapon3': '1.218', 'weapon2': '1.254'} [2024-08-05 21:42:36,268][52650] Updated weights for policy 0, policy_version 2161 (0.0016) [2024-08-05 21:42:36,330][52794] DAMAGECOUNT value on done: 736.0 [2024-08-05 21:42:36,539][52662] DAMAGECOUNT value on done: 933.0 [2024-08-05 21:42:36,539][52662] Sum rewards: -4.449, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.529', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'HITCOUNT': '0.070', 'ARMOR': '0.084', 'AMMO4': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.282', 'DAMAGECOUNT': '0.339', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.248', 'weapon3': '2.146'} [2024-08-05 21:42:37,223][52803] DAMAGECOUNT value on done: 354.0 [2024-08-05 21:42:37,226][52803] Sum rewards: -2.930, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.414', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'HITCOUNT': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.284', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.178', 'weapon3': '1.594'} [2024-08-05 21:42:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16657.1, 300 sec: 17189.3). Total num frames: 17727488. Throughput: 0: 4089.1. Samples: 4435790. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 21:42:37,795][52567] Avg episode reward: [(0, '-2.558')] [2024-08-05 21:42:37,990][52820] DAMAGECOUNT value on done: 987.0 [2024-08-05 21:42:37,990][52820] Sum rewards: -5.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.018', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.282', 'ARMOR': '0.428', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.960', 'weapon2': '1.494', 'weapon3': '1.686'} [2024-08-05 21:42:38,613][52795] DAMAGECOUNT value on done: 729.0 [2024-08-05 21:42:38,613][52795] Sum rewards: 0.117, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.142', 'HITCOUNT': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.132', 'DAMAGECOUNT': '1.155', 'weapon3': '2.012', 'FRAGCOUNT': '3.000'} [2024-08-05 21:42:38,833][52794] DAMAGECOUNT value on done: 500.0 [2024-08-05 21:42:38,842][52794] Sum rewards: -6.238, reward structure: {'DEATHCOUNT': '-9.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.966', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'ARMOR': '0.072', 'HITCOUNT': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.194', 'DAMAGECOUNT': '0.231', 'WEAPON3': '0.850', 'weapon2': '1.310', 'weapon3': '1.846'} [2024-08-05 21:42:39,063][52811] DAMAGECOUNT value on done: 1027.0 [2024-08-05 21:42:39,063][52811] Sum rewards: -2.296, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.490', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.046', 'AMMO3': '0.077', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.500', 'weapon3': '1.444', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:39,073][52662] DAMAGECOUNT value on done: 795.0 [2024-08-05 21:42:39,075][52662] Sum rewards: -1.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.863', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.120', 'weapon4': '0.266', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.624', 'weapon3': '1.710'} [2024-08-05 21:42:40,235][52803] DAMAGECOUNT value on done: 712.0 [2024-08-05 21:42:40,235][52803] Sum rewards: 1.341, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.819', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'weapon5': '0.082', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'ARMOR': '0.104', 'weapon4': '0.146', 'HITCOUNT': '0.180', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.936', 'weapon2': '1.400', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:40,803][52650] Updated weights for policy 0, policy_version 2171 (0.0024) [2024-08-05 21:42:40,973][52820] DAMAGECOUNT value on done: 656.0 [2024-08-05 21:42:41,601][52795] DAMAGECOUNT value on done: 596.0 [2024-08-05 21:42:41,603][52795] Sum rewards: -2.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.103', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.120', 'ARMOR': '0.144', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.400', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.418', 'weapon2': '1.484'} [2024-08-05 21:42:41,833][52794] DAMAGECOUNT value on done: 795.0 [2024-08-05 21:42:41,835][52794] Sum rewards: 0.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO4': '0.046', 'ARMOR': '0.075', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon2': '1.624', 'weapon3': '2.090'} [2024-08-05 21:42:42,071][52811] DAMAGECOUNT value on done: 552.0 [2024-08-05 21:42:42,072][52811] Sum rewards: 0.273, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.323', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.040', 'weapon7': '0.054', 'HITCOUNT': '0.090', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.600', 'weapon2': '0.992', 'weapon3': '1.434', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:42,142][52662] DAMAGECOUNT value on done: 874.0 [2024-08-05 21:42:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16657.1, 300 sec: 17217.1). Total num frames: 17817600. Throughput: 0: 4123.6. Samples: 4463420. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:42:42,794][52567] Avg episode reward: [(0, '-2.439')] [2024-08-05 21:42:43,100][52803] DAMAGECOUNT value on done: 545.0 [2024-08-05 21:42:43,973][52820] DAMAGECOUNT value on done: 440.0 [2024-08-05 21:42:43,981][52820] Sum rewards: 0.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.324', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.004', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.116', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'ARMOR': '0.470', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'weapon3': '1.262', 'weapon2': '1.410', 'FRAGCOUNT': '1.500'} [2024-08-05 21:42:44,145][52794] DAMAGECOUNT value on done: 1353.0 [2024-08-05 21:42:44,146][52794] Sum rewards: -1.055, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.649', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'ARMOR': '0.064', 'AMMO3': '0.181', 'HITCOUNT': '0.380', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.500', 'weapon2': '1.710', 'weapon3': '1.736', 'FRAGCOUNT': '4.000'} [2024-08-05 21:42:44,411][52662] DAMAGECOUNT value on done: 540.0 [2024-08-05 21:42:44,411][52662] Sum rewards: -3.872, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-3.000', 'HEALTH': '-0.712', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.044', 'HITCOUNT': '0.060', 'AMMO3': '0.089', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'DAMAGECOUNT': '0.120', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.828', 'weapon2': '1.310', 'weapon3': '1.634'} [2024-08-05 21:42:44,610][52795] DAMAGECOUNT value on done: 741.0 [2024-08-05 21:42:44,965][52811] DAMAGECOUNT value on done: 520.0 [2024-08-05 21:42:44,965][52811] Sum rewards: 0.531, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.024', 'ARMOR': '0.076', 'AMMO4': '0.121', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'HEALTH': '0.210', 'weapon4': '0.234', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.800', 'weapon2': '0.862', 'weapon3': '2.238', 'FRAGCOUNT': '3.000'} [2024-08-05 21:42:45,118][52650] Updated weights for policy 0, policy_version 2181 (0.0022) [2024-08-05 21:42:46,146][52803] DAMAGECOUNT value on done: 590.0 [2024-08-05 21:42:46,147][52803] Sum rewards: -4.139, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'ARMOR': '0.040', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.416', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.366', 'weapon3': '1.618'} [2024-08-05 21:42:46,645][52794] DAMAGECOUNT value on done: 1038.0 [2024-08-05 21:42:46,968][52662] DAMAGECOUNT value on done: 781.0 [2024-08-05 21:42:46,969][52662] Sum rewards: -1.687, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.560', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.122', 'weapon4': '0.144', 'HITCOUNT': '0.300', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.023', 'weapon3': '1.586', 'weapon2': '1.682'} [2024-08-05 21:42:47,024][52820] DAMAGECOUNT value on done: 610.0 [2024-08-05 21:42:47,024][52820] Sum rewards: -2.465, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.124', 'HEALTH': '0.156', 'HITCOUNT': '0.180', 'ARMOR': '0.480', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.726', 'FRAGCOUNT': '1.000', 'weapon2': '1.656', 'weapon3': '1.938'} [2024-08-05 21:42:47,711][52795] DAMAGECOUNT value on done: 595.0 [2024-08-05 21:42:47,794][52567] Fps is (10 sec: 18841.7, 60 sec: 16930.3, 300 sec: 17244.9). Total num frames: 17915904. Throughput: 0: 4128.2. Samples: 4476790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:42:47,794][52567] Avg episode reward: [(0, '-2.273')] [2024-08-05 21:42:47,934][52811] DAMAGECOUNT value on done: 846.0 [2024-08-05 21:42:47,936][52811] Sum rewards: -0.349, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.271', 'AMMO2': '0.007', 'ARMOR': '0.028', 'AMMO4': '0.037', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.621', 'weapon4': '0.812', 'weapon3': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.140'} [2024-08-05 21:42:49,140][52803] DAMAGECOUNT value on done: 785.0 [2024-08-05 21:42:49,516][52794] DAMAGECOUNT value on done: 652.0 [2024-08-05 21:42:49,516][52794] Sum rewards: -3.976, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.638', 'AMMO2': '0.009', 'AMMO5': '0.014', 'weapon5': '0.026', 'AMMO4': '0.045', 'ARMOR': '0.060', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'FRAGCOUNT': '0.500', 'weapon4': '0.536', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.850', 'weapon2': '1.128', 'weapon3': '1.898'} [2024-08-05 21:42:49,707][52650] Updated weights for policy 0, policy_version 2191 (0.0012) [2024-08-05 21:42:49,781][52662] DAMAGECOUNT value on done: 610.0 [2024-08-05 21:42:49,782][52662] Sum rewards: -0.887, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.395', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.088', 'weapon7': '0.088', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.466', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.630', 'weapon2': '1.100', 'weapon3': '1.324'} [2024-08-05 21:42:50,120][52820] DAMAGECOUNT value on done: 735.0 [2024-08-05 21:42:50,120][52820] Sum rewards: 0.037, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.275', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'HITCOUNT': '0.070', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.180', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.264', 'weapon3': '1.686'} [2024-08-05 21:42:50,657][52795] DAMAGECOUNT value on done: 469.0 [2024-08-05 21:42:50,658][52795] Sum rewards: -1.316, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.602', 'AMMO4': '-0.115', 'AMMO2': '-0.023', 'WEAPON1': '0.020', 'weapon7': '0.050', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'ARMOR': '0.529', 'DAMAGECOUNT': '0.537', 'WEAPON3': '0.900', 'weapon3': '1.646', 'weapon2': '1.780', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:50,944][52811] DAMAGECOUNT value on done: 350.0 [2024-08-05 21:42:52,231][52803] DAMAGECOUNT value on done: 841.0 [2024-08-05 21:42:52,231][52803] Sum rewards: -2.424, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.003', 'weapon7': '0.016', 'WEAPON5': '0.050', 'HITCOUNT': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.210', 'WEAPON3': '0.700', 'ARMOR': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '1.578', 'weapon3': '1.940'} [2024-08-05 21:42:52,432][52794] DAMAGECOUNT value on done: 862.0 [2024-08-05 21:42:52,433][52794] Sum rewards: -1.585, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.126', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.368', 'ARMOR': '0.510', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.800', 'weapon2': '1.330', 'weapon3': '1.836', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:52,724][52662] DAMAGECOUNT value on done: 957.0 [2024-08-05 21:42:52,725][52662] Sum rewards: -2.160, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.434', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.266', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'ARMOR': '0.995', 'FRAGCOUNT': '1.000', 'weapon2': '1.416', 'weapon3': '1.734'} [2024-08-05 21:42:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16657.1, 300 sec: 17217.1). Total num frames: 17997824. Throughput: 0: 4155.6. Samples: 4504200. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:42:52,794][52567] Avg episode reward: [(0, '-2.449')] [2024-08-05 21:42:53,194][52820] DAMAGECOUNT value on done: 690.0 [2024-08-05 21:42:53,194][52820] Sum rewards: -0.676, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.991', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.462', 'WEAPON3': '0.600', 'weapon3': '1.326', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:53,669][52795] DAMAGECOUNT value on done: 907.0 [2024-08-05 21:42:53,673][52795] Sum rewards: -0.717, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.355', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.106', 'weapon5': '0.108', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.650', 'weapon3': '1.664', 'weapon2': '1.774', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:53,933][52650] Updated weights for policy 0, policy_version 2201 (0.0031) [2024-08-05 21:42:55,446][52794] DAMAGECOUNT value on done: 1261.0 [2024-08-05 21:42:55,456][52794] Sum rewards: -3.958, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.186', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.226', 'DAMAGECOUNT': '0.438', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.406', 'weapon3': '1.828'} [2024-08-05 21:42:55,785][52662] DAMAGECOUNT value on done: 467.0 [2024-08-05 21:42:55,787][52662] Sum rewards: -0.089, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.025', 'ARMOR': '0.041', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'weapon5': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.127', 'weapon4': '0.136', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.213', 'HEALTH': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.382', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'} [2024-08-05 21:42:56,345][52820] DAMAGECOUNT value on done: 736.0 [2024-08-05 21:42:56,348][52820] Sum rewards: 0.069, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.671', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.062', 'HITCOUNT': '0.090', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.350', 'weapon4': '0.354', 'FRAGCOUNT': '1.000', 'weapon2': '1.352', 'weapon3': '1.526'} [2024-08-05 21:42:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 16930.1, 300 sec: 17272.6). Total num frames: 18096128. Throughput: 0: 4194.2. Samples: 4531410. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 21:42:57,794][52567] Avg episode reward: [(0, '-2.357')] [2024-08-05 21:42:58,467][52794] DAMAGECOUNT value on done: 882.0 [2024-08-05 21:42:58,680][52650] Updated weights for policy 0, policy_version 2211 (0.0011) [2024-08-05 21:42:58,757][52662] DAMAGECOUNT value on done: 863.0 [2024-08-05 21:42:58,757][52662] Sum rewards: -1.394, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.182', 'HITCOUNT': '0.300', 'DAMAGECOUNT': '1.140', 'WEAPON3': '1.150', 'weapon2': '1.316', 'weapon3': '2.450', 'FRAGCOUNT': '4.000'} [2024-08-05 21:42:59,510][52820] DAMAGECOUNT value on done: 576.0 [2024-08-05 21:42:59,510][52820] Sum rewards: -4.025, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.190', 'AMMO2': '0.001', 'AMMO4': '0.007', 'weapon5': '0.008', 'AMMO5': '0.012', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.428', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.498', 'weapon2': '1.820'} [2024-08-05 21:43:01,115][52794] DAMAGECOUNT value on done: 739.0 [2024-08-05 21:43:01,117][52794] Sum rewards: -2.463, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.636', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.074', 'ARMOR': '0.082', 'HITCOUNT': '0.120', 'WEAPON4': '0.250', 'weapon4': '0.350', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.422', 'weapon3': '1.556'} [2024-08-05 21:43:01,386][52662] DAMAGECOUNT value on done: 933.0 [2024-08-05 21:43:01,388][52662] Sum rewards: -2.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.131', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.222', 'ARMOR': '0.444', 'DAMAGECOUNT': '0.612', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.314', 'weapon3': '1.388'} [2024-08-05 21:43:02,489][52820] DAMAGECOUNT value on done: 797.0 [2024-08-05 21:43:02,489][52820] Sum rewards: -1.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.407', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.091', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.384', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.579', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.190', 'weapon3': '1.760'} [2024-08-05 21:43:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17066.7, 300 sec: 17272.6). Total num frames: 18186240. Throughput: 0: 4208.9. Samples: 4545070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:43:02,794][52567] Avg episode reward: [(0, '-2.405')] [2024-08-05 21:43:03,176][52650] Updated weights for policy 0, policy_version 2221 (0.0010) [2024-08-05 21:43:03,863][52662] DAMAGECOUNT value on done: 925.0 [2024-08-05 21:43:03,863][52662] Sum rewards: -1.424, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.178', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '0.828', 'FRAGCOUNT': '1.000', 'weapon3': '1.490', 'weapon2': '1.618'} [2024-08-05 21:43:05,382][52820] DAMAGECOUNT value on done: 951.0 [2024-08-05 21:43:05,382][52820] Sum rewards: -2.507, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.824', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.280', 'weapon4': '0.306', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.861', 'weapon2': '1.270', 'weapon3': '1.920', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:07,500][52650] Updated weights for policy 0, policy_version 2231 (0.0012) [2024-08-05 21:43:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17066.7, 300 sec: 17300.4). Total num frames: 18276352. Throughput: 0: 4385.8. Samples: 4572460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:43:07,794][52567] Avg episode reward: [(0, '-2.451')] [2024-08-05 21:43:12,471][52650] Updated weights for policy 0, policy_version 2241 (0.0022) [2024-08-05 21:43:12,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17203.1, 300 sec: 17300.4). Total num frames: 18366464. Throughput: 0: 4530.2. Samples: 4599260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:43:12,795][52567] Avg episode reward: [(0, '-2.451')] [2024-08-05 21:43:16,897][52650] Updated weights for policy 0, policy_version 2251 (0.0018) [2024-08-05 21:43:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.8, 300 sec: 17301.0). Total num frames: 18448384. Throughput: 0: 4525.8. Samples: 4612330. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:43:17,794][52567] Avg episode reward: [(0, '-2.451')] [2024-08-05 21:43:18,493][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 21:43:21,840][52665] DAMAGECOUNT value on done: 1050.0 [2024-08-05 21:43:21,848][52665] Sum rewards: -3.088, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.010', 'AMMO4': '0.036', 'ARMOR': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'AMMO3': '0.155', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.448', 'weapon3': '1.834', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:22,238][52650] Updated weights for policy 0, policy_version 2261 (0.0034) [2024-08-05 21:43:22,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17272.6). Total num frames: 18530304. Throughput: 0: 4448.2. Samples: 4635960. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 21:43:22,794][52567] Avg episode reward: [(0, '-2.427')] [2024-08-05 21:43:24,978][52665] DAMAGECOUNT value on done: 816.0 [2024-08-05 21:43:24,979][52665] Sum rewards: -3.613, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.262', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.009', 'weapon5': '0.066', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.244', 'ARMOR': '0.530', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.660', 'weapon3': '1.442', 'weapon2': '1.936'} [2024-08-05 21:43:27,010][52650] Updated weights for policy 0, policy_version 2271 (0.0030) [2024-08-05 21:43:27,681][52665] DAMAGECOUNT value on done: 857.0 [2024-08-05 21:43:27,682][52665] Sum rewards: -0.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.651', 'AMMO2': '0.016', 'ARMOR': '0.060', 'AMMO4': '0.080', 'AMMO3': '0.120', 'weapon4': '0.154', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.035', 'weapon2': '1.206', 'weapon3': '1.998', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17749.4, 300 sec: 17244.9). Total num frames: 18612224. Throughput: 0: 4411.3. Samples: 4661930. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:43:27,794][52567] Avg episode reward: [(0, '-2.390')] [2024-08-05 21:43:31,035][52665] DAMAGECOUNT value on done: 560.0 [2024-08-05 21:43:31,700][52650] Updated weights for policy 0, policy_version 2281 (0.0041) [2024-08-05 21:43:32,518][52649] DAMAGECOUNT value on done: 904.0 [2024-08-05 21:43:32,518][52649] Sum rewards: -3.523, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.666', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.164', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon2': '1.072', 'weapon3': '2.212'} [2024-08-05 21:43:32,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17612.7, 300 sec: 17244.8). Total num frames: 18694144. Throughput: 0: 4396.4. Samples: 4674630. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:43:32,795][52567] Avg episode reward: [(0, '-2.327')] [2024-08-05 21:43:34,130][52665] DAMAGECOUNT value on done: 836.0 [2024-08-05 21:43:34,130][52665] Sum rewards: 0.720, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.376', 'weapon5': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.013', 'weapon7': '0.072', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.258', 'DAMAGECOUNT': '0.366', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'weapon2': '1.266', 'weapon3': '1.346', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:35,318][52649] DAMAGECOUNT value on done: 1023.0 [2024-08-05 21:43:35,326][52649] Sum rewards: -1.072, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.308', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.038', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.166', 'HITCOUNT': '0.230', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.711', 'ARMOR': '0.942', 'FRAGCOUNT': '1.000', 'weapon2': '1.668', 'weapon3': '1.852'} [2024-08-05 21:43:36,503][52650] Updated weights for policy 0, policy_version 2291 (0.0023) [2024-08-05 21:43:36,751][52665] DAMAGECOUNT value on done: 655.0 [2024-08-05 21:43:36,752][52665] Sum rewards: 2.978, reward structure: {'DEATHCOUNT': '-0.750', 'HEALTH': '-0.249', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'ARMOR': '0.040', 'AMMO3': '0.047', 'HITCOUNT': '0.070', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON3': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.228', 'DAMAGECOUNT': '0.378', 'weapon2': '0.604', 'weapon3': '0.816', 'FRAGCOUNT': '1.000'} [2024-08-05 21:43:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17244.9). Total num frames: 18784256. Throughput: 0: 4361.8. Samples: 4700480. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:43:37,794][52567] Avg episode reward: [(0, '-2.235')] [2024-08-05 21:43:37,959][52649] DAMAGECOUNT value on done: 657.0 [2024-08-05 21:43:37,970][52649] Sum rewards: 1.875, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.034', 'ARMOR': '0.061', 'AMMO3': '0.096', 'AMMO4': '0.167', 'HITCOUNT': '0.230', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HEALTH': '0.554', 'DAMAGECOUNT': '0.855', 'weapon2': '1.288', 'weapon3': '2.058', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:38,218][52647] DAMAGECOUNT value on done: 499.0 [2024-08-05 21:43:38,221][52647] Sum rewards: -0.003, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.006', 'HEALTH': '0.022', 'weapon4': '0.028', 'AMMO4': '0.028', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'HITCOUNT': '0.070', 'weapon5': '0.190', 'DAMAGECOUNT': '0.240', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.122', 'weapon2': '1.182'} [2024-08-05 21:43:39,100][52665] DAMAGECOUNT value on done: 666.0 [2024-08-05 21:43:39,116][52669] DAMAGECOUNT value on done: 462.0 [2024-08-05 21:43:39,116][52669] Sum rewards: -4.700, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.768', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO4': '0.048', 'ARMOR': '0.056', 'HITCOUNT': '0.170', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.606', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.200', 'weapon2': '1.530', 'weapon3': '2.022'} [2024-08-05 21:43:40,308][52649] DAMAGECOUNT value on done: 980.0 [2024-08-05 21:43:40,310][52649] Sum rewards: -1.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.942', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON1': '0.020', 'weapon4': '0.036', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.176', 'HITCOUNT': '0.280', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.170', 'weapon2': '1.588', 'weapon3': '2.002', 'FRAGCOUNT': '4.000'} [2024-08-05 21:43:40,613][52667] DAMAGECOUNT value on done: 795.0 [2024-08-05 21:43:40,620][52667] Sum rewards: 1.419, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.288', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon7': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.324', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'weapon2': '0.936', 'weapon3': '1.548', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:41,029][52650] Updated weights for policy 0, policy_version 2301 (0.0023) [2024-08-05 21:43:41,415][52647] DAMAGECOUNT value on done: 1269.0 [2024-08-05 21:43:41,415][52647] Sum rewards: -0.676, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.106', 'AMMO3': '0.109', 'weapon4': '0.138', 'HITCOUNT': '0.180', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.978', 'weapon3': '1.488', 'weapon2': '1.736', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:41,480][52665] DAMAGECOUNT value on done: 882.0 [2024-08-05 21:43:41,480][52665] Sum rewards: -3.139, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.960', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.019', 'AMMO3': '0.098', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.315', 'weapon4': '0.350', 'weapon5': '0.368', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.901', 'weapon3': '1.084', 'weapon2': '1.408'} [2024-08-05 21:43:41,909][52669] DAMAGECOUNT value on done: 1147.0 [2024-08-05 21:43:41,910][52669] Sum rewards: -2.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.846', 'WEAPON3': '0.900', 'weapon2': '1.612', 'FRAGCOUNT': '2.000', 'weapon3': '2.118'} [2024-08-05 21:43:42,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17244.9). Total num frames: 18874368. Throughput: 0: 4328.2. Samples: 4726180. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:43:42,794][52567] Avg episode reward: [(0, '-2.163')] [2024-08-05 21:43:42,795][52614] Saving new best policy, reward=-2.163! [2024-08-05 21:43:42,865][52649] DAMAGECOUNT value on done: 367.0 [2024-08-05 21:43:42,865][52649] Sum rewards: -5.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.018', 'weapon7': '0.026', 'weapon4': '0.040', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.360', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.574', 'weapon3': '2.110'} [2024-08-05 21:43:43,354][52667] DAMAGECOUNT value on done: 779.0 [2024-08-05 21:43:43,355][52667] Sum rewards: -2.157, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.603', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.032', 'AMMO3': '0.130', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.336', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.242', 'weapon3': '2.114'} [2024-08-05 21:43:44,359][52663] DAMAGECOUNT value on done: 918.0 [2024-08-05 21:43:44,359][52663] Sum rewards: -1.815, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'ARMOR': '0.033', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.114', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.230', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.308', 'weapon3': '2.032'} [2024-08-05 21:43:44,498][52665] DAMAGECOUNT value on done: 628.0 [2024-08-05 21:43:44,501][52665] Sum rewards: -3.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.154', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.022', 'HITCOUNT': '0.040', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.054', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'DAMAGECOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.266', 'weapon3': '2.032'} [2024-08-05 21:43:44,671][52669] DAMAGECOUNT value on done: 759.0 [2024-08-05 21:43:44,671][52669] Sum rewards: -3.424, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.875', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.128', 'HITCOUNT': '0.200', 'ARMOR': '0.408', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.810', 'weapon3': '1.650', 'weapon2': '1.912', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:44,830][52647] DAMAGECOUNT value on done: 914.0 [2024-08-05 21:43:44,831][52647] Sum rewards: -1.499, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.942', 'AMMO2': '0.011', 'AMMO4': '0.057', 'HITCOUNT': '0.110', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'weapon4': '0.240', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.750', 'weapon3': '1.306', 'ARMOR': '1.386', 'weapon2': '1.804', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:45,285][52658] DAMAGECOUNT value on done: 967.0 [2024-08-05 21:43:46,021][52650] Updated weights for policy 0, policy_version 2311 (0.0014) [2024-08-05 21:43:46,112][52649] DAMAGECOUNT value on done: 724.0 [2024-08-05 21:43:46,602][52667] DAMAGECOUNT value on done: 1155.0 [2024-08-05 21:43:46,602][52667] Sum rewards: 1.213, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.122', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'HITCOUNT': '0.140', 'ARMOR': '0.145', 'AMMO4': '0.169', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.447', 'weapon4': '0.452', 'WEAPON3': '0.650', 'weapon2': '0.910', 'FRAGCOUNT': '2.000', 'weapon3': '2.072'} [2024-08-05 21:43:46,983][52663] DAMAGECOUNT value on done: 789.0 [2024-08-05 21:43:46,998][52663] Sum rewards: -1.952, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.013', 'weapon5': '0.034', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.250', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.005', 'weapon2': '1.422', 'weapon3': '1.612'} [2024-08-05 21:43:47,281][52669] DAMAGECOUNT value on done: 1530.0 [2024-08-05 21:43:47,281][52669] Sum rewards: -2.491, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.144', 'HITCOUNT': '0.290', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.275', 'weapon2': '1.284', 'weapon3': '2.050', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:47,455][52665] DAMAGECOUNT value on done: 1365.0 [2024-08-05 21:43:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17272.6). Total num frames: 18956288. Throughput: 0: 4305.1. Samples: 4738800. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:43:47,794][52567] Avg episode reward: [(0, '-2.158')] [2024-08-05 21:43:47,891][52614] Saving new best policy, reward=-2.158! [2024-08-05 21:43:48,138][52647] DAMAGECOUNT value on done: 629.0 [2024-08-05 21:43:48,140][52647] Sum rewards: -3.118, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.340', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'ARMOR': '0.032', 'HITCOUNT': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.165', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.850', 'weapon2': '0.938', 'weapon3': '1.430', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:48,239][52658] DAMAGECOUNT value on done: 843.0 [2024-08-05 21:43:48,244][52658] Sum rewards: -5.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.384', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.137', 'HITCOUNT': '0.170', 'weapon4': '0.236', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.700', 'ARMOR': '0.891', 'FRAGCOUNT': '1.000', 'weapon2': '1.470', 'weapon3': '1.766'} [2024-08-05 21:43:48,960][52649] DAMAGECOUNT value on done: 749.0 [2024-08-05 21:43:49,477][52667] DAMAGECOUNT value on done: 476.0 [2024-08-05 21:43:49,478][52667] Sum rewards: -2.395, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.112', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon5': '0.046', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'weapon4': '0.144', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.434', 'weapon3': '1.874'} [2024-08-05 21:43:50,175][52663] DAMAGECOUNT value on done: 717.0 [2024-08-05 21:43:50,176][52663] Sum rewards: -4.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.674', 'AMMO2': '0.013', 'HITCOUNT': '0.050', 'AMMO4': '0.063', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.165', 'AMMO3': '0.180', 'weapon4': '0.314', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.078', 'weapon3': '1.680'} [2024-08-05 21:43:50,452][52669] DAMAGECOUNT value on done: 616.0 [2024-08-05 21:43:50,454][52669] Sum rewards: -2.946, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.785', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'weapon7': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.160', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.262', 'WEAPON7': '0.300', 'DAMAGECOUNT': '0.438', 'WEAPON3': '0.750', 'weapon2': '0.954', 'weapon3': '2.060'} [2024-08-05 21:43:50,638][52665] DAMAGECOUNT value on done: 1047.0 [2024-08-05 21:43:50,639][52665] Sum rewards: -3.459, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.775', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.138', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.296', 'ARMOR': '0.400', 'FRAGCOUNT': '0.500', 'weapon2': '0.780', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.951', 'weapon3': '2.416'} [2024-08-05 21:43:50,805][52650] Updated weights for policy 0, policy_version 2321 (0.0014) [2024-08-05 21:43:51,071][52647] DAMAGECOUNT value on done: 699.0 [2024-08-05 21:43:51,071][52647] Sum rewards: -0.024, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.054', 'AMMO2': '0.023', 'AMMO3': '0.078', 'AMMO4': '0.116', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.765', 'ARMOR': '0.908', 'weapon3': '1.364', 'FRAGCOUNT': '2.000', 'weapon2': '2.002'} [2024-08-05 21:43:51,251][52658] DAMAGECOUNT value on done: 572.0 [2024-08-05 21:43:51,252][52658] Sum rewards: -0.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.195', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.094', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.300', 'ARMOR': '0.477', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.586', 'weapon3': '1.596'} [2024-08-05 21:43:51,700][52649] DAMAGECOUNT value on done: 667.0 [2024-08-05 21:43:51,707][52649] Sum rewards: -2.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.210', 'AMMO2': '0.025', 'ARMOR': '0.080', 'AMMO4': '0.126', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.238', 'DAMAGECOUNT': '0.729', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.364', 'weapon3': '2.110'} [2024-08-05 21:43:52,286][52614] Signal inference workers to stop experience collection... (400 times) [2024-08-05 21:43:52,287][52614] Signal inference workers to resume experience collection... (400 times) [2024-08-05 21:43:52,354][52650] InferenceWorker_p0-w0: stopping experience collection (400 times) [2024-08-05 21:43:52,363][52650] InferenceWorker_p0-w0: resuming experience collection (400 times) [2024-08-05 21:43:52,407][52667] DAMAGECOUNT value on done: 770.0 [2024-08-05 21:43:52,408][52667] Sum rewards: 0.591, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.626', 'AMMO2': '0.028', 'ARMOR': '0.084', 'AMMO3': '0.085', 'AMMO4': '0.142', 'HITCOUNT': '0.190', 'weapon4': '0.192', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.660', 'weapon2': '1.696', 'weapon3': '1.740', 'FRAGCOUNT': '4.000'} [2024-08-05 21:43:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17244.9). Total num frames: 19046400. Throughput: 0: 4264.0. Samples: 4764340. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:43:52,794][52567] Avg episode reward: [(0, '-2.042')] [2024-08-05 21:43:52,795][52614] Saving new best policy, reward=-2.042! [2024-08-05 21:43:52,889][52663] DAMAGECOUNT value on done: 1305.0 [2024-08-05 21:43:53,040][52669] DAMAGECOUNT value on done: 766.0 [2024-08-05 21:43:53,040][52669] Sum rewards: -1.387, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.442', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.106', 'HITCOUNT': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.516', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.975', 'weapon2': '1.122', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:53,572][52665] DAMAGECOUNT value on done: 1062.0 [2024-08-05 21:43:53,574][52665] Sum rewards: -0.108, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.082', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.097', 'weapon5': '0.146', 'HITCOUNT': '0.220', 'weapon4': '0.250', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.852', 'weapon2': '1.238', 'weapon3': '1.876'} [2024-08-05 21:43:54,231][52664] DAMAGECOUNT value on done: 858.0 [2024-08-05 21:43:54,235][52664] Sum rewards: -1.734, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.170', 'weapon4': '0.182', 'ARMOR': '0.465', 'DAMAGECOUNT': '0.498', 'WEAPON3': '0.700', 'weapon2': '1.360', 'weapon3': '1.666', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:54,329][52647] DAMAGECOUNT value on done: 842.0 [2024-08-05 21:43:54,329][52647] Sum rewards: -4.309, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.759', 'AMMO2': '0.015', 'ARMOR': '0.040', 'weapon4': '0.072', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.837', 'FRAGCOUNT': '1.000', 'weapon3': '1.782', 'weapon2': '1.840'} [2024-08-05 21:43:54,668][52658] DAMAGECOUNT value on done: 719.0 [2024-08-05 21:43:54,668][52658] Sum rewards: -0.660, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.034', 'AMMO2': '0.022', 'ARMOR': '0.044', 'AMMO4': '0.112', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.448', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.822', 'weapon2': '1.246', 'weapon3': '1.728', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:54,775][52649] DAMAGECOUNT value on done: 1003.0 [2024-08-05 21:43:54,777][52649] Sum rewards: -4.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.056', 'HITCOUNT': '0.160', 'AMMO3': '0.161', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.774', 'WEAPON3': '0.950', 'weapon2': '1.510', 'weapon3': '2.170'} [2024-08-05 21:43:55,507][52663] DAMAGECOUNT value on done: 585.0 [2024-08-05 21:43:55,761][52669] DAMAGECOUNT value on done: 876.0 [2024-08-05 21:43:55,778][52650] Updated weights for policy 0, policy_version 2331 (0.0011) [2024-08-05 21:43:55,836][52667] DAMAGECOUNT value on done: 478.0 [2024-08-05 21:43:56,135][52665] DAMAGECOUNT value on done: 1034.0 [2024-08-05 21:43:56,136][52665] Sum rewards: 1.270, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.372', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.370', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.482', 'weapon2': '1.640', 'weapon3': '1.894', 'FRAGCOUNT': '4.000'} [2024-08-05 21:43:57,008][52664] DAMAGECOUNT value on done: 887.0 [2024-08-05 21:43:57,008][52664] Sum rewards: -0.360, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.740', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon7': '0.072', 'ARMOR': '0.088', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.050', 'weapon2': '1.094', 'weapon3': '1.414', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:57,038][52647] DAMAGECOUNT value on done: 768.0 [2024-08-05 21:43:57,370][52649] DAMAGECOUNT value on done: 787.0 [2024-08-05 21:43:57,372][52649] Sum rewards: -2.103, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'weapon4': '0.118', 'AMMO3': '0.163', 'HITCOUNT': '0.200', 'HEALTH': '0.392', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.278', 'weapon3': '1.958'} [2024-08-05 21:43:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17189.3). Total num frames: 19120128. Throughput: 0: 4236.0. Samples: 4789880. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 21:43:57,794][52567] Avg episode reward: [(0, '-2.066')] [2024-08-05 21:43:58,060][52658] DAMAGECOUNT value on done: 665.0 [2024-08-05 21:43:58,060][52658] Sum rewards: -4.115, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.855', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO5': '0.012', 'weapon5': '0.032', 'weapon4': '0.048', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.460', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.542', 'weapon3': '1.784'} [2024-08-05 21:43:58,723][52663] DAMAGECOUNT value on done: 972.0 [2024-08-05 21:43:58,725][52663] Sum rewards: -8.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.062', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.044', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon4': '0.178', 'weapon5': '0.182', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.143', 'weapon2': '1.534', 'weapon3': '1.734'} [2024-08-05 21:43:58,782][52665] DAMAGECOUNT value on done: 1278.0 [2024-08-05 21:43:58,784][52665] Sum rewards: -1.481, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.360', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.162', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'ARMOR': '0.909', 'DAMAGECOUNT': '1.080', 'weapon2': '1.712', 'weapon3': '1.804', 'FRAGCOUNT': '2.000'} [2024-08-05 21:43:58,874][52669] DAMAGECOUNT value on done: 891.0 [2024-08-05 21:43:58,876][52669] Sum rewards: 1.085, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon7': '0.046', 'weapon4': '0.054', 'AMMO3': '0.078', 'ARMOR': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.284', 'weapon3': '1.474', 'weapon2': '1.616', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:58,921][52668] DAMAGECOUNT value on done: 782.0 [2024-08-05 21:43:58,921][52668] Sum rewards: -2.808, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.854', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.210', 'weapon4': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.825', 'weapon2': '1.346', 'weapon3': '1.654', 'FRAGCOUNT': '3.000'} [2024-08-05 21:43:59,095][52667] DAMAGECOUNT value on done: 1311.0 [2024-08-05 21:43:59,095][52667] Sum rewards: -3.103, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.398', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'weapon4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.861', 'ARMOR': '0.924', 'weapon2': '1.522', 'weapon3': '1.876'} [2024-08-05 21:43:59,268][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 21:44:00,113][52649] DAMAGECOUNT value on done: 751.0 [2024-08-05 21:44:00,114][52649] Sum rewards: -1.318, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.650', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.153', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.963', 'FRAGCOUNT': '1.000', 'weapon2': '1.288', 'weapon3': '2.408'} [2024-08-05 21:44:00,190][52664] DAMAGECOUNT value on done: 1055.0 [2024-08-05 21:44:00,193][52664] Sum rewards: -1.384, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.861', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO4': '0.028', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.174', 'HITCOUNT': '0.310', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.035', 'weapon2': '1.224', 'FRAGCOUNT': '2.000', 'weapon3': '2.338'} [2024-08-05 21:44:00,213][52647] DAMAGECOUNT value on done: 834.0 [2024-08-05 21:44:00,401][52650] Updated weights for policy 0, policy_version 2341 (0.0012) [2024-08-05 21:44:00,779][52660] DAMAGECOUNT value on done: 1007.0 [2024-08-05 21:44:00,780][52660] Sum rewards: -0.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'HITCOUNT': '0.310', 'ARMOR': '0.498', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.056', 'weapon2': '1.412', 'weapon3': '2.388', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:00,859][52658] DAMAGECOUNT value on done: 804.0 [2024-08-05 21:44:00,859][52658] Sum rewards: -6.110, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.700', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.072', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.129', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.736', 'weapon3': '1.804'} [2024-08-05 21:44:01,547][52663] DAMAGECOUNT value on done: 1041.0 [2024-08-05 21:44:01,547][52663] Sum rewards: 2.614, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.174', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'weapon5': '0.026', 'weapon4': '0.082', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.350', 'ARMOR': '0.521', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.578', 'weapon2': '1.644', 'weapon3': '1.900', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:01,713][52665] DAMAGECOUNT value on done: 1100.0 [2024-08-05 21:44:01,782][52669] DAMAGECOUNT value on done: 779.0 [2024-08-05 21:44:01,943][52667] DAMAGECOUNT value on done: 1093.0 [2024-08-05 21:44:01,944][52667] Sum rewards: -3.543, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.134', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'ARMOR': '0.036', 'weapon4': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.732', 'FRAGCOUNT': '1.000', 'weapon2': '1.368', 'weapon3': '2.144'} [2024-08-05 21:44:02,058][52668] DAMAGECOUNT value on done: 1291.0 [2024-08-05 21:44:02,060][52668] Sum rewards: -4.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.172', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.134', 'AMMO3': '0.182', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.660', 'WEAPON3': '1.100', 'weapon2': '1.376', 'FRAGCOUNT': '2.000', 'weapon3': '2.002'} [2024-08-05 21:44:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.6, 300 sec: 17217.1). Total num frames: 19210240. Throughput: 0: 4226.4. Samples: 4802520. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:44:02,794][52567] Avg episode reward: [(0, '-2.268')] [2024-08-05 21:44:03,331][52647] DAMAGECOUNT value on done: 1066.0 [2024-08-05 21:44:03,339][52647] Sum rewards: 1.210, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.874', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.073', 'weapon5': '0.124', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.196', 'HITCOUNT': '0.230', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.005', 'weapon2': '1.492', 'weapon3': '1.774', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:03,343][52664] DAMAGECOUNT value on done: 654.0 [2024-08-05 21:44:03,344][52664] Sum rewards: 0.492, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.026', 'ARMOR': '0.040', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'HITCOUNT': '0.210', 'weapon4': '0.392', 'WEAPON3': '0.500', 'HEALTH': '0.510', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '1.000', 'weapon2': '1.098', 'weapon3': '1.310'} [2024-08-05 21:44:03,416][52649] DAMAGECOUNT value on done: 408.0 [2024-08-05 21:44:03,418][52649] Sum rewards: -1.572, reward structure: {'DEATHCOUNT': '-4.500', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'HITCOUNT': '0.020', 'weapon5': '0.022', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.058', 'weapon7': '0.088', 'DAMAGECOUNT': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HEALTH': '0.344', 'weapon4': '0.368', 'ARMOR': '0.424', 'weapon3': '0.852', 'weapon2': '1.046'} [2024-08-05 21:44:03,846][52660] DAMAGECOUNT value on done: 825.0 [2024-08-05 21:44:03,848][52660] Sum rewards: -1.833, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.066', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'HITCOUNT': '0.240', 'weapon4': '0.262', 'DAMAGECOUNT': '0.897', 'WEAPON3': '0.950', 'weapon2': '1.172', 'weapon3': '2.220', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:03,908][52658] DAMAGECOUNT value on done: 794.0 [2024-08-05 21:44:03,910][52658] Sum rewards: -0.134, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.259', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon5': '0.036', 'weapon7': '0.050', 'ARMOR': '0.084', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.476', 'DAMAGECOUNT': '0.585', 'weapon2': '0.650', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.732'} [2024-08-05 21:44:04,736][52665] DAMAGECOUNT value on done: 1115.0 [2024-08-05 21:44:04,738][52665] Sum rewards: -3.019, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.552', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.179', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.264', 'DAMAGECOUNT': '0.615', 'WEAPON3': '1.100', 'weapon2': '1.344', 'weapon3': '2.014', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:04,809][52667] DAMAGECOUNT value on done: 654.0 [2024-08-05 21:44:04,810][52667] Sum rewards: -5.129, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.268', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.021', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon4': '0.184', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.600', 'weapon3': '1.436', 'weapon2': '1.964'} [2024-08-05 21:44:04,840][52663] DAMAGECOUNT value on done: 856.0 [2024-08-05 21:44:04,841][52663] Sum rewards: -4.020, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.483', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.145', 'weapon4': '0.146', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.381', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.582', 'weapon3': '1.960', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:05,009][52669] DAMAGECOUNT value on done: 921.0 [2024-08-05 21:44:05,177][52668] DAMAGECOUNT value on done: 1051.0 [2024-08-05 21:44:05,179][52668] Sum rewards: -1.897, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.532', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'weapon5': '0.072', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'HITCOUNT': '0.200', 'weapon4': '0.572', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.962', 'FRAGCOUNT': '1.000', 'weapon3': '1.392'} [2024-08-05 21:44:05,636][52647] DAMAGECOUNT value on done: 800.0 [2024-08-05 21:44:05,637][52647] Sum rewards: -2.671, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.750', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'HITCOUNT': '0.230', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.927', 'weapon3': '1.590', 'FRAGCOUNT': '2.000', 'weapon2': '2.124'} [2024-08-05 21:44:05,680][52650] Updated weights for policy 0, policy_version 2351 (0.0013) [2024-08-05 21:44:05,693][52664] DAMAGECOUNT value on done: 1021.0 [2024-08-05 21:44:05,695][52664] Sum rewards: 0.117, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.192', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.040', 'HITCOUNT': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.300', 'ARMOR': '0.499', 'weapon2': '0.952', 'weapon3': '0.956', 'FRAGCOUNT': '1.000'} [2024-08-05 21:44:06,400][52649] DAMAGECOUNT value on done: 1361.0 [2024-08-05 21:44:06,590][52671] DAMAGECOUNT value on done: 682.0 [2024-08-05 21:44:06,592][52671] Sum rewards: 0.829, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.181', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.020', 'ARMOR': '0.036', 'AMMO3': '0.072', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.855', 'weapon3': '1.330', 'weapon2': '1.812', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:06,963][52658] DAMAGECOUNT value on done: 619.0 [2024-08-05 21:44:06,964][52658] Sum rewards: -2.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.698', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon7': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.050', 'AMMO3': '0.107', 'DAMAGECOUNT': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.408', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.728', 'weapon3': '1.738'} [2024-08-05 21:44:06,992][52660] DAMAGECOUNT value on done: 610.0 [2024-08-05 21:44:06,995][52660] Sum rewards: -6.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.796', 'AMMO2': '0.007', 'ARMOR': '0.032', 'AMMO4': '0.037', 'HITCOUNT': '0.200', 'AMMO3': '0.217', 'DAMAGECOUNT': '0.618', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.822', 'weapon3': '1.952'} [2024-08-05 21:44:07,434][52663] DAMAGECOUNT value on done: 631.0 [2024-08-05 21:44:07,435][52663] Sum rewards: -1.482, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'ARMOR': '0.032', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.125', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.717', 'FRAGCOUNT': '1.000', 'weapon2': '1.452', 'weapon3': '1.540'} [2024-08-05 21:44:07,545][52669] DAMAGECOUNT value on done: 874.0 [2024-08-05 21:44:07,546][52669] Sum rewards: -0.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.700', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.009', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.416', 'weapon2': '1.560', 'weapon3': '1.634', 'FRAGCOUNT': '2.500'} [2024-08-05 21:44:07,570][52665] DAMAGECOUNT value on done: 959.0 [2024-08-05 21:44:07,631][52667] DAMAGECOUNT value on done: 899.0 [2024-08-05 21:44:07,632][52667] Sum rewards: -3.176, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.034', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.128', 'HITCOUNT': '0.230', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.092', 'weapon2': '1.420', 'FRAGCOUNT': '1.500', 'weapon3': '1.606'} [2024-08-05 21:44:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 17217.1). Total num frames: 19292160. Throughput: 0: 4271.8. Samples: 4828190. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:44:07,795][52567] Avg episode reward: [(0, '-2.231')] [2024-08-05 21:44:08,228][52668] DAMAGECOUNT value on done: 425.0 [2024-08-05 21:44:08,855][52647] DAMAGECOUNT value on done: 755.0 [2024-08-05 21:44:08,855][52647] Sum rewards: -1.795, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.873', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.063', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.750', 'weapon2': '1.414', 'FRAGCOUNT': '2.000', 'weapon3': '2.096'} [2024-08-05 21:44:08,957][52664] DAMAGECOUNT value on done: 729.0 [2024-08-05 21:44:08,957][52664] Sum rewards: -0.730, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.868', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'HITCOUNT': '0.230', 'weapon5': '0.358', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.855', 'WEAPON3': '0.900', 'weapon2': '1.516', 'weapon3': '1.986', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:09,319][52659] DAMAGECOUNT value on done: 656.0 [2024-08-05 21:44:09,322][52659] Sum rewards: -0.657, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.522', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'HITCOUNT': '0.180', 'ARMOR': '0.458', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.850', 'weapon2': '1.104', 'FRAGCOUNT': '2.000', 'weapon3': '2.260'} [2024-08-05 21:44:09,407][52671] DAMAGECOUNT value on done: 822.0 [2024-08-05 21:44:09,411][52671] Sum rewards: -3.605, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'HITCOUNT': '0.080', 'weapon5': '0.130', 'AMMO3': '0.138', 'AMMO4': '0.140', 'weapon4': '0.352', 'DAMAGECOUNT': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.500', 'weapon2': '1.536', 'weapon3': '1.590'} [2024-08-05 21:44:09,497][52649] DAMAGECOUNT value on done: 765.0 [2024-08-05 21:44:09,794][52658] DAMAGECOUNT value on done: 729.0 [2024-08-05 21:44:09,794][52658] Sum rewards: -1.901, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.399', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.280', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.891', 'weapon2': '1.256', 'FRAGCOUNT': '2.000', 'weapon3': '2.050'} [2024-08-05 21:44:09,871][52663] DAMAGECOUNT value on done: 1038.0 [2024-08-05 21:44:09,871][52663] Sum rewards: -2.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.975', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.144', 'HITCOUNT': '0.270', 'ARMOR': '0.479', 'DAMAGECOUNT': '0.885', 'WEAPON3': '1.050', 'weapon2': '1.562', 'weapon3': '2.152', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:10,036][52669] DAMAGECOUNT value on done: 898.0 [2024-08-05 21:44:10,036][52669] Sum rewards: 0.029, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.558', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.129', 'weapon4': '0.158', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.700', 'ARMOR': '0.828', 'weapon2': '1.554', 'weapon3': '1.860', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:10,134][52650] Updated weights for policy 0, policy_version 2361 (0.0011) [2024-08-05 21:44:10,395][52660] DAMAGECOUNT value on done: 968.0 [2024-08-05 21:44:10,396][52660] Sum rewards: -0.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.936', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon4': '0.040', 'HITCOUNT': '0.080', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.282', 'ARMOR': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.082', 'weapon3': '1.648', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:10,561][52667] DAMAGECOUNT value on done: 905.0 [2024-08-05 21:44:10,562][52667] Sum rewards: -3.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.698', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.156', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.536', 'DAMAGECOUNT': '1.077', 'WEAPON3': '1.100', 'weapon2': '1.414', 'weapon3': '2.158', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:10,678][52665] DAMAGECOUNT value on done: 1309.0 [2024-08-05 21:44:10,679][52665] Sum rewards: -4.193, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.275', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'weapon7': '0.052', 'HITCOUNT': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.152', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.798', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.418', 'weapon3': '1.678'} [2024-08-05 21:44:11,450][52668] DAMAGECOUNT value on done: 555.0 [2024-08-05 21:44:11,452][52668] Sum rewards: -1.773, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.782', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.438', 'ARMOR': '0.497', 'WEAPON3': '0.750', 'weapon2': '1.530', 'weapon3': '1.844', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:11,917][52647] DAMAGECOUNT value on done: 984.0 [2024-08-05 21:44:11,917][52647] Sum rewards: 2.083, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.016', 'weapon4': '0.022', 'ARMOR': '0.032', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.981', 'weapon2': '1.568', 'weapon3': '1.674', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:11,986][52664] DAMAGECOUNT value on done: 793.0 [2024-08-05 21:44:11,986][52664] Sum rewards: -0.348, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon4': '0.124', 'HITCOUNT': '0.130', 'AMMO3': '0.136', 'HEALTH': '0.328', 'DAMAGECOUNT': '0.429', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.390', 'weapon3': '2.226'} [2024-08-05 21:44:12,223][52659] DAMAGECOUNT value on done: 1022.0 [2024-08-05 21:44:12,347][52671] DAMAGECOUNT value on done: 530.0 [2024-08-05 21:44:12,360][52649] DAMAGECOUNT value on done: 326.0 [2024-08-05 21:44:12,362][52649] Sum rewards: 0.511, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.012', 'HEALTH': '0.024', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'HITCOUNT': '0.080', 'AMMO3': '0.091', 'weapon5': '0.092', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.162', 'DAMAGECOUNT': '0.414', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.404', 'weapon3': '1.984'} [2024-08-05 21:44:12,412][52658] DAMAGECOUNT value on done: 666.0 [2024-08-05 21:44:12,414][52658] Sum rewards: -2.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.141', 'weapon4': '0.190', 'HITCOUNT': '0.310', 'ARMOR': '0.436', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.095', 'weapon2': '1.564', 'weapon3': '2.054', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.2, 300 sec: 17217.1). Total num frames: 19382272. Throughput: 0: 4268.4. Samples: 4854010. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:44:12,794][52567] Avg episode reward: [(0, '-2.266')] [2024-08-05 21:44:12,910][52663] DAMAGECOUNT value on done: 597.0 [2024-08-05 21:44:12,911][52663] Sum rewards: -2.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.172', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.132', 'HITCOUNT': '0.170', 'ARMOR': '0.458', 'DAMAGECOUNT': '0.534', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.880', 'weapon2': '1.980'} [2024-08-05 21:44:12,991][52669] DAMAGECOUNT value on done: 677.0 [2024-08-05 21:44:13,115][52660] DAMAGECOUNT value on done: 993.0 [2024-08-05 21:44:13,327][52667] DAMAGECOUNT value on done: 1379.0 [2024-08-05 21:44:13,327][52667] Sum rewards: -2.033, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-2.000', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'HEALTH': '0.247', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'weapon5': '0.576', 'DAMAGECOUNT': '0.900', 'weapon2': '1.370', 'weapon3': '1.690'} [2024-08-05 21:44:13,678][52665] DAMAGECOUNT value on done: 983.0 [2024-08-05 21:44:13,680][52665] Sum rewards: -1.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.402', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.020', 'weapon7': '0.056', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '0.980', 'FRAGCOUNT': '1.000', 'weapon3': '1.928'} [2024-08-05 21:44:14,128][52668] DAMAGECOUNT value on done: 928.0 [2024-08-05 21:44:14,129][52668] Sum rewards: 3.102, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.146', 'WEAPON3': '0.400', 'HEALTH': '0.520', 'DAMAGECOUNT': '0.555', 'weapon2': '1.190', 'weapon3': '2.062', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:14,741][52650] Updated weights for policy 0, policy_version 2371 (0.0022) [2024-08-05 21:44:14,769][52647] DAMAGECOUNT value on done: 794.0 [2024-08-05 21:44:14,771][52647] Sum rewards: -0.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.062', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon4': '0.138', 'AMMO3': '0.156', 'HITCOUNT': '0.310', 'ARMOR': '0.901', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.230', 'weapon2': '1.308', 'weapon3': '2.020', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:14,847][52664] DAMAGECOUNT value on done: 865.0 [2024-08-05 21:44:14,847][52664] Sum rewards: -1.862, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.066', 'HEALTH': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.134', 'HITCOUNT': '0.170', 'weapon4': '0.246', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'weapon2': '1.336', 'weapon3': '1.584'} [2024-08-05 21:44:15,226][52659] DAMAGECOUNT value on done: 1366.0 [2024-08-05 21:44:15,228][52659] Sum rewards: 0.152, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.316', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.013', 'weapon4': '0.032', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.981', 'weapon2': '1.506', 'FRAGCOUNT': '2.000', 'weapon3': '2.236'} [2024-08-05 21:44:15,317][52671] DAMAGECOUNT value on done: 1436.0 [2024-08-05 21:44:15,506][52658] DAMAGECOUNT value on done: 953.0 [2024-08-05 21:44:15,506][52658] Sum rewards: -3.147, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.238', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.114', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.494', 'weapon3': '1.906'} [2024-08-05 21:44:15,584][52649] DAMAGECOUNT value on done: 420.0 [2024-08-05 21:44:15,794][52669] DAMAGECOUNT value on done: 1005.0 [2024-08-05 21:44:15,794][52669] Sum rewards: 0.747, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.020', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.160', 'WEAPON5': '0.300', 'weapon5': '0.446', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.567', 'WEAPON3': '0.700', 'weapon2': '1.388', 'weapon3': '1.552', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:15,801][52663] DAMAGECOUNT value on done: 992.0 [2024-08-05 21:44:15,802][52663] Sum rewards: 1.383, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'ARMOR': '0.030', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.130', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon2': '1.504', 'DAMAGECOUNT': '1.506', 'weapon3': '1.892', 'FRAGCOUNT': '3.500'} [2024-08-05 21:44:15,931][52660] DAMAGECOUNT value on done: 1218.0 [2024-08-05 21:44:15,931][52660] Sum rewards: -3.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.049', 'AMMO2': '0.007', 'AMMO4': '0.034', 'HITCOUNT': '0.100', 'ARMOR': '0.116', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.260', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.654', 'weapon3': '1.700'} [2024-08-05 21:44:16,493][52667] DAMAGECOUNT value on done: 962.0 [2024-08-05 21:44:16,493][52667] Sum rewards: 1.907, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.302', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.180', 'ARMOR': '0.484', 'DAMAGECOUNT': '0.528', 'WEAPON3': '0.550', 'weapon2': '1.486', 'weapon3': '1.792', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:16,958][52665] DAMAGECOUNT value on done: 933.0 [2024-08-05 21:44:16,959][52665] Sum rewards: -3.950, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.580', 'AMMO2': '0.006', 'AMMO4': '0.031', 'ARMOR': '0.076', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'HITCOUNT': '0.240', 'weapon4': '0.328', 'DAMAGECOUNT': '0.735', 'weapon2': '0.976', 'WEAPON3': '1.150', 'FRAGCOUNT': '2.000', 'weapon3': '2.148'} [2024-08-05 21:44:16,969][52668] DAMAGECOUNT value on done: 921.0 [2024-08-05 21:44:17,586][52647] DAMAGECOUNT value on done: 677.0 [2024-08-05 21:44:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17066.6, 300 sec: 17217.1). Total num frames: 19472384. Throughput: 0: 4274.5. Samples: 4866980. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:44:17,795][52567] Avg episode reward: [(0, '-2.196')] [2024-08-05 21:44:17,817][52664] DAMAGECOUNT value on done: 1221.0 [2024-08-05 21:44:17,817][52664] Sum rewards: 0.021, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.600', 'AMMO2': '0.005', 'AMMO4': '0.023', 'ARMOR': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.180', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon2': '1.622', 'weapon3': '1.828', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:18,130][52659] DAMAGECOUNT value on done: 893.0 [2024-08-05 21:44:18,131][52659] Sum rewards: -2.812, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.343', 'AMMO2': '0.023', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.133', 'weapon4': '0.196', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.993', 'FRAGCOUNT': '1.000', 'weapon2': '1.642', 'weapon3': '2.046'} [2024-08-05 21:44:18,236][52671] DAMAGECOUNT value on done: 1017.0 [2024-08-05 21:44:18,236][52671] Sum rewards: 3.706, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.358', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'HITCOUNT': '0.430', 'ARMOR': '0.465', 'WEAPON3': '0.950', 'weapon2': '1.178', 'DAMAGECOUNT': '1.929', 'weapon3': '2.170', 'FRAGCOUNT': '6.000'} [2024-08-05 21:44:18,339][52658] DAMAGECOUNT value on done: 1333.0 [2024-08-05 21:44:18,341][52658] Sum rewards: 1.187, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.333', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'weapon3': '1.558', 'DAMAGECOUNT': '1.593', 'weapon2': '1.800', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:18,700][52669] DAMAGECOUNT value on done: 663.0 [2024-08-05 21:44:18,701][52669] Sum rewards: -5.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.632', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon4': '0.032', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.139', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.488', 'weapon3': '2.124'} [2024-08-05 21:44:18,726][52663] DAMAGECOUNT value on done: 919.0 [2024-08-05 21:44:18,728][52663] Sum rewards: 1.592, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.344', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.081', 'AMMO4': '0.110', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.412', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.876', 'weapon2': '1.472', 'weapon3': '1.662', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:18,820][52660] DAMAGECOUNT value on done: 580.0 [2024-08-05 21:44:18,826][52649] DAMAGECOUNT value on done: 781.0 [2024-08-05 21:44:18,827][52649] Sum rewards: -0.528, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.687', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon4': '0.006', 'weapon5': '0.016', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.550', 'ARMOR': '0.553', 'FRAGCOUNT': '1.000', 'weapon3': '1.334', 'weapon2': '1.872'} [2024-08-05 21:44:19,281][52667] DAMAGECOUNT value on done: 1188.0 [2024-08-05 21:44:19,281][52667] Sum rewards: -5.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.948', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'weapon4': '0.038', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'AMMO3': '0.189', 'ARMOR': '0.512', 'DAMAGECOUNT': '0.600', 'WEAPON3': '1.150', 'weapon2': '1.492', 'FRAGCOUNT': '2.000', 'weapon3': '2.176'} [2024-08-05 21:44:19,745][52650] Updated weights for policy 0, policy_version 2381 (0.0035) [2024-08-05 21:44:19,878][52668] DAMAGECOUNT value on done: 950.0 [2024-08-05 21:44:19,879][52668] Sum rewards: -5.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.475', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.076', 'AMMO3': '0.134', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.372', 'weapon3': '1.548'} [2024-08-05 21:44:20,425][52647] DAMAGECOUNT value on done: 1251.0 [2024-08-05 21:44:20,425][52647] Sum rewards: 2.163, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'ARMOR': '0.072', 'AMMO3': '0.135', 'weapon4': '0.224', 'HEALTH': '0.305', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'weapon2': '1.280', 'DAMAGECOUNT': '1.350', 'weapon3': '2.200', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:20,683][52664] DAMAGECOUNT value on done: 824.0 [2024-08-05 21:44:20,683][52664] Sum rewards: 1.333, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.095', 'HITCOUNT': '0.280', 'ARMOR': '0.451', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.095', 'weapon3': '1.524', 'weapon2': '1.724', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:21,065][52658] DAMAGECOUNT value on done: 668.0 [2024-08-05 21:44:21,065][52658] Sum rewards: -2.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.582', 'AMMO4': '-0.099', 'AMMO2': '-0.020', 'WEAPON1': '0.020', 'HITCOUNT': '0.120', 'AMMO3': '0.151', 'ARMOR': '0.566', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.950', 'weapon2': '1.566', 'FRAGCOUNT': '2.000', 'weapon3': '2.062'} [2024-08-05 21:44:21,331][52659] DAMAGECOUNT value on done: 635.0 [2024-08-05 21:44:21,331][52659] Sum rewards: 0.349, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.942', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.088', 'AMMO4': '0.098', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON3': '0.650', 'ARMOR': '0.960', 'weapon2': '1.408', 'weapon3': '1.628', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:21,392][52671] DAMAGECOUNT value on done: 890.0 [2024-08-05 21:44:21,394][52671] Sum rewards: -3.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO2': '0.014', 'weapon7': '0.066', 'AMMO4': '0.070', 'weapon4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.020', 'weapon3': '1.644', 'weapon2': '2.016', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:21,639][52669] DAMAGECOUNT value on done: 1062.0 [2024-08-05 21:44:21,640][52669] Sum rewards: 1.897, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.029', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon5': '0.072', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.470', 'ARMOR': '0.507', 'WEAPON3': '0.750', 'weapon2': '1.258', 'DAMAGECOUNT': '1.548', 'weapon3': '2.214', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:21,792][52667] DAMAGECOUNT value on done: 920.0 [2024-08-05 21:44:21,796][52667] Sum rewards: -5.182, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.342', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.262', 'ARMOR': '0.508', 'DAMAGECOUNT': '0.759', 'WEAPON3': '1.100', 'weapon2': '1.344', 'FRAGCOUNT': '2.000', 'weapon3': '2.074'} [2024-08-05 21:44:21,819][52663] DAMAGECOUNT value on done: 1110.0 [2024-08-05 21:44:21,819][52663] Sum rewards: 0.112, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.498', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.036', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.582', 'weapon3': '2.114'} [2024-08-05 21:44:21,996][52660] DAMAGECOUNT value on done: 813.0 [2024-08-05 21:44:21,997][52660] Sum rewards: -0.279, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.432', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.103', 'HITCOUNT': '0.200', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.705', 'FRAGCOUNT': '1.000', 'weapon2': '1.854', 'weapon3': '1.960'} [2024-08-05 21:44:22,148][52649] DAMAGECOUNT value on done: 892.0 [2024-08-05 21:44:22,148][52649] Sum rewards: -1.940, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.904', 'AMMO2': '0.006', 'ARMOR': '0.016', 'AMMO4': '0.030', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.166', 'DAMAGECOUNT': '0.330', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.290', 'weapon3': '1.972'} [2024-08-05 21:44:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 17189.3). Total num frames: 19554304. Throughput: 0: 4261.8. Samples: 4892260. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-05 21:44:22,794][52567] Avg episode reward: [(0, '-1.958')] [2024-08-05 21:44:22,795][52614] Saving new best policy, reward=-1.958! [2024-08-05 21:44:23,144][52647] DAMAGECOUNT value on done: 1009.0 [2024-08-05 21:44:23,180][52668] DAMAGECOUNT value on done: 1025.0 [2024-08-05 21:44:23,180][52668] Sum rewards: -2.387, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'HITCOUNT': '0.220', 'ARMOR': '0.487', 'DAMAGECOUNT': '0.783', 'WEAPON3': '1.000', 'weapon2': '1.798', 'weapon3': '1.828', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:23,495][52664] DAMAGECOUNT value on done: 820.0 [2024-08-05 21:44:23,500][52664] Sum rewards: -0.870, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.788', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO3': '0.096', 'HITCOUNT': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon5': '0.160', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.362', 'weapon2': '1.784'} [2024-08-05 21:44:23,935][52658] DAMAGECOUNT value on done: 962.0 [2024-08-05 21:44:23,938][52658] Sum rewards: -3.309, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.446', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.873', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.408', 'weapon3': '2.104'} [2024-08-05 21:44:24,595][52650] Updated weights for policy 0, policy_version 2391 (0.0018) [2024-08-05 21:44:24,634][52659] DAMAGECOUNT value on done: 582.0 [2024-08-05 21:44:24,635][52659] Sum rewards: -0.082, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.028', 'weapon7': '0.036', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.180', 'weapon4': '0.182', 'AMMO6': '0.260', 'AMMO7': '0.260', 'WEAPON7': '0.300', 'DAMAGECOUNT': '0.489', 'WEAPON3': '0.750', 'weapon2': '1.400', 'FRAGCOUNT': '2.000', 'weapon3': '2.046'} [2024-08-05 21:44:24,648][52671] DAMAGECOUNT value on done: 700.0 [2024-08-05 21:44:24,648][52671] Sum rewards: -1.561, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.900', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.045', 'weapon4': '0.058', 'AMMO3': '0.086', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.312', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.354', 'weapon3': '1.912'} [2024-08-05 21:44:24,770][52660] DAMAGECOUNT value on done: 1024.0 [2024-08-05 21:44:24,772][52660] Sum rewards: -1.526, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.576', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.058', 'ARMOR': '0.060', 'AMMO3': '0.125', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.750', 'weapon2': '1.564', 'weapon3': '1.986', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:24,879][52667] DAMAGECOUNT value on done: 687.0 [2024-08-05 21:44:24,881][52667] Sum rewards: 1.223, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.899', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.200', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.744', 'WEAPON3': '0.800', 'weapon2': '1.544', 'weapon3': '1.684', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:24,935][52669] DAMAGECOUNT value on done: 999.0 [2024-08-05 21:44:24,935][52669] Sum rewards: 0.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.271', 'AMMO2': '0.011', 'weapon7': '0.018', 'AMMO4': '0.054', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.400', 'ARMOR': '0.474', 'DAMAGECOUNT': '0.588', 'weapon3': '0.908', 'FRAGCOUNT': '1.000', 'weapon2': '2.268'} [2024-08-05 21:44:25,144][52663] DAMAGECOUNT value on done: 728.0 [2024-08-05 21:44:25,362][52649] DAMAGECOUNT value on done: 980.0 [2024-08-05 21:44:25,363][52649] Sum rewards: -2.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.150', 'weapon4': '0.246', 'ARMOR': '0.491', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.586', 'weapon3': '1.830'} [2024-08-05 21:44:25,809][52647] DAMAGECOUNT value on done: 1106.0 [2024-08-05 21:44:25,810][52647] Sum rewards: -0.869, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.740', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.256', 'HITCOUNT': '0.270', 'ARMOR': '0.464', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.004', 'DAMAGECOUNT': '1.161', 'weapon3': '1.926'} [2024-08-05 21:44:25,973][52668] DAMAGECOUNT value on done: 1129.0 [2024-08-05 21:44:25,973][52668] Sum rewards: -1.510, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.106', 'weapon4': '0.118', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'ARMOR': '0.532', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '1.738', 'weapon3': '1.842'} [2024-08-05 21:44:26,151][52664] DAMAGECOUNT value on done: 1159.0 [2024-08-05 21:44:27,109][52658] DAMAGECOUNT value on done: 1019.0 [2024-08-05 21:44:27,111][52658] Sum rewards: 0.731, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.357', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'ARMOR': '0.012', 'AMMO3': '0.141', 'HITCOUNT': '0.330', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.260', 'weapon2': '1.366', 'weapon3': '2.220', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:27,611][52671] DAMAGECOUNT value on done: 782.0 [2024-08-05 21:44:27,611][52671] Sum rewards: 0.186, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.222', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.180', 'weapon4': '0.264', 'ARMOR': '0.473', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.765', 'weapon2': '1.062', 'weapon3': '1.400', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:27,646][52659] DAMAGECOUNT value on done: 1243.0 [2024-08-05 21:44:27,649][52659] Sum rewards: -4.434, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.372', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'ARMOR': '0.078', 'AMMO3': '0.126', 'weapon5': '0.184', 'HITCOUNT': '0.210', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.800', 'weapon2': '1.610', 'weapon3': '1.776'} [2024-08-05 21:44:27,748][52669] DAMAGECOUNT value on done: 1064.0 [2024-08-05 21:44:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17066.7, 300 sec: 17217.1). Total num frames: 19636224. Throughput: 0: 4258.2. Samples: 4917800. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:44:27,794][52567] Avg episode reward: [(0, '-1.770')] [2024-08-05 21:44:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002397_19636224.pth... [2024-08-05 21:44:27,831][52667] DAMAGECOUNT value on done: 1112.0 [2024-08-05 21:44:27,833][52667] Sum rewards: -2.458, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.060', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.022', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.160', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.538', 'weapon3': '2.134'} [2024-08-05 21:44:27,903][52660] DAMAGECOUNT value on done: 587.0 [2024-08-05 21:44:27,905][52660] Sum rewards: -1.651, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.465', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.120', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.240', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.362', 'weapon3': '1.944'} [2024-08-05 21:44:27,986][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000001896_15532032.pth [2024-08-05 21:44:27,995][52614] Saving new best policy, reward=-1.770! [2024-08-05 21:44:28,090][52663] DAMAGECOUNT value on done: 981.0 [2024-08-05 21:44:28,090][52663] Sum rewards: -2.174, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.210', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'weapon4': '0.126', 'DAMAGECOUNT': '0.162', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'weapon3': '1.244', 'weapon2': '1.584'} [2024-08-05 21:44:28,345][52649] DAMAGECOUNT value on done: 1010.0 [2024-08-05 21:44:28,386][52647] DAMAGECOUNT value on done: 475.0 [2024-08-05 21:44:28,646][52664] DAMAGECOUNT value on done: 715.0 [2024-08-05 21:44:28,647][52664] Sum rewards: -2.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.146', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.260', 'DAMAGECOUNT': '0.810', 'WEAPON3': '0.850', 'ARMOR': '0.861', 'FRAGCOUNT': '1.000', 'weapon2': '1.532', 'weapon3': '1.580'} [2024-08-05 21:44:29,327][52650] Updated weights for policy 0, policy_version 2401 (0.0041) [2024-08-05 21:44:29,331][52668] DAMAGECOUNT value on done: 893.0 [2024-08-05 21:44:29,333][52668] Sum rewards: -2.469, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.070', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'weapon7': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.276', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.167', 'weapon2': '1.196', 'weapon3': '1.400', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:29,788][52658] DAMAGECOUNT value on done: 1298.0 [2024-08-05 21:44:29,789][52658] Sum rewards: -1.219, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.564', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.128', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.338', 'weapon3': '1.938'} [2024-08-05 21:44:30,554][52667] DAMAGECOUNT value on done: 1280.0 [2024-08-05 21:44:30,557][52667] Sum rewards: 1.697, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.994', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.148', 'HITCOUNT': '0.330', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.156', 'DAMAGECOUNT': '1.335', 'weapon3': '2.252', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:30,923][52671] DAMAGECOUNT value on done: 1640.0 [2024-08-05 21:44:30,924][52671] Sum rewards: 0.991, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.808', 'AMMO4': '-0.086', 'AMMO2': '-0.017', 'AMMO5': '0.008', 'weapon5': '0.062', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.464', 'weapon3': '1.616', 'weapon2': '1.804', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:31,004][52659] DAMAGECOUNT value on done: 990.0 [2024-08-05 21:44:31,005][52659] Sum rewards: 0.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.067', 'AMMO2': '0.023', 'ARMOR': '0.056', 'AMMO3': '0.094', 'weapon4': '0.094', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.224', 'weapon2': '1.634', 'weapon3': '1.800', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:31,124][52669] DAMAGECOUNT value on done: 914.0 [2024-08-05 21:44:31,125][52669] Sum rewards: -1.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.592', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'ARMOR': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'HITCOUNT': '0.420', 'WEAPON3': '1.050', 'weapon2': '1.190', 'DAMAGECOUNT': '1.521', 'weapon3': '2.376', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:31,240][52647] DAMAGECOUNT value on done: 1016.0 [2024-08-05 21:44:31,241][52647] Sum rewards: -1.333, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.134', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.375', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.392', 'weapon3': '1.816'} [2024-08-05 21:44:31,422][52663] DAMAGECOUNT value on done: 672.0 [2024-08-05 21:44:31,425][52663] Sum rewards: -2.210, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.958', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO4': '0.020', 'HITCOUNT': '0.130', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.950', 'weapon2': '1.538', 'FRAGCOUNT': '2.000', 'weapon3': '2.172'} [2024-08-05 21:44:31,600][52660] DAMAGECOUNT value on done: 876.0 [2024-08-05 21:44:31,603][52660] Sum rewards: -4.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.340', 'AMMO2': '0.004', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO4': '0.018', 'AMMO5': '0.025', 'HITCOUNT': '0.130', 'AMMO3': '0.167', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.420', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.432', 'weapon3': '1.994'} [2024-08-05 21:44:31,778][52664] DAMAGECOUNT value on done: 843.0 [2024-08-05 21:44:31,778][52664] Sum rewards: 2.951, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.370', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'weapon4': '0.102', 'AMMO4': '0.110', 'weapon6': '0.188', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.329', 'weapon2': '1.520', 'weapon3': '1.846', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:32,619][52668] DAMAGECOUNT value on done: 742.0 [2024-08-05 21:44:32,657][52658] DAMAGECOUNT value on done: 889.0 [2024-08-05 21:44:32,659][52658] Sum rewards: 3.181, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'HEALTH': '0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.507', 'DAMAGECOUNT': '0.873', 'weapon2': '1.326', 'weapon3': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.3, 300 sec: 17189.4). Total num frames: 19726336. Throughput: 0: 4255.8. Samples: 4930310. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:44:32,794][52567] Avg episode reward: [(0, '-1.628')] [2024-08-05 21:44:32,795][52614] Saving new best policy, reward=-1.628! [2024-08-05 21:44:33,390][52667] DAMAGECOUNT value on done: 1243.0 [2024-08-05 21:44:33,390][52667] Sum rewards: 5.743, reward structure: {'DEATHCOUNT': '-7.500', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.107', 'weapon4': '0.224', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'HEALTH': '0.573', 'weapon2': '1.224', 'DAMAGECOUNT': '1.671', 'weapon3': '2.106', 'FRAGCOUNT': '6.000'} [2024-08-05 21:44:34,065][52671] DAMAGECOUNT value on done: 977.0 [2024-08-05 21:44:34,163][52659] DAMAGECOUNT value on done: 914.0 [2024-08-05 21:44:34,163][52659] Sum rewards: 2.436, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.567', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.036', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.284', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'weapon3': '1.226', 'weapon2': '1.346', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:34,213][52650] Updated weights for policy 0, policy_version 2411 (0.0012) [2024-08-05 21:44:34,235][52669] DAMAGECOUNT value on done: 1273.0 [2024-08-05 21:44:34,236][52669] Sum rewards: 1.531, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.123', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.212', 'HITCOUNT': '0.330', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.182', 'weapon2': '1.724', 'weapon3': '1.882', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:34,532][52647] DAMAGECOUNT value on done: 1098.0 [2024-08-05 21:44:34,532][52647] Sum rewards: 1.269, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.720', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'ARMOR': '0.028', 'AMMO3': '0.116', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.550', 'DAMAGECOUNT': '1.608', 'weapon3': '1.892', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:34,594][52663] DAMAGECOUNT value on done: 1138.0 [2024-08-05 21:44:34,594][52663] Sum rewards: 1.163, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.726', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.470', 'ARMOR': '0.904', 'weapon2': '1.006', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.377', 'weapon3': '2.766', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:34,975][52660] DAMAGECOUNT value on done: 488.0 [2024-08-05 21:44:34,976][52660] Sum rewards: -6.440, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.820', 'FRAGCOUNT': '-1.500', 'AMMO2': '0.010', 'AMMO5': '0.019', 'ARMOR': '0.024', 'weapon5': '0.034', 'AMMO4': '0.051', 'HITCOUNT': '0.080', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.506', 'WEAPON3': '0.800', 'weapon2': '1.046', 'weapon3': '1.740'} [2024-08-05 21:44:35,136][52664] DAMAGECOUNT value on done: 1228.0 [2024-08-05 21:44:35,136][52664] Sum rewards: 2.253, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.158', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon4': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.058', 'ARMOR': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.368', 'DAMAGECOUNT': '1.620', 'weapon3': '2.286', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:35,359][52658] DAMAGECOUNT value on done: 329.0 [2024-08-05 21:44:35,360][52658] Sum rewards: 0.749, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'AMMO3': '0.081', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.130', 'ARMOR': '0.197', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.500', 'weapon4': '0.572', 'weapon3': '1.120', 'weapon2': '1.274', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:36,064][52667] DAMAGECOUNT value on done: 1243.0 [2024-08-05 21:44:36,064][52667] Sum rewards: 0.372, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.911', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.056', 'ARMOR': '0.072', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.215', 'weapon2': '1.774', 'weapon3': '1.930', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:36,167][52668] DAMAGECOUNT value on done: 918.0 [2024-08-05 21:44:36,169][52668] Sum rewards: 0.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.432', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.200', 'weapon5': '0.230', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.855', 'weapon2': '1.418', 'weapon3': '1.800', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:36,679][52666] DAMAGECOUNT value on done: 689.0 [2024-08-05 21:44:37,348][52671] DAMAGECOUNT value on done: 1091.0 [2024-08-05 21:44:37,349][52671] Sum rewards: 2.014, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.275', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.097', 'HITCOUNT': '0.220', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.900', 'weapon2': '1.254', 'weapon3': '1.780', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:37,472][52663] DAMAGECOUNT value on done: 702.0 [2024-08-05 21:44:37,475][52663] Sum rewards: 3.413, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.237', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'weapon7': '0.054', 'weapon5': '0.062', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.190', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.810', 'weapon2': '1.216', 'weapon3': '1.828', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:37,530][52659] DAMAGECOUNT value on done: 1306.0 [2024-08-05 21:44:37,531][52659] Sum rewards: -2.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.026', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.070', 'AMMO4': '0.085', 'AMMO3': '0.141', 'weapon4': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.444', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.952', 'DAMAGECOUNT': '1.101', 'weapon3': '2.162'} [2024-08-05 21:44:37,756][52660] DAMAGECOUNT value on done: 657.0 [2024-08-05 21:44:37,756][52660] Sum rewards: -4.421, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.653', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.115', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.822', 'weapon2': '1.886'} [2024-08-05 21:44:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.6, 300 sec: 17189.3). Total num frames: 19808256. Throughput: 0: 4258.4. Samples: 4955970. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 21:44:37,795][52567] Avg episode reward: [(0, '-1.247')] [2024-08-05 21:44:37,798][52614] Saving new best policy, reward=-1.247! [2024-08-05 21:44:38,055][52658] DAMAGECOUNT value on done: 1224.0 [2024-08-05 21:44:38,055][52658] Sum rewards: -4.163, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.314', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.077', 'HITCOUNT': '0.140', 'weapon4': '0.170', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.278', 'ARMOR': '0.456', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.500', 'weapon3': '1.404', 'weapon2': '1.790'} [2024-08-05 21:44:38,484][52664] DAMAGECOUNT value on done: 740.0 [2024-08-05 21:44:38,487][52664] Sum rewards: -4.955, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.936', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.072', 'HITCOUNT': '0.100', 'AMMO3': '0.147', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.586', 'weapon3': '2.224'} [2024-08-05 21:44:38,943][52668] DAMAGECOUNT value on done: 685.0 [2024-08-05 21:44:38,944][52668] Sum rewards: -1.857, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.121', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.020', 'ARMOR': '0.068', 'AMMO4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.412', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.308', 'weapon3': '1.732'} [2024-08-05 21:44:38,963][52670] DAMAGECOUNT value on done: 974.0 [2024-08-05 21:44:38,963][52670] Sum rewards: -1.202, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'weapon5': '0.070', 'AMMO4': '0.099', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.280', 'HITCOUNT': '0.300', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.296', 'weapon2': '1.342', 'weapon3': '1.816'} [2024-08-05 21:44:38,975][52650] Updated weights for policy 0, policy_version 2421 (0.0024) [2024-08-05 21:44:40,036][52666] DAMAGECOUNT value on done: 885.0 [2024-08-05 21:44:40,037][52666] Sum rewards: 1.863, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'weapon5': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.422', 'weapon2': '1.456', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:40,521][52660] DAMAGECOUNT value on done: 1129.0 [2024-08-05 21:44:40,521][52660] Sum rewards: -2.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.980', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.834', 'WEAPON3': '0.950', 'weapon2': '1.360', 'FRAGCOUNT': '2.000', 'weapon3': '2.232'} [2024-08-05 21:44:40,900][52671] DAMAGECOUNT value on done: 1740.0 [2024-08-05 21:44:41,083][52659] DAMAGECOUNT value on done: 991.0 [2024-08-05 21:44:41,083][52659] Sum rewards: 1.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.024', 'AMMO5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.070', 'HITCOUNT': '0.170', 'weapon5': '0.278', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'ARMOR': '1.254', 'weapon3': '1.428', 'weapon2': '1.952', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:41,166][52658] DAMAGECOUNT value on done: 982.0 [2024-08-05 21:44:41,220][52663] DAMAGECOUNT value on done: 609.0 [2024-08-05 21:44:41,226][52663] Sum rewards: -0.055, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.484', 'AMMO2': '0.012', 'ARMOR': '0.032', 'weapon4': '0.038', 'AMMO4': '0.060', 'AMMO3': '0.076', 'HITCOUNT': '0.080', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.324', 'WEAPON3': '0.400', 'FRAGCOUNT': '1.000', 'weapon3': '1.342', 'weapon2': '1.464'} [2024-08-05 21:44:41,317][52668] DAMAGECOUNT value on done: 1213.0 [2024-08-05 21:44:41,318][52668] Sum rewards: 4.880, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.064', 'weapon5': '0.076', 'AMMO3': '0.080', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'HEALTH': '0.726', 'DAMAGECOUNT': '1.506', 'weapon2': '1.710', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:41,553][52670] DAMAGECOUNT value on done: 947.0 [2024-08-05 21:44:41,553][52670] Sum rewards: 2.046, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.275', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.017', 'WEAPON1': '0.030', 'weapon5': '0.056', 'AMMO3': '0.080', 'HITCOUNT': '0.180', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.825', 'weapon3': '1.742', 'weapon2': '1.922', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:41,653][52664] DAMAGECOUNT value on done: 949.0 [2024-08-05 21:44:41,655][52664] Sum rewards: -2.829, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.022', 'ARMOR': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'HEALTH': '0.131', 'AMMO3': '0.134', 'HITCOUNT': '0.180', 'weapon4': '0.270', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.440', 'weapon3': '2.064'} [2024-08-05 21:44:42,715][52666] DAMAGECOUNT value on done: 935.0 [2024-08-05 21:44:42,715][52666] Sum rewards: -3.590, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.714', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.139', 'HITCOUNT': '0.300', 'ARMOR': '0.469', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.248', 'weapon2': '1.372', 'weapon3': '2.082'} [2024-08-05 21:44:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17189.3). Total num frames: 19898368. Throughput: 0: 4254.9. Samples: 4981350. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:44:42,794][52567] Avg episode reward: [(0, '-1.190')] [2024-08-05 21:44:42,795][52614] Saving new best policy, reward=-1.190! [2024-08-05 21:44:42,944][52660] DAMAGECOUNT value on done: 831.0 [2024-08-05 21:44:42,945][52660] Sum rewards: -4.355, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.202', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.029', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'HITCOUNT': '0.240', 'ARMOR': '0.477', 'DAMAGECOUNT': '0.597', 'WEAPON3': '1.050', 'weapon3': '1.412', 'FRAGCOUNT': '2.000', 'weapon2': '2.114'} [2024-08-05 21:44:43,792][52650] Updated weights for policy 0, policy_version 2431 (0.0012) [2024-08-05 21:44:43,825][52668] DAMAGECOUNT value on done: 1016.0 [2024-08-05 21:44:43,826][52668] Sum rewards: -2.955, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.168', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.020', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.302', 'HITCOUNT': '0.330', 'WEAPON3': '1.150', 'weapon2': '1.166', 'DAMAGECOUNT': '1.218', 'weapon3': '2.204', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:44,350][52671] DAMAGECOUNT value on done: 1160.0 [2024-08-05 21:44:44,350][52671] Sum rewards: 2.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.828', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.234', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.074', 'weapon3': '1.476', 'weapon2': '1.590', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:44,371][52664] DAMAGECOUNT value on done: 699.0 [2024-08-05 21:44:44,372][52664] Sum rewards: -2.696, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.080', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'HITCOUNT': '0.050', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.165', 'weapon5': '0.304', 'WEAPON3': '0.500', 'weapon3': '1.072', 'weapon2': '1.800'} [2024-08-05 21:44:44,413][52659] DAMAGECOUNT value on done: 1068.0 [2024-08-05 21:44:44,414][52659] Sum rewards: 1.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.036', 'ARMOR': '0.076', 'weapon7': '0.094', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.744', 'weapon3': '1.586', 'weapon2': '1.980', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:45,012][52670] DAMAGECOUNT value on done: 952.0 [2024-08-05 21:44:45,013][52670] Sum rewards: 0.355, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.440', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO3': '0.081', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.582', 'WEAPON3': '0.600', 'ARMOR': '0.973', 'weapon2': '1.714', 'weapon3': '1.740', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:46,066][52660] DAMAGECOUNT value on done: 1100.0 [2024-08-05 21:44:46,067][52660] Sum rewards: -3.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.024', 'AMMO5': '0.025', 'weapon5': '0.032', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'DAMAGECOUNT': '1.092', 'WEAPON3': '1.250', 'weapon2': '1.448', 'weapon3': '1.940', 'FRAGCOUNT': '3.500'} [2024-08-05 21:44:46,103][52666] DAMAGECOUNT value on done: 719.0 [2024-08-05 21:44:47,179][52668] DAMAGECOUNT value on done: 805.0 [2024-08-05 21:44:47,181][52668] Sum rewards: -1.119, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.494', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.096', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.274', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.650', 'ARMOR': '0.965', 'weapon2': '1.464', 'weapon3': '1.686', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:47,417][52671] DAMAGECOUNT value on done: 896.0 [2024-08-05 21:44:47,418][52671] Sum rewards: -5.693, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.980', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'HITCOUNT': '0.100', 'AMMO3': '0.118', 'weapon4': '0.228', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.420', 'weapon3': '1.808'} [2024-08-05 21:44:47,504][52664] DAMAGECOUNT value on done: 801.0 [2024-08-05 21:44:47,566][52659] DAMAGECOUNT value on done: 1209.0 [2024-08-05 21:44:47,568][52659] Sum rewards: -3.865, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.723', 'AMMO5': '0.005', 'AMMO2': '0.037', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'HITCOUNT': '0.110', 'AMMO4': '0.187', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.357', 'weapon4': '0.492', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.240', 'weapon3': '1.280'} [2024-08-05 21:44:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17161.5). Total num frames: 19980288. Throughput: 0: 4252.4. Samples: 4993880. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-05 21:44:47,794][52567] Avg episode reward: [(0, '-1.360')] [2024-08-05 21:44:48,285][52670] DAMAGECOUNT value on done: 1120.0 [2024-08-05 21:44:48,287][52670] Sum rewards: 2.049, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.610', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'HITCOUNT': '0.310', 'WEAPON3': '1.000', 'weapon2': '1.450', 'DAMAGECOUNT': '1.695', 'weapon3': '2.078', 'FRAGCOUNT': '6.000'} [2024-08-05 21:44:48,531][52650] Updated weights for policy 0, policy_version 2441 (0.0013) [2024-08-05 21:44:48,955][52660] DAMAGECOUNT value on done: 1084.0 [2024-08-05 21:44:49,266][52666] DAMAGECOUNT value on done: 814.0 [2024-08-05 21:44:50,028][52664] DAMAGECOUNT value on done: 1528.0 [2024-08-05 21:44:50,030][52664] Sum rewards: 0.588, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.808', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.365', 'weapon3': '1.622', 'weapon2': '1.986', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:50,260][52668] DAMAGECOUNT value on done: 912.0 [2024-08-05 21:44:50,261][52668] Sum rewards: 2.286, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.283', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO4': '0.090', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.174', 'HITCOUNT': '0.260', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.074', 'weapon3': '1.492', 'weapon2': '1.796', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:50,617][52671] DAMAGECOUNT value on done: 856.0 [2024-08-05 21:44:50,617][52671] Sum rewards: 0.454, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.280', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO5': '0.010', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon5': '0.254', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.094', 'weapon2': '1.890'} [2024-08-05 21:44:50,718][52659] DAMAGECOUNT value on done: 2176.0 [2024-08-05 21:44:50,718][52659] Sum rewards: 2.302, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.860', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.029', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.436', 'weapon4': '0.438', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.266', 'weapon2': '1.326', 'weapon3': '1.746', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:51,468][52670] DAMAGECOUNT value on done: 907.0 [2024-08-05 21:44:52,248][52660] DAMAGECOUNT value on done: 1179.0 [2024-08-05 21:44:52,250][52660] Sum rewards: 2.062, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.115', 'weapon5': '0.120', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'ARMOR': '0.499', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.431', 'weapon2': '1.690', 'weapon3': '1.774', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:52,349][52666] DAMAGECOUNT value on done: 1155.0 [2024-08-05 21:44:52,351][52666] Sum rewards: -2.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.116', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.030', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.164', 'weapon4': '0.242', 'HITCOUNT': '0.390', 'WEAPON3': '0.900', 'weapon3': '1.458', 'DAMAGECOUNT': '1.641', 'weapon2': '1.782', 'FRAGCOUNT': '4.000'} [2024-08-05 21:44:52,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16930.1, 300 sec: 17161.5). Total num frames: 20062208. Throughput: 0: 4263.3. Samples: 5020040. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:44:52,795][52567] Avg episode reward: [(0, '-1.229')] [2024-08-05 21:44:52,947][52671] DAMAGECOUNT value on done: 602.0 [2024-08-05 21:44:52,949][52671] Sum rewards: -4.190, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.459', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.072', 'HITCOUNT': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.255', 'WEAPON3': '0.400', 'weapon4': '0.434', 'weapon3': '1.160', 'weapon2': '1.706'} [2024-08-05 21:44:53,063][52659] DAMAGECOUNT value on done: 950.0 [2024-08-05 21:44:53,064][52659] Sum rewards: -1.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.078', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon7': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.256', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.116', 'weapon3': '1.812'} [2024-08-05 21:44:53,436][52650] Updated weights for policy 0, policy_version 2451 (0.0016) [2024-08-05 21:44:53,526][52668] DAMAGECOUNT value on done: 796.0 [2024-08-05 21:44:53,527][52668] Sum rewards: 2.183, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon7': '0.048', 'ARMOR': '0.052', 'weapon5': '0.052', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'HEALTH': '0.290', 'weapon4': '0.392', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.420', 'weapon3': '1.008', 'weapon2': '1.146', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:54,036][52670] DAMAGECOUNT value on done: 918.0 [2024-08-05 21:44:54,037][52670] Sum rewards: -1.218, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.082', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.138', 'AMMO3': '0.141', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.546', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.882', 'weapon2': '0.982', 'weapon3': '1.666', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:55,066][52666] DAMAGECOUNT value on done: 1071.0 [2024-08-05 21:44:55,068][52666] Sum rewards: 0.557, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'weapon5': '0.156', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.801', 'weapon3': '1.528', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:55,557][52660] DAMAGECOUNT value on done: 758.0 [2024-08-05 21:44:55,839][52669] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 21:44:55,842][52671] DAMAGECOUNT value on done: 1045.0 [2024-08-05 21:44:55,843][52671] Sum rewards: 3.094, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.900', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'weapon5': '0.108', 'WEAPON5': '0.300', 'HITCOUNT': '0.320', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.299', 'weapon3': '1.680', 'weapon2': '1.908', 'FRAGCOUNT': '5.000'} [2024-08-05 21:44:55,944][52659] DAMAGECOUNT value on done: 1427.0 [2024-08-05 21:44:55,946][52659] Sum rewards: 2.889, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.502', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.112', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.350', 'weapon2': '1.420', 'weapon3': '1.696', 'FRAGCOUNT': '3.000'} [2024-08-05 21:44:56,789][52668] DAMAGECOUNT value on done: 737.0 [2024-08-05 21:44:57,317][52670] DAMAGECOUNT value on done: 780.0 [2024-08-05 21:44:57,319][52670] Sum rewards: -2.813, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO2': '0.012', 'AMMO4': '0.059', 'ARMOR': '0.087', 'HITCOUNT': '0.150', 'AMMO3': '0.153', 'weapon4': '0.168', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.540', 'WEAPON3': '0.800', 'weapon3': '1.412', 'weapon2': '1.976', 'FRAGCOUNT': '2.000'} [2024-08-05 21:44:57,611][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 21:44:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17161.5). Total num frames: 20152320. Throughput: 0: 4257.8. Samples: 5045610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:44:57,794][52567] Avg episode reward: [(0, '-1.135')] [2024-08-05 21:44:57,798][52614] Saving new best policy, reward=-1.135! [2024-08-05 21:44:58,221][52650] Updated weights for policy 0, policy_version 2461 (0.0042) [2024-08-05 21:44:58,362][52666] DAMAGECOUNT value on done: 821.0 [2024-08-05 21:44:58,464][52660] DAMAGECOUNT value on done: 1030.0 [2024-08-05 21:44:58,466][52660] Sum rewards: -2.303, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.333', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon5': '0.082', 'AMMO3': '0.115', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.234', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.838', 'FRAGCOUNT': '1.000', 'weapon2': '1.360', 'weapon3': '2.082'} [2024-08-05 21:44:59,701][52671] DAMAGECOUNT value on done: 1906.0 [2024-08-05 21:44:59,701][52671] Sum rewards: 1.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.575', 'AMMO5': '0.008', 'AMMO2': '0.014', 'ARMOR': '0.024', 'weapon4': '0.064', 'AMMO4': '0.071', 'AMMO3': '0.096', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.600', 'weapon3': '1.618', 'DAMAGECOUNT': '1.668', 'weapon2': '1.800', 'FRAGCOUNT': '2.500'} [2024-08-05 21:44:59,898][52659] DAMAGECOUNT value on done: 1025.0 [2024-08-05 21:44:59,900][52659] Sum rewards: -1.343, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.718', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'HITCOUNT': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.422', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '2.000', 'weapon3': '2.254'} [2024-08-05 21:45:00,395][52670] DAMAGECOUNT value on done: 735.0 [2024-08-05 21:45:01,360][52666] DAMAGECOUNT value on done: 806.0 [2024-08-05 21:45:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17066.7, 300 sec: 17133.8). Total num frames: 20234240. Throughput: 0: 4251.1. Samples: 5058280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:45:02,794][52567] Avg episode reward: [(0, '-1.130')] [2024-08-05 21:45:02,795][52614] Saving new best policy, reward=-1.130! [2024-08-05 21:45:03,052][52671] DAMAGECOUNT value on done: 728.0 [2024-08-05 21:45:03,052][52671] Sum rewards: 1.581, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.595', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon5': '0.028', 'AMMO4': '0.062', 'weapon7': '0.062', 'ARMOR': '0.064', 'AMMO3': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.322', 'DAMAGECOUNT': '0.522', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.402', 'weapon3': '1.756'} [2024-08-05 21:45:03,070][52650] Updated weights for policy 0, policy_version 2471 (0.0014) [2024-08-05 21:45:03,259][52659] DAMAGECOUNT value on done: 1154.0 [2024-08-05 21:45:03,259][52659] Sum rewards: -2.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.860', 'AMMO2': '0.036', 'ARMOR': '0.040', 'AMMO3': '0.119', 'weapon4': '0.160', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.350', 'weapon2': '1.542', 'weapon3': '1.652', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:03,767][52670] DAMAGECOUNT value on done: 490.0 [2024-08-05 21:45:03,769][52670] Sum rewards: -2.136, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.196', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon4': '0.074', 'HITCOUNT': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.255', 'weapon5': '0.440', 'ARMOR': '0.571', 'WEAPON3': '0.750', 'weapon3': '1.316', 'weapon2': '1.712', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:04,069][52794] DAMAGECOUNT value on done: 740.0 [2024-08-05 21:45:04,072][52794] Sum rewards: 1.724, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.995', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'ARMOR': '0.040', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.156', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.776', 'weapon3': '1.798', 'FRAGCOUNT': '4.000'} [2024-08-05 21:45:04,678][52666] DAMAGECOUNT value on done: 1011.0 [2024-08-05 21:45:04,680][52666] Sum rewards: -2.355, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.169', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'weapon4': '0.236', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.232', 'weapon3': '1.842'} [2024-08-05 21:45:06,411][52671] DAMAGECOUNT value on done: 1065.0 [2024-08-05 21:45:06,413][52671] Sum rewards: 0.126, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.450', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.096', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.411', 'weapon4': '0.436', 'ARMOR': '0.564', 'WEAPON3': '0.650', 'weapon2': '0.760', 'FRAGCOUNT': '1.000', 'weapon3': '1.872'} [2024-08-05 21:45:06,551][52659] DAMAGECOUNT value on done: 920.0 [2024-08-05 21:45:06,555][52659] Sum rewards: -0.450, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.335', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.124', 'HITCOUNT': '0.130', 'weapon4': '0.130', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.600', 'weapon2': '1.322', 'weapon3': '1.578', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:06,822][52794] DAMAGECOUNT value on done: 1114.0 [2024-08-05 21:45:06,824][52794] Sum rewards: 0.439, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.386', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.038', 'weapon4': '0.054', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon6': '0.158', 'WEAPON6': '0.200', 'HITCOUNT': '0.230', 'ARMOR': '0.560', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.735', 'weapon3': '1.478', 'weapon2': '1.980', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:06,977][52670] DAMAGECOUNT value on done: 993.0 [2024-08-05 21:45:06,979][52670] Sum rewards: 0.876, reward structure: {'DEATHCOUNT': '-8.250', 'weapon4': '0.004', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.140', 'HEALTH': '0.296', 'HITCOUNT': '0.320', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.957', 'weapon2': '1.284', 'weapon3': '2.170', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:07,306][52662] DAMAGECOUNT value on done: 863.0 [2024-08-05 21:45:07,306][52662] Sum rewards: -5.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.429', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'ARMOR': '0.032', 'weapon4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.774', 'WEAPON3': '1.150', 'weapon2': '1.284', 'FRAGCOUNT': '2.000', 'weapon3': '2.132'} [2024-08-05 21:45:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17066.7, 300 sec: 17133.8). Total num frames: 20316160. Throughput: 0: 4262.7. Samples: 5084080. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 21:45:07,795][52567] Avg episode reward: [(0, '-1.081')] [2024-08-05 21:45:07,827][52614] Saving new best policy, reward=-1.081! [2024-08-05 21:45:07,834][52666] DAMAGECOUNT value on done: 1196.0 [2024-08-05 21:45:07,835][52666] Sum rewards: -1.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.220', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.108', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.458', 'weapon2': '0.812', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '2.000', 'weapon3': '2.030'} [2024-08-05 21:45:07,840][52650] Updated weights for policy 0, policy_version 2481 (0.0034) [2024-08-05 21:45:09,355][52794] DAMAGECOUNT value on done: 1155.0 [2024-08-05 21:45:09,355][52794] Sum rewards: -1.012, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.762', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.096', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.885', 'weapon2': '1.392', 'FRAGCOUNT': '2.000', 'weapon3': '2.034'} [2024-08-05 21:45:09,834][52659] DAMAGECOUNT value on done: 1250.0 [2024-08-05 21:45:09,834][52659] Sum rewards: -2.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.754', 'AMMO2': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.290', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.269', 'weapon2': '1.518', 'weapon3': '1.992', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:09,851][52662] DAMAGECOUNT value on done: 1102.0 [2024-08-05 21:45:09,851][52662] Sum rewards: -4.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.390', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.024', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.536', 'weapon2': '1.540'} [2024-08-05 21:45:09,960][52670] DAMAGECOUNT value on done: 1373.0 [2024-08-05 21:45:09,960][52670] Sum rewards: 1.517, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.432', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'HITCOUNT': '0.390', 'ARMOR': '0.507', 'WEAPON3': '1.000', 'weapon2': '1.660', 'DAMAGECOUNT': '1.734', 'weapon3': '2.080', 'FRAGCOUNT': '5.000'} [2024-08-05 21:45:10,814][52666] DAMAGECOUNT value on done: 720.0 [2024-08-05 21:45:12,062][52794] DAMAGECOUNT value on done: 953.0 [2024-08-05 21:45:12,063][52794] Sum rewards: 1.055, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.144', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.272', 'weapon3': '1.368', 'weapon2': '2.012', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:12,589][52650] Updated weights for policy 0, policy_version 2491 (0.0012) [2024-08-05 21:45:12,636][52662] DAMAGECOUNT value on done: 1061.0 [2024-08-05 21:45:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17133.8). Total num frames: 20406272. Throughput: 0: 4264.0. Samples: 5109680. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 21:45:12,794][52567] Avg episode reward: [(0, '-1.082')] [2024-08-05 21:45:12,883][52670] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon7', 0.002)] [2024-08-05 21:45:13,206][52670] DAMAGECOUNT value on done: 1281.0 [2024-08-05 21:45:13,214][52670] Sum rewards: 0.780, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.014', 'ARMOR': '0.060', 'weapon7': '0.062', 'AMMO4': '0.071', 'HEALTH': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.239', 'weapon2': '1.498', 'weapon3': '2.260', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:14,011][52666] DAMAGECOUNT value on done: 930.0 [2024-08-05 21:45:14,012][52666] Sum rewards: -1.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.866', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon5': '0.068', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.807', 'weapon3': '1.714', 'weapon2': '1.846', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:14,120][52663] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 21:45:14,563][52794] DAMAGECOUNT value on done: 1315.0 [2024-08-05 21:45:14,566][52794] Sum rewards: -0.719, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.685', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO3': '0.146', 'HITCOUNT': '0.410', 'WEAPON3': '0.950', 'weapon2': '1.452', 'DAMAGECOUNT': '1.740', 'weapon3': '2.348', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:15,143][52662] DAMAGECOUNT value on done: 775.0 [2024-08-05 21:45:16,560][52670] DAMAGECOUNT value on done: 702.0 [2024-08-05 21:45:16,561][52670] Sum rewards: -2.776, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO3': '0.085', 'weapon5': '0.090', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon3': '1.560', 'weapon2': '1.784'} [2024-08-05 21:45:16,981][52794] DAMAGECOUNT value on done: 1225.0 [2024-08-05 21:45:16,982][52794] Sum rewards: -3.410, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.132', 'HITCOUNT': '0.160', 'weapon5': '0.172', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.800', 'ARMOR': '0.905', 'FRAGCOUNT': '1.000', 'weapon3': '1.566', 'weapon2': '1.624'} [2024-08-05 21:45:17,100][52650] Updated weights for policy 0, policy_version 2501 (0.0025) [2024-08-05 21:45:17,336][52666] DAMAGECOUNT value on done: 1029.0 [2024-08-05 21:45:17,337][52666] Sum rewards: -0.770, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.668', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.022', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'ARMOR': '0.120', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.484', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.650', 'weapon2': '1.196', 'weapon3': '1.602', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:17,588][52662] DAMAGECOUNT value on done: 1146.0 [2024-08-05 21:45:17,588][52662] Sum rewards: 0.610, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.028', 'weapon5': '0.062', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.288', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.041', 'weapon3': '1.214', 'weapon2': '1.830'} [2024-08-05 21:45:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17066.7, 300 sec: 17133.8). Total num frames: 20496384. Throughput: 0: 4281.8. Samples: 5122990. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 21:45:17,794][52567] Avg episode reward: [(0, '-1.117')] [2024-08-05 21:45:18,712][52811] DAMAGECOUNT value on done: 916.0 [2024-08-05 21:45:18,866][52803] DAMAGECOUNT value on done: 1028.0 [2024-08-05 21:45:18,866][52803] Sum rewards: 2.206, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.758', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.150', 'HITCOUNT': '0.200', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.780', 'weapon3': '1.390', 'weapon2': '1.462', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:19,237][52794] DAMAGECOUNT value on done: 714.0 [2024-08-05 21:45:19,237][52794] Sum rewards: 0.213, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.107', 'HITCOUNT': '0.150', 'weapon4': '0.288', 'HEALTH': '0.348', 'DAMAGECOUNT': '0.474', 'ARMOR': '0.515', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.526', 'weapon3': '1.716'} [2024-08-05 21:45:19,780][52662] DAMAGECOUNT value on done: 1275.0 [2024-08-05 21:45:19,781][52662] Sum rewards: -0.049, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.528', 'weapon5': '0.002', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.038', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.107', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.290', 'weapon2': '1.368', 'weapon3': '1.808', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:20,048][52670] DAMAGECOUNT value on done: 1204.0 [2024-08-05 21:45:20,048][52670] Sum rewards: 0.281, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.378', 'weapon5': '0.002', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'ARMOR': '0.891', 'DAMAGECOUNT': '0.990', 'weapon2': '1.684', 'FRAGCOUNT': '2.000', 'weapon3': '2.044'} [2024-08-05 21:45:20,759][52666] DAMAGECOUNT value on done: 754.0 [2024-08-05 21:45:20,759][52666] Sum rewards: -1.612, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.054', 'HITCOUNT': '0.080', 'HEALTH': '0.114', 'AMMO3': '0.124', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.666', 'weapon3': '1.848'} [2024-08-05 21:45:21,442][52795] DAMAGECOUNT value on done: 831.0 [2024-08-05 21:45:21,763][52794] DAMAGECOUNT value on done: 1130.0 [2024-08-05 21:45:21,764][52794] Sum rewards: -3.623, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.639', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.168', 'HITCOUNT': '0.300', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.807', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.138', 'weapon3': '2.574'} [2024-08-05 21:45:22,021][52803] DAMAGECOUNT value on done: 1451.0 [2024-08-05 21:45:22,022][52803] Sum rewards: 3.142, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.440', 'ARMOR': '0.452', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.290', 'weapon3': '1.650', 'weapon2': '1.814', 'FRAGCOUNT': '5.000'} [2024-08-05 21:45:22,125][52811] DAMAGECOUNT value on done: 638.0 [2024-08-05 21:45:22,125][52811] Sum rewards: -1.589, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.462', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon5': '0.192', 'weapon4': '0.234', 'DAMAGECOUNT': '0.702', 'WEAPON3': '0.900', 'weapon2': '1.428', 'FRAGCOUNT': '1.500', 'weapon3': '1.784'} [2024-08-05 21:45:22,439][52650] Updated weights for policy 0, policy_version 2511 (0.0013) [2024-08-05 21:45:22,493][52662] DAMAGECOUNT value on done: 1664.0 [2024-08-05 21:45:22,493][52662] Sum rewards: 0.302, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.505', 'AMMO2': '0.012', 'ARMOR': '0.028', 'AMMO4': '0.060', 'AMMO3': '0.119', 'weapon4': '0.146', 'WEAPON4': '0.200', 'HITCOUNT': '0.550', 'weapon2': '0.786', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.950', 'weapon3': '2.106', 'FRAGCOUNT': '4.000'} [2024-08-05 21:45:22,512][52670] DAMAGECOUNT value on done: 1314.0 [2024-08-05 21:45:22,514][52670] Sum rewards: 2.143, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.106', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'ARMOR': '0.044', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.176', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.020', 'weapon2': '1.134', 'weapon3': '1.404', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 20578304. Throughput: 0: 4279.8. Samples: 5148560. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:45:22,794][52567] Avg episode reward: [(0, '-1.217')] [2024-08-05 21:45:23,363][52666] DAMAGECOUNT value on done: 729.0 [2024-08-05 21:45:23,366][52666] Sum rewards: 0.284, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.548', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.090', 'weapon4': '0.180', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.657', 'weapon2': '0.802', 'weapon3': '1.562', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:24,568][52794] DAMAGECOUNT value on done: 1138.0 [2024-08-05 21:45:24,570][52794] Sum rewards: -1.633, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.295', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon5': '0.178', 'HITCOUNT': '0.320', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.969', 'FRAGCOUNT': '1.000', 'weapon2': '1.058', 'weapon3': '1.910'} [2024-08-05 21:45:24,698][52795] DAMAGECOUNT value on done: 931.0 [2024-08-05 21:45:24,698][52795] Sum rewards: -3.134, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.022', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.152', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.564', 'weapon3': '1.970'} [2024-08-05 21:45:25,035][52662] DAMAGECOUNT value on done: 1046.0 [2024-08-05 21:45:25,293][52811] DAMAGECOUNT value on done: 1132.0 [2024-08-05 21:45:25,296][52811] Sum rewards: -2.768, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.014', 'ARMOR': '0.049', 'WEAPON5': '0.050', 'weapon7': '0.064', 'AMMO4': '0.068', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.146', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.258', 'weapon3': '1.764'} [2024-08-05 21:45:25,474][52670] DAMAGECOUNT value on done: 573.0 [2024-08-05 21:45:25,476][52670] Sum rewards: -5.262, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.017', 'ARMOR': '0.032', 'HITCOUNT': '0.090', 'weapon5': '0.108', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.345', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.458', 'weapon3': '2.144'} [2024-08-05 21:45:25,574][52803] DAMAGECOUNT value on done: 711.0 [2024-08-05 21:45:25,574][52803] Sum rewards: -3.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.618', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.222', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'weapon3': '1.696', 'weapon2': '1.784', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:26,227][52666] DAMAGECOUNT value on done: 853.0 [2024-08-05 21:45:26,227][52666] Sum rewards: -0.919, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.574', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.111', 'weapon4': '0.166', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.800', 'weapon3': '1.684', 'weapon2': '1.740', 'FRAGCOUNT': '4.000'} [2024-08-05 21:45:26,655][52650] Updated weights for policy 0, policy_version 2521 (0.0022) [2024-08-05 21:45:26,944][52794] DAMAGECOUNT value on done: 989.0 [2024-08-05 21:45:26,945][52794] Sum rewards: -5.761, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.800', 'AMMO2': '0.001', 'AMMO4': '0.003', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.218', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.250', 'weapon2': '1.570', 'weapon3': '1.712'} [2024-08-05 21:45:27,452][52662] DAMAGECOUNT value on done: 1146.0 [2024-08-05 21:45:27,454][52662] Sum rewards: -3.082, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.798', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.028', 'ARMOR': '0.040', 'weapon5': '0.068', 'AMMO3': '0.137', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon3': '1.694', 'weapon2': '1.880'} [2024-08-05 21:45:27,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17066.6, 300 sec: 17106.0). Total num frames: 20660224. Throughput: 0: 4286.4. Samples: 5174240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:45:27,795][52567] Avg episode reward: [(0, '-1.382')] [2024-08-05 21:45:28,071][52795] DAMAGECOUNT value on done: 947.0 [2024-08-05 21:45:28,073][52795] Sum rewards: -4.700, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.400', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.013', 'weapon5': '0.068', 'HITCOUNT': '0.140', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.324', 'ARMOR': '0.458', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.580', 'weapon3': '1.864'} [2024-08-05 21:45:28,400][52670] DAMAGECOUNT value on done: 1160.0 [2024-08-05 21:45:28,401][52670] Sum rewards: -0.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO3': '0.133', 'HITCOUNT': '0.360', 'ARMOR': '0.418', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.146', 'weapon2': '1.250', 'weapon3': '2.240', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:28,569][52811] DAMAGECOUNT value on done: 1014.0 [2024-08-05 21:45:28,570][52811] Sum rewards: -3.111, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.985', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.220', 'weapon4': '0.222', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.810', 'weapon2': '1.420', 'weapon3': '1.992', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:28,957][52666] DAMAGECOUNT value on done: 1039.0 [2024-08-05 21:45:28,958][52666] Sum rewards: -1.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.941', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.127', 'HITCOUNT': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.900', 'weapon2': '1.566', 'weapon3': '1.800', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:29,061][52803] DAMAGECOUNT value on done: 2341.0 [2024-08-05 21:45:29,063][52803] Sum rewards: 10.966, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO2': '0.008', 'ARMOR': '0.028', 'AMMO4': '0.040', 'weapon4': '0.042', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.700', 'weapon3': '1.910', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '8.000'} [2024-08-05 21:45:29,745][52794] DAMAGECOUNT value on done: 1011.0 [2024-08-05 21:45:29,745][52794] Sum rewards: 1.628, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.870', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.052', 'weapon7': '0.058', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'weapon5': '0.472', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.825', 'weapon3': '1.200', 'weapon2': '1.786', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:30,263][52662] DAMAGECOUNT value on done: 1166.0 [2024-08-05 21:45:30,266][52662] Sum rewards: -1.334, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.108', 'weapon7': '0.006', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.180', 'weapon4': '0.244', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.700', 'ARMOR': '0.824', 'FRAGCOUNT': '1.000', 'weapon3': '1.272', 'weapon2': '1.822'} [2024-08-05 21:45:31,033][52670] DAMAGECOUNT value on done: 1516.0 [2024-08-05 21:45:31,035][52670] Sum rewards: 1.761, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.338', 'AMMO2': '0.026', 'AMMO3': '0.116', 'ARMOR': '0.124', 'AMMO4': '0.130', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'weapon4': '0.710', 'WEAPON3': '0.750', 'weapon2': '0.868', 'DAMAGECOUNT': '1.317', 'weapon3': '1.878', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:31,453][52795] DAMAGECOUNT value on done: 1882.0 [2024-08-05 21:45:31,455][52795] Sum rewards: 0.046, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.539', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'weapon5': '0.132', 'HITCOUNT': '0.220', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.242', 'FRAGCOUNT': '2.000', 'weapon3': '2.214'} [2024-08-05 21:45:31,668][52811] DAMAGECOUNT value on done: 1224.0 [2024-08-05 21:45:31,671][52811] Sum rewards: 0.515, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.030', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.040', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.114', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.140', 'weapon2': '1.566', 'FRAGCOUNT': '2.000', 'weapon3': '2.028'} [2024-08-05 21:45:31,833][52650] Updated weights for policy 0, policy_version 2531 (0.0026) [2024-08-05 21:45:31,896][52666] DAMAGECOUNT value on done: 1552.0 [2024-08-05 21:45:31,896][52666] Sum rewards: 2.285, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.080', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.074', 'AMMO3': '0.092', 'weapon4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.179', 'weapon2': '1.322', 'weapon3': '1.648', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:32,320][52794] DAMAGECOUNT value on done: 980.0 [2024-08-05 21:45:32,320][52794] Sum rewards: -3.633, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.740', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.380', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.440', 'weapon2': '1.706', 'weapon3': '1.818'} [2024-08-05 21:45:32,465][52803] DAMAGECOUNT value on done: 878.0 [2024-08-05 21:45:32,467][52803] Sum rewards: -2.599, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.158', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.088', 'ARMOR': '0.104', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.196', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.216', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.846', 'FRAGCOUNT': '1.000', 'weapon2': '1.226', 'weapon3': '1.260'} [2024-08-05 21:45:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 17106.0). Total num frames: 20750336. Throughput: 0: 4295.1. Samples: 5187160. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:45:32,795][52567] Avg episode reward: [(0, '-1.162')] [2024-08-05 21:45:32,831][52662] DAMAGECOUNT value on done: 1120.0 [2024-08-05 21:45:32,832][52662] Sum rewards: -0.189, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.594', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon4': '0.322', 'HITCOUNT': '0.360', 'ARMOR': '0.505', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '1.000', 'weapon3': '1.444', 'weapon2': '1.508'} [2024-08-05 21:45:34,312][52670] DAMAGECOUNT value on done: 1109.0 [2024-08-05 21:45:34,313][52670] Sum rewards: -0.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.882', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.016', 'weapon4': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.495', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.999', 'weapon3': '1.490', 'weapon2': '1.936', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:34,574][52794] DAMAGECOUNT value on done: 966.0 [2024-08-05 21:45:34,575][52794] Sum rewards: -1.101, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.513', 'WEAPON3': '0.650', 'weapon2': '1.628', 'FRAGCOUNT': '2.000', 'weapon3': '2.088'} [2024-08-05 21:45:34,798][52795] DAMAGECOUNT value on done: 1090.0 [2024-08-05 21:45:34,799][52795] Sum rewards: 3.555, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'AMMO2': '0.004', 'AMMO4': '0.019', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.240', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'weapon2': '1.022', 'DAMAGECOUNT': '1.353', 'weapon3': '1.996', 'FRAGCOUNT': '4.000'} [2024-08-05 21:45:34,805][52811] DAMAGECOUNT value on done: 877.0 [2024-08-05 21:45:34,806][52811] Sum rewards: -6.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.484', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'HITCOUNT': '0.200', 'ARMOR': '0.519', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon3': '1.510', 'weapon2': '2.120'} [2024-08-05 21:45:35,148][52662] DAMAGECOUNT value on done: 999.0 [2024-08-05 21:45:35,198][52666] DAMAGECOUNT value on done: 1204.0 [2024-08-05 21:45:35,200][52666] Sum rewards: -1.287, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.659', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.260', 'weapon5': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.458', 'DAMAGECOUNT': '0.960', 'weapon3': '0.992', 'FRAGCOUNT': '1.000', 'weapon2': '1.652'} [2024-08-05 21:45:35,318][52803] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)] [2024-08-05 21:45:35,546][52803] DAMAGECOUNT value on done: 748.0 [2024-08-05 21:45:35,549][52803] Sum rewards: -1.028, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.610', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.010', 'ARMOR': '0.072', 'weapon5': '0.084', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'DAMAGECOUNT': '0.249', 'WEAPON3': '0.800', 'weapon3': '1.536', 'weapon2': '1.578', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:36,354][52820] DAMAGECOUNT value on done: 567.0 [2024-08-05 21:45:36,630][52650] Updated weights for policy 0, policy_version 2541 (0.0017) [2024-08-05 21:45:37,030][52794] DAMAGECOUNT value on done: 1605.0 [2024-08-05 21:45:37,031][52794] Sum rewards: -4.121, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.477', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.280', 'DAMAGECOUNT': '0.756', 'WEAPON3': '0.800', 'weapon3': '1.818', 'weapon2': '1.870', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:37,670][52662] DAMAGECOUNT value on done: 783.0 [2024-08-05 21:45:37,671][52662] Sum rewards: 0.323, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.081', 'AMMO4': '0.085', 'weapon4': '0.132', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.729', 'FRAGCOUNT': '1.000', 'weapon2': '1.800', 'weapon3': '1.852'} [2024-08-05 21:45:37,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17203.2, 300 sec: 17133.8). Total num frames: 20840448. Throughput: 0: 4284.7. Samples: 5212850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:45:37,794][52567] Avg episode reward: [(0, '-1.067')] [2024-08-05 21:45:37,798][52614] Saving new best policy, reward=-1.067! [2024-08-05 21:45:37,797][52670] DAMAGECOUNT value on done: 1184.0 [2024-08-05 21:45:37,822][52670] Sum rewards: -0.240, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.029', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'weapon7': '0.070', 'AMMO3': '0.078', 'ARMOR': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.394', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.846', 'weapon2': '1.398', 'weapon3': '1.532', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:37,979][52795] DAMAGECOUNT value on done: 1090.0 [2024-08-05 21:45:37,980][52795] Sum rewards: 2.020, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.106', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.454', 'ARMOR': '0.540', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'weapon2': '1.188', 'weapon3': '1.854', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:38,068][52811] DAMAGECOUNT value on done: 871.0 [2024-08-05 21:45:38,069][52811] Sum rewards: 0.102, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.823', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'HITCOUNT': '0.310', 'ARMOR': '0.416', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.116', 'weapon2': '1.366', 'FRAGCOUNT': '1.500', 'weapon3': '2.114'} [2024-08-05 21:45:38,772][52803] DAMAGECOUNT value on done: 1595.0 [2024-08-05 21:45:38,774][52803] Sum rewards: 2.040, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.368', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon5': '0.270', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.264', 'DAMAGECOUNT': '1.437', 'weapon3': '1.702', 'FRAGCOUNT': '5.000'} [2024-08-05 21:45:39,587][52794] DAMAGECOUNT value on done: 1265.0 [2024-08-05 21:45:39,587][52794] Sum rewards: -4.707, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.544', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.158', 'HITCOUNT': '0.160', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.681', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.498', 'weapon3': '1.836'} [2024-08-05 21:45:39,894][52820] DAMAGECOUNT value on done: 1045.0 [2024-08-05 21:45:39,896][52820] Sum rewards: -1.291, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.082', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.522', 'weapon3': '1.560', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:40,139][52662] DAMAGECOUNT value on done: 1200.0 [2024-08-05 21:45:40,139][52662] Sum rewards: 0.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.096', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'ARMOR': '0.048', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.238', 'HITCOUNT': '0.410', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.257', 'weapon2': '1.380', 'weapon3': '2.076', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:40,981][52650] Updated weights for policy 0, policy_version 2551 (0.0012) [2024-08-05 21:45:41,277][52795] DAMAGECOUNT value on done: 1096.0 [2024-08-05 21:45:41,279][52795] Sum rewards: -1.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'AMMO2': '0.010', 'ARMOR': '0.042', 'AMMO4': '0.049', 'AMMO3': '0.111', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.858', 'weapon2': '1.142', 'weapon3': '1.878', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:41,400][52811] DAMAGECOUNT value on done: 782.0 [2024-08-05 21:45:41,401][52811] Sum rewards: -3.839, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.032', 'weapon5': '0.064', 'AMMO3': '0.134', 'HITCOUNT': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.162', 'weapon3': '2.074'} [2024-08-05 21:45:41,873][52794] DAMAGECOUNT value on done: 1072.0 [2024-08-05 21:45:41,873][52794] Sum rewards: -0.417, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.890', 'AMMO2': '0.007', 'weapon5': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'DAMAGECOUNT': '1.260', 'weapon2': '1.354', 'weapon3': '1.856', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:41,960][52803] DAMAGECOUNT value on done: 1019.0 [2024-08-05 21:45:41,960][52803] Sum rewards: 0.085, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.834', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.160', 'HITCOUNT': '0.380', 'ARMOR': '0.444', 'WEAPON3': '0.800', 'weapon2': '0.996', 'DAMAGECOUNT': '1.314', 'FRAGCOUNT': '2.000', 'weapon3': '2.026'} [2024-08-05 21:45:42,467][52662] DAMAGECOUNT value on done: 822.0 [2024-08-05 21:45:42,467][52662] Sum rewards: -1.442, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.966', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.026', 'AMMO4': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'weapon4': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.900', 'ARMOR': '0.924', 'weapon2': '1.188', 'FRAGCOUNT': '2.000', 'weapon3': '2.150'} [2024-08-05 21:45:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17066.7, 300 sec: 17133.8). Total num frames: 20922368. Throughput: 0: 4284.7. Samples: 5238420. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:45:42,794][52567] Avg episode reward: [(0, '-1.091')] [2024-08-05 21:45:43,078][52820] DAMAGECOUNT value on done: 844.0 [2024-08-05 21:45:43,088][52820] Sum rewards: -2.023, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.384', 'AMMO2': '0.014', 'ARMOR': '0.040', 'weapon7': '0.060', 'weapon4': '0.070', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.568', 'weapon2': '1.612', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:44,476][52794] DAMAGECOUNT value on done: 1289.0 [2024-08-05 21:45:44,477][52794] Sum rewards: 1.737, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.965', 'AMMO5': '0.015', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon5': '0.036', 'weapon7': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon2': '1.160', 'DAMAGECOUNT': '1.281', 'weapon3': '1.338', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:44,518][52811] DAMAGECOUNT value on done: 1251.0 [2024-08-05 21:45:44,518][52811] Sum rewards: -3.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.131', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.155', 'HITCOUNT': '0.470', 'ARMOR': '0.492', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.404', 'weapon2': '1.578', 'weapon3': '1.938', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:44,613][52795] DAMAGECOUNT value on done: 1263.0 [2024-08-05 21:45:44,614][52795] Sum rewards: 1.157, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.016', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.113', 'weapon2': '1.444', 'weapon3': '1.484', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:44,821][52662] DAMAGECOUNT value on done: 1142.0 [2024-08-05 21:45:44,821][52662] Sum rewards: -5.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.402', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.150', 'AMMO3': '0.222', 'ARMOR': '0.495', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.250', 'weapon2': '1.342', 'weapon3': '2.176'} [2024-08-05 21:45:45,105][52803] DAMAGECOUNT value on done: 1067.0 [2024-08-05 21:45:46,159][52650] Updated weights for policy 0, policy_version 2561 (0.0012) [2024-08-05 21:45:46,319][52820] DAMAGECOUNT value on done: 946.0 [2024-08-05 21:45:47,229][52794] DAMAGECOUNT value on done: 1330.0 [2024-08-05 21:45:47,229][52794] Sum rewards: -1.096, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.212', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.040', 'weapon5': '0.058', 'HITCOUNT': '0.080', 'AMMO3': '0.088', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.207', 'weapon4': '0.304', 'WEAPON3': '0.450', 'FRAGCOUNT': '0.500', 'weapon3': '1.454', 'weapon2': '1.562'} [2024-08-05 21:45:47,594][52662] DAMAGECOUNT value on done: 537.0 [2024-08-05 21:45:47,695][52811] DAMAGECOUNT value on done: 895.0 [2024-08-05 21:45:47,695][52811] Sum rewards: -1.241, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.028', 'ARMOR': '0.056', 'AMMO4': '0.081', 'AMMO3': '0.106', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.960', 'weapon2': '1.694', 'weapon3': '1.954', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:47,766][52795] DAMAGECOUNT value on done: 836.0 [2024-08-05 21:45:47,769][52795] Sum rewards: -0.914, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.107', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'ARMOR': '0.052', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.200', 'weapon4': '0.304', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.650', 'weapon2': '1.360', 'weapon3': '1.892', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 21004288. Throughput: 0: 4287.8. Samples: 5251230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:45:47,794][52567] Avg episode reward: [(0, '-1.215')] [2024-08-05 21:45:48,216][52803] DAMAGECOUNT value on done: 764.0 [2024-08-05 21:45:48,216][52803] Sum rewards: 0.534, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.021', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'ARMOR': '0.092', 'AMMO3': '0.097', 'weapon5': '0.124', 'weapon4': '0.136', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.768', 'FRAGCOUNT': '1.000', 'weapon3': '1.492', 'weapon2': '1.876'} [2024-08-05 21:45:49,653][52820] DAMAGECOUNT value on done: 673.0 [2024-08-05 21:45:49,657][52820] Sum rewards: -2.902, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.966', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon4': '0.078', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.800', 'ARMOR': '0.907', 'weapon3': '1.704', 'weapon2': '2.060', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:49,679][52794] DAMAGECOUNT value on done: 1796.0 [2024-08-05 21:45:49,679][52794] Sum rewards: 11.199, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.682', 'AMMO2': '0.002', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.122', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.446', 'weapon3': '2.154', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '11.000'} [2024-08-05 21:45:50,270][52662] DAMAGECOUNT value on done: 1469.0 [2024-08-05 21:45:50,273][52662] Sum rewards: 4.179, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.132', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.296', 'DAMAGECOUNT': '1.818', 'weapon3': '2.212', 'FRAGCOUNT': '5.000'} [2024-08-05 21:45:50,841][52795] DAMAGECOUNT value on done: 1194.0 [2024-08-05 21:45:50,842][52795] Sum rewards: -0.881, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.980', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.210', 'weapon4': '0.300', 'ARMOR': '0.496', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.939', 'weapon3': '1.524', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:50,946][52650] Updated weights for policy 0, policy_version 2571 (0.0012) [2024-08-05 21:45:51,072][52811] DAMAGECOUNT value on done: 996.0 [2024-08-05 21:45:51,073][52811] Sum rewards: -1.367, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.300', 'ARMOR': '0.459', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.011', 'weapon2': '1.058', 'weapon3': '2.444', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:51,367][52803] DAMAGECOUNT value on done: 766.0 [2024-08-05 21:45:51,368][52803] Sum rewards: -1.257, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.710', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.020', 'weapon5': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.624', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'FRAGCOUNT': '1.000', 'weapon2': '1.514', 'weapon3': '1.760'} [2024-08-05 21:45:52,693][52794] DAMAGECOUNT value on done: 1184.0 [2024-08-05 21:45:52,693][52794] Sum rewards: 0.800, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'ARMOR': '0.494', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.335', 'weapon2': '1.692', 'weapon3': '1.914', 'FRAGCOUNT': '4.000'} [2024-08-05 21:45:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.3, 300 sec: 17106.0). Total num frames: 21094400. Throughput: 0: 4291.1. Samples: 5277180. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:45:52,794][52567] Avg episode reward: [(0, '-0.960')] [2024-08-05 21:45:52,795][52614] Saving new best policy, reward=-0.960! [2024-08-05 21:45:53,104][52820] DAMAGECOUNT value on done: 751.0 [2024-08-05 21:45:53,105][52820] Sum rewards: -5.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.965', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon4': '0.302', 'HITCOUNT': '0.340', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.005', 'weapon2': '1.112', 'weapon3': '2.044'} [2024-08-05 21:45:53,115][52662] DAMAGECOUNT value on done: 1133.0 [2024-08-05 21:45:54,234][52795] DAMAGECOUNT value on done: 595.0 [2024-08-05 21:45:54,533][52811] DAMAGECOUNT value on done: 1037.0 [2024-08-05 21:45:54,533][52811] Sum rewards: -3.137, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.154', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.520', 'DAMAGECOUNT': '0.876', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.472', 'weapon3': '2.018'} [2024-08-05 21:45:54,562][52803] DAMAGECOUNT value on done: 1179.0 [2024-08-05 21:45:54,562][52803] Sum rewards: 2.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon7': '0.068', 'AMMO3': '0.085', 'weapon5': '0.086', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.278', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.810', 'weapon2': '0.972', 'weapon3': '1.376', 'FRAGCOUNT': '4.000'} [2024-08-05 21:45:55,666][52662] DAMAGECOUNT value on done: 1234.0 [2024-08-05 21:45:55,666][52662] Sum rewards: -0.960, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.226', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'DAMAGECOUNT': '0.927', 'FRAGCOUNT': '1.000', 'weapon3': '1.374', 'weapon2': '1.496'} [2024-08-05 21:45:55,718][52650] Updated weights for policy 0, policy_version 2581 (0.0020) [2024-08-05 21:45:56,328][52820] DAMAGECOUNT value on done: 642.0 [2024-08-05 21:45:56,330][52820] Sum rewards: -1.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.868', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.079', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.182', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'weapon4': '0.586', 'FRAGCOUNT': '1.000', 'weapon2': '1.282', 'weapon3': '1.342'} [2024-08-05 21:45:57,526][52795] DAMAGECOUNT value on done: 977.0 [2024-08-05 21:45:57,528][52795] Sum rewards: -0.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.380', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.032', 'weapon7': '0.050', 'AMMO3': '0.065', 'ARMOR': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.828', 'weapon3': '1.262', 'weapon2': '1.672', 'FRAGCOUNT': '2.000'} [2024-08-05 21:45:57,741][52803] DAMAGECOUNT value on done: 1073.0 [2024-08-05 21:45:57,741][52803] Sum rewards: 1.594, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.682', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon4': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.155', 'weapon3': '1.602', 'weapon2': '1.742', 'FRAGCOUNT': '4.000'} [2024-08-05 21:45:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 21176320. Throughput: 0: 4285.3. Samples: 5302520. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:45:57,794][52567] Avg episode reward: [(0, '-1.075')] [2024-08-05 21:45:57,871][52811] DAMAGECOUNT value on done: 849.0 [2024-08-05 21:45:57,872][52811] Sum rewards: -4.246, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.907', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.260', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.930', 'WEAPON3': '1.100', 'weapon2': '1.126', 'weapon3': '2.480', 'FRAGCOUNT': '3.000'} [2024-08-05 21:45:59,558][52820] DAMAGECOUNT value on done: 862.0 [2024-08-05 21:45:59,558][52820] Sum rewards: 2.019, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.165', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.110', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.065', 'weapon3': '1.620', 'weapon2': '1.772', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:00,134][52650] Updated weights for policy 0, policy_version 2591 (0.0013) [2024-08-05 21:46:00,624][52795] DAMAGECOUNT value on done: 835.0 [2024-08-05 21:46:00,626][52795] Sum rewards: -3.611, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.328', 'AMMO2': '0.007', 'AMMO5': '0.015', 'weapon4': '0.024', 'AMMO4': '0.033', 'weapon5': '0.060', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.628', 'weapon2': '1.836'} [2024-08-05 21:46:00,887][52803] DAMAGECOUNT value on done: 1242.0 [2024-08-05 21:46:00,887][52803] Sum rewards: -1.579, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.436', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'weapon5': '0.002', 'AMMO5': '0.010', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'HITCOUNT': '0.430', 'WEAPON3': '1.200', 'weapon2': '1.370', 'DAMAGECOUNT': '1.875', 'weapon3': '2.462', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:01,082][52811] DAMAGECOUNT value on done: 1061.0 [2024-08-05 21:46:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 21266432. Throughput: 0: 4277.6. Samples: 5315480. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 21:46:02,794][52567] Avg episode reward: [(0, '-1.119')] [2024-08-05 21:46:03,142][52820] DAMAGECOUNT value on done: 970.0 [2024-08-05 21:46:03,756][52795] DAMAGECOUNT value on done: 1359.0 [2024-08-05 21:46:03,759][52795] Sum rewards: 2.974, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.812', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon7': '0.088', 'AMMO3': '0.113', 'HITCOUNT': '0.170', 'AMMO6': '0.320', 'AMMO7': '0.320', 'WEAPON4': '0.350', 'WEAPON7': '0.400', 'ARMOR': '0.577', 'weapon2': '0.620', 'weapon4': '0.652', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.143', 'weapon3': '1.644', 'FRAGCOUNT': '5.000'} [2024-08-05 21:46:04,052][52803] DAMAGECOUNT value on done: 544.0 [2024-08-05 21:46:04,055][52803] Sum rewards: -3.229, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.150', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.772', 'weapon2': '2.008'} [2024-08-05 21:46:04,243][52811] DAMAGECOUNT value on done: 1032.0 [2024-08-05 21:46:04,244][52811] Sum rewards: -0.555, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.504', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.118', 'HITCOUNT': '0.170', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.702', 'weapon2': '1.610', 'weapon3': '1.990', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:05,187][52650] Updated weights for policy 0, policy_version 2601 (0.0015) [2024-08-05 21:46:05,359][52614] Signal inference workers to stop experience collection... (450 times) [2024-08-05 21:46:05,363][52614] Signal inference workers to resume experience collection... (450 times) [2024-08-05 21:46:05,442][52650] InferenceWorker_p0-w0: stopping experience collection (450 times) [2024-08-05 21:46:05,442][52650] InferenceWorker_p0-w0: resuming experience collection (450 times) [2024-08-05 21:46:06,431][52820] DAMAGECOUNT value on done: 1200.0 [2024-08-05 21:46:06,432][52820] Sum rewards: -1.076, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.060', 'AMMO2': '0.007', 'AMMO4': '0.034', 'ARMOR': '0.040', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.131', 'weapon2': '1.314', 'weapon3': '1.522', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:07,024][52795] DAMAGECOUNT value on done: 949.0 [2024-08-05 21:46:07,176][52803] DAMAGECOUNT value on done: 927.0 [2024-08-05 21:46:07,179][52803] Sum rewards: -2.121, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'ARMOR': '0.073', 'AMMO3': '0.126', 'HITCOUNT': '0.250', 'weapon4': '0.266', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.700', 'weapon3': '1.590', 'weapon2': '1.598', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:07,391][52811] DAMAGECOUNT value on done: 1047.0 [2024-08-05 21:46:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 21348352. Throughput: 0: 4288.7. Samples: 5341550. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 21:46:07,794][52567] Avg episode reward: [(0, '-1.166')] [2024-08-05 21:46:09,627][52820] DAMAGECOUNT value on done: 1307.0 [2024-08-05 21:46:09,630][52820] Sum rewards: -1.105, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.842', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'HITCOUNT': '0.310', 'ARMOR': '0.855', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.960', 'weapon2': '1.540', 'weapon3': '1.598', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:09,841][52650] Updated weights for policy 0, policy_version 2611 (0.0020) [2024-08-05 21:46:10,295][52803] DAMAGECOUNT value on done: 760.0 [2024-08-05 21:46:10,299][52803] Sum rewards: -1.184, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.084', 'AMMO4': '0.102', 'AMMO3': '0.124', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.456', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.850', 'weapon2': '1.242', 'FRAGCOUNT': '2.000', 'weapon3': '2.014'} [2024-08-05 21:46:10,447][52795] DAMAGECOUNT value on done: 916.0 [2024-08-05 21:46:10,828][52811] DAMAGECOUNT value on done: 1013.0 [2024-08-05 21:46:10,828][52811] Sum rewards: 2.853, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.877', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.292', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'ARMOR': '0.940', 'DAMAGECOUNT': '1.383', 'weapon2': '1.384', 'weapon3': '1.716', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 21438464. Throughput: 0: 4280.2. Samples: 5366850. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:46:12,795][52567] Avg episode reward: [(0, '-1.163')] [2024-08-05 21:46:12,864][52820] DAMAGECOUNT value on done: 1117.0 [2024-08-05 21:46:12,864][52820] Sum rewards: -0.523, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.817', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.072', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.383', 'weapon3': '1.752', 'weapon2': '1.862', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:13,695][52795] DAMAGECOUNT value on done: 1150.0 [2024-08-05 21:46:13,696][52803] DAMAGECOUNT value on done: 605.0 [2024-08-05 21:46:13,697][52795] Sum rewards: -3.689, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.814', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.032', 'weapon4': '0.032', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'HITCOUNT': '0.380', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.227', 'weapon2': '1.300', 'weapon3': '2.410'} [2024-08-05 21:46:14,106][52811] DAMAGECOUNT value on done: 715.0 [2024-08-05 21:46:14,759][52650] Updated weights for policy 0, policy_version 2621 (0.0022) [2024-08-05 21:46:16,132][52820] DAMAGECOUNT value on done: 759.0 [2024-08-05 21:46:16,732][52803] DAMAGECOUNT value on done: 1033.0 [2024-08-05 21:46:16,732][52803] Sum rewards: -6.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.896', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.032', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'HITCOUNT': '0.280', 'DAMAGECOUNT': '0.744', 'WEAPON3': '1.150', 'weapon2': '1.442', 'FRAGCOUNT': '2.000', 'weapon3': '2.142'} [2024-08-05 21:46:16,816][52795] DAMAGECOUNT value on done: 1245.0 [2024-08-05 21:46:16,818][52795] Sum rewards: 0.874, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.289', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.148', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'weapon2': '1.654', 'DAMAGECOUNT': '1.950', 'weapon3': '2.000', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:17,230][52811] DAMAGECOUNT value on done: 1116.0 [2024-08-05 21:46:17,234][52811] Sum rewards: -1.922, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.140', 'HITCOUNT': '0.260', 'HEALTH': '0.266', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.234', 'weapon3': '2.488'} [2024-08-05 21:46:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 21520384. Throughput: 0: 4281.1. Samples: 5379810. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-05 21:46:17,794][52567] Avg episode reward: [(0, '-1.257')] [2024-08-05 21:46:19,214][52650] Updated weights for policy 0, policy_version 2631 (0.0043) [2024-08-05 21:46:19,461][52820] DAMAGECOUNT value on done: 1043.0 [2024-08-05 21:46:19,461][52820] Sum rewards: 4.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.895', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon7': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.131', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.492', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.260', 'weapon2': '1.292', 'weapon3': '1.762', 'FRAGCOUNT': '5.000'} [2024-08-05 21:46:20,214][52795] DAMAGECOUNT value on done: 712.0 [2024-08-05 21:46:20,215][52795] Sum rewards: -6.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.336', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.112', 'AMMO3': '0.145', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'ARMOR': '0.548', 'DAMAGECOUNT': '0.729', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.580', 'weapon2': '1.808'} [2024-08-05 21:46:20,223][52803] DAMAGECOUNT value on done: 903.0 [2024-08-05 21:46:20,224][52803] Sum rewards: -2.555, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.034', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO4': '0.050', 'HITCOUNT': '0.060', 'AMMO3': '0.097', 'ARMOR': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.186', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.318', 'weapon2': '1.462'} [2024-08-05 21:46:20,729][52811] DAMAGECOUNT value on done: 630.0 [2024-08-05 21:46:20,729][52811] Sum rewards: -2.806, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.240', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'weapon5': '0.078', 'AMMO3': '0.088', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'weapon3': '1.330', 'weapon2': '1.644'} [2024-08-05 21:46:22,693][52820] DAMAGECOUNT value on done: 905.0 [2024-08-05 21:46:22,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17066.6, 300 sec: 17078.2). Total num frames: 21602304. Throughput: 0: 4276.9. Samples: 5405310. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-05 21:46:22,795][52567] Avg episode reward: [(0, '-1.338')] [2024-08-05 21:46:23,492][52795] DAMAGECOUNT value on done: 1352.0 [2024-08-05 21:46:23,496][52795] Sum rewards: 0.710, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.195', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.142', 'HITCOUNT': '0.400', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.335', 'weapon2': '1.458', 'weapon3': '2.096', 'FRAGCOUNT': '6.000'} [2024-08-05 21:46:24,423][52650] Updated weights for policy 0, policy_version 2641 (0.0021) [2024-08-05 21:46:26,114][52820] DAMAGECOUNT value on done: 964.0 [2024-08-05 21:46:26,116][52820] Sum rewards: -1.484, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO3': '0.106', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.822', 'FRAGCOUNT': '1.000', 'ARMOR': '1.303', 'weapon3': '1.698', 'weapon2': '1.938'} [2024-08-05 21:46:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17203.3, 300 sec: 17106.0). Total num frames: 21692416. Throughput: 0: 4290.0. Samples: 5431470. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:46:27,794][52567] Avg episode reward: [(0, '-1.265')] [2024-08-05 21:46:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002648_21692416.pth... [2024-08-05 21:46:27,927][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002142_17547264.pth [2024-08-05 21:46:28,681][52650] Updated weights for policy 0, policy_version 2651 (0.0016) [2024-08-05 21:46:29,154][52820] DAMAGECOUNT value on done: 906.0 [2024-08-05 21:46:29,158][52820] Sum rewards: -2.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.012', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO3': '0.138', 'AMMO4': '0.147', 'HITCOUNT': '0.150', 'weapon5': '0.192', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.602', 'weapon3': '1.772'} [2024-08-05 21:46:32,346][52820] DAMAGECOUNT value on done: 872.0 [2024-08-05 21:46:32,374][52820] Sum rewards: 2.372, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.120', 'HITCOUNT': '0.270', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.888', 'weapon2': '1.302', 'weapon3': '2.132', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:32,649][52665] DAMAGECOUNT value on done: 1367.0 [2024-08-05 21:46:32,650][52665] Sum rewards: -2.739, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.180', 'AMMO5': '0.018', 'AMMO2': '0.023', 'ARMOR': '0.068', 'weapon5': '0.076', 'AMMO4': '0.117', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.410', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.951', 'FRAGCOUNT': '1.000', 'weapon3': '1.340', 'weapon2': '1.726'} [2024-08-05 21:46:32,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17203.3, 300 sec: 17133.8). Total num frames: 21782528. Throughput: 0: 4292.0. Samples: 5444370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:46:32,794][52567] Avg episode reward: [(0, '-1.186')] [2024-08-05 21:46:34,185][52650] Updated weights for policy 0, policy_version 2661 (0.0030) [2024-08-05 21:46:35,045][52665] DAMAGECOUNT value on done: 1169.0 [2024-08-05 21:46:35,046][52665] Sum rewards: -1.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.154', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON5': '0.050', 'weapon7': '0.080', 'AMMO4': '0.086', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'weapon4': '0.442', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'weapon2': '0.970', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.059', 'weapon3': '1.708'} [2024-08-05 21:46:35,926][52820] DAMAGECOUNT value on done: 1652.0 [2024-08-05 21:46:35,929][52820] Sum rewards: 5.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.005', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'weapon5': '0.128', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.280', 'weapon3': '2.198', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '6.000'} [2024-08-05 21:46:37,568][52665] DAMAGECOUNT value on done: 1215.0 [2024-08-05 21:46:37,569][52665] Sum rewards: -0.964, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.593', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.143', 'HITCOUNT': '0.290', 'WEAPON3': '0.900', 'ARMOR': '0.921', 'DAMAGECOUNT': '1.074', 'weapon2': '1.358', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.1, 300 sec: 17078.2). Total num frames: 21856256. Throughput: 0: 4272.4. Samples: 5469440. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 21:46:37,794][52567] Avg episode reward: [(0, '-1.070')] [2024-08-05 21:46:38,410][52650] Updated weights for policy 0, policy_version 2671 (0.0028) [2024-08-05 21:46:39,365][52820] DAMAGECOUNT value on done: 1208.0 [2024-08-05 21:46:39,367][52820] Sum rewards: -0.100, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.381', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.121', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.448', 'ARMOR': '0.527', 'DAMAGECOUNT': '0.771', 'WEAPON3': '0.800', 'weapon2': '1.304', 'weapon3': '1.764', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:40,077][52665] DAMAGECOUNT value on done: 754.0 [2024-08-05 21:46:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 21946368. Throughput: 0: 4284.7. Samples: 5495330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:46:42,797][52567] Avg episode reward: [(0, '-1.034')] [2024-08-05 21:46:42,833][52665] DAMAGECOUNT value on done: 1076.0 [2024-08-05 21:46:42,834][52665] Sum rewards: -3.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.065', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.032', 'weapon5': '0.054', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.720', 'ARMOR': '0.893', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.292', 'weapon3': '2.264'} [2024-08-05 21:46:43,209][52649] DAMAGECOUNT value on done: 1199.0 [2024-08-05 21:46:43,209][52649] Sum rewards: -3.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'weapon4': '0.006', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.188', 'HITCOUNT': '0.240', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.885', 'weapon2': '1.056', 'WEAPON3': '1.100', 'weapon3': '2.678', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:43,710][52650] Updated weights for policy 0, policy_version 2681 (0.0012) [2024-08-05 21:46:45,594][52665] DAMAGECOUNT value on done: 1165.0 [2024-08-05 21:46:45,602][52665] Sum rewards: 0.492, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.748', 'AMMO2': '0.021', 'ARMOR': '0.084', 'AMMO3': '0.088', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'weapon4': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.530', 'weapon3': '1.602', 'weapon2': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:45,979][52649] DAMAGECOUNT value on done: 1341.0 [2024-08-05 21:46:45,979][52649] Sum rewards: 3.485, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'HEALTH': '0.776', 'DAMAGECOUNT': '0.954', 'weapon2': '1.602', 'weapon3': '1.986', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 22036480. Throughput: 0: 4268.9. Samples: 5507580. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 21:46:47,794][52567] Avg episode reward: [(0, '-1.199')] [2024-08-05 21:46:47,992][52665] DAMAGECOUNT value on done: 971.0 [2024-08-05 21:46:48,002][52665] Sum rewards: -0.006, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.716', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.140', 'HITCOUNT': '0.220', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.915', 'weapon2': '1.422', 'weapon3': '1.886', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:48,174][52650] Updated weights for policy 0, policy_version 2691 (0.0018) [2024-08-05 21:46:48,433][52649] DAMAGECOUNT value on done: 1051.0 [2024-08-05 21:46:48,433][52649] Sum rewards: 2.494, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.188', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'DAMAGECOUNT': '1.182', 'weapon3': '1.372', 'weapon2': '1.866', 'FRAGCOUNT': '2.500'} [2024-08-05 21:46:49,471][52669] DAMAGECOUNT value on done: 782.0 [2024-08-05 21:46:49,473][52669] Sum rewards: -1.464, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'weapon4': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.300', 'ARMOR': '0.495', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.960', 'weapon2': '1.582', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:50,303][52665] DAMAGECOUNT value on done: 1287.0 [2024-08-05 21:46:50,304][52665] Sum rewards: 3.289, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.022', 'AMMO4': '0.075', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.140', 'weapon4': '0.160', 'HITCOUNT': '0.320', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.215', 'weapon3': '1.570', 'weapon2': '1.934', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:50,716][52649] DAMAGECOUNT value on done: 1155.0 [2024-08-05 21:46:50,719][52649] Sum rewards: -3.451, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.016', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.020', 'weapon5': '0.148', 'AMMO3': '0.156', 'HITCOUNT': '0.200', 'WEAPON5': '0.250', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.384', 'weapon3': '2.012'} [2024-08-05 21:46:52,042][52647] DAMAGECOUNT value on done: 772.0 [2024-08-05 21:46:52,042][52647] Sum rewards: -0.720, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.030', 'AMMO4': '0.056', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.388', 'DAMAGECOUNT': '0.819', 'WEAPON3': '0.850', 'weapon2': '1.402', 'weapon3': '1.922', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:52,341][52669] DAMAGECOUNT value on done: 1381.0 [2024-08-05 21:46:52,343][52669] Sum rewards: -2.310, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.795', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'ARMOR': '0.028', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.250', 'weapon5': '0.680', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.702', 'weapon2': '1.194', 'weapon3': '1.948'} [2024-08-05 21:46:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 22118400. Throughput: 0: 4265.6. Samples: 5533500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:46:52,794][52567] Avg episode reward: [(0, '-1.179')] [2024-08-05 21:46:53,174][52650] Updated weights for policy 0, policy_version 2701 (0.0016) [2024-08-05 21:46:53,269][52667] DAMAGECOUNT value on done: 1255.0 [2024-08-05 21:46:53,269][52667] Sum rewards: 2.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.306', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.234', 'weapon4': '0.234', 'HITCOUNT': '0.360', 'ARMOR': '0.457', 'WEAPON3': '0.500', 'weapon2': '1.196', 'DAMAGECOUNT': '1.380', 'weapon3': '1.464', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:53,396][52665] DAMAGECOUNT value on done: 699.0 [2024-08-05 21:46:53,398][52665] Sum rewards: -0.319, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.233', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.080', 'AMMO4': '0.089', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.213', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.569', 'weapon3': '1.458', 'weapon2': '2.072'} [2024-08-05 21:46:54,019][52649] DAMAGECOUNT value on done: 567.0 [2024-08-05 21:46:54,816][52647] DAMAGECOUNT value on done: 1701.0 [2024-08-05 21:46:54,818][52647] Sum rewards: 0.085, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.256', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.066', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'weapon4': '0.280', 'HITCOUNT': '0.390', 'ARMOR': '0.544', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.296', 'weapon2': '1.494', 'weapon3': '1.768', 'FRAGCOUNT': '2.000'} [2024-08-05 21:46:55,045][52669] DAMAGECOUNT value on done: 864.0 [2024-08-05 21:46:55,046][52669] Sum rewards: -0.604, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.615', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.012', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.628', 'weapon3': '2.010'} [2024-08-05 21:46:55,927][52663] DAMAGECOUNT value on done: 1223.0 [2024-08-05 21:46:55,927][52663] Sum rewards: -1.883, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.086', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon5': '0.158', 'weapon4': '0.216', 'HITCOUNT': '0.270', 'ARMOR': '0.873', 'DAMAGECOUNT': '0.915', 'WEAPON3': '0.950', 'weapon2': '1.386', 'weapon3': '1.858', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:56,162][52665] DAMAGECOUNT value on done: 2023.0 [2024-08-05 21:46:56,164][52665] Sum rewards: 2.823, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.260', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'weapon4': '0.084', 'AMMO3': '0.135', 'HITCOUNT': '0.360', 'WEAPON3': '0.900', 'weapon2': '1.730', 'weapon3': '1.768', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '6.000'} [2024-08-05 21:46:56,569][52667] DAMAGECOUNT value on done: 1099.0 [2024-08-05 21:46:56,569][52667] Sum rewards: 3.193, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.030', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.034', 'ARMOR': '0.040', 'weapon4': '0.048', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.960', 'weapon2': '1.418', 'weapon3': '1.766', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:56,759][52649] DAMAGECOUNT value on done: 1466.0 [2024-08-05 21:46:56,762][52649] Sum rewards: -2.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.718', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.038', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.500', 'weapon2': '1.588', 'weapon3': '1.908', 'DAMAGECOUNT': '2.226'} [2024-08-05 21:46:57,787][52669] DAMAGECOUNT value on done: 2002.0 [2024-08-05 21:46:57,787][52669] Sum rewards: 1.803, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.563', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon5': '0.168', 'HITCOUNT': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.362', 'DAMAGECOUNT': '1.416', 'weapon3': '2.148', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 22200320. Throughput: 0: 4280.0. Samples: 5559450. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:46:57,794][52567] Avg episode reward: [(0, '-1.013')] [2024-08-05 21:46:57,870][52647] DAMAGECOUNT value on done: 1242.0 [2024-08-05 21:46:57,870][52647] Sum rewards: -2.391, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.914', 'AMMO2': '0.020', 'ARMOR': '0.044', 'AMMO4': '0.099', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.984', 'weapon2': '1.180', 'FRAGCOUNT': '2.000', 'weapon3': '2.236'} [2024-08-05 21:46:57,992][52650] Updated weights for policy 0, policy_version 2711 (0.0023) [2024-08-05 21:46:58,876][52663] DAMAGECOUNT value on done: 1241.0 [2024-08-05 21:46:58,878][52663] Sum rewards: 3.884, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.206', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.026', 'weapon7': '0.064', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.308', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'ARMOR': '0.467', 'weapon3': '0.916', 'DAMAGECOUNT': '1.356', 'weapon2': '1.412', 'FRAGCOUNT': '4.000'} [2024-08-05 21:46:58,973][52665] DAMAGECOUNT value on done: 1394.0 [2024-08-05 21:46:59,601][52667] DAMAGECOUNT value on done: 1504.0 [2024-08-05 21:46:59,603][52667] Sum rewards: -2.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.635', 'AMMO2': '0.003', 'ARMOR': '0.016', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.166', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.047', 'weapon2': '1.428', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'} [2024-08-05 21:46:59,754][52658] DAMAGECOUNT value on done: 1082.0 [2024-08-05 21:46:59,766][52649] DAMAGECOUNT value on done: 1024.0 [2024-08-05 21:46:59,767][52649] Sum rewards: 2.766, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.932', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.052', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'ARMOR': '0.469', 'DAMAGECOUNT': '0.825', 'weapon3': '1.122', 'weapon2': '1.412', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:00,461][52669] DAMAGECOUNT value on done: 1241.0 [2024-08-05 21:47:00,463][52669] Sum rewards: 6.139, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.667', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.160', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.110', 'weapon3': '1.540', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '7.000'} [2024-08-05 21:47:00,874][52647] DAMAGECOUNT value on done: 925.0 [2024-08-05 21:47:00,876][52647] Sum rewards: -1.208, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.916', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.107', 'HITCOUNT': '0.270', 'ARMOR': '0.508', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.888', 'weapon2': '1.716', 'weapon3': '1.768', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:01,262][52663] DAMAGECOUNT value on done: 1241.0 [2024-08-05 21:47:01,262][52663] Sum rewards: -1.095, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.140', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.190', 'HITCOUNT': '0.390', 'ARMOR': '0.548', 'WEAPON3': '1.050', 'weapon2': '1.280', 'DAMAGECOUNT': '1.572', 'weapon3': '1.932', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:01,867][52665] DAMAGECOUNT value on done: 1527.0 [2024-08-05 21:47:01,867][52665] Sum rewards: 2.687, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.029', 'AMMO2': '0.020', 'ARMOR': '0.068', 'weapon4': '0.086', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'weapon2': '1.240', 'DAMAGECOUNT': '1.395', 'weapon3': '2.296', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:02,579][52650] Updated weights for policy 0, policy_version 2721 (0.0038) [2024-08-05 21:47:02,620][52649] DAMAGECOUNT value on done: 886.0 [2024-08-05 21:47:02,621][52649] Sum rewards: -1.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.344', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'ARMOR': '0.068', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.130', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.750', 'weapon2': '1.440', 'weapon3': '1.852', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:02,702][52667] DAMAGECOUNT value on done: 691.0 [2024-08-05 21:47:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 22290432. Throughput: 0: 4277.8. Samples: 5572310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:47:02,794][52567] Avg episode reward: [(0, '-0.961')] [2024-08-05 21:47:02,827][52658] DAMAGECOUNT value on done: 1212.0 [2024-08-05 21:47:02,827][52658] Sum rewards: -3.432, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.864', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.107', 'weapon2': '1.608', 'weapon3': '1.886'} [2024-08-05 21:47:03,214][52669] DAMAGECOUNT value on done: 1061.0 [2024-08-05 21:47:03,772][52647] DAMAGECOUNT value on done: 720.0 [2024-08-05 21:47:03,772][52647] Sum rewards: 2.807, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'HITCOUNT': '0.020', 'AMMO3': '0.040', 'DAMAGECOUNT': '0.063', 'HEALTH': '0.113', 'WEAPON3': '0.150', 'ARMOR': '0.497', 'weapon2': '0.730', 'weapon3': '0.944', 'FRAGCOUNT': '1.000'} [2024-08-05 21:47:04,432][52663] DAMAGECOUNT value on done: 1492.0 [2024-08-05 21:47:04,433][52663] Sum rewards: 0.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.130', 'AMMO2': '0.033', 'weapon4': '0.034', 'AMMO3': '0.085', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'ARMOR': '0.449', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.561', 'weapon3': '1.560', 'FRAGCOUNT': '2.000', 'weapon2': '2.046'} [2024-08-05 21:47:04,976][52665] DAMAGECOUNT value on done: 1527.0 [2024-08-05 21:47:04,976][52665] Sum rewards: 0.798, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.374', 'weapon4': '0.002', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.034', 'ARMOR': '0.068', 'AMMO4': '0.111', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.479', 'weapon3': '1.666', 'weapon2': '1.896', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:05,967][52667] DAMAGECOUNT value on done: 984.0 [2024-08-05 21:47:05,969][52667] Sum rewards: -3.534, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.765', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.147', 'HITCOUNT': '0.230', 'weapon5': '0.506', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.800', 'weapon2': '1.270', 'weapon3': '1.966', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:06,029][52649] DAMAGECOUNT value on done: 1193.0 [2024-08-05 21:47:06,077][52658] DAMAGECOUNT value on done: 672.0 [2024-08-05 21:47:06,077][52658] Sum rewards: -3.682, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.248', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.084', 'HITCOUNT': '0.100', 'AMMO3': '0.121', 'DAMAGECOUNT': '0.300', 'ARMOR': '0.493', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.452', 'weapon2': '2.114'} [2024-08-05 21:47:06,251][52669] DAMAGECOUNT value on done: 1175.0 [2024-08-05 21:47:06,251][52669] Sum rewards: 4.431, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.339', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.200', 'weapon5': '0.216', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'weapon4': '0.300', 'weapon3': '0.848', 'DAMAGECOUNT': '0.897', 'ARMOR': '0.932', 'weapon2': '1.510', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:06,718][52647] DAMAGECOUNT value on done: 911.0 [2024-08-05 21:47:07,299][52650] Updated weights for policy 0, policy_version 2731 (0.0012) [2024-08-05 21:47:07,511][52663] DAMAGECOUNT value on done: 918.0 [2024-08-05 21:47:07,511][52663] Sum rewards: 0.618, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.422', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.102', 'HITCOUNT': '0.330', 'ARMOR': '0.437', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.999', 'weapon2': '1.486', 'weapon3': '1.840', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 22372352. Throughput: 0: 4284.3. Samples: 5598100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:47:07,794][52567] Avg episode reward: [(0, '-0.844')] [2024-08-05 21:47:07,873][52614] Saving new best policy, reward=-0.844! [2024-08-05 21:47:08,193][52665] DAMAGECOUNT value on done: 1498.0 [2024-08-05 21:47:08,194][52665] Sum rewards: 0.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.078', 'AMMO2': '0.006', 'AMMO4': '0.027', 'ARMOR': '0.076', 'AMMO3': '0.102', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.530', 'weapon3': '1.944', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:09,104][52667] DAMAGECOUNT value on done: 905.0 [2024-08-05 21:47:09,105][52667] Sum rewards: 0.639, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.150', 'AMMO2': '0.002', 'AMMO5': '0.004', 'AMMO4': '0.010', 'weapon5': '0.086', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.114', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.281', 'weapon3': '1.446', 'FRAGCOUNT': '1.500', 'weapon2': '1.642'} [2024-08-05 21:47:09,202][52658] DAMAGECOUNT value on done: 949.0 [2024-08-05 21:47:09,204][52658] Sum rewards: 1.684, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.527', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon4': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'HITCOUNT': '0.160', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.690', 'weapon3': '1.150', 'weapon2': '1.336', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:09,384][52664] DAMAGECOUNT value on done: 1053.0 [2024-08-05 21:47:09,385][52664] Sum rewards: -3.091, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.107', 'weapon4': '0.108', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.646', 'weapon3': '1.678'} [2024-08-05 21:47:09,520][52647] DAMAGECOUNT value on done: 943.0 [2024-08-05 21:47:09,520][52647] Sum rewards: 1.076, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.012', 'AMMO4': '0.060', 'HEALTH': '0.064', 'AMMO3': '0.103', 'HITCOUNT': '0.190', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.525', 'weapon2': '1.050', 'weapon3': '1.422', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:09,598][52669] DAMAGECOUNT value on done: 1331.0 [2024-08-05 21:47:09,599][52669] Sum rewards: -1.339, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.254', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.148', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '1.050', 'weapon2': '1.292', 'DAMAGECOUNT': '1.320', 'weapon3': '2.220', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:09,873][52649] DAMAGECOUNT value on done: 1226.0 [2024-08-05 21:47:09,874][52649] Sum rewards: 0.320, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.011', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'weapon5': '0.316', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.317', 'weapon2': '1.384', 'weapon3': '1.940', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:10,895][52663] DAMAGECOUNT value on done: 1147.0 [2024-08-05 21:47:10,896][52663] Sum rewards: -2.490, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.615', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.132', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.204', 'weapon3': '2.064'} [2024-08-05 21:47:11,916][52664] DAMAGECOUNT value on done: 1707.0 [2024-08-05 21:47:11,918][52664] Sum rewards: 3.315, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.242', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.131', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.468', 'weapon3': '2.310', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:12,048][52647] DAMAGECOUNT value on done: 978.0 [2024-08-05 21:47:12,049][52647] Sum rewards: -4.603, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.508', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.018', 'weapon4': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.432', 'ARMOR': '0.453', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.544', 'weapon3': '1.720'} [2024-08-05 21:47:12,119][52667] DAMAGECOUNT value on done: 1606.0 [2024-08-05 21:47:12,121][52667] Sum rewards: 0.392, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.080', 'ARMOR': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon2': '1.134', 'weapon3': '1.922'} [2024-08-05 21:47:12,246][52665] DAMAGECOUNT value on done: 1206.0 [2024-08-05 21:47:12,259][52650] Updated weights for policy 0, policy_version 2741 (0.0021) [2024-08-05 21:47:12,327][52658] DAMAGECOUNT value on done: 1050.0 [2024-08-05 21:47:12,329][52658] Sum rewards: 1.535, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.286', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.109', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'ARMOR': '0.860', 'DAMAGECOUNT': '1.155', 'weapon2': '1.500', 'weapon3': '1.956', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:12,403][52669] DAMAGECOUNT value on done: 1079.0 [2024-08-05 21:47:12,404][52669] Sum rewards: 0.245, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.958', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon7': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'weapon4': '0.134', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.900', 'weapon3': '1.636', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 17050.5). Total num frames: 22454272. Throughput: 0: 4257.8. Samples: 5623070. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:47:12,794][52567] Avg episode reward: [(0, '-0.788')] [2024-08-05 21:47:12,835][52614] Saving new best policy, reward=-0.788! [2024-08-05 21:47:13,004][52649] DAMAGECOUNT value on done: 921.0 [2024-08-05 21:47:13,324][52663] DAMAGECOUNT value on done: 1292.0 [2024-08-05 21:47:13,326][52663] Sum rewards: 1.090, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.280', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.055', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.180', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.465', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '0.753', 'weapon3': '1.066', 'weapon2': '1.200'} [2024-08-05 21:47:14,855][52669] DAMAGECOUNT value on done: 1056.0 [2024-08-05 21:47:14,928][52664] DAMAGECOUNT value on done: 1464.0 [2024-08-05 21:47:14,931][52664] Sum rewards: -0.934, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.614', 'AMMO2': '0.011', 'weapon4': '0.022', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.133', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'weapon2': '1.130', 'DAMAGECOUNT': '1.227', 'FRAGCOUNT': '2.000', 'weapon3': '2.084'} [2024-08-05 21:47:15,096][52647] DAMAGECOUNT value on done: 1476.0 [2024-08-05 21:47:15,098][52647] Sum rewards: 1.410, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.769', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.014', 'ARMOR': '0.044', 'weapon4': '0.046', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.230', 'weapon2': '1.446', 'weapon3': '1.598', 'FRAGCOUNT': '5.000'} [2024-08-05 21:47:15,237][52665] DAMAGECOUNT value on done: 1600.0 [2024-08-05 21:47:15,238][52665] Sum rewards: 2.654, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.375', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.127', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.455', 'weapon2': '1.462', 'weapon3': '2.016', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:15,279][52667] DAMAGECOUNT value on done: 1239.0 [2024-08-05 21:47:15,428][52658] DAMAGECOUNT value on done: 940.0 [2024-08-05 21:47:15,429][52658] Sum rewards: -2.839, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.109', 'HITCOUNT': '0.140', 'weapon4': '0.146', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.408', 'ARMOR': '0.496', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.362', 'weapon3': '1.698'} [2024-08-05 21:47:15,965][52663] DAMAGECOUNT value on done: 1191.0 [2024-08-05 21:47:15,969][52663] Sum rewards: -3.650, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.002', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.013', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.238', 'HITCOUNT': '0.280', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '1.144', 'weapon3': '2.058'} [2024-08-05 21:47:16,232][52649] DAMAGECOUNT value on done: 768.0 [2024-08-05 21:47:16,236][52649] Sum rewards: -1.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.652', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.060', 'AMMO3': '0.129', 'HITCOUNT': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.080', 'weapon2': '1.838', 'weapon3': '2.034', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:17,154][52650] Updated weights for policy 0, policy_version 2751 (0.0027) [2024-08-05 21:47:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17203.2, 300 sec: 17189.3). Total num frames: 22552576. Throughput: 0: 4252.0. Samples: 5635710. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:47:17,795][52567] Avg episode reward: [(0, '-0.718')] [2024-08-05 21:47:17,798][52614] Saving new best policy, reward=-0.718! [2024-08-05 21:47:18,086][52669] DAMAGECOUNT value on done: 1423.0 [2024-08-05 21:47:18,088][52669] Sum rewards: 6.045, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.336', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.053', 'weapon7': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.268', 'WEAPON3': '0.350', 'ARMOR': '0.412', 'weapon2': '0.708', 'weapon3': '0.814', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '6.000'} [2024-08-05 21:47:18,135][52665] DAMAGECOUNT value on done: 1226.0 [2024-08-05 21:47:18,137][52665] Sum rewards: -0.981, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.446', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'ARMOR': '0.055', 'AMMO3': '0.140', 'weapon4': '0.152', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.786', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.568', 'weapon3': '2.132'} [2024-08-05 21:47:18,287][52667] DAMAGECOUNT value on done: 987.0 [2024-08-05 21:47:18,287][52667] Sum rewards: 2.231, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.110', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.014', 'AMMO4': '0.029', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'weapon3': '0.874', 'DAMAGECOUNT': '0.999', 'weapon2': '2.048', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:18,317][52668] DAMAGECOUNT value on done: 1207.0 [2024-08-05 21:47:18,333][52668] Sum rewards: 1.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.430', 'AMMO2': '0.003', 'AMMO4': '0.017', 'ARMOR': '0.040', 'AMMO3': '0.128', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.275', 'weapon2': '1.656', 'weapon3': '2.144', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:18,378][52664] DAMAGECOUNT value on done: 1096.0 [2024-08-05 21:47:18,379][52664] Sum rewards: 5.971, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'weapon5': '0.156', 'weapon4': '0.252', 'HITCOUNT': '0.350', 'ARMOR': '0.540', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.326', 'weapon2': '1.492', 'weapon3': '1.724', 'FRAGCOUNT': '6.000'} [2024-08-05 21:47:18,461][52647] DAMAGECOUNT value on done: 940.0 [2024-08-05 21:47:18,556][52658] DAMAGECOUNT value on done: 884.0 [2024-08-05 21:47:18,557][52658] Sum rewards: 1.469, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.017', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.085', 'HITCOUNT': '0.090', 'HEALTH': '0.164', 'weapon4': '0.220', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.350', 'weapon2': '0.918', 'weapon3': '0.936', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:18,904][52649] DAMAGECOUNT value on done: 1718.0 [2024-08-05 21:47:18,905][52649] Sum rewards: -0.573, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.999', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.142', 'WEAPON4': '0.200', 'weapon5': '0.272', 'HITCOUNT': '0.330', 'ARMOR': '0.516', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.071', 'weapon2': '1.532', 'weapon3': '1.872'} [2024-08-05 21:47:19,098][52663] DAMAGECOUNT value on done: 1008.0 [2024-08-05 21:47:19,100][52663] Sum rewards: 0.789, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.575', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.049', 'AMMO4': '0.066', 'weapon7': '0.076', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.933', 'weapon2': '1.312', 'weapon3': '1.884', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:20,816][52660] DAMAGECOUNT value on done: 1390.0 [2024-08-05 21:47:20,817][52660] Sum rewards: 1.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.809', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.160', 'HITCOUNT': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.149', 'weapon3': '1.570', 'weapon2': '1.870', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:20,828][52665] DAMAGECOUNT value on done: 1588.0 [2024-08-05 21:47:20,830][52665] Sum rewards: 3.663, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.748', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'weapon4': '0.084', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.837', 'weapon3': '1.128', 'weapon2': '1.936', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:20,892][52669] DAMAGECOUNT value on done: 1183.0 [2024-08-05 21:47:20,893][52669] Sum rewards: -1.528, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.812', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon4': '0.120', 'AMMO3': '0.136', 'HITCOUNT': '0.280', 'ARMOR': '0.484', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.855', 'weapon2': '1.584', 'weapon3': '1.960', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:20,990][52667] DAMAGECOUNT value on done: 1151.0 [2024-08-05 21:47:20,991][52667] Sum rewards: 0.348, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.680', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'ARMOR': '0.040', 'AMMO3': '0.098', 'HITCOUNT': '0.220', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.756', 'weapon3': '1.598', 'weapon2': '1.672', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:21,174][52658] DAMAGECOUNT value on done: 826.0 [2024-08-05 21:47:21,174][52658] Sum rewards: -0.234, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.046', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'HITCOUNT': '0.220', 'ARMOR': '0.518', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.621', 'FRAGCOUNT': '1.000', 'weapon3': '1.122', 'weapon2': '1.904'} [2024-08-05 21:47:21,409][52664] DAMAGECOUNT value on done: 1286.0 [2024-08-05 21:47:21,410][52664] Sum rewards: -3.112, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.173', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon5': '0.028', 'weapon4': '0.062', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.800', 'weapon3': '1.534', 'weapon2': '1.932', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:21,434][52647] DAMAGECOUNT value on done: 964.0 [2024-08-05 21:47:21,435][52647] Sum rewards: -1.809, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.877', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.126', 'weapon4': '0.148', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.750', 'weapon3': '1.470', 'weapon2': '1.840', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:21,523][52668] DAMAGECOUNT value on done: 1346.0 [2024-08-05 21:47:21,662][52649] DAMAGECOUNT value on done: 1315.0 [2024-08-05 21:47:21,663][52649] Sum rewards: 0.327, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.065', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO3': '0.170', 'HITCOUNT': '0.460', 'WEAPON3': '1.000', 'weapon2': '1.208', 'DAMAGECOUNT': '1.650', 'weapon3': '2.330', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:22,193][52663] DAMAGECOUNT value on done: 1623.0 [2024-08-05 21:47:22,195][52663] Sum rewards: 1.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.672', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.140', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'ARMOR': '1.290', 'DAMAGECOUNT': '1.755', 'weapon2': '1.828', 'weapon3': '1.960', 'FRAGCOUNT': '5.000'} [2024-08-05 21:47:22,520][52650] Updated weights for policy 0, policy_version 2761 (0.0011) [2024-08-05 21:47:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 17189.3). Total num frames: 22618112. Throughput: 0: 4253.3. Samples: 5660840. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 21:47:22,794][52567] Avg episode reward: [(0, '-0.261')] [2024-08-05 21:47:22,816][52614] Saving new best policy, reward=-0.261! [2024-08-05 21:47:23,432][52667] DAMAGECOUNT value on done: 1270.0 [2024-08-05 21:47:23,432][52667] Sum rewards: 1.649, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.258', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'ARMOR': '0.881', 'DAMAGECOUNT': '1.095', 'weapon2': '1.600', 'weapon3': '2.028', 'FRAGCOUNT': '5.000'} [2024-08-05 21:47:23,529][52665] DAMAGECOUNT value on done: 1098.0 [2024-08-05 21:47:23,733][52658] DAMAGECOUNT value on done: 880.0 [2024-08-05 21:47:24,083][52660] DAMAGECOUNT value on done: 1233.0 [2024-08-05 21:47:24,084][52660] Sum rewards: -0.204, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.525', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.116', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.224', 'weapon2': '1.658', 'weapon3': '1.688', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:24,210][52669] DAMAGECOUNT value on done: 1214.0 [2024-08-05 21:47:24,210][52669] Sum rewards: 3.703, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'HEALTH': '0.035', 'ARMOR': '0.040', 'AMMO4': '0.057', 'weapon5': '0.058', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.611', 'weapon2': '1.732', 'weapon3': '1.994', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:24,468][52664] DAMAGECOUNT value on done: 1124.0 [2024-08-05 21:47:24,469][52664] Sum rewards: 1.016, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.142', 'AMMO3': '0.153', 'weapon4': '0.222', 'weapon5': '0.222', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.185', 'weapon2': '1.250', 'weapon3': '1.602', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:24,553][52668] DAMAGECOUNT value on done: 1381.0 [2024-08-05 21:47:24,553][52668] Sum rewards: -0.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.670', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'weapon4': '0.022', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.540', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon3': '1.708', 'weapon2': '1.742'} [2024-08-05 21:47:24,591][52647] DAMAGECOUNT value on done: 1208.0 [2024-08-05 21:47:24,592][52647] Sum rewards: 1.993, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.754', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.086', 'weapon4': '0.128', 'HITCOUNT': '0.180', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.672', 'weapon2': '1.584', 'weapon3': '1.584', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:24,714][52649] DAMAGECOUNT value on done: 461.0 [2024-08-05 21:47:24,714][52649] Sum rewards: 2.679, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.310', 'AMMO2': '0.005', 'AMMO5': '0.012', 'AMMO4': '0.026', 'AMMO3': '0.080', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon5': '0.462', 'weapon2': '1.242', 'weapon3': '1.320', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:25,480][52663] DAMAGECOUNT value on done: 1011.0 [2024-08-05 21:47:25,481][52663] Sum rewards: 1.092, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.255', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.340', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.167', 'weapon2': '1.794', 'weapon3': '1.838', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:26,089][52667] DAMAGECOUNT value on done: 1807.0 [2024-08-05 21:47:26,090][52667] Sum rewards: -0.947, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.851', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.136', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.284', 'weapon2': '1.776', 'weapon3': '1.808', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:26,269][52658] DAMAGECOUNT value on done: 1009.0 [2024-08-05 21:47:26,270][52658] Sum rewards: 2.639, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.168', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.097', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.029', 'weapon3': '1.354', 'weapon2': '1.946', 'FRAGCOUNT': '5.000'} [2024-08-05 21:47:26,322][52665] DAMAGECOUNT value on done: 1138.0 [2024-08-05 21:47:26,858][52650] Updated weights for policy 0, policy_version 2771 (0.0014) [2024-08-05 21:47:26,989][52660] DAMAGECOUNT value on done: 652.0 [2024-08-05 21:47:27,353][52669] DAMAGECOUNT value on done: 1315.0 [2024-08-05 21:47:27,353][52649] DAMAGECOUNT value on done: 885.0 [2024-08-05 21:47:27,355][52649] Sum rewards: 2.684, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.251', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.204', 'HITCOUNT': '0.340', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.395', 'weapon2': '1.674', 'weapon3': '1.760', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:27,355][52669] Sum rewards: 1.396, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.894', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.190', 'weapon4': '0.304', 'ARMOR': '0.478', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.930', 'weapon2': '1.364', 'weapon3': '1.802', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:27,405][52668] DAMAGECOUNT value on done: 910.0 [2024-08-05 21:47:27,405][52668] Sum rewards: 0.941, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.840', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.111', 'HITCOUNT': '0.410', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.455', 'weapon2': '1.722', 'weapon3': '2.106', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17066.7, 300 sec: 17217.1). Total num frames: 22716416. Throughput: 0: 4235.1. Samples: 5685910. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:47:27,794][52567] Avg episode reward: [(0, '-0.015')] [2024-08-05 21:47:27,797][52614] Saving new best policy, reward=-0.015! [2024-08-05 21:47:27,872][52664] DAMAGECOUNT value on done: 1288.0 [2024-08-05 21:47:27,873][52664] Sum rewards: 3.837, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.222', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'weapon5': '0.054', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.360', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.485', 'weapon2': '1.506', 'weapon3': '1.904', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:27,942][52647] DAMAGECOUNT value on done: 1064.0 [2024-08-05 21:47:27,942][52647] Sum rewards: 1.112, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.541', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO3': '0.070', 'weapon4': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon3': '1.224', 'weapon2': '1.570'} [2024-08-05 21:47:28,357][52663] DAMAGECOUNT value on done: 1262.0 [2024-08-05 21:47:28,358][52663] Sum rewards: -1.525, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.366', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.058', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon4': '0.312', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon2': '1.468', 'FRAGCOUNT': '2.000', 'weapon3': '2.078'} [2024-08-05 21:47:28,565][52671] DAMAGECOUNT value on done: 752.0 [2024-08-05 21:47:28,603][52667] DAMAGECOUNT value on done: 1389.0 [2024-08-05 21:47:28,605][52667] Sum rewards: 4.108, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.730', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.028', 'AMMO3': '0.070', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'weapon2': '1.074', 'weapon3': '1.168', 'DAMAGECOUNT': '1.281', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:28,804][52658] DAMAGECOUNT value on done: 1248.0 [2024-08-05 21:47:28,805][52658] Sum rewards: 3.363, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.790', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.226', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'ARMOR': '0.528', 'DAMAGECOUNT': '0.885', 'weapon2': '1.186', 'weapon3': '1.216', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:29,418][52660] DAMAGECOUNT value on done: 1726.0 [2024-08-05 21:47:29,419][52660] Sum rewards: 6.525, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.849', 'AMMO2': '0.023', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.123', 'weapon4': '0.256', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.302', 'weapon3': '1.906', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '8.000'} [2024-08-05 21:47:30,054][52668] DAMAGECOUNT value on done: 795.0 [2024-08-05 21:47:30,054][52668] Sum rewards: 1.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.712', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.030', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'HITCOUNT': '0.210', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.720', 'weapon2': '1.008', 'weapon3': '1.322', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:30,149][52669] DAMAGECOUNT value on done: 1035.0 [2024-08-05 21:47:30,149][52669] Sum rewards: -1.623, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.304', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.052', 'AMMO4': '0.062', 'AMMO3': '0.126', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.116', 'weapon3': '1.650', 'weapon2': '1.808', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:30,817][52649] DAMAGECOUNT value on done: 830.0 [2024-08-05 21:47:31,253][52667] DAMAGECOUNT value on done: 1400.0 [2024-08-05 21:47:31,253][52667] Sum rewards: -0.890, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.651', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.210', 'weapon4': '0.228', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.138', 'weapon3': '1.612'} [2024-08-05 21:47:31,344][52647] DAMAGECOUNT value on done: 1042.0 [2024-08-05 21:47:31,344][52647] Sum rewards: 1.455, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.346', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.085', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.095', 'weapon2': '1.596', 'weapon3': '1.824', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:31,359][52664] DAMAGECOUNT value on done: 1050.0 [2024-08-05 21:47:31,423][52658] DAMAGECOUNT value on done: 1548.0 [2024-08-05 21:47:31,423][52658] Sum rewards: -2.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.150', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon5': '0.166', 'HITCOUNT': '0.210', 'ARMOR': '0.451', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.344', 'weapon3': '2.246'} [2024-08-05 21:47:31,449][52663] DAMAGECOUNT value on done: 1247.0 [2024-08-05 21:47:31,450][52663] Sum rewards: -2.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.410', 'AMMO2': '0.012', 'ARMOR': '0.044', 'AMMO4': '0.059', 'AMMO3': '0.145', 'HITCOUNT': '0.270', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.984', 'weapon2': '1.650', 'FRAGCOUNT': '2.000', 'weapon3': '2.224'} [2024-08-05 21:47:31,791][52671] DAMAGECOUNT value on done: 1159.0 [2024-08-05 21:47:31,791][52671] Sum rewards: -1.208, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.278', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO3': '0.136', 'HITCOUNT': '0.290', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.011', 'weapon2': '1.210', 'weapon3': '2.490', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:31,962][52659] DAMAGECOUNT value on done: 1164.0 [2024-08-05 21:47:31,966][52659] Sum rewards: 0.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.036', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.189', 'HITCOUNT': '0.430', 'WEAPON3': '1.050', 'weapon2': '1.246', 'DAMAGECOUNT': '1.524', 'weapon3': '2.392', 'FRAGCOUNT': '5.000'} [2024-08-05 21:47:32,083][52650] Updated weights for policy 0, policy_version 2781 (0.0026) [2024-08-05 21:47:32,724][52660] DAMAGECOUNT value on done: 1263.0 [2024-08-05 21:47:32,724][52660] Sum rewards: -3.931, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.557', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO3': '0.118', 'HITCOUNT': '0.170', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'ARMOR': '0.978', 'FRAGCOUNT': '1.000', 'weapon3': '1.188', 'weapon2': '1.948'} [2024-08-05 21:47:32,795][52567] Fps is (10 sec: 17202.4, 60 sec: 16793.5, 300 sec: 17161.5). Total num frames: 22790144. Throughput: 0: 4242.4. Samples: 5698490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:47:32,796][52567] Avg episode reward: [(0, '0.020')] [2024-08-05 21:47:32,811][52614] Saving new best policy, reward=0.020! [2024-08-05 21:47:33,139][52668] DAMAGECOUNT value on done: 1666.0 [2024-08-05 21:47:33,141][52668] Sum rewards: 2.506, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.632', 'AMMO2': '0.009', 'AMMO4': '0.044', 'ARMOR': '0.045', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'weapon2': '1.476', 'weapon3': '1.944', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:33,296][52669] DAMAGECOUNT value on done: 1192.0 [2024-08-05 21:47:33,856][52649] DAMAGECOUNT value on done: 1324.0 [2024-08-05 21:47:33,857][52649] Sum rewards: -0.125, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.530', 'AMMO4': '-0.118', 'AMMO2': '-0.024', 'AMMO5': '0.010', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'weapon5': '0.138', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon3': '0.984', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.296', 'weapon2': '1.864'} [2024-08-05 21:47:34,093][52647] DAMAGECOUNT value on done: 1710.0 [2024-08-05 21:47:34,094][52647] Sum rewards: 1.931, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.416', 'AMMO2': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.113', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon2': '1.270', 'DAMAGECOUNT': '1.377', 'weapon3': '1.620', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:34,167][52667] DAMAGECOUNT value on done: 1010.0 [2024-08-05 21:47:34,176][52664] DAMAGECOUNT value on done: 1560.0 [2024-08-05 21:47:34,176][52664] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.361', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon4': '0.012', 'weapon5': '0.022', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.017', 'weapon3': '1.504', 'FRAGCOUNT': '2.000', 'weapon2': '2.026'} [2024-08-05 21:47:34,405][52658] DAMAGECOUNT value on done: 881.0 [2024-08-05 21:47:34,406][52658] Sum rewards: -2.428, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.398', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.639', 'WEAPON3': '0.650', 'ARMOR': '0.824', 'FRAGCOUNT': '1.000', 'weapon2': '1.690', 'weapon3': '1.716'} [2024-08-05 21:47:34,462][52663] DAMAGECOUNT value on done: 1497.0 [2024-08-05 21:47:34,462][52663] Sum rewards: 2.265, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.532', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.020', 'AMMO3': '0.068', 'weapon4': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.250', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon3': '1.052', 'DAMAGECOUNT': '1.161', 'weapon2': '2.160', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:35,035][52671] DAMAGECOUNT value on done: 655.0 [2024-08-05 21:47:35,172][52659] DAMAGECOUNT value on done: 1286.0 [2024-08-05 21:47:35,172][52659] Sum rewards: 1.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.070', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.026', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'HITCOUNT': '0.270', 'ARMOR': '0.487', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.792', 'weapon3': '1.620', 'weapon2': '1.842', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:35,758][52660] DAMAGECOUNT value on done: 1737.0 [2024-08-05 21:47:35,759][52660] Sum rewards: 2.687, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.576', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.097', 'ARMOR': '0.400', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.114', 'DAMAGECOUNT': '1.557', 'weapon3': '1.720', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:36,233][52649] DAMAGECOUNT value on done: 1160.0 [2024-08-05 21:47:36,234][52649] Sum rewards: 2.281, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.061', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'ARMOR': '0.032', 'AMMO3': '0.060', 'HITCOUNT': '0.160', 'WEAPON5': '0.200', 'weapon5': '0.202', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.540', 'FRAGCOUNT': '1.000', 'weapon3': '1.156', 'weapon2': '1.606'} [2024-08-05 21:47:36,274][52668] DAMAGECOUNT value on done: 1316.0 [2024-08-05 21:47:36,274][52668] Sum rewards: -0.019, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.238', 'AMMO2': '0.011', 'AMMO4': '0.054', 'ARMOR': '0.064', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.185', 'weapon2': '1.516', 'weapon3': '1.944'} [2024-08-05 21:47:36,294][52669] DAMAGECOUNT value on done: 1249.0 [2024-08-05 21:47:36,296][52669] Sum rewards: -0.880, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.165', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'ARMOR': '0.040', 'AMMO3': '0.154', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.750', 'WEAPON3': '0.850', 'weapon3': '1.750', 'weapon2': '1.800', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:36,618][52650] Updated weights for policy 0, policy_version 2791 (0.0014) [2024-08-05 21:47:36,770][52667] DAMAGECOUNT value on done: 1052.0 [2024-08-05 21:47:36,771][52667] Sum rewards: 2.498, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.598', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.108', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.095', 'weapon2': '1.704', 'weapon3': '1.918', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:37,132][52658] DAMAGECOUNT value on done: 1363.0 [2024-08-05 21:47:37,133][52658] Sum rewards: 3.104, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.330', 'ARMOR': '0.004', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.080', 'weapon4': '0.130', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'weapon2': '1.128', 'weapon3': '1.160', 'DAMAGECOUNT': '1.203', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:37,406][52647] DAMAGECOUNT value on done: 1210.0 [2024-08-05 21:47:37,406][52647] Sum rewards: -1.793, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.168', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.066', 'ARMOR': '0.080', 'AMMO3': '0.091', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.562', 'DAMAGECOUNT': '0.603', 'weapon4': '0.644', 'WEAPON3': '0.650', 'weapon3': '1.782'} [2024-08-05 21:47:37,524][52664] DAMAGECOUNT value on done: 1232.0 [2024-08-05 21:47:37,525][52664] Sum rewards: 1.334, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.122', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'ARMOR': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.242', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'weapon2': '0.988', 'DAMAGECOUNT': '1.224', 'weapon3': '1.684', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:37,694][52663] DAMAGECOUNT value on done: 990.0 [2024-08-05 21:47:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17161.5). Total num frames: 22880256. Throughput: 0: 4223.8. Samples: 5723570. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:47:37,794][52567] Avg episode reward: [(0, '0.161')] [2024-08-05 21:47:37,797][52614] Saving new best policy, reward=0.161! [2024-08-05 21:47:38,238][52671] DAMAGECOUNT value on done: 1778.0 [2024-08-05 21:47:38,449][52659] DAMAGECOUNT value on done: 1711.0 [2024-08-05 21:47:38,451][52659] Sum rewards: -1.928, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.477', 'AMMO4': '-0.084', 'AMMO2': '-0.017', 'ARMOR': '0.024', 'AMMO3': '0.154', 'HITCOUNT': '0.270', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.035', 'weapon3': '1.746', 'weapon2': '1.820', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:38,934][52669] DAMAGECOUNT value on done: 1467.0 [2024-08-05 21:47:38,934][52669] Sum rewards: -5.252, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.028', 'weapon5': '0.046', 'weapon4': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.209', 'weapon2': '1.516', 'weapon3': '2.162'} [2024-08-05 21:47:39,125][52660] DAMAGECOUNT value on done: 829.0 [2024-08-05 21:47:39,126][52660] Sum rewards: 0.557, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.040', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.278', 'DAMAGECOUNT': '0.747', 'WEAPON3': '0.750', 'weapon2': '1.282', 'FRAGCOUNT': '2.000', 'weapon3': '2.130'} [2024-08-05 21:47:39,339][52649] DAMAGECOUNT value on done: 1249.0 [2024-08-05 21:47:39,341][52649] Sum rewards: -0.399, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.905', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'ARMOR': '0.040', 'weapon7': '0.050', 'AMMO3': '0.085', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.717', 'weapon3': '1.338', 'weapon2': '1.622', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:39,714][52668] DAMAGECOUNT value on done: 1262.0 [2024-08-05 21:47:39,718][52668] Sum rewards: 1.226, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.046', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.392', 'ARMOR': '0.534', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.936', 'weapon2': '1.250', 'weapon3': '1.298', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:39,721][52667] DAMAGECOUNT value on done: 1212.0 [2024-08-05 21:47:39,724][52667] Sum rewards: -0.192, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.667', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.052', 'AMMO3': '0.065', 'HITCOUNT': '0.090', 'DAMAGECOUNT': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.896', 'FRAGCOUNT': '1.000', 'weapon3': '1.318'} [2024-08-05 21:47:39,971][52658] DAMAGECOUNT value on done: 1471.0 [2024-08-05 21:47:39,972][52658] Sum rewards: -1.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.522', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.024', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.173', 'HITCOUNT': '0.410', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.356', 'weapon2': '1.374', 'weapon3': '2.448', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:40,064][52647] DAMAGECOUNT value on done: 1424.0 [2024-08-05 21:47:40,065][52647] Sum rewards: -0.965, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.268', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon5': '0.172', 'weapon4': '0.174', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.954', 'FRAGCOUNT': '1.000', 'weapon2': '1.368', 'weapon3': '1.896'} [2024-08-05 21:47:40,121][52663] DAMAGECOUNT value on done: 1502.0 [2024-08-05 21:47:40,122][52663] Sum rewards: 3.381, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.331', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.008', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'HITCOUNT': '0.490', 'WEAPON3': '0.950', 'weapon2': '1.454', 'DAMAGECOUNT': '1.563', 'weapon3': '2.208', 'FRAGCOUNT': '6.000'} [2024-08-05 21:47:40,227][52664] DAMAGECOUNT value on done: 944.0 [2024-08-05 21:47:40,227][52664] Sum rewards: 2.506, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.455', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.073', 'HITCOUNT': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.256', 'DAMAGECOUNT': '0.372', 'WEAPON3': '0.400', 'ARMOR': '0.412', 'weapon2': '0.950', 'weapon3': '1.280', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:41,144][52671] DAMAGECOUNT value on done: 1147.0 [2024-08-05 21:47:41,144][52671] Sum rewards: 0.243, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.430', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.074', 'ARMOR': '0.080', 'HITCOUNT': '0.110', 'weapon4': '0.228', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.500', 'weapon3': '1.100', 'weapon2': '1.324', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:41,316][52659] DAMAGECOUNT value on done: 988.0 [2024-08-05 21:47:41,317][52659] Sum rewards: -1.063, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.056', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'ARMOR': '0.062', 'HITCOUNT': '0.090', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.750', 'weapon2': '1.456', 'weapon3': '1.936', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:41,741][52669] DAMAGECOUNT value on done: 1134.0 [2024-08-05 21:47:41,970][52650] Updated weights for policy 0, policy_version 2801 (0.0012) [2024-08-05 21:47:42,476][52660] DAMAGECOUNT value on done: 1118.0 [2024-08-05 21:47:42,477][52660] Sum rewards: -3.992, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.985', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.040', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'HITCOUNT': '0.280', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.528', 'weapon3': '2.010'} [2024-08-05 21:47:42,794][52567] Fps is (10 sec: 17204.0, 60 sec: 16930.1, 300 sec: 17106.0). Total num frames: 22962176. Throughput: 0: 4208.4. Samples: 5748830. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 21:47:42,794][52567] Avg episode reward: [(0, '0.072')] [2024-08-05 21:47:42,950][52668] DAMAGECOUNT value on done: 1242.0 [2024-08-05 21:47:42,950][52668] Sum rewards: -0.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.334', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.046', 'ARMOR': '0.052', 'AMMO4': '0.055', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.651', 'FRAGCOUNT': '1.000', 'weapon2': '1.442', 'weapon3': '1.606'} [2024-08-05 21:47:43,101][52667] DAMAGECOUNT value on done: 1734.0 [2024-08-05 21:47:43,103][52667] Sum rewards: 0.863, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.876', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.028', 'weapon4': '0.028', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.362', 'weapon2': '1.662', 'weapon3': '1.774', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:43,224][52663] DAMAGECOUNT value on done: 1173.0 [2024-08-05 21:47:43,226][52663] Sum rewards: 0.377, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.766', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'weapon3': '1.358', 'DAMAGECOUNT': '1.503', 'weapon2': '2.086', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:43,405][52647] DAMAGECOUNT value on done: 645.0 [2024-08-05 21:47:43,458][52658] DAMAGECOUNT value on done: 1524.0 [2024-08-05 21:47:43,522][52664] DAMAGECOUNT value on done: 1385.0 [2024-08-05 21:47:43,523][52664] Sum rewards: 0.317, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.010', 'AMMO2': '0.018', 'ARMOR': '0.063', 'AMMO4': '0.089', 'AMMO3': '0.121', 'HITCOUNT': '0.180', 'weapon4': '0.184', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.678', 'WEAPON3': '0.750', 'weapon2': '1.304', 'FRAGCOUNT': '2.000', 'weapon3': '2.240'} [2024-08-05 21:47:43,914][52671] DAMAGECOUNT value on done: 1050.0 [2024-08-05 21:47:43,915][52671] Sum rewards: -3.888, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.651', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'HITCOUNT': '0.160', 'weapon5': '0.398', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.800', 'weapon3': '1.554', 'weapon2': '1.690'} [2024-08-05 21:47:44,103][52659] DAMAGECOUNT value on done: 870.0 [2024-08-05 21:47:44,105][52659] Sum rewards: 1.700, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.524', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.222', 'WEAPON3': '0.450', 'ARMOR': '0.577', 'DAMAGECOUNT': '0.705', 'weapon3': '1.174', 'weapon2': '1.190', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:44,838][52669] DAMAGECOUNT value on done: 1713.0 [2024-08-05 21:47:44,839][52669] Sum rewards: -4.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.142', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.181', 'HITCOUNT': '0.360', 'ARMOR': '0.489', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.320', 'weapon2': '1.618', 'FRAGCOUNT': '2.000', 'weapon3': '2.172'} [2024-08-05 21:47:45,309][52660] DAMAGECOUNT value on done: 1380.0 [2024-08-05 21:47:45,311][52660] Sum rewards: 1.232, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.149', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.048', 'AMMO3': '0.060', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'ARMOR': '0.973', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.068', 'weapon3': '1.338', 'weapon2': '1.860'} [2024-08-05 21:47:45,909][52667] DAMAGECOUNT value on done: 1642.0 [2024-08-05 21:47:45,912][52667] Sum rewards: 0.174, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.090', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'weapon4': '0.038', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.197', 'weapon3': '1.358', 'weapon2': '1.512'} [2024-08-05 21:47:45,929][52668] DAMAGECOUNT value on done: 1369.0 [2024-08-05 21:47:45,929][52668] Sum rewards: 1.413, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.070', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.040', 'AMMO3': '0.070', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.532', 'WEAPON3': '0.600', 'weapon2': '0.632', 'DAMAGECOUNT': '0.720', 'weapon3': '1.360', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:46,107][52650] Updated weights for policy 0, policy_version 2811 (0.0021) [2024-08-05 21:47:46,286][52658] DAMAGECOUNT value on done: 1279.0 [2024-08-05 21:47:46,289][52658] Sum rewards: 0.089, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.400', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.048', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'weapon4': '0.194', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon3': '1.466', 'weapon2': '1.710'} [2024-08-05 21:47:46,307][52663] DAMAGECOUNT value on done: 1148.0 [2024-08-05 21:47:46,330][52647] DAMAGECOUNT value on done: 1174.0 [2024-08-05 21:47:46,330][52647] Sum rewards: -0.244, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.650', 'AMMO4': '-0.102', 'AMMO2': '-0.020', 'ARMOR': '0.064', 'AMMO3': '0.112', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.474', 'WEAPON3': '0.750', 'weapon3': '1.602', 'weapon2': '1.616', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:46,497][52664] DAMAGECOUNT value on done: 994.0 [2024-08-05 21:47:46,499][52664] Sum rewards: -0.260, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.122', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.008', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.286', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.837', 'FRAGCOUNT': '1.000', 'ARMOR': '1.022', 'weapon2': '1.474', 'weapon3': '1.630'} [2024-08-05 21:47:46,881][52671] DAMAGECOUNT value on done: 1326.0 [2024-08-05 21:47:46,883][52671] Sum rewards: 3.335, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.460', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'weapon4': '0.184', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.354', 'DAMAGECOUNT': '1.878', 'weapon3': '2.024', 'FRAGCOUNT': '5.000'} [2024-08-05 21:47:47,108][52659] DAMAGECOUNT value on done: 1072.0 [2024-08-05 21:47:47,109][52659] Sum rewards: -0.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.575', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.141', 'HITCOUNT': '0.400', 'ARMOR': '0.501', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.470', 'weapon2': '1.564', 'weapon3': '2.176', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:47,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16793.6, 300 sec: 17106.0). Total num frames: 23044096. Throughput: 0: 4205.3. Samples: 5761550. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:47:47,795][52567] Avg episode reward: [(0, '-0.007')] [2024-08-05 21:47:48,438][52660] DAMAGECOUNT value on done: 922.0 [2024-08-05 21:47:48,438][52660] Sum rewards: 3.820, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.040', 'HEALTH': '0.045', 'ARMOR': '0.060', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'HITCOUNT': '0.230', 'weapon4': '0.344', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.005', 'weapon2': '1.254', 'weapon3': '1.904', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:49,082][52667] DAMAGECOUNT value on done: 1508.0 [2024-08-05 21:47:49,083][52667] Sum rewards: 2.189, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.065', 'weapon7': '0.090', 'AMMO3': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON7': '0.200', 'weapon4': '0.460', 'WEAPON3': '0.650', 'weapon2': '0.746', 'DAMAGECOUNT': '0.795', 'weapon3': '1.576', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:49,092][52668] DAMAGECOUNT value on done: 1082.0 [2024-08-05 21:47:49,095][52668] Sum rewards: -0.891, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.136', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.160', 'HITCOUNT': '0.170', 'ARMOR': '0.469', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.567', 'weapon3': '1.158', 'weapon2': '1.902', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:49,102][52663] DAMAGECOUNT value on done: 877.0 [2024-08-05 21:47:49,102][52663] Sum rewards: -2.481, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.338', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.020', 'AMMO3': '0.121', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.130', 'weapon2': '1.922'} [2024-08-05 21:47:49,194][52647] DAMAGECOUNT value on done: 1488.0 [2024-08-05 21:47:49,196][52647] Sum rewards: -1.905, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.671', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon4': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon2': '1.456', 'weapon3': '1.670'} [2024-08-05 21:47:49,348][52671] DAMAGECOUNT value on done: 856.0 [2024-08-05 21:47:49,349][52671] Sum rewards: -1.342, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.702', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.022', 'ARMOR': '0.028', 'HITCOUNT': '0.080', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.222', 'weapon4': '0.412', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.036', 'weapon3': '1.498'} [2024-08-05 21:47:49,396][52658] DAMAGECOUNT value on done: 454.0 [2024-08-05 21:47:49,398][52658] Sum rewards: 0.308, reward structure: {'DEATHCOUNT': '-5.250', 'weapon4': '0.002', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.061', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.120', 'HEALTH': '0.150', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.226', 'weapon2': '1.282'} [2024-08-05 21:47:49,428][52664] DAMAGECOUNT value on done: 1225.0 [2024-08-05 21:47:49,428][52664] Sum rewards: 2.780, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.032', 'weapon5': '0.070', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon4': '0.262', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.146', 'weapon2': '1.408', 'weapon3': '1.570', 'FRAGCOUNT': '5.000'} [2024-08-05 21:47:49,507][52659] DAMAGECOUNT value on done: 1623.0 [2024-08-05 21:47:49,507][52659] Sum rewards: 1.050, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.493', 'AMMO2': '0.030', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'HITCOUNT': '0.330', 'weapon4': '0.370', 'WEAPON3': '0.750', 'ARMOR': '0.934', 'DAMAGECOUNT': '1.140', 'weapon2': '1.256', 'weapon3': '1.806', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:51,230][52660] DAMAGECOUNT value on done: 1170.0 [2024-08-05 21:47:51,231][52660] Sum rewards: 2.989, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.015', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.073', 'AMMO3': '0.094', 'HEALTH': '0.147', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.882', 'weapon3': '1.378', 'weapon2': '2.274', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:51,308][52650] Updated weights for policy 0, policy_version 2821 (0.0025) [2024-08-05 21:47:51,975][52668] DAMAGECOUNT value on done: 987.0 [2024-08-05 21:47:51,975][52668] Sum rewards: 2.175, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'weapon5': '0.104', 'AMMO4': '0.121', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.735', 'HEALTH': '0.834', 'FRAGCOUNT': '1.000', 'weapon3': '1.122', 'weapon2': '2.016'} [2024-08-05 21:47:52,215][52671] DAMAGECOUNT value on done: 1945.0 [2024-08-05 21:47:52,222][52671] Sum rewards: -2.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.808', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon5': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'HITCOUNT': '0.250', 'ARMOR': '0.877', 'DAMAGECOUNT': '0.915', 'WEAPON3': '1.100', 'weapon2': '1.388', 'weapon3': '2.158', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:52,300][52663] DAMAGECOUNT value on done: 706.0 [2024-08-05 21:47:52,463][52664] DAMAGECOUNT value on done: 1308.0 [2024-08-05 21:47:52,484][52659] DAMAGECOUNT value on done: 1089.0 [2024-08-05 21:47:52,572][52658] DAMAGECOUNT value on done: 1514.0 [2024-08-05 21:47:52,572][52658] Sum rewards: -3.054, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.842', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.122', 'HITCOUNT': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.856', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.432', 'weapon3': '1.658'} [2024-08-05 21:47:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 17078.2). Total num frames: 23134208. Throughput: 0: 4202.4. Samples: 5787210. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-05 21:47:52,794][52567] Avg episode reward: [(0, '-0.001')] [2024-08-05 21:47:53,244][52794] DAMAGECOUNT value on done: 1004.0 [2024-08-05 21:47:53,245][52794] Sum rewards: 0.206, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.804', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.070', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.792', 'weapon3': '1.020', 'FRAGCOUNT': '2.000', 'weapon2': '2.112'} [2024-08-05 21:47:54,888][52660] DAMAGECOUNT value on done: 1100.0 [2024-08-05 21:47:54,888][52660] Sum rewards: 3.296, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.121', 'HITCOUNT': '0.480', 'ARMOR': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.594', 'DAMAGECOUNT': '1.836', 'weapon3': '1.934', 'FRAGCOUNT': '6.000'} [2024-08-05 21:47:55,116][52671] DAMAGECOUNT value on done: 1522.0 [2024-08-05 21:47:55,116][52671] Sum rewards: -4.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.948', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.182', 'HITCOUNT': '0.480', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.624', 'DAMAGECOUNT': '1.635', 'weapon3': '1.938'} [2024-08-05 21:47:55,313][52659] DAMAGECOUNT value on done: 1288.0 [2024-08-05 21:47:55,315][52659] Sum rewards: 2.915, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.198', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'ARMOR': '0.056', 'AMMO3': '0.060', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.418', 'DAMAGECOUNT': '1.122', 'weapon2': '1.262', 'weapon3': '1.400', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:55,400][52658] DAMAGECOUNT value on done: 1201.0 [2024-08-05 21:47:55,400][52658] Sum rewards: 0.167, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.350', 'AMMO2': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'WEAPON5': '0.050', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.230', 'ARMOR': '0.489', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.850', 'weapon2': '1.724', 'weapon3': '1.974', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:55,426][52664] DAMAGECOUNT value on done: 930.0 [2024-08-05 21:47:55,428][52664] Sum rewards: -3.473, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.518', 'AMMO2': '0.023', 'AMMO4': '0.116', 'HITCOUNT': '0.130', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.300', 'ARMOR': '0.405', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.084', 'weapon3': '2.022'} [2024-08-05 21:47:55,558][52668] DAMAGECOUNT value on done: 1343.0 [2024-08-05 21:47:55,558][52668] Sum rewards: 1.502, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO2': '0.007', 'AMMO4': '0.035', 'ARMOR': '0.056', 'AMMO3': '0.106', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.275', 'weapon2': '1.494', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'} [2024-08-05 21:47:55,992][52794] DAMAGECOUNT value on done: 1264.0 [2024-08-05 21:47:55,997][52794] Sum rewards: -2.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.778', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.501', 'weapon5': '0.528', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.260', 'weapon2': '1.846'} [2024-08-05 21:47:56,202][52650] Updated weights for policy 0, policy_version 2831 (0.0020) [2024-08-05 21:47:56,342][52662] DAMAGECOUNT value on done: 1016.0 [2024-08-05 21:47:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 17050.5). Total num frames: 23216128. Throughput: 0: 4215.8. Samples: 5812780. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:47:57,795][52567] Avg episode reward: [(0, '-0.146')] [2024-08-05 21:47:58,093][52664] DAMAGECOUNT value on done: 1405.0 [2024-08-05 21:47:58,094][52664] Sum rewards: 0.846, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.642', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.044', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'HITCOUNT': '0.410', 'ARMOR': '0.527', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.368', 'weapon2': '1.504', 'weapon3': '1.978', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:58,099][52660] DAMAGECOUNT value on done: 1183.0 [2024-08-05 21:47:58,101][52660] Sum rewards: 4.330, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.916', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.028', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.141', 'HITCOUNT': '0.430', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.578', 'weapon2': '1.870', 'weapon3': '1.896', 'FRAGCOUNT': '8.000'} [2024-08-05 21:47:58,365][52671] DAMAGECOUNT value on done: 1253.0 [2024-08-05 21:47:58,367][52671] Sum rewards: 0.530, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.072', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon5': '0.088', 'AMMO3': '0.090', 'HITCOUNT': '0.170', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.486', 'WEAPON3': '0.550', 'weapon3': '1.388', 'weapon2': '1.944', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:58,456][52794] DAMAGECOUNT value on done: 1390.0 [2024-08-05 21:47:58,456][52794] Sum rewards: 1.798, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.026', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.080', 'HITCOUNT': '0.240', 'ARMOR': '0.429', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.705', 'weapon3': '1.418', 'weapon2': '1.658', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:58,636][52662] DAMAGECOUNT value on done: 1412.0 [2024-08-05 21:47:58,636][52662] Sum rewards: 2.852, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.063', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.240', 'ARMOR': '0.518', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.930', 'weapon2': '1.314', 'weapon3': '1.520', 'FRAGCOUNT': '4.000'} [2024-08-05 21:47:58,660][52659] DAMAGECOUNT value on done: 1601.0 [2024-08-05 21:47:58,661][52659] Sum rewards: 0.518, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'AMMO2': '0.004', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.021', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.885', 'weapon3': '1.712', 'weapon2': '1.976', 'FRAGCOUNT': '2.000'} [2024-08-05 21:47:58,687][52668] DAMAGECOUNT value on done: 983.0 [2024-08-05 21:48:00,719][52664] DAMAGECOUNT value on done: 778.0 [2024-08-05 21:48:00,719][52664] Sum rewards: -1.057, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.060', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.226', 'DAMAGECOUNT': '0.237', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.322', 'weapon2': '1.580'} [2024-08-05 21:48:00,792][52650] Updated weights for policy 0, policy_version 2841 (0.0011) [2024-08-05 21:48:00,973][52660] DAMAGECOUNT value on done: 1293.0 [2024-08-05 21:48:00,974][52660] Sum rewards: 2.616, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.083', 'HEALTH': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.236', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.492', 'ARMOR': '0.505', 'weapon2': '1.370', 'weapon3': '1.512', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:01,104][52794] DAMAGECOUNT value on done: 1188.0 [2024-08-05 21:48:01,104][52794] Sum rewards: -2.544, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.723', 'AMMO2': '0.013', 'AMMO4': '0.067', 'ARMOR': '0.080', 'AMMO3': '0.090', 'weapon6': '0.096', 'HITCOUNT': '0.190', 'AMMO6': '0.191', 'AMMO7': '0.191', 'WEAPON6': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'weapon2': '1.238', 'weapon3': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:01,279][52662] DAMAGECOUNT value on done: 1163.0 [2024-08-05 21:48:01,449][52671] DAMAGECOUNT value on done: 1985.0 [2024-08-05 21:48:01,451][52671] Sum rewards: 0.924, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.860', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.220', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'weapon3': '1.784', 'weapon2': '1.896', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:01,610][52668] DAMAGECOUNT value on done: 1538.0 [2024-08-05 21:48:01,610][52668] Sum rewards: 0.294, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.103', 'AMMO4': '0.104', 'HITCOUNT': '0.260', 'WEAPON3': '0.550', 'HEALTH': '0.766', 'DAMAGECOUNT': '0.975', 'weapon2': '1.548', 'FRAGCOUNT': '2.000', 'weapon3': '2.020'} [2024-08-05 21:48:01,617][52659] DAMAGECOUNT value on done: 1103.0 [2024-08-05 21:48:01,617][52659] Sum rewards: 0.257, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.810', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.050', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'weapon3': '1.256', 'weapon2': '1.474', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.1, 300 sec: 17050.5). Total num frames: 23306240. Throughput: 0: 4222.0. Samples: 5825700. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:48:02,795][52567] Avg episode reward: [(0, '-0.250')] [2024-08-05 21:48:03,685][52664] DAMAGECOUNT value on done: 1179.0 [2024-08-05 21:48:03,687][52664] Sum rewards: -0.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.838', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'ARMOR': '0.028', 'weapon5': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.280', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.134', 'weapon2': '1.334', 'weapon3': '1.720', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:03,695][52794] DAMAGECOUNT value on done: 1665.0 [2024-08-05 21:48:03,695][52794] Sum rewards: -1.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.131', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.138', 'HITCOUNT': '0.300', 'ARMOR': '0.457', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.050', 'weapon3': '1.588', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:03,926][52662] DAMAGECOUNT value on done: 1020.0 [2024-08-05 21:48:03,927][52662] Sum rewards: -0.483, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'weapon4': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon5': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'weapon3': '1.572', 'weapon2': '1.744', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:03,941][52660] DAMAGECOUNT value on done: 1084.0 [2024-08-05 21:48:03,941][52660] Sum rewards: 0.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.186', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.081', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.759', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.294'} [2024-08-05 21:48:04,600][52671] DAMAGECOUNT value on done: 1290.0 [2024-08-05 21:48:04,602][52671] Sum rewards: 1.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.678', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.140', 'weapon4': '0.204', 'DAMAGECOUNT': '0.390', 'WEAPON3': '0.600', 'weapon2': '1.500', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:04,607][52668] DAMAGECOUNT value on done: 1466.0 [2024-08-05 21:48:04,609][52668] Sum rewards: -1.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.438', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.026', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.154', 'weapon4': '0.158', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.900', 'weapon2': '1.312', 'DAMAGECOUNT': '1.350', 'weapon3': '2.266', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:04,880][52659] DAMAGECOUNT value on done: 1378.0 [2024-08-05 21:48:04,882][52659] Sum rewards: -0.823, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.356', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon3': '1.252', 'ARMOR': '1.300', 'weapon2': '1.654'} [2024-08-05 21:48:05,446][52650] Updated weights for policy 0, policy_version 2851 (0.0026) [2024-08-05 21:48:06,146][52794] DAMAGECOUNT value on done: 1504.0 [2024-08-05 21:48:06,154][52794] Sum rewards: 0.891, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.577', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.113', 'weapon4': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.837', 'weapon2': '1.418', 'FRAGCOUNT': '2.000', 'weapon3': '2.082'} [2024-08-05 21:48:06,323][52662] DAMAGECOUNT value on done: 1348.0 [2024-08-05 21:48:06,323][52662] Sum rewards: 1.635, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.068', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.118', 'HEALTH': '0.177', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'ARMOR': '0.532', 'DAMAGECOUNT': '0.606', 'weapon3': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.462'} [2024-08-05 21:48:06,432][52666] DAMAGECOUNT value on done: 843.0 [2024-08-05 21:48:06,627][52664] DAMAGECOUNT value on done: 1705.0 [2024-08-05 21:48:06,627][52664] Sum rewards: -1.976, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.434', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon7': '0.104', 'AMMO3': '0.135', 'HITCOUNT': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon4': '0.356', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.800', 'ARMOR': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.236', 'weapon3': '1.352'} [2024-08-05 21:48:06,758][52660] DAMAGECOUNT value on done: 1380.0 [2024-08-05 21:48:06,760][52660] Sum rewards: 0.524, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.099', 'weapon4': '0.144', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'weapon2': '1.436', 'weapon3': '1.926', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:06,815][52614] Signal inference workers to stop experience collection... (500 times) [2024-08-05 21:48:06,822][52614] Signal inference workers to resume experience collection... (500 times) [2024-08-05 21:48:06,893][52650] InferenceWorker_p0-w0: stopping experience collection (500 times) [2024-08-05 21:48:06,894][52650] InferenceWorker_p0-w0: resuming experience collection (500 times) [2024-08-05 21:48:07,458][52668] DAMAGECOUNT value on done: 1279.0 [2024-08-05 21:48:07,461][52668] Sum rewards: 3.438, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.730', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.224', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.422', 'weapon2': '1.636', 'weapon3': '1.654', 'FRAGCOUNT': '5.000'} [2024-08-05 21:48:07,655][52671] DAMAGECOUNT value on done: 1298.0 [2024-08-05 21:48:07,656][52671] Sum rewards: 1.661, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.934', 'AMMO2': '0.002', 'ARMOR': '0.008', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.206', 'weapon2': '1.428', 'weapon3': '2.094', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 23388160. Throughput: 0: 4236.9. Samples: 5851500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:48:07,794][52567] Avg episode reward: [(0, '-0.071')] [2024-08-05 21:48:07,894][52659] DAMAGECOUNT value on done: 1414.0 [2024-08-05 21:48:07,894][52659] Sum rewards: -0.028, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.291', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.032', 'AMMO3': '0.128', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.484', 'weapon3': '2.108'} [2024-08-05 21:48:08,939][52794] DAMAGECOUNT value on done: 859.0 [2024-08-05 21:48:08,942][52794] Sum rewards: -0.836, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.251', 'AMMO2': '0.025', 'AMMO3': '0.093', 'AMMO4': '0.122', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.324', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'ARMOR': '0.940', 'FRAGCOUNT': '1.000', 'weapon2': '1.068', 'weapon3': '1.208'} [2024-08-05 21:48:09,121][52662] DAMAGECOUNT value on done: 1723.0 [2024-08-05 21:48:09,123][52662] Sum rewards: 2.910, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.060', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.044', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'ARMOR': '0.457', 'weapon3': '0.688', 'weapon2': '1.214', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:09,301][52670] DAMAGECOUNT value on done: 1321.0 [2024-08-05 21:48:09,302][52670] Sum rewards: 0.881, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.629', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.114', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'ARMOR': '0.851', 'DAMAGECOUNT': '1.041', 'weapon2': '1.564', 'weapon3': '1.652', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:09,532][52666] DAMAGECOUNT value on done: 1446.0 [2024-08-05 21:48:09,534][52666] Sum rewards: 2.578, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.640', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.158', 'HITCOUNT': '0.470', 'WEAPON3': '0.750', 'weapon2': '1.288', 'DAMAGECOUNT': '1.683', 'weapon3': '2.032', 'FRAGCOUNT': '5.000'} [2024-08-05 21:48:09,698][52660] DAMAGECOUNT value on done: 1439.0 [2024-08-05 21:48:09,698][52660] Sum rewards: -0.126, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'ARMOR': '0.072', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.326', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.065', 'weapon2': '1.178', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:10,322][52650] Updated weights for policy 0, policy_version 2861 (0.0011) [2024-08-05 21:48:10,473][52668] DAMAGECOUNT value on done: 1121.0 [2024-08-05 21:48:10,474][52668] Sum rewards: -2.025, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO2': '0.002', 'ARMOR': '0.008', 'AMMO4': '0.011', 'AMMO3': '0.120', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.627', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.600', 'weapon3': '1.726'} [2024-08-05 21:48:10,486][52671] DAMAGECOUNT value on done: 991.0 [2024-08-05 21:48:10,488][52671] Sum rewards: -2.585, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.838', 'AMMO2': '0.003', 'AMMO4': '0.017', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.122', 'AMMO3': '0.128', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.356', 'weapon3': '1.720'} [2024-08-05 21:48:10,732][52659] DAMAGECOUNT value on done: 2387.0 [2024-08-05 21:48:10,734][52659] Sum rewards: 2.742, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.334', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.077', 'weapon4': '0.114', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.633', 'weapon3': '1.326', 'weapon2': '1.560', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:11,347][52794] DAMAGECOUNT value on done: 1329.0 [2024-08-05 21:48:11,355][52794] Sum rewards: -4.144, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HEALTH': '0.054', 'AMMO4': '0.054', 'weapon4': '0.060', 'AMMO3': '0.113', 'HITCOUNT': '0.220', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.700', 'weapon5': '0.714', 'FRAGCOUNT': '1.000', 'weapon3': '1.362', 'weapon2': '1.700'} [2024-08-05 21:48:11,655][52662] DAMAGECOUNT value on done: 1694.0 [2024-08-05 21:48:12,236][52670] DAMAGECOUNT value on done: 1224.0 [2024-08-05 21:48:12,236][52670] Sum rewards: 0.469, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.056', 'AMMO2': '0.019', 'AMMO3': '0.086', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'HITCOUNT': '0.250', 'weapon4': '0.336', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.831', 'weapon3': '1.402', 'weapon2': '1.404', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:12,482][52666] DAMAGECOUNT value on done: 1236.0 [2024-08-05 21:48:12,484][52666] Sum rewards: -0.858, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.348', 'AMMO5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.050', 'AMMO4': '0.056', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.903', 'WEAPON3': '1.000', 'weapon2': '1.714', 'weapon3': '1.882', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.6, 300 sec: 17050.5). Total num frames: 23478272. Throughput: 0: 4246.2. Samples: 5876990. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 21:48:12,795][52567] Avg episode reward: [(0, '-0.170')] [2024-08-05 21:48:13,117][52660] DAMAGECOUNT value on done: 1571.0 [2024-08-05 21:48:13,118][52660] Sum rewards: 0.296, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.544', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.120', 'weapon4': '0.168', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'ARMOR': '0.919', 'DAMAGECOUNT': '1.176', 'weapon2': '1.354', 'weapon3': '1.836', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:13,552][52671] DAMAGECOUNT value on done: 812.0 [2024-08-05 21:48:13,554][52671] Sum rewards: 0.438, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.244', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.200', 'ARMOR': '0.486', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.354', 'weapon3': '1.616', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:13,772][52659] DAMAGECOUNT value on done: 1160.0 [2024-08-05 21:48:13,772][52659] Sum rewards: 2.730, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.002', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.080', 'HITCOUNT': '0.150', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.630', 'weapon2': '1.162', 'weapon3': '1.418', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:13,818][52668] DAMAGECOUNT value on done: 1117.0 [2024-08-05 21:48:13,818][52668] Sum rewards: -2.658, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.984', 'AMMO2': '0.012', 'AMMO4': '0.061', 'ARMOR': '0.076', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'weapon4': '0.350', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.963', 'FRAGCOUNT': '1.000', 'weapon2': '1.484', 'weapon3': '1.932'} [2024-08-05 21:48:14,221][52794] DAMAGECOUNT value on done: 1545.0 [2024-08-05 21:48:14,221][52794] Sum rewards: 1.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.456', 'AMMO2': '0.022', 'weapon4': '0.032', 'ARMOR': '0.056', 'weapon7': '0.068', 'AMMO3': '0.107', 'AMMO4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'weapon3': '1.172', 'DAMAGECOUNT': '1.221', 'weapon2': '1.662', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:14,548][52662] DAMAGECOUNT value on done: 1431.0 [2024-08-05 21:48:14,548][52662] Sum rewards: -0.039, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.365', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.099', 'weapon4': '0.218', 'WEAPON4': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.537', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.155', 'weapon2': '1.614', 'weapon3': '1.856', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:15,006][52650] Updated weights for policy 0, policy_version 2871 (0.0011) [2024-08-05 21:48:15,681][52670] DAMAGECOUNT value on done: 1307.0 [2024-08-05 21:48:15,682][52670] Sum rewards: -0.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.929', 'AMMO2': '0.002', 'weapon4': '0.008', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.350', 'ARMOR': '0.558', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.646', 'weapon3': '2.084', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:15,901][52666] DAMAGECOUNT value on done: 1188.0 [2024-08-05 21:48:15,905][52666] Sum rewards: -0.801, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.610', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.407', 'weapon2': '1.540', 'weapon3': '1.638', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:16,168][52671] DAMAGECOUNT value on done: 1540.0 [2024-08-05 21:48:16,168][52671] Sum rewards: 2.149, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.036', 'weapon4': '0.132', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '1.000', 'weapon2': '1.286', 'DAMAGECOUNT': '1.485', 'weapon3': '2.186', 'FRAGCOUNT': '6.000'} [2024-08-05 21:48:16,173][52660] DAMAGECOUNT value on done: 1233.0 [2024-08-05 21:48:16,174][52660] Sum rewards: -2.053, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.362', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.201', 'HITCOUNT': '0.380', 'ARMOR': '0.948', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.425', 'weapon2': '1.698', 'weapon3': '1.990', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:16,559][52659] DAMAGECOUNT value on done: 1719.0 [2024-08-05 21:48:16,569][52659] Sum rewards: 0.518, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.508', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon5': '0.038', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.876', 'weapon2': '1.258', 'weapon3': '1.750', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:16,803][52794] DAMAGECOUNT value on done: 1259.0 [2024-08-05 21:48:16,805][52794] Sum rewards: 1.250, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.310', 'AMMO2': '0.009', 'AMMO4': '0.047', 'ARMOR': '0.048', 'AMMO3': '0.080', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.810', 'weapon3': '1.222', 'weapon2': '1.864', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:16,878][52668] DAMAGECOUNT value on done: 1016.0 [2024-08-05 21:48:16,878][52668] Sum rewards: 0.519, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.433', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'ARMOR': '0.020', 'AMMO3': '0.116', 'HITCOUNT': '0.280', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.837', 'weapon2': '1.682', 'weapon3': '1.988', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:17,048][52662] DAMAGECOUNT value on done: 1378.0 [2024-08-05 21:48:17,050][52662] Sum rewards: 0.806, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.198', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.046', 'AMMO3': '0.071', 'weapon7': '0.082', 'ARMOR': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.600', 'weapon2': '0.670', 'DAMAGECOUNT': '0.696', 'FRAGCOUNT': '1.000', 'weapon3': '1.742'} [2024-08-05 21:48:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 17050.5). Total num frames: 23560192. Throughput: 0: 4251.6. Samples: 5889810. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:48:17,795][52567] Avg episode reward: [(0, '-0.088')] [2024-08-05 21:48:18,566][52671] DAMAGECOUNT value on done: 2146.0 [2024-08-05 21:48:18,568][52671] Sum rewards: -1.730, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.468', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.086', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.720', 'weapon3': '0.928', 'FRAGCOUNT': '1.000', 'weapon2': '1.328'} [2024-08-05 21:48:18,769][52659] DAMAGECOUNT value on done: 1441.0 [2024-08-05 21:48:18,770][52659] Sum rewards: -2.539, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.972', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.149', 'HITCOUNT': '0.350', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.248', 'weapon2': '1.706', 'weapon3': '1.990'} [2024-08-05 21:48:19,132][52794] DAMAGECOUNT value on done: 1171.0 [2024-08-05 21:48:19,132][52794] Sum rewards: 0.660, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.191', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.020', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.144', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.644', 'weapon3': '1.696', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:19,355][52670] DAMAGECOUNT value on done: 1410.0 [2024-08-05 21:48:19,356][52670] Sum rewards: -0.221, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.129', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.104', 'HITCOUNT': '0.330', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.670', 'weapon3': '1.812'} [2024-08-05 21:48:19,368][52660] DAMAGECOUNT value on done: 1200.0 [2024-08-05 21:48:19,371][52660] Sum rewards: -2.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.436', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.140', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.362', 'weapon3': '1.778'} [2024-08-05 21:48:19,651][52666] DAMAGECOUNT value on done: 1135.0 [2024-08-05 21:48:19,652][52666] Sum rewards: -1.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.124', 'weapon4': '0.008', 'AMMO2': '0.014', 'ARMOR': '0.068', 'AMMO4': '0.072', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.963', 'FRAGCOUNT': '1.000', 'weapon2': '1.614', 'weapon3': '1.816'} [2024-08-05 21:48:19,768][52662] DAMAGECOUNT value on done: 1306.0 [2024-08-05 21:48:20,060][52650] Updated weights for policy 0, policy_version 2881 (0.0032) [2024-08-05 21:48:21,419][52671] DAMAGECOUNT value on done: 1176.0 [2024-08-05 21:48:21,421][52671] Sum rewards: 0.969, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.569', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO3': '0.099', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.344', 'weapon2': '1.722', 'weapon3': '1.754', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:21,698][52659] DAMAGECOUNT value on done: 1245.0 [2024-08-05 21:48:21,805][52794] DAMAGECOUNT value on done: 1403.0 [2024-08-05 21:48:21,808][52794] Sum rewards: 4.868, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.210', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.058', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'weapon3': '0.826', 'ARMOR': '0.899', 'DAMAGECOUNT': '1.269', 'weapon2': '1.800', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:22,217][52662] DAMAGECOUNT value on done: 1548.0 [2024-08-05 21:48:22,218][52662] Sum rewards: 2.110, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.057', 'ARMOR': '0.077', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.284', 'weapon2': '1.460', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:22,724][52670] DAMAGECOUNT value on done: 1177.0 [2024-08-05 21:48:22,727][52670] Sum rewards: -1.882, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.382', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.136', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.810', 'WEAPON3': '0.850', 'ARMOR': '0.912', 'weapon2': '1.526', 'FRAGCOUNT': '2.000', 'weapon3': '2.098'} [2024-08-05 21:48:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 23650304. Throughput: 0: 4260.2. Samples: 5915280. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:48:22,794][52567] Avg episode reward: [(0, '-0.009')] [2024-08-05 21:48:22,950][52666] DAMAGECOUNT value on done: 1549.0 [2024-08-05 21:48:22,950][52666] Sum rewards: 1.114, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.611', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.092', 'weapon4': '0.194', 'HITCOUNT': '0.370', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.182', 'weapon3': '1.648', 'weapon2': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:24,581][52794] DAMAGECOUNT value on done: 1181.0 [2024-08-05 21:48:24,581][52794] Sum rewards: -2.615, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.435', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.036', 'AMMO3': '0.109', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'weapon5': '0.250', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.242', 'weapon3': '1.730'} [2024-08-05 21:48:24,647][52671] DAMAGECOUNT value on done: 1381.0 [2024-08-05 21:48:24,648][52671] Sum rewards: -0.109, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.708', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.106', 'HITCOUNT': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.948', 'weapon2': '1.570', 'weapon3': '1.876', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:24,835][52650] Updated weights for policy 0, policy_version 2891 (0.0026) [2024-08-05 21:48:25,064][52662] DAMAGECOUNT value on done: 1419.0 [2024-08-05 21:48:25,064][52662] Sum rewards: 3.998, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.313', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.170', 'WEAPON3': '0.250', 'HITCOUNT': '0.380', 'ARMOR': '0.440', 'weapon3': '0.696', 'DAMAGECOUNT': '1.260', 'weapon2': '1.710', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:25,065][52659] DAMAGECOUNT value on done: 1351.0 [2024-08-05 21:48:25,066][52659] Sum rewards: 1.975, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.714', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'ARMOR': '0.032', 'AMMO3': '0.063', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.293', 'weapon3': '1.396', 'weapon2': '1.564', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:25,686][52670] DAMAGECOUNT value on done: 1535.0 [2024-08-05 21:48:25,686][52670] Sum rewards: -1.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.570', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'ARMOR': '0.028', 'AMMO3': '0.155', 'HITCOUNT': '0.480', 'WEAPON3': '1.150', 'weapon2': '1.454', 'DAMAGECOUNT': '1.851', 'weapon3': '1.984', 'FRAGCOUNT': '5.000'} [2024-08-05 21:48:25,849][52666] DAMAGECOUNT value on done: 1398.0 [2024-08-05 21:48:25,850][52666] Sum rewards: -4.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.046', 'ARMOR': '0.052', 'AMMO4': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.981', 'WEAPON3': '1.200', 'weapon2': '1.412', 'weapon3': '2.370', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:27,090][52794] DAMAGECOUNT value on done: 2116.0 [2024-08-05 21:48:27,099][52794] Sum rewards: -0.428, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.778', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.533', 'weapon2': '1.544', 'weapon3': '2.116', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:27,497][52662] DAMAGECOUNT value on done: 998.0 [2024-08-05 21:48:27,499][52662] Sum rewards: -2.469, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.370', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.022', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.156', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.400', 'weapon3': '2.102'} [2024-08-05 21:48:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 17078.2). Total num frames: 23732224. Throughput: 0: 4268.6. Samples: 5940920. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:48:27,795][52567] Avg episode reward: [(0, '-0.128')] [2024-08-05 21:48:27,812][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002897_23732224.pth... [2024-08-05 21:48:28,025][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002397_19636224.pth [2024-08-05 21:48:28,071][52659] DAMAGECOUNT value on done: 1712.0 [2024-08-05 21:48:28,071][52659] Sum rewards: -0.845, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.345', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.028', 'ARMOR': '0.032', 'weapon4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.366', 'DAMAGECOUNT': '1.386', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:28,846][52670] DAMAGECOUNT value on done: 1292.0 [2024-08-05 21:48:28,846][52670] Sum rewards: -0.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.186', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.152', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '1.150', 'weapon2': '1.212', 'DAMAGECOUNT': '1.536', 'weapon3': '2.378', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:29,137][52666] DAMAGECOUNT value on done: 1024.0 [2024-08-05 21:48:29,139][52666] Sum rewards: -2.998, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.762', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.122', 'HITCOUNT': '0.220', 'ARMOR': '0.414', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.612', 'weapon3': '2.160'} [2024-08-05 21:48:29,798][52794] DAMAGECOUNT value on done: 1595.0 [2024-08-05 21:48:29,799][52794] Sum rewards: 3.169, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'AMMO5': '0.010', 'HEALTH': '0.024', 'weapon4': '0.042', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.144', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.937', 'DAMAGECOUNT': '0.990', 'weapon3': '1.298', 'weapon2': '1.884', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:29,957][52650] Updated weights for policy 0, policy_version 2901 (0.0023) [2024-08-05 21:48:30,145][52662] DAMAGECOUNT value on done: 1290.0 [2024-08-05 21:48:31,819][52670] DAMAGECOUNT value on done: 1098.0 [2024-08-05 21:48:31,820][52670] Sum rewards: 0.491, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.112', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'ARMOR': '0.804', 'DAMAGECOUNT': '1.089', 'weapon2': '1.214', 'weapon3': '1.436', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:32,087][52666] DAMAGECOUNT value on done: 1351.0 [2024-08-05 21:48:32,089][52666] Sum rewards: 4.854, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.326', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.156', 'HITCOUNT': '0.420', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'weapon3': '1.508', 'DAMAGECOUNT': '1.635', 'weapon2': '2.106', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:32,242][52794] DAMAGECOUNT value on done: 1420.0 [2024-08-05 21:48:32,242][52794] Sum rewards: -1.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.310', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.060', 'weapon5': '0.082', 'weapon7': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'HITCOUNT': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.044', 'weapon2': '1.082', 'weapon3': '1.764', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:32,525][52662] DAMAGECOUNT value on done: 1202.0 [2024-08-05 21:48:32,526][52662] Sum rewards: 0.029, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.258', 'AMMO5': '0.007', 'AMMO2': '0.027', 'ARMOR': '0.040', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO3': '0.133', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.140', 'weapon2': '1.442', 'weapon3': '1.956', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:32,794][52567] Fps is (10 sec: 15564.7, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 23805952. Throughput: 0: 4266.4. Samples: 5953540. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-05 21:48:32,795][52567] Avg episode reward: [(0, '-0.181')] [2024-08-05 21:48:34,242][52650] Updated weights for policy 0, policy_version 2911 (0.0014) [2024-08-05 21:48:35,029][52670] DAMAGECOUNT value on done: 510.0 [2024-08-05 21:48:35,040][52794] DAMAGECOUNT value on done: 1699.0 [2024-08-05 21:48:35,041][52794] Sum rewards: 1.818, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.395', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.115', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.230', 'weapon2': '1.304', 'weapon3': '1.912', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:35,375][52666] DAMAGECOUNT value on done: 1311.0 [2024-08-05 21:48:35,376][52666] Sum rewards: 3.000, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.338', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'ARMOR': '0.068', 'weapon5': '0.108', 'HITCOUNT': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.900', 'weapon3': '1.258', 'weapon2': '1.444', 'FRAGCOUNT': '2.500'} [2024-08-05 21:48:35,407][52662] DAMAGECOUNT value on done: 1666.0 [2024-08-05 21:48:35,410][52662] Sum rewards: 3.375, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.440', 'AMMO2': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.016', 'weapon5': '0.024', 'AMMO4': '0.038', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.208', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.572', 'weapon2': '1.636', 'weapon3': '2.014', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 23904256. Throughput: 0: 4273.3. Samples: 5979510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:48:37,794][52567] Avg episode reward: [(0, '-0.109')] [2024-08-05 21:48:37,982][52794] DAMAGECOUNT value on done: 1665.0 [2024-08-05 21:48:37,982][52794] Sum rewards: 0.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.202', 'HITCOUNT': '0.230', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.005', 'weapon2': '1.158', 'weapon3': '1.792', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:38,179][52670] DAMAGECOUNT value on done: 1212.0 [2024-08-05 21:48:38,181][52670] Sum rewards: -2.279, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.153', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.098', 'AMMO3': '0.119', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.750', 'ARMOR': '0.832', 'FRAGCOUNT': '1.000', 'weapon3': '1.784', 'weapon2': '1.984'} [2024-08-05 21:48:38,305][52662] DAMAGECOUNT value on done: 893.0 [2024-08-05 21:48:38,306][52662] Sum rewards: 2.792, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.068', 'weapon2': '1.150', 'weapon3': '1.222', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:38,403][52666] DAMAGECOUNT value on done: 1656.0 [2024-08-05 21:48:38,404][52666] Sum rewards: -0.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.822', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'HITCOUNT': '0.410', 'WEAPON3': '1.050', 'weapon2': '1.204', 'DAMAGECOUNT': '1.380', 'weapon3': '2.532', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:39,310][52650] Updated weights for policy 0, policy_version 2921 (0.0016) [2024-08-05 21:48:40,144][52794] DAMAGECOUNT value on done: 2121.0 [2024-08-05 21:48:40,144][52794] Sum rewards: -0.195, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.620', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.108', 'HITCOUNT': '0.340', 'ARMOR': '0.490', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.975', 'weapon3': '1.260', 'weapon2': '2.110', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:40,449][52662] DAMAGECOUNT value on done: 1693.0 [2024-08-05 21:48:40,449][52662] Sum rewards: -0.622, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'weapon7': '0.088', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.114', 'HITCOUNT': '0.230', 'weapon4': '0.242', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.672', 'weapon3': '1.632', 'weapon2': '1.730', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:41,485][52670] DAMAGECOUNT value on done: 1613.0 [2024-08-05 21:48:41,485][52670] Sum rewards: -0.937, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.916', 'AMMO2': '0.013', 'ARMOR': '0.037', 'AMMO4': '0.066', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.720', 'weapon2': '1.708', 'weapon3': '1.760', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:41,637][52666] DAMAGECOUNT value on done: 1200.0 [2024-08-05 21:48:41,637][52666] Sum rewards: -1.731, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'HITCOUNT': '0.400', 'ARMOR': '0.476', 'WEAPON3': '1.150', 'weapon2': '1.316', 'DAMAGECOUNT': '1.440', 'weapon3': '2.236', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 23986176. Throughput: 0: 4274.0. Samples: 6005110. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-05 21:48:42,794][52567] Avg episode reward: [(0, '-0.063')] [2024-08-05 21:48:43,205][52794] DAMAGECOUNT value on done: 1407.0 [2024-08-05 21:48:43,206][52794] Sum rewards: -2.070, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.830', 'AMMO2': '0.011', 'ARMOR': '0.025', 'AMMO4': '0.053', 'AMMO3': '0.126', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.700', 'weapon3': '1.380', 'weapon2': '1.866', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:43,650][52662] DAMAGECOUNT value on done: 1658.0 [2024-08-05 21:48:43,651][52662] Sum rewards: 0.083, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.019', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'HEALTH': '0.066', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.330', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon2': '1.384', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.575', 'weapon3': '2.146'} [2024-08-05 21:48:43,702][52650] Updated weights for policy 0, policy_version 2931 (0.0012) [2024-08-05 21:48:43,846][52670] DAMAGECOUNT value on done: 1446.0 [2024-08-05 21:48:43,847][52670] Sum rewards: -2.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.754', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.160', 'weapon4': '0.276', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.334', 'weapon3': '1.730'} [2024-08-05 21:48:43,993][52666] DAMAGECOUNT value on done: 1039.0 [2024-08-05 21:48:43,996][52666] Sum rewards: -2.241, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.028', 'weapon4': '0.052', 'HEALTH': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.140', 'AMMO4': '0.141', 'DAMAGECOUNT': '0.327', 'ARMOR': '0.479', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.562', 'weapon2': '2.066'} [2024-08-05 21:48:46,439][52662] DAMAGECOUNT value on done: 1519.0 [2024-08-05 21:48:46,439][52662] Sum rewards: 1.652, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.478', 'ARMOR': '0.527', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.855', 'weapon2': '1.096', 'weapon3': '2.006', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:46,608][52670] DAMAGECOUNT value on done: 1046.0 [2024-08-05 21:48:46,608][52670] Sum rewards: 0.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.108', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.032', 'weapon3': '1.324', 'weapon2': '1.598', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:46,891][52666] DAMAGECOUNT value on done: 1353.0 [2024-08-05 21:48:46,892][52666] Sum rewards: 2.093, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.601', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'ARMOR': '0.016', 'AMMO3': '0.068', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.972', 'weapon3': '1.098', 'weapon2': '1.262', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:47,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17066.6, 300 sec: 17022.7). Total num frames: 24068096. Throughput: 0: 4274.6. Samples: 6018060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:48:47,802][52567] Avg episode reward: [(0, '-0.148')] [2024-08-05 21:48:48,951][52650] Updated weights for policy 0, policy_version 2941 (0.0029) [2024-08-05 21:48:49,925][52670] DAMAGECOUNT value on done: 1400.0 [2024-08-05 21:48:49,927][52670] Sum rewards: -0.080, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.127', 'HITCOUNT': '0.170', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.700', 'weapon2': '1.086', 'weapon3': '1.970', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:50,172][52666] DAMAGECOUNT value on done: 1165.0 [2024-08-05 21:48:50,172][52666] Sum rewards: 0.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.005', 'weapon4': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.928', 'DAMAGECOUNT': '1.233', 'weapon3': '1.472', 'weapon2': '1.664', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:50,781][52803] DAMAGECOUNT value on done: 1349.0 [2024-08-05 21:48:50,783][52803] Sum rewards: 0.605, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.838', 'AMMO2': '0.019', 'AMMO3': '0.089', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.530', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.963', 'FRAGCOUNT': '1.000', 'weapon3': '1.670', 'weapon2': '1.710'} [2024-08-05 21:48:51,177][52811] DAMAGECOUNT value on done: 1486.0 [2024-08-05 21:48:51,179][52811] Sum rewards: 0.550, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.736', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO4': '0.091', 'AMMO3': '0.151', 'HITCOUNT': '0.380', 'WEAPON3': '0.850', 'weapon3': '1.472', 'weapon2': '1.474', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 24158208. Throughput: 0: 4260.7. Samples: 6043230. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-05 21:48:52,794][52567] Avg episode reward: [(0, '-0.144')] [2024-08-05 21:48:53,088][52670] DAMAGECOUNT value on done: 1371.0 [2024-08-05 21:48:53,300][52666] DAMAGECOUNT value on done: 1109.0 [2024-08-05 21:48:53,303][52666] Sum rewards: 1.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.562', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.113', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'ARMOR': '0.983', 'DAMAGECOUNT': '1.140', 'weapon2': '1.448', 'weapon3': '1.998', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:53,755][52650] Updated weights for policy 0, policy_version 2951 (0.0013) [2024-08-05 21:48:54,092][52795] DAMAGECOUNT value on done: 871.0 [2024-08-05 21:48:54,093][52795] Sum rewards: -5.168, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.754', 'FRAGCOUNT': '-1.500', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'HITCOUNT': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO3': '0.100', 'ARMOR': '0.118', 'DAMAGECOUNT': '0.120', 'weapon4': '0.228', 'WEAPON3': '0.800', 'weapon2': '1.550', 'weapon3': '1.724'} [2024-08-05 21:48:54,147][52803] DAMAGECOUNT value on done: 1593.0 [2024-08-05 21:48:54,148][52803] Sum rewards: 1.112, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'AMMO3': '0.059', 'AMMO4': '0.080', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'weapon7': '0.166', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HEALTH': '0.248', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.408', 'DAMAGECOUNT': '0.426', 'weapon4': '0.526', 'weapon2': '0.632', 'weapon3': '0.710', 'FRAGCOUNT': '1.000'} [2024-08-05 21:48:54,469][52811] DAMAGECOUNT value on done: 1223.0 [2024-08-05 21:48:54,469][52811] Sum rewards: 2.607, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.664', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.136', 'ARMOR': '0.419', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon2': '1.404', 'DAMAGECOUNT': '1.755', 'weapon3': '2.278', 'FRAGCOUNT': '4.000'} [2024-08-05 21:48:56,108][52670] DAMAGECOUNT value on done: 738.0 [2024-08-05 21:48:56,388][52666] DAMAGECOUNT value on done: 1048.0 [2024-08-05 21:48:56,388][52666] Sum rewards: -0.858, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.120', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.083', 'HITCOUNT': '0.150', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon2': '1.096', 'weapon3': '1.362'} [2024-08-05 21:48:57,468][52795] DAMAGECOUNT value on done: 1286.0 [2024-08-05 21:48:57,469][52795] Sum rewards: 0.422, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.387', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'ARMOR': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'weapon5': '0.686', 'DAMAGECOUNT': '1.065', 'weapon3': '1.322', 'weapon2': '1.560', 'FRAGCOUNT': '3.000'} [2024-08-05 21:48:57,536][52803] DAMAGECOUNT value on done: 1266.0 [2024-08-05 21:48:57,537][52803] Sum rewards: 2.837, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.394', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.145', 'HITCOUNT': '0.470', 'ARMOR': '0.479', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.665', 'weapon3': '1.780', 'weapon2': '1.784', 'FRAGCOUNT': '6.000'} [2024-08-05 21:48:57,765][52811] DAMAGECOUNT value on done: 1382.0 [2024-08-05 21:48:57,766][52811] Sum rewards: -0.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.886', 'AMMO2': '0.011', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.110', 'weapon4': '0.188', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.750', 'weapon2': '1.486', 'weapon3': '1.684', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:57,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 24248320. Throughput: 0: 4258.9. Samples: 6068640. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:48:57,799][52567] Avg episode reward: [(0, '-0.097')] [2024-08-05 21:48:58,253][52650] Updated weights for policy 0, policy_version 2961 (0.0025) [2024-08-05 21:48:59,139][52670] DAMAGECOUNT value on done: 1422.0 [2024-08-05 21:48:59,140][52670] Sum rewards: 2.377, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.800', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.118', 'weapon4': '0.198', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.786', 'weapon3': '1.180', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'} [2024-08-05 21:48:59,409][52666] DAMAGECOUNT value on done: 1522.0 [2024-08-05 21:48:59,410][52666] Sum rewards: -0.905, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.623', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'ARMOR': '0.880', 'FRAGCOUNT': '1.000', 'weapon2': '1.326', 'DAMAGECOUNT': '1.449', 'weapon3': '1.950'} [2024-08-05 21:49:00,712][52795] DAMAGECOUNT value on done: 1127.0 [2024-08-05 21:49:00,882][52803] DAMAGECOUNT value on done: 2806.0 [2024-08-05 21:49:00,883][52803] Sum rewards: -4.880, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.306', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'ARMOR': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'HITCOUNT': '0.280', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.395', 'weapon2': '1.726', 'weapon3': '1.798', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:00,947][52811] DAMAGECOUNT value on done: 1390.0 [2024-08-05 21:49:00,948][52811] Sum rewards: -4.122, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'ARMOR': '0.116', 'HEALTH': '0.122', 'AMMO3': '0.186', 'HITCOUNT': '0.310', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.128', 'weapon2': '1.618', 'weapon3': '2.234'} [2024-08-05 21:49:01,853][52670] DAMAGECOUNT value on done: 2121.0 [2024-08-05 21:49:01,856][52670] Sum rewards: 1.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'AMMO2': '0.022', 'ARMOR': '0.028', 'weapon5': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.180', 'HITCOUNT': '0.550', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.815', 'weapon2': '1.860', 'weapon3': '1.954', 'FRAGCOUNT': '4.000'} [2024-08-05 21:49:02,100][52666] DAMAGECOUNT value on done: 1856.0 [2024-08-05 21:49:02,102][52666] Sum rewards: -3.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.138', 'HITCOUNT': '0.240', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon2': '1.572', 'weapon3': '2.088'} [2024-08-05 21:49:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 17050.5). Total num frames: 24322048. Throughput: 0: 4261.1. Samples: 6081560. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:49:02,802][52567] Avg episode reward: [(0, '-0.183')] [2024-08-05 21:49:03,187][52650] Updated weights for policy 0, policy_version 2971 (0.0020) [2024-08-05 21:49:04,008][52803] DAMAGECOUNT value on done: 1426.0 [2024-08-05 21:49:04,009][52803] Sum rewards: 3.768, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.013', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.150', 'HITCOUNT': '0.430', 'ARMOR': '0.483', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.644', 'weapon3': '1.690', 'weapon2': '1.922', 'FRAGCOUNT': '6.000'} [2024-08-05 21:49:04,068][52811] DAMAGECOUNT value on done: 1679.0 [2024-08-05 21:49:04,068][52811] Sum rewards: -4.513, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'HITCOUNT': '0.350', 'weapon2': '1.178', 'WEAPON3': '1.250', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '2.000', 'weapon3': '2.390'} [2024-08-05 21:49:04,123][52795] DAMAGECOUNT value on done: 2729.0 [2024-08-05 21:49:04,124][52795] Sum rewards: 4.959, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.198', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.157', 'HITCOUNT': '0.650', 'ARMOR': '0.870', 'WEAPON3': '1.000', 'weapon2': '1.678', 'weapon3': '1.884', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '8.000'} [2024-08-05 21:49:04,674][52670] DAMAGECOUNT value on done: 1186.0 [2024-08-05 21:49:04,675][52670] Sum rewards: -0.806, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.180', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon4': '0.062', 'AMMO3': '0.068', 'HITCOUNT': '0.090', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.231', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.214', 'weapon2': '1.628'} [2024-08-05 21:49:04,855][52666] DAMAGECOUNT value on done: 1509.0 [2024-08-05 21:49:04,856][52666] Sum rewards: -1.050, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.390', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.056', 'AMMO3': '0.152', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.915', 'weapon2': '1.656', 'weapon3': '1.728', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:07,212][52803] DAMAGECOUNT value on done: 1572.0 [2024-08-05 21:49:07,213][52803] Sum rewards: 0.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.730', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon7': '0.072', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.350', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.975', 'weapon2': '1.276', 'weapon3': '1.430', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:07,230][52811] DAMAGECOUNT value on done: 1141.0 [2024-08-05 21:49:07,231][52811] Sum rewards: 0.125, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.920', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.792', 'ARMOR': '0.979', 'weapon2': '1.540', 'weapon3': '1.826', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:07,333][52670] DAMAGECOUNT value on done: 1608.0 [2024-08-05 21:49:07,335][52670] Sum rewards: -0.072, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.750', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'ARMOR': '0.040', 'AMMO3': '0.096', 'weapon4': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.272', 'weapon3': '1.438', 'weapon2': '1.728'} [2024-08-05 21:49:07,482][52795] DAMAGECOUNT value on done: 1445.0 [2024-08-05 21:49:07,482][52795] Sum rewards: -1.606, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.552', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.068', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon3': '1.328', 'weapon2': '2.182'} [2024-08-05 21:49:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 24412160. Throughput: 0: 4270.7. Samples: 6107460. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:49:07,794][52567] Avg episode reward: [(0, '-0.278')] [2024-08-05 21:49:07,914][52650] Updated weights for policy 0, policy_version 2981 (0.0021) [2024-08-05 21:49:10,373][52811] DAMAGECOUNT value on done: 1314.0 [2024-08-05 21:49:10,384][52811] Sum rewards: 3.430, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.000', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'weapon7': '0.054', 'AMMO3': '0.119', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.455', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.329', 'weapon2': '1.708', 'weapon3': '2.144', 'FRAGCOUNT': '6.000'} [2024-08-05 21:49:10,618][52803] DAMAGECOUNT value on done: 2020.0 [2024-08-05 21:49:10,618][52803] Sum rewards: 6.337, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.855', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO3': '0.076', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.275', 'weapon3': '1.278', 'weapon2': '1.486', 'FRAGCOUNT': '6.000'} [2024-08-05 21:49:10,964][52795] DAMAGECOUNT value on done: 1204.0 [2024-08-05 21:49:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 24494080. Throughput: 0: 4248.0. Samples: 6132080. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:49:12,794][52567] Avg episode reward: [(0, '-0.168')] [2024-08-05 21:49:12,960][52650] Updated weights for policy 0, policy_version 2991 (0.0015) [2024-08-05 21:49:13,739][52811] DAMAGECOUNT value on done: 857.0 [2024-08-05 21:49:13,739][52811] Sum rewards: -0.822, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.016', 'HITCOUNT': '0.070', 'ARMOR': '0.076', 'AMMO4': '0.077', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.224', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.268', 'weapon3': '1.382'} [2024-08-05 21:49:13,859][52803] DAMAGECOUNT value on done: 1370.0 [2024-08-05 21:49:13,862][52803] Sum rewards: 2.125, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.705', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.101', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.053', 'weapon3': '1.624', 'weapon2': '1.806', 'FRAGCOUNT': '4.000'} [2024-08-05 21:49:14,083][52820] DAMAGECOUNT value on done: 1086.0 [2024-08-05 21:49:14,086][52820] Sum rewards: 4.809, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.181', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.040', 'AMMO3': '0.116', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '1.546', 'DAMAGECOUNT': '1.557', 'weapon3': '2.308', 'FRAGCOUNT': '5.000'} [2024-08-05 21:49:14,193][52795] DAMAGECOUNT value on done: 1331.0 [2024-08-05 21:49:14,193][52795] Sum rewards: -0.255, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.106', 'HITCOUNT': '0.190', 'ARMOR': '0.470', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.705', 'weapon2': '1.598', 'weapon3': '1.746', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:16,885][52811] DAMAGECOUNT value on done: 1321.0 [2024-08-05 21:49:17,228][52820] DAMAGECOUNT value on done: 1435.0 [2024-08-05 21:49:17,230][52820] Sum rewards: 0.553, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.140', 'weapon4': '0.002', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.330', 'ARMOR': '0.512', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon3': '1.514', 'weapon2': '1.526'} [2024-08-05 21:49:17,457][52795] DAMAGECOUNT value on done: 1513.0 [2024-08-05 21:49:17,459][52795] Sum rewards: 4.692, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO3': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.160', 'HEALTH': '0.170', 'HITCOUNT': '0.200', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.750', 'weapon3': '1.180', 'weapon2': '1.630', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:17,468][52803] DAMAGECOUNT value on done: 1197.0 [2024-08-05 21:49:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 24576000. Throughput: 0: 4254.0. Samples: 6144970. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 21:49:17,794][52567] Avg episode reward: [(0, '0.007')] [2024-08-05 21:49:17,976][52650] Updated weights for policy 0, policy_version 3001 (0.0020) [2024-08-05 21:49:20,241][52811] DAMAGECOUNT value on done: 1265.0 [2024-08-05 21:49:20,241][52811] Sum rewards: -1.105, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.036', 'ARMOR': '0.052', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'HITCOUNT': '0.270', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.110', 'weapon2': '1.432', 'FRAGCOUNT': '2.000', 'weapon3': '2.100'} [2024-08-05 21:49:20,514][52820] DAMAGECOUNT value on done: 1229.0 [2024-08-05 21:49:20,514][52820] Sum rewards: -0.587, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.297', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.149', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.155', 'weapon2': '1.476', 'FRAGCOUNT': '2.000', 'weapon3': '2.236'} [2024-08-05 21:49:20,791][52803] DAMAGECOUNT value on done: 1240.0 [2024-08-05 21:49:20,792][52803] Sum rewards: 0.390, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.351', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.276', 'HITCOUNT': '0.380', 'ARMOR': '0.559', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.428', 'weapon3': '1.604', 'weapon2': '1.814', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:20,816][52795] DAMAGECOUNT value on done: 1101.0 [2024-08-05 21:49:20,817][52795] Sum rewards: -4.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.310', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO3': '0.141', 'HITCOUNT': '0.200', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.795', 'WEAPON3': '0.900', 'weapon2': '1.352', 'weapon3': '1.538', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:22,468][52650] Updated weights for policy 0, policy_version 3011 (0.0015) [2024-08-05 21:49:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 17050.5). Total num frames: 24666112. Throughput: 0: 4234.4. Samples: 6170060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:49:22,794][52567] Avg episode reward: [(0, '-0.045')] [2024-08-05 21:49:23,332][52811] DAMAGECOUNT value on done: 1336.0 [2024-08-05 21:49:23,334][52811] Sum rewards: 1.091, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon5': '0.238', 'HITCOUNT': '0.310', 'ARMOR': '0.491', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.020', 'weapon2': '1.428', 'weapon3': '1.612', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:23,765][52820] DAMAGECOUNT value on done: 1467.0 [2024-08-05 21:49:23,767][52820] Sum rewards: 4.026, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.744', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.032', 'weapon7': '0.062', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'weapon4': '0.194', 'WEAPON7': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.563', 'weapon3': '1.676', 'weapon2': '1.740', 'FRAGCOUNT': '5.000'} [2024-08-05 21:49:24,080][52803] DAMAGECOUNT value on done: 971.0 [2024-08-05 21:49:24,146][52795] DAMAGECOUNT value on done: 1330.0 [2024-08-05 21:49:24,149][52795] Sum rewards: -5.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.142', 'HITCOUNT': '0.150', 'AMMO3': '0.153', 'DAMAGECOUNT': '0.408', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon3': '1.690', 'weapon2': '1.704'} [2024-08-05 21:49:26,443][52811] DAMAGECOUNT value on done: 1347.0 [2024-08-05 21:49:26,446][52811] Sum rewards: -5.821, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.403', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.270', 'ARMOR': '0.498', 'DAMAGECOUNT': '0.930', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.512', 'weapon3': '2.210'} [2024-08-05 21:49:27,143][52820] DAMAGECOUNT value on done: 1032.0 [2024-08-05 21:49:27,144][52820] Sum rewards: 1.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.700', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'ARMOR': '0.948', 'DAMAGECOUNT': '1.077', 'weapon2': '1.886', 'weapon3': '1.922', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:27,280][52795] DAMAGECOUNT value on done: 885.0 [2024-08-05 21:49:27,280][52795] Sum rewards: -0.255, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.755', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon5': '0.194', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.870', 'weapon3': '1.468', 'weapon2': '1.850', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:27,364][52803] DAMAGECOUNT value on done: 1565.0 [2024-08-05 21:49:27,367][52803] Sum rewards: 1.647, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.997', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.158', 'weapon3': '1.356', 'weapon2': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 21:49:27,608][52650] Updated weights for policy 0, policy_version 3021 (0.0023) [2024-08-05 21:49:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 24748032. Throughput: 0: 4239.6. Samples: 6195890. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 21:49:27,802][52567] Avg episode reward: [(0, '-0.108')] [2024-08-05 21:49:29,628][52811] DAMAGECOUNT value on done: 959.0 [2024-08-05 21:49:30,521][52795] DAMAGECOUNT value on done: 1526.0 [2024-08-05 21:49:30,523][52795] Sum rewards: 7.837, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.084', 'WEAPON3': '0.450', 'HEALTH': '0.476', 'HITCOUNT': '0.510', 'ARMOR': '0.900', 'weapon3': '1.326', 'DAMAGECOUNT': '1.647', 'weapon2': '1.860', 'FRAGCOUNT': '5.000'} [2024-08-05 21:49:30,580][52803] DAMAGECOUNT value on done: 1283.0 [2024-08-05 21:49:30,581][52803] Sum rewards: -4.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.586', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'HITCOUNT': '0.210', 'ARMOR': '0.416', 'DAMAGECOUNT': '0.630', 'WEAPON3': '1.000', 'weapon2': '1.552', 'FRAGCOUNT': '2.000', 'weapon3': '2.182'} [2024-08-05 21:49:30,636][52820] DAMAGECOUNT value on done: 1395.0 [2024-08-05 21:49:30,637][52820] Sum rewards: 3.006, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.356', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon3': '1.858', 'DAMAGECOUNT': '1.932', 'weapon2': '1.966', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:32,525][52650] Updated weights for policy 0, policy_version 3031 (0.0013) [2024-08-05 21:49:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 24829952. Throughput: 0: 4233.8. Samples: 6208580. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:49:32,795][52567] Avg episode reward: [(0, '-0.012')] [2024-08-05 21:49:32,838][52811] DAMAGECOUNT value on done: 1199.0 [2024-08-05 21:49:32,841][52811] Sum rewards: -0.874, reward structure: {'DEATHCOUNT': '-3.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.290', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'AMMO3': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.090', 'HITCOUNT': '0.130', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.414', 'ARMOR': '0.435', 'weapon3': '0.774', 'weapon2': '1.416'} [2024-08-05 21:49:33,749][52795] DAMAGECOUNT value on done: 1149.0 [2024-08-05 21:49:33,752][52795] Sum rewards: -1.350, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.208', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.250', 'ARMOR': '0.529', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.942', 'weapon2': '1.568', 'weapon3': '1.830', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:33,758][52803] DAMAGECOUNT value on done: 1546.0 [2024-08-05 21:49:33,759][52803] Sum rewards: 0.438, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.891', 'AMMO5': '0.003', 'weapon5': '0.004', 'weapon7': '0.014', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.464', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon2': '1.138', 'weapon3': '1.742'} [2024-08-05 21:49:33,861][52820] DAMAGECOUNT value on done: 1147.0 [2024-08-05 21:49:33,863][52820] Sum rewards: 2.881, reward structure: {'DEATHCOUNT': '-7.500', 'weapon4': '0.014', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.123', 'HEALTH': '0.302', 'HITCOUNT': '0.440', 'ARMOR': '0.486', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.515', 'weapon2': '1.572', 'weapon3': '2.028', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:35,980][52811] DAMAGECOUNT value on done: 1632.0 [2024-08-05 21:49:35,982][52811] Sum rewards: 2.292, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO3': '0.159', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon2': '1.506', 'DAMAGECOUNT': '1.800', 'weapon3': '2.266', 'FRAGCOUNT': '6.000'} [2024-08-05 21:49:36,803][52803] DAMAGECOUNT value on done: 763.0 [2024-08-05 21:49:36,804][52803] Sum rewards: 0.714, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.084', 'HITCOUNT': '0.200', 'ARMOR': '0.432', 'HEALTH': '0.438', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.657', 'FRAGCOUNT': '1.000', 'weapon2': '1.520', 'weapon3': '1.752'} [2024-08-05 21:49:36,927][52795] DAMAGECOUNT value on done: 2153.0 [2024-08-05 21:49:36,929][52795] Sum rewards: 5.235, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.554', 'AMMO2': '0.026', 'ARMOR': '0.035', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.127', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon3': '1.582', 'weapon2': '1.638', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '5.000'} [2024-08-05 21:49:36,939][52650] Updated weights for policy 0, policy_version 3041 (0.0013) [2024-08-05 21:49:37,158][52820] DAMAGECOUNT value on done: 1724.0 [2024-08-05 21:49:37,162][52820] Sum rewards: 3.115, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.062', 'AMMO3': '0.152', 'ARMOR': '0.430', 'HITCOUNT': '0.720', 'WEAPON3': '0.900', 'weapon2': '1.602', 'weapon3': '2.118', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '5.000'} [2024-08-05 21:49:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 24920064. Throughput: 0: 4253.8. Samples: 6234650. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 21:49:37,794][52567] Avg episode reward: [(0, '0.105')] [2024-08-05 21:49:39,145][52811] DAMAGECOUNT value on done: 1467.0 [2024-08-05 21:49:39,147][52811] Sum rewards: 4.336, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.302', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'weapon4': '0.144', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.887', 'DAMAGECOUNT': '1.260', 'weapon2': '1.314', 'weapon3': '1.496', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:39,905][52803] DAMAGECOUNT value on done: 1017.0 [2024-08-05 21:49:39,906][52803] Sum rewards: 2.934, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.070', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.056', 'HITCOUNT': '0.060', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.270', 'ARMOR': '0.500', 'weapon3': '1.020', 'weapon2': '1.128', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:40,132][52614] Signal inference workers to stop experience collection... (550 times) [2024-08-05 21:49:40,132][52614] Signal inference workers to resume experience collection... (550 times) [2024-08-05 21:49:40,173][52650] InferenceWorker_p0-w0: stopping experience collection (550 times) [2024-08-05 21:49:40,173][52650] InferenceWorker_p0-w0: resuming experience collection (550 times) [2024-08-05 21:49:40,214][52795] DAMAGECOUNT value on done: 1326.0 [2024-08-05 21:49:40,215][52795] Sum rewards: -1.107, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.414', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.040', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.258', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.034', 'DAMAGECOUNT': '1.131', 'weapon3': '1.618'} [2024-08-05 21:49:40,385][52820] DAMAGECOUNT value on done: 1105.0 [2024-08-05 21:49:40,385][52820] Sum rewards: -1.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.114', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.150', 'weapon4': '0.240', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.336', 'weapon2': '1.364'} [2024-08-05 21:49:41,668][52650] Updated weights for policy 0, policy_version 3051 (0.0013) [2024-08-05 21:49:42,450][52811] DAMAGECOUNT value on done: 1501.0 [2024-08-05 21:49:42,451][52811] Sum rewards: 4.595, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.837', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'ARMOR': '0.068', 'AMMO3': '0.107', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.464', 'weapon3': '1.708', 'weapon2': '1.786', 'FRAGCOUNT': '7.000'} [2024-08-05 21:49:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 25010176. Throughput: 0: 4262.2. Samples: 6260440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:49:42,794][52567] Avg episode reward: [(0, '0.197')] [2024-08-05 21:49:42,795][52614] Saving new best policy, reward=0.197! [2024-08-05 21:49:43,141][52803] DAMAGECOUNT value on done: 1001.0 [2024-08-05 21:49:43,653][52820] DAMAGECOUNT value on done: 1555.0 [2024-08-05 21:49:43,654][52820] Sum rewards: 2.254, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.468', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.020', 'ARMOR': '0.072', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.065', 'weapon2': '1.456', 'weapon3': '1.904', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:43,688][52795] DAMAGECOUNT value on done: 1266.0 [2024-08-05 21:49:43,689][52795] Sum rewards: -1.372, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.220', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.129', 'weapon4': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.548', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.050', 'weapon2': '1.376', 'FRAGCOUNT': '2.000', 'weapon3': '2.184'} [2024-08-05 21:49:45,688][52811] DAMAGECOUNT value on done: 878.0 [2024-08-05 21:49:45,688][52811] Sum rewards: 0.040, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.009', 'AMMO4': '0.043', 'HEALTH': '0.085', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.489', 'WEAPON3': '0.550', 'ARMOR': '0.562', 'FRAGCOUNT': '1.000', 'weapon2': '1.326', 'weapon3': '1.498'} [2024-08-05 21:49:46,410][52803] DAMAGECOUNT value on done: 878.0 [2024-08-05 21:49:46,410][52803] Sum rewards: -0.501, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.810', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO3': '0.097', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.819', 'weapon2': '1.054', 'weapon3': '1.512', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:46,671][52650] Updated weights for policy 0, policy_version 3061 (0.0016) [2024-08-05 21:49:46,707][52665] DAMAGECOUNT value on done: 2014.0 [2024-08-05 21:49:46,708][52665] Sum rewards: 0.895, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.800', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.440', 'WEAPON3': '0.950', 'weapon2': '1.362', 'DAMAGECOUNT': '1.941', 'weapon3': '2.028', 'FRAGCOUNT': '4.000'} [2024-08-05 21:49:46,879][52820] DAMAGECOUNT value on done: 1872.0 [2024-08-05 21:49:46,881][52820] Sum rewards: 2.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.100', 'weapon5': '0.134', 'AMMO3': '0.138', 'HITCOUNT': '0.420', 'ARMOR': '0.471', 'WEAPON3': '0.750', 'weapon2': '1.118', 'DAMAGECOUNT': '1.695', 'weapon3': '2.182', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:47,055][52795] DAMAGECOUNT value on done: 1205.0 [2024-08-05 21:49:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 25092096. Throughput: 0: 4256.0. Samples: 6273080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:49:47,795][52567] Avg episode reward: [(0, '0.299')] [2024-08-05 21:49:47,875][52614] Saving new best policy, reward=0.299! [2024-08-05 21:49:48,827][52811] DAMAGECOUNT value on done: 1988.0 [2024-08-05 21:49:48,829][52811] Sum rewards: 6.723, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.522', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'ARMOR': '0.060', 'AMMO3': '0.107', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.550', 'weapon3': '1.722', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '7.000'} [2024-08-05 21:49:49,632][52803] DAMAGECOUNT value on done: 1723.0 [2024-08-05 21:49:49,634][52803] Sum rewards: 0.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.376', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.092', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'HITCOUNT': '0.470', 'WEAPON3': '1.050', 'weapon2': '1.500', 'DAMAGECOUNT': '2.070', 'weapon3': '2.088', 'FRAGCOUNT': '6.000'} [2024-08-05 21:49:49,725][52665] DAMAGECOUNT value on done: 1314.0 [2024-08-05 21:49:49,727][52665] Sum rewards: -1.126, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.820', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.172', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.454', 'weapon2': '1.732'} [2024-08-05 21:49:50,032][52820] DAMAGECOUNT value on done: 1257.0 [2024-08-05 21:49:50,244][52795] DAMAGECOUNT value on done: 1325.0 [2024-08-05 21:49:51,570][52650] Updated weights for policy 0, policy_version 3071 (0.0011) [2024-08-05 21:49:51,960][52811] DAMAGECOUNT value on done: 1132.0 [2024-08-05 21:49:51,963][52811] Sum rewards: 1.438, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.900', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.020', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon3': '1.252', 'DAMAGECOUNT': '1.506', 'weapon2': '1.906', 'FRAGCOUNT': '3.000'} [2024-08-05 21:49:52,615][52665] DAMAGECOUNT value on done: 1654.0 [2024-08-05 21:49:52,615][52665] Sum rewards: 4.541, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.149', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.360', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.317', 'weapon3': '1.400', 'weapon2': '1.928', 'FRAGCOUNT': '6.000'} [2024-08-05 21:49:52,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17066.5, 300 sec: 17050.4). Total num frames: 25182208. Throughput: 0: 4247.1. Samples: 6298580. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:49:52,795][52567] Avg episode reward: [(0, '0.314')] [2024-08-05 21:49:52,796][52614] Saving new best policy, reward=0.314! [2024-08-05 21:49:52,933][52803] DAMAGECOUNT value on done: 993.0 [2024-08-05 21:49:53,351][52820] DAMAGECOUNT value on done: 1054.0 [2024-08-05 21:49:53,351][52820] Sum rewards: 0.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.665', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.240', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.885', 'weapon2': '1.542', 'FRAGCOUNT': '2.000', 'weapon3': '2.060'} [2024-08-05 21:49:53,534][52795] DAMAGECOUNT value on done: 935.0 [2024-08-05 21:49:53,534][52795] Sum rewards: -0.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.858', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.246', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.370', 'weapon3': '1.744'} [2024-08-05 21:49:55,997][52665] DAMAGECOUNT value on done: 1054.0 [2024-08-05 21:49:55,998][52665] Sum rewards: -1.697, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.378', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.032', 'weapon7': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.228', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.900', 'weapon3': '1.444', 'weapon2': '1.506', 'FRAGCOUNT': '2.000'} [2024-08-05 21:49:56,208][52650] Updated weights for policy 0, policy_version 3081 (0.0010) [2024-08-05 21:49:56,689][52820] DAMAGECOUNT value on done: 1253.0 [2024-08-05 21:49:56,689][52820] Sum rewards: -0.867, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.111', 'HITCOUNT': '0.230', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.664', 'weapon2': '1.872'} [2024-08-05 21:49:56,792][52795] DAMAGECOUNT value on done: 1520.0 [2024-08-05 21:49:56,793][52795] Sum rewards: -3.109, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.114', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon7': '0.018', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.107', 'weapon5': '0.110', 'HITCOUNT': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'DAMAGECOUNT': '0.504', 'WEAPON3': '0.650', 'weapon3': '1.570', 'weapon2': '1.722'} [2024-08-05 21:49:57,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16793.6, 300 sec: 17022.7). Total num frames: 25255936. Throughput: 0: 4256.9. Samples: 6323640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:49:57,802][52567] Avg episode reward: [(0, '0.261')] [2024-08-05 21:49:58,802][52665] DAMAGECOUNT value on done: 1526.0 [2024-08-05 21:49:58,804][52665] Sum rewards: 3.272, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.338', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'AMMO3': '0.052', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon3': '1.140', 'weapon2': '1.342', 'DAMAGECOUNT': '1.350', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:00,138][52820] DAMAGECOUNT value on done: 1103.0 [2024-08-05 21:50:00,138][52820] Sum rewards: 0.856, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.275', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.202', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.594', 'weapon3': '0.912', 'FRAGCOUNT': '1.000', 'weapon2': '1.144'} [2024-08-05 21:50:00,727][52649] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon2', 0.002)] [2024-08-05 21:50:01,082][52650] Updated weights for policy 0, policy_version 3091 (0.0016) [2024-08-05 21:50:01,400][52649] DAMAGECOUNT value on done: 1494.0 [2024-08-05 21:50:01,400][52649] Sum rewards: 1.713, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.650', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.082', 'weapon4': '0.088', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.885', 'weapon3': '1.734', 'weapon2': '1.738', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:01,401][52665] DAMAGECOUNT value on done: 1510.0 [2024-08-05 21:50:01,402][52665] Sum rewards: -2.356, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.405', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'ARMOR': '0.068', 'AMMO3': '0.113', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon3': '1.538', 'weapon2': '1.672'} [2024-08-05 21:50:02,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 25346048. Throughput: 0: 4257.8. Samples: 6336570. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 21:50:02,795][52567] Avg episode reward: [(0, '0.342')] [2024-08-05 21:50:02,795][52614] Saving new best policy, reward=0.342! [2024-08-05 21:50:02,796][52647] DAMAGECOUNT value on done: 1013.0 [2024-08-05 21:50:02,797][52647] Sum rewards: -1.079, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.544', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.121', 'HITCOUNT': '0.250', 'ARMOR': '0.540', 'DAMAGECOUNT': '0.723', 'WEAPON3': '0.900', 'weapon2': '1.454', 'FRAGCOUNT': '2.000', 'weapon3': '2.008'} [2024-08-05 21:50:03,512][52820] DAMAGECOUNT value on done: 1175.0 [2024-08-05 21:50:03,513][52820] Sum rewards: -0.402, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.465', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.077', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.160', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.633', 'FRAGCOUNT': '1.000', 'weapon3': '1.418', 'weapon2': '1.612'} [2024-08-05 21:50:03,784][52669] DAMAGECOUNT value on done: 1223.0 [2024-08-05 21:50:03,785][52669] Sum rewards: 3.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.417', 'AMMO2': '0.007', 'AMMO4': '0.036', 'ARMOR': '0.056', 'AMMO3': '0.070', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.512', 'WEAPON3': '0.550', 'weapon2': '1.102', 'DAMAGECOUNT': '1.323', 'weapon3': '1.444', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:04,230][52649] DAMAGECOUNT value on done: 1841.0 [2024-08-05 21:50:04,230][52649] Sum rewards: 0.412, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.056', 'AMMO4': '-0.091', 'AMMO2': '-0.018', 'AMMO3': '0.113', 'HITCOUNT': '0.420', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.500', 'weapon3': '1.620', 'weapon2': '1.872', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:04,248][52665] DAMAGECOUNT value on done: 1135.0 [2024-08-05 21:50:04,252][52665] Sum rewards: 2.065, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.087', 'HEALTH': '0.142', 'HITCOUNT': '0.170', 'weapon4': '0.260', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.500', 'ARMOR': '0.516', 'weapon3': '1.492', 'weapon2': '1.512', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:05,347][52647] DAMAGECOUNT value on done: 2203.0 [2024-08-05 21:50:05,347][52647] Sum rewards: 3.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon7': '0.166', 'AMMO6': '0.240', 'AMMO7': '0.240', 'HITCOUNT': '0.290', 'WEAPON7': '0.400', 'ARMOR': '0.503', 'WEAPON3': '0.700', 'weapon2': '1.366', 'DAMAGECOUNT': '1.506', 'weapon3': '1.644', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:05,949][52650] Updated weights for policy 0, policy_version 3101 (0.0013) [2024-08-05 21:50:06,278][52669] DAMAGECOUNT value on done: 1506.0 [2024-08-05 21:50:06,927][52820] DAMAGECOUNT value on done: 1262.0 [2024-08-05 21:50:06,927][52820] Sum rewards: 5.431, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.118', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.108', 'HITCOUNT': '0.290', 'weapon5': '0.584', 'WEAPON3': '0.700', 'ARMOR': '0.857', 'weapon3': '0.992', 'DAMAGECOUNT': '1.068', 'weapon2': '1.862', 'FRAGCOUNT': '6.000'} [2024-08-05 21:50:07,224][52665] DAMAGECOUNT value on done: 1662.0 [2024-08-05 21:50:07,227][52665] Sum rewards: 3.336, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.300', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.073', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.160', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'ARMOR': '0.856', 'DAMAGECOUNT': '1.125', 'weapon3': '1.468', 'weapon2': '1.878', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:07,276][52649] DAMAGECOUNT value on done: 1421.0 [2024-08-05 21:50:07,279][52649] Sum rewards: -1.594, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.265', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.101', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.110', 'weapon2': '1.336', 'weapon3': '1.840'} [2024-08-05 21:50:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 25436160. Throughput: 0: 4267.5. Samples: 6362100. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:50:07,794][52567] Avg episode reward: [(0, '0.448')] [2024-08-05 21:50:07,797][52614] Saving new best policy, reward=0.448! [2024-08-05 21:50:08,268][52647] DAMAGECOUNT value on done: 1622.0 [2024-08-05 21:50:08,269][52647] Sum rewards: 1.474, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.175', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.140', 'weapon3': '1.490', 'weapon2': '1.960', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:09,155][52667] DAMAGECOUNT value on done: 1665.0 [2024-08-05 21:50:09,156][52667] Sum rewards: 3.222, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'HEALTH': '-0.004', 'ARMOR': '0.040', 'AMMO3': '0.050', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon2': '1.006', 'weapon3': '1.220', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:09,241][52669] DAMAGECOUNT value on done: 1120.0 [2024-08-05 21:50:09,241][52669] Sum rewards: 2.917, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.721', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'ARMOR': '0.012', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.768', 'weapon2': '1.154', 'weapon3': '1.344', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:09,954][52665] DAMAGECOUNT value on done: 1013.0 [2024-08-05 21:50:09,956][52665] Sum rewards: -3.154, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.598', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'ARMOR': '0.044', 'AMMO3': '0.091', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '1.000', 'weapon3': '1.616', 'weapon2': '2.038'} [2024-08-05 21:50:10,032][52649] DAMAGECOUNT value on done: 1544.0 [2024-08-05 21:50:10,034][52649] Sum rewards: -0.530, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.860', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'ARMOR': '0.088', 'AMMO3': '0.115', 'weapon4': '0.256', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.167', 'weapon2': '1.662', 'weapon3': '1.760', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:10,318][52820] DAMAGECOUNT value on done: 1202.0 [2024-08-05 21:50:10,319][52820] Sum rewards: -4.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.400', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.050', 'AMMO3': '0.177', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.990', 'weapon2': '1.224', 'WEAPON3': '1.250', 'FRAGCOUNT': '2.000', 'weapon3': '2.656'} [2024-08-05 21:50:10,721][52650] Updated weights for policy 0, policy_version 3111 (0.0017) [2024-08-05 21:50:11,127][52647] DAMAGECOUNT value on done: 976.0 [2024-08-05 21:50:11,127][52647] Sum rewards: -0.932, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.780', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'weapon7': '0.048', 'HITCOUNT': '0.070', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'DAMAGECOUNT': '0.153', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'weapon2': '0.554', 'weapon3': '0.798', 'FRAGCOUNT': '1.000'} [2024-08-05 21:50:11,382][52663] DAMAGECOUNT value on done: 1418.0 [2024-08-05 21:50:11,382][52663] Sum rewards: -1.072, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.018', 'AMMO4': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.900', 'weapon2': '1.086', 'weapon3': '2.370', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:11,863][52669] DAMAGECOUNT value on done: 2832.0 [2024-08-05 21:50:11,864][52669] Sum rewards: 1.682, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.424', 'AMMO2': '0.013', 'weapon7': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.250', 'HITCOUNT': '0.260', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'weapon3': '0.936', 'weapon2': '0.952', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:12,364][52667] DAMAGECOUNT value on done: 1641.0 [2024-08-05 21:50:12,366][52667] Sum rewards: 1.801, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.656', 'AMMO2': '0.012', 'AMMO4': '0.062', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.316', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.162', 'DAMAGECOUNT': '1.626', 'weapon3': '1.692', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:12,656][52665] DAMAGECOUNT value on done: 2293.0 [2024-08-05 21:50:12,657][52665] Sum rewards: 0.530, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.065', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'AMMO3': '0.070', 'ARMOR': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.810', 'weapon3': '1.522', 'weapon2': '1.592', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:12,783][52649] DAMAGECOUNT value on done: 889.0 [2024-08-05 21:50:12,784][52649] Sum rewards: 2.226, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.618', 'AMMO5': '0.005', 'weapon4': '0.012', 'weapon5': '0.016', 'AMMO2': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.117', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.966', 'weapon2': '1.392', 'weapon3': '1.968', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 25518080. Throughput: 0: 4261.6. Samples: 6387660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:50:12,796][52567] Avg episode reward: [(0, '0.426')] [2024-08-05 21:50:13,570][52820] DAMAGECOUNT value on done: 2114.0 [2024-08-05 21:50:13,570][52820] Sum rewards: 2.676, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.346', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.062', 'weapon7': '0.066', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.386', 'weapon2': '1.578', 'weapon3': '1.660', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:14,091][52647] DAMAGECOUNT value on done: 925.0 [2024-08-05 21:50:14,107][52663] DAMAGECOUNT value on done: 1534.0 [2024-08-05 21:50:14,109][52663] Sum rewards: 0.271, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.813', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon4': '0.222', 'HITCOUNT': '0.280', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.879', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'weapon2': '1.546'} [2024-08-05 21:50:14,765][52669] DAMAGECOUNT value on done: 1524.0 [2024-08-05 21:50:14,767][52669] Sum rewards: -0.926, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.634', 'AMMO2': '0.007', 'ARMOR': '0.032', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'weapon7': '0.124', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HITCOUNT': '0.270', 'weapon4': '0.274', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.849', 'FRAGCOUNT': '1.000', 'weapon2': '1.170', 'weapon3': '1.404'} [2024-08-05 21:50:15,269][52667] DAMAGECOUNT value on done: 1657.0 [2024-08-05 21:50:15,270][52667] Sum rewards: -1.262, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.310', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.268', 'DAMAGECOUNT': '0.459', 'ARMOR': '0.464', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.340', 'weapon3': '1.432'} [2024-08-05 21:50:15,289][52665] DAMAGECOUNT value on done: 1645.0 [2024-08-05 21:50:15,289][52665] Sum rewards: -1.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.567', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'ARMOR': '0.085', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'weapon2': '1.248', 'weapon3': '1.598'} [2024-08-05 21:50:15,443][52649] DAMAGECOUNT value on done: 1712.0 [2024-08-05 21:50:15,445][52649] Sum rewards: -0.487, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.432', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon7': '0.060', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.465', 'DAMAGECOUNT': '0.738', 'weapon3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.296'} [2024-08-05 21:50:15,519][52650] Updated weights for policy 0, policy_version 3121 (0.0022) [2024-08-05 21:50:16,671][52820] DAMAGECOUNT value on done: 1702.0 [2024-08-05 21:50:16,672][52820] Sum rewards: 0.744, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.910', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'ARMOR': '0.958', 'DAMAGECOUNT': '1.482', 'weapon2': '1.768', 'weapon3': '1.834', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:17,010][52663] DAMAGECOUNT value on done: 1456.0 [2024-08-05 21:50:17,011][52663] Sum rewards: -2.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.928', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.138', 'HITCOUNT': '0.160', 'ARMOR': '0.498', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.900', 'weapon2': '1.516', 'FRAGCOUNT': '2.000', 'weapon3': '2.314'} [2024-08-05 21:50:17,014][52658] DAMAGECOUNT value on done: 1407.0 [2024-08-05 21:50:17,016][52658] Sum rewards: 0.099, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.465', 'AMMO2': '0.001', 'weapon4': '0.004', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon7': '0.048', 'AMMO3': '0.062', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.975', 'weapon3': '1.376', 'weapon2': '1.564', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:17,089][52647] DAMAGECOUNT value on done: 1616.0 [2024-08-05 21:50:17,089][52647] Sum rewards: 7.524, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.120', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.348', 'DAMAGECOUNT': '2.115', 'weapon3': '2.170', 'FRAGCOUNT': '8.000'} [2024-08-05 21:50:17,710][52665] DAMAGECOUNT value on done: 1937.0 [2024-08-05 21:50:17,710][52669] DAMAGECOUNT value on done: 1681.0 [2024-08-05 21:50:17,710][52665] Sum rewards: 1.066, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.905', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.180', 'HITCOUNT': '0.330', 'ARMOR': '0.458', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.230', 'weapon2': '1.488', 'FRAGCOUNT': '2.000', 'weapon3': '2.088'} [2024-08-05 21:50:17,710][52669] Sum rewards: 6.095, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.074', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.095', 'weapon4': '0.202', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'ARMOR': '0.876', 'weapon3': '1.340', 'weapon2': '1.626', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17066.6, 300 sec: 17022.7). Total num frames: 25600000. Throughput: 0: 4266.2. Samples: 6400560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 21:50:17,795][52567] Avg episode reward: [(0, '0.571')] [2024-08-05 21:50:17,825][52614] Saving new best policy, reward=0.571! [2024-08-05 21:50:18,100][52649] DAMAGECOUNT value on done: 1469.0 [2024-08-05 21:50:18,101][52649] Sum rewards: 2.702, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.516', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.024', 'AMMO3': '0.090', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.335', 'weapon2': '1.398', 'weapon3': '1.494', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:18,615][52667] DAMAGECOUNT value on done: 916.0 [2024-08-05 21:50:18,616][52667] Sum rewards: -2.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.346', 'ARMOR': '0.523', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon3': '1.460', 'weapon2': '1.600'} [2024-08-05 21:50:19,962][52663] DAMAGECOUNT value on done: 1889.0 [2024-08-05 21:50:19,963][52663] Sum rewards: -2.023, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.089', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.191', 'weapon2': '1.340', 'FRAGCOUNT': '2.000', 'weapon3': '2.148'} [2024-08-05 21:50:20,243][52658] DAMAGECOUNT value on done: 1467.0 [2024-08-05 21:50:20,246][52658] Sum rewards: -2.274, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.000', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.154', 'HITCOUNT': '0.290', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.900', 'weapon2': '1.684', 'weapon3': '1.916', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:20,281][52647] DAMAGECOUNT value on done: 1243.0 [2024-08-05 21:50:20,284][52647] Sum rewards: 0.273, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.460', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.158', 'HITCOUNT': '0.240', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.900', 'weapon2': '1.418', 'weapon3': '1.768', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:20,552][52665] DAMAGECOUNT value on done: 1811.0 [2024-08-05 21:50:20,553][52650] Updated weights for policy 0, policy_version 3131 (0.0013) [2024-08-05 21:50:20,622][52669] DAMAGECOUNT value on done: 1620.0 [2024-08-05 21:50:20,622][52669] Sum rewards: 4.852, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.041', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.056', 'AMMO3': '0.076', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'ARMOR': '0.898', 'DAMAGECOUNT': '1.335', 'weapon3': '1.412', 'weapon2': '1.548', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:20,844][52649] DAMAGECOUNT value on done: 1316.0 [2024-08-05 21:50:20,846][52649] Sum rewards: -1.616, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.308', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.121', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.290', 'weapon2': '1.318', 'weapon3': '1.626', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:21,534][52667] DAMAGECOUNT value on done: 1276.0 [2024-08-05 21:50:21,534][52667] Sum rewards: -3.206, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.862', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.340', 'ARMOR': '0.408', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon3': '1.384', 'weapon2': '1.538'} [2024-08-05 21:50:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 25681920. Throughput: 0: 4247.6. Samples: 6425790. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 21:50:22,794][52567] Avg episode reward: [(0, '0.462')] [2024-08-05 21:50:23,084][52658] DAMAGECOUNT value on done: 939.0 [2024-08-05 21:50:23,086][52658] Sum rewards: -0.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.210', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.125', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.801', 'FRAGCOUNT': '1.000', 'weapon2': '1.422', 'weapon3': '1.838'} [2024-08-05 21:50:23,342][52663] DAMAGECOUNT value on done: 1330.0 [2024-08-05 21:50:23,344][52663] Sum rewards: 2.002, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.200', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.032', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'weapon3': '0.880', 'weapon2': '1.010', 'DAMAGECOUNT': '1.236', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:23,423][52664] DAMAGECOUNT value on done: 1220.0 [2024-08-05 21:50:23,423][52664] Sum rewards: -1.703, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.802', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'ARMOR': '0.112', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.501', 'weapon4': '0.504', 'WEAPON3': '0.550', 'weapon2': '1.506', 'weapon3': '1.578', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:23,483][52647] DAMAGECOUNT value on done: 1288.0 [2024-08-05 21:50:23,484][52647] Sum rewards: -1.879, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.521', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.158', 'HITCOUNT': '0.270', 'ARMOR': '0.523', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.930', 'weapon3': '1.602', 'weapon2': '1.688', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:23,788][52669] DAMAGECOUNT value on done: 1959.0 [2024-08-05 21:50:23,790][52669] Sum rewards: -1.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.606', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'weapon5': '0.014', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.168', 'ARMOR': '0.444', 'HITCOUNT': '0.570', 'WEAPON3': '0.950', 'weapon2': '1.492', 'DAMAGECOUNT': '1.884', 'weapon3': '2.198', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:23,922][52665] DAMAGECOUNT value on done: 1938.0 [2024-08-05 21:50:23,924][52665] Sum rewards: 1.452, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.428', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO3': '0.079', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon2': '1.268', 'DAMAGECOUNT': '1.320', 'weapon3': '1.480', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:24,189][52649] DAMAGECOUNT value on done: 1735.0 [2024-08-05 21:50:24,190][52649] Sum rewards: 1.835, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.424', 'AMMO2': '0.003', 'ARMOR': '0.008', 'AMMO4': '0.015', 'AMMO3': '0.174', 'HITCOUNT': '0.430', 'WEAPON3': '0.950', 'weapon2': '1.294', 'DAMAGECOUNT': '1.626', 'weapon3': '2.508', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:24,231][52667] DAMAGECOUNT value on done: 1740.0 [2024-08-05 21:50:24,231][52667] Sum rewards: 8.144, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.150', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.036', 'AMMO3': '0.072', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.022', 'weapon3': '1.628', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '8.000'} [2024-08-05 21:50:25,039][52650] Updated weights for policy 0, policy_version 3141 (0.0023) [2024-08-05 21:50:26,093][52663] DAMAGECOUNT value on done: 1361.0 [2024-08-05 21:50:26,095][52663] Sum rewards: -1.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.856', 'AMMO2': '0.015', 'weapon7': '0.050', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon4': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.642', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.464', 'weapon3': '1.638'} [2024-08-05 21:50:26,268][52665] DAMAGECOUNT value on done: 1600.0 [2024-08-05 21:50:26,269][52665] Sum rewards: 1.807, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.692', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.016', 'AMMO3': '0.112', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.182', 'weapon2': '1.316', 'weapon3': '1.884', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:26,332][52658] DAMAGECOUNT value on done: 1224.0 [2024-08-05 21:50:26,333][52658] Sum rewards: 1.989, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'ARMOR': '0.014', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon7': '0.062', 'AMMO3': '0.073', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.152', 'AMMO4': '0.155', 'weapon4': '0.226', 'HITCOUNT': '0.250', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.825', 'weapon2': '1.510', 'weapon3': '1.590', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:26,381][52664] DAMAGECOUNT value on done: 1872.0 [2024-08-05 21:50:26,433][52647] DAMAGECOUNT value on done: 1585.0 [2024-08-05 21:50:26,507][52649] DAMAGECOUNT value on done: 1807.0 [2024-08-05 21:50:26,520][52649] Sum rewards: 6.334, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.556', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.075', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.100', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.322', 'weapon3': '1.714', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '6.000'} [2024-08-05 21:50:26,571][52669] DAMAGECOUNT value on done: 1504.0 [2024-08-05 21:50:26,571][52669] Sum rewards: 1.075, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.204', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon4': '0.166', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.275', 'weapon3': '1.628', 'weapon2': '1.826', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:27,647][52667] DAMAGECOUNT value on done: 1755.0 [2024-08-05 21:50:27,648][52667] Sum rewards: -2.275, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.452', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.058', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.447', 'WEAPON3': '0.850', 'weapon2': '1.518', 'FRAGCOUNT': '2.000', 'weapon3': '2.150'} [2024-08-05 21:50:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 25772032. Throughput: 0: 4250.2. Samples: 6451700. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 21:50:27,795][52567] Avg episode reward: [(0, '0.610')] [2024-08-05 21:50:27,886][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003147_25780224.pth... [2024-08-05 21:50:28,023][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002648_21692416.pth [2024-08-05 21:50:28,032][52614] Saving new best policy, reward=0.610! [2024-08-05 21:50:29,208][52665] DAMAGECOUNT value on done: 2062.0 [2024-08-05 21:50:29,208][52665] Sum rewards: 0.703, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.240', 'AMMO2': '0.026', 'weapon4': '0.058', 'ARMOR': '0.072', 'AMMO4': '0.131', 'AMMO3': '0.150', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.386', 'weapon2': '1.440', 'weapon3': '2.130', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:29,375][52658] DAMAGECOUNT value on done: 1210.0 [2024-08-05 21:50:29,463][52663] DAMAGECOUNT value on done: 1739.0 [2024-08-05 21:50:29,466][52663] Sum rewards: 1.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.494', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'weapon5': '0.086', 'AMMO3': '0.119', 'weapon4': '0.158', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.341', 'ARMOR': '1.351', 'weapon3': '1.642', 'weapon2': '1.886', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:29,599][52664] DAMAGECOUNT value on done: 1801.0 [2024-08-05 21:50:29,600][52664] Sum rewards: 2.113, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.080', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'weapon5': '0.114', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.011', 'weapon3': '1.304', 'weapon2': '1.314', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:29,614][52647] DAMAGECOUNT value on done: 1335.0 [2024-08-05 21:50:29,616][52647] Sum rewards: 0.020, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.759', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.116', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.185', 'weapon2': '1.326', 'weapon3': '1.992', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:29,621][52649] DAMAGECOUNT value on done: 1245.0 [2024-08-05 21:50:29,622][52649] Sum rewards: 5.543, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.094', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.046', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.180', 'weapon4': '0.240', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.972', 'weapon3': '1.284', 'weapon2': '1.556', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:29,896][52650] Updated weights for policy 0, policy_version 3151 (0.0022) [2024-08-05 21:50:29,999][52669] DAMAGECOUNT value on done: 1426.0 [2024-08-05 21:50:30,000][52669] Sum rewards: -2.326, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.382', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon7': '0.070', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'weapon4': '0.158', 'WEAPON7': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.110', 'weapon2': '1.494', 'weapon3': '1.590'} [2024-08-05 21:50:30,425][52667] DAMAGECOUNT value on done: 1845.0 [2024-08-05 21:50:30,427][52667] Sum rewards: 5.895, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.272', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.044', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.236', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.296', 'weapon3': '1.496', 'DAMAGECOUNT': '1.818', 'FRAGCOUNT': '6.000'} [2024-08-05 21:50:31,913][52658] DAMAGECOUNT value on done: 1267.0 [2024-08-05 21:50:31,913][52658] Sum rewards: -0.084, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.844', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon7': '0.072', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.360', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'weapon2': '0.932', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '1.000', 'weapon3': '1.408'} [2024-08-05 21:50:32,500][52665] DAMAGECOUNT value on done: 1561.0 [2024-08-05 21:50:32,500][52665] Sum rewards: 1.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.230', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon4': '0.038', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.005', 'weapon2': '1.442', 'weapon3': '1.888', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:32,515][52663] DAMAGECOUNT value on done: 1428.0 [2024-08-05 21:50:32,516][52663] Sum rewards: 0.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.025', 'AMMO3': '0.076', 'weapon4': '0.124', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.666', 'weapon3': '0.854', 'weapon2': '1.552', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16994.9). Total num frames: 25853952. Throughput: 0: 4244.9. Samples: 6464100. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:50:32,794][52567] Avg episode reward: [(0, '0.584')] [2024-08-05 21:50:32,863][52649] DAMAGECOUNT value on done: 1103.0 [2024-08-05 21:50:32,864][52649] Sum rewards: -1.081, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.536', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'HITCOUNT': '0.310', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.005', 'weapon3': '1.502', 'weapon2': '1.886', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:32,889][52669] DAMAGECOUNT value on done: 1888.0 [2024-08-05 21:50:32,890][52669] Sum rewards: 1.913, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.478', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.084', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.244', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.395', 'weapon2': '1.414', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:32,925][52667] DAMAGECOUNT value on done: 1297.0 [2024-08-05 21:50:33,032][52647] DAMAGECOUNT value on done: 1259.0 [2024-08-05 21:50:33,032][52647] Sum rewards: -2.436, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.022', 'AMMO4': '0.029', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'HITCOUNT': '0.260', 'ARMOR': '0.488', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.885', 'weapon2': '1.664', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:33,048][52664] DAMAGECOUNT value on done: 1374.0 [2024-08-05 21:50:33,048][52664] Sum rewards: 0.721, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.215', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.054', 'ARMOR': '0.080', 'AMMO3': '0.104', 'HITCOUNT': '0.240', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.834', 'weapon2': '1.396', 'weapon3': '1.740', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:34,836][52658] DAMAGECOUNT value on done: 1341.0 [2024-08-05 21:50:34,837][52658] Sum rewards: 2.651, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon4': '0.308', 'HITCOUNT': '0.470', 'WEAPON3': '0.800', 'weapon2': '0.886', 'DAMAGECOUNT': '1.371', 'weapon3': '2.058', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:35,024][52650] Updated weights for policy 0, policy_version 3161 (0.0021) [2024-08-05 21:50:35,485][52647] DAMAGECOUNT value on done: 1528.0 [2024-08-05 21:50:35,487][52664] DAMAGECOUNT value on done: 1954.0 [2024-08-05 21:50:35,486][52647] Sum rewards: -5.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'HITCOUNT': '0.310', 'ARMOR': '0.892', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.644', 'weapon3': '2.026'} [2024-08-05 21:50:35,487][52664] Sum rewards: 2.223, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.960', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.116', 'HITCOUNT': '0.460', 'WEAPON3': '0.900', 'weapon2': '1.506', 'DAMAGECOUNT': '2.004', 'weapon3': '2.026', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:35,584][52665] DAMAGECOUNT value on done: 1813.0 [2024-08-05 21:50:35,585][52665] Sum rewards: -2.292, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.932', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO3': '0.081', 'HITCOUNT': '0.100', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'ARMOR': '0.940', 'FRAGCOUNT': '1.000', 'weapon3': '1.378', 'weapon2': '2.284'} [2024-08-05 21:50:35,600][52663] DAMAGECOUNT value on done: 1544.0 [2024-08-05 21:50:35,601][52663] Sum rewards: -2.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.705', 'AMMO4': '-0.083', 'AMMO2': '-0.016', 'AMMO3': '0.118', 'ARMOR': '0.448', 'HITCOUNT': '0.510', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.418', 'DAMAGECOUNT': '1.608', 'weapon3': '2.238'} [2024-08-05 21:50:35,866][52649] DAMAGECOUNT value on done: 1917.0 [2024-08-05 21:50:35,867][52649] Sum rewards: 0.825, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.764', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon7': '0.070', 'ARMOR': '0.097', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.314', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.700', 'weapon2': '1.014', 'weapon3': '1.570', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:35,947][52667] DAMAGECOUNT value on done: 1638.0 [2024-08-05 21:50:35,948][52667] Sum rewards: 4.464, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.806', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.042', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon4': '0.118', 'WEAPON5': '0.200', 'ARMOR': '0.432', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.420', 'DAMAGECOUNT': '1.461', 'weapon3': '1.602', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:36,077][52669] DAMAGECOUNT value on done: 1837.0 [2024-08-05 21:50:36,077][52669] Sum rewards: 1.690, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.696', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.204', 'ARMOR': '0.508', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.066', 'DAMAGECOUNT': '1.962', 'weapon3': '2.182', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:36,761][52668] DAMAGECOUNT value on done: 1497.0 [2024-08-05 21:50:36,762][52668] Sum rewards: 3.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.311', 'AMMO2': '0.008', 'ARMOR': '0.028', 'weapon4': '0.038', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.870', 'weapon2': '1.172', 'weapon3': '1.408', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:37,742][52658] DAMAGECOUNT value on done: 1096.0 [2024-08-05 21:50:37,746][52658] Sum rewards: -0.105, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.095', 'HITCOUNT': '0.240', 'ARMOR': '0.511', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.810', 'weapon3': '1.284', 'weapon2': '1.786', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 25944064. Throughput: 0: 4244.7. Samples: 6489590. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:50:37,795][52567] Avg episode reward: [(0, '0.472')] [2024-08-05 21:50:38,347][52665] DAMAGECOUNT value on done: 1540.0 [2024-08-05 21:50:38,349][52665] Sum rewards: 3.311, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.795', 'AMMO4': '-0.101', 'AMMO2': '-0.020', 'AMMO5': '0.005', 'AMMO3': '0.112', 'HITCOUNT': '0.400', 'ARMOR': '0.454', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.326', 'weapon2': '1.546', 'weapon3': '1.884', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:38,401][52664] DAMAGECOUNT value on done: 1259.0 [2024-08-05 21:50:38,402][52664] Sum rewards: 1.640, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.841', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.026', 'AMMO4': '0.039', 'AMMO3': '0.060', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.244', 'DAMAGECOUNT': '0.405', 'WEAPON3': '0.450', 'ARMOR': '0.936', 'weapon3': '1.470', 'weapon2': '1.738', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:38,430][52647] DAMAGECOUNT value on done: 1394.0 [2024-08-05 21:50:38,432][52647] Sum rewards: 1.255, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'weapon5': '0.266', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon3': '1.428', 'weapon2': '1.930'} [2024-08-05 21:50:38,514][52649] DAMAGECOUNT value on done: 1615.0 [2024-08-05 21:50:38,514][52649] Sum rewards: -0.807, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.802', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.900', 'weapon3': '1.454', 'weapon2': '1.672', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:38,712][52667] DAMAGECOUNT value on done: 1607.0 [2024-08-05 21:50:38,713][52667] Sum rewards: 0.844, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.656', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.110', 'HITCOUNT': '0.330', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.011', 'weapon2': '1.168', 'weapon3': '1.432', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:38,796][52663] DAMAGECOUNT value on done: 1753.0 [2024-08-05 21:50:38,798][52663] Sum rewards: -3.494, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.902', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO3': '0.108', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.716', 'weapon3': '1.722'} [2024-08-05 21:50:39,258][52669] DAMAGECOUNT value on done: 1779.0 [2024-08-05 21:50:39,260][52669] Sum rewards: 1.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon4': '0.316', 'HITCOUNT': '0.420', 'ARMOR': '0.507', 'WEAPON3': '0.650', 'weapon3': '1.412', 'weapon2': '1.620', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:39,409][52650] Updated weights for policy 0, policy_version 3171 (0.0032) [2024-08-05 21:50:39,686][52660] DAMAGECOUNT value on done: 1741.0 [2024-08-05 21:50:39,688][52660] Sum rewards: 0.698, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.175', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.080', 'AMMO3': '0.119', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.006', 'DAMAGECOUNT': '1.053', 'weapon3': '2.054', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:40,023][52668] DAMAGECOUNT value on done: 1630.0 [2024-08-05 21:50:40,716][52658] DAMAGECOUNT value on done: 1279.0 [2024-08-05 21:50:40,717][52658] Sum rewards: 1.778, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.660', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.052', 'AMMO3': '0.096', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.197', 'weapon2': '1.660', 'weapon3': '1.780', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:41,322][52647] DAMAGECOUNT value on done: 1401.0 [2024-08-05 21:50:41,322][52647] Sum rewards: 1.063, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.008', 'weapon5': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.204', 'HITCOUNT': '0.340', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.077', 'weapon3': '1.398', 'weapon2': '1.434', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:41,340][52664] DAMAGECOUNT value on done: 1733.0 [2024-08-05 21:50:41,340][52664] Sum rewards: 1.263, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.508', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon7': '0.048', 'ARMOR': '0.071', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.100', 'DAMAGECOUNT': '1.335', 'weapon3': '1.424', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:41,533][52665] Large shaping reward -2.558 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.01, -10.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:50:41,577][52665] DAMAGECOUNT value on done: 1461.0 [2024-08-05 21:50:41,580][52665] Sum rewards: 0.340, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.262', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.063', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.906', 'DAMAGECOUNT': '0.969', 'weapon3': '1.312', 'weapon2': '1.652', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:41,688][52663] DAMAGECOUNT value on done: 1275.0 [2024-08-05 21:50:41,688][52663] Sum rewards: -7.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.434', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.076', 'AMMO3': '0.179', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.356', 'DAMAGECOUNT': '0.792', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.216', 'weapon3': '2.064'} [2024-08-05 21:50:41,851][52667] DAMAGECOUNT value on done: 2400.0 [2024-08-05 21:50:41,851][52667] Sum rewards: 1.609, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.254', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'ARMOR': '0.040', 'AMMO3': '0.130', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'weapon2': '1.642', 'DAMAGECOUNT': '1.779', 'weapon3': '2.260', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:41,955][52649] DAMAGECOUNT value on done: 1281.0 [2024-08-05 21:50:41,955][52649] Sum rewards: 4.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'AMMO4': '-0.100', 'AMMO2': '-0.020', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon3': '1.382', 'weapon2': '1.636', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '6.000'} [2024-08-05 21:50:42,009][52669] DAMAGECOUNT value on done: 1575.0 [2024-08-05 21:50:42,009][52669] Sum rewards: 0.778, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.854', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.070', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.780', 'ARMOR': '0.857', 'weapon2': '1.532', 'weapon3': '1.552', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17066.6, 300 sec: 17050.5). Total num frames: 26034176. Throughput: 0: 4251.5. Samples: 6514960. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:50:42,795][52567] Avg episode reward: [(0, '0.489')] [2024-08-05 21:50:42,840][52660] DAMAGECOUNT value on done: 1830.0 [2024-08-05 21:50:42,840][52660] Sum rewards: 3.657, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.526', 'AMMO2': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.068', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.208', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'weapon2': '1.478', 'weapon3': '1.736', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:43,035][52668] DAMAGECOUNT value on done: 1714.0 [2024-08-05 21:50:43,036][52668] Sum rewards: -1.241, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.884', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.077', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.290', 'HITCOUNT': '0.300', 'weapon5': '0.310', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.999', 'weapon2': '1.260', 'FRAGCOUNT': '1.500', 'weapon3': '1.886'} [2024-08-05 21:50:43,573][52658] DAMAGECOUNT value on done: 1501.0 [2024-08-05 21:50:43,573][52658] Sum rewards: 0.936, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.382', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.036', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.122', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.476', 'weapon3': '1.514', 'weapon2': '1.554', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:44,035][52647] DAMAGECOUNT value on done: 1990.0 [2024-08-05 21:50:44,035][52647] Sum rewards: -1.808, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.630', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.117', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '1.638', 'weapon3': '1.674'} [2024-08-05 21:50:44,119][52671] DAMAGECOUNT value on done: 1155.0 [2024-08-05 21:50:44,119][52671] Sum rewards: -1.672, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.198', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.086', 'ARMOR': '0.092', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.900', 'weapon2': '1.100', 'DAMAGECOUNT': '1.209', 'FRAGCOUNT': '2.000', 'weapon3': '2.370'} [2024-08-05 21:50:44,137][52664] DAMAGECOUNT value on done: 1321.0 [2024-08-05 21:50:44,139][52664] Sum rewards: 0.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.001', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.813', 'weapon3': '1.294', 'weapon2': '1.440', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:44,321][52667] DAMAGECOUNT value on done: 1919.0 [2024-08-05 21:50:44,322][52667] Sum rewards: 3.376, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.100', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.084', 'AMMO3': '0.122', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.590', 'weapon3': '1.818', 'weapon2': '1.870', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:44,494][52650] Updated weights for policy 0, policy_version 3181 (0.0028) [2024-08-05 21:50:44,773][52663] DAMAGECOUNT value on done: 1652.0 [2024-08-05 21:50:44,774][52663] Sum rewards: 0.451, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.080', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.406', 'WEAPON3': '0.550', 'ARMOR': '0.561', 'DAMAGECOUNT': '1.170', 'weapon2': '1.358', 'weapon3': '1.498', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:45,088][52669] DAMAGECOUNT value on done: 1460.0 [2024-08-05 21:50:45,089][52669] Sum rewards: 2.008, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.101', 'HITCOUNT': '0.380', 'HEALTH': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.275', 'weapon3': '1.388', 'weapon2': '1.490', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:45,200][52649] DAMAGECOUNT value on done: 1365.0 [2024-08-05 21:50:45,202][52649] Sum rewards: -0.785, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.147', 'HITCOUNT': '0.440', 'ARMOR': '0.453', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.440', 'weapon3': '1.564', 'weapon2': '1.628', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:45,421][52660] DAMAGECOUNT value on done: 1112.0 [2024-08-05 21:50:45,422][52660] Sum rewards: 1.336, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.515', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.040', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.144', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.380', 'weapon3': '1.450', 'weapon2': '1.590', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:45,631][52668] DAMAGECOUNT value on done: 970.0 [2024-08-05 21:50:46,054][52794] DAMAGECOUNT value on done: 1352.0 [2024-08-05 21:50:46,054][52794] Sum rewards: 1.394, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.956', 'AMMO2': '0.011', 'weapon7': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.095', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.112', 'HITCOUNT': '0.320', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.044', 'weapon3': '1.556', 'weapon2': '1.650', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:46,559][52658] DAMAGECOUNT value on done: 1585.0 [2024-08-05 21:50:46,559][52658] Sum rewards: 0.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.249', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.123', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.011', 'weapon2': '1.552', 'weapon3': '2.046', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:46,720][52671] DAMAGECOUNT value on done: 1569.0 [2024-08-05 21:50:47,335][52647] DAMAGECOUNT value on done: 1383.0 [2024-08-05 21:50:47,336][52647] Sum rewards: 2.986, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'HITCOUNT': '0.190', 'weapon4': '0.250', 'HEALTH': '0.318', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.519', 'weapon2': '0.976', 'weapon3': '1.166', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:47,497][52664] DAMAGECOUNT value on done: 1745.0 [2024-08-05 21:50:47,497][52664] Sum rewards: -0.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.044', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.096', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.314', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'ARMOR': '1.006', 'weapon2': '1.322', 'weapon3': '1.420'} [2024-08-05 21:50:47,565][52667] DAMAGECOUNT value on done: 1770.0 [2024-08-05 21:50:47,566][52667] Sum rewards: 1.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.422', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO3': '0.110', 'HITCOUNT': '0.340', 'ARMOR': '0.523', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.110', 'weapon2': '1.670', 'weapon3': '1.974', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:47,582][52663] DAMAGECOUNT value on done: 1462.0 [2024-08-05 21:50:47,582][52663] Sum rewards: 1.027, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.152', 'HITCOUNT': '0.170', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.645', 'weapon2': '1.332', 'weapon3': '1.462', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:47,736][52659] DAMAGECOUNT value on done: 1890.0 [2024-08-05 21:50:47,737][52659] Sum rewards: 1.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.390', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.028', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.187', 'HITCOUNT': '0.560', 'WEAPON3': '1.050', 'weapon2': '1.598', 'weapon3': '2.174', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '7.000'} [2024-08-05 21:50:47,750][52669] DAMAGECOUNT value on done: 1508.0 [2024-08-05 21:50:47,751][52669] Sum rewards: 2.491, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.210', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.004', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.192', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.948', 'weapon3': '1.406', 'weapon2': '1.454', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:47,795][52567] Fps is (10 sec: 16382.9, 60 sec: 16930.0, 300 sec: 16994.9). Total num frames: 26107904. Throughput: 0: 4248.4. Samples: 6527750. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 21:50:47,796][52567] Avg episode reward: [(0, '0.516')] [2024-08-05 21:50:48,151][52649] DAMAGECOUNT value on done: 875.0 [2024-08-05 21:50:48,509][52794] DAMAGECOUNT value on done: 1541.0 [2024-08-05 21:50:48,509][52794] Sum rewards: -2.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.898', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'weapon4': '0.186', 'HITCOUNT': '0.270', 'ARMOR': '0.550', 'DAMAGECOUNT': '0.831', 'WEAPON3': '0.950', 'weapon2': '1.332', 'weapon3': '2.228', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:48,567][52662] DAMAGECOUNT value on done: 1198.0 [2024-08-05 21:50:48,567][52662] Sum rewards: -0.127, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.433', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.034', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.286', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.800', 'weapon2': '1.214', 'weapon3': '1.938', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:48,644][52660] DAMAGECOUNT value on done: 2086.0 [2024-08-05 21:50:48,645][52660] Sum rewards: -2.623, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.153', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.010', 'AMMO4': '0.035', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon4': '0.180', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.080', 'weapon2': '1.370', 'FRAGCOUNT': '2.000', 'weapon3': '2.278'} [2024-08-05 21:50:48,979][52668] DAMAGECOUNT value on done: 1071.0 [2024-08-05 21:50:48,979][52668] Sum rewards: 1.301, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.770', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.086', 'ARMOR': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.158', 'HITCOUNT': '0.220', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.828', 'weapon2': '1.476', 'weapon3': '1.760', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:49,234][52650] Updated weights for policy 0, policy_version 3191 (0.0032) [2024-08-05 21:50:49,666][52658] DAMAGECOUNT value on done: 1889.0 [2024-08-05 21:50:49,666][52658] Sum rewards: 0.234, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.088', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.128', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'ARMOR': '0.885', 'DAMAGECOUNT': '1.023', 'weapon2': '1.782', 'weapon3': '1.850', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:50,058][52647] DAMAGECOUNT value on done: 1934.0 [2024-08-05 21:50:50,058][52647] Sum rewards: -1.497, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.021', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.168', 'HITCOUNT': '0.390', 'ARMOR': '0.461', 'WEAPON3': '1.100', 'weapon2': '1.378', 'DAMAGECOUNT': '1.530', 'weapon3': '2.308', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:50,080][52671] DAMAGECOUNT value on done: 892.0 [2024-08-05 21:50:50,082][52671] Sum rewards: -0.169, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.522', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.068', 'AMMO3': '0.106', 'HITCOUNT': '0.180', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.711', 'weapon3': '1.518', 'weapon2': '1.830', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:50,207][52664] DAMAGECOUNT value on done: 1527.0 [2024-08-05 21:50:50,208][52664] Sum rewards: -2.283, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.263', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.024', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'AMMO3': '0.150', 'HITCOUNT': '0.230', 'weapon6': '0.230', 'DAMAGECOUNT': '0.885', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.374', 'weapon3': '2.094'} [2024-08-05 21:50:50,562][52667] DAMAGECOUNT value on done: 1542.0 [2024-08-05 21:50:50,562][52667] Sum rewards: 1.103, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO2': '0.028', 'weapon4': '0.072', 'AMMO4': '0.139', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'HITCOUNT': '0.510', 'ARMOR': '0.521', 'WEAPON3': '0.950', 'weapon2': '1.336', 'DAMAGECOUNT': '1.596', 'weapon3': '2.202', 'FRAGCOUNT': '6.000'} [2024-08-05 21:50:50,693][52663] DAMAGECOUNT value on done: 1959.0 [2024-08-05 21:50:50,693][52663] Sum rewards: 2.140, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.274', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.028', 'AMMO3': '0.098', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'weapon2': '1.334', 'DAMAGECOUNT': '1.386', 'weapon3': '1.788', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:50,760][52659] DAMAGECOUNT value on done: 1559.0 [2024-08-05 21:50:50,760][52659] Sum rewards: -2.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.482', 'AMMO2': '0.036', 'AMMO3': '0.152', 'AMMO4': '0.181', 'weapon4': '0.182', 'HITCOUNT': '0.190', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.816', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon3': '1.682', 'weapon2': '1.704'} [2024-08-05 21:50:50,790][52794] DAMAGECOUNT value on done: 1985.0 [2024-08-05 21:50:50,791][52794] Sum rewards: 3.639, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.540', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.070', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.428', 'weapon2': '1.710', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:50,828][52662] DAMAGECOUNT value on done: 1807.0 [2024-08-05 21:50:50,831][52662] Sum rewards: 2.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.852', 'AMMO2': '0.008', 'ARMOR': '0.040', 'AMMO4': '0.041', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.260', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.185', 'weapon2': '1.196', 'weapon3': '1.600', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:50,881][52669] DAMAGECOUNT value on done: 1574.0 [2024-08-05 21:50:50,881][52669] Sum rewards: 2.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.088', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.975', 'weapon2': '1.228', 'weapon3': '1.630', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:51,287][52649] DAMAGECOUNT value on done: 1780.0 [2024-08-05 21:50:51,295][52649] Sum rewards: 1.176, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.088', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.186', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'weapon3': '0.754', 'ARMOR': '0.876', 'DAMAGECOUNT': '1.185', 'weapon2': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:51,780][52660] DAMAGECOUNT value on done: 1613.0 [2024-08-05 21:50:51,784][52660] Sum rewards: 0.938, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.162', 'AMMO2': '0.020', 'AMMO4': '0.099', 'ARMOR': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.218', 'HITCOUNT': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.032', 'DAMAGECOUNT': '1.050', 'weapon3': '2.350', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:52,114][52668] DAMAGECOUNT value on done: 2031.0 [2024-08-05 21:50:52,116][52668] Sum rewards: 2.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.451', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.499', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.095', 'weapon2': '1.360', 'weapon3': '2.272', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:52,708][52658] DAMAGECOUNT value on done: 1267.0 [2024-08-05 21:50:52,708][52658] Sum rewards: -1.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.127', 'weapon4': '0.134', 'HITCOUNT': '0.280', 'ARMOR': '0.496', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.158', 'weapon3': '1.296', 'weapon2': '1.566'} [2024-08-05 21:50:52,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 26198016. Throughput: 0: 4249.8. Samples: 6553340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:50:52,794][52567] Avg episode reward: [(0, '0.475')] [2024-08-05 21:50:53,158][52647] DAMAGECOUNT value on done: 948.0 [2024-08-05 21:50:53,160][52647] Sum rewards: 0.828, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.816', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.100', 'HITCOUNT': '0.240', 'ARMOR': '0.515', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.909', 'weapon2': '1.430', 'weapon3': '1.754', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:53,198][52671] DAMAGECOUNT value on done: 2153.0 [2024-08-05 21:50:53,201][52671] Sum rewards: 2.687, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.003', 'AMMO4': '0.013', 'HEALTH': '0.086', 'AMMO3': '0.088', 'HITCOUNT': '0.380', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.125', 'weapon3': '1.304', 'weapon2': '1.706', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:53,314][52794] DAMAGECOUNT value on done: 1578.0 [2024-08-05 21:50:53,314][52794] Sum rewards: -0.824, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.121', 'HITCOUNT': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.170', 'weapon2': '1.462', 'FRAGCOUNT': '2.000', 'weapon3': '2.280'} [2024-08-05 21:50:53,352][52664] DAMAGECOUNT value on done: 1099.0 [2024-08-05 21:50:53,352][52664] Sum rewards: -0.848, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.233', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon4': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.114', 'DAMAGECOUNT': '0.465', 'ARMOR': '0.573', 'WEAPON3': '0.750', 'weapon2': '1.604', 'FRAGCOUNT': '2.000', 'weapon3': '2.122'} [2024-08-05 21:50:53,407][52662] DAMAGECOUNT value on done: 1396.0 [2024-08-05 21:50:53,408][52662] Sum rewards: 3.270, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.990', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.091', 'HITCOUNT': '0.200', 'ARMOR': '0.478', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.699', 'weapon3': '1.644', 'weapon2': '1.832', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:53,473][52667] DAMAGECOUNT value on done: 1222.0 [2024-08-05 21:50:53,473][52667] Sum rewards: -1.369, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.318', 'AMMO4': '-0.098', 'AMMO2': '-0.019', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.170', 'weapon4': '0.242', 'ARMOR': '0.457', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.850', 'weapon3': '1.592', 'weapon2': '1.684', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:53,636][52663] DAMAGECOUNT value on done: 1355.0 [2024-08-05 21:50:53,638][52663] Sum rewards: 4.002, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'HEALTH': '0.178', 'weapon4': '0.220', 'HITCOUNT': '0.320', 'ARMOR': '0.448', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.095', 'weapon3': '1.176', 'weapon2': '1.946', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:53,724][52669] DAMAGECOUNT value on done: 1821.0 [2024-08-05 21:50:53,725][52669] Sum rewards: 0.439, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.870', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon4': '0.024', 'weapon5': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.320', 'ARMOR': '0.484', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.062', 'weapon2': '1.576', 'weapon3': '1.684', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:53,915][52650] Updated weights for policy 0, policy_version 3201 (0.0012) [2024-08-05 21:50:54,017][52649] DAMAGECOUNT value on done: 1717.0 [2024-08-05 21:50:54,023][52649] Sum rewards: 5.500, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.152', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '1.600', 'DAMAGECOUNT': '1.671', 'weapon3': '1.906', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:54,162][52659] DAMAGECOUNT value on done: 1831.0 [2024-08-05 21:50:54,162][52659] Sum rewards: -2.897, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'ARMOR': '0.106', 'AMMO3': '0.131', 'HITCOUNT': '0.140', 'weapon4': '0.244', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.040', 'weapon3': '1.834'} [2024-08-05 21:50:54,758][52660] DAMAGECOUNT value on done: 2031.0 [2024-08-05 21:50:54,758][52660] Sum rewards: -2.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.152', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'HITCOUNT': '0.220', 'weapon4': '0.224', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.882', 'WEAPON3': '1.050', 'weapon2': '1.348', 'weapon3': '2.186', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:54,958][52668] DAMAGECOUNT value on done: 1926.0 [2024-08-05 21:50:54,961][52668] Sum rewards: -0.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.032', 'AMMO3': '0.140', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'weapon2': '1.688', 'weapon3': '1.728', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:55,656][52671] DAMAGECOUNT value on done: 1517.0 [2024-08-05 21:50:55,657][52671] Sum rewards: -6.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.199', 'HITCOUNT': '0.290', 'ARMOR': '0.977', 'DAMAGECOUNT': '1.110', 'WEAPON3': '1.250', 'weapon2': '1.644', 'FRAGCOUNT': '2.000', 'weapon3': '2.142'} [2024-08-05 21:50:55,773][52647] DAMAGECOUNT value on done: 1532.0 [2024-08-05 21:50:55,774][52647] Sum rewards: -0.775, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.574', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'ARMOR': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.074', 'weapon2': '1.216', 'FRAGCOUNT': '2.000', 'weapon3': '2.106'} [2024-08-05 21:50:55,868][52658] DAMAGECOUNT value on done: 1559.0 [2024-08-05 21:50:55,981][52664] DAMAGECOUNT value on done: 1500.0 [2024-08-05 21:50:56,395][52794] DAMAGECOUNT value on done: 2069.0 [2024-08-05 21:50:56,395][52794] Sum rewards: -0.959, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.326', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.080', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.212', 'weapon2': '1.498', 'FRAGCOUNT': '2.000', 'weapon3': '2.112'} [2024-08-05 21:50:56,572][52662] DAMAGECOUNT value on done: 1255.0 [2024-08-05 21:50:56,572][52662] Sum rewards: -1.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.115', 'weapon4': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.800', 'weapon2': '1.742', 'weapon3': '1.804', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:56,585][52659] DAMAGECOUNT value on done: 1648.0 [2024-08-05 21:50:56,585][52659] Sum rewards: 2.344, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.600', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.028', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.624', 'weapon3': '1.694', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '4.000'} [2024-08-05 21:50:56,631][52667] DAMAGECOUNT value on done: 1622.0 [2024-08-05 21:50:56,631][52667] Sum rewards: -2.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.348', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.029', 'weapon6': '0.082', 'AMMO3': '0.120', 'AMMO6': '0.182', 'AMMO7': '0.182', 'WEAPON6': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.230', 'weapon2': '1.394', 'weapon3': '1.906', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:56,669][52663] DAMAGECOUNT value on done: 2139.0 [2024-08-05 21:50:56,670][52663] Sum rewards: 3.942, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'AMMO2': '0.001', 'AMMO4': '0.002', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.136', 'ARMOR': '0.492', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.264', 'DAMAGECOUNT': '1.911', 'weapon3': '2.346', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:56,772][52669] DAMAGECOUNT value on done: 1246.0 [2024-08-05 21:50:56,773][52669] Sum rewards: 0.585, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.322', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.085', 'HITCOUNT': '0.130', 'weapon4': '0.178', 'DAMAGECOUNT': '0.336', 'WEAPON3': '0.400', 'ARMOR': '0.528', 'weapon3': '1.174', 'weapon2': '1.936', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:57,096][52649] DAMAGECOUNT value on done: 1707.0 [2024-08-05 21:50:57,096][52649] Sum rewards: 0.311, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.011', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.108', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'ARMOR': '0.877', 'DAMAGECOUNT': '1.374', 'weapon2': '1.720', 'weapon3': '2.076', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:57,416][52660] DAMAGECOUNT value on done: 1405.0 [2024-08-05 21:50:57,417][52660] Sum rewards: 4.392, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.113', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.016', 'DAMAGECOUNT': '1.728', 'weapon3': '1.864', 'FRAGCOUNT': '6.000'} [2024-08-05 21:50:57,568][52668] DAMAGECOUNT value on done: 1492.0 [2024-08-05 21:50:57,568][52668] Sum rewards: 0.041, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'weapon4': '0.052', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon5': '0.120', 'HITCOUNT': '0.230', 'ARMOR': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon2': '1.546', 'weapon3': '1.646'} [2024-08-05 21:50:57,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17066.6, 300 sec: 16994.9). Total num frames: 26279936. Throughput: 0: 4247.1. Samples: 6578780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:50:57,795][52567] Avg episode reward: [(0, '0.230')] [2024-08-05 21:50:58,414][52647] DAMAGECOUNT value on done: 1974.0 [2024-08-05 21:50:58,414][52647] Sum rewards: -1.259, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.488', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.004', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon4': '0.154', 'HITCOUNT': '0.340', 'ARMOR': '0.524', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.458', 'FRAGCOUNT': '1.500', 'weapon2': '1.572', 'weapon3': '1.946'} [2024-08-05 21:50:58,558][52658] DAMAGECOUNT value on done: 2025.0 [2024-08-05 21:50:58,560][52658] Sum rewards: 2.439, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.030', 'AMMO4': '0.055', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.228', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.520', 'DAMAGECOUNT': '1.662', 'weapon3': '1.758', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:58,606][52671] DAMAGECOUNT value on done: 1544.0 [2024-08-05 21:50:58,608][52671] Sum rewards: 3.214, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.980', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.482', 'weapon2': '1.772', 'weapon3': '1.798', 'FRAGCOUNT': '6.000'} [2024-08-05 21:50:58,717][52664] DAMAGECOUNT value on done: 1349.0 [2024-08-05 21:50:58,717][52664] Sum rewards: 1.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.115', 'HITCOUNT': '0.320', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.065', 'weapon2': '1.756', 'weapon3': '1.968', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:59,086][52650] Updated weights for policy 0, policy_version 3211 (0.0014) [2024-08-05 21:50:59,161][52794] DAMAGECOUNT value on done: 1824.0 [2024-08-05 21:50:59,162][52794] Sum rewards: 3.421, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'weapon7': '0.084', 'AMMO4': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.224', 'HEALTH': '0.340', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.960', 'weapon2': '1.100', 'weapon3': '1.138', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:59,235][52662] DAMAGECOUNT value on done: 1543.0 [2024-08-05 21:50:59,235][52662] Sum rewards: -0.781, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.316', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.150', 'HITCOUNT': '0.210', 'weapon5': '0.320', 'ARMOR': '0.531', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.800', 'weapon2': '1.596', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'} [2024-08-05 21:50:59,567][52669] DAMAGECOUNT value on done: 1840.0 [2024-08-05 21:50:59,575][52663] DAMAGECOUNT value on done: 1359.0 [2024-08-05 21:50:59,577][52663] Sum rewards: 2.318, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.572', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.558', 'weapon3': '1.260', 'weapon2': '2.064', 'FRAGCOUNT': '3.000'} [2024-08-05 21:50:59,607][52667] DAMAGECOUNT value on done: 2115.0 [2024-08-05 21:50:59,608][52667] Sum rewards: 4.050, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.021', 'HEALTH': '0.023', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.104', 'weapon4': '0.178', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.143', 'weapon3': '1.224', 'weapon2': '1.400', 'FRAGCOUNT': '5.000'} [2024-08-05 21:50:59,780][52659] DAMAGECOUNT value on done: 1306.0 [2024-08-05 21:50:59,780][52659] Sum rewards: 0.100, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.350', 'ARMOR': '0.509', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.308', 'weapon2': '1.604', 'weapon3': '1.692', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:00,347][52660] DAMAGECOUNT value on done: 1403.0 [2024-08-05 21:51:00,347][52660] Sum rewards: 0.169, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.360', 'AMMO4': '-0.086', 'AMMO2': '-0.017', 'AMMO5': '0.010', 'ARMOR': '0.040', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'weapon5': '0.656', 'DAMAGECOUNT': '0.855', 'WEAPON3': '0.900', 'weapon2': '1.392', 'weapon3': '1.706', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:00,636][52668] DAMAGECOUNT value on done: 1697.0 [2024-08-05 21:51:00,638][52668] Sum rewards: -1.012, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'AMMO2': '0.006', 'AMMO4': '0.027', 'ARMOR': '0.052', 'AMMO3': '0.138', 'HITCOUNT': '0.350', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.365', 'weapon2': '1.454', 'FRAGCOUNT': '2.000', 'weapon3': '2.126'} [2024-08-05 21:51:01,309][52658] DAMAGECOUNT value on done: 1989.0 [2024-08-05 21:51:01,310][52658] Sum rewards: 0.398, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.024', 'AMMO2': '0.014', 'ARMOR': '0.028', 'AMMO4': '0.067', 'AMMO3': '0.132', 'HITCOUNT': '0.320', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.395', 'weapon2': '1.640', 'weapon3': '1.976', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:01,540][52794] DAMAGECOUNT value on done: 1042.0 [2024-08-05 21:51:01,559][52794] Sum rewards: 1.648, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.280', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.040', 'weapon7': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.300', 'weapon2': '0.456', 'DAMAGECOUNT': '0.549', 'weapon3': '0.828', 'FRAGCOUNT': '1.000'} [2024-08-05 21:51:01,634][52662] DAMAGECOUNT value on done: 2183.0 [2024-08-05 21:51:01,634][52662] Sum rewards: 0.321, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.276', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.024', 'AMMO4': '0.046', 'ARMOR': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO3': '0.115', 'HITCOUNT': '0.390', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.380', 'weapon3': '1.686', 'weapon2': '1.830', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:02,007][52671] DAMAGECOUNT value on done: 1559.0 [2024-08-05 21:51:02,067][52664] DAMAGECOUNT value on done: 1502.0 [2024-08-05 21:51:02,068][52664] Sum rewards: 1.631, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.327', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'AMMO3': '0.052', 'weapon5': '0.070', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.831', 'ARMOR': '0.858', 'weapon3': '1.110', 'weapon2': '1.624', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:02,115][52667] DAMAGECOUNT value on done: 1807.0 [2024-08-05 21:51:02,126][52663] DAMAGECOUNT value on done: 1528.0 [2024-08-05 21:51:02,130][52663] Sum rewards: 0.341, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.014', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.876', 'DAMAGECOUNT': '1.140', 'weapon3': '1.608', 'weapon2': '1.996', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 26370048. Throughput: 0: 4237.6. Samples: 6591250. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-05 21:51:02,794][52567] Avg episode reward: [(0, '0.254')] [2024-08-05 21:51:03,224][52659] DAMAGECOUNT value on done: 1295.0 [2024-08-05 21:51:03,229][52659] Sum rewards: -0.419, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.986', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'weapon5': '0.124', 'HITCOUNT': '0.230', 'ARMOR': '0.475', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.850', 'weapon2': '1.430', 'FRAGCOUNT': '2.000', 'weapon3': '2.044'} [2024-08-05 21:51:03,420][52650] Updated weights for policy 0, policy_version 3221 (0.0012) [2024-08-05 21:51:03,424][52660] DAMAGECOUNT value on done: 1602.0 [2024-08-05 21:51:03,425][52660] Sum rewards: -1.604, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.897', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.132', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.750', 'weapon2': '1.656', 'FRAGCOUNT': '2.000', 'weapon3': '2.108'} [2024-08-05 21:51:03,636][52668] DAMAGECOUNT value on done: 1804.0 [2024-08-05 21:51:03,636][52668] Sum rewards: 2.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.282', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.052', 'ARMOR': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.305', 'weapon2': '1.556', 'weapon3': '1.742', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:04,166][52794] DAMAGECOUNT value on done: 1867.0 [2024-08-05 21:51:04,166][52794] Sum rewards: -0.214, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.404', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.017', 'AMMO3': '0.182', 'HITCOUNT': '0.530', 'WEAPON3': '0.950', 'weapon2': '1.400', 'DAMAGECOUNT': '1.614', 'weapon3': '2.242', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:04,265][52662] DAMAGECOUNT value on done: 2444.0 [2024-08-05 21:51:04,266][52662] Sum rewards: 2.357, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.055', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.146', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.566', 'weapon3': '2.112', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:04,469][52658] DAMAGECOUNT value on done: 1404.0 [2024-08-05 21:51:04,471][52658] Sum rewards: -5.886, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.474', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'HITCOUNT': '0.110', 'AMMO3': '0.141', 'weapon5': '0.334', 'DAMAGECOUNT': '0.375', 'ARMOR': '0.448', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.576', 'weapon2': '1.880'} [2024-08-05 21:51:04,536][52663] DAMAGECOUNT value on done: 1161.0 [2024-08-05 21:51:04,537][52663] Sum rewards: 0.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.099', 'weapon4': '0.238', 'HITCOUNT': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.852', 'weapon3': '1.334', 'weapon2': '1.580', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:04,759][52664] DAMAGECOUNT value on done: 1533.0 [2024-08-05 21:51:04,760][52664] Sum rewards: -2.881, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.954', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.800', 'ARMOR': '0.836', 'weapon3': '1.386', 'weapon2': '1.858', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:05,132][52667] DAMAGECOUNT value on done: 1853.0 [2024-08-05 21:51:05,132][52667] Sum rewards: 1.461, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.777', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.039', 'HITCOUNT': '0.210', 'WEAPON3': '0.250', 'weapon3': '0.482', 'DAMAGECOUNT': '1.035', 'weapon2': '1.262', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:05,537][52671] DAMAGECOUNT value on done: 1116.0 [2024-08-05 21:51:05,540][52671] Sum rewards: 1.053, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.086', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.045', 'AMMO3': '0.105', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.780', 'weapon2': '1.048', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:06,497][52660] DAMAGECOUNT value on done: 1132.0 [2024-08-05 21:51:06,531][52794] DAMAGECOUNT value on done: 2165.0 [2024-08-05 21:51:06,532][52794] Sum rewards: 4.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.112', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.078', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'ARMOR': '0.436', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon3': '1.440', 'DAMAGECOUNT': '1.860', 'weapon2': '1.872', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:06,615][52662] DAMAGECOUNT value on done: 1695.0 [2024-08-05 21:51:06,667][52668] DAMAGECOUNT value on done: 1348.0 [2024-08-05 21:51:07,006][52659] DAMAGECOUNT value on done: 1673.0 [2024-08-05 21:51:07,006][52659] Sum rewards: -0.297, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.044', 'HITCOUNT': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO4': '0.101', 'AMMO3': '0.101', 'DAMAGECOUNT': '0.150', 'HEALTH': '0.188', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.788', 'weapon3': '1.810'} [2024-08-05 21:51:07,300][52658] DAMAGECOUNT value on done: 640.0 [2024-08-05 21:51:07,302][52658] Sum rewards: 0.910, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.440', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.085', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon5': '0.246', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.558', 'FRAGCOUNT': '1.000', 'weapon2': '1.566', 'weapon3': '1.694'} [2024-08-05 21:51:07,310][52663] DAMAGECOUNT value on done: 926.0 [2024-08-05 21:51:07,310][52663] Sum rewards: -1.299, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'ARMOR': '0.032', 'AMMO3': '0.114', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.486', 'weapon3': '2.052'} [2024-08-05 21:51:07,682][52664] DAMAGECOUNT value on done: 1350.0 [2024-08-05 21:51:07,684][52664] Sum rewards: -0.837, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.590', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'ARMOR': '0.040', 'AMMO3': '0.105', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.260', 'weapon3': '1.576', 'weapon2': '1.950', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:07,794][52567] Fps is (10 sec: 17203.7, 60 sec: 16930.2, 300 sec: 16994.9). Total num frames: 26451968. Throughput: 0: 4252.2. Samples: 6617140. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-05 21:51:07,795][52567] Avg episode reward: [(0, '0.140')] [2024-08-05 21:51:08,455][52650] Updated weights for policy 0, policy_version 3231 (0.0011) [2024-08-05 21:51:08,908][52671] DAMAGECOUNT value on done: 2343.0 [2024-08-05 21:51:08,909][52671] Sum rewards: -0.037, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.787', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.152', 'HITCOUNT': '0.400', 'ARMOR': '0.474', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.194', 'weapon2': '1.574', 'weapon3': '2.040', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:09,079][52794] DAMAGECOUNT value on done: 1549.0 [2024-08-05 21:51:09,079][52794] Sum rewards: 1.555, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.028', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'HEALTH': '0.171', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.870', 'weapon3': '1.242', 'weapon2': '1.622', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:09,168][52662] DAMAGECOUNT value on done: 1763.0 [2024-08-05 21:51:09,169][52662] Sum rewards: 3.972, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.636', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.127', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'ARMOR': '0.913', 'DAMAGECOUNT': '1.155', 'weapon2': '1.564', 'weapon3': '1.850', 'FRAGCOUNT': '8.000'} [2024-08-05 21:51:09,309][52660] DAMAGECOUNT value on done: 1435.0 [2024-08-05 21:51:09,311][52660] Sum rewards: 1.153, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.115', 'AMMO4': '-0.107', 'AMMO2': '-0.021', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.795', 'weapon3': '1.286', 'weapon2': '1.730', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:09,471][52668] DAMAGECOUNT value on done: 1287.0 [2024-08-05 21:51:09,936][52659] DAMAGECOUNT value on done: 1333.0 [2024-08-05 21:51:09,938][52659] Sum rewards: -4.399, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.064', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.072', 'HITCOUNT': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.366', 'ARMOR': '0.520', 'DAMAGECOUNT': '0.732', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.310', 'weapon3': '1.868'} [2024-08-05 21:51:10,598][52658] DAMAGECOUNT value on done: 1766.0 [2024-08-05 21:51:10,598][52658] Sum rewards: 0.853, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.709', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.105', 'weapon4': '0.138', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.756', 'ARMOR': '0.902', 'weapon3': '1.338', 'weapon2': '1.858', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:10,933][52664] DAMAGECOUNT value on done: 1847.0 [2024-08-05 21:51:10,934][52664] Sum rewards: -1.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.686', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon5': '0.244', 'HITCOUNT': '0.390', 'ARMOR': '0.454', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.326', 'weapon3': '1.410', 'weapon2': '1.660', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:11,526][52794] DAMAGECOUNT value on done: 1527.0 [2024-08-05 21:51:11,527][52794] Sum rewards: 3.769, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.880', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'WEAPON3': '0.250', 'weapon5': '0.288', 'HITCOUNT': '0.290', 'ARMOR': '0.454', 'weapon3': '0.700', 'DAMAGECOUNT': '1.068', 'weapon2': '1.520', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:11,631][52662] DAMAGECOUNT value on done: 1915.0 [2024-08-05 21:51:11,632][52662] Sum rewards: 2.622, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.084', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'ARMOR': '0.866', 'weapon3': '1.618', 'weapon2': '1.770', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:11,750][52671] DAMAGECOUNT value on done: 1822.0 [2024-08-05 21:51:11,752][52671] Sum rewards: 0.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.646', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.122', 'weapon4': '0.202', 'HITCOUNT': '0.260', 'ARMOR': '0.460', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.900', 'weapon2': '1.462', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:12,473][52660] DAMAGECOUNT value on done: 1371.0 [2024-08-05 21:51:12,475][52660] Sum rewards: 4.157, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.360', 'weapon4': '0.002', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.300', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.813', 'weapon2': '1.716', 'weapon3': '1.878', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:12,579][52668] DAMAGECOUNT value on done: 1808.0 [2024-08-05 21:51:12,579][52668] Sum rewards: 1.878, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.119', 'HITCOUNT': '0.340', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HEALTH': '0.796', 'DAMAGECOUNT': '1.395', 'weapon2': '1.688', 'weapon3': '1.868', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 26542080. Throughput: 0: 4246.9. Samples: 6642810. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:51:12,794][52567] Avg episode reward: [(0, '0.252')] [2024-08-05 21:51:12,851][52659] DAMAGECOUNT value on done: 1807.0 [2024-08-05 21:51:12,853][52659] Sum rewards: 2.712, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.034', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'ARMOR': '0.104', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.304', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'HEALTH': '0.604', 'weapon2': '1.326', 'DAMAGECOUNT': '1.557', 'weapon3': '1.708', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:13,069][52650] Updated weights for policy 0, policy_version 3241 (0.0014) [2024-08-05 21:51:13,632][52664] DAMAGECOUNT value on done: 1058.0 [2024-08-05 21:51:13,633][52664] Sum rewards: -1.003, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.028', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.230', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '1.360', 'weapon3': '2.302'} [2024-08-05 21:51:13,675][52658] DAMAGECOUNT value on done: 1510.0 [2024-08-05 21:51:13,675][52658] Sum rewards: -2.250, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.755', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'ARMOR': '0.032', 'AMMO3': '0.113', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.927', 'weapon2': '1.914', 'FRAGCOUNT': '2.000', 'weapon3': '2.040'} [2024-08-05 21:51:13,945][52794] DAMAGECOUNT value on done: 1815.0 [2024-08-05 21:51:13,947][52794] Sum rewards: 1.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.982', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO3': '0.094', 'HITCOUNT': '0.430', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.236', 'weapon3': '1.256', 'weapon2': '1.746', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:14,085][52662] DAMAGECOUNT value on done: 1818.0 [2024-08-05 21:51:14,086][52662] Sum rewards: 1.101, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.040', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.220', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon3': '1.406', 'weapon2': '2.012', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:14,636][52671] DAMAGECOUNT value on done: 1463.0 [2024-08-05 21:51:15,514][52659] DAMAGECOUNT value on done: 1840.0 [2024-08-05 21:51:15,516][52659] Sum rewards: -1.838, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.034', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.147', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.717', 'WEAPON3': '0.900', 'weapon2': '1.550', 'weapon3': '2.324', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:15,553][52660] DAMAGECOUNT value on done: 1270.0 [2024-08-05 21:51:15,738][52668] DAMAGECOUNT value on done: 1563.0 [2024-08-05 21:51:15,739][52668] Sum rewards: 3.166, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.754', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.060', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.434', 'weapon2': '1.498', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:15,914][52664] DAMAGECOUNT value on done: 1369.0 [2024-08-05 21:51:15,914][52664] Sum rewards: -4.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.040', 'weapon4': '0.046', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'HITCOUNT': '0.200', 'ARMOR': '0.511', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.670', 'weapon3': '2.032'} [2024-08-05 21:51:16,595][52794] DAMAGECOUNT value on done: 1575.0 [2024-08-05 21:51:16,811][52662] DAMAGECOUNT value on done: 1934.0 [2024-08-05 21:51:16,811][52662] Sum rewards: 0.137, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.060', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'ARMOR': '0.024', 'AMMO3': '0.147', 'HITCOUNT': '0.460', 'WEAPON3': '1.050', 'weapon2': '1.260', 'DAMAGECOUNT': '1.545', 'weapon3': '2.014', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:17,466][52671] DAMAGECOUNT value on done: 2215.0 [2024-08-05 21:51:17,467][52671] Sum rewards: -4.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.796', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'weapon5': '0.148', 'AMMO3': '0.151', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'weapon3': '1.470', 'weapon2': '1.744', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16994.9). Total num frames: 26615808. Throughput: 0: 4261.6. Samples: 6655870. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 21:51:17,794][52567] Avg episode reward: [(0, '0.108')] [2024-08-05 21:51:18,150][52659] DAMAGECOUNT value on done: 1279.0 [2024-08-05 21:51:18,151][52659] Sum rewards: -2.623, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.110', 'HITCOUNT': '0.190', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.528', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.506', 'weapon2': '1.690'} [2024-08-05 21:51:18,270][52650] Updated weights for policy 0, policy_version 3251 (0.0016) [2024-08-05 21:51:18,596][52664] DAMAGECOUNT value on done: 1850.0 [2024-08-05 21:51:18,641][52660] DAMAGECOUNT value on done: 1649.0 [2024-08-05 21:51:18,642][52660] Sum rewards: -0.418, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.180', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.943', 'DAMAGECOUNT': '1.068', 'weapon3': '1.514', 'weapon2': '1.528', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:18,798][52668] DAMAGECOUNT value on done: 1918.0 [2024-08-05 21:51:18,799][52668] Sum rewards: 1.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.772', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.168', 'HITCOUNT': '0.320', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.140', 'weapon2': '1.154', 'weapon3': '1.640', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:19,054][52794] DAMAGECOUNT value on done: 2771.0 [2024-08-05 21:51:19,054][52794] Sum rewards: 3.840, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.573', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.106', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.402', 'weapon3': '1.728', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:19,245][52662] DAMAGECOUNT value on done: 1425.0 [2024-08-05 21:51:19,246][52662] Sum rewards: 0.896, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'HITCOUNT': '0.290', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'weapon3': '1.214', 'DAMAGECOUNT': '1.281', 'weapon2': '1.622', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:20,110][52671] DAMAGECOUNT value on done: 1594.0 [2024-08-05 21:51:20,112][52671] Sum rewards: 0.282, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.661', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.270', 'weapon5': '0.378', 'WEAPON3': '0.800', 'ARMOR': '0.816', 'DAMAGECOUNT': '0.912', 'weapon2': '1.534', 'weapon3': '1.624', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:20,893][52659] DAMAGECOUNT value on done: 1811.0 [2024-08-05 21:51:20,895][52659] Sum rewards: 3.289, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.904', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'ARMOR': '0.008', 'AMMO3': '0.080', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.299', 'weapon2': '1.374', 'weapon3': '1.734', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:21,122][52794] DAMAGECOUNT value on done: 1875.0 [2024-08-05 21:51:21,122][52794] Sum rewards: -2.030, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.018', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'ARMOR': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon3': '1.724', 'weapon2': '1.726'} [2024-08-05 21:51:21,242][52660] DAMAGECOUNT value on done: 1723.0 [2024-08-05 21:51:21,244][52660] Sum rewards: 5.120, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.498', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.128', 'ARMOR': '0.436', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon3': '1.844', 'weapon2': '1.856', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:21,331][52662] DAMAGECOUNT value on done: 1705.0 [2024-08-05 21:51:21,331][52662] Sum rewards: 1.671, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.361', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.014', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon4': '0.176', 'HITCOUNT': '0.360', 'ARMOR': '0.493', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.245', 'weapon3': '1.266', 'weapon2': '2.026', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:21,472][52668] DAMAGECOUNT value on done: 1696.0 [2024-08-05 21:51:21,472][52668] Sum rewards: -3.679, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.636', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'weapon4': '0.064', 'AMMO3': '0.099', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'ARMOR': '0.991', 'weapon3': '1.384', 'FRAGCOUNT': '2.000', 'weapon2': '2.026'} [2024-08-05 21:51:22,558][52671] DAMAGECOUNT value on done: 1648.0 [2024-08-05 21:51:22,558][52671] Sum rewards: 1.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.331', 'AMMO5': '0.009', 'weapon5': '0.018', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.050', 'weapon2': '1.424', 'weapon3': '1.964', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:22,738][52650] Updated weights for policy 0, policy_version 3261 (0.0012) [2024-08-05 21:51:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17022.7). Total num frames: 26714112. Throughput: 0: 4267.8. Samples: 6681640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:51:22,795][52567] Avg episode reward: [(0, '0.047')] [2024-08-05 21:51:23,448][52794] DAMAGECOUNT value on done: 2035.0 [2024-08-05 21:51:23,448][52794] Sum rewards: 3.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.316', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.122', 'weapon4': '0.122', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.826', 'DAMAGECOUNT': '1.845', 'weapon3': '1.886', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:23,533][52659] DAMAGECOUNT value on done: 1688.0 [2024-08-05 21:51:23,533][52659] Sum rewards: 2.969, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.409', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.060', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.822', 'weapon2': '1.282', 'weapon3': '1.358', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:23,660][52662] DAMAGECOUNT value on done: 1611.0 [2024-08-05 21:51:23,662][52662] Sum rewards: -1.631, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.967', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'weapon5': '0.002', 'AMMO5': '0.003', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'ARMOR': '0.941', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.227', 'weapon2': '1.602', 'weapon3': '1.732'} [2024-08-05 21:51:24,219][52660] DAMAGECOUNT value on done: 1650.0 [2024-08-05 21:51:24,219][52660] Sum rewards: -4.536, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.866', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.060', 'weapon4': '0.060', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.810', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.694', 'weapon3': '1.750'} [2024-08-05 21:51:24,367][52668] DAMAGECOUNT value on done: 1603.0 [2024-08-05 21:51:24,369][52668] Sum rewards: 1.667, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.899', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.142', 'HITCOUNT': '0.270', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.972', 'weapon2': '1.232', 'weapon3': '1.600', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:25,872][52794] DAMAGECOUNT value on done: 1884.0 [2024-08-05 21:51:25,873][52794] Sum rewards: 1.022, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'HEALTH': '0.062', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon2': '1.392', 'weapon3': '1.482'} [2024-08-05 21:51:26,056][52671] DAMAGECOUNT value on done: 1306.0 [2024-08-05 21:51:26,057][52671] Sum rewards: 0.045, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.490', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.945', 'weapon2': '0.974', 'weapon3': '1.538', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:26,138][52662] DAMAGECOUNT value on done: 1933.0 [2024-08-05 21:51:26,138][52662] Sum rewards: 1.090, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.134', 'HITCOUNT': '0.270', 'DAMAGECOUNT': '0.801', 'WEAPON3': '0.850', 'weapon2': '1.348', 'weapon3': '2.328', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:26,975][52659] DAMAGECOUNT value on done: 2612.0 [2024-08-05 21:51:26,977][52659] Sum rewards: 1.367, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.168', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.040', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.320', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.750', 'weapon2': '1.090', 'weapon3': '2.248', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:27,146][52660] DAMAGECOUNT value on done: 1892.0 [2024-08-05 21:51:27,146][52660] Sum rewards: -0.802, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.450', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.124', 'weapon4': '0.188', 'HITCOUNT': '0.440', 'ARMOR': '0.527', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.359', 'weapon2': '1.650', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:27,318][52668] DAMAGECOUNT value on done: 1480.0 [2024-08-05 21:51:27,320][52668] Sum rewards: -1.310, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.130', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.077', 'weapon3': '1.780', 'weapon2': '1.868', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:27,425][52614] Signal inference workers to stop experience collection... (600 times) [2024-08-05 21:51:27,426][52614] Signal inference workers to resume experience collection... (600 times) [2024-08-05 21:51:27,479][52650] InferenceWorker_p0-w0: stopping experience collection (600 times) [2024-08-05 21:51:27,480][52650] InferenceWorker_p0-w0: resuming experience collection (600 times) [2024-08-05 21:51:27,519][52650] Updated weights for policy 0, policy_version 3271 (0.0039) [2024-08-05 21:51:27,794][52567] Fps is (10 sec: 18841.2, 60 sec: 17203.2, 300 sec: 17022.7). Total num frames: 26804224. Throughput: 0: 4268.4. Samples: 6707040. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:51:27,802][52567] Avg episode reward: [(0, '0.032')] [2024-08-05 21:51:28,283][52794] DAMAGECOUNT value on done: 1870.0 [2024-08-05 21:51:28,284][52794] Sum rewards: -3.307, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.500', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'ARMOR': '0.056', 'AMMO3': '0.143', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.702', 'weapon3': '1.854'} [2024-08-05 21:51:28,500][52662] DAMAGECOUNT value on done: 1491.0 [2024-08-05 21:51:28,500][52662] Sum rewards: 3.376, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.545', 'AMMO2': '0.013', 'weapon7': '0.062', 'AMMO4': '0.063', 'AMMO3': '0.071', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.310', 'ARMOR': '0.456', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.196', 'weapon2': '1.316', 'DAMAGECOUNT': '1.794', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:29,369][52671] DAMAGECOUNT value on done: 1096.0 [2024-08-05 21:51:29,371][52671] Sum rewards: -1.971, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.572', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'ARMOR': '0.054', 'AMMO3': '0.113', 'HITCOUNT': '0.180', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.852', 'FRAGCOUNT': '1.000', 'weapon2': '1.422', 'weapon3': '1.924'} [2024-08-05 21:51:30,294][52659] DAMAGECOUNT value on done: 1720.0 [2024-08-05 21:51:30,295][52659] Sum rewards: 2.130, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.360', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon4': '0.030', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon2': '1.422', 'DAMAGECOUNT': '1.680', 'weapon3': '2.000', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:30,551][52660] DAMAGECOUNT value on done: 1833.0 [2024-08-05 21:51:30,652][52668] DAMAGECOUNT value on done: 1334.0 [2024-08-05 21:51:30,652][52668] Sum rewards: -1.235, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.380', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.109', 'HITCOUNT': '0.220', 'ARMOR': '0.515', 'DAMAGECOUNT': '0.651', 'WEAPON3': '0.750', 'weapon3': '1.446', 'weapon2': '1.944', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:31,227][52794] DAMAGECOUNT value on done: 2528.0 [2024-08-05 21:51:31,228][52794] Sum rewards: -0.176, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.108', 'AMMO3': '0.132', 'AMMO4': '0.152', 'weapon4': '0.254', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.221', 'weapon2': '1.580', 'weapon3': '1.584', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:31,484][52662] DAMAGECOUNT value on done: 2440.0 [2024-08-05 21:51:31,485][52662] Sum rewards: 5.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.270', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon2': '1.306', 'weapon3': '2.090', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '7.000'} [2024-08-05 21:51:32,253][52671] DAMAGECOUNT value on done: 1922.0 [2024-08-05 21:51:32,253][52671] Sum rewards: 1.858, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.981', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'weapon2': '0.828', 'DAMAGECOUNT': '1.146', 'weapon3': '1.294', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:32,389][52650] Updated weights for policy 0, policy_version 3281 (0.0020) [2024-08-05 21:51:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17050.5). Total num frames: 26886144. Throughput: 0: 4270.7. Samples: 6719930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 21:51:32,794][52567] Avg episode reward: [(0, '0.214')] [2024-08-05 21:51:33,378][52660] DAMAGECOUNT value on done: 1567.0 [2024-08-05 21:51:33,381][52660] Sum rewards: 1.678, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'ARMOR': '0.040', 'AMMO3': '0.084', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.002', 'weapon3': '1.778', 'weapon2': '1.814', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:33,481][52668] DAMAGECOUNT value on done: 1261.0 [2024-08-05 21:51:33,481][52659] DAMAGECOUNT value on done: 2048.0 [2024-08-05 21:51:33,481][52668] Sum rewards: 3.055, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.483', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.040', 'HITCOUNT': '0.240', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.735', 'weapon3': '0.876', 'ARMOR': '0.959', 'weapon2': '1.416', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:33,483][52659] Sum rewards: -2.665, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.631', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.216', 'HITCOUNT': '0.280', 'ARMOR': '0.516', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.987', 'weapon3': '1.366', 'weapon2': '1.672', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:33,570][52794] DAMAGECOUNT value on done: 1717.0 [2024-08-05 21:51:33,571][52794] Sum rewards: -1.588, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.655', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.104', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.930', 'ARMOR': '0.962', 'weapon2': '1.686', 'weapon3': '1.702', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:33,981][52662] DAMAGECOUNT value on done: 1947.0 [2024-08-05 21:51:34,392][52666] DAMAGECOUNT value on done: 983.0 [2024-08-05 21:51:34,393][52666] Sum rewards: -4.220, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.210', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.722', 'weapon3': '1.764'} [2024-08-05 21:51:35,756][52671] DAMAGECOUNT value on done: 2291.0 [2024-08-05 21:51:35,756][52671] Sum rewards: -0.626, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.762', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.220', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.572'} [2024-08-05 21:51:36,436][52660] DAMAGECOUNT value on done: 1935.0 [2024-08-05 21:51:36,436][52660] Sum rewards: 3.406, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.241', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.113', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.786', 'weapon3': '2.042', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:36,820][52659] DAMAGECOUNT value on done: 1576.0 [2024-08-05 21:51:36,839][52670] DAMAGECOUNT value on done: 1762.0 [2024-08-05 21:51:36,840][52670] Sum rewards: 2.289, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.447', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.051', 'AMMO3': '0.104', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'weapon2': '1.130', 'DAMAGECOUNT': '1.323', 'weapon3': '1.782', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:36,932][52662] DAMAGECOUNT value on done: 1572.0 [2024-08-05 21:51:37,041][52650] Updated weights for policy 0, policy_version 3291 (0.0012) [2024-08-05 21:51:37,094][52666] DAMAGECOUNT value on done: 1966.0 [2024-08-05 21:51:37,095][52666] Sum rewards: 1.321, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.123', 'HITCOUNT': '0.430', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.560', 'weapon2': '1.874', 'weapon3': '2.010', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:37,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 26968064. Throughput: 0: 4279.8. Samples: 6745930. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:51:37,794][52567] Avg episode reward: [(0, '0.059')] [2024-08-05 21:51:38,699][52671] DAMAGECOUNT value on done: 1475.0 [2024-08-05 21:51:38,699][52671] Sum rewards: -1.714, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.420', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'ARMOR': '0.004', 'AMMO3': '0.071', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.897', 'weapon3': '1.474', 'weapon2': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:39,375][52659] DAMAGECOUNT value on done: 2075.0 [2024-08-05 21:51:39,375][52659] Sum rewards: 6.976, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.456', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.162', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.730', 'weapon3': '1.158', 'weapon2': '1.890', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2024-08-05 21:51:39,795][52670] DAMAGECOUNT value on done: 1599.0 [2024-08-05 21:51:39,795][52670] Sum rewards: 0.754, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.072', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.125', 'weapon2': '1.272', 'weapon3': '1.878', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:40,013][52666] DAMAGECOUNT value on done: 1748.0 [2024-08-05 21:51:40,015][52666] Sum rewards: 2.222, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.015', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.024', 'weapon4': '0.058', 'weapon5': '0.076', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'weapon3': '1.472', 'DAMAGECOUNT': '1.536', 'weapon2': '1.590', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:41,544][52671] DAMAGECOUNT value on done: 1761.0 [2024-08-05 21:51:41,548][52671] Sum rewards: 5.753, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.032', 'AMMO3': '0.070', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.104', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'HEALTH': '0.844', 'DAMAGECOUNT': '1.140', 'weapon3': '1.342', 'weapon2': '1.558', 'FRAGCOUNT': '5.000'} [2024-08-05 21:51:41,906][52650] Updated weights for policy 0, policy_version 3301 (0.0028) [2024-08-05 21:51:42,237][52659] DAMAGECOUNT value on done: 1491.0 [2024-08-05 21:51:42,645][52670] DAMAGECOUNT value on done: 1622.0 [2024-08-05 21:51:42,646][52670] Sum rewards: 0.503, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.024', 'ARMOR': '0.032', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'weapon5': '0.080', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'weapon3': '0.882', 'DAMAGECOUNT': '0.945', 'weapon2': '1.388', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:42,769][52666] DAMAGECOUNT value on done: 1257.0 [2024-08-05 21:51:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.2, 300 sec: 16994.9). Total num frames: 27049984. Throughput: 0: 4290.0. Samples: 6771830. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:51:42,794][52567] Avg episode reward: [(0, '0.123')] [2024-08-05 21:51:44,831][52659] DAMAGECOUNT value on done: 2028.0 [2024-08-05 21:51:44,831][52659] Sum rewards: -1.943, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.850', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'ARMOR': '0.044', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon5': '0.292', 'DAMAGECOUNT': '0.948', 'WEAPON3': '1.000', 'weapon2': '1.040', 'FRAGCOUNT': '2.000', 'weapon3': '2.070'} [2024-08-05 21:51:45,949][52670] DAMAGECOUNT value on done: 1822.0 [2024-08-05 21:51:45,949][52670] Sum rewards: 2.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.805', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.117', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.236', 'weapon3': '1.462', 'weapon2': '2.170', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:46,074][52666] DAMAGECOUNT value on done: 1325.0 [2024-08-05 21:51:46,079][52666] Sum rewards: -1.805, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.330', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.044', 'weapon5': '0.086', 'AMMO4': '0.130', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.186', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.096', 'FRAGCOUNT': '2.000', 'weapon3': '2.012'} [2024-08-05 21:51:46,504][52650] Updated weights for policy 0, policy_version 3311 (0.0014) [2024-08-05 21:51:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.4, 300 sec: 17022.7). Total num frames: 27140096. Throughput: 0: 4302.4. Samples: 6784860. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 21:51:47,802][52567] Avg episode reward: [(0, '0.073')] [2024-08-05 21:51:49,183][52670] DAMAGECOUNT value on done: 1317.0 [2024-08-05 21:51:49,187][52670] Sum rewards: -6.608, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.348', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'HITCOUNT': '0.140', 'AMMO3': '0.192', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.452', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.692', 'weapon3': '1.968'} [2024-08-05 21:51:49,379][52666] DAMAGECOUNT value on done: 1749.0 [2024-08-05 21:51:49,381][52666] Sum rewards: 2.275, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.025', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'ARMOR': '0.116', 'HITCOUNT': '0.140', 'weapon4': '0.174', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.600', 'weapon2': '1.054', 'weapon3': '1.404', 'FRAGCOUNT': '2.000'} [2024-08-05 21:51:51,707][52650] Updated weights for policy 0, policy_version 3321 (0.0013) [2024-08-05 21:51:52,268][52670] DAMAGECOUNT value on done: 1717.0 [2024-08-05 21:51:52,269][52670] Sum rewards: -1.897, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.100', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'HITCOUNT': '0.100', 'AMMO4': '0.127', 'weapon5': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.234', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.550', 'ARMOR': '0.907', 'FRAGCOUNT': '1.000', 'weapon3': '1.404', 'weapon2': '1.888'} [2024-08-05 21:51:52,444][52666] DAMAGECOUNT value on done: 1902.0 [2024-08-05 21:51:52,445][52666] Sum rewards: 1.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.940', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO3': '0.126', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.512', 'weapon2': '1.602', 'weapon3': '1.700', 'FRAGCOUNT': '3.000'} [2024-08-05 21:51:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17203.2, 300 sec: 17050.5). Total num frames: 27230208. Throughput: 0: 4292.9. Samples: 6810320. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 21:51:52,795][52567] Avg episode reward: [(0, '0.023')] [2024-08-05 21:51:55,230][52670] DAMAGECOUNT value on done: 1732.0 [2024-08-05 21:51:55,232][52670] Sum rewards: 2.565, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO2': '0.004', 'weapon4': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'WEAPON5': '0.200', 'weapon5': '0.300', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'ARMOR': '0.951', 'DAMAGECOUNT': '1.320', 'weapon3': '1.322', 'weapon2': '1.598', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:55,495][52666] DAMAGECOUNT value on done: 1119.0 [2024-08-05 21:51:55,495][52666] Sum rewards: 0.275, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'HEALTH': '0.080', 'AMMO3': '0.095', 'HITCOUNT': '0.100', 'weapon5': '0.106', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.285', 'weapon4': '0.302', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon3': '1.340', 'weapon2': '1.346'} [2024-08-05 21:51:55,981][52650] Updated weights for policy 0, policy_version 3331 (0.0011) [2024-08-05 21:51:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 16994.9). Total num frames: 27303936. Throughput: 0: 4300.7. Samples: 6836340. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-05 21:51:57,802][52567] Avg episode reward: [(0, '0.087')] [2024-08-05 21:51:58,676][52670] DAMAGECOUNT value on done: 1470.0 [2024-08-05 21:51:58,679][52670] Sum rewards: 2.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.197', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.164', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.116', 'weapon3': '1.276', 'weapon2': '1.786', 'FRAGCOUNT': '4.000'} [2024-08-05 21:51:58,750][52659] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 21:51:58,909][52666] DAMAGECOUNT value on done: 1668.0 [2024-08-05 21:52:01,217][52650] Updated weights for policy 0, policy_version 3341 (0.0018) [2024-08-05 21:52:01,866][52670] DAMAGECOUNT value on done: 715.0 [2024-08-05 21:52:01,867][52670] Sum rewards: -2.219, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.466', 'AMMO5': '0.004', 'AMMO2': '0.049', 'weapon7': '0.060', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.160', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'weapon4': '0.474', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'weapon3': '1.334', 'weapon2': '1.368'} [2024-08-05 21:52:02,119][52666] DAMAGECOUNT value on done: 1848.0 [2024-08-05 21:52:02,119][52666] Sum rewards: 0.883, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.874', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.010', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.490', 'WEAPON3': '0.900', 'weapon2': '1.274', 'DAMAGECOUNT': '1.611', 'weapon3': '2.000', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17050.5). Total num frames: 27402240. Throughput: 0: 4288.4. Samples: 6848850. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 21:52:02,794][52567] Avg episode reward: [(0, '0.064')] [2024-08-05 21:52:05,236][52670] DAMAGECOUNT value on done: 1272.0 [2024-08-05 21:52:05,239][52670] Sum rewards: 0.912, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.238', 'AMMO2': '0.005', 'AMMO4': '0.027', 'ARMOR': '0.029', 'HITCOUNT': '0.070', 'AMMO3': '0.095', 'DAMAGECOUNT': '0.180', 'WEAPON3': '0.600', 'weapon2': '1.558', 'weapon3': '1.836', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:05,414][52666] DAMAGECOUNT value on done: 1811.0 [2024-08-05 21:52:05,705][52650] Updated weights for policy 0, policy_version 3351 (0.0044) [2024-08-05 21:52:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17203.2, 300 sec: 17050.5). Total num frames: 27484160. Throughput: 0: 4291.1. Samples: 6874740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:52:07,802][52567] Avg episode reward: [(0, '0.027')] [2024-08-05 21:52:08,321][52670] DAMAGECOUNT value on done: 1737.0 [2024-08-05 21:52:08,570][52666] DAMAGECOUNT value on done: 1620.0 [2024-08-05 21:52:08,571][52666] Sum rewards: 2.923, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.128', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.078', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'weapon3': '1.142', 'weapon2': '1.192', 'DAMAGECOUNT': '1.260', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:10,398][52650] Updated weights for policy 0, policy_version 3361 (0.0020) [2024-08-05 21:52:11,519][52670] DAMAGECOUNT value on done: 2092.0 [2024-08-05 21:52:11,522][52670] Sum rewards: 5.131, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.099', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.646', 'weapon3': '1.818', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '6.000'} [2024-08-05 21:52:11,725][52666] DAMAGECOUNT value on done: 1268.0 [2024-08-05 21:52:11,726][52666] Sum rewards: 1.350, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.940', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'ARMOR': '0.036', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.687', 'weapon2': '1.182', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17022.7). Total num frames: 27574272. Throughput: 0: 4297.1. Samples: 6900410. Policy #0 lag: (min: 0.0, avg: 2.9, max: 9.0) [2024-08-05 21:52:12,795][52567] Avg episode reward: [(0, '0.187')] [2024-08-05 21:52:14,765][52670] DAMAGECOUNT value on done: 1551.0 [2024-08-05 21:52:14,765][52670] Sum rewards: -1.602, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.753', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.149', 'weapon4': '0.216', 'HITCOUNT': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.272', 'DAMAGECOUNT': '1.515', 'weapon3': '2.238', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:14,992][52666] DAMAGECOUNT value on done: 1625.0 [2024-08-05 21:52:14,994][52666] Sum rewards: 2.230, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.870', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.060', 'weapon7': '0.062', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.260', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.816', 'weapon3': '1.386', 'weapon2': '1.864', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:15,366][52650] Updated weights for policy 0, policy_version 3371 (0.0020) [2024-08-05 21:52:17,510][52670] DAMAGECOUNT value on done: 1808.0 [2024-08-05 21:52:17,512][52670] Sum rewards: 3.681, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.199', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.130', 'HITCOUNT': '0.370', 'ARMOR': '0.463', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.224', 'weapon3': '1.606', 'weapon2': '2.082', 'FRAGCOUNT': '5.000'} [2024-08-05 21:52:17,708][52666] DAMAGECOUNT value on done: 1668.0 [2024-08-05 21:52:17,711][52666] Sum rewards: -1.215, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.325', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon4': '0.026', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.509', 'weapon2': '1.732', 'FRAGCOUNT': '2.000', 'weapon3': '2.076'} [2024-08-05 21:52:17,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17203.1, 300 sec: 17050.4). Total num frames: 27648000. Throughput: 0: 4294.2. Samples: 6913170. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:52:17,795][52567] Avg episode reward: [(0, '0.202')] [2024-08-05 21:52:20,266][52650] Updated weights for policy 0, policy_version 3381 (0.0039) [2024-08-05 21:52:21,028][52811] DAMAGECOUNT value on done: 1852.0 [2024-08-05 21:52:21,028][52811] Sum rewards: 0.779, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.448', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.168', 'HITCOUNT': '0.310', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.098', 'weapon3': '1.498', 'weapon2': '1.806', 'FRAGCOUNT': '4.000'} [2024-08-05 21:52:21,114][52670] DAMAGECOUNT value on done: 1721.0 [2024-08-05 21:52:21,116][52670] Sum rewards: -2.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.920', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.103', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon3': '1.310', 'weapon2': '1.890'} [2024-08-05 21:52:21,304][52666] DAMAGECOUNT value on done: 1424.0 [2024-08-05 21:52:21,306][52666] Sum rewards: -0.611, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.894', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.945', 'weapon3': '1.698', 'FRAGCOUNT': '2.000', 'weapon2': '2.056'} [2024-08-05 21:52:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 27738112. Throughput: 0: 4289.8. Samples: 6938970. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-05 21:52:22,794][52567] Avg episode reward: [(0, '0.122')] [2024-08-05 21:52:23,211][52803] DAMAGECOUNT value on done: 1689.0 [2024-08-05 21:52:23,219][52803] Sum rewards: -3.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO2': '0.016', 'ARMOR': '0.052', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon4': '0.214', 'HITCOUNT': '0.370', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon2': '1.158', 'weapon3': '2.402'} [2024-08-05 21:52:24,015][52670] DAMAGECOUNT value on done: 1191.0 [2024-08-05 21:52:24,022][52670] Sum rewards: 3.640, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.227', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.108', 'AMMO3': '0.118', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '0.950', 'DAMAGECOUNT': '1.359', 'weapon2': '1.612', 'weapon3': '1.744', 'FRAGCOUNT': '6.000'} [2024-08-05 21:52:24,205][52666] DAMAGECOUNT value on done: 1235.0 [2024-08-05 21:52:24,205][52666] Sum rewards: -2.487, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'ARMOR': '0.076', 'AMMO3': '0.110', 'HITCOUNT': '0.180', 'weapon4': '0.190', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.700', 'weapon2': '1.610', 'weapon3': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:24,383][52811] DAMAGECOUNT value on done: 1413.0 [2024-08-05 21:52:24,384][52811] Sum rewards: -0.524, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.296', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.013', 'weapon5': '0.036', 'AMMO3': '0.078', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.410', 'weapon2': '1.610'} [2024-08-05 21:52:24,666][52650] Updated weights for policy 0, policy_version 3391 (0.0014) [2024-08-05 21:52:26,476][52803] DAMAGECOUNT value on done: 2027.0 [2024-08-05 21:52:26,478][52803] Sum rewards: 3.852, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.100', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.086', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.302', 'weapon3': '1.466', 'weapon2': '1.516', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:26,634][52795] DAMAGECOUNT value on done: 1150.0 [2024-08-05 21:52:26,634][52795] Sum rewards: -4.156, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.780', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.004', 'AMMO4': '0.014', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.092', 'AMMO3': '0.138', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.837', 'WEAPON3': '0.850', 'weapon2': '1.438', 'weapon3': '1.870'} [2024-08-05 21:52:27,332][52670] DAMAGECOUNT value on done: 1792.0 [2024-08-05 21:52:27,334][52670] Sum rewards: -1.711, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.780', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.112', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.110', 'weapon2': '1.366', 'weapon3': '1.918', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:27,545][52811] DAMAGECOUNT value on done: 1892.0 [2024-08-05 21:52:27,545][52811] Sum rewards: 2.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.061', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.530', 'weapon2': '1.634', 'weapon3': '1.650', 'FRAGCOUNT': '4.000'} [2024-08-05 21:52:27,640][52666] DAMAGECOUNT value on done: 1968.0 [2024-08-05 21:52:27,640][52666] Sum rewards: -0.616, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.248', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.107', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'ARMOR': '0.882', 'weapon3': '1.244', 'DAMAGECOUNT': '1.338', 'weapon2': '1.532', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:27,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17066.7, 300 sec: 17078.3). Total num frames: 27828224. Throughput: 0: 4290.4. Samples: 6964900. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 21:52:27,794][52567] Avg episode reward: [(0, '-0.022')] [2024-08-05 21:52:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003397_27828224.pth... [2024-08-05 21:52:27,945][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000002897_23732224.pth [2024-08-05 21:52:29,482][52650] Updated weights for policy 0, policy_version 3401 (0.0015) [2024-08-05 21:52:29,755][52803] DAMAGECOUNT value on done: 1641.0 [2024-08-05 21:52:29,757][52803] Sum rewards: -4.056, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.540', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.170', 'HITCOUNT': '0.340', 'ARMOR': '0.454', 'DAMAGECOUNT': '1.125', 'weapon2': '1.140', 'WEAPON3': '1.200', 'FRAGCOUNT': '2.000', 'weapon3': '2.494'} [2024-08-05 21:52:30,266][52795] DAMAGECOUNT value on done: 1731.0 [2024-08-05 21:52:30,267][52795] Sum rewards: 2.681, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.832', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.120', 'HITCOUNT': '0.360', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.252', 'DAMAGECOUNT': '1.335', 'weapon3': '1.904', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:30,752][52670] DAMAGECOUNT value on done: 2438.0 [2024-08-05 21:52:30,752][52670] Sum rewards: 0.874, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.641', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.330', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.951', 'weapon2': '1.700', 'weapon3': '2.124', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:30,810][52811] DAMAGECOUNT value on done: 1732.0 [2024-08-05 21:52:30,812][52811] Sum rewards: -0.823, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.264', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.136', 'HITCOUNT': '0.250', 'weapon4': '0.306', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.026', 'weapon2': '1.058', 'FRAGCOUNT': '2.000', 'weapon3': '2.008'} [2024-08-05 21:52:30,884][52666] DAMAGECOUNT value on done: 2311.0 [2024-08-05 21:52:30,884][52666] Sum rewards: 2.545, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.240', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON3': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.458', 'weapon3': '1.040', 'DAMAGECOUNT': '1.365', 'weapon2': '1.470', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 27910144. Throughput: 0: 4285.6. Samples: 6977710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:52:32,794][52567] Avg episode reward: [(0, '0.029')] [2024-08-05 21:52:33,105][52803] DAMAGECOUNT value on done: 3056.0 [2024-08-05 21:52:33,105][52803] Sum rewards: -0.258, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.892', 'AMMO2': '0.005', 'weapon4': '0.008', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'HITCOUNT': '0.220', 'ARMOR': '0.522', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.108', 'weapon2': '1.556'} [2024-08-05 21:52:33,291][52670] DAMAGECOUNT value on done: 1458.0 [2024-08-05 21:52:33,291][52670] Sum rewards: 0.788, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.650', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'ARMOR': '0.012', 'AMMO3': '0.141', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.816', 'WEAPON3': '0.900', 'weapon3': '1.786', 'weapon2': '2.062', 'FRAGCOUNT': '4.000'} [2024-08-05 21:52:33,311][52666] DAMAGECOUNT value on done: 1780.0 [2024-08-05 21:52:33,311][52666] Sum rewards: 3.756, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.178', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.190', 'WEAPON3': '0.400', 'ARMOR': '0.437', 'weapon5': '0.636', 'DAMAGECOUNT': '0.813', 'weapon3': '0.966', 'weapon2': '1.092', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:33,478][52795] DAMAGECOUNT value on done: 1912.0 [2024-08-05 21:52:33,478][52795] Sum rewards: 6.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.096', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'ARMOR': '0.500', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon3': '1.448', 'weapon2': '1.696', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '6.000'} [2024-08-05 21:52:33,973][52811] DAMAGECOUNT value on done: 1804.0 [2024-08-05 21:52:34,109][52650] Updated weights for policy 0, policy_version 3411 (0.0043) [2024-08-05 21:52:36,349][52803] DAMAGECOUNT value on done: 2266.0 [2024-08-05 21:52:36,350][52670] DAMAGECOUNT value on done: 1817.0 [2024-08-05 21:52:36,353][52803] Sum rewards: 4.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.979', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'weapon2': '1.276', 'weapon3': '1.754', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '7.000'} [2024-08-05 21:52:36,666][52795] DAMAGECOUNT value on done: 2968.0 [2024-08-05 21:52:36,669][52795] Sum rewards: 1.152, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.071', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.717', 'weapon2': '0.874', 'ARMOR': '0.886', 'weapon3': '0.922', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:37,082][52811] DAMAGECOUNT value on done: 1626.0 [2024-08-05 21:52:37,083][52811] Sum rewards: 0.615, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.578', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.136', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.455', 'weapon2': '1.480', 'weapon3': '1.966', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 28000256. Throughput: 0: 4293.6. Samples: 7003530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:52:37,794][52567] Avg episode reward: [(0, '0.307')] [2024-08-05 21:52:39,225][52650] Updated weights for policy 0, policy_version 3421 (0.0039) [2024-08-05 21:52:39,693][52803] DAMAGECOUNT value on done: 1992.0 [2024-08-05 21:52:39,693][52803] Sum rewards: -0.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.740', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'weapon4': '0.222', 'HITCOUNT': '0.330', 'ARMOR': '0.471', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.260', 'weapon2': '1.716', 'weapon3': '1.736', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:39,806][52795] DAMAGECOUNT value on done: 1684.0 [2024-08-05 21:52:39,807][52795] Sum rewards: 1.729, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.110', 'weapon4': '0.016', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO3': '0.072', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.717', 'weapon2': '0.852', 'weapon3': '1.048', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:40,445][52811] DAMAGECOUNT value on done: 1939.0 [2024-08-05 21:52:40,445][52811] Sum rewards: 0.875, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.480', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon2': '1.732', 'DAMAGECOUNT': '1.875', 'weapon3': '1.976', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 28082176. Throughput: 0: 4283.6. Samples: 7029100. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:52:42,794][52567] Avg episode reward: [(0, '0.285')] [2024-08-05 21:52:43,013][52803] DAMAGECOUNT value on done: 2619.0 [2024-08-05 21:52:43,013][52803] Sum rewards: 3.822, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.706', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.159', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'weapon2': '1.248', 'DAMAGECOUNT': '1.797', 'weapon3': '2.290', 'FRAGCOUNT': '6.000'} [2024-08-05 21:52:43,039][52795] DAMAGECOUNT value on done: 1918.0 [2024-08-05 21:52:43,039][52795] Sum rewards: 4.435, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.066', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.909', 'weapon3': '1.374', 'weapon2': '1.704', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '4.000'} [2024-08-05 21:52:43,712][52811] DAMAGECOUNT value on done: 997.0 [2024-08-05 21:52:43,712][52811] Sum rewards: -3.377, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.684', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.020', 'HITCOUNT': '0.150', 'AMMO3': '0.155', 'DAMAGECOUNT': '0.420', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.510', 'weapon3': '2.342'} [2024-08-05 21:52:43,967][52650] Updated weights for policy 0, policy_version 3431 (0.0011) [2024-08-05 21:52:46,273][52795] DAMAGECOUNT value on done: 1756.0 [2024-08-05 21:52:46,274][52795] Sum rewards: 0.778, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.582', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.016', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.380', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.275', 'weapon3': '1.754', 'weapon2': '1.774', 'FRAGCOUNT': '5.000'} [2024-08-05 21:52:46,280][52803] DAMAGECOUNT value on done: 1955.0 [2024-08-05 21:52:46,280][52803] Sum rewards: 4.352, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.185', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'ARMOR': '0.036', 'AMMO3': '0.070', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.400', 'weapon3': '1.634', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '5.000'} [2024-08-05 21:52:46,962][52811] DAMAGECOUNT value on done: 1436.0 [2024-08-05 21:52:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 28172288. Throughput: 0: 4291.8. Samples: 7041980. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 21:52:47,795][52567] Avg episode reward: [(0, '0.280')] [2024-08-05 21:52:48,792][52650] Updated weights for policy 0, policy_version 3441 (0.0030) [2024-08-05 21:52:49,607][52803] DAMAGECOUNT value on done: 1397.0 [2024-08-05 21:52:49,607][52803] Sum rewards: -1.300, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.099', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon5': '0.196', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.452', 'weapon3': '1.714'} [2024-08-05 21:52:49,655][52795] DAMAGECOUNT value on done: 1829.0 [2024-08-05 21:52:49,658][52795] Sum rewards: -0.040, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.095', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.084', 'AMMO3': '0.088', 'HITCOUNT': '0.230', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.948', 'weapon2': '1.210', 'weapon3': '1.504', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:50,046][52811] DAMAGECOUNT value on done: 1709.0 [2024-08-05 21:52:50,048][52811] Sum rewards: 2.042, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.228', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.125', 'HITCOUNT': '0.370', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.332', 'weapon2': '1.362', 'weapon3': '2.048', 'FRAGCOUNT': '5.000'} [2024-08-05 21:52:50,914][52820] DAMAGECOUNT value on done: 1501.0 [2024-08-05 21:52:50,917][52820] Sum rewards: -0.875, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.097', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.156', 'weapon4': '0.166', 'HITCOUNT': '0.290', 'weapon2': '0.812', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.245', 'weapon3': '2.342', 'FRAGCOUNT': '3.000'} [2024-08-05 21:52:52,745][52803] DAMAGECOUNT value on done: 1439.0 [2024-08-05 21:52:52,745][52803] Sum rewards: -6.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.143', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.374', 'ARMOR': '0.565', 'DAMAGECOUNT': '0.597', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.230', 'weapon2': '1.792'} [2024-08-05 21:52:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 28254208. Throughput: 0: 4293.3. Samples: 7067940. Policy #0 lag: (min: 0.0, avg: 4.1, max: 10.0) [2024-08-05 21:52:52,794][52567] Avg episode reward: [(0, '0.236')] [2024-08-05 21:52:53,028][52795] DAMAGECOUNT value on done: 1711.0 [2024-08-05 21:52:53,030][52795] Sum rewards: 0.342, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.255', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.166', 'HITCOUNT': '0.600', 'weapon2': '0.928', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.830', 'weapon3': '2.662', 'FRAGCOUNT': '5.000'} [2024-08-05 21:52:53,123][52811] DAMAGECOUNT value on done: 1788.0 [2024-08-05 21:52:53,125][52811] Sum rewards: 2.607, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.190', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'ARMOR': '0.008', 'weapon4': '0.080', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.356', 'weapon3': '1.642', 'weapon2': '1.836', 'FRAGCOUNT': '6.000'} [2024-08-05 21:52:53,437][52650] Updated weights for policy 0, policy_version 3451 (0.0018) [2024-08-05 21:52:54,307][52820] DAMAGECOUNT value on done: 1693.0 [2024-08-05 21:52:54,307][52820] Sum rewards: -0.223, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.739', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.014', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.774', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'weapon2': '1.388'} [2024-08-05 21:52:55,940][52803] DAMAGECOUNT value on done: 1495.0 [2024-08-05 21:52:55,942][52803] Sum rewards: 2.727, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HEALTH': '0.098', 'weapon4': '0.122', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon2': '1.476', 'weapon3': '1.526', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:56,194][52795] DAMAGECOUNT value on done: 1938.0 [2024-08-05 21:52:56,197][52795] Sum rewards: 2.991, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.282', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.136', 'HITCOUNT': '0.460', 'WEAPON3': '0.950', 'weapon2': '1.392', 'DAMAGECOUNT': '1.824', 'weapon3': '2.242', 'FRAGCOUNT': '6.000'} [2024-08-05 21:52:56,226][52811] DAMAGECOUNT value on done: 1537.0 [2024-08-05 21:52:56,227][52811] Sum rewards: -1.262, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.562', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.040', 'AMMO3': '0.097', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.614', 'weapon3': '1.878'} [2024-08-05 21:52:57,635][52820] DAMAGECOUNT value on done: 1610.0 [2024-08-05 21:52:57,636][52820] Sum rewards: 0.940, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.121', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.103', 'weapon7': '0.110', 'ARMOR': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.236', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.143', 'weapon2': '1.452', 'weapon3': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 21:52:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17078.2). Total num frames: 28344320. Throughput: 0: 4301.8. Samples: 7093990. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 21:52:57,794][52567] Avg episode reward: [(0, '0.270')] [2024-08-05 21:52:58,077][52650] Updated weights for policy 0, policy_version 3461 (0.0021) [2024-08-05 21:52:59,113][52803] DAMAGECOUNT value on done: 1760.0 [2024-08-05 21:52:59,114][52803] Sum rewards: 0.654, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.391', 'AMMO2': '0.012', 'ARMOR': '0.037', 'AMMO4': '0.060', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'weapon7': '0.142', 'WEAPON7': '0.200', 'weapon4': '0.282', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.132', 'weapon3': '1.690'} [2024-08-05 21:52:59,332][52795] DAMAGECOUNT value on done: 1692.0 [2024-08-05 21:52:59,333][52795] Sum rewards: 5.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'AMMO2': '0.023', 'ARMOR': '0.104', 'AMMO4': '0.116', 'AMMO3': '0.124', 'weapon4': '0.228', 'WEAPON4': '0.250', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.666', 'weapon3': '1.940', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '9.000'} [2024-08-05 21:52:59,343][52811] DAMAGECOUNT value on done: 1319.0 [2024-08-05 21:52:59,345][52811] Sum rewards: 1.790, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.038', 'weapon4': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.330', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.080', 'weapon3': '1.742', 'weapon2': '2.002', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:00,806][52665] DAMAGECOUNT value on done: 2579.0 [2024-08-05 21:53:00,806][52665] Sum rewards: -1.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'weapon5': '0.156', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.950', 'weapon2': '1.570', 'weapon3': '1.692', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:01,113][52820] DAMAGECOUNT value on done: 2052.0 [2024-08-05 21:53:01,114][52820] Sum rewards: 5.509, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.780', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.400', 'ARMOR': '0.492', 'WEAPON3': '0.800', 'weapon2': '1.352', 'weapon3': '1.734', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '8.000'} [2024-08-05 21:53:02,170][52803] DAMAGECOUNT value on done: 1553.0 [2024-08-05 21:53:02,170][52803] Sum rewards: -3.065, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'weapon5': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.116', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon2': '1.232', 'weapon3': '1.586'} [2024-08-05 21:53:02,602][52795] DAMAGECOUNT value on done: 1631.0 [2024-08-05 21:53:02,650][52811] DAMAGECOUNT value on done: 1436.0 [2024-08-05 21:53:02,652][52811] Sum rewards: -1.181, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'HITCOUNT': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.356', 'WEAPON3': '0.400', 'ARMOR': '0.446', 'DAMAGECOUNT': '0.711', 'FRAGCOUNT': '1.000', 'weapon3': '1.182', 'weapon2': '1.638'} [2024-08-05 21:53:02,779][52650] Updated weights for policy 0, policy_version 3471 (0.0041) [2024-08-05 21:53:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 28434432. Throughput: 0: 4306.3. Samples: 7106950. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:53:02,794][52567] Avg episode reward: [(0, '0.399')] [2024-08-05 21:53:03,598][52665] DAMAGECOUNT value on done: 1705.0 [2024-08-05 21:53:03,600][52665] Sum rewards: 2.789, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.582', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.118', 'HITCOUNT': '0.400', 'ARMOR': '0.483', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.173', 'weapon2': '1.288', 'weapon3': '1.498', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:04,564][52820] DAMAGECOUNT value on done: 1333.0 [2024-08-05 21:53:04,567][52820] Sum rewards: 3.076, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.576', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.032', 'AMMO3': '0.081', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.903', 'weapon2': '1.482', 'weapon3': '1.920', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:05,289][52803] DAMAGECOUNT value on done: 1988.0 [2024-08-05 21:53:05,289][52803] Sum rewards: 1.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.968', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'weapon5': '0.014', 'weapon7': '0.062', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon3': '0.976', 'DAMAGECOUNT': '1.326', 'FRAGCOUNT': '2.000', 'weapon2': '2.274'} [2024-08-05 21:53:05,746][52795] DAMAGECOUNT value on done: 1491.0 [2024-08-05 21:53:05,750][52795] Sum rewards: 2.354, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.021', 'AMMO3': '0.091', 'AMMO4': '0.104', 'HEALTH': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.026', 'weapon2': '1.150', 'weapon3': '1.902', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:05,753][52811] DAMAGECOUNT value on done: 2062.0 [2024-08-05 21:53:05,757][52811] Sum rewards: 1.214, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.780', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.040', 'AMMO3': '0.135', 'HITCOUNT': '0.380', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.290', 'weapon3': '1.506', 'weapon2': '1.532', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:06,466][52665] DAMAGECOUNT value on done: 2465.0 [2024-08-05 21:53:06,466][52665] Sum rewards: 3.536, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.312', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.010', 'ARMOR': '0.065', 'AMMO3': '0.117', 'weapon4': '0.136', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.454', 'weapon3': '1.770', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '6.000'} [2024-08-05 21:53:07,625][52650] Updated weights for policy 0, policy_version 3481 (0.0017) [2024-08-05 21:53:07,792][52820] DAMAGECOUNT value on done: 2361.0 [2024-08-05 21:53:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17203.1, 300 sec: 17078.2). Total num frames: 28516352. Throughput: 0: 4310.6. Samples: 7132950. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:53:07,800][52567] Avg episode reward: [(0, '0.464')] [2024-08-05 21:53:07,800][52820] Sum rewards: 4.391, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.488', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.218', 'ARMOR': '0.436', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.234', 'weapon2': '1.704', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:08,407][52803] DAMAGECOUNT value on done: 1246.0 [2024-08-05 21:53:08,407][52803] Sum rewards: 1.636, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.006', 'AMMO4': '0.027', 'ARMOR': '0.032', 'AMMO3': '0.140', 'HEALTH': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.449', 'weapon2': '1.528', 'weapon3': '2.204', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:08,815][52795] DAMAGECOUNT value on done: 2403.0 [2024-08-05 21:53:08,819][52795] Sum rewards: 0.001, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.805', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.020', 'AMMO3': '0.110', 'weapon4': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'weapon3': '1.350', 'weapon2': '1.380', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:08,964][52811] DAMAGECOUNT value on done: 1596.0 [2024-08-05 21:53:09,234][52665] DAMAGECOUNT value on done: 1104.0 [2024-08-05 21:53:09,546][52669] DAMAGECOUNT value on done: 1288.0 [2024-08-05 21:53:09,546][52669] Sum rewards: -0.971, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.270', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.045', 'HITCOUNT': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.182', 'DAMAGECOUNT': '0.195', 'WEAPON3': '0.750', 'weapon3': '1.382', 'weapon2': '1.494', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:09,970][52659] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 21:53:11,064][52820] DAMAGECOUNT value on done: 1502.0 [2024-08-05 21:53:11,064][52820] Sum rewards: 0.254, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.243', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.082', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.736', 'weapon3': '1.760'} [2024-08-05 21:53:11,627][52803] DAMAGECOUNT value on done: 1102.0 [2024-08-05 21:53:11,902][52795] DAMAGECOUNT value on done: 1753.0 [2024-08-05 21:53:11,904][52795] Sum rewards: 2.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.925', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.076', 'AMMO3': '0.086', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.281', 'weapon3': '1.580', 'weapon2': '1.882', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:12,112][52665] DAMAGECOUNT value on done: 1776.0 [2024-08-05 21:53:12,114][52665] Sum rewards: -6.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.782', 'AMMO2': '0.015', 'weapon4': '0.018', 'ARMOR': '0.036', 'AMMO4': '0.074', 'AMMO3': '0.159', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.750', 'WEAPON3': '1.100', 'weapon2': '1.514', 'FRAGCOUNT': '2.000', 'weapon3': '2.168'} [2024-08-05 21:53:12,214][52811] DAMAGECOUNT value on done: 1666.0 [2024-08-05 21:53:12,216][52811] Sum rewards: -1.941, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.110', 'AMMO3': '0.113', 'weapon4': '0.118', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.800', 'weapon3': '1.562', 'weapon2': '1.572', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:12,337][52650] Updated weights for policy 0, policy_version 3491 (0.0016) [2024-08-05 21:53:12,626][52669] DAMAGECOUNT value on done: 1671.0 [2024-08-05 21:53:12,626][52669] Sum rewards: -0.487, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.044', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'FRAGCOUNT': '1.000', 'weapon2': '1.216', 'weapon3': '1.228'} [2024-08-05 21:53:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 28606464. Throughput: 0: 4305.3. Samples: 7158640. Policy #0 lag: (min: 1.0, avg: 3.7, max: 9.0) [2024-08-05 21:53:12,795][52567] Avg episode reward: [(0, '0.354')] [2024-08-05 21:53:13,597][52647] DAMAGECOUNT value on done: 1373.0 [2024-08-05 21:53:13,597][52647] Sum rewards: 3.090, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.242', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.094', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'ARMOR': '0.876', 'DAMAGECOUNT': '1.080', 'weapon3': '1.296', 'weapon2': '1.920', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:14,352][52820] DAMAGECOUNT value on done: 2108.0 [2024-08-05 21:53:14,354][52820] Sum rewards: -7.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.164', 'HITCOUNT': '0.310', 'ARMOR': '0.454', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.152', 'weapon2': '1.436', 'weapon3': '2.120'} [2024-08-05 21:53:14,717][52803] DAMAGECOUNT value on done: 1326.0 [2024-08-05 21:53:14,720][52803] Sum rewards: 1.303, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.969', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.085', 'HITCOUNT': '0.320', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.975', 'weapon2': '1.336', 'weapon3': '1.488', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:15,061][52669] DAMAGECOUNT value on done: 1509.0 [2024-08-05 21:53:15,061][52669] Sum rewards: -0.679, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.032', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'ARMOR': '0.883', 'DAMAGECOUNT': '1.167', 'weapon3': '1.714', 'weapon2': '1.926', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:15,276][52795] DAMAGECOUNT value on done: 1766.0 [2024-08-05 21:53:15,277][52795] Sum rewards: 0.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.446', 'AMMO2': '0.011', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'ARMOR': '0.071', 'AMMO3': '0.119', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.380', 'DAMAGECOUNT': '1.500', 'weapon3': '1.994', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:15,362][52811] DAMAGECOUNT value on done: 1283.0 [2024-08-05 21:53:15,364][52811] Sum rewards: -0.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.761', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.042', 'AMMO3': '0.144', 'HITCOUNT': '0.320', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.215', 'weapon2': '1.472', 'FRAGCOUNT': '2.000', 'weapon3': '2.356'} [2024-08-05 21:53:15,445][52665] DAMAGECOUNT value on done: 1928.0 [2024-08-05 21:53:15,448][52665] Sum rewards: -2.375, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.737', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon5': '0.134', 'AMMO3': '0.136', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.470', 'weapon4': '0.598', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.254', 'weapon3': '1.290', 'weapon2': '1.294'} [2024-08-05 21:53:16,154][52647] DAMAGECOUNT value on done: 2323.0 [2024-08-05 21:53:17,079][52650] Updated weights for policy 0, policy_version 3501 (0.0028) [2024-08-05 21:53:17,333][52649] DAMAGECOUNT value on done: 1604.0 [2024-08-05 21:53:17,335][52649] Sum rewards: -0.621, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.800', 'AMMO4': '-0.087', 'AMMO2': '-0.017', 'AMMO5': '0.015', 'HITCOUNT': '0.060', 'AMMO3': '0.072', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.330', 'weapon5': '0.484', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.350', 'weapon3': '1.672'} [2024-08-05 21:53:17,615][52820] DAMAGECOUNT value on done: 1799.0 [2024-08-05 21:53:17,615][52820] Sum rewards: 4.499, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.210', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.320', 'weapon3': '2.050', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '6.000'} [2024-08-05 21:53:17,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17339.9, 300 sec: 17078.2). Total num frames: 28688384. Throughput: 0: 4308.2. Samples: 7171580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:53:17,794][52803] DAMAGECOUNT value on done: 1232.0 [2024-08-05 21:53:17,794][52567] Avg episode reward: [(0, '0.431')] [2024-08-05 21:53:17,802][52803] Sum rewards: -1.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.774', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'weapon5': '0.148', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.062', 'weapon2': '1.640', 'FRAGCOUNT': '2.000', 'weapon3': '2.058'} [2024-08-05 21:53:18,160][52669] DAMAGECOUNT value on done: 3327.0 [2024-08-05 21:53:18,162][52669] Sum rewards: 3.396, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.591', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.107', 'HITCOUNT': '0.430', 'ARMOR': '0.488', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.485', 'weapon3': '1.590', 'weapon2': '1.894', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:18,223][52665] DAMAGECOUNT value on done: 1555.0 [2024-08-05 21:53:18,227][52665] Sum rewards: -1.244, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.710', 'AMMO5': '0.004', 'AMMO2': '0.004', 'weapon5': '0.016', 'AMMO4': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.124', 'HITCOUNT': '0.390', 'WEAPON3': '0.900', 'weapon2': '1.202', 'DAMAGECOUNT': '1.260', 'weapon3': '1.954', 'FRAGCOUNT': '2.500'} [2024-08-05 21:53:18,474][52811] DAMAGECOUNT value on done: 2125.0 [2024-08-05 21:53:18,532][52795] DAMAGECOUNT value on done: 1510.0 [2024-08-05 21:53:18,534][52795] Sum rewards: 0.518, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.006', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.915', 'WEAPON3': '0.950', 'weapon2': '1.120', 'weapon3': '2.334', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:19,347][52663] DAMAGECOUNT value on done: 1687.0 [2024-08-05 21:53:19,347][52663] Sum rewards: -5.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.142', 'HITCOUNT': '0.230', 'ARMOR': '0.424', 'DAMAGECOUNT': '0.807', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.452', 'weapon3': '2.226'} [2024-08-05 21:53:19,435][52647] DAMAGECOUNT value on done: 1991.0 [2024-08-05 21:53:20,602][52649] DAMAGECOUNT value on done: 2096.0 [2024-08-05 21:53:20,602][52649] Sum rewards: -3.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.124', 'HITCOUNT': '0.210', 'ARMOR': '0.448', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.850', 'weapon2': '1.654', 'FRAGCOUNT': '2.000', 'weapon3': '2.210'} [2024-08-05 21:53:20,671][52669] DAMAGECOUNT value on done: 2071.0 [2024-08-05 21:53:20,672][52669] Sum rewards: -1.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.684', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'HITCOUNT': '0.480', 'WEAPON3': '1.100', 'weapon2': '1.342', 'DAMAGECOUNT': '1.641', 'weapon3': '2.044', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:20,923][52803] DAMAGECOUNT value on done: 2283.0 [2024-08-05 21:53:20,924][52803] Sum rewards: 2.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.710', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.114', 'HITCOUNT': '0.410', 'WEAPON3': '0.800', 'weapon2': '1.532', 'DAMAGECOUNT': '1.680', 'weapon3': '1.874', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:20,961][52820] DAMAGECOUNT value on done: 1886.0 [2024-08-05 21:53:20,962][52820] Sum rewards: -6.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.690', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'HITCOUNT': '0.270', 'weapon4': '0.306', 'ARMOR': '0.457', 'weapon2': '0.926', 'DAMAGECOUNT': '0.993', 'WEAPON3': '1.250', 'weapon3': '2.424', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:21,272][52665] DAMAGECOUNT value on done: 1904.0 [2024-08-05 21:53:21,272][52665] Sum rewards: 0.349, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.641', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.012', 'ARMOR': '0.037', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.726', 'weapon3': '1.244', 'weapon2': '1.542', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:21,689][52811] DAMAGECOUNT value on done: 1602.0 [2024-08-05 21:53:21,689][52811] Sum rewards: -0.596, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.830', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'ARMOR': '0.068', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.370', 'WEAPON3': '0.950', 'weapon2': '1.368', 'DAMAGECOUNT': '1.410', 'FRAGCOUNT': '2.000', 'weapon3': '2.262'} [2024-08-05 21:53:21,753][52795] DAMAGECOUNT value on done: 1433.0 [2024-08-05 21:53:21,753][52795] Sum rewards: 1.742, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.081', 'AMMO2': '0.014', 'AMMO3': '0.041', 'AMMO4': '0.072', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.192', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.324', 'ARMOR': '0.504', 'weapon3': '0.952', 'FRAGCOUNT': '1.000', 'weapon2': '1.154'} [2024-08-05 21:53:22,102][52663] DAMAGECOUNT value on done: 2040.0 [2024-08-05 21:53:22,105][52663] Sum rewards: -1.166, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.102', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON4': '0.050', 'AMMO3': '0.135', 'weapon4': '0.148', 'HITCOUNT': '0.410', 'ARMOR': '0.440', 'WEAPON3': '0.900', 'weapon3': '1.496', 'DAMAGECOUNT': '1.518', 'weapon2': '1.584', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:22,106][52650] Updated weights for policy 0, policy_version 3511 (0.0022) [2024-08-05 21:53:22,313][52647] DAMAGECOUNT value on done: 1229.0 [2024-08-05 21:53:22,318][52647] Sum rewards: 0.890, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.034', 'AMMO3': '0.070', 'AMMO4': '0.169', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.428', 'ARMOR': '0.460', 'HEALTH': '0.580', 'DAMAGECOUNT': '0.759', 'FRAGCOUNT': '1.000', 'weapon2': '1.218', 'weapon3': '1.312'} [2024-08-05 21:53:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17106.0). Total num frames: 28778496. Throughput: 0: 4309.3. Samples: 7197450. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:53:22,802][52567] Avg episode reward: [(0, '0.149')] [2024-08-05 21:53:23,064][52649] DAMAGECOUNT value on done: 1589.0 [2024-08-05 21:53:23,066][52649] Sum rewards: -1.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.896', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.222', 'DAMAGECOUNT': '0.504', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.002', 'weapon3': '1.802'} [2024-08-05 21:53:23,778][52669] DAMAGECOUNT value on done: 1950.0 [2024-08-05 21:53:23,779][52669] Sum rewards: -0.767, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.240', 'AMMO2': '0.005', 'ARMOR': '0.024', 'AMMO4': '0.026', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.140', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.807', 'WEAPON3': '0.850', 'weapon2': '1.570', 'FRAGCOUNT': '2.000', 'weapon3': '2.232'} [2024-08-05 21:53:23,877][52665] DAMAGECOUNT value on done: 1175.0 [2024-08-05 21:53:24,153][52803] DAMAGECOUNT value on done: 1543.0 [2024-08-05 21:53:24,155][52803] Sum rewards: 1.509, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.194', 'ARMOR': '0.456', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.650', 'weapon3': '1.656', 'weapon2': '1.930', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:24,199][52820] DAMAGECOUNT value on done: 2531.0 [2024-08-05 21:53:24,203][52820] Sum rewards: 4.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.088', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.047', 'AMMO3': '0.106', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.646', 'DAMAGECOUNT': '1.977', 'weapon3': '2.210', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:25,029][52795] DAMAGECOUNT value on done: 1145.0 [2024-08-05 21:53:25,031][52795] Sum rewards: -1.154, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.742', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'HITCOUNT': '0.170', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.630', 'ARMOR': '0.919', 'FRAGCOUNT': '1.000', 'weapon3': '1.528', 'weapon2': '2.034'} [2024-08-05 21:53:25,149][52663] DAMAGECOUNT value on done: 1601.0 [2024-08-05 21:53:25,149][52663] Sum rewards: 0.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.123', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.750', 'weapon2': '1.150', 'weapon3': '2.244', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:25,477][52614] Signal inference workers to stop experience collection... (650 times) [2024-08-05 21:53:25,489][52614] Signal inference workers to resume experience collection... (650 times) [2024-08-05 21:53:25,579][52650] InferenceWorker_p0-w0: stopping experience collection (650 times) [2024-08-05 21:53:25,584][52650] InferenceWorker_p0-w0: resuming experience collection (650 times) [2024-08-05 21:53:25,651][52647] DAMAGECOUNT value on done: 1397.0 [2024-08-05 21:53:25,651][52647] Sum rewards: 2.024, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.110', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'weapon5': '0.248', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon3': '1.180', 'DAMAGECOUNT': '1.416', 'weapon2': '1.798', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:26,372][52649] DAMAGECOUNT value on done: 2079.0 [2024-08-05 21:53:26,373][52649] Sum rewards: -0.882, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.708', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.232', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'ARMOR': '0.971', 'weapon2': '1.134', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '2.000', 'weapon3': '2.250'} [2024-08-05 21:53:26,540][52650] Updated weights for policy 0, policy_version 3521 (0.0024) [2024-08-05 21:53:26,722][52667] DAMAGECOUNT value on done: 1971.0 [2024-08-05 21:53:26,724][52667] Sum rewards: 3.701, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.093', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.050', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'ARMOR': '0.486', 'DAMAGECOUNT': '0.918', 'weapon3': '0.976', 'weapon2': '1.440', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:26,785][52669] DAMAGECOUNT value on done: 2140.0 [2024-08-05 21:53:26,787][52669] Sum rewards: 0.944, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.244', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'ARMOR': '0.032', 'weapon4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon5': '0.178', 'HITCOUNT': '0.380', 'WEAPON3': '0.850', 'weapon2': '1.258', 'DAMAGECOUNT': '1.560', 'weapon3': '2.130', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:27,119][52665] DAMAGECOUNT value on done: 2789.0 [2024-08-05 21:53:27,120][52665] Sum rewards: -2.441, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.591', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.044', 'AMMO3': '0.194', 'HITCOUNT': '0.450', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.488', 'weapon2': '1.804', 'weapon3': '1.898', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:27,380][52820] DAMAGECOUNT value on done: 1732.0 [2024-08-05 21:53:27,383][52820] Sum rewards: 2.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.032', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.122', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.036', 'DAMAGECOUNT': '1.425', 'weapon3': '2.070', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 28852224. Throughput: 0: 4306.4. Samples: 7222890. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-05 21:53:27,794][52567] Avg episode reward: [(0, '0.282')] [2024-08-05 21:53:27,923][52663] DAMAGECOUNT value on done: 2045.0 [2024-08-05 21:53:28,019][52647] DAMAGECOUNT value on done: 2163.0 [2024-08-05 21:53:28,019][52647] Sum rewards: 3.318, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.295', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.122', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'weapon2': '1.118', 'weapon3': '1.546', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:28,213][52795] DAMAGECOUNT value on done: 1748.0 [2024-08-05 21:53:28,213][52795] Sum rewards: 0.637, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.658', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO3': '0.068', 'ARMOR': '0.078', 'weapon5': '0.090', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.426', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.684', 'weapon3': '1.222', 'weapon2': '1.506', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:29,423][52669] DAMAGECOUNT value on done: 2203.0 [2024-08-05 21:53:29,423][52669] Sum rewards: 1.240, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.225', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO3': '0.075', 'ARMOR': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.250', 'weapon4': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.732', 'weapon2': '1.030', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:29,568][52649] DAMAGECOUNT value on done: 1279.0 [2024-08-05 21:53:29,569][52649] Sum rewards: 3.328, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.018', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.085', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.222', 'HEALTH': '0.304', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.170', 'weapon2': '1.172', 'weapon3': '1.568', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:30,074][52667] DAMAGECOUNT value on done: 2011.0 [2024-08-05 21:53:30,074][52667] Sum rewards: -1.888, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.100', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.142', 'HITCOUNT': '0.350', 'ARMOR': '0.916', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.110', 'weapon2': '1.802', 'weapon3': '1.930', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:30,244][52665] DAMAGECOUNT value on done: 2128.0 [2024-08-05 21:53:30,246][52665] Sum rewards: 1.161, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.296', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.131', 'HITCOUNT': '0.500', 'ARMOR': '0.897', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.449', 'weapon3': '1.700', 'weapon2': '1.762', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:30,397][52663] DAMAGECOUNT value on done: 2007.0 [2024-08-05 21:53:30,398][52663] Sum rewards: 3.890, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.202', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.103', 'ARMOR': '0.400', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.792', 'weapon3': '2.008', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:30,615][52820] DAMAGECOUNT value on done: 1355.0 [2024-08-05 21:53:30,617][52820] Sum rewards: -1.746, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.982', 'AMMO4': '-0.081', 'AMMO2': '-0.016', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.132', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.903', 'WEAPON3': '1.000', 'weapon2': '1.658', 'weapon3': '1.828', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:31,437][52647] DAMAGECOUNT value on done: 1498.0 [2024-08-05 21:53:31,439][52647] Sum rewards: -1.174, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.584', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.004', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.176', 'HITCOUNT': '0.190', 'ARMOR': '0.540', 'DAMAGECOUNT': '0.765', 'WEAPON3': '0.900', 'weapon2': '1.522', 'weapon3': '1.906', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:31,599][52650] Updated weights for policy 0, policy_version 3531 (0.0012) [2024-08-05 21:53:31,810][52669] DAMAGECOUNT value on done: 1789.0 [2024-08-05 21:53:31,810][52669] Sum rewards: -1.229, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.122', 'weapon4': '0.170', 'HITCOUNT': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.855', 'ARMOR': '0.955', 'weapon2': '1.642', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:32,782][52667] DAMAGECOUNT value on done: 1837.0 [2024-08-05 21:53:32,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 28942336. Throughput: 0: 4305.6. Samples: 7235730. Policy #0 lag: (min: 0.0, avg: 2.2, max: 7.0) [2024-08-05 21:53:32,795][52567] Avg episode reward: [(0, '0.161')] [2024-08-05 21:53:32,844][52649] DAMAGECOUNT value on done: 1927.0 [2024-08-05 21:53:32,845][52649] Sum rewards: -0.480, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.090', 'weapon5': '0.208', 'weapon4': '0.216', 'HITCOUNT': '0.230', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.645', 'FRAGCOUNT': '1.000', 'weapon2': '1.144', 'weapon3': '1.610'} [2024-08-05 21:53:33,147][52663] DAMAGECOUNT value on done: 1836.0 [2024-08-05 21:53:33,147][52663] Sum rewards: 0.622, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.532', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.028', 'AMMO3': '0.091', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon2': '1.170', 'weapon3': '1.418', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:33,483][52665] DAMAGECOUNT value on done: 2462.0 [2024-08-05 21:53:33,485][52665] Sum rewards: 2.711, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'HEALTH': '0.022', 'weapon4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.750', 'weapon2': '1.398', 'DAMAGECOUNT': '1.575', 'weapon3': '1.924', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:33,922][52820] DAMAGECOUNT value on done: 1437.0 [2024-08-05 21:53:33,922][52820] Sum rewards: 0.669, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.780', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.020', 'AMMO3': '0.062', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.552', 'weapon2': '1.232', 'weapon3': '1.400', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:34,248][52647] DAMAGECOUNT value on done: 1463.0 [2024-08-05 21:53:34,706][52669] DAMAGECOUNT value on done: 1783.0 [2024-08-05 21:53:34,706][52669] Sum rewards: 0.829, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.071', 'weapon2': '1.178', 'weapon3': '1.744', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:35,258][52667] DAMAGECOUNT value on done: 1341.0 [2024-08-05 21:53:35,258][52667] Sum rewards: 0.679, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.397', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO3': '0.085', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.275', 'weapon3': '1.512', 'weapon2': '1.536', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:35,393][52658] DAMAGECOUNT value on done: 1524.0 [2024-08-05 21:53:35,781][52794] DAMAGECOUNT value on done: 1563.0 [2024-08-05 21:53:35,781][52794] Sum rewards: -0.361, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.170', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.135', 'HITCOUNT': '0.180', 'weapon4': '0.296', 'DAMAGECOUNT': '0.633', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '0.916', 'FRAGCOUNT': '2.000', 'weapon3': '2.062'} [2024-08-05 21:53:35,903][52649] DAMAGECOUNT value on done: 1750.0 [2024-08-05 21:53:35,903][52649] Sum rewards: 1.512, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.941', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.071', 'ARMOR': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.843', 'weapon2': '1.476', 'weapon3': '1.624', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:36,114][52650] Updated weights for policy 0, policy_version 3541 (0.0043) [2024-08-05 21:53:36,139][52663] DAMAGECOUNT value on done: 1997.0 [2024-08-05 21:53:36,139][52663] Sum rewards: 1.873, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.804', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.104', 'HITCOUNT': '0.250', 'weapon5': '0.362', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.774', 'weapon2': '1.156', 'weapon3': '1.352', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:36,544][52665] DAMAGECOUNT value on done: 2316.0 [2024-08-05 21:53:36,545][52665] Sum rewards: -0.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.315', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.118', 'weapon4': '0.260', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'weapon2': '1.226', 'DAMAGECOUNT': '1.515', 'weapon3': '1.790', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:37,055][52820] DAMAGECOUNT value on done: 1493.0 [2024-08-05 21:53:37,059][52820] Sum rewards: 0.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.757', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.141', 'HITCOUNT': '0.370', 'ARMOR': '0.551', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.170', 'weapon2': '1.608', 'weapon3': '2.028', 'FRAGCOUNT': '6.000'} [2024-08-05 21:53:37,329][52664] DAMAGECOUNT value on done: 1699.0 [2024-08-05 21:53:37,329][52664] Sum rewards: 3.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.131', 'weapon4': '0.206', 'HITCOUNT': '0.390', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.437', 'weapon2': '1.502', 'weapon3': '1.636', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:37,367][52669] DAMAGECOUNT value on done: 2119.0 [2024-08-05 21:53:37,367][52669] Sum rewards: -2.271, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.721', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'weapon4': '0.132', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.514', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.693', 'FRAGCOUNT': '1.000', 'weapon3': '1.564', 'weapon2': '1.714'} [2024-08-05 21:53:37,682][52647] DAMAGECOUNT value on done: 2271.0 [2024-08-05 21:53:37,683][52647] Sum rewards: 6.759, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.098', 'weapon4': '0.154', 'weapon5': '0.256', 'HITCOUNT': '0.420', 'HEALTH': '0.473', 'WEAPON3': '0.500', 'weapon2': '1.384', 'weapon3': '1.920', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '6.000'} [2024-08-05 21:53:37,723][52667] DAMAGECOUNT value on done: 2115.0 [2024-08-05 21:53:37,724][52667] Sum rewards: 8.727, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.312', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.073', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.392', 'weapon2': '1.896', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '9.000'} [2024-08-05 21:53:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 29024256. Throughput: 0: 4295.3. Samples: 7261230. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:53:37,802][52567] Avg episode reward: [(0, '0.372')] [2024-08-05 21:53:37,868][52658] DAMAGECOUNT value on done: 1942.0 [2024-08-05 21:53:37,868][52658] Sum rewards: 0.395, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.678', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'ARMOR': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon5': '0.302', 'HITCOUNT': '0.430', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.425', 'weapon3': '1.754', 'weapon2': '1.788', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:38,125][52794] DAMAGECOUNT value on done: 1796.0 [2024-08-05 21:53:38,125][52794] Sum rewards: 2.757, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.464', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.076', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.765', 'weapon3': '1.184', 'weapon2': '1.998', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:38,681][52662] DAMAGECOUNT value on done: 1383.0 [2024-08-05 21:53:38,681][52662] Sum rewards: 2.227, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.520', 'AMMO2': '0.000', 'AMMO4': '0.001', 'ARMOR': '0.040', 'AMMO3': '0.056', 'weapon7': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.262', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.555', 'weapon2': '0.620', 'weapon3': '0.984', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:38,857][52663] DAMAGECOUNT value on done: 1606.0 [2024-08-05 21:53:38,858][52663] Sum rewards: -2.932, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.860', 'AMMO2': '0.028', 'weapon4': '0.102', 'AMMO4': '0.142', 'AMMO3': '0.150', 'HITCOUNT': '0.170', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.534', 'ARMOR': '0.966', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.548', 'weapon3': '1.988'} [2024-08-05 21:53:38,874][52649] DAMAGECOUNT value on done: 1546.0 [2024-08-05 21:53:38,876][52649] Sum rewards: 0.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.343', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'weapon5': '0.434', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.700', 'ARMOR': '1.358', 'weapon3': '1.578', 'weapon2': '1.790', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:39,507][52665] DAMAGECOUNT value on done: 2293.0 [2024-08-05 21:53:40,311][52667] DAMAGECOUNT value on done: 2207.0 [2024-08-05 21:53:40,313][52667] Sum rewards: 4.171, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.358', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.024', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.104', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.394', 'DAMAGECOUNT': '1.401', 'weapon3': '2.072', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:40,320][52820] DAMAGECOUNT value on done: 1283.0 [2024-08-05 21:53:40,323][52820] Sum rewards: -1.380, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.400', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO3': '0.058', 'HITCOUNT': '0.100', 'DAMAGECOUNT': '0.324', 'WEAPON3': '0.500', 'ARMOR': '0.855', 'FRAGCOUNT': '1.000', 'weapon3': '1.008', 'weapon2': '1.506'} [2024-08-05 21:53:40,496][52658] DAMAGECOUNT value on done: 1237.0 [2024-08-05 21:53:40,496][52658] Sum rewards: 0.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.018', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.174', 'HITCOUNT': '0.250', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.894', 'weapon2': '1.476', 'weapon3': '1.940', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:40,520][52664] DAMAGECOUNT value on done: 2221.0 [2024-08-05 21:53:40,520][52664] Sum rewards: -1.482, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.128', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.276', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'weapon2': '0.970', 'DAMAGECOUNT': '1.047', 'weapon3': '1.966', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:40,579][52794] DAMAGECOUNT value on done: 2407.0 [2024-08-05 21:53:40,580][52794] Sum rewards: 0.157, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.129', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.266', 'weapon2': '1.502', 'weapon3': '1.756', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:40,643][52669] DAMAGECOUNT value on done: 1987.0 [2024-08-05 21:53:40,839][52647] DAMAGECOUNT value on done: 1712.0 [2024-08-05 21:53:40,843][52647] Sum rewards: -2.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.142', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.408', 'WEAPON3': '0.850', 'ARMOR': '0.986', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.131', 'weapon3': '1.542', 'weapon2': '1.646'} [2024-08-05 21:53:41,195][52650] Updated weights for policy 0, policy_version 3551 (0.0022) [2024-08-05 21:53:41,293][52662] DAMAGECOUNT value on done: 1862.0 [2024-08-05 21:53:41,293][52662] Sum rewards: -2.800, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.288', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.048', 'HITCOUNT': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.165', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.340', 'weapon3': '1.776'} [2024-08-05 21:53:41,826][52663] DAMAGECOUNT value on done: 1744.0 [2024-08-05 21:53:41,826][52663] Sum rewards: -1.616, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon5': '0.156', 'weapon4': '0.214', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.082', 'weapon3': '1.858', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:42,539][52649] DAMAGECOUNT value on done: 2154.0 [2024-08-05 21:53:42,539][52649] Sum rewards: 0.306, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.590', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.142', 'HITCOUNT': '0.380', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.257', 'weapon3': '1.732', 'weapon2': '1.862', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 29114368. Throughput: 0: 4286.2. Samples: 7286870. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 21:53:42,794][52567] Avg episode reward: [(0, '0.131')] [2024-08-05 21:53:42,994][52669] DAMAGECOUNT value on done: 2011.0 [2024-08-05 21:53:42,994][52669] Sum rewards: 1.691, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.782', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.220', 'weapon5': '0.258', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.696', 'weapon3': '1.100', 'weapon2': '2.028', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:43,044][52794] DAMAGECOUNT value on done: 2032.0 [2024-08-05 21:53:43,045][52794] Sum rewards: -0.594, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.036', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.228', 'HITCOUNT': '0.460', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.362', 'weapon2': '1.380', 'weapon3': '1.854', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:43,136][52667] DAMAGECOUNT value on done: 2178.0 [2024-08-05 21:53:43,136][52667] Sum rewards: -1.028, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.418', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.258', 'HITCOUNT': '0.350', 'ARMOR': '0.461', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.269', 'weapon2': '1.676', 'weapon3': '1.868', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:43,245][52658] DAMAGECOUNT value on done: 1898.0 [2024-08-05 21:53:43,245][52658] Sum rewards: 6.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.222', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon3': '1.516', 'weapon2': '2.006', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '6.000'} [2024-08-05 21:53:43,269][52665] DAMAGECOUNT value on done: 1775.0 [2024-08-05 21:53:43,448][52664] DAMAGECOUNT value on done: 2211.0 [2024-08-05 21:53:43,449][52664] Sum rewards: 0.945, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.553', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.144', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.230', 'weapon2': '1.514', 'weapon3': '1.618', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:43,496][52662] DAMAGECOUNT value on done: 1746.0 [2024-08-05 21:53:43,497][52662] Sum rewards: 2.717, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.152', 'HITCOUNT': '0.340', 'HEALTH': '0.358', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.050', 'weapon2': '1.308', 'weapon3': '1.386', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:43,596][52820] DAMAGECOUNT value on done: 1575.0 [2024-08-05 21:53:43,596][52820] Sum rewards: 1.716, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.518', 'AMMO2': '0.022', 'ARMOR': '0.024', 'AMMO4': '0.108', 'AMMO3': '0.135', 'HITCOUNT': '0.250', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.939', 'weapon2': '1.474', 'weapon3': '1.732', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:43,655][52647] DAMAGECOUNT value on done: 1769.0 [2024-08-05 21:53:43,656][52647] Sum rewards: -1.120, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.491', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'WEAPON1': '0.020', 'AMMO3': '0.137', 'HITCOUNT': '0.350', 'ARMOR': '0.530', 'WEAPON3': '0.950', 'weapon2': '1.124', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '2.000', 'weapon3': '2.040'} [2024-08-05 21:53:44,782][52663] DAMAGECOUNT value on done: 1923.0 [2024-08-05 21:53:45,481][52794] DAMAGECOUNT value on done: 2254.0 [2024-08-05 21:53:45,482][52794] Sum rewards: 1.173, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.763', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.138', 'HITCOUNT': '0.160', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.555', 'ARMOR': '0.937', 'weapon3': '1.190', 'weapon2': '1.820', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:45,655][52650] Updated weights for policy 0, policy_version 3561 (0.0013) [2024-08-05 21:53:45,657][52649] DAMAGECOUNT value on done: 2123.0 [2024-08-05 21:53:45,657][52649] Sum rewards: 1.967, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.299', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.060', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.008', 'weapon3': '1.206'} [2024-08-05 21:53:45,953][52662] DAMAGECOUNT value on done: 1667.0 [2024-08-05 21:53:45,953][52662] Sum rewards: -0.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.204', 'AMMO5': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.032', 'weapon5': '0.034', 'AMMO4': '0.083', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.236', 'weapon3': '1.344', 'weapon2': '1.358', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:46,000][52665] DAMAGECOUNT value on done: 2406.0 [2024-08-05 21:53:46,002][52665] Sum rewards: -0.591, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.560', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.125', 'HITCOUNT': '0.380', 'ARMOR': '0.428', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.032', 'weapon3': '1.518', 'FRAGCOUNT': '2.000', 'weapon2': '2.120'} [2024-08-05 21:53:46,112][52667] DAMAGECOUNT value on done: 2033.0 [2024-08-05 21:53:46,113][52667] Sum rewards: -1.108, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.854', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.218', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.564', 'ARMOR': '0.839', 'FRAGCOUNT': '1.000', 'weapon2': '1.256', 'weapon3': '1.452'} [2024-08-05 21:53:46,275][52658] DAMAGECOUNT value on done: 1489.0 [2024-08-05 21:53:46,284][52669] DAMAGECOUNT value on done: 1732.0 [2024-08-05 21:53:46,284][52669] Sum rewards: -4.047, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.494', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon4': '0.046', 'weapon5': '0.102', 'AMMO3': '0.123', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'ARMOR': '1.301', 'weapon2': '1.584', 'weapon3': '1.982'} [2024-08-05 21:53:46,466][52664] DAMAGECOUNT value on done: 1599.0 [2024-08-05 21:53:46,467][52664] Sum rewards: 3.221, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.372', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'ARMOR': '0.024', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'HITCOUNT': '0.170', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.675', 'weapon2': '1.242', 'weapon3': '1.596', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:46,753][52647] DAMAGECOUNT value on done: 1758.0 [2024-08-05 21:53:46,755][52647] Sum rewards: 2.002, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.615', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.055', 'HITCOUNT': '0.140', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.690', 'weapon2': '0.968', 'weapon3': '0.984', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:46,775][52820] DAMAGECOUNT value on done: 1517.0 [2024-08-05 21:53:46,775][52820] Sum rewards: -0.736, reward structure: {'DEATHCOUNT': '-10.500', 'weapon4': '0.010', 'AMMO2': '0.016', 'weapon7': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.156', 'HEALTH': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.452', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.945', 'weapon3': '1.594', 'weapon2': '1.620', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:47,728][52794] DAMAGECOUNT value on done: 2261.0 [2024-08-05 21:53:47,728][52794] Sum rewards: 3.355, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.618', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon4': '0.102', 'HITCOUNT': '0.400', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'weapon2': '1.242', 'DAMAGECOUNT': '1.311', 'weapon3': '1.668', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 29204480. Throughput: 0: 4281.8. Samples: 7299630. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:53:47,802][52567] Avg episode reward: [(0, '0.238')] [2024-08-05 21:53:48,118][52663] DAMAGECOUNT value on done: 1595.0 [2024-08-05 21:53:48,119][52663] Sum rewards: 1.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.100', 'AMMO2': '0.008', 'weapon4': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.960', 'weapon2': '1.454', 'weapon3': '1.678', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:48,217][52649] DAMAGECOUNT value on done: 1486.0 [2024-08-05 21:53:48,217][52649] Sum rewards: 2.168, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.136', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'ARMOR': '0.092', 'AMMO3': '0.101', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.723', 'weapon2': '1.074', 'weapon3': '1.870', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:48,279][52662] DAMAGECOUNT value on done: 2177.0 [2024-08-05 21:53:48,280][52662] Sum rewards: 5.374, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HEALTH': '0.128', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.156', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'weapon3': '1.578', 'weapon2': '1.660', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:48,654][52665] DAMAGECOUNT value on done: 2077.0 [2024-08-05 21:53:48,654][52665] Sum rewards: 3.945, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.707', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.062', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.444', 'WEAPON3': '0.450', 'ARMOR': '0.501', 'weapon2': '0.884', 'weapon3': '1.490', 'DAMAGECOUNT': '1.548', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:48,874][52667] DAMAGECOUNT value on done: 2487.0 [2024-08-05 21:53:48,876][52667] Sum rewards: 8.385, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.124', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'ARMOR': '0.524', 'HITCOUNT': '0.830', 'WEAPON3': '0.950', 'weapon2': '1.592', 'weapon3': '2.040', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '9.000'} [2024-08-05 21:53:48,960][52658] DAMAGECOUNT value on done: 1562.0 [2024-08-05 21:53:49,662][52669] DAMAGECOUNT value on done: 1795.0 [2024-08-05 21:53:49,664][52669] Sum rewards: -0.725, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.965', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'HITCOUNT': '0.260', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '1.698', 'weapon3': '2.024', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:49,686][52664] DAMAGECOUNT value on done: 2349.0 [2024-08-05 21:53:49,687][52664] Sum rewards: 5.737, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.809', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'weapon4': '0.214', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.185', 'weapon2': '1.220', 'weapon3': '1.816', 'FRAGCOUNT': '7.000'} [2024-08-05 21:53:49,905][52794] DAMAGECOUNT value on done: 1107.0 [2024-08-05 21:53:49,963][52647] DAMAGECOUNT value on done: 1774.0 [2024-08-05 21:53:49,965][52647] Sum rewards: 0.940, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.890', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.014', 'ARMOR': '0.040', 'AMMO3': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'FRAGCOUNT': '0.500', 'DAMAGECOUNT': '1.140', 'weapon3': '1.200', 'weapon2': '1.320'} [2024-08-05 21:53:50,076][52820] DAMAGECOUNT value on done: 2363.0 [2024-08-05 21:53:50,078][52820] Sum rewards: 1.334, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.310', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO3': '0.092', 'HITCOUNT': '0.180', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.747', 'weapon2': '1.358', 'weapon3': '1.500', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:50,627][52662] DAMAGECOUNT value on done: 2443.0 [2024-08-05 21:53:50,628][52662] Sum rewards: -0.074, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.360', 'AMMO4': '-0.078', 'AMMO2': '-0.016', 'AMMO3': '0.060', 'HITCOUNT': '0.220', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.780', 'weapon3': '1.252', 'weapon2': '1.868', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:50,638][52650] Updated weights for policy 0, policy_version 3571 (0.0035) [2024-08-05 21:53:50,948][52649] DAMAGECOUNT value on done: 1308.0 [2024-08-05 21:53:50,950][52649] Sum rewards: -0.197, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.715', 'AMMO5': '0.003', 'weapon4': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.081', 'HITCOUNT': '0.160', 'weapon5': '0.364', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'weapon3': '1.554', 'weapon2': '1.946'} [2024-08-05 21:53:51,384][52663] DAMAGECOUNT value on done: 2127.0 [2024-08-05 21:53:51,384][52663] Sum rewards: 0.020, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.140', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.036', 'AMMO3': '0.115', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.425', 'weapon2': '1.650', 'weapon3': '1.912', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:51,393][52665] DAMAGECOUNT value on done: 2309.0 [2024-08-05 21:53:51,396][52665] Sum rewards: 2.311, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'ARMOR': '0.018', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'weapon4': '0.128', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'HEALTH': '0.424', 'weapon5': '0.496', 'weapon3': '1.134', 'weapon2': '1.458', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:51,801][52667] DAMAGECOUNT value on done: 1993.0 [2024-08-05 21:53:51,802][52667] Sum rewards: 1.087, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.330', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.034', 'ARMOR': '0.036', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.136', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.065', 'weapon3': '1.350', 'weapon2': '1.744', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:51,989][52658] DAMAGECOUNT value on done: 1486.0 [2024-08-05 21:53:51,992][52658] Sum rewards: 1.551, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.178', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'HITCOUNT': '0.150', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.435', 'ARMOR': '0.500', 'weapon2': '0.898', 'FRAGCOUNT': '1.000', 'weapon3': '1.200'} [2024-08-05 21:53:52,362][52794] DAMAGECOUNT value on done: 2385.0 [2024-08-05 21:53:52,363][52794] Sum rewards: 1.789, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.202', 'weapon7': '0.012', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.138', 'AMMO4': '0.147', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'ARMOR': '1.200', 'weapon3': '1.312', 'DAMAGECOUNT': '1.554', 'FRAGCOUNT': '2.000', 'weapon2': '2.096'} [2024-08-05 21:53:52,433][52664] DAMAGECOUNT value on done: 1847.0 [2024-08-05 21:53:52,435][52664] Sum rewards: 3.345, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.663', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.129', 'HITCOUNT': '0.410', 'ARMOR': '0.861', 'WEAPON3': '0.900', 'weapon3': '1.610', 'DAMAGECOUNT': '1.764', 'weapon2': '1.808', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:52,701][52647] DAMAGECOUNT value on done: 1777.0 [2024-08-05 21:53:52,704][52647] Sum rewards: 1.853, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.203', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.400', 'weapon7': '0.442', 'ARMOR': '0.503', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.128', 'weapon2': '1.162', 'weapon3': '1.232'} [2024-08-05 21:53:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 29278208. Throughput: 0: 4275.1. Samples: 7325330. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:53:52,802][52567] Avg episode reward: [(0, '0.780')] [2024-08-05 21:53:52,817][52669] DAMAGECOUNT value on done: 1733.0 [2024-08-05 21:53:52,825][52669] Sum rewards: 0.775, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.472', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.053', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.675', 'ARMOR': '0.852', 'FRAGCOUNT': '1.000', 'weapon3': '1.084', 'weapon2': '1.380'} [2024-08-05 21:53:52,834][52662] DAMAGECOUNT value on done: 2903.0 [2024-08-05 21:53:52,835][52662] Sum rewards: -1.408, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.442', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.380', 'ARMOR': '0.424', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.377', 'weapon2': '1.744', 'weapon3': '1.824', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:52,880][52614] Saving new best policy, reward=0.780! [2024-08-05 21:53:53,303][52820] DAMAGECOUNT value on done: 2017.0 [2024-08-05 21:53:53,308][52820] Sum rewards: -1.334, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'weapon7': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'weapon5': '0.628', 'DAMAGECOUNT': '0.945', 'weapon2': '1.208', 'weapon3': '1.786'} [2024-08-05 21:53:54,511][52649] DAMAGECOUNT value on done: 2404.0 [2024-08-05 21:53:54,511][52649] Sum rewards: 1.938, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.485', 'AMMO2': '0.009', 'ARMOR': '0.044', 'AMMO4': '0.044', 'AMMO3': '0.121', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'weapon2': '1.196', 'DAMAGECOUNT': '1.461', 'weapon3': '1.888', 'FRAGCOUNT': '4.000'} [2024-08-05 21:53:54,568][52663] DAMAGECOUNT value on done: 1628.0 [2024-08-05 21:53:54,573][52663] Sum rewards: -5.082, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.688', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.019', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.129', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.498', 'ARMOR': '0.522', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon3': '1.744', 'weapon2': '1.824'} [2024-08-05 21:53:54,676][52667] DAMAGECOUNT value on done: 1852.0 [2024-08-05 21:53:54,812][52665] DAMAGECOUNT value on done: 1772.0 [2024-08-05 21:53:54,813][52665] Sum rewards: 1.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.446', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.074', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'weapon5': '0.352', 'ARMOR': '0.498', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.696', 'weapon3': '1.402', 'weapon2': '1.788', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:54,857][52794] DAMAGECOUNT value on done: 2475.0 [2024-08-05 21:53:54,857][52794] Sum rewards: 1.889, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.937', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'weapon5': '0.034', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.930', 'weapon3': '1.300', 'weapon2': '1.654', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:54,927][52658] DAMAGECOUNT value on done: 1516.0 [2024-08-05 21:53:54,928][52658] Sum rewards: 2.978, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.336', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.222', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'weapon3': '1.198', 'DAMAGECOUNT': '1.260', 'weapon2': '1.818', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:55,289][52662] DAMAGECOUNT value on done: 1765.0 [2024-08-05 21:53:55,506][52669] DAMAGECOUNT value on done: 1908.0 [2024-08-05 21:53:55,506][52669] Sum rewards: 0.047, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.592', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.230', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.002', 'weapon2': '1.394', 'FRAGCOUNT': '2.000', 'weapon3': '2.058'} [2024-08-05 21:53:55,659][52668] DAMAGECOUNT value on done: 2115.0 [2024-08-05 21:53:55,662][52668] Sum rewards: 6.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.329', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.097', 'weapon4': '0.160', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'ARMOR': '0.913', 'weapon3': '1.366', 'weapon2': '1.844', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '6.000'} [2024-08-05 21:53:55,918][52664] DAMAGECOUNT value on done: 2173.0 [2024-08-05 21:53:55,918][52664] Sum rewards: -0.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.864', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.130', 'HITCOUNT': '0.430', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.320', 'weapon2': '1.576', 'weapon3': '1.886', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:55,920][52650] Updated weights for policy 0, policy_version 3581 (0.0018) [2024-08-05 21:53:56,059][52647] DAMAGECOUNT value on done: 2040.0 [2024-08-05 21:53:57,352][52663] DAMAGECOUNT value on done: 2204.0 [2024-08-05 21:53:57,355][52663] Sum rewards: 0.682, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.768', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.366', 'ARMOR': '0.479', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon2': '1.024', 'weapon3': '1.940'} [2024-08-05 21:53:57,363][52794] DAMAGECOUNT value on done: 1678.0 [2024-08-05 21:53:57,363][52794] Sum rewards: -1.556, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.942', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO3': '0.116', 'HITCOUNT': '0.130', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.640', 'weapon3': '2.040'} [2024-08-05 21:53:57,614][52671] DAMAGECOUNT value on done: 1610.0 [2024-08-05 21:53:57,615][52671] Sum rewards: -2.104, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.290', 'HITCOUNT': '0.350', 'weapon5': '0.356', 'ARMOR': '0.520', 'WEAPON3': '1.000', 'weapon2': '1.066', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '1.500', 'weapon3': '1.986'} [2024-08-05 21:53:57,753][52662] DAMAGECOUNT value on done: 2138.0 [2024-08-05 21:53:57,753][52662] Sum rewards: 1.711, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.354', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.020', 'AMMO4': '0.031', 'weapon4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.125', 'weapon2': '1.564', 'weapon3': '2.006', 'FRAGCOUNT': '5.000'} [2024-08-05 21:53:57,766][52649] DAMAGECOUNT value on done: 1820.0 [2024-08-05 21:53:57,767][52649] Sum rewards: 0.508, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.262', 'ARMOR': '0.567', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.700', 'weapon2': '0.852', 'weapon3': '1.842', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17203.2, 300 sec: 17133.8). Total num frames: 29376512. Throughput: 0: 4261.3. Samples: 7350400. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:53:57,794][52567] Avg episode reward: [(0, '0.748')] [2024-08-05 21:53:57,962][52667] DAMAGECOUNT value on done: 2866.0 [2024-08-05 21:53:57,963][52667] Sum rewards: 2.042, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.885', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'ARMOR': '0.032', 'AMMO3': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '1.206', 'DAMAGECOUNT': '1.398', 'weapon2': '1.784', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:57,992][52665] DAMAGECOUNT value on done: 2275.0 [2024-08-05 21:53:57,992][52665] Sum rewards: 9.538, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.380', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon4': '0.198', 'weapon5': '0.292', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.300', 'weapon2': '1.794', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '7.000'} [2024-08-05 21:53:58,256][52658] DAMAGECOUNT value on done: 1419.0 [2024-08-05 21:53:58,265][52658] Sum rewards: 2.155, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.185', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.060', 'HITCOUNT': '0.120', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.420', 'FRAGCOUNT': '1.000', 'weapon2': '1.260', 'weapon3': '1.438'} [2024-08-05 21:53:58,325][52668] DAMAGECOUNT value on done: 1802.0 [2024-08-05 21:53:58,328][52668] Sum rewards: 0.988, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.302', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'ARMOR': '0.030', 'AMMO3': '0.077', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.550', 'weapon3': '1.276', 'weapon2': '1.908', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:58,387][52660] DAMAGECOUNT value on done: 2024.0 [2024-08-05 21:53:58,388][52660] Sum rewards: 0.674, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.174', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.056', 'AMMO3': '0.068', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'weapon4': '0.396', 'DAMAGECOUNT': '0.849', 'weapon3': '0.966', 'weapon2': '1.432', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:58,636][52669] DAMAGECOUNT value on done: 2308.0 [2024-08-05 21:53:58,638][52669] Sum rewards: 1.181, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.435', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon4': '0.014', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'ARMOR': '0.913', 'DAMAGECOUNT': '1.461', 'weapon3': '1.518', 'weapon2': '1.786', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:59,309][52664] DAMAGECOUNT value on done: 1736.0 [2024-08-05 21:53:59,309][52664] Sum rewards: 0.391, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.300', 'ARMOR': '0.532', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.245', 'weapon2': '1.722', 'weapon3': '1.844', 'FRAGCOUNT': '3.000'} [2024-08-05 21:53:59,388][52647] DAMAGECOUNT value on done: 1672.0 [2024-08-05 21:53:59,388][52647] Sum rewards: -0.341, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.123', 'HITCOUNT': '0.200', 'WEAPON3': '0.600', 'HEALTH': '0.766', 'ARMOR': '0.816', 'DAMAGECOUNT': '0.867', 'weapon2': '1.248', 'weapon3': '1.960', 'FRAGCOUNT': '2.000'} [2024-08-05 21:53:59,786][52794] DAMAGECOUNT value on done: 1854.0 [2024-08-05 21:53:59,787][52794] Sum rewards: -1.870, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'HITCOUNT': '0.280', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '1.000', 'weapon2': '1.078', 'weapon3': '2.010'} [2024-08-05 21:54:00,230][52662] DAMAGECOUNT value on done: 2426.0 [2024-08-05 21:54:00,232][52662] Sum rewards: -0.484, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.078', 'DAMAGECOUNT': '1.533', 'weapon3': '1.906', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:00,278][52649] DAMAGECOUNT value on done: 1416.0 [2024-08-05 21:54:00,324][52650] Updated weights for policy 0, policy_version 3591 (0.0028) [2024-08-05 21:54:00,660][52660] DAMAGECOUNT value on done: 2545.0 [2024-08-05 21:54:00,661][52668] DAMAGECOUNT value on done: 2007.0 [2024-08-05 21:54:00,660][52660] Sum rewards: 1.326, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.305', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.036', 'ARMOR': '0.040', 'AMMO4': '0.099', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '1.346', 'DAMAGECOUNT': '2.145', 'weapon3': '2.288', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:00,665][52668] Sum rewards: 1.377, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.076', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.100', 'HITCOUNT': '0.300', 'weapon5': '0.410', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.879', 'weapon3': '1.368', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:00,712][52663] DAMAGECOUNT value on done: 1541.0 [2024-08-05 21:54:00,714][52663] Sum rewards: -3.352, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.076', 'ARMOR': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.248', 'DAMAGECOUNT': '0.558', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.242', 'weapon2': '1.434'} [2024-08-05 21:54:00,801][52671] DAMAGECOUNT value on done: 2277.0 [2024-08-05 21:54:00,803][52671] Sum rewards: 4.120, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.690', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.079', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'weapon3': '1.420', 'weapon2': '1.872', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:01,259][52667] DAMAGECOUNT value on done: 2055.0 [2024-08-05 21:54:01,260][52667] Sum rewards: 1.440, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.509', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO3': '0.045', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.262', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.408', 'ARMOR': '0.465', 'weapon3': '0.820', 'FRAGCOUNT': '1.000', 'weapon2': '1.178'} [2024-08-05 21:54:01,427][52658] DAMAGECOUNT value on done: 1831.0 [2024-08-05 21:54:01,429][52658] Sum rewards: -2.549, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.177', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'HITCOUNT': '0.350', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.990', 'WEAPON3': '1.100', 'weapon2': '1.148', 'FRAGCOUNT': '2.000', 'weapon3': '2.536'} [2024-08-05 21:54:02,088][52659] DAMAGECOUNT value on done: 2314.0 [2024-08-05 21:54:02,089][52659] Sum rewards: 2.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.405', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO3': '0.065', 'weapon5': '0.148', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.449', 'DAMAGECOUNT': '1.272', 'weapon3': '1.276', 'weapon2': '1.614', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:02,144][52669] DAMAGECOUNT value on done: 1431.0 [2024-08-05 21:54:02,145][52669] Sum rewards: -0.848, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.076', 'AMMO2': '0.007', 'ARMOR': '0.029', 'AMMO4': '0.034', 'AMMO3': '0.095', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.710', 'weapon2': '1.738'} [2024-08-05 21:54:02,546][52664] DAMAGECOUNT value on done: 2135.0 [2024-08-05 21:54:02,547][52647] DAMAGECOUNT value on done: 2373.0 [2024-08-05 21:54:02,548][52664] Sum rewards: 0.328, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.092', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.900', 'ARMOR': '0.911', 'DAMAGECOUNT': '1.170', 'weapon2': '1.550', 'weapon3': '1.952', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:02,549][52647] Sum rewards: 4.028, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.845', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.164', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.317', 'weapon3': '1.318', 'weapon2': '1.490', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:02,571][52794] DAMAGECOUNT value on done: 2166.0 [2024-08-05 21:54:02,571][52794] Sum rewards: 3.981, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.342', 'AMMO2': '0.024', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.117', 'HITCOUNT': '0.340', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.053', 'weapon2': '1.284', 'weapon3': '1.422', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 29458432. Throughput: 0: 4260.9. Samples: 7363320. Policy #0 lag: (min: 0.0, avg: 4.8, max: 9.0) [2024-08-05 21:54:02,794][52567] Avg episode reward: [(0, '0.905')] [2024-08-05 21:54:02,795][52614] Saving new best policy, reward=0.905! [2024-08-05 21:54:02,796][52649] DAMAGECOUNT value on done: 1580.0 [2024-08-05 21:54:03,010][52662] DAMAGECOUNT value on done: 2318.0 [2024-08-05 21:54:03,011][52662] Sum rewards: -0.219, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.186', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.148', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'ARMOR': '0.886', 'DAMAGECOUNT': '1.500', 'weapon3': '1.740', 'weapon2': '1.788', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:03,587][52671] DAMAGECOUNT value on done: 1129.0 [2024-08-05 21:54:03,874][52668] DAMAGECOUNT value on done: 1324.0 [2024-08-05 21:54:03,876][52668] Sum rewards: 1.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '0.000', 'AMMO2': '0.018', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.140', 'HITCOUNT': '0.380', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.062', 'weapon3': '1.592', 'weapon2': '2.000', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:03,933][52660] DAMAGECOUNT value on done: 1717.0 [2024-08-05 21:54:03,934][52660] Sum rewards: 1.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.124', 'weapon4': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.008', 'DAMAGECOUNT': '1.815', 'weapon3': '2.078', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:04,170][52663] DAMAGECOUNT value on done: 2409.0 [2024-08-05 21:54:04,172][52663] Sum rewards: 2.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.349', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.091', 'HITCOUNT': '0.280', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.810', 'weapon2': '1.390', 'weapon3': '1.706', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:04,248][52667] DAMAGECOUNT value on done: 2158.0 [2024-08-05 21:54:04,248][52667] Sum rewards: 3.223, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.762', 'AMMO4': '-0.083', 'AMMO2': '-0.017', 'AMMO5': '0.005', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.226', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.164', 'weapon2': '1.344', 'weapon3': '1.486', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:04,601][52658] DAMAGECOUNT value on done: 2098.0 [2024-08-05 21:54:04,601][52658] Sum rewards: 3.236, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.060', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.128', 'weapon4': '0.178', 'ARMOR': '0.400', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.539', 'weapon2': '1.746', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:04,605][52659] DAMAGECOUNT value on done: 1988.0 [2024-08-05 21:54:04,605][52659] Sum rewards: -0.792, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.434', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.238', 'HITCOUNT': '0.360', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.287', 'weapon2': '1.326', 'FRAGCOUNT': '1.500', 'weapon3': '1.884'} [2024-08-05 21:54:04,958][52794] DAMAGECOUNT value on done: 2006.0 [2024-08-05 21:54:04,960][52794] Sum rewards: 2.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.912', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.198', 'DAMAGECOUNT': '1.293', 'weapon2': '1.710', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:05,320][52649] DAMAGECOUNT value on done: 1078.0 [2024-08-05 21:54:05,320][52649] Sum rewards: -2.492, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.725', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.151', 'HITCOUNT': '0.190', 'ARMOR': '0.525', 'DAMAGECOUNT': '0.609', 'WEAPON3': '0.950', 'weapon2': '1.050', 'FRAGCOUNT': '2.000', 'weapon3': '2.782'} [2024-08-05 21:54:05,325][52662] DAMAGECOUNT value on done: 2300.0 [2024-08-05 21:54:05,327][52662] Sum rewards: 2.307, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.064', 'weapon4': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.178', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.954', 'DAMAGECOUNT': '1.098', 'weapon3': '1.352', 'weapon2': '1.768', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:05,515][52650] Updated weights for policy 0, policy_version 3601 (0.0015) [2024-08-05 21:54:05,542][52669] DAMAGECOUNT value on done: 2071.0 [2024-08-05 21:54:05,545][52669] Sum rewards: -1.043, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO4': '0.100', 'AMMO3': '0.149', 'HITCOUNT': '0.210', 'HEALTH': '0.678', 'DAMAGECOUNT': '0.693', 'WEAPON3': '0.700', 'ARMOR': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '1.574', 'weapon3': '1.820'} [2024-08-05 21:54:05,936][52671] DAMAGECOUNT value on done: 2192.0 [2024-08-05 21:54:05,955][52647] DAMAGECOUNT value on done: 1274.0 [2024-08-05 21:54:05,957][52647] Sum rewards: 1.771, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.080', 'HITCOUNT': '0.280', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.978', 'weapon2': '1.150', 'weapon3': '1.624', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:05,973][52664] DAMAGECOUNT value on done: 1672.0 [2024-08-05 21:54:05,978][52664] Sum rewards: 0.762, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.340', 'AMMO2': '0.016', 'ARMOR': '0.041', 'AMMO3': '0.063', 'weapon4': '0.076', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.435', 'weapon3': '0.852', 'weapon2': '0.932', 'FRAGCOUNT': '1.000'} [2024-08-05 21:54:07,003][52668] DAMAGECOUNT value on done: 1406.0 [2024-08-05 21:54:07,003][52668] Sum rewards: 1.553, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.026', 'ARMOR': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon4': '0.184', 'HITCOUNT': '0.280', 'HEALTH': '0.306', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.005', 'weapon3': '1.418', 'weapon2': '1.440', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:07,005][52660] DAMAGECOUNT value on done: 2387.0 [2024-08-05 21:54:07,005][52660] Sum rewards: -1.542, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.791', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.038', 'ARMOR': '0.072', 'AMMO3': '0.114', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.903', 'FRAGCOUNT': '1.000', 'weapon2': '1.594', 'weapon3': '1.850'} [2024-08-05 21:54:07,100][52663] DAMAGECOUNT value on done: 1811.0 [2024-08-05 21:54:07,101][52663] Sum rewards: 3.250, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.282', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.034', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.410', 'ARMOR': '0.557', 'WEAPON3': '0.600', 'weapon2': '1.248', 'DAMAGECOUNT': '1.356', 'weapon3': '1.896', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:07,233][52667] DAMAGECOUNT value on done: 1788.0 [2024-08-05 21:54:07,235][52667] Sum rewards: -1.538, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-1.285', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.086', 'ARMOR': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.280', 'weapon5': '0.334', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.738', 'weapon2': '1.368', 'weapon3': '1.640'} [2024-08-05 21:54:07,371][52659] DAMAGECOUNT value on done: 2281.0 [2024-08-05 21:54:07,371][52659] Sum rewards: -2.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'ARMOR': '0.072', 'AMMO3': '0.142', 'weapon4': '0.218', 'HITCOUNT': '0.430', 'weapon2': '0.800', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.350', 'FRAGCOUNT': '2.000', 'weapon3': '2.186'} [2024-08-05 21:54:07,637][52658] DAMAGECOUNT value on done: 2112.0 [2024-08-05 21:54:07,638][52658] Sum rewards: 1.071, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.620', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.750', 'weapon2': '1.548', 'weapon3': '2.084', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.8, 300 sec: 17106.0). Total num frames: 29540352. Throughput: 0: 4252.7. Samples: 7388820. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:54:07,794][52567] Avg episode reward: [(0, '0.834')] [2024-08-05 21:54:07,861][52794] DAMAGECOUNT value on done: 3030.0 [2024-08-05 21:54:07,862][52794] Sum rewards: 1.501, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.401', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.226', 'HITCOUNT': '0.260', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.777', 'FRAGCOUNT': '1.000', 'weapon3': '1.556', 'weapon2': '1.960'} [2024-08-05 21:54:08,224][52649] DAMAGECOUNT value on done: 2065.0 [2024-08-05 21:54:08,233][52649] Sum rewards: -4.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.506', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.155', 'HITCOUNT': '0.230', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.855', 'WEAPON3': '0.900', 'weapon2': '1.474', 'weapon3': '1.542', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:08,243][52662] DAMAGECOUNT value on done: 1836.0 [2024-08-05 21:54:08,243][52662] Sum rewards: 4.715, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.776', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'ARMOR': '0.032', 'AMMO3': '0.113', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.233', 'weapon2': '1.556', 'weapon3': '1.802', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:08,833][52671] DAMAGECOUNT value on done: 1677.0 [2024-08-05 21:54:08,833][52671] Sum rewards: -1.509, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.010', 'weapon5': '0.034', 'AMMO4': '0.045', 'ARMOR': '0.092', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.140', 'DAMAGECOUNT': '0.480', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.676', 'weapon3': '1.832'} [2024-08-05 21:54:09,157][52647] DAMAGECOUNT value on done: 1897.0 [2024-08-05 21:54:09,158][52647] Sum rewards: -1.787, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.232', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.148', 'HITCOUNT': '0.310', 'WEAPON3': '0.950', 'ARMOR': '0.986', 'DAMAGECOUNT': '1.095', 'weapon3': '1.748', 'weapon2': '1.856', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:09,176][52664] DAMAGECOUNT value on done: 1608.0 [2024-08-05 21:54:09,177][52664] Sum rewards: 3.175, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.120', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'weapon3': '0.842', 'weapon2': '1.266', 'DAMAGECOUNT': '1.527', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:09,725][52668] DAMAGECOUNT value on done: 2744.0 [2024-08-05 21:54:09,725][52668] Sum rewards: 1.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.485', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'ARMOR': '0.523', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon3': '1.414', 'weapon2': '1.744', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:09,750][52660] DAMAGECOUNT value on done: 1691.0 [2024-08-05 21:54:09,751][52660] Sum rewards: -1.793, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.780', 'AMMO4': '-0.078', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'AMMO3': '0.082', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.234', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'weapon3': '0.918', 'FRAGCOUNT': '1.000', 'weapon2': '1.174'} [2024-08-05 21:54:10,131][52650] Updated weights for policy 0, policy_version 3611 (0.0031) [2024-08-05 21:54:10,176][52663] DAMAGECOUNT value on done: 1843.0 [2024-08-05 21:54:10,176][52663] Sum rewards: -3.686, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.604', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.044', 'weapon4': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.945', 'weapon2': '1.268', 'weapon3': '1.842', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:10,398][52659] DAMAGECOUNT value on done: 2298.0 [2024-08-05 21:54:10,398][52659] Sum rewards: 1.967, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.040', 'AMMO3': '0.153', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'weapon2': '1.456', 'weapon3': '1.908', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:10,420][52794] DAMAGECOUNT value on done: 2564.0 [2024-08-05 21:54:10,421][52794] Sum rewards: 1.183, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.630', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.408', 'ARMOR': '0.446', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'weapon2': '1.226', 'weapon3': '1.938', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:10,662][52667] DAMAGECOUNT value on done: 1592.0 [2024-08-05 21:54:10,665][52667] Sum rewards: 0.955, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.060', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'AMMO3': '0.059', 'WEAPON5': '0.150', 'weapon5': '0.198', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'weapon3': '0.978', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.110', 'weapon2': '1.634'} [2024-08-05 21:54:10,810][52662] DAMAGECOUNT value on done: 2180.0 [2024-08-05 21:54:10,810][52662] Sum rewards: 2.606, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.425', 'weapon2': '1.562', 'weapon3': '1.822', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:10,999][52658] DAMAGECOUNT value on done: 1446.0 [2024-08-05 21:54:11,179][52649] DAMAGECOUNT value on done: 2017.0 [2024-08-05 21:54:11,180][52649] Sum rewards: -3.220, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.456', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.032', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.156', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.900', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.716', 'weapon3': '2.132'} [2024-08-05 21:54:11,644][52671] DAMAGECOUNT value on done: 2224.0 [2024-08-05 21:54:11,644][52671] Sum rewards: 0.902, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.009', 'weapon5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.460', 'WEAPON3': '0.850', 'weapon2': '1.366', 'DAMAGECOUNT': '2.040', 'weapon3': '2.094', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:11,950][52647] DAMAGECOUNT value on done: 2415.0 [2024-08-05 21:54:11,951][52647] Sum rewards: 1.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.016', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon4': '0.010', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.323', 'weapon2': '1.456', 'weapon3': '1.844', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:12,003][52664] DAMAGECOUNT value on done: 1640.0 [2024-08-05 21:54:12,004][52664] Sum rewards: -1.620, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.132', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon4': '0.016', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.140', 'weapon5': '0.200', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.300', 'ARMOR': '1.462', 'weapon2': '1.718'} [2024-08-05 21:54:12,654][52668] DAMAGECOUNT value on done: 3026.0 [2024-08-05 21:54:12,656][52668] Sum rewards: 0.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.961', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.076', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.430', 'ARMOR': '0.432', 'WEAPON3': '0.900', 'weapon2': '1.068', 'DAMAGECOUNT': '1.800', 'weapon3': '1.880', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:12,716][52660] DAMAGECOUNT value on done: 2141.0 [2024-08-05 21:54:12,718][52660] Sum rewards: -6.466, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.484', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.078', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.120', 'AMMO4': '0.130', 'AMMO3': '0.176', 'DAMAGECOUNT': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon2': '1.202', 'weapon3': '2.466'} [2024-08-05 21:54:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.2, 300 sec: 17106.0). Total num frames: 29622272. Throughput: 0: 4255.1. Samples: 7414370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 21:54:12,794][52567] Avg episode reward: [(0, '0.794')] [2024-08-05 21:54:13,065][52794] DAMAGECOUNT value on done: 2368.0 [2024-08-05 21:54:13,066][52794] Sum rewards: -1.323, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.862', 'AMMO2': '0.028', 'ARMOR': '0.031', 'AMMO3': '0.116', 'AMMO4': '0.139', 'weapon4': '0.166', 'HITCOUNT': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.999', 'FRAGCOUNT': '1.000', 'weapon3': '1.630', 'weapon2': '1.720'} [2024-08-05 21:54:13,105][52663] DAMAGECOUNT value on done: 1475.0 [2024-08-05 21:54:13,362][52659] DAMAGECOUNT value on done: 1789.0 [2024-08-05 21:54:13,370][52659] Sum rewards: 3.550, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.256', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon4': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.117', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon3': '1.414', 'DAMAGECOUNT': '1.449', 'weapon2': '1.912', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:13,420][52662] DAMAGECOUNT value on done: 1866.0 [2024-08-05 21:54:13,420][52662] Sum rewards: 4.399, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.605', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'weapon5': '0.752', 'DAMAGECOUNT': '0.765', 'weapon3': '0.934', 'weapon2': '1.130', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:13,793][52649] DAMAGECOUNT value on done: 1852.0 [2024-08-05 21:54:13,794][52649] Sum rewards: 1.606, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.396', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.101', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.435', 'ARMOR': '0.559', 'WEAPON3': '0.600', 'weapon2': '1.186', 'weapon3': '1.684', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:13,894][52667] DAMAGECOUNT value on done: 2062.0 [2024-08-05 21:54:13,896][52667] Sum rewards: -2.207, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.942', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.032', 'AMMO3': '0.158', 'HITCOUNT': '0.380', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.320', 'weapon2': '1.444', 'FRAGCOUNT': '2.000', 'weapon3': '2.412'} [2024-08-05 21:54:14,126][52658] DAMAGECOUNT value on done: 1929.0 [2024-08-05 21:54:14,126][52658] Sum rewards: 2.193, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.360', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.057', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.110', 'weapon3': '1.626', 'weapon2': '1.692', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:14,779][52664] DAMAGECOUNT value on done: 1519.0 [2024-08-05 21:54:15,003][52650] Updated weights for policy 0, policy_version 3621 (0.0013) [2024-08-05 21:54:15,039][52671] DAMAGECOUNT value on done: 1873.0 [2024-08-05 21:54:15,040][52671] Sum rewards: 0.073, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.437', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.028', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.942', 'weapon2': '1.426', 'weapon3': '1.684', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:15,890][52663] DAMAGECOUNT value on done: 1173.0 [2024-08-05 21:54:15,891][52663] Sum rewards: 1.355, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.160', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.044', 'AMMO3': '0.047', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON3': '0.350', 'ARMOR': '0.480', 'DAMAGECOUNT': '0.741', 'weapon3': '0.762', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:16,067][52668] DAMAGECOUNT value on done: 1781.0 [2024-08-05 21:54:16,123][52667] DAMAGECOUNT value on done: 2643.0 [2024-08-05 21:54:16,123][52667] Sum rewards: 5.967, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.805', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO3': '0.085', 'HITCOUNT': '0.440', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'weapon2': '1.222', 'DAMAGECOUNT': '1.584', 'weapon3': '1.678', 'FRAGCOUNT': '6.000'} [2024-08-05 21:54:16,160][52660] DAMAGECOUNT value on done: 1795.0 [2024-08-05 21:54:16,163][52660] Sum rewards: 6.296, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.050', 'HEALTH': '0.219', 'WEAPON3': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.912', 'weapon3': '0.968', 'DAMAGECOUNT': '1.170', 'weapon2': '1.410', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:16,182][52794] DAMAGECOUNT value on done: 2253.0 [2024-08-05 21:54:16,183][52794] Sum rewards: -2.397, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.794', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.086', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.513', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.107', 'weapon2': '1.264', 'weapon3': '2.080'} [2024-08-05 21:54:16,428][52658] DAMAGECOUNT value on done: 2437.0 [2024-08-05 21:54:16,428][52658] Sum rewards: 1.373, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.101', 'weapon4': '0.236', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'HEALTH': '1.013', 'DAMAGECOUNT': '1.236', 'weapon2': '1.646', 'weapon3': '1.794'} [2024-08-05 21:54:16,526][52659] DAMAGECOUNT value on done: 1555.0 [2024-08-05 21:54:16,527][52659] Sum rewards: 1.573, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.681', 'AMMO2': '0.003', 'AMMO4': '0.012', 'ARMOR': '0.036', 'AMMO3': '0.141', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.900', 'weapon2': '1.290', 'weapon3': '2.102', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:16,641][52662] DAMAGECOUNT value on done: 2476.0 [2024-08-05 21:54:16,642][52662] Sum rewards: 1.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.440', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.470', 'ARMOR': '0.535', 'WEAPON3': '0.600', 'weapon3': '1.432', 'DAMAGECOUNT': '1.629', 'weapon2': '1.968', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 29712384. Throughput: 0: 4255.8. Samples: 7427240. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 21:54:17,794][52567] Avg episode reward: [(0, '0.513')] [2024-08-05 21:54:18,039][52664] DAMAGECOUNT value on done: 1642.0 [2024-08-05 21:54:18,039][52664] Sum rewards: 1.373, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.265', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon7': '0.008', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.102', 'weapon4': '0.114', 'weapon5': '0.134', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'weapon3': '1.212', 'weapon2': '1.774', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:18,264][52671] DAMAGECOUNT value on done: 1238.0 [2024-08-05 21:54:18,264][52671] Sum rewards: 0.181, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.175', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon7': '0.060', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.140', 'WEAPON7': '0.200', 'weapon4': '0.232', 'DAMAGECOUNT': '0.366', 'weapon5': '0.418', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.136', 'weapon3': '1.566'} [2024-08-05 21:54:18,567][52667] DAMAGECOUNT value on done: 1967.0 [2024-08-05 21:54:18,569][52667] Sum rewards: 2.251, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.370', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.079', 'HITCOUNT': '0.140', 'weapon5': '0.158', 'weapon4': '0.170', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.480', 'weapon3': '1.222', 'weapon2': '1.524', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:18,821][52658] DAMAGECOUNT value on done: 2172.0 [2024-08-05 21:54:18,822][52658] Sum rewards: -0.048, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.378', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.103', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.549', 'WEAPON3': '0.700', 'weapon3': '1.350', 'ARMOR': '1.387', 'weapon2': '1.706', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:19,072][52794] DAMAGECOUNT value on done: 2280.0 [2024-08-05 21:54:19,072][52794] Sum rewards: 0.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.244', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.252', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'ARMOR': '0.892', 'DAMAGECOUNT': '1.230', 'weapon3': '1.246', 'weapon2': '1.504', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:19,422][52662] DAMAGECOUNT value on done: 1936.0 [2024-08-05 21:54:19,424][52662] Sum rewards: 1.061, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.903', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.070', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.294', 'DAMAGECOUNT': '1.335', 'weapon2': '1.954', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:19,654][52668] DAMAGECOUNT value on done: 1982.0 [2024-08-05 21:54:19,710][52659] DAMAGECOUNT value on done: 1870.0 [2024-08-05 21:54:19,724][52659] Sum rewards: -4.119, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.680', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.250', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.700', 'weapon2': '1.588', 'weapon3': '1.700'} [2024-08-05 21:54:19,727][52660] DAMAGECOUNT value on done: 1523.0 [2024-08-05 21:54:19,825][52650] Updated weights for policy 0, policy_version 3631 (0.0019) [2024-08-05 21:54:20,969][52664] DAMAGECOUNT value on done: 1690.0 [2024-08-05 21:54:20,970][52664] Sum rewards: -1.381, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.033', 'ARMOR': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'HITCOUNT': '0.180', 'weapon4': '0.334', 'DAMAGECOUNT': '0.471', 'WEAPON3': '0.550', 'HEALTH': '0.790', 'FRAGCOUNT': '1.000', 'weapon3': '1.446', 'weapon2': '1.542'} [2024-08-05 21:54:21,045][52671] DAMAGECOUNT value on done: 2423.0 [2024-08-05 21:54:21,536][52667] DAMAGECOUNT value on done: 2435.0 [2024-08-05 21:54:21,537][52667] Sum rewards: 7.354, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.296', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.040', 'AMMO3': '0.080', 'HITCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon2': '1.388', 'DAMAGECOUNT': '1.746', 'weapon3': '1.886', 'FRAGCOUNT': '6.000'} [2024-08-05 21:54:21,660][52794] DAMAGECOUNT value on done: 2863.0 [2024-08-05 21:54:21,660][52794] Sum rewards: 1.457, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.540', 'AMMO2': '0.006', 'weapon7': '0.010', 'AMMO4': '0.031', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'weapon2': '0.906', 'DAMAGECOUNT': '1.005', 'weapon3': '1.524', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:21,789][52658] DAMAGECOUNT value on done: 1879.0 [2024-08-05 21:54:21,790][52658] Sum rewards: 0.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.298', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'WEAPON1': '0.020', 'weapon4': '0.062', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.425', 'weapon3': '1.538', 'weapon2': '1.770', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:21,940][52662] DAMAGECOUNT value on done: 2689.0 [2024-08-05 21:54:21,941][52662] Sum rewards: -3.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.807', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.230', 'ARMOR': '0.432', 'DAMAGECOUNT': '0.747', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.440', 'weapon3': '2.000'} [2024-08-05 21:54:22,395][52659] DAMAGECOUNT value on done: 1488.0 [2024-08-05 21:54:22,395][52659] Sum rewards: -1.611, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.072', 'AMMO2': '0.015', 'AMMO4': '0.072', 'ARMOR': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.130', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.465', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon2': '0.852', 'FRAGCOUNT': '1.000', 'weapon3': '1.850'} [2024-08-05 21:54:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 17106.0). Total num frames: 29794304. Throughput: 0: 4251.6. Samples: 7452550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:54:22,794][52567] Avg episode reward: [(0, '0.446')] [2024-08-05 21:54:23,008][52668] DAMAGECOUNT value on done: 2237.0 [2024-08-05 21:54:23,010][52668] Sum rewards: -0.288, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.152', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.149', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.445', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.299', 'weapon3': '1.424', 'weapon2': '1.606'} [2024-08-05 21:54:23,017][52660] DAMAGECOUNT value on done: 1999.0 [2024-08-05 21:54:23,018][52660] Sum rewards: 1.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.970', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.048', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HITCOUNT': '0.310', 'weapon4': '0.316', 'WEAPON3': '0.650', 'weapon2': '1.160', 'DAMAGECOUNT': '1.191', 'weapon3': '1.282', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:24,064][52664] DAMAGECOUNT value on done: 1882.0 [2024-08-05 21:54:24,072][52664] Sum rewards: 4.826, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.200', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.344', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.088', 'DAMAGECOUNT': '1.596', 'weapon3': '2.218', 'FRAGCOUNT': '6.000'} [2024-08-05 21:54:24,080][52794] DAMAGECOUNT value on done: 2107.0 [2024-08-05 21:54:24,081][52794] Sum rewards: 2.571, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.780', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'weapon7': '0.054', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'weapon3': '0.676', 'DAMAGECOUNT': '1.170', 'weapon2': '1.272', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:24,153][52671] DAMAGECOUNT value on done: 1977.0 [2024-08-05 21:54:24,158][52671] Sum rewards: -0.966, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.811', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.110', 'weapon5': '0.364', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.650', 'ARMOR': '0.913', 'weapon3': '1.212', 'weapon2': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:24,221][52650] Updated weights for policy 0, policy_version 3641 (0.0012) [2024-08-05 21:54:24,716][52662] DAMAGECOUNT value on done: 2192.0 [2024-08-05 21:54:24,717][52662] Sum rewards: -0.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.332', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'ARMOR': '0.024', 'AMMO3': '0.121', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.735', 'weapon2': '1.464', 'FRAGCOUNT': '2.000', 'weapon3': '2.152'} [2024-08-05 21:54:25,064][52658] DAMAGECOUNT value on done: 1005.0 [2024-08-05 21:54:25,065][52658] Sum rewards: 1.318, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.580', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'AMMO3': '0.099', 'weapon5': '0.160', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.095', 'weapon2': '1.280', 'weapon3': '1.444', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:25,234][52659] DAMAGECOUNT value on done: 1902.0 [2024-08-05 21:54:25,757][52668] DAMAGECOUNT value on done: 1495.0 [2024-08-05 21:54:25,770][52660] DAMAGECOUNT value on done: 1499.0 [2024-08-05 21:54:25,771][52660] Sum rewards: -1.469, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.215', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.370', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.101', 'weapon3': '1.492', 'weapon2': '1.984', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:26,545][52671] DAMAGECOUNT value on done: 1713.0 [2024-08-05 21:54:26,546][52671] Sum rewards: -1.001, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.924', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'weapon4': '0.030', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'ARMOR': '0.408', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.750', 'weapon2': '1.664', 'weapon3': '1.714', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:26,561][52664] DAMAGECOUNT value on done: 2147.0 [2024-08-05 21:54:26,565][52664] Sum rewards: 0.306, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.040', 'HEALTH': '0.060', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'AMMO4': '0.132', 'HITCOUNT': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.828', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.264', 'weapon2': '2.058'} [2024-08-05 21:54:27,460][52662] DAMAGECOUNT value on done: 1979.0 [2024-08-05 21:54:27,460][52662] Sum rewards: 1.860, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.087', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.226', 'HITCOUNT': '0.330', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.221', 'weapon3': '1.278', 'weapon2': '1.468', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17133.8). Total num frames: 29884416. Throughput: 0: 4251.6. Samples: 7478190. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:54:27,794][52567] Avg episode reward: [(0, '0.315')] [2024-08-05 21:54:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003648_29884416.pth... [2024-08-05 21:54:27,941][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003147_25780224.pth [2024-08-05 21:54:28,057][52658] DAMAGECOUNT value on done: 2081.0 [2024-08-05 21:54:28,058][52658] Sum rewards: -1.602, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.255', 'AMMO2': '0.002', 'AMMO4': '0.012', 'ARMOR': '0.020', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.146', 'WEAPON7': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.258', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.000', 'weapon2': '1.334', 'weapon3': '1.976'} [2024-08-05 21:54:28,142][52659] DAMAGECOUNT value on done: 2510.0 [2024-08-05 21:54:28,143][52659] Sum rewards: 3.168, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon5': '0.160', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.436', 'weapon2': '1.544', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:28,827][52668] DAMAGECOUNT value on done: 1441.0 [2024-08-05 21:54:28,828][52668] Sum rewards: -0.540, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.570', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.135', 'weapon4': '0.172', 'DAMAGECOUNT': '0.462', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'weapon2': '1.368', 'weapon3': '1.442', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:28,880][52660] DAMAGECOUNT value on done: 1865.0 [2024-08-05 21:54:28,882][52660] Sum rewards: 6.480, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.685', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon7': '0.012', 'weapon5': '0.032', 'AMMO4': '0.042', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.467', 'WEAPON3': '0.500', 'weapon3': '1.168', 'DAMAGECOUNT': '1.290', 'weapon2': '1.450', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:29,383][52650] Updated weights for policy 0, policy_version 3651 (0.0021) [2024-08-05 21:54:29,594][52664] DAMAGECOUNT value on done: 1473.0 [2024-08-05 21:54:29,598][52664] Sum rewards: 1.210, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.304', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.032', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.250', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.245', 'weapon2': '1.458', 'weapon3': '1.592', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:29,824][52671] DAMAGECOUNT value on done: 2789.0 [2024-08-05 21:54:29,825][52671] Sum rewards: 2.301, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.454', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.352', 'HITCOUNT': '0.410', 'ARMOR': '0.436', 'WEAPON3': '0.800', 'weapon2': '0.850', 'DAMAGECOUNT': '1.722', 'weapon3': '2.130', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:31,341][52659] DAMAGECOUNT value on done: 1884.0 [2024-08-05 21:54:31,342][52659] Sum rewards: 2.298, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.164', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.036', 'weapon5': '0.042', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.125', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'weapon2': '1.148', 'DAMAGECOUNT': '1.815', 'weapon3': '2.298', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:31,550][52658] DAMAGECOUNT value on done: 1785.0 [2024-08-05 21:54:31,552][52658] Sum rewards: 0.480, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.966', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.024', 'AMMO3': '0.063', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.825', 'weapon2': '0.976', 'weapon3': '1.280', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:31,962][52668] DAMAGECOUNT value on done: 1985.0 [2024-08-05 21:54:31,962][52668] Sum rewards: 1.243, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.464', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.085', 'AMMO3': '0.115', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.750', 'ARMOR': '0.820', 'weapon2': '1.580', 'weapon3': '1.778', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:32,038][52660] DAMAGECOUNT value on done: 1771.0 [2024-08-05 21:54:32,039][52660] Sum rewards: 0.108, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.882', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.097', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.200', 'weapon3': '1.346', 'weapon2': '1.726'} [2024-08-05 21:54:32,321][52664] DAMAGECOUNT value on done: 1604.0 [2024-08-05 21:54:32,321][52664] Sum rewards: 3.685, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.307', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'weapon4': '0.164', 'HITCOUNT': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.705', 'weapon2': '0.864', 'weapon3': '1.372', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:32,696][52671] DAMAGECOUNT value on done: 2082.0 [2024-08-05 21:54:32,696][52671] Sum rewards: 1.111, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.184', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'AMMO3': '0.124', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.464', 'weapon2': '1.580', 'weapon3': '2.262', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 29966336. Throughput: 0: 4250.7. Samples: 7490910. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:54:32,795][52567] Avg episode reward: [(0, '0.415')] [2024-08-05 21:54:33,911][52650] Updated weights for policy 0, policy_version 3661 (0.0016) [2024-08-05 21:54:34,123][52659] DAMAGECOUNT value on done: 2289.0 [2024-08-05 21:54:34,125][52659] Sum rewards: 2.232, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.846', 'AMMO2': '0.004', 'ARMOR': '0.012', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.129', 'weapon4': '0.202', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon2': '1.092', 'DAMAGECOUNT': '1.434', 'weapon3': '2.022', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:34,863][52664] DAMAGECOUNT value on done: 2009.0 [2024-08-05 21:54:34,864][52664] Sum rewards: 0.558, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon4': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.214', 'weapon3': '1.416'} [2024-08-05 21:54:35,005][52668] DAMAGECOUNT value on done: 1817.0 [2024-08-05 21:54:35,005][52668] Sum rewards: -0.487, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.478', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO4': '0.031', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.762', 'WEAPON3': '0.850', 'weapon2': '1.602', 'weapon3': '1.990', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:35,059][52660] DAMAGECOUNT value on done: 1482.0 [2024-08-05 21:54:35,059][52660] Sum rewards: -1.240, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.256', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.114', 'AMMO3': '0.124', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.412', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.314', 'weapon3': '2.036'} [2024-08-05 21:54:35,720][52671] DAMAGECOUNT value on done: 1743.0 [2024-08-05 21:54:35,720][52671] Sum rewards: 0.108, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.932', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.024', 'AMMO4': '0.050', 'weapon5': '0.088', 'AMMO3': '0.089', 'HITCOUNT': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.285', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'weapon3': '1.122', 'weapon2': '1.614', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:37,028][52659] DAMAGECOUNT value on done: 1963.0 [2024-08-05 21:54:37,028][52659] Sum rewards: 0.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.716', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.274', 'weapon5': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'ARMOR': '0.870', 'FRAGCOUNT': '1.000', 'weapon3': '1.420', 'weapon2': '1.474'} [2024-08-05 21:54:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 30048256. Throughput: 0: 4254.9. Samples: 7516800. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 21:54:37,794][52567] Avg episode reward: [(0, '0.412')] [2024-08-05 21:54:37,795][52668] DAMAGECOUNT value on done: 2313.0 [2024-08-05 21:54:37,795][52668] Sum rewards: 2.196, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.520', 'AMMO2': '0.015', 'weapon4': '0.018', 'AMMO3': '0.070', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'ARMOR': '0.994', 'weapon3': '1.096', 'DAMAGECOUNT': '1.185', 'FRAGCOUNT': '2.000', 'weapon2': '2.374'} [2024-08-05 21:54:37,866][52660] DAMAGECOUNT value on done: 2163.0 [2024-08-05 21:54:37,866][52660] Sum rewards: 4.018, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.589', 'weapon4': '0.002', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.350', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.542', 'weapon3': '1.602', 'weapon2': '1.722', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:38,243][52671] DAMAGECOUNT value on done: 1982.0 [2024-08-05 21:54:38,243][52671] Sum rewards: 4.772, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.146', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'AMMO3': '0.099', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.539', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.200', 'weapon3': '1.812', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '5.000'} [2024-08-05 21:54:38,978][52650] Updated weights for policy 0, policy_version 3671 (0.0012) [2024-08-05 21:54:39,677][52659] DAMAGECOUNT value on done: 3264.0 [2024-08-05 21:54:39,677][52659] Sum rewards: 7.019, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.220', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO3': '0.071', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'weapon2': '1.196', 'weapon3': '1.540', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '6.000'} [2024-08-05 21:54:40,661][52668] DAMAGECOUNT value on done: 1915.0 [2024-08-05 21:54:40,664][52668] Sum rewards: -0.507, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.919', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.089', 'HITCOUNT': '0.160', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.657', 'FRAGCOUNT': '1.000', 'weapon3': '1.560', 'weapon2': '1.910'} [2024-08-05 21:54:40,755][52660] DAMAGECOUNT value on done: 2172.0 [2024-08-05 21:54:40,757][52660] Sum rewards: 0.217, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO3': '0.090', 'HITCOUNT': '0.450', 'ARMOR': '0.477', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.347', 'weapon3': '1.692', 'weapon2': '1.892', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:40,931][52671] DAMAGECOUNT value on done: 1316.0 [2024-08-05 21:54:40,931][52671] Sum rewards: -1.965, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.579', 'ARMOR': '0.008', 'AMMO2': '0.009', 'weapon4': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.660', 'weapon3': '1.432', 'weapon2': '1.778', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:42,018][52659] DAMAGECOUNT value on done: 2025.0 [2024-08-05 21:54:42,020][52659] Sum rewards: 1.383, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.106', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.146', 'HITCOUNT': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.915', 'weapon3': '1.258', 'weapon2': '1.706', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17066.6, 300 sec: 17106.0). Total num frames: 30138368. Throughput: 0: 4272.2. Samples: 7542650. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-05 21:54:42,795][52567] Avg episode reward: [(0, '0.529')] [2024-08-05 21:54:43,171][52668] DAMAGECOUNT value on done: 1883.0 [2024-08-05 21:54:43,171][52668] Sum rewards: -1.534, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.680', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.053', 'weapon4': '0.102', 'AMMO3': '0.117', 'weapon5': '0.138', 'HITCOUNT': '0.280', 'DAMAGECOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.196', 'weapon3': '1.926', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:43,277][52660] DAMAGECOUNT value on done: 2090.0 [2024-08-05 21:54:43,279][52660] Sum rewards: 2.393, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.334', 'AMMO2': '0.010', 'AMMO5': '0.018', 'AMMO4': '0.047', 'AMMO3': '0.109', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.176', 'WEAPON5': '0.250', 'HITCOUNT': '0.420', 'ARMOR': '0.487', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.320', 'weapon2': '1.438', 'weapon3': '1.892', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:43,413][52650] Updated weights for policy 0, policy_version 3681 (0.0016) [2024-08-05 21:54:43,880][52671] DAMAGECOUNT value on done: 2147.0 [2024-08-05 21:54:43,881][52671] Sum rewards: 0.761, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.146', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.020', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.675', 'weapon3': '0.838', 'weapon2': '1.340', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:45,432][52668] DAMAGECOUNT value on done: 1780.0 [2024-08-05 21:54:45,434][52668] Sum rewards: 2.999, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.400', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO3': '0.106', 'HITCOUNT': '0.250', 'ARMOR': '0.478', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.900', 'weapon2': '1.542', 'weapon3': '1.756', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:45,628][52660] DAMAGECOUNT value on done: 2152.0 [2024-08-05 21:54:45,629][52660] Sum rewards: 0.597, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.180', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.027', 'ARMOR': '0.028', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.530', 'weapon3': '1.788', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:45,629][52659] DAMAGECOUNT value on done: 2207.0 [2024-08-05 21:54:47,269][52671] DAMAGECOUNT value on done: 2729.0 [2024-08-05 21:54:47,270][52671] Sum rewards: 4.873, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.228', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.070', 'weapon4': '0.164', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.314', 'weapon3': '1.610', 'weapon2': '1.678', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 17078.3). Total num frames: 30220288. Throughput: 0: 4271.8. Samples: 7555550. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-05 21:54:47,794][52567] Avg episode reward: [(0, '0.581')] [2024-08-05 21:54:48,338][52668] DAMAGECOUNT value on done: 1598.0 [2024-08-05 21:54:48,339][52668] Sum rewards: 1.668, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.012', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.226', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.792', 'ARMOR': '0.856', 'weapon3': '1.320', 'weapon2': '1.406', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:48,408][52659] DAMAGECOUNT value on done: 1773.0 [2024-08-05 21:54:48,408][52659] Sum rewards: 1.203, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.400', 'AMMO2': '0.023', 'ARMOR': '0.072', 'AMMO3': '0.077', 'weapon4': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.591', 'weapon3': '1.366', 'weapon2': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:48,493][52660] DAMAGECOUNT value on done: 2068.0 [2024-08-05 21:54:48,495][52660] Sum rewards: -3.262, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.664', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.094', 'AMMO3': '0.152', 'weapon4': '0.172', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.264', 'weapon3': '1.844'} [2024-08-05 21:54:48,619][52650] Updated weights for policy 0, policy_version 3691 (0.0039) [2024-08-05 21:54:50,153][52671] DAMAGECOUNT value on done: 1693.0 [2024-08-05 21:54:50,156][52671] Sum rewards: -4.626, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.700', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.086', 'weapon5': '0.094', 'AMMO4': '0.172', 'HITCOUNT': '0.240', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.654', 'weapon2': '1.422', 'weapon3': '1.776'} [2024-08-05 21:54:51,190][52659] DAMAGECOUNT value on done: 2347.0 [2024-08-05 21:54:51,190][52659] Sum rewards: 0.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.067', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.492', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.816', 'weapon2': '1.068', 'weapon3': '1.778', 'FRAGCOUNT': '2.000'} [2024-08-05 21:54:51,282][52668] DAMAGECOUNT value on done: 1501.0 [2024-08-05 21:54:51,282][52668] Sum rewards: 0.831, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.092', 'HEALTH': '0.102', 'HITCOUNT': '0.220', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.486', 'weapon3': '1.876'} [2024-08-05 21:54:51,426][52660] DAMAGECOUNT value on done: 1702.0 [2024-08-05 21:54:51,429][52660] Sum rewards: 1.167, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO3': '0.054', 'AMMO4': '0.077', 'HITCOUNT': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.206', 'WEAPON3': '0.300', 'weapon4': '0.354', 'DAMAGECOUNT': '0.405', 'ARMOR': '0.440', 'weapon3': '0.646', 'weapon2': '0.892', 'FRAGCOUNT': '1.000'} [2024-08-05 21:54:52,558][52671] DAMAGECOUNT value on done: 2126.0 [2024-08-05 21:54:52,559][52671] Sum rewards: -1.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.528', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.270', 'ARMOR': '0.476', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.095', 'weapon2': '1.512', 'weapon3': '1.800', 'FRAGCOUNT': '3.000'} [2024-08-05 21:54:52,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17203.2, 300 sec: 17133.8). Total num frames: 30310400. Throughput: 0: 4285.3. Samples: 7581660. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 21:54:52,794][52567] Avg episode reward: [(0, '0.500')] [2024-08-05 21:54:52,887][52650] Updated weights for policy 0, policy_version 3701 (0.0026) [2024-08-05 21:54:54,074][52659] DAMAGECOUNT value on done: 1716.0 [2024-08-05 21:54:54,248][52660] DAMAGECOUNT value on done: 2931.0 [2024-08-05 21:54:54,248][52660] Sum rewards: 5.852, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.356', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'weapon4': '0.150', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon2': '1.104', 'weapon3': '2.140', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '7.000'} [2024-08-05 21:54:57,003][52659] DAMAGECOUNT value on done: 2520.0 [2024-08-05 21:54:57,003][52659] Sum rewards: 0.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.231', 'AMMO2': '0.022', 'AMMO3': '0.107', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'weapon4': '0.408', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'weapon2': '1.302', 'DAMAGECOUNT': '1.476', 'weapon3': '1.756', 'FRAGCOUNT': '4.000'} [2024-08-05 21:54:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.1, 300 sec: 17106.0). Total num frames: 30392320. Throughput: 0: 4281.8. Samples: 7607050. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:54:57,795][52567] Avg episode reward: [(0, '0.536')] [2024-08-05 21:54:58,218][52650] Updated weights for policy 0, policy_version 3711 (0.0024) [2024-08-05 21:55:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 17078.2). Total num frames: 30474240. Throughput: 0: 4274.2. Samples: 7619580. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:55:02,803][52567] Avg episode reward: [(0, '0.536')] [2024-08-05 21:55:02,892][52650] Updated weights for policy 0, policy_version 3721 (0.0023) [2024-08-05 21:55:03,086][52666] DAMAGECOUNT value on done: 1680.0 [2024-08-05 21:55:03,087][52666] Sum rewards: 5.654, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.346', 'AMMO2': '0.014', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.124', 'WEAPON3': '0.400', 'ARMOR': '0.420', 'HITCOUNT': '0.480', 'weapon3': '1.216', 'weapon2': '1.708', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '5.000'} [2024-08-05 21:55:06,435][52670] DAMAGECOUNT value on done: 2132.0 [2024-08-05 21:55:06,438][52670] Sum rewards: 5.583, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.535', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.194', 'weapon5': '0.272', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.110', 'weapon3': '1.332', 'weapon2': '1.504', 'FRAGCOUNT': '5.000'} [2024-08-05 21:55:06,470][52666] DAMAGECOUNT value on done: 2339.0 [2024-08-05 21:55:06,472][52666] Sum rewards: -2.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.680', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.226', 'HITCOUNT': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.119', 'weapon3': '1.284', 'weapon2': '1.772'} [2024-08-05 21:55:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.1, 300 sec: 17078.2). Total num frames: 30556160. Throughput: 0: 4262.2. Samples: 7644350. Policy #0 lag: (min: 1.0, avg: 4.1, max: 7.0) [2024-08-05 21:55:07,794][52567] Avg episode reward: [(0, '0.578')] [2024-08-05 21:55:08,004][52650] Updated weights for policy 0, policy_version 3731 (0.0020) [2024-08-05 21:55:09,863][52666] DAMAGECOUNT value on done: 1824.0 [2024-08-05 21:55:09,884][52670] DAMAGECOUNT value on done: 1863.0 [2024-08-05 21:55:09,885][52670] Sum rewards: -2.235, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.610', 'AMMO2': '0.023', 'weapon4': '0.106', 'AMMO4': '0.115', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'ARMOR': '0.436', 'DAMAGECOUNT': '0.792', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.424', 'weapon3': '2.082'} [2024-08-05 21:55:12,315][52650] Updated weights for policy 0, policy_version 3741 (0.0012) [2024-08-05 21:55:12,538][52670] DAMAGECOUNT value on done: 1764.0 [2024-08-05 21:55:12,538][52670] Sum rewards: -0.174, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.099', 'weapon4': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.426', 'WEAPON3': '0.650', 'ARMOR': '0.953', 'FRAGCOUNT': '1.000', 'weapon3': '1.338', 'weapon2': '1.930'} [2024-08-05 21:55:12,571][52666] DAMAGECOUNT value on done: 1572.0 [2024-08-05 21:55:12,571][52666] Sum rewards: 3.107, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'ARMOR': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.172', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.945', 'weapon2': '1.550', 'weapon3': '1.688', 'FRAGCOUNT': '4.000'} [2024-08-05 21:55:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 30646272. Throughput: 0: 4265.6. Samples: 7670140. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:55:12,794][52567] Avg episode reward: [(0, '0.575')] [2024-08-05 21:55:15,772][52670] DAMAGECOUNT value on done: 2094.0 [2024-08-05 21:55:15,776][52670] Sum rewards: -0.546, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.000', 'HEALTH': '-0.132', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.066', 'weapon7': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'weapon5': '0.272', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.816', 'ARMOR': '0.895', 'weapon3': '1.008', 'weapon2': '2.212'} [2024-08-05 21:55:15,815][52666] DAMAGECOUNT value on done: 1795.0 [2024-08-05 21:55:15,817][52666] Sum rewards: 2.986, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.818', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'weapon5': '0.118', 'HITCOUNT': '0.410', 'ARMOR': '0.416', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.410', 'weapon2': '1.552', 'weapon3': '1.842', 'FRAGCOUNT': '4.000'} [2024-08-05 21:55:17,348][52650] Updated weights for policy 0, policy_version 3751 (0.0020) [2024-08-05 21:55:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17066.7, 300 sec: 17133.8). Total num frames: 30736384. Throughput: 0: 4263.3. Samples: 7682760. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 21:55:17,794][52567] Avg episode reward: [(0, '0.612')] [2024-08-05 21:55:18,512][52670] DAMAGECOUNT value on done: 1482.0 [2024-08-05 21:55:18,514][52670] Sum rewards: 0.134, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.590', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.070', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.346', 'weapon3': '1.634'} [2024-08-05 21:55:18,542][52666] DAMAGECOUNT value on done: 2074.0 [2024-08-05 21:55:18,543][52666] Sum rewards: 1.902, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.313', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.975', 'weapon3': '1.528', 'weapon2': '1.966', 'FRAGCOUNT': '3.000'} [2024-08-05 21:55:19,144][52614] Signal inference workers to stop experience collection... (700 times) [2024-08-05 21:55:19,149][52614] Signal inference workers to resume experience collection... (700 times) [2024-08-05 21:55:19,241][52650] InferenceWorker_p0-w0: stopping experience collection (700 times) [2024-08-05 21:55:19,244][52650] InferenceWorker_p0-w0: resuming experience collection (700 times) [2024-08-05 21:55:21,472][52670] DAMAGECOUNT value on done: 2106.0 [2024-08-05 21:55:21,472][52670] Sum rewards: 1.758, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.658', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'ARMOR': '0.080', 'AMMO3': '0.109', 'weapon4': '0.110', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.167', 'weapon2': '1.574', 'weapon3': '1.978', 'FRAGCOUNT': '3.000'} [2024-08-05 21:55:21,557][52666] DAMAGECOUNT value on done: 2292.0 [2024-08-05 21:55:21,559][52666] Sum rewards: 1.865, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.074', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.170', 'weapon3': '1.412', 'weapon2': '1.578', 'FRAGCOUNT': '3.000'} [2024-08-05 21:55:22,134][52650] Updated weights for policy 0, policy_version 3761 (0.0023) [2024-08-05 21:55:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 30818304. Throughput: 0: 4259.8. Samples: 7708490. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:55:22,794][52567] Avg episode reward: [(0, '0.722')] [2024-08-05 21:55:24,605][52670] DAMAGECOUNT value on done: 2022.0 [2024-08-05 21:55:24,605][52670] Sum rewards: -0.798, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.559', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.100', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.870', 'weapon2': '1.510', 'weapon3': '1.630', 'FRAGCOUNT': '2.000'} [2024-08-05 21:55:24,713][52666] DAMAGECOUNT value on done: 1248.0 [2024-08-05 21:55:24,714][52666] Sum rewards: -1.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.960', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.115', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.387', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.594', 'weapon3': '1.870'} [2024-08-05 21:55:27,038][52650] Updated weights for policy 0, policy_version 3771 (0.0039) [2024-08-05 21:55:27,743][52670] DAMAGECOUNT value on done: 1750.0 [2024-08-05 21:55:27,746][52670] Sum rewards: -1.555, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.435', 'AMMO4': '-0.097', 'AMMO2': '-0.019', 'AMMO5': '0.010', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'HITCOUNT': '0.250', 'weapon5': '0.352', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.840', 'weapon3': '1.298', 'weapon2': '1.480', 'FRAGCOUNT': '2.000'} [2024-08-05 21:55:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 17106.0). Total num frames: 30900224. Throughput: 0: 4261.6. Samples: 7734420. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:55:27,794][52567] Avg episode reward: [(0, '0.637')] [2024-08-05 21:55:27,965][52666] DAMAGECOUNT value on done: 2243.0 [2024-08-05 21:55:27,965][52666] Sum rewards: 4.465, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.708', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.112', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon2': '1.576', 'DAMAGECOUNT': '1.725', 'weapon3': '1.936', 'FRAGCOUNT': '5.000'} [2024-08-05 21:55:30,780][52670] DAMAGECOUNT value on done: 1209.0 [2024-08-05 21:55:30,780][52670] Sum rewards: -2.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.380', 'ARMOR': '0.452', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.482', 'weapon2': '1.696', 'weapon3': '1.832', 'FRAGCOUNT': '2.000'} [2024-08-05 21:55:30,893][52666] DAMAGECOUNT value on done: 2059.0 [2024-08-05 21:55:30,895][52666] Sum rewards: 1.125, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.774', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'HITCOUNT': '0.160', 'weapon4': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.633', 'weapon2': '1.042', 'weapon3': '1.122', 'FRAGCOUNT': '2.000'} [2024-08-05 21:55:31,730][52650] Updated weights for policy 0, policy_version 3781 (0.0012) [2024-08-05 21:55:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 30990336. Throughput: 0: 4257.8. Samples: 7747150. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 21:55:32,802][52567] Avg episode reward: [(0, '0.682')] [2024-08-05 21:55:34,174][52670] DAMAGECOUNT value on done: 1733.0 [2024-08-05 21:55:34,176][52670] Sum rewards: 2.895, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.795', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.383', 'weapon2': '1.684', 'weapon3': '2.088', 'FRAGCOUNT': '4.000'} [2024-08-05 21:55:34,342][52666] DAMAGECOUNT value on done: 2141.0 [2024-08-05 21:55:34,343][52666] Sum rewards: -0.902, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO2': '0.009', 'AMMO5': '0.015', 'weapon5': '0.030', 'AMMO4': '0.044', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'ARMOR': '0.504', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.990', 'weapon2': '1.500', 'FRAGCOUNT': '2.000', 'weapon3': '2.070'} [2024-08-05 21:55:36,806][52650] Updated weights for policy 0, policy_version 3791 (0.0027) [2024-08-05 21:55:37,499][52670] DAMAGECOUNT value on done: 2029.0 [2024-08-05 21:55:37,499][52670] Sum rewards: 2.040, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.314', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'AMMO4': '0.074', 'AMMO3': '0.097', 'weapon4': '0.102', 'HITCOUNT': '0.280', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.876', 'weapon2': '0.972', 'weapon3': '1.466', 'FRAGCOUNT': '3.000'} [2024-08-05 21:55:37,686][52666] DAMAGECOUNT value on done: 2025.0 [2024-08-05 21:55:37,688][52666] Sum rewards: 1.190, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon5': '0.046', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.215', 'weapon3': '1.478', 'weapon2': '2.046', 'FRAGCOUNT': '3.000'} [2024-08-05 21:55:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 31072256. Throughput: 0: 4243.3. Samples: 7772610. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:55:37,794][52567] Avg episode reward: [(0, '0.673')] [2024-08-05 21:55:40,514][52670] DAMAGECOUNT value on done: 2471.0 [2024-08-05 21:55:40,517][52670] Sum rewards: 0.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.350', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.238', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.137', 'weapon2': '1.634', 'weapon3': '1.832', 'FRAGCOUNT': '2.000'} [2024-08-05 21:55:40,648][52666] DAMAGECOUNT value on done: 1476.0 [2024-08-05 21:55:40,650][52666] Sum rewards: 0.340, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.785', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.047', 'WEAPON4': '0.100', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'weapon4': '0.278', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.624', 'weapon3': '0.822', 'weapon2': '0.924', 'FRAGCOUNT': '1.000'} [2024-08-05 21:55:41,268][52650] Updated weights for policy 0, policy_version 3801 (0.0021) [2024-08-05 21:55:42,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16930.2, 300 sec: 17106.0). Total num frames: 31154176. Throughput: 0: 4236.7. Samples: 7797700. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:55:42,794][52567] Avg episode reward: [(0, '0.694')] [2024-08-05 21:55:43,757][52670] DAMAGECOUNT value on done: 2186.0 [2024-08-05 21:55:43,762][52670] Sum rewards: 4.910, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.270', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.077', 'ARMOR': '0.090', 'weapon4': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.320', 'weapon3': '1.458', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '5.000'} [2024-08-05 21:55:43,887][52666] DAMAGECOUNT value on done: 2210.0 [2024-08-05 21:55:43,887][52666] Sum rewards: 6.091, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.728', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'weapon4': '0.474', 'ARMOR': '0.580', 'WEAPON3': '0.650', 'weapon2': '1.240', 'DAMAGECOUNT': '1.755', 'weapon3': '1.920', 'FRAGCOUNT': '6.000'} [2024-08-05 21:55:46,204][52650] Updated weights for policy 0, policy_version 3811 (0.0013) [2024-08-05 21:55:47,043][52670] DAMAGECOUNT value on done: 2243.0 [2024-08-05 21:55:47,046][52670] Sum rewards: -1.138, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'HITCOUNT': '0.380', 'ARMOR': '0.857', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.305', 'weapon2': '1.402', 'FRAGCOUNT': '2.000', 'weapon3': '2.168'} [2024-08-05 21:55:47,157][52666] DAMAGECOUNT value on done: 1778.0 [2024-08-05 21:55:47,161][52666] Sum rewards: 1.236, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.055', 'AMMO2': '0.011', 'AMMO3': '0.040', 'ARMOR': '0.040', 'AMMO4': '0.055', 'HITCOUNT': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.190', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.330', 'FRAGCOUNT': '1.000', 'weapon2': '1.028', 'weapon3': '1.086'} [2024-08-05 21:55:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.6, 300 sec: 17106.0). Total num frames: 31244288. Throughput: 0: 4242.0. Samples: 7810470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:55:47,795][52567] Avg episode reward: [(0, '0.757')] [2024-08-05 21:55:50,284][52670] DAMAGECOUNT value on done: 1853.0 [2024-08-05 21:55:50,287][52670] Sum rewards: -1.139, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.465', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'AMMO3': '0.073', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.130', 'weapon2': '1.616'} [2024-08-05 21:55:50,394][52666] DAMAGECOUNT value on done: 1754.0 [2024-08-05 21:55:50,396][52666] Sum rewards: 0.158, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.397', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon4': '0.022', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon2': '1.730', 'weapon3': '1.810'} [2024-08-05 21:55:50,817][52650] Updated weights for policy 0, policy_version 3821 (0.0025) [2024-08-05 21:55:52,311][52811] DAMAGECOUNT value on done: 2380.0 [2024-08-05 21:55:52,311][52811] Sum rewards: -0.009, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.085', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'HITCOUNT': '0.510', 'weapon2': '0.918', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.584', 'weapon3': '1.694', 'FRAGCOUNT': '5.000'} [2024-08-05 21:55:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 17106.0). Total num frames: 31326208. Throughput: 0: 4268.9. Samples: 7836450. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 21:55:52,794][52567] Avg episode reward: [(0, '0.721')] [2024-08-05 21:55:53,149][52670] DAMAGECOUNT value on done: 1406.0 [2024-08-05 21:55:53,151][52670] Sum rewards: -0.514, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.665', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.064', 'AMMO3': '0.108', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.320', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.800', 'weapon2': '1.404', 'weapon3': '1.814', 'FRAGCOUNT': '4.000'} [2024-08-05 21:55:53,287][52666] DAMAGECOUNT value on done: 1485.0 [2024-08-05 21:55:53,289][52666] Sum rewards: 3.269, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.171', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.212', 'ARMOR': '1.381', 'weapon2': '1.718'} [2024-08-05 21:55:55,402][52803] DAMAGECOUNT value on done: 2214.0 [2024-08-05 21:55:55,404][52803] Sum rewards: 0.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.086', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon4': '0.136', 'AMMO3': '0.147', 'weapon5': '0.186', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.575', 'weapon3': '1.708', 'weapon2': '1.826', 'FRAGCOUNT': '3.000'} [2024-08-05 21:55:55,547][52811] DAMAGECOUNT value on done: 1778.0 [2024-08-05 21:55:55,547][52811] Sum rewards: 1.756, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.208', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'ARMOR': '0.108', 'weapon5': '0.108', 'AMMO3': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.358', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.095', 'weapon2': '1.190', 'weapon3': '2.006', 'FRAGCOUNT': '3.000'} [2024-08-05 21:55:55,874][52650] Updated weights for policy 0, policy_version 3831 (0.0010) [2024-08-05 21:55:56,610][52670] DAMAGECOUNT value on done: 2047.0 [2024-08-05 21:55:56,612][52670] Sum rewards: 0.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO3': '0.070', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.765', 'weapon3': '1.642', 'weapon2': '1.870', 'FRAGCOUNT': '2.000'} [2024-08-05 21:55:56,829][52666] DAMAGECOUNT value on done: 2006.0 [2024-08-05 21:55:57,724][52795] DAMAGECOUNT value on done: 1400.0 [2024-08-05 21:55:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 31416320. Throughput: 0: 4262.4. Samples: 7861950. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:55:57,794][52567] Avg episode reward: [(0, '0.782')] [2024-08-05 21:55:58,520][52803] DAMAGECOUNT value on done: 2416.0 [2024-08-05 21:55:58,522][52803] Sum rewards: -2.269, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.980', 'AMMO2': '0.009', 'ARMOR': '0.020', 'AMMO4': '0.047', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.080', 'DAMAGECOUNT': '1.167', 'weapon3': '1.648'} [2024-08-05 21:55:58,839][52811] DAMAGECOUNT value on done: 2162.0 [2024-08-05 21:55:58,839][52811] Sum rewards: 0.126, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.876', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.284', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.810', 'weapon2': '1.208', 'weapon3': '1.774', 'FRAGCOUNT': '2.000'} [2024-08-05 21:55:59,891][52670] DAMAGECOUNT value on done: 2713.0 [2024-08-05 21:55:59,894][52670] Sum rewards: -0.259, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.656', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.101', 'HITCOUNT': '0.180', 'ARMOR': '0.425', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'weapon3': '1.418', 'weapon2': '1.430', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:00,074][52666] DAMAGECOUNT value on done: 2736.0 [2024-08-05 21:56:00,077][52666] Sum rewards: 1.777, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.002', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.046', 'weapon7': '0.058', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.370', 'ARMOR': '0.481', 'WEAPON3': '0.600', 'weapon3': '0.888', 'DAMAGECOUNT': '1.275', 'weapon2': '1.516', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:00,365][52650] Updated weights for policy 0, policy_version 3841 (0.0041) [2024-08-05 21:56:01,119][52795] DAMAGECOUNT value on done: 2106.0 [2024-08-05 21:56:01,119][52795] Sum rewards: -1.984, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.056', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.146', 'weapon4': '0.212', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.125', 'weapon2': '1.234', 'weapon3': '2.332', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:01,825][52803] DAMAGECOUNT value on done: 1904.0 [2024-08-05 21:56:01,827][52803] Sum rewards: 2.332, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.512', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.015', 'AMMO3': '0.060', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'weapon5': '0.424', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.789', 'ARMOR': '0.913', 'weapon3': '1.436', 'weapon2': '1.594', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:01,989][52811] DAMAGECOUNT value on done: 2119.0 [2024-08-05 21:56:01,991][52811] Sum rewards: -3.067, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.382', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.145', 'HITCOUNT': '0.330', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.161', 'weapon3': '1.650', 'weapon2': '1.912', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:02,550][52670] DAMAGECOUNT value on done: 1628.0 [2024-08-05 21:56:02,552][52670] Sum rewards: 0.227, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.956', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'AMMO3': '0.050', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.510', 'ARMOR': '0.865', 'weapon3': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.630'} [2024-08-05 21:56:02,728][52666] DAMAGECOUNT value on done: 1992.0 [2024-08-05 21:56:02,730][52666] Sum rewards: -1.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.604', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.230', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.636', 'ARMOR': '0.909', 'FRAGCOUNT': '1.000', 'weapon3': '1.354', 'weapon2': '1.718'} [2024-08-05 21:56:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 31498240. Throughput: 0: 4266.4. Samples: 7874750. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 21:56:02,794][52567] Avg episode reward: [(0, '0.693')] [2024-08-05 21:56:04,390][52795] DAMAGECOUNT value on done: 2036.0 [2024-08-05 21:56:04,390][52795] Sum rewards: 2.415, reward structure: {'DEATHCOUNT': '-0.750', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'HEALTH': '0.017', 'AMMO3': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON3': '0.150', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.372', 'weapon2': '0.416', 'weapon3': '0.462', 'FRAGCOUNT': '1.000'} [2024-08-05 21:56:05,124][52803] DAMAGECOUNT value on done: 3351.0 [2024-08-05 21:56:05,125][52803] Sum rewards: 2.173, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.700', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.021', 'AMMO3': '0.080', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.396', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.885', 'weapon2': '1.316', 'weapon3': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:05,144][52811] DAMAGECOUNT value on done: 2143.0 [2024-08-05 21:56:05,145][52811] Sum rewards: -0.393, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.040', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon4': '0.010', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.280', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.017', 'weapon2': '1.782', 'weapon3': '2.014', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:05,429][52650] Updated weights for policy 0, policy_version 3851 (0.0020) [2024-08-05 21:56:05,656][52670] DAMAGECOUNT value on done: 2062.0 [2024-08-05 21:56:05,658][52670] Sum rewards: 1.698, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.570', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.070', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.260', 'WEAPON3': '0.500', 'ARMOR': '0.573', 'DAMAGECOUNT': '0.735', 'weapon2': '1.362', 'weapon3': '1.456', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:07,733][52795] DAMAGECOUNT value on done: 3098.0 [2024-08-05 21:56:07,741][52795] Sum rewards: -0.335, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.556', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.030', 'AMMO3': '0.081', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'weapon5': '0.186', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.449', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.380', 'weapon2': '1.472'} [2024-08-05 21:56:07,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17066.6, 300 sec: 17078.2). Total num frames: 31580160. Throughput: 0: 4262.4. Samples: 7900300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:56:07,795][52567] Avg episode reward: [(0, '0.821')] [2024-08-05 21:56:08,328][52811] DAMAGECOUNT value on done: 2151.0 [2024-08-05 21:56:08,330][52803] DAMAGECOUNT value on done: 2912.0 [2024-08-05 21:56:08,330][52811] Sum rewards: -1.861, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.488', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon4': '0.004', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.575', 'weapon3': '1.628', 'FRAGCOUNT': '2.000', 'weapon2': '2.126'} [2024-08-05 21:56:08,330][52803] Sum rewards: 0.757, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.519', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.159', 'ARMOR': '0.472', 'HITCOUNT': '0.550', 'WEAPON3': '1.050', 'weapon2': '1.634', 'weapon3': '1.876', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:10,035][52650] Updated weights for policy 0, policy_version 3861 (0.0033) [2024-08-05 21:56:10,968][52795] DAMAGECOUNT value on done: 2129.0 [2024-08-05 21:56:10,968][52795] Sum rewards: 4.369, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.507', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon4': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.228', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'weapon3': '1.208', 'ARMOR': '1.327', 'DAMAGECOUNT': '1.335', 'weapon2': '2.190', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:11,517][52811] DAMAGECOUNT value on done: 2307.0 [2024-08-05 21:56:11,519][52811] Sum rewards: 0.840, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.833', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'DAMAGECOUNT': '1.104', 'weapon3': '1.214', 'FRAGCOUNT': '2.000', 'weapon2': '2.000'} [2024-08-05 21:56:11,611][52803] DAMAGECOUNT value on done: 2239.0 [2024-08-05 21:56:11,612][52803] Sum rewards: -2.691, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.930', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.741', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.088', 'weapon3': '2.470'} [2024-08-05 21:56:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17066.6, 300 sec: 17133.8). Total num frames: 31670272. Throughput: 0: 4261.8. Samples: 7926200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:56:12,795][52567] Avg episode reward: [(0, '0.808')] [2024-08-05 21:56:14,220][52795] DAMAGECOUNT value on done: 2468.0 [2024-08-05 21:56:14,224][52795] Sum rewards: 1.756, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.380', 'AMMO2': '0.008', 'ARMOR': '0.016', 'AMMO4': '0.040', 'AMMO3': '0.133', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'weapon2': '1.452', 'DAMAGECOUNT': '1.650', 'weapon3': '1.756', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:14,586][52811] DAMAGECOUNT value on done: 1292.0 [2024-08-05 21:56:14,587][52811] Sum rewards: 0.360, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.582', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon7': '0.086', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.510', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.885', 'weapon2': '1.592', 'weapon3': '1.614', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:14,880][52803] DAMAGECOUNT value on done: 3081.0 [2024-08-05 21:56:14,880][52803] Sum rewards: 1.386, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.708', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon7': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.188', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.428', 'ARMOR': '0.546', 'WEAPON3': '0.700', 'weapon3': '1.208', 'DAMAGECOUNT': '1.386', 'weapon2': '1.528', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:15,238][52650] Updated weights for policy 0, policy_version 3871 (0.0060) [2024-08-05 21:56:16,383][52665] DAMAGECOUNT value on done: 2859.0 [2024-08-05 21:56:16,386][52665] Sum rewards: 0.403, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.393', 'AMMO4': '-0.090', 'AMMO2': '-0.018', 'AMMO5': '0.010', 'weapon5': '0.080', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'HITCOUNT': '0.270', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.840', 'weapon3': '1.106', 'weapon2': '1.646', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:17,495][52795] DAMAGECOUNT value on done: 2001.0 [2024-08-05 21:56:17,495][52795] Sum rewards: 2.189, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.015', 'ARMOR': '0.016', 'HEALTH': '0.041', 'AMMO4': '0.072', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.170', 'HITCOUNT': '0.240', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.735', 'weapon2': '1.274', 'weapon3': '1.548', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16930.1, 300 sec: 17078.2). Total num frames: 31752192. Throughput: 0: 4269.1. Samples: 7939260. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 21:56:17,802][52567] Avg episode reward: [(0, '0.752')] [2024-08-05 21:56:17,826][52811] DAMAGECOUNT value on done: 1641.0 [2024-08-05 21:56:17,829][52811] Sum rewards: -4.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.862', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.034', 'AMMO3': '0.151', 'HITCOUNT': '0.160', 'weapon5': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.064', 'weapon3': '2.084'} [2024-08-05 21:56:18,212][52803] DAMAGECOUNT value on done: 2710.0 [2024-08-05 21:56:18,215][52803] Sum rewards: 4.401, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.476', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon7': '0.064', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.272', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.350', 'weapon3': '1.558', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:19,190][52665] DAMAGECOUNT value on done: 1970.0 [2024-08-05 21:56:19,192][52665] Sum rewards: 2.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.280', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'weapon4': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.795', 'ARMOR': '0.897', 'weapon3': '1.318', 'weapon2': '1.640', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:19,449][52650] Updated weights for policy 0, policy_version 3881 (0.0014) [2024-08-05 21:56:20,780][52795] DAMAGECOUNT value on done: 2364.0 [2024-08-05 21:56:20,784][52795] Sum rewards: 3.211, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.644', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'ARMOR': '0.024', 'AMMO3': '0.113', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.605', 'weapon2': '1.780', 'weapon3': '2.114', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:20,970][52811] DAMAGECOUNT value on done: 1932.0 [2024-08-05 21:56:20,971][52811] Sum rewards: -0.108, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.241', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.110', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.700', 'ARMOR': '1.305', 'weapon3': '1.516', 'weapon2': '1.794', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:21,311][52803] DAMAGECOUNT value on done: 1670.0 [2024-08-05 21:56:21,311][52803] Sum rewards: -0.371, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.475', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.015', 'weapon5': '0.042', 'ARMOR': '0.048', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon2': '1.188', 'weapon3': '1.550'} [2024-08-05 21:56:22,045][52665] DAMAGECOUNT value on done: 3174.0 [2024-08-05 21:56:22,046][52665] Sum rewards: -0.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.088', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.630', 'ARMOR': '0.832', 'WEAPON3': '0.950', 'weapon2': '1.886', 'weapon3': '1.950', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.127'} [2024-08-05 21:56:22,049][52794] DAMAGECOUNT value on done: 1778.0 [2024-08-05 21:56:22,049][52794] Sum rewards: 0.742, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.033', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.096', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.122', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.700', 'weapon2': '1.470', 'weapon3': '1.936', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:22,604][52669] DAMAGECOUNT value on done: 1673.0 [2024-08-05 21:56:22,604][52669] Sum rewards: 2.831, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.785', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.088', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.155', 'weapon2': '1.306', 'weapon3': '1.710', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 31850496. Throughput: 0: 4275.6. Samples: 7965010. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-05 21:56:22,794][52567] Avg episode reward: [(0, '0.766')] [2024-08-05 21:56:23,950][52795] DAMAGECOUNT value on done: 2245.0 [2024-08-05 21:56:23,954][52795] Sum rewards: 2.350, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.876', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.025', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'weapon3': '1.586', 'DAMAGECOUNT': '1.602', 'weapon2': '1.854', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:24,135][52820] DAMAGECOUNT value on done: 1896.0 [2024-08-05 21:56:24,137][52820] Sum rewards: 2.123, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.014', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.094', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.185', 'weapon2': '1.568', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:24,288][52811] DAMAGECOUNT value on done: 2479.0 [2024-08-05 21:56:24,290][52811] Sum rewards: 6.947, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.112', 'ARMOR': '0.457', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.612', 'weapon3': '1.654', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:24,414][52803] DAMAGECOUNT value on done: 1774.0 [2024-08-05 21:56:24,417][52803] Sum rewards: 0.282, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.064', 'weapon4': '0.082', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.005', 'weapon3': '1.418', 'weapon2': '1.678', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:24,501][52794] DAMAGECOUNT value on done: 2211.0 [2024-08-05 21:56:24,504][52794] Sum rewards: 4.860, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.712', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.245', 'weapon3': '1.324', 'ARMOR': '1.365', 'weapon2': '1.852', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:24,589][52650] Updated weights for policy 0, policy_version 3891 (0.0034) [2024-08-05 21:56:24,856][52665] DAMAGECOUNT value on done: 1229.0 [2024-08-05 21:56:25,245][52662] DAMAGECOUNT value on done: 1869.0 [2024-08-05 21:56:25,247][52662] Sum rewards: 2.246, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.236', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.087', 'HITCOUNT': '0.370', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'weapon2': '1.306', 'weapon3': '1.394', 'DAMAGECOUNT': '1.458', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:25,986][52669] DAMAGECOUNT value on done: 2069.0 [2024-08-05 21:56:25,986][52669] Sum rewards: 0.941, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.580', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.102', 'weapon4': '0.124', 'HITCOUNT': '0.350', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.194', 'weapon2': '1.554', 'weapon3': '1.704', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:27,093][52794] DAMAGECOUNT value on done: 3032.0 [2024-08-05 21:56:27,093][52794] Sum rewards: 4.637, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.734', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO3': '0.072', 'WEAPON5': '0.150', 'ARMOR': '0.415', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon2': '1.250', 'weapon3': '1.560', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:27,189][52795] DAMAGECOUNT value on done: 2007.0 [2024-08-05 21:56:27,189][52795] Sum rewards: -1.878, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.258', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.028', 'WEAPON5': '0.050', 'HITCOUNT': '0.070', 'weapon4': '0.074', 'AMMO4': '0.075', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.207', 'WEAPON3': '0.550', 'ARMOR': '0.965', 'FRAGCOUNT': '1.000', 'weapon3': '1.244', 'weapon2': '1.550'} [2024-08-05 21:56:27,417][52820] DAMAGECOUNT value on done: 2284.0 [2024-08-05 21:56:27,419][52820] Sum rewards: 1.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.618', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.486', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.430', 'DAMAGECOUNT': '1.773', 'weapon3': '1.860', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:27,579][52811] DAMAGECOUNT value on done: 1864.0 [2024-08-05 21:56:27,580][52811] Sum rewards: 3.069, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.258', 'HEALTH': '0.364', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.981', 'weapon2': '0.984', 'weapon3': '1.584', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:27,683][52803] DAMAGECOUNT value on done: 1648.0 [2024-08-05 21:56:27,777][52662] DAMAGECOUNT value on done: 2060.0 [2024-08-05 21:56:27,778][52665] DAMAGECOUNT value on done: 2233.0 [2024-08-05 21:56:27,778][52665] Sum rewards: 0.701, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.066', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.152', 'WEAPON7': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'ARMOR': '0.954', 'weapon3': '1.352', 'DAMAGECOUNT': '1.371', 'weapon2': '1.840', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:27,781][52662] Sum rewards: -3.076, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon4': '0.260', 'ARMOR': '0.461', 'DAMAGECOUNT': '0.594', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '2.074'} [2024-08-05 21:56:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.6, 300 sec: 17078.2). Total num frames: 31924224. Throughput: 0: 4281.6. Samples: 7990370. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:56:27,795][52567] Avg episode reward: [(0, '0.759')] [2024-08-05 21:56:27,875][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003898_31932416.pth... [2024-08-05 21:56:28,007][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003397_27828224.pth [2024-08-05 21:56:29,254][52650] Updated weights for policy 0, policy_version 3901 (0.0025) [2024-08-05 21:56:29,436][52669] DAMAGECOUNT value on done: 2079.0 [2024-08-05 21:56:29,437][52669] Sum rewards: 4.373, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.262', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'ARMOR': '0.440', 'weapon4': '0.494', 'WEAPON3': '0.750', 'weapon2': '0.936', 'DAMAGECOUNT': '1.710', 'weapon3': '2.138', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:29,850][52794] DAMAGECOUNT value on done: 3031.0 [2024-08-05 21:56:29,850][52794] Sum rewards: 5.054, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.230', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'weapon5': '0.038', 'ARMOR': '0.056', 'AMMO3': '0.125', 'weapon4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.900', 'WEAPON3': '0.950', 'weapon2': '1.378', 'weapon3': '2.224', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '7.000'} [2024-08-05 21:56:30,384][52795] DAMAGECOUNT value on done: 1932.0 [2024-08-05 21:56:30,384][52795] Sum rewards: 0.249, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'HITCOUNT': '0.160', 'weapon4': '0.194', 'AMMO4': '0.239', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.720', 'ARMOR': '0.848', 'weapon3': '1.276', 'weapon2': '1.354', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:30,395][52662] DAMAGECOUNT value on done: 2236.0 [2024-08-05 21:56:30,395][52662] Sum rewards: 1.519, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.653', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.062', 'weapon4': '0.116', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.246', 'HITCOUNT': '0.360', 'ARMOR': '0.496', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.470', 'weapon2': '1.634', 'weapon3': '1.678', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:30,813][52820] DAMAGECOUNT value on done: 2012.0 [2024-08-05 21:56:30,813][52820] Sum rewards: 2.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.357', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.074', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'HITCOUNT': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.206', 'weapon2': '1.472', 'weapon3': '1.886', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:30,822][52665] DAMAGECOUNT value on done: 2008.0 [2024-08-05 21:56:30,822][52665] Sum rewards: -0.258, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.429', 'AMMO2': '0.021', 'HITCOUNT': '0.070', 'AMMO4': '0.104', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'DAMAGECOUNT': '0.240', 'weapon4': '0.372', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'weapon2': '0.928', 'FRAGCOUNT': '1.000', 'weapon3': '1.378'} [2024-08-05 21:56:30,944][52811] DAMAGECOUNT value on done: 1577.0 [2024-08-05 21:56:30,948][52811] Sum rewards: 0.510, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HEALTH': '0.196', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.744', 'FRAGCOUNT': '1.000', 'weapon3': '1.466', 'weapon2': '2.016'} [2024-08-05 21:56:30,976][52803] DAMAGECOUNT value on done: 1885.0 [2024-08-05 21:56:31,457][52647] DAMAGECOUNT value on done: 1533.0 [2024-08-05 21:56:31,459][52647] Sum rewards: 0.422, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.956', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.091', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.480', 'ARMOR': '0.486', 'WEAPON3': '0.600', 'weapon3': '1.030', 'weapon2': '1.074', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:32,189][52794] DAMAGECOUNT value on done: 2669.0 [2024-08-05 21:56:32,189][52794] Sum rewards: 0.896, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.838', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.234', 'HITCOUNT': '0.420', 'ARMOR': '0.498', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.245', 'weapon3': '1.440', 'weapon2': '1.674', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:32,445][52669] DAMAGECOUNT value on done: 3562.0 [2024-08-05 21:56:32,445][52669] Sum rewards: -2.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.272', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'ARMOR': '0.032', 'AMMO3': '0.132', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.526', 'weapon3': '2.076'} [2024-08-05 21:56:32,775][52662] DAMAGECOUNT value on done: 1817.0 [2024-08-05 21:56:32,775][52662] Sum rewards: -1.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.634', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.058', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'AMMO3': '0.133', 'weapon5': '0.172', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.264', 'weapon3': '1.978'} [2024-08-05 21:56:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 32014336. Throughput: 0: 4272.5. Samples: 8002730. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:56:32,794][52567] Avg episode reward: [(0, '0.958')] [2024-08-05 21:56:32,795][52614] Saving new best policy, reward=0.958! [2024-08-05 21:56:33,704][52795] DAMAGECOUNT value on done: 1976.0 [2024-08-05 21:56:33,704][52795] Sum rewards: 3.442, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.755', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'weapon4': '0.006', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'HITCOUNT': '0.210', 'WEAPON3': '0.500', 'ARMOR': '0.548', 'DAMAGECOUNT': '1.035', 'weapon2': '1.468', 'weapon3': '1.610', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:33,989][52665] DAMAGECOUNT value on done: 1755.0 [2024-08-05 21:56:33,992][52665] Sum rewards: 1.900, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.434', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon5': '0.256', 'weapon4': '0.326', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.600', 'ARMOR': '0.861', 'weapon3': '1.236', 'weapon2': '1.272', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:34,008][52820] DAMAGECOUNT value on done: 2589.0 [2024-08-05 21:56:34,008][52820] Sum rewards: 4.794, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.475', 'AMMO2': '0.019', 'AMMO3': '0.048', 'weapon7': '0.048', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.280', 'WEAPON3': '0.350', 'ARMOR': '0.421', 'weapon3': '0.800', 'weapon2': '0.820', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:34,163][52803] DAMAGECOUNT value on done: 2170.0 [2024-08-05 21:56:34,163][52803] Sum rewards: 8.035, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.060', 'AMMO4': '0.060', 'weapon4': '0.268', 'HEALTH': '0.304', 'WEAPON3': '0.350', 'HITCOUNT': '0.470', 'ARMOR': '0.885', 'weapon3': '1.346', 'weapon2': '1.766', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:34,274][52650] Updated weights for policy 0, policy_version 3911 (0.0017) [2024-08-05 21:56:34,412][52811] DAMAGECOUNT value on done: 1795.0 [2024-08-05 21:56:34,413][52811] Sum rewards: -0.499, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.106', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.131', 'HITCOUNT': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.077', 'weapon2': '1.572', 'FRAGCOUNT': '2.000', 'weapon3': '2.302'} [2024-08-05 21:56:34,458][52647] DAMAGECOUNT value on done: 2598.0 [2024-08-05 21:56:34,747][52794] DAMAGECOUNT value on done: 2608.0 [2024-08-05 21:56:34,747][52794] Sum rewards: -1.777, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.927', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'weapon5': '0.264', 'HITCOUNT': '0.320', 'WEAPON3': '0.800', 'ARMOR': '0.895', 'DAMAGECOUNT': '1.041', 'weapon3': '1.388', 'weapon2': '1.920', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:34,803][52669] DAMAGECOUNT value on done: 2483.0 [2024-08-05 21:56:34,807][52669] Sum rewards: 2.224, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.400', 'AMMO4': '-0.110', 'AMMO2': '-0.022', 'AMMO3': '0.119', 'HITCOUNT': '0.340', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.236', 'weapon2': '1.746', 'weapon3': '1.758', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:34,839][52663] DAMAGECOUNT value on done: 1703.0 [2024-08-05 21:56:35,358][52662] DAMAGECOUNT value on done: 2479.0 [2024-08-05 21:56:35,358][52662] Sum rewards: 2.127, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.570', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO3': '0.115', 'HITCOUNT': '0.290', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.906', 'weapon2': '1.430', 'weapon3': '1.526', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:36,226][52649] DAMAGECOUNT value on done: 1908.0 [2024-08-05 21:56:36,230][52649] Sum rewards: 0.998, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.980', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.230', 'ARMOR': '0.535', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.912', 'weapon2': '1.206', 'weapon3': '1.374', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:37,055][52795] DAMAGECOUNT value on done: 1946.0 [2024-08-05 21:56:37,056][52795] Sum rewards: 3.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.830', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.139', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'weapon2': '1.228', 'DAMAGECOUNT': '1.305', 'weapon3': '1.894', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:37,077][52794] DAMAGECOUNT value on done: 1497.0 [2024-08-05 21:56:37,079][52794] Sum rewards: 4.545, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO2': '0.025', 'weapon4': '0.078', 'AMMO3': '0.098', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.548', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.170', 'weapon3': '1.396', 'weapon2': '1.472', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:37,222][52665] DAMAGECOUNT value on done: 2000.0 [2024-08-05 21:56:37,223][52665] Sum rewards: 1.864, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.472', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'ARMOR': '0.119', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.288', 'weapon4': '0.408', 'WEAPON3': '0.450', 'weapon2': '1.002', 'weapon3': '1.506', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:37,315][52647] DAMAGECOUNT value on done: 2487.0 [2024-08-05 21:56:37,316][52647] Sum rewards: 0.706, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.728', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.488', 'weapon2': '1.736', 'weapon3': '1.792', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:37,402][52820] DAMAGECOUNT value on done: 1587.0 [2024-08-05 21:56:37,403][52820] Sum rewards: -4.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.296', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.054', 'weapon4': '0.062', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'HITCOUNT': '0.220', 'ARMOR': '0.472', 'DAMAGECOUNT': '0.762', 'weapon2': '0.914', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '1.936'} [2024-08-05 21:56:37,512][52803] DAMAGECOUNT value on done: 2537.0 [2024-08-05 21:56:37,513][52803] Sum rewards: 0.627, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-3.445', 'AMMO4': '-0.115', 'AMMO2': '-0.023', 'AMMO3': '0.170', 'ARMOR': '0.486', 'HITCOUNT': '0.540', 'WEAPON3': '1.200', 'weapon3': '1.638', 'DAMAGECOUNT': '1.647', 'weapon2': '1.778', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:37,676][52811] DAMAGECOUNT value on done: 2121.0 [2024-08-05 21:56:37,771][52662] DAMAGECOUNT value on done: 2943.0 [2024-08-05 21:56:37,771][52662] Sum rewards: 0.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.156', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.028', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.410', 'WEAPON3': '0.900', 'weapon3': '1.450', 'DAMAGECOUNT': '1.500', 'weapon2': '1.502', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 32096256. Throughput: 0: 4257.6. Samples: 8028040. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:56:37,794][52567] Avg episode reward: [(0, '0.965')] [2024-08-05 21:56:37,800][52614] Saving new best policy, reward=0.965! [2024-08-05 21:56:38,044][52669] DAMAGECOUNT value on done: 2591.0 [2024-08-05 21:56:38,045][52669] Sum rewards: 2.151, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.850', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.090', 'weapon4': '0.186', 'WEAPON4': '0.200', 'ARMOR': '0.428', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.414', 'DAMAGECOUNT': '1.923', 'weapon3': '1.996', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:38,193][52663] DAMAGECOUNT value on done: 2227.0 [2024-08-05 21:56:38,193][52663] Sum rewards: -0.143, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.683', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.037', 'AMMO3': '0.110', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.561', 'WEAPON3': '0.700', 'weapon2': '1.562', 'FRAGCOUNT': '2.000', 'weapon3': '2.126'} [2024-08-05 21:56:38,967][52650] Updated weights for policy 0, policy_version 3921 (0.0036) [2024-08-05 21:56:39,510][52649] DAMAGECOUNT value on done: 2266.0 [2024-08-05 21:56:39,565][52794] DAMAGECOUNT value on done: 2635.0 [2024-08-05 21:56:39,566][52794] Sum rewards: -2.138, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.650', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.180', 'weapon5': '0.416', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.040', 'weapon3': '1.242'} [2024-08-05 21:56:40,111][52647] DAMAGECOUNT value on done: 1304.0 [2024-08-05 21:56:40,199][52662] DAMAGECOUNT value on done: 3305.0 [2024-08-05 21:56:40,201][52662] Sum rewards: -1.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.058', 'AMMO2': '0.011', 'AMMO4': '0.054', 'ARMOR': '0.084', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.350', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.206', 'weapon2': '1.482', 'weapon3': '2.074', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:40,317][52665] DAMAGECOUNT value on done: 1360.0 [2024-08-05 21:56:40,319][52665] Sum rewards: 0.396, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.950', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.070', 'weapon4': '0.158', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.555', 'FRAGCOUNT': '1.000', 'weapon3': '1.506', 'weapon2': '1.716'} [2024-08-05 21:56:40,336][52795] DAMAGECOUNT value on done: 2728.0 [2024-08-05 21:56:40,338][52795] Sum rewards: -0.663, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.683', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon5': '0.136', 'weapon4': '0.262', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'ARMOR': '0.876', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '1.000', 'weapon2': '1.016', 'weapon3': '1.934'} [2024-08-05 21:56:40,681][52820] DAMAGECOUNT value on done: 3031.0 [2024-08-05 21:56:40,681][52820] Sum rewards: 4.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.830', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'AMMO3': '0.068', 'weapon5': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.154', 'weapon2': '1.344', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:40,723][52803] DAMAGECOUNT value on done: 1591.0 [2024-08-05 21:56:40,726][52803] Sum rewards: 0.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'HITCOUNT': '0.330', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.035', 'weapon2': '1.048', 'weapon3': '2.218', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:41,202][52669] DAMAGECOUNT value on done: 2371.0 [2024-08-05 21:56:41,204][52669] Sum rewards: 0.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.506', 'AMMO2': '0.015', 'ARMOR': '0.029', 'weapon4': '0.064', 'AMMO4': '0.077', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.693', 'WEAPON3': '0.700', 'weapon2': '1.390', 'weapon3': '1.438', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:41,310][52811] DAMAGECOUNT value on done: 1806.0 [2024-08-05 21:56:41,312][52811] Sum rewards: 1.553, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.846', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'weapon5': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'HITCOUNT': '0.170', 'weapon4': '0.286', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.630', 'weapon2': '1.216', 'weapon3': '1.402', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:41,328][52663] DAMAGECOUNT value on done: 2019.0 [2024-08-05 21:56:41,329][52663] Sum rewards: 2.191, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.024', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon7': '0.094', 'AMMO3': '0.102', 'ARMOR': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.494', 'WEAPON3': '0.700', 'weapon2': '0.734', 'weapon3': '1.096', 'DAMAGECOUNT': '1.254', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:42,015][52649] DAMAGECOUNT value on done: 1979.0 [2024-08-05 21:56:42,016][52649] Sum rewards: 1.982, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.840', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.127', 'HITCOUNT': '0.370', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.170', 'weapon3': '1.924', 'weapon2': '1.948', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:42,049][52794] DAMAGECOUNT value on done: 3045.0 [2024-08-05 21:56:42,050][52794] Sum rewards: -1.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.563', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'ARMOR': '0.458', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon3': '1.546', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '2.000', 'weapon2': '2.062'} [2024-08-05 21:56:42,645][52662] DAMAGECOUNT value on done: 2181.0 [2024-08-05 21:56:42,647][52662] Sum rewards: 3.039, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'ARMOR': '0.076', 'weapon5': '0.076', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.362', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.156', 'DAMAGECOUNT': '1.248', 'weapon3': '1.286', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:42,707][52665] DAMAGECOUNT value on done: 3284.0 [2024-08-05 21:56:42,707][52665] Sum rewards: 2.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.866', 'AMMO2': '0.029', 'ARMOR': '0.090', 'AMMO3': '0.106', 'AMMO4': '0.143', 'WEAPON4': '0.350', 'weapon4': '0.392', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '0.802', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '2.000', 'weapon3': '2.388'} [2024-08-05 21:56:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 32186368. Throughput: 0: 4251.1. Samples: 8053250. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-05 21:56:42,794][52567] Avg episode reward: [(0, '0.870')] [2024-08-05 21:56:43,165][52667] DAMAGECOUNT value on done: 2441.0 [2024-08-05 21:56:43,174][52667] Sum rewards: 1.023, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.133', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'ARMOR': '1.300', 'DAMAGECOUNT': '1.410', 'weapon3': '1.586', 'weapon2': '2.050', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:43,282][52647] DAMAGECOUNT value on done: 1637.0 [2024-08-05 21:56:43,284][52647] Sum rewards: 3.246, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.047', 'WEAPON3': '0.200', 'HITCOUNT': '0.230', 'HEALTH': '0.455', 'weapon3': '0.532', 'DAMAGECOUNT': '0.720', 'ARMOR': '1.296', 'weapon2': '1.466', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:43,494][52795] DAMAGECOUNT value on done: 1883.0 [2024-08-05 21:56:43,496][52795] Sum rewards: -2.090, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.050', 'HITCOUNT': '0.130', 'AMMO3': '0.133', 'HEALTH': '0.322', 'DAMAGECOUNT': '0.390', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.580', 'weapon3': '2.046'} [2024-08-05 21:56:43,663][52669] DAMAGECOUNT value on done: 2398.0 [2024-08-05 21:56:43,665][52669] Sum rewards: 0.926, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.762', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.700', 'ARMOR': '1.375', 'weapon2': '1.418', 'weapon3': '1.912', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:43,830][52650] Updated weights for policy 0, policy_version 3931 (0.0012) [2024-08-05 21:56:43,938][52663] DAMAGECOUNT value on done: 2614.0 [2024-08-05 21:56:43,940][52663] Sum rewards: 0.593, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.828', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'ARMOR': '0.926', 'WEAPON3': '1.000', 'weapon2': '1.422', 'DAMAGECOUNT': '1.707', 'weapon3': '1.968', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:43,984][52803] DAMAGECOUNT value on done: 1604.0 [2024-08-05 21:56:43,986][52803] Sum rewards: 4.120, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.522', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon7': '0.048', 'ARMOR': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.370', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.506', 'weapon2': '1.546', 'weapon3': '1.628', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:44,011][52820] DAMAGECOUNT value on done: 1932.0 [2024-08-05 21:56:44,011][52820] Sum rewards: 2.026, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.920', 'weapon7': '0.006', 'AMMO2': '0.011', 'weapon4': '0.018', 'ARMOR': '0.020', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.290', 'weapon2': '1.354', 'weapon3': '1.950', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:44,524][52794] DAMAGECOUNT value on done: 1738.0 [2024-08-05 21:56:44,524][52794] Sum rewards: -0.982, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.281', 'AMMO2': '0.019', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'HITCOUNT': '0.060', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'DAMAGECOUNT': '0.180', 'weapon4': '0.244', 'WEAPON3': '0.300', 'weapon3': '0.674', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.478'} [2024-08-05 21:56:44,590][52811] DAMAGECOUNT value on done: 1913.0 [2024-08-05 21:56:44,591][52811] Sum rewards: -0.807, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.222', 'AMMO2': '0.009', 'AMMO4': '0.042', 'ARMOR': '0.044', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.190', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.741', 'weapon2': '0.786', 'FRAGCOUNT': '1.000', 'weapon3': '1.736'} [2024-08-05 21:56:45,120][52649] DAMAGECOUNT value on done: 2554.0 [2024-08-05 21:56:45,120][52649] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.146', 'AMMO2': '0.013', 'weapon4': '0.058', 'AMMO4': '0.063', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.473', 'weapon2': '1.184', 'DAMAGECOUNT': '1.425', 'weapon3': '1.556', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:45,572][52662] DAMAGECOUNT value on done: 2594.0 [2024-08-05 21:56:45,576][52662] Sum rewards: 5.999, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.730', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.026', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.100', 'weapon4': '0.296', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon2': '1.354', 'DAMAGECOUNT': '1.368', 'weapon3': '1.404', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:45,613][52647] DAMAGECOUNT value on done: 2526.0 [2024-08-05 21:56:45,615][52647] Sum rewards: 0.887, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.020', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.131', 'HITCOUNT': '0.370', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.089', 'weapon2': '1.688', 'weapon3': '2.004', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:45,937][52665] DAMAGECOUNT value on done: 2542.0 [2024-08-05 21:56:45,938][52665] Sum rewards: 3.025, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.728', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.008', 'weapon7': '0.050', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.330', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.052', 'DAMAGECOUNT': '1.242', 'weapon3': '2.052', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:46,107][52667] DAMAGECOUNT value on done: 2268.0 [2024-08-05 21:56:46,110][52667] Sum rewards: 0.994, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.497', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'weapon7': '0.066', 'ARMOR': '0.068', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.771', 'weapon2': '1.302', 'weapon3': '1.770', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:46,657][52795] DAMAGECOUNT value on done: 1926.0 [2024-08-05 21:56:46,912][52669] DAMAGECOUNT value on done: 2029.0 [2024-08-05 21:56:47,035][52803] DAMAGECOUNT value on done: 1752.0 [2024-08-05 21:56:47,035][52803] Sum rewards: 3.064, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.416', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.196', 'WEAPON7': '0.200', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'weapon2': '1.260', 'DAMAGECOUNT': '1.278', 'weapon3': '2.280', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:47,074][52663] DAMAGECOUNT value on done: 2317.0 [2024-08-05 21:56:47,076][52663] Sum rewards: 2.561, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.710', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'ARMOR': '0.048', 'AMMO3': '0.110', 'HITCOUNT': '0.300', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.930', 'weapon2': '1.670', 'weapon3': '2.124', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:47,216][52820] DAMAGECOUNT value on done: 2420.0 [2024-08-05 21:56:47,568][52794] DAMAGECOUNT value on done: 2009.0 [2024-08-05 21:56:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 32268288. Throughput: 0: 4248.2. Samples: 8065920. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-05 21:56:47,794][52567] Avg episode reward: [(0, '1.031')] [2024-08-05 21:56:47,798][52614] Saving new best policy, reward=1.031! [2024-08-05 21:56:47,927][52811] DAMAGECOUNT value on done: 1724.0 [2024-08-05 21:56:47,928][52811] Sum rewards: 2.607, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.482', 'AMMO2': '0.005', 'AMMO4': '0.023', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.138', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.323', 'weapon3': '1.592', 'weapon2': '1.842', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:48,202][52647] DAMAGECOUNT value on done: 1653.0 [2024-08-05 21:56:48,219][52662] DAMAGECOUNT value on done: 2652.0 [2024-08-05 21:56:48,219][52662] Sum rewards: -2.651, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.012', 'HEALTH': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'weapon5': '0.266', 'ARMOR': '0.517', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.678', 'weapon2': '1.510', 'weapon3': '1.826'} [2024-08-05 21:56:48,303][52649] DAMAGECOUNT value on done: 1339.0 [2024-08-05 21:56:48,689][52650] Updated weights for policy 0, policy_version 3941 (0.0019) [2024-08-05 21:56:49,275][52667] DAMAGECOUNT value on done: 1961.0 [2024-08-05 21:56:49,421][52665] DAMAGECOUNT value on done: 2827.0 [2024-08-05 21:56:49,423][52665] Sum rewards: 0.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.762', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.300', 'ARMOR': '0.503', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.095', 'weapon2': '1.348', 'weapon3': '2.068', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:49,950][52794] DAMAGECOUNT value on done: 2556.0 [2024-08-05 21:56:49,950][52794] Sum rewards: 3.669, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.320', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO3': '0.092', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.170', 'weapon2': '1.636', 'weapon3': '1.650', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:49,964][52795] DAMAGECOUNT value on done: 1811.0 [2024-08-05 21:56:49,965][52795] Sum rewards: -1.029, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.504', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.338', 'ARMOR': '0.464', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.903', 'FRAGCOUNT': '1.000', 'weapon2': '1.310', 'weapon3': '2.010'} [2024-08-05 21:56:50,149][52669] DAMAGECOUNT value on done: 2113.0 [2024-08-05 21:56:50,150][52669] Sum rewards: 2.632, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.882', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'ARMOR': '0.908', 'DAMAGECOUNT': '0.990', 'weapon2': '1.602', 'weapon3': '1.946', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:50,289][52803] DAMAGECOUNT value on done: 1427.0 [2024-08-05 21:56:50,290][52803] Sum rewards: 0.292, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.825', 'AMMO2': '0.011', 'AMMO5': '0.020', 'AMMO3': '0.052', 'AMMO4': '0.053', 'weapon5': '0.130', 'HITCOUNT': '0.150', 'weapon4': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.585', 'ARMOR': '0.914', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.916'} [2024-08-05 21:56:50,487][52663] DAMAGECOUNT value on done: 2201.0 [2024-08-05 21:56:50,489][52663] Sum rewards: 0.470, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.064', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.190', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.095', 'ARMOR': '1.363', 'weapon2': '1.700', 'weapon3': '1.922', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:50,520][52820] DAMAGECOUNT value on done: 2044.0 [2024-08-05 21:56:50,520][52820] Sum rewards: -0.241, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.142', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'ARMOR': '0.024', 'weapon5': '0.024', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.051', 'HITCOUNT': '0.220', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon3': '1.172', 'weapon2': '1.634'} [2024-08-05 21:56:50,791][52662] DAMAGECOUNT value on done: 2575.0 [2024-08-05 21:56:50,791][52662] Sum rewards: -0.407, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.770', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.041', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.446', 'DAMAGECOUNT': '0.771', 'WEAPON3': '0.800', 'weapon2': '1.710', 'weapon3': '1.762', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:51,140][52647] DAMAGECOUNT value on done: 1795.0 [2024-08-05 21:56:51,141][52647] Sum rewards: 1.811, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO2': '0.011', 'ARMOR': '0.016', 'AMMO4': '0.055', 'weapon4': '0.082', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.996', 'weapon2': '1.100', 'weapon3': '2.024', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:51,182][52811] DAMAGECOUNT value on done: 2934.0 [2024-08-05 21:56:51,182][52811] Sum rewards: 4.506, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.018', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'ARMOR': '0.440', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.572', 'weapon3': '2.074', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:51,690][52649] DAMAGECOUNT value on done: 2139.0 [2024-08-05 21:56:51,692][52649] Sum rewards: 0.467, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.908', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.051', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.636', 'FRAGCOUNT': '1.000', 'weapon3': '1.334', 'weapon2': '1.462'} [2024-08-05 21:56:52,264][52667] DAMAGECOUNT value on done: 1846.0 [2024-08-05 21:56:52,265][52667] Sum rewards: 0.436, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.348', 'AMMO2': '0.008', 'weapon4': '0.024', 'AMMO4': '0.040', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.888', 'DAMAGECOUNT': '1.515', 'weapon2': '1.686', 'weapon3': '2.104', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:52,374][52794] DAMAGECOUNT value on done: 2246.0 [2024-08-05 21:56:52,376][52794] Sum rewards: 0.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.838', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.097', 'HITCOUNT': '0.220', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.720', 'weapon2': '1.594', 'weapon3': '1.868', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:52,406][52665] DAMAGECOUNT value on done: 2676.0 [2024-08-05 21:56:52,795][52567] Fps is (10 sec: 15564.2, 60 sec: 16930.0, 300 sec: 17078.2). Total num frames: 32342016. Throughput: 0: 4243.8. Samples: 8091270. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 21:56:52,795][52567] Avg episode reward: [(0, '0.877')] [2024-08-05 21:56:53,063][52662] DAMAGECOUNT value on done: 2554.0 [2024-08-05 21:56:53,203][52795] DAMAGECOUNT value on done: 1606.0 [2024-08-05 21:56:53,203][52795] Sum rewards: 0.949, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.071', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.180', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.519', 'weapon5': '0.586', 'ARMOR': '0.844', 'weapon3': '1.058', 'weapon2': '1.876', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:53,278][52669] DAMAGECOUNT value on done: 2624.0 [2024-08-05 21:56:53,282][52669] Sum rewards: 4.144, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.288', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.098', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.515', 'weapon3': '1.572', 'weapon2': '1.674', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:53,517][52803] DAMAGECOUNT value on done: 2621.0 [2024-08-05 21:56:53,517][52803] Sum rewards: -0.338, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'HITCOUNT': '0.250', 'ARMOR': '0.436', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.939', 'weapon2': '1.472', 'FRAGCOUNT': '2.000', 'weapon3': '2.160'} [2024-08-05 21:56:53,538][52658] DAMAGECOUNT value on done: 1778.0 [2024-08-05 21:56:53,538][52658] Sum rewards: 0.985, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.900', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'weapon5': '0.496', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '1.000', 'weapon3': '1.164', 'weapon2': '1.482'} [2024-08-05 21:56:53,608][52650] Updated weights for policy 0, policy_version 3951 (0.0017) [2024-08-05 21:56:53,692][52663] DAMAGECOUNT value on done: 2581.0 [2024-08-05 21:56:53,696][52663] Sum rewards: 8.167, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.108', 'AMMO2': '0.010', 'AMMO4': '0.050', 'ARMOR': '0.055', 'AMMO3': '0.074', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon3': '1.576', 'weapon2': '1.598', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:53,839][52820] DAMAGECOUNT value on done: 2035.0 [2024-08-05 21:56:53,840][52820] Sum rewards: -0.327, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.164', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon4': '0.128', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.447', 'ARMOR': '0.515', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon3': '1.396', 'weapon2': '1.552'} [2024-08-05 21:56:54,310][52647] DAMAGECOUNT value on done: 2877.0 [2024-08-05 21:56:54,313][52647] Sum rewards: 0.073, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.535', 'AMMO2': '0.011', 'AMMO4': '0.056', 'ARMOR': '0.064', 'AMMO3': '0.125', 'weapon4': '0.156', 'WEAPON4': '0.200', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.362', 'weapon3': '1.706', 'DAMAGECOUNT': '1.818', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:54,333][52811] DAMAGECOUNT value on done: 1889.0 [2024-08-05 21:56:54,334][52811] Sum rewards: 4.117, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.504', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO3': '0.057', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon5': '0.352', 'DAMAGECOUNT': '0.861', 'weapon3': '1.010', 'weapon2': '1.276', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:54,785][52649] DAMAGECOUNT value on done: 2034.0 [2024-08-05 21:56:54,785][52649] Sum rewards: 3.320, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.026', 'AMMO3': '0.060', 'ARMOR': '0.064', 'weapon4': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.852', 'weapon5': '0.904', 'weapon3': '1.302', 'weapon2': '1.534', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:54,873][52794] DAMAGECOUNT value on done: 3516.0 [2024-08-05 21:56:54,874][52794] Sum rewards: 4.573, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.332', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.075', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.458', 'weapon3': '1.598', 'weapon2': '1.612', 'FRAGCOUNT': '4.000'} [2024-08-05 21:56:55,222][52667] DAMAGECOUNT value on done: 2380.0 [2024-08-05 21:56:55,224][52667] Sum rewards: -1.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.596', 'AMMO5': '0.012', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.065', 'weapon5': '0.070', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.272', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'FRAGCOUNT': '1.000', 'weapon2': '1.102', 'weapon3': '1.916'} [2024-08-05 21:56:55,677][52662] DAMAGECOUNT value on done: 2331.0 [2024-08-05 21:56:55,677][52662] Sum rewards: 0.357, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.028', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.114', 'weapon4': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.833', 'weapon3': '1.020', 'DAMAGECOUNT': '1.485', 'weapon2': '1.574'} [2024-08-05 21:56:55,805][52665] DAMAGECOUNT value on done: 2653.0 [2024-08-05 21:56:55,805][52665] Sum rewards: 3.526, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.137', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.102', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon3': '1.574', 'weapon2': '1.664', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:55,972][52669] DAMAGECOUNT value on done: 2432.0 [2024-08-05 21:56:55,972][52669] Sum rewards: 1.208, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.178', 'HITCOUNT': '0.390', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.335', 'weapon2': '1.354', 'weapon3': '2.242'} [2024-08-05 21:56:56,228][52658] DAMAGECOUNT value on done: 2277.0 [2024-08-05 21:56:56,229][52658] Sum rewards: -0.577, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.032', 'AMMO4': '0.070', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.160', 'HITCOUNT': '0.320', 'WEAPON4': '0.350', 'FRAGCOUNT': '0.500', 'weapon4': '0.542', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.005', 'weapon2': '1.236', 'weapon3': '1.712'} [2024-08-05 21:56:56,380][52663] DAMAGECOUNT value on done: 1885.0 [2024-08-05 21:56:56,380][52663] Sum rewards: 1.646, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.529', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.066', 'weapon7': '0.084', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.250', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.837', 'weapon2': '0.904', 'FRAGCOUNT': '1.000', 'weapon3': '1.092'} [2024-08-05 21:56:56,675][52803] DAMAGECOUNT value on done: 1881.0 [2024-08-05 21:56:56,679][52803] Sum rewards: 1.276, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.714', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'ARMOR': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'weapon4': '0.516', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.014', 'weapon2': '1.054', 'weapon3': '1.484', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:56,683][52795] DAMAGECOUNT value on done: 1405.0 [2024-08-05 21:56:56,955][52664] DAMAGECOUNT value on done: 2376.0 [2024-08-05 21:56:56,956][52664] Sum rewards: 5.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'weapon5': '0.004', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'ARMOR': '0.436', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.558', 'DAMAGECOUNT': '2.031', 'weapon3': '2.266', 'FRAGCOUNT': '6.000'} [2024-08-05 21:56:57,093][52820] DAMAGECOUNT value on done: 2651.0 [2024-08-05 21:56:57,095][52820] Sum rewards: 0.424, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.111', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.224', 'DAMAGECOUNT': '0.360', 'WEAPON3': '0.750', 'weapon3': '1.570', 'weapon2': '1.616', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:57,545][52794] DAMAGECOUNT value on done: 2813.0 [2024-08-05 21:56:57,545][52794] Sum rewards: -1.571, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.876', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.127', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.450', 'DAMAGECOUNT': '0.747', 'WEAPON3': '0.850', 'ARMOR': '1.354', 'weapon2': '1.506', 'weapon3': '1.732', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:57,661][52647] DAMAGECOUNT value on done: 2285.0 [2024-08-05 21:56:57,664][52647] Sum rewards: 5.656, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.142', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '1.082', 'DAMAGECOUNT': '1.719', 'weapon2': '1.950', 'FRAGCOUNT': '5.000'} [2024-08-05 21:56:57,772][52667] DAMAGECOUNT value on done: 2516.0 [2024-08-05 21:56:57,773][52667] Sum rewards: 2.035, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.460', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'weapon4': '0.042', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'ARMOR': '0.508', 'DAMAGECOUNT': '0.927', 'weapon2': '1.298', 'weapon3': '1.532', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 17050.5). Total num frames: 32432128. Throughput: 0: 4237.3. Samples: 8116880. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:56:57,794][52567] Avg episode reward: [(0, '0.906')] [2024-08-05 21:56:57,795][52649] DAMAGECOUNT value on done: 1840.0 [2024-08-05 21:56:57,795][52649] Sum rewards: -1.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.586', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.181', 'HITCOUNT': '0.250', 'ARMOR': '0.480', 'DAMAGECOUNT': '0.882', 'WEAPON3': '0.900', 'weapon2': '1.096', 'FRAGCOUNT': '2.000', 'weapon3': '2.254'} [2024-08-05 21:56:58,335][52650] Updated weights for policy 0, policy_version 3961 (0.0013) [2024-08-05 21:56:58,390][52662] DAMAGECOUNT value on done: 2652.0 [2024-08-05 21:56:58,391][52662] Sum rewards: 2.483, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.666', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO3': '0.091', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.470', 'ARMOR': '0.473', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.416', 'weapon2': '1.474', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'} [2024-08-05 21:56:58,468][52665] DAMAGECOUNT value on done: 2065.0 [2024-08-05 21:56:58,469][52665] Sum rewards: -2.328, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.018', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.094', 'AMMO3': '0.128', 'HITCOUNT': '0.250', 'ARMOR': '0.559', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.870', 'weapon2': '1.704', 'weapon3': '1.934', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:58,601][52669] DAMAGECOUNT value on done: 2338.0 [2024-08-05 21:56:58,601][52669] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.368', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.087', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'ARMOR': '0.836', 'DAMAGECOUNT': '0.981', 'weapon2': '1.384', 'weapon3': '1.602', 'FRAGCOUNT': '3.000'} [2024-08-05 21:56:58,917][52663] DAMAGECOUNT value on done: 2016.0 [2024-08-05 21:56:58,918][52663] Sum rewards: -0.925, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.672', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.098', 'HITCOUNT': '0.220', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.816', 'FRAGCOUNT': '1.000', 'weapon2': '1.618', 'weapon3': '1.742'} [2024-08-05 21:56:58,992][52658] DAMAGECOUNT value on done: 1498.0 [2024-08-05 21:56:58,994][52658] Sum rewards: 0.380, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.090', 'HEALTH': '0.150', 'HITCOUNT': '0.220', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon2': '1.350', 'weapon3': '1.710'} [2024-08-05 21:56:59,782][52664] DAMAGECOUNT value on done: 2421.0 [2024-08-05 21:56:59,784][52664] Sum rewards: -1.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.985', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.006', 'WEAPON4': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.879', 'FRAGCOUNT': '1.000', 'weapon3': '1.346', 'weapon2': '1.628'} [2024-08-05 21:56:59,854][52795] DAMAGECOUNT value on done: 1943.0 [2024-08-05 21:57:00,121][52794] DAMAGECOUNT value on done: 2849.0 [2024-08-05 21:57:00,121][52794] Sum rewards: -1.851, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.264', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.108', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'ARMOR': '1.014', 'DAMAGECOUNT': '1.443', 'weapon2': '1.586', 'weapon3': '1.868', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:00,190][52647] DAMAGECOUNT value on done: 2198.0 [2024-08-05 21:57:00,192][52647] Sum rewards: 0.602, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.861', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.046', 'WEAPON5': '0.050', 'weapon6': '0.050', 'WEAPON6': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'weapon2': '1.192', 'DAMAGECOUNT': '1.287', 'weapon3': '1.790', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:00,659][52820] DAMAGECOUNT value on done: 2265.0 [2024-08-05 21:57:00,660][52820] Sum rewards: 4.418, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.114', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'HITCOUNT': '0.450', 'weapon4': '0.464', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'weapon2': '1.270', 'DAMAGECOUNT': '1.599', 'weapon3': '1.944', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:00,807][52662] DAMAGECOUNT value on done: 2193.0 [2024-08-05 21:57:00,807][52662] Sum rewards: -0.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.591', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.116', 'weapon4': '0.204', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.981', 'weapon2': '1.552', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:00,877][52649] DAMAGECOUNT value on done: 2474.0 [2024-08-05 21:57:00,878][52649] Sum rewards: 1.400, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.137', 'weapon5': '0.210', 'HITCOUNT': '0.230', 'HEALTH': '0.290', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.960', 'weapon2': '1.136', 'weapon3': '1.938', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:01,039][52667] DAMAGECOUNT value on done: 2369.0 [2024-08-05 21:57:01,041][52667] Sum rewards: -1.125, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.068', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.573', 'WEAPON3': '0.900', 'ARMOR': '0.951', 'weapon3': '1.802', 'weapon2': '1.884', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:01,354][52669] DAMAGECOUNT value on done: 2055.0 [2024-08-05 21:57:01,358][52669] Sum rewards: 2.460, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.070', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HEALTH': '0.266', 'weapon4': '0.338', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.969', 'FRAGCOUNT': '1.000', 'weapon3': '1.534', 'weapon2': '1.720'} [2024-08-05 21:57:01,599][52665] DAMAGECOUNT value on done: 2782.0 [2024-08-05 21:57:01,599][52665] Sum rewards: 3.155, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.954', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.070', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.442', 'DAMAGECOUNT': '1.128', 'weapon3': '1.262', 'weapon2': '1.802', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:01,807][52663] DAMAGECOUNT value on done: 2306.0 [2024-08-05 21:57:01,807][52663] Sum rewards: 2.832, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.080', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'AMMO3': '0.042', 'weapon7': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.248', 'weapon4': '0.294', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon3': '0.822', 'weapon2': '0.832', 'DAMAGECOUNT': '1.149', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:01,914][52658] DAMAGECOUNT value on done: 2294.0 [2024-08-05 21:57:01,914][52658] Sum rewards: 3.004, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.547', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon5': '0.206', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.188', 'weapon3': '1.576', 'weapon2': '1.618', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:02,481][52794] DAMAGECOUNT value on done: 2450.0 [2024-08-05 21:57:02,481][52794] Sum rewards: 0.717, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.142', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.067', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.178', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.600', 'ARMOR': '0.898', 'weapon3': '1.626', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:02,677][52664] DAMAGECOUNT value on done: 2632.0 [2024-08-05 21:57:02,679][52664] Sum rewards: -0.030, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.376', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.130', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.092', 'DAMAGECOUNT': '1.263', 'weapon2': '1.648'} [2024-08-05 21:57:02,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17066.6, 300 sec: 17078.2). Total num frames: 32522240. Throughput: 0: 4230.9. Samples: 8129650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:57:02,795][52567] Avg episode reward: [(0, '0.866')] [2024-08-05 21:57:03,033][52662] DAMAGECOUNT value on done: 2798.0 [2024-08-05 21:57:03,034][52662] Sum rewards: -0.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon4': '0.144', 'HITCOUNT': '0.260', 'ARMOR': '0.461', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.966', 'weapon2': '1.666', 'weapon3': '1.680', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:03,088][52647] DAMAGECOUNT value on done: 2208.0 [2024-08-05 21:57:03,090][52647] Sum rewards: 4.784, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.129', 'HEALTH': '0.154', 'weapon4': '0.356', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.350', 'weapon2': '1.438', 'weapon3': '1.696', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:03,574][52650] Updated weights for policy 0, policy_version 3971 (0.0021) [2024-08-05 21:57:04,066][52820] DAMAGECOUNT value on done: 1750.0 [2024-08-05 21:57:04,066][52820] Sum rewards: 0.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.910', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'AMMO3': '0.084', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.185', 'weapon2': '1.372', 'weapon3': '1.524', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:04,158][52667] DAMAGECOUNT value on done: 2422.0 [2024-08-05 21:57:04,160][52667] Sum rewards: 1.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.355', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'ARMOR': '0.036', 'AMMO3': '0.098', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.167', 'weapon2': '1.526', 'weapon3': '1.826', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:04,351][52669] DAMAGECOUNT value on done: 2344.0 [2024-08-05 21:57:04,352][52669] Sum rewards: 0.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.140', 'HITCOUNT': '0.430', 'ARMOR': '0.501', 'WEAPON3': '0.600', 'weapon2': '1.526', 'weapon3': '1.546', 'DAMAGECOUNT': '1.647', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:04,356][52649] DAMAGECOUNT value on done: 2238.0 [2024-08-05 21:57:04,357][52649] Sum rewards: -1.968, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.894', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.090', 'AMMO3': '0.126', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.700', 'ARMOR': '0.857', 'weapon2': '1.410', 'weapon3': '1.510', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:04,750][52663] DAMAGECOUNT value on done: 2011.0 [2024-08-05 21:57:04,751][52663] Sum rewards: -0.316, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.988', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'ARMOR': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'HITCOUNT': '0.340', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.248', 'weapon2': '1.318', 'weapon3': '1.814', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:04,932][52665] DAMAGECOUNT value on done: 2275.0 [2024-08-05 21:57:04,933][52665] Sum rewards: -1.132, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.529', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.086', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.246', 'DAMAGECOUNT': '0.594', 'WEAPON3': '0.650', 'ARMOR': '0.935', 'FRAGCOUNT': '1.000', 'weapon2': '1.422', 'weapon3': '1.848'} [2024-08-05 21:57:05,020][52794] DAMAGECOUNT value on done: 2780.0 [2024-08-05 21:57:05,021][52794] Sum rewards: 1.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'weapon7': '0.070', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'weapon4': '0.230', 'HITCOUNT': '0.380', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.500', 'weapon2': '1.508', 'weapon3': '1.850', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:05,084][52658] DAMAGECOUNT value on done: 1604.0 [2024-08-05 21:57:05,086][52658] Sum rewards: -1.513, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.555', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'weapon5': '0.050', 'AMMO3': '0.057', 'HITCOUNT': '0.110', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.345', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'weapon2': '1.340'} [2024-08-05 21:57:05,281][52664] DAMAGECOUNT value on done: 1709.0 [2024-08-05 21:57:05,700][52647] DAMAGECOUNT value on done: 2041.0 [2024-08-05 21:57:05,702][52647] Sum rewards: -0.447, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.030', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.260', 'weapon4': '0.292', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.801', 'weapon2': '1.310', 'FRAGCOUNT': '2.000', 'weapon3': '2.078'} [2024-08-05 21:57:05,724][52662] DAMAGECOUNT value on done: 2190.0 [2024-08-05 21:57:05,725][52662] Sum rewards: 0.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.133', 'AMMO2': '0.012', 'ARMOR': '0.048', 'AMMO4': '0.061', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.118', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.762', 'FRAGCOUNT': '1.000', 'weapon3': '1.302', 'weapon2': '2.074'} [2024-08-05 21:57:06,591][52667] DAMAGECOUNT value on done: 2752.0 [2024-08-05 21:57:06,593][52667] Sum rewards: 5.245, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.276', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.079', 'ARMOR': '0.132', 'weapon5': '0.156', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.392', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'weapon2': '1.164', 'weapon3': '1.584', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:07,199][52669] DAMAGECOUNT value on done: 2254.0 [2024-08-05 21:57:07,200][52669] Sum rewards: 3.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.560', 'AMMO2': '0.004', 'weapon5': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.021', 'weapon7': '0.050', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.340', 'ARMOR': '0.574', 'WEAPON3': '0.800', 'weapon2': '1.062', 'DAMAGECOUNT': '1.563', 'weapon3': '1.570', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:07,373][52649] DAMAGECOUNT value on done: 2193.0 [2024-08-05 21:57:07,373][52649] Sum rewards: 2.604, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.548', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.035', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'HITCOUNT': '0.540', 'WEAPON3': '1.100', 'weapon2': '1.334', 'DAMAGECOUNT': '2.121', 'weapon3': '2.402', 'FRAGCOUNT': '6.000'} [2024-08-05 21:57:07,474][52820] DAMAGECOUNT value on done: 1739.0 [2024-08-05 21:57:07,475][52820] Sum rewards: 1.857, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.555', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.178', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.467', 'DAMAGECOUNT': '0.906', 'weapon3': '1.368', 'weapon2': '1.864', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:07,554][52794] DAMAGECOUNT value on done: 3011.0 [2024-08-05 21:57:07,558][52663] DAMAGECOUNT value on done: 2214.0 [2024-08-05 21:57:07,558][52794] Sum rewards: 0.071, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.478', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO3': '0.082', 'ARMOR': '0.086', 'HITCOUNT': '0.110', 'DAMAGECOUNT': '0.444', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.234', 'weapon3': '1.372'} [2024-08-05 21:57:07,558][52663] Sum rewards: -4.437, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.618', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'ARMOR': '0.056', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.194', 'weapon5': '0.242', 'DAMAGECOUNT': '0.261', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.242', 'weapon3': '1.786'} [2024-08-05 21:57:07,776][52658] DAMAGECOUNT value on done: 1852.0 [2024-08-05 21:57:07,779][52658] Sum rewards: 0.487, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.037', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO3': '0.094', 'HITCOUNT': '0.230', 'ARMOR': '0.496', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.870', 'weapon3': '1.422', 'weapon2': '1.608', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 32604160. Throughput: 0: 4230.4. Samples: 8155380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:57:07,794][52567] Avg episode reward: [(0, '0.841')] [2024-08-05 21:57:07,953][52665] DAMAGECOUNT value on done: 2779.0 [2024-08-05 21:57:07,953][52665] Sum rewards: 2.365, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.422', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.080', 'HITCOUNT': '0.380', 'ARMOR': '0.498', 'WEAPON3': '0.500', 'weapon2': '1.396', 'DAMAGECOUNT': '1.410', 'weapon3': '1.810', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:08,089][52650] Updated weights for policy 0, policy_version 3981 (0.0029) [2024-08-05 21:57:08,276][52664] DAMAGECOUNT value on done: 3048.0 [2024-08-05 21:57:08,277][52664] Sum rewards: 0.728, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.480', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.050', 'AMMO3': '0.163', 'weapon4': '0.272', 'ARMOR': '0.532', 'HITCOUNT': '0.540', 'weapon2': '0.944', 'WEAPON3': '1.100', 'DAMAGECOUNT': '2.097', 'weapon3': '2.256', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:08,696][52647] DAMAGECOUNT value on done: 2152.0 [2024-08-05 21:57:08,697][52647] Sum rewards: 2.413, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.915', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.036', 'AMMO3': '0.052', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '1.104', 'DAMAGECOUNT': '1.125', 'weapon2': '1.754', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:08,851][52662] DAMAGECOUNT value on done: 3076.0 [2024-08-05 21:57:08,852][52662] Sum rewards: -1.689, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.374', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.134', 'HITCOUNT': '0.360', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.161', 'weapon2': '1.374', 'weapon3': '1.950', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:09,763][52669] DAMAGECOUNT value on done: 2288.0 [2024-08-05 21:57:09,917][52667] DAMAGECOUNT value on done: 2396.0 [2024-08-05 21:57:09,917][52667] Sum rewards: 2.114, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.550', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.071', 'HITCOUNT': '0.420', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.209', 'weapon3': '1.524', 'weapon2': '1.772', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:10,021][52671] DAMAGECOUNT value on done: 2499.0 [2024-08-05 21:57:10,022][52671] Sum rewards: 4.524, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.149', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.068', 'weapon5': '0.114', 'AMMO3': '0.115', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.394', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '0.768', 'weapon3': '2.044', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '5.500'} [2024-08-05 21:57:10,066][52649] DAMAGECOUNT value on done: 1565.0 [2024-08-05 21:57:10,066][52649] Sum rewards: 1.212, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.244', 'HITCOUNT': '0.270', 'ARMOR': '0.442', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.771', 'weapon2': '0.924', 'weapon3': '1.292', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:10,134][52663] DAMAGECOUNT value on done: 2287.0 [2024-08-05 21:57:10,134][52663] Sum rewards: 4.286, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.124', 'WEAPON4': '0.300', 'HITCOUNT': '0.490', 'ARMOR': '0.527', 'WEAPON3': '0.650', 'weapon3': '1.728', 'weapon2': '1.752', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:10,330][52794] DAMAGECOUNT value on done: 2382.0 [2024-08-05 21:57:10,330][52794] Sum rewards: 0.866, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.295', 'AMMO4': '-0.068', 'AMMO2': '-0.014', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon5': '0.152', 'HITCOUNT': '0.210', 'ARMOR': '0.489', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'weapon3': '1.616', 'FRAGCOUNT': '2.000', 'weapon2': '2.088'} [2024-08-05 21:57:10,528][52665] DAMAGECOUNT value on done: 1904.0 [2024-08-05 21:57:10,528][52665] Sum rewards: 1.701, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.785', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'AMMO3': '0.059', 'HITCOUNT': '0.120', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.450', 'weapon5': '0.910', 'weapon3': '0.976', 'FRAGCOUNT': '1.000', 'weapon2': '1.434'} [2024-08-05 21:57:10,806][52820] DAMAGECOUNT value on done: 1878.0 [2024-08-05 21:57:10,807][52820] Sum rewards: 0.976, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.478', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.056', 'weapon4': '0.064', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'DAMAGECOUNT': '1.155', 'weapon3': '1.444', 'weapon2': '1.486', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:11,117][52658] DAMAGECOUNT value on done: 2186.0 [2024-08-05 21:57:11,118][52658] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.604', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.025', 'weapon5': '0.038', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.630', 'ARMOR': '0.927', 'WEAPON3': '1.000', 'weapon2': '1.534', 'weapon3': '1.868', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '6.000'} [2024-08-05 21:57:11,179][52662] DAMAGECOUNT value on done: 2362.0 [2024-08-05 21:57:11,180][52662] Sum rewards: -1.117, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.766', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.510', 'FRAGCOUNT': '1.000', 'weapon3': '1.016', 'ARMOR': '1.323', 'weapon2': '1.476'} [2024-08-05 21:57:11,467][52664] DAMAGECOUNT value on done: 1994.0 [2024-08-05 21:57:11,467][52664] Sum rewards: -1.863, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.725', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'HITCOUNT': '0.130', 'weapon4': '0.310', 'DAMAGECOUNT': '0.441', 'ARMOR': '0.459', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon3': '1.234', 'weapon2': '1.464'} [2024-08-05 21:57:11,677][52647] DAMAGECOUNT value on done: 2385.0 [2024-08-05 21:57:11,679][52647] Sum rewards: 3.002, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.501', 'AMMO2': '0.004', 'AMMO5': '0.015', 'weapon4': '0.016', 'AMMO4': '0.020', 'AMMO3': '0.082', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'ARMOR': '0.882', 'DAMAGECOUNT': '1.035', 'weapon3': '1.446', 'weapon2': '1.630', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:12,590][52649] DAMAGECOUNT value on done: 2954.0 [2024-08-05 21:57:12,591][52649] Sum rewards: 3.373, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.978', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'weapon5': '0.034', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'ARMOR': '0.432', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.408', 'DAMAGECOUNT': '1.650', 'weapon3': '1.800', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:12,671][52650] Updated weights for policy 0, policy_version 3991 (0.0015) [2024-08-05 21:57:12,698][52667] DAMAGECOUNT value on done: 2236.0 [2024-08-05 21:57:12,699][52667] Sum rewards: -1.878, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.969', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.020', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.400', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.152', 'weapon2': '1.378', 'weapon3': '2.058'} [2024-08-05 21:57:12,775][52669] DAMAGECOUNT value on done: 2477.0 [2024-08-05 21:57:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 32694272. Throughput: 0: 4233.3. Samples: 8180870. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 21:57:12,794][52567] Avg episode reward: [(0, '0.925')] [2024-08-05 21:57:12,978][52665] DAMAGECOUNT value on done: 2605.0 [2024-08-05 21:57:13,044][52663] DAMAGECOUNT value on done: 2454.0 [2024-08-05 21:57:13,044][52663] Sum rewards: 2.004, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.006', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO3': '0.040', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.260', 'WEAPON3': '0.300', 'ARMOR': '0.440', 'DAMAGECOUNT': '0.750', 'weapon3': '0.926', 'weapon2': '1.584', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:13,441][52671] DAMAGECOUNT value on done: 2711.0 [2024-08-05 21:57:13,443][52671] Sum rewards: 0.755, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.119', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.020', 'AMMO4': '0.060', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.350', 'ARMOR': '0.520', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.302', 'weapon2': '1.456', 'weapon3': '2.204', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:13,526][52658] DAMAGECOUNT value on done: 2096.0 [2024-08-05 21:57:13,528][52658] Sum rewards: 4.275, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.076', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.150', 'ARMOR': '0.453', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.382', 'DAMAGECOUNT': '1.740', 'weapon3': '2.096', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:14,006][52820] DAMAGECOUNT value on done: 1782.0 [2024-08-05 21:57:14,008][52820] Sum rewards: 2.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.650', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.074', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon4': '0.482', 'ARMOR': '0.919', 'weapon2': '0.990', 'weapon3': '0.994', 'DAMAGECOUNT': '1.497', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:14,172][52662] DAMAGECOUNT value on done: 2234.0 [2024-08-05 21:57:14,172][52662] Sum rewards: 0.676, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.001', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.073', 'ARMOR': '0.080', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.472', 'weapon2': '1.584'} [2024-08-05 21:57:14,593][52664] DAMAGECOUNT value on done: 2550.0 [2024-08-05 21:57:14,861][52647] DAMAGECOUNT value on done: 1962.0 [2024-08-05 21:57:14,861][52647] Sum rewards: -1.044, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.081', 'WEAPON4': '0.200', 'weapon4': '0.298', 'HITCOUNT': '0.300', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.154', 'weapon3': '1.390'} [2024-08-05 21:57:14,953][52668] DAMAGECOUNT value on done: 2597.0 [2024-08-05 21:57:14,954][52668] Sum rewards: -0.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO2': '0.007', 'ARMOR': '0.028', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.156', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.446', 'weapon2': '1.498', 'weapon3': '1.988'} [2024-08-05 21:57:15,154][52649] DAMAGECOUNT value on done: 2310.0 [2024-08-05 21:57:15,154][52649] Sum rewards: 7.935, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.060', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon4': '0.014', 'ARMOR': '0.032', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.470', 'weapon3': '1.550', 'weapon2': '1.606', 'FRAGCOUNT': '7.000'} [2024-08-05 21:57:15,297][52667] DAMAGECOUNT value on done: 3269.0 [2024-08-05 21:57:15,299][52667] Sum rewards: -0.119, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.040', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.067', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.209', 'weapon3': '1.340', 'weapon2': '1.798', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:15,515][52659] DAMAGECOUNT value on done: 2674.0 [2024-08-05 21:57:15,517][52659] Sum rewards: 0.544, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.161', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.085', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.080', 'weapon3': '1.602', 'weapon2': '1.792'} [2024-08-05 21:57:15,622][52669] DAMAGECOUNT value on done: 1654.0 [2024-08-05 21:57:15,623][52669] Sum rewards: -0.504, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.982', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.109', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.406', 'ARMOR': '0.512', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.669', 'weapon2': '1.490', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:16,016][52663] DAMAGECOUNT value on done: 1612.0 [2024-08-05 21:57:16,018][52663] Sum rewards: 1.343, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.806', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'HITCOUNT': '0.030', 'AMMO3': '0.055', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'DAMAGECOUNT': '0.213', 'weapon4': '0.244', 'WEAPON3': '0.400', 'weapon3': '0.820', 'ARMOR': '0.892', 'weapon5': '0.970', 'FRAGCOUNT': '1.000', 'weapon2': '1.254'} [2024-08-05 21:57:16,267][52658] DAMAGECOUNT value on done: 1812.0 [2024-08-05 21:57:16,268][52658] Sum rewards: 1.428, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.049', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'weapon4': '0.282', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.179', 'weapon3': '1.390', 'weapon2': '1.684'} [2024-08-05 21:57:16,386][52671] DAMAGECOUNT value on done: 1317.0 [2024-08-05 21:57:17,087][52820] DAMAGECOUNT value on done: 1770.0 [2024-08-05 21:57:17,088][52820] Sum rewards: 0.614, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.025', 'HEALTH': '0.042', 'AMMO3': '0.073', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.294', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.585', 'ARMOR': '0.918', 'FRAGCOUNT': '1.000', 'weapon2': '1.244', 'weapon3': '1.576'} [2024-08-05 21:57:17,555][52649] DAMAGECOUNT value on done: 1631.0 [2024-08-05 21:57:17,555][52649] Sum rewards: 1.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.063', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.095', 'ARMOR': '0.106', 'AMMO4': '0.135', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.645', 'weapon2': '1.294', 'weapon3': '1.644', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:17,654][52650] Updated weights for policy 0, policy_version 4001 (0.0047) [2024-08-05 21:57:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 32776192. Throughput: 0: 4244.7. Samples: 8193740. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 21:57:17,794][52567] Avg episode reward: [(0, '1.035')] [2024-08-05 21:57:17,799][52614] Saving new best policy, reward=1.035! [2024-08-05 21:57:17,870][52664] DAMAGECOUNT value on done: 2138.0 [2024-08-05 21:57:17,871][52664] Sum rewards: 4.412, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.970', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.206', 'weapon3': '1.346', 'weapon2': '1.562', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:18,056][52668] DAMAGECOUNT value on done: 2188.0 [2024-08-05 21:57:18,057][52668] Sum rewards: -0.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.938', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon5': '0.018', 'weapon4': '0.058', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'ARMOR': '0.536', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.158', 'weapon2': '1.706', 'FRAGCOUNT': '2.000', 'weapon3': '2.016'} [2024-08-05 21:57:18,061][52647] DAMAGECOUNT value on done: 2492.0 [2024-08-05 21:57:18,062][52647] Sum rewards: -3.983, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.729', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.149', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.357', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.668', 'weapon3': '2.192'} [2024-08-05 21:57:18,320][52667] DAMAGECOUNT value on done: 2496.0 [2024-08-05 21:57:18,320][52667] Sum rewards: 4.536, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.470', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.410', 'weapon4': '0.410', 'ARMOR': '0.496', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.323', 'weapon2': '1.404', 'weapon3': '1.756', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:18,696][52659] DAMAGECOUNT value on done: 2457.0 [2024-08-05 21:57:18,700][52659] Sum rewards: 1.423, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.825', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'ARMOR': '0.080', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.138', 'weapon4': '0.254', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'weapon2': '1.126', 'DAMAGECOUNT': '1.407', 'weapon3': '1.808', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:18,782][52669] DAMAGECOUNT value on done: 2699.0 [2024-08-05 21:57:18,783][52669] Sum rewards: 3.067, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.080', 'weapon4': '0.120', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.528', 'HEALTH': '0.954', 'weapon2': '1.484', 'weapon3': '1.732', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:19,007][52660] DAMAGECOUNT value on done: 2064.0 [2024-08-05 21:57:19,104][52663] DAMAGECOUNT value on done: 3109.0 [2024-08-05 21:57:19,105][52663] Sum rewards: 2.200, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.779', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.121', 'weapon5': '0.180', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon3': '1.634', 'weapon2': '1.930', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:19,476][52658] DAMAGECOUNT value on done: 2171.0 [2024-08-05 21:57:19,477][52658] Sum rewards: 2.250, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.593', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'AMMO3': '0.085', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.238', 'HITCOUNT': '0.310', 'ARMOR': '0.543', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.020', 'weapon3': '1.338', 'weapon2': '1.434', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:19,593][52671] DAMAGECOUNT value on done: 2477.0 [2024-08-05 21:57:19,594][52671] Sum rewards: 1.545, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'weapon5': '0.112', 'HITCOUNT': '0.280', 'HEALTH': '0.356', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.855', 'weapon2': '1.076', 'weapon3': '1.080', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:20,237][52820] DAMAGECOUNT value on done: 1791.0 [2024-08-05 21:57:20,239][52820] Sum rewards: 3.240, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon4': '0.276', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon5': '0.366', 'DAMAGECOUNT': '0.822', 'ARMOR': '0.884', 'weapon3': '1.136', 'weapon2': '1.246', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:20,535][52649] DAMAGECOUNT value on done: 2140.0 [2024-08-05 21:57:20,536][52649] Sum rewards: 0.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.162', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.040', 'ARMOR': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.680', 'weapon2': '1.818', 'weapon3': '1.854', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:20,828][52614] Signal inference workers to stop experience collection... (750 times) [2024-08-05 21:57:20,829][52614] Signal inference workers to resume experience collection... (750 times) [2024-08-05 21:57:20,913][52650] InferenceWorker_p0-w0: stopping experience collection (750 times) [2024-08-05 21:57:20,913][52650] InferenceWorker_p0-w0: resuming experience collection (750 times) [2024-08-05 21:57:21,151][52664] DAMAGECOUNT value on done: 2820.0 [2024-08-05 21:57:21,152][52664] Sum rewards: 2.936, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.261', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon7': '0.086', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.276', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'ARMOR': '0.816', 'weapon2': '1.304', 'weapon3': '1.878', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:21,371][52667] DAMAGECOUNT value on done: 2763.0 [2024-08-05 21:57:21,371][52667] Sum rewards: 1.082, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'ARMOR': '0.446', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon3': '1.498', 'weapon2': '1.758', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:21,391][52647] DAMAGECOUNT value on done: 1964.0 [2024-08-05 21:57:21,393][52647] Sum rewards: 3.503, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.028', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'HEALTH': '0.190', 'ARMOR': '0.456', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.588', 'DAMAGECOUNT': '2.070', 'weapon3': '2.236', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:21,416][52659] DAMAGECOUNT value on done: 2634.0 [2024-08-05 21:57:21,420][52659] Sum rewards: -1.830, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.124', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon5': '0.144', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.059', 'ARMOR': '1.300', 'weapon3': '1.518', 'weapon2': '1.934'} [2024-08-05 21:57:21,455][52668] DAMAGECOUNT value on done: 2322.0 [2024-08-05 21:57:21,457][52668] Sum rewards: 0.253, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.157', 'AMMO2': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.049', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.300', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.945', 'weapon2': '1.278', 'FRAGCOUNT': '2.000', 'weapon3': '2.144'} [2024-08-05 21:57:21,532][52663] DAMAGECOUNT value on done: 2049.0 [2024-08-05 21:57:21,534][52663] Sum rewards: -0.210, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.431', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.186', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.714', 'FRAGCOUNT': '1.000', 'weapon2': '1.420', 'weapon3': '1.694'} [2024-08-05 21:57:22,066][52650] Updated weights for policy 0, policy_version 4011 (0.0012) [2024-08-05 21:57:22,333][52660] DAMAGECOUNT value on done: 3140.0 [2024-08-05 21:57:22,333][52660] Sum rewards: 2.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.695', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'ARMOR': '0.020', 'AMMO3': '0.101', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.058', 'DAMAGECOUNT': '1.785', 'weapon3': '2.236', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:22,355][52658] DAMAGECOUNT value on done: 2412.0 [2024-08-05 21:57:22,454][52671] DAMAGECOUNT value on done: 2077.0 [2024-08-05 21:57:22,455][52671] Sum rewards: 2.314, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.194', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.032', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.200', 'weapon2': '1.594', 'weapon3': '1.848', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 17050.5). Total num frames: 32858112. Throughput: 0: 4250.0. Samples: 8219290. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 21:57:22,794][52567] Avg episode reward: [(0, '0.957')] [2024-08-05 21:57:23,461][52820] DAMAGECOUNT value on done: 2585.0 [2024-08-05 21:57:23,796][52664] DAMAGECOUNT value on done: 2077.0 [2024-08-05 21:57:23,808][52664] Sum rewards: 0.683, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.186', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.100', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.215', 'weapon2': '1.394', 'weapon3': '1.482', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:23,937][52667] DAMAGECOUNT value on done: 2100.0 [2024-08-05 21:57:23,938][52667] Sum rewards: 0.124, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.375', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.110', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.936', 'weapon2': '1.424', 'FRAGCOUNT': '2.000', 'weapon3': '2.276'} [2024-08-05 21:57:23,974][52649] DAMAGECOUNT value on done: 1263.0 [2024-08-05 21:57:23,976][52649] Sum rewards: 1.606, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.471', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon5': '0.164', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.546', 'DAMAGECOUNT': '0.555', 'weapon2': '1.330', 'weapon3': '1.456', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:23,998][52668] DAMAGECOUNT value on done: 1594.0 [2024-08-05 21:57:24,103][52647] DAMAGECOUNT value on done: 2216.0 [2024-08-05 21:57:24,104][52647] Sum rewards: 1.307, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.477', 'AMMO2': '0.011', 'ARMOR': '0.048', 'AMMO4': '0.057', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.324', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.957', 'weapon2': '1.032', 'weapon3': '1.426', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:24,540][52663] DAMAGECOUNT value on done: 2039.0 [2024-08-05 21:57:24,542][52663] Sum rewards: -1.666, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.046', 'AMMO2': '0.016', 'AMMO4': '0.080', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.180', 'weapon4': '0.200', 'DAMAGECOUNT': '0.588', 'WEAPON3': '0.750', 'weapon2': '1.284', 'weapon3': '1.472', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:24,683][52659] DAMAGECOUNT value on done: 2660.0 [2024-08-05 21:57:24,684][52659] Sum rewards: -0.046, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.269', 'AMMO5': '0.005', 'weapon5': '0.018', 'weapon4': '0.032', 'AMMO2': '0.032', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'ARMOR': '0.836', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.086', 'weapon3': '1.442', 'weapon2': '1.866'} [2024-08-05 21:57:24,935][52660] DAMAGECOUNT value on done: 2162.0 [2024-08-05 21:57:24,936][52660] Sum rewards: 6.790, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.004', 'AMMO2': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.050', 'AMMO3': '0.059', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'weapon2': '0.794', 'weapon3': '0.912', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:25,044][52658] DAMAGECOUNT value on done: 2407.0 [2024-08-05 21:57:25,044][52658] Sum rewards: 2.765, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.617', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon7': '0.062', 'ARMOR': '0.064', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.885', 'weapon2': '1.376', 'weapon3': '1.718', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:25,438][52671] DAMAGECOUNT value on done: 2505.0 [2024-08-05 21:57:25,439][52671] Sum rewards: 0.740, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.016', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'HEALTH': '0.186', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.843', 'weapon2': '1.564', 'weapon3': '1.690', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:26,833][52820] DAMAGECOUNT value on done: 2327.0 [2024-08-05 21:57:26,834][52820] Sum rewards: 0.213, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.350', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.094', 'HITCOUNT': '0.260', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.930', 'weapon2': '1.422', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:26,901][52668] DAMAGECOUNT value on done: 1840.0 [2024-08-05 21:57:26,902][52668] Sum rewards: 3.057, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.032', 'weapon4': '0.014', 'AMMO2': '0.018', 'AMMO3': '0.077', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'HITCOUNT': '0.350', 'ARMOR': '0.549', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.302', 'weapon3': '1.534', 'weapon2': '1.708', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:26,960][52649] DAMAGECOUNT value on done: 2429.0 [2024-08-05 21:57:26,962][52649] Sum rewards: 1.243, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.546', 'AMMO2': '0.010', 'AMMO4': '0.047', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.092', 'weapon2': '1.438', 'weapon3': '1.658', 'FRAGCOUNT': '6.000'} [2024-08-05 21:57:27,114][52664] DAMAGECOUNT value on done: 1762.0 [2024-08-05 21:57:27,115][52650] Updated weights for policy 0, policy_version 4021 (0.0014) [2024-08-05 21:57:27,123][52667] DAMAGECOUNT value on done: 1976.0 [2024-08-05 21:57:27,123][52667] Sum rewards: 1.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.401', 'AMMO2': '0.019', 'ARMOR': '0.064', 'AMMO4': '0.097', 'AMMO3': '0.105', 'weapon4': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.152', 'weapon2': '1.440', 'FRAGCOUNT': '2.000', 'weapon3': '2.130'} [2024-08-05 21:57:27,233][52659] DAMAGECOUNT value on done: 2280.0 [2024-08-05 21:57:27,237][52659] Sum rewards: 0.226, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO2': '0.013', 'weapon4': '0.022', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.473', 'weapon3': '1.560', 'weapon2': '1.670', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:27,277][52647] DAMAGECOUNT value on done: 2778.0 [2024-08-05 21:57:27,279][52647] Sum rewards: 0.366, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.464', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.328', 'HITCOUNT': '0.380', 'ARMOR': '0.497', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.089', 'weapon2': '1.568', 'weapon3': '1.864', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:27,732][52663] DAMAGECOUNT value on done: 1804.0 [2024-08-05 21:57:27,732][52663] Sum rewards: 0.760, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.028', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.380', 'ARMOR': '0.507', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.987', 'FRAGCOUNT': '1.000', 'weapon2': '1.152', 'weapon3': '1.324'} [2024-08-05 21:57:27,757][52660] DAMAGECOUNT value on done: 2562.0 [2024-08-05 21:57:27,758][52660] Sum rewards: 0.928, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.044', 'AMMO4': '0.053', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.368', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.600', 'weapon2': '1.286', 'weapon3': '1.456', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17203.2, 300 sec: 17106.0). Total num frames: 32956416. Throughput: 0: 4255.1. Samples: 8244730. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:57:27,795][52567] Avg episode reward: [(0, '0.894')] [2024-08-05 21:57:28,084][52671] DAMAGECOUNT value on done: 2268.0 [2024-08-05 21:57:28,085][52671] Sum rewards: -0.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.035', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'ARMOR': '1.053', 'DAMAGECOUNT': '1.185', 'weapon3': '1.274', 'weapon2': '1.488'} [2024-08-05 21:57:28,221][52658] DAMAGECOUNT value on done: 1662.0 [2024-08-05 21:57:28,230][52658] Sum rewards: 0.397, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.280', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.648', 'FRAGCOUNT': '1.000', 'weapon2': '1.018', 'weapon3': '1.536'} [2024-08-05 21:57:29,756][52649] DAMAGECOUNT value on done: 2372.0 [2024-08-05 21:57:29,757][52649] Sum rewards: 1.365, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.674', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.206', 'HITCOUNT': '0.300', 'ARMOR': '0.538', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.065', 'weapon3': '1.350', 'weapon2': '1.698', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:29,988][52668] DAMAGECOUNT value on done: 3019.0 [2024-08-05 21:57:29,988][52668] Sum rewards: -2.064, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.926', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.260', 'weapon4': '0.300', 'DAMAGECOUNT': '0.825', 'WEAPON3': '0.850', 'ARMOR': '0.911', 'FRAGCOUNT': '1.000', 'weapon2': '1.330', 'weapon3': '1.678'} [2024-08-05 21:57:30,045][52664] DAMAGECOUNT value on done: 2081.0 [2024-08-05 21:57:30,049][52664] Sum rewards: 1.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO3': '0.087', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.918', 'DAMAGECOUNT': '1.323', 'weapon3': '1.390', 'weapon2': '2.228', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:30,264][52663] DAMAGECOUNT value on done: 1247.0 [2024-08-05 21:57:30,281][52667] DAMAGECOUNT value on done: 2347.0 [2024-08-05 21:57:30,349][52659] DAMAGECOUNT value on done: 1990.0 [2024-08-05 21:57:30,352][52659] Sum rewards: 2.025, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.632', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon5': '0.078', 'AMMO3': '0.115', 'weapon4': '0.124', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.305', 'weapon2': '1.472', 'weapon3': '2.024', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:30,791][52660] DAMAGECOUNT value on done: 2040.0 [2024-08-05 21:57:30,795][52660] Sum rewards: -1.576, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.157', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.024', 'AMMO3': '0.118', 'HITCOUNT': '0.290', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.047', 'weapon3': '1.160', 'weapon2': '1.976'} [2024-08-05 21:57:31,050][52671] DAMAGECOUNT value on done: 1483.0 [2024-08-05 21:57:31,050][52671] Sum rewards: 0.632, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.026', 'weapon4': '0.044', 'AMMO4': '0.053', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'ARMOR': '0.465', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'weapon2': '1.420', 'weapon3': '1.470', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:31,717][52658] DAMAGECOUNT value on done: 2231.0 [2024-08-05 21:57:31,717][52658] Sum rewards: 1.246, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.068', 'ARMOR': '0.084', 'AMMO3': '0.101', 'weapon4': '0.104', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.906', 'weapon2': '1.128', 'weapon3': '1.876', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:32,133][52650] Updated weights for policy 0, policy_version 4031 (0.0028) [2024-08-05 21:57:32,351][52664] DAMAGECOUNT value on done: 1807.0 [2024-08-05 21:57:32,353][52664] Sum rewards: -0.172, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.244', 'AMMO2': '0.026', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.174', 'HITCOUNT': '0.270', 'ARMOR': '0.480', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.864', 'FRAGCOUNT': '1.000', 'weapon2': '1.386', 'weapon3': '1.930'} [2024-08-05 21:57:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 17050.5). Total num frames: 33030144. Throughput: 0: 4258.7. Samples: 8257560. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 21:57:32,794][52567] Avg episode reward: [(0, '0.856')] [2024-08-05 21:57:32,986][52649] DAMAGECOUNT value on done: 2266.0 [2024-08-05 21:57:32,987][52649] Sum rewards: 2.083, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon4': '0.062', 'AMMO3': '0.077', 'HEALTH': '0.192', 'HITCOUNT': '0.370', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.242', 'weapon2': '1.342', 'weapon3': '1.448', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:33,204][52668] DAMAGECOUNT value on done: 3461.0 [2024-08-05 21:57:33,204][52668] Sum rewards: 2.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.225', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.222', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'ARMOR': '0.918', 'DAMAGECOUNT': '1.305', 'weapon3': '1.526', 'weapon2': '1.698', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:33,326][52659] DAMAGECOUNT value on done: 2330.0 [2024-08-05 21:57:33,328][52659] Sum rewards: 4.064, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'HEALTH': '0.082', 'AMMO3': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'weapon2': '1.164', 'DAMAGECOUNT': '1.380', 'weapon3': '2.032', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:33,515][52667] DAMAGECOUNT value on done: 2940.0 [2024-08-05 21:57:33,832][52660] DAMAGECOUNT value on done: 2501.0 [2024-08-05 21:57:33,833][52660] Sum rewards: -0.904, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.550', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'weapon5': '0.086', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.350', 'ARMOR': '0.497', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.080', 'weapon3': '1.644', 'weapon2': '1.678', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:33,967][52671] DAMAGECOUNT value on done: 2816.0 [2024-08-05 21:57:33,969][52671] Sum rewards: 1.530, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.538', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.102', 'HITCOUNT': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.179', 'weapon3': '1.190', 'weapon2': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:34,747][52664] DAMAGECOUNT value on done: 1705.0 [2024-08-05 21:57:34,829][52658] DAMAGECOUNT value on done: 2838.0 [2024-08-05 21:57:34,832][52658] Sum rewards: 2.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.408', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon4': '0.242', 'weapon5': '0.318', 'HITCOUNT': '0.320', 'ARMOR': '0.444', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.203', 'weapon2': '1.242', 'weapon3': '1.876', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:35,806][52668] DAMAGECOUNT value on done: 2411.0 [2024-08-05 21:57:35,808][52668] Sum rewards: 2.232, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.674', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.196', 'weapon5': '0.424', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'ARMOR': '0.824', 'weapon3': '1.114', 'FRAGCOUNT': '1.500', 'weapon2': '1.736', 'DAMAGECOUNT': '1.890'} [2024-08-05 21:57:35,809][52659] DAMAGECOUNT value on done: 1783.0 [2024-08-05 21:57:35,810][52659] Sum rewards: 4.127, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.236', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'HITCOUNT': '0.260', 'ARMOR': '0.416', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.885', 'weapon2': '1.464', 'weapon3': '1.576', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:36,415][52650] Updated weights for policy 0, policy_version 4041 (0.0023) [2024-08-05 21:57:36,558][52667] DAMAGECOUNT value on done: 2057.0 [2024-08-05 21:57:36,559][52667] Sum rewards: -3.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.641', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.018', 'weapon4': '0.056', 'AMMO3': '0.092', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.700', 'ARMOR': '0.864', 'FRAGCOUNT': '1.000', 'weapon3': '1.218', 'weapon2': '1.302'} [2024-08-05 21:57:36,644][52671] DAMAGECOUNT value on done: 2422.0 [2024-08-05 21:57:36,646][52671] Sum rewards: 6.629, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.407', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.060', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.442', 'WEAPON3': '0.450', 'ARMOR': '0.934', 'weapon2': '0.948', 'DAMAGECOUNT': '1.335', 'weapon3': '1.536', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:36,741][52660] DAMAGECOUNT value on done: 2420.0 [2024-08-05 21:57:36,742][52660] Sum rewards: 4.535, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.151', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'weapon5': '0.296', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '1.361', 'weapon2': '1.524', 'weapon3': '1.770', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:37,474][52658] DAMAGECOUNT value on done: 2514.0 [2024-08-05 21:57:37,475][52658] Sum rewards: 3.718, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.310', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'AMMO3': '0.061', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.026', 'weapon3': '1.294', 'weapon2': '1.606', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:37,794][52567] Fps is (10 sec: 15564.7, 60 sec: 16930.1, 300 sec: 17050.5). Total num frames: 33112064. Throughput: 0: 4274.9. Samples: 8283640. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-05 21:57:37,795][52567] Avg episode reward: [(0, '1.015')] [2024-08-05 21:57:37,843][52664] DAMAGECOUNT value on done: 2060.0 [2024-08-05 21:57:37,845][52664] Sum rewards: 1.357, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.815', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.048', 'AMMO3': '0.102', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.110', 'weapon2': '1.594', 'weapon3': '2.022', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:38,835][52667] DAMAGECOUNT value on done: 2751.0 [2024-08-05 21:57:38,836][52667] Sum rewards: -2.962, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.859', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.212', 'HITCOUNT': '0.300', 'ARMOR': '0.505', 'DAMAGECOUNT': '0.948', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.490', 'weapon3': '2.008'} [2024-08-05 21:57:38,866][52659] DAMAGECOUNT value on done: 2097.0 [2024-08-05 21:57:38,871][52659] Sum rewards: 2.360, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.690', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO3': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon4': '0.154', 'HITCOUNT': '0.190', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.585', 'weapon3': '0.692', 'weapon2': '1.182', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:39,303][52668] DAMAGECOUNT value on done: 2433.0 [2024-08-05 21:57:39,304][52668] Sum rewards: 4.800, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.720', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.210', 'HITCOUNT': '0.340', 'ARMOR': '0.503', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.353', 'weapon3': '1.536', 'weapon2': '1.666', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:39,803][52671] DAMAGECOUNT value on done: 2267.0 [2024-08-05 21:57:39,803][52671] Sum rewards: 2.218, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.612', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'ARMOR': '0.459', 'HITCOUNT': '0.530', 'weapon4': '0.536', 'WEAPON3': '0.650', 'weapon2': '0.976', 'DAMAGECOUNT': '1.662', 'weapon3': '1.918', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:40,005][52658] DAMAGECOUNT value on done: 2145.0 [2024-08-05 21:57:40,005][52658] Sum rewards: -0.907, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.322', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.798', 'ARMOR': '0.994', 'weapon3': '1.292', 'weapon2': '1.320', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:40,252][52660] DAMAGECOUNT value on done: 1788.0 [2024-08-05 21:57:40,252][52660] Sum rewards: 4.281, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.201', 'weapon4': '0.006', 'AMMO2': '0.025', 'ARMOR': '0.052', 'AMMO3': '0.077', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.795', 'weapon3': '1.504', 'weapon2': '1.510', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:41,171][52664] DAMAGECOUNT value on done: 2113.0 [2024-08-05 21:57:41,171][52664] Sum rewards: 0.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.348', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'AMMO3': '0.091', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.693', 'weapon2': '1.044', 'FRAGCOUNT': '2.000', 'weapon3': '2.108'} [2024-08-05 21:57:41,364][52650] Updated weights for policy 0, policy_version 4051 (0.0031) [2024-08-05 21:57:41,565][52659] DAMAGECOUNT value on done: 2844.0 [2024-08-05 21:57:42,236][52671] DAMAGECOUNT value on done: 3242.0 [2024-08-05 21:57:42,236][52671] Sum rewards: 1.574, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.966', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.126', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.359', 'weapon2': '1.516', 'weapon3': '1.732', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:42,321][52668] DAMAGECOUNT value on done: 2582.0 [2024-08-05 21:57:42,322][52668] Sum rewards: 0.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.036', 'weapon5': '0.042', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.035', 'weapon2': '1.566', 'weapon3': '2.026', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17066.7, 300 sec: 17078.2). Total num frames: 33210368. Throughput: 0: 4281.1. Samples: 8309530. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 21:57:42,794][52567] Avg episode reward: [(0, '0.983')] [2024-08-05 21:57:43,153][52658] DAMAGECOUNT value on done: 1289.0 [2024-08-05 21:57:43,153][52658] Sum rewards: -0.370, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.640', 'AMMO2': '0.024', 'AMMO3': '0.105', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.286', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.852', 'ARMOR': '0.868', 'FRAGCOUNT': '1.000', 'weapon3': '1.034', 'weapon2': '1.812'} [2024-08-05 21:57:43,221][52660] DAMAGECOUNT value on done: 2329.0 [2024-08-05 21:57:43,222][52660] Sum rewards: 1.704, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.150', 'AMMO2': '0.001', 'weapon4': '0.002', 'AMMO4': '0.004', 'ARMOR': '0.044', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'weapon2': '0.696', 'DAMAGECOUNT': '0.990', 'weapon3': '1.164', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:44,106][52664] DAMAGECOUNT value on done: 2827.0 [2024-08-05 21:57:44,114][52664] Sum rewards: 5.196, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'ARMOR': '0.028', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.382', 'weapon3': '1.926', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:44,609][52659] DAMAGECOUNT value on done: 2332.0 [2024-08-05 21:57:44,609][52659] Sum rewards: 2.899, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.952', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon7': '0.068', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'weapon4': '0.410', 'ARMOR': '0.430', 'WEAPON3': '0.800', 'weapon2': '1.126', 'DAMAGECOUNT': '1.344', 'weapon3': '1.936', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:45,222][52668] DAMAGECOUNT value on done: 1693.0 [2024-08-05 21:57:45,224][52668] Sum rewards: -1.537, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.888', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.594', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.736', 'weapon3': '1.810'} [2024-08-05 21:57:45,439][52671] DAMAGECOUNT value on done: 2668.0 [2024-08-05 21:57:45,441][52671] Sum rewards: 1.011, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.174', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.560', 'WEAPON3': '0.900', 'weapon2': '1.486', 'DAMAGECOUNT': '1.758', 'weapon3': '1.948', 'FRAGCOUNT': '5.000'} [2024-08-05 21:57:45,889][52658] DAMAGECOUNT value on done: 2208.0 [2024-08-05 21:57:45,891][52658] Sum rewards: 0.269, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.110', 'HITCOUNT': '0.120', 'WEAPON4': '0.150', 'ARMOR': '0.154', 'HEALTH': '0.316', 'DAMAGECOUNT': '0.381', 'weapon4': '0.386', 'WEAPON3': '0.700', 'weapon2': '1.286', 'FRAGCOUNT': '2.000', 'weapon3': '2.084'} [2024-08-05 21:57:46,074][52650] Updated weights for policy 0, policy_version 4061 (0.0026) [2024-08-05 21:57:46,183][52660] DAMAGECOUNT value on done: 1689.0 [2024-08-05 21:57:46,946][52664] DAMAGECOUNT value on done: 1803.0 [2024-08-05 21:57:46,947][52664] Sum rewards: -0.394, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon4': '0.056', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.990', 'weapon2': '1.524', 'weapon3': '1.854', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17066.6, 300 sec: 17078.2). Total num frames: 33292288. Throughput: 0: 4284.2. Samples: 8322440. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:57:47,794][52567] Avg episode reward: [(0, '0.935')] [2024-08-05 21:57:47,818][52659] DAMAGECOUNT value on done: 2366.0 [2024-08-05 21:57:48,418][52671] DAMAGECOUNT value on done: 1881.0 [2024-08-05 21:57:48,420][52671] Sum rewards: 3.440, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.072', 'HITCOUNT': '0.150', 'WEAPON3': '0.250', 'HEALTH': '0.279', 'DAMAGECOUNT': '0.414', 'ARMOR': '0.487', 'weapon2': '1.062', 'weapon3': '1.712', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:48,461][52668] DAMAGECOUNT value on done: 1832.0 [2024-08-05 21:57:48,463][52668] Sum rewards: 3.002, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.455', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.040', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.872', 'weapon3': '0.942', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.173', 'weapon2': '1.712'} [2024-08-05 21:57:49,350][52658] DAMAGECOUNT value on done: 2315.0 [2024-08-05 21:57:49,353][52658] Sum rewards: 3.177, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.516', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.055', 'weapon4': '0.088', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.420', 'weapon3': '1.006', 'weapon2': '1.110', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:49,548][52660] DAMAGECOUNT value on done: 2180.0 [2024-08-05 21:57:49,553][52660] Sum rewards: -0.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon4': '0.128', 'HITCOUNT': '0.230', 'ARMOR': '0.466', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.945', 'weapon2': '1.584', 'weapon3': '1.600', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:50,067][52664] DAMAGECOUNT value on done: 1826.0 [2024-08-05 21:57:50,071][52664] Sum rewards: -1.499, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.452', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.200', 'ARMOR': '0.461', 'weapon5': '0.496', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.666', 'weapon3': '1.152', 'weapon2': '1.516', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:50,357][52659] DAMAGECOUNT value on done: 2424.0 [2024-08-05 21:57:50,360][52659] Sum rewards: 4.950, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.015', 'AMMO3': '0.061', 'ARMOR': '0.072', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.102', 'HITCOUNT': '0.280', 'HEALTH': '0.284', 'weapon4': '0.292', 'WEAPON3': '0.400', 'weapon2': '0.994', 'weapon3': '1.340', 'DAMAGECOUNT': '1.383', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:50,871][52650] Updated weights for policy 0, policy_version 4071 (0.0012) [2024-08-05 21:57:51,105][52671] DAMAGECOUNT value on done: 2357.0 [2024-08-05 21:57:51,106][52671] Sum rewards: 1.478, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.513', 'AMMO2': '0.018', 'weapon7': '0.030', 'AMMO3': '0.084', 'AMMO4': '0.088', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'weapon4': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.524', 'DAMAGECOUNT': '1.125', 'weapon2': '1.400', 'weapon3': '1.712', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:51,836][52668] DAMAGECOUNT value on done: 2305.0 [2024-08-05 21:57:51,836][52668] Sum rewards: 1.571, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.446', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.240', 'HITCOUNT': '0.280', 'ARMOR': '0.448', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.960', 'weapon2': '1.368', 'weapon3': '1.878', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17078.2). Total num frames: 33382400. Throughput: 0: 4284.2. Samples: 8348170. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 21:57:52,795][52567] Avg episode reward: [(0, '1.030')] [2024-08-05 21:57:52,805][52660] DAMAGECOUNT value on done: 2235.0 [2024-08-05 21:57:52,807][52660] Sum rewards: 2.142, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.356', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.028', 'weapon4': '0.036', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.392', 'weapon2': '1.480', 'weapon3': '1.708', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:52,954][52659] DAMAGECOUNT value on done: 3479.0 [2024-08-05 21:57:52,955][52659] Sum rewards: 1.827, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.713', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon4': '0.012', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.645', 'ARMOR': '0.930', 'FRAGCOUNT': '1.000', 'weapon3': '1.152', 'weapon2': '1.326'} [2024-08-05 21:57:52,983][52664] DAMAGECOUNT value on done: 2551.0 [2024-08-05 21:57:52,984][52664] Sum rewards: 0.870, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.125', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.242', 'DAMAGECOUNT': '1.626', 'weapon3': '1.774', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:53,696][52671] DAMAGECOUNT value on done: 1516.0 [2024-08-05 21:57:53,698][52671] Sum rewards: -2.147, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.865', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO3': '0.100', 'AMMO4': '0.136', 'HITCOUNT': '0.190', 'WEAPON4': '0.400', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.036', 'weapon3': '1.678'} [2024-08-05 21:57:54,571][52668] DAMAGECOUNT value on done: 2312.0 [2024-08-05 21:57:54,571][52668] Sum rewards: 0.369, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.112', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'ARMOR': '0.976', 'weapon2': '1.398', 'DAMAGECOUNT': '1.485', 'weapon3': '1.504', 'FRAGCOUNT': '2.000'} [2024-08-05 21:57:55,668][52650] Updated weights for policy 0, policy_version 4081 (0.0014) [2024-08-05 21:57:55,821][52660] DAMAGECOUNT value on done: 1742.0 [2024-08-05 21:57:55,968][52659] DAMAGECOUNT value on done: 2349.0 [2024-08-05 21:57:55,969][52659] Sum rewards: 0.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.286', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'AMMO4': '0.151', 'HITCOUNT': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.630', 'ARMOR': '0.902', 'DAMAGECOUNT': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.106', 'weapon3': '1.784'} [2024-08-05 21:57:56,756][52671] DAMAGECOUNT value on done: 2441.0 [2024-08-05 21:57:56,759][52671] Sum rewards: 2.548, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.015', 'ARMOR': '0.035', 'HEALTH': '0.035', 'AMMO3': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.154', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon3': '1.166', 'weapon2': '1.394'} [2024-08-05 21:57:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17203.2, 300 sec: 17050.5). Total num frames: 33464320. Throughput: 0: 4288.7. Samples: 8373860. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 21:57:57,794][52567] Avg episode reward: [(0, '1.027')] [2024-08-05 21:57:58,003][52668] DAMAGECOUNT value on done: 2503.0 [2024-08-05 21:57:58,004][52668] Sum rewards: 1.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO4': '0.060', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.306', 'DAMAGECOUNT': '0.570', 'WEAPON3': '0.750', 'ARMOR': '0.891', 'weapon2': '1.434', 'weapon3': '1.636', 'FRAGCOUNT': '3.000'} [2024-08-05 21:57:59,040][52659] DAMAGECOUNT value on done: 2546.0 [2024-08-05 21:57:59,041][52659] Sum rewards: -0.202, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.885', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'HITCOUNT': '0.360', 'ARMOR': '0.454', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.017', 'weapon2': '1.398', 'weapon3': '2.334', 'FRAGCOUNT': '4.000'} [2024-08-05 21:57:59,206][52660] DAMAGECOUNT value on done: 2443.0 [2024-08-05 21:57:59,206][52660] Sum rewards: -1.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.532', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.109', 'weapon5': '0.170', 'weapon4': '0.180', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon2': '1.218', 'weapon3': '2.102'} [2024-08-05 21:57:59,760][52671] DAMAGECOUNT value on done: 3282.0 [2024-08-05 21:57:59,760][52671] Sum rewards: -1.263, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.451', 'weapon4': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'ARMOR': '0.944', 'DAMAGECOUNT': '1.659', 'weapon3': '1.684', 'weapon2': '1.908', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:00,640][52650] Updated weights for policy 0, policy_version 4091 (0.0028) [2024-08-05 21:58:01,090][52668] DAMAGECOUNT value on done: 2215.0 [2024-08-05 21:58:01,093][52668] Sum rewards: 2.325, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON7': '0.200', 'weapon4': '0.308', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'weapon2': '0.786', 'DAMAGECOUNT': '0.900', 'weapon3': '1.470', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:02,120][52660] DAMAGECOUNT value on done: 2689.0 [2024-08-05 21:58:02,121][52660] Sum rewards: 3.499, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.393', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.114', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'ARMOR': '0.964', 'DAMAGECOUNT': '1.506', 'weapon2': '1.592', 'weapon3': '1.774', 'FRAGCOUNT': '5.000'} [2024-08-05 21:58:02,184][52659] DAMAGECOUNT value on done: 2204.0 [2024-08-05 21:58:02,186][52659] Sum rewards: 4.986, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.660', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.071', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon3': '1.020', 'weapon2': '1.112', 'DAMAGECOUNT': '1.293', 'FRAGCOUNT': '5.000'} [2024-08-05 21:58:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17066.7, 300 sec: 17050.5). Total num frames: 33546240. Throughput: 0: 4287.1. Samples: 8386660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:58:02,794][52567] Avg episode reward: [(0, '0.991')] [2024-08-05 21:58:03,084][52671] DAMAGECOUNT value on done: 2037.0 [2024-08-05 21:58:03,085][52671] Sum rewards: 1.351, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.106', 'weapon5': '0.120', 'HEALTH': '0.144', 'HITCOUNT': '0.300', 'weapon4': '0.468', 'WEAPON3': '0.500', 'weapon2': '1.012', 'DAMAGECOUNT': '1.032', 'weapon3': '1.342', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:03,590][52668] DAMAGECOUNT value on done: 2333.0 [2024-08-05 21:58:03,590][52668] Sum rewards: 0.343, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.350', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'weapon4': '0.168', 'HITCOUNT': '0.420', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.350', 'weapon2': '1.508', 'weapon3': '1.822', 'FRAGCOUNT': '3.000'} [2024-08-05 21:58:04,555][52660] DAMAGECOUNT value on done: 2338.0 [2024-08-05 21:58:04,556][52660] Sum rewards: -2.054, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.884', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.126', 'HITCOUNT': '0.230', 'ARMOR': '0.483', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.744', 'FRAGCOUNT': '1.000', 'weapon2': '1.790', 'weapon3': '1.832'} [2024-08-05 21:58:04,871][52659] DAMAGECOUNT value on done: 2582.0 [2024-08-05 21:58:04,872][52659] Sum rewards: 1.073, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.050', 'AMMO2': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'HITCOUNT': '0.210', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.705', 'weapon3': '1.230', 'ARMOR': '1.369', 'weapon2': '1.658', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:05,276][52650] Updated weights for policy 0, policy_version 4101 (0.0019) [2024-08-05 21:58:05,420][52671] DAMAGECOUNT value on done: 2341.0 [2024-08-05 21:58:05,420][52671] Sum rewards: 1.156, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.274', 'AMMO2': '0.018', 'ARMOR': '0.056', 'AMMO3': '0.086', 'AMMO4': '0.089', 'HITCOUNT': '0.150', 'weapon4': '0.204', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.650', 'weapon2': '1.322', 'weapon3': '1.460', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:06,751][52668] DAMAGECOUNT value on done: 2482.0 [2024-08-05 21:58:06,751][52668] Sum rewards: 9.504, reward structure: {'DEATHCOUNT': '-5.250', 'weapon4': '0.004', 'AMMO2': '0.022', 'ARMOR': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'HEALTH': '0.176', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.232', 'weapon3': '1.736', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '8.000'} [2024-08-05 21:58:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17050.5). Total num frames: 33636352. Throughput: 0: 4294.7. Samples: 8412550. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 21:58:07,794][52567] Avg episode reward: [(0, '1.045')] [2024-08-05 21:58:07,797][52614] Saving new best policy, reward=1.045! [2024-08-05 21:58:07,811][52660] DAMAGECOUNT value on done: 2347.0 [2024-08-05 21:58:07,812][52660] Sum rewards: 2.037, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.016', 'AMMO3': '0.050', 'AMMO4': '0.079', 'HEALTH': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.234', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.585', 'FRAGCOUNT': '1.000', 'weapon3': '1.050', 'weapon2': '1.546'} [2024-08-05 21:58:07,862][52659] DAMAGECOUNT value on done: 1961.0 [2024-08-05 21:58:09,939][52668] DAMAGECOUNT value on done: 1888.0 [2024-08-05 21:58:09,939][52668] Sum rewards: -0.808, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.618', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'weapon5': '0.026', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'ARMOR': '0.858', 'DAMAGECOUNT': '0.870', 'weapon2': '1.556', 'weapon3': '1.750', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:10,162][52650] Updated weights for policy 0, policy_version 4111 (0.0024) [2024-08-05 21:58:10,857][52660] DAMAGECOUNT value on done: 2538.0 [2024-08-05 21:58:10,858][52660] Sum rewards: 2.402, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.396', 'weapon4': '0.008', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.132', 'HITCOUNT': '0.480', 'ARMOR': '0.564', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.410', 'weapon3': '1.800', 'weapon2': '1.816', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:11,138][52659] DAMAGECOUNT value on done: 3065.0 [2024-08-05 21:58:11,140][52659] Sum rewards: 1.325, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.610', 'AMMO2': '0.024', 'ARMOR': '0.040', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.240', 'HITCOUNT': '0.460', 'weapon2': '0.878', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.635', 'weapon3': '2.546', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17066.6, 300 sec: 17050.5). Total num frames: 33718272. Throughput: 0: 4298.4. Samples: 8438160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:58:12,795][52567] Avg episode reward: [(0, '1.039')] [2024-08-05 21:58:13,018][52668] DAMAGECOUNT value on done: 1753.0 [2024-08-05 21:58:13,019][52668] Sum rewards: 1.564, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.440', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.004', 'weapon5': '0.036', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.244', 'WEAPON3': '0.500', 'ARMOR': '0.512', 'DAMAGECOUNT': '0.756', 'weapon2': '1.112', 'weapon3': '1.198', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:13,959][52660] DAMAGECOUNT value on done: 1947.0 [2024-08-05 21:58:13,959][52660] Sum rewards: -2.597, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.011', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'HEALTH': '0.066', 'AMMO3': '0.113', 'HITCOUNT': '0.220', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon3': '1.666', 'weapon2': '2.128'} [2024-08-05 21:58:14,949][52650] Updated weights for policy 0, policy_version 4121 (0.0013) [2024-08-05 21:58:16,406][52660] DAMAGECOUNT value on done: 3561.0 [2024-08-05 21:58:16,408][52660] Sum rewards: 5.649, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.435', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.174', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.428', 'DAMAGECOUNT': '1.890', 'weapon2': '1.974', 'FRAGCOUNT': '5.000'} [2024-08-05 21:58:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 33800192. Throughput: 0: 4303.1. Samples: 8451200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:58:17,794][52567] Avg episode reward: [(0, '1.061')] [2024-08-05 21:58:17,873][52614] Saving new best policy, reward=1.061! [2024-08-05 21:58:19,830][52650] Updated weights for policy 0, policy_version 4131 (0.0014) [2024-08-05 21:58:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 33890304. Throughput: 0: 4293.8. Samples: 8476860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:58:22,794][52567] Avg episode reward: [(0, '1.061')] [2024-08-05 21:58:24,638][52650] Updated weights for policy 0, policy_version 4141 (0.0027) [2024-08-05 21:58:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 17050.5). Total num frames: 33972224. Throughput: 0: 4276.2. Samples: 8501960. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 21:58:27,802][52567] Avg episode reward: [(0, '1.061')] [2024-08-05 21:58:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004147_33972224.pth... [2024-08-05 21:58:28,010][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003648_29884416.pth [2024-08-05 21:58:29,299][52650] Updated weights for policy 0, policy_version 4151 (0.0011) [2024-08-05 21:58:32,190][52666] DAMAGECOUNT value on done: 2051.0 [2024-08-05 21:58:32,191][52666] Sum rewards: -0.470, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.656', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'HITCOUNT': '0.270', 'weapon5': '0.340', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.113', 'weapon2': '1.586', 'weapon3': '1.688', 'FRAGCOUNT': '2.000'} [2024-08-05 21:58:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17078.2). Total num frames: 34062336. Throughput: 0: 4270.9. Samples: 8514630. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 21:58:32,794][52567] Avg episode reward: [(0, '1.097')] [2024-08-05 21:58:32,795][52614] Saving new best policy, reward=1.097! [2024-08-05 21:58:34,541][52650] Updated weights for policy 0, policy_version 4161 (0.0015) [2024-08-05 21:58:35,268][52670] DAMAGECOUNT value on done: 2785.0 [2024-08-05 21:58:35,272][52670] Sum rewards: 2.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.126', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.224', 'ARMOR': '0.550', 'HITCOUNT': '0.550', 'WEAPON3': '0.950', 'weapon2': '1.288', 'weapon3': '1.860', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '5.000'} [2024-08-05 21:58:35,563][52666] DAMAGECOUNT value on done: 2745.0 [2024-08-05 21:58:35,564][52666] Sum rewards: -1.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.144', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'ARMOR': '0.987', 'DAMAGECOUNT': '1.218', 'weapon3': '1.760', 'weapon2': '2.082', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17050.5). Total num frames: 34144256. Throughput: 0: 4255.8. Samples: 8539680. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 21:58:37,796][52567] Avg episode reward: [(0, '1.112')] [2024-08-05 21:58:37,800][52614] Saving new best policy, reward=1.112! [2024-08-05 21:58:38,539][52670] DAMAGECOUNT value on done: 2353.0 [2024-08-05 21:58:38,541][52670] Sum rewards: 5.001, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.032', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.034', 'ARMOR': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon4': '0.314', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon2': '1.150', 'DAMAGECOUNT': '1.470', 'weapon3': '1.930', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:38,841][52666] DAMAGECOUNT value on done: 2062.0 [2024-08-05 21:58:38,843][52666] Sum rewards: -0.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.062', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'AMMO3': '0.104', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.714', 'FRAGCOUNT': '1.000', 'weapon2': '1.646', 'weapon3': '1.854'} [2024-08-05 21:58:39,053][52650] Updated weights for policy 0, policy_version 4171 (0.0018) [2024-08-05 21:58:41,802][52670] DAMAGECOUNT value on done: 2009.0 [2024-08-05 21:58:41,802][52670] Sum rewards: 1.569, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.180', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.094', 'weapon4': '0.152', 'HITCOUNT': '0.280', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.735', 'FRAGCOUNT': '1.000', 'weapon3': '1.202', 'weapon2': '1.758'} [2024-08-05 21:58:42,057][52666] DAMAGECOUNT value on done: 2224.0 [2024-08-05 21:58:42,060][52666] Sum rewards: 4.921, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.108', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.266', 'HEALTH': '0.320', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon2': '0.852', 'weapon3': '1.950', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 34226176. Throughput: 0: 4234.4. Samples: 8564410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 21:58:42,802][52567] Avg episode reward: [(0, '1.116')] [2024-08-05 21:58:42,803][52614] Saving new best policy, reward=1.116! [2024-08-05 21:58:44,333][52650] Updated weights for policy 0, policy_version 4181 (0.0022) [2024-08-05 21:58:44,621][52670] DAMAGECOUNT value on done: 2482.0 [2024-08-05 21:58:44,626][52670] Sum rewards: 3.920, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.825', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.222', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.532', 'DAMAGECOUNT': '1.164', 'weapon3': '1.240', 'weapon2': '1.546', 'FRAGCOUNT': '3.000'} [2024-08-05 21:58:44,998][52666] DAMAGECOUNT value on done: 2241.0 [2024-08-05 21:58:44,999][52666] Sum rewards: 3.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.692', 'weapon4': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'weapon5': '0.086', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.390', 'ARMOR': '0.436', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.338', 'weapon3': '1.610', 'weapon2': '1.826', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 17078.2). Total num frames: 34316288. Throughput: 0: 4229.8. Samples: 8577000. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 21:58:47,795][52567] Avg episode reward: [(0, '1.153')] [2024-08-05 21:58:47,798][52614] Saving new best policy, reward=1.153! [2024-08-05 21:58:48,267][52670] DAMAGECOUNT value on done: 1587.0 [2024-08-05 21:58:48,686][52666] DAMAGECOUNT value on done: 2164.0 [2024-08-05 21:58:48,688][52666] Sum rewards: -2.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.308', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'ARMOR': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.178', 'DAMAGECOUNT': '0.270', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.350', 'weapon3': '1.684'} [2024-08-05 21:58:48,844][52650] Updated weights for policy 0, policy_version 4191 (0.0024) [2024-08-05 21:58:51,068][52670] DAMAGECOUNT value on done: 2794.0 [2024-08-05 21:58:51,068][52670] Sum rewards: 2.732, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.629', 'AMMO2': '0.004', 'AMMO4': '0.022', 'ARMOR': '0.060', 'weapon4': '0.080', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.508', 'weapon3': '1.670', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:51,494][52666] DAMAGECOUNT value on done: 2561.0 [2024-08-05 21:58:51,495][52666] Sum rewards: 3.908, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.050', 'ARMOR': '0.064', 'HEALTH': '0.101', 'HITCOUNT': '0.250', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.807', 'weapon3': '1.080', 'weapon2': '1.174', 'FRAGCOUNT': '3.000'} [2024-08-05 21:58:52,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 16994.9). Total num frames: 34390016. Throughput: 0: 4219.1. Samples: 8602410. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-05 21:58:52,795][52567] Avg episode reward: [(0, '1.173')] [2024-08-05 21:58:52,795][52614] Saving new best policy, reward=1.173! [2024-08-05 21:58:53,804][52650] Updated weights for policy 0, policy_version 4201 (0.0027) [2024-08-05 21:58:54,204][52670] DAMAGECOUNT value on done: 2564.0 [2024-08-05 21:58:54,205][52670] Sum rewards: 0.347, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.618', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'ARMOR': '0.412', 'HITCOUNT': '0.460', 'WEAPON3': '0.950', 'weapon2': '1.264', 'DAMAGECOUNT': '1.626', 'weapon3': '2.274', 'FRAGCOUNT': '4.000'} [2024-08-05 21:58:54,630][52666] DAMAGECOUNT value on done: 1988.0 [2024-08-05 21:58:54,632][52666] Sum rewards: 6.047, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'ARMOR': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.300', 'HITCOUNT': '0.480', 'weapon4': '0.636', 'WEAPON3': '0.750', 'weapon2': '1.022', 'weapon3': '1.506', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2024-08-05 21:58:57,454][52670] DAMAGECOUNT value on done: 2155.0 [2024-08-05 21:58:57,457][52670] Sum rewards: 3.069, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.083', 'weapon4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'HEALTH': '0.436', 'ARMOR': '0.897', 'weapon3': '1.152', 'DAMAGECOUNT': '1.215', 'weapon2': '1.876', 'FRAGCOUNT': '3.000'} [2024-08-05 21:58:57,729][52666] DAMAGECOUNT value on done: 2714.0 [2024-08-05 21:58:57,731][52666] Sum rewards: 6.895, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.300', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.070', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.413', 'weapon3': '1.468', 'weapon2': '1.840', 'FRAGCOUNT': '6.000'} [2024-08-05 21:58:57,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 34480128. Throughput: 0: 4215.8. Samples: 8627870. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-05 21:58:57,794][52567] Avg episode reward: [(0, '1.321')] [2024-08-05 21:58:57,798][52614] Saving new best policy, reward=1.321! [2024-08-05 21:58:58,677][52650] Updated weights for policy 0, policy_version 4211 (0.0020) [2024-08-05 21:58:59,786][52670] DAMAGECOUNT value on done: 1546.0 [2024-08-05 21:58:59,787][52670] Sum rewards: 0.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'weapon7': '0.016', 'AMMO2': '0.027', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.135', 'weapon5': '0.138', 'HITCOUNT': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.382', 'ARMOR': '0.524', 'WEAPON3': '0.850', 'weapon2': '0.932', 'DAMAGECOUNT': '1.011', 'weapon3': '1.702', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:00,100][52666] DAMAGECOUNT value on done: 2439.0 [2024-08-05 21:59:00,100][52666] Sum rewards: 2.935, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.222', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.140', 'ARMOR': '1.336', 'weapon3': '1.576', 'weapon2': '2.078', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 34562048. Throughput: 0: 4198.0. Samples: 8640110. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 21:59:02,794][52567] Avg episode reward: [(0, '1.340')] [2024-08-05 21:59:02,795][52614] Saving new best policy, reward=1.340! [2024-08-05 21:59:03,089][52670] DAMAGECOUNT value on done: 1888.0 [2024-08-05 21:59:03,091][52670] Sum rewards: -1.393, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.558', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'weapon7': '0.062', 'ARMOR': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.216', 'DAMAGECOUNT': '0.465', 'WEAPON3': '0.900', 'weapon2': '1.062', 'FRAGCOUNT': '2.000', 'weapon3': '2.062'} [2024-08-05 21:59:03,451][52666] DAMAGECOUNT value on done: 2401.0 [2024-08-05 21:59:03,451][52666] Sum rewards: -1.514, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.180', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '1.000', 'weapon3': '1.738', 'weapon2': '1.794'} [2024-08-05 21:59:03,683][52650] Updated weights for policy 0, policy_version 4221 (0.0011) [2024-08-05 21:59:06,085][52670] DAMAGECOUNT value on done: 2439.0 [2024-08-05 21:59:06,087][52670] Sum rewards: 4.082, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.242', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.080', 'ARMOR': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'weapon4': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.148', 'DAMAGECOUNT': '1.230', 'weapon3': '1.470', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:06,397][52666] DAMAGECOUNT value on done: 2410.0 [2024-08-05 21:59:06,399][52666] Sum rewards: 1.738, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.316', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.068', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.198', 'HITCOUNT': '0.280', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.155', 'weapon2': '1.228', 'weapon3': '2.010', 'FRAGCOUNT': '2.500'} [2024-08-05 21:59:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 17022.7). Total num frames: 34643968. Throughput: 0: 4186.7. Samples: 8665260. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:59:07,794][52567] Avg episode reward: [(0, '1.373')] [2024-08-05 21:59:07,798][52614] Saving new best policy, reward=1.373! [2024-08-05 21:59:08,480][52650] Updated weights for policy 0, policy_version 4231 (0.0016) [2024-08-05 21:59:09,358][52670] DAMAGECOUNT value on done: 2945.0 [2024-08-05 21:59:09,360][52670] Sum rewards: 1.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.895', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon7': '0.068', 'ARMOR': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON7': '0.200', 'weapon4': '0.288', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.066', 'DAMAGECOUNT': '1.422', 'weapon3': '1.774', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:09,641][52666] DAMAGECOUNT value on done: 1705.0 [2024-08-05 21:59:09,644][52666] Sum rewards: 0.955, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.760', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.035', 'weapon5': '0.076', 'AMMO3': '0.119', 'HITCOUNT': '0.170', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.700', 'ARMOR': '0.976', 'weapon2': '1.356', 'weapon3': '1.904', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:11,710][52794] DAMAGECOUNT value on done: 1966.0 [2024-08-05 21:59:11,710][52794] Sum rewards: -2.572, reward structure: {'DEATHCOUNT': '-7.500', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'AMMO2': '0.026', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.129', 'weapon4': '0.130', 'HITCOUNT': '0.200', 'weapon5': '0.544', 'DAMAGECOUNT': '0.564', 'WEAPON3': '0.650', 'weapon2': '1.590', 'weapon3': '1.610'} [2024-08-05 21:59:12,173][52614] Signal inference workers to stop experience collection... (800 times) [2024-08-05 21:59:12,174][52614] Signal inference workers to resume experience collection... (800 times) [2024-08-05 21:59:12,222][52650] InferenceWorker_p0-w0: stopping experience collection (800 times) [2024-08-05 21:59:12,222][52650] InferenceWorker_p0-w0: resuming experience collection (800 times) [2024-08-05 21:59:12,549][52670] DAMAGECOUNT value on done: 2657.0 [2024-08-05 21:59:12,552][52670] Sum rewards: 2.264, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.029', 'ARMOR': '0.072', 'weapon7': '0.080', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'HEALTH': '0.253', 'weapon4': '0.254', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'weapon2': '1.234', 'DAMAGECOUNT': '1.413', 'weapon3': '1.562'} [2024-08-05 21:59:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 34734080. Throughput: 0: 4196.0. Samples: 8690780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 21:59:12,794][52567] Avg episode reward: [(0, '1.372')] [2024-08-05 21:59:12,857][52666] DAMAGECOUNT value on done: 2387.0 [2024-08-05 21:59:12,862][52666] Sum rewards: -2.647, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.698', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.087', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.190', 'weapon4': '0.348', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.650', 'weapon2': '1.028', 'weapon3': '1.692'} [2024-08-05 21:59:13,256][52650] Updated weights for policy 0, policy_version 4241 (0.0043) [2024-08-05 21:59:14,109][52794] DAMAGECOUNT value on done: 2785.0 [2024-08-05 21:59:14,117][52794] Sum rewards: 2.250, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.304', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.068', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'ARMOR': '0.479', 'HITCOUNT': '0.530', 'WEAPON3': '0.900', 'weapon2': '1.690', 'DAMAGECOUNT': '1.722', 'weapon3': '1.926', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:14,883][52662] DAMAGECOUNT value on done: 2246.0 [2024-08-05 21:59:14,888][52662] Sum rewards: 3.575, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.294', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'weapon4': '0.048', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'ARMOR': '0.913', 'DAMAGECOUNT': '1.131', 'weapon3': '1.336', 'weapon2': '1.838', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:15,846][52670] DAMAGECOUNT value on done: 2678.0 [2024-08-05 21:59:15,848][52670] Sum rewards: -1.480, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.282', 'AMMO4': '-0.096', 'AMMO2': '-0.019', 'AMMO5': '0.005', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'HITCOUNT': '0.310', 'WEAPON3': '1.000', 'ARMOR': '1.004', 'DAMAGECOUNT': '1.305', 'weapon3': '1.792', 'weapon2': '1.986', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:16,236][52666] DAMAGECOUNT value on done: 2122.0 [2024-08-05 21:59:16,238][52666] Sum rewards: 1.335, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.514', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.129', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.032', 'weapon2': '1.072', 'weapon3': '1.512', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:16,761][52794] DAMAGECOUNT value on done: 3297.0 [2024-08-05 21:59:16,762][52794] Sum rewards: 3.899, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.526', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.180', 'weapon5': '0.180', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.795', 'weapon2': '1.240', 'weapon3': '1.714', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:17,238][52662] DAMAGECOUNT value on done: 2485.0 [2024-08-05 21:59:17,239][52662] Sum rewards: 0.531, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.666', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.083', 'HITCOUNT': '0.280', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.275', 'weapon3': '1.354', 'weapon2': '1.916', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 34816000. Throughput: 0: 4202.0. Samples: 8703720. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 21:59:17,795][52567] Avg episode reward: [(0, '1.358')] [2024-08-05 21:59:18,131][52650] Updated weights for policy 0, policy_version 4251 (0.0013) [2024-08-05 21:59:18,922][52670] DAMAGECOUNT value on done: 2258.0 [2024-08-05 21:59:18,923][52670] Sum rewards: 3.817, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.209', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.893', 'weapon3': '1.174', 'DAMAGECOUNT': '1.215', 'weapon2': '1.410', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:19,216][52794] DAMAGECOUNT value on done: 3364.0 [2024-08-05 21:59:19,224][52794] Sum rewards: 3.879, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.123', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO3': '0.062', 'AMMO4': '0.066', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'weapon4': '0.536', 'DAMAGECOUNT': '0.999', 'weapon2': '1.392', 'weapon3': '1.488', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:19,274][52666] DAMAGECOUNT value on done: 2491.0 [2024-08-05 21:59:19,276][52666] Sum rewards: 5.404, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'weapon4': '0.192', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'ARMOR': '0.913', 'HEALTH': '0.984', 'weapon3': '1.522', 'weapon2': '1.968', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:19,799][52662] DAMAGECOUNT value on done: 2550.0 [2024-08-05 21:59:19,801][52662] Sum rewards: 1.713, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.626', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.102', 'HITCOUNT': '0.260', 'WEAPON3': '0.750', 'ARMOR': '0.840', 'DAMAGECOUNT': '0.942', 'weapon2': '1.588', 'weapon3': '1.868', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:21,716][52794] DAMAGECOUNT value on done: 2898.0 [2024-08-05 21:59:21,716][52794] Sum rewards: -0.067, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.078', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.700', 'weapon2': '1.436', 'FRAGCOUNT': '2.000', 'weapon3': '2.136'} [2024-08-05 21:59:22,126][52670] DAMAGECOUNT value on done: 1625.0 [2024-08-05 21:59:22,127][52670] Sum rewards: -0.103, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.628', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.119', 'HITCOUNT': '0.230', 'weapon4': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.657', 'ARMOR': '0.932', 'FRAGCOUNT': '1.000', 'weapon3': '1.258', 'weapon2': '1.310'} [2024-08-05 21:59:22,326][52666] DAMAGECOUNT value on done: 1839.0 [2024-08-05 21:59:22,327][52666] Sum rewards: 1.954, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.656', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.034', 'AMMO4': '0.086', 'ARMOR': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.230', 'weapon4': '0.294', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.062', 'weapon2': '1.330', 'weapon3': '1.870', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:22,333][52662] DAMAGECOUNT value on done: 2151.0 [2024-08-05 21:59:22,333][52662] Sum rewards: -1.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.632', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.111', 'HITCOUNT': '0.290', 'ARMOR': '0.408', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.002', 'weapon2': '1.284', 'FRAGCOUNT': '2.000', 'weapon3': '2.012'} [2024-08-05 21:59:22,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16793.6, 300 sec: 16994.9). Total num frames: 34897920. Throughput: 0: 4219.5. Samples: 8729560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 21:59:22,795][52567] Avg episode reward: [(0, '1.328')] [2024-08-05 21:59:22,858][52650] Updated weights for policy 0, policy_version 4261 (0.0023) [2024-08-05 21:59:24,617][52670] DAMAGECOUNT value on done: 2487.0 [2024-08-05 21:59:24,617][52670] Sum rewards: 0.125, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.422', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.133', 'HITCOUNT': '0.330', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.320', 'ARMOR': '1.637', 'weapon2': '1.890', 'weapon3': '1.904'} [2024-08-05 21:59:24,631][52794] DAMAGECOUNT value on done: 2730.0 [2024-08-05 21:59:24,739][52811] DAMAGECOUNT value on done: 2715.0 [2024-08-05 21:59:24,742][52811] Sum rewards: 3.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.015', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.110', 'HITCOUNT': '0.250', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.005', 'weapon3': '1.436', 'weapon2': '2.072', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:24,987][52666] DAMAGECOUNT value on done: 2364.0 [2024-08-05 21:59:24,987][52666] Sum rewards: 2.693, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.504', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.057', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'weapon3': '1.026', 'weapon2': '1.028', 'DAMAGECOUNT': '1.074', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:25,203][52662] DAMAGECOUNT value on done: 2938.0 [2024-08-05 21:59:25,204][52662] Sum rewards: 2.113, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.964', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.152', 'HITCOUNT': '0.390', 'ARMOR': '0.483', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.377', 'weapon2': '1.522', 'weapon3': '1.642', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:26,816][52803] DAMAGECOUNT value on done: 2738.0 [2024-08-05 21:59:26,816][52803] Sum rewards: 5.193, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.210', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.214', 'WEAPON3': '0.400', 'ARMOR': '0.440', 'HITCOUNT': '0.480', 'weapon2': '1.258', 'weapon3': '1.446', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:27,090][52794] DAMAGECOUNT value on done: 2261.0 [2024-08-05 21:59:27,091][52794] Sum rewards: 5.286, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.130', 'HEALTH': '0.130', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.214', 'weapon3': '1.980', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '7.000'} [2024-08-05 21:59:27,478][52650] Updated weights for policy 0, policy_version 4271 (0.0019) [2024-08-05 21:59:27,770][52662] DAMAGECOUNT value on done: 3476.0 [2024-08-05 21:59:27,770][52662] Sum rewards: 2.846, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.072', 'ARMOR': '0.076', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'HEALTH': '0.514', 'DAMAGECOUNT': '1.599', 'weapon3': '1.614', 'weapon2': '2.056', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 34988032. Throughput: 0: 4243.3. Samples: 8755360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 21:59:27,795][52567] Avg episode reward: [(0, '1.403')] [2024-08-05 21:59:27,798][52614] Saving new best policy, reward=1.403! [2024-08-05 21:59:27,914][52670] DAMAGECOUNT value on done: 3239.0 [2024-08-05 21:59:27,914][52670] Sum rewards: 0.891, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.528', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.137', 'ARMOR': '0.436', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'weapon3': '1.524', 'DAMAGECOUNT': '1.578', 'weapon2': '2.070', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:27,997][52811] DAMAGECOUNT value on done: 2078.0 [2024-08-05 21:59:28,000][52811] Sum rewards: 5.512, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.136', 'WEAPON5': '0.150', 'HEALTH': '0.267', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'ARMOR': '0.449', 'weapon5': '0.458', 'DAMAGECOUNT': '0.900', 'weapon3': '1.234', 'weapon2': '1.528', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:28,149][52666] DAMAGECOUNT value on done: 3273.0 [2024-08-05 21:59:28,151][52666] Sum rewards: 1.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.078', 'ARMOR': '0.496', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.466', 'DAMAGECOUNT': '1.611', 'weapon2': '1.678', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:29,325][52665] DAMAGECOUNT value on done: 3292.0 [2024-08-05 21:59:29,328][52665] Sum rewards: 1.630, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.072', 'WEAPON4': '0.200', 'weapon4': '0.278', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.299', 'weapon3': '1.410', 'weapon2': '1.530', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:30,076][52794] DAMAGECOUNT value on done: 2910.0 [2024-08-05 21:59:30,076][52794] Sum rewards: -1.364, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.945', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.124', 'HITCOUNT': '0.250', 'ARMOR': '0.480', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon2': '1.652', 'weapon3': '1.918'} [2024-08-05 21:59:30,280][52795] DAMAGECOUNT value on done: 1602.0 [2024-08-05 21:59:30,280][52795] Sum rewards: 0.396, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.893', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.084', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.358', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.606', 'weapon2': '1.330', 'weapon3': '1.864', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:30,287][52803] DAMAGECOUNT value on done: 2761.0 [2024-08-05 21:59:30,287][52803] Sum rewards: 4.110, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.052', 'AMMO3': '0.080', 'HEALTH': '0.302', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.035', 'weapon2': '1.444', 'weapon3': '1.592', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:30,657][52670] DAMAGECOUNT value on done: 2083.0 [2024-08-05 21:59:30,657][52670] Sum rewards: 0.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.158', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.145', 'HITCOUNT': '0.400', 'ARMOR': '0.436', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.365', 'weapon2': '1.770', 'weapon3': '2.078', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:30,696][52662] DAMAGECOUNT value on done: 3910.0 [2024-08-05 21:59:30,696][52662] Sum rewards: 3.003, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.180', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.065', 'WEAPON3': '0.350', 'HITCOUNT': '0.450', 'ARMOR': '0.497', 'weapon3': '1.262', 'DAMAGECOUNT': '1.815', 'weapon2': '1.920', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:31,037][52666] DAMAGECOUNT value on done: 2580.0 [2024-08-05 21:59:31,037][52666] Sum rewards: 2.435, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.572', 'AMMO2': '0.017', 'weapon4': '0.018', 'ARMOR': '0.036', 'AMMO4': '0.084', 'AMMO3': '0.116', 'WEAPON4': '0.250', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.546', 'DAMAGECOUNT': '1.764', 'weapon3': '1.926', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:31,368][52811] DAMAGECOUNT value on done: 2680.0 [2024-08-05 21:59:31,368][52811] Sum rewards: -0.725, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.258', 'AMMO4': '-0.097', 'AMMO2': '-0.019', 'AMMO3': '0.111', 'ARMOR': '0.456', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.554', 'weapon2': '1.646', 'weapon3': '1.802', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:32,293][52650] Updated weights for policy 0, policy_version 4281 (0.0026) [2024-08-05 21:59:32,390][52794] DAMAGECOUNT value on done: 3597.0 [2024-08-05 21:59:32,390][52794] Sum rewards: 2.651, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.082', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'weapon4': '0.314', 'WEAPON4': '0.350', 'HITCOUNT': '0.480', 'ARMOR': '0.534', 'WEAPON3': '0.850', 'weapon2': '1.382', 'DAMAGECOUNT': '1.656', 'weapon3': '1.932', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:32,703][52665] DAMAGECOUNT value on done: 2675.0 [2024-08-05 21:59:32,703][52665] Sum rewards: 9.542, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.016', 'AMMO2': '0.018', 'AMMO3': '0.083', 'AMMO4': '0.088', 'ARMOR': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.402', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.112', 'weapon3': '1.578', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '8.000'} [2024-08-05 21:59:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 17022.7). Total num frames: 35069952. Throughput: 0: 4242.9. Samples: 8767930. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 21:59:32,794][52567] Avg episode reward: [(0, '1.678')] [2024-08-05 21:59:32,795][52614] Saving new best policy, reward=1.678! [2024-08-05 21:59:32,865][52662] DAMAGECOUNT value on done: 2629.0 [2024-08-05 21:59:32,867][52662] Sum rewards: 2.941, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.294', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.018', 'AMMO4': '0.029', 'AMMO3': '0.065', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.134', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'weapon2': '1.144', 'weapon3': '1.250', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:33,593][52803] DAMAGECOUNT value on done: 2246.0 [2024-08-05 21:59:33,596][52803] Sum rewards: 1.987, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.975', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'ARMOR': '0.948', 'DAMAGECOUNT': '1.026', 'weapon3': '1.340', 'FRAGCOUNT': '2.000', 'weapon2': '2.006'} [2024-08-05 21:59:33,721][52795] DAMAGECOUNT value on done: 2346.0 [2024-08-05 21:59:33,722][52795] Sum rewards: 1.041, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.990', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.450', 'ARMOR': '0.520', 'DAMAGECOUNT': '0.720', 'weapon3': '0.914', 'weapon2': '1.272', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:33,742][52670] DAMAGECOUNT value on done: 2182.0 [2024-08-05 21:59:33,743][52670] Sum rewards: 3.820, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.021', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'HITCOUNT': '0.070', 'AMMO4': '0.103', 'weapon4': '0.254', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.360', 'HEALTH': '0.436', 'ARMOR': '0.456', 'weapon3': '1.188', 'weapon2': '1.532', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:34,765][52811] DAMAGECOUNT value on done: 2503.0 [2024-08-05 21:59:34,766][52811] Sum rewards: -1.828, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.350', 'ARMOR': '0.518', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.152', 'weapon2': '1.632', 'weapon3': '2.108', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:35,005][52794] DAMAGECOUNT value on done: 2140.0 [2024-08-05 21:59:35,006][52794] Sum rewards: 0.979, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.399', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon5': '0.044', 'weapon4': '0.062', 'AMMO4': '0.063', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.206', 'ARMOR': '1.379', 'weapon2': '1.456', 'weapon3': '1.876', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:35,560][52662] DAMAGECOUNT value on done: 3179.0 [2024-08-05 21:59:35,560][52662] Sum rewards: 7.315, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.582', 'AMMO2': '0.006', 'AMMO5': '0.013', 'weapon4': '0.028', 'AMMO4': '0.030', 'AMMO3': '0.075', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.350', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.948', 'weapon3': '1.388', 'DAMAGECOUNT': '1.755', 'weapon2': '1.844', 'FRAGCOUNT': '7.000'} [2024-08-05 21:59:35,655][52669] DAMAGECOUNT value on done: 2142.0 [2024-08-05 21:59:35,656][52669] Sum rewards: -0.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.136', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.390', 'weapon4': '0.442', 'ARMOR': '0.551', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.407', 'weapon3': '1.544', 'weapon2': '1.668', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:35,872][52665] DAMAGECOUNT value on done: 3442.0 [2024-08-05 21:59:35,872][52665] Sum rewards: 3.838, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.195', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO3': '0.061', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.332', 'WEAPON3': '0.450', 'ARMOR': '0.571', 'DAMAGECOUNT': '0.804', 'weapon3': '1.292', 'weapon2': '1.502', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:36,901][52795] DAMAGECOUNT value on done: 2183.0 [2024-08-05 21:59:37,089][52803] DAMAGECOUNT value on done: 3796.0 [2024-08-05 21:59:37,089][52803] Sum rewards: 2.264, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'ARMOR': '0.468', 'weapon5': '0.636', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.335', 'weapon2': '1.478', 'weapon3': '1.524', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:37,286][52650] Updated weights for policy 0, policy_version 4291 (0.0047) [2024-08-05 21:59:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 35160064. Throughput: 0: 4236.0. Samples: 8793030. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 21:59:37,794][52567] Avg episode reward: [(0, '1.696')] [2024-08-05 21:59:37,799][52614] Saving new best policy, reward=1.696! [2024-08-05 21:59:37,814][52794] DAMAGECOUNT value on done: 2744.0 [2024-08-05 21:59:37,815][52794] Sum rewards: -0.502, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.136', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.388', 'HITCOUNT': '0.640', 'weapon2': '0.956', 'WEAPON3': '1.000', 'DAMAGECOUNT': '2.205', 'weapon3': '2.340', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:37,982][52811] DAMAGECOUNT value on done: 2434.0 [2024-08-05 21:59:37,983][52811] Sum rewards: 4.769, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.075', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.873', 'weapon3': '1.084', 'weapon2': '1.436', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:38,338][52662] DAMAGECOUNT value on done: 2872.0 [2024-08-05 21:59:38,338][52662] Sum rewards: 0.610, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.586', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.190', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.800', 'ARMOR': '1.360', 'weapon2': '1.540', 'weapon3': '2.184', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:38,816][52665] DAMAGECOUNT value on done: 1807.0 [2024-08-05 21:59:38,819][52665] Sum rewards: 2.946, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.082', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'ARMOR': '0.901', 'weapon2': '1.540', 'DAMAGECOUNT': '1.734', 'weapon3': '1.792', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:39,072][52669] DAMAGECOUNT value on done: 2324.0 [2024-08-05 21:59:39,072][52669] Sum rewards: 0.351, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'HEALTH': '0.020', 'AMMO2': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon5': '0.166', 'weapon4': '0.206', 'HITCOUNT': '0.210', 'ARMOR': '0.217', 'AMMO4': '0.286', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.765', 'weapon2': '1.316', 'weapon3': '1.872', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:40,012][52795] DAMAGECOUNT value on done: 3553.0 [2024-08-05 21:59:40,014][52795] Sum rewards: 6.082, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.895', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon7': '0.062', 'ARMOR': '0.072', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.212', 'weapon5': '0.356', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.302', 'weapon3': '1.356', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:40,409][52803] DAMAGECOUNT value on done: 3197.0 [2024-08-05 21:59:40,411][52803] Sum rewards: 0.636, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.326', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'weapon4': '0.036', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'weapon5': '0.310', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.855', 'ARMOR': '0.929', 'FRAGCOUNT': '1.000', 'weapon3': '1.196', 'weapon2': '1.766'} [2024-08-05 21:59:40,500][52794] DAMAGECOUNT value on done: 3046.0 [2024-08-05 21:59:40,501][52794] Sum rewards: 2.709, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'AMMO2': '0.004', 'AMMO4': '0.018', 'ARMOR': '0.032', 'AMMO3': '0.117', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.470', 'weapon3': '1.586', 'weapon2': '1.876', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:40,985][52662] DAMAGECOUNT value on done: 2687.0 [2024-08-05 21:59:41,438][52665] DAMAGECOUNT value on done: 2533.0 [2024-08-05 21:59:41,438][52665] Sum rewards: -0.375, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'weapon7': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.135', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon5': '0.450', 'weapon4': '0.472', 'ARMOR': '0.510', 'weapon2': '0.730', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.972'} [2024-08-05 21:59:41,504][52811] DAMAGECOUNT value on done: 2560.0 [2024-08-05 21:59:41,504][52811] Sum rewards: -0.703, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.429', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'ARMOR': '0.886', 'DAMAGECOUNT': '1.227', 'weapon3': '1.464', 'weapon2': '1.980', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:41,866][52669] DAMAGECOUNT value on done: 2455.0 [2024-08-05 21:59:41,867][52669] Sum rewards: 2.375, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.186', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.008', 'AMMO3': '0.088', 'weapon5': '0.164', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'ARMOR': '0.898', 'DAMAGECOUNT': '1.128', 'weapon3': '1.544', 'weapon2': '1.628', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:42,466][52650] Updated weights for policy 0, policy_version 4301 (0.0023) [2024-08-05 21:59:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 35241984. Throughput: 0: 4231.8. Samples: 8818300. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 21:59:42,794][52567] Avg episode reward: [(0, '1.759')] [2024-08-05 21:59:42,795][52614] Saving new best policy, reward=1.759! [2024-08-05 21:59:42,985][52794] DAMAGECOUNT value on done: 2521.0 [2024-08-05 21:59:42,985][52794] Sum rewards: 0.226, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.117', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.076', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'weapon4': '0.408', 'ARMOR': '0.485', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.825', 'weapon2': '0.942', 'FRAGCOUNT': '1.000', 'weapon3': '1.512'} [2024-08-05 21:59:43,198][52795] DAMAGECOUNT value on done: 2352.0 [2024-08-05 21:59:43,559][52662] DAMAGECOUNT value on done: 2764.0 [2024-08-05 21:59:43,562][52662] Sum rewards: 0.271, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO2': '0.023', 'AMMO3': '0.107', 'AMMO4': '0.115', 'HITCOUNT': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.348', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.630', 'ARMOR': '0.632', 'FRAGCOUNT': '1.000', 'weapon2': '1.668', 'weapon3': '1.708'} [2024-08-05 21:59:43,845][52803] DAMAGECOUNT value on done: 2587.0 [2024-08-05 21:59:43,845][52803] Sum rewards: 4.459, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.061', 'AMMO4': '-0.093', 'AMMO2': '-0.019', 'AMMO5': '0.010', 'AMMO3': '0.054', 'WEAPON5': '0.100', 'weapon5': '0.176', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'ARMOR': '0.486', 'DAMAGECOUNT': '1.044', 'weapon3': '1.120', 'weapon2': '1.602', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:44,176][52665] DAMAGECOUNT value on done: 2240.0 [2024-08-05 21:59:44,178][52665] Sum rewards: 0.803, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.032', 'AMMO3': '0.077', 'ARMOR': '0.112', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.696', 'weapon4': '0.810', 'weapon2': '0.984', 'weapon3': '1.440', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:44,751][52669] DAMAGECOUNT value on done: 4242.0 [2024-08-05 21:59:44,753][52669] Sum rewards: 3.294, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.906', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.111', 'weapon4': '0.146', 'WEAPON4': '0.250', 'ARMOR': '0.497', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.114', 'weapon3': '1.582', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:44,766][52811] DAMAGECOUNT value on done: 2761.0 [2024-08-05 21:59:44,767][52811] Sum rewards: 4.764, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.022', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.077', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.350', 'DAMAGECOUNT': '1.362', 'weapon3': '1.494', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:45,257][52794] DAMAGECOUNT value on done: 3929.0 [2024-08-05 21:59:45,258][52794] Sum rewards: 2.570, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.965', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'weapon4': '0.178', 'weapon5': '0.220', 'HITCOUNT': '0.410', 'ARMOR': '0.416', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.239', 'weapon3': '1.428', 'weapon2': '1.788', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:45,771][52662] DAMAGECOUNT value on done: 2785.0 [2024-08-05 21:59:45,771][52662] Sum rewards: 0.672, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.443', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.262', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'ARMOR': '0.892', 'FRAGCOUNT': '1.000', 'weapon3': '1.112', 'DAMAGECOUNT': '1.362', 'weapon2': '2.234'} [2024-08-05 21:59:46,341][52795] DAMAGECOUNT value on done: 3061.0 [2024-08-05 21:59:46,341][52795] Sum rewards: 2.812, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.851', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.036', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.308', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'weapon2': '1.488', 'DAMAGECOUNT': '1.779', 'weapon3': '1.990', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:46,743][52650] Updated weights for policy 0, policy_version 4311 (0.0024) [2024-08-05 21:59:46,989][52647] DAMAGECOUNT value on done: 2120.0 [2024-08-05 21:59:46,991][52647] Sum rewards: 5.172, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.725', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.015', 'AMMO3': '0.060', 'WEAPON5': '0.150', 'weapon5': '0.344', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '1.346', 'DAMAGECOUNT': '1.761', 'weapon2': '1.918', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:47,004][52665] DAMAGECOUNT value on done: 1850.0 [2024-08-05 21:59:47,004][52665] Sum rewards: 1.240, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.251', 'AMMO5': '0.006', 'AMMO2': '0.022', 'AMMO3': '0.062', 'HITCOUNT': '0.080', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.164', 'WEAPON4': '0.250', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.400', 'weapon3': '0.806', 'ARMOR': '0.864', 'FRAGCOUNT': '1.000', 'weapon5': '1.240', 'weapon2': '1.304'} [2024-08-05 21:59:47,045][52803] DAMAGECOUNT value on done: 3451.0 [2024-08-05 21:59:47,049][52803] Sum rewards: 3.381, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.100', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.172', 'weapon5': '0.210', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.110', 'weapon2': '1.294', 'weapon3': '1.350', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:47,754][52794] DAMAGECOUNT value on done: 3238.0 [2024-08-05 21:59:47,754][52794] Sum rewards: 2.684, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.038', 'weapon4': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.275', 'weapon2': '1.456', 'weapon3': '1.840', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:47,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.6, 300 sec: 16994.9). Total num frames: 35323904. Throughput: 0: 4244.2. Samples: 8831100. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 21:59:47,795][52669] DAMAGECOUNT value on done: 2512.0 [2024-08-05 21:59:47,795][52567] Avg episode reward: [(0, '1.897')] [2024-08-05 21:59:47,795][52669] Sum rewards: 1.852, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.036', 'HEALTH': '0.044', 'AMMO3': '0.050', 'HITCOUNT': '0.050', 'DAMAGECOUNT': '0.087', 'WEAPON3': '0.350', 'weapon2': '1.046', 'weapon3': '1.170', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:47,798][52614] Saving new best policy, reward=1.897! [2024-08-05 21:59:48,119][52811] DAMAGECOUNT value on done: 1456.0 [2024-08-05 21:59:48,119][52811] Sum rewards: -1.088, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.205', 'AMMO2': '0.019', 'AMMO4': '0.095', 'ARMOR': '0.112', 'AMMO3': '0.129', 'HITCOUNT': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.438', 'DAMAGECOUNT': '0.492', 'WEAPON3': '0.850', 'weapon2': '0.972', 'FRAGCOUNT': '2.000', 'weapon3': '2.080'} [2024-08-05 21:59:48,332][52662] DAMAGECOUNT value on done: 3131.0 [2024-08-05 21:59:48,334][52662] Sum rewards: 4.618, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.646', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.074', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.437', 'weapon2': '1.484', 'weapon3': '1.630', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:49,104][52663] DAMAGECOUNT value on done: 2118.0 [2024-08-05 21:59:49,105][52663] Sum rewards: -0.037, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.121', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'HEALTH': '0.304', 'weapon4': '0.342', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.245', 'weapon2': '1.308', 'FRAGCOUNT': '2.000', 'weapon3': '2.020'} [2024-08-05 21:59:49,765][52795] DAMAGECOUNT value on done: 2335.0 [2024-08-05 21:59:49,766][52795] Sum rewards: -0.394, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.366', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.118', 'weapon4': '0.256', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.002', 'weapon2': '1.352', 'weapon3': '1.470', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:49,785][52647] DAMAGECOUNT value on done: 2833.0 [2024-08-05 21:59:49,787][52647] Sum rewards: -3.114, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.038', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.134', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.705', 'WEAPON3': '0.850', 'ARMOR': '1.255', 'weapon2': '1.582', 'weapon3': '1.650', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:50,003][52665] DAMAGECOUNT value on done: 2437.0 [2024-08-05 21:59:50,003][52665] Sum rewards: 4.589, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'ARMOR': '0.072', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.218', 'HITCOUNT': '0.390', 'weapon4': '0.498', 'WEAPON3': '0.550', 'weapon2': '0.648', 'DAMAGECOUNT': '1.311', 'weapon3': '1.820', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:50,216][52794] DAMAGECOUNT value on done: 3149.0 [2024-08-05 21:59:50,217][52794] Sum rewards: 1.224, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.022', 'HEALTH': '0.040', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.146', 'weapon4': '0.176', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.900', 'weapon2': '1.312', 'weapon3': '1.968', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:50,347][52803] DAMAGECOUNT value on done: 2937.0 [2024-08-05 21:59:50,348][52803] Sum rewards: -0.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.856', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon4': '0.006', 'weapon5': '0.010', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.681', 'WEAPON3': '0.850', 'weapon2': '1.042', 'weapon3': '1.682', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:50,468][52669] DAMAGECOUNT value on done: 2896.0 [2024-08-05 21:59:50,469][52669] Sum rewards: -1.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.820', 'AMMO2': '0.011', 'ARMOR': '0.036', 'AMMO4': '0.057', 'AMMO3': '0.118', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.590', 'weapon3': '1.710'} [2024-08-05 21:59:51,005][52662] DAMAGECOUNT value on done: 2352.0 [2024-08-05 21:59:51,006][52662] Sum rewards: -1.206, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.080', 'AMMO3': '0.105', 'weapon5': '0.152', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'DAMAGECOUNT': '0.477', 'WEAPON3': '0.700', 'weapon2': '1.482', 'weapon3': '1.598', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:51,165][52649] DAMAGECOUNT value on done: 2652.0 [2024-08-05 21:59:51,165][52649] Sum rewards: 1.414, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.104', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'weapon5': '0.112', 'ARMOR': '0.400', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.500', 'weapon2': '1.678', 'weapon3': '1.752', 'DAMAGECOUNT': '2.232'} [2024-08-05 21:59:51,328][52811] DAMAGECOUNT value on done: 2133.0 [2024-08-05 21:59:51,328][52811] Sum rewards: 1.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.523', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.110', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'ARMOR': '0.875', 'weapon2': '1.468', 'DAMAGECOUNT': '1.476', 'weapon3': '1.630', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:51,898][52663] DAMAGECOUNT value on done: 2817.0 [2024-08-05 21:59:51,899][52663] Sum rewards: 4.103, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.728', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.028', 'AMMO4': '0.043', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'ARMOR': '0.884', 'weapon3': '1.490', 'DAMAGECOUNT': '1.770', 'weapon2': '1.848', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:52,101][52650] Updated weights for policy 0, policy_version 4321 (0.0023) [2024-08-05 21:59:52,113][52647] DAMAGECOUNT value on done: 2873.0 [2024-08-05 21:59:52,114][52647] Sum rewards: 2.588, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.349', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.087', 'AMMO3': '0.117', 'weapon4': '0.168', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.158', 'weapon2': '1.190', 'weapon3': '1.744', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 35414016. Throughput: 0: 4250.2. Samples: 8856520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 21:59:52,795][52567] Avg episode reward: [(0, '1.766')] [2024-08-05 21:59:52,922][52794] DAMAGECOUNT value on done: 3025.0 [2024-08-05 21:59:52,923][52794] Sum rewards: 3.820, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.752', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'ARMOR': '0.060', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.204', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.522', 'DAMAGECOUNT': '1.725', 'weapon3': '1.766', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:53,192][52795] DAMAGECOUNT value on done: 3306.0 [2024-08-05 21:59:53,200][52795] Sum rewards: 8.935, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.898', 'AMMO2': '0.010', 'weapon7': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'ARMOR': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.149', 'weapon4': '0.258', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'weapon2': '1.036', 'weapon3': '1.892', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '9.000'} [2024-08-05 21:59:53,367][52669] DAMAGECOUNT value on done: 2837.0 [2024-08-05 21:59:53,367][52669] Sum rewards: 4.737, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.036', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon4': '0.156', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'ARMOR': '1.378', 'DAMAGECOUNT': '1.398', 'weapon2': '1.676', 'weapon3': '1.730', 'FRAGCOUNT': '7.000'} [2024-08-05 21:59:53,517][52803] DAMAGECOUNT value on done: 2196.0 [2024-08-05 21:59:53,517][52803] Sum rewards: 4.803, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'weapon4': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.070', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.514', 'weapon3': '1.292', 'weapon2': '1.512', 'DAMAGECOUNT': '1.578', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:53,565][52662] DAMAGECOUNT value on done: 3265.0 [2024-08-05 21:59:53,567][52662] Sum rewards: 3.025, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.072', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.172', 'HITCOUNT': '0.390', 'weapon4': '0.464', 'WEAPON3': '0.750', 'weapon2': '0.972', 'DAMAGECOUNT': '1.401', 'weapon3': '2.100', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:53,617][52665] DAMAGECOUNT value on done: 1750.0 [2024-08-05 21:59:53,617][52665] Sum rewards: -0.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.395', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.128', 'HITCOUNT': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon2': '1.480', 'weapon3': '1.964'} [2024-08-05 21:59:54,552][52811] DAMAGECOUNT value on done: 2539.0 [2024-08-05 21:59:54,555][52811] Sum rewards: 7.931, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.221', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.318', 'HITCOUNT': '0.490', 'ARMOR': '0.900', 'weapon3': '1.146', 'DAMAGECOUNT': '1.821', 'weapon2': '1.970', 'FRAGCOUNT': '6.000'} [2024-08-05 21:59:54,755][52663] DAMAGECOUNT value on done: 2195.0 [2024-08-05 21:59:54,756][52663] Sum rewards: -0.192, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.260', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.085', 'HITCOUNT': '0.160', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.528', 'FRAGCOUNT': '1.000', 'weapon3': '1.342', 'ARMOR': '1.439', 'weapon2': '2.086'} [2024-08-05 21:59:54,803][52649] DAMAGECOUNT value on done: 2546.0 [2024-08-05 21:59:54,803][52649] Sum rewards: 1.950, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.452', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.034', 'weapon4': '0.042', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.840', 'ARMOR': '0.940', 'weapon2': '1.232', 'weapon3': '1.352', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:54,905][52647] DAMAGECOUNT value on done: 1563.0 [2024-08-05 21:59:54,906][52647] Sum rewards: 3.557, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.646', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.382', 'ARMOR': '0.546', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.777', 'weapon2': '1.490', 'weapon3': '1.496', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:56,029][52794] DAMAGECOUNT value on done: 3494.0 [2024-08-05 21:59:56,029][52794] Sum rewards: 4.258, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.896', 'AMMO2': '0.007', 'weapon4': '0.028', 'AMMO4': '0.035', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'ARMOR': '0.483', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.262', 'weapon2': '1.820', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:56,175][52669] DAMAGECOUNT value on done: 2760.0 [2024-08-05 21:59:56,175][52669] Sum rewards: 4.400, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.537', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.188', 'HITCOUNT': '0.250', 'weapon4': '0.478', 'WEAPON3': '0.500', 'ARMOR': '0.889', 'DAMAGECOUNT': '1.086', 'weapon2': '1.218', 'weapon3': '1.416', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:56,641][52803] DAMAGECOUNT value on done: 2065.0 [2024-08-05 21:59:56,644][52803] Sum rewards: -1.591, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.612', 'weapon7': '0.038', 'ARMOR': '0.044', 'AMMO2': '0.045', 'weapon4': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.226', 'HITCOUNT': '0.230', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.873', 'WEAPON3': '0.950', 'weapon2': '1.318', 'weapon3': '2.182', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:56,669][52795] DAMAGECOUNT value on done: 2703.0 [2024-08-05 21:59:56,670][52795] Sum rewards: 0.788, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO2': '0.015', 'ARMOR': '0.056', 'AMMO4': '0.072', 'AMMO3': '0.077', 'WEAPON4': '0.200', 'weapon4': '0.354', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.152', 'DAMAGECOUNT': '1.374', 'weapon3': '1.478', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:56,686][52650] Updated weights for policy 0, policy_version 4331 (0.0019) [2024-08-05 21:59:56,953][52662] DAMAGECOUNT value on done: 2314.0 [2024-08-05 21:59:57,104][52665] DAMAGECOUNT value on done: 3899.0 [2024-08-05 21:59:57,104][52665] Sum rewards: 3.126, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.658', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO3': '0.080', 'ARMOR': '0.461', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.152', 'weapon3': '1.596', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '3.000'} [2024-08-05 21:59:57,430][52663] DAMAGECOUNT value on done: 3190.0 [2024-08-05 21:59:57,430][52663] Sum rewards: 5.937, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.033', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.073', 'weapon4': '0.108', 'WEAPON4': '0.200', 'ARMOR': '0.472', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.144', 'weapon2': '1.588', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '5.000'} [2024-08-05 21:59:57,463][52647] DAMAGECOUNT value on done: 1964.0 [2024-08-05 21:59:57,464][52647] Sum rewards: 3.542, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.738', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'AMMO3': '0.069', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.190', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'weapon3': '0.924', 'DAMAGECOUNT': '0.981', 'ARMOR': '1.796', 'weapon2': '2.042', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:57,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16793.6, 300 sec: 16994.9). Total num frames: 35487744. Throughput: 0: 4244.2. Samples: 8881770. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 21:59:57,795][52567] Avg episode reward: [(0, '2.078')] [2024-08-05 21:59:57,797][52614] Saving new best policy, reward=2.078! [2024-08-05 21:59:57,832][52811] DAMAGECOUNT value on done: 2906.0 [2024-08-05 21:59:57,834][52811] Sum rewards: 0.047, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'weapon4': '0.090', 'AMMO3': '0.103', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.281', 'weapon2': '1.644', 'weapon3': '1.672', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:57,955][52667] DAMAGECOUNT value on done: 2814.0 [2024-08-05 21:59:57,955][52667] Sum rewards: 1.866, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.046', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.018', 'weapon4': '0.038', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'weapon5': '0.472', 'ARMOR': '0.915', 'DAMAGECOUNT': '1.119', 'weapon3': '1.424', 'weapon2': '1.808', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:58,252][52649] DAMAGECOUNT value on done: 2383.0 [2024-08-05 21:59:58,252][52649] Sum rewards: 3.362, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO2': '0.022', 'AMMO3': '0.094', 'AMMO4': '0.111', 'ARMOR': '0.147', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'weapon4': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.064', 'DAMAGECOUNT': '1.212', 'weapon3': '1.612', 'FRAGCOUNT': '4.000'} [2024-08-05 21:59:58,971][52794] DAMAGECOUNT value on done: 3145.0 [2024-08-05 21:59:58,974][52794] Sum rewards: -1.715, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.965', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon7': '0.050', 'HITCOUNT': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.126', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.402', 'WEAPON3': '0.650', 'weapon3': '0.848', 'FRAGCOUNT': '1.000', 'weapon2': '1.388'} [2024-08-05 21:59:59,095][52820] DAMAGECOUNT value on done: 2146.0 [2024-08-05 21:59:59,096][52820] Sum rewards: 0.031, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon4': '0.018', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'HITCOUNT': '0.240', 'WEAPON3': '0.450', 'ARMOR': '0.486', 'DAMAGECOUNT': '0.750', 'weapon3': '1.034', 'weapon2': '1.260', 'FRAGCOUNT': '2.000'} [2024-08-05 21:59:59,398][52662] DAMAGECOUNT value on done: 3287.0 [2024-08-05 21:59:59,528][52669] DAMAGECOUNT value on done: 2073.0 [2024-08-05 21:59:59,929][52803] DAMAGECOUNT value on done: 1833.0 [2024-08-05 21:59:59,931][52803] Sum rewards: -1.379, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.161', 'AMMO2': '0.010', 'AMMO4': '0.047', 'ARMOR': '0.080', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.160', 'weapon4': '0.226', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.226', 'weapon3': '1.522'} [2024-08-05 22:00:00,073][52795] DAMAGECOUNT value on done: 2521.0 [2024-08-05 22:00:00,074][52795] Sum rewards: 1.958, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.446', 'weapon4': '0.002', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'weapon2': '1.428', 'DAMAGECOUNT': '1.530', 'weapon3': '2.064', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:00,349][52647] DAMAGECOUNT value on done: 2943.0 [2024-08-05 22:00:00,352][52647] Sum rewards: 1.386, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.045', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.400', 'ARMOR': '0.519', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.251', 'weapon2': '1.412', 'weapon3': '1.522', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:00,419][52665] DAMAGECOUNT value on done: 3221.0 [2024-08-05 22:00:00,419][52665] Sum rewards: 6.305, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.013', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.104', 'HEALTH': '0.170', 'WEAPON3': '0.350', 'HITCOUNT': '0.590', 'weapon3': '1.110', 'weapon2': '1.514', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:00,696][52663] DAMAGECOUNT value on done: 2702.0 [2024-08-05 22:00:00,696][52663] Sum rewards: 4.202, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.157', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'HITCOUNT': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.155', 'weapon3': '1.406', 'weapon2': '1.588', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:01,057][52811] DAMAGECOUNT value on done: 2256.0 [2024-08-05 22:00:01,060][52811] Sum rewards: 1.435, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.400', 'ARMOR': '0.542', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.176', 'weapon2': '1.388', 'weapon3': '1.994', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:01,060][52667] DAMAGECOUNT value on done: 2760.0 [2024-08-05 22:00:01,064][52667] Sum rewards: 4.234, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.971', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO3': '0.097', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'weapon3': '1.308', 'ARMOR': '1.349', 'DAMAGECOUNT': '1.476', 'weapon2': '2.196', 'FRAGCOUNT': '7.000'} [2024-08-05 22:00:01,535][52650] Updated weights for policy 0, policy_version 4341 (0.0013) [2024-08-05 22:00:01,673][52794] DAMAGECOUNT value on done: 2889.0 [2024-08-05 22:00:01,674][52794] Sum rewards: 2.248, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.008', 'AMMO2': '0.039', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon4': '0.120', 'weapon5': '0.162', 'AMMO4': '0.193', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'HEALTH': '0.554', 'WEAPON3': '0.600', 'weapon2': '1.446', 'DAMAGECOUNT': '1.521', 'weapon3': '1.728', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:01,699][52649] DAMAGECOUNT value on done: 3027.0 [2024-08-05 22:00:01,705][52649] Sum rewards: 4.014, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.116', 'weapon5': '0.136', 'HEALTH': '0.172', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.554', 'DAMAGECOUNT': '1.419', 'weapon3': '1.594', 'weapon2': '1.872', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:02,061][52669] DAMAGECOUNT value on done: 2413.0 [2024-08-05 22:00:02,063][52669] Sum rewards: 0.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.372', 'AMMO2': '0.044', 'AMMO3': '0.118', 'HITCOUNT': '0.210', 'AMMO4': '0.220', 'weapon4': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.472', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.900', 'weapon2': '1.192', 'weapon3': '1.510', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:02,167][52662] DAMAGECOUNT value on done: 2609.0 [2024-08-05 22:00:02,169][52662] Sum rewards: -2.932, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.956', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.741', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.772', 'weapon3': '2.054'} [2024-08-05 22:00:02,440][52820] DAMAGECOUNT value on done: 2716.0 [2024-08-05 22:00:02,441][52820] Sum rewards: 1.039, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.066', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.151', 'HITCOUNT': '0.390', 'ARMOR': '0.408', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.296', 'weapon2': '1.530', 'weapon3': '1.686', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 35577856. Throughput: 0: 4230.5. Samples: 8894090. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:00:02,794][52567] Avg episode reward: [(0, '1.883')] [2024-08-05 22:00:03,129][52803] DAMAGECOUNT value on done: 2342.0 [2024-08-05 22:00:03,138][52803] Sum rewards: -2.396, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.920', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'ARMOR': '0.056', 'AMMO3': '0.174', 'HITCOUNT': '0.500', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.371', 'weapon2': '1.450', 'weapon3': '2.064', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:03,260][52647] DAMAGECOUNT value on done: 2102.0 [2024-08-05 22:00:03,262][52647] Sum rewards: 6.798, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.510', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.070', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.347', 'weapon3': '1.668', 'weapon2': '1.780', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:03,351][52795] DAMAGECOUNT value on done: 2367.0 [2024-08-05 22:00:03,352][52795] Sum rewards: 4.020, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.184', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.230', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.904', 'DAMAGECOUNT': '1.305', 'weapon3': '1.624', 'weapon2': '1.862', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:03,471][52665] DAMAGECOUNT value on done: 3107.0 [2024-08-05 22:00:03,472][52665] Sum rewards: 0.962, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.066', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon4': '0.080', 'AMMO3': '0.090', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.840', 'weapon3': '1.528', 'weapon2': '1.870', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:03,575][52663] DAMAGECOUNT value on done: 2825.0 [2024-08-05 22:00:03,578][52663] Sum rewards: 3.310, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.529', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.065', 'WEAPON4': '0.150', 'weapon4': '0.360', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon2': '1.176', 'weapon3': '1.230', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:04,331][52667] DAMAGECOUNT value on done: 2444.0 [2024-08-05 22:00:04,331][52667] Sum rewards: 3.729, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.179', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.085', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.881', 'weapon3': '1.336', 'weapon2': '1.396', 'DAMAGECOUNT': '1.449', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:04,576][52811] DAMAGECOUNT value on done: 2175.0 [2024-08-05 22:00:04,577][52811] Sum rewards: 4.897, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.176', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO3': '0.082', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.678', 'DAMAGECOUNT': '1.794', 'weapon2': '1.912', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:04,606][52649] DAMAGECOUNT value on done: 1581.0 [2024-08-05 22:00:04,607][52649] Sum rewards: 0.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.450', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'weapon5': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.726', 'weapon3': '1.560', 'weapon2': '1.676', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:04,938][52662] DAMAGECOUNT value on done: 2725.0 [2024-08-05 22:00:04,938][52662] Sum rewards: 0.962, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.086', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.134', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'HITCOUNT': '0.430', 'ARMOR': '0.512', 'WEAPON3': '0.850', 'weapon2': '1.422', 'DAMAGECOUNT': '1.473', 'weapon3': '2.110', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:05,014][52669] DAMAGECOUNT value on done: 2860.0 [2024-08-05 22:00:05,014][52669] Sum rewards: 0.491, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.360', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.162', 'HITCOUNT': '0.240', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.724', 'weapon2': '1.788'} [2024-08-05 22:00:05,783][52820] DAMAGECOUNT value on done: 2323.0 [2024-08-05 22:00:05,785][52820] Sum rewards: 3.256, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.364', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO2': '0.031', 'AMMO3': '0.050', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.224', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.933', 'ARMOR': '0.967', 'weapon3': '1.086', 'weapon2': '1.398', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:06,147][52803] DAMAGECOUNT value on done: 2752.0 [2024-08-05 22:00:06,147][52803] Sum rewards: 2.695, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.641', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.180', 'weapon4': '0.180', 'ARMOR': '0.516', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.504', 'DAMAGECOUNT': '1.746', 'weapon3': '1.934', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:06,363][52665] DAMAGECOUNT value on done: 3344.0 [2024-08-05 22:00:06,367][52665] Sum rewards: 3.457, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.369', 'AMMO2': '0.006', 'AMMO4': '0.031', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'HITCOUNT': '0.570', 'WEAPON3': '0.950', 'weapon2': '1.538', 'DAMAGECOUNT': '2.004', 'weapon3': '2.240', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:06,366][52647] DAMAGECOUNT value on done: 2100.0 [2024-08-05 22:00:06,371][52647] Sum rewards: -0.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.526', 'AMMO2': '0.014', 'ARMOR': '0.030', 'AMMO4': '0.067', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.292', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.352', 'weapon3': '1.686'} [2024-08-05 22:00:06,635][52795] DAMAGECOUNT value on done: 2506.0 [2024-08-05 22:00:06,636][52795] Sum rewards: 2.885, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.076', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.115', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'weapon4': '0.450', 'weapon2': '0.502', 'ARMOR': '0.567', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.590', 'weapon3': '1.928', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:06,651][52650] Updated weights for policy 0, policy_version 4351 (0.0012) [2024-08-05 22:00:06,704][52667] DAMAGECOUNT value on done: 2290.0 [2024-08-05 22:00:06,704][52667] Sum rewards: -0.290, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.925', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'AMMO3': '0.131', 'HITCOUNT': '0.420', 'WEAPON3': '0.900', 'weapon2': '1.270', 'DAMAGECOUNT': '1.332', 'weapon3': '1.896', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:06,728][52663] DAMAGECOUNT value on done: 3416.0 [2024-08-05 22:00:06,728][52663] Sum rewards: 5.446, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.795', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.101', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.308', 'ARMOR': '0.494', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.614', 'weapon3': '1.656', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:07,584][52649] DAMAGECOUNT value on done: 2383.0 [2024-08-05 22:00:07,586][52649] Sum rewards: 0.826, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'weapon7': '0.068', 'AMMO3': '0.086', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.386', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.732', 'weapon2': '0.996', 'weapon3': '1.274', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16994.9). Total num frames: 35659776. Throughput: 0: 4218.9. Samples: 8919410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:00:07,794][52567] Avg episode reward: [(0, '1.894')] [2024-08-05 22:00:07,882][52811] DAMAGECOUNT value on done: 2150.0 [2024-08-05 22:00:07,882][52811] Sum rewards: -0.463, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.116', 'HITCOUNT': '0.250', 'ARMOR': '0.544', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.065', 'FRAGCOUNT': '1.500', 'weapon3': '1.774', 'weapon2': '1.836'} [2024-08-05 22:00:07,890][52669] DAMAGECOUNT value on done: 2945.0 [2024-08-05 22:00:07,890][52669] Sum rewards: 5.848, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.137', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.036', 'AMMO3': '0.050', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.196', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.350', 'weapon2': '0.722', 'weapon3': '1.114', 'DAMAGECOUNT': '1.539', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:08,973][52658] DAMAGECOUNT value on done: 1937.0 [2024-08-05 22:00:08,976][52658] Sum rewards: 0.119, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.160', 'weapon4': '0.280', 'DAMAGECOUNT': '0.477', 'ARMOR': '0.513', 'WEAPON3': '0.700', 'weapon2': '1.160', 'weapon3': '1.774', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:09,174][52820] DAMAGECOUNT value on done: 2794.0 [2024-08-05 22:00:09,175][52820] Sum rewards: 3.405, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'HITCOUNT': '0.240', 'weapon5': '0.252', 'HEALTH': '0.288', 'WEAPON3': '0.350', 'weapon4': '0.394', 'DAMAGECOUNT': '0.615', 'weapon3': '1.146', 'weapon2': '1.464', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:09,219][52647] DAMAGECOUNT value on done: 3167.0 [2024-08-05 22:00:09,220][52647] Sum rewards: 1.102, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.468', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.166', 'weapon4': '0.236', 'HITCOUNT': '0.270', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.870', 'ARMOR': '0.873', 'FRAGCOUNT': '1.000', 'weapon3': '1.294', 'weapon2': '1.326'} [2024-08-05 22:00:09,284][52803] DAMAGECOUNT value on done: 3050.0 [2024-08-05 22:00:09,286][52803] Sum rewards: 4.171, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.594', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.007', 'AMMO3': '0.112', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'weapon4': '0.452', 'WEAPON3': '0.750', 'ARMOR': '0.958', 'weapon2': '1.110', 'DAMAGECOUNT': '1.539', 'weapon3': '1.688', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:09,311][52665] DAMAGECOUNT value on done: 3228.0 [2024-08-05 22:00:09,312][52665] Sum rewards: 1.064, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.456', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.214', 'ARMOR': '0.440', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.542', 'DAMAGECOUNT': '1.725', 'weapon3': '1.740', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:09,527][52667] DAMAGECOUNT value on done: 2667.0 [2024-08-05 22:00:09,528][52667] Sum rewards: -1.997, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.564', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'weapon4': '0.072', 'AMMO3': '0.109', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.861', 'FRAGCOUNT': '1.000', 'weapon3': '1.436', 'weapon2': '1.788'} [2024-08-05 22:00:09,722][52663] DAMAGECOUNT value on done: 2239.0 [2024-08-05 22:00:10,088][52795] DAMAGECOUNT value on done: 2301.0 [2024-08-05 22:00:10,090][52795] Sum rewards: 0.363, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.562', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.198', 'HITCOUNT': '0.330', 'weapon5': '0.360', 'WEAPON3': '0.500', 'weapon3': '0.898', 'DAMAGECOUNT': '1.065', 'weapon2': '1.548', 'ARMOR': '1.758', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:10,542][52649] DAMAGECOUNT value on done: 2313.0 [2024-08-05 22:00:11,186][52669] DAMAGECOUNT value on done: 2659.0 [2024-08-05 22:00:11,187][52669] Sum rewards: 3.654, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.054', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.074', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'ARMOR': '0.890', 'DAMAGECOUNT': '0.963', 'weapon3': '1.498', 'weapon2': '1.690', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:11,500][52811] DAMAGECOUNT value on done: 2369.0 [2024-08-05 22:00:11,500][52811] Sum rewards: -0.909, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.508', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON1': '0.030', 'weapon6': '0.048', 'weapon5': '0.056', 'WEAPON6': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.350', 'ARMOR': '0.465', 'weapon2': '0.662', 'DAMAGECOUNT': '0.744', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '2.670'} [2024-08-05 22:00:11,524][52650] Updated weights for policy 0, policy_version 4361 (0.0026) [2024-08-05 22:00:11,781][52658] DAMAGECOUNT value on done: 2447.0 [2024-08-05 22:00:11,783][52658] Sum rewards: -4.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.490', 'ARMOR': '0.024', 'AMMO2': '0.036', 'AMMO3': '0.155', 'HITCOUNT': '0.180', 'AMMO4': '0.182', 'weapon4': '0.250', 'WEAPON4': '0.400', 'DAMAGECOUNT': '0.510', 'WEAPON3': '1.050', 'weapon2': '1.168', 'FRAGCOUNT': '2.000', 'weapon3': '2.106'} [2024-08-05 22:00:12,051][52665] DAMAGECOUNT value on done: 2240.0 [2024-08-05 22:00:12,150][52647] DAMAGECOUNT value on done: 2515.0 [2024-08-05 22:00:12,151][52647] Sum rewards: -0.837, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.410', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.089', 'HITCOUNT': '0.250', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon2': '1.144', 'weapon3': '1.386'} [2024-08-05 22:00:12,370][52803] DAMAGECOUNT value on done: 1936.0 [2024-08-05 22:00:12,372][52803] Sum rewards: 4.761, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.009', 'AMMO3': '0.040', 'AMMO4': '0.042', 'HEALTH': '0.231', 'WEAPON3': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.492', 'weapon3': '0.968', 'DAMAGECOUNT': '1.035', 'weapon2': '1.424', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:12,508][52820] DAMAGECOUNT value on done: 1827.0 [2024-08-05 22:00:12,510][52820] Sum rewards: 0.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.351', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'weapon5': '0.036', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.490', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon3': '1.482', 'weapon2': '1.586'} [2024-08-05 22:00:12,520][52667] DAMAGECOUNT value on done: 2695.0 [2024-08-05 22:00:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 16994.9). Total num frames: 35749888. Throughput: 0: 4213.6. Samples: 8944970. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 22:00:12,794][52567] Avg episode reward: [(0, '1.764')] [2024-08-05 22:00:12,893][52663] DAMAGECOUNT value on done: 2300.0 [2024-08-05 22:00:12,893][52663] Sum rewards: 2.427, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.744', 'weapon4': '0.004', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.498', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.852', 'weapon3': '1.304', 'weapon2': '1.436', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:13,239][52795] DAMAGECOUNT value on done: 3008.0 [2024-08-05 22:00:13,241][52795] Sum rewards: -1.708, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.828', 'AMMO2': '0.012', 'AMMO5': '0.013', 'weapon5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.125', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.595', 'DAMAGECOUNT': '0.840', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.160', 'weapon3': '1.776'} [2024-08-05 22:00:13,409][52649] DAMAGECOUNT value on done: 2217.0 [2024-08-05 22:00:13,410][52649] Sum rewards: 2.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.631', 'weapon5': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.334', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.131', 'weapon2': '1.340', 'ARMOR': '1.394', 'weapon3': '1.926', 'FRAGCOUNT': '2.500'} [2024-08-05 22:00:13,925][52664] DAMAGECOUNT value on done: 2834.0 [2024-08-05 22:00:13,927][52664] Sum rewards: 2.522, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.654', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'HITCOUNT': '0.460', 'weapon5': '0.518', 'WEAPON3': '0.550', 'ARMOR': '0.991', 'weapon2': '1.270', 'DAMAGECOUNT': '1.374', 'weapon3': '1.558', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:14,232][52669] DAMAGECOUNT value on done: 2645.0 [2024-08-05 22:00:14,241][52669] Sum rewards: 7.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.137', 'weapon6': '0.002', 'AMMO2': '0.003', 'weapon4': '0.006', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'WEAPON6': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.849', 'weapon3': '1.404', 'DAMAGECOUNT': '1.770', 'weapon2': '1.830', 'FRAGCOUNT': '7.000'} [2024-08-05 22:00:14,465][52647] DAMAGECOUNT value on done: 2723.0 [2024-08-05 22:00:14,466][52647] Sum rewards: 1.508, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.268', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'weapon5': '0.176', 'weapon4': '0.190', 'HITCOUNT': '0.390', 'WEAPON3': '0.950', 'weapon2': '1.370', 'DAMAGECOUNT': '1.575', 'weapon3': '2.060', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:14,612][52811] DAMAGECOUNT value on done: 2003.0 [2024-08-05 22:00:14,612][52811] Sum rewards: -1.447, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.514', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.200', 'ARMOR': '0.498', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.750', 'weapon3': '1.472', 'weapon2': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:14,710][52658] DAMAGECOUNT value on done: 1893.0 [2024-08-05 22:00:14,711][52658] Sum rewards: 1.616, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.586', 'AMMO2': '0.013', 'weapon4': '0.018', 'ARMOR': '0.037', 'AMMO4': '0.065', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.185', 'weapon2': '1.516', 'weapon3': '1.614', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:15,245][52665] DAMAGECOUNT value on done: 3407.0 [2024-08-05 22:00:15,249][52665] Sum rewards: 0.946, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.336', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.101', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'HITCOUNT': '0.480', 'weapon4': '0.496', 'WEAPON3': '0.650', 'weapon2': '0.866', 'weapon3': '1.830', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '3.500'} [2024-08-05 22:00:15,489][52667] DAMAGECOUNT value on done: 2709.0 [2024-08-05 22:00:15,489][52667] Sum rewards: -1.633, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.606', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.128', 'HITCOUNT': '0.220', 'ARMOR': '0.840', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.020', 'weapon2': '1.528', 'FRAGCOUNT': '2.000', 'weapon3': '2.138'} [2024-08-05 22:00:15,683][52803] DAMAGECOUNT value on done: 2068.0 [2024-08-05 22:00:15,685][52803] Sum rewards: 4.274, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.080', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.084', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.338', 'weapon3': '1.384', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:15,902][52820] DAMAGECOUNT value on done: 3549.0 [2024-08-05 22:00:15,907][52820] Sum rewards: 3.402, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.546', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.024', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.064', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '1.000', 'weapon2': '1.414', 'DAMAGECOUNT': '1.554', 'weapon3': '2.178', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:15,929][52650] Updated weights for policy 0, policy_version 4371 (0.0042) [2024-08-05 22:00:16,171][52663] DAMAGECOUNT value on done: 2825.0 [2024-08-05 22:00:16,172][52663] Sum rewards: 4.141, reward structure: {'DEATHCOUNT': '-6.750', 'weapon4': '0.014', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.135', 'HEALTH': '0.424', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.557', 'weapon2': '1.758', 'weapon3': '1.758', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:16,539][52649] DAMAGECOUNT value on done: 2643.0 [2024-08-05 22:00:16,539][52649] Sum rewards: 0.452, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.755', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'HITCOUNT': '0.140', 'weapon5': '0.278', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.507', 'weapon3': '0.708', 'ARMOR': '0.871', 'FRAGCOUNT': '1.000', 'weapon2': '1.704'} [2024-08-05 22:00:16,640][52795] DAMAGECOUNT value on done: 2531.0 [2024-08-05 22:00:16,641][52795] Sum rewards: 1.578, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.894', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'ARMOR': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'HITCOUNT': '0.540', 'WEAPON3': '1.050', 'weapon2': '1.140', 'DAMAGECOUNT': '1.944', 'weapon3': '2.330', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:16,972][52664] DAMAGECOUNT value on done: 2651.0 [2024-08-05 22:00:16,973][52664] Sum rewards: 0.391, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.218', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.095', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.316', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon3': '1.398', 'weapon2': '1.466'} [2024-08-05 22:00:17,217][52658] DAMAGECOUNT value on done: 2354.0 [2024-08-05 22:00:17,558][52669] DAMAGECOUNT value on done: 2813.0 [2024-08-05 22:00:17,558][52669] Sum rewards: 1.918, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.851', 'AMMO2': '0.027', 'weapon7': '0.080', 'AMMO3': '0.083', 'ARMOR': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.134', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.388', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.004', 'DAMAGECOUNT': '1.407', 'weapon3': '1.432'} [2024-08-05 22:00:17,608][52647] DAMAGECOUNT value on done: 2358.0 [2024-08-05 22:00:17,609][52647] Sum rewards: 1.613, reward structure: {'DEATHCOUNT': '-4.500', 'weapon4': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.078', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.110', 'WEAPON3': '0.350', 'HEALTH': '0.382', 'DAMAGECOUNT': '0.450', 'ARMOR': '0.492', 'FRAGCOUNT': '1.000', 'weapon3': '1.394', 'weapon2': '1.626'} [2024-08-05 22:00:17,679][52667] DAMAGECOUNT value on done: 3052.0 [2024-08-05 22:00:17,679][52667] Sum rewards: 3.658, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.722', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.148', 'WEAPON5': '0.150', 'ARMOR': '0.497', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.134', 'DAMAGECOUNT': '1.890', 'weapon3': '2.246', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:17,794][52567] Fps is (10 sec: 16383.5, 60 sec: 16793.6, 300 sec: 16967.1). Total num frames: 35823616. Throughput: 0: 4216.2. Samples: 8957660. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 22:00:17,795][52567] Avg episode reward: [(0, '1.702')] [2024-08-05 22:00:17,946][52811] DAMAGECOUNT value on done: 2518.0 [2024-08-05 22:00:17,947][52811] Sum rewards: 3.755, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'ARMOR': '0.895', 'weapon3': '1.164', 'DAMAGECOUNT': '1.815', 'weapon2': '1.964', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:18,018][52665] DAMAGECOUNT value on done: 2892.0 [2024-08-05 22:00:18,019][52665] Sum rewards: -0.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon7': '0.052', 'ARMOR': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.500', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.162', 'DAMAGECOUNT': '1.806', 'weapon3': '2.116'} [2024-08-05 22:00:18,877][52803] DAMAGECOUNT value on done: 2122.0 [2024-08-05 22:00:18,877][52803] Sum rewards: -1.384, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.757', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.009', 'weapon4': '0.020', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.204', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.843', 'DAMAGECOUNT': '1.110', 'weapon2': '1.572', 'weapon3': '1.812'} [2024-08-05 22:00:19,243][52663] DAMAGECOUNT value on done: 2226.0 [2024-08-05 22:00:19,251][52663] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.267', 'AMMO2': '0.023', 'weapon4': '0.026', 'AMMO4': '0.117', 'AMMO3': '0.132', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.900', 'ARMOR': '1.006', 'weapon2': '1.462', 'weapon3': '2.040', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:19,418][52820] DAMAGECOUNT value on done: 2251.0 [2024-08-05 22:00:19,419][52820] Sum rewards: -0.729, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.892', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.248', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'ARMOR': '0.535', 'DAMAGECOUNT': '0.957', 'weapon2': '1.010', 'WEAPON3': '1.050', 'weapon3': '2.418', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:19,505][52649] DAMAGECOUNT value on done: 2726.0 [2024-08-05 22:00:19,508][52649] Sum rewards: 0.495, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.833', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'ARMOR': '0.010', 'AMMO3': '0.088', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.194', 'DAMAGECOUNT': '1.464', 'weapon3': '1.494', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:19,757][52658] DAMAGECOUNT value on done: 2076.0 [2024-08-05 22:00:19,758][52658] Sum rewards: 3.555, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.103', 'ARMOR': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.128', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.380', 'weapon2': '0.556', 'WEAPON3': '0.600', 'HEALTH': '0.704', 'DAMAGECOUNT': '1.416', 'weapon3': '2.168', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:19,870][52795] DAMAGECOUNT value on done: 2546.0 [2024-08-05 22:00:19,871][52795] Sum rewards: 1.306, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.097', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon3': '1.710', 'DAMAGECOUNT': '1.860', 'weapon2': '1.914', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:20,039][52664] DAMAGECOUNT value on done: 3182.0 [2024-08-05 22:00:20,040][52664] Sum rewards: 5.628, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.788', 'AMMO2': '0.008', 'ARMOR': '0.040', 'AMMO4': '0.041', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon2': '0.680', 'weapon3': '1.564', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:20,226][52669] DAMAGECOUNT value on done: 2704.0 [2024-08-05 22:00:20,339][52667] DAMAGECOUNT value on done: 3202.0 [2024-08-05 22:00:20,341][52667] Sum rewards: 3.931, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.748', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.083', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'ARMOR': '0.860', 'weapon3': '1.206', 'DAMAGECOUNT': '1.350', 'weapon2': '1.614', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:20,714][52647] DAMAGECOUNT value on done: 2678.0 [2024-08-05 22:00:20,714][52647] Sum rewards: 5.575, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.902', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.105', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.862', 'weapon2': '1.528', 'DAMAGECOUNT': '1.911', 'weapon3': '2.024', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:21,113][52650] Updated weights for policy 0, policy_version 4381 (0.0013) [2024-08-05 22:00:21,174][52811] DAMAGECOUNT value on done: 2068.0 [2024-08-05 22:00:21,175][52811] Sum rewards: 1.192, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.140', 'HITCOUNT': '0.340', 'HEALTH': '0.414', 'WEAPON3': '0.500', 'ARMOR': '0.884', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.032', 'weapon2': '1.452', 'weapon3': '1.758'} [2024-08-05 22:00:21,328][52665] DAMAGECOUNT value on done: 3064.0 [2024-08-05 22:00:21,329][52665] Sum rewards: 2.926, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.026', 'AMMO3': '0.061', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.310', 'HEALTH': '0.394', 'WEAPON3': '0.400', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.855', 'weapon2': '0.916', 'weapon3': '1.426', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:21,981][52663] DAMAGECOUNT value on done: 2649.0 [2024-08-05 22:00:21,981][52663] Sum rewards: 3.560, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'AMMO4': '0.046', 'HEALTH': '0.060', 'AMMO3': '0.091', 'ARMOR': '0.092', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon2': '0.968', 'DAMAGECOUNT': '1.305', 'weapon3': '1.328', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:22,166][52803] DAMAGECOUNT value on done: 1522.0 [2024-08-05 22:00:22,168][52803] Sum rewards: -1.391, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.796', 'AMMO2': '0.031', 'AMMO3': '0.091', 'HITCOUNT': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'DAMAGECOUNT': '0.285', 'weapon4': '0.382', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.178', 'weapon3': '1.734'} [2024-08-05 22:00:22,556][52649] DAMAGECOUNT value on done: 2687.0 [2024-08-05 22:00:22,556][52649] Sum rewards: 2.695, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.928', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.138', 'HITCOUNT': '0.340', 'weapon5': '0.374', 'weapon4': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.878', 'DAMAGECOUNT': '1.482', 'weapon3': '1.972', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:22,579][52658] DAMAGECOUNT value on done: 2177.0 [2024-08-05 22:00:22,584][52658] Sum rewards: 3.646, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.300', 'AMMO4': '-0.086', 'AMMO2': '-0.017', 'AMMO5': '0.007', 'AMMO3': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.252', 'HITCOUNT': '0.270', 'ARMOR': '0.446', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.975', 'weapon3': '1.220', 'weapon2': '1.616', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:22,608][52820] DAMAGECOUNT value on done: 2580.0 [2024-08-05 22:00:22,795][52567] Fps is (10 sec: 16383.5, 60 sec: 16930.0, 300 sec: 16994.9). Total num frames: 35913728. Throughput: 0: 4226.6. Samples: 8983230. Policy #0 lag: (min: 0.0, avg: 4.1, max: 10.0) [2024-08-05 22:00:22,795][52567] Avg episode reward: [(0, '1.491')] [2024-08-05 22:00:22,961][52669] DAMAGECOUNT value on done: 2558.0 [2024-08-05 22:00:22,961][52669] Sum rewards: 4.626, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon4': '0.118', 'HEALTH': '0.230', 'HITCOUNT': '0.250', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.810', 'weapon3': '1.064', 'weapon2': '1.390', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:23,211][52667] DAMAGECOUNT value on done: 2726.0 [2024-08-05 22:00:23,212][52667] Sum rewards: 1.391, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.906', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'weapon5': '0.148', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'ARMOR': '0.855', 'DAMAGECOUNT': '0.990', 'weapon3': '1.330', 'FRAGCOUNT': '2.000', 'weapon2': '2.046'} [2024-08-05 22:00:23,370][52795] DAMAGECOUNT value on done: 2294.0 [2024-08-05 22:00:23,372][52795] Sum rewards: 1.261, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.892', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.058', 'ARMOR': '0.080', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.428', 'DAMAGECOUNT': '1.449', 'weapon3': '2.172', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:23,419][52664] DAMAGECOUNT value on done: 2004.0 [2024-08-05 22:00:24,079][52647] DAMAGECOUNT value on done: 2589.0 [2024-08-05 22:00:24,082][52647] Sum rewards: 2.521, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.092', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.311', 'weapon3': '1.442', 'weapon2': '1.730', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:24,388][52811] DAMAGECOUNT value on done: 3091.0 [2024-08-05 22:00:24,392][52811] Sum rewards: 0.011, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.322', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'HITCOUNT': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.172', 'weapon4': '0.216', 'DAMAGECOUNT': '0.471', 'ARMOR': '0.525', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.222', 'weapon3': '1.658'} [2024-08-05 22:00:24,421][52665] DAMAGECOUNT value on done: 2372.0 [2024-08-05 22:00:24,422][52665] Sum rewards: 1.861, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.903', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'ARMOR': '0.036', 'AMMO3': '0.060', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.404', 'weapon3': '1.424', 'weapon2': '1.748'} [2024-08-05 22:00:24,472][52663] DAMAGECOUNT value on done: 2514.0 [2024-08-05 22:00:25,120][52658] DAMAGECOUNT value on done: 2488.0 [2024-08-05 22:00:25,121][52658] Sum rewards: 1.309, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.017', 'weapon4': '0.028', 'HEALTH': '0.052', 'AMMO3': '0.060', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.906', 'ARMOR': '0.940', 'FRAGCOUNT': '1.000', 'weapon2': '1.196', 'weapon3': '1.456'} [2024-08-05 22:00:25,438][52650] Updated weights for policy 0, policy_version 4391 (0.0023) [2024-08-05 22:00:25,479][52803] DAMAGECOUNT value on done: 3245.0 [2024-08-05 22:00:25,482][52803] Sum rewards: 4.728, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.031', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.018', 'weapon5': '0.018', 'weapon7': '0.068', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.490', 'weapon2': '0.726', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.872', 'weapon3': '2.008', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:25,740][52669] DAMAGECOUNT value on done: 2867.0 [2024-08-05 22:00:25,740][52669] Sum rewards: 3.408, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.995', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.075', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.445', 'weapon3': '1.032', 'DAMAGECOUNT': '1.170', 'weapon2': '1.398', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:25,776][52667] DAMAGECOUNT value on done: 2706.0 [2024-08-05 22:00:25,822][52820] DAMAGECOUNT value on done: 2364.0 [2024-08-05 22:00:25,825][52820] Sum rewards: 2.146, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.009', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.059', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon5': '0.450', 'weapon3': '0.884', 'DAMAGECOUNT': '0.960', 'weapon2': '1.742', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:25,952][52649] DAMAGECOUNT value on done: 1840.0 [2024-08-05 22:00:25,954][52649] Sum rewards: -2.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon4': '0.086', 'ARMOR': '0.096', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.260', 'DAMAGECOUNT': '0.825', 'WEAPON3': '0.950', 'weapon2': '1.394', 'FRAGCOUNT': '2.000', 'weapon3': '2.300'} [2024-08-05 22:00:26,705][52795] DAMAGECOUNT value on done: 2457.0 [2024-08-05 22:00:26,707][52795] Sum rewards: 3.763, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.062', 'weapon7': '0.066', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'weapon2': '1.084', 'weapon3': '1.480', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:26,770][52664] DAMAGECOUNT value on done: 3403.0 [2024-08-05 22:00:26,772][52664] Sum rewards: 0.557, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.138', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'HITCOUNT': '0.300', 'ARMOR': '0.526', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.065', 'weapon2': '1.382', 'weapon3': '1.604', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:27,043][52665] DAMAGECOUNT value on done: 3005.0 [2024-08-05 22:00:27,044][52665] Sum rewards: 0.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.220', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'weapon7': '0.052', 'AMMO3': '0.090', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.471', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.200', 'weapon3': '1.546', 'weapon2': '2.076'} [2024-08-05 22:00:27,187][52671] DAMAGECOUNT value on done: 3151.0 [2024-08-05 22:00:27,189][52671] Sum rewards: 6.358, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.159', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.106', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.712', 'weapon3': '1.930', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:27,255][52647] DAMAGECOUNT value on done: 2641.0 [2024-08-05 22:00:27,255][52647] Sum rewards: -3.426, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.478', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.040', 'AMMO4': '0.041', 'ARMOR': '0.120', 'weapon4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.768', 'weapon2': '0.952', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon3': '2.208'} [2024-08-05 22:00:27,564][52811] DAMAGECOUNT value on done: 2590.0 [2024-08-05 22:00:27,567][52811] Sum rewards: 5.660, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.818', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'ARMOR': '1.240', 'weapon3': '1.260', 'weapon2': '1.898', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '4.500'} [2024-08-05 22:00:27,590][52663] DAMAGECOUNT value on done: 2946.0 [2024-08-05 22:00:27,593][52663] Sum rewards: 1.472, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.372', 'AMMO4': '-0.148', 'AMMO2': '-0.030', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.164', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '0.900', 'weapon3': '0.930', 'DAMAGECOUNT': '1.476', 'weapon2': '2.182', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:27,800][52567] Fps is (10 sec: 18012.3, 60 sec: 16928.5, 300 sec: 16994.6). Total num frames: 36003840. Throughput: 0: 4234.6. Samples: 9008880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:00:27,800][52567] Avg episode reward: [(0, '1.407')] [2024-08-05 22:00:27,804][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004395_36003840.pth... [2024-08-05 22:00:27,943][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000003898_31932416.pth [2024-08-05 22:00:28,560][52649] DAMAGECOUNT value on done: 3293.0 [2024-08-05 22:00:28,560][52649] Sum rewards: 2.012, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.582', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'ARMOR': '0.072', 'AMMO3': '0.075', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.017', 'weapon3': '1.470', 'weapon2': '1.592', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:28,772][52669] DAMAGECOUNT value on done: 2016.0 [2024-08-05 22:00:28,774][52669] Sum rewards: 2.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.080', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon4': '0.022', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.959', 'DAMAGECOUNT': '1.086', 'weapon2': '1.626', 'weapon3': '1.916', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:28,917][52803] DAMAGECOUNT value on done: 2501.0 [2024-08-05 22:00:28,920][52803] Sum rewards: 6.218, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.047', 'ARMOR': '0.004', 'AMMO2': '0.037', 'AMMO3': '0.085', 'AMMO4': '0.183', 'weapon4': '0.290', 'WEAPON4': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon3': '1.340', 'weapon2': '1.416', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:28,953][52658] DAMAGECOUNT value on done: 2346.0 [2024-08-05 22:00:28,955][52658] Sum rewards: -1.954, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.727', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon4': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.250', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.602', 'weapon3': '1.908', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:29,347][52820] DAMAGECOUNT value on done: 2420.0 [2024-08-05 22:00:29,349][52820] Sum rewards: 0.593, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.620', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.102', 'HITCOUNT': '0.320', 'ARMOR': '0.543', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.155', 'weapon2': '1.402', 'weapon3': '1.838', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:29,524][52664] DAMAGECOUNT value on done: 2318.0 [2024-08-05 22:00:29,525][52664] Sum rewards: 4.605, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.028', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.141', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'ARMOR': '0.518', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.957', 'weapon2': '1.710', 'weapon3': '1.966', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:29,733][52667] DAMAGECOUNT value on done: 3642.0 [2024-08-05 22:00:29,734][52667] Sum rewards: 1.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.662', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.040', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.330', 'ARMOR': '0.436', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.119', 'weapon2': '1.124', 'weapon3': '1.932', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:29,903][52647] DAMAGECOUNT value on done: 2602.0 [2024-08-05 22:00:29,906][52647] Sum rewards: -0.380, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.180', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO3': '0.113', 'AMMO4': '0.198', 'WEAPON4': '0.400', 'ARMOR': '0.517', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon3': '1.656', 'weapon2': '1.772', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:29,995][52795] DAMAGECOUNT value on done: 2130.0 [2024-08-05 22:00:29,995][52795] Sum rewards: 5.818, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.061', 'AMMO3': '0.079', 'HEALTH': '0.092', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.442', 'weapon2': '2.066', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:30,188][52671] DAMAGECOUNT value on done: 2940.0 [2024-08-05 22:00:30,544][52663] DAMAGECOUNT value on done: 2032.0 [2024-08-05 22:00:30,545][52663] Sum rewards: 0.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.633', 'AMMO2': '0.015', 'ARMOR': '0.072', 'AMMO4': '0.073', 'AMMO3': '0.126', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.260', 'weapon2': '1.366', 'weapon3': '1.608', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:30,768][52650] Updated weights for policy 0, policy_version 4401 (0.0027) [2024-08-05 22:00:31,873][52649] DAMAGECOUNT value on done: 2775.0 [2024-08-05 22:00:31,874][52649] Sum rewards: -3.873, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.220', 'AMMO5': '0.018', 'AMMO2': '0.025', 'ARMOR': '0.072', 'weapon5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.182', 'weapon4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'FRAGCOUNT': '0.500', 'WEAPON3': '1.100', 'weapon2': '1.212', 'DAMAGECOUNT': '1.395', 'weapon3': '2.260'} [2024-08-05 22:00:31,893][52658] DAMAGECOUNT value on done: 2090.0 [2024-08-05 22:00:31,895][52658] Sum rewards: 0.379, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.441', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.518', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.834', 'ARMOR': '0.939', 'weapon2': '1.210', 'weapon3': '1.416', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:32,063][52669] DAMAGECOUNT value on done: 3091.0 [2024-08-05 22:00:32,064][52669] Sum rewards: -1.268, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.220', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.122', 'HITCOUNT': '0.320', 'ARMOR': '0.500', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.176', 'weapon2': '1.582', 'weapon3': '1.848', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:32,267][52664] DAMAGECOUNT value on done: 3241.0 [2024-08-05 22:00:32,269][52664] Sum rewards: 5.715, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.708', 'AMMO5': '0.003', 'AMMO2': '0.014', 'ARMOR': '0.020', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.168', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '1.398', 'weapon3': '1.742', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:32,396][52667] DAMAGECOUNT value on done: 2838.0 [2024-08-05 22:00:32,397][52667] Sum rewards: 2.450, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.683', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO3': '0.125', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.026', 'weapon2': '1.374', 'weapon3': '2.166', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:32,486][52647] DAMAGECOUNT value on done: 2759.0 [2024-08-05 22:00:32,486][52647] Sum rewards: 2.567, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.414', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.282', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'ARMOR': '0.469', 'DAMAGECOUNT': '0.801', 'weapon2': '0.840', 'weapon3': '1.432', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:32,637][52659] DAMAGECOUNT value on done: 2814.0 [2024-08-05 22:00:32,637][52659] Sum rewards: -1.411, reward structure: {'DEATHCOUNT': '-8.250', 'weapon4': '0.014', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.100', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.480', 'HEALTH': '0.524', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.668', 'weapon2': '1.770'} [2024-08-05 22:00:32,641][52820] DAMAGECOUNT value on done: 3021.0 [2024-08-05 22:00:32,641][52820] Sum rewards: 2.252, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.162', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.280', 'ARMOR': '0.840', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.110', 'weapon2': '1.378', 'weapon3': '1.990', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:32,794][52567] Fps is (10 sec: 17203.9, 60 sec: 16930.1, 300 sec: 16994.9). Total num frames: 36085760. Throughput: 0: 4226.5. Samples: 9021290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:00:32,795][52567] Avg episode reward: [(0, '1.279')] [2024-08-05 22:00:32,939][52671] DAMAGECOUNT value on done: 1949.0 [2024-08-05 22:00:32,940][52671] Sum rewards: 4.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.520', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO3': '0.080', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.724', 'weapon3': '1.804', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:33,411][52795] DAMAGECOUNT value on done: 2216.0 [2024-08-05 22:00:33,412][52795] Sum rewards: 1.116, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.910', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'weapon4': '0.226', 'HITCOUNT': '0.270', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.819', 'weapon3': '0.950', 'weapon2': '1.060', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:33,986][52663] DAMAGECOUNT value on done: 3329.0 [2024-08-05 22:00:33,986][52663] Sum rewards: 2.587, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.325', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO3': '0.040', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.660', 'weapon3': '0.694', 'weapon2': '1.498', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:34,617][52664] DAMAGECOUNT value on done: 2588.0 [2024-08-05 22:00:34,617][52664] Sum rewards: 2.875, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.041', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'weapon4': '0.024', 'weapon5': '0.076', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'ARMOR': '0.887', 'DAMAGECOUNT': '1.350', 'weapon2': '1.422', 'weapon3': '1.514', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:34,796][52647] DAMAGECOUNT value on done: 2332.0 [2024-08-05 22:00:34,796][52647] Sum rewards: 1.078, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'AMMO4': '0.195', 'HITCOUNT': '0.410', 'ARMOR': '0.428', 'weapon4': '0.456', 'WEAPON3': '0.500', 'HEALTH': '0.724', 'DAMAGECOUNT': '1.104', 'weapon3': '1.442', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:34,803][52658] DAMAGECOUNT value on done: 2629.0 [2024-08-05 22:00:34,804][52658] Sum rewards: 2.285, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.076', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.094', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'ARMOR': '0.891', 'weapon2': '1.310', 'DAMAGECOUNT': '1.374', 'weapon3': '1.602', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:35,105][52649] DAMAGECOUNT value on done: 2036.0 [2024-08-05 22:00:35,106][52649] Sum rewards: -2.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.000', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.380', 'ARMOR': '0.479', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.215', 'weapon2': '1.482', 'weapon3': '1.984', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:35,392][52667] DAMAGECOUNT value on done: 3535.0 [2024-08-05 22:00:35,393][52667] Sum rewards: 4.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.182', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.121', 'ARMOR': '0.492', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.522', 'weapon3': '2.272', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:35,455][52659] DAMAGECOUNT value on done: 2977.0 [2024-08-05 22:00:35,456][52659] Sum rewards: -0.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.823', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.950', 'weapon2': '1.442', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '2.000', 'weapon3': '2.224'} [2024-08-05 22:00:35,517][52650] Updated weights for policy 0, policy_version 4411 (0.0021) [2024-08-05 22:00:35,718][52671] DAMAGECOUNT value on done: 2706.0 [2024-08-05 22:00:36,001][52820] DAMAGECOUNT value on done: 2515.0 [2024-08-05 22:00:36,004][52820] Sum rewards: 1.234, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.932', 'AMMO2': '0.006', 'ARMOR': '0.028', 'AMMO4': '0.029', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.196', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.750', 'weapon2': '1.190', 'weapon3': '1.926', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:36,884][52663] DAMAGECOUNT value on done: 2189.0 [2024-08-05 22:00:36,896][52663] Sum rewards: 0.607, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.415', 'AMMO4': '-0.099', 'AMMO2': '-0.020', 'AMMO5': '0.010', 'AMMO3': '0.046', 'WEAPON5': '0.100', 'HITCOUNT': '0.150', 'weapon5': '0.212', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.458', 'weapon3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.544'} [2024-08-05 22:00:37,396][52664] DAMAGECOUNT value on done: 3549.0 [2024-08-05 22:00:37,397][52664] Sum rewards: 0.704, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.354', 'AMMO2': '0.001', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.007', 'weapon4': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'HITCOUNT': '0.540', 'ARMOR': '0.898', 'WEAPON3': '1.050', 'weapon2': '1.570', 'weapon3': '2.056', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:37,620][52647] DAMAGECOUNT value on done: 2486.0 [2024-08-05 22:00:37,621][52647] Sum rewards: -0.332, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.052', 'AMMO4': '0.099', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.269', 'HITCOUNT': '0.300', 'ARMOR': '0.518', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon2': '1.150', 'FRAGCOUNT': '2.000', 'weapon3': '2.128'} [2024-08-05 22:00:37,794][52567] Fps is (10 sec: 16393.7, 60 sec: 16793.6, 300 sec: 16994.9). Total num frames: 36167680. Throughput: 0: 4232.9. Samples: 9047000. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 22:00:37,794][52567] Avg episode reward: [(0, '1.295')] [2024-08-05 22:00:37,967][52659] DAMAGECOUNT value on done: 3193.0 [2024-08-05 22:00:37,968][52659] Sum rewards: 3.853, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.924', 'AMMO2': '0.002', 'ARMOR': '0.008', 'AMMO4': '0.012', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.340', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon2': '1.428', 'weapon3': '1.564', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:38,073][52658] DAMAGECOUNT value on done: 2731.0 [2024-08-05 22:00:38,073][52658] Sum rewards: 2.052, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.662', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.250', 'weapon4': '0.286', 'WEAPON3': '0.650', 'ARMOR': '0.932', 'DAMAGECOUNT': '0.957', 'weapon2': '1.502', 'weapon3': '1.876', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:38,227][52671] DAMAGECOUNT value on done: 2702.0 [2024-08-05 22:00:38,230][52671] Sum rewards: 5.397, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.832', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.091', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.933', 'weapon3': '1.648', 'weapon2': '1.748', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:38,277][52649] DAMAGECOUNT value on done: 2482.0 [2024-08-05 22:00:38,278][52649] Sum rewards: 0.895, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.616', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.054', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'HITCOUNT': '0.270', 'WEAPON4': '0.300', 'ARMOR': '0.521', 'WEAPON3': '0.600', 'weapon4': '0.604', 'DAMAGECOUNT': '1.026', 'weapon2': '1.054', 'weapon3': '1.758', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:38,680][52667] DAMAGECOUNT value on done: 2436.0 [2024-08-05 22:00:38,682][52667] Sum rewards: -1.513, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.210', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'ARMOR': '0.876', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.008', 'weapon3': '1.440', 'weapon2': '1.478'} [2024-08-05 22:00:38,976][52668] DAMAGECOUNT value on done: 2860.0 [2024-08-05 22:00:38,976][52668] Sum rewards: 0.946, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.490', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'ARMOR': '0.052', 'AMMO3': '0.101', 'HITCOUNT': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.789', 'weapon2': '1.130', 'FRAGCOUNT': '2.000', 'weapon3': '2.024'} [2024-08-05 22:00:39,128][52820] DAMAGECOUNT value on done: 2126.0 [2024-08-05 22:00:39,136][52820] Sum rewards: 0.366, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon5': '0.068', 'ARMOR': '0.072', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.150', 'HITCOUNT': '0.330', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.128', 'weapon2': '1.502', 'weapon3': '1.946'} [2024-08-05 22:00:39,979][52663] DAMAGECOUNT value on done: 2404.0 [2024-08-05 22:00:39,980][52663] Sum rewards: 3.009, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.612', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.036', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'ARMOR': '0.855', 'weapon2': '1.040', 'DAMAGECOUNT': '1.095', 'weapon3': '1.110', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:40,025][52664] DAMAGECOUNT value on done: 2629.0 [2024-08-05 22:00:40,029][52664] Sum rewards: 5.367, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.036', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.082', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'weapon3': '1.288', 'weapon2': '1.448', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:40,248][52650] Updated weights for policy 0, policy_version 4421 (0.0012) [2024-08-05 22:00:40,358][52647] DAMAGECOUNT value on done: 2883.0 [2024-08-05 22:00:40,360][52647] Sum rewards: -2.034, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.549', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.130', 'weapon4': '0.160', 'weapon5': '0.240', 'DAMAGECOUNT': '0.315', 'ARMOR': '0.491', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.140', 'weapon3': '1.922'} [2024-08-05 22:00:41,053][52649] DAMAGECOUNT value on done: 1533.0 [2024-08-05 22:00:41,055][52649] Sum rewards: -0.475, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO3': '0.122', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.810', 'weapon3': '1.444', 'weapon2': '2.054', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:41,146][52658] DAMAGECOUNT value on done: 2922.0 [2024-08-05 22:00:41,150][52658] Sum rewards: 4.432, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.550', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.426', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'ARMOR': '0.914', 'weapon2': '1.424', 'weapon3': '1.446', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:41,283][52659] DAMAGECOUNT value on done: 2975.0 [2024-08-05 22:00:41,284][52659] Sum rewards: -1.861, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.208', 'AMMO2': '0.005', 'weapon7': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.024', 'weapon5': '0.056', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.100', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.459', 'DAMAGECOUNT': '0.945', 'WEAPON3': '1.000', 'weapon2': '1.470', 'FRAGCOUNT': '2.000', 'weapon3': '2.120'} [2024-08-05 22:00:41,450][52668] DAMAGECOUNT value on done: 2458.0 [2024-08-05 22:00:41,450][52668] Sum rewards: -0.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.075', 'AMMO4': '0.080', 'ARMOR': '0.092', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon4': '0.296', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.810', 'weapon2': '1.014', 'weapon3': '1.156', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:41,600][52671] DAMAGECOUNT value on done: 2748.0 [2024-08-05 22:00:41,701][52667] DAMAGECOUNT value on done: 2612.0 [2024-08-05 22:00:41,703][52667] Sum rewards: 2.563, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.720', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'ARMOR': '0.863', 'weapon2': '1.474', 'DAMAGECOUNT': '1.908', 'weapon3': '1.966', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:41,898][52660] DAMAGECOUNT value on done: 2475.0 [2024-08-05 22:00:41,907][52660] Sum rewards: -1.590, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.698', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.274', 'HITCOUNT': '0.380', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.233', 'weapon2': '1.674', 'weapon3': '1.918', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:42,411][52820] DAMAGECOUNT value on done: 1889.0 [2024-08-05 22:00:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 36265984. Throughput: 0: 4238.4. Samples: 9072500. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:00:42,794][52567] Avg episode reward: [(0, '1.370')] [2024-08-05 22:00:43,016][52663] DAMAGECOUNT value on done: 2144.0 [2024-08-05 22:00:43,018][52663] Sum rewards: -1.645, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'weapon7': '0.022', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.139', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.246', 'HITCOUNT': '0.280', 'WEAPON4': '0.300', 'ARMOR': '0.508', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.020', 'weapon2': '1.292', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:43,480][52664] DAMAGECOUNT value on done: 2035.0 [2024-08-05 22:00:43,481][52664] Sum rewards: 1.491, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.295', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.048', 'ARMOR': '0.076', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.126', 'HITCOUNT': '0.240', 'weapon4': '0.342', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.819', 'weapon2': '1.188', 'weapon3': '1.776', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:44,011][52658] DAMAGECOUNT value on done: 2085.0 [2024-08-05 22:00:44,012][52658] Sum rewards: 2.670, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.256', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO4': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'ARMOR': '0.515', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.269', 'weapon2': '1.452', 'weapon3': '1.846', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:44,188][52649] DAMAGECOUNT value on done: 2822.0 [2024-08-05 22:00:44,192][52649] Sum rewards: 1.990, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.681', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.380', 'ARMOR': '0.491', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.179', 'weapon2': '1.484', 'weapon3': '1.878', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:44,479][52659] DAMAGECOUNT value on done: 2658.0 [2024-08-05 22:00:44,481][52659] Sum rewards: 2.758, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.115', 'ARMOR': '0.145', 'weapon7': '0.258', 'AMMO6': '0.280', 'AMMO7': '0.280', 'WEAPON4': '0.300', 'HITCOUNT': '0.370', 'WEAPON7': '0.400', 'weapon4': '0.484', 'WEAPON3': '0.750', 'weapon2': '0.950', 'DAMAGECOUNT': '1.134', 'weapon3': '1.896', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:44,538][52668] DAMAGECOUNT value on done: 2687.0 [2024-08-05 22:00:44,539][52668] Sum rewards: 0.832, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.203', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.330', 'ARMOR': '0.591', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.095', 'weapon2': '1.166', 'weapon3': '1.902'} [2024-08-05 22:00:44,594][52667] DAMAGECOUNT value on done: 2677.0 [2024-08-05 22:00:44,595][52667] Sum rewards: 3.079, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.170', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.020', 'AMMO4': '0.082', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.238', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'weapon5': '0.382', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.990', 'weapon2': '1.224', 'weapon3': '1.588', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:44,775][52671] DAMAGECOUNT value on done: 2772.0 [2024-08-05 22:00:44,779][52671] Sum rewards: 2.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.326', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'weapon2': '1.394', 'DAMAGECOUNT': '1.512', 'weapon3': '1.768', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:45,052][52660] DAMAGECOUNT value on done: 3502.0 [2024-08-05 22:00:45,052][52660] Sum rewards: -0.073, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.805', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO3': '0.109', 'HITCOUNT': '0.310', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.086', 'weapon2': '1.102', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:45,099][52650] Updated weights for policy 0, policy_version 4431 (0.0014) [2024-08-05 22:00:45,412][52663] DAMAGECOUNT value on done: 1523.0 [2024-08-05 22:00:45,414][52663] Sum rewards: 2.454, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.126', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'weapon4': '0.452', 'ARMOR': '0.580', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon2': '1.152', 'weapon3': '1.466'} [2024-08-05 22:00:45,651][52820] DAMAGECOUNT value on done: 2214.0 [2024-08-05 22:00:45,652][52820] Sum rewards: -0.418, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.154', 'HITCOUNT': '0.340', 'ARMOR': '0.470', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.008', 'weapon3': '1.622', 'weapon2': '1.630'} [2024-08-05 22:00:46,604][52658] DAMAGECOUNT value on done: 2697.0 [2024-08-05 22:00:46,604][52658] Sum rewards: 4.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon5': '0.108', 'weapon4': '0.108', 'WEAPON4': '0.200', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.398', 'weapon2': '1.572', 'weapon3': '1.736', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:46,697][52664] DAMAGECOUNT value on done: 2382.0 [2024-08-05 22:00:46,701][52664] Sum rewards: 2.083, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.366', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'ARMOR': '0.104', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.474', 'WEAPON3': '0.850', 'weapon2': '0.866', 'DAMAGECOUNT': '0.903', 'weapon3': '2.314', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:46,967][52667] DAMAGECOUNT value on done: 3294.0 [2024-08-05 22:00:46,967][52667] Sum rewards: 3.586, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.240', 'AMMO2': '0.033', 'AMMO3': '0.089', 'weapon4': '0.106', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.062', 'weapon2': '1.656', 'weapon3': '1.718', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:47,073][52649] DAMAGECOUNT value on done: 2644.0 [2024-08-05 22:00:47,074][52649] Sum rewards: -0.995, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.400', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.079', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.816', 'ARMOR': '0.940', 'FRAGCOUNT': '1.000', 'weapon2': '1.778', 'weapon3': '1.940'} [2024-08-05 22:00:47,503][52668] DAMAGECOUNT value on done: 2334.0 [2024-08-05 22:00:47,504][52668] Sum rewards: 6.874, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.111', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.095', 'AMMO4': '0.104', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'ARMOR': '1.287', 'weapon3': '1.804', 'weapon2': '1.882', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:47,541][52659] DAMAGECOUNT value on done: 2338.0 [2024-08-05 22:00:47,541][52659] Sum rewards: 3.349, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.570', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.108', 'ARMOR': '0.196', 'weapon4': '0.244', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.044', 'weapon2': '1.166', 'weapon3': '2.290', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17066.7, 300 sec: 17022.7). Total num frames: 36347904. Throughput: 0: 4252.7. Samples: 9085460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:00:47,795][52567] Avg episode reward: [(0, '1.516')] [2024-08-05 22:00:47,832][52671] DAMAGECOUNT value on done: 1748.0 [2024-08-05 22:00:47,836][52671] Sum rewards: 1.264, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.086', 'HEALTH': '0.087', 'HITCOUNT': '0.270', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.795', 'weapon3': '1.410', 'weapon2': '1.580', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:47,918][52660] DAMAGECOUNT value on done: 2357.0 [2024-08-05 22:00:49,040][52820] DAMAGECOUNT value on done: 2108.0 [2024-08-05 22:00:49,040][52820] Sum rewards: -3.548, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.152', 'weapon4': '0.194', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '1.000', 'weapon2': '1.370', 'weapon3': '1.922'} [2024-08-05 22:00:49,348][52658] DAMAGECOUNT value on done: 3250.0 [2024-08-05 22:00:49,349][52658] Sum rewards: 4.125, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO5': '0.010', 'HEALTH': '0.042', 'AMMO4': '0.044', 'AMMO3': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON5': '0.200', 'weapon5': '0.254', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'ARMOR': '0.492', 'weapon3': '1.122', 'DAMAGECOUNT': '1.236', 'weapon2': '1.684', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:49,729][52667] DAMAGECOUNT value on done: 2361.0 [2024-08-05 22:00:49,729][52667] Sum rewards: -1.015, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.028', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.143', 'HITCOUNT': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon3': '1.366', 'weapon2': '1.628'} [2024-08-05 22:00:49,781][52664] DAMAGECOUNT value on done: 1949.0 [2024-08-05 22:00:49,924][52650] Updated weights for policy 0, policy_version 4441 (0.0022) [2024-08-05 22:00:50,167][52668] DAMAGECOUNT value on done: 2257.0 [2024-08-05 22:00:50,171][52668] Sum rewards: 1.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.596', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'AMMO3': '0.061', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.251', 'weapon3': '1.326', 'weapon2': '1.932', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:50,460][52649] DAMAGECOUNT value on done: 2773.0 [2024-08-05 22:00:50,460][52649] Sum rewards: -2.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.206', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon4': '0.046', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.152', 'HITCOUNT': '0.410', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'weapon2': '1.364', 'DAMAGECOUNT': '1.521', 'weapon3': '2.356'} [2024-08-05 22:00:50,743][52660] DAMAGECOUNT value on done: 2702.0 [2024-08-05 22:00:50,745][52660] Sum rewards: -0.284, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.486', 'AMMO2': '0.016', 'ARMOR': '0.044', 'weapon7': '0.054', 'AMMO3': '0.058', 'AMMO4': '0.078', 'HITCOUNT': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.242', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.420', 'weapon3': '0.982', 'FRAGCOUNT': '1.000', 'weapon2': '1.618'} [2024-08-05 22:00:50,760][52659] DAMAGECOUNT value on done: 2618.0 [2024-08-05 22:00:50,976][52671] DAMAGECOUNT value on done: 3216.0 [2024-08-05 22:00:50,978][52671] Sum rewards: -0.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.575', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.012', 'AMMO3': '0.105', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.200', 'weapon2': '1.224', 'weapon3': '1.836', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:52,330][52820] DAMAGECOUNT value on done: 1993.0 [2024-08-05 22:00:52,338][52820] Sum rewards: 0.285, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.400', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.017', 'ARMOR': '0.048', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.128', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.669', 'WEAPON3': '0.750', 'weapon2': '1.434', 'weapon3': '1.538', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:52,663][52658] DAMAGECOUNT value on done: 2913.0 [2024-08-05 22:00:52,665][52658] Sum rewards: 0.829, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.542', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'ARMOR': '0.088', 'weapon4': '0.120', 'AMMO3': '0.125', 'AMMO4': '0.150', 'HITCOUNT': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.018', 'DAMAGECOUNT': '1.197', 'weapon3': '2.342', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:52,706][52664] DAMAGECOUNT value on done: 2060.0 [2024-08-05 22:00:52,706][52664] Sum rewards: -0.270, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.026', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.057', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.126', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.065', 'weapon3': '1.496', 'weapon2': '1.524', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16994.9). Total num frames: 36429824. Throughput: 0: 4258.4. Samples: 9111040. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:00:52,794][52567] Avg episode reward: [(0, '1.117')] [2024-08-05 22:00:52,982][52667] DAMAGECOUNT value on done: 3123.0 [2024-08-05 22:00:52,983][52667] Sum rewards: 2.362, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.442', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.034', 'ARMOR': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon7': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'weapon2': '0.826', 'DAMAGECOUNT': '1.116', 'weapon3': '1.460', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:53,397][52668] DAMAGECOUNT value on done: 3847.0 [2024-08-05 22:00:53,399][52668] Sum rewards: 1.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.450', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'ARMOR': '0.497', 'HITCOUNT': '0.540', 'WEAPON3': '1.050', 'weapon2': '1.574', 'weapon3': '2.050', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:53,832][52660] DAMAGECOUNT value on done: 2385.0 [2024-08-05 22:00:53,834][52660] Sum rewards: -1.026, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.438', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.250', 'weapon4': '0.260', 'ARMOR': '0.566', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon2': '1.098', 'weapon3': '1.750'} [2024-08-05 22:00:53,937][52659] DAMAGECOUNT value on done: 2123.0 [2024-08-05 22:00:53,937][52659] Sum rewards: 1.573, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.600', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.216', 'HITCOUNT': '0.260', 'ARMOR': '0.469', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.020', 'weapon2': '1.302', 'weapon3': '1.356', 'FRAGCOUNT': '3.000'} [2024-08-05 22:00:54,208][52671] DAMAGECOUNT value on done: 2812.0 [2024-08-05 22:00:54,210][52671] Sum rewards: -0.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.708', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.068', 'AMMO3': '0.103', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon2': '1.474', 'weapon3': '1.474'} [2024-08-05 22:00:54,529][52650] Updated weights for policy 0, policy_version 4451 (0.0013) [2024-08-05 22:00:55,440][52658] DAMAGECOUNT value on done: 2635.0 [2024-08-05 22:00:55,441][52658] Sum rewards: 4.560, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.630', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.038', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.470', 'weapon2': '1.576', 'weapon3': '1.898', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:55,694][52820] DAMAGECOUNT value on done: 2084.0 [2024-08-05 22:00:55,696][52820] Sum rewards: 0.579, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.764', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon7': '0.072', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'weapon4': '0.194', 'WEAPON7': '0.200', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'weapon2': '0.744', 'DAMAGECOUNT': '0.879', 'FRAGCOUNT': '1.000', 'weapon3': '1.170'} [2024-08-05 22:00:55,705][52664] DAMAGECOUNT value on done: 2418.0 [2024-08-05 22:00:55,708][52664] Sum rewards: 1.795, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.640', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.230', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.074', 'weapon3': '1.316', 'ARMOR': '1.655', 'weapon2': '2.032', 'FRAGCOUNT': '4.000'} [2024-08-05 22:00:56,327][52668] DAMAGECOUNT value on done: 3777.0 [2024-08-05 22:00:56,329][52668] Sum rewards: 1.586, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.182', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.024', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.126', 'HITCOUNT': '0.300', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.106', 'weapon2': '1.538'} [2024-08-05 22:00:56,927][52659] DAMAGECOUNT value on done: 2826.0 [2024-08-05 22:00:56,928][52659] Sum rewards: 7.067, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.995', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.252', 'weapon5': '0.372', 'ARMOR': '0.503', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon3': '1.358', 'weapon2': '1.504', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:56,994][52660] DAMAGECOUNT value on done: 2801.0 [2024-08-05 22:00:56,998][52660] Sum rewards: -2.502, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.278', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.900', 'ARMOR': '0.909', 'FRAGCOUNT': '1.000', 'weapon3': '1.688', 'weapon2': '1.698'} [2024-08-05 22:00:57,235][52671] DAMAGECOUNT value on done: 2731.0 [2024-08-05 22:00:57,235][52671] Sum rewards: 0.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.138', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.162', 'HITCOUNT': '0.390', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.152', 'DAMAGECOUNT': '1.392', 'weapon3': '1.804'} [2024-08-05 22:00:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17203.2, 300 sec: 17022.7). Total num frames: 36519936. Throughput: 0: 4264.2. Samples: 9136860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:00:57,794][52567] Avg episode reward: [(0, '1.185')] [2024-08-05 22:00:57,825][52658] DAMAGECOUNT value on done: 1942.0 [2024-08-05 22:00:57,828][52658] Sum rewards: 6.844, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.085', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'ARMOR': '0.108', 'weapon4': '0.264', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon3': '1.778', 'weapon2': '1.806', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '5.000'} [2024-08-05 22:00:59,330][52668] DAMAGECOUNT value on done: 2646.0 [2024-08-05 22:00:59,331][52668] Sum rewards: 0.135, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.005', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.032', 'AMMO3': '0.072', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'weapon3': '1.630', 'weapon2': '1.946', 'FRAGCOUNT': '2.000'} [2024-08-05 22:00:59,368][52664] DAMAGECOUNT value on done: 2381.0 [2024-08-05 22:00:59,369][52664] Sum rewards: -1.988, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.406', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.130', 'weapon4': '0.134', 'WEAPON4': '0.200', 'HITCOUNT': '0.200', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.804', 'FRAGCOUNT': '1.000', 'weapon3': '1.304', 'ARMOR': '1.352', 'weapon2': '1.744'} [2024-08-05 22:00:59,473][52820] DAMAGECOUNT value on done: 3188.0 [2024-08-05 22:00:59,473][52820] Sum rewards: 2.757, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.445', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.855', 'weapon3': '1.618', 'DAMAGECOUNT': '1.809', 'weapon2': '2.264', 'FRAGCOUNT': '6.000'} [2024-08-05 22:00:59,944][52650] Updated weights for policy 0, policy_version 4461 (0.0014) [2024-08-05 22:00:59,990][52660] DAMAGECOUNT value on done: 2740.0 [2024-08-05 22:01:00,478][52659] DAMAGECOUNT value on done: 2989.0 [2024-08-05 22:01:00,481][52659] Sum rewards: -0.015, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.026', 'weapon4': '0.036', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.130', 'HITCOUNT': '0.130', 'WEAPON4': '0.150', 'HEALTH': '0.250', 'DAMAGECOUNT': '0.435', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.650', 'weapon3': '2.040'} [2024-08-05 22:01:00,791][52671] DAMAGECOUNT value on done: 3634.0 [2024-08-05 22:01:00,791][52671] Sum rewards: 1.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.176', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.368', 'ARMOR': '0.488', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.176', 'weapon2': '1.216', 'weapon3': '2.010', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:02,546][52658] DAMAGECOUNT value on done: 2703.0 [2024-08-05 22:01:02,554][52658] Sum rewards: 1.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.096', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.036', 'weapon4': '0.076', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'weapon2': '0.946', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.485', 'weapon3': '2.490', 'FRAGCOUNT': '4.000'} [2024-08-05 22:01:02,794][52567] Fps is (10 sec: 14745.5, 60 sec: 16657.0, 300 sec: 16939.4). Total num frames: 36577280. Throughput: 0: 4191.6. Samples: 9146280. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 22:01:02,795][52567] Avg episode reward: [(0, '1.136')] [2024-08-05 22:01:03,260][52668] DAMAGECOUNT value on done: 2880.0 [2024-08-05 22:01:03,260][52668] Sum rewards: 4.834, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.494', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.150', 'weapon4': '0.244', 'HITCOUNT': '0.340', 'ARMOR': '0.486', 'WEAPON3': '0.550', 'weapon2': '0.882', 'DAMAGECOUNT': '1.341', 'weapon3': '1.554', 'FRAGCOUNT': '4.000'} [2024-08-05 22:01:03,672][52659] DAMAGECOUNT value on done: 2905.0 [2024-08-05 22:01:03,672][52659] Sum rewards: 6.205, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.490', 'AMMO5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.043', 'weapon5': '0.082', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.340', 'weapon2': '1.344', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:03,881][52671] DAMAGECOUNT value on done: 3223.0 [2024-08-05 22:01:03,882][52671] Sum rewards: 0.748, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.496', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'HITCOUNT': '0.450', 'WEAPON3': '0.950', 'ARMOR': '0.952', 'DAMAGECOUNT': '1.665', 'weapon2': '1.728', 'weapon3': '1.896', 'FRAGCOUNT': '4.000'} [2024-08-05 22:01:04,552][52660] DAMAGECOUNT value on done: 2406.0 [2024-08-05 22:01:04,553][52660] Sum rewards: 4.555, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon4': '0.022', 'ARMOR': '0.040', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.182', 'WEAPON5': '0.200', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.450', 'weapon3': '1.798', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:04,582][52664] DAMAGECOUNT value on done: 2992.0 [2024-08-05 22:01:04,586][52664] Sum rewards: 0.317, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.115', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.011', 'AMMO3': '0.063', 'weapon4': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.495', 'ARMOR': '0.502', 'weapon5': '0.536', 'FRAGCOUNT': '1.000', 'weapon2': '1.206', 'weapon3': '1.216'} [2024-08-05 22:01:04,817][52820] DAMAGECOUNT value on done: 2682.0 [2024-08-05 22:01:04,823][52820] Sum rewards: 0.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.440', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO3': '0.090', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.065', 'weapon2': '1.156', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:06,241][52614] Signal inference workers to stop experience collection... (850 times) [2024-08-05 22:01:06,242][52614] Signal inference workers to resume experience collection... (850 times) [2024-08-05 22:01:06,319][52650] InferenceWorker_p0-w0: stopping experience collection (850 times) [2024-08-05 22:01:06,319][52650] InferenceWorker_p0-w0: resuming experience collection (850 times) [2024-08-05 22:01:06,329][52650] Updated weights for policy 0, policy_version 4471 (0.0022) [2024-08-05 22:01:06,564][52659] DAMAGECOUNT value on done: 2541.0 [2024-08-05 22:01:06,564][52659] Sum rewards: -1.605, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.882', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'ARMOR': '0.480', 'DAMAGECOUNT': '0.525', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.550', 'weapon3': '1.984'} [2024-08-05 22:01:06,676][52671] DAMAGECOUNT value on done: 2161.0 [2024-08-05 22:01:06,678][52671] Sum rewards: -1.357, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.418', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'weapon5': '0.166', 'HITCOUNT': '0.240', 'ARMOR': '0.486', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.840', 'weapon2': '1.716', 'weapon3': '1.722', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:06,827][52658] DAMAGECOUNT value on done: 2953.0 [2024-08-05 22:01:06,827][52658] Sum rewards: 8.453, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.103', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.062', 'weapon7': '0.066', 'AMMO4': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.350', 'ARMOR': '0.420', 'HITCOUNT': '0.440', 'weapon2': '0.790', 'weapon3': '1.412', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:07,734][52668] DAMAGECOUNT value on done: 3197.0 [2024-08-05 22:01:07,735][52668] Sum rewards: 5.094, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'ARMOR': '0.865', 'weapon3': '1.548', 'weapon2': '1.636', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:07,794][52567] Fps is (10 sec: 12287.9, 60 sec: 16384.0, 300 sec: 16856.1). Total num frames: 36642816. Throughput: 0: 4044.7. Samples: 9165240. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:01:07,795][52567] Avg episode reward: [(0, '1.222')] [2024-08-05 22:01:08,050][52664] DAMAGECOUNT value on done: 2328.0 [2024-08-05 22:01:08,050][52664] Sum rewards: 2.703, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.072', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.125', 'ARMOR': '0.128', 'HITCOUNT': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.048', 'DAMAGECOUNT': '1.575', 'weapon3': '2.460', 'FRAGCOUNT': '6.000'} [2024-08-05 22:01:08,098][52660] DAMAGECOUNT value on done: 3077.0 [2024-08-05 22:01:08,098][52660] Sum rewards: 3.631, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.149', 'AMMO5': '0.003', 'weapon7': '0.006', 'AMMO2': '0.038', 'ARMOR': '0.104', 'AMMO3': '0.138', 'AMMO4': '0.191', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.462', 'HITCOUNT': '0.510', 'WEAPON3': '0.950', 'weapon2': '0.994', 'weapon3': '2.240', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:09,427][52659] DAMAGECOUNT value on done: 2744.0 [2024-08-05 22:01:09,428][52659] Sum rewards: 0.830, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.790', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.072', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'ARMOR': '0.920', 'DAMAGECOUNT': '0.960', 'weapon2': '1.380', 'weapon3': '1.902', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:09,538][52671] DAMAGECOUNT value on done: 3222.0 [2024-08-05 22:01:09,538][52671] Sum rewards: 1.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.116', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.165', 'HITCOUNT': '0.710', 'WEAPON3': '1.100', 'weapon2': '1.500', 'weapon3': '2.220', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '4.000'} [2024-08-05 22:01:09,983][52668] DAMAGECOUNT value on done: 2098.0 [2024-08-05 22:01:09,983][52668] Sum rewards: 0.152, reward structure: {'DEATHCOUNT': '-6.000', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.012', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.096', 'weapon5': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.208', 'HEALTH': '0.318', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.488', 'DAMAGECOUNT': '1.215', 'weapon3': '1.220', 'weapon2': '1.756'} [2024-08-05 22:01:10,564][52660] DAMAGECOUNT value on done: 1956.0 [2024-08-05 22:01:10,567][52660] Sum rewards: 1.630, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.038', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.060', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.801', 'ARMOR': '0.853', 'FRAGCOUNT': '1.000', 'weapon2': '1.390', 'weapon3': '1.420'} [2024-08-05 22:01:11,225][52664] DAMAGECOUNT value on done: 2480.0 [2024-08-05 22:01:11,225][52664] Sum rewards: -0.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.190', 'AMMO2': '0.030', 'AMMO3': '0.147', 'AMMO4': '0.148', 'weapon4': '0.178', 'WEAPON4': '0.250', 'HITCOUNT': '0.480', 'ARMOR': '0.596', 'WEAPON3': '0.900', 'weapon2': '1.154', 'DAMAGECOUNT': '1.962', 'weapon3': '2.418', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:11,447][52650] Updated weights for policy 0, policy_version 4481 (0.0018) [2024-08-05 22:01:12,472][52659] DAMAGECOUNT value on done: 3691.0 [2024-08-05 22:01:12,474][52659] Sum rewards: 1.158, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.915', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.030', 'weapon6': '0.068', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'ARMOR': '0.100', 'AMMO6': '0.171', 'AMMO7': '0.171', 'WEAPON4': '0.200', 'WEAPON6': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.382', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.650', 'weapon2': '0.756', 'weapon3': '1.580', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:12,607][52671] DAMAGECOUNT value on done: 1701.0 [2024-08-05 22:01:12,608][52671] Sum rewards: 1.238, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.254', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'weapon4': '0.020', 'weapon5': '0.028', 'weapon7': '0.048', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.555', 'weapon3': '1.166', 'weapon2': '1.238', 'ARMOR': '1.322', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:12,786][52668] DAMAGECOUNT value on done: 2163.0 [2024-08-05 22:01:12,786][52668] Sum rewards: -2.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.437', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'weapon5': '0.018', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.230', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.993', 'FRAGCOUNT': '1.000', 'weapon2': '1.270', 'weapon3': '1.928'} [2024-08-05 22:01:12,794][52567] Fps is (10 sec: 14745.7, 60 sec: 16247.5, 300 sec: 16856.1). Total num frames: 36724736. Throughput: 0: 4041.9. Samples: 9190740. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:01:12,794][52567] Avg episode reward: [(0, '1.274')] [2024-08-05 22:01:13,292][52660] DAMAGECOUNT value on done: 2835.0 [2024-08-05 22:01:13,293][52660] Sum rewards: 3.932, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.995', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.147', 'ARMOR': '0.483', 'HITCOUNT': '0.520', 'WEAPON3': '0.950', 'weapon2': '1.444', 'DAMAGECOUNT': '1.965', 'weapon3': '2.290', 'FRAGCOUNT': '7.000'} [2024-08-05 22:01:14,454][52664] DAMAGECOUNT value on done: 3171.0 [2024-08-05 22:01:14,456][52664] Sum rewards: 2.174, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.060', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.004', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.132', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '0.918', 'weapon3': '1.570', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:15,304][52659] DAMAGECOUNT value on done: 2690.0 [2024-08-05 22:01:15,306][52659] Sum rewards: -0.505, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.158', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'weapon4': '0.244', 'HITCOUNT': '0.320', 'weapon5': '0.320', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.023', 'weapon2': '1.528', 'weapon3': '1.590', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:15,508][52671] DAMAGECOUNT value on done: 2763.0 [2024-08-05 22:01:15,509][52671] Sum rewards: 3.966, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.532', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO3': '0.102', 'AMMO4': '0.115', 'ARMOR': '0.119', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.966', 'weapon2': '1.098', 'weapon3': '1.842', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:15,936][52668] DAMAGECOUNT value on done: 2412.0 [2024-08-05 22:01:16,183][52650] Updated weights for policy 0, policy_version 4491 (0.0013) [2024-08-05 22:01:16,609][52660] DAMAGECOUNT value on done: 2690.0 [2024-08-05 22:01:16,609][52660] Sum rewards: 3.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.016', 'weapon4': '0.030', 'AMMO4': '0.065', 'AMMO3': '0.093', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.365', 'weapon2': '1.480', 'weapon3': '1.628', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16520.6, 300 sec: 16828.3). Total num frames: 36814848. Throughput: 0: 4049.3. Samples: 9203510. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:01:17,802][52567] Avg episode reward: [(0, '1.240')] [2024-08-05 22:01:17,892][52659] DAMAGECOUNT value on done: 2936.0 [2024-08-05 22:01:17,894][52659] Sum rewards: 5.355, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.155', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO3': '0.060', 'HITCOUNT': '0.410', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.170', 'weapon3': '1.200', 'weapon2': '2.266', 'FRAGCOUNT': '5.000'} [2024-08-05 22:01:18,044][52671] DAMAGECOUNT value on done: 3853.0 [2024-08-05 22:01:18,045][52671] Sum rewards: 2.836, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.685', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'ARMOR': '0.028', 'AMMO3': '0.102', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'weapon3': '1.372', 'weapon2': '1.426', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '4.000'} [2024-08-05 22:01:19,540][52668] DAMAGECOUNT value on done: 2864.0 [2024-08-05 22:01:19,540][52668] Sum rewards: 0.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.706', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'AMMO3': '0.113', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon6': '0.168', 'ARMOR': '0.453', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.576', 'DAMAGECOUNT': '1.656', 'weapon3': '1.928', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:20,070][52660] DAMAGECOUNT value on done: 2087.0 [2024-08-05 22:01:20,380][52794] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:01:20,756][52659] DAMAGECOUNT value on done: 2483.0 [2024-08-05 22:01:20,756][52659] Sum rewards: 0.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.402', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.032', 'ARMOR': '0.069', 'AMMO4': '0.075', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.196', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.837', 'weapon2': '1.528', 'weapon3': '1.926', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:20,903][52671] DAMAGECOUNT value on done: 2385.0 [2024-08-05 22:01:20,903][52671] Sum rewards: 1.091, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.001', 'AMMO4': '0.004', 'HEALTH': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'weapon7': '0.068', 'weapon4': '0.080', 'AMMO3': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.044', 'weapon2': '1.430', 'weapon3': '1.624', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:21,072][52650] Updated weights for policy 0, policy_version 4501 (0.0019) [2024-08-05 22:01:22,440][52668] DAMAGECOUNT value on done: 2851.0 [2024-08-05 22:01:22,441][52668] Sum rewards: 0.833, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.702', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO3': '0.063', 'weapon7': '0.090', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.320', 'WEAPON3': '0.450', 'weapon5': '0.516', 'ARMOR': '0.912', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.044', 'weapon3': '1.186', 'weapon2': '1.362'} [2024-08-05 22:01:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16384.1, 300 sec: 16856.1). Total num frames: 36896768. Throughput: 0: 4044.9. Samples: 9229020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:01:22,802][52567] Avg episode reward: [(0, '1.265')] [2024-08-05 22:01:23,013][52660] DAMAGECOUNT value on done: 3005.0 [2024-08-05 22:01:23,014][52660] Sum rewards: -0.065, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.562', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon4': '0.006', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'ARMOR': '0.459', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'weapon2': '1.220', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '2.000', 'weapon3': '2.034'} [2024-08-05 22:01:23,982][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 22:01:23,991][52659] DAMAGECOUNT value on done: 2727.0 [2024-08-05 22:01:23,991][52659] Sum rewards: -0.452, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.710', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.057', 'weapon4': '0.068', 'HITCOUNT': '0.130', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.435', 'weapon2': '0.848', 'FRAGCOUNT': '1.000', 'weapon3': '1.042'} [2024-08-05 22:01:24,147][52671] DAMAGECOUNT value on done: 2883.0 [2024-08-05 22:01:24,149][52671] Sum rewards: 2.783, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.478', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.262', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'ARMOR': '0.880', 'weapon2': '1.476', 'DAMAGECOUNT': '1.626', 'weapon3': '1.990', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:24,944][52668] DAMAGECOUNT value on done: 2698.0 [2024-08-05 22:01:24,945][52668] Sum rewards: -1.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.804', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.150', 'weapon4': '0.178', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'ARMOR': '0.852', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.449', 'weapon3': '1.634', 'weapon2': '1.820'} [2024-08-05 22:01:25,514][52660] DAMAGECOUNT value on done: 3009.0 [2024-08-05 22:01:25,516][52660] Sum rewards: -2.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.286', 'WEAPON3': '0.950', 'ARMOR': '0.957', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon2': '1.470', 'weapon3': '1.960'} [2024-08-05 22:01:25,665][52650] Updated weights for policy 0, policy_version 4511 (0.0020) [2024-08-05 22:01:26,761][52659] DAMAGECOUNT value on done: 2280.0 [2024-08-05 22:01:26,762][52659] Sum rewards: -0.522, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.022', 'AMMO4': '0.033', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'HITCOUNT': '0.280', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.957', 'weapon3': '1.504', 'weapon2': '1.644', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:27,498][52668] DAMAGECOUNT value on done: 2664.0 [2024-08-05 22:01:27,499][52668] Sum rewards: 0.645, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.285', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.222', 'HITCOUNT': '0.330', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.993', 'weapon2': '1.178', 'weapon3': '1.606', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16385.6, 300 sec: 16856.1). Total num frames: 36986880. Throughput: 0: 4048.9. Samples: 9254700. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-05 22:01:27,794][52567] Avg episode reward: [(0, '1.110')] [2024-08-05 22:01:27,936][52660] DAMAGECOUNT value on done: 2672.0 [2024-08-05 22:01:27,936][52660] Sum rewards: 1.936, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.044', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.002', 'weapon3': '1.376', 'weapon2': '1.486', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:29,935][52659] DAMAGECOUNT value on done: 3386.0 [2024-08-05 22:01:29,935][52659] Sum rewards: 1.972, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.885', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.052', 'AMMO3': '0.085', 'WEAPON4': '0.300', 'HITCOUNT': '0.320', 'weapon4': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.963', 'weapon2': '1.336', 'weapon3': '1.650', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:29,986][52668] DAMAGECOUNT value on done: 2692.0 [2024-08-05 22:01:29,987][52668] Sum rewards: -0.786, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.124', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.498', 'DAMAGECOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.927', 'weapon2': '1.336', 'weapon3': '1.584', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:30,553][52650] Updated weights for policy 0, policy_version 4521 (0.0020) [2024-08-05 22:01:30,681][52660] DAMAGECOUNT value on done: 2651.0 [2024-08-05 22:01:30,683][52660] Sum rewards: 0.200, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.094', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.128', 'weapon4': '0.134', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.912', 'weapon2': '1.188', 'weapon3': '1.944', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 16383.9, 300 sec: 16856.1). Total num frames: 37068800. Throughput: 0: 4048.9. Samples: 9267660. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:01:32,802][52567] Avg episode reward: [(0, '1.142')] [2024-08-05 22:01:33,084][52668] DAMAGECOUNT value on done: 2191.0 [2024-08-05 22:01:33,086][52668] Sum rewards: -3.009, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'weapon5': '0.066', 'AMMO3': '0.163', 'HITCOUNT': '0.330', 'DAMAGECOUNT': '0.909', 'ARMOR': '0.938', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'weapon2': '1.488', 'weapon3': '2.070'} [2024-08-05 22:01:33,773][52660] DAMAGECOUNT value on done: 2789.0 [2024-08-05 22:01:33,775][52660] Sum rewards: -0.414, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.682', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.196', 'HITCOUNT': '0.220', 'DAMAGECOUNT': '0.753', 'WEAPON3': '0.800', 'ARMOR': '0.816', 'weapon2': '1.298', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 22:01:35,221][52650] Updated weights for policy 0, policy_version 4531 (0.0028) [2024-08-05 22:01:35,847][52668] DAMAGECOUNT value on done: 1961.0 [2024-08-05 22:01:35,849][52668] Sum rewards: 0.815, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.767', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.024', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'HITCOUNT': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.450', 'ARMOR': '0.480', 'DAMAGECOUNT': '0.624', 'weapon3': '1.398', 'weapon2': '1.478', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:36,402][52660] DAMAGECOUNT value on done: 2099.0 [2024-08-05 22:01:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16520.5, 300 sec: 16856.1). Total num frames: 37158912. Throughput: 0: 4052.7. Samples: 9293410. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:01:37,794][52567] Avg episode reward: [(0, '1.095')] [2024-08-05 22:01:39,307][52660] DAMAGECOUNT value on done: 3961.0 [2024-08-05 22:01:39,308][52660] Sum rewards: 0.544, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.163', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'ARMOR': '0.888', 'weapon3': '0.900', 'DAMAGECOUNT': '1.200', 'weapon2': '1.560', 'FRAGCOUNT': '2.000'} [2024-08-05 22:01:39,876][52650] Updated weights for policy 0, policy_version 4541 (0.0022) [2024-08-05 22:01:42,794][52567] Fps is (10 sec: 17203.7, 60 sec: 16247.5, 300 sec: 16856.1). Total num frames: 37240832. Throughput: 0: 4045.3. Samples: 9318900. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 22:01:42,794][52567] Avg episode reward: [(0, '1.105')] [2024-08-05 22:01:45,084][52650] Updated weights for policy 0, policy_version 4551 (0.0014) [2024-08-05 22:01:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16247.5, 300 sec: 16883.9). Total num frames: 37322752. Throughput: 0: 4107.3. Samples: 9331110. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 22:01:47,794][52567] Avg episode reward: [(0, '1.105')] [2024-08-05 22:01:49,665][52650] Updated weights for policy 0, policy_version 4561 (0.0034) [2024-08-05 22:01:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16384.0, 300 sec: 16883.9). Total num frames: 37412864. Throughput: 0: 4252.5. Samples: 9356600. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:01:52,802][52567] Avg episode reward: [(0, '1.105')] [2024-08-05 22:01:54,632][52650] Updated weights for policy 0, policy_version 4571 (0.0028) [2024-08-05 22:01:57,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16110.9, 300 sec: 16828.3). Total num frames: 37486592. Throughput: 0: 4238.9. Samples: 9381490. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 22:01:57,802][52567] Avg episode reward: [(0, '1.105')] [2024-08-05 22:01:59,490][52650] Updated weights for policy 0, policy_version 4581 (0.0013) [2024-08-05 22:02:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 16856.1). Total num frames: 37576704. Throughput: 0: 4242.4. Samples: 9394420. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:02:02,795][52567] Avg episode reward: [(0, '1.105')] [2024-08-05 22:02:04,280][52794] DAMAGECOUNT value on done: 2730.0 [2024-08-05 22:02:04,280][52794] Sum rewards: -0.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.595', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.161', 'ARMOR': '0.400', 'HITCOUNT': '0.690', 'WEAPON3': '1.100', 'weapon2': '1.342', 'DAMAGECOUNT': '2.292', 'weapon3': '2.366', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:04,527][52650] Updated weights for policy 0, policy_version 4591 (0.0026) [2024-08-05 22:02:05,158][52666] DAMAGECOUNT value on done: 2326.0 [2024-08-05 22:02:05,159][52666] Sum rewards: -1.197, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.295', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.036', 'weapon5': '0.060', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon2': '1.576', 'weapon3': '1.846'} [2024-08-05 22:02:07,325][52794] DAMAGECOUNT value on done: 2968.0 [2024-08-05 22:02:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 37666816. Throughput: 0: 4228.0. Samples: 9419280. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-05 22:02:07,794][52567] Avg episode reward: [(0, '1.033')] [2024-08-05 22:02:07,913][52670] DAMAGECOUNT value on done: 3043.0 [2024-08-05 22:02:07,915][52670] Sum rewards: 1.960, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.035', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO3': '0.060', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.242', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.774', 'weapon2': '1.298', 'weapon3': '1.312', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:08,307][52662] DAMAGECOUNT value on done: 2628.0 [2024-08-05 22:02:08,308][52662] Sum rewards: -1.335, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.692', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO3': '0.117', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.092', 'DAMAGECOUNT': '1.146', 'weapon3': '2.050'} [2024-08-05 22:02:08,388][52666] DAMAGECOUNT value on done: 3200.0 [2024-08-05 22:02:08,390][52666] Sum rewards: -2.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.614', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.141', 'HITCOUNT': '0.450', 'ARMOR': '0.477', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.365', 'weapon3': '1.712', 'weapon2': '1.908', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:09,277][52650] Updated weights for policy 0, policy_version 4601 (0.0020) [2024-08-05 22:02:10,198][52794] DAMAGECOUNT value on done: 3596.0 [2024-08-05 22:02:10,199][52794] Sum rewards: 1.202, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.365', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon7': '0.050', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.897', 'ARMOR': '1.328', 'weapon2': '1.464', 'weapon3': '1.670', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:11,092][52662] DAMAGECOUNT value on done: 2895.0 [2024-08-05 22:02:11,092][52662] Sum rewards: 0.307, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.254', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon4': '0.216', 'HITCOUNT': '0.430', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.230', 'weapon2': '1.484', 'weapon3': '1.898', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:11,150][52670] DAMAGECOUNT value on done: 2633.0 [2024-08-05 22:02:11,152][52670] Sum rewards: -2.902, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.533', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.240', 'weapon5': '0.342', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'ARMOR': '1.347', 'weapon3': '1.574', 'weapon2': '1.808'} [2024-08-05 22:02:11,661][52666] DAMAGECOUNT value on done: 2699.0 [2024-08-05 22:02:11,661][52666] Sum rewards: -0.059, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.915', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.145', 'ARMOR': '0.485', 'HITCOUNT': '0.570', 'WEAPON3': '1.050', 'weapon2': '1.558', 'DAMAGECOUNT': '1.911', 'weapon3': '2.156', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 37748736. Throughput: 0: 4222.7. Samples: 9444720. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:02:12,794][52567] Avg episode reward: [(0, '0.858')] [2024-08-05 22:02:13,286][52794] DAMAGECOUNT value on done: 3602.0 [2024-08-05 22:02:13,287][52794] Sum rewards: 2.038, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.156', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.454', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.714', 'ARMOR': '1.232', 'weapon2': '1.262', 'weapon3': '1.544', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:14,059][52662] DAMAGECOUNT value on done: 3181.0 [2024-08-05 22:02:14,059][52650] Updated weights for policy 0, policy_version 4611 (0.0022) [2024-08-05 22:02:14,060][52662] Sum rewards: -0.953, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.870', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.497', 'WEAPON3': '1.150', 'weapon2': '1.304', 'DAMAGECOUNT': '1.893', 'weapon3': '2.328', 'FRAGCOUNT': '3.500'} [2024-08-05 22:02:14,249][52670] DAMAGECOUNT value on done: 2714.0 [2024-08-05 22:02:14,249][52670] Sum rewards: 2.591, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.354', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'ARMOR': '0.108', 'weapon4': '0.142', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.600', 'weapon3': '1.664', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '2.500'} [2024-08-05 22:02:14,549][52666] DAMAGECOUNT value on done: 2664.0 [2024-08-05 22:02:14,549][52666] Sum rewards: 0.480, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.438', 'AMMO2': '0.018', 'AMMO4': '0.091', 'ARMOR': '0.116', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'HITCOUNT': '0.320', 'weapon4': '0.460', 'weapon2': '0.556', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.320', 'weapon3': '2.370', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:15,823][52794] DAMAGECOUNT value on done: 3502.0 [2024-08-05 22:02:15,824][52794] Sum rewards: 6.058, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.685', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.070', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.508', 'weapon2': '1.598', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '6.000'} [2024-08-05 22:02:16,805][52662] DAMAGECOUNT value on done: 2539.0 [2024-08-05 22:02:16,807][52662] Sum rewards: -0.656, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.044', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.163', 'weapon5': '0.284', 'HITCOUNT': '0.290', 'ARMOR': '0.436', 'WEAPON3': '0.900', 'weapon2': '1.082', 'DAMAGECOUNT': '1.164', 'weapon3': '2.462', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:17,390][52670] DAMAGECOUNT value on done: 2686.0 [2024-08-05 22:02:17,391][52670] Sum rewards: 2.550, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.823', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.053', 'HITCOUNT': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.461', 'DAMAGECOUNT': '0.612', 'weapon3': '1.100', 'weapon2': '1.376', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:17,794][52567] Fps is (10 sec: 15564.8, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 37822464. Throughput: 0: 4218.5. Samples: 9457490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:02:17,794][52567] Avg episode reward: [(0, '0.787')] [2024-08-05 22:02:17,808][52666] DAMAGECOUNT value on done: 2453.0 [2024-08-05 22:02:17,812][52666] Sum rewards: 1.749, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.230', 'AMMO2': '0.030', 'AMMO3': '0.056', 'weapon4': '0.068', 'AMMO4': '0.148', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'ARMOR': '0.493', 'DAMAGECOUNT': '0.636', 'weapon3': '1.034', 'weapon2': '1.324', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:18,354][52794] DAMAGECOUNT value on done: 3390.0 [2024-08-05 22:02:18,358][52794] Sum rewards: 1.879, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon4': '0.204', 'HITCOUNT': '0.590', 'weapon2': '0.764', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.980', 'weapon3': '2.766', 'FRAGCOUNT': '5.000'} [2024-08-05 22:02:18,939][52650] Updated weights for policy 0, policy_version 4621 (0.0030) [2024-08-05 22:02:19,607][52662] DAMAGECOUNT value on done: 3298.0 [2024-08-05 22:02:19,608][52662] Sum rewards: 2.787, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.020', 'AMMO3': '0.084', 'AMMO4': '0.099', 'HEALTH': '0.124', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.080', 'weapon3': '1.330', 'weapon2': '1.830', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:20,723][52670] DAMAGECOUNT value on done: 1949.0 [2024-08-05 22:02:20,723][52670] Sum rewards: 1.065, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO2': '0.009', 'AMMO5': '0.014', 'weapon5': '0.022', 'AMMO4': '0.045', 'AMMO3': '0.090', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.487', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.086', 'weapon2': '1.498', 'weapon3': '2.060', 'FRAGCOUNT': '3.500'} [2024-08-05 22:02:20,944][52794] DAMAGECOUNT value on done: 2795.0 [2024-08-05 22:02:20,944][52794] Sum rewards: 0.813, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.548', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'weapon4': '0.038', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'HITCOUNT': '0.390', 'ARMOR': '0.948', 'WEAPON3': '1.000', 'weapon2': '1.346', 'DAMAGECOUNT': '1.602', 'weapon3': '2.030', 'FRAGCOUNT': '5.000'} [2024-08-05 22:02:21,220][52666] DAMAGECOUNT value on done: 2462.0 [2024-08-05 22:02:21,221][52666] Sum rewards: 1.958, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.075', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'weapon4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.228', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.894', 'ARMOR': '0.996', 'FRAGCOUNT': '1.000', 'weapon3': '1.146', 'weapon2': '1.218'} [2024-08-05 22:02:22,069][52662] DAMAGECOUNT value on done: 3806.0 [2024-08-05 22:02:22,070][52662] Sum rewards: -0.784, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.512', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.280', 'weapon4': '0.294', 'WEAPON4': '0.300', 'ARMOR': '0.604', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.990', 'weapon2': '1.582', 'weapon3': '1.824', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16828.3). Total num frames: 37920768. Throughput: 0: 4224.4. Samples: 9483510. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-05 22:02:22,794][52567] Avg episode reward: [(0, '0.924')] [2024-08-05 22:02:23,461][52794] DAMAGECOUNT value on done: 3094.0 [2024-08-05 22:02:24,015][52670] DAMAGECOUNT value on done: 3183.0 [2024-08-05 22:02:24,016][52670] Sum rewards: 3.045, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.386', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.104', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.848', 'DAMAGECOUNT': '1.167', 'weapon3': '1.672', 'weapon2': '1.692', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:24,234][52650] Updated weights for policy 0, policy_version 4631 (0.0039) [2024-08-05 22:02:24,406][52666] DAMAGECOUNT value on done: 2941.0 [2024-08-05 22:02:24,407][52666] Sum rewards: 4.426, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.295', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO3': '0.073', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'weapon3': '1.124', 'DAMAGECOUNT': '1.140', 'ARMOR': '1.844', 'weapon2': '2.008', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:24,707][52662] DAMAGECOUNT value on done: 4151.0 [2024-08-05 22:02:24,708][52662] Sum rewards: -3.811, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.084', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'HITCOUNT': '0.250', 'weapon4': '0.252', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.723', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.140', 'weapon3': '2.188'} [2024-08-05 22:02:26,488][52794] DAMAGECOUNT value on done: 3820.0 [2024-08-05 22:02:26,967][52670] DAMAGECOUNT value on done: 3024.0 [2024-08-05 22:02:26,967][52670] Sum rewards: 4.524, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.968', 'AMMO2': '0.017', 'ARMOR': '0.052', 'AMMO4': '0.082', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'HITCOUNT': '0.320', 'weapon4': '0.324', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.380', 'weapon2': '1.416', 'weapon3': '1.698', 'FRAGCOUNT': '6.000'} [2024-08-05 22:02:27,367][52666] DAMAGECOUNT value on done: 2608.0 [2024-08-05 22:02:27,369][52666] Sum rewards: 3.342, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.442', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.082', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'ARMOR': '0.950', 'weapon2': '1.510', 'DAMAGECOUNT': '1.860', 'weapon3': '2.020', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:27,481][52662] DAMAGECOUNT value on done: 3328.0 [2024-08-05 22:02:27,482][52662] Sum rewards: 8.063, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.146', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.086', 'AMMO4': '0.111', 'ARMOR': '0.136', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon3': '1.598', 'weapon2': '1.632', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '6.000'} [2024-08-05 22:02:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 37994496. Throughput: 0: 4218.9. Samples: 9508750. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-05 22:02:27,795][52567] Avg episode reward: [(0, '1.121')] [2024-08-05 22:02:27,861][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004639_38002688.pth... [2024-08-05 22:02:28,029][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004147_33972224.pth [2024-08-05 22:02:28,378][52650] Updated weights for policy 0, policy_version 4641 (0.0040) [2024-08-05 22:02:29,174][52794] DAMAGECOUNT value on done: 2720.0 [2024-08-05 22:02:29,177][52794] Sum rewards: 6.652, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.155', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.131', 'weapon4': '0.174', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'ARMOR': '0.890', 'weapon2': '1.428', 'DAMAGECOUNT': '1.740', 'weapon3': '2.048', 'FRAGCOUNT': '7.000'} [2024-08-05 22:02:30,199][52662] DAMAGECOUNT value on done: 3477.0 [2024-08-05 22:02:30,201][52662] Sum rewards: -1.544, reward structure: {'DEATHCOUNT': '-8.250', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'HEALTH': '0.086', 'AMMO3': '0.116', 'weapon5': '0.284', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.894', 'ARMOR': '1.310', 'weapon3': '1.346', 'weapon2': '2.060'} [2024-08-05 22:02:30,310][52670] DAMAGECOUNT value on done: 2929.0 [2024-08-05 22:02:30,312][52670] Sum rewards: 3.623, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.100', 'ARMOR': '0.128', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.402', 'HITCOUNT': '0.690', 'weapon2': '0.936', 'WEAPON3': '0.950', 'weapon3': '2.162', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '5.000'} [2024-08-05 22:02:30,728][52666] DAMAGECOUNT value on done: 3062.0 [2024-08-05 22:02:30,728][52666] Sum rewards: -1.144, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.774', 'AMMO4': '-0.094', 'AMMO2': '-0.019', 'AMMO3': '0.094', 'HITCOUNT': '0.330', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.044', 'weapon3': '1.474', 'weapon2': '1.710'} [2024-08-05 22:02:31,630][52794] DAMAGECOUNT value on done: 3011.0 [2024-08-05 22:02:31,631][52794] Sum rewards: -1.923, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.100', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.040', 'AMMO3': '0.147', 'HITCOUNT': '0.290', 'DAMAGECOUNT': '0.801', 'WEAPON3': '0.850', 'weapon2': '1.288', 'weapon3': '1.990', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:31,721][52614] Signal inference workers to stop experience collection... (900 times) [2024-08-05 22:02:31,722][52614] Signal inference workers to resume experience collection... (900 times) [2024-08-05 22:02:31,759][52650] InferenceWorker_p0-w0: stopping experience collection (900 times) [2024-08-05 22:02:31,773][52650] InferenceWorker_p0-w0: resuming experience collection (900 times) [2024-08-05 22:02:32,550][52662] DAMAGECOUNT value on done: 3686.0 [2024-08-05 22:02:32,550][52662] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.310', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon5': '0.202', 'weapon4': '0.206', 'HITCOUNT': '0.680', 'WEAPON3': '1.000', 'weapon2': '1.186', 'weapon3': '1.958', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '6.000'} [2024-08-05 22:02:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17066.7, 300 sec: 16883.9). Total num frames: 38092800. Throughput: 0: 4227.5. Samples: 9521350. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-05 22:02:32,794][52567] Avg episode reward: [(0, '1.150')] [2024-08-05 22:02:33,821][52670] DAMAGECOUNT value on done: 1741.0 [2024-08-05 22:02:33,822][52670] Sum rewards: -0.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.874', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'HITCOUNT': '0.180', 'WEAPON4': '0.450', 'weapon4': '0.460', 'ARMOR': '0.548', 'DAMAGECOUNT': '0.585', 'WEAPON3': '0.750', 'weapon2': '1.044', 'weapon3': '1.572', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:34,001][52650] Updated weights for policy 0, policy_version 4651 (0.0014) [2024-08-05 22:02:34,228][52666] DAMAGECOUNT value on done: 2593.0 [2024-08-05 22:02:34,280][52794] DAMAGECOUNT value on done: 3634.0 [2024-08-05 22:02:34,280][52794] Sum rewards: 2.313, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.784', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'weapon5': '0.020', 'WEAPON1': '0.030', 'AMMO3': '0.148', 'WEAPON5': '0.250', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'weapon2': '1.708', 'DAMAGECOUNT': '1.764', 'weapon3': '2.070', 'FRAGCOUNT': '5.000'} [2024-08-05 22:02:35,348][52662] DAMAGECOUNT value on done: 2973.0 [2024-08-05 22:02:35,348][52662] Sum rewards: -0.106, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.243', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'ARMOR': '0.048', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon5': '0.128', 'weapon4': '0.134', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.858', 'weapon2': '1.264', 'weapon3': '1.290', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:36,634][52794] DAMAGECOUNT value on done: 2906.0 [2024-08-05 22:02:36,637][52794] Sum rewards: 0.268, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.282', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO3': '0.109', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'ARMOR': '0.858', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.155', 'weapon3': '1.392', 'weapon2': '1.960'} [2024-08-05 22:02:37,269][52670] DAMAGECOUNT value on done: 2539.0 [2024-08-05 22:02:37,271][52670] Sum rewards: 1.864, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.853', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.194', 'ARMOR': '0.576', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.426', 'DAMAGECOUNT': '1.953', 'weapon3': '1.992', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:37,619][52666] DAMAGECOUNT value on done: 2722.0 [2024-08-05 22:02:37,622][52666] Sum rewards: -0.102, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.351', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.062', 'weapon4': '0.090', 'AMMO3': '0.104', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.270', 'WEAPON3': '0.600', 'ARMOR': '0.899', 'DAMAGECOUNT': '0.963', 'weapon2': '1.400', 'weapon3': '1.514', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:37,768][52662] DAMAGECOUNT value on done: 2879.0 [2024-08-05 22:02:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 38174720. Throughput: 0: 4226.0. Samples: 9546770. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-05 22:02:37,794][52567] Avg episode reward: [(0, '1.023')] [2024-08-05 22:02:38,025][52650] Updated weights for policy 0, policy_version 4661 (0.0030) [2024-08-05 22:02:39,243][52794] DAMAGECOUNT value on done: 4165.0 [2024-08-05 22:02:39,251][52794] Sum rewards: -0.934, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.907', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.088', 'ARMOR': '0.108', 'HITCOUNT': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.356', 'weapon2': '0.694', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.298'} [2024-08-05 22:02:40,326][52662] DAMAGECOUNT value on done: 3092.0 [2024-08-05 22:02:40,326][52662] Sum rewards: 0.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.280', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '1.000', 'weapon2': '1.636', 'weapon3': '2.168'} [2024-08-05 22:02:40,503][52670] DAMAGECOUNT value on done: 2882.0 [2024-08-05 22:02:40,504][52670] Sum rewards: 2.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.524', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'ARMOR': '0.405', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon3': '0.972', 'DAMAGECOUNT': '1.329', 'weapon2': '1.578', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:40,841][52666] DAMAGECOUNT value on done: 2780.0 [2024-08-05 22:02:40,841][52666] Sum rewards: -0.480, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.361', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.128', 'weapon4': '0.208', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'ARMOR': '0.471', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.110', 'weapon2': '1.646', 'weapon3': '1.832', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:41,945][52794] DAMAGECOUNT value on done: 3443.0 [2024-08-05 22:02:41,945][52794] Sum rewards: -3.414, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.852', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.024', 'AMMO4': '0.116', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.615', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'ARMOR': '1.363', 'weapon3': '1.684', 'weapon2': '1.686'} [2024-08-05 22:02:42,795][52567] Fps is (10 sec: 15564.3, 60 sec: 16793.5, 300 sec: 16800.5). Total num frames: 38248448. Throughput: 0: 4239.8. Samples: 9572280. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:02:42,795][52567] Avg episode reward: [(0, '0.948')] [2024-08-05 22:02:42,939][52662] DAMAGECOUNT value on done: 3677.0 [2024-08-05 22:02:42,940][52662] Sum rewards: 3.416, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.028', 'AMMO3': '0.050', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HEALTH': '0.404', 'weapon4': '0.422', 'HITCOUNT': '0.450', 'ARMOR': '0.648', 'weapon3': '1.174', 'DAMAGECOUNT': '1.638', 'weapon2': '1.962', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:43,189][52650] Updated weights for policy 0, policy_version 4671 (0.0019) [2024-08-05 22:02:43,593][52670] DAMAGECOUNT value on done: 3409.0 [2024-08-05 22:02:43,594][52670] Sum rewards: 2.282, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.124', 'weapon4': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'ARMOR': '0.890', 'DAMAGECOUNT': '1.392', 'weapon3': '1.616', 'weapon2': '1.896', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:43,868][52666] DAMAGECOUNT value on done: 2370.0 [2024-08-05 22:02:43,868][52666] Sum rewards: 2.285, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'weapon5': '0.182', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'ARMOR': '0.922', 'weapon2': '1.728', 'weapon3': '1.970', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '5.000'} [2024-08-05 22:02:44,515][52794] DAMAGECOUNT value on done: 3384.0 [2024-08-05 22:02:44,517][52794] Sum rewards: 0.664, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.940', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.041', 'AMMO4': '0.073', 'AMMO3': '0.092', 'weapon4': '0.098', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.705', 'weapon2': '0.848', 'weapon3': '1.242', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:45,686][52662] DAMAGECOUNT value on done: 2764.0 [2024-08-05 22:02:45,686][52662] Sum rewards: -0.459, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.996', 'AMMO2': '0.007', 'AMMO5': '0.008', 'AMMO4': '0.034', 'weapon5': '0.092', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.236', 'ARMOR': '1.326', 'weapon2': '1.682', 'weapon3': '1.824', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:46,991][52794] DAMAGECOUNT value on done: 3775.0 [2024-08-05 22:02:46,992][52794] Sum rewards: 3.238, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.068', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.510', 'WEAPON3': '1.050', 'weapon2': '1.164', 'DAMAGECOUNT': '2.235', 'weapon3': '2.494', 'FRAGCOUNT': '6.000'} [2024-08-05 22:02:47,096][52670] DAMAGECOUNT value on done: 3088.0 [2024-08-05 22:02:47,098][52670] Sum rewards: 4.958, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.025', 'AMMO2': '0.031', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'HITCOUNT': '0.360', 'weapon4': '0.376', 'WEAPON3': '0.650', 'ARMOR': '1.248', 'DAMAGECOUNT': '1.293', 'weapon2': '1.652', 'weapon3': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:47,297][52666] DAMAGECOUNT value on done: 2781.0 [2024-08-05 22:02:47,299][52666] Sum rewards: 4.370, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.025', 'weapon7': '0.048', 'AMMO3': '0.079', 'weapon4': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'HEALTH': '0.162', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.182', 'weapon3': '1.292', 'ARMOR': '1.294', 'FRAGCOUNT': '2.000', 'weapon2': '2.200'} [2024-08-05 22:02:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 38338560. Throughput: 0: 4238.0. Samples: 9585130. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:02:47,794][52567] Avg episode reward: [(0, '1.013')] [2024-08-05 22:02:47,980][52662] DAMAGECOUNT value on done: 4018.0 [2024-08-05 22:02:47,982][52662] Sum rewards: 4.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.261', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.181', 'HITCOUNT': '0.640', 'WEAPON3': '1.000', 'ARMOR': '1.287', 'weapon2': '1.358', 'DAMAGECOUNT': '2.259', 'weapon3': '2.390', 'FRAGCOUNT': '8.000'} [2024-08-05 22:02:48,076][52650] Updated weights for policy 0, policy_version 4681 (0.0012) [2024-08-05 22:02:48,804][52665] DAMAGECOUNT value on done: 3595.0 [2024-08-05 22:02:48,805][52665] Sum rewards: -0.813, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.052', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'ARMOR': '0.204', 'weapon4': '0.276', 'HITCOUNT': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.909', 'FRAGCOUNT': '1.000', 'weapon2': '1.488', 'weapon3': '1.724'} [2024-08-05 22:02:49,367][52669] DAMAGECOUNT value on done: 2527.0 [2024-08-05 22:02:49,368][52669] Sum rewards: 2.706, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.142', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.100', 'ARMOR': '0.190', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.438', 'WEAPON3': '0.650', 'weapon2': '1.044', 'DAMAGECOUNT': '1.155', 'weapon3': '1.816', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:49,502][52794] DAMAGECOUNT value on done: 4119.0 [2024-08-05 22:02:49,502][52794] Sum rewards: 2.797, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.164', 'AMMO2': '0.009', 'AMMO4': '0.044', 'ARMOR': '0.072', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.252', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'weapon2': '1.416', 'weapon3': '1.838', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '5.000'} [2024-08-05 22:02:50,432][52662] DAMAGECOUNT value on done: 2612.0 [2024-08-05 22:02:50,441][52662] Sum rewards: 0.537, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.902', 'AMMO5': '0.007', 'AMMO2': '0.054', 'AMMO3': '0.083', 'HITCOUNT': '0.240', 'AMMO4': '0.270', 'weapon4': '0.486', 'ARMOR': '0.496', 'WEAPON3': '0.550', 'WEAPON4': '0.550', 'DAMAGECOUNT': '0.894', 'weapon2': '1.194', 'weapon3': '1.364', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:50,522][52670] DAMAGECOUNT value on done: 3493.0 [2024-08-05 22:02:50,525][52670] Sum rewards: 4.333, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.335', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'ARMOR': '0.457', 'HITCOUNT': '0.530', 'WEAPON3': '1.000', 'weapon2': '1.334', 'weapon3': '2.044', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '6.000'} [2024-08-05 22:02:50,697][52666] DAMAGECOUNT value on done: 2302.0 [2024-08-05 22:02:50,698][52666] Sum rewards: 3.790, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '0.006', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'HITCOUNT': '0.150', 'weapon4': '0.220', 'WEAPON3': '0.300', 'ARMOR': '0.428', 'DAMAGECOUNT': '0.540', 'weapon3': '0.992', 'weapon2': '1.006', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:51,747][52794] DAMAGECOUNT value on done: 3360.0 [2024-08-05 22:02:51,747][52794] Sum rewards: -1.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.084', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'ARMOR': '0.564', 'DAMAGECOUNT': '0.645', 'WEAPON3': '0.800', 'weapon3': '1.562', 'weapon2': '1.992', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:51,945][52665] DAMAGECOUNT value on done: 2975.0 [2024-08-05 22:02:51,945][52665] Sum rewards: -0.820, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.530', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.016', 'AMMO3': '0.096', 'weapon5': '0.126', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.270', 'WEAPON3': '0.650', 'ARMOR': '0.893', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.420', 'weapon2': '1.582'} [2024-08-05 22:02:52,221][52669] DAMAGECOUNT value on done: 2588.0 [2024-08-05 22:02:52,222][52669] Sum rewards: -0.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.498', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.016', 'AMMO3': '0.079', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.792', 'weapon3': '0.998', 'FRAGCOUNT': '1.000', 'weapon2': '1.434'} [2024-08-05 22:02:52,419][52650] Updated weights for policy 0, policy_version 4691 (0.0014) [2024-08-05 22:02:52,794][52567] Fps is (10 sec: 18023.1, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 38428672. Throughput: 0: 4255.3. Samples: 9610770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:02:52,794][52567] Avg episode reward: [(0, '0.915')] [2024-08-05 22:02:52,831][52662] DAMAGECOUNT value on done: 3517.0 [2024-08-05 22:02:52,832][52662] Sum rewards: -0.393, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.868', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO3': '0.040', 'HITCOUNT': '0.220', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.690', 'ARMOR': '0.890', 'weapon3': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.686'} [2024-08-05 22:02:53,780][52670] DAMAGECOUNT value on done: 2766.0 [2024-08-05 22:02:53,782][52670] Sum rewards: 4.523, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.898', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.115', 'ARMOR': '0.408', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.524', 'weapon2': '1.756', 'weapon3': '1.894', 'FRAGCOUNT': '6.000'} [2024-08-05 22:02:53,960][52666] DAMAGECOUNT value on done: 3032.0 [2024-08-05 22:02:53,960][52666] Sum rewards: 1.667, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.435', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '1.379', 'weapon2': '1.474', 'DAMAGECOUNT': '1.623', 'weapon3': '2.206', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:54,165][52794] DAMAGECOUNT value on done: 3289.0 [2024-08-05 22:02:54,165][52794] Sum rewards: 3.458, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.215', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.060', 'weapon7': '0.062', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'weapon4': '0.384', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.200', 'weapon2': '1.366', 'weapon3': '1.732', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:54,308][52665] DAMAGECOUNT value on done: 3604.0 [2024-08-05 22:02:54,310][52665] Sum rewards: 2.256, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.130', 'HEALTH': '0.182', 'weapon5': '0.238', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.486', 'ARMOR': '0.840', 'weapon3': '1.028', 'weapon2': '1.752', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:54,746][52669] DAMAGECOUNT value on done: 2824.0 [2024-08-05 22:02:54,747][52669] Sum rewards: 2.056, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.992', 'AMMO2': '0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon4': '0.160', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.850', 'ARMOR': '1.048', 'DAMAGECOUNT': '1.107', 'weapon2': '1.642', 'weapon3': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:55,109][52662] DAMAGECOUNT value on done: 3102.0 [2024-08-05 22:02:55,109][52662] Sum rewards: 5.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.036', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'ARMOR': '0.894', 'weapon3': '1.330', 'DAMAGECOUNT': '1.479', 'weapon2': '2.062', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:57,126][52665] DAMAGECOUNT value on done: 2276.0 [2024-08-05 22:02:57,126][52665] Sum rewards: 1.312, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.341', 'AMMO2': '0.021', 'AMMO3': '0.060', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.366', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.895', 'weapon3': '1.190', 'DAMAGECOUNT': '1.407', 'FRAGCOUNT': '2.000', 'weapon2': '2.038'} [2024-08-05 22:02:57,152][52670] DAMAGECOUNT value on done: 2055.0 [2024-08-05 22:02:57,153][52670] Sum rewards: -0.584, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.770', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.290', 'weapon3': '1.604', 'weapon2': '1.762', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:57,337][52666] DAMAGECOUNT value on done: 2154.0 [2024-08-05 22:02:57,338][52666] Sum rewards: 3.414, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.990', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.099', 'weapon4': '0.194', 'HITCOUNT': '0.290', 'ARMOR': '0.492', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.945', 'weapon2': '1.616', 'weapon3': '1.986', 'FRAGCOUNT': '4.000'} [2024-08-05 22:02:57,495][52662] DAMAGECOUNT value on done: 2998.0 [2024-08-05 22:02:57,496][52662] Sum rewards: -4.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.026', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.163', 'HITCOUNT': '0.290', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.819', 'FRAGCOUNT': '1.000', 'weapon2': '1.068', 'WEAPON3': '1.100', 'weapon3': '2.524'} [2024-08-05 22:02:57,648][52669] DAMAGECOUNT value on done: 4489.0 [2024-08-05 22:02:57,648][52669] Sum rewards: 2.167, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.107', 'HEALTH': '0.116', 'weapon4': '0.188', 'HITCOUNT': '0.190', 'WEAPON3': '0.450', 'ARMOR': '0.522', 'DAMAGECOUNT': '0.741', 'weapon3': '1.382', 'weapon2': '1.508', 'FRAGCOUNT': '2.000'} [2024-08-05 22:02:57,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 38502400. Throughput: 0: 4254.4. Samples: 9636170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:02:57,795][52567] Avg episode reward: [(0, '0.975')] [2024-08-05 22:02:57,963][52650] Updated weights for policy 0, policy_version 4701 (0.0021) [2024-08-05 22:02:59,309][52811] DAMAGECOUNT value on done: 3105.0 [2024-08-05 22:02:59,310][52811] Sum rewards: 0.613, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.961', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO5': '0.007', 'weapon5': '0.040', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.170', 'weapon3': '1.668', 'weapon2': '1.806', 'FRAGCOUNT': '3.000'} [2024-08-05 22:02:59,852][52665] DAMAGECOUNT value on done: 3105.0 [2024-08-05 22:02:59,854][52665] Sum rewards: 3.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.980', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.480', 'WEAPON3': '0.900', 'ARMOR': '0.914', 'weapon3': '1.592', 'DAMAGECOUNT': '1.716', 'weapon2': '1.828', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:00,726][52670] DAMAGECOUNT value on done: 2949.0 [2024-08-05 22:03:00,727][52670] Sum rewards: -3.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.294', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.158', 'weapon5': '0.160', 'weapon4': '0.190', 'HITCOUNT': '0.410', 'WEAPON3': '0.950', 'FRAGCOUNT': '1.000', 'ARMOR': '1.300', 'DAMAGECOUNT': '1.386', 'weapon2': '1.410', 'weapon3': '1.666'} [2024-08-05 22:03:00,823][52803] DAMAGECOUNT value on done: 3212.0 [2024-08-05 22:03:00,823][52803] Sum rewards: 1.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.360', 'ARMOR': '0.544', 'WEAPON3': '0.750', 'weapon2': '1.368', 'DAMAGECOUNT': '1.422', 'weapon3': '1.524', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:00,878][52666] DAMAGECOUNT value on done: 2678.0 [2024-08-05 22:03:00,878][52666] Sum rewards: 0.952, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.022', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.230', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.942', 'weapon2': '1.220', 'weapon3': '1.864', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:00,943][52669] DAMAGECOUNT value on done: 2955.0 [2024-08-05 22:03:00,944][52669] Sum rewards: 2.623, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.110', 'HEALTH': '0.208', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.329', 'weapon2': '1.546', 'weapon3': '2.018', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:02,113][52650] Updated weights for policy 0, policy_version 4711 (0.0029) [2024-08-05 22:03:02,484][52811] DAMAGECOUNT value on done: 2466.0 [2024-08-05 22:03:02,484][52811] Sum rewards: -1.067, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.164', 'ARMOR': '1.306', 'weapon3': '1.486', 'FRAGCOUNT': '2.000', 'weapon2': '2.176'} [2024-08-05 22:03:02,676][52665] DAMAGECOUNT value on done: 2500.0 [2024-08-05 22:03:02,678][52665] Sum rewards: 0.536, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'HEALTH': '0.064', 'AMMO3': '0.106', 'HITCOUNT': '0.210', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.780', 'ARMOR': '0.985', 'weapon2': '1.862', 'weapon3': '1.944', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16828.3). Total num frames: 38600704. Throughput: 0: 4256.4. Samples: 9649030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:03:02,794][52567] Avg episode reward: [(0, '1.009')] [2024-08-05 22:03:03,523][52647] DAMAGECOUNT value on done: 2414.0 [2024-08-05 22:03:03,524][52647] Sum rewards: 0.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.163', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.014', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.182', 'HITCOUNT': '0.320', 'ARMOR': '0.516', 'DAMAGECOUNT': '0.882', 'WEAPON3': '0.900', 'weapon2': '1.304', 'weapon3': '1.668', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:03,712][52670] DAMAGECOUNT value on done: 3680.0 [2024-08-05 22:03:03,713][52670] Sum rewards: 2.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.628', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.020', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'ARMOR': '1.310', 'DAMAGECOUNT': '1.323', 'weapon3': '1.352', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:03,821][52666] DAMAGECOUNT value on done: 3953.0 [2024-08-05 22:03:03,823][52666] Sum rewards: 3.315, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.082', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'ARMOR': '0.053', 'weapon4': '0.088', 'AMMO3': '0.120', 'HITCOUNT': '0.560', 'WEAPON3': '0.850', 'weapon2': '1.052', 'DAMAGECOUNT': '2.040', 'weapon3': '2.104', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:04,064][52803] DAMAGECOUNT value on done: 3117.0 [2024-08-05 22:03:04,065][52803] Sum rewards: 1.093, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.540', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.070', 'HITCOUNT': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.068', 'weapon3': '1.488', 'weapon2': '2.112'} [2024-08-05 22:03:04,180][52669] DAMAGECOUNT value on done: 3509.0 [2024-08-05 22:03:04,182][52669] Sum rewards: 4.265, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'ARMOR': '0.440', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.478', 'weapon2': '1.486', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '3.500'} [2024-08-05 22:03:04,350][52663] DAMAGECOUNT value on done: 2583.0 [2024-08-05 22:03:04,350][52663] Sum rewards: 3.728, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.626', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'weapon5': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.430', 'ARMOR': '0.508', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.395', 'weapon3': '1.430', 'weapon2': '1.548', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:05,722][52665] DAMAGECOUNT value on done: 2692.0 [2024-08-05 22:03:05,724][52665] Sum rewards: 7.274, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.150', 'weapon4': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.680', 'ARMOR': '0.887', 'WEAPON3': '1.000', 'weapon2': '1.166', 'DAMAGECOUNT': '2.526', 'weapon3': '2.604', 'FRAGCOUNT': '9.000'} [2024-08-05 22:03:05,917][52811] DAMAGECOUNT value on done: 3031.0 [2024-08-05 22:03:05,918][52811] Sum rewards: 0.156, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.222', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon7': '0.004', 'AMMO5': '0.005', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO3': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'ARMOR': '0.933', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.053', 'weapon3': '1.494', 'weapon2': '2.030'} [2024-08-05 22:03:06,636][52647] DAMAGECOUNT value on done: 3353.0 [2024-08-05 22:03:06,641][52647] Sum rewards: 4.601, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.490', 'AMMO5': '0.003', 'AMMO2': '0.025', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.092', 'AMMO4': '0.125', 'weapon4': '0.210', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'weapon2': '1.452', 'DAMAGECOUNT': '1.560', 'weapon3': '1.694', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:06,924][52670] DAMAGECOUNT value on done: 2688.0 [2024-08-05 22:03:06,925][52670] Sum rewards: -1.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.408', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon4': '0.224', 'ARMOR': '0.440', 'HITCOUNT': '0.520', 'weapon2': '0.976', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.815', 'weapon3': '2.468', 'FRAGCOUNT': '2.500'} [2024-08-05 22:03:07,009][52666] DAMAGECOUNT value on done: 3030.0 [2024-08-05 22:03:07,010][52666] Sum rewards: 2.233, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.008', 'ARMOR': '0.012', 'weapon4': '0.032', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'HEALTH': '0.084', 'AMMO3': '0.127', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.284', 'DAMAGECOUNT': '1.350', 'weapon3': '2.446', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:07,231][52803] DAMAGECOUNT value on done: 2561.0 [2024-08-05 22:03:07,231][52803] Sum rewards: 3.856, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.603', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'AMMO3': '0.055', 'WEAPON5': '0.100', 'HITCOUNT': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.945', 'weapon3': '0.990', 'weapon2': '1.138', 'weapon5': '1.204', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:07,425][52650] Updated weights for policy 0, policy_version 4721 (0.0034) [2024-08-05 22:03:07,432][52669] DAMAGECOUNT value on done: 3296.0 [2024-08-05 22:03:07,438][52669] Sum rewards: 1.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.411', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.066', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.450', 'ARMOR': '0.523', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.377', 'weapon3': '1.550', 'weapon2': '2.080'} [2024-08-05 22:03:07,531][52663] DAMAGECOUNT value on done: 3017.0 [2024-08-05 22:03:07,784][52795] DAMAGECOUNT value on done: 2247.0 [2024-08-05 22:03:07,785][52795] Sum rewards: 5.481, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.719', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'AMMO3': '0.060', 'ARMOR': '0.060', 'weapon5': '0.064', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon3': '1.314', 'weapon2': '1.464', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:07,796][52567] Fps is (10 sec: 18018.8, 60 sec: 16929.5, 300 sec: 16828.2). Total num frames: 38682624. Throughput: 0: 4236.9. Samples: 9674180. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-05 22:03:07,797][52567] Avg episode reward: [(0, '1.341')] [2024-08-05 22:03:08,518][52665] DAMAGECOUNT value on done: 2852.0 [2024-08-05 22:03:08,518][52665] Sum rewards: 1.722, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.978', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.310', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.245', 'weapon2': '1.536', 'weapon3': '1.786', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:09,311][52811] DAMAGECOUNT value on done: 2985.0 [2024-08-05 22:03:09,313][52811] Sum rewards: 1.024, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.845', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.192', 'HITCOUNT': '0.440', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'weapon2': '0.996', 'DAMAGECOUNT': '1.446', 'weapon3': '1.448', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:09,589][52647] DAMAGECOUNT value on done: 3488.0 [2024-08-05 22:03:09,590][52647] Sum rewards: 6.888, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.756', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.214', 'ARMOR': '0.400', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.286', 'DAMAGECOUNT': '1.845', 'weapon2': '2.036', 'FRAGCOUNT': '8.000'} [2024-08-05 22:03:09,864][52670] DAMAGECOUNT value on done: 2905.0 [2024-08-05 22:03:09,865][52670] Sum rewards: 5.844, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.129', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.107', 'weapon4': '0.198', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.036', 'weapon3': '1.766', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:10,456][52803] DAMAGECOUNT value on done: 4347.0 [2024-08-05 22:03:10,456][52803] Sum rewards: 3.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.040', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.034', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.252', 'weapon5': '0.310', 'ARMOR': '0.453', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon3': '1.320', 'weapon2': '1.346', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:10,801][52669] DAMAGECOUNT value on done: 3388.0 [2024-08-05 22:03:10,801][52669] Sum rewards: 7.290, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.277', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.082', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon3': '1.336', 'DAMAGECOUNT': '1.884', 'weapon2': '1.914', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:10,959][52663] DAMAGECOUNT value on done: 2761.0 [2024-08-05 22:03:10,960][52663] Sum rewards: 4.197, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.288', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon5': '0.096', 'ARMOR': '0.455', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.452', 'DAMAGECOUNT': '1.698', 'weapon2': '1.852', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:11,236][52795] DAMAGECOUNT value on done: 2596.0 [2024-08-05 22:03:11,237][52795] Sum rewards: -1.576, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.944', 'AMMO2': '0.019', 'AMMO3': '0.070', 'AMMO4': '0.093', 'HITCOUNT': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.372', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.544', 'weapon2': '1.594'} [2024-08-05 22:03:11,416][52665] DAMAGECOUNT value on done: 1990.0 [2024-08-05 22:03:11,417][52665] Sum rewards: -0.298, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.025', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.260', 'ARMOR': '0.496', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.366', 'weapon3': '1.678'} [2024-08-05 22:03:11,866][52650] Updated weights for policy 0, policy_version 4731 (0.0025) [2024-08-05 22:03:12,009][52649] DAMAGECOUNT value on done: 3023.0 [2024-08-05 22:03:12,011][52649] Sum rewards: 4.864, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.191', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'ARMOR': '0.895', 'DAMAGECOUNT': '1.113', 'weapon2': '1.284', 'weapon3': '1.412', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:12,714][52811] DAMAGECOUNT value on done: 2891.0 [2024-08-05 22:03:12,722][52811] Sum rewards: 4.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'AMMO2': '0.023', 'weapon4': '0.038', 'ARMOR': '0.076', 'AMMO4': '0.113', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.850', 'weapon2': '1.322', 'DAMAGECOUNT': '1.371', 'weapon3': '2.164', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 38764544. Throughput: 0: 4243.3. Samples: 9699700. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:03:12,795][52567] Avg episode reward: [(0, '1.707')] [2024-08-05 22:03:12,863][52647] DAMAGECOUNT value on done: 2328.0 [2024-08-05 22:03:12,863][52647] Sum rewards: 3.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.338', 'AMMO2': '0.011', 'weapon4': '0.052', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'HITCOUNT': '0.620', 'WEAPON3': '0.900', 'ARMOR': '1.348', 'weapon2': '1.730', 'weapon3': '1.928', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:13,568][52803] DAMAGECOUNT value on done: 3840.0 [2024-08-05 22:03:13,568][52803] Sum rewards: 4.967, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.749', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'ARMOR': '0.862', 'weapon3': '1.594', 'weapon2': '1.658', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:13,774][52667] DAMAGECOUNT value on done: 3732.0 [2024-08-05 22:03:13,774][52667] Sum rewards: 4.765, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.123', 'ARMOR': '0.480', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.412', 'weapon3': '1.954', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:13,926][52669] DAMAGECOUNT value on done: 2503.0 [2024-08-05 22:03:13,926][52669] Sum rewards: -0.570, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.968', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.118', 'HITCOUNT': '0.420', 'ARMOR': '0.544', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.290', 'weapon2': '1.378', 'weapon3': '1.660'} [2024-08-05 22:03:14,042][52663] DAMAGECOUNT value on done: 3584.0 [2024-08-05 22:03:14,042][52663] Sum rewards: -3.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.386', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.160', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'weapon4': '0.460', 'weapon2': '1.008', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.182', 'FRAGCOUNT': '2.000', 'weapon3': '2.180'} [2024-08-05 22:03:14,487][52795] DAMAGECOUNT value on done: 2518.0 [2024-08-05 22:03:14,489][52795] Sum rewards: -2.107, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.164', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon4': '0.022', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.270', 'ARMOR': '0.574', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.005', 'weapon2': '1.518', 'weapon3': '1.782'} [2024-08-05 22:03:14,563][52665] DAMAGECOUNT value on done: 4328.0 [2024-08-05 22:03:14,563][52665] Sum rewards: -2.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.046', 'weapon7': '0.006', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.085', 'AMMO3': '0.175', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.370', 'ARMOR': '0.961', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.287', 'weapon2': '1.492', 'weapon3': '2.300', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:15,181][52649] DAMAGECOUNT value on done: 2923.0 [2024-08-05 22:03:15,182][52649] Sum rewards: 1.364, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.029', 'AMMO3': '0.074', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'HEALTH': '0.203', 'weapon4': '0.318', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.840', 'DAMAGECOUNT': '1.131', 'weapon3': '1.264', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:15,703][52647] DAMAGECOUNT value on done: 2289.0 [2024-08-05 22:03:15,706][52647] Sum rewards: 2.118, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.480', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.088', 'ARMOR': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.268', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.975', 'weapon2': '1.286', 'weapon3': '1.728', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:15,938][52811] DAMAGECOUNT value on done: 2803.0 [2024-08-05 22:03:15,939][52811] Sum rewards: 3.282, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.124', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'AMMO3': '0.053', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.729', 'weapon3': '0.926', 'weapon5': '1.108', 'weapon2': '1.464', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:16,679][52650] Updated weights for policy 0, policy_version 4741 (0.0028) [2024-08-05 22:03:16,740][52667] DAMAGECOUNT value on done: 3048.0 [2024-08-05 22:03:16,741][52667] Sum rewards: 1.439, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.472', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'weapon5': '0.106', 'HITCOUNT': '0.250', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.864', 'weapon3': '1.354', 'weapon2': '1.438', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:16,801][52803] DAMAGECOUNT value on done: 3282.0 [2024-08-05 22:03:16,802][52803] Sum rewards: 6.932, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.986', 'AMMO2': '0.002', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'ARMOR': '0.452', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon3': '1.566', 'weapon2': '1.654', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '8.000'} [2024-08-05 22:03:17,195][52669] DAMAGECOUNT value on done: 2831.0 [2024-08-05 22:03:17,196][52669] Sum rewards: 0.348, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.391', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.116', 'HITCOUNT': '0.330', 'ARMOR': '0.518', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.254', 'weapon2': '1.344', 'weapon3': '2.386', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:17,401][52663] DAMAGECOUNT value on done: 3426.0 [2024-08-05 22:03:17,405][52663] Sum rewards: 3.238, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.358', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.531', 'HITCOUNT': '0.640', 'WEAPON3': '0.950', 'weapon2': '1.104', 'weapon3': '2.100', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:17,465][52665] DAMAGECOUNT value on done: 3990.0 [2024-08-05 22:03:17,465][52665] Sum rewards: 8.931, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'HEALTH': '0.219', 'weapon4': '0.230', 'ARMOR': '0.510', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.242', 'weapon3': '1.800', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:17,719][52795] DAMAGECOUNT value on done: 3853.0 [2024-08-05 22:03:17,719][52795] Sum rewards: 0.767, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.228', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.084', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.479', 'DAMAGECOUNT': '0.900', 'weapon3': '1.108', 'weapon2': '1.686', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:17,794][52567] Fps is (10 sec: 17207.1, 60 sec: 17203.2, 300 sec: 16828.3). Total num frames: 38854656. Throughput: 0: 4246.7. Samples: 9712450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:03:17,794][52567] Avg episode reward: [(0, '1.834')] [2024-08-05 22:03:18,149][52649] DAMAGECOUNT value on done: 2523.0 [2024-08-05 22:03:18,149][52649] Sum rewards: -0.247, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'HEALTH': '0.008', 'AMMO2': '0.025', 'ARMOR': '0.084', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon5': '0.134', 'HITCOUNT': '0.140', 'weapon4': '0.192', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.614', 'weapon3': '1.706'} [2024-08-05 22:03:18,182][52647] DAMAGECOUNT value on done: 3050.0 [2024-08-05 22:03:18,184][52647] Sum rewards: 1.361, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.673', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon6': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'WEAPON6': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'HITCOUNT': '0.150', 'ARMOR': '0.192', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.321', 'WEAPON3': '0.500', 'weapon4': '0.576', 'FRAGCOUNT': '1.000', 'weapon2': '1.024', 'weapon3': '1.134'} [2024-08-05 22:03:19,088][52811] DAMAGECOUNT value on done: 3550.0 [2024-08-05 22:03:19,091][52811] Sum rewards: 9.571, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.251', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'ARMOR': '0.892', 'weapon3': '1.426', 'weapon2': '1.700', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '10.000'} [2024-08-05 22:03:19,151][52667] DAMAGECOUNT value on done: 3282.0 [2024-08-05 22:03:19,153][52667] Sum rewards: 6.962, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.126', 'HEALTH': '0.142', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'ARMOR': '0.884', 'weapon2': '1.424', 'weapon3': '2.212', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:20,213][52803] DAMAGECOUNT value on done: 3814.0 [2024-08-05 22:03:20,214][52803] Sum rewards: 3.796, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.584', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.220', 'weapon4': '0.258', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.089', 'weapon2': '1.246', 'weapon3': '1.330', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:20,288][52665] DAMAGECOUNT value on done: 3291.0 [2024-08-05 22:03:20,290][52665] Sum rewards: 0.135, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.564', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.200', 'weapon4': '0.420', 'ARMOR': '0.541', 'DAMAGECOUNT': '0.552', 'WEAPON3': '0.750', 'weapon2': '0.830', 'weapon3': '1.388', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:20,391][52669] DAMAGECOUNT value on done: 3000.0 [2024-08-05 22:03:20,391][52669] Sum rewards: -0.457, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.016', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.131', 'weapon4': '0.132', 'HITCOUNT': '0.150', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '1.093', 'weapon2': '1.484', 'weapon3': '1.694', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:20,630][52663] DAMAGECOUNT value on done: 3255.0 [2024-08-05 22:03:20,636][52663] Sum rewards: 0.991, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.147', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.360', 'WEAPON3': '0.800', 'weapon2': '1.230', 'DAMAGECOUNT': '1.290', 'weapon3': '1.824', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:20,846][52649] DAMAGECOUNT value on done: 3618.0 [2024-08-05 22:03:20,846][52649] Sum rewards: 5.257, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.016', 'weapon4': '0.024', 'ARMOR': '0.073', 'AMMO4': '0.079', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'HEALTH': '0.344', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.582', 'DAMAGECOUNT': '1.773', 'weapon3': '1.980', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:20,976][52795] DAMAGECOUNT value on done: 2931.0 [2024-08-05 22:03:20,978][52795] Sum rewards: 1.146, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.275', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.091', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon3': '1.332', 'DAMAGECOUNT': '1.737', 'weapon2': '1.768', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:21,144][52647] DAMAGECOUNT value on done: 2599.0 [2024-08-05 22:03:21,144][52647] Sum rewards: 0.520, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.048', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.028', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.434', 'DAMAGECOUNT': '1.491', 'weapon3': '1.772', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:21,710][52650] Updated weights for policy 0, policy_version 4751 (0.0038) [2024-08-05 22:03:22,095][52667] DAMAGECOUNT value on done: 2835.0 [2024-08-05 22:03:22,096][52667] Sum rewards: 4.688, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.250', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.420', 'WEAPON3': '0.800', 'ARMOR': '0.934', 'DAMAGECOUNT': '1.635', 'weapon2': '1.788', 'weapon3': '1.788', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:22,305][52811] DAMAGECOUNT value on done: 1713.0 [2024-08-05 22:03:22,305][52811] Sum rewards: -1.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.404', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.210', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.771', 'FRAGCOUNT': '1.000', 'ARMOR': '1.358', 'weapon3': '1.842', 'weapon2': '1.928'} [2024-08-05 22:03:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 38928384. Throughput: 0: 4245.8. Samples: 9737830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:03:22,802][52567] Avg episode reward: [(0, '1.953')] [2024-08-05 22:03:22,852][52665] DAMAGECOUNT value on done: 3604.0 [2024-08-05 22:03:22,858][52665] Sum rewards: 0.643, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.266', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.026', 'AMMO3': '0.064', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.560', 'DAMAGECOUNT': '0.780', 'FRAGCOUNT': '1.000', 'weapon3': '1.398', 'weapon2': '1.668'} [2024-08-05 22:03:23,301][52803] DAMAGECOUNT value on done: 3367.0 [2024-08-05 22:03:23,302][52803] Sum rewards: 1.923, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.218', 'weapon4': '0.286', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.471', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.290', 'weapon3': '1.408', 'weapon2': '1.418'} [2024-08-05 22:03:23,561][52669] DAMAGECOUNT value on done: 3376.0 [2024-08-05 22:03:23,563][52669] Sum rewards: 4.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.830', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.091', 'HITCOUNT': '0.380', 'ARMOR': '0.442', 'WEAPON3': '0.550', 'weapon3': '0.958', 'DAMAGECOUNT': '1.293', 'weapon2': '1.646', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:23,574][52649] DAMAGECOUNT value on done: 1823.0 [2024-08-05 22:03:23,574][52649] Sum rewards: -1.864, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.480', 'AMMO2': '0.028', 'ARMOR': '0.048', 'AMMO4': '0.137', 'AMMO3': '0.147', 'HITCOUNT': '0.240', 'weapon4': '0.288', 'WEAPON4': '0.300', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.950', 'weapon2': '1.018', 'weapon3': '1.984', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:23,715][52663] DAMAGECOUNT value on done: 4023.0 [2024-08-05 22:03:23,716][52663] Sum rewards: 4.245, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'HEALTH': '0.292', 'weapon4': '0.298', 'WEAPON3': '0.500', 'ARMOR': '0.504', 'HITCOUNT': '0.580', 'weapon2': '1.100', 'weapon3': '1.710', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:24,122][52795] DAMAGECOUNT value on done: 3643.0 [2024-08-05 22:03:24,126][52795] Sum rewards: 3.497, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.865', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.074', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.135', 'ARMOR': '0.140', 'WEAPON4': '0.300', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.096', 'DAMAGECOUNT': '1.746', 'weapon3': '2.472', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:24,454][52647] DAMAGECOUNT value on done: 2555.0 [2024-08-05 22:03:24,457][52647] Sum rewards: 3.231, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.835', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO3': '0.058', 'AMMO4': '0.072', 'ARMOR': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.356', 'WEAPON3': '0.400', 'weapon3': '0.996', 'DAMAGECOUNT': '1.365', 'weapon2': '1.538', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:25,147][52658] DAMAGECOUNT value on done: 2243.0 [2024-08-05 22:03:25,148][52658] Sum rewards: -0.908, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.288', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.155', 'HITCOUNT': '0.250', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.918', 'weapon2': '1.248', 'weapon3': '1.704', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:25,327][52667] DAMAGECOUNT value on done: 3382.0 [2024-08-05 22:03:25,328][52667] Sum rewards: 2.037, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.446', 'weapon4': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.059', 'ARMOR': '0.065', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.270', 'weapon3': '2.050', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:25,463][52811] DAMAGECOUNT value on done: 2288.0 [2024-08-05 22:03:25,465][52811] Sum rewards: -0.091, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.690', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'AMMO3': '0.056', 'weapon5': '0.060', 'HITCOUNT': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.465', 'FRAGCOUNT': '1.000', 'weapon3': '1.034', 'ARMOR': '1.448', 'weapon2': '1.520'} [2024-08-05 22:03:25,734][52665] DAMAGECOUNT value on done: 4079.0 [2024-08-05 22:03:25,737][52665] Sum rewards: 7.371, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.524', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.216', 'ARMOR': '0.463', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon2': '1.408', 'weapon3': '1.938', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '7.500'} [2024-08-05 22:03:25,931][52669] DAMAGECOUNT value on done: 2960.0 [2024-08-05 22:03:25,931][52669] Sum rewards: 0.175, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.115', 'AMMO2': '0.028', 'ARMOR': '0.032', 'AMMO3': '0.124', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'HITCOUNT': '0.300', 'weapon4': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.903', 'weapon2': '1.006', 'FRAGCOUNT': '2.000', 'weapon3': '2.120'} [2024-08-05 22:03:26,084][52663] DAMAGECOUNT value on done: 2765.0 [2024-08-05 22:03:26,085][52663] Sum rewards: 4.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.195', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.198', 'ARMOR': '0.444', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.328', 'DAMAGECOUNT': '1.578', 'weapon3': '1.630', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:26,401][52649] DAMAGECOUNT value on done: 2989.0 [2024-08-05 22:03:26,401][52649] Sum rewards: -0.613, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.004', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'weapon5': '0.002', 'AMMO5': '0.003', 'weapon4': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'HITCOUNT': '0.520', 'ARMOR': '0.543', 'WEAPON3': '1.100', 'weapon2': '1.192', 'DAMAGECOUNT': '1.818', 'weapon3': '2.486', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:26,410][52803] DAMAGECOUNT value on done: 2583.0 [2024-08-05 22:03:26,412][52803] Sum rewards: 0.532, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon7': '0.078', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.390', 'weapon5': '0.390', 'WEAPON3': '0.750', 'weapon2': '1.096', 'DAMAGECOUNT': '1.161', 'weapon3': '1.512', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:26,496][52650] Updated weights for policy 0, policy_version 4761 (0.0017) [2024-08-05 22:03:27,633][52795] DAMAGECOUNT value on done: 2830.0 [2024-08-05 22:03:27,634][52795] Sum rewards: 1.317, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.038', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.440', 'ARMOR': '0.568', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.485', 'weapon3': '1.598', 'weapon2': '1.816', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17066.7, 300 sec: 16800.5). Total num frames: 39018496. Throughput: 0: 4241.6. Samples: 9763150. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 22:03:27,802][52567] Avg episode reward: [(0, '2.035')] [2024-08-05 22:03:28,006][52647] DAMAGECOUNT value on done: 3417.0 [2024-08-05 22:03:28,007][52647] Sum rewards: 1.173, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.180', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO3': '0.040', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.180', 'weapon4': '0.216', 'WEAPON3': '0.250', 'weapon5': '0.272', 'DAMAGECOUNT': '0.750', 'weapon3': '0.764', 'FRAGCOUNT': '1.000', 'weapon2': '1.222'} [2024-08-05 22:03:28,374][52658] DAMAGECOUNT value on done: 2949.0 [2024-08-05 22:03:28,374][52658] Sum rewards: 1.371, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.111', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.238', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'ARMOR': '0.945', 'weapon2': '1.286', 'DAMAGECOUNT': '1.506', 'weapon3': '1.826', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:28,457][52665] DAMAGECOUNT value on done: 2933.0 [2024-08-05 22:03:28,459][52665] Sum rewards: 3.836, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.310', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.176', 'HITCOUNT': '0.560', 'ARMOR': '0.873', 'WEAPON3': '1.000', 'weapon2': '1.534', 'weapon3': '1.900', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:28,549][52667] DAMAGECOUNT value on done: 3443.0 [2024-08-05 22:03:28,549][52667] Sum rewards: 5.390, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.916', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'ARMOR': '0.032', 'AMMO3': '0.101', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.026', 'weapon3': '1.574', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:28,581][52669] DAMAGECOUNT value on done: 3112.0 [2024-08-05 22:03:28,582][52669] Sum rewards: 1.927, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.706', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.170', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'ARMOR': '1.307', 'weapon3': '1.398', 'DAMAGECOUNT': '1.401', 'weapon2': '1.630', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:28,743][52811] DAMAGECOUNT value on done: 3011.0 [2024-08-05 22:03:28,746][52811] Sum rewards: 4.769, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.014', 'AMMO4': '0.070', 'HEALTH': '0.072', 'AMMO3': '0.090', 'HITCOUNT': '0.380', 'ARMOR': '0.408', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.416', 'weapon2': '1.434', 'weapon3': '1.634', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:28,890][52663] DAMAGECOUNT value on done: 2690.0 [2024-08-05 22:03:28,894][52663] Sum rewards: 4.858, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.428', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.190', 'weapon5': '0.274', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.840', 'weapon2': '1.050', 'DAMAGECOUNT': '1.170', 'weapon3': '1.806', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:29,047][52649] DAMAGECOUNT value on done: 2540.0 [2024-08-05 22:03:29,048][52649] Sum rewards: 0.981, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.200', 'HITCOUNT': '0.230', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.681', 'weapon3': '1.512', 'weapon2': '1.602', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:29,742][52803] DAMAGECOUNT value on done: 2837.0 [2024-08-05 22:03:29,743][52803] Sum rewards: -1.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.174', 'weapon4': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.528', 'HITCOUNT': '0.680', 'WEAPON3': '1.150', 'weapon2': '1.772', 'weapon3': '1.928', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:30,873][52795] DAMAGECOUNT value on done: 3457.0 [2024-08-05 22:03:30,875][52795] Sum rewards: -1.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.630', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'DAMAGECOUNT': '0.453', 'weapon4': '0.456', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.348', 'weapon3': '1.450'} [2024-08-05 22:03:31,043][52665] DAMAGECOUNT value on done: 3857.0 [2024-08-05 22:03:31,044][52665] Sum rewards: 0.481, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.032', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.164', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.326', 'DAMAGECOUNT': '1.350', 'weapon2': '1.408', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:31,093][52647] DAMAGECOUNT value on done: 3228.0 [2024-08-05 22:03:31,093][52647] Sum rewards: 4.670, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.012', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'ARMOR': '0.453', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon3': '1.668', 'weapon2': '1.802', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:31,355][52669] DAMAGECOUNT value on done: 3338.0 [2024-08-05 22:03:31,355][52669] Sum rewards: 2.846, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.008', 'AMMO4': '0.037', 'HEALTH': '0.053', 'AMMO3': '0.085', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '1.518', 'DAMAGECOUNT': '1.575', 'weapon3': '1.680', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:31,416][52650] Updated weights for policy 0, policy_version 4771 (0.0037) [2024-08-05 22:03:31,557][52658] DAMAGECOUNT value on done: 2310.0 [2024-08-05 22:03:31,557][52658] Sum rewards: 4.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.129', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.056', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.256', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.251', 'weapon2': '1.288', 'weapon3': '1.412', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:31,603][52667] DAMAGECOUNT value on done: 3194.0 [2024-08-05 22:03:31,603][52667] Sum rewards: 2.370, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.950', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'HITCOUNT': '0.440', 'ARMOR': '0.548', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.455', 'weapon2': '1.498', 'weapon3': '2.244', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:31,753][52663] DAMAGECOUNT value on done: 3564.0 [2024-08-05 22:03:31,756][52663] Sum rewards: 5.471, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.334', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'ARMOR': '0.509', 'HITCOUNT': '0.600', 'WEAPON3': '1.000', 'weapon2': '1.612', 'weapon3': '1.760', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '8.000'} [2024-08-05 22:03:31,841][52649] DAMAGECOUNT value on done: 2532.0 [2024-08-05 22:03:31,843][52649] Sum rewards: 1.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.236', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.113', 'weapon4': '0.132', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'ARMOR': '0.913', 'DAMAGECOUNT': '0.945', 'weapon2': '1.348', 'weapon3': '1.820', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:32,160][52811] DAMAGECOUNT value on done: 3279.0 [2024-08-05 22:03:32,161][52811] Sum rewards: 0.088, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.518', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.178', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.850', 'ARMOR': '0.909', 'DAMAGECOUNT': '1.119', 'weapon2': '1.334', 'FRAGCOUNT': '2.000', 'weapon3': '2.114'} [2024-08-05 22:03:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 39100416. Throughput: 0: 4232.2. Samples: 9775580. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 22:03:32,794][52567] Avg episode reward: [(0, '2.167')] [2024-08-05 22:03:32,802][52614] Saving new best policy, reward=2.167! [2024-08-05 22:03:32,979][52803] DAMAGECOUNT value on done: 2118.0 [2024-08-05 22:03:32,982][52803] Sum rewards: -1.169, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.190', 'AMMO4': '-0.103', 'AMMO2': '-0.021', 'AMMO3': '0.104', 'HITCOUNT': '0.270', 'ARMOR': '0.450', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.855', 'weapon2': '1.670', 'weapon3': '1.696', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:33,930][52665] DAMAGECOUNT value on done: 3481.0 [2024-08-05 22:03:33,931][52665] Sum rewards: 3.599, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.968', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.034', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'weapon4': '0.238', 'HITCOUNT': '0.500', 'ARMOR': '0.528', 'WEAPON3': '0.850', 'weapon2': '1.376', 'DAMAGECOUNT': '1.767', 'weapon3': '1.898', 'FRAGCOUNT': '4.500'} [2024-08-05 22:03:34,150][52795] DAMAGECOUNT value on done: 3052.0 [2024-08-05 22:03:34,153][52795] Sum rewards: 0.873, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.380', 'AMMO4': '-0.083', 'AMMO2': '-0.017', 'ARMOR': '0.048', 'AMMO3': '0.096', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.047', 'weapon2': '1.296', 'weapon3': '1.376', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:34,269][52647] DAMAGECOUNT value on done: 3461.0 [2024-08-05 22:03:34,270][52647] Sum rewards: 3.951, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.626', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.040', 'weapon7': '0.046', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.165', 'WEAPON7': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.700', 'weapon2': '0.870', 'WEAPON3': '1.100', 'DAMAGECOUNT': '2.214', 'weapon3': '2.440', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:34,641][52649] DAMAGECOUNT value on done: 3046.0 [2024-08-05 22:03:34,641][52649] Sum rewards: 0.838, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.043', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.078', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.209', 'weapon2': '1.228', 'weapon3': '1.736', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:34,784][52658] DAMAGECOUNT value on done: 2623.0 [2024-08-05 22:03:34,840][52667] DAMAGECOUNT value on done: 3206.0 [2024-08-05 22:03:34,845][52667] Sum rewards: -2.815, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.412', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.037', 'weapon5': '0.072', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'HITCOUNT': '0.160', 'DAMAGECOUNT': '0.462', 'WEAPON3': '0.850', 'ARMOR': '0.920', 'FRAGCOUNT': '1.000', 'weapon2': '1.750', 'weapon3': '1.912'} [2024-08-05 22:03:34,879][52669] DAMAGECOUNT value on done: 2981.0 [2024-08-05 22:03:34,879][52669] Sum rewards: 0.682, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.062', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.109', 'weapon4': '0.210', 'HITCOUNT': '0.280', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.831', 'ARMOR': '1.280', 'weapon3': '1.604', 'weapon2': '1.778', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:35,153][52663] DAMAGECOUNT value on done: 2943.0 [2024-08-05 22:03:35,153][52663] Sum rewards: 5.985, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.054', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'ARMOR': '0.008', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.536', 'DAMAGECOUNT': '2.106', 'weapon3': '2.198', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:35,361][52811] DAMAGECOUNT value on done: 2854.0 [2024-08-05 22:03:35,364][52811] Sum rewards: 4.363, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.475', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.080', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '1.714', 'weapon3': '1.742', 'DAMAGECOUNT': '1.794', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:36,191][52664] DAMAGECOUNT value on done: 3532.0 [2024-08-05 22:03:36,192][52664] Sum rewards: 2.313, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'AMMO2': '0.023', 'weapon7': '0.066', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.236', 'ARMOR': '0.499', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.208', 'weapon3': '1.852', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:36,253][52803] DAMAGECOUNT value on done: 2547.0 [2024-08-05 22:03:36,255][52803] Sum rewards: 0.416, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.700', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.206', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.700', 'weapon2': '1.186', 'weapon3': '1.582', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:36,347][52650] Updated weights for policy 0, policy_version 4781 (0.0016) [2024-08-05 22:03:36,747][52647] DAMAGECOUNT value on done: 2832.0 [2024-08-05 22:03:36,747][52647] Sum rewards: -4.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'HITCOUNT': '0.400', 'ARMOR': '0.440', 'WEAPON3': '1.200', 'weapon2': '1.414', 'DAMAGECOUNT': '1.422', 'FRAGCOUNT': '2.000', 'weapon3': '2.400'} [2024-08-05 22:03:37,184][52665] DAMAGECOUNT value on done: 3706.0 [2024-08-05 22:03:37,185][52665] Sum rewards: 8.424, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.660', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.061', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon4': '0.510', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon2': '1.122', 'weapon3': '1.470', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '7.000'} [2024-08-05 22:03:37,622][52795] DAMAGECOUNT value on done: 2825.0 [2024-08-05 22:03:37,624][52795] Sum rewards: 0.744, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.499', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'ARMOR': '0.076', 'AMMO3': '0.117', 'HITCOUNT': '0.270', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.912', 'weapon2': '1.242', 'weapon3': '1.890', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 39190528. Throughput: 0: 4225.6. Samples: 9800920. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 22:03:37,794][52567] Avg episode reward: [(0, '2.265')] [2024-08-05 22:03:37,803][52614] Saving new best policy, reward=2.265! [2024-08-05 22:03:37,851][52669] DAMAGECOUNT value on done: 3200.0 [2024-08-05 22:03:37,851][52669] Sum rewards: 4.802, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.473', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'ARMOR': '0.040', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '1.436', 'weapon3': '1.694', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:37,965][52667] DAMAGECOUNT value on done: 3642.0 [2024-08-05 22:03:37,966][52667] Sum rewards: 2.054, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.060', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'ARMOR': '0.020', 'AMMO3': '0.070', 'HITCOUNT': '0.390', 'WEAPON3': '0.400', 'weapon3': '1.168', 'DAMAGECOUNT': '1.320', 'weapon2': '2.060', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:37,991][52658] DAMAGECOUNT value on done: 2798.0 [2024-08-05 22:03:37,992][52658] Sum rewards: 1.396, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.054', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.338', 'ARMOR': '0.523', 'HITCOUNT': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.502', 'weapon3': '1.894', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:38,140][52649] DAMAGECOUNT value on done: 2968.0 [2024-08-05 22:03:38,140][52649] Sum rewards: 0.399, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.328', 'WEAPON3': '0.600', 'ARMOR': '0.602', 'DAMAGECOUNT': '0.726', 'weapon2': '1.484', 'weapon3': '1.536', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:38,450][52663] DAMAGECOUNT value on done: 2880.0 [2024-08-05 22:03:38,450][52663] Sum rewards: 0.923, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.098', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.106', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.693', 'weapon2': '1.476', 'weapon3': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:38,467][52811] DAMAGECOUNT value on done: 2779.0 [2024-08-05 22:03:38,468][52811] Sum rewards: 5.172, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.861', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.198', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '1.335', 'weapon3': '1.726', 'DAMAGECOUNT': '1.812', 'weapon2': '1.846', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:38,658][52664] DAMAGECOUNT value on done: 3115.0 [2024-08-05 22:03:38,659][52664] Sum rewards: 1.045, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.022', 'AMMO4': '0.091', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'ARMOR': '0.946', 'DAMAGECOUNT': '1.392', 'weapon3': '1.612', 'weapon2': '2.016', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:38,983][52647] DAMAGECOUNT value on done: 3348.0 [2024-08-05 22:03:38,983][52647] Sum rewards: 3.336, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '0.002', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.130', 'HITCOUNT': '0.460', 'ARMOR': '0.506', 'WEAPON3': '0.800', 'weapon2': '1.166', 'DAMAGECOUNT': '2.010', 'weapon3': '2.214', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:39,483][52803] DAMAGECOUNT value on done: 3172.0 [2024-08-05 22:03:39,484][52803] Sum rewards: 0.498, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.023', 'weapon4': '0.050', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.400', 'ARMOR': '0.444', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon2': '1.742', 'weapon3': '1.778'} [2024-08-05 22:03:40,558][52665] DAMAGECOUNT value on done: 2892.0 [2024-08-05 22:03:40,559][52665] Sum rewards: 4.006, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.320', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.036', 'AMMO3': '0.095', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.552', 'DAMAGECOUNT': '1.560', 'weapon3': '1.852', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:40,954][52820] DAMAGECOUNT value on done: 2330.0 [2024-08-05 22:03:40,955][52820] Sum rewards: 2.185, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'weapon4': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.055', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'HITCOUNT': '0.210', 'HEALTH': '0.262', 'WEAPON3': '0.300', 'ARMOR': '0.540', 'DAMAGECOUNT': '0.552', 'weapon3': '0.972', 'FRAGCOUNT': '1.000', 'weapon2': '1.692'} [2024-08-05 22:03:40,973][52795] DAMAGECOUNT value on done: 2597.0 [2024-08-05 22:03:40,974][52795] Sum rewards: -1.851, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.728', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.138', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.750', 'ARMOR': '0.887', 'FRAGCOUNT': '1.000', 'weapon3': '1.672', 'weapon2': '1.794'} [2024-08-05 22:03:41,047][52669] DAMAGECOUNT value on done: 3281.0 [2024-08-05 22:03:41,050][52669] Sum rewards: 1.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.084', 'AMMO2': '0.026', 'AMMO3': '0.090', 'ARMOR': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'weapon4': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.242', 'weapon2': '1.326', 'weapon3': '1.920', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:41,117][52649] DAMAGECOUNT value on done: 3100.0 [2024-08-05 22:03:41,117][52649] Sum rewards: 6.283, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.027', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.166', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'ARMOR': '0.571', 'DAMAGECOUNT': '1.239', 'weapon2': '1.368', 'weapon3': '1.666', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:41,121][52667] DAMAGECOUNT value on done: 3181.0 [2024-08-05 22:03:41,122][52667] Sum rewards: 0.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.374', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO3': '0.092', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'ARMOR': '0.981', 'DAMAGECOUNT': '1.320', 'weapon2': '1.680', 'weapon3': '1.918', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:41,138][52658] DAMAGECOUNT value on done: 2316.0 [2024-08-05 22:03:41,310][52650] Updated weights for policy 0, policy_version 4791 (0.0020) [2024-08-05 22:03:41,404][52663] DAMAGECOUNT value on done: 3177.0 [2024-08-05 22:03:41,406][52663] Sum rewards: 4.739, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.021', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.256', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'ARMOR': '0.944', 'weapon2': '1.002', 'DAMAGECOUNT': '1.989', 'weapon3': '2.136', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:41,744][52811] DAMAGECOUNT value on done: 2350.0 [2024-08-05 22:03:41,747][52811] Sum rewards: 2.056, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.394', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'HITCOUNT': '0.210', 'WEAPON3': '0.350', 'weapon5': '0.540', 'DAMAGECOUNT': '0.600', 'ARMOR': '0.824', 'weapon3': '0.870', 'FRAGCOUNT': '1.000', 'weapon2': '1.320'} [2024-08-05 22:03:41,896][52664] DAMAGECOUNT value on done: 3800.0 [2024-08-05 22:03:41,898][52664] Sum rewards: -0.333, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.500', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'HITCOUNT': '0.500', 'WEAPON3': '1.100', 'weapon2': '1.440', 'DAMAGECOUNT': '1.854', 'weapon3': '2.312', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:42,303][52647] DAMAGECOUNT value on done: 2859.0 [2024-08-05 22:03:42,303][52647] Sum rewards: 0.101, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.166', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO3': '0.092', 'AMMO4': '0.098', 'weapon4': '0.150', 'HITCOUNT': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.487', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.810', 'weapon3': '1.616', 'weapon2': '1.638', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:42,700][52803] DAMAGECOUNT value on done: 3365.0 [2024-08-05 22:03:42,702][52803] Sum rewards: -1.006, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.217', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.050', 'weapon7': '0.096', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.314', 'WEAPON3': '0.550', 'weapon3': '0.810', 'ARMOR': '0.918', 'DAMAGECOUNT': '0.945', 'weapon2': '1.784', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.8, 300 sec: 16800.6). Total num frames: 39272448. Throughput: 0: 4224.5. Samples: 9826270. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 22:03:42,794][52567] Avg episode reward: [(0, '2.029')] [2024-08-05 22:03:43,185][52665] DAMAGECOUNT value on done: 3561.0 [2024-08-05 22:03:43,186][52665] Sum rewards: 3.442, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.981', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.083', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.118', 'ARMOR': '1.360', 'DAMAGECOUNT': '1.668', 'weapon2': '2.252', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:43,912][52667] DAMAGECOUNT value on done: 3249.0 [2024-08-05 22:03:43,912][52667] Sum rewards: 4.205, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.240', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.264', 'ARMOR': '0.500', 'HITCOUNT': '0.500', 'weapon5': '0.508', 'WEAPON3': '0.600', 'weapon2': '1.394', 'weapon3': '1.412', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:43,919][52669] DAMAGECOUNT value on done: 2973.0 [2024-08-05 22:03:43,919][52669] Sum rewards: 8.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.339', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.018', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'ARMOR': '1.313', 'weapon2': '1.636', 'weapon3': '1.932', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '10.000'} [2024-08-05 22:03:43,992][52658] DAMAGECOUNT value on done: 2722.0 [2024-08-05 22:03:43,992][52658] Sum rewards: 1.509, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.265', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.034', 'weapon5': '0.056', 'weapon7': '0.072', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.286', 'ARMOR': '0.514', 'weapon3': '0.636', 'DAMAGECOUNT': '0.702', 'FRAGCOUNT': '1.000', 'weapon2': '1.066'} [2024-08-05 22:03:44,060][52649] DAMAGECOUNT value on done: 2322.0 [2024-08-05 22:03:44,060][52649] Sum rewards: 3.461, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.133', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.070', 'HITCOUNT': '0.450', 'ARMOR': '0.491', 'WEAPON3': '0.500', 'weapon2': '1.436', 'DAMAGECOUNT': '1.446', 'weapon3': '1.488', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:44,184][52663] DAMAGECOUNT value on done: 3391.0 [2024-08-05 22:03:44,186][52663] Sum rewards: 1.734, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.049', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.061', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.370', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'weapon3': '1.276', 'DAMAGECOUNT': '1.335', 'weapon2': '1.544', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:44,274][52795] DAMAGECOUNT value on done: 2683.0 [2024-08-05 22:03:44,283][52820] DAMAGECOUNT value on done: 3181.0 [2024-08-05 22:03:44,284][52820] Sum rewards: 5.568, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.872', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.214', 'WEAPON5': '0.250', 'HITCOUNT': '0.380', 'ARMOR': '0.534', 'WEAPON3': '0.600', 'weapon2': '0.780', 'weapon5': '0.790', 'DAMAGECOUNT': '1.395', 'weapon3': '1.494', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:44,820][52811] DAMAGECOUNT value on done: 2664.0 [2024-08-05 22:03:44,821][52811] Sum rewards: 1.417, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.385', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.012', 'AMMO3': '0.096', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.885', 'weapon2': '1.376', 'weapon3': '1.500', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:45,259][52664] DAMAGECOUNT value on done: 2279.0 [2024-08-05 22:03:45,489][52647] DAMAGECOUNT value on done: 2998.0 [2024-08-05 22:03:45,492][52647] Sum rewards: -1.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.116', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.071', 'ARMOR': '1.284', 'weapon3': '1.824', 'weapon2': '2.072', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:45,711][52671] DAMAGECOUNT value on done: 3436.0 [2024-08-05 22:03:45,713][52671] Sum rewards: 1.363, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.078', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.036', 'AMMO3': '0.096', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'weapon2': '1.468', 'weapon3': '2.012', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:45,906][52650] Updated weights for policy 0, policy_version 4801 (0.0012) [2024-08-05 22:03:46,071][52803] DAMAGECOUNT value on done: 2281.0 [2024-08-05 22:03:46,810][52669] DAMAGECOUNT value on done: 3571.0 [2024-08-05 22:03:46,810][52669] Sum rewards: 3.412, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.070', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'ARMOR': '0.472', 'DAMAGECOUNT': '1.440', 'weapon3': '1.480', 'weapon2': '1.550', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:46,867][52667] DAMAGECOUNT value on done: 4189.0 [2024-08-05 22:03:46,867][52667] Sum rewards: 0.538, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.302', 'HITCOUNT': '0.420', 'WEAPON3': '0.900', 'ARMOR': '1.443', 'DAMAGECOUNT': '1.641', 'weapon2': '1.670', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:46,953][52658] DAMAGECOUNT value on done: 3051.0 [2024-08-05 22:03:46,954][52658] Sum rewards: 0.774, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.264', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'ARMOR': '0.497', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.326', 'weapon3': '1.956', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:47,031][52649] DAMAGECOUNT value on done: 3523.0 [2024-08-05 22:03:47,032][52649] Sum rewards: 1.522, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.938', 'AMMO5': '0.004', 'AMMO2': '0.005', 'weapon5': '0.020', 'AMMO4': '0.027', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.154', 'HITCOUNT': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.690', 'ARMOR': '1.027', 'weapon2': '1.170', 'weapon3': '1.372', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:47,109][52663] DAMAGECOUNT value on done: 2294.0 [2024-08-05 22:03:47,109][52663] Sum rewards: 0.538, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.530', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.112', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.786', 'FRAGCOUNT': '1.000', 'ARMOR': '1.414', 'weapon3': '1.572', 'weapon2': '1.658'} [2024-08-05 22:03:47,324][52795] DAMAGECOUNT value on done: 2735.0 [2024-08-05 22:03:47,325][52795] Sum rewards: -2.308, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.516', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.302', 'weapon2': '1.540', 'weapon3': '2.304'} [2024-08-05 22:03:47,695][52820] DAMAGECOUNT value on done: 3119.0 [2024-08-05 22:03:47,697][52820] Sum rewards: 7.546, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.350', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.096', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.991', 'weapon3': '1.820', 'weapon2': '1.998', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:47,795][52567] Fps is (10 sec: 16383.2, 60 sec: 16930.0, 300 sec: 16828.3). Total num frames: 39354368. Throughput: 0: 4221.5. Samples: 9839000. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:03:47,795][52567] Avg episode reward: [(0, '1.840')] [2024-08-05 22:03:48,043][52664] DAMAGECOUNT value on done: 3989.0 [2024-08-05 22:03:48,043][52664] Sum rewards: 5.255, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.803', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon7': '0.052', 'ARMOR': '0.088', 'AMMO3': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.300', 'weapon4': '0.404', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'weapon2': '1.148', 'DAMAGECOUNT': '1.758', 'weapon3': '1.776', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:48,087][52811] DAMAGECOUNT value on done: 2398.0 [2024-08-05 22:03:48,095][52811] Sum rewards: 2.689, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.017', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.106', 'HITCOUNT': '0.460', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.185', 'weapon2': '1.550', 'weapon3': '1.844', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:48,292][52647] DAMAGECOUNT value on done: 2787.0 [2024-08-05 22:03:49,005][52671] DAMAGECOUNT value on done: 3586.0 [2024-08-05 22:03:49,005][52671] Sum rewards: -2.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.246', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.184', 'HITCOUNT': '0.580', 'ARMOR': '0.836', 'WEAPON3': '1.150', 'weapon2': '1.342', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '2.000', 'weapon3': '2.228'} [2024-08-05 22:03:49,447][52803] DAMAGECOUNT value on done: 2423.0 [2024-08-05 22:03:49,450][52667] DAMAGECOUNT value on done: 3136.0 [2024-08-05 22:03:49,450][52803] Sum rewards: -1.072, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.010', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.360', 'weapon2': '1.048', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.065', 'weapon3': '2.394', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:49,452][52667] Sum rewards: 2.357, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.052', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.364', 'weapon5': '0.436', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.894', 'weapon2': '1.158', 'weapon3': '1.586', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:49,476][52658] DAMAGECOUNT value on done: 2656.0 [2024-08-05 22:03:49,476][52658] Sum rewards: 4.624, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.980', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.234', 'ARMOR': '0.504', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.280', 'weapon3': '1.656', 'DAMAGECOUNT': '1.698', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:49,914][52649] DAMAGECOUNT value on done: 3279.0 [2024-08-05 22:03:49,918][52649] Sum rewards: 2.323, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.623', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'ARMOR': '0.892', 'weapon2': '1.300', 'DAMAGECOUNT': '1.512', 'weapon3': '1.758', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:49,919][52663] DAMAGECOUNT value on done: 3637.0 [2024-08-05 22:03:49,920][52663] Sum rewards: 2.914, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.272', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.050', 'WEAPON3': '0.300', 'HITCOUNT': '0.310', 'ARMOR': '0.851', 'DAMAGECOUNT': '0.924', 'weapon3': '1.152', 'FRAGCOUNT': '2.000', 'weapon2': '2.086'} [2024-08-05 22:03:50,559][52795] DAMAGECOUNT value on done: 3438.0 [2024-08-05 22:03:50,564][52795] Sum rewards: 6.174, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.483', 'weapon4': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.071', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.290', 'weapon2': '1.522', 'weapon3': '1.610', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:50,818][52664] DAMAGECOUNT value on done: 2834.0 [2024-08-05 22:03:50,818][52664] Sum rewards: -2.308, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.550', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon4': '0.342', 'HITCOUNT': '0.380', 'ARMOR': '0.970', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.548', 'weapon2': '1.574', 'weapon3': '1.868', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:50,828][52650] Updated weights for policy 0, policy_version 4811 (0.0020) [2024-08-05 22:03:50,963][52647] DAMAGECOUNT value on done: 3254.0 [2024-08-05 22:03:50,964][52647] Sum rewards: 1.805, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.662', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'AMMO3': '0.078', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.440', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.404', 'DAMAGECOUNT': '1.485', 'weapon3': '1.568', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:51,078][52820] DAMAGECOUNT value on done: 3277.0 [2024-08-05 22:03:51,079][52820] Sum rewards: -1.655, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.360', 'ARMOR': '0.488', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.449', 'weapon2': '1.732', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:51,216][52811] DAMAGECOUNT value on done: 3414.0 [2024-08-05 22:03:51,217][52811] Sum rewards: 10.558, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'HEALTH': '0.044', 'AMMO4': '0.047', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.180', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.668', 'weapon3': '1.898', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '8.000'} [2024-08-05 22:03:51,911][52659] DAMAGECOUNT value on done: 3069.0 [2024-08-05 22:03:51,912][52659] Sum rewards: 1.473, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.654', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.174', 'HITCOUNT': '0.210', 'weapon5': '0.214', 'ARMOR': '0.457', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.128', 'weapon2': '1.148'} [2024-08-05 22:03:52,146][52671] DAMAGECOUNT value on done: 2409.0 [2024-08-05 22:03:52,147][52671] Sum rewards: -2.084, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.022', 'AMMO4': '0.066', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.222', 'DAMAGECOUNT': '1.380', 'weapon3': '2.036'} [2024-08-05 22:03:52,639][52667] DAMAGECOUNT value on done: 3874.0 [2024-08-05 22:03:52,640][52667] Sum rewards: 4.133, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.058', 'HEALTH': '0.242', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.493', 'weapon3': '0.968', 'DAMAGECOUNT': '1.017', 'weapon2': '1.398', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:52,659][52658] DAMAGECOUNT value on done: 3012.0 [2024-08-05 22:03:52,661][52658] Sum rewards: 3.818, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.308', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'ARMOR': '0.144', 'WEAPON4': '0.250', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'weapon4': '0.608', 'weapon2': '0.630', 'DAMAGECOUNT': '1.149', 'weapon3': '1.718', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:52,773][52803] DAMAGECOUNT value on done: 2621.0 [2024-08-05 22:03:52,773][52803] Sum rewards: 3.588, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon4': '0.240', 'HITCOUNT': '0.450', 'WEAPON3': '0.850', 'ARMOR': '1.298', 'DAMAGECOUNT': '1.497', 'weapon3': '1.678', 'weapon2': '1.692', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 39444480. Throughput: 0: 4227.5. Samples: 9864410. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:03:52,794][52567] Avg episode reward: [(0, '1.844')] [2024-08-05 22:03:53,086][52663] DAMAGECOUNT value on done: 2661.0 [2024-08-05 22:03:53,086][52663] Sum rewards: 5.491, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.472', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.022', 'AMMO4': '0.040', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.416', 'weapon3': '1.524', 'weapon2': '1.696', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:53,145][52649] DAMAGECOUNT value on done: 2213.0 [2024-08-05 22:03:53,153][52649] Sum rewards: -0.728, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.110', 'HITCOUNT': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.350', 'DAMAGECOUNT': '0.531', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.100', 'ARMOR': '1.363', 'weapon2': '1.626'} [2024-08-05 22:03:53,306][52664] DAMAGECOUNT value on done: 3490.0 [2024-08-05 22:03:53,308][52664] Sum rewards: 1.566, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.278', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO3': '0.060', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000', 'weapon2': '1.240', 'weapon3': '1.290'} [2024-08-05 22:03:53,359][52647] DAMAGECOUNT value on done: 2892.0 [2024-08-05 22:03:53,361][52647] Sum rewards: 4.956, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.398', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.094', 'weapon4': '0.122', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'ARMOR': '0.612', 'DAMAGECOUNT': '1.680', 'weapon2': '1.728', 'weapon3': '1.766', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:53,792][52795] DAMAGECOUNT value on done: 2651.0 [2024-08-05 22:03:53,793][52795] Sum rewards: 1.453, reward structure: {'DEATHCOUNT': '-1.500', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO3': '0.045', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'HITCOUNT': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.134', 'WEAPON3': '0.200', 'weapon4': '0.214', 'DAMAGECOUNT': '0.360', 'weapon5': '0.600', 'weapon2': '0.712', 'weapon3': '0.852'} [2024-08-05 22:03:54,392][52820] DAMAGECOUNT value on done: 2142.0 [2024-08-05 22:03:54,395][52820] Sum rewards: 0.076, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.272', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.162', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.945', 'ARMOR': '0.955', 'FRAGCOUNT': '1.000', 'weapon3': '1.072', 'weapon2': '1.600'} [2024-08-05 22:03:54,452][52811] DAMAGECOUNT value on done: 2543.0 [2024-08-05 22:03:54,453][52811] Sum rewards: 2.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.480', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.190', 'HITCOUNT': '0.350', 'WEAPON3': '0.800', 'ARMOR': '1.306', 'weapon2': '1.354', 'DAMAGECOUNT': '1.425', 'weapon3': '1.962', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:55,129][52659] DAMAGECOUNT value on done: 3407.0 [2024-08-05 22:03:55,130][52659] Sum rewards: 2.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.400', 'weapon4': '0.428', 'ARMOR': '0.480', 'WEAPON3': '0.800', 'weapon2': '1.142', 'DAMAGECOUNT': '1.290', 'weapon3': '1.772', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:55,341][52650] Updated weights for policy 0, policy_version 4821 (0.0039) [2024-08-05 22:03:55,448][52667] DAMAGECOUNT value on done: 3177.0 [2024-08-05 22:03:55,452][52667] Sum rewards: 12.958, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'HEALTH': '0.133', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.514', 'weapon2': '1.744', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '11.000'} [2024-08-05 22:03:55,449][52671] DAMAGECOUNT value on done: 3357.0 [2024-08-05 22:03:55,460][52671] Sum rewards: 2.778, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.198', 'ARMOR': '0.524', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.602', 'DAMAGECOUNT': '1.953', 'weapon3': '1.968', 'FRAGCOUNT': '5.000'} [2024-08-05 22:03:55,558][52658] DAMAGECOUNT value on done: 3181.0 [2024-08-05 22:03:55,558][52658] Sum rewards: -2.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'weapon5': '0.098', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'ARMOR': '0.979', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.350', 'weapon3': '1.534', 'weapon2': '1.736'} [2024-08-05 22:03:55,827][52663] DAMAGECOUNT value on done: 2849.0 [2024-08-05 22:03:55,827][52663] Sum rewards: 0.886, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'HITCOUNT': '0.280', 'weapon5': '0.390', 'ARMOR': '0.516', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.335', 'weapon2': '1.388', 'FRAGCOUNT': '1.500', 'weapon3': '1.636'} [2024-08-05 22:03:56,066][52803] DAMAGECOUNT value on done: 1802.0 [2024-08-05 22:03:56,249][52649] DAMAGECOUNT value on done: 3026.0 [2024-08-05 22:03:56,252][52649] Sum rewards: 1.354, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.264', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'weapon4': '0.006', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.306', 'weapon3': '1.308', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:56,280][52647] DAMAGECOUNT value on done: 3311.0 [2024-08-05 22:03:56,283][52647] Sum rewards: 1.403, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon4': '0.216', 'WEAPON4': '0.300', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'ARMOR': '0.962', 'weapon2': '1.516', 'weapon3': '2.124', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'} [2024-08-05 22:03:56,305][52664] DAMAGECOUNT value on done: 3106.0 [2024-08-05 22:03:56,307][52664] Sum rewards: 3.826, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.260', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.080', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.554', 'weapon3': '1.578', 'weapon2': '1.774', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:57,095][52795] DAMAGECOUNT value on done: 2901.0 [2024-08-05 22:03:57,095][52795] Sum rewards: 3.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.387', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.020', 'AMMO4': '0.042', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.358', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.065', 'ARMOR': '1.370', 'weapon2': '1.460', 'weapon3': '1.502', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:57,642][52820] DAMAGECOUNT value on done: 4068.0 [2024-08-05 22:03:57,643][52820] Sum rewards: -1.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.360', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.238', 'ARMOR': '0.513', 'HITCOUNT': '0.520', 'weapon2': '1.160', 'WEAPON3': '1.200', 'DAMAGECOUNT': '1.557', 'weapon3': '2.300', 'FRAGCOUNT': '3.000'} [2024-08-05 22:03:57,795][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.6, 300 sec: 16828.3). Total num frames: 39526400. Throughput: 0: 4231.8. Samples: 9890130. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 22:03:57,795][52567] Avg episode reward: [(0, '1.920')] [2024-08-05 22:03:57,824][52811] DAMAGECOUNT value on done: 3598.0 [2024-08-05 22:03:57,824][52811] Sum rewards: 3.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.110', 'HITCOUNT': '0.440', 'ARMOR': '0.537', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.401', 'weapon2': '1.686', 'weapon3': '2.030', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:58,025][52668] DAMAGECOUNT value on done: 3045.0 [2024-08-05 22:03:58,027][52668] Sum rewards: 0.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.154', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon7': '0.082', 'AMMO3': '0.120', 'HITCOUNT': '0.170', 'ARMOR': '0.193', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON4': '0.350', 'DAMAGECOUNT': '0.555', 'weapon4': '0.746', 'WEAPON3': '0.850', 'weapon2': '0.994', 'weapon3': '1.500', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:58,274][52659] DAMAGECOUNT value on done: 3577.0 [2024-08-05 22:03:58,274][52659] Sum rewards: 1.627, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.076', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.113', 'weapon5': '0.156', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'WEAPON4': '0.350', 'ARMOR': '0.485', 'weapon4': '0.486', 'WEAPON3': '0.850', 'weapon2': '1.116', 'DAMAGECOUNT': '1.152', 'weapon3': '1.794', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:58,587][52667] DAMAGECOUNT value on done: 2837.0 [2024-08-05 22:03:58,590][52667] Sum rewards: 1.528, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.321', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.022', 'weapon4': '0.052', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.675', 'weapon3': '1.228', 'weapon2': '2.008', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:58,640][52671] DAMAGECOUNT value on done: 2923.0 [2024-08-05 22:03:58,641][52671] Sum rewards: -2.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.574', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon7': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.150', 'weapon4': '0.166', 'WEAPON7': '0.200', 'ARMOR': '0.452', 'DAMAGECOUNT': '0.663', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.516', 'weapon3': '1.628'} [2024-08-05 22:03:58,718][52658] DAMAGECOUNT value on done: 3320.0 [2024-08-05 22:03:58,720][52658] Sum rewards: 0.540, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.524', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'weapon4': '0.410', 'ARMOR': '0.537', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.194', 'weapon2': '1.242', 'weapon3': '1.364'} [2024-08-05 22:03:59,026][52649] DAMAGECOUNT value on done: 2112.0 [2024-08-05 22:03:59,028][52649] Sum rewards: 2.423, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'weapon4': '0.298', 'WEAPON4': '0.300', 'HITCOUNT': '0.460', 'ARMOR': '0.496', 'WEAPON3': '0.900', 'weapon2': '1.256', 'DAMAGECOUNT': '1.737', 'weapon3': '1.890', 'FRAGCOUNT': '4.000'} [2024-08-05 22:03:59,100][52647] DAMAGECOUNT value on done: 3036.0 [2024-08-05 22:03:59,129][52664] DAMAGECOUNT value on done: 3987.0 [2024-08-05 22:03:59,130][52664] Sum rewards: -0.027, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.195', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.074', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.538', 'ARMOR': '0.580', 'WEAPON3': '0.800', 'weapon2': '0.910', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.314', 'weapon3': '1.930'} [2024-08-05 22:03:59,216][52663] DAMAGECOUNT value on done: 2574.0 [2024-08-05 22:03:59,218][52663] Sum rewards: 3.752, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.449', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.282', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.488', 'weapon2': '0.974', 'weapon3': '1.174', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '2.000'} [2024-08-05 22:03:59,297][52803] DAMAGECOUNT value on done: 3665.0 [2024-08-05 22:03:59,301][52803] Sum rewards: 4.583, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.259', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.006', 'weapon5': '0.026', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.252', 'HITCOUNT': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'weapon2': '1.202', 'DAMAGECOUNT': '1.260', 'weapon3': '1.496', 'FRAGCOUNT': '3.500'} [2024-08-05 22:04:00,382][52795] DAMAGECOUNT value on done: 3058.0 [2024-08-05 22:04:00,386][52795] Sum rewards: 5.895, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.387', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'ARMOR': '0.483', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon2': '1.554', 'weapon3': '1.816', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '6.000'} [2024-08-05 22:04:00,507][52650] Updated weights for policy 0, policy_version 4831 (0.0011) [2024-08-05 22:04:01,025][52668] DAMAGECOUNT value on done: 3076.0 [2024-08-05 22:04:01,025][52668] Sum rewards: 1.667, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.155', 'weapon4': '0.348', 'HITCOUNT': '0.580', 'WEAPON3': '0.950', 'weapon2': '1.154', 'DAMAGECOUNT': '1.854', 'weapon3': '2.076', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:01,028][52820] DAMAGECOUNT value on done: 2746.0 [2024-08-05 22:04:01,029][52820] Sum rewards: 1.169, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.388', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'ARMOR': '1.006', 'DAMAGECOUNT': '1.485', 'weapon2': '1.668', 'weapon3': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:01,065][52811] DAMAGECOUNT value on done: 3022.0 [2024-08-05 22:04:01,068][52811] Sum rewards: 0.792, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.018', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.354', 'HITCOUNT': '0.360', 'ARMOR': '0.502', 'WEAPON3': '0.700', 'weapon2': '1.238', 'DAMAGECOUNT': '1.296', 'weapon3': '1.302', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:01,262][52659] DAMAGECOUNT value on done: 3504.0 [2024-08-05 22:04:01,266][52659] Sum rewards: 2.683, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.146', 'AMMO2': '0.004', 'AMMO4': '0.019', 'ARMOR': '0.076', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.430', 'WEAPON3': '0.850', 'weapon2': '1.418', 'DAMAGECOUNT': '1.587', 'weapon3': '1.996', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:01,566][52671] DAMAGECOUNT value on done: 3006.0 [2024-08-05 22:04:01,567][52671] Sum rewards: -0.119, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.077', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.094', 'HITCOUNT': '0.250', 'ARMOR': '0.496', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.774', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '1.720'} [2024-08-05 22:04:01,678][52660] DAMAGECOUNT value on done: 2984.0 [2024-08-05 22:04:01,678][52660] Sum rewards: 3.621, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon4': '0.022', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.370', 'ARMOR': '0.576', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.527', 'weapon2': '1.544', 'weapon3': '1.638', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:01,982][52667] DAMAGECOUNT value on done: 3204.0 [2024-08-05 22:04:01,986][52667] Sum rewards: 1.437, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.398', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.206', 'weapon5': '0.262', 'HITCOUNT': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'weapon2': '1.354', 'weapon3': '1.552', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:02,102][52658] DAMAGECOUNT value on done: 2585.0 [2024-08-05 22:04:02,104][52658] Sum rewards: 4.043, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.628', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.114', 'weapon4': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'weapon2': '1.468', 'DAMAGECOUNT': '1.500', 'weapon3': '2.002', 'FRAGCOUNT': '6.000'} [2024-08-05 22:04:02,119][52649] DAMAGECOUNT value on done: 3067.0 [2024-08-05 22:04:02,119][52649] Sum rewards: -1.081, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.298', 'AMMO5': '0.010', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.074', 'weapon4': '0.078', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'ARMOR': '0.973', 'FRAGCOUNT': '1.000', 'weapon3': '1.616', 'weapon2': '1.878'} [2024-08-05 22:04:02,214][52663] DAMAGECOUNT value on done: 2202.0 [2024-08-05 22:04:02,215][52663] Sum rewards: 1.318, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.606', 'weapon4': '0.012', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.108', 'ARMOR': '0.420', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.712', 'weapon3': '1.946', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:02,496][52664] DAMAGECOUNT value on done: 3134.0 [2024-08-05 22:04:02,497][52664] Sum rewards: 2.129, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.015', 'HEALTH': '0.040', 'ARMOR': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.080', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.515', 'weapon3': '1.696', 'weapon2': '1.788', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:02,506][52803] DAMAGECOUNT value on done: 2806.0 [2024-08-05 22:04:02,506][52803] Sum rewards: 0.780, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.164', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.038', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon5': '0.250', 'weapon4': '0.256', 'ARMOR': '0.473', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.915', 'weapon2': '1.188', 'FRAGCOUNT': '2.000', 'weapon3': '2.070'} [2024-08-05 22:04:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 39608320. Throughput: 0: 4234.4. Samples: 9903000. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:04:02,794][52567] Avg episode reward: [(0, '1.776')] [2024-08-05 22:04:03,537][52795] DAMAGECOUNT value on done: 2643.0 [2024-08-05 22:04:03,537][52795] Sum rewards: 0.513, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.831', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.004', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.140', 'weapon4': '0.186', 'weapon5': '0.266', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.558', 'ARMOR': '0.926', 'FRAGCOUNT': '1.000', 'weapon3': '1.294', 'weapon2': '1.472'} [2024-08-05 22:04:03,741][52668] DAMAGECOUNT value on done: 2831.0 [2024-08-05 22:04:03,743][52668] Sum rewards: 1.621, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.230', 'AMMO2': '0.005', 'ARMOR': '0.024', 'AMMO4': '0.025', 'AMMO3': '0.040', 'HITCOUNT': '0.140', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'DAMAGECOUNT': '0.432', 'weapon4': '0.442', 'weapon2': '0.492', 'FRAGCOUNT': '1.000', 'weapon3': '1.000'} [2024-08-05 22:04:04,310][52820] DAMAGECOUNT value on done: 3025.0 [2024-08-05 22:04:04,310][52820] Sum rewards: 0.445, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.640', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.094', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon3': '1.188', 'weapon2': '1.284', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:04,363][52667] DAMAGECOUNT value on done: 3580.0 [2024-08-05 22:04:04,363][52667] Sum rewards: -2.831, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.266', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.142', 'weapon5': '0.156', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.220', 'FRAGCOUNT': '0.500', 'ARMOR': '0.559', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.858', 'weapon3': '1.668', 'weapon2': '1.772'} [2024-08-05 22:04:04,462][52660] DAMAGECOUNT value on done: 4076.0 [2024-08-05 22:04:04,463][52660] Sum rewards: 3.763, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.015', 'HEALTH': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.080', 'weapon4': '0.080', 'ARMOR': '0.440', 'HITCOUNT': '0.550', 'WEAPON3': '0.550', 'weapon2': '1.560', 'weapon3': '1.602', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:04,471][52659] DAMAGECOUNT value on done: 3052.0 [2024-08-05 22:04:04,474][52659] Sum rewards: 3.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.098', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.256', 'HITCOUNT': '0.370', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.182', 'weapon2': '1.290', 'weapon3': '2.236', 'FRAGCOUNT': '6.000'} [2024-08-05 22:04:04,525][52658] DAMAGECOUNT value on done: 3007.0 [2024-08-05 22:04:04,525][52658] Sum rewards: 0.001, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.116', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon5': '0.124', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.356', 'WEAPON3': '0.500', 'ARMOR': '0.504', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '1.216', 'weapon3': '1.400'} [2024-08-05 22:04:04,620][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 22:04:04,736][52671] DAMAGECOUNT value on done: 3053.0 [2024-08-05 22:04:04,740][52671] Sum rewards: -0.241, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.346', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.843', 'weapon3': '1.658', 'ARMOR': '1.795', 'weapon2': '1.908', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:05,112][52650] Updated weights for policy 0, policy_version 4841 (0.0021) [2024-08-05 22:04:05,436][52649] DAMAGECOUNT value on done: 3114.0 [2024-08-05 22:04:05,438][52649] Sum rewards: 2.332, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.222', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.272', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.410', 'weapon3': '1.526', 'weapon2': '1.744', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:05,684][52664] DAMAGECOUNT value on done: 2316.0 [2024-08-05 22:04:06,592][52668] DAMAGECOUNT value on done: 2519.0 [2024-08-05 22:04:06,593][52668] Sum rewards: -0.243, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.470', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.071', 'HITCOUNT': '0.200', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.555', 'ARMOR': '0.898', 'FRAGCOUNT': '1.000', 'weapon3': '1.434', 'weapon2': '1.562'} [2024-08-05 22:04:06,633][52795] DAMAGECOUNT value on done: 2499.0 [2024-08-05 22:04:06,637][52795] Sum rewards: -0.168, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.615', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.202', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon2': '1.538', 'weapon3': '1.884', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:06,818][52667] DAMAGECOUNT value on done: 2754.0 [2024-08-05 22:04:06,818][52667] Sum rewards: 2.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.207', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.070', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.481', 'DAMAGECOUNT': '1.179', 'weapon3': '1.358', 'weapon2': '1.506', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:06,917][52658] DAMAGECOUNT value on done: 3974.0 [2024-08-05 22:04:06,919][52658] Sum rewards: 4.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.382', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.130', 'ARMOR': '0.563', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'weapon2': '1.372', 'weapon3': '2.148', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:07,086][52660] DAMAGECOUNT value on done: 2777.0 [2024-08-05 22:04:07,086][52660] Sum rewards: 0.541, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.686', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.040', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.360', 'ARMOR': '0.452', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon2': '1.458', 'weapon3': '1.760'} [2024-08-05 22:04:07,531][52820] DAMAGECOUNT value on done: 2833.0 [2024-08-05 22:04:07,532][52820] Sum rewards: 1.488, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.886', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'ARMOR': '0.912', 'DAMAGECOUNT': '1.407', 'weapon3': '1.780', 'weapon2': '1.992', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:07,794][52567] Fps is (10 sec: 17203.7, 60 sec: 16930.7, 300 sec: 16828.3). Total num frames: 39698432. Throughput: 0: 4234.7. Samples: 9928390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:04:07,795][52567] Avg episode reward: [(0, '1.660')] [2024-08-05 22:04:07,858][52659] DAMAGECOUNT value on done: 2712.0 [2024-08-05 22:04:07,860][52659] Sum rewards: 2.288, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.849', 'AMMO2': '0.017', 'AMMO3': '0.050', 'weapon7': '0.056', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.896', 'DAMAGECOUNT': '1.122', 'weapon3': '1.244', 'weapon2': '1.262', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:08,131][52671] DAMAGECOUNT value on done: 2163.0 [2024-08-05 22:04:08,135][52671] Sum rewards: 3.099, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.026', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'HEALTH': '0.478', 'ARMOR': '0.836', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.245', 'weapon3': '1.430', 'weapon2': '1.560'} [2024-08-05 22:04:08,796][52664] DAMAGECOUNT value on done: 2746.0 [2024-08-05 22:04:08,798][52664] Sum rewards: 1.917, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.246', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'weapon5': '0.146', 'HITCOUNT': '0.310', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.092', 'weapon3': '1.524', 'weapon2': '1.568', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:09,028][52649] DAMAGECOUNT value on done: 3378.0 [2024-08-05 22:04:09,029][52649] Sum rewards: 2.725, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.116', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.096', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'ARMOR': '0.854', 'weapon3': '1.368', 'weapon2': '1.754', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:09,144][52668] DAMAGECOUNT value on done: 2622.0 [2024-08-05 22:04:09,145][52668] Sum rewards: -0.513, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.230', 'HITCOUNT': '0.300', 'WEAPON3': '0.850', 'ARMOR': '0.910', 'DAMAGECOUNT': '1.095', 'weapon2': '1.120', 'weapon3': '2.242', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:09,742][52660] DAMAGECOUNT value on done: 2947.0 [2024-08-05 22:04:09,820][52795] DAMAGECOUNT value on done: 2492.0 [2024-08-05 22:04:09,822][52795] Sum rewards: -0.084, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.460', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon5': '0.176', 'weapon4': '0.192', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon2': '1.088', 'weapon3': '1.820'} [2024-08-05 22:04:09,906][52667] DAMAGECOUNT value on done: 3652.0 [2024-08-05 22:04:09,908][52667] Sum rewards: -1.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.114', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.356', 'HITCOUNT': '0.480', 'ARMOR': '0.490', 'weapon2': '0.526', 'WEAPON3': '1.200', 'DAMAGECOUNT': '1.587', 'weapon3': '2.486', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:10,049][52650] Updated weights for policy 0, policy_version 4851 (0.0029) [2024-08-05 22:04:10,133][52658] DAMAGECOUNT value on done: 3483.0 [2024-08-05 22:04:10,134][52658] Sum rewards: -2.020, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.371', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.162', 'weapon5': '0.176', 'ARMOR': '0.480', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.332', 'DAMAGECOUNT': '1.710', 'weapon3': '1.766'} [2024-08-05 22:04:10,888][52820] DAMAGECOUNT value on done: 2962.0 [2024-08-05 22:04:10,889][52820] Sum rewards: 2.859, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.144', 'AMMO2': '0.018', 'AMMO3': '0.077', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '1.347', 'weapon3': '1.538', 'weapon2': '1.604', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:11,085][52659] DAMAGECOUNT value on done: 3359.0 [2024-08-05 22:04:11,085][52659] Sum rewards: 5.417, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.842', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.016', 'AMMO3': '0.084', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon3': '1.180', 'weapon2': '1.846', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:11,227][52671] DAMAGECOUNT value on done: 3405.0 [2024-08-05 22:04:11,228][52671] Sum rewards: 0.025, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.131', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.044', 'AMMO3': '0.063', 'ARMOR': '0.086', 'weapon5': '0.134', 'WEAPON4': '0.150', 'HITCOUNT': '0.210', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.567', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '1.690'} [2024-08-05 22:04:11,510][52664] DAMAGECOUNT value on done: 2416.0 [2024-08-05 22:04:11,510][52664] Sum rewards: 2.950, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.358', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon4': '0.146', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'ARMOR': '0.893', 'DAMAGECOUNT': '1.401', 'weapon3': '1.638', 'weapon2': '1.734', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:12,305][52668] DAMAGECOUNT value on done: 4097.0 [2024-08-05 22:04:12,305][52668] Sum rewards: -1.794, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.157', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.230', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.750', 'ARMOR': '0.891', 'FRAGCOUNT': '1.000', 'weapon2': '1.394', 'weapon3': '1.724'} [2024-08-05 22:04:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 39780352. Throughput: 0: 4238.7. Samples: 9953890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:04:12,795][52567] Avg episode reward: [(0, '1.624')] [2024-08-05 22:04:12,915][52660] DAMAGECOUNT value on done: 2688.0 [2024-08-05 22:04:12,917][52660] Sum rewards: 3.069, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.860', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.049', 'AMMO3': '0.087', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'ARMOR': '0.496', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.909', 'weapon2': '1.338', 'weapon3': '1.506', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:12,923][52658] DAMAGECOUNT value on done: 3152.0 [2024-08-05 22:04:12,923][52658] Sum rewards: 1.451, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.346', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.031', 'ARMOR': '0.035', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.456', 'DAMAGECOUNT': '1.551', 'weapon3': '2.098', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:13,888][52659] DAMAGECOUNT value on done: 2377.0 [2024-08-05 22:04:13,896][52659] Sum rewards: 0.180, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'weapon4': '0.076', 'AMMO4': '0.083', 'AMMO3': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.762', 'HEALTH': '0.902', 'FRAGCOUNT': '1.000', 'weapon2': '1.646', 'weapon3': '2.170'} [2024-08-05 22:04:14,148][52671] DAMAGECOUNT value on done: 3224.0 [2024-08-05 22:04:14,151][52671] Sum rewards: -3.660, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO2': '0.013', 'AMMO4': '0.062', 'ARMOR': '0.075', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'HITCOUNT': '0.350', 'DAMAGECOUNT': '1.236', 'WEAPON3': '1.250', 'weapon2': '1.372', 'weapon3': '2.350', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:14,171][52820] DAMAGECOUNT value on done: 3659.0 [2024-08-05 22:04:14,173][52820] Sum rewards: 0.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.228', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO4': '0.022', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.530', 'WEAPON3': '0.950', 'weapon2': '1.462', 'DAMAGECOUNT': '1.914', 'weapon3': '2.332', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:14,301][52664] DAMAGECOUNT value on done: 2703.0 [2024-08-05 22:04:14,302][52664] Sum rewards: 3.589, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.718', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'ARMOR': '0.456', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.680', 'DAMAGECOUNT': '1.929', 'weapon3': '2.244', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:14,851][52650] Updated weights for policy 0, policy_version 4861 (0.0025) [2024-08-05 22:04:15,153][52668] DAMAGECOUNT value on done: 4465.0 [2024-08-05 22:04:15,153][52668] Sum rewards: 2.373, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.010', 'AMMO4': '0.048', 'HEALTH': '0.094', 'AMMO3': '0.189', 'HITCOUNT': '0.560', 'WEAPON3': '0.950', 'ARMOR': '1.026', 'weapon2': '1.204', 'DAMAGECOUNT': '2.064', 'weapon3': '2.478', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:15,605][52658] DAMAGECOUNT value on done: 2477.0 [2024-08-05 22:04:15,607][52658] Sum rewards: 5.505, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.276', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.176', 'ARMOR': '0.460', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.605', 'weapon2': '1.684', 'weapon3': '1.946', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:15,917][52660] DAMAGECOUNT value on done: 3657.0 [2024-08-05 22:04:15,924][52660] Sum rewards: 1.602, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.452', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.145', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.258', 'ARMOR': '1.416', 'weapon3': '2.456', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:17,164][52659] DAMAGECOUNT value on done: 3454.0 [2024-08-05 22:04:17,167][52659] Sum rewards: 0.123, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.088', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.460', 'ARMOR': '0.525', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.450', 'weapon3': '1.832', 'DAMAGECOUNT': '1.884'} [2024-08-05 22:04:17,272][52664] DAMAGECOUNT value on done: 2913.0 [2024-08-05 22:04:17,275][52664] Sum rewards: -1.603, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.768', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.186', 'HITCOUNT': '0.400', 'ARMOR': '0.521', 'WEAPON3': '0.950', 'weapon2': '1.038', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '2.000', 'weapon3': '2.374'} [2024-08-05 22:04:17,391][52671] DAMAGECOUNT value on done: 2951.0 [2024-08-05 22:04:17,393][52671] Sum rewards: -1.729, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.105', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.660', 'WEAPON3': '0.800', 'ARMOR': '0.954', 'weapon2': '1.808', 'weapon3': '1.928', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:17,623][52820] DAMAGECOUNT value on done: 2781.0 [2024-08-05 22:04:17,624][52820] Sum rewards: 4.063, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.060', 'ARMOR': '0.137', 'HITCOUNT': '0.230', 'HEALTH': '0.343', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.798', 'weapon2': '1.378', 'weapon3': '1.430', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 39870464. Throughput: 0: 4249.8. Samples: 9966820. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 22:04:17,794][52567] Avg episode reward: [(0, '1.634')] [2024-08-05 22:04:18,120][52668] DAMAGECOUNT value on done: 3122.0 [2024-08-05 22:04:18,122][52668] Sum rewards: 8.129, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.262', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'HEALTH': '0.630', 'ARMOR': '0.972', 'weapon2': '1.072', 'weapon3': '1.396', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:18,284][52658] DAMAGECOUNT value on done: 3070.0 [2024-08-05 22:04:18,285][52658] Sum rewards: 1.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.183', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon7': '0.064', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.270', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.101', 'weapon3': '1.222', 'weapon2': '1.494', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:18,964][52660] DAMAGECOUNT value on done: 3315.0 [2024-08-05 22:04:18,967][52660] Sum rewards: 4.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.277', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.021', 'weapon7': '0.052', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.234', 'HITCOUNT': '0.390', 'ARMOR': '0.595', 'WEAPON3': '0.600', 'weapon2': '0.868', 'weapon3': '1.358', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '4.500'} [2024-08-05 22:04:19,518][52650] Updated weights for policy 0, policy_version 4871 (0.0012) [2024-08-05 22:04:20,162][52659] DAMAGECOUNT value on done: 3323.0 [2024-08-05 22:04:20,165][52659] Sum rewards: 4.731, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.153', 'WEAPON3': '0.300', 'weapon4': '0.328', 'HITCOUNT': '0.360', 'ARMOR': '0.424', 'HEALTH': '0.910', 'DAMAGECOUNT': '1.002', 'weapon3': '1.400', 'weapon2': '1.786', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:20,212][52664] DAMAGECOUNT value on done: 2808.0 [2024-08-05 22:04:20,213][52664] Sum rewards: 5.234, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.192', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon4': '0.214', 'ARMOR': '0.456', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.281', 'weapon3': '1.404', 'weapon2': '1.664', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:20,385][52671] DAMAGECOUNT value on done: 3982.0 [2024-08-05 22:04:20,389][52671] Sum rewards: 3.770, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon4': '0.064', 'AMMO4': '0.073', 'weapon5': '0.102', 'WEAPON4': '0.150', 'HEALTH': '0.298', 'WEAPON3': '0.300', 'HITCOUNT': '0.330', 'ARMOR': '0.880', 'weapon2': '0.940', 'DAMAGECOUNT': '1.044', 'weapon3': '1.212', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:20,871][52820] DAMAGECOUNT value on done: 2248.0 [2024-08-05 22:04:20,872][52820] Sum rewards: -0.486, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.067', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.366', 'WEAPON3': '0.500', 'ARMOR': '0.508', 'FRAGCOUNT': '1.000', 'weapon3': '1.232', 'weapon2': '1.808'} [2024-08-05 22:04:21,283][52658] DAMAGECOUNT value on done: 3269.0 [2024-08-05 22:04:21,285][52658] Sum rewards: 0.229, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.915', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.260', 'ARMOR': '0.480', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.566', 'weapon2': '1.728'} [2024-08-05 22:04:21,508][52668] DAMAGECOUNT value on done: 3080.0 [2024-08-05 22:04:21,510][52668] Sum rewards: 2.471, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.467', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'HITCOUNT': '0.160', 'weapon4': '0.256', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.600', 'ARMOR': '0.972', 'weapon2': '1.504', 'weapon3': '1.758', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:22,084][52660] DAMAGECOUNT value on done: 2687.0 [2024-08-05 22:04:22,085][52660] Sum rewards: 0.616, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.145', 'HITCOUNT': '0.260', 'weapon4': '0.386', 'WEAPON4': '0.400', 'ARMOR': '0.496', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.843', 'weapon2': '1.216', 'weapon3': '2.080', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.6, 300 sec: 16828.3). Total num frames: 39952384. Throughput: 0: 4261.3. Samples: 9992680. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:04:22,795][52567] Avg episode reward: [(0, '1.690')] [2024-08-05 22:04:23,032][52659] DAMAGECOUNT value on done: 3441.0 [2024-08-05 22:04:23,034][52659] Sum rewards: 4.759, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.827', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO3': '0.070', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'weapon3': '1.336', 'DAMAGECOUNT': '1.608', 'weapon2': '2.028', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:23,193][52671] DAMAGECOUNT value on done: 3506.0 [2024-08-05 22:04:23,310][52664] DAMAGECOUNT value on done: 3234.0 [2024-08-05 22:04:23,313][52664] Sum rewards: -2.771, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.886', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'weapon4': '0.122', 'HITCOUNT': '0.220', 'ARMOR': '0.489', 'DAMAGECOUNT': '0.726', 'WEAPON3': '0.800', 'weapon2': '1.762', 'weapon3': '1.896', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:24,088][52820] DAMAGECOUNT value on done: 2335.0 [2024-08-05 22:04:24,089][52820] Sum rewards: 1.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.902', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.051', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.170', 'DAMAGECOUNT': '1.338', 'FRAGCOUNT': '2.000', 'weapon3': '2.014'} [2024-08-05 22:04:24,278][52668] DAMAGECOUNT value on done: 4020.0 [2024-08-05 22:04:24,279][52668] Sum rewards: 2.962, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.340', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.070', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'weapon4': '0.322', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.862', 'weapon3': '1.796', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:24,544][52650] Updated weights for policy 0, policy_version 4881 (0.0018) [2024-08-05 22:04:24,856][52660] DAMAGECOUNT value on done: 3541.0 [2024-08-05 22:04:24,856][52660] Sum rewards: 2.646, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.692', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'ARMOR': '0.024', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.208', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.392', 'weapon2': '1.416', 'weapon3': '1.528', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:26,211][52659] DAMAGECOUNT value on done: 3128.0 [2024-08-05 22:04:26,214][52659] Sum rewards: 2.217, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.578', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'weapon4': '0.006', 'ARMOR': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.570', 'WEAPON3': '0.950', 'weapon2': '1.386', 'DAMAGECOUNT': '1.761', 'weapon3': '2.336', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:26,308][52664] DAMAGECOUNT value on done: 2793.0 [2024-08-05 22:04:26,310][52664] Sum rewards: 2.450, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.472', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.012', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'HITCOUNT': '0.390', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.395', 'weapon2': '1.722', 'weapon3': '2.144', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:26,376][52671] DAMAGECOUNT value on done: 2727.0 [2024-08-05 22:04:26,376][52671] Sum rewards: 0.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.032', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon4': '0.008', 'weapon5': '0.008', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'ARMOR': '1.018', 'weapon2': '1.042', 'weapon3': '1.630', 'DAMAGECOUNT': '1.698', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:26,914][52668] DAMAGECOUNT value on done: 2378.0 [2024-08-05 22:04:27,333][52820] DAMAGECOUNT value on done: 2975.0 [2024-08-05 22:04:27,337][52820] Sum rewards: 0.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.966', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.034', 'weapon4': '0.042', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'HITCOUNT': '0.720', 'WEAPON3': '1.100', 'ARMOR': '1.228', 'weapon2': '1.440', 'weapon3': '2.270', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:27,368][52660] DAMAGECOUNT value on done: 2371.0 [2024-08-05 22:04:27,369][52660] Sum rewards: 2.023, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.522', 'AMMO2': '0.016', 'AMMO4': '0.082', 'ARMOR': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.206', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.245', 'weapon2': '1.410', 'weapon3': '1.750', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 40042496. Throughput: 0: 4271.3. Samples: 10018480. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:04:27,794][52567] Avg episode reward: [(0, '1.539')] [2024-08-05 22:04:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004888_40042496.pth... [2024-08-05 22:04:27,970][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004395_36003840.pth [2024-08-05 22:04:28,894][52650] Updated weights for policy 0, policy_version 4891 (0.0011) [2024-08-05 22:04:29,113][52659] DAMAGECOUNT value on done: 3209.0 [2024-08-05 22:04:29,113][52659] Sum rewards: 0.794, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.961', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon5': '0.044', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'ARMOR': '1.351', 'DAMAGECOUNT': '1.395', 'weapon3': '1.560', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:29,157][52671] DAMAGECOUNT value on done: 3852.0 [2024-08-05 22:04:29,158][52671] Sum rewards: 1.068, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'HITCOUNT': '0.460', 'WEAPON3': '1.000', 'weapon2': '1.378', 'DAMAGECOUNT': '1.890', 'weapon3': '1.910', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:29,723][52664] DAMAGECOUNT value on done: 2787.0 [2024-08-05 22:04:29,724][52664] Sum rewards: -0.640, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.346', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'HITCOUNT': '0.280', 'ARMOR': '0.498', 'DAMAGECOUNT': '0.921', 'WEAPON3': '1.000', 'weapon2': '1.180', 'weapon3': '2.368', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:29,884][52668] DAMAGECOUNT value on done: 2791.0 [2024-08-05 22:04:29,885][52668] Sum rewards: 4.650, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.282', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.030', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'ARMOR': '0.088', 'AMMO3': '0.118', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.250', 'DAMAGECOUNT': '1.884', 'weapon3': '1.980', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:30,516][52660] DAMAGECOUNT value on done: 3225.0 [2024-08-05 22:04:30,516][52660] Sum rewards: 2.593, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.328', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.280', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.170', 'weapon2': '1.188', 'weapon3': '1.782', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:30,716][52820] DAMAGECOUNT value on done: 2750.0 [2024-08-05 22:04:30,717][52820] Sum rewards: 4.361, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.600', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.022', 'AMMO4': '0.022', 'ARMOR': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.636', 'weapon3': '1.658', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:31,728][52659] DAMAGECOUNT value on done: 4265.0 [2024-08-05 22:04:31,730][52659] Sum rewards: 2.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.434', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'ARMOR': '0.522', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon2': '1.514', 'DAMAGECOUNT': '1.722', 'weapon3': '2.332', 'FRAGCOUNT': '5.000'} [2024-08-05 22:04:31,749][52671] DAMAGECOUNT value on done: 2101.0 [2024-08-05 22:04:31,749][52671] Sum rewards: -2.597, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.868', 'weapon4': '0.002', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.390', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.200', 'weapon2': '1.628', 'weapon3': '1.944'} [2024-08-05 22:04:32,762][52668] DAMAGECOUNT value on done: 2847.0 [2024-08-05 22:04:32,763][52668] Sum rewards: 2.395, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.620', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.482', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.305', 'weapon2': '1.464', 'weapon3': '1.846', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17066.6, 300 sec: 16828.3). Total num frames: 40124416. Throughput: 0: 4265.1. Samples: 10030930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:04:32,795][52567] Avg episode reward: [(0, '1.453')] [2024-08-05 22:04:33,352][52660] DAMAGECOUNT value on done: 3080.0 [2024-08-05 22:04:33,354][52660] Sum rewards: 2.938, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.326', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON1': '0.020', 'AMMO3': '0.073', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.426', 'ARMOR': '0.497', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.170', 'weapon2': '1.320', 'weapon3': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:33,421][52664] DAMAGECOUNT value on done: 4055.0 [2024-08-05 22:04:33,423][52664] Sum rewards: 2.544, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.214', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon4': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.136', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'ARMOR': '0.890', 'weapon2': '1.420', 'weapon3': '1.904', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:33,798][52650] Updated weights for policy 0, policy_version 4901 (0.0028) [2024-08-05 22:04:34,077][52820] DAMAGECOUNT value on done: 2368.0 [2024-08-05 22:04:34,081][52820] Sum rewards: 4.844, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.708', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.380', 'weapon4': '0.388', 'ARMOR': '0.555', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.125', 'weapon2': '1.328', 'weapon3': '1.586', 'FRAGCOUNT': '6.000'} [2024-08-05 22:04:34,536][52659] DAMAGECOUNT value on done: 3379.0 [2024-08-05 22:04:34,538][52659] Sum rewards: 11.230, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.340', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.180', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.044', 'weapon3': '1.186', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '11.000'} [2024-08-05 22:04:34,573][52671] DAMAGECOUNT value on done: 3156.0 [2024-08-05 22:04:34,576][52671] Sum rewards: -1.163, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.040', 'weapon5': '0.062', 'AMMO4': '0.062', 'ARMOR': '0.092', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.310', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.154', 'DAMAGECOUNT': '1.179', 'weapon3': '1.688'} [2024-08-05 22:04:35,582][52668] DAMAGECOUNT value on done: 3215.0 [2024-08-05 22:04:35,583][52668] Sum rewards: 1.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'weapon5': '0.038', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.280', 'WEAPON3': '0.750', 'weapon2': '0.890', 'ARMOR': '1.036', 'DAMAGECOUNT': '1.053', 'weapon3': '1.420', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:36,190][52660] DAMAGECOUNT value on done: 2809.0 [2024-08-05 22:04:36,190][52660] Sum rewards: 6.741, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.863', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.118', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '1.220', 'DAMAGECOUNT': '2.166', 'weapon3': '2.318', 'FRAGCOUNT': '7.000'} [2024-08-05 22:04:37,413][52659] DAMAGECOUNT value on done: 3481.0 [2024-08-05 22:04:37,415][52659] Sum rewards: 3.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.754', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.123', 'HITCOUNT': '0.420', 'ARMOR': '0.529', 'WEAPON3': '0.750', 'weapon2': '1.470', 'DAMAGECOUNT': '1.635', 'weapon3': '2.060', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:37,447][52820] DAMAGECOUNT value on done: 2374.0 [2024-08-05 22:04:37,448][52820] Sum rewards: -3.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.958', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon5': '0.206', 'HITCOUNT': '0.340', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.870', 'ARMOR': '0.871', 'FRAGCOUNT': '1.000', 'weapon2': '1.490', 'weapon3': '1.732'} [2024-08-05 22:04:37,470][52671] DAMAGECOUNT value on done: 4217.0 [2024-08-05 22:04:37,471][52671] Sum rewards: 0.592, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.673', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'weapon4': '0.128', 'WEAPON4': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.092', 'weapon3': '1.400', 'FRAGCOUNT': '2.000', 'weapon2': '2.226'} [2024-08-05 22:04:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 40214528. Throughput: 0: 4270.5. Samples: 10056580. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:04:37,794][52567] Avg episode reward: [(0, '1.674')] [2024-08-05 22:04:38,537][52668] DAMAGECOUNT value on done: 3161.0 [2024-08-05 22:04:38,537][52668] Sum rewards: -0.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.136', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.123', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.286', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.930', 'FRAGCOUNT': '1.000', 'weapon2': '1.320', 'weapon3': '1.764'} [2024-08-05 22:04:38,789][52650] Updated weights for policy 0, policy_version 4911 (0.0012) [2024-08-05 22:04:39,396][52660] DAMAGECOUNT value on done: 3338.0 [2024-08-05 22:04:39,399][52660] Sum rewards: -0.162, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.672', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon7': '0.068', 'ARMOR': '0.072', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.456', 'weapon2': '0.684', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.999', 'weapon3': '1.552', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:40,345][52659] DAMAGECOUNT value on done: 2949.0 [2024-08-05 22:04:40,347][52659] Sum rewards: 2.207, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.059', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.398', 'weapon2': '1.744', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:40,394][52671] DAMAGECOUNT value on done: 2720.0 [2024-08-05 22:04:40,720][52820] DAMAGECOUNT value on done: 3342.0 [2024-08-05 22:04:40,722][52820] Sum rewards: 1.362, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.780', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.453', 'DAMAGECOUNT': '0.462', 'FRAGCOUNT': '1.000', 'weapon3': '1.208', 'weapon2': '1.244'} [2024-08-05 22:04:41,541][52614] Signal inference workers to stop experience collection... (950 times) [2024-08-05 22:04:41,551][52614] Signal inference workers to resume experience collection... (950 times) [2024-08-05 22:04:41,595][52650] InferenceWorker_p0-w0: stopping experience collection (950 times) [2024-08-05 22:04:41,604][52650] InferenceWorker_p0-w0: resuming experience collection (950 times) [2024-08-05 22:04:41,987][52668] DAMAGECOUNT value on done: 3126.0 [2024-08-05 22:04:41,987][52668] Sum rewards: 2.840, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.028', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.238', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'ARMOR': '1.033', 'weapon2': '1.230', 'DAMAGECOUNT': '1.284', 'weapon3': '1.632', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:42,694][52660] DAMAGECOUNT value on done: 3593.0 [2024-08-05 22:04:42,695][52660] Sum rewards: 1.586, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.024', 'weapon5': '0.026', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'HEALTH': '0.124', 'ARMOR': '0.436', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.312', 'DAMAGECOUNT': '1.752', 'weapon3': '1.768', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:42,798][52567] Fps is (10 sec: 17198.3, 60 sec: 17065.8, 300 sec: 16855.9). Total num frames: 40296448. Throughput: 0: 4272.2. Samples: 10082390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:04:42,802][52567] Avg episode reward: [(0, '1.556')] [2024-08-05 22:04:42,829][52671] DAMAGECOUNT value on done: 3294.0 [2024-08-05 22:04:42,831][52671] Sum rewards: 0.294, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon7': '0.048', 'ARMOR': '0.056', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon2': '0.716', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.233', 'weapon3': '2.388', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:42,868][52659] DAMAGECOUNT value on done: 3301.0 [2024-08-05 22:04:42,870][52659] Sum rewards: 2.563, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.642', 'AMMO2': '0.003', 'weapon4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'HITCOUNT': '0.530', 'ARMOR': '0.857', 'WEAPON3': '0.900', 'weapon2': '1.458', 'DAMAGECOUNT': '1.722', 'weapon3': '2.068', 'FRAGCOUNT': '6.000'} [2024-08-05 22:04:43,469][52650] Updated weights for policy 0, policy_version 4921 (0.0023) [2024-08-05 22:04:43,974][52820] DAMAGECOUNT value on done: 2932.0 [2024-08-05 22:04:43,975][52820] Sum rewards: -0.845, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.065', 'AMMO4': '0.076', 'weapon5': '0.120', 'AMMO3': '0.122', 'weapon4': '0.200', 'HITCOUNT': '0.260', 'weapon2': '0.666', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.588'} [2024-08-05 22:04:44,476][52668] DAMAGECOUNT value on done: 3179.0 [2024-08-05 22:04:44,480][52668] Sum rewards: -1.688, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO2': '0.020', 'AMMO5': '0.020', 'weapon5': '0.030', 'ARMOR': '0.056', 'AMMO4': '0.099', 'AMMO3': '0.120', 'weapon4': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'weapon2': '1.488', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '2.000', 'weapon3': '2.012'} [2024-08-05 22:04:45,065][52660] DAMAGECOUNT value on done: 3062.0 [2024-08-05 22:04:45,066][52660] Sum rewards: 2.398, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'HEALTH': '0.012', 'AMMO3': '0.050', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.430', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'weapon2': '1.144', 'DAMAGECOUNT': '1.170'} [2024-08-05 22:04:45,571][52659] DAMAGECOUNT value on done: 2560.0 [2024-08-05 22:04:45,573][52659] Sum rewards: 1.467, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.504', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.030', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.152', 'weapon4': '0.180', 'HITCOUNT': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'ARMOR': '0.566', 'DAMAGECOUNT': '0.840', 'weapon2': '1.434', 'weapon3': '1.628', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:47,059][52668] DAMAGECOUNT value on done: 3239.0 [2024-08-05 22:04:47,061][52668] Sum rewards: 3.999, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.816', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.172', 'HITCOUNT': '0.450', 'ARMOR': '0.524', 'WEAPON3': '0.600', 'weapon2': '1.360', 'weapon3': '1.428', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:47,643][52660] DAMAGECOUNT value on done: 3099.0 [2024-08-05 22:04:47,645][52660] Sum rewards: 1.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.232', 'AMMO2': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon5': '0.068', 'AMMO3': '0.114', 'WEAPON5': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.497', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.344', 'weapon2': '1.712', 'weapon3': '1.998', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.8, 300 sec: 16828.3). Total num frames: 40378368. Throughput: 0: 4277.3. Samples: 10095480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 22:04:47,794][52567] Avg episode reward: [(0, '1.527')] [2024-08-05 22:04:48,240][52659] DAMAGECOUNT value on done: 3766.0 [2024-08-05 22:04:48,240][52659] Sum rewards: 1.330, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO3': '0.093', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.140', 'weapon3': '1.518', 'weapon2': '1.862', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:48,442][52650] Updated weights for policy 0, policy_version 4931 (0.0014) [2024-08-05 22:04:50,087][52668] DAMAGECOUNT value on done: 2449.0 [2024-08-05 22:04:50,088][52668] Sum rewards: 3.876, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.378', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.194', 'HITCOUNT': '0.220', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.774', 'ARMOR': '0.808', 'weapon3': '1.096', 'weapon2': '1.612', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:50,833][52660] DAMAGECOUNT value on done: 3342.0 [2024-08-05 22:04:50,835][52660] Sum rewards: 0.933, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.142', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.186', 'HITCOUNT': '0.420', 'ARMOR': '0.535', 'WEAPON3': '0.950', 'weapon2': '1.080', 'DAMAGECOUNT': '1.659', 'weapon3': '2.178', 'FRAGCOUNT': '3.000'} [2024-08-05 22:04:52,794][52567] Fps is (10 sec: 17208.3, 60 sec: 17066.7, 300 sec: 16883.8). Total num frames: 40468480. Throughput: 0: 4286.4. Samples: 10121280. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-05 22:04:52,795][52567] Avg episode reward: [(0, '1.545')] [2024-08-05 22:04:52,947][52650] Updated weights for policy 0, policy_version 4941 (0.0037) [2024-08-05 22:04:52,948][52668] DAMAGECOUNT value on done: 2493.0 [2024-08-05 22:04:52,950][52668] Sum rewards: 0.270, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.064', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.125', 'weapon4': '0.128', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'ARMOR': '0.922', 'DAMAGECOUNT': '1.596', 'weapon2': '1.598', 'weapon3': '1.798', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:53,564][52660] DAMAGECOUNT value on done: 2465.0 [2024-08-05 22:04:53,566][52660] Sum rewards: 1.296, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'ARMOR': '0.110', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.098', 'weapon3': '1.512', 'weapon2': '1.746', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:54,658][52794] DAMAGECOUNT value on done: 3045.0 [2024-08-05 22:04:54,660][52794] Sum rewards: 1.443, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.293', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.700', 'ARMOR': '0.865', 'DAMAGECOUNT': '0.945', 'weapon3': '1.700', 'weapon2': '1.958', 'FRAGCOUNT': '2.000'} [2024-08-05 22:04:56,277][52660] DAMAGECOUNT value on done: 4143.0 [2024-08-05 22:04:56,278][52660] Sum rewards: 1.217, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.582', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.076', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'HITCOUNT': '0.130', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.278', 'ARMOR': '0.481', 'DAMAGECOUNT': '0.546', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.196', 'weapon3': '1.256'} [2024-08-05 22:04:57,133][52794] DAMAGECOUNT value on done: 3658.0 [2024-08-05 22:04:57,134][52794] Sum rewards: 5.780, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.066', 'AMMO3': '0.105', 'HEALTH': '0.152', 'weapon4': '0.168', 'ARMOR': '0.457', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.540', 'weapon3': '1.852', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '4.000'} [2024-08-05 22:04:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.8, 300 sec: 16856.1). Total num frames: 40550400. Throughput: 0: 4293.3. Samples: 10147090. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:04:57,802][52567] Avg episode reward: [(0, '1.596')] [2024-08-05 22:04:57,898][52650] Updated weights for policy 0, policy_version 4951 (0.0034) [2024-08-05 22:04:58,139][52662] DAMAGECOUNT value on done: 3088.0 [2024-08-05 22:04:58,140][52662] Sum rewards: 0.129, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.228', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.082', 'HITCOUNT': '0.380', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.342', 'weapon3': '1.374', 'DAMAGECOUNT': '1.380'} [2024-08-05 22:04:59,675][52794] DAMAGECOUNT value on done: 3876.0 [2024-08-05 22:04:59,676][52794] Sum rewards: 2.945, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.003', 'AMMO5': '0.005', 'HEALTH': '0.012', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'ARMOR': '0.454', 'DAMAGECOUNT': '0.840', 'FRAGCOUNT': '1.000', 'weapon3': '1.172', 'weapon2': '1.610'} [2024-08-05 22:05:00,649][52662] DAMAGECOUNT value on done: 3270.0 [2024-08-05 22:05:00,651][52662] Sum rewards: -0.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.136', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'HITCOUNT': '0.340', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.125', 'weapon2': '1.388', 'weapon3': '2.424', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:02,484][52794] DAMAGECOUNT value on done: 3938.0 [2024-08-05 22:05:02,485][52794] Sum rewards: 0.916, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.013', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO3': '0.080', 'HITCOUNT': '0.310', 'ARMOR': '0.525', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.008', 'weapon3': '1.294', 'weapon2': '1.442', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 40632320. Throughput: 0: 4289.3. Samples: 10159840. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:05:02,802][52567] Avg episode reward: [(0, '1.610')] [2024-08-05 22:05:02,829][52650] Updated weights for policy 0, policy_version 4961 (0.0021) [2024-08-05 22:05:03,574][52662] DAMAGECOUNT value on done: 3468.0 [2024-08-05 22:05:03,575][52662] Sum rewards: 4.476, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.027', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'HEALTH': '0.186', 'HITCOUNT': '0.230', 'weapon4': '0.298', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.861', 'weapon2': '1.312', 'ARMOR': '1.369', 'weapon3': '1.572', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:05,045][52794] DAMAGECOUNT value on done: 3820.0 [2024-08-05 22:05:05,045][52794] Sum rewards: 0.337, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.817', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.049', 'AMMO3': '0.062', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.954', 'weapon3': '1.398', 'weapon2': '1.542', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:06,111][52662] DAMAGECOUNT value on done: 3010.0 [2024-08-05 22:05:06,113][52662] Sum rewards: 2.555, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.952', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.420', 'ARMOR': '0.532', 'WEAPON3': '0.750', 'weapon2': '0.892', 'DAMAGECOUNT': '1.413', 'weapon3': '1.602', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:07,283][52650] Updated weights for policy 0, policy_version 4971 (0.0027) [2024-08-05 22:05:07,758][52794] DAMAGECOUNT value on done: 3808.0 [2024-08-05 22:05:07,758][52794] Sum rewards: 2.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.830', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.014', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.254', 'weapon2': '1.264', 'weapon3': '1.426', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17203.2, 300 sec: 16883.9). Total num frames: 40730624. Throughput: 0: 4291.3. Samples: 10185790. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-05 22:05:07,795][52567] Avg episode reward: [(0, '1.612')] [2024-08-05 22:05:08,703][52662] DAMAGECOUNT value on done: 3683.0 [2024-08-05 22:05:08,703][52662] Sum rewards: 0.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.052', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'HITCOUNT': '0.340', 'weapon4': '0.424', 'WEAPON3': '0.700', 'ARMOR': '0.940', 'DAMAGECOUNT': '1.155', 'weapon2': '1.228', 'weapon3': '1.510', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:10,209][52794] DAMAGECOUNT value on done: 3145.0 [2024-08-05 22:05:10,209][52794] Sum rewards: 4.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.038', 'ARMOR': '0.080', 'AMMO3': '0.083', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.050', 'weapon2': '1.564', 'weapon3': '1.850', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:11,357][52662] DAMAGECOUNT value on done: 4113.0 [2024-08-05 22:05:11,358][52662] Sum rewards: 0.785, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.349', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.016', 'AMMO4': '0.026', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.270', 'ARMOR': '0.560', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.921', 'weapon3': '1.450', 'weapon2': '1.938', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:12,261][52650] Updated weights for policy 0, policy_version 4981 (0.0020) [2024-08-05 22:05:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17203.2, 300 sec: 16911.6). Total num frames: 40812544. Throughput: 0: 4286.7. Samples: 10211380. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:05:12,802][52567] Avg episode reward: [(0, '1.619')] [2024-08-05 22:05:12,961][52794] DAMAGECOUNT value on done: 3263.0 [2024-08-05 22:05:12,962][52794] Sum rewards: 2.436, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.554', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.070', 'weapon4': '0.158', 'HITCOUNT': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.507', 'weapon2': '1.224', 'weapon3': '1.284', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:14,237][52662] DAMAGECOUNT value on done: 4501.0 [2024-08-05 22:05:14,237][52662] Sum rewards: 0.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.188', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.028', 'ARMOR': '0.060', 'weapon4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.122', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.050', 'weapon2': '1.372', 'weapon3': '2.176', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:15,741][52794] DAMAGECOUNT value on done: 4194.0 [2024-08-05 22:05:15,741][52794] Sum rewards: 0.929, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.296', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.026', 'ARMOR': '0.072', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.122', 'weapon2': '1.724', 'weapon3': '1.954', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:16,638][52662] DAMAGECOUNT value on done: 4012.0 [2024-08-05 22:05:16,638][52662] Sum rewards: 4.398, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.021', 'weapon7': '0.066', 'HEALTH': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'ARMOR': '0.136', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.520', 'weapon2': '0.526', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'DAMAGECOUNT': '2.052', 'weapon3': '2.122', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:16,899][52650] Updated weights for policy 0, policy_version 4991 (0.0029) [2024-08-05 22:05:17,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17066.7, 300 sec: 16883.9). Total num frames: 40894464. Throughput: 0: 4293.4. Samples: 10224130. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-05 22:05:17,802][52567] Avg episode reward: [(0, '1.662')] [2024-08-05 22:05:18,150][52794] DAMAGECOUNT value on done: 2978.0 [2024-08-05 22:05:18,152][52794] Sum rewards: -1.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.924', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.280', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.774', 'FRAGCOUNT': '1.000', 'weapon2': '1.582', 'weapon3': '1.796'} [2024-08-05 22:05:19,137][52662] DAMAGECOUNT value on done: 3871.0 [2024-08-05 22:05:19,140][52662] Sum rewards: 0.450, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon5': '0.032', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'ARMOR': '0.444', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.182', 'weapon2': '1.828', 'weapon3': '1.930', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:20,609][52794] DAMAGECOUNT value on done: 3441.0 [2024-08-05 22:05:20,609][52794] Sum rewards: 5.151, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.350', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'weapon5': '0.406', 'ARMOR': '0.456', 'weapon3': '1.092', 'DAMAGECOUNT': '1.290', 'weapon2': '1.634', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:21,142][52660] Large shaping reward -2.554 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.006, -6.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 22:05:21,683][52650] Updated weights for policy 0, policy_version 5001 (0.0011) [2024-08-05 22:05:21,685][52662] DAMAGECOUNT value on done: 3741.0 [2024-08-05 22:05:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 16884.2). Total num frames: 40984576. Throughput: 0: 4295.8. Samples: 10249890. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:05:22,802][52567] Avg episode reward: [(0, '1.724')] [2024-08-05 22:05:23,074][52794] DAMAGECOUNT value on done: 3880.0 [2024-08-05 22:05:23,074][52794] Sum rewards: 3.679, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'weapon5': '0.056', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.230', 'weapon4': '0.268', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.738', 'ARMOR': '0.946', 'weapon3': '1.526', 'weapon2': '1.630', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:23,987][52662] DAMAGECOUNT value on done: 3467.0 [2024-08-05 22:05:25,594][52794] DAMAGECOUNT value on done: 3381.0 [2024-08-05 22:05:25,595][52794] Sum rewards: 2.534, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'AMMO3': '0.104', 'weapon5': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.467', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.425', 'weapon2': '1.472', 'weapon3': '1.896', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:26,424][52662] DAMAGECOUNT value on done: 3085.0 [2024-08-05 22:05:26,424][52662] Sum rewards: 1.041, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.572', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.124', 'HITCOUNT': '0.190', 'DAMAGECOUNT': '0.618', 'WEAPON3': '0.700', 'ARMOR': '1.381', 'weapon3': '1.592', 'weapon2': '1.990', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:26,592][52650] Updated weights for policy 0, policy_version 5011 (0.0018) [2024-08-05 22:05:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17203.2, 300 sec: 16911.6). Total num frames: 41074688. Throughput: 0: 4293.4. Samples: 10275580. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 22:05:27,794][52567] Avg episode reward: [(0, '1.682')] [2024-08-05 22:05:28,138][52794] DAMAGECOUNT value on done: 4587.0 [2024-08-05 22:05:28,138][52794] Sum rewards: 3.057, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.010', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.060', 'ARMOR': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.266', 'weapon3': '1.400', 'weapon2': '1.618', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:28,948][52662] DAMAGECOUNT value on done: 3861.0 [2024-08-05 22:05:28,948][52662] Sum rewards: 5.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.346', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'ARMOR': '0.103', 'weapon4': '0.110', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.270', 'weapon3': '2.304', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '5.000'} [2024-08-05 22:05:30,591][52794] DAMAGECOUNT value on done: 4008.0 [2024-08-05 22:05:30,591][52794] Sum rewards: 4.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.424', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.070', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon3': '1.474', 'ARMOR': '1.666', 'DAMAGECOUNT': '1.695', 'weapon2': '1.710', 'FRAGCOUNT': '5.000'} [2024-08-05 22:05:30,995][52650] Updated weights for policy 0, policy_version 5021 (0.0026) [2024-08-05 22:05:31,518][52662] DAMAGECOUNT value on done: 3941.0 [2024-08-05 22:05:31,519][52662] Sum rewards: -3.014, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.327', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.180', 'HITCOUNT': '0.260', 'ARMOR': '0.436', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.792', 'weapon2': '1.592', 'weapon3': '1.714', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.3, 300 sec: 16911.6). Total num frames: 41156608. Throughput: 0: 4290.7. Samples: 10288560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:05:32,802][52567] Avg episode reward: [(0, '1.728')] [2024-08-05 22:05:33,088][52794] DAMAGECOUNT value on done: 4163.0 [2024-08-05 22:05:33,089][52794] Sum rewards: 6.917, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.416', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.114', 'WEAPON5': '0.200', 'ARMOR': '0.508', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.258', 'weapon3': '1.930', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '6.500'} [2024-08-05 22:05:34,113][52662] DAMAGECOUNT value on done: 3510.0 [2024-08-05 22:05:34,115][52662] Sum rewards: 2.326, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.732', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.126', 'ARMOR': '0.489', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.336', 'weapon3': '1.710', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:34,587][52666] DAMAGECOUNT value on done: 2641.0 [2024-08-05 22:05:34,589][52666] Sum rewards: 0.509, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.314', 'AMMO2': '0.006', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'ARMOR': '0.068', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.406', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.945', 'FRAGCOUNT': '1.000', 'weapon2': '1.190', 'weapon3': '1.716'} [2024-08-05 22:05:35,915][52794] DAMAGECOUNT value on done: 4037.0 [2024-08-05 22:05:35,916][52794] Sum rewards: 3.402, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.152', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'HITCOUNT': '0.240', 'weapon4': '0.308', 'WEAPON3': '0.350', 'ARMOR': '0.574', 'DAMAGECOUNT': '0.786', 'weapon3': '1.154', 'weapon2': '1.336', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:36,406][52650] Updated weights for policy 0, policy_version 5031 (0.0040) [2024-08-05 22:05:37,091][52662] DAMAGECOUNT value on done: 4414.0 [2024-08-05 22:05:37,092][52662] Sum rewards: 2.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.144', 'weapon4': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'HITCOUNT': '0.350', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.188', 'weapon3': '1.474', 'weapon2': '1.650', 'FRAGCOUNT': '5.000'} [2024-08-05 22:05:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 16883.8). Total num frames: 41246720. Throughput: 0: 4286.9. Samples: 10314190. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:05:37,802][52567] Avg episode reward: [(0, '1.790')] [2024-08-05 22:05:37,805][52670] DAMAGECOUNT value on done: 3553.0 [2024-08-05 22:05:37,808][52670] Sum rewards: 1.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.107', 'weapon4': '0.226', 'HITCOUNT': '0.400', 'ARMOR': '0.452', 'WEAPON3': '0.700', 'weapon2': '1.100', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '2.000', 'weapon3': '2.004'} [2024-08-05 22:05:37,848][52666] DAMAGECOUNT value on done: 3840.0 [2024-08-05 22:05:37,849][52666] Sum rewards: 4.177, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.462', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.062', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'ARMOR': '0.489', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.412', 'weapon2': '1.566', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 22:05:38,732][52794] DAMAGECOUNT value on done: 4569.0 [2024-08-05 22:05:38,732][52794] Sum rewards: 1.223, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.012', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.167', 'weapon4': '0.258', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.092', 'weapon3': '1.286', 'DAMAGECOUNT': '1.350'} [2024-08-05 22:05:39,657][52662] DAMAGECOUNT value on done: 2987.0 [2024-08-05 22:05:39,657][52662] Sum rewards: 1.800, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.671', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.204', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.125', 'weapon3': '1.638', 'weapon2': '1.748', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:40,542][52650] Updated weights for policy 0, policy_version 5041 (0.0028) [2024-08-05 22:05:41,274][52794] DAMAGECOUNT value on done: 3765.0 [2024-08-05 22:05:41,274][52794] Sum rewards: 4.929, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'AMMO4': '0.097', 'weapon4': '0.218', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'HEALTH': '0.582', 'weapon2': '0.768', 'weapon3': '0.862', 'DAMAGECOUNT': '1.215', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:41,290][52670] DAMAGECOUNT value on done: 3057.0 [2024-08-05 22:05:41,290][52670] Sum rewards: 3.816, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.410', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'weapon5': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.188', 'HITCOUNT': '0.390', 'ARMOR': '0.540', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.272', 'weapon2': '1.314', 'weapon3': '1.724', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:41,375][52666] DAMAGECOUNT value on done: 3104.0 [2024-08-05 22:05:41,377][52666] Sum rewards: 2.614, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.084', 'HEALTH': '0.126', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'ARMOR': '0.848', 'weapon2': '1.106', 'DAMAGECOUNT': '1.215', 'weapon3': '1.600', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:42,306][52662] DAMAGECOUNT value on done: 4025.0 [2024-08-05 22:05:42,306][52662] Sum rewards: 6.863, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.302', 'HEALTH': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon2': '1.434', 'DAMAGECOUNT': '1.524', 'weapon3': '1.608', 'FRAGCOUNT': '5.000'} [2024-08-05 22:05:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17204.1, 300 sec: 16883.9). Total num frames: 41328640. Throughput: 0: 4286.0. Samples: 10339960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:05:42,802][52567] Avg episode reward: [(0, '1.855')] [2024-08-05 22:05:44,139][52794] DAMAGECOUNT value on done: 4137.0 [2024-08-05 22:05:44,139][52794] Sum rewards: 4.893, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.096', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'weapon5': '0.028', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'ARMOR': '0.447', 'HITCOUNT': '0.760', 'WEAPON3': '0.950', 'weapon2': '1.398', 'weapon3': '1.798', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '6.000'} [2024-08-05 22:05:44,270][52670] DAMAGECOUNT value on done: 3319.0 [2024-08-05 22:05:44,271][52670] Sum rewards: 3.289, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.090', 'WEAPON3': '0.500', 'ARMOR': '0.501', 'HITCOUNT': '0.540', 'weapon3': '1.556', 'DAMAGECOUNT': '1.815', 'weapon2': '1.854', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:44,374][52666] DAMAGECOUNT value on done: 3404.0 [2024-08-05 22:05:44,375][52666] Sum rewards: 7.771, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.964', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.117', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'ARMOR': '1.379', 'weapon3': '1.884', 'weapon2': '1.986', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '8.000'} [2024-08-05 22:05:44,990][52662] DAMAGECOUNT value on done: 3716.0 [2024-08-05 22:05:44,990][52662] Sum rewards: 5.404, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.323', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.116', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.378', 'ARMOR': '1.388', 'DAMAGECOUNT': '1.842', 'weapon3': '1.862', 'FRAGCOUNT': '7.000'} [2024-08-05 22:05:45,890][52650] Updated weights for policy 0, policy_version 5051 (0.0025) [2024-08-05 22:05:47,362][52670] DAMAGECOUNT value on done: 2976.0 [2024-08-05 22:05:47,366][52670] Sum rewards: 3.414, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.673', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'weapon7': '0.048', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON7': '0.200', 'HITCOUNT': '0.280', 'ARMOR': '0.472', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.870', 'weapon2': '1.042', 'weapon3': '1.460', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:47,443][52666] DAMAGECOUNT value on done: 3170.0 [2024-08-05 22:05:47,447][52666] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.401', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.346', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.360', 'weapon3': '1.636', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '5.000'} [2024-08-05 22:05:47,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17203.1, 300 sec: 16883.8). Total num frames: 41410560. Throughput: 0: 4288.4. Samples: 10352820. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:05:47,795][52567] Avg episode reward: [(0, '2.046')] [2024-08-05 22:05:48,057][52662] DAMAGECOUNT value on done: 3514.0 [2024-08-05 22:05:48,057][52662] Sum rewards: 3.614, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.654', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.490', 'WEAPON3': '0.900', 'ARMOR': '1.252', 'DAMAGECOUNT': '1.548', 'weapon2': '1.618', 'weapon3': '1.792', 'FRAGCOUNT': '6.000'} [2024-08-05 22:05:50,354][52650] Updated weights for policy 0, policy_version 5061 (0.0041) [2024-08-05 22:05:50,417][52670] DAMAGECOUNT value on done: 2604.0 [2024-08-05 22:05:50,419][52670] Sum rewards: 6.656, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.250', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'AMMO3': '0.069', 'WEAPON5': '0.200', 'ARMOR': '0.460', 'HITCOUNT': '0.510', 'weapon5': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.126', 'weapon3': '1.320', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'} [2024-08-05 22:05:50,516][52666] DAMAGECOUNT value on done: 3234.0 [2024-08-05 22:05:50,518][52666] Sum rewards: 9.598, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.067', 'weapon7': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.172', 'WEAPON7': '0.200', 'ARMOR': '0.448', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '1.084', 'weapon3': '1.168', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '7.000'} [2024-08-05 22:05:52,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 41492480. Throughput: 0: 4256.0. Samples: 10377310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-05 22:05:52,802][52567] Avg episode reward: [(0, '2.214')] [2024-08-05 22:05:53,680][52670] DAMAGECOUNT value on done: 3300.0 [2024-08-05 22:05:53,682][52670] Sum rewards: 0.897, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.652', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.050', 'HITCOUNT': '0.100', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.351', 'ARMOR': '0.849', 'weapon3': '0.998', 'weapon2': '1.394', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:53,781][52666] DAMAGECOUNT value on done: 3251.0 [2024-08-05 22:05:53,787][52666] Sum rewards: -1.084, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.220', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO3': '0.162', 'weapon5': '0.162', 'HITCOUNT': '0.260', 'ARMOR': '0.572', 'DAMAGECOUNT': '0.930', 'WEAPON3': '1.000', 'weapon2': '1.492', 'weapon3': '1.840', 'FRAGCOUNT': '2.000'} [2024-08-05 22:05:55,162][52650] Updated weights for policy 0, policy_version 5071 (0.0019) [2024-08-05 22:05:56,444][52670] DAMAGECOUNT value on done: 3412.0 [2024-08-05 22:05:56,446][52670] Sum rewards: 2.706, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.405', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.081', 'HITCOUNT': '0.320', 'ARMOR': '0.418', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.164', 'weapon2': '1.402', 'weapon3': '1.440', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:56,491][52666] DAMAGECOUNT value on done: 3250.0 [2024-08-05 22:05:56,493][52666] Sum rewards: 4.397, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.370', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.034', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.176', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'weapon2': '1.236', 'DAMAGECOUNT': '1.926', 'weapon3': '2.024', 'FRAGCOUNT': '6.000'} [2024-08-05 22:05:57,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17203.2, 300 sec: 16967.2). Total num frames: 41582592. Throughput: 0: 4262.0. Samples: 10403170. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 22:05:57,794][52567] Avg episode reward: [(0, '2.193')] [2024-08-05 22:05:59,510][52670] DAMAGECOUNT value on done: 3178.0 [2024-08-05 22:05:59,512][52670] Sum rewards: 2.555, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.045', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'AMMO3': '0.080', 'ARMOR': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.150', 'HITCOUNT': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.334', 'weapon2': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.747', 'weapon3': '1.938', 'FRAGCOUNT': '3.000'} [2024-08-05 22:05:59,541][52666] DAMAGECOUNT value on done: 3736.0 [2024-08-05 22:05:59,544][52666] Sum rewards: 3.931, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.991', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'weapon4': '0.128', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'ARMOR': '0.971', 'weapon2': '1.502', 'weapon3': '1.616', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:00,226][52650] Updated weights for policy 0, policy_version 5081 (0.0014) [2024-08-05 22:06:02,315][52665] DAMAGECOUNT value on done: 4037.0 [2024-08-05 22:06:02,318][52665] Sum rewards: 3.270, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.505', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.130', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'ARMOR': '0.512', 'weapon3': '1.160', 'DAMAGECOUNT': '1.326', 'weapon2': '1.932', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:02,724][52670] DAMAGECOUNT value on done: 2140.0 [2024-08-05 22:06:02,727][52670] Sum rewards: 3.206, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.197', 'ARMOR': '1.279', 'weapon2': '1.418', 'weapon3': '1.570', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:02,749][52666] DAMAGECOUNT value on done: 3068.0 [2024-08-05 22:06:02,754][52666] Sum rewards: 6.453, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.702', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.067', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.947', 'weapon3': '1.252', 'weapon2': '1.332', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17203.2, 300 sec: 17022.7). Total num frames: 41664512. Throughput: 0: 4266.4. Samples: 10416120. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:06:02,794][52567] Avg episode reward: [(0, '2.357')] [2024-08-05 22:06:02,795][52614] Saving new best policy, reward=2.357! [2024-08-05 22:06:04,642][52669] DAMAGECOUNT value on done: 2909.0 [2024-08-05 22:06:04,644][52669] Sum rewards: 4.619, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.521', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.040', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'ARMOR': '0.424', 'weapon3': '0.944', 'DAMAGECOUNT': '1.146', 'weapon2': '1.242', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:04,923][52650] Updated weights for policy 0, policy_version 5091 (0.0030) [2024-08-05 22:06:05,567][52665] DAMAGECOUNT value on done: 3580.0 [2024-08-05 22:06:05,567][52665] Sum rewards: 6.788, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO2': '0.002', 'weapon4': '0.006', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'weapon2': '1.344', 'weapon3': '1.678', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '7.000'} [2024-08-05 22:06:05,670][52670] DAMAGECOUNT value on done: 2836.0 [2024-08-05 22:06:05,670][52670] Sum rewards: 0.214, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.170', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'AMMO3': '0.096', 'HITCOUNT': '0.250', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.891', 'FRAGCOUNT': '1.000', 'weapon3': '1.392', 'ARMOR': '1.419', 'weapon2': '2.154'} [2024-08-05 22:06:05,705][52666] DAMAGECOUNT value on done: 3192.0 [2024-08-05 22:06:07,794][52567] Fps is (10 sec: 15564.5, 60 sec: 16793.6, 300 sec: 16994.9). Total num frames: 41738240. Throughput: 0: 4222.4. Samples: 10439900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:06:07,795][52567] Avg episode reward: [(0, '2.458')] [2024-08-05 22:06:07,799][52614] Saving new best policy, reward=2.458! [2024-08-05 22:06:08,215][52669] DAMAGECOUNT value on done: 3053.0 [2024-08-05 22:06:08,219][52669] Sum rewards: 3.780, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.360', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.088', 'HITCOUNT': '0.450', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'weapon3': '1.384', 'DAMAGECOUNT': '1.395', 'weapon2': '1.552', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:09,954][52665] DAMAGECOUNT value on done: 4256.0 [2024-08-05 22:06:09,957][52665] Sum rewards: 4.737, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.421', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'weapon5': '0.008', 'AMMO5': '0.012', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'ARMOR': '0.891', 'weapon3': '1.826', 'weapon2': '1.842', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:10,491][52666] DAMAGECOUNT value on done: 3370.0 [2024-08-05 22:06:10,494][52666] Sum rewards: 3.775, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon7': '0.012', 'weapon5': '0.020', 'weapon4': '0.048', 'AMMO4': '0.053', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.480', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '1.134', 'DAMAGECOUNT': '1.770', 'weapon3': '2.372', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:10,577][52670] DAMAGECOUNT value on done: 3359.0 [2024-08-05 22:06:10,581][52670] Sum rewards: 2.067, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.434', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.117', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'ARMOR': '0.868', 'DAMAGECOUNT': '1.431', 'weapon3': '1.594', 'weapon2': '1.732', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:11,861][52669] DAMAGECOUNT value on done: 3057.0 [2024-08-05 22:06:11,862][52669] Sum rewards: -1.525, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.355', 'AMMO2': '0.033', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'HITCOUNT': '0.220', 'ARMOR': '0.476', 'weapon4': '0.536', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.699', 'FRAGCOUNT': '1.000', 'weapon3': '1.118', 'weapon2': '1.292'} [2024-08-05 22:06:12,028][52650] Updated weights for policy 0, policy_version 5101 (0.0035) [2024-08-05 22:06:12,795][52567] Fps is (10 sec: 13106.8, 60 sec: 16383.9, 300 sec: 16883.8). Total num frames: 41795584. Throughput: 0: 4033.3. Samples: 10457080. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:06:12,795][52567] Avg episode reward: [(0, '2.494')] [2024-08-05 22:06:12,796][52614] Saving new best policy, reward=2.494! [2024-08-05 22:06:14,428][52665] DAMAGECOUNT value on done: 2796.0 [2024-08-05 22:06:14,429][52665] Sum rewards: 5.975, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.000', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.138', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon3': '1.084', 'DAMAGECOUNT': '1.560', 'weapon2': '1.570', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:14,914][52666] DAMAGECOUNT value on done: 3111.0 [2024-08-05 22:06:14,914][52666] Sum rewards: 5.900, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.508', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.119', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'ARMOR': '0.982', 'weapon2': '1.528', 'weapon3': '1.636', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:14,926][52670] DAMAGECOUNT value on done: 3719.0 [2024-08-05 22:06:15,121][52669] DAMAGECOUNT value on done: 5209.0 [2024-08-05 22:06:15,124][52669] Sum rewards: 8.370, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.022', 'weapon7': '0.078', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'HEALTH': '0.163', 'weapon4': '0.412', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '0.806', 'weapon3': '1.650', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:17,208][52650] Updated weights for policy 0, policy_version 5111 (0.0035) [2024-08-05 22:06:17,331][52665] DAMAGECOUNT value on done: 3653.0 [2024-08-05 22:06:17,331][52665] Sum rewards: 2.655, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.345', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon5': '0.032', 'weapon4': '0.064', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'weapon2': '1.520', 'DAMAGECOUNT': '1.644', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:17,794][52567] Fps is (10 sec: 13107.5, 60 sec: 16247.5, 300 sec: 16856.1). Total num frames: 41869312. Throughput: 0: 3982.0. Samples: 10467750. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 22:06:17,794][52567] Avg episode reward: [(0, '2.523')] [2024-08-05 22:06:17,841][52614] Saving new best policy, reward=2.523! [2024-08-05 22:06:17,979][52669] DAMAGECOUNT value on done: 3358.0 [2024-08-05 22:06:17,979][52669] Sum rewards: -0.161, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.252', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'HITCOUNT': '0.330', 'ARMOR': '0.480', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.209', 'weapon2': '1.642', 'weapon3': '1.686', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:18,015][52670] DAMAGECOUNT value on done: 3315.0 [2024-08-05 22:06:18,016][52670] Sum rewards: 1.572, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.078', 'AMMO2': '0.011', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.116', 'HITCOUNT': '0.220', 'WEAPON3': '0.350', 'ARMOR': '0.488', 'DAMAGECOUNT': '0.681', 'FRAGCOUNT': '1.000', 'weapon3': '1.006', 'weapon2': '1.372'} [2024-08-05 22:06:18,039][52666] DAMAGECOUNT value on done: 3391.0 [2024-08-05 22:06:18,039][52666] Sum rewards: 3.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.521', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.129', 'weapon4': '0.218', 'ARMOR': '0.428', 'HITCOUNT': '0.520', 'WEAPON3': '0.950', 'weapon2': '1.362', 'DAMAGECOUNT': '1.830', 'weapon3': '1.956', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:20,339][52665] DAMAGECOUNT value on done: 3271.0 [2024-08-05 22:06:20,339][52665] Sum rewards: 3.731, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.878', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON1': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon5': '0.270', 'ARMOR': '0.496', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.168', 'weapon3': '1.800', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '4.500'} [2024-08-05 22:06:20,695][52669] DAMAGECOUNT value on done: 3834.0 [2024-08-05 22:06:20,697][52669] Sum rewards: 1.994, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.121', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO3': '0.075', 'WEAPON4': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.344', 'WEAPON3': '0.600', 'ARMOR': '0.631', 'DAMAGECOUNT': '0.975', 'weapon2': '1.150', 'weapon3': '1.434', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:20,906][52666] DAMAGECOUNT value on done: 2620.0 [2024-08-05 22:06:20,908][52670] DAMAGECOUNT value on done: 3682.0 [2024-08-05 22:06:20,908][52670] Sum rewards: 0.220, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.042', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.109', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.348', 'ARMOR': '0.519', 'weapon4': '0.520', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.567', 'weapon2': '0.838', 'weapon3': '1.840'} [2024-08-05 22:06:21,799][52663] DAMAGECOUNT value on done: 3417.0 [2024-08-05 22:06:21,800][52663] Sum rewards: 7.103, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.513', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.021', 'weapon4': '0.034', 'WEAPON1': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'ARMOR': '0.992', 'weapon3': '1.766', 'weapon2': '1.846', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:22,178][52650] Updated weights for policy 0, policy_version 5121 (0.0013) [2024-08-05 22:06:22,302][52647] DAMAGECOUNT value on done: 2875.0 [2024-08-05 22:06:22,305][52647] Sum rewards: -3.214, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.013', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'ARMOR': '0.040', 'AMMO3': '0.136', 'HITCOUNT': '0.470', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.383', 'weapon2': '1.622', 'weapon3': '2.226'} [2024-08-05 22:06:22,794][52567] Fps is (10 sec: 16384.6, 60 sec: 16247.5, 300 sec: 16856.1). Total num frames: 41959424. Throughput: 0: 3996.2. Samples: 10494020. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:06:22,794][52567] Avg episode reward: [(0, '2.548')] [2024-08-05 22:06:22,795][52614] Saving new best policy, reward=2.548! [2024-08-05 22:06:23,431][52666] DAMAGECOUNT value on done: 3209.0 [2024-08-05 22:06:23,433][52666] Sum rewards: 2.823, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.040', 'HEALTH': '0.138', 'HITCOUNT': '0.190', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.531', 'weapon3': '0.788', 'weapon2': '1.106', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:23,435][52670] DAMAGECOUNT value on done: 3254.0 [2024-08-05 22:06:23,438][52670] Sum rewards: 5.560, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.468', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.500', 'ARMOR': '0.516', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.464', 'weapon3': '1.684', 'weapon2': '1.796', 'FRAGCOUNT': '7.000'} [2024-08-05 22:06:23,699][52665] DAMAGECOUNT value on done: 3587.0 [2024-08-05 22:06:23,699][52665] Sum rewards: 6.316, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon5': '0.074', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.480', 'HITCOUNT': '0.690', 'HEALTH': '0.754', 'WEAPON3': '0.900', 'weapon2': '0.924', 'DAMAGECOUNT': '2.685', 'weapon3': '2.720', 'FRAGCOUNT': '8.000'} [2024-08-05 22:06:23,712][52669] DAMAGECOUNT value on done: 4053.0 [2024-08-05 22:06:23,712][52669] Sum rewards: 4.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.467', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.346', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'ARMOR': '0.977', 'weapon2': '1.244', 'weapon3': '1.790', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:24,949][52663] DAMAGECOUNT value on done: 3585.0 [2024-08-05 22:06:24,950][52663] Sum rewards: 2.078, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.090', 'ARMOR': '0.097', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'weapon2': '1.362', 'DAMAGECOUNT': '1.704', 'weapon3': '2.188', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:24,980][52647] DAMAGECOUNT value on done: 3684.0 [2024-08-05 22:06:24,980][52647] Sum rewards: 0.674, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.320', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'weapon5': '0.002', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'ARMOR': '0.535', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.993', 'FRAGCOUNT': '1.000', 'weapon2': '1.592', 'weapon3': '1.872'} [2024-08-05 22:06:25,898][52670] DAMAGECOUNT value on done: 2412.0 [2024-08-05 22:06:25,900][52670] Sum rewards: 1.504, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.118', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon7': '0.010', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.310', 'ARMOR': '0.480', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.071', 'weapon2': '1.362', 'weapon3': '1.568', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:25,920][52666] DAMAGECOUNT value on done: 2643.0 [2024-08-05 22:06:25,920][52666] Sum rewards: 1.697, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.048', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'HITCOUNT': '0.440', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.288', 'DAMAGECOUNT': '1.467', 'weapon3': '1.822', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:26,677][52650] Updated weights for policy 0, policy_version 5131 (0.0028) [2024-08-05 22:06:26,702][52665] DAMAGECOUNT value on done: 3112.0 [2024-08-05 22:06:26,703][52665] Sum rewards: 1.410, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.652', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'ARMOR': '0.068', 'AMMO3': '0.087', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.780', 'weapon2': '1.250', 'weapon3': '1.324', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:26,790][52669] DAMAGECOUNT value on done: 3593.0 [2024-08-05 22:06:26,791][52669] Sum rewards: 3.151, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon4': '0.242', 'HEALTH': '0.454', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.615', 'weapon2': '0.844', 'weapon3': '1.716', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:27,318][52647] DAMAGECOUNT value on done: 4168.0 [2024-08-05 22:06:27,319][52647] Sum rewards: 5.677, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.344', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon4': '0.192', 'ARMOR': '0.456', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon3': '1.546', 'weapon2': '1.598', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 16247.4, 300 sec: 16883.9). Total num frames: 42049536. Throughput: 0: 4005.8. Samples: 10520220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:06:27,795][52567] Avg episode reward: [(0, '2.748')] [2024-08-05 22:06:27,857][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005134_42057728.pth... [2024-08-05 22:06:27,991][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004639_38002688.pth [2024-08-05 22:06:27,992][52614] Saving new best policy, reward=2.748! [2024-08-05 22:06:28,060][52663] DAMAGECOUNT value on done: 3182.0 [2024-08-05 22:06:28,061][52663] Sum rewards: 2.284, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon7': '0.048', 'AMMO3': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.556', 'weapon2': '1.190', 'DAMAGECOUNT': '1.263', 'weapon3': '1.406', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:28,702][52670] DAMAGECOUNT value on done: 3394.0 [2024-08-05 22:06:28,702][52670] Sum rewards: 1.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.464', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.384', 'HITCOUNT': '0.420', 'ARMOR': '0.508', 'WEAPON3': '0.700', 'weapon3': '1.180', 'weapon2': '1.274', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:28,784][52666] DAMAGECOUNT value on done: 3208.0 [2024-08-05 22:06:28,784][52666] Sum rewards: 0.786, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.538', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.095', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'weapon2': '1.222', 'DAMAGECOUNT': '1.590', 'weapon3': '1.908', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:29,396][52667] DAMAGECOUNT value on done: 4163.0 [2024-08-05 22:06:29,397][52667] Sum rewards: -0.652, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.288', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'ARMOR': '0.116', 'weapon4': '0.166', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.293', 'weapon2': '1.588', 'weapon3': '1.782'} [2024-08-05 22:06:29,651][52665] DAMAGECOUNT value on done: 2243.0 [2024-08-05 22:06:29,653][52665] Sum rewards: -1.310, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.748', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'HITCOUNT': '0.200', 'DAMAGECOUNT': '0.759', 'WEAPON3': '0.800', 'ARMOR': '0.975', 'FRAGCOUNT': '1.000', 'weapon3': '1.648', 'weapon2': '1.650'} [2024-08-05 22:06:29,888][52669] DAMAGECOUNT value on done: 3401.0 [2024-08-05 22:06:29,888][52669] Sum rewards: 4.350, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.534', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.496', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'weapon2': '1.082', 'weapon3': '2.156', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '7.000'} [2024-08-05 22:06:30,693][52647] DAMAGECOUNT value on done: 2748.0 [2024-08-05 22:06:30,696][52647] Sum rewards: -1.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.036', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'HITCOUNT': '0.340', 'ARMOR': '0.452', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.260', 'weapon2': '1.462', 'weapon3': '2.266', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:31,177][52663] DAMAGECOUNT value on done: 4316.0 [2024-08-05 22:06:31,177][52663] Sum rewards: 7.015, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.922', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'ARMOR': '0.551', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.100', 'weapon3': '1.560', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '7.000'} [2024-08-05 22:06:31,606][52650] Updated weights for policy 0, policy_version 5141 (0.0013) [2024-08-05 22:06:31,610][52670] DAMAGECOUNT value on done: 3925.0 [2024-08-05 22:06:31,611][52670] Sum rewards: 1.700, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.540', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO3': '0.088', 'HITCOUNT': '0.220', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'ARMOR': '0.928', 'weapon3': '1.236', 'weapon2': '1.714', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:31,672][52666] DAMAGECOUNT value on done: 4470.0 [2024-08-05 22:06:31,674][52666] Sum rewards: 4.682, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.590', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'WEAPON1': '0.020', 'AMMO3': '0.068', 'ARMOR': '0.441', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'weapon2': '0.688', 'weapon3': '1.086', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:32,110][52649] DAMAGECOUNT value on done: 3335.0 [2024-08-05 22:06:32,111][52649] Sum rewards: -0.185, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.066', 'weapon4': '0.174', 'HITCOUNT': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.596', 'DAMAGECOUNT': '0.936', 'FRAGCOUNT': '1.000', 'weapon3': '1.100', 'weapon2': '1.446'} [2024-08-05 22:06:32,365][52667] DAMAGECOUNT value on done: 3442.0 [2024-08-05 22:06:32,402][52665] DAMAGECOUNT value on done: 4662.0 [2024-08-05 22:06:32,402][52665] Sum rewards: 2.270, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.112', 'HITCOUNT': '0.270', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.002', 'weapon3': '1.388', 'weapon2': '1.462', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16384.0, 300 sec: 16883.9). Total num frames: 42139648. Throughput: 0: 4007.8. Samples: 10533170. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 22:06:32,794][52567] Avg episode reward: [(0, '2.689')] [2024-08-05 22:06:32,927][52803] DAMAGECOUNT value on done: 3544.0 [2024-08-05 22:06:32,930][52803] Sum rewards: 2.809, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.074', 'HEALTH': '0.290', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.832', 'DAMAGECOUNT': '0.996', 'weapon2': '1.160', 'weapon3': '1.494', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:33,027][52669] DAMAGECOUNT value on done: 3233.0 [2024-08-05 22:06:33,027][52669] Sum rewards: 1.465, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.901', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.040', 'AMMO3': '0.139', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.206', 'weapon2': '1.440', 'FRAGCOUNT': '2.000', 'weapon3': '2.486'} [2024-08-05 22:06:33,342][52647] DAMAGECOUNT value on done: 2816.0 [2024-08-05 22:06:33,344][52647] Sum rewards: 1.182, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.898', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'weapon5': '0.036', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'ARMOR': '1.319', 'DAMAGECOUNT': '1.581', 'weapon2': '1.672', 'weapon3': '1.898', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:33,610][52811] DAMAGECOUNT value on done: 3415.0 [2024-08-05 22:06:33,610][52811] Sum rewards: 1.830, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.330', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.100', 'HITCOUNT': '0.270', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.930', 'weapon3': '1.246', 'ARMOR': '1.404', 'weapon2': '1.784', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:34,236][52663] DAMAGECOUNT value on done: 4091.0 [2024-08-05 22:06:34,237][52663] Sum rewards: 6.597, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.296', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '0.971', 'weapon3': '1.570', 'weapon2': '1.790', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:34,532][52670] DAMAGECOUNT value on done: 3083.0 [2024-08-05 22:06:34,532][52670] Sum rewards: 1.915, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.073', 'HEALTH': '0.308', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'ARMOR': '0.524', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.185', 'weapon2': '1.198', 'weapon3': '1.234'} [2024-08-05 22:06:34,628][52666] DAMAGECOUNT value on done: 3530.0 [2024-08-05 22:06:34,630][52666] Sum rewards: 2.424, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.402', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.062', 'AMMO3': '0.085', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.420', 'ARMOR': '0.524', 'WEAPON3': '0.600', 'weapon3': '1.180', 'weapon2': '1.232', 'DAMAGECOUNT': '1.500', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:35,043][52649] DAMAGECOUNT value on done: 3208.0 [2024-08-05 22:06:35,043][52649] Sum rewards: 1.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.866', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.117', 'HITCOUNT': '0.200', 'ARMOR': '0.526', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.855', 'weapon2': '1.458', 'weapon3': '1.874', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:35,350][52665] DAMAGECOUNT value on done: 4355.0 [2024-08-05 22:06:35,351][52665] Sum rewards: 2.467, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HEALTH': '0.148', 'weapon4': '0.206', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.095', 'weapon2': '1.290', 'weapon3': '1.758', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:35,406][52667] DAMAGECOUNT value on done: 3759.0 [2024-08-05 22:06:35,407][52667] Sum rewards: 4.090, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.023', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'HEALTH': '0.084', 'AMMO3': '0.105', 'AMMO4': '0.116', 'weapon4': '0.210', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon2': '1.256', 'DAMAGECOUNT': '1.431', 'weapon3': '1.652', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:35,901][52650] Updated weights for policy 0, policy_version 5151 (0.0012) [2024-08-05 22:06:35,927][52803] DAMAGECOUNT value on done: 3862.0 [2024-08-05 22:06:35,930][52803] Sum rewards: 3.706, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.194', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.137', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'weapon4': '0.282', 'ARMOR': '0.472', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.630', 'weapon3': '1.910', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:36,015][52669] DAMAGECOUNT value on done: 3422.0 [2024-08-05 22:06:36,015][52669] Sum rewards: 1.238, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.830', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.123', 'HITCOUNT': '0.310', 'WEAPON3': '0.800', 'ARMOR': '0.834', 'DAMAGECOUNT': '1.266', 'weapon2': '1.700', 'weapon3': '2.028', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:36,240][52647] DAMAGECOUNT value on done: 3698.0 [2024-08-05 22:06:36,241][52647] Sum rewards: 9.806, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.339', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'weapon7': '0.046', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.166', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.400', 'ARMOR': '0.897', 'weapon3': '1.026', 'weapon2': '1.540', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '7.000'} [2024-08-05 22:06:36,630][52811] DAMAGECOUNT value on done: 2975.0 [2024-08-05 22:06:36,631][52811] Sum rewards: 4.093, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.242', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.933', 'weapon2': '1.246', 'weapon3': '1.484', 'DAMAGECOUNT': '1.527', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:37,117][52663] DAMAGECOUNT value on done: 3406.0 [2024-08-05 22:06:37,364][52649] DAMAGECOUNT value on done: 2941.0 [2024-08-05 22:06:37,365][52649] Sum rewards: 2.998, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.436', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.056', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'ARMOR': '0.445', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.254', 'weapon2': '1.512', 'weapon3': '1.796', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:37,471][52670] DAMAGECOUNT value on done: 3281.0 [2024-08-05 22:06:37,512][52665] DAMAGECOUNT value on done: 3976.0 [2024-08-05 22:06:37,512][52665] Sum rewards: 6.168, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.092', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.031', 'ARMOR': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.350', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.414', 'weapon3': '1.522', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16247.5, 300 sec: 16883.9). Total num frames: 42221568. Throughput: 0: 4063.1. Samples: 10560150. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-05 22:06:37,794][52567] Avg episode reward: [(0, '2.946')] [2024-08-05 22:06:37,876][52614] Saving new best policy, reward=2.946! [2024-08-05 22:06:38,503][52667] DAMAGECOUNT value on done: 3340.0 [2024-08-05 22:06:38,509][52667] Sum rewards: 4.440, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'HEALTH': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.440', 'ARMOR': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.208', 'DAMAGECOUNT': '1.515', 'weapon3': '2.392', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:38,847][52669] DAMAGECOUNT value on done: 3938.0 [2024-08-05 22:06:38,847][52669] Sum rewards: 6.304, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.614', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.036', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'ARMOR': '0.820', 'weapon3': '1.512', 'DAMAGECOUNT': '1.686', 'weapon2': '1.832', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:39,000][52803] DAMAGECOUNT value on done: 3077.0 [2024-08-05 22:06:39,000][52803] Sum rewards: 4.961, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.126', 'HITCOUNT': '0.450', 'weapon5': '0.532', 'WEAPON3': '0.750', 'weapon2': '1.430', 'DAMAGECOUNT': '1.548', 'ARMOR': '1.655', 'weapon3': '1.668', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:39,275][52647] DAMAGECOUNT value on done: 2903.0 [2024-08-05 22:06:39,278][52647] Sum rewards: 1.103, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.166', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.092', 'HITCOUNT': '0.260', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.912', 'weapon2': '1.310', 'weapon3': '1.494', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:39,643][52811] DAMAGECOUNT value on done: 3561.0 [2024-08-05 22:06:39,643][52811] Sum rewards: 2.844, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.121', 'HEALTH': '0.422', 'ARMOR': '0.432', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.480', 'DAMAGECOUNT': '1.590', 'weapon3': '2.004', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:40,045][52663] DAMAGECOUNT value on done: 4510.0 [2024-08-05 22:06:40,046][52663] Sum rewards: 2.164, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.223', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.022', 'weapon5': '0.022', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.580', 'WEAPON3': '0.950', 'weapon2': '1.392', 'DAMAGECOUNT': '1.461', 'weapon3': '2.334', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:40,065][52649] DAMAGECOUNT value on done: 4089.0 [2024-08-05 22:06:40,065][52649] Sum rewards: 2.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.157', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.108', 'weapon4': '0.114', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'weapon2': '1.214', 'DAMAGECOUNT': '1.413', 'weapon3': '1.742', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:40,209][52665] DAMAGECOUNT value on done: 3798.0 [2024-08-05 22:06:40,803][52650] Updated weights for policy 0, policy_version 5161 (0.0025) [2024-08-05 22:06:41,317][52667] DAMAGECOUNT value on done: 4120.0 [2024-08-05 22:06:41,317][52667] Sum rewards: 0.359, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.922', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon4': '0.208', 'ARMOR': '0.400', 'HITCOUNT': '0.640', 'WEAPON3': '1.100', 'weapon2': '1.132', 'weapon3': '1.866', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:41,771][52669] DAMAGECOUNT value on done: 3429.0 [2024-08-05 22:06:41,773][52669] Sum rewards: 4.687, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.661', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.080', 'ARMOR': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon5': '0.388', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon2': '1.256', 'DAMAGECOUNT': '1.407', 'weapon3': '1.632', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:41,956][52803] DAMAGECOUNT value on done: 4597.0 [2024-08-05 22:06:41,957][52803] Sum rewards: 2.738, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.090', 'weapon4': '0.188', 'HITCOUNT': '0.250', 'HEALTH': '0.285', 'ARMOR': '0.428', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.750', 'weapon2': '0.974', 'weapon3': '1.978', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:42,116][52795] DAMAGECOUNT value on done: 2787.0 [2024-08-05 22:06:42,121][52795] Sum rewards: 3.461, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.671', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.026', 'weapon4': '0.036', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'HITCOUNT': '0.470', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.620', 'weapon2': '1.660', 'weapon3': '1.916', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:42,220][52647] DAMAGECOUNT value on done: 3009.0 [2024-08-05 22:06:42,225][52647] Sum rewards: -1.043, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.620', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon4': '0.210', 'ARMOR': '0.454', 'HITCOUNT': '0.520', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.362', 'weapon2': '1.510', 'weapon3': '1.932', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:42,325][52658] DAMAGECOUNT value on done: 2783.0 [2024-08-05 22:06:42,326][52658] Sum rewards: 2.505, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.500', 'ARMOR': '0.505', 'WEAPON3': '0.650', 'weapon2': '1.548', 'DAMAGECOUNT': '1.620', 'weapon3': '1.672', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:42,421][52649] DAMAGECOUNT value on done: 2218.0 [2024-08-05 22:06:42,421][52649] Sum rewards: 2.345, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.096', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.360', 'weapon5': '0.416', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'weapon3': '1.124', 'DAMAGECOUNT': '1.185', 'weapon2': '1.602', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:42,515][52665] DAMAGECOUNT value on done: 4563.0 [2024-08-05 22:06:42,516][52665] Sum rewards: 5.121, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.151', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'ARMOR': '0.844', 'DAMAGECOUNT': '1.452', 'weapon2': '1.640', 'weapon3': '1.704', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:42,622][52811] DAMAGECOUNT value on done: 3316.0 [2024-08-05 22:06:42,623][52811] Sum rewards: 2.569, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.456', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.078', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'HITCOUNT': '0.310', 'ARMOR': '0.462', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.993', 'weapon2': '1.330', 'weapon3': '1.332', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16384.0, 300 sec: 16911.6). Total num frames: 42311680. Throughput: 0: 4079.3. Samples: 10586740. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-05 22:06:42,794][52567] Avg episode reward: [(0, '2.883')] [2024-08-05 22:06:43,069][52663] DAMAGECOUNT value on done: 2904.0 [2024-08-05 22:06:43,070][52663] Sum rewards: -0.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.242', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'HITCOUNT': '0.150', 'weapon4': '0.224', 'DAMAGECOUNT': '0.417', 'WEAPON3': '0.600', 'ARMOR': '0.907', 'FRAGCOUNT': '1.000', 'weapon2': '1.030', 'weapon3': '1.512'} [2024-08-05 22:06:44,080][52667] DAMAGECOUNT value on done: 3888.0 [2024-08-05 22:06:44,081][52667] Sum rewards: 4.375, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.968', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.028', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'ARMOR': '0.928', 'DAMAGECOUNT': '1.335', 'weapon2': '1.830', 'weapon3': '1.904', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:44,755][52669] DAMAGECOUNT value on done: 3612.0 [2024-08-05 22:06:44,757][52669] Sum rewards: 0.548, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.034', 'AMMO4': '0.054', 'AMMO3': '0.088', 'ARMOR': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.500', 'weapon3': '1.748', 'weapon2': '1.842', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:44,899][52649] DAMAGECOUNT value on done: 3496.0 [2024-08-05 22:06:44,900][52649] Sum rewards: 2.607, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.560', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'ARMOR': '0.037', 'AMMO3': '0.098', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon3': '1.514', 'DAMAGECOUNT': '1.521', 'weapon2': '1.550', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:44,957][52650] Updated weights for policy 0, policy_version 5171 (0.0012) [2024-08-05 22:06:44,993][52665] DAMAGECOUNT value on done: 3451.0 [2024-08-05 22:06:44,994][52665] Sum rewards: 1.957, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.757', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.210', 'HITCOUNT': '0.470', 'ARMOR': '0.526', 'WEAPON3': '0.650', 'weapon2': '1.376', 'DAMAGECOUNT': '1.554', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:45,082][52658] DAMAGECOUNT value on done: 3369.0 [2024-08-05 22:06:45,084][52658] Sum rewards: -1.429, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.715', 'FRAGCOUNT': '-0.500', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'ARMOR': '0.932', 'DAMAGECOUNT': '1.260', 'weapon3': '1.442', 'weapon2': '1.484'} [2024-08-05 22:06:45,111][52803] DAMAGECOUNT value on done: 4444.0 [2024-08-05 22:06:45,113][52803] Sum rewards: 6.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.380', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.024', 'AMMO4': '0.036', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'ARMOR': '0.516', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon3': '1.602', 'weapon2': '1.634', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:45,132][52795] DAMAGECOUNT value on done: 3227.0 [2024-08-05 22:06:45,134][52795] Sum rewards: 5.125, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.888', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'weapon4': '0.210', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.250', 'weapon2': '1.516', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:45,238][52647] DAMAGECOUNT value on done: 3820.0 [2024-08-05 22:06:45,240][52647] Sum rewards: 0.537, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.101', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.262', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'ARMOR': '0.636', 'FRAGCOUNT': '1.000', 'weapon2': '1.184', 'DAMAGECOUNT': '1.209', 'weapon3': '1.430'} [2024-08-05 22:06:45,650][52811] DAMAGECOUNT value on done: 3422.0 [2024-08-05 22:06:45,650][52811] Sum rewards: -0.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.148', 'HITCOUNT': '0.500', 'ARMOR': '0.999', 'WEAPON3': '1.000', 'weapon2': '1.262', 'DAMAGECOUNT': '1.593', 'weapon3': '2.144', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:45,698][52663] DAMAGECOUNT value on done: 2955.0 [2024-08-05 22:06:45,699][52663] Sum rewards: 1.510, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.523', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.250', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.795', 'ARMOR': '0.923', 'weapon2': '1.388', 'weapon3': '1.424', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:47,105][52667] DAMAGECOUNT value on done: 3938.0 [2024-08-05 22:06:47,105][52667] Sum rewards: 7.133, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.111', 'ARMOR': '0.416', 'HEALTH': '0.486', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '1.798', 'weapon2': '1.932', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:47,131][52669] DAMAGECOUNT value on done: 3678.0 [2024-08-05 22:06:47,131][52669] Sum rewards: 1.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.542', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon4': '0.146', 'HITCOUNT': '0.340', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.020', 'weapon3': '1.408', 'weapon2': '1.526', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:47,659][52647] DAMAGECOUNT value on done: 3833.0 [2024-08-05 22:06:47,660][52647] Sum rewards: 3.370, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'HITCOUNT': '0.590', 'WEAPON3': '1.000', 'weapon2': '1.524', 'DAMAGECOUNT': '1.815', 'weapon3': '2.208', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:47,794][52567] Fps is (10 sec: 18841.4, 60 sec: 16657.1, 300 sec: 16939.4). Total num frames: 42409984. Throughput: 0: 4084.7. Samples: 10599930. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:06:47,795][52567] Avg episode reward: [(0, '2.610')] [2024-08-05 22:06:47,885][52649] DAMAGECOUNT value on done: 3165.0 [2024-08-05 22:06:47,886][52649] Sum rewards: 1.657, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.408', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon4': '0.162', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'ARMOR': '0.968', 'weapon2': '1.478', 'weapon3': '1.596', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '3.500'} [2024-08-05 22:06:47,922][52665] DAMAGECOUNT value on done: 4236.0 [2024-08-05 22:06:47,922][52665] Sum rewards: 1.293, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.565', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.066', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'DAMAGECOUNT': '1.137', 'weapon3': '1.164', 'weapon2': '1.418', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:48,057][52658] DAMAGECOUNT value on done: 3084.0 [2024-08-05 22:06:48,061][52658] Sum rewards: 5.984, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.664', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'ARMOR': '1.401', 'weapon2': '1.684', 'weapon3': '1.972', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:48,162][52803] DAMAGECOUNT value on done: 3967.0 [2024-08-05 22:06:48,163][52803] Sum rewards: 5.097, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.073', 'weapon4': '0.116', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '1.274', 'ARMOR': '1.294', 'weapon3': '1.598', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:48,183][52663] DAMAGECOUNT value on done: 3923.0 [2024-08-05 22:06:48,184][52663] Sum rewards: 2.309, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.518', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.124', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon5': '0.262', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.077', 'weapon2': '1.104', 'weapon3': '1.506', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:48,224][52795] DAMAGECOUNT value on done: 3022.0 [2024-08-05 22:06:48,225][52795] Sum rewards: 4.316, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.020', 'AMMO3': '0.075', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '1.268', 'weapon3': '1.454', 'DAMAGECOUNT': '1.512', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:48,645][52811] DAMAGECOUNT value on done: 3352.0 [2024-08-05 22:06:48,648][52811] Sum rewards: 6.335, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.557', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.064', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.354', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.112', 'DAMAGECOUNT': '1.647', 'weapon3': '1.828', 'FRAGCOUNT': '7.000'} [2024-08-05 22:06:49,614][52669] DAMAGECOUNT value on done: 3629.0 [2024-08-05 22:06:49,615][52669] Sum rewards: 4.476, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.073', 'ARMOR': '0.100', 'HEALTH': '0.210', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon3': '1.336', 'weapon2': '1.624', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:49,618][52667] DAMAGECOUNT value on done: 3616.0 [2024-08-05 22:06:49,618][52667] Sum rewards: 3.999, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.478', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.046', 'AMMO3': '0.063', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'ARMOR': '0.903', 'DAMAGECOUNT': '1.230', 'weapon3': '1.388', 'FRAGCOUNT': '2.000', 'weapon2': '2.234'} [2024-08-05 22:06:49,929][52650] Updated weights for policy 0, policy_version 5181 (0.0019) [2024-08-05 22:06:50,566][52658] DAMAGECOUNT value on done: 3036.0 [2024-08-05 22:06:50,566][52658] Sum rewards: -0.572, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO4': '0.034', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.430', 'ARMOR': '0.876', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.239', 'weapon2': '1.306', 'FRAGCOUNT': '2.000', 'weapon3': '2.242'} [2024-08-05 22:06:50,644][52647] DAMAGECOUNT value on done: 3956.0 [2024-08-05 22:06:50,646][52647] Sum rewards: 1.538, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.194', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.358', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.550', 'weapon3': '1.342', 'DAMAGECOUNT': '1.485', 'weapon2': '1.490', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:50,856][52663] DAMAGECOUNT value on done: 3391.0 [2024-08-05 22:06:50,857][52663] Sum rewards: 3.209, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.358', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.228', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'ARMOR': '0.876', 'weapon2': '1.316', 'DAMAGECOUNT': '1.344', 'weapon3': '1.400', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:50,974][52649] DAMAGECOUNT value on done: 2762.0 [2024-08-05 22:06:50,975][52649] Sum rewards: -0.612, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.478', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'weapon4': '0.202', 'ARMOR': '0.515', 'DAMAGECOUNT': '0.690', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.042', 'weapon3': '1.962'} [2024-08-05 22:06:51,006][52665] DAMAGECOUNT value on done: 3901.0 [2024-08-05 22:06:51,008][52665] Sum rewards: 2.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.934', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'ARMOR': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.170', 'weapon4': '0.226', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.260', 'weapon2': '1.408', 'weapon3': '1.494', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:51,164][52803] DAMAGECOUNT value on done: 4318.0 [2024-08-05 22:06:51,165][52803] Sum rewards: 1.995, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.685', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'HITCOUNT': '0.500', 'ARMOR': '0.529', 'WEAPON3': '0.700', 'weapon2': '1.306', 'DAMAGECOUNT': '1.512', 'weapon3': '1.676', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:51,216][52795] DAMAGECOUNT value on done: 4297.0 [2024-08-05 22:06:51,218][52795] Sum rewards: 3.854, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.650', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'HITCOUNT': '0.370', 'ARMOR': '0.470', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.332', 'weapon3': '1.386', 'weapon2': '1.714', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:51,616][52811] DAMAGECOUNT value on done: 4097.0 [2024-08-05 22:06:51,616][52811] Sum rewards: 1.269, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.698', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.510', 'WEAPON3': '0.650', 'ARMOR': '0.907', 'DAMAGECOUNT': '1.641', 'weapon2': '1.652', 'weapon3': '2.162', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:52,404][52667] DAMAGECOUNT value on done: 3989.0 [2024-08-05 22:06:52,405][52667] Sum rewards: -1.559, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.718', 'FRAGCOUNT': '-0.500', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.008', 'weapon5': '0.080', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.102', 'ARMOR': '0.108', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.041', 'weapon3': '1.488', 'weapon2': '1.552'} [2024-08-05 22:06:52,632][52669] DAMAGECOUNT value on done: 3531.0 [2024-08-05 22:06:52,633][52669] Sum rewards: 4.047, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'ARMOR': '0.868', 'DAMAGECOUNT': '0.993', 'weapon3': '1.566', 'weapon2': '1.614', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16657.1, 300 sec: 16967.2). Total num frames: 42491904. Throughput: 0: 4157.8. Samples: 10627000. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:06:52,794][52567] Avg episode reward: [(0, '2.466')] [2024-08-05 22:06:53,052][52647] DAMAGECOUNT value on done: 2954.0 [2024-08-05 22:06:53,052][52647] Sum rewards: 1.015, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.580', 'AMMO2': '0.007', 'AMMO4': '0.033', 'HITCOUNT': '0.110', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.222', 'DAMAGECOUNT': '0.366', 'ARMOR': '0.512', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.048', 'weapon3': '1.984'} [2024-08-05 22:06:53,457][52658] DAMAGECOUNT value on done: 4146.0 [2024-08-05 22:06:53,459][52658] Sum rewards: 2.569, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.428', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon7': '0.072', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'weapon4': '0.184', 'WEAPON7': '0.200', 'HITCOUNT': '0.530', 'WEAPON3': '0.900', 'weapon2': '0.952', 'weapon3': '2.020', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:53,865][52663] DAMAGECOUNT value on done: 3296.0 [2024-08-05 22:06:53,866][52663] Sum rewards: 2.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.285', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'ARMOR': '0.116', 'weapon4': '0.216', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.248', 'weapon2': '1.330', 'weapon3': '1.888', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:53,875][52665] DAMAGECOUNT value on done: 4260.0 [2024-08-05 22:06:53,877][52665] Sum rewards: 4.009, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.940', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.218', 'HITCOUNT': '0.250', 'WEAPON3': '0.550', 'weapon3': '0.772', 'weapon2': '0.920', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:53,896][52649] DAMAGECOUNT value on done: 3452.0 [2024-08-05 22:06:53,898][52649] Sum rewards: 1.886, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.752', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.062', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.238', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon2': '1.178', 'DAMAGECOUNT': '1.218', 'weapon3': '1.598', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:53,958][52650] Updated weights for policy 0, policy_version 5191 (0.0017) [2024-08-05 22:06:54,118][52795] DAMAGECOUNT value on done: 3131.0 [2024-08-05 22:06:54,121][52795] Sum rewards: 2.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.703', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.190', 'weapon4': '0.234', 'DAMAGECOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '1.401', 'weapon2': '1.416', 'weapon3': '1.656', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:54,150][52803] DAMAGECOUNT value on done: 3743.0 [2024-08-05 22:06:54,152][52803] Sum rewards: 1.760, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.022', 'weapon5': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'HITCOUNT': '0.280', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.128', 'ARMOR': '1.347', 'weapon2': '1.610', 'weapon3': '1.738', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:54,588][52811] DAMAGECOUNT value on done: 1918.0 [2024-08-05 22:06:54,588][52811] Sum rewards: -0.404, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.445', 'AMMO2': '0.001', 'AMMO4': '0.006', 'weapon4': '0.084', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'ARMOR': '0.526', 'DAMAGECOUNT': '0.615', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.426', 'weapon3': '1.538'} [2024-08-05 22:06:55,343][52667] DAMAGECOUNT value on done: 3691.0 [2024-08-05 22:06:55,343][52667] Sum rewards: 4.949, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.070', 'HEALTH': '0.362', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.800', 'weapon3': '0.994', 'weapon2': '1.088', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:55,382][52664] DAMAGECOUNT value on done: 4349.0 [2024-08-05 22:06:55,383][52664] Sum rewards: 5.080, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.547', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.117', 'ARMOR': '0.424', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.374', 'weapon3': '2.080', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:55,465][52647] DAMAGECOUNT value on done: 3612.0 [2024-08-05 22:06:55,465][52647] Sum rewards: -1.106, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.782', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.240', 'weapon4': '0.256', 'ARMOR': '0.531', 'DAMAGECOUNT': '0.792', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.518', 'weapon3': '2.038'} [2024-08-05 22:06:55,506][52669] DAMAGECOUNT value on done: 3961.0 [2024-08-05 22:06:55,507][52669] Sum rewards: 5.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.110', 'AMMO2': '0.007', 'AMMO5': '0.015', 'weapon5': '0.032', 'AMMO4': '0.032', 'AMMO3': '0.088', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'ARMOR': '1.380', 'weapon2': '1.430', 'weapon3': '1.752', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:56,374][52658] DAMAGECOUNT value on done: 2541.0 [2024-08-05 22:06:56,374][52658] Sum rewards: -0.904, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.974', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.250', 'ARMOR': '0.445', 'DAMAGECOUNT': '0.675', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.124', 'weapon3': '2.332'} [2024-08-05 22:06:56,570][52663] DAMAGECOUNT value on done: 3817.0 [2024-08-05 22:06:56,570][52663] Sum rewards: 0.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.542', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.176', 'ARMOR': '0.476', 'HITCOUNT': '0.570', 'WEAPON3': '1.100', 'weapon2': '1.164', 'DAMAGECOUNT': '1.920', 'weapon3': '2.644', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:56,912][52665] DAMAGECOUNT value on done: 3212.0 [2024-08-05 22:06:56,913][52665] Sum rewards: -1.438, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.992', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.328', 'HITCOUNT': '0.350', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'ARMOR': '1.332', 'weapon2': '1.494', 'weapon3': '1.956'} [2024-08-05 22:06:56,980][52649] DAMAGECOUNT value on done: 3253.0 [2024-08-05 22:06:56,982][52649] Sum rewards: -0.062, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.048', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.220', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'FRAGCOUNT': '1.000', 'weapon2': '1.492', 'weapon3': '1.718'} [2024-08-05 22:06:57,174][52803] DAMAGECOUNT value on done: 3151.0 [2024-08-05 22:06:57,174][52795] DAMAGECOUNT value on done: 4138.0 [2024-08-05 22:06:57,176][52803] Sum rewards: 6.045, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.027', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.088', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.682', 'DAMAGECOUNT': '1.704', 'weapon2': '1.714', 'FRAGCOUNT': '5.000'} [2024-08-05 22:06:57,176][52795] Sum rewards: 5.111, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.252', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.088', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.900', 'weapon2': '1.380', 'DAMAGECOUNT': '1.485', 'weapon3': '1.604', 'FRAGCOUNT': '4.000'} [2024-08-05 22:06:57,609][52811] DAMAGECOUNT value on done: 2393.0 [2024-08-05 22:06:57,609][52811] Sum rewards: 0.793, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.063', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.072', 'HITCOUNT': '0.120', 'DAMAGECOUNT': '0.315', 'WEAPON3': '0.400', 'weapon3': '0.908', 'FRAGCOUNT': '1.000', 'weapon2': '1.156', 'ARMOR': '1.329'} [2024-08-05 22:06:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.0, 300 sec: 16967.2). Total num frames: 42582016. Throughput: 0: 4374.5. Samples: 10653930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:06:57,794][52567] Avg episode reward: [(0, '2.417')] [2024-08-05 22:06:57,818][52669] DAMAGECOUNT value on done: 3390.0 [2024-08-05 22:06:57,818][52669] Sum rewards: 1.859, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.415', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.370', 'ARMOR': '0.520', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.251', 'weapon3': '1.600', 'weapon2': '1.802', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:57,930][52664] DAMAGECOUNT value on done: 3515.0 [2024-08-05 22:06:57,932][52664] Sum rewards: 2.125, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.104', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.085', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.962', 'DAMAGECOUNT': '1.200', 'weapon2': '1.336', 'weapon3': '1.658', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:57,976][52647] DAMAGECOUNT value on done: 3189.0 [2024-08-05 22:06:57,977][52647] Sum rewards: 1.820, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.099', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon4': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.990', 'weapon3': '1.440', 'weapon2': '1.974', 'FRAGCOUNT': '2.000'} [2024-08-05 22:06:58,171][52667] DAMAGECOUNT value on done: 3727.0 [2024-08-05 22:06:58,171][52667] Sum rewards: 2.615, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.097', 'weapon4': '0.124', 'WEAPON4': '0.200', 'HEALTH': '0.278', 'weapon5': '0.300', 'HITCOUNT': '0.460', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'weapon2': '1.022', 'DAMAGECOUNT': '1.434', 'weapon3': '2.020', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:58,725][52663] DAMAGECOUNT value on done: 3576.0 [2024-08-05 22:06:58,757][52663] Sum rewards: -0.445, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.020', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.130', 'DAMAGECOUNT': '0.555', 'WEAPON3': '0.650', 'ARMOR': '0.924', 'FRAGCOUNT': '1.000', 'weapon2': '1.466', 'weapon3': '1.538'} [2024-08-05 22:06:58,933][52614] Signal inference workers to stop experience collection... (1000 times) [2024-08-05 22:06:58,934][52614] Signal inference workers to resume experience collection... (1000 times) [2024-08-05 22:06:59,002][52650] InferenceWorker_p0-w0: stopping experience collection (1000 times) [2024-08-05 22:06:59,002][52650] InferenceWorker_p0-w0: resuming experience collection (1000 times) [2024-08-05 22:06:59,039][52650] Updated weights for policy 0, policy_version 5201 (0.0018) [2024-08-05 22:06:59,131][52658] DAMAGECOUNT value on done: 3583.0 [2024-08-05 22:06:59,133][52658] Sum rewards: 3.474, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.811', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.020', 'AMMO3': '0.149', 'HITCOUNT': '0.700', 'WEAPON3': '1.050', 'weapon2': '1.258', 'weapon3': '2.506', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '6.000'} [2024-08-05 22:06:59,777][52665] DAMAGECOUNT value on done: 4135.0 [2024-08-05 22:06:59,780][52665] Sum rewards: 1.461, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'ARMOR': '0.905', 'weapon2': '1.558', 'DAMAGECOUNT': '1.722', 'weapon3': '1.778', 'FRAGCOUNT': '3.000'} [2024-08-05 22:06:59,831][52649] DAMAGECOUNT value on done: 3685.0 [2024-08-05 22:06:59,833][52649] Sum rewards: 3.071, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.070', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.051', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.560', 'WEAPON3': '0.900', 'weapon2': '1.570', 'DAMAGECOUNT': '1.755', 'weapon3': '2.232', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:00,195][52803] DAMAGECOUNT value on done: 3421.0 [2024-08-05 22:07:00,196][52803] Sum rewards: 2.256, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'ARMOR': '0.080', 'AMMO4': '0.095', 'AMMO3': '0.106', 'HEALTH': '0.114', 'weapon4': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.202', 'DAMAGECOUNT': '1.752', 'weapon3': '1.926', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:00,269][52795] DAMAGECOUNT value on done: 3745.0 [2024-08-05 22:07:00,269][52795] Sum rewards: 9.539, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.648', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon7': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.106', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '1.008', 'weapon2': '1.660', 'weapon3': '1.918', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '8.000'} [2024-08-05 22:07:00,300][52669] DAMAGECOUNT value on done: 4314.0 [2024-08-05 22:07:00,300][52669] Sum rewards: 10.972, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'HEALTH': '0.080', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.312', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.999', 'weapon2': '1.222', 'weapon3': '1.770', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '8.000'} [2024-08-05 22:07:00,452][52664] DAMAGECOUNT value on done: 4344.0 [2024-08-05 22:07:00,453][52664] Sum rewards: 0.112, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.774', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.121', 'HITCOUNT': '0.520', 'ARMOR': '0.860', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.632', 'weapon2': '1.684', 'weapon3': '2.148', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:00,474][52647] DAMAGECOUNT value on done: 3610.0 [2024-08-05 22:07:00,474][52647] Sum rewards: 4.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.936', 'AMMO2': '0.018', 'weapon7': '0.086', 'AMMO4': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.480', 'ARMOR': '0.572', 'WEAPON3': '0.850', 'weapon2': '1.150', 'weapon3': '1.730', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:00,830][52811] DAMAGECOUNT value on done: 3479.0 [2024-08-05 22:07:00,832][52811] Sum rewards: 1.208, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.734', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon7': '0.082', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.206', 'HITCOUNT': '0.220', 'weapon4': '0.398', 'ARMOR': '0.551', 'WEAPON3': '0.750', 'weapon2': '0.936', 'DAMAGECOUNT': '1.404', 'weapon3': '1.490', 'FRAGCOUNT': '3.500'} [2024-08-05 22:07:00,944][52671] DAMAGECOUNT value on done: 3846.0 [2024-08-05 22:07:00,944][52671] Sum rewards: 4.025, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.928', 'AMMO4': '-0.084', 'AMMO2': '-0.017', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'weapon5': '0.074', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.230', 'weapon3': '1.246', 'weapon2': '1.428', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:01,123][52667] DAMAGECOUNT value on done: 4678.0 [2024-08-05 22:07:01,125][52667] Sum rewards: 2.572, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.240', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.050', 'ARMOR': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon3': '1.180', 'weapon2': '1.460', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:01,348][52663] DAMAGECOUNT value on done: 3179.0 [2024-08-05 22:07:01,349][52663] Sum rewards: 6.835, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.374', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.116', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'ARMOR': '0.850', 'weapon3': '1.566', 'weapon2': '1.658', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:02,329][52658] DAMAGECOUNT value on done: 3270.0 [2024-08-05 22:07:02,333][52649] DAMAGECOUNT value on done: 2759.0 [2024-08-05 22:07:02,334][52649] Sum rewards: 1.787, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.422', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon4': '0.200', 'HITCOUNT': '0.430', 'ARMOR': '0.510', 'WEAPON3': '1.050', 'weapon2': '1.192', 'DAMAGECOUNT': '1.311', 'weapon3': '2.148', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 16793.6, 300 sec: 16967.2). Total num frames: 42672128. Throughput: 0: 4436.4. Samples: 10667390. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:07:02,795][52567] Avg episode reward: [(0, '2.650')] [2024-08-05 22:07:03,208][52795] DAMAGECOUNT value on done: 3873.0 [2024-08-05 22:07:03,211][52795] Sum rewards: 2.687, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.124', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO4': '0.081', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.188', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.248', 'ARMOR': '1.356', 'weapon3': '1.384', 'weapon2': '1.500', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:03,292][52647] DAMAGECOUNT value on done: 3140.0 [2024-08-05 22:07:03,293][52647] Sum rewards: 2.826, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.330', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'ARMOR': '0.954', 'DAMAGECOUNT': '1.059', 'weapon2': '1.530', 'weapon3': '1.754', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:03,304][52664] DAMAGECOUNT value on done: 3047.0 [2024-08-05 22:07:03,305][52664] Sum rewards: 5.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.161', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.124', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'ARMOR': '0.888', 'weapon2': '1.492', 'DAMAGECOUNT': '2.304', 'weapon3': '2.406', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:03,325][52803] DAMAGECOUNT value on done: 2572.0 [2024-08-05 22:07:03,326][52803] Sum rewards: 1.521, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.064', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'HITCOUNT': '0.410', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.362', 'weapon2': '1.406', 'weapon3': '2.042', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:03,583][52650] Updated weights for policy 0, policy_version 5211 (0.0013) [2024-08-05 22:07:03,725][52671] DAMAGECOUNT value on done: 3878.0 [2024-08-05 22:07:03,725][52671] Sum rewards: 1.284, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.090', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'HITCOUNT': '0.270', 'weapon4': '0.290', 'HEALTH': '0.543', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.876', 'weapon2': '1.036', 'weapon3': '1.790', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:03,869][52811] DAMAGECOUNT value on done: 3719.0 [2024-08-05 22:07:03,869][52811] Sum rewards: 3.723, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.186', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.122', 'weapon4': '0.232', 'HITCOUNT': '0.430', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'weapon3': '1.220', 'DAMAGECOUNT': '1.320', 'weapon2': '1.528', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:04,197][52667] DAMAGECOUNT value on done: 3511.0 [2024-08-05 22:07:04,198][52667] Sum rewards: 1.936, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'HEALTH': '0.071', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'ARMOR': '0.116', 'weapon4': '0.202', 'HITCOUNT': '0.350', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.095', 'weapon2': '1.600', 'weapon3': '1.632'} [2024-08-05 22:07:04,208][52663] DAMAGECOUNT value on done: 4241.0 [2024-08-05 22:07:04,209][52663] Sum rewards: 1.661, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.336', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.025', 'weapon4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'ARMOR': '0.512', 'HITCOUNT': '0.540', 'WEAPON3': '1.050', 'weapon2': '1.436', 'DAMAGECOUNT': '1.812', 'weapon3': '2.014', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:05,150][52649] DAMAGECOUNT value on done: 4210.0 [2024-08-05 22:07:05,151][52649] Sum rewards: 3.302, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.179', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.058', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'HITCOUNT': '0.500', 'ARMOR': '0.516', 'WEAPON3': '0.900', 'weapon2': '1.184', 'DAMAGECOUNT': '2.061', 'weapon3': '2.214', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:05,227][52658] DAMAGECOUNT value on done: 2972.0 [2024-08-05 22:07:05,227][52658] Sum rewards: -0.098, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.036', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon4': '0.128', 'HITCOUNT': '0.290', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.328', 'ARMOR': '1.392', 'weapon2': '2.208'} [2024-08-05 22:07:06,044][52647] DAMAGECOUNT value on done: 3619.0 [2024-08-05 22:07:06,045][52647] Sum rewards: 0.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.835', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.120', 'HITCOUNT': '0.310', 'ARMOR': '0.455', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.095', 'weapon3': '1.526', 'weapon2': '1.886', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:06,101][52664] DAMAGECOUNT value on done: 4301.0 [2024-08-05 22:07:06,102][52664] Sum rewards: -0.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.418', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.114', 'HITCOUNT': '0.320', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.936', 'FRAGCOUNT': '1.000', 'weapon2': '1.354', 'weapon3': '1.890'} [2024-08-05 22:07:06,288][52795] DAMAGECOUNT value on done: 3573.0 [2024-08-05 22:07:06,290][52795] Sum rewards: 5.028, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'weapon4': '0.002', 'AMMO2': '0.022', 'AMMO3': '0.082', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'ARMOR': '0.950', 'weapon3': '1.258', 'DAMAGECOUNT': '1.563', 'weapon2': '1.802', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:06,422][52671] DAMAGECOUNT value on done: 3196.0 [2024-08-05 22:07:06,423][52671] Sum rewards: 5.028, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.515', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.060', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '1.316', 'DAMAGECOUNT': '2.361', 'weapon3': '2.388', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:06,442][52803] DAMAGECOUNT value on done: 3001.0 [2024-08-05 22:07:06,443][52803] Sum rewards: 3.537, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.486', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.180', 'HITCOUNT': '0.490', 'ARMOR': '0.550', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.362', 'weapon2': '1.450', 'weapon3': '1.522', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:06,634][52659] DAMAGECOUNT value on done: 3449.0 [2024-08-05 22:07:06,634][52659] Sum rewards: 0.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.912', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.060', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'ARMOR': '0.859', 'DAMAGECOUNT': '1.140', 'weapon3': '1.470', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:07,041][52811] DAMAGECOUNT value on done: 3439.0 [2024-08-05 22:07:07,041][52811] Sum rewards: 3.281, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.440', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '1.210', 'weapon3': '1.586', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:07,073][52663] DAMAGECOUNT value on done: 3280.0 [2024-08-05 22:07:07,075][52663] Sum rewards: 3.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.749', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.030', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.260', 'HITCOUNT': '0.450', 'WEAPON3': '0.850', 'ARMOR': '0.930', 'weapon2': '1.456', 'weapon3': '1.810', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:07,159][52667] DAMAGECOUNT value on done: 4447.0 [2024-08-05 22:07:07,160][52667] Sum rewards: 4.892, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.060', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.125', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'ARMOR': '0.861', 'weapon2': '1.378', 'DAMAGECOUNT': '1.719', 'weapon3': '1.804', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17066.7, 300 sec: 16994.9). Total num frames: 42762240. Throughput: 0: 4452.9. Samples: 10694400. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:07:07,794][52567] Avg episode reward: [(0, '2.542')] [2024-08-05 22:07:07,967][52650] Updated weights for policy 0, policy_version 5221 (0.0025) [2024-08-05 22:07:07,982][52649] DAMAGECOUNT value on done: 3595.0 [2024-08-05 22:07:07,984][52649] Sum rewards: 2.016, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.206', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.060', 'ARMOR': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.178', 'HITCOUNT': '0.290', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.246', 'weapon2': '1.520'} [2024-08-05 22:07:08,287][52658] DAMAGECOUNT value on done: 3567.0 [2024-08-05 22:07:08,289][52658] Sum rewards: 3.364, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.766', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'ARMOR': '0.928', 'WEAPON3': '0.950', 'weapon2': '1.402', 'DAMAGECOUNT': '1.665', 'weapon3': '1.972', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:08,754][52647] DAMAGECOUNT value on done: 3400.0 [2024-08-05 22:07:08,755][52647] Sum rewards: 7.457, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'ARMOR': '0.096', 'AMMO3': '0.122', 'weapon5': '0.122', 'HEALTH': '0.134', 'AMMO4': '0.165', 'weapon4': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.520', 'DAMAGECOUNT': '1.524', 'weapon3': '1.798', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:08,885][52664] DAMAGECOUNT value on done: 3279.0 [2024-08-05 22:07:08,887][52664] Sum rewards: 5.909, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.253', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'ARMOR': '0.037', 'AMMO3': '0.060', 'HITCOUNT': '0.390', 'WEAPON3': '0.450', 'weapon3': '1.322', 'weapon2': '1.324', 'DAMAGECOUNT': '1.335', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:09,221][52795] DAMAGECOUNT value on done: 3326.0 [2024-08-05 22:07:09,229][52795] Sum rewards: 2.793, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.386', 'weapon4': '0.002', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.137', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'ARMOR': '1.399', 'DAMAGECOUNT': '1.503', 'weapon2': '1.566', 'weapon3': '1.780', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:09,245][52671] DAMAGECOUNT value on done: 3742.0 [2024-08-05 22:07:09,245][52671] Sum rewards: 4.235, reward structure: {'DEATHCOUNT': '-6.000', 'weapon4': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.090', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'HEALTH': '0.891', 'ARMOR': '0.913', 'DAMAGECOUNT': '1.155', 'weapon2': '1.582', 'weapon3': '1.598', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:09,417][52803] DAMAGECOUNT value on done: 3712.0 [2024-08-05 22:07:09,418][52803] Sum rewards: 3.291, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.953', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.011', 'AMMO3': '0.086', 'weapon5': '0.166', 'WEAPON5': '0.300', 'HITCOUNT': '0.440', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'weapon3': '1.328', 'DAMAGECOUNT': '1.620', 'weapon2': '1.954', 'FRAGCOUNT': '2.500'} [2024-08-05 22:07:09,713][52659] DAMAGECOUNT value on done: 3930.0 [2024-08-05 22:07:09,713][52659] Sum rewards: 4.824, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.304', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.097', 'weapon4': '0.118', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.680', 'weapon3': '1.230', 'weapon2': '1.420', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:09,742][52667] DAMAGECOUNT value on done: 3734.0 [2024-08-05 22:07:09,743][52667] Sum rewards: 4.585, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.674', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'weapon5': '0.110', 'WEAPON5': '0.200', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.907', 'weapon3': '1.270', 'DAMAGECOUNT': '1.671', 'weapon2': '2.082', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:09,951][52663] DAMAGECOUNT value on done: 3117.0 [2024-08-05 22:07:09,951][52663] Sum rewards: -2.343, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.416', 'AMMO4': '-0.093', 'AMMO2': '-0.018', 'AMMO5': '0.005', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.280', 'DAMAGECOUNT': '0.804', 'ARMOR': '1.023', 'WEAPON3': '1.050', 'weapon2': '1.766', 'weapon3': '1.946', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:10,100][52811] DAMAGECOUNT value on done: 3479.0 [2024-08-05 22:07:10,103][52811] Sum rewards: 6.966, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.011', 'HEALTH': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.100', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '1.257', 'weapon3': '1.796', 'weapon2': '1.886', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:10,807][52658] DAMAGECOUNT value on done: 3568.0 [2024-08-05 22:07:10,811][52658] Sum rewards: -1.290, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.080', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'weapon4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.161', 'weapon3': '1.218', 'weapon2': '1.574', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:10,982][52649] DAMAGECOUNT value on done: 2763.0 [2024-08-05 22:07:10,982][52649] Sum rewards: 2.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.362', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'ARMOR': '0.416', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.480', 'DAMAGECOUNT': '1.650', 'weapon3': '1.776', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:11,519][52647] DAMAGECOUNT value on done: 3838.0 [2024-08-05 22:07:11,522][52647] Sum rewards: 2.952, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.150', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'ARMOR': '1.248', 'weapon2': '1.500', 'DAMAGECOUNT': '1.581', 'weapon3': '2.168', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:11,688][52664] DAMAGECOUNT value on done: 3765.0 [2024-08-05 22:07:11,689][52664] Sum rewards: 3.335, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.180', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.208', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.825', 'weapon3': '1.200', 'weapon2': '1.452', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:12,214][52671] DAMAGECOUNT value on done: 3668.0 [2024-08-05 22:07:12,215][52671] Sum rewards: 3.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.350', 'AMMO2': '0.004', 'AMMO4': '0.017', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.232', 'weapon3': '1.652', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:12,236][52795] DAMAGECOUNT value on done: 3075.0 [2024-08-05 22:07:12,237][52795] Sum rewards: 2.611, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.054', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'AMMO3': '0.098', 'weapon5': '0.166', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.406', 'DAMAGECOUNT': '1.434', 'weapon3': '1.850', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:12,328][52663] DAMAGECOUNT value on done: 3063.0 [2024-08-05 22:07:12,329][52663] Sum rewards: 4.767, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'weapon4': '0.002', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'ARMOR': '0.088', 'AMMO3': '0.093', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.414', 'DAMAGECOUNT': '1.467', 'weapon2': '1.742', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:12,526][52667] DAMAGECOUNT value on done: 3088.0 [2024-08-05 22:07:12,526][52667] Sum rewards: -0.070, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.111', 'HITCOUNT': '0.210', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.753', 'weapon3': '1.394', 'weapon2': '1.988', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:12,607][52803] DAMAGECOUNT value on done: 4090.0 [2024-08-05 22:07:12,608][52803] Sum rewards: 1.310, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.222', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '1.348', 'weapon2': '1.544', 'weapon3': '1.814', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.175'} [2024-08-05 22:07:12,668][52659] DAMAGECOUNT value on done: 4057.0 [2024-08-05 22:07:12,668][52659] Sum rewards: 4.509, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.531', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.095', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.440', 'weapon3': '1.532', 'ARMOR': '1.711', 'weapon2': '1.894', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17022.7). Total num frames: 42844160. Throughput: 0: 4463.6. Samples: 10721080. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:07:12,794][52567] Avg episode reward: [(0, '2.789')] [2024-08-05 22:07:12,873][52650] Updated weights for policy 0, policy_version 5231 (0.0012) [2024-08-05 22:07:13,107][52811] DAMAGECOUNT value on done: 2634.0 [2024-08-05 22:07:13,109][52811] Sum rewards: -0.093, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.156', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.254', 'HITCOUNT': '0.260', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.852', 'FRAGCOUNT': '1.000', 'weapon3': '1.438', 'weapon2': '1.622'} [2024-08-05 22:07:13,784][52647] DAMAGECOUNT value on done: 3805.0 [2024-08-05 22:07:13,785][52647] Sum rewards: 5.891, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.116', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.106', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon3': '1.672', 'weapon2': '1.968', 'DAMAGECOUNT': '2.307', 'ARMOR': '2.657', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:13,828][52658] DAMAGECOUNT value on done: 3456.0 [2024-08-05 22:07:13,834][52658] Sum rewards: 1.315, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.022', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'HITCOUNT': '0.110', 'HEALTH': '0.142', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon4': '0.208', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.408', 'ARMOR': '0.720', 'FRAGCOUNT': '1.000', 'weapon2': '1.022', 'weapon3': '1.372'} [2024-08-05 22:07:14,135][52664] DAMAGECOUNT value on done: 3506.0 [2024-08-05 22:07:14,136][52664] Sum rewards: -0.238, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.728', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.166', 'HITCOUNT': '0.360', 'ARMOR': '0.472', 'WEAPON3': '1.000', 'weapon2': '1.186', 'DAMAGECOUNT': '1.200', 'weapon3': '1.848', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:14,141][52649] DAMAGECOUNT value on done: 3346.0 [2024-08-05 22:07:14,142][52649] Sum rewards: -0.259, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.630', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.083', 'HITCOUNT': '0.230', 'WEAPON3': '0.550', 'ARMOR': '0.924', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon3': '1.332', 'weapon2': '2.000'} [2024-08-05 22:07:14,960][52671] DAMAGECOUNT value on done: 3298.0 [2024-08-05 22:07:14,961][52671] Sum rewards: -0.602, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.111', 'HITCOUNT': '0.230', 'weapon4': '0.236', 'weapon2': '0.746', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.876', 'weapon3': '1.806', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:15,082][52663] DAMAGECOUNT value on done: 2818.0 [2024-08-05 22:07:15,082][52663] Sum rewards: 0.459, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.080', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.028', 'weapon4': '0.036', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.460', 'WEAPON3': '0.950', 'weapon2': '1.396', 'DAMAGECOUNT': '1.848', 'weapon3': '1.956', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:15,303][52820] DAMAGECOUNT value on done: 2597.0 [2024-08-05 22:07:15,307][52820] Sum rewards: 3.066, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.490', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO3': '0.060', 'HITCOUNT': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'DAMAGECOUNT': '0.801', 'weapon2': '1.320', 'weapon3': '1.334', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:15,316][52795] DAMAGECOUNT value on done: 3029.0 [2024-08-05 22:07:15,318][52795] Sum rewards: -0.036, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.228', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'ARMOR': '0.518', 'weapon5': '0.586', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.038', 'weapon3': '1.174', 'weapon2': '1.426'} [2024-08-05 22:07:15,464][52659] DAMAGECOUNT value on done: 3994.0 [2024-08-05 22:07:15,468][52659] Sum rewards: 0.428, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.634', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.121', 'ARMOR': '0.412', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.264', 'DAMAGECOUNT': '1.470', 'weapon3': '1.826', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:15,588][52667] DAMAGECOUNT value on done: 3736.0 [2024-08-05 22:07:15,590][52667] Sum rewards: 0.812, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.251', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.040', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'ARMOR': '0.934', 'FRAGCOUNT': '1.000', 'weapon2': '1.364', 'DAMAGECOUNT': '1.596', 'weapon3': '1.804'} [2024-08-05 22:07:15,593][52803] DAMAGECOUNT value on done: 2797.0 [2024-08-05 22:07:15,593][52803] Sum rewards: 4.645, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.649', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.058', 'AMMO3': '0.080', 'ARMOR': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '1.400', 'DAMAGECOUNT': '1.548', 'weapon3': '1.894', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:15,960][52668] DAMAGECOUNT value on done: 3400.0 [2024-08-05 22:07:15,962][52668] Sum rewards: 1.411, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.528', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'AMMO3': '0.099', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.858', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon2': '1.404', 'weapon3': '1.924'} [2024-08-05 22:07:16,095][52811] DAMAGECOUNT value on done: 3009.0 [2024-08-05 22:07:16,097][52811] Sum rewards: 3.144, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.664', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.071', 'HITCOUNT': '0.320', 'ARMOR': '0.493', 'WEAPON3': '0.500', 'weapon2': '1.012', 'DAMAGECOUNT': '1.035', 'weapon3': '1.150', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:16,492][52664] DAMAGECOUNT value on done: 4422.0 [2024-08-05 22:07:16,493][52664] Sum rewards: 2.455, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.270', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.080', 'HITCOUNT': '0.390', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.305', 'weapon3': '1.504', 'weapon2': '1.760', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:16,658][52658] DAMAGECOUNT value on done: 3184.0 [2024-08-05 22:07:16,659][52658] Sum rewards: 2.260, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.034', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.012', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'weapon2': '1.312', 'DAMAGECOUNT': '1.797', 'weapon3': '2.104', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:17,175][52650] Updated weights for policy 0, policy_version 5241 (0.0026) [2024-08-05 22:07:17,243][52649] DAMAGECOUNT value on done: 2285.0 [2024-08-05 22:07:17,244][52649] Sum rewards: 1.829, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.504', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'weapon4': '0.484', 'DAMAGECOUNT': '0.519', 'WEAPON3': '0.550', 'ARMOR': '0.554', 'weapon2': '1.102', 'weapon3': '1.148', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17022.7). Total num frames: 42942464. Throughput: 0: 4477.3. Samples: 10734650. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 22:07:17,794][52567] Avg episode reward: [(0, '2.517')] [2024-08-05 22:07:17,937][52671] DAMAGECOUNT value on done: 3855.0 [2024-08-05 22:07:17,939][52671] Sum rewards: 6.590, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.464', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO3': '0.095', 'weapon4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.491', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.058', 'weapon3': '1.882', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:18,224][52667] DAMAGECOUNT value on done: 4111.0 [2024-08-05 22:07:18,224][52667] Sum rewards: 3.051, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.181', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'HITCOUNT': '0.490', 'ARMOR': '0.521', 'WEAPON3': '0.550', 'weapon2': '1.416', 'weapon3': '1.448', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:18,381][52820] DAMAGECOUNT value on done: 3695.0 [2024-08-05 22:07:18,381][52820] Sum rewards: 4.884, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.724', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.194', 'ARMOR': '0.432', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon3': '1.426', 'DAMAGECOUNT': '1.542', 'weapon2': '1.742', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:18,425][52795] DAMAGECOUNT value on done: 2830.0 [2024-08-05 22:07:18,425][52795] Sum rewards: 2.759, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.060', 'HITCOUNT': '0.080', 'DAMAGECOUNT': '0.285', 'HEALTH': '0.294', 'WEAPON3': '0.400', 'ARMOR': '0.880', 'FRAGCOUNT': '1.000', 'weapon3': '1.412', 'weapon2': '1.936'} [2024-08-05 22:07:18,497][52659] DAMAGECOUNT value on done: 3287.0 [2024-08-05 22:07:18,498][52659] Sum rewards: 1.731, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.069', 'ARMOR': '0.080', 'AMMO4': '0.104', 'weapon4': '0.200', 'HEALTH': '0.259', 'HITCOUNT': '0.260', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.705', 'weapon2': '0.964', 'FRAGCOUNT': '1.000', 'weapon3': '1.256'} [2024-08-05 22:07:18,558][52803] DAMAGECOUNT value on done: 2992.0 [2024-08-05 22:07:18,559][52803] Sum rewards: 4.657, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.200', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.676', 'DAMAGECOUNT': '1.707', 'weapon3': '1.782', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:19,128][52668] DAMAGECOUNT value on done: 3746.0 [2024-08-05 22:07:19,129][52668] Sum rewards: 6.967, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.166', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO4': '0.020', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.242', 'ARMOR': '0.503', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon3': '1.340', 'weapon2': '2.010', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '8.000'} [2024-08-05 22:07:19,193][52811] DAMAGECOUNT value on done: 2672.0 [2024-08-05 22:07:19,195][52811] Sum rewards: 2.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.248', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'ARMOR': '0.084', 'weapon4': '0.108', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.822', 'weapon2': '1.092', 'weapon3': '1.572', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:19,256][52658] DAMAGECOUNT value on done: 3285.0 [2024-08-05 22:07:19,259][52658] Sum rewards: -0.390, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.220', 'weapon4': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.458', 'DAMAGECOUNT': '0.834', 'weapon3': '1.122', 'weapon2': '1.870', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:19,421][52664] DAMAGECOUNT value on done: 3766.0 [2024-08-05 22:07:19,422][52664] Sum rewards: 7.643, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.440', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.178', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '1.020', 'weapon3': '1.590', 'weapon2': '1.594', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:19,767][52660] DAMAGECOUNT value on done: 3478.0 [2024-08-05 22:07:19,768][52660] Sum rewards: 5.581, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.795', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.142', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.482', 'weapon3': '1.658', 'weapon2': '1.686', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:20,187][52649] DAMAGECOUNT value on done: 3512.0 [2024-08-05 22:07:20,196][52649] Sum rewards: 2.896, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.010', 'HEALTH': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.103', 'weapon4': '0.114', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'ARMOR': '1.332', 'DAMAGECOUNT': '1.335', 'weapon2': '1.590', 'weapon3': '1.774', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:20,549][52671] DAMAGECOUNT value on done: 2397.0 [2024-08-05 22:07:20,549][52671] Sum rewards: 2.060, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.070', 'HITCOUNT': '0.170', 'WEAPON3': '0.450', 'HEALTH': '0.495', 'DAMAGECOUNT': '0.702', 'ARMOR': '0.828', 'FRAGCOUNT': '1.000', 'weapon3': '1.466', 'weapon2': '1.996'} [2024-08-05 22:07:20,840][52667] DAMAGECOUNT value on done: 3458.0 [2024-08-05 22:07:20,841][52667] Sum rewards: 5.125, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.275', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.031', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.108', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.510', 'weapon3': '2.006', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:21,163][52659] DAMAGECOUNT value on done: 3109.0 [2024-08-05 22:07:21,165][52659] Sum rewards: -0.999, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.376', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.134', 'HITCOUNT': '0.340', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.191', 'weapon2': '1.362', 'weapon3': '2.310'} [2024-08-05 22:07:21,435][52795] DAMAGECOUNT value on done: 3799.0 [2024-08-05 22:07:21,437][52795] Sum rewards: 2.854, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.410', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon7': '0.086', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'ARMOR': '0.909', 'DAMAGECOUNT': '1.083', 'weapon3': '1.238', 'weapon2': '1.602', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:21,549][52803] DAMAGECOUNT value on done: 2880.0 [2024-08-05 22:07:21,553][52803] Sum rewards: 3.226, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.363', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.044', 'AMMO3': '0.045', 'AMMO4': '0.048', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.190', 'weapon4': '0.348', 'WEAPON3': '0.350', 'weapon2': '0.502', 'DAMAGECOUNT': '0.777', 'weapon3': '0.874', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:21,678][52820] DAMAGECOUNT value on done: 3822.0 [2024-08-05 22:07:21,681][52820] Sum rewards: 4.401, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.311', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.086', 'ARMOR': '0.432', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon2': '1.482', 'weapon3': '1.552', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:21,964][52650] Updated weights for policy 0, policy_version 5251 (0.0013) [2024-08-05 22:07:22,095][52668] DAMAGECOUNT value on done: 3179.0 [2024-08-05 22:07:22,097][52668] Sum rewards: -0.696, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.166', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.090', 'weapon4': '0.116', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.210', 'WEAPON3': '0.800', 'ARMOR': '0.932', 'DAMAGECOUNT': '1.044', 'weapon2': '1.438', 'weapon3': '1.698', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:22,102][52658] DAMAGECOUNT value on done: 4199.0 [2024-08-05 22:07:22,103][52658] Sum rewards: 0.037, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.387', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'weapon4': '0.202', 'HITCOUNT': '0.220', 'ARMOR': '0.529', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.675', 'FRAGCOUNT': '1.000', 'weapon2': '1.342', 'weapon3': '1.610'} [2024-08-05 22:07:22,176][52811] DAMAGECOUNT value on done: 3815.0 [2024-08-05 22:07:22,177][52811] Sum rewards: 0.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.808', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'ARMOR': '1.003', 'DAMAGECOUNT': '1.203', 'weapon2': '1.494', 'weapon3': '1.578'} [2024-08-05 22:07:22,346][52664] DAMAGECOUNT value on done: 2926.0 [2024-08-05 22:07:22,346][52664] Sum rewards: 5.182, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.488', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.170', 'HITCOUNT': '0.460', 'ARMOR': '0.553', 'WEAPON3': '0.600', 'weapon2': '1.258', 'weapon3': '1.716', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:22,743][52649] DAMAGECOUNT value on done: 3531.0 [2024-08-05 22:07:22,743][52649] Sum rewards: -0.726, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.413', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.097', 'HITCOUNT': '0.320', 'ARMOR': '0.533', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.251', 'weapon2': '1.612', 'weapon3': '1.800'} [2024-08-05 22:07:22,746][52660] DAMAGECOUNT value on done: 4582.0 [2024-08-05 22:07:22,746][52660] Sum rewards: 1.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.768', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.127', 'weapon4': '0.224', 'HITCOUNT': '0.420', 'WEAPON3': '0.750', 'ARMOR': '0.904', 'DAMAGECOUNT': '1.518', 'weapon2': '1.526', 'weapon3': '1.562', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17885.9, 300 sec: 17078.2). Total num frames: 43032576. Throughput: 0: 4474.7. Samples: 10761510. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:07:22,794][52567] Avg episode reward: [(0, '2.732')] [2024-08-05 22:07:23,542][52671] DAMAGECOUNT value on done: 4313.0 [2024-08-05 22:07:23,542][52671] Sum rewards: 9.069, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.634', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.099', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'ARMOR': '0.888', 'weapon2': '1.174', 'weapon3': '1.440', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '8.000'} [2024-08-05 22:07:23,575][52667] DAMAGECOUNT value on done: 4180.0 [2024-08-05 22:07:23,577][52667] Sum rewards: 4.200, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.100', 'AMMO4': '0.107', 'weapon5': '0.182', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'HEALTH': '0.906', 'DAMAGECOUNT': '1.584', 'weapon2': '1.604', 'weapon3': '1.840', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:24,198][52659] DAMAGECOUNT value on done: 3718.0 [2024-08-05 22:07:24,199][52659] Sum rewards: 2.453, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.672', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'ARMOR': '0.117', 'weapon4': '0.146', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.077', 'weapon3': '1.408', 'weapon2': '1.616', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:24,406][52795] DAMAGECOUNT value on done: 3382.0 [2024-08-05 22:07:24,407][52795] Sum rewards: 9.159, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.019', 'HEALTH': '0.062', 'AMMO3': '0.084', 'AMMO4': '0.094', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'ARMOR': '0.888', 'weapon3': '1.568', 'weapon2': '1.710', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:24,530][52803] DAMAGECOUNT value on done: 2460.0 [2024-08-05 22:07:24,531][52803] Sum rewards: 5.019, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.350', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon7': '0.060', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.292', 'HITCOUNT': '0.440', 'ARMOR': '0.546', 'WEAPON3': '0.600', 'weapon2': '1.166', 'weapon3': '1.410', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:24,787][52820] DAMAGECOUNT value on done: 3677.0 [2024-08-05 22:07:24,791][52820] Sum rewards: 3.043, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.064', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'ARMOR': '1.023', 'DAMAGECOUNT': '1.200', 'weapon3': '1.706', 'weapon2': '1.902', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:24,855][52658] DAMAGECOUNT value on done: 3861.0 [2024-08-05 22:07:24,857][52658] Sum rewards: 3.946, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.522', 'AMMO2': '0.027', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.134', 'weapon4': '0.166', 'HITCOUNT': '0.380', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'DAMAGECOUNT': '1.134', 'weapon2': '1.472', 'weapon3': '1.506', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:25,124][52668] DAMAGECOUNT value on done: 3271.0 [2024-08-05 22:07:25,124][52668] Sum rewards: 5.197, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.293', 'AMMO2': '0.012', 'AMMO4': '0.059', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.610', 'WEAPON3': '0.900', 'weapon2': '1.890', 'weapon3': '1.970', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:25,172][52811] DAMAGECOUNT value on done: 2918.0 [2024-08-05 22:07:25,173][52811] Sum rewards: 1.110, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.062', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'ARMOR': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.125', 'weapon2': '1.240', 'weapon3': '1.688'} [2024-08-05 22:07:25,174][52649] DAMAGECOUNT value on done: 3800.0 [2024-08-05 22:07:25,174][52649] Sum rewards: 7.297, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.208', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.079', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.266', 'weapon2': '1.286', 'ARMOR': '1.324', 'weapon3': '1.692', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:25,343][52664] DAMAGECOUNT value on done: 3194.0 [2024-08-05 22:07:25,346][52664] Sum rewards: 3.136, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.430', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'AMMO3': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.467', 'FRAGCOUNT': '1.000', 'weapon3': '1.158', 'DAMAGECOUNT': '1.344', 'weapon2': '1.548'} [2024-08-05 22:07:25,890][52660] DAMAGECOUNT value on done: 3057.0 [2024-08-05 22:07:25,890][52660] Sum rewards: 3.204, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.002', 'AMMO2': '0.014', 'AMMO5': '0.018', 'WEAPON1': '0.040', 'AMMO4': '0.072', 'AMMO3': '0.113', 'weapon5': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.290', 'WEAPON5': '0.350', 'ARMOR': '0.449', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.840', 'weapon2': '1.222', 'weapon3': '1.976', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:26,130][52671] DAMAGECOUNT value on done: 3585.0 [2024-08-05 22:07:26,131][52671] Sum rewards: -1.591, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.464', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'weapon4': '0.118', 'AMMO3': '0.124', 'HITCOUNT': '0.290', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.083', 'weapon2': '1.316', 'weapon3': '1.710'} [2024-08-05 22:07:26,287][52650] Updated weights for policy 0, policy_version 5261 (0.0012) [2024-08-05 22:07:26,686][52659] DAMAGECOUNT value on done: 2981.0 [2024-08-05 22:07:26,686][52659] Sum rewards: -0.901, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.052', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'WEAPON4': '0.050', 'AMMO3': '0.119', 'weapon4': '0.160', 'HITCOUNT': '0.500', 'ARMOR': '0.940', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.812', 'weapon3': '1.822', 'weapon2': '1.886', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:27,369][52803] DAMAGECOUNT value on done: 4543.0 [2024-08-05 22:07:27,370][52803] Sum rewards: 6.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.566', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'weapon4': '0.134', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'ARMOR': '0.895', 'weapon2': '1.100', 'weapon3': '1.838', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:27,441][52795] DAMAGECOUNT value on done: 3397.0 [2024-08-05 22:07:27,441][52795] Sum rewards: 1.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.055', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.131', 'ARMOR': '0.488', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.488', 'weapon2': '1.536', 'weapon3': '2.034', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:27,608][52658] DAMAGECOUNT value on done: 3595.0 [2024-08-05 22:07:27,611][52658] Sum rewards: 1.006, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.860', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'weapon5': '0.044', 'weapon4': '0.088', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.420', 'WEAPON3': '0.800', 'ARMOR': '0.932', 'DAMAGECOUNT': '1.329', 'weapon2': '1.570', 'weapon3': '1.646', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:27,794][52820] DAMAGECOUNT value on done: 2710.0 [2024-08-05 22:07:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17050.5). Total num frames: 43122688. Throughput: 0: 4484.9. Samples: 10788560. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 22:07:27,794][52567] Avg episode reward: [(0, '2.793')] [2024-08-05 22:07:27,794][52820] Sum rewards: 2.936, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.772', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.038', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.520', 'ARMOR': '0.529', 'WEAPON3': '0.650', 'weapon2': '1.544', 'DAMAGECOUNT': '1.704', 'weapon3': '1.850', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:28,249][52668] DAMAGECOUNT value on done: 3277.0 [2024-08-05 22:07:28,251][52668] Sum rewards: 2.904, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.076', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.064', 'AMMO3': '0.111', 'WEAPON5': '0.200', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'ARMOR': '0.920', 'weapon2': '1.754', 'DAMAGECOUNT': '1.965', 'weapon3': '2.046', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:28,269][52811] DAMAGECOUNT value on done: 3869.0 [2024-08-05 22:07:28,269][52811] Sum rewards: 2.536, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.166', 'HITCOUNT': '0.290', 'HEALTH': '0.472', 'WEAPON3': '0.500', 'ARMOR': '0.511', 'DAMAGECOUNT': '0.813', 'weapon3': '1.568', 'weapon2': '1.710', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:28,576][52664] DAMAGECOUNT value on done: 2660.0 [2024-08-05 22:07:28,577][52664] Sum rewards: 1.235, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.462', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.091', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.336', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'weapon4': '0.624', 'DAMAGECOUNT': '0.732', 'FRAGCOUNT': '1.000', 'weapon2': '1.048', 'weapon3': '1.316'} [2024-08-05 22:07:28,616][52671] DAMAGECOUNT value on done: 3407.0 [2024-08-05 22:07:28,616][52671] Sum rewards: 0.651, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.811', 'AMMO2': '0.003', 'ARMOR': '0.012', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.368', 'weapon3': '1.412', 'weapon2': '1.800'} [2024-08-05 22:07:28,894][52660] DAMAGECOUNT value on done: 3189.0 [2024-08-05 22:07:28,894][52660] Sum rewards: -0.303, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.866', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.412', 'DAMAGECOUNT': '0.726', 'weapon2': '0.742', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'ARMOR': '1.017', 'weapon3': '2.390'} [2024-08-05 22:07:29,266][52659] DAMAGECOUNT value on done: 4426.0 [2024-08-05 22:07:29,267][52659] Sum rewards: 5.178, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.914', 'AMMO2': '0.001', 'AMMO4': '0.002', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.107', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'ARMOR': '0.938', 'weapon2': '1.718', 'weapon3': '1.844', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:30,290][52803] DAMAGECOUNT value on done: 3122.0 [2024-08-05 22:07:30,298][52803] Sum rewards: -0.836, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.948', 'FRAGCOUNT': '1.000', 'weapon3': '1.318', 'weapon2': '1.508'} [2024-08-05 22:07:30,418][52795] DAMAGECOUNT value on done: 3440.0 [2024-08-05 22:07:30,420][52795] Sum rewards: 1.815, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.100', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.204', 'WEAPON5': '0.300', 'weapon5': '0.350', 'HITCOUNT': '0.360', 'ARMOR': '0.536', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.146', 'weapon3': '1.430', 'weapon2': '1.802', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:30,497][52658] DAMAGECOUNT value on done: 2904.0 [2024-08-05 22:07:30,498][52658] Sum rewards: 3.855, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.097', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.200', 'HEALTH': '0.208', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.281', 'weapon2': '1.512', 'weapon3': '1.658', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:30,880][52820] DAMAGECOUNT value on done: 4910.0 [2024-08-05 22:07:30,884][52820] Sum rewards: 4.312, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.855', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'ARMOR': '0.941', 'weapon2': '1.640', 'weapon3': '1.852', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:31,024][52650] Updated weights for policy 0, policy_version 5271 (0.0027) [2024-08-05 22:07:31,296][52664] DAMAGECOUNT value on done: 3219.0 [2024-08-05 22:07:31,296][52664] Sum rewards: -1.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.101', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.163', 'HITCOUNT': '0.500', 'WEAPON3': '1.050', 'ARMOR': '1.224', 'DAMAGECOUNT': '1.548', 'weapon2': '1.900', 'weapon3': '1.912', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:31,338][52811] DAMAGECOUNT value on done: 3416.0 [2024-08-05 22:07:31,339][52811] Sum rewards: 3.473, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.222', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.186', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.980', 'DAMAGECOUNT': '1.182', 'weapon2': '1.220', 'weapon3': '1.880', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:31,362][52668] DAMAGECOUNT value on done: 4347.0 [2024-08-05 22:07:31,363][52668] Sum rewards: 1.169, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'HITCOUNT': '0.250', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.750', 'weapon2': '1.352', 'weapon3': '1.366', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:31,894][52671] DAMAGECOUNT value on done: 4521.0 [2024-08-05 22:07:31,894][52671] Sum rewards: 4.687, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.982', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.132', 'ARMOR': '0.444', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.614', 'DAMAGECOUNT': '1.617', 'weapon3': '1.680', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:32,042][52660] DAMAGECOUNT value on done: 3134.0 [2024-08-05 22:07:32,042][52660] Sum rewards: 1.228, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.029', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'ARMOR': '0.044', 'AMMO3': '0.095', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.338', 'weapon2': '1.644', 'FRAGCOUNT': '2.000', 'weapon3': '2.018'} [2024-08-05 22:07:32,367][52659] DAMAGECOUNT value on done: 3668.0 [2024-08-05 22:07:32,368][52659] Sum rewards: 2.436, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.069', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.112', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'ARMOR': '0.488', 'weapon3': '0.930', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.035', 'weapon2': '1.186'} [2024-08-05 22:07:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17050.5). Total num frames: 43204608. Throughput: 0: 4486.0. Samples: 10801800. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:07:32,794][52567] Avg episode reward: [(0, '2.773')] [2024-08-05 22:07:33,462][52795] DAMAGECOUNT value on done: 3376.0 [2024-08-05 22:07:33,464][52795] Sum rewards: -0.025, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.144', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.076', 'AMMO3': '0.193', 'HITCOUNT': '0.640', 'weapon2': '1.190', 'WEAPON3': '1.200', 'DAMAGECOUNT': '2.199', 'weapon3': '2.628', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:33,553][52658] DAMAGECOUNT value on done: 3445.0 [2024-08-05 22:07:33,554][52658] Sum rewards: 3.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.337', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.050', 'weapon4': '0.084', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'ARMOR': '0.580', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.125', 'weapon2': '1.714', 'weapon3': '1.942', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:33,908][52820] DAMAGECOUNT value on done: 3062.0 [2024-08-05 22:07:33,911][52820] Sum rewards: 3.377, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.589', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'ARMOR': '0.480', 'DAMAGECOUNT': '0.948', 'weapon2': '1.494', 'weapon3': '1.524', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:34,216][52668] DAMAGECOUNT value on done: 4905.0 [2024-08-05 22:07:34,217][52668] Sum rewards: -0.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.925', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'weapon4': '0.276', 'HITCOUNT': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.900', 'weapon2': '1.120', 'DAMAGECOUNT': '1.320', 'weapon3': '1.972', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:34,241][52664] DAMAGECOUNT value on done: 3302.0 [2024-08-05 22:07:34,519][52671] DAMAGECOUNT value on done: 4079.0 [2024-08-05 22:07:34,521][52671] Sum rewards: 2.244, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.262', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.127', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.416', 'DAMAGECOUNT': '1.719', 'weapon3': '2.450', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:34,884][52660] DAMAGECOUNT value on done: 4176.0 [2024-08-05 22:07:34,884][52660] Sum rewards: 5.727, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.319', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.120', 'HITCOUNT': '0.490', 'ARMOR': '0.520', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.557', 'weapon3': '1.582', 'weapon2': '1.776', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:35,014][52659] DAMAGECOUNT value on done: 3941.0 [2024-08-05 22:07:35,014][52659] Sum rewards: 0.990, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.898', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.144', 'ARMOR': '0.484', 'HITCOUNT': '0.490', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.500', 'weapon2': '1.594', 'weapon3': '1.770', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:35,727][52650] Updated weights for policy 0, policy_version 5281 (0.0014) [2024-08-05 22:07:36,081][52658] DAMAGECOUNT value on done: 3889.0 [2024-08-05 22:07:36,081][52658] Sum rewards: 1.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.126', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'ARMOR': '1.252', 'weapon2': '1.418', 'DAMAGECOUNT': '1.860', 'weapon3': '2.432', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:36,336][52795] DAMAGECOUNT value on done: 3473.0 [2024-08-05 22:07:36,336][52795] Sum rewards: 5.894, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.458', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.010', 'AMMO4': '0.027', 'weapon5': '0.042', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.286', 'weapon3': '1.776', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:36,979][52671] DAMAGECOUNT value on done: 2939.0 [2024-08-05 22:07:36,979][52671] Sum rewards: 0.137, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'weapon4': '0.018', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.636', 'WEAPON3': '0.850', 'weapon2': '1.388', 'ARMOR': '1.484', 'weapon3': '2.140', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:37,071][52820] DAMAGECOUNT value on done: 3838.0 [2024-08-05 22:07:37,074][52820] Sum rewards: 5.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.232', 'AMMO5': '0.005', 'AMMO2': '0.029', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.147', 'weapon4': '0.192', 'WEAPON4': '0.250', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.446', 'weapon3': '1.846', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:37,235][52664] DAMAGECOUNT value on done: 3358.0 [2024-08-05 22:07:37,235][52664] Sum rewards: 2.718, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.310', 'AMMO2': '0.036', 'AMMO3': '0.103', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.342', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.812', 'weapon2': '1.332', 'DAMAGECOUNT': '1.650', 'weapon3': '1.724', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:37,268][52668] DAMAGECOUNT value on done: 3498.0 [2024-08-05 22:07:37,269][52668] Sum rewards: 0.131, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.110', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.380', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.128', 'ARMOR': '1.392', 'weapon2': '1.642', 'FRAGCOUNT': '2.000', 'weapon3': '2.116'} [2024-08-05 22:07:37,743][52659] DAMAGECOUNT value on done: 3550.0 [2024-08-05 22:07:37,744][52659] Sum rewards: 3.973, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.098', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.944', 'DAMAGECOUNT': '1.266', 'weapon2': '1.776', 'weapon3': '1.886', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 18022.4, 300 sec: 17133.8). Total num frames: 43302912. Throughput: 0: 4480.2. Samples: 10828610. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:07:37,794][52567] Avg episode reward: [(0, '2.560')] [2024-08-05 22:07:37,904][52660] DAMAGECOUNT value on done: 3569.0 [2024-08-05 22:07:37,905][52660] Sum rewards: -2.486, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.748', 'weapon4': '0.006', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon5': '0.066', 'AMMO4': '0.083', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HITCOUNT': '0.250', 'ARMOR': '0.571', 'DAMAGECOUNT': '0.762', 'WEAPON3': '0.850', 'weapon2': '1.444', 'FRAGCOUNT': '1.500', 'weapon3': '2.074'} [2024-08-05 22:07:39,393][52795] DAMAGECOUNT value on done: 3114.0 [2024-08-05 22:07:39,394][52795] Sum rewards: 4.086, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.330', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'ARMOR': '0.455', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.486', 'weapon3': '1.670', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:40,061][52820] DAMAGECOUNT value on done: 3386.0 [2024-08-05 22:07:40,061][52820] Sum rewards: 4.729, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.008', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.073', 'AMMO3': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.144', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.380', 'weapon2': '1.516', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:40,072][52671] DAMAGECOUNT value on done: 4319.0 [2024-08-05 22:07:40,075][52671] Sum rewards: 3.266, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.672', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.084', 'weapon5': '0.146', 'WEAPON5': '0.150', 'HITCOUNT': '0.340', 'ARMOR': '0.550', 'WEAPON3': '0.650', 'weapon3': '1.306', 'weapon2': '1.390', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:40,097][52650] Updated weights for policy 0, policy_version 5291 (0.0044) [2024-08-05 22:07:40,287][52664] DAMAGECOUNT value on done: 3524.0 [2024-08-05 22:07:40,398][52668] DAMAGECOUNT value on done: 3690.0 [2024-08-05 22:07:40,398][52668] Sum rewards: 1.563, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.077', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'ARMOR': '0.040', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.174', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.044', 'weapon3': '1.794', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:40,774][52659] DAMAGECOUNT value on done: 3942.0 [2024-08-05 22:07:40,774][52659] Sum rewards: 6.097, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.722', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.048', 'ARMOR': '0.072', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '1.622', 'weapon3': '1.720', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:41,078][52660] DAMAGECOUNT value on done: 3051.0 [2024-08-05 22:07:41,080][52660] Sum rewards: -1.215, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO3': '0.088', 'HITCOUNT': '0.380', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.092', 'weapon3': '1.688', 'weapon2': '1.842'} [2024-08-05 22:07:41,341][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:07:42,794][52567] Fps is (10 sec: 18841.6, 60 sec: 18022.4, 300 sec: 17133.8). Total num frames: 43393024. Throughput: 0: 4477.8. Samples: 10855430. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:07:42,794][52567] Avg episode reward: [(0, '2.525')] [2024-08-05 22:07:43,145][52820] DAMAGECOUNT value on done: 3972.0 [2024-08-05 22:07:43,147][52820] Sum rewards: 4.364, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.755', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.116', 'ARMOR': '0.493', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '1.386', 'weapon3': '1.648', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:43,170][52664] DAMAGECOUNT value on done: 3156.0 [2024-08-05 22:07:43,170][52664] Sum rewards: 3.370, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.345', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.200', 'weapon5': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'ARMOR': '0.959', 'DAMAGECOUNT': '1.089', 'weapon3': '1.426', 'weapon2': '1.856', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:43,266][52671] DAMAGECOUNT value on done: 2597.0 [2024-08-05 22:07:43,266][52671] Sum rewards: 4.943, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.094', 'weapon4': '0.124', 'HEALTH': '0.130', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.560', 'weapon2': '1.092', 'weapon3': '1.400', 'DAMAGECOUNT': '1.488', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:43,542][52668] DAMAGECOUNT value on done: 4694.0 [2024-08-05 22:07:43,543][52668] Sum rewards: 4.663, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.088', 'AMMO2': '0.008', 'ARMOR': '0.016', 'AMMO4': '0.041', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.942', 'weapon3': '1.530', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:44,004][52659] DAMAGECOUNT value on done: 4655.0 [2024-08-05 22:07:44,006][52659] Sum rewards: 3.545, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.070', 'HEALTH': '0.293', 'HITCOUNT': '0.330', 'WEAPON3': '0.400', 'weapon3': '1.122', 'DAMAGECOUNT': '1.170', 'ARMOR': '1.298', 'weapon2': '1.742', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:44,087][52660] DAMAGECOUNT value on done: 3971.0 [2024-08-05 22:07:44,087][52660] Sum rewards: -0.731, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.481', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.119', 'weapon5': '0.144', 'weapon4': '0.198', 'HITCOUNT': '0.440', 'FRAGCOUNT': '0.500', 'WEAPON3': '0.750', 'ARMOR': '0.876', 'DAMAGECOUNT': '1.290', 'weapon2': '1.474', 'weapon3': '1.930'} [2024-08-05 22:07:44,631][52650] Updated weights for policy 0, policy_version 5301 (0.0021) [2024-08-05 22:07:45,636][52664] DAMAGECOUNT value on done: 3109.0 [2024-08-05 22:07:45,636][52664] Sum rewards: 1.579, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.584', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.036', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.320', 'ARMOR': '0.480', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.966', 'weapon2': '1.558', 'weapon3': '1.878', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:46,108][52671] DAMAGECOUNT value on done: 3658.0 [2024-08-05 22:07:46,117][52671] Sum rewards: 2.764, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.159', 'AMMO2': '0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '0.857', 'DAMAGECOUNT': '1.506', 'weapon3': '1.518', 'weapon2': '2.058', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:46,170][52820] DAMAGECOUNT value on done: 4053.0 [2024-08-05 22:07:46,170][52820] Sum rewards: 1.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.382', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'weapon4': '0.114', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.508', 'weapon3': '1.100', 'DAMAGECOUNT': '1.182', 'FRAGCOUNT': '2.000', 'weapon2': '2.142'} [2024-08-05 22:07:46,615][52659] DAMAGECOUNT value on done: 4091.0 [2024-08-05 22:07:46,617][52659] Sum rewards: 9.981, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon5': '0.094', 'AMMO3': '0.096', 'HEALTH': '0.114', 'weapon4': '0.120', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.954', 'weapon2': '1.356', 'weapon3': '1.774', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '8.000'} [2024-08-05 22:07:46,692][52668] DAMAGECOUNT value on done: 3151.0 [2024-08-05 22:07:46,692][52668] Sum rewards: 4.778, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.876', 'AMMO2': '0.018', 'weapon4': '0.054', 'AMMO4': '0.091', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'HITCOUNT': '0.630', 'WEAPON3': '1.000', 'ARMOR': '1.327', 'weapon2': '1.700', 'weapon3': '1.972', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:47,322][52660] DAMAGECOUNT value on done: 2751.0 [2024-08-05 22:07:47,323][52660] Sum rewards: 4.266, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.399', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.106', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.930', 'DAMAGECOUNT': '1.140', 'weapon3': '1.270', 'weapon2': '1.468', 'FRAGCOUNT': '4.000'} [2024-08-05 22:07:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17133.8). Total num frames: 43483136. Throughput: 0: 4477.6. Samples: 10868880. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:07:47,794][52567] Avg episode reward: [(0, '2.820')] [2024-08-05 22:07:48,506][52664] DAMAGECOUNT value on done: 4567.0 [2024-08-05 22:07:48,507][52664] Sum rewards: -0.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.026', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.153', 'HITCOUNT': '0.400', 'ARMOR': '0.941', 'WEAPON3': '1.050', 'weapon2': '1.412', 'DAMAGECOUNT': '1.536', 'weapon3': '2.344', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:48,689][52671] DAMAGECOUNT value on done: 4522.0 [2024-08-05 22:07:48,690][52671] Sum rewards: 0.005, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.376', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon4': '0.076', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'HITCOUNT': '0.320', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.915', 'FRAGCOUNT': '1.000', 'weapon2': '1.196', 'weapon3': '1.550'} [2024-08-05 22:07:49,157][52659] DAMAGECOUNT value on done: 4065.0 [2024-08-05 22:07:49,158][52659] Sum rewards: 3.792, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.240', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.218', 'ARMOR': '0.400', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.298', 'weapon3': '1.580', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:49,216][52820] DAMAGECOUNT value on done: 3206.0 [2024-08-05 22:07:49,216][52820] Sum rewards: -1.995, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.332', 'weapon4': '0.002', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.145', 'HITCOUNT': '0.310', 'WEAPON3': '0.900', 'weapon2': '1.262', 'DAMAGECOUNT': '1.275', 'ARMOR': '1.364', 'weapon3': '1.608', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:49,483][52650] Updated weights for policy 0, policy_version 5311 (0.0012) [2024-08-05 22:07:49,720][52668] DAMAGECOUNT value on done: 3131.0 [2024-08-05 22:07:49,721][52668] Sum rewards: 1.329, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.503', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.010', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.172', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'ARMOR': '0.860', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.020', 'weapon2': '1.384', 'weapon3': '1.458'} [2024-08-05 22:07:50,364][52660] DAMAGECOUNT value on done: 3879.0 [2024-08-05 22:07:50,366][52660] Sum rewards: -0.771, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.994', 'AMMO2': '0.005', 'AMMO5': '0.015', 'AMMO4': '0.023', 'AMMO3': '0.158', 'weapon5': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.416', 'HITCOUNT': '0.530', 'WEAPON3': '1.100', 'weapon2': '1.106', 'DAMAGECOUNT': '1.962', 'weapon3': '2.208', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:51,504][52671] DAMAGECOUNT value on done: 3300.0 [2024-08-05 22:07:51,512][52671] Sum rewards: 4.825, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.542', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.113', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'ARMOR': '1.315', 'weapon3': '1.332', 'DAMAGECOUNT': '1.740', 'weapon2': '2.010', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:52,242][52659] DAMAGECOUNT value on done: 3311.0 [2024-08-05 22:07:52,243][52659] Sum rewards: 0.418, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.885', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.074', 'HITCOUNT': '0.320', 'ARMOR': '0.518', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.086', 'weapon2': '1.502', 'weapon3': '1.538'} [2024-08-05 22:07:52,284][52820] DAMAGECOUNT value on done: 2672.0 [2024-08-05 22:07:52,285][52820] Sum rewards: 3.136, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.310', 'AMMO4': '-0.128', 'AMMO2': '-0.026', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.272', 'weapon3': '1.342', 'ARMOR': '1.412', 'weapon2': '1.956', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17885.8, 300 sec: 17161.6). Total num frames: 43565056. Throughput: 0: 4483.1. Samples: 10896140. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:07:52,794][52567] Avg episode reward: [(0, '2.656')] [2024-08-05 22:07:53,039][52668] DAMAGECOUNT value on done: 3364.0 [2024-08-05 22:07:53,040][52668] Sum rewards: 6.886, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.755', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON1': '0.030', 'AMMO3': '0.078', 'ARMOR': '0.470', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.158', 'weapon3': '1.484', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '7.000'} [2024-08-05 22:07:53,589][52650] Updated weights for policy 0, policy_version 5321 (0.0014) [2024-08-05 22:07:53,624][52660] DAMAGECOUNT value on done: 3468.0 [2024-08-05 22:07:53,624][52660] Sum rewards: 2.982, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.805', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'weapon7': '0.052', 'AMMO3': '0.075', 'ARMOR': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'weapon3': '1.026', 'DAMAGECOUNT': '1.164', 'weapon2': '1.376', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:54,501][52671] DAMAGECOUNT value on done: 3804.0 [2024-08-05 22:07:54,503][52671] Sum rewards: 1.158, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.092', 'AMMO2': '0.010', 'AMMO4': '0.049', 'ARMOR': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.160', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.116', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '2.000', 'weapon3': '2.376'} [2024-08-05 22:07:55,119][52659] DAMAGECOUNT value on done: 3610.0 [2024-08-05 22:07:55,120][52659] Sum rewards: 2.742, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.423', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'weapon4': '0.228', 'HITCOUNT': '0.310', 'WEAPON3': '0.500', 'ARMOR': '0.925', 'DAMAGECOUNT': '0.927', 'weapon2': '1.306', 'weapon3': '1.320', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:55,369][52820] DAMAGECOUNT value on done: 2792.0 [2024-08-05 22:07:55,370][52820] Sum rewards: 4.537, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.516', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.120', 'HITCOUNT': '0.450', 'WEAPON3': '0.850', 'ARMOR': '0.948', 'DAMAGECOUNT': '1.371', 'weapon2': '1.414', 'weapon3': '1.656', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:55,645][52668] DAMAGECOUNT value on done: 3990.0 [2024-08-05 22:07:55,646][52668] Sum rewards: 4.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.938', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.129', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'ARMOR': '1.320', 'weapon2': '1.440', 'weapon3': '2.216', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '6.000'} [2024-08-05 22:07:56,113][52660] DAMAGECOUNT value on done: 3292.0 [2024-08-05 22:07:56,114][52660] Sum rewards: 0.797, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.440', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.398', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'ARMOR': '0.869', 'weapon2': '0.946', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.449', 'weapon3': '1.820'} [2024-08-05 22:07:56,563][52794] DAMAGECOUNT value on done: 3594.0 [2024-08-05 22:07:56,572][52794] Sum rewards: 4.303, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'HEALTH': '0.160', 'weapon4': '0.196', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '1.220', 'DAMAGECOUNT': '1.647', 'weapon3': '1.678', 'weapon2': '1.796', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:57,559][52659] DAMAGECOUNT value on done: 2903.0 [2024-08-05 22:07:57,561][52659] Sum rewards: 0.488, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.978', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.310', 'ARMOR': '0.490', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.029', 'weapon2': '1.316', 'weapon3': '1.352', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17885.9, 300 sec: 17133.8). Total num frames: 43655168. Throughput: 0: 4480.7. Samples: 10922710. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 22:07:57,795][52567] Avg episode reward: [(0, '2.578')] [2024-08-05 22:07:58,388][52650] Updated weights for policy 0, policy_version 5331 (0.0012) [2024-08-05 22:07:58,471][52668] DAMAGECOUNT value on done: 3631.0 [2024-08-05 22:07:58,471][52668] Sum rewards: -1.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.976', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.198', 'HITCOUNT': '0.410', 'ARMOR': '0.554', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.312', 'DAMAGECOUNT': '1.410', 'weapon3': '1.748'} [2024-08-05 22:07:58,496][52820] DAMAGECOUNT value on done: 3477.0 [2024-08-05 22:07:58,496][52820] Sum rewards: 5.273, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.020', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'weapon5': '0.066', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'weapon3': '1.424', 'DAMAGECOUNT': '1.506', 'weapon2': '1.584', 'FRAGCOUNT': '5.000'} [2024-08-05 22:07:58,862][52660] DAMAGECOUNT value on done: 3707.0 [2024-08-05 22:07:58,864][52660] Sum rewards: 0.373, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.010', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.216', 'HITCOUNT': '0.320', 'ARMOR': '0.611', 'WEAPON3': '0.800', 'weapon2': '1.058', 'DAMAGECOUNT': '1.107', 'weapon3': '1.808', 'FRAGCOUNT': '3.000'} [2024-08-05 22:07:59,576][52794] DAMAGECOUNT value on done: 3943.0 [2024-08-05 22:07:59,577][52794] Sum rewards: 1.375, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.124', 'HITCOUNT': '0.220', 'HEALTH': '0.390', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.855', 'ARMOR': '0.928', 'weapon2': '1.638', 'weapon3': '1.942', 'FRAGCOUNT': '2.000'} [2024-08-05 22:07:59,956][52659] DAMAGECOUNT value on done: 3786.0 [2024-08-05 22:08:00,516][52662] DAMAGECOUNT value on done: 3996.0 [2024-08-05 22:08:00,516][52662] Sum rewards: 6.758, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.628', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.124', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'ARMOR': '0.956', 'weapon3': '1.458', 'weapon2': '1.676', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:01,536][52820] DAMAGECOUNT value on done: 3295.0 [2024-08-05 22:08:01,536][52820] Sum rewards: 2.205, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'AMMO3': '0.111', 'weapon5': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'ARMOR': '0.489', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.635', 'weapon2': '1.664', 'weapon3': '1.978', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:01,563][52668] DAMAGECOUNT value on done: 3698.0 [2024-08-05 22:08:01,573][52668] Sum rewards: 3.559, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.574', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.008', 'ARMOR': '0.016', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.320', 'DAMAGECOUNT': '1.716', 'weapon3': '1.796', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:01,967][52660] DAMAGECOUNT value on done: 3970.0 [2024-08-05 22:08:01,969][52660] Sum rewards: 3.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.086', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.145', 'HITCOUNT': '0.360', 'ARMOR': '0.504', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.131', 'weapon2': '1.618', 'weapon3': '1.624', 'FRAGCOUNT': '6.000'} [2024-08-05 22:08:02,557][52794] DAMAGECOUNT value on done: 4497.0 [2024-08-05 22:08:02,559][52794] Sum rewards: 2.953, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.794', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.024', 'AMMO3': '0.083', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.750', 'weapon3': '1.782', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:02,701][52650] Updated weights for policy 0, policy_version 5341 (0.0010) [2024-08-05 22:08:02,794][52567] Fps is (10 sec: 18841.4, 60 sec: 18022.4, 300 sec: 17189.4). Total num frames: 43753472. Throughput: 0: 4482.2. Samples: 10936350. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:08:02,795][52567] Avg episode reward: [(0, '2.621')] [2024-08-05 22:08:02,911][52795] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 22:08:03,466][52662] DAMAGECOUNT value on done: 3749.0 [2024-08-05 22:08:03,466][52662] Sum rewards: 2.565, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.536', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.032', 'AMMO4': '0.069', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.336', 'HITCOUNT': '0.430', 'ARMOR': '0.506', 'WEAPON3': '0.650', 'weapon2': '1.210', 'DAMAGECOUNT': '1.437', 'weapon3': '1.730', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:04,592][52820] DAMAGECOUNT value on done: 3015.0 [2024-08-05 22:08:04,593][52820] Sum rewards: 2.189, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.608', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.036', 'AMMO4': '0.110', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'ARMOR': '0.951', 'weapon2': '1.442', 'weapon3': '1.722', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:04,861][52668] DAMAGECOUNT value on done: 3656.0 [2024-08-05 22:08:04,862][52668] Sum rewards: 4.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.323', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.090', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.958', 'weapon3': '1.394', 'DAMAGECOUNT': '1.431', 'weapon2': '2.210', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:05,076][52794] DAMAGECOUNT value on done: 4222.0 [2024-08-05 22:08:05,076][52794] Sum rewards: 0.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.986', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.015', 'weapon5': '0.056', 'weapon4': '0.106', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.852', 'ARMOR': '0.864', 'weapon2': '1.622', 'weapon3': '1.834', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:05,177][52660] DAMAGECOUNT value on done: 3487.0 [2024-08-05 22:08:05,179][52660] Sum rewards: 2.665, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.550', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.220', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'ARMOR': '0.567', 'weapon2': '1.228', 'DAMAGECOUNT': '1.275', 'weapon3': '1.304', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:05,868][52662] DAMAGECOUNT value on done: 4062.0 [2024-08-05 22:08:05,869][52662] Sum rewards: 2.931, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.534', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'ARMOR': '0.084', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.106', 'AMMO3': '0.109', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.398', 'DAMAGECOUNT': '1.782', 'weapon3': '2.164', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:07,578][52794] DAMAGECOUNT value on done: 4340.0 [2024-08-05 22:08:07,579][52794] Sum rewards: 1.088, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.773', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'HITCOUNT': '0.440', 'WEAPON3': '0.900', 'ARMOR': '1.335', 'DAMAGECOUNT': '1.560', 'weapon3': '1.576', 'weapon2': '1.586', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:07,592][52650] Updated weights for policy 0, policy_version 5351 (0.0018) [2024-08-05 22:08:07,699][52668] DAMAGECOUNT value on done: 3983.0 [2024-08-05 22:08:07,702][52668] Sum rewards: 1.076, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.027', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'ARMOR': '0.493', 'HITCOUNT': '0.550', 'WEAPON3': '0.950', 'weapon2': '1.428', 'weapon3': '2.184', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:07,783][52820] DAMAGECOUNT value on done: 3196.0 [2024-08-05 22:08:07,784][52820] Sum rewards: 3.256, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.499', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.162', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.256', 'ARMOR': '0.525', 'HITCOUNT': '0.610', 'WEAPON3': '1.000', 'weapon2': '1.092', 'weapon3': '2.464', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17189.3). Total num frames: 43835392. Throughput: 0: 4480.0. Samples: 10963110. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:08:07,794][52567] Avg episode reward: [(0, '2.429')] [2024-08-05 22:08:08,149][52660] DAMAGECOUNT value on done: 3588.0 [2024-08-05 22:08:08,151][52660] Sum rewards: 5.390, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.358', 'HITCOUNT': '0.450', 'ARMOR': '0.488', 'WEAPON3': '0.550', 'HEALTH': '0.568', 'weapon2': '1.064', 'DAMAGECOUNT': '1.467', 'weapon3': '2.062', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:08,706][52662] DAMAGECOUNT value on done: 3391.0 [2024-08-05 22:08:10,592][52794] DAMAGECOUNT value on done: 4342.0 [2024-08-05 22:08:10,593][52794] Sum rewards: 4.191, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'HEALTH': '0.062', 'weapon4': '0.096', 'AMMO4': '0.105', 'AMMO3': '0.143', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.602', 'ARMOR': '1.720', 'weapon2': '1.728', 'weapon3': '1.974', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:10,741][52668] DAMAGECOUNT value on done: 2875.0 [2024-08-05 22:08:10,744][52668] Sum rewards: -0.541, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.256', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'WEAPON1': '0.040', 'ARMOR': '0.072', 'AMMO3': '0.103', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.206', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.278', 'weapon3': '1.354', 'weapon2': '1.706', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:10,804][52820] DAMAGECOUNT value on done: 3859.0 [2024-08-05 22:08:10,806][52820] Sum rewards: 0.205, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.290', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'ARMOR': '0.028', 'AMMO3': '0.108', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'weapon2': '1.510', 'DAMAGECOUNT': '1.551', 'weapon3': '1.840', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:11,129][52660] DAMAGECOUNT value on done: 3710.0 [2024-08-05 22:08:11,130][52660] Sum rewards: 0.075, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.060', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.013', 'AMMO3': '0.092', 'weapon5': '0.108', 'WEAPON5': '0.200', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'ARMOR': '0.935', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.104', 'weapon2': '1.256', 'weapon3': '1.642'} [2024-08-05 22:08:11,514][52662] DAMAGECOUNT value on done: 3975.0 [2024-08-05 22:08:11,516][52662] Sum rewards: 0.605, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.140', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'HITCOUNT': '0.290', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.876', 'FRAGCOUNT': '1.000', 'weapon3': '1.592', 'weapon2': '1.868'} [2024-08-05 22:08:12,240][52650] Updated weights for policy 0, policy_version 5361 (0.0011) [2024-08-05 22:08:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 18158.9, 300 sec: 17217.1). Total num frames: 43933696. Throughput: 0: 4476.0. Samples: 10989980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:08:12,794][52567] Avg episode reward: [(0, '2.301')] [2024-08-05 22:08:13,086][52794] DAMAGECOUNT value on done: 3690.0 [2024-08-05 22:08:13,087][52794] Sum rewards: 5.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.556', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.013', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.224', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.792', 'weapon5': '1.252', 'ARMOR': '1.314', 'weapon3': '1.608', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:13,532][52668] DAMAGECOUNT value on done: 3218.0 [2024-08-05 22:08:13,533][52668] Sum rewards: 2.289, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.942', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'ARMOR': '1.317', 'weapon3': '1.604', 'weapon2': '1.710', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '3.500'} [2024-08-05 22:08:13,724][52820] DAMAGECOUNT value on done: 3752.0 [2024-08-05 22:08:13,725][52820] Sum rewards: 4.370, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.737', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.097', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.551', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.554', 'weapon3': '2.012', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:13,790][52662] DAMAGECOUNT value on done: 4549.0 [2024-08-05 22:08:13,790][52662] Sum rewards: 3.695, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.055', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.089', 'HITCOUNT': '0.340', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'weapon3': '1.182', 'DAMAGECOUNT': '1.308', 'weapon2': '1.326', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:13,866][52660] DAMAGECOUNT value on done: 2739.0 [2024-08-05 22:08:13,868][52660] Sum rewards: -0.353, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.690', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'weapon4': '0.256', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.822', 'ARMOR': '0.945', 'FRAGCOUNT': '1.000', 'weapon2': '1.120', 'weapon3': '1.344'} [2024-08-05 22:08:15,871][52794] DAMAGECOUNT value on done: 3622.0 [2024-08-05 22:08:15,872][52794] Sum rewards: 2.183, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.541', 'AMMO2': '0.006', 'AMMO4': '0.031', 'ARMOR': '0.044', 'AMMO3': '0.072', 'HITCOUNT': '0.320', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.077', 'weapon2': '1.520', 'weapon3': '1.604', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:16,451][52650] Updated weights for policy 0, policy_version 5371 (0.0032) [2024-08-05 22:08:16,578][52660] DAMAGECOUNT value on done: 4731.0 [2024-08-05 22:08:16,579][52660] Sum rewards: -0.140, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.351', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.014', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'HITCOUNT': '0.570', 'ARMOR': '0.902', 'WEAPON3': '1.050', 'weapon2': '1.580', 'DAMAGECOUNT': '1.764', 'weapon3': '2.114', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:16,867][52662] DAMAGECOUNT value on done: 5161.0 [2024-08-05 22:08:16,868][52662] Sum rewards: 5.374, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.050', 'AMMO4': '-0.098', 'AMMO2': '-0.020', 'AMMO3': '0.101', 'ARMOR': '0.499', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.784', 'weapon3': '1.908', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '6.000'} [2024-08-05 22:08:17,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17885.8, 300 sec: 17244.8). Total num frames: 44015616. Throughput: 0: 4479.7. Samples: 11003390. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:08:17,795][52567] Avg episode reward: [(0, '2.348')] [2024-08-05 22:08:18,976][52794] DAMAGECOUNT value on done: 4763.0 [2024-08-05 22:08:18,977][52794] Sum rewards: 4.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.806', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon4': '0.086', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.440', 'weapon3': '1.688', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:20,044][52662] DAMAGECOUNT value on done: 4787.0 [2024-08-05 22:08:20,044][52662] Sum rewards: 9.694, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.370', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '0.993', 'weapon2': '1.290', 'weapon3': '1.566', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '7.000'} [2024-08-05 22:08:21,166][52650] Updated weights for policy 0, policy_version 5381 (0.0011) [2024-08-05 22:08:21,909][52794] DAMAGECOUNT value on done: 3849.0 [2024-08-05 22:08:21,909][52794] Sum rewards: 5.501, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.887', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'ARMOR': '0.045', 'AMMO3': '0.099', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon3': '1.920', 'weapon2': '1.998', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '6.000'} [2024-08-05 22:08:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17244.9). Total num frames: 44105728. Throughput: 0: 4484.4. Samples: 11030410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:08:22,794][52567] Avg episode reward: [(0, '2.490')] [2024-08-05 22:08:22,912][52662] DAMAGECOUNT value on done: 4574.0 [2024-08-05 22:08:22,912][52662] Sum rewards: 6.144, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'weapon4': '0.022', 'WEAPON1': '0.030', 'AMMO2': '0.032', 'HEALTH': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'AMMO4': '0.158', 'ARMOR': '0.448', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.338', 'DAMAGECOUNT': '2.109', 'weapon3': '2.330', 'FRAGCOUNT': '7.000'} [2024-08-05 22:08:25,066][52794] DAMAGECOUNT value on done: 4026.0 [2024-08-05 22:08:25,067][52794] Sum rewards: 0.173, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.933', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.530', 'ARMOR': '0.552', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.755', 'weapon2': '1.756', 'weapon3': '1.778', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:25,673][52650] Updated weights for policy 0, policy_version 5391 (0.0019) [2024-08-05 22:08:26,054][52662] DAMAGECOUNT value on done: 3996.0 [2024-08-05 22:08:27,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17272.6). Total num frames: 44195840. Throughput: 0: 4484.0. Samples: 11057210. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:08:27,802][52567] Avg episode reward: [(0, '2.497')] [2024-08-05 22:08:27,889][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005396_44204032.pth... [2024-08-05 22:08:27,905][52794] DAMAGECOUNT value on done: 4460.0 [2024-08-05 22:08:27,905][52794] Sum rewards: 3.342, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.548', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.116', 'HITCOUNT': '0.470', 'ARMOR': '0.552', 'WEAPON3': '0.850', 'weapon2': '1.648', 'DAMAGECOUNT': '1.740', 'weapon3': '1.988', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:28,026][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000004888_40042496.pth [2024-08-05 22:08:28,702][52662] DAMAGECOUNT value on done: 4133.0 [2024-08-05 22:08:28,704][52662] Sum rewards: 4.056, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.849', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'ARMOR': '0.847', 'weapon3': '1.584', 'weapon2': '1.588', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:30,375][52650] Updated weights for policy 0, policy_version 5401 (0.0022) [2024-08-05 22:08:30,605][52794] DAMAGECOUNT value on done: 3927.0 [2024-08-05 22:08:30,607][52794] Sum rewards: 4.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon7': '0.046', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.440', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'weapon2': '1.050', 'weapon3': '1.622', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:31,854][52662] DAMAGECOUNT value on done: 3566.0 [2024-08-05 22:08:31,854][52662] Sum rewards: 2.024, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.028', 'AMMO4': '0.053', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.450', 'ARMOR': '0.474', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.443', 'weapon3': '1.498', 'weapon2': '1.612', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 18022.3, 300 sec: 17272.6). Total num frames: 44285952. Throughput: 0: 4480.2. Samples: 11070490. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-05 22:08:32,795][52567] Avg episode reward: [(0, '2.561')] [2024-08-05 22:08:33,537][52794] DAMAGECOUNT value on done: 5354.0 [2024-08-05 22:08:33,537][52794] Sum rewards: 2.508, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.127', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.035', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.818', 'weapon3': '1.900', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:34,599][52662] DAMAGECOUNT value on done: 4254.0 [2024-08-05 22:08:34,600][52662] Sum rewards: 4.439, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.034', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.700', 'ARMOR': '0.844', 'DAMAGECOUNT': '1.179', 'weapon2': '1.300', 'weapon3': '1.484', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:35,052][52650] Updated weights for policy 0, policy_version 5411 (0.0012) [2024-08-05 22:08:36,244][52794] DAMAGECOUNT value on done: 4230.0 [2024-08-05 22:08:36,246][52794] Sum rewards: 0.049, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.604', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.092', 'WEAPON5': '0.200', 'HITCOUNT': '0.210', 'ARMOR': '0.460', 'DAMAGECOUNT': '0.666', 'WEAPON3': '0.700', 'weapon2': '1.410', 'weapon3': '1.664', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:37,428][52662] DAMAGECOUNT value on done: 4414.0 [2024-08-05 22:08:37,428][52662] Sum rewards: 1.917, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.116', 'AMMO4': '-0.089', 'AMMO2': '-0.018', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO3': '0.077', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'ARMOR': '0.954', 'weapon3': '1.384', 'DAMAGECOUNT': '1.419', 'weapon2': '1.950', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17885.8, 300 sec: 17300.4). Total num frames: 44376064. Throughput: 0: 4470.0. Samples: 11097290. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:08:37,795][52567] Avg episode reward: [(0, '2.567')] [2024-08-05 22:08:39,308][52794] DAMAGECOUNT value on done: 4473.0 [2024-08-05 22:08:39,319][52794] Sum rewards: 3.375, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.423', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'AMMO3': '0.080', 'weapon5': '0.088', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'ARMOR': '0.928', 'DAMAGECOUNT': '0.930', 'weapon2': '1.740', 'weapon3': '1.878', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:39,523][52650] Updated weights for policy 0, policy_version 5421 (0.0013) [2024-08-05 22:08:40,458][52662] DAMAGECOUNT value on done: 3954.0 [2024-08-05 22:08:40,462][52662] Sum rewards: -0.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.926', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.196', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.332', 'ARMOR': '1.383', 'weapon3': '1.510', 'weapon2': '1.772'} [2024-08-05 22:08:42,187][52794] DAMAGECOUNT value on done: 4627.0 [2024-08-05 22:08:42,189][52794] Sum rewards: -0.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.133', 'HITCOUNT': '0.480', 'ARMOR': '0.848', 'WEAPON3': '0.850', 'weapon2': '1.616', 'DAMAGECOUNT': '1.770', 'weapon3': '1.910', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17885.8, 300 sec: 17328.2). Total num frames: 44466176. Throughput: 0: 4473.6. Samples: 11124020. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-05 22:08:42,794][52567] Avg episode reward: [(0, '2.530')] [2024-08-05 22:08:43,420][52662] DAMAGECOUNT value on done: 4714.0 [2024-08-05 22:08:43,422][52662] Sum rewards: 2.911, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.485', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO3': '0.056', 'WEAPON4': '0.200', 'weapon4': '0.214', 'HITCOUNT': '0.260', 'WEAPON3': '0.500', 'ARMOR': '0.518', 'DAMAGECOUNT': '0.900', 'weapon3': '1.012', 'weapon2': '1.556', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:44,287][52650] Updated weights for policy 0, policy_version 5431 (0.0024) [2024-08-05 22:08:45,225][52794] DAMAGECOUNT value on done: 5128.0 [2024-08-05 22:08:45,227][52794] Sum rewards: 4.110, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.544', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.144', 'ARMOR': '0.489', 'HITCOUNT': '0.530', 'WEAPON3': '0.950', 'weapon2': '1.500', 'DAMAGECOUNT': '1.677', 'weapon3': '2.070', 'FRAGCOUNT': '7.000'} [2024-08-05 22:08:46,166][52666] DAMAGECOUNT value on done: 2964.0 [2024-08-05 22:08:46,166][52666] Sum rewards: -0.169, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.879', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.114', 'HITCOUNT': '0.270', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.969', 'FRAGCOUNT': '1.000', 'weapon2': '1.396', 'weapon3': '1.636'} [2024-08-05 22:08:46,437][52662] DAMAGECOUNT value on done: 3647.0 [2024-08-05 22:08:46,437][52662] Sum rewards: 3.026, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.955', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'weapon4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'ARMOR': '0.526', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon3': '1.750', 'weapon2': '1.776', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '4.000'} [2024-08-05 22:08:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17885.9, 300 sec: 17328.2). Total num frames: 44556288. Throughput: 0: 4472.0. Samples: 11137590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:08:47,794][52567] Avg episode reward: [(0, '2.550')] [2024-08-05 22:08:48,372][52794] DAMAGECOUNT value on done: 4275.0 [2024-08-05 22:08:48,374][52794] Sum rewards: -1.196, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'weapon7': '0.156', 'WEAPON7': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.900', 'ARMOR': '0.998', 'weapon2': '1.396', 'DAMAGECOUNT': '1.530', 'weapon3': '1.676', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:48,554][52666] DAMAGECOUNT value on done: 4364.0 [2024-08-05 22:08:48,555][52666] Sum rewards: 1.147, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.270', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON1': '0.020', 'AMMO3': '0.110', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.404', 'DAMAGECOUNT': '1.572', 'weapon3': '1.888', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:48,627][52650] Updated weights for policy 0, policy_version 5441 (0.0018) [2024-08-05 22:08:48,856][52670] DAMAGECOUNT value on done: 3913.0 [2024-08-05 22:08:48,857][52670] Sum rewards: 1.414, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.980', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'ARMOR': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.186', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon2': '1.522', 'weapon3': '1.556', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:49,573][52662] DAMAGECOUNT value on done: 4787.0 [2024-08-05 22:08:49,574][52662] Sum rewards: 4.136, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.744', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'ARMOR': '0.511', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '1.876', 'weapon3': '1.946', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:50,991][52666] DAMAGECOUNT value on done: 3802.0 [2024-08-05 22:08:50,993][52666] Sum rewards: 8.650, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.018', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'ARMOR': '0.925', 'weapon2': '1.660', 'weapon3': '1.722', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '7.000'} [2024-08-05 22:08:51,143][52670] DAMAGECOUNT value on done: 3424.0 [2024-08-05 22:08:51,144][52670] Sum rewards: 1.936, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.645', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.280', 'WEAPON3': '0.750', 'ARMOR': '0.843', 'weapon2': '1.016', 'DAMAGECOUNT': '1.101', 'weapon3': '1.966', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:51,375][52794] DAMAGECOUNT value on done: 4478.0 [2024-08-05 22:08:51,376][52794] Sum rewards: -0.740, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.292', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.300', 'ARMOR': '0.462', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.023', 'weapon3': '1.722', 'weapon2': '1.792'} [2024-08-05 22:08:52,600][52662] DAMAGECOUNT value on done: 4064.0 [2024-08-05 22:08:52,601][52662] Sum rewards: 1.271, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.586', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.090', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'HITCOUNT': '0.310', 'ARMOR': '0.536', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.044', 'weapon2': '1.826', 'weapon3': '1.890', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17885.9, 300 sec: 17328.2). Total num frames: 44638208. Throughput: 0: 4476.2. Samples: 11164540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:08:52,795][52567] Avg episode reward: [(0, '2.546')] [2024-08-05 22:08:53,382][52650] Updated weights for policy 0, policy_version 5451 (0.0012) [2024-08-05 22:08:53,701][52666] DAMAGECOUNT value on done: 4074.0 [2024-08-05 22:08:53,703][52666] Sum rewards: 2.690, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.745', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.101', 'ARMOR': '0.475', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.558', 'weapon3': '1.856', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:53,934][52670] DAMAGECOUNT value on done: 3399.0 [2024-08-05 22:08:55,430][52662] DAMAGECOUNT value on done: 3909.0 [2024-08-05 22:08:55,431][52662] Sum rewards: 2.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.013', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.380', 'ARMOR': '0.448', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.185', 'weapon2': '1.390', 'weapon3': '2.228', 'FRAGCOUNT': '5.000'} [2024-08-05 22:08:56,379][52666] DAMAGECOUNT value on done: 3760.0 [2024-08-05 22:08:56,387][52666] Sum rewards: 1.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.924', 'AMMO2': '0.005', 'AMMO5': '0.013', 'weapon5': '0.024', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.216', 'ARMOR': '0.444', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.378', 'weapon3': '1.428', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '2.000'} [2024-08-05 22:08:56,592][52670] DAMAGECOUNT value on done: 3354.0 [2024-08-05 22:08:56,594][52670] Sum rewards: 0.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.628', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.370', 'ARMOR': '0.506', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.134', 'weapon2': '1.296', 'weapon3': '1.908', 'FRAGCOUNT': '3.000'} [2024-08-05 22:08:57,804][52567] Fps is (10 sec: 17186.4, 60 sec: 17883.0, 300 sec: 17355.4). Total num frames: 44728320. Throughput: 0: 4473.2. Samples: 11191320. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:08:57,804][52567] Avg episode reward: [(0, '2.483')] [2024-08-05 22:08:57,908][52650] Updated weights for policy 0, policy_version 5461 (0.0029) [2024-08-05 22:08:59,220][52666] DAMAGECOUNT value on done: 3964.0 [2024-08-05 22:08:59,222][52666] Sum rewards: 4.646, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.268', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'HITCOUNT': '0.640', 'WEAPON3': '0.900', 'ARMOR': '0.981', 'weapon2': '1.536', 'weapon3': '2.084', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '6.000'} [2024-08-05 22:08:59,430][52670] DAMAGECOUNT value on done: 2980.0 [2024-08-05 22:08:59,432][52670] Sum rewards: 3.403, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.515', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'weapon5': '0.030', 'AMMO3': '0.093', 'WEAPON5': '0.150', 'HITCOUNT': '0.320', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.128', 'weapon3': '1.614', 'FRAGCOUNT': '2.000', 'weapon2': '2.030'} [2024-08-05 22:09:01,993][52666] DAMAGECOUNT value on done: 3692.0 [2024-08-05 22:09:02,001][52666] Sum rewards: -0.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.176', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'ARMOR': '0.499', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.323', 'FRAGCOUNT': '1.500', 'weapon3': '1.654', 'weapon2': '1.746'} [2024-08-05 22:09:02,207][52650] Updated weights for policy 0, policy_version 5471 (0.0018) [2024-08-05 22:09:02,274][52670] DAMAGECOUNT value on done: 3740.0 [2024-08-05 22:09:02,275][52670] Sum rewards: 1.286, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.643', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.360', 'WEAPON3': '0.850', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.320', 'weapon3': '1.782', 'weapon2': '1.822', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17355.9). Total num frames: 44818432. Throughput: 0: 4474.7. Samples: 11204750. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:09:02,794][52567] Avg episode reward: [(0, '2.448')] [2024-08-05 22:09:05,225][52666] DAMAGECOUNT value on done: 4302.0 [2024-08-05 22:09:05,225][52666] Sum rewards: 8.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.334', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.144', 'WEAPON3': '0.900', 'HITCOUNT': '0.940', 'ARMOR': '0.983', 'weapon2': '1.326', 'weapon3': '2.216', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'} [2024-08-05 22:09:05,549][52670] DAMAGECOUNT value on done: 3658.0 [2024-08-05 22:09:05,550][52670] Sum rewards: -0.057, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.054', 'AMMO3': '0.144', 'HITCOUNT': '0.220', 'HEALTH': '0.470', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.738', 'weapon2': '1.354', 'FRAGCOUNT': '2.000', 'weapon3': '2.440'} [2024-08-05 22:09:06,286][52669] DAMAGECOUNT value on done: 3200.0 [2024-08-05 22:09:07,280][52650] Updated weights for policy 0, policy_version 5481 (0.0020) [2024-08-05 22:09:07,794][52567] Fps is (10 sec: 18040.1, 60 sec: 17885.9, 300 sec: 17383.7). Total num frames: 44908544. Throughput: 0: 4462.4. Samples: 11231220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:09:07,794][52567] Avg episode reward: [(0, '2.395')] [2024-08-05 22:09:08,017][52666] DAMAGECOUNT value on done: 4465.0 [2024-08-05 22:09:08,018][52666] Sum rewards: 2.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.644', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.165', 'ARMOR': '0.444', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.368', 'DAMAGECOUNT': '2.187', 'weapon3': '2.472', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:08,296][52670] DAMAGECOUNT value on done: 3510.0 [2024-08-05 22:09:08,298][52670] Sum rewards: 2.340, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.878', 'AMMO5': '0.003', 'weapon7': '0.008', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.250', 'weapon4': '0.276', 'ARMOR': '0.532', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.996', 'weapon2': '1.160', 'weapon3': '1.546', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:08,944][52669] DAMAGECOUNT value on done: 3611.0 [2024-08-05 22:09:08,945][52669] Sum rewards: 6.744, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.611', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.182', 'ARMOR': '0.444', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'DAMAGECOUNT': '1.674', 'weapon3': '1.678', 'weapon2': '1.790', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:10,989][52666] DAMAGECOUNT value on done: 3316.0 [2024-08-05 22:09:10,989][52666] Sum rewards: 2.179, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.090', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.220', 'ARMOR': '0.560', 'DAMAGECOUNT': '0.744', 'WEAPON3': '0.750', 'weapon2': '1.424', 'weapon3': '1.964', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:11,290][52670] DAMAGECOUNT value on done: 2465.0 [2024-08-05 22:09:11,291][52670] Sum rewards: 1.434, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.150', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.032', 'AMMO3': '0.056', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.478', 'weapon3': '0.942', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '1.000', 'weapon2': '1.056'} [2024-08-05 22:09:11,424][52669] DAMAGECOUNT value on done: 3472.0 [2024-08-05 22:09:11,425][52669] Sum rewards: 2.828, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon4': '0.042', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.350', 'ARMOR': '0.535', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.245', 'weapon3': '1.436', 'weapon2': '1.750', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:11,744][52650] Updated weights for policy 0, policy_version 5491 (0.0018) [2024-08-05 22:09:11,940][52665] DAMAGECOUNT value on done: 4402.0 [2024-08-05 22:09:11,940][52665] Sum rewards: -2.324, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.918', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'HITCOUNT': '0.320', 'ARMOR': '0.440', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.095', 'weapon2': '1.502', 'weapon3': '2.108'} [2024-08-05 22:09:12,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17383.7). Total num frames: 44998656. Throughput: 0: 4455.1. Samples: 11257690. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:09:12,795][52567] Avg episode reward: [(0, '2.312')] [2024-08-05 22:09:13,729][52666] DAMAGECOUNT value on done: 3572.0 [2024-08-05 22:09:13,729][52666] Sum rewards: -0.049, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.848', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'ARMOR': '0.051', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'weapon2': '0.896', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.140', 'weapon3': '1.688'} [2024-08-05 22:09:14,021][52670] DAMAGECOUNT value on done: 3204.0 [2024-08-05 22:09:14,022][52670] Sum rewards: -0.007, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.110', 'HITCOUNT': '0.390', 'HEALTH': '0.402', 'ARMOR': '0.415', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.104', 'weapon2': '1.702', 'FRAGCOUNT': '2.000', 'weapon3': '2.164'} [2024-08-05 22:09:14,193][52669] DAMAGECOUNT value on done: 5599.0 [2024-08-05 22:09:14,193][52669] Sum rewards: 0.736, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.170', 'weapon3': '1.202', 'ARMOR': '1.248', 'weapon2': '1.580', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:14,501][52665] DAMAGECOUNT value on done: 3745.0 [2024-08-05 22:09:14,502][52665] Sum rewards: 2.355, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.950', 'weapon4': '0.002', 'weapon5': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'DAMAGECOUNT': '0.495', 'WEAPON3': '0.550', 'weapon2': '1.076', 'weapon3': '1.350', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:16,099][52650] Updated weights for policy 0, policy_version 5501 (0.0011) [2024-08-05 22:09:16,160][52666] DAMAGECOUNT value on done: 3800.0 [2024-08-05 22:09:16,161][52666] Sum rewards: 1.460, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.064', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'ARMOR': '0.934', 'DAMAGECOUNT': '1.290', 'weapon3': '1.722', 'weapon2': '1.798', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:16,304][52670] DAMAGECOUNT value on done: 4038.0 [2024-08-05 22:09:16,306][52670] Sum rewards: 4.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.042', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.104', 'ARMOR': '0.485', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.600', 'DAMAGECOUNT': '2.037', 'weapon3': '2.058', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:17,106][52665] DAMAGECOUNT value on done: 4561.0 [2024-08-05 22:09:17,106][52665] Sum rewards: 4.008, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.330', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.915', 'ARMOR': '0.975', 'weapon3': '1.408', 'weapon2': '1.424', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:17,111][52669] DAMAGECOUNT value on done: 3823.0 [2024-08-05 22:09:17,111][52669] Sum rewards: 0.560, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.422', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon5': '0.214', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'ARMOR': '0.860', 'weapon2': '1.366', 'DAMAGECOUNT': '1.395', 'weapon3': '2.138', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17886.0, 300 sec: 17411.5). Total num frames: 45088768. Throughput: 0: 4457.6. Samples: 11271080. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:09:17,795][52567] Avg episode reward: [(0, '2.376')] [2024-08-05 22:09:18,872][52666] DAMAGECOUNT value on done: 3355.0 [2024-08-05 22:09:18,874][52666] Sum rewards: -1.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.775', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.113', 'HITCOUNT': '0.250', 'ARMOR': '0.420', 'DAMAGECOUNT': '0.732', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.370', 'weapon3': '1.684'} [2024-08-05 22:09:19,119][52670] DAMAGECOUNT value on done: 4459.0 [2024-08-05 22:09:19,121][52670] Sum rewards: 7.669, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.346', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.860', 'weapon3': '1.362', 'weapon2': '2.160', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:19,497][52669] DAMAGECOUNT value on done: 4277.0 [2024-08-05 22:09:19,498][52669] Sum rewards: 1.115, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.032', 'ARMOR': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'weapon2': '1.122', 'DAMAGECOUNT': '1.329', 'weapon3': '1.398', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:19,899][52665] DAMAGECOUNT value on done: 3068.0 [2024-08-05 22:09:19,901][52665] Sum rewards: 3.083, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.031', 'AMMO3': '0.072', 'ARMOR': '0.128', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'HITCOUNT': '0.260', 'HEALTH': '0.336', 'WEAPON3': '0.400', 'weapon4': '0.518', 'DAMAGECOUNT': '0.816', 'weapon2': '0.834', 'weapon3': '1.132', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:20,801][52650] Updated weights for policy 0, policy_version 5511 (0.0010) [2024-08-05 22:09:21,824][52666] DAMAGECOUNT value on done: 3946.0 [2024-08-05 22:09:21,826][52666] Sum rewards: 4.835, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.715', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '1.294', 'weapon2': '1.396', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:21,908][52663] DAMAGECOUNT value on done: 4281.0 [2024-08-05 22:09:21,909][52663] Sum rewards: 6.736, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'ARMOR': '0.511', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'weapon2': '1.472', 'weapon3': '1.988', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:21,966][52614] Signal inference workers to stop experience collection... (1050 times) [2024-08-05 22:09:21,966][52614] Signal inference workers to resume experience collection... (1050 times) [2024-08-05 22:09:22,022][52670] DAMAGECOUNT value on done: 4058.0 [2024-08-05 22:09:22,022][52670] Sum rewards: 5.947, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.333', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.140', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'ARMOR': '0.901', 'weapon2': '1.620', 'DAMAGECOUNT': '2.229', 'weapon3': '2.232', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:22,048][52650] InferenceWorker_p0-w0: stopping experience collection (1050 times) [2024-08-05 22:09:22,055][52650] InferenceWorker_p0-w0: resuming experience collection (1050 times) [2024-08-05 22:09:22,362][52665] DAMAGECOUNT value on done: 4120.0 [2024-08-05 22:09:22,363][52665] Sum rewards: 2.540, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.686', 'AMMO2': '0.014', 'weapon4': '0.014', 'ARMOR': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.214', 'DAMAGECOUNT': '1.401', 'weapon3': '1.820', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:22,475][52669] DAMAGECOUNT value on done: 4614.0 [2024-08-05 22:09:22,475][52669] Sum rewards: 5.262, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.070', 'ARMOR': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.108', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon2': '1.660', 'DAMAGECOUNT': '1.683', 'weapon3': '1.686', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:22,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17885.9, 300 sec: 17411.5). Total num frames: 45178880. Throughput: 0: 4466.2. Samples: 11298270. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:09:22,794][52567] Avg episode reward: [(0, '2.429')] [2024-08-05 22:09:24,661][52666] DAMAGECOUNT value on done: 3282.0 [2024-08-05 22:09:24,661][52666] Sum rewards: 0.712, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.498', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.132', 'AMMO3': '0.140', 'HITCOUNT': '0.490', 'WEAPON3': '0.900', 'ARMOR': '0.907', 'weapon3': '1.662', 'weapon2': '1.676', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:24,706][52647] DAMAGECOUNT value on done: 3597.0 [2024-08-05 22:09:24,706][52647] Sum rewards: 5.449, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.467', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.126', 'weapon4': '0.212', 'ARMOR': '0.412', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.264', 'weapon3': '1.882', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:24,808][52663] DAMAGECOUNT value on done: 4190.0 [2024-08-05 22:09:24,808][52663] Sum rewards: 2.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.310', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'ARMOR': '0.452', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.632', 'weapon2': '1.782', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:24,808][52670] DAMAGECOUNT value on done: 4524.0 [2024-08-05 22:09:24,809][52670] Sum rewards: 5.415, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.200', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.172', 'HITCOUNT': '0.630', 'WEAPON3': '0.850', 'ARMOR': '0.948', 'weapon3': '1.336', 'weapon2': '1.572', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:25,367][52650] Updated weights for policy 0, policy_version 5521 (0.0010) [2024-08-05 22:09:25,378][52669] DAMAGECOUNT value on done: 3952.0 [2024-08-05 22:09:25,379][52669] Sum rewards: 2.076, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.118', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.232', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.077', 'weapon3': '1.418', 'weapon2': '1.466', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:25,407][52665] DAMAGECOUNT value on done: 3616.0 [2024-08-05 22:09:25,407][52665] Sum rewards: 2.936, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.353', 'AMMO2': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'AMMO3': '0.070', 'weapon5': '0.082', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.035', 'weapon3': '1.518', 'weapon2': '2.178', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:27,398][52647] DAMAGECOUNT value on done: 4378.0 [2024-08-05 22:09:27,398][52647] Sum rewards: 5.836, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.963', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.300', 'weapon4': '0.420', 'ARMOR': '0.480', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'weapon3': '1.582', 'weapon2': '1.612', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:27,506][52666] DAMAGECOUNT value on done: 4008.0 [2024-08-05 22:09:27,507][52666] Sum rewards: 1.156, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.916', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'HITCOUNT': '0.480', 'WEAPON3': '0.850', 'ARMOR': '0.931', 'weapon2': '1.598', 'weapon3': '1.660', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:27,600][52670] DAMAGECOUNT value on done: 4111.0 [2024-08-05 22:09:27,601][52670] Sum rewards: 5.799, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.780', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.167', 'weapon4': '0.198', 'HITCOUNT': '0.680', 'ARMOR': '0.896', 'WEAPON3': '1.000', 'weapon2': '1.290', 'weapon3': '2.340', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:27,748][52663] DAMAGECOUNT value on done: 3352.0 [2024-08-05 22:09:27,748][52663] Sum rewards: 1.437, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.502', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.083', 'HITCOUNT': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'DAMAGECOUNT': '0.510', 'WEAPON3': '0.750', 'ARMOR': '0.859', 'weapon2': '1.136', 'weapon3': '2.584', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17885.9, 300 sec: 17439.3). Total num frames: 45268992. Throughput: 0: 4460.9. Samples: 11324760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:09:27,794][52567] Avg episode reward: [(0, '2.565')] [2024-08-05 22:09:28,379][52669] DAMAGECOUNT value on done: 3706.0 [2024-08-05 22:09:28,379][52669] Sum rewards: 2.068, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.992', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'AMMO3': '0.111', 'HITCOUNT': '0.270', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.915', 'ARMOR': '0.925', 'weapon2': '1.612', 'weapon3': '2.170', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:28,604][52665] DAMAGECOUNT value on done: 3851.0 [2024-08-05 22:09:28,605][52665] Sum rewards: 0.898, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.702', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.140', 'HITCOUNT': '0.260', 'ARMOR': '0.493', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.792', 'weapon2': '1.544', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:30,134][52650] Updated weights for policy 0, policy_version 5531 (0.0017) [2024-08-05 22:09:30,469][52647] DAMAGECOUNT value on done: 4913.0 [2024-08-05 22:09:30,470][52647] Sum rewards: 2.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.812', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'weapon4': '0.126', 'AMMO3': '0.141', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.580', 'ARMOR': '1.799', 'weapon3': '2.088', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:30,595][52663] DAMAGECOUNT value on done: 4894.0 [2024-08-05 22:09:30,596][52663] Sum rewards: 4.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.944', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.130', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'ARMOR': '0.898', 'weapon3': '1.454', 'DAMAGECOUNT': '1.734', 'weapon2': '2.170', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:30,773][52666] DAMAGECOUNT value on done: 2761.0 [2024-08-05 22:09:30,773][52666] Sum rewards: 0.389, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.746', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.073', 'AMMO3': '0.085', 'HITCOUNT': '0.120', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.354', 'WEAPON3': '0.650', 'ARMOR': '0.864', 'weapon3': '1.742', 'weapon2': '1.778', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:30,861][52670] DAMAGECOUNT value on done: 2553.0 [2024-08-05 22:09:30,985][52669] DAMAGECOUNT value on done: 3682.0 [2024-08-05 22:09:30,985][52669] Sum rewards: 1.588, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.099', 'HITCOUNT': '0.310', 'WEAPON3': '0.600', 'weapon3': '0.952', 'DAMAGECOUNT': '1.302', 'ARMOR': '1.367', 'weapon2': '1.530', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:31,955][52665] DAMAGECOUNT value on done: 3273.0 [2024-08-05 22:09:31,955][52665] Sum rewards: 1.482, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.351', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.055', 'weapon5': '0.064', 'WEAPON4': '0.100', 'HITCOUNT': '0.120', 'weapon4': '0.124', 'WEAPON5': '0.200', 'DAMAGECOUNT': '0.483', 'WEAPON3': '0.500', 'ARMOR': '0.558', 'FRAGCOUNT': '1.000', 'weapon3': '1.106', 'weapon2': '1.518'} [2024-08-05 22:09:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17411.5). Total num frames: 45350912. Throughput: 0: 4446.7. Samples: 11337690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:09:32,794][52567] Avg episode reward: [(0, '2.476')] [2024-08-05 22:09:33,772][52647] DAMAGECOUNT value on done: 3126.0 [2024-08-05 22:09:33,775][52647] Sum rewards: 2.924, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.390', 'AMMO2': '0.014', 'AMMO3': '0.066', 'AMMO4': '0.071', 'weapon4': '0.296', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'ARMOR': '0.564', 'DAMAGECOUNT': '1.134', 'weapon3': '1.322', 'weapon2': '1.686', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:34,241][52663] DAMAGECOUNT value on done: 4601.0 [2024-08-05 22:09:34,242][52663] Sum rewards: 2.912, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.235', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.094', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'ARMOR': '0.958', 'weapon2': '1.166', 'DAMAGECOUNT': '1.530', 'weapon3': '1.530', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:34,304][52666] DAMAGECOUNT value on done: 3673.0 [2024-08-05 22:09:34,304][52666] Sum rewards: 5.377, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.095', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.026', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon2': '1.310', 'weapon3': '1.346', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:34,443][52670] DAMAGECOUNT value on done: 3624.0 [2024-08-05 22:09:34,446][52670] Sum rewards: 3.147, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.623', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.210', 'WEAPON3': '0.300', 'ARMOR': '0.476', 'DAMAGECOUNT': '0.690', 'weapon3': '0.926', 'weapon2': '1.670', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:34,677][52665] DAMAGECOUNT value on done: 2429.0 [2024-08-05 22:09:34,678][52665] Sum rewards: 2.838, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.458', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.092', 'HITCOUNT': '0.160', 'weapon5': '0.192', 'DAMAGECOUNT': '0.558', 'WEAPON3': '0.600', 'ARMOR': '1.380', 'weapon3': '1.384', 'FRAGCOUNT': '2.000', 'weapon2': '2.064'} [2024-08-05 22:09:34,837][52669] DAMAGECOUNT value on done: 3722.0 [2024-08-05 22:09:34,837][52669] Sum rewards: 2.880, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.897', 'DAMAGECOUNT': '0.900', 'weapon3': '1.498', 'weapon2': '1.542', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:35,261][52667] DAMAGECOUNT value on done: 4747.0 [2024-08-05 22:09:35,261][52667] Sum rewards: 6.140, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.726', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.084', 'ARMOR': '0.400', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.346', 'weapon3': '1.426', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:35,317][52650] Updated weights for policy 0, policy_version 5541 (0.0029) [2024-08-05 22:09:36,695][52647] DAMAGECOUNT value on done: 3671.0 [2024-08-05 22:09:36,695][52647] Sum rewards: 4.572, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.726', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'ARMOR': '0.478', 'HITCOUNT': '0.730', 'WEAPON3': '0.950', 'weapon2': '1.376', 'weapon3': '2.204', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:37,175][52666] DAMAGECOUNT value on done: 5223.0 [2024-08-05 22:09:37,175][52666] Sum rewards: 6.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.375', 'AMMO4': '-0.078', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'WEAPON1': '0.030', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.284', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'ARMOR': '0.982', 'weapon2': '1.336', 'weapon3': '1.908', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:37,230][52663] DAMAGECOUNT value on done: 4046.0 [2024-08-05 22:09:37,234][52663] Sum rewards: 8.240, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.924', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'ARMOR': '0.476', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.458', 'weapon2': '1.618', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:37,460][52670] DAMAGECOUNT value on done: 4593.0 [2024-08-05 22:09:37,464][52670] Sum rewards: 1.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.100', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.624', 'weapon2': '1.672', 'DAMAGECOUNT': '2.004'} [2024-08-05 22:09:37,681][52669] DAMAGECOUNT value on done: 4533.0 [2024-08-05 22:09:37,681][52669] Sum rewards: 5.003, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.681', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.084', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '1.302', 'ARMOR': '1.330', 'weapon3': '1.644', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:37,724][52665] DAMAGECOUNT value on done: 4934.0 [2024-08-05 22:09:37,755][52665] Sum rewards: 4.065, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.093', 'weapon5': '0.116', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.816', 'weapon2': '1.580', 'weapon3': '2.100', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:37,794][52567] Fps is (10 sec: 15564.2, 60 sec: 17476.2, 300 sec: 17383.9). Total num frames: 45424640. Throughput: 0: 4381.7. Samples: 11361720. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:09:37,795][52567] Avg episode reward: [(0, '2.743')] [2024-08-05 22:09:38,015][52667] DAMAGECOUNT value on done: 3982.0 [2024-08-05 22:09:38,015][52667] Sum rewards: 1.352, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.962', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'ARMOR': '0.120', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.604', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.000', 'weapon3': '2.172'} [2024-08-05 22:09:38,999][52647] DAMAGECOUNT value on done: 4393.0 [2024-08-05 22:09:39,000][52647] Sum rewards: 3.198, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.288', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.139', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'ARMOR': '1.285', 'weapon2': '1.646', 'weapon3': '1.978', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:40,120][52663] DAMAGECOUNT value on done: 5282.0 [2024-08-05 22:09:40,123][52663] Sum rewards: 6.393, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO2': '0.013', 'weapon4': '0.058', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'ARMOR': '0.469', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.436', 'weapon3': '2.014', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:40,169][52650] Updated weights for policy 0, policy_version 5551 (0.0023) [2024-08-05 22:09:40,346][52649] DAMAGECOUNT value on done: 4093.0 [2024-08-05 22:09:40,347][52649] Sum rewards: 5.030, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.435', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.560', 'ARMOR': '0.910', 'WEAPON3': '0.950', 'weapon3': '1.690', 'weapon2': '2.154', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:40,704][52669] DAMAGECOUNT value on done: 3964.0 [2024-08-05 22:09:40,704][52669] Sum rewards: 1.882, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.659', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.103', 'HITCOUNT': '0.480', 'ARMOR': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.500', 'DAMAGECOUNT': '1.605', 'weapon3': '2.156', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:40,854][52665] DAMAGECOUNT value on done: 4919.0 [2024-08-05 22:09:40,855][52665] Sum rewards: 0.027, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.870', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.208', 'ARMOR': '0.456', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'weapon2': '1.534', 'DAMAGECOUNT': '1.692', 'weapon3': '1.950', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:40,899][52666] DAMAGECOUNT value on done: 4340.0 [2024-08-05 22:09:40,899][52666] Sum rewards: 5.579, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.982', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.090', 'HITCOUNT': '0.580', 'weapon2': '0.646', 'WEAPON3': '0.650', 'ARMOR': '0.839', 'weapon3': '1.536', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:41,109][52670] DAMAGECOUNT value on done: 3523.0 [2024-08-05 22:09:41,112][52670] Sum rewards: 7.952, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.857', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'weapon5': '0.062', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'ARMOR': '1.308', 'DAMAGECOUNT': '1.320', 'weapon3': '1.426', 'weapon2': '1.776', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:41,365][52647] DAMAGECOUNT value on done: 3315.0 [2024-08-05 22:09:41,366][52647] Sum rewards: 3.745, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.439', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.164', 'ARMOR': '0.436', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.236', 'weapon2': '1.348', 'weapon3': '1.684', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:41,722][52667] DAMAGECOUNT value on done: 4280.0 [2024-08-05 22:09:41,724][52667] Sum rewards: -1.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.416', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.044', 'weapon4': '0.054', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.500', 'ARMOR': '0.917', 'WEAPON3': '1.100', 'weapon2': '1.378', 'DAMAGECOUNT': '1.563', 'weapon3': '2.348', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 45522944. Throughput: 0: 4351.2. Samples: 11387080. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 22:09:42,794][52567] Avg episode reward: [(0, '2.762')] [2024-08-05 22:09:43,295][52663] DAMAGECOUNT value on done: 3473.0 [2024-08-05 22:09:43,297][52663] Sum rewards: 1.456, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.823', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'ARMOR': '0.509', 'HITCOUNT': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.624', 'DAMAGECOUNT': '1.707', 'weapon3': '1.996', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:43,472][52649] DAMAGECOUNT value on done: 3482.0 [2024-08-05 22:09:43,474][52649] Sum rewards: 4.109, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.129', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.022', 'ARMOR': '0.044', 'AMMO4': '0.047', 'AMMO3': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.230', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.822', 'weapon5': '0.942', 'weapon3': '1.004', 'weapon2': '1.134', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:43,679][52669] DAMAGECOUNT value on done: 4073.0 [2024-08-05 22:09:43,680][52669] Sum rewards: 1.976, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.742', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.230', 'HITCOUNT': '0.450', 'ARMOR': '0.902', 'WEAPON3': '0.950', 'weapon2': '1.220', 'DAMAGECOUNT': '1.383', 'weapon3': '1.908', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:44,006][52665] DAMAGECOUNT value on done: 4553.0 [2024-08-05 22:09:44,007][52665] Sum rewards: 0.530, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.531', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.038', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'ARMOR': '0.424', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.688', 'DAMAGECOUNT': '1.731', 'weapon3': '1.764', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:44,076][52647] DAMAGECOUNT value on done: 3699.0 [2024-08-05 22:09:44,076][52647] Sum rewards: 3.864, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.444', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon4': '0.058', 'weapon5': '0.068', 'AMMO3': '0.123', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '1.356', 'DAMAGECOUNT': '2.070', 'weapon3': '2.138', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:44,742][52670] DAMAGECOUNT value on done: 3905.0 [2024-08-05 22:09:44,742][52670] Sum rewards: 2.048, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.676', 'weapon4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'ARMOR': '0.440', 'HITCOUNT': '0.530', 'WEAPON3': '0.950', 'weapon2': '1.502', 'DAMAGECOUNT': '1.872', 'weapon3': '1.946', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:45,096][52667] DAMAGECOUNT value on done: 3735.0 [2024-08-05 22:09:45,099][52667] Sum rewards: 2.668, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.162', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'HITCOUNT': '0.370', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.185', 'weapon2': '1.282', 'weapon3': '1.632', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:45,099][52650] Updated weights for policy 0, policy_version 5561 (0.0029) [2024-08-05 22:09:45,863][52663] DAMAGECOUNT value on done: 3349.0 [2024-08-05 22:09:45,863][52663] Sum rewards: -1.544, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'weapon4': '0.130', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.182', 'weapon2': '1.690', 'weapon3': '1.752', 'ARMOR': '1.768', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:46,451][52649] DAMAGECOUNT value on done: 3313.0 [2024-08-05 22:09:46,453][52649] Sum rewards: 0.953, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon4': '0.124', 'WEAPON4': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.116', 'weapon3': '1.478', 'FRAGCOUNT': '2.000', 'weapon2': '2.092'} [2024-08-05 22:09:46,455][52669] DAMAGECOUNT value on done: 4103.0 [2024-08-05 22:09:46,457][52669] Sum rewards: 0.574, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.868', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.380', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'weapon2': '1.042', 'DAMAGECOUNT': '1.275', 'weapon3': '1.672', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:46,776][52665] DAMAGECOUNT value on done: 4280.0 [2024-08-05 22:09:46,776][52665] Sum rewards: 3.145, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.302', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.113', 'weapon4': '0.138', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.446', 'weapon3': '1.482', 'weapon2': '1.906', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:46,841][52647] DAMAGECOUNT value on done: 4227.0 [2024-08-05 22:09:46,844][52647] Sum rewards: 3.029, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.596', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.079', 'weapon4': '0.236', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'ARMOR': '0.846', 'weapon2': '0.900', 'DAMAGECOUNT': '1.221', 'weapon3': '1.536', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:47,795][52567] Fps is (10 sec: 17201.7, 60 sec: 17339.4, 300 sec: 17383.6). Total num frames: 45596672. Throughput: 0: 4333.0. Samples: 11399740. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:09:47,804][52567] Avg episode reward: [(0, '2.704')] [2024-08-05 22:09:48,486][52667] DAMAGECOUNT value on done: 4765.0 [2024-08-05 22:09:48,487][52667] Sum rewards: 5.846, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.389', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.076', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.376', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.182', 'weapon3': '1.486', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:48,667][52663] DAMAGECOUNT value on done: 4552.0 [2024-08-05 22:09:48,670][52663] Sum rewards: 2.580, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.187', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.013', 'weapon5': '0.066', 'weapon4': '0.066', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'ARMOR': '0.412', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.346', 'weapon3': '1.368', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:49,166][52669] DAMAGECOUNT value on done: 4255.0 [2024-08-05 22:09:49,166][52669] Sum rewards: 0.819, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.119', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.112', 'HITCOUNT': '0.510', 'ARMOR': '0.546', 'WEAPON3': '0.750', 'weapon2': '1.652', 'weapon3': '1.772', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:49,602][52649] DAMAGECOUNT value on done: 4419.0 [2024-08-05 22:09:49,605][52649] Sum rewards: 3.197, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.014', 'AMMO2': '0.011', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.110', 'WEAPON3': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.548', 'weapon3': '0.750', 'DAMAGECOUNT': '0.990', 'weapon2': '1.100', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:50,073][52650] Updated weights for policy 0, policy_version 5571 (0.0055) [2024-08-05 22:09:50,112][52647] DAMAGECOUNT value on done: 4347.0 [2024-08-05 22:09:50,114][52647] Sum rewards: 4.840, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.064', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.119', 'weapon4': '0.150', 'ARMOR': '0.452', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.542', 'weapon3': '1.572', 'weapon2': '1.700', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:50,176][52665] DAMAGECOUNT value on done: 4823.0 [2024-08-05 22:09:50,492][52658] DAMAGECOUNT value on done: 3441.0 [2024-08-05 22:09:50,496][52658] Sum rewards: 7.549, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.600', 'weapon3': '1.768', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:51,245][52663] DAMAGECOUNT value on done: 4210.0 [2024-08-05 22:09:51,246][52663] Sum rewards: 0.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.519', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'HITCOUNT': '0.690', 'WEAPON3': '1.050', 'ARMOR': '1.369', 'weapon2': '1.568', 'weapon3': '2.244', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:51,626][52667] DAMAGECOUNT value on done: 4757.0 [2024-08-05 22:09:51,628][52667] Sum rewards: 2.761, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.612', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.126', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'ARMOR': '0.920', 'weapon3': '1.692', 'FRAGCOUNT': '2.000', 'weapon2': '2.014', 'DAMAGECOUNT': '2.607'} [2024-08-05 22:09:51,832][52669] DAMAGECOUNT value on done: 4110.0 [2024-08-05 22:09:51,833][52669] Sum rewards: 5.514, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon4': '0.112', 'weapon5': '0.144', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'ARMOR': '0.985', 'weapon3': '1.594', 'weapon2': '1.682', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:51,915][52803] DAMAGECOUNT value on done: 4187.0 [2024-08-05 22:09:51,915][52803] Sum rewards: 7.149, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.114', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO3': '0.076', 'HITCOUNT': '0.560', 'ARMOR': '0.592', 'WEAPON3': '0.600', 'weapon3': '1.366', 'weapon2': '1.714', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:52,577][52649] DAMAGECOUNT value on done: 2648.0 [2024-08-05 22:09:52,578][52649] Sum rewards: 1.905, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.101', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.011', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.380', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.290', 'weapon3': '1.720', 'weapon2': '2.072', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:52,800][52567] Fps is (10 sec: 16374.5, 60 sec: 17474.6, 300 sec: 17411.1). Total num frames: 45686784. Throughput: 0: 4314.8. Samples: 11425410. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-05 22:09:52,800][52567] Avg episode reward: [(0, '2.850')] [2024-08-05 22:09:53,158][52665] DAMAGECOUNT value on done: 3835.0 [2024-08-05 22:09:53,159][52665] Sum rewards: 1.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.114', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.061', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'ARMOR': '0.412', 'DAMAGECOUNT': '1.152', 'weapon3': '1.256', 'weapon2': '1.780', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:53,166][52647] DAMAGECOUNT value on done: 4463.0 [2024-08-05 22:09:53,169][52647] Sum rewards: 0.888, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.824', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.114', 'WEAPON5': '0.150', 'HITCOUNT': '0.500', 'ARMOR': '0.508', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.442', 'DAMAGECOUNT': '1.521', 'weapon3': '1.702'} [2024-08-05 22:09:53,320][52658] DAMAGECOUNT value on done: 3821.0 [2024-08-05 22:09:53,320][52658] Sum rewards: -2.817, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.190', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.100', 'AMMO3': '0.111', 'weapon4': '0.182', 'WEAPON4': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.356', 'weapon3': '1.632', 'weapon2': '1.810'} [2024-08-05 22:09:53,724][52663] DAMAGECOUNT value on done: 3916.0 [2024-08-05 22:09:53,725][52663] Sum rewards: 2.655, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.122', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'AMMO3': '0.131', 'weapon4': '0.182', 'WEAPON4': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.850', 'ARMOR': '1.359', 'weapon2': '1.502', 'DAMAGECOUNT': '1.860', 'weapon3': '2.056', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:53,775][52811] DAMAGECOUNT value on done: 4081.0 [2024-08-05 22:09:53,781][52811] Sum rewards: 6.576, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.134', 'AMMO3': '0.145', 'HITCOUNT': '0.560', 'ARMOR': '0.930', 'WEAPON3': '0.950', 'weapon2': '1.312', 'weapon3': '1.942', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '8.000'} [2024-08-05 22:09:54,369][52667] DAMAGECOUNT value on done: 4397.0 [2024-08-05 22:09:54,369][52667] Sum rewards: -0.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.744', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'ARMOR': '0.906', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.377', 'weapon3': '1.572', 'weapon2': '2.208'} [2024-08-05 22:09:54,402][52650] Updated weights for policy 0, policy_version 5581 (0.0015) [2024-08-05 22:09:54,412][52669] DAMAGECOUNT value on done: 4629.0 [2024-08-05 22:09:54,416][52669] Sum rewards: 3.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.041', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'ARMOR': '0.035', 'AMMO3': '0.114', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.260', 'DAMAGECOUNT': '2.004', 'weapon3': '2.254', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:55,123][52803] DAMAGECOUNT value on done: 4478.0 [2024-08-05 22:09:55,126][52803] Sum rewards: 5.384, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.131', 'ARMOR': '0.460', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon2': '1.688', 'DAMAGECOUNT': '1.848', 'weapon3': '1.860', 'FRAGCOUNT': '7.000'} [2024-08-05 22:09:55,990][52649] DAMAGECOUNT value on done: 3956.0 [2024-08-05 22:09:55,991][52649] Sum rewards: 3.407, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.300', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'HITCOUNT': '0.350', 'ARMOR': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.118', 'DAMAGECOUNT': '1.380', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:56,183][52663] DAMAGECOUNT value on done: 4344.0 [2024-08-05 22:09:56,183][52663] Sum rewards: 3.496, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.918', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.182', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'ARMOR': '0.960', 'weapon3': '1.340', 'weapon2': '1.580', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:56,367][52647] DAMAGECOUNT value on done: 3207.0 [2024-08-05 22:09:56,370][52647] Sum rewards: 2.908, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.400', 'weapon4': '0.002', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.759', 'weapon3': '1.366', 'weapon2': '1.658', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:56,423][52665] DAMAGECOUNT value on done: 4846.0 [2024-08-05 22:09:56,423][52665] Sum rewards: 3.017, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.488', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.104', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'ARMOR': '0.892', 'DAMAGECOUNT': '1.830', 'weapon2': '1.842', 'weapon3': '1.914', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:56,467][52658] DAMAGECOUNT value on done: 3427.0 [2024-08-05 22:09:56,470][52658] Sum rewards: 2.374, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.018', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.060', 'weapon5': '0.090', 'AMMO4': '0.091', 'AMMO3': '0.096', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.029', 'weapon3': '1.504', 'weapon2': '1.890', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:56,911][52669] DAMAGECOUNT value on done: 3604.0 [2024-08-05 22:09:56,913][52669] Sum rewards: -0.390, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.047', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.210', 'weapon4': '0.230', 'ARMOR': '0.479', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.642', 'weapon2': '1.346', 'weapon3': '1.524', 'FRAGCOUNT': '2.000'} [2024-08-05 22:09:57,180][52811] DAMAGECOUNT value on done: 3330.0 [2024-08-05 22:09:57,182][52811] Sum rewards: 1.814, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.367', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'ARMOR': '0.088', 'weapon4': '0.124', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.065', 'weapon3': '1.486', 'weapon2': '1.580'} [2024-08-05 22:09:57,430][52667] DAMAGECOUNT value on done: 4193.0 [2024-08-05 22:09:57,430][52667] Sum rewards: 5.306, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.395', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.043', 'ARMOR': '0.048', 'AMMO3': '0.080', 'weapon4': '0.198', 'WEAPON4': '0.200', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.572', 'weapon2': '1.730', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '5.000'} [2024-08-05 22:09:57,794][52567] Fps is (10 sec: 18024.6, 60 sec: 17479.1, 300 sec: 17439.2). Total num frames: 45776896. Throughput: 0: 4292.5. Samples: 11450850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:09:57,794][52567] Avg episode reward: [(0, '2.879')] [2024-08-05 22:09:58,310][52803] DAMAGECOUNT value on done: 3760.0 [2024-08-05 22:09:58,312][52803] Sum rewards: 4.257, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.718', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.232', 'HITCOUNT': '0.580', 'ARMOR': '0.872', 'WEAPON3': '1.000', 'weapon3': '1.518', 'weapon2': '1.726', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '6.000'} [2024-08-05 22:09:59,183][52647] DAMAGECOUNT value on done: 4018.0 [2024-08-05 22:09:59,186][52647] Sum rewards: 4.299, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'weapon5': '0.186', 'HEALTH': '0.230', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.218', 'weapon2': '1.286', 'weapon3': '1.794', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:59,201][52658] DAMAGECOUNT value on done: 3672.0 [2024-08-05 22:09:59,203][52658] Sum rewards: 4.594, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.377', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'weapon4': '0.216', 'ARMOR': '0.436', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.194', 'weapon3': '1.474', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '3.000'} [2024-08-05 22:09:59,243][52663] DAMAGECOUNT value on done: 3871.0 [2024-08-05 22:09:59,245][52663] Sum rewards: 5.635, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO3': '0.101', 'HITCOUNT': '0.340', 'HEALTH': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.812', 'DAMAGECOUNT': '0.885', 'weapon2': '1.506', 'weapon3': '2.246', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:59,424][52649] DAMAGECOUNT value on done: 3833.0 [2024-08-05 22:09:59,426][52649] Sum rewards: 3.684, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.228', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.254', 'HITCOUNT': '0.500', 'ARMOR': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.294', 'weapon3': '1.972', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:59,791][52665] DAMAGECOUNT value on done: 4302.0 [2024-08-05 22:09:59,792][52665] Sum rewards: 3.606, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'ARMOR': '0.048', 'weapon5': '0.076', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'weapon2': '1.192', 'DAMAGECOUNT': '1.203', 'weapon3': '2.020', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:59,906][52650] Updated weights for policy 0, policy_version 5591 (0.0013) [2024-08-05 22:09:59,913][52667] DAMAGECOUNT value on done: 4589.0 [2024-08-05 22:09:59,913][52667] Sum rewards: 3.184, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.336', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.210', 'HITCOUNT': '0.460', 'WEAPON3': '0.900', 'ARMOR': '1.029', 'weapon2': '1.568', 'DAMAGECOUNT': '1.800', 'weapon3': '1.866', 'FRAGCOUNT': '4.000'} [2024-08-05 22:09:59,931][52669] DAMAGECOUNT value on done: 4879.0 [2024-08-05 22:09:59,931][52669] Sum rewards: 0.840, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.690', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.042', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.490', 'ARMOR': '0.519', 'WEAPON3': '0.900', 'weapon2': '1.436', 'DAMAGECOUNT': '1.695', 'weapon3': '2.002', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:00,490][52811] DAMAGECOUNT value on done: 4073.0 [2024-08-05 22:10:00,490][52811] Sum rewards: -0.412, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.446', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.026', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.506', 'weapon2': '1.760', 'weapon3': '1.954', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:01,658][52803] DAMAGECOUNT value on done: 4951.0 [2024-08-05 22:10:01,659][52803] Sum rewards: 0.716, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.770', 'AMMO4': '-0.102', 'AMMO2': '-0.020', 'ARMOR': '0.082', 'AMMO3': '0.098', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.062', 'weapon2': '1.692', 'weapon3': '1.824', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:01,717][52664] DAMAGECOUNT value on done: 5075.0 [2024-08-05 22:10:01,719][52664] Sum rewards: 0.400, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.138', 'weapon4': '0.164', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'ARMOR': '0.873', 'weapon3': '1.546', 'weapon2': '1.728', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:01,795][52647] DAMAGECOUNT value on done: 3707.0 [2024-08-05 22:10:01,796][52647] Sum rewards: 1.981, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO5': '0.003', 'weapon5': '0.010', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.344', 'DAMAGECOUNT': '1.554', 'weapon3': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:02,120][52663] DAMAGECOUNT value on done: 3654.0 [2024-08-05 22:10:02,121][52663] Sum rewards: 1.567, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.924', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'ARMOR': '0.036', 'AMMO3': '0.081', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '1.102', 'weapon3': '1.376', 'DAMAGECOUNT': '1.425', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:02,182][52658] DAMAGECOUNT value on done: 4576.0 [2024-08-05 22:10:02,182][52658] Sum rewards: 0.672, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.707', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.096', 'HITCOUNT': '0.360', 'ARMOR': '0.507', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.290', 'weapon3': '1.330', 'weapon2': '1.592', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:02,544][52649] DAMAGECOUNT value on done: 2902.0 [2024-08-05 22:10:02,545][52649] Sum rewards: 1.166, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.960', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.114', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.328', 'DAMAGECOUNT': '0.420', 'ARMOR': '0.534', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.170', 'weapon2': '1.960'} [2024-08-05 22:10:02,794][52567] Fps is (10 sec: 16393.5, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 45850624. Throughput: 0: 4278.5. Samples: 11463610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 22:10:02,794][52567] Avg episode reward: [(0, '2.949')] [2024-08-05 22:10:02,795][52614] Saving new best policy, reward=2.949! [2024-08-05 22:10:02,995][52665] DAMAGECOUNT value on done: 4917.0 [2024-08-05 22:10:02,995][52665] Sum rewards: 5.187, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.728', 'AMMO2': '0.016', 'weapon7': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.368', 'HITCOUNT': '0.400', 'ARMOR': '0.472', 'WEAPON3': '0.500', 'weapon3': '1.118', 'weapon2': '1.382', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:03,211][52667] DAMAGECOUNT value on done: 4528.0 [2024-08-05 22:10:03,213][52667] Sum rewards: 3.588, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.784', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.153', 'weapon4': '0.164', 'HITCOUNT': '0.740', 'ARMOR': '0.894', 'WEAPON3': '0.950', 'weapon2': '1.452', 'weapon3': '2.132', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:03,456][52795] DAMAGECOUNT value on done: 3347.0 [2024-08-05 22:10:03,457][52795] Sum rewards: 4.993, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.730', 'AMMO4': '-0.113', 'AMMO2': '-0.023', 'AMMO3': '0.113', 'HITCOUNT': '0.510', 'ARMOR': '0.540', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.680', 'weapon3': '1.906', 'weapon2': '1.960', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:03,769][52811] DAMAGECOUNT value on done: 3863.0 [2024-08-05 22:10:03,770][52811] Sum rewards: 5.243, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.510', 'DAMAGECOUNT': '1.641', 'weapon3': '2.226', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:03,825][52665] Large shaping reward -2.558 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.009000000000000001, -9.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 22:10:04,147][52650] Updated weights for policy 0, policy_version 5601 (0.0013) [2024-08-05 22:10:04,579][52664] DAMAGECOUNT value on done: 3714.0 [2024-08-05 22:10:04,581][52664] Sum rewards: 3.940, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.047', 'AMMO2': '0.015', 'AMMO3': '0.058', 'AMMO4': '0.073', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.134', 'HITCOUNT': '0.240', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.597', 'weapon3': '0.992', 'weapon2': '1.348', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:04,589][52647] DAMAGECOUNT value on done: 4030.0 [2024-08-05 22:10:04,592][52647] Sum rewards: 4.260, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.114', 'HITCOUNT': '0.320', 'ARMOR': '0.539', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.260', 'weapon2': '1.314', 'weapon3': '1.608', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:04,967][52803] DAMAGECOUNT value on done: 4741.0 [2024-08-05 22:10:04,967][52803] Sum rewards: -0.690, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.222', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.186', 'HITCOUNT': '0.290', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.891', 'FRAGCOUNT': '1.000', 'weapon2': '1.378', 'weapon3': '1.402'} [2024-08-05 22:10:05,237][52663] DAMAGECOUNT value on done: 4432.0 [2024-08-05 22:10:05,238][52663] Sum rewards: 2.454, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.057', 'HITCOUNT': '0.130', 'WEAPON3': '0.200', 'DAMAGECOUNT': '0.573', 'weapon3': '0.652', 'HEALTH': '0.742', 'ARMOR': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.128'} [2024-08-05 22:10:05,353][52658] DAMAGECOUNT value on done: 3071.0 [2024-08-05 22:10:05,353][52658] Sum rewards: 4.048, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.489', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.068', 'AMMO3': '0.075', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'weapon3': '1.518', 'DAMAGECOUNT': '1.590', 'weapon2': '1.982', 'FRAGCOUNT': '3.500'} [2024-08-05 22:10:05,705][52649] DAMAGECOUNT value on done: 3993.0 [2024-08-05 22:10:05,707][52649] Sum rewards: 3.478, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.054', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.538', 'HEALTH': '0.717', 'FRAGCOUNT': '1.000', 'weapon3': '1.576', 'DAMAGECOUNT': '1.623', 'weapon2': '1.968'} [2024-08-05 22:10:06,061][52665] DAMAGECOUNT value on done: 3512.0 [2024-08-05 22:10:06,064][52665] Sum rewards: -1.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.835', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.121', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.900', 'ARMOR': '0.959', 'FRAGCOUNT': '1.000', 'weapon2': '1.464', 'weapon3': '1.688'} [2024-08-05 22:10:06,279][52667] DAMAGECOUNT value on done: 3997.0 [2024-08-05 22:10:06,652][52795] DAMAGECOUNT value on done: 3695.0 [2024-08-05 22:10:06,653][52795] Sum rewards: 4.818, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.037', 'weapon4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.250', 'WEAPON3': '0.250', 'weapon5': '0.376', 'weapon3': '0.528', 'ARMOR': '0.846', 'weapon2': '1.014', 'DAMAGECOUNT': '1.404', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:07,155][52647] DAMAGECOUNT value on done: 3454.0 [2024-08-05 22:10:07,157][52647] Sum rewards: 2.948, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.395', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.224', 'HITCOUNT': '0.300', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.942', 'ARMOR': '1.472', 'weapon3': '1.632', 'weapon2': '1.814', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:07,170][52664] DAMAGECOUNT value on done: 4687.0 [2024-08-05 22:10:07,170][52664] Sum rewards: 1.769, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.330', 'AMMO4': '-0.103', 'AMMO2': '-0.020', 'AMMO3': '0.074', 'HITCOUNT': '0.390', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.029', 'weapon3': '1.542', 'weapon2': '1.582', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:07,213][52811] DAMAGECOUNT value on done: 4136.0 [2024-08-05 22:10:07,217][52811] Sum rewards: 5.028, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.730', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.042', 'weapon4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'ARMOR': '0.464', 'HITCOUNT': '0.620', 'WEAPON3': '0.900', 'weapon2': '1.634', 'weapon3': '1.900', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:07,649][52671] DAMAGECOUNT value on done: 4653.0 [2024-08-05 22:10:07,649][52671] Sum rewards: 6.937, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.570', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.126', 'ARMOR': '0.448', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon3': '1.558', 'weapon2': '1.712', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:07,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 45940736. Throughput: 0: 4237.1. Samples: 11488940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 22:10:07,795][52567] Avg episode reward: [(0, '2.918')] [2024-08-05 22:10:08,174][52803] DAMAGECOUNT value on done: 4263.0 [2024-08-05 22:10:08,182][52803] Sum rewards: 0.031, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.785', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.126', 'HITCOUNT': '0.320', 'ARMOR': '0.484', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.888', 'weapon2': '1.574', 'FRAGCOUNT': '2.000', 'weapon3': '2.030'} [2024-08-05 22:10:08,443][52658] DAMAGECOUNT value on done: 4010.0 [2024-08-05 22:10:08,444][52658] Sum rewards: 6.103, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.426', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.226', 'HITCOUNT': '0.380', 'ARMOR': '0.466', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.281', 'weapon3': '1.548', 'weapon2': '1.682', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:08,451][52663] DAMAGECOUNT value on done: 3934.0 [2024-08-05 22:10:08,451][52663] Sum rewards: 0.657, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.670', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO3': '0.073', 'ARMOR': '0.128', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.564', 'weapon2': '1.722', 'DAMAGECOUNT': '1.962'} [2024-08-05 22:10:08,988][52649] DAMAGECOUNT value on done: 3676.0 [2024-08-05 22:10:08,988][52649] Sum rewards: 3.536, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.606', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.030', 'AMMO3': '0.072', 'WEAPON5': '0.150', 'weapon5': '0.226', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.860', 'DAMAGECOUNT': '1.269', 'weapon3': '1.348', 'weapon2': '2.004', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:09,329][52650] Updated weights for policy 0, policy_version 5611 (0.0010) [2024-08-05 22:10:09,338][52667] DAMAGECOUNT value on done: 5157.0 [2024-08-05 22:10:09,339][52665] DAMAGECOUNT value on done: 4737.0 [2024-08-05 22:10:09,344][52665] Sum rewards: 1.687, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.768', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.100', 'AMMO3': '0.125', 'ARMOR': '0.435', 'HITCOUNT': '0.600', 'WEAPON3': '0.850', 'weapon2': '1.528', 'DAMAGECOUNT': '1.806', 'weapon3': '1.894', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:09,344][52667] Sum rewards: 4.916, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.658', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO3': '0.098', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'ARMOR': '0.911', 'DAMAGECOUNT': '1.437', 'weapon3': '1.456', 'weapon2': '1.760', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:09,772][52647] DAMAGECOUNT value on done: 4334.0 [2024-08-05 22:10:09,772][52647] Sum rewards: 3.173, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.106', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.062', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.144', 'ARMOR': '0.424', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.692', 'weapon3': '1.806', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '2.500'} [2024-08-05 22:10:09,821][52664] DAMAGECOUNT value on done: 3667.0 [2024-08-05 22:10:09,823][52664] Sum rewards: 2.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.969', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.117', 'ARMOR': '0.482', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.706', 'DAMAGECOUNT': '1.860', 'weapon3': '2.192', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:09,962][52795] DAMAGECOUNT value on done: 3544.0 [2024-08-05 22:10:09,965][52795] Sum rewards: 0.841, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.472', 'weapon4': '0.002', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'HITCOUNT': '0.440', 'FRAGCOUNT': '0.500', 'ARMOR': '0.512', 'WEAPON3': '0.650', 'weapon3': '1.458', 'DAMAGECOUNT': '1.566', 'weapon2': '1.654'} [2024-08-05 22:10:10,400][52671] DAMAGECOUNT value on done: 4426.0 [2024-08-05 22:10:10,401][52671] Sum rewards: 3.631, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.861', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.190', 'weapon5': '0.268', 'ARMOR': '0.480', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon3': '1.456', 'DAMAGECOUNT': '1.644', 'weapon2': '1.764', 'FRAGCOUNT': '3.500'} [2024-08-05 22:10:10,492][52811] DAMAGECOUNT value on done: 3838.0 [2024-08-05 22:10:10,493][52811] Sum rewards: -0.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'ARMOR': '0.478', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '1.048', 'DAMAGECOUNT': '1.458', 'weapon2': '1.788', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:11,403][52803] DAMAGECOUNT value on done: 4613.0 [2024-08-05 22:10:11,403][52803] Sum rewards: 2.486, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.656', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.052', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.276', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.885', 'ARMOR': '0.900', 'weapon3': '0.930', 'weapon2': '0.938', 'FRAGCOUNT': '1.000'} [2024-08-05 22:10:11,451][52663] DAMAGECOUNT value on done: 3558.0 [2024-08-05 22:10:11,451][52663] Sum rewards: 1.622, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.118', 'weapon4': '0.172', 'HITCOUNT': '0.390', 'ARMOR': '0.510', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.323', 'weapon2': '1.478', 'weapon3': '1.786', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:11,652][52658] DAMAGECOUNT value on done: 4206.0 [2024-08-05 22:10:11,653][52658] Sum rewards: 3.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.948', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.142', 'AMMO3': '0.185', 'ARMOR': '0.456', 'HITCOUNT': '0.840', 'weapon2': '1.030', 'WEAPON3': '1.300', 'weapon3': '2.658', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '9.000'} [2024-08-05 22:10:12,137][52647] DAMAGECOUNT value on done: 3882.0 [2024-08-05 22:10:12,137][52647] Sum rewards: -0.395, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'ARMOR': '0.920', 'DAMAGECOUNT': '1.446', 'weapon3': '1.520', 'weapon2': '1.686', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:12,198][52649] DAMAGECOUNT value on done: 4267.0 [2024-08-05 22:10:12,198][52649] Sum rewards: 4.609, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.045', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.121', 'ARMOR': '0.448', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon2': '1.528', 'DAMAGECOUNT': '1.746', 'weapon3': '1.950', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:12,205][52664] DAMAGECOUNT value on done: 4766.0 [2024-08-05 22:10:12,206][52664] Sum rewards: 3.127, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.072', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'weapon5': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon3': '1.184', 'weapon2': '1.208', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:12,598][52667] DAMAGECOUNT value on done: 4115.0 [2024-08-05 22:10:12,600][52667] Sum rewards: 7.092, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.802', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.110', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.070', 'weapon3': '1.506', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:12,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17066.7, 300 sec: 17383.7). Total num frames: 46022656. Throughput: 0: 4219.1. Samples: 11514620. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:10:12,795][52567] Avg episode reward: [(0, '2.769')] [2024-08-05 22:10:13,170][52671] DAMAGECOUNT value on done: 4128.0 [2024-08-05 22:10:13,170][52671] Sum rewards: 4.211, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.214', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'WEAPON1': '0.010', 'AMMO3': '0.140', 'HITCOUNT': '0.720', 'ARMOR': '0.901', 'WEAPON3': '1.000', 'weapon2': '1.260', 'weapon3': '2.400', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:13,171][52795] DAMAGECOUNT value on done: 4776.0 [2024-08-05 22:10:13,172][52795] Sum rewards: 1.436, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.009', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon5': '0.358', 'HITCOUNT': '0.420', 'ARMOR': '0.436', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.437', 'weapon2': '1.494', 'weapon3': '1.648', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:13,711][52650] Updated weights for policy 0, policy_version 5621 (0.0012) [2024-08-05 22:10:13,905][52659] DAMAGECOUNT value on done: 3845.0 [2024-08-05 22:10:13,905][52659] Sum rewards: 1.963, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.094', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.188', 'weapon2': '1.290', 'weapon3': '1.486', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:13,916][52811] DAMAGECOUNT value on done: 4327.0 [2024-08-05 22:10:13,920][52811] Sum rewards: 1.679, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.200', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.144', 'HITCOUNT': '0.210', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.690', 'FRAGCOUNT': '1.000', 'weapon2': '1.106', 'weapon3': '1.248'} [2024-08-05 22:10:14,240][52663] DAMAGECOUNT value on done: 3658.0 [2024-08-05 22:10:14,240][52663] Sum rewards: -0.199, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.058', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.130', 'HITCOUNT': '0.530', 'WEAPON3': '0.900', 'ARMOR': '0.911', 'weapon2': '1.638', 'DAMAGECOUNT': '1.785', 'weapon3': '1.912', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:14,773][52803] DAMAGECOUNT value on done: 4167.0 [2024-08-05 22:10:14,773][52803] Sum rewards: 3.571, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.665', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.030', 'weapon4': '0.034', 'AMMO4': '0.088', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.360', 'ARMOR': '0.515', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.272', 'weapon3': '1.580', 'weapon2': '1.732', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:15,058][52658] DAMAGECOUNT value on done: 3502.0 [2024-08-05 22:10:15,059][52658] Sum rewards: 3.070, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.515', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.126', 'HITCOUNT': '0.390', 'ARMOR': '0.436', 'WEAPON3': '0.900', 'weapon2': '1.548', 'DAMAGECOUNT': '1.590', 'weapon3': '2.126', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:15,308][52649] DAMAGECOUNT value on done: 3567.0 [2024-08-05 22:10:15,309][52649] Sum rewards: 2.805, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'ARMOR': '0.016', 'AMMO3': '0.096', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.846', 'weapon3': '1.892', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:15,480][52647] DAMAGECOUNT value on done: 4346.0 [2024-08-05 22:10:15,482][52647] Sum rewards: 5.024, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.530', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.232', 'ARMOR': '0.424', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'weapon3': '1.178', 'weapon2': '1.506', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:15,575][52664] DAMAGECOUNT value on done: 4094.0 [2024-08-05 22:10:15,578][52664] Sum rewards: 7.861, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.358', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.126', 'ARMOR': '0.488', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon3': '1.612', 'weapon2': '1.718', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:15,982][52667] DAMAGECOUNT value on done: 5132.0 [2024-08-05 22:10:15,983][52667] Sum rewards: 0.901, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.784', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.127', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'ARMOR': '0.883', 'weapon2': '1.620', 'weapon3': '1.742', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:16,270][52671] DAMAGECOUNT value on done: 4112.0 [2024-08-05 22:10:16,270][52671] Sum rewards: 1.933, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.614', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.650', 'ARMOR': '1.026', 'DAMAGECOUNT': '1.110', 'weapon2': '1.154', 'weapon3': '1.408', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:16,461][52795] DAMAGECOUNT value on done: 4037.0 [2024-08-05 22:10:16,461][52795] Sum rewards: 9.789, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.274', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.136', 'ARMOR': '0.529', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.356', 'weapon3': '1.908', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '10.000'} [2024-08-05 22:10:16,875][52663] DAMAGECOUNT value on done: 3494.0 [2024-08-05 22:10:16,875][52663] Sum rewards: 3.066, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.825', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.125', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '0.917', 'weapon2': '1.384', 'weapon3': '1.582', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:16,946][52659] DAMAGECOUNT value on done: 4725.0 [2024-08-05 22:10:16,948][52659] Sum rewards: 4.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.679', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.572', 'weapon3': '1.578', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:17,260][52811] DAMAGECOUNT value on done: 2421.0 [2024-08-05 22:10:17,262][52811] Sum rewards: 3.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.781', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.133', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'ARMOR': '1.254', 'weapon2': '1.374', 'weapon3': '1.458', 'DAMAGECOUNT': '1.509', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.6, 300 sec: 17383.7). Total num frames: 46112768. Throughput: 0: 4213.1. Samples: 11527280. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-05 22:10:17,795][52567] Avg episode reward: [(0, '2.840')] [2024-08-05 22:10:17,983][52803] DAMAGECOUNT value on done: 3704.0 [2024-08-05 22:10:17,983][52803] Sum rewards: 3.959, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.370', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'ARMOR': '0.830', 'weapon3': '1.586', 'weapon2': '1.594', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:18,226][52658] DAMAGECOUNT value on done: 3877.0 [2024-08-05 22:10:18,520][52647] DAMAGECOUNT value on done: 4135.0 [2024-08-05 22:10:18,530][52647] Sum rewards: 1.350, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.986', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'AMMO3': '0.073', 'HITCOUNT': '0.330', 'ARMOR': '0.495', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.990', 'FRAGCOUNT': '1.000', 'weapon3': '1.358', 'weapon2': '1.374'} [2024-08-05 22:10:18,584][52664] DAMAGECOUNT value on done: 4387.0 [2024-08-05 22:10:18,584][52664] Sum rewards: 1.054, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.541', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.144', 'HITCOUNT': '0.560', 'ARMOR': '0.832', 'WEAPON3': '1.050', 'weapon2': '1.134', 'DAMAGECOUNT': '1.866', 'weapon3': '2.546', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:18,694][52649] DAMAGECOUNT value on done: 4750.0 [2024-08-05 22:10:18,694][52649] Sum rewards: 1.935, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.260', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'weapon5': '0.340', 'HITCOUNT': '0.440', 'ARMOR': '0.468', 'WEAPON3': '0.600', 'weapon3': '1.584', 'DAMAGECOUNT': '1.620', 'weapon2': '1.714', 'FRAGCOUNT': '3.500'} [2024-08-05 22:10:18,942][52671] DAMAGECOUNT value on done: 3981.0 [2024-08-05 22:10:18,944][52671] Sum rewards: 1.714, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.029', 'HEALTH': '0.040', 'AMMO3': '0.090', 'weapon5': '0.112', 'AMMO4': '0.142', 'weapon4': '0.168', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.520', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.939', 'weapon3': '1.456', 'weapon2': '1.770', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:19,006][52650] Updated weights for policy 0, policy_version 5631 (0.0021) [2024-08-05 22:10:19,155][52667] DAMAGECOUNT value on done: 4258.0 [2024-08-05 22:10:19,158][52667] Sum rewards: 2.292, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.162', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.108', 'weapon4': '0.142', 'WEAPON4': '0.150', 'HITCOUNT': '0.490', 'ARMOR': '0.557', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.572', 'weapon2': '1.582', 'weapon3': '2.138', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:19,511][52659] DAMAGECOUNT value on done: 4447.0 [2024-08-05 22:10:19,512][52659] Sum rewards: 5.636, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.224', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.064', 'AMMO3': '0.070', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.170', 'weapon3': '1.680', 'weapon2': '1.800', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:19,889][52795] DAMAGECOUNT value on done: 4534.0 [2024-08-05 22:10:19,889][52795] Sum rewards: 3.240, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'HEALTH': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.226', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'ARMOR': '0.942', 'DAMAGECOUNT': '1.188', 'weapon2': '1.538', 'weapon3': '1.710', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:20,422][52811] DAMAGECOUNT value on done: 2937.0 [2024-08-05 22:10:20,422][52811] Sum rewards: 3.760, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.875', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon5': '0.310', 'ARMOR': '0.420', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.404', 'weapon3': '1.500', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:21,156][52803] DAMAGECOUNT value on done: 3870.0 [2024-08-05 22:10:21,157][52803] Sum rewards: 3.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.416', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'weapon7': '0.084', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.347', 'weapon2': '1.382', 'weapon3': '1.524', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:21,339][52671] DAMAGECOUNT value on done: 3816.0 [2024-08-05 22:10:21,341][52671] Sum rewards: 2.122, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.702', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.020', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.270', 'WEAPON3': '0.400', 'HITCOUNT': '0.460', 'ARMOR': '0.478', 'FRAGCOUNT': '1.000', 'weapon3': '1.248', 'DAMAGECOUNT': '1.554', 'weapon2': '1.644'} [2024-08-05 22:10:21,458][52658] DAMAGECOUNT value on done: 4390.0 [2024-08-05 22:10:21,460][52658] Sum rewards: 6.352, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.858', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.720', 'WEAPON3': '0.850', 'ARMOR': '0.997', 'weapon2': '1.474', 'weapon3': '1.960', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:21,576][52664] DAMAGECOUNT value on done: 4481.0 [2024-08-05 22:10:21,578][52664] Sum rewards: 6.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.178', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.154', 'HITCOUNT': '0.830', 'WEAPON3': '0.950', 'ARMOR': '1.279', 'weapon2': '1.338', 'weapon3': '2.322', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:21,857][52649] DAMAGECOUNT value on done: 3752.0 [2024-08-05 22:10:21,880][52659] DAMAGECOUNT value on done: 4368.0 [2024-08-05 22:10:22,420][52667] DAMAGECOUNT value on done: 3452.0 [2024-08-05 22:10:22,421][52667] Sum rewards: 0.402, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.097', 'HITCOUNT': '0.350', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.092', 'weapon2': '1.448', 'weapon3': '1.724'} [2024-08-05 22:10:22,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16930.1, 300 sec: 17355.9). Total num frames: 46194688. Throughput: 0: 4235.6. Samples: 11552320. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:10:22,794][52567] Avg episode reward: [(0, '2.742')] [2024-08-05 22:10:23,347][52795] DAMAGECOUNT value on done: 4235.0 [2024-08-05 22:10:23,349][52795] Sum rewards: 2.362, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.075', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.095', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'ARMOR': '0.899', 'weapon2': '1.376', 'DAMAGECOUNT': '1.470', 'weapon3': '1.828', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:23,404][52650] Updated weights for policy 0, policy_version 5641 (0.0027) [2024-08-05 22:10:23,633][52811] DAMAGECOUNT value on done: 4073.0 [2024-08-05 22:10:23,643][52811] Sum rewards: 0.210, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.832', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.112', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'ARMOR': '0.875', 'FRAGCOUNT': '1.000', 'weapon2': '1.678', 'DAMAGECOUNT': '1.782', 'weapon3': '1.822'} [2024-08-05 22:10:23,843][52671] DAMAGECOUNT value on done: 4529.0 [2024-08-05 22:10:23,843][52671] Sum rewards: 7.253, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.928', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.066', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'ARMOR': '0.559', 'weapon3': '1.254', 'weapon2': '1.372', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '8.000'} [2024-08-05 22:10:24,357][52659] DAMAGECOUNT value on done: 3854.0 [2024-08-05 22:10:24,359][52659] Sum rewards: 4.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.904', 'AMMO4': '-0.090', 'AMMO2': '-0.018', 'AMMO5': '0.005', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'ARMOR': '0.488', 'HITCOUNT': '0.610', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.701', 'weapon2': '1.736', 'weapon3': '1.976', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:24,478][52803] DAMAGECOUNT value on done: 3431.0 [2024-08-05 22:10:24,480][52803] Sum rewards: 9.228, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.032', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.080', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon3': '1.594', 'weapon2': '1.658', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:24,576][52658] DAMAGECOUNT value on done: 3740.0 [2024-08-05 22:10:24,579][52658] Sum rewards: 2.218, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.971', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.250', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.852', 'weapon2': '1.052', 'weapon3': '1.374', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:24,885][52649] DAMAGECOUNT value on done: 3416.0 [2024-08-05 22:10:24,885][52649] Sum rewards: 5.342, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.899', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.075', 'ARMOR': '0.091', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon3': '1.520', 'weapon2': '1.914', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:24,955][52664] DAMAGECOUNT value on done: 5097.0 [2024-08-05 22:10:24,955][52664] Sum rewards: 4.557, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.780', 'AMMO4': '-0.095', 'AMMO2': '-0.019', 'AMMO3': '0.080', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'ARMOR': '0.976', 'weapon3': '1.492', 'weapon2': '1.558', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:25,290][52667] DAMAGECOUNT value on done: 4188.0 [2024-08-05 22:10:25,291][52667] Sum rewards: -0.601, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.530', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.410', 'ARMOR': '0.584', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.356', 'weapon2': '1.706', 'FRAGCOUNT': '2.000', 'weapon3': '2.100'} [2024-08-05 22:10:26,698][52795] DAMAGECOUNT value on done: 4298.0 [2024-08-05 22:10:26,700][52795] Sum rewards: 0.781, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.863', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'ARMOR': '0.008', 'AMMO3': '0.112', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.275', 'weapon2': '1.322', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:26,857][52811] DAMAGECOUNT value on done: 3998.0 [2024-08-05 22:10:26,862][52811] Sum rewards: 0.196, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.864', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.040', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'ARMOR': '0.512', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.837', 'weapon3': '1.394', 'weapon2': '1.570', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:26,863][52671] DAMAGECOUNT value on done: 2629.0 [2024-08-05 22:10:26,865][52671] Sum rewards: 1.910, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.590', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO3': '0.073', 'HITCOUNT': '0.180', 'ARMOR': '0.552', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.696', 'weapon3': '1.086', 'weapon2': '1.150', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:27,246][52658] DAMAGECOUNT value on done: 3617.0 [2024-08-05 22:10:27,246][52658] Sum rewards: 5.090, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.935', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'AMMO3': '0.060', 'weapon5': '0.098', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'ARMOR': '0.518', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.299', 'weapon3': '1.440', 'weapon2': '2.120', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:27,557][52659] DAMAGECOUNT value on done: 3429.0 [2024-08-05 22:10:27,559][52659] Sum rewards: -0.775, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.950', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.044', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon2': '1.498', 'weapon3': '2.004'} [2024-08-05 22:10:27,740][52803] DAMAGECOUNT value on done: 3301.0 [2024-08-05 22:10:27,742][52803] Sum rewards: 1.934, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.345', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon5': '0.060', 'AMMO3': '0.080', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.362', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.900', 'ARMOR': '0.951', 'weapon2': '1.576', 'weapon3': '1.714', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:27,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.6, 300 sec: 17355.9). Total num frames: 46276608. Throughput: 0: 4238.4. Samples: 11577810. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:10:27,794][52567] Avg episode reward: [(0, '2.846')] [2024-08-05 22:10:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005649_46276608.pth... [2024-08-05 22:10:27,942][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005134_42057728.pth [2024-08-05 22:10:28,118][52667] DAMAGECOUNT value on done: 4756.0 [2024-08-05 22:10:28,120][52667] Sum rewards: 3.778, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.244', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.174', 'HITCOUNT': '0.520', 'ARMOR': '0.828', 'WEAPON3': '1.100', 'weapon2': '1.142', 'DAMAGECOUNT': '1.935', 'weapon3': '2.308', 'FRAGCOUNT': '8.000'} [2024-08-05 22:10:28,225][52649] DAMAGECOUNT value on done: 4186.0 [2024-08-05 22:10:28,225][52649] Sum rewards: 7.243, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.209', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.072', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '1.672', 'weapon2': '1.676', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:28,411][52664] DAMAGECOUNT value on done: 4306.0 [2024-08-05 22:10:28,413][52664] Sum rewards: 2.016, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.282', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.216', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.508', 'weapon3': '1.216', 'weapon2': '1.474', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:28,946][52650] Updated weights for policy 0, policy_version 5651 (0.0018) [2024-08-05 22:10:29,981][52795] DAMAGECOUNT value on done: 4332.0 [2024-08-05 22:10:29,982][52795] Sum rewards: -0.920, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.136', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'HITCOUNT': '0.640', 'ARMOR': '0.941', 'WEAPON3': '1.050', 'weapon2': '1.598', 'weapon3': '2.066', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:29,998][52658] DAMAGECOUNT value on done: 3972.0 [2024-08-05 22:10:30,000][52658] Sum rewards: 8.412, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'HEALTH': '0.186', 'weapon4': '0.232', 'ARMOR': '0.504', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.272', 'weapon3': '1.806', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:30,077][52671] DAMAGECOUNT value on done: 4812.0 [2024-08-05 22:10:30,078][52671] Sum rewards: 3.936, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.436', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'ARMOR': '0.508', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.497', 'weapon2': '1.662', 'weapon3': '1.904', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:30,086][52811] DAMAGECOUNT value on done: 4084.0 [2024-08-05 22:10:30,086][52811] Sum rewards: 1.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.013', 'weapon5': '0.026', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.580', 'WEAPON3': '1.000', 'weapon2': '1.258', 'ARMOR': '1.342', 'DAMAGECOUNT': '1.935', 'weapon3': '2.474', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:30,653][52667] DAMAGECOUNT value on done: 3989.0 [2024-08-05 22:10:30,653][52667] Sum rewards: 0.893, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.957', 'AMMO2': '0.008', 'weapon4': '0.010', 'AMMO5': '0.010', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'ARMOR': '0.910', 'weapon3': '1.460', 'DAMAGECOUNT': '1.593', 'weapon2': '2.382', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:30,785][52659] DAMAGECOUNT value on done: 4143.0 [2024-08-05 22:10:30,786][52659] Sum rewards: 1.467, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.709', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.078', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.275', 'ARMOR': '1.370', 'weapon3': '1.396', 'weapon2': '1.956'} [2024-08-05 22:10:31,048][52803] DAMAGECOUNT value on done: 4178.0 [2024-08-05 22:10:31,048][52803] Sum rewards: 0.530, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.060', 'weapon5': '0.084', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'weapon2': '1.354', 'DAMAGECOUNT': '1.398', 'weapon3': '1.632', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:31,683][52649] DAMAGECOUNT value on done: 2770.0 [2024-08-05 22:10:31,683][52649] Sum rewards: -2.004, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.511', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.101', 'AMMO3': '0.122', 'HITCOUNT': '0.430', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.455', 'weapon3': '1.514', 'weapon2': '1.602'} [2024-08-05 22:10:31,807][52664] DAMAGECOUNT value on done: 3516.0 [2024-08-05 22:10:31,809][52664] Sum rewards: 1.800, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.488', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.364', 'ARMOR': '0.436', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.278', 'DAMAGECOUNT': '1.770', 'weapon3': '1.844', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:32,727][52671] DAMAGECOUNT value on done: 4279.0 [2024-08-05 22:10:32,728][52671] Sum rewards: 2.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.097', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.094', 'ARMOR': '0.499', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.864', 'weapon3': '1.936', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 17355.9). Total num frames: 46366720. Throughput: 0: 4230.6. Samples: 11590110. Policy #0 lag: (min: 1.0, avg: 4.9, max: 9.0) [2024-08-05 22:10:32,794][52567] Avg episode reward: [(0, '2.785')] [2024-08-05 22:10:33,021][52658] DAMAGECOUNT value on done: 4776.0 [2024-08-05 22:10:33,021][52658] Sum rewards: 3.028, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'ARMOR': '0.072', 'AMMO3': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.247', 'weapon4': '0.434', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon3': '1.512', 'weapon2': '1.570', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:33,060][52668] DAMAGECOUNT value on done: 3949.0 [2024-08-05 22:10:33,060][52668] Sum rewards: 6.995, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.038', 'AMMO2': '0.023', 'AMMO3': '0.112', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.426', 'ARMOR': '0.444', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '1.032', 'DAMAGECOUNT': '1.647', 'weapon3': '1.922', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:33,231][52650] Updated weights for policy 0, policy_version 5661 (0.0014) [2024-08-05 22:10:33,286][52795] DAMAGECOUNT value on done: 3686.0 [2024-08-05 22:10:33,289][52795] Sum rewards: 3.209, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.360', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.146', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon3': '1.136', 'weapon2': '1.414', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:33,353][52659] DAMAGECOUNT value on done: 3427.0 [2024-08-05 22:10:33,354][52659] Sum rewards: 4.554, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.812', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'AMMO4': '0.095', 'weapon4': '0.208', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'ARMOR': '0.528', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.338', 'weapon2': '1.470', 'weapon3': '1.612', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:33,405][52811] DAMAGECOUNT value on done: 4249.0 [2024-08-05 22:10:33,405][52811] Sum rewards: 2.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.112', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.246', 'ARMOR': '0.560', 'HITCOUNT': '0.640', 'WEAPON3': '0.900', 'weapon2': '1.474', 'weapon3': '2.002', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:34,011][52667] DAMAGECOUNT value on done: 4645.0 [2024-08-05 22:10:34,011][52667] Sum rewards: -1.240, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.520', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'HITCOUNT': '0.440', 'ARMOR': '0.939', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.395', 'weapon2': '1.592', 'FRAGCOUNT': '2.000', 'weapon3': '2.192'} [2024-08-05 22:10:34,052][52649] DAMAGECOUNT value on done: 4013.0 [2024-08-05 22:10:34,053][52649] Sum rewards: 0.039, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.012', 'weapon5': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.370', 'ARMOR': '0.515', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.503', 'weapon2': '1.816', 'weapon3': '1.914', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:34,440][52803] DAMAGECOUNT value on done: 4515.0 [2024-08-05 22:10:34,440][52803] Sum rewards: 0.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.394', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.060', 'ARMOR': '0.064', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'FRAGCOUNT': '0.500', 'weapon3': '1.274', 'DAMAGECOUNT': '1.275', 'weapon2': '2.006'} [2024-08-05 22:10:35,138][52664] DAMAGECOUNT value on done: 3716.0 [2024-08-05 22:10:35,140][52664] Sum rewards: 3.895, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.510', 'ARMOR': '0.524', 'WEAPON3': '0.850', 'weapon2': '1.486', 'DAMAGECOUNT': '1.566', 'weapon3': '2.180', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:35,831][52671] DAMAGECOUNT value on done: 3939.0 [2024-08-05 22:10:35,834][52671] Sum rewards: 4.241, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.115', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'HITCOUNT': '0.470', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.596', 'weapon2': '1.620', 'weapon3': '1.760', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:36,197][52668] DAMAGECOUNT value on done: 4313.0 [2024-08-05 22:10:36,197][52668] Sum rewards: 4.200, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.932', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'ARMOR': '0.457', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.126', 'DAMAGECOUNT': '1.701', 'weapon3': '1.862', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:36,392][52658] DAMAGECOUNT value on done: 4469.0 [2024-08-05 22:10:36,394][52658] Sum rewards: 3.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.856', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.129', 'weapon5': '0.134', 'HITCOUNT': '0.490', 'WEAPON3': '0.900', 'ARMOR': '1.432', 'weapon3': '1.486', 'DAMAGECOUNT': '1.824', 'weapon2': '1.832', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:36,542][52659] DAMAGECOUNT value on done: 4931.0 [2024-08-05 22:10:36,542][52659] Sum rewards: 2.196, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.796', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon4': '0.028', 'ARMOR': '0.036', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.448', 'DAMAGECOUNT': '1.515', 'weapon3': '1.866', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:36,573][52811] DAMAGECOUNT value on done: 3197.0 [2024-08-05 22:10:36,577][52811] Sum rewards: 3.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.526', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.172', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'ARMOR': '0.896', 'weapon2': '1.382', 'DAMAGECOUNT': '1.689', 'weapon3': '2.036', 'FRAGCOUNT': '3.500'} [2024-08-05 22:10:36,601][52795] DAMAGECOUNT value on done: 3417.0 [2024-08-05 22:10:36,602][52795] Sum rewards: -0.855, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.598', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.222', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.026', 'weapon2': '1.060', 'weapon3': '1.734', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:36,778][52649] DAMAGECOUNT value on done: 4151.0 [2024-08-05 22:10:36,778][52649] Sum rewards: 4.808, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'HEALTH': '0.281', 'weapon4': '0.386', 'ARMOR': '0.483', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.076', 'DAMAGECOUNT': '1.860', 'weapon3': '1.904', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:37,411][52660] DAMAGECOUNT value on done: 4153.0 [2024-08-05 22:10:37,411][52660] Sum rewards: 7.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.184', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.248', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'ARMOR': '1.200', 'weapon2': '1.454', 'weapon3': '1.864', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 17355.9). Total num frames: 46448640. Throughput: 0: 4224.3. Samples: 11615480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:10:37,794][52567] Avg episode reward: [(0, '2.865')] [2024-08-05 22:10:37,856][52803] DAMAGECOUNT value on done: 3736.0 [2024-08-05 22:10:37,856][52803] Sum rewards: 5.862, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.126', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.124', 'ARMOR': '0.528', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '1.604', 'weapon3': '1.658', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:37,915][52664] DAMAGECOUNT value on done: 2881.0 [2024-08-05 22:10:37,918][52664] Sum rewards: 3.834, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON6': '0.100', 'HEALTH': '0.173', 'weapon6': '0.180', 'HITCOUNT': '0.230', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.663', 'weapon2': '1.374', 'weapon3': '1.418', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:38,267][52650] Updated weights for policy 0, policy_version 5671 (0.0016) [2024-08-05 22:10:38,920][52668] DAMAGECOUNT value on done: 3616.0 [2024-08-05 22:10:38,920][52668] Sum rewards: 0.790, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.706', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'ARMOR': '0.882', 'DAMAGECOUNT': '1.311', 'weapon3': '1.568', 'weapon2': '1.790', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:39,224][52671] DAMAGECOUNT value on done: 5425.0 [2024-08-05 22:10:39,226][52671] Sum rewards: 8.358, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.894', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.067', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'ARMOR': '0.949', 'weapon2': '1.682', 'weapon3': '1.930', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '8.000'} [2024-08-05 22:10:39,428][52658] DAMAGECOUNT value on done: 4010.0 [2024-08-05 22:10:39,430][52658] Sum rewards: 2.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.147', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.238', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.245', 'weapon2': '1.558', 'weapon3': '1.674', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:39,767][52649] DAMAGECOUNT value on done: 4428.0 [2024-08-05 22:10:39,768][52649] Sum rewards: 5.453, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.195', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.128', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'ARMOR': '0.969', 'weapon3': '1.806', 'weapon2': '1.834', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:39,854][52795] DAMAGECOUNT value on done: 3504.0 [2024-08-05 22:10:39,857][52795] Sum rewards: 1.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.065', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'HITCOUNT': '0.410', 'WEAPON3': '1.000', 'ARMOR': '1.299', 'DAMAGECOUNT': '1.425', 'weapon2': '1.508', 'weapon3': '1.834', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:39,873][52659] DAMAGECOUNT value on done: 4394.0 [2024-08-05 22:10:39,874][52659] Sum rewards: 6.337, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.412', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'ARMOR': '0.056', 'AMMO3': '0.100', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon2': '1.288', 'weapon3': '1.732', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:39,941][52811] DAMAGECOUNT value on done: 3725.0 [2024-08-05 22:10:39,941][52811] Sum rewards: 6.079, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.362', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.090', 'weapon4': '0.112', 'WEAPON4': '0.150', 'ARMOR': '0.520', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.272', 'weapon3': '1.842', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:40,691][52660] DAMAGECOUNT value on done: 5454.0 [2024-08-05 22:10:40,693][52660] Sum rewards: 5.557, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.014', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon4': '0.208', 'HITCOUNT': '0.770', 'WEAPON3': '0.950', 'ARMOR': '1.317', 'weapon2': '1.444', 'weapon3': '2.070', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:41,147][52664] DAMAGECOUNT value on done: 3519.0 [2024-08-05 22:10:41,148][52664] Sum rewards: 0.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.820', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.028', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.900', 'ARMOR': '0.921', 'weapon2': '1.188', 'weapon3': '1.582', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:41,245][52803] DAMAGECOUNT value on done: 3358.0 [2024-08-05 22:10:41,246][52803] Sum rewards: 0.610, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.978', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.043', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.956', 'DAMAGECOUNT': '1.098', 'weapon2': '1.512', 'weapon3': '1.566', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:41,384][52820] DAMAGECOUNT value on done: 3207.0 [2024-08-05 22:10:41,385][52820] Sum rewards: 4.104, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.088', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'ARMOR': '1.345', 'weapon3': '1.532', 'DAMAGECOUNT': '1.830', 'weapon2': '1.978', 'FRAGCOUNT': '4.500'} [2024-08-05 22:10:42,009][52668] DAMAGECOUNT value on done: 3874.0 [2024-08-05 22:10:42,010][52668] Sum rewards: 4.961, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.012', 'AMMO4': '0.030', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.384', 'weapon3': '1.672', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:42,316][52671] DAMAGECOUNT value on done: 4846.0 [2024-08-05 22:10:42,316][52671] Sum rewards: 2.167, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.900', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon4': '0.064', 'AMMO3': '0.122', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'ARMOR': '0.905', 'weapon3': '1.606', 'weapon2': '1.736', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:42,463][52658] DAMAGECOUNT value on done: 3914.0 [2024-08-05 22:10:42,465][52658] Sum rewards: 6.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.262', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.020', 'ARMOR': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'HITCOUNT': '0.670', 'WEAPON3': '1.050', 'weapon2': '1.322', 'weapon3': '2.442', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.000'} [2024-08-05 22:10:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 17356.0). Total num frames: 46530560. Throughput: 0: 4223.3. Samples: 11640900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:10:42,802][52567] Avg episode reward: [(0, '3.057')] [2024-08-05 22:10:42,802][52614] Saving new best policy, reward=3.057! [2024-08-05 22:10:42,857][52795] DAMAGECOUNT value on done: 3346.0 [2024-08-05 22:10:42,858][52795] Sum rewards: 6.501, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.848', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.018', 'weapon4': '0.024', 'AMMO4': '0.044', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.484', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.396', 'weapon2': '1.442', 'DAMAGECOUNT': '1.548', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:43,013][52659] DAMAGECOUNT value on done: 4261.0 [2024-08-05 22:10:43,014][52659] Sum rewards: 2.453, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'HEALTH': '0.028', 'weapon5': '0.028', 'AMMO4': '0.039', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'ARMOR': '0.922', 'DAMAGECOUNT': '0.960', 'FRAGCOUNT': '1.000', 'weapon2': '1.398', 'weapon3': '1.542'} [2024-08-05 22:10:43,120][52811] DAMAGECOUNT value on done: 3048.0 [2024-08-05 22:10:43,129][52811] Sum rewards: 2.972, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.626', 'AMMO5': '0.004', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon5': '0.242', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'ARMOR': '0.560', 'weapon3': '0.942', 'DAMAGECOUNT': '1.128', 'FRAGCOUNT': '1.500', 'weapon2': '1.706'} [2024-08-05 22:10:43,168][52650] Updated weights for policy 0, policy_version 5681 (0.0023) [2024-08-05 22:10:43,417][52660] DAMAGECOUNT value on done: 3437.0 [2024-08-05 22:10:43,417][52660] Sum rewards: 4.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.708', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.424', 'ARMOR': '0.483', 'WEAPON3': '0.650', 'weapon2': '0.982', 'DAMAGECOUNT': '1.140', 'weapon3': '1.724', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:43,448][52664] DAMAGECOUNT value on done: 4195.0 [2024-08-05 22:10:43,449][52664] Sum rewards: 7.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.222', 'AMMO2': '0.001', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'ARMOR': '0.892', 'weapon2': '1.430', 'weapon3': '1.570', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:44,445][52803] DAMAGECOUNT value on done: 3338.0 [2024-08-05 22:10:44,447][52803] Sum rewards: -1.009, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.026', 'weapon5': '0.026', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.380', 'ARMOR': '0.466', 'WEAPON3': '0.900', 'weapon2': '1.326', 'DAMAGECOUNT': '1.374', 'weapon3': '1.898', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:44,763][52820] DAMAGECOUNT value on done: 4060.0 [2024-08-05 22:10:44,767][52820] Sum rewards: 3.425, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.492', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.210', 'HITCOUNT': '0.350', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.095', 'weapon2': '1.522', 'weapon3': '1.588', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:44,968][52668] DAMAGECOUNT value on done: 3676.0 [2024-08-05 22:10:44,968][52668] Sum rewards: 0.218, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.170', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.164', 'HITCOUNT': '0.320', 'ARMOR': '0.898', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.197', 'weapon2': '1.426', 'weapon3': '2.464', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:45,572][52658] DAMAGECOUNT value on done: 4161.0 [2024-08-05 22:10:45,573][52658] Sum rewards: 2.846, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.218', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'weapon4': '0.006', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'ARMOR': '0.531', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon3': '1.696', 'weapon2': '1.704', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:45,699][52671] DAMAGECOUNT value on done: 3473.0 [2024-08-05 22:10:45,700][52671] Sum rewards: 1.409, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.109', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'AMMO3': '0.135', 'HITCOUNT': '0.440', 'ARMOR': '0.519', 'WEAPON3': '0.850', 'weapon2': '1.550', 'DAMAGECOUNT': '1.602', 'weapon3': '2.074', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:46,132][52795] DAMAGECOUNT value on done: 4351.0 [2024-08-05 22:10:46,134][52795] Sum rewards: 4.511, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.910', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'ARMOR': '0.044', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.172', 'DAMAGECOUNT': '1.656', 'weapon3': '1.940', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:46,190][52664] DAMAGECOUNT value on done: 3641.0 [2024-08-05 22:10:46,191][52664] Sum rewards: -0.570, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.100', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.016', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.238', 'HITCOUNT': '0.300', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.849', 'FRAGCOUNT': '1.000', 'weapon2': '1.294', 'weapon3': '1.912'} [2024-08-05 22:10:46,218][52660] DAMAGECOUNT value on done: 3580.0 [2024-08-05 22:10:46,219][52660] Sum rewards: 3.023, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.164', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'ARMOR': '0.897', 'DAMAGECOUNT': '1.173', 'weapon2': '1.556', 'weapon3': '1.588', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:46,318][52659] DAMAGECOUNT value on done: 3735.0 [2024-08-05 22:10:46,322][52659] Sum rewards: 1.732, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.089', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.152', 'HITCOUNT': '0.160', 'HEALTH': '0.179', 'weapon5': '0.188', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.555', 'ARMOR': '0.820', 'FRAGCOUNT': '1.000', 'weapon2': '1.342', 'weapon3': '1.674'} [2024-08-05 22:10:46,510][52811] DAMAGECOUNT value on done: 4193.0 [2024-08-05 22:10:46,512][52811] Sum rewards: 2.169, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'ARMOR': '0.072', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.284', 'HITCOUNT': '0.350', 'WEAPON3': '0.500', 'HEALTH': '0.516', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.134', 'weapon2': '1.430', 'weapon3': '1.750'} [2024-08-05 22:10:47,627][52650] Updated weights for policy 0, policy_version 5691 (0.0021) [2024-08-05 22:10:47,638][52803] DAMAGECOUNT value on done: 3163.0 [2024-08-05 22:10:47,640][52803] Sum rewards: 5.749, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.852', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.092', 'ARMOR': '0.524', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.458', 'weapon3': '1.938', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17067.0, 300 sec: 17383.7). Total num frames: 46620672. Throughput: 0: 4224.0. Samples: 11653690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:10:47,794][52567] Avg episode reward: [(0, '3.014')] [2024-08-05 22:10:47,850][52668] DAMAGECOUNT value on done: 4742.0 [2024-08-05 22:10:47,851][52668] Sum rewards: 1.893, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.216', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.072', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'weapon5': '0.190', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.185', 'weapon2': '1.670', 'weapon3': '1.818', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:47,979][52820] DAMAGECOUNT value on done: 4156.0 [2024-08-05 22:10:47,979][52820] Sum rewards: 4.396, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.230', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.050', 'ARMOR': '0.070', 'WEAPON4': '0.100', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'weapon3': '0.926', 'DAMAGECOUNT': '1.002', 'weapon2': '1.570', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:48,461][52658] DAMAGECOUNT value on done: 4328.0 [2024-08-05 22:10:48,461][52658] Sum rewards: 4.663, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.102', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'ARMOR': '1.258', 'DAMAGECOUNT': '1.317', 'weapon3': '1.706', 'weapon2': '2.096', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:48,600][52671] DAMAGECOUNT value on done: 4844.0 [2024-08-05 22:10:48,600][52671] Sum rewards: 2.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.678', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.112', 'weapon5': '0.140', 'weapon4': '0.194', 'HITCOUNT': '0.390', 'WEAPON3': '0.800', 'weapon2': '1.390', 'DAMAGECOUNT': '1.575', 'weapon3': '1.608', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:49,014][52664] DAMAGECOUNT value on done: 4059.0 [2024-08-05 22:10:49,015][52664] Sum rewards: 3.668, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'weapon5': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'weapon4': '0.162', 'HITCOUNT': '0.460', 'ARMOR': '0.534', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.605', 'weapon2': '1.656', 'weapon3': '1.944', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:49,268][52660] DAMAGECOUNT value on done: 3411.0 [2024-08-05 22:10:49,270][52660] Sum rewards: 2.378, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.712', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon7': '0.048', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.290', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.831', 'weapon2': '1.226', 'weapon3': '1.352', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:49,427][52795] DAMAGECOUNT value on done: 4278.0 [2024-08-05 22:10:49,429][52795] Sum rewards: 7.664, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.518', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.131', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '1.240', 'ARMOR': '1.398', 'weapon3': '2.422', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:49,501][52659] DAMAGECOUNT value on done: 4307.0 [2024-08-05 22:10:49,501][52659] Sum rewards: 2.722, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.477', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.030', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.550', 'ARMOR': '0.976', 'DAMAGECOUNT': '1.095', 'weapon2': '1.582', 'weapon3': '1.706', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:49,814][52811] DAMAGECOUNT value on done: 3409.0 [2024-08-05 22:10:49,815][52811] Sum rewards: 5.825, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.080', 'HEALTH': '0.303', 'ARMOR': '0.424', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.473', 'weapon3': '1.710', 'weapon2': '1.960', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:50,679][52668] DAMAGECOUNT value on done: 5578.0 [2024-08-05 22:10:50,682][52668] Sum rewards: 2.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.272', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.124', 'ARMOR': '0.509', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon2': '1.476', 'weapon3': '1.936', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:50,881][52803] DAMAGECOUNT value on done: 4894.0 [2024-08-05 22:10:50,882][52803] Sum rewards: 2.163, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.370', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.053', 'ARMOR': '1.244', 'weapon2': '1.824', 'weapon3': '1.874', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:51,368][52820] DAMAGECOUNT value on done: 4333.0 [2024-08-05 22:10:51,370][52820] Sum rewards: 3.671, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.488', 'weapon3': '1.810', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:52,174][52671] DAMAGECOUNT value on done: 3171.0 [2024-08-05 22:10:52,175][52671] Sum rewards: 2.443, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.156', 'HITCOUNT': '0.440', 'WEAPON3': '0.850', 'ARMOR': '0.908', 'weapon2': '1.700', 'DAMAGECOUNT': '1.722', 'weapon3': '2.160', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:52,191][52664] DAMAGECOUNT value on done: 3736.0 [2024-08-05 22:10:52,194][52664] Sum rewards: 4.947, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.588', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'ARMOR': '0.112', 'weapon4': '0.136', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.428', 'weapon2': '1.610', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:52,203][52660] DAMAGECOUNT value on done: 4678.0 [2024-08-05 22:10:52,203][52660] Sum rewards: 1.798, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.022', 'AMMO4': '0.052', 'ARMOR': '0.064', 'weapon4': '0.080', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.416', 'weapon2': '1.420', 'DAMAGECOUNT': '1.506', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:52,645][52795] DAMAGECOUNT value on done: 3822.0 [2024-08-05 22:10:52,645][52795] Sum rewards: 4.522, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.464', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.041', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.275', 'weapon2': '1.374', 'weapon3': '1.698', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:52,808][52567] Fps is (10 sec: 16361.4, 60 sec: 16791.4, 300 sec: 17327.4). Total num frames: 46694400. Throughput: 0: 4216.5. Samples: 11678740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:10:52,808][52567] Avg episode reward: [(0, '3.147')] [2024-08-05 22:10:52,809][52614] Saving new best policy, reward=3.147! [2024-08-05 22:10:52,897][52659] DAMAGECOUNT value on done: 5108.0 [2024-08-05 22:10:52,897][52659] Sum rewards: 1.993, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.592', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.099', 'weapon4': '0.206', 'HITCOUNT': '0.410', 'WEAPON3': '0.700', 'ARMOR': '0.832', 'DAMAGECOUNT': '1.359', 'weapon2': '1.562', 'weapon3': '1.984', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:53,124][52650] Updated weights for policy 0, policy_version 5701 (0.0035) [2024-08-05 22:10:53,195][52811] DAMAGECOUNT value on done: 4228.0 [2024-08-05 22:10:53,195][52811] Sum rewards: 1.911, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.040', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.090', 'ARMOR': '0.096', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.077', 'weapon2': '1.646', 'weapon3': '1.818', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:53,806][52668] DAMAGECOUNT value on done: 3886.0 [2024-08-05 22:10:53,806][52668] Sum rewards: 1.165, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.070', 'AMMO3': '0.113', 'weapon4': '0.128', 'HITCOUNT': '0.280', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.164', 'weapon2': '1.232', 'weapon3': '2.032', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:54,148][52803] DAMAGECOUNT value on done: 3838.0 [2024-08-05 22:10:54,151][52803] Sum rewards: 5.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.370', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'weapon5': '0.002', 'AMMO5': '0.015', 'weapon4': '0.024', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '1.043', 'weapon3': '1.564', 'weapon2': '2.000', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:54,850][52820] DAMAGECOUNT value on done: 3284.0 [2024-08-05 22:10:54,851][52820] Sum rewards: 2.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.450', 'AMMO2': '0.001', 'AMMO4': '0.005', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.161', 'HITCOUNT': '0.460', 'WEAPON3': '1.100', 'weapon2': '1.716', 'DAMAGECOUNT': '1.722', 'weapon3': '1.984', 'FRAGCOUNT': '7.000'} [2024-08-05 22:10:55,111][52664] DAMAGECOUNT value on done: 3651.0 [2024-08-05 22:10:55,111][52664] Sum rewards: 5.615, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.451', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'weapon5': '0.276', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.943', 'weapon3': '1.478', 'DAMAGECOUNT': '1.626', 'weapon2': '1.842', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:55,161][52671] DAMAGECOUNT value on done: 3934.0 [2024-08-05 22:10:55,161][52671] Sum rewards: 0.436, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.881', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'AMMO3': '0.093', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.828', 'FRAGCOUNT': '1.000', 'weapon3': '1.608', 'weapon2': '1.730'} [2024-08-05 22:10:55,325][52660] DAMAGECOUNT value on done: 3989.0 [2024-08-05 22:10:55,326][52660] Sum rewards: 2.208, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.642', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.117', 'weapon5': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.820', 'DAMAGECOUNT': '1.260', 'weapon2': '1.494', 'weapon3': '1.812', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:55,386][52794] DAMAGECOUNT value on done: 4360.0 [2024-08-05 22:10:55,386][52794] Sum rewards: 8.476, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.758', 'AMMO5': '0.005', 'weapon4': '0.006', 'weapon5': '0.018', 'AMMO2': '0.026', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.130', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon3': '1.830', 'weapon2': '1.914', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '8.000'} [2024-08-05 22:10:55,660][52659] DAMAGECOUNT value on done: 5015.0 [2024-08-05 22:10:55,662][52659] Sum rewards: 7.736, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.291', 'AMMO5': '0.003', 'AMMO2': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon2': '1.298', 'weapon3': '1.324', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2024-08-05 22:10:56,163][52795] DAMAGECOUNT value on done: 3940.0 [2024-08-05 22:10:56,165][52795] Sum rewards: 3.274, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.685', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'weapon5': '0.128', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HITCOUNT': '0.430', 'weapon4': '0.446', 'WEAPON3': '0.550', 'ARMOR': '1.031', 'DAMAGECOUNT': '1.272', 'weapon3': '1.324', 'weapon2': '1.350', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:56,388][52811] DAMAGECOUNT value on done: 3692.0 [2024-08-05 22:10:56,391][52811] Sum rewards: 1.165, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.651', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.117', 'weapon4': '0.150', 'HITCOUNT': '0.280', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.828', 'ARMOR': '0.916', 'FRAGCOUNT': '1.000', 'weapon3': '1.460', 'weapon2': '1.570'} [2024-08-05 22:10:56,772][52668] DAMAGECOUNT value on done: 4265.0 [2024-08-05 22:10:56,774][52668] Sum rewards: 4.345, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.814', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO3': '0.062', 'AMMO4': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'ARMOR': '0.512', 'HITCOUNT': '0.520', 'weapon3': '1.352', 'weapon2': '1.472', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:57,466][52664] DAMAGECOUNT value on done: 5052.0 [2024-08-05 22:10:57,467][52664] Sum rewards: 5.613, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.194', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.078', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'ARMOR': '0.858', 'weapon3': '1.146', 'DAMAGECOUNT': '1.455', 'weapon2': '1.910', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:57,794][52567] Fps is (10 sec: 15564.7, 60 sec: 16657.1, 300 sec: 17328.2). Total num frames: 46776320. Throughput: 0: 4215.1. Samples: 11704300. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:10:57,794][52567] Avg episode reward: [(0, '3.187')] [2024-08-05 22:10:57,834][52614] Saving new best policy, reward=3.187! [2024-08-05 22:10:57,837][52650] Updated weights for policy 0, policy_version 5711 (0.0031) [2024-08-05 22:10:58,016][52794] DAMAGECOUNT value on done: 4215.0 [2024-08-05 22:10:58,017][52794] Sum rewards: 1.496, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.104', 'AMMO3': '0.127', 'HITCOUNT': '0.250', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.816', 'weapon2': '1.436', 'weapon3': '1.902', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:58,112][52820] DAMAGECOUNT value on done: 5463.0 [2024-08-05 22:10:58,112][52820] Sum rewards: 5.028, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.450', 'AMMO2': '0.035', 'weapon7': '0.052', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.128', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.312', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon2': '0.970', 'weapon3': '1.426', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '3.000'} [2024-08-05 22:10:58,234][52671] DAMAGECOUNT value on done: 5059.0 [2024-08-05 22:10:58,234][52671] Sum rewards: 1.469, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.730', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.113', 'ARMOR': '0.432', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.544', 'weapon3': '1.588', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:58,389][52660] DAMAGECOUNT value on done: 3473.0 [2024-08-05 22:10:58,389][52660] Sum rewards: 2.322, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.585', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.088', 'HITCOUNT': '0.430', 'ARMOR': '0.471', 'WEAPON3': '0.550', 'weapon3': '1.244', 'DAMAGECOUNT': '1.266', 'weapon2': '1.326', 'FRAGCOUNT': '2.000'} [2024-08-05 22:10:58,811][52659] DAMAGECOUNT value on done: 4709.0 [2024-08-05 22:10:58,814][52659] Sum rewards: 0.740, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.795', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.171', 'ARMOR': '0.472', 'HITCOUNT': '0.590', 'WEAPON3': '1.050', 'weapon2': '1.372', 'DAMAGECOUNT': '1.932', 'weapon3': '2.390', 'FRAGCOUNT': '4.000'} [2024-08-05 22:10:58,836][52662] DAMAGECOUNT value on done: 4436.0 [2024-08-05 22:10:58,836][52662] Sum rewards: -0.507, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.440', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon5': '0.438', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.320', 'weapon2': '1.462', 'weapon3': '1.774'} [2024-08-05 22:10:59,399][52795] DAMAGECOUNT value on done: 3906.0 [2024-08-05 22:10:59,400][52795] Sum rewards: 2.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.286', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'HITCOUNT': '0.440', 'ARMOR': '0.892', 'weapon2': '0.978', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.590', 'weapon3': '2.596', 'FRAGCOUNT': '5.000'} [2024-08-05 22:10:59,850][52668] DAMAGECOUNT value on done: 5180.0 [2024-08-05 22:10:59,853][52668] Sum rewards: -1.170, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.622', 'AMMO2': '0.005', 'weapon4': '0.008', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.133', 'HITCOUNT': '0.450', 'ARMOR': '0.508', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.458', 'weapon2': '1.460', 'FRAGCOUNT': '2.000', 'weapon3': '2.354'} [2024-08-05 22:11:00,972][52794] DAMAGECOUNT value on done: 5315.0 [2024-08-05 22:11:00,973][52794] Sum rewards: 10.409, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.874', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.063', 'AMMO3': '0.064', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.202', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.300', 'weapon2': '1.500', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '8.000'} [2024-08-05 22:11:01,302][52660] DAMAGECOUNT value on done: 4466.0 [2024-08-05 22:11:01,304][52660] Sum rewards: 0.405, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.284', 'HITCOUNT': '0.430', 'ARMOR': '0.568', 'WEAPON3': '0.650', 'weapon2': '1.300', 'DAMAGECOUNT': '1.485', 'weapon3': '1.686', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:01,479][52820] DAMAGECOUNT value on done: 3586.0 [2024-08-05 22:11:01,480][52820] Sum rewards: 6.782, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.014', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO3': '0.083', 'AMMO4': '0.095', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.818', 'weapon3': '1.340', 'DAMAGECOUNT': '1.572', 'weapon2': '2.178', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:01,619][52671] DAMAGECOUNT value on done: 3561.0 [2024-08-05 22:11:01,623][52671] Sum rewards: -2.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.181', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.230', 'ARMOR': '0.524', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.783', 'FRAGCOUNT': '1.000', 'weapon3': '1.408', 'weapon2': '1.720'} [2024-08-05 22:11:01,699][52662] DAMAGECOUNT value on done: 4403.0 [2024-08-05 22:11:01,700][52662] Sum rewards: 5.388, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.236', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon7': '0.056', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.940', 'weapon3': '1.332', 'weapon2': '1.494', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:02,216][52659] DAMAGECOUNT value on done: 3606.0 [2024-08-05 22:11:02,218][52659] Sum rewards: 0.208, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.082', 'HITCOUNT': '0.270', 'ARMOR': '0.504', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'weapon2': '1.562', 'weapon3': '1.874'} [2024-08-05 22:11:02,657][52795] DAMAGECOUNT value on done: 4140.0 [2024-08-05 22:11:02,657][52795] Sum rewards: -3.683, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.835', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.042', 'WEAPON4': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'ARMOR': '0.515', 'HITCOUNT': '0.600', 'WEAPON3': '1.300', 'weapon2': '1.680', 'weapon3': '1.832', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.001'} [2024-08-05 22:11:02,706][52650] Updated weights for policy 0, policy_version 5721 (0.0013) [2024-08-05 22:11:02,770][52668] DAMAGECOUNT value on done: 3794.0 [2024-08-05 22:11:02,771][52668] Sum rewards: 4.290, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.250', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.097', 'ARMOR': '0.508', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.624', 'DAMAGECOUNT': '1.929', 'weapon3': '1.972', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:02,794][52567] Fps is (10 sec: 17227.0, 60 sec: 16930.1, 300 sec: 17383.7). Total num frames: 46866432. Throughput: 0: 4202.5. Samples: 11716390. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:11:02,794][52567] Avg episode reward: [(0, '3.082')] [2024-08-05 22:11:02,874][52614] Signal inference workers to stop experience collection... (1100 times) [2024-08-05 22:11:02,874][52614] Signal inference workers to resume experience collection... (1100 times) [2024-08-05 22:11:02,960][52650] InferenceWorker_p0-w0: stopping experience collection (1100 times) [2024-08-05 22:11:02,961][52650] InferenceWorker_p0-w0: resuming experience collection (1100 times) [2024-08-05 22:11:03,585][52794] DAMAGECOUNT value on done: 4883.0 [2024-08-05 22:11:03,590][52794] Sum rewards: 4.246, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.528', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'WEAPON1': '0.010', 'AMMO3': '0.118', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'ARMOR': '0.890', 'weapon2': '1.500', 'weapon3': '1.914', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:04,514][52662] DAMAGECOUNT value on done: 4537.0 [2024-08-05 22:11:04,514][52662] Sum rewards: 0.920, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.612', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.131', 'weapon5': '0.146', 'WEAPON4': '0.150', 'HITCOUNT': '0.420', 'ARMOR': '0.552', 'WEAPON3': '0.950', 'weapon2': '1.386', 'DAMAGECOUNT': '1.425', 'weapon3': '2.096', 'FRAGCOUNT': '2.500'} [2024-08-05 22:11:04,579][52660] DAMAGECOUNT value on done: 3501.0 [2024-08-05 22:11:04,580][52660] Sum rewards: 4.926, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.250', 'ARMOR': '0.466', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.278', 'weapon3': '2.152', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '7.000'} [2024-08-05 22:11:04,601][52671] DAMAGECOUNT value on done: 4409.0 [2024-08-05 22:11:04,601][52671] Sum rewards: 2.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.790', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.162', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.376', 'DAMAGECOUNT': '1.815', 'weapon3': '1.938', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:04,872][52820] DAMAGECOUNT value on done: 4283.0 [2024-08-05 22:11:04,873][52820] Sum rewards: 4.468, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.088', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'HEALTH': '0.126', 'weapon5': '0.300', 'ARMOR': '0.400', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.335', 'weapon2': '1.588', 'weapon3': '1.690', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:05,321][52659] DAMAGECOUNT value on done: 4185.0 [2024-08-05 22:11:05,322][52659] Sum rewards: 1.535, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.370', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.022', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.044', 'weapon3': '1.396', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '2.000'} [2024-08-05 22:11:05,989][52794] DAMAGECOUNT value on done: 4437.0 [2024-08-05 22:11:06,007][52795] DAMAGECOUNT value on done: 3572.0 [2024-08-05 22:11:06,007][52795] Sum rewards: 5.421, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.080', 'weapon5': '0.110', 'WEAPON5': '0.200', 'weapon4': '0.208', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'ARMOR': '0.994', 'DAMAGECOUNT': '1.374', 'weapon2': '1.434', 'weapon3': '1.768', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:06,138][52668] DAMAGECOUNT value on done: 3624.0 [2024-08-05 22:11:06,141][52668] Sum rewards: 2.546, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.142', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.090', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'ARMOR': '0.916', 'DAMAGECOUNT': '1.479', 'weapon2': '1.482', 'weapon3': '1.682', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:06,622][52662] DAMAGECOUNT value on done: 3921.0 [2024-08-05 22:11:06,623][52662] Sum rewards: 2.995, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'weapon4': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.130', 'HITCOUNT': '0.540', 'WEAPON3': '0.900', 'ARMOR': '0.919', 'weapon2': '1.440', 'DAMAGECOUNT': '1.590', 'weapon3': '2.052', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:07,248][52650] Updated weights for policy 0, policy_version 5731 (0.0025) [2024-08-05 22:11:07,402][52660] DAMAGECOUNT value on done: 4644.0 [2024-08-05 22:11:07,403][52660] Sum rewards: 5.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.429', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon5': '0.388', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'weapon2': '1.590', 'weapon3': '1.726', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '7.000'} [2024-08-05 22:11:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16930.2, 300 sec: 17494.8). Total num frames: 46956544. Throughput: 0: 4213.6. Samples: 11741930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:11:07,794][52567] Avg episode reward: [(0, '3.247')] [2024-08-05 22:11:07,797][52614] Saving new best policy, reward=3.247! [2024-08-05 22:11:08,166][52820] DAMAGECOUNT value on done: 3923.0 [2024-08-05 22:11:08,169][52820] Sum rewards: 3.435, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.856', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.078', 'HITCOUNT': '0.460', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'weapon3': '1.464', 'DAMAGECOUNT': '1.611', 'weapon2': '1.636', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:08,251][52659] DAMAGECOUNT value on done: 3096.0 [2024-08-05 22:11:08,254][52659] Sum rewards: -2.631, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.376', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'ARMOR': '0.084', 'AMMO4': '0.120', 'AMMO3': '0.135', 'HITCOUNT': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.328', 'DAMAGECOUNT': '0.579', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.262', 'weapon3': '1.950'} [2024-08-05 22:11:08,530][52794] DAMAGECOUNT value on done: 4797.0 [2024-08-05 22:11:08,531][52794] Sum rewards: 1.709, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.008', 'weapon4': '0.014', 'AMMO4': '0.023', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'HEALTH': '0.145', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon2': '0.856', 'DAMAGECOUNT': '1.365', 'weapon3': '1.392', 'FRAGCOUNT': '2.000'} [2024-08-05 22:11:09,222][52668] DAMAGECOUNT value on done: 3699.0 [2024-08-05 22:11:09,222][52668] Sum rewards: 5.435, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.146', 'AMMO4': '0.157', 'weapon4': '0.210', 'HEALTH': '0.296', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'ARMOR': '0.576', 'DAMAGECOUNT': '1.005', 'weapon3': '1.168', 'weapon2': '1.710', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:09,253][52662] DAMAGECOUNT value on done: 4302.0 [2024-08-05 22:11:09,256][52662] Sum rewards: 2.840, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.836', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO3': '0.042', 'AMMO4': '0.068', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.468', 'ARMOR': '0.911', 'weapon3': '0.912', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '1.000', 'weapon2': '1.676'} [2024-08-05 22:11:10,391][52660] DAMAGECOUNT value on done: 4021.0 [2024-08-05 22:11:10,391][52660] Sum rewards: 0.305, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.778', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.158', 'HITCOUNT': '0.480', 'WEAPON3': '1.000', 'ARMOR': '1.268', 'weapon2': '1.616', 'DAMAGECOUNT': '1.659', 'weapon3': '2.286', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:11,034][52794] DAMAGECOUNT value on done: 4134.0 [2024-08-05 22:11:11,036][52794] Sum rewards: 4.663, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.417', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO3': '0.080', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'HITCOUNT': '0.390', 'ARMOR': '0.508', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.332', 'weapon3': '1.622', 'weapon2': '2.000', 'FRAGCOUNT': '3.500'} [2024-08-05 22:11:11,129][52659] DAMAGECOUNT value on done: 4364.0 [2024-08-05 22:11:11,131][52659] Sum rewards: 5.376, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.396', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.082', 'ARMOR': '0.530', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon3': '1.240', 'weapon2': '1.610', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:11,399][52820] DAMAGECOUNT value on done: 4519.0 [2024-08-05 22:11:11,400][52820] Sum rewards: 5.751, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'ARMOR': '0.885', 'weapon2': '1.596', 'weapon3': '1.600', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:11,758][52668] DAMAGECOUNT value on done: 4728.0 [2024-08-05 22:11:11,758][52668] Sum rewards: 6.706, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.468', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.123', 'ARMOR': '0.549', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon3': '1.816', 'weapon2': '2.010', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '8.000'} [2024-08-05 22:11:11,896][52662] DAMAGECOUNT value on done: 4804.0 [2024-08-05 22:11:11,897][52662] Sum rewards: 1.391, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO4': '0.047', 'AMMO3': '0.088', 'HITCOUNT': '0.270', 'HEALTH': '0.320', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.765', 'FRAGCOUNT': '1.000', 'weapon3': '1.384', 'weapon2': '1.542'} [2024-08-05 22:11:12,224][52650] Updated weights for policy 0, policy_version 5741 (0.0022) [2024-08-05 22:11:12,794][52567] Fps is (10 sec: 17202.6, 60 sec: 16930.1, 300 sec: 17522.5). Total num frames: 47038464. Throughput: 0: 4210.2. Samples: 11767270. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 22:11:12,795][52567] Avg episode reward: [(0, '3.260')] [2024-08-05 22:11:12,795][52614] Saving new best policy, reward=3.260! [2024-08-05 22:11:12,936][52660] DAMAGECOUNT value on done: 3851.0 [2024-08-05 22:11:12,937][52660] Sum rewards: 1.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'AMMO2': '0.011', 'ARMOR': '0.028', 'AMMO4': '0.053', 'weapon4': '0.066', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon2': '1.292', 'weapon3': '1.330', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:13,464][52794] DAMAGECOUNT value on done: 3842.0 [2024-08-05 22:11:13,464][52794] Sum rewards: 4.271, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON3': '0.200', 'HITCOUNT': '0.220', 'HEALTH': '0.277', 'ARMOR': '0.437', 'DAMAGECOUNT': '0.660', 'weapon3': '1.218', 'weapon2': '1.340', 'FRAGCOUNT': '2.000'} [2024-08-05 22:11:13,947][52668] DAMAGECOUNT value on done: 4061.0 [2024-08-05 22:11:13,947][52668] Sum rewards: 2.991, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.119', 'HITCOUNT': '0.300', 'ARMOR': '0.400', 'HEALTH': '0.476', 'WEAPON3': '0.650', 'weapon2': '1.244', 'DAMAGECOUNT': '1.290', 'weapon3': '2.170', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:14,500][52662] DAMAGECOUNT value on done: 5913.0 [2024-08-05 22:11:14,502][52662] Sum rewards: 6.831, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.016', 'HEALTH': '0.023', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.304', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.434', 'weapon3': '1.896', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '6.000'} [2024-08-05 22:11:14,837][52820] DAMAGECOUNT value on done: 4277.0 [2024-08-05 22:11:14,839][52820] Sum rewards: 2.213, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.227', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.190', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.672', 'ARMOR': '0.907', 'weapon3': '1.116', 'weapon2': '1.286', 'FRAGCOUNT': '2.000'} [2024-08-05 22:11:15,102][52660] DAMAGECOUNT value on done: 4202.0 [2024-08-05 22:11:15,104][52660] Sum rewards: 1.995, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'ARMOR': '0.428', 'HITCOUNT': '0.450', 'weapon5': '0.706', 'WEAPON3': '0.850', 'weapon2': '1.276', 'DAMAGECOUNT': '1.485', 'weapon3': '1.794', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:16,348][52794] DAMAGECOUNT value on done: 5184.0 [2024-08-05 22:11:16,348][52794] Sum rewards: 2.905, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.118', 'HEALTH': '0.326', 'HITCOUNT': '0.360', 'ARMOR': '0.506', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.263', 'weapon3': '1.528', 'weapon2': '1.570', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:16,603][52668] DAMAGECOUNT value on done: 4266.0 [2024-08-05 22:11:16,604][52668] Sum rewards: 2.514, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.052', 'AMMO3': '0.123', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.458', 'DAMAGECOUNT': '1.704', 'weapon3': '2.280', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:16,968][52650] Updated weights for policy 0, policy_version 5751 (0.0011) [2024-08-05 22:11:17,151][52662] DAMAGECOUNT value on done: 5373.0 [2024-08-05 22:11:17,155][52662] Sum rewards: 3.743, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'ARMOR': '0.428', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.218', 'weapon3': '1.390', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 17494.8). Total num frames: 47120384. Throughput: 0: 4218.4. Samples: 11779940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:11:17,794][52567] Avg episode reward: [(0, '3.142')] [2024-08-05 22:11:17,808][52660] DAMAGECOUNT value on done: 4306.0 [2024-08-05 22:11:17,810][52660] Sum rewards: 2.479, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.592', 'AMMO4': '-0.078', 'AMMO2': '-0.015', 'WEAPON1': '0.010', 'AMMO3': '0.080', 'HITCOUNT': '0.340', 'WEAPON3': '0.700', 'ARMOR': '0.920', 'DAMAGECOUNT': '1.008', 'weapon3': '1.406', 'weapon2': '1.950', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:18,175][52820] DAMAGECOUNT value on done: 3818.0 [2024-08-05 22:11:18,183][52820] Sum rewards: 5.642, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.119', 'HEALTH': '0.162', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'ARMOR': '0.909', 'weapon2': '1.328', 'DAMAGECOUNT': '1.836', 'weapon3': '2.314', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:18,750][52794] DAMAGECOUNT value on done: 4266.0 [2024-08-05 22:11:18,751][52794] Sum rewards: 4.518, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.262', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.479', 'weapon3': '1.150', 'DAMAGECOUNT': '1.251', 'weapon2': '1.636', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:19,200][52668] DAMAGECOUNT value on done: 4171.0 [2024-08-05 22:11:19,201][52668] Sum rewards: 6.619, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.556', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.040', 'weapon7': '0.048', 'AMMO3': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon2': '0.974', 'weapon3': '1.106', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '6.000'} [2024-08-05 22:11:19,608][52662] DAMAGECOUNT value on done: 5214.0 [2024-08-05 22:11:19,609][52662] Sum rewards: 3.949, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.342', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.133', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'ARMOR': '0.868', 'weapon2': '1.622', 'DAMAGECOUNT': '1.920', 'weapon3': '1.968', 'FRAGCOUNT': '6.000'} [2024-08-05 22:11:20,416][52660] DAMAGECOUNT value on done: 3941.0 [2024-08-05 22:11:20,417][52660] Sum rewards: 2.769, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.955', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon4': '0.114', 'ARMOR': '0.120', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.362', 'weapon2': '1.456', 'weapon3': '1.474', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:21,331][52794] DAMAGECOUNT value on done: 4441.0 [2024-08-05 22:11:21,331][52794] Sum rewards: 3.653, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.498', 'AMMO2': '0.032', 'AMMO3': '0.092', 'AMMO4': '0.160', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'weapon4': '0.448', 'ARMOR': '0.529', 'WEAPON3': '0.550', 'weapon3': '1.120', 'DAMAGECOUNT': '1.245', 'weapon2': '1.564', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:21,511][52820] DAMAGECOUNT value on done: 3657.0 [2024-08-05 22:11:21,511][52820] Sum rewards: 8.845, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.632', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'ARMOR': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.144', 'HITCOUNT': '0.850', 'WEAPON3': '0.950', 'weapon2': '1.364', 'weapon3': '2.222', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '9.000'} [2024-08-05 22:11:21,779][52650] Updated weights for policy 0, policy_version 5761 (0.0026) [2024-08-05 22:11:21,858][52668] DAMAGECOUNT value on done: 4558.0 [2024-08-05 22:11:21,860][52668] Sum rewards: 5.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.166', 'ARMOR': '0.465', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.720', 'DAMAGECOUNT': '1.725', 'weapon2': '1.726', 'FRAGCOUNT': '6.000'} [2024-08-05 22:11:22,384][52662] DAMAGECOUNT value on done: 4384.0 [2024-08-05 22:11:22,385][52662] Sum rewards: 2.638, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.063', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.164', 'weapon2': '1.210', 'weapon3': '1.386', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:22,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16793.6, 300 sec: 17467.0). Total num frames: 47202304. Throughput: 0: 4227.6. Samples: 11805720. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 22:11:22,795][52567] Avg episode reward: [(0, '3.248')] [2024-08-05 22:11:23,655][52660] DAMAGECOUNT value on done: 4240.0 [2024-08-05 22:11:23,657][52660] Sum rewards: 8.695, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.245', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.021', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon3': '1.364', 'weapon2': '1.878', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '7.000'} [2024-08-05 22:11:24,085][52794] DAMAGECOUNT value on done: 5215.0 [2024-08-05 22:11:24,086][52794] Sum rewards: 8.126, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.989', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.188', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'ARMOR': '0.897', 'weapon3': '1.212', 'weapon2': '1.742', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '6.000'} [2024-08-05 22:11:24,788][52820] DAMAGECOUNT value on done: 3007.0 [2024-08-05 22:11:24,788][52820] Sum rewards: 1.830, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.280', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'HITCOUNT': '0.210', 'WEAPON3': '0.250', 'DAMAGECOUNT': '0.645', 'weapon3': '0.700', 'ARMOR': '0.948', 'FRAGCOUNT': '1.000', 'weapon2': '1.214'} [2024-08-05 22:11:24,887][52662] DAMAGECOUNT value on done: 4653.0 [2024-08-05 22:11:24,888][52662] Sum rewards: 2.444, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.587', 'AMMO5': '0.007', 'weapon4': '0.012', 'weapon5': '0.020', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'HITCOUNT': '0.370', 'WEAPON3': '1.050', 'ARMOR': '1.353', 'DAMAGECOUNT': '1.560', 'weapon2': '1.764', 'weapon3': '2.016', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:25,049][52668] DAMAGECOUNT value on done: 3540.0 [2024-08-05 22:11:25,052][52668] Sum rewards: 3.676, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.622', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'weapon5': '0.044', 'AMMO3': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.260', 'ARMOR': '0.476', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.246', 'weapon3': '1.592', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:26,327][52794] DAMAGECOUNT value on done: 4208.0 [2024-08-05 22:11:26,328][52794] Sum rewards: 1.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.088', 'AMMO3': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.188', 'HITCOUNT': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.843', 'weapon3': '1.416', 'weapon2': '1.770', 'FRAGCOUNT': '2.000'} [2024-08-05 22:11:26,528][52650] Updated weights for policy 0, policy_version 5771 (0.0030) [2024-08-05 22:11:26,892][52660] DAMAGECOUNT value on done: 4331.0 [2024-08-05 22:11:26,893][52660] Sum rewards: 1.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.416', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'HITCOUNT': '0.580', 'WEAPON3': '0.950', 'ARMOR': '1.054', 'weapon2': '1.428', 'DAMAGECOUNT': '1.863', 'weapon3': '2.342', 'FRAGCOUNT': '3.500'} [2024-08-05 22:11:27,199][52662] DAMAGECOUNT value on done: 3881.0 [2024-08-05 22:11:27,201][52662] Sum rewards: 3.867, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.430', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'HITCOUNT': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.832', 'DAMAGECOUNT': '0.945', 'weapon3': '1.082', 'weapon2': '1.790', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:27,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.5, 300 sec: 17439.2). Total num frames: 47284224. Throughput: 0: 4238.0. Samples: 11831610. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:11:27,795][52567] Avg episode reward: [(0, '3.335')] [2024-08-05 22:11:27,802][52614] Saving new best policy, reward=3.335! [2024-08-05 22:11:28,017][52820] DAMAGECOUNT value on done: 3994.0 [2024-08-05 22:11:28,021][52820] Sum rewards: 5.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.663', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'ARMOR': '1.354', 'DAMAGECOUNT': '1.551', 'weapon2': '1.716', 'weapon3': '1.760', 'FRAGCOUNT': '6.000'} [2024-08-05 22:11:28,208][52668] DAMAGECOUNT value on done: 3608.0 [2024-08-05 22:11:28,208][52668] Sum rewards: 0.682, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'ARMOR': '0.044', 'AMMO4': '0.050', 'AMMO3': '0.108', 'HITCOUNT': '0.370', 'HEALTH': '0.568', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.170', 'weapon2': '1.602', 'weapon3': '1.910'} [2024-08-05 22:11:29,132][52794] DAMAGECOUNT value on done: 5726.0 [2024-08-05 22:11:29,135][52794] Sum rewards: 7.240, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.716', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.110', 'weapon5': '0.222', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.515', 'DAMAGECOUNT': '1.116', 'weapon3': '1.192', 'weapon2': '1.844', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:29,887][52660] DAMAGECOUNT value on done: 3189.0 [2024-08-05 22:11:29,888][52660] Sum rewards: 3.455, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.458', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO3': '0.105', 'HITCOUNT': '0.390', 'ARMOR': '0.492', 'WEAPON3': '0.650', 'weapon3': '1.284', 'DAMAGECOUNT': '1.350', 'weapon2': '1.694', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:30,183][52662] DAMAGECOUNT value on done: 4979.0 [2024-08-05 22:11:30,185][52662] Sum rewards: 4.483, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.613', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.040', 'weapon4': '0.050', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.511', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon3': '1.658', 'weapon2': '1.940', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:31,280][52820] DAMAGECOUNT value on done: 3960.0 [2024-08-05 22:11:31,282][52820] Sum rewards: 4.421, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.958', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon4': '0.174', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'ARMOR': '0.956', 'weapon2': '1.384', 'weapon3': '1.740', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2024-08-05 22:11:31,609][52650] Updated weights for policy 0, policy_version 5781 (0.0028) [2024-08-05 22:11:31,633][52794] DAMAGECOUNT value on done: 5240.0 [2024-08-05 22:11:31,633][52794] Sum rewards: 11.839, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.972', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.884', 'weapon3': '1.504', 'weapon2': '1.618', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.500'} [2024-08-05 22:11:32,573][52662] DAMAGECOUNT value on done: 5260.0 [2024-08-05 22:11:32,573][52662] Sum rewards: 8.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.812', 'weapon4': '0.002', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'ARMOR': '1.292', 'weapon2': '1.644', 'weapon3': '1.834', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '9.000'} [2024-08-05 22:11:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 16930.1, 300 sec: 17494.8). Total num frames: 47382528. Throughput: 0: 4228.2. Samples: 11843960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:11:32,794][52567] Avg episode reward: [(0, '3.564')] [2024-08-05 22:11:32,795][52614] Saving new best policy, reward=3.564! [2024-08-05 22:11:32,824][52660] DAMAGECOUNT value on done: 5296.0 [2024-08-05 22:11:32,827][52660] Sum rewards: 1.838, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.542', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.031', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.155', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'weapon2': '1.612', 'weapon3': '1.650', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:34,089][52794] DAMAGECOUNT value on done: 5246.0 [2024-08-05 22:11:34,090][52794] Sum rewards: 5.511, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.293', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO3': '0.118', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.368', 'weapon3': '1.752', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:34,577][52820] DAMAGECOUNT value on done: 3684.0 [2024-08-05 22:11:34,581][52820] Sum rewards: 2.892, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.096', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '0.892', 'FRAGCOUNT': '1.000', 'weapon3': '1.348', 'weapon2': '1.690', 'DAMAGECOUNT': '2.007'} [2024-08-05 22:11:34,918][52662] DAMAGECOUNT value on done: 4739.0 [2024-08-05 22:11:34,918][52662] Sum rewards: 5.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.188', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'ARMOR': '0.942', 'weapon3': '1.824', 'weapon2': '1.830', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:36,435][52794] DAMAGECOUNT value on done: 5017.0 [2024-08-05 22:11:36,435][52794] Sum rewards: 2.302, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.166', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'ARMOR': '0.941', 'DAMAGECOUNT': '1.170', 'weapon3': '1.774', 'weapon2': '2.042', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:36,451][52650] Updated weights for policy 0, policy_version 5791 (0.0022) [2024-08-05 22:11:37,543][52662] DAMAGECOUNT value on done: 5198.0 [2024-08-05 22:11:37,544][52662] Sum rewards: 2.146, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.226', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.092', 'weapon4': '0.228', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.554', 'weapon2': '1.350', 'DAMAGECOUNT': '1.452', 'weapon3': '1.500', 'FRAGCOUNT': '2.000'} [2024-08-05 22:11:37,778][52820] DAMAGECOUNT value on done: 3672.0 [2024-08-05 22:11:37,780][52820] Sum rewards: 3.948, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.363', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.428', 'weapon3': '1.534', 'weapon2': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16793.6, 300 sec: 17439.2). Total num frames: 47456256. Throughput: 0: 4233.3. Samples: 11869180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:11:37,795][52567] Avg episode reward: [(0, '3.511')] [2024-08-05 22:11:39,424][52794] DAMAGECOUNT value on done: 5372.0 [2024-08-05 22:11:39,425][52794] Sum rewards: -2.038, reward structure: {'DEATHCOUNT': '-5.250', 'FRAGCOUNT': '-1.500', 'HEALTH': '-0.629', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.036', 'weapon4': '0.052', 'ARMOR': '0.078', 'AMMO4': '0.082', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.732', 'weapon2': '1.490', 'weapon3': '1.614'} [2024-08-05 22:11:40,419][52662] DAMAGECOUNT value on done: 3956.0 [2024-08-05 22:11:40,421][52662] Sum rewards: 3.771, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.134', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.244', 'HITCOUNT': '0.360', 'WEAPON3': '0.400', 'weapon2': '0.692', 'ARMOR': '0.828', 'DAMAGECOUNT': '0.927', 'weapon3': '1.010', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:40,994][52650] Updated weights for policy 0, policy_version 5801 (0.0015) [2024-08-05 22:11:41,060][52820] DAMAGECOUNT value on done: 4337.0 [2024-08-05 22:11:41,061][52820] Sum rewards: 1.764, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.042', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'weapon5': '0.096', 'AMMO3': '0.116', 'HITCOUNT': '0.330', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.434', 'weapon2': '1.674', 'weapon3': '1.922', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:41,958][52794] DAMAGECOUNT value on done: 4946.0 [2024-08-05 22:11:41,958][52794] Sum rewards: 9.236, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.362', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'ARMOR': '0.030', 'weapon4': '0.054', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.268', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon2': '1.406', 'weapon3': '1.916', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '7.000'} [2024-08-05 22:11:42,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 17439.2). Total num frames: 47554560. Throughput: 0: 4237.8. Samples: 11895000. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 22:11:42,795][52567] Avg episode reward: [(0, '3.526')] [2024-08-05 22:11:42,880][52662] DAMAGECOUNT value on done: 5157.0 [2024-08-05 22:11:42,881][52662] Sum rewards: 5.740, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.080', 'HEALTH': '0.152', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.110', 'weapon2': '1.464', 'weapon3': '1.728', 'FRAGCOUNT': '4.000'} [2024-08-05 22:11:44,327][52794] DAMAGECOUNT value on done: 4956.0 [2024-08-05 22:11:44,327][52794] Sum rewards: 4.605, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.231', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO3': '0.060', 'ARMOR': '0.088', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'weapon3': '1.374', 'DAMAGECOUNT': '1.434', 'weapon2': '1.794', 'FRAGCOUNT': '3.000'} [2024-08-05 22:11:44,411][52820] DAMAGECOUNT value on done: 4079.0 [2024-08-05 22:11:44,413][52820] Sum rewards: 1.793, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'weapon4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'HITCOUNT': '0.320', 'weapon5': '0.394', 'WEAPON3': '0.450', 'ARMOR': '0.922', 'DAMAGECOUNT': '0.981', 'FRAGCOUNT': '1.000', 'weapon3': '1.220', 'weapon2': '1.700'} [2024-08-05 22:11:45,301][52662] DAMAGECOUNT value on done: 4359.0 [2024-08-05 22:11:45,302][52662] Sum rewards: -2.550, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.463', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.046', 'AMMO3': '0.133', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'weapon4': '0.556', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.885', 'ARMOR': '0.900', 'weapon2': '1.060', 'weapon3': '1.948', 'FRAGCOUNT': '2.000'} [2024-08-05 22:11:45,633][52650] Updated weights for policy 0, policy_version 5811 (0.0012) [2024-08-05 22:11:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16793.5, 300 sec: 17411.5). Total num frames: 47628288. Throughput: 0: 4257.5. Samples: 11907980. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 22:11:47,795][52567] Avg episode reward: [(0, '3.513')] [2024-08-05 22:11:48,414][52662] DAMAGECOUNT value on done: 4499.0 [2024-08-05 22:11:48,415][52662] Sum rewards: 5.046, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.130', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO3': '0.106', 'HITCOUNT': '0.430', 'ARMOR': '0.484', 'WEAPON3': '0.700', 'weapon2': '1.502', 'DAMAGECOUNT': '1.770', 'weapon3': '1.958', 'FRAGCOUNT': '5.000'} [2024-08-05 22:11:50,763][52650] Updated weights for policy 0, policy_version 5821 (0.0022) [2024-08-05 22:11:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17070.6, 300 sec: 17411.5). Total num frames: 47718400. Throughput: 0: 4254.9. Samples: 11933400. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:11:52,795][52567] Avg episode reward: [(0, '3.552')] [2024-08-05 22:11:55,617][52650] Updated weights for policy 0, policy_version 5831 (0.0016) [2024-08-05 22:11:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17066.7, 300 sec: 17383.7). Total num frames: 47800320. Throughput: 0: 4235.4. Samples: 11957860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:11:57,795][52567] Avg episode reward: [(0, '3.552')] [2024-08-05 22:12:00,729][52650] Updated weights for policy 0, policy_version 5841 (0.0012) [2024-08-05 22:12:02,327][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 22:12:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16930.1, 300 sec: 17355.9). Total num frames: 47882240. Throughput: 0: 4226.4. Samples: 11970130. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:12:02,794][52567] Avg episode reward: [(0, '3.552')] [2024-08-05 22:12:05,522][52650] Updated weights for policy 0, policy_version 5851 (0.0013) [2024-08-05 22:12:07,794][52567] Fps is (10 sec: 15564.8, 60 sec: 16657.1, 300 sec: 17328.2). Total num frames: 47955968. Throughput: 0: 4189.8. Samples: 11994260. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-05 22:12:07,802][52567] Avg episode reward: [(0, '3.552')] [2024-08-05 22:12:09,870][52666] DAMAGECOUNT value on done: 3571.0 [2024-08-05 22:12:09,878][52666] Sum rewards: -0.196, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'ARMOR': '0.493', 'HITCOUNT': '0.640', 'WEAPON3': '1.150', 'weapon2': '1.326', 'DAMAGECOUNT': '1.821', 'weapon3': '2.468', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:11,187][52650] Updated weights for policy 0, policy_version 5861 (0.0013) [2024-08-05 22:12:12,543][52670] DAMAGECOUNT value on done: 4618.0 [2024-08-05 22:12:12,545][52670] Sum rewards: 5.209, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.120', 'HEALTH': '0.331', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'ARMOR': '0.919', 'weapon2': '1.644', 'weapon3': '1.946', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 17300.4). Total num frames: 48046080. Throughput: 0: 4170.7. Samples: 12019290. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-05 22:12:12,794][52567] Avg episode reward: [(0, '3.525')] [2024-08-05 22:12:13,166][52666] DAMAGECOUNT value on done: 4554.0 [2024-08-05 22:12:13,168][52666] Sum rewards: 2.025, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.408', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'HITCOUNT': '0.200', 'weapon5': '0.380', 'ARMOR': '0.447', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.570', 'weapon3': '1.180', 'weapon2': '1.458', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:15,336][52650] Updated weights for policy 0, policy_version 5871 (0.0020) [2024-08-05 22:12:15,551][52670] DAMAGECOUNT value on done: 4213.0 [2024-08-05 22:12:15,554][52670] Sum rewards: 10.624, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.548', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.060', 'WEAPON3': '0.400', 'ARMOR': '0.485', 'HITCOUNT': '0.700', 'weapon3': '1.392', 'weapon2': '1.526', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '8.000'} [2024-08-05 22:12:16,064][52666] DAMAGECOUNT value on done: 4152.0 [2024-08-05 22:12:16,064][52666] Sum rewards: 0.992, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.036', 'HEALTH': '0.040', 'AMMO4': '0.069', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.250', 'ARMOR': '0.482', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.050', 'weapon2': '1.528', 'FRAGCOUNT': '2.000', 'weapon3': '2.018'} [2024-08-05 22:12:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 17272.6). Total num frames: 48128000. Throughput: 0: 4182.0. Samples: 12032150. Policy #0 lag: (min: 1.0, avg: 2.8, max: 7.0) [2024-08-05 22:12:17,794][52567] Avg episode reward: [(0, '3.579')] [2024-08-05 22:12:17,806][52614] Saving new best policy, reward=3.579! [2024-08-05 22:12:17,882][52669] DAMAGECOUNT value on done: 3570.0 [2024-08-05 22:12:17,883][52669] Sum rewards: 1.987, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'weapon4': '0.422', 'WEAPON3': '0.700', 'weapon2': '1.024', 'DAMAGECOUNT': '1.068', 'weapon3': '1.732', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:18,342][52670] DAMAGECOUNT value on done: 3807.0 [2024-08-05 22:12:18,345][52670] Sum rewards: 2.591, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.080', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.134', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'ARMOR': '0.982', 'DAMAGECOUNT': '1.224', 'weapon2': '1.512', 'weapon3': '1.760', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:19,034][52666] DAMAGECOUNT value on done: 4841.0 [2024-08-05 22:12:19,034][52666] Sum rewards: 10.717, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.192', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.040', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.068', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.356', 'weapon2': '1.428', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '8.000'} [2024-08-05 22:12:20,440][52669] DAMAGECOUNT value on done: 4273.0 [2024-08-05 22:12:20,443][52669] Sum rewards: 3.545, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.144', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.156', 'HITCOUNT': '0.490', 'WEAPON3': '0.950', 'ARMOR': '0.987', 'weapon2': '1.628', 'DAMAGECOUNT': '1.986', 'weapon3': '2.198', 'FRAGCOUNT': '6.000'} [2024-08-05 22:12:20,461][52650] Updated weights for policy 0, policy_version 5881 (0.0023) [2024-08-05 22:12:21,855][52670] DAMAGECOUNT value on done: 4002.0 [2024-08-05 22:12:21,856][52670] Sum rewards: 2.432, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.032', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'ARMOR': '0.444', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon2': '1.258', 'DAMAGECOUNT': '1.944', 'weapon3': '2.128', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:22,373][52666] DAMAGECOUNT value on done: 4032.0 [2024-08-05 22:12:22,373][52666] Sum rewards: 0.757, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.801', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.072', 'ARMOR': '0.080', 'weapon4': '0.124', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.816', 'weapon2': '0.920', 'FRAGCOUNT': '1.000', 'weapon3': '1.192'} [2024-08-05 22:12:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 17272.6). Total num frames: 48218112. Throughput: 0: 4191.1. Samples: 12057780. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:12:22,794][52567] Avg episode reward: [(0, '3.493')] [2024-08-05 22:12:22,849][52669] DAMAGECOUNT value on done: 4461.0 [2024-08-05 22:12:22,849][52669] Sum rewards: 3.677, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.184', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.034', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.154', 'HITCOUNT': '0.780', 'ARMOR': '0.980', 'weapon2': '1.060', 'WEAPON3': '1.100', 'weapon3': '2.322', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:24,869][52670] DAMAGECOUNT value on done: 3187.0 [2024-08-05 22:12:24,871][52670] Sum rewards: -0.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.520', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO3': '0.123', 'HITCOUNT': '0.190', 'ARMOR': '0.484', 'DAMAGECOUNT': '0.621', 'WEAPON3': '0.700', 'weapon3': '1.308', 'weapon2': '1.768', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:25,180][52669] DAMAGECOUNT value on done: 6084.0 [2024-08-05 22:12:25,180][52669] Sum rewards: 4.066, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.810', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.060', 'ARMOR': '0.088', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon3': '1.156', 'DAMAGECOUNT': '1.455', 'weapon2': '1.534', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:25,205][52650] Updated weights for policy 0, policy_version 5891 (0.0012) [2024-08-05 22:12:25,575][52666] DAMAGECOUNT value on done: 4619.0 [2024-08-05 22:12:25,575][52666] Sum rewards: 6.887, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.190', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.072', 'AMMO3': '0.112', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'ARMOR': '0.911', 'weapon2': '1.500', 'weapon3': '1.574', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '7.000'} [2024-08-05 22:12:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 17272.6). Total num frames: 48300032. Throughput: 0: 4183.6. Samples: 12083260. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:12:27,794][52567] Avg episode reward: [(0, '3.532')] [2024-08-05 22:12:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005896_48300032.pth... [2024-08-05 22:12:27,953][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005396_44204032.pth [2024-08-05 22:12:28,111][52670] DAMAGECOUNT value on done: 4057.0 [2024-08-05 22:12:28,113][52670] Sum rewards: 4.414, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.952', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'AMMO3': '0.050', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon5': '0.516', 'DAMAGECOUNT': '0.951', 'ARMOR': '0.953', 'weapon3': '1.210', 'weapon2': '1.860', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:28,549][52669] DAMAGECOUNT value on done: 4325.0 [2024-08-05 22:12:28,549][52669] Sum rewards: 3.129, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.362', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'ARMOR': '0.100', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.506', 'weapon2': '1.526', 'weapon3': '1.980', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:28,862][52666] DAMAGECOUNT value on done: 4023.0 [2024-08-05 22:12:28,866][52666] Sum rewards: 0.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.116', 'AMMO4': '-0.094', 'AMMO2': '-0.019', 'AMMO3': '0.075', 'HITCOUNT': '0.310', 'WEAPON3': '0.700', 'ARMOR': '0.957', 'DAMAGECOUNT': '0.993', 'weapon3': '1.520', 'weapon2': '1.932', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:30,158][52650] Updated weights for policy 0, policy_version 5901 (0.0024) [2024-08-05 22:12:31,252][52665] DAMAGECOUNT value on done: 5253.0 [2024-08-05 22:12:31,254][52665] Sum rewards: 7.315, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.054', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.071', 'weapon4': '0.106', 'WEAPON3': '0.400', 'ARMOR': '0.468', 'HITCOUNT': '0.640', 'weapon3': '1.436', 'weapon2': '1.974', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:31,389][52669] DAMAGECOUNT value on done: 4955.0 [2024-08-05 22:12:31,389][52669] Sum rewards: 5.030, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.410', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.210', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon2': '1.396', 'weapon3': '1.676', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:31,478][52670] DAMAGECOUNT value on done: 3922.0 [2024-08-05 22:12:31,479][52670] Sum rewards: 0.089, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.236', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.112', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'HITCOUNT': '0.250', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.792', 'weapon2': '1.628', 'weapon3': '2.016', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:32,065][52666] DAMAGECOUNT value on done: 4840.0 [2024-08-05 22:12:32,066][52666] Sum rewards: 2.905, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.123', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.144', 'HITCOUNT': '0.440', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.456', 'weapon3': '1.528', 'DAMAGECOUNT': '1.614', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 17217.1). Total num frames: 48381952. Throughput: 0: 4169.4. Samples: 12095600. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-05 22:12:32,794][52567] Avg episode reward: [(0, '3.576')] [2024-08-05 22:12:34,526][52669] DAMAGECOUNT value on done: 5175.0 [2024-08-05 22:12:34,528][52669] Sum rewards: 3.461, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.806', 'weapon4': '0.002', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.136', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'HITCOUNT': '0.520', 'WEAPON3': '1.150', 'weapon2': '1.386', 'DAMAGECOUNT': '1.683', 'weapon3': '2.262', 'FRAGCOUNT': '7.000'} [2024-08-05 22:12:34,530][52670] DAMAGECOUNT value on done: 4209.0 [2024-08-05 22:12:34,530][52670] Sum rewards: 7.933, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.922', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.844', 'weapon2': '1.728', 'weapon3': '2.046', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '8.000'} [2024-08-05 22:12:34,737][52650] Updated weights for policy 0, policy_version 5911 (0.0020) [2024-08-05 22:12:34,823][52665] DAMAGECOUNT value on done: 4515.0 [2024-08-05 22:12:34,825][52665] Sum rewards: 1.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.606', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON1': '0.010', 'AMMO3': '0.124', 'ARMOR': '0.469', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.176', 'weapon3': '1.804', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.310'} [2024-08-05 22:12:35,086][52663] DAMAGECOUNT value on done: 4821.0 [2024-08-05 22:12:35,087][52663] Sum rewards: 2.643, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.470', 'AMMO2': '0.005', 'weapon4': '0.008', 'AMMO5': '0.010', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'HITCOUNT': '0.500', 'ARMOR': '0.929', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.620', 'weapon2': '1.662', 'weapon3': '1.914', 'FRAGCOUNT': '6.000'} [2024-08-05 22:12:35,177][52666] DAMAGECOUNT value on done: 4790.0 [2024-08-05 22:12:35,177][52666] Sum rewards: -1.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'AMMO3': '0.112', 'HITCOUNT': '0.260', 'ARMOR': '0.498', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.975', 'FRAGCOUNT': '1.000', 'weapon2': '1.772', 'weapon3': '2.086'} [2024-08-05 22:12:36,652][52647] DAMAGECOUNT value on done: 4382.0 [2024-08-05 22:12:36,653][52647] Sum rewards: 6.165, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.075', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.097', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'ARMOR': '0.968', 'weapon2': '1.710', 'weapon3': '1.838', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:37,344][52669] DAMAGECOUNT value on done: 4524.0 [2024-08-05 22:12:37,344][52669] Sum rewards: 2.045, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.268', 'AMMO4': '-0.090', 'AMMO2': '-0.018', 'AMMO3': '0.112', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'ARMOR': '1.376', 'weapon3': '1.638', 'weapon2': '1.668', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:37,786][52670] DAMAGECOUNT value on done: 2905.0 [2024-08-05 22:12:37,790][52670] Sum rewards: 1.301, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.474', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'weapon5': '0.170', 'HITCOUNT': '0.400', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.320', 'weapon3': '1.504', 'weapon2': '1.810', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 17217.1). Total num frames: 48472064. Throughput: 0: 4169.6. Samples: 12121030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:12:37,794][52567] Avg episode reward: [(0, '3.709')] [2024-08-05 22:12:37,798][52614] Saving new best policy, reward=3.709! [2024-08-05 22:12:38,005][52665] DAMAGECOUNT value on done: 5030.0 [2024-08-05 22:12:38,007][52665] Sum rewards: -3.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.005', 'AMMO2': '0.011', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'ARMOR': '0.128', 'AMMO3': '0.190', 'HITCOUNT': '0.470', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.407', 'weapon2': '1.562', 'FRAGCOUNT': '2.000', 'weapon3': '2.256'} [2024-08-05 22:12:38,275][52663] DAMAGECOUNT value on done: 4454.0 [2024-08-05 22:12:38,275][52663] Sum rewards: 1.117, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon5': '0.132', 'HITCOUNT': '0.270', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.792', 'weapon2': '1.634', 'weapon3': '1.682', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:38,474][52666] DAMAGECOUNT value on done: 3745.0 [2024-08-05 22:12:38,474][52666] Sum rewards: 4.098, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.038', 'ARMOR': '0.068', 'weapon5': '0.070', 'AMMO4': '0.076', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.650', 'weapon2': '1.096', 'DAMAGECOUNT': '1.287', 'weapon3': '2.360', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:39,542][52647] DAMAGECOUNT value on done: 4836.0 [2024-08-05 22:12:39,542][52647] Sum rewards: 1.993, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.028', 'AMMO4': '-0.101', 'AMMO2': '-0.020', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'HITCOUNT': '0.450', 'ARMOR': '0.489', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.374', 'weapon3': '1.696', 'weapon2': '2.170', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:39,861][52650] Updated weights for policy 0, policy_version 5921 (0.0051) [2024-08-05 22:12:40,045][52669] DAMAGECOUNT value on done: 4013.0 [2024-08-05 22:12:40,045][52669] Sum rewards: 0.927, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.524', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.108', 'weapon4': '0.128', 'HITCOUNT': '0.270', 'ARMOR': '0.568', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.921', 'FRAGCOUNT': '1.000', 'weapon2': '1.458', 'weapon3': '1.500'} [2024-08-05 22:12:40,676][52663] DAMAGECOUNT value on done: 3642.0 [2024-08-05 22:12:40,679][52663] Sum rewards: 1.828, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.304', 'AMMO2': '0.020', 'AMMO3': '0.078', 'AMMO4': '0.100', 'ARMOR': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.164', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.870', 'weapon3': '1.454', 'weapon2': '1.568', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:40,893][52665] DAMAGECOUNT value on done: 3527.0 [2024-08-05 22:12:40,894][52665] Sum rewards: -0.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.875', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.118', 'HITCOUNT': '0.470', 'ARMOR': '0.527', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.377', 'weapon2': '1.620', 'FRAGCOUNT': '2.000', 'weapon3': '2.052'} [2024-08-05 22:12:41,217][52670] DAMAGECOUNT value on done: 4049.0 [2024-08-05 22:12:41,217][52670] Sum rewards: 2.481, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.501', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.132', 'HITCOUNT': '0.690', 'ARMOR': '0.882', 'WEAPON3': '0.900', 'weapon2': '1.780', 'weapon3': '2.048', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:41,800][52666] DAMAGECOUNT value on done: 4224.0 [2024-08-05 22:12:41,802][52666] Sum rewards: 4.127, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.250', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'ARMOR': '1.001', 'weapon2': '1.536', 'weapon3': '1.908', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:42,666][52647] DAMAGECOUNT value on done: 5439.0 [2024-08-05 22:12:42,672][52647] Sum rewards: 2.163, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.863', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.082', 'weapon5': '0.120', 'WEAPON5': '0.200', 'HITCOUNT': '0.470', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.376', 'DAMAGECOUNT': '1.578', 'weapon2': '1.988', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 17189.3). Total num frames: 48553984. Throughput: 0: 4188.5. Samples: 12146340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:12:42,794][52567] Avg episode reward: [(0, '3.555')] [2024-08-05 22:12:43,267][52669] DAMAGECOUNT value on done: 3932.0 [2024-08-05 22:12:43,467][52670] DAMAGECOUNT value on done: 4625.0 [2024-08-05 22:12:43,469][52670] Sum rewards: 6.759, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.052', 'AMMO2': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.033', 'AMMO3': '0.122', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'weapon2': '1.492', 'DAMAGECOUNT': '1.761', 'weapon3': '1.992', 'FRAGCOUNT': '7.000'} [2024-08-05 22:12:43,481][52665] DAMAGECOUNT value on done: 4506.0 [2024-08-05 22:12:43,482][52665] Sum rewards: -1.798, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.978', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO4': '0.022', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'ARMOR': '0.908', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.158', 'weapon2': '1.304', 'FRAGCOUNT': '1.500', 'weapon3': '2.368'} [2024-08-05 22:12:43,972][52666] DAMAGECOUNT value on done: 4187.0 [2024-08-05 22:12:43,973][52666] Sum rewards: 5.908, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.294', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.087', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'HITCOUNT': '0.410', 'weapon4': '0.574', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.161', 'weapon2': '1.260', 'weapon3': '1.674', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:44,017][52663] DAMAGECOUNT value on done: 5490.0 [2024-08-05 22:12:44,019][52663] Sum rewards: 3.597, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.419', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'weapon4': '0.094', 'WEAPON4': '0.100', 'ARMOR': '0.519', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.416', 'weapon3': '1.780', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:44,468][52650] Updated weights for policy 0, policy_version 5931 (0.0019) [2024-08-05 22:12:45,220][52647] DAMAGECOUNT value on done: 3845.0 [2024-08-05 22:12:45,221][52647] Sum rewards: 7.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.783', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon4': '0.194', 'ARMOR': '0.456', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon3': '1.620', 'weapon2': '1.896', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '10.000'} [2024-08-05 22:12:46,026][52669] DAMAGECOUNT value on done: 4325.0 [2024-08-05 22:12:46,029][52669] Sum rewards: 2.510, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.076', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.284', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'ARMOR': '0.877', 'weapon3': '1.524', 'weapon2': '1.730', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:46,302][52670] DAMAGECOUNT value on done: 4929.0 [2024-08-05 22:12:46,305][52670] Sum rewards: 1.723, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.713', 'AMMO2': '0.014', 'ARMOR': '0.064', 'AMMO4': '0.070', 'AMMO3': '0.088', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon3': '1.236', 'DAMAGECOUNT': '1.410', 'weapon2': '1.914', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:46,537][52665] DAMAGECOUNT value on done: 4315.0 [2024-08-05 22:12:46,537][52665] Sum rewards: 8.250, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.748', 'AMMO2': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'weapon5': '0.358', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '1.256', 'weapon2': '1.362', 'weapon3': '1.704', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '7.500'} [2024-08-05 22:12:46,855][52663] DAMAGECOUNT value on done: 5021.0 [2024-08-05 22:12:46,857][52663] Sum rewards: 4.186, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.645', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon4': '0.162', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'ARMOR': '0.943', 'DAMAGECOUNT': '1.260', 'weapon3': '1.620', 'weapon2': '1.740', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:47,090][52666] DAMAGECOUNT value on done: 3888.0 [2024-08-05 22:12:47,090][52666] Sum rewards: 3.295, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.806', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'ARMOR': '1.013', 'weapon3': '1.400', 'DAMAGECOUNT': '1.599', 'weapon2': '1.704', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.2, 300 sec: 17217.1). Total num frames: 48644096. Throughput: 0: 4200.4. Samples: 12159150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 22:12:47,795][52567] Avg episode reward: [(0, '3.597')] [2024-08-05 22:12:47,933][52647] DAMAGECOUNT value on done: 3907.0 [2024-08-05 22:12:47,934][52647] Sum rewards: -0.127, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.831', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.074', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.220', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.708', 'FRAGCOUNT': '1.000', 'weapon3': '1.086', 'weapon2': '1.666'} [2024-08-05 22:12:49,117][52669] DAMAGECOUNT value on done: 4762.0 [2024-08-05 22:12:49,117][52669] Sum rewards: -1.315, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.558', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'ARMOR': '0.120', 'weapon5': '0.142', 'HITCOUNT': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.216', 'DAMAGECOUNT': '0.687', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.280', 'weapon3': '1.338'} [2024-08-05 22:12:49,326][52665] DAMAGECOUNT value on done: 4758.0 [2024-08-05 22:12:49,329][52665] Sum rewards: 6.851, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.256', 'ARMOR': '0.560', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.584', 'weapon3': '1.838', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '8.000'} [2024-08-05 22:12:49,496][52650] Updated weights for policy 0, policy_version 5941 (0.0024) [2024-08-05 22:12:49,630][52670] DAMAGECOUNT value on done: 4481.0 [2024-08-05 22:12:49,632][52670] Sum rewards: 1.672, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.116', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'HITCOUNT': '0.390', 'weapon5': '0.402', 'WEAPON3': '0.700', 'ARMOR': '1.264', 'DAMAGECOUNT': '1.269', 'weapon3': '1.518', 'weapon2': '1.652', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:50,026][52663] DAMAGECOUNT value on done: 5024.0 [2024-08-05 22:12:50,027][52663] Sum rewards: 7.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.218', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.230', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'ARMOR': '0.997', 'weapon2': '1.306', 'weapon3': '2.032', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '8.000'} [2024-08-05 22:12:50,569][52666] DAMAGECOUNT value on done: 4404.0 [2024-08-05 22:12:50,569][52666] Sum rewards: -0.597, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.332', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.136', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'ARMOR': '0.835', 'DAMAGECOUNT': '1.374', 'weapon3': '1.496', 'weapon2': '1.666', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:50,939][52647] DAMAGECOUNT value on done: 4858.0 [2024-08-05 22:12:50,939][52647] Sum rewards: 4.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.728', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.084', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.450', 'ARMOR': '0.515', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.395', 'weapon3': '1.530', 'weapon2': '1.798', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:51,760][52669] DAMAGECOUNT value on done: 4581.0 [2024-08-05 22:12:51,762][52669] Sum rewards: 2.856, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.248', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'WEAPON1': '0.020', 'AMMO3': '0.092', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'ARMOR': '0.990', 'weapon2': '1.658', 'weapon3': '1.780', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:52,337][52665] DAMAGECOUNT value on done: 3543.0 [2024-08-05 22:12:52,338][52665] Sum rewards: -1.716, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.310', 'weapon4': '0.002', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.250', 'DAMAGECOUNT': '0.810', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'ARMOR': '1.297', 'weapon2': '1.420', 'weapon3': '2.078'} [2024-08-05 22:12:52,763][52663] DAMAGECOUNT value on done: 6218.0 [2024-08-05 22:12:52,766][52663] Sum rewards: 6.861, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.002', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.119', 'AMMO3': '0.124', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'ARMOR': '0.932', 'weapon2': '1.650', 'weapon3': '1.676', 'DAMAGECOUNT': '2.808', 'FRAGCOUNT': '7.000'} [2024-08-05 22:12:52,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16793.6, 300 sec: 17189.3). Total num frames: 48726016. Throughput: 0: 4233.8. Samples: 12184780. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:12:52,795][52567] Avg episode reward: [(0, '3.487')] [2024-08-05 22:12:53,076][52667] DAMAGECOUNT value on done: 5421.0 [2024-08-05 22:12:53,076][52667] Sum rewards: 4.601, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.521', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.224', 'HITCOUNT': '0.480', 'ARMOR': '0.483', 'WEAPON3': '0.800', 'weapon2': '1.260', 'weapon3': '1.802', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '6.000'} [2024-08-05 22:12:53,198][52670] DAMAGECOUNT value on done: 4957.0 [2024-08-05 22:12:53,198][52670] Sum rewards: 0.337, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.077', 'AMMO2': '0.009', 'AMMO4': '0.046', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.299', 'weapon2': '1.400', 'weapon3': '1.656', 'FRAGCOUNT': '3.000'} [2024-08-05 22:12:53,715][52647] DAMAGECOUNT value on done: 3484.0 [2024-08-05 22:12:53,715][52647] Sum rewards: -1.934, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.558', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'weapon5': '0.108', 'AMMO3': '0.135', 'HITCOUNT': '0.190', 'WEAPON5': '0.350', 'DAMAGECOUNT': '0.507', 'WEAPON3': '0.950', 'ARMOR': '0.956', 'FRAGCOUNT': '1.000', 'weapon2': '1.674', 'weapon3': '1.970'} [2024-08-05 22:12:54,230][52666] DAMAGECOUNT value on done: 4110.0 [2024-08-05 22:12:54,238][52666] Sum rewards: 5.095, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.306', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'ARMOR': '0.978', 'weapon2': '1.462', 'weapon3': '2.190', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '6.000'} [2024-08-05 22:12:54,423][52650] Updated weights for policy 0, policy_version 5951 (0.0017) [2024-08-05 22:12:54,551][52669] DAMAGECOUNT value on done: 4666.0 [2024-08-05 22:12:54,552][52669] Sum rewards: 2.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.180', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.102', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'ARMOR': '0.923', 'FRAGCOUNT': '1.000', 'weapon2': '1.580', 'DAMAGECOUNT': '1.779', 'weapon3': '1.830'} [2024-08-05 22:12:55,393][52665] DAMAGECOUNT value on done: 2789.0 [2024-08-05 22:12:55,393][52665] Sum rewards: 1.222, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.101', 'weapon4': '0.132', 'WEAPON4': '0.150', 'HITCOUNT': '0.310', 'ARMOR': '0.552', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.080', 'weapon2': '1.382', 'weapon3': '1.826', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:55,755][52663] DAMAGECOUNT value on done: 3903.0 [2024-08-05 22:12:55,755][52663] Sum rewards: 0.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.302', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.290', 'weapon3': '1.470', 'weapon2': '1.596', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:56,513][52667] DAMAGECOUNT value on done: 4301.0 [2024-08-05 22:12:56,514][52667] Sum rewards: -1.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.562', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'HITCOUNT': '0.270', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.957', 'weapon3': '1.050', 'FRAGCOUNT': '1.500', 'weapon2': '1.572'} [2024-08-05 22:12:56,522][52647] DAMAGECOUNT value on done: 4379.0 [2024-08-05 22:12:56,523][52647] Sum rewards: 1.218, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.762', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'ARMOR': '0.056', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '0.992', 'weapon3': '1.740', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:56,725][52670] DAMAGECOUNT value on done: 4356.0 [2024-08-05 22:12:56,726][52670] Sum rewards: 0.303, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.185', 'AMMO2': '0.005', 'ARMOR': '0.016', 'AMMO4': '0.022', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'weapon4': '0.570', 'weapon2': '0.586', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.735', 'weapon3': '1.636', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:57,088][52669] DAMAGECOUNT value on done: 4378.0 [2024-08-05 22:12:57,088][52669] Sum rewards: -1.222, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.472', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon5': '0.070', 'AMMO4': '0.084', 'AMMO3': '0.122', 'HITCOUNT': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.825', 'ARMOR': '0.907', 'weapon2': '1.546', 'weapon3': '1.894', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:57,604][52666] DAMAGECOUNT value on done: 4343.0 [2024-08-05 22:12:57,604][52666] Sum rewards: 6.200, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'AMMO3': '0.060', 'HEALTH': '0.076', 'weapon7': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.310', 'weapon4': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.820', 'DAMAGECOUNT': '1.005', 'weapon3': '1.406', 'weapon2': '1.606', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:57,794][52567] Fps is (10 sec: 15564.8, 60 sec: 16657.0, 300 sec: 17106.0). Total num frames: 48799744. Throughput: 0: 4236.2. Samples: 12209920. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:12:57,795][52567] Avg episode reward: [(0, '3.094')] [2024-08-05 22:12:57,940][52663] DAMAGECOUNT value on done: 3783.0 [2024-08-05 22:12:57,942][52663] Sum rewards: 1.844, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.968', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'weapon5': '0.572', 'DAMAGECOUNT': '1.302', 'weapon3': '1.434', 'weapon2': '1.482', 'FRAGCOUNT': '1.500'} [2024-08-05 22:12:58,687][52665] DAMAGECOUNT value on done: 5289.0 [2024-08-05 22:12:58,689][52665] Sum rewards: 4.349, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.610', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.380', 'ARMOR': '0.516', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.065', 'weapon3': '1.540', 'weapon2': '1.576', 'FRAGCOUNT': '4.000'} [2024-08-05 22:12:58,973][52650] Updated weights for policy 0, policy_version 5961 (0.0030) [2024-08-05 22:12:59,475][52647] DAMAGECOUNT value on done: 4597.0 [2024-08-05 22:12:59,489][52647] Sum rewards: 2.056, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.500', 'HEALTH': '0.530', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.110', 'weapon3': '1.596', 'weapon2': '1.662', 'FRAGCOUNT': '2.000'} [2024-08-05 22:12:59,769][52669] DAMAGECOUNT value on done: 4915.0 [2024-08-05 22:12:59,769][52669] Sum rewards: 5.120, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.003', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'ARMOR': '0.501', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.454', 'weapon3': '1.526', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '5.000'} [2024-08-05 22:12:59,948][52670] DAMAGECOUNT value on done: 3030.0 [2024-08-05 22:12:59,949][52670] Sum rewards: 5.147, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.094', 'HEALTH': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.957', 'DAMAGECOUNT': '1.431', 'weapon2': '1.764', 'weapon3': '1.920', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:00,026][52667] DAMAGECOUNT value on done: 5048.0 [2024-08-05 22:13:00,029][52667] Sum rewards: 5.664, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.263', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.074', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'ARMOR': '0.884', 'weapon3': '1.500', 'weapon2': '1.628', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:00,835][52666] DAMAGECOUNT value on done: 3341.0 [2024-08-05 22:13:00,835][52666] Sum rewards: 3.736, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.395', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.011', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'weapon4': '0.054', 'weapon5': '0.066', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.432', 'DAMAGECOUNT': '1.740', 'weapon3': '2.132', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:01,217][52663] DAMAGECOUNT value on done: 5007.0 [2024-08-05 22:13:01,219][52663] Sum rewards: 1.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.548', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon4': '0.192', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'ARMOR': '0.874', 'DAMAGECOUNT': '1.365', 'weapon2': '1.382', 'weapon3': '2.020', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:01,381][52665] DAMAGECOUNT value on done: 5522.0 [2024-08-05 22:13:01,382][52665] Sum rewards: 2.441, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.588', 'AMMO4': '-0.083', 'AMMO2': '-0.016', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'ARMOR': '0.951', 'weapon3': '1.320', 'weapon2': '1.788', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:02,748][52647] DAMAGECOUNT value on done: 4809.0 [2024-08-05 22:13:02,748][52647] Sum rewards: 4.509, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.094', 'AMMO2': '0.022', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon4': '0.214', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'ARMOR': '0.808', 'weapon2': '1.274', 'DAMAGECOUNT': '1.386', 'weapon3': '1.612', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 17161.5). Total num frames: 48898048. Throughput: 0: 4229.6. Samples: 12222480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:13:02,794][52567] Avg episode reward: [(0, '3.091')] [2024-08-05 22:13:02,888][52667] DAMAGECOUNT value on done: 4900.0 [2024-08-05 22:13:02,889][52667] Sum rewards: 11.589, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.464', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.298', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'ARMOR': '1.379', 'weapon3': '1.612', 'weapon2': '1.888', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '10.000'} [2024-08-05 22:13:02,956][52670] DAMAGECOUNT value on done: 4399.0 [2024-08-05 22:13:02,964][52670] Sum rewards: 6.647, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.468', 'AMMO2': '0.015', 'AMMO4': '0.073', 'ARMOR': '0.078', 'AMMO3': '0.126', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '1.568', 'weapon3': '2.150', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:03,040][52669] DAMAGECOUNT value on done: 4414.0 [2024-08-05 22:13:03,042][52669] Sum rewards: 0.150, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.008', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon4': '0.162', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.912', 'FRAGCOUNT': '1.000', 'weapon3': '1.174', 'weapon2': '1.348'} [2024-08-05 22:13:03,472][52649] DAMAGECOUNT value on done: 4737.0 [2024-08-05 22:13:03,473][52649] Sum rewards: 8.003, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.823', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.216', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '0.957', 'weapon3': '1.522', 'weapon2': '1.732', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:03,879][52663] DAMAGECOUNT value on done: 5052.0 [2024-08-05 22:13:03,879][52663] Sum rewards: 8.267, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.427', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.128', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.638', 'weapon3': '1.678', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:03,949][52650] Updated weights for policy 0, policy_version 5971 (0.0012) [2024-08-05 22:13:04,060][52666] DAMAGECOUNT value on done: 4286.0 [2024-08-05 22:13:04,060][52666] Sum rewards: 3.533, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.851', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon5': '0.128', 'HITCOUNT': '0.480', 'ARMOR': '0.496', 'WEAPON3': '0.750', 'weapon2': '1.350', 'DAMAGECOUNT': '1.839', 'weapon3': '1.924', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:04,713][52665] DAMAGECOUNT value on done: 5340.0 [2024-08-05 22:13:04,713][52665] Sum rewards: 6.187, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.086', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'weapon4': '0.192', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.078', 'ARMOR': '1.432', 'weapon3': '1.676', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:04,816][52647] DAMAGECOUNT value on done: 5430.0 [2024-08-05 22:13:04,816][52647] Sum rewards: 4.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.842', 'AMMO2': '0.002', 'AMMO4': '0.007', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.161', 'HITCOUNT': '0.940', 'WEAPON3': '1.100', 'weapon2': '1.192', 'weapon3': '2.350', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:05,529][52669] DAMAGECOUNT value on done: 4968.0 [2024-08-05 22:13:05,529][52669] Sum rewards: 2.910, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'HEALTH': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.078', 'weapon5': '0.252', 'HITCOUNT': '0.280', 'WEAPON3': '0.500', 'ARMOR': '0.832', 'DAMAGECOUNT': '1.017', 'weapon3': '1.346', 'weapon2': '1.438', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:05,889][52667] DAMAGECOUNT value on done: 5175.0 [2024-08-05 22:13:05,891][52667] Sum rewards: 5.101, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.956', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.284', 'WEAPON5': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.463', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.230', 'weapon2': '1.424', 'weapon3': '1.718', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:06,346][52670] DAMAGECOUNT value on done: 4780.0 [2024-08-05 22:13:06,347][52670] Sum rewards: -2.673, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.358', 'weapon4': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.561', 'ARMOR': '0.947', 'FRAGCOUNT': '1.000', 'weapon3': '1.214', 'weapon2': '1.528'} [2024-08-05 22:13:06,724][52663] DAMAGECOUNT value on done: 4759.0 [2024-08-05 22:13:06,725][52663] Sum rewards: 5.535, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.247', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.620', 'ARMOR': '0.937', 'WEAPON3': '1.000', 'weapon2': '1.424', 'weapon3': '2.262', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:06,863][52649] DAMAGECOUNT value on done: 4007.0 [2024-08-05 22:13:06,865][52649] Sum rewards: 3.526, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.136', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.102', 'ARMOR': '0.464', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.575', 'weapon3': '1.822', 'weapon2': '1.964', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:06,893][52666] DAMAGECOUNT value on done: 6145.0 [2024-08-05 22:13:06,894][52666] Sum rewards: 7.704, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.372', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.576', 'weapon3': '2.162', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:07,567][52647] DAMAGECOUNT value on done: 3434.0 [2024-08-05 22:13:07,568][52647] Sum rewards: 2.182, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.180', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.106', 'HITCOUNT': '0.210', 'weapon4': '0.238', 'WEAPON3': '0.400', 'ARMOR': '0.492', 'DAMAGECOUNT': '0.681', 'weapon2': '0.890', 'weapon3': '0.964', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 48979968. Throughput: 0: 4229.8. Samples: 12248120. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:13:07,795][52567] Avg episode reward: [(0, '3.176')] [2024-08-05 22:13:08,085][52665] DAMAGECOUNT value on done: 4934.0 [2024-08-05 22:13:08,086][52665] Sum rewards: 5.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.096', 'AMMO2': '0.020', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.110', 'weapon4': '0.186', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.456', 'DAMAGECOUNT': '1.962', 'weapon3': '1.990', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:08,474][52669] DAMAGECOUNT value on done: 4353.0 [2024-08-05 22:13:08,474][52669] Sum rewards: 6.115, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.014', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.032', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.114', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.314', 'DAMAGECOUNT': '2.247', 'weapon3': '2.344', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:08,815][52650] Updated weights for policy 0, policy_version 5981 (0.0050) [2024-08-05 22:13:08,846][52667] DAMAGECOUNT value on done: 5254.0 [2024-08-05 22:13:08,847][52667] Sum rewards: -1.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.896', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'ARMOR': '0.036', 'AMMO3': '0.124', 'HITCOUNT': '0.520', 'WEAPON3': '0.900', 'weapon2': '1.484', 'DAMAGECOUNT': '1.491', 'weapon3': '1.892', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:08,952][52670] DAMAGECOUNT value on done: 4333.0 [2024-08-05 22:13:08,952][52670] Sum rewards: 8.653, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.294', 'AMMO5': '0.003', 'weapon4': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '0.800', 'weapon3': '1.386', 'weapon2': '1.964', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:09,104][52658] DAMAGECOUNT value on done: 3674.0 [2024-08-05 22:13:09,105][52658] Sum rewards: -2.342, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.120', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO4': '0.023', 'AMMO3': '0.117', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.240', 'DAMAGECOUNT': '0.699', 'WEAPON3': '0.800', 'ARMOR': '0.916', 'FRAGCOUNT': '1.000', 'weapon3': '1.340', 'weapon2': '1.564'} [2024-08-05 22:13:09,355][52663] DAMAGECOUNT value on done: 4685.0 [2024-08-05 22:13:09,355][52663] Sum rewards: -0.330, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.385', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON1': '0.020', 'AMMO3': '0.081', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.023', 'weapon2': '1.234', 'weapon3': '1.342'} [2024-08-05 22:13:09,906][52666] DAMAGECOUNT value on done: 4959.0 [2024-08-05 22:13:09,914][52666] Sum rewards: 6.059, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.774', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.128', 'HITCOUNT': '0.470', 'ARMOR': '0.884', 'WEAPON3': '0.900', 'weapon2': '1.460', 'DAMAGECOUNT': '1.857', 'weapon3': '2.072', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:09,952][52647] DAMAGECOUNT value on done: 4636.0 [2024-08-05 22:13:09,952][52647] Sum rewards: 5.147, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.040', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO3': '0.102', 'ARMOR': '0.447', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon2': '1.184', 'DAMAGECOUNT': '1.854', 'weapon3': '2.000', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:10,186][52649] DAMAGECOUNT value on done: 4128.0 [2024-08-05 22:13:10,188][52649] Sum rewards: 8.947, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.092', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon3': '1.414', 'ARMOR': '1.768', 'weapon2': '1.960', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:11,078][52665] DAMAGECOUNT value on done: 5362.0 [2024-08-05 22:13:11,078][52665] Sum rewards: 3.336, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.678', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.022', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.272', 'weapon2': '1.414', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:11,096][52669] DAMAGECOUNT value on done: 5296.0 [2024-08-05 22:13:11,097][52669] Sum rewards: -0.598, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.525', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.250', 'HITCOUNT': '0.470', 'ARMOR': '0.892', 'WEAPON3': '1.050', 'weapon2': '1.218', 'DAMAGECOUNT': '1.251', 'weapon3': '1.516', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:11,307][52667] DAMAGECOUNT value on done: 4697.0 [2024-08-05 22:13:11,308][52667] Sum rewards: 0.954, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.252', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.094', 'weapon5': '0.154', 'WEAPON4': '0.200', 'HITCOUNT': '0.210', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.900', 'ARMOR': '0.919', 'FRAGCOUNT': '1.000', 'weapon2': '1.510', 'weapon3': '1.768'} [2024-08-05 22:13:11,680][52658] DAMAGECOUNT value on done: 4101.0 [2024-08-05 22:13:12,279][52663] DAMAGECOUNT value on done: 4422.0 [2024-08-05 22:13:12,280][52663] Sum rewards: 2.238, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.903', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'weapon5': '0.256', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.950', 'weapon2': '1.552', 'DAMAGECOUNT': '1.653', 'weapon3': '1.942', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:12,385][52670] DAMAGECOUNT value on done: 4412.0 [2024-08-05 22:13:12,388][52670] Sum rewards: 3.622, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.032', 'AMMO3': '0.072', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.340', 'weapon4': '0.376', 'WEAPON3': '0.550', 'ARMOR': '0.567', 'DAMAGECOUNT': '1.317', 'weapon3': '1.454', 'weapon2': '1.502', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:12,660][52647] DAMAGECOUNT value on done: 4244.0 [2024-08-05 22:13:12,660][52647] Sum rewards: 2.211, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.498', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'ARMOR': '0.068', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'HITCOUNT': '0.390', 'WEAPON3': '0.950', 'weapon2': '1.268', 'DAMAGECOUNT': '1.611', 'weapon3': '2.250', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 17106.0). Total num frames: 49061888. Throughput: 0: 4220.9. Samples: 12273200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:13:12,794][52567] Avg episode reward: [(0, '3.126')] [2024-08-05 22:13:13,162][52649] DAMAGECOUNT value on done: 5059.0 [2024-08-05 22:13:13,162][52649] Sum rewards: 3.047, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.244', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.134', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'ARMOR': '0.982', 'weapon2': '1.674', 'weapon3': '1.810', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:13,713][52650] Updated weights for policy 0, policy_version 5991 (0.0033) [2024-08-05 22:13:14,143][52665] DAMAGECOUNT value on done: 4545.0 [2024-08-05 22:13:14,145][52665] Sum rewards: 6.434, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.990', 'AMMO2': '0.000', 'AMMO4': '0.000', 'ARMOR': '0.064', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.136', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.592', 'weapon2': '1.658', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:14,288][52667] DAMAGECOUNT value on done: 4711.0 [2024-08-05 22:13:14,289][52667] Sum rewards: 0.755, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.824', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.112', 'AMMO3': '0.125', 'weapon5': '0.264', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'ARMOR': '1.313', 'DAMAGECOUNT': '1.554', 'weapon3': '1.574', 'weapon2': '1.726'} [2024-08-05 22:13:14,931][52658] DAMAGECOUNT value on done: 3806.0 [2024-08-05 22:13:14,939][52658] Sum rewards: -0.099, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.622', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.150', 'HITCOUNT': '0.320', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.137', 'ARMOR': '1.761', 'weapon2': '1.768', 'FRAGCOUNT': '2.000', 'weapon3': '2.112'} [2024-08-05 22:13:15,176][52663] DAMAGECOUNT value on done: 4259.0 [2024-08-05 22:13:15,176][52663] Sum rewards: 7.712, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.009', 'ARMOR': '0.028', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.184', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'HEALTH': '0.928', 'weapon2': '1.106', 'DAMAGECOUNT': '1.815', 'weapon3': '2.012', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:15,275][52664] DAMAGECOUNT value on done: 5860.0 [2024-08-05 22:13:15,275][52664] Sum rewards: 8.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.152', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.068', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.638', 'weapon3': '1.642', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:15,495][52647] DAMAGECOUNT value on done: 4769.0 [2024-08-05 22:13:15,498][52647] Sum rewards: 4.062, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'HEALTH': '0.010', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.098', 'weapon4': '0.110', 'AMMO3': '0.122', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'ARMOR': '1.305', 'weapon2': '1.364', 'weapon3': '1.804', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:16,274][52649] DAMAGECOUNT value on done: 3043.0 [2024-08-05 22:13:16,275][52649] Sum rewards: 3.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.548', 'weapon4': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'HITCOUNT': '0.420', 'ARMOR': '0.484', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.185', 'weapon2': '1.642', 'weapon3': '1.730', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:17,121][52665] DAMAGECOUNT value on done: 5253.0 [2024-08-05 22:13:17,122][52665] Sum rewards: -0.047, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.733', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.016', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.310', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.221', 'weapon2': '1.678', 'weapon3': '1.832', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:17,321][52667] DAMAGECOUNT value on done: 5360.0 [2024-08-05 22:13:17,322][52667] Sum rewards: 10.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.058', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.130', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'ARMOR': '0.852', 'weapon3': '1.582', 'weapon2': '1.690', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '8.000'} [2024-08-05 22:13:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17106.0). Total num frames: 49152000. Throughput: 0: 4227.8. Samples: 12285850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:13:17,794][52567] Avg episode reward: [(0, '3.150')] [2024-08-05 22:13:17,944][52663] DAMAGECOUNT value on done: 5411.0 [2024-08-05 22:13:17,945][52663] Sum rewards: 5.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.042', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO3': '0.171', 'HITCOUNT': '0.780', 'WEAPON3': '1.100', 'weapon2': '1.178', 'ARMOR': '1.361', 'weapon3': '2.494', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '9.000'} [2024-08-05 22:13:17,966][52658] DAMAGECOUNT value on done: 4363.0 [2024-08-05 22:13:17,966][52658] Sum rewards: 6.779, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.404', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.244', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.879', 'weapon2': '1.464', 'weapon3': '1.844', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:18,479][52650] Updated weights for policy 0, policy_version 6001 (0.0027) [2024-08-05 22:13:18,573][52664] DAMAGECOUNT value on done: 4504.0 [2024-08-05 22:13:18,573][52664] Sum rewards: 3.701, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.142', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'ARMOR': '0.400', 'HITCOUNT': '0.670', 'WEAPON3': '1.000', 'weapon2': '1.606', 'weapon3': '1.950', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:18,721][52647] DAMAGECOUNT value on done: 3975.0 [2024-08-05 22:13:18,722][52647] Sum rewards: 3.328, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.097', 'HEALTH': '0.158', 'WEAPON3': '0.450', 'ARMOR': '0.454', 'HITCOUNT': '0.460', 'weapon3': '1.164', 'DAMAGECOUNT': '1.563', 'weapon2': '1.794', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:19,096][52649] DAMAGECOUNT value on done: 4809.0 [2024-08-05 22:13:19,096][52649] Sum rewards: 12.062, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.164', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'weapon5': '0.066', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.296', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '0.900', 'ARMOR': '0.901', 'weapon3': '1.440', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '9.000'} [2024-08-05 22:13:20,000][52665] DAMAGECOUNT value on done: 4859.0 [2024-08-05 22:13:20,001][52665] Sum rewards: 1.000, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.689', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.026', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'ARMOR': '0.448', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.458', 'DAMAGECOUNT': '1.671', 'weapon3': '1.986', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:20,433][52667] DAMAGECOUNT value on done: 5340.0 [2024-08-05 22:13:20,435][52667] Sum rewards: 6.453, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.112', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '1.702', 'weapon3': '1.864', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:20,832][52663] DAMAGECOUNT value on done: 4494.0 [2024-08-05 22:13:20,833][52663] Sum rewards: 1.476, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon4': '0.234', 'HITCOUNT': '0.260', 'WEAPON3': '0.700', 'ARMOR': '0.883', 'weapon3': '1.422', 'weapon2': '1.496', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:21,078][52658] DAMAGECOUNT value on done: 4708.0 [2024-08-05 22:13:21,078][52658] Sum rewards: 1.798, reward structure: {'DEATHCOUNT': '-3.750', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'ARMOR': '0.096', 'AMMO4': '0.128', 'HITCOUNT': '0.130', 'HEALTH': '0.161', 'WEAPON4': '0.200', 'DAMAGECOUNT': '0.396', 'WEAPON3': '0.400', 'weapon4': '0.642', 'weapon2': '0.992', 'FRAGCOUNT': '1.000', 'weapon3': '1.258'} [2024-08-05 22:13:21,100][52664] DAMAGECOUNT value on done: 5417.0 [2024-08-05 22:13:21,101][52664] Sum rewards: 0.756, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.382', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon5': '0.036', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'ARMOR': '0.522', 'HITCOUNT': '0.550', 'weapon2': '0.978', 'WEAPON3': '1.200', 'DAMAGECOUNT': '2.190', 'weapon3': '2.494', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:21,171][52647] DAMAGECOUNT value on done: 5067.0 [2024-08-05 22:13:21,172][52647] Sum rewards: 6.835, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.495', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'HITCOUNT': '0.720', 'ARMOR': '0.888', 'WEAPON3': '0.900', 'weapon2': '1.756', 'weapon3': '1.840', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '8.000'} [2024-08-05 22:13:22,356][52649] DAMAGECOUNT value on done: 4230.0 [2024-08-05 22:13:22,358][52649] Sum rewards: -0.589, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.644', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon7': '0.030', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.137', 'weapon5': '0.160', 'WEAPON5': '0.300', 'HITCOUNT': '0.350', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.191', 'ARMOR': '1.389', 'weapon2': '1.546', 'weapon3': '1.994'} [2024-08-05 22:13:22,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 17050.5). Total num frames: 49225728. Throughput: 0: 4225.5. Samples: 12311180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:13:22,795][52567] Avg episode reward: [(0, '3.453')] [2024-08-05 22:13:23,065][52665] DAMAGECOUNT value on done: 5351.0 [2024-08-05 22:13:23,065][52665] Sum rewards: -3.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.968', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.192', 'HITCOUNT': '0.370', 'ARMOR': '0.548', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.302', 'weapon2': '1.768', 'weapon3': '1.994'} [2024-08-05 22:13:23,291][52650] Updated weights for policy 0, policy_version 6011 (0.0014) [2024-08-05 22:13:23,473][52664] DAMAGECOUNT value on done: 4065.0 [2024-08-05 22:13:23,474][52664] Sum rewards: 4.843, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.014', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.083', 'ARMOR': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.224', 'HEALTH': '0.270', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.194', 'weapon2': '1.286', 'weapon3': '1.630', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:23,515][52647] DAMAGECOUNT value on done: 4417.0 [2024-08-05 22:13:23,517][52647] Sum rewards: 3.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.775', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.117', 'HITCOUNT': '0.460', 'ARMOR': '0.513', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.605', 'weapon2': '1.630', 'weapon3': '2.000', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:23,622][52667] DAMAGECOUNT value on done: 4407.0 [2024-08-05 22:13:23,624][52667] Sum rewards: 1.845, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.222', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.054', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'HITCOUNT': '0.370', 'ARMOR': '0.816', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.230', 'weapon2': '1.560', 'weapon3': '1.924', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:23,798][52663] DAMAGECOUNT value on done: 4123.0 [2024-08-05 22:13:23,799][52663] Sum rewards: 0.841, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.256', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.186', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'ARMOR': '0.910', 'weapon2': '1.334', 'DAMAGECOUNT': '1.695', 'weapon3': '2.144', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:24,339][52658] DAMAGECOUNT value on done: 3659.0 [2024-08-05 22:13:24,341][52658] Sum rewards: 3.875, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.418', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.004', 'weapon5': '0.014', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'ARMOR': '0.907', 'weapon3': '1.688', 'DAMAGECOUNT': '1.764', 'weapon2': '2.074', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:25,706][52649] DAMAGECOUNT value on done: 3442.0 [2024-08-05 22:13:25,987][52803] DAMAGECOUNT value on done: 5117.0 [2024-08-05 22:13:25,989][52803] Sum rewards: 6.685, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.183', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '0.884', 'weapon2': '1.548', 'weapon3': '1.880', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:26,127][52664] DAMAGECOUNT value on done: 5454.0 [2024-08-05 22:13:26,127][52664] Sum rewards: 4.591, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.800', 'AMMO2': '0.002', 'AMMO4': '0.011', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'weapon4': '0.112', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.254', 'weapon3': '1.722', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:26,132][52647] DAMAGECOUNT value on done: 5127.0 [2024-08-05 22:13:26,133][52647] Sum rewards: 1.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.556', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.270', 'ARMOR': '0.488', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.426', 'weapon3': '2.078', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:26,340][52667] DAMAGECOUNT value on done: 5406.0 [2024-08-05 22:13:26,340][52667] Sum rewards: 1.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.425', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.016', 'ARMOR': '0.016', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.747', 'weapon3': '1.536', 'weapon2': '1.680', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:26,465][52665] DAMAGECOUNT value on done: 4021.0 [2024-08-05 22:13:26,465][52665] Sum rewards: -0.922, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.992', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.107', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.892', 'DAMAGECOUNT': '1.527', 'weapon3': '1.700', 'weapon2': '1.708', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:26,816][52663] DAMAGECOUNT value on done: 4203.0 [2024-08-05 22:13:26,818][52663] Sum rewards: 0.573, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.630', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.094', 'WEAPON4': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.400', 'ARMOR': '0.441', 'WEAPON3': '0.650', 'weapon2': '0.898', 'FRAGCOUNT': '1.000', 'weapon3': '1.600', 'DAMAGECOUNT': '1.635'} [2024-08-05 22:13:26,980][52658] DAMAGECOUNT value on done: 5075.0 [2024-08-05 22:13:26,982][52658] Sum rewards: 4.273, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.594', 'AMMO2': '0.011', 'ARMOR': '0.044', 'AMMO4': '0.055', 'AMMO3': '0.134', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.678', 'weapon3': '2.090', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:27,794][52567] Fps is (10 sec: 16383.3, 60 sec: 16930.0, 300 sec: 17050.5). Total num frames: 49315840. Throughput: 0: 4234.0. Samples: 12336870. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-05 22:13:27,795][52567] Avg episode reward: [(0, '3.194')] [2024-08-05 22:13:28,209][52650] Updated weights for policy 0, policy_version 6021 (0.0013) [2024-08-05 22:13:28,773][52649] DAMAGECOUNT value on done: 4415.0 [2024-08-05 22:13:28,774][52649] Sum rewards: 1.135, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.400', 'ARMOR': '0.508', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.266', 'weapon2': '1.280', 'weapon3': '2.058', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:29,009][52647] DAMAGECOUNT value on done: 4399.0 [2024-08-05 22:13:29,011][52647] Sum rewards: 6.060, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.032', 'weapon4': '0.046', 'AMMO3': '0.059', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.320', 'WEAPON3': '0.350', 'ARMOR': '0.501', 'DAMAGECOUNT': '0.792', 'weapon3': '0.958', 'weapon2': '1.826', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:29,056][52664] DAMAGECOUNT value on done: 4717.0 [2024-08-05 22:13:29,057][52664] Sum rewards: 7.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.706', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon4': '0.126', 'ARMOR': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.290', 'DAMAGECOUNT': '1.869', 'weapon3': '2.052', 'FRAGCOUNT': '8.000'} [2024-08-05 22:13:29,353][52667] DAMAGECOUNT value on done: 4817.0 [2024-08-05 22:13:29,353][52667] Sum rewards: 0.060, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'weapon4': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'HITCOUNT': '0.620', 'ARMOR': '0.888', 'WEAPON3': '1.150', 'weapon2': '1.528', 'DAMAGECOUNT': '2.106', 'weapon3': '2.180', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:29,358][52803] DAMAGECOUNT value on done: 5028.0 [2024-08-05 22:13:29,358][52803] Sum rewards: 0.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.674', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.156', 'HITCOUNT': '0.500', 'WEAPON3': '1.000', 'ARMOR': '1.340', 'weapon2': '1.472', 'DAMAGECOUNT': '1.650', 'weapon3': '2.160', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:29,520][52665] DAMAGECOUNT value on done: 5516.0 [2024-08-05 22:13:29,521][52665] Sum rewards: 6.599, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.154', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.028', 'weapon4': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'HITCOUNT': '0.640', 'WEAPON3': '0.850', 'ARMOR': '1.105', 'weapon2': '1.664', 'weapon3': '2.092', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:29,586][52663] DAMAGECOUNT value on done: 4104.0 [2024-08-05 22:13:29,589][52663] Sum rewards: 1.904, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.507', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon5': '0.024', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'weapon3': '1.378', 'ARMOR': '1.382', 'DAMAGECOUNT': '1.830', 'weapon2': '2.180', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:29,590][52811] DAMAGECOUNT value on done: 4904.0 [2024-08-05 22:13:29,594][52811] Sum rewards: 7.387, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.900', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.085', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon3': '1.172', 'weapon2': '1.552', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:29,820][52658] DAMAGECOUNT value on done: 4753.0 [2024-08-05 22:13:29,821][52658] Sum rewards: 5.452, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.815', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'HITCOUNT': '0.450', 'ARMOR': '0.543', 'WEAPON3': '0.650', 'weapon2': '1.400', 'DAMAGECOUNT': '1.641', 'weapon3': '1.754', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:31,952][52649] DAMAGECOUNT value on done: 3881.0 [2024-08-05 22:13:32,094][52664] DAMAGECOUNT value on done: 5018.0 [2024-08-05 22:13:32,094][52664] Sum rewards: 7.685, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.159', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.072', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon3': '1.426', 'weapon2': '1.836', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:32,304][52667] DAMAGECOUNT value on done: 5862.0 [2024-08-05 22:13:32,305][52667] Sum rewards: 7.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.152', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'weapon7': '0.050', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.828', 'weapon3': '1.548', 'weapon2': '1.918', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:32,580][52803] DAMAGECOUNT value on done: 4444.0 [2024-08-05 22:13:32,580][52803] Sum rewards: 5.100, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.030', 'AMMO4': '0.044', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'HITCOUNT': '0.530', 'ARMOR': '0.880', 'WEAPON3': '0.900', 'weapon2': '1.466', 'DAMAGECOUNT': '2.052', 'weapon3': '2.062', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:32,775][52811] DAMAGECOUNT value on done: 3960.0 [2024-08-05 22:13:32,776][52811] Sum rewards: 3.536, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.214', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.106', 'AMMO3': '0.127', 'HITCOUNT': '0.560', 'ARMOR': '0.581', 'WEAPON3': '0.800', 'weapon2': '1.354', 'DAMAGECOUNT': '1.860', 'weapon3': '2.278', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 49397760. Throughput: 0: 4231.1. Samples: 12349550. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-05 22:13:32,794][52567] Avg episode reward: [(0, '3.361')] [2024-08-05 22:13:32,978][52658] DAMAGECOUNT value on done: 3917.0 [2024-08-05 22:13:32,979][52658] Sum rewards: 3.134, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.022', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.044', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.224', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'weapon2': '1.066', 'DAMAGECOUNT': '1.245', 'weapon3': '1.278', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:33,161][52671] DAMAGECOUNT value on done: 5329.0 [2024-08-05 22:13:33,162][52671] Sum rewards: 6.964, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.325', 'AMMO2': '0.012', 'AMMO4': '0.057', 'ARMOR': '0.076', 'AMMO3': '0.111', 'weapon4': '0.174', 'WEAPON4': '0.200', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.456', 'weapon3': '1.950', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:33,398][52650] Updated weights for policy 0, policy_version 6031 (0.0024) [2024-08-05 22:13:33,510][52614] Signal inference workers to stop experience collection... (1150 times) [2024-08-05 22:13:33,511][52614] Signal inference workers to resume experience collection... (1150 times) [2024-08-05 22:13:33,565][52650] InferenceWorker_p0-w0: stopping experience collection (1150 times) [2024-08-05 22:13:33,566][52650] InferenceWorker_p0-w0: resuming experience collection (1150 times) [2024-08-05 22:13:34,582][52664] DAMAGECOUNT value on done: 5095.0 [2024-08-05 22:13:34,584][52664] Sum rewards: 1.130, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.560', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'weapon4': '0.066', 'ARMOR': '0.108', 'AMMO3': '0.131', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'weapon2': '1.202', 'DAMAGECOUNT': '1.842', 'weapon3': '2.160', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:35,252][52667] DAMAGECOUNT value on done: 5090.0 [2024-08-05 22:13:35,252][52667] Sum rewards: 4.838, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.297', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'ARMOR': '0.513', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '1.510', 'weapon3': '1.746', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:35,352][52649] DAMAGECOUNT value on done: 4811.0 [2024-08-05 22:13:35,354][52649] Sum rewards: 0.731, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.128', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.460', 'ARMOR': '0.488', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.632', 'weapon3': '1.640', 'weapon2': '1.670', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:35,639][52658] DAMAGECOUNT value on done: 4361.0 [2024-08-05 22:13:35,640][52658] Sum rewards: -0.247, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.089', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.022', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'HITCOUNT': '0.380', 'ARMOR': '0.539', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.398', 'DAMAGECOUNT': '1.452', 'weapon3': '2.356'} [2024-08-05 22:13:35,854][52803] DAMAGECOUNT value on done: 5170.0 [2024-08-05 22:13:35,855][52803] Sum rewards: -1.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'ARMOR': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.140', 'HITCOUNT': '0.230', 'DAMAGECOUNT': '0.657', 'WEAPON3': '0.800', 'weapon3': '1.450', 'weapon2': '1.862', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:35,925][52811] DAMAGECOUNT value on done: 4591.0 [2024-08-05 22:13:35,925][52811] Sum rewards: 1.203, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.844', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'ARMOR': '0.465', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.554', 'weapon3': '1.662', 'weapon2': '1.724', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:36,371][52671] DAMAGECOUNT value on done: 4614.0 [2024-08-05 22:13:36,373][52671] Sum rewards: -0.985, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.724', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.099', 'HITCOUNT': '0.210', 'DAMAGECOUNT': '0.564', 'ARMOR': '0.592', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.566', 'weapon3': '1.780'} [2024-08-05 22:13:37,579][52650] Updated weights for policy 0, policy_version 6041 (0.0022) [2024-08-05 22:13:37,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16930.1, 300 sec: 17022.7). Total num frames: 49487872. Throughput: 0: 4234.0. Samples: 12375310. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:13:37,795][52567] Avg episode reward: [(0, '3.426')] [2024-08-05 22:13:37,818][52664] DAMAGECOUNT value on done: 5385.0 [2024-08-05 22:13:37,820][52664] Sum rewards: -0.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.682', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.280', 'ARMOR': '0.491', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.864', 'weapon2': '1.440', 'weapon3': '1.728', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:38,071][52649] DAMAGECOUNT value on done: 3998.0 [2024-08-05 22:13:38,074][52649] Sum rewards: 4.631, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.760', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO3': '0.077', 'HITCOUNT': '0.420', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.293', 'weapon3': '1.464', 'weapon2': '1.626', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:38,132][52667] DAMAGECOUNT value on done: 4407.0 [2024-08-05 22:13:38,135][52667] Sum rewards: 4.687, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.114', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO3': '0.131', 'ARMOR': '0.476', 'HITCOUNT': '0.820', 'WEAPON3': '0.950', 'weapon2': '1.594', 'weapon3': '2.274', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:38,567][52795] DAMAGECOUNT value on done: 3702.0 [2024-08-05 22:13:38,619][52658] DAMAGECOUNT value on done: 4908.0 [2024-08-05 22:13:38,621][52658] Sum rewards: 4.670, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.204', 'ARMOR': '0.477', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.528', 'DAMAGECOUNT': '1.554', 'weapon3': '1.698', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:39,033][52803] DAMAGECOUNT value on done: 5334.0 [2024-08-05 22:13:39,033][52803] Sum rewards: 2.789, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.122', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'WEAPON1': '0.010', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.136', 'ARMOR': '0.468', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.452', 'weapon2': '1.574', 'DAMAGECOUNT': '1.779', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:39,260][52811] DAMAGECOUNT value on done: 4641.0 [2024-08-05 22:13:39,260][52811] Sum rewards: 10.577, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.684', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.238', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'weapon3': '1.664', 'weapon2': '1.814', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '8.000'} [2024-08-05 22:13:39,421][52671] DAMAGECOUNT value on done: 4871.0 [2024-08-05 22:13:39,422][52671] Sum rewards: 8.203, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.605', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO3': '0.071', 'weapon4': '0.074', 'AMMO4': '0.081', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon3': '1.640', 'weapon2': '1.672', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:40,074][52659] DAMAGECOUNT value on done: 4177.0 [2024-08-05 22:13:40,075][52659] Sum rewards: 3.538, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.010', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.008', 'AMMO4': '0.016', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.500', 'DAMAGECOUNT': '0.996', 'weapon2': '1.282', 'weapon3': '1.360', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:40,906][52664] DAMAGECOUNT value on done: 4944.0 [2024-08-05 22:13:40,909][52664] Sum rewards: 3.699, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'AMMO3': '0.108', 'HITCOUNT': '0.410', 'WEAPON3': '0.750', 'ARMOR': '1.228', 'weapon3': '1.418', 'DAMAGECOUNT': '1.914', 'weapon2': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:41,151][52667] DAMAGECOUNT value on done: 4630.0 [2024-08-05 22:13:41,153][52667] Sum rewards: 4.414, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.083', 'weapon4': '0.132', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'HEALTH': '0.485', 'ARMOR': '0.501', 'DAMAGECOUNT': '1.326', 'weapon3': '1.410', 'weapon2': '1.708', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:41,499][52649] DAMAGECOUNT value on done: 5497.0 [2024-08-05 22:13:41,499][52649] Sum rewards: 11.164, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'AMMO4': '0.217', 'HEALTH': '0.317', 'WEAPON3': '0.350', 'ARMOR': '0.549', 'weapon4': '0.592', 'HITCOUNT': '0.710', 'weapon2': '1.160', 'weapon3': '1.254', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '8.000'} [2024-08-05 22:13:41,764][52658] DAMAGECOUNT value on done: 4249.0 [2024-08-05 22:13:41,764][52658] Sum rewards: 0.673, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.735', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO3': '0.097', 'ARMOR': '0.466', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon3': '1.476', 'DAMAGECOUNT': '1.527', 'weapon2': '1.614', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:41,835][52671] DAMAGECOUNT value on done: 4542.0 [2024-08-05 22:13:41,835][52671] Sum rewards: 1.059, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'HEALTH': '0.050', 'weapon5': '0.056', 'AMMO4': '0.058', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.400', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.290', 'weapon3': '1.364', 'weapon2': '1.642', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:41,910][52795] DAMAGECOUNT value on done: 4492.0 [2024-08-05 22:13:41,910][52795] Sum rewards: 2.229, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.186', 'AMMO2': '0.002', 'AMMO4': '0.012', 'ARMOR': '0.092', 'AMMO3': '0.130', 'HITCOUNT': '0.720', 'WEAPON3': '0.900', 'weapon2': '1.268', 'weapon3': '2.150', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:42,380][52803] DAMAGECOUNT value on done: 4653.0 [2024-08-05 22:13:42,382][52803] Sum rewards: 3.043, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'ARMOR': '0.153', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.170', 'weapon2': '1.662', 'weapon3': '1.958', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:42,403][52659] DAMAGECOUNT value on done: 5490.0 [2024-08-05 22:13:42,403][52659] Sum rewards: 7.309, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.120', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.152', 'ARMOR': '0.556', 'HITCOUNT': '0.660', 'WEAPON3': '0.950', 'weapon2': '1.424', 'weapon3': '2.188', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '9.000'} [2024-08-05 22:13:42,575][52811] DAMAGECOUNT value on done: 4877.0 [2024-08-05 22:13:42,575][52811] Sum rewards: 4.115, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.554', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.125', 'ARMOR': '0.444', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon3': '1.596', 'weapon2': '1.656', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16967.2). Total num frames: 49561600. Throughput: 0: 4234.2. Samples: 12400460. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-05 22:13:42,794][52567] Avg episode reward: [(0, '3.328')] [2024-08-05 22:13:43,043][52650] Updated weights for policy 0, policy_version 6051 (0.0022) [2024-08-05 22:13:43,987][52664] DAMAGECOUNT value on done: 4305.0 [2024-08-05 22:13:43,988][52664] Sum rewards: 6.521, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.390', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'ARMOR': '0.929', 'weapon2': '1.630', 'weapon3': '2.010', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:44,401][52667] DAMAGECOUNT value on done: 5180.0 [2024-08-05 22:13:44,401][52667] Sum rewards: 3.433, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.349', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.212', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.272', 'weapon2': '1.404', 'weapon3': '1.572', 'ARMOR': '1.774', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:44,493][52649] DAMAGECOUNT value on done: 4298.0 [2024-08-05 22:13:44,495][52649] Sum rewards: 4.987, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.134', 'HEALTH': '0.154', 'HITCOUNT': '0.460', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.638', 'weapon2': '1.682', 'weapon3': '1.718', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:44,558][52671] DAMAGECOUNT value on done: 4682.0 [2024-08-05 22:13:44,560][52671] Sum rewards: 10.922, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.052', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.071', 'weapon4': '0.126', 'WEAPON4': '0.150', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon3': '1.610', 'weapon2': '1.748', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '8.000'} [2024-08-05 22:13:44,685][52794] DAMAGECOUNT value on done: 5072.0 [2024-08-05 22:13:44,687][52794] Sum rewards: 0.998, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.985', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'weapon5': '0.008', 'AMMO5': '0.010', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.630', 'ARMOR': '0.966', 'WEAPON3': '1.100', 'weapon2': '1.470', 'DAMAGECOUNT': '2.136', 'weapon3': '2.306', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:44,792][52658] DAMAGECOUNT value on done: 3873.0 [2024-08-05 22:13:44,792][52658] Sum rewards: -0.079, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.436', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.119', 'weapon4': '0.204', 'HITCOUNT': '0.250', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.768', 'ARMOR': '0.941', 'FRAGCOUNT': '1.000', 'weapon3': '1.642', 'weapon2': '1.742'} [2024-08-05 22:13:45,303][52795] DAMAGECOUNT value on done: 4224.0 [2024-08-05 22:13:45,303][52795] Sum rewards: 8.202, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.392', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.236', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon2': '1.358', 'weapon3': '1.500', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:45,432][52659] DAMAGECOUNT value on done: 4732.0 [2024-08-05 22:13:45,432][52659] Sum rewards: -0.242, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.740', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO3': '0.102', 'HITCOUNT': '0.210', 'WEAPON5': '0.250', 'ARMOR': '0.485', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.855', 'weapon3': '1.606', 'weapon2': '1.868', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:45,588][52803] DAMAGECOUNT value on done: 4973.0 [2024-08-05 22:13:45,590][52803] Sum rewards: 2.388, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.028', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'HITCOUNT': '0.290', 'ARMOR': '0.450', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.080', 'weapon2': '1.148', 'weapon3': '1.354', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:45,785][52811] DAMAGECOUNT value on done: 4303.0 [2024-08-05 22:13:45,785][52811] Sum rewards: 1.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.034', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.948', 'weapon2': '1.284', 'DAMAGECOUNT': '1.395', 'weapon3': '1.920', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:46,972][52664] DAMAGECOUNT value on done: 4200.0 [2024-08-05 22:13:46,977][52664] Sum rewards: 1.250, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.579', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.338', 'ARMOR': '0.456', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.286', 'DAMAGECOUNT': '1.452', 'weapon3': '1.614', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:47,134][52794] DAMAGECOUNT value on done: 4542.0 [2024-08-05 22:13:47,134][52794] Sum rewards: 1.227, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.012', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.140', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'ARMOR': '0.596', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.981', 'weapon3': '1.452', 'weapon2': '1.742', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:47,177][52649] DAMAGECOUNT value on done: 4282.0 [2024-08-05 22:13:47,178][52649] Sum rewards: 4.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.321', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'HITCOUNT': '0.700', 'ARMOR': '0.844', 'weapon2': '1.078', 'WEAPON3': '1.150', 'weapon3': '2.596', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:47,273][52650] Updated weights for policy 0, policy_version 6061 (0.0017) [2024-08-05 22:13:47,382][52667] DAMAGECOUNT value on done: 4526.0 [2024-08-05 22:13:47,384][52667] Sum rewards: 2.869, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.119', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.611', 'weapon2': '1.734', 'ARMOR': '1.791', 'weapon3': '2.118', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:47,707][52671] DAMAGECOUNT value on done: 4265.0 [2024-08-05 22:13:47,708][52671] Sum rewards: 3.678, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.039', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'ARMOR': '0.956', 'DAMAGECOUNT': '1.347', 'weapon2': '1.416', 'weapon3': '1.736', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.2, 300 sec: 17022.7). Total num frames: 49659904. Throughput: 0: 4238.2. Samples: 12413200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 22:13:47,794][52567] Avg episode reward: [(0, '3.332')] [2024-08-05 22:13:47,937][52658] DAMAGECOUNT value on done: 4431.0 [2024-08-05 22:13:47,942][52658] Sum rewards: 2.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.028', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.142', 'HITCOUNT': '0.400', 'ARMOR': '0.504', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.377', 'weapon2': '1.828', 'weapon3': '1.870', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:48,129][52662] DAMAGECOUNT value on done: 4949.0 [2024-08-05 22:13:48,129][52662] Sum rewards: 3.333, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.036', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'ARMOR': '1.379', 'DAMAGECOUNT': '1.539', 'weapon3': '1.646', 'weapon2': '1.882', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:48,406][52659] DAMAGECOUNT value on done: 4759.0 [2024-08-05 22:13:48,407][52659] Sum rewards: 1.605, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.247', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.276', 'HITCOUNT': '0.380', 'WEAPON3': '0.850', 'ARMOR': '0.969', 'DAMAGECOUNT': '1.173', 'weapon2': '1.414', 'weapon3': '2.042', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:48,736][52795] DAMAGECOUNT value on done: 5521.0 [2024-08-05 22:13:48,736][52795] Sum rewards: 6.159, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.763', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.278', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'ARMOR': '0.946', 'weapon3': '1.644', 'weapon2': '1.714', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:48,891][52811] DAMAGECOUNT value on done: 4957.0 [2024-08-05 22:13:48,894][52811] Sum rewards: 6.256, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.098', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.111', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'ARMOR': '0.858', 'weapon2': '1.482', 'weapon3': '1.744', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:48,935][52803] DAMAGECOUNT value on done: 5117.0 [2024-08-05 22:13:48,936][52803] Sum rewards: 7.914, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.589', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO3': '0.088', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'ARMOR': '1.354', 'weapon2': '1.458', 'weapon3': '1.698', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:49,428][52794] DAMAGECOUNT value on done: 5950.0 [2024-08-05 22:13:49,430][52794] Sum rewards: 3.418, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.446', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.075', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.520', 'ARMOR': '0.538', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.500', 'weapon3': '1.506', 'weapon2': '1.774', 'DAMAGECOUNT': '1.905'} [2024-08-05 22:13:50,251][52671] DAMAGECOUNT value on done: 5352.0 [2024-08-05 22:13:50,251][52671] Sum rewards: 5.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.332', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.054', 'ARMOR': '0.064', 'AMMO3': '0.107', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.730', 'weapon3': '1.868', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:50,372][52649] DAMAGECOUNT value on done: 4676.0 [2024-08-05 22:13:50,374][52649] Sum rewards: 7.029, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.060', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.024', 'AMMO3': '0.080', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon2': '1.334', 'DAMAGECOUNT': '1.470', 'weapon3': '1.732', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:50,417][52664] DAMAGECOUNT value on done: 3707.0 [2024-08-05 22:13:50,419][52664] Sum rewards: 7.789, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.415', 'AMMO2': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.073', 'AMMO3': '0.116', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '1.416', 'weapon3': '2.012', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '8.000'} [2024-08-05 22:13:50,481][52662] DAMAGECOUNT value on done: 5020.0 [2024-08-05 22:13:50,481][52662] Sum rewards: 1.685, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.018', 'weapon7': '0.020', 'HEALTH': '0.032', 'AMMO4': '0.092', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon3': '0.988', 'weapon2': '1.492', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:50,540][52667] DAMAGECOUNT value on done: 5065.0 [2024-08-05 22:13:50,545][52667] Sum rewards: 4.137, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.157', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.060', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'ARMOR': '0.489', 'weapon3': '1.252', 'DAMAGECOUNT': '1.260', 'weapon2': '1.314', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:51,126][52658] DAMAGECOUNT value on done: 5445.0 [2024-08-05 22:13:51,127][52658] Sum rewards: 6.402, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.463', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.107', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.106', 'weapon3': '1.986', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:51,164][52659] DAMAGECOUNT value on done: 4050.0 [2024-08-05 22:13:51,165][52659] Sum rewards: 1.053, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.173', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'HITCOUNT': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.588', 'ARMOR': '0.914', 'FRAGCOUNT': '1.000', 'weapon2': '1.352', 'weapon3': '1.626'} [2024-08-05 22:13:51,764][52794] DAMAGECOUNT value on done: 5153.0 [2024-08-05 22:13:51,766][52794] Sum rewards: -1.371, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.740', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'HITCOUNT': '0.270', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.810', 'FRAGCOUNT': '1.000', 'weapon3': '1.872', 'weapon2': '1.986'} [2024-08-05 22:13:52,055][52795] DAMAGECOUNT value on done: 4812.0 [2024-08-05 22:13:52,059][52795] Sum rewards: 6.722, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.187', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.066', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'ARMOR': '0.848', 'weapon2': '1.730', 'weapon3': '1.770', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:52,101][52803] DAMAGECOUNT value on done: 3871.0 [2024-08-05 22:13:52,104][52803] Sum rewards: 2.022, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.589', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'weapon5': '0.036', 'AMMO3': '0.050', 'HITCOUNT': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'DAMAGECOUNT': '0.501', 'ARMOR': '0.986', 'weapon3': '1.178', 'weapon2': '1.694', 'FRAGCOUNT': '2.000'} [2024-08-05 22:13:52,229][52811] DAMAGECOUNT value on done: 2802.0 [2024-08-05 22:13:52,230][52811] Sum rewards: 3.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.658', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.096', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.143', 'ARMOR': '1.368', 'weapon2': '1.564', 'weapon3': '1.984', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:52,296][52668] DAMAGECOUNT value on done: 4576.0 [2024-08-05 22:13:52,296][52668] Sum rewards: 2.844, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.085', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'ARMOR': '0.917', 'weapon2': '1.216', 'weapon3': '1.398', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:52,630][52650] Updated weights for policy 0, policy_version 6071 (0.0022) [2024-08-05 22:13:52,778][52662] DAMAGECOUNT value on done: 5140.0 [2024-08-05 22:13:52,779][52662] Sum rewards: 4.038, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.498', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.120', 'HITCOUNT': '0.530', 'WEAPON3': '0.900', 'ARMOR': '0.900', 'weapon2': '1.554', 'DAMAGECOUNT': '1.809', 'weapon3': '2.002', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16967.7). Total num frames: 49733632. Throughput: 0: 4229.8. Samples: 12438460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:13:52,794][52567] Avg episode reward: [(0, '3.438')] [2024-08-05 22:13:53,219][52649] DAMAGECOUNT value on done: 3675.0 [2024-08-05 22:13:53,221][52649] Sum rewards: 7.472, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.698', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.009', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.112', 'ARMOR': '0.446', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon3': '1.400', 'weapon2': '1.506', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '6.500'} [2024-08-05 22:13:53,499][52671] DAMAGECOUNT value on done: 3438.0 [2024-08-05 22:13:53,500][52671] Sum rewards: 9.853, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.455', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.032', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.806', 'weapon3': '1.858', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '9.000'} [2024-08-05 22:13:53,613][52664] DAMAGECOUNT value on done: 3878.0 [2024-08-05 22:13:53,615][52664] Sum rewards: 3.729, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.195', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.038', 'ARMOR': '0.040', 'AMMO4': '0.071', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.077', 'weapon3': '1.518', 'weapon2': '1.656', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:54,179][52658] DAMAGECOUNT value on done: 5373.0 [2024-08-05 22:13:54,181][52658] Sum rewards: 5.068, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'weapon4': '0.144', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'ARMOR': '1.419', 'weapon2': '1.666', 'weapon3': '1.868', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:54,223][52794] DAMAGECOUNT value on done: 5162.0 [2024-08-05 22:13:54,224][52794] Sum rewards: 5.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.101', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.950', 'weapon2': '1.358', 'DAMAGECOUNT': '2.175', 'weapon3': '2.296', 'FRAGCOUNT': '6.000'} [2024-08-05 22:13:54,355][52659] DAMAGECOUNT value on done: 3861.0 [2024-08-05 22:13:54,356][52659] Sum rewards: 3.960, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.408', 'AMMO2': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'weapon5': '0.088', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.750', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.296', 'weapon2': '1.588', 'weapon3': '1.876', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:55,204][52668] DAMAGECOUNT value on done: 4843.0 [2024-08-05 22:13:55,206][52668] Sum rewards: 5.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.776', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON1': '0.040', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'ARMOR': '0.988', 'weapon3': '1.304', 'DAMAGECOUNT': '1.590', 'weapon2': '1.682', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:55,268][52662] DAMAGECOUNT value on done: 4389.0 [2024-08-05 22:13:55,269][52662] Sum rewards: -0.517, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.008', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.124', 'HITCOUNT': '0.430', 'ARMOR': '0.480', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.404', 'weapon3': '1.484', 'FRAGCOUNT': '2.000', 'weapon2': '2.022'} [2024-08-05 22:13:55,313][52803] DAMAGECOUNT value on done: 4404.0 [2024-08-05 22:13:55,488][52795] DAMAGECOUNT value on done: 5053.0 [2024-08-05 22:13:55,490][52795] Sum rewards: 5.396, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.416', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.030', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.142', 'WEAPON3': '0.250', 'HITCOUNT': '0.410', 'ARMOR': '0.518', 'weapon3': '0.700', 'weapon2': '1.264', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:55,664][52811] DAMAGECOUNT value on done: 3356.0 [2024-08-05 22:13:55,666][52811] Sum rewards: 0.963, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.454', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.200', 'HITCOUNT': '0.370', 'ARMOR': '0.480', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.214', 'DAMAGECOUNT': '1.257', 'weapon3': '1.348'} [2024-08-05 22:13:56,123][52671] DAMAGECOUNT value on done: 5228.0 [2024-08-05 22:13:56,124][52671] Sum rewards: 2.455, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.292', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'weapon4': '0.370', 'WEAPON3': '0.500', 'ARMOR': '0.563', 'weapon3': '1.064', 'DAMAGECOUNT': '1.248', 'weapon2': '1.492', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:56,631][52794] DAMAGECOUNT value on done: 5182.0 [2024-08-05 22:13:56,632][52794] Sum rewards: 1.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.350', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.113', 'HITCOUNT': '0.420', 'WEAPON3': '0.700', 'ARMOR': '0.848', 'DAMAGECOUNT': '1.155', 'weapon2': '1.610', 'weapon3': '1.888', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:56,879][52650] Updated weights for policy 0, policy_version 6081 (0.0013) [2024-08-05 22:13:56,940][52659] DAMAGECOUNT value on done: 4709.0 [2024-08-05 22:13:56,942][52659] Sum rewards: 0.268, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon4': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'HITCOUNT': '0.570', 'WEAPON3': '0.950', 'ARMOR': '0.985', 'weapon2': '1.450', 'DAMAGECOUNT': '1.683', 'weapon3': '1.794', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:56,987][52664] DAMAGECOUNT value on done: 4778.0 [2024-08-05 22:13:56,987][52664] Sum rewards: 6.884, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.570', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.150', 'ARMOR': '0.464', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon3': '1.182', 'weapon2': '1.394', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:57,046][52649] DAMAGECOUNT value on done: 4701.0 [2024-08-05 22:13:57,046][52649] Sum rewards: 5.738, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.267', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.040', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'ARMOR': '0.800', 'weapon2': '1.272', 'weapon3': '1.686', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:57,104][52658] DAMAGECOUNT value on done: 4680.0 [2024-08-05 22:13:57,107][52658] Sum rewards: 2.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.661', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.102', 'weapon4': '0.154', 'WEAPON4': '0.250', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'ARMOR': '1.061', 'weapon3': '1.626', 'weapon2': '1.678', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:57,638][52662] DAMAGECOUNT value on done: 4822.0 [2024-08-05 22:13:57,638][52662] Sum rewards: 4.601, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.539', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.106', 'ARMOR': '0.432', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.560', 'weapon2': '1.666', 'weapon3': '1.916', 'FRAGCOUNT': '5.000'} [2024-08-05 22:13:57,778][52660] DAMAGECOUNT value on done: 4693.0 [2024-08-05 22:13:57,779][52660] Sum rewards: 3.301, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.988', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.117', 'HITCOUNT': '0.500', 'ARMOR': '0.507', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.620', 'weapon3': '1.754', 'weapon2': '1.776', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:57,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17066.7, 300 sec: 16967.1). Total num frames: 49823744. Throughput: 0: 4232.0. Samples: 12463640. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:13:57,802][52567] Avg episode reward: [(0, '3.623')] [2024-08-05 22:13:58,427][52668] DAMAGECOUNT value on done: 4116.0 [2024-08-05 22:13:58,427][52668] Sum rewards: 1.447, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.815', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.258', 'HITCOUNT': '0.540', 'ARMOR': '0.551', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.384', 'DAMAGECOUNT': '1.500', 'weapon2': '1.690'} [2024-08-05 22:13:58,572][52803] DAMAGECOUNT value on done: 3962.0 [2024-08-05 22:13:58,575][52803] Sum rewards: 3.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.188', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.108', 'ARMOR': '0.435', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon3': '1.442', 'DAMAGECOUNT': '1.593', 'weapon2': '1.696', 'FRAGCOUNT': '4.000'} [2024-08-05 22:13:58,623][52671] DAMAGECOUNT value on done: 4759.0 [2024-08-05 22:13:58,624][52671] Sum rewards: 1.102, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.539', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.144', 'HITCOUNT': '0.360', 'WEAPON3': '0.700', 'ARMOR': '0.965', 'DAMAGECOUNT': '1.440', 'weapon2': '1.442', 'FRAGCOUNT': '2.000', 'weapon3': '2.122'} [2024-08-05 22:13:58,847][52795] DAMAGECOUNT value on done: 4454.0 [2024-08-05 22:13:58,847][52795] Sum rewards: -0.567, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.058', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'weapon4': '0.172', 'HITCOUNT': '0.210', 'ARMOR': '0.516', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.657', 'FRAGCOUNT': '1.000', 'weapon2': '1.166', 'weapon3': '1.338'} [2024-08-05 22:13:58,878][52811] DAMAGECOUNT value on done: 4957.0 [2024-08-05 22:13:58,879][52811] Sum rewards: 9.136, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.266', 'ARMOR': '0.535', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '1.674', 'weapon3': '1.686', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '9.000'} [2024-08-05 22:13:59,043][52794] DAMAGECOUNT value on done: 5145.0 [2024-08-05 22:13:59,044][52794] Sum rewards: 4.487, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.081', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'ARMOR': '0.853', 'weapon3': '1.714', 'weapon2': '1.820', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '7.000'} [2024-08-05 22:13:59,587][52659] DAMAGECOUNT value on done: 3773.0 [2024-08-05 22:13:59,589][52659] Sum rewards: 3.641, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.326', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.060', 'HITCOUNT': '0.280', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.038', 'weapon3': '1.238', 'weapon2': '1.274', 'FRAGCOUNT': '3.000'} [2024-08-05 22:13:59,984][52658] DAMAGECOUNT value on done: 4518.0 [2024-08-05 22:13:59,987][52658] Sum rewards: 4.340, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.325', 'AMMO5': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.017', 'ARMOR': '0.032', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'HITCOUNT': '0.460', 'WEAPON3': '1.000', 'weapon2': '1.422', 'DAMAGECOUNT': '1.812', 'weapon3': '2.380', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:00,185][52662] DAMAGECOUNT value on done: 5510.0 [2024-08-05 22:14:00,188][52662] Sum rewards: 5.021, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.791', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'ARMOR': '0.926', 'weapon2': '1.466', 'DAMAGECOUNT': '2.118', 'weapon3': '2.290', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:00,358][52664] DAMAGECOUNT value on done: 4186.0 [2024-08-05 22:14:00,359][52664] Sum rewards: -0.422, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.301', 'AMMO2': '0.014', 'AMMO4': '0.067', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.131', 'HITCOUNT': '0.460', 'WEAPON3': '0.850', 'weapon2': '1.406', 'DAMAGECOUNT': '1.635', 'weapon3': '2.022', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:00,396][52649] DAMAGECOUNT value on done: 4639.0 [2024-08-05 22:14:00,396][52649] Sum rewards: 2.463, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.256', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.220', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'FRAGCOUNT': '1.000', 'ARMOR': '1.030', 'weapon3': '1.424', 'DAMAGECOUNT': '1.464', 'weapon2': '1.580'} [2024-08-05 22:14:00,516][52660] DAMAGECOUNT value on done: 6147.0 [2024-08-05 22:14:00,516][52660] Sum rewards: 6.447, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.695', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.075', 'ARMOR': '0.124', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon3': '1.546', 'weapon2': '1.584', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:01,269][52668] DAMAGECOUNT value on done: 4284.0 [2024-08-05 22:14:01,269][52668] Sum rewards: 2.297, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.342', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'ARMOR': '0.032', 'weapon5': '0.074', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.242', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.230', 'weapon2': '1.424', 'weapon3': '1.604', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:01,543][52794] DAMAGECOUNT value on done: 4192.0 [2024-08-05 22:14:01,782][52803] DAMAGECOUNT value on done: 4121.0 [2024-08-05 22:14:01,783][52671] DAMAGECOUNT value on done: 4807.0 [2024-08-05 22:14:01,783][52803] Sum rewards: 6.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.980', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.123', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'ARMOR': '0.893', 'weapon2': '1.722', 'weapon3': '1.872', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:01,785][52671] Sum rewards: 5.102, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.024', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO3': '0.120', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'ARMOR': '1.024', 'weapon2': '1.554', 'weapon3': '2.302', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:02,132][52811] DAMAGECOUNT value on done: 4813.0 [2024-08-05 22:14:02,132][52811] Sum rewards: 4.925, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.688', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon5': '0.006', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.250', 'ARMOR': '0.504', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '1.586', 'weapon3': '2.112', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:02,224][52795] DAMAGECOUNT value on done: 4712.0 [2024-08-05 22:14:02,224][52795] Sum rewards: 0.316, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.134', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'HITCOUNT': '0.360', 'ARMOR': '0.448', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.242', 'weapon2': '1.392', 'weapon3': '2.140', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:02,344][52650] Updated weights for policy 0, policy_version 6091 (0.0018) [2024-08-05 22:14:02,413][52662] DAMAGECOUNT value on done: 6222.0 [2024-08-05 22:14:02,722][52659] DAMAGECOUNT value on done: 5105.0 [2024-08-05 22:14:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16793.6, 300 sec: 16939.4). Total num frames: 49905664. Throughput: 0: 4231.3. Samples: 12476260. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:14:02,795][52567] Avg episode reward: [(0, '3.579')] [2024-08-05 22:14:03,134][52660] DAMAGECOUNT value on done: 4128.0 [2024-08-05 22:14:03,135][52660] Sum rewards: 1.358, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.314', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon7': '0.052', 'weapon4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.530', 'ARMOR': '0.539', 'WEAPON3': '0.800', 'weapon2': '1.506', 'weapon3': '1.832', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:03,270][52658] DAMAGECOUNT value on done: 4445.0 [2024-08-05 22:14:03,272][52658] Sum rewards: 0.474, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.858', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.032', 'AMMO4': '0.060', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.852', 'ARMOR': '0.891', 'weapon3': '1.308', 'weapon2': '1.442', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:03,647][52649] DAMAGECOUNT value on done: 4952.0 [2024-08-05 22:14:03,647][52649] Sum rewards: 1.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.069', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.048', 'AMMO3': '0.151', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'weapon2': '1.244', 'DAMAGECOUNT': '1.542', 'weapon3': '2.462', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:03,695][52664] DAMAGECOUNT value on done: 4417.0 [2024-08-05 22:14:03,696][52664] Sum rewards: 4.474, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.488', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'weapon4': '0.172', 'HITCOUNT': '0.320', 'WEAPON3': '0.850', 'ARMOR': '1.000', 'DAMAGECOUNT': '1.074', 'weapon2': '1.424', 'weapon3': '2.146', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:03,895][52668] DAMAGECOUNT value on done: 4460.0 [2024-08-05 22:14:03,897][52668] Sum rewards: 6.336, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.538', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.140', 'HITCOUNT': '0.670', 'WEAPON3': '0.900', 'weapon2': '1.322', 'weapon3': '2.150', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '8.000'} [2024-08-05 22:14:04,301][52794] DAMAGECOUNT value on done: 5907.0 [2024-08-05 22:14:04,302][52794] Sum rewards: 6.619, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.676', 'AMMO2': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.151', 'ARMOR': '0.480', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.752', 'weapon3': '1.976', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '8.000'} [2024-08-05 22:14:04,780][52671] DAMAGECOUNT value on done: 5851.0 [2024-08-05 22:14:04,781][52671] Sum rewards: 3.133, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.787', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon4': '0.194', 'HITCOUNT': '0.410', 'ARMOR': '0.495', 'WEAPON3': '0.500', 'weapon2': '1.096', 'DAMAGECOUNT': '1.278', 'weapon3': '1.336', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:05,119][52803] DAMAGECOUNT value on done: 4758.0 [2024-08-05 22:14:05,120][52803] Sum rewards: 4.969, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.172', 'weapon4': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.040', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'ARMOR': '0.495', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.606', 'DAMAGECOUNT': '1.740', 'weapon3': '1.814', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:05,259][52662] DAMAGECOUNT value on done: 5819.0 [2024-08-05 22:14:05,259][52662] Sum rewards: 7.340, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.408', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.160', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.522', 'weapon2': '1.032', 'DAMAGECOUNT': '1.338', 'weapon3': '1.386', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:05,372][52811] DAMAGECOUNT value on done: 4654.0 [2024-08-05 22:14:05,373][52811] Sum rewards: 0.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.928', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.128', 'HITCOUNT': '0.520', 'WEAPON3': '0.900', 'weapon2': '0.950', 'DAMAGECOUNT': '1.710', 'weapon3': '2.238', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:05,401][52795] DAMAGECOUNT value on done: 4942.0 [2024-08-05 22:14:05,402][52795] Sum rewards: 5.443, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.788', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon3': '1.600', 'weapon2': '1.826', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:05,672][52659] DAMAGECOUNT value on done: 5010.0 [2024-08-05 22:14:05,673][52659] Sum rewards: 2.953, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.672', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.208', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.880', 'weapon3': '1.440', 'weapon2': '1.480', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:05,817][52658] DAMAGECOUNT value on done: 4680.0 [2024-08-05 22:14:05,819][52658] Sum rewards: 4.078, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.157', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'HITCOUNT': '0.330', 'WEAPON3': '0.700', 'ARMOR': '0.943', 'DAMAGECOUNT': '1.056', 'weapon3': '1.628', 'weapon2': '1.958', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:06,304][52660] DAMAGECOUNT value on done: 4292.0 [2024-08-05 22:14:06,305][52660] Sum rewards: 3.459, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.178', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'weapon5': '0.158', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'FRAGCOUNT': '1.500', 'weapon3': '1.594', 'weapon2': '1.668', 'DAMAGECOUNT': '2.136'} [2024-08-05 22:14:06,708][52650] Updated weights for policy 0, policy_version 6101 (0.0014) [2024-08-05 22:14:06,795][52664] DAMAGECOUNT value on done: 4234.0 [2024-08-05 22:14:06,797][52664] Sum rewards: 0.132, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.024', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.420', 'ARMOR': '0.528', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.494', 'weapon2': '1.616', 'weapon3': '1.916', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:06,982][52794] DAMAGECOUNT value on done: 5052.0 [2024-08-05 22:14:06,982][52794] Sum rewards: 7.312, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.974', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'weapon7': '0.072', 'AMMO3': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'ARMOR': '0.903', 'weapon2': '1.388', 'weapon3': '1.884', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:07,171][52668] DAMAGECOUNT value on done: 5047.0 [2024-08-05 22:14:07,173][52668] Sum rewards: 2.196, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.612', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.006', 'AMMO4': '0.012', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'ARMOR': '0.547', 'DAMAGECOUNT': '0.915', 'weapon2': '0.996', 'weapon3': '1.186', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:07,604][52671] DAMAGECOUNT value on done: 5399.0 [2024-08-05 22:14:07,606][52671] Sum rewards: 5.936, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon4': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.089', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'HEALTH': '0.676', 'weapon2': '1.488', 'weapon3': '1.636', 'DAMAGECOUNT': '1.659', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:07,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 16911.6). Total num frames: 49987584. Throughput: 0: 4226.2. Samples: 12501360. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:14:07,794][52567] Avg episode reward: [(0, '3.685')] [2024-08-05 22:14:07,956][52662] DAMAGECOUNT value on done: 5723.0 [2024-08-05 22:14:07,956][52662] Sum rewards: -0.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.196', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.224', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'ARMOR': '0.944', 'DAMAGECOUNT': '1.527', 'weapon2': '1.552', 'weapon3': '1.846', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:08,438][52659] DAMAGECOUNT value on done: 5010.0 [2024-08-05 22:14:08,438][52659] Sum rewards: 6.524, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.275', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.119', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'ARMOR': '0.508', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon3': '1.528', 'weapon2': '1.970', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:08,510][52803] DAMAGECOUNT value on done: 4996.0 [2024-08-05 22:14:08,510][52803] Sum rewards: 2.575, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.872', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'HITCOUNT': '0.400', 'ARMOR': '0.516', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.443', 'weapon3': '1.538', 'weapon2': '2.084', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:08,579][52795] DAMAGECOUNT value on done: 4188.0 [2024-08-05 22:14:08,580][52795] Sum rewards: 1.555, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.390', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.111', 'weapon4': '0.132', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.468', 'DAMAGECOUNT': '1.506', 'weapon3': '1.612'} [2024-08-05 22:14:08,690][52811] DAMAGECOUNT value on done: 5009.0 [2024-08-05 22:14:08,692][52811] Sum rewards: 1.884, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.008', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'ARMOR': '0.432', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.722', 'weapon3': '1.756', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.280'} [2024-08-05 22:14:09,343][52794] DAMAGECOUNT value on done: 4936.0 [2024-08-05 22:14:09,345][52794] Sum rewards: 2.352, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.304', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.410', 'WEAPON3': '0.800', 'ARMOR': '0.829', 'DAMAGECOUNT': '1.485', 'weapon2': '1.656', 'weapon3': '2.084', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:09,634][52660] DAMAGECOUNT value on done: 3754.0 [2024-08-05 22:14:09,635][52660] Sum rewards: 2.179, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.436', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon4': '0.174', 'HITCOUNT': '0.340', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.029', 'weapon3': '1.234', 'weapon2': '1.440', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:09,936][52664] DAMAGECOUNT value on done: 3983.0 [2024-08-05 22:14:09,937][52664] Sum rewards: 4.851, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.025', 'AMMO2': '0.008', 'ARMOR': '0.030', 'AMMO4': '0.038', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'weapon3': '0.940', 'DAMAGECOUNT': '0.996', 'weapon2': '1.258', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:10,502][52662] DAMAGECOUNT value on done: 5288.0 [2024-08-05 22:14:10,503][52662] Sum rewards: 5.275, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.126', 'ARMOR': '0.470', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.490', 'weapon3': '1.542', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:10,567][52671] DAMAGECOUNT value on done: 4010.0 [2024-08-05 22:14:10,568][52671] Sum rewards: 4.720, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.700', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'ARMOR': '0.032', 'AMMO3': '0.066', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.062', 'weapon2': '1.394', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:10,593][52668] DAMAGECOUNT value on done: 6700.0 [2024-08-05 22:14:10,593][52668] Sum rewards: 6.386, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.087', 'HEALTH': '0.120', 'AMMO3': '0.123', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.808', 'weapon3': '1.814', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:11,139][52659] DAMAGECOUNT value on done: 4726.0 [2024-08-05 22:14:11,139][52659] Sum rewards: 4.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.194', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '0.988', 'weapon3': '1.558', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:11,722][52794] DAMAGECOUNT value on done: 5585.0 [2024-08-05 22:14:11,723][52794] Sum rewards: 2.781, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.330', 'ARMOR': '0.496', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.110', 'weapon2': '1.236', 'weapon3': '2.122', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:11,789][52803] DAMAGECOUNT value on done: 4351.0 [2024-08-05 22:14:11,791][52803] Sum rewards: 0.302, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.158', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'WEAPON3': '0.950', 'weapon2': '1.370', 'DAMAGECOUNT': '1.845', 'weapon3': '1.906', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:11,991][52795] DAMAGECOUNT value on done: 3942.0 [2024-08-05 22:14:11,992][52795] Sum rewards: 5.327, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.460', 'AMMO4': '-0.101', 'AMMO2': '-0.020', 'AMMO5': '0.010', 'ARMOR': '0.045', 'AMMO3': '0.070', 'WEAPON5': '0.200', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.575', 'weapon2': '1.640', 'weapon3': '1.698', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:12,011][52811] DAMAGECOUNT value on done: 3588.0 [2024-08-05 22:14:12,012][52811] Sum rewards: 3.490, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.539', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'HITCOUNT': '0.390', 'ARMOR': '0.518', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.173', 'weapon3': '1.562', 'weapon2': '1.824', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:12,116][52650] Updated weights for policy 0, policy_version 6111 (0.0013) [2024-08-05 22:14:12,557][52660] DAMAGECOUNT value on done: 5315.0 [2024-08-05 22:14:12,557][52660] Sum rewards: 4.478, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.079', 'weapon5': '0.108', 'WEAPON4': '0.300', 'weapon4': '0.322', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.022', 'weapon2': '1.666', 'DAMAGECOUNT': '1.911', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:12,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.5, 300 sec: 16883.8). Total num frames: 50069504. Throughput: 0: 4229.1. Samples: 12527180. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 22:14:12,800][52664] DAMAGECOUNT value on done: 5571.0 [2024-08-05 22:14:12,802][52567] Avg episode reward: [(0, '3.565')] [2024-08-05 22:14:12,802][52664] Sum rewards: 6.351, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.054', 'AMMO3': '0.070', 'AMMO4': '0.112', 'ARMOR': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.362', 'weapon4': '0.390', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '1.426', 'weapon2': '1.502', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:12,872][52671] DAMAGECOUNT value on done: 5214.0 [2024-08-05 22:14:12,873][52671] Sum rewards: 4.119, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.108', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.070', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'ARMOR': '0.489', 'weapon2': '0.940', 'DAMAGECOUNT': '1.110', 'weapon3': '1.346', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:13,272][52662] DAMAGECOUNT value on done: 4977.0 [2024-08-05 22:14:13,273][52662] Sum rewards: -1.470, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.185', 'HITCOUNT': '0.330', 'ARMOR': '0.885', 'DAMAGECOUNT': '0.972', 'WEAPON3': '1.200', 'weapon2': '1.508', 'weapon3': '2.176', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:13,397][52668] DAMAGECOUNT value on done: 4312.0 [2024-08-05 22:14:13,397][52668] Sum rewards: 2.381, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.390', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.126', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'ARMOR': '0.971', 'weapon3': '1.170', 'DAMAGECOUNT': '1.278', 'weapon2': '1.660', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:14,045][52659] DAMAGECOUNT value on done: 4795.0 [2024-08-05 22:14:14,045][52659] Sum rewards: 1.378, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'ARMOR': '0.978', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.449', 'weapon2': '1.624', 'weapon3': '1.848'} [2024-08-05 22:14:14,460][52794] DAMAGECOUNT value on done: 4884.0 [2024-08-05 22:14:14,461][52794] Sum rewards: 1.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.038', 'weapon4': '0.064', 'AMMO4': '0.098', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.461', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.768', 'weapon3': '1.850', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:15,005][52803] DAMAGECOUNT value on done: 3899.0 [2024-08-05 22:14:15,007][52803] Sum rewards: 2.586, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.875', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'AMMO3': '0.080', 'ARMOR': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon3': '1.430', 'DAMAGECOUNT': '1.623', 'weapon2': '1.784', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:15,327][52795] DAMAGECOUNT value on done: 4107.0 [2024-08-05 22:14:15,328][52795] Sum rewards: 5.978, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.820', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.084', 'WEAPON4': '0.250', 'weapon4': '0.396', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.578', 'weapon2': '1.442', 'weapon3': '1.604', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:15,352][52660] DAMAGECOUNT value on done: 4514.0 [2024-08-05 22:14:15,353][52660] Sum rewards: 4.609, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.090', 'HEALTH': '0.104', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.204', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.593', 'DAMAGECOUNT': '1.575', 'weapon2': '1.600', 'weapon3': '1.730', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:15,410][52811] DAMAGECOUNT value on done: 4627.0 [2024-08-05 22:14:15,412][52811] Sum rewards: 8.841, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.040', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.250', 'weapon4': '0.360', 'ARMOR': '0.586', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon3': '1.224', 'weapon2': '1.684', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:15,511][52662] DAMAGECOUNT value on done: 4356.0 [2024-08-05 22:14:15,512][52662] Sum rewards: 2.250, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.786', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.178', 'HITCOUNT': '0.430', 'ARMOR': '0.516', 'WEAPON3': '0.600', 'weapon2': '1.390', 'DAMAGECOUNT': '1.425', 'weapon3': '1.672', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:15,946][52671] DAMAGECOUNT value on done: 3888.0 [2024-08-05 22:14:15,948][52671] Sum rewards: 5.157, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.414', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.328', 'weapon2': '1.630', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:16,055][52668] DAMAGECOUNT value on done: 4799.0 [2024-08-05 22:14:16,055][52668] Sum rewards: 3.346, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.692', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'ARMOR': '0.024', 'AMMO3': '0.094', 'HITCOUNT': '0.410', 'WEAPON3': '0.600', 'weapon2': '1.280', 'weapon3': '1.302', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:16,531][52650] Updated weights for policy 0, policy_version 6121 (0.0040) [2024-08-05 22:14:16,914][52794] DAMAGECOUNT value on done: 6231.0 [2024-08-05 22:14:16,914][52794] Sum rewards: 4.875, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.018', 'AMMO4': '0.070', 'AMMO3': '0.070', 'HEALTH': '0.079', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'weapon3': '1.380', 'DAMAGECOUNT': '1.515', 'weapon2': '1.960', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:16,967][52659] DAMAGECOUNT value on done: 5750.0 [2024-08-05 22:14:16,969][52659] Sum rewards: 2.024, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.956', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'ARMOR': '0.081', 'AMMO3': '0.106', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon2': '1.726', 'DAMAGECOUNT': '1.926', 'weapon3': '2.088', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16883.8). Total num frames: 50159616. Throughput: 0: 4227.3. Samples: 12539780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:14:17,794][52567] Avg episode reward: [(0, '3.517')] [2024-08-05 22:14:17,863][52662] DAMAGECOUNT value on done: 5454.0 [2024-08-05 22:14:17,863][52662] Sum rewards: 3.589, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.644', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.121', 'HITCOUNT': '0.430', 'WEAPON3': '0.700', 'ARMOR': '1.260', 'DAMAGECOUNT': '1.425', 'weapon2': '1.770', 'weapon3': '1.780', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:18,308][52803] DAMAGECOUNT value on done: 3920.0 [2024-08-05 22:14:18,309][52803] Sum rewards: 2.333, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.592', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.114', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'ARMOR': '1.302', 'weapon2': '1.454', 'DAMAGECOUNT': '1.746', 'weapon3': '2.228', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:18,465][52660] DAMAGECOUNT value on done: 4142.0 [2024-08-05 22:14:18,465][52660] Sum rewards: 4.234, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.720', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.040', 'AMMO3': '0.091', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon3': '1.628', 'DAMAGECOUNT': '2.007', 'weapon2': '2.220', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:18,594][52811] DAMAGECOUNT value on done: 4004.0 [2024-08-05 22:14:18,595][52811] Sum rewards: 11.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.472', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.149', 'HITCOUNT': '0.790', 'WEAPON3': '0.950', 'ARMOR': '0.971', 'weapon2': '1.280', 'weapon3': '2.494', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '12.000'} [2024-08-05 22:14:18,637][52795] DAMAGECOUNT value on done: 4140.0 [2024-08-05 22:14:18,638][52795] Sum rewards: 2.619, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.130', 'HITCOUNT': '0.680', 'ARMOR': '0.820', 'WEAPON3': '0.950', 'weapon2': '1.182', 'weapon3': '2.234', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:18,651][52820] DAMAGECOUNT value on done: 3592.0 [2024-08-05 22:14:18,654][52820] Sum rewards: 1.708, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.544', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'ARMOR': '0.072', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'HITCOUNT': '0.380', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.155', 'weapon2': '1.512', 'weapon3': '2.068', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:18,694][52671] DAMAGECOUNT value on done: 4503.0 [2024-08-05 22:14:18,694][52671] Sum rewards: 3.913, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.620', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon4': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'HITCOUNT': '0.480', 'WEAPON3': '0.750', 'weapon3': '1.702', 'DAMAGECOUNT': '1.707', 'weapon2': '1.758', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:19,051][52668] DAMAGECOUNT value on done: 5804.0 [2024-08-05 22:14:19,052][52668] Sum rewards: 5.449, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.082', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.084', 'weapon4': '0.108', 'WEAPON4': '0.150', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.236', 'weapon3': '1.676', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:19,269][52794] DAMAGECOUNT value on done: 5378.0 [2024-08-05 22:14:19,451][52659] DAMAGECOUNT value on done: 5516.0 [2024-08-05 22:14:19,452][52659] Sum rewards: 0.945, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.034', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.147', 'HITCOUNT': '0.460', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.503', 'ARMOR': '1.819', 'weapon2': '1.866', 'weapon3': '1.992', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:20,614][52662] DAMAGECOUNT value on done: 5981.0 [2024-08-05 22:14:20,619][52662] Sum rewards: 5.842, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.114', 'AMMO3': '0.120', 'ARMOR': '0.484', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.362', 'weapon3': '1.980', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:21,306][52671] DAMAGECOUNT value on done: 5759.0 [2024-08-05 22:14:21,307][52671] Sum rewards: 4.148, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.338', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.112', 'weapon4': '0.132', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'ARMOR': '1.353', 'weapon2': '1.574', 'weapon3': '1.664', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:21,358][52803] DAMAGECOUNT value on done: 3799.0 [2024-08-05 22:14:21,361][52803] Sum rewards: -0.272, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO2': '0.018', 'weapon7': '0.058', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.153', 'HITCOUNT': '0.590', 'ARMOR': '0.847', 'WEAPON3': '0.850', 'FRAGCOUNT': '1.000', 'weapon2': '1.716', 'DAMAGECOUNT': '1.908', 'weapon3': '1.930'} [2024-08-05 22:14:21,475][52650] Updated weights for policy 0, policy_version 6131 (0.0024) [2024-08-05 22:14:21,615][52660] DAMAGECOUNT value on done: 4896.0 [2024-08-05 22:14:21,627][52660] Sum rewards: 3.661, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.642', 'AMMO2': '0.015', 'AMMO3': '0.070', 'AMMO4': '0.077', 'ARMOR': '0.089', 'weapon4': '0.138', 'WEAPON4': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.290', 'weapon2': '1.494', 'weapon3': '1.570', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:21,873][52794] DAMAGECOUNT value on done: 5765.0 [2024-08-05 22:14:21,874][52794] Sum rewards: 2.311, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.073', 'weapon4': '0.104', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'ARMOR': '0.880', 'weapon2': '1.530', 'DAMAGECOUNT': '1.557', 'weapon3': '1.898', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:21,898][52795] DAMAGECOUNT value on done: 5165.0 [2024-08-05 22:14:21,899][52795] Sum rewards: 4.367, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.694', 'weapon4': '0.018', 'AMMO2': '0.022', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.111', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.602', 'weapon3': '2.092', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:21,913][52811] DAMAGECOUNT value on done: 4642.0 [2024-08-05 22:14:21,914][52811] Sum rewards: 1.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.680', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.450', 'ARMOR': '0.546', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.347', 'weapon3': '1.898', 'weapon2': '1.944', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:21,902][52820] DAMAGECOUNT value on done: 4965.0 [2024-08-05 22:14:21,917][52820] Sum rewards: 6.457, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.718', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.136', 'ARMOR': '0.412', 'HITCOUNT': '0.680', 'WEAPON3': '0.950', 'weapon2': '1.810', 'weapon3': '1.824', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:22,029][52659] DAMAGECOUNT value on done: 5126.0 [2024-08-05 22:14:22,030][52659] Sum rewards: 2.828, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.542', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'weapon5': '0.006', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'ARMOR': '0.603', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.251', 'weapon3': '1.458', 'weapon2': '1.950', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:22,346][52668] DAMAGECOUNT value on done: 4099.0 [2024-08-05 22:14:22,346][52668] Sum rewards: 0.248, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.020', 'ARMOR': '0.068', 'weapon4': '0.072', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.350', 'WEAPON3': '0.900', 'DAMAGECOUNT': '0.915', 'weapon2': '1.466', 'weapon3': '1.868', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:22,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16930.2, 300 sec: 16856.1). Total num frames: 50241536. Throughput: 0: 4218.9. Samples: 12565160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:14:22,794][52567] Avg episode reward: [(0, '3.390')] [2024-08-05 22:14:22,939][52662] DAMAGECOUNT value on done: 5141.0 [2024-08-05 22:14:22,940][52662] Sum rewards: 2.410, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.368', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.118', 'HITCOUNT': '0.380', 'ARMOR': '0.504', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.206', 'weapon3': '1.406', 'weapon2': '1.484', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:24,098][52671] DAMAGECOUNT value on done: 4199.0 [2024-08-05 22:14:24,098][52671] Sum rewards: 4.895, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.434', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.102', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '1.320', 'weapon2': '1.858', 'weapon3': '1.860', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:24,403][52794] DAMAGECOUNT value on done: 5676.0 [2024-08-05 22:14:24,403][52794] Sum rewards: 4.543, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.736', 'AMMO5': '0.003', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'ARMOR': '1.066', 'weapon3': '1.408', 'weapon2': '1.970', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:24,613][52803] DAMAGECOUNT value on done: 5312.0 [2024-08-05 22:14:24,613][52803] Sum rewards: 2.953, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.194', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'HITCOUNT': '0.350', 'ARMOR': '0.545', 'weapon4': '0.592', 'WEAPON3': '0.650', 'weapon2': '1.000', 'DAMAGECOUNT': '1.254', 'weapon3': '1.740', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:24,858][52660] DAMAGECOUNT value on done: 3911.0 [2024-08-05 22:14:24,860][52660] Sum rewards: 1.040, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.734', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.141', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.230', 'weapon2': '1.352', 'weapon3': '2.162', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:24,916][52659] DAMAGECOUNT value on done: 3881.0 [2024-08-05 22:14:24,919][52659] Sum rewards: 0.911, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.146', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'AMMO4': '0.053', 'weapon5': '0.064', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'HITCOUNT': '0.280', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.825', 'FRAGCOUNT': '1.000', 'weapon3': '1.502', 'weapon2': '1.936'} [2024-08-05 22:14:25,094][52795] DAMAGECOUNT value on done: 4602.0 [2024-08-05 22:14:25,099][52795] Sum rewards: -0.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.147', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.097', 'weapon4': '0.114', 'ARMOR': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.972', 'FRAGCOUNT': '1.000', 'weapon3': '1.588', 'weapon2': '1.688'} [2024-08-05 22:14:25,188][52811] DAMAGECOUNT value on done: 3631.0 [2024-08-05 22:14:25,189][52811] Sum rewards: 0.619, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.355', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.210', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.666', 'ARMOR': '0.906', 'weapon2': '1.374', 'weapon3': '1.822', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:25,458][52820] DAMAGECOUNT value on done: 4506.0 [2024-08-05 22:14:25,458][52820] Sum rewards: -1.102, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.176', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON4': '0.050', 'weapon4': '0.090', 'AMMO3': '0.096', 'HITCOUNT': '0.360', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'ARMOR': '1.470', 'weapon3': '1.772', 'weapon2': '1.824'} [2024-08-05 22:14:25,464][52668] DAMAGECOUNT value on done: 4286.0 [2024-08-05 22:14:25,466][52668] Sum rewards: 7.954, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.362', 'AMMO2': '0.012', 'ARMOR': '0.044', 'AMMO4': '0.059', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.230', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon2': '1.078', 'weapon3': '1.112', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:25,804][52662] DAMAGECOUNT value on done: 5883.0 [2024-08-05 22:14:25,804][52662] Sum rewards: 7.953, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.602', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.210', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.282', 'weapon3': '1.334', 'ARMOR': '1.437', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:26,268][52650] Updated weights for policy 0, policy_version 6141 (0.0013) [2024-08-05 22:14:26,820][52671] DAMAGECOUNT value on done: 4829.0 [2024-08-05 22:14:26,821][52671] Sum rewards: 3.890, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'HITCOUNT': '0.340', 'HEALTH': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.520', 'DAMAGECOUNT': '1.260', 'weapon2': '1.334', 'weapon3': '1.376', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:27,450][52794] DAMAGECOUNT value on done: 5930.0 [2024-08-05 22:14:27,451][52794] Sum rewards: 3.416, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.068', 'AMMO4': '-0.093', 'AMMO2': '-0.019', 'AMMO5': '0.005', 'weapon5': '0.034', 'WEAPON1': '0.040', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'ARMOR': '1.403', 'weapon3': '1.574', 'weapon2': '1.630', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:27,592][52803] DAMAGECOUNT value on done: 4169.0 [2024-08-05 22:14:27,595][52803] Sum rewards: -1.164, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.370', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.036', 'ARMOR': '0.092', 'AMMO3': '0.107', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.250', 'WEAPON3': '0.850', 'DAMAGECOUNT': '0.993', 'weapon2': '1.468', 'weapon3': '1.750', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.2, 300 sec: 16883.8). Total num frames: 50331648. Throughput: 0: 4228.0. Samples: 12590720. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 22:14:27,802][52567] Avg episode reward: [(0, '3.380')] [2024-08-05 22:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006144_50331648.pth... [2024-08-05 22:14:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005649_46276608.pth [2024-08-05 22:14:28,001][52660] DAMAGECOUNT value on done: 5169.0 [2024-08-05 22:14:28,005][52660] Sum rewards: 2.216, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.317', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.124', 'HITCOUNT': '0.410', 'weapon5': '0.522', 'WEAPON3': '0.750', 'weapon2': '1.044', 'DAMAGECOUNT': '1.575', 'weapon3': '1.772', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:28,092][52659] DAMAGECOUNT value on done: 4633.0 [2024-08-05 22:14:28,092][52659] Sum rewards: 9.018, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.375', 'AMMO2': '0.014', 'AMMO3': '0.051', 'AMMO4': '0.070', 'WEAPON3': '0.250', 'HITCOUNT': '0.350', 'ARMOR': '0.441', 'weapon3': '0.918', 'weapon2': '1.204', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:28,348][52795] DAMAGECOUNT value on done: 4287.0 [2024-08-05 22:14:28,348][52795] Sum rewards: 2.360, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO3': '0.080', 'HITCOUNT': '0.350', 'ARMOR': '0.526', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.395', 'weapon2': '1.410', 'weapon3': '1.680', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:28,356][52811] DAMAGECOUNT value on done: 4409.0 [2024-08-05 22:14:28,358][52811] Sum rewards: -0.599, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.198', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.170', 'ARMOR': '0.518', 'DAMAGECOUNT': '0.543', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.648', 'weapon2': '1.760'} [2024-08-05 22:14:28,900][52820] DAMAGECOUNT value on done: 5203.0 [2024-08-05 22:14:28,901][52820] Sum rewards: 6.970, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.350', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO3': '0.099', 'HITCOUNT': '0.740', 'ARMOR': '0.824', 'WEAPON3': '0.850', 'weapon2': '1.846', 'weapon3': '1.914', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '8.000'} [2024-08-05 22:14:28,917][52662] DAMAGECOUNT value on done: 4470.0 [2024-08-05 22:14:28,918][52662] Sum rewards: 1.613, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.470', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon5': '0.012', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'ARMOR': '0.889', 'DAMAGECOUNT': '1.542', 'weapon3': '1.616', 'weapon2': '1.716', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:28,949][52668] DAMAGECOUNT value on done: 4558.0 [2024-08-05 22:14:28,949][52668] Sum rewards: 9.364, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.404', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.140', 'weapon5': '0.224', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.989', 'weapon3': '1.022', 'weapon2': '1.414', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:30,440][52794] DAMAGECOUNT value on done: 5536.0 [2024-08-05 22:14:30,441][52794] Sum rewards: 5.637, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.003', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.119', 'weapon4': '0.162', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'weapon2': '1.496', 'weapon3': '1.626', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:30,768][52659] DAMAGECOUNT value on done: 3769.0 [2024-08-05 22:14:30,769][52659] Sum rewards: 5.692, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.517', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.210', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'ARMOR': '1.271', 'weapon3': '1.462', 'weapon2': '1.508', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:31,434][52662] DAMAGECOUNT value on done: 5590.0 [2024-08-05 22:14:31,434][52662] Sum rewards: 2.240, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.590', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.476', 'ARMOR': '0.545', 'WEAPON3': '0.650', 'weapon2': '1.164', 'weapon3': '1.266', 'DAMAGECOUNT': '1.299', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:31,459][52650] Updated weights for policy 0, policy_version 6151 (0.0014) [2024-08-05 22:14:31,545][52660] DAMAGECOUNT value on done: 4704.0 [2024-08-05 22:14:31,548][52660] Sum rewards: 1.830, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.464', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.214', 'ARMOR': '0.542', 'HITCOUNT': '0.610', 'WEAPON3': '0.900', 'weapon2': '1.128', 'DAMAGECOUNT': '2.049', 'weapon3': '2.424', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:31,610][52795] DAMAGECOUNT value on done: 4589.0 [2024-08-05 22:14:31,611][52795] Sum rewards: 3.661, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.557', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.100', 'AMMO3': '0.133', 'weapon4': '0.156', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.094', 'DAMAGECOUNT': '1.947', 'weapon3': '2.016', 'FRAGCOUNT': '8.000'} [2024-08-05 22:14:31,859][52811] DAMAGECOUNT value on done: 4112.0 [2024-08-05 22:14:31,860][52811] Sum rewards: 4.063, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.970', 'AMMO2': '0.001', 'AMMO4': '0.005', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.152', 'HITCOUNT': '0.390', 'WEAPON3': '0.700', 'weapon2': '1.238', 'DAMAGECOUNT': '1.260', 'weapon3': '2.014', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:32,695][52668] DAMAGECOUNT value on done: 5165.0 [2024-08-05 22:14:32,700][52668] Sum rewards: 2.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.501', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.232', 'HITCOUNT': '0.420', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.311', 'weapon3': '1.584', 'weapon2': '1.638', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:32,795][52567] Fps is (10 sec: 16383.4, 60 sec: 16793.5, 300 sec: 16883.9). Total num frames: 50405376. Throughput: 0: 4225.1. Samples: 12603330. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:14:32,795][52567] Avg episode reward: [(0, '3.379')] [2024-08-05 22:14:32,894][52820] DAMAGECOUNT value on done: 3874.0 [2024-08-05 22:14:32,895][52820] Sum rewards: 5.191, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.001', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.024', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon3': '1.318', 'DAMAGECOUNT': '1.770', 'weapon2': '2.018', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:33,347][52794] DAMAGECOUNT value on done: 5226.0 [2024-08-05 22:14:33,347][52794] Sum rewards: 1.931, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.228', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.016', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'HITCOUNT': '0.250', 'weapon4': '0.408', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.810', 'weapon2': '0.856', 'ARMOR': '0.911', 'weapon3': '1.352', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:34,902][52662] DAMAGECOUNT value on done: 5090.0 [2024-08-05 22:14:34,903][52662] Sum rewards: 5.462, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.142', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.244', 'ARMOR': '0.492', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.364', 'weapon3': '1.704', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:35,056][52659] DAMAGECOUNT value on done: 4613.0 [2024-08-05 22:14:35,063][52659] Sum rewards: 1.839, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO4': '0.075', 'AMMO3': '0.086', 'HEALTH': '0.126', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.342', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.747', 'ARMOR': '1.297', 'weapon3': '1.370', 'weapon2': '1.490', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:35,953][52660] DAMAGECOUNT value on done: 4536.0 [2024-08-05 22:14:35,967][52660] Sum rewards: 2.697, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.294', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.156', 'weapon4': '0.240', 'HITCOUNT': '0.520', 'WEAPON3': '1.100', 'weapon2': '1.234', 'ARMOR': '1.290', 'weapon3': '2.042', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:36,286][52795] DAMAGECOUNT value on done: 4360.0 [2024-08-05 22:14:36,287][52795] Sum rewards: 2.924, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.128', 'weapon4': '0.168', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'HEALTH': '0.858', 'weapon2': '1.202', 'DAMAGECOUNT': '1.362', 'weapon3': '2.350', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:36,673][52668] DAMAGECOUNT value on done: 4491.0 [2024-08-05 22:14:36,673][52668] Sum rewards: 6.374, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.218', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.124', 'weapon5': '0.204', 'weapon4': '0.218', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'weapon3': '0.986', 'DAMAGECOUNT': '1.290', 'weapon2': '1.468', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:37,080][52820] DAMAGECOUNT value on done: 6124.0 [2024-08-05 22:14:37,083][52820] Sum rewards: 3.027, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.986', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.032', 'AMMO3': '0.107', 'ARMOR': '0.116', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.724', 'weapon3': '1.902', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:37,358][52650] Updated weights for policy 0, policy_version 6161 (0.0020) [2024-08-05 22:14:37,492][52662] DAMAGECOUNT value on done: 5120.0 [2024-08-05 22:14:37,493][52662] Sum rewards: 6.311, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.061', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.028', 'ARMOR': '0.036', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon3': '1.404', 'weapon2': '1.590', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:37,794][52567] Fps is (10 sec: 14745.6, 60 sec: 16520.5, 300 sec: 16800.5). Total num frames: 50479104. Throughput: 0: 4105.3. Samples: 12623200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:14:37,794][52567] Avg episode reward: [(0, '3.535')] [2024-08-05 22:14:39,200][52660] DAMAGECOUNT value on done: 4727.0 [2024-08-05 22:14:39,200][52660] Sum rewards: 5.563, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO4': '0.057', 'weapon4': '0.066', 'AMMO3': '0.080', 'weapon5': '0.110', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'HEALTH': '0.580', 'weapon2': '1.420', 'weapon3': '1.494', 'DAMAGECOUNT': '1.575', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:39,684][52795] DAMAGECOUNT value on done: 4698.0 [2024-08-05 22:14:39,686][52795] Sum rewards: 3.742, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.736', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.878', 'weapon3': '1.194', 'DAMAGECOUNT': '1.674', 'weapon2': '1.856', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:39,910][52668] DAMAGECOUNT value on done: 4841.0 [2024-08-05 22:14:39,910][52668] Sum rewards: 9.631, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.843', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '1.251', 'weapon3': '1.694', 'weapon2': '1.700', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '8.000'} [2024-08-05 22:14:40,425][52820] DAMAGECOUNT value on done: 4226.0 [2024-08-05 22:14:40,425][52820] Sum rewards: 2.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.185', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.572', 'weapon3': '1.670', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:42,082][52650] Updated weights for policy 0, policy_version 6171 (0.0022) [2024-08-05 22:14:42,352][52660] DAMAGECOUNT value on done: 4771.0 [2024-08-05 22:14:42,353][52660] Sum rewards: 3.193, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon5': '0.076', 'WEAPON5': '0.150', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'ARMOR': '1.007', 'DAMAGECOUNT': '1.395', 'weapon3': '1.636', 'weapon2': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:42,794][52567] Fps is (10 sec: 15565.4, 60 sec: 16657.1, 300 sec: 16828.4). Total num frames: 50561024. Throughput: 0: 4114.2. Samples: 12648780. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:14:42,794][52567] Avg episode reward: [(0, '3.567')] [2024-08-05 22:14:42,928][52668] DAMAGECOUNT value on done: 4779.0 [2024-08-05 22:14:42,931][52668] Sum rewards: -0.539, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.994', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'weapon5': '0.030', 'ARMOR': '0.040', 'WEAPON1': '0.060', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'HITCOUNT': '0.570', 'WEAPON3': '0.950', 'weapon2': '1.394', 'DAMAGECOUNT': '1.824', 'weapon3': '2.300', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:42,965][52795] DAMAGECOUNT value on done: 4182.0 [2024-08-05 22:14:42,965][52795] Sum rewards: 1.509, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.807', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.034', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO3': '0.124', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'weapon2': '1.310', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '2.000', 'weapon3': '2.186'} [2024-08-05 22:14:43,765][52820] DAMAGECOUNT value on done: 4989.0 [2024-08-05 22:14:43,766][52820] Sum rewards: -6.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.025', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'ARMOR': '0.456', 'HITCOUNT': '0.620', 'weapon2': '0.930', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.300', 'DAMAGECOUNT': '2.118', 'weapon3': '2.704'} [2024-08-05 22:14:45,430][52660] DAMAGECOUNT value on done: 4032.0 [2024-08-05 22:14:45,431][52660] Sum rewards: 2.140, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.402', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'AMMO3': '0.068', 'AMMO4': '0.074', 'HITCOUNT': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'DAMAGECOUNT': '0.273', 'weapon4': '0.280', 'WEAPON3': '0.450', 'ARMOR': '0.895', 'FRAGCOUNT': '1.000', 'weapon3': '1.124', 'weapon2': '1.606'} [2024-08-05 22:14:46,515][52668] DAMAGECOUNT value on done: 5013.0 [2024-08-05 22:14:46,516][52668] Sum rewards: -0.177, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.602', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'weapon5': '0.028', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.136', 'WEAPON5': '0.300', 'HITCOUNT': '0.390', 'WEAPON3': '0.900', 'ARMOR': '0.975', 'DAMAGECOUNT': '1.365', 'weapon2': '1.518', 'weapon3': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 22:14:46,895][52650] Updated weights for policy 0, policy_version 6181 (0.0028) [2024-08-05 22:14:46,951][52820] DAMAGECOUNT value on done: 4599.0 [2024-08-05 22:14:46,953][52820] Sum rewards: 1.534, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.169', 'HEALTH': '0.207', 'HITCOUNT': '0.560', 'ARMOR': '0.824', 'WEAPON3': '0.950', 'weapon2': '1.076', 'DAMAGECOUNT': '2.028', 'weapon3': '2.346', 'FRAGCOUNT': '3.000'} [2024-08-05 22:14:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16384.0, 300 sec: 16800.9). Total num frames: 50642944. Throughput: 0: 4118.0. Samples: 12661570. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:14:47,794][52567] Avg episode reward: [(0, '3.315')] [2024-08-05 22:14:49,272][52660] DAMAGECOUNT value on done: 4881.0 [2024-08-05 22:14:49,273][52660] Sum rewards: 3.256, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.479', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.120', 'ARMOR': '0.468', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.190', 'weapon3': '1.452', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:49,930][52668] DAMAGECOUNT value on done: 4253.0 [2024-08-05 22:14:49,931][52668] Sum rewards: 6.954, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.557', 'AMMO2': '0.021', 'ARMOR': '0.042', 'AMMO3': '0.064', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon3': '1.302', 'weapon2': '1.682', 'DAMAGECOUNT': '2.139', 'FRAGCOUNT': '6.000'} [2024-08-05 22:14:50,243][52820] DAMAGECOUNT value on done: 5571.0 [2024-08-05 22:14:50,243][52820] Sum rewards: 10.894, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.626', 'AMMO2': '0.004', 'ARMOR': '0.012', 'AMMO4': '0.020', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.184', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon2': '1.312', 'weapon3': '1.754', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'} [2024-08-05 22:14:51,545][52650] Updated weights for policy 0, policy_version 6191 (0.0012) [2024-08-05 22:14:51,932][52660] DAMAGECOUNT value on done: 4875.0 [2024-08-05 22:14:51,935][52660] Sum rewards: 5.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.568', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'weapon5': '0.012', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '0.894', 'weapon3': '1.360', 'DAMAGECOUNT': '1.632', 'weapon2': '1.912', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:52,677][52668] DAMAGECOUNT value on done: 4239.0 [2024-08-05 22:14:52,680][52668] Sum rewards: 6.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.468', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'weapon4': '0.080', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.242', 'ARMOR': '1.353', 'weapon2': '1.750', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '7.000'} [2024-08-05 22:14:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16657.0, 300 sec: 16800.5). Total num frames: 50733056. Throughput: 0: 4130.2. Samples: 12687220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:14:52,795][52567] Avg episode reward: [(0, '3.526')] [2024-08-05 22:14:53,519][52820] DAMAGECOUNT value on done: 4728.0 [2024-08-05 22:14:53,522][52820] Sum rewards: 4.904, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.761', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.061', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.871', 'weapon3': '0.920', 'DAMAGECOUNT': '1.353', 'weapon2': '1.442', 'FRAGCOUNT': '4.000'} [2024-08-05 22:14:55,090][52660] DAMAGECOUNT value on done: 3880.0 [2024-08-05 22:14:55,091][52660] Sum rewards: 3.039, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.258', 'AMMO4': '-0.092', 'AMMO2': '-0.018', 'AMMO3': '0.085', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'ARMOR': '0.941', 'weapon3': '1.536', 'weapon2': '1.732', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.073'} [2024-08-05 22:14:56,383][52650] Updated weights for policy 0, policy_version 6201 (0.0030) [2024-08-05 22:14:56,777][52820] DAMAGECOUNT value on done: 4373.0 [2024-08-05 22:14:56,780][52820] Sum rewards: 5.494, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.964', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.091', 'WEAPON5': '0.150', 'HITCOUNT': '0.410', 'ARMOR': '0.558', 'WEAPON3': '0.650', 'weapon3': '1.546', 'weapon2': '1.612', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '5.000'} [2024-08-05 22:14:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16657.1, 300 sec: 16856.1). Total num frames: 50823168. Throughput: 0: 4127.1. Samples: 12712900. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:14:57,794][52567] Avg episode reward: [(0, '3.566')] [2024-08-05 22:14:58,007][52660] DAMAGECOUNT value on done: 5944.0 [2024-08-05 22:14:58,007][52660] Sum rewards: 7.081, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.660', 'weapon3': '1.864', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '7.000'} [2024-08-05 22:15:00,145][52820] DAMAGECOUNT value on done: 4507.0 [2024-08-05 22:15:00,145][52820] Sum rewards: 3.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.405', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'ARMOR': '1.306', 'weapon2': '1.420', 'weapon3': '2.194', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:01,188][52650] Updated weights for policy 0, policy_version 6211 (0.0016) [2024-08-05 22:15:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16657.1, 300 sec: 16828.3). Total num frames: 50905088. Throughput: 0: 4126.7. Samples: 12725480. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 22:15:02,794][52567] Avg episode reward: [(0, '3.573')] [2024-08-05 22:15:03,638][52820] DAMAGECOUNT value on done: 3612.0 [2024-08-05 22:15:03,639][52820] Sum rewards: 5.517, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.398', 'AMMO5': '0.015', 'weapon5': '0.022', 'AMMO2': '0.023', 'weapon4': '0.090', 'AMMO4': '0.116', 'AMMO3': '0.130', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.535', 'HITCOUNT': '0.540', 'WEAPON3': '0.900', 'weapon2': '1.346', 'DAMAGECOUNT': '1.815', 'weapon3': '2.282', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:06,109][52650] Updated weights for policy 0, policy_version 6221 (0.0033) [2024-08-05 22:15:06,942][52820] DAMAGECOUNT value on done: 4630.0 [2024-08-05 22:15:06,945][52820] Sum rewards: 3.934, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.391', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.124', 'weapon4': '0.162', 'WEAPON4': '0.200', 'ARMOR': '0.584', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'weapon2': '1.370', 'DAMAGECOUNT': '1.908', 'weapon3': '1.968', 'FRAGCOUNT': '5.000'} [2024-08-05 22:15:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16828.3). Total num frames: 50987008. Throughput: 0: 4131.6. Samples: 12751080. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 22:15:07,794][52567] Avg episode reward: [(0, '3.556')] [2024-08-05 22:15:10,293][52820] DAMAGECOUNT value on done: 4370.0 [2024-08-05 22:15:10,296][52820] Sum rewards: 3.159, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'HEALTH': '0.283', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.230', 'ARMOR': '1.256', 'weapon2': '1.594', 'weapon3': '1.654', 'FRAGCOUNT': '2.000'} [2024-08-05 22:15:10,839][52650] Updated weights for policy 0, policy_version 6231 (0.0013) [2024-08-05 22:15:12,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.2, 300 sec: 16800.6). Total num frames: 51068928. Throughput: 0: 4132.4. Samples: 12776680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:15:12,802][52567] Avg episode reward: [(0, '3.560')] [2024-08-05 22:15:13,512][52820] DAMAGECOUNT value on done: 4008.0 [2024-08-05 22:15:13,514][52820] Sum rewards: 1.215, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.404', 'AMMO2': '0.021', 'AMMO3': '0.074', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'HITCOUNT': '0.220', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.972', 'weapon3': '1.078', 'weapon2': '1.358', 'FRAGCOUNT': '2.000'} [2024-08-05 22:15:15,707][52650] Updated weights for policy 0, policy_version 6241 (0.0018) [2024-08-05 22:15:16,766][52820] DAMAGECOUNT value on done: 4347.0 [2024-08-05 22:15:16,766][52820] Sum rewards: 3.058, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON1': '0.020', 'AMMO3': '0.102', 'ARMOR': '0.475', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.666', 'weapon3': '1.698', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'} [2024-08-05 22:15:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16657.0, 300 sec: 16828.3). Total num frames: 51159040. Throughput: 0: 4140.2. Samples: 12789640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:15:17,802][52567] Avg episode reward: [(0, '3.547')] [2024-08-05 22:15:18,619][52671] Large shaping reward 2.549 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.498, 166.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:15:20,041][52820] DAMAGECOUNT value on done: 4988.0 [2024-08-05 22:15:20,041][52820] Sum rewards: 6.583, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.665', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO3': '0.074', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon3': '1.544', 'weapon2': '1.780', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '5.000'} [2024-08-05 22:15:20,413][52650] Updated weights for policy 0, policy_version 6251 (0.0013) [2024-08-05 22:15:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16657.1, 300 sec: 16828.3). Total num frames: 51240960. Throughput: 0: 4268.9. Samples: 12815300. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:15:22,794][52567] Avg episode reward: [(0, '3.578')] [2024-08-05 22:15:23,288][52820] DAMAGECOUNT value on done: 4821.0 [2024-08-05 22:15:23,290][52820] Sum rewards: 6.345, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.516', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon5': '0.410', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'ARMOR': '1.018', 'weapon2': '1.418', 'weapon3': '1.944', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.000'} [2024-08-05 22:15:25,056][52650] Updated weights for policy 0, policy_version 6261 (0.0010) [2024-08-05 22:15:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16657.1, 300 sec: 16828.3). Total num frames: 51331072. Throughput: 0: 4265.1. Samples: 12840710. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:15:27,794][52567] Avg episode reward: [(0, '3.596')] [2024-08-05 22:15:30,354][52650] Updated weights for policy 0, policy_version 6271 (0.0027) [2024-08-05 22:15:31,162][52669] DAMAGECOUNT value on done: 4332.0 [2024-08-05 22:15:31,169][52669] Sum rewards: 3.387, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.358', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.131', 'weapon4': '0.132', 'ARMOR': '0.519', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'weapon3': '1.660', 'weapon2': '1.730', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.7, 300 sec: 16828.3). Total num frames: 51412992. Throughput: 0: 4243.3. Samples: 12852520. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 22:15:32,794][52567] Avg episode reward: [(0, '3.567')] [2024-08-05 22:15:34,134][52669] DAMAGECOUNT value on done: 5033.0 [2024-08-05 22:15:34,138][52669] Sum rewards: 5.436, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.058', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'weapon4': '0.132', 'HITCOUNT': '0.580', 'ARMOR': '0.601', 'WEAPON3': '0.900', 'weapon2': '1.664', 'weapon3': '1.828', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:34,969][52650] Updated weights for policy 0, policy_version 6281 (0.0014) [2024-08-05 22:15:37,035][52669] DAMAGECOUNT value on done: 5142.0 [2024-08-05 22:15:37,036][52669] Sum rewards: 1.656, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.408', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'ARMOR': '0.092', 'AMMO3': '0.115', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.176', 'weapon3': '1.874', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '3.000'} [2024-08-05 22:15:37,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 51494912. Throughput: 0: 4237.3. Samples: 12877900. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 22:15:37,795][52567] Avg episode reward: [(0, '3.611')] [2024-08-05 22:15:39,984][52650] Updated weights for policy 0, policy_version 6291 (0.0027) [2024-08-05 22:15:40,286][52669] DAMAGECOUNT value on done: 6574.0 [2024-08-05 22:15:40,286][52669] Sum rewards: 3.768, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.210', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.164', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon3': '1.370', 'DAMAGECOUNT': '1.470', 'weapon2': '1.558', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:42,407][52669] DAMAGECOUNT value on done: 4607.0 [2024-08-05 22:15:42,408][52669] Sum rewards: 3.755, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.010', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'HITCOUNT': '0.250', 'weapon4': '0.280', 'WEAPON3': '0.300', 'ARMOR': '0.455', 'weapon3': '0.838', 'DAMAGECOUNT': '0.846', 'weapon5': '0.974', 'weapon2': '1.068', 'FRAGCOUNT': '3.000'} [2024-08-05 22:15:42,701][52666] DAMAGECOUNT value on done: 4242.0 [2024-08-05 22:15:42,703][52666] Sum rewards: 6.160, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.212', 'AMMO2': '0.023', 'weapon4': '0.046', 'ARMOR': '0.060', 'AMMO3': '0.096', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '0.658', 'weapon3': '1.320', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16828.3). Total num frames: 51585024. Throughput: 0: 4234.4. Samples: 12903450. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 22:15:42,794][52567] Avg episode reward: [(0, '3.696')] [2024-08-05 22:15:44,692][52670] DAMAGECOUNT value on done: 5576.0 [2024-08-05 22:15:44,694][52670] Sum rewards: 8.069, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.295', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'weapon4': '0.118', 'ARMOR': '0.516', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '1.584', 'weapon3': '1.710', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:44,826][52650] Updated weights for policy 0, policy_version 6301 (0.0023) [2024-08-05 22:15:45,082][52669] DAMAGECOUNT value on done: 5604.0 [2024-08-05 22:15:45,093][52669] Sum rewards: 5.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.894', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'ARMOR': '0.104', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'HITCOUNT': '0.500', 'weapon2': '1.092', 'WEAPON3': '1.150', 'DAMAGECOUNT': '1.947', 'weapon3': '2.552', 'FRAGCOUNT': '9.000'} [2024-08-05 22:15:45,844][52666] DAMAGECOUNT value on done: 5063.0 [2024-08-05 22:15:45,845][52666] Sum rewards: 2.794, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.520', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'ARMOR': '0.912', 'DAMAGECOUNT': '1.527', 'weapon3': '1.578', 'weapon2': '1.854', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:47,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16930.1, 300 sec: 16829.1). Total num frames: 51658752. Throughput: 0: 4237.1. Samples: 12916150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:15:47,794][52567] Avg episode reward: [(0, '3.726')] [2024-08-05 22:15:47,853][52614] Saving new best policy, reward=3.726! [2024-08-05 22:15:48,138][52669] DAMAGECOUNT value on done: 6174.0 [2024-08-05 22:15:48,138][52669] Sum rewards: 5.962, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.316', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'ARMOR': '0.061', 'AMMO3': '0.154', 'HITCOUNT': '0.850', 'WEAPON3': '1.000', 'weapon2': '1.146', 'weapon3': '2.006', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '8.000'} [2024-08-05 22:15:48,163][52670] DAMAGECOUNT value on done: 4567.0 [2024-08-05 22:15:48,167][52670] Sum rewards: 4.726, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.590', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'ARMOR': '0.020', 'AMMO3': '0.050', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'DAMAGECOUNT': '1.062', 'weapon3': '1.154', 'weapon2': '1.318', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:49,472][52666] DAMAGECOUNT value on done: 4882.0 [2024-08-05 22:15:49,473][52666] Sum rewards: 4.875, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.336', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.050', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.416', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon3': '1.482', 'weapon2': '1.544', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:49,527][52650] Updated weights for policy 0, policy_version 6311 (0.0029) [2024-08-05 22:15:49,947][52647] DAMAGECOUNT value on done: 4922.0 [2024-08-05 22:15:49,947][52647] Sum rewards: 2.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.750', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.091', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'weapon3': '1.400', 'weapon2': '1.496', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.000'} [2024-08-05 22:15:50,527][52663] DAMAGECOUNT value on done: 5561.0 [2024-08-05 22:15:50,529][52663] Sum rewards: 7.120, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.081', 'ARMOR': '0.428', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.784', 'weapon3': '1.814', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:50,944][52669] DAMAGECOUNT value on done: 5216.0 [2024-08-05 22:15:50,945][52669] Sum rewards: 7.938, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.120', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.085', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.706', 'weapon3': '1.736', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:51,436][52670] DAMAGECOUNT value on done: 4214.0 [2024-08-05 22:15:51,436][52670] Sum rewards: 3.145, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.140', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.221', 'ARMOR': '1.245', 'weapon3': '1.628', 'weapon2': '2.138', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:52,448][52666] DAMAGECOUNT value on done: 5319.0 [2024-08-05 22:15:52,448][52666] Sum rewards: 4.889, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.427', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'WEAPON1': '0.010', 'AMMO3': '0.070', 'HITCOUNT': '0.390', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.434', 'weapon3': '1.636', 'weapon2': '1.872', 'FRAGCOUNT': '5.000'} [2024-08-05 22:15:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.2, 300 sec: 16856.1). Total num frames: 51748864. Throughput: 0: 4229.3. Samples: 12941400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:15:52,794][52567] Avg episode reward: [(0, '3.810')] [2024-08-05 22:15:52,795][52614] Saving new best policy, reward=3.810! [2024-08-05 22:15:53,212][52647] DAMAGECOUNT value on done: 5342.0 [2024-08-05 22:15:53,215][52647] Sum rewards: 2.738, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.416', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon4': '0.212', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.518', 'weapon2': '1.520', 'weapon3': '1.870', 'FRAGCOUNT': '2.000'} [2024-08-05 22:15:53,603][52663] DAMAGECOUNT value on done: 4909.0 [2024-08-05 22:15:53,603][52663] Sum rewards: 5.419, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.272', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.080', 'HITCOUNT': '0.390', 'ARMOR': '0.493', 'WEAPON3': '0.550', 'weapon2': '0.964', 'weapon3': '1.344', 'DAMAGECOUNT': '1.365', 'FRAGCOUNT': '5.000'} [2024-08-05 22:15:53,871][52665] DAMAGECOUNT value on done: 5671.0 [2024-08-05 22:15:53,871][52665] Sum rewards: 1.927, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.951', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.012', 'weapon5': '0.062', 'AMMO3': '0.115', 'WEAPON5': '0.250', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'ARMOR': '0.859', 'DAMAGECOUNT': '1.254', 'weapon2': '1.494', 'weapon3': '2.068', 'FRAGCOUNT': '3.000'} [2024-08-05 22:15:54,116][52669] DAMAGECOUNT value on done: 4554.0 [2024-08-05 22:15:54,116][52669] Sum rewards: 0.896, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.158', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.186', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.318', 'ARMOR': '1.328', 'weapon3': '1.588', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '3.000'} [2024-08-05 22:15:54,621][52650] Updated weights for policy 0, policy_version 6321 (0.0014) [2024-08-05 22:15:54,622][52670] DAMAGECOUNT value on done: 4358.0 [2024-08-05 22:15:54,623][52670] Sum rewards: 1.033, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.700', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.078', 'ARMOR': '0.088', 'WEAPON4': '0.200', 'weapon4': '0.238', 'HITCOUNT': '0.430', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.068', 'weapon3': '1.448', 'weapon2': '1.704', 'FRAGCOUNT': '2.000'} [2024-08-05 22:15:55,713][52666] DAMAGECOUNT value on done: 4621.0 [2024-08-05 22:15:55,716][52666] Sum rewards: 5.270, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.895', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon7': '0.050', 'weapon5': '0.058', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'ARMOR': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.284', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon2': '0.806', 'weapon3': '1.034', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:56,194][52647] DAMAGECOUNT value on done: 6199.0 [2024-08-05 22:15:56,195][52647] Sum rewards: 6.763, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.823', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon4': '0.090', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon3': '1.374', 'weapon2': '1.716', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '6.000'} [2024-08-05 22:15:56,300][52663] DAMAGECOUNT value on done: 3969.0 [2024-08-05 22:15:56,300][52663] Sum rewards: 4.086, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.080', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'HITCOUNT': '0.330', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.981', 'weapon2': '1.458', 'weapon3': '1.656', 'FRAGCOUNT': '3.000'} [2024-08-05 22:15:56,740][52669] DAMAGECOUNT value on done: 4487.0 [2024-08-05 22:15:56,742][52669] Sum rewards: 3.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.440', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'weapon4': '0.034', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'ARMOR': '0.878', 'weapon2': '1.354', 'weapon3': '1.562', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'} [2024-08-05 22:15:56,987][52665] DAMAGECOUNT value on done: 5349.0 [2024-08-05 22:15:56,991][52665] Sum rewards: 6.973, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.292', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'ARMOR': '1.032', 'weapon2': '1.656', 'weapon3': '1.910', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '7.000'} [2024-08-05 22:15:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16793.5, 300 sec: 16828.3). Total num frames: 51830784. Throughput: 0: 4217.1. Samples: 12966450. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 22:15:57,795][52567] Avg episode reward: [(0, '3.800')] [2024-08-05 22:15:57,909][52670] DAMAGECOUNT value on done: 3438.0 [2024-08-05 22:15:57,909][52670] Sum rewards: -0.329, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.812', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.160', 'HITCOUNT': '0.240', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.753', 'FRAGCOUNT': '1.000', 'ARMOR': '1.449', 'weapon2': '1.626', 'weapon3': '1.670'} [2024-08-05 22:15:58,931][52666] DAMAGECOUNT value on done: 5061.0 [2024-08-05 22:15:58,933][52666] Sum rewards: 3.994, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.277', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.014', 'weapon4': '0.042', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'ARMOR': '0.530', 'weapon3': '1.218', 'DAMAGECOUNT': '1.326', 'weapon2': '1.972', 'FRAGCOUNT': '5.000'} [2024-08-05 22:15:59,164][52663] DAMAGECOUNT value on done: 5923.0 [2024-08-05 22:15:59,166][52663] Sum rewards: 5.742, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.088', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.288', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'HEALTH': '0.492', 'ARMOR': '0.528', 'weapon2': '1.288', 'DAMAGECOUNT': '1.299', 'weapon3': '1.330', 'FRAGCOUNT': '3.000'} [2024-08-05 22:15:59,443][52647] DAMAGECOUNT value on done: 4279.0 [2024-08-05 22:15:59,444][52647] Sum rewards: 2.678, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.606', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.096', 'AMMO3': '0.099', 'weapon4': '0.116', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.302', 'weapon2': '1.370', 'weapon3': '1.738', 'FRAGCOUNT': '2.000'} [2024-08-05 22:15:59,544][52650] Updated weights for policy 0, policy_version 6331 (0.0042) [2024-08-05 22:15:59,592][52669] DAMAGECOUNT value on done: 5279.0 [2024-08-05 22:15:59,593][52669] Sum rewards: 8.084, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.012', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO3': '0.078', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.296', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '0.944', 'weapon3': '1.406', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:00,069][52665] DAMAGECOUNT value on done: 5613.0 [2024-08-05 22:16:00,071][52665] Sum rewards: 3.866, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.140', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'ARMOR': '0.064', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '1.084', 'weapon3': '1.720', 'DAMAGECOUNT': '1.749', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:01,292][52670] DAMAGECOUNT value on done: 4626.0 [2024-08-05 22:16:01,292][52670] Sum rewards: 4.812, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.266', 'AMMO5': '0.005', 'weapon7': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.420', 'weapon4': '0.462', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '1.176', 'weapon3': '1.630', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:01,874][52663] DAMAGECOUNT value on done: 5441.0 [2024-08-05 22:16:01,875][52663] Sum rewards: -1.011, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO3': '0.106', 'HEALTH': '0.146', 'HITCOUNT': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon2': '1.218', 'DAMAGECOUNT': '1.260', 'weapon3': '1.344'} [2024-08-05 22:16:02,080][52666] DAMAGECOUNT value on done: 4461.0 [2024-08-05 22:16:02,081][52666] Sum rewards: -0.643, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.278', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.040', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.224', 'HITCOUNT': '0.390', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'weapon2': '1.242', 'DAMAGECOUNT': '1.314', 'weapon3': '1.612'} [2024-08-05 22:16:02,248][52669] DAMAGECOUNT value on done: 5581.0 [2024-08-05 22:16:02,248][52669] Sum rewards: 5.864, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.915', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.054', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.308', 'weapon3': '1.530', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 51912704. Throughput: 0: 4213.4. Samples: 12979240. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:16:02,794][52567] Avg episode reward: [(0, '3.849')] [2024-08-05 22:16:02,795][52647] DAMAGECOUNT value on done: 4449.0 [2024-08-05 22:16:02,796][52647] Sum rewards: 4.580, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.700', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.081', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.950', 'weapon3': '1.388', 'DAMAGECOUNT': '1.626', 'weapon2': '1.678', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:02,795][52614] Saving new best policy, reward=3.849! [2024-08-05 22:16:02,879][52665] DAMAGECOUNT value on done: 3942.0 [2024-08-05 22:16:02,879][52665] Sum rewards: 2.564, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.490', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon4': '0.166', 'WEAPON5': '0.200', 'HITCOUNT': '0.430', 'ARMOR': '0.529', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.245', 'weapon2': '1.430', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:03,859][52670] DAMAGECOUNT value on done: 4306.0 [2024-08-05 22:16:03,859][52670] Sum rewards: 2.175, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.070', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.020', 'ARMOR': '0.068', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.202', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.152', 'weapon2': '1.314', 'weapon3': '1.548', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:04,171][52650] Updated weights for policy 0, policy_version 6341 (0.0023) [2024-08-05 22:16:04,561][52666] DAMAGECOUNT value on done: 5569.0 [2024-08-05 22:16:04,562][52666] Sum rewards: 5.866, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.962', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'ARMOR': '0.436', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.838', 'weapon3': '1.922', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '8.000'} [2024-08-05 22:16:04,780][52663] DAMAGECOUNT value on done: 5512.0 [2024-08-05 22:16:04,782][52663] Sum rewards: 4.397, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.952', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.196', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'ARMOR': '0.954', 'weapon2': '1.410', 'DAMAGECOUNT': '1.464', 'weapon3': '1.556', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:05,069][52669] DAMAGECOUNT value on done: 4971.0 [2024-08-05 22:16:05,071][52669] Sum rewards: 1.454, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.641', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.023', 'WEAPON1': '0.030', 'weapon5': '0.042', 'AMMO3': '0.126', 'WEAPON5': '0.250', 'HITCOUNT': '0.340', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.170', 'weapon2': '1.514', 'weapon3': '2.182', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:06,053][52647] DAMAGECOUNT value on done: 5204.0 [2024-08-05 22:16:06,053][52647] Sum rewards: 3.154, reward structure: {'DEATHCOUNT': '-6.000', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'HEALTH': '0.229', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.038', 'ARMOR': '1.356', 'weapon3': '1.380', 'weapon2': '1.988', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:06,127][52665] DAMAGECOUNT value on done: 4788.0 [2024-08-05 22:16:06,131][52665] Sum rewards: -0.298, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.360', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.320', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.846', 'ARMOR': '0.896', 'weapon2': '1.642', 'FRAGCOUNT': '2.000', 'weapon3': '2.024'} [2024-08-05 22:16:06,807][52670] DAMAGECOUNT value on done: 5095.0 [2024-08-05 22:16:06,809][52670] Sum rewards: 9.394, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.070', 'ARMOR': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '1.352', 'weapon3': '1.574', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '8.000'} [2024-08-05 22:16:07,739][52666] DAMAGECOUNT value on done: 5449.0 [2024-08-05 22:16:07,739][52666] Sum rewards: 3.024, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.329', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'ARMOR': '0.520', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon2': '1.782', 'weapon3': '1.818', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 52002816. Throughput: 0: 4203.3. Samples: 13004450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:16:07,794][52567] Avg episode reward: [(0, '3.933')] [2024-08-05 22:16:07,798][52614] Saving new best policy, reward=3.933! [2024-08-05 22:16:07,961][52663] DAMAGECOUNT value on done: 6594.0 [2024-08-05 22:16:07,962][52663] Sum rewards: -2.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.144', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.178', 'HITCOUNT': '0.380', 'ARMOR': '0.463', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.128', 'weapon2': '1.278', 'weapon3': '1.902'} [2024-08-05 22:16:08,418][52669] DAMAGECOUNT value on done: 5681.0 [2024-08-05 22:16:08,420][52669] Sum rewards: 8.921, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.094', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'ARMOR': '0.900', 'weapon2': '1.632', 'weapon3': '1.866', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:09,153][52670] DAMAGECOUNT value on done: 3629.0 [2024-08-05 22:16:09,154][52670] Sum rewards: 7.351, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'HEALTH': '0.361', 'weapon4': '0.516', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'ARMOR': '0.895', 'weapon2': '1.246', 'weapon3': '1.768', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:09,172][52665] DAMAGECOUNT value on done: 5130.0 [2024-08-05 22:16:09,173][52665] Sum rewards: 3.969, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'ARMOR': '0.510', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.590', 'weapon3': '1.616', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:09,347][52650] Updated weights for policy 0, policy_version 6351 (0.0011) [2024-08-05 22:16:09,433][52647] DAMAGECOUNT value on done: 3980.0 [2024-08-05 22:16:09,434][52647] Sum rewards: 6.226, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.283', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.488', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.440', 'DAMAGECOUNT': '1.488', 'weapon2': '1.836', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:10,172][52666] DAMAGECOUNT value on done: 4045.0 [2024-08-05 22:16:10,175][52666] Sum rewards: 2.321, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.106', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'weapon5': '0.384', 'ARMOR': '0.464', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.900', 'weapon2': '1.424', 'weapon3': '1.776', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:10,813][52663] DAMAGECOUNT value on done: 4740.0 [2024-08-05 22:16:10,814][52663] Sum rewards: 6.614, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.040', 'ARMOR': '0.056', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'HEALTH': '0.171', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'weapon3': '1.316', 'weapon2': '1.662', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:11,107][52669] DAMAGECOUNT value on done: 4973.0 [2024-08-05 22:16:11,108][52669] Sum rewards: -0.328, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.356', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.150', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.294', 'weapon2': '1.324', 'DAMAGECOUNT': '1.785'} [2024-08-05 22:16:11,795][52667] DAMAGECOUNT value on done: 5911.0 [2024-08-05 22:16:11,795][52667] Sum rewards: 2.281, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.290', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.126', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'DAMAGECOUNT': '1.470', 'weapon3': '1.584', 'weapon2': '1.662', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:11,877][52665] DAMAGECOUNT value on done: 5395.0 [2024-08-05 22:16:11,877][52665] Sum rewards: 4.037, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.812', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.107', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'ARMOR': '0.863', 'weapon2': '1.286', 'DAMAGECOUNT': '1.911', 'weapon3': '2.086', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:12,076][52670] DAMAGECOUNT value on done: 4704.0 [2024-08-05 22:16:12,076][52670] Sum rewards: 7.635, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.895', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.066', 'ARMOR': '0.469', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.212', 'weapon2': '1.332', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:12,332][52647] DAMAGECOUNT value on done: 4817.0 [2024-08-05 22:16:12,334][52647] Sum rewards: 4.338, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.014', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '1.302', 'DAMAGECOUNT': '1.314', 'weapon3': '1.424', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:12,795][52567] Fps is (10 sec: 17202.5, 60 sec: 16930.0, 300 sec: 16828.3). Total num frames: 52084736. Throughput: 0: 4202.0. Samples: 13029800. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:16:12,795][52567] Avg episode reward: [(0, '3.977')] [2024-08-05 22:16:12,842][52614] Saving new best policy, reward=3.977! [2024-08-05 22:16:13,314][52666] DAMAGECOUNT value on done: 4769.0 [2024-08-05 22:16:13,314][52666] Sum rewards: 5.591, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.431', 'AMMO2': '0.011', 'AMMO4': '0.056', 'ARMOR': '0.068', 'AMMO3': '0.092', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.288', 'WEAPON3': '0.550', 'HITCOUNT': '0.550', 'weapon2': '1.440', 'DAMAGECOUNT': '1.635', 'weapon3': '1.886', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:14,212][52663] DAMAGECOUNT value on done: 4517.0 [2024-08-05 22:16:14,214][52663] Sum rewards: 3.138, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.140', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.116', 'ARMOR': '0.463', 'HITCOUNT': '0.620', 'WEAPON3': '0.900', 'weapon2': '1.568', 'weapon3': '1.950', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:14,431][52665] DAMAGECOUNT value on done: 4020.0 [2024-08-05 22:16:14,433][52665] Sum rewards: 6.719, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon4': '0.206', 'WEAPON3': '0.250', 'HITCOUNT': '0.410', 'HEALTH': '0.456', 'ARMOR': '0.468', 'weapon3': '1.050', 'weapon2': '1.272', 'DAMAGECOUNT': '1.431', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:14,486][52650] Updated weights for policy 0, policy_version 6361 (0.0044) [2024-08-05 22:16:14,594][52669] DAMAGECOUNT value on done: 5419.0 [2024-08-05 22:16:14,594][52669] Sum rewards: 0.614, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.135', 'weapon4': '0.202', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'ARMOR': '0.897', 'weapon2': '1.308', 'DAMAGECOUNT': '1.512', 'weapon3': '1.956', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:14,697][52667] DAMAGECOUNT value on done: 5045.0 [2024-08-05 22:16:14,699][52667] Sum rewards: 6.409, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.486', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'ARMOR': '1.342', 'weapon3': '1.692', 'weapon2': '1.718', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:15,480][52647] DAMAGECOUNT value on done: 4957.0 [2024-08-05 22:16:15,480][52647] Sum rewards: 4.338, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.940', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.156', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.984', 'DAMAGECOUNT': '1.080', 'weapon3': '1.304', 'weapon2': '1.910', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:15,673][52670] DAMAGECOUNT value on done: 5344.0 [2024-08-05 22:16:15,676][52670] Sum rewards: 5.168, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.132', 'weapon4': '0.310', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'ARMOR': '0.863', 'weapon2': '1.390', 'weapon3': '1.942', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:15,991][52614] Signal inference workers to stop experience collection... (1200 times) [2024-08-05 22:16:15,993][52614] Signal inference workers to resume experience collection... (1200 times) [2024-08-05 22:16:16,043][52650] InferenceWorker_p0-w0: stopping experience collection (1200 times) [2024-08-05 22:16:16,043][52650] InferenceWorker_p0-w0: resuming experience collection (1200 times) [2024-08-05 22:16:16,624][52666] DAMAGECOUNT value on done: 5020.0 [2024-08-05 22:16:16,626][52666] Sum rewards: 6.695, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.022', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.836', 'weapon3': '1.714', 'weapon2': '1.750', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:17,124][52663] DAMAGECOUNT value on done: 5597.0 [2024-08-05 22:16:17,127][52663] Sum rewards: 2.045, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.352', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.119', 'HITCOUNT': '0.460', 'ARMOR': '0.844', 'WEAPON3': '0.850', 'weapon2': '1.586', 'DAMAGECOUNT': '1.770', 'weapon3': '1.862', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:17,340][52669] DAMAGECOUNT value on done: 4904.0 [2024-08-05 22:16:17,341][52669] Sum rewards: 1.739, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.879', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.152', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.557', 'weapon3': '1.438', 'DAMAGECOUNT': '1.470', 'weapon2': '1.644', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:17,434][52667] DAMAGECOUNT value on done: 5615.0 [2024-08-05 22:16:17,436][52667] Sum rewards: 4.780, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.282', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.256', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'ARMOR': '0.894', 'weapon3': '1.400', 'weapon2': '1.576', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:17,446][52665] DAMAGECOUNT value on done: 3738.0 [2024-08-05 22:16:17,447][52665] Sum rewards: 10.828, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.476', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.136', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'ARMOR': '0.916', 'weapon2': '1.518', 'weapon3': '1.886', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '10.000'} [2024-08-05 22:16:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16828.3). Total num frames: 52166656. Throughput: 0: 4217.1. Samples: 13042290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:16:17,794][52567] Avg episode reward: [(0, '4.148')] [2024-08-05 22:16:17,798][52614] Saving new best policy, reward=4.148! [2024-08-05 22:16:18,473][52670] DAMAGECOUNT value on done: 5341.0 [2024-08-05 22:16:18,883][52650] Updated weights for policy 0, policy_version 6371 (0.0026) [2024-08-05 22:16:18,986][52647] DAMAGECOUNT value on done: 5189.0 [2024-08-05 22:16:18,986][52647] Sum rewards: 2.714, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.824', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'ARMOR': '0.064', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.196', 'HITCOUNT': '0.290', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.140', 'weapon3': '1.148', 'weapon2': '1.570', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:19,441][52666] DAMAGECOUNT value on done: 4303.0 [2024-08-05 22:16:19,442][52666] Sum rewards: 4.707, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.268', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.049', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'weapon4': '0.338', 'ARMOR': '0.535', 'weapon3': '0.718', 'weapon2': '1.110', 'DAMAGECOUNT': '1.245', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:20,286][52663] DAMAGECOUNT value on done: 5465.0 [2024-08-05 22:16:20,286][52663] Sum rewards: -1.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'weapon4': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'HITCOUNT': '0.440', 'DAMAGECOUNT': '1.239', 'WEAPON3': '1.250', 'weapon2': '1.256', 'ARMOR': '1.433', 'weapon3': '2.540', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:20,470][52669] DAMAGECOUNT value on done: 5632.0 [2024-08-05 22:16:20,473][52669] Sum rewards: 4.815, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.499', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.250', 'ARMOR': '0.468', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.114', 'weapon3': '1.680', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:20,764][52665] DAMAGECOUNT value on done: 5659.0 [2024-08-05 22:16:20,766][52665] Sum rewards: -0.965, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.062', 'AMMO2': '0.003', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon5': '0.134', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'DAMAGECOUNT': '1.110', 'weapon2': '1.266', 'weapon3': '1.280', 'FRAGCOUNT': '1.500'} [2024-08-05 22:16:21,085][52667] DAMAGECOUNT value on done: 5555.0 [2024-08-05 22:16:21,086][52667] Sum rewards: 7.565, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.282', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '1.021', 'weapon3': '1.756', 'weapon2': '1.794', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:21,891][52670] DAMAGECOUNT value on done: 5074.0 [2024-08-05 22:16:21,893][52670] Sum rewards: 5.192, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.370', 'WEAPON3': '0.400', 'ARMOR': '0.445', 'HITCOUNT': '0.490', 'HEALTH': '0.570', 'weapon2': '1.110', 'weapon3': '1.296', 'DAMAGECOUNT': '1.779', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:21,902][52647] DAMAGECOUNT value on done: 5857.0 [2024-08-05 22:16:21,905][52647] Sum rewards: 3.209, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'HEALTH': '0.106', 'weapon4': '0.118', 'HITCOUNT': '0.340', 'WEAPON3': '0.500', 'ARMOR': '0.940', 'weapon2': '1.196', 'DAMAGECOUNT': '1.281', 'weapon3': '1.550', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:22,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 52256768. Throughput: 0: 4212.2. Samples: 13067450. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-05 22:16:22,794][52567] Avg episode reward: [(0, '4.143')] [2024-08-05 22:16:22,886][52666] DAMAGECOUNT value on done: 4776.0 [2024-08-05 22:16:22,887][52666] Sum rewards: 2.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.496', 'weapon5': '0.008', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.320', 'ARMOR': '0.525', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.116', 'weapon3': '1.704', 'weapon2': '1.708', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:23,258][52663] DAMAGECOUNT value on done: 5244.0 [2024-08-05 22:16:23,258][52663] Sum rewards: 1.858, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.382', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon5': '0.280', 'HITCOUNT': '0.470', 'ARMOR': '0.526', 'WEAPON3': '0.750', 'weapon2': '1.302', 'DAMAGECOUNT': '1.455', 'weapon3': '1.886', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:23,549][52669] DAMAGECOUNT value on done: 4550.0 [2024-08-05 22:16:23,552][52669] Sum rewards: -0.109, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.806', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'weapon4': '0.234', 'HITCOUNT': '0.240', 'ARMOR': '0.468', 'DAMAGECOUNT': '0.591', 'WEAPON3': '0.650', 'weapon3': '1.300', 'weapon2': '1.794', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:23,650][52667] DAMAGECOUNT value on done: 6340.0 [2024-08-05 22:16:23,652][52667] Sum rewards: 12.198, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.131', 'WEAPON3': '0.750', 'ARMOR': '0.885', 'HITCOUNT': '0.970', 'weapon2': '1.610', 'weapon3': '2.072', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '11.000'} [2024-08-05 22:16:23,747][52665] DAMAGECOUNT value on done: 6359.0 [2024-08-05 22:16:23,747][52665] Sum rewards: 6.005, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'weapon4': '0.126', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'ARMOR': '0.898', 'weapon2': '1.380', 'weapon3': '1.430', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:23,941][52650] Updated weights for policy 0, policy_version 6381 (0.0035) [2024-08-05 22:16:24,660][52647] DAMAGECOUNT value on done: 3980.0 [2024-08-05 22:16:24,664][52647] Sum rewards: 1.608, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.196', 'HITCOUNT': '0.450', 'ARMOR': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.514', 'weapon3': '1.592', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:25,431][52670] DAMAGECOUNT value on done: 5683.0 [2024-08-05 22:16:25,432][52670] Sum rewards: 8.428, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.382', 'AMMO2': '0.024', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon4': '0.476', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon3': '1.514', 'weapon2': '1.534', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:26,337][52666] DAMAGECOUNT value on done: 4744.0 [2024-08-05 22:16:26,339][52666] Sum rewards: -1.588, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.850', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.178', 'HITCOUNT': '0.460', 'ARMOR': '0.583', 'weapon2': '1.016', 'WEAPON3': '1.200', 'DAMAGECOUNT': '1.902', 'weapon3': '2.204', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:26,349][52663] DAMAGECOUNT value on done: 5516.0 [2024-08-05 22:16:26,350][52663] Sum rewards: 5.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon7': '0.054', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.282', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'ARMOR': '1.411', 'weapon2': '1.492', 'weapon3': '1.810', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:26,530][52669] DAMAGECOUNT value on done: 6051.0 [2024-08-05 22:16:26,530][52669] Sum rewards: 9.622, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.066', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.172', 'weapon4': '0.286', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon2': '1.470', 'weapon3': '1.470', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:26,798][52667] DAMAGECOUNT value on done: 5944.0 [2024-08-05 22:16:26,800][52667] Sum rewards: -1.488, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.674', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'weapon4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'ARMOR': '0.478', 'HITCOUNT': '0.680', 'WEAPON3': '1.150', 'weapon2': '1.442', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.070', 'weapon3': '2.140'} [2024-08-05 22:16:26,944][52665] DAMAGECOUNT value on done: 5802.0 [2024-08-05 22:16:26,945][52665] Sum rewards: 2.263, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.242', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.226', 'HITCOUNT': '0.430', 'ARMOR': '0.542', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.386', 'weapon3': '1.524', 'weapon2': '1.712', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:27,656][52647] DAMAGECOUNT value on done: 5001.0 [2024-08-05 22:16:27,659][52647] Sum rewards: 0.778, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon5': '0.128', 'HITCOUNT': '0.380', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.095', 'weapon2': '1.600', 'weapon3': '1.656', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 52338688. Throughput: 0: 4208.2. Samples: 13092820. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:16:27,795][52567] Avg episode reward: [(0, '4.011')] [2024-08-05 22:16:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006389_52338688.pth... [2024-08-05 22:16:27,847][52649] DAMAGECOUNT value on done: 5462.0 [2024-08-05 22:16:27,850][52649] Sum rewards: 1.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.839', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'HITCOUNT': '0.630', 'WEAPON3': '1.200', 'weapon2': '1.304', 'ARMOR': '1.358', 'DAMAGECOUNT': '2.175', 'weapon3': '2.460', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:27,869][52658] DAMAGECOUNT value on done: 4457.0 [2024-08-05 22:16:27,869][52658] Sum rewards: 5.173, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.376', 'ARMOR': '0.460', 'HITCOUNT': '0.610', 'WEAPON3': '0.950', 'weapon2': '1.236', 'weapon3': '2.016', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:28,005][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000005896_48300032.pth [2024-08-05 22:16:28,938][52650] Updated weights for policy 0, policy_version 6391 (0.0021) [2024-08-05 22:16:28,976][52670] DAMAGECOUNT value on done: 4926.0 [2024-08-05 22:16:28,980][52670] Sum rewards: 2.515, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.984', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.178', 'HITCOUNT': '0.510', 'ARMOR': '0.909', 'WEAPON3': '1.050', 'weapon2': '1.702', 'DAMAGECOUNT': '1.710', 'weapon3': '1.814', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:28,987][52663] DAMAGECOUNT value on done: 4985.0 [2024-08-05 22:16:28,988][52663] Sum rewards: 1.561, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.018', 'AMMO2': '0.013', 'ARMOR': '0.016', 'weapon4': '0.054', 'AMMO4': '0.063', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.578', 'DAMAGECOUNT': '1.689', 'weapon3': '1.748', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:29,828][52667] DAMAGECOUNT value on done: 5340.0 [2024-08-05 22:16:29,829][52667] Sum rewards: 5.461, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.034', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.330', 'HITCOUNT': '0.550', 'weapon5': '0.566', 'WEAPON3': '0.750', 'ARMOR': '0.919', 'weapon2': '1.122', 'weapon3': '1.660', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:29,831][52666] DAMAGECOUNT value on done: 4482.0 [2024-08-05 22:16:29,831][52666] Sum rewards: -0.766, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.083', 'weapon4': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.170', 'DAMAGECOUNT': '0.417', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.800', 'weapon2': '1.988'} [2024-08-05 22:16:29,971][52665] DAMAGECOUNT value on done: 5508.0 [2024-08-05 22:16:29,972][52665] Sum rewards: 1.385, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.437', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.135', 'ARMOR': '0.451', 'HITCOUNT': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.478', 'DAMAGECOUNT': '1.722', 'weapon3': '2.022', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:30,689][52647] DAMAGECOUNT value on done: 4538.0 [2024-08-05 22:16:30,689][52647] Sum rewards: 1.506, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.297', 'AMMO2': '0.007', 'ARMOR': '0.028', 'AMMO4': '0.035', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'HITCOUNT': '0.230', 'weapon4': '0.238', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon3': '1.154', 'weapon2': '1.426'} [2024-08-05 22:16:30,861][52649] DAMAGECOUNT value on done: 4575.0 [2024-08-05 22:16:30,862][52649] Sum rewards: 3.975, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.120', 'weapon4': '0.240', 'ARMOR': '0.502', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.504', 'weapon3': '1.618', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:30,895][52658] DAMAGECOUNT value on done: 4286.0 [2024-08-05 22:16:31,908][52663] DAMAGECOUNT value on done: 5050.0 [2024-08-05 22:16:31,910][52663] Sum rewards: 4.939, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.468', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.172', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.450', 'weapon3': '1.832', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:31,969][52670] DAMAGECOUNT value on done: 3540.0 [2024-08-05 22:16:31,970][52670] Sum rewards: 2.310, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.312', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO4': '0.115', 'AMMO3': '0.118', 'weapon4': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.454', 'HITCOUNT': '0.480', 'WEAPON3': '0.800', 'weapon3': '1.330', 'DAMAGECOUNT': '1.530', 'weapon2': '1.666', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:32,694][52794] DAMAGECOUNT value on done: 5448.0 [2024-08-05 22:16:32,695][52794] Sum rewards: 1.085, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.208', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.294', 'HITCOUNT': '0.360', 'ARMOR': '0.504', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.128', 'weapon2': '1.398', 'weapon3': '1.810', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:32,753][52665] DAMAGECOUNT value on done: 6412.0 [2024-08-05 22:16:32,753][52665] Sum rewards: 13.716, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.011', 'HEALTH': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.116', 'weapon5': '0.138', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'ARMOR': '0.876', 'weapon2': '1.288', 'weapon3': '2.266', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '11.000'} [2024-08-05 22:16:32,795][52567] Fps is (10 sec: 16383.5, 60 sec: 16793.5, 300 sec: 16828.3). Total num frames: 52420608. Throughput: 0: 4200.4. Samples: 13105170. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:16:32,795][52567] Avg episode reward: [(0, '3.802')] [2024-08-05 22:16:32,985][52666] DAMAGECOUNT value on done: 4076.0 [2024-08-05 22:16:32,987][52666] Sum rewards: 3.198, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.232', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'ARMOR': '0.490', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '1.216', 'weapon3': '2.010', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:33,019][52667] DAMAGECOUNT value on done: 5210.0 [2024-08-05 22:16:33,020][52667] Sum rewards: 5.118, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.048', 'AMMO2': '0.010', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.202', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon2': '1.174', 'DAMAGECOUNT': '1.497', 'weapon3': '1.646', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:33,287][52650] Updated weights for policy 0, policy_version 6401 (0.0023) [2024-08-05 22:16:33,795][52649] DAMAGECOUNT value on done: 4660.0 [2024-08-05 22:16:33,796][52649] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.982', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.111', 'ARMOR': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.276', 'HITCOUNT': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.120', 'DAMAGECOUNT': '1.596', 'weapon3': '1.662', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:34,062][52647] DAMAGECOUNT value on done: 5136.0 [2024-08-05 22:16:34,066][52647] Sum rewards: 6.204, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.326', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.350', 'HITCOUNT': '0.350', 'ARMOR': '0.448', 'weapon2': '0.910', 'weapon3': '0.974', 'DAMAGECOUNT': '1.101', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:34,124][52658] DAMAGECOUNT value on done: 4306.0 [2024-08-05 22:16:34,124][52658] Sum rewards: 0.118, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.412', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon4': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'ARMOR': '0.983', 'DAMAGECOUNT': '1.500', 'weapon2': '1.724', 'weapon3': '1.828', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:35,010][52794] DAMAGECOUNT value on done: 5746.0 [2024-08-05 22:16:35,012][52794] Sum rewards: 10.452, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.367', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.118', 'weapon4': '0.196', 'WEAPON3': '0.800', 'ARMOR': '0.876', 'HITCOUNT': '1.050', 'weapon2': '1.350', 'weapon3': '1.840', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '10.000'} [2024-08-05 22:16:35,017][52663] DAMAGECOUNT value on done: 6081.0 [2024-08-05 22:16:35,018][52663] Sum rewards: 4.482, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.294', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'ARMOR': '0.044', 'AMMO3': '0.090', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.216', 'weapon3': '1.548', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:35,366][52670] DAMAGECOUNT value on done: 4762.0 [2024-08-05 22:16:35,369][52670] Sum rewards: 2.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.008', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.226', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'ARMOR': '0.917', 'DAMAGECOUNT': '1.089', 'weapon3': '1.248', 'weapon2': '1.548', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:35,687][52665] DAMAGECOUNT value on done: 4967.0 [2024-08-05 22:16:35,687][52665] Sum rewards: 4.672, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.854', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.128', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.266', 'ARMOR': '1.350', 'weapon2': '1.424', 'weapon3': '1.540', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:35,837][52667] DAMAGECOUNT value on done: 5954.0 [2024-08-05 22:16:35,839][52667] Sum rewards: 4.180, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.302', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'ARMOR': '0.112', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.416', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon2': '1.278', 'weapon3': '1.684', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:36,101][52666] DAMAGECOUNT value on done: 4870.0 [2024-08-05 22:16:36,102][52666] Sum rewards: 3.447, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.316', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.092', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.871', 'weapon2': '1.626', 'weapon3': '1.660', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:36,556][52662] DAMAGECOUNT value on done: 5699.0 [2024-08-05 22:16:36,558][52662] Sum rewards: 3.550, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.238', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.150', 'ARMOR': '0.432', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.090', 'weapon3': '2.136', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:36,672][52664] DAMAGECOUNT value on done: 6441.0 [2024-08-05 22:16:36,672][52664] Sum rewards: 5.117, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.308', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.422', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.861', 'weapon2': '0.924', 'weapon3': '0.928', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:36,818][52658] DAMAGECOUNT value on done: 5196.0 [2024-08-05 22:16:36,819][52658] Sum rewards: 3.218, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.582', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.134', 'ARMOR': '0.489', 'HITCOUNT': '0.740', 'WEAPON3': '0.950', 'weapon2': '1.474', 'weapon3': '1.802', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:36,930][52649] DAMAGECOUNT value on done: 5582.0 [2024-08-05 22:16:36,931][52649] Sum rewards: 6.946, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.010', 'HEALTH': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.256', 'WEAPON3': '0.300', 'HITCOUNT': '0.380', 'ARMOR': '0.879', 'weapon3': '0.926', 'weapon2': '1.414', 'DAMAGECOUNT': '1.569', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:37,614][52663] DAMAGECOUNT value on done: 4865.0 [2024-08-05 22:16:37,616][52663] Sum rewards: 0.167, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.260', 'HITCOUNT': '0.270', 'WEAPON3': '0.850', 'ARMOR': '0.924', 'weapon2': '1.028', 'DAMAGECOUNT': '1.113', 'FRAGCOUNT': '1.500', 'weapon3': '2.152'} [2024-08-05 22:16:37,679][52794] DAMAGECOUNT value on done: 6373.0 [2024-08-05 22:16:37,681][52794] Sum rewards: 0.583, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.086', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.083', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'weapon4': '0.394', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.269', 'weapon3': '1.344', 'weapon2': '1.522', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:37,718][52647] DAMAGECOUNT value on done: 4520.0 [2024-08-05 22:16:37,718][52647] Sum rewards: 5.876, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.356', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.073', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'ARMOR': '0.493', 'weapon3': '1.568', 'DAMAGECOUNT': '1.635', 'weapon2': '2.076', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 52502528. Throughput: 0: 4202.9. Samples: 13130530. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 22:16:37,794][52567] Avg episode reward: [(0, '3.732')] [2024-08-05 22:16:38,257][52670] DAMAGECOUNT value on done: 5240.0 [2024-08-05 22:16:38,257][52670] Sum rewards: 2.469, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.844', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'HITCOUNT': '0.360', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.380', 'weapon2': '1.632', 'weapon3': '1.872', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:38,284][52650] Updated weights for policy 0, policy_version 6411 (0.0012) [2024-08-05 22:16:38,479][52667] DAMAGECOUNT value on done: 6040.0 [2024-08-05 22:16:38,479][52667] Sum rewards: 6.091, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.884', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'AMMO3': '0.073', 'weapon4': '0.082', 'WEAPON4': '0.100', 'ARMOR': '0.436', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon3': '1.600', 'weapon2': '1.650', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:38,682][52665] DAMAGECOUNT value on done: 5836.0 [2024-08-05 22:16:38,683][52665] Sum rewards: 6.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.122', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'weapon3': '1.488', 'DAMAGECOUNT': '1.749', 'ARMOR': '1.770', 'weapon2': '1.890', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:38,920][52662] DAMAGECOUNT value on done: 5691.0 [2024-08-05 22:16:38,920][52662] Sum rewards: 8.175, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'ARMOR': '0.934', 'weapon2': '1.538', 'DAMAGECOUNT': '2.013', 'weapon3': '2.090', 'FRAGCOUNT': '9.000'} [2024-08-05 22:16:39,194][52666] DAMAGECOUNT value on done: 6692.0 [2024-08-05 22:16:39,197][52666] Sum rewards: 6.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.854', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.038', 'ARMOR': '0.060', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'HITCOUNT': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.444', 'DAMAGECOUNT': '1.641', 'weapon2': '2.100', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:39,641][52649] DAMAGECOUNT value on done: 3908.0 [2024-08-05 22:16:39,642][52649] Sum rewards: 5.694, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.138', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'AMMO3': '0.130', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'ARMOR': '1.275', 'weapon2': '1.292', 'weapon3': '2.182', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:39,847][52658] DAMAGECOUNT value on done: 5533.0 [2024-08-05 22:16:39,848][52658] Sum rewards: 7.146, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.873', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON5': '0.250', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'ARMOR': '0.872', 'weapon2': '1.582', 'weapon3': '2.096', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:40,118][52794] DAMAGECOUNT value on done: 5655.0 [2024-08-05 22:16:40,118][52794] Sum rewards: 0.618, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.160', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.184', 'HITCOUNT': '0.420', 'ARMOR': '0.517', 'WEAPON3': '0.850', 'weapon2': '1.200', 'DAMAGECOUNT': '1.506', 'weapon3': '1.634', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:40,258][52664] DAMAGECOUNT value on done: 4867.0 [2024-08-05 22:16:40,259][52664] Sum rewards: 2.981, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.794', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.089', 'weapon3': '1.272', 'weapon2': '1.550', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:40,901][52663] DAMAGECOUNT value on done: 4578.0 [2024-08-05 22:16:40,903][52663] Sum rewards: 4.568, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.065', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.164', 'HEALTH': '0.271', 'HITCOUNT': '0.400', 'WEAPON3': '0.400', 'ARMOR': '0.452', 'DAMAGECOUNT': '1.365', 'weapon3': '1.402', 'weapon2': '1.504', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:41,223][52667] DAMAGECOUNT value on done: 4802.0 [2024-08-05 22:16:41,223][52667] Sum rewards: 1.153, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.258', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.185', 'weapon2': '1.262', 'weapon3': '1.390', 'ARMOR': '1.399', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:41,236][52647] DAMAGECOUNT value on done: 6204.0 [2024-08-05 22:16:41,239][52647] Sum rewards: 8.797, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.048', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.086', 'weapon4': '0.226', 'ARMOR': '0.539', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '1.432', 'weapon3': '1.718', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '6.500'} [2024-08-05 22:16:41,324][52662] DAMAGECOUNT value on done: 5734.0 [2024-08-05 22:16:41,327][52662] Sum rewards: 5.822, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.072', 'HITCOUNT': '0.450', 'ARMOR': '0.486', 'WEAPON3': '0.550', 'weapon3': '1.084', 'weapon2': '1.648', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:41,455][52670] DAMAGECOUNT value on done: 4908.0 [2024-08-05 22:16:41,456][52670] Sum rewards: 2.829, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.398', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'weapon5': '0.008', 'AMMO5': '0.010', 'weapon7': '0.076', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'ARMOR': '0.852', 'weapon3': '1.134', 'weapon2': '1.724', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:41,958][52665] DAMAGECOUNT value on done: 5060.0 [2024-08-05 22:16:42,116][52666] DAMAGECOUNT value on done: 5602.0 [2024-08-05 22:16:42,116][52666] Sum rewards: 5.963, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.447', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.100', 'ARMOR': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.310', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.412', 'weapon3': '1.736', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:42,366][52658] DAMAGECOUNT value on done: 4103.0 [2024-08-05 22:16:42,366][52658] Sum rewards: 5.033, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.975', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.022', 'WEAPON1': '0.040', 'AMMO4': '0.046', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.126', 'WEAPON5': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.489', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.332', 'weapon3': '1.414', 'weapon2': '1.800', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16793.5, 300 sec: 16828.3). Total num frames: 52592640. Throughput: 0: 4206.7. Samples: 13155750. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:16:42,795][52567] Avg episode reward: [(0, '3.920')] [2024-08-05 22:16:42,862][52794] DAMAGECOUNT value on done: 5767.0 [2024-08-05 22:16:42,868][52794] Sum rewards: 4.174, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.704', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'ARMOR': '0.824', 'weapon2': '1.164', 'weapon3': '1.330', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:43,138][52649] DAMAGECOUNT value on done: 5500.0 [2024-08-05 22:16:43,138][52649] Sum rewards: 5.690, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.168', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'weapon5': '0.076', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon3': '1.168', 'ARMOR': '1.792', 'weapon2': '1.896', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:43,360][52650] Updated weights for policy 0, policy_version 6421 (0.0015) [2024-08-05 22:16:43,543][52663] DAMAGECOUNT value on done: 5041.0 [2024-08-05 22:16:43,543][52663] Sum rewards: 4.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.949', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.052', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.364', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.410', 'weapon3': '2.062', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:43,549][52664] DAMAGECOUNT value on done: 6070.0 [2024-08-05 22:16:43,551][52664] Sum rewards: 2.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.070', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon4': '0.012', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'ARMOR': '1.337', 'weapon2': '1.764', 'weapon3': '1.944', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:43,951][52670] DAMAGECOUNT value on done: 5107.0 [2024-08-05 22:16:43,952][52670] Sum rewards: 6.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.313', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon5': '0.026', 'AMMO4': '0.036', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'ARMOR': '0.874', 'weapon3': '1.592', 'weapon2': '1.718', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '6.500'} [2024-08-05 22:16:44,158][52667] DAMAGECOUNT value on done: 6180.0 [2024-08-05 22:16:44,158][52667] Sum rewards: 7.759, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.681', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.070', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.832', 'weapon2': '1.644', 'weapon3': '1.730', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:44,398][52662] DAMAGECOUNT value on done: 4645.0 [2024-08-05 22:16:44,398][52662] Sum rewards: 4.462, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'HITCOUNT': '0.180', 'weapon5': '0.188', 'HEALTH': '0.352', 'WEAPON3': '0.400', 'ARMOR': '0.458', 'DAMAGECOUNT': '0.768', 'weapon3': '1.216', 'weapon2': '1.752', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:44,455][52647] DAMAGECOUNT value on done: 4971.0 [2024-08-05 22:16:44,455][52647] Sum rewards: 2.114, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.184', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'ARMOR': '0.885', 'weapon2': '1.550', 'weapon3': '1.556', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:44,977][52665] DAMAGECOUNT value on done: 5662.0 [2024-08-05 22:16:44,978][52665] Sum rewards: 2.132, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.432', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'AMMO4': '0.042', 'weapon5': '0.056', 'weapon4': '0.072', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.180', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.933', 'weapon2': '1.182', 'weapon3': '1.694', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:45,372][52658] DAMAGECOUNT value on done: 5844.0 [2024-08-05 22:16:45,373][52658] Sum rewards: 1.242, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.648', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'HITCOUNT': '0.650', 'ARMOR': '0.932', 'WEAPON3': '1.150', 'weapon2': '1.190', 'DAMAGECOUNT': '2.307', 'weapon3': '2.558', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:45,584][52794] DAMAGECOUNT value on done: 6044.0 [2024-08-05 22:16:45,586][52794] Sum rewards: 7.726, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.158', 'weapon3': '1.692', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '8.000'} [2024-08-05 22:16:46,024][52649] DAMAGECOUNT value on done: 4534.0 [2024-08-05 22:16:46,024][52649] Sum rewards: -2.949, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.758', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.191', 'HITCOUNT': '0.340', 'DAMAGECOUNT': '0.912', 'WEAPON3': '1.100', 'weapon2': '1.160', 'weapon3': '1.754', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:46,676][52663] DAMAGECOUNT value on done: 5070.0 [2024-08-05 22:16:46,676][52663] Sum rewards: 5.972, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'ARMOR': '0.526', 'HITCOUNT': '0.830', 'WEAPON3': '0.900', 'weapon2': '1.360', 'weapon3': '1.644', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '8.000'} [2024-08-05 22:16:46,850][52664] DAMAGECOUNT value on done: 4628.0 [2024-08-05 22:16:46,851][52664] Sum rewards: 4.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.448', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon5': '0.194', 'HITCOUNT': '0.420', 'WEAPON3': '0.850', 'ARMOR': '0.892', 'weapon2': '1.196', 'weapon3': '1.332', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '5.500'} [2024-08-05 22:16:47,064][52662] DAMAGECOUNT value on done: 5778.0 [2024-08-05 22:16:47,065][52662] Sum rewards: 7.427, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.308', 'AMMO2': '0.010', 'AMMO4': '0.049', 'ARMOR': '0.072', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon2': '0.724', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon3': '2.228', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '7.000'} [2024-08-05 22:16:47,455][52667] DAMAGECOUNT value on done: 6100.0 [2024-08-05 22:16:47,455][52667] Sum rewards: 10.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.818', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.143', 'ARMOR': '0.574', 'WEAPON3': '0.950', 'HITCOUNT': '1.040', 'weapon2': '1.468', 'weapon3': '2.080', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '12.000'} [2024-08-05 22:16:47,566][52647] DAMAGECOUNT value on done: 5582.0 [2024-08-05 22:16:47,568][52647] Sum rewards: 2.372, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.504', 'AMMO2': '0.022', 'AMMO3': '0.093', 'AMMO4': '0.110', 'weapon4': '0.136', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.040', 'ARMOR': '1.318', 'DAMAGECOUNT': '1.365', 'weapon3': '1.492', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:47,620][52665] DAMAGECOUNT value on done: 4256.0 [2024-08-05 22:16:47,621][52665] Sum rewards: 1.064, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.588', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.164', 'HITCOUNT': '0.190', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.705', 'weapon3': '1.238', 'weapon2': '1.880', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:47,795][52567] Fps is (10 sec: 17201.2, 60 sec: 16929.8, 300 sec: 16800.5). Total num frames: 52674560. Throughput: 0: 4203.4. Samples: 13168400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:16:47,796][52567] Avg episode reward: [(0, '3.958')] [2024-08-05 22:16:47,903][52671] DAMAGECOUNT value on done: 6171.0 [2024-08-05 22:16:47,903][52671] Sum rewards: 7.156, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.328', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon7': '0.046', 'AMMO3': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.298', 'weapon2': '1.312', 'ARMOR': '1.782', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:47,980][52650] Updated weights for policy 0, policy_version 6431 (0.0013) [2024-08-05 22:16:48,426][52658] DAMAGECOUNT value on done: 5586.0 [2024-08-05 22:16:48,426][52658] Sum rewards: 5.612, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.036', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.090', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'ARMOR': '0.880', 'weapon2': '1.152', 'weapon3': '2.090', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:48,568][52794] DAMAGECOUNT value on done: 5763.0 [2024-08-05 22:16:48,577][52794] Sum rewards: 6.412, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.051', 'weapon7': '0.052', 'HEALTH': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.146', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.350', 'ARMOR': '0.484', 'HITCOUNT': '0.490', 'weapon2': '1.188', 'weapon3': '1.206', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '2.500'} [2024-08-05 22:16:48,765][52649] DAMAGECOUNT value on done: 4266.0 [2024-08-05 22:16:48,767][52649] Sum rewards: 0.432, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.434', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.173', 'ARMOR': '0.457', 'HITCOUNT': '0.610', 'WEAPON3': '1.150', 'weapon2': '1.588', 'weapon3': '1.852', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:49,707][52664] DAMAGECOUNT value on done: 5659.0 [2024-08-05 22:16:50,057][52662] DAMAGECOUNT value on done: 6066.0 [2024-08-05 22:16:50,058][52662] Sum rewards: 6.765, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.062', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.134', 'weapon5': '0.318', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon3': '1.174', 'DAMAGECOUNT': '1.668', 'weapon2': '1.684', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:50,113][52667] DAMAGECOUNT value on done: 6172.0 [2024-08-05 22:16:50,113][52667] Sum rewards: 2.352, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.382', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.468', 'ARMOR': '0.483', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.930', 'weapon2': '1.100', 'weapon3': '1.530', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:50,420][52665] DAMAGECOUNT value on done: 5872.0 [2024-08-05 22:16:50,421][52665] Sum rewards: 4.621, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.166', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.110', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'ARMOR': '0.507', 'DAMAGECOUNT': '1.068', 'weapon3': '1.156', 'weapon2': '1.846', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:50,458][52647] DAMAGECOUNT value on done: 5135.0 [2024-08-05 22:16:50,464][52647] Sum rewards: 5.515, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.404', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.032', 'weapon4': '0.042', 'AMMO4': '0.084', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'ARMOR': '0.556', 'HITCOUNT': '0.660', 'weapon3': '1.144', 'weapon2': '1.586', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:51,103][52671] DAMAGECOUNT value on done: 5568.0 [2024-08-05 22:16:51,105][52671] Sum rewards: 12.810, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.205', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.880', 'weapon3': '1.406', 'weapon2': '1.724', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '9.000'} [2024-08-05 22:16:51,166][52658] DAMAGECOUNT value on done: 4239.0 [2024-08-05 22:16:51,170][52658] Sum rewards: 1.862, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.180', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.024', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.224', 'HITCOUNT': '0.340', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.966', 'weapon3': '1.068', 'weapon2': '1.460', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:51,355][52794] DAMAGECOUNT value on done: 4622.0 [2024-08-05 22:16:51,355][52794] Sum rewards: 2.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.876', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.122', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'HITCOUNT': '0.460', 'ARMOR': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.258', 'DAMAGECOUNT': '1.290', 'weapon3': '2.204', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:51,795][52649] DAMAGECOUNT value on done: 4840.0 [2024-08-05 22:16:51,795][52649] Sum rewards: 2.049, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.163', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.252', 'HITCOUNT': '0.340', 'ARMOR': '0.507', 'WEAPON3': '0.700', 'weapon2': '1.184', 'DAMAGECOUNT': '1.275', 'weapon3': '1.466', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:52,518][52662] DAMAGECOUNT value on done: 6927.0 [2024-08-05 22:16:52,519][52662] Sum rewards: 4.621, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.309', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'weapon4': '0.144', 'ARMOR': '0.475', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.308', 'weapon3': '1.450', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:52,602][52664] DAMAGECOUNT value on done: 5338.0 [2024-08-05 22:16:52,602][52664] Sum rewards: -1.225, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.151', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.194', 'HITCOUNT': '0.480', 'ARMOR': '0.509', 'weapon2': '1.216', 'WEAPON3': '1.300', 'DAMAGECOUNT': '1.863', 'weapon3': '2.646', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:52,780][52650] Updated weights for policy 0, policy_version 6441 (0.0024) [2024-08-05 22:16:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 52764672. Throughput: 0: 4212.6. Samples: 13194020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:16:52,795][52567] Avg episode reward: [(0, '3.987')] [2024-08-05 22:16:53,077][52667] DAMAGECOUNT value on done: 5916.0 [2024-08-05 22:16:53,078][52667] Sum rewards: 4.056, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.623', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.135', 'HITCOUNT': '0.670', 'WEAPON3': '0.850', 'ARMOR': '1.008', 'weapon2': '1.750', 'weapon3': '1.826', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:53,583][52671] DAMAGECOUNT value on done: 5346.0 [2024-08-05 22:16:53,585][52671] Sum rewards: 5.894, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.212', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.070', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'DAMAGECOUNT': '1.425', 'ARMOR': '1.448', 'weapon3': '1.534', 'weapon2': '1.976', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:54,013][52794] DAMAGECOUNT value on done: 6518.0 [2024-08-05 22:16:54,014][52794] Sum rewards: 4.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.007', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.004', 'WEAPON5': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.520', 'ARMOR': '0.536', 'WEAPON3': '0.800', 'weapon2': '1.634', 'DAMAGECOUNT': '1.833', 'weapon3': '1.982', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:54,315][52658] DAMAGECOUNT value on done: 4836.0 [2024-08-05 22:16:54,317][52658] Sum rewards: 5.109, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.037', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'weapon4': '0.178', 'WEAPON3': '0.350', 'HITCOUNT': '0.470', 'weapon3': '1.000', 'DAMAGECOUNT': '1.425', 'weapon2': '1.506', 'FRAGCOUNT': '3.000'} [2024-08-05 22:16:54,375][52659] DAMAGECOUNT value on done: 4743.0 [2024-08-05 22:16:54,377][52659] Sum rewards: 2.946, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.186', 'AMMO4': '-0.099', 'AMMO2': '-0.020', 'AMMO5': '0.007', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'weapon5': '0.278', 'HITCOUNT': '0.400', 'ARMOR': '0.897', 'WEAPON3': '0.950', 'weapon3': '1.592', 'DAMAGECOUNT': '1.698', 'weapon2': '1.898', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:54,951][52649] DAMAGECOUNT value on done: 4359.0 [2024-08-05 22:16:54,952][52649] Sum rewards: 2.128, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.893', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.014', 'AMMO3': '0.065', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.460', 'ARMOR': '0.472', 'WEAPON3': '0.500', 'weapon3': '1.150', 'DAMAGECOUNT': '1.434', 'weapon2': '1.780', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:55,168][52662] DAMAGECOUNT value on done: 6542.0 [2024-08-05 22:16:55,169][52662] Sum rewards: 5.711, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.108', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'ARMOR': '1.385', 'weapon2': '1.594', 'weapon3': '1.616', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:55,328][52664] DAMAGECOUNT value on done: 5658.0 [2024-08-05 22:16:55,332][52664] Sum rewards: 8.543, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.186', 'AMMO2': '0.029', 'AMMO3': '0.133', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.170', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon2': '1.158', 'ARMOR': '1.348', 'DAMAGECOUNT': '1.920', 'weapon3': '2.284', 'FRAGCOUNT': '9.000'} [2024-08-05 22:16:56,412][52794] DAMAGECOUNT value on done: 6224.0 [2024-08-05 22:16:56,414][52794] Sum rewards: 7.676, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.934', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.200', 'ARMOR': '0.493', 'weapon2': '0.878', 'HITCOUNT': '1.000', 'WEAPON3': '1.100', 'weapon3': '2.550', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '10.000'} [2024-08-05 22:16:56,434][52667] DAMAGECOUNT value on done: 5221.0 [2024-08-05 22:16:56,434][52667] Sum rewards: 5.036, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.211', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.012', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '1.354', 'weapon3': '1.378', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:56,509][52671] DAMAGECOUNT value on done: 5339.0 [2024-08-05 22:16:56,509][52671] Sum rewards: 6.015, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.692', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.060', 'weapon4': '0.082', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.466', 'weapon3': '1.890', 'DAMAGECOUNT': '2.391', 'FRAGCOUNT': '6.000'} [2024-08-05 22:16:57,403][52658] DAMAGECOUNT value on done: 5517.0 [2024-08-05 22:16:57,405][52658] Sum rewards: 4.309, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.898', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'ARMOR': '0.084', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.250', 'weapon4': '0.368', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.114', 'DAMAGECOUNT': '1.827', 'weapon3': '1.932', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:57,603][52662] DAMAGECOUNT value on done: 6300.0 [2024-08-05 22:16:57,603][52662] Sum rewards: 1.294, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.982', 'ARMOR': '0.015', 'AMMO2': '0.015', 'weapon4': '0.020', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.610', 'WEAPON3': '1.000', 'weapon2': '1.238', 'DAMAGECOUNT': '1.731', 'weapon3': '2.332', 'FRAGCOUNT': '4.000'} [2024-08-05 22:16:57,607][52659] DAMAGECOUNT value on done: 5984.0 [2024-08-05 22:16:57,608][52659] Sum rewards: 2.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.349', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.282', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'ARMOR': '1.377', 'weapon3': '1.382', 'weapon2': '1.476', 'DAMAGECOUNT': '1.482'} [2024-08-05 22:16:57,694][52650] Updated weights for policy 0, policy_version 6451 (0.0044) [2024-08-05 22:16:57,794][52567] Fps is (10 sec: 17205.3, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 52846592. Throughput: 0: 4211.8. Samples: 13219330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:16:57,795][52567] Avg episode reward: [(0, '4.079')] [2024-08-05 22:16:57,858][52664] DAMAGECOUNT value on done: 5625.0 [2024-08-05 22:16:57,860][52664] Sum rewards: 8.095, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.026', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'weapon4': '0.158', 'WEAPON3': '0.350', 'HITCOUNT': '0.490', 'HEALTH': '0.507', 'ARMOR': '0.981', 'weapon3': '1.370', 'DAMAGECOUNT': '1.590', 'weapon2': '1.690', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:58,181][52649] DAMAGECOUNT value on done: 5342.0 [2024-08-05 22:16:58,181][52649] Sum rewards: 0.035, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.117', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.172', 'HITCOUNT': '0.420', 'WEAPON3': '0.800', 'ARMOR': '0.820', 'weapon2': '1.068', 'weapon3': '1.486', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '2.000'} [2024-08-05 22:16:58,920][52794] DAMAGECOUNT value on done: 5938.0 [2024-08-05 22:16:58,925][52794] Sum rewards: 6.198, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.356', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.008', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.148', 'WEAPON5': '0.200', 'HITCOUNT': '0.760', 'WEAPON3': '1.000', 'weapon2': '1.576', 'weapon3': '1.896', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '8.000'} [2024-08-05 22:16:59,401][52667] DAMAGECOUNT value on done: 5206.0 [2024-08-05 22:16:59,401][52667] Sum rewards: 1.262, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.182', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.380', 'HITCOUNT': '0.550', 'weapon2': '0.602', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.728', 'weapon3': '1.874', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:59,564][52671] DAMAGECOUNT value on done: 5511.0 [2024-08-05 22:16:59,565][52671] Sum rewards: 4.549, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.523', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'ARMOR': '0.060', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.182', 'WEAPON5': '0.250', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.122', 'weapon3': '1.924', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '5.000'} [2024-08-05 22:16:59,581][52803] DAMAGECOUNT value on done: 5769.0 [2024-08-05 22:16:59,582][52803] Sum rewards: 0.106, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.301', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.168', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.246', 'ARMOR': '1.283', 'weapon2': '1.636', 'DAMAGECOUNT': '1.956'} [2024-08-05 22:17:00,167][52662] DAMAGECOUNT value on done: 5658.0 [2024-08-05 22:17:00,167][52662] Sum rewards: 0.269, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'HITCOUNT': '0.370', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.110', 'weapon2': '1.400', 'weapon3': '1.632'} [2024-08-05 22:17:00,459][52658] DAMAGECOUNT value on done: 4657.0 [2024-08-05 22:17:00,460][52658] Sum rewards: 3.568, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.774', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.180', 'HITCOUNT': '0.400', 'ARMOR': '0.478', 'WEAPON3': '0.650', 'weapon2': '1.112', 'DAMAGECOUNT': '1.224', 'weapon3': '1.388', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:00,543][52659] DAMAGECOUNT value on done: 5326.0 [2024-08-05 22:17:00,544][52659] Sum rewards: 3.982, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon4': '0.060', 'AMMO3': '0.090', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'HEALTH': '0.218', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.837', 'weapon2': '1.420', 'DAMAGECOUNT': '1.782', 'weapon3': '1.912', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:00,757][52664] DAMAGECOUNT value on done: 5646.0 [2024-08-05 22:17:00,758][52664] Sum rewards: 2.768, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.049', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.258', 'HITCOUNT': '0.270', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'DAMAGECOUNT': '0.783', 'weapon2': '1.106', 'weapon3': '1.706', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:01,351][52794] DAMAGECOUNT value on done: 6352.0 [2024-08-05 22:17:01,351][52794] Sum rewards: 5.883, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.149', 'weapon4': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '0.950', 'ARMOR': '1.470', 'weapon2': '1.536', 'weapon3': '2.046', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:01,402][52649] DAMAGECOUNT value on done: 4626.0 [2024-08-05 22:17:01,403][52649] Sum rewards: 3.131, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.128', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'weapon4': '0.136', 'ARMOR': '0.490', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon3': '1.504', 'weapon2': '1.768', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:02,316][52667] DAMAGECOUNT value on done: 6105.0 [2024-08-05 22:17:02,320][52667] Sum rewards: 8.777, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.936', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.106', 'ARMOR': '0.517', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.204', 'weapon3': '1.768', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:02,585][52650] Updated weights for policy 0, policy_version 6461 (0.0023) [2024-08-05 22:17:02,691][52671] DAMAGECOUNT value on done: 4922.0 [2024-08-05 22:17:02,691][52671] Sum rewards: 6.480, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'weapon5': '0.056', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.376', 'ARMOR': '0.484', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.206', 'weapon3': '1.448', 'DAMAGECOUNT': '1.971', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:02,729][52662] DAMAGECOUNT value on done: 5539.0 [2024-08-05 22:17:02,732][52662] Sum rewards: 2.283, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.130', 'HITCOUNT': '0.420', 'ARMOR': '0.469', 'WEAPON3': '0.850', 'weapon2': '1.340', 'weapon3': '1.580', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:02,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 52928512. Throughput: 0: 4219.3. Samples: 13232160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:17:02,794][52567] Avg episode reward: [(0, '4.301')] [2024-08-05 22:17:02,809][52614] Saving new best policy, reward=4.301! [2024-08-05 22:17:02,922][52803] DAMAGECOUNT value on done: 6025.0 [2024-08-05 22:17:02,923][52803] Sum rewards: 5.198, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.034', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.492', 'HITCOUNT': '0.770', 'WEAPON3': '0.950', 'weapon2': '1.570', 'weapon3': '1.902', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '6.500'} [2024-08-05 22:17:03,441][52659] DAMAGECOUNT value on done: 5675.0 [2024-08-05 22:17:03,442][52659] Sum rewards: 7.629, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.474', 'AMMO2': '0.018', 'ARMOR': '0.048', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.382', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.250', 'weapon3': '1.976', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:03,468][52664] DAMAGECOUNT value on done: 5409.0 [2024-08-05 22:17:03,468][52664] Sum rewards: 1.524, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.566', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.320', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'ARMOR': '0.878', 'weapon3': '1.218', 'DAMAGECOUNT': '1.395', 'weapon2': '1.796', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:03,782][52658] DAMAGECOUNT value on done: 4452.0 [2024-08-05 22:17:03,782][52658] Sum rewards: 6.798, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.008', 'AMMO4': '0.039', 'HEALTH': '0.066', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.180', 'WEAPON3': '0.400', 'ARMOR': '0.460', 'HITCOUNT': '0.530', 'weapon2': '1.430', 'weapon3': '1.528', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:04,176][52794] DAMAGECOUNT value on done: 5902.0 [2024-08-05 22:17:04,176][52794] Sum rewards: 7.586, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.160', 'ARMOR': '0.515', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.632', 'weapon3': '1.872', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:04,537][52811] DAMAGECOUNT value on done: 5569.0 [2024-08-05 22:17:04,537][52811] Sum rewards: 3.308, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'ARMOR': '0.076', 'AMMO3': '0.093', 'HEALTH': '0.120', 'weapon4': '0.210', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '1.346', 'weapon3': '1.440', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:04,782][52649] DAMAGECOUNT value on done: 6170.0 [2024-08-05 22:17:04,784][52649] Sum rewards: 2.491, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.688', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.306', 'ARMOR': '0.503', 'HITCOUNT': '0.590', 'WEAPON3': '0.950', 'weapon2': '0.952', 'DAMAGECOUNT': '2.019', 'weapon3': '2.036', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:05,203][52667] DAMAGECOUNT value on done: 5110.0 [2024-08-05 22:17:05,203][52667] Sum rewards: 4.411, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.185', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.032', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.472', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.298', 'weapon3': '1.708', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:05,493][52662] DAMAGECOUNT value on done: 4956.0 [2024-08-05 22:17:05,494][52662] Sum rewards: 11.066, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.281', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.071', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'HITCOUNT': '0.510', 'weapon2': '0.884', 'weapon3': '0.914', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '10.000'} [2024-08-05 22:17:05,570][52671] DAMAGECOUNT value on done: 6172.0 [2024-08-05 22:17:05,570][52671] Sum rewards: 6.986, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.010', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.103', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'ARMOR': '0.824', 'weapon2': '1.376', 'weapon3': '1.614', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:06,231][52803] DAMAGECOUNT value on done: 5421.0 [2024-08-05 22:17:06,231][52803] Sum rewards: 5.977, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.350', 'weapon4': '0.374', 'HITCOUNT': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.306', 'ARMOR': '1.430', 'weapon3': '2.008', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:06,267][52658] DAMAGECOUNT value on done: 5287.0 [2024-08-05 22:17:06,270][52658] Sum rewards: 9.404, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.386', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.070', 'weapon4': '0.168', 'WEAPON4': '0.300', 'ARMOR': '0.549', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.444', 'weapon3': '1.642', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:06,428][52659] DAMAGECOUNT value on done: 4590.0 [2024-08-05 22:17:06,428][52659] Sum rewards: 3.286, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.310', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.204', 'weapon5': '0.358', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'ARMOR': '0.838', 'weapon3': '1.462', 'weapon2': '1.492', 'DAMAGECOUNT': '1.620', 'FRAGCOUNT': '2.500'} [2024-08-05 22:17:06,846][52664] DAMAGECOUNT value on done: 4715.0 [2024-08-05 22:17:06,847][52664] Sum rewards: 2.065, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.256', 'AMMO2': '0.017', 'ARMOR': '0.056', 'AMMO4': '0.085', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.216', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.230', 'weapon2': '1.266', 'weapon3': '1.454', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:06,898][52794] DAMAGECOUNT value on done: 6795.0 [2024-08-05 22:17:06,899][52794] Sum rewards: 2.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.714', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.029', 'AMMO3': '0.120', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.114', 'DAMAGECOUNT': '1.692', 'weapon3': '1.744', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:07,397][52649] DAMAGECOUNT value on done: 4553.0 [2024-08-05 22:17:07,471][52650] Updated weights for policy 0, policy_version 6471 (0.0014) [2024-08-05 22:17:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 53010432. Throughput: 0: 4210.9. Samples: 13256940. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:17:07,794][52567] Avg episode reward: [(0, '4.398')] [2024-08-05 22:17:07,797][52614] Saving new best policy, reward=4.398! [2024-08-05 22:17:08,015][52811] DAMAGECOUNT value on done: 5269.0 [2024-08-05 22:17:08,018][52811] Sum rewards: 5.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon4': '0.322', 'ARMOR': '0.824', 'HITCOUNT': '1.140', 'weapon2': '1.164', 'WEAPON3': '1.200', 'weapon3': '2.320', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '9.000'} [2024-08-05 22:17:08,266][52662] DAMAGECOUNT value on done: 6079.0 [2024-08-05 22:17:08,266][52662] Sum rewards: 4.478, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.237', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.170', 'ARMOR': '0.400', 'weapon4': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '0.946', 'weapon3': '1.378', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:08,448][52667] DAMAGECOUNT value on done: 5571.0 [2024-08-05 22:17:08,452][52667] Sum rewards: 3.376, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.598', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.032', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.222', 'HITCOUNT': '0.420', 'ARMOR': '0.505', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.518', 'weapon3': '1.522', 'weapon2': '1.542', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:08,486][52671] DAMAGECOUNT value on done: 4057.0 [2024-08-05 22:17:08,487][52671] Sum rewards: 2.812, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON1': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.126', 'AMMO4': '0.129', 'ARMOR': '0.498', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon3': '1.414', 'weapon2': '1.436', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:09,326][52659] DAMAGECOUNT value on done: 4495.0 [2024-08-05 22:17:09,327][52659] Sum rewards: 3.008, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.520', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.139', 'ARMOR': '0.455', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.514', 'DAMAGECOUNT': '1.902', 'weapon3': '2.108', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:09,449][52794] DAMAGECOUNT value on done: 5703.0 [2024-08-05 22:17:09,450][52794] Sum rewards: 1.328, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.844', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'weapon4': '0.056', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.158', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'ARMOR': '0.464', 'WEAPON3': '0.750', 'DAMAGECOUNT': '0.975', 'weapon3': '1.548', 'weapon2': '1.640', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:09,650][52803] DAMAGECOUNT value on done: 5656.0 [2024-08-05 22:17:09,651][52803] Sum rewards: 3.647, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.462', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.088', 'weapon4': '0.196', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.462', 'WEAPON3': '0.600', 'weapon2': '1.362', 'DAMAGECOUNT': '1.458', 'weapon3': '1.538', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:09,764][52658] DAMAGECOUNT value on done: 5914.0 [2024-08-05 22:17:09,765][52658] Sum rewards: 3.137, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.398', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.087', 'WEAPON4': '0.250', 'HITCOUNT': '0.390', 'ARMOR': '0.495', 'weapon4': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.328', 'DAMAGECOUNT': '1.407', 'weapon2': '1.410', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:10,218][52664] DAMAGECOUNT value on done: 4963.0 [2024-08-05 22:17:10,218][52664] Sum rewards: 4.766, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.858', 'AMMO2': '0.007', 'weapon4': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.438', 'weapon3': '1.972', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:10,471][52662] DAMAGECOUNT value on done: 6331.0 [2024-08-05 22:17:10,471][52662] Sum rewards: -2.257, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.162', 'AMMO2': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.330', 'WEAPON3': '0.900', 'ARMOR': '0.969', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.050', 'weapon2': '1.468', 'weapon3': '1.690'} [2024-08-05 22:17:10,849][52649] DAMAGECOUNT value on done: 5118.0 [2024-08-05 22:17:10,850][52649] Sum rewards: 8.011, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.232', 'HEALTH': '0.265', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.484', 'weapon3': '1.684', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:11,343][52671] DAMAGECOUNT value on done: 5915.0 [2024-08-05 22:17:11,343][52671] Sum rewards: 4.558, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.427', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'ARMOR': '0.104', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.486', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.326', 'weapon3': '1.794', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:11,376][52811] DAMAGECOUNT value on done: 4941.0 [2024-08-05 22:17:11,378][52811] Sum rewards: 0.940, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.156', 'HITCOUNT': '0.330', 'WEAPON3': '0.850', 'ARMOR': '0.898', 'DAMAGECOUNT': '1.050', 'weapon2': '1.404', 'FRAGCOUNT': '2.000', 'weapon3': '2.026'} [2024-08-05 22:17:11,712][52794] DAMAGECOUNT value on done: 6498.0 [2024-08-05 22:17:11,714][52794] Sum rewards: 6.420, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.060', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.136', 'weapon4': '0.242', 'HEALTH': '0.276', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.224', 'weapon3': '1.900', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:12,368][52659] DAMAGECOUNT value on done: 5539.0 [2024-08-05 22:17:12,370][52659] Sum rewards: 8.624, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'ARMOR': '0.912', 'weapon3': '1.574', 'weapon2': '2.022', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '8.000'} [2024-08-05 22:17:12,567][52650] Updated weights for policy 0, policy_version 6481 (0.0026) [2024-08-05 22:17:12,687][52664] DAMAGECOUNT value on done: 4131.0 [2024-08-05 22:17:12,691][52664] Sum rewards: 2.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.464', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.107', 'weapon4': '0.162', 'HITCOUNT': '0.400', 'ARMOR': '0.461', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.272', 'weapon2': '1.780', 'weapon3': '1.894', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:12,794][52567] Fps is (10 sec: 16383.5, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 53092352. Throughput: 0: 4206.2. Samples: 13282100. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:17:12,795][52567] Avg episode reward: [(0, '4.328')] [2024-08-05 22:17:12,908][52658] DAMAGECOUNT value on done: 5773.0 [2024-08-05 22:17:12,909][52658] Sum rewards: 1.549, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.535', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.062', 'weapon5': '0.062', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'ARMOR': '0.918', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.200', 'weapon3': '1.278', 'weapon2': '1.654'} [2024-08-05 22:17:13,020][52803] DAMAGECOUNT value on done: 6063.0 [2024-08-05 22:17:13,022][52803] Sum rewards: 7.508, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon7': '0.048', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.216', 'ARMOR': '0.489', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.520', 'weapon3': '1.888', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:13,104][52662] DAMAGECOUNT value on done: 5514.0 [2024-08-05 22:17:13,105][52662] Sum rewards: 6.039, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.320', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.052', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.250', 'HITCOUNT': '0.320', 'ARMOR': '0.484', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.119', 'weapon3': '1.630', 'weapon2': '1.768', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:13,801][52649] DAMAGECOUNT value on done: 5121.0 [2024-08-05 22:17:13,802][52649] Sum rewards: 5.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.630', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.089', 'AMMO3': '0.090', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.286', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'ARMOR': '0.868', 'DAMAGECOUNT': '1.335', 'weapon3': '1.460', 'weapon2': '1.498', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:14,427][52794] DAMAGECOUNT value on done: 6681.0 [2024-08-05 22:17:14,427][52794] Sum rewards: 4.219, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.036', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.143', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.492', 'weapon3': '1.964', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:14,702][52811] DAMAGECOUNT value on done: 5123.0 [2024-08-05 22:17:14,704][52811] Sum rewards: 2.932, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.436', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.064', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.222', 'ARMOR': '0.445', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon3': '1.290', 'DAMAGECOUNT': '1.446', 'weapon2': '1.656', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:15,001][52671] DAMAGECOUNT value on done: 5394.0 [2024-08-05 22:17:15,003][52671] Sum rewards: 0.537, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.478', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.016', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.544', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '2.000', 'weapon3': '2.018'} [2024-08-05 22:17:15,349][52668] DAMAGECOUNT value on done: 5384.0 [2024-08-05 22:17:15,349][52668] Sum rewards: 8.624, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.318', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.056', 'weapon4': '0.056', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.696', 'weapon3': '1.942', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '8.000'} [2024-08-05 22:17:15,473][52664] DAMAGECOUNT value on done: 4151.0 [2024-08-05 22:17:15,674][52662] DAMAGECOUNT value on done: 6692.0 [2024-08-05 22:17:15,674][52662] Sum rewards: 6.640, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.210', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.099', 'weapon4': '0.226', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'ARMOR': '1.358', 'weapon3': '1.518', 'weapon2': '1.608', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:15,823][52659] DAMAGECOUNT value on done: 4342.0 [2024-08-05 22:17:15,824][52659] Sum rewards: 3.743, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.746', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.098', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'ARMOR': '0.499', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.640', 'weapon2': '1.660', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:16,000][52795] DAMAGECOUNT value on done: 4266.0 [2024-08-05 22:17:16,001][52795] Sum rewards: 2.106, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.492', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.034', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.124', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon2': '1.162', 'weapon3': '1.478', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:16,413][52658] DAMAGECOUNT value on done: 5365.0 [2024-08-05 22:17:16,414][52658] Sum rewards: 5.762, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.928', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.204', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'ARMOR': '0.844', 'weapon2': '1.318', 'weapon3': '1.886', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:16,454][52803] DAMAGECOUNT value on done: 4902.0 [2024-08-05 22:17:16,457][52803] Sum rewards: 4.184, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.302', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.080', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.142', 'HITCOUNT': '0.250', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.747', 'weapon2': '1.188', 'weapon3': '1.270', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:16,629][52649] DAMAGECOUNT value on done: 4151.0 [2024-08-05 22:17:16,630][52649] Sum rewards: 5.148, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.602', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon4': '0.310', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.935', 'weapon3': '1.368', 'DAMAGECOUNT': '1.428', 'weapon2': '1.828', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:17,019][52650] Updated weights for policy 0, policy_version 6491 (0.0014) [2024-08-05 22:17:17,216][52794] DAMAGECOUNT value on done: 6549.0 [2024-08-05 22:17:17,216][52794] Sum rewards: 7.197, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'HEALTH': '0.066', 'AMMO4': '0.075', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.368', 'WEAPON3': '0.450', 'ARMOR': '0.472', 'HITCOUNT': '0.530', 'weapon2': '1.442', 'DAMAGECOUNT': '1.857', 'weapon3': '1.932', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:17,560][52671] DAMAGECOUNT value on done: 5662.0 [2024-08-05 22:17:17,561][52671] Sum rewards: 9.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.026', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO3': '0.099', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'ARMOR': '0.906', 'weapon2': '1.660', 'weapon3': '1.894', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '9.000'} [2024-08-05 22:17:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 53174272. Throughput: 0: 4208.7. Samples: 13294560. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:17:17,794][52567] Avg episode reward: [(0, '4.339')] [2024-08-05 22:17:17,925][52811] DAMAGECOUNT value on done: 5712.0 [2024-08-05 22:17:17,926][52811] Sum rewards: 10.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.588', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.116', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'ARMOR': '1.250', 'weapon2': '1.742', 'weapon3': '1.774', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '10.000'} [2024-08-05 22:17:18,465][52662] DAMAGECOUNT value on done: 5226.0 [2024-08-05 22:17:18,465][52662] Sum rewards: 3.057, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.326', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon5': '0.274', 'HITCOUNT': '0.710', 'ARMOR': '0.982', 'WEAPON3': '1.100', 'weapon2': '1.528', 'weapon3': '1.866', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:18,490][52659] DAMAGECOUNT value on done: 5417.0 [2024-08-05 22:17:18,491][52659] Sum rewards: 0.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.418', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'weapon4': '0.486', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'DAMAGECOUNT': '0.936', 'weapon2': '1.030', 'weapon3': '1.632', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:18,736][52664] DAMAGECOUNT value on done: 5590.0 [2024-08-05 22:17:18,737][52664] Sum rewards: 0.747, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.848', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'ARMOR': '0.450', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.296', 'weapon3': '1.610', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:18,745][52668] DAMAGECOUNT value on done: 5553.0 [2024-08-05 22:17:18,745][52668] Sum rewards: 6.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO2': '0.026', 'AMMO3': '0.120', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'ARMOR': '0.448', 'weapon4': '0.546', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon2': '0.942', 'weapon3': '1.756', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:19,260][52795] DAMAGECOUNT value on done: 5334.0 [2024-08-05 22:17:19,261][52795] Sum rewards: 5.825, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.597', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'ARMOR': '1.220', 'weapon2': '1.332', 'weapon3': '2.456', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:19,403][52649] DAMAGECOUNT value on done: 5524.0 [2024-08-05 22:17:19,404][52649] Sum rewards: 5.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.873', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.144', 'HITCOUNT': '0.830', 'WEAPON3': '0.900', 'weapon2': '1.350', 'weapon3': '1.494', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:19,434][52658] DAMAGECOUNT value on done: 4977.0 [2024-08-05 22:17:19,434][52658] Sum rewards: -0.496, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.802', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.129', 'HITCOUNT': '0.440', 'WEAPON3': '0.800', 'ARMOR': '1.299', 'DAMAGECOUNT': '1.377', 'weapon3': '1.594', 'weapon2': '1.654', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:19,769][52803] DAMAGECOUNT value on done: 5953.0 [2024-08-05 22:17:19,769][52803] Sum rewards: 10.877, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.356', 'weapon3': '2.024', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '10.000'} [2024-08-05 22:17:20,068][52794] DAMAGECOUNT value on done: 6079.0 [2024-08-05 22:17:20,068][52794] Sum rewards: 1.641, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.518', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon4': '0.210', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'ARMOR': '0.942', 'weapon2': '1.396', 'DAMAGECOUNT': '1.629', 'weapon3': '1.954', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:20,749][52671] DAMAGECOUNT value on done: 6661.0 [2024-08-05 22:17:20,749][52671] Sum rewards: 5.834, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.822', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'ARMOR': '0.870', 'weapon2': '1.158', 'weapon3': '1.840', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:21,122][52662] DAMAGECOUNT value on done: 6178.0 [2024-08-05 22:17:21,123][52662] Sum rewards: 3.636, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.091', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'WEAPON1': '0.020', 'weapon7': '0.056', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.443', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.444', 'DAMAGECOUNT': '1.764', 'weapon3': '2.054', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:21,258][52811] DAMAGECOUNT value on done: 5037.0 [2024-08-05 22:17:21,258][52811] Sum rewards: 5.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.040', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.145', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'ARMOR': '0.872', 'weapon2': '1.450', 'DAMAGECOUNT': '2.202', 'weapon3': '2.258', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:21,446][52660] DAMAGECOUNT value on done: 5305.0 [2024-08-05 22:17:21,448][52660] Sum rewards: 3.127, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.888', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.044', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.192', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.584', 'DAMAGECOUNT': '1.836', 'weapon3': '1.910', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:21,555][52659] DAMAGECOUNT value on done: 5936.0 [2024-08-05 22:17:21,556][52659] Sum rewards: 8.263, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.906', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'ARMOR': '0.933', 'weapon2': '1.628', 'weapon3': '2.096', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '9.000'} [2024-08-05 22:17:21,968][52668] DAMAGECOUNT value on done: 4610.0 [2024-08-05 22:17:21,968][52668] Sum rewards: -3.299, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.416', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'HITCOUNT': '0.490', 'FRAGCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.324', 'ARMOR': '1.386', 'DAMAGECOUNT': '1.482', 'weapon3': '2.250'} [2024-08-05 22:17:22,031][52664] DAMAGECOUNT value on done: 4562.0 [2024-08-05 22:17:22,032][52664] Sum rewards: -1.622, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.674', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.107', 'HITCOUNT': '0.420', 'ARMOR': '0.480', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.128', 'weapon2': '1.290', 'weapon3': '1.614'} [2024-08-05 22:17:22,111][52658] DAMAGECOUNT value on done: 4895.0 [2024-08-05 22:17:22,112][52658] Sum rewards: 5.372, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.192', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon7': '0.056', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.290', 'ARMOR': '0.447', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.350', 'weapon3': '1.502', 'weapon2': '1.558', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:22,186][52650] Updated weights for policy 0, policy_version 6501 (0.0037) [2024-08-05 22:17:22,475][52795] DAMAGECOUNT value on done: 4803.0 [2024-08-05 22:17:22,476][52795] Sum rewards: 1.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.298', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon4': '0.182', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'ARMOR': '0.934', 'weapon2': '1.168', 'DAMAGECOUNT': '1.737', 'weapon3': '2.118', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:22,558][52794] DAMAGECOUNT value on done: 6101.0 [2024-08-05 22:17:22,558][52794] Sum rewards: 5.894, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.098', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.147', 'HITCOUNT': '0.710', 'WEAPON3': '1.000', 'ARMOR': '1.292', 'weapon3': '1.724', 'weapon2': '1.746', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:22,686][52649] DAMAGECOUNT value on done: 5134.0 [2024-08-05 22:17:22,687][52649] Sum rewards: -1.783, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.346', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.162', 'HITCOUNT': '0.470', 'WEAPON3': '0.950', 'weapon2': '1.240', 'ARMOR': '1.300', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '2.000', 'weapon3': '2.458'} [2024-08-05 22:17:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 53264384. Throughput: 0: 4209.5. Samples: 13319960. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:17:22,795][52567] Avg episode reward: [(0, '4.196')] [2024-08-05 22:17:23,080][52803] DAMAGECOUNT value on done: 5382.0 [2024-08-05 22:17:23,080][52803] Sum rewards: 3.500, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.013', 'ARMOR': '0.030', 'AMMO4': '0.065', 'AMMO3': '0.069', 'HEALTH': '0.184', 'HITCOUNT': '0.210', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.795', 'weapon3': '1.116', 'weapon2': '1.368', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:23,456][52671] DAMAGECOUNT value on done: 6132.0 [2024-08-05 22:17:23,459][52671] Sum rewards: 5.028, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.643', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.010', 'weapon5': '0.014', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'HITCOUNT': '0.680', 'ARMOR': '0.912', 'WEAPON3': '0.950', 'weapon2': '1.576', 'DAMAGECOUNT': '2.199', 'weapon3': '2.204', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:23,672][52662] DAMAGECOUNT value on done: 5930.0 [2024-08-05 22:17:23,673][52662] Sum rewards: 10.943, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.735', 'AMMO2': '0.025', 'AMMO3': '0.094', 'AMMO4': '0.122', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'ARMOR': '1.317', 'weapon3': '1.662', 'weapon2': '1.852', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'} [2024-08-05 22:17:24,489][52811] DAMAGECOUNT value on done: 5853.0 [2024-08-05 22:17:24,492][52811] Sum rewards: 5.164, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.335', 'AMMO2': '0.009', 'AMMO4': '0.047', 'ARMOR': '0.056', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.830', 'WEAPON3': '0.950', 'weapon2': '1.254', 'weapon3': '2.336', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:24,530][52659] DAMAGECOUNT value on done: 5677.0 [2024-08-05 22:17:24,532][52659] Sum rewards: 3.787, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.278', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'ARMOR': '0.444', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.298', 'weapon3': '1.548', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:24,762][52660] DAMAGECOUNT value on done: 6891.0 [2024-08-05 22:17:24,762][52660] Sum rewards: 3.970, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.968', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'HITCOUNT': '0.610', 'ARMOR': '0.913', 'WEAPON3': '1.000', 'weapon2': '1.324', 'DAMAGECOUNT': '2.232', 'weapon3': '2.240', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:24,837][52664] DAMAGECOUNT value on done: 5013.0 [2024-08-05 22:17:24,837][52664] Sum rewards: 6.623, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.010', 'ARMOR': '0.028', 'AMMO3': '0.070', 'HEALTH': '0.106', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '1.272', 'weapon3': '1.672', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:25,362][52658] DAMAGECOUNT value on done: 5521.0 [2024-08-05 22:17:25,366][52658] Sum rewards: 11.458, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.426', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'ARMOR': '0.907', 'weapon3': '1.528', 'weapon2': '1.830', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '8.000'} [2024-08-05 22:17:25,395][52668] DAMAGECOUNT value on done: 4848.0 [2024-08-05 22:17:25,404][52668] Sum rewards: 4.567, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.083', 'weapon5': '0.146', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.832', 'weapon3': '1.316', 'DAMAGECOUNT': '1.692', 'weapon2': '1.768', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:25,538][52649] DAMAGECOUNT value on done: 5623.0 [2024-08-05 22:17:25,547][52649] Sum rewards: 5.378, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.122', 'ARMOR': '0.470', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon3': '1.218', 'weapon2': '1.566', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:25,768][52795] DAMAGECOUNT value on done: 6386.0 [2024-08-05 22:17:25,770][52795] Sum rewards: 7.904, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.286', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon3': '1.620', 'weapon2': '1.708', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:26,306][52803] DAMAGECOUNT value on done: 4768.0 [2024-08-05 22:17:26,308][52803] Sum rewards: 6.702, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.361', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'weapon4': '0.222', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'ARMOR': '0.893', 'weapon2': '1.374', 'weapon3': '1.504', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:26,404][52662] DAMAGECOUNT value on done: 5835.0 [2024-08-05 22:17:26,406][52662] Sum rewards: 2.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'AMMO3': '0.160', 'HITCOUNT': '0.620', 'WEAPON3': '1.100', 'ARMOR': '1.295', 'weapon2': '1.392', 'DAMAGECOUNT': '2.145', 'weapon3': '2.212', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:26,535][52671] DAMAGECOUNT value on done: 4644.0 [2024-08-05 22:17:26,536][52671] Sum rewards: 5.404, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.378', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.200', 'ARMOR': '0.512', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.304', 'DAMAGECOUNT': '1.902', 'weapon3': '2.206', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:27,303][52650] Updated weights for policy 0, policy_version 6511 (0.0015) [2024-08-05 22:17:27,672][52659] DAMAGECOUNT value on done: 5450.0 [2024-08-05 22:17:27,675][52659] Sum rewards: 3.176, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.022', 'weapon4': '0.058', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'ARMOR': '0.916', 'weapon2': '1.350', 'weapon3': '2.144', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:27,709][52811] DAMAGECOUNT value on done: 3589.0 [2024-08-05 22:17:27,710][52811] Sum rewards: 8.702, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.108', 'HEALTH': '0.309', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'ARMOR': '0.937', 'weapon2': '1.544', 'weapon3': '1.872', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:27,749][52664] DAMAGECOUNT value on done: 4994.0 [2024-08-05 22:17:27,750][52664] Sum rewards: 6.079, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.024', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'weapon5': '0.118', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.456', 'weapon3': '1.998', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16793.5, 300 sec: 16828.3). Total num frames: 53346304. Throughput: 0: 4204.4. Samples: 13344950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:17:27,795][52567] Avg episode reward: [(0, '4.415')] [2024-08-05 22:17:27,798][52614] Saving new best policy, reward=4.415! [2024-08-05 22:17:28,016][52660] DAMAGECOUNT value on done: 4933.0 [2024-08-05 22:17:28,018][52660] Sum rewards: 9.171, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.415', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.017', 'weapon7': '0.056', 'AMMO4': '0.083', 'AMMO3': '0.084', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.484', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.672', 'weapon3': '1.852', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:28,763][52668] DAMAGECOUNT value on done: 5232.0 [2024-08-05 22:17:28,764][52668] Sum rewards: 4.004, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.658', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.222', 'ARMOR': '0.477', 'HITCOUNT': '0.660', 'WEAPON3': '0.900', 'weapon2': '1.270', 'weapon3': '1.862', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:29,059][52795] DAMAGECOUNT value on done: 5277.0 [2024-08-05 22:17:29,060][52795] Sum rewards: 2.286, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.440', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'weapon2': '1.216', 'DAMAGECOUNT': '1.395', 'weapon3': '1.530', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:29,704][52803] DAMAGECOUNT value on done: 4904.0 [2024-08-05 22:17:29,705][52803] Sum rewards: 5.857, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.610', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'weapon4': '0.108', 'WEAPON3': '0.450', 'ARMOR': '0.472', 'HITCOUNT': '0.540', 'weapon3': '0.856', 'weapon2': '1.200', 'DAMAGECOUNT': '1.500', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:29,940][52671] DAMAGECOUNT value on done: 5665.0 [2024-08-05 22:17:29,943][52671] Sum rewards: 6.985, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.746', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.380', 'WEAPON3': '0.500', 'ARMOR': '0.550', 'weapon3': '1.244', 'DAMAGECOUNT': '1.353', 'weapon2': '1.766', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:30,855][52660] DAMAGECOUNT value on done: 4597.0 [2024-08-05 22:17:30,856][52660] Sum rewards: -1.473, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon5': '0.036', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.240', 'ARMOR': '0.499', 'DAMAGECOUNT': '0.915', 'WEAPON3': '1.050', 'weapon2': '1.590', 'weapon3': '1.938', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:30,920][52811] DAMAGECOUNT value on done: 3941.0 [2024-08-05 22:17:30,920][52811] Sum rewards: 1.105, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.298', 'AMMO2': '0.025', 'ARMOR': '0.048', 'AMMO3': '0.094', 'AMMO4': '0.123', 'weapon4': '0.156', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.755', 'weapon2': '1.774', 'weapon3': '1.818'} [2024-08-05 22:17:31,002][52659] DAMAGECOUNT value on done: 5477.0 [2024-08-05 22:17:31,002][52659] Sum rewards: 7.964, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.021', 'weapon4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'weapon2': '1.384', 'weapon3': '1.404', 'DAMAGECOUNT': '2.046', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:31,187][52664] DAMAGECOUNT value on done: 4832.0 [2024-08-05 22:17:31,187][52664] Sum rewards: 3.586, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.276', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.158', 'AMMO3': '0.168', 'ARMOR': '0.440', 'HITCOUNT': '0.640', 'weapon2': '0.832', 'WEAPON3': '1.000', 'weapon3': '2.420', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:31,549][52668] DAMAGECOUNT value on done: 5509.0 [2024-08-05 22:17:31,551][52668] Sum rewards: 3.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.230', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.950', 'weapon3': '1.080', 'weapon2': '1.350', 'DAMAGECOUNT': '1.386', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:31,827][52650] Updated weights for policy 0, policy_version 6521 (0.0013) [2024-08-05 22:17:32,337][52795] DAMAGECOUNT value on done: 6128.0 [2024-08-05 22:17:32,337][52795] Sum rewards: 12.178, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.296', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO3': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'ARMOR': '1.337', 'weapon3': '1.620', 'weapon2': '1.750', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2024-08-05 22:17:32,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 53428224. Throughput: 0: 4204.6. Samples: 13357600. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:17:32,794][52567] Avg episode reward: [(0, '4.620')] [2024-08-05 22:17:32,795][52614] Saving new best policy, reward=4.620! [2024-08-05 22:17:32,932][52803] DAMAGECOUNT value on done: 4854.0 [2024-08-05 22:17:32,933][52803] Sum rewards: 6.171, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.171', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.119', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.544', 'weapon3': '1.972', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:33,140][52671] DAMAGECOUNT value on done: 4636.0 [2024-08-05 22:17:33,140][52671] Sum rewards: 3.642, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.126', 'WEAPON4': '0.200', 'ARMOR': '0.512', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'weapon2': '1.744', 'weapon3': '1.972', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:34,076][52664] DAMAGECOUNT value on done: 6033.0 [2024-08-05 22:17:34,076][52664] Sum rewards: 1.690, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.950', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.104', 'weapon4': '0.126', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon3': '1.370', 'DAMAGECOUNT': '1.386', 'weapon2': '1.500', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:34,234][52659] DAMAGECOUNT value on done: 6544.0 [2024-08-05 22:17:34,236][52659] Sum rewards: 4.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.062', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.270', 'ARMOR': '0.464', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon3': '1.648', 'weapon2': '1.748', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:34,265][52660] DAMAGECOUNT value on done: 4291.0 [2024-08-05 22:17:34,266][52660] Sum rewards: 8.284, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.302', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.414', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.520', 'weapon3': '1.180', 'weapon2': '1.346', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:34,482][52811] DAMAGECOUNT value on done: 5608.0 [2024-08-05 22:17:34,482][52811] Sum rewards: 3.365, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.972', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.308', 'ARMOR': '0.440', 'HITCOUNT': '0.560', 'WEAPON3': '1.150', 'weapon2': '1.172', 'weapon3': '1.938', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:35,100][52668] DAMAGECOUNT value on done: 6958.0 [2024-08-05 22:17:35,103][52668] Sum rewards: 3.211, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.024', 'weapon5': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.120', 'HITCOUNT': '0.190', 'weapon4': '0.208', 'WEAPON3': '0.350', 'HEALTH': '0.655', 'DAMAGECOUNT': '0.774', 'weapon2': '1.128', 'weapon3': '1.274', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:35,798][52795] DAMAGECOUNT value on done: 4775.0 [2024-08-05 22:17:35,799][52795] Sum rewards: 1.935, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.384', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.092', 'weapon4': '0.152', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.963', 'FRAGCOUNT': '1.000', 'weapon3': '1.028', 'weapon2': '1.214'} [2024-08-05 22:17:36,041][52671] DAMAGECOUNT value on done: 5045.0 [2024-08-05 22:17:36,043][52671] Sum rewards: 6.792, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.886', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.184', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.877', 'weapon3': '1.298', 'DAMAGECOUNT': '1.626', 'weapon2': '1.660', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:36,140][52803] DAMAGECOUNT value on done: 4636.0 [2024-08-05 22:17:36,142][52803] Sum rewards: 1.674, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.830', 'AMMO2': '0.018', 'AMMO4': '0.089', 'ARMOR': '0.107', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.036', 'DAMAGECOUNT': '1.545', 'weapon3': '1.660', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:36,900][52650] Updated weights for policy 0, policy_version 6531 (0.0016) [2024-08-05 22:17:36,919][52659] DAMAGECOUNT value on done: 5977.0 [2024-08-05 22:17:36,921][52659] Sum rewards: 4.705, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'weapon5': '0.066', 'AMMO4': '0.068', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'weapon3': '0.878', 'weapon2': '1.230', 'DAMAGECOUNT': '1.383', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:37,399][52660] DAMAGECOUNT value on done: 5954.0 [2024-08-05 22:17:37,400][52660] Sum rewards: 10.296, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon4': '0.180', 'weapon5': '0.244', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'HITCOUNT': '0.470', 'HEALTH': '0.818', 'weapon3': '1.176', 'weapon2': '1.448', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '8.000'} [2024-08-05 22:17:37,782][52811] DAMAGECOUNT value on done: 5544.0 [2024-08-05 22:17:37,784][52811] Sum rewards: 3.040, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon4': '0.230', 'ARMOR': '0.480', 'HITCOUNT': '0.680', 'WEAPON3': '0.900', 'weapon2': '1.142', 'weapon3': '2.156', 'DAMAGECOUNT': '2.193', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:37,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 53510144. Throughput: 0: 4189.6. Samples: 13382550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:17:37,794][52567] Avg episode reward: [(0, '4.527')] [2024-08-05 22:17:38,197][52668] DAMAGECOUNT value on done: 4772.0 [2024-08-05 22:17:38,198][52668] Sum rewards: 7.430, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.135', 'weapon4': '0.178', 'WEAPON3': '0.350', 'ARMOR': '0.440', 'HITCOUNT': '0.470', 'HEALTH': '0.760', 'DAMAGECOUNT': '1.380', 'weapon2': '1.542', 'weapon3': '1.764', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:38,774][52671] DAMAGECOUNT value on done: 6164.0 [2024-08-05 22:17:38,774][52671] Sum rewards: 1.757, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.512', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.023', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.290', 'weapon4': '0.372', 'ARMOR': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.184', 'DAMAGECOUNT': '1.215', 'weapon3': '1.568', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:39,063][52795] DAMAGECOUNT value on done: 5223.0 [2024-08-05 22:17:39,065][52795] Sum rewards: 4.915, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.084', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.006', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.120', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.200', 'DAMAGECOUNT': '1.533', 'weapon3': '1.794', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:39,399][52803] DAMAGECOUNT value on done: 5297.0 [2024-08-05 22:17:39,402][52803] Sum rewards: 3.899, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.979', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.356', 'ARMOR': '0.436', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.206', 'DAMAGECOUNT': '1.617', 'weapon3': '1.776', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:40,030][52660] DAMAGECOUNT value on done: 4947.0 [2024-08-05 22:17:40,030][52660] Sum rewards: -0.221, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.732', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.130', 'weapon4': '0.180', 'HITCOUNT': '0.390', 'WEAPON3': '0.800', 'weapon2': '1.096', 'DAMAGECOUNT': '1.299', 'weapon3': '1.698', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:40,059][52659] DAMAGECOUNT value on done: 5698.0 [2024-08-05 22:17:40,060][52659] Sum rewards: -0.520, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.810', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'WEAPON4': '0.050', 'AMMO3': '0.178', 'weapon4': '0.246', 'ARMOR': '0.496', 'HITCOUNT': '0.550', 'WEAPON3': '1.100', 'weapon3': '1.290', 'weapon2': '1.714', 'DAMAGECOUNT': '1.716', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:40,721][52668] DAMAGECOUNT value on done: 5631.0 [2024-08-05 22:17:40,722][52668] Sum rewards: 8.892, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.364', 'ARMOR': '0.548', 'WEAPON3': '0.600', 'HEALTH': '0.645', 'HITCOUNT': '0.800', 'weapon2': '0.948', 'weapon3': '1.816', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:41,144][52811] DAMAGECOUNT value on done: 5034.0 [2024-08-05 22:17:41,146][52811] Sum rewards: 3.345, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.188', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.071', 'WEAPON4': '0.200', 'weapon4': '0.276', 'HITCOUNT': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.669', 'weapon2': '0.954', 'DAMAGECOUNT': '1.140', 'weapon3': '1.522', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:41,673][52650] Updated weights for policy 0, policy_version 6541 (0.0046) [2024-08-05 22:17:42,144][52795] DAMAGECOUNT value on done: 5354.0 [2024-08-05 22:17:42,145][52795] Sum rewards: 2.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.178', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.131', 'weapon4': '0.190', 'WEAPON4': '0.200', 'HITCOUNT': '0.300', 'ARMOR': '0.492', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.236', 'weapon2': '1.474', 'weapon3': '2.034', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:42,290][52671] DAMAGECOUNT value on done: 4975.0 [2024-08-05 22:17:42,290][52671] Sum rewards: 0.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.566', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'ARMOR': '0.029', 'AMMO3': '0.147', 'HITCOUNT': '0.700', 'WEAPON3': '0.950', 'weapon2': '1.464', 'weapon3': '2.058', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 53600256. Throughput: 0: 4195.1. Samples: 13408110. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:17:42,794][52567] Avg episode reward: [(0, '4.436')] [2024-08-05 22:17:42,824][52803] DAMAGECOUNT value on done: 5556.0 [2024-08-05 22:17:42,824][52803] Sum rewards: 5.499, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.179', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'ARMOR': '0.436', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.206', 'DAMAGECOUNT': '1.680', 'weapon3': '1.704', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:43,404][52660] DAMAGECOUNT value on done: 5188.0 [2024-08-05 22:17:43,418][52660] Sum rewards: 11.619, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.232', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'ARMOR': '0.020', 'AMMO3': '0.149', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'weapon2': '1.216', 'weapon3': '2.650', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '12.000'} [2024-08-05 22:17:43,464][52659] DAMAGECOUNT value on done: 4419.0 [2024-08-05 22:17:43,466][52659] Sum rewards: 5.509, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.459', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.394', 'ARMOR': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.322', 'DAMAGECOUNT': '1.614', 'weapon3': '2.020', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:44,098][52668] DAMAGECOUNT value on done: 6444.0 [2024-08-05 22:17:44,098][52668] Sum rewards: 4.574, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.522', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.188', 'ARMOR': '0.440', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.292', 'weapon3': '1.622', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:44,411][52811] DAMAGECOUNT value on done: 5592.0 [2024-08-05 22:17:44,415][52811] Sum rewards: 4.038, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.154', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'HITCOUNT': '0.490', 'ARMOR': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.482', 'DAMAGECOUNT': '1.749', 'weapon3': '2.018', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:45,232][52795] DAMAGECOUNT value on done: 4868.0 [2024-08-05 22:17:45,232][52795] Sum rewards: 7.216, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO4': '0.106', 'AMMO3': '0.107', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'HEALTH': '0.848', 'weapon2': '1.498', 'weapon3': '1.670', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:45,548][52671] DAMAGECOUNT value on done: 5258.0 [2024-08-05 22:17:45,549][52671] Sum rewards: 0.864, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.304', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.040', 'AMMO3': '0.101', 'weapon4': '0.166', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'WEAPON3': '0.650', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.287', 'weapon3': '1.356', 'weapon2': '1.438'} [2024-08-05 22:17:46,180][52803] DAMAGECOUNT value on done: 4924.0 [2024-08-05 22:17:46,183][52803] Sum rewards: 1.807, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.010', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'HITCOUNT': '0.570', 'WEAPON3': '1.100', 'weapon2': '1.506', 'ARMOR': '1.718', 'DAMAGECOUNT': '1.719', 'weapon3': '2.076', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:46,714][52659] DAMAGECOUNT value on done: 5360.0 [2024-08-05 22:17:46,718][52650] Updated weights for policy 0, policy_version 6551 (0.0027) [2024-08-05 22:17:46,723][52660] DAMAGECOUNT value on done: 5450.0 [2024-08-05 22:17:46,717][52659] Sum rewards: 5.905, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.720', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.054', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'ARMOR': '0.468', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.558', 'weapon3': '1.816', 'DAMAGECOUNT': '2.181', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:46,726][52660] Sum rewards: 2.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.719', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.124', 'weapon4': '0.248', 'ARMOR': '0.483', 'HITCOUNT': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.214', 'DAMAGECOUNT': '1.662', 'weapon3': '1.808', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:47,267][52668] DAMAGECOUNT value on done: 4993.0 [2024-08-05 22:17:47,269][52668] Sum rewards: 10.115, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.525', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.853', 'weapon3': '1.568', 'weapon2': '1.764', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '9.000'} [2024-08-05 22:17:47,780][52811] DAMAGECOUNT value on done: 4364.0 [2024-08-05 22:17:47,782][52811] Sum rewards: 4.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.650', 'weapon4': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.112', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'HITCOUNT': '0.610', 'WEAPON3': '1.100', 'weapon2': '1.288', 'DAMAGECOUNT': '2.328', 'weapon3': '2.494', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16930.5, 300 sec: 16828.3). Total num frames: 53690368. Throughput: 0: 4188.4. Samples: 13420640. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 22:17:47,794][52567] Avg episode reward: [(0, '4.616')] [2024-08-05 22:17:48,506][52795] DAMAGECOUNT value on done: 4468.0 [2024-08-05 22:17:48,514][52795] Sum rewards: 1.564, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.016', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon4': '0.158', 'HITCOUNT': '0.460', 'ARMOR': '0.499', 'WEAPON3': '1.000', 'weapon2': '1.094', 'DAMAGECOUNT': '1.578', 'weapon3': '2.458', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:49,368][52803] DAMAGECOUNT value on done: 4359.0 [2024-08-05 22:17:49,370][52803] Sum rewards: 3.642, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.161', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'ARMOR': '0.839', 'weapon3': '1.364', 'DAMAGECOUNT': '1.380', 'weapon2': '1.610', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:49,710][52659] DAMAGECOUNT value on done: 4340.0 [2024-08-05 22:17:49,711][52659] Sum rewards: 2.922, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon5': '0.002', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'ARMOR': '1.376', 'weapon3': '1.590', 'DAMAGECOUNT': '1.668', 'weapon2': '1.900', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:50,171][52660] DAMAGECOUNT value on done: 4351.0 [2024-08-05 22:17:50,172][52660] Sum rewards: 3.902, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.551', 'AMMO2': '0.009', 'AMMO4': '0.044', 'ARMOR': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.330', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon3': '1.214', 'DAMAGECOUNT': '1.320', 'weapon2': '1.438', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:50,591][52668] DAMAGECOUNT value on done: 5386.0 [2024-08-05 22:17:50,592][52668] Sum rewards: 7.273, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.680', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'ARMOR': '0.468', 'weapon4': '0.488', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'weapon2': '1.100', 'weapon3': '1.686', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '8.000'} [2024-08-05 22:17:50,968][52650] Updated weights for policy 0, policy_version 6561 (0.0018) [2024-08-05 22:17:51,201][52811] DAMAGECOUNT value on done: 5362.0 [2024-08-05 22:17:51,203][52811] Sum rewards: 5.390, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.604', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'weapon4': '0.044', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'ARMOR': '1.353', 'weapon3': '1.528', 'weapon2': '2.000', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:51,701][52795] DAMAGECOUNT value on done: 4889.0 [2024-08-05 22:17:51,704][52795] Sum rewards: 6.652, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.577', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.096', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.704', 'weapon3': '1.728', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:52,490][52660] DAMAGECOUNT value on done: 5475.0 [2024-08-05 22:17:52,492][52660] Sum rewards: 2.561, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'HITCOUNT': '0.290', 'HEALTH': '0.308', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.918', 'weapon2': '1.220', 'weapon3': '1.334', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 16828.3). Total num frames: 53764096. Throughput: 0: 4206.7. Samples: 13446240. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:17:52,795][52567] Avg episode reward: [(0, '4.659')] [2024-08-05 22:17:52,841][52614] Saving new best policy, reward=4.659! [2024-08-05 22:17:52,864][52803] DAMAGECOUNT value on done: 4772.0 [2024-08-05 22:17:52,865][52803] Sum rewards: 7.236, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.440', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.050', 'AMMO3': '0.119', 'weapon4': '0.192', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'ARMOR': '1.463', 'weapon2': '1.516', 'weapon3': '1.916', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:52,924][52659] DAMAGECOUNT value on done: 5298.0 [2024-08-05 22:17:52,924][52659] Sum rewards: -0.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.024', 'AMMO3': '0.190', 'HITCOUNT': '0.620', 'WEAPON3': '1.200', 'weapon2': '1.506', 'DAMAGECOUNT': '2.055', 'weapon3': '2.310', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:53,096][52668] DAMAGECOUNT value on done: 4978.0 [2024-08-05 22:17:53,099][52668] Sum rewards: 2.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.390', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.091', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'DAMAGECOUNT': '1.260', 'weapon3': '1.636', 'weapon2': '1.818', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:54,490][52811] DAMAGECOUNT value on done: 4475.0 [2024-08-05 22:17:54,491][52811] Sum rewards: 3.465, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.458', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.054', 'ARMOR': '0.056', 'AMMO3': '0.094', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.358', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'weapon2': '1.174', 'DAMAGECOUNT': '1.413', 'weapon3': '1.546', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:55,147][52660] DAMAGECOUNT value on done: 5389.0 [2024-08-05 22:17:55,147][52660] Sum rewards: 4.084, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon5': '0.216', 'HITCOUNT': '0.610', 'WEAPON3': '0.950', 'ARMOR': '1.250', 'weapon2': '1.678', 'weapon3': '1.870', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:55,169][52795] DAMAGECOUNT value on done: 4695.0 [2024-08-05 22:17:55,169][52795] Sum rewards: 0.485, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.732', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'HITCOUNT': '0.460', 'ARMOR': '0.832', 'WEAPON3': '1.050', 'DAMAGECOUNT': '1.665', 'weapon2': '1.706', 'weapon3': '2.032', 'FRAGCOUNT': '4.000'} [2024-08-05 22:17:55,875][52668] DAMAGECOUNT value on done: 5912.0 [2024-08-05 22:17:55,877][52668] Sum rewards: 7.143, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO3': '0.101', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'weapon3': '1.358', 'weapon2': '1.688', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '6.000'} [2024-08-05 22:17:56,068][52803] DAMAGECOUNT value on done: 4592.0 [2024-08-05 22:17:56,071][52803] Sum rewards: 1.921, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.184', 'ARMOR': '0.471', 'HITCOUNT': '0.620', 'WEAPON3': '0.950', 'weapon2': '1.560', 'weapon3': '2.014', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:56,209][52650] Updated weights for policy 0, policy_version 6571 (0.0040) [2024-08-05 22:17:57,645][52811] DAMAGECOUNT value on done: 5162.0 [2024-08-05 22:17:57,645][52811] Sum rewards: 2.055, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.472', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'weapon4': '0.140', 'HITCOUNT': '0.440', 'ARMOR': '0.519', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.560', 'weapon3': '1.612', 'weapon2': '1.632', 'FRAGCOUNT': '5.000'} [2024-08-05 22:17:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 53854208. Throughput: 0: 4207.8. Samples: 13471450. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-05 22:17:57,794][52567] Avg episode reward: [(0, '4.398')] [2024-08-05 22:17:58,374][52660] DAMAGECOUNT value on done: 4930.0 [2024-08-05 22:17:58,378][52660] Sum rewards: -1.711, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.040', 'weapon5': '0.054', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.486', 'WEAPON3': '0.950', 'weapon2': '1.176', 'DAMAGECOUNT': '1.182', 'weapon3': '2.362', 'FRAGCOUNT': '3.000'} [2024-08-05 22:17:58,605][52795] DAMAGECOUNT value on done: 5538.0 [2024-08-05 22:17:58,606][52795] Sum rewards: -1.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.734', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.924', 'DAMAGECOUNT': '1.119', 'weapon3': '1.586', 'weapon2': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 22:17:58,988][52668] DAMAGECOUNT value on done: 5169.0 [2024-08-05 22:17:58,990][52668] Sum rewards: 7.403, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.380', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.332', 'ARMOR': '0.440', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.470', 'weapon3': '1.772', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '7.000'} [2024-08-05 22:17:59,237][52803] DAMAGECOUNT value on done: 5762.0 [2024-08-05 22:17:59,237][52803] Sum rewards: 4.282, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.244', 'HITCOUNT': '0.470', 'ARMOR': '0.524', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.350', 'weapon2': '1.362', 'weapon3': '1.616', 'FRAGCOUNT': '5.000'} [2024-08-05 22:18:00,349][52820] DAMAGECOUNT value on done: 4124.0 [2024-08-05 22:18:00,351][52820] Sum rewards: 2.601, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.991', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.218', 'HITCOUNT': '0.430', 'ARMOR': '0.488', 'WEAPON3': '0.750', 'weapon2': '1.308', 'DAMAGECOUNT': '1.596', 'weapon3': '1.606', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:00,818][52811] DAMAGECOUNT value on done: 4010.0 [2024-08-05 22:18:00,821][52811] Sum rewards: -0.440, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.137', 'weapon2': '1.404', 'FRAGCOUNT': '1.500', 'weapon3': '1.778'} [2024-08-05 22:18:00,930][52660] DAMAGECOUNT value on done: 5705.0 [2024-08-05 22:18:00,930][52660] Sum rewards: 10.553, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.921', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.101', 'ARMOR': '0.510', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon3': '1.588', 'weapon2': '1.590', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '10.000'} [2024-08-05 22:18:01,118][52650] Updated weights for policy 0, policy_version 6581 (0.0028) [2024-08-05 22:18:01,339][52668] DAMAGECOUNT value on done: 5316.0 [2024-08-05 22:18:01,341][52668] Sum rewards: 5.039, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.080', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.086', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon5': '0.380', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon3': '1.118', 'ARMOR': '1.324', 'DAMAGECOUNT': '1.425', 'weapon2': '1.920', 'FRAGCOUNT': '5.000'} [2024-08-05 22:18:01,832][52795] DAMAGECOUNT value on done: 4908.0 [2024-08-05 22:18:01,832][52795] Sum rewards: 3.917, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.058', 'AMMO2': '0.032', 'AMMO3': '0.051', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'HITCOUNT': '0.290', 'WEAPON3': '0.350', 'weapon4': '0.356', 'ARMOR': '0.471', 'DAMAGECOUNT': '0.918', 'weapon2': '0.974', 'weapon3': '1.172', 'FRAGCOUNT': '2.000'} [2024-08-05 22:18:02,329][52803] DAMAGECOUNT value on done: 5055.0 [2024-08-05 22:18:02,331][52803] Sum rewards: 6.987, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.016', 'HEALTH': '0.026', 'ARMOR': '0.045', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.129', 'weapon4': '0.214', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.076', 'weapon3': '2.372', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '7.000'} [2024-08-05 22:18:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 53944320. Throughput: 0: 4216.7. Samples: 13484310. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:18:02,794][52567] Avg episode reward: [(0, '4.380')] [2024-08-05 22:18:03,678][52660] DAMAGECOUNT value on done: 5649.0 [2024-08-05 22:18:03,680][52660] Sum rewards: 5.431, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.508', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.126', 'weapon4': '0.228', 'HITCOUNT': '0.780', 'ARMOR': '0.875', 'WEAPON3': '0.900', 'weapon2': '1.422', 'weapon3': '2.082', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '6.000'} [2024-08-05 22:18:03,803][52820] DAMAGECOUNT value on done: 5791.0 [2024-08-05 22:18:03,803][52820] Sum rewards: 6.993, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.085', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.029', 'weapon4': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'HITCOUNT': '0.580', 'WEAPON3': '0.750', 'weapon2': '1.740', 'weapon3': '1.786', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '7.000'} [2024-08-05 22:18:04,057][52668] DAMAGECOUNT value on done: 5431.0 [2024-08-05 22:18:04,058][52668] Sum rewards: 7.160, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.871', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.590', 'ARMOR': '0.897', 'WEAPON3': '0.900', 'weapon2': '1.484', 'DAMAGECOUNT': '1.956', 'weapon3': '2.042', 'FRAGCOUNT': '8.000'} [2024-08-05 22:18:04,258][52811] DAMAGECOUNT value on done: 5194.0 [2024-08-05 22:18:04,260][52811] Sum rewards: 3.863, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.582', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'weapon4': '0.130', 'AMMO4': '0.134', 'WEAPON4': '0.300', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'ARMOR': '1.456', 'weapon2': '1.472', 'weapon3': '2.100', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.000'} [2024-08-05 22:18:05,090][52795] DAMAGECOUNT value on done: 5092.0 [2024-08-05 22:18:05,090][52795] Sum rewards: 5.342, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.966', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'ARMOR': '0.431', 'HITCOUNT': '0.690', 'weapon2': '0.996', 'WEAPON3': '1.100', 'weapon3': '2.312', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '8.000'} [2024-08-05 22:18:05,884][52650] Updated weights for policy 0, policy_version 6591 (0.0014) [2024-08-05 22:18:06,784][52660] DAMAGECOUNT value on done: 5006.0 [2024-08-05 22:18:06,786][52660] Sum rewards: 9.965, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.946', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.228', 'WEAPON3': '0.600', 'HITCOUNT': '0.930', 'weapon3': '1.338', 'weapon2': '1.378', 'ARMOR': '1.396', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '8.000'} [2024-08-05 22:18:06,967][52820] DAMAGECOUNT value on done: 4946.0 [2024-08-05 22:18:06,967][52820] Sum rewards: 0.816, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.987', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'WEAPON1': '0.030', 'weapon5': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'weapon4': '0.204', 'HITCOUNT': '0.360', 'WEAPON3': '0.550', 'weapon2': '0.820', 'DAMAGECOUNT': '1.320', 'weapon3': '1.416', 'FRAGCOUNT': '2.000'} [2024-08-05 22:18:07,294][52668] DAMAGECOUNT value on done: 6316.0 [2024-08-05 22:18:07,295][52668] Sum rewards: 12.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO2': '0.003', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'ARMOR': '0.875', 'WEAPON3': '1.000', 'HITCOUNT': '1.040', 'weapon2': '1.374', 'weapon3': '2.028', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '14.000'} [2024-08-05 22:18:07,608][52811] DAMAGECOUNT value on done: 4672.0 [2024-08-05 22:18:07,608][52811] Sum rewards: 3.578, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.062', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.094', 'weapon4': '0.176', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '1.276', 'weapon3': '1.458', 'weapon2': '1.496', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 54026240. Throughput: 0: 4221.1. Samples: 13509910. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:18:07,794][52567] Avg episode reward: [(0, '4.647')] [2024-08-05 22:18:08,495][52795] DAMAGECOUNT value on done: 5447.0 [2024-08-05 22:18:08,497][52795] Sum rewards: 3.127, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.274', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.320', 'ARMOR': '0.463', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '1.310', 'weapon3': '1.952', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '5.000'} [2024-08-05 22:18:09,725][52660] DAMAGECOUNT value on done: 5624.0 [2024-08-05 22:18:09,725][52660] Sum rewards: 4.968, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.075', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO3': '0.116', 'HITCOUNT': '0.640', 'WEAPON3': '0.900', 'weapon2': '1.056', 'weapon3': '1.932', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '7.000'} [2024-08-05 22:18:10,282][52668] DAMAGECOUNT value on done: 4981.0 [2024-08-05 22:18:10,283][52668] Sum rewards: 9.006, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.892', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.012', 'weapon5': '0.036', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.142', 'WEAPON5': '0.150', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'ARMOR': '0.927', 'weapon3': '1.216', 'weapon2': '1.446', 'DAMAGECOUNT': '2.184', 'FRAGCOUNT': '7.000'} [2024-08-05 22:18:10,305][52820] DAMAGECOUNT value on done: 5923.0 [2024-08-05 22:18:10,306][52820] Sum rewards: 4.785, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.448', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'ARMOR': '0.572', 'weapon4': '0.578', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '0.886', 'weapon3': '1.976', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '5.000'} [2024-08-05 22:18:10,829][52650] Updated weights for policy 0, policy_version 6601 (0.0018) [2024-08-05 22:18:11,952][52795] DAMAGECOUNT value on done: 4871.0 [2024-08-05 22:18:11,952][52795] Sum rewards: 7.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.538', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.088', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'ARMOR': '0.436', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.418', 'DAMAGECOUNT': '1.533', 'weapon2': '1.792', 'FRAGCOUNT': '8.000'} [2024-08-05 22:18:12,360][52660] DAMAGECOUNT value on done: 5407.0 [2024-08-05 22:18:12,363][52660] Sum rewards: 2.496, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.104', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.078', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.440', 'HITCOUNT': '0.500', 'weapon5': '0.560', 'WEAPON3': '0.900', 'weapon2': '1.454', 'DAMAGECOUNT': '1.596', 'weapon3': '1.768', 'FRAGCOUNT': '4.000'} [2024-08-05 22:18:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 54108160. Throughput: 0: 4235.4. Samples: 13535540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:18:12,794][52567] Avg episode reward: [(0, '4.697')] [2024-08-05 22:18:12,795][52614] Saving new best policy, reward=4.697! [2024-08-05 22:18:13,020][52668] DAMAGECOUNT value on done: 4792.0 [2024-08-05 22:18:13,020][52668] Sum rewards: 1.328, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'HEALTH': '0.118', 'weapon4': '0.120', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.118', 'DAMAGECOUNT': '1.659', 'weapon3': '1.678', 'FRAGCOUNT': '2.000'} [2024-08-05 22:18:13,838][52820] DAMAGECOUNT value on done: 4836.0 [2024-08-05 22:18:13,838][52820] Sum rewards: 10.391, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.048', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.324', 'HITCOUNT': '0.750', 'weapon2': '0.786', 'WEAPON3': '0.800', 'weapon3': '2.544', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '10.000'} [2024-08-05 22:18:15,416][52795] DAMAGECOUNT value on done: 4773.0 [2024-08-05 22:18:15,418][52795] Sum rewards: -0.143, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.026', 'HITCOUNT': '0.060', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'DAMAGECOUNT': '0.225', 'WEAPON3': '0.400', 'weapon2': '0.750', 'FRAGCOUNT': '1.000', 'weapon3': '1.430'} [2024-08-05 22:18:15,639][52660] DAMAGECOUNT value on done: 4919.0 [2024-08-05 22:18:15,639][52660] Sum rewards: 8.227, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.589', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon5': '0.026', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.318', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'weapon2': '1.084', 'weapon3': '1.868', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '8.000'} [2024-08-05 22:18:15,810][52650] Updated weights for policy 0, policy_version 6611 (0.0024) [2024-08-05 22:18:16,563][52614] Signal inference workers to stop experience collection... (1250 times) [2024-08-05 22:18:16,573][52614] Signal inference workers to resume experience collection... (1250 times) [2024-08-05 22:18:16,646][52650] InferenceWorker_p0-w0: stopping experience collection (1250 times) [2024-08-05 22:18:16,647][52650] InferenceWorker_p0-w0: resuming experience collection (1250 times) [2024-08-05 22:18:17,102][52820] DAMAGECOUNT value on done: 6758.0 [2024-08-05 22:18:17,104][52820] Sum rewards: 6.953, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.674', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'ARMOR': '0.420', 'HITCOUNT': '0.560', 'WEAPON3': '0.850', 'weapon2': '1.734', 'DAMAGECOUNT': '1.902', 'weapon3': '2.104', 'FRAGCOUNT': '8.000'} [2024-08-05 22:18:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 54190080. Throughput: 0: 4234.6. Samples: 13548160. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:18:17,795][52567] Avg episode reward: [(0, '4.645')] [2024-08-05 22:18:18,239][52660] DAMAGECOUNT value on done: 6673.0 [2024-08-05 22:18:18,239][52660] Sum rewards: 5.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.246', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'ARMOR': '0.400', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon2': '1.514', 'weapon3': '1.826', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '5.000'} [2024-08-05 22:18:18,575][52795] DAMAGECOUNT value on done: 4708.0 [2024-08-05 22:18:18,575][52795] Sum rewards: 4.496, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.644', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.046', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.244', 'ARMOR': '0.412', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.462', 'weapon2': '1.518', 'DAMAGECOUNT': '1.578', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:20,265][52650] Updated weights for policy 0, policy_version 6621 (0.0032) [2024-08-05 22:18:20,565][52820] DAMAGECOUNT value on done: 4695.0 [2024-08-05 22:18:20,570][52820] Sum rewards: 1.361, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.996', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.136', 'AMMO3': '0.142', 'weapon4': '0.146', 'HITCOUNT': '0.420', 'WEAPON3': '0.900', 'ARMOR': '1.270', 'DAMAGECOUNT': '1.407', 'weapon2': '1.574', 'weapon3': '1.866', 'FRAGCOUNT': '4.000'} [2024-08-05 22:18:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 54280192. Throughput: 0: 4242.0. Samples: 13573440. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-05 22:18:22,794][52567] Avg episode reward: [(0, '4.588')] [2024-08-05 22:18:23,937][52820] DAMAGECOUNT value on done: 5536.0 [2024-08-05 22:18:23,938][52820] Sum rewards: 4.592, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.280', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon7': '0.048', 'AMMO4': '0.060', 'ARMOR': '0.067', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '1.134', 'weapon3': '1.460', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:24,852][52650] Updated weights for policy 0, policy_version 6631 (0.0026) [2024-08-05 22:18:27,415][52820] DAMAGECOUNT value on done: 5195.0 [2024-08-05 22:18:27,417][52820] Sum rewards: 3.342, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.484', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.296', 'ARMOR': '0.523', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon3': '1.394', 'weapon2': '1.584', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:27,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 54370304. Throughput: 0: 4243.8. Samples: 13599080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:18:27,794][52567] Avg episode reward: [(0, '4.582')] [2024-08-05 22:18:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006637_54370304.pth... [2024-08-05 22:18:27,937][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006144_50331648.pth [2024-08-05 22:18:30,260][52650] Updated weights for policy 0, policy_version 6641 (0.0012) [2024-08-05 22:18:31,055][52820] DAMAGECOUNT value on done: 6361.0 [2024-08-05 22:18:31,058][52820] Sum rewards: 9.974, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.607', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO3': '0.074', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.244', 'WEAPON3': '0.550', 'ARMOR': '0.569', 'HITCOUNT': '0.620', 'weapon2': '1.464', 'weapon3': '1.506', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '8.000'} [2024-08-05 22:18:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 54444032. Throughput: 0: 4234.0. Samples: 13611170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:18:32,794][52567] Avg episode reward: [(0, '4.595')] [2024-08-05 22:18:34,509][52820] DAMAGECOUNT value on done: 5458.0 [2024-08-05 22:18:34,509][52820] Sum rewards: 8.024, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon4': '0.104', 'AMMO3': '0.107', 'HEALTH': '0.222', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.516', 'weapon3': '1.744', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.000'} [2024-08-05 22:18:34,775][52650] Updated weights for policy 0, policy_version 6651 (0.0012) [2024-08-05 22:18:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 54534144. Throughput: 0: 4225.3. Samples: 13636380. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:18:37,794][52567] Avg episode reward: [(0, '4.614')] [2024-08-05 22:18:37,808][52820] DAMAGECOUNT value on done: 5070.0 [2024-08-05 22:18:37,808][52820] Sum rewards: 6.625, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.316', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.060', 'AMMO4': '0.091', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.330', 'WEAPON3': '0.400', 'weapon4': '0.580', 'HITCOUNT': '0.650', 'weapon2': '1.230', 'weapon3': '1.290', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '5.000'} [2024-08-05 22:18:40,034][52650] Updated weights for policy 0, policy_version 6661 (0.0044) [2024-08-05 22:18:41,184][52820] DAMAGECOUNT value on done: 5712.0 [2024-08-05 22:18:41,187][52820] Sum rewards: 9.391, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.115', 'HEALTH': '0.273', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.688', 'weapon3': '2.080', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '7.000'} [2024-08-05 22:18:41,606][52669] DAMAGECOUNT value on done: 5026.0 [2024-08-05 22:18:41,607][52669] Sum rewards: 9.759, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.270', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.208', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'ARMOR': '0.972', 'weapon2': '0.990', 'weapon3': '1.318', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '7.000'} [2024-08-05 22:18:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 54616064. Throughput: 0: 4224.9. Samples: 13661570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:18:42,794][52567] Avg episode reward: [(0, '4.717')] [2024-08-05 22:18:42,795][52614] Saving new best policy, reward=4.717! [2024-08-05 22:18:44,538][52820] DAMAGECOUNT value on done: 4434.0 [2024-08-05 22:18:44,540][52820] Sum rewards: 8.437, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.665', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'ARMOR': '0.451', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.238', 'DAMAGECOUNT': '2.466', 'weapon3': '2.556', 'FRAGCOUNT': '9.000'} [2024-08-05 22:18:44,626][52650] Updated weights for policy 0, policy_version 6671 (0.0023) [2024-08-05 22:18:44,674][52669] DAMAGECOUNT value on done: 5674.0 [2024-08-05 22:18:44,675][52669] Sum rewards: 3.258, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'AMMO3': '0.100', 'WEAPON4': '0.250', 'ARMOR': '0.540', 'weapon4': '0.560', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '0.704', 'weapon3': '1.910', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:47,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 54697984. Throughput: 0: 4214.7. Samples: 13673970. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:18:47,794][52567] Avg episode reward: [(0, '4.706')] [2024-08-05 22:18:47,842][52669] DAMAGECOUNT value on done: 6040.0 [2024-08-05 22:18:47,846][52669] Sum rewards: 11.519, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.048', 'ARMOR': '0.064', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.278', 'WEAPON3': '0.500', 'HEALTH': '0.766', 'HITCOUNT': '0.800', 'weapon2': '0.940', 'weapon3': '1.920', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '9.000'} [2024-08-05 22:18:47,890][52820] DAMAGECOUNT value on done: 5513.0 [2024-08-05 22:18:47,893][52820] Sum rewards: 12.680, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HEALTH': '0.115', 'weapon4': '0.290', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '1.384', 'weapon3': '1.986', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '10.000'} [2024-08-05 22:18:49,615][52650] Updated weights for policy 0, policy_version 6681 (0.0012) [2024-08-05 22:18:50,973][52669] DAMAGECOUNT value on done: 7290.0 [2024-08-05 22:18:50,976][52669] Sum rewards: 4.023, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.744', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.058', 'weapon4': '0.114', 'AMMO3': '0.148', 'ARMOR': '0.469', 'HITCOUNT': '0.630', 'WEAPON3': '1.000', 'weapon2': '1.272', 'weapon3': '2.070', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '6.000'} [2024-08-05 22:18:50,980][52820] DAMAGECOUNT value on done: 5414.0 [2024-08-05 22:18:50,983][52820] Sum rewards: 4.653, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.064', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.010', 'weapon4': '0.032', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.113', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'ARMOR': '1.735', 'weapon2': '1.776', 'weapon3': '2.038', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '4.000'} [2024-08-05 22:18:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16800.6). Total num frames: 54779904. Throughput: 0: 4202.2. Samples: 13699010. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:18:52,794][52567] Avg episode reward: [(0, '4.923')] [2024-08-05 22:18:52,802][52614] Saving new best policy, reward=4.923! [2024-08-05 22:18:54,260][52820] DAMAGECOUNT value on done: 4542.0 [2024-08-05 22:18:54,261][52820] Sum rewards: -0.322, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.149', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'ARMOR': '0.436', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'weapon2': '1.536', 'DAMAGECOUNT': '1.602', 'weapon3': '1.800', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:54,589][52650] Updated weights for policy 0, policy_version 6691 (0.0021) [2024-08-05 22:18:54,652][52669] DAMAGECOUNT value on done: 5723.0 [2024-08-05 22:18:54,654][52669] Sum rewards: 9.419, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.866', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.040', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon2': '1.164', 'weapon3': '2.174', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '9.000'} [2024-08-05 22:18:57,539][52669] DAMAGECOUNT value on done: 5975.0 [2024-08-05 22:18:57,540][52669] Sum rewards: 5.826, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.128', 'weapon4': '0.286', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.432', 'HEALTH': '0.717', 'DAMAGECOUNT': '1.113', 'weapon3': '1.416', 'weapon2': '1.438', 'FRAGCOUNT': '3.000'} [2024-08-05 22:18:57,616][52820] DAMAGECOUNT value on done: 4855.0 [2024-08-05 22:18:57,618][52820] Sum rewards: 2.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.940', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO3': '0.112', 'HITCOUNT': '0.460', 'WEAPON3': '0.800', 'ARMOR': '0.936', 'weapon3': '1.482', 'DAMAGECOUNT': '1.524', 'weapon2': '1.568', 'FRAGCOUNT': '4.000'} [2024-08-05 22:18:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 54861824. Throughput: 0: 4190.0. Samples: 13724090. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:18:57,794][52567] Avg episode reward: [(0, '4.840')] [2024-08-05 22:18:59,380][52650] Updated weights for policy 0, policy_version 6701 (0.0045) [2024-08-05 22:19:00,337][52669] DAMAGECOUNT value on done: 7238.0 [2024-08-05 22:19:00,339][52669] Sum rewards: 5.898, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.900', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon4': '0.124', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'ARMOR': '0.491', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.316', 'weapon3': '1.958', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:00,940][52820] DAMAGECOUNT value on done: 5813.0 [2024-08-05 22:19:00,944][52820] Sum rewards: 8.617, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.333', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.266', 'WEAPON3': '0.400', 'HITCOUNT': '0.730', 'weapon3': '1.194', 'weapon2': '1.208', 'ARMOR': '1.340', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 54951936. Throughput: 0: 4183.1. Samples: 13736400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:19:02,794][52567] Avg episode reward: [(0, '4.922')] [2024-08-05 22:19:03,380][52669] DAMAGECOUNT value on done: 5676.0 [2024-08-05 22:19:03,381][52669] Sum rewards: 4.275, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.001', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.032', 'AMMO3': '0.055', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.800', 'weapon3': '1.038', 'weapon2': '1.224', 'DAMAGECOUNT': '1.380', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:03,995][52663] DAMAGECOUNT value on done: 6271.0 [2024-08-05 22:19:03,995][52663] Sum rewards: 3.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.284', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon5': '0.178', 'WEAPON5': '0.200', 'HITCOUNT': '0.600', 'ARMOR': '0.861', 'WEAPON3': '1.000', 'weapon2': '1.518', 'weapon3': '2.002', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:04,130][52820] DAMAGECOUNT value on done: 5689.0 [2024-08-05 22:19:04,131][52820] Sum rewards: 11.124, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.075', 'HEALTH': '0.098', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'HITCOUNT': '0.810', 'weapon3': '1.404', 'weapon2': '2.008', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:04,631][52650] Updated weights for policy 0, policy_version 6711 (0.0014) [2024-08-05 22:19:06,461][52669] DAMAGECOUNT value on done: 5538.0 [2024-08-05 22:19:06,462][52669] Sum rewards: 7.101, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.566', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'AMMO4': '0.125', 'weapon4': '0.180', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'ARMOR': '0.812', 'weapon2': '1.474', 'weapon3': '1.886', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:07,158][52663] DAMAGECOUNT value on done: 5615.0 [2024-08-05 22:19:07,158][52663] Sum rewards: 4.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.448', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.112', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon3': '1.580', 'weapon2': '1.800', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 16800.6). Total num frames: 55025664. Throughput: 0: 4185.1. Samples: 13761770. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:19:07,795][52567] Avg episode reward: [(0, '4.994')] [2024-08-05 22:19:07,866][52614] Saving new best policy, reward=4.994! [2024-08-05 22:19:09,088][52650] Updated weights for policy 0, policy_version 6721 (0.0015) [2024-08-05 22:19:09,433][52669] DAMAGECOUNT value on done: 5264.0 [2024-08-05 22:19:09,434][52669] Sum rewards: 6.754, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.679', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon4': '0.208', 'ARMOR': '0.473', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.422', 'weapon3': '1.578', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:09,698][52647] DAMAGECOUNT value on done: 5710.0 [2024-08-05 22:19:09,699][52647] Sum rewards: 3.371, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.590', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.107', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.024', 'weapon3': '2.252', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:10,169][52663] DAMAGECOUNT value on done: 4684.0 [2024-08-05 22:19:10,171][52663] Sum rewards: 8.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.270', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.084', 'AMMO3': '0.103', 'weapon4': '0.194', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '0.867', 'weapon2': '1.276', 'weapon3': '1.576', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:12,431][52669] DAMAGECOUNT value on done: 6165.0 [2024-08-05 22:19:12,431][52669] Sum rewards: -1.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.378', 'HITCOUNT': '0.840', 'WEAPON3': '1.000', 'ARMOR': '1.335', 'weapon2': '1.498', 'weapon3': '1.826', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.658'} [2024-08-05 22:19:12,453][52647] DAMAGECOUNT value on done: 6042.0 [2024-08-05 22:19:12,457][52647] Sum rewards: 2.330, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.940', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.143', 'weapon4': '0.144', 'WEAPON4': '0.200', 'HITCOUNT': '0.640', 'ARMOR': '0.881', 'WEAPON3': '0.950', 'weapon2': '1.444', 'weapon3': '1.498', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:12,489][52665] DAMAGECOUNT value on done: 6043.0 [2024-08-05 22:19:12,489][52665] Sum rewards: 3.624, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.039', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'ARMOR': '0.076', 'AMMO4': '0.083', 'WEAPON4': '0.200', 'HITCOUNT': '0.380', 'WEAPON3': '0.400', 'weapon4': '0.444', 'weapon2': '1.086', 'DAMAGECOUNT': '1.116', 'weapon3': '1.248', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:12,794][52567] Fps is (10 sec: 16383.4, 60 sec: 16793.5, 300 sec: 16800.5). Total num frames: 55115776. Throughput: 0: 4177.5. Samples: 13787070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:19:12,795][52567] Avg episode reward: [(0, '4.936')] [2024-08-05 22:19:13,292][52663] DAMAGECOUNT value on done: 6726.0 [2024-08-05 22:19:13,292][52663] Sum rewards: 8.880, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.040', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon4': '0.224', 'HITCOUNT': '0.610', 'WEAPON3': '0.950', 'ARMOR': '0.959', 'weapon2': '1.516', 'weapon3': '1.522', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '10.000'} [2024-08-05 22:19:14,005][52650] Updated weights for policy 0, policy_version 6731 (0.0024) [2024-08-05 22:19:15,125][52666] DAMAGECOUNT value on done: 4947.0 [2024-08-05 22:19:15,126][52666] Sum rewards: 7.492, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.148', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'ARMOR': '0.415', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.480', 'weapon2': '1.586', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:15,283][52669] DAMAGECOUNT value on done: 6101.0 [2024-08-05 22:19:15,287][52669] Sum rewards: 4.287, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.081', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon4': '0.596', 'ARMOR': '1.019', 'weapon2': '1.168', 'weapon3': '1.314', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:15,682][52647] DAMAGECOUNT value on done: 6980.0 [2024-08-05 22:19:15,683][52647] Sum rewards: 5.383, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.772', 'AMMO2': '0.006', 'weapon4': '0.008', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.128', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'ARMOR': '0.858', 'weapon2': '1.698', 'weapon3': '2.004', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:15,793][52665] DAMAGECOUNT value on done: 5815.0 [2024-08-05 22:19:15,793][52665] Sum rewards: 4.174, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.468', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.036', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon2': '0.194', 'weapon4': '0.218', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.398', 'weapon3': '1.400', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:15,893][52663] DAMAGECOUNT value on done: 5913.0 [2024-08-05 22:19:15,895][52663] Sum rewards: 5.297, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.344', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon7': '0.056', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.380', 'weapon4': '0.410', 'WEAPON3': '0.600', 'weapon2': '0.864', 'ARMOR': '0.890', 'DAMAGECOUNT': '1.416', 'weapon3': '1.564', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:17,742][52670] DAMAGECOUNT value on done: 6553.0 [2024-08-05 22:19:17,742][52670] Sum rewards: 5.861, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.221', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'ARMOR': '0.997', 'weapon2': '1.304', 'weapon3': '2.294', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 55205888. Throughput: 0: 4192.2. Samples: 13799820. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:19:17,795][52567] Avg episode reward: [(0, '5.124')] [2024-08-05 22:19:17,797][52614] Saving new best policy, reward=5.124! [2024-08-05 22:19:17,845][52669] DAMAGECOUNT value on done: 5164.0 [2024-08-05 22:19:17,845][52669] Sum rewards: 0.970, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.171', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.068', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.200', 'weapon4': '0.248', 'ARMOR': '0.496', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.579', 'weapon2': '1.018', 'weapon3': '1.166', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:18,345][52663] DAMAGECOUNT value on done: 6290.0 [2024-08-05 22:19:18,345][52663] Sum rewards: 5.292, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.550', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'ARMOR': '0.064', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon4': '0.378', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.294', 'weapon3': '1.430', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:18,739][52666] DAMAGECOUNT value on done: 5521.0 [2024-08-05 22:19:18,741][52666] Sum rewards: 4.358, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.005', 'AMMO4': '0.025', 'HEALTH': '0.026', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON3': '0.350', 'HITCOUNT': '0.480', 'ARMOR': '0.873', 'weapon3': '1.158', 'DAMAGECOUNT': '1.374', 'weapon2': '1.428', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:18,758][52647] DAMAGECOUNT value on done: 4905.0 [2024-08-05 22:19:18,760][52647] Sum rewards: 6.579, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.878', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'ARMOR': '0.846', 'weapon2': '1.090', 'weapon3': '1.576', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:18,786][52665] DAMAGECOUNT value on done: 6399.0 [2024-08-05 22:19:18,787][52665] Sum rewards: 8.751, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.018', 'ARMOR': '0.064', 'AMMO4': '0.078', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.396', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon2': '1.320', 'weapon3': '1.848', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:18,965][52650] Updated weights for policy 0, policy_version 6741 (0.0011) [2024-08-05 22:19:20,756][52669] DAMAGECOUNT value on done: 6436.0 [2024-08-05 22:19:20,757][52669] Sum rewards: 6.563, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.428', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.212', 'ARMOR': '0.457', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon3': '1.480', 'weapon2': '1.570', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:21,087][52670] DAMAGECOUNT value on done: 5689.0 [2024-08-05 22:19:21,088][52670] Sum rewards: 5.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.518', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.066', 'AMMO3': '0.188', 'ARMOR': '0.497', 'HITCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.252', 'weapon3': '2.384', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:21,789][52665] DAMAGECOUNT value on done: 4565.0 [2024-08-05 22:19:21,793][52663] DAMAGECOUNT value on done: 7010.0 [2024-08-05 22:19:21,791][52665] Sum rewards: 7.835, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.122', 'weapon4': '0.244', 'ARMOR': '0.468', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'HEALTH': '0.540', 'weapon2': '1.052', 'weapon3': '1.568', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:21,795][52663] Sum rewards: 2.173, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.244', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'ARMOR': '0.876', 'weapon2': '1.130', 'DAMAGECOUNT': '1.248', 'weapon3': '1.662', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:21,819][52647] DAMAGECOUNT value on done: 4827.0 [2024-08-05 22:19:21,820][52647] Sum rewards: 0.571, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.308', 'HITCOUNT': '0.390', 'ARMOR': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.100', 'DAMAGECOUNT': '1.134', 'weapon3': '1.696', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:22,166][52666] DAMAGECOUNT value on done: 5468.0 [2024-08-05 22:19:22,167][52666] Sum rewards: 6.475, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.144', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.860', 'weapon2': '1.424', 'weapon3': '1.642', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:22,794][52567] Fps is (10 sec: 16384.5, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 55279616. Throughput: 0: 4194.7. Samples: 13825140. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:19:22,794][52567] Avg episode reward: [(0, '5.178')] [2024-08-05 22:19:22,795][52614] Saving new best policy, reward=5.178! [2024-08-05 22:19:22,966][52794] DAMAGECOUNT value on done: 6047.0 [2024-08-05 22:19:22,966][52794] Sum rewards: 5.976, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.646', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.128', 'weapon4': '0.202', 'WEAPON4': '0.250', 'ARMOR': '0.540', 'HITCOUNT': '0.540', 'WEAPON3': '0.900', 'weapon2': '1.434', 'DAMAGECOUNT': '1.797', 'weapon3': '1.900', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:23,565][52650] Updated weights for policy 0, policy_version 6751 (0.0012) [2024-08-05 22:19:23,649][52669] DAMAGECOUNT value on done: 5690.0 [2024-08-05 22:19:23,650][52669] Sum rewards: 7.696, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.098', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.078', 'weapon4': '0.198', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'ARMOR': '0.859', 'weapon3': '1.348', 'weapon2': '1.524', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:24,530][52665] DAMAGECOUNT value on done: 5368.0 [2024-08-05 22:19:24,531][52665] Sum rewards: 7.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'weapon4': '0.490', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.028', 'DAMAGECOUNT': '1.740', 'weapon3': '1.782', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:24,614][52663] DAMAGECOUNT value on done: 5401.0 [2024-08-05 22:19:24,614][52663] Sum rewards: 3.349, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.370', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'ARMOR': '1.363', 'weapon3': '1.578', 'weapon2': '1.776', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:24,664][52670] DAMAGECOUNT value on done: 4906.0 [2024-08-05 22:19:24,666][52670] Sum rewards: 4.266, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.429', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.106', 'WEAPON4': '0.250', 'weapon4': '0.474', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'ARMOR': '0.948', 'weapon2': '1.240', 'weapon3': '1.678', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:25,015][52647] DAMAGECOUNT value on done: 6043.0 [2024-08-05 22:19:25,015][52647] Sum rewards: 7.263, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.088', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.132', 'weapon4': '0.140', 'WEAPON4': '0.200', 'ARMOR': '0.434', 'HITCOUNT': '0.630', 'WEAPON3': '0.850', 'weapon2': '1.120', 'weapon3': '1.742', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:25,259][52794] DAMAGECOUNT value on done: 6521.0 [2024-08-05 22:19:25,259][52794] Sum rewards: 12.399, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.020', 'weapon5': '0.028', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.212', 'WEAPON3': '0.300', 'HITCOUNT': '0.470', 'HEALTH': '0.491', 'weapon2': '1.062', 'weapon3': '1.212', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:25,647][52666] DAMAGECOUNT value on done: 5990.0 [2024-08-05 22:19:25,648][52666] Sum rewards: 7.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'ARMOR': '1.271', 'weapon2': '1.508', 'weapon3': '1.550', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:27,139][52669] DAMAGECOUNT value on done: 6242.0 [2024-08-05 22:19:27,139][52669] Sum rewards: 5.744, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.404', 'AMMO2': '0.011', 'AMMO4': '0.055', 'ARMOR': '0.084', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon2': '1.236', 'weapon3': '1.962', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:27,155][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:19:27,166][52662] DAMAGECOUNT value on done: 6227.0 [2024-08-05 22:19:27,167][52662] Sum rewards: 7.020, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.070', 'AMMO2': '0.017', 'AMMO3': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.326', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'ARMOR': '0.511', 'weapon3': '1.182', 'weapon2': '1.396', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:27,338][52665] DAMAGECOUNT value on done: 5302.0 [2024-08-05 22:19:27,338][52665] Sum rewards: -1.300, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.428', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.180', 'weapon4': '0.190', 'DAMAGECOUNT': '0.516', 'WEAPON3': '0.700', 'ARMOR': '0.923', 'FRAGCOUNT': '1.000', 'weapon2': '1.126', 'weapon3': '1.718'} [2024-08-05 22:19:27,704][52647] DAMAGECOUNT value on done: 4540.0 [2024-08-05 22:19:27,704][52647] Sum rewards: 2.259, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.028', 'AMMO3': '0.105', 'weapon4': '0.138', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'HEALTH': '0.252', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.893', 'weapon2': '1.312', 'DAMAGECOUNT': '1.680', 'weapon3': '1.700', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.0, 300 sec: 16828.3). Total num frames: 55369728. Throughput: 0: 4192.0. Samples: 13850210. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:19:27,795][52567] Avg episode reward: [(0, '5.317')] [2024-08-05 22:19:27,798][52614] Saving new best policy, reward=5.317! [2024-08-05 22:19:27,836][52794] DAMAGECOUNT value on done: 6757.0 [2024-08-05 22:19:27,836][52794] Sum rewards: 4.264, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.896', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.370', 'weapon4': '0.430', 'weapon2': '0.858', 'ARMOR': '0.940', 'weapon3': '1.052', 'DAMAGECOUNT': '1.152', 'weapon5': '1.196', 'FRAGCOUNT': '1.500'} [2024-08-05 22:19:27,898][52670] DAMAGECOUNT value on done: 4809.0 [2024-08-05 22:19:27,902][52670] Sum rewards: 1.046, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.915', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.400', 'ARMOR': '0.886', 'WEAPON3': '0.900', 'weapon2': '1.084', 'DAMAGECOUNT': '1.353', 'weapon3': '2.270', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:27,986][52663] DAMAGECOUNT value on done: 4837.0 [2024-08-05 22:19:27,987][52663] Sum rewards: -0.964, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'HITCOUNT': '0.270', 'weapon2': '0.888', 'ARMOR': '0.915', 'DAMAGECOUNT': '0.960', 'WEAPON3': '1.100', 'weapon3': '2.550', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:28,062][52667] DAMAGECOUNT value on done: 6820.0 [2024-08-05 22:19:28,064][52667] Sum rewards: 7.297, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.608', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'ARMOR': '1.366', 'weapon2': '1.652', 'weapon3': '1.936', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:28,835][52650] Updated weights for policy 0, policy_version 6761 (0.0045) [2024-08-05 22:19:28,908][52666] DAMAGECOUNT value on done: 5362.0 [2024-08-05 22:19:28,911][52666] Sum rewards: 9.626, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.747', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.040', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'ARMOR': '1.355', 'weapon2': '1.738', 'weapon3': '1.944', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:29,495][52662] DAMAGECOUNT value on done: 6264.0 [2024-08-05 22:19:29,496][52662] Sum rewards: 8.446, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.276', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'WEAPON3': '0.300', 'weapon5': '0.314', 'HITCOUNT': '0.490', 'weapon3': '0.946', 'ARMOR': '1.251', 'weapon2': '1.620', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:29,817][52669] DAMAGECOUNT value on done: 5135.0 [2024-08-05 22:19:29,817][52669] Sum rewards: 0.613, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.858', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.063', 'HITCOUNT': '0.170', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.644', 'DAMAGECOUNT': '0.693', 'weapon2': '0.762', 'weapon3': '0.874', 'FRAGCOUNT': '1.000', 'ARMOR': '1.031'} [2024-08-05 22:19:30,335][52665] DAMAGECOUNT value on done: 6020.0 [2024-08-05 22:19:30,336][52665] Sum rewards: 8.860, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.095', 'weapon5': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.903', 'weapon2': '1.324', 'weapon3': '1.590', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:30,506][52794] DAMAGECOUNT value on done: 6206.0 [2024-08-05 22:19:30,506][52794] Sum rewards: 0.031, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.174', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'HITCOUNT': '0.440', 'ARMOR': '0.907', 'WEAPON3': '1.000', 'weapon2': '1.374', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '2.000', 'weapon3': '2.248'} [2024-08-05 22:19:30,773][52663] DAMAGECOUNT value on done: 6108.0 [2024-08-05 22:19:30,775][52663] Sum rewards: 0.904, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.272', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.190', 'HITCOUNT': '0.440', 'ARMOR': '0.452', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon3': '1.050', 'weapon2': '1.064', 'DAMAGECOUNT': '1.533'} [2024-08-05 22:19:31,084][52667] DAMAGECOUNT value on done: 5494.0 [2024-08-05 22:19:31,085][52667] Sum rewards: 3.326, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.023', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'weapon4': '0.352', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'ARMOR': '0.471', 'HEALTH': '0.564', 'FRAGCOUNT': '1.000', 'weapon3': '1.292', 'DAMAGECOUNT': '1.347', 'weapon2': '1.584'} [2024-08-05 22:19:31,232][52670] DAMAGECOUNT value on done: 4514.0 [2024-08-05 22:19:31,235][52670] Sum rewards: 6.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.736', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO4': '0.054', 'weapon4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'ARMOR': '1.377', 'weapon2': '1.648', 'weapon3': '1.986', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:31,343][52647] DAMAGECOUNT value on done: 6029.0 [2024-08-05 22:19:31,343][52647] Sum rewards: 11.879, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.595', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.026', 'weapon4': '0.030', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.883', 'HITCOUNT': '1.070', 'weapon2': '1.364', 'weapon3': '1.822', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:32,013][52662] DAMAGECOUNT value on done: 6384.0 [2024-08-05 22:19:32,013][52662] Sum rewards: 1.751, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.625', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon4': '0.024', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'ARMOR': '0.448', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.230', 'weapon3': '1.840', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:32,299][52666] DAMAGECOUNT value on done: 5841.0 [2024-08-05 22:19:32,300][52666] Sum rewards: 3.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.052', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon4': '0.392', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.116', 'weapon3': '1.814', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:32,778][52794] DAMAGECOUNT value on done: 6453.0 [2024-08-05 22:19:32,778][52794] Sum rewards: 11.255, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.728', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.090', 'WEAPON4': '0.250', 'weapon4': '0.408', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'ARMOR': '0.990', 'weapon2': '1.554', 'weapon3': '1.560', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16856.1). Total num frames: 55451648. Throughput: 0: 4192.2. Samples: 13862620. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:19:32,794][52567] Avg episode reward: [(0, '5.508')] [2024-08-05 22:19:32,795][52614] Saving new best policy, reward=5.508! [2024-08-05 22:19:33,003][52665] DAMAGECOUNT value on done: 4738.0 [2024-08-05 22:19:33,003][52665] Sum rewards: 5.803, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO2': '0.024', 'AMMO3': '0.114', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'HITCOUNT': '0.590', 'weapon4': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'weapon2': '0.938', 'weapon3': '1.764', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:33,076][52669] DAMAGECOUNT value on done: 5946.0 [2024-08-05 22:19:33,076][52669] Sum rewards: 3.798, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.545', 'AMMO2': '0.019', 'AMMO3': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.350', 'HITCOUNT': '0.360', 'WEAPON3': '0.500', 'ARMOR': '0.599', 'weapon4': '0.668', 'DAMAGECOUNT': '0.942', 'weapon2': '1.062', 'weapon3': '1.416', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:33,445][52650] Updated weights for policy 0, policy_version 6771 (0.0012) [2024-08-05 22:19:33,912][52663] DAMAGECOUNT value on done: 5783.0 [2024-08-05 22:19:33,985][52649] Large shaping reward 3.486 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.435, 145.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:19:34,674][52647] DAMAGECOUNT value on done: 5696.0 [2024-08-05 22:19:34,674][52647] Sum rewards: 8.206, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.120', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.060', 'WEAPON3': '0.400', 'HITCOUNT': '0.560', 'weapon3': '0.936', 'weapon2': '1.124', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:34,907][52662] DAMAGECOUNT value on done: 5086.0 [2024-08-05 22:19:34,907][52662] Sum rewards: 1.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon4': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.910', 'DAMAGECOUNT': '1.323', 'weapon3': '1.720', 'weapon2': '1.924', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:34,956][52667] DAMAGECOUNT value on done: 6309.0 [2024-08-05 22:19:34,957][52667] Sum rewards: 2.366, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.027', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.024', 'AMMO4': '0.101', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'weapon4': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.552', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.540', 'weapon3': '1.880', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:35,216][52670] DAMAGECOUNT value on done: 5530.0 [2024-08-05 22:19:35,217][52670] Sum rewards: 9.049, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.600', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.040', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.348', 'ARMOR': '0.504', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon3': '1.456', 'weapon2': '1.794', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:36,006][52794] DAMAGECOUNT value on done: 7055.0 [2024-08-05 22:19:36,009][52794] Sum rewards: 8.611, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.341', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.198', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.430', 'ARMOR': '1.789', 'weapon3': '2.116', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:36,080][52666] DAMAGECOUNT value on done: 5303.0 [2024-08-05 22:19:36,081][52666] Sum rewards: 5.650, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.044', 'weapon5': '0.058', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.214', 'weapon3': '1.890', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:36,142][52665] DAMAGECOUNT value on done: 4613.0 [2024-08-05 22:19:36,143][52665] Sum rewards: 12.088, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.468', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.074', 'AMMO4': '0.084', 'weapon5': '0.096', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.426', 'ARMOR': '0.528', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon2': '1.230', 'weapon3': '1.500', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:36,495][52669] DAMAGECOUNT value on done: 5274.0 [2024-08-05 22:19:36,496][52669] Sum rewards: 3.848, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.440', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon4': '0.200', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '1.033', 'weapon2': '1.320', 'weapon3': '1.536', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:37,138][52663] DAMAGECOUNT value on done: 5635.0 [2024-08-05 22:19:37,138][52663] Sum rewards: -0.765, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.435', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'weapon4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'ARMOR': '0.531', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.173', 'weapon2': '1.312', 'FRAGCOUNT': '2.000', 'weapon3': '2.060'} [2024-08-05 22:19:37,520][52647] DAMAGECOUNT value on done: 6092.0 [2024-08-05 22:19:37,520][52647] Sum rewards: 10.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.852', 'AMMO2': '0.000', 'AMMO4': '0.002', 'weapon4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'HITCOUNT': '0.740', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'weapon2': '1.794', 'weapon3': '1.878', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '10.000'} [2024-08-05 22:19:37,711][52662] DAMAGECOUNT value on done: 6873.0 [2024-08-05 22:19:37,711][52662] Sum rewards: 10.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.208', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.104', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon5': '0.194', 'ARMOR': '0.428', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.132', 'weapon3': '2.328', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:37,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16657.0, 300 sec: 16856.1). Total num frames: 55533568. Throughput: 0: 4169.3. Samples: 13886630. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:19:37,794][52567] Avg episode reward: [(0, '5.541')] [2024-08-05 22:19:37,798][52614] Saving new best policy, reward=5.541! [2024-08-05 22:19:38,205][52667] DAMAGECOUNT value on done: 6176.0 [2024-08-05 22:19:38,205][52667] Sum rewards: 4.292, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.008', 'HEALTH': '0.014', 'AMMO4': '0.042', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.210', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '0.918', 'ARMOR': '0.958', 'weapon3': '1.844', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:38,500][52670] DAMAGECOUNT value on done: 5361.0 [2024-08-05 22:19:38,501][52670] Sum rewards: 8.133, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.365', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.068', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'ARMOR': '0.439', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon2': '1.372', 'weapon3': '2.400', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:38,524][52794] DAMAGECOUNT value on done: 6056.0 [2024-08-05 22:19:38,526][52794] Sum rewards: -0.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.936', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'HITCOUNT': '0.330', 'weapon4': '0.400', 'ARMOR': '0.444', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.879', 'weapon2': '1.054', 'weapon3': '1.212', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:38,868][52650] Updated weights for policy 0, policy_version 6781 (0.0024) [2024-08-05 22:19:39,223][52669] DAMAGECOUNT value on done: 6503.0 [2024-08-05 22:19:39,224][52669] Sum rewards: 6.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.040', 'AMMO4': '0.053', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.344', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.356', 'ARMOR': '1.472', 'weapon3': '1.482', 'weapon2': '1.592', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:39,228][52665] DAMAGECOUNT value on done: 6104.0 [2024-08-05 22:19:39,231][52665] Sum rewards: 0.459, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.020', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.420', 'ARMOR': '0.848', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.335', 'weapon2': '1.394', 'FRAGCOUNT': '2.000', 'weapon3': '2.114'} [2024-08-05 22:19:39,706][52666] DAMAGECOUNT value on done: 5975.0 [2024-08-05 22:19:39,706][52666] Sum rewards: 2.102, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.067', 'HEALTH': '0.094', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'weapon3': '1.020', 'DAMAGECOUNT': '1.218', 'weapon2': '1.598', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:40,229][52663] DAMAGECOUNT value on done: 6196.0 [2024-08-05 22:19:40,230][52663] Sum rewards: 5.573, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.922', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'AMMO3': '0.078', 'WEAPON5': '0.200', 'weapon5': '0.300', 'ARMOR': '0.486', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '1.154', 'weapon3': '1.534', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:40,424][52662] DAMAGECOUNT value on done: 7100.0 [2024-08-05 22:19:40,424][52662] Sum rewards: 5.999, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.094', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.027', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'weapon2': '1.460', 'weapon3': '1.762', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:40,488][52647] DAMAGECOUNT value on done: 6106.0 [2024-08-05 22:19:40,491][52647] Sum rewards: -1.041, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.400', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.116', 'HITCOUNT': '0.250', 'ARMOR': '0.528', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.747', 'FRAGCOUNT': '1.000', 'weapon3': '1.012', 'weapon2': '1.214'} [2024-08-05 22:19:40,753][52667] DAMAGECOUNT value on done: 6845.0 [2024-08-05 22:19:40,753][52667] Sum rewards: 3.871, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.855', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.520', 'WEAPON3': '0.850', 'weapon2': '1.322', 'DAMAGECOUNT': '1.515', 'weapon3': '1.780', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:41,368][52794] DAMAGECOUNT value on done: 5080.0 [2024-08-05 22:19:41,370][52794] Sum rewards: 2.258, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.528', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'ARMOR': '0.832', 'DAMAGECOUNT': '1.374', 'weapon3': '1.418', 'weapon2': '1.810', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:42,129][52670] DAMAGECOUNT value on done: 5305.0 [2024-08-05 22:19:42,173][52665] DAMAGECOUNT value on done: 6779.0 [2024-08-05 22:19:42,174][52665] Sum rewards: 2.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.126', 'AMMO2': '0.004', 'AMMO4': '0.019', 'ARMOR': '0.048', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'weapon4': '0.418', 'weapon2': '0.680', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.260', 'weapon3': '1.732', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:42,795][52567] Fps is (10 sec: 15564.2, 60 sec: 16520.4, 300 sec: 16828.3). Total num frames: 55607296. Throughput: 0: 4168.2. Samples: 13911660. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:19:42,795][52567] Avg episode reward: [(0, '5.272')] [2024-08-05 22:19:42,966][52662] DAMAGECOUNT value on done: 7667.0 [2024-08-05 22:19:42,968][52662] Sum rewards: 3.689, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.076', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.040', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.300', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '0.875', 'weapon2': '1.618', 'weapon3': '1.750', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:43,230][52666] DAMAGECOUNT value on done: 6151.0 [2024-08-05 22:19:43,238][52666] Sum rewards: 1.950, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.398', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.158', 'ARMOR': '0.485', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon3': '1.606', 'weapon2': '1.866', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:43,347][52647] DAMAGECOUNT value on done: 4783.0 [2024-08-05 22:19:43,347][52647] Sum rewards: 5.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.528', 'AMMO2': '0.013', 'AMMO4': '0.062', 'ARMOR': '0.104', 'AMMO3': '0.107', 'WEAPON4': '0.250', 'weapon2': '0.566', 'weapon4': '0.652', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon3': '1.780', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:43,431][52663] DAMAGECOUNT value on done: 5753.0 [2024-08-05 22:19:43,431][52663] Sum rewards: 6.928, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.314', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '0.992', 'weapon2': '1.506', 'weapon3': '1.608', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:43,604][52650] Updated weights for policy 0, policy_version 6791 (0.0024) [2024-08-05 22:19:43,973][52667] DAMAGECOUNT value on done: 6603.0 [2024-08-05 22:19:43,973][52667] Sum rewards: 3.623, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.142', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'WEAPON1': '0.020', 'AMMO3': '0.115', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'ARMOR': '0.912', 'weapon2': '1.416', 'DAMAGECOUNT': '1.977', 'weapon3': '2.014', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:44,121][52794] DAMAGECOUNT value on done: 7136.0 [2024-08-05 22:19:44,122][52794] Sum rewards: 2.203, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.535', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.420', 'ARMOR': '0.516', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.888', 'weapon3': '1.662', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '2.500'} [2024-08-05 22:19:45,148][52665] DAMAGECOUNT value on done: 6175.0 [2024-08-05 22:19:45,148][52665] Sum rewards: 4.570, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.178', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.061', 'weapon5': '0.130', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.360', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.500', 'weapon2': '0.970', 'DAMAGECOUNT': '1.074', 'weapon3': '1.474', 'FRAGCOUNT': '2.500'} [2024-08-05 22:19:45,610][52670] DAMAGECOUNT value on done: 4501.0 [2024-08-05 22:19:45,613][52670] Sum rewards: 10.889, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.973', 'AMMO2': '0.006', 'AMMO4': '0.032', 'ARMOR': '0.036', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon2': '1.352', 'weapon3': '1.592', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:45,740][52662] DAMAGECOUNT value on done: 7182.0 [2024-08-05 22:19:45,741][52662] Sum rewards: 5.760, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.976', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.114', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.432', 'DAMAGECOUNT': '1.920', 'weapon3': '1.944', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:45,882][52658] DAMAGECOUNT value on done: 5426.0 [2024-08-05 22:19:45,883][52658] Sum rewards: 7.547, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.857', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'weapon4': '0.104', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.760', 'WEAPON3': '0.950', 'weapon2': '1.516', 'weapon3': '1.744', 'ARMOR': '1.836', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:46,256][52663] DAMAGECOUNT value on done: 5639.0 [2024-08-05 22:19:46,261][52663] Sum rewards: 2.833, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'HEALTH': '0.082', 'AMMO3': '0.121', 'weapon4': '0.264', 'ARMOR': '0.546', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon3': '1.696', 'weapon2': '1.700', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:46,347][52647] DAMAGECOUNT value on done: 5834.0 [2024-08-05 22:19:46,349][52647] Sum rewards: 5.347, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.767', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.022', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.174', 'weapon3': '1.866', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:46,562][52794] DAMAGECOUNT value on done: 6806.0 [2024-08-05 22:19:46,563][52794] Sum rewards: 7.715, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.200', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.070', 'weapon4': '0.186', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'ARMOR': '0.897', 'weapon3': '1.432', 'weapon2': '1.592', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:46,686][52666] DAMAGECOUNT value on done: 4644.0 [2024-08-05 22:19:46,687][52666] Sum rewards: 6.712, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.846', 'AMMO2': '0.021', 'AMMO3': '0.072', 'AMMO4': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.410', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'ARMOR': '0.956', 'weapon2': '1.214', 'weapon3': '1.644', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:46,950][52667] DAMAGECOUNT value on done: 6091.0 [2024-08-05 22:19:46,961][52667] Sum rewards: 1.759, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.596', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.169', 'ARMOR': '0.456', 'HITCOUNT': '0.610', 'WEAPON3': '1.050', 'weapon2': '1.348', 'weapon3': '2.244', 'DAMAGECOUNT': '2.253', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:47,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16657.0, 300 sec: 16828.3). Total num frames: 55697408. Throughput: 0: 4176.4. Samples: 13924340. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 22:19:47,795][52567] Avg episode reward: [(0, '5.033')] [2024-08-05 22:19:48,449][52662] DAMAGECOUNT value on done: 7287.0 [2024-08-05 22:19:48,449][52662] Sum rewards: 11.989, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.694', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'weapon4': '0.078', 'weapon5': '0.128', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon2': '1.590', 'weapon3': '1.592', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:48,524][52649] DAMAGECOUNT value on done: 6132.0 [2024-08-05 22:19:48,527][52649] Sum rewards: 3.871, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.380', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'ARMOR': '0.100', 'AMMO3': '0.113', 'weapon4': '0.162', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.360', 'weapon3': '1.814', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:48,541][52665] DAMAGECOUNT value on done: 6107.0 [2024-08-05 22:19:48,542][52665] Sum rewards: 4.485, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.987', 'AMMO2': '0.003', 'AMMO5': '0.008', 'AMMO4': '0.017', 'weapon5': '0.034', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.208', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.134', 'ARMOR': '1.365', 'weapon3': '1.610', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:48,543][52670] DAMAGECOUNT value on done: 5399.0 [2024-08-05 22:19:48,544][52670] Sum rewards: 7.277, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.542', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.096', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.222', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.332', 'weapon2': '1.666', 'ARMOR': '1.844', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:48,762][52658] DAMAGECOUNT value on done: 5543.0 [2024-08-05 22:19:48,762][52658] Sum rewards: 10.427, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.550', 'AMMO2': '0.013', 'AMMO4': '0.064', 'ARMOR': '0.080', 'AMMO3': '0.103', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.642', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon3': '1.764', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:48,839][52650] Updated weights for policy 0, policy_version 6801 (0.0022) [2024-08-05 22:19:49,150][52647] DAMAGECOUNT value on done: 5203.0 [2024-08-05 22:19:49,150][52647] Sum rewards: 4.736, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.563', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '1.018', 'weapon2': '1.616', 'weapon3': '1.652', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:49,245][52663] DAMAGECOUNT value on done: 6345.0 [2024-08-05 22:19:49,247][52663] Sum rewards: 1.807, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.568', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'HITCOUNT': '0.280', 'ARMOR': '0.476', 'weapon4': '0.492', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.792', 'weapon2': '1.200', 'weapon3': '1.304', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:49,246][52666] DAMAGECOUNT value on done: 5422.0 [2024-08-05 22:19:49,248][52666] Sum rewards: 7.432, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.400', 'AMMO2': '0.008', 'AMMO4': '0.041', 'ARMOR': '0.052', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.436', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '1.046', 'weapon3': '1.460', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:49,668][52794] DAMAGECOUNT value on done: 6397.0 [2024-08-05 22:19:49,670][52794] Sum rewards: 4.869, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.408', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.073', 'weapon4': '0.208', 'WEAPON3': '0.450', 'HITCOUNT': '0.450', 'weapon2': '0.990', 'weapon3': '1.096', 'DAMAGECOUNT': '1.377', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:50,264][52667] DAMAGECOUNT value on done: 6109.0 [2024-08-05 22:19:50,264][52667] Sum rewards: 9.294, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.865', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'ARMOR': '0.474', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.264', 'weapon3': '1.666', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:51,324][52665] DAMAGECOUNT value on done: 6849.0 [2024-08-05 22:19:51,325][52665] Sum rewards: 4.292, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.130', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO2': '0.026', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.130', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.311', 'weapon2': '1.714', 'weapon3': '1.858', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:51,351][52649] DAMAGECOUNT value on done: 5476.0 [2024-08-05 22:19:51,351][52649] Sum rewards: 7.654, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.666', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.254', 'weapon3': '1.752', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'} [2024-08-05 22:19:51,429][52662] DAMAGECOUNT value on done: 6956.0 [2024-08-05 22:19:51,429][52662] Sum rewards: 14.697, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.546', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon2': '1.540', 'weapon3': '2.130', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '13.000'} [2024-08-05 22:19:51,578][52663] DAMAGECOUNT value on done: 5674.0 [2024-08-05 22:19:51,579][52663] Sum rewards: 3.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon4': '0.236', 'ARMOR': '0.545', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.424', 'weapon3': '1.994', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:51,771][52670] DAMAGECOUNT value on done: 6240.0 [2024-08-05 22:19:51,774][52670] Sum rewards: 4.854, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.572', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'weapon4': '0.444', 'HITCOUNT': '0.810', 'WEAPON3': '0.950', 'weapon2': '1.074', 'weapon3': '2.176', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:51,934][52647] DAMAGECOUNT value on done: 5673.0 [2024-08-05 22:19:51,936][52647] Sum rewards: 3.302, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.388', 'AMMO2': '0.011', 'ARMOR': '0.035', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.123', 'weapon4': '0.124', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.224', 'DAMAGECOUNT': '1.611', 'weapon3': '1.980', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:52,291][52658] DAMAGECOUNT value on done: 5065.0 [2024-08-05 22:19:52,293][52658] Sum rewards: 6.208, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.042', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'ARMOR': '0.128', 'WEAPON4': '0.300', 'weapon4': '0.398', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '1.110', 'weapon3': '1.694', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:52,470][52666] DAMAGECOUNT value on done: 5295.0 [2024-08-05 22:19:52,470][52666] Sum rewards: 1.088, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.508', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.010', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'weapon4': '0.406', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.825', 'weapon2': '1.066', 'weapon3': '1.610', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:52,747][52794] DAMAGECOUNT value on done: 7093.0 [2024-08-05 22:19:52,748][52794] Sum rewards: 11.906, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.374', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '0.986', 'weapon2': '1.264', 'weapon3': '1.776', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '11.000'} [2024-08-05 22:19:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16657.0, 300 sec: 16800.5). Total num frames: 55779328. Throughput: 0: 4170.9. Samples: 13949460. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-05 22:19:52,795][52567] Avg episode reward: [(0, '5.169')] [2024-08-05 22:19:53,390][52650] Updated weights for policy 0, policy_version 6811 (0.0019) [2024-08-05 22:19:53,477][52667] DAMAGECOUNT value on done: 6292.0 [2024-08-05 22:19:53,487][52667] Sum rewards: 2.930, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.362', 'AMMO2': '0.007', 'AMMO4': '0.037', 'ARMOR': '0.042', 'AMMO3': '0.100', 'HITCOUNT': '0.270', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.014', 'weapon2': '1.830', 'weapon3': '1.942', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:54,027][52665] DAMAGECOUNT value on done: 5725.0 [2024-08-05 22:19:54,027][52665] Sum rewards: 5.606, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.386', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.078', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.898', 'weapon3': '1.440', 'weapon2': '1.594', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:54,164][52649] DAMAGECOUNT value on done: 5111.0 [2024-08-05 22:19:54,165][52649] Sum rewards: 0.340, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.250', 'HITCOUNT': '0.440', 'weapon4': '0.462', 'WEAPON3': '0.750', 'FRAGCOUNT': '1.000', 'weapon2': '1.012', 'ARMOR': '1.043', 'DAMAGECOUNT': '1.353', 'weapon3': '1.822'} [2024-08-05 22:19:54,316][52670] DAMAGECOUNT value on done: 6451.0 [2024-08-05 22:19:54,317][52670] Sum rewards: 4.719, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.188', 'ARMOR': '0.428', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '1.198', 'weapon3': '1.880', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:54,472][52662] DAMAGECOUNT value on done: 6158.0 [2024-08-05 22:19:54,472][52662] Sum rewards: 7.419, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.111', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.082', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'ARMOR': '0.845', 'weapon3': '1.428', 'DAMAGECOUNT': '1.857', 'weapon2': '2.120', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:54,683][52663] DAMAGECOUNT value on done: 5058.0 [2024-08-05 22:19:54,685][52663] Sum rewards: 6.592, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.028', 'AMMO3': '0.043', 'AMMO4': '0.071', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.218', 'WEAPON3': '0.300', 'HITCOUNT': '0.370', 'weapon3': '0.884', 'weapon2': '0.924', 'ARMOR': '1.268', 'DAMAGECOUNT': '1.440', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:55,363][52666] DAMAGECOUNT value on done: 5145.0 [2024-08-05 22:19:55,366][52666] Sum rewards: 6.868, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.534', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'ARMOR': '0.912', 'weapon3': '1.606', 'weapon2': '1.774', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:55,430][52658] DAMAGECOUNT value on done: 5755.0 [2024-08-05 22:19:55,432][52658] Sum rewards: 4.180, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.116', 'AMMO2': '0.018', 'AMMO3': '0.070', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.228', 'ARMOR': '0.456', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon2': '1.334', 'weapon3': '1.534', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:55,482][52794] DAMAGECOUNT value on done: 6390.0 [2024-08-05 22:19:55,483][52794] Sum rewards: 2.431, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.017', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.084', 'weapon4': '0.180', 'WEAPON3': '0.400', 'HEALTH': '0.464', 'HITCOUNT': '0.520', 'weapon3': '0.908', 'DAMAGECOUNT': '1.464', 'weapon2': '1.494', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:55,533][52647] DAMAGECOUNT value on done: 5485.0 [2024-08-05 22:19:55,534][52647] Sum rewards: 10.739, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.590', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.196', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'ARMOR': '0.868', 'weapon2': '1.424', 'weapon3': '1.894', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.000'} [2024-08-05 22:19:56,532][52665] DAMAGECOUNT value on done: 6091.0 [2024-08-05 22:19:56,533][52665] Sum rewards: -2.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.978', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.026', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'HITCOUNT': '0.220', 'weapon4': '0.472', 'DAMAGECOUNT': '0.765', 'weapon2': '0.808', 'WEAPON3': '0.950', 'ARMOR': '0.999', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:56,688][52649] DAMAGECOUNT value on done: 6425.0 [2024-08-05 22:19:56,688][52649] Sum rewards: 5.443, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.556', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.250', 'ARMOR': '0.456', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'weapon2': '0.926', 'weapon3': '2.464', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:56,840][52662] DAMAGECOUNT value on done: 5609.0 [2024-08-05 22:19:56,843][52662] Sum rewards: 4.614, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.404', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.214', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'ARMOR': '0.956', 'weapon2': '1.354', 'weapon3': '1.500', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:57,041][52667] DAMAGECOUNT value on done: 6564.0 [2024-08-05 22:19:57,043][52667] Sum rewards: 3.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.702', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon7': '0.056', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'ARMOR': '0.524', 'weapon4': '0.548', 'weapon2': '0.754', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.572', 'weapon3': '1.582', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:57,190][52664] DAMAGECOUNT value on done: 7070.0 [2024-08-05 22:19:57,192][52664] Sum rewards: 5.994, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.060', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon5': '0.020', 'WEAPON1': '0.040', 'AMMO3': '0.101', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'ARMOR': '0.973', 'weapon2': '1.368', 'weapon3': '1.720', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:57,531][52670] DAMAGECOUNT value on done: 5839.0 [2024-08-05 22:19:57,534][52670] Sum rewards: 5.489, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.672', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON1': '0.010', 'AMMO3': '0.102', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'ARMOR': '0.861', 'weapon2': '1.172', 'weapon3': '2.112', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:57,557][52663] DAMAGECOUNT value on done: 5251.0 [2024-08-05 22:19:57,557][52663] Sum rewards: 0.834, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.613', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.348', 'WEAPON3': '0.450', 'ARMOR': '0.598', 'DAMAGECOUNT': '0.630', 'weapon3': '0.914', 'weapon2': '1.244', 'FRAGCOUNT': '2.000'} [2024-08-05 22:19:57,715][52794] DAMAGECOUNT value on done: 7678.0 [2024-08-05 22:19:57,716][52794] Sum rewards: 8.257, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.238', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'weapon4': '0.176', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.402', 'weapon3': '2.036', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '7.000'} [2024-08-05 22:19:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.0, 300 sec: 16800.5). Total num frames: 55861248. Throughput: 0: 4167.8. Samples: 13974620. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:19:57,795][52567] Avg episode reward: [(0, '5.031')] [2024-08-05 22:19:58,380][52650] Updated weights for policy 0, policy_version 6821 (0.0021) [2024-08-05 22:19:58,706][52666] DAMAGECOUNT value on done: 5386.0 [2024-08-05 22:19:58,715][52666] Sum rewards: 7.342, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.606', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.092', 'weapon5': '0.114', 'WEAPON5': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'ARMOR': '0.901', 'weapon2': '1.418', 'DAMAGECOUNT': '1.830', 'weapon3': '2.018', 'FRAGCOUNT': '6.000'} [2024-08-05 22:19:58,815][52647] DAMAGECOUNT value on done: 6734.0 [2024-08-05 22:19:58,815][52647] Sum rewards: 3.685, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.652', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'WEAPON5': '0.150', 'weapon5': '0.366', 'ARMOR': '0.429', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.320', 'weapon3': '1.584', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '3.000'} [2024-08-05 22:19:59,063][52658] DAMAGECOUNT value on done: 6015.0 [2024-08-05 22:19:59,064][52658] Sum rewards: 5.511, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.174', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'weapon7': '0.072', 'AMMO3': '0.075', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'ARMOR': '0.927', 'DAMAGECOUNT': '1.446', 'weapon3': '1.446', 'weapon2': '1.548', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:59,302][52665] DAMAGECOUNT value on done: 5568.0 [2024-08-05 22:19:59,304][52665] Sum rewards: 3.251, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.148', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'ARMOR': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.266', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.164', 'DAMAGECOUNT': '1.524', 'weapon3': '1.526', 'FRAGCOUNT': '4.000'} [2024-08-05 22:19:59,412][52662] DAMAGECOUNT value on done: 6824.0 [2024-08-05 22:19:59,412][52662] Sum rewards: 5.628, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.970', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.226', 'ARMOR': '0.420', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.610', 'weapon2': '1.682', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'} [2024-08-05 22:19:59,522][52649] DAMAGECOUNT value on done: 4992.0 [2024-08-05 22:19:59,538][52649] Sum rewards: 5.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.990', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon4': '0.076', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.853', 'HITCOUNT': '0.960', 'weapon2': '1.668', 'weapon3': '1.750', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.252'} [2024-08-05 22:20:00,080][52664] DAMAGECOUNT value on done: 5841.0 [2024-08-05 22:20:00,080][52664] Sum rewards: 5.501, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.231', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.028', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'ARMOR': '1.017', 'weapon2': '1.362', 'weapon3': '2.132', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:00,273][52794] DAMAGECOUNT value on done: 6352.0 [2024-08-05 22:20:00,275][52794] Sum rewards: 1.383, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'HITCOUNT': '0.570', 'WEAPON3': '0.900', 'weapon2': '1.348', 'weapon3': '1.722', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:00,309][52667] DAMAGECOUNT value on done: 5428.0 [2024-08-05 22:20:00,310][52667] Sum rewards: 7.841, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.279', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'weapon4': '0.208', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon2': '0.942', 'weapon3': '1.258', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:00,329][52663] DAMAGECOUNT value on done: 5660.0 [2024-08-05 22:20:00,329][52663] Sum rewards: 4.545, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.376', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.115', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.901', 'weapon3': '1.686', 'weapon2': '1.714', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:00,852][52670] DAMAGECOUNT value on done: 6275.0 [2024-08-05 22:20:00,854][52670] Sum rewards: 7.197, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.730', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.540', 'weapon3': '0.924', 'weapon2': '1.188', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:01,401][52647] DAMAGECOUNT value on done: 5846.0 [2024-08-05 22:20:01,402][52647] Sum rewards: 5.102, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.710', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.117', 'WEAPON4': '0.400', 'weapon4': '0.552', 'ARMOR': '0.575', 'HITCOUNT': '0.660', 'WEAPON3': '0.900', 'weapon2': '1.314', 'weapon3': '1.872', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:01,879][52662] DAMAGECOUNT value on done: 6980.0 [2024-08-05 22:20:01,880][52662] Sum rewards: -1.580, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.420', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.306', 'ARMOR': '0.493', 'HITCOUNT': '0.590', 'WEAPON3': '1.000', 'FRAGCOUNT': '1.000', 'weapon2': '1.070', 'DAMAGECOUNT': '1.947', 'weapon3': '2.032'} [2024-08-05 22:20:01,943][52666] DAMAGECOUNT value on done: 5647.0 [2024-08-05 22:20:01,944][52666] Sum rewards: 5.995, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.052', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon4': '0.174', 'ARMOR': '0.482', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.218', 'weapon3': '2.174', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:02,326][52658] DAMAGECOUNT value on done: 5098.0 [2024-08-05 22:20:02,328][52658] Sum rewards: 9.928, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.313', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.094', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.458', 'weapon3': '1.818', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:02,431][52665] DAMAGECOUNT value on done: 6097.0 [2024-08-05 22:20:02,432][52665] Sum rewards: 4.138, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.985', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon5': '0.090', 'WEAPON5': '0.150', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.840', 'weapon3': '1.124', 'DAMAGECOUNT': '1.305', 'weapon2': '1.796', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:02,698][52664] DAMAGECOUNT value on done: 6719.0 [2024-08-05 22:20:02,698][52664] Sum rewards: 6.627, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.400', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.064', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.264', 'weapon3': '1.464', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:02,782][52649] DAMAGECOUNT value on done: 6265.0 [2024-08-05 22:20:02,785][52649] Sum rewards: 2.659, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.289', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.364', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'ARMOR': '0.965', 'weapon3': '1.402', 'weapon2': '1.424', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.0, 300 sec: 16828.3). Total num frames: 55951360. Throughput: 0: 4166.4. Samples: 13987310. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 22:20:02,795][52567] Avg episode reward: [(0, '5.200')] [2024-08-05 22:20:02,848][52671] DAMAGECOUNT value on done: 7243.0 [2024-08-05 22:20:02,850][52671] Sum rewards: 6.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.542', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'ARMOR': '1.259', 'weapon2': '1.476', 'weapon3': '2.134', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:02,896][52794] DAMAGECOUNT value on done: 7038.0 [2024-08-05 22:20:02,898][52794] Sum rewards: 3.985, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.010', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.118', 'ARMOR': '0.128', 'WEAPON4': '0.250', 'weapon4': '0.438', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'weapon2': '0.928', 'DAMAGECOUNT': '1.620', 'weapon3': '1.872', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:03,192][52650] Updated weights for policy 0, policy_version 6831 (0.0032) [2024-08-05 22:20:03,608][52667] DAMAGECOUNT value on done: 6405.0 [2024-08-05 22:20:03,662][52647] DAMAGECOUNT value on done: 6274.0 [2024-08-05 22:20:03,663][52647] Sum rewards: 5.713, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.174', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.071', 'weapon4': '0.074', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.634', 'weapon2': '1.642', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:04,104][52670] DAMAGECOUNT value on done: 5494.0 [2024-08-05 22:20:04,116][52670] Sum rewards: 5.412, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.026', 'HEALTH': '0.044', 'AMMO3': '0.087', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'weapon4': '0.588', 'weapon2': '0.762', 'DAMAGECOUNT': '1.704', 'weapon3': '1.710', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:04,364][52662] DAMAGECOUNT value on done: 6214.0 [2024-08-05 22:20:04,365][52662] Sum rewards: 6.855, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.309', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.092', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon3': '1.426', 'weapon2': '1.572', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:04,952][52666] DAMAGECOUNT value on done: 5293.0 [2024-08-05 22:20:04,953][52666] Sum rewards: 3.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.896', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.264', 'HITCOUNT': '0.620', 'ARMOR': '0.894', 'WEAPON3': '1.050', 'weapon2': '1.246', 'weapon3': '2.264', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:05,208][52664] DAMAGECOUNT value on done: 5150.0 [2024-08-05 22:20:05,208][52664] Sum rewards: 2.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.020', 'AMMO4': '0.027', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'HITCOUNT': '0.540', 'WEAPON3': '0.900', 'ARMOR': '0.943', 'DAMAGECOUNT': '1.566', 'weapon2': '1.578', 'weapon3': '2.000', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:05,522][52665] DAMAGECOUNT value on done: 4895.0 [2024-08-05 22:20:05,525][52665] Sum rewards: 4.036, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.025', 'AMMO4': '-0.087', 'AMMO2': '-0.017', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'WEAPON7': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.580', 'ARMOR': '0.938', 'WEAPON3': '0.950', 'weapon3': '1.502', 'weapon2': '1.810', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:05,546][52658] DAMAGECOUNT value on done: 6851.0 [2024-08-05 22:20:05,546][52658] Sum rewards: 12.881, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.092', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.750', 'WEAPON3': '0.950', 'ARMOR': '1.348', 'weapon2': '1.408', 'weapon3': '2.296', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '12.000'} [2024-08-05 22:20:05,707][52794] DAMAGECOUNT value on done: 7252.0 [2024-08-05 22:20:05,707][52794] Sum rewards: 3.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.164', 'WEAPON4': '0.200', 'ARMOR': '0.457', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.540', 'weapon3': '1.686', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:05,941][52649] DAMAGECOUNT value on done: 5104.0 [2024-08-05 22:20:05,944][52649] Sum rewards: 4.002, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon4': '0.188', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon3': '1.318', 'ARMOR': '1.359', 'weapon2': '1.446', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:06,097][52671] DAMAGECOUNT value on done: 5963.0 [2024-08-05 22:20:06,098][52671] Sum rewards: 0.385, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.850', 'AMMO2': '0.033', 'ARMOR': '0.067', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.166', 'HITCOUNT': '0.320', 'weapon4': '0.622', 'WEAPON3': '0.750', 'weapon2': '0.782', 'DAMAGECOUNT': '1.185', 'weapon3': '1.790', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:06,208][52647] DAMAGECOUNT value on done: 6017.0 [2024-08-05 22:20:06,209][52647] Sum rewards: 11.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.346', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.196', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.470', 'weapon3': '1.658', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '10.000'} [2024-08-05 22:20:06,641][52667] DAMAGECOUNT value on done: 6745.0 [2024-08-05 22:20:06,642][52667] Sum rewards: 4.652, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.808', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.032', 'AMMO4': '0.115', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.274', 'HITCOUNT': '0.510', 'ARMOR': '0.539', 'WEAPON3': '0.800', 'weapon2': '1.054', 'DAMAGECOUNT': '1.935', 'weapon3': '1.992', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:07,111][52670] DAMAGECOUNT value on done: 4672.0 [2024-08-05 22:20:07,113][52670] Sum rewards: 8.913, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.110', 'ARMOR': '0.471', 'WEAPON3': '0.550', 'HEALTH': '0.564', 'HITCOUNT': '0.920', 'weapon2': '1.684', 'weapon3': '2.198', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:07,179][52662] DAMAGECOUNT value on done: 7319.0 [2024-08-05 22:20:07,180][52662] Sum rewards: 2.091, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.371', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO3': '0.079', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'ARMOR': '0.867', 'weapon3': '1.436', 'DAMAGECOUNT': '1.881', 'weapon2': '2.150', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:07,702][52664] DAMAGECOUNT value on done: 6489.0 [2024-08-05 22:20:07,703][52664] Sum rewards: 6.511, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.013', 'ARMOR': '0.044', 'AMMO4': '0.064', 'AMMO3': '0.158', 'HEALTH': '0.224', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon2': '1.250', 'weapon3': '2.088', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:07,795][52567] Fps is (10 sec: 17202.9, 60 sec: 16793.5, 300 sec: 16828.3). Total num frames: 56033280. Throughput: 0: 4161.3. Samples: 14012400. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 22:20:07,795][52567] Avg episode reward: [(0, '4.993')] [2024-08-05 22:20:07,858][52650] Updated weights for policy 0, policy_version 6841 (0.0021) [2024-08-05 22:20:08,040][52666] DAMAGECOUNT value on done: 4486.0 [2024-08-05 22:20:08,040][52666] Sum rewards: 3.745, reward structure: {'DEATHCOUNT': '-4.500', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.109', 'weapon4': '0.262', 'HITCOUNT': '0.330', 'HEALTH': '0.394', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'DAMAGECOUNT': '1.230', 'weapon2': '1.286', 'weapon3': '1.592', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:08,426][52794] DAMAGECOUNT value on done: 6883.0 [2024-08-05 22:20:08,427][52794] Sum rewards: 2.315, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.820', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.040', 'ARMOR': '0.061', 'WEAPON4': '0.150', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon4': '0.358', 'weapon2': '0.880', 'weapon3': '0.924', 'DAMAGECOUNT': '1.002', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:08,539][52665] DAMAGECOUNT value on done: 6797.0 [2024-08-05 22:20:08,539][52665] Sum rewards: 6.119, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.352', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '1.066', 'weapon3': '1.652', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:08,686][52658] DAMAGECOUNT value on done: 6120.0 [2024-08-05 22:20:08,686][52658] Sum rewards: 2.503, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.817', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'weapon4': '0.174', 'weapon5': '0.188', 'HITCOUNT': '0.370', 'WEAPON3': '0.700', 'weapon2': '1.354', 'DAMAGECOUNT': '1.602', 'weapon3': '1.692', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:08,909][52649] DAMAGECOUNT value on done: 4928.0 [2024-08-05 22:20:08,909][52649] Sum rewards: 7.618, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.228', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.424', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'ARMOR': '0.899', 'weapon2': '1.246', 'weapon3': '1.644', 'DAMAGECOUNT': '1.986', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:09,450][52671] DAMAGECOUNT value on done: 6092.0 [2024-08-05 22:20:09,451][52671] Sum rewards: 4.058, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.672', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'weapon5': '0.130', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon2': '1.078', 'weapon3': '1.156', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:09,875][52667] DAMAGECOUNT value on done: 7003.0 [2024-08-05 22:20:09,875][52667] Sum rewards: 5.981, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.979', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.166', 'ARMOR': '0.535', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.372', 'weapon3': '1.672', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:09,979][52662] DAMAGECOUNT value on done: 6199.0 [2024-08-05 22:20:09,979][52662] Sum rewards: 7.506, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.397', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.109', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'ARMOR': '0.908', 'weapon2': '1.610', 'weapon3': '1.720', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:10,299][52670] DAMAGECOUNT value on done: 5184.0 [2024-08-05 22:20:10,302][52670] Sum rewards: 0.280, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.830', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'weapon5': '0.086', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.330', 'WEAPON3': '0.750', 'ARMOR': '0.961', 'DAMAGECOUNT': '1.266', 'weapon2': '1.666', 'weapon3': '1.668', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:10,527][52664] DAMAGECOUNT value on done: 6243.0 [2024-08-05 22:20:10,527][52664] Sum rewards: 7.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.290', 'ARMOR': '0.526', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.194', 'weapon3': '1.652', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:10,959][52659] DAMAGECOUNT value on done: 5630.0 [2024-08-05 22:20:10,959][52659] Sum rewards: 6.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.905', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.170', 'weapon4': '0.204', 'WEAPON4': '0.350', 'ARMOR': '0.496', 'weapon2': '0.650', 'HITCOUNT': '0.760', 'WEAPON3': '1.100', 'DAMAGECOUNT': '2.661', 'weapon3': '2.844', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:11,048][52794] DAMAGECOUNT value on done: 7034.0 [2024-08-05 22:20:11,050][52794] Sum rewards: 8.596, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.195', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.370', 'ARMOR': '0.457', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.484', 'weapon3': '1.826', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:11,527][52666] DAMAGECOUNT value on done: 5535.0 [2024-08-05 22:20:11,529][52666] Sum rewards: 5.173, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.702', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.222', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.564', 'weapon2': '1.140', 'weapon3': '1.234', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:11,654][52658] DAMAGECOUNT value on done: 5110.0 [2024-08-05 22:20:11,654][52658] Sum rewards: 9.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.341', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'weapon4': '0.210', 'ARMOR': '0.448', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon2': '1.340', 'weapon3': '1.682', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:12,344][52649] DAMAGECOUNT value on done: 5484.0 [2024-08-05 22:20:12,345][52649] Sum rewards: 4.465, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.328', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.258', 'weapon4': '0.300', 'HITCOUNT': '0.450', 'ARMOR': '0.475', 'WEAPON3': '0.550', 'weapon2': '0.982', 'weapon3': '1.626', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:12,414][52671] DAMAGECOUNT value on done: 6160.0 [2024-08-05 22:20:12,414][52671] Sum rewards: 10.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon7': '0.058', 'ARMOR': '0.073', 'weapon5': '0.078', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.258', 'weapon3': '1.894', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '10.000'} [2024-08-05 22:20:12,575][52662] DAMAGECOUNT value on done: 6791.0 [2024-08-05 22:20:12,576][52662] Sum rewards: 3.564, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.484', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.064', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'ARMOR': '0.420', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.566', 'DAMAGECOUNT': '1.839', 'weapon3': '1.908', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:12,794][52567] Fps is (10 sec: 16384.6, 60 sec: 16657.2, 300 sec: 16800.6). Total num frames: 56115200. Throughput: 0: 4160.7. Samples: 14037440. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:20:12,794][52567] Avg episode reward: [(0, '5.384')] [2024-08-05 22:20:12,918][52667] DAMAGECOUNT value on done: 6726.0 [2024-08-05 22:20:12,920][52667] Sum rewards: 7.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.594', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.052', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon2': '0.716', 'HITCOUNT': '0.720', 'WEAPON3': '0.950', 'weapon3': '2.166', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '9.000'} [2024-08-05 22:20:13,181][52650] Updated weights for policy 0, policy_version 6851 (0.0017) [2024-08-05 22:20:13,419][52659] DAMAGECOUNT value on done: 6952.0 [2024-08-05 22:20:13,421][52659] Sum rewards: 7.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.194', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO4': '0.082', 'AMMO3': '0.117', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.716', 'weapon3': '1.848', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:13,522][52670] DAMAGECOUNT value on done: 5904.0 [2024-08-05 22:20:13,527][52670] Sum rewards: 6.747, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.098', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.150', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.386', 'weapon3': '1.472', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:13,603][52664] DAMAGECOUNT value on done: 6376.0 [2024-08-05 22:20:13,604][52664] Sum rewards: 6.690, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.262', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO4': '0.089', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.208', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'ARMOR': '0.956', 'weapon2': '1.332', 'weapon3': '1.610', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:13,817][52794] DAMAGECOUNT value on done: 6566.0 [2024-08-05 22:20:13,819][52794] Sum rewards: 6.952, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon7': '0.048', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'weapon5': '0.186', 'HITCOUNT': '0.400', 'ARMOR': '0.449', 'WEAPON3': '0.500', 'weapon3': '1.250', 'DAMAGECOUNT': '1.395', 'weapon2': '1.584', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:14,434][52658] DAMAGECOUNT value on done: 5614.0 [2024-08-05 22:20:14,435][52658] Sum rewards: 1.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.622', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.157', 'WEAPON4': '0.350', 'weapon4': '0.428', 'ARMOR': '0.568', 'HITCOUNT': '0.750', 'WEAPON3': '0.900', 'weapon2': '1.188', 'weapon3': '1.952', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:14,564][52666] DAMAGECOUNT value on done: 7138.0 [2024-08-05 22:20:14,566][52666] Sum rewards: 3.166, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.320', 'AMMO2': '0.040', 'AMMO3': '0.105', 'AMMO4': '0.199', 'HITCOUNT': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.482', 'ARMOR': '0.544', 'WEAPON3': '0.700', 'weapon2': '1.102', 'DAMAGECOUNT': '1.338', 'weapon3': '1.866', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:15,255][52649] DAMAGECOUNT value on done: 5106.0 [2024-08-05 22:20:15,256][52649] Sum rewards: 7.755, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.126', 'weapon4': '0.212', 'ARMOR': '0.494', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.498', 'weapon3': '1.860', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:15,372][52662] DAMAGECOUNT value on done: 6685.0 [2024-08-05 22:20:15,374][52662] Sum rewards: 5.304, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.396', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.039', 'weapon4': '0.086', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.244', 'weapon3': '1.830', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:15,427][52671] DAMAGECOUNT value on done: 6066.0 [2024-08-05 22:20:15,429][52671] Sum rewards: 2.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.724', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'ARMOR': '0.060', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.246', 'HITCOUNT': '0.540', 'WEAPON3': '0.950', 'weapon2': '1.174', 'DAMAGECOUNT': '1.665', 'weapon3': '1.910', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:15,950][52667] DAMAGECOUNT value on done: 5622.0 [2024-08-05 22:20:15,951][52667] Sum rewards: 3.675, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.595', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.390', 'ARMOR': '0.487', 'WEAPON3': '0.600', 'weapon2': '1.110', 'DAMAGECOUNT': '1.203', 'weapon3': '1.442', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:16,664][52664] DAMAGECOUNT value on done: 6395.0 [2024-08-05 22:20:16,667][52664] Sum rewards: 7.761, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.452', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.084', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'ARMOR': '0.930', 'weapon3': '1.578', 'weapon2': '1.746', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:16,715][52670] DAMAGECOUNT value on done: 5617.0 [2024-08-05 22:20:16,718][52670] Sum rewards: 5.022, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.144', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'ARMOR': '0.840', 'weapon2': '1.354', 'weapon3': '1.556', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:16,741][52659] DAMAGECOUNT value on done: 5638.0 [2024-08-05 22:20:16,745][52659] Sum rewards: 2.444, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.081', 'HITCOUNT': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.426', 'ARMOR': '0.528', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.936', 'weapon2': '1.228', 'weapon3': '1.752', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:17,679][52658] DAMAGECOUNT value on done: 6494.0 [2024-08-05 22:20:17,679][52658] Sum rewards: 7.054, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.265', 'weapon5': '0.006', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon3': '1.564', 'weapon2': '1.570', 'ARMOR': '1.730', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:17,727][52666] DAMAGECOUNT value on done: 6305.0 [2024-08-05 22:20:17,727][52666] Sum rewards: 5.118, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.680', 'AMMO2': '0.018', 'ARMOR': '0.080', 'AMMO4': '0.088', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.252', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '0.942', 'weapon3': '1.714', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:17,777][52662] DAMAGECOUNT value on done: 6338.0 [2024-08-05 22:20:17,777][52662] Sum rewards: 1.654, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.768', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO3': '0.087', 'AMMO4': '0.091', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon2': '1.416', 'DAMAGECOUNT': '1.509', 'weapon3': '1.596', 'ARMOR': '1.766', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:17,794][52567] Fps is (10 sec: 16384.7, 60 sec: 16520.6, 300 sec: 16800.5). Total num frames: 56197120. Throughput: 0: 4164.9. Samples: 14050040. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:20:17,794][52567] Avg episode reward: [(0, '5.258')] [2024-08-05 22:20:17,858][52650] Updated weights for policy 0, policy_version 6861 (0.0019) [2024-08-05 22:20:18,251][52649] DAMAGECOUNT value on done: 5664.0 [2024-08-05 22:20:18,251][52649] Sum rewards: 0.997, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.101', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon4': '0.040', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.883', 'DAMAGECOUNT': '0.966', 'weapon3': '1.066', 'weapon2': '1.454', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:18,684][52671] DAMAGECOUNT value on done: 5492.0 [2024-08-05 22:20:18,684][52671] Sum rewards: 3.801, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.390', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.202', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.927', 'weapon2': '1.322', 'weapon3': '1.698', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:18,827][52667] DAMAGECOUNT value on done: 6050.0 [2024-08-05 22:20:18,828][52667] Sum rewards: 10.088, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.480', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.196', 'WEAPON3': '0.400', 'ARMOR': '0.520', 'HITCOUNT': '0.830', 'weapon3': '1.162', 'weapon2': '1.422', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:19,997][52659] DAMAGECOUNT value on done: 6385.0 [2024-08-05 22:20:20,005][52659] Sum rewards: 6.195, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.884', 'AMMO2': '0.036', 'AMMO3': '0.143', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.280', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'ARMOR': '1.208', 'weapon2': '1.518', 'weapon3': '1.992', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:20,102][52670] DAMAGECOUNT value on done: 5737.0 [2024-08-05 22:20:20,103][52670] Sum rewards: 7.093, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.876', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.119', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'ARMOR': '1.228', 'weapon2': '1.628', 'weapon3': '1.770', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:20,107][52664] DAMAGECOUNT value on done: 6015.0 [2024-08-05 22:20:20,109][52664] Sum rewards: 2.057, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon5': '0.040', 'AMMO4': '0.051', 'AMMO3': '0.084', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.340', 'WEAPON3': '0.650', 'ARMOR': '0.935', 'weapon2': '1.102', 'DAMAGECOUNT': '1.107', 'weapon3': '1.370', 'FRAGCOUNT': '1.500'} [2024-08-05 22:20:20,266][52658] DAMAGECOUNT value on done: 5567.0 [2024-08-05 22:20:20,267][52658] Sum rewards: 10.687, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.142', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '0.859', 'weapon2': '1.428', 'weapon3': '1.516', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '9.000'} [2024-08-05 22:20:20,941][52649] DAMAGECOUNT value on done: 5073.0 [2024-08-05 22:20:20,941][52649] Sum rewards: 4.426, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'HEALTH': '0.059', 'AMMO3': '0.110', 'weapon4': '0.212', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon2': '0.946', 'DAMAGECOUNT': '1.341', 'weapon3': '1.934', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:21,543][52667] DAMAGECOUNT value on done: 6599.0 [2024-08-05 22:20:21,543][52667] Sum rewards: 1.330, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.501', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.276', 'HITCOUNT': '0.480', 'ARMOR': '0.890', 'WEAPON3': '0.950', 'weapon2': '1.398', 'DAMAGECOUNT': '1.482', 'weapon3': '2.038', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:21,818][52671] DAMAGECOUNT value on done: 6639.0 [2024-08-05 22:20:21,818][52671] Sum rewards: 3.628, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.076', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.224', 'ARMOR': '0.416', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.260', 'DAMAGECOUNT': '1.401', 'weapon2': '1.422', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:22,736][52650] Updated weights for policy 0, policy_version 6871 (0.0027) [2024-08-05 22:20:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 56287232. Throughput: 0: 4198.4. Samples: 14075560. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 22:20:22,795][52567] Avg episode reward: [(0, '5.103')] [2024-08-05 22:20:22,974][52664] DAMAGECOUNT value on done: 6134.0 [2024-08-05 22:20:22,976][52664] Sum rewards: 9.910, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.127', 'weapon4': '0.220', 'WEAPON3': '0.350', 'ARMOR': '0.464', 'HITCOUNT': '0.660', 'HEALTH': '0.676', 'weapon3': '1.382', 'weapon2': '1.460', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:22,992][52658] DAMAGECOUNT value on done: 4941.0 [2024-08-05 22:20:22,994][52658] Sum rewards: 1.459, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.676', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.127', 'WEAPON4': '0.350', 'HITCOUNT': '0.390', 'ARMOR': '0.496', 'weapon4': '0.752', 'WEAPON3': '0.800', 'weapon2': '0.966', 'DAMAGECOUNT': '1.467', 'weapon3': '1.766', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:23,180][52659] DAMAGECOUNT value on done: 5274.0 [2024-08-05 22:20:23,184][52659] Sum rewards: 5.991, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.235', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.085', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon2': '1.104', 'weapon3': '1.282', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:24,120][52649] DAMAGECOUNT value on done: 6989.0 [2024-08-05 22:20:24,121][52649] Sum rewards: 7.425, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.469', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO3': '0.093', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'ARMOR': '0.900', 'weapon2': '1.530', 'weapon3': '1.536', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:24,205][52667] DAMAGECOUNT value on done: 6071.0 [2024-08-05 22:20:24,206][52667] Sum rewards: 8.541, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.961', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'ARMOR': '0.893', 'weapon2': '1.254', 'weapon3': '2.090', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:24,838][52671] DAMAGECOUNT value on done: 4643.0 [2024-08-05 22:20:24,838][52671] Sum rewards: 4.856, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.014', 'HEALTH': '0.042', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.071', 'AMMO3': '0.090', 'weapon4': '0.132', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon2': '1.296', 'weapon3': '1.756', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:26,086][52659] DAMAGECOUNT value on done: 5118.0 [2024-08-05 22:20:26,088][52659] Sum rewards: 4.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.233', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.202', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'ARMOR': '0.860', 'weapon2': '1.118', 'weapon3': '1.824', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:26,121][52658] DAMAGECOUNT value on done: 6219.0 [2024-08-05 22:20:26,127][52658] Sum rewards: 5.521, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.472', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.057', 'weapon7': '0.058', 'weapon4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.136', 'HITCOUNT': '0.710', 'WEAPON3': '0.950', 'weapon2': '1.388', 'weapon3': '1.874', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:26,252][52664] DAMAGECOUNT value on done: 5422.0 [2024-08-05 22:20:26,252][52664] Sum rewards: 7.499, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.244', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'ARMOR': '0.896', 'weapon2': '1.096', 'weapon3': '1.712', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:27,365][52667] DAMAGECOUNT value on done: 6244.0 [2024-08-05 22:20:27,367][52667] Sum rewards: 0.993, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.076', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.190', 'HITCOUNT': '0.610', 'ARMOR': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.448', 'weapon3': '1.736', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:27,412][52649] DAMAGECOUNT value on done: 5031.0 [2024-08-05 22:20:27,412][52649] Sum rewards: 6.107, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.300', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.013', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.230', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon2': '1.356', 'DAMAGECOUNT': '1.434', 'weapon3': '1.644', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:27,550][52650] Updated weights for policy 0, policy_version 6881 (0.0012) [2024-08-05 22:20:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16657.1, 300 sec: 16800.5). Total num frames: 56369152. Throughput: 0: 4207.6. Samples: 14101000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:20:27,794][52567] Avg episode reward: [(0, '5.189')] [2024-08-05 22:20:27,883][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006882_56377344.pth... [2024-08-05 22:20:28,039][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006389_52338688.pth [2024-08-05 22:20:28,417][52671] DAMAGECOUNT value on done: 6913.0 [2024-08-05 22:20:28,418][52671] Sum rewards: 10.981, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.332', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'ARMOR': '0.913', 'weapon2': '1.396', 'weapon3': '1.868', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '10.000'} [2024-08-05 22:20:28,950][52664] DAMAGECOUNT value on done: 5338.0 [2024-08-05 22:20:28,950][52664] Sum rewards: 2.410, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.831', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'weapon4': '0.092', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.946', 'DAMAGECOUNT': '1.125', 'weapon3': '1.566', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:29,159][52658] DAMAGECOUNT value on done: 6718.0 [2024-08-05 22:20:29,161][52658] Sum rewards: 8.820, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.706', 'AMMO2': '0.034', 'ARMOR': '0.071', 'AMMO3': '0.102', 'weapon4': '0.108', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.176', 'weapon3': '1.972', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:29,737][52659] DAMAGECOUNT value on done: 6442.0 [2024-08-05 22:20:29,738][52659] Sum rewards: 10.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.388', 'AMMO2': '0.027', 'ARMOR': '0.028', 'AMMO3': '0.105', 'AMMO4': '0.135', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon2': '1.494', 'weapon3': '1.698', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '10.000'} [2024-08-05 22:20:30,734][52649] DAMAGECOUNT value on done: 5919.0 [2024-08-05 22:20:30,735][52649] Sum rewards: 8.357, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.653', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.184', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'ARMOR': '1.265', 'weapon2': '1.298', 'weapon3': '1.974', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:31,370][52671] DAMAGECOUNT value on done: 5902.0 [2024-08-05 22:20:31,370][52671] Sum rewards: 5.839, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.308', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.068', 'AMMO4': '0.086', 'weapon5': '0.102', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.078', 'DAMAGECOUNT': '1.524', 'weapon3': '2.186', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:31,795][52664] DAMAGECOUNT value on done: 4805.0 [2024-08-05 22:20:31,796][52664] Sum rewards: 5.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.086', 'AMMO3': '0.124', 'WEAPON4': '0.300', 'weapon4': '0.530', 'HITCOUNT': '0.540', 'weapon2': '0.642', 'WEAPON3': '0.900', 'DAMAGECOUNT': '2.022', 'weapon3': '2.218', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:32,023][52658] DAMAGECOUNT value on done: 6707.0 [2024-08-05 22:20:32,024][52658] Sum rewards: 7.267, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.297', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.020', 'AMMO4': '0.053', 'weapon4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.270', 'weapon3': '2.210', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:32,441][52650] Updated weights for policy 0, policy_version 6891 (0.0016) [2024-08-05 22:20:32,619][52659] DAMAGECOUNT value on done: 4911.0 [2024-08-05 22:20:32,622][52659] Sum rewards: 3.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.584', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.158', 'HITCOUNT': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.226', 'DAMAGECOUNT': '1.707', 'weapon3': '1.722', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16657.1, 300 sec: 16800.6). Total num frames: 56451072. Throughput: 0: 4201.8. Samples: 14113420. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:20:32,794][52567] Avg episode reward: [(0, '5.401')] [2024-08-05 22:20:33,972][52649] DAMAGECOUNT value on done: 5821.0 [2024-08-05 22:20:33,973][52649] Sum rewards: 6.189, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.704', 'weapon5': '0.002', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.472', 'DAMAGECOUNT': '2.100', 'weapon3': '2.196', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:34,606][52664] DAMAGECOUNT value on done: 4872.0 [2024-08-05 22:20:34,607][52664] Sum rewards: 4.173, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.380', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'weapon4': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'ARMOR': '0.472', 'HITCOUNT': '0.670', 'WEAPON3': '0.850', 'weapon2': '1.136', 'DAMAGECOUNT': '2.142', 'weapon3': '2.146', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:34,943][52671] DAMAGECOUNT value on done: 6057.0 [2024-08-05 22:20:34,952][52671] Sum rewards: -1.397, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.668', 'AMMO2': '0.011', 'AMMO4': '0.053', 'ARMOR': '0.056', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.364', 'HITCOUNT': '0.390', 'WEAPON3': '0.600', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.185', 'weapon3': '1.424', 'weapon2': '1.440'} [2024-08-05 22:20:35,182][52658] DAMAGECOUNT value on done: 6171.0 [2024-08-05 22:20:35,182][52658] Sum rewards: 4.614, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.541', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO3': '0.088', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon3': '1.650', 'weapon2': '2.016', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:35,390][52803] DAMAGECOUNT value on done: 6593.0 [2024-08-05 22:20:35,392][52803] Sum rewards: 5.656, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.638', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO3': '0.076', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.302', 'ARMOR': '0.544', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.350', 'weapon3': '1.482', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '3.500'} [2024-08-05 22:20:36,170][52659] DAMAGECOUNT value on done: 5919.0 [2024-08-05 22:20:36,172][52659] Sum rewards: 3.408, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.011', 'ARMOR': '0.048', 'AMMO4': '0.057', 'HEALTH': '0.099', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.236', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.990', 'DAMAGECOUNT': '1.506', 'weapon3': '2.172', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:36,233][52649] DAMAGECOUNT value on done: 5006.0 [2024-08-05 22:20:36,235][52649] Sum rewards: 5.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.806', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'HITCOUNT': '0.760', 'WEAPON3': '0.800', 'weapon2': '1.488', 'weapon3': '1.720', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:37,263][52650] Updated weights for policy 0, policy_version 6901 (0.0037) [2024-08-05 22:20:37,748][52671] DAMAGECOUNT value on done: 7860.0 [2024-08-05 22:20:37,748][52671] Sum rewards: 8.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.334', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.163', 'weapon4': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.444', 'HITCOUNT': '0.900', 'weapon2': '1.054', 'WEAPON3': '1.100', 'weapon3': '2.566', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '10.000'} [2024-08-05 22:20:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 56541184. Throughput: 0: 4207.1. Samples: 14138780. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:20:37,795][52567] Avg episode reward: [(0, '5.388')] [2024-08-05 22:20:38,029][52664] DAMAGECOUNT value on done: 6399.0 [2024-08-05 22:20:38,029][52664] Sum rewards: 1.786, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.732', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.234', 'HITCOUNT': '0.840', 'ARMOR': '0.901', 'weapon2': '1.066', 'WEAPON3': '1.200', 'weapon3': '2.170', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:38,321][52658] DAMAGECOUNT value on done: 5852.0 [2024-08-05 22:20:38,321][52658] Sum rewards: 9.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.558', 'AMMO2': '0.025', 'ARMOR': '0.084', 'AMMO4': '0.123', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.258', 'weapon2': '0.646', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon3': '2.144', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '9.000'} [2024-08-05 22:20:38,601][52803] DAMAGECOUNT value on done: 6816.0 [2024-08-05 22:20:38,603][52803] Sum rewards: 7.732, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'HEALTH': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.252', 'ARMOR': '0.452', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon2': '1.372', 'weapon3': '1.592', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:38,799][52659] DAMAGECOUNT value on done: 6855.0 [2024-08-05 22:20:38,799][52659] Sum rewards: 8.761, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.427', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.220', 'ARMOR': '0.508', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.498', 'weapon3': '1.526', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:39,417][52668] DAMAGECOUNT value on done: 6019.0 [2024-08-05 22:20:39,418][52668] Sum rewards: 5.244, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.550', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.182', 'ARMOR': '0.492', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon3': '1.308', 'weapon2': '1.730', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:39,569][52649] DAMAGECOUNT value on done: 6354.0 [2024-08-05 22:20:39,572][52649] Sum rewards: 4.314, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.012', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'ARMOR': '0.888', 'weapon2': '1.316', 'weapon3': '1.972', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:40,259][52671] DAMAGECOUNT value on done: 6820.0 [2024-08-05 22:20:40,267][52671] Sum rewards: 3.525, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.432', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.094', 'ARMOR': '1.429', 'DAMAGECOUNT': '2.064', 'weapon3': '2.072', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:41,144][52811] DAMAGECOUNT value on done: 6281.0 [2024-08-05 22:20:41,145][52811] Sum rewards: 6.984, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.340', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.073', 'ARMOR': '0.420', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.272', 'weapon3': '1.550', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:41,249][52664] DAMAGECOUNT value on done: 5448.0 [2024-08-05 22:20:41,251][52664] Sum rewards: 3.886, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.275', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.103', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.020', 'weapon3': '1.804', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:41,611][52658] DAMAGECOUNT value on done: 5542.0 [2024-08-05 22:20:41,613][52658] Sum rewards: 7.168, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.352', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'ARMOR': '0.470', 'HITCOUNT': '0.560', 'weapon2': '1.380', 'weapon3': '1.392', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:41,676][52659] DAMAGECOUNT value on done: 6600.0 [2024-08-05 22:20:41,676][52659] Sum rewards: 0.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.922', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.028', 'ARMOR': '0.056', 'weapon4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'HITCOUNT': '0.760', 'weapon2': '0.834', 'WEAPON3': '1.400', 'weapon3': '2.738', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:41,871][52803] DAMAGECOUNT value on done: 5936.0 [2024-08-05 22:20:41,873][52803] Sum rewards: 0.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.886', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.032', 'weapon5': '0.036', 'weapon7': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.278', 'HITCOUNT': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.026', 'DAMAGECOUNT': '1.545', 'weapon3': '1.668', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:42,077][52650] Updated weights for policy 0, policy_version 6911 (0.0033) [2024-08-05 22:20:42,262][52668] DAMAGECOUNT value on done: 6515.0 [2024-08-05 22:20:42,262][52668] Sum rewards: 9.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.341', 'AMMO2': '0.002', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.116', 'weapon4': '0.170', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.634', 'weapon3': '1.800', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '9.000'} [2024-08-05 22:20:42,444][52649] DAMAGECOUNT value on done: 5874.0 [2024-08-05 22:20:42,446][52649] Sum rewards: 4.470, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.550', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO3': '0.132', 'ARMOR': '0.466', 'HITCOUNT': '0.740', 'WEAPON3': '0.850', 'weapon3': '1.498', 'weapon2': '1.730', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 56614912. Throughput: 0: 4216.9. Samples: 14164380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:20:42,794][52567] Avg episode reward: [(0, '5.463')] [2024-08-05 22:20:43,106][52671] DAMAGECOUNT value on done: 5777.0 [2024-08-05 22:20:43,107][52671] Sum rewards: 8.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.873', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'weapon4': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'HITCOUNT': '0.920', 'WEAPON3': '1.000', 'weapon2': '1.332', 'weapon3': '2.308', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '9.000'} [2024-08-05 22:20:44,247][52664] DAMAGECOUNT value on done: 5700.0 [2024-08-05 22:20:44,249][52664] Sum rewards: 4.239, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.462', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.448', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon2': '1.114', 'weapon3': '1.772', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:44,328][52659] DAMAGECOUNT value on done: 6269.0 [2024-08-05 22:20:44,329][52659] Sum rewards: 6.733, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.034', 'weapon4': '0.004', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.091', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '1.574', 'weapon3': '1.760', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:44,349][52811] DAMAGECOUNT value on done: 6227.0 [2024-08-05 22:20:44,350][52811] Sum rewards: 10.296, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.046', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.202', 'ARMOR': '0.491', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon2': '1.334', 'weapon3': '1.380', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:44,661][52660] DAMAGECOUNT value on done: 6216.0 [2024-08-05 22:20:44,663][52660] Sum rewards: 7.626, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.092', 'HEALTH': '0.152', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'ARMOR': '0.923', 'weapon2': '1.482', 'weapon3': '1.820', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:44,778][52658] DAMAGECOUNT value on done: 6556.0 [2024-08-05 22:20:44,779][52658] Sum rewards: 8.256, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.521', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.074', 'ARMOR': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.310', 'weapon3': '2.386', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:45,173][52668] DAMAGECOUNT value on done: 4961.0 [2024-08-05 22:20:45,174][52668] Sum rewards: 6.035, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'HEALTH': '0.138', 'weapon7': '0.166', 'weapon4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON3': '0.300', 'WEAPON7': '0.300', 'HITCOUNT': '0.330', 'weapon3': '0.934', 'DAMAGECOUNT': '1.053', 'weapon2': '1.240', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:45,198][52803] DAMAGECOUNT value on done: 6562.0 [2024-08-05 22:20:45,202][52803] Sum rewards: 11.006, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.185', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.078', 'ARMOR': '0.080', 'WEAPON4': '0.200', 'weapon5': '0.352', 'WEAPON3': '0.500', 'weapon4': '0.542', 'HITCOUNT': '0.670', 'weapon2': '0.860', 'weapon3': '1.552', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:45,417][52649] DAMAGECOUNT value on done: 6309.0 [2024-08-05 22:20:45,417][52649] Sum rewards: 0.625, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.082', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'ARMOR': '0.452', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.456', 'weapon2': '1.824', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.058'} [2024-08-05 22:20:45,811][52671] DAMAGECOUNT value on done: 6073.0 [2024-08-05 22:20:45,811][52671] Sum rewards: 2.651, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.068', 'ARMOR': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'weapon4': '0.432', 'WEAPON3': '0.450', 'FRAGCOUNT': '1.000', 'weapon2': '1.034', 'DAMAGECOUNT': '1.224', 'weapon3': '1.236'} [2024-08-05 22:20:46,986][52650] Updated weights for policy 0, policy_version 6921 (0.0028) [2024-08-05 22:20:47,132][52659] DAMAGECOUNT value on done: 6317.0 [2024-08-05 22:20:47,133][52659] Sum rewards: 3.694, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.975', 'AMMO2': '0.008', 'AMMO4': '0.041', 'ARMOR': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.186', 'HITCOUNT': '0.790', 'WEAPON3': '0.950', 'weapon2': '1.292', 'weapon3': '2.262', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:47,144][52660] DAMAGECOUNT value on done: 7607.0 [2024-08-05 22:20:47,146][52660] Sum rewards: 5.030, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.189', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.196', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'weapon2': '1.348', 'weapon3': '1.786', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:47,366][52664] DAMAGECOUNT value on done: 5432.0 [2024-08-05 22:20:47,368][52664] Sum rewards: 2.480, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.895', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.218', 'HITCOUNT': '0.400', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.314', 'weapon2': '1.396', 'ARMOR': '1.425', 'weapon3': '1.736', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:47,579][52811] DAMAGECOUNT value on done: 5641.0 [2024-08-05 22:20:47,582][52811] Sum rewards: 8.782, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.262', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.062', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon3': '1.272', 'weapon2': '1.626', 'ARMOR': '1.728', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 56705024. Throughput: 0: 4210.9. Samples: 14176800. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:20:47,795][52567] Avg episode reward: [(0, '5.553')] [2024-08-05 22:20:47,876][52614] Saving new best policy, reward=5.553! [2024-08-05 22:20:47,994][52668] DAMAGECOUNT value on done: 5383.0 [2024-08-05 22:20:47,996][52668] Sum rewards: 4.756, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.423', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.472', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'weapon2': '0.872', 'weapon3': '1.526', 'DAMAGECOUNT': '1.605', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:48,498][52803] DAMAGECOUNT value on done: 6462.0 [2024-08-05 22:20:48,499][52803] Sum rewards: 5.251, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.015', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.074', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'weapon2': '1.102', 'DAMAGECOUNT': '1.197', 'ARMOR': '1.200', 'weapon3': '1.250', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:48,857][52671] DAMAGECOUNT value on done: 5571.0 [2024-08-05 22:20:48,860][52671] Sum rewards: 4.836, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.780', 'ARMOR': '0.893', 'WEAPON3': '0.950', 'weapon2': '1.324', 'weapon3': '1.896', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:49,954][52659] DAMAGECOUNT value on done: 7036.0 [2024-08-05 22:20:49,954][52659] Sum rewards: 7.063, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.663', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'ARMOR': '0.850', 'weapon3': '1.348', 'DAMAGECOUNT': '1.476', 'weapon2': '1.650', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:50,408][52664] DAMAGECOUNT value on done: 5376.0 [2024-08-05 22:20:50,409][52664] Sum rewards: 1.279, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.055', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.016', 'ARMOR': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.178', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.342', 'weapon3': '1.524', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:50,641][52660] DAMAGECOUNT value on done: 5561.0 [2024-08-05 22:20:50,642][52660] Sum rewards: 2.346, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.098', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.048', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.246', 'WEAPON5': '0.300', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'ARMOR': '0.901', 'weapon2': '1.400', 'weapon3': '1.734', 'DAMAGECOUNT': '1.884', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:50,969][52811] DAMAGECOUNT value on done: 5809.0 [2024-08-05 22:20:50,971][52811] Sum rewards: 5.581, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.626', 'AMMO2': '0.008', 'weapon4': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.296', 'DAMAGECOUNT': '2.058', 'weapon3': '2.174', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:51,416][52668] DAMAGECOUNT value on done: 5742.0 [2024-08-05 22:20:51,417][52668] Sum rewards: 5.417, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.674', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.108', 'HITCOUNT': '0.370', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'weapon2': '1.338', 'weapon3': '1.420', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:51,694][52803] DAMAGECOUNT value on done: 5503.0 [2024-08-05 22:20:51,695][52803] Sum rewards: 0.678, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.336', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'ARMOR': '0.930', 'weapon2': '1.282', 'DAMAGECOUNT': '1.803', 'weapon3': '1.918', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:51,702][52650] Updated weights for policy 0, policy_version 6931 (0.0013) [2024-08-05 22:20:52,137][52671] DAMAGECOUNT value on done: 5620.0 [2024-08-05 22:20:52,139][52671] Sum rewards: 7.395, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.020', 'weapon7': '0.054', 'AMMO3': '0.075', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'HEALTH': '0.190', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.468', 'weapon3': '1.446', 'weapon2': '1.606', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 56795136. Throughput: 0: 4209.8. Samples: 14201840. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:20:52,794][52567] Avg episode reward: [(0, '5.527')] [2024-08-05 22:20:53,174][52664] DAMAGECOUNT value on done: 6448.0 [2024-08-05 22:20:53,174][52664] Sum rewards: 4.397, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.980', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.085', 'ARMOR': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.226', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'weapon2': '0.838', 'weapon3': '1.162', 'DAMAGECOUNT': '1.245', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:53,239][52659] DAMAGECOUNT value on done: 6177.0 [2024-08-05 22:20:53,240][52659] Sum rewards: -1.568, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.344', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.072', 'HITCOUNT': '0.170', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.600', 'FRAGCOUNT': '1.000', 'weapon3': '1.260', 'weapon2': '1.454'} [2024-08-05 22:20:53,542][52795] DAMAGECOUNT value on done: 5059.0 [2024-08-05 22:20:53,542][52795] Sum rewards: 6.092, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.140', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'AMMO3': '0.117', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '1.538', 'weapon3': '2.080', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:53,822][52660] DAMAGECOUNT value on done: 5581.0 [2024-08-05 22:20:53,824][52660] Sum rewards: 5.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.246', 'HITCOUNT': '0.750', 'WEAPON3': '1.000', 'ARMOR': '1.349', 'weapon3': '1.752', 'weapon2': '1.774', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:54,159][52811] DAMAGECOUNT value on done: 6576.0 [2024-08-05 22:20:54,164][52811] Sum rewards: 4.871, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.552', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon4': '0.038', 'weapon5': '0.042', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'ARMOR': '1.303', 'weapon3': '1.362', 'weapon2': '1.698', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:54,434][52668] DAMAGECOUNT value on done: 6264.0 [2024-08-05 22:20:54,435][52668] Sum rewards: 12.013, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'ARMOR': '0.071', 'AMMO3': '0.085', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.554', 'HITCOUNT': '0.660', 'weapon2': '1.194', 'weapon3': '1.292', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '9.000'} [2024-08-05 22:20:54,645][52671] DAMAGECOUNT value on done: 6582.0 [2024-08-05 22:20:54,647][52671] Sum rewards: 0.314, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.005', 'AMMO2': '0.019', 'ARMOR': '0.064', 'AMMO4': '0.097', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.310', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.086', 'DAMAGECOUNT': '1.254', 'weapon3': '1.780', 'FRAGCOUNT': '2.000'} [2024-08-05 22:20:55,017][52803] DAMAGECOUNT value on done: 6760.0 [2024-08-05 22:20:55,019][52803] Sum rewards: 6.966, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.288', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'ARMOR': '0.872', 'weapon2': '1.408', 'weapon3': '1.854', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '8.000'} [2024-08-05 22:20:55,680][52659] DAMAGECOUNT value on done: 6299.0 [2024-08-05 22:20:55,680][52659] Sum rewards: 6.391, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.874', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.065', 'WEAPON4': '0.150', 'weapon4': '0.416', 'WEAPON3': '0.500', 'ARMOR': '0.505', 'HITCOUNT': '0.510', 'weapon2': '0.806', 'weapon3': '1.256', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:56,608][52650] Updated weights for policy 0, policy_version 6941 (0.0038) [2024-08-05 22:20:56,848][52660] DAMAGECOUNT value on done: 5154.0 [2024-08-05 22:20:56,850][52660] Sum rewards: 9.824, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.020', 'weapon4': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'HEALTH': '0.328', 'ARMOR': '0.463', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.524', 'weapon3': '1.682', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '9.000'} [2024-08-05 22:20:56,876][52795] DAMAGECOUNT value on done: 6028.0 [2024-08-05 22:20:56,879][52795] Sum rewards: 3.581, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.638', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.200', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '1.001', 'weapon2': '1.708', 'weapon3': '1.746', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '6.000'} [2024-08-05 22:20:57,508][52811] DAMAGECOUNT value on done: 5489.0 [2024-08-05 22:20:57,510][52811] Sum rewards: 3.216, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.390', 'AMMO2': '0.008', 'AMMO4': '0.037', 'ARMOR': '0.052', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.206', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon2': '1.012', 'DAMAGECOUNT': '1.356', 'weapon3': '1.954', 'FRAGCOUNT': '3.000'} [2024-08-05 22:20:57,614][52668] DAMAGECOUNT value on done: 7250.0 [2024-08-05 22:20:57,636][52671] DAMAGECOUNT value on done: 5782.0 [2024-08-05 22:20:57,639][52671] Sum rewards: 5.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.313', 'AMMO2': '0.023', 'ARMOR': '0.060', 'AMMO4': '0.116', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.360', 'HITCOUNT': '0.750', 'WEAPON3': '0.900', 'weapon2': '0.922', 'weapon3': '2.000', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '7.000'} [2024-08-05 22:20:57,795][52567] Fps is (10 sec: 17202.5, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 56877056. Throughput: 0: 4214.0. Samples: 14227070. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 22:20:57,795][52567] Avg episode reward: [(0, '5.326')] [2024-08-05 22:20:58,219][52803] DAMAGECOUNT value on done: 5918.0 [2024-08-05 22:20:58,219][52803] Sum rewards: 5.287, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.710', 'AMMO2': '0.006', 'ARMOR': '0.020', 'AMMO4': '0.027', 'weapon4': '0.044', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'weapon3': '1.306', 'DAMAGECOUNT': '1.608', 'weapon2': '1.696', 'FRAGCOUNT': '4.000'} [2024-08-05 22:20:58,690][52659] DAMAGECOUNT value on done: 5261.0 [2024-08-05 22:20:58,694][52659] Sum rewards: 7.028, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.703', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.166', 'ARMOR': '0.534', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon3': '1.530', 'weapon2': '1.638', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '5.000'} [2024-08-05 22:20:59,558][52660] DAMAGECOUNT value on done: 6484.0 [2024-08-05 22:20:59,558][52660] Sum rewards: 2.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.029', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.168', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon2': '1.152', 'weapon3': '1.166', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:00,114][52795] DAMAGECOUNT value on done: 5714.0 [2024-08-05 22:21:00,115][52795] Sum rewards: 10.177, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.293', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.090', 'ARMOR': '0.412', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.512', 'weapon3': '2.072', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '9.000'} [2024-08-05 22:21:00,178][52671] DAMAGECOUNT value on done: 5836.0 [2024-08-05 22:21:00,178][52671] Sum rewards: 6.863, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.263', 'AMMO2': '0.019', 'AMMO3': '0.054', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON3': '0.350', 'weapon4': '0.396', 'HITCOUNT': '0.500', 'ARMOR': '0.513', 'weapon2': '1.012', 'weapon3': '1.104', 'DAMAGECOUNT': '1.734', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:00,202][52668] DAMAGECOUNT value on done: 5149.0 [2024-08-05 22:21:00,203][52668] Sum rewards: 3.341, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.579', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'ARMOR': '0.028', 'AMMO3': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.162', 'HITCOUNT': '0.340', 'WEAPON3': '0.350', 'weapon3': '0.874', 'weapon2': '1.060', 'DAMAGECOUNT': '1.131', 'FRAGCOUNT': '2.000'} [2024-08-05 22:21:00,566][52811] DAMAGECOUNT value on done: 6618.0 [2024-08-05 22:21:00,566][52811] Sum rewards: 3.924, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.356', 'AMMO2': '0.023', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.190', 'ARMOR': '0.531', 'HITCOUNT': '0.660', 'WEAPON3': '0.950', 'weapon2': '1.094', 'weapon3': '2.114', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:01,326][52659] DAMAGECOUNT value on done: 6165.0 [2024-08-05 22:21:01,326][52659] Sum rewards: 10.702, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.123', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.080', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'ARMOR': '1.331', 'weapon2': '1.628', 'weapon3': '1.730', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '9.000'} [2024-08-05 22:21:01,490][52803] DAMAGECOUNT value on done: 5101.0 [2024-08-05 22:21:01,490][52803] Sum rewards: 3.123, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.587', 'AMMO2': '0.014', 'AMMO3': '0.064', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.210', 'HITCOUNT': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.535', 'DAMAGECOUNT': '0.999', 'weapon2': '1.242', 'weapon3': '1.374', 'FRAGCOUNT': '2.000'} [2024-08-05 22:21:01,598][52650] Updated weights for policy 0, policy_version 6951 (0.0020) [2024-08-05 22:21:02,493][52660] DAMAGECOUNT value on done: 5777.0 [2024-08-05 22:21:02,495][52660] Sum rewards: 4.538, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.184', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.212', 'ARMOR': '0.460', 'HITCOUNT': '0.690', 'weapon2': '0.924', 'WEAPON3': '1.150', 'DAMAGECOUNT': '2.490', 'weapon3': '2.718', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 56958976. Throughput: 0: 4219.3. Samples: 14239910. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:21:02,794][52567] Avg episode reward: [(0, '5.414')] [2024-08-05 22:21:03,304][52668] DAMAGECOUNT value on done: 6383.0 [2024-08-05 22:21:03,313][52668] Sum rewards: 8.649, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.686', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.232', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'ARMOR': '0.930', 'weapon2': '1.514', 'weapon3': '1.890', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:03,429][52795] DAMAGECOUNT value on done: 6988.0 [2024-08-05 22:21:03,430][52795] Sum rewards: 5.530, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.220', 'AMMO2': '0.021', 'AMMO3': '0.095', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.436', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '0.897', 'weapon3': '1.134', 'weapon2': '1.316', 'DAMAGECOUNT': '1.806', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:03,714][52811] DAMAGECOUNT value on done: 4269.0 [2024-08-05 22:21:03,714][52811] Sum rewards: 5.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.502', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'weapon4': '0.206', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'ARMOR': '1.024', 'weapon2': '1.640', 'weapon3': '1.650', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:04,360][52659] DAMAGECOUNT value on done: 4847.0 [2024-08-05 22:21:04,361][52659] Sum rewards: 7.823, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.005', 'HEALTH': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.027', 'AMMO3': '0.050', 'WEAPON3': '0.350', 'HITCOUNT': '0.450', 'weapon2': '1.186', 'weapon3': '1.190', 'DAMAGECOUNT': '1.521', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:05,125][52803] DAMAGECOUNT value on done: 5904.0 [2024-08-05 22:21:05,127][52803] Sum rewards: 4.747, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.101', 'AMMO2': '0.010', 'AMMO4': '0.047', 'ARMOR': '0.072', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.326', 'HITCOUNT': '0.840', 'WEAPON3': '1.050', 'weapon2': '1.088', 'weapon3': '2.322', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:05,535][52660] DAMAGECOUNT value on done: 5953.0 [2024-08-05 22:21:05,536][52660] Sum rewards: 6.676, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.116', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.258', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'ARMOR': '0.938', 'weapon2': '1.494', 'weapon3': '1.802', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:06,161][52668] DAMAGECOUNT value on done: 7173.0 [2024-08-05 22:21:06,162][52668] Sum rewards: 3.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.514', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO4': '0.017', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.204', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.296', 'ARMOR': '1.302', 'weapon3': '1.654', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:06,359][52650] Updated weights for policy 0, policy_version 6961 (0.0016) [2024-08-05 22:21:06,806][52795] DAMAGECOUNT value on done: 6181.0 [2024-08-05 22:21:06,807][52795] Sum rewards: 6.634, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.846', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.034', 'AMMO3': '0.111', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'ARMOR': '0.512', 'weapon4': '0.612', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.090', 'weapon3': '1.948', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:06,990][52811] DAMAGECOUNT value on done: 4911.0 [2024-08-05 22:21:06,991][52811] Sum rewards: 6.356, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.490', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.208', 'ARMOR': '0.477', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.286', 'weapon3': '1.416', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:07,478][52659] DAMAGECOUNT value on done: 6176.0 [2024-08-05 22:21:07,479][52659] Sum rewards: 8.456, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon4': '0.218', 'HEALTH': '0.312', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.316', 'weapon3': '1.748', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:07,794][52567] Fps is (10 sec: 17203.9, 60 sec: 16930.3, 300 sec: 16828.3). Total num frames: 57049088. Throughput: 0: 4218.5. Samples: 14265390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:21:07,794][52567] Avg episode reward: [(0, '5.544')] [2024-08-05 22:21:08,326][52803] DAMAGECOUNT value on done: 5191.0 [2024-08-05 22:21:08,334][52803] Sum rewards: 2.663, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.080', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.050', 'weapon5': '0.054', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.360', 'weapon4': '0.424', 'ARMOR': '0.495', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.011', 'weapon2': '1.192', 'weapon3': '1.264'} [2024-08-05 22:21:08,344][52660] DAMAGECOUNT value on done: 5965.0 [2024-08-05 22:21:08,345][52660] Sum rewards: 1.907, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.644', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.110', 'ARMOR': '0.400', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.456', 'DAMAGECOUNT': '1.545', 'weapon3': '1.570', 'FRAGCOUNT': '2.000'} [2024-08-05 22:21:09,190][52668] DAMAGECOUNT value on done: 5729.0 [2024-08-05 22:21:09,192][52668] Sum rewards: 6.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.335', 'AMMO2': '0.010', 'weapon4': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'ARMOR': '0.481', 'HITCOUNT': '0.590', 'WEAPON3': '1.000', 'weapon2': '1.270', 'weapon3': '2.106', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '9.000'} [2024-08-05 22:21:10,110][52795] DAMAGECOUNT value on done: 6833.0 [2024-08-05 22:21:10,111][52795] Sum rewards: 6.626, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO3': '0.070', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'ARMOR': '0.492', 'HITCOUNT': '0.590', 'HEALTH': '0.632', 'weapon2': '0.922', 'weapon3': '1.550', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:10,361][52811] DAMAGECOUNT value on done: 5990.0 [2024-08-05 22:21:10,363][52811] Sum rewards: 4.549, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.320', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.178', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.146', 'weapon2': '1.370', 'weapon3': '1.704', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:11,188][52650] Updated weights for policy 0, policy_version 6971 (0.0021) [2024-08-05 22:21:11,479][52803] DAMAGECOUNT value on done: 5789.0 [2024-08-05 22:21:11,480][52803] Sum rewards: 8.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.022', 'AMMO2': '0.012', 'AMMO4': '0.060', 'ARMOR': '0.072', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.404', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.164', 'weapon3': '2.086', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:11,650][52660] DAMAGECOUNT value on done: 4967.0 [2024-08-05 22:21:11,651][52660] Sum rewards: 6.497, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.524', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.065', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '1.314', 'ARMOR': '1.354', 'DAMAGECOUNT': '1.848', 'weapon2': '1.924', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:12,496][52668] DAMAGECOUNT value on done: 6473.0 [2024-08-05 22:21:12,499][52668] Sum rewards: 10.705, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.100', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.115', 'weapon4': '0.158', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.406', 'weapon3': '1.604', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '10.000'} [2024-08-05 22:21:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 57131008. Throughput: 0: 4221.1. Samples: 14290950. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:21:12,794][52567] Avg episode reward: [(0, '5.549')] [2024-08-05 22:21:13,471][52795] DAMAGECOUNT value on done: 5758.0 [2024-08-05 22:21:13,472][52795] Sum rewards: 7.293, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.786', 'AMMO2': '0.009', 'weapon4': '0.046', 'AMMO4': '0.046', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '1.400', 'weapon3': '1.566', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:13,615][52811] DAMAGECOUNT value on done: 6208.0 [2024-08-05 22:21:13,617][52811] Sum rewards: 5.546, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.483', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.104', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.891', 'weapon2': '1.860', 'weapon3': '1.908', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:13,862][52614] Signal inference workers to stop experience collection... (1300 times) [2024-08-05 22:21:13,865][52614] Signal inference workers to resume experience collection... (1300 times) [2024-08-05 22:21:13,949][52650] InferenceWorker_p0-w0: stopping experience collection (1300 times) [2024-08-05 22:21:13,949][52650] InferenceWorker_p0-w0: resuming experience collection (1300 times) [2024-08-05 22:21:14,634][52803] DAMAGECOUNT value on done: 5930.0 [2024-08-05 22:21:14,635][52803] Sum rewards: 6.078, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'HEALTH': '0.098', 'AMMO4': '0.112', 'weapon4': '0.208', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'ARMOR': '1.240', 'weapon3': '1.354', 'weapon2': '1.432', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:14,968][52660] DAMAGECOUNT value on done: 6220.0 [2024-08-05 22:21:14,968][52660] Sum rewards: 7.407, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.523', 'AMMO4': '-0.088', 'AMMO2': '-0.018', 'AMMO3': '0.087', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon3': '1.470', 'weapon2': '1.644', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:15,579][52668] DAMAGECOUNT value on done: 5718.0 [2024-08-05 22:21:15,580][52668] Sum rewards: 2.033, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.948', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.318', 'ARMOR': '0.486', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.206', 'weapon3': '2.164', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:16,097][52650] Updated weights for policy 0, policy_version 6981 (0.0031) [2024-08-05 22:21:16,653][52795] DAMAGECOUNT value on done: 5749.0 [2024-08-05 22:21:16,653][52795] Sum rewards: 2.651, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.230', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.098', 'HITCOUNT': '0.440', 'WEAPON3': '0.600', 'weapon3': '1.508', 'DAMAGECOUNT': '1.578', 'weapon2': '1.658', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:16,767][52811] DAMAGECOUNT value on done: 5589.0 [2024-08-05 22:21:16,767][52811] Sum rewards: 8.331, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.299', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.416', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'ARMOR': '0.892', 'weapon2': '1.500', 'weapon3': '1.662', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:17,720][52660] DAMAGECOUNT value on done: 5571.0 [2024-08-05 22:21:17,720][52660] Sum rewards: 2.050, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.284', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.070', 'ARMOR': '0.107', 'WEAPON4': '0.150', 'HITCOUNT': '0.170', 'WEAPON3': '0.450', 'weapon4': '0.462', 'DAMAGECOUNT': '0.546', 'weapon2': '0.938', 'weapon3': '1.132', 'FRAGCOUNT': '2.000'} [2024-08-05 22:21:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16828.3). Total num frames: 57221120. Throughput: 0: 4232.0. Samples: 14303860. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:21:17,794][52567] Avg episode reward: [(0, '5.401')] [2024-08-05 22:21:18,007][52803] DAMAGECOUNT value on done: 6233.0 [2024-08-05 22:21:18,007][52803] Sum rewards: 3.728, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.254', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.014', 'weapon4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.098', 'ARMOR': '0.444', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.782', 'weapon3': '1.908', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:18,267][52668] DAMAGECOUNT value on done: 6417.0 [2024-08-05 22:21:18,267][52668] Sum rewards: 3.459, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.272', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO3': '0.090', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'ARMOR': '0.959', 'weapon2': '1.342', 'DAMAGECOUNT': '1.515', 'weapon3': '1.762', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:19,948][52795] DAMAGECOUNT value on done: 6312.0 [2024-08-05 22:21:19,948][52795] Sum rewards: 7.827, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.485', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.258', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'ARMOR': '0.886', 'weapon2': '1.314', 'weapon3': '1.916', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:19,997][52811] DAMAGECOUNT value on done: 6017.0 [2024-08-05 22:21:19,998][52811] Sum rewards: 5.859, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.315', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.071', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.150', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.275', 'weapon2': '1.284', 'weapon3': '1.582', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:20,471][52650] Updated weights for policy 0, policy_version 6991 (0.0019) [2024-08-05 22:21:20,475][52660] DAMAGECOUNT value on done: 5408.0 [2024-08-05 22:21:20,477][52660] Sum rewards: 4.597, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.178', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.042', 'ARMOR': '0.048', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.140', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon2': '1.032', 'weapon3': '1.192', 'DAMAGECOUNT': '1.434', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:21,004][52668] DAMAGECOUNT value on done: 6014.0 [2024-08-05 22:21:21,004][52668] Sum rewards: 8.838, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.340', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.010', 'ARMOR': '0.056', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.174', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.336', 'weapon3': '1.646', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:21,202][52803] DAMAGECOUNT value on done: 5879.0 [2024-08-05 22:21:21,203][52803] Sum rewards: 9.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.492', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'ARMOR': '1.277', 'weapon2': '1.594', 'weapon3': '1.804', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:21,984][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:21:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 57303040. Throughput: 0: 4234.2. Samples: 14329320. Policy #0 lag: (min: 0.0, avg: 3.4, max: 10.0) [2024-08-05 22:21:22,794][52567] Avg episode reward: [(0, '5.527')] [2024-08-05 22:21:22,976][52660] DAMAGECOUNT value on done: 6090.0 [2024-08-05 22:21:22,977][52660] Sum rewards: 1.611, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.652', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'HITCOUNT': '0.300', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.155', 'weapon2': '1.184', 'weapon3': '1.684', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:23,201][52795] DAMAGECOUNT value on done: 6243.0 [2024-08-05 22:21:23,201][52795] Sum rewards: 11.808, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.424', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.104', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'weapon2': '1.548', 'weapon3': '2.074', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '10.000'} [2024-08-05 22:21:23,319][52811] DAMAGECOUNT value on done: 5684.0 [2024-08-05 22:21:23,319][52811] Sum rewards: 7.654, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.656', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.398', 'weapon2': '0.848', 'WEAPON3': '0.900', 'ARMOR': '1.019', 'HITCOUNT': '1.030', 'weapon3': '1.944', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:23,641][52668] DAMAGECOUNT value on done: 5645.0 [2024-08-05 22:21:23,642][52668] Sum rewards: 2.616, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.491', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.032', 'weapon5': '0.038', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.987', 'weapon2': '1.418', 'weapon3': '1.446', 'FRAGCOUNT': '2.000'} [2024-08-05 22:21:24,519][52803] DAMAGECOUNT value on done: 5139.0 [2024-08-05 22:21:24,519][52803] Sum rewards: 8.653, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.102', 'HEALTH': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'ARMOR': '0.510', 'weapon4': '0.602', 'HITCOUNT': '0.620', 'weapon2': '1.214', 'weapon3': '1.520', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:25,555][52660] DAMAGECOUNT value on done: 6214.0 [2024-08-05 22:21:25,557][52660] Sum rewards: 2.824, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.402', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.230', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'ARMOR': '0.924', 'weapon2': '1.096', 'weapon3': '1.644', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:25,785][52650] Updated weights for policy 0, policy_version 7001 (0.0017) [2024-08-05 22:21:26,324][52795] DAMAGECOUNT value on done: 5208.0 [2024-08-05 22:21:26,324][52795] Sum rewards: 7.511, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.730', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'weapon4': '0.056', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'ARMOR': '0.484', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.302', 'weapon3': '1.690', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:26,387][52668] DAMAGECOUNT value on done: 6353.0 [2024-08-05 22:21:26,390][52668] Sum rewards: 8.891, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.608', 'AMMO2': '0.024', 'ARMOR': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.120', 'WEAPON4': '0.350', 'weapon4': '0.452', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '0.866', 'weapon3': '2.202', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:26,493][52811] DAMAGECOUNT value on done: 5993.0 [2024-08-05 22:21:26,505][52811] Sum rewards: 4.365, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.221', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO5': '0.007', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'weapon5': '0.210', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'ARMOR': '1.419', 'weapon3': '1.450', 'weapon2': '1.580', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 57384960. Throughput: 0: 4235.6. Samples: 14354980. Policy #0 lag: (min: 0.0, avg: 3.4, max: 10.0) [2024-08-05 22:21:27,794][52567] Avg episode reward: [(0, '5.536')] [2024-08-05 22:21:27,817][52803] DAMAGECOUNT value on done: 5693.0 [2024-08-05 22:21:27,818][52803] Sum rewards: 7.867, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.233', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.128', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'ARMOR': '0.929', 'weapon2': '1.700', 'weapon3': '1.974', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:28,600][52660] DAMAGECOUNT value on done: 6016.0 [2024-08-05 22:21:28,601][52660] Sum rewards: 6.893, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.320', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.224', 'WEAPON3': '0.450', 'ARMOR': '0.496', 'HITCOUNT': '0.790', 'weapon2': '1.430', 'weapon3': '1.454', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:29,527][52668] DAMAGECOUNT value on done: 6821.0 [2024-08-05 22:21:29,528][52668] Sum rewards: 5.480, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.153', 'AMMO2': '0.012', 'weapon7': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.218', 'HITCOUNT': '0.410', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.515', 'weapon3': '1.662', 'weapon2': '1.664', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:29,534][52795] DAMAGECOUNT value on done: 5652.0 [2024-08-05 22:21:29,535][52795] Sum rewards: 6.534, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.306', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.020', 'ARMOR': '0.076', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon2': '1.588', 'weapon3': '1.906', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:29,758][52811] DAMAGECOUNT value on done: 5204.0 [2024-08-05 22:21:29,759][52811] Sum rewards: 9.053, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.020', 'weapon4': '0.026', 'ARMOR': '0.040', 'AMMO3': '0.064', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.393', 'WEAPON3': '0.400', 'HITCOUNT': '0.570', 'weapon2': '1.278', 'weapon3': '1.324', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:30,138][52650] Updated weights for policy 0, policy_version 7011 (0.0022) [2024-08-05 22:21:31,119][52803] DAMAGECOUNT value on done: 5198.0 [2024-08-05 22:21:31,121][52803] Sum rewards: 3.687, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.964', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'weapon4': '0.204', 'HITCOUNT': '0.590', 'WEAPON3': '0.800', 'ARMOR': '0.924', 'weapon2': '1.248', 'DAMAGECOUNT': '1.818', 'weapon3': '2.118', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:31,672][52660] DAMAGECOUNT value on done: 5973.0 [2024-08-05 22:21:31,674][52660] Sum rewards: 0.236, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.190', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'HITCOUNT': '0.290', 'WEAPON3': '0.600', 'ARMOR': '0.938', 'DAMAGECOUNT': '1.047', 'weapon3': '1.392', 'weapon2': '1.620', 'FRAGCOUNT': '2.000'} [2024-08-05 22:21:32,614][52668] DAMAGECOUNT value on done: 5749.0 [2024-08-05 22:21:32,614][52668] Sum rewards: 4.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.854', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.061', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.396', 'ARMOR': '1.403', 'weapon2': '1.658', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 57475072. Throughput: 0: 4240.2. Samples: 14367610. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:21:32,794][52567] Avg episode reward: [(0, '5.665')] [2024-08-05 22:21:32,795][52614] Saving new best policy, reward=5.665! [2024-08-05 22:21:32,864][52795] DAMAGECOUNT value on done: 5568.0 [2024-08-05 22:21:32,864][52795] Sum rewards: 6.717, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.168', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.282', 'weapon3': '1.372', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:32,930][52811] DAMAGECOUNT value on done: 5744.0 [2024-08-05 22:21:32,933][52811] Sum rewards: 4.835, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.244', 'AMMO4': '-0.083', 'AMMO2': '-0.016', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO3': '0.084', 'weapon5': '0.096', 'WEAPON5': '0.100', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'weapon2': '1.316', 'DAMAGECOUNT': '1.746', 'weapon3': '1.818', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:34,333][52803] DAMAGECOUNT value on done: 6213.0 [2024-08-05 22:21:34,337][52803] Sum rewards: 5.344, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.202', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.073', 'HITCOUNT': '0.390', 'ARMOR': '0.481', 'WEAPON3': '0.550', 'weapon3': '1.142', 'weapon2': '1.350', 'DAMAGECOUNT': '1.353', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:34,346][52660] DAMAGECOUNT value on done: 6147.0 [2024-08-05 22:21:34,347][52660] Sum rewards: 8.016, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'HEALTH': '0.228', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'ARMOR': '0.905', 'weapon2': '1.434', 'weapon3': '1.676', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:34,982][52668] DAMAGECOUNT value on done: 5538.0 [2024-08-05 22:21:34,983][52668] Sum rewards: 7.915, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.174', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.114', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon3': '1.466', 'ARMOR': '1.502', 'weapon2': '1.582', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:35,445][52650] Updated weights for policy 0, policy_version 7021 (0.0012) [2024-08-05 22:21:36,281][52795] DAMAGECOUNT value on done: 6102.0 [2024-08-05 22:21:36,281][52795] Sum rewards: 5.213, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.614', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.104', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '1.325', 'weapon3': '1.442', 'DAMAGECOUNT': '1.692', 'weapon2': '1.746', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:36,339][52811] DAMAGECOUNT value on done: 4565.0 [2024-08-05 22:21:36,340][52811] Sum rewards: 5.202, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'HEALTH': '0.107', 'WEAPON3': '0.450', 'ARMOR': '0.491', 'HITCOUNT': '0.570', 'weapon2': '1.500', 'weapon3': '1.664', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '3.000'} [2024-08-05 22:21:37,251][52660] DAMAGECOUNT value on done: 5643.0 [2024-08-05 22:21:37,255][52660] Sum rewards: 6.861, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.544', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.120', 'weapon4': '0.162', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'ARMOR': '0.909', 'weapon2': '1.500', 'weapon3': '1.516', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:37,430][52803] DAMAGECOUNT value on done: 6046.0 [2024-08-05 22:21:37,431][52803] Sum rewards: 6.067, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.525', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'HITCOUNT': '0.770', 'ARMOR': '0.932', 'WEAPON3': '1.000', 'weapon2': '1.312', 'weapon3': '2.282', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 57556992. Throughput: 0: 4242.9. Samples: 14392770. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:21:37,794][52567] Avg episode reward: [(0, '5.571')] [2024-08-05 22:21:39,177][52820] DAMAGECOUNT value on done: 5009.0 [2024-08-05 22:21:39,178][52820] Sum rewards: 6.027, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.300', 'ARMOR': '0.556', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.352', 'weapon3': '1.922', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:39,523][52795] DAMAGECOUNT value on done: 5873.0 [2024-08-05 22:21:39,524][52795] Sum rewards: 7.004, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.812', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.167', 'HITCOUNT': '0.790', 'ARMOR': '1.014', 'WEAPON3': '1.100', 'weapon2': '1.640', 'weapon3': '1.882', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:39,579][52811] DAMAGECOUNT value on done: 6175.0 [2024-08-05 22:21:39,582][52811] Sum rewards: 7.553, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.305', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'ARMOR': '0.068', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.206', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '0.900', 'weapon3': '1.370', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:39,742][52660] DAMAGECOUNT value on done: 7221.0 [2024-08-05 22:21:39,742][52660] Sum rewards: 4.312, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.628', 'AMMO2': '0.013', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.196', 'ARMOR': '0.467', 'WEAPON3': '0.500', 'HITCOUNT': '0.530', 'weapon2': '1.066', 'weapon3': '1.246', 'DAMAGECOUNT': '1.644', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:40,046][52650] Updated weights for policy 0, policy_version 7031 (0.0028) [2024-08-05 22:21:42,534][52820] DAMAGECOUNT value on done: 6346.0 [2024-08-05 22:21:42,535][52820] Sum rewards: 6.568, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.038', 'HEALTH': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.398', 'ARMOR': '0.472', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '1.446', 'DAMAGECOUNT': '1.665', 'weapon3': '1.708', 'FRAGCOUNT': '4.000'} [2024-08-05 22:21:42,786][52811] DAMAGECOUNT value on done: 6239.0 [2024-08-05 22:21:42,786][52811] Sum rewards: 16.107, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.216', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'weapon4': '0.176', 'WEAPON3': '0.800', 'ARMOR': '0.935', 'HITCOUNT': '1.070', 'weapon2': '1.418', 'weapon3': '2.124', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '14.000'} [2024-08-05 22:21:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 16828.4). Total num frames: 57638912. Throughput: 0: 4256.0. Samples: 14418590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 22:21:42,794][52567] Avg episode reward: [(0, '5.655')] [2024-08-05 22:21:42,861][52795] DAMAGECOUNT value on done: 5942.0 [2024-08-05 22:21:42,862][52795] Sum rewards: 3.313, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.432', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.170', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'ARMOR': '1.282', 'weapon2': '1.478', 'weapon3': '2.114', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'} [2024-08-05 22:21:44,667][52650] Updated weights for policy 0, policy_version 7041 (0.0022) [2024-08-05 22:21:45,869][52820] DAMAGECOUNT value on done: 5826.0 [2024-08-05 22:21:45,871][52820] Sum rewards: 7.183, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.218', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO3': '0.113', 'ARMOR': '0.428', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.684', 'weapon3': '1.808', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:46,143][52795] DAMAGECOUNT value on done: 6545.0 [2024-08-05 22:21:46,144][52795] Sum rewards: 8.941, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.440', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.208', 'ARMOR': '0.469', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon2': '1.540', 'weapon3': '1.748', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16828.3). Total num frames: 57729024. Throughput: 0: 4252.2. Samples: 14431260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:21:47,794][52567] Avg episode reward: [(0, '5.798')] [2024-08-05 22:21:47,797][52614] Saving new best policy, reward=5.798! [2024-08-05 22:21:49,219][52820] DAMAGECOUNT value on done: 7200.0 [2024-08-05 22:21:49,220][52820] Sum rewards: 10.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.624', 'AMMO2': '0.013', 'weapon4': '0.058', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'ARMOR': '1.054', 'weapon2': '1.372', 'weapon3': '2.386', 'DAMAGECOUNT': '3.831', 'FRAGCOUNT': '10.000'} [2024-08-05 22:21:49,530][52795] DAMAGECOUNT value on done: 5801.0 [2024-08-05 22:21:49,538][52795] Sum rewards: 9.523, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.276', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.034', 'AMMO3': '0.106', 'ARMOR': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon4': '0.714', 'HITCOUNT': '0.730', 'weapon2': '0.854', 'weapon3': '1.802', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:49,794][52650] Updated weights for policy 0, policy_version 7051 (0.0013) [2024-08-05 22:21:52,448][52820] DAMAGECOUNT value on done: 5831.0 [2024-08-05 22:21:52,449][52820] Sum rewards: 11.551, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.083', 'weapon4': '0.164', 'HEALTH': '0.222', 'WEAPON3': '0.400', 'ARMOR': '0.436', 'HITCOUNT': '0.650', 'weapon3': '1.402', 'weapon2': '1.512', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '8.000'} [2024-08-05 22:21:52,795][52567] Fps is (10 sec: 16382.9, 60 sec: 16793.4, 300 sec: 16800.5). Total num frames: 57802752. Throughput: 0: 4245.3. Samples: 14456430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:21:52,795][52567] Avg episode reward: [(0, '5.982')] [2024-08-05 22:21:52,808][52614] Saving new best policy, reward=5.982! [2024-08-05 22:21:52,889][52795] DAMAGECOUNT value on done: 5529.0 [2024-08-05 22:21:52,892][52795] Sum rewards: 2.023, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.985', 'AMMO2': '0.021', 'weapon4': '0.086', 'AMMO4': '0.107', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'ARMOR': '0.458', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.378', 'weapon3': '1.650', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.268'} [2024-08-05 22:21:55,192][52650] Updated weights for policy 0, policy_version 7061 (0.0012) [2024-08-05 22:21:55,728][52820] DAMAGECOUNT value on done: 7274.0 [2024-08-05 22:21:55,730][52820] Sum rewards: 3.271, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.430', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.144', 'weapon4': '0.218', 'HITCOUNT': '0.430', 'WEAPON3': '0.600', 'weapon3': '1.248', 'DAMAGECOUNT': '1.548', 'ARMOR': '1.749', 'weapon2': '1.776', 'FRAGCOUNT': '2.000'} [2024-08-05 22:21:56,156][52795] DAMAGECOUNT value on done: 5356.0 [2024-08-05 22:21:56,156][52795] Sum rewards: 4.219, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.076', 'AMMO2': '0.009', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon5': '0.124', 'weapon4': '0.138', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.545', 'HITCOUNT': '0.580', 'WEAPON3': '1.000', 'weapon2': '1.564', 'weapon3': '1.776', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '7.000'} [2024-08-05 22:21:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 57892864. Throughput: 0: 4226.2. Samples: 14481130. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-05 22:21:57,794][52567] Avg episode reward: [(0, '5.943')] [2024-08-05 22:21:59,239][52820] DAMAGECOUNT value on done: 5314.0 [2024-08-05 22:21:59,239][52820] Sum rewards: 6.430, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.231', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.424', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon3': '1.452', 'DAMAGECOUNT': '1.857', 'weapon2': '1.860', 'FRAGCOUNT': '6.000'} [2024-08-05 22:21:59,250][52669] DAMAGECOUNT value on done: 6048.0 [2024-08-05 22:21:59,253][52669] Sum rewards: 9.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.956', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'ARMOR': '0.902', 'weapon2': '1.540', 'weapon3': '1.790', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '9.000'} [2024-08-05 22:21:59,594][52650] Updated weights for policy 0, policy_version 7071 (0.0013) [2024-08-05 22:22:01,941][52669] DAMAGECOUNT value on done: 6443.0 [2024-08-05 22:22:01,941][52669] Sum rewards: 2.662, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.484', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'ARMOR': '0.452', 'HITCOUNT': '0.730', 'weapon2': '1.022', 'WEAPON3': '1.250', 'DAMAGECOUNT': '2.307', 'weapon3': '2.414', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:02,735][52820] DAMAGECOUNT value on done: 6262.0 [2024-08-05 22:22:02,737][52820] Sum rewards: 7.233, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.520', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO3': '0.072', 'weapon4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'ARMOR': '1.358', 'weapon3': '1.590', 'weapon2': '1.808', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:02,794][52567] Fps is (10 sec: 17204.4, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 57974784. Throughput: 0: 4220.4. Samples: 14493780. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-05 22:22:02,794][52567] Avg episode reward: [(0, '6.065')] [2024-08-05 22:22:02,795][52614] Saving new best policy, reward=6.065! [2024-08-05 22:22:04,643][52650] Updated weights for policy 0, policy_version 7081 (0.0035) [2024-08-05 22:22:05,235][52669] DAMAGECOUNT value on done: 6708.0 [2024-08-05 22:22:05,235][52669] Sum rewards: 3.961, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.228', 'ARMOR': '1.319', 'DAMAGECOUNT': '2.004', 'weapon3': '2.236', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:06,066][52820] DAMAGECOUNT value on done: 5962.0 [2024-08-05 22:22:06,068][52820] Sum rewards: 9.930, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.033', 'AMMO3': '0.060', 'ARMOR': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'WEAPON3': '0.350', 'weapon4': '0.470', 'HEALTH': '0.634', 'HITCOUNT': '0.680', 'weapon2': '1.352', 'weapon3': '1.392', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:07,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.5, 300 sec: 16828.3). Total num frames: 58056704. Throughput: 0: 4213.7. Samples: 14518940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:22:07,795][52567] Avg episode reward: [(0, '6.119')] [2024-08-05 22:22:07,865][52614] Saving new best policy, reward=6.119! [2024-08-05 22:22:08,492][52669] DAMAGECOUNT value on done: 7925.0 [2024-08-05 22:22:08,494][52669] Sum rewards: 5.409, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.860', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'AMMO3': '0.056', 'WEAPON5': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.402', 'WEAPON3': '0.450', 'ARMOR': '0.479', 'HITCOUNT': '0.590', 'weapon2': '0.968', 'weapon3': '1.026', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:09,419][52820] DAMAGECOUNT value on done: 7050.0 [2024-08-05 22:22:09,420][52820] Sum rewards: 3.513, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.410', 'ARMOR': '0.488', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '0.884', 'weapon3': '1.672', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:09,525][52650] Updated weights for policy 0, policy_version 7091 (0.0036) [2024-08-05 22:22:10,642][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:22:11,487][52669] DAMAGECOUNT value on done: 6101.0 [2024-08-05 22:22:11,489][52669] Sum rewards: 3.698, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.876', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.060', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'HITCOUNT': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.134', 'weapon2': '1.394', 'weapon3': '1.810', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 58138624. Throughput: 0: 4206.2. Samples: 14544260. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:22:12,794][52567] Avg episode reward: [(0, '6.073')] [2024-08-05 22:22:13,019][52820] DAMAGECOUNT value on done: 5975.0 [2024-08-05 22:22:13,020][52820] Sum rewards: 1.516, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.244', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.132', 'WEAPON5': '0.250', 'weapon5': '0.314', 'ARMOR': '0.440', 'HITCOUNT': '0.470', 'WEAPON3': '0.750', 'weapon3': '1.500', 'weapon2': '1.520', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '2.500'} [2024-08-05 22:22:13,989][52669] DAMAGECOUNT value on done: 6499.0 [2024-08-05 22:22:13,991][52669] Sum rewards: 2.797, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.224', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.020', 'weapon5': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.178', 'WEAPON5': '0.300', 'ARMOR': '0.462', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon3': '1.376', 'weapon2': '1.504', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:14,035][52650] Updated weights for policy 0, policy_version 7101 (0.0025) [2024-08-05 22:22:14,370][52794] DAMAGECOUNT value on done: 6766.0 [2024-08-05 22:22:14,371][52794] Sum rewards: 0.538, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.863', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.137', 'HITCOUNT': '0.650', 'ARMOR': '0.871', 'WEAPON3': '0.900', 'weapon3': '1.470', 'weapon2': '1.610', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.157'} [2024-08-05 22:22:16,392][52820] DAMAGECOUNT value on done: 5683.0 [2024-08-05 22:22:16,396][52820] Sum rewards: 3.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.122', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.077', 'AMMO3': '0.082', 'ARMOR': '0.083', 'weapon4': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.552', 'weapon3': '1.576', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:16,949][52794] DAMAGECOUNT value on done: 7253.0 [2024-08-05 22:22:16,949][52794] Sum rewards: 9.665, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.739', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.194', 'WEAPON3': '0.500', 'ARMOR': '0.530', 'HITCOUNT': '0.740', 'weapon3': '1.338', 'weapon2': '1.506', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:17,112][52669] DAMAGECOUNT value on done: 7658.0 [2024-08-05 22:22:17,115][52669] Sum rewards: 6.441, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.390', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.178', 'HITCOUNT': '0.320', 'WEAPON3': '0.500', 'ARMOR': '0.528', 'DAMAGECOUNT': '1.260', 'weapon3': '1.428', 'weapon2': '1.622', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 58228736. Throughput: 0: 4208.4. Samples: 14556990. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:22:17,795][52567] Avg episode reward: [(0, '6.010')] [2024-08-05 22:22:18,911][52662] DAMAGECOUNT value on done: 7217.0 [2024-08-05 22:22:18,911][52662] Sum rewards: 6.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.642', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.072', 'AMMO3': '0.152', 'ARMOR': '0.836', 'HITCOUNT': '0.900', 'WEAPON3': '0.950', 'weapon2': '1.448', 'weapon3': '2.154', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:19,225][52650] Updated weights for policy 0, policy_version 7111 (0.0020) [2024-08-05 22:22:19,633][52669] DAMAGECOUNT value on done: 6503.0 [2024-08-05 22:22:19,633][52669] Sum rewards: 5.568, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.096', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon7': '0.024', 'ARMOR': '0.038', 'AMMO4': '0.082', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.426', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '0.786', 'weapon3': '1.302', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:19,839][52820] DAMAGECOUNT value on done: 6453.0 [2024-08-05 22:22:19,840][52820] Sum rewards: 4.427, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.004', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.108', 'weapon5': '0.160', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'ARMOR': '0.957', 'weapon2': '1.454', 'weapon3': '1.770', 'DAMAGECOUNT': '2.223', 'FRAGCOUNT': '4.500'} [2024-08-05 22:22:19,949][52794] DAMAGECOUNT value on done: 7545.0 [2024-08-05 22:22:19,952][52794] Sum rewards: 3.605, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.746', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.150', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'ARMOR': '0.892', 'weapon2': '1.636', 'weapon3': '1.652', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:21,548][52662] DAMAGECOUNT value on done: 7173.0 [2024-08-05 22:22:21,550][52662] Sum rewards: 6.118, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.529', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.030', 'weapon4': '0.064', 'AMMO3': '0.103', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'ARMOR': '1.302', 'weapon3': '1.636', 'weapon2': '1.764', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:21,785][52663] DAMAGECOUNT value on done: 6866.0 [2024-08-05 22:22:21,786][52663] Sum rewards: 7.093, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.688', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.178', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '0.968', 'weapon3': '1.600', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:22,293][52794] DAMAGECOUNT value on done: 7019.0 [2024-08-05 22:22:22,295][52794] Sum rewards: 8.361, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.337', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.034', 'ARMOR': '0.064', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.135', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.336', 'weapon3': '1.958', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '9.000'} [2024-08-05 22:22:22,530][52669] DAMAGECOUNT value on done: 6538.0 [2024-08-05 22:22:22,531][52669] Sum rewards: 13.603, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.092', 'weapon4': '0.134', 'HEALTH': '0.399', 'WEAPON3': '0.400', 'HITCOUNT': '0.810', 'weapon3': '1.364', 'ARMOR': '1.687', 'weapon2': '2.088', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 58310656. Throughput: 0: 4211.8. Samples: 14582300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:22:22,794][52567] Avg episode reward: [(0, '6.116')] [2024-08-05 22:22:23,118][52820] DAMAGECOUNT value on done: 4944.0 [2024-08-05 22:22:23,119][52820] Sum rewards: 2.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.051', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.032', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'HITCOUNT': '0.490', 'WEAPON3': '0.850', 'weapon2': '1.398', 'DAMAGECOUNT': '1.530', 'ARMOR': '1.839', 'weapon3': '2.046', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:23,847][52650] Updated weights for policy 0, policy_version 7121 (0.0023) [2024-08-05 22:22:24,371][52647] DAMAGECOUNT value on done: 6560.0 [2024-08-05 22:22:24,373][52647] Sum rewards: 4.137, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.333', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.149', 'ARMOR': '0.487', 'HITCOUNT': '0.780', 'WEAPON3': '1.100', 'weapon2': '1.578', 'weapon3': '2.148', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:24,534][52662] DAMAGECOUNT value on done: 7184.0 [2024-08-05 22:22:24,535][52662] Sum rewards: 5.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.193', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.074', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.206', 'ARMOR': '0.507', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.206', 'weapon3': '1.430', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:24,722][52663] DAMAGECOUNT value on done: 6109.0 [2024-08-05 22:22:24,730][52663] Sum rewards: 3.953, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.026', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO4': '0.115', 'WEAPON3': '0.250', 'HEALTH': '0.368', 'HITCOUNT': '0.470', 'ARMOR': '0.480', 'weapon3': '1.056', 'DAMAGECOUNT': '1.482', 'weapon2': '1.616', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:25,215][52794] DAMAGECOUNT value on done: 6990.0 [2024-08-05 22:22:25,215][52794] Sum rewards: 6.380, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.913', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon4': '0.368', 'HITCOUNT': '0.400', 'WEAPON3': '0.600', 'ARMOR': '0.966', 'weapon2': '1.216', 'weapon3': '1.344', 'DAMAGECOUNT': '1.611', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:25,433][52669] DAMAGECOUNT value on done: 5853.0 [2024-08-05 22:22:25,433][52669] Sum rewards: 6.678, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.066', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'ARMOR': '1.364', 'weapon2': '1.454', 'DAMAGECOUNT': '1.767', 'weapon3': '2.062', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:26,441][52820] DAMAGECOUNT value on done: 5970.0 [2024-08-05 22:22:26,441][52820] Sum rewards: 2.377, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.853', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.150', 'HITCOUNT': '0.450', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'weapon3': '0.976', 'weapon2': '1.364', 'DAMAGECOUNT': '1.371', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:26,982][52662] DAMAGECOUNT value on done: 5939.0 [2024-08-05 22:22:26,983][52662] Sum rewards: 8.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.683', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.091', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.288', 'weapon3': '1.346', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:27,241][52663] DAMAGECOUNT value on done: 5552.0 [2024-08-05 22:22:27,243][52663] Sum rewards: 6.074, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.102', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'ARMOR': '0.847', 'weapon3': '1.736', 'weapon2': '1.916', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:27,266][52647] DAMAGECOUNT value on done: 6735.0 [2024-08-05 22:22:27,267][52647] Sum rewards: 8.367, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.072', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '0.913', 'weapon3': '1.436', 'weapon2': '1.730', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:27,552][52665] DAMAGECOUNT value on done: 6477.0 [2024-08-05 22:22:27,552][52665] Sum rewards: 4.542, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.096', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'weapon7': '0.050', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HITCOUNT': '0.330', 'WEAPON3': '0.600', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.302', 'weapon3': '1.320', 'weapon2': '2.118', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:27,730][52794] DAMAGECOUNT value on done: 7736.0 [2024-08-05 22:22:27,730][52794] Sum rewards: 9.495, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.857', 'AMMO2': '0.017', 'ARMOR': '0.072', 'AMMO3': '0.077', 'AMMO4': '0.085', 'WEAPON4': '0.300', 'weapon4': '0.476', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.070', 'weapon3': '1.472', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.0, 300 sec: 16856.1). Total num frames: 58400768. Throughput: 0: 4199.5. Samples: 14607570. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:22:27,795][52567] Avg episode reward: [(0, '6.076')] [2024-08-05 22:22:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007129_58400768.pth... [2024-08-05 22:22:27,944][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006637_54370304.pth [2024-08-05 22:22:28,296][52669] DAMAGECOUNT value on done: 6493.0 [2024-08-05 22:22:28,297][52669] Sum rewards: -1.447, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.294', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.450', 'weapon2': '0.722', 'WEAPON3': '0.950', 'DAMAGECOUNT': '0.984', 'ARMOR': '1.027', 'FRAGCOUNT': '2.000', 'weapon3': '2.058'} [2024-08-05 22:22:28,803][52650] Updated weights for policy 0, policy_version 7131 (0.0022) [2024-08-05 22:22:29,354][52662] DAMAGECOUNT value on done: 7355.0 [2024-08-05 22:22:29,354][52662] Sum rewards: -3.062, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.203', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon4': '0.288', 'HITCOUNT': '0.410', 'ARMOR': '0.468', 'weapon2': '0.864', 'WEAPON3': '0.900', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.446', 'weapon3': '1.650'} [2024-08-05 22:22:29,899][52665] DAMAGECOUNT value on done: 6292.0 [2024-08-05 22:22:29,900][52665] Sum rewards: 4.151, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.264', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'AMMO3': '0.072', 'weapon5': '0.072', 'WEAPON5': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'ARMOR': '0.857', 'weapon3': '1.418', 'DAMAGECOUNT': '1.431', 'weapon2': '1.550', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:30,093][52820] DAMAGECOUNT value on done: 6105.0 [2024-08-05 22:22:30,093][52820] Sum rewards: 3.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.278', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'ARMOR': '0.549', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.406', 'weapon3': '1.826', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:30,116][52794] DAMAGECOUNT value on done: 6768.0 [2024-08-05 22:22:30,117][52794] Sum rewards: 8.811, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.014', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'HEALTH': '0.229', 'WEAPON3': '0.450', 'HITCOUNT': '0.510', 'ARMOR': '0.828', 'weapon2': '1.550', 'weapon3': '1.582', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:30,488][52663] DAMAGECOUNT value on done: 7528.0 [2024-08-05 22:22:30,490][52663] Sum rewards: 4.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.819', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.056', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.378', 'weapon3': '1.576', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:30,491][52647] DAMAGECOUNT value on done: 8098.0 [2024-08-05 22:22:30,494][52647] Sum rewards: 9.039, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.394', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'ARMOR': '1.249', 'weapon2': '1.612', 'weapon3': '2.008', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:31,446][52669] DAMAGECOUNT value on done: 7136.0 [2024-08-05 22:22:31,447][52669] Sum rewards: 7.430, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.940', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'ARMOR': '0.044', 'AMMO3': '0.133', 'HITCOUNT': '0.880', 'WEAPON3': '1.050', 'weapon2': '1.072', 'weapon3': '2.394', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '9.000'} [2024-08-05 22:22:32,238][52662] DAMAGECOUNT value on done: 8305.0 [2024-08-05 22:22:32,239][52662] Sum rewards: 6.200, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'weapon4': '0.004', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.172', 'ARMOR': '0.444', 'WEAPON3': '1.000', 'HITCOUNT': '1.030', 'weapon2': '1.332', 'weapon3': '1.510', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16856.1). Total num frames: 58482688. Throughput: 0: 4194.0. Samples: 14619990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:22:32,794][52567] Avg episode reward: [(0, '5.894')] [2024-08-05 22:22:32,871][52794] DAMAGECOUNT value on done: 5764.0 [2024-08-05 22:22:32,872][52794] Sum rewards: 6.394, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.210', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.222', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'ARMOR': '0.914', 'weapon3': '1.412', 'weapon2': '1.654', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:33,252][52665] DAMAGECOUNT value on done: 7502.0 [2024-08-05 22:22:33,261][52665] Sum rewards: 13.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.016', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.262', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'ARMOR': '0.944', 'weapon2': '1.244', 'weapon3': '1.710', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '10.000'} [2024-08-05 22:22:33,378][52647] DAMAGECOUNT value on done: 5291.0 [2024-08-05 22:22:33,381][52820] DAMAGECOUNT value on done: 5310.0 [2024-08-05 22:22:33,380][52647] Sum rewards: -0.474, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.445', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.216', 'HITCOUNT': '0.360', 'ARMOR': '0.464', 'WEAPON3': '0.800', 'weapon2': '1.048', 'DAMAGECOUNT': '1.158', 'weapon3': '1.444', 'FRAGCOUNT': '2.000'} [2024-08-05 22:22:33,382][52820] Sum rewards: 8.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO2': '0.007', 'weapon4': '0.034', 'AMMO4': '0.037', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '0.910', 'weapon3': '1.442', 'weapon2': '1.604', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:33,436][52663] DAMAGECOUNT value on done: 6346.0 [2024-08-05 22:22:33,436][52663] Sum rewards: 5.805, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO3': '0.077', 'AMMO4': '0.085', 'ARMOR': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'HITCOUNT': '0.390', 'weapon4': '0.444', 'WEAPON3': '0.550', 'weapon2': '1.126', 'DAMAGECOUNT': '1.299', 'weapon3': '1.528', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:33,779][52650] Updated weights for policy 0, policy_version 7141 (0.0030) [2024-08-05 22:22:34,295][52669] DAMAGECOUNT value on done: 5782.0 [2024-08-05 22:22:34,297][52669] Sum rewards: 2.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.786', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon4': '0.192', 'ARMOR': '0.404', 'HITCOUNT': '0.630', 'WEAPON3': '0.900', 'weapon2': '1.392', 'DAMAGECOUNT': '1.854', 'weapon3': '2.258', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:34,604][52662] DAMAGECOUNT value on done: 8191.0 [2024-08-05 22:22:34,605][52662] Sum rewards: 5.667, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.266', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.208', 'ARMOR': '0.472', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.254', 'weapon3': '1.316', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:35,293][52794] DAMAGECOUNT value on done: 8091.0 [2024-08-05 22:22:35,294][52794] Sum rewards: 6.313, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.224', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon4': '0.114', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.432', 'weapon3': '1.804', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:35,991][52647] DAMAGECOUNT value on done: 5471.0 [2024-08-05 22:22:35,994][52647] Sum rewards: 4.620, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.425', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'ARMOR': '0.064', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon4': '0.352', 'HITCOUNT': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.214', 'weapon3': '1.288', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:36,004][52663] DAMAGECOUNT value on done: 7204.0 [2024-08-05 22:22:36,006][52663] Sum rewards: 11.514, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.060', 'HEALTH': '0.146', 'weapon4': '0.174', 'WEAPON3': '0.400', 'ARMOR': '0.440', 'HITCOUNT': '0.810', 'weapon3': '1.468', 'weapon2': '1.842', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:36,377][52665] DAMAGECOUNT value on done: 5535.0 [2024-08-05 22:22:36,378][52665] Sum rewards: 7.974, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.778', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon4': '0.340', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'ARMOR': '1.287', 'weapon3': '1.416', 'weapon2': '1.844', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:36,669][52669] DAMAGECOUNT value on done: 7265.0 [2024-08-05 22:22:36,669][52669] Sum rewards: 10.270, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.921', 'weapon5': '0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.025', 'AMMO3': '0.110', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.206', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '1.160', 'weapon3': '1.970', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '10.000'} [2024-08-05 22:22:36,846][52820] DAMAGECOUNT value on done: 5330.0 [2024-08-05 22:22:36,847][52820] Sum rewards: 2.430, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.532', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'HITCOUNT': '0.420', 'WEAPON3': '0.550', 'ARMOR': '0.901', 'weapon3': '1.078', 'DAMAGECOUNT': '1.425', 'weapon2': '1.684', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:37,528][52662] DAMAGECOUNT value on done: 7697.0 [2024-08-05 22:22:37,528][52662] Sum rewards: 3.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.131', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.226', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'ARMOR': '0.936', 'DAMAGECOUNT': '1.545', 'weapon2': '1.550', 'weapon3': '1.856', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:37,794][52567] Fps is (10 sec: 16384.5, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 58564608. Throughput: 0: 4196.7. Samples: 14645280. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:22:37,794][52567] Avg episode reward: [(0, '6.025')] [2024-08-05 22:22:38,373][52794] DAMAGECOUNT value on done: 7205.0 [2024-08-05 22:22:38,381][52794] Sum rewards: 1.260, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.340', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon7': '0.046', 'ARMOR': '0.080', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.230', 'weapon2': '0.566', 'WEAPON3': '0.650', 'weapon3': '1.188', 'DAMAGECOUNT': '1.197', 'FRAGCOUNT': '2.000'} [2024-08-05 22:22:38,403][52650] Updated weights for policy 0, policy_version 7151 (0.0028) [2024-08-05 22:22:38,694][52663] DAMAGECOUNT value on done: 8001.0 [2024-08-05 22:22:38,695][52663] Sum rewards: 2.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.006', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.014', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'HITCOUNT': '0.800', 'ARMOR': '0.955', 'WEAPON3': '1.150', 'weapon2': '1.694', 'weapon3': '2.130', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:38,699][52647] DAMAGECOUNT value on done: 6733.0 [2024-08-05 22:22:38,699][52647] Sum rewards: 5.859, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.276', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.190', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.840', 'weapon2': '1.648', 'weapon3': '1.904', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:39,347][52669] DAMAGECOUNT value on done: 6527.0 [2024-08-05 22:22:39,349][52669] Sum rewards: 8.660, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.040', 'ARMOR': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.454', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '0.870', 'weapon3': '1.848', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:39,435][52665] DAMAGECOUNT value on done: 6363.0 [2024-08-05 22:22:39,435][52665] Sum rewards: 12.024, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.752', 'ARMOR': '0.004', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.086', 'weapon4': '0.224', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'weapon2': '1.492', 'weapon3': '1.630', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '10.000'} [2024-08-05 22:22:40,145][52662] DAMAGECOUNT value on done: 7802.0 [2024-08-05 22:22:40,145][52662] Sum rewards: 2.287, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.564', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.048', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.122', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.160', 'DAMAGECOUNT': '1.545', 'weapon3': '1.582', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:40,173][52820] DAMAGECOUNT value on done: 6659.0 [2024-08-05 22:22:40,176][52820] Sum rewards: 6.108, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.822', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.028', 'AMMO4': '0.057', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.508', 'weapon4': '0.614', 'weapon2': '0.688', 'HITCOUNT': '0.700', 'WEAPON3': '0.950', 'weapon3': '1.786', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:40,730][52794] DAMAGECOUNT value on done: 7085.0 [2024-08-05 22:22:40,731][52794] Sum rewards: 6.742, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.873', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'ARMOR': '1.430', 'weapon3': '1.662', 'weapon2': '1.764', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:41,556][52647] DAMAGECOUNT value on done: 5269.0 [2024-08-05 22:22:41,556][52647] Sum rewards: 8.943, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.453', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.058', 'weapon4': '0.072', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'ARMOR': '0.484', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.388', 'weapon3': '1.904', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '9.000'} [2024-08-05 22:22:41,908][52663] DAMAGECOUNT value on done: 5829.0 [2024-08-05 22:22:41,909][52663] Sum rewards: 3.251, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.003', 'HEALTH': '0.014', 'AMMO4': '0.017', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.230', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'FRAGCOUNT': '1.000', 'weapon3': '1.026', 'weapon2': '1.062', 'DAMAGECOUNT': '1.284', 'ARMOR': '1.335'} [2024-08-05 22:22:42,633][52665] DAMAGECOUNT value on done: 5844.0 [2024-08-05 22:22:42,634][52665] Sum rewards: 5.838, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.120', 'AMMO4': '0.139', 'HEALTH': '0.388', 'ARMOR': '0.485', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '1.556', 'DAMAGECOUNT': '1.626', 'weapon3': '1.662', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:42,756][52669] DAMAGECOUNT value on done: 7174.0 [2024-08-05 22:22:42,756][52669] Sum rewards: 5.176, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.956', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'weapon4': '0.252', 'ARMOR': '0.501', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.430', 'weapon3': '1.536', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:42,797][52567] Fps is (10 sec: 17198.6, 60 sec: 16929.4, 300 sec: 16828.2). Total num frames: 58654720. Throughput: 0: 4212.0. Samples: 14670680. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:22:42,797][52567] Avg episode reward: [(0, '5.905')] [2024-08-05 22:22:42,821][52662] DAMAGECOUNT value on done: 7564.0 [2024-08-05 22:22:42,822][52662] Sum rewards: 5.255, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.885', 'AMMO2': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon4': '0.268', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon2': '1.026', 'weapon3': '1.258', 'DAMAGECOUNT': '1.824', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:43,318][52794] DAMAGECOUNT value on done: 7822.0 [2024-08-05 22:22:43,318][52794] Sum rewards: 6.308, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'weapon5': '0.092', 'AMMO4': '0.111', 'HEALTH': '0.174', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'weapon3': '1.156', 'weapon2': '2.154', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:43,524][52820] DAMAGECOUNT value on done: 6107.0 [2024-08-05 22:22:43,527][52820] Sum rewards: 0.809, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'HEALTH': '0.254', 'HITCOUNT': '0.300', 'weapon4': '0.316', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.254', 'weapon2': '1.330', 'weapon3': '1.600', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:43,821][52650] Updated weights for policy 0, policy_version 7161 (0.0026) [2024-08-05 22:22:44,488][52647] DAMAGECOUNT value on done: 6810.0 [2024-08-05 22:22:44,490][52647] Sum rewards: 8.746, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.156', 'HEALTH': '0.241', 'WEAPON3': '0.400', 'HITCOUNT': '0.740', 'ARMOR': '0.877', 'weapon2': '1.238', 'weapon3': '1.294', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:45,241][52663] DAMAGECOUNT value on done: 5518.0 [2024-08-05 22:22:45,242][52663] Sum rewards: 2.607, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.254', 'ARMOR': '0.455', 'HITCOUNT': '0.560', 'WEAPON3': '0.800', 'weapon2': '1.252', 'weapon3': '1.938', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:45,393][52665] DAMAGECOUNT value on done: 6752.0 [2024-08-05 22:22:45,394][52665] Sum rewards: 5.003, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.102', 'HEALTH': '0.126', 'ARMOR': '0.456', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.276', 'weapon3': '1.938', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:45,406][52662] DAMAGECOUNT value on done: 6453.0 [2024-08-05 22:22:45,406][52662] Sum rewards: 4.007, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.188', 'HEALTH': '0.204', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.885', 'FRAGCOUNT': '1.000', 'ARMOR': '1.256', 'weapon2': '1.586', 'weapon3': '1.672'} [2024-08-05 22:22:45,995][52669] DAMAGECOUNT value on done: 6111.0 [2024-08-05 22:22:45,995][52669] Sum rewards: 10.480, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.152', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.088', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'ARMOR': '0.881', 'weapon2': '1.334', 'weapon3': '1.820', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '9.000'} [2024-08-05 22:22:46,228][52794] DAMAGECOUNT value on done: 7053.0 [2024-08-05 22:22:46,231][52794] Sum rewards: 9.085, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.511', 'AMMO2': '0.004', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.208', 'weapon4': '0.210', 'WEAPON5': '0.250', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.863', 'weapon2': '1.294', 'weapon3': '1.606', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:47,710][52647] DAMAGECOUNT value on done: 7088.0 [2024-08-05 22:22:47,711][52647] Sum rewards: 13.267, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.035', 'AMMO3': '0.126', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON3': '0.650', 'HEALTH': '1.010', 'HITCOUNT': '1.150', 'weapon2': '1.238', 'ARMOR': '1.672', 'weapon3': '2.220', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '10.000'} [2024-08-05 22:22:47,766][52667] DAMAGECOUNT value on done: 7646.0 [2024-08-05 22:22:47,769][52667] Sum rewards: 9.448, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.948', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.086', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '1.288', 'weapon3': '1.626', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '9.000'} [2024-08-05 22:22:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16856.1). Total num frames: 58736640. Throughput: 0: 4211.1. Samples: 14683280. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:22:47,794][52567] Avg episode reward: [(0, '6.012')] [2024-08-05 22:22:47,938][52650] Updated weights for policy 0, policy_version 7171 (0.0012) [2024-08-05 22:22:48,035][52662] DAMAGECOUNT value on done: 6307.0 [2024-08-05 22:22:48,035][52662] Sum rewards: 6.596, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.428', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.090', 'weapon4': '0.106', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.504', 'weapon3': '1.646', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:48,199][52665] DAMAGECOUNT value on done: 5200.0 [2024-08-05 22:22:48,201][52665] Sum rewards: 4.849, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.003', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.052', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.190', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.280', 'DAMAGECOUNT': '1.386', 'weapon3': '1.790', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:48,438][52663] DAMAGECOUNT value on done: 6721.0 [2024-08-05 22:22:48,438][52663] Sum rewards: 3.831, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.202', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'weapon2': '1.422', 'DAMAGECOUNT': '1.839', 'weapon3': '1.890', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:48,632][52794] DAMAGECOUNT value on done: 8221.0 [2024-08-05 22:22:48,640][52794] Sum rewards: 1.667, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.171', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.129', 'weapon5': '0.324', 'HITCOUNT': '0.440', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'weapon2': '1.560', 'weapon3': '1.578', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:49,140][52666] DAMAGECOUNT value on done: 5963.0 [2024-08-05 22:22:49,141][52666] Sum rewards: 10.390, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.932', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.056', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'ARMOR': '0.460', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.570', 'weapon3': '1.826', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '9.000'} [2024-08-05 22:22:49,232][52669] DAMAGECOUNT value on done: 6919.0 [2024-08-05 22:22:49,232][52669] Sum rewards: 8.519, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.072', 'weapon5': '0.118', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'ARMOR': '0.483', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.356', 'weapon3': '1.852', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:50,587][52662] DAMAGECOUNT value on done: 7573.0 [2024-08-05 22:22:50,588][52662] Sum rewards: 7.419, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.136', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.082', 'weapon4': '0.134', 'weapon5': '0.258', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon2': '1.236', 'weapon3': '1.404', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:50,664][52647] DAMAGECOUNT value on done: 6591.0 [2024-08-05 22:22:50,664][52647] Sum rewards: 6.122, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.154', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.094', 'weapon4': '0.200', 'ARMOR': '0.420', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon2': '1.034', 'weapon3': '1.178', 'DAMAGECOUNT': '1.497', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:50,904][52667] DAMAGECOUNT value on done: 6392.0 [2024-08-05 22:22:50,906][52667] Sum rewards: 7.321, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.150', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.150', 'ARMOR': '0.506', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '1.634', 'weapon3': '1.794', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:51,015][52670] DAMAGECOUNT value on done: 7386.0 [2024-08-05 22:22:51,017][52670] Sum rewards: 6.156, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.179', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'ARMOR': '1.360', 'weapon2': '1.748', 'weapon3': '1.878', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:51,157][52665] DAMAGECOUNT value on done: 5260.0 [2024-08-05 22:22:51,157][52665] Sum rewards: 2.414, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.026', 'weapon4': '0.034', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'HITCOUNT': '0.560', 'ARMOR': '0.864', 'WEAPON3': '0.900', 'weapon2': '1.472', 'weapon3': '1.926', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:51,362][52794] DAMAGECOUNT value on done: 7463.0 [2024-08-05 22:22:51,363][52794] Sum rewards: 14.310, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.226', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.750', 'ARMOR': '0.933', 'HITCOUNT': '0.960', 'weapon2': '1.364', 'weapon3': '1.988', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '12.000'} [2024-08-05 22:22:51,423][52663] DAMAGECOUNT value on done: 6525.0 [2024-08-05 22:22:51,425][52663] Sum rewards: 9.797, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.480', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.374', 'WEAPON3': '0.400', 'ARMOR': '0.542', 'HITCOUNT': '0.600', 'weapon2': '0.798', 'weapon3': '1.028', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:51,968][52666] DAMAGECOUNT value on done: 6436.0 [2024-08-05 22:22:51,969][52666] Sum rewards: 5.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.653', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.220', 'ARMOR': '0.495', 'HITCOUNT': '0.690', 'WEAPON3': '1.000', 'weapon2': '1.050', 'weapon3': '1.658', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:52,055][52669] DAMAGECOUNT value on done: 6471.0 [2024-08-05 22:22:52,055][52669] Sum rewards: 15.590, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'HEALTH': '0.134', 'weapon4': '0.226', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon3': '1.224', 'weapon2': '1.576', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '12.000'} [2024-08-05 22:22:52,794][52567] Fps is (10 sec: 16388.1, 60 sec: 16930.3, 300 sec: 16828.3). Total num frames: 58818560. Throughput: 0: 4223.6. Samples: 14709000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:22:52,795][52567] Avg episode reward: [(0, '6.029')] [2024-08-05 22:22:53,112][52650] Updated weights for policy 0, policy_version 7181 (0.0024) [2024-08-05 22:22:53,465][52662] DAMAGECOUNT value on done: 7725.0 [2024-08-05 22:22:53,468][52662] Sum rewards: 2.199, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.202', 'HITCOUNT': '0.650', 'WEAPON3': '0.900', 'ARMOR': '1.009', 'weapon2': '1.308', 'weapon3': '2.180', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:53,709][52670] DAMAGECOUNT value on done: 6228.0 [2024-08-05 22:22:53,719][52670] Sum rewards: 3.251, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.064', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'ARMOR': '0.066', 'AMMO4': '0.077', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.260', 'WEAPON4': '0.300', 'HITCOUNT': '0.440', 'WEAPON3': '1.050', 'weapon2': '1.302', 'DAMAGECOUNT': '1.617', 'weapon3': '2.104', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:53,851][52665] DAMAGECOUNT value on done: 7120.0 [2024-08-05 22:22:53,853][52665] Sum rewards: 11.284, reward structure: {'DEATHCOUNT': '-7.500', 'weapon7': '0.008', 'AMMO2': '0.028', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'HEALTH': '0.216', 'weapon4': '0.292', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'ARMOR': '1.303', 'weapon2': '1.424', 'weapon3': '1.476', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '9.000'} [2024-08-05 22:22:53,864][52647] DAMAGECOUNT value on done: 7069.0 [2024-08-05 22:22:53,865][52647] Sum rewards: 8.191, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.061', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.020', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.832', 'weapon3': '1.696', 'weapon2': '1.704', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:54,134][52667] DAMAGECOUNT value on done: 7191.0 [2024-08-05 22:22:54,134][52667] Sum rewards: 6.721, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.290', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO4': '0.016', 'weapon5': '0.018', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'ARMOR': '0.912', 'weapon2': '1.710', 'weapon3': '1.876', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '6.000'} [2024-08-05 22:22:54,264][52663] DAMAGECOUNT value on done: 6485.0 [2024-08-05 22:22:54,264][52663] Sum rewards: 4.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.199', 'AMMO2': '0.013', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.113', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'ARMOR': '0.896', 'weapon2': '1.420', 'weapon3': '2.188', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:54,307][52666] DAMAGECOUNT value on done: 5843.0 [2024-08-05 22:22:54,307][52666] Sum rewards: 2.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.044', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'HITCOUNT': '0.320', 'WEAPON3': '0.650', 'ARMOR': '0.853', 'DAMAGECOUNT': '1.125', 'weapon3': '1.382', 'weapon2': '1.464', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:54,421][52794] DAMAGECOUNT value on done: 7861.0 [2024-08-05 22:22:54,426][52794] Sum rewards: 6.135, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.477', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'HITCOUNT': '0.790', 'ARMOR': '0.935', 'weapon3': '1.512', 'weapon2': '1.772', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:54,786][52669] DAMAGECOUNT value on done: 7210.0 [2024-08-05 22:22:54,787][52669] Sum rewards: 5.123, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.155', 'weapon4': '0.226', 'ARMOR': '0.436', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '1.370', 'weapon3': '1.922', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:56,147][52662] DAMAGECOUNT value on done: 6809.0 [2024-08-05 22:22:56,148][52662] Sum rewards: 5.792, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.551', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.076', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'ARMOR': '0.587', 'weapon4': '0.618', 'weapon2': '0.848', 'weapon3': '1.528', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '4.000'} [2024-08-05 22:22:56,712][52665] DAMAGECOUNT value on done: 7224.0 [2024-08-05 22:22:56,714][52665] Sum rewards: 7.016, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.812', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'ARMOR': '1.226', 'DAMAGECOUNT': '1.335', 'weapon3': '1.534', 'weapon2': '1.882', 'FRAGCOUNT': '8.000'} [2024-08-05 22:22:56,797][52663] DAMAGECOUNT value on done: 6759.0 [2024-08-05 22:22:56,799][52663] Sum rewards: 3.036, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.928', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.330', 'ARMOR': '0.472', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.804', 'weapon3': '1.416', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:56,833][52670] DAMAGECOUNT value on done: 5610.0 [2024-08-05 22:22:56,835][52670] Sum rewards: 8.290, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.019', 'AMMO3': '0.060', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.274', 'WEAPON3': '0.400', 'HEALTH': '0.406', 'HITCOUNT': '0.640', 'weapon3': '1.272', 'ARMOR': '1.353', 'weapon2': '1.808', 'DAMAGECOUNT': '2.112', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:56,840][52794] DAMAGECOUNT value on done: 8382.0 [2024-08-05 22:22:56,840][52794] Sum rewards: 10.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.657', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'weapon4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'ARMOR': '0.449', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.286', 'weapon3': '1.876', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '10.000'} [2024-08-05 22:22:56,949][52647] DAMAGECOUNT value on done: 5438.0 [2024-08-05 22:22:56,949][52647] Sum rewards: 2.055, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.222', 'ARMOR': '0.440', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '0.966', 'weapon3': '1.788', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '3.000'} [2024-08-05 22:22:56,997][52667] DAMAGECOUNT value on done: 6750.0 [2024-08-05 22:22:56,997][52667] Sum rewards: -0.715, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.686', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'HITCOUNT': '0.520', 'ARMOR': '0.963', 'WEAPON3': '1.050', 'weapon2': '1.596', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '2.000', 'weapon3': '2.084'} [2024-08-05 22:22:57,720][52666] DAMAGECOUNT value on done: 7418.0 [2024-08-05 22:22:57,721][52666] Sum rewards: 15.997, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.882', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON3': '0.800', 'ARMOR': '0.940', 'HITCOUNT': '1.200', 'weapon2': '1.650', 'weapon3': '2.232', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '13.000'} [2024-08-05 22:22:57,763][52650] Updated weights for policy 0, policy_version 7191 (0.0028) [2024-08-05 22:22:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 58908672. Throughput: 0: 4227.6. Samples: 14734500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:22:57,794][52567] Avg episode reward: [(0, '6.097')] [2024-08-05 22:22:58,518][52662] DAMAGECOUNT value on done: 8102.0 [2024-08-05 22:22:58,519][52662] Sum rewards: 6.207, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.078', 'AMMO4': '0.080', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'HEALTH': '0.186', 'weapon4': '0.350', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.388', 'weapon3': '2.028', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '5.000'} [2024-08-05 22:22:59,005][52665] DAMAGECOUNT value on done: 6175.0 [2024-08-05 22:22:59,147][52794] DAMAGECOUNT value on done: 7701.0 [2024-08-05 22:22:59,148][52794] Sum rewards: 5.082, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.223', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.370', 'ARMOR': '0.497', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'weapon2': '0.952', 'weapon3': '2.036', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '7.000'} [2024-08-05 22:22:59,803][52663] DAMAGECOUNT value on done: 6532.0 [2024-08-05 22:22:59,803][52663] Sum rewards: 2.403, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.956', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.086', 'WEAPON4': '0.300', 'weapon4': '0.368', 'ARMOR': '0.464', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.010', 'weapon3': '1.426', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.337'} [2024-08-05 22:23:00,180][52670] DAMAGECOUNT value on done: 5858.0 [2024-08-05 22:23:00,181][52670] Sum rewards: 7.140, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.300', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'weapon4': '0.128', 'AMMO3': '0.136', 'ARMOR': '0.476', 'HITCOUNT': '0.870', 'WEAPON3': '1.000', 'weapon2': '1.130', 'weapon3': '2.020', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:00,236][52647] DAMAGECOUNT value on done: 6329.0 [2024-08-05 22:23:00,237][52647] Sum rewards: 5.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.343', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.180', 'HITCOUNT': '0.450', 'ARMOR': '0.525', 'WEAPON3': '0.800', 'weapon2': '1.364', 'DAMAGECOUNT': '1.485', 'weapon3': '1.946', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:00,377][52667] DAMAGECOUNT value on done: 7769.0 [2024-08-05 22:23:00,377][52667] Sum rewards: 9.738, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.151', 'weapon4': '0.436', 'HEALTH': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.856', 'weapon2': '1.064', 'weapon3': '1.900', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:00,814][52662] DAMAGECOUNT value on done: 6917.0 [2024-08-05 22:23:00,815][52662] Sum rewards: 7.137, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.242', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon5': '0.096', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.358', 'ARMOR': '0.512', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.394', 'weapon3': '1.634', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:01,069][52666] DAMAGECOUNT value on done: 6284.0 [2024-08-05 22:23:01,070][52666] Sum rewards: 6.313, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.856', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.300', 'weapon4': '0.434', 'ARMOR': '0.512', 'WEAPON3': '0.800', 'weapon2': '0.844', 'HITCOUNT': '0.860', 'weapon3': '2.034', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:01,506][52794] DAMAGECOUNT value on done: 7639.0 [2024-08-05 22:23:01,506][52794] Sum rewards: 5.210, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.098', 'WEAPON3': '0.550', 'HEALTH': '0.584', 'HITCOUNT': '0.610', 'ARMOR': '0.844', 'weapon2': '1.142', 'weapon3': '1.540', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:01,714][52665] DAMAGECOUNT value on done: 6451.0 [2024-08-05 22:23:01,717][52665] Sum rewards: 5.002, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.090', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.182', 'WEAPON3': '0.300', 'HITCOUNT': '0.350', 'ARMOR': '0.528', 'weapon2': '0.810', 'weapon3': '0.876', 'DAMAGECOUNT': '1.032', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:02,683][52650] Updated weights for policy 0, policy_version 7201 (0.0011) [2024-08-05 22:23:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 58990592. Throughput: 0: 4225.1. Samples: 14747120. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:23:02,794][52567] Avg episode reward: [(0, '6.100')] [2024-08-05 22:23:03,030][52663] DAMAGECOUNT value on done: 6734.0 [2024-08-05 22:23:03,031][52663] Sum rewards: 10.725, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.048', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.827', 'HITCOUNT': '0.930', 'weapon2': '1.648', 'weapon3': '1.846', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '9.000'} [2024-08-05 22:23:03,124][52662] DAMAGECOUNT value on done: 7931.0 [2024-08-05 22:23:03,124][52662] Sum rewards: 10.188, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.129', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon5': '0.234', 'WEAPON5': '0.300', 'HEALTH': '0.430', 'WEAPON3': '0.700', 'ARMOR': '0.804', 'HITCOUNT': '0.940', 'weapon2': '1.160', 'weapon3': '1.834', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:03,181][52647] DAMAGECOUNT value on done: 5991.0 [2024-08-05 22:23:03,182][52647] Sum rewards: 2.802, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.192', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.094', 'AMMO3': '0.139', 'WEAPON4': '0.300', 'HITCOUNT': '0.770', 'ARMOR': '0.935', 'WEAPON3': '1.000', 'weapon2': '1.376', 'weapon3': '1.944', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:03,582][52649] DAMAGECOUNT value on done: 7002.0 [2024-08-05 22:23:03,591][52649] Sum rewards: 6.903, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.125', 'WEAPON4': '0.250', 'weapon4': '0.414', 'ARMOR': '0.541', 'HITCOUNT': '0.740', 'WEAPON3': '0.900', 'weapon2': '1.216', 'weapon3': '2.050', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:03,626][52670] DAMAGECOUNT value on done: 5199.0 [2024-08-05 22:23:03,626][52667] DAMAGECOUNT value on done: 7290.0 [2024-08-05 22:23:03,630][52670] Sum rewards: 4.275, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.504', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.114', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'HITCOUNT': '0.560', 'WEAPON3': '0.900', 'weapon2': '1.650', 'weapon3': '1.960', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:03,630][52667] Sum rewards: 2.796, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.594', 'weapon4': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '0.950', 'ARMOR': '0.962', 'weapon2': '1.570', 'DAMAGECOUNT': '2.061', 'weapon3': '2.276', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:03,781][52794] DAMAGECOUNT value on done: 7553.0 [2024-08-05 22:23:03,781][52794] Sum rewards: 8.253, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.884', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'ARMOR': '0.068', 'AMMO3': '0.098', 'weapon4': '0.212', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon3': '1.318', 'weapon2': '1.546', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:04,434][52666] DAMAGECOUNT value on done: 6662.0 [2024-08-05 22:23:04,442][52666] Sum rewards: 9.126, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.072', 'HEALTH': '0.212', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'weapon3': '1.608', 'weapon2': '1.788', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:04,541][52665] DAMAGECOUNT value on done: 7393.0 [2024-08-05 22:23:04,542][52665] Sum rewards: 8.122, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.934', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO3': '0.062', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.902', 'weapon3': '0.910', 'weapon2': '1.422', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:05,700][52662] DAMAGECOUNT value on done: 7452.0 [2024-08-05 22:23:05,702][52662] Sum rewards: 7.363, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.102', 'weapon4': '0.364', 'ARMOR': '0.548', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.324', 'weapon3': '1.976', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:05,971][52658] DAMAGECOUNT value on done: 6020.0 [2024-08-05 22:23:05,973][52658] Sum rewards: 3.694, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.259', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'weapon4': '0.204', 'ARMOR': '0.481', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.524', 'DAMAGECOUNT': '1.782', 'weapon3': '1.956', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:06,154][52663] DAMAGECOUNT value on done: 6980.0 [2024-08-05 22:23:06,156][52663] Sum rewards: 8.059, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.668', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'weapon4': '0.194', 'ARMOR': '0.514', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.286', 'weapon3': '1.680', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:06,347][52649] DAMAGECOUNT value on done: 6085.0 [2024-08-05 22:23:06,347][52649] Sum rewards: 4.216, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.668', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'HITCOUNT': '0.550', 'WEAPON3': '0.800', 'ARMOR': '1.275', 'weapon2': '1.360', 'DAMAGECOUNT': '1.827', 'weapon3': '1.908', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:06,501][52647] DAMAGECOUNT value on done: 6878.0 [2024-08-05 22:23:06,502][52647] Sum rewards: 10.580, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.742', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.416', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.356', 'weapon3': '1.552', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:06,766][52667] DAMAGECOUNT value on done: 7114.0 [2024-08-05 22:23:06,767][52667] Sum rewards: 8.667, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.700', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'ARMOR': '0.515', 'weapon4': '0.594', 'WEAPON3': '0.750', 'weapon2': '0.864', 'HITCOUNT': '0.920', 'weapon3': '1.982', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:06,938][52670] DAMAGECOUNT value on done: 6361.0 [2024-08-05 22:23:06,939][52670] Sum rewards: 7.402, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.036', 'AMMO3': '0.099', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'HEALTH': '0.290', 'weapon4': '0.394', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'ARMOR': '0.925', 'weapon2': '1.298', 'weapon3': '1.958', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:07,075][52665] DAMAGECOUNT value on done: 6622.0 [2024-08-05 22:23:07,075][52665] Sum rewards: 4.582, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.946', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.045', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'ARMOR': '0.501', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.374', 'weapon3': '1.666', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:07,596][52650] Updated weights for policy 0, policy_version 7211 (0.0027) [2024-08-05 22:23:07,615][52666] DAMAGECOUNT value on done: 6216.0 [2024-08-05 22:23:07,615][52666] Sum rewards: 6.711, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.585', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon4': '0.210', 'ARMOR': '0.448', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.198', 'weapon3': '2.242', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 59072512. Throughput: 0: 4225.6. Samples: 14772450. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:23:07,794][52567] Avg episode reward: [(0, '6.431')] [2024-08-05 22:23:07,798][52614] Saving new best policy, reward=6.431! [2024-08-05 22:23:08,643][52649] DAMAGECOUNT value on done: 5482.0 [2024-08-05 22:23:08,643][52649] Sum rewards: 0.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.824', 'AMMO2': '0.019', 'AMMO3': '0.090', 'AMMO4': '0.095', 'ARMOR': '0.104', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.428', 'WEAPON3': '0.600', 'weapon2': '0.942', 'DAMAGECOUNT': '1.113', 'weapon3': '1.586', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:08,801][52662] DAMAGECOUNT value on done: 7208.0 [2024-08-05 22:23:08,803][52662] Sum rewards: 4.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'ARMOR': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.342', 'weapon3': '2.364', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:08,949][52658] DAMAGECOUNT value on done: 6041.0 [2024-08-05 22:23:08,949][52658] Sum rewards: 3.311, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.520', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'weapon7': '0.126', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.328', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '0.900', 'ARMOR': '0.911', 'weapon3': '0.982', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.494'} [2024-08-05 22:23:09,421][52663] DAMAGECOUNT value on done: 6479.0 [2024-08-05 22:23:09,421][52663] Sum rewards: 4.640, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.018', 'weapon4': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'ARMOR': '0.472', 'HITCOUNT': '0.670', 'WEAPON3': '0.950', 'weapon2': '1.472', 'weapon3': '1.906', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:09,459][52665] DAMAGECOUNT value on done: 6610.0 [2024-08-05 22:23:09,461][52665] Sum rewards: 6.518, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.098', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.210', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'ARMOR': '0.900', 'weapon2': '0.952', 'weapon3': '1.276', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:09,877][52667] DAMAGECOUNT value on done: 6463.0 [2024-08-05 22:23:09,877][52667] Sum rewards: 1.504, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'HEALTH': '0.152', 'HITCOUNT': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'weapon5': '0.494', 'FRAGCOUNT': '0.500', 'weapon2': '1.010', 'DAMAGECOUNT': '1.062', 'weapon3': '1.338'} [2024-08-05 22:23:09,893][52670] DAMAGECOUNT value on done: 6201.0 [2024-08-05 22:23:09,895][52670] Sum rewards: 3.523, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.270', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'ARMOR': '0.491', 'HITCOUNT': '0.530', 'WEAPON3': '0.950', 'weapon2': '1.490', 'weapon3': '1.750', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:10,011][52647] DAMAGECOUNT value on done: 6074.0 [2024-08-05 22:23:10,011][52647] Sum rewards: 3.661, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.256', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.215', 'WEAPON4': '0.400', 'weapon4': '0.476', 'ARMOR': '0.540', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '0.972', 'weapon3': '1.674', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:10,722][52666] DAMAGECOUNT value on done: 6335.0 [2024-08-05 22:23:10,724][52666] Sum rewards: 3.932, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.229', 'AMMO2': '0.017', 'AMMO3': '0.065', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.278', 'HITCOUNT': '0.310', 'WEAPON3': '0.450', 'weapon2': '0.878', 'DAMAGECOUNT': '1.080', 'weapon3': '1.176', 'ARMOR': '1.371', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:11,283][52649] DAMAGECOUNT value on done: 7445.0 [2024-08-05 22:23:11,284][52649] Sum rewards: 7.961, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.972', 'AMMO2': '0.026', 'AMMO3': '0.118', 'AMMO4': '0.130', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon3': '1.652', 'weapon2': '1.742', 'ARMOR': '1.829', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:12,228][52658] DAMAGECOUNT value on done: 5502.0 [2024-08-05 22:23:12,229][52658] Sum rewards: 2.114, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.573', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'ARMOR': '0.564', 'WEAPON3': '0.600', 'weapon2': '0.628', 'weapon4': '0.806', 'DAMAGECOUNT': '1.311', 'weapon3': '1.710', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:12,231][52650] Updated weights for policy 0, policy_version 7221 (0.0013) [2024-08-05 22:23:12,274][52647] Large shaping reward 3.246 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.195, 65.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:23:12,414][52647] DAMAGECOUNT value on done: 7304.0 [2024-08-05 22:23:12,415][52647] Sum rewards: 4.212, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'HEALTH': '0.129', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.234', 'DAMAGECOUNT': '1.710', 'weapon3': '2.202', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:12,434][52665] DAMAGECOUNT value on done: 6398.0 [2024-08-05 22:23:12,435][52665] Sum rewards: 4.685, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.033', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'ARMOR': '0.455', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon2': '1.238', 'weapon3': '2.056', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:12,448][52663] DAMAGECOUNT value on done: 6008.0 [2024-08-05 22:23:12,449][52663] Sum rewards: 4.545, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.106', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.342', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'ARMOR': '1.048', 'weapon2': '1.300', 'weapon3': '1.812', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 59162624. Throughput: 0: 4226.3. Samples: 14797750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:23:12,794][52567] Avg episode reward: [(0, '6.022')] [2024-08-05 22:23:12,811][52667] DAMAGECOUNT value on done: 6619.0 [2024-08-05 22:23:12,813][52667] Sum rewards: 4.817, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.113', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.282', 'HITCOUNT': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.973', 'DAMAGECOUNT': '0.981', 'weapon3': '1.184', 'weapon2': '1.268', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:13,250][52670] DAMAGECOUNT value on done: 5760.0 [2024-08-05 22:23:13,251][52670] Sum rewards: 2.456, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.079', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.119', 'HITCOUNT': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.326', 'DAMAGECOUNT': '1.365', 'weapon3': '1.756', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:13,851][52664] DAMAGECOUNT value on done: 7775.0 [2024-08-05 22:23:13,852][52664] Sum rewards: 4.239, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.396', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'ARMOR': '0.451', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.522', 'weapon3': '1.636', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:13,880][52666] DAMAGECOUNT value on done: 6724.0 [2024-08-05 22:23:13,880][52666] Sum rewards: 1.017, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'weapon4': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.894', 'weapon2': '1.432', 'weapon3': '1.706', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:14,583][52649] DAMAGECOUNT value on done: 5521.0 [2024-08-05 22:23:14,585][52649] Sum rewards: 3.644, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.396', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.244', 'ARMOR': '0.522', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.212', 'weapon3': '1.568', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:14,780][52658] DAMAGECOUNT value on done: 6393.0 [2024-08-05 22:23:14,782][52658] Sum rewards: 6.706, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.806', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.070', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '1.604', 'weapon3': '1.686', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:15,170][52647] DAMAGECOUNT value on done: 6867.0 [2024-08-05 22:23:15,172][52647] Sum rewards: 5.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.279', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.124', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'HITCOUNT': '0.920', 'WEAPON3': '1.000', 'weapon2': '1.190', 'weapon3': '1.752', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:15,404][52663] DAMAGECOUNT value on done: 6059.0 [2024-08-05 22:23:15,404][52663] Sum rewards: 7.632, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.736', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.098', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.356', 'weapon3': '1.830', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:15,547][52665] DAMAGECOUNT value on done: 6571.0 [2024-08-05 22:23:15,547][52665] Sum rewards: 4.401, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.324', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'weapon3': '1.146', 'DAMAGECOUNT': '1.422', 'weapon2': '1.666', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:15,720][52667] DAMAGECOUNT value on done: 7219.0 [2024-08-05 22:23:15,722][52667] Sum rewards: 7.281, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.594', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.286', 'HITCOUNT': '0.500', 'ARMOR': '0.551', 'WEAPON3': '0.750', 'weapon2': '1.326', 'weapon3': '1.958', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:16,162][52670] DAMAGECOUNT value on done: 5412.0 [2024-08-05 22:23:16,162][52670] Sum rewards: 1.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.884', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon4': '0.230', 'HITCOUNT': '0.750', 'ARMOR': '0.911', 'weapon2': '1.042', 'WEAPON3': '1.250', 'weapon3': '2.274', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:16,568][52664] DAMAGECOUNT value on done: 6813.0 [2024-08-05 22:23:16,568][52664] Sum rewards: 10.792, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.820', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO3': '0.143', 'ARMOR': '0.424', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.264', 'weapon3': '2.198', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '11.000'} [2024-08-05 22:23:16,925][52666] DAMAGECOUNT value on done: 5486.0 [2024-08-05 22:23:16,926][52666] Sum rewards: 10.588, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.270', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.840', 'ARMOR': '0.952', 'weapon3': '1.644', 'weapon2': '1.768', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '9.000'} [2024-08-05 22:23:17,248][52650] Updated weights for policy 0, policy_version 7231 (0.0050) [2024-08-05 22:23:17,495][52647] DAMAGECOUNT value on done: 6928.0 [2024-08-05 22:23:17,496][52647] Sum rewards: 8.399, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.977', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'ARMOR': '0.511', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.476', 'weapon3': '1.858', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:17,755][52649] DAMAGECOUNT value on done: 7331.0 [2024-08-05 22:23:17,755][52649] Sum rewards: 9.803, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.001', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.045', 'AMMO3': '0.070', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.188', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon2': '1.432', 'weapon3': '1.578', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 59244544. Throughput: 0: 4230.4. Samples: 14810360. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:23:17,795][52567] Avg episode reward: [(0, '6.067')] [2024-08-05 22:23:18,057][52658] DAMAGECOUNT value on done: 6864.0 [2024-08-05 22:23:18,059][52658] Sum rewards: 4.244, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.365', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.106', 'AMMO3': '0.115', 'ARMOR': '0.457', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.104', 'weapon3': '1.566', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:18,740][52667] DAMAGECOUNT value on done: 6317.0 [2024-08-05 22:23:18,740][52667] Sum rewards: 8.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.568', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.104', 'AMMO3': '0.120', 'weapon4': '0.132', 'WEAPON5': '0.150', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.334', 'weapon3': '1.730', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '9.000'} [2024-08-05 22:23:18,759][52665] DAMAGECOUNT value on done: 5956.0 [2024-08-05 22:23:18,760][52665] Sum rewards: 14.209, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.422', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.061', 'ARMOR': '0.072', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.392', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'weapon2': '0.990', 'weapon3': '1.460', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '10.000'} [2024-08-05 22:23:18,912][52664] DAMAGECOUNT value on done: 7235.0 [2024-08-05 22:23:18,912][52664] Sum rewards: 0.559, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.472', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.137', 'HITCOUNT': '0.460', 'ARMOR': '0.479', 'WEAPON3': '0.700', 'weapon3': '1.430', 'DAMAGECOUNT': '1.548', 'weapon2': '1.782', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:19,031][52663] DAMAGECOUNT value on done: 6370.0 [2024-08-05 22:23:19,032][52663] Sum rewards: 6.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.558', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.112', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'ARMOR': '0.941', 'weapon3': '1.392', 'weapon2': '1.460', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:19,098][52670] DAMAGECOUNT value on done: 5969.0 [2024-08-05 22:23:19,099][52670] Sum rewards: 4.277, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.050', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.084', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon4': '0.236', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'weapon2': '1.148', 'DAMAGECOUNT': '1.710', 'weapon3': '1.730', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:19,780][52647] DAMAGECOUNT value on done: 6771.0 [2024-08-05 22:23:19,780][52647] Sum rewards: 7.494, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.431', 'AMMO2': '0.030', 'AMMO3': '0.123', 'ARMOR': '0.134', 'AMMO4': '0.151', 'weapon4': '0.256', 'WEAPON4': '0.300', 'HITCOUNT': '0.640', 'weapon2': '0.942', 'WEAPON3': '0.950', 'weapon3': '1.886', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '9.000'} [2024-08-05 22:23:19,982][52666] DAMAGECOUNT value on done: 5821.0 [2024-08-05 22:23:19,982][52666] Sum rewards: 5.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.432', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.088', 'HITCOUNT': '0.360', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.197', 'ARMOR': '1.344', 'weapon2': '1.532', 'weapon3': '1.704', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:20,713][52658] DAMAGECOUNT value on done: 5633.0 [2024-08-05 22:23:20,713][52658] Sum rewards: 2.213, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.438', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.099', 'weapon4': '0.198', 'ARMOR': '0.464', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.138', 'DAMAGECOUNT': '1.605', 'weapon3': '1.792', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:21,014][52649] DAMAGECOUNT value on done: 5579.0 [2024-08-05 22:23:21,014][52649] Sum rewards: 3.376, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.034', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'HITCOUNT': '0.440', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.425', 'weapon2': '1.498', 'weapon3': '1.974', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:21,241][52667] DAMAGECOUNT value on done: 7227.0 [2024-08-05 22:23:21,242][52667] Sum rewards: 6.386, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.138', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'weapon3': '1.462', 'ARMOR': '1.654', 'weapon2': '1.794', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:21,627][52664] DAMAGECOUNT value on done: 6016.0 [2024-08-05 22:23:21,628][52664] Sum rewards: 9.449, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.216', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.154', 'weapon3': '1.962', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:21,956][52665] DAMAGECOUNT value on done: 7429.0 [2024-08-05 22:23:21,957][52665] Sum rewards: 2.076, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.446', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.026', 'AMMO4': '0.074', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.502', 'HITCOUNT': '0.600', 'weapon2': '0.830', 'ARMOR': '0.947', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.896', 'weapon3': '2.068', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:22,030][52650] Updated weights for policy 0, policy_version 7241 (0.0026) [2024-08-05 22:23:22,366][52670] DAMAGECOUNT value on done: 6930.0 [2024-08-05 22:23:22,370][52670] Sum rewards: 8.135, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.108', 'weapon4': '0.162', 'WEAPON4': '0.200', 'ARMOR': '0.440', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.246', 'weapon3': '1.872', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 59326464. Throughput: 0: 4236.7. Samples: 14835930. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:23:22,794][52567] Avg episode reward: [(0, '6.076')] [2024-08-05 22:23:23,209][52671] DAMAGECOUNT value on done: 8155.0 [2024-08-05 22:23:23,209][52671] Sum rewards: 12.348, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.773', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'weapon4': '0.286', 'WEAPON3': '0.500', 'ARMOR': '0.515', 'HITCOUNT': '0.860', 'weapon3': '1.358', 'weapon2': '1.532', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '9.000'} [2024-08-05 22:23:23,319][52666] DAMAGECOUNT value on done: 5886.0 [2024-08-05 22:23:23,320][52666] Sum rewards: 4.733, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO4': '0.043', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.284', 'HITCOUNT': '0.470', 'WEAPON3': '0.750', 'weapon2': '1.034', 'DAMAGECOUNT': '1.773', 'weapon3': '2.110', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:23,631][52658] DAMAGECOUNT value on done: 7725.0 [2024-08-05 22:23:23,633][52658] Sum rewards: 6.622, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.842', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.113', 'weapon4': '0.132', 'ARMOR': '0.453', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.526', 'weapon3': '1.872', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:23,699][52649] DAMAGECOUNT value on done: 5991.0 [2024-08-05 22:23:23,701][52649] Sum rewards: 12.700, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.691', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.070', 'AMMO4': '0.076', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'ARMOR': '1.283', 'weapon2': '1.478', 'weapon3': '1.926', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '10.000'} [2024-08-05 22:23:24,464][52664] DAMAGECOUNT value on done: 7087.0 [2024-08-05 22:23:24,473][52664] Sum rewards: 2.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.653', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'ARMOR': '0.032', 'AMMO3': '0.131', 'HITCOUNT': '0.530', 'WEAPON3': '0.850', 'weapon2': '1.326', 'DAMAGECOUNT': '1.794', 'weapon3': '1.852', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:24,504][52667] DAMAGECOUNT value on done: 7400.0 [2024-08-05 22:23:24,507][52667] Sum rewards: 7.373, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.174', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.027', 'ARMOR': '0.036', 'AMMO3': '0.105', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon2': '1.428', 'weapon3': '1.852', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:25,720][52670] DAMAGECOUNT value on done: 7266.0 [2024-08-05 22:23:25,722][52670] Sum rewards: 6.058, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.995', 'AMMO2': '0.011', 'ARMOR': '0.024', 'AMMO4': '0.055', 'AMMO3': '0.075', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon2': '1.528', 'weapon3': '1.580', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:25,746][52671] DAMAGECOUNT value on done: 6403.0 [2024-08-05 22:23:25,747][52671] Sum rewards: 4.366, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.019', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.278', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'ARMOR': '0.914', 'weapon2': '1.288', 'weapon3': '1.294', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:26,641][52666] DAMAGECOUNT value on done: 5866.0 [2024-08-05 22:23:26,645][52666] Sum rewards: 8.363, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.028', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'ARMOR': '1.357', 'weapon3': '1.580', 'weapon2': '1.662', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:26,754][52650] Updated weights for policy 0, policy_version 7251 (0.0051) [2024-08-05 22:23:27,020][52664] DAMAGECOUNT value on done: 6735.0 [2024-08-05 22:23:27,021][52664] Sum rewards: 5.455, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.784', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO3': '0.067', 'HITCOUNT': '0.370', 'WEAPON3': '0.500', 'weapon3': '1.090', 'weapon2': '1.160', 'ARMOR': '1.413', 'DAMAGECOUNT': '1.476', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:27,096][52649] DAMAGECOUNT value on done: 6272.0 [2024-08-05 22:23:27,096][52649] Sum rewards: 3.114, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.840', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'ARMOR': '0.464', 'HITCOUNT': '0.670', 'WEAPON3': '1.250', 'weapon2': '1.282', 'weapon3': '2.120', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:27,157][52658] DAMAGECOUNT value on done: 7042.0 [2024-08-05 22:23:27,159][52658] Sum rewards: 7.754, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.964', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.106', 'ARMOR': '0.159', 'WEAPON4': '0.300', 'weapon4': '0.334', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '0.860', 'weapon3': '2.202', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:27,635][52667] DAMAGECOUNT value on done: 7774.0 [2024-08-05 22:23:27,635][52667] Sum rewards: 5.926, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.048', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.066', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'ARMOR': '0.930', 'weapon2': '1.738', 'weapon3': '1.890', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.7, 300 sec: 16828.3). Total num frames: 59408384. Throughput: 0: 4235.8. Samples: 14861280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:23:27,794][52567] Avg episode reward: [(0, '5.961')] [2024-08-05 22:23:28,860][52671] DAMAGECOUNT value on done: 6997.0 [2024-08-05 22:23:28,860][52671] Sum rewards: 7.549, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.026', 'AMMO3': '0.080', 'ARMOR': '0.104', 'HEALTH': '0.113', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.476', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon2': '0.844', 'weapon3': '1.850', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:29,021][52670] DAMAGECOUNT value on done: 6350.0 [2024-08-05 22:23:29,023][52670] Sum rewards: 3.757, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.162', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.176', 'HITCOUNT': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.222', 'DAMAGECOUNT': '1.533', 'weapon3': '1.558', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:29,860][52659] DAMAGECOUNT value on done: 6360.0 [2024-08-05 22:23:29,861][52659] Sum rewards: 8.187, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.252', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.396', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon2': '1.274', 'weapon3': '1.292', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:29,938][52664] DAMAGECOUNT value on done: 7147.0 [2024-08-05 22:23:29,940][52664] Sum rewards: 8.479, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.946', 'AMMO2': '0.019', 'AMMO3': '0.064', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.278', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'ARMOR': '0.894', 'weapon3': '1.316', 'weapon2': '1.418', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:29,962][52658] DAMAGECOUNT value on done: 5983.0 [2024-08-05 22:23:29,962][52658] Sum rewards: 8.894, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.317', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.246', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.084', 'weapon3': '1.528', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:30,070][52666] DAMAGECOUNT value on done: 6153.0 [2024-08-05 22:23:30,071][52666] Sum rewards: 6.202, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.672', 'HITCOUNT': '0.770', 'ARMOR': '0.966', 'weapon2': '0.972', 'WEAPON3': '1.000', 'weapon3': '1.686', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:30,359][52649] DAMAGECOUNT value on done: 6292.0 [2024-08-05 22:23:30,359][52649] Sum rewards: 12.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.254', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.111', 'WEAPON3': '0.700', 'ARMOR': '0.861', 'HITCOUNT': '0.990', 'weapon2': '1.446', 'weapon3': '1.796', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '10.000'} [2024-08-05 22:23:30,642][52667] DAMAGECOUNT value on done: 7273.0 [2024-08-05 22:23:30,643][52667] Sum rewards: 5.217, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.934', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'ARMOR': '0.424', 'HITCOUNT': '0.520', 'WEAPON3': '0.800', 'weapon3': '1.254', 'DAMAGECOUNT': '1.641', 'weapon2': '1.948', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:31,584][52650] Updated weights for policy 0, policy_version 7261 (0.0011) [2024-08-05 22:23:31,858][52671] DAMAGECOUNT value on done: 6812.0 [2024-08-05 22:23:31,858][52671] Sum rewards: 5.829, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.988', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.089', 'ARMOR': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.326', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.218', 'weapon3': '1.680', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:32,380][52670] DAMAGECOUNT value on done: 7019.0 [2024-08-05 22:23:32,384][52670] Sum rewards: 4.989, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.107', 'weapon5': '0.244', 'HEALTH': '0.252', 'weapon4': '0.278', 'HITCOUNT': '0.470', 'WEAPON3': '0.600', 'ARMOR': '0.804', 'weapon2': '1.140', 'weapon3': '1.642', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:32,741][52664] DAMAGECOUNT value on done: 7115.0 [2024-08-05 22:23:32,742][52664] Sum rewards: 7.111, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.130', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO3': '0.089', 'AMMO4': '0.093', 'weapon5': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.402', 'ARMOR': '0.566', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '0.956', 'weapon3': '1.808', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 59498496. Throughput: 0: 4240.2. Samples: 14874090. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:23:32,794][52567] Avg episode reward: [(0, '6.066')] [2024-08-05 22:23:33,078][52658] DAMAGECOUNT value on done: 6076.0 [2024-08-05 22:23:33,082][52658] Sum rewards: 1.393, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.540', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.102', 'weapon4': '0.246', 'HITCOUNT': '0.420', 'ARMOR': '0.537', 'WEAPON3': '0.550', 'weapon2': '0.780', 'DAMAGECOUNT': '1.386', 'weapon3': '1.838', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:33,291][52666] DAMAGECOUNT value on done: 6348.0 [2024-08-05 22:23:33,291][52666] Sum rewards: 5.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.926', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'ARMOR': '0.492', 'weapon4': '0.528', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '0.954', 'weapon3': '1.920', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:33,291][52659] DAMAGECOUNT value on done: 7555.0 [2024-08-05 22:23:33,292][52659] Sum rewards: 2.439, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon4': '0.238', 'HITCOUNT': '0.510', 'weapon2': '0.788', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.809', 'weapon3': '2.048', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:33,449][52649] DAMAGECOUNT value on done: 6397.0 [2024-08-05 22:23:33,450][52649] Sum rewards: 7.284, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.274', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.106', 'WEAPON3': '0.400', 'ARMOR': '0.509', 'HITCOUNT': '0.650', 'weapon3': '1.174', 'weapon2': '1.434', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:33,567][52667] DAMAGECOUNT value on done: 5912.0 [2024-08-05 22:23:33,570][52667] Sum rewards: 2.576, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'weapon4': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HITCOUNT': '0.230', 'HEALTH': '0.244', 'WEAPON3': '0.450', 'weapon2': '0.714', 'DAMAGECOUNT': '0.870', 'weapon3': '1.324', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:35,284][52671] DAMAGECOUNT value on done: 6844.0 [2024-08-05 22:23:35,285][52671] Sum rewards: 6.953, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.572', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon4': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'ARMOR': '0.879', 'weapon2': '1.256', 'weapon3': '1.530', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:35,445][52664] DAMAGECOUNT value on done: 6702.0 [2024-08-05 22:23:35,445][52664] Sum rewards: 4.943, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.018', 'ARMOR': '0.068', 'AMMO4': '0.092', 'AMMO3': '0.118', 'weapon4': '0.130', 'WEAPON4': '0.200', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon2': '1.632', 'weapon3': '1.834', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:35,581][52658] DAMAGECOUNT value on done: 6986.0 [2024-08-05 22:23:35,581][52658] Sum rewards: 2.747, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.270', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.302', 'HITCOUNT': '0.440', 'ARMOR': '0.520', 'WEAPON3': '0.950', 'weapon2': '1.214', 'DAMAGECOUNT': '1.476', 'weapon3': '2.050', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:35,656][52670] DAMAGECOUNT value on done: 6150.0 [2024-08-05 22:23:35,656][52670] Sum rewards: 1.851, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.012', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO3': '0.140', 'HITCOUNT': '0.430', 'ARMOR': '0.520', 'WEAPON3': '0.850', 'weapon2': '1.540', 'weapon3': '1.702', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:36,016][52667] DAMAGECOUNT value on done: 6581.0 [2024-08-05 22:23:36,018][52667] Sum rewards: 2.369, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'weapon4': '0.274', 'HITCOUNT': '0.430', 'WEAPON3': '0.900', 'ARMOR': '0.978', 'weapon2': '1.304', 'DAMAGECOUNT': '1.593', 'weapon3': '1.824', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:36,486][52649] DAMAGECOUNT value on done: 5622.0 [2024-08-05 22:23:36,486][52649] Sum rewards: 2.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.974', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'ARMOR': '1.320', 'weapon3': '1.516', 'DAMAGECOUNT': '1.647', 'weapon2': '1.674', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:36,577][52666] DAMAGECOUNT value on done: 5838.0 [2024-08-05 22:23:36,579][52666] Sum rewards: -0.522, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.507', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.161', 'HITCOUNT': '0.480', 'ARMOR': '0.509', 'weapon2': '0.900', 'WEAPON3': '1.100', 'DAMAGECOUNT': '1.635', 'weapon3': '2.242', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:36,592][52659] DAMAGECOUNT value on done: 6392.0 [2024-08-05 22:23:36,592][52659] Sum rewards: 2.411, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.069', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.206', 'ARMOR': '0.448', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon2': '1.336', 'weapon3': '1.900', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:36,735][52650] Updated weights for policy 0, policy_version 7271 (0.0019) [2024-08-05 22:23:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 59580416. Throughput: 0: 4235.6. Samples: 14899600. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:23:37,795][52567] Avg episode reward: [(0, '5.703')] [2024-08-05 22:23:38,432][52658] DAMAGECOUNT value on done: 6326.0 [2024-08-05 22:23:38,434][52658] Sum rewards: 6.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.929', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'ARMOR': '1.291', 'weapon3': '1.686', 'weapon2': '1.696', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:38,437][52671] DAMAGECOUNT value on done: 6550.0 [2024-08-05 22:23:38,437][52671] Sum rewards: 6.557, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.402', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'weapon4': '0.162', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '1.060', 'weapon3': '2.004', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:38,612][52664] DAMAGECOUNT value on done: 7289.0 [2024-08-05 22:23:38,612][52664] Sum rewards: 11.364, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.986', 'AMMO2': '0.018', 'weapon4': '0.078', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON3': '0.800', 'ARMOR': '0.851', 'HITCOUNT': '0.930', 'weapon3': '1.224', 'weapon2': '1.664', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '12.000'} [2024-08-05 22:23:38,866][52670] DAMAGECOUNT value on done: 5647.0 [2024-08-05 22:23:38,870][52670] Sum rewards: 9.060, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.782', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'weapon4': '0.120', 'AMMO3': '0.129', 'HITCOUNT': '0.820', 'WEAPON3': '0.950', 'ARMOR': '0.964', 'weapon2': '1.288', 'weapon3': '2.094', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '9.000'} [2024-08-05 22:23:38,884][52667] DAMAGECOUNT value on done: 7417.0 [2024-08-05 22:23:38,886][52667] Sum rewards: 7.530, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.455', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.282', 'ARMOR': '0.523', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.584', 'weapon3': '1.806', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:39,481][52649] DAMAGECOUNT value on done: 7538.0 [2024-08-05 22:23:39,483][52649] Sum rewards: 4.137, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.242', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.198', 'ARMOR': '0.496', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'weapon3': '1.524', 'weapon2': '1.610', 'DAMAGECOUNT': '1.647', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:39,717][52659] DAMAGECOUNT value on done: 7250.0 [2024-08-05 22:23:39,719][52659] Sum rewards: 6.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.835', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.698', 'weapon3': '1.854', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:39,823][52666] DAMAGECOUNT value on done: 5221.0 [2024-08-05 22:23:39,824][52666] Sum rewards: 6.017, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.544', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.126', 'ARMOR': '0.540', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.324', 'weapon3': '1.428', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:41,266][52658] DAMAGECOUNT value on done: 6017.0 [2024-08-05 22:23:41,267][52658] Sum rewards: 1.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.195', 'HITCOUNT': '0.940', 'weapon2': '0.954', 'WEAPON3': '1.350', 'weapon3': '2.822', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:41,380][52671] DAMAGECOUNT value on done: 7410.0 [2024-08-05 22:23:41,382][52671] Sum rewards: 4.738, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.292', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon5': '0.074', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'ARMOR': '0.964', 'weapon2': '1.350', 'weapon3': '1.900', 'DAMAGECOUNT': '2.313', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:41,407][52650] Updated weights for policy 0, policy_version 7281 (0.0044) [2024-08-05 22:23:41,459][52664] DAMAGECOUNT value on done: 5967.0 [2024-08-05 22:23:41,459][52664] Sum rewards: 5.698, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.749', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.145', 'HITCOUNT': '0.460', 'weapon4': '0.466', 'WEAPON3': '0.850', 'ARMOR': '0.889', 'weapon3': '1.394', 'weapon2': '1.618', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:41,801][52667] DAMAGECOUNT value on done: 6766.0 [2024-08-05 22:23:41,803][52667] Sum rewards: 6.376, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.030', 'weapon5': '0.038', 'AMMO4': '0.055', 'ARMOR': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'weapon4': '0.294', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.060', 'DAMAGECOUNT': '2.085', 'weapon3': '2.212', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:42,237][52670] DAMAGECOUNT value on done: 5940.0 [2024-08-05 22:23:42,238][52670] Sum rewards: 2.854, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.895', 'AMMO2': '0.004', 'AMMO4': '0.017', 'ARMOR': '0.068', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.172', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.498', 'weapon3': '1.508', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.268'} [2024-08-05 22:23:42,480][52659] DAMAGECOUNT value on done: 5924.0 [2024-08-05 22:23:42,481][52659] Sum rewards: 5.476, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.026', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '0.853', 'weapon3': '1.516', 'DAMAGECOUNT': '1.950', 'weapon2': '2.114', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:42,751][52649] DAMAGECOUNT value on done: 5857.0 [2024-08-05 22:23:42,751][52649] Sum rewards: 9.428, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.263', 'AMMO2': '0.024', 'AMMO3': '0.101', 'ARMOR': '0.108', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'weapon4': '0.728', 'HITCOUNT': '0.730', 'weapon2': '0.776', 'weapon3': '1.774', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:42,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16794.3, 300 sec: 16828.3). Total num frames: 59662336. Throughput: 0: 4238.2. Samples: 14925220. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 22:23:42,795][52567] Avg episode reward: [(0, '5.674')] [2024-08-05 22:23:43,041][52666] DAMAGECOUNT value on done: 6220.0 [2024-08-05 22:23:43,042][52666] Sum rewards: 5.230, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.639', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.086', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.240', 'HITCOUNT': '0.670', 'WEAPON3': '0.850', 'weapon2': '1.546', 'weapon3': '1.838', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:43,997][52671] DAMAGECOUNT value on done: 5898.0 [2024-08-05 22:23:43,999][52671] Sum rewards: 14.286, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.851', 'AMMO2': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'weapon5': '0.060', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.840', 'HITCOUNT': '1.010', 'weapon2': '1.516', 'weapon3': '1.752', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '11.000'} [2024-08-05 22:23:44,329][52658] DAMAGECOUNT value on done: 6726.0 [2024-08-05 22:23:44,329][52658] Sum rewards: 2.275, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.877', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.356', 'ARMOR': '0.476', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon3': '1.262', 'weapon2': '1.292', 'DAMAGECOUNT': '1.521', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:44,758][52664] DAMAGECOUNT value on done: 6032.0 [2024-08-05 22:23:44,758][52664] Sum rewards: 7.994, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.222', 'AMMO2': '0.024', 'AMMO3': '0.089', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'ARMOR': '0.559', 'weapon4': '0.618', 'HITCOUNT': '0.660', 'weapon2': '1.124', 'weapon3': '1.442', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:44,973][52667] DAMAGECOUNT value on done: 7254.0 [2024-08-05 22:23:44,975][52667] Sum rewards: 15.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.024', 'AMMO2': '0.036', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'weapon4': '0.228', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'HITCOUNT': '0.850', 'weapon2': '1.430', 'weapon3': '1.980', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '13.000'} [2024-08-05 22:23:45,230][52659] DAMAGECOUNT value on done: 5854.0 [2024-08-05 22:23:45,231][52659] Sum rewards: 6.505, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.080', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.208', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'ARMOR': '0.960', 'weapon2': '1.298', 'weapon3': '1.592', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:45,433][52670] DAMAGECOUNT value on done: 7367.0 [2024-08-05 22:23:45,434][52670] Sum rewards: 13.310, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.560', 'AMMO4': '-0.123', 'AMMO2': '-0.025', 'AMMO3': '0.070', 'ARMOR': '0.449', 'WEAPON3': '0.600', 'HITCOUNT': '1.260', 'weapon3': '1.458', 'weapon2': '2.042', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '10.000'} [2024-08-05 22:23:45,708][52649] DAMAGECOUNT value on done: 6344.0 [2024-08-05 22:23:45,709][52649] Sum rewards: 6.976, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.660', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.162', 'HITCOUNT': '0.400', 'ARMOR': '0.477', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.275', 'weapon2': '1.386', 'weapon3': '1.546', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:46,357][52650] Updated weights for policy 0, policy_version 7291 (0.0020) [2024-08-05 22:23:46,462][52666] DAMAGECOUNT value on done: 7414.0 [2024-08-05 22:23:46,464][52666] Sum rewards: 2.373, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.794', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.045', 'weapon7': '0.050', 'ARMOR': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'HITCOUNT': '0.220', 'weapon4': '0.344', 'WEAPON3': '0.350', 'weapon2': '0.826', 'DAMAGECOUNT': '0.828', 'weapon3': '0.862', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:47,236][52671] DAMAGECOUNT value on done: 7776.0 [2024-08-05 22:23:47,237][52671] Sum rewards: 4.385, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'HEALTH': '0.068', 'weapon4': '0.092', 'AMMO4': '0.111', 'AMMO3': '0.116', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'ARMOR': '0.832', 'weapon3': '1.406', 'weapon2': '1.438', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:47,318][52658] DAMAGECOUNT value on done: 7048.0 [2024-08-05 22:23:47,319][52658] Sum rewards: 7.519, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.800', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.085', 'weapon5': '0.094', 'ARMOR': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.300', 'weapon4': '0.430', 'WEAPON3': '0.450', 'weapon2': '0.932', 'DAMAGECOUNT': '0.990', 'weapon3': '1.366', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 59752448. Throughput: 0: 4237.1. Samples: 14937790. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 22:23:47,794][52567] Avg episode reward: [(0, '5.927')] [2024-08-05 22:23:47,995][52664] DAMAGECOUNT value on done: 5855.0 [2024-08-05 22:23:48,000][52664] Sum rewards: 16.706, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.164', 'AMMO2': '0.018', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.127', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'ARMOR': '0.948', 'weapon2': '1.348', 'weapon3': '2.076', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '15.000'} [2024-08-05 22:23:48,342][52649] DAMAGECOUNT value on done: 6712.0 [2024-08-05 22:23:48,342][52649] Sum rewards: 11.127, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.012', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.158', 'ARMOR': '0.523', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.424', 'weapon3': '1.838', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '9.000'} [2024-08-05 22:23:48,462][52659] DAMAGECOUNT value on done: 7162.0 [2024-08-05 22:23:48,463][52659] Sum rewards: 7.994, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.126', 'AMMO5': '0.003', 'weapon4': '0.006', 'weapon5': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon2': '1.054', 'weapon3': '1.522', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:48,923][52670] DAMAGECOUNT value on done: 6490.0 [2024-08-05 22:23:48,925][52670] Sum rewards: 6.937, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.378', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.088', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'ARMOR': '0.526', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '0.882', 'weapon3': '2.002', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:49,923][52666] DAMAGECOUNT value on done: 6690.0 [2024-08-05 22:23:49,924][52666] Sum rewards: 5.421, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.084', 'weapon4': '0.200', 'HEALTH': '0.352', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'ARMOR': '0.832', 'DAMAGECOUNT': '1.155', 'weapon3': '1.186', 'weapon2': '1.554', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:50,114][52658] DAMAGECOUNT value on done: 7356.0 [2024-08-05 22:23:50,116][52658] Sum rewards: 4.890, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.610', 'AMMO4': '-0.121', 'AMMO2': '-0.024', 'AMMO3': '0.079', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon3': '1.426', 'ARMOR': '1.799', 'weapon2': '1.864', 'DAMAGECOUNT': '1.947', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:50,325][52671] DAMAGECOUNT value on done: 6377.0 [2024-08-05 22:23:50,325][52671] Sum rewards: 0.965, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.018', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.316', 'HITCOUNT': '0.490', 'ARMOR': '0.553', 'WEAPON3': '0.700', 'FRAGCOUNT': '1.000', 'weapon2': '1.320', 'DAMAGECOUNT': '1.425', 'weapon3': '1.836'} [2024-08-05 22:23:51,195][52650] Updated weights for policy 0, policy_version 7301 (0.0028) [2024-08-05 22:23:51,351][52659] DAMAGECOUNT value on done: 5661.0 [2024-08-05 22:23:51,354][52659] Sum rewards: 7.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.209', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.101', 'AMMO4': '0.105', 'ARMOR': '0.112', 'weapon4': '0.212', 'WEAPON4': '0.300', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.976', 'weapon3': '2.128', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:51,717][52649] DAMAGECOUNT value on done: 5831.0 [2024-08-05 22:23:51,718][52649] Sum rewards: 5.082, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.757', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.127', 'weapon4': '0.162', 'WEAPON4': '0.200', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'ARMOR': '0.925', 'weapon2': '1.306', 'weapon3': '2.280', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:51,760][52664] DAMAGECOUNT value on done: 5612.0 [2024-08-05 22:23:51,760][52664] Sum rewards: 6.720, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.258', 'AMMO2': '0.021', 'AMMO3': '0.093', 'AMMO4': '0.105', 'weapon4': '0.106', 'WEAPON4': '0.150', 'ARMOR': '0.430', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.298', 'weapon3': '1.344', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:52,303][52670] DAMAGECOUNT value on done: 6573.0 [2024-08-05 22:23:52,304][52670] Sum rewards: 4.839, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.446', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon4': '0.192', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.448', 'weapon3': '1.464', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17066.7, 300 sec: 16883.8). Total num frames: 59842560. Throughput: 0: 4238.7. Samples: 14963190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:23:52,796][52567] Avg episode reward: [(0, '6.270')] [2024-08-05 22:23:53,222][52671] DAMAGECOUNT value on done: 6497.0 [2024-08-05 22:23:53,225][52671] Sum rewards: 5.212, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.962', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.073', 'WEAPON4': '0.200', 'weapon4': '0.282', 'HITCOUNT': '0.410', 'ARMOR': '0.498', 'WEAPON3': '0.550', 'weapon3': '1.086', 'DAMAGECOUNT': '1.320', 'weapon2': '1.488', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:53,242][52658] DAMAGECOUNT value on done: 7331.0 [2024-08-05 22:23:53,243][52658] Sum rewards: 9.200, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.329', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.018', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.558', 'weapon3': '2.158', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:54,231][52659] DAMAGECOUNT value on done: 6421.0 [2024-08-05 22:23:54,232][52659] Sum rewards: -0.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.074', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.117', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'ARMOR': '0.953', 'weapon2': '1.382', 'DAMAGECOUNT': '1.506', 'weapon3': '1.586', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:54,401][52664] DAMAGECOUNT value on done: 6839.0 [2024-08-05 22:23:54,402][52664] Sum rewards: 3.161, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.002', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO3': '0.088', 'weapon5': '0.094', 'WEAPON5': '0.200', 'HITCOUNT': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.320', 'weapon3': '1.514', 'weapon2': '1.582', 'FRAGCOUNT': '4.000'} [2024-08-05 22:23:54,977][52649] DAMAGECOUNT value on done: 7448.0 [2024-08-05 22:23:54,977][52649] Sum rewards: 11.008, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.967', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon7': '0.054', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.424', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.172', 'weapon3': '1.584', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '8.000'} [2024-08-05 22:23:55,872][52650] Updated weights for policy 0, policy_version 7311 (0.0013) [2024-08-05 22:23:55,985][52658] DAMAGECOUNT value on done: 6570.0 [2024-08-05 22:23:55,985][52658] Sum rewards: 7.882, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.500', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.080', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon3': '1.214', 'ARMOR': '1.256', 'weapon2': '1.718', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:56,531][52668] DAMAGECOUNT value on done: 6727.0 [2024-08-05 22:23:56,531][52668] Sum rewards: 7.384, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.074', 'HEALTH': '0.094', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.258', 'weapon3': '1.806', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '6.000'} [2024-08-05 22:23:56,543][52671] DAMAGECOUNT value on done: 8410.0 [2024-08-05 22:23:56,543][52671] Sum rewards: 6.214, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.726', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'ARMOR': '0.948', 'weapon2': '1.520', 'DAMAGECOUNT': '1.650', 'weapon3': '1.918', 'FRAGCOUNT': '5.000'} [2024-08-05 22:23:57,139][52614] Signal inference workers to stop experience collection... (1350 times) [2024-08-05 22:23:57,140][52614] Signal inference workers to resume experience collection... (1350 times) [2024-08-05 22:23:57,184][52650] InferenceWorker_p0-w0: stopping experience collection (1350 times) [2024-08-05 22:23:57,185][52650] InferenceWorker_p0-w0: resuming experience collection (1350 times) [2024-08-05 22:23:57,516][52664] DAMAGECOUNT value on done: 5831.0 [2024-08-05 22:23:57,516][52649] DAMAGECOUNT value on done: 6242.0 [2024-08-05 22:23:57,519][52664] Sum rewards: 4.951, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.488', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon7': '0.048', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.240', 'weapon4': '0.266', 'WEAPON3': '0.300', 'ARMOR': '0.956', 'weapon3': '0.996', 'DAMAGECOUNT': '1.149', 'weapon2': '1.680', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:57,518][52659] DAMAGECOUNT value on done: 7556.0 [2024-08-05 22:23:57,519][52649] Sum rewards: 1.508, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.722', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.032', 'ARMOR': '0.081', 'AMMO4': '0.093', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.356', 'WEAPON3': '0.650', 'weapon2': '0.754', 'DAMAGECOUNT': '1.104', 'weapon3': '1.640', 'FRAGCOUNT': '2.000'} [2024-08-05 22:23:57,523][52659] Sum rewards: 10.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.894', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.164', 'ARMOR': '0.448', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.428', 'weapon3': '1.802', 'DAMAGECOUNT': '2.103', 'FRAGCOUNT': '10.000'} [2024-08-05 22:23:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 59924480. Throughput: 0: 4244.7. Samples: 14988760. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 22:23:57,794][52567] Avg episode reward: [(0, '6.267')] [2024-08-05 22:23:58,824][52658] DAMAGECOUNT value on done: 6362.0 [2024-08-05 22:23:58,825][52658] Sum rewards: 7.673, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.290', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.180', 'weapon3': '1.538', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '7.000'} [2024-08-05 22:23:59,252][52668] DAMAGECOUNT value on done: 7526.0 [2024-08-05 22:23:59,253][52671] DAMAGECOUNT value on done: 7430.0 [2024-08-05 22:23:59,255][52671] Sum rewards: 4.512, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.081', 'AMMO3': '0.083', 'WEAPON5': '0.150', 'HEALTH': '0.376', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'ARMOR': '0.832', 'weapon2': '1.316', 'weapon3': '1.726', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.000'} [2024-08-05 22:23:59,255][52668] Sum rewards: 10.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.388', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.107', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.320', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.740', 'weapon3': '1.778', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '9.000'} [2024-08-05 22:24:00,139][52659] DAMAGECOUNT value on done: 7472.0 [2024-08-05 22:24:00,139][52659] Sum rewards: 10.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.037', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.232', 'weapon5': '0.344', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'weapon2': '1.416', 'weapon3': '1.672', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:00,194][52664] DAMAGECOUNT value on done: 6190.0 [2024-08-05 22:24:00,194][52664] Sum rewards: 5.520, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.072', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'weapon7': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.450', 'ARMOR': '0.479', 'WEAPON3': '0.500', 'weapon3': '1.262', 'weapon2': '1.400', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:00,419][52650] Updated weights for policy 0, policy_version 7321 (0.0012) [2024-08-05 22:24:00,529][52649] DAMAGECOUNT value on done: 7304.0 [2024-08-05 22:24:00,529][52649] Sum rewards: 12.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.056', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'weapon3': '1.254', 'ARMOR': '1.310', 'weapon2': '1.612', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '10.000'} [2024-08-05 22:24:01,514][52658] DAMAGECOUNT value on done: 7378.0 [2024-08-05 22:24:01,516][52658] Sum rewards: 3.357, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.830', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.040', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.362', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.410', 'weapon3': '1.716', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:01,820][52660] DAMAGECOUNT value on done: 7016.0 [2024-08-05 22:24:01,820][52660] Sum rewards: 5.917, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.874', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.242', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'ARMOR': '0.975', 'weapon2': '1.348', 'weapon3': '1.804', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:02,350][52671] DAMAGECOUNT value on done: 6247.0 [2024-08-05 22:24:02,359][52671] Sum rewards: 2.024, reward structure: {'DEATHCOUNT': '-8.250', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.408', 'HEALTH': '0.424', 'ARMOR': '0.464', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'DAMAGECOUNT': '1.410', 'weapon2': '1.418', 'weapon3': '1.418', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:02,438][52668] DAMAGECOUNT value on done: 5299.0 [2024-08-05 22:24:02,439][52668] Sum rewards: 0.529, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.915', 'FRAGCOUNT': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.016', 'AMMO4': '0.022', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.128', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'WEAPON3': '0.450', 'weapon4': '0.694', 'weapon2': '0.702', 'DAMAGECOUNT': '1.014', 'weapon3': '1.220'} [2024-08-05 22:24:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.1, 300 sec: 16883.9). Total num frames: 60006400. Throughput: 0: 4250.2. Samples: 15001620. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 22:24:02,794][52567] Avg episode reward: [(0, '6.260')] [2024-08-05 22:24:03,186][52664] DAMAGECOUNT value on done: 6367.0 [2024-08-05 22:24:03,187][52664] Sum rewards: 8.667, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.380', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'weapon4': '0.042', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'weapon3': '1.544', 'weapon2': '1.808', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:03,385][52659] DAMAGECOUNT value on done: 6876.0 [2024-08-05 22:24:03,385][52659] Sum rewards: 6.154, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.205', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.060', 'ARMOR': '0.080', 'AMMO4': '0.085', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.160', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.658', 'DAMAGECOUNT': '1.821', 'weapon3': '1.846', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:05,455][52650] Updated weights for policy 0, policy_version 7331 (0.0022) [2024-08-05 22:24:05,487][52660] DAMAGECOUNT value on done: 8002.0 [2024-08-05 22:24:05,490][52660] Sum rewards: 1.577, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.682', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.242', 'HITCOUNT': '0.420', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'weapon2': '1.092', 'DAMAGECOUNT': '1.185', 'weapon3': '1.798', 'FRAGCOUNT': '2.000'} [2024-08-05 22:24:05,509][52671] DAMAGECOUNT value on done: 6887.0 [2024-08-05 22:24:05,509][52671] Sum rewards: 8.121, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.265', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.058', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'ARMOR': '0.921', 'weapon2': '1.212', 'weapon3': '1.554', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:05,883][52668] DAMAGECOUNT value on done: 5888.0 [2024-08-05 22:24:05,884][52668] Sum rewards: 0.130, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'HITCOUNT': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.046', 'DAMAGECOUNT': '1.515', 'weapon3': '1.616', 'FRAGCOUNT': '2.000'} [2024-08-05 22:24:05,971][52664] DAMAGECOUNT value on done: 6016.0 [2024-08-05 22:24:05,971][52664] Sum rewards: 3.534, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.951', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'weapon4': '0.250', 'HITCOUNT': '0.590', 'ARMOR': '0.865', 'WEAPON3': '0.900', 'weapon2': '1.286', 'DAMAGECOUNT': '1.920', 'weapon3': '1.938', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:06,190][52803] DAMAGECOUNT value on done: 7192.0 [2024-08-05 22:24:06,191][52803] Sum rewards: 5.660, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.130', 'weapon4': '0.262', 'HITCOUNT': '0.480', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'HEALTH': '0.924', 'weapon2': '1.062', 'DAMAGECOUNT': '1.797', 'weapon3': '2.112', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:06,681][52659] DAMAGECOUNT value on done: 7047.0 [2024-08-05 22:24:06,683][52659] Sum rewards: 3.731, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.488', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'ARMOR': '0.892', 'weapon2': '1.422', 'weapon3': '1.842', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16883.9). Total num frames: 60096512. Throughput: 0: 4253.3. Samples: 15027330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:24:07,794][52567] Avg episode reward: [(0, '6.043')] [2024-08-05 22:24:08,380][52660] DAMAGECOUNT value on done: 6032.0 [2024-08-05 22:24:08,381][52660] Sum rewards: 6.327, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.117', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.220', 'HITCOUNT': '0.400', 'ARMOR': '0.529', 'WEAPON3': '0.600', 'weapon2': '0.956', 'DAMAGECOUNT': '1.413', 'weapon3': '1.854', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:08,738][52671] DAMAGECOUNT value on done: 6267.0 [2024-08-05 22:24:08,738][52671] Sum rewards: 6.791, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.980', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.046', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'ARMOR': '0.498', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon3': '1.264', 'weapon2': '1.532', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:08,919][52668] DAMAGECOUNT value on done: 6781.0 [2024-08-05 22:24:08,919][52668] Sum rewards: 10.824, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.082', 'AMMO2': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.061', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.214', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon2': '1.002', 'weapon3': '1.850', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '11.000'} [2024-08-05 22:24:09,380][52803] DAMAGECOUNT value on done: 7791.0 [2024-08-05 22:24:09,384][52803] Sum rewards: 8.556, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.083', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon2': '1.102', 'weapon3': '1.734', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:09,422][52664] DAMAGECOUNT value on done: 7066.0 [2024-08-05 22:24:09,424][52664] Sum rewards: 6.348, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.290', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.418', 'ARMOR': '0.529', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.456', 'weapon3': '1.476', 'DAMAGECOUNT': '1.854', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:09,910][52659] DAMAGECOUNT value on done: 8017.0 [2024-08-05 22:24:09,913][52659] Sum rewards: 5.227, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.498', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon4': '0.046', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.790', 'WEAPON3': '0.950', 'ARMOR': '1.349', 'weapon2': '1.396', 'weapon3': '2.112', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:10,031][52650] Updated weights for policy 0, policy_version 7341 (0.0011) [2024-08-05 22:24:11,482][52660] DAMAGECOUNT value on done: 6680.0 [2024-08-05 22:24:11,484][52660] Sum rewards: 7.631, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.346', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.220', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'ARMOR': '0.936', 'weapon2': '1.016', 'weapon3': '1.948', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:11,486][52671] DAMAGECOUNT value on done: 6473.0 [2024-08-05 22:24:11,488][52671] Sum rewards: 8.705, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.662', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'weapon4': '0.086', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.490', 'weapon3': '1.600', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:11,991][52668] DAMAGECOUNT value on done: 6611.0 [2024-08-05 22:24:11,992][52668] Sum rewards: 2.032, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.420', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.192', 'HITCOUNT': '0.340', 'WEAPON3': '0.600', 'ARMOR': '0.869', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.041', 'weapon2': '1.260', 'weapon3': '2.106'} [2024-08-05 22:24:12,573][52659] DAMAGECOUNT value on done: 7283.0 [2024-08-05 22:24:12,576][52659] Sum rewards: 11.124, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.064', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.078', 'WEAPON5': '0.150', 'weapon4': '0.218', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.950', 'weapon2': '1.096', 'weapon3': '1.584', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:12,613][52803] DAMAGECOUNT value on done: 6327.0 [2024-08-05 22:24:12,615][52803] Sum rewards: 4.336, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.070', 'HEALTH': '0.260', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'weapon3': '1.138', 'DAMAGECOUNT': '1.173', 'weapon2': '1.218', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 60178432. Throughput: 0: 4259.6. Samples: 15052960. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:24:12,802][52567] Avg episode reward: [(0, '6.171')] [2024-08-05 22:24:14,374][52671] DAMAGECOUNT value on done: 7433.0 [2024-08-05 22:24:14,374][52671] Sum rewards: 8.716, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.725', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.083', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon3': '1.328', 'weapon2': '1.612', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:14,747][52660] DAMAGECOUNT value on done: 5723.0 [2024-08-05 22:24:14,749][52660] Sum rewards: 3.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.630', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.032', 'ARMOR': '0.088', 'AMMO3': '0.095', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.388', 'DAMAGECOUNT': '1.707', 'weapon3': '1.808', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:14,835][52811] DAMAGECOUNT value on done: 6721.0 [2024-08-05 22:24:14,840][52811] Sum rewards: 1.993, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO5': '0.013', 'AMMO2': '0.018', 'WEAPON1': '0.030', 'ARMOR': '0.032', 'weapon5': '0.048', 'AMMO4': '0.091', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.278', 'HITCOUNT': '0.390', 'WEAPON3': '0.750', 'weapon2': '0.962', 'DAMAGECOUNT': '1.320', 'weapon3': '1.970', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:14,897][52650] Updated weights for policy 0, policy_version 7351 (0.0015) [2024-08-05 22:24:15,158][52668] DAMAGECOUNT value on done: 8098.0 [2024-08-05 22:24:15,162][52668] Sum rewards: 3.869, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.292', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon5': '0.020', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.260', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.360', 'weapon3': '1.902', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:15,297][52659] DAMAGECOUNT value on done: 7226.0 [2024-08-05 22:24:15,297][52659] Sum rewards: 9.631, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.594', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'weapon4': '0.190', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon3': '1.280', 'weapon2': '1.676', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:15,893][52803] DAMAGECOUNT value on done: 7010.0 [2024-08-05 22:24:15,895][52803] Sum rewards: 6.058, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.887', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'WEAPON4': '0.300', 'HITCOUNT': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.504', 'weapon4': '0.672', 'weapon2': '0.760', 'weapon3': '1.174', 'DAMAGECOUNT': '1.344', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:17,349][52671] DAMAGECOUNT value on done: 6524.0 [2024-08-05 22:24:17,352][52671] Sum rewards: 6.749, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.236', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.137', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'ARMOR': '1.312', 'weapon2': '1.538', 'weapon3': '1.662', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:17,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16930.1, 300 sec: 16883.8). Total num frames: 60260352. Throughput: 0: 4258.4. Samples: 15065720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:24:17,795][52567] Avg episode reward: [(0, '6.045')] [2024-08-05 22:24:17,985][52811] DAMAGECOUNT value on done: 6896.0 [2024-08-05 22:24:17,985][52811] Sum rewards: 6.350, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.073', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.095', 'weapon4': '0.196', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.370', 'weapon3': '1.978', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:17,997][52660] DAMAGECOUNT value on done: 7687.0 [2024-08-05 22:24:17,998][52660] Sum rewards: 11.189, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.392', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'weapon5': '0.086', 'weapon4': '0.198', 'WEAPON3': '0.550', 'ARMOR': '0.891', 'HITCOUNT': '1.020', 'weapon3': '1.474', 'weapon2': '1.542', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '6.500'} [2024-08-05 22:24:18,306][52659] DAMAGECOUNT value on done: 6053.0 [2024-08-05 22:24:18,306][52659] Sum rewards: 6.427, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.000', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.242', 'WEAPON3': '0.400', 'HITCOUNT': '0.670', 'ARMOR': '0.914', 'weapon3': '1.050', 'weapon2': '1.148', 'DAMAGECOUNT': '2.376', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:18,386][52668] DAMAGECOUNT value on done: 5739.0 [2024-08-05 22:24:18,387][52668] Sum rewards: 6.999, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.382', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.184', 'HITCOUNT': '0.470', 'WEAPON3': '0.900', 'ARMOR': '0.958', 'weapon2': '1.384', 'DAMAGECOUNT': '1.770', 'weapon3': '1.998', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:19,228][52803] DAMAGECOUNT value on done: 7994.0 [2024-08-05 22:24:19,229][52803] Sum rewards: 16.478, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.390', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'weapon2': '1.348', 'HITCOUNT': '1.460', 'weapon3': '2.196', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '14.000'} [2024-08-05 22:24:19,664][52650] Updated weights for policy 0, policy_version 7361 (0.0023) [2024-08-05 22:24:20,447][52671] DAMAGECOUNT value on done: 6852.0 [2024-08-05 22:24:20,449][52671] Sum rewards: 7.577, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.650', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.119', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'ARMOR': '0.875', 'weapon2': '1.630', 'weapon3': '1.880', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:20,858][52660] DAMAGECOUNT value on done: 6473.0 [2024-08-05 22:24:20,863][52660] Sum rewards: 8.420, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.279', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.083', 'WEAPON4': '0.300', 'weapon4': '0.496', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'ARMOR': '0.949', 'weapon2': '1.250', 'weapon3': '1.554', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:21,135][52668] DAMAGECOUNT value on done: 7370.0 [2024-08-05 22:24:21,135][52668] Sum rewards: 12.218, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.295', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.170', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon3': '1.644', 'weapon2': '2.000', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '12.000'} [2024-08-05 22:24:21,189][52811] DAMAGECOUNT value on done: 6435.0 [2024-08-05 22:24:21,189][52811] Sum rewards: 7.901, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.797', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.046', 'AMMO3': '0.060', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'ARMOR': '0.468', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon3': '1.398', 'weapon2': '1.724', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:21,454][52659] DAMAGECOUNT value on done: 6733.0 [2024-08-05 22:24:21,456][52659] Sum rewards: 5.247, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.202', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.272', 'ARMOR': '0.456', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '1.504', 'weapon3': '1.546', 'DAMAGECOUNT': '1.704', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:22,362][52803] DAMAGECOUNT value on done: 6106.0 [2024-08-05 22:24:22,362][52803] Sum rewards: 7.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.384', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.482', 'WEAPON3': '0.550', 'ARMOR': '0.568', 'HITCOUNT': '0.620', 'weapon2': '1.072', 'weapon3': '1.478', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 16883.9). Total num frames: 60350464. Throughput: 0: 4259.6. Samples: 15091280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:24:22,794][52567] Avg episode reward: [(0, '6.489')] [2024-08-05 22:24:22,802][52614] Saving new best policy, reward=6.489! [2024-08-05 22:24:23,364][52660] DAMAGECOUNT value on done: 6739.0 [2024-08-05 22:24:23,365][52660] Sum rewards: 2.185, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.168', 'AMMO2': '0.010', 'AMMO5': '0.025', 'AMMO4': '0.048', 'weapon4': '0.098', 'weapon5': '0.152', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.710', 'WEAPON3': '1.200', 'ARMOR': '1.389', 'weapon2': '1.528', 'weapon3': '1.894', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:23,636][52668] DAMAGECOUNT value on done: 8028.0 [2024-08-05 22:24:23,636][52668] Sum rewards: 6.788, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.076', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon3': '1.452', 'weapon2': '1.850', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:24,445][52811] DAMAGECOUNT value on done: 6825.0 [2024-08-05 22:24:24,446][52811] Sum rewards: 7.358, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.969', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.144', 'ARMOR': '0.460', 'HITCOUNT': '0.900', 'WEAPON3': '1.000', 'weapon2': '1.418', 'weapon3': '2.102', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '9.000'} [2024-08-05 22:24:24,640][52650] Updated weights for policy 0, policy_version 7371 (0.0014) [2024-08-05 22:24:25,090][52659] DAMAGECOUNT value on done: 5217.0 [2024-08-05 22:24:25,090][52659] Sum rewards: 3.009, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.016', 'AMMO4': '0.047', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.270', 'weapon4': '0.322', 'WEAPON3': '0.550', 'ARMOR': '0.887', 'weapon2': '0.994', 'DAMAGECOUNT': '1.110', 'weapon3': '1.634', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:25,540][52803] DAMAGECOUNT value on done: 7728.0 [2024-08-05 22:24:25,540][52803] Sum rewards: 8.525, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.321', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.366', 'ARMOR': '0.576', 'HITCOUNT': '0.790', 'weapon2': '0.840', 'WEAPON3': '0.900', 'weapon3': '2.302', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '9.000'} [2024-08-05 22:24:26,558][52660] DAMAGECOUNT value on done: 6941.0 [2024-08-05 22:24:26,559][52660] Sum rewards: 12.604, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.330', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.069', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'weapon3': '1.172', 'weapon2': '1.570', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '10.000'} [2024-08-05 22:24:26,976][52668] DAMAGECOUNT value on done: 6275.0 [2024-08-05 22:24:26,976][52668] Sum rewards: 5.042, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'weapon5': '0.012', 'HEALTH': '0.018', 'AMMO2': '0.021', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon4': '0.480', 'ARMOR': '0.530', 'weapon3': '1.484', 'weapon2': '1.546', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:27,750][52659] DAMAGECOUNT value on done: 6604.0 [2024-08-05 22:24:27,751][52659] Sum rewards: 0.330, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.116', 'WEAPON4': '0.250', 'weapon4': '0.354', 'HITCOUNT': '0.420', 'ARMOR': '0.444', 'WEAPON3': '0.900', 'weapon2': '1.016', 'DAMAGECOUNT': '1.284', 'weapon3': '1.968', 'FRAGCOUNT': '2.000'} [2024-08-05 22:24:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17203.2, 300 sec: 16911.6). Total num frames: 60440576. Throughput: 0: 4237.8. Samples: 15115920. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:24:27,795][52567] Avg episode reward: [(0, '6.725')] [2024-08-05 22:24:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007378_60440576.pth... [2024-08-05 22:24:27,946][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000006882_56377344.pth [2024-08-05 22:24:27,952][52614] Saving new best policy, reward=6.725! [2024-08-05 22:24:28,173][52811] DAMAGECOUNT value on done: 7258.0 [2024-08-05 22:24:28,174][52811] Sum rewards: 5.810, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.696', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.036', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.478', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.420', 'weapon3': '1.662', 'ARMOR': '1.843', 'DAMAGECOUNT': '2.046', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:28,836][52803] DAMAGECOUNT value on done: 6307.0 [2024-08-05 22:24:28,836][52803] Sum rewards: 4.240, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.800', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'HITCOUNT': '0.320', 'WEAPON3': '0.600', 'ARMOR': '0.992', 'DAMAGECOUNT': '1.167', 'weapon3': '1.336', 'weapon2': '1.630', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:28,950][52795] DAMAGECOUNT value on done: 5545.0 [2024-08-05 22:24:28,952][52795] Sum rewards: 5.831, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.069', 'weapon5': '0.088', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.330', 'WEAPON3': '0.500', 'weapon4': '0.644', 'weapon2': '0.828', 'ARMOR': '0.936', 'weapon3': '1.314', 'DAMAGECOUNT': '1.458', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:29,776][52650] Updated weights for policy 0, policy_version 7381 (0.0015) [2024-08-05 22:24:30,216][52660] DAMAGECOUNT value on done: 5829.0 [2024-08-05 22:24:30,216][52660] Sum rewards: 12.078, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.152', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon3': '1.358', 'weapon2': '1.816', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '9.000'} [2024-08-05 22:24:30,569][52668] DAMAGECOUNT value on done: 6937.0 [2024-08-05 22:24:30,570][52668] Sum rewards: 3.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'weapon7': '0.058', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.464', 'HITCOUNT': '0.490', 'weapon4': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.230', 'DAMAGECOUNT': '1.392', 'weapon3': '1.526', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:31,531][52811] DAMAGECOUNT value on done: 6168.0 [2024-08-05 22:24:31,534][52811] Sum rewards: 8.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.634', 'AMMO2': '0.010', 'weapon7': '0.048', 'AMMO4': '0.051', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.496', 'HITCOUNT': '0.570', 'weapon4': '0.666', 'WEAPON3': '0.700', 'weapon2': '1.046', 'weapon3': '1.492', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:32,008][52803] DAMAGECOUNT value on done: 5995.0 [2024-08-05 22:24:32,011][52803] Sum rewards: 6.030, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.362', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'ARMOR': '1.332', 'weapon2': '1.500', 'weapon3': '1.534', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:32,165][52795] DAMAGECOUNT value on done: 6612.0 [2024-08-05 22:24:32,165][52795] Sum rewards: 7.097, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.486', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.390', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'ARMOR': '0.496', 'weapon3': '1.062', 'weapon2': '1.094', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:32,676][52660] DAMAGECOUNT value on done: 7125.0 [2024-08-05 22:24:32,681][52660] Sum rewards: 3.876, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.036', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'ARMOR': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.300', 'weapon4': '0.466', 'HITCOUNT': '0.700', 'weapon2': '1.026', 'WEAPON3': '1.100', 'weapon3': '2.172', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16930.1, 300 sec: 16883.9). Total num frames: 60514304. Throughput: 0: 4237.6. Samples: 15128480. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-05 22:24:32,794][52567] Avg episode reward: [(0, '6.665')] [2024-08-05 22:24:33,013][52668] DAMAGECOUNT value on done: 6354.0 [2024-08-05 22:24:33,017][52668] Sum rewards: 5.692, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'weapon4': '0.120', 'WEAPON5': '0.200', 'weapon5': '0.362', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'ARMOR': '0.919', 'weapon2': '1.592', 'weapon3': '1.594', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:34,239][52650] Updated weights for policy 0, policy_version 7391 (0.0025) [2024-08-05 22:24:34,782][52811] DAMAGECOUNT value on done: 7020.0 [2024-08-05 22:24:34,783][52811] Sum rewards: 3.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.680', 'AMMO2': '0.007', 'AMMO4': '0.036', 'ARMOR': '0.049', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.342', 'HITCOUNT': '0.350', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.206', 'weapon3': '1.540', 'weapon2': '1.638', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:35,299][52803] DAMAGECOUNT value on done: 6446.0 [2024-08-05 22:24:35,301][52803] Sum rewards: 1.024, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.065', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.254', 'HITCOUNT': '0.450', 'ARMOR': '0.472', 'WEAPON3': '0.600', 'weapon2': '0.998', 'weapon3': '1.430', 'DAMAGECOUNT': '1.626', 'FRAGCOUNT': '2.000'} [2024-08-05 22:24:35,661][52795] DAMAGECOUNT value on done: 6554.0 [2024-08-05 22:24:35,671][52795] Sum rewards: 10.223, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.290', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.048', 'AMMO3': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.234', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'ARMOR': '1.017', 'weapon2': '1.346', 'weapon3': '1.724', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:35,763][52660] DAMAGECOUNT value on done: 6176.0 [2024-08-05 22:24:35,765][52660] Sum rewards: 6.503, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.098', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon4': '0.320', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.128', 'weapon3': '1.418', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:36,102][52668] DAMAGECOUNT value on done: 7101.0 [2024-08-05 22:24:36,104][52668] Sum rewards: 5.256, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.628', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon4': '0.212', 'ARMOR': '0.486', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon3': '1.302', 'weapon2': '1.476', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:37,795][52567] Fps is (10 sec: 16384.2, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 60604416. Throughput: 0: 4242.2. Samples: 15154090. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 22:24:37,795][52567] Avg episode reward: [(0, '6.589')] [2024-08-05 22:24:38,030][52811] DAMAGECOUNT value on done: 4870.0 [2024-08-05 22:24:38,030][52811] Sum rewards: 4.168, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.783', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.458', 'HITCOUNT': '0.510', 'ARMOR': '0.545', 'WEAPON3': '0.550', 'weapon2': '0.996', 'weapon3': '1.578', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:38,566][52803] DAMAGECOUNT value on done: 5678.0 [2024-08-05 22:24:38,569][52803] Sum rewards: 1.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.890', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.326', 'HITCOUNT': '0.450', 'ARMOR': '0.480', 'WEAPON3': '0.800', 'weapon2': '1.074', 'DAMAGECOUNT': '1.461', 'weapon3': '1.716', 'FRAGCOUNT': '2.000'} [2024-08-05 22:24:38,742][52660] DAMAGECOUNT value on done: 6201.0 [2024-08-05 22:24:38,747][52660] Sum rewards: 8.703, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.308', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.276', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'ARMOR': '0.938', 'weapon2': '1.184', 'weapon3': '2.094', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:38,943][52795] DAMAGECOUNT value on done: 7823.0 [2024-08-05 22:24:38,943][52795] Sum rewards: 10.838, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.304', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.178', 'WEAPON3': '0.450', 'ARMOR': '0.518', 'HITCOUNT': '0.680', 'weapon3': '1.522', 'weapon2': '1.714', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:39,046][52668] DAMAGECOUNT value on done: 6308.0 [2024-08-05 22:24:39,047][52668] Sum rewards: 0.694, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.077', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.246', 'HITCOUNT': '0.290', 'ARMOR': '0.541', 'WEAPON3': '0.600', 'DAMAGECOUNT': '0.882', 'FRAGCOUNT': '1.000', 'weapon2': '1.342', 'weapon3': '1.616'} [2024-08-05 22:24:39,541][52650] Updated weights for policy 0, policy_version 7401 (0.0028) [2024-08-05 22:24:41,285][52811] DAMAGECOUNT value on done: 6030.0 [2024-08-05 22:24:41,293][52811] Sum rewards: 9.764, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.152', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'ARMOR': '1.271', 'weapon2': '1.538', 'weapon3': '1.700', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:41,649][52660] DAMAGECOUNT value on done: 6834.0 [2024-08-05 22:24:41,649][52660] Sum rewards: 8.526, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.318', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'ARMOR': '0.055', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '0.948', 'weapon3': '1.758', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:41,695][52803] DAMAGECOUNT value on done: 6483.0 [2024-08-05 22:24:41,696][52803] Sum rewards: 6.208, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.654', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.117', 'ARMOR': '0.484', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon3': '1.716', 'weapon2': '1.740', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:41,933][52668] DAMAGECOUNT value on done: 6535.0 [2024-08-05 22:24:41,935][52668] Sum rewards: 5.826, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.962', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.244', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '1.228', 'weapon3': '1.370', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:42,313][52795] DAMAGECOUNT value on done: 7122.0 [2024-08-05 22:24:42,313][52795] Sum rewards: 6.706, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.609', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.376', 'ARMOR': '0.560', 'HITCOUNT': '0.820', 'weapon2': '1.044', 'WEAPON3': '1.100', 'weapon3': '2.182', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:42,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17066.6, 300 sec: 16911.6). Total num frames: 60686336. Throughput: 0: 4246.0. Samples: 15179830. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 22:24:42,795][52567] Avg episode reward: [(0, '6.290')] [2024-08-05 22:24:43,901][52650] Updated weights for policy 0, policy_version 7411 (0.0036) [2024-08-05 22:24:44,350][52811] DAMAGECOUNT value on done: 6489.0 [2024-08-05 22:24:44,351][52811] Sum rewards: 2.083, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon4': '0.066', 'weapon5': '0.066', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'FRAGCOUNT': '0.500', 'ARMOR': '0.836', 'HEALTH': '0.854', 'weapon3': '1.156', 'weapon2': '1.234', 'DAMAGECOUNT': '1.497'} [2024-08-05 22:24:44,659][52660] DAMAGECOUNT value on done: 6754.0 [2024-08-05 22:24:44,661][52660] Sum rewards: 2.230, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.401', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.204', 'HITCOUNT': '0.490', 'WEAPON3': '0.800', 'ARMOR': '0.888', 'weapon2': '1.228', 'DAMAGECOUNT': '1.620', 'weapon3': '1.674', 'FRAGCOUNT': '4.000'} [2024-08-05 22:24:44,774][52803] DAMAGECOUNT value on done: 6708.0 [2024-08-05 22:24:44,775][52803] Sum rewards: 6.662, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.650', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.236', 'ARMOR': '0.521', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.116', 'weapon3': '1.698', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:44,896][52668] DAMAGECOUNT value on done: 7338.0 [2024-08-05 22:24:44,896][52668] Sum rewards: 7.166, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.094', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO3': '0.100', 'ARMOR': '0.464', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon2': '1.700', 'weapon3': '1.730', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '9.000'} [2024-08-05 22:24:45,699][52795] DAMAGECOUNT value on done: 7707.0 [2024-08-05 22:24:45,699][52795] Sum rewards: 5.890, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.098', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.100', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.740', 'weapon3': '1.870', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:47,043][52660] DAMAGECOUNT value on done: 6953.0 [2024-08-05 22:24:47,045][52660] Sum rewards: 5.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.066', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.022', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.312', 'weapon3': '1.954', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:47,301][52668] DAMAGECOUNT value on done: 7496.0 [2024-08-05 22:24:47,301][52668] Sum rewards: 7.358, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.352', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.306', 'ARMOR': '0.432', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.100', 'weapon3': '1.818', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:47,795][52567] Fps is (10 sec: 16382.4, 60 sec: 16929.9, 300 sec: 16911.6). Total num frames: 60768256. Throughput: 0: 4243.9. Samples: 15192600. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 22:24:47,796][52567] Avg episode reward: [(0, '6.273')] [2024-08-05 22:24:47,819][52811] DAMAGECOUNT value on done: 7178.0 [2024-08-05 22:24:47,820][52811] Sum rewards: 11.254, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.101', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'ARMOR': '0.448', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon2': '1.214', 'weapon3': '2.340', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '10.000'} [2024-08-05 22:24:48,531][52803] DAMAGECOUNT value on done: 6948.0 [2024-08-05 22:24:48,531][52803] Sum rewards: 2.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'HITCOUNT': '0.440', 'ARMOR': '0.490', 'WEAPON3': '0.950', 'weapon2': '1.388', 'DAMAGECOUNT': '2.145', 'weapon3': '2.230', 'FRAGCOUNT': '7.000'} [2024-08-05 22:24:49,788][52650] Updated weights for policy 0, policy_version 7421 (0.0038) [2024-08-05 22:24:50,003][52795] DAMAGECOUNT value on done: 6712.0 [2024-08-05 22:24:50,004][52795] Sum rewards: 5.529, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.630', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'ARMOR': '0.052', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.354', 'weapon3': '1.812', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:51,196][52660] DAMAGECOUNT value on done: 6841.0 [2024-08-05 22:24:51,197][52660] Sum rewards: 4.562, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.244', 'HITCOUNT': '0.760', 'ARMOR': '0.882', 'WEAPON3': '0.950', 'weapon2': '1.390', 'weapon3': '2.094', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:51,666][52668] DAMAGECOUNT value on done: 6588.0 [2024-08-05 22:24:51,666][52668] Sum rewards: 6.453, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.434', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.083', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.316', 'weapon3': '1.844', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:52,311][52811] DAMAGECOUNT value on done: 6596.0 [2024-08-05 22:24:52,320][52811] Sum rewards: 6.530, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.294', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.119', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.288', 'ARMOR': '0.505', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon2': '1.472', 'weapon3': '1.948', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:52,794][52567] Fps is (10 sec: 13926.9, 60 sec: 16384.0, 300 sec: 16828.3). Total num frames: 60825600. Throughput: 0: 4103.1. Samples: 15211970. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:24:52,794][52567] Avg episode reward: [(0, '6.357')] [2024-08-05 22:24:53,041][52803] DAMAGECOUNT value on done: 6550.0 [2024-08-05 22:24:53,043][52803] Sum rewards: 5.707, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.463', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.396', 'ARMOR': '0.464', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon2': '1.480', 'weapon3': '1.814', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:53,853][52795] DAMAGECOUNT value on done: 6814.0 [2024-08-05 22:24:53,854][52795] Sum rewards: 10.315, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.000', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.194', 'WEAPON3': '0.650', 'ARMOR': '0.950', 'HITCOUNT': '0.960', 'weapon2': '1.446', 'weapon3': '1.694', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:54,439][52660] DAMAGECOUNT value on done: 6568.0 [2024-08-05 22:24:54,440][52660] Sum rewards: 1.798, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.781', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.010', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'ARMOR': '0.116', 'WEAPON4': '0.300', 'HITCOUNT': '0.440', 'weapon4': '0.558', 'weapon2': '0.576', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.263', 'weapon3': '1.614', 'FRAGCOUNT': '3.000'} [2024-08-05 22:24:54,799][52668] DAMAGECOUNT value on done: 6491.0 [2024-08-05 22:24:54,799][52668] Sum rewards: 9.409, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.098', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.113', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.924', 'weapon2': '1.802', 'weapon3': '1.884', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '9.000'} [2024-08-05 22:24:55,283][52650] Updated weights for policy 0, policy_version 7431 (0.0023) [2024-08-05 22:24:55,758][52811] DAMAGECOUNT value on done: 6502.0 [2024-08-05 22:24:55,761][52811] Sum rewards: 4.854, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.608', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.346', 'HITCOUNT': '0.410', 'ARMOR': '0.492', 'WEAPON3': '0.700', 'weapon2': '1.262', 'DAMAGECOUNT': '1.455', 'weapon3': '1.618', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:56,216][52803] DAMAGECOUNT value on done: 5659.0 [2024-08-05 22:24:56,218][52803] Sum rewards: 5.228, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.080', 'AMMO2': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.025', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.100', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '1.398', 'DAMAGECOUNT': '1.560', 'weapon3': '1.880', 'FRAGCOUNT': '5.000'} [2024-08-05 22:24:57,094][52795] DAMAGECOUNT value on done: 7232.0 [2024-08-05 22:24:57,095][52795] Sum rewards: 12.179, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.098', 'weapon4': '0.216', 'ARMOR': '0.408', 'weapon5': '0.444', 'WEAPON3': '0.450', 'HEALTH': '0.460', 'HITCOUNT': '0.970', 'weapon3': '1.260', 'weapon2': '1.658', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '8.500'} [2024-08-05 22:24:57,391][52660] DAMAGECOUNT value on done: 6544.0 [2024-08-05 22:24:57,400][52660] Sum rewards: 7.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.252', 'AMMO2': '0.019', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.150', 'ARMOR': '0.461', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.696', 'weapon3': '2.106', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'} [2024-08-05 22:24:57,794][52567] Fps is (10 sec: 14747.1, 60 sec: 16520.5, 300 sec: 16828.3). Total num frames: 60915712. Throughput: 0: 4101.8. Samples: 15237540. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 22:24:57,794][52567] Avg episode reward: [(0, '6.351')] [2024-08-05 22:24:59,057][52811] DAMAGECOUNT value on done: 6633.0 [2024-08-05 22:24:59,059][52811] Sum rewards: 6.514, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.377', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.090', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'ARMOR': '0.424', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon2': '1.314', 'weapon3': '1.946', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '6.000'} [2024-08-05 22:24:59,367][52803] DAMAGECOUNT value on done: 6470.0 [2024-08-05 22:24:59,367][52803] Sum rewards: 5.932, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.686', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.110', 'weapon4': '0.188', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '1.275', 'weapon3': '1.470', 'weapon2': '1.522', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:00,139][52650] Updated weights for policy 0, policy_version 7441 (0.0023) [2024-08-05 22:25:00,311][52795] DAMAGECOUNT value on done: 7132.0 [2024-08-05 22:25:00,315][52795] Sum rewards: 7.161, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.120', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.394', 'ARMOR': '0.496', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '0.952', 'weapon3': '1.922', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:00,768][52660] DAMAGECOUNT value on done: 8041.0 [2024-08-05 22:25:00,768][52660] Sum rewards: 2.326, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'weapon4': '0.126', 'ARMOR': '0.541', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.454', 'weapon3': '1.490', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.460'} [2024-08-05 22:25:02,451][52811] DAMAGECOUNT value on done: 7393.0 [2024-08-05 22:25:02,460][52811] Sum rewards: 14.577, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.572', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.117', 'ARMOR': '0.428', 'WEAPON3': '0.750', 'HITCOUNT': '1.100', 'weapon2': '1.554', 'weapon3': '1.748', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '12.000'} [2024-08-05 22:25:02,645][52803] DAMAGECOUNT value on done: 5758.0 [2024-08-05 22:25:02,648][52803] Sum rewards: 4.823, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.284', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.210', 'WEAPON3': '0.450', 'ARMOR': '0.451', 'HITCOUNT': '0.510', 'weapon3': '1.082', 'weapon2': '1.238', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '3.000'} [2024-08-05 22:25:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16657.1, 300 sec: 16856.1). Total num frames: 61005824. Throughput: 0: 4102.7. Samples: 15250340. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 22:25:02,794][52567] Avg episode reward: [(0, '6.298')] [2024-08-05 22:25:03,450][52794] DAMAGECOUNT value on done: 7752.0 [2024-08-05 22:25:03,450][52794] Sum rewards: 4.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.024', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.116', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'ARMOR': '0.886', 'weapon3': '1.554', 'weapon2': '1.746', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '4.500'} [2024-08-05 22:25:03,627][52795] DAMAGECOUNT value on done: 5903.0 [2024-08-05 22:25:03,627][52795] Sum rewards: 4.745, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'weapon4': '0.086', 'AMMO4': '0.098', 'HEALTH': '0.282', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon3': '1.478', 'weapon2': '1.950', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '3.000'} [2024-08-05 22:25:04,694][52650] Updated weights for policy 0, policy_version 7451 (0.0012) [2024-08-05 22:25:05,847][52803] DAMAGECOUNT value on done: 6963.0 [2024-08-05 22:25:05,847][52803] Sum rewards: 6.368, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.683', 'AMMO2': '0.018', 'AMMO3': '0.084', 'AMMO4': '0.089', 'weapon4': '0.206', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '1.050', 'weapon3': '1.588', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:05,911][52794] DAMAGECOUNT value on done: 8444.0 [2024-08-05 22:25:05,914][52794] Sum rewards: 15.147, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.060', 'HEALTH': '0.186', 'WEAPON3': '0.400', 'ARMOR': '0.857', 'HITCOUNT': '1.080', 'weapon3': '1.438', 'weapon2': '2.008', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '10.000'} [2024-08-05 22:25:05,920][52811] DAMAGECOUNT value on done: 5688.0 [2024-08-05 22:25:05,920][52811] Sum rewards: 2.415, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.390', 'AMMO4': '-0.099', 'AMMO2': '-0.020', 'AMMO3': '0.074', 'ARMOR': '0.454', 'HITCOUNT': '0.490', 'WEAPON3': '0.600', 'weapon3': '1.104', 'DAMAGECOUNT': '1.452', 'weapon2': '1.500', 'FRAGCOUNT': '2.000'} [2024-08-05 22:25:06,821][52795] DAMAGECOUNT value on done: 6202.0 [2024-08-05 22:25:06,824][52795] Sum rewards: 5.415, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.150', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.490', 'WEAPON3': '0.850', 'weapon2': '1.282', 'DAMAGECOUNT': '1.650', 'weapon3': '2.182', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16520.5, 300 sec: 16856.1). Total num frames: 61087744. Throughput: 0: 4108.0. Samples: 15276140. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:25:07,795][52567] Avg episode reward: [(0, '6.439')] [2024-08-05 22:25:07,849][52662] DAMAGECOUNT value on done: 7498.0 [2024-08-05 22:25:07,850][52662] Sum rewards: 3.572, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '0.004', 'AMMO2': '0.015', 'AMMO3': '0.050', 'AMMO4': '0.075', 'ARMOR': '0.084', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'WEAPON3': '0.350', 'weapon4': '0.480', 'DAMAGECOUNT': '0.843', 'weapon2': '0.996', 'weapon3': '1.194', 'FRAGCOUNT': '2.000'} [2024-08-05 22:25:08,502][52794] DAMAGECOUNT value on done: 8353.0 [2024-08-05 22:25:08,502][52794] Sum rewards: 7.406, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.662', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.106', 'weapon4': '0.168', 'ARMOR': '0.466', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.392', 'weapon3': '1.750', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:09,056][52803] DAMAGECOUNT value on done: 7081.0 [2024-08-05 22:25:09,058][52803] Sum rewards: 11.621, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.366', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.071', 'ARMOR': '0.128', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon3': '1.420', 'weapon2': '1.742', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:09,060][52811] DAMAGECOUNT value on done: 6363.0 [2024-08-05 22:25:09,064][52811] Sum rewards: 1.674, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'ARMOR': '0.036', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.224', 'weapon3': '1.646', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:09,505][52650] Updated weights for policy 0, policy_version 7461 (0.0029) [2024-08-05 22:25:09,968][52795] DAMAGECOUNT value on done: 6494.0 [2024-08-05 22:25:09,972][52795] Sum rewards: 3.694, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.636', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON7': '0.200', 'weapon4': '0.456', 'ARMOR': '0.509', 'HITCOUNT': '0.750', 'WEAPON3': '1.000', 'weapon2': '1.232', 'weapon3': '1.758', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:10,390][52662] DAMAGECOUNT value on done: 8234.0 [2024-08-05 22:25:10,391][52662] Sum rewards: 7.836, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.065', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.202', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'ARMOR': '0.976', 'weapon2': '1.346', 'weapon3': '2.036', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:11,150][52794] DAMAGECOUNT value on done: 7948.0 [2024-08-05 22:25:11,151][52794] Sum rewards: 10.907, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.124', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.080', 'ARMOR': '0.099', 'WEAPON4': '0.300', 'weapon4': '0.566', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.182', 'weapon3': '1.834', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:12,241][52811] DAMAGECOUNT value on done: 5270.0 [2024-08-05 22:25:12,241][52811] Sum rewards: 7.113, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.666', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.497', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '1.572', 'weapon3': '1.726', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16520.5, 300 sec: 16856.1). Total num frames: 61169664. Throughput: 0: 4122.4. Samples: 15301430. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 22:25:12,795][52567] Avg episode reward: [(0, '6.526')] [2024-08-05 22:25:12,979][52662] DAMAGECOUNT value on done: 8292.0 [2024-08-05 22:25:12,980][52662] Sum rewards: 5.401, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.396', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'WEAPON4': '0.100', 'weapon4': '0.192', 'AMMO3': '0.198', 'ARMOR': '0.456', 'weapon2': '1.054', 'HITCOUNT': '1.170', 'WEAPON3': '1.300', 'weapon3': '2.318', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:13,336][52795] DAMAGECOUNT value on done: 7269.0 [2024-08-05 22:25:13,338][52795] Sum rewards: 9.607, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.104', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.123', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'ARMOR': '1.294', 'weapon2': '1.426', 'weapon3': '2.104', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:13,488][52794] DAMAGECOUNT value on done: 8249.0 [2024-08-05 22:25:13,490][52794] Sum rewards: 15.095, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.938', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.146', 'ARMOR': '0.475', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.300', 'weapon3': '2.218', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '12.000'} [2024-08-05 22:25:14,186][52650] Updated weights for policy 0, policy_version 7471 (0.0025) [2024-08-05 22:25:15,514][52669] DAMAGECOUNT value on done: 6725.0 [2024-08-05 22:25:15,514][52669] Sum rewards: 3.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.688', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.244', 'DAMAGECOUNT': '2.031', 'weapon3': '2.088', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:15,540][52662] DAMAGECOUNT value on done: 6484.0 [2024-08-05 22:25:15,540][52662] Sum rewards: 4.783, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.530', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.086', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'weapon4': '0.430', 'WEAPON3': '0.650', 'ARMOR': '0.937', 'weapon2': '1.280', 'weapon3': '1.534', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:15,612][52811] DAMAGECOUNT value on done: 6689.0 [2024-08-05 22:25:15,615][52811] Sum rewards: 6.680, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.150', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.022', 'AMMO3': '0.083', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.212', 'HITCOUNT': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.894', 'weapon2': '1.370', 'DAMAGECOUNT': '1.542', 'weapon3': '1.710', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:16,132][52794] DAMAGECOUNT value on done: 8535.0 [2024-08-05 22:25:16,133][52794] Sum rewards: 7.918, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.028', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.032', 'weapon4': '0.096', 'AMMO3': '0.119', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.467', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.056', 'weapon3': '2.152', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:16,474][52795] DAMAGECOUNT value on done: 6418.0 [2024-08-05 22:25:16,475][52795] Sum rewards: 9.122, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.577', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.060', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon4': '0.678', 'ARMOR': '1.009', 'weapon2': '1.054', 'weapon3': '1.426', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16657.1, 300 sec: 16856.1). Total num frames: 61259776. Throughput: 0: 4123.1. Samples: 15314020. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:25:17,802][52567] Avg episode reward: [(0, '6.609')] [2024-08-05 22:25:18,116][52662] DAMAGECOUNT value on done: 7990.0 [2024-08-05 22:25:18,117][52662] Sum rewards: 5.030, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.915', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.264', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'ARMOR': '0.964', 'weapon2': '1.162', 'weapon3': '1.210', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '3.000'} [2024-08-05 22:25:18,380][52669] DAMAGECOUNT value on done: 7505.0 [2024-08-05 22:25:18,381][52669] Sum rewards: 7.184, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.323', 'AMMO2': '0.002', 'AMMO4': '0.008', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'ARMOR': '0.507', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.508', 'weapon3': '2.138', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:18,664][52794] DAMAGECOUNT value on done: 7616.0 [2024-08-05 22:25:18,664][52794] Sum rewards: 6.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.224', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.332', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.046', 'weapon3': '1.980', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:18,790][52811] DAMAGECOUNT value on done: 7261.0 [2024-08-05 22:25:18,794][52811] Sum rewards: 7.893, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.627', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'ARMOR': '0.965', 'weapon2': '1.228', 'weapon3': '1.826', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:18,939][52650] Updated weights for policy 0, policy_version 7481 (0.0021) [2024-08-05 22:25:19,527][52820] DAMAGECOUNT value on done: 5743.0 [2024-08-05 22:25:19,527][52820] Sum rewards: 6.686, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.591', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.027', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.220', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '0.920', 'weapon3': '1.802', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:19,784][52795] DAMAGECOUNT value on done: 7056.0 [2024-08-05 22:25:19,788][52795] Sum rewards: 8.798, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.186', 'AMMO2': '0.027', 'AMMO3': '0.111', 'AMMO4': '0.133', 'weapon4': '0.184', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'ARMOR': '0.925', 'weapon3': '1.790', 'weapon2': '1.812', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:20,468][52662] DAMAGECOUNT value on done: 9235.0 [2024-08-05 22:25:20,468][52662] Sum rewards: 9.271, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon4': '0.196', 'HEALTH': '0.284', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.296', 'weapon3': '1.840', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:21,083][52794] DAMAGECOUNT value on done: 6578.0 [2024-08-05 22:25:21,083][52794] Sum rewards: 9.165, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.602', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.013', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'weapon5': '0.484', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'ARMOR': '0.900', 'weapon3': '1.348', 'weapon2': '1.602', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:21,406][52669] DAMAGECOUNT value on done: 7784.0 [2024-08-05 22:25:21,407][52669] Sum rewards: 11.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.515', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'ARMOR': '0.959', 'weapon3': '1.404', 'weapon2': '1.512', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16520.5, 300 sec: 16856.1). Total num frames: 61341696. Throughput: 0: 4124.4. Samples: 15339690. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:25:22,794][52567] Avg episode reward: [(0, '6.748')] [2024-08-05 22:25:22,802][52614] Saving new best policy, reward=6.748! [2024-08-05 22:25:22,933][52662] DAMAGECOUNT value on done: 8419.0 [2024-08-05 22:25:22,935][52662] Sum rewards: 2.169, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.709', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'weapon5': '0.072', 'WEAPON5': '0.150', 'HITCOUNT': '0.220', 'weapon4': '0.238', 'WEAPON3': '0.500', 'DAMAGECOUNT': '0.684', 'FRAGCOUNT': '1.000', 'weapon2': '1.024', 'weapon3': '1.210', 'ARMOR': '1.380'} [2024-08-05 22:25:23,009][52820] DAMAGECOUNT value on done: 7132.0 [2024-08-05 22:25:23,011][52820] Sum rewards: 3.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.144', 'AMMO2': '0.024', 'ARMOR': '0.061', 'AMMO3': '0.110', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.068', 'weapon3': '1.970', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '3.000'} [2024-08-05 22:25:23,040][52795] DAMAGECOUNT value on done: 7319.0 [2024-08-05 22:25:23,041][52795] Sum rewards: 10.688, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.717', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.081', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'ARMOR': '0.856', 'weapon2': '1.184', 'weapon3': '1.440', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:23,631][52794] DAMAGECOUNT value on done: 9087.0 [2024-08-05 22:25:23,632][52794] Sum rewards: 11.924, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.453', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon4': '0.018', 'weapon7': '0.046', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.499', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.514', 'weapon3': '1.806', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '10.000'} [2024-08-05 22:25:23,764][52669] DAMAGECOUNT value on done: 8870.0 [2024-08-05 22:25:23,765][52669] Sum rewards: 11.310, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.085', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.130', 'HEALTH': '0.362', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'ARMOR': '0.924', 'weapon2': '1.526', 'weapon3': '1.824', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:24,316][52650] Updated weights for policy 0, policy_version 7491 (0.0011) [2024-08-05 22:25:25,588][52662] DAMAGECOUNT value on done: 8800.0 [2024-08-05 22:25:25,588][52662] Sum rewards: 10.459, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.426', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.099', 'WEAPON4': '0.250', 'ARMOR': '0.475', 'weapon4': '0.646', 'weapon2': '0.744', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon3': '1.746', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:26,111][52794] DAMAGECOUNT value on done: 7852.0 [2024-08-05 22:25:26,112][52794] Sum rewards: 7.747, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.021', 'weapon4': '0.040', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'HEALTH': '0.112', 'WEAPON3': '0.400', 'ARMOR': '0.413', 'HITCOUNT': '0.550', 'weapon3': '1.696', 'weapon2': '1.800', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:26,240][52795] DAMAGECOUNT value on done: 7011.0 [2024-08-05 22:25:26,242][52795] Sum rewards: 8.599, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.835', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.931', 'HITCOUNT': '1.010', 'weapon2': '1.518', 'weapon3': '1.760', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:26,462][52820] DAMAGECOUNT value on done: 7017.0 [2024-08-05 22:25:26,462][52820] Sum rewards: 9.085, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.555', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.012', 'AMMO3': '0.111', 'WEAPON3': '0.800', 'HITCOUNT': '1.080', 'weapon2': '1.642', 'weapon3': '1.912', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:27,383][52669] DAMAGECOUNT value on done: 6975.0 [2024-08-05 22:25:27,384][52669] Sum rewards: 6.356, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.058', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.141', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.556', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.170', 'weapon3': '2.214', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16384.0, 300 sec: 16856.1). Total num frames: 61423616. Throughput: 0: 4111.8. Samples: 15364860. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:25:27,795][52567] Avg episode reward: [(0, '6.759')] [2024-08-05 22:25:27,911][52614] Saving new best policy, reward=6.759! [2024-08-05 22:25:28,112][52662] DAMAGECOUNT value on done: 8407.0 [2024-08-05 22:25:28,113][52662] Sum rewards: 6.790, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.858', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.066', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.444', 'HITCOUNT': '0.480', 'WEAPON3': '0.600', 'ARMOR': '0.868', 'weapon2': '1.122', 'weapon3': '1.344', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:28,668][52794] DAMAGECOUNT value on done: 7718.0 [2024-08-05 22:25:28,668][52794] Sum rewards: 7.571, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.032', 'AMMO3': '0.070', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.460', 'HEALTH': '0.540', 'HITCOUNT': '0.580', 'ARMOR': '0.828', 'weapon2': '0.832', 'weapon3': '1.368', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:28,789][52650] Updated weights for policy 0, policy_version 7501 (0.0039) [2024-08-05 22:25:29,898][52820] DAMAGECOUNT value on done: 7946.0 [2024-08-05 22:25:29,900][52820] Sum rewards: 6.313, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.544', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.178', 'ARMOR': '0.493', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.404', 'weapon3': '1.776', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:30,035][52795] DAMAGECOUNT value on done: 6157.0 [2024-08-05 22:25:30,036][52795] Sum rewards: 5.470, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.919', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon4': '0.160', 'ARMOR': '0.472', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.222', 'DAMAGECOUNT': '1.884', 'weapon3': '2.444', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:30,376][52669] DAMAGECOUNT value on done: 7646.0 [2024-08-05 22:25:30,376][52669] Sum rewards: 9.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.119', 'AMMO2': '0.024', 'weapon4': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.121', 'ARMOR': '0.408', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon2': '1.412', 'weapon3': '1.642', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:30,559][52662] DAMAGECOUNT value on done: 8439.0 [2024-08-05 22:25:30,560][52662] Sum rewards: 7.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.215', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.170', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon2': '1.114', 'weapon3': '1.400', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:31,019][52794] DAMAGECOUNT value on done: 8377.0 [2024-08-05 22:25:31,021][52794] Sum rewards: 3.339, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.574', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.012', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon4': '0.186', 'HITCOUNT': '0.510', 'WEAPON3': '0.900', 'ARMOR': '1.253', 'weapon2': '1.600', 'DAMAGECOUNT': '1.665', 'weapon3': '1.956', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:32,693][52669] DAMAGECOUNT value on done: 8173.0 [2024-08-05 22:25:32,693][52669] Sum rewards: 1.470, reward structure: {'DEATHCOUNT': '-7.500', 'weapon4': '0.006', 'AMMO2': '0.015', 'HEALTH': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.114', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'ARMOR': '0.808', 'weapon2': '1.292', 'DAMAGECOUNT': '1.545', 'weapon3': '1.828', 'FRAGCOUNT': '2.000'} [2024-08-05 22:25:32,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16520.5, 300 sec: 16828.3). Total num frames: 61505536. Throughput: 0: 4099.0. Samples: 15377050. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 22:25:32,795][52567] Avg episode reward: [(0, '6.742')] [2024-08-05 22:25:33,127][52820] DAMAGECOUNT value on done: 6514.0 [2024-08-05 22:25:33,129][52820] Sum rewards: 8.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon7': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.180', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.488', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'weapon2': '1.500', 'weapon3': '1.802', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:33,160][52662] DAMAGECOUNT value on done: 7668.0 [2024-08-05 22:25:33,161][52662] Sum rewards: 9.293, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.564', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.480', 'ARMOR': '0.911', 'weapon2': '0.930', 'HITCOUNT': '0.970', 'WEAPON3': '1.100', 'weapon3': '2.128', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '10.000'} [2024-08-05 22:25:33,464][52795] DAMAGECOUNT value on done: 6120.0 [2024-08-05 22:25:33,465][52795] Sum rewards: 3.781, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.104', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.020', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.104', 'ARMOR': '0.487', 'HITCOUNT': '0.660', 'WEAPON3': '0.850', 'weapon2': '1.444', 'weapon3': '1.728', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:33,668][52794] DAMAGECOUNT value on done: 7958.0 [2024-08-05 22:25:33,669][52794] Sum rewards: 9.377, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.248', 'ARMOR': '0.540', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.126', 'weapon3': '1.578', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:33,754][52650] Updated weights for policy 0, policy_version 7511 (0.0028) [2024-08-05 22:25:35,870][52662] DAMAGECOUNT value on done: 6847.0 [2024-08-05 22:25:35,870][52662] Sum rewards: 1.109, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.139', 'ARMOR': '0.468', 'HITCOUNT': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.100', 'DAMAGECOUNT': '1.620', 'weapon3': '2.214', 'FRAGCOUNT': '3.000'} [2024-08-05 22:25:35,985][52669] DAMAGECOUNT value on done: 7033.0 [2024-08-05 22:25:35,985][52669] Sum rewards: 5.151, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'HEALTH': '0.068', 'AMMO3': '0.075', 'ARMOR': '0.490', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '1.088', 'weapon3': '1.312', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:36,309][52794] DAMAGECOUNT value on done: 9772.0 [2024-08-05 22:25:36,310][52794] Sum rewards: 10.579, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.077', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.164', 'weapon4': '0.164', 'WEAPON4': '0.200', 'ARMOR': '0.448', 'weapon2': '1.050', 'WEAPON3': '1.100', 'HITCOUNT': '1.250', 'weapon3': '2.190', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '11.000'} [2024-08-05 22:25:36,603][52820] DAMAGECOUNT value on done: 8252.0 [2024-08-05 22:25:36,605][52820] Sum rewards: 12.724, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.890', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'AMMO3': '0.060', 'ARMOR': '0.078', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.282', 'weapon4': '0.290', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon3': '1.340', 'weapon2': '1.408', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '10.000'} [2024-08-05 22:25:37,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16383.9, 300 sec: 16856.1). Total num frames: 61587456. Throughput: 0: 4228.9. Samples: 15402270. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 22:25:37,795][52567] Avg episode reward: [(0, '6.836')] [2024-08-05 22:25:37,802][52614] Saving new best policy, reward=6.836! [2024-08-05 22:25:38,504][52662] DAMAGECOUNT value on done: 8375.0 [2024-08-05 22:25:38,505][52662] Sum rewards: 5.155, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.671', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.398', 'ARMOR': '0.424', 'HITCOUNT': '0.670', 'weapon2': '0.802', 'WEAPON3': '0.850', 'weapon3': '2.170', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:38,646][52650] Updated weights for policy 0, policy_version 7521 (0.0045) [2024-08-05 22:25:39,082][52794] DAMAGECOUNT value on done: 8287.0 [2024-08-05 22:25:39,083][52794] Sum rewards: 7.444, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.083', 'AMMO2': '0.020', 'AMMO3': '0.090', 'ARMOR': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '0.852', 'weapon3': '1.836', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:39,552][52669] DAMAGECOUNT value on done: 6978.0 [2024-08-05 22:25:39,552][52669] Sum rewards: 4.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.988', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.302', 'HITCOUNT': '0.440', 'ARMOR': '0.557', 'WEAPON3': '0.700', 'weapon2': '1.106', 'DAMAGECOUNT': '1.320', 'weapon3': '1.796', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:39,896][52820] DAMAGECOUNT value on done: 5607.0 [2024-08-05 22:25:39,896][52820] Sum rewards: 4.219, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.614', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.280', 'HITCOUNT': '0.330', 'WEAPON3': '0.450', 'DAMAGECOUNT': '0.879', 'ARMOR': '0.984', 'weapon3': '1.106', 'weapon2': '1.722', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:40,335][52663] DAMAGECOUNT value on done: 7725.0 [2024-08-05 22:25:40,336][52663] Sum rewards: 6.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.062', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon5': '0.138', 'weapon4': '0.260', 'ARMOR': '0.481', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.460', 'weapon3': '1.862', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:40,578][52647] DAMAGECOUNT value on done: 8046.0 [2024-08-05 22:25:40,578][52647] Sum rewards: 13.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.543', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.095', 'ARMOR': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.608', 'WEAPON3': '0.700', 'weapon2': '0.816', 'HITCOUNT': '0.880', 'weapon3': '1.588', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '11.000'} [2024-08-05 22:25:40,958][52662] DAMAGECOUNT value on done: 8749.0 [2024-08-05 22:25:40,958][52662] Sum rewards: 11.022, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.156', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO3': '0.070', 'ARMOR': '0.076', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'weapon2': '1.546', 'weapon3': '1.660', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:41,428][52794] DAMAGECOUNT value on done: 8707.0 [2024-08-05 22:25:41,428][52794] Sum rewards: 7.626, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.106', 'AMMO3': '0.122', 'ARMOR': '0.408', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon2': '1.268', 'weapon3': '2.084', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:41,842][52665] DAMAGECOUNT value on done: 7089.0 [2024-08-05 22:25:41,845][52665] Sum rewards: 6.269, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.554', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.900', 'weapon2': '1.214', 'weapon3': '1.298', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '5.500'} [2024-08-05 22:25:42,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16384.1, 300 sec: 16828.3). Total num frames: 61669376. Throughput: 0: 4221.3. Samples: 15427500. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 22:25:42,795][52567] Avg episode reward: [(0, '7.026')] [2024-08-05 22:25:42,861][52614] Saving new best policy, reward=7.026! [2024-08-05 22:25:42,978][52669] DAMAGECOUNT value on done: 6894.0 [2024-08-05 22:25:42,978][52669] Sum rewards: 6.327, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.766', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.024', 'AMMO3': '0.085', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.558', 'weapon3': '1.700', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:43,240][52820] DAMAGECOUNT value on done: 6806.0 [2024-08-05 22:25:43,243][52820] Sum rewards: 9.262, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.070', 'AMMO2': '0.000', 'AMMO4': '0.002', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.248', 'WEAPON3': '0.400', 'HITCOUNT': '0.580', 'weapon2': '0.864', 'weapon3': '1.206', 'DAMAGECOUNT': '1.632', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:43,645][52662] DAMAGECOUNT value on done: 7934.0 [2024-08-05 22:25:43,646][52662] Sum rewards: 8.764, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO4': '0.078', 'weapon4': '0.078', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '0.990', 'weapon2': '1.170', 'weapon3': '2.502', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:43,659][52647] DAMAGECOUNT value on done: 7890.0 [2024-08-05 22:25:43,659][52647] Sum rewards: 13.079, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.360', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon4': '0.190', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.242', 'weapon3': '2.130', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '10.000'} [2024-08-05 22:25:43,688][52663] DAMAGECOUNT value on done: 7362.0 [2024-08-05 22:25:43,689][52663] Sum rewards: 13.705, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.502', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.076', 'ARMOR': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.198', 'WEAPON3': '0.550', 'HITCOUNT': '1.110', 'weapon2': '1.338', 'weapon3': '1.464', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '10.000'} [2024-08-05 22:25:43,849][52650] Updated weights for policy 0, policy_version 7531 (0.0011) [2024-08-05 22:25:44,251][52794] DAMAGECOUNT value on done: 9307.0 [2024-08-05 22:25:44,251][52794] Sum rewards: 7.412, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.080', 'AMMO4': '0.093', 'AMMO3': '0.104', 'weapon4': '0.220', 'HEALTH': '0.384', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'ARMOR': '0.874', 'weapon2': '1.382', 'weapon3': '1.688', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:44,906][52665] DAMAGECOUNT value on done: 6718.0 [2024-08-05 22:25:44,906][52665] Sum rewards: 1.740, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.106', 'weapon4': '0.222', 'HITCOUNT': '0.320', 'WEAPON3': '0.400', 'ARMOR': '0.412', 'FRAGCOUNT': '1.000', 'weapon2': '1.026', 'DAMAGECOUNT': '1.278', 'weapon3': '1.330'} [2024-08-05 22:25:46,322][52669] DAMAGECOUNT value on done: 7533.0 [2024-08-05 22:25:46,325][52669] Sum rewards: 8.425, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.022', 'AMMO3': '0.081', 'AMMO4': '0.112', 'ARMOR': '0.120', 'WEAPON4': '0.200', 'HEALTH': '0.284', 'WEAPON3': '0.550', 'weapon4': '0.566', 'HITCOUNT': '0.800', 'weapon2': '0.886', 'weapon3': '1.684', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:46,517][52647] DAMAGECOUNT value on done: 8887.0 [2024-08-05 22:25:46,520][52647] Sum rewards: 9.985, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.734', 'AMMO2': '0.029', 'AMMO3': '0.073', 'AMMO4': '0.146', 'weapon4': '0.282', 'WEAPON4': '0.300', 'ARMOR': '0.532', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '1.420', 'weapon3': '1.590', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:46,683][52820] DAMAGECOUNT value on done: 6604.0 [2024-08-05 22:25:46,684][52820] Sum rewards: 11.553, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.198', 'weapon5': '0.288', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'HITCOUNT': '0.570', 'HEALTH': '0.718', 'weapon2': '0.788', 'weapon3': '1.346', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:46,690][52662] DAMAGECOUNT value on done: 8656.0 [2024-08-05 22:25:46,690][52662] Sum rewards: 4.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.980', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO3': '0.121', 'HITCOUNT': '0.530', 'ARMOR': '0.821', 'WEAPON3': '0.850', 'weapon2': '1.318', 'weapon3': '1.622', 'DAMAGECOUNT': '1.662', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:46,897][52663] DAMAGECOUNT value on done: 6049.0 [2024-08-05 22:25:46,897][52663] Sum rewards: 0.974, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'HITCOUNT': '0.440', 'weapon4': '0.462', 'weapon2': '0.816', 'WEAPON3': '0.950', 'ARMOR': '0.972', 'DAMAGECOUNT': '1.491', 'weapon3': '2.198', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:47,205][52794] DAMAGECOUNT value on done: 7908.0 [2024-08-05 22:25:47,206][52794] Sum rewards: 4.989, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.123', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO3': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.052', 'ARMOR': '0.056', 'weapon7': '0.062', 'AMMO4': '0.106', 'HITCOUNT': '0.110', 'WEAPON4': '0.200', 'weapon2': '0.272', 'WEAPON3': '0.300', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'DAMAGECOUNT': '0.621', 'weapon4': '0.760', 'weapon3': '0.804', 'FRAGCOUNT': '3.000'} [2024-08-05 22:25:47,706][52665] DAMAGECOUNT value on done: 8298.0 [2024-08-05 22:25:47,708][52665] Sum rewards: 7.500, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.846', 'AMMO2': '0.034', 'AMMO3': '0.108', 'ARMOR': '0.108', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.692', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '0.808', 'weapon3': '2.018', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16520.8, 300 sec: 16828.3). Total num frames: 61759488. Throughput: 0: 4205.5. Samples: 15439590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:25:47,795][52567] Avg episode reward: [(0, '7.248')] [2024-08-05 22:25:47,799][52614] Saving new best policy, reward=7.248! [2024-08-05 22:25:48,737][52650] Updated weights for policy 0, policy_version 7541 (0.0025) [2024-08-05 22:25:49,104][52669] DAMAGECOUNT value on done: 8337.0 [2024-08-05 22:25:49,107][52669] Sum rewards: 8.804, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.047', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.170', 'WEAPON3': '0.900', 'HITCOUNT': '0.910', 'weapon2': '1.428', 'weapon3': '2.014', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:49,554][52662] DAMAGECOUNT value on done: 7597.0 [2024-08-05 22:25:49,555][52662] Sum rewards: 8.843, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.632', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.450', 'ARMOR': '0.489', 'HITCOUNT': '0.610', 'weapon3': '1.254', 'weapon2': '1.648', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:49,585][52663] DAMAGECOUNT value on done: 8721.0 [2024-08-05 22:25:49,588][52663] Sum rewards: 7.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.198', 'WEAPON3': '0.950', 'ARMOR': '0.956', 'HITCOUNT': '1.050', 'weapon2': '1.360', 'weapon3': '2.006', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:49,749][52647] DAMAGECOUNT value on done: 6061.0 [2024-08-05 22:25:49,750][52647] Sum rewards: 13.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.994', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '1.264', 'weapon3': '1.704', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '13.000'} [2024-08-05 22:25:50,005][52794] DAMAGECOUNT value on done: 8177.0 [2024-08-05 22:25:50,007][52794] Sum rewards: 4.797, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.065', 'weapon4': '0.234', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon2': '0.822', 'weapon3': '1.272', 'DAMAGECOUNT': '1.614', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:50,071][52820] DAMAGECOUNT value on done: 7442.0 [2024-08-05 22:25:50,073][52820] Sum rewards: 6.072, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.012', 'AMMO3': '0.056', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'HEALTH': '0.254', 'weapon4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.380', 'ARMOR': '0.450', 'weapon2': '0.912', 'weapon3': '1.024', 'DAMAGECOUNT': '1.176', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:50,801][52665] DAMAGECOUNT value on done: 6388.0 [2024-08-05 22:25:50,802][52665] Sum rewards: 5.073, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.015', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.070', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.210', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon2': '1.150', 'weapon3': '2.128', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '7.000'} [2024-08-05 22:25:51,864][52647] DAMAGECOUNT value on done: 6110.0 [2024-08-05 22:25:51,868][52647] Sum rewards: 9.346, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.005', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.076', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.242', 'ARMOR': '0.473', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.236', 'weapon3': '1.806', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '9.000'} [2024-08-05 22:25:52,259][52662] DAMAGECOUNT value on done: 8781.0 [2024-08-05 22:25:52,260][52662] Sum rewards: 2.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.898', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.158', 'ARMOR': '0.416', 'HITCOUNT': '0.820', 'WEAPON3': '1.100', 'weapon2': '1.240', 'weapon3': '2.416', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:52,430][52669] DAMAGECOUNT value on done: 6143.0 [2024-08-05 22:25:52,432][52669] Sum rewards: 2.594, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.617', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.071', 'HITCOUNT': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.469', 'DAMAGECOUNT': '1.083', 'weapon3': '1.208', 'weapon2': '1.390', 'FRAGCOUNT': '2.000'} [2024-08-05 22:25:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17066.6, 300 sec: 16856.1). Total num frames: 61849600. Throughput: 0: 4195.1. Samples: 15464920. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 22:25:52,795][52567] Avg episode reward: [(0, '7.291')] [2024-08-05 22:25:52,795][52614] Saving new best policy, reward=7.291! [2024-08-05 22:25:52,847][52794] DAMAGECOUNT value on done: 8157.0 [2024-08-05 22:25:52,850][52794] Sum rewards: 3.652, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.329', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.056', 'AMMO3': '0.075', 'WEAPON4': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.488', 'weapon3': '1.570', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '3.000'} [2024-08-05 22:25:52,934][52663] DAMAGECOUNT value on done: 6776.0 [2024-08-05 22:25:52,934][52663] Sum rewards: 4.101, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.800', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'ARMOR': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.296', 'HITCOUNT': '0.390', 'WEAPON3': '0.500', 'weapon2': '0.562', 'weapon3': '1.252', 'DAMAGECOUNT': '1.290', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:53,284][52650] Updated weights for policy 0, policy_version 7551 (0.0013) [2024-08-05 22:25:53,428][52820] DAMAGECOUNT value on done: 6784.0 [2024-08-05 22:25:53,429][52820] Sum rewards: 7.685, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.834', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.059', 'AMMO3': '0.099', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'ARMOR': '0.824', 'weapon2': '1.376', 'weapon3': '1.772', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:53,998][52665] DAMAGECOUNT value on done: 7215.0 [2024-08-05 22:25:53,999][52665] Sum rewards: 4.426, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.781', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.028', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.242', 'HITCOUNT': '0.720', 'weapon2': '0.976', 'WEAPON3': '1.000', 'weapon3': '2.488', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:54,750][52662] DAMAGECOUNT value on done: 8407.0 [2024-08-05 22:25:54,751][52662] Sum rewards: 3.521, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.840', 'AMMO2': '0.009', 'AMMO5': '0.015', 'weapon5': '0.032', 'AMMO4': '0.043', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.300', 'ARMOR': '0.450', 'HITCOUNT': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.114', 'weapon3': '1.748', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:54,865][52647] DAMAGECOUNT value on done: 7892.0 [2024-08-05 22:25:54,865][52647] Sum rewards: 9.637, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.386', 'ARMOR': '0.556', 'WEAPON3': '0.650', 'weapon2': '0.866', 'HITCOUNT': '0.980', 'weapon3': '1.530', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:55,203][52669] DAMAGECOUNT value on done: 8442.0 [2024-08-05 22:25:55,204][52669] Sum rewards: 7.853, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.377', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon5': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.414', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'ARMOR': '0.951', 'weapon2': '1.368', 'weapon3': '1.692', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:55,723][52663] DAMAGECOUNT value on done: 7858.0 [2024-08-05 22:25:55,724][52663] Sum rewards: 3.605, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.527', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO2': '0.028', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.112', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'ARMOR': '0.853', 'weapon3': '1.258', 'weapon2': '1.818', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '5.000'} [2024-08-05 22:25:56,685][52820] DAMAGECOUNT value on done: 6716.0 [2024-08-05 22:25:56,686][52820] Sum rewards: 11.246, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.126', 'WEAPON3': '0.850', 'ARMOR': '0.864', 'HITCOUNT': '0.880', 'weapon2': '1.548', 'weapon3': '2.006', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '11.000'} [2024-08-05 22:25:57,150][52665] DAMAGECOUNT value on done: 6703.0 [2024-08-05 22:25:57,151][52665] Sum rewards: 8.047, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.561', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.095', 'AMMO4': '0.140', 'AMMO3': '0.143', 'WEAPON4': '0.250', 'weapon4': '0.620', 'weapon2': '0.706', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon3': '1.986', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '8.000'} [2024-08-05 22:25:57,393][52662] DAMAGECOUNT value on done: 7573.0 [2024-08-05 22:25:57,396][52662] Sum rewards: 6.861, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO3': '0.030', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.154', 'weapon5': '0.174', 'WEAPON3': '0.200', 'weapon4': '0.224', 'HITCOUNT': '0.290', 'weapon3': '0.704', 'ARMOR': '0.891', 'DAMAGECOUNT': '1.095', 'weapon2': '1.186', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:57,794][52567] Fps is (10 sec: 16383.5, 60 sec: 16793.5, 300 sec: 16828.3). Total num frames: 61923328. Throughput: 0: 4187.5. Samples: 15489870. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:25:57,795][52567] Avg episode reward: [(0, '7.243')] [2024-08-05 22:25:58,168][52669] DAMAGECOUNT value on done: 6953.0 [2024-08-05 22:25:58,179][52669] Sum rewards: 0.628, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.820', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon5': '0.042', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'HITCOUNT': '0.350', 'WEAPON3': '0.900', 'ARMOR': '0.902', 'DAMAGECOUNT': '1.278', 'weapon2': '1.544', 'weapon3': '1.638', 'FRAGCOUNT': '2.000'} [2024-08-05 22:25:58,295][52647] DAMAGECOUNT value on done: 6216.0 [2024-08-05 22:25:58,296][52647] Sum rewards: 7.830, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.240', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'weapon5': '0.262', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.166', 'weapon3': '1.704', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:58,369][52650] Updated weights for policy 0, policy_version 7561 (0.0022) [2024-08-05 22:25:58,728][52663] DAMAGECOUNT value on done: 8716.0 [2024-08-05 22:25:58,729][52663] Sum rewards: 2.845, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.820', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'ARMOR': '0.496', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon2': '1.610', 'weapon3': '1.914', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '4.000'} [2024-08-05 22:25:59,801][52665] DAMAGECOUNT value on done: 7652.0 [2024-08-05 22:25:59,802][52665] Sum rewards: 7.994, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.352', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.104', 'ARMOR': '0.534', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.772', 'weapon3': '1.780', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '6.000'} [2024-08-05 22:25:59,987][52820] DAMAGECOUNT value on done: 7153.0 [2024-08-05 22:25:59,987][52820] Sum rewards: 3.810, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.742', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.154', 'HITCOUNT': '0.600', 'ARMOR': '0.919', 'WEAPON3': '1.050', 'weapon2': '1.316', 'DAMAGECOUNT': '2.100', 'weapon3': '2.188', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:01,053][52647] DAMAGECOUNT value on done: 7560.0 [2024-08-05 22:26:01,054][52647] Sum rewards: 6.978, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.010', 'weapon4': '0.020', 'ARMOR': '0.035', 'AMMO4': '0.047', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HEALTH': '0.244', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '0.976', 'weapon3': '1.946', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:01,275][52669] DAMAGECOUNT value on done: 7729.0 [2024-08-05 22:26:01,277][52669] Sum rewards: 4.654, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.402', 'AMMO2': '0.011', 'AMMO4': '0.057', 'ARMOR': '0.064', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.278', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.044', 'weapon3': '1.258', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:01,854][52663] DAMAGECOUNT value on done: 6207.0 [2024-08-05 22:26:01,855][52663] Sum rewards: 2.544, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.738', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON1': '0.040', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'weapon4': '0.198', 'HITCOUNT': '0.390', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.134', 'weapon2': '1.392', 'weapon3': '1.484', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:02,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 62013440. Throughput: 0: 4194.2. Samples: 15502760. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:26:02,796][52567] Avg episode reward: [(0, '7.049')] [2024-08-05 22:26:02,906][52665] DAMAGECOUNT value on done: 6424.0 [2024-08-05 22:26:02,906][52665] Sum rewards: 8.833, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.656', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.134', 'weapon4': '0.198', 'ARMOR': '0.572', 'WEAPON3': '0.900', 'weapon2': '1.074', 'HITCOUNT': '1.160', 'weapon3': '2.418', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:03,092][52650] Updated weights for policy 0, policy_version 7571 (0.0015) [2024-08-05 22:26:03,376][52820] DAMAGECOUNT value on done: 5759.0 [2024-08-05 22:26:03,383][52667] DAMAGECOUNT value on done: 8426.0 [2024-08-05 22:26:03,385][52820] Sum rewards: 11.080, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.251', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.090', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'weapon2': '1.380', 'weapon3': '1.834', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:03,385][52667] Sum rewards: 4.913, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.016', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'ARMOR': '0.063', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.268', 'HITCOUNT': '0.760', 'WEAPON3': '0.900', 'weapon2': '1.360', 'weapon3': '1.976', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:04,149][52647] DAMAGECOUNT value on done: 7703.0 [2024-08-05 22:26:04,149][52647] Sum rewards: 2.548, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.756', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.446', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'ARMOR': '0.934', 'weapon2': '1.154', 'DAMAGECOUNT': '1.845', 'weapon3': '1.974', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:04,642][52669] DAMAGECOUNT value on done: 6957.0 [2024-08-05 22:26:04,643][52669] Sum rewards: 5.797, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.441', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'ARMOR': '0.068', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.300', 'weapon4': '0.552', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon2': '1.016', 'weapon3': '1.824', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:05,188][52663] DAMAGECOUNT value on done: 6594.0 [2024-08-05 22:26:05,189][52663] Sum rewards: 8.012, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.112', 'weapon4': '0.124', 'AMMO3': '0.135', 'WEAPON5': '0.300', 'ARMOR': '0.850', 'WEAPON3': '1.000', 'HITCOUNT': '1.000', 'weapon2': '1.314', 'weapon3': '2.214', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '7.500'} [2024-08-05 22:26:05,860][52665] DAMAGECOUNT value on done: 6638.0 [2024-08-05 22:26:05,861][52665] Sum rewards: 14.066, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.471', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.116', 'ARMOR': '0.428', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.512', 'weapon3': '1.996', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '13.000'} [2024-08-05 22:26:06,682][52667] DAMAGECOUNT value on done: 7544.0 [2024-08-05 22:26:06,683][52667] Sum rewards: 12.715, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.830', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon4': '0.008', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.334', 'weapon3': '1.696', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '10.000'} [2024-08-05 22:26:06,719][52820] DAMAGECOUNT value on done: 6704.0 [2024-08-05 22:26:06,724][52820] Sum rewards: 2.113, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.669', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.308', 'ARMOR': '0.470', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.324', 'weapon3': '1.806', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:07,257][52647] DAMAGECOUNT value on done: 7313.0 [2024-08-05 22:26:07,257][52647] Sum rewards: 6.677, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.736', 'AMMO2': '0.025', 'AMMO3': '0.107', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.352', 'ARMOR': '0.526', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.136', 'weapon3': '2.004', 'DAMAGECOUNT': '2.166', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:07,691][52669] DAMAGECOUNT value on done: 7465.0 [2024-08-05 22:26:07,693][52669] Sum rewards: 5.566, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.054', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.068', 'WEAPON4': '0.150', 'ARMOR': '0.467', 'HITCOUNT': '0.490', 'weapon4': '0.502', 'WEAPON3': '0.550', 'weapon2': '0.952', 'weapon3': '1.246', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:07,794][52567] Fps is (10 sec: 17203.9, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 62095360. Throughput: 0: 4181.3. Samples: 15527850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:26:07,794][52567] Avg episode reward: [(0, '7.107')] [2024-08-05 22:26:07,929][52650] Updated weights for policy 0, policy_version 7581 (0.0024) [2024-08-05 22:26:08,185][52663] DAMAGECOUNT value on done: 7681.0 [2024-08-05 22:26:08,187][52663] Sum rewards: 9.948, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.008', 'AMMO4': '0.026', 'ARMOR': '0.036', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.540', 'weapon3': '1.772', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:08,443][52665] DAMAGECOUNT value on done: 7904.0 [2024-08-05 22:26:08,451][52665] Sum rewards: 8.922, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.285', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.048', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.242', 'weapon4': '0.316', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '0.844', 'weapon3': '1.076', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:09,585][52667] DAMAGECOUNT value on done: 8065.0 [2024-08-05 22:26:09,586][52667] Sum rewards: 3.573, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.796', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'AMMO3': '0.158', 'weapon4': '0.242', 'HITCOUNT': '0.790', 'WEAPON3': '1.100', 'weapon2': '1.224', 'ARMOR': '1.415', 'weapon3': '1.796', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:10,005][52820] DAMAGECOUNT value on done: 7022.0 [2024-08-05 22:26:10,008][52820] Sum rewards: 5.278, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.573', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.066', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'ARMOR': '0.925', 'weapon2': '1.674', 'weapon3': '1.864', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:10,121][52669] DAMAGECOUNT value on done: 7125.0 [2024-08-05 22:26:10,121][52669] Sum rewards: 4.513, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.101', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.030', 'ARMOR': '0.108', 'AMMO3': '0.129', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.314', 'HITCOUNT': '0.610', 'weapon2': '0.660', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.962', 'weapon3': '2.516', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:10,241][52647] DAMAGECOUNT value on done: 7615.0 [2024-08-05 22:26:10,241][52647] Sum rewards: 3.331, reward structure: {'DEATHCOUNT': '-5.250', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.087', 'AMMO4': '0.098', 'HEALTH': '0.454', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.522', 'weapon2': '1.196', 'weapon3': '1.586', 'DAMAGECOUNT': '1.638', 'FRAGCOUNT': '2.000'} [2024-08-05 22:26:10,901][52663] DAMAGECOUNT value on done: 7135.0 [2024-08-05 22:26:10,902][52663] Sum rewards: 3.785, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.249', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.276', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'ARMOR': '0.910', 'weapon2': '1.332', 'weapon3': '1.602', 'DAMAGECOUNT': '1.830', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:11,649][52665] DAMAGECOUNT value on done: 8199.0 [2024-08-05 22:26:11,650][52665] Sum rewards: 10.339, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.411', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.088', 'AMMO3': '0.111', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.544', 'weapon3': '1.874', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 62177280. Throughput: 0: 4190.0. Samples: 15553410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:26:12,794][52567] Avg episode reward: [(0, '7.016')] [2024-08-05 22:26:12,824][52667] DAMAGECOUNT value on done: 7542.0 [2024-08-05 22:26:12,829][52667] Sum rewards: 9.120, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.076', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'HEALTH': '0.778', 'weapon2': '1.092', 'weapon3': '1.198', 'DAMAGECOUNT': '2.376', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:12,932][52647] DAMAGECOUNT value on done: 5988.0 [2024-08-05 22:26:12,933][52647] Sum rewards: 4.121, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.849', 'AMMO5': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'ARMOR': '0.412', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.054', 'weapon3': '1.378', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:13,201][52650] Updated weights for policy 0, policy_version 7591 (0.0039) [2024-08-05 22:26:13,241][52669] DAMAGECOUNT value on done: 8169.0 [2024-08-05 22:26:13,242][52669] Sum rewards: 9.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.916', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'ARMOR': '0.055', 'AMMO4': '0.079', 'AMMO3': '0.131', 'weapon4': '0.168', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '1.350', 'weapon3': '2.068', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:13,612][52820] DAMAGECOUNT value on done: 6111.0 [2024-08-05 22:26:13,620][52820] Sum rewards: 8.243, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.477', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.238', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'ARMOR': '0.967', 'weapon2': '1.424', 'weapon3': '1.606', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:13,692][52614] Signal inference workers to stop experience collection... (1400 times) [2024-08-05 22:26:13,705][52614] Signal inference workers to resume experience collection... (1400 times) [2024-08-05 22:26:13,738][52650] InferenceWorker_p0-w0: stopping experience collection (1400 times) [2024-08-05 22:26:13,738][52650] InferenceWorker_p0-w0: resuming experience collection (1400 times) [2024-08-05 22:26:13,903][52663] DAMAGECOUNT value on done: 7257.0 [2024-08-05 22:26:13,903][52663] Sum rewards: 8.013, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.400', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.440', 'ARMOR': '0.536', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '0.792', 'weapon3': '1.728', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:14,780][52665] DAMAGECOUNT value on done: 6883.0 [2024-08-05 22:26:14,781][52665] Sum rewards: 4.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.860', 'AMMO5': '0.014', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.040', 'AMMO4': '0.096', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.340', 'ARMOR': '0.470', 'HITCOUNT': '0.600', 'weapon2': '0.954', 'WEAPON3': '1.000', 'weapon3': '1.976', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:15,454][52667] DAMAGECOUNT value on done: 8422.0 [2024-08-05 22:26:15,454][52667] Sum rewards: 6.452, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.061', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.214', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '1.542', 'weapon3': '1.608', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:16,288][52647] DAMAGECOUNT value on done: 7442.0 [2024-08-05 22:26:16,290][52647] Sum rewards: 12.565, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.344', 'AMMO4': '-0.091', 'AMMO2': '-0.018', 'AMMO5': '0.003', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'WEAPON3': '0.800', 'ARMOR': '0.942', 'HITCOUNT': '0.980', 'weapon2': '1.488', 'weapon3': '1.774', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '12.000'} [2024-08-05 22:26:16,563][52663] DAMAGECOUNT value on done: 7879.0 [2024-08-05 22:26:16,565][52663] Sum rewards: 11.341, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.294', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon4': '0.056', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'ARMOR': '0.516', 'WEAPON3': '0.650', 'HITCOUNT': '1.000', 'weapon3': '1.536', 'weapon2': '1.836', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:17,130][52820] DAMAGECOUNT value on done: 5670.0 [2024-08-05 22:26:17,132][52820] Sum rewards: 2.446, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.003', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon4': '0.218', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.696', 'ARMOR': '0.938', 'DAMAGECOUNT': '1.020', 'weapon3': '1.330', 'FRAGCOUNT': '2.000'} [2024-08-05 22:26:17,475][52665] DAMAGECOUNT value on done: 7810.0 [2024-08-05 22:26:17,477][52665] Sum rewards: 14.294, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.436', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.028', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'ARMOR': '1.230', 'weapon2': '1.462', 'weapon3': '2.020', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '12.000'} [2024-08-05 22:26:17,800][52567] Fps is (10 sec: 16374.7, 60 sec: 16655.5, 300 sec: 16800.2). Total num frames: 62259200. Throughput: 0: 4200.1. Samples: 15566080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:26:17,800][52567] Avg episode reward: [(0, '6.949')] [2024-08-05 22:26:17,849][52650] Updated weights for policy 0, policy_version 7601 (0.0024) [2024-08-05 22:26:18,347][52667] DAMAGECOUNT value on done: 8222.0 [2024-08-05 22:26:18,347][52667] Sum rewards: 8.581, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.195', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.070', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.402', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'ARMOR': '0.864', 'weapon2': '1.142', 'weapon3': '1.638', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:19,524][52663] DAMAGECOUNT value on done: 7331.0 [2024-08-05 22:26:19,532][52663] Sum rewards: 3.688, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'ARMOR': '0.060', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'HITCOUNT': '0.680', 'weapon2': '0.862', 'WEAPON3': '1.200', 'DAMAGECOUNT': '2.397', 'weapon3': '2.738', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:19,645][52647] DAMAGECOUNT value on done: 6941.0 [2024-08-05 22:26:19,646][52647] Sum rewards: 10.023, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.990', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.402', 'WEAPON3': '0.800', 'HITCOUNT': '0.870', 'ARMOR': '0.977', 'weapon2': '1.396', 'weapon3': '1.648', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '11.000'} [2024-08-05 22:26:20,583][52665] DAMAGECOUNT value on done: 8268.0 [2024-08-05 22:26:20,588][52665] Sum rewards: 7.276, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.787', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.322', 'ARMOR': '0.545', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.138', 'weapon3': '1.500', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:20,735][52820] DAMAGECOUNT value on done: 7127.0 [2024-08-05 22:26:20,736][52820] Sum rewards: 4.989, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.022', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'HEALTH': '0.262', 'weapon4': '0.360', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'ARMOR': '0.432', 'weapon3': '1.286', 'DAMAGECOUNT': '1.404', 'weapon2': '1.408', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:20,962][52667] DAMAGECOUNT value on done: 7759.0 [2024-08-05 22:26:20,963][52667] Sum rewards: 3.234, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.339', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.126', 'AMMO4': '0.126', 'ARMOR': '0.128', 'WEAPON4': '0.200', 'HITCOUNT': '0.470', 'weapon4': '0.594', 'weapon2': '0.596', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.935', 'weapon3': '2.214', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:21,068][52658] DAMAGECOUNT value on done: 6844.0 [2024-08-05 22:26:21,070][52658] Sum rewards: 11.315, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.685', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.034', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.528', 'HITCOUNT': '0.720', 'weapon3': '1.378', 'weapon2': '1.494', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:21,331][52649] DAMAGECOUNT value on done: 8104.0 [2024-08-05 22:26:21,331][52649] Sum rewards: 7.484, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.914', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.148', 'HITCOUNT': '0.980', 'weapon2': '1.006', 'WEAPON3': '1.100', 'weapon3': '2.554', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:22,406][52650] Updated weights for policy 0, policy_version 7611 (0.0022) [2024-08-05 22:26:22,550][52663] DAMAGECOUNT value on done: 7755.0 [2024-08-05 22:26:22,550][52663] Sum rewards: 12.466, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.669', 'AMMO2': '0.022', 'weapon4': '0.036', 'AMMO3': '0.086', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.914', 'HITCOUNT': '0.970', 'weapon2': '1.584', 'weapon3': '1.798', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 62349312. Throughput: 0: 4201.6. Samples: 15591340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:26:22,794][52567] Avg episode reward: [(0, '7.022')] [2024-08-05 22:26:22,849][52647] DAMAGECOUNT value on done: 7946.0 [2024-08-05 22:26:22,850][52647] Sum rewards: 10.329, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.185', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.220', 'ARMOR': '0.416', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon2': '0.950', 'weapon3': '1.002', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:23,072][52665] DAMAGECOUNT value on done: 8040.0 [2024-08-05 22:26:23,072][52665] Sum rewards: 9.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.568', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.022', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON3': '1.000', 'HITCOUNT': '1.100', 'weapon2': '1.356', 'ARMOR': '1.392', 'weapon3': '2.244', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:23,926][52649] DAMAGECOUNT value on done: 6699.0 [2024-08-05 22:26:23,932][52649] Sum rewards: 3.918, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.738', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.174', 'ARMOR': '0.476', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon3': '1.286', 'weapon2': '1.430', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:23,995][52667] DAMAGECOUNT value on done: 7239.0 [2024-08-05 22:26:23,995][52667] Sum rewards: 2.730, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.444', 'weapon3': '2.114', 'DAMAGECOUNT': '2.328', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:24,133][52820] DAMAGECOUNT value on done: 7177.0 [2024-08-05 22:26:24,133][52820] Sum rewards: 12.076, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.120', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.462', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon2': '1.056', 'weapon3': '1.608', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '10.000'} [2024-08-05 22:26:24,195][52658] DAMAGECOUNT value on done: 6980.0 [2024-08-05 22:26:24,198][52658] Sum rewards: 9.023, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.776', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.322', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'ARMOR': '0.980', 'weapon2': '1.450', 'weapon3': '1.636', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:24,750][52663] DAMAGECOUNT value on done: 7372.0 [2024-08-05 22:26:24,752][52663] Sum rewards: -0.944, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.054', 'ARMOR': '0.096', 'AMMO4': '0.107', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'HITCOUNT': '0.400', 'weapon4': '0.604', 'weapon2': '0.918', 'WEAPON3': '0.950', 'DAMAGECOUNT': '1.176', 'weapon3': '1.838', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:25,414][52666] DAMAGECOUNT value on done: 6850.0 [2024-08-05 22:26:25,415][52666] Sum rewards: 8.463, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.487', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON1': '0.010', 'AMMO3': '0.123', 'HITCOUNT': '0.760', 'WEAPON3': '0.850', 'ARMOR': '0.912', 'weapon3': '1.700', 'weapon2': '1.714', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:25,966][52647] DAMAGECOUNT value on done: 7108.0 [2024-08-05 22:26:25,966][52647] Sum rewards: 13.824, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.414', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO3': '0.082', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '0.948', 'weapon2': '1.366', 'weapon3': '1.850', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '10.000'} [2024-08-05 22:26:26,265][52665] DAMAGECOUNT value on done: 6979.0 [2024-08-05 22:26:26,265][52665] Sum rewards: 2.430, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.661', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.170', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon2': '0.882', 'DAMAGECOUNT': '1.107', 'weapon3': '1.414', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:27,003][52670] DAMAGECOUNT value on done: 8176.0 [2024-08-05 22:26:27,005][52670] Sum rewards: 8.100, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.750', 'AMMO2': '0.013', 'ARMOR': '0.056', 'AMMO4': '0.067', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.214', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '0.986', 'weapon3': '1.788', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:27,136][52667] DAMAGECOUNT value on done: 7421.0 [2024-08-05 22:26:27,138][52667] Sum rewards: 5.641, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.228', 'weapon4': '0.022', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.134', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '0.836', 'weapon3': '1.428', 'weapon2': '1.718', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:27,333][52649] DAMAGECOUNT value on done: 5746.0 [2024-08-05 22:26:27,334][52649] Sum rewards: 0.552, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.884', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.036', 'AMMO3': '0.091', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.505', 'weapon4': '0.578', 'WEAPON3': '0.650', 'DAMAGECOUNT': '0.792', 'FRAGCOUNT': '1.000', 'weapon2': '1.284', 'weapon3': '1.714'} [2024-08-05 22:26:27,427][52658] DAMAGECOUNT value on done: 6307.0 [2024-08-05 22:26:27,430][52658] Sum rewards: 2.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.914', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.022', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'ARMOR': '0.933', 'weapon2': '1.318', 'weapon3': '1.908', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:27,439][52650] Updated weights for policy 0, policy_version 7621 (0.0020) [2024-08-05 22:26:27,732][52666] DAMAGECOUNT value on done: 7100.0 [2024-08-05 22:26:27,734][52666] Sum rewards: 6.298, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.010', 'AMMO4': '0.050', 'ARMOR': '0.050', 'AMMO3': '0.092', 'HEALTH': '0.146', 'WEAPON3': '0.500', 'HITCOUNT': '0.540', 'weapon2': '0.964', 'weapon3': '1.454', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:27,794][52567] Fps is (10 sec: 17212.7, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 62431232. Throughput: 0: 4206.7. Samples: 15616800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:26:27,795][52567] Avg episode reward: [(0, '6.943')] [2024-08-05 22:26:27,819][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007622_62439424.pth... [2024-08-05 22:26:27,942][52663] DAMAGECOUNT value on done: 7209.0 [2024-08-05 22:26:27,943][52663] Sum rewards: 8.557, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.451', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'weapon4': '0.230', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.933', 'weapon2': '1.392', 'weapon3': '1.746', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:27,958][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007129_58400768.pth [2024-08-05 22:26:28,386][52647] DAMAGECOUNT value on done: 7889.0 [2024-08-05 22:26:28,386][52647] Sum rewards: 5.459, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.235', 'AMMO2': '0.002', 'AMMO4': '0.007', 'ARMOR': '0.048', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.210', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon2': '0.808', 'weapon3': '1.424', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:29,619][52665] DAMAGECOUNT value on done: 7053.0 [2024-08-05 22:26:29,621][52665] Sum rewards: 7.619, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.130', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.072', 'AMMO4': '0.076', 'AMMO3': '0.077', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.360', 'WEAPON3': '0.500', 'weapon4': '0.568', 'HITCOUNT': '0.680', 'weapon2': '1.030', 'weapon3': '1.548', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:29,785][52670] DAMAGECOUNT value on done: 7303.0 [2024-08-05 22:26:29,785][52670] Sum rewards: 6.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.386', 'weapon3': '1.902', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:30,385][52667] DAMAGECOUNT value on done: 7953.0 [2024-08-05 22:26:30,386][52667] Sum rewards: 6.502, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.429', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.084', 'AMMO3': '0.087', 'WEAPON4': '0.250', 'ARMOR': '0.468', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon4': '0.732', 'weapon2': '1.064', 'weapon3': '1.608', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:30,606][52658] DAMAGECOUNT value on done: 7462.0 [2024-08-05 22:26:30,609][52658] Sum rewards: 11.170, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.016', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.037', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'ARMOR': '1.466', 'weapon2': '1.546', 'weapon3': '1.842', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:30,660][52649] DAMAGECOUNT value on done: 8602.0 [2024-08-05 22:26:30,663][52649] Sum rewards: 12.981, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.566', 'AMMO4': '-0.088', 'AMMO2': '-0.017', 'AMMO3': '0.142', 'ARMOR': '0.857', 'WEAPON3': '0.950', 'HITCOUNT': '1.000', 'weapon3': '1.802', 'weapon2': '1.930', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '13.000'} [2024-08-05 22:26:30,914][52666] DAMAGECOUNT value on done: 6696.0 [2024-08-05 22:26:30,915][52666] Sum rewards: 7.091, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.464', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon4': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon3': '1.300', 'ARMOR': '1.338', 'weapon2': '1.386', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:31,069][52647] DAMAGECOUNT value on done: 7218.0 [2024-08-05 22:26:31,070][52647] Sum rewards: 1.730, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.341', 'AMMO2': '0.003', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'weapon4': '0.196', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.997', 'weapon2': '1.026', 'DAMAGECOUNT': '1.053', 'weapon3': '1.628', 'FRAGCOUNT': '2.000'} [2024-08-05 22:26:31,198][52663] DAMAGECOUNT value on done: 6865.0 [2024-08-05 22:26:31,201][52663] Sum rewards: 10.362, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.026', 'HEALTH': '0.054', 'AMMO3': '0.090', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.434', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'ARMOR': '0.824', 'weapon2': '1.406', 'weapon3': '1.528', 'DAMAGECOUNT': '2.571', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:32,144][52664] DAMAGECOUNT value on done: 8622.0 [2024-08-05 22:26:32,144][52664] Sum rewards: 8.755, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.130', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.220', 'WEAPON3': '0.450', 'ARMOR': '0.468', 'HITCOUNT': '0.800', 'weapon2': '1.338', 'weapon3': '1.418', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:32,344][52650] Updated weights for policy 0, policy_version 7631 (0.0036) [2024-08-05 22:26:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 62521344. Throughput: 0: 4213.6. Samples: 15629200. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:26:32,794][52567] Avg episode reward: [(0, '6.879')] [2024-08-05 22:26:32,936][52665] DAMAGECOUNT value on done: 7381.0 [2024-08-05 22:26:32,936][52665] Sum rewards: 7.737, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.752', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.094', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'ARMOR': '0.874', 'weapon3': '1.198', 'weapon2': '1.596', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:33,046][52670] DAMAGECOUNT value on done: 6414.0 [2024-08-05 22:26:33,047][52670] Sum rewards: 9.065, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.060', 'weapon4': '0.124', 'HEALTH': '0.129', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'HITCOUNT': '0.680', 'weapon2': '1.214', 'weapon3': '1.250', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:33,221][52667] DAMAGECOUNT value on done: 6987.0 [2024-08-05 22:26:33,222][52667] Sum rewards: 4.791, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.228', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.018', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.260', 'ARMOR': '0.420', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon3': '1.262', 'weapon2': '1.356', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:33,479][52658] DAMAGECOUNT value on done: 7233.0 [2024-08-05 22:26:33,481][52658] Sum rewards: 1.828, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.140', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon7': '0.054', 'AMMO3': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.328', 'HITCOUNT': '0.330', 'ARMOR': '0.528', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.107', 'weapon2': '1.142', 'weapon3': '1.428', 'FRAGCOUNT': '2.000'} [2024-08-05 22:26:33,726][52647] DAMAGECOUNT value on done: 7658.0 [2024-08-05 22:26:33,740][52647] Sum rewards: 7.234, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.320', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.113', 'ARMOR': '0.428', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.284', 'weapon3': '1.662', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:33,960][52649] DAMAGECOUNT value on done: 6026.0 [2024-08-05 22:26:33,964][52649] Sum rewards: 3.022, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.354', 'AMMO2': '0.025', 'AMMO3': '0.117', 'AMMO4': '0.125', 'weapon4': '0.268', 'WEAPON4': '0.300', 'HITCOUNT': '0.450', 'ARMOR': '0.488', 'weapon2': '0.596', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.515', 'weapon3': '1.542', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:34,231][52666] DAMAGECOUNT value on done: 8148.0 [2024-08-05 22:26:34,235][52666] Sum rewards: 7.763, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'weapon5': '0.038', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON3': '0.500', 'HEALTH': '0.502', 'HITCOUNT': '0.660', 'ARMOR': '1.337', 'weapon2': '1.564', 'weapon3': '1.722', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '4.500'} [2024-08-05 22:26:34,385][52663] DAMAGECOUNT value on done: 6743.0 [2024-08-05 22:26:34,386][52663] Sum rewards: 7.622, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.013', 'weapon7': '0.052', 'AMMO4': '0.063', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.170', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '1.296', 'weapon3': '1.336', 'weapon2': '1.416', 'DAMAGECOUNT': '2.052', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:34,982][52664] DAMAGECOUNT value on done: 7703.0 [2024-08-05 22:26:34,982][52664] Sum rewards: 8.633, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.147', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.224', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'weapon2': '1.526', 'weapon3': '1.528', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:36,177][52665] DAMAGECOUNT value on done: 6911.0 [2024-08-05 22:26:36,179][52665] Sum rewards: 8.504, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon5': '0.098', 'HEALTH': '0.358', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'ARMOR': '0.887', 'weapon3': '1.438', 'weapon2': '1.584', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:36,323][52667] DAMAGECOUNT value on done: 8581.0 [2024-08-05 22:26:36,326][52667] Sum rewards: 15.888, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'HEALTH': '0.140', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'ARMOR': '1.651', 'weapon2': '1.790', 'weapon3': '1.976', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '11.000'} [2024-08-05 22:26:36,448][52670] DAMAGECOUNT value on done: 6439.0 [2024-08-05 22:26:36,452][52670] Sum rewards: 7.846, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.322', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.028', 'AMMO4': '0.041', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'ARMOR': '0.109', 'WEAPON4': '0.250', 'weapon4': '0.420', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon2': '1.230', 'weapon3': '1.528', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:36,595][52658] DAMAGECOUNT value on done: 6148.0 [2024-08-05 22:26:36,596][52658] Sum rewards: 5.073, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.314', 'AMMO4': '-0.108', 'AMMO2': '-0.022', 'AMMO3': '0.060', 'HITCOUNT': '0.400', 'WEAPON3': '0.450', 'ARMOR': '1.282', 'weapon3': '1.510', 'DAMAGECOUNT': '1.545', 'weapon2': '1.770', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:37,027][52663] DAMAGECOUNT value on done: 6834.0 [2024-08-05 22:26:37,027][52663] Sum rewards: 3.791, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.045', 'weapon7': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'HEALTH': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.258', 'HITCOUNT': '0.310', 'weapon5': '0.414', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'weapon2': '1.034', 'DAMAGECOUNT': '1.392', 'weapon3': '1.430', 'FRAGCOUNT': '2.500'} [2024-08-05 22:26:37,029][52647] DAMAGECOUNT value on done: 7351.0 [2024-08-05 22:26:37,029][52647] Sum rewards: 3.190, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.111', 'weapon4': '0.216', 'HEALTH': '0.294', 'HITCOUNT': '0.440', 'WEAPON3': '0.650', 'ARMOR': '0.875', 'weapon2': '1.402', 'DAMAGECOUNT': '1.740', 'weapon3': '1.898', 'FRAGCOUNT': '2.000'} [2024-08-05 22:26:37,264][52650] Updated weights for policy 0, policy_version 7641 (0.0014) [2024-08-05 22:26:37,343][52649] DAMAGECOUNT value on done: 7663.0 [2024-08-05 22:26:37,345][52649] Sum rewards: 3.101, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.673', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.230', 'WEAPON3': '0.250', 'HITCOUNT': '0.310', 'ARMOR': '0.486', 'weapon3': '0.736', 'weapon2': '0.886', 'DAMAGECOUNT': '0.996', 'FRAGCOUNT': '2.000'} [2024-08-05 22:26:37,574][52666] DAMAGECOUNT value on done: 7165.0 [2024-08-05 22:26:37,578][52666] Sum rewards: 8.672, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.104', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.516', 'weapon4': '0.564', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.220', 'weapon3': '1.696', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 62603264. Throughput: 0: 4215.4. Samples: 15654610. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-05 22:26:37,794][52567] Avg episode reward: [(0, '6.901')] [2024-08-05 22:26:38,292][52664] DAMAGECOUNT value on done: 8014.0 [2024-08-05 22:26:38,292][52664] Sum rewards: 11.463, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.188', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.282', 'ARMOR': '0.517', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon2': '1.038', 'weapon3': '1.876', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '10.000'} [2024-08-05 22:26:39,265][52667] DAMAGECOUNT value on done: 8586.0 [2024-08-05 22:26:39,268][52667] Sum rewards: 10.017, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.288', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.192', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon2': '1.152', 'weapon3': '1.780', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '10.000'} [2024-08-05 22:26:39,481][52665] DAMAGECOUNT value on done: 8167.0 [2024-08-05 22:26:39,481][52665] Sum rewards: 3.696, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.377', 'AMMO2': '0.012', 'ARMOR': '0.052', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'HITCOUNT': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.064', 'weapon3': '2.128', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:39,531][52670] DAMAGECOUNT value on done: 5899.0 [2024-08-05 22:26:39,531][52670] Sum rewards: 6.761, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.992', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO3': '0.119', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'weapon3': '1.286', 'ARMOR': '1.800', 'weapon2': '1.952', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:39,645][52658] DAMAGECOUNT value on done: 8330.0 [2024-08-05 22:26:39,646][52658] Sum rewards: 3.688, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.964', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO5': '0.025', 'weapon5': '0.034', 'AMMO4': '0.115', 'AMMO3': '0.127', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HITCOUNT': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.254', 'ARMOR': '1.466', 'weapon3': '1.748', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:40,648][52649] DAMAGECOUNT value on done: 6304.0 [2024-08-05 22:26:40,651][52649] Sum rewards: 2.413, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.177', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.015', 'weapon7': '0.068', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.172', 'WEAPON7': '0.200', 'ARMOR': '0.502', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon3': '1.440', 'FRAGCOUNT': '1.500', 'weapon2': '1.504', 'DAMAGECOUNT': '2.175'} [2024-08-05 22:26:40,765][52666] DAMAGECOUNT value on done: 6978.0 [2024-08-05 22:26:41,955][52667] DAMAGECOUNT value on done: 8824.0 [2024-08-05 22:26:41,956][52667] Sum rewards: 11.890, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.246', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.126', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'ARMOR': '1.294', 'weapon2': '1.316', 'weapon3': '1.910', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:41,980][52664] DAMAGECOUNT value on done: 6525.0 [2024-08-05 22:26:41,980][52664] Sum rewards: 4.772, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.679', 'AMMO2': '0.018', 'weapon7': '0.054', 'AMMO3': '0.085', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.340', 'weapon4': '0.514', 'ARMOR': '0.520', 'WEAPON3': '0.550', 'weapon2': '1.410', 'DAMAGECOUNT': '1.527', 'weapon3': '1.544', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:42,080][52650] Updated weights for policy 0, policy_version 7651 (0.0012) [2024-08-05 22:26:42,389][52658] DAMAGECOUNT value on done: 7817.0 [2024-08-05 22:26:42,391][52658] Sum rewards: 8.039, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.813', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'HITCOUNT': '0.660', 'ARMOR': '0.978', 'WEAPON3': '1.000', 'weapon2': '1.888', 'weapon3': '1.978', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 62685184. Throughput: 0: 4220.9. Samples: 15679810. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-05 22:26:42,794][52567] Avg episode reward: [(0, '6.879')] [2024-08-05 22:26:42,954][52670] DAMAGECOUNT value on done: 7127.0 [2024-08-05 22:26:42,955][52670] Sum rewards: 4.861, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.316', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'ARMOR': '0.901', 'weapon2': '1.144', 'weapon3': '2.096', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:43,410][52649] DAMAGECOUNT value on done: 6838.0 [2024-08-05 22:26:43,411][52649] Sum rewards: 8.808, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.086', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.144', 'HEALTH': '0.402', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.388', 'weapon3': '1.620', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:43,558][52671] DAMAGECOUNT value on done: 8490.0 [2024-08-05 22:26:43,559][52671] Sum rewards: 3.602, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.598', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HITCOUNT': '0.400', 'ARMOR': '0.434', 'WEAPON3': '0.450', 'weapon2': '0.822', 'weapon3': '0.972', 'DAMAGECOUNT': '1.005', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:44,069][52666] DAMAGECOUNT value on done: 7204.0 [2024-08-05 22:26:44,072][52666] Sum rewards: 9.735, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.472', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.012', 'weapon5': '0.076', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'ARMOR': '0.909', 'weapon2': '1.158', 'weapon3': '1.974', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:44,760][52664] DAMAGECOUNT value on done: 7623.0 [2024-08-05 22:26:44,762][52664] Sum rewards: 4.900, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.136', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.258', 'weapon5': '0.262', 'ARMOR': '0.428', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.244', 'weapon2': '1.446', 'DAMAGECOUNT': '1.608', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:44,988][52667] DAMAGECOUNT value on done: 7956.0 [2024-08-05 22:26:44,990][52667] Sum rewards: 6.578, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.024', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.028', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.218', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon2': '0.980', 'weapon3': '1.378', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:45,257][52658] DAMAGECOUNT value on done: 6473.0 [2024-08-05 22:26:45,257][52658] Sum rewards: 5.798, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.678', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO3': '0.050', 'AMMO4': '0.055', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon4': '0.460', 'HITCOUNT': '0.470', 'ARMOR': '0.483', 'weapon5': '0.570', 'weapon3': '0.870', 'weapon2': '0.976', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:46,164][52670] DAMAGECOUNT value on done: 7041.0 [2024-08-05 22:26:46,165][52670] Sum rewards: 7.356, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.418', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.083', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon3': '1.274', 'weapon2': '1.434', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:46,452][52649] DAMAGECOUNT value on done: 7141.0 [2024-08-05 22:26:46,452][52649] Sum rewards: 5.683, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.468', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.076', 'ARMOR': '0.095', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '1.316', 'weapon3': '2.362', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:46,833][52671] DAMAGECOUNT value on done: 7175.0 [2024-08-05 22:26:46,835][52671] Sum rewards: 4.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.466', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.161', 'HITCOUNT': '0.640', 'WEAPON3': '1.000', 'ARMOR': '1.309', 'weapon2': '1.322', 'weapon3': '1.888', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:46,873][52666] DAMAGECOUNT value on done: 7100.0 [2024-08-05 22:26:46,874][52666] Sum rewards: 3.863, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.544', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.232', 'ARMOR': '0.464', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon3': '1.336', 'weapon2': '1.504', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:47,027][52650] Updated weights for policy 0, policy_version 7661 (0.0041) [2024-08-05 22:26:47,538][52667] DAMAGECOUNT value on done: 6612.0 [2024-08-05 22:26:47,540][52667] Sum rewards: 8.461, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.075', 'HEALTH': '0.302', 'weapon4': '0.312', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'weapon2': '0.804', 'ARMOR': '0.836', 'weapon3': '1.412', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 62767104. Throughput: 0: 4216.7. Samples: 15692510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 22:26:47,794][52567] Avg episode reward: [(0, '6.974')] [2024-08-05 22:26:47,803][52658] DAMAGECOUNT value on done: 6491.0 [2024-08-05 22:26:47,804][52658] Sum rewards: 0.334, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.986', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'weapon4': '0.062', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.310', 'weapon5': '0.360', 'FRAGCOUNT': '0.500', 'ARMOR': '0.507', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.005', 'weapon2': '1.404', 'weapon3': '1.850'} [2024-08-05 22:26:48,025][52664] DAMAGECOUNT value on done: 7122.0 [2024-08-05 22:26:48,028][52664] Sum rewards: 1.046, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.138', 'AMMO2': '0.021', 'AMMO3': '0.089', 'ARMOR': '0.104', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.262', 'HITCOUNT': '0.300', 'WEAPON3': '0.550', 'FRAGCOUNT': '1.000', 'weapon2': '1.022', 'DAMAGECOUNT': '1.161', 'weapon3': '1.670'} [2024-08-05 22:26:48,840][52670] DAMAGECOUNT value on done: 6664.0 [2024-08-05 22:26:48,848][52670] Sum rewards: 5.496, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.265', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.093', 'weapon4': '0.274', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'ARMOR': '0.901', 'weapon2': '1.416', 'weapon3': '1.428', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:49,580][52649] DAMAGECOUNT value on done: 7076.0 [2024-08-05 22:26:49,580][52649] Sum rewards: 6.316, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.706', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'ARMOR': '0.933', 'weapon2': '1.506', 'weapon3': '1.932', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:49,899][52666] DAMAGECOUNT value on done: 7517.0 [2024-08-05 22:26:49,901][52666] Sum rewards: 5.850, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.753', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.140', 'HITCOUNT': '0.700', 'ARMOR': '0.850', 'WEAPON3': '0.900', 'weapon2': '1.360', 'weapon3': '1.948', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:50,235][52671] DAMAGECOUNT value on done: 8202.0 [2024-08-05 22:26:50,235][52671] Sum rewards: 10.911, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.041', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.081', 'ARMOR': '0.112', 'WEAPON4': '0.300', 'weapon4': '0.478', 'WEAPON3': '0.800', 'HITCOUNT': '0.970', 'weapon2': '0.996', 'weapon3': '1.862', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:50,582][52667] DAMAGECOUNT value on done: 7551.0 [2024-08-05 22:26:50,584][52667] Sum rewards: 4.943, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.382', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'HITCOUNT': '0.770', 'WEAPON3': '0.950', 'ARMOR': '1.296', 'weapon2': '1.560', 'weapon3': '1.846', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:50,836][52664] DAMAGECOUNT value on done: 7687.0 [2024-08-05 22:26:50,838][52664] Sum rewards: 0.930, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.108', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'ARMOR': '0.453', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.620', 'weapon3': '1.652', 'weapon2': '1.664', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:51,021][52658] DAMAGECOUNT value on done: 7996.0 [2024-08-05 22:26:51,021][52658] Sum rewards: 12.087, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.085', 'weapon4': '0.224', 'WEAPON3': '0.500', 'HEALTH': '0.528', 'HITCOUNT': '0.870', 'weapon2': '1.218', 'weapon3': '1.716', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.000'} [2024-08-05 22:26:51,491][52659] DAMAGECOUNT value on done: 7200.0 [2024-08-05 22:26:51,493][52659] Sum rewards: 7.732, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.510', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.115', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.068', 'weapon3': '1.854', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:51,583][52650] Updated weights for policy 0, policy_version 7671 (0.0031) [2024-08-05 22:26:52,338][52670] DAMAGECOUNT value on done: 6224.0 [2024-08-05 22:26:52,338][52670] Sum rewards: 7.544, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.777', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.126', 'weapon4': '0.286', 'WEAPON4': '0.300', 'ARMOR': '0.481', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'weapon2': '1.206', 'weapon3': '1.528', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:52,793][52649] DAMAGECOUNT value on done: 7847.0 [2024-08-05 22:26:52,793][52649] Sum rewards: 16.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.041', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.120', 'weapon4': '0.268', 'ARMOR': '0.543', 'WEAPON3': '0.800', 'HITCOUNT': '1.080', 'weapon2': '1.156', 'weapon3': '2.356', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '14.000'} [2024-08-05 22:26:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16828.3). Total num frames: 62857216. Throughput: 0: 4222.7. Samples: 15717870. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:26:52,794][52567] Avg episode reward: [(0, '6.780')] [2024-08-05 22:26:53,146][52671] DAMAGECOUNT value on done: 7826.0 [2024-08-05 22:26:53,147][52671] Sum rewards: 6.452, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.582', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.022', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.280', 'weapon3': '1.714', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:53,166][52664] DAMAGECOUNT value on done: 8221.0 [2024-08-05 22:26:53,166][52664] Sum rewards: 8.833, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.958', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.137', 'ARMOR': '0.444', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.466', 'weapon3': '2.098', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '8.000'} [2024-08-05 22:26:53,318][52666] DAMAGECOUNT value on done: 6801.0 [2024-08-05 22:26:53,318][52666] Sum rewards: 13.858, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.543', 'AMMO5': '0.003', 'weapon5': '0.030', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'ARMOR': '0.092', 'AMMO3': '0.124', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.388', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.004', 'weapon3': '1.788', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '11.000'} [2024-08-05 22:26:53,534][52667] DAMAGECOUNT value on done: 8198.0 [2024-08-05 22:26:53,534][52667] Sum rewards: 7.978, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.826', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon4': '0.074', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.418', 'ARMOR': '0.475', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.298', 'weapon3': '1.692', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:53,925][52658] DAMAGECOUNT value on done: 6924.0 [2024-08-05 22:26:53,926][52658] Sum rewards: 6.570, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.920', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.330', 'weapon5': '0.364', 'HITCOUNT': '0.420', 'ARMOR': '0.527', 'WEAPON3': '0.750', 'weapon2': '1.296', 'weapon3': '1.650', 'DAMAGECOUNT': '1.794', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:54,408][52659] DAMAGECOUNT value on done: 8517.0 [2024-08-05 22:26:54,410][52659] Sum rewards: 11.977, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.050', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon3': '1.326', 'weapon2': '1.404', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '10.000'} [2024-08-05 22:26:55,624][52670] DAMAGECOUNT value on done: 6469.0 [2024-08-05 22:26:55,624][52670] Sum rewards: 4.775, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.915', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.430', 'weapon4': '0.444', 'ARMOR': '0.572', 'WEAPON3': '0.750', 'weapon2': '1.160', 'DAMAGECOUNT': '1.500', 'weapon3': '1.582', 'FRAGCOUNT': '5.000'} [2024-08-05 22:26:55,981][52664] DAMAGECOUNT value on done: 7612.0 [2024-08-05 22:26:55,981][52664] Sum rewards: 7.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'ARMOR': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.242', 'weapon2': '0.610', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon3': '2.476', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:56,052][52671] DAMAGECOUNT value on done: 7774.0 [2024-08-05 22:26:56,052][52671] Sum rewards: 8.476, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO3': '0.099', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon3': '1.482', 'weapon2': '1.562', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:56,370][52649] DAMAGECOUNT value on done: 6477.0 [2024-08-05 22:26:56,370][52649] Sum rewards: 5.441, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.804', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.022', 'AMMO4': '0.082', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.254', 'ARMOR': '0.467', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'weapon2': '1.206', 'weapon3': '1.906', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:56,676][52650] Updated weights for policy 0, policy_version 7681 (0.0012) [2024-08-05 22:26:56,687][52666] DAMAGECOUNT value on done: 6341.0 [2024-08-05 22:26:56,689][52666] Sum rewards: 4.521, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.166', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'ARMOR': '0.892', 'weapon3': '0.932', 'weapon2': '1.212', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:56,768][52667] DAMAGECOUNT value on done: 7407.0 [2024-08-05 22:26:56,768][52667] Sum rewards: 3.351, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.341', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.066', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.506', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon2': '0.878', 'weapon3': '1.260', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:57,077][52658] DAMAGECOUNT value on done: 6599.0 [2024-08-05 22:26:57,081][52658] Sum rewards: 2.914, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.330', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO3': '0.108', 'ARMOR': '0.460', 'HITCOUNT': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.268', 'weapon3': '1.432', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '4.000'} [2024-08-05 22:26:57,512][52659] DAMAGECOUNT value on done: 7597.0 [2024-08-05 22:26:57,514][52659] Sum rewards: 9.354, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.716', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'WEAPON3': '1.050', 'HITCOUNT': '1.050', 'weapon3': '1.710', 'ARMOR': '1.811', 'weapon2': '2.054', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '10.000'} [2024-08-05 22:26:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 62939136. Throughput: 0: 4215.8. Samples: 15743120. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 22:26:57,795][52567] Avg episode reward: [(0, '6.839')] [2024-08-05 22:26:58,849][52671] DAMAGECOUNT value on done: 7385.0 [2024-08-05 22:26:58,849][52671] Sum rewards: 6.446, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.142', 'AMMO2': '0.012', 'AMMO5': '0.020', 'weapon4': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.264', 'WEAPON5': '0.300', 'ARMOR': '0.519', 'HITCOUNT': '0.690', 'WEAPON3': '0.800', 'weapon2': '1.268', 'weapon3': '2.074', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '5.500'} [2024-08-05 22:26:59,044][52664] DAMAGECOUNT value on done: 7784.0 [2024-08-05 22:26:59,044][52664] Sum rewards: 4.846, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'weapon5': '0.080', 'HEALTH': '0.288', 'WEAPON3': '0.400', 'HITCOUNT': '0.470', 'weapon3': '1.188', 'DAMAGECOUNT': '1.485', 'weapon2': '1.510', 'FRAGCOUNT': '3.000'} [2024-08-05 22:26:59,143][52670] DAMAGECOUNT value on done: 7743.0 [2024-08-05 22:26:59,144][52670] Sum rewards: 5.375, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.318', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.128', 'ARMOR': '0.475', 'HITCOUNT': '0.620', 'WEAPON3': '0.850', 'weapon2': '1.196', 'weapon3': '2.084', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '7.000'} [2024-08-05 22:26:59,608][52649] DAMAGECOUNT value on done: 8214.0 [2024-08-05 22:26:59,608][52649] Sum rewards: 8.460, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.543', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.266', 'WEAPON3': '0.400', 'HITCOUNT': '0.560', 'ARMOR': '0.949', 'weapon3': '1.116', 'weapon2': '1.166', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '6.000'} [2024-08-05 22:26:59,839][52667] DAMAGECOUNT value on done: 7898.0 [2024-08-05 22:26:59,847][52667] Sum rewards: 7.655, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.036', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.115', 'WEAPON4': '0.300', 'weapon4': '0.456', 'HITCOUNT': '0.610', 'WEAPON3': '0.750', 'weapon2': '0.944', 'ARMOR': '1.039', 'weapon3': '1.514', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:00,152][52666] DAMAGECOUNT value on done: 6326.0 [2024-08-05 22:27:00,153][52666] Sum rewards: 3.187, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.092', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.222', 'HITCOUNT': '0.430', 'WEAPON3': '0.750', 'ARMOR': '0.945', 'DAMAGECOUNT': '1.320', 'weapon2': '1.352', 'weapon3': '1.738', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:00,186][52658] DAMAGECOUNT value on done: 7665.0 [2024-08-05 22:27:00,187][52658] Sum rewards: 6.023, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.030', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.368', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.398', 'weapon3': '1.940', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:00,559][52659] DAMAGECOUNT value on done: 7920.0 [2024-08-05 22:27:00,562][52659] Sum rewards: 5.180, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.458', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon4': '0.290', 'HITCOUNT': '0.480', 'WEAPON3': '0.550', 'weapon3': '1.302', 'ARMOR': '1.319', 'weapon2': '1.536', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:01,428][52650] Updated weights for policy 0, policy_version 7691 (0.0021) [2024-08-05 22:27:01,925][52671] DAMAGECOUNT value on done: 8250.0 [2024-08-05 22:27:01,925][52671] Sum rewards: 10.395, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.019', 'AMMO3': '0.070', 'ARMOR': '0.076', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.522', 'HEALTH': '0.531', 'HITCOUNT': '0.740', 'weapon2': '1.328', 'weapon3': '1.392', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:02,207][52664] DAMAGECOUNT value on done: 6467.0 [2024-08-05 22:27:02,208][52664] Sum rewards: 7.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.692', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.020', 'WEAPON1': '0.040', 'weapon4': '0.052', 'weapon5': '0.058', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'HITCOUNT': '0.430', 'ARMOR': '0.514', 'WEAPON3': '0.600', 'weapon2': '1.426', 'DAMAGECOUNT': '1.500', 'weapon3': '1.796', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:02,435][52670] DAMAGECOUNT value on done: 8084.0 [2024-08-05 22:27:02,436][52670] Sum rewards: 4.231, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.123', 'weapon4': '0.196', 'WEAPON4': '0.300', 'ARMOR': '0.498', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.422', 'weapon3': '1.562', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:02,748][52649] DAMAGECOUNT value on done: 6424.0 [2024-08-05 22:27:02,750][52649] Sum rewards: 5.238, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.011', 'HEALTH': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.182', 'weapon4': '0.380', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'weapon2': '1.096', 'weapon3': '1.352', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '3.000'} [2024-08-05 22:27:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 63021056. Throughput: 0: 4216.8. Samples: 15755810. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 22:27:02,794][52567] Avg episode reward: [(0, '6.662')] [2024-08-05 22:27:03,206][52658] DAMAGECOUNT value on done: 7679.0 [2024-08-05 22:27:03,207][52658] Sum rewards: 5.329, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.781', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.072', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'ARMOR': '0.871', 'weapon2': '1.256', 'weapon3': '1.436', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:03,227][52659] DAMAGECOUNT value on done: 6594.0 [2024-08-05 22:27:03,228][52659] Sum rewards: 8.948, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.674', 'AMMO5': '0.010', 'weapon6': '0.016', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.032', 'AMMO4': '0.080', 'AMMO3': '0.097', 'AMMO6': '0.198', 'AMMO7': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON6': '0.200', 'weapon4': '0.518', 'weapon2': '0.576', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'ARMOR': '0.904', 'DAMAGECOUNT': '2.010', 'weapon3': '2.036', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:03,380][52666] DAMAGECOUNT value on done: 6312.0 [2024-08-05 22:27:03,381][52666] Sum rewards: 4.394, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.178', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'weapon5': '0.104', 'HITCOUNT': '0.440', 'ARMOR': '0.466', 'WEAPON3': '0.550', 'weapon2': '1.044', 'weapon3': '1.228', 'DAMAGECOUNT': '1.338', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:04,321][52671] DAMAGECOUNT value on done: 6751.0 [2024-08-05 22:27:04,331][52671] Sum rewards: 5.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.822', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon5': '0.152', 'weapon4': '0.196', 'WEAPON5': '0.200', 'ARMOR': '0.464', 'HITCOUNT': '0.630', 'weapon2': '0.892', 'WEAPON3': '0.900', 'weapon3': '2.060', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '6.500'} [2024-08-05 22:27:05,281][52664] DAMAGECOUNT value on done: 6868.0 [2024-08-05 22:27:05,285][52664] Sum rewards: 7.664, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.558', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.090', 'ARMOR': '0.117', 'WEAPON4': '0.250', 'weapon4': '0.540', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '0.982', 'weapon3': '1.524', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:05,548][52659] DAMAGECOUNT value on done: 6517.0 [2024-08-05 22:27:05,548][52659] Sum rewards: 8.843, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.755', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'ARMOR': '0.446', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.184', 'weapon3': '1.304', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:05,681][52670] DAMAGECOUNT value on done: 7186.0 [2024-08-05 22:27:05,683][52670] Sum rewards: 2.025, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.532', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.056', 'weapon5': '0.140', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'ARMOR': '0.600', 'HITCOUNT': '0.720', 'WEAPON3': '1.050', 'weapon2': '1.058', 'weapon3': '2.248', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:06,267][52649] DAMAGECOUNT value on done: 7572.0 [2024-08-05 22:27:06,267][52649] Sum rewards: 10.840, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.255', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'HITCOUNT': '0.960', 'WEAPON3': '1.050', 'weapon2': '1.266', 'ARMOR': '1.272', 'weapon3': '2.446', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '11.000'} [2024-08-05 22:27:06,408][52658] DAMAGECOUNT value on done: 8841.0 [2024-08-05 22:27:06,409][52658] Sum rewards: 12.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.304', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.186', 'ARMOR': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.266', 'HITCOUNT': '1.320', 'weapon3': '2.500', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '14.000'} [2024-08-05 22:27:06,517][52650] Updated weights for policy 0, policy_version 7701 (0.0012) [2024-08-05 22:27:06,618][52666] DAMAGECOUNT value on done: 6756.0 [2024-08-05 22:27:06,618][52666] Sum rewards: 3.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.494', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.012', 'weapon5': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.252', 'HITCOUNT': '0.620', 'WEAPON3': '0.800', 'ARMOR': '0.840', 'weapon3': '1.420', 'weapon2': '1.628', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:06,621][52671] DAMAGECOUNT value on done: 8143.0 [2024-08-05 22:27:06,621][52671] Sum rewards: 1.530, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.573', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'ARMOR': '0.088', 'WEAPON4': '0.200', 'weapon4': '0.274', 'HITCOUNT': '0.310', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.101', 'weapon2': '1.186', 'weapon3': '1.490', 'FRAGCOUNT': '2.000'} [2024-08-05 22:27:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 63111168. Throughput: 0: 4221.8. Samples: 15781320. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 22:27:07,794][52567] Avg episode reward: [(0, '6.740')] [2024-08-05 22:27:08,006][52659] DAMAGECOUNT value on done: 8137.0 [2024-08-05 22:27:08,007][52659] Sum rewards: 8.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.312', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.157', 'HITCOUNT': '0.780', 'WEAPON3': '1.000', 'ARMOR': '1.371', 'weapon2': '1.550', 'weapon3': '2.030', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:08,184][52664] DAMAGECOUNT value on done: 6763.0 [2024-08-05 22:27:08,185][52664] Sum rewards: 2.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.378', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon5': '0.024', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'HITCOUNT': '0.770', 'WEAPON3': '1.150', 'weapon2': '1.214', 'ARMOR': '1.380', 'weapon3': '2.220', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:08,979][52670] DAMAGECOUNT value on done: 8137.0 [2024-08-05 22:27:08,979][52670] Sum rewards: 10.983, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.734', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO5': '0.013', 'weapon5': '0.028', 'ARMOR': '0.056', 'AMMO4': '0.057', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.476', 'WEAPON3': '0.700', 'weapon2': '0.750', 'HITCOUNT': '0.840', 'weapon3': '2.030', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:09,134][52671] DAMAGECOUNT value on done: 7315.0 [2024-08-05 22:27:09,134][52671] Sum rewards: 5.456, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.032', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.206', 'HITCOUNT': '0.880', 'WEAPON3': '0.950', 'ARMOR': '1.423', 'weapon2': '1.596', 'weapon3': '1.776', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:09,575][52658] DAMAGECOUNT value on done: 8149.0 [2024-08-05 22:27:09,577][52658] Sum rewards: 3.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.074', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'WEAPON4': '0.050', 'weapon4': '0.092', 'AMMO3': '0.148', 'HITCOUNT': '0.750', 'WEAPON3': '1.000', 'ARMOR': '1.304', 'weapon2': '1.316', 'weapon3': '1.928', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:09,602][52649] DAMAGECOUNT value on done: 7998.0 [2024-08-05 22:27:09,607][52649] Sum rewards: 12.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.148', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.184', 'ARMOR': '0.800', 'HITCOUNT': '0.950', 'WEAPON3': '1.000', 'weapon2': '1.598', 'weapon3': '2.146', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '15.000'} [2024-08-05 22:27:09,812][52666] DAMAGECOUNT value on done: 6951.0 [2024-08-05 22:27:09,814][52666] Sum rewards: 5.664, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.518', 'AMMO2': '0.019', 'AMMO3': '0.086', 'AMMO4': '0.094', 'weapon4': '0.248', 'WEAPON4': '0.250', 'ARMOR': '0.476', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '0.870', 'weapon3': '1.450', 'DAMAGECOUNT': '1.809', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:10,765][52659] DAMAGECOUNT value on done: 6206.0 [2024-08-05 22:27:10,766][52659] Sum rewards: 3.802, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.674', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.076', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.480', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.044', 'DAMAGECOUNT': '1.635', 'weapon3': '1.690', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:11,023][52664] DAMAGECOUNT value on done: 6518.0 [2024-08-05 22:27:11,024][52664] Sum rewards: 9.921, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.681', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.034', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.458', 'ARMOR': '0.540', 'weapon2': '0.704', 'HITCOUNT': '0.780', 'WEAPON3': '1.000', 'weapon3': '2.158', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '11.000'} [2024-08-05 22:27:11,562][52650] Updated weights for policy 0, policy_version 7711 (0.0016) [2024-08-05 22:27:11,888][52671] DAMAGECOUNT value on done: 6811.0 [2024-08-05 22:27:11,889][52671] Sum rewards: 3.658, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.032', 'HEALTH': '0.058', 'AMMO3': '0.059', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.310', 'WEAPON3': '0.400', 'weapon3': '0.930', 'DAMAGECOUNT': '0.942', 'weapon2': '1.110', 'FRAGCOUNT': '3.000'} [2024-08-05 22:27:12,198][52670] DAMAGECOUNT value on done: 7185.0 [2024-08-05 22:27:12,201][52670] Sum rewards: 10.419, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.952', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.068', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.310', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.332', 'ARMOR': '1.355', 'weapon3': '2.054', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 63193088. Throughput: 0: 4210.9. Samples: 15806290. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:27:12,794][52567] Avg episode reward: [(0, '6.663')] [2024-08-05 22:27:12,810][52649] DAMAGECOUNT value on done: 6805.0 [2024-08-05 22:27:12,814][52649] Sum rewards: 7.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.225', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.166', 'HITCOUNT': '1.040', 'WEAPON3': '1.050', 'weapon2': '1.236', 'ARMOR': '1.430', 'weapon3': '2.394', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:12,949][52658] DAMAGECOUNT value on done: 7615.0 [2024-08-05 22:27:12,950][52658] Sum rewards: 6.836, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.948', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.128', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'ARMOR': '0.440', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.270', 'weapon3': '2.360', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '6.500'} [2024-08-05 22:27:13,160][52666] DAMAGECOUNT value on done: 6821.0 [2024-08-05 22:27:13,161][52666] Sum rewards: 6.094, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.550', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO3': '0.123', 'ARMOR': '0.455', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.602', 'weapon3': '2.068', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:13,234][52659] DAMAGECOUNT value on done: 7080.0 [2024-08-05 22:27:13,242][52659] Sum rewards: 11.141, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.125', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.042', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.410', 'ARMOR': '0.534', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.182', 'weapon3': '1.382', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:13,862][52664] DAMAGECOUNT value on done: 7703.0 [2024-08-05 22:27:13,862][52664] Sum rewards: 10.503, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.642', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.052', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.428', 'HITCOUNT': '0.670', 'weapon2': '0.794', 'WEAPON3': '0.800', 'weapon3': '1.490', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '11.000'} [2024-08-05 22:27:14,281][52671] DAMAGECOUNT value on done: 8817.0 [2024-08-05 22:27:14,282][52671] Sum rewards: 1.431, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.957', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'weapon4': '0.078', 'weapon5': '0.088', 'HITCOUNT': '0.390', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.221', 'weapon3': '1.272', 'weapon2': '1.390', 'FRAGCOUNT': '2.000'} [2024-08-05 22:27:15,354][52670] DAMAGECOUNT value on done: 6262.0 [2024-08-05 22:27:15,355][52670] Sum rewards: 4.764, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon3': '1.530', 'weapon2': '1.580', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:15,731][52649] DAMAGECOUNT value on done: 8201.0 [2024-08-05 22:27:15,733][52649] Sum rewards: 6.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.080', 'AMMO2': '0.019', 'ARMOR': '0.056', 'AMMO3': '0.088', 'AMMO4': '0.096', 'WEAPON4': '0.300', 'weapon4': '0.478', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.992', 'weapon3': '1.618', 'DAMAGECOUNT': '2.259', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:15,942][52659] DAMAGECOUNT value on done: 8346.0 [2024-08-05 22:27:15,942][52659] Sum rewards: 10.260, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'AMMO4': '0.107', 'weapon4': '0.186', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'HEALTH': '0.656', 'ARMOR': '0.840', 'weapon3': '1.276', 'weapon2': '1.774', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:16,154][52650] Updated weights for policy 0, policy_version 7721 (0.0022) [2024-08-05 22:27:16,156][52658] DAMAGECOUNT value on done: 7318.0 [2024-08-05 22:27:16,159][52658] Sum rewards: 13.509, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.828', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.045', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.466', 'ARMOR': '0.496', 'HITCOUNT': '0.810', 'weapon2': '0.916', 'weapon3': '1.374', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '11.000'} [2024-08-05 22:27:16,327][52666] DAMAGECOUNT value on done: 6014.0 [2024-08-05 22:27:16,328][52666] Sum rewards: 8.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.244', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'ARMOR': '0.936', 'weapon3': '1.604', 'weapon2': '1.680', 'DAMAGECOUNT': '2.379', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:16,773][52664] DAMAGECOUNT value on done: 6294.0 [2024-08-05 22:27:16,776][52664] Sum rewards: 2.213, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.070', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HITCOUNT': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.984', 'DAMAGECOUNT': '1.389', 'weapon2': '1.556', 'weapon3': '2.106', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:17,347][52671] DAMAGECOUNT value on done: 8586.0 [2024-08-05 22:27:17,349][52671] Sum rewards: 8.585, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.171', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'ARMOR': '0.454', 'HITCOUNT': '0.940', 'WEAPON3': '0.950', 'weapon2': '1.540', 'weapon3': '2.040', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:17,365][52668] DAMAGECOUNT value on done: 6903.0 [2024-08-05 22:27:17,366][52668] Sum rewards: 2.992, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.011', 'HEALTH': '0.038', 'AMMO3': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'HITCOUNT': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.316', 'DAMAGECOUNT': '0.528', 'weapon2': '0.662', 'weapon3': '0.842', 'ARMOR': '0.895', 'FRAGCOUNT': '2.000'} [2024-08-05 22:27:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16931.7, 300 sec: 16828.3). Total num frames: 63275008. Throughput: 0: 4220.7. Samples: 15819130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:27:17,794][52567] Avg episode reward: [(0, '6.628')] [2024-08-05 22:27:18,568][52670] DAMAGECOUNT value on done: 6659.0 [2024-08-05 22:27:18,569][52670] Sum rewards: 6.149, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.125', 'weapon4': '0.330', 'HEALTH': '0.438', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.828', 'weapon2': '1.148', 'weapon3': '1.852', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:18,732][52649] DAMAGECOUNT value on done: 6851.0 [2024-08-05 22:27:18,733][52649] Sum rewards: 5.095, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.666', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.106', 'ARMOR': '0.140', 'WEAPON4': '0.300', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.806', 'weapon2': '0.824', 'weapon3': '1.392', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:18,804][52659] DAMAGECOUNT value on done: 8519.0 [2024-08-05 22:27:18,806][52659] Sum rewards: 9.965, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.274', 'AMMO2': '0.017', 'weapon7': '0.058', 'weapon4': '0.060', 'AMMO4': '0.086', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.372', 'weapon3': '1.880', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:19,357][52658] DAMAGECOUNT value on done: 8088.0 [2024-08-05 22:27:19,358][52658] Sum rewards: 3.097, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.740', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'ARMOR': '0.032', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.188', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.150', 'weapon3': '1.446', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.130'} [2024-08-05 22:27:19,798][52666] DAMAGECOUNT value on done: 6785.0 [2024-08-05 22:27:19,799][52666] Sum rewards: 5.909, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'HEALTH': '0.268', 'weapon5': '0.278', 'WEAPON3': '0.400', 'HITCOUNT': '0.480', 'ARMOR': '0.923', 'weapon3': '1.188', 'weapon2': '1.268', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '3.000'} [2024-08-05 22:27:19,895][52664] DAMAGECOUNT value on done: 7135.0 [2024-08-05 22:27:19,898][52664] Sum rewards: 8.594, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.730', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.096', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '0.908', 'weapon3': '1.432', 'weapon2': '1.592', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:19,913][52668] DAMAGECOUNT value on done: 8949.0 [2024-08-05 22:27:19,915][52668] Sum rewards: 11.445, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.458', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.035', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.300', 'weapon5': '0.366', 'weapon4': '0.442', 'weapon2': '0.970', 'HITCOUNT': '0.980', 'WEAPON3': '1.050', 'ARMOR': '1.382', 'weapon3': '1.770', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '10.000'} [2024-08-05 22:27:20,244][52671] DAMAGECOUNT value on done: 6827.0 [2024-08-05 22:27:20,245][52671] Sum rewards: 5.366, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.401', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.284', 'ARMOR': '0.437', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '1.190', 'weapon3': '1.594', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:20,724][52650] Updated weights for policy 0, policy_version 7731 (0.0023) [2024-08-05 22:27:21,578][52649] DAMAGECOUNT value on done: 8147.0 [2024-08-05 22:27:21,578][52649] Sum rewards: 6.685, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.390', 'ARMOR': '0.507', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.282', 'weapon3': '1.962', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:21,808][52659] DAMAGECOUNT value on done: 7287.0 [2024-08-05 22:27:21,811][52659] Sum rewards: 4.284, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.024', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'HEALTH': '0.250', 'weapon4': '0.254', 'HITCOUNT': '0.350', 'WEAPON3': '0.400', 'weapon3': '1.068', 'weapon2': '1.126', 'DAMAGECOUNT': '1.233', 'FRAGCOUNT': '3.000'} [2024-08-05 22:27:21,963][52670] DAMAGECOUNT value on done: 8210.0 [2024-08-05 22:27:21,963][52670] Sum rewards: 7.437, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.994', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.112', 'weapon4': '0.170', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.296', 'weapon3': '2.164', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 63365120. Throughput: 0: 4213.8. Samples: 15844230. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-05 22:27:22,794][52567] Avg episode reward: [(0, '6.780')] [2024-08-05 22:27:23,080][52666] DAMAGECOUNT value on done: 8533.0 [2024-08-05 22:27:23,081][52666] Sum rewards: 10.197, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.280', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'ARMOR': '1.379', 'weapon2': '1.426', 'weapon3': '1.624', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:23,090][52664] DAMAGECOUNT value on done: 7001.0 [2024-08-05 22:27:23,090][52664] Sum rewards: 6.782, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.730', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'ARMOR': '0.024', 'weapon5': '0.062', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon4': '0.356', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon2': '1.100', 'weapon3': '1.700', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:23,092][52671] DAMAGECOUNT value on done: 7488.0 [2024-08-05 22:27:23,095][52671] Sum rewards: 7.314, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.735', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.076', 'WEAPON4': '0.300', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon4': '0.714', 'weapon2': '0.880', 'ARMOR': '1.057', 'weapon3': '1.378', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:23,294][52660] DAMAGECOUNT value on done: 8005.0 [2024-08-05 22:27:23,297][52660] Sum rewards: 9.893, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.032', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'weapon4': '0.118', 'ARMOR': '0.532', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.342', 'weapon3': '1.796', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:23,324][52668] DAMAGECOUNT value on done: 6150.0 [2024-08-05 22:27:23,328][52668] Sum rewards: 5.927, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.368', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.099', 'WEAPON4': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '1.018', 'ARMOR': '1.456', 'weapon3': '1.814', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:24,362][52659] DAMAGECOUNT value on done: 7689.0 [2024-08-05 22:27:24,364][52659] Sum rewards: 9.193, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.941', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.012', 'weapon5': '0.078', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'ARMOR': '0.857', 'weapon2': '1.358', 'weapon3': '1.506', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:25,317][52671] DAMAGECOUNT value on done: 7083.0 [2024-08-05 22:27:25,318][52671] Sum rewards: 7.964, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.406', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.066', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '0.857', 'weapon2': '1.418', 'weapon3': '1.478', 'DAMAGECOUNT': '2.448', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:25,363][52670] DAMAGECOUNT value on done: 7293.0 [2024-08-05 22:27:25,366][52670] Sum rewards: 2.859, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.118', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'AMMO3': '0.104', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon3': '1.510', 'weapon2': '1.556', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '3.000'} [2024-08-05 22:27:25,803][52650] Updated weights for policy 0, policy_version 7741 (0.0016) [2024-08-05 22:27:26,282][52664] DAMAGECOUNT value on done: 6593.0 [2024-08-05 22:27:26,285][52664] Sum rewards: 6.183, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.020', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'weapon5': '0.074', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.244', 'HITCOUNT': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.564', 'weapon3': '1.490', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:26,470][52666] DAMAGECOUNT value on done: 7459.0 [2024-08-05 22:27:26,470][52666] Sum rewards: 5.474, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.088', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.084', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.338', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.310', 'weapon3': '1.570', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:26,504][52668] DAMAGECOUNT value on done: 6093.0 [2024-08-05 22:27:26,504][52668] Sum rewards: 2.515, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.460', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO3': '0.041', 'HITCOUNT': '0.180', 'WEAPON3': '0.300', 'ARMOR': '0.477', 'DAMAGECOUNT': '0.615', 'weapon2': '0.962', 'weapon3': '0.970', 'FRAGCOUNT': '1.000'} [2024-08-05 22:27:26,533][52660] DAMAGECOUNT value on done: 8787.0 [2024-08-05 22:27:26,534][52660] Sum rewards: 2.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.190', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'HITCOUNT': '0.710', 'ARMOR': '0.987', 'WEAPON3': '1.050', 'weapon2': '1.614', 'weapon3': '2.158', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:26,881][52659] DAMAGECOUNT value on done: 8829.0 [2024-08-05 22:27:26,883][52659] Sum rewards: 5.699, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.175', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.067', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.230', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon3': '1.252', 'weapon2': '1.266', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 63447040. Throughput: 0: 4219.1. Samples: 15869670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:27:27,794][52567] Avg episode reward: [(0, '6.734')] [2024-08-05 22:27:28,095][52671] DAMAGECOUNT value on done: 6844.0 [2024-08-05 22:27:28,098][52671] Sum rewards: 3.106, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.654', 'AMMO2': '0.005', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'AMMO3': '0.083', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.350', 'weapon4': '0.484', 'WEAPON3': '0.550', 'ARMOR': '0.557', 'DAMAGECOUNT': '1.113', 'weapon2': '1.172', 'weapon3': '1.442', 'FRAGCOUNT': '3.000'} [2024-08-05 22:27:28,834][52670] DAMAGECOUNT value on done: 7446.0 [2024-08-05 22:27:28,837][52670] Sum rewards: 5.246, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.114', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.424', 'HITCOUNT': '0.750', 'ARMOR': '0.876', 'WEAPON3': '0.900', 'weapon2': '1.178', 'weapon3': '1.984', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:29,538][52664] DAMAGECOUNT value on done: 8030.0 [2024-08-05 22:27:29,540][52664] Sum rewards: 8.699, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'weapon4': '0.166', 'ARMOR': '0.481', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '1.486', 'weapon3': '1.592', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:29,781][52659] DAMAGECOUNT value on done: 8141.0 [2024-08-05 22:27:29,784][52659] Sum rewards: 5.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.436', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.306', 'ARMOR': '0.543', 'HITCOUNT': '0.810', 'weapon2': '0.878', 'WEAPON3': '0.900', 'weapon3': '1.976', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:30,501][52668] DAMAGECOUNT value on done: 7585.0 [2024-08-05 22:27:30,501][52668] Sum rewards: 12.124, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO3': '0.074', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HEALTH': '0.130', 'weapon4': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon2': '1.258', 'weapon3': '1.582', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '10.000'} [2024-08-05 22:27:30,600][52660] DAMAGECOUNT value on done: 6988.0 [2024-08-05 22:27:30,602][52660] Sum rewards: 8.397, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.484', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.133', 'weapon4': '0.212', 'ARMOR': '0.436', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon2': '0.982', 'weapon3': '1.848', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:30,613][52650] Updated weights for policy 0, policy_version 7751 (0.0026) [2024-08-05 22:27:31,003][52671] DAMAGECOUNT value on done: 8297.0 [2024-08-05 22:27:31,005][52671] Sum rewards: 4.914, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.480', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.030', 'ARMOR': '0.072', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.234', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon2': '0.956', 'weapon3': '1.392', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 63537152. Throughput: 0: 4222.9. Samples: 15882540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 22:27:32,794][52567] Avg episode reward: [(0, '6.902')] [2024-08-05 22:27:33,107][52659] DAMAGECOUNT value on done: 8335.0 [2024-08-05 22:27:33,109][52659] Sum rewards: 9.043, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'HITCOUNT': '0.900', 'WEAPON3': '1.100', 'ARMOR': '1.361', 'weapon2': '1.364', 'weapon3': '2.348', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:33,491][52668] DAMAGECOUNT value on done: 7455.0 [2024-08-05 22:27:33,492][52668] Sum rewards: 12.343, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.047', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.032', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.680', 'weapon3': '1.686', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '10.000'} [2024-08-05 22:27:33,565][52660] DAMAGECOUNT value on done: 7386.0 [2024-08-05 22:27:33,567][52660] Sum rewards: 5.304, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.835', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO3': '0.058', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon3': '0.878', 'weapon2': '1.114', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:34,350][52671] DAMAGECOUNT value on done: 7197.0 [2024-08-05 22:27:34,350][52671] Sum rewards: 5.142, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.107', 'WEAPON4': '0.250', 'weapon4': '0.356', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.134', 'ARMOR': '1.283', 'weapon3': '1.318', 'DAMAGECOUNT': '2.019', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:35,249][52650] Updated weights for policy 0, policy_version 7761 (0.0027) [2024-08-05 22:27:35,775][52659] DAMAGECOUNT value on done: 6835.0 [2024-08-05 22:27:35,776][52659] Sum rewards: 7.806, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.086', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.098', 'ARMOR': '0.116', 'WEAPON4': '0.250', 'weapon2': '0.536', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon4': '0.776', 'weapon3': '1.552', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:36,420][52668] DAMAGECOUNT value on done: 9033.0 [2024-08-05 22:27:36,420][52668] Sum rewards: 10.119, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.144', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.148', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'ARMOR': '0.858', 'weapon3': '1.464', 'weapon2': '1.738', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:36,466][52660] DAMAGECOUNT value on done: 6591.0 [2024-08-05 22:27:36,466][52660] Sum rewards: 8.974, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.593', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.062', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.232', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon2': '1.156', 'weapon3': '1.338', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:37,181][52671] DAMAGECOUNT value on done: 7475.0 [2024-08-05 22:27:37,183][52671] Sum rewards: 5.867, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.702', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.109', 'WEAPON4': '0.250', 'weapon5': '0.278', 'ARMOR': '0.495', 'weapon4': '0.500', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'weapon2': '0.786', 'weapon3': '1.590', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16800.7). Total num frames: 63610880. Throughput: 0: 4226.2. Samples: 15908050. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 22:27:37,794][52567] Avg episode reward: [(0, '6.880')] [2024-08-05 22:27:38,460][52659] DAMAGECOUNT value on done: 7420.0 [2024-08-05 22:27:38,462][52659] Sum rewards: 6.473, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.782', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.214', 'HITCOUNT': '0.620', 'weapon2': '0.792', 'WEAPON3': '0.800', 'ARMOR': '0.958', 'weapon3': '1.536', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:39,375][52668] DAMAGECOUNT value on done: 6363.0 [2024-08-05 22:27:39,376][52668] Sum rewards: 5.875, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.270', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.210', 'ARMOR': '0.484', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.138', 'weapon3': '1.266', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:39,402][52660] DAMAGECOUNT value on done: 8739.0 [2024-08-05 22:27:39,404][52660] Sum rewards: 8.196, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.366', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'ARMOR': '0.132', 'AMMO3': '0.135', 'weapon4': '0.460', 'weapon2': '0.798', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'weapon3': '2.068', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:39,440][52803] DAMAGECOUNT value on done: 7764.0 [2024-08-05 22:27:39,442][52803] Sum rewards: 4.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.221', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'weapon4': '0.062', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'HITCOUNT': '0.410', 'WEAPON3': '0.850', 'ARMOR': '1.328', 'weapon2': '1.438', 'DAMAGECOUNT': '1.716', 'weapon3': '2.134', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:39,965][52650] Updated weights for policy 0, policy_version 7771 (0.0026) [2024-08-05 22:27:41,202][52659] DAMAGECOUNT value on done: 5586.0 [2024-08-05 22:27:41,203][52659] Sum rewards: 2.438, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.216', 'AMMO2': '0.017', 'ARMOR': '0.020', 'AMMO3': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.250', 'HITCOUNT': '0.330', 'WEAPON3': '0.350', 'weapon4': '0.400', 'weapon3': '0.928', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.107', 'weapon2': '1.120'} [2024-08-05 22:27:42,110][52668] DAMAGECOUNT value on done: 7922.0 [2024-08-05 22:27:42,112][52668] Sum rewards: 3.662, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.750', 'AMMO2': '0.002', 'AMMO4': '0.008', 'ARMOR': '0.072', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.438', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'weapon2': '1.176', 'weapon3': '1.536', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:42,137][52660] DAMAGECOUNT value on done: 7263.0 [2024-08-05 22:27:42,137][52660] Sum rewards: 4.675, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.708', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '1.202', 'ARMOR': '1.332', 'weapon3': '2.090', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:42,796][52567] Fps is (10 sec: 17200.0, 60 sec: 17066.1, 300 sec: 16856.0). Total num frames: 63709184. Throughput: 0: 4241.0. Samples: 15933970. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:27:42,796][52567] Avg episode reward: [(0, '6.623')] [2024-08-05 22:27:42,806][52803] DAMAGECOUNT value on done: 8457.0 [2024-08-05 22:27:42,807][52803] Sum rewards: 6.304, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.003', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.224', 'weapon5': '0.330', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'ARMOR': '0.867', 'weapon2': '1.036', 'weapon3': '1.198', 'DAMAGECOUNT': '1.998', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:43,883][52659] DAMAGECOUNT value on done: 7173.0 [2024-08-05 22:27:43,884][52659] Sum rewards: 4.764, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.710', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.016', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.322', 'HITCOUNT': '0.520', 'WEAPON3': '0.700', 'ARMOR': '0.966', 'weapon2': '1.270', 'weapon3': '1.558', 'DAMAGECOUNT': '1.707', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:45,175][52650] Updated weights for policy 0, policy_version 7781 (0.0012) [2024-08-05 22:27:45,200][52668] DAMAGECOUNT value on done: 8879.0 [2024-08-05 22:27:45,204][52668] Sum rewards: 7.328, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.119', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.073', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '0.921', 'weapon3': '1.122', 'weapon2': '1.238', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:45,254][52660] DAMAGECOUNT value on done: 7634.0 [2024-08-05 22:27:45,256][52660] Sum rewards: 5.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.987', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.121', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.616', 'weapon3': '1.728', 'ARMOR': '2.222', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:46,000][52803] DAMAGECOUNT value on done: 7321.0 [2024-08-05 22:27:46,002][52803] Sum rewards: 11.458, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.444', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.013', 'WEAPON1': '0.030', 'AMMO3': '0.086', 'weapon5': '0.116', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '1.400', 'weapon3': '1.600', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 63782912. Throughput: 0: 4250.0. Samples: 15947060. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 22:27:47,795][52567] Avg episode reward: [(0, '6.731')] [2024-08-05 22:27:47,852][52668] DAMAGECOUNT value on done: 6794.0 [2024-08-05 22:27:47,854][52668] Sum rewards: 6.298, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.081', 'AMMO4': '0.087', 'HEALTH': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon4': '0.426', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '1.240', 'DAMAGECOUNT': '1.557', 'weapon3': '1.684', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:47,876][52660] DAMAGECOUNT value on done: 7659.0 [2024-08-05 22:27:47,876][52660] Sum rewards: 6.902, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.659', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.236', 'weapon4': '0.252', 'HITCOUNT': '0.510', 'ARMOR': '0.521', 'WEAPON3': '0.650', 'weapon2': '1.338', 'weapon3': '1.788', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:49,300][52803] DAMAGECOUNT value on done: 7435.0 [2024-08-05 22:27:49,301][52803] Sum rewards: 2.344, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.437', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'weapon4': '0.214', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.520', 'weapon3': '0.990', 'DAMAGECOUNT': '1.275', 'weapon2': '1.312', 'FRAGCOUNT': '2.000'} [2024-08-05 22:27:49,607][52650] Updated weights for policy 0, policy_version 7791 (0.0023) [2024-08-05 22:27:50,314][52811] DAMAGECOUNT value on done: 7699.0 [2024-08-05 22:27:50,314][52811] Sum rewards: 6.090, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.084', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HEALTH': '0.266', 'weapon4': '0.436', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '1.056', 'weapon3': '1.808', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:50,770][52668] DAMAGECOUNT value on done: 7524.0 [2024-08-05 22:27:50,772][52668] Sum rewards: 4.374, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.230', 'AMMO2': '0.004', 'weapon4': '0.006', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'ARMOR': '0.517', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.588', 'weapon3': '1.722', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:50,787][52660] DAMAGECOUNT value on done: 7356.0 [2024-08-05 22:27:50,788][52660] Sum rewards: 7.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.305', 'AMMO4': '-0.068', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'ARMOR': '0.893', 'WEAPON3': '1.100', 'HITCOUNT': '1.140', 'weapon2': '1.370', 'weapon3': '2.294', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '11.000'} [2024-08-05 22:27:52,499][52803] DAMAGECOUNT value on done: 8551.0 [2024-08-05 22:27:52,499][52803] Sum rewards: 2.261, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.322', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.262', 'HITCOUNT': '0.520', 'WEAPON3': '0.650', 'ARMOR': '0.888', 'weapon3': '1.540', 'DAMAGECOUNT': '1.671', 'weapon2': '1.766', 'FRAGCOUNT': '2.000'} [2024-08-05 22:27:52,794][52567] Fps is (10 sec: 17206.3, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 63881216. Throughput: 0: 4250.0. Samples: 15972570. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-05 22:27:52,794][52567] Avg episode reward: [(0, '6.633')] [2024-08-05 22:27:53,559][52794] DAMAGECOUNT value on done: 8656.0 [2024-08-05 22:27:53,559][52794] Sum rewards: 8.108, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.330', 'ARMOR': '0.476', 'HITCOUNT': '0.740', 'weapon2': '0.892', 'WEAPON3': '0.950', 'weapon3': '2.442', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '9.000'} [2024-08-05 22:27:53,632][52811] DAMAGECOUNT value on done: 7935.0 [2024-08-05 22:27:53,632][52811] Sum rewards: 10.752, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.672', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'weapon7': '0.030', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.322', 'weapon4': '0.346', 'WEAPON3': '0.550', 'HITCOUNT': '0.930', 'weapon2': '1.224', 'weapon3': '1.484', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '7.000'} [2024-08-05 22:27:54,293][52668] DAMAGECOUNT value on done: 6950.0 [2024-08-05 22:27:54,293][52668] Sum rewards: 3.167, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.076', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'ARMOR': '0.489', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'weapon2': '1.254', 'DAMAGECOUNT': '1.788', 'weapon3': '1.858', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:54,300][52660] DAMAGECOUNT value on done: 7696.0 [2024-08-05 22:27:54,300][52660] Sum rewards: 9.964, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.377', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.055', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.570', 'weapon3': '1.048', 'weapon2': '1.126', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:54,718][52650] Updated weights for policy 0, policy_version 7801 (0.0011) [2024-08-05 22:27:55,946][52803] DAMAGECOUNT value on done: 7048.0 [2024-08-05 22:27:55,948][52803] Sum rewards: 6.770, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.165', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.030', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'ARMOR': '0.467', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.168', 'weapon3': '1.810', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:56,023][52794] DAMAGECOUNT value on done: 8877.0 [2024-08-05 22:27:56,023][52794] Sum rewards: 3.581, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.605', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.256', 'HITCOUNT': '0.410', 'weapon5': '0.592', 'WEAPON3': '0.600', 'ARMOR': '0.976', 'weapon2': '1.010', 'DAMAGECOUNT': '1.299', 'weapon3': '1.656', 'FRAGCOUNT': '3.000'} [2024-08-05 22:27:56,978][52811] DAMAGECOUNT value on done: 7080.0 [2024-08-05 22:27:56,979][52811] Sum rewards: 3.902, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO3': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '1.242', 'ARMOR': '1.330', 'weapon3': '1.592', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:57,380][52668] DAMAGECOUNT value on done: 8097.0 [2024-08-05 22:27:57,381][52668] Sum rewards: 8.862, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.187', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'ARMOR': '0.920', 'weapon2': '1.214', 'weapon3': '1.980', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '8.000'} [2024-08-05 22:27:57,406][52660] DAMAGECOUNT value on done: 6791.0 [2024-08-05 22:27:57,406][52660] Sum rewards: 5.330, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.082', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon4': '0.196', 'HITCOUNT': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.922', 'ARMOR': '0.951', 'weapon3': '1.742', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '6.000'} [2024-08-05 22:27:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 63954944. Throughput: 0: 4265.1. Samples: 15998220. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-05 22:27:57,802][52567] Avg episode reward: [(0, '6.661')] [2024-08-05 22:27:58,525][52794] DAMAGECOUNT value on done: 9091.0 [2024-08-05 22:27:58,526][52794] Sum rewards: 1.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.164', 'weapon4': '0.236', 'WEAPON4': '0.250', 'ARMOR': '0.552', 'HITCOUNT': '0.670', 'weapon2': '0.822', 'WEAPON3': '1.000', 'DAMAGECOUNT': '2.214', 'weapon3': '2.500', 'FRAGCOUNT': '4.000'} [2024-08-05 22:27:58,733][52662] DAMAGECOUNT value on done: 8281.0 [2024-08-05 22:27:58,736][52662] Sum rewards: 4.495, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.273', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.250', 'ARMOR': '0.568', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.194', 'weapon3': '1.554', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '5.000'} [2024-08-05 22:27:59,176][52650] Updated weights for policy 0, policy_version 7811 (0.0017) [2024-08-05 22:27:59,284][52803] DAMAGECOUNT value on done: 8855.0 [2024-08-05 22:27:59,285][52803] Sum rewards: 12.832, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.452', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.175', 'WEAPON4': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.220', 'ARMOR': '1.408', 'weapon3': '1.864', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '11.000'} [2024-08-05 22:28:00,248][52811] DAMAGECOUNT value on done: 7607.0 [2024-08-05 22:28:00,249][52811] Sum rewards: 5.178, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.432', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.084', 'weapon4': '0.240', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon2': '1.394', 'weapon3': '1.734', 'ARMOR': '1.785', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.346'} [2024-08-05 22:28:00,369][52668] DAMAGECOUNT value on done: 7029.0 [2024-08-05 22:28:00,370][52668] Sum rewards: 6.399, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.268', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.089', 'ARMOR': '0.091', 'weapon5': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.458', 'weapon2': '0.532', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon3': '1.766', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:00,377][52660] DAMAGECOUNT value on done: 7517.0 [2024-08-05 22:28:00,378][52660] Sum rewards: 13.679, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.468', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.108', 'ARMOR': '0.503', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.382', 'weapon3': '2.148', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '11.000'} [2024-08-05 22:28:00,761][52794] DAMAGECOUNT value on done: 8477.0 [2024-08-05 22:28:00,762][52794] Sum rewards: 4.767, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.155', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.084', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '0.744', 'weapon3': '0.956', 'DAMAGECOUNT': '1.587', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:01,044][52662] DAMAGECOUNT value on done: 8966.0 [2024-08-05 22:28:01,045][52662] Sum rewards: 9.275, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.248', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.060', 'AMMO4': '0.121', 'ARMOR': '0.163', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon2': '0.850', 'weapon4': '1.000', 'weapon3': '1.484', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:02,723][52803] DAMAGECOUNT value on done: 6570.0 [2024-08-05 22:28:02,723][52803] Sum rewards: 2.287, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.462', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.011', 'weapon5': '0.042', 'ARMOR': '0.048', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.254', 'HITCOUNT': '0.280', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.789', 'weapon2': '0.822', 'weapon3': '1.156', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:02,769][52660] DAMAGECOUNT value on done: 7648.0 [2024-08-05 22:28:02,769][52660] Sum rewards: 6.442, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO3': '0.096', 'ARMOR': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.392', 'HITCOUNT': '0.540', 'weapon2': '0.666', 'WEAPON3': '0.700', 'weapon3': '2.046', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:02,782][52668] DAMAGECOUNT value on done: 7157.0 [2024-08-05 22:28:02,782][52668] Sum rewards: 4.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.605', 'AMMO2': '0.018', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.124', 'ARMOR': '0.469', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon3': '1.454', 'weapon2': '1.540', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 64045056. Throughput: 0: 4264.2. Samples: 16011020. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 22:28:02,794][52567] Avg episode reward: [(0, '6.647')] [2024-08-05 22:28:03,215][52794] DAMAGECOUNT value on done: 8644.0 [2024-08-05 22:28:03,215][52794] Sum rewards: 0.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.839', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.072', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.236', 'HITCOUNT': '0.430', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.185', 'weapon2': '1.240', 'weapon3': '1.854', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:03,425][52811] DAMAGECOUNT value on done: 8169.0 [2024-08-05 22:28:03,428][52811] Sum rewards: 4.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.133', 'ARMOR': '0.428', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.324', 'weapon3': '2.342', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:03,471][52662] DAMAGECOUNT value on done: 9437.0 [2024-08-05 22:28:03,471][52662] Sum rewards: 9.277, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.326', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.316', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'ARMOR': '1.282', 'weapon2': '1.654', 'weapon3': '1.780', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:04,084][52650] Updated weights for policy 0, policy_version 7821 (0.0023) [2024-08-05 22:28:05,248][52795] DAMAGECOUNT value on done: 6107.0 [2024-08-05 22:28:05,248][52795] Sum rewards: 5.278, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.012', 'HEALTH': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.192', 'WEAPON3': '0.350', 'ARMOR': '0.432', 'HITCOUNT': '0.600', 'weapon3': '1.180', 'weapon2': '1.568', 'DAMAGECOUNT': '1.686', 'FRAGCOUNT': '2.000'} [2024-08-05 22:28:05,764][52794] DAMAGECOUNT value on done: 8981.0 [2024-08-05 22:28:05,764][52794] Sum rewards: 3.887, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.208', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.358', 'HITCOUNT': '0.410', 'ARMOR': '0.474', 'WEAPON3': '0.600', 'weapon2': '0.830', 'DAMAGECOUNT': '1.338', 'weapon3': '1.460', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:05,829][52803] DAMAGECOUNT value on done: 6596.0 [2024-08-05 22:28:05,831][52803] Sum rewards: 6.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.032', 'weapon5': '0.044', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.234', 'ARMOR': '0.524', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'weapon2': '1.298', 'weapon3': '1.380', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:05,944][52660] DAMAGECOUNT value on done: 7576.0 [2024-08-05 22:28:05,945][52660] Sum rewards: 9.795, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.179', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon5': '0.022', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'ARMOR': '0.913', 'weapon2': '1.286', 'weapon3': '1.566', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:06,014][52668] DAMAGECOUNT value on done: 7903.0 [2024-08-05 22:28:06,015][52668] Sum rewards: 6.056, reward structure: {'DEATHCOUNT': '-3.750', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.026', 'HEALTH': '0.044', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon2': '1.144', 'weapon3': '1.382', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:06,048][52662] DAMAGECOUNT value on done: 7066.0 [2024-08-05 22:28:06,048][52662] Sum rewards: 1.906, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.013', 'HEALTH': '0.018', 'AMMO2': '0.031', 'weapon5': '0.072', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.250', 'ARMOR': '0.418', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.198', 'DAMAGECOUNT': '1.746', 'weapon3': '1.782', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:06,687][52811] DAMAGECOUNT value on done: 7281.0 [2024-08-05 22:28:06,690][52811] Sum rewards: 10.221, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.715', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.034', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.630', 'HITCOUNT': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.034', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '10.000'} [2024-08-05 22:28:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17066.6, 300 sec: 16856.1). Total num frames: 64135168. Throughput: 0: 4276.0. Samples: 16036650. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:28:07,794][52567] Avg episode reward: [(0, '6.516')] [2024-08-05 22:28:08,397][52794] DAMAGECOUNT value on done: 8386.0 [2024-08-05 22:28:08,398][52794] Sum rewards: 9.375, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.600', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.400', 'ARMOR': '0.565', 'HITCOUNT': '0.690', 'weapon2': '0.722', 'WEAPON3': '0.750', 'weapon4': '0.776', 'weapon3': '1.746', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:08,553][52795] DAMAGECOUNT value on done: 7092.0 [2024-08-05 22:28:08,556][52795] Sum rewards: 3.643, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.303', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.021', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.104', 'weapon4': '0.310', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'weapon2': '0.912', 'DAMAGECOUNT': '1.440', 'weapon3': '1.466', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:08,620][52662] DAMAGECOUNT value on done: 8969.0 [2024-08-05 22:28:08,620][52662] Sum rewards: 6.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.396', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.558', 'weapon2': '0.786', 'HITCOUNT': '0.890', 'WEAPON3': '1.050', 'ARMOR': '1.361', 'weapon3': '2.336', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:08,939][52650] Updated weights for policy 0, policy_version 7831 (0.0017) [2024-08-05 22:28:08,988][52803] DAMAGECOUNT value on done: 6901.0 [2024-08-05 22:28:08,990][52803] Sum rewards: 4.914, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.014', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'weapon7': '0.068', 'AMMO3': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.400', 'ARMOR': '0.435', 'WEAPON3': '0.600', 'weapon2': '1.352', 'DAMAGECOUNT': '1.365', 'weapon3': '1.478', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:09,038][52660] DAMAGECOUNT value on done: 8178.0 [2024-08-05 22:28:09,039][52660] Sum rewards: 9.474, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.586', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.112', 'WEAPON3': '0.800', 'ARMOR': '0.992', 'HITCOUNT': '1.100', 'weapon2': '1.358', 'weapon3': '2.054', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:09,200][52668] DAMAGECOUNT value on done: 8492.0 [2024-08-05 22:28:09,201][52668] Sum rewards: 6.394, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.176', 'AMMO4': '-0.087', 'AMMO2': '-0.017', 'AMMO3': '0.085', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'ARMOR': '0.931', 'weapon2': '1.438', 'weapon3': '1.672', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:09,768][52811] DAMAGECOUNT value on done: 7753.0 [2024-08-05 22:28:09,770][52811] Sum rewards: 10.057, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.030', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.096', 'weapon4': '0.168', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.126', 'weapon3': '1.634', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:10,884][52794] DAMAGECOUNT value on done: 7224.0 [2024-08-05 22:28:10,885][52794] Sum rewards: 5.496, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.408', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.286', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.865', 'weapon2': '1.456', 'weapon3': '1.810', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:11,135][52662] DAMAGECOUNT value on done: 10115.0 [2024-08-05 22:28:11,138][52662] Sum rewards: 5.240, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.656', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.146', 'weapon4': '0.224', 'ARMOR': '0.428', 'HITCOUNT': '0.720', 'WEAPON3': '0.950', 'weapon2': '1.374', 'weapon3': '1.784', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:11,828][52795] DAMAGECOUNT value on done: 7064.0 [2024-08-05 22:28:11,831][52795] Sum rewards: 3.989, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.730', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'ARMOR': '0.008', 'AMMO3': '0.075', 'WEAPON4': '0.200', 'weapon4': '0.434', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.260', 'weapon3': '1.366', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:11,841][52614] Signal inference workers to stop experience collection... (1450 times) [2024-08-05 22:28:11,856][52614] Signal inference workers to resume experience collection... (1450 times) [2024-08-05 22:28:11,925][52650] InferenceWorker_p0-w0: stopping experience collection (1450 times) [2024-08-05 22:28:11,926][52650] InferenceWorker_p0-w0: resuming experience collection (1450 times) [2024-08-05 22:28:12,230][52803] DAMAGECOUNT value on done: 6587.0 [2024-08-05 22:28:12,231][52803] Sum rewards: 10.435, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.071', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'weapon5': '0.354', 'WEAPON3': '0.400', 'weapon4': '0.428', 'ARMOR': '0.460', 'HITCOUNT': '0.560', 'weapon2': '1.238', 'weapon3': '1.466', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '7.000'} [2024-08-05 22:28:12,261][52660] DAMAGECOUNT value on done: 7846.0 [2024-08-05 22:28:12,262][52660] Sum rewards: 14.012, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.445', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'ARMOR': '0.456', 'weapon5': '0.540', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '1.428', 'weapon3': '1.590', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '11.000'} [2024-08-05 22:28:12,459][52668] DAMAGECOUNT value on done: 7168.0 [2024-08-05 22:28:12,461][52668] Sum rewards: 7.671, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.346', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'ARMOR': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.184', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon2': '0.906', 'weapon3': '1.108', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 64217088. Throughput: 0: 4274.9. Samples: 16062040. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:28:12,794][52567] Avg episode reward: [(0, '6.560')] [2024-08-05 22:28:13,030][52811] DAMAGECOUNT value on done: 5385.0 [2024-08-05 22:28:13,031][52811] Sum rewards: 2.304, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.110', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.012', 'weapon4': '0.036', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'weapon2': '0.990', 'weapon3': '1.128', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '2.000'} [2024-08-05 22:28:13,386][52794] DAMAGECOUNT value on done: 9961.0 [2024-08-05 22:28:13,386][52794] Sum rewards: 5.351, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.242', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.354', 'ARMOR': '1.666', 'weapon3': '1.846', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:13,622][52662] DAMAGECOUNT value on done: 9069.0 [2024-08-05 22:28:13,624][52662] Sum rewards: 3.644, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.968', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.034', 'AMMO3': '0.097', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.470', 'ARMOR': '0.504', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '0.808', 'DAMAGECOUNT': '1.950', 'weapon3': '2.014', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:13,829][52650] Updated weights for policy 0, policy_version 7841 (0.0027) [2024-08-05 22:28:15,192][52795] DAMAGECOUNT value on done: 8657.0 [2024-08-05 22:28:15,193][52795] Sum rewards: 6.651, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.947', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.076', 'AMMO4': '0.142', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.500', 'HITCOUNT': '0.620', 'weapon2': '0.816', 'ARMOR': '0.933', 'WEAPON3': '1.000', 'weapon3': '2.016', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:15,511][52803] DAMAGECOUNT value on done: 7300.0 [2024-08-05 22:28:15,515][52803] Sum rewards: 4.582, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.259', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'ARMOR': '0.522', 'weapon4': '0.596', 'HITCOUNT': '0.690', 'WEAPON3': '0.750', 'weapon2': '1.080', 'weapon3': '1.874', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:15,549][52660] DAMAGECOUNT value on done: 6868.0 [2024-08-05 22:28:15,553][52660] Sum rewards: 1.425, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.488', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.230', 'HITCOUNT': '0.270', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'DAMAGECOUNT': '0.900', 'FRAGCOUNT': '1.000', 'weapon3': '1.080', 'weapon2': '1.272'} [2024-08-05 22:28:15,723][52668] DAMAGECOUNT value on done: 7205.0 [2024-08-05 22:28:15,724][52668] Sum rewards: 7.210, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.867', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.058', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'ARMOR': '0.478', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.524', 'weapon2': '1.740', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:15,756][52794] DAMAGECOUNT value on done: 8577.0 [2024-08-05 22:28:15,756][52794] Sum rewards: 7.174, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO3': '0.072', 'AMMO4': '0.073', 'HEALTH': '0.120', 'weapon5': '0.170', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.400', 'weapon3': '1.640', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:16,028][52662] DAMAGECOUNT value on done: 9393.0 [2024-08-05 22:28:16,030][52662] Sum rewards: 5.857, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.219', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'ARMOR': '0.523', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.142', 'DAMAGECOUNT': '1.779', 'weapon3': '2.022', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:16,397][52811] DAMAGECOUNT value on done: 7385.0 [2024-08-05 22:28:16,397][52811] Sum rewards: 12.752, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.933', 'HITCOUNT': '0.990', 'weapon2': '1.192', 'weapon3': '1.886', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17066.6, 300 sec: 16856.1). Total num frames: 64299008. Throughput: 0: 4272.2. Samples: 16074790. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:28:17,803][52567] Avg episode reward: [(0, '6.451')] [2024-08-05 22:28:18,141][52794] DAMAGECOUNT value on done: 8723.0 [2024-08-05 22:28:18,142][52794] Sum rewards: 12.995, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.090', 'AMMO4': '0.120', 'HEALTH': '0.199', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.806', 'weapon4': '0.808', 'HITCOUNT': '0.860', 'ARMOR': '0.932', 'weapon3': '1.412', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:18,305][52650] Updated weights for policy 0, policy_version 7851 (0.0025) [2024-08-05 22:28:18,461][52662] DAMAGECOUNT value on done: 8867.0 [2024-08-05 22:28:18,461][52662] Sum rewards: 7.504, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.246', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.040', 'WEAPON3': '0.300', 'HITCOUNT': '0.480', 'ARMOR': '0.848', 'weapon3': '0.868', 'weapon2': '1.114', 'DAMAGECOUNT': '1.380', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:18,520][52795] DAMAGECOUNT value on done: 8089.0 [2024-08-05 22:28:18,521][52795] Sum rewards: 7.290, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.409', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.210', 'WEAPON3': '0.550', 'weapon5': '0.582', 'HITCOUNT': '0.680', 'weapon2': '0.776', 'weapon3': '1.166', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:18,807][52803] DAMAGECOUNT value on done: 7173.0 [2024-08-05 22:28:18,807][52803] Sum rewards: 2.763, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.794', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.080', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.250', 'weapon4': '0.298', 'HITCOUNT': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.782', 'DAMAGECOUNT': '1.395', 'weapon3': '1.630', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:19,310][52660] DAMAGECOUNT value on done: 8006.0 [2024-08-05 22:28:19,311][52660] Sum rewards: 12.996, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.721', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.161', 'ARMOR': '0.484', 'WEAPON3': '0.850', 'HITCOUNT': '1.290', 'weapon2': '1.748', 'weapon3': '1.812', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '12.000'} [2024-08-05 22:28:19,746][52811] DAMAGECOUNT value on done: 7136.0 [2024-08-05 22:28:19,749][52811] Sum rewards: 4.938, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.270', 'AMMO4': '-0.109', 'AMMO2': '-0.022', 'AMMO3': '0.067', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon3': '1.104', 'ARMOR': '1.396', 'weapon2': '1.890', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:20,281][52794] DAMAGECOUNT value on done: 9167.0 [2024-08-05 22:28:20,282][52794] Sum rewards: 8.074, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.916', 'AMMO2': '0.020', 'weapon7': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.544', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'ARMOR': '0.964', 'weapon2': '0.980', 'weapon3': '1.622', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '7.000'} [2024-08-05 22:28:20,609][52662] DAMAGECOUNT value on done: 9134.0 [2024-08-05 22:28:20,610][52662] Sum rewards: 7.192, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.075', 'weapon7': '0.010', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.067', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.919', 'weapon2': '1.202', 'weapon3': '1.216', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:21,699][52795] DAMAGECOUNT value on done: 8781.0 [2024-08-05 22:28:21,700][52795] Sum rewards: 6.940, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.246', 'AMMO2': '0.018', 'weapon4': '0.022', 'weapon7': '0.050', 'AMMO4': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.780', 'ARMOR': '0.820', 'WEAPON3': '0.900', 'weapon2': '1.338', 'weapon3': '1.898', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:21,972][52660] DAMAGECOUNT value on done: 8301.0 [2024-08-05 22:28:21,972][52660] Sum rewards: 2.404, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.321', 'AMMO2': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO4': '0.028', 'ARMOR': '0.072', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.522', 'WEAPON3': '0.550', 'weapon2': '0.692', 'DAMAGECOUNT': '0.780', 'weapon3': '1.580', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:22,207][52803] DAMAGECOUNT value on done: 7615.0 [2024-08-05 22:28:22,208][52803] Sum rewards: 5.700, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.965', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.060', 'ARMOR': '0.068', 'WEAPON4': '0.200', 'weapon4': '0.398', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '1.250', 'weapon3': '1.318', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:22,741][52794] DAMAGECOUNT value on done: 8448.0 [2024-08-05 22:28:22,742][52794] Sum rewards: 2.622, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.610', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.104', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'HITCOUNT': '0.460', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.470', 'weapon2': '1.610', 'weapon3': '1.628', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:22,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17066.6, 300 sec: 16883.8). Total num frames: 64389120. Throughput: 0: 4267.7. Samples: 16100100. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:28:22,802][52567] Avg episode reward: [(0, '6.502')] [2024-08-05 22:28:22,996][52811] DAMAGECOUNT value on done: 7628.0 [2024-08-05 22:28:22,999][52811] Sum rewards: 8.324, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'weapon5': '0.012', 'HEALTH': '0.056', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'DAMAGECOUNT': '1.350', 'weapon3': '1.536', 'weapon2': '1.724', 'ARMOR': '1.755', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:23,033][52662] DAMAGECOUNT value on done: 8420.0 [2024-08-05 22:28:23,033][52662] Sum rewards: 9.125, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.851', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.154', 'WEAPON3': '0.450', 'ARMOR': '0.481', 'HITCOUNT': '0.760', 'weapon2': '1.294', 'weapon3': '1.478', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:23,364][52650] Updated weights for policy 0, policy_version 7861 (0.0013) [2024-08-05 22:28:25,001][52795] DAMAGECOUNT value on done: 7694.0 [2024-08-05 22:28:25,003][52795] Sum rewards: 8.461, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.972', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.137', 'HITCOUNT': '0.750', 'WEAPON3': '0.900', 'ARMOR': '1.228', 'weapon2': '1.274', 'weapon3': '2.224', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:25,023][52794] DAMAGECOUNT value on done: 10277.0 [2024-08-05 22:28:25,023][52794] Sum rewards: 1.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.404', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'weapon4': '0.442', 'ARMOR': '0.543', 'WEAPON3': '0.900', 'weapon2': '1.084', 'DAMAGECOUNT': '1.515', 'weapon3': '2.036', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:25,279][52662] DAMAGECOUNT value on done: 8053.0 [2024-08-05 22:28:25,279][52662] Sum rewards: 15.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.087', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.094', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.470', 'WEAPON3': '0.750', 'ARMOR': '0.860', 'weapon2': '0.914', 'HITCOUNT': '0.950', 'weapon3': '2.262', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '13.000'} [2024-08-05 22:28:25,500][52803] DAMAGECOUNT value on done: 7448.0 [2024-08-05 22:28:25,502][52803] Sum rewards: 9.515, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.391', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.080', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'ARMOR': '0.965', 'weapon3': '1.496', 'weapon2': '1.550', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:26,086][52811] DAMAGECOUNT value on done: 7239.0 [2024-08-05 22:28:26,088][52811] Sum rewards: 0.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.886', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon4': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'ARMOR': '0.530', 'HITCOUNT': '0.690', 'WEAPON3': '1.150', 'weapon2': '1.236', 'DAMAGECOUNT': '1.929', 'weapon3': '2.428', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 64471040. Throughput: 0: 4261.7. Samples: 16125740. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 22:28:27,802][52567] Avg episode reward: [(0, '6.551')] [2024-08-05 22:28:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007870_64471040.pth... [2024-08-05 22:28:27,930][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007378_60440576.pth [2024-08-05 22:28:27,961][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:28:28,292][52650] Updated weights for policy 0, policy_version 7871 (0.0031) [2024-08-05 22:28:28,387][52795] DAMAGECOUNT value on done: 7694.0 [2024-08-05 22:28:28,387][52795] Sum rewards: 5.525, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.132', 'HEALTH': '0.138', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'ARMOR': '0.832', 'weapon3': '1.734', 'weapon2': '1.934', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:28,392][52794] DAMAGECOUNT value on done: 8966.0 [2024-08-05 22:28:28,392][52794] Sum rewards: 6.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.591', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO3': '0.083', 'weapon7': '0.086', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.176', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'ARMOR': '0.909', 'weapon2': '1.016', 'weapon3': '1.712', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:28,713][52662] DAMAGECOUNT value on done: 9364.0 [2024-08-05 22:28:28,713][52662] Sum rewards: 7.365, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.050', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'AMMO3': '0.127', 'HITCOUNT': '0.690', 'WEAPON3': '0.850', 'ARMOR': '0.908', 'weapon2': '1.368', 'weapon3': '1.716', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:28,748][52803] DAMAGECOUNT value on done: 6211.0 [2024-08-05 22:28:28,750][52803] Sum rewards: 6.361, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'HEALTH': '0.375', 'WEAPON3': '0.400', 'weapon5': '0.408', 'HITCOUNT': '0.490', 'weapon4': '0.498', 'weapon2': '0.746', 'ARMOR': '0.928', 'weapon3': '1.272', 'DAMAGECOUNT': '1.656', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:29,400][52811] DAMAGECOUNT value on done: 6834.0 [2024-08-05 22:28:29,403][52811] Sum rewards: 3.702, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.072', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'HITCOUNT': '0.260', 'WEAPON3': '0.450', 'ARMOR': '0.567', 'weapon4': '0.646', 'weapon2': '0.782', 'DAMAGECOUNT': '0.996', 'weapon3': '1.480', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:30,647][52794] DAMAGECOUNT value on done: 9611.0 [2024-08-05 22:28:30,648][52794] Sum rewards: 5.200, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.482', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.108', 'AMMO4': '0.133', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '0.960', 'weapon3': '2.184', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:30,919][52662] DAMAGECOUNT value on done: 9533.0 [2024-08-05 22:28:30,920][52662] Sum rewards: 9.984, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.140', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'weapon5': '0.088', 'ARMOR': '0.447', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'weapon3': '1.336', 'weapon2': '1.432', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '7.000'} [2024-08-05 22:28:31,785][52795] DAMAGECOUNT value on done: 7624.0 [2024-08-05 22:28:31,785][52795] Sum rewards: 3.313, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.456', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.262', 'WEAPON3': '0.300', 'HITCOUNT': '0.400', 'ARMOR': '0.528', 'weapon3': '0.882', 'weapon2': '1.100', 'DAMAGECOUNT': '1.176', 'FRAGCOUNT': '2.000'} [2024-08-05 22:28:31,965][52803] DAMAGECOUNT value on done: 7100.0 [2024-08-05 22:28:31,967][52803] Sum rewards: 2.997, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.862', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'weapon4': '0.148', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'ARMOR': '1.350', 'weapon2': '1.544', 'weapon3': '1.624', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:32,428][52650] Updated weights for policy 0, policy_version 7881 (0.0011) [2024-08-05 22:28:32,571][52811] DAMAGECOUNT value on done: 7119.0 [2024-08-05 22:28:32,573][52811] Sum rewards: 6.134, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.412', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.228', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'weapon3': '1.336', 'DAMAGECOUNT': '1.458', 'weapon2': '1.736', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.6, 300 sec: 16883.8). Total num frames: 64561152. Throughput: 0: 4252.2. Samples: 16138410. Policy #0 lag: (min: 1.0, avg: 4.9, max: 9.0) [2024-08-05 22:28:32,795][52567] Avg episode reward: [(0, '6.359')] [2024-08-05 22:28:32,968][52669] DAMAGECOUNT value on done: 7558.0 [2024-08-05 22:28:32,969][52669] Sum rewards: 10.555, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.577', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.166', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'ARMOR': '0.932', 'weapon3': '1.574', 'weapon2': '1.606', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:33,556][52794] DAMAGECOUNT value on done: 9999.0 [2024-08-05 22:28:33,556][52794] Sum rewards: 7.183, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.539', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.072', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon4': '0.714', 'ARMOR': '0.899', 'weapon2': '1.088', 'weapon3': '1.654', 'DAMAGECOUNT': '2.076', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:33,906][52662] DAMAGECOUNT value on done: 8499.0 [2024-08-05 22:28:33,910][52662] Sum rewards: 4.452, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.030', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'weapon4': '0.182', 'HITCOUNT': '0.490', 'WEAPON3': '0.650', 'ARMOR': '0.879', 'weapon2': '1.060', 'DAMAGECOUNT': '1.695', 'weapon3': '1.854', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:35,003][52795] DAMAGECOUNT value on done: 8206.0 [2024-08-05 22:28:35,003][52795] Sum rewards: 6.173, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.018', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon5': '0.208', 'HITCOUNT': '0.920', 'WEAPON3': '1.000', 'weapon2': '1.292', 'weapon3': '2.092', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '7.000'} [2024-08-05 22:28:35,306][52803] DAMAGECOUNT value on done: 7028.0 [2024-08-05 22:28:35,307][52803] Sum rewards: 11.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.408', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.103', 'weapon4': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.488', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.406', 'weapon3': '1.922', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '10.000'} [2024-08-05 22:28:35,799][52811] DAMAGECOUNT value on done: 8338.0 [2024-08-05 22:28:35,801][52811] Sum rewards: 7.339, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.550', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO4': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon4': '0.452', 'ARMOR': '0.460', 'HITCOUNT': '0.660', 'weapon2': '0.936', 'WEAPON3': '0.950', 'weapon3': '1.598', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:35,894][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:28:36,114][52794] DAMAGECOUNT value on done: 8657.0 [2024-08-05 22:28:36,115][52794] Sum rewards: 8.190, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.972', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.004', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.146', 'weapon4': '0.282', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'ARMOR': '0.821', 'weapon2': '1.030', 'weapon3': '1.090', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '6.500'} [2024-08-05 22:28:36,295][52669] DAMAGECOUNT value on done: 7995.0 [2024-08-05 22:28:36,296][52669] Sum rewards: 5.326, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.521', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.146', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '0.460', 'weapon2': '1.200', 'weapon3': '1.284', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:36,438][52662] DAMAGECOUNT value on done: 9337.0 [2024-08-05 22:28:36,438][52662] Sum rewards: 7.187, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.004', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'AMMO3': '0.075', 'weapon4': '0.256', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.380', 'weapon3': '1.556', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:37,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17066.5, 300 sec: 16856.1). Total num frames: 64634880. Throughput: 0: 4246.0. Samples: 16163640. Policy #0 lag: (min: 1.0, avg: 4.9, max: 9.0) [2024-08-05 22:28:37,795][52567] Avg episode reward: [(0, '6.562')] [2024-08-05 22:28:37,911][52650] Updated weights for policy 0, policy_version 7891 (0.0025) [2024-08-05 22:28:38,259][52795] DAMAGECOUNT value on done: 7237.0 [2024-08-05 22:28:38,260][52795] Sum rewards: 16.770, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.285', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.013', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.863', 'HITCOUNT': '1.100', 'weapon2': '1.496', 'weapon3': '2.084', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '15.000'} [2024-08-05 22:28:38,711][52794] DAMAGECOUNT value on done: 9527.0 [2024-08-05 22:28:38,711][52794] Sum rewards: 10.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.976', 'AMMO2': '0.008', 'AMMO4': '0.039', 'ARMOR': '0.060', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'WEAPON3': '1.050', 'HITCOUNT': '1.110', 'weapon2': '1.342', 'weapon3': '2.376', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '12.000'} [2024-08-05 22:28:38,726][52803] DAMAGECOUNT value on done: 7593.0 [2024-08-05 22:28:38,726][52803] Sum rewards: 5.555, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.371', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.022', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.246', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon2': '1.442', 'weapon3': '1.672', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:39,048][52662] DAMAGECOUNT value on done: 8705.0 [2024-08-05 22:28:39,049][52662] Sum rewards: 12.722, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.812', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '1.080', 'ARMOR': '1.430', 'weapon2': '1.812', 'weapon3': '1.844', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '10.000'} [2024-08-05 22:28:39,140][52811] DAMAGECOUNT value on done: 6404.0 [2024-08-05 22:28:39,140][52811] Sum rewards: 12.012, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.203', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.360', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'ARMOR': '0.884', 'weapon3': '1.192', 'weapon2': '1.400', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '8.000'} [2024-08-05 22:28:39,245][52669] DAMAGECOUNT value on done: 8428.0 [2024-08-05 22:28:39,245][52669] Sum rewards: 5.295, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'ARMOR': '0.112', 'AMMO4': '0.164', 'WEAPON4': '0.350', 'HITCOUNT': '0.590', 'weapon4': '0.614', 'WEAPON3': '0.700', 'weapon2': '0.932', 'weapon3': '1.886', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:41,262][52794] DAMAGECOUNT value on done: 9467.0 [2024-08-05 22:28:41,263][52794] Sum rewards: 15.827, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.766', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.114', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'ARMOR': '1.251', 'weapon2': '1.640', 'weapon3': '1.946', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '12.000'} [2024-08-05 22:28:41,489][52795] DAMAGECOUNT value on done: 7103.0 [2024-08-05 22:28:41,490][52795] Sum rewards: 9.740, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.803', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.280', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '0.950', 'weapon2': '1.128', 'weapon3': '1.804', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '10.000'} [2024-08-05 22:28:41,770][52662] DAMAGECOUNT value on done: 9668.0 [2024-08-05 22:28:41,771][52662] Sum rewards: 7.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.819', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO3': '0.095', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon2': '1.186', 'ARMOR': '1.300', 'weapon3': '2.070', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:41,773][52669] DAMAGECOUNT value on done: 9588.0 [2024-08-05 22:28:41,774][52669] Sum rewards: 6.758, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.748', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.476', 'ARMOR': '0.488', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.040', 'weapon3': '1.736', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:42,107][52803] DAMAGECOUNT value on done: 8311.0 [2024-08-05 22:28:42,107][52803] Sum rewards: 10.469, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.592', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.127', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon2': '1.232', 'weapon3': '2.268', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:42,280][52811] DAMAGECOUNT value on done: 7195.0 [2024-08-05 22:28:42,280][52811] Sum rewards: 5.227, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.378', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.230', 'ARMOR': '0.464', 'HITCOUNT': '0.680', 'WEAPON3': '0.900', 'weapon2': '1.168', 'weapon3': '1.856', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:42,785][52650] Updated weights for policy 0, policy_version 7901 (0.0030) [2024-08-05 22:28:42,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16930.6, 300 sec: 16856.1). Total num frames: 64724992. Throughput: 0: 4247.1. Samples: 16189340. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-05 22:28:42,795][52567] Avg episode reward: [(0, '7.000')] [2024-08-05 22:28:43,974][52669] DAMAGECOUNT value on done: 7673.0 [2024-08-05 22:28:43,976][52669] Sum rewards: 5.212, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.611', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO3': '0.104', 'ARMOR': '0.460', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'weapon2': '1.664', 'weapon3': '1.760', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:44,734][52795] DAMAGECOUNT value on done: 7844.0 [2024-08-05 22:28:44,734][52795] Sum rewards: 12.490, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.442', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'ARMOR': '0.940', 'HITCOUNT': '1.170', 'weapon2': '1.432', 'weapon3': '2.058', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '11.000'} [2024-08-05 22:28:45,049][52662] DAMAGECOUNT value on done: 8962.0 [2024-08-05 22:28:45,049][52662] Sum rewards: 6.355, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.014', 'AMMO3': '0.060', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'HEALTH': '0.152', 'weapon4': '0.342', 'WEAPON3': '0.350', 'HITCOUNT': '0.470', 'ARMOR': '0.922', 'weapon2': '1.338', 'weapon3': '1.370', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:45,487][52811] DAMAGECOUNT value on done: 5656.0 [2024-08-05 22:28:45,487][52811] Sum rewards: 4.088, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'HEALTH': '0.198', 'weapon4': '0.288', 'HITCOUNT': '0.320', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.158', 'weapon2': '1.340', 'weapon3': '1.564', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:46,855][52669] DAMAGECOUNT value on done: 8355.0 [2024-08-05 22:28:46,855][52669] Sum rewards: 6.134, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.810', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON1': '0.040', 'weapon4': '0.062', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'ARMOR': '1.280', 'weapon3': '1.624', 'weapon2': '1.996', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:47,375][52662] DAMAGECOUNT value on done: 8332.0 [2024-08-05 22:28:47,376][52662] Sum rewards: 1.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO5': '0.013', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.640', 'weapon2': '1.104', 'WEAPON3': '1.200', 'ARMOR': '1.308', 'DAMAGECOUNT': '2.277', 'weapon3': '2.460', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:47,494][52650] Updated weights for policy 0, policy_version 7911 (0.0012) [2024-08-05 22:28:47,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17066.7, 300 sec: 16828.3). Total num frames: 64806912. Throughput: 0: 4240.2. Samples: 16201830. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:28:47,794][52567] Avg episode reward: [(0, '6.976')] [2024-08-05 22:28:48,024][52795] DAMAGECOUNT value on done: 8081.0 [2024-08-05 22:28:48,024][52795] Sum rewards: 10.973, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'weapon4': '0.412', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.100', 'ARMOR': '1.398', 'weapon3': '2.056', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:48,694][52811] DAMAGECOUNT value on done: 7628.0 [2024-08-05 22:28:48,695][52811] Sum rewards: 2.555, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.644', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'ARMOR': '0.544', 'HITCOUNT': '0.740', 'weapon4': '0.744', 'WEAPON3': '0.900', 'weapon2': '0.958', 'weapon3': '2.072', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:49,339][52665] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 22:28:49,662][52669] DAMAGECOUNT value on done: 8817.0 [2024-08-05 22:28:49,662][52669] Sum rewards: 5.564, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.206', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.058', 'ARMOR': '0.064', 'AMMO3': '0.078', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.540', 'weapon4': '0.578', 'WEAPON3': '0.600', 'weapon2': '1.210', 'weapon3': '1.498', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:51,277][52795] DAMAGECOUNT value on done: 7419.0 [2024-08-05 22:28:51,278][52795] Sum rewards: 5.154, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.038', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.230', 'HITCOUNT': '0.870', 'ARMOR': '0.915', 'WEAPON3': '1.100', 'weapon2': '1.206', 'weapon3': '2.358', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:51,987][52811] DAMAGECOUNT value on done: 8031.0 [2024-08-05 22:28:51,990][52811] Sum rewards: 10.743, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.954', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.338', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'ARMOR': '0.882', 'weapon2': '1.156', 'weapon3': '1.224', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:52,206][52669] DAMAGECOUNT value on done: 7807.0 [2024-08-05 22:28:52,208][52669] Sum rewards: 7.439, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.688', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO3': '0.065', 'WEAPON4': '0.200', 'weapon4': '0.380', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'ARMOR': '0.941', 'weapon3': '1.322', 'weapon2': '1.386', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:52,300][52650] Updated weights for policy 0, policy_version 7921 (0.0018) [2024-08-05 22:28:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 64888832. Throughput: 0: 4237.8. Samples: 16227350. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:28:52,794][52567] Avg episode reward: [(0, '6.963')] [2024-08-05 22:28:53,053][52647] DAMAGECOUNT value on done: 8725.0 [2024-08-05 22:28:53,057][52647] Sum rewards: 5.764, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.854', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.087', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.194', 'weapon3': '1.302', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:54,698][52795] DAMAGECOUNT value on done: 7855.0 [2024-08-05 22:28:54,698][52795] Sum rewards: 2.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.876', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.088', 'weapon4': '0.144', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'ARMOR': '0.525', 'HITCOUNT': '0.720', 'weapon2': '0.884', 'WEAPON3': '0.950', 'DAMAGECOUNT': '2.397', 'weapon3': '2.634', 'FRAGCOUNT': '5.000'} [2024-08-05 22:28:54,794][52669] DAMAGECOUNT value on done: 8039.0 [2024-08-05 22:28:54,795][52669] Sum rewards: 13.240, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.284', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.358', 'weapon3': '1.684', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '11.000'} [2024-08-05 22:28:56,041][52647] DAMAGECOUNT value on done: 8298.0 [2024-08-05 22:28:56,042][52647] Sum rewards: 3.132, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.662', 'AMMO2': '0.020', 'ARMOR': '0.076', 'AMMO3': '0.095', 'AMMO4': '0.097', 'WEAPON4': '0.350', 'HITCOUNT': '0.440', 'weapon4': '0.550', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.224', 'weapon2': '1.254', 'weapon3': '1.988', 'FRAGCOUNT': '3.000'} [2024-08-05 22:28:56,075][52663] DAMAGECOUNT value on done: 8881.0 [2024-08-05 22:28:56,076][52663] Sum rewards: 8.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.604', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.184', 'ARMOR': '0.479', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon2': '1.238', 'weapon3': '2.132', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '9.000'} [2024-08-05 22:28:56,934][52665] DAMAGECOUNT value on done: 8127.0 [2024-08-05 22:28:56,936][52665] Sum rewards: 9.918, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.770', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'weapon5': '0.016', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.300', 'ARMOR': '0.516', 'HITCOUNT': '0.650', 'WEAPON3': '0.850', 'weapon2': '0.884', 'weapon3': '2.064', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '10.000'} [2024-08-05 22:28:57,330][52650] Updated weights for policy 0, policy_version 7931 (0.0032) [2024-08-05 22:28:57,383][52669] DAMAGECOUNT value on done: 7495.0 [2024-08-05 22:28:57,384][52669] Sum rewards: 8.232, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.240', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.050', 'ARMOR': '0.132', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon4': '0.680', 'weapon2': '1.144', 'weapon3': '1.228', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 64978944. Throughput: 0: 4246.9. Samples: 16253150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:28:57,794][52567] Avg episode reward: [(0, '7.145')] [2024-08-05 22:28:57,796][52795] DAMAGECOUNT value on done: 7983.0 [2024-08-05 22:28:57,797][52795] Sum rewards: 3.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.650', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.018', 'WEAPON1': '0.030', 'weapon7': '0.050', 'weapon5': '0.070', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.350', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'ARMOR': '0.913', 'weapon2': '1.794', 'weapon3': '1.818', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:58,524][52647] DAMAGECOUNT value on done: 9548.0 [2024-08-05 22:28:58,525][52647] Sum rewards: 4.558, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.238', 'AMMO2': '0.002', 'AMMO4': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.112', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.540', 'weapon3': '1.568', 'ARMOR': '1.786', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '4.000'} [2024-08-05 22:28:58,676][52820] DAMAGECOUNT value on done: 6408.0 [2024-08-05 22:28:58,676][52820] Sum rewards: 7.585, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.647', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon4': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.095', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'ARMOR': '0.971', 'weapon2': '1.316', 'weapon3': '1.942', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2024-08-05 22:28:58,761][52663] DAMAGECOUNT value on done: 7852.0 [2024-08-05 22:28:58,761][52663] Sum rewards: 2.888, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.518', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.048', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.164', 'HITCOUNT': '0.390', 'weapon4': '0.454', 'WEAPON3': '0.650', 'weapon2': '0.888', 'DAMAGECOUNT': '1.470', 'weapon3': '1.998', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:00,288][52665] DAMAGECOUNT value on done: 7351.0 [2024-08-05 22:29:00,296][52665] Sum rewards: 7.949, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.009', 'HEALTH': '0.018', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.080', 'weapon4': '0.264', 'HITCOUNT': '0.410', 'WEAPON3': '0.500', 'weapon3': '1.102', 'ARMOR': '1.216', 'weapon2': '1.488', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:00,461][52669] DAMAGECOUNT value on done: 8311.0 [2024-08-05 22:29:00,464][52669] Sum rewards: 6.038, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.070', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'weapon4': '0.422', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.942', 'weapon3': '2.186', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:01,114][52795] DAMAGECOUNT value on done: 8204.0 [2024-08-05 22:29:01,116][52795] Sum rewards: 12.415, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.724', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.222', 'WEAPON3': '0.750', 'ARMOR': '0.940', 'HITCOUNT': '0.960', 'weapon2': '1.538', 'weapon3': '1.802', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '13.000'} [2024-08-05 22:29:01,445][52647] DAMAGECOUNT value on done: 6546.0 [2024-08-05 22:29:01,445][52647] Sum rewards: 2.346, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.754', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.368', 'HITCOUNT': '0.410', 'ARMOR': '0.911', 'WEAPON3': '0.950', 'weapon2': '1.126', 'DAMAGECOUNT': '1.455', 'weapon3': '1.972', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:01,740][52663] DAMAGECOUNT value on done: 6736.0 [2024-08-05 22:29:01,740][52663] Sum rewards: 6.889, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'ARMOR': '0.492', 'WEAPON3': '0.500', 'weapon4': '0.510', 'HITCOUNT': '0.620', 'HEALTH': '0.654', 'weapon2': '1.062', 'weapon3': '1.596', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:02,059][52650] Updated weights for policy 0, policy_version 7941 (0.0026) [2024-08-05 22:29:02,220][52820] DAMAGECOUNT value on done: 7838.0 [2024-08-05 22:29:02,220][52820] Sum rewards: 6.402, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.713', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.112', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.390', 'DAMAGECOUNT': '2.118', 'weapon3': '2.262', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:02,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 65060864. Throughput: 0: 4246.4. Samples: 16265880. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:29:02,795][52567] Avg episode reward: [(0, '7.091')] [2024-08-05 22:29:03,333][52665] DAMAGECOUNT value on done: 8922.0 [2024-08-05 22:29:03,335][52665] Sum rewards: 6.489, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.544', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.470', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon2': '1.030', 'ARMOR': '1.276', 'weapon3': '1.468', 'DAMAGECOUNT': '1.872', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:03,421][52669] DAMAGECOUNT value on done: 9425.0 [2024-08-05 22:29:03,422][52669] Sum rewards: 7.977, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.016', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'ARMOR': '0.436', 'HITCOUNT': '0.900', 'WEAPON3': '1.000', 'weapon2': '1.386', 'weapon3': '2.016', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:04,370][52795] DAMAGECOUNT value on done: 6337.0 [2024-08-05 22:29:04,447][52647] DAMAGECOUNT value on done: 7044.0 [2024-08-05 22:29:04,449][52647] Sum rewards: 6.541, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.434', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.100', 'AMMO3': '0.146', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.444', 'HITCOUNT': '0.680', 'WEAPON3': '0.850', 'weapon2': '0.874', 'weapon3': '2.364', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:04,618][52660] Large shaping reward -2.514 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('ARMOR', -0.01, -10.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 22:29:04,694][52663] DAMAGECOUNT value on done: 9846.0 [2024-08-05 22:29:04,695][52663] Sum rewards: 8.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.378', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.028', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'ARMOR': '0.508', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'weapon2': '1.276', 'weapon3': '2.198', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:05,616][52820] DAMAGECOUNT value on done: 8162.0 [2024-08-05 22:29:05,619][52820] Sum rewards: 11.648, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.159', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.214', 'ARMOR': '0.514', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon2': '1.482', 'weapon3': '1.868', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:05,919][52669] DAMAGECOUNT value on done: 7743.0 [2024-08-05 22:29:05,921][52669] Sum rewards: 19.299, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.992', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.160', 'ARMOR': '0.469', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon2': '1.396', 'weapon3': '1.740', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '15.000'} [2024-08-05 22:29:06,061][52665] DAMAGECOUNT value on done: 7733.0 [2024-08-05 22:29:06,061][52665] Sum rewards: 12.113, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.768', 'AMMO2': '0.005', 'AMMO4': '0.027', 'ARMOR': '0.045', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.240', 'WEAPON3': '0.900', 'weapon2': '1.084', 'HITCOUNT': '1.180', 'weapon3': '2.336', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '11.000'} [2024-08-05 22:29:06,996][52650] Updated weights for policy 0, policy_version 7951 (0.0019) [2024-08-05 22:29:07,414][52663] DAMAGECOUNT value on done: 7416.0 [2024-08-05 22:29:07,416][52663] Sum rewards: 3.593, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'weapon5': '0.114', 'WEAPON3': '0.450', 'ARMOR': '0.487', 'HITCOUNT': '0.580', 'weapon3': '1.238', 'weapon2': '1.774', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:07,479][52647] DAMAGECOUNT value on done: 8735.0 [2024-08-05 22:29:07,480][52647] Sum rewards: 2.919, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.167', 'weapon4': '0.246', 'HITCOUNT': '0.680', 'ARMOR': '0.927', 'WEAPON3': '1.100', 'weapon2': '1.330', 'weapon3': '2.134', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:07,539][52795] DAMAGECOUNT value on done: 7119.0 [2024-08-05 22:29:07,539][52795] Sum rewards: 11.173, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.412', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.096', 'WEAPON4': '0.300', 'weapon4': '0.590', 'WEAPON3': '0.750', 'ARMOR': '0.908', 'HITCOUNT': '0.980', 'weapon2': '1.488', 'weapon3': '1.656', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '11.000'} [2024-08-05 22:29:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 65150976. Throughput: 0: 4255.3. Samples: 16291590. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:29:07,795][52567] Avg episode reward: [(0, '7.167')] [2024-08-05 22:29:08,748][52820] DAMAGECOUNT value on done: 8951.0 [2024-08-05 22:29:08,753][52820] Sum rewards: 8.003, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.239', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.087', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.268', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'ARMOR': '0.950', 'weapon2': '1.512', 'weapon3': '1.526', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:09,098][52669] DAMAGECOUNT value on done: 9480.0 [2024-08-05 22:29:09,100][52669] Sum rewards: 16.166, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.460', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.026', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.960', 'weapon3': '1.438', 'weapon2': '1.830', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '13.000'} [2024-08-05 22:29:09,440][52665] DAMAGECOUNT value on done: 8166.0 [2024-08-05 22:29:09,440][52665] Sum rewards: 10.478, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.658', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.392', 'ARMOR': '0.501', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon3': '1.272', 'weapon2': '1.626', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:09,997][52647] DAMAGECOUNT value on done: 6781.0 [2024-08-05 22:29:09,998][52647] Sum rewards: 6.955, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.921', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO5': '0.010', 'weapon4': '0.022', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'HITCOUNT': '0.510', 'WEAPON3': '0.750', 'weapon3': '1.414', 'DAMAGECOUNT': '1.695', 'weapon2': '1.776', 'ARMOR': '1.887', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:10,320][52663] DAMAGECOUNT value on done: 8782.0 [2024-08-05 22:29:10,321][52663] Sum rewards: 8.554, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.784', 'AMMO2': '0.007', 'weapon4': '0.010', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.113', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.338', 'weapon3': '1.830', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:11,471][52650] Updated weights for policy 0, policy_version 7961 (0.0053) [2024-08-05 22:29:11,759][52669] DAMAGECOUNT value on done: 8100.0 [2024-08-05 22:29:11,759][52669] Sum rewards: 11.947, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.914', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON3': '0.700', 'ARMOR': '0.905', 'HITCOUNT': '1.090', 'weapon2': '1.506', 'weapon3': '1.878', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:12,154][52820] DAMAGECOUNT value on done: 7638.0 [2024-08-05 22:29:12,155][52820] Sum rewards: 12.902, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.393', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.892', 'ARMOR': '0.918', 'weapon3': '1.728', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:12,512][52665] DAMAGECOUNT value on done: 7885.0 [2024-08-05 22:29:12,512][52665] Sum rewards: 6.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.747', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.152', 'WEAPON3': '0.850', 'ARMOR': '0.860', 'HITCOUNT': '1.000', 'weapon3': '1.558', 'weapon2': '1.628', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:12,794][52567] Fps is (10 sec: 17203.7, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 65232896. Throughput: 0: 4246.2. Samples: 16316820. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:29:12,794][52567] Avg episode reward: [(0, '7.602')] [2024-08-05 22:29:12,795][52614] Saving new best policy, reward=7.602! [2024-08-05 22:29:12,850][52663] DAMAGECOUNT value on done: 9488.0 [2024-08-05 22:29:12,851][52663] Sum rewards: 4.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.284', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.528', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'ARMOR': '1.342', 'weapon2': '1.424', 'weapon3': '1.426', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:13,077][52647] DAMAGECOUNT value on done: 8193.0 [2024-08-05 22:29:13,078][52647] Sum rewards: 6.735, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.145', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.108', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.856', 'weapon3': '1.260', 'weapon2': '1.444', 'DAMAGECOUNT': '1.899', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:14,317][52669] DAMAGECOUNT value on done: 8407.0 [2024-08-05 22:29:14,318][52669] Sum rewards: 8.940, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.048', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.124', 'ARMOR': '0.432', 'HITCOUNT': '0.540', 'WEAPON3': '0.550', 'weapon2': '1.372', 'weapon3': '1.420', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:15,524][52820] DAMAGECOUNT value on done: 9142.0 [2024-08-05 22:29:15,525][52820] Sum rewards: 5.964, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.096', 'ARMOR': '0.104', 'weapon5': '0.156', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '0.914', 'weapon3': '1.956', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:15,577][52665] DAMAGECOUNT value on done: 8252.0 [2024-08-05 22:29:15,578][52665] Sum rewards: 6.028, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.362', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.030', 'AMMO4': '0.042', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.164', 'ARMOR': '0.453', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.180', 'weapon3': '1.470', 'DAMAGECOUNT': '1.800', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:15,802][52663] DAMAGECOUNT value on done: 6944.0 [2024-08-05 22:29:15,825][52663] Sum rewards: 6.097, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.714', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'ARMOR': '0.472', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.234', 'weapon3': '1.802', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:16,393][52647] DAMAGECOUNT value on done: 8633.0 [2024-08-05 22:29:16,394][52647] Sum rewards: 8.303, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.186', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.334', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon2': '1.302', 'weapon3': '1.834', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:16,753][52650] Updated weights for policy 0, policy_version 7971 (0.0022) [2024-08-05 22:29:17,092][52669] DAMAGECOUNT value on done: 7734.0 [2024-08-05 22:29:17,093][52669] Sum rewards: 10.696, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.230', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.210', 'ARMOR': '1.736', 'weapon3': '2.090', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:17,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 65314816. Throughput: 0: 4236.9. Samples: 16329070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:29:17,794][52567] Avg episode reward: [(0, '7.499')] [2024-08-05 22:29:17,964][52665] DAMAGECOUNT value on done: 7335.0 [2024-08-05 22:29:17,965][52665] Sum rewards: 9.023, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.614', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.029', 'weapon4': '0.066', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.450', 'weapon3': '1.968', 'DAMAGECOUNT': '2.733', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:18,705][52663] DAMAGECOUNT value on done: 7283.0 [2024-08-05 22:29:18,705][52663] Sum rewards: 2.707, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.379', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.181', 'HITCOUNT': '0.600', 'ARMOR': '0.974', 'WEAPON3': '1.200', 'weapon2': '1.342', 'DAMAGECOUNT': '2.067', 'weapon3': '2.094', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:18,797][52820] DAMAGECOUNT value on done: 6287.0 [2024-08-05 22:29:18,797][52820] Sum rewards: 6.021, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.295', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.492', 'weapon4': '0.610', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '0.894', 'weapon3': '1.650', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:19,342][52647] DAMAGECOUNT value on done: 8032.0 [2024-08-05 22:29:19,343][52647] Sum rewards: 4.123, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.845', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.064', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'ARMOR': '0.923', 'weapon3': '1.228', 'weapon2': '1.358', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:19,858][52669] DAMAGECOUNT value on done: 8601.0 [2024-08-05 22:29:19,858][52669] Sum rewards: 8.596, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.120', 'HEALTH': '0.195', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'HITCOUNT': '1.040', 'weapon2': '1.484', 'weapon3': '2.298', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:21,142][52650] Updated weights for policy 0, policy_version 7981 (0.0015) [2024-08-05 22:29:21,179][52665] DAMAGECOUNT value on done: 7297.0 [2024-08-05 22:29:21,180][52665] Sum rewards: 5.697, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.294', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.009', 'WEAPON1': '0.040', 'weapon5': '0.086', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.234', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'ARMOR': '1.376', 'weapon2': '1.430', 'weapon3': '1.508', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:21,488][52663] DAMAGECOUNT value on done: 8756.0 [2024-08-05 22:29:21,488][52663] Sum rewards: 17.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.134', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon3': '1.400', 'ARMOR': '1.735', 'weapon2': '1.898', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '14.000'} [2024-08-05 22:29:22,015][52647] DAMAGECOUNT value on done: 8454.0 [2024-08-05 22:29:22,016][52647] Sum rewards: 10.350, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.450', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon4': '0.050', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.084', 'weapon3': '1.552', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:22,096][52820] DAMAGECOUNT value on done: 7647.0 [2024-08-05 22:29:22,103][52820] Sum rewards: 9.860, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.609', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.614', 'weapon3': '1.844', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:22,675][52669] DAMAGECOUNT value on done: 7991.0 [2024-08-05 22:29:22,676][52669] Sum rewards: 8.616, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.097', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon3': '1.184', 'weapon2': '1.874', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 65396736. Throughput: 0: 4238.7. Samples: 16354380. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-05 22:29:22,794][52567] Avg episode reward: [(0, '7.713')] [2024-08-05 22:29:22,795][52614] Saving new best policy, reward=7.713! [2024-08-05 22:29:23,564][52667] DAMAGECOUNT value on done: 9514.0 [2024-08-05 22:29:23,566][52667] Sum rewards: 10.668, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.672', 'AMMO2': '0.003', 'ARMOR': '0.012', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon4': '0.238', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.474', 'weapon3': '1.666', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '11.000'} [2024-08-05 22:29:24,168][52663] DAMAGECOUNT value on done: 8164.0 [2024-08-05 22:29:24,169][52663] Sum rewards: 15.783, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.211', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.109', 'weapon4': '0.298', 'ARMOR': '0.489', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.176', 'weapon3': '1.820', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '14.000'} [2024-08-05 22:29:24,365][52665] DAMAGECOUNT value on done: 8526.0 [2024-08-05 22:29:24,365][52665] Sum rewards: 1.919, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.043', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.350', 'ARMOR': '0.476', 'HITCOUNT': '0.550', 'WEAPON3': '0.650', 'weapon2': '1.360', 'weapon3': '1.668', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:24,699][52647] DAMAGECOUNT value on done: 7195.0 [2024-08-05 22:29:24,701][52647] Sum rewards: 12.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.421', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'ARMOR': '0.974', 'weapon2': '1.170', 'weapon3': '2.162', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:25,550][52820] DAMAGECOUNT value on done: 7569.0 [2024-08-05 22:29:25,553][52820] Sum rewards: 11.456, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO2': '0.019', 'weapon7': '0.064', 'AMMO4': '0.096', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '0.990', 'ARMOR': '1.027', 'weapon3': '1.678', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:25,647][52669] DAMAGECOUNT value on done: 8814.0 [2024-08-05 22:29:25,647][52669] Sum rewards: 3.874, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.214', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.084', 'AMMO4': '0.108', 'weapon4': '0.344', 'ARMOR': '0.475', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '1.300', 'weapon3': '1.586', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:26,228][52667] DAMAGECOUNT value on done: 7966.0 [2024-08-05 22:29:26,229][52667] Sum rewards: 0.006, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.304', 'HITCOUNT': '0.380', 'ARMOR': '0.499', 'WEAPON3': '0.750', 'DAMAGECOUNT': '1.266', 'weapon2': '1.516', 'weapon3': '1.654', 'FRAGCOUNT': '2.000'} [2024-08-05 22:29:26,267][52650] Updated weights for policy 0, policy_version 7991 (0.0014) [2024-08-05 22:29:27,223][52663] DAMAGECOUNT value on done: 7727.0 [2024-08-05 22:29:27,223][52663] Sum rewards: 4.498, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.828', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'HITCOUNT': '0.390', 'weapon4': '0.484', 'WEAPON3': '0.600', 'weapon2': '0.754', 'ARMOR': '1.324', 'DAMAGECOUNT': '1.410', 'weapon3': '1.612', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:27,302][52647] DAMAGECOUNT value on done: 8232.0 [2024-08-05 22:29:27,304][52647] Sum rewards: 9.542, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.828', 'AMMO2': '0.029', 'AMMO3': '0.091', 'AMMO4': '0.145', 'weapon4': '0.166', 'WEAPON4': '0.350', 'ARMOR': '0.500', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.136', 'weapon3': '2.202', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:27,462][52665] DAMAGECOUNT value on done: 9760.0 [2024-08-05 22:29:27,463][52665] Sum rewards: 17.942, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.851', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.110', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'ARMOR': '0.850', 'WEAPON3': '0.850', 'weapon2': '0.960', 'HITCOUNT': '1.330', 'weapon3': '2.140', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '15.000'} [2024-08-05 22:29:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 65486848. Throughput: 0: 4218.5. Samples: 16379170. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:29:27,794][52567] Avg episode reward: [(0, '7.891')] [2024-08-05 22:29:27,797][52614] Saving new best policy, reward=7.891! [2024-08-05 22:29:29,267][52820] DAMAGECOUNT value on done: 8202.0 [2024-08-05 22:29:29,268][52820] Sum rewards: 4.021, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.700', 'AMMO2': '0.013', 'AMMO4': '0.063', 'ARMOR': '0.104', 'AMMO3': '0.123', 'WEAPON4': '0.350', 'weapon4': '0.372', 'HITCOUNT': '0.770', 'weapon2': '0.928', 'WEAPON3': '0.950', 'weapon3': '2.268', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:29,622][52667] DAMAGECOUNT value on done: 8929.0 [2024-08-05 22:29:29,624][52667] Sum rewards: 5.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.090', 'AMMO2': '0.005', 'ARMOR': '0.024', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.218', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.376', 'weapon3': '1.752', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:30,216][52665] DAMAGECOUNT value on done: 7646.0 [2024-08-05 22:29:30,218][52665] Sum rewards: 7.089, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.008', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.096', 'HEALTH': '0.184', 'weapon4': '0.296', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.124', 'weapon3': '1.564', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:30,281][52663] DAMAGECOUNT value on done: 8919.0 [2024-08-05 22:29:30,282][52663] Sum rewards: 4.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.157', 'weapon4': '0.238', 'WEAPON4': '0.250', 'HITCOUNT': '0.820', 'WEAPON3': '1.100', 'weapon2': '1.216', 'weapon3': '2.326', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:30,683][52647] DAMAGECOUNT value on done: 7436.0 [2024-08-05 22:29:30,684][52647] Sum rewards: 1.922, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.434', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.164', 'HITCOUNT': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.918', 'weapon2': '1.476', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '2.000', 'weapon3': '2.086'} [2024-08-05 22:29:31,053][52650] Updated weights for policy 0, policy_version 8001 (0.0027) [2024-08-05 22:29:32,512][52667] DAMAGECOUNT value on done: 8473.0 [2024-08-05 22:29:32,513][52667] Sum rewards: 8.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.994', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'weapon3': '1.624', 'weapon2': '2.048', 'ARMOR': '2.169', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:32,666][52820] DAMAGECOUNT value on done: 7294.0 [2024-08-05 22:29:32,669][52820] Sum rewards: 3.590, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.845', 'weapon4': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.059', 'weapon5': '0.066', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'HITCOUNT': '0.480', 'WEAPON3': '0.650', 'weapon2': '0.936', 'DAMAGECOUNT': '1.530', 'weapon3': '1.572', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16828.3). Total num frames: 65568768. Throughput: 0: 4221.6. Samples: 16391800. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:29:32,794][52567] Avg episode reward: [(0, '7.843')] [2024-08-05 22:29:33,144][52665] DAMAGECOUNT value on done: 8189.0 [2024-08-05 22:29:33,144][52665] Sum rewards: 2.171, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.617', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon5': '0.006', 'AMMO5': '0.007', 'weapon7': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.941', 'DAMAGECOUNT': '1.137', 'weapon2': '1.196', 'weapon3': '1.390', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:33,429][52647] DAMAGECOUNT value on done: 9195.0 [2024-08-05 22:29:33,430][52647] Sum rewards: 11.097, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.144', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.520', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon2': '0.948', 'ARMOR': '1.296', 'weapon3': '1.934', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '11.000'} [2024-08-05 22:29:33,649][52663] DAMAGECOUNT value on done: 8332.0 [2024-08-05 22:29:33,650][52663] Sum rewards: 4.600, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.260', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'HITCOUNT': '0.880', 'ARMOR': '0.948', 'WEAPON3': '1.000', 'weapon2': '1.384', 'weapon3': '1.896', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:35,226][52667] DAMAGECOUNT value on done: 9274.0 [2024-08-05 22:29:35,226][52667] Sum rewards: 10.483, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.452', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon7': '0.048', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.346', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.052', 'weapon3': '1.760', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:35,976][52820] DAMAGECOUNT value on done: 7143.0 [2024-08-05 22:29:35,984][52820] Sum rewards: 3.434, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.096', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.027', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.276', 'HITCOUNT': '0.380', 'WEAPON3': '0.450', 'weapon2': '0.912', 'DAMAGECOUNT': '1.281', 'weapon3': '1.298', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:35,987][52665] DAMAGECOUNT value on done: 8705.0 [2024-08-05 22:29:35,991][52665] Sum rewards: 3.565, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.842', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.015', 'AMMO3': '0.060', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.208', 'HITCOUNT': '0.380', 'weapon4': '0.410', 'WEAPON3': '0.500', 'ARMOR': '0.564', 'weapon2': '1.012', 'DAMAGECOUNT': '1.311', 'weapon3': '1.320', 'FRAGCOUNT': '2.000'} [2024-08-05 22:29:36,095][52650] Updated weights for policy 0, policy_version 8011 (0.0020) [2024-08-05 22:29:36,334][52647] DAMAGECOUNT value on done: 7969.0 [2024-08-05 22:29:36,334][52647] Sum rewards: 10.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.408', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.068', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'ARMOR': '0.420', 'weapon4': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.404', 'weapon2': '1.490', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:37,122][52663] DAMAGECOUNT value on done: 8306.0 [2024-08-05 22:29:37,123][52663] Sum rewards: 6.911, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.484', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'ARMOR': '0.136', 'HITCOUNT': '0.440', 'weapon4': '0.544', 'WEAPON3': '0.700', 'weapon2': '1.120', 'weapon3': '1.554', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17066.7, 300 sec: 16856.1). Total num frames: 65658880. Throughput: 0: 4225.3. Samples: 16417490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:29:37,795][52567] Avg episode reward: [(0, '7.655')] [2024-08-05 22:29:38,265][52667] DAMAGECOUNT value on done: 10146.0 [2024-08-05 22:29:38,266][52667] Sum rewards: 21.052, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.680', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'WEAPON3': '0.900', 'ARMOR': '0.956', 'HITCOUNT': '1.530', 'weapon2': '1.636', 'weapon3': '1.924', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '18.000'} [2024-08-05 22:29:38,928][52665] DAMAGECOUNT value on done: 8721.0 [2024-08-05 22:29:38,929][52665] Sum rewards: 6.441, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.956', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON5': '0.300', 'HITCOUNT': '0.620', 'ARMOR': '0.908', 'WEAPON3': '1.000', 'weapon2': '1.096', 'DAMAGECOUNT': '2.043', 'weapon3': '2.270', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:39,229][52649] DAMAGECOUNT value on done: 9066.0 [2024-08-05 22:29:39,231][52649] Sum rewards: 6.155, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.766', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.130', 'weapon4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.421', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '0.904', 'weapon3': '2.356', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:39,371][52820] DAMAGECOUNT value on done: 7759.0 [2024-08-05 22:29:39,372][52820] Sum rewards: 2.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.711', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.132', 'weapon4': '0.164', 'WEAPON4': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon2': '1.606', 'ARMOR': '1.686', 'weapon3': '1.706', 'DAMAGECOUNT': '1.818', 'FRAGCOUNT': '2.000'} [2024-08-05 22:29:39,567][52647] DAMAGECOUNT value on done: 8680.0 [2024-08-05 22:29:39,569][52647] Sum rewards: 10.228, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.810', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'AMMO3': '0.059', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'HITCOUNT': '0.550', 'weapon5': '0.738', 'weapon3': '0.996', 'weapon2': '1.204', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:40,282][52663] DAMAGECOUNT value on done: 8273.0 [2024-08-05 22:29:40,284][52663] Sum rewards: 2.852, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'HEALTH': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.146', 'HITCOUNT': '0.810', 'ARMOR': '0.857', 'WEAPON3': '0.900', 'weapon2': '1.378', 'weapon3': '2.388', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:40,551][52650] Updated weights for policy 0, policy_version 8021 (0.0026) [2024-08-05 22:29:40,622][52667] DAMAGECOUNT value on done: 8731.0 [2024-08-05 22:29:40,624][52667] Sum rewards: 5.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.905', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon4': '0.328', 'ARMOR': '0.515', 'HITCOUNT': '0.790', 'WEAPON3': '1.000', 'weapon2': '1.264', 'weapon3': '1.822', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:41,642][52658] DAMAGECOUNT value on done: 7547.0 [2024-08-05 22:29:41,642][52658] Sum rewards: 4.249, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.785', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'ARMOR': '0.486', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.334', 'DAMAGECOUNT': '2.109', 'weapon3': '2.368', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:41,842][52665] DAMAGECOUNT value on done: 8118.0 [2024-08-05 22:29:41,844][52665] Sum rewards: 10.669, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.028', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'ARMOR': '0.493', 'HITCOUNT': '0.810', 'WEAPON3': '0.950', 'weapon2': '1.154', 'weapon3': '2.228', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '12.000'} [2024-08-05 22:29:42,294][52649] DAMAGECOUNT value on done: 7415.0 [2024-08-05 22:29:42,294][52649] Sum rewards: 3.074, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.572', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.044', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'ARMOR': '0.428', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '1.154', 'DAMAGECOUNT': '2.148', 'weapon3': '2.378', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:42,678][52820] DAMAGECOUNT value on done: 6577.0 [2024-08-05 22:29:42,679][52820] Sum rewards: 8.014, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.934', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'weapon5': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.312', 'HITCOUNT': '0.690', 'WEAPON3': '0.900', 'weapon2': '1.420', 'weapon3': '1.866', 'ARMOR': '1.868', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:42,724][52647] DAMAGECOUNT value on done: 7998.0 [2024-08-05 22:29:42,727][52647] Sum rewards: 6.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.703', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.290', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '0.958', 'weapon3': '1.796', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16828.4). Total num frames: 65732608. Throughput: 0: 4212.2. Samples: 16442700. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:29:42,794][52567] Avg episode reward: [(0, '7.426')] [2024-08-05 22:29:42,839][52663] DAMAGECOUNT value on done: 8561.0 [2024-08-05 22:29:42,840][52663] Sum rewards: 16.189, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.332', 'AMMO4': '-0.101', 'AMMO2': '-0.020', 'AMMO3': '0.125', 'WEAPON3': '0.850', 'ARMOR': '0.889', 'HITCOUNT': '1.200', 'weapon2': '1.576', 'weapon3': '1.696', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '15.000'} [2024-08-05 22:29:44,093][52667] DAMAGECOUNT value on done: 7944.0 [2024-08-05 22:29:44,093][52667] Sum rewards: 4.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.822', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.121', 'ARMOR': '0.400', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'weapon2': '1.276', 'weapon3': '1.668', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:44,432][52665] DAMAGECOUNT value on done: 7652.0 [2024-08-05 22:29:44,434][52665] Sum rewards: 5.036, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.022', 'weapon5': '0.026', 'AMMO4': '0.080', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'ARMOR': '0.857', 'weapon2': '0.968', 'weapon3': '1.300', 'DAMAGECOUNT': '1.776', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:44,784][52649] DAMAGECOUNT value on done: 6943.0 [2024-08-05 22:29:44,784][52649] Sum rewards: 7.968, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.895', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'WEAPON4': '0.050', 'weapon4': '0.106', 'AMMO3': '0.118', 'ARMOR': '0.484', 'WEAPON3': '0.900', 'HITCOUNT': '1.120', 'weapon2': '1.332', 'weapon3': '2.202', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:45,084][52658] DAMAGECOUNT value on done: 8156.0 [2024-08-05 22:29:45,084][52658] Sum rewards: 16.418, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.478', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'weapon4': '0.342', 'WEAPON3': '0.750', 'ARMOR': '1.009', 'HITCOUNT': '1.060', 'weapon2': '1.484', 'weapon3': '1.890', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '13.000'} [2024-08-05 22:29:45,831][52820] DAMAGECOUNT value on done: 7397.0 [2024-08-05 22:29:45,832][52820] Sum rewards: 5.630, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.018', 'HEALTH': '0.076', 'AMMO4': '0.088', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.188', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'ARMOR': '0.944', 'weapon2': '1.448', 'weapon3': '2.058', 'DAMAGECOUNT': '2.079', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:45,851][52647] DAMAGECOUNT value on done: 8475.0 [2024-08-05 22:29:45,852][52647] Sum rewards: 11.575, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.392', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'AMMO3': '0.050', 'weapon7': '0.052', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.422', 'ARMOR': '0.536', 'HITCOUNT': '0.550', 'weapon2': '1.110', 'weapon3': '1.204', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:45,893][52650] Updated weights for policy 0, policy_version 8031 (0.0029) [2024-08-05 22:29:46,164][52663] DAMAGECOUNT value on done: 7758.0 [2024-08-05 22:29:46,165][52663] Sum rewards: 6.149, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.474', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.344', 'ARMOR': '0.532', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.232', 'weapon3': '1.658', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:47,024][52664] DAMAGECOUNT value on done: 9389.0 [2024-08-05 22:29:47,025][52664] Sum rewards: 2.082, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.320', 'weapon4': '0.002', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'HITCOUNT': '0.720', 'WEAPON3': '0.850', 'weapon2': '1.440', 'weapon3': '2.070', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:47,258][52665] DAMAGECOUNT value on done: 8090.0 [2024-08-05 22:29:47,259][52665] Sum rewards: 6.113, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.036', 'AMMO4': '0.042', 'ARMOR': '0.064', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.244', 'HEALTH': '0.410', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '0.870', 'weapon3': '1.894', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:47,314][52667] DAMAGECOUNT value on done: 7814.0 [2024-08-05 22:29:47,316][52667] Sum rewards: 4.183, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.022', 'ARMOR': '0.051', 'AMMO4': '0.092', 'HEALTH': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon4': '0.184', 'WEAPON4': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.550', 'weapon2': '1.124', 'DAMAGECOUNT': '1.179', 'weapon3': '2.320', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:47,594][52649] DAMAGECOUNT value on done: 9612.0 [2024-08-05 22:29:47,597][52649] Sum rewards: 6.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.643', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.020', 'weapon4': '0.034', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'ARMOR': '0.517', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon2': '1.344', 'weapon3': '2.328', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:47,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 65822720. Throughput: 0: 4213.4. Samples: 16455480. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:29:47,794][52567] Avg episode reward: [(0, '7.599')] [2024-08-05 22:29:48,277][52658] DAMAGECOUNT value on done: 7348.0 [2024-08-05 22:29:48,279][52658] Sum rewards: 11.722, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.888', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.158', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'ARMOR': '1.339', 'weapon2': '1.408', 'weapon3': '1.416', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:49,085][52647] DAMAGECOUNT value on done: 7927.0 [2024-08-05 22:29:49,086][52647] Sum rewards: 3.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.406', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.025', 'ARMOR': '0.054', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.378', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon2': '1.234', 'weapon3': '1.250', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:49,223][52663] DAMAGECOUNT value on done: 7362.0 [2024-08-05 22:29:49,224][52663] Sum rewards: 6.289, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.069', 'AMMO2': '0.008', 'ARMOR': '0.036', 'AMMO4': '0.040', 'AMMO3': '0.070', 'weapon4': '0.084', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon2': '1.260', 'weapon3': '1.542', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:49,290][52820] DAMAGECOUNT value on done: 7513.0 [2024-08-05 22:29:49,292][52820] Sum rewards: 3.539, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.535', 'AMMO2': '0.007', 'AMMO4': '0.035', 'ARMOR': '0.048', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'HITCOUNT': '0.370', 'WEAPON3': '0.600', 'weapon4': '0.634', 'weapon2': '0.856', 'DAMAGECOUNT': '1.473', 'weapon3': '1.770', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:49,651][52665] DAMAGECOUNT value on done: 7565.0 [2024-08-05 22:29:49,653][52665] Sum rewards: 6.569, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.147', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'ARMOR': '0.040', 'AMMO3': '0.088', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '1.436', 'weapon3': '1.644', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:49,990][52667] DAMAGECOUNT value on done: 8435.0 [2024-08-05 22:29:49,990][52667] Sum rewards: 3.293, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'AMMO2': '0.003', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.017', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.200', 'HITCOUNT': '0.510', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.446', 'ARMOR': '1.461', 'weapon2': '1.534', 'weapon3': '1.680', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:50,061][52664] DAMAGECOUNT value on done: 8292.0 [2024-08-05 22:29:50,061][52664] Sum rewards: 6.780, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.314', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.054', 'weapon5': '0.090', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'ARMOR': '0.864', 'weapon2': '1.126', 'weapon3': '1.176', 'DAMAGECOUNT': '1.767', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:50,251][52649] DAMAGECOUNT value on done: 6966.0 [2024-08-05 22:29:50,251][52649] Sum rewards: 10.826, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.074', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'HEALTH': '0.292', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.306', 'weapon3': '1.842', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:50,409][52650] Updated weights for policy 0, policy_version 8041 (0.0025) [2024-08-05 22:29:50,747][52658] DAMAGECOUNT value on done: 8306.0 [2024-08-05 22:29:50,748][52658] Sum rewards: 5.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.316', 'ARMOR': '0.489', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'weapon2': '0.964', 'weapon3': '1.762', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:52,366][52665] DAMAGECOUNT value on done: 9131.0 [2024-08-05 22:29:52,367][52665] Sum rewards: 7.767, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.472', 'AMMO2': '0.008', 'ARMOR': '0.028', 'AMMO4': '0.041', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.140', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon3': '1.224', 'weapon2': '1.238', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:52,601][52820] DAMAGECOUNT value on done: 6705.0 [2024-08-05 22:29:52,604][52820] Sum rewards: 3.260, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.593', 'AMMO2': '0.001', 'AMMO4': '0.002', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'ARMOR': '0.481', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon2': '1.314', 'weapon3': '1.338', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '3.000'} [2024-08-05 22:29:52,611][52667] DAMAGECOUNT value on done: 7993.0 [2024-08-05 22:29:52,612][52667] Sum rewards: 6.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.211', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon4': '0.266', 'WEAPON3': '0.550', 'ARMOR': '0.876', 'HITCOUNT': '0.880', 'weapon2': '1.332', 'weapon3': '1.540', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '4.000'} [2024-08-05 22:29:52,717][52649] DAMAGECOUNT value on done: 8354.0 [2024-08-05 22:29:52,717][52649] Sum rewards: 6.615, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.888', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.242', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon5': '0.836', 'weapon2': '1.252', 'weapon3': '1.308', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:52,798][52567] Fps is (10 sec: 17197.6, 60 sec: 16929.2, 300 sec: 16911.4). Total num frames: 65904640. Throughput: 0: 4198.8. Samples: 16480550. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:29:52,803][52567] Avg episode reward: [(0, '7.578')] [2024-08-05 22:29:53,149][52663] DAMAGECOUNT value on done: 7617.0 [2024-08-05 22:29:53,149][52663] Sum rewards: 4.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON4': '0.050', 'AMMO3': '0.132', 'ARMOR': '0.507', 'HITCOUNT': '0.630', 'WEAPON3': '0.900', 'weapon2': '1.314', 'weapon3': '2.170', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:53,156][52664] DAMAGECOUNT value on done: 9062.0 [2024-08-05 22:29:53,157][52664] Sum rewards: 12.211, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.195', 'AMMO4': '-0.101', 'AMMO2': '-0.020', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'ARMOR': '0.458', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon3': '1.524', 'weapon2': '1.526', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '11.000'} [2024-08-05 22:29:53,705][52658] DAMAGECOUNT value on done: 8210.0 [2024-08-05 22:29:53,708][52658] Sum rewards: 10.590, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.109', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.097', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.448', 'weapon3': '1.832', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:55,597][52650] Updated weights for policy 0, policy_version 8051 (0.0012) [2024-08-05 22:29:55,687][52667] DAMAGECOUNT value on done: 9078.0 [2024-08-05 22:29:55,687][52667] Sum rewards: 1.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.632', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO3': '0.102', 'AMMO4': '0.120', 'ARMOR': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.450', 'weapon4': '0.482', 'weapon2': '0.698', 'WEAPON3': '0.700', 'DAMAGECOUNT': '1.491', 'weapon3': '1.726', 'FRAGCOUNT': '2.000'} [2024-08-05 22:29:56,190][52649] DAMAGECOUNT value on done: 6927.0 [2024-08-05 22:29:56,190][52649] Sum rewards: 4.582, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.308', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.108', 'WEAPON4': '0.350', 'HITCOUNT': '0.510', 'ARMOR': '0.555', 'weapon4': '0.558', 'WEAPON3': '0.750', 'weapon2': '1.116', 'weapon3': '1.634', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '5.000'} [2024-08-05 22:29:56,194][52820] DAMAGECOUNT value on done: 6779.0 [2024-08-05 22:29:56,194][52820] Sum rewards: 14.992, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.522', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.384', 'WEAPON3': '0.550', 'HITCOUNT': '0.960', 'ARMOR': '0.974', 'weapon3': '1.660', 'weapon2': '1.766', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '13.000'} [2024-08-05 22:29:56,476][52664] DAMAGECOUNT value on done: 7460.0 [2024-08-05 22:29:56,477][52664] Sum rewards: 8.666, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.294', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.149', 'ARMOR': '0.440', 'HITCOUNT': '0.730', 'WEAPON3': '0.950', 'weapon2': '1.186', 'weapon3': '1.934', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:56,835][52658] DAMAGECOUNT value on done: 6680.0 [2024-08-05 22:29:56,835][52658] Sum rewards: 6.855, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.383', 'AMMO2': '0.011', 'AMMO4': '0.052', 'ARMOR': '0.076', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'HITCOUNT': '0.460', 'weapon4': '0.508', 'WEAPON3': '0.550', 'weapon2': '1.024', 'weapon3': '1.226', 'DAMAGECOUNT': '1.596', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:57,204][52671] DAMAGECOUNT value on done: 9648.0 [2024-08-05 22:29:57,204][52671] Sum rewards: 7.914, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.348', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.018', 'AMMO4': '0.082', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.262', 'WEAPON3': '0.850', 'ARMOR': '0.899', 'HITCOUNT': '0.970', 'weapon2': '1.266', 'weapon3': '1.638', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:57,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.5, 300 sec: 16883.8). Total num frames: 65986560. Throughput: 0: 4200.9. Samples: 16505860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:29:57,795][52567] Avg episode reward: [(0, '7.494')] [2024-08-05 22:29:58,574][52667] DAMAGECOUNT value on done: 9437.0 [2024-08-05 22:29:58,574][52667] Sum rewards: 7.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.180', 'HITCOUNT': '0.680', 'ARMOR': '0.890', 'WEAPON3': '0.900', 'weapon2': '1.226', 'weapon3': '2.362', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '7.000'} [2024-08-05 22:29:59,108][52649] DAMAGECOUNT value on done: 7594.0 [2024-08-05 22:29:59,108][52649] Sum rewards: 9.887, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.370', 'AMMO2': '0.021', 'AMMO3': '0.084', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'ARMOR': '0.498', 'WEAPON3': '0.550', 'weapon4': '0.550', 'HITCOUNT': '0.610', 'weapon2': '0.824', 'weapon3': '1.548', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '9.000'} [2024-08-05 22:29:59,306][52664] DAMAGECOUNT value on done: 8775.0 [2024-08-05 22:29:59,307][52664] Sum rewards: 8.643, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.346', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'ARMOR': '1.350', 'weapon3': '1.676', 'weapon2': '1.744', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '8.000'} [2024-08-05 22:29:59,658][52658] DAMAGECOUNT value on done: 9067.0 [2024-08-05 22:29:59,659][52658] Sum rewards: 8.848, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.593', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.061', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'ARMOR': '1.362', 'weapon3': '1.414', 'weapon2': '1.616', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '6.000'} [2024-08-05 22:29:59,811][52820] DAMAGECOUNT value on done: 7739.0 [2024-08-05 22:29:59,812][52820] Sum rewards: 9.752, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.006', 'AMMO2': '0.028', 'weapon4': '0.030', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'ARMOR': '0.913', 'weapon3': '1.766', 'DAMAGECOUNT': '1.836', 'weapon2': '1.974', 'FRAGCOUNT': '10.000'} [2024-08-05 22:29:59,876][52666] DAMAGECOUNT value on done: 7728.0 [2024-08-05 22:29:59,878][52666] Sum rewards: 7.999, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.190', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO3': '0.099', 'ARMOR': '0.494', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon3': '1.520', 'weapon2': '1.678', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:00,251][52650] Updated weights for policy 0, policy_version 8061 (0.0011) [2024-08-05 22:30:00,492][52671] DAMAGECOUNT value on done: 7921.0 [2024-08-05 22:30:00,493][52671] Sum rewards: 6.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.074', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO3': '0.081', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.298', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '0.926', 'weapon3': '1.668', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:01,345][52670] DAMAGECOUNT value on done: 9428.0 [2024-08-05 22:30:01,346][52670] Sum rewards: 11.543, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.082', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.252', 'HITCOUNT': '0.880', 'WEAPON3': '0.900', 'ARMOR': '0.936', 'weapon2': '1.362', 'weapon3': '1.842', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '11.000'} [2024-08-05 22:30:01,474][52667] DAMAGECOUNT value on done: 9660.0 [2024-08-05 22:30:01,474][52667] Sum rewards: 4.422, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.591', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'HITCOUNT': '0.800', 'WEAPON3': '0.950', 'ARMOR': '0.986', 'weapon2': '1.460', 'weapon3': '1.890', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:01,879][52649] DAMAGECOUNT value on done: 7681.0 [2024-08-05 22:30:01,883][52649] Sum rewards: 4.447, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.612', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.202', 'HITCOUNT': '0.510', 'ARMOR': '0.533', 'WEAPON3': '0.600', 'DAMAGECOUNT': '1.620', 'weapon3': '1.776', 'weapon2': '1.824', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:02,349][52664] DAMAGECOUNT value on done: 8016.0 [2024-08-05 22:30:02,350][52664] Sum rewards: 10.496, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.165', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'weapon7': '0.064', 'AMMO3': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.352', 'ARMOR': '0.493', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.220', 'weapon2': '1.274', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:02,794][52567] Fps is (10 sec: 16389.0, 60 sec: 16793.6, 300 sec: 16883.8). Total num frames: 66068480. Throughput: 0: 4208.4. Samples: 16518450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:30:02,795][52567] Avg episode reward: [(0, '7.394')] [2024-08-05 22:30:02,798][52658] DAMAGECOUNT value on done: 8667.0 [2024-08-05 22:30:02,799][52658] Sum rewards: 9.480, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.136', 'AMMO2': '0.022', 'AMMO3': '0.080', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.426', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'ARMOR': '0.971', 'weapon2': '1.088', 'weapon3': '1.902', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:02,947][52666] DAMAGECOUNT value on done: 7725.0 [2024-08-05 22:30:02,956][52666] Sum rewards: 4.075, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.548', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.128', 'weapon3': '1.486', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:03,116][52671] DAMAGECOUNT value on done: 9017.0 [2024-08-05 22:30:03,116][52671] Sum rewards: 8.123, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.453', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'weapon5': '0.058', 'AMMO3': '0.090', 'weapon4': '0.252', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.170', 'weapon3': '1.486', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:03,300][52820] DAMAGECOUNT value on done: 7938.0 [2024-08-05 22:30:03,302][52820] Sum rewards: 9.130, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.530', 'weapon4': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'AMMO4': '0.081', 'weapon5': '0.086', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'ARMOR': '0.828', 'weapon2': '1.560', 'weapon3': '1.562', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:04,440][52659] DAMAGECOUNT value on done: 8288.0 [2024-08-05 22:30:04,442][52659] Sum rewards: 7.277, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.114', 'AMMO2': '0.010', 'AMMO4': '0.047', 'ARMOR': '0.060', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.312', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '0.968', 'weapon3': '2.238', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:04,802][52667] DAMAGECOUNT value on done: 8675.0 [2024-08-05 22:30:04,802][52667] Sum rewards: 8.318, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.027', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.238', 'WEAPON3': '0.400', 'ARMOR': '0.473', 'HITCOUNT': '0.630', 'weapon2': '1.306', 'weapon3': '1.614', 'DAMAGECOUNT': '2.157', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:05,069][52664] DAMAGECOUNT value on done: 8860.0 [2024-08-05 22:30:05,069][52664] Sum rewards: 9.424, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.364', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.544', 'weapon2': '0.758', 'WEAPON3': '0.800', 'HITCOUNT': '0.980', 'weapon3': '2.212', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:05,090][52650] Updated weights for policy 0, policy_version 8071 (0.0014) [2024-08-05 22:30:05,093][52670] DAMAGECOUNT value on done: 7908.0 [2024-08-05 22:30:05,093][52670] Sum rewards: 6.697, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.084', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.334', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '0.898', 'ARMOR': '1.001', 'weapon3': '1.220', 'DAMAGECOUNT': '1.815', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:05,238][52649] DAMAGECOUNT value on done: 8116.0 [2024-08-05 22:30:05,241][52649] Sum rewards: 13.482, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'HEALTH': '0.082', 'AMMO4': '0.084', 'AMMO3': '0.103', 'weapon4': '0.310', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon3': '1.356', 'weapon2': '1.454', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '11.000'} [2024-08-05 22:30:05,966][52658] DAMAGECOUNT value on done: 7150.0 [2024-08-05 22:30:05,968][52658] Sum rewards: 3.658, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.418', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'weapon4': '0.382', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'ARMOR': '0.868', 'weapon2': '1.230', 'weapon3': '1.754', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:06,286][52671] DAMAGECOUNT value on done: 8741.0 [2024-08-05 22:30:06,286][52671] Sum rewards: 10.136, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.725', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.020', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'ARMOR': '0.863', 'weapon2': '1.364', 'weapon3': '1.744', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:06,479][52666] DAMAGECOUNT value on done: 7570.0 [2024-08-05 22:30:06,482][52666] Sum rewards: 7.900, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.206', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'weapon5': '0.078', 'AMMO4': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'ARMOR': '0.800', 'weapon3': '1.186', 'weapon2': '1.498', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:07,453][52659] DAMAGECOUNT value on done: 9366.0 [2024-08-05 22:30:07,453][52659] Sum rewards: 9.590, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.070', 'HEALTH': '0.193', 'WEAPON3': '0.400', 'HITCOUNT': '0.700', 'weapon2': '1.136', 'weapon3': '1.210', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16793.7, 300 sec: 16911.6). Total num frames: 66158592. Throughput: 0: 4204.9. Samples: 16543600. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:30:07,794][52567] Avg episode reward: [(0, '7.594')] [2024-08-05 22:30:07,858][52667] DAMAGECOUNT value on done: 7494.0 [2024-08-05 22:30:07,858][52667] Sum rewards: 7.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'ARMOR': '0.472', 'weapon4': '0.580', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '1.288', 'weapon3': '1.536', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:07,860][52670] DAMAGECOUNT value on done: 7093.0 [2024-08-05 22:30:07,862][52670] Sum rewards: 7.982, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.098', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'ARMOR': '0.420', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon3': '1.660', 'weapon2': '1.918', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:08,392][52664] DAMAGECOUNT value on done: 8337.0 [2024-08-05 22:30:08,394][52664] Sum rewards: 1.056, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.094', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.050', 'HITCOUNT': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.256', 'DAMAGECOUNT': '0.348', 'WEAPON3': '0.450', 'ARMOR': '0.950', 'FRAGCOUNT': '1.000', 'weapon3': '1.060', 'weapon2': '1.498'} [2024-08-05 22:30:08,502][52649] DAMAGECOUNT value on done: 8272.0 [2024-08-05 22:30:08,505][52649] Sum rewards: 3.565, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.030', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.040', 'weapon4': '0.046', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.252', 'DAMAGECOUNT': '1.275', 'weapon2': '1.546', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:08,792][52671] DAMAGECOUNT value on done: 8245.0 [2024-08-05 22:30:08,792][52671] Sum rewards: 5.894, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.021', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'HEALTH': '0.284', 'ARMOR': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'weapon4': '0.564', 'weapon2': '1.102', 'weapon3': '1.344', 'DAMAGECOUNT': '1.413', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:08,962][52666] DAMAGECOUNT value on done: 8722.0 [2024-08-05 22:30:08,964][52666] Sum rewards: 2.164, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.358', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'HITCOUNT': '0.410', 'weapon4': '0.508', 'weapon2': '0.554', 'ARMOR': '0.559', 'WEAPON3': '0.650', 'weapon3': '1.590', 'DAMAGECOUNT': '1.722', 'FRAGCOUNT': '2.000'} [2024-08-05 22:30:09,107][52658] DAMAGECOUNT value on done: 7410.0 [2024-08-05 22:30:09,107][52658] Sum rewards: 8.722, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.324', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'ARMOR': '0.028', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '0.912', 'weapon3': '1.980', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:10,153][52650] Updated weights for policy 0, policy_version 8081 (0.0017) [2024-08-05 22:30:10,280][52659] DAMAGECOUNT value on done: 8242.0 [2024-08-05 22:30:10,282][52659] Sum rewards: 6.748, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.042', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'HITCOUNT': '0.590', 'weapon3': '1.238', 'weapon2': '1.476', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:10,419][52667] DAMAGECOUNT value on done: 8824.0 [2024-08-05 22:30:10,419][52667] Sum rewards: 10.764, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.388', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.115', 'WEAPON3': '0.850', 'ARMOR': '0.931', 'HITCOUNT': '0.990', 'weapon2': '1.214', 'weapon3': '1.876', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:10,811][52670] DAMAGECOUNT value on done: 7418.0 [2024-08-05 22:30:10,811][52670] Sum rewards: 7.276, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.591', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon4': '0.224', 'ARMOR': '0.484', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon2': '1.422', 'weapon3': '2.006', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:11,440][52649] DAMAGECOUNT value on done: 7090.0 [2024-08-05 22:30:11,444][52649] Sum rewards: 5.619, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.883', 'AMMO2': '0.013', 'ARMOR': '0.052', 'AMMO4': '0.065', 'AMMO3': '0.077', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon4': '0.602', 'HITCOUNT': '0.630', 'weapon2': '1.198', 'weapon3': '1.526', 'DAMAGECOUNT': '1.839', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:11,592][52658] DAMAGECOUNT value on done: 8490.0 [2024-08-05 22:30:11,592][52658] Sum rewards: 4.346, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.919', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'ARMOR': '0.040', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.332', 'HITCOUNT': '0.420', 'WEAPON3': '0.600', 'weapon2': '0.954', 'DAMAGECOUNT': '1.482', 'weapon3': '1.646', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:11,945][52671] DAMAGECOUNT value on done: 8375.0 [2024-08-05 22:30:11,945][52664] DAMAGECOUNT value on done: 8611.0 [2024-08-05 22:30:11,947][52671] Sum rewards: 11.844, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.048', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.020', 'weapon7': '0.024', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.478', 'WEAPON3': '0.550', 'HITCOUNT': '0.880', 'weapon3': '1.236', 'weapon2': '1.412', 'ARMOR': '1.415', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:11,947][52664] Sum rewards: 8.829, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO3': '0.079', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.252', 'HEALTH': '0.262', 'WEAPON3': '0.500', 'HITCOUNT': '0.880', 'ARMOR': '0.924', 'weapon3': '1.446', 'weapon2': '1.534', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:12,176][52666] DAMAGECOUNT value on done: 7912.0 [2024-08-05 22:30:12,178][52666] Sum rewards: 7.641, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.634', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO3': '0.142', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'weapon3': '1.686', 'weapon2': '1.722', 'ARMOR': '1.865', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:12,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16793.6, 300 sec: 16883.9). Total num frames: 66240512. Throughput: 0: 4218.0. Samples: 16568980. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:30:12,794][52567] Avg episode reward: [(0, '7.193')] [2024-08-05 22:30:13,123][52667] DAMAGECOUNT value on done: 8517.0 [2024-08-05 22:30:13,123][52667] Sum rewards: 4.148, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.238', 'AMMO2': '0.021', 'AMMO3': '0.081', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'HITCOUNT': '0.280', 'weapon4': '0.412', 'WEAPON3': '0.550', 'ARMOR': '0.860', 'DAMAGECOUNT': '0.957', 'weapon3': '1.218', 'weapon2': '1.654', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:13,513][52659] DAMAGECOUNT value on done: 8566.0 [2024-08-05 22:30:13,515][52659] Sum rewards: 3.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.357', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.232', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon2': '1.036', 'weapon3': '1.344', 'DAMAGECOUNT': '1.938', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:13,522][52670] DAMAGECOUNT value on done: 6474.0 [2024-08-05 22:30:13,523][52670] Sum rewards: 5.150, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.332', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.066', 'weapon7': '0.076', 'ARMOR': '0.080', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.350', 'HITCOUNT': '0.600', 'weapon2': '0.668', 'WEAPON3': '0.700', 'weapon4': '0.892', 'weapon3': '1.710', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:14,343][52658] DAMAGECOUNT value on done: 7815.0 [2024-08-05 22:30:14,344][52658] Sum rewards: 10.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.224', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.014', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '0.892', 'weapon2': '1.264', 'weapon3': '1.698', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:14,643][52649] DAMAGECOUNT value on done: 8784.0 [2024-08-05 22:30:14,646][52649] Sum rewards: 3.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.062', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.500', 'HITCOUNT': '0.520', 'ARMOR': '0.837', 'weapon3': '1.138', 'weapon2': '1.152', 'DAMAGECOUNT': '1.710', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:14,695][52666] DAMAGECOUNT value on done: 7724.0 [2024-08-05 22:30:14,696][52666] Sum rewards: 7.401, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.724', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.074', 'weapon5': '0.082', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon4': '0.640', 'weapon2': '0.906', 'ARMOR': '0.941', 'weapon3': '1.484', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:15,132][52650] Updated weights for policy 0, policy_version 8091 (0.0021) [2024-08-05 22:30:15,134][52664] DAMAGECOUNT value on done: 8256.0 [2024-08-05 22:30:15,147][52664] Sum rewards: 4.170, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.224', 'AMMO2': '0.014', 'AMMO5': '0.015', 'AMMO3': '0.070', 'AMMO4': '0.071', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.360', 'HITCOUNT': '0.450', 'ARMOR': '0.536', 'WEAPON3': '0.550', 'DAMAGECOUNT': '1.416', 'weapon2': '1.494', 'weapon3': '1.608', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:15,159][52671] DAMAGECOUNT value on done: 9225.0 [2024-08-05 22:30:15,161][52671] Sum rewards: 10.351, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.688', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'ARMOR': '0.096', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.800', 'HITCOUNT': '0.880', 'weapon2': '1.046', 'weapon3': '2.050', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:15,334][52614] Signal inference workers to stop experience collection... (1500 times) [2024-08-05 22:30:15,340][52614] Signal inference workers to resume experience collection... (1500 times) [2024-08-05 22:30:15,415][52650] InferenceWorker_p0-w0: stopping experience collection (1500 times) [2024-08-05 22:30:15,416][52650] InferenceWorker_p0-w0: resuming experience collection (1500 times) [2024-08-05 22:30:15,938][52667] DAMAGECOUNT value on done: 8208.0 [2024-08-05 22:30:15,940][52667] Sum rewards: 5.070, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.308', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.084', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.258', 'weapon3': '1.314', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:16,585][52670] DAMAGECOUNT value on done: 8540.0 [2024-08-05 22:30:16,587][52670] Sum rewards: 18.672, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.107', 'WEAPON3': '0.700', 'ARMOR': '0.859', 'HITCOUNT': '1.330', 'weapon2': '1.650', 'weapon3': '1.896', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '16.000'} [2024-08-05 22:30:16,637][52659] DAMAGECOUNT value on done: 7332.0 [2024-08-05 22:30:16,641][52659] Sum rewards: 5.122, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.984', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.246', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '0.878', 'weapon3': '1.346', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:17,328][52658] DAMAGECOUNT value on done: 7499.0 [2024-08-05 22:30:17,329][52658] Sum rewards: 4.882, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.040', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.296', 'HEALTH': '0.308', 'ARMOR': '0.509', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon2': '1.340', 'weapon3': '1.666', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:17,658][52649] DAMAGECOUNT value on done: 7331.0 [2024-08-05 22:30:17,661][52649] Sum rewards: 4.395, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'HITCOUNT': '0.790', 'WEAPON3': '1.100', 'ARMOR': '1.351', 'weapon2': '1.412', 'weapon3': '2.274', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16883.8). Total num frames: 66322432. Throughput: 0: 4217.5. Samples: 16581590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:30:17,795][52567] Avg episode reward: [(0, '7.354')] [2024-08-05 22:30:17,795][52666] DAMAGECOUNT value on done: 8125.0 [2024-08-05 22:30:17,802][52666] Sum rewards: 8.464, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.686', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.566', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.036', 'ARMOR': '1.477', 'weapon3': '1.896', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:18,142][52664] DAMAGECOUNT value on done: 7319.0 [2024-08-05 22:30:18,142][52664] Sum rewards: 9.042, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.550', 'AMMO2': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'weapon5': '0.084', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'ARMOR': '1.280', 'weapon2': '1.482', 'weapon3': '1.764', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:18,310][52671] DAMAGECOUNT value on done: 7994.0 [2024-08-05 22:30:18,311][52671] Sum rewards: 10.707, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.920', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO3': '0.135', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon2': '1.432', 'weapon3': '1.824', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '11.000'} [2024-08-05 22:30:19,262][52667] DAMAGECOUNT value on done: 8464.0 [2024-08-05 22:30:19,263][52667] Sum rewards: 1.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.152', 'weapon4': '0.352', 'WEAPON4': '0.400', 'HITCOUNT': '0.510', 'ARMOR': '0.589', 'WEAPON3': '0.850', 'weapon2': '0.902', 'DAMAGECOUNT': '1.698', 'weapon3': '2.048', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:19,618][52650] Updated weights for policy 0, policy_version 8101 (0.0012) [2024-08-05 22:30:19,933][52670] DAMAGECOUNT value on done: 7816.0 [2024-08-05 22:30:19,934][52670] Sum rewards: 7.527, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.770', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.356', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'ARMOR': '0.916', 'weapon2': '1.216', 'weapon3': '1.938', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:19,962][52659] DAMAGECOUNT value on done: 7704.0 [2024-08-05 22:30:19,962][52659] Sum rewards: 11.311, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.194', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.116', 'AMMO3': '0.138', 'ARMOR': '0.555', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.356', 'weapon3': '2.018', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:20,702][52649] DAMAGECOUNT value on done: 7992.0 [2024-08-05 22:30:20,702][52649] Sum rewards: 2.958, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.381', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.076', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.262', 'HITCOUNT': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.905', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.260', 'weapon2': '1.392', 'weapon3': '1.506'} [2024-08-05 22:30:20,764][52658] DAMAGECOUNT value on done: 8377.0 [2024-08-05 22:30:20,764][52658] Sum rewards: 6.501, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO2': '0.017', 'weapon4': '0.060', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'ARMOR': '0.400', 'HITCOUNT': '0.630', 'WEAPON3': '0.750', 'weapon2': '1.384', 'weapon3': '1.868', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:21,120][52664] DAMAGECOUNT value on done: 7427.0 [2024-08-05 22:30:21,120][52664] Sum rewards: 5.904, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.688', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.074', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'WEAPON3': '0.500', 'ARMOR': '0.557', 'weapon2': '0.594', 'weapon4': '0.682', 'weapon3': '1.526', 'DAMAGECOUNT': '1.677', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:21,296][52666] DAMAGECOUNT value on done: 8219.0 [2024-08-05 22:30:21,297][52666] Sum rewards: 11.768, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.840', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.278', 'WEAPON3': '0.550', 'HITCOUNT': '1.020', 'weapon2': '1.044', 'weapon3': '1.354', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:21,744][52671] DAMAGECOUNT value on done: 8927.0 [2024-08-05 22:30:21,745][52671] Sum rewards: 4.830, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.700', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.350', 'weapon4': '0.522', 'ARMOR': '0.548', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.286', 'weapon3': '1.716', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:22,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.6, 300 sec: 16883.8). Total num frames: 66404352. Throughput: 0: 4211.1. Samples: 16606990. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:30:22,803][52567] Avg episode reward: [(0, '7.290')] [2024-08-05 22:30:22,946][52659] DAMAGECOUNT value on done: 8752.0 [2024-08-05 22:30:22,948][52659] Sum rewards: 2.521, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.922', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.440', 'ARMOR': '0.536', 'HITCOUNT': '0.570', 'WEAPON3': '0.850', 'weapon2': '1.266', 'DAMAGECOUNT': '1.845', 'weapon3': '2.058', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:23,279][52649] DAMAGECOUNT value on done: 8558.0 [2024-08-05 22:30:23,282][52649] Sum rewards: 9.373, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.312', 'AMMO2': '0.021', 'AMMO3': '0.085', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'HITCOUNT': '0.470', 'weapon4': '0.572', 'WEAPON3': '0.600', 'weapon2': '1.108', 'weapon3': '1.606', 'DAMAGECOUNT': '1.680', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:23,413][52670] DAMAGECOUNT value on done: 7184.0 [2024-08-05 22:30:23,416][52670] Sum rewards: 5.535, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.578', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'ARMOR': '0.068', 'AMMO3': '0.088', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.410', 'weapon4': '0.460', 'WEAPON3': '0.600', 'weapon2': '1.200', 'weapon3': '1.492', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:24,176][52658] DAMAGECOUNT value on done: 8368.0 [2024-08-05 22:30:24,176][52658] Sum rewards: 5.155, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.012', 'weapon7': '0.056', 'AMMO4': '0.061', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.108', 'AMMO3': '0.168', 'weapon4': '0.276', 'ARMOR': '0.555', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.248', 'DAMAGECOUNT': '2.067', 'weapon3': '2.074', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:24,203][52664] DAMAGECOUNT value on done: 7818.0 [2024-08-05 22:30:24,204][52664] Sum rewards: 9.265, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.691', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.324', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.134', 'weapon3': '1.770', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:24,348][52671] DAMAGECOUNT value on done: 8742.0 [2024-08-05 22:30:24,349][52671] Sum rewards: 12.539, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.564', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '1.180', 'weapon2': '1.396', 'weapon3': '1.920', 'DAMAGECOUNT': '4.281', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:24,620][52666] DAMAGECOUNT value on done: 8131.0 [2024-08-05 22:30:24,620][52666] Sum rewards: 6.498, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.195', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.322', 'HITCOUNT': '0.490', 'ARMOR': '0.516', 'WEAPON3': '0.700', 'weapon2': '1.526', 'weapon3': '1.678', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:24,746][52650] Updated weights for policy 0, policy_version 8111 (0.0025) [2024-08-05 22:30:25,664][52659] DAMAGECOUNT value on done: 7069.0 [2024-08-05 22:30:25,668][52659] Sum rewards: 5.526, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.416', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon4': '0.114', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'ARMOR': '0.832', 'weapon2': '1.322', 'weapon3': '1.892', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:26,464][52649] DAMAGECOUNT value on done: 7507.0 [2024-08-05 22:30:26,466][52649] Sum rewards: 8.124, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.152', 'HEALTH': '0.222', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.198', 'weapon3': '2.092', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:26,755][52670] DAMAGECOUNT value on done: 7243.0 [2024-08-05 22:30:26,755][52670] Sum rewards: 12.159, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.800', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.238', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.234', 'weapon3': '1.586', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:26,761][52664] DAMAGECOUNT value on done: 7351.0 [2024-08-05 22:30:26,761][52664] Sum rewards: 1.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.116', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'weapon2': '1.348', 'ARMOR': '1.397', 'weapon3': '2.278', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:27,046][52671] DAMAGECOUNT value on done: 8422.0 [2024-08-05 22:30:27,046][52671] Sum rewards: 22.709, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.001', 'AMMO4': '0.005', 'HEALTH': '0.046', 'AMMO3': '0.080', 'WEAPON3': '0.550', 'ARMOR': '0.858', 'HITCOUNT': '1.270', 'weapon2': '1.636', 'weapon3': '1.680', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '17.000'} [2024-08-05 22:30:27,107][52658] DAMAGECOUNT value on done: 9360.0 [2024-08-05 22:30:27,111][52658] Sum rewards: 2.749, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.720', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.448', 'HITCOUNT': '0.510', 'ARMOR': '0.534', 'WEAPON3': '0.750', 'weapon2': '0.968', 'DAMAGECOUNT': '1.557', 'weapon3': '1.702', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 16911.6). Total num frames: 66494464. Throughput: 0: 4212.0. Samples: 16632240. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:30:27,794][52567] Avg episode reward: [(0, '7.333')] [2024-08-05 22:30:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008117_66494464.pth... [2024-08-05 22:30:27,958][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007622_62439424.pth [2024-08-05 22:30:27,967][52666] DAMAGECOUNT value on done: 7386.0 [2024-08-05 22:30:27,968][52666] Sum rewards: 3.945, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.584', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.012', 'weapon5': '0.092', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.252', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.903', 'weapon2': '1.286', 'weapon3': '1.600', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:28,766][52659] DAMAGECOUNT value on done: 8086.0 [2024-08-05 22:30:28,768][52659] Sum rewards: 8.748, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.576', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'weapon5': '0.080', 'AMMO3': '0.119', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'ARMOR': '0.934', 'weapon2': '1.268', 'weapon3': '2.090', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:29,414][52650] Updated weights for policy 0, policy_version 8121 (0.0023) [2024-08-05 22:30:29,528][52664] DAMAGECOUNT value on done: 8889.0 [2024-08-05 22:30:29,529][52664] Sum rewards: 10.141, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.411', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.250', 'WEAPON3': '0.600', 'weapon2': '0.914', 'HITCOUNT': '1.030', 'weapon3': '1.828', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:29,705][52649] DAMAGECOUNT value on done: 9156.0 [2024-08-05 22:30:29,707][52649] Sum rewards: 8.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.778', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.166', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '0.994', 'weapon2': '1.262', 'weapon3': '1.316', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:29,833][52670] DAMAGECOUNT value on done: 7366.0 [2024-08-05 22:30:29,833][52670] Sum rewards: 9.566, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.392', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.282', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'ARMOR': '0.967', 'weapon2': '1.154', 'weapon3': '1.742', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:30,380][52658] DAMAGECOUNT value on done: 8639.0 [2024-08-05 22:30:30,382][52658] Sum rewards: 2.983, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.098', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.308', 'HITCOUNT': '0.500', 'WEAPON3': '0.850', 'ARMOR': '1.040', 'weapon2': '1.402', 'DAMAGECOUNT': '1.470', 'weapon3': '1.698', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:30,453][52671] DAMAGECOUNT value on done: 9314.0 [2024-08-05 22:30:30,453][52671] Sum rewards: 2.209, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.224', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.070', 'weapon4': '0.102', 'WEAPON4': '0.200', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'ARMOR': '0.903', 'weapon3': '1.210', 'DAMAGECOUNT': '1.491', 'weapon2': '1.588', 'FRAGCOUNT': '2.000'} [2024-08-05 22:30:31,042][52666] DAMAGECOUNT value on done: 7179.0 [2024-08-05 22:30:31,043][52666] Sum rewards: 3.552, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.498', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.016', 'weapon4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'ARMOR': '0.964', 'weapon2': '1.106', 'weapon3': '2.254', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:31,818][52659] DAMAGECOUNT value on done: 9222.0 [2024-08-05 22:30:31,818][52659] Sum rewards: 8.147, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.074', 'AMMO3': '0.098', 'weapon4': '0.108', 'WEAPON5': '0.250', 'HEALTH': '0.292', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '1.044', 'weapon3': '1.942', 'DAMAGECOUNT': '2.628', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:32,431][52664] DAMAGECOUNT value on done: 7152.0 [2024-08-05 22:30:32,433][52664] Sum rewards: 8.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.642', 'AMMO2': '0.037', 'ARMOR': '0.068', 'AMMO3': '0.120', 'weapon4': '0.150', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.100', 'weapon3': '1.960', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:32,794][52567] Fps is (10 sec: 18022.8, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 66584576. Throughput: 0: 4204.9. Samples: 16644700. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:30:32,794][52567] Avg episode reward: [(0, '7.360')] [2024-08-05 22:30:32,860][52649] DAMAGECOUNT value on done: 7791.0 [2024-08-05 22:30:32,861][52649] Sum rewards: 8.422, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'weapon5': '0.026', 'weapon4': '0.076', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'ARMOR': '0.479', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.312', 'weapon3': '1.442', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:33,052][52670] DAMAGECOUNT value on done: 8550.0 [2024-08-05 22:30:33,055][52670] Sum rewards: 6.223, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.169', 'AMMO2': '0.024', 'weapon4': '0.034', 'ARMOR': '0.054', 'AMMO3': '0.093', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '1.468', 'weapon3': '1.630', 'DAMAGECOUNT': '2.421', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:33,066][52671] DAMAGECOUNT value on done: 9958.0 [2024-08-05 22:30:33,067][52671] Sum rewards: 11.818, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.377', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.208', 'WEAPON3': '1.100', 'HITCOUNT': '1.170', 'weapon2': '1.590', 'ARMOR': '1.702', 'weapon3': '1.836', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '12.000'} [2024-08-05 22:30:33,367][52658] DAMAGECOUNT value on done: 8528.0 [2024-08-05 22:30:33,369][52658] Sum rewards: 2.704, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.095', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.044', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'ARMOR': '0.484', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.398', 'weapon3': '1.786', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:34,070][52666] DAMAGECOUNT value on done: 6850.0 [2024-08-05 22:30:34,070][52666] Sum rewards: 1.370, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'HITCOUNT': '0.420', 'weapon4': '0.520', 'weapon2': '0.820', 'ARMOR': '0.893', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.572', 'weapon3': '2.440', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:34,265][52659] DAMAGECOUNT value on done: 9159.0 [2024-08-05 22:30:34,266][52659] Sum rewards: 6.143, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.914', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'ARMOR': '0.465', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.298', 'weapon2': '1.578', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:34,671][52650] Updated weights for policy 0, policy_version 8131 (0.0012) [2024-08-05 22:30:35,491][52664] DAMAGECOUNT value on done: 7970.0 [2024-08-05 22:30:35,491][52664] Sum rewards: 6.960, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.385', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.266', 'ARMOR': '0.471', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.480', 'weapon3': '1.794', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:35,641][52671] DAMAGECOUNT value on done: 7591.0 [2024-08-05 22:30:35,641][52671] Sum rewards: 7.205, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.120', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'AMMO3': '0.063', 'ARMOR': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon5': '0.324', 'weapon4': '0.542', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '0.792', 'weapon3': '1.294', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:36,050][52670] DAMAGECOUNT value on done: 9393.0 [2024-08-05 22:30:36,054][52670] Sum rewards: 14.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.315', 'AMMO4': '-0.084', 'AMMO2': '-0.017', 'AMMO3': '0.142', 'ARMOR': '0.459', 'WEAPON3': '1.050', 'HITCOUNT': '1.080', 'weapon2': '1.344', 'weapon3': '2.082', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '15.000'} [2024-08-05 22:30:36,099][52649] DAMAGECOUNT value on done: 9169.0 [2024-08-05 22:30:36,099][52649] Sum rewards: 9.254, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.025', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'ARMOR': '1.284', 'weapon2': '1.298', 'weapon3': '1.852', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:36,457][52658] DAMAGECOUNT value on done: 8362.0 [2024-08-05 22:30:36,458][52658] Sum rewards: 10.432, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.066', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.328', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'weapon2': '1.354', 'weapon3': '1.476', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '6.500'} [2024-08-05 22:30:36,868][52659] DAMAGECOUNT value on done: 8346.0 [2024-08-05 22:30:36,869][52659] Sum rewards: 8.818, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.020', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.160', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'ARMOR': '0.935', 'weapon2': '1.182', 'weapon3': '1.446', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:37,286][52666] DAMAGECOUNT value on done: 7302.0 [2024-08-05 22:30:37,288][52666] Sum rewards: 12.671, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.206', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.574', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'ARMOR': '0.917', 'weapon2': '1.276', 'weapon3': '1.542', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 16911.6). Total num frames: 66658304. Throughput: 0: 4214.3. Samples: 16670180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:30:37,794][52567] Avg episode reward: [(0, '7.495')] [2024-08-05 22:30:38,009][52664] DAMAGECOUNT value on done: 7886.0 [2024-08-05 22:30:38,009][52664] Sum rewards: 7.493, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.072', 'HEALTH': '0.078', 'AMMO3': '0.112', 'ARMOR': '0.473', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '1.482', 'weapon3': '1.828', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:38,028][52671] DAMAGECOUNT value on done: 8092.0 [2024-08-05 22:30:38,028][52671] Sum rewards: 5.314, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.126', 'weapon3': '1.678', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:39,278][52650] Updated weights for policy 0, policy_version 8141 (0.0022) [2024-08-05 22:30:39,348][52670] DAMAGECOUNT value on done: 8331.0 [2024-08-05 22:30:39,348][52670] Sum rewards: 9.166, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.248', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon4': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'ARMOR': '0.840', 'WEAPON3': '0.950', 'HITCOUNT': '1.080', 'weapon2': '1.312', 'weapon3': '2.482', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:39,357][52659] DAMAGECOUNT value on done: 8484.0 [2024-08-05 22:30:39,357][52659] Sum rewards: 8.830, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.322', 'AMMO2': '0.018', 'AMMO3': '0.089', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'ARMOR': '0.496', 'weapon4': '0.542', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '0.902', 'weapon3': '1.480', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:39,588][52658] DAMAGECOUNT value on done: 9060.0 [2024-08-05 22:30:39,588][52658] Sum rewards: 2.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.018', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'ARMOR': '0.497', 'weapon2': '0.786', 'HITCOUNT': '0.870', 'WEAPON3': '1.050', 'weapon3': '2.832', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:40,483][52668] DAMAGECOUNT value on done: 7759.0 [2024-08-05 22:30:40,484][52668] Sum rewards: 6.128, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.705', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.028', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.350', 'WEAPON3': '0.400', 'HITCOUNT': '0.820', 'weapon2': '1.188', 'weapon3': '1.202', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:40,506][52666] DAMAGECOUNT value on done: 7691.0 [2024-08-05 22:30:40,509][52666] Sum rewards: 4.226, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.112', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO4': '0.018', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO3': '0.122', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'ARMOR': '0.907', 'weapon2': '1.428', 'weapon3': '1.714', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:40,778][52671] DAMAGECOUNT value on done: 8134.0 [2024-08-05 22:30:40,779][52671] Sum rewards: 13.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.489', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.082', 'weapon4': '0.082', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.483', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.614', 'weapon3': '1.784', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '12.000'} [2024-08-05 22:30:41,111][52664] DAMAGECOUNT value on done: 7503.0 [2024-08-05 22:30:41,111][52664] Sum rewards: 6.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.730', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.274', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'ARMOR': '0.870', 'weapon2': '1.272', 'weapon3': '1.810', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:42,225][52659] DAMAGECOUNT value on done: 9380.0 [2024-08-05 22:30:42,225][52659] Sum rewards: 6.859, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.915', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.270', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'ARMOR': '0.890', 'weapon2': '1.316', 'weapon3': '1.584', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:42,547][52670] DAMAGECOUNT value on done: 8714.0 [2024-08-05 22:30:42,547][52670] Sum rewards: 4.702, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.014', 'HEALTH': '0.068', 'AMMO4': '0.068', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.286', 'HITCOUNT': '0.500', 'ARMOR': '0.521', 'WEAPON3': '0.550', 'weapon2': '1.268', 'weapon3': '1.708', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:42,683][52794] DAMAGECOUNT value on done: 9371.0 [2024-08-05 22:30:42,685][52794] Sum rewards: 6.604, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.573', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.394', 'ARMOR': '0.436', 'HITCOUNT': '0.640', 'WEAPON3': '0.750', 'weapon2': '1.420', 'weapon3': '1.846', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 66756608. Throughput: 0: 4215.4. Samples: 16695550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:30:42,794][52567] Avg episode reward: [(0, '7.342')] [2024-08-05 22:30:43,417][52664] DAMAGECOUNT value on done: 8711.0 [2024-08-05 22:30:43,417][52664] Sum rewards: 3.535, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.100', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.300', 'ARMOR': '0.540', 'HITCOUNT': '0.570', 'weapon2': '0.914', 'WEAPON3': '1.100', 'DAMAGECOUNT': '2.043', 'weapon3': '2.084', 'FRAGCOUNT': '8.000'} [2024-08-05 22:30:43,812][52666] DAMAGECOUNT value on done: 7536.0 [2024-08-05 22:30:43,812][52666] Sum rewards: 4.454, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.314', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'HITCOUNT': '0.530', 'WEAPON3': '0.700', 'ARMOR': '0.939', 'weapon2': '1.256', 'weapon3': '1.622', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:43,897][52668] DAMAGECOUNT value on done: 10021.0 [2024-08-05 22:30:43,898][52668] Sum rewards: 9.768, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.422', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'ARMOR': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon5': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '1.226', 'weapon3': '1.900', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:43,934][52671] DAMAGECOUNT value on done: 7704.0 [2024-08-05 22:30:43,934][52671] Sum rewards: 5.708, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.236', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'ARMOR': '0.485', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.860', 'weapon3': '1.906', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:44,212][52650] Updated weights for policy 0, policy_version 8151 (0.0038) [2024-08-05 22:30:45,056][52794] DAMAGECOUNT value on done: 9636.0 [2024-08-05 22:30:45,057][52794] Sum rewards: 9.656, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.005', 'AMMO4': '0.026', 'HEALTH': '0.041', 'AMMO3': '0.060', 'ARMOR': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.322', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'weapon2': '0.992', 'weapon3': '1.300', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:45,370][52659] DAMAGECOUNT value on done: 8862.0 [2024-08-05 22:30:45,371][52659] Sum rewards: 7.189, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.991', 'AMMO2': '0.022', 'AMMO3': '0.106', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon2': '0.400', 'HITCOUNT': '0.600', 'ARMOR': '0.624', 'weapon4': '0.682', 'WEAPON3': '0.700', 'weapon3': '1.622', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:45,882][52670] DAMAGECOUNT value on done: 8305.0 [2024-08-05 22:30:45,884][52670] Sum rewards: 16.729, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.220', 'AMMO2': '0.019', 'AMMO3': '0.071', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'weapon4': '0.582', 'HITCOUNT': '0.740', 'ARMOR': '0.978', 'weapon2': '1.334', 'weapon3': '1.672', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '12.000'} [2024-08-05 22:30:46,624][52671] DAMAGECOUNT value on done: 9677.0 [2024-08-05 22:30:46,625][52671] Sum rewards: 12.120, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.690', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO3': '0.165', 'ARMOR': '0.907', 'WEAPON3': '1.100', 'HITCOUNT': '1.120', 'weapon2': '1.538', 'weapon3': '2.160', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '12.000'} [2024-08-05 22:30:47,175][52666] DAMAGECOUNT value on done: 7672.0 [2024-08-05 22:30:47,177][52666] Sum rewards: 6.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.280', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'ARMOR': '0.527', 'HITCOUNT': '0.740', 'WEAPON3': '0.900', 'weapon2': '1.346', 'weapon3': '2.424', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:47,248][52668] DAMAGECOUNT value on done: 7052.0 [2024-08-05 22:30:47,249][52660] DAMAGECOUNT value on done: 8947.0 [2024-08-05 22:30:47,250][52668] Sum rewards: 11.319, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.024', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'HEALTH': '0.089', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.008', 'weapon3': '1.686', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:47,252][52660] Sum rewards: 4.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.012', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'HITCOUNT': '0.790', 'ARMOR': '0.894', 'WEAPON3': '1.150', 'weapon2': '1.328', 'weapon3': '2.190', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:47,528][52794] DAMAGECOUNT value on done: 10181.0 [2024-08-05 22:30:47,528][52794] Sum rewards: 8.851, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.734', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.312', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'ARMOR': '0.971', 'weapon2': '1.160', 'weapon3': '1.864', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:47,624][52662] DAMAGECOUNT value on done: 9061.0 [2024-08-05 22:30:47,624][52662] Sum rewards: 9.464, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.575', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.250', 'weapon5': '0.252', 'weapon4': '0.256', 'WEAPON3': '0.450', 'HITCOUNT': '0.540', 'ARMOR': '0.962', 'weapon2': '1.154', 'weapon3': '1.444', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16883.9). Total num frames: 66830336. Throughput: 0: 4222.2. Samples: 16708450. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 22:30:47,795][52567] Avg episode reward: [(0, '7.361')] [2024-08-05 22:30:48,052][52659] DAMAGECOUNT value on done: 9105.0 [2024-08-05 22:30:48,054][52659] Sum rewards: 4.575, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.508', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'weapon4': '0.160', 'ARMOR': '0.491', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '1.030', 'weapon3': '1.664', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:48,637][52650] Updated weights for policy 0, policy_version 8161 (0.0013) [2024-08-05 22:30:49,339][52670] DAMAGECOUNT value on done: 7669.0 [2024-08-05 22:30:49,340][52670] Sum rewards: 15.612, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.325', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.009', 'weapon5': '0.030', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'ARMOR': '0.446', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon2': '1.542', 'weapon3': '1.980', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '12.500'} [2024-08-05 22:30:49,420][52671] DAMAGECOUNT value on done: 8141.0 [2024-08-05 22:30:49,420][52671] Sum rewards: 5.126, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.922', 'AMMO2': '0.019', 'AMMO3': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.290', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'ARMOR': '0.963', 'weapon2': '1.380', 'weapon3': '2.136', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:50,204][52668] DAMAGECOUNT value on done: 6953.0 [2024-08-05 22:30:50,215][52668] Sum rewards: 12.166, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HEALTH': '0.088', 'weapon4': '0.238', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '1.370', 'weapon3': '1.646', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:50,219][52660] DAMAGECOUNT value on done: 10048.0 [2024-08-05 22:30:50,220][52660] Sum rewards: 10.947, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.463', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.128', 'ARMOR': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.272', 'weapon2': '0.698', 'WEAPON3': '0.950', 'HITCOUNT': '1.060', 'weapon3': '2.394', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '11.000'} [2024-08-05 22:30:50,396][52794] DAMAGECOUNT value on done: 9373.0 [2024-08-05 22:30:50,397][52794] Sum rewards: 7.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.318', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'weapon5': '0.184', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'ARMOR': '0.850', 'weapon2': '1.622', 'weapon3': '1.714', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:50,553][52662] DAMAGECOUNT value on done: 9762.0 [2024-08-05 22:30:50,554][52662] Sum rewards: 11.044, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.388', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.234', 'ARMOR': '0.501', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.810', 'weapon3': '1.918', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:50,593][52666] DAMAGECOUNT value on done: 6295.0 [2024-08-05 22:30:50,594][52666] Sum rewards: 3.316, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.104', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.048', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'HITCOUNT': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon5': '0.462', 'weapon4': '0.634', 'DAMAGECOUNT': '0.843', 'weapon2': '1.016', 'weapon3': '1.026', 'FRAGCOUNT': '2.000'} [2024-08-05 22:30:50,771][52659] DAMAGECOUNT value on done: 7619.0 [2024-08-05 22:30:50,771][52659] Sum rewards: 10.677, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HEALTH': '0.078', 'AMMO3': '0.080', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'weapon2': '1.392', 'weapon3': '1.716', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:52,256][52671] DAMAGECOUNT value on done: 8393.0 [2024-08-05 22:30:52,256][52671] Sum rewards: 8.708, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.523', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.020', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.226', 'WEAPON3': '0.400', 'ARMOR': '0.517', 'HITCOUNT': '0.840', 'weapon3': '1.038', 'weapon2': '1.168', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:52,789][52670] DAMAGECOUNT value on done: 7133.0 [2024-08-05 22:30:52,793][52670] Sum rewards: 5.928, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.222', 'HITCOUNT': '0.420', 'ARMOR': '0.487', 'WEAPON3': '0.700', 'weapon2': '0.990', 'DAMAGECOUNT': '1.422', 'weapon3': '1.778', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16931.1, 300 sec: 16939.4). Total num frames: 66920448. Throughput: 0: 4229.8. Samples: 16733940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:30:52,794][52567] Avg episode reward: [(0, '7.646')] [2024-08-05 22:30:52,799][52794] DAMAGECOUNT value on done: 9334.0 [2024-08-05 22:30:52,799][52794] Sum rewards: 6.381, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.060', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.052', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.250', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.130', 'weapon3': '1.442', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:53,074][52662] DAMAGECOUNT value on done: 10051.0 [2024-08-05 22:30:53,075][52662] Sum rewards: 7.252, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.106', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.320', 'ARMOR': '0.507', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.108', 'weapon3': '1.514', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:53,079][52668] DAMAGECOUNT value on done: 8391.0 [2024-08-05 22:30:53,081][52668] Sum rewards: 6.396, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.718', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon5': '0.110', 'ARMOR': '0.400', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.044', 'weapon3': '1.372', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:53,082][52660] DAMAGECOUNT value on done: 7489.0 [2024-08-05 22:30:53,086][52660] Sum rewards: 7.780, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.480', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.024', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'ARMOR': '0.118', 'AMMO4': '0.119', 'WEAPON4': '0.300', 'weapon4': '0.480', 'HITCOUNT': '0.490', 'WEAPON3': '0.500', 'weapon2': '1.016', 'weapon3': '1.272', 'DAMAGECOUNT': '1.503', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:53,623][52659] DAMAGECOUNT value on done: 8376.0 [2024-08-05 22:30:53,625][52659] Sum rewards: 11.854, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.335', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.070', 'WEAPON3': '0.500', 'ARMOR': '0.854', 'HITCOUNT': '0.860', 'weapon2': '1.628', 'weapon3': '1.628', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '9.000'} [2024-08-05 22:30:53,881][52650] Updated weights for policy 0, policy_version 8171 (0.0037) [2024-08-05 22:30:53,980][52666] DAMAGECOUNT value on done: 7606.0 [2024-08-05 22:30:53,982][52666] Sum rewards: 7.045, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.076', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.882', 'weapon2': '1.422', 'weapon3': '1.486', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:55,115][52794] DAMAGECOUNT value on done: 9829.0 [2024-08-05 22:30:55,115][52794] Sum rewards: 5.978, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.987', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.820', 'WEAPON3': '0.950', 'ARMOR': '0.969', 'weapon2': '1.436', 'weapon3': '1.982', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:55,344][52662] DAMAGECOUNT value on done: 8772.0 [2024-08-05 22:30:55,351][52662] Sum rewards: 17.415, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.418', 'AMMO4': '-0.078', 'AMMO2': '-0.016', 'AMMO3': '0.132', 'WEAPON3': '0.800', 'ARMOR': '1.357', 'HITCOUNT': '1.420', 'weapon2': '1.488', 'weapon3': '2.112', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '14.000'} [2024-08-05 22:30:55,958][52668] DAMAGECOUNT value on done: 8219.0 [2024-08-05 22:30:55,959][52668] Sum rewards: 3.654, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.068', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.240', 'ARMOR': '0.495', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '1.096', 'weapon3': '1.576', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:55,988][52660] DAMAGECOUNT value on done: 8159.0 [2024-08-05 22:30:55,989][52660] Sum rewards: 9.267, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.594', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon7': '0.006', 'ARMOR': '0.008', 'AMMO3': '0.140', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.730', 'WEAPON3': '0.900', 'weapon2': '1.280', 'weapon3': '2.132', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '10.000'} [2024-08-05 22:30:56,124][52670] DAMAGECOUNT value on done: 9035.0 [2024-08-05 22:30:56,126][52670] Sum rewards: 5.946, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.302', 'ARMOR': '1.340', 'weapon3': '1.624', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:56,785][52659] DAMAGECOUNT value on done: 6037.0 [2024-08-05 22:30:56,798][52659] Sum rewards: 3.901, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.188', 'AMMO2': '0.001', 'AMMO4': '0.007', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'HITCOUNT': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.540', 'weapon3': '1.316', 'DAMAGECOUNT': '1.353', 'weapon2': '1.374', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:57,300][52666] DAMAGECOUNT value on done: 9118.0 [2024-08-05 22:30:57,302][52666] Sum rewards: 6.252, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.696', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'ARMOR': '0.892', 'weapon2': '0.892', 'weapon3': '1.108', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'} [2024-08-05 22:30:57,566][52794] DAMAGECOUNT value on done: 9065.0 [2024-08-05 22:30:57,568][52794] Sum rewards: 4.516, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.794', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.250', 'ARMOR': '0.492', 'HITCOUNT': '0.680', 'WEAPON3': '1.000', 'weapon2': '1.610', 'weapon3': '1.930', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '7.000'} [2024-08-05 22:30:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 67010560. Throughput: 0: 4224.0. Samples: 16759060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:30:57,794][52567] Avg episode reward: [(0, '7.629')] [2024-08-05 22:30:57,875][52662] DAMAGECOUNT value on done: 9613.0 [2024-08-05 22:30:57,875][52662] Sum rewards: 7.043, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'HEALTH': '0.308', 'weapon4': '0.444', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.086', 'weapon3': '1.772', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '6.000'} [2024-08-05 22:30:58,365][52650] Updated weights for policy 0, policy_version 8181 (0.0021) [2024-08-05 22:30:59,054][52668] DAMAGECOUNT value on done: 9721.0 [2024-08-05 22:30:59,056][52668] Sum rewards: 7.597, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.144', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.075', 'weapon4': '0.298', 'ARMOR': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '1.064', 'weapon2': '1.268', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '5.000'} [2024-08-05 22:30:59,080][52660] DAMAGECOUNT value on done: 7106.0 [2024-08-05 22:30:59,082][52660] Sum rewards: 0.757, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO2': '0.023', 'ARMOR': '0.092', 'AMMO4': '0.113', 'AMMO3': '0.124', 'weapon4': '0.246', 'WEAPON4': '0.250', 'HITCOUNT': '0.470', 'WEAPON3': '0.850', 'weapon2': '1.320', 'DAMAGECOUNT': '1.545', 'weapon3': '1.894', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:59,476][52659] DAMAGECOUNT value on done: 7947.0 [2024-08-05 22:30:59,479][52659] Sum rewards: -0.046, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.538', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.020', 'weapon7': '0.052', 'AMMO4': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.474', 'weapon4': '0.480', 'HITCOUNT': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.260', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '3.000'} [2024-08-05 22:30:59,477][52670] DAMAGECOUNT value on done: 8210.0 [2024-08-05 22:30:59,479][52670] Sum rewards: 6.559, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.358', 'AMMO2': '0.012', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.074', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '1.308', 'weapon3': '1.586', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:00,052][52794] DAMAGECOUNT value on done: 8266.0 [2024-08-05 22:31:00,053][52794] Sum rewards: 14.108, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.611', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon7': '0.016', 'weapon5': '0.016', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.408', 'WEAPON3': '0.600', 'ARMOR': '1.017', 'HITCOUNT': '1.070', 'weapon2': '1.132', 'weapon3': '1.658', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '10.000'} [2024-08-05 22:31:00,372][52662] DAMAGECOUNT value on done: 10620.0 [2024-08-05 22:31:00,380][52662] Sum rewards: 2.633, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.281', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.168', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.889', 'weapon2': '1.244', 'weapon3': '1.366', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:00,686][52666] DAMAGECOUNT value on done: 8215.0 [2024-08-05 22:31:00,689][52666] Sum rewards: 4.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.356', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.128', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'ARMOR': '0.853', 'weapon3': '1.654', 'weapon2': '1.874', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:02,103][52668] DAMAGECOUNT value on done: 7574.0 [2024-08-05 22:31:02,104][52668] Sum rewards: 8.029, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.238', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.116', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'ARMOR': '1.240', 'weapon3': '1.576', 'weapon2': '1.768', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '6.500'} [2024-08-05 22:31:02,171][52660] DAMAGECOUNT value on done: 9451.0 [2024-08-05 22:31:02,173][52660] Sum rewards: 6.127, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.217', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon7': '0.074', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.262', 'HITCOUNT': '0.510', 'ARMOR': '0.523', 'WEAPON3': '0.650', 'weapon2': '1.072', 'weapon3': '1.488', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:02,611][52670] DAMAGECOUNT value on done: 8072.0 [2024-08-05 22:31:02,611][52670] Sum rewards: 4.719, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.220', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.204', 'ARMOR': '0.465', 'HITCOUNT': '0.610', 'weapon2': '0.862', 'WEAPON3': '1.000', 'DAMAGECOUNT': '1.878', 'weapon3': '2.476', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 67092480. Throughput: 0: 4228.2. Samples: 16771860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:31:02,794][52567] Avg episode reward: [(0, '7.520')] [2024-08-05 22:31:02,966][52794] DAMAGECOUNT value on done: 11169.0 [2024-08-05 22:31:02,966][52794] Sum rewards: 9.523, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.840', 'AMMO2': '0.015', 'ARMOR': '0.056', 'AMMO4': '0.072', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.262', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.070', 'weapon3': '2.044', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '10.000'} [2024-08-05 22:31:03,120][52650] Updated weights for policy 0, policy_version 8191 (0.0012) [2024-08-05 22:31:03,389][52662] DAMAGECOUNT value on done: 9954.0 [2024-08-05 22:31:03,390][52662] Sum rewards: 6.202, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.688', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.016', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.476', 'ARMOR': '0.572', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '0.878', 'weapon3': '2.158', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:05,482][52794] DAMAGECOUNT value on done: 9116.0 [2024-08-05 22:31:05,490][52794] Sum rewards: 6.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.578', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.070', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.998', 'weapon2': '1.304', 'weapon3': '1.508', 'DAMAGECOUNT': '1.617', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:05,554][52668] DAMAGECOUNT value on done: 8977.0 [2024-08-05 22:31:05,555][52668] Sum rewards: 6.514, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.062', 'weapon4': '0.094', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.468', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.240', 'weapon3': '1.944', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:05,610][52660] DAMAGECOUNT value on done: 8298.0 [2024-08-05 22:31:05,610][52660] Sum rewards: 15.848, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.268', 'AMMO2': '0.012', 'AMMO3': '0.052', 'AMMO4': '0.060', 'ARMOR': '0.064', 'WEAPON4': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.400', 'HITCOUNT': '0.800', 'weapon2': '1.034', 'weapon3': '1.154', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '12.000'} [2024-08-05 22:31:05,965][52662] DAMAGECOUNT value on done: 10467.0 [2024-08-05 22:31:05,965][52662] Sum rewards: 6.004, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.296', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.212', 'weapon4': '0.216', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.488', 'weapon3': '1.594', 'ARMOR': '1.726', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '3.222'} [2024-08-05 22:31:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 67174400. Throughput: 0: 4229.1. Samples: 16797300. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 22:31:07,794][52567] Avg episode reward: [(0, '7.631')] [2024-08-05 22:31:08,007][52650] Updated weights for policy 0, policy_version 8201 (0.0026) [2024-08-05 22:31:08,282][52794] DAMAGECOUNT value on done: 9780.0 [2024-08-05 22:31:08,283][52794] Sum rewards: 11.939, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'weapon5': '0.122', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.290', 'HEALTH': '0.408', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'HITCOUNT': '0.940', 'weapon2': '1.030', 'weapon3': '1.760', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:08,649][52668] DAMAGECOUNT value on done: 9855.0 [2024-08-05 22:31:08,651][52668] Sum rewards: 8.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.453', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO4': '0.096', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.330', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'ARMOR': '1.297', 'weapon2': '1.416', 'weapon3': '1.844', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:08,704][52660] DAMAGECOUNT value on done: 8559.0 [2024-08-05 22:31:08,709][52660] Sum rewards: 3.275, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.325', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon4': '0.202', 'HITCOUNT': '0.870', 'weapon2': '1.046', 'WEAPON3': '1.150', 'ARMOR': '1.380', 'weapon3': '2.336', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:08,844][52662] DAMAGECOUNT value on done: 10141.0 [2024-08-05 22:31:08,844][52662] Sum rewards: 6.684, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.462', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon4': '0.202', 'WEAPON3': '0.800', 'ARMOR': '0.900', 'HITCOUNT': '1.250', 'weapon2': '1.470', 'weapon3': '1.520', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:11,290][52794] DAMAGECOUNT value on done: 9619.0 [2024-08-05 22:31:11,298][52794] Sum rewards: 3.877, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.880', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.226', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.536', 'weapon3': '0.944', 'weapon2': '1.202', 'DAMAGECOUNT': '1.356', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:11,623][52668] DAMAGECOUNT value on done: 7589.0 [2024-08-05 22:31:11,627][52668] Sum rewards: 9.449, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.838', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.104', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.476', 'weapon3': '1.590', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:11,666][52660] DAMAGECOUNT value on done: 8790.0 [2024-08-05 22:31:11,668][52660] Sum rewards: 9.192, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.802', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.076', 'AMMO3': '0.130', 'WEAPON3': '0.850', 'HITCOUNT': '0.980', 'weapon2': '1.444', 'weapon3': '2.336', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:11,726][52662] DAMAGECOUNT value on done: 10256.0 [2024-08-05 22:31:11,726][52662] Sum rewards: 12.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.375', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.085', 'weapon5': '0.110', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.508', 'weapon3': '1.752', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '10.500'} [2024-08-05 22:31:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16939.7). Total num frames: 67256320. Throughput: 0: 4234.2. Samples: 16822780. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 22:31:12,794][52567] Avg episode reward: [(0, '7.680')] [2024-08-05 22:31:13,085][52650] Updated weights for policy 0, policy_version 8211 (0.0038) [2024-08-05 22:31:13,787][52803] DAMAGECOUNT value on done: 8331.0 [2024-08-05 22:31:13,790][52803] Sum rewards: 8.105, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.084', 'HEALTH': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'ARMOR': '0.922', 'weapon3': '1.140', 'weapon2': '1.686', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:13,810][52794] DAMAGECOUNT value on done: 9406.0 [2024-08-05 22:31:13,811][52794] Sum rewards: 7.311, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.591', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.192', 'ARMOR': '0.494', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '1.312', 'weapon3': '1.822', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:14,177][52668] DAMAGECOUNT value on done: 8000.0 [2024-08-05 22:31:14,178][52668] Sum rewards: 3.880, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.654', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'WEAPON5': '0.150', 'weapon5': '0.154', 'weapon4': '0.352', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'weapon2': '0.952', 'weapon3': '0.986', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:14,193][52662] DAMAGECOUNT value on done: 9495.0 [2024-08-05 22:31:14,193][52662] Sum rewards: 7.686, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.717', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.364', 'ARMOR': '0.910', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon2': '1.512', 'weapon3': '1.894', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:14,198][52660] DAMAGECOUNT value on done: 8375.0 [2024-08-05 22:31:14,198][52660] Sum rewards: 5.776, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.904', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.024', 'weapon4': '0.030', 'AMMO4': '0.063', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'ARMOR': '0.540', 'HITCOUNT': '0.900', 'WEAPON3': '1.000', 'weapon2': '1.160', 'weapon3': '2.334', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:16,220][52794] DAMAGECOUNT value on done: 11472.0 [2024-08-05 22:31:16,221][52794] Sum rewards: 10.355, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.302', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON3': '0.550', 'ARMOR': '0.851', 'HITCOUNT': '0.980', 'weapon2': '1.448', 'weapon3': '1.560', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:16,764][52662] DAMAGECOUNT value on done: 9126.0 [2024-08-05 22:31:16,764][52662] Sum rewards: 11.256, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.405', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.075', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.990', 'weapon3': '1.182', 'weapon2': '1.316', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '10.000'} [2024-08-05 22:31:17,066][52803] DAMAGECOUNT value on done: 9552.0 [2024-08-05 22:31:17,066][52803] Sum rewards: 11.018, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.239', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.058', 'AMMO3': '0.089', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.496', 'WEAPON3': '0.600', 'weapon4': '0.712', 'HITCOUNT': '0.920', 'weapon2': '1.170', 'weapon3': '1.722', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:17,789][52668] DAMAGECOUNT value on done: 7649.0 [2024-08-05 22:31:17,792][52668] Sum rewards: 5.866, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.262', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.044', 'AMMO3': '0.074', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.678', 'HITCOUNT': '0.700', 'weapon2': '0.868', 'weapon3': '1.060', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16930.2, 300 sec: 16911.6). Total num frames: 67338240. Throughput: 0: 4238.7. Samples: 16835440. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 22:31:17,795][52567] Avg episode reward: [(0, '7.638')] [2024-08-05 22:31:17,848][52650] Updated weights for policy 0, policy_version 8221 (0.0013) [2024-08-05 22:31:17,899][52660] DAMAGECOUNT value on done: 8656.0 [2024-08-05 22:31:17,899][52660] Sum rewards: 4.749, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.986', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.156', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.860', 'weapon2': '1.288', 'weapon3': '1.758', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:19,018][52794] DAMAGECOUNT value on done: 9845.0 [2024-08-05 22:31:19,018][52794] Sum rewards: 2.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.636', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.123', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.524', 'HITCOUNT': '0.740', 'weapon2': '0.886', 'WEAPON3': '0.900', 'ARMOR': '0.930', 'weapon3': '1.844', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '3.000'} [2024-08-05 22:31:19,440][52662] DAMAGECOUNT value on done: 10238.0 [2024-08-05 22:31:19,440][52662] Sum rewards: 6.043, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.699', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.129', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.316', 'WEAPON4': '0.400', 'ARMOR': '0.488', 'HITCOUNT': '0.830', 'weapon2': '0.888', 'WEAPON3': '1.200', 'weapon3': '2.370', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:20,354][52803] DAMAGECOUNT value on done: 8405.0 [2024-08-05 22:31:20,360][52803] Sum rewards: 13.208, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.598', 'AMMO2': '0.007', 'AMMO5': '0.008', 'AMMO4': '0.037', 'weapon5': '0.062', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.210', 'WEAPON3': '0.700', 'ARMOR': '0.904', 'HITCOUNT': '1.030', 'weapon2': '1.364', 'weapon3': '1.884', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '10.000'} [2024-08-05 22:31:20,833][52668] DAMAGECOUNT value on done: 8796.0 [2024-08-05 22:31:20,833][52668] Sum rewards: 6.474, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.596', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.060', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.650', 'ARMOR': '0.895', 'weapon3': '1.426', 'weapon2': '1.666', 'DAMAGECOUNT': '2.097', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:21,029][52660] DAMAGECOUNT value on done: 7433.0 [2024-08-05 22:31:21,035][52660] Sum rewards: 6.361, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.073', 'HEALTH': '0.082', 'weapon4': '0.180', 'ARMOR': '0.471', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '1.346', 'weapon3': '1.606', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:21,523][52794] DAMAGECOUNT value on done: 10798.0 [2024-08-05 22:31:21,523][52794] Sum rewards: 13.565, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.895', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.334', 'ARMOR': '0.448', 'weapon2': '0.938', 'HITCOUNT': '0.960', 'WEAPON3': '1.000', 'weapon3': '2.408', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '14.000'} [2024-08-05 22:31:22,055][52662] DAMAGECOUNT value on done: 10167.0 [2024-08-05 22:31:22,065][52662] Sum rewards: 6.464, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.338', 'AMMO2': '0.002', 'weapon5': '0.008', 'AMMO4': '0.009', 'AMMO5': '0.010', 'AMMO3': '0.071', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HITCOUNT': '0.540', 'ARMOR': '0.608', 'weapon4': '0.614', 'WEAPON3': '0.650', 'weapon2': '0.828', 'weapon3': '1.660', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:22,610][52650] Updated weights for policy 0, policy_version 8231 (0.0013) [2024-08-05 22:31:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 67428352. Throughput: 0: 4237.6. Samples: 16860870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:31:22,794][52567] Avg episode reward: [(0, '7.762')] [2024-08-05 22:31:23,460][52668] DAMAGECOUNT value on done: 7456.0 [2024-08-05 22:31:23,463][52668] Sum rewards: 3.437, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.798', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.938', 'DAMAGECOUNT': '1.281', 'weapon2': '1.418', 'weapon3': '1.606', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:23,524][52811] DAMAGECOUNT value on done: 8334.0 [2024-08-05 22:31:23,525][52811] Sum rewards: 4.460, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.662', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon7': '0.060', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.400', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon3': '1.330', 'DAMAGECOUNT': '1.905', 'weapon2': '2.056', 'FRAGCOUNT': '3.000'} [2024-08-05 22:31:23,559][52660] DAMAGECOUNT value on done: 8124.0 [2024-08-05 22:31:23,560][52660] Sum rewards: 6.643, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.276', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.024', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.316', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon2': '1.366', 'weapon3': '1.554', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:23,712][52803] DAMAGECOUNT value on done: 8673.0 [2024-08-05 22:31:23,713][52803] Sum rewards: 13.160, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.090', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.155', 'WEAPON3': '0.950', 'HITCOUNT': '0.980', 'ARMOR': '1.324', 'weapon2': '1.848', 'weapon3': '2.010', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '12.000'} [2024-08-05 22:31:24,148][52794] DAMAGECOUNT value on done: 11294.0 [2024-08-05 22:31:24,150][52794] Sum rewards: 14.314, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.170', 'WEAPON3': '0.500', 'ARMOR': '0.989', 'HITCOUNT': '0.990', 'weapon3': '1.516', 'weapon2': '1.986', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '10.000'} [2024-08-05 22:31:24,551][52662] DAMAGECOUNT value on done: 9164.0 [2024-08-05 22:31:24,551][52662] Sum rewards: 3.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'ARMOR': '0.080', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.350', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon4': '0.766', 'weapon2': '0.932', 'weapon3': '1.358', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:25,132][52667] Large shaping reward -2.593 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('AMMO2', 0.01, 50.0), ('WEAPON4', -0.05, -1.0), ('AMMO4', 0.05, 50.0), ('WEAPON5', -0.05, -1.0), ('AMMO5', -0.0025, -5.0), ('AMMO6', -0.1, -100.0), ('WEAPON7', -0.1, -1.0), ('AMMO7', -0.1, -100.0)] [2024-08-05 22:31:26,432][52794] DAMAGECOUNT value on done: 9954.0 [2024-08-05 22:31:26,433][52794] Sum rewards: 13.738, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.922', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.108', 'WEAPON3': '0.750', 'ARMOR': '0.879', 'HITCOUNT': '1.170', 'weapon2': '1.468', 'weapon3': '2.020', 'DAMAGECOUNT': '3.786', 'FRAGCOUNT': '12.000'} [2024-08-05 22:31:26,453][52668] DAMAGECOUNT value on done: 8034.0 [2024-08-05 22:31:26,455][52668] Sum rewards: 9.400, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.883', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO3': '0.060', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '1.302', 'weapon3': '1.418', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:26,569][52660] DAMAGECOUNT value on done: 8304.0 [2024-08-05 22:31:26,570][52660] Sum rewards: 5.638, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.156', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.254', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'ARMOR': '0.862', 'weapon2': '1.118', 'weapon3': '1.396', 'DAMAGECOUNT': '1.968', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:26,799][52811] DAMAGECOUNT value on done: 8445.0 [2024-08-05 22:31:26,800][52811] Sum rewards: 5.905, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.168', 'HITCOUNT': '0.540', 'WEAPON3': '0.650', 'weapon3': '1.206', 'ARMOR': '1.380', 'DAMAGECOUNT': '1.530', 'weapon2': '1.858', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:26,822][52662] DAMAGECOUNT value on done: 10452.0 [2024-08-05 22:31:26,822][52662] Sum rewards: 2.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.291', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'ARMOR': '0.895', 'HITCOUNT': '0.990', 'WEAPON3': '1.000', 'weapon2': '1.696', 'weapon3': '1.914', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:27,131][52803] DAMAGECOUNT value on done: 9451.0 [2024-08-05 22:31:27,139][52803] Sum rewards: 6.460, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO2': '0.017', 'AMMO3': '0.080', 'ARMOR': '0.081', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon3': '1.446', 'weapon2': '1.588', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:27,503][52650] Updated weights for policy 0, policy_version 8241 (0.0021) [2024-08-05 22:31:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.1, 300 sec: 16911.6). Total num frames: 67510272. Throughput: 0: 4245.6. Samples: 16886600. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:31:27,794][52567] Avg episode reward: [(0, '7.593')] [2024-08-05 22:31:28,967][52794] DAMAGECOUNT value on done: 9962.0 [2024-08-05 22:31:28,967][52794] Sum rewards: 4.785, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.387', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.055', 'weapon4': '0.222', 'WEAPON3': '0.350', 'HITCOUNT': '0.430', 'ARMOR': '0.485', 'weapon3': '0.934', 'weapon2': '1.038', 'DAMAGECOUNT': '1.305', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:29,346][52662] DAMAGECOUNT value on done: 9441.0 [2024-08-05 22:31:29,347][52662] Sum rewards: 5.761, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.706', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon7': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.434', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'ARMOR': '0.918', 'weapon2': '0.948', 'weapon3': '1.940', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:29,712][52668] DAMAGECOUNT value on done: 8661.0 [2024-08-05 22:31:29,716][52668] Sum rewards: 8.987, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.405', 'AMMO2': '0.014', 'AMMO3': '0.060', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.334', 'WEAPON3': '0.450', 'HITCOUNT': '0.670', 'ARMOR': '0.855', 'weapon2': '1.480', 'weapon3': '1.534', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:29,907][52660] DAMAGECOUNT value on done: 9005.0 [2024-08-05 22:31:29,908][52660] Sum rewards: 15.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.693', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'weapon4': '0.308', 'ARMOR': '0.436', 'WEAPON3': '0.750', 'HITCOUNT': '1.120', 'weapon2': '1.376', 'weapon3': '1.684', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '13.000'} [2024-08-05 22:31:30,133][52811] DAMAGECOUNT value on done: 8290.0 [2024-08-05 22:31:30,133][52811] Sum rewards: 12.988, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.134', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'ARMOR': '0.416', 'weapon4': '0.442', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon2': '1.094', 'weapon3': '1.782', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '10.000'} [2024-08-05 22:31:30,607][52803] DAMAGECOUNT value on done: 8137.0 [2024-08-05 22:31:30,607][52803] Sum rewards: 11.696, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.724', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.650', 'ARMOR': '0.875', 'HITCOUNT': '0.900', 'weapon2': '1.250', 'weapon3': '1.896', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:31,668][52794] DAMAGECOUNT value on done: 10516.0 [2024-08-05 22:31:31,670][52794] Sum rewards: 10.708, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.627', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.089', 'ARMOR': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.380', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.196', 'weapon3': '1.554', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:32,060][52662] DAMAGECOUNT value on done: 10133.0 [2024-08-05 22:31:32,060][52662] Sum rewards: 0.676, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.902', 'AMMO2': '0.012', 'weapon4': '0.052', 'AMMO4': '0.060', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'HITCOUNT': '0.410', 'ARMOR': '0.878', 'WEAPON3': '0.950', 'weapon2': '0.998', 'DAMAGECOUNT': '1.395', 'weapon3': '1.780', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:32,183][52668] DAMAGECOUNT value on done: 9313.0 [2024-08-05 22:31:32,193][52668] Sum rewards: 5.292, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.709', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.562', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'ARMOR': '0.912', 'weapon2': '1.022', 'weapon3': '1.924', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:32,271][52650] Updated weights for policy 0, policy_version 8251 (0.0027) [2024-08-05 22:31:32,279][52660] DAMAGECOUNT value on done: 9305.0 [2024-08-05 22:31:32,279][52660] Sum rewards: 11.723, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'ARMOR': '0.444', 'weapon4': '0.546', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon2': '1.084', 'weapon3': '1.664', 'DAMAGECOUNT': '3.381', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16911.6). Total num frames: 67592192. Throughput: 0: 4240.0. Samples: 16899250. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:31:32,794][52567] Avg episode reward: [(0, '7.883')] [2024-08-05 22:31:33,397][52811] DAMAGECOUNT value on done: 8134.0 [2024-08-05 22:31:33,400][52811] Sum rewards: 2.958, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.264', 'AMMO2': '0.014', 'AMMO4': '0.071', 'ARMOR': '0.104', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'HITCOUNT': '0.500', 'weapon4': '0.548', 'weapon2': '0.586', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.581', 'weapon3': '2.120', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:33,963][52803] DAMAGECOUNT value on done: 9603.0 [2024-08-05 22:31:33,964][52803] Sum rewards: 6.456, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.656', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'ARMOR': '0.904', 'weapon2': '1.350', 'weapon3': '1.882', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:34,522][52662] DAMAGECOUNT value on done: 9529.0 [2024-08-05 22:31:34,522][52662] Sum rewards: 4.625, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.685', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'weapon4': '0.300', 'HITCOUNT': '0.470', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.162', 'weapon3': '1.514', 'DAMAGECOUNT': '1.701', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:34,728][52668] DAMAGECOUNT value on done: 8125.0 [2024-08-05 22:31:34,730][52668] Sum rewards: 8.816, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.852', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.142', 'weapon4': '0.204', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '1.260', 'ARMOR': '1.295', 'weapon3': '2.024', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:34,784][52660] DAMAGECOUNT value on done: 9262.0 [2024-08-05 22:31:34,789][52660] Sum rewards: 15.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.278', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'ARMOR': '0.020', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'weapon7': '0.132', 'WEAPON7': '0.200', 'weapon4': '0.222', 'weapon2': '0.792', 'WEAPON3': '0.900', 'HITCOUNT': '1.160', 'weapon3': '2.064', 'DAMAGECOUNT': '4.248', 'FRAGCOUNT': '14.000'} [2024-08-05 22:31:36,754][52811] DAMAGECOUNT value on done: 9388.0 [2024-08-05 22:31:36,755][52811] Sum rewards: 12.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.316', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.256', 'WEAPON3': '0.650', 'ARMOR': '0.804', 'HITCOUNT': '0.860', 'weapon3': '1.654', 'weapon2': '1.704', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '10.000'} [2024-08-05 22:31:36,784][52650] Updated weights for policy 0, policy_version 8261 (0.0012) [2024-08-05 22:31:37,191][52803] DAMAGECOUNT value on done: 7200.0 [2024-08-05 22:31:37,192][52803] Sum rewards: 6.266, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.947', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.083', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'ARMOR': '0.905', 'weapon2': '1.100', 'weapon3': '1.356', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:37,212][52662] DAMAGECOUNT value on done: 9034.0 [2024-08-05 22:31:37,213][52662] Sum rewards: 4.875, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.430', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.048', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'weapon4': '0.362', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon3': '1.340', 'weapon2': '1.388', 'DAMAGECOUNT': '2.106', 'FRAGCOUNT': '4.000'} [2024-08-05 22:31:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17066.6, 300 sec: 16939.4). Total num frames: 67682304. Throughput: 0: 4240.2. Samples: 16924750. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:31:37,795][52567] Avg episode reward: [(0, '7.717')] [2024-08-05 22:31:38,064][52668] DAMAGECOUNT value on done: 7790.0 [2024-08-05 22:31:38,067][52668] Sum rewards: 7.217, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.104', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.523', 'HITCOUNT': '0.570', 'weapon2': '1.018', 'weapon3': '1.178', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:38,124][52660] DAMAGECOUNT value on done: 8305.0 [2024-08-05 22:31:38,126][52660] Sum rewards: 16.541, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.760', 'AMMO2': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.016', 'AMMO4': '0.021', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'WEAPON3': '1.000', 'HITCOUNT': '1.100', 'weapon2': '1.490', 'weapon3': '2.118', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '16.000'} [2024-08-05 22:31:38,724][52795] DAMAGECOUNT value on done: 6823.0 [2024-08-05 22:31:38,724][52795] Sum rewards: 5.038, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.218', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.200', 'HITCOUNT': '0.540', 'WEAPON3': '0.800', 'ARMOR': '1.265', 'weapon2': '1.318', 'weapon3': '1.662', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:39,963][52811] DAMAGECOUNT value on done: 7780.0 [2024-08-05 22:31:39,965][52811] Sum rewards: 4.235, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.724', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.058', 'WEAPON4': '0.150', 'HITCOUNT': '0.310', 'WEAPON3': '0.350', 'weapon4': '0.474', 'ARMOR': '0.516', 'weapon2': '0.884', 'weapon3': '0.914', 'DAMAGECOUNT': '1.497', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:40,365][52803] DAMAGECOUNT value on done: 7271.0 [2024-08-05 22:31:40,367][52803] Sum rewards: 4.513, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'HITCOUNT': '0.530', 'WEAPON3': '0.800', 'ARMOR': '0.907', 'weapon2': '1.520', 'weapon3': '1.546', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:40,855][52660] DAMAGECOUNT value on done: 8797.0 [2024-08-05 22:31:40,856][52660] Sum rewards: 5.176, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.037', 'AMMO3': '0.070', 'ARMOR': '0.084', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.604', 'HITCOUNT': '0.630', 'weapon2': '1.054', 'weapon3': '1.702', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '3.500'} [2024-08-05 22:31:42,000][52650] Updated weights for policy 0, policy_version 8271 (0.0021) [2024-08-05 22:31:42,056][52795] DAMAGECOUNT value on done: 7865.0 [2024-08-05 22:31:42,057][52795] Sum rewards: 8.554, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.746', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.034', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.672', 'HITCOUNT': '0.800', 'ARMOR': '0.923', 'weapon2': '1.196', 'weapon3': '1.590', 'DAMAGECOUNT': '2.319', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 16930.1, 300 sec: 16967.2). Total num frames: 67772416. Throughput: 0: 4248.4. Samples: 16950240. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:31:42,794][52567] Avg episode reward: [(0, '7.632')] [2024-08-05 22:31:43,112][52811] DAMAGECOUNT value on done: 8779.0 [2024-08-05 22:31:43,114][52811] Sum rewards: 9.596, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.424', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'weapon4': '0.140', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.426', 'weapon3': '1.602', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:43,214][52660] DAMAGECOUNT value on done: 8945.0 [2024-08-05 22:31:43,216][52660] Sum rewards: 6.850, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.488', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.420', 'HITCOUNT': '0.600', 'WEAPON3': '0.800', 'ARMOR': '1.372', 'weapon2': '1.510', 'weapon3': '1.606', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:43,848][52803] DAMAGECOUNT value on done: 7721.0 [2024-08-05 22:31:43,848][52803] Sum rewards: 8.242, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.350', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'ARMOR': '0.032', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.326', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '0.970', 'weapon3': '1.252', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:45,612][52795] DAMAGECOUNT value on done: 7350.0 [2024-08-05 22:31:45,613][52795] Sum rewards: 2.822, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.129', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO3': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'weapon4': '0.260', 'WEAPON3': '0.300', 'HITCOUNT': '0.300', 'weapon2': '0.442', 'weapon3': '0.828', 'DAMAGECOUNT': '0.858', 'FRAGCOUNT': '2.000'} [2024-08-05 22:31:46,132][52811] DAMAGECOUNT value on done: 5734.0 [2024-08-05 22:31:46,135][52811] Sum rewards: 3.206, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.012', 'ARMOR': '0.024', 'AMMO3': '0.030', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.340', 'HEALTH': '0.363', 'weapon3': '0.716', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.047', 'weapon2': '1.054'} [2024-08-05 22:31:46,753][52650] Updated weights for policy 0, policy_version 8281 (0.0023) [2024-08-05 22:31:46,985][52803] DAMAGECOUNT value on done: 7770.0 [2024-08-05 22:31:46,988][52803] Sum rewards: 7.075, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.036', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.532', 'ARMOR': '0.560', 'WEAPON3': '0.800', 'weapon2': '0.826', 'HITCOUNT': '0.910', 'weapon3': '2.210', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:47,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16930.1, 300 sec: 16911.6). Total num frames: 67846144. Throughput: 0: 4251.8. Samples: 16963190. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:31:47,802][52567] Avg episode reward: [(0, '7.483')] [2024-08-05 22:31:47,880][52669] DAMAGECOUNT value on done: 9184.0 [2024-08-05 22:31:47,880][52669] Sum rewards: 15.240, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.497', 'AMMO4': '-0.088', 'AMMO2': '-0.018', 'AMMO5': '0.012', 'weapon5': '0.054', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.454', 'HITCOUNT': '0.990', 'WEAPON3': '1.050', 'weapon2': '1.378', 'weapon3': '1.676', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '16.000'} [2024-08-05 22:31:49,111][52795] DAMAGECOUNT value on done: 9736.0 [2024-08-05 22:31:49,112][52795] Sum rewards: 9.551, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.705', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO3': '0.074', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'ARMOR': '0.441', 'WEAPON3': '0.550', 'HITCOUNT': '0.980', 'weapon2': '1.378', 'weapon3': '1.624', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:49,363][52811] DAMAGECOUNT value on done: 8352.0 [2024-08-05 22:31:49,363][52811] Sum rewards: 9.988, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.036', 'AMMO3': '0.079', 'HEALTH': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.560', 'HITCOUNT': '0.750', 'weapon2': '0.868', 'weapon4': '1.110', 'weapon3': '1.506', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '5.500'} [2024-08-05 22:31:50,121][52803] DAMAGECOUNT value on done: 8504.0 [2024-08-05 22:31:50,123][52803] Sum rewards: 12.425, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.890', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.102', 'WEAPON3': '0.800', 'HITCOUNT': '1.010', 'ARMOR': '1.346', 'weapon2': '1.494', 'weapon3': '1.756', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '11.000'} [2024-08-05 22:31:50,631][52669] DAMAGECOUNT value on done: 8689.0 [2024-08-05 22:31:50,633][52669] Sum rewards: 6.248, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.170', 'weapon4': '0.002', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'ARMOR': '0.412', 'HITCOUNT': '0.580', 'WEAPON3': '0.700', 'weapon2': '1.250', 'weapon3': '1.420', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:51,492][52650] Updated weights for policy 0, policy_version 8291 (0.0032) [2024-08-05 22:31:52,321][52795] DAMAGECOUNT value on done: 9474.0 [2024-08-05 22:31:52,322][52795] Sum rewards: 16.277, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON3': '1.050', 'HITCOUNT': '1.220', 'ARMOR': '1.417', 'weapon2': '1.436', 'weapon3': '2.152', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '15.000'} [2024-08-05 22:31:52,690][52811] DAMAGECOUNT value on done: 8037.0 [2024-08-05 22:31:52,692][52811] Sum rewards: 7.013, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.667', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.204', 'ARMOR': '0.469', 'WEAPON3': '0.850', 'HITCOUNT': '0.890', 'weapon2': '1.428', 'weapon3': '1.472', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '7.000'} [2024-08-05 22:31:52,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 67936256. Throughput: 0: 4255.3. Samples: 16988790. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:31:52,802][52567] Avg episode reward: [(0, '7.724')] [2024-08-05 22:31:53,291][52803] DAMAGECOUNT value on done: 7932.0 [2024-08-05 22:31:53,292][52803] Sum rewards: 5.133, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.310', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.434', 'ARMOR': '0.456', 'HITCOUNT': '0.610', 'WEAPON3': '0.950', 'weapon2': '1.302', 'weapon3': '1.718', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:53,736][52669] DAMAGECOUNT value on done: 9341.0 [2024-08-05 22:31:53,739][52669] Sum rewards: 8.930, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.131', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'ARMOR': '0.468', 'weapon4': '0.520', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '0.942', 'weapon3': '1.938', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:55,700][52795] DAMAGECOUNT value on done: 10227.0 [2024-08-05 22:31:55,702][52795] Sum rewards: 14.808, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.598', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'weapon4': '0.402', 'ARMOR': '0.473', 'WEAPON3': '0.800', 'weapon2': '1.066', 'HITCOUNT': '1.170', 'weapon3': '2.166', 'DAMAGECOUNT': '4.338', 'FRAGCOUNT': '12.000'} [2024-08-05 22:31:55,950][52811] DAMAGECOUNT value on done: 8862.0 [2024-08-05 22:31:55,951][52811] Sum rewards: 1.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.028', 'AMMO4': '0.068', 'ARMOR': '0.080', 'weapon4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.904', 'HITCOUNT': '1.120', 'WEAPON3': '1.300', 'weapon3': '2.594', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:56,557][52803] DAMAGECOUNT value on done: 8448.0 [2024-08-05 22:31:56,559][52803] Sum rewards: 8.293, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.575', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.036', 'ARMOR': '0.075', 'AMMO3': '0.077', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'weapon2': '1.184', 'weapon3': '1.406', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '6.000'} [2024-08-05 22:31:56,683][52650] Updated weights for policy 0, policy_version 8301 (0.0028) [2024-08-05 22:31:56,909][52669] DAMAGECOUNT value on done: 10707.0 [2024-08-05 22:31:56,909][52669] Sum rewards: 11.006, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.425', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'WEAPON3': '0.800', 'ARMOR': '0.918', 'HITCOUNT': '1.000', 'weapon2': '1.484', 'weapon3': '2.004', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '9.000'} [2024-08-05 22:31:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16930.1, 300 sec: 16967.2). Total num frames: 68026368. Throughput: 0: 4249.6. Samples: 17014010. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:31:57,794][52567] Avg episode reward: [(0, '7.761')] [2024-08-05 22:31:58,939][52795] DAMAGECOUNT value on done: 8221.0 [2024-08-05 22:31:58,940][52795] Sum rewards: 4.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.632', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.095', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '0.610', 'weapon4': '0.658', 'weapon3': '1.524', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '5.000'} [2024-08-05 22:31:59,142][52811] DAMAGECOUNT value on done: 8140.0 [2024-08-05 22:31:59,142][52811] Sum rewards: 12.230, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.594', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.168', 'WEAPON3': '0.350', 'HITCOUNT': '0.870', 'ARMOR': '0.887', 'weapon3': '0.968', 'weapon2': '0.982', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '8.000'} [2024-08-05 22:31:59,810][52803] DAMAGECOUNT value on done: 8345.0 [2024-08-05 22:31:59,815][52803] Sum rewards: 6.149, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.844', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.278', 'HITCOUNT': '0.780', 'WEAPON3': '0.900', 'weapon2': '1.176', 'ARMOR': '1.406', 'weapon3': '1.918', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:00,584][52669] DAMAGECOUNT value on done: 8405.0 [2024-08-05 22:32:00,586][52669] Sum rewards: 5.581, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.830', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'ARMOR': '0.028', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon4': '0.656', 'HITCOUNT': '0.690', 'weapon2': '0.792', 'weapon3': '1.366', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:00,724][52650] Updated weights for policy 0, policy_version 8311 (0.0022) [2024-08-05 22:32:02,242][52795] DAMAGECOUNT value on done: 9518.0 [2024-08-05 22:32:02,242][52795] Sum rewards: 17.822, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.245', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.124', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.940', 'HITCOUNT': '1.410', 'weapon2': '1.436', 'weapon3': '1.868', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '14.000'} [2024-08-05 22:32:02,380][52811] DAMAGECOUNT value on done: 8076.0 [2024-08-05 22:32:02,380][52811] Sum rewards: 10.118, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.093', 'weapon4': '0.226', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon2': '1.248', 'weapon3': '1.368', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.5, 300 sec: 16911.6). Total num frames: 68100096. Throughput: 0: 4248.9. Samples: 17026640. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:32:02,795][52567] Avg episode reward: [(0, '7.998')] [2024-08-05 22:32:02,802][52614] Saving new best policy, reward=7.998! [2024-08-05 22:32:03,060][52803] DAMAGECOUNT value on done: 7076.0 [2024-08-05 22:32:03,063][52803] Sum rewards: 11.313, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.024', 'AMMO4': '0.045', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.250', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.887', 'weapon2': '0.996', 'weapon3': '1.728', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:03,774][52669] DAMAGECOUNT value on done: 8860.0 [2024-08-05 22:32:03,774][52669] Sum rewards: 3.397, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.152', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.070', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.310', 'HITCOUNT': '0.490', 'ARMOR': '0.499', 'WEAPON3': '0.500', 'weapon2': '1.008', 'weapon3': '1.330', 'DAMAGECOUNT': '1.515', 'FRAGCOUNT': '2.000'} [2024-08-05 22:32:05,587][52811] DAMAGECOUNT value on done: 7692.0 [2024-08-05 22:32:05,587][52811] Sum rewards: 6.579, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.052', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.030', 'AMMO4': '0.037', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'ARMOR': '0.494', 'HITCOUNT': '0.510', 'weapon3': '1.292', 'weapon2': '1.422', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:05,598][52795] DAMAGECOUNT value on done: 8243.0 [2024-08-05 22:32:05,598][52795] Sum rewards: 4.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.450', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'weapon4': '0.128', 'HITCOUNT': '0.510', 'WEAPON3': '0.850', 'ARMOR': '0.856', 'weapon2': '1.294', 'DAMAGECOUNT': '1.857', 'weapon3': '2.040', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:05,631][52647] DAMAGECOUNT value on done: 9953.0 [2024-08-05 22:32:05,640][52647] Sum rewards: 9.252, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.638', 'AMMO2': '0.006', 'AMMO4': '0.032', 'ARMOR': '0.077', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.736', 'HITCOUNT': '0.970', 'WEAPON3': '1.000', 'weapon3': '2.468', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '11.000'} [2024-08-05 22:32:06,126][52650] Updated weights for policy 0, policy_version 8321 (0.0013) [2024-08-05 22:32:06,338][52803] DAMAGECOUNT value on done: 7800.0 [2024-08-05 22:32:06,342][52803] Sum rewards: 8.093, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.416', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.520', 'weapon4': '0.610', 'WEAPON3': '0.650', 'weapon2': '0.850', 'weapon3': '1.482', 'ARMOR': '1.925', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:07,269][52669] DAMAGECOUNT value on done: 10104.0 [2024-08-05 22:32:07,270][52669] Sum rewards: 9.809, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.435', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.292', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'HITCOUNT': '1.120', 'weapon2': '1.174', 'weapon3': '2.156', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 68190208. Throughput: 0: 4244.9. Samples: 17051890. Policy #0 lag: (min: 2.0, avg: 3.9, max: 9.0) [2024-08-05 22:32:07,794][52567] Avg episode reward: [(0, '8.126')] [2024-08-05 22:32:07,797][52614] Saving new best policy, reward=8.126! [2024-08-05 22:32:08,658][52647] DAMAGECOUNT value on done: 8912.0 [2024-08-05 22:32:08,659][52647] Sum rewards: 2.562, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.886', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.134', 'ARMOR': '0.493', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.182', 'weapon3': '1.604', 'DAMAGECOUNT': '1.842', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:08,894][52795] DAMAGECOUNT value on done: 8959.0 [2024-08-05 22:32:08,894][52795] Sum rewards: 7.696, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'weapon4': '0.110', 'AMMO3': '0.114', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'weapon2': '1.104', 'DAMAGECOUNT': '2.259', 'weapon3': '2.478', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:09,125][52671] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 22:32:09,138][52811] DAMAGECOUNT value on done: 9318.0 [2024-08-05 22:32:09,138][52811] Sum rewards: 9.795, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.952', 'AMMO4': '-0.112', 'AMMO2': '-0.022', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON3': '0.850', 'HITCOUNT': '0.880', 'weapon3': '1.440', 'weapon2': '1.710', 'ARMOR': '1.835', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:09,816][52803] DAMAGECOUNT value on done: 7951.0 [2024-08-05 22:32:09,816][52803] Sum rewards: 10.622, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.069', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.226', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.336', 'weapon3': '1.754', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:10,462][52665] DAMAGECOUNT value on done: 8837.0 [2024-08-05 22:32:10,463][52665] Sum rewards: 10.215, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.566', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.089', 'weapon4': '0.244', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '0.794', 'ARMOR': '0.906', 'weapon3': '1.788', 'DAMAGECOUNT': '2.130', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:10,643][52650] Updated weights for policy 0, policy_version 8331 (0.0026) [2024-08-05 22:32:10,678][52669] DAMAGECOUNT value on done: 8906.0 [2024-08-05 22:32:10,681][52669] Sum rewards: 4.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.442', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon4': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.578', 'weapon3': '1.842', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:11,590][52647] DAMAGECOUNT value on done: 10202.0 [2024-08-05 22:32:11,592][52647] Sum rewards: 7.019, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.940', 'AMMO2': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.060', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.210', 'WEAPON3': '0.550', 'HITCOUNT': '0.600', 'weapon2': '0.748', 'weapon3': '1.350', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:12,262][52795] DAMAGECOUNT value on done: 8118.0 [2024-08-05 22:32:12,262][52795] Sum rewards: 5.575, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.283', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.103', 'WEAPON4': '0.250', 'ARMOR': '0.480', 'weapon4': '0.548', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.306', 'weapon3': '1.790', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:12,405][52811] DAMAGECOUNT value on done: 7093.0 [2024-08-05 22:32:12,405][52811] Sum rewards: 7.081, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.966', 'AMMO2': '0.022', 'AMMO3': '0.080', 'AMMO4': '0.109', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.946', 'ARMOR': '1.033', 'weapon3': '1.666', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:12,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 68272128. Throughput: 0: 4233.6. Samples: 17077110. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 22:32:12,794][52567] Avg episode reward: [(0, '8.030')] [2024-08-05 22:32:13,184][52665] DAMAGECOUNT value on done: 8465.0 [2024-08-05 22:32:13,187][52665] Sum rewards: 7.474, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.772', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.022', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon4': '0.190', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon2': '1.426', 'ARMOR': '1.470', 'weapon3': '2.126', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:13,210][52803] DAMAGECOUNT value on done: 8728.0 [2024-08-05 22:32:13,210][52803] Sum rewards: 11.620, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.877', 'AMMO2': '0.017', 'weapon7': '0.026', 'ARMOR': '0.060', 'AMMO3': '0.074', 'AMMO4': '0.085', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon2': '1.240', 'weapon3': '1.532', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:13,592][52669] DAMAGECOUNT value on done: 8546.0 [2024-08-05 22:32:13,592][52669] Sum rewards: 1.201, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.964', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.092', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'ARMOR': '0.440', 'HITCOUNT': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.288', 'DAMAGECOUNT': '1.521', 'weapon3': '1.948', 'FRAGCOUNT': '2.000'} [2024-08-05 22:32:14,425][52647] DAMAGECOUNT value on done: 7644.0 [2024-08-05 22:32:14,425][52647] Sum rewards: 11.198, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.307', 'AMMO2': '0.008', 'weapon4': '0.036', 'AMMO4': '0.041', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.898', 'HITCOUNT': '0.970', 'weapon3': '1.674', 'weapon2': '1.746', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:15,517][52795] DAMAGECOUNT value on done: 7882.0 [2024-08-05 22:32:15,519][52795] Sum rewards: 5.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.409', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.050', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.300', 'weapon4': '0.492', 'WEAPON3': '0.550', 'ARMOR': '0.555', 'HITCOUNT': '0.660', 'weapon2': '1.030', 'weapon3': '1.832', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:15,719][52811] DAMAGECOUNT value on done: 7815.0 [2024-08-05 22:32:15,721][52811] Sum rewards: 5.129, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.698', 'AMMO2': '0.034', 'AMMO3': '0.085', 'ARMOR': '0.123', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon4': '0.780', 'weapon2': '0.800', 'weapon3': '1.724', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:15,991][52650] Updated weights for policy 0, policy_version 8341 (0.0029) [2024-08-05 22:32:16,066][52665] DAMAGECOUNT value on done: 9629.0 [2024-08-05 22:32:16,067][52665] Sum rewards: 1.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.616', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.038', 'AMMO3': '0.110', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.464', 'weapon4': '0.554', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'FRAGCOUNT': '1.000', 'weapon2': '1.000', 'weapon3': '2.064', 'DAMAGECOUNT': '2.121'} [2024-08-05 22:32:16,363][52803] DAMAGECOUNT value on done: 8856.0 [2024-08-05 22:32:16,366][52803] Sum rewards: 8.746, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.280', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO4': '0.022', 'AMMO3': '0.056', 'ARMOR': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon4': '0.516', 'weapon2': '0.534', 'weapon3': '0.898', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:16,887][52663] DAMAGECOUNT value on done: 9631.0 [2024-08-05 22:32:16,888][52663] Sum rewards: 8.724, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.664', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.424', 'ARMOR': '0.496', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '1.334', 'weapon3': '1.656', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:17,072][52669] DAMAGECOUNT value on done: 8810.0 [2024-08-05 22:32:17,075][52669] Sum rewards: 12.889, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'WEAPON3': '0.500', 'HEALTH': '0.735', 'ARMOR': '0.912', 'HITCOUNT': '1.210', 'weapon2': '1.534', 'weapon3': '1.642', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:17,532][52647] DAMAGECOUNT value on done: 8002.0 [2024-08-05 22:32:17,533][52647] Sum rewards: 8.088, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.128', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.258', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'ARMOR': '0.895', 'weapon2': '1.458', 'weapon3': '1.460', 'DAMAGECOUNT': '2.874', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 68362240. Throughput: 0: 4238.2. Samples: 17089970. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 22:32:17,794][52567] Avg episode reward: [(0, '8.002')] [2024-08-05 22:32:18,760][52665] DAMAGECOUNT value on done: 8295.0 [2024-08-05 22:32:18,761][52665] Sum rewards: 3.989, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.833', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.192', 'HITCOUNT': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.296', 'ARMOR': '1.413', 'DAMAGECOUNT': '1.686', 'weapon3': '1.766', 'FRAGCOUNT': '3.000'} [2024-08-05 22:32:18,946][52811] DAMAGECOUNT value on done: 6583.0 [2024-08-05 22:32:18,947][52811] Sum rewards: 6.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.978', 'AMMO2': '0.024', 'ARMOR': '0.084', 'AMMO3': '0.106', 'weapon4': '0.114', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.284', 'weapon3': '2.220', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:19,067][52795] DAMAGECOUNT value on done: 9274.0 [2024-08-05 22:32:19,070][52795] Sum rewards: 14.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.206', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.134', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'HITCOUNT': '1.190', 'weapon2': '1.306', 'weapon3': '2.214', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '13.000'} [2024-08-05 22:32:19,995][52663] DAMAGECOUNT value on done: 9307.0 [2024-08-05 22:32:19,995][52663] Sum rewards: 15.783, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.666', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.131', 'weapon4': '0.218', 'WEAPON3': '0.800', 'HITCOUNT': '1.160', 'weapon2': '1.468', 'weapon3': '1.630', 'ARMOR': '1.835', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '13.000'} [2024-08-05 22:32:20,095][52669] DAMAGECOUNT value on done: 9160.0 [2024-08-05 22:32:20,097][52669] Sum rewards: 8.227, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.669', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'ARMOR': '0.477', 'HITCOUNT': '0.840', 'weapon3': '1.026', 'weapon2': '1.232', 'DAMAGECOUNT': '2.547', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:20,395][52650] Updated weights for policy 0, policy_version 8351 (0.0013) [2024-08-05 22:32:21,008][52647] DAMAGECOUNT value on done: 9429.0 [2024-08-05 22:32:21,012][52647] Sum rewards: 8.483, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.019', 'AMMO3': '0.079', 'HEALTH': '0.080', 'AMMO4': '0.096', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '0.978', 'weapon2': '1.498', 'DAMAGECOUNT': '2.082', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:21,763][52665] DAMAGECOUNT value on done: 9431.0 [2024-08-05 22:32:21,764][52665] Sum rewards: 12.595, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.646', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.142', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '0.800', 'ARMOR': '0.916', 'weapon2': '1.022', 'HITCOUNT': '1.070', 'weapon3': '1.704', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '11.000'} [2024-08-05 22:32:22,141][52811] DAMAGECOUNT value on done: 8453.0 [2024-08-05 22:32:22,144][52811] Sum rewards: 10.439, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.070', 'HEALTH': '0.106', 'WEAPON3': '0.400', 'HITCOUNT': '0.700', 'weapon3': '0.790', 'ARMOR': '0.800', 'weapon2': '1.546', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:22,571][52795] DAMAGECOUNT value on done: 8831.0 [2024-08-05 22:32:22,574][52795] Sum rewards: 8.490, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.954', 'AMMO2': '0.021', 'AMMO3': '0.098', 'AMMO4': '0.107', 'WEAPON4': '0.300', 'weapon4': '0.488', 'ARMOR': '0.592', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.292', 'weapon3': '1.886', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:22,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.5, 300 sec: 16911.6). Total num frames: 68435968. Throughput: 0: 4236.4. Samples: 17115390. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 22:32:22,795][52567] Avg episode reward: [(0, '8.216')] [2024-08-05 22:32:22,798][52614] Saving new best policy, reward=8.216! [2024-08-05 22:32:23,341][52647] DAMAGECOUNT value on done: 8025.0 [2024-08-05 22:32:23,342][52647] Sum rewards: 13.137, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.083', 'weapon4': '0.204', 'WEAPON3': '0.400', 'ARMOR': '0.432', 'HEALTH': '0.656', 'HITCOUNT': '0.950', 'weapon2': '1.356', 'weapon3': '1.428', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:23,464][52663] DAMAGECOUNT value on done: 7771.0 [2024-08-05 22:32:23,465][52663] Sum rewards: 8.100, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.110', 'weapon4': '0.274', 'HEALTH': '0.288', 'ARMOR': '0.416', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon3': '1.668', 'weapon2': '1.704', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:23,614][52669] DAMAGECOUNT value on done: 10350.0 [2024-08-05 22:32:23,615][52669] Sum rewards: 5.765, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.574', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.156', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '0.918', 'weapon3': '1.658', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:24,648][52665] DAMAGECOUNT value on done: 8856.0 [2024-08-05 22:32:24,648][52665] Sum rewards: 10.508, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.019', 'ARMOR': '0.060', 'AMMO3': '0.080', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'HEALTH': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.450', 'HITCOUNT': '0.790', 'weapon2': '1.278', 'weapon3': '1.876', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:25,504][52811] DAMAGECOUNT value on done: 8911.0 [2024-08-05 22:32:25,505][52811] Sum rewards: 5.826, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.531', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.032', 'weapon7': '0.036', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.116', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.394', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.992', 'weapon2': '1.230', 'weapon3': '1.926', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '6.500'} [2024-08-05 22:32:25,730][52650] Updated weights for policy 0, policy_version 8361 (0.0023) [2024-08-05 22:32:25,914][52795] DAMAGECOUNT value on done: 8236.0 [2024-08-05 22:32:25,918][52795] Sum rewards: 11.827, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.019', 'AMMO3': '0.052', 'AMMO4': '0.097', 'WEAPON3': '0.350', 'HEALTH': '0.362', 'HITCOUNT': '0.690', 'ARMOR': '0.812', 'weapon3': '1.140', 'weapon2': '1.604', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:26,482][52663] DAMAGECOUNT value on done: 10551.0 [2024-08-05 22:32:26,485][52663] Sum rewards: 8.600, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.221', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.050', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.510', 'weapon4': '0.598', 'ARMOR': '1.014', 'weapon3': '1.026', 'weapon2': '1.236', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:26,566][52669] DAMAGECOUNT value on done: 8556.0 [2024-08-05 22:32:26,566][52669] Sum rewards: 7.468, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.491', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'ARMOR': '0.028', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.338', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '1.276', 'weapon3': '1.454', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:26,752][52647] DAMAGECOUNT value on done: 8708.0 [2024-08-05 22:32:26,755][52647] Sum rewards: 3.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.745', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.062', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.244', 'ARMOR': '0.443', 'HITCOUNT': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.212', 'weapon3': '1.456', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:27,287][52665] DAMAGECOUNT value on done: 8981.0 [2024-08-05 22:32:27,289][52665] Sum rewards: 8.396, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.011', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'ARMOR': '0.463', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.012', 'weapon3': '1.614', 'DAMAGECOUNT': '2.187', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 68534272. Throughput: 0: 4228.2. Samples: 17140510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:32:27,794][52567] Avg episode reward: [(0, '8.159')] [2024-08-05 22:32:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008366_68534272.pth... [2024-08-05 22:32:27,910][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000007870_64471040.pth [2024-08-05 22:32:29,351][52795] DAMAGECOUNT value on done: 9100.0 [2024-08-05 22:32:29,355][52795] Sum rewards: 10.933, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.941', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.057', 'ARMOR': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.250', 'weapon4': '0.582', 'weapon2': '0.640', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon3': '1.700', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:29,605][52663] DAMAGECOUNT value on done: 8310.0 [2024-08-05 22:32:29,607][52663] Sum rewards: 4.537, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.449', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.302', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '0.956', 'ARMOR': '1.349', 'weapon3': '1.658', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:29,629][52669] DAMAGECOUNT value on done: 9947.0 [2024-08-05 22:32:29,630][52669] Sum rewards: 7.669, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.030', 'WEAPON3': '0.200', 'HITCOUNT': '0.390', 'HEALTH': '0.428', 'weapon3': '0.692', 'ARMOR': '0.892', 'weapon2': '1.106', 'DAMAGECOUNT': '1.401', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:29,666][52647] DAMAGECOUNT value on done: 9857.0 [2024-08-05 22:32:29,668][52647] Sum rewards: 13.911, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.224', 'HEALTH': '0.254', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.198', 'weapon3': '1.574', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '11.000'} [2024-08-05 22:32:30,179][52614] Signal inference workers to stop experience collection... (1550 times) [2024-08-05 22:32:30,186][52614] Signal inference workers to resume experience collection... (1550 times) [2024-08-05 22:32:30,221][52650] InferenceWorker_p0-w0: stopping experience collection (1550 times) [2024-08-05 22:32:30,232][52650] InferenceWorker_p0-w0: resuming experience collection (1550 times) [2024-08-05 22:32:30,303][52650] Updated weights for policy 0, policy_version 8371 (0.0012) [2024-08-05 22:32:30,541][52665] DAMAGECOUNT value on done: 8460.0 [2024-08-05 22:32:30,543][52665] Sum rewards: 5.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.134', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.260', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'ARMOR': '0.929', 'weapon2': '1.452', 'weapon3': '1.906', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:32,389][52669] DAMAGECOUNT value on done: 9236.0 [2024-08-05 22:32:32,391][52663] DAMAGECOUNT value on done: 9682.0 [2024-08-05 22:32:32,390][52669] Sum rewards: 12.775, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO2': '0.015', 'AMMO4': '0.076', 'ARMOR': '0.084', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'weapon4': '0.442', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon2': '1.016', 'weapon3': '1.836', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '11.000'} [2024-08-05 22:32:32,393][52663] Sum rewards: 4.579, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.126', 'AMMO2': '0.026', 'ARMOR': '0.074', 'weapon4': '0.098', 'AMMO3': '0.122', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.320', 'weapon3': '1.906', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:32,716][52647] DAMAGECOUNT value on done: 8778.0 [2024-08-05 22:32:32,718][52647] Sum rewards: 5.806, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.664', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon4': '0.108', 'WEAPON3': '0.400', 'HITCOUNT': '0.670', 'ARMOR': '0.900', 'weapon3': '1.064', 'weapon2': '1.470', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:32,766][52795] DAMAGECOUNT value on done: 8870.0 [2024-08-05 22:32:32,770][52795] Sum rewards: 4.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.260', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.162', 'ARMOR': '0.438', 'HITCOUNT': '0.700', 'WEAPON3': '0.850', 'weapon2': '1.482', 'weapon3': '1.634', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:32,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 68608000. Throughput: 0: 4215.3. Samples: 17152880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:32:32,794][52567] Avg episode reward: [(0, '8.258')] [2024-08-05 22:32:32,795][52614] Saving new best policy, reward=8.258! [2024-08-05 22:32:33,314][52665] DAMAGECOUNT value on done: 8253.0 [2024-08-05 22:32:33,316][52665] Sum rewards: 5.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.566', 'AMMO2': '0.032', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'weapon4': '0.236', 'ARMOR': '0.568', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '1.196', 'weapon3': '1.776', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:35,271][52663] DAMAGECOUNT value on done: 10953.0 [2024-08-05 22:32:35,272][52663] Sum rewards: 16.693, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.250', 'HEALTH': '0.322', 'ARMOR': '0.504', 'weapon2': '0.872', 'WEAPON3': '0.950', 'HITCOUNT': '1.080', 'weapon3': '2.502', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '16.000'} [2024-08-05 22:32:35,315][52669] DAMAGECOUNT value on done: 9511.0 [2024-08-05 22:32:35,315][52669] Sum rewards: 11.308, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.120', 'AMMO2': '0.016', 'weapon6': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.088', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.178', 'AMMO7': '0.178', 'WEAPON6': '0.200', 'WEAPON3': '0.550', 'ARMOR': '0.820', 'HITCOUNT': '0.840', 'weapon2': '1.336', 'weapon3': '1.338', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:35,363][52650] Updated weights for policy 0, policy_version 8381 (0.0019) [2024-08-05 22:32:36,249][52647] DAMAGECOUNT value on done: 8951.0 [2024-08-05 22:32:36,252][52647] Sum rewards: 5.509, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.510', 'HEALTH': '0.619', 'weapon4': '0.772', 'weapon3': '1.284', 'weapon2': '1.392', 'DAMAGECOUNT': '1.491', 'FRAGCOUNT': '3.000'} [2024-08-05 22:32:36,272][52795] DAMAGECOUNT value on done: 9175.0 [2024-08-05 22:32:36,273][52795] Sum rewards: 9.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'weapon3': '1.264', 'weapon2': '1.290', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:36,524][52665] DAMAGECOUNT value on done: 9392.0 [2024-08-05 22:32:36,524][52665] Sum rewards: 8.471, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.545', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.081', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon2': '1.190', 'weapon3': '1.506', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:37,594][52820] DAMAGECOUNT value on done: 7003.0 [2024-08-05 22:32:37,596][52820] Sum rewards: 2.377, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.708', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.169', 'HITCOUNT': '0.510', 'weapon4': '0.682', 'WEAPON3': '0.850', 'ARMOR': '0.969', 'weapon2': '0.980', 'DAMAGECOUNT': '1.785', 'weapon3': '1.812', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16911.7). Total num frames: 68698112. Throughput: 0: 4214.0. Samples: 17178420. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:32:37,794][52567] Avg episode reward: [(0, '8.271')] [2024-08-05 22:32:37,798][52614] Saving new best policy, reward=8.271! [2024-08-05 22:32:37,979][52663] DAMAGECOUNT value on done: 7977.0 [2024-08-05 22:32:37,981][52663] Sum rewards: 7.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.096', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon4': '0.224', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.226', 'ARMOR': '1.364', 'weapon3': '1.884', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:38,003][52669] DAMAGECOUNT value on done: 8971.0 [2024-08-05 22:32:38,003][52669] Sum rewards: 14.489, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.106', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.688', 'weapon2': '0.898', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'ARMOR': '1.784', 'weapon3': '1.934', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '13.000'} [2024-08-05 22:32:39,506][52665] DAMAGECOUNT value on done: 10301.0 [2024-08-05 22:32:39,507][52665] Sum rewards: 8.485, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.102', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.062', 'weapon7': '0.062', 'AMMO3': '0.065', 'AMMO4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.278', 'HITCOUNT': '0.410', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'weapon2': '0.882', 'weapon3': '1.368', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:39,515][52647] DAMAGECOUNT value on done: 8258.0 [2024-08-05 22:32:39,516][52647] Sum rewards: 7.532, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.081', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.260', 'ARMOR': '0.517', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon2': '1.186', 'weapon3': '2.186', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:39,729][52795] DAMAGECOUNT value on done: 7069.0 [2024-08-05 22:32:39,731][52795] Sum rewards: 4.166, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.424', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.048', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'HITCOUNT': '0.630', 'ARMOR': '0.851', 'WEAPON3': '0.900', 'weapon2': '1.332', 'weapon3': '1.558', 'DAMAGECOUNT': '2.196', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:40,045][52650] Updated weights for policy 0, policy_version 8391 (0.0032) [2024-08-05 22:32:40,611][52667] DAMAGECOUNT value on done: 10237.0 [2024-08-05 22:32:40,612][52667] Sum rewards: 5.363, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.055', 'ARMOR': '0.080', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.436', 'HITCOUNT': '0.660', 'weapon2': '0.676', 'WEAPON3': '0.700', 'weapon3': '1.958', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:40,940][52663] DAMAGECOUNT value on done: 8365.0 [2024-08-05 22:32:40,940][52663] Sum rewards: 11.126, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.162', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.178', 'ARMOR': '0.492', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.310', 'weapon3': '1.872', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:40,962][52669] DAMAGECOUNT value on done: 9589.0 [2024-08-05 22:32:40,962][52669] Sum rewards: 8.612, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.326', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '0.764', 'ARMOR': '0.852', 'weapon3': '1.904', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:41,072][52820] DAMAGECOUNT value on done: 8834.0 [2024-08-05 22:32:41,072][52820] Sum rewards: 7.531, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.168', 'ARMOR': '0.400', 'HITCOUNT': '0.890', 'WEAPON3': '0.950', 'weapon2': '1.680', 'weapon3': '1.754', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:42,730][52647] DAMAGECOUNT value on done: 9584.0 [2024-08-05 22:32:42,732][52647] Sum rewards: 13.623, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.423', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.112', 'WEAPON3': '0.800', 'ARMOR': '0.892', 'HITCOUNT': '1.220', 'weapon2': '1.588', 'weapon3': '1.874', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '12.000'} [2024-08-05 22:32:42,748][52665] DAMAGECOUNT value on done: 8854.0 [2024-08-05 22:32:42,748][52665] Sum rewards: 16.805, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.435', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.374', 'ARMOR': '0.463', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.158', 'weapon3': '1.852', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '14.000'} [2024-08-05 22:32:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 16930.1, 300 sec: 16967.2). Total num frames: 68788224. Throughput: 0: 4215.6. Samples: 17203710. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:32:42,794][52567] Avg episode reward: [(0, '8.417')] [2024-08-05 22:32:42,795][52614] Saving new best policy, reward=8.417! [2024-08-05 22:32:43,016][52795] DAMAGECOUNT value on done: 7923.0 [2024-08-05 22:32:43,018][52795] Sum rewards: 7.810, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.441', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.093', 'WEAPON4': '0.250', 'weapon4': '0.558', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'ARMOR': '1.006', 'weapon2': '1.086', 'weapon3': '1.582', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:43,362][52667] DAMAGECOUNT value on done: 8687.0 [2024-08-05 22:32:43,366][52667] Sum rewards: 10.765, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.024', 'AMMO2': '0.002', 'weapon4': '0.008', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.011', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'ARMOR': '0.412', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon2': '1.520', 'weapon3': '1.520', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:44,001][52663] DAMAGECOUNT value on done: 10126.0 [2024-08-05 22:32:44,002][52663] Sum rewards: 13.153, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.838', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.108', 'ARMOR': '0.497', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon2': '1.082', 'weapon3': '2.118', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '11.000'} [2024-08-05 22:32:44,041][52669] DAMAGECOUNT value on done: 8846.0 [2024-08-05 22:32:44,043][52669] Sum rewards: 6.688, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.400', 'weapon4': '0.448', 'ARMOR': '0.487', 'HITCOUNT': '0.720', 'WEAPON3': '0.850', 'weapon2': '1.124', 'weapon3': '2.006', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:44,375][52820] DAMAGECOUNT value on done: 8662.0 [2024-08-05 22:32:44,378][52820] Sum rewards: 3.263, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.522', 'AMMO2': '0.021', 'AMMO3': '0.090', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.322', 'HITCOUNT': '0.440', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'weapon2': '0.652', 'DAMAGECOUNT': '1.500', 'weapon3': '1.660', 'FRAGCOUNT': '3.000'} [2024-08-05 22:32:45,079][52650] Updated weights for policy 0, policy_version 8401 (0.0018) [2024-08-05 22:32:45,132][52665] DAMAGECOUNT value on done: 9085.0 [2024-08-05 22:32:45,132][52665] Sum rewards: 9.489, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.630', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.422', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'ARMOR': '0.920', 'weapon2': '1.112', 'weapon3': '1.650', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:45,837][52647] DAMAGECOUNT value on done: 7943.0 [2024-08-05 22:32:45,839][52647] Sum rewards: 3.081, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.735', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.078', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'HITCOUNT': '0.510', 'ARMOR': '0.587', 'WEAPON3': '0.600', 'weapon2': '1.204', 'weapon3': '1.298', 'DAMAGECOUNT': '1.521', 'FRAGCOUNT': '3.000'} [2024-08-05 22:32:46,383][52667] DAMAGECOUNT value on done: 9836.0 [2024-08-05 22:32:46,383][52667] Sum rewards: 12.841, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.757', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon5': '0.336', 'ARMOR': '0.443', 'WEAPON3': '0.450', 'HITCOUNT': '0.800', 'weapon3': '1.116', 'weapon2': '1.208', 'DAMAGECOUNT': '2.721', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:47,188][52669] DAMAGECOUNT value on done: 9619.0 [2024-08-05 22:32:47,189][52669] Sum rewards: 7.345, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.064', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.356', 'ARMOR': '0.562', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon3': '1.378', 'weapon2': '1.458', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:47,191][52663] DAMAGECOUNT value on done: 9226.0 [2024-08-05 22:32:47,192][52663] Sum rewards: 11.706, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.600', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.410', 'ARMOR': '0.543', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.282', 'weapon3': '1.418', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:47,606][52820] DAMAGECOUNT value on done: 9828.0 [2024-08-05 22:32:47,607][52820] Sum rewards: 11.539, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.097', 'HEALTH': '0.166', 'weapon4': '0.368', 'WEAPON3': '0.400', 'ARMOR': '0.408', 'HITCOUNT': '0.630', 'weapon2': '1.074', 'weapon3': '1.360', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 16911.6). Total num frames: 68870144. Throughput: 0: 4212.2. Samples: 17216190. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:32:47,795][52567] Avg episode reward: [(0, '8.531')] [2024-08-05 22:32:47,797][52614] Saving new best policy, reward=8.531! [2024-08-05 22:32:48,353][52665] DAMAGECOUNT value on done: 9412.0 [2024-08-05 22:32:48,354][52665] Sum rewards: 5.515, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.494', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.544', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'ARMOR': '0.940', 'weapon2': '1.114', 'weapon3': '1.572', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:48,787][52647] DAMAGECOUNT value on done: 10195.0 [2024-08-05 22:32:48,787][52647] Sum rewards: 8.763, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.018', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.472', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'ARMOR': '0.950', 'weapon2': '1.132', 'weapon3': '1.458', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:49,191][52667] DAMAGECOUNT value on done: 9197.0 [2024-08-05 22:32:49,192][52667] Sum rewards: 1.128, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.032', 'ARMOR': '0.040', 'AMMO3': '0.110', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'weapon4': '0.234', 'WEAPON4': '0.400', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.454', 'FRAGCOUNT': '1.500', 'weapon3': '1.868', 'DAMAGECOUNT': '2.172'} [2024-08-05 22:32:49,746][52650] Updated weights for policy 0, policy_version 8411 (0.0035) [2024-08-05 22:32:50,178][52663] DAMAGECOUNT value on done: 8477.0 [2024-08-05 22:32:50,178][52663] Sum rewards: 5.591, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'ARMOR': '0.948', 'weapon2': '1.450', 'weapon3': '1.554', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:50,832][52820] DAMAGECOUNT value on done: 8591.0 [2024-08-05 22:32:50,832][52820] Sum rewards: 9.006, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.091', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.970', 'weapon3': '1.468', 'weapon2': '1.606', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:51,295][52665] DAMAGECOUNT value on done: 9876.0 [2024-08-05 22:32:51,299][52665] Sum rewards: 10.685, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.096', 'weapon4': '0.106', 'WEAPON3': '0.550', 'ARMOR': '0.900', 'HITCOUNT': '1.020', 'weapon3': '1.664', 'weapon2': '1.794', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:51,503][52647] DAMAGECOUNT value on done: 8743.0 [2024-08-05 22:32:51,503][52647] Sum rewards: 8.301, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.957', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'ARMOR': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.318', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.070', 'weapon3': '1.752', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:52,511][52667] DAMAGECOUNT value on done: 9819.0 [2024-08-05 22:32:52,514][52667] Sum rewards: 9.214, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'HEALTH': '0.011', 'AMMO2': '0.016', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.077', 'ARMOR': '0.092', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'weapon4': '0.520', 'weapon2': '0.890', 'weapon3': '1.460', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16939.4). Total num frames: 68952064. Throughput: 0: 4215.8. Samples: 17241600. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:32:52,794][52567] Avg episode reward: [(0, '8.388')] [2024-08-05 22:32:52,840][52663] DAMAGECOUNT value on done: 9573.0 [2024-08-05 22:32:52,840][52663] Sum rewards: 8.256, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.120', 'AMMO4': '-0.100', 'AMMO2': '-0.020', 'AMMO3': '0.067', 'ARMOR': '0.500', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon3': '1.092', 'weapon2': '1.554', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:54,027][52649] DAMAGECOUNT value on done: 10224.0 [2024-08-05 22:32:54,027][52649] Sum rewards: 9.554, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.692', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.232', 'WEAPON3': '0.850', 'weapon2': '0.992', 'HITCOUNT': '1.030', 'weapon3': '1.984', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '9.000'} [2024-08-05 22:32:54,152][52665] DAMAGECOUNT value on done: 8959.0 [2024-08-05 22:32:54,153][52665] Sum rewards: 5.551, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.095', 'weapon5': '0.096', 'AMMO3': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.328', 'weapon3': '1.870', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '5.000'} [2024-08-05 22:32:54,299][52820] DAMAGECOUNT value on done: 9908.0 [2024-08-05 22:32:54,300][52820] Sum rewards: 7.965, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.017', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.044', 'AMMO3': '0.052', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.492', 'weapon2': '0.630', 'HITCOUNT': '0.670', 'weapon3': '1.130', 'DAMAGECOUNT': '2.298', 'FRAGCOUNT': '6.000'} [2024-08-05 22:32:54,565][52650] Updated weights for policy 0, policy_version 8421 (0.0014) [2024-08-05 22:32:54,747][52647] DAMAGECOUNT value on done: 9660.0 [2024-08-05 22:32:54,748][52647] Sum rewards: 13.056, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.074', 'HEALTH': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.850', 'weapon2': '1.164', 'weapon3': '1.556', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '10.000'} [2024-08-05 22:32:55,064][52667] DAMAGECOUNT value on done: 10689.0 [2024-08-05 22:32:55,065][52667] Sum rewards: 4.338, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.024', 'weapon7': '0.046', 'AMMO4': '0.074', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'ARMOR': '0.926', 'weapon2': '1.158', 'weapon3': '1.614', 'DAMAGECOUNT': '1.629', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:55,778][52663] DAMAGECOUNT value on done: 8822.0 [2024-08-05 22:32:55,780][52663] Sum rewards: 4.837, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.040', 'weapon4': '0.076', 'HEALTH': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.106', 'weapon5': '0.108', 'HITCOUNT': '0.450', 'WEAPON3': '0.600', 'weapon2': '1.272', 'DAMAGECOUNT': '1.470', 'weapon3': '2.294', 'FRAGCOUNT': '4.000'} [2024-08-05 22:32:57,354][52649] DAMAGECOUNT value on done: 8277.0 [2024-08-05 22:32:57,355][52649] Sum rewards: 8.592, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.356', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.108', 'weapon4': '0.218', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'weapon2': '0.738', 'HITCOUNT': '0.760', 'weapon3': '2.150', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:57,402][52665] DAMAGECOUNT value on done: 8733.0 [2024-08-05 22:32:57,402][52665] Sum rewards: 5.378, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.530', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'ARMOR': '0.486', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon3': '1.732', 'weapon2': '1.782', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.000'} [2024-08-05 22:32:57,625][52820] DAMAGECOUNT value on done: 7201.0 [2024-08-05 22:32:57,627][52820] Sum rewards: 11.790, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.227', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO3': '0.070', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.360', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'HITCOUNT': '0.860', 'weapon2': '1.474', 'weapon3': '1.548', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '8.000'} [2024-08-05 22:32:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 16939.4). Total num frames: 69042176. Throughput: 0: 4227.1. Samples: 17267330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:32:57,794][52567] Avg episode reward: [(0, '8.277')] [2024-08-05 22:32:57,845][52667] DAMAGECOUNT value on done: 9346.0 [2024-08-05 22:32:57,848][52667] Sum rewards: 6.205, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.418', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.055', 'WEAPON3': '0.400', 'HITCOUNT': '0.620', 'ARMOR': '0.800', 'weapon3': '1.046', 'weapon2': '1.828', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '3.000'} [2024-08-05 22:32:57,905][52647] DAMAGECOUNT value on done: 9182.0 [2024-08-05 22:32:57,906][52647] Sum rewards: 17.287, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.945', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'weapon7': '0.048', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.174', 'ARMOR': '0.505', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon3': '1.496', 'weapon2': '1.592', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '14.000'} [2024-08-05 22:32:58,865][52663] DAMAGECOUNT value on done: 8928.0 [2024-08-05 22:32:58,866][52663] Sum rewards: 3.459, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.535', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.050', 'WEAPON4': '0.200', 'weapon4': '0.272', 'WEAPON3': '0.500', 'ARMOR': '0.523', 'HITCOUNT': '0.530', 'weapon3': '1.204', 'weapon2': '1.678', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '2.000'} [2024-08-05 22:32:59,480][52650] Updated weights for policy 0, policy_version 8431 (0.0023) [2024-08-05 22:33:00,004][52658] DAMAGECOUNT value on done: 8757.0 [2024-08-05 22:33:00,004][52658] Sum rewards: 13.987, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'HEALTH': '0.323', 'ARMOR': '0.432', 'weapon4': '0.496', 'HITCOUNT': '0.850', 'weapon2': '0.928', 'weapon3': '1.018', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:00,229][52647] DAMAGECOUNT value on done: 9342.0 [2024-08-05 22:33:00,230][52647] Sum rewards: 9.096, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.550', 'AMMO2': '0.019', 'weapon7': '0.046', 'weapon4': '0.056', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'weapon2': '0.692', 'HITCOUNT': '0.700', 'ARMOR': '0.891', 'weapon3': '1.392', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:00,487][52649] DAMAGECOUNT value on done: 8667.0 [2024-08-05 22:33:00,487][52649] Sum rewards: 21.236, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.921', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.304', 'WEAPON3': '0.900', 'ARMOR': '0.946', 'weapon2': '1.122', 'HITCOUNT': '1.380', 'weapon3': '2.356', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '18.000'} [2024-08-05 22:33:00,523][52665] DAMAGECOUNT value on done: 9118.0 [2024-08-05 22:33:00,527][52665] Sum rewards: 15.490, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.667', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.091', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.242', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.368', 'weapon3': '1.692', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '13.000'} [2024-08-05 22:33:00,787][52667] DAMAGECOUNT value on done: 8958.0 [2024-08-05 22:33:00,793][52667] Sum rewards: 9.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.984', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon5': '0.030', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.336', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'ARMOR': '0.999', 'weapon2': '1.164', 'weapon3': '1.940', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:00,826][52820] DAMAGECOUNT value on done: 8511.0 [2024-08-05 22:33:00,828][52820] Sum rewards: 0.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'weapon4': '0.150', 'AMMO3': '0.191', 'HITCOUNT': '0.690', 'ARMOR': '0.910', 'WEAPON3': '1.200', 'weapon2': '1.484', 'weapon3': '2.130', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:01,896][52663] DAMAGECOUNT value on done: 9158.0 [2024-08-05 22:33:01,898][52663] Sum rewards: 9.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.526', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO4': '0.015', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'ARMOR': '0.451', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.308', 'weapon3': '1.846', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16883.9). Total num frames: 69115904. Throughput: 0: 4221.8. Samples: 17279950. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:33:02,794][52567] Avg episode reward: [(0, '8.549')] [2024-08-05 22:33:02,820][52614] Saving new best policy, reward=8.549! [2024-08-05 22:33:03,060][52658] DAMAGECOUNT value on done: 8819.0 [2024-08-05 22:33:03,062][52658] Sum rewards: 6.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.162', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.997', 'weapon2': '1.454', 'weapon3': '1.594', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:03,547][52647] DAMAGECOUNT value on done: 8228.0 [2024-08-05 22:33:03,547][52647] Sum rewards: 3.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.963', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.072', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'WEAPON3': '0.550', 'weapon4': '0.588', 'DAMAGECOUNT': '0.903', 'ARMOR': '0.949', 'weapon2': '1.174', 'weapon3': '1.496', 'FRAGCOUNT': '3.000'} [2024-08-05 22:33:03,763][52667] DAMAGECOUNT value on done: 8704.0 [2024-08-05 22:33:03,763][52667] Sum rewards: 6.661, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.552', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.356', 'WEAPON3': '0.750', 'ARMOR': '0.828', 'HITCOUNT': '0.840', 'weapon2': '1.214', 'weapon3': '1.826', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:04,018][52649] DAMAGECOUNT value on done: 10688.0 [2024-08-05 22:33:04,019][52649] Sum rewards: 13.152, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.448', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.066', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.340', 'ARMOR': '0.507', 'WEAPON3': '0.600', 'weapon2': '0.712', 'HITCOUNT': '0.870', 'weapon3': '1.774', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:04,027][52665] DAMAGECOUNT value on done: 8077.0 [2024-08-05 22:33:04,027][52665] Sum rewards: 5.704, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.166', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO4': '0.042', 'AMMO3': '0.068', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HITCOUNT': '0.400', 'weapon4': '0.408', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon2': '0.816', 'weapon3': '1.108', 'DAMAGECOUNT': '1.536', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:04,117][52820] DAMAGECOUNT value on done: 8064.0 [2024-08-05 22:33:04,119][52820] Sum rewards: 7.985, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.326', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO3': '0.050', 'WEAPON4': '0.200', 'HITCOUNT': '0.450', 'weapon4': '0.478', 'WEAPON3': '0.500', 'ARMOR': '0.980', 'weapon2': '1.068', 'weapon3': '1.168', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:04,143][52650] Updated weights for policy 0, policy_version 8441 (0.0013) [2024-08-05 22:33:04,427][52664] DAMAGECOUNT value on done: 10261.0 [2024-08-05 22:33:04,429][52664] Sum rewards: 6.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.873', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'weapon4': '0.446', 'HITCOUNT': '0.580', 'ARMOR': '0.585', 'WEAPON3': '0.700', 'weapon2': '0.752', 'weapon3': '2.402', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:05,209][52663] DAMAGECOUNT value on done: 9430.0 [2024-08-05 22:33:05,209][52663] Sum rewards: 12.517, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.581', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon7': '0.052', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'ARMOR': '0.895', 'weapon2': '1.606', 'weapon3': '1.688', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:06,418][52658] DAMAGECOUNT value on done: 8277.0 [2024-08-05 22:33:06,418][52658] Sum rewards: 7.434, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.506', 'AMMO2': '0.029', 'ARMOR': '0.093', 'AMMO3': '0.126', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon2': '1.140', 'weapon3': '2.024', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:06,952][52664] DAMAGECOUNT value on done: 9066.0 [2024-08-05 22:33:06,954][52664] Sum rewards: 7.162, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.012', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.090', 'HEALTH': '0.117', 'weapon4': '0.236', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.362', 'weapon3': '1.746', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:07,091][52667] DAMAGECOUNT value on done: 9655.0 [2024-08-05 22:33:07,091][52667] Sum rewards: 14.222, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.886', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.022', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'ARMOR': '0.536', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon2': '1.576', 'weapon3': '1.768', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:07,352][52665] DAMAGECOUNT value on done: 10254.0 [2024-08-05 22:33:07,352][52665] Sum rewards: 10.575, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.084', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'HEALTH': '0.470', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'weapon2': '1.366', 'weapon3': '1.528', 'ARMOR': '1.684', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:07,361][52649] DAMAGECOUNT value on done: 8016.0 [2024-08-05 22:33:07,364][52649] Sum rewards: 7.930, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.391', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.114', 'ARMOR': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.214', 'weapon3': '1.908', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:07,418][52820] DAMAGECOUNT value on done: 9097.0 [2024-08-05 22:33:07,420][52820] Sum rewards: 7.603, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.294', 'AMMO2': '0.001', 'AMMO4': '0.006', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.304', 'ARMOR': '0.509', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.224', 'weapon3': '1.954', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16911.6). Total num frames: 69206016. Throughput: 0: 4219.4. Samples: 17305260. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:33:07,794][52567] Avg episode reward: [(0, '8.736')] [2024-08-05 22:33:07,797][52614] Saving new best policy, reward=8.736! [2024-08-05 22:33:08,369][52663] DAMAGECOUNT value on done: 8508.0 [2024-08-05 22:33:08,369][52663] Sum rewards: 6.644, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.048', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.232', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'ARMOR': '0.804', 'weapon2': '1.180', 'weapon3': '1.724', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:09,243][52650] Updated weights for policy 0, policy_version 8451 (0.0021) [2024-08-05 22:33:09,525][52658] DAMAGECOUNT value on done: 9070.0 [2024-08-05 22:33:09,525][52658] Sum rewards: 4.224, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.403', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'ARMOR': '0.408', 'weapon4': '0.438', 'HITCOUNT': '0.630', 'weapon2': '0.672', 'WEAPON3': '0.700', 'weapon3': '1.736', 'DAMAGECOUNT': '2.292', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:10,050][52649] DAMAGECOUNT value on done: 9235.0 [2024-08-05 22:33:10,050][52649] Sum rewards: 8.584, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'HEALTH': '0.064', 'AMMO4': '0.099', 'weapon5': '0.234', 'weapon4': '0.240', 'WEAPON3': '0.350', 'HITCOUNT': '0.830', 'weapon3': '1.116', 'ARMOR': '1.332', 'weapon2': '1.740', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:10,161][52664] DAMAGECOUNT value on done: 10029.0 [2024-08-05 22:33:10,164][52664] Sum rewards: 8.105, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.660', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.562', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '0.840', 'ARMOR': '0.951', 'weapon3': '1.576', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:10,178][52667] DAMAGECOUNT value on done: 8795.0 [2024-08-05 22:33:10,181][52667] Sum rewards: 10.294, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.271', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon5': '0.068', 'weapon4': '0.190', 'WEAPON3': '0.400', 'ARMOR': '0.487', 'HITCOUNT': '0.600', 'weapon2': '1.332', 'weapon3': '1.364', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:10,669][52820] DAMAGECOUNT value on done: 7828.0 [2024-08-05 22:33:10,670][52820] Sum rewards: 5.678, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.641', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.440', 'WEAPON3': '0.500', 'weapon4': '0.782', 'ARMOR': '0.968', 'weapon2': '1.056', 'weapon3': '1.306', 'DAMAGECOUNT': '1.602', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:11,279][52671] DAMAGECOUNT value on done: 10244.0 [2024-08-05 22:33:11,280][52671] Sum rewards: 7.171, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.465', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO3': '0.087', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.312', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.580', 'weapon2': '1.336', 'weapon3': '1.566', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '6.500'} [2024-08-05 22:33:11,897][52663] DAMAGECOUNT value on done: 8132.0 [2024-08-05 22:33:11,899][52663] Sum rewards: 4.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.488', 'AMMO2': '0.011', 'AMMO4': '0.056', 'ARMOR': '0.080', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.554', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.294', 'weapon3': '1.444', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:12,492][52658] DAMAGECOUNT value on done: 8886.0 [2024-08-05 22:33:12,493][52658] Sum rewards: 4.159, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.148', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.442', 'HITCOUNT': '0.660', 'weapon2': '0.852', 'WEAPON3': '0.900', 'ARMOR': '1.439', 'DAMAGECOUNT': '2.013', 'weapon3': '2.066', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:12,779][52649] DAMAGECOUNT value on done: 7442.0 [2024-08-05 22:33:12,780][52649] Sum rewards: 3.984, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'HITCOUNT': '0.480', 'ARMOR': '0.517', 'weapon4': '0.534', 'weapon2': '0.568', 'WEAPON3': '0.650', 'weapon3': '1.462', 'DAMAGECOUNT': '1.545', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17066.7, 300 sec: 16939.4). Total num frames: 69296128. Throughput: 0: 4210.2. Samples: 17329970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:33:12,794][52567] Avg episode reward: [(0, '8.448')] [2024-08-05 22:33:13,255][52667] DAMAGECOUNT value on done: 10041.0 [2024-08-05 22:33:13,263][52667] Sum rewards: 6.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.372', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'weapon4': '0.154', 'ARMOR': '0.485', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.208', 'weapon3': '1.986', 'DAMAGECOUNT': '2.889', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:13,280][52664] DAMAGECOUNT value on done: 8540.0 [2024-08-05 22:33:13,280][52664] Sum rewards: 10.930, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.592', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'weapon4': '0.066', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.880', 'ARMOR': '0.956', 'weapon2': '1.164', 'weapon3': '1.368', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:13,945][52820] DAMAGECOUNT value on done: 7882.0 [2024-08-05 22:33:13,946][52820] Sum rewards: 9.301, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.528', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.740', 'ARMOR': '0.852', 'weapon2': '1.172', 'weapon3': '1.380', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:14,282][52650] Updated weights for policy 0, policy_version 8461 (0.0025) [2024-08-05 22:33:14,608][52671] DAMAGECOUNT value on done: 8773.0 [2024-08-05 22:33:14,612][52671] Sum rewards: 6.290, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.480', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.346', 'HITCOUNT': '0.770', 'weapon2': '0.924', 'ARMOR': '0.969', 'WEAPON3': '1.100', 'weapon3': '2.174', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:15,202][52663] DAMAGECOUNT value on done: 8671.0 [2024-08-05 22:33:15,202][52663] Sum rewards: 13.211, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.368', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.086', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.424', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'ARMOR': '0.980', 'weapon2': '1.188', 'weapon3': '1.666', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '9.500'} [2024-08-05 22:33:15,377][52649] DAMAGECOUNT value on done: 8529.0 [2024-08-05 22:33:15,379][52649] Sum rewards: 8.195, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.698', 'AMMO2': '0.013', 'weapon4': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon3': '1.378', 'weapon2': '1.654', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:15,524][52658] DAMAGECOUNT value on done: 7360.0 [2024-08-05 22:33:15,526][52658] Sum rewards: 6.622, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.080', 'HEALTH': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.340', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'ARMOR': '0.865', 'weapon2': '1.366', 'weapon3': '1.638', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:15,969][52667] DAMAGECOUNT value on done: 10079.0 [2024-08-05 22:33:15,970][52667] Sum rewards: 5.565, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.681', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'ARMOR': '0.004', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon3': '1.376', 'DAMAGECOUNT': '1.926', 'weapon2': '1.980', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:16,598][52664] DAMAGECOUNT value on done: 9123.0 [2024-08-05 22:33:17,287][52820] DAMAGECOUNT value on done: 8873.0 [2024-08-05 22:33:17,293][52820] Sum rewards: 10.806, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.244', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.113', 'weapon5': '0.356', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'ARMOR': '1.273', 'weapon3': '1.510', 'weapon2': '1.722', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16883.9). Total num frames: 69369856. Throughput: 0: 4217.1. Samples: 17342650. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:33:17,795][52567] Avg episode reward: [(0, '8.334')] [2024-08-05 22:33:17,896][52671] DAMAGECOUNT value on done: 10734.0 [2024-08-05 22:33:17,897][52671] Sum rewards: 12.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.574', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.032', 'weapon5': '0.048', 'weapon4': '0.064', 'AMMO4': '0.074', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.232', 'HITCOUNT': '1.520', 'weapon3': '2.402', 'DAMAGECOUNT': '5.151', 'FRAGCOUNT': '13.000'} [2024-08-05 22:33:18,277][52649] DAMAGECOUNT value on done: 8933.0 [2024-08-05 22:33:18,277][52649] Sum rewards: 10.456, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.156', 'AMMO2': '0.037', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.183', 'weapon4': '0.220', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'ARMOR': '1.200', 'weapon2': '1.646', 'weapon3': '1.764', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:18,317][52658] DAMAGECOUNT value on done: 10299.0 [2024-08-05 22:33:18,326][52658] Sum rewards: 13.403, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.864', 'weapon4': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'ARMOR': '0.444', 'WEAPON3': '1.000', 'HITCOUNT': '1.060', 'weapon2': '1.482', 'weapon3': '1.976', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '15.000'} [2024-08-05 22:33:18,747][52794] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 22:33:18,871][52650] Updated weights for policy 0, policy_version 8471 (0.0024) [2024-08-05 22:33:19,091][52667] DAMAGECOUNT value on done: 10247.0 [2024-08-05 22:33:19,092][52667] Sum rewards: 6.485, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.096', 'weapon4': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '0.874', 'ARMOR': '0.895', 'weapon3': '1.456', 'DAMAGECOUNT': '1.761', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:19,662][52659] DAMAGECOUNT value on done: 9097.0 [2024-08-05 22:33:19,664][52659] Sum rewards: 6.929, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.456', 'AMMO2': '0.019', 'ARMOR': '0.040', 'AMMO4': '0.093', 'AMMO3': '0.124', 'WEAPON4': '0.300', 'weapon4': '0.312', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'weapon2': '0.964', 'weapon3': '1.916', 'DAMAGECOUNT': '2.427', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:19,940][52664] DAMAGECOUNT value on done: 8976.0 [2024-08-05 22:33:19,941][52664] Sum rewards: 7.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.977', 'AMMO2': '0.005', 'AMMO4': '0.023', 'ARMOR': '0.024', 'weapon4': '0.048', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon2': '1.132', 'weapon3': '1.308', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:20,599][52820] DAMAGECOUNT value on done: 7056.0 [2024-08-05 22:33:20,602][52820] Sum rewards: 2.302, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.808', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.022', 'AMMO3': '0.070', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HITCOUNT': '0.380', 'weapon4': '0.522', 'WEAPON3': '0.600', 'weapon2': '0.740', 'ARMOR': '0.868', 'weapon3': '1.248', 'DAMAGECOUNT': '1.437', 'FRAGCOUNT': '2.000'} [2024-08-05 22:33:20,846][52671] DAMAGECOUNT value on done: 9721.0 [2024-08-05 22:33:20,848][52671] Sum rewards: 11.812, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.488', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.128', 'weapon5': '0.414', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.436', 'weapon3': '1.528', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:21,004][52649] DAMAGECOUNT value on done: 9075.0 [2024-08-05 22:33:21,005][52649] Sum rewards: 11.189, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.714', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.070', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon2': '1.362', 'weapon3': '1.614', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:21,093][52658] DAMAGECOUNT value on done: 9382.0 [2024-08-05 22:33:21,094][52658] Sum rewards: 5.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.413', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.508', 'weapon4': '0.540', 'HITCOUNT': '0.630', 'WEAPON3': '0.900', 'ARMOR': '1.404', 'DAMAGECOUNT': '2.145', 'weapon3': '2.358', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:21,762][52667] DAMAGECOUNT value on done: 9767.0 [2024-08-05 22:33:21,763][52667] Sum rewards: 12.341, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.728', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.220', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.080', 'weapon3': '1.662', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:22,527][52659] DAMAGECOUNT value on done: 10164.0 [2024-08-05 22:33:22,528][52659] Sum rewards: 5.759, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.420', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO4': '0.082', 'AMMO3': '0.106', 'WEAPON4': '0.250', 'weapon4': '0.470', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '0.992', 'weapon3': '1.908', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:22,764][52664] DAMAGECOUNT value on done: 9877.0 [2024-08-05 22:33:22,764][52664] Sum rewards: 7.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.294', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon3': '1.468', 'weapon2': '1.566', 'DAMAGECOUNT': '3.051', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17066.7, 300 sec: 16911.6). Total num frames: 69459968. Throughput: 0: 4217.1. Samples: 17368190. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:33:22,794][52567] Avg episode reward: [(0, '8.354')] [2024-08-05 22:33:23,292][52671] DAMAGECOUNT value on done: 9299.0 [2024-08-05 22:33:23,301][52671] Sum rewards: 6.334, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.138', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'weapon5': '0.064', 'AMMO4': '0.072', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '0.938', 'weapon3': '2.138', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:23,836][52820] DAMAGECOUNT value on done: 8302.0 [2024-08-05 22:33:23,838][52820] Sum rewards: 3.444, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.900', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO4': '0.029', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.515', 'HITCOUNT': '0.780', 'weapon2': '1.176', 'WEAPON3': '1.200', 'weapon3': '2.304', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:24,005][52650] Updated weights for policy 0, policy_version 8481 (0.0015) [2024-08-05 22:33:24,185][52649] DAMAGECOUNT value on done: 9172.0 [2024-08-05 22:33:24,186][52649] Sum rewards: 6.425, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.732', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'ARMOR': '0.832', 'weapon2': '1.364', 'weapon3': '1.584', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:24,411][52658] DAMAGECOUNT value on done: 7762.0 [2024-08-05 22:33:24,411][52658] Sum rewards: 4.647, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.406', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.078', 'ARMOR': '0.488', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon3': '1.230', 'weapon2': '1.382', 'DAMAGECOUNT': '1.836', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:25,031][52667] DAMAGECOUNT value on done: 8724.0 [2024-08-05 22:33:25,034][52667] Sum rewards: 16.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.000', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.060', 'AMMO4': '0.080', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.406', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'weapon2': '1.206', 'weapon3': '2.084', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '13.000'} [2024-08-05 22:33:25,104][52659] DAMAGECOUNT value on done: 9183.0 [2024-08-05 22:33:25,108][52659] Sum rewards: 11.151, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.226', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.008', 'weapon3': '1.664', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:26,036][52664] DAMAGECOUNT value on done: 8932.0 [2024-08-05 22:33:26,036][52664] Sum rewards: 2.404, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.586', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.028', 'AMMO3': '0.091', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.500', 'ARMOR': '0.547', 'weapon4': '0.686', 'WEAPON3': '0.700', 'weapon2': '0.714', 'weapon3': '1.486', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '3.000'} [2024-08-05 22:33:26,289][52671] DAMAGECOUNT value on done: 9084.0 [2024-08-05 22:33:26,289][52671] Sum rewards: 6.851, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.223', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.044', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.264', 'ARMOR': '0.544', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '1.316', 'weapon3': '1.494', 'DAMAGECOUNT': '2.127', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:26,596][52649] DAMAGECOUNT value on done: 7780.0 [2024-08-05 22:33:26,597][52649] Sum rewards: 7.622, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.612', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.063', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.580', 'weapon3': '1.100', 'weapon2': '2.054', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:26,951][52658] DAMAGECOUNT value on done: 7881.0 [2024-08-05 22:33:26,953][52658] Sum rewards: 4.692, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.028', 'ARMOR': '0.056', 'AMMO3': '0.074', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.208', 'HEALTH': '0.349', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon2': '1.286', 'DAMAGECOUNT': '1.413', 'weapon3': '1.592', 'FRAGCOUNT': '3.000'} [2024-08-05 22:33:27,348][52820] DAMAGECOUNT value on done: 9193.0 [2024-08-05 22:33:27,352][52820] Sum rewards: 18.334, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.912', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon5': '0.068', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.528', 'WEAPON3': '0.550', 'ARMOR': '0.922', 'weapon2': '1.020', 'HITCOUNT': '1.170', 'weapon3': '1.644', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '14.000'} [2024-08-05 22:33:27,497][52667] DAMAGECOUNT value on done: 9743.0 [2024-08-05 22:33:27,497][52667] Sum rewards: 5.761, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.996', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'ARMOR': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'weapon4': '0.564', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon2': '1.080', 'weapon3': '1.740', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '3.500'} [2024-08-05 22:33:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16883.9). Total num frames: 69541888. Throughput: 0: 4224.4. Samples: 17393810. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:33:27,794][52567] Avg episode reward: [(0, '8.378')] [2024-08-05 22:33:28,165][52659] DAMAGECOUNT value on done: 9622.0 [2024-08-05 22:33:28,168][52659] Sum rewards: 9.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.225', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'weapon4': '0.352', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.118', 'weapon3': '1.954', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:28,740][52650] Updated weights for policy 0, policy_version 8491 (0.0017) [2024-08-05 22:33:28,943][52671] DAMAGECOUNT value on done: 10105.0 [2024-08-05 22:33:28,943][52671] Sum rewards: 4.610, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.645', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.178', 'ARMOR': '0.471', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon3': '1.528', 'weapon2': '1.608', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:29,438][52649] DAMAGECOUNT value on done: 10825.0 [2024-08-05 22:33:29,440][52649] Sum rewards: 13.980, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.360', 'AMMO4': '-0.091', 'AMMO2': '-0.018', 'AMMO3': '0.068', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon3': '1.268', 'weapon2': '1.438', 'DAMAGECOUNT': '4.323', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:29,439][52664] DAMAGECOUNT value on done: 9900.0 [2024-08-05 22:33:29,442][52664] Sum rewards: 16.068, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.220', 'WEAPON3': '0.650', 'HITCOUNT': '1.140', 'ARMOR': '1.240', 'weapon2': '1.434', 'weapon3': '1.582', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '12.000'} [2024-08-05 22:33:29,930][52658] DAMAGECOUNT value on done: 9606.0 [2024-08-05 22:33:29,931][52658] Sum rewards: 8.425, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.083', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'ARMOR': '0.871', 'weapon2': '0.894', 'HITCOUNT': '1.030', 'WEAPON3': '1.150', 'weapon3': '2.414', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:30,661][52667] DAMAGECOUNT value on done: 9560.0 [2024-08-05 22:33:30,661][52667] Sum rewards: 7.591, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.068', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'HITCOUNT': '0.840', 'WEAPON3': '1.000', 'ARMOR': '1.285', 'weapon3': '1.492', 'weapon2': '1.840', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:30,732][52820] DAMAGECOUNT value on done: 7704.0 [2024-08-05 22:33:30,736][52820] Sum rewards: 8.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.238', 'AMMO2': '0.027', 'weapon4': '0.068', 'AMMO3': '0.121', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'ARMOR': '0.467', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.002', 'weapon3': '1.678', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:30,967][52659] DAMAGECOUNT value on done: 8323.0 [2024-08-05 22:33:30,967][52659] Sum rewards: 9.576, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.219', 'AMMO2': '0.020', 'AMMO3': '0.099', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.322', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '1.088', 'weapon3': '2.000', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:31,012][52666] DAMAGECOUNT value on done: 8657.0 [2024-08-05 22:33:31,012][52666] Sum rewards: 8.882, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.730', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon5': '0.060', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.268', 'HITCOUNT': '0.780', 'WEAPON3': '0.950', 'weapon2': '1.030', 'weapon3': '2.178', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:31,971][52671] DAMAGECOUNT value on done: 9203.0 [2024-08-05 22:33:31,972][52671] Sum rewards: 13.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.455', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon2': '1.278', 'weapon3': '1.716', 'DAMAGECOUNT': '3.627', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:32,088][52664] DAMAGECOUNT value on done: 9910.0 [2024-08-05 22:33:32,090][52664] Sum rewards: 13.986, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.119', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.248', 'ARMOR': '0.494', 'WEAPON3': '0.850', 'weapon2': '1.164', 'HITCOUNT': '1.230', 'weapon3': '2.364', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:32,457][52649] DAMAGECOUNT value on done: 8540.0 [2024-08-05 22:33:32,457][52649] Sum rewards: 13.605, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.257', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.032', 'weapon5': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.242', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon3': '1.618', 'weapon2': '1.644', 'DAMAGECOUNT': '3.627', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:32,734][52794] DAMAGECOUNT value on done: 10240.0 [2024-08-05 22:33:32,735][52794] Sum rewards: 8.204, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.432', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO3': '0.076', 'ARMOR': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.216', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.198', 'weapon3': '1.482', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16911.6). Total num frames: 69623808. Throughput: 0: 4229.6. Samples: 17406520. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:33:32,794][52567] Avg episode reward: [(0, '8.459')] [2024-08-05 22:33:33,012][52670] DAMAGECOUNT value on done: 10264.0 [2024-08-05 22:33:33,014][52670] Sum rewards: 12.171, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.130', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.282', 'WEAPON3': '0.300', 'HITCOUNT': '0.720', 'weapon3': '0.964', 'weapon2': '1.426', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:33,115][52658] DAMAGECOUNT value on done: 9000.0 [2024-08-05 22:33:33,118][52658] Sum rewards: 10.232, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.106', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.300', 'ARMOR': '0.476', 'weapon4': '0.492', 'weapon2': '0.728', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'weapon3': '2.086', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:33,370][52650] Updated weights for policy 0, policy_version 8501 (0.0014) [2024-08-05 22:33:33,636][52659] DAMAGECOUNT value on done: 8961.0 [2024-08-05 22:33:33,638][52659] Sum rewards: 8.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.804', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO3': '0.151', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon2': '1.426', 'weapon3': '2.150', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:33,746][52667] DAMAGECOUNT value on done: 9170.0 [2024-08-05 22:33:33,747][52667] Sum rewards: 9.267, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.430', 'AMMO4': '-0.068', 'AMMO2': '-0.014', 'AMMO3': '0.100', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.196', 'ARMOR': '1.421', 'weapon3': '1.686', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:34,128][52820] DAMAGECOUNT value on done: 8009.0 [2024-08-05 22:33:34,130][52820] Sum rewards: 13.126, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.674', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'ARMOR': '0.563', 'WEAPON3': '0.750', 'weapon4': '0.770', 'weapon2': '0.878', 'HITCOUNT': '1.000', 'weapon3': '1.524', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '12.000'} [2024-08-05 22:33:34,325][52666] DAMAGECOUNT value on done: 8108.0 [2024-08-05 22:33:34,326][52666] Sum rewards: 3.892, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.117', 'weapon7': '0.008', 'AMMO2': '0.021', 'AMMO3': '0.040', 'AMMO4': '0.105', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.350', 'WEAPON4': '0.350', 'HITCOUNT': '0.370', 'ARMOR': '0.552', 'weapon4': '0.628', 'weapon2': '0.802', 'weapon3': '1.034', 'DAMAGECOUNT': '1.149', 'FRAGCOUNT': '2.000'} [2024-08-05 22:33:34,613][52671] DAMAGECOUNT value on done: 9997.0 [2024-08-05 22:33:34,615][52671] Sum rewards: 11.399, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.817', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.278', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'ARMOR': '0.908', 'weapon2': '1.212', 'weapon3': '2.154', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:35,308][52664] DAMAGECOUNT value on done: 8847.0 [2024-08-05 22:33:35,308][52664] Sum rewards: 17.328, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.780', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.342', 'ARMOR': '0.448', 'WEAPON3': '1.000', 'weapon2': '1.008', 'HITCOUNT': '1.260', 'weapon3': '2.226', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '16.000'} [2024-08-05 22:33:35,668][52794] DAMAGECOUNT value on done: 10468.0 [2024-08-05 22:33:35,668][52794] Sum rewards: 7.866, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.640', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.228', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'ARMOR': '0.961', 'weapon2': '0.992', 'weapon3': '1.552', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:35,843][52649] DAMAGECOUNT value on done: 8953.0 [2024-08-05 22:33:35,845][52649] Sum rewards: 7.692, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.476', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.036', 'AMMO3': '0.147', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.562', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'ARMOR': '0.940', 'weapon2': '1.348', 'weapon3': '1.504', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:36,119][52658] DAMAGECOUNT value on done: 8353.0 [2024-08-05 22:33:36,121][52658] Sum rewards: 5.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.284', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon3': '1.398', 'weapon2': '1.650', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:36,121][52670] DAMAGECOUNT value on done: 8767.0 [2024-08-05 22:33:36,125][52670] Sum rewards: 4.750, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.090', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.085', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon3': '1.298', 'weapon2': '1.346', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:36,688][52659] DAMAGECOUNT value on done: 9231.0 [2024-08-05 22:33:36,690][52659] Sum rewards: 4.049, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.030', 'AMMO3': '0.061', 'AMMO4': '0.065', 'ARMOR': '0.088', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'WEAPON3': '0.500', 'weapon2': '0.620', 'weapon4': '0.986', 'weapon3': '1.416', 'DAMAGECOUNT': '1.437', 'FRAGCOUNT': '3.000'} [2024-08-05 22:33:36,795][52667] DAMAGECOUNT value on done: 9446.0 [2024-08-05 22:33:36,796][52667] Sum rewards: 8.278, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.431', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'ARMOR': '1.358', 'weapon2': '1.422', 'weapon3': '2.076', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:37,304][52666] DAMAGECOUNT value on done: 8450.0 [2024-08-05 22:33:37,304][52666] Sum rewards: 9.161, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.865', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'weapon5': '0.054', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.264', 'ARMOR': '0.459', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.110', 'weapon3': '1.462', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:37,416][52671] DAMAGECOUNT value on done: 9739.0 [2024-08-05 22:33:37,416][52671] Sum rewards: 9.600, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.795', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.100', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.530', 'weapon3': '1.808', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:37,458][52820] DAMAGECOUNT value on done: 8668.0 [2024-08-05 22:33:37,459][52820] Sum rewards: 9.115, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.070', 'weapon4': '0.116', 'HEALTH': '0.290', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'HITCOUNT': '0.780', 'weapon3': '1.518', 'weapon2': '1.712', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:37,795][52567] Fps is (10 sec: 16383.3, 60 sec: 16793.5, 300 sec: 16883.8). Total num frames: 69705728. Throughput: 0: 4224.2. Samples: 17431690. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:33:37,796][52567] Avg episode reward: [(0, '8.727')] [2024-08-05 22:33:37,992][52664] DAMAGECOUNT value on done: 8324.0 [2024-08-05 22:33:37,992][52664] Sum rewards: 11.116, reward structure: {'DEATHCOUNT': '-6.750', 'weapon4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.132', 'WEAPON3': '0.600', 'HEALTH': '0.610', 'ARMOR': '0.840', 'HITCOUNT': '0.900', 'weapon2': '1.324', 'weapon3': '1.464', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:38,083][52794] DAMAGECOUNT value on done: 11182.0 [2024-08-05 22:33:38,083][52794] Sum rewards: 9.246, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.536', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '1.272', 'weapon3': '1.380', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:38,310][52650] Updated weights for policy 0, policy_version 8511 (0.0022) [2024-08-05 22:33:38,671][52662] DAMAGECOUNT value on done: 10046.0 [2024-08-05 22:33:38,671][52662] Sum rewards: 8.134, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.038', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.467', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.490', 'weapon3': '1.810', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:38,697][52649] DAMAGECOUNT value on done: 10064.0 [2024-08-05 22:33:38,699][52649] Sum rewards: 13.099, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.029', 'AMMO4': '-0.081', 'AMMO2': '-0.016', 'AMMO3': '0.152', 'ARMOR': '0.865', 'WEAPON3': '1.100', 'HITCOUNT': '1.100', 'weapon2': '1.422', 'weapon3': '2.068', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '13.000'} [2024-08-05 22:33:39,064][52658] DAMAGECOUNT value on done: 9298.0 [2024-08-05 22:33:39,064][52658] Sum rewards: 8.852, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.174', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.117', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'ARMOR': '1.654', 'weapon2': '1.662', 'weapon3': '1.692', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:39,480][52670] DAMAGECOUNT value on done: 7894.0 [2024-08-05 22:33:39,480][52670] Sum rewards: 6.980, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.402', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.458', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '1.334', 'weapon3': '1.474', 'ARMOR': '1.701', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:39,574][52659] DAMAGECOUNT value on done: 8019.0 [2024-08-05 22:33:39,575][52659] Sum rewards: 10.521, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO2': '0.015', 'AMMO3': '0.073', 'AMMO4': '0.076', 'WEAPON4': '0.200', 'ARMOR': '0.408', 'weapon4': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '0.924', 'weapon3': '1.572', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:40,340][52671] DAMAGECOUNT value on done: 8997.0 [2024-08-05 22:33:40,340][52671] Sum rewards: 5.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.108', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.188', 'ARMOR': '0.497', 'HITCOUNT': '0.550', 'WEAPON3': '0.750', 'weapon3': '1.310', 'weapon2': '1.582', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:40,670][52794] DAMAGECOUNT value on done: 10850.0 [2024-08-05 22:33:40,670][52794] Sum rewards: 17.499, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.101', 'HEALTH': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'weapon2': '1.202', 'weapon3': '1.938', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '14.000'} [2024-08-05 22:33:40,688][52666] DAMAGECOUNT value on done: 9729.0 [2024-08-05 22:33:40,689][52666] Sum rewards: 5.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.966', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.266', 'ARMOR': '0.808', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'weapon2': '1.720', 'weapon3': '1.788', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:40,832][52820] DAMAGECOUNT value on done: 8628.0 [2024-08-05 22:33:40,835][52820] Sum rewards: 6.166, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.857', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.032', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon5': '0.124', 'WEAPON5': '0.150', 'HITCOUNT': '0.610', 'ARMOR': '0.882', 'WEAPON3': '0.900', 'weapon2': '1.452', 'weapon3': '2.020', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:41,149][52664] DAMAGECOUNT value on done: 8585.0 [2024-08-05 22:33:41,151][52664] Sum rewards: 7.615, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.937', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.099', 'WEAPON4': '0.250', 'ARMOR': '0.492', 'weapon4': '0.572', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '0.894', 'weapon3': '1.678', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:41,213][52662] DAMAGECOUNT value on done: 11107.0 [2024-08-05 22:33:41,214][52662] Sum rewards: 16.997, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.070', 'HEALTH': '0.331', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '1.100', 'weapon2': '1.428', 'weapon3': '1.684', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '12.000'} [2024-08-05 22:33:41,593][52649] DAMAGECOUNT value on done: 8464.0 [2024-08-05 22:33:41,596][52649] Sum rewards: 7.559, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.979', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.188', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'weapon4': '0.528', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'weapon2': '0.904', 'weapon3': '1.674', 'DAMAGECOUNT': '2.871', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:42,204][52658] DAMAGECOUNT value on done: 8839.0 [2024-08-05 22:33:42,205][52658] Sum rewards: 3.850, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO3': '0.051', 'weapon4': '0.056', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'HEALTH': '0.154', 'WEAPON3': '0.350', 'HITCOUNT': '0.390', 'weapon2': '0.886', 'weapon3': '1.274', 'DAMAGECOUNT': '1.413', 'FRAGCOUNT': '2.000'} [2024-08-05 22:33:42,237][52659] DAMAGECOUNT value on done: 9285.0 [2024-08-05 22:33:42,239][52659] Sum rewards: 18.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.120', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.274', 'WEAPON3': '0.600', 'ARMOR': '0.960', 'weapon2': '1.110', 'HITCOUNT': '1.160', 'weapon3': '1.520', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '16.000'} [2024-08-05 22:33:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16911.6). Total num frames: 69795840. Throughput: 0: 4222.7. Samples: 17457350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:33:42,794][52567] Avg episode reward: [(0, '8.770')] [2024-08-05 22:33:42,795][52614] Saving new best policy, reward=8.770! [2024-08-05 22:33:42,912][52670] DAMAGECOUNT value on done: 8252.0 [2024-08-05 22:33:42,912][52670] Sum rewards: 8.162, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.512', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '0.980', 'weapon3': '1.648', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:43,072][52650] Updated weights for policy 0, policy_version 8521 (0.0033) [2024-08-05 22:33:43,142][52671] DAMAGECOUNT value on done: 9619.0 [2024-08-05 22:33:43,149][52671] Sum rewards: 3.387, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.026', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'HITCOUNT': '0.280', 'WEAPON3': '0.400', 'HEALTH': '0.408', 'ARMOR': '0.428', 'weapon4': '0.590', 'DAMAGECOUNT': '0.915', 'weapon2': '1.256', 'weapon3': '1.286', 'FRAGCOUNT': '2.000'} [2024-08-05 22:33:43,243][52794] DAMAGECOUNT value on done: 10580.0 [2024-08-05 22:33:43,243][52794] Sum rewards: 6.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.095', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.276', 'HITCOUNT': '0.950', 'weapon2': '0.982', 'WEAPON3': '1.100', 'ARMOR': '1.316', 'weapon3': '2.300', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '8.500'} [2024-08-05 22:33:43,752][52662] DAMAGECOUNT value on done: 10878.0 [2024-08-05 22:33:43,752][52662] Sum rewards: 8.408, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.296', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO3': '0.119', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'weapon2': '1.300', 'ARMOR': '1.332', 'weapon3': '2.064', 'DAMAGECOUNT': '2.481', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:44,113][52666] DAMAGECOUNT value on done: 8737.0 [2024-08-05 22:33:44,115][52666] Sum rewards: 9.398, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.882', 'weapon4': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.856', 'weapon2': '1.240', 'weapon3': '1.672', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:44,243][52649] DAMAGECOUNT value on done: 10096.0 [2024-08-05 22:33:44,244][52649] Sum rewards: 12.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.830', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.020', 'ARMOR': '0.020', 'weapon7': '0.056', 'AMMO3': '0.095', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '0.872', 'weapon3': '1.416', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:44,666][52664] DAMAGECOUNT value on done: 8135.0 [2024-08-05 22:33:44,667][52664] Sum rewards: 7.972, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.326', 'ARMOR': '0.448', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon2': '1.284', 'weapon3': '1.756', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:45,224][52658] DAMAGECOUNT value on done: 10177.0 [2024-08-05 22:33:45,224][52658] Sum rewards: 7.304, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.515', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.342', 'ARMOR': '0.531', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '1.276', 'weapon3': '1.348', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:45,697][52659] DAMAGECOUNT value on done: 9948.0 [2024-08-05 22:33:45,701][52659] Sum rewards: 7.995, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.165', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '0.976', 'weapon3': '1.366', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:45,735][52794] DAMAGECOUNT value on done: 10988.0 [2024-08-05 22:33:45,736][52794] Sum rewards: 8.338, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'HEALTH': '0.246', 'weapon4': '0.438', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon2': '1.154', 'ARMOR': '1.245', 'weapon3': '1.622', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:46,179][52670] DAMAGECOUNT value on done: 7418.0 [2024-08-05 22:33:46,181][52670] Sum rewards: 9.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.074', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.115', 'weapon4': '0.338', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.280', 'ARMOR': '1.324', 'weapon3': '1.940', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:46,357][52662] DAMAGECOUNT value on done: 10562.0 [2024-08-05 22:33:46,357][52662] Sum rewards: 20.711, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.122', 'WEAPON3': '0.900', 'weapon2': '1.416', 'ARMOR': '1.420', 'HITCOUNT': '1.430', 'weapon3': '2.306', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '17.000'} [2024-08-05 22:33:46,686][52671] DAMAGECOUNT value on done: 10799.0 [2024-08-05 22:33:46,687][52671] Sum rewards: 6.046, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'ARMOR': '0.048', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.508', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '0.916', 'weapon3': '1.916', 'DAMAGECOUNT': '2.523', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:47,208][52666] DAMAGECOUNT value on done: 8369.0 [2024-08-05 22:33:47,208][52666] Sum rewards: 8.923, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'HEALTH': '0.028', 'WEAPON4': '0.050', 'ARMOR': '0.065', 'AMMO3': '0.079', 'AMMO4': '0.081', 'weapon4': '0.390', 'WEAPON3': '0.500', 'HITCOUNT': '0.580', 'weapon3': '1.204', 'weapon2': '1.494', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:47,603][52649] DAMAGECOUNT value on done: 8770.0 [2024-08-05 22:33:47,603][52649] Sum rewards: 11.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.256', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.300', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon2': '1.104', 'weapon3': '1.672', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:47,794][52567] Fps is (10 sec: 17203.9, 60 sec: 16793.6, 300 sec: 16911.6). Total num frames: 69877760. Throughput: 0: 4216.2. Samples: 17469680. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 22:33:47,794][52567] Avg episode reward: [(0, '8.876')] [2024-08-05 22:33:47,797][52614] Saving new best policy, reward=8.876! [2024-08-05 22:33:48,197][52664] DAMAGECOUNT value on done: 9637.0 [2024-08-05 22:33:48,197][52664] Sum rewards: 5.779, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.482', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.040', 'ARMOR': '0.068', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.194', 'weapon3': '1.698', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:48,266][52650] Updated weights for policy 0, policy_version 8531 (0.0039) [2024-08-05 22:33:48,445][52794] DAMAGECOUNT value on done: 9852.0 [2024-08-05 22:33:48,445][52794] Sum rewards: 7.284, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.101', 'WEAPON4': '0.300', 'weapon2': '0.364', 'weapon4': '0.444', 'ARMOR': '0.550', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon3': '2.292', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:48,492][52659] DAMAGECOUNT value on done: 9876.0 [2024-08-05 22:33:48,494][52659] Sum rewards: 8.640, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.017', 'AMMO3': '0.068', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HEALTH': '0.236', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.600', 'weapon3': '0.918', 'weapon2': '1.414', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:48,503][52658] DAMAGECOUNT value on done: 9588.0 [2024-08-05 22:33:48,503][52658] Sum rewards: 5.191, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.050', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'ARMOR': '0.471', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon3': '1.268', 'weapon2': '2.006', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:48,778][52670] DAMAGECOUNT value on done: 9679.0 [2024-08-05 22:33:48,778][52670] Sum rewards: 10.631, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.595', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.061', 'AMMO3': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.272', 'weapon3': '1.876', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:49,316][52662] DAMAGECOUNT value on done: 10240.0 [2024-08-05 22:33:49,316][52662] Sum rewards: 6.057, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.916', 'AMMO2': '0.014', 'AMMO3': '0.060', 'weapon7': '0.068', 'AMMO4': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon3': '0.968', 'weapon2': '1.282', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:49,600][52671] DAMAGECOUNT value on done: 8682.0 [2024-08-05 22:33:49,604][52671] Sum rewards: 7.401, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.340', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'weapon7': '0.048', 'AMMO3': '0.085', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '1.268', 'weapon3': '1.368', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:49,847][52666] DAMAGECOUNT value on done: 9173.0 [2024-08-05 22:33:49,849][52666] Sum rewards: 13.014, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.122', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.106', 'weapon5': '0.122', 'weapon4': '0.326', 'ARMOR': '0.492', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.256', 'weapon3': '1.654', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '12.000'} [2024-08-05 22:33:50,240][52649] DAMAGECOUNT value on done: 9809.0 [2024-08-05 22:33:50,241][52649] Sum rewards: 7.008, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.470', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon3': '1.368', 'weapon2': '1.496', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:50,996][52794] DAMAGECOUNT value on done: 9125.0 [2024-08-05 22:33:50,997][52794] Sum rewards: 10.113, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.872', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.054', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.456', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.008', 'weapon3': '1.194', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:51,437][52658] DAMAGECOUNT value on done: 9329.0 [2024-08-05 22:33:51,437][52658] Sum rewards: 9.716, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.290', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.060', 'ARMOR': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '1.038', 'weapon3': '1.390', 'DAMAGECOUNT': '2.403', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:51,514][52659] DAMAGECOUNT value on done: 9196.0 [2024-08-05 22:33:51,514][52659] Sum rewards: 6.039, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.329', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'AMMO3': '0.090', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.352', 'weapon3': '1.672', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '4.500'} [2024-08-05 22:33:51,611][52664] DAMAGECOUNT value on done: 7583.0 [2024-08-05 22:33:51,613][52664] Sum rewards: 2.830, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.696', 'AMMO2': '0.022', 'AMMO3': '0.093', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.276', 'HITCOUNT': '0.360', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'weapon3': '1.110', 'DAMAGECOUNT': '1.293', 'weapon2': '2.006', 'FRAGCOUNT': '3.000'} [2024-08-05 22:33:51,812][52670] DAMAGECOUNT value on done: 8371.0 [2024-08-05 22:33:51,815][52670] Sum rewards: 3.549, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.162', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.034', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.540', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.848', 'weapon3': '1.516', 'DAMAGECOUNT': '1.665', 'FRAGCOUNT': '3.000'} [2024-08-05 22:33:51,841][52662] DAMAGECOUNT value on done: 11712.0 [2024-08-05 22:33:51,844][52662] Sum rewards: 13.778, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.472', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.048', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.362', 'WEAPON3': '0.600', 'ARMOR': '0.877', 'HITCOUNT': '1.000', 'weapon2': '1.144', 'weapon3': '1.750', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:52,424][52650] Updated weights for policy 0, policy_version 8541 (0.0047) [2024-08-05 22:33:52,464][52671] DAMAGECOUNT value on done: 9154.0 [2024-08-05 22:33:52,465][52671] Sum rewards: 7.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.436', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.240', 'HITCOUNT': '0.830', 'ARMOR': '0.883', 'WEAPON3': '1.000', 'weapon2': '1.370', 'weapon3': '1.864', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '9.000'} [2024-08-05 22:33:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16911.6). Total num frames: 69967872. Throughput: 0: 4211.3. Samples: 17494770. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 22:33:52,794][52567] Avg episode reward: [(0, '8.928')] [2024-08-05 22:33:52,795][52614] Saving new best policy, reward=8.928! [2024-08-05 22:33:53,127][52666] DAMAGECOUNT value on done: 8680.0 [2024-08-05 22:33:53,127][52666] Sum rewards: 4.118, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.157', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon4': '0.062', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'HITCOUNT': '0.410', 'WEAPON3': '0.550', 'weapon2': '0.854', 'weapon3': '1.016', 'ARMOR': '1.296', 'DAMAGECOUNT': '1.383', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:53,495][52794] DAMAGECOUNT value on done: 12298.0 [2024-08-05 22:33:53,496][52794] Sum rewards: 10.036, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.666', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon4': '0.204', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon2': '1.222', 'weapon3': '1.666', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:54,202][52662] DAMAGECOUNT value on done: 11232.0 [2024-08-05 22:33:54,204][52662] Sum rewards: 11.396, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.782', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon4': '0.238', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon2': '1.424', 'weapon3': '1.816', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:54,233][52659] DAMAGECOUNT value on done: 9104.0 [2024-08-05 22:33:54,233][52659] Sum rewards: 10.199, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.842', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.090', 'weapon5': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.456', 'ARMOR': '0.511', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.198', 'weapon3': '1.688', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:54,767][52658] DAMAGECOUNT value on done: 8626.0 [2024-08-05 22:33:54,767][52658] Sum rewards: 2.897, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.335', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'HITCOUNT': '0.260', 'weapon4': '0.390', 'WEAPON3': '0.450', 'ARMOR': '0.542', 'DAMAGECOUNT': '0.792', 'weapon2': '0.956', 'weapon3': '1.398', 'FRAGCOUNT': '2.000'} [2024-08-05 22:33:54,981][52664] DAMAGECOUNT value on done: 8798.0 [2024-08-05 22:33:54,984][52664] Sum rewards: 6.987, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'ARMOR': '0.016', 'AMMO4': '0.055', 'weapon4': '0.062', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon3': '1.648', 'weapon2': '1.726', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:55,064][52670] DAMAGECOUNT value on done: 8209.0 [2024-08-05 22:33:55,066][52670] Sum rewards: 8.569, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.108', 'weapon4': '0.192', 'WEAPON3': '0.650', 'ARMOR': '0.888', 'HITCOUNT': '1.010', 'weapon2': '1.230', 'weapon3': '1.490', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:55,306][52671] DAMAGECOUNT value on done: 9187.0 [2024-08-05 22:33:55,307][52671] Sum rewards: 7.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.452', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.072', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'HITCOUNT': '0.890', 'ARMOR': '0.914', 'WEAPON3': '1.200', 'weapon2': '1.350', 'weapon3': '2.030', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:56,092][52794] DAMAGECOUNT value on done: 10655.0 [2024-08-05 22:33:56,092][52794] Sum rewards: 18.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.948', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.206', 'ARMOR': '0.533', 'WEAPON3': '0.800', 'HITCOUNT': '1.360', 'weapon2': '1.700', 'weapon3': '1.884', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '15.000'} [2024-08-05 22:33:56,310][52666] DAMAGECOUNT value on done: 9121.0 [2024-08-05 22:33:56,312][52666] Sum rewards: 3.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.620', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon4': '0.228', 'ARMOR': '0.492', 'HITCOUNT': '0.940', 'weapon2': '1.132', 'WEAPON3': '1.150', 'weapon3': '2.078', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '6.000'} [2024-08-05 22:33:56,756][52662] DAMAGECOUNT value on done: 11504.0 [2024-08-05 22:33:56,756][52662] Sum rewards: 5.316, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'ARMOR': '0.458', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon3': '1.658', 'weapon2': '2.060', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:57,178][52659] DAMAGECOUNT value on done: 9900.0 [2024-08-05 22:33:57,179][52659] Sum rewards: 4.030, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.667', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.024', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.096', 'AMMO4': '0.115', 'WEAPON4': '0.300', 'weapon4': '0.484', 'HITCOUNT': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.718', 'DAMAGECOUNT': '1.560', 'weapon3': '1.860', 'FRAGCOUNT': '5.000'} [2024-08-05 22:33:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.0, 300 sec: 16883.9). Total num frames: 70041600. Throughput: 0: 4225.5. Samples: 17520120. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:33:57,795][52567] Avg episode reward: [(0, '8.876')] [2024-08-05 22:33:57,834][52650] Updated weights for policy 0, policy_version 8551 (0.0049) [2024-08-05 22:33:57,870][52671] DAMAGECOUNT value on done: 8202.0 [2024-08-05 22:33:57,871][52671] Sum rewards: 3.537, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.414', 'HITCOUNT': '0.510', 'WEAPON3': '0.600', 'weapon2': '0.974', 'DAMAGECOUNT': '1.494', 'weapon3': '1.494', 'FRAGCOUNT': '3.000'} [2024-08-05 22:33:57,942][52664] DAMAGECOUNT value on done: 8975.0 [2024-08-05 22:33:57,944][52664] Sum rewards: 9.627, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.185', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'ARMOR': '0.458', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.558', 'weapon3': '1.874', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '10.000'} [2024-08-05 22:33:57,969][52658] DAMAGECOUNT value on done: 9845.0 [2024-08-05 22:33:57,969][52658] Sum rewards: 13.517, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.070', 'HEALTH': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.148', 'weapon4': '0.176', 'WEAPON3': '0.450', 'HITCOUNT': '0.720', 'ARMOR': '0.847', 'weapon2': '1.310', 'weapon3': '1.354', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:58,261][52670] DAMAGECOUNT value on done: 8290.0 [2024-08-05 22:33:58,261][52670] Sum rewards: 7.764, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.330', 'AMMO2': '0.027', 'ARMOR': '0.048', 'AMMO3': '0.128', 'AMMO4': '0.132', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '0.984', 'weapon3': '1.752', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:58,583][52794] DAMAGECOUNT value on done: 10896.0 [2024-08-05 22:33:58,583][52794] Sum rewards: 10.666, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.506', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.076', 'WEAPON3': '0.550', 'ARMOR': '0.898', 'HITCOUNT': '0.980', 'weapon2': '1.090', 'weapon3': '1.446', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '8.000'} [2024-08-05 22:33:59,042][52668] DAMAGECOUNT value on done: 8693.0 [2024-08-05 22:33:59,043][52668] Sum rewards: 8.613, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.234', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon3': '1.404', 'weapon2': '1.638', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '7.000'} [2024-08-05 22:33:59,239][52662] DAMAGECOUNT value on done: 10606.0 [2024-08-05 22:33:59,239][52662] Sum rewards: 3.008, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.770', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'weapon4': '0.058', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'ARMOR': '0.890', 'DAMAGECOUNT': '1.395', 'weapon2': '1.510', 'weapon3': '1.574', 'FRAGCOUNT': '4.000'} [2024-08-05 22:33:59,741][52666] DAMAGECOUNT value on done: 8632.0 [2024-08-05 22:33:59,743][52666] Sum rewards: 13.630, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.747', 'AMMO4': '-0.119', 'AMMO2': '-0.024', 'AMMO3': '0.086', 'ARMOR': '0.474', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon3': '1.248', 'weapon2': '1.804', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '11.000'} [2024-08-05 22:33:59,865][52659] DAMAGECOUNT value on done: 9570.0 [2024-08-05 22:33:59,867][52659] Sum rewards: 7.341, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.020', 'AMMO3': '0.090', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.206', 'HEALTH': '0.288', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'ARMOR': '0.879', 'weapon3': '1.214', 'weapon2': '1.338', 'DAMAGECOUNT': '2.124', 'FRAGCOUNT': '5.000'} [2024-08-05 22:34:00,538][52671] DAMAGECOUNT value on done: 10997.0 [2024-08-05 22:34:00,539][52671] Sum rewards: 16.674, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.742', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.110', 'weapon3': '1.760', 'weapon2': '1.902', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '13.000'} [2024-08-05 22:34:01,119][52794] DAMAGECOUNT value on done: 11098.0 [2024-08-05 22:34:01,119][52794] Sum rewards: 13.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.173', 'weapon4': '0.252', 'ARMOR': '0.420', 'weapon2': '0.990', 'WEAPON3': '1.100', 'HITCOUNT': '1.310', 'weapon3': '2.486', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '14.000'} [2024-08-05 22:34:01,376][52670] DAMAGECOUNT value on done: 7802.0 [2024-08-05 22:34:01,377][52670] Sum rewards: 2.248, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.389', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.354', 'HITCOUNT': '0.380', 'WEAPON3': '0.700', 'weapon2': '0.864', 'ARMOR': '0.901', 'DAMAGECOUNT': '1.308', 'weapon3': '1.452', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:01,622][52664] DAMAGECOUNT value on done: 8490.0 [2024-08-05 22:34:01,623][52664] Sum rewards: 7.774, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.415', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon4': '0.064', 'AMMO4': '0.129', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'weapon2': '0.958', 'weapon3': '2.102', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:01,624][52668] DAMAGECOUNT value on done: 10612.0 [2024-08-05 22:34:01,625][52668] Sum rewards: 3.839, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.146', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.093', 'weapon4': '0.130', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.892', 'weapon2': '1.188', 'weapon3': '1.564', 'DAMAGECOUNT': '1.773', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:02,034][52662] DAMAGECOUNT value on done: 10904.0 [2024-08-05 22:34:02,035][52662] Sum rewards: 2.620, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.212', 'HITCOUNT': '0.580', 'WEAPON3': '0.850', 'weapon2': '1.236', 'weapon3': '1.310', 'ARMOR': '1.328', 'DAMAGECOUNT': '1.944', 'FRAGCOUNT': '5.000'} [2024-08-05 22:34:02,526][52650] Updated weights for policy 0, policy_version 8561 (0.0012) [2024-08-05 22:34:02,576][52659] DAMAGECOUNT value on done: 10614.0 [2024-08-05 22:34:02,577][52659] Sum rewards: 15.585, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.723', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.128', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.967', 'HITCOUNT': '1.310', 'weapon2': '1.588', 'weapon3': '1.712', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '13.000'} [2024-08-05 22:34:02,758][52666] DAMAGECOUNT value on done: 7854.0 [2024-08-05 22:34:02,761][52666] Sum rewards: 7.374, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.454', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.560', 'weapon4': '0.622', 'WEAPON3': '0.700', 'weapon2': '0.916', 'ARMOR': '0.933', 'weapon3': '1.684', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:02,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16930.1, 300 sec: 16883.9). Total num frames: 70131712. Throughput: 0: 4228.2. Samples: 17532920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:34:02,795][52567] Avg episode reward: [(0, '8.871')] [2024-08-05 22:34:03,257][52671] DAMAGECOUNT value on done: 9160.0 [2024-08-05 22:34:03,258][52671] Sum rewards: 12.841, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.885', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'weapon4': '0.272', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '1.294', 'ARMOR': '1.392', 'weapon3': '1.410', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:03,523][52794] DAMAGECOUNT value on done: 10244.0 [2024-08-05 22:34:03,523][52794] Sum rewards: 11.766, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.477', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO3': '0.063', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '0.936', 'weapon3': '1.420', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '10.000'} [2024-08-05 22:34:04,245][52668] DAMAGECOUNT value on done: 7737.0 [2024-08-05 22:34:04,245][52668] Sum rewards: 7.965, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.026', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.206', 'HEALTH': '0.244', 'WEAPON3': '0.350', 'HITCOUNT': '0.670', 'weapon3': '0.998', 'weapon2': '1.240', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '5.000'} [2024-08-05 22:34:04,282][52660] DAMAGECOUNT value on done: 9466.0 [2024-08-05 22:34:04,285][52660] Sum rewards: 8.588, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.390', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'ARMOR': '0.032', 'AMMO3': '0.050', 'weapon7': '0.054', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.400', 'HITCOUNT': '0.510', 'weapon3': '1.110', 'DAMAGECOUNT': '1.557', 'weapon2': '1.566', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:04,559][52662] DAMAGECOUNT value on done: 10340.0 [2024-08-05 22:34:04,560][52662] Sum rewards: 5.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.636', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.104', 'ARMOR': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.540', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon2': '1.046', 'weapon3': '1.360', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '5.000'} [2024-08-05 22:34:04,605][52670] DAMAGECOUNT value on done: 9537.0 [2024-08-05 22:34:04,607][52670] Sum rewards: 8.063, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.660', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'AMMO3': '0.062', 'WEAPON4': '0.200', 'weapon4': '0.418', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon2': '1.214', 'weapon3': '1.328', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:04,910][52659] DAMAGECOUNT value on done: 8975.0 [2024-08-05 22:34:04,911][52659] Sum rewards: 13.458, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.522', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'WEAPON3': '0.800', 'ARMOR': '0.880', 'weapon2': '1.018', 'HITCOUNT': '1.150', 'weapon3': '2.018', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '12.000'} [2024-08-05 22:34:05,193][52664] DAMAGECOUNT value on done: 9621.0 [2024-08-05 22:34:05,194][52664] Sum rewards: 7.948, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.726', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'AMMO3': '0.060', 'weapon5': '0.070', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.860', 'weapon3': '1.466', 'weapon2': '1.670', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:05,556][52671] DAMAGECOUNT value on done: 9614.0 [2024-08-05 22:34:05,558][52671] Sum rewards: 12.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.285', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'ARMOR': '0.854', 'WEAPON3': '0.900', 'HITCOUNT': '1.130', 'weapon2': '1.598', 'weapon3': '1.878', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '12.000'} [2024-08-05 22:34:06,136][52794] DAMAGECOUNT value on done: 12607.0 [2024-08-05 22:34:06,137][52794] Sum rewards: 13.845, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.045', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'HEALTH': '0.119', 'weapon5': '0.146', 'weapon4': '0.310', 'WEAPON3': '0.350', 'HITCOUNT': '0.940', 'weapon2': '1.066', 'weapon3': '1.262', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:06,215][52666] DAMAGECOUNT value on done: 7834.0 [2024-08-05 22:34:06,217][52666] Sum rewards: 10.061, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.460', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.268', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon2': '1.454', 'weapon3': '1.678', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:06,829][52662] DAMAGECOUNT value on done: 10098.0 [2024-08-05 22:34:06,829][52662] Sum rewards: 14.112, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.013', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.110', 'ARMOR': '0.432', 'weapon4': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.190', 'weapon3': '1.990', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '12.000'} [2024-08-05 22:34:06,966][52668] DAMAGECOUNT value on done: 8138.0 [2024-08-05 22:34:06,966][52668] Sum rewards: 11.274, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.222', 'AMMO2': '0.029', 'AMMO3': '0.108', 'AMMO4': '0.142', 'weapon4': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon2': '1.254', 'weapon3': '1.726', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:06,973][52660] DAMAGECOUNT value on done: 10826.0 [2024-08-05 22:34:06,976][52660] Sum rewards: 2.787, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.463', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.018', 'weapon7': '0.052', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.478', 'weapon4': '0.558', 'HITCOUNT': '0.640', 'weapon2': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.052', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '3.000'} [2024-08-05 22:34:07,612][52650] Updated weights for policy 0, policy_version 8571 (0.0023) [2024-08-05 22:34:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 16883.9). Total num frames: 70213632. Throughput: 0: 4220.9. Samples: 17558130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:34:07,794][52567] Avg episode reward: [(0, '8.831')] [2024-08-05 22:34:07,828][52670] DAMAGECOUNT value on done: 9956.0 [2024-08-05 22:34:07,829][52670] Sum rewards: 4.774, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.345', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.186', 'weapon4': '0.256', 'WEAPON3': '0.450', 'HITCOUNT': '0.500', 'ARMOR': '1.008', 'weapon2': '1.106', 'weapon3': '1.122', 'DAMAGECOUNT': '1.689', 'FRAGCOUNT': '3.000'} [2024-08-05 22:34:07,963][52659] DAMAGECOUNT value on done: 8871.0 [2024-08-05 22:34:07,966][52659] Sum rewards: 2.105, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.280', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'HITCOUNT': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.024', 'DAMAGECOUNT': '1.485', 'weapon3': '1.944', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:08,642][52794] DAMAGECOUNT value on done: 10760.0 [2024-08-05 22:34:08,650][52794] Sum rewards: 9.596, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.843', 'weapon4': '0.006', 'AMMO2': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.048', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.700', 'weapon2': '0.844', 'weapon3': '1.474', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:09,237][52666] DAMAGECOUNT value on done: 8933.0 [2024-08-05 22:34:09,239][52666] Sum rewards: 6.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.030', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon4': '0.388', 'ARMOR': '0.536', 'weapon2': '0.670', 'HITCOUNT': '1.370', 'WEAPON3': '1.650', 'weapon3': '2.620', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '11.000'} [2024-08-05 22:34:09,269][52662] DAMAGECOUNT value on done: 11076.0 [2024-08-05 22:34:09,269][52662] Sum rewards: 11.762, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.327', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'WEAPON5': '0.100', 'weapon5': '0.154', 'weapon4': '0.256', 'WEAPON3': '0.400', 'HITCOUNT': '0.680', 'weapon3': '1.190', 'ARMOR': '1.424', 'weapon2': '1.728', 'DAMAGECOUNT': '2.514', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:09,737][52668] DAMAGECOUNT value on done: 9293.0 [2024-08-05 22:34:09,738][52668] Sum rewards: 10.145, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.950', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.096', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'ARMOR': '0.905', 'weapon3': '0.970', 'weapon2': '1.046', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:09,747][52660] DAMAGECOUNT value on done: 8310.0 [2024-08-05 22:34:09,750][52660] Sum rewards: 8.619, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.875', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.212', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'ARMOR': '0.912', 'weapon2': '0.968', 'weapon3': '1.558', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:10,665][52659] DAMAGECOUNT value on done: 7120.0 [2024-08-05 22:34:10,667][52659] Sum rewards: 8.616, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.819', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'weapon4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'HITCOUNT': '0.910', 'ARMOR': '0.955', 'WEAPON3': '1.000', 'weapon2': '1.032', 'weapon3': '2.482', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:11,044][52794] DAMAGECOUNT value on done: 11853.0 [2024-08-05 22:34:11,045][52794] Sum rewards: 6.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.154', 'weapon4': '0.392', 'WEAPON4': '0.400', 'weapon2': '0.822', 'HITCOUNT': '0.890', 'ARMOR': '0.970', 'WEAPON3': '1.050', 'weapon3': '2.198', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:11,384][52670] DAMAGECOUNT value on done: 10226.0 [2024-08-05 22:34:11,386][52670] Sum rewards: 16.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.097', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.084', 'AMMO3': '0.161', 'ARMOR': '0.448', 'WEAPON3': '0.950', 'weapon2': '1.140', 'HITCOUNT': '1.490', 'weapon3': '2.408', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '16.000'} [2024-08-05 22:34:11,667][52662] DAMAGECOUNT value on done: 10978.0 [2024-08-05 22:34:11,669][52662] Sum rewards: 6.904, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.157', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'ARMOR': '0.836', 'weapon2': '1.290', 'weapon3': '2.174', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:12,342][52650] Updated weights for policy 0, policy_version 8581 (0.0023) [2024-08-05 22:34:12,783][52666] DAMAGECOUNT value on done: 8723.0 [2024-08-05 22:34:12,787][52666] Sum rewards: 8.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.286', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'AMMO5': '0.007', 'AMMO3': '0.090', 'weapon5': '0.128', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon3': '1.692', 'weapon2': '1.770', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 16911.6). Total num frames: 70303744. Throughput: 0: 4217.3. Samples: 17583590. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-05 22:34:12,794][52567] Avg episode reward: [(0, '8.806')] [2024-08-05 22:34:12,888][52668] DAMAGECOUNT value on done: 8917.0 [2024-08-05 22:34:12,888][52668] Sum rewards: 8.466, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.079', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'AMMO3': '0.076', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.142', 'WEAPON3': '0.600', 'HITCOUNT': '0.660', 'weapon3': '1.264', 'ARMOR': '1.324', 'weapon2': '1.584', 'DAMAGECOUNT': '2.094', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:12,903][52660] DAMAGECOUNT value on done: 8704.0 [2024-08-05 22:34:12,904][52660] Sum rewards: 1.914, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.586', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.272', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '0.979', 'weapon2': '1.222', 'DAMAGECOUNT': '1.635', 'weapon3': '1.712', 'FRAGCOUNT': '3.000'} [2024-08-05 22:34:13,570][52794] DAMAGECOUNT value on done: 12263.0 [2024-08-05 22:34:13,571][52794] Sum rewards: 5.812, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'ARMOR': '0.952', 'weapon2': '1.562', 'weapon3': '1.634', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:13,587][52659] DAMAGECOUNT value on done: 8742.0 [2024-08-05 22:34:13,588][52659] Sum rewards: 7.405, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.310', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.424', 'ARMOR': '0.469', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon2': '1.054', 'weapon3': '1.272', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:14,212][52662] DAMAGECOUNT value on done: 10083.0 [2024-08-05 22:34:14,212][52662] Sum rewards: 4.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.232', 'ARMOR': '0.400', 'HITCOUNT': '0.880', 'WEAPON3': '1.000', 'weapon2': '1.406', 'weapon3': '2.126', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:14,853][52670] DAMAGECOUNT value on done: 9595.0 [2024-08-05 22:34:14,855][52670] Sum rewards: 9.601, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO2': '0.031', 'HEALTH': '0.046', 'ARMOR': '0.088', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.582', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon4': '0.670', 'weapon3': '1.700', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:15,869][52794] DAMAGECOUNT value on done: 10925.0 [2024-08-05 22:34:15,870][52794] Sum rewards: 8.173, reward structure: {'DEATHCOUNT': '-7.500', 'weapon4': '0.018', 'AMMO2': '0.026', 'HEALTH': '0.090', 'AMMO3': '0.119', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'ARMOR': '0.467', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.232', 'weapon3': '2.028', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:16,057][52668] DAMAGECOUNT value on done: 10669.0 [2024-08-05 22:34:16,058][52668] Sum rewards: 5.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.773', 'AMMO2': '0.030', 'AMMO3': '0.147', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.502', 'HITCOUNT': '0.820', 'weapon2': '0.896', 'WEAPON3': '0.950', 'ARMOR': '1.378', 'weapon3': '1.998', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:16,061][52660] DAMAGECOUNT value on done: 7703.0 [2024-08-05 22:34:16,064][52660] Sum rewards: 0.776, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.272', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'HITCOUNT': '0.550', 'ARMOR': '0.568', 'WEAPON3': '1.000', 'weapon2': '1.244', 'DAMAGECOUNT': '1.791', 'weapon3': '1.964', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:16,066][52666] DAMAGECOUNT value on done: 8349.0 [2024-08-05 22:34:16,068][52666] Sum rewards: 10.514, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.180', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'weapon7': '0.046', 'ARMOR': '0.048', 'AMMO3': '0.056', 'weapon5': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.044', 'weapon2': '1.140', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:16,770][52662] DAMAGECOUNT value on done: 11466.0 [2024-08-05 22:34:16,770][52662] Sum rewards: 7.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.927', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'ARMOR': '0.498', 'weapon4': '0.574', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.054', 'weapon3': '1.634', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:16,907][52650] Updated weights for policy 0, policy_version 8591 (0.0019) [2024-08-05 22:34:17,589][52670] DAMAGECOUNT value on done: 9190.0 [2024-08-05 22:34:17,589][52670] Sum rewards: 7.091, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.014', 'HEALTH': '0.032', 'AMMO4': '0.070', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'ARMOR': '0.840', 'weapon2': '0.936', 'weapon3': '1.964', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 16911.6). Total num frames: 70385664. Throughput: 0: 4223.3. Samples: 17596570. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:34:17,794][52567] Avg episode reward: [(0, '8.418')] [2024-08-05 22:34:18,498][52666] DAMAGECOUNT value on done: 9134.0 [2024-08-05 22:34:18,499][52666] Sum rewards: 15.387, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.813', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.850', 'weapon2': '0.940', 'ARMOR': '1.265', 'HITCOUNT': '1.280', 'weapon3': '2.254', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '12.000'} [2024-08-05 22:34:19,216][52660] DAMAGECOUNT value on done: 10622.0 [2024-08-05 22:34:19,216][52660] Sum rewards: 12.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.984', 'AMMO2': '0.012', 'weapon4': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.254', 'weapon3': '1.726', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '11.000'} [2024-08-05 22:34:19,251][52668] DAMAGECOUNT value on done: 8661.0 [2024-08-05 22:34:19,252][52668] Sum rewards: 11.754, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'weapon4': '0.294', 'HEALTH': '0.474', 'WEAPON3': '0.500', 'ARMOR': '0.824', 'HITCOUNT': '0.900', 'weapon3': '1.458', 'weapon2': '1.548', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:19,313][52794] DAMAGECOUNT value on done: 10943.0 [2024-08-05 22:34:19,316][52794] Sum rewards: 7.864, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.020', 'AMMO2': '0.026', 'ARMOR': '0.044', 'AMMO3': '0.085', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.274', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.230', 'weapon3': '1.750', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:19,983][52662] DAMAGECOUNT value on done: 10524.0 [2024-08-05 22:34:19,983][52662] Sum rewards: 9.221, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.396', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.358', 'WEAPON3': '0.900', 'HITCOUNT': '0.930', 'weapon2': '1.074', 'ARMOR': '1.276', 'weapon3': '2.134', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:20,142][52670] DAMAGECOUNT value on done: 8449.0 [2024-08-05 22:34:20,143][52670] Sum rewards: 2.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.388', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.090', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'ARMOR': '0.925', 'weapon2': '1.676', 'weapon3': '1.848', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:21,477][52666] DAMAGECOUNT value on done: 7378.0 [2024-08-05 22:34:21,479][52666] Sum rewards: 6.157, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.790', 'AMMO2': '0.019', 'weapon7': '0.068', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.416', 'WEAPON3': '0.750', 'ARMOR': '0.925', 'HITCOUNT': '0.980', 'weapon2': '1.474', 'weapon3': '1.868', 'DAMAGECOUNT': '3.249', 'FRAGCOUNT': '5.000'} [2024-08-05 22:34:21,509][52794] DAMAGECOUNT value on done: 11111.0 [2024-08-05 22:34:21,510][52794] Sum rewards: 8.299, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.853', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.020', 'AMMO3': '0.048', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.350', 'ARMOR': '0.420', 'HITCOUNT': '0.450', 'weapon3': '0.616', 'weapon2': '1.282', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:21,930][52650] Updated weights for policy 0, policy_version 8601 (0.0017) [2024-08-05 22:34:22,014][52660] DAMAGECOUNT value on done: 8849.0 [2024-08-05 22:34:22,015][52660] Sum rewards: 5.133, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.052', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.392', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'ARMOR': '0.867', 'weapon3': '0.918', 'weapon2': '1.366', 'DAMAGECOUNT': '1.653', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:22,030][52668] DAMAGECOUNT value on done: 9738.0 [2024-08-05 22:34:22,031][52668] Sum rewards: 4.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.080', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'ARMOR': '0.947', 'weapon2': '1.404', 'weapon3': '2.114', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:22,296][52662] DAMAGECOUNT value on done: 11004.0 [2024-08-05 22:34:22,296][52662] Sum rewards: 6.458, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.156', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO3': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.434', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'weapon2': '0.894', 'weapon5': '0.918', 'weapon3': '1.748', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:22,794][52567] Fps is (10 sec: 17202.6, 60 sec: 16930.0, 300 sec: 16911.6). Total num frames: 70475776. Throughput: 0: 4231.6. Samples: 17622110. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:34:22,795][52567] Avg episode reward: [(0, '8.383')] [2024-08-05 22:34:24,200][52670] DAMAGECOUNT value on done: 8088.0 [2024-08-05 22:34:24,201][52670] Sum rewards: 9.695, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.230', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.020', 'AMMO3': '0.075', 'AMMO4': '0.081', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '1.502', 'weapon3': '1.674', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:25,663][52662] DAMAGECOUNT value on done: 10758.0 [2024-08-05 22:34:25,664][52662] Sum rewards: 14.780, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.655', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.032', 'AMMO4': '0.039', 'AMMO3': '0.120', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.596', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon3': '1.872', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '14.000'} [2024-08-05 22:34:26,558][52660] DAMAGECOUNT value on done: 9223.0 [2024-08-05 22:34:26,561][52660] Sum rewards: 2.627, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'HEALTH': '0.216', 'weapon4': '0.216', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'ARMOR': '0.808', 'weapon2': '1.018', 'weapon3': '1.582', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '2.000'} [2024-08-05 22:34:26,601][52668] DAMAGECOUNT value on done: 10505.0 [2024-08-05 22:34:26,603][52668] Sum rewards: 5.937, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.868', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.304', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'ARMOR': '0.893', 'weapon3': '1.610', 'weapon2': '1.644', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:26,754][52666] DAMAGECOUNT value on done: 8487.0 [2024-08-05 22:34:26,755][52666] Sum rewards: 10.493, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.186', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.067', 'WEAPON3': '0.350', 'ARMOR': '0.455', 'HITCOUNT': '0.720', 'weapon2': '1.064', 'weapon3': '1.122', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:27,794][52567] Fps is (10 sec: 14745.4, 60 sec: 16520.5, 300 sec: 16828.3). Total num frames: 70533120. Throughput: 0: 4057.8. Samples: 17639950. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:34:27,795][52567] Avg episode reward: [(0, '8.285')] [2024-08-05 22:34:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008610_70533120.pth... [2024-08-05 22:34:27,995][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008117_66494464.pth [2024-08-05 22:34:29,101][52650] Updated weights for policy 0, policy_version 8611 (0.0016) [2024-08-05 22:34:29,772][52662] DAMAGECOUNT value on done: 9814.0 [2024-08-05 22:34:29,775][52662] Sum rewards: 8.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.383', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'weapon5': '0.252', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon3': '1.190', 'weapon2': '1.504', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:30,028][52670] DAMAGECOUNT value on done: 9953.0 [2024-08-05 22:34:30,032][52670] Sum rewards: 3.958, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.765', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.458', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '0.914', 'ARMOR': '0.915', 'weapon3': '1.464', 'DAMAGECOUNT': '2.754', 'FRAGCOUNT': '3.000'} [2024-08-05 22:34:30,403][52668] DAMAGECOUNT value on done: 8099.0 [2024-08-05 22:34:30,405][52668] Sum rewards: 5.058, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.974', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.300', 'HITCOUNT': '0.470', 'ARMOR': '0.498', 'weapon3': '0.760', 'weapon2': '1.456', 'DAMAGECOUNT': '1.530', 'FRAGCOUNT': '3.000'} [2024-08-05 22:34:30,421][52660] DAMAGECOUNT value on done: 9559.0 [2024-08-05 22:34:30,421][52660] Sum rewards: 8.082, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.774', 'weapon5': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO3': '0.073', 'AMMO4': '0.075', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon2': '1.332', 'weapon3': '1.652', 'DAMAGECOUNT': '2.307', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:31,920][52666] DAMAGECOUNT value on done: 10228.0 [2024-08-05 22:34:31,922][52666] Sum rewards: 12.110, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.230', 'WEAPON3': '0.750', 'ARMOR': '0.903', 'HITCOUNT': '0.960', 'weapon2': '1.194', 'weapon3': '1.750', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '10.000'} [2024-08-05 22:34:32,794][52567] Fps is (10 sec: 11469.2, 60 sec: 16110.9, 300 sec: 16717.2). Total num frames: 70590464. Throughput: 0: 3980.2. Samples: 17648790. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-05 22:34:32,794][52567] Avg episode reward: [(0, '8.284')] [2024-08-05 22:34:33,344][52668] DAMAGECOUNT value on done: 9125.0 [2024-08-05 22:34:33,345][52668] Sum rewards: 10.470, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.111', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'ARMOR': '1.458', 'weapon2': '1.480', 'weapon3': '1.494', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:33,350][52660] DAMAGECOUNT value on done: 9439.0 [2024-08-05 22:34:33,354][52660] Sum rewards: 8.351, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.925', 'AMMO5': '0.020', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.110', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'HITCOUNT': '0.830', 'WEAPON3': '0.900', 'ARMOR': '0.945', 'weapon2': '1.388', 'weapon3': '2.004', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:33,676][52670] DAMAGECOUNT value on done: 9529.0 [2024-08-05 22:34:33,677][52670] Sum rewards: 14.232, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.395', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.306', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.244', 'weapon3': '1.532', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '10.000'} [2024-08-05 22:34:34,142][52650] Updated weights for policy 0, policy_version 8621 (0.0013) [2024-08-05 22:34:34,739][52666] DAMAGECOUNT value on done: 9264.0 [2024-08-05 22:34:34,739][52666] Sum rewards: 9.538, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.118', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'ARMOR': '1.381', 'weapon2': '1.496', 'weapon3': '1.962', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:35,908][52670] DAMAGECOUNT value on done: 8872.0 [2024-08-05 22:34:35,908][52670] Sum rewards: 6.496, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.050', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'weapon5': '0.002', 'AMMO5': '0.007', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.496', 'weapon3': '1.574', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:36,199][52668] DAMAGECOUNT value on done: 8666.0 [2024-08-05 22:34:36,199][52668] Sum rewards: 5.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.120', 'weapon4': '0.164', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'HITCOUNT': '0.910', 'weapon3': '1.592', 'weapon2': '1.680', 'DAMAGECOUNT': '3.051', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:36,220][52660] DAMAGECOUNT value on done: 9033.0 [2024-08-05 22:34:36,221][52660] Sum rewards: -1.782, reward structure: {'DEATHCOUNT': '-6.750', 'FRAGCOUNT': '-0.500', 'HEALTH': '-0.264', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'weapon7': '0.068', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.280', 'weapon4': '0.496', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.890', 'weapon3': '0.940', 'DAMAGECOUNT': '1.131'} [2024-08-05 22:34:37,794][52567] Fps is (10 sec: 15565.1, 60 sec: 16384.1, 300 sec: 16800.5). Total num frames: 70688768. Throughput: 0: 3996.7. Samples: 17674620. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:34:37,794][52567] Avg episode reward: [(0, '8.171')] [2024-08-05 22:34:38,848][52650] Updated weights for policy 0, policy_version 8631 (0.0025) [2024-08-05 22:34:39,229][52668] DAMAGECOUNT value on done: 9736.0 [2024-08-05 22:34:39,231][52668] Sum rewards: 11.343, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.025', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'ARMOR': '0.911', 'weapon2': '1.182', 'weapon3': '1.596', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:39,243][52660] DAMAGECOUNT value on done: 8823.0 [2024-08-05 22:34:39,244][52660] Sum rewards: 16.149, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.839', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.018', 'weapon5': '0.056', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.930', 'HITCOUNT': '1.050', 'weapon2': '1.304', 'weapon3': '1.692', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '12.500'} [2024-08-05 22:34:41,630][52668] DAMAGECOUNT value on done: 8315.0 [2024-08-05 22:34:41,632][52668] Sum rewards: 8.732, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.520', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.080', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'HITCOUNT': '0.710', 'WEAPON3': '0.850', 'ARMOR': '0.991', 'weapon2': '1.306', 'weapon3': '2.064', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:41,666][52660] DAMAGECOUNT value on done: 9384.0 [2024-08-05 22:34:41,666][52660] Sum rewards: 16.201, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.768', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.220', 'WEAPON3': '0.700', 'ARMOR': '0.960', 'weapon2': '1.102', 'HITCOUNT': '1.150', 'weapon3': '1.506', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '15.000'} [2024-08-05 22:34:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16247.5, 300 sec: 16772.8). Total num frames: 70770688. Throughput: 0: 4016.0. Samples: 17700840. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:34:42,802][52567] Avg episode reward: [(0, '8.434')] [2024-08-05 22:34:43,556][52650] Updated weights for policy 0, policy_version 8641 (0.0012) [2024-08-05 22:34:44,504][52668] DAMAGECOUNT value on done: 8868.0 [2024-08-05 22:34:44,505][52668] Sum rewards: 10.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.024', 'AMMO3': '0.106', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.332', 'ARMOR': '0.542', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.056', 'weapon3': '1.986', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '9.000'} [2024-08-05 22:34:44,510][52660] DAMAGECOUNT value on done: 9299.0 [2024-08-05 22:34:44,516][52660] Sum rewards: 7.211, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.733', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.262', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'ARMOR': '0.915', 'weapon2': '1.596', 'weapon3': '1.774', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:47,604][52668] DAMAGECOUNT value on done: 9396.0 [2024-08-05 22:34:47,606][52668] Sum rewards: 6.704, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.120', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.083', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.654', 'weapon4': '0.730', 'ARMOR': '0.945', 'weapon3': '1.198', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '5.000'} [2024-08-05 22:34:47,629][52660] DAMAGECOUNT value on done: 9721.0 [2024-08-05 22:34:47,631][52660] Sum rewards: 4.320, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.045', 'AMMO2': '0.041', 'AMMO3': '0.081', 'AMMO4': '0.204', 'ARMOR': '0.485', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.746', 'weapon2': '0.794', 'weapon3': '1.716', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '5.000'} [2024-08-05 22:34:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16384.0, 300 sec: 16800.7). Total num frames: 70860800. Throughput: 0: 4028.9. Samples: 17714220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:34:47,794][52567] Avg episode reward: [(0, '8.384')] [2024-08-05 22:34:48,132][52650] Updated weights for policy 0, policy_version 8651 (0.0023) [2024-08-05 22:34:50,079][52660] DAMAGECOUNT value on done: 10578.0 [2024-08-05 22:34:50,080][52660] Sum rewards: 12.197, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.817', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'ARMOR': '0.484', 'weapon4': '0.508', 'weapon2': '0.664', 'HITCOUNT': '1.040', 'WEAPON3': '1.150', 'weapon3': '2.348', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '13.000'} [2024-08-05 22:34:50,095][52668] DAMAGECOUNT value on done: 9976.0 [2024-08-05 22:34:50,095][52668] Sum rewards: 8.725, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.196', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.150', 'ARMOR': '0.412', 'weapon4': '0.540', 'HITCOUNT': '0.580', 'WEAPON3': '0.650', 'weapon2': '0.836', 'weapon3': '1.524', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:50,168][52614] Signal inference workers to stop experience collection... (1600 times) [2024-08-05 22:34:50,169][52614] Signal inference workers to resume experience collection... (1600 times) [2024-08-05 22:34:50,199][52650] InferenceWorker_p0-w0: stopping experience collection (1600 times) [2024-08-05 22:34:50,203][52650] InferenceWorker_p0-w0: resuming experience collection (1600 times) [2024-08-05 22:34:50,230][52803] DAMAGECOUNT value on done: 9429.0 [2024-08-05 22:34:50,233][52803] Sum rewards: 14.927, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.576', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.042', 'AMMO3': '0.077', 'weapon4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '0.870', 'weapon2': '1.474', 'weapon3': '1.480', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '11.000'} [2024-08-05 22:34:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16247.4, 300 sec: 16800.6). Total num frames: 70942720. Throughput: 0: 4052.7. Samples: 17740500. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 22:34:52,795][52567] Avg episode reward: [(0, '8.541')] [2024-08-05 22:34:52,834][52650] Updated weights for policy 0, policy_version 8661 (0.0013) [2024-08-05 22:34:52,937][52668] DAMAGECOUNT value on done: 9260.0 [2024-08-05 22:34:52,939][52668] Sum rewards: 10.313, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.332', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'ARMOR': '0.444', 'weapon4': '0.444', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.158', 'weapon3': '1.888', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '10.000'} [2024-08-05 22:34:52,987][52660] DAMAGECOUNT value on done: 10014.0 [2024-08-05 22:34:52,988][52660] Sum rewards: 9.343, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.951', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'AMMO3': '0.071', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'ARMOR': '0.957', 'weapon3': '1.144', 'weapon2': '1.462', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:53,354][52803] DAMAGECOUNT value on done: 10341.0 [2024-08-05 22:34:53,354][52803] Sum rewards: 6.959, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.464', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.286', 'ARMOR': '0.415', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.046', 'weapon3': '1.956', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '7.000'} [2024-08-05 22:34:56,058][52668] DAMAGECOUNT value on done: 8557.0 [2024-08-05 22:34:56,059][52668] Sum rewards: 4.326, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.382', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.090', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'weapon4': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.806', 'weapon3': '1.762', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '4.000'} [2024-08-05 22:34:56,149][52660] DAMAGECOUNT value on done: 9660.0 [2024-08-05 22:34:56,151][52660] Sum rewards: 13.960, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.356', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.218', 'ARMOR': '0.444', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'weapon2': '1.648', 'weapon3': '1.786', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '13.000'} [2024-08-05 22:34:56,386][52803] DAMAGECOUNT value on done: 9530.0 [2024-08-05 22:34:56,388][52803] Sum rewards: 9.275, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.148', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.150', 'ARMOR': '0.443', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon2': '1.670', 'weapon3': '2.036', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '8.000'} [2024-08-05 22:34:57,603][52650] Updated weights for policy 0, policy_version 8671 (0.0018) [2024-08-05 22:34:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16520.6, 300 sec: 16828.3). Total num frames: 71032832. Throughput: 0: 4065.1. Samples: 17766520. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 22:34:57,795][52567] Avg episode reward: [(0, '8.617')] [2024-08-05 22:34:58,627][52811] DAMAGECOUNT value on done: 9354.0 [2024-08-05 22:34:58,629][52811] Sum rewards: 7.299, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.482', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.320', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'weapon2': '1.100', 'ARMOR': '1.443', 'weapon3': '1.554', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '6.000'} [2024-08-05 22:34:59,273][52660] DAMAGECOUNT value on done: 10312.0 [2024-08-05 22:34:59,274][52660] Sum rewards: 13.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.040', 'AMMO4': '0.059', 'weapon4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon5': '0.298', 'weapon2': '0.842', 'WEAPON3': '1.050', 'HITCOUNT': '1.270', 'weapon3': '2.392', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '14.000'} [2024-08-05 22:34:59,404][52803] DAMAGECOUNT value on done: 9880.0 [2024-08-05 22:34:59,405][52803] Sum rewards: 8.722, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.764', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.151', 'WEAPON3': '0.950', 'HITCOUNT': '1.130', 'ARMOR': '1.306', 'weapon2': '1.640', 'weapon3': '1.720', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '9.000'} [2024-08-05 22:35:01,708][52811] DAMAGECOUNT value on done: 9365.0 [2024-08-05 22:35:01,708][52811] Sum rewards: 7.823, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.030', 'AMMO4': '0.065', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.370', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '1.120', 'weapon3': '1.446', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:02,082][52660] DAMAGECOUNT value on done: 9599.0 [2024-08-05 22:35:02,083][52660] Sum rewards: 6.755, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.072', 'AMMO3': '0.129', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'ARMOR': '0.468', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'weapon2': '1.244', 'weapon3': '1.572', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:02,345][52650] Updated weights for policy 0, policy_version 8681 (0.0025) [2024-08-05 22:35:02,531][52803] DAMAGECOUNT value on done: 10196.0 [2024-08-05 22:35:02,532][52803] Sum rewards: 2.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.123', 'weapon4': '0.156', 'WEAPON4': '0.250', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'ARMOR': '0.876', 'weapon2': '1.086', 'weapon3': '1.974', 'DAMAGECOUNT': '2.235', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16384.0, 300 sec: 16800.5). Total num frames: 71114752. Throughput: 0: 4063.1. Samples: 17779410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:35:02,794][52567] Avg episode reward: [(0, '8.549')] [2024-08-05 22:35:05,033][52811] DAMAGECOUNT value on done: 9705.0 [2024-08-05 22:35:05,033][52811] Sum rewards: 10.316, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.284', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.396', 'ARMOR': '0.481', 'WEAPON3': '0.950', 'weapon2': '1.020', 'HITCOUNT': '1.180', 'weapon3': '2.134', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '9.000'} [2024-08-05 22:35:06,146][52803] DAMAGECOUNT value on done: 9380.0 [2024-08-05 22:35:06,147][52803] Sum rewards: 16.280, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.129', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon2': '1.176', 'ARMOR': '1.392', 'weapon3': '1.696', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '12.000'} [2024-08-05 22:35:07,361][52650] Updated weights for policy 0, policy_version 8691 (0.0018) [2024-08-05 22:35:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16520.5, 300 sec: 16828.3). Total num frames: 71204864. Throughput: 0: 4047.1. Samples: 17804230. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 22:35:07,794][52567] Avg episode reward: [(0, '8.649')] [2024-08-05 22:35:08,557][52811] DAMAGECOUNT value on done: 9126.0 [2024-08-05 22:35:08,558][52811] Sum rewards: 3.782, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.205', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.070', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.262', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '1.284', 'ARMOR': '1.376', 'weapon3': '1.798', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.976'} [2024-08-05 22:35:09,373][52803] DAMAGECOUNT value on done: 10628.0 [2024-08-05 22:35:09,373][52803] Sum rewards: 9.896, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.994', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.250', 'ARMOR': '0.412', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon3': '1.216', 'weapon2': '1.404', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:12,795][52567] Fps is (10 sec: 13925.6, 60 sec: 15837.7, 300 sec: 16717.2). Total num frames: 71254016. Throughput: 0: 4040.0. Samples: 17821750. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 22:35:12,803][52567] Avg episode reward: [(0, '8.546')] [2024-08-05 22:35:17,289][52669] DAMAGECOUNT value on done: 10354.0 [2024-08-05 22:35:17,297][52669] Sum rewards: 8.403, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.142', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon5': '0.040', 'AMMO3': '0.138', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.540', 'weapon2': '0.572', 'HITCOUNT': '0.900', 'WEAPON3': '0.950', 'ARMOR': '0.951', 'weapon3': '2.284', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:17,794][52567] Fps is (10 sec: 6553.6, 60 sec: 14745.6, 300 sec: 16495.1). Total num frames: 71270400. Throughput: 0: 3848.0. Samples: 17821950. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:35:17,794][52567] Avg episode reward: [(0, '8.492')] [2024-08-05 22:35:17,955][52811] DAMAGECOUNT value on done: 10373.0 [2024-08-05 22:35:17,955][52811] Sum rewards: 7.801, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.634', 'AMMO2': '0.013', 'AMMO3': '0.066', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'ARMOR': '0.440', 'weapon4': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'weapon2': '1.210', 'weapon3': '1.314', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:18,459][52650] Updated weights for policy 0, policy_version 8701 (0.0047) [2024-08-05 22:35:19,123][52803] DAMAGECOUNT value on done: 8073.0 [2024-08-05 22:35:19,124][52803] Sum rewards: 6.993, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.345', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.300', 'weapon4': '0.414', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '1.170', 'ARMOR': '1.224', 'weapon3': '1.622', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:20,749][52669] DAMAGECOUNT value on done: 9622.0 [2024-08-05 22:35:20,758][52669] Sum rewards: 7.044, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'ARMOR': '0.064', 'AMMO4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.128', 'HEALTH': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon3': '1.264', 'weapon2': '1.416', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:21,602][52811] DAMAGECOUNT value on done: 8671.0 [2024-08-05 22:35:21,602][52811] Sum rewards: 5.109, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.068', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.118', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'ARMOR': '0.891', 'weapon2': '1.694', 'weapon3': '1.940', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:22,783][52803] DAMAGECOUNT value on done: 8176.0 [2024-08-05 22:35:22,785][52803] Sum rewards: 10.251, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.417', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.105', 'weapon4': '0.108', 'WEAPON4': '0.150', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.318', 'weapon3': '1.826', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '10.000'} [2024-08-05 22:35:22,794][52567] Fps is (10 sec: 9011.7, 60 sec: 14472.6, 300 sec: 16439.5). Total num frames: 71344128. Throughput: 0: 3687.6. Samples: 17840560. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:35:22,794][52567] Avg episode reward: [(0, '8.596')] [2024-08-05 22:35:23,375][52650] Updated weights for policy 0, policy_version 8711 (0.0017) [2024-08-05 22:35:24,077][52669] DAMAGECOUNT value on done: 10135.0 [2024-08-05 22:35:24,078][52669] Sum rewards: 7.934, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.487', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.053', 'WEAPON5': '0.100', 'weapon5': '0.232', 'WEAPON4': '0.300', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'weapon2': '0.520', 'HITCOUNT': '0.630', 'weapon4': '0.880', 'weapon3': '1.134', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:24,483][52795] DAMAGECOUNT value on done: 7798.0 [2024-08-05 22:35:24,486][52795] Sum rewards: 10.147, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.757', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.096', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'ARMOR': '0.913', 'weapon3': '1.358', 'weapon2': '1.570', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '11.000'} [2024-08-05 22:35:25,170][52811] DAMAGECOUNT value on done: 9173.0 [2024-08-05 22:35:25,174][52811] Sum rewards: 1.451, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.346', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'HITCOUNT': '0.360', 'ARMOR': '0.489', 'WEAPON3': '0.800', 'DAMAGECOUNT': '1.182', 'weapon2': '1.440', 'weapon3': '1.742', 'FRAGCOUNT': '4.000'} [2024-08-05 22:35:26,550][52803] DAMAGECOUNT value on done: 8763.0 [2024-08-05 22:35:26,551][52803] Sum rewards: 11.920, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.107', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.210', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.266', 'weapon3': '1.654', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '10.000'} [2024-08-05 22:35:27,599][52669] DAMAGECOUNT value on done: 11488.0 [2024-08-05 22:35:27,601][52669] Sum rewards: 9.614, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.008', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.332', 'WEAPON3': '0.400', 'HITCOUNT': '0.750', 'weapon2': '0.908', 'weapon3': '1.300', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:27,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14745.6, 300 sec: 16384.0). Total num frames: 71417856. Throughput: 0: 3602.9. Samples: 17862970. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 22:35:27,794][52567] Avg episode reward: [(0, '8.468')] [2024-08-05 22:35:28,279][52795] DAMAGECOUNT value on done: 9139.0 [2024-08-05 22:35:28,280][52795] Sum rewards: 14.729, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.014', 'AMMO4': '0.024', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.236', 'WEAPON3': '0.650', 'HITCOUNT': '1.130', 'weapon2': '1.242', 'weapon3': '1.762', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '12.000'} [2024-08-05 22:35:28,624][52811] DAMAGECOUNT value on done: 7068.0 [2024-08-05 22:35:28,627][52811] Sum rewards: 10.455, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.081', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.820', 'HITCOUNT': '1.050', 'weapon2': '1.564', 'weapon3': '1.744', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:28,953][52650] Updated weights for policy 0, policy_version 8721 (0.0029) [2024-08-05 22:35:30,125][52803] DAMAGECOUNT value on done: 8887.0 [2024-08-05 22:35:30,125][52803] Sum rewards: 9.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.352', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'ARMOR': '0.832', 'WEAPON3': '0.950', 'HITCOUNT': '1.120', 'weapon2': '1.470', 'weapon3': '2.232', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'} [2024-08-05 22:35:30,798][52669] DAMAGECOUNT value on done: 9364.0 [2024-08-05 22:35:30,798][52669] Sum rewards: 11.827, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'HEALTH': '0.338', 'WEAPON3': '0.550', 'weapon4': '0.646', 'HITCOUNT': '0.900', 'weapon2': '1.154', 'ARMOR': '1.343', 'weapon3': '1.544', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:31,444][52795] DAMAGECOUNT value on done: 8570.0 [2024-08-05 22:35:31,467][52795] Sum rewards: 16.542, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'weapon4': '0.266', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '1.414', 'weapon3': '1.678', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '14.000'} [2024-08-05 22:35:31,836][52811] DAMAGECOUNT value on done: 9306.0 [2024-08-05 22:35:31,847][52811] Sum rewards: 7.635, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.092', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'ARMOR': '0.522', 'weapon4': '0.598', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '1.108', 'weapon3': '1.790', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:32,800][52567] Fps is (10 sec: 15555.6, 60 sec: 15153.7, 300 sec: 16411.4). Total num frames: 71499776. Throughput: 0: 3585.8. Samples: 17875600. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-05 22:35:32,801][52567] Avg episode reward: [(0, '8.557')] [2024-08-05 22:35:33,452][52803] DAMAGECOUNT value on done: 9327.0 [2024-08-05 22:35:33,453][52803] Sum rewards: 6.558, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.432', 'ARMOR': '0.499', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'weapon2': '1.462', 'weapon3': '1.528', 'DAMAGECOUNT': '2.469', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:33,559][52665] DAMAGECOUNT value on done: 9355.0 [2024-08-05 22:35:33,562][52665] Sum rewards: 6.216, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.582', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.060', 'WEAPON4': '0.300', 'HITCOUNT': '0.470', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'weapon4': '0.776', 'weapon2': '1.010', 'weapon3': '1.388', 'DAMAGECOUNT': '1.554', 'FRAGCOUNT': '4.000'} [2024-08-05 22:35:33,631][52647] DAMAGECOUNT value on done: 10914.0 [2024-08-05 22:35:33,632][52647] Sum rewards: 8.400, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.540', 'AMMO2': '0.021', 'AMMO3': '0.092', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.528', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'ARMOR': '0.966', 'weapon2': '1.032', 'weapon3': '1.634', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:33,800][52650] Updated weights for policy 0, policy_version 8731 (0.0027) [2024-08-05 22:35:34,411][52669] DAMAGECOUNT value on done: 10451.0 [2024-08-05 22:35:34,412][52669] Sum rewards: 16.527, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.344', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.094', 'ARMOR': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.268', 'WEAPON3': '0.750', 'weapon2': '1.146', 'HITCOUNT': '1.510', 'weapon3': '2.060', 'DAMAGECOUNT': '4.773', 'FRAGCOUNT': '13.000'} [2024-08-05 22:35:34,809][52795] DAMAGECOUNT value on done: 11160.0 [2024-08-05 22:35:34,811][52795] Sum rewards: 13.062, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.342', 'AMMO2': '0.014', 'ARMOR': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.154', 'WEAPON3': '0.950', 'weapon2': '1.020', 'HITCOUNT': '1.190', 'weapon3': '2.630', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '12.000'} [2024-08-05 22:35:35,091][52811] DAMAGECOUNT value on done: 9334.0 [2024-08-05 22:35:35,093][52811] Sum rewards: 13.770, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.293', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.062', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.262', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.168', 'weapon3': '1.838', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '11.000'} [2024-08-05 22:35:36,570][52665] DAMAGECOUNT value on done: 8888.0 [2024-08-05 22:35:36,572][52665] Sum rewards: 5.742, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.363', 'AMMO2': '0.023', 'AMMO3': '0.087', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.250', 'HITCOUNT': '0.440', 'WEAPON3': '0.550', 'ARMOR': '0.901', 'weapon2': '1.146', 'DAMAGECOUNT': '1.269', 'weapon3': '1.374', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:36,620][52803] DAMAGECOUNT value on done: 8821.0 [2024-08-05 22:35:36,622][52803] Sum rewards: 11.652, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.068', 'AMMO2': '0.025', 'AMMO3': '0.095', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'weapon4': '0.516', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '0.892', 'weapon3': '1.592', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '9.000'} [2024-08-05 22:35:36,705][52647] DAMAGECOUNT value on done: 9767.0 [2024-08-05 22:35:36,705][52647] Sum rewards: 6.986, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.035', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.034', 'ARMOR': '0.044', 'AMMO4': '0.142', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.620', 'HITCOUNT': '0.760', 'weapon2': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.068', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '9.000'} [2024-08-05 22:35:37,194][52669] DAMAGECOUNT value on done: 10729.0 [2024-08-05 22:35:37,202][52669] Sum rewards: 2.887, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.226', 'AMMO2': '0.017', 'ARMOR': '0.028', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.338', 'HITCOUNT': '0.540', 'WEAPON3': '0.700', 'weapon2': '0.978', 'weapon3': '1.838', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'} [2024-08-05 22:35:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 15018.7, 300 sec: 16384.0). Total num frames: 71589888. Throughput: 0: 3562.7. Samples: 17900820. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-05 22:35:37,794][52567] Avg episode reward: [(0, '8.640')] [2024-08-05 22:35:38,108][52795] DAMAGECOUNT value on done: 10217.0 [2024-08-05 22:35:38,109][52795] Sum rewards: 4.669, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.592', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.300', 'ARMOR': '0.541', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.450', 'weapon3': '1.558', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:38,256][52811] DAMAGECOUNT value on done: 9540.0 [2024-08-05 22:35:38,259][52811] Sum rewards: 8.711, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON3': '0.250', 'HEALTH': '0.388', 'HITCOUNT': '0.660', 'weapon3': '0.962', 'weapon2': '1.504', 'DAMAGECOUNT': '2.034', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:38,709][52650] Updated weights for policy 0, policy_version 8741 (0.0025) [2024-08-05 22:35:39,201][52647] DAMAGECOUNT value on done: 11322.0 [2024-08-05 22:35:39,201][52647] Sum rewards: 9.195, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.298', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.132', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'ARMOR': '1.257', 'weapon2': '1.590', 'weapon3': '1.698', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:39,763][52665] DAMAGECOUNT value on done: 10350.0 [2024-08-05 22:35:39,763][52665] Sum rewards: 4.954, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'weapon7': '0.006', 'AMMO2': '0.012', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.248', 'HEALTH': '0.292', 'HITCOUNT': '0.670', 'WEAPON3': '0.700', 'ARMOR': '0.892', 'weapon2': '1.160', 'weapon3': '2.104', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:40,001][52803] DAMAGECOUNT value on done: 8873.0 [2024-08-05 22:35:40,004][52803] Sum rewards: 6.553, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.818', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.024', 'AMMO3': '0.060', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON3': '0.350', 'HITCOUNT': '0.460', 'ARMOR': '0.486', 'weapon3': '0.948', 'weapon2': '0.986', 'DAMAGECOUNT': '1.275', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:40,116][52669] DAMAGECOUNT value on done: 10092.0 [2024-08-05 22:35:40,117][52669] Sum rewards: 15.355, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.334', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'AMMO4': '0.136', 'weapon4': '0.172', 'WEAPON4': '0.250', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '0.990', 'weapon3': '2.010', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '13.000'} [2024-08-05 22:35:41,303][52795] DAMAGECOUNT value on done: 11470.0 [2024-08-05 22:35:41,303][52795] Sum rewards: 12.198, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.562', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.246', 'ARMOR': '0.535', 'WEAPON3': '0.600', 'weapon2': '0.982', 'HITCOUNT': '1.050', 'weapon3': '1.580', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '9.000'} [2024-08-05 22:35:41,722][52811] DAMAGECOUNT value on done: 9130.0 [2024-08-05 22:35:41,723][52811] Sum rewards: 8.941, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.290', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'ARMOR': '0.025', 'AMMO4': '0.069', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.296', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.206', 'weapon3': '1.666', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:41,745][52647] DAMAGECOUNT value on done: 7739.0 [2024-08-05 22:35:41,745][52647] Sum rewards: 1.913, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.840', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'AMMO3': '0.060', 'HITCOUNT': '0.090', 'DAMAGECOUNT': '0.285', 'WEAPON3': '0.300', 'weapon2': '0.894', 'ARMOR': '0.927', 'FRAGCOUNT': '1.000', 'weapon3': '1.496'} [2024-08-05 22:35:42,787][52665] DAMAGECOUNT value on done: 9223.0 [2024-08-05 22:35:42,788][52665] Sum rewards: 4.899, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.461', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.286', 'ARMOR': '0.527', 'HITCOUNT': '0.750', 'WEAPON3': '1.000', 'weapon2': '1.010', 'weapon3': '1.988', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:42,804][52567] Fps is (10 sec: 17196.5, 60 sec: 15016.2, 300 sec: 16411.2). Total num frames: 71671808. Throughput: 0: 3547.2. Samples: 17926180. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 22:35:42,804][52567] Avg episode reward: [(0, '8.649')] [2024-08-05 22:35:43,379][52650] Updated weights for policy 0, policy_version 8751 (0.0011) [2024-08-05 22:35:43,407][52669] DAMAGECOUNT value on done: 9344.0 [2024-08-05 22:35:43,410][52669] Sum rewards: 5.109, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.250', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'ARMOR': '0.053', 'AMMO4': '0.085', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.328', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.090', 'weapon3': '2.164', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:43,425][52803] DAMAGECOUNT value on done: 9820.0 [2024-08-05 22:35:43,425][52803] Sum rewards: 12.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO2': '0.010', 'AMMO4': '0.051', 'ARMOR': '0.069', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '1.040', 'HITCOUNT': '1.150', 'WEAPON3': '1.200', 'weapon3': '2.608', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '15.000'} [2024-08-05 22:35:44,454][52647] DAMAGECOUNT value on done: 9484.0 [2024-08-05 22:35:44,454][52647] Sum rewards: 13.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.512', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'ARMOR': '0.417', 'weapon2': '0.994', 'WEAPON3': '1.150', 'HITCOUNT': '1.350', 'weapon3': '2.554', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '14.000'} [2024-08-05 22:35:44,579][52795] DAMAGECOUNT value on done: 9380.0 [2024-08-05 22:35:44,579][52795] Sum rewards: 10.921, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.544', 'AMMO2': '0.022', 'ARMOR': '0.080', 'AMMO3': '0.098', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon4': '0.736', 'weapon2': '0.952', 'HITCOUNT': '1.060', 'weapon3': '1.982', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:44,874][52811] DAMAGECOUNT value on done: 9021.0 [2024-08-05 22:35:44,875][52811] Sum rewards: 6.387, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.699', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.062', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'ARMOR': '1.281', 'weapon3': '1.586', 'weapon2': '1.636', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:45,941][52665] DAMAGECOUNT value on done: 9959.0 [2024-08-05 22:35:45,942][52665] Sum rewards: 7.207, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.714', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.246', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon3': '0.558', 'weapon2': '1.094', 'ARMOR': '1.244', 'DAMAGECOUNT': '1.584', 'FRAGCOUNT': '5.500'} [2024-08-05 22:35:46,630][52669] DAMAGECOUNT value on done: 10199.0 [2024-08-05 22:35:46,632][52669] Sum rewards: 14.331, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.106', 'ARMOR': '0.483', 'WEAPON3': '0.750', 'HITCOUNT': '1.000', 'weapon2': '1.202', 'weapon3': '1.938', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '12.000'} [2024-08-05 22:35:46,732][52803] DAMAGECOUNT value on done: 7854.0 [2024-08-05 22:35:46,733][52803] Sum rewards: 6.438, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.935', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'ARMOR': '0.486', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.356', 'weapon3': '2.064', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:47,124][52647] DAMAGECOUNT value on done: 10038.0 [2024-08-05 22:35:47,130][52647] Sum rewards: 6.220, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.321', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.342', 'HITCOUNT': '0.480', 'ARMOR': '0.492', 'WEAPON3': '0.600', 'weapon2': '1.122', 'weapon3': '1.398', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:47,745][52795] DAMAGECOUNT value on done: 10173.0 [2024-08-05 22:35:47,749][52795] Sum rewards: 5.060, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.577', 'AMMO5': '0.005', 'AMMO2': '0.031', 'ARMOR': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.154', 'weapon4': '0.292', 'WEAPON4': '0.300', 'HITCOUNT': '0.570', 'WEAPON3': '0.750', 'weapon2': '1.228', 'weapon3': '1.792', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:47,794][52567] Fps is (10 sec: 17202.5, 60 sec: 15018.6, 300 sec: 16411.7). Total num frames: 71761920. Throughput: 0: 3548.2. Samples: 17939080. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:35:47,802][52567] Avg episode reward: [(0, '8.756')] [2024-08-05 22:35:47,991][52663] DAMAGECOUNT value on done: 10732.0 [2024-08-05 22:35:47,992][52663] Sum rewards: 14.939, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.185', 'AMMO2': '0.015', 'AMMO3': '0.070', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.430', 'WEAPON3': '0.500', 'ARMOR': '0.512', 'HITCOUNT': '0.960', 'weapon2': '1.048', 'weapon3': '1.564', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '11.000'} [2024-08-05 22:35:48,206][52811] DAMAGECOUNT value on done: 8560.0 [2024-08-05 22:35:48,207][52811] Sum rewards: 10.442, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.770', 'AMMO2': '0.008', 'AMMO4': '0.038', 'ARMOR': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.250', 'weapon4': '0.396', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.098', 'weapon3': '1.188', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:48,642][52650] Updated weights for policy 0, policy_version 8761 (0.0018) [2024-08-05 22:35:48,719][52665] DAMAGECOUNT value on done: 9473.0 [2024-08-05 22:35:48,720][52665] Sum rewards: 8.348, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'HEALTH': '0.278', 'WEAPON3': '0.400', 'weapon4': '0.404', 'ARMOR': '0.432', 'HITCOUNT': '0.580', 'weapon2': '1.232', 'weapon3': '1.314', 'DAMAGECOUNT': '1.851', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:49,748][52669] DAMAGECOUNT value on done: 10049.0 [2024-08-05 22:35:49,750][52669] Sum rewards: 7.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.042', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.232', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'ARMOR': '0.875', 'weapon2': '0.896', 'weapon3': '1.764', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:50,105][52803] DAMAGECOUNT value on done: 8661.0 [2024-08-05 22:35:50,106][52803] Sum rewards: 10.389, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.076', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.284', 'HEALTH': '0.331', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.076', 'weapon3': '1.556', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '10.000'} [2024-08-05 22:35:50,477][52647] DAMAGECOUNT value on done: 8881.0 [2024-08-05 22:35:50,477][52647] Sum rewards: 9.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.556', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon7': '0.058', 'AMMO4': '0.077', 'AMMO3': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.538', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'ARMOR': '0.844', 'weapon2': '0.920', 'weapon3': '2.038', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '7.000'} [2024-08-05 22:35:51,098][52663] DAMAGECOUNT value on done: 9970.0 [2024-08-05 22:35:51,099][52663] Sum rewards: 5.189, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.477', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.063', 'WEAPON5': '0.200', 'weapon5': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.463', 'HITCOUNT': '0.530', 'weapon3': '0.894', 'weapon2': '1.884', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '4.500'} [2024-08-05 22:35:51,106][52795] DAMAGECOUNT value on done: 9130.0 [2024-08-05 22:35:51,107][52795] Sum rewards: 9.493, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.953', 'AMMO2': '0.008', 'AMMO4': '0.037', 'ARMOR': '0.056', 'AMMO3': '0.062', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon2': '1.012', 'weapon3': '1.376', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:51,429][52811] DAMAGECOUNT value on done: 10354.0 [2024-08-05 22:35:51,430][52811] Sum rewards: 11.986, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.296', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.228', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.474', 'weapon3': '1.556', 'DAMAGECOUNT': '3.108', 'FRAGCOUNT': '10.000'} [2024-08-05 22:35:51,811][52665] DAMAGECOUNT value on done: 10074.0 [2024-08-05 22:35:51,813][52665] Sum rewards: 11.752, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.647', 'AMMO2': '0.003', 'weapon4': '0.004', 'AMMO4': '0.013', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.422', 'weapon3': '1.786', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '11.000'} [2024-08-05 22:35:52,794][52567] Fps is (10 sec: 16400.1, 60 sec: 14882.2, 300 sec: 16356.2). Total num frames: 71835648. Throughput: 0: 3556.7. Samples: 17964280. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:35:52,794][52567] Avg episode reward: [(0, '8.953')] [2024-08-05 22:35:52,813][52614] Saving new best policy, reward=8.953! [2024-08-05 22:35:52,993][52669] DAMAGECOUNT value on done: 11396.0 [2024-08-05 22:35:52,995][52669] Sum rewards: 11.234, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.154', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.129', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.412', 'weapon2': '0.776', 'HITCOUNT': '0.800', 'WEAPON3': '0.900', 'ARMOR': '0.930', 'weapon3': '2.164', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '10.000'} [2024-08-05 22:35:53,166][52650] Updated weights for policy 0, policy_version 8771 (0.0014) [2024-08-05 22:35:53,574][52803] DAMAGECOUNT value on done: 8785.0 [2024-08-05 22:35:53,576][52803] Sum rewards: 9.973, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.254', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.085', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'HITCOUNT': '0.700', 'weapon2': '1.432', 'weapon3': '1.612', 'DAMAGECOUNT': '2.502', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:53,700][52647] DAMAGECOUNT value on done: 9497.0 [2024-08-05 22:35:53,701][52647] Sum rewards: 2.729, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.190', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.306', 'HITCOUNT': '0.690', 'ARMOR': '0.980', 'weapon2': '1.084', 'WEAPON3': '1.100', 'weapon3': '1.788', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:54,302][52663] DAMAGECOUNT value on done: 8920.0 [2024-08-05 22:35:54,305][52663] Sum rewards: 17.705, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.062', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'ARMOR': '0.012', 'AMMO3': '0.070', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon3': '1.634', 'weapon2': '1.722', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '15.000'} [2024-08-05 22:35:54,510][52795] DAMAGECOUNT value on done: 10063.0 [2024-08-05 22:35:54,510][52795] Sum rewards: 9.258, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.478', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.012', 'AMMO4': '0.025', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.344', 'WEAPON3': '0.550', 'ARMOR': '0.832', 'HITCOUNT': '0.980', 'weapon3': '1.258', 'weapon2': '1.582', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:54,681][52811] DAMAGECOUNT value on done: 8487.0 [2024-08-05 22:35:54,682][52811] Sum rewards: 15.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.498', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'WEAPON3': '1.100', 'ARMOR': '1.277', 'HITCOUNT': '1.300', 'weapon2': '1.478', 'weapon3': '2.226', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '16.000'} [2024-08-05 22:35:55,183][52665] DAMAGECOUNT value on done: 9150.0 [2024-08-05 22:35:55,184][52665] Sum rewards: 5.346, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.783', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'ARMOR': '1.349', 'weapon2': '1.566', 'weapon3': '1.584', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:56,318][52669] DAMAGECOUNT value on done: 9429.0 [2024-08-05 22:35:56,319][52669] Sum rewards: 10.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.954', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON3': '0.600', 'ARMOR': '0.832', 'HITCOUNT': '0.880', 'weapon3': '1.226', 'weapon2': '1.572', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '9.000'} [2024-08-05 22:35:56,689][52647] DAMAGECOUNT value on done: 10671.0 [2024-08-05 22:35:56,691][52647] Sum rewards: 4.825, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.012', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.088', 'weapon5': '0.090', 'AMMO4': '0.106', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '0.966', 'weapon3': '1.874', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:57,564][52803] DAMAGECOUNT value on done: 9443.0 [2024-08-05 22:35:57,566][52803] Sum rewards: 8.191, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.006', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'weapon4': '0.396', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'ARMOR': '1.394', 'weapon3': '1.444', 'weapon2': '1.530', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '4.500'} [2024-08-05 22:35:57,584][52663] DAMAGECOUNT value on done: 11548.0 [2024-08-05 22:35:57,585][52663] Sum rewards: 10.381, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.164', 'HEALTH': '0.190', 'weapon5': '0.306', 'WEAPON3': '0.650', 'ARMOR': '0.836', 'HITCOUNT': '0.890', 'weapon2': '1.294', 'weapon3': '1.406', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '8.000'} [2024-08-05 22:35:57,794][52567] Fps is (10 sec: 15565.1, 60 sec: 14745.6, 300 sec: 16356.2). Total num frames: 71917568. Throughput: 0: 3696.5. Samples: 17988090. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 22:35:57,795][52567] Avg episode reward: [(0, '9.102')] [2024-08-05 22:35:57,802][52614] Saving new best policy, reward=9.102! [2024-08-05 22:35:58,112][52811] DAMAGECOUNT value on done: 8494.0 [2024-08-05 22:35:58,112][52811] Sum rewards: 6.710, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.870', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon7': '0.054', 'ARMOR': '0.064', 'AMMO3': '0.083', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.616', 'HITCOUNT': '0.620', 'WEAPON3': '0.650', 'weapon2': '0.980', 'weapon3': '1.754', 'DAMAGECOUNT': '2.037', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:58,164][52795] DAMAGECOUNT value on done: 8649.0 [2024-08-05 22:35:58,164][52795] Sum rewards: 8.195, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.044', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon2': '0.448', 'HEALTH': '0.475', 'HITCOUNT': '0.590', 'ARMOR': '0.880', 'weapon4': '1.096', 'weapon3': '1.550', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '5.000'} [2024-08-05 22:35:58,403][52665] DAMAGECOUNT value on done: 9015.0 [2024-08-05 22:35:58,403][52665] Sum rewards: 8.012, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.141', 'AMMO2': '0.029', 'AMMO3': '0.086', 'ARMOR': '0.112', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.470', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon2': '1.188', 'weapon3': '1.618', 'DAMAGECOUNT': '2.286', 'FRAGCOUNT': '6.000'} [2024-08-05 22:35:58,528][52650] Updated weights for policy 0, policy_version 8781 (0.0022) [2024-08-05 22:35:59,224][52669] DAMAGECOUNT value on done: 10768.0 [2024-08-05 22:35:59,225][52669] Sum rewards: 9.420, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.573', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'ARMOR': '0.474', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.202', 'weapon3': '1.228', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:00,093][52647] DAMAGECOUNT value on done: 9680.0 [2024-08-05 22:36:00,094][52647] Sum rewards: 9.794, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.144', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.304', 'ARMOR': '0.482', 'WEAPON3': '0.600', 'HITCOUNT': '0.770', 'weapon2': '0.940', 'weapon3': '1.666', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:00,544][52663] DAMAGECOUNT value on done: 9043.0 [2024-08-05 22:36:00,552][52663] Sum rewards: 4.348, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.958', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.083', 'WEAPON4': '0.300', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon4': '0.778', 'weapon2': '1.284', 'weapon3': '1.348', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:01,466][52803] DAMAGECOUNT value on done: 9736.0 [2024-08-05 22:36:01,466][52803] Sum rewards: 3.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.044', 'weapon4': '0.002', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'ARMOR': '0.912', 'weapon2': '1.372', 'weapon3': '1.454', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:01,818][52811] DAMAGECOUNT value on done: 7933.0 [2024-08-05 22:36:01,820][52811] Sum rewards: 13.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.832', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.113', 'WEAPON3': '0.700', 'HITCOUNT': '1.210', 'ARMOR': '1.345', 'weapon3': '1.668', 'weapon2': '1.772', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '14.000'} [2024-08-05 22:36:01,897][52665] DAMAGECOUNT value on done: 10017.0 [2024-08-05 22:36:01,898][52665] Sum rewards: 6.301, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.095', 'AMMO2': '0.010', 'weapon7': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.520', 'ARMOR': '0.884', 'weapon3': '1.006', 'weapon2': '1.546', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:02,062][52795] DAMAGECOUNT value on done: 9032.0 [2024-08-05 22:36:02,062][52795] Sum rewards: 12.037, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.025', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.260', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon2': '1.222', 'weapon3': '1.414', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:02,423][52669] DAMAGECOUNT value on done: 10238.0 [2024-08-05 22:36:02,423][52669] Sum rewards: 7.119, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.346', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.432', 'ARMOR': '0.525', 'WEAPON3': '0.800', 'HITCOUNT': '0.800', 'weapon2': '0.856', 'weapon3': '2.182', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:02,794][52567] Fps is (10 sec: 15564.3, 60 sec: 14609.0, 300 sec: 16328.4). Total num frames: 71991296. Throughput: 0: 3942.9. Samples: 17999380. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 22:36:02,795][52567] Avg episode reward: [(0, '8.954')] [2024-08-05 22:36:03,078][52667] DAMAGECOUNT value on done: 10952.0 [2024-08-05 22:36:03,086][52667] Sum rewards: 4.426, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.588', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.208', 'HITCOUNT': '0.550', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'weapon2': '1.310', 'weapon3': '1.740', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:03,516][52647] DAMAGECOUNT value on done: 10403.0 [2024-08-05 22:36:03,517][52647] Sum rewards: 14.668, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.196', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'ARMOR': '0.067', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.408', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon2': '1.230', 'weapon3': '1.622', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:03,673][52663] DAMAGECOUNT value on done: 10468.0 [2024-08-05 22:36:03,674][52663] Sum rewards: 10.707, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.126', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.064', 'weapon5': '0.078', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon4': '0.768', 'ARMOR': '0.892', 'weapon2': '1.064', 'weapon3': '1.318', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:03,696][52650] Updated weights for policy 0, policy_version 8791 (0.0044) [2024-08-05 22:36:04,917][52665] DAMAGECOUNT value on done: 10970.0 [2024-08-05 22:36:04,919][52665] Sum rewards: 11.925, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'ARMOR': '0.548', 'HITCOUNT': '0.570', 'weapon4': '0.622', 'HEALTH': '0.682', 'weapon2': '0.732', 'weapon3': '1.054', 'DAMAGECOUNT': '2.007', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:05,149][52811] DAMAGECOUNT value on done: 9823.0 [2024-08-05 22:36:05,149][52811] Sum rewards: 14.081, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.888', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.358', 'WEAPON3': '0.900', 'ARMOR': '0.934', 'HITCOUNT': '1.190', 'weapon2': '1.306', 'weapon3': '1.950', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:05,378][52667] DAMAGECOUNT value on done: 10031.0 [2024-08-05 22:36:05,379][52667] Sum rewards: 13.622, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.112', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon4': '0.282', 'ARMOR': '0.968', 'WEAPON3': '1.000', 'HITCOUNT': '1.130', 'weapon2': '1.300', 'weapon3': '2.238', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:05,497][52795] DAMAGECOUNT value on done: 10732.0 [2024-08-05 22:36:05,498][52795] Sum rewards: 14.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.938', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.020', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.850', 'HITCOUNT': '1.200', 'ARMOR': '1.321', 'weapon2': '1.542', 'weapon3': '1.794', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:05,675][52669] DAMAGECOUNT value on done: 10388.0 [2024-08-05 22:36:05,677][52669] Sum rewards: 9.104, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.974', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'ARMOR': '0.855', 'weapon3': '0.926', 'weapon2': '0.982', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:06,176][52647] DAMAGECOUNT value on done: 9171.0 [2024-08-05 22:36:06,176][52647] Sum rewards: 10.876, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.023', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'weapon4': '0.252', 'ARMOR': '0.452', 'HEALTH': '0.487', 'WEAPON3': '0.500', 'weapon2': '0.754', 'HITCOUNT': '0.860', 'weapon3': '1.500', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:07,200][52663] DAMAGECOUNT value on done: 12529.0 [2024-08-05 22:36:07,201][52663] Sum rewards: 18.333, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'weapon4': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.068', 'AMMO3': '0.090', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'HITCOUNT': '1.270', 'weapon2': '1.482', 'weapon3': '2.070', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '14.000'} [2024-08-05 22:36:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 14609.0, 300 sec: 16356.2). Total num frames: 72081408. Throughput: 0: 4071.3. Samples: 18023770. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 22:36:07,795][52567] Avg episode reward: [(0, '9.259')] [2024-08-05 22:36:07,798][52614] Saving new best policy, reward=9.259! [2024-08-05 22:36:08,196][52667] DAMAGECOUNT value on done: 10096.0 [2024-08-05 22:36:08,197][52667] Sum rewards: 0.525, reward structure: {'DEATHCOUNT': '-3.000', 'FRAGCOUNT': '-1.500', 'AMMO5': '0.004', 'AMMO2': '0.020', 'AMMO3': '0.050', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.170', 'WEAPON4': '0.200', 'HITCOUNT': '0.260', 'WEAPON3': '0.350', 'weapon4': '0.510', 'ARMOR': '0.569', 'weapon2': '0.646', 'DAMAGECOUNT': '0.780', 'weapon3': '1.182'} [2024-08-05 22:36:08,277][52665] DAMAGECOUNT value on done: 9550.0 [2024-08-05 22:36:08,278][52665] Sum rewards: 10.925, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.306', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.032', 'weapon7': '0.058', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'ARMOR': '1.314', 'weapon3': '1.356', 'weapon2': '1.556', 'DAMAGECOUNT': '2.088', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:08,688][52811] DAMAGECOUNT value on done: 9702.0 [2024-08-05 22:36:08,688][52811] Sum rewards: 9.468, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.745', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.067', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'ARMOR': '0.908', 'weapon3': '1.034', 'weapon2': '1.262', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:08,820][52650] Updated weights for policy 0, policy_version 8801 (0.0013) [2024-08-05 22:36:08,959][52795] DAMAGECOUNT value on done: 9588.0 [2024-08-05 22:36:08,963][52795] Sum rewards: 7.277, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.282', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'ARMOR': '0.492', 'weapon4': '0.576', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '0.852', 'weapon3': '2.010', 'DAMAGECOUNT': '2.271', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:09,209][52669] DAMAGECOUNT value on done: 10333.0 [2024-08-05 22:36:09,213][52669] Sum rewards: 14.976, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.658', 'AMMO5': '0.014', 'AMMO2': '0.051', 'ARMOR': '0.060', 'AMMO3': '0.120', 'weapon5': '0.128', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.834', 'WEAPON3': '0.850', 'HITCOUNT': '1.120', 'weapon3': '2.018', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '13.500'} [2024-08-05 22:36:09,380][52647] DAMAGECOUNT value on done: 10485.0 [2024-08-05 22:36:09,381][52647] Sum rewards: 12.973, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.936', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.044', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'ARMOR': '0.512', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.252', 'weapon3': '1.704', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:10,688][52663] DAMAGECOUNT value on done: 9208.0 [2024-08-05 22:36:10,689][52663] Sum rewards: 12.696, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.556', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon4': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.938', 'HITCOUNT': '1.010', 'weapon2': '1.278', 'weapon3': '1.694', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:10,998][52667] DAMAGECOUNT value on done: 10337.0 [2024-08-05 22:36:10,998][52667] Sum rewards: 9.811, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.632', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.174', 'ARMOR': '0.474', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.414', 'weapon3': '2.114', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:11,437][52665] DAMAGECOUNT value on done: 9846.0 [2024-08-05 22:36:11,439][52665] Sum rewards: 11.643, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO3': '0.060', 'ARMOR': '0.084', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon4': '0.978', 'weapon2': '1.282', 'weapon3': '1.386', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:12,311][52669] DAMAGECOUNT value on done: 10294.0 [2024-08-05 22:36:12,311][52669] Sum rewards: 5.448, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.642', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.196', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.931', 'weapon3': '1.132', 'weapon2': '1.506', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:12,443][52795] DAMAGECOUNT value on done: 9582.0 [2024-08-05 22:36:12,443][52795] Sum rewards: 10.436, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.306', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.226', 'ARMOR': '0.486', 'WEAPON3': '0.850', 'weapon2': '1.094', 'HITCOUNT': '1.100', 'weapon3': '1.918', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:12,478][52647] DAMAGECOUNT value on done: 9197.0 [2024-08-05 22:36:12,478][52647] Sum rewards: 12.785, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.829', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.022', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'weapon4': '0.282', 'WEAPON3': '0.750', 'ARMOR': '0.901', 'HITCOUNT': '1.090', 'weapon2': '1.200', 'weapon3': '1.744', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 15155.3, 300 sec: 16356.2). Total num frames: 72163328. Throughput: 0: 4113.5. Samples: 18048080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:36:12,795][52567] Avg episode reward: [(0, '9.400')] [2024-08-05 22:36:12,795][52614] Saving new best policy, reward=9.400! [2024-08-05 22:36:13,703][52667] DAMAGECOUNT value on done: 10399.0 [2024-08-05 22:36:13,702][52663] DAMAGECOUNT value on done: 9430.0 [2024-08-05 22:36:13,704][52667] Sum rewards: 3.603, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.508', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'weapon4': '0.778', 'ARMOR': '0.924', 'weapon2': '1.026', 'weapon3': '1.732', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '3.000'} [2024-08-05 22:36:13,704][52663] Sum rewards: 7.892, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.012', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO3': '0.109', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'weapon5': '0.354', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'ARMOR': '0.956', 'weapon2': '1.212', 'weapon3': '1.942', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '6.500'} [2024-08-05 22:36:13,944][52650] Updated weights for policy 0, policy_version 8811 (0.0023) [2024-08-05 22:36:14,703][52665] DAMAGECOUNT value on done: 10254.0 [2024-08-05 22:36:14,704][52665] Sum rewards: 7.895, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.470', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.083', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'ARMOR': '0.912', 'weapon3': '1.352', 'weapon2': '1.946', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:15,008][52647] DAMAGECOUNT value on done: 11161.0 [2024-08-05 22:36:15,011][52647] Sum rewards: 10.732, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.216', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.212', 'HITCOUNT': '0.670', 'WEAPON3': '0.850', 'ARMOR': '1.265', 'weapon2': '1.402', 'weapon3': '1.684', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:15,410][52669] DAMAGECOUNT value on done: 9497.0 [2024-08-05 22:36:15,410][52669] Sum rewards: 9.166, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.335', 'AMMO2': '0.015', 'AMMO3': '0.074', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.392', 'WEAPON3': '0.500', 'HITCOUNT': '0.620', 'weapon2': '0.794', 'ARMOR': '1.033', 'weapon3': '1.346', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:15,660][52795] DAMAGECOUNT value on done: 10396.0 [2024-08-05 22:36:15,661][52795] Sum rewards: 16.016, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.410', 'WEAPON3': '0.700', 'HEALTH': '0.908', 'HITCOUNT': '0.970', 'weapon2': '1.174', 'ARMOR': '1.331', 'weapon3': '2.190', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:16,701][52667] DAMAGECOUNT value on done: 11890.0 [2024-08-05 22:36:16,704][52667] Sum rewards: 13.056, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.132', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'weapon4': '0.578', 'weapon2': '0.832', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon3': '2.254', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:16,907][52663] DAMAGECOUNT value on done: 10851.0 [2024-08-05 22:36:16,909][52663] Sum rewards: 5.890, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.285', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.086', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '1.226', 'weapon3': '1.342', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:17,364][52647] DAMAGECOUNT value on done: 9695.0 [2024-08-05 22:36:17,367][52647] Sum rewards: 9.606, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.063', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.079', 'ARMOR': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.238', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '0.914', 'weapon3': '1.388', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:17,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16247.5, 300 sec: 16328.5). Total num frames: 72245248. Throughput: 0: 4112.8. Samples: 18060650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:36:17,794][52567] Avg episode reward: [(0, '9.552')] [2024-08-05 22:36:17,798][52614] Saving new best policy, reward=9.552! [2024-08-05 22:36:18,158][52665] DAMAGECOUNT value on done: 10596.0 [2024-08-05 22:36:18,158][52665] Sum rewards: 6.736, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'HEALTH': '0.034', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.272', 'weapon4': '0.304', 'WEAPON3': '0.400', 'ARMOR': '0.532', 'HITCOUNT': '0.670', 'weapon3': '1.266', 'weapon2': '1.284', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:18,548][52650] Updated weights for policy 0, policy_version 8821 (0.0020) [2024-08-05 22:36:18,664][52669] DAMAGECOUNT value on done: 10331.0 [2024-08-05 22:36:18,664][52669] Sum rewards: 5.651, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.076', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon4': '0.384', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'ARMOR': '0.907', 'weapon3': '1.252', 'weapon2': '1.470', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '4.500'} [2024-08-05 22:36:19,007][52660] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 22:36:19,177][52795] DAMAGECOUNT value on done: 10020.0 [2024-08-05 22:36:19,178][52795] Sum rewards: 11.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.238', 'weapon5': '0.336', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.152', 'weapon3': '1.846', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:19,806][52663] DAMAGECOUNT value on done: 10136.0 [2024-08-05 22:36:19,807][52663] Sum rewards: 8.412, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.208', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.070', 'WEAPON4': '0.350', 'weapon4': '0.370', 'ARMOR': '0.540', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '1.012', 'weapon3': '1.416', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:20,032][52647] DAMAGECOUNT value on done: 11179.0 [2024-08-05 22:36:20,034][52647] Sum rewards: 16.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.181', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.160', 'WEAPON3': '0.850', 'ARMOR': '0.861', 'weapon2': '1.140', 'HITCOUNT': '1.260', 'weapon3': '2.088', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '15.000'} [2024-08-05 22:36:20,071][52667] DAMAGECOUNT value on done: 10599.0 [2024-08-05 22:36:20,072][52667] Sum rewards: 13.587, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.765', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.526', 'WEAPON3': '0.550', 'weapon2': '0.888', 'HITCOUNT': '1.010', 'weapon3': '1.752', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:21,460][52665] DAMAGECOUNT value on done: 10101.0 [2024-08-05 22:36:21,462][52665] Sum rewards: 7.098, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.904', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.424', 'ARMOR': '0.552', 'weapon2': '0.578', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '1.706', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:22,520][52795] DAMAGECOUNT value on done: 10388.0 [2024-08-05 22:36:22,520][52795] Sum rewards: 14.283, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.880', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.214', 'WEAPON3': '0.900', 'HITCOUNT': '1.080', 'weapon2': '1.594', 'weapon3': '1.714', 'ARMOR': '1.780', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '14.000'} [2024-08-05 22:36:22,781][52663] DAMAGECOUNT value on done: 9382.0 [2024-08-05 22:36:22,784][52663] Sum rewards: 9.326, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.020', 'AMMO2': '0.026', 'ARMOR': '0.076', 'AMMO3': '0.089', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.266', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'weapon2': '1.194', 'weapon3': '1.652', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:22,785][52667] DAMAGECOUNT value on done: 9861.0 [2024-08-05 22:36:22,786][52667] Sum rewards: 9.920, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.343', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.274', 'ARMOR': '0.483', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.592', 'weapon3': '1.728', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:22,800][52567] Fps is (10 sec: 16374.5, 60 sec: 16382.4, 300 sec: 16328.1). Total num frames: 72327168. Throughput: 0: 4103.7. Samples: 18085510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:36:22,800][52567] Avg episode reward: [(0, '9.517')] [2024-08-05 22:36:22,863][52658] DAMAGECOUNT value on done: 9472.0 [2024-08-05 22:36:22,866][52658] Sum rewards: 7.936, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.302', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.056', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.370', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'HITCOUNT': '0.650', 'weapon2': '1.030', 'weapon3': '1.208', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:23,287][52647] DAMAGECOUNT value on done: 9823.0 [2024-08-05 22:36:23,296][52647] Sum rewards: 6.880, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.800', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon7': '0.068', 'AMMO3': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.480', 'ARMOR': '0.523', 'weapon2': '0.566', 'WEAPON3': '0.600', 'weapon4': '0.896', 'weapon3': '1.416', 'DAMAGECOUNT': '1.923', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:23,738][52649] DAMAGECOUNT value on done: 10818.0 [2024-08-05 22:36:23,738][52649] Sum rewards: 7.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.124', 'AMMO2': '0.020', 'AMMO3': '0.095', 'AMMO4': '0.101', 'weapon4': '0.144', 'WEAPON4': '0.200', 'HITCOUNT': '0.460', 'WEAPON3': '0.650', 'ARMOR': '1.303', 'weapon2': '1.324', 'DAMAGECOUNT': '1.782', 'weapon3': '1.854', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:23,817][52650] Updated weights for policy 0, policy_version 8831 (0.0018) [2024-08-05 22:36:24,244][52665] DAMAGECOUNT value on done: 9414.0 [2024-08-05 22:36:24,245][52665] Sum rewards: 2.760, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.120', 'AMMO4': '0.215', 'HEALTH': '0.322', 'WEAPON4': '0.350', 'weapon4': '0.424', 'HITCOUNT': '0.620', 'WEAPON3': '0.700', 'weapon2': '1.100', 'weapon3': '1.838', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '3.000'} [2024-08-05 22:36:25,714][52795] DAMAGECOUNT value on done: 8397.0 [2024-08-05 22:36:25,716][52795] Sum rewards: 17.308, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.030', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.026', 'AMMO3': '0.091', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.960', 'HITCOUNT': '1.140', 'weapon2': '1.142', 'weapon3': '1.956', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:26,070][52649] DAMAGECOUNT value on done: 9207.0 [2024-08-05 22:36:26,072][52649] Sum rewards: 9.280, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.006', 'HEALTH': '0.019', 'AMMO4': '0.028', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.184', 'WEAPON3': '0.300', 'ARMOR': '0.478', 'HITCOUNT': '0.840', 'weapon2': '0.910', 'weapon3': '0.930', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:26,162][52663] DAMAGECOUNT value on done: 10227.0 [2024-08-05 22:36:26,164][52663] Sum rewards: 7.623, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.178', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.019', 'ARMOR': '0.060', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'HITCOUNT': '0.600', 'weapon4': '0.652', 'WEAPON3': '0.700', 'weapon2': '0.796', 'weapon3': '1.760', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:26,217][52820] DAMAGECOUNT value on done: 7847.0 [2024-08-05 22:36:26,221][52820] Sum rewards: 9.322, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.837', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.082', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.148', 'ARMOR': '1.278', 'weapon3': '1.944', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:26,332][52667] DAMAGECOUNT value on done: 9600.0 [2024-08-05 22:36:26,334][52667] Sum rewards: 11.231, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.047', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.030', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.750', 'ARMOR': '0.939', 'weapon3': '1.348', 'weapon2': '1.572', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:26,499][52658] DAMAGECOUNT value on done: 10266.0 [2024-08-05 22:36:26,500][52658] Sum rewards: 11.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.295', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'ARMOR': '0.040', 'weapon5': '0.054', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.440', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon2': '1.284', 'weapon3': '1.886', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:26,560][52647] DAMAGECOUNT value on done: 10301.0 [2024-08-05 22:36:26,563][52647] Sum rewards: 5.995, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.153', 'HEALTH': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.544', 'WEAPON3': '0.650', 'weapon2': '0.762', 'HITCOUNT': '0.860', 'weapon3': '1.880', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:27,042][52665] DAMAGECOUNT value on done: 10133.0 [2024-08-05 22:36:27,043][52665] Sum rewards: 12.120, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.877', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'ARMOR': '0.485', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.466', 'weapon3': '1.658', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:27,795][52567] Fps is (10 sec: 16382.6, 60 sec: 16520.3, 300 sec: 16328.4). Total num frames: 72409088. Throughput: 0: 4102.6. Samples: 18110760. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:36:27,795][52567] Avg episode reward: [(0, '9.614')] [2024-08-05 22:36:27,819][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008840_72417280.pth... [2024-08-05 22:36:27,958][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008366_68534272.pth [2024-08-05 22:36:27,961][52614] Saving new best policy, reward=9.614! [2024-08-05 22:36:28,277][52650] Updated weights for policy 0, policy_version 8841 (0.0035) [2024-08-05 22:36:29,157][52663] DAMAGECOUNT value on done: 9677.0 [2024-08-05 22:36:29,157][52663] Sum rewards: 10.286, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.051', 'AMMO2': '0.025', 'ARMOR': '0.112', 'AMMO3': '0.116', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'weapon4': '0.388', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.058', 'weapon3': '1.896', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:29,292][52795] DAMAGECOUNT value on done: 9464.0 [2024-08-05 22:36:29,292][52795] Sum rewards: 12.359, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.626', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon4': '0.216', 'ARMOR': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '1.240', 'weapon2': '1.246', 'weapon3': '2.136', 'DAMAGECOUNT': '4.623', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:29,529][52820] DAMAGECOUNT value on done: 9522.0 [2024-08-05 22:36:29,534][52820] Sum rewards: 6.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.104', 'WEAPON4': '0.350', 'weapon4': '0.370', 'HITCOUNT': '0.520', 'weapon2': '0.754', 'WEAPON3': '0.800', 'ARMOR': '1.015', 'weapon3': '2.010', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:29,744][52667] DAMAGECOUNT value on done: 11025.0 [2024-08-05 22:36:29,744][52667] Sum rewards: 18.464, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.583', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'ARMOR': '1.347', 'weapon2': '1.382', 'weapon3': '1.770', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '16.000'} [2024-08-05 22:36:29,823][52649] DAMAGECOUNT value on done: 9859.0 [2024-08-05 22:36:29,825][52649] Sum rewards: 8.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.148', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.030', 'ARMOR': '0.032', 'weapon5': '0.040', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'HITCOUNT': '0.880', 'weapon2': '0.964', 'WEAPON3': '1.200', 'weapon3': '2.574', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:29,960][52658] DAMAGECOUNT value on done: 9272.0 [2024-08-05 22:36:29,961][52658] Sum rewards: 10.591, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.861', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.017', 'weapon5': '0.054', 'AMMO3': '0.102', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'ARMOR': '1.346', 'weapon2': '1.632', 'weapon3': '1.900', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:30,301][52647] DAMAGECOUNT value on done: 9510.0 [2024-08-05 22:36:30,303][52647] Sum rewards: 13.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.399', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.093', 'WEAPON3': '0.650', 'ARMOR': '0.872', 'HITCOUNT': '0.940', 'weapon2': '1.408', 'weapon3': '1.506', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:30,619][52665] DAMAGECOUNT value on done: 9419.0 [2024-08-05 22:36:30,621][52665] Sum rewards: 11.638, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.223', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'ARMOR': '0.966', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon2': '1.684', 'weapon3': '2.132', 'DAMAGECOUNT': '4.026', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:32,613][52649] DAMAGECOUNT value on done: 11816.0 [2024-08-05 22:36:32,613][52649] Sum rewards: 9.455, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.586', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.362', 'ARMOR': '0.520', 'WEAPON3': '0.700', 'HITCOUNT': '0.950', 'weapon2': '1.538', 'weapon3': '1.610', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:32,794][52567] Fps is (10 sec: 15573.9, 60 sec: 16385.6, 300 sec: 16272.9). Total num frames: 72482816. Throughput: 0: 4065.4. Samples: 18122020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:36:32,794][52567] Avg episode reward: [(0, '9.768')] [2024-08-05 22:36:32,800][52614] Saving new best policy, reward=9.768! [2024-08-05 22:36:33,280][52665] DAMAGECOUNT value on done: 10744.0 [2024-08-05 22:36:33,282][52665] Sum rewards: 4.460, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.416', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.232', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon3': '0.778', 'ARMOR': '0.800', 'weapon2': '1.010', 'DAMAGECOUNT': '1.470', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:33,541][52663] DAMAGECOUNT value on done: 10368.0 [2024-08-05 22:36:33,541][52663] Sum rewards: 11.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.632', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'WEAPON3': '0.950', 'HITCOUNT': '1.350', 'weapon2': '1.478', 'ARMOR': '1.663', 'weapon3': '2.270', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:34,370][52667] DAMAGECOUNT value on done: 9210.0 [2024-08-05 22:36:34,371][52667] Sum rewards: 3.737, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.937', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO3': '0.084', 'HITCOUNT': '0.460', 'WEAPON3': '0.550', 'ARMOR': '0.959', 'DAMAGECOUNT': '1.245', 'weapon2': '1.538', 'weapon3': '1.624', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:34,472][52658] DAMAGECOUNT value on done: 10280.0 [2024-08-05 22:36:34,473][52658] Sum rewards: 13.562, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.032', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'HEALTH': '0.390', 'WEAPON3': '0.400', 'HITCOUNT': '1.020', 'weapon2': '1.224', 'weapon3': '1.438', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:34,760][52650] Updated weights for policy 0, policy_version 8851 (0.0020) [2024-08-05 22:36:34,791][52820] DAMAGECOUNT value on done: 9482.0 [2024-08-05 22:36:34,791][52820] Sum rewards: 5.293, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.052', 'AMMO2': '0.022', 'AMMO3': '0.110', 'AMMO4': '0.110', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'ARMOR': '0.884', 'weapon3': '1.414', 'weapon2': '2.098', 'DAMAGECOUNT': '2.460', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:35,323][52794] DAMAGECOUNT value on done: 11598.0 [2024-08-05 22:36:35,323][52794] Sum rewards: 13.313, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.113', 'WEAPON3': '0.800', 'ARMOR': '0.828', 'HITCOUNT': '1.200', 'weapon2': '1.642', 'weapon3': '1.866', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:35,657][52664] DAMAGECOUNT value on done: 11557.0 [2024-08-05 22:36:35,658][52664] Sum rewards: 12.137, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.726', 'AMMO2': '0.026', 'AMMO3': '0.111', 'AMMO4': '0.128', 'WEAPON4': '0.300', 'ARMOR': '0.534', 'weapon4': '0.620', 'WEAPON3': '0.750', 'HITCOUNT': '1.110', 'weapon2': '1.158', 'weapon3': '1.988', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:36,471][52649] DAMAGECOUNT value on done: 9037.0 [2024-08-05 22:36:36,503][52649] Sum rewards: 10.284, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.148', 'weapon4': '0.204', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '1.646', 'weapon3': '1.732', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:38,102][52567] Fps is (10 sec: 11922.4, 60 sec: 15621.3, 300 sec: 16117.3). Total num frames: 72531968. Throughput: 0: 3889.6. Samples: 18140510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:36:38,193][52567] Avg episode reward: [(0, '9.799')] [2024-08-05 22:36:38,791][52614] Saving new best policy, reward=9.799! [2024-08-05 22:36:39,579][52663] DAMAGECOUNT value on done: 10400.0 [2024-08-05 22:36:39,579][52663] Sum rewards: 13.883, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.246', 'weapon5': '0.006', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.064', 'ARMOR': '0.066', 'weapon4': '0.118', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.830', 'WEAPON3': '1.000', 'HITCOUNT': '1.010', 'weapon3': '2.692', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '14.000'} [2024-08-05 22:36:39,685][52667] DAMAGECOUNT value on done: 10672.0 [2024-08-05 22:36:39,685][52667] Sum rewards: 6.635, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.320', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.436', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.847', 'weapon2': '1.234', 'weapon3': '1.366', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:39,914][52658] DAMAGECOUNT value on done: 10166.0 [2024-08-05 22:36:39,914][52658] Sum rewards: 10.782, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.354', 'AMMO2': '0.002', 'AMMO4': '0.009', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'weapon4': '0.174', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon2': '1.206', 'weapon3': '1.740', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:40,198][52794] DAMAGECOUNT value on done: 12082.0 [2024-08-05 22:36:40,199][52794] Sum rewards: 15.091, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.014', 'AMMO4': '0.025', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'WEAPON3': '0.900', 'weapon2': '1.266', 'HITCOUNT': '1.330', 'weapon3': '1.766', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '14.000'} [2024-08-05 22:36:40,871][52820] DAMAGECOUNT value on done: 10793.0 [2024-08-05 22:36:40,877][52820] Sum rewards: 10.002, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.814', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.702', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon2': '0.962', 'ARMOR': '1.052', 'weapon3': '1.740', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.500'} [2024-08-05 22:36:41,581][52664] DAMAGECOUNT value on done: 10291.0 [2024-08-05 22:36:41,582][52664] Sum rewards: 6.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.630', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.012', 'AMMO4': '0.031', 'ARMOR': '0.040', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON3': '0.650', 'weapon2': '1.024', 'HITCOUNT': '1.040', 'weapon3': '1.640', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:42,199][52663] DAMAGECOUNT value on done: 10477.0 [2024-08-05 22:36:42,199][52663] Sum rewards: 14.214, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.586', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon5': '0.440', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon2': '1.210', 'ARMOR': '1.353', 'weapon3': '1.564', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:42,421][52649] DAMAGECOUNT value on done: 10293.0 [2024-08-05 22:36:42,422][52649] Sum rewards: 7.688, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.078', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON3': '0.750', 'ARMOR': '0.944', 'HITCOUNT': '0.990', 'weapon2': '1.578', 'weapon3': '1.894', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:42,621][52667] DAMAGECOUNT value on done: 11094.0 [2024-08-05 22:36:42,624][52667] Sum rewards: 11.236, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.624', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.090', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.246', 'weapon5': '0.248', 'ARMOR': '0.508', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon2': '1.258', 'weapon3': '1.626', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:42,794][52567] Fps is (10 sec: 9830.5, 60 sec: 15157.7, 300 sec: 16050.8). Total num frames: 72581120. Throughput: 0: 3720.9. Samples: 18155530. Policy #0 lag: (min: 1.0, avg: 3.7, max: 11.0) [2024-08-05 22:36:42,794][52567] Avg episode reward: [(0, '9.907')] [2024-08-05 22:36:42,795][52614] Saving new best policy, reward=9.907! [2024-08-05 22:36:42,939][52658] DAMAGECOUNT value on done: 8498.0 [2024-08-05 22:36:42,941][52658] Sum rewards: 13.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.716', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'weapon4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.520', 'weapon3': '2.142', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:43,053][52650] Updated weights for policy 0, policy_version 8861 (0.0026) [2024-08-05 22:36:43,145][52794] DAMAGECOUNT value on done: 12178.0 [2024-08-05 22:36:43,145][52794] Sum rewards: 10.651, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.012', 'HEALTH': '0.016', 'AMMO4': '0.061', 'AMMO3': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'ARMOR': '1.256', 'weapon3': '1.548', 'weapon2': '1.670', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:44,312][52662] DAMAGECOUNT value on done: 10743.0 [2024-08-05 22:36:44,312][52662] Sum rewards: 5.477, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.285', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.026', 'AMMO4': '0.067', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.562', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '0.925', 'weapon2': '1.062', 'weapon3': '1.452', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:44,737][52820] DAMAGECOUNT value on done: 9598.0 [2024-08-05 22:36:44,741][52820] Sum rewards: 6.973, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.216', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.524', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon2': '1.306', 'ARMOR': '1.330', 'weapon3': '1.640', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:45,006][52671] DAMAGECOUNT value on done: 11619.0 [2024-08-05 22:36:45,007][52671] Sum rewards: 19.705, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.091', 'AMMO2': '0.026', 'AMMO3': '0.098', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.486', 'WEAPON3': '0.650', 'ARMOR': '0.933', 'weapon2': '0.984', 'HITCOUNT': '1.200', 'weapon3': '1.966', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '15.000'} [2024-08-05 22:36:45,146][52663] DAMAGECOUNT value on done: 9773.0 [2024-08-05 22:36:45,146][52663] Sum rewards: 9.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.112', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.138', 'WEAPON3': '1.050', 'HITCOUNT': '1.080', 'weapon2': '1.558', 'ARMOR': '1.746', 'weapon3': '2.346', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:45,322][52664] DAMAGECOUNT value on done: 10909.0 [2024-08-05 22:36:45,323][52664] Sum rewards: 8.317, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.439', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.074', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'ARMOR': '0.910', 'weapon3': '1.546', 'weapon2': '1.652', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:45,727][52667] DAMAGECOUNT value on done: 11240.0 [2024-08-05 22:36:45,729][52667] Sum rewards: 10.519, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.238', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.348', 'ARMOR': '0.489', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon3': '1.396', 'weapon2': '1.422', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:45,915][52658] DAMAGECOUNT value on done: 11585.0 [2024-08-05 22:36:45,917][52658] Sum rewards: 2.958, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.826', 'AMMO2': '0.019', 'weapon7': '0.078', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.350', 'HITCOUNT': '0.700', 'weapon4': '0.770', 'weapon2': '0.806', 'WEAPON3': '0.950', 'ARMOR': '0.984', 'weapon3': '1.900', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:46,189][52794] DAMAGECOUNT value on done: 11510.0 [2024-08-05 22:36:46,190][52794] Sum rewards: 6.736, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.089', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.041', 'WEAPON4': '0.050', 'ARMOR': '0.072', 'weapon4': '0.256', 'WEAPON3': '0.300', 'HITCOUNT': '0.560', 'weapon2': '0.600', 'weapon3': '0.938', 'DAMAGECOUNT': '1.980', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:46,455][52649] DAMAGECOUNT value on done: 8301.0 [2024-08-05 22:36:46,459][52649] Sum rewards: 10.524, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'WEAPON7': '0.200', 'weapon4': '0.240', 'ARMOR': '0.430', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon3': '1.222', 'weapon2': '1.266', 'DAMAGECOUNT': '2.577', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:47,034][52662] DAMAGECOUNT value on done: 11497.0 [2024-08-05 22:36:47,034][52662] Sum rewards: 2.640, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.468', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.082', 'ARMOR': '0.100', 'WEAPON4': '0.200', 'HITCOUNT': '0.370', 'weapon4': '0.468', 'WEAPON3': '0.600', 'weapon2': '0.842', 'DAMAGECOUNT': '1.170', 'weapon3': '1.456', 'FRAGCOUNT': '3.000'} [2024-08-05 22:36:47,794][52567] Fps is (10 sec: 13522.9, 60 sec: 15018.8, 300 sec: 16023.0). Total num frames: 72663040. Throughput: 0: 3704.9. Samples: 18166100. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:36:47,794][52567] Avg episode reward: [(0, '9.880')] [2024-08-05 22:36:48,247][52650] Updated weights for policy 0, policy_version 8871 (0.0030) [2024-08-05 22:36:48,374][52820] DAMAGECOUNT value on done: 11181.0 [2024-08-05 22:36:48,375][52820] Sum rewards: 12.128, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.403', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'ARMOR': '0.512', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon2': '1.050', 'weapon3': '2.234', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '12.000'} [2024-08-05 22:36:48,864][52664] DAMAGECOUNT value on done: 9452.0 [2024-08-05 22:36:48,864][52664] Sum rewards: 8.927, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.713', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.063', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '1.136', 'weapon3': '1.636', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:48,871][52671] DAMAGECOUNT value on done: 9642.0 [2024-08-05 22:36:48,871][52671] Sum rewards: 9.843, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.506', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.072', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon4': '0.744', 'weapon2': '0.950', 'ARMOR': '1.337', 'weapon3': '1.586', 'DAMAGECOUNT': '2.607', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:48,935][52663] DAMAGECOUNT value on done: 9128.0 [2024-08-05 22:36:48,935][52663] Sum rewards: 11.359, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.205', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.022', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'ARMOR': '0.060', 'AMMO3': '0.095', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'weapon2': '1.378', 'weapon3': '1.988', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:49,069][52667] DAMAGECOUNT value on done: 10748.0 [2024-08-05 22:36:49,070][52667] Sum rewards: 9.112, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.956', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.428', 'ARMOR': '0.472', 'HITCOUNT': '0.910', 'WEAPON3': '1.000', 'weapon2': '1.076', 'weapon3': '1.812', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:49,341][52658] DAMAGECOUNT value on done: 9814.0 [2024-08-05 22:36:49,491][52794] DAMAGECOUNT value on done: 12175.0 [2024-08-05 22:36:49,493][52794] Sum rewards: 16.547, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.989', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.268', 'WEAPON3': '0.900', 'HITCOUNT': '1.300', 'weapon2': '1.300', 'weapon3': '1.938', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '15.000'} [2024-08-05 22:36:50,156][52649] DAMAGECOUNT value on done: 9558.0 [2024-08-05 22:36:50,156][52649] Sum rewards: 14.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.528', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.300', 'weapon4': '0.632', 'WEAPON3': '0.800', 'HITCOUNT': '0.860', 'ARMOR': '0.978', 'weapon2': '1.138', 'weapon3': '1.840', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:50,517][52662] DAMAGECOUNT value on done: 12412.0 [2024-08-05 22:36:50,517][52662] Sum rewards: 15.798, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.376', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.232', 'ARMOR': '0.498', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon2': '1.408', 'weapon3': '2.114', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:52,110][52820] DAMAGECOUNT value on done: 7680.0 [2024-08-05 22:36:52,113][52820] Sum rewards: 6.067, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.178', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.298', 'weapon5': '0.368', 'WEAPON3': '0.450', 'HITCOUNT': '0.530', 'ARMOR': '0.545', 'weapon2': '1.140', 'weapon3': '1.334', 'DAMAGECOUNT': '1.437', 'FRAGCOUNT': '5.000'} [2024-08-05 22:36:52,238][52664] DAMAGECOUNT value on done: 10418.0 [2024-08-05 22:36:52,239][52664] Sum rewards: 13.861, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.175', 'AMMO2': '0.009', 'AMMO4': '0.043', 'ARMOR': '0.092', 'AMMO3': '0.119', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '1.190', 'weapon2': '1.442', 'weapon3': '2.140', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:52,291][52671] DAMAGECOUNT value on done: 12034.0 [2024-08-05 22:36:52,293][52671] Sum rewards: 15.351, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.439', 'AMMO2': '0.004', 'AMMO4': '0.019', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'weapon4': '0.260', 'WEAPON3': '0.650', 'HITCOUNT': '1.270', 'weapon2': '1.478', 'weapon3': '1.768', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:52,328][52794] DAMAGECOUNT value on done: 12084.0 [2024-08-05 22:36:52,329][52794] Sum rewards: 11.374, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.532', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.095', 'weapon4': '0.110', 'WEAPON4': '0.150', 'ARMOR': '0.516', 'WEAPON3': '0.800', 'weapon2': '0.884', 'HITCOUNT': '0.910', 'weapon3': '2.082', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:52,430][52667] DAMAGECOUNT value on done: 9699.0 [2024-08-05 22:36:52,430][52667] Sum rewards: 10.474, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.351', 'AMMO5': '0.009', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.038', 'ARMOR': '0.060', 'AMMO4': '0.064', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.418', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.242', 'weapon3': '1.758', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:52,667][52658] DAMAGECOUNT value on done: 8430.0 [2024-08-05 22:36:52,668][52658] Sum rewards: 5.487, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.518', 'AMMO2': '0.024', 'AMMO3': '0.067', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON3': '0.450', 'ARMOR': '0.484', 'HITCOUNT': '0.610', 'weapon2': '1.016', 'weapon3': '1.304', 'DAMAGECOUNT': '2.004', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:52,762][52663] DAMAGECOUNT value on done: 9506.0 [2024-08-05 22:36:52,762][52663] Sum rewards: 7.506, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.419', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'weapon4': '0.218', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.270', 'ARMOR': '1.321', 'weapon3': '2.250', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:52,794][52567] Fps is (10 sec: 15564.7, 60 sec: 15018.7, 300 sec: 15967.5). Total num frames: 72736768. Throughput: 0: 3648.2. Samples: 18187940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:36:52,795][52567] Avg episode reward: [(0, '10.076')] [2024-08-05 22:36:52,795][52614] Saving new best policy, reward=10.076! [2024-08-05 22:36:52,991][52662] DAMAGECOUNT value on done: 11616.0 [2024-08-05 22:36:52,991][52662] Sum rewards: 14.162, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.025', 'AMMO3': '0.060', 'HEALTH': '0.085', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.502', 'weapon4': '0.742', 'HITCOUNT': '0.970', 'weapon2': '1.254', 'weapon3': '1.386', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:53,958][52650] Updated weights for policy 0, policy_version 8881 (0.0024) [2024-08-05 22:36:54,025][52649] DAMAGECOUNT value on done: 9941.0 [2024-08-05 22:36:54,025][52649] Sum rewards: 11.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'ARMOR': '0.052', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon4': '0.732', 'HITCOUNT': '0.760', 'weapon2': '0.918', 'weapon3': '1.532', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:54,653][52794] DAMAGECOUNT value on done: 11223.0 [2024-08-05 22:36:54,653][52794] Sum rewards: 13.993, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.851', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.019', 'weapon7': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon4': '0.196', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.150', 'weapon2': '1.344', 'weapon3': '2.108', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:55,018][52659] DAMAGECOUNT value on done: 10132.0 [2024-08-05 22:36:55,018][52659] Sum rewards: 9.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.660', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'HITCOUNT': '0.760', 'ARMOR': '0.911', 'WEAPON3': '1.000', 'weapon2': '1.182', 'weapon3': '2.108', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '10.000'} [2024-08-05 22:36:55,301][52662] DAMAGECOUNT value on done: 11798.0 [2024-08-05 22:36:55,302][52662] Sum rewards: 17.296, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.138', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'WEAPON3': '0.700', 'ARMOR': '0.848', 'HITCOUNT': '1.280', 'weapon2': '1.448', 'weapon3': '2.088', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '15.000'} [2024-08-05 22:36:55,820][52664] DAMAGECOUNT value on done: 10186.0 [2024-08-05 22:36:55,822][52664] Sum rewards: 2.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'ARMOR': '0.545', 'weapon2': '0.592', 'HITCOUNT': '1.010', 'WEAPON3': '1.450', 'weapon3': '2.942', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:55,911][52820] DAMAGECOUNT value on done: 9744.0 [2024-08-05 22:36:55,912][52820] Sum rewards: 15.402, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.028', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.108', 'AMMO4': '0.112', 'AMMO3': '0.117', 'HEALTH': '0.196', 'weapon4': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.036', 'weapon3': '1.708', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '13.000'} [2024-08-05 22:36:55,961][52671] DAMAGECOUNT value on done: 10787.0 [2024-08-05 22:36:55,962][52671] Sum rewards: 8.250, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.844', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'ARMOR': '0.855', 'weapon3': '1.634', 'weapon2': '1.724', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:56,173][52667] DAMAGECOUNT value on done: 10179.0 [2024-08-05 22:36:56,176][52667] Sum rewards: 3.213, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.882', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.282', 'HITCOUNT': '0.350', 'ARMOR': '0.499', 'WEAPON3': '0.700', 'weapon2': '1.080', 'DAMAGECOUNT': '1.308', 'weapon3': '1.668', 'FRAGCOUNT': '4.000'} [2024-08-05 22:36:56,296][52658] DAMAGECOUNT value on done: 9129.0 [2024-08-05 22:36:56,297][52658] Sum rewards: 6.620, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon4': '0.192', 'HITCOUNT': '1.030', 'WEAPON3': '1.200', 'ARMOR': '1.323', 'weapon2': '1.332', 'weapon3': '2.262', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '8.000'} [2024-08-05 22:36:57,438][52649] DAMAGECOUNT value on done: 10101.0 [2024-08-05 22:36:57,441][52649] Sum rewards: 15.337, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon5': '0.190', 'HEALTH': '0.249', 'WEAPON3': '0.350', 'weapon4': '0.392', 'HITCOUNT': '0.830', 'ARMOR': '0.997', 'weapon2': '1.074', 'weapon3': '1.258', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '11.000'} [2024-08-05 22:36:57,794][52567] Fps is (10 sec: 14745.5, 60 sec: 14882.2, 300 sec: 15967.5). Total num frames: 72810496. Throughput: 0: 3592.7. Samples: 18209750. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:36:57,795][52567] Avg episode reward: [(0, '10.017')] [2024-08-05 22:36:57,799][52794] DAMAGECOUNT value on done: 9768.0 [2024-08-05 22:36:57,800][52794] Sum rewards: 5.256, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'ARMOR': '0.428', 'HITCOUNT': '0.570', 'WEAPON3': '0.600', 'weapon2': '0.650', 'weapon3': '1.386', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:58,508][52659] DAMAGECOUNT value on done: 10780.0 [2024-08-05 22:36:58,508][52659] Sum rewards: 6.224, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.780', 'AMMO2': '0.021', 'AMMO3': '0.088', 'AMMO4': '0.106', 'weapon4': '0.248', 'WEAPON4': '0.250', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'ARMOR': '0.847', 'weapon2': '1.016', 'weapon3': '1.420', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:58,528][52662] DAMAGECOUNT value on done: 12971.0 [2024-08-05 22:36:58,529][52662] Sum rewards: 10.655, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.045', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon7': '0.116', 'weapon4': '0.146', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.156', 'weapon3': '1.308', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:58,994][52664] DAMAGECOUNT value on done: 10900.0 [2024-08-05 22:36:58,995][52664] Sum rewards: 7.680, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.691', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.040', 'AMMO4': '0.063', 'weapon4': '0.126', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.862', 'HITCOUNT': '0.930', 'weapon3': '1.620', 'weapon2': '1.788', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '7.000'} [2024-08-05 22:36:59,063][52671] DAMAGECOUNT value on done: 10454.0 [2024-08-05 22:36:59,064][52671] Sum rewards: 8.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.020', 'AMMO4': '0.048', 'weapon4': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'ARMOR': '1.348', 'weapon3': '1.586', 'weapon2': '1.836', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '9.000'} [2024-08-05 22:36:59,454][52650] Updated weights for policy 0, policy_version 8891 (0.0014) [2024-08-05 22:36:59,647][52667] DAMAGECOUNT value on done: 10481.0 [2024-08-05 22:36:59,649][52667] Sum rewards: 4.974, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.701', 'ARMOR': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.386', 'weapon2': '0.726', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon3': '2.030', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:59,759][52820] DAMAGECOUNT value on done: 8829.0 [2024-08-05 22:36:59,777][52820] Sum rewards: 3.996, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.702', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.264', 'ARMOR': '0.455', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'weapon2': '0.944', 'weapon3': '1.862', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '6.000'} [2024-08-05 22:36:59,831][52658] DAMAGECOUNT value on done: 10079.0 [2024-08-05 22:36:59,834][52658] Sum rewards: 5.907, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.658', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.086', 'WEAPON4': '0.250', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon4': '0.722', 'weapon2': '0.778', 'weapon3': '1.296', 'DAMAGECOUNT': '1.419', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:00,725][52794] DAMAGECOUNT value on done: 12949.0 [2024-08-05 22:37:00,727][52794] Sum rewards: 7.676, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.336', 'AMMO2': '0.001', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon7': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.610', 'WEAPON3': '0.800', 'ARMOR': '1.410', 'weapon2': '1.498', 'weapon3': '1.696', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:00,847][52649] DAMAGECOUNT value on done: 10181.0 [2024-08-05 22:37:00,848][52649] Sum rewards: 5.978, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.647', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.152', 'ARMOR': '0.416', 'HITCOUNT': '0.760', 'WEAPON3': '1.000', 'weapon2': '1.114', 'weapon3': '2.072', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:01,856][52662] DAMAGECOUNT value on done: 12171.0 [2024-08-05 22:37:01,856][52662] Sum rewards: 3.622, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.006', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.326', 'ARMOR': '0.511', 'HITCOUNT': '0.780', 'weapon2': '0.818', 'WEAPON3': '0.900', 'weapon3': '2.004', 'DAMAGECOUNT': '2.817', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:01,913][52659] DAMAGECOUNT value on done: 10178.0 [2024-08-05 22:37:01,920][52659] Sum rewards: 10.667, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.002', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.328', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'ARMOR': '0.868', 'weapon2': '1.192', 'weapon3': '1.828', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:02,410][52671] DAMAGECOUNT value on done: 10071.0 [2024-08-05 22:37:02,410][52671] Sum rewards: 13.046, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.553', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.294', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon3': '1.412', 'weapon2': '1.454', 'DAMAGECOUNT': '2.961', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:02,445][52664] DAMAGECOUNT value on done: 10124.0 [2024-08-05 22:37:02,446][52664] Sum rewards: 15.046, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.034', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.082', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.980', 'weapon2': '1.434', 'weapon3': '1.724', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '13.000'} [2024-08-05 22:37:02,794][52567] Fps is (10 sec: 13926.2, 60 sec: 14745.6, 300 sec: 15884.1). Total num frames: 72876032. Throughput: 0: 3555.5. Samples: 18220650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:37:02,795][52567] Avg episode reward: [(0, '9.799')] [2024-08-05 22:37:03,036][52667] DAMAGECOUNT value on done: 9630.0 [2024-08-05 22:37:03,039][52667] Sum rewards: 0.969, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.978', 'AMMO2': '0.002', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.012', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'HITCOUNT': '0.400', 'weapon4': '0.566', 'weapon2': '0.682', 'WEAPON3': '0.850', 'DAMAGECOUNT': '1.380', 'weapon3': '1.632', 'FRAGCOUNT': '3.000'} [2024-08-05 22:37:03,299][52658] DAMAGECOUNT value on done: 9819.0 [2024-08-05 22:37:03,301][52658] Sum rewards: 7.410, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.579', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.046', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'WEAPON4': '0.400', 'ARMOR': '0.504', 'WEAPON3': '0.550', 'weapon4': '0.654', 'HITCOUNT': '0.690', 'weapon2': '0.712', 'weapon3': '1.832', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:03,564][52794] DAMAGECOUNT value on done: 11429.0 [2024-08-05 22:37:03,567][52794] Sum rewards: 10.260, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.570', 'AMMO2': '0.016', 'AMMO3': '0.060', 'AMMO4': '0.078', 'WEAPON4': '0.400', 'WEAPON3': '0.500', 'ARMOR': '0.566', 'weapon4': '0.758', 'HITCOUNT': '0.760', 'weapon2': '0.798', 'weapon3': '1.322', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:03,933][52820] DAMAGECOUNT value on done: 10116.0 [2024-08-05 22:37:03,935][52820] Sum rewards: 11.291, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.024', 'AMMO2': '0.011', 'weapon7': '0.052', 'AMMO4': '0.055', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.126', 'ARMOR': '0.447', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon2': '1.332', 'weapon3': '1.526', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:04,142][52649] DAMAGECOUNT value on done: 8887.0 [2024-08-05 22:37:04,143][52649] Sum rewards: 10.632, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.706', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon4': '0.070', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.461', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.554', 'weapon3': '1.978', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:04,210][52662] DAMAGECOUNT value on done: 12735.0 [2024-08-05 22:37:04,211][52662] Sum rewards: 10.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.512', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'weapon4': '0.002', 'ARMOR': '0.044', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.070', 'weapon2': '1.434', 'weapon3': '1.748', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:04,878][52650] Updated weights for policy 0, policy_version 8901 (0.0035) [2024-08-05 22:37:05,561][52659] DAMAGECOUNT value on done: 10826.0 [2024-08-05 22:37:05,561][52659] Sum rewards: 12.768, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'ARMOR': '0.040', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'weapon4': '0.224', 'WEAPON3': '0.850', 'HITCOUNT': '0.880', 'weapon2': '0.918', 'weapon3': '2.096', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:05,915][52664] DAMAGECOUNT value on done: 11008.0 [2024-08-05 22:37:05,917][52664] Sum rewards: 10.342, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.757', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.012', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '0.852', 'ARMOR': '0.953', 'weapon3': '1.396', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:06,462][52671] DAMAGECOUNT value on done: 10946.0 [2024-08-05 22:37:06,462][52671] Sum rewards: 8.890, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.067', 'HEALTH': '0.188', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'weapon3': '1.220', 'ARMOR': '1.252', 'weapon2': '1.874', 'DAMAGECOUNT': '2.478', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:06,647][52667] DAMAGECOUNT value on done: 10686.0 [2024-08-05 22:37:06,647][52667] Sum rewards: 12.312, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'weapon4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'ARMOR': '1.252', 'weapon2': '1.672', 'weapon3': '1.882', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:06,864][52794] DAMAGECOUNT value on done: 11518.0 [2024-08-05 22:37:06,865][52794] Sum rewards: 4.610, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.276', 'ARMOR': '0.500', 'HITCOUNT': '0.500', 'WEAPON3': '0.600', 'weapon2': '1.240', 'weapon3': '1.840', 'DAMAGECOUNT': '1.866', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:06,939][52658] DAMAGECOUNT value on done: 9776.0 [2024-08-05 22:37:06,940][52658] Sum rewards: 11.739, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.310', 'ARMOR': '0.475', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'weapon2': '1.362', 'weapon3': '1.924', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:07,122][52649] DAMAGECOUNT value on done: 11704.0 [2024-08-05 22:37:07,123][52649] Sum rewards: 10.620, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.328', 'ARMOR': '0.459', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'weapon2': '0.972', 'weapon3': '1.992', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:07,708][52820] DAMAGECOUNT value on done: 8577.0 [2024-08-05 22:37:07,709][52820] Sum rewards: 8.733, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.298', 'ARMOR': '0.509', 'WEAPON3': '0.700', 'HITCOUNT': '0.730', 'weapon2': '1.136', 'weapon3': '1.900', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:07,794][52567] Fps is (10 sec: 13926.2, 60 sec: 14472.5, 300 sec: 15856.4). Total num frames: 72949760. Throughput: 0: 3492.2. Samples: 18242640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:37:07,795][52567] Avg episode reward: [(0, '9.728')] [2024-08-05 22:37:07,799][52662] DAMAGECOUNT value on done: 11358.0 [2024-08-05 22:37:07,800][52662] Sum rewards: 6.375, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.116', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO3': '0.074', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.472', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon2': '0.792', 'weapon3': '1.648', 'DAMAGECOUNT': '2.256', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:09,539][52664] DAMAGECOUNT value on done: 10575.0 [2024-08-05 22:37:09,541][52664] Sum rewards: 5.669, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.132', 'weapon5': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.204', 'ARMOR': '0.510', 'HITCOUNT': '0.610', 'WEAPON3': '0.900', 'weapon2': '1.144', 'weapon3': '1.962', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:09,575][52659] DAMAGECOUNT value on done: 8911.0 [2024-08-05 22:37:09,576][52659] Sum rewards: 8.733, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.024', 'AMMO3': '0.067', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.120', 'AMMO4': '0.120', 'WEAPON3': '0.350', 'weapon4': '0.460', 'ARMOR': '0.465', 'HITCOUNT': '0.480', 'weapon2': '0.662', 'weapon3': '0.742', 'DAMAGECOUNT': '1.764', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:09,738][52794] DAMAGECOUNT value on done: 12276.0 [2024-08-05 22:37:09,741][52794] Sum rewards: 6.936, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.768', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.016', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.246', 'ARMOR': '0.416', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon2': '1.288', 'weapon3': '1.714', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:10,303][52671] DAMAGECOUNT value on done: 10364.0 [2024-08-05 22:37:10,305][52671] Sum rewards: 8.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.484', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.232', 'WEAPON3': '0.950', 'HITCOUNT': '1.030', 'weapon2': '1.312', 'ARMOR': '1.376', 'weapon3': '2.048', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:10,363][52662] DAMAGECOUNT value on done: 11574.0 [2024-08-05 22:37:10,364][52662] Sum rewards: 3.921, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.391', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.150', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon3': '1.448', 'weapon2': '1.558', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:10,912][52650] Updated weights for policy 0, policy_version 8911 (0.0021) [2024-08-05 22:37:11,001][52649] DAMAGECOUNT value on done: 9176.0 [2024-08-05 22:37:11,001][52649] Sum rewards: 7.488, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.435', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.384', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.946', 'weapon2': '1.106', 'weapon3': '1.406', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:11,465][52820] DAMAGECOUNT value on done: 9204.0 [2024-08-05 22:37:11,466][52820] Sum rewards: 12.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.027', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.358', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.176', 'weapon3': '2.034', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:11,851][52658] DAMAGECOUNT value on done: 10193.0 [2024-08-05 22:37:11,854][52658] Sum rewards: 8.313, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.951', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '1.340', 'weapon3': '1.664', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:12,241][52794] DAMAGECOUNT value on done: 11042.0 [2024-08-05 22:37:12,241][52794] Sum rewards: 10.022, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.026', 'AMMO4': '0.039', 'ARMOR': '0.064', 'AMMO3': '0.080', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.148', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '1.060', 'weapon3': '1.912', 'DAMAGECOUNT': '2.394', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:12,794][52567] Fps is (10 sec: 15565.1, 60 sec: 14472.6, 300 sec: 15828.6). Total num frames: 73031680. Throughput: 0: 3416.3. Samples: 18264490. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 22:37:12,794][52567] Avg episode reward: [(0, '9.556')] [2024-08-05 22:37:12,970][52664] DAMAGECOUNT value on done: 10188.0 [2024-08-05 22:37:12,974][52664] Sum rewards: 13.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.186', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.218', 'ARMOR': '0.471', 'WEAPON3': '0.850', 'HITCOUNT': '1.190', 'weapon2': '1.418', 'weapon3': '1.988', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:13,109][52662] DAMAGECOUNT value on done: 11380.0 [2024-08-05 22:37:13,109][52662] Sum rewards: 7.953, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.147', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'ARMOR': '0.056', 'weapon4': '0.056', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'weapon5': '0.218', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.264', 'weapon3': '1.876', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:13,400][52659] DAMAGECOUNT value on done: 10525.0 [2024-08-05 22:37:13,400][52659] Sum rewards: 15.219, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.770', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.028', 'weapon4': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON3': '1.150', 'HITCOUNT': '1.310', 'weapon2': '1.388', 'ARMOR': '1.428', 'weapon3': '2.314', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '15.000'} [2024-08-05 22:37:13,891][52671] DAMAGECOUNT value on done: 11131.0 [2024-08-05 22:37:13,893][52671] Sum rewards: 9.773, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.130', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'ARMOR': '0.963', 'weapon2': '1.188', 'weapon3': '1.418', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:14,077][52649] DAMAGECOUNT value on done: 9785.0 [2024-08-05 22:37:14,078][52649] Sum rewards: 8.320, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.232', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO3': '0.105', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.404', 'ARMOR': '0.526', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.184', 'weapon3': '1.876', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:15,199][52820] DAMAGECOUNT value on done: 9704.0 [2024-08-05 22:37:15,207][52820] Sum rewards: 8.874, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.277', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon7': '0.056', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '0.782', 'ARMOR': '0.865', 'weapon3': '1.560', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:15,507][52658] DAMAGECOUNT value on done: 10139.0 [2024-08-05 22:37:15,507][52658] Sum rewards: 14.226, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.214', 'AMMO2': '0.008', 'weapon4': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.118', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'ARMOR': '1.307', 'weapon2': '1.466', 'weapon3': '1.946', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '13.000'} [2024-08-05 22:37:16,183][52650] Updated weights for policy 0, policy_version 8921 (0.0020) [2024-08-05 22:37:16,267][52794] DAMAGECOUNT value on done: 13447.0 [2024-08-05 22:37:16,267][52794] Sum rewards: 8.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.046', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'weapon7': '0.070', 'AMMO3': '0.105', 'weapon4': '0.194', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.482', 'HITCOUNT': '0.740', 'WEAPON3': '0.750', 'weapon2': '1.430', 'weapon3': '1.722', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:16,471][52659] DAMAGECOUNT value on done: 10137.0 [2024-08-05 22:37:16,472][52659] Sum rewards: 8.445, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.215', 'AMMO4': '-0.053', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.044', 'weapon7': '0.060', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon2': '1.170', 'weapon3': '1.412', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '7.500'} [2024-08-05 22:37:16,678][52664] DAMAGECOUNT value on done: 8959.0 [2024-08-05 22:37:16,679][52664] Sum rewards: 9.718, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.788', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.172', 'HITCOUNT': '0.510', 'ARMOR': '0.524', 'weapon4': '0.578', 'WEAPON3': '0.600', 'weapon2': '0.874', 'weapon3': '1.510', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:17,003][52671] DAMAGECOUNT value on done: 11078.0 [2024-08-05 22:37:17,003][52671] Sum rewards: 10.237, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.972', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.258', 'ARMOR': '0.897', 'WEAPON3': '0.900', 'weapon2': '1.094', 'HITCOUNT': '1.120', 'weapon3': '2.066', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:17,021][52662] DAMAGECOUNT value on done: 11180.0 [2024-08-05 22:37:17,021][52662] Sum rewards: 8.804, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.444', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'weapon4': '0.324', 'WEAPON3': '0.600', 'ARMOR': '0.966', 'HITCOUNT': '0.970', 'weapon2': '1.064', 'weapon3': '1.758', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:17,418][52649] DAMAGECOUNT value on done: 11591.0 [2024-08-05 22:37:17,418][52649] Sum rewards: 10.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.710', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'weapon4': '0.290', 'ARMOR': '0.436', 'weapon2': '0.808', 'WEAPON3': '1.300', 'HITCOUNT': '1.420', 'weapon3': '2.730', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:17,794][52567] Fps is (10 sec: 14745.7, 60 sec: 14199.4, 300 sec: 15800.8). Total num frames: 73097216. Throughput: 0: 3408.2. Samples: 18275390. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:37:17,795][52567] Avg episode reward: [(0, '9.546')] [2024-08-05 22:37:18,158][52666] DAMAGECOUNT value on done: 9856.0 [2024-08-05 22:37:18,159][52666] Sum rewards: 11.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.883', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.432', 'WEAPON3': '0.750', 'ARMOR': '0.969', 'HITCOUNT': '1.080', 'weapon2': '1.422', 'weapon3': '1.834', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:18,901][52658] DAMAGECOUNT value on done: 11318.0 [2024-08-05 22:37:18,902][52658] Sum rewards: 9.806, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'HEALTH': '0.288', 'weapon4': '0.630', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.028', 'ARMOR': '1.300', 'weapon3': '1.920', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:19,279][52820] DAMAGECOUNT value on done: 7881.0 [2024-08-05 22:37:19,279][52820] Sum rewards: 9.931, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.091', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.060', 'WEAPON3': '0.400', 'HITCOUNT': '0.750', 'weapon3': '1.428', 'weapon2': '1.458', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:19,280][52794] DAMAGECOUNT value on done: 11626.0 [2024-08-05 22:37:19,280][52794] Sum rewards: 8.496, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.199', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.109', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'weapon3': '1.690', 'weapon2': '1.798', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:19,593][52659] DAMAGECOUNT value on done: 9043.0 [2024-08-05 22:37:19,595][52659] Sum rewards: 7.995, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.264', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.064', 'weapon4': '0.084', 'AMMO4': '0.122', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'ARMOR': '0.845', 'weapon3': '1.334', 'weapon2': '1.650', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:19,899][52662] DAMAGECOUNT value on done: 12386.0 [2024-08-05 22:37:19,899][52662] Sum rewards: 10.971, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.832', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.344', 'WEAPON3': '0.900', 'HITCOUNT': '1.020', 'ARMOR': '1.039', 'weapon2': '1.144', 'weapon3': '2.100', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:20,022][52664] DAMAGECOUNT value on done: 9742.0 [2024-08-05 22:37:20,023][52664] Sum rewards: 14.900, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.972', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'WEAPON3': '0.600', 'weapon5': '0.724', 'HITCOUNT': '0.840', 'ARMOR': '0.867', 'weapon2': '1.270', 'weapon3': '1.452', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:20,388][52671] DAMAGECOUNT value on done: 10028.0 [2024-08-05 22:37:20,389][52671] Sum rewards: 7.897, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.091', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'weapon4': '0.264', 'ARMOR': '0.485', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '0.930', 'weapon3': '1.690', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:20,616][52670] DAMAGECOUNT value on done: 11049.0 [2024-08-05 22:37:20,625][52670] Sum rewards: 10.975, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.551', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.166', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '0.690', 'weapon2': '1.062', 'weapon3': '1.650', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:21,287][52649] DAMAGECOUNT value on done: 8903.0 [2024-08-05 22:37:21,297][52649] Sum rewards: 5.492, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.025', 'AMMO3': '0.045', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON3': '0.250', 'HITCOUNT': '0.440', 'HEALTH': '0.510', 'ARMOR': '0.857', 'weapon3': '0.864', 'DAMAGECOUNT': '1.317', 'weapon2': '1.552', 'FRAGCOUNT': '3.000'} [2024-08-05 22:37:21,601][52794] DAMAGECOUNT value on done: 12384.0 [2024-08-05 22:37:21,601][52794] Sum rewards: 7.250, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.452', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'AMMO3': '0.065', 'weapon4': '0.140', 'WEAPON4': '0.150', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon3': '1.300', 'ARMOR': '1.373', 'weapon2': '1.486', 'DAMAGECOUNT': '1.593', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:21,972][52650] Updated weights for policy 0, policy_version 8931 (0.0012) [2024-08-05 22:37:22,205][52666] DAMAGECOUNT value on done: 8997.0 [2024-08-05 22:37:22,206][52666] Sum rewards: 7.518, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.316', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon4': '0.426', 'ARMOR': '0.517', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon2': '0.870', 'weapon3': '2.132', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:22,301][52662] DAMAGECOUNT value on done: 11765.0 [2024-08-05 22:37:22,303][52662] Sum rewards: 6.859, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'HEALTH': '0.046', 'AMMO4': '0.048', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.552', 'HITCOUNT': '0.740', 'weapon3': '1.474', 'weapon2': '1.558', 'DAMAGECOUNT': '2.361', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:22,540][52658] DAMAGECOUNT value on done: 10848.0 [2024-08-05 22:37:22,544][52658] Sum rewards: 12.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.419', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.127', 'WEAPON3': '0.900', 'ARMOR': '0.901', 'HITCOUNT': '1.110', 'weapon2': '1.370', 'weapon3': '2.398', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:22,794][52567] Fps is (10 sec: 13926.4, 60 sec: 14064.3, 300 sec: 15717.5). Total num frames: 73170944. Throughput: 0: 3511.8. Samples: 18297460. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:37:22,794][52567] Avg episode reward: [(0, '9.444')] [2024-08-05 22:37:23,060][52659] DAMAGECOUNT value on done: 10470.0 [2024-08-05 22:37:23,061][52659] Sum rewards: 11.545, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.476', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon7': '0.054', 'AMMO4': '0.063', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.482', 'WEAPON3': '0.750', 'weapon2': '0.764', 'HITCOUNT': '0.920', 'ARMOR': '0.925', 'weapon3': '1.496', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:23,236][52820] DAMAGECOUNT value on done: 9395.0 [2024-08-05 22:37:23,240][52820] Sum rewards: 13.009, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.032', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO3': '0.085', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon3': '1.306', 'ARMOR': '1.341', 'weapon2': '1.576', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:23,761][52670] DAMAGECOUNT value on done: 9513.0 [2024-08-05 22:37:23,761][52670] Sum rewards: 7.776, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.612', 'AMMO2': '0.030', 'AMMO3': '0.082', 'AMMO4': '0.152', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'ARMOR': '0.960', 'weapon2': '1.240', 'weapon3': '1.772', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:23,749][52671] DAMAGECOUNT value on done: 10723.0 [2024-08-05 22:37:23,768][52671] Sum rewards: 11.319, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.968', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.048', 'AMMO3': '0.057', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.418', 'WEAPON3': '0.450', 'HITCOUNT': '0.730', 'weapon2': '0.956', 'weapon3': '1.004', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:24,068][52664] DAMAGECOUNT value on done: 9146.0 [2024-08-05 22:37:24,070][52664] Sum rewards: 9.519, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.741', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.018', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.294', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '1.208', 'weapon3': '2.010', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:24,610][52649] DAMAGECOUNT value on done: 11329.0 [2024-08-05 22:37:24,611][52649] Sum rewards: 9.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.178', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'HITCOUNT': '0.980', 'WEAPON3': '1.000', 'weapon2': '1.200', 'ARMOR': '1.323', 'weapon3': '2.496', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:24,623][52794] DAMAGECOUNT value on done: 12845.0 [2024-08-05 22:37:24,623][52794] Sum rewards: 8.822, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.058', 'weapon4': '0.278', 'WEAPON3': '0.450', 'HITCOUNT': '0.560', 'ARMOR': '0.895', 'weapon3': '0.980', 'weapon2': '1.292', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:25,106][52666] DAMAGECOUNT value on done: 9554.0 [2024-08-05 22:37:25,107][52666] Sum rewards: 15.239, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.768', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'weapon4': '0.270', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.248', 'ARMOR': '1.288', 'weapon3': '1.418', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:25,358][52662] DAMAGECOUNT value on done: 11083.0 [2024-08-05 22:37:25,361][52662] Sum rewards: 7.376, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.408', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'ARMOR': '0.914', 'weapon2': '1.300', 'weapon3': '1.928', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:26,019][52658] DAMAGECOUNT value on done: 9806.0 [2024-08-05 22:37:26,032][52658] Sum rewards: 6.109, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.013', 'AMMO3': '0.050', 'AMMO4': '0.065', 'HEALTH': '0.220', 'WEAPON3': '0.300', 'HITCOUNT': '0.440', 'ARMOR': '0.500', 'weapon3': '0.980', 'DAMAGECOUNT': '1.431', 'weapon2': '1.610', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:26,924][52659] DAMAGECOUNT value on done: 10928.0 [2024-08-05 22:37:26,925][52659] Sum rewards: 5.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.550', 'AMMO5': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.372', 'HITCOUNT': '0.760', 'ARMOR': '0.832', 'WEAPON3': '1.050', 'weapon2': '1.136', 'weapon3': '2.182', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:27,068][52820] DAMAGECOUNT value on done: 10025.0 [2024-08-05 22:37:27,069][52820] Sum rewards: 6.794, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.658', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'weapon4': '0.236', 'ARMOR': '0.458', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.446', 'weapon3': '1.778', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:27,215][52650] Updated weights for policy 0, policy_version 8941 (0.0034) [2024-08-05 22:37:27,387][52670] DAMAGECOUNT value on done: 8791.0 [2024-08-05 22:37:27,388][52670] Sum rewards: 8.357, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.936', 'AMMO2': '0.020', 'weapon7': '0.074', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'ARMOR': '0.120', 'AMMO3': '0.131', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.670', 'weapon4': '0.706', 'weapon2': '0.710', 'WEAPON3': '0.850', 'weapon3': '1.880', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:27,446][52671] DAMAGECOUNT value on done: 12003.0 [2024-08-05 22:37:27,446][52671] Sum rewards: 15.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.655', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'weapon4': '0.694', 'weapon2': '0.842', 'HITCOUNT': '0.960', 'weapon3': '1.626', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '13.000'} [2024-08-05 22:37:27,545][52664] DAMAGECOUNT value on done: 10603.0 [2024-08-05 22:37:27,545][52664] Sum rewards: 7.894, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.569', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon3': '1.490', 'weapon2': '1.572', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:27,794][52567] Fps is (10 sec: 14745.7, 60 sec: 13926.6, 300 sec: 15717.5). Total num frames: 73244672. Throughput: 0: 3637.8. Samples: 18319230. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:37:27,794][52567] Avg episode reward: [(0, '9.479')] [2024-08-05 22:37:27,810][52794] DAMAGECOUNT value on done: 11445.0 [2024-08-05 22:37:27,813][52794] Sum rewards: 6.325, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.110', 'AMMO2': '0.036', 'AMMO3': '0.079', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon4': '0.574', 'weapon2': '0.886', 'weapon3': '1.490', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:27,876][52649] DAMAGECOUNT value on done: 9863.0 [2024-08-05 22:37:27,876][52649] Sum rewards: 10.980, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.319', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.478', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.168', 'weapon3': '1.264', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:28,265][52666] DAMAGECOUNT value on done: 10285.0 [2024-08-05 22:37:28,266][52666] Sum rewards: 6.070, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.198', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'ARMOR': '0.474', 'HITCOUNT': '0.500', 'WEAPON3': '0.500', 'weapon2': '1.004', 'weapon3': '1.298', 'DAMAGECOUNT': '1.668', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:28,621][52658] DAMAGECOUNT value on done: 9724.0 [2024-08-05 22:37:28,621][52658] Sum rewards: 15.383, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.038', 'AMMO2': '0.013', 'AMMO3': '0.061', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '0.960', 'weapon3': '1.420', 'weapon2': '1.534', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:28,811][52662] DAMAGECOUNT value on done: 12945.0 [2024-08-05 22:37:28,815][52662] Sum rewards: 6.931, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.120', 'AMMO4': '-0.094', 'AMMO2': '-0.019', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'WEAPON3': '1.050', 'HITCOUNT': '1.120', 'weapon2': '1.480', 'weapon3': '1.854', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:30,196][52670] DAMAGECOUNT value on done: 9831.0 [2024-08-05 22:37:30,198][52670] Sum rewards: 14.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.452', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.056', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'ARMOR': '0.476', 'WEAPON3': '1.050', 'weapon2': '1.144', 'HITCOUNT': '1.250', 'weapon3': '2.524', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '16.000'} [2024-08-05 22:37:30,672][52794] DAMAGECOUNT value on done: 12382.0 [2024-08-05 22:37:30,673][52794] Sum rewards: 13.891, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.450', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.378', 'ARMOR': '0.572', 'WEAPON3': '0.850', 'weapon2': '0.864', 'HITCOUNT': '1.040', 'weapon3': '2.014', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:30,725][52659] DAMAGECOUNT value on done: 11020.0 [2024-08-05 22:37:30,729][52659] Sum rewards: 8.221, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.489', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.276', 'ARMOR': '0.495', 'WEAPON3': '0.900', 'HITCOUNT': '1.030', 'weapon2': '1.120', 'weapon3': '1.982', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:30,795][52820] DAMAGECOUNT value on done: 8492.0 [2024-08-05 22:37:30,797][52820] Sum rewards: 9.773, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.070', 'ARMOR': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'WEAPON3': '0.400', 'HEALTH': '0.412', 'HITCOUNT': '0.700', 'weapon4': '0.800', 'weapon2': '0.964', 'weapon3': '1.512', 'DAMAGECOUNT': '2.364', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:30,973][52664] DAMAGECOUNT value on done: 8303.0 [2024-08-05 22:37:30,974][52664] Sum rewards: 5.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.516', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.498', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'ARMOR': '0.943', 'weapon2': '1.144', 'weapon3': '1.670', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:31,209][52671] DAMAGECOUNT value on done: 9352.0 [2024-08-05 22:37:31,220][52671] Sum rewards: 7.580, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.020', 'AMMO3': '0.100', 'HEALTH': '0.101', 'AMMO4': '0.101', 'weapon4': '0.172', 'WEAPON4': '0.200', 'ARMOR': '0.518', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '1.308', 'weapon3': '1.580', 'DAMAGECOUNT': '2.010', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:31,323][52662] DAMAGECOUNT value on done: 11158.0 [2024-08-05 22:37:31,323][52662] Sum rewards: 6.068, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'HEALTH': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.061', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon5': '0.496', 'HITCOUNT': '0.570', 'weapon3': '1.200', 'weapon2': '1.220', 'DAMAGECOUNT': '1.902', 'FRAGCOUNT': '3.000'} [2024-08-05 22:37:31,455][52658] DAMAGECOUNT value on done: 10719.0 [2024-08-05 22:37:31,456][52658] Sum rewards: 10.325, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.316', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.290', 'weapon5': '0.314', 'ARMOR': '0.465', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon2': '1.106', 'weapon3': '1.466', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:31,662][52666] DAMAGECOUNT value on done: 9652.0 [2024-08-05 22:37:31,669][52666] Sum rewards: 10.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.080', 'weapon4': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.128', 'WEAPON5': '0.300', 'HITCOUNT': '0.650', 'weapon2': '0.672', 'WEAPON3': '0.800', 'weapon5': '0.842', 'ARMOR': '0.875', 'weapon3': '1.558', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:31,995][52649] DAMAGECOUNT value on done: 10801.0 [2024-08-05 22:37:31,997][52649] Sum rewards: 7.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.969', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'AMMO3': '0.125', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'ARMOR': '1.304', 'weapon2': '1.548', 'weapon3': '2.244', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:32,794][52567] Fps is (10 sec: 14745.6, 60 sec: 13926.4, 300 sec: 15662.0). Total num frames: 73318400. Throughput: 0: 3648.2. Samples: 18330270. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:37:32,794][52567] Avg episode reward: [(0, '9.190')] [2024-08-05 22:37:33,118][52650] Updated weights for policy 0, policy_version 8951 (0.0034) [2024-08-05 22:37:33,381][52794] DAMAGECOUNT value on done: 11834.0 [2024-08-05 22:37:33,383][52794] Sum rewards: 6.288, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.814', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'ARMOR': '0.824', 'weapon2': '1.272', 'weapon3': '1.568', 'DAMAGECOUNT': '2.169', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:33,657][52670] DAMAGECOUNT value on done: 8483.0 [2024-08-05 22:37:33,658][52670] Sum rewards: 7.736, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.106', 'HEALTH': '0.338', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon2': '1.180', 'weapon3': '1.530', 'ARMOR': '1.765', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:33,986][52662] DAMAGECOUNT value on done: 12169.0 [2024-08-05 22:37:33,987][52662] Sum rewards: 15.206, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.108', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'weapon5': '0.016', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.318', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.274', 'weapon3': '1.680', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '13.000'} [2024-08-05 22:37:34,583][52659] DAMAGECOUNT value on done: 10439.0 [2024-08-05 22:37:34,587][52659] Sum rewards: 14.136, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.500', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.226', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '1.080', 'weapon2': '1.398', 'weapon3': '1.438', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:34,792][52820] DAMAGECOUNT value on done: 8822.0 [2024-08-05 22:37:34,794][52820] Sum rewards: 8.284, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.440', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'weapon4': '0.008', 'AMMO3': '0.056', 'WEAPON4': '0.100', 'ARMOR': '0.438', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon3': '1.042', 'weapon2': '1.164', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:35,053][52671] DAMAGECOUNT value on done: 9884.0 [2024-08-05 22:37:35,054][52671] Sum rewards: 5.053, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.094', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'weapon4': '0.166', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon3': '1.318', 'weapon2': '1.732', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:35,204][52664] DAMAGECOUNT value on done: 9384.0 [2024-08-05 22:37:35,208][52664] Sum rewards: 4.468, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.224', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'ARMOR': '0.928', 'weapon2': '0.928', 'weapon3': '1.452', 'DAMAGECOUNT': '1.758', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:35,308][52666] DAMAGECOUNT value on done: 8989.0 [2024-08-05 22:37:35,313][52666] Sum rewards: 7.363, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.256', 'AMMO2': '0.016', 'weapon7': '0.076', 'AMMO3': '0.077', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.531', 'HITCOUNT': '0.550', 'weapon2': '0.828', 'weapon3': '1.500', 'DAMAGECOUNT': '1.860', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:37,162][52662] DAMAGECOUNT value on done: 12184.0 [2024-08-05 22:37:37,178][52662] Sum rewards: 12.661, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.027', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.135', 'weapon4': '0.280', 'ARMOR': '0.472', 'HEALTH': '0.542', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.180', 'weapon3': '2.034', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:37,479][52670] DAMAGECOUNT value on done: 10434.0 [2024-08-05 22:37:37,481][52670] Sum rewards: 8.708, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.139', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.230', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'ARMOR': '1.255', 'weapon3': '1.634', 'weapon2': '1.738', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:37,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14409.8, 300 sec: 15606.5). Total num frames: 73392128. Throughput: 0: 3643.6. Samples: 18351900. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 22:37:37,794][52567] Avg episode reward: [(0, '9.218')] [2024-08-05 22:37:38,166][52664] DAMAGECOUNT value on done: 9622.0 [2024-08-05 22:37:38,188][52664] Sum rewards: 6.213, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.020', 'AMMO2': '0.041', 'AMMO3': '0.077', 'WEAPON4': '0.200', 'AMMO4': '0.206', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon4': '0.846', 'weapon2': '1.094', 'weapon3': '1.492', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:38,511][52820] DAMAGECOUNT value on done: 10553.0 [2024-08-05 22:37:38,515][52820] Sum rewards: 20.266, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON3': '0.750', 'ARMOR': '0.824', 'weapon2': '1.356', 'HITCOUNT': '1.440', 'weapon3': '1.986', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '16.000'} [2024-08-05 22:37:38,582][52659] DAMAGECOUNT value on done: 10016.0 [2024-08-05 22:37:38,582][52659] Sum rewards: 11.604, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'HEALTH': '0.184', 'weapon4': '0.228', 'WEAPON3': '0.350', 'weapon5': '0.352', 'ARMOR': '0.532', 'HITCOUNT': '0.830', 'weapon2': '0.932', 'weapon3': '1.170', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:38,866][52650] Updated weights for policy 0, policy_version 8961 (0.0016) [2024-08-05 22:37:38,965][52671] DAMAGECOUNT value on done: 10127.0 [2024-08-05 22:37:38,967][52671] Sum rewards: 6.777, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.017', 'AMMO4': '-0.073', 'AMMO2': '-0.014', 'AMMO3': '0.105', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon2': '1.230', 'weapon3': '1.664', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:39,243][52668] DAMAGECOUNT value on done: 10118.0 [2024-08-05 22:37:39,244][52668] Sum rewards: 17.951, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.130', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'WEAPON3': '0.900', 'HITCOUNT': '1.230', 'ARMOR': '1.247', 'weapon2': '1.672', 'weapon3': '1.910', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '15.000'} [2024-08-05 22:37:39,261][52666] DAMAGECOUNT value on done: 10079.0 [2024-08-05 22:37:39,263][52666] Sum rewards: 12.309, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.620', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.072', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'weapon4': '0.506', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon2': '1.376', 'weapon3': '1.618', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:39,844][52662] DAMAGECOUNT value on done: 11002.0 [2024-08-05 22:37:39,844][52662] Sum rewards: 13.030, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.402', 'AMMO2': '0.015', 'weapon7': '0.058', 'AMMO3': '0.062', 'AMMO4': '0.075', 'ARMOR': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.716', 'weapon2': '0.806', 'HITCOUNT': '1.050', 'weapon3': '1.316', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:41,507][52670] DAMAGECOUNT value on done: 8799.0 [2024-08-05 22:37:41,507][52670] Sum rewards: 4.461, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.954', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.244', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.464', 'weapon3': '1.088', 'DAMAGECOUNT': '1.284', 'weapon2': '1.330', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:41,818][52659] DAMAGECOUNT value on done: 11314.0 [2024-08-05 22:37:41,820][52659] Sum rewards: 14.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.942', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON3': '1.000', 'HITCOUNT': '1.200', 'ARMOR': '1.336', 'weapon2': '1.888', 'weapon3': '1.988', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '13.000'} [2024-08-05 22:37:42,019][52671] DAMAGECOUNT value on done: 9585.0 [2024-08-05 22:37:42,021][52671] Sum rewards: 14.997, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.136', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'weapon5': '0.104', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'ARMOR': '0.428', 'WEAPON3': '0.750', 'HITCOUNT': '1.120', 'weapon2': '1.272', 'weapon3': '1.790', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '13.000'} [2024-08-05 22:37:42,387][52820] DAMAGECOUNT value on done: 9398.0 [2024-08-05 22:37:42,391][52820] Sum rewards: 5.048, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.230', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon3': '1.524', 'ARMOR': '1.600', 'weapon2': '1.610', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:42,794][52567] Fps is (10 sec: 13926.0, 60 sec: 14609.0, 300 sec: 15550.9). Total num frames: 73457664. Throughput: 0: 3642.2. Samples: 18373650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:37:42,795][52567] Avg episode reward: [(0, '9.692')] [2024-08-05 22:37:42,979][52668] DAMAGECOUNT value on done: 11967.0 [2024-08-05 22:37:42,979][52668] Sum rewards: 17.191, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.900', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.238', 'ARMOR': '0.486', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon2': '1.480', 'weapon3': '1.504', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '13.000'} [2024-08-05 22:37:43,000][52664] DAMAGECOUNT value on done: 9677.0 [2024-08-05 22:37:43,003][52664] Sum rewards: 12.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.211', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.018', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.156', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.891', 'HITCOUNT': '0.970', 'weapon2': '1.342', 'weapon3': '2.166', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:43,028][52666] DAMAGECOUNT value on done: 9499.0 [2024-08-05 22:37:43,028][52666] Sum rewards: 6.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.870', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.294', 'HITCOUNT': '0.730', 'WEAPON3': '0.850', 'ARMOR': '0.939', 'weapon2': '0.946', 'weapon3': '1.582', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '6.000'} [2024-08-05 22:37:44,898][52650] Updated weights for policy 0, policy_version 8971 (0.0019) [2024-08-05 22:37:45,388][52659] DAMAGECOUNT value on done: 10687.0 [2024-08-05 22:37:45,389][52659] Sum rewards: 10.336, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.119', 'ARMOR': '0.405', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon3': '1.558', 'weapon2': '1.674', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:45,534][52670] DAMAGECOUNT value on done: 9169.0 [2024-08-05 22:37:45,534][52670] Sum rewards: 11.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.464', 'AMMO2': '0.031', 'ARMOR': '0.104', 'AMMO3': '0.105', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.310', 'weapon3': '1.856', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:45,658][52671] DAMAGECOUNT value on done: 12046.0 [2024-08-05 22:37:45,662][52671] Sum rewards: 12.029, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.034', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.126', 'WEAPON3': '0.550', 'HITCOUNT': '0.830', 'ARMOR': '0.868', 'weapon3': '1.618', 'weapon2': '1.644', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:45,863][52668] DAMAGECOUNT value on done: 9070.0 [2024-08-05 22:37:45,864][52668] Sum rewards: 9.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.470', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'ARMOR': '0.485', 'WEAPON3': '1.000', 'weapon2': '1.088', 'HITCOUNT': '1.140', 'weapon3': '2.182', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:45,912][52660] DAMAGECOUNT value on done: 10413.0 [2024-08-05 22:37:45,913][52660] Sum rewards: 6.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.422', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.060', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'ARMOR': '0.460', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.010', 'weapon3': '1.952', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:46,733][52664] DAMAGECOUNT value on done: 11093.0 [2024-08-05 22:37:46,747][52664] Sum rewards: 14.328, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.420', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.308', 'ARMOR': '0.919', 'WEAPON3': '1.100', 'weapon2': '1.130', 'HITCOUNT': '1.270', 'weapon3': '2.178', 'DAMAGECOUNT': '4.416', 'FRAGCOUNT': '15.000'} [2024-08-05 22:37:46,883][52666] DAMAGECOUNT value on done: 10046.0 [2024-08-05 22:37:46,884][52666] Sum rewards: 6.638, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.402', 'HITCOUNT': '0.770', 'ARMOR': '0.899', 'WEAPON3': '0.900', 'weapon2': '1.234', 'weapon3': '1.926', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:46,964][52614] Signal inference workers to stop experience collection... (1650 times) [2024-08-05 22:37:46,965][52614] Signal inference workers to resume experience collection... (1650 times) [2024-08-05 22:37:46,995][52650] InferenceWorker_p0-w0: stopping experience collection (1650 times) [2024-08-05 22:37:46,996][52650] InferenceWorker_p0-w0: resuming experience collection (1650 times) [2024-08-05 22:37:47,794][52567] Fps is (10 sec: 13926.5, 60 sec: 14472.5, 300 sec: 15523.1). Total num frames: 73531392. Throughput: 0: 3620.9. Samples: 18383590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:37:47,794][52567] Avg episode reward: [(0, '9.720')] [2024-08-05 22:37:48,263][52659] DAMAGECOUNT value on done: 11424.0 [2024-08-05 22:37:48,263][52659] Sum rewards: 11.918, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.028', 'AMMO3': '0.087', 'HEALTH': '0.098', 'ARMOR': '0.108', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.326', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '0.704', 'weapon3': '1.700', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:48,448][52671] DAMAGECOUNT value on done: 9800.0 [2024-08-05 22:37:48,448][52671] Sum rewards: 7.559, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.868', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.178', 'WEAPON4': '0.300', 'ARMOR': '0.490', 'weapon4': '0.524', 'HITCOUNT': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.166', 'weapon3': '1.402', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:48,948][52670] DAMAGECOUNT value on done: 9432.0 [2024-08-05 22:37:48,951][52670] Sum rewards: 11.809, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.230', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.140', 'WEAPON3': '0.550', 'ARMOR': '0.834', 'HITCOUNT': '0.980', 'weapon2': '1.548', 'weapon3': '1.570', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:49,068][52668] DAMAGECOUNT value on done: 8998.0 [2024-08-05 22:37:49,070][52668] Sum rewards: 8.360, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.200', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon4': '0.340', 'ARMOR': '0.488', 'HITCOUNT': '0.610', 'WEAPON3': '0.850', 'weapon2': '0.952', 'weapon3': '1.478', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '9.000'} [2024-08-05 22:37:49,214][52660] DAMAGECOUNT value on done: 12409.0 [2024-08-05 22:37:49,219][52660] Sum rewards: 15.409, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.114', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.310', 'ARMOR': '0.568', 'WEAPON3': '0.750', 'weapon2': '1.074', 'HITCOUNT': '1.200', 'weapon3': '2.126', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '12.000'} [2024-08-05 22:37:49,641][52650] Updated weights for policy 0, policy_version 8981 (0.0024) [2024-08-05 22:37:50,155][52666] DAMAGECOUNT value on done: 9633.0 [2024-08-05 22:37:50,156][52666] Sum rewards: 11.985, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.314', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.312', 'WEAPON3': '0.550', 'HITCOUNT': '0.890', 'weapon2': '1.202', 'ARMOR': '1.310', 'weapon3': '1.488', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:51,251][52659] DAMAGECOUNT value on done: 10241.0 [2024-08-05 22:37:51,255][52659] Sum rewards: 15.626, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.087', 'HEALTH': '0.331', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '1.020', 'weapon3': '1.444', 'weapon2': '1.756', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:51,417][52670] DAMAGECOUNT value on done: 8878.0 [2024-08-05 22:37:51,420][52670] Sum rewards: 6.831, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.231', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.128', 'weapon4': '0.452', 'WEAPON3': '0.700', 'HITCOUNT': '0.770', 'ARMOR': '0.978', 'weapon2': '1.202', 'weapon3': '1.522', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '4.500'} [2024-08-05 22:37:51,482][52671] DAMAGECOUNT value on done: 11124.0 [2024-08-05 22:37:51,485][52671] Sum rewards: 19.055, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'HEALTH': '0.368', 'ARMOR': '0.491', 'weapon4': '0.508', 'WEAPON3': '0.600', 'weapon2': '1.026', 'HITCOUNT': '1.120', 'weapon3': '2.110', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '14.000'} [2024-08-05 22:37:51,853][52668] DAMAGECOUNT value on done: 9840.0 [2024-08-05 22:37:51,856][52668] Sum rewards: 2.219, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.694', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'ARMOR': '0.060', 'AMMO3': '0.097', 'weapon5': '0.192', 'weapon4': '0.282', 'HITCOUNT': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.174', 'weapon3': '1.478', 'DAMAGECOUNT': '1.641', 'FRAGCOUNT': '2.000'} [2024-08-05 22:37:51,969][52660] DAMAGECOUNT value on done: 9066.0 [2024-08-05 22:37:51,969][52660] Sum rewards: 9.771, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.191', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'weapon7': '0.078', 'weapon4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '1.282', 'ARMOR': '1.326', 'weapon2': '1.434', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:52,794][52567] Fps is (10 sec: 16384.5, 60 sec: 14745.6, 300 sec: 15523.1). Total num frames: 73621504. Throughput: 0: 3680.5. Samples: 18408260. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:37:52,794][52567] Avg episode reward: [(0, '10.044')] [2024-08-05 22:37:53,069][52666] DAMAGECOUNT value on done: 8571.0 [2024-08-05 22:37:53,069][52666] Sum rewards: 9.321, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.926', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.053', 'AMMO4': '0.072', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.551', 'HITCOUNT': '0.570', 'weapon4': '0.632', 'weapon2': '0.806', 'weapon3': '1.092', 'DAMAGECOUNT': '2.151', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:54,075][52659] DAMAGECOUNT value on done: 9470.0 [2024-08-05 22:37:54,076][52659] Sum rewards: 7.503, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.571', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.040', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.490', 'weapon3': '0.950', 'weapon2': '1.364', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:55,001][52668] DAMAGECOUNT value on done: 9808.0 [2024-08-05 22:37:55,004][52668] Sum rewards: 9.288, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.040', 'AMMO4': '-0.094', 'AMMO2': '-0.019', 'AMMO3': '0.062', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'ARMOR': '0.926', 'weapon3': '1.288', 'weapon2': '1.622', 'DAMAGECOUNT': '2.673', 'FRAGCOUNT': '7.000'} [2024-08-05 22:37:55,109][52660] DAMAGECOUNT value on done: 10032.0 [2024-08-05 22:37:55,110][52660] Sum rewards: 13.968, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.601', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.366', 'ARMOR': '0.505', 'WEAPON3': '0.750', 'HITCOUNT': '1.240', 'weapon2': '1.510', 'weapon3': '1.868', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:55,193][52650] Updated weights for policy 0, policy_version 8991 (0.0038) [2024-08-05 22:37:55,204][52670] DAMAGECOUNT value on done: 10173.0 [2024-08-05 22:37:55,206][52670] Sum rewards: 11.621, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.238', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.508', 'HITCOUNT': '0.610', 'weapon2': '0.792', 'weapon4': '0.874', 'weapon3': '1.206', 'DAMAGECOUNT': '1.908', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:56,607][52666] DAMAGECOUNT value on done: 8633.0 [2024-08-05 22:37:56,608][52666] Sum rewards: 8.824, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.421', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'weapon4': '0.458', 'ARMOR': '0.526', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '0.964', 'weapon3': '1.506', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '8.000'} [2024-08-05 22:37:57,167][52659] DAMAGECOUNT value on done: 8350.0 [2024-08-05 22:37:57,167][52659] Sum rewards: 12.292, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.849', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.196', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon2': '1.492', 'weapon3': '1.814', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '10.000'} [2024-08-05 22:37:57,787][52668] DAMAGECOUNT value on done: 11376.0 [2024-08-05 22:37:57,789][52668] Sum rewards: 6.744, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'HEALTH': '0.057', 'AMMO3': '0.094', 'AMMO4': '0.126', 'weapon5': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.208', 'ARMOR': '0.432', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.166', 'weapon3': '1.954', 'DAMAGECOUNT': '2.121', 'FRAGCOUNT': '5.000'} [2024-08-05 22:37:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 14745.6, 300 sec: 15523.1). Total num frames: 73695232. Throughput: 0: 3738.2. Samples: 18432710. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-05 22:37:57,794][52567] Avg episode reward: [(0, '10.039')] [2024-08-05 22:37:57,824][52660] DAMAGECOUNT value on done: 8343.0 [2024-08-05 22:37:57,827][52660] Sum rewards: 3.045, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.026', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.280', 'weapon4': '0.456', 'HITCOUNT': '0.590', 'WEAPON3': '0.850', 'weapon2': '1.178', 'ARMOR': '1.308', 'weapon3': '1.408', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 22:37:58,780][52670] DAMAGECOUNT value on done: 11163.0 [2024-08-05 22:37:58,782][52670] Sum rewards: 12.083, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.648', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.238', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'weapon2': '0.926', 'HITCOUNT': '1.080', 'weapon3': '2.350', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '11.000'} [2024-08-05 22:37:59,420][52650] Updated weights for policy 0, policy_version 9001 (0.0035) [2024-08-05 22:38:00,084][52666] DAMAGECOUNT value on done: 9573.0 [2024-08-05 22:38:00,092][52666] Sum rewards: 4.938, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.432', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.072', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'weapon2': '0.712', 'weapon3': '0.948', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 22:38:00,470][52659] DAMAGECOUNT value on done: 9976.0 [2024-08-05 22:38:00,471][52659] Sum rewards: 9.915, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'ARMOR': '0.904', 'WEAPON3': '1.050', 'HITCOUNT': '1.090', 'weapon2': '1.530', 'weapon3': '2.122', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '10.000'} [2024-08-05 22:38:00,893][52668] DAMAGECOUNT value on done: 10401.0 [2024-08-05 22:38:00,894][52668] Sum rewards: 20.421, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.480', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'weapon4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.129', 'ARMOR': '0.916', 'WEAPON3': '0.950', 'weapon2': '1.112', 'HITCOUNT': '1.310', 'weapon3': '2.484', 'DAMAGECOUNT': '5.220', 'FRAGCOUNT': '18.000'} [2024-08-05 22:38:00,929][52660] DAMAGECOUNT value on done: 11542.0 [2024-08-05 22:38:00,930][52660] Sum rewards: 5.713, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.508', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.226', 'ARMOR': '0.478', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '0.942', 'weapon3': '1.246', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '5.000'} [2024-08-05 22:38:02,038][52670] DAMAGECOUNT value on done: 11305.0 [2024-08-05 22:38:02,039][52670] Sum rewards: 11.394, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.920', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.010', 'weapon7': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.190', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.306', 'ARMOR': '1.638', 'weapon3': '1.854', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 15155.3, 300 sec: 15523.1). Total num frames: 73785344. Throughput: 0: 3780.2. Samples: 18445500. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 22:38:02,794][52567] Avg episode reward: [(0, '9.957')] [2024-08-05 22:38:03,144][52666] DAMAGECOUNT value on done: 9737.0 [2024-08-05 22:38:03,144][52666] Sum rewards: 11.907, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.166', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.256', 'weapon4': '0.280', 'WEAPON5': '0.300', 'ARMOR': '0.490', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '0.956', 'weapon3': '1.810', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '10.000'} [2024-08-05 22:38:03,778][52668] DAMAGECOUNT value on done: 10315.0 [2024-08-05 22:38:03,779][52668] Sum rewards: 3.819, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'HEALTH': '0.036', 'AMMO3': '0.068', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.438', 'ARMOR': '0.456', 'HITCOUNT': '0.550', 'weapon3': '1.010', 'weapon2': '1.382', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '2.000'} [2024-08-05 22:38:03,792][52660] DAMAGECOUNT value on done: 10244.0 [2024-08-05 22:38:03,792][52660] Sum rewards: 14.748, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.030', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.010', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'weapon2': '0.932', 'weapon3': '1.998', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '14.000'} [2024-08-05 22:38:04,787][52670] DAMAGECOUNT value on done: 10647.0 [2024-08-05 22:38:04,789][52670] Sum rewards: 8.521, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.094', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.036', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.152', 'ARMOR': '0.412', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '1.210', 'weapon3': '1.800', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '7.000'} [2024-08-05 22:38:04,837][52650] Updated weights for policy 0, policy_version 9011 (0.0012) [2024-08-05 22:38:06,039][52666] DAMAGECOUNT value on done: 9426.0 [2024-08-05 22:38:06,041][52666] Sum rewards: 9.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon4': '0.254', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'ARMOR': '1.249', 'weapon2': '1.326', 'weapon3': '1.832', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:06,555][52668] DAMAGECOUNT value on done: 11540.0 [2024-08-05 22:38:06,556][52668] Sum rewards: 10.118, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.822', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'ARMOR': '0.940', 'weapon2': '1.604', 'weapon3': '1.946', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:06,694][52660] DAMAGECOUNT value on done: 10707.0 [2024-08-05 22:38:06,694][52660] Sum rewards: 15.530, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.168', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.106', 'ARMOR': '0.446', 'WEAPON3': '0.650', 'HITCOUNT': '1.260', 'weapon2': '1.382', 'weapon3': '1.890', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '13.000'} [2024-08-05 22:38:07,794][52567] Fps is (10 sec: 16383.5, 60 sec: 15155.2, 300 sec: 15467.6). Total num frames: 73859072. Throughput: 0: 3855.5. Samples: 18470960. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-05 22:38:07,795][52567] Avg episode reward: [(0, '10.001')] [2024-08-05 22:38:07,939][52670] DAMAGECOUNT value on done: 10598.0 [2024-08-05 22:38:07,942][52670] Sum rewards: 11.417, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.872', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.108', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'weapon4': '0.308', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.120', 'HITCOUNT': '1.180', 'weapon3': '2.180', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '10.000'} [2024-08-05 22:38:09,133][52650] Updated weights for policy 0, policy_version 9021 (0.0014) [2024-08-05 22:38:09,313][52666] DAMAGECOUNT value on done: 10394.0 [2024-08-05 22:38:09,315][52666] Sum rewards: 11.443, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.024', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.031', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon4': '0.236', 'WEAPON3': '0.750', 'HITCOUNT': '1.020', 'weapon2': '1.254', 'weapon3': '2.268', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:09,774][52668] DAMAGECOUNT value on done: 9009.0 [2024-08-05 22:38:09,775][52668] Sum rewards: 7.391, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.647', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.324', 'ARMOR': '0.440', 'HITCOUNT': '0.640', 'WEAPON3': '0.650', 'weapon2': '1.124', 'weapon3': '1.204', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '7.000'} [2024-08-05 22:38:09,847][52660] DAMAGECOUNT value on done: 10377.0 [2024-08-05 22:38:09,848][52660] Sum rewards: 8.109, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.526', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon7': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'weapon4': '0.270', 'ARMOR': '0.432', 'HITCOUNT': '0.630', 'WEAPON3': '0.700', 'weapon2': '1.082', 'weapon3': '1.436', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:11,585][52670] DAMAGECOUNT value on done: 9366.0 [2024-08-05 22:38:11,585][52670] Sum rewards: 9.026, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.289', 'AMMO2': '0.013', 'ARMOR': '0.032', 'weapon7': '0.060', 'AMMO4': '0.065', 'AMMO3': '0.071', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.290', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon2': '1.206', 'weapon3': '1.476', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '6.000'} [2024-08-05 22:38:12,552][52668] DAMAGECOUNT value on done: 10123.0 [2024-08-05 22:38:12,553][52668] Sum rewards: 5.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.762', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'ARMOR': '0.020', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.120', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'weapon2': '1.450', 'weapon3': '1.878', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '6.000'} [2024-08-05 22:38:12,584][52660] DAMAGECOUNT value on done: 10928.0 [2024-08-05 22:38:12,587][52660] Sum rewards: 15.278, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.142', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'WEAPON3': '0.750', 'ARMOR': '0.832', 'weapon2': '1.170', 'HITCOUNT': '1.220', 'weapon3': '2.066', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '13.000'} [2024-08-05 22:38:12,794][52567] Fps is (10 sec: 16383.9, 60 sec: 15291.7, 300 sec: 15523.1). Total num frames: 73949184. Throughput: 0: 3928.4. Samples: 18496010. Policy #0 lag: (min: 0.0, avg: 4.9, max: 8.0) [2024-08-05 22:38:12,794][52567] Avg episode reward: [(0, '10.068')] [2024-08-05 22:38:12,986][52666] DAMAGECOUNT value on done: 8401.0 [2024-08-05 22:38:12,986][52666] Sum rewards: 8.067, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.240', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'ARMOR': '0.020', 'AMMO3': '0.062', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon2': '1.232', 'weapon3': '1.354', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '5.000'} [2024-08-05 22:38:14,432][52650] Updated weights for policy 0, policy_version 9031 (0.0013) [2024-08-05 22:38:14,884][52670] DAMAGECOUNT value on done: 9646.0 [2024-08-05 22:38:14,887][52670] Sum rewards: 18.742, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.687', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.422', 'WEAPON3': '0.850', 'ARMOR': '0.903', 'weapon2': '1.204', 'HITCOUNT': '1.250', 'weapon3': '2.082', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '16.000'} [2024-08-05 22:38:15,232][52668] DAMAGECOUNT value on done: 9850.0 [2024-08-05 22:38:15,232][52668] Sum rewards: 10.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.126', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.044', 'AMMO4': '0.141', 'AMMO3': '0.145', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '1.000', 'weapon2': '1.210', 'ARMOR': '1.304', 'weapon3': '2.206', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '11.000'} [2024-08-05 22:38:15,335][52660] DAMAGECOUNT value on done: 10064.0 [2024-08-05 22:38:15,335][52660] Sum rewards: 10.003, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.908', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon7': '0.056', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.388', 'ARMOR': '0.508', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.128', 'weapon3': '1.518', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '8.000'} [2024-08-05 22:38:16,320][52666] DAMAGECOUNT value on done: 9640.0 [2024-08-05 22:38:16,329][52666] Sum rewards: 12.951, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.470', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.078', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.338', 'weapon3': '1.504', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '10.000'} [2024-08-05 22:38:17,794][52567] Fps is (10 sec: 17203.7, 60 sec: 15564.8, 300 sec: 15495.4). Total num frames: 74031104. Throughput: 0: 3970.2. Samples: 18508930. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:38:17,794][52567] Avg episode reward: [(0, '10.163')] [2024-08-05 22:38:17,863][52614] Saving new best policy, reward=10.163! [2024-08-05 22:38:18,241][52670] DAMAGECOUNT value on done: 10618.0 [2024-08-05 22:38:18,244][52670] Sum rewards: 6.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.406', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.234', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.620', 'weapon2': '1.162', 'weapon3': '1.416', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '6.000'} [2024-08-05 22:38:18,329][52668] DAMAGECOUNT value on done: 10466.0 [2024-08-05 22:38:18,329][52668] Sum rewards: 8.459, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.830', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.068', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon3': '1.274', 'weapon2': '1.644', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '7.000'} [2024-08-05 22:38:18,413][52660] DAMAGECOUNT value on done: 10398.0 [2024-08-05 22:38:18,414][52660] Sum rewards: 15.080, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.745', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon4': '0.234', 'WEAPON3': '0.800', 'weapon2': '0.984', 'HITCOUNT': '1.310', 'weapon3': '2.010', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '13.000'} [2024-08-05 22:38:19,196][52650] Updated weights for policy 0, policy_version 9041 (0.0028) [2024-08-05 22:38:19,963][52666] DAMAGECOUNT value on done: 11452.0 [2024-08-05 22:38:19,964][52666] Sum rewards: 7.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.388', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon3': '1.600', 'ARMOR': '1.638', 'weapon2': '1.808', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '8.000'} [2024-08-05 22:38:21,422][52668] DAMAGECOUNT value on done: 9290.0 [2024-08-05 22:38:21,423][52668] Sum rewards: 10.112, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.353', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO3': '0.050', 'WEAPON3': '0.350', 'HITCOUNT': '0.830', 'ARMOR': '0.855', 'weapon3': '1.160', 'weapon2': '1.804', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '7.000'} [2024-08-05 22:38:21,491][52660] DAMAGECOUNT value on done: 10854.0 [2024-08-05 22:38:21,492][52660] Sum rewards: 14.349, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.743', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.024', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.132', 'WEAPON4': '0.150', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'weapon2': '1.134', 'HITCOUNT': '1.170', 'weapon3': '1.600', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '11.000'} [2024-08-05 22:38:21,865][52670] DAMAGECOUNT value on done: 10803.0 [2024-08-05 22:38:21,866][52670] Sum rewards: 11.664, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.166', 'WEAPON3': '0.750', 'ARMOR': '0.891', 'HITCOUNT': '1.050', 'weapon2': '1.660', 'weapon3': '1.834', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '10.000'} [2024-08-05 22:38:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 15837.9, 300 sec: 15523.1). Total num frames: 74121216. Throughput: 0: 4048.2. Samples: 18534070. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:38:22,794][52567] Avg episode reward: [(0, '10.320')] [2024-08-05 22:38:22,795][52614] Saving new best policy, reward=10.320! [2024-08-05 22:38:23,307][52666] DAMAGECOUNT value on done: 10209.0 [2024-08-05 22:38:23,310][52666] Sum rewards: 11.083, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.758', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.053', 'ARMOR': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.194', 'WEAPON3': '0.450', 'weapon5': '0.490', 'HITCOUNT': '0.600', 'weapon2': '0.994', 'weapon3': '1.120', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '8.000'} [2024-08-05 22:38:24,214][52650] Updated weights for policy 0, policy_version 9051 (0.0033) [2024-08-05 22:38:24,388][52668] DAMAGECOUNT value on done: 10012.0 [2024-08-05 22:38:24,389][52668] Sum rewards: 12.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.442', 'ARMOR': '0.452', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '0.984', 'weapon3': '2.286', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '11.000'} [2024-08-05 22:38:24,572][52660] DAMAGECOUNT value on done: 10204.0 [2024-08-05 22:38:24,573][52660] Sum rewards: 10.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.100', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.516', 'WEAPON3': '0.750', 'weapon2': '0.828', 'HITCOUNT': '0.830', 'ARMOR': '0.930', 'weapon3': '1.962', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:25,263][52670] DAMAGECOUNT value on done: 10396.0 [2024-08-05 22:38:25,264][52670] Sum rewards: 14.984, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.230', 'ARMOR': '0.445', 'WEAPON3': '0.700', 'HITCOUNT': '1.210', 'weapon2': '1.384', 'weapon3': '1.878', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '12.000'} [2024-08-05 22:38:27,545][52668] DAMAGECOUNT value on done: 10346.0 [2024-08-05 22:38:27,547][52668] Sum rewards: 11.171, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.408', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.094', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'ARMOR': '1.249', 'weapon3': '1.462', 'weapon2': '2.244', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '10.000'} [2024-08-05 22:38:27,624][52660] DAMAGECOUNT value on done: 10681.0 [2024-08-05 22:38:27,625][52660] Sum rewards: 11.638, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.095', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.214', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'ARMOR': '0.882', 'weapon3': '1.264', 'weapon2': '1.494', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '8.000'} [2024-08-05 22:38:27,795][52567] Fps is (10 sec: 17202.0, 60 sec: 15974.2, 300 sec: 15523.1). Total num frames: 74203136. Throughput: 0: 4122.0. Samples: 18559140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:38:27,795][52567] Avg episode reward: [(0, '10.414')] [2024-08-05 22:38:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009058_74203136.pth... [2024-08-05 22:38:27,928][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008610_70533120.pth [2024-08-05 22:38:27,935][52614] Saving new best policy, reward=10.414! [2024-08-05 22:38:28,875][52650] Updated weights for policy 0, policy_version 9061 (0.0013) [2024-08-05 22:38:30,771][52668] DAMAGECOUNT value on done: 10952.0 [2024-08-05 22:38:30,775][52668] Sum rewards: 13.853, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.264', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.260', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'weapon2': '0.886', 'ARMOR': '1.281', 'weapon3': '1.468', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '11.000'} [2024-08-05 22:38:30,879][52660] DAMAGECOUNT value on done: 11201.0 [2024-08-05 22:38:30,882][52660] Sum rewards: 5.406, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.414', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO4': '0.077', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.557', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'weapon4': '0.736', 'weapon2': '0.848', 'weapon3': '1.668', 'DAMAGECOUNT': '1.869', 'FRAGCOUNT': '4.000'} [2024-08-05 22:38:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16110.9, 300 sec: 15523.2). Total num frames: 74285056. Throughput: 0: 4172.2. Samples: 18571340. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-05 22:38:32,794][52567] Avg episode reward: [(0, '10.394')] [2024-08-05 22:38:33,853][52668] DAMAGECOUNT value on done: 10157.0 [2024-08-05 22:38:33,856][52668] Sum rewards: 7.793, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.290', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.077', 'weapon4': '0.114', 'AMMO3': '0.119', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'weapon2': '1.040', 'weapon3': '2.394', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '8.000'} [2024-08-05 22:38:34,009][52660] DAMAGECOUNT value on done: 11154.0 [2024-08-05 22:38:34,011][52660] Sum rewards: 8.549, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.692', 'AMMO2': '0.026', 'weapon4': '0.116', 'AMMO3': '0.121', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.937', 'weapon2': '1.368', 'weapon3': '2.204', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '8.000'} [2024-08-05 22:38:34,402][52650] Updated weights for policy 0, policy_version 9071 (0.0013) [2024-08-05 22:38:36,848][52668] DAMAGECOUNT value on done: 9708.0 [2024-08-05 22:38:36,848][52668] Sum rewards: 10.712, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.606', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'ARMOR': '1.200', 'weapon3': '1.384', 'weapon2': '1.746', 'DAMAGECOUNT': '3.453', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:36,937][52660] DAMAGECOUNT value on done: 10628.0 [2024-08-05 22:38:36,937][52660] Sum rewards: 8.009, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.328', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.810', 'WEAPON3': '0.950', 'weapon2': '1.426', 'weapon3': '2.144', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '10.000'} [2024-08-05 22:38:37,794][52567] Fps is (10 sec: 16385.1, 60 sec: 16247.5, 300 sec: 15495.4). Total num frames: 74366976. Throughput: 0: 4186.7. Samples: 18596660. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-05 22:38:37,795][52567] Avg episode reward: [(0, '10.368')] [2024-08-05 22:38:38,818][52650] Updated weights for policy 0, policy_version 9081 (0.0015) [2024-08-05 22:38:39,528][52660] DAMAGECOUNT value on done: 10897.0 [2024-08-05 22:38:39,529][52660] Sum rewards: 6.245, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.258', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon2': '1.288', 'weapon3': '1.338', 'ARMOR': '1.412', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'} [2024-08-05 22:38:42,536][52660] DAMAGECOUNT value on done: 10749.0 [2024-08-05 22:38:42,538][52660] Sum rewards: 9.392, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.705', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.444', 'WEAPON3': '0.550', 'ARMOR': '0.568', 'HITCOUNT': '0.910', 'weapon2': '0.930', 'weapon3': '1.520', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '6.000'} [2024-08-05 22:38:42,796][52567] Fps is (10 sec: 16380.6, 60 sec: 16520.0, 300 sec: 15495.3). Total num frames: 74448896. Throughput: 0: 4210.5. Samples: 18622190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:38:42,800][52567] Avg episode reward: [(0, '10.388')] [2024-08-05 22:38:43,664][52650] Updated weights for policy 0, policy_version 9091 (0.0013) [2024-08-05 22:38:47,614][52803] DAMAGECOUNT value on done: 10248.0 [2024-08-05 22:38:47,624][52803] Sum rewards: 9.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.048', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.112', 'AMMO3': '0.118', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.258', 'ARMOR': '1.283', 'weapon3': '2.070', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '9.000'} [2024-08-05 22:38:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 15495.4). Total num frames: 74539008. Throughput: 0: 4195.6. Samples: 18634300. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-05 22:38:47,794][52567] Avg episode reward: [(0, '10.384')] [2024-08-05 22:38:48,883][52650] Updated weights for policy 0, policy_version 9101 (0.0029) [2024-08-05 22:38:49,888][52670] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0)] [2024-08-05 22:38:50,560][52670] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)] [2024-08-05 22:38:50,866][52803] DAMAGECOUNT value on done: 11644.0 [2024-08-05 22:38:50,868][52803] Sum rewards: 13.418, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.829', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.055', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.236', 'HITCOUNT': '1.260', 'weapon3': '2.372', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '12.000'} [2024-08-05 22:38:52,794][52567] Fps is (10 sec: 17206.8, 60 sec: 16657.1, 300 sec: 15523.2). Total num frames: 74620928. Throughput: 0: 4183.6. Samples: 18659220. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-05 22:38:52,794][52567] Avg episode reward: [(0, '10.410')] [2024-08-05 22:38:53,841][52650] Updated weights for policy 0, policy_version 9111 (0.0026) [2024-08-05 22:38:54,075][52811] DAMAGECOUNT value on done: 10381.0 [2024-08-05 22:38:54,075][52811] Sum rewards: 7.417, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.534', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.158', 'WEAPON7': '0.200', 'ARMOR': '0.511', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon2': '1.472', 'weapon3': '2.080', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '6.000'} [2024-08-05 22:38:54,171][52803] DAMAGECOUNT value on done: 10115.0 [2024-08-05 22:38:54,173][52803] Sum rewards: 2.359, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.485', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon7': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon4': '0.190', 'WEAPON7': '0.200', 'ARMOR': '0.420', 'HITCOUNT': '0.570', 'WEAPON3': '0.800', 'weapon2': '1.266', 'weapon3': '1.504', 'DAMAGECOUNT': '1.755', 'FRAGCOUNT': '4.000'} [2024-08-05 22:38:56,185][52669] DAMAGECOUNT value on done: 10815.0 [2024-08-05 22:38:56,185][52669] Sum rewards: 5.172, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.492', 'AMMO2': '0.017', 'AMMO3': '0.066', 'AMMO4': '0.085', 'WEAPON4': '0.250', 'weapon4': '0.286', 'HITCOUNT': '0.400', 'ARMOR': '0.489', 'WEAPON3': '0.500', 'weapon2': '0.626', 'weapon3': '1.312', 'DAMAGECOUNT': '1.383', 'FRAGCOUNT': '4.000'} [2024-08-05 22:38:57,255][52811] DAMAGECOUNT value on done: 10581.0 [2024-08-05 22:38:57,258][52811] Sum rewards: 15.252, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.173', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'ARMOR': '0.995', 'weapon2': '1.502', 'weapon3': '1.990', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '14.000'} [2024-08-05 22:38:57,356][52803] DAMAGECOUNT value on done: 10592.0 [2024-08-05 22:38:57,358][52803] Sum rewards: 9.820, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.085', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'ARMOR': '0.599', 'HITCOUNT': '0.600', 'weapon4': '0.654', 'weapon2': '1.064', 'weapon3': '1.454', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '7.000'} [2024-08-05 22:38:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 15495.4). Total num frames: 74702848. Throughput: 0: 4187.3. Samples: 18684440. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:38:57,794][52567] Avg episode reward: [(0, '10.297')] [2024-08-05 22:38:58,587][52650] Updated weights for policy 0, policy_version 9121 (0.0022) [2024-08-05 22:38:59,067][52669] DAMAGECOUNT value on done: 10707.0 [2024-08-05 22:38:59,069][52669] Sum rewards: 13.375, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.528', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'AMMO3': '0.064', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.450', 'weapon5': '0.478', 'weapon4': '0.484', 'ARMOR': '0.517', 'HITCOUNT': '0.660', 'weapon2': '0.698', 'weapon3': '1.264', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:00,284][52647] DAMAGECOUNT value on done: 11941.0 [2024-08-05 22:39:00,286][52647] Sum rewards: 10.513, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.518', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.400', 'HITCOUNT': '0.870', 'ARMOR': '0.901', 'weapon3': '1.250', 'weapon2': '1.390', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:00,584][52803] DAMAGECOUNT value on done: 11307.0 [2024-08-05 22:39:00,586][52803] Sum rewards: 8.058, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.730', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.446', 'ARMOR': '0.506', 'WEAPON3': '0.750', 'weapon2': '0.984', 'HITCOUNT': '1.020', 'weapon3': '1.764', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:00,641][52811] DAMAGECOUNT value on done: 10524.0 [2024-08-05 22:39:00,642][52811] Sum rewards: 7.701, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.005', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.100', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'weapon2': '1.144', 'weapon3': '1.186', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:01,806][52669] DAMAGECOUNT value on done: 11452.0 [2024-08-05 22:39:01,810][52669] Sum rewards: 15.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.102', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO3': '0.116', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.460', 'ARMOR': '0.475', 'WEAPON3': '0.800', 'HITCOUNT': '0.980', 'weapon2': '1.178', 'weapon3': '1.922', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '13.000'} [2024-08-05 22:39:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 15523.1). Total num frames: 74792960. Throughput: 0: 4179.5. Samples: 18697010. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 22:39:02,795][52567] Avg episode reward: [(0, '10.473')] [2024-08-05 22:39:02,802][52614] Saving new best policy, reward=10.473! [2024-08-05 22:39:03,004][52647] DAMAGECOUNT value on done: 10328.0 [2024-08-05 22:39:03,004][52647] Sum rewards: 7.431, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.562', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.035', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.530', 'weapon3': '0.932', 'weapon2': '1.306', 'DAMAGECOUNT': '1.683', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:03,639][52650] Updated weights for policy 0, policy_version 9131 (0.0027) [2024-08-05 22:39:03,836][52803] DAMAGECOUNT value on done: 10370.0 [2024-08-05 22:39:03,840][52803] Sum rewards: 10.963, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.625', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon5': '0.146', 'weapon4': '0.208', 'ARMOR': '0.512', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.082', 'weapon3': '1.794', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:03,868][52811] DAMAGECOUNT value on done: 11440.0 [2024-08-05 22:39:03,869][52811] Sum rewards: 27.801, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'WEAPON3': '1.000', 'weapon2': '1.296', 'HITCOUNT': '1.720', 'weapon3': '2.198', 'DAMAGECOUNT': '6.942', 'FRAGCOUNT': '24.000'} [2024-08-05 22:39:05,591][52669] DAMAGECOUNT value on done: 12348.0 [2024-08-05 22:39:05,591][52669] Sum rewards: 7.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.780', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.073', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.504', 'ARMOR': '0.514', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon2': '1.282', 'weapon3': '1.398', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:05,998][52647] DAMAGECOUNT value on done: 12546.0 [2024-08-05 22:39:05,998][52647] Sum rewards: 11.315, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.390', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon4': '0.182', 'WEAPON3': '0.950', 'HITCOUNT': '1.180', 'ARMOR': '1.480', 'weapon2': '1.548', 'weapon3': '1.602', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:07,088][52811] DAMAGECOUNT value on done: 11473.0 [2024-08-05 22:39:07,090][52811] Sum rewards: 16.037, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.331', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.060', 'WEAPON3': '0.400', 'HITCOUNT': '0.830', 'weapon2': '0.896', 'ARMOR': '0.938', 'weapon3': '0.954', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:07,189][52803] DAMAGECOUNT value on done: 11966.0 [2024-08-05 22:39:07,189][52803] Sum rewards: 12.597, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.446', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.070', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.312', 'weapon3': '1.982', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 15495.4). Total num frames: 74874880. Throughput: 0: 4186.2. Samples: 18722450. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 22:39:07,794][52567] Avg episode reward: [(0, '10.570')] [2024-08-05 22:39:07,798][52614] Saving new best policy, reward=10.570! [2024-08-05 22:39:08,041][52650] Updated weights for policy 0, policy_version 9141 (0.0031) [2024-08-05 22:39:08,573][52665] DAMAGECOUNT value on done: 9980.0 [2024-08-05 22:39:08,577][52665] Sum rewards: 2.597, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.579', 'AMMO2': '0.017', 'ARMOR': '0.068', 'AMMO4': '0.084', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.488', 'HITCOUNT': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.356', 'weapon3': '1.706', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '5.000'} [2024-08-05 22:39:08,862][52669] DAMAGECOUNT value on done: 10883.0 [2024-08-05 22:39:08,862][52669] Sum rewards: 15.688, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.366', 'AMMO4': '-0.083', 'AMMO2': '-0.016', 'AMMO3': '0.082', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'HITCOUNT': '1.350', 'weapon2': '1.580', 'weapon3': '1.710', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:09,153][52647] DAMAGECOUNT value on done: 8135.0 [2024-08-05 22:39:09,153][52647] Sum rewards: 2.474, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.898', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.170', 'WEAPON4': '0.200', 'HITCOUNT': '0.360', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'weapon2': '0.862', 'DAMAGECOUNT': '1.188', 'weapon3': '1.534', 'FRAGCOUNT': '3.000'} [2024-08-05 22:39:10,419][52803] DAMAGECOUNT value on done: 9161.0 [2024-08-05 22:39:10,419][52803] Sum rewards: 9.798, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.196', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'HITCOUNT': '1.020', 'weapon2': '1.328', 'weapon3': '1.512', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:10,861][52811] DAMAGECOUNT value on done: 9824.0 [2024-08-05 22:39:10,863][52811] Sum rewards: 11.090, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.780', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.194', 'WEAPON3': '0.800', 'weapon2': '0.844', 'HITCOUNT': '0.900', 'ARMOR': '0.926', 'weapon3': '1.768', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:11,695][52647] DAMAGECOUNT value on done: 10717.0 [2024-08-05 22:39:11,697][52647] Sum rewards: 11.104, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.501', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.024', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.146', 'WEAPON3': '0.700', 'ARMOR': '0.912', 'HITCOUNT': '0.980', 'weapon2': '1.336', 'weapon3': '1.926', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:11,750][52665] DAMAGECOUNT value on done: 9882.0 [2024-08-05 22:39:11,755][52665] Sum rewards: 3.692, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.127', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.167', 'ARMOR': '0.480', 'HITCOUNT': '0.850', 'weapon2': '1.082', 'WEAPON3': '1.100', 'weapon3': '2.214', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:11,776][52669] DAMAGECOUNT value on done: 11523.0 [2024-08-05 22:39:11,776][52669] Sum rewards: 9.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.752', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.266', 'WEAPON3': '0.800', 'ARMOR': '0.857', 'HITCOUNT': '0.970', 'weapon2': '1.056', 'weapon3': '2.052', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 15495.4). Total num frames: 74956800. Throughput: 0: 4182.5. Samples: 18747350. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 22:39:12,794][52567] Avg episode reward: [(0, '10.357')] [2024-08-05 22:39:13,330][52650] Updated weights for policy 0, policy_version 9151 (0.0027) [2024-08-05 22:39:13,632][52803] DAMAGECOUNT value on done: 9763.0 [2024-08-05 22:39:13,633][52803] Sum rewards: 15.226, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.980', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'ARMOR': '0.498', 'weapon2': '1.026', 'HITCOUNT': '1.240', 'WEAPON3': '1.350', 'weapon3': '2.482', 'DAMAGECOUNT': '4.761', 'FRAGCOUNT': '17.000'} [2024-08-05 22:39:14,075][52811] DAMAGECOUNT value on done: 10233.0 [2024-08-05 22:39:14,076][52811] Sum rewards: 5.930, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.042', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO4': '0.035', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'ARMOR': '0.462', 'weapon4': '0.484', 'weapon2': '0.888', 'HITCOUNT': '0.970', 'WEAPON3': '1.250', 'weapon3': '1.766', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:14,411][52647] DAMAGECOUNT value on done: 10916.0 [2024-08-05 22:39:14,412][52647] Sum rewards: 3.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.146', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.012', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.190', 'HITCOUNT': '0.700', 'ARMOR': '0.910', 'WEAPON3': '1.150', 'weapon2': '1.332', 'weapon3': '1.968', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:14,517][52669] DAMAGECOUNT value on done: 12096.0 [2024-08-05 22:39:14,517][52669] Sum rewards: 12.306, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.725', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon2': '1.326', 'ARMOR': '1.393', 'weapon3': '1.872', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:14,843][52665] DAMAGECOUNT value on done: 11282.0 [2024-08-05 22:39:14,843][52665] Sum rewards: 14.270, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.020', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'HEALTH': '0.198', 'ARMOR': '0.400', 'weapon4': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon2': '0.850', 'weapon3': '1.874', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:15,635][52795] DAMAGECOUNT value on done: 8748.0 [2024-08-05 22:39:15,635][52795] Sum rewards: 5.779, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.480', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.392', 'ARMOR': '0.506', 'WEAPON3': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.132', 'weapon3': '1.888', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '4.500'} [2024-08-05 22:39:16,799][52803] DAMAGECOUNT value on done: 9184.0 [2024-08-05 22:39:16,801][52803] Sum rewards: 2.698, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.936', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.278', 'HITCOUNT': '0.530', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.263', 'ARMOR': '1.379', 'weapon3': '1.382', 'weapon2': '1.546', 'FRAGCOUNT': '3.000'} [2024-08-05 22:39:17,053][52647] DAMAGECOUNT value on done: 10178.0 [2024-08-05 22:39:17,054][52647] Sum rewards: 12.923, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.642', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.346', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.140', 'weapon2': '1.342', 'weapon3': '1.478', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:17,218][52811] DAMAGECOUNT value on done: 7634.0 [2024-08-05 22:39:17,221][52811] Sum rewards: 6.272, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.176', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.069', 'weapon4': '0.116', 'WEAPON3': '0.450', 'HITCOUNT': '0.490', 'ARMOR': '0.844', 'weapon3': '1.164', 'weapon2': '1.254', 'DAMAGECOUNT': '1.698', 'FRAGCOUNT': '4.000'} [2024-08-05 22:39:17,427][52669] DAMAGECOUNT value on done: 11401.0 [2024-08-05 22:39:17,427][52669] Sum rewards: 12.567, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.573', 'AMMO5': '0.004', 'AMMO2': '0.014', 'ARMOR': '0.040', 'AMMO4': '0.070', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon5': '0.264', 'weapon4': '0.544', 'WEAPON3': '0.550', 'weapon2': '0.712', 'HITCOUNT': '1.100', 'weapon3': '1.734', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.1, 300 sec: 15495.4). Total num frames: 75046912. Throughput: 0: 4197.1. Samples: 18760210. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 22:39:17,795][52567] Avg episode reward: [(0, '10.250')] [2024-08-05 22:39:17,810][52650] Updated weights for policy 0, policy_version 9161 (0.0023) [2024-08-05 22:39:18,262][52665] DAMAGECOUNT value on done: 10500.0 [2024-08-05 22:39:18,263][52665] Sum rewards: 14.368, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.250', 'HEALTH': '0.340', 'weapon5': '0.482', 'WEAPON3': '0.550', 'weapon2': '0.994', 'HITCOUNT': '1.110', 'weapon3': '1.904', 'DAMAGECOUNT': '3.831', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:18,922][52795] DAMAGECOUNT value on done: 9834.0 [2024-08-05 22:39:18,932][52795] Sum rewards: 6.190, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.988', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'ARMOR': '0.858', 'weapon2': '1.126', 'weapon3': '1.650', 'DAMAGECOUNT': '2.085', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:20,049][52803] DAMAGECOUNT value on done: 10296.0 [2024-08-05 22:39:20,051][52803] Sum rewards: 15.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.671', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.008', 'AMMO4': '0.025', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.276', 'WEAPON3': '0.650', 'ARMOR': '0.912', 'weapon2': '1.174', 'HITCOUNT': '1.210', 'weapon3': '1.578', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:20,315][52647] DAMAGECOUNT value on done: 10751.0 [2024-08-05 22:39:20,315][52647] Sum rewards: 10.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.236', 'ARMOR': '0.521', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.542', 'weapon3': '1.982', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:20,440][52811] DAMAGECOUNT value on done: 10420.0 [2024-08-05 22:39:20,442][52811] Sum rewards: 7.131, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.102', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.123', 'AMMO4': '0.168', 'weapon4': '0.184', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.276', 'weapon3': '2.130', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:20,592][52669] DAMAGECOUNT value on done: 10551.0 [2024-08-05 22:39:20,592][52669] Sum rewards: 18.648, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.515', 'AMMO2': '0.022', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon4': '0.302', 'WEAPON3': '0.650', 'ARMOR': '0.866', 'HITCOUNT': '1.070', 'weapon2': '1.170', 'weapon3': '1.906', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '16.000'} [2024-08-05 22:39:20,818][52665] DAMAGECOUNT value on done: 10967.0 [2024-08-05 22:39:20,819][52665] Sum rewards: 11.054, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'ARMOR': '0.067', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.272', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.246', 'weapon3': '1.256', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:22,127][52795] DAMAGECOUNT value on done: 9945.0 [2024-08-05 22:39:22,127][52795] Sum rewards: 12.531, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.250', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.204', 'WEAPON3': '0.450', 'ARMOR': '0.515', 'weapon2': '1.076', 'HITCOUNT': '1.300', 'weapon3': '1.408', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 15550.9). Total num frames: 75120640. Throughput: 0: 4197.3. Samples: 18785540. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 22:39:22,794][52567] Avg episode reward: [(0, '10.318')] [2024-08-05 22:39:22,944][52650] Updated weights for policy 0, policy_version 9171 (0.0024) [2024-08-05 22:39:23,124][52647] DAMAGECOUNT value on done: 11898.0 [2024-08-05 22:39:23,126][52647] Sum rewards: 13.521, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.175', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.246', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'weapon2': '1.354', 'weapon3': '1.418', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:23,498][52803] DAMAGECOUNT value on done: 10476.0 [2024-08-05 22:39:23,502][52803] Sum rewards: 9.863, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON3': '0.850', 'ARMOR': '0.920', 'HITCOUNT': '0.960', 'weapon2': '1.266', 'weapon3': '1.604', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:23,558][52669] DAMAGECOUNT value on done: 11060.0 [2024-08-05 22:39:23,561][52669] Sum rewards: 11.434, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.399', 'AMMO2': '0.018', 'AMMO3': '0.063', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.660', 'weapon4': '0.728', 'ARMOR': '0.891', 'weapon2': '1.280', 'weapon3': '1.422', 'DAMAGECOUNT': '2.583', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:23,845][52811] DAMAGECOUNT value on done: 11109.0 [2024-08-05 22:39:23,846][52811] Sum rewards: 18.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'HITCOUNT': '1.450', 'weapon2': '1.832', 'weapon3': '1.894', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '15.000'} [2024-08-05 22:39:24,086][52665] DAMAGECOUNT value on done: 10233.0 [2024-08-05 22:39:24,086][52665] Sum rewards: 4.867, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.918', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.012', 'weapon5': '0.032', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.200', 'ARMOR': '0.458', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '0.998', 'weapon3': '1.806', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '3.500'} [2024-08-05 22:39:25,370][52795] DAMAGECOUNT value on done: 11759.0 [2024-08-05 22:39:25,370][52795] Sum rewards: 4.024, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'HITCOUNT': '0.460', 'weapon4': '0.548', 'WEAPON3': '0.750', 'weapon2': '0.786', 'weapon3': '1.424', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '5.000'} [2024-08-05 22:39:25,630][52663] DAMAGECOUNT value on done: 11364.0 [2024-08-05 22:39:25,632][52663] Sum rewards: 8.364, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.431', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.276', 'weapon5': '0.404', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '0.884', 'weapon3': '1.160', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:26,097][52669] DAMAGECOUNT value on done: 11011.0 [2024-08-05 22:39:26,101][52669] Sum rewards: 5.864, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.350', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.013', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.252', 'ARMOR': '0.508', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '0.944', 'weapon3': '1.926', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:26,329][52647] DAMAGECOUNT value on done: 10697.0 [2024-08-05 22:39:26,330][52647] Sum rewards: 14.302, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.269', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.491', 'HITCOUNT': '0.900', 'weapon3': '1.400', 'weapon2': '1.602', 'DAMAGECOUNT': '3.036', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:26,653][52665] DAMAGECOUNT value on done: 11273.0 [2024-08-05 22:39:26,656][52665] Sum rewards: 5.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.256', 'ARMOR': '0.497', 'HITCOUNT': '1.000', 'WEAPON3': '1.050', 'weapon2': '1.108', 'weapon3': '2.262', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '6.500'} [2024-08-05 22:39:26,752][52803] DAMAGECOUNT value on done: 9353.0 [2024-08-05 22:39:26,757][52803] Sum rewards: 2.735, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO3': '0.063', 'AMMO4': '0.063', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.246', 'HITCOUNT': '0.360', 'WEAPON3': '0.450', 'ARMOR': '0.532', 'weapon2': '1.164', 'weapon3': '1.428', 'FRAGCOUNT': '1.500', 'DAMAGECOUNT': '1.596'} [2024-08-05 22:39:27,098][52811] DAMAGECOUNT value on done: 11159.0 [2024-08-05 22:39:27,101][52811] Sum rewards: 12.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.760', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON3': '1.000', 'weapon2': '1.154', 'HITCOUNT': '1.260', 'weapon3': '2.116', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:27,653][52650] Updated weights for policy 0, policy_version 9181 (0.0011) [2024-08-05 22:39:27,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.8, 300 sec: 15662.0). Total num frames: 75210752. Throughput: 0: 4187.3. Samples: 18810610. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:39:27,794][52567] Avg episode reward: [(0, '10.336')] [2024-08-05 22:39:28,535][52663] DAMAGECOUNT value on done: 10869.0 [2024-08-05 22:39:28,537][52663] Sum rewards: 11.745, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.919', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.460', 'HITCOUNT': '0.850', 'ARMOR': '0.930', 'weapon2': '1.064', 'weapon3': '1.440', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:28,671][52795] DAMAGECOUNT value on done: 11121.0 [2024-08-05 22:39:28,671][52795] Sum rewards: 4.281, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.018', 'AMMO5': '0.003', 'weapon5': '0.032', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.180', 'WEAPON4': '0.400', 'ARMOR': '0.464', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '0.796', 'weapon4': '0.922', 'weapon3': '1.748', 'FRAGCOUNT': '2.500', 'DAMAGECOUNT': '2.712'} [2024-08-05 22:39:29,234][52669] DAMAGECOUNT value on done: 12416.0 [2024-08-05 22:39:29,234][52669] Sum rewards: 3.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.128', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'HITCOUNT': '0.790', 'ARMOR': '0.901', 'weapon2': '1.094', 'WEAPON3': '1.100', 'weapon3': '2.560', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:29,507][52647] DAMAGECOUNT value on done: 11385.0 [2024-08-05 22:39:29,507][52647] Sum rewards: 11.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.419', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.374', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.248', 'weapon3': '1.968', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:29,814][52665] DAMAGECOUNT value on done: 10282.0 [2024-08-05 22:39:29,814][52665] Sum rewards: 9.656, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.094', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.078', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.494', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.012', 'weapon3': '1.792', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:29,976][52803] DAMAGECOUNT value on done: 10123.0 [2024-08-05 22:39:29,976][52803] Sum rewards: 12.296, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.398', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon5': '0.168', 'weapon4': '0.204', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.138', 'weapon3': '1.702', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:30,664][52614] Signal inference workers to stop experience collection... (1700 times) [2024-08-05 22:39:30,665][52614] Signal inference workers to resume experience collection... (1700 times) [2024-08-05 22:39:30,701][52811] DAMAGECOUNT value on done: 10018.0 [2024-08-05 22:39:30,706][52811] Sum rewards: 8.337, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.869', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon5': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'ARMOR': '0.056', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon2': '0.942', 'weapon3': '1.806', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:30,742][52650] InferenceWorker_p0-w0: stopping experience collection (1700 times) [2024-08-05 22:39:30,743][52650] InferenceWorker_p0-w0: resuming experience collection (1700 times) [2024-08-05 22:39:31,301][52663] DAMAGECOUNT value on done: 10028.0 [2024-08-05 22:39:31,303][52663] Sum rewards: 13.885, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.607', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.052', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.266', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'weapon2': '0.766', 'HITCOUNT': '0.790', 'weapon3': '1.370', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:31,358][52667] DAMAGECOUNT value on done: 11857.0 [2024-08-05 22:39:31,359][52667] Sum rewards: 9.387, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.077', 'HEALTH': '0.090', 'WEAPON3': '0.350', 'ARMOR': '0.416', 'HITCOUNT': '0.850', 'weapon3': '1.302', 'weapon2': '1.762', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:31,919][52795] DAMAGECOUNT value on done: 12734.0 [2024-08-05 22:39:31,922][52795] Sum rewards: 12.505, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.099', 'ARMOR': '0.471', 'WEAPON3': '0.750', 'HITCOUNT': '1.120', 'weapon2': '1.660', 'weapon3': '1.934', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:31,959][52669] DAMAGECOUNT value on done: 10082.0 [2024-08-05 22:39:31,960][52669] Sum rewards: 2.132, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.686', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.036', 'AMMO4': '0.064', 'AMMO3': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon4': '0.754', 'ARMOR': '0.892', 'weapon2': '1.052', 'weapon3': '1.648', 'DAMAGECOUNT': '1.959', 'FRAGCOUNT': '4.500'} [2024-08-05 22:39:32,356][52665] DAMAGECOUNT value on done: 10214.0 [2024-08-05 22:39:32,357][52665] Sum rewards: 10.642, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.832', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon5': '0.094', 'AMMO3': '0.135', 'WEAPON3': '0.850', 'HITCOUNT': '0.970', 'weapon2': '1.130', 'ARMOR': '1.249', 'weapon3': '1.804', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:32,706][52650] Updated weights for policy 0, policy_version 9191 (0.0022) [2024-08-05 22:39:32,762][52647] DAMAGECOUNT value on done: 10503.0 [2024-08-05 22:39:32,762][52647] Sum rewards: 13.758, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.240', 'HEALTH': '0.484', 'WEAPON3': '0.500', 'HITCOUNT': '1.100', 'weapon2': '1.298', 'weapon3': '1.658', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 15606.5). Total num frames: 75292672. Throughput: 0: 4197.1. Samples: 18823170. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:39:32,794][52567] Avg episode reward: [(0, '10.092')] [2024-08-05 22:39:33,257][52803] DAMAGECOUNT value on done: 11090.0 [2024-08-05 22:39:33,257][52803] Sum rewards: 12.301, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.622', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'weapon4': '0.232', 'WEAPON3': '0.850', 'ARMOR': '0.924', 'HITCOUNT': '1.130', 'weapon3': '1.608', 'weapon2': '1.646', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:33,705][52663] DAMAGECOUNT value on done: 12600.0 [2024-08-05 22:39:33,705][52663] Sum rewards: 9.953, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.536', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.026', 'AMMO3': '0.103', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'weapon4': '0.782', 'HITCOUNT': '0.890', 'weapon2': '0.928', 'weapon3': '1.872', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:34,056][52811] DAMAGECOUNT value on done: 10498.0 [2024-08-05 22:39:34,058][52811] Sum rewards: 14.590, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.160', 'WEAPON3': '1.050', 'HITCOUNT': '1.090', 'weapon2': '1.108', 'weapon3': '2.146', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '15.000'} [2024-08-05 22:39:34,440][52669] DAMAGECOUNT value on done: 12337.0 [2024-08-05 22:39:34,441][52669] Sum rewards: 17.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.022', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.012', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'ARMOR': '0.492', 'WEAPON3': '0.900', 'weapon2': '1.146', 'HITCOUNT': '1.320', 'weapon3': '2.114', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '16.000'} [2024-08-05 22:39:34,702][52667] DAMAGECOUNT value on done: 11161.0 [2024-08-05 22:39:34,704][52667] Sum rewards: 8.372, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.370', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.800', 'HITCOUNT': '0.970', 'weapon2': '1.184', 'ARMOR': '1.401', 'weapon3': '1.640', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:34,997][52665] DAMAGECOUNT value on done: 10835.0 [2024-08-05 22:39:34,999][52665] Sum rewards: 7.824, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.029', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.214', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'ARMOR': '0.964', 'weapon2': '1.252', 'weapon3': '1.360', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '5.000'} [2024-08-05 22:39:35,102][52795] DAMAGECOUNT value on done: 11006.0 [2024-08-05 22:39:35,111][52795] Sum rewards: 14.531, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.152', 'HEALTH': '0.330', 'ARMOR': '0.836', 'WEAPON3': '0.900', 'weapon2': '1.092', 'HITCOUNT': '1.320', 'weapon3': '2.346', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:35,660][52647] DAMAGECOUNT value on done: 10871.0 [2024-08-05 22:39:35,660][52647] Sum rewards: 2.797, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.450', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO3': '0.054', 'HITCOUNT': '0.370', 'WEAPON3': '0.450', 'ARMOR': '0.884', 'weapon3': '1.092', 'DAMAGECOUNT': '1.158', 'weapon2': '1.822', 'FRAGCOUNT': '3.000'} [2024-08-05 22:39:36,531][52803] DAMAGECOUNT value on done: 8848.0 [2024-08-05 22:39:36,532][52803] Sum rewards: 9.648, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.083', 'WEAPON4': '0.250', 'weapon4': '0.274', 'ARMOR': '0.451', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.208', 'weapon3': '1.878', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:36,625][52663] DAMAGECOUNT value on done: 10243.0 [2024-08-05 22:39:36,626][52663] Sum rewards: 11.605, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.306', 'weapon4': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.126', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.020', 'weapon2': '1.252', 'weapon3': '2.028', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:37,125][52669] DAMAGECOUNT value on done: 11386.0 [2024-08-05 22:39:37,125][52669] Sum rewards: 9.916, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.002', 'AMMO2': '0.018', 'AMMO4': '0.091', 'ARMOR': '0.124', 'AMMO3': '0.125', 'WEAPON4': '0.300', 'weapon2': '0.762', 'weapon4': '0.774', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon3': '2.120', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:37,293][52811] DAMAGECOUNT value on done: 9592.0 [2024-08-05 22:39:37,294][52811] Sum rewards: 10.554, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.530', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.638', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'weapon2': '1.024', 'ARMOR': '1.467', 'weapon3': '2.140', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:37,332][52650] Updated weights for policy 0, policy_version 9201 (0.0020) [2024-08-05 22:39:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 15634.2). Total num frames: 75382784. Throughput: 0: 4206.0. Samples: 18848490. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:39:37,795][52567] Avg episode reward: [(0, '10.162')] [2024-08-05 22:39:38,000][52667] DAMAGECOUNT value on done: 11114.0 [2024-08-05 22:39:38,002][52667] Sum rewards: 7.533, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.252', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.112', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.248', 'weapon3': '1.322', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:38,236][52665] DAMAGECOUNT value on done: 11963.0 [2024-08-05 22:39:38,236][52665] Sum rewards: 8.085, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.150', 'AMMO2': '0.011', 'ARMOR': '0.040', 'AMMO4': '0.054', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.258', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '0.970', 'weapon3': '1.578', 'DAMAGECOUNT': '2.979', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:38,326][52795] DAMAGECOUNT value on done: 11299.0 [2024-08-05 22:39:38,327][52795] Sum rewards: 7.652, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.570', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'ARMOR': '0.442', 'HITCOUNT': '0.960', 'WEAPON3': '1.000', 'weapon2': '1.216', 'weapon3': '2.006', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:38,436][52647] DAMAGECOUNT value on done: 10341.0 [2024-08-05 22:39:38,437][52647] Sum rewards: 11.436, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.680', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.091', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'ARMOR': '0.942', 'weapon3': '1.472', 'weapon2': '1.690', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:39,145][52794] DAMAGECOUNT value on done: 12171.0 [2024-08-05 22:39:39,146][52794] Sum rewards: 5.079, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.078', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.570', 'weapon4': '0.632', 'weapon2': '0.656', 'weapon3': '1.246', 'DAMAGECOUNT': '1.719', 'FRAGCOUNT': '3.000'} [2024-08-05 22:39:39,450][52663] DAMAGECOUNT value on done: 11530.0 [2024-08-05 22:39:39,452][52663] Sum rewards: 9.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.095', 'WEAPON4': '0.300', 'weapon4': '0.500', 'ARMOR': '0.557', 'WEAPON3': '0.800', 'weapon2': '0.800', 'HITCOUNT': '0.940', 'weapon3': '1.972', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:39,676][52803] DAMAGECOUNT value on done: 9399.0 [2024-08-05 22:39:39,677][52803] Sum rewards: 10.268, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.055', 'AMMO2': '0.015', 'AMMO3': '0.040', 'ARMOR': '0.060', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.322', 'HITCOUNT': '0.640', 'weapon3': '0.874', 'weapon2': '1.584', 'DAMAGECOUNT': '2.214', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:40,131][52669] DAMAGECOUNT value on done: 11882.0 [2024-08-05 22:39:40,131][52669] Sum rewards: 14.623, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.094', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon4': '0.124', 'WEAPON3': '0.600', 'HITCOUNT': '1.160', 'ARMOR': '1.275', 'weapon3': '1.796', 'weapon2': '1.882', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:40,543][52811] DAMAGECOUNT value on done: 11358.0 [2024-08-05 22:39:40,545][52811] Sum rewards: 10.414, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.542', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.200', 'weapon4': '0.384', 'ARMOR': '0.574', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '1.312', 'weapon3': '1.902', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:40,868][52667] DAMAGECOUNT value on done: 12003.0 [2024-08-05 22:39:40,868][52667] Sum rewards: 14.876, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.370', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.382', 'ARMOR': '0.836', 'WEAPON3': '0.950', 'weapon2': '1.168', 'HITCOUNT': '1.400', 'weapon3': '2.120', 'DAMAGECOUNT': '4.998', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:41,256][52647] DAMAGECOUNT value on done: 12827.0 [2024-08-05 22:39:41,257][52647] Sum rewards: 20.334, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON3': '0.500', 'HEALTH': '0.584', 'ARMOR': '0.851', 'HITCOUNT': '1.350', 'weapon2': '1.564', 'weapon3': '1.602', 'DAMAGECOUNT': '4.998', 'FRAGCOUNT': '14.000'} [2024-08-05 22:39:41,371][52665] DAMAGECOUNT value on done: 10773.0 [2024-08-05 22:39:41,372][52665] Sum rewards: 10.944, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.887', 'AMMO2': '0.018', 'ARMOR': '0.072', 'AMMO4': '0.090', 'AMMO3': '0.137', 'WEAPON4': '0.350', 'weapon4': '0.566', 'weapon2': '0.954', 'WEAPON3': '1.000', 'HITCOUNT': '1.020', 'weapon3': '2.204', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:41,571][52794] DAMAGECOUNT value on done: 13348.0 [2024-08-05 22:39:41,571][52794] Sum rewards: 12.622, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.108', 'weapon4': '0.112', 'HEALTH': '0.118', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.956', 'HITCOUNT': '1.100', 'weapon2': '1.730', 'weapon3': '1.810', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:41,592][52795] DAMAGECOUNT value on done: 10293.0 [2024-08-05 22:39:41,594][52795] Sum rewards: 10.843, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.736', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.258', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'ARMOR': '1.252', 'weapon2': '1.272', 'weapon3': '1.946', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:42,473][52650] Updated weights for policy 0, policy_version 9211 (0.0026) [2024-08-05 22:39:42,749][52663] DAMAGECOUNT value on done: 13651.0 [2024-08-05 22:39:42,749][52663] Sum rewards: 14.443, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'HEALTH': '0.262', 'ARMOR': '0.432', 'weapon4': '0.486', 'WEAPON3': '0.600', 'weapon2': '0.748', 'HITCOUNT': '1.100', 'weapon3': '1.726', 'DAMAGECOUNT': '3.366', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:42,795][52567] Fps is (10 sec: 16384.0, 60 sec: 16794.2, 300 sec: 15578.7). Total num frames: 75456512. Throughput: 0: 4213.6. Samples: 18874050. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:39:42,795][52567] Avg episode reward: [(0, '10.197')] [2024-08-05 22:39:43,055][52803] DAMAGECOUNT value on done: 9702.0 [2024-08-05 22:39:43,056][52803] Sum rewards: 6.280, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.235', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '1.021', 'weapon2': '1.284', 'weapon3': '1.538', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:43,207][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:39:43,335][52669] DAMAGECOUNT value on done: 11522.0 [2024-08-05 22:39:43,335][52669] Sum rewards: 14.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.170', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.494', 'WEAPON3': '0.700', 'weapon2': '0.912', 'ARMOR': '0.940', 'HITCOUNT': '0.980', 'weapon3': '2.040', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:43,784][52811] DAMAGECOUNT value on done: 9968.0 [2024-08-05 22:39:43,785][52811] Sum rewards: 20.119, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.509', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.250', 'WEAPON3': '0.600', 'ARMOR': '0.908', 'HITCOUNT': '1.190', 'weapon2': '1.364', 'weapon3': '1.720', 'DAMAGECOUNT': '4.443', 'FRAGCOUNT': '15.000'} [2024-08-05 22:39:43,847][52667] DAMAGECOUNT value on done: 11849.0 [2024-08-05 22:39:43,848][52667] Sum rewards: 14.357, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.616', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'weapon4': '0.524', 'WEAPON3': '0.850', 'weapon2': '0.984', 'HITCOUNT': '1.180', 'weapon3': '1.936', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:44,166][52794] DAMAGECOUNT value on done: 12777.0 [2024-08-05 22:39:44,168][52794] Sum rewards: 4.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.560', 'AMMO2': '0.030', 'AMMO3': '0.146', 'AMMO4': '0.148', 'weapon4': '0.248', 'WEAPON4': '0.300', 'ARMOR': '0.563', 'HITCOUNT': '0.590', 'WEAPON3': '0.900', 'weapon2': '1.070', 'DAMAGECOUNT': '1.797', 'weapon3': '1.932', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:44,198][52662] DAMAGECOUNT value on done: 11404.0 [2024-08-05 22:39:44,199][52662] Sum rewards: 9.637, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.793', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.238', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.082', 'ARMOR': '1.401', 'weapon3': '1.460', 'DAMAGECOUNT': '1.983', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:44,226][52647] DAMAGECOUNT value on done: 10578.0 [2024-08-05 22:39:44,227][52647] Sum rewards: 3.190, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.369', 'AMMO2': '0.005', 'weapon7': '0.012', 'AMMO4': '0.026', 'ARMOR': '0.060', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HITCOUNT': '0.720', 'WEAPON3': '0.850', 'weapon2': '1.182', 'weapon3': '1.740', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '3.000'} [2024-08-05 22:39:44,417][52665] DAMAGECOUNT value on done: 11166.0 [2024-08-05 22:39:44,419][52665] Sum rewards: 9.592, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.854', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.114', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.422', 'ARMOR': '0.486', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon2': '1.034', 'weapon3': '2.192', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:45,195][52795] DAMAGECOUNT value on done: 11266.0 [2024-08-05 22:39:45,196][52795] Sum rewards: 13.699, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.088', 'AMMO2': '0.032', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.159', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '0.980', 'weapon2': '1.288', 'weapon3': '1.768', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:45,721][52663] DAMAGECOUNT value on done: 10336.0 [2024-08-05 22:39:45,721][52663] Sum rewards: 10.312, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.490', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.102', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'ARMOR': '1.322', 'weapon2': '1.644', 'weapon3': '1.812', 'DAMAGECOUNT': '3.384', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:46,440][52803] DAMAGECOUNT value on done: 10500.0 [2024-08-05 22:39:46,442][52803] Sum rewards: 7.163, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.304', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.125', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'ARMOR': '0.907', 'HITCOUNT': '0.920', 'weapon2': '1.422', 'weapon3': '2.198', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '6.500'} [2024-08-05 22:39:46,449][52669] DAMAGECOUNT value on done: 11516.0 [2024-08-05 22:39:46,449][52669] Sum rewards: 20.757, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.716', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.077', 'WEAPON3': '0.500', 'ARMOR': '0.965', 'HITCOUNT': '1.090', 'weapon2': '1.456', 'weapon3': '1.500', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '16.000'} [2024-08-05 22:39:46,467][52794] DAMAGECOUNT value on done: 12400.0 [2024-08-05 22:39:46,469][52794] Sum rewards: 8.373, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.745', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON3': '0.400', 'ARMOR': '0.497', 'HITCOUNT': '0.760', 'weapon3': '1.000', 'weapon2': '1.258', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:46,506][52662] DAMAGECOUNT value on done: 12659.0 [2024-08-05 22:39:46,508][52662] Sum rewards: 15.399, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.276', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.376', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.232', 'weapon3': '2.004', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '13.000'} [2024-08-05 22:39:46,586][52647] DAMAGECOUNT value on done: 12213.0 [2024-08-05 22:39:46,587][52647] Sum rewards: 9.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.548', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.030', 'ARMOR': '0.060', 'AMMO4': '0.078', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.542', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.172', 'weapon3': '1.826', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:47,001][52650] Updated weights for policy 0, policy_version 9221 (0.0021) [2024-08-05 22:39:47,199][52811] DAMAGECOUNT value on done: 9699.0 [2024-08-05 22:39:47,201][52811] Sum rewards: 10.938, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.855', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.206', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon3': '1.536', 'weapon2': '1.598', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:47,348][52667] DAMAGECOUNT value on done: 12832.0 [2024-08-05 22:39:47,348][52667] Sum rewards: 9.808, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.421', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'weapon4': '0.490', 'weapon2': '0.812', 'HITCOUNT': '0.870', 'WEAPON3': '1.000', 'weapon3': '2.304', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:47,701][52665] DAMAGECOUNT value on done: 11636.0 [2024-08-05 22:39:47,703][52665] Sum rewards: 11.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.292', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.176', 'weapon4': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.516', 'weapon2': '1.042', 'HITCOUNT': '1.070', 'WEAPON3': '1.200', 'weapon3': '2.490', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '14.000'} [2024-08-05 22:39:47,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 15606.5). Total num frames: 75546624. Throughput: 0: 4215.1. Samples: 18886690. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:39:47,794][52567] Avg episode reward: [(0, '10.342')] [2024-08-05 22:39:48,468][52795] DAMAGECOUNT value on done: 9229.0 [2024-08-05 22:39:48,471][52795] Sum rewards: 3.564, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.284', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon7': '0.070', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon2': '0.326', 'ARMOR': '0.400', 'HITCOUNT': '0.440', 'weapon4': '0.714', 'WEAPON3': '0.750', 'weapon3': '1.730', 'DAMAGECOUNT': '1.740', 'FRAGCOUNT': '4.000'} [2024-08-05 22:39:48,517][52663] DAMAGECOUNT value on done: 11030.0 [2024-08-05 22:39:48,520][52663] Sum rewards: 16.776, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.122', 'ARMOR': '0.495', 'WEAPON3': '0.900', 'weapon2': '1.324', 'HITCOUNT': '1.430', 'weapon3': '2.174', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '14.000'} [2024-08-05 22:39:48,973][52647] DAMAGECOUNT value on done: 10845.0 [2024-08-05 22:39:48,974][52647] Sum rewards: 8.652, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon7': '0.048', 'weapon5': '0.056', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.440', 'weapon3': '1.584', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:48,977][52669] DAMAGECOUNT value on done: 10385.0 [2024-08-05 22:39:48,978][52669] Sum rewards: 9.748, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.761', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'weapon4': '0.486', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'ARMOR': '0.910', 'weapon2': '1.022', 'weapon3': '1.360', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:48,983][52794] DAMAGECOUNT value on done: 13623.0 [2024-08-05 22:39:48,984][52794] Sum rewards: 11.285, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.110', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'ARMOR': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'WEAPON3': '1.050', 'weapon2': '1.146', 'HITCOUNT': '1.280', 'weapon3': '2.482', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:49,012][52662] DAMAGECOUNT value on done: 13636.0 [2024-08-05 22:39:49,013][52662] Sum rewards: 13.999, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.138', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.288', 'ARMOR': '0.482', 'WEAPON3': '0.550', 'HITCOUNT': '1.090', 'weapon2': '1.214', 'weapon3': '1.704', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:49,894][52803] DAMAGECOUNT value on done: 10485.0 [2024-08-05 22:39:49,897][52803] Sum rewards: 7.197, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.405', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.495', 'HITCOUNT': '0.670', 'weapon3': '1.166', 'weapon2': '1.682', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:50,577][52811] DAMAGECOUNT value on done: 9213.0 [2024-08-05 22:39:50,577][52811] Sum rewards: 8.164, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.308', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon4': '0.220', 'ARMOR': '0.926', 'WEAPON3': '1.000', 'HITCOUNT': '1.010', 'weapon2': '1.512', 'weapon3': '2.076', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:50,587][52667] DAMAGECOUNT value on done: 11384.0 [2024-08-05 22:39:50,587][52667] Sum rewards: 2.014, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.482', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.104', 'weapon4': '0.210', 'WEAPON4': '0.350', 'ARMOR': '0.521', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.390', 'weapon3': '1.692', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.355'} [2024-08-05 22:39:50,731][52665] DAMAGECOUNT value on done: 11534.0 [2024-08-05 22:39:50,732][52665] Sum rewards: 9.052, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.130', 'weapon4': '0.286', 'WEAPON4': '0.300', 'HITCOUNT': '0.840', 'WEAPON3': '0.950', 'ARMOR': '0.964', 'weapon2': '1.022', 'weapon3': '2.358', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:51,057][52663] DAMAGECOUNT value on done: 12176.0 [2024-08-05 22:39:51,058][52663] Sum rewards: 13.500, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.096', 'AMMO4': '-0.086', 'AMMO2': '-0.017', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'WEAPON3': '0.850', 'ARMOR': '0.881', 'HITCOUNT': '1.050', 'weapon3': '1.704', 'weapon2': '1.820', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:51,703][52795] DAMAGECOUNT value on done: 9970.0 [2024-08-05 22:39:51,706][52795] Sum rewards: 8.476, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.391', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.084', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.232', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.368', 'weapon3': '1.540', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:51,761][52794] DAMAGECOUNT value on done: 13024.0 [2024-08-05 22:39:51,763][52794] Sum rewards: 7.252, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.473', 'AMMO2': '0.006', 'AMMO4': '0.029', 'ARMOR': '0.052', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.426', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'weapon2': '1.182', 'weapon3': '1.586', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:51,782][52669] DAMAGECOUNT value on done: 11479.0 [2024-08-05 22:39:51,783][52669] Sum rewards: 12.847, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.599', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.126', 'weapon4': '0.162', 'WEAPON4': '0.250', 'ARMOR': '0.538', 'WEAPON3': '0.900', 'HITCOUNT': '0.970', 'weapon2': '1.500', 'weapon3': '2.034', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:51,793][52662] DAMAGECOUNT value on done: 12350.0 [2024-08-05 22:39:51,801][52662] Sum rewards: 7.910, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.154', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.244', 'WEAPON3': '0.500', 'ARMOR': '0.534', 'HITCOUNT': '0.660', 'weapon3': '1.188', 'weapon2': '1.402', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:51,967][52647] DAMAGECOUNT value on done: 11271.0 [2024-08-05 22:39:51,970][52647] Sum rewards: 8.724, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.529', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.428', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon2': '1.182', 'weapon3': '1.378', 'ARMOR': '1.796', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '4.000'} [2024-08-05 22:39:52,235][52650] Updated weights for policy 0, policy_version 9231 (0.0025) [2024-08-05 22:39:52,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16657.0, 300 sec: 15550.9). Total num frames: 75620352. Throughput: 0: 4208.4. Samples: 18911830. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 22:39:52,795][52567] Avg episode reward: [(0, '10.331')] [2024-08-05 22:39:53,635][52667] DAMAGECOUNT value on done: 10611.0 [2024-08-05 22:39:53,635][52667] Sum rewards: 9.487, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.791', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.015', 'weapon5': '0.052', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.324', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'ARMOR': '0.902', 'weapon3': '1.076', 'weapon2': '1.238', 'DAMAGECOUNT': '2.250', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:53,776][52811] DAMAGECOUNT value on done: 10534.0 [2024-08-05 22:39:53,777][52811] Sum rewards: 5.897, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.362', 'AMMO2': '0.018', 'weapon7': '0.070', 'AMMO4': '0.092', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.498', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon4': '0.704', 'weapon2': '0.826', 'weapon3': '1.556', 'DAMAGECOUNT': '2.133', 'FRAGCOUNT': '5.000'} [2024-08-05 22:39:53,905][52663] DAMAGECOUNT value on done: 10601.0 [2024-08-05 22:39:53,907][52663] Sum rewards: 3.924, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HEALTH': '0.028', 'AMMO3': '0.053', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.312', 'WEAPON3': '0.350', 'HITCOUNT': '0.410', 'ARMOR': '0.815', 'weapon3': '1.212', 'weapon2': '1.306', 'DAMAGECOUNT': '1.395', 'FRAGCOUNT': '1.500'} [2024-08-05 22:39:53,992][52665] DAMAGECOUNT value on done: 11435.0 [2024-08-05 22:39:53,993][52665] Sum rewards: 12.844, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.294', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.096', 'weapon4': '0.196', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon2': '1.216', 'weapon3': '1.632', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:54,108][52658] DAMAGECOUNT value on done: 10895.0 [2024-08-05 22:39:54,109][52658] Sum rewards: 19.915, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.114', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'WEAPON3': '0.600', 'HITCOUNT': '1.230', 'weapon3': '1.388', 'weapon2': '1.508', 'ARMOR': '2.146', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '15.000'} [2024-08-05 22:39:54,436][52794] DAMAGECOUNT value on done: 12091.0 [2024-08-05 22:39:54,436][52794] Sum rewards: 9.243, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.860', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.194', 'ARMOR': '0.447', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon3': '1.574', 'weapon2': '1.586', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '8.000'} [2024-08-05 22:39:54,468][52662] DAMAGECOUNT value on done: 13052.0 [2024-08-05 22:39:54,471][52662] Sum rewards: 15.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.573', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.200', 'ARMOR': '0.468', 'WEAPON3': '0.600', 'HITCOUNT': '1.130', 'weapon2': '1.548', 'weapon3': '1.636', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '12.000'} [2024-08-05 22:39:55,031][52795] DAMAGECOUNT value on done: 11597.0 [2024-08-05 22:39:55,033][52795] Sum rewards: 5.790, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.290', 'ARMOR': '0.482', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon2': '0.868', 'weapon3': '1.484', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:55,160][52647] DAMAGECOUNT value on done: 10464.0 [2024-08-05 22:39:55,160][52647] Sum rewards: 8.842, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.336', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.871', 'HITCOUNT': '0.880', 'weapon2': '1.378', 'weapon3': '1.612', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:56,503][52667] DAMAGECOUNT value on done: 11123.0 [2024-08-05 22:39:56,505][52667] Sum rewards: 17.274, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.092', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.288', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'weapon2': '1.494', 'weapon3': '1.770', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '16.000'} [2024-08-05 22:39:56,731][52650] Updated weights for policy 0, policy_version 9241 (0.0014) [2024-08-05 22:39:56,894][52665] DAMAGECOUNT value on done: 10435.0 [2024-08-05 22:39:56,894][52665] Sum rewards: 8.792, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.327', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.076', 'AMMO3': '0.080', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'ARMOR': '0.454', 'weapon4': '0.510', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.154', 'weapon3': '1.708', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '5.500'} [2024-08-05 22:39:56,916][52811] DAMAGECOUNT value on done: 10327.0 [2024-08-05 22:39:56,923][52811] Sum rewards: 8.068, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.409', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon4': '0.796', 'weapon2': '0.992', 'ARMOR': '1.052', 'weapon3': '1.632', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:57,148][52663] DAMAGECOUNT value on done: 10120.0 [2024-08-05 22:39:57,148][52663] Sum rewards: 2.399, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.144', 'weapon4': '0.248', 'WEAPON4': '0.250', 'HITCOUNT': '0.780', 'WEAPON3': '0.950', 'ARMOR': '1.013', 'weapon2': '1.196', 'DAMAGECOUNT': '2.214', 'weapon3': '2.324', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:57,185][52658] DAMAGECOUNT value on done: 11198.0 [2024-08-05 22:39:57,189][52658] Sum rewards: 9.491, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.021', 'weapon4': '0.086', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'ARMOR': '0.446', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon3': '1.678', 'weapon2': '1.700', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:57,235][52794] DAMAGECOUNT value on done: 10702.0 [2024-08-05 22:39:57,235][52794] Sum rewards: 8.879, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.418', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.075', 'weapon4': '0.216', 'WEAPON3': '0.550', 'ARMOR': '0.868', 'HITCOUNT': '0.910', 'weapon2': '1.390', 'weapon3': '1.558', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:57,296][52662] DAMAGECOUNT value on done: 14212.0 [2024-08-05 22:39:57,297][52662] Sum rewards: 10.669, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.203', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.234', 'ARMOR': '0.849', 'WEAPON3': '0.950', 'weapon2': '0.980', 'HITCOUNT': '1.080', 'weapon3': '1.882', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '11.000'} [2024-08-05 22:39:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 15606.5). Total num frames: 75718656. Throughput: 0: 4206.0. Samples: 18936620. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 22:39:57,794][52567] Avg episode reward: [(0, '10.158')] [2024-08-05 22:39:57,804][52649] DAMAGECOUNT value on done: 11408.0 [2024-08-05 22:39:57,804][52649] Sum rewards: 5.936, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.329', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'ARMOR': '0.440', 'HITCOUNT': '0.460', 'WEAPON3': '0.600', 'weapon2': '0.794', 'weapon3': '1.128', 'DAMAGECOUNT': '1.770', 'FRAGCOUNT': '6.000'} [2024-08-05 22:39:58,380][52795] DAMAGECOUNT value on done: 10996.0 [2024-08-05 22:39:58,382][52795] Sum rewards: 12.902, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.522', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'weapon4': '0.302', 'WEAPON3': '0.500', 'ARMOR': '0.897', 'weapon2': '1.018', 'HITCOUNT': '1.090', 'weapon3': '1.472', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '9.000'} [2024-08-05 22:39:59,437][52667] DAMAGECOUNT value on done: 12285.0 [2024-08-05 22:39:59,439][52667] Sum rewards: 11.150, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.444', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.112', 'WEAPON3': '0.750', 'weapon2': '0.870', 'HITCOUNT': '1.010', 'weapon3': '1.778', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '10.000'} [2024-08-05 22:39:59,832][52794] DAMAGECOUNT value on done: 13989.0 [2024-08-05 22:39:59,833][52794] Sum rewards: 6.183, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.758', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.098', 'AMMO3': '0.132', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.800', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon2': '1.146', 'weapon3': '2.246', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '7.000'} [2024-08-05 22:39:59,926][52662] DAMAGECOUNT value on done: 13218.0 [2024-08-05 22:39:59,926][52662] Sum rewards: 13.158, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.042', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.080', 'ARMOR': '0.097', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'weapon4': '0.578', 'HITCOUNT': '0.900', 'weapon2': '1.216', 'weapon3': '1.498', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:00,044][52658] DAMAGECOUNT value on done: 10104.0 [2024-08-05 22:40:00,045][52658] Sum rewards: 3.734, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.944', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.402', 'ARMOR': '0.528', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '0.930', 'weapon3': '1.678', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:00,263][52663] DAMAGECOUNT value on done: 11744.0 [2024-08-05 22:40:00,264][52663] Sum rewards: 12.247, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon4': '0.088', 'AMMO4': '0.104', 'weapon5': '0.128', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '1.102', 'WEAPON3': '1.150', 'HITCOUNT': '1.180', 'ARMOR': '1.200', 'weapon3': '2.410', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:00,317][52665] DAMAGECOUNT value on done: 11507.0 [2024-08-05 22:40:00,321][52665] Sum rewards: 14.411, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.372', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.954', 'ARMOR': '0.977', 'WEAPON3': '1.050', 'HITCOUNT': '1.130', 'weapon3': '2.302', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '14.000'} [2024-08-05 22:40:01,281][52649] DAMAGECOUNT value on done: 9871.0 [2024-08-05 22:40:01,281][52649] Sum rewards: 5.905, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.131', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon5': '0.022', 'AMMO4': '0.052', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.390', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'ARMOR': '0.857', 'weapon2': '1.084', 'weapon3': '1.320', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:01,890][52795] DAMAGECOUNT value on done: 10605.0 [2024-08-05 22:40:01,898][52795] Sum rewards: 11.476, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.268', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.284', 'ARMOR': '0.554', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon3': '1.188', 'weapon2': '1.350', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:01,972][52650] Updated weights for policy 0, policy_version 9251 (0.0016) [2024-08-05 22:40:02,043][52664] DAMAGECOUNT value on done: 12622.0 [2024-08-05 22:40:02,044][52664] Sum rewards: 7.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.438', 'AMMO2': '0.015', 'ARMOR': '0.064', 'AMMO4': '0.074', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.616', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '0.926', 'weapon3': '1.804', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:02,417][52794] DAMAGECOUNT value on done: 12258.0 [2024-08-05 22:40:02,418][52794] Sum rewards: 11.342, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.458', 'HEALTH': '0.476', 'WEAPON3': '0.550', 'HITCOUNT': '0.630', 'weapon2': '0.722', 'ARMOR': '1.295', 'weapon3': '1.616', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:02,449][52662] DAMAGECOUNT value on done: 13707.0 [2024-08-05 22:40:02,451][52662] Sum rewards: 8.948, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.894', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.048', 'weapon4': '0.072', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'ARMOR': '0.940', 'weapon3': '1.136', 'weapon2': '1.804', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:02,668][52663] DAMAGECOUNT value on done: 11591.0 [2024-08-05 22:40:02,669][52663] Sum rewards: 19.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.398', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.016', 'weapon4': '0.060', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'ARMOR': '0.444', 'WEAPON3': '1.150', 'weapon2': '1.416', 'HITCOUNT': '1.560', 'weapon3': '2.208', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '19.000'} [2024-08-05 22:40:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 16793.6, 300 sec: 15578.7). Total num frames: 75800576. Throughput: 0: 4194.2. Samples: 18948950. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 22:40:02,794][52567] Avg episode reward: [(0, '10.406')] [2024-08-05 22:40:02,805][52667] DAMAGECOUNT value on done: 10061.0 [2024-08-05 22:40:02,805][52667] Sum rewards: 9.105, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.061', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'WEAPON7': '0.200', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'ARMOR': '0.940', 'weapon2': '1.334', 'weapon3': '2.062', 'DAMAGECOUNT': '2.553', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:03,496][52658] DAMAGECOUNT value on done: 10788.0 [2024-08-05 22:40:03,497][52658] Sum rewards: 7.203, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.666', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.030', 'WEAPON4': '0.200', 'WEAPON3': '0.250', 'weapon4': '0.346', 'HITCOUNT': '0.510', 'weapon3': '0.692', 'ARMOR': '1.072', 'weapon2': '1.252', 'DAMAGECOUNT': '1.524', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:03,552][52665] DAMAGECOUNT value on done: 9998.0 [2024-08-05 22:40:03,553][52665] Sum rewards: 4.699, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.246', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'WEAPON3': '0.500', 'ARMOR': '0.544', 'HITCOUNT': '0.630', 'weapon4': '0.780', 'weapon2': '1.268', 'weapon3': '1.498', 'DAMAGECOUNT': '1.737', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:04,661][52649] DAMAGECOUNT value on done: 10284.0 [2024-08-05 22:40:04,661][52649] Sum rewards: 4.674, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.009', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.042', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.234', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'ARMOR': '0.974', 'weapon2': '1.162', 'DAMAGECOUNT': '1.275', 'weapon3': '1.438', 'FRAGCOUNT': '3.000'} [2024-08-05 22:40:05,015][52662] DAMAGECOUNT value on done: 12086.0 [2024-08-05 22:40:05,023][52662] Sum rewards: 3.812, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.460', 'AMMO2': '0.015', 'AMMO3': '0.061', 'AMMO4': '0.074', 'ARMOR': '0.104', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon4': '0.740', 'weapon3': '1.502', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '3.000'} [2024-08-05 22:40:05,102][52794] DAMAGECOUNT value on done: 12710.0 [2024-08-05 22:40:05,102][52794] Sum rewards: 17.000, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.268', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.360', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.070', 'weapon3': '1.942', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '16.000'} [2024-08-05 22:40:05,187][52663] DAMAGECOUNT value on done: 11562.0 [2024-08-05 22:40:05,188][52663] Sum rewards: 8.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.018', 'AMMO3': '0.060', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.496', 'ARMOR': '0.974', 'HITCOUNT': '1.040', 'weapon2': '1.170', 'weapon3': '1.314', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:05,240][52795] DAMAGECOUNT value on done: 11654.0 [2024-08-05 22:40:05,243][52795] Sum rewards: 13.574, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.653', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.108', 'weapon5': '0.144', 'WEAPON5': '0.150', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'HITCOUNT': '1.130', 'weapon2': '1.498', 'weapon3': '1.528', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:05,258][52664] DAMAGECOUNT value on done: 11386.0 [2024-08-05 22:40:05,258][52664] Sum rewards: 13.750, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.010', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon5': '0.216', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'weapon3': '1.310', 'weapon2': '1.636', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:05,430][52667] DAMAGECOUNT value on done: 11787.0 [2024-08-05 22:40:05,430][52667] Sum rewards: 11.001, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.973', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'weapon2': '1.404', 'weapon3': '1.934', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:06,070][52658] DAMAGECOUNT value on done: 10891.0 [2024-08-05 22:40:06,071][52658] Sum rewards: 11.111, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.265', 'AMMO5': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.250', 'ARMOR': '0.539', 'WEAPON3': '0.550', 'weapon4': '0.596', 'HITCOUNT': '0.660', 'weapon2': '0.894', 'weapon3': '1.614', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:06,810][52650] Updated weights for policy 0, policy_version 9261 (0.0027) [2024-08-05 22:40:06,901][52665] DAMAGECOUNT value on done: 11572.0 [2024-08-05 22:40:06,916][52665] Sum rewards: 14.869, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.946', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.012', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'weapon4': '0.228', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.160', 'weapon3': '1.534', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '13.000'} [2024-08-05 22:40:07,604][52662] DAMAGECOUNT value on done: 12634.0 [2024-08-05 22:40:07,605][52662] Sum rewards: 10.280, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.166', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.384', 'ARMOR': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon2': '1.266', 'weapon3': '1.942', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:07,669][52794] DAMAGECOUNT value on done: 12737.0 [2024-08-05 22:40:07,669][52794] Sum rewards: 8.044, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.316', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.194', 'WEAPON4': '0.200', 'HITCOUNT': '0.420', 'ARMOR': '0.435', 'WEAPON3': '0.550', 'weapon3': '1.344', 'DAMAGECOUNT': '1.383', 'weapon2': '1.758', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:07,720][52649] DAMAGECOUNT value on done: 12851.0 [2024-08-05 22:40:07,721][52649] Sum rewards: 13.673, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.099', 'AMMO5': '0.003', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'weapon4': '0.336', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '1.070', 'weapon3': '1.670', 'DAMAGECOUNT': '3.105', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:07,794][52567] Fps is (10 sec: 16383.4, 60 sec: 16793.5, 300 sec: 15689.8). Total num frames: 75882496. Throughput: 0: 4201.5. Samples: 18974610. Policy #0 lag: (min: 1.0, avg: 4.5, max: 10.0) [2024-08-05 22:40:07,795][52567] Avg episode reward: [(0, '10.286')] [2024-08-05 22:40:08,052][52663] DAMAGECOUNT value on done: 11472.0 [2024-08-05 22:40:08,052][52663] Sum rewards: 11.653, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.025', 'AMMO3': '0.104', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.479', 'weapon4': '0.490', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon3': '1.410', 'weapon2': '1.494', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:08,194][52664] DAMAGECOUNT value on done: 11568.0 [2024-08-05 22:40:08,194][52664] Sum rewards: 7.456, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.545', 'AMMO2': '0.022', 'ARMOR': '0.076', 'AMMO3': '0.081', 'AMMO4': '0.109', 'WEAPON4': '0.300', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'weapon4': '0.668', 'weapon2': '1.072', 'weapon3': '1.756', 'DAMAGECOUNT': '1.977', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:08,602][52795] DAMAGECOUNT value on done: 10595.0 [2024-08-05 22:40:08,604][52795] Sum rewards: 4.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.934', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.110', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.440', 'ARMOR': '0.492', 'weapon2': '0.578', 'weapon4': '0.700', 'WEAPON3': '0.900', 'DAMAGECOUNT': '1.725', 'weapon3': '1.976', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:08,616][52667] DAMAGECOUNT value on done: 11669.0 [2024-08-05 22:40:08,617][52667] Sum rewards: 10.093, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO3': '0.060', 'AMMO4': '0.067', 'HEALTH': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON3': '0.300', 'weapon4': '0.412', 'HITCOUNT': '0.490', 'weapon2': '0.818', 'ARMOR': '0.912', 'weapon3': '0.976', 'DAMAGECOUNT': '1.725', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:09,494][52658] DAMAGECOUNT value on done: 9356.0 [2024-08-05 22:40:09,500][52658] Sum rewards: 11.104, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'AMMO4': '0.087', 'weapon5': '0.210', 'ARMOR': '0.416', 'WEAPON3': '0.500', 'HEALTH': '0.505', 'HITCOUNT': '0.810', 'weapon3': '1.464', 'weapon2': '1.558', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:10,008][52662] DAMAGECOUNT value on done: 12386.0 [2024-08-05 22:40:10,009][52662] Sum rewards: 6.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.158', 'AMMO2': '0.011', 'ARMOR': '0.020', 'AMMO4': '0.055', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.456', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.262', 'weapon3': '2.036', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:10,180][52794] DAMAGECOUNT value on done: 12163.0 [2024-08-05 22:40:10,180][52794] Sum rewards: 13.098, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.040', 'AMMO4': '0.052', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.578', 'WEAPON3': '0.750', 'ARMOR': '0.907', 'weapon2': '0.986', 'HITCOUNT': '1.110', 'weapon3': '1.854', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:10,275][52649] DAMAGECOUNT value on done: 10542.0 [2024-08-05 22:40:10,288][52649] Sum rewards: 16.619, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.667', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon7': '0.076', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.356', 'ARMOR': '0.545', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.188', 'weapon3': '1.554', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '12.000'} [2024-08-05 22:40:10,887][52663] DAMAGECOUNT value on done: 11734.0 [2024-08-05 22:40:10,889][52663] Sum rewards: 15.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.864', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.260', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon2': '1.246', 'weapon3': '1.588', 'ARMOR': '1.644', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '13.000'} [2024-08-05 22:40:11,210][52664] DAMAGECOUNT value on done: 10034.0 [2024-08-05 22:40:11,210][52664] Sum rewards: 4.358, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.527', 'AMMO2': '0.019', 'weapon7': '0.054', 'AMMO3': '0.084', 'ARMOR': '0.088', 'AMMO4': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'HITCOUNT': '0.520', 'WEAPON3': '0.600', 'weapon2': '0.662', 'weapon4': '0.762', 'weapon3': '1.664', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '3.000'} [2024-08-05 22:40:11,460][52650] Updated weights for policy 0, policy_version 9271 (0.0033) [2024-08-05 22:40:11,652][52667] DAMAGECOUNT value on done: 12414.0 [2024-08-05 22:40:11,654][52667] Sum rewards: 12.162, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.026', 'ARMOR': '0.036', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.127', 'weapon4': '0.150', 'HEALTH': '0.532', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'weapon2': '1.474', 'weapon3': '1.798', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:11,890][52795] DAMAGECOUNT value on done: 11443.0 [2024-08-05 22:40:11,891][52795] Sum rewards: 8.206, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.346', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '1.126', 'ARMOR': '1.300', 'weapon3': '1.762', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:12,091][52671] DAMAGECOUNT value on done: 12998.0 [2024-08-05 22:40:12,093][52671] Sum rewards: 14.490, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.794', 'AMMO2': '0.018', 'AMMO3': '0.076', 'AMMO4': '0.092', 'weapon4': '0.116', 'WEAPON4': '0.250', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'HITCOUNT': '1.180', 'weapon2': '1.412', 'weapon3': '1.488', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:12,127][52658] DAMAGECOUNT value on done: 12656.0 [2024-08-05 22:40:12,128][52658] Sum rewards: 8.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.734', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'weapon7': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'WEAPON7': '0.200', 'weapon4': '0.222', 'ARMOR': '0.481', 'HITCOUNT': '0.880', 'weapon2': '0.926', 'WEAPON3': '1.000', 'weapon3': '1.690', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:12,715][52662] DAMAGECOUNT value on done: 11935.0 [2024-08-05 22:40:12,715][52662] Sum rewards: 3.294, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.976', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'weapon4': '0.264', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'ARMOR': '0.918', 'weapon2': '1.412', 'weapon3': '1.782', 'DAMAGECOUNT': '2.265', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:12,771][52794] DAMAGECOUNT value on done: 14138.0 [2024-08-05 22:40:12,771][52794] Sum rewards: 8.026, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon4': '0.100', 'HEALTH': '0.238', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'HITCOUNT': '0.600', 'weapon3': '1.468', 'weapon2': '1.696', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 15911.9). Total num frames: 75964416. Throughput: 0: 4198.0. Samples: 18999520. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 22:40:12,794][52567] Avg episode reward: [(0, '10.315')] [2024-08-05 22:40:13,627][52649] DAMAGECOUNT value on done: 11145.0 [2024-08-05 22:40:13,628][52649] Sum rewards: 8.156, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.275', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.380', 'ARMOR': '0.497', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon3': '1.296', 'weapon2': '1.474', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:13,765][52663] DAMAGECOUNT value on done: 10262.0 [2024-08-05 22:40:13,768][52663] Sum rewards: 4.193, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.504', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.264', 'HITCOUNT': '0.390', 'WEAPON3': '0.550', 'weapon2': '1.344', 'weapon3': '1.402', 'DAMAGECOUNT': '1.437', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:14,127][52667] DAMAGECOUNT value on done: 11788.0 [2024-08-05 22:40:14,127][52667] Sum rewards: 7.020, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.706', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon2': '1.330', 'weapon3': '1.960', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:14,551][52664] DAMAGECOUNT value on done: 10942.0 [2024-08-05 22:40:14,551][52664] Sum rewards: 8.097, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.040', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.094', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.480', 'weapon4': '0.594', 'WEAPON3': '0.650', 'weapon2': '0.946', 'ARMOR': '0.951', 'weapon3': '1.480', 'DAMAGECOUNT': '1.572', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:14,878][52658] DAMAGECOUNT value on done: 10770.0 [2024-08-05 22:40:14,881][52658] Sum rewards: 7.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.533', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon7': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.800', 'weapon2': '0.988', 'weapon3': '1.750', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:15,138][52671] DAMAGECOUNT value on done: 10407.0 [2024-08-05 22:40:15,139][52671] Sum rewards: 7.038, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.063', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.152', 'WEAPON3': '0.350', 'ARMOR': '0.479', 'HITCOUNT': '0.640', 'weapon2': '0.786', 'weapon3': '1.294', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:15,153][52795] DAMAGECOUNT value on done: 9409.0 [2024-08-05 22:40:15,155][52795] Sum rewards: 11.287, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.175', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.078', 'ARMOR': '0.094', 'weapon7': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'weapon4': '0.614', 'HITCOUNT': '0.920', 'weapon2': '1.008', 'weapon3': '1.548', 'DAMAGECOUNT': '3.036', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:15,468][52662] DAMAGECOUNT value on done: 13176.0 [2024-08-05 22:40:15,468][52662] Sum rewards: 11.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.710', 'AMMO2': '0.024', 'AMMO3': '0.113', 'AMMO4': '0.118', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'ARMOR': '0.885', 'weapon2': '0.906', 'weapon4': '0.938', 'weapon3': '1.506', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:15,530][52794] DAMAGECOUNT value on done: 12778.0 [2024-08-05 22:40:15,530][52794] Sum rewards: 9.904, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.054', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'ARMOR': '1.420', 'weapon2': '1.508', 'weapon3': '1.918', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:16,170][52663] DAMAGECOUNT value on done: 9658.0 [2024-08-05 22:40:16,171][52663] Sum rewards: 6.103, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.488', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.105', 'weapon5': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.416', 'HITCOUNT': '0.470', 'WEAPON3': '0.700', 'weapon2': '1.254', 'weapon3': '1.514', 'DAMAGECOUNT': '1.590', 'ARMOR': '1.759', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:16,512][52650] Updated weights for policy 0, policy_version 9281 (0.0017) [2024-08-05 22:40:16,945][52649] DAMAGECOUNT value on done: 9736.0 [2024-08-05 22:40:16,945][52649] Sum rewards: 16.524, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.706', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.084', 'weapon7': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'HITCOUNT': '1.140', 'weapon2': '1.478', 'weapon3': '1.644', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '13.000'} [2024-08-05 22:40:17,371][52667] DAMAGECOUNT value on done: 11411.0 [2024-08-05 22:40:17,372][52667] Sum rewards: 19.415, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.930', 'AMMO2': '0.003', 'weapon4': '0.010', 'AMMO4': '0.013', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'ARMOR': '0.899', 'WEAPON3': '1.100', 'weapon2': '1.212', 'HITCOUNT': '1.470', 'weapon3': '2.242', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '18.000'} [2024-08-05 22:40:17,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16657.1, 300 sec: 15939.7). Total num frames: 76046336. Throughput: 0: 4198.4. Samples: 19012100. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 22:40:17,795][52567] Avg episode reward: [(0, '10.006')] [2024-08-05 22:40:17,920][52658] DAMAGECOUNT value on done: 9895.0 [2024-08-05 22:40:17,920][52658] Sum rewards: 8.762, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.023', 'ARMOR': '0.028', 'weapon7': '0.052', 'HEALTH': '0.070', 'AMMO3': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'WEAPON3': '0.450', 'weapon4': '0.458', 'HITCOUNT': '0.740', 'weapon2': '1.170', 'weapon3': '1.522', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:17,982][52662] DAMAGECOUNT value on done: 12645.0 [2024-08-05 22:40:17,983][52662] Sum rewards: 12.179, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.769', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.258', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.032', 'weapon3': '1.632', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:18,009][52671] DAMAGECOUNT value on done: 13154.0 [2024-08-05 22:40:18,011][52671] Sum rewards: 12.737, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.206', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon7': '0.048', 'AMMO3': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'HITCOUNT': '0.950', 'weapon3': '1.032', 'ARMOR': '1.200', 'weapon2': '1.686', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:18,072][52664] DAMAGECOUNT value on done: 11074.0 [2024-08-05 22:40:18,073][52664] Sum rewards: 9.550, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.076', 'WEAPON4': '0.250', 'weapon4': '0.458', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'ARMOR': '0.959', 'weapon2': '0.966', 'weapon3': '1.516', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:18,080][52794] DAMAGECOUNT value on done: 13706.0 [2024-08-05 22:40:18,081][52794] Sum rewards: 14.949, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.946', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.148', 'ARMOR': '0.444', 'WEAPON3': '0.900', 'HITCOUNT': '1.090', 'weapon2': '1.432', 'weapon3': '2.094', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '14.000'} [2024-08-05 22:40:18,445][52795] DAMAGECOUNT value on done: 10497.0 [2024-08-05 22:40:18,445][52795] Sum rewards: 8.161, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.140', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.051', 'WEAPON5': '0.150', 'WEAPON3': '0.350', 'HITCOUNT': '0.690', 'ARMOR': '0.836', 'weapon5': '0.836', 'weapon3': '0.976', 'weapon2': '1.756', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:19,208][52663] DAMAGECOUNT value on done: 11030.0 [2024-08-05 22:40:19,212][52663] Sum rewards: 11.621, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.292', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.115', 'WEAPON3': '0.750', 'ARMOR': '0.895', 'weapon2': '1.224', 'HITCOUNT': '1.310', 'weapon3': '2.290', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:19,559][52649] DAMAGECOUNT value on done: 10637.0 [2024-08-05 22:40:19,560][52649] Sum rewards: 9.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.679', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.288', 'ARMOR': '0.472', 'HITCOUNT': '0.740', 'WEAPON3': '0.850', 'weapon2': '1.520', 'weapon3': '1.886', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:20,110][52667] DAMAGECOUNT value on done: 11710.0 [2024-08-05 22:40:20,110][52667] Sum rewards: 15.605, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.163', 'weapon4': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'ARMOR': '0.434', 'WEAPON3': '0.950', 'weapon2': '1.062', 'HITCOUNT': '1.220', 'weapon3': '2.468', 'DAMAGECOUNT': '4.593', 'FRAGCOUNT': '14.000'} [2024-08-05 22:40:20,308][52820] DAMAGECOUNT value on done: 8662.0 [2024-08-05 22:40:20,309][52820] Sum rewards: 10.222, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.254', 'HEALTH': '0.255', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'ARMOR': '0.812', 'weapon2': '1.118', 'weapon3': '1.640', 'DAMAGECOUNT': '2.445', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:20,369][52662] DAMAGECOUNT value on done: 11968.0 [2024-08-05 22:40:20,370][52662] Sum rewards: 9.019, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'HEALTH': '0.007', 'ARMOR': '0.008', 'weapon4': '0.024', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '0.994', 'weapon3': '1.532', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:20,457][52794] DAMAGECOUNT value on done: 13767.0 [2024-08-05 22:40:20,457][52794] Sum rewards: 9.307, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.680', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.074', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON3': '0.550', 'HITCOUNT': '0.820', 'weapon3': '0.872', 'weapon2': '1.344', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:20,843][52658] DAMAGECOUNT value on done: 10685.0 [2024-08-05 22:40:20,845][52658] Sum rewards: 16.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.887', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.800', 'HITCOUNT': '1.240', 'ARMOR': '1.391', 'weapon2': '1.558', 'weapon3': '1.940', 'DAMAGECOUNT': '4.668', 'FRAGCOUNT': '13.000'} [2024-08-05 22:40:21,183][52664] DAMAGECOUNT value on done: 11737.0 [2024-08-05 22:40:21,183][52664] Sum rewards: 9.945, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.542', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.092', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.218', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon3': '1.436', 'weapon2': '1.486', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:21,328][52659] DAMAGECOUNT value on done: 10820.0 [2024-08-05 22:40:21,328][52659] Sum rewards: 6.180, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.109', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'weapon3': '1.444', 'weapon2': '1.474', 'DAMAGECOUNT': '2.064', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:21,357][52671] DAMAGECOUNT value on done: 11314.0 [2024-08-05 22:40:21,357][52671] Sum rewards: 5.890, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.899', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.430', 'WEAPON3': '0.450', 'weapon4': '0.714', 'weapon3': '1.054', 'weapon2': '1.108', 'DAMAGECOUNT': '1.581', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:21,484][52650] Updated weights for policy 0, policy_version 9291 (0.0012) [2024-08-05 22:40:22,537][52649] DAMAGECOUNT value on done: 10420.0 [2024-08-05 22:40:22,544][52649] Sum rewards: 5.706, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.416', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO4': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.348', 'WEAPON3': '0.400', 'HITCOUNT': '0.450', 'weapon2': '1.206', 'weapon3': '1.212', 'DAMAGECOUNT': '1.437', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:22,644][52662] DAMAGECOUNT value on done: 13829.0 [2024-08-05 22:40:22,645][52662] Sum rewards: 10.358, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.019', 'ARMOR': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '0.722', 'weapon3': '1.536', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 15995.2). Total num frames: 76136448. Throughput: 0: 4195.1. Samples: 19037270. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:40:22,794][52567] Avg episode reward: [(0, '9.881')] [2024-08-05 22:40:22,800][52794] DAMAGECOUNT value on done: 12635.0 [2024-08-05 22:40:22,800][52794] Sum rewards: 17.009, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.069', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.210', 'WEAPON3': '0.350', 'HEALTH': '0.626', 'ARMOR': '0.800', 'HITCOUNT': '0.930', 'weapon3': '1.206', 'weapon2': '1.530', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '12.000'} [2024-08-05 22:40:23,045][52667] DAMAGECOUNT value on done: 11453.0 [2024-08-05 22:40:23,045][52667] Sum rewards: 12.715, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.067', 'HEALTH': '0.214', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.870', 'weapon3': '1.258', 'weapon2': '1.296', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:23,647][52820] DAMAGECOUNT value on done: 10148.0 [2024-08-05 22:40:23,648][52820] Sum rewards: 5.300, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.693', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.188', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'weapon2': '1.350', 'weapon3': '1.516', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:23,665][52658] DAMAGECOUNT value on done: 11424.0 [2024-08-05 22:40:23,666][52658] Sum rewards: 12.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.232', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.070', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '1.220', 'weapon3': '1.450', 'weapon2': '1.956', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:24,155][52659] DAMAGECOUNT value on done: 11827.0 [2024-08-05 22:40:24,157][52659] Sum rewards: 11.427, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.596', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'weapon4': '0.250', 'ARMOR': '0.488', 'WEAPON3': '0.750', 'HITCOUNT': '0.840', 'weapon2': '1.224', 'weapon3': '1.698', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:24,176][52671] DAMAGECOUNT value on done: 11236.0 [2024-08-05 22:40:24,177][52671] Sum rewards: 9.086, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.019', 'ARMOR': '0.050', 'AMMO3': '0.065', 'AMMO4': '0.094', 'HEALTH': '0.330', 'WEAPON3': '0.400', 'HITCOUNT': '0.680', 'weapon3': '1.232', 'weapon2': '1.620', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:24,274][52664] DAMAGECOUNT value on done: 11126.0 [2024-08-05 22:40:24,277][52664] Sum rewards: 9.389, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.336', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.087', 'WEAPON3': '0.550', 'ARMOR': '0.899', 'HITCOUNT': '0.920', 'weapon3': '1.068', 'weapon2': '1.916', 'DAMAGECOUNT': '3.006', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:25,236][52662] DAMAGECOUNT value on done: 12521.0 [2024-08-05 22:40:25,238][52662] Sum rewards: 12.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.714', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon4': '0.392', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon2': '1.214', 'weapon3': '1.846', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:25,327][52794] DAMAGECOUNT value on done: 13651.0 [2024-08-05 22:40:25,327][52794] Sum rewards: 10.910, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.949', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon3': '1.772', 'weapon2': '1.774', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:25,779][52649] DAMAGECOUNT value on done: 11210.0 [2024-08-05 22:40:25,779][52649] Sum rewards: 12.596, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.133', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'ARMOR': '0.881', 'HITCOUNT': '0.890', 'weapon2': '1.420', 'weapon3': '1.424', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:26,150][52650] Updated weights for policy 0, policy_version 9301 (0.0014) [2024-08-05 22:40:26,238][52667] DAMAGECOUNT value on done: 10645.0 [2024-08-05 22:40:26,238][52667] Sum rewards: 4.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.093', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon4': '0.196', 'HITCOUNT': '0.780', 'weapon2': '0.964', 'WEAPON3': '1.050', 'ARMOR': '1.380', 'weapon3': '2.628', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:26,785][52658] DAMAGECOUNT value on done: 10811.0 [2024-08-05 22:40:26,786][52658] Sum rewards: 9.767, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.324', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.152', 'ARMOR': '0.521', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon3': '1.380', 'weapon2': '1.482', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:26,865][52671] DAMAGECOUNT value on done: 11781.0 [2024-08-05 22:40:26,866][52671] Sum rewards: 20.822, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.031', 'ARMOR': '0.032', 'HEALTH': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'WEAPON3': '0.550', 'HITCOUNT': '1.400', 'weapon2': '1.404', 'weapon3': '1.928', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '15.000'} [2024-08-05 22:40:26,874][52659] DAMAGECOUNT value on done: 11298.0 [2024-08-05 22:40:26,877][52659] Sum rewards: 10.113, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.714', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'ARMOR': '0.460', 'weapon4': '0.510', 'weapon2': '0.650', 'HITCOUNT': '0.770', 'WEAPON3': '0.950', 'weapon3': '1.702', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:26,909][52820] DAMAGECOUNT value on done: 10154.0 [2024-08-05 22:40:26,912][52820] Sum rewards: 7.270, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.442', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.087', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.502', 'HITCOUNT': '0.530', 'weapon2': '0.858', 'ARMOR': '0.956', 'weapon3': '1.202', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '4.500'} [2024-08-05 22:40:27,520][52664] DAMAGECOUNT value on done: 12365.0 [2024-08-05 22:40:27,522][52664] Sum rewards: 11.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.092', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'weapon4': '0.362', 'WEAPON3': '0.700', 'HITCOUNT': '1.170', 'weapon2': '1.196', 'weapon3': '1.910', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 15995.5). Total num frames: 76218368. Throughput: 0: 4188.7. Samples: 19062540. Policy #0 lag: (min: 1.0, avg: 4.5, max: 8.0) [2024-08-05 22:40:27,794][52567] Avg episode reward: [(0, '10.111')] [2024-08-05 22:40:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009304_76218368.pth... [2024-08-05 22:40:27,898][52662] DAMAGECOUNT value on done: 13278.0 [2024-08-05 22:40:27,898][52662] Sum rewards: 14.307, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.195', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.081', 'weapon4': '0.222', 'WEAPON3': '0.550', 'ARMOR': '0.881', 'HITCOUNT': '0.950', 'weapon2': '0.988', 'weapon3': '1.636', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:27,936][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000008840_72417280.pth [2024-08-05 22:40:28,061][52794] DAMAGECOUNT value on done: 12901.0 [2024-08-05 22:40:28,062][52794] Sum rewards: 11.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.594', 'AMMO2': '0.015', 'AMMO4': '0.073', 'ARMOR': '0.080', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.410', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.270', 'weapon3': '2.012', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '14.000'} [2024-08-05 22:40:28,874][52649] DAMAGECOUNT value on done: 11495.0 [2024-08-05 22:40:28,876][52649] Sum rewards: 10.281, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.087', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.933', 'HITCOUNT': '1.280', 'weapon2': '1.450', 'weapon3': '1.726', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:29,248][52667] DAMAGECOUNT value on done: 11500.0 [2024-08-05 22:40:29,248][52667] Sum rewards: 6.143, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.060', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.263', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'HITCOUNT': '0.740', 'weapon3': '1.256', 'weapon2': '2.142', 'DAMAGECOUNT': '2.442', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:29,840][52658] DAMAGECOUNT value on done: 11226.0 [2024-08-05 22:40:29,844][52658] Sum rewards: 17.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.514', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.086', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon3': '1.394', 'weapon2': '1.636', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '14.000'} [2024-08-05 22:40:29,915][52664] DAMAGECOUNT value on done: 11457.0 [2024-08-05 22:40:29,916][52664] Sum rewards: 10.912, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.235', 'AMMO2': '0.021', 'AMMO3': '0.072', 'AMMO4': '0.105', 'WEAPON4': '0.250', 'weapon4': '0.394', 'ARMOR': '0.489', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon2': '0.964', 'weapon3': '1.596', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:30,280][52820] DAMAGECOUNT value on done: 11556.0 [2024-08-05 22:40:30,282][52820] Sum rewards: 9.747, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.516', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.026', 'weapon7': '0.068', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.488', 'weapon4': '0.594', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.126', 'weapon3': '1.764', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:30,398][52671] DAMAGECOUNT value on done: 11629.0 [2024-08-05 22:40:30,398][52671] Sum rewards: 6.664, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.024', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.268', 'ARMOR': '0.458', 'WEAPON3': '0.550', 'HITCOUNT': '0.560', 'weapon2': '1.210', 'weapon3': '1.238', 'DAMAGECOUNT': '2.049', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:30,401][52659] DAMAGECOUNT value on done: 11647.0 [2024-08-05 22:40:30,404][52659] Sum rewards: 9.870, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.046', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.250', 'WEAPON3': '0.300', 'HITCOUNT': '0.690', 'weapon4': '0.696', 'ARMOR': '0.916', 'weapon3': '1.198', 'weapon2': '1.442', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:30,554][52662] DAMAGECOUNT value on done: 13382.0 [2024-08-05 22:40:30,554][52662] Sum rewards: 10.471, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.225', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.060', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.348', 'weapon4': '0.408', 'WEAPON3': '0.600', 'weapon2': '0.648', 'HITCOUNT': '1.040', 'weapon3': '1.084', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:31,172][52650] Updated weights for policy 0, policy_version 9311 (0.0014) [2024-08-05 22:40:32,009][52649] DAMAGECOUNT value on done: 9801.0 [2024-08-05 22:40:32,011][52649] Sum rewards: 11.420, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.039', 'WEAPON5': '0.050', 'HEALTH': '0.054', 'AMMO3': '0.100', 'AMMO4': '0.111', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.604', 'weapon3': '1.778', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 15967.5). Total num frames: 76300288. Throughput: 0: 4180.7. Samples: 19074820. Policy #0 lag: (min: 1.0, avg: 4.5, max: 8.0) [2024-08-05 22:40:32,794][52567] Avg episode reward: [(0, '10.316')] [2024-08-05 22:40:32,892][52658] DAMAGECOUNT value on done: 11831.0 [2024-08-05 22:40:32,892][52658] Sum rewards: 17.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.648', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.122', 'AMMO3': '0.161', 'ARMOR': '0.492', 'WEAPON3': '1.000', 'weapon2': '1.246', 'HITCOUNT': '1.310', 'weapon3': '2.344', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '16.000'} [2024-08-05 22:40:32,955][52664] DAMAGECOUNT value on done: 11235.0 [2024-08-05 22:40:32,956][52664] Sum rewards: 4.830, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.136', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.044', 'ARMOR': '0.048', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.532', 'HITCOUNT': '0.850', 'weapon2': '0.946', 'WEAPON3': '0.950', 'weapon3': '1.778', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:33,092][52662] DAMAGECOUNT value on done: 12156.0 [2024-08-05 22:40:33,095][52662] Sum rewards: 12.576, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.536', 'weapon4': '0.004', 'AMMO2': '0.026', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'ARMOR': '0.480', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.422', 'weapon3': '1.782', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:33,194][52671] DAMAGECOUNT value on done: 11064.0 [2024-08-05 22:40:33,194][52671] Sum rewards: 4.436, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.230', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.464', 'ARMOR': '0.492', 'HITCOUNT': '0.610', 'WEAPON3': '0.700', 'weapon2': '1.180', 'weapon3': '1.582', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:33,220][52659] DAMAGECOUNT value on done: 10086.0 [2024-08-05 22:40:33,221][52659] Sum rewards: 12.414, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.152', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.936', 'HITCOUNT': '1.010', 'weapon2': '1.428', 'weapon3': '2.204', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:33,665][52820] DAMAGECOUNT value on done: 10481.0 [2024-08-05 22:40:33,669][52820] Sum rewards: 5.233, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.742', 'AMMO2': '0.000', 'AMMO4': '0.000', 'ARMOR': '0.008', 'AMMO3': '0.103', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.102', 'weapon3': '1.722', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:34,497][52649] DAMAGECOUNT value on done: 12771.0 [2024-08-05 22:40:34,498][52649] Sum rewards: 11.525, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.266', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'ARMOR': '0.480', 'weapon4': '0.488', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '0.898', 'weapon3': '1.928', 'DAMAGECOUNT': '3.201', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:36,121][52650] Updated weights for policy 0, policy_version 9321 (0.0018) [2024-08-05 22:40:36,215][52664] DAMAGECOUNT value on done: 9772.0 [2024-08-05 22:40:36,218][52664] Sum rewards: 5.194, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.642', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'weapon4': '0.458', 'HITCOUNT': '0.690', 'ARMOR': '0.903', 'weapon2': '0.912', 'WEAPON3': '0.950', 'weapon3': '1.958', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:36,364][52658] DAMAGECOUNT value on done: 11195.0 [2024-08-05 22:40:36,364][52658] Sum rewards: 12.945, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.320', 'AMMO2': '0.033', 'AMMO3': '0.090', 'AMMO4': '0.164', 'WEAPON4': '0.350', 'ARMOR': '0.532', 'WEAPON3': '0.600', 'weapon2': '0.768', 'weapon4': '0.774', 'HITCOUNT': '0.980', 'weapon3': '1.806', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:36,642][52671] DAMAGECOUNT value on done: 11971.0 [2024-08-05 22:40:36,642][52671] Sum rewards: 8.693, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.159', 'AMMO4': '-0.092', 'AMMO2': '-0.018', 'AMMO5': '0.007', 'AMMO3': '0.050', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon5': '0.360', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'weapon3': '1.182', 'ARMOR': '1.717', 'weapon2': '1.906', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:36,708][52659] DAMAGECOUNT value on done: 11449.0 [2024-08-05 22:40:36,708][52659] Sum rewards: 7.738, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.727', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.066', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.500', 'ARMOR': '0.516', 'HITCOUNT': '0.640', 'weapon2': '0.884', 'weapon3': '1.224', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:36,955][52820] DAMAGECOUNT value on done: 12521.0 [2024-08-05 22:40:36,955][52820] Sum rewards: 15.660, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.535', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'ARMOR': '0.032', 'weapon5': '0.074', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.650', 'weapon2': '1.022', 'HITCOUNT': '1.040', 'weapon3': '1.784', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '13.000'} [2024-08-05 22:40:37,223][52649] DAMAGECOUNT value on done: 10223.0 [2024-08-05 22:40:37,224][52649] Sum rewards: 10.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.939', 'weapon4': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '0.970', 'weapon3': '2.066', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 15968.0). Total num frames: 76382208. Throughput: 0: 4182.0. Samples: 19100020. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:40:37,794][52567] Avg episode reward: [(0, '10.259')] [2024-08-05 22:40:39,000][52671] DAMAGECOUNT value on done: 12703.0 [2024-08-05 22:40:39,002][52671] Sum rewards: 17.190, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.252', 'ARMOR': '0.506', 'WEAPON3': '0.750', 'weapon2': '1.142', 'HITCOUNT': '1.300', 'weapon3': '2.302', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '13.000'} [2024-08-05 22:40:39,074][52659] DAMAGECOUNT value on done: 11145.0 [2024-08-05 22:40:39,076][52659] Sum rewards: 6.608, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.563', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '1.419', 'weapon3': '1.502', 'weapon2': '2.128', 'DAMAGECOUNT': '3.024', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:39,472][52658] DAMAGECOUNT value on done: 12355.0 [2024-08-05 22:40:39,473][52658] Sum rewards: 12.077, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.485', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.210', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'HITCOUNT': '0.980', 'weapon2': '1.722', 'weapon3': '1.740', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:39,586][52664] DAMAGECOUNT value on done: 10972.0 [2024-08-05 22:40:39,587][52664] Sum rewards: 16.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.146', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.126', 'WEAPON3': '0.550', 'ARMOR': '0.826', 'HITCOUNT': '1.140', 'weapon2': '1.512', 'weapon3': '1.634', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '12.000'} [2024-08-05 22:40:40,148][52649] DAMAGECOUNT value on done: 10315.0 [2024-08-05 22:40:40,149][52649] Sum rewards: 4.196, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.050', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.002', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon3': '1.356', 'weapon2': '1.566', 'DAMAGECOUNT': '1.590', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:40,462][52820] DAMAGECOUNT value on done: 8800.0 [2024-08-05 22:40:40,465][52820] Sum rewards: 10.062, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.196', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.516', 'weapon4': '0.518', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '0.948', 'weapon3': '1.578', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:41,040][52650] Updated weights for policy 0, policy_version 9331 (0.0027) [2024-08-05 22:40:42,161][52671] DAMAGECOUNT value on done: 10888.0 [2024-08-05 22:40:42,164][52671] Sum rewards: 3.582, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.966', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.024', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'ARMOR': '0.531', 'HITCOUNT': '0.670', 'WEAPON3': '0.800', 'weapon2': '1.266', 'weapon3': '1.812', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '3.000'} [2024-08-05 22:40:42,255][52659] DAMAGECOUNT value on done: 9854.0 [2024-08-05 22:40:42,255][52659] Sum rewards: 9.843, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.645', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.016', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.148', 'WEAPON7': '0.200', 'ARMOR': '0.556', 'WEAPON3': '0.800', 'HITCOUNT': '0.820', 'weapon2': '1.058', 'weapon3': '1.904', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:42,504][52664] DAMAGECOUNT value on done: 9793.0 [2024-08-05 22:40:42,505][52664] Sum rewards: 10.699, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.014', 'AMMO3': '0.050', 'HEALTH': '0.064', 'AMMO4': '0.072', 'ARMOR': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.232', 'WEAPON3': '0.350', 'HITCOUNT': '0.600', 'weapon2': '1.022', 'weapon3': '1.182', 'DAMAGECOUNT': '1.941', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:42,507][52658] DAMAGECOUNT value on done: 12436.0 [2024-08-05 22:40:42,509][52658] Sum rewards: 19.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.352', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.008', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'ARMOR': '0.849', 'WEAPON3': '0.850', 'HITCOUNT': '1.340', 'weapon2': '1.512', 'weapon3': '2.204', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '18.000'} [2024-08-05 22:40:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.1, 300 sec: 15967.5). Total num frames: 76472320. Throughput: 0: 4197.6. Samples: 19125510. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:40:42,794][52567] Avg episode reward: [(0, '10.408')] [2024-08-05 22:40:42,837][52649] DAMAGECOUNT value on done: 12011.0 [2024-08-05 22:40:42,837][52649] Sum rewards: 3.009, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.681', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.214', 'HITCOUNT': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.480', 'weapon3': '0.928', 'weapon2': '1.000', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '2.000'} [2024-08-05 22:40:43,889][52820] DAMAGECOUNT value on done: 10858.0 [2024-08-05 22:40:43,889][52820] Sum rewards: 11.495, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.031', 'ARMOR': '0.032', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'HEALTH': '0.304', 'WEAPON3': '0.400', 'weapon4': '0.808', 'HITCOUNT': '1.030', 'weapon2': '1.090', 'weapon3': '1.340', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:45,408][52671] DAMAGECOUNT value on done: 11594.0 [2024-08-05 22:40:45,409][52671] Sum rewards: 7.828, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.103', 'weapon4': '0.218', 'ARMOR': '0.440', 'HEALTH': '0.442', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '1.044', 'weapon3': '1.474', 'DAMAGECOUNT': '2.613', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:45,439][52659] DAMAGECOUNT value on done: 11595.0 [2024-08-05 22:40:45,440][52659] Sum rewards: 13.731, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.070', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.450', 'HEALTH': '0.479', 'HITCOUNT': '0.970', 'weapon2': '1.148', 'weapon3': '1.326', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:45,500][52649] DAMAGECOUNT value on done: 10213.0 [2024-08-05 22:40:45,502][52649] Sum rewards: 10.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.470', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.252', 'ARMOR': '0.424', 'WEAPON3': '0.750', 'HITCOUNT': '1.140', 'weapon2': '1.492', 'weapon3': '1.900', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:45,602][52664] DAMAGECOUNT value on done: 11543.0 [2024-08-05 22:40:45,602][52664] Sum rewards: 8.816, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.664', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.029', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'ARMOR': '0.860', 'weapon3': '1.686', 'weapon2': '1.858', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:45,641][52650] Updated weights for policy 0, policy_version 9341 (0.0024) [2024-08-05 22:40:45,950][52658] DAMAGECOUNT value on done: 10932.0 [2024-08-05 22:40:45,950][52658] Sum rewards: 9.751, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.299', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.222', 'ARMOR': '0.468', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.128', 'weapon3': '2.222', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:47,114][52820] DAMAGECOUNT value on done: 9844.0 [2024-08-05 22:40:47,116][52820] Sum rewards: 11.070, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.340', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.004', 'weapon7': '0.052', 'weapon5': '0.072', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon3': '1.290', 'ARMOR': '1.354', 'weapon2': '1.388', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '7.500'} [2024-08-05 22:40:47,794][52567] Fps is (10 sec: 17202.6, 60 sec: 16793.5, 300 sec: 15995.2). Total num frames: 76554240. Throughput: 0: 4200.2. Samples: 19137960. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:40:47,795][52567] Avg episode reward: [(0, '10.367')] [2024-08-05 22:40:48,039][52664] DAMAGECOUNT value on done: 8807.0 [2024-08-05 22:40:48,040][52664] Sum rewards: 3.999, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.014', 'ARMOR': '0.020', 'AMMO4': '0.032', 'weapon7': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'HITCOUNT': '0.450', 'weapon4': '0.526', 'weapon2': '0.622', 'WEAPON3': '0.650', 'DAMAGECOUNT': '1.512', 'weapon3': '1.514', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:48,537][52671] DAMAGECOUNT value on done: 13244.0 [2024-08-05 22:40:48,538][52671] Sum rewards: 10.150, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.280', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.139', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'HITCOUNT': '1.040', 'weapon2': '1.404', 'weapon3': '1.930', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:48,604][52659] DAMAGECOUNT value on done: 11701.0 [2024-08-05 22:40:48,605][52659] Sum rewards: 6.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.280', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO3': '0.098', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'ARMOR': '0.899', 'weapon3': '1.478', 'weapon2': '1.596', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:48,606][52649] DAMAGECOUNT value on done: 12521.0 [2024-08-05 22:40:48,607][52649] Sum rewards: 9.441, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.230', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'weapon5': '0.022', 'ARMOR': '0.032', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON3': '0.900', 'HITCOUNT': '0.940', 'weapon2': '1.284', 'weapon3': '1.830', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:49,066][52658] DAMAGECOUNT value on done: 10548.0 [2024-08-05 22:40:49,067][52658] Sum rewards: 10.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.144', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'ARMOR': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'weapon4': '0.406', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '0.864', 'weapon3': '2.472', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:50,438][52820] DAMAGECOUNT value on done: 11289.0 [2024-08-05 22:40:50,440][52820] Sum rewards: 9.828, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.402', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.504', 'ARMOR': '0.526', 'WEAPON3': '0.850', 'HITCOUNT': '1.050', 'weapon2': '1.128', 'weapon3': '1.808', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:50,646][52650] Updated weights for policy 0, policy_version 9351 (0.0024) [2024-08-05 22:40:51,154][52649] DAMAGECOUNT value on done: 11661.0 [2024-08-05 22:40:51,155][52649] Sum rewards: 19.184, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.118', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.230', 'weapon2': '0.682', 'WEAPON3': '1.050', 'HITCOUNT': '1.530', 'weapon3': '2.710', 'DAMAGECOUNT': '5.394', 'FRAGCOUNT': '18.000'} [2024-08-05 22:40:51,245][52671] DAMAGECOUNT value on done: 10386.0 [2024-08-05 22:40:51,245][52671] Sum rewards: 4.324, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.769', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.181', 'HITCOUNT': '0.850', 'ARMOR': '0.864', 'weapon2': '1.134', 'WEAPON3': '1.200', 'weapon3': '1.786', 'DAMAGECOUNT': '3.102', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:51,302][52659] DAMAGECOUNT value on done: 11670.0 [2024-08-05 22:40:51,303][52659] Sum rewards: 8.508, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.326', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon7': '0.048', 'AMMO3': '0.049', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'weapon3': '0.734', 'ARMOR': '0.900', 'weapon2': '0.988', 'DAMAGECOUNT': '1.950', 'FRAGCOUNT': '5.000'} [2024-08-05 22:40:51,599][52664] DAMAGECOUNT value on done: 10820.0 [2024-08-05 22:40:51,600][52664] Sum rewards: 11.647, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.611', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'AMMO3': '0.117', 'weapon4': '0.146', 'WEAPON3': '0.750', 'ARMOR': '0.885', 'HITCOUNT': '1.050', 'weapon2': '1.192', 'weapon3': '2.020', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:52,101][52658] DAMAGECOUNT value on done: 11646.0 [2024-08-05 22:40:52,101][52658] Sum rewards: 13.371, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.286', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON3': '0.450', 'ARMOR': '0.879', 'HITCOUNT': '0.900', 'weapon3': '1.280', 'weapon2': '1.396', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '10.000'} [2024-08-05 22:40:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 15995.2). Total num frames: 76636160. Throughput: 0: 4189.6. Samples: 19163140. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:40:52,794][52567] Avg episode reward: [(0, '10.306')] [2024-08-05 22:40:53,740][52820] DAMAGECOUNT value on done: 9648.0 [2024-08-05 22:40:53,740][52820] Sum rewards: 10.260, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.060', 'HEALTH': '0.064', 'WEAPON3': '0.400', 'HITCOUNT': '0.960', 'weapon3': '1.440', 'ARMOR': '1.763', 'weapon2': '2.210', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '6.000'} [2024-08-05 22:40:54,029][52671] DAMAGECOUNT value on done: 10921.0 [2024-08-05 22:40:54,030][52671] Sum rewards: 10.899, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.648', 'AMMO2': '0.009', 'ARMOR': '0.036', 'AMMO4': '0.047', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.430', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '0.930', 'weapon3': '1.592', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:54,057][52659] DAMAGECOUNT value on done: 11454.0 [2024-08-05 22:40:54,057][52659] Sum rewards: 11.473, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.699', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.094', 'WEAPON3': '0.650', 'ARMOR': '0.907', 'HITCOUNT': '0.930', 'weapon2': '1.276', 'weapon3': '1.524', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:54,429][52664] DAMAGECOUNT value on done: 10788.0 [2024-08-05 22:40:54,430][52664] Sum rewards: 6.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.318', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.170', 'ARMOR': '0.523', 'WEAPON3': '0.950', 'HITCOUNT': '0.990', 'weapon2': '1.632', 'weapon3': '1.788', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '8.000'} [2024-08-05 22:40:54,467][52649] DAMAGECOUNT value on done: 12235.0 [2024-08-05 22:40:54,467][52649] Sum rewards: 14.247, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.052', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.352', 'ARMOR': '0.485', 'WEAPON3': '0.700', 'HITCOUNT': '1.120', 'weapon2': '1.208', 'weapon3': '1.578', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '12.000'} [2024-08-05 22:40:54,480][52666] DAMAGECOUNT value on done: 10782.0 [2024-08-05 22:40:54,483][52666] Sum rewards: 8.922, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.530', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.007', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.166', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.166', 'weapon3': '2.084', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:55,486][52650] Updated weights for policy 0, policy_version 9361 (0.0042) [2024-08-05 22:40:56,958][52820] DAMAGECOUNT value on done: 9856.0 [2024-08-05 22:40:56,959][52820] Sum rewards: 4.436, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.726', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.050', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'weapon4': '0.444', 'HITCOUNT': '0.620', 'weapon2': '1.070', 'weapon3': '1.180', 'DAMAGECOUNT': '1.956', 'FRAGCOUNT': '3.000'} [2024-08-05 22:40:57,094][52664] DAMAGECOUNT value on done: 10669.0 [2024-08-05 22:40:57,096][52664] Sum rewards: 10.273, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.118', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.066', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '0.810', 'weapon3': '1.202', 'weapon2': '1.582', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:57,111][52670] DAMAGECOUNT value on done: 12251.0 [2024-08-05 22:40:57,115][52670] Sum rewards: 7.936, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.086', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon5': '0.058', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.346', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'ARMOR': '0.996', 'weapon2': '1.310', 'weapon3': '1.570', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '7.000'} [2024-08-05 22:40:57,460][52671] DAMAGECOUNT value on done: 11306.0 [2024-08-05 22:40:57,461][52671] Sum rewards: 10.827, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.085', 'AMMO3': '0.098', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '0.900', 'ARMOR': '0.935', 'weapon3': '2.012', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '9.000'} [2024-08-05 22:40:57,499][52659] DAMAGECOUNT value on done: 10806.0 [2024-08-05 22:40:57,499][52659] Sum rewards: 6.317, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.176', 'AMMO2': '0.016', 'AMMO3': '0.064', 'AMMO4': '0.080', 'WEAPON3': '0.350', 'HITCOUNT': '0.770', 'weapon3': '0.860', 'ARMOR': '0.909', 'weapon2': '1.574', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '4.000'} [2024-08-05 22:40:57,627][52666] DAMAGECOUNT value on done: 10252.0 [2024-08-05 22:40:57,627][52666] Sum rewards: 15.513, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.267', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.078', 'WEAPON3': '0.500', 'ARMOR': '0.860', 'HITCOUNT': '1.000', 'weapon3': '1.444', 'weapon2': '1.590', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '11.000'} [2024-08-05 22:40:57,794][52567] Fps is (10 sec: 16384.6, 60 sec: 16657.1, 300 sec: 16023.0). Total num frames: 76718080. Throughput: 0: 4203.1. Samples: 19188660. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:40:57,794][52567] Avg episode reward: [(0, '10.418')] [2024-08-05 22:40:59,432][52664] DAMAGECOUNT value on done: 12236.0 [2024-08-05 22:40:59,432][52664] Sum rewards: 13.415, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.004', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.090', 'weapon4': '0.262', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.378', 'weapon3': '1.766', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:00,322][52650] Updated weights for policy 0, policy_version 9371 (0.0039) [2024-08-05 22:41:00,323][52670] DAMAGECOUNT value on done: 10669.0 [2024-08-05 22:41:00,324][52670] Sum rewards: 9.163, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.820', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'weapon7': '0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.959', 'HITCOUNT': '0.970', 'weapon3': '1.514', 'weapon2': '1.602', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:00,384][52820] DAMAGECOUNT value on done: 10486.0 [2024-08-05 22:41:00,384][52820] Sum rewards: 7.647, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.328', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon5': '0.014', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.232', 'WEAPON3': '0.600', 'HITCOUNT': '0.710', 'weapon3': '1.152', 'ARMOR': '1.372', 'weapon2': '1.492', 'DAMAGECOUNT': '2.346', 'FRAGCOUNT': '5.000'} [2024-08-05 22:41:00,488][52671] DAMAGECOUNT value on done: 10900.0 [2024-08-05 22:41:00,489][52671] Sum rewards: 12.823, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO3': '0.163', 'ARMOR': '0.429', 'WEAPON3': '1.050', 'HITCOUNT': '1.130', 'weapon2': '1.462', 'weapon3': '2.120', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '13.000'} [2024-08-05 22:41:00,541][52659] DAMAGECOUNT value on done: 12131.0 [2024-08-05 22:41:00,548][52659] Sum rewards: 4.812, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.884', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.022', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '0.986', 'ARMOR': '0.994', 'weapon3': '1.816', 'DAMAGECOUNT': '2.451', 'FRAGCOUNT': '6.000'} [2024-08-05 22:41:01,031][52666] DAMAGECOUNT value on done: 10668.0 [2024-08-05 22:41:01,033][52666] Sum rewards: 9.630, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.284', 'AMMO2': '0.021', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon4': '0.336', 'ARMOR': '0.548', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.332', 'weapon3': '1.480', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16023.0). Total num frames: 76808192. Throughput: 0: 4207.1. Samples: 19201420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:41:02,794][52567] Avg episode reward: [(0, '10.217')] [2024-08-05 22:41:03,018][52670] DAMAGECOUNT value on done: 9712.0 [2024-08-05 22:41:03,019][52670] Sum rewards: 8.568, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.163', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.140', 'weapon4': '0.482', 'ARMOR': '0.508', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'weapon2': '1.010', 'weapon3': '1.654', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:03,437][52671] DAMAGECOUNT value on done: 12830.0 [2024-08-05 22:41:03,438][52671] Sum rewards: 7.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.477', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'AMMO3': '0.102', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'weapon2': '1.378', 'weapon3': '1.624', 'ARMOR': '1.856', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '6.000'} [2024-08-05 22:41:03,489][52659] DAMAGECOUNT value on done: 11966.0 [2024-08-05 22:41:03,490][52659] Sum rewards: 13.050, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'weapon4': '0.558', 'WEAPON3': '0.800', 'weapon2': '0.930', 'HITCOUNT': '0.990', 'weapon3': '1.860', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:03,541][52666] DAMAGECOUNT value on done: 10894.0 [2024-08-05 22:41:03,543][52666] Sum rewards: 6.143, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.038', 'AMMO2': '0.025', 'AMMO3': '0.087', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'ARMOR': '0.551', 'WEAPON3': '0.600', 'weapon4': '0.744', 'weapon2': '0.852', 'weapon3': '1.660', 'DAMAGECOUNT': '1.827', 'FRAGCOUNT': '5.000'} [2024-08-05 22:41:03,824][52820] DAMAGECOUNT value on done: 9249.0 [2024-08-05 22:41:03,825][52820] Sum rewards: 14.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.674', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.300', 'ARMOR': '0.472', 'weapon4': '0.574', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.102', 'weapon3': '1.816', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:04,651][52668] DAMAGECOUNT value on done: 10638.0 [2024-08-05 22:41:04,651][52668] Sum rewards: 6.119, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.286', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.068', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.230', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'weapon2': '0.846', 'ARMOR': '0.944', 'weapon3': '1.082', 'DAMAGECOUNT': '1.560', 'FRAGCOUNT': '5.000'} [2024-08-05 22:41:04,921][52650] Updated weights for policy 0, policy_version 9381 (0.0022) [2024-08-05 22:41:06,118][52670] DAMAGECOUNT value on done: 10882.0 [2024-08-05 22:41:06,121][52670] Sum rewards: 7.811, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'weapon4': '0.164', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon3': '1.554', 'ARMOR': '1.826', 'weapon2': '2.094', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:06,417][52671] DAMAGECOUNT value on done: 10570.0 [2024-08-05 22:41:06,417][52671] Sum rewards: 10.364, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.029', 'AMMO3': '0.066', 'weapon7': '0.076', 'HEALTH': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'ARMOR': '0.504', 'weapon2': '0.530', 'HITCOUNT': '0.560', 'weapon4': '0.658', 'weapon3': '1.286', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:06,479][52659] DAMAGECOUNT value on done: 12802.0 [2024-08-05 22:41:06,483][52659] Sum rewards: 15.774, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.827', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.324', 'WEAPON3': '0.850', 'ARMOR': '0.952', 'HITCOUNT': '1.010', 'weapon2': '1.416', 'weapon3': '1.788', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '14.000'} [2024-08-05 22:41:06,870][52666] DAMAGECOUNT value on done: 10573.0 [2024-08-05 22:41:06,871][52666] Sum rewards: 0.988, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.309', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.066', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.430', 'HITCOUNT': '0.650', 'weapon2': '0.758', 'WEAPON3': '1.000', 'weapon3': '1.664', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '4.000'} [2024-08-05 22:41:07,179][52820] DAMAGECOUNT value on done: 10084.0 [2024-08-05 22:41:07,182][52820] Sum rewards: 9.798, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.036', 'AMMO4': '0.056', 'AMMO3': '0.063', 'WEAPON4': '0.150', 'weapon4': '0.252', 'WEAPON3': '0.500', 'HITCOUNT': '0.630', 'weapon2': '0.964', 'weapon3': '1.384', 'DAMAGECOUNT': '2.067', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:07,434][52668] DAMAGECOUNT value on done: 13253.0 [2024-08-05 22:41:07,436][52668] Sum rewards: 12.133, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.724', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO3': '0.108', 'ARMOR': '0.516', 'WEAPON3': '0.750', 'HITCOUNT': '1.170', 'weapon2': '1.358', 'weapon3': '1.838', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.7, 300 sec: 16023.0). Total num frames: 76890112. Throughput: 0: 4208.7. Samples: 19226660. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:41:07,795][52567] Avg episode reward: [(0, '10.173')] [2024-08-05 22:41:09,394][52670] DAMAGECOUNT value on done: 9555.0 [2024-08-05 22:41:09,398][52670] Sum rewards: 10.221, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.028', 'weapon4': '0.032', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.443', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon2': '1.304', 'weapon3': '1.664', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:09,850][52671] DAMAGECOUNT value on done: 12560.0 [2024-08-05 22:41:09,851][52671] Sum rewards: 15.017, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.855', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.244', 'ARMOR': '0.575', 'WEAPON3': '0.700', 'HITCOUNT': '1.170', 'weapon2': '1.294', 'weapon3': '2.152', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '11.000'} [2024-08-05 22:41:09,908][52659] DAMAGECOUNT value on done: 10915.0 [2024-08-05 22:41:09,910][52659] Sum rewards: 8.174, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.865', 'AMMO2': '0.001', 'AMMO4': '0.002', 'ARMOR': '0.036', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.358', 'WEAPON3': '0.450', 'HITCOUNT': '0.590', 'weapon3': '1.260', 'weapon2': '1.356', 'DAMAGECOUNT': '2.022', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:10,151][52666] DAMAGECOUNT value on done: 9614.0 [2024-08-05 22:41:10,153][52666] Sum rewards: 3.185, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.239', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'ARMOR': '0.033', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.218', 'HITCOUNT': '0.480', 'WEAPON3': '0.700', 'weapon2': '0.924', 'weapon3': '1.306', 'DAMAGECOUNT': '1.875', 'FRAGCOUNT': '4.000'} [2024-08-05 22:41:10,260][52650] Updated weights for policy 0, policy_version 9391 (0.0021) [2024-08-05 22:41:10,455][52668] DAMAGECOUNT value on done: 10491.0 [2024-08-05 22:41:10,459][52668] Sum rewards: 14.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.401', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'ARMOR': '0.470', 'WEAPON3': '0.700', 'HITCOUNT': '1.170', 'weapon2': '1.326', 'weapon3': '1.604', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:10,730][52660] DAMAGECOUNT value on done: 11642.0 [2024-08-05 22:41:10,730][52660] Sum rewards: 11.424, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.880', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.236', 'WEAPON3': '0.700', 'ARMOR': '0.936', 'HITCOUNT': '1.140', 'weapon2': '1.434', 'weapon3': '1.790', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:10,736][52820] DAMAGECOUNT value on done: 11106.0 [2024-08-05 22:41:10,737][52820] Sum rewards: 10.004, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.702', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.088', 'WEAPON4': '0.250', 'weapon4': '0.334', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.372', 'weapon3': '1.662', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 16050.8). Total num frames: 76980224. Throughput: 0: 4206.0. Samples: 19251810. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:41:12,795][52567] Avg episode reward: [(0, '10.117')] [2024-08-05 22:41:12,853][52670] DAMAGECOUNT value on done: 11476.0 [2024-08-05 22:41:12,855][52670] Sum rewards: 10.234, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.119', 'HEALTH': '0.132', 'weapon4': '0.292', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '0.873', 'weapon2': '1.160', 'weapon3': '2.018', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '9.000'} [2024-08-05 22:41:13,195][52659] DAMAGECOUNT value on done: 10905.0 [2024-08-05 22:41:13,197][52659] Sum rewards: 17.032, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.106', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.038', 'weapon4': '0.042', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'WEAPON3': '0.850', 'ARMOR': '0.910', 'HITCOUNT': '1.170', 'weapon2': '1.342', 'weapon3': '2.322', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '15.000'} [2024-08-05 22:41:13,354][52668] DAMAGECOUNT value on done: 10293.0 [2024-08-05 22:41:13,356][52668] Sum rewards: 9.982, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.288', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.418', 'weapon4': '0.458', 'WEAPON3': '0.850', 'weapon2': '0.958', 'HITCOUNT': '1.020', 'ARMOR': '1.297', 'weapon3': '1.696', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '9.000'} [2024-08-05 22:41:13,611][52660] DAMAGECOUNT value on done: 13261.0 [2024-08-05 22:41:13,612][52660] Sum rewards: 7.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.276', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'ARMOR': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.148', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.380', 'weapon3': '1.676', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '9.000'} [2024-08-05 22:41:13,615][52666] DAMAGECOUNT value on done: 11259.0 [2024-08-05 22:41:13,617][52666] Sum rewards: 18.116, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.140', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'weapon5': '0.326', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '1.020', 'weapon2': '1.044', 'weapon3': '1.648', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '14.000'} [2024-08-05 22:41:14,043][52820] DAMAGECOUNT value on done: 9096.0 [2024-08-05 22:41:14,047][52820] Sum rewards: 3.960, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.922', 'AMMO2': '0.015', 'AMMO3': '0.074', 'AMMO4': '0.075', 'WEAPON4': '0.200', 'weapon4': '0.284', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '0.550', 'weapon3': '1.350', 'weapon2': '1.522', 'DAMAGECOUNT': '1.812', 'FRAGCOUNT': '4.000'} [2024-08-05 22:41:14,810][52614] Signal inference workers to stop experience collection... (1750 times) [2024-08-05 22:41:14,811][52614] Signal inference workers to resume experience collection... (1750 times) [2024-08-05 22:41:14,882][52650] InferenceWorker_p0-w0: stopping experience collection (1750 times) [2024-08-05 22:41:14,896][52650] InferenceWorker_p0-w0: resuming experience collection (1750 times) [2024-08-05 22:41:14,897][52650] Updated weights for policy 0, policy_version 9401 (0.0020) [2024-08-05 22:41:16,246][52670] DAMAGECOUNT value on done: 9803.0 [2024-08-05 22:41:16,251][52670] Sum rewards: 12.362, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.084', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'HEALTH': '0.488', 'WEAPON3': '0.550', 'weapon4': '0.584', 'HITCOUNT': '0.690', 'weapon2': '0.998', 'ARMOR': '1.228', 'weapon3': '1.664', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:16,405][52668] DAMAGECOUNT value on done: 11285.0 [2024-08-05 22:41:16,406][52668] Sum rewards: 13.882, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.452', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.232', 'ARMOR': '0.493', 'WEAPON3': '0.750', 'weapon2': '1.008', 'HITCOUNT': '1.170', 'weapon3': '2.262', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:16,525][52660] DAMAGECOUNT value on done: 9894.0 [2024-08-05 22:41:16,526][52660] Sum rewards: 7.522, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.114', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.013', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'ARMOR': '0.429', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.290', 'weapon3': '2.036', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:16,719][52659] DAMAGECOUNT value on done: 9566.0 [2024-08-05 22:41:16,720][52659] Sum rewards: 11.827, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HEALTH': '0.170', 'weapon4': '0.220', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.018', 'ARMOR': '1.368', 'weapon3': '2.364', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:16,844][52666] DAMAGECOUNT value on done: 10233.0 [2024-08-05 22:41:16,844][52666] Sum rewards: 7.629, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.146', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.102', 'WEAPON4': '0.250', 'weapon4': '0.464', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '0.930', 'ARMOR': '0.994', 'weapon3': '1.616', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '6.000'} [2024-08-05 22:41:17,249][52820] DAMAGECOUNT value on done: 10500.0 [2024-08-05 22:41:17,250][52820] Sum rewards: 20.183, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.722', 'AMMO2': '0.008', 'AMMO4': '0.042', 'ARMOR': '0.068', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.304', 'WEAPON3': '0.950', 'weapon2': '1.136', 'HITCOUNT': '1.330', 'weapon3': '2.264', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '18.000'} [2024-08-05 22:41:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.2, 300 sec: 16051.1). Total num frames: 77062144. Throughput: 0: 4220.0. Samples: 19264720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:41:17,795][52567] Avg episode reward: [(0, '10.169')] [2024-08-05 22:41:19,406][52650] Updated weights for policy 0, policy_version 9411 (0.0026) [2024-08-05 22:41:19,408][52659] DAMAGECOUNT value on done: 11246.0 [2024-08-05 22:41:19,411][52659] Sum rewards: 12.587, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.098', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon4': '0.230', 'WEAPON3': '1.050', 'weapon2': '1.118', 'HITCOUNT': '1.170', 'ARMOR': '1.349', 'weapon3': '2.346', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '13.000'} [2024-08-05 22:41:19,445][52668] DAMAGECOUNT value on done: 11245.0 [2024-08-05 22:41:19,445][52668] Sum rewards: 14.757, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.376', 'AMMO2': '0.008', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.088', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '1.180', 'ARMOR': '1.398', 'weapon2': '1.666', 'weapon3': '1.710', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '13.000'} [2024-08-05 22:41:19,456][52670] DAMAGECOUNT value on done: 10243.0 [2024-08-05 22:41:19,457][52670] Sum rewards: 8.727, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.238', 'weapon4': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '0.956', 'weapon3': '1.688', 'weapon2': '1.886', 'DAMAGECOUNT': '3.222', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:19,567][52660] DAMAGECOUNT value on done: 11069.0 [2024-08-05 22:41:19,569][52660] Sum rewards: 4.502, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.880', 'AMMO2': '0.025', 'AMMO3': '0.110', 'AMMO4': '0.125', 'weapon4': '0.232', 'WEAPON4': '0.300', 'ARMOR': '0.487', 'WEAPON3': '0.700', 'HITCOUNT': '0.950', 'weapon2': '1.078', 'weapon3': '2.014', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.111'} [2024-08-05 22:41:20,195][52666] DAMAGECOUNT value on done: 11243.0 [2024-08-05 22:41:20,195][52666] Sum rewards: 14.073, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.086', 'HEALTH': '0.206', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.040', 'weapon3': '1.250', 'weapon2': '1.324', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:20,637][52820] DAMAGECOUNT value on done: 11435.0 [2024-08-05 22:41:20,637][52820] Sum rewards: 8.519, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.058', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'ARMOR': '0.842', 'weapon2': '1.186', 'weapon3': '1.548', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:22,020][52668] DAMAGECOUNT value on done: 12330.0 [2024-08-05 22:41:22,022][52668] Sum rewards: 11.055, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.137', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO3': '0.068', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'HITCOUNT': '0.840', 'weapon2': '1.068', 'weapon3': '1.188', 'DAMAGECOUNT': '2.862', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:22,199][52660] DAMAGECOUNT value on done: 8676.0 [2024-08-05 22:41:22,199][52660] Sum rewards: 0.200, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.280', 'AMMO2': '0.011', 'ARMOR': '0.032', 'AMMO4': '0.055', 'AMMO3': '0.071', 'WEAPON4': '0.300', 'HITCOUNT': '0.350', 'weapon4': '0.356', 'WEAPON3': '0.550', 'DAMAGECOUNT': '0.999', 'FRAGCOUNT': '1.000', 'weapon2': '1.112', 'weapon3': '1.144'} [2024-08-05 22:41:22,737][52670] DAMAGECOUNT value on done: 10702.0 [2024-08-05 22:41:22,739][52670] Sum rewards: 10.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.003', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'ARMOR': '0.446', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon3': '1.240', 'weapon2': '1.320', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '9.000'} [2024-08-05 22:41:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16050.8). Total num frames: 77144064. Throughput: 0: 4227.1. Samples: 19290240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:41:22,794][52567] Avg episode reward: [(0, '10.094')] [2024-08-05 22:41:23,400][52666] DAMAGECOUNT value on done: 10611.0 [2024-08-05 22:41:23,401][52666] Sum rewards: 10.256, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.080', 'WEAPON4': '0.250', 'weapon4': '0.468', 'WEAPON3': '0.550', 'HITCOUNT': '0.850', 'weapon2': '1.096', 'ARMOR': '1.455', 'weapon3': '1.744', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:24,050][52820] DAMAGECOUNT value on done: 10251.0 [2024-08-05 22:41:24,052][52820] Sum rewards: 8.068, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.346', 'AMMO2': '0.004', 'weapon7': '0.006', 'AMMO4': '0.022', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.430', 'HITCOUNT': '0.660', 'WEAPON3': '0.800', 'weapon2': '0.898', 'ARMOR': '1.260', 'weapon3': '2.110', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:24,299][52650] Updated weights for policy 0, policy_version 9421 (0.0029) [2024-08-05 22:41:24,551][52668] DAMAGECOUNT value on done: 11882.0 [2024-08-05 22:41:24,552][52668] Sum rewards: 18.804, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.685', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.216', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'weapon2': '1.014', 'HITCOUNT': '1.250', 'weapon3': '1.518', 'DAMAGECOUNT': '4.443', 'FRAGCOUNT': '15.000'} [2024-08-05 22:41:24,745][52660] DAMAGECOUNT value on done: 12763.0 [2024-08-05 22:41:24,747][52660] Sum rewards: 10.227, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.036', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.314', 'WEAPON3': '0.750', 'HITCOUNT': '0.980', 'ARMOR': '1.417', 'weapon2': '1.438', 'weapon3': '1.900', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:25,689][52670] DAMAGECOUNT value on done: 10253.0 [2024-08-05 22:41:25,689][52670] Sum rewards: 17.662, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.434', 'AMMO2': '0.003', 'AMMO5': '0.004', 'AMMO4': '0.015', 'weapon5': '0.044', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.467', 'weapon4': '0.492', 'WEAPON3': '0.650', 'weapon2': '0.798', 'HITCOUNT': '1.130', 'weapon3': '1.978', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '14.000'} [2024-08-05 22:41:26,104][52666] DAMAGECOUNT value on done: 9476.0 [2024-08-05 22:41:26,106][52666] Sum rewards: 13.090, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.345', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'ARMOR': '0.444', 'weapon4': '0.486', 'weapon2': '0.622', 'WEAPON3': '0.700', 'HITCOUNT': '0.710', 'weapon3': '2.176', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:26,960][52668] DAMAGECOUNT value on done: 10909.0 [2024-08-05 22:41:26,964][52668] Sum rewards: 2.961, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.895', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.099', 'weapon4': '0.268', 'HITCOUNT': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.744', 'ARMOR': '0.895', 'weapon3': '1.040', 'DAMAGECOUNT': '1.782', 'FRAGCOUNT': '3.000'} [2024-08-05 22:41:27,288][52660] DAMAGECOUNT value on done: 10761.0 [2024-08-05 22:41:27,292][52660] Sum rewards: 7.853, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.668', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'ARMOR': '0.076', 'weapon4': '0.260', 'WEAPON3': '0.350', 'HITCOUNT': '0.440', 'weapon2': '0.806', 'weapon3': '0.944', 'DAMAGECOUNT': '1.551', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16930.1, 300 sec: 16106.3). Total num frames: 77234176. Throughput: 0: 4223.3. Samples: 19315560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:41:27,795][52567] Avg episode reward: [(0, '10.238')] [2024-08-05 22:41:28,400][52670] DAMAGECOUNT value on done: 11621.0 [2024-08-05 22:41:28,402][52670] Sum rewards: 9.987, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.036', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.368', 'ARMOR': '0.884', 'WEAPON3': '0.900', 'weapon2': '0.964', 'HITCOUNT': '1.120', 'weapon3': '1.828', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '9.000'} [2024-08-05 22:41:28,983][52666] DAMAGECOUNT value on done: 9697.0 [2024-08-05 22:41:28,987][52666] Sum rewards: 8.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.556', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon7': '0.074', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.480', 'weapon4': '0.612', 'HITCOUNT': '0.790', 'WEAPON3': '0.800', 'weapon2': '1.032', 'weapon3': '1.690', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:29,525][52650] Updated weights for policy 0, policy_version 9431 (0.0025) [2024-08-05 22:41:30,194][52668] DAMAGECOUNT value on done: 12325.0 [2024-08-05 22:41:30,200][52668] Sum rewards: 9.826, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.031', 'weapon7': '0.084', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'HEALTH': '0.188', 'WEAPON7': '0.200', 'weapon4': '0.376', 'ARMOR': '0.448', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'weapon2': '1.372', 'weapon3': '1.642', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:30,465][52660] DAMAGECOUNT value on done: 12392.0 [2024-08-05 22:41:30,467][52660] Sum rewards: 15.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.232', 'AMMO5': '0.011', 'AMMO2': '0.016', 'ARMOR': '0.052', 'AMMO4': '0.080', 'weapon5': '0.134', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.506', 'weapon2': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '1.220', 'weapon3': '2.452', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '15.500'} [2024-08-05 22:41:31,588][52670] DAMAGECOUNT value on done: 12185.0 [2024-08-05 22:41:31,589][52670] Sum rewards: 8.233, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.366', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.476', 'weapon4': '0.502', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '0.854', 'weapon3': '2.076', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:32,237][52666] DAMAGECOUNT value on done: 10412.0 [2024-08-05 22:41:32,241][52666] Sum rewards: 6.885, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.246', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '0.780', 'weapon3': '1.596', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '6.000'} [2024-08-05 22:41:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16206.5). Total num frames: 77307904. Throughput: 0: 4227.8. Samples: 19328210. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 22:41:32,802][52567] Avg episode reward: [(0, '10.099')] [2024-08-05 22:41:33,165][52668] DAMAGECOUNT value on done: 9616.0 [2024-08-05 22:41:33,168][52668] Sum rewards: 4.849, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.307', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.078', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.660', 'weapon3': '1.300', 'ARMOR': '1.350', 'weapon2': '1.464', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '3.000'} [2024-08-05 22:41:33,420][52660] DAMAGECOUNT value on done: 11580.0 [2024-08-05 22:41:33,421][52660] Sum rewards: 9.593, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.334', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.294', 'ARMOR': '0.526', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.274', 'weapon3': '1.610', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:33,775][52650] Updated weights for policy 0, policy_version 9441 (0.0011) [2024-08-05 22:41:35,088][52670] DAMAGECOUNT value on done: 12600.0 [2024-08-05 22:41:35,091][52670] Sum rewards: 6.764, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.674', 'AMMO2': '0.004', 'weapon4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'ARMOR': '1.248', 'weapon2': '1.580', 'weapon3': '1.972', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:35,765][52666] DAMAGECOUNT value on done: 10977.0 [2024-08-05 22:41:35,765][52666] Sum rewards: 10.549, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.107', 'WEAPON4': '0.250', 'weapon4': '0.602', 'WEAPON3': '0.650', 'weapon2': '0.914', 'ARMOR': '0.920', 'HITCOUNT': '1.100', 'weapon3': '1.622', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:35,818][52668] DAMAGECOUNT value on done: 11340.0 [2024-08-05 22:41:35,818][52668] Sum rewards: 6.318, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.018', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.064', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.040', 'weapon2': '1.600', 'weapon3': '2.080', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:35,983][52660] DAMAGECOUNT value on done: 12323.0 [2024-08-05 22:41:35,983][52660] Sum rewards: 20.221, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.083', 'weapon4': '0.226', 'WEAPON3': '0.400', 'HEALTH': '0.510', 'ARMOR': '0.800', 'HITCOUNT': '1.190', 'weapon2': '1.374', 'weapon3': '1.494', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '15.000'} [2024-08-05 22:41:37,795][52567] Fps is (10 sec: 16382.5, 60 sec: 16929.8, 300 sec: 16328.4). Total num frames: 77398016. Throughput: 0: 4236.6. Samples: 19353790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:41:37,796][52567] Avg episode reward: [(0, '10.153')] [2024-08-05 22:41:38,538][52668] DAMAGECOUNT value on done: 11020.0 [2024-08-05 22:41:38,538][52668] Sum rewards: 12.543, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.078', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.083', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.250', 'ARMOR': '0.480', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '1.140', 'weapon3': '1.694', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '9.000'} [2024-08-05 22:41:38,554][52670] DAMAGECOUNT value on done: 12596.0 [2024-08-05 22:41:38,556][52670] Sum rewards: 22.207, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.102', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'HEALTH': '0.194', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.518', 'HITCOUNT': '1.620', 'weapon3': '1.878', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '18.000'} [2024-08-05 22:41:38,648][52650] Updated weights for policy 0, policy_version 9451 (0.0028) [2024-08-05 22:41:38,732][52660] DAMAGECOUNT value on done: 11303.0 [2024-08-05 22:41:38,734][52660] Sum rewards: 14.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.488', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.030', 'weapon7': '0.060', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.304', 'WEAPON3': '0.900', 'HITCOUNT': '0.970', 'ARMOR': '1.256', 'weapon2': '1.342', 'weapon3': '1.818', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '14.000'} [2024-08-05 22:41:39,130][52666] DAMAGECOUNT value on done: 10422.0 [2024-08-05 22:41:39,131][52666] Sum rewards: 7.389, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.010', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.120', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'ARMOR': '0.951', 'weapon2': '1.244', 'weapon3': '2.000', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:40,622][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:41:40,867][52668] DAMAGECOUNT value on done: 11386.0 [2024-08-05 22:41:40,868][52668] Sum rewards: 4.603, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.837', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO3': '0.065', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'ARMOR': '0.456', 'HITCOUNT': '0.800', 'weapon3': '1.148', 'weapon2': '1.446', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '4.000'} [2024-08-05 22:41:41,170][52660] DAMAGECOUNT value on done: 11604.0 [2024-08-05 22:41:41,170][52660] Sum rewards: 16.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.600', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.332', 'WEAPON3': '0.600', 'HITCOUNT': '1.040', 'weapon2': '1.232', 'weapon3': '1.730', 'ARMOR': '1.848', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:41,840][52670] DAMAGECOUNT value on done: 11612.0 [2024-08-05 22:41:41,843][52670] Sum rewards: 15.405, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.330', 'AMMO2': '0.014', 'AMMO3': '0.070', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.402', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'HITCOUNT': '0.940', 'weapon2': '1.046', 'weapon3': '1.524', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:42,403][52666] DAMAGECOUNT value on done: 11169.0 [2024-08-05 22:41:42,405][52666] Sum rewards: 5.387, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.059', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.440', 'ARMOR': '0.487', 'weapon2': '0.584', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon3': '2.088', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16300.7). Total num frames: 77471744. Throughput: 0: 4242.4. Samples: 19379570. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:41:42,794][52567] Avg episode reward: [(0, '10.272')] [2024-08-05 22:41:43,735][52650] Updated weights for policy 0, policy_version 9461 (0.0013) [2024-08-05 22:41:44,309][52668] DAMAGECOUNT value on done: 10437.0 [2024-08-05 22:41:44,309][52668] Sum rewards: 12.206, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.020', 'AMMO4': '0.037', 'weapon7': '0.058', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.110', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.398', 'weapon3': '1.892', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:44,422][52660] DAMAGECOUNT value on done: 11729.0 [2024-08-05 22:41:44,423][52660] Sum rewards: 7.847, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.238', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.068', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.500', 'ARMOR': '0.832', 'HITCOUNT': '0.850', 'weapon3': '1.212', 'weapon2': '1.432', 'DAMAGECOUNT': '2.625', 'FRAGCOUNT': '5.000'} [2024-08-05 22:41:45,194][52670] DAMAGECOUNT value on done: 9997.0 [2024-08-05 22:41:45,196][52670] Sum rewards: 8.387, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.774', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.472', 'HITCOUNT': '0.570', 'WEAPON3': '0.650', 'ARMOR': '0.888', 'weapon2': '1.130', 'weapon3': '1.512', 'DAMAGECOUNT': '1.893', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:45,693][52666] DAMAGECOUNT value on done: 9273.0 [2024-08-05 22:41:45,696][52666] Sum rewards: 8.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.248', 'weapon4': '0.452', 'HITCOUNT': '0.720', 'WEAPON3': '0.750', 'weapon2': '1.166', 'weapon3': '1.410', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:46,871][52668] DAMAGECOUNT value on done: 10754.0 [2024-08-05 22:41:46,874][52668] Sum rewards: 2.831, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.168', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon5': '0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'ARMOR': '1.313', 'weapon3': '1.654', 'weapon2': '1.682', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '3.500'} [2024-08-05 22:41:47,026][52660] DAMAGECOUNT value on done: 11036.0 [2024-08-05 22:41:47,027][52660] Sum rewards: 9.605, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.166', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.102', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.608', 'weapon3': '1.654', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:47,794][52567] Fps is (10 sec: 17205.0, 60 sec: 16930.2, 300 sec: 16384.0). Total num frames: 77570048. Throughput: 0: 4236.9. Samples: 19392080. Policy #0 lag: (min: 1.0, avg: 5.2, max: 10.0) [2024-08-05 22:41:47,794][52567] Avg episode reward: [(0, '10.266')] [2024-08-05 22:41:48,550][52670] DAMAGECOUNT value on done: 10910.0 [2024-08-05 22:41:48,554][52670] Sum rewards: 13.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.198', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.224', 'WEAPON3': '0.850', 'HITCOUNT': '1.140', 'weapon2': '1.306', 'weapon3': '1.724', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '13.000'} [2024-08-05 22:41:48,841][52650] Updated weights for policy 0, policy_version 9471 (0.0024) [2024-08-05 22:41:49,130][52666] DAMAGECOUNT value on done: 10946.0 [2024-08-05 22:41:49,134][52666] Sum rewards: 12.870, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.870', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.270', 'WEAPON3': '0.800', 'HITCOUNT': '1.130', 'ARMOR': '1.347', 'weapon2': '1.492', 'weapon3': '1.782', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:49,644][52668] DAMAGECOUNT value on done: 10985.0 [2024-08-05 22:41:49,644][52668] Sum rewards: 2.959, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.269', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.027', 'AMMO3': '0.125', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.254', 'HITCOUNT': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.134', 'ARMOR': '1.389', 'DAMAGECOUNT': '1.917', 'weapon3': '2.118', 'FRAGCOUNT': '5.000'} [2024-08-05 22:41:49,792][52660] DAMAGECOUNT value on done: 12322.0 [2024-08-05 22:41:49,794][52660] Sum rewards: 15.840, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon4': '0.160', 'WEAPON3': '0.950', 'weapon2': '1.238', 'ARMOR': '1.294', 'HITCOUNT': '1.400', 'weapon3': '2.156', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '13.000'} [2024-08-05 22:41:52,010][52670] DAMAGECOUNT value on done: 11348.0 [2024-08-05 22:41:52,012][52670] Sum rewards: 1.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.860', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.444', 'HITCOUNT': '0.700', 'weapon2': '0.822', 'ARMOR': '0.952', 'WEAPON3': '1.200', 'DAMAGECOUNT': '2.190', 'weapon3': '2.470', 'FRAGCOUNT': '6.000'} [2024-08-05 22:41:52,246][52668] DAMAGECOUNT value on done: 11969.0 [2024-08-05 22:41:52,248][52668] Sum rewards: 9.418, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.730', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.242', 'weapon5': '0.322', 'ARMOR': '0.500', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon2': '0.982', 'weapon3': '1.218', 'DAMAGECOUNT': '3.051', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:52,430][52660] DAMAGECOUNT value on done: 12001.0 [2024-08-05 22:41:52,432][52660] Sum rewards: 11.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.934', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.126', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'ARMOR': '0.883', 'weapon2': '1.430', 'weapon3': '1.796', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:52,615][52666] DAMAGECOUNT value on done: 12430.0 [2024-08-05 22:41:52,616][52666] Sum rewards: 8.041, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.013', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'ARMOR': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.260', 'weapon4': '0.318', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.060', 'weapon3': '1.752', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '8.000'} [2024-08-05 22:41:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 16930.1, 300 sec: 16411.8). Total num frames: 77651968. Throughput: 0: 4232.7. Samples: 19417130. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:41:52,795][52567] Avg episode reward: [(0, '10.161')] [2024-08-05 22:41:53,610][52650] Updated weights for policy 0, policy_version 9481 (0.0013) [2024-08-05 22:41:55,344][52670] DAMAGECOUNT value on done: 11836.0 [2024-08-05 22:41:55,347][52670] Sum rewards: 12.683, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.372', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.384', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.012', 'ARMOR': '1.333', 'weapon3': '1.476', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '9.000'} [2024-08-05 22:41:55,503][52668] DAMAGECOUNT value on done: 11953.0 [2024-08-05 22:41:55,505][52668] Sum rewards: 19.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.042', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.118', 'ARMOR': '0.529', 'WEAPON3': '0.750', 'weapon2': '1.450', 'HITCOUNT': '1.540', 'weapon3': '2.164', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '15.000'} [2024-08-05 22:41:55,633][52660] DAMAGECOUNT value on done: 12362.0 [2024-08-05 22:41:55,633][52660] Sum rewards: 15.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.104', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.070', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.980', 'weapon2': '1.528', 'weapon3': '1.612', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '12.000'} [2024-08-05 22:41:55,934][52666] DAMAGECOUNT value on done: 11038.0 [2024-08-05 22:41:55,948][52666] Sum rewards: 10.285, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.398', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.174', 'WEAPON3': '0.500', 'HITCOUNT': '0.670', 'weapon3': '1.316', 'weapon2': '1.540', 'ARMOR': '1.747', 'DAMAGECOUNT': '2.487', 'FRAGCOUNT': '7.000'} [2024-08-05 22:41:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16495.1). Total num frames: 77742080. Throughput: 0: 4242.5. Samples: 19442720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:41:57,794][52567] Avg episode reward: [(0, '10.352')] [2024-08-05 22:41:58,175][52650] Updated weights for policy 0, policy_version 9491 (0.0011) [2024-08-05 22:41:58,559][52670] DAMAGECOUNT value on done: 11522.0 [2024-08-05 22:41:58,563][52670] Sum rewards: 13.282, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.086', 'AMMO2': '0.031', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO4': '0.154', 'weapon4': '0.412', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.340', 'weapon3': '1.742', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '10.000'} [2024-08-05 22:41:58,636][52668] DAMAGECOUNT value on done: 10953.0 [2024-08-05 22:41:58,640][52668] Sum rewards: 14.920, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.518', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'AMMO3': '0.075', 'WEAPON5': '0.150', 'weapon5': '0.184', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'HITCOUNT': '1.040', 'weapon2': '1.158', 'weapon3': '1.592', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '11.000'} [2024-08-05 22:41:58,849][52660] DAMAGECOUNT value on done: 11820.0 [2024-08-05 22:41:58,850][52660] Sum rewards: 13.950, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.752', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.298', 'WEAPON3': '0.600', 'ARMOR': '0.896', 'HITCOUNT': '0.930', 'weapon2': '1.014', 'weapon3': '1.578', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:01,520][52660] DAMAGECOUNT value on done: 12015.0 [2024-08-05 22:42:01,521][52660] Sum rewards: 12.699, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.080', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'weapon4': '0.010', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.898', 'HITCOUNT': '0.970', 'weapon2': '1.288', 'weapon3': '1.642', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 16495.1). Total num frames: 77815808. Throughput: 0: 4241.1. Samples: 19455570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:42:02,813][52567] Avg episode reward: [(0, '10.545')] [2024-08-05 22:42:03,720][52650] Updated weights for policy 0, policy_version 9501 (0.0028) [2024-08-05 22:42:03,906][52663] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon7', 0.002)] [2024-08-05 22:42:04,390][52660] DAMAGECOUNT value on done: 11331.0 [2024-08-05 22:42:04,392][52660] Sum rewards: 6.545, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'HEALTH': '0.094', 'AMMO4': '0.100', 'weapon5': '0.166', 'weapon4': '0.254', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.520', 'weapon2': '0.806', 'weapon3': '0.922', 'DAMAGECOUNT': '1.746', 'FRAGCOUNT': '4.000'} [2024-08-05 22:42:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17066.7, 300 sec: 16550.6). Total num frames: 77914112. Throughput: 0: 4225.1. Samples: 19480370. Policy #0 lag: (min: 0.0, avg: 4.8, max: 9.0) [2024-08-05 22:42:07,803][52567] Avg episode reward: [(0, '10.507')] [2024-08-05 22:42:07,806][52650] Updated weights for policy 0, policy_version 9511 (0.0012) [2024-08-05 22:42:09,180][52647] DAMAGECOUNT value on done: 13540.0 [2024-08-05 22:42:09,180][52647] Sum rewards: 20.861, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.027', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.136', 'WEAPON3': '0.400', 'weapon4': '0.418', 'ARMOR': '0.424', 'HEALTH': '0.593', 'HITCOUNT': '1.320', 'weapon2': '1.422', 'weapon3': '1.654', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '14.000'} [2024-08-05 22:42:12,331][52647] DAMAGECOUNT value on done: 11105.0 [2024-08-05 22:42:12,344][52647] Sum rewards: 9.908, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.419', 'AMMO2': '0.031', 'AMMO3': '0.092', 'ARMOR': '0.096', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.680', 'weapon4': '0.852', 'weapon2': '0.894', 'weapon3': '1.594', 'DAMAGECOUNT': '2.331', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 16550.6). Total num frames: 77979648. Throughput: 0: 4198.7. Samples: 19504500. Policy #0 lag: (min: 0.0, avg: 4.8, max: 9.0) [2024-08-05 22:42:12,794][52567] Avg episode reward: [(0, '10.644')] [2024-08-05 22:42:12,795][52614] Saving new best policy, reward=10.644! [2024-08-05 22:42:13,402][52669] DAMAGECOUNT value on done: 11811.0 [2024-08-05 22:42:13,402][52669] Sum rewards: 6.900, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.750', 'AMMO4': '-0.106', 'AMMO2': '-0.021', 'AMMO5': '0.007', 'weapon5': '0.052', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'ARMOR': '0.467', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon3': '1.494', 'weapon2': '1.642', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:13,459][52650] Updated weights for policy 0, policy_version 9521 (0.0035) [2024-08-05 22:42:14,862][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 22:42:15,832][52669] DAMAGECOUNT value on done: 11915.0 [2024-08-05 22:42:15,833][52669] Sum rewards: 15.030, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.424', 'AMMO2': '0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.114', 'weapon3': '1.690', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:15,836][52647] DAMAGECOUNT value on done: 13967.0 [2024-08-05 22:42:15,838][52647] Sum rewards: 9.087, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.354', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.010', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'ARMOR': '0.096', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.402', 'weapon2': '0.860', 'WEAPON3': '1.000', 'HITCOUNT': '1.330', 'weapon3': '2.096', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:17,794][52567] Fps is (10 sec: 15564.9, 60 sec: 16793.6, 300 sec: 16606.2). Total num frames: 78069760. Throughput: 0: 4188.0. Samples: 19516670. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 22:42:17,794][52567] Avg episode reward: [(0, '10.573')] [2024-08-05 22:42:18,196][52650] Updated weights for policy 0, policy_version 9531 (0.0018) [2024-08-05 22:42:18,838][52647] DAMAGECOUNT value on done: 9374.0 [2024-08-05 22:42:18,840][52647] Sum rewards: 7.764, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon4': '0.264', 'ARMOR': '0.484', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'weapon2': '1.040', 'weapon3': '2.200', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:19,325][52669] DAMAGECOUNT value on done: 12705.0 [2024-08-05 22:42:19,325][52669] Sum rewards: 12.865, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.912', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.152', 'weapon4': '0.228', 'WEAPON3': '0.900', 'HITCOUNT': '1.010', 'ARMOR': '1.380', 'weapon2': '1.570', 'weapon3': '1.848', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '11.000'} [2024-08-05 22:42:22,068][52669] DAMAGECOUNT value on done: 13337.0 [2024-08-05 22:42:22,069][52669] Sum rewards: 18.362, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.049', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.250', 'WEAPON3': '0.350', 'HITCOUNT': '0.870', 'weapon3': '1.162', 'weapon2': '1.560', 'DAMAGECOUNT': '2.967', 'FRAGCOUNT': '14.000'} [2024-08-05 22:42:22,074][52647] DAMAGECOUNT value on done: 12264.0 [2024-08-05 22:42:22,076][52647] Sum rewards: 16.378, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.056', 'AMMO2': '0.014', 'weapon7': '0.064', 'AMMO4': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.102', 'AMMO3': '0.116', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'weapon2': '1.266', 'HITCOUNT': '1.320', 'weapon3': '1.982', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:22,794][52567] Fps is (10 sec: 17202.6, 60 sec: 16793.5, 300 sec: 16633.9). Total num frames: 78151680. Throughput: 0: 4188.1. Samples: 19542250. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 22:42:22,795][52567] Avg episode reward: [(0, '10.778')] [2024-08-05 22:42:22,864][52614] Saving new best policy, reward=10.778! [2024-08-05 22:42:22,899][52650] Updated weights for policy 0, policy_version 9541 (0.0038) [2024-08-05 22:42:23,788][52803] DAMAGECOUNT value on done: 10996.0 [2024-08-05 22:42:23,790][52803] Sum rewards: 5.398, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.342', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.091', 'WEAPON4': '0.250', 'weapon4': '0.284', 'HITCOUNT': '0.600', 'WEAPON3': '0.650', 'ARMOR': '0.951', 'weapon2': '1.156', 'weapon3': '1.484', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '5.000'} [2024-08-05 22:42:24,651][52665] DAMAGECOUNT value on done: 10947.0 [2024-08-05 22:42:24,651][52665] Sum rewards: 8.705, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.152', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'ARMOR': '0.519', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.384', 'weapon3': '1.918', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:25,572][52669] DAMAGECOUNT value on done: 12055.0 [2024-08-05 22:42:25,576][52669] Sum rewards: 10.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.128', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.178', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'ARMOR': '1.304', 'weapon2': '1.354', 'weapon3': '1.748', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:25,632][52647] DAMAGECOUNT value on done: 12240.0 [2024-08-05 22:42:25,632][52647] Sum rewards: 12.804, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.006', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'ARMOR': '0.043', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon2': '1.268', 'weapon3': '1.628', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:26,954][52803] DAMAGECOUNT value on done: 13804.0 [2024-08-05 22:42:26,956][52803] Sum rewards: 15.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.551', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.032', 'weapon7': '0.064', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.444', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon2': '1.126', 'weapon3': '1.696', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16661.7). Total num frames: 78233600. Throughput: 0: 4163.6. Samples: 19566930. Policy #0 lag: (min: 0.0, avg: 5.1, max: 10.0) [2024-08-05 22:42:27,794][52567] Avg episode reward: [(0, '10.804')] [2024-08-05 22:42:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009550_78233600.pth... [2024-08-05 22:42:27,970][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009058_74203136.pth [2024-08-05 22:42:27,975][52614] Saving new best policy, reward=10.804! [2024-08-05 22:42:28,193][52665] DAMAGECOUNT value on done: 10987.0 [2024-08-05 22:42:28,195][52665] Sum rewards: 10.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.956', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon7': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.434', 'weapon3': '1.698', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:28,283][52811] DAMAGECOUNT value on done: 11961.0 [2024-08-05 22:42:28,284][52811] Sum rewards: 19.589, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.843', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon4': '0.210', 'ARMOR': '0.501', 'WEAPON3': '0.700', 'weapon2': '1.144', 'HITCOUNT': '1.200', 'weapon3': '1.752', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '16.000'} [2024-08-05 22:42:28,291][52650] Updated weights for policy 0, policy_version 9551 (0.0024) [2024-08-05 22:42:28,808][52669] DAMAGECOUNT value on done: 12388.0 [2024-08-05 22:42:28,814][52669] Sum rewards: 7.791, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.451', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.444', 'weapon3': '1.710', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:29,166][52647] DAMAGECOUNT value on done: 11134.0 [2024-08-05 22:42:29,166][52647] Sum rewards: 5.631, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.644', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'ARMOR': '0.514', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.202', 'weapon3': '1.588', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '6.000'} [2024-08-05 22:42:30,281][52794] DAMAGECOUNT value on done: 13551.0 [2024-08-05 22:42:30,281][52794] Sum rewards: 13.251, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.690', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.121', 'WEAPON3': '0.850', 'HITCOUNT': '1.230', 'ARMOR': '1.301', 'weapon2': '1.678', 'weapon3': '1.872', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:30,426][52803] DAMAGECOUNT value on done: 11119.0 [2024-08-05 22:42:30,426][52803] Sum rewards: 10.415, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.014', 'ARMOR': '0.052', 'AMMO4': '0.071', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'HEALTH': '0.602', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.216', 'weapon3': '2.092', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:31,090][52665] DAMAGECOUNT value on done: 12502.0 [2024-08-05 22:42:31,090][52665] Sum rewards: 11.189, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.153', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'weapon4': '0.462', 'ARMOR': '0.493', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon2': '1.218', 'weapon3': '1.980', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:31,582][52811] DAMAGECOUNT value on done: 12088.0 [2024-08-05 22:42:31,586][52811] Sum rewards: 17.575, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.611', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.010', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.210', 'WEAPON3': '0.650', 'HITCOUNT': '1.300', 'weapon2': '1.362', 'weapon3': '1.824', 'DAMAGECOUNT': '4.521', 'FRAGCOUNT': '14.000'} [2024-08-05 22:42:31,909][52669] DAMAGECOUNT value on done: 13022.0 [2024-08-05 22:42:31,913][52669] Sum rewards: 8.934, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.346', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon5': '0.038', 'AMMO4': '0.039', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'ARMOR': '1.252', 'weapon3': '1.504', 'weapon2': '1.510', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:32,355][52647] DAMAGECOUNT value on done: 11723.0 [2024-08-05 22:42:32,356][52647] Sum rewards: 6.404, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.696', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.326', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.208', 'ARMOR': '1.408', 'weapon3': '1.432', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '5.000'} [2024-08-05 22:42:32,738][52794] DAMAGECOUNT value on done: 14520.0 [2024-08-05 22:42:32,739][52794] Sum rewards: 10.725, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.435', 'AMMO2': '0.024', 'AMMO3': '0.084', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'weapon4': '0.374', 'WEAPON3': '0.600', 'ARMOR': '0.885', 'HITCOUNT': '0.990', 'weapon2': '1.292', 'weapon3': '1.524', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:32,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.6, 300 sec: 16689.5). Total num frames: 78315520. Throughput: 0: 4156.0. Samples: 19579100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:42:32,795][52567] Avg episode reward: [(0, '11.028')] [2024-08-05 22:42:32,795][52614] Saving new best policy, reward=11.028! [2024-08-05 22:42:33,100][52650] Updated weights for policy 0, policy_version 9561 (0.0047) [2024-08-05 22:42:33,674][52803] DAMAGECOUNT value on done: 11832.0 [2024-08-05 22:42:33,674][52803] Sum rewards: 11.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.898', 'AMMO2': '0.020', 'weapon4': '0.098', 'AMMO4': '0.102', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'ARMOR': '0.915', 'HITCOUNT': '1.010', 'WEAPON3': '1.050', 'weapon2': '1.240', 'weapon3': '2.404', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:33,734][52665] DAMAGECOUNT value on done: 11797.0 [2024-08-05 22:42:33,735][52665] Sum rewards: 18.120, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.100', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.230', 'WEAPON3': '0.500', 'ARMOR': '0.944', 'HITCOUNT': '1.060', 'weapon3': '1.170', 'weapon2': '1.316', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:34,950][52669] DAMAGECOUNT value on done: 11729.0 [2024-08-05 22:42:34,950][52669] Sum rewards: 5.241, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.192', 'HITCOUNT': '0.300', 'HEALTH': '0.356', 'WEAPON3': '0.400', 'weapon5': '0.410', 'ARMOR': '0.804', 'DAMAGECOUNT': '0.984', 'weapon3': '1.086', 'weapon2': '1.626', 'FRAGCOUNT': '4.000'} [2024-08-05 22:42:35,099][52811] DAMAGECOUNT value on done: 11666.0 [2024-08-05 22:42:35,099][52662] DAMAGECOUNT value on done: 12434.0 [2024-08-05 22:42:35,101][52811] Sum rewards: 11.388, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.264', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'ARMOR': '1.318', 'weapon2': '1.458', 'weapon3': '1.832', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:35,102][52662] Sum rewards: 9.241, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.328', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.153', 'ARMOR': '0.443', 'HITCOUNT': '0.890', 'WEAPON3': '1.000', 'weapon2': '1.248', 'weapon3': '2.136', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '11.000'} [2024-08-05 22:42:35,311][52794] DAMAGECOUNT value on done: 14072.0 [2024-08-05 22:42:35,312][52794] Sum rewards: 14.057, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.546', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.090', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.484', 'WEAPON3': '0.600', 'HITCOUNT': '1.130', 'weapon2': '1.646', 'weapon3': '1.690', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:35,816][52647] DAMAGECOUNT value on done: 13513.0 [2024-08-05 22:42:35,817][52647] Sum rewards: 17.922, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.795', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.102', 'weapon4': '0.204', 'ARMOR': '0.457', 'WEAPON3': '0.650', 'HITCOUNT': '1.490', 'weapon3': '1.656', 'weapon2': '1.924', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '14.000'} [2024-08-05 22:42:36,824][52803] DAMAGECOUNT value on done: 12639.0 [2024-08-05 22:42:36,825][52803] Sum rewards: 11.513, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.585', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.010', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.192', 'WEAPON3': '0.650', 'ARMOR': '0.898', 'weapon2': '1.104', 'HITCOUNT': '1.130', 'weapon3': '1.576', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:37,157][52665] DAMAGECOUNT value on done: 11728.0 [2024-08-05 22:42:37,158][52665] Sum rewards: 6.458, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.500', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO4': '0.011', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon2': '0.530', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon3': '1.362', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.4, 300 sec: 16745.0). Total num frames: 78397440. Throughput: 0: 4155.6. Samples: 19604130. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:42:37,794][52567] Avg episode reward: [(0, '11.047')] [2024-08-05 22:42:37,872][52614] Saving new best policy, reward=11.047! [2024-08-05 22:42:37,887][52650] Updated weights for policy 0, policy_version 9571 (0.0022) [2024-08-05 22:42:37,935][52662] DAMAGECOUNT value on done: 13878.0 [2024-08-05 22:42:37,936][52662] Sum rewards: 14.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.769', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.220', 'ARMOR': '0.840', 'WEAPON3': '0.950', 'weapon2': '1.090', 'HITCOUNT': '1.130', 'weapon3': '2.082', 'DAMAGECOUNT': '3.657', 'FRAGCOUNT': '15.000'} [2024-08-05 22:42:37,939][52669] DAMAGECOUNT value on done: 11950.0 [2024-08-05 22:42:37,940][52669] Sum rewards: 17.533, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.449', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.014', 'ARMOR': '0.036', 'AMMO4': '0.066', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.320', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon2': '1.338', 'weapon3': '2.074', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '15.000'} [2024-08-05 22:42:38,180][52794] DAMAGECOUNT value on done: 13105.0 [2024-08-05 22:42:38,180][52794] Sum rewards: 8.927, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.450', 'AMMO2': '0.029', 'ARMOR': '0.055', 'AMMO3': '0.087', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.008', 'weapon3': '1.268', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:38,299][52811] DAMAGECOUNT value on done: 12742.0 [2024-08-05 22:42:38,299][52811] Sum rewards: 12.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.146', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.256', 'ARMOR': '0.436', 'WEAPON3': '0.800', 'weapon2': '1.082', 'HITCOUNT': '1.120', 'weapon3': '1.822', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '11.000'} [2024-08-05 22:42:39,089][52647] DAMAGECOUNT value on done: 11897.0 [2024-08-05 22:42:39,091][52647] Sum rewards: 12.448, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.299', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.007', 'weapon5': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON3': '1.000', 'HITCOUNT': '1.030', 'weapon2': '1.414', 'ARMOR': '1.815', 'weapon3': '2.274', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:40,230][52803] DAMAGECOUNT value on done: 11103.0 [2024-08-05 22:42:40,232][52803] Sum rewards: 7.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.058', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'ARMOR': '0.514', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.190', 'weapon3': '1.832', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:40,568][52662] DAMAGECOUNT value on done: 15198.0 [2024-08-05 22:42:40,568][52662] Sum rewards: 19.687, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.502', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.392', 'WEAPON3': '0.600', 'ARMOR': '0.971', 'weapon2': '1.358', 'HITCOUNT': '1.380', 'weapon3': '1.774', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '14.000'} [2024-08-05 22:42:40,617][52665] DAMAGECOUNT value on done: 11840.0 [2024-08-05 22:42:40,617][52665] Sum rewards: 18.078, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.654', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON3': '0.900', 'ARMOR': '0.961', 'HITCOUNT': '1.310', 'weapon3': '1.780', 'weapon2': '1.982', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '16.000'} [2024-08-05 22:42:40,814][52794] DAMAGECOUNT value on done: 14851.0 [2024-08-05 22:42:40,814][52794] Sum rewards: 13.166, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.864', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.084', 'weapon4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'HITCOUNT': '1.020', 'weapon2': '1.632', 'weapon3': '1.790', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '10.500'} [2024-08-05 22:42:40,824][52669] DAMAGECOUNT value on done: 11849.0 [2024-08-05 22:42:40,825][52669] Sum rewards: 6.375, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.563', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.003', 'weapon5': '0.052', 'AMMO3': '0.074', 'weapon7': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.220', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'ARMOR': '0.998', 'weapon3': '1.098', 'weapon2': '1.110', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '4.000'} [2024-08-05 22:42:41,623][52811] DAMAGECOUNT value on done: 12747.0 [2024-08-05 22:42:41,625][52811] Sum rewards: 16.169, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.979', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.260', 'ARMOR': '0.506', 'WEAPON3': '0.600', 'HITCOUNT': '0.940', 'weapon2': '1.460', 'weapon3': '1.590', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '14.000'} [2024-08-05 22:42:41,868][52647] DAMAGECOUNT value on done: 12320.0 [2024-08-05 22:42:41,869][52647] Sum rewards: 8.954, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.205', 'AMMO4': '-0.083', 'AMMO2': '-0.016', 'AMMO5': '0.010', 'AMMO3': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.200', 'ARMOR': '0.422', 'WEAPON3': '0.450', 'HITCOUNT': '0.800', 'weapon3': '1.174', 'weapon2': '2.018', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '6.000'} [2024-08-05 22:42:42,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16793.5, 300 sec: 16772.8). Total num frames: 78479360. Throughput: 0: 4143.3. Samples: 19629170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:42:42,795][52567] Avg episode reward: [(0, '11.244')] [2024-08-05 22:42:42,808][52614] Saving new best policy, reward=11.244! [2024-08-05 22:42:42,813][52650] Updated weights for policy 0, policy_version 9581 (0.0022) [2024-08-05 22:42:43,185][52662] DAMAGECOUNT value on done: 13469.0 [2024-08-05 22:42:43,186][52662] Sum rewards: 8.404, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.040', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.032', 'AMMO3': '0.107', 'WEAPON4': '0.250', 'weapon4': '0.712', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.102', 'weapon3': '1.716', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:43,445][52794] DAMAGECOUNT value on done: 13950.0 [2024-08-05 22:42:43,446][52794] Sum rewards: 8.197, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.098', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.486', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'ARMOR': '0.877', 'weapon2': '0.926', 'weapon3': '1.534', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '6.000'} [2024-08-05 22:42:43,530][52665] DAMAGECOUNT value on done: 12563.0 [2024-08-05 22:42:43,531][52665] Sum rewards: 12.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.111', 'WEAPON3': '0.750', 'HITCOUNT': '1.160', 'weapon2': '1.318', 'weapon3': '1.544', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '11.000'} [2024-08-05 22:42:43,592][52803] DAMAGECOUNT value on done: 12988.0 [2024-08-05 22:42:43,594][52803] Sum rewards: 7.362, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.732', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.156', 'WEAPON3': '0.850', 'ARMOR': '0.911', 'HITCOUNT': '0.940', 'weapon2': '1.488', 'weapon3': '1.712', 'DAMAGECOUNT': '3.066', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:44,225][52669] DAMAGECOUNT value on done: 12008.0 [2024-08-05 22:42:44,227][52669] Sum rewards: 12.162, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.024', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'HEALTH': '0.173', 'WEAPON3': '0.450', 'weapon4': '0.502', 'ARMOR': '0.538', 'HITCOUNT': '0.830', 'weapon2': '1.332', 'weapon3': '1.530', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:44,527][52663] DAMAGECOUNT value on done: 12782.0 [2024-08-05 22:42:44,527][52663] Sum rewards: 8.224, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.245', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.113', 'WEAPON3': '0.850', 'ARMOR': '0.913', 'HITCOUNT': '1.190', 'weapon2': '1.564', 'weapon3': '1.894', 'DAMAGECOUNT': '4.254', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:44,866][52811] DAMAGECOUNT value on done: 10994.0 [2024-08-05 22:42:44,868][52811] Sum rewards: 10.827, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.270', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'HITCOUNT': '1.070', 'weapon2': '1.208', 'weapon3': '1.740', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:45,282][52647] DAMAGECOUNT value on done: 11509.0 [2024-08-05 22:42:45,284][52647] Sum rewards: 12.426, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.203', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.206', 'WEAPON3': '0.400', 'HITCOUNT': '0.830', 'ARMOR': '0.963', 'weapon3': '1.314', 'weapon2': '1.516', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:46,048][52662] DAMAGECOUNT value on done: 14410.0 [2024-08-05 22:42:46,049][52662] Sum rewards: 16.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.039', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.404', 'ARMOR': '0.464', 'WEAPON3': '0.550', 'weapon2': '1.150', 'HITCOUNT': '1.230', 'weapon3': '1.748', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:46,125][52665] DAMAGECOUNT value on done: 11565.0 [2024-08-05 22:42:46,127][52665] Sum rewards: 10.113, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.220', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'weapon4': '0.238', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.440', 'weapon3': '1.626', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:46,355][52794] DAMAGECOUNT value on done: 12745.0 [2024-08-05 22:42:46,360][52794] Sum rewards: 5.683, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.656', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.288', 'WEAPON3': '0.450', 'HITCOUNT': '0.630', 'ARMOR': '0.891', 'weapon2': '1.010', 'weapon3': '1.414', 'DAMAGECOUNT': '1.962', 'FRAGCOUNT': '4.000'} [2024-08-05 22:42:46,851][52803] DAMAGECOUNT value on done: 9983.0 [2024-08-05 22:42:46,851][52803] Sum rewards: 7.273, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.176', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '0.932', 'weapon3': '1.010', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:47,638][52669] DAMAGECOUNT value on done: 13218.0 [2024-08-05 22:42:47,639][52669] Sum rewards: 5.966, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.962', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'weapon4': '0.254', 'HITCOUNT': '0.710', 'WEAPON3': '0.750', 'ARMOR': '0.927', 'weapon2': '1.254', 'weapon3': '1.680', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '6.000'} [2024-08-05 22:42:47,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16520.5, 300 sec: 16745.0). Total num frames: 78561280. Throughput: 0: 4133.3. Samples: 19641570. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:42:47,794][52567] Avg episode reward: [(0, '11.215')] [2024-08-05 22:42:47,887][52663] DAMAGECOUNT value on done: 12248.0 [2024-08-05 22:42:47,889][52663] Sum rewards: 15.971, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.656', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.238', 'WEAPON3': '0.550', 'ARMOR': '0.818', 'HITCOUNT': '1.270', 'weapon3': '1.428', 'weapon2': '1.606', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:48,041][52650] Updated weights for policy 0, policy_version 9591 (0.0012) [2024-08-05 22:42:48,145][52811] DAMAGECOUNT value on done: 11800.0 [2024-08-05 22:42:48,153][52811] Sum rewards: 14.768, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.100', 'ARMOR': '0.447', 'WEAPON3': '0.700', 'weapon2': '1.290', 'HITCOUNT': '1.320', 'weapon3': '1.690', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '11.000'} [2024-08-05 22:42:48,301][52647] DAMAGECOUNT value on done: 11871.0 [2024-08-05 22:42:48,302][52647] Sum rewards: 8.192, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.449', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.262', 'ARMOR': '0.504', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.418', 'weapon3': '1.982', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:48,615][52665] DAMAGECOUNT value on done: 11408.0 [2024-08-05 22:42:48,616][52665] Sum rewards: 11.878, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.724', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.332', 'ARMOR': '0.504', 'weapon2': '0.782', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'weapon3': '1.674', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '11.000'} [2024-08-05 22:42:48,710][52662] DAMAGECOUNT value on done: 15776.0 [2024-08-05 22:42:48,710][52662] Sum rewards: 17.099, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.072', 'HEALTH': '0.096', 'WEAPON3': '0.450', 'HITCOUNT': '1.280', 'weapon3': '1.410', 'weapon2': '1.570', 'ARMOR': '1.745', 'DAMAGECOUNT': '4.671', 'FRAGCOUNT': '11.000'} [2024-08-05 22:42:49,158][52794] DAMAGECOUNT value on done: 11899.0 [2024-08-05 22:42:49,159][52794] Sum rewards: 16.859, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.162', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'weapon4': '0.106', 'WEAPON3': '0.500', 'HITCOUNT': '1.010', 'weapon3': '1.384', 'ARMOR': '1.707', 'weapon2': '1.816', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:49,348][52614] Signal inference workers to stop experience collection... (1800 times) [2024-08-05 22:42:49,349][52614] Signal inference workers to resume experience collection... (1800 times) [2024-08-05 22:42:49,402][52650] InferenceWorker_p0-w0: stopping experience collection (1800 times) [2024-08-05 22:42:49,402][52650] InferenceWorker_p0-w0: resuming experience collection (1800 times) [2024-08-05 22:42:50,251][52803] DAMAGECOUNT value on done: 10952.0 [2024-08-05 22:42:50,253][52803] Sum rewards: 13.541, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.672', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.236', 'ARMOR': '0.561', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon2': '1.028', 'weapon3': '1.894', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:50,926][52669] DAMAGECOUNT value on done: 11154.0 [2024-08-05 22:42:50,926][52669] Sum rewards: 12.697, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.565', 'AMMO4': '-0.092', 'AMMO2': '-0.018', 'ARMOR': '0.032', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.274', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon3': '1.398', 'weapon2': '1.470', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:51,107][52665] DAMAGECOUNT value on done: 11603.0 [2024-08-05 22:42:51,110][52665] Sum rewards: 5.043, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.494', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.414', 'ARMOR': '0.436', 'HITCOUNT': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.020', 'weapon3': '1.586', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '6.000'} [2024-08-05 22:42:51,172][52663] DAMAGECOUNT value on done: 11923.0 [2024-08-05 22:42:51,173][52663] Sum rewards: 27.021, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.382', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.114', 'weapon4': '0.204', 'WEAPON3': '0.700', 'ARMOR': '1.296', 'HITCOUNT': '1.370', 'weapon2': '1.566', 'weapon3': '2.078', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '21.000'} [2024-08-05 22:42:51,564][52662] DAMAGECOUNT value on done: 14348.0 [2024-08-05 22:42:51,564][52662] Sum rewards: 11.068, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.228', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'ARMOR': '0.900', 'weapon2': '1.450', 'weapon3': '1.704', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:51,624][52811] DAMAGECOUNT value on done: 8700.0 [2024-08-05 22:42:51,625][52811] Sum rewards: 12.910, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.317', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'weapon4': '0.692', 'HITCOUNT': '0.820', 'weapon2': '0.860', 'WEAPON3': '0.900', 'ARMOR': '1.024', 'weapon3': '1.780', 'DAMAGECOUNT': '3.198', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:51,705][52647] DAMAGECOUNT value on done: 11378.0 [2024-08-05 22:42:51,708][52647] Sum rewards: 8.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.359', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.454', 'ARMOR': '0.464', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.118', 'weapon3': '1.756', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:51,860][52794] DAMAGECOUNT value on done: 14934.0 [2024-08-05 22:42:51,860][52794] Sum rewards: 9.955, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.610', 'AMMO2': '0.001', 'AMMO4': '0.004', 'ARMOR': '0.032', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.248', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.476', 'weapon3': '1.482', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:51,919][52795] DAMAGECOUNT value on done: 9794.0 [2024-08-05 22:42:51,921][52795] Sum rewards: 12.947, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.541', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.172', 'ARMOR': '0.508', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon2': '1.254', 'weapon3': '1.642', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:52,576][52650] Updated weights for policy 0, policy_version 9601 (0.0022) [2024-08-05 22:42:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16657.1, 300 sec: 16800.5). Total num frames: 78651392. Throughput: 0: 4137.3. Samples: 19666550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:42:52,795][52567] Avg episode reward: [(0, '11.591')] [2024-08-05 22:42:52,867][52614] Saving new best policy, reward=11.591! [2024-08-05 22:42:53,704][52803] DAMAGECOUNT value on done: 10002.0 [2024-08-05 22:42:53,707][52803] Sum rewards: 2.733, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.218', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'weapon2': '1.346', 'weapon3': '1.648', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '5.000'} [2024-08-05 22:42:53,960][52669] DAMAGECOUNT value on done: 13857.0 [2024-08-05 22:42:53,962][52669] Sum rewards: 14.943, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.086', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.194', 'ARMOR': '0.444', 'WEAPON3': '0.900', 'weapon2': '1.100', 'HITCOUNT': '1.290', 'weapon3': '1.808', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:53,959][52667] DAMAGECOUNT value on done: 12847.0 [2024-08-05 22:42:53,962][52667] Sum rewards: 6.441, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.620', 'AMMO2': '0.022', 'weapon4': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.111', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'ARMOR': '0.900', 'weapon2': '1.282', 'weapon3': '2.246', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '6.000'} [2024-08-05 22:42:54,124][52665] DAMAGECOUNT value on done: 13298.0 [2024-08-05 22:42:54,124][52665] Sum rewards: 9.790, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.336', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.096', 'weapon4': '0.124', 'WEAPON4': '0.150', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.474', 'weapon3': '1.982', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:54,233][52663] DAMAGECOUNT value on done: 14002.0 [2024-08-05 22:42:54,237][52663] Sum rewards: 13.480, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.153', 'ARMOR': '0.869', 'WEAPON3': '1.100', 'HITCOUNT': '1.140', 'weapon2': '1.492', 'weapon3': '2.390', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:54,375][52662] DAMAGECOUNT value on done: 15012.0 [2024-08-05 22:42:54,375][52662] Sum rewards: 14.339, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.250', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.068', 'WEAPON4': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.450', 'ARMOR': '0.845', 'HITCOUNT': '0.950', 'weapon3': '1.264', 'weapon2': '1.314', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:54,646][52794] DAMAGECOUNT value on done: 13113.0 [2024-08-05 22:42:54,647][52794] Sum rewards: 7.618, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.117', 'weapon4': '0.350', 'ARMOR': '0.428', 'HITCOUNT': '0.610', 'HEALTH': '0.638', 'WEAPON3': '0.650', 'weapon2': '1.360', 'weapon3': '1.554', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:54,717][52647] DAMAGECOUNT value on done: 14047.0 [2024-08-05 22:42:54,720][52647] Sum rewards: 10.899, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.150', 'AMMO5': '0.013', 'AMMO2': '0.015', 'ARMOR': '0.056', 'weapon5': '0.062', 'AMMO4': '0.076', 'weapon4': '0.084', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '1.020', 'weapon2': '1.066', 'weapon3': '2.204', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:54,833][52811] DAMAGECOUNT value on done: 11064.0 [2024-08-05 22:42:54,834][52811] Sum rewards: 4.126, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.860', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.220', 'ARMOR': '0.522', 'HITCOUNT': '0.530', 'WEAPON3': '0.600', 'weapon2': '1.240', 'weapon3': '1.288', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '3.000'} [2024-08-05 22:42:55,160][52795] DAMAGECOUNT value on done: 10573.0 [2024-08-05 22:42:55,163][52795] Sum rewards: 7.045, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.522', 'AMMO2': '0.022', 'weapon7': '0.060', 'ARMOR': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.120', 'WEAPON4': '0.350', 'HITCOUNT': '0.410', 'weapon4': '0.504', 'weapon2': '0.762', 'WEAPON3': '0.800', 'weapon3': '1.842', 'DAMAGECOUNT': '2.217', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:56,489][52665] DAMAGECOUNT value on done: 11519.0 [2024-08-05 22:42:56,490][52665] Sum rewards: 8.149, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.972', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.454', 'HITCOUNT': '0.760', 'ARMOR': '0.829', 'WEAPON3': '0.950', 'weapon2': '1.104', 'weapon3': '1.662', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:57,081][52662] DAMAGECOUNT value on done: 12835.0 [2024-08-05 22:42:57,081][52662] Sum rewards: 9.237, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.847', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'weapon7': '0.056', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.476', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.112', 'ARMOR': '1.407', 'weapon3': '1.812', 'DAMAGECOUNT': '2.247', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:57,258][52803] DAMAGECOUNT value on done: 11292.0 [2024-08-05 22:42:57,260][52803] Sum rewards: 5.297, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.866', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'weapon4': '0.202', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'ARMOR': '1.409', 'weapon2': '1.502', 'weapon3': '1.778', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '7.000'} [2024-08-05 22:42:57,321][52669] DAMAGECOUNT value on done: 12566.0 [2024-08-05 22:42:57,322][52669] Sum rewards: 9.861, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'HEALTH': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.494', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon2': '1.152', 'weapon3': '1.942', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:57,345][52667] DAMAGECOUNT value on done: 12459.0 [2024-08-05 22:42:57,345][52667] Sum rewards: 18.028, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.786', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.252', 'WEAPON3': '0.550', 'HITCOUNT': '1.030', 'weapon2': '1.448', 'weapon3': '1.480', 'ARMOR': '2.260', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '13.000'} [2024-08-05 22:42:57,385][52794] DAMAGECOUNT value on done: 13468.0 [2024-08-05 22:42:57,385][52794] Sum rewards: 9.958, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO3': '0.040', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.074', 'WEAPON3': '0.250', 'HEALTH': '0.502', 'HITCOUNT': '0.630', 'ARMOR': '0.895', 'weapon3': '0.962', 'weapon2': '1.466', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '5.000'} [2024-08-05 22:42:57,506][52663] DAMAGECOUNT value on done: 11253.0 [2024-08-05 22:42:57,508][52663] Sum rewards: 11.987, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.016', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.336', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'weapon2': '1.188', 'weapon3': '1.726', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '10.000'} [2024-08-05 22:42:57,711][52650] Updated weights for policy 0, policy_version 9611 (0.0012) [2024-08-05 22:42:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16520.5, 300 sec: 16772.8). Total num frames: 78733312. Throughput: 0: 4160.9. Samples: 19691740. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 22:42:57,795][52567] Avg episode reward: [(0, '11.605')] [2024-08-05 22:42:57,797][52614] Saving new best policy, reward=11.605! [2024-08-05 22:42:57,847][52647] DAMAGECOUNT value on done: 11350.0 [2024-08-05 22:42:57,847][52647] Sum rewards: 9.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.822', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.022', 'weapon4': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '1.210', 'ARMOR': '1.333', 'weapon3': '1.544', 'DAMAGECOUNT': '2.316', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:58,253][52811] DAMAGECOUNT value on done: 11905.0 [2024-08-05 22:42:58,253][52811] Sum rewards: 8.039, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.140', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.069', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'HITCOUNT': '0.710', 'weapon2': '0.902', 'weapon3': '1.012', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '6.000'} [2024-08-05 22:42:58,482][52795] DAMAGECOUNT value on done: 10986.0 [2024-08-05 22:42:58,483][52795] Sum rewards: 10.705, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.782', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.300', 'ARMOR': '0.560', 'weapon4': '0.608', 'WEAPON3': '0.700', 'weapon2': '0.880', 'HITCOUNT': '0.990', 'weapon3': '1.952', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:59,632][52662] DAMAGECOUNT value on done: 13892.0 [2024-08-05 22:42:59,633][52662] Sum rewards: 13.680, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.120', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.372', 'WEAPON3': '0.650', 'ARMOR': '1.008', 'HITCOUNT': '1.050', 'weapon2': '1.248', 'weapon3': '1.816', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '12.000'} [2024-08-05 22:42:59,647][52665] DAMAGECOUNT value on done: 12093.0 [2024-08-05 22:42:59,650][52665] Sum rewards: 7.276, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.474', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.328', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'weapon2': '1.276', 'ARMOR': '1.320', 'weapon3': '1.780', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '9.000'} [2024-08-05 22:42:59,843][52794] DAMAGECOUNT value on done: 13714.0 [2024-08-05 22:42:59,846][52794] Sum rewards: 9.541, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.424', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.310', 'ARMOR': '0.523', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon2': '1.278', 'weapon3': '1.898', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '8.000'} [2024-08-05 22:42:59,855][52669] DAMAGECOUNT value on done: 12986.0 [2024-08-05 22:42:59,855][52669] Sum rewards: 11.607, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.470', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.124', 'WEAPON3': '0.700', 'weapon2': '0.724', 'ARMOR': '0.873', 'HITCOUNT': '0.960', 'weapon3': '1.668', 'DAMAGECOUNT': '3.312', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:00,125][52663] DAMAGECOUNT value on done: 12159.0 [2024-08-05 22:43:00,129][52663] Sum rewards: 10.779, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.466', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.060', 'ARMOR': '0.064', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.460', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'weapon2': '1.194', 'weapon3': '1.392', 'DAMAGECOUNT': '1.887', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:00,332][52667] DAMAGECOUNT value on done: 12158.0 [2024-08-05 22:43:00,332][52667] Sum rewards: 14.310, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.002', 'AMMO4': '0.009', 'HEALTH': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon4': '0.090', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'ARMOR': '0.981', 'weapon2': '1.674', 'weapon3': '1.712', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:00,665][52803] DAMAGECOUNT value on done: 11540.0 [2024-08-05 22:43:00,667][52803] Sum rewards: 11.178, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.020', 'HEALTH': '0.044', 'weapon5': '0.046', 'ARMOR': '0.068', 'AMMO3': '0.071', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.446', 'WEAPON3': '0.450', 'weapon2': '0.704', 'HITCOUNT': '0.820', 'weapon3': '1.410', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:01,371][52647] DAMAGECOUNT value on done: 13479.0 [2024-08-05 22:43:01,372][52647] Sum rewards: 11.363, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.535', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON3': '0.650', 'weapon2': '1.026', 'HITCOUNT': '1.050', 'weapon3': '1.638', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:01,513][52811] DAMAGECOUNT value on done: 12853.0 [2024-08-05 22:43:01,515][52811] Sum rewards: 18.988, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'ARMOR': '0.116', 'WEAPON4': '0.350', 'weapon4': '0.584', 'weapon2': '0.740', 'WEAPON3': '0.900', 'HITCOUNT': '1.460', 'weapon3': '2.076', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '16.000'} [2024-08-05 22:43:01,871][52795] DAMAGECOUNT value on done: 12768.0 [2024-08-05 22:43:01,871][52795] Sum rewards: 11.287, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.010', 'HEALTH': '0.031', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.074', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.278', 'WEAPON3': '0.450', 'HITCOUNT': '0.880', 'ARMOR': '0.887', 'weapon2': '1.024', 'weapon3': '1.518', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:02,218][52662] DAMAGECOUNT value on done: 14076.0 [2024-08-05 22:43:02,218][52662] Sum rewards: 20.389, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'weapon7': '0.052', 'ARMOR': '0.064', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.400', 'WEAPON3': '0.500', 'weapon2': '1.370', 'HITCOUNT': '1.480', 'weapon3': '1.560', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '15.000'} [2024-08-05 22:43:02,479][52665] DAMAGECOUNT value on done: 12917.0 [2024-08-05 22:43:02,480][52665] Sum rewards: 10.755, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.220', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.314', 'ARMOR': '0.487', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'weapon3': '1.582', 'weapon2': '1.982', 'DAMAGECOUNT': '3.843', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:02,647][52650] Updated weights for policy 0, policy_version 9621 (0.0013) [2024-08-05 22:43:02,724][52669] DAMAGECOUNT value on done: 12225.0 [2024-08-05 22:43:02,727][52669] Sum rewards: 6.745, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.044', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon2': '0.996', 'weapon3': '1.506', 'DAMAGECOUNT': '2.109', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:02,784][52794] DAMAGECOUNT value on done: 13350.0 [2024-08-05 22:43:02,784][52794] Sum rewards: 10.183, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.712', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.256', 'WEAPON3': '0.850', 'ARMOR': '0.948', 'HITCOUNT': '1.050', 'weapon2': '1.278', 'weapon3': '1.976', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:02,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16657.0, 300 sec: 16800.5). Total num frames: 78815232. Throughput: 0: 4156.4. Samples: 19703710. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 22:43:02,795][52567] Avg episode reward: [(0, '11.510')] [2024-08-05 22:43:03,167][52663] DAMAGECOUNT value on done: 15025.0 [2024-08-05 22:43:03,175][52663] Sum rewards: 11.448, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.118', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.084', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '0.920', 'ARMOR': '0.954', 'weapon3': '1.460', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:03,352][52667] DAMAGECOUNT value on done: 13468.0 [2024-08-05 22:43:03,354][52667] Sum rewards: 17.462, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.874', 'AMMO4': '-0.091', 'AMMO2': '-0.018', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.264', 'WEAPON3': '0.750', 'HITCOUNT': '1.100', 'ARMOR': '1.394', 'weapon2': '1.430', 'weapon3': '1.662', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '15.000'} [2024-08-05 22:43:04,007][52803] DAMAGECOUNT value on done: 10463.0 [2024-08-05 22:43:04,007][52803] Sum rewards: 11.059, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.524', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.072', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.220', 'ARMOR': '0.490', 'WEAPON3': '0.550', 'weapon2': '0.838', 'HITCOUNT': '0.940', 'weapon3': '1.396', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:04,564][52647] DAMAGECOUNT value on done: 12279.0 [2024-08-05 22:43:04,564][52647] Sum rewards: 12.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.906', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'ARMOR': '0.412', 'WEAPON3': '0.900', 'HITCOUNT': '1.090', 'weapon2': '1.340', 'weapon3': '2.296', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:04,877][52811] DAMAGECOUNT value on done: 10537.0 [2024-08-05 22:43:04,881][52811] Sum rewards: 1.959, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.521', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.482', 'HITCOUNT': '0.520', 'WEAPON3': '0.550', 'ARMOR': '0.915', 'weapon2': '1.418', 'weapon3': '1.450', 'DAMAGECOUNT': '1.557', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:05,114][52665] DAMAGECOUNT value on done: 12835.0 [2024-08-05 22:43:05,115][52665] Sum rewards: 11.321, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.270', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'weapon5': '0.214', 'ARMOR': '0.437', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.300', 'weapon3': '1.720', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:05,188][52795] DAMAGECOUNT value on done: 12865.0 [2024-08-05 22:43:05,191][52795] Sum rewards: 19.476, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.214', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.444', 'ARMOR': '0.488', 'WEAPON3': '0.900', 'weapon2': '0.900', 'HITCOUNT': '1.420', 'weapon3': '2.342', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '16.000'} [2024-08-05 22:43:05,199][52662] DAMAGECOUNT value on done: 13124.0 [2024-08-05 22:43:05,199][52662] Sum rewards: 10.709, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.750', 'ARMOR': '0.952', 'HITCOUNT': '0.960', 'weapon2': '1.480', 'weapon3': '1.772', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:05,484][52794] DAMAGECOUNT value on done: 15156.0 [2024-08-05 22:43:05,484][52794] Sum rewards: 8.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.314', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.150', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'weapon2': '0.798', 'HITCOUNT': '0.960', 'weapon3': '1.696', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:06,072][52669] DAMAGECOUNT value on done: 12535.0 [2024-08-05 22:43:06,072][52669] Sum rewards: 8.794, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.728', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.158', 'ARMOR': '0.853', 'HITCOUNT': '0.930', 'WEAPON3': '0.950', 'weapon2': '1.430', 'weapon3': '2.066', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:06,396][52663] DAMAGECOUNT value on done: 10935.0 [2024-08-05 22:43:06,396][52663] Sum rewards: 4.796, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.172', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.342', 'ARMOR': '0.482', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '1.162', 'weapon3': '1.666', 'DAMAGECOUNT': '1.797', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:06,898][52667] DAMAGECOUNT value on done: 13544.0 [2024-08-05 22:43:06,899][52667] Sum rewards: 21.146, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.370', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.100', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'HITCOUNT': '1.480', 'weapon2': '1.616', 'weapon3': '1.870', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '17.000'} [2024-08-05 22:43:07,404][52650] Updated weights for policy 0, policy_version 9631 (0.0033) [2024-08-05 22:43:07,505][52803] DAMAGECOUNT value on done: 11326.0 [2024-08-05 22:43:07,505][52803] Sum rewards: 11.605, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.662', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon4': '0.108', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'ARMOR': '0.824', 'weapon2': '0.914', 'WEAPON3': '0.950', 'HITCOUNT': '1.020', 'weapon3': '2.326', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:07,657][52647] DAMAGECOUNT value on done: 12402.0 [2024-08-05 22:43:07,657][52647] Sum rewards: 10.573, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.700', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO3': '0.114', 'ARMOR': '0.453', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon2': '1.420', 'weapon3': '1.794', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:07,685][52665] DAMAGECOUNT value on done: 12415.0 [2024-08-05 22:43:07,686][52665] Sum rewards: 8.808, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.216', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.274', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'ARMOR': '0.883', 'weapon2': '1.150', 'weapon3': '1.416', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:07,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16384.0, 300 sec: 16772.8). Total num frames: 78897152. Throughput: 0: 4149.4. Samples: 19728970. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:43:07,794][52567] Avg episode reward: [(0, '11.331')] [2024-08-05 22:43:08,009][52662] DAMAGECOUNT value on done: 13916.0 [2024-08-05 22:43:08,012][52662] Sum rewards: 9.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.632', 'AMMO2': '0.022', 'AMMO3': '0.060', 'AMMO4': '0.111', 'WEAPON4': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'weapon3': '1.190', 'ARMOR': '1.208', 'weapon2': '1.576', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:08,246][52811] DAMAGECOUNT value on done: 11436.0 [2024-08-05 22:43:08,247][52811] Sum rewards: 10.260, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.862', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.140', 'weapon5': '0.142', 'ARMOR': '0.499', 'WEAPON3': '0.650', 'HITCOUNT': '0.900', 'weapon2': '1.418', 'weapon3': '1.600', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:08,385][52794] DAMAGECOUNT value on done: 13573.0 [2024-08-05 22:43:08,385][52794] Sum rewards: 7.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.252', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'HITCOUNT': '0.670', 'weapon2': '1.262', 'weapon3': '1.492', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:08,484][52795] DAMAGECOUNT value on done: 13898.0 [2024-08-05 22:43:08,484][52795] Sum rewards: 8.139, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.554', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'weapon7': '0.068', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.266', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'ARMOR': '0.848', 'weapon2': '0.974', 'weapon3': '1.328', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:08,594][52669] DAMAGECOUNT value on done: 11919.0 [2024-08-05 22:43:08,596][52669] Sum rewards: 11.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.890', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.146', 'ARMOR': '0.451', 'WEAPON3': '0.950', 'HITCOUNT': '1.360', 'weapon2': '1.616', 'weapon3': '2.058', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:08,840][52663] DAMAGECOUNT value on done: 12093.0 [2024-08-05 22:43:08,841][52663] Sum rewards: 7.983, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.338', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.014', 'ARMOR': '0.024', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.276', 'weapon2': '0.798', 'HITCOUNT': '0.840', 'WEAPON3': '0.900', 'weapon3': '2.320', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:09,996][52667] DAMAGECOUNT value on done: 14050.0 [2024-08-05 22:43:09,997][52667] Sum rewards: 11.144, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.445', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.328', 'ARMOR': '0.505', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'weapon2': '1.450', 'weapon3': '1.720', 'DAMAGECOUNT': '3.624', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:10,747][52803] DAMAGECOUNT value on done: 12339.0 [2024-08-05 22:43:10,747][52803] Sum rewards: 8.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.760', 'weapon5': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.268', 'WEAPON3': '0.850', 'ARMOR': '0.896', 'HITCOUNT': '1.030', 'weapon2': '1.560', 'weapon3': '1.756', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:10,812][52665] DAMAGECOUNT value on done: 11694.0 [2024-08-05 22:43:10,814][52665] Sum rewards: 10.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.748', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.282', 'ARMOR': '0.542', 'WEAPON3': '1.000', 'HITCOUNT': '1.050', 'weapon2': '1.294', 'weapon3': '2.038', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:10,913][52662] DAMAGECOUNT value on done: 13769.0 [2024-08-05 22:43:10,913][52662] Sum rewards: 11.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.954', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.098', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.438', 'weapon3': '1.464', 'ARMOR': '1.512', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:11,135][52794] DAMAGECOUNT value on done: 14381.0 [2024-08-05 22:43:11,136][52794] Sum rewards: 8.540, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon7': '0.048', 'ARMOR': '0.079', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.492', 'HITCOUNT': '0.660', 'weapon2': '0.730', 'HEALTH': '0.874', 'weapon3': '1.518', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:11,249][52669] DAMAGECOUNT value on done: 12185.0 [2024-08-05 22:43:11,249][52669] Sum rewards: 6.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO2': '0.011', 'ARMOR': '0.024', 'AMMO4': '0.052', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'weapon4': '0.446', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.124', 'weapon3': '1.716', 'DAMAGECOUNT': '2.118', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:11,250][52647] DAMAGECOUNT value on done: 11682.0 [2024-08-05 22:43:11,251][52647] Sum rewards: 10.528, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.100', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'ARMOR': '0.024', 'weapon5': '0.060', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.236', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '0.902', 'weapon3': '1.978', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:11,405][52811] DAMAGECOUNT value on done: 10150.0 [2024-08-05 22:43:11,405][52811] Sum rewards: 3.083, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.540', 'AMMO2': '0.015', 'weapon7': '0.052', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.406', 'HITCOUNT': '0.490', 'WEAPON3': '0.550', 'weapon2': '0.870', 'weapon3': '1.276', 'ARMOR': '1.411', 'DAMAGECOUNT': '1.674', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:11,777][52795] DAMAGECOUNT value on done: 11954.0 [2024-08-05 22:43:11,778][52795] Sum rewards: 8.563, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.360', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'WEAPON7': '0.200', 'HITCOUNT': '0.770', 'WEAPON3': '0.850', 'ARMOR': '0.900', 'weapon2': '1.572', 'weapon3': '1.608', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:11,944][52663] DAMAGECOUNT value on done: 13562.0 [2024-08-05 22:43:11,945][52663] Sum rewards: 16.258, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.056', 'weapon5': '0.070', 'AMMO3': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.550', 'weapon2': '0.722', 'HITCOUNT': '1.120', 'weapon3': '1.558', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:12,136][52650] Updated weights for policy 0, policy_version 9641 (0.0016) [2024-08-05 22:43:12,794][52567] Fps is (10 sec: 17203.7, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 78987264. Throughput: 0: 4162.4. Samples: 19754240. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:43:12,794][52567] Avg episode reward: [(0, '10.951')] [2024-08-05 22:43:13,028][52667] DAMAGECOUNT value on done: 12764.0 [2024-08-05 22:43:13,032][52667] Sum rewards: 11.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.242', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'weapon4': '0.350', 'ARMOR': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.026', 'HITCOUNT': '1.170', 'weapon3': '2.358', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:13,279][52662] DAMAGECOUNT value on done: 13200.0 [2024-08-05 22:43:13,280][52662] Sum rewards: 17.154, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.544', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.086', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon3': '1.520', 'weapon2': '1.554', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:13,458][52794] DAMAGECOUNT value on done: 14766.0 [2024-08-05 22:43:13,458][52794] Sum rewards: 6.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO2': '0.026', 'ARMOR': '0.078', 'AMMO3': '0.093', 'AMMO4': '0.129', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '0.936', 'weapon3': '1.920', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:13,950][52803] DAMAGECOUNT value on done: 10222.0 [2024-08-05 22:43:13,950][52803] Sum rewards: 12.272, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.281', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.150', 'weapon4': '0.252', 'WEAPON3': '0.650', 'ARMOR': '0.946', 'weapon2': '1.112', 'HITCOUNT': '1.180', 'weapon3': '1.380', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:14,150][52665] DAMAGECOUNT value on done: 12666.0 [2024-08-05 22:43:14,150][52665] Sum rewards: 7.926, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.783', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'ARMOR': '0.940', 'weapon2': '1.424', 'weapon3': '1.788', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:14,574][52649] DAMAGECOUNT value on done: 12673.0 [2024-08-05 22:43:14,575][52649] Sum rewards: 13.181, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.378', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon7': '0.066', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.600', 'ARMOR': '0.853', 'HITCOUNT': '1.030', 'weapon3': '1.572', 'weapon2': '1.818', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:14,761][52663] DAMAGECOUNT value on done: 11597.0 [2024-08-05 22:43:14,761][52811] DAMAGECOUNT value on done: 11892.0 [2024-08-05 22:43:14,763][52663] Sum rewards: 11.435, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.880', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.146', 'WEAPON3': '0.300', 'ARMOR': '0.465', 'HITCOUNT': '0.840', 'weapon3': '0.932', 'weapon2': '1.228', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:14,765][52811] Sum rewards: 5.679, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.341', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.314', 'ARMOR': '0.432', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'weapon2': '0.904', 'DAMAGECOUNT': '1.602', 'weapon3': '1.650', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:15,162][52795] DAMAGECOUNT value on done: 11926.0 [2024-08-05 22:43:15,165][52795] Sum rewards: 3.770, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.664', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON3': '0.500', 'HITCOUNT': '0.590', 'ARMOR': '0.974', 'weapon3': '1.418', 'weapon2': '1.858', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:15,397][52667] DAMAGECOUNT value on done: 11862.0 [2024-08-05 22:43:15,398][52667] Sum rewards: 12.780, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.143', 'AMMO2': '0.020', 'AMMO3': '0.079', 'weapon7': '0.080', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON3': '0.500', 'HITCOUNT': '0.870', 'ARMOR': '0.904', 'weapon3': '1.226', 'weapon2': '1.324', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:15,918][52662] DAMAGECOUNT value on done: 14918.0 [2024-08-05 22:43:15,919][52662] Sum rewards: 12.936, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.474', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.322', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.074', 'ARMOR': '1.388', 'weapon3': '1.474', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:16,113][52794] DAMAGECOUNT value on done: 13893.0 [2024-08-05 22:43:16,114][52794] Sum rewards: 17.237, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.780', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.388', 'ARMOR': '0.512', 'WEAPON3': '0.650', 'HITCOUNT': '1.070', 'weapon3': '1.626', 'weapon2': '1.652', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:16,434][52658] DAMAGECOUNT value on done: 11998.0 [2024-08-05 22:43:16,434][52658] Sum rewards: 15.533, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.506', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon5': '0.034', 'AMMO4': '0.036', 'AMMO3': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'weapon4': '0.502', 'HITCOUNT': '0.960', 'ARMOR': '0.970', 'weapon2': '1.164', 'weapon3': '1.426', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:17,036][52803] DAMAGECOUNT value on done: 10064.0 [2024-08-05 22:43:17,039][52803] Sum rewards: 5.397, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.047', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.514', 'weapon4': '0.526', 'HITCOUNT': '0.580', 'WEAPON3': '0.600', 'weapon2': '0.790', 'weapon3': '1.802', 'DAMAGECOUNT': '1.995', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:17,237][52650] Updated weights for policy 0, policy_version 9651 (0.0012) [2024-08-05 22:43:17,528][52665] DAMAGECOUNT value on done: 10881.0 [2024-08-05 22:43:17,532][52665] Sum rewards: 7.958, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'AMMO2': '0.028', 'ARMOR': '0.092', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'weapon2': '1.292', 'weapon3': '1.972', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:17,713][52663] DAMAGECOUNT value on done: 11196.0 [2024-08-05 22:43:17,714][52663] Sum rewards: 11.525, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.250', 'ARMOR': '0.536', 'weapon4': '0.620', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.050', 'weapon3': '1.588', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:17,794][52567] Fps is (10 sec: 17202.6, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 79069184. Throughput: 0: 4173.5. Samples: 19766910. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:43:17,795][52567] Avg episode reward: [(0, '10.809')] [2024-08-05 22:43:17,922][52649] DAMAGECOUNT value on done: 10982.0 [2024-08-05 22:43:17,922][52649] Sum rewards: 11.378, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.726', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.093', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.940', 'weapon2': '1.212', 'ARMOR': '1.330', 'weapon3': '1.942', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:18,041][52811] DAMAGECOUNT value on done: 10378.0 [2024-08-05 22:43:18,042][52811] Sum rewards: 4.663, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.288', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.050', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.350', 'HITCOUNT': '0.420', 'weapon3': '0.734', 'ARMOR': '0.844', 'weapon2': '0.982', 'DAMAGECOUNT': '1.230', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:18,370][52667] DAMAGECOUNT value on done: 12065.0 [2024-08-05 22:43:18,380][52667] Sum rewards: 9.510, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.785', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'ARMOR': '0.857', 'weapon3': '1.416', 'weapon2': '1.964', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:18,496][52795] DAMAGECOUNT value on done: 10956.0 [2024-08-05 22:43:18,499][52795] Sum rewards: 7.179, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.050', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.026', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'WEAPON3': '0.350', 'HITCOUNT': '0.660', 'weapon3': '1.182', 'weapon2': '1.586', 'DAMAGECOUNT': '1.989', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:18,645][52662] DAMAGECOUNT value on done: 13452.0 [2024-08-05 22:43:18,646][52662] Sum rewards: 7.674, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.419', 'AMMO2': '0.023', 'AMMO3': '0.087', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.236', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'HITCOUNT': '0.800', 'weapon2': '0.948', 'weapon3': '1.170', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:18,865][52794] DAMAGECOUNT value on done: 14067.0 [2024-08-05 22:43:18,865][52794] Sum rewards: 0.391, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.291', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'ARMOR': '0.040', 'AMMO3': '0.081', 'WEAPON4': '0.200', 'HITCOUNT': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.650', 'weapon2': '0.908', 'FRAGCOUNT': '1.000', 'DAMAGECOUNT': '1.248', 'weapon3': '1.338'} [2024-08-05 22:43:19,218][52658] DAMAGECOUNT value on done: 12594.0 [2024-08-05 22:43:19,219][52658] Sum rewards: 10.884, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.500', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'weapon5': '0.056', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.318', 'ARMOR': '0.897', 'WEAPON3': '1.000', 'HITCOUNT': '1.040', 'weapon2': '1.100', 'weapon3': '1.702', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:20,043][52665] DAMAGECOUNT value on done: 11885.0 [2024-08-05 22:43:20,046][52665] Sum rewards: 0.450, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.274', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.121', 'WEAPON4': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.565', 'weapon4': '0.746', 'WEAPON3': '0.800', 'DAMAGECOUNT': '0.939', 'weapon2': '1.138', 'weapon3': '1.452', 'FRAGCOUNT': '2.000'} [2024-08-05 22:43:20,331][52803] DAMAGECOUNT value on done: 10598.0 [2024-08-05 22:43:20,334][52803] Sum rewards: 7.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.200', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'ARMOR': '0.487', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.166', 'weapon3': '1.662', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:20,412][52649] DAMAGECOUNT value on done: 11317.0 [2024-08-05 22:43:20,412][52649] Sum rewards: 11.629, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.890', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.316', 'ARMOR': '0.480', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.344', 'weapon3': '1.784', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:20,991][52663] DAMAGECOUNT value on done: 12512.0 [2024-08-05 22:43:20,991][52663] Sum rewards: 6.646, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.020', 'HEALTH': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.097', 'weapon4': '0.122', 'ARMOR': '0.467', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon2': '1.314', 'weapon3': '1.462', 'DAMAGECOUNT': '2.304', 'FRAGCOUNT': '4.000'} [2024-08-05 22:43:21,058][52664] DAMAGECOUNT value on done: 13764.0 [2024-08-05 22:43:21,059][52664] Sum rewards: 14.395, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.808', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.165', 'weapon4': '0.498', 'ARMOR': '0.820', 'WEAPON3': '1.000', 'HITCOUNT': '1.080', 'weapon2': '1.116', 'weapon3': '1.870', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:21,104][52667] DAMAGECOUNT value on done: 13115.0 [2024-08-05 22:43:21,105][52667] Sum rewards: 9.310, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.018', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.068', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '0.840', 'weapon3': '1.194', 'weapon2': '1.926', 'DAMAGECOUNT': '2.490', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:21,324][52662] DAMAGECOUNT value on done: 14771.0 [2024-08-05 22:43:21,326][52662] Sum rewards: 17.732, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.161', 'AMMO2': '0.006', 'weapon4': '0.026', 'AMMO4': '0.031', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.320', 'weapon3': '1.648', 'weapon2': '1.712', 'DAMAGECOUNT': '4.479', 'FRAGCOUNT': '13.000'} [2024-08-05 22:43:21,348][52811] DAMAGECOUNT value on done: 10954.0 [2024-08-05 22:43:21,355][52811] Sum rewards: 13.145, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.942', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'weapon4': '0.352', 'WEAPON3': '0.500', 'ARMOR': '0.946', 'HITCOUNT': '1.000', 'weapon2': '1.330', 'weapon3': '1.426', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:21,518][52794] DAMAGECOUNT value on done: 14115.0 [2024-08-05 22:43:21,519][52794] Sum rewards: 10.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.199', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'weapon4': '0.276', 'WEAPON3': '0.800', 'ARMOR': '0.845', 'HITCOUNT': '1.030', 'weapon2': '1.060', 'weapon3': '1.376', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:21,709][52795] DAMAGECOUNT value on done: 12633.0 [2024-08-05 22:43:21,711][52795] Sum rewards: 17.944, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.605', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.102', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'weapon2': '1.250', 'weapon3': '1.454', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:21,967][52650] Updated weights for policy 0, policy_version 9661 (0.0025) [2024-08-05 22:43:22,093][52658] DAMAGECOUNT value on done: 10723.0 [2024-08-05 22:43:22,095][52658] Sum rewards: 10.727, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.186', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon7': '0.058', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.630', 'WEAPON3': '0.650', 'ARMOR': '0.929', 'weapon2': '1.102', 'weapon3': '1.602', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 79151104. Throughput: 0: 4184.0. Samples: 19792410. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:43:22,795][52567] Avg episode reward: [(0, '10.384')] [2024-08-05 22:43:23,542][52663] DAMAGECOUNT value on done: 12369.0 [2024-08-05 22:43:23,544][52663] Sum rewards: 6.978, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.474', 'AMMO2': '0.021', 'ARMOR': '0.028', 'AMMO3': '0.063', 'AMMO4': '0.104', 'weapon7': '0.118', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.446', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon2': '0.988', 'weapon3': '1.320', 'DAMAGECOUNT': '2.334', 'FRAGCOUNT': '4.000'} [2024-08-05 22:43:23,546][52803] DAMAGECOUNT value on done: 11500.0 [2024-08-05 22:43:23,552][52803] Sum rewards: 11.487, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.657', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.095', 'weapon4': '0.188', 'ARMOR': '0.475', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon3': '1.510', 'weapon2': '1.602', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:23,717][52649] DAMAGECOUNT value on done: 13587.0 [2024-08-05 22:43:23,717][52649] Sum rewards: 7.168, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.639', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.040', 'AMMO3': '0.073', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.306', 'WEAPON3': '0.550', 'HITCOUNT': '0.710', 'weapon2': '1.310', 'weapon3': '1.624', 'DAMAGECOUNT': '2.208', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:23,832][52667] DAMAGECOUNT value on done: 11295.0 [2024-08-05 22:43:23,833][52667] Sum rewards: 15.537, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.672', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.036', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.184', 'WEAPON3': '0.500', 'HITCOUNT': '0.980', 'weapon3': '1.406', 'weapon2': '1.660', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:23,858][52662] DAMAGECOUNT value on done: 14380.0 [2024-08-05 22:43:23,858][52662] Sum rewards: 14.884, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.663', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'ARMOR': '0.040', 'AMMO3': '0.068', 'WEAPON4': '0.200', 'weapon4': '0.438', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '0.906', 'weapon3': '1.256', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '13.000'} [2024-08-05 22:43:24,010][52664] DAMAGECOUNT value on done: 11962.0 [2024-08-05 22:43:24,011][52664] Sum rewards: 5.247, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.017', 'HEALTH': '0.038', 'AMMO3': '0.063', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.256', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'ARMOR': '0.996', 'weapon2': '1.172', 'weapon3': '1.340', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:24,521][52811] DAMAGECOUNT value on done: 10791.0 [2024-08-05 22:43:24,522][52811] Sum rewards: 16.580, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.423', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.040', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.374', 'WEAPON3': '0.800', 'weapon2': '1.334', 'HITCOUNT': '1.370', 'weapon3': '1.968', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '13.000'} [2024-08-05 22:43:24,784][52658] DAMAGECOUNT value on done: 11582.0 [2024-08-05 22:43:24,786][52658] Sum rewards: 8.814, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.983', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'HITCOUNT': '0.700', 'WEAPON3': '0.750', 'ARMOR': '0.844', 'weapon3': '1.426', 'weapon2': '1.452', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:25,230][52795] DAMAGECOUNT value on done: 10535.0 [2024-08-05 22:43:25,231][52795] Sum rewards: 14.518, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.961', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'ARMOR': '0.024', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.212', 'WEAPON3': '0.650', 'HITCOUNT': '1.040', 'weapon2': '1.210', 'weapon3': '1.518', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:26,440][52667] DAMAGECOUNT value on done: 12900.0 [2024-08-05 22:43:26,440][52667] Sum rewards: 4.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.440', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'ARMOR': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'weapon5': '0.332', 'weapon4': '0.348', 'HITCOUNT': '0.910', 'WEAPON3': '1.000', 'weapon2': '1.048', 'weapon3': '1.904', 'DAMAGECOUNT': '3.339', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:26,610][52663] DAMAGECOUNT value on done: 12761.0 [2024-08-05 22:43:26,612][52663] Sum rewards: 12.258, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.950', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.044', 'weapon5': '0.068', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '1.318', 'weapon3': '1.966', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:26,732][52803] DAMAGECOUNT value on done: 11855.0 [2024-08-05 22:43:26,734][52803] Sum rewards: 14.447, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.208', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.492', 'WEAPON3': '0.700', 'ARMOR': '0.946', 'HITCOUNT': '1.040', 'weapon2': '1.190', 'weapon3': '1.584', 'DAMAGECOUNT': '4.110', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:26,757][52662] DAMAGECOUNT value on done: 13803.0 [2024-08-05 22:43:26,757][52662] Sum rewards: 19.731, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.105', 'HEALTH': '0.265', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.240', 'weapon2': '1.450', 'weapon3': '1.890', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '15.000'} [2024-08-05 22:43:26,906][52650] Updated weights for policy 0, policy_version 9671 (0.0035) [2024-08-05 22:43:26,929][52649] DAMAGECOUNT value on done: 12144.0 [2024-08-05 22:43:26,930][52649] Sum rewards: 16.628, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO4': '0.086', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.428', 'WEAPON3': '0.600', 'HEALTH': '0.768', 'weapon2': '1.006', 'HITCOUNT': '1.370', 'weapon3': '1.936', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:27,284][52664] DAMAGECOUNT value on done: 12868.0 [2024-08-05 22:43:27,285][52664] Sum rewards: 13.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.296', 'AMMO2': '0.022', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.135', 'weapon4': '0.268', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'weapon2': '1.264', 'weapon3': '1.728', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:27,297][52658] DAMAGECOUNT value on done: 12121.0 [2024-08-05 22:43:27,299][52658] Sum rewards: 10.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.180', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'weapon4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.135', 'WEAPON5': '0.250', 'ARMOR': '0.432', 'HITCOUNT': '0.960', 'WEAPON3': '1.000', 'weapon2': '1.496', 'weapon3': '1.948', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:27,742][52811] DAMAGECOUNT value on done: 11164.0 [2024-08-05 22:43:27,744][52811] Sum rewards: 5.413, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.435', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'weapon4': '0.264', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.006', 'weapon3': '1.576', 'DAMAGECOUNT': '1.890', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:27,795][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.5, 300 sec: 16800.5). Total num frames: 79241216. Throughput: 0: 4183.8. Samples: 19817440. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:43:27,795][52567] Avg episode reward: [(0, '10.760')] [2024-08-05 22:43:28,391][52671] DAMAGECOUNT value on done: 14477.0 [2024-08-05 22:43:28,392][52671] Sum rewards: 11.313, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.712', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon5': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON3': '0.900', 'weapon2': '0.954', 'ARMOR': '0.962', 'HITCOUNT': '1.150', 'weapon3': '2.098', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:28,540][52795] DAMAGECOUNT value on done: 11206.0 [2024-08-05 22:43:28,542][52795] Sum rewards: 12.489, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.201', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'ARMOR': '0.487', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'weapon3': '1.424', 'weapon2': '2.072', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:29,414][52667] DAMAGECOUNT value on done: 12383.0 [2024-08-05 22:43:29,416][52667] Sum rewards: 5.424, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.266', 'HITCOUNT': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.352', 'ARMOR': '1.411', 'weapon3': '1.868', 'DAMAGECOUNT': '2.142', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:29,487][52663] DAMAGECOUNT value on done: 12438.0 [2024-08-05 22:43:29,487][52663] Sum rewards: 9.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.396', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.123', 'weapon4': '0.332', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'weapon2': '1.254', 'weapon3': '1.786', 'DAMAGECOUNT': '2.898', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:29,594][52649] DAMAGECOUNT value on done: 12208.0 [2024-08-05 22:43:29,597][52649] Sum rewards: 13.357, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.759', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.092', 'weapon4': '0.190', 'WEAPON3': '0.450', 'ARMOR': '0.508', 'HITCOUNT': '0.840', 'weapon3': '1.182', 'weapon2': '1.580', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:30,329][52658] DAMAGECOUNT value on done: 10315.0 [2024-08-05 22:43:30,334][52658] Sum rewards: 9.803, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.980', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO5': '0.004', 'weapon5': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.280', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.937', 'weapon2': '1.094', 'weapon3': '1.674', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:30,514][52664] DAMAGECOUNT value on done: 11714.0 [2024-08-05 22:43:30,514][52664] Sum rewards: 19.006, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.139', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.151', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.954', 'WEAPON3': '1.150', 'ARMOR': '1.240', 'HITCOUNT': '1.430', 'weapon3': '2.414', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '18.000'} [2024-08-05 22:43:31,001][52811] DAMAGECOUNT value on done: 11250.0 [2024-08-05 22:43:31,004][52811] Sum rewards: 8.818, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.942', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.294', 'ARMOR': '0.488', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.394', 'weapon3': '1.560', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:31,330][52671] DAMAGECOUNT value on done: 11746.0 [2024-08-05 22:43:31,331][52671] Sum rewards: 14.131, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.284', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.047', 'weapon7': '0.048', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon2': '1.008', 'ARMOR': '1.379', 'weapon3': '1.430', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:31,803][52795] DAMAGECOUNT value on done: 13532.0 [2024-08-05 22:43:31,804][52795] Sum rewards: 22.350, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.894', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'weapon4': '0.528', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.224', 'weapon3': '1.632', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.805', 'FRAGCOUNT': '17.000'} [2024-08-05 22:43:31,903][52650] Updated weights for policy 0, policy_version 9681 (0.0014) [2024-08-05 22:43:32,242][52663] DAMAGECOUNT value on done: 13279.0 [2024-08-05 22:43:32,243][52663] Sum rewards: 18.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.169', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.750', 'ARMOR': '0.872', 'weapon2': '1.172', 'HITCOUNT': '1.250', 'weapon3': '1.742', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:32,422][52667] DAMAGECOUNT value on done: 13394.0 [2024-08-05 22:43:32,422][52667] Sum rewards: 10.351, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'ARMOR': '0.907', 'weapon2': '1.588', 'weapon3': '1.608', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:32,637][52649] DAMAGECOUNT value on done: 10782.0 [2024-08-05 22:43:32,637][52649] Sum rewards: 10.378, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.579', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon2': '1.426', 'weapon3': '1.502', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 79314944. Throughput: 0: 4191.6. Samples: 19830190. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:43:32,794][52567] Avg episode reward: [(0, '10.882')] [2024-08-05 22:43:33,289][52664] DAMAGECOUNT value on done: 12067.0 [2024-08-05 22:43:33,292][52664] Sum rewards: 14.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.746', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.428', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'ARMOR': '0.909', 'weapon2': '1.220', 'weapon3': '1.610', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:33,556][52658] DAMAGECOUNT value on done: 13263.0 [2024-08-05 22:43:33,560][52658] Sum rewards: 4.727, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.010', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.068', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.206', 'WEAPON3': '0.600', 'HITCOUNT': '0.610', 'weapon2': '1.100', 'weapon3': '1.518', 'DAMAGECOUNT': '1.821', 'FRAGCOUNT': '4.000'} [2024-08-05 22:43:34,178][52671] DAMAGECOUNT value on done: 13939.0 [2024-08-05 22:43:34,180][52671] Sum rewards: 8.997, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.035', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.406', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '0.800', 'weapon2': '1.196', 'weapon3': '1.528', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '6.500'} [2024-08-05 22:43:35,021][52795] DAMAGECOUNT value on done: 12097.0 [2024-08-05 22:43:35,023][52795] Sum rewards: 9.596, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.182', 'AMMO2': '0.001', 'AMMO4': '0.005', 'ARMOR': '0.040', 'AMMO3': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'weapon2': '1.564', 'weapon3': '1.742', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:35,418][52663] DAMAGECOUNT value on done: 10904.0 [2024-08-05 22:43:35,419][52663] Sum rewards: 3.663, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.246', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.068', 'AMMO4': '0.095', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'ARMOR': '0.512', 'weapon4': '0.518', 'weapon3': '1.262', 'weapon2': '1.350', 'DAMAGECOUNT': '1.926', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:35,704][52667] DAMAGECOUNT value on done: 13213.0 [2024-08-05 22:43:35,707][52667] Sum rewards: 14.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.485', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.346', 'ARMOR': '0.404', 'WEAPON3': '0.750', 'weapon2': '0.832', 'HITCOUNT': '1.190', 'weapon3': '2.150', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:35,901][52649] DAMAGECOUNT value on done: 11101.0 [2024-08-05 22:43:35,901][52649] Sum rewards: 2.140, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'HEALTH': '0.204', 'HITCOUNT': '0.340', 'weapon4': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.022', 'weapon2': '1.052', 'ARMOR': '1.332', 'DAMAGECOUNT': '1.392', 'FRAGCOUNT': '2.000'} [2024-08-05 22:43:36,095][52664] DAMAGECOUNT value on done: 12632.0 [2024-08-05 22:43:36,095][52664] Sum rewards: 17.003, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'ARMOR': '0.031', 'AMMO3': '0.094', 'WEAPON3': '0.750', 'weapon2': '1.196', 'HITCOUNT': '1.310', 'weapon3': '1.916', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:36,336][52650] Updated weights for policy 0, policy_version 9691 (0.0012) [2024-08-05 22:43:36,800][52658] DAMAGECOUNT value on done: 11933.0 [2024-08-05 22:43:36,801][52658] Sum rewards: 10.553, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.228', 'WEAPON3': '0.800', 'ARMOR': '0.916', 'HITCOUNT': '1.030', 'weapon2': '1.242', 'weapon3': '1.790', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:36,809][52659] DAMAGECOUNT value on done: 12216.0 [2024-08-05 22:43:36,809][52659] Sum rewards: 9.939, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.521', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.005', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.194', 'ARMOR': '0.512', 'weapon2': '1.052', 'WEAPON3': '1.100', 'HITCOUNT': '1.100', 'weapon3': '2.152', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:37,018][52671] DAMAGECOUNT value on done: 12628.0 [2024-08-05 22:43:37,020][52671] Sum rewards: 17.331, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.776', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.142', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon2': '1.706', 'weapon3': '1.832', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:37,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16793.6, 300 sec: 16800.7). Total num frames: 79405056. Throughput: 0: 4201.6. Samples: 19855620. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:43:37,795][52567] Avg episode reward: [(0, '10.765')] [2024-08-05 22:43:38,372][52795] DAMAGECOUNT value on done: 11201.0 [2024-08-05 22:43:38,372][52795] Sum rewards: 6.259, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.072', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.244', 'HITCOUNT': '0.470', 'WEAPON3': '0.550', 'ARMOR': '0.868', 'weapon2': '0.886', 'weapon3': '1.394', 'DAMAGECOUNT': '1.788', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:38,588][52663] DAMAGECOUNT value on done: 10477.0 [2024-08-05 22:43:38,588][52663] Sum rewards: 6.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.429', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'weapon4': '0.428', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'ARMOR': '0.940', 'weapon2': '1.090', 'weapon3': '1.432', 'DAMAGECOUNT': '2.457', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:38,730][52649] DAMAGECOUNT value on done: 11087.0 [2024-08-05 22:43:38,730][52649] Sum rewards: 5.796, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.815', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.236', 'HITCOUNT': '0.600', 'WEAPON3': '0.700', 'ARMOR': '0.923', 'weapon2': '1.156', 'weapon3': '1.620', 'DAMAGECOUNT': '2.001', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:39,006][52667] DAMAGECOUNT value on done: 12802.0 [2024-08-05 22:43:39,006][52667] Sum rewards: 17.343, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.991', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.073', 'weapon4': '0.140', 'WEAPON4': '0.150', 'ARMOR': '0.498', 'WEAPON3': '0.600', 'HITCOUNT': '1.230', 'weapon2': '1.284', 'weapon3': '1.604', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '13.000'} [2024-08-05 22:43:39,292][52664] DAMAGECOUNT value on done: 12936.0 [2024-08-05 22:43:39,293][52664] Sum rewards: 14.740, reward structure: {'DEATHCOUNT': '-5.250', 'weapon7': '0.006', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.109', 'weapon4': '0.208', 'HEALTH': '0.338', 'ARMOR': '0.456', 'WEAPON3': '0.500', 'HITCOUNT': '1.040', 'weapon2': '1.438', 'weapon3': '1.846', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:39,731][52659] DAMAGECOUNT value on done: 12561.0 [2024-08-05 22:43:39,733][52659] Sum rewards: 4.991, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.224', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.034', 'ARMOR': '0.084', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.350', 'HITCOUNT': '0.620', 'WEAPON3': '0.750', 'weapon2': '0.824', 'weapon3': '1.884', 'DAMAGECOUNT': '2.202', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:39,762][52658] DAMAGECOUNT value on done: 11742.0 [2024-08-05 22:43:39,766][52658] Sum rewards: 17.510, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.378', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.157', 'ARMOR': '0.424', 'WEAPON3': '0.950', 'weapon2': '0.990', 'HITCOUNT': '1.520', 'weapon3': '2.624', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '16.000'} [2024-08-05 22:43:39,926][52671] DAMAGECOUNT value on done: 12759.0 [2024-08-05 22:43:39,926][52671] Sum rewards: 16.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon4': '0.386', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'weapon2': '1.092', 'HITCOUNT': '1.300', 'weapon3': '2.044', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:41,520][52663] DAMAGECOUNT value on done: 11772.0 [2024-08-05 22:43:41,525][52663] Sum rewards: 5.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.057', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.063', 'AMMO4': '0.098', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.458', 'HITCOUNT': '0.490', 'weapon4': '0.506', 'weapon2': '0.798', 'weapon3': '1.160', 'DAMAGECOUNT': '2.226', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:41,621][52664] DAMAGECOUNT value on done: 12049.0 [2024-08-05 22:43:41,622][52664] Sum rewards: 9.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.018', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.380', 'ARMOR': '0.472', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon2': '1.172', 'weapon3': '2.128', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:41,635][52650] Updated weights for policy 0, policy_version 9701 (0.0027) [2024-08-05 22:43:41,743][52667] DAMAGECOUNT value on done: 12792.0 [2024-08-05 22:43:41,744][52667] Sum rewards: 10.493, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.897', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'weapon5': '0.034', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.866', 'HITCOUNT': '0.960', 'weapon2': '1.696', 'weapon3': '2.056', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:41,817][52795] DAMAGECOUNT value on done: 12094.0 [2024-08-05 22:43:41,817][52795] Sum rewards: 4.661, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'ARMOR': '0.158', 'AMMO4': '0.179', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'weapon4': '0.802', 'weapon3': '1.262', 'DAMAGECOUNT': '1.320', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:42,194][52649] DAMAGECOUNT value on done: 12156.0 [2024-08-05 22:43:42,198][52649] Sum rewards: 7.792, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.645', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon4': '0.214', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'HITCOUNT': '0.860', 'weapon2': '1.536', 'weapon3': '1.558', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16772.8). Total num frames: 79486976. Throughput: 0: 4209.1. Samples: 19881150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:43:42,794][52567] Avg episode reward: [(0, '10.634')] [2024-08-05 22:43:42,884][52659] DAMAGECOUNT value on done: 12510.0 [2024-08-05 22:43:42,885][52659] Sum rewards: 14.791, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.660', 'AMMO2': '0.003', 'AMMO5': '0.004', 'AMMO4': '0.013', 'weapon5': '0.030', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.474', 'WEAPON3': '0.500', 'HITCOUNT': '0.880', 'ARMOR': '0.884', 'weapon2': '1.102', 'weapon3': '1.312', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:42,959][52658] DAMAGECOUNT value on done: 11362.0 [2024-08-05 22:43:42,960][52658] Sum rewards: 7.067, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.614', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.067', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon5': '0.294', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'ARMOR': '0.889', 'weapon3': '1.144', 'weapon2': '1.178', 'DAMAGECOUNT': '2.031', 'FRAGCOUNT': '4.000'} [2024-08-05 22:43:43,134][52671] DAMAGECOUNT value on done: 12829.0 [2024-08-05 22:43:43,135][52671] Sum rewards: 13.127, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.300', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon7': '0.050', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.210', 'weapon4': '0.340', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '1.094', 'weapon3': '1.386', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:44,385][52664] DAMAGECOUNT value on done: 13567.0 [2024-08-05 22:43:44,386][52664] Sum rewards: 12.859, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.304', 'ARMOR': '0.481', 'WEAPON3': '0.800', 'HITCOUNT': '1.010', 'weapon2': '1.026', 'weapon3': '1.710', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:44,577][52667] DAMAGECOUNT value on done: 12458.0 [2024-08-05 22:43:44,579][52667] Sum rewards: 6.458, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.348', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.390', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'ARMOR': '0.975', 'weapon2': '1.166', 'weapon3': '1.488', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:45,380][52795] DAMAGECOUNT value on done: 11961.0 [2024-08-05 22:43:45,382][52795] Sum rewards: 11.867, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.080', 'HEALTH': '0.450', 'WEAPON3': '0.500', 'HITCOUNT': '1.090', 'weapon2': '1.092', 'weapon3': '1.586', 'DAMAGECOUNT': '4.098', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:45,486][52658] DAMAGECOUNT value on done: 12397.0 [2024-08-05 22:43:45,487][52658] Sum rewards: 12.490, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.226', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.050', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'weapon2': '0.720', 'weapon4': '0.720', 'HITCOUNT': '0.800', 'weapon3': '1.230', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:45,679][52649] DAMAGECOUNT value on done: 12343.0 [2024-08-05 22:43:45,679][52649] Sum rewards: 6.481, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.282', 'AMMO2': '0.016', 'weapon7': '0.056', 'AMMO3': '0.064', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.600', 'weapon2': '0.830', 'ARMOR': '0.952', 'weapon3': '1.220', 'DAMAGECOUNT': '2.544', 'FRAGCOUNT': '3.000'} [2024-08-05 22:43:46,018][52650] Updated weights for policy 0, policy_version 9711 (0.0013) [2024-08-05 22:43:46,253][52659] DAMAGECOUNT value on done: 12599.0 [2024-08-05 22:43:46,255][52659] Sum rewards: 10.514, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.744', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.328', 'WEAPON3': '0.800', 'ARMOR': '0.916', 'HITCOUNT': '0.940', 'weapon2': '1.346', 'weapon3': '1.932', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:46,562][52671] DAMAGECOUNT value on done: 12666.0 [2024-08-05 22:43:46,570][52671] Sum rewards: 11.801, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.441', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'ARMOR': '0.032', 'AMMO3': '0.080', 'WEAPON4': '0.250', 'weapon4': '0.434', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '1.230', 'weapon3': '1.802', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:47,102][52664] DAMAGECOUNT value on done: 12409.0 [2024-08-05 22:43:47,103][52664] Sum rewards: 10.366, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.262', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.026', 'AMMO3': '0.086', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.328', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon2': '1.398', 'weapon3': '1.614', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:47,507][52667] DAMAGECOUNT value on done: 11975.0 [2024-08-05 22:43:47,507][52667] Sum rewards: 12.740, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.138', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.188', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'ARMOR': '1.298', 'weapon2': '1.474', 'weapon3': '1.586', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:47,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 79568896. Throughput: 0: 4216.0. Samples: 19893430. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:43:47,794][52567] Avg episode reward: [(0, '10.790')] [2024-08-05 22:43:48,633][52658] DAMAGECOUNT value on done: 12128.0 [2024-08-05 22:43:48,635][52658] Sum rewards: 16.689, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.349', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.010', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon4': '0.190', 'WEAPON3': '0.600', 'ARMOR': '0.966', 'HITCOUNT': '1.150', 'weapon2': '1.396', 'weapon3': '1.814', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:48,694][52795] DAMAGECOUNT value on done: 12721.0 [2024-08-05 22:43:48,695][52795] Sum rewards: 10.257, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.129', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.240', 'ARMOR': '0.481', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'weapon2': '1.538', 'weapon3': '1.838', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:48,840][52649] DAMAGECOUNT value on done: 11288.0 [2024-08-05 22:43:48,840][52649] Sum rewards: 14.337, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.200', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.020', 'AMMO4': '0.050', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'HITCOUNT': '1.290', 'weapon2': '1.596', 'weapon3': '2.196', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:49,504][52659] DAMAGECOUNT value on done: 11726.0 [2024-08-05 22:43:49,505][52659] Sum rewards: 14.657, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.853', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'ARMOR': '0.913', 'WEAPON3': '1.000', 'HITCOUNT': '1.240', 'weapon2': '1.678', 'weapon3': '1.922', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '14.000'} [2024-08-05 22:43:49,623][52664] DAMAGECOUNT value on done: 12179.0 [2024-08-05 22:43:49,623][52664] Sum rewards: 13.282, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.435', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'ARMOR': '0.529', 'weapon4': '0.564', 'WEAPON3': '0.650', 'HITCOUNT': '0.770', 'weapon2': '0.916', 'weapon3': '2.068', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:49,738][52671] DAMAGECOUNT value on done: 11914.0 [2024-08-05 22:43:49,739][52671] Sum rewards: 4.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.472', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.092', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'ARMOR': '0.828', 'weapon3': '1.478', 'weapon2': '2.112', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '4.000'} [2024-08-05 22:43:50,484][52667] DAMAGECOUNT value on done: 12560.0 [2024-08-05 22:43:50,485][52667] Sum rewards: 10.920, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.209', 'AMMO2': '0.016', 'ARMOR': '0.040', 'AMMO4': '0.081', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.326', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '1.210', 'weapon3': '1.882', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:51,100][52650] Updated weights for policy 0, policy_version 9721 (0.0023) [2024-08-05 22:43:51,473][52658] DAMAGECOUNT value on done: 12114.0 [2024-08-05 22:43:51,473][52658] Sum rewards: 7.692, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.465', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.083', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'weapon4': '0.508', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon3': '1.344', 'weapon2': '1.370', 'DAMAGECOUNT': '2.664', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:51,923][52795] DAMAGECOUNT value on done: 11140.0 [2024-08-05 22:43:51,932][52795] Sum rewards: 20.019, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.399', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.020', 'weapon5': '0.028', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.800', 'ARMOR': '0.905', 'weapon2': '1.194', 'HITCOUNT': '1.350', 'weapon3': '1.870', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '16.000'} [2024-08-05 22:43:52,083][52649] DAMAGECOUNT value on done: 14126.0 [2024-08-05 22:43:52,083][52649] Sum rewards: 13.968, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.447', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon5': '0.224', 'ARMOR': '0.471', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'weapon2': '1.470', 'weapon3': '1.620', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:52,343][52659] DAMAGECOUNT value on done: 12809.0 [2024-08-05 22:43:52,345][52659] Sum rewards: 13.950, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.215', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.111', 'WEAPON3': '0.750', 'HITCOUNT': '1.260', 'ARMOR': '1.274', 'weapon2': '1.822', 'weapon3': '2.084', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '12.000'} [2024-08-05 22:43:52,633][52671] DAMAGECOUNT value on done: 13213.0 [2024-08-05 22:43:52,634][52671] Sum rewards: 11.577, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.218', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.146', 'WEAPON3': '0.950', 'HITCOUNT': '0.970', 'weapon2': '1.252', 'ARMOR': '1.389', 'weapon3': '1.576', 'DAMAGECOUNT': '3.726', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:52,733][52664] DAMAGECOUNT value on done: 11336.0 [2024-08-05 22:43:52,733][52664] Sum rewards: 11.135, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.242', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.028', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.264', 'WEAPON3': '0.800', 'weapon2': '1.090', 'HITCOUNT': '1.230', 'weapon3': '1.572', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 79659008. Throughput: 0: 4219.3. Samples: 19918840. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:43:52,795][52567] Avg episode reward: [(0, '10.934')] [2024-08-05 22:43:54,444][52658] DAMAGECOUNT value on done: 13129.0 [2024-08-05 22:43:54,445][52658] Sum rewards: 13.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon7': '0.066', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.258', 'ARMOR': '0.492', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon2': '1.228', 'weapon3': '1.584', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:54,912][52649] DAMAGECOUNT value on done: 11029.0 [2024-08-05 22:43:54,914][52649] Sum rewards: 5.375, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.998', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.222', 'HITCOUNT': '0.640', 'ARMOR': '0.926', 'WEAPON3': '1.000', 'weapon2': '1.412', 'weapon3': '1.792', 'DAMAGECOUNT': '2.418', 'FRAGCOUNT': '7.000'} [2024-08-05 22:43:55,219][52795] DAMAGECOUNT value on done: 11896.0 [2024-08-05 22:43:55,219][52795] Sum rewards: 13.185, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.010', 'weapon4': '0.014', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon2': '1.478', 'weapon3': '2.164', 'DAMAGECOUNT': '4.197', 'FRAGCOUNT': '11.000'} [2024-08-05 22:43:55,736][52659] DAMAGECOUNT value on done: 12216.0 [2024-08-05 22:43:55,736][52659] Sum rewards: 12.331, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.243', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.082', 'weapon4': '0.210', 'WEAPON3': '0.550', 'ARMOR': '0.840', 'HITCOUNT': '0.970', 'weapon2': '0.986', 'weapon3': '1.848', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '9.000'} [2024-08-05 22:43:55,846][52671] DAMAGECOUNT value on done: 14344.0 [2024-08-05 22:43:55,847][52671] Sum rewards: 9.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.075', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon4': '0.162', 'ARMOR': '0.449', 'WEAPON3': '1.050', 'weapon2': '1.156', 'HITCOUNT': '1.330', 'weapon3': '2.094', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '10.000'} [2024-08-05 22:43:55,948][52664] DAMAGECOUNT value on done: 12152.0 [2024-08-05 22:43:55,950][52664] Sum rewards: 7.302, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.130', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.901', 'HITCOUNT': '0.950', 'weapon2': '1.254', 'weapon3': '1.982', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:56,111][52650] Updated weights for policy 0, policy_version 9731 (0.0033) [2024-08-05 22:43:57,449][52658] DAMAGECOUNT value on done: 12597.0 [2024-08-05 22:43:57,458][52658] Sum rewards: 14.725, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.774', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.152', 'WEAPON3': '1.000', 'HITCOUNT': '1.150', 'weapon2': '1.346', 'weapon3': '1.756', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '15.000'} [2024-08-05 22:43:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 79749120. Throughput: 0: 4223.6. Samples: 19944300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:43:57,794][52567] Avg episode reward: [(0, '11.123')] [2024-08-05 22:43:58,292][52649] DAMAGECOUNT value on done: 10954.0 [2024-08-05 22:43:58,292][52649] Sum rewards: 6.519, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.071', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.176', 'weapon4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.520', 'weapon2': '1.266', 'weapon3': '1.340', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '5.000'} [2024-08-05 22:43:58,417][52659] DAMAGECOUNT value on done: 10983.0 [2024-08-05 22:43:58,418][52659] Sum rewards: 10.131, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.038', 'AMMO3': '0.087', 'weapon7': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.448', 'WEAPON3': '0.600', 'weapon2': '0.824', 'ARMOR': '0.920', 'HITCOUNT': '0.960', 'weapon3': '1.640', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '8.000'} [2024-08-05 22:43:58,537][52671] DAMAGECOUNT value on done: 12453.0 [2024-08-05 22:43:58,537][52671] Sum rewards: 20.081, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.895', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon4': '0.276', 'WEAPON3': '0.750', 'ARMOR': '0.950', 'HITCOUNT': '1.290', 'weapon2': '1.430', 'weapon3': '1.824', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '17.000'} [2024-08-05 22:43:58,633][52820] DAMAGECOUNT value on done: 9579.0 [2024-08-05 22:43:58,634][52820] Sum rewards: 10.415, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.070', 'AMMO4': '0.092', 'WEAPON3': '0.400', 'HEALTH': '0.463', 'ARMOR': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.626', 'weapon3': '1.644', 'DAMAGECOUNT': '2.751', 'FRAGCOUNT': '6.000'} [2024-08-05 22:43:58,906][52664] DAMAGECOUNT value on done: 10601.0 [2024-08-05 22:43:58,907][52664] Sum rewards: 6.967, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.767', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'ARMOR': '1.290', 'weapon2': '1.464', 'weapon3': '1.672', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:00,642][52658] DAMAGECOUNT value on done: 14674.0 [2024-08-05 22:44:00,643][52658] Sum rewards: 23.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.308', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.013', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'ARMOR': '0.879', 'weapon2': '0.994', 'WEAPON3': '1.300', 'HITCOUNT': '2.040', 'weapon3': '2.756', 'DAMAGECOUNT': '6.957', 'FRAGCOUNT': '21.000'} [2024-08-05 22:44:00,752][52650] Updated weights for policy 0, policy_version 9741 (0.0016) [2024-08-05 22:44:01,200][52659] DAMAGECOUNT value on done: 12144.0 [2024-08-05 22:44:01,200][52659] Sum rewards: 5.092, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.829', 'AMMO2': '0.028', 'AMMO3': '0.104', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'HITCOUNT': '0.460', 'weapon2': '0.676', 'WEAPON3': '0.700', 'weapon4': '0.932', 'ARMOR': '1.257', 'DAMAGECOUNT': '1.647', 'weapon3': '1.728', 'FRAGCOUNT': '4.000'} [2024-08-05 22:44:01,295][52671] DAMAGECOUNT value on done: 12622.0 [2024-08-05 22:44:01,295][52671] Sum rewards: 8.728, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.208', 'AMMO2': '0.005', 'weapon7': '0.014', 'AMMO4': '0.024', 'AMMO3': '0.106', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.338', 'ARMOR': '1.395', 'weapon3': '1.986', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '6.000'} [2024-08-05 22:44:01,304][52664] DAMAGECOUNT value on done: 12746.0 [2024-08-05 22:44:01,305][52664] Sum rewards: 6.441, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.881', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.152', 'weapon4': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '1.110', 'weapon2': '1.170', 'ARMOR': '1.329', 'weapon3': '2.090', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:01,410][52649] DAMAGECOUNT value on done: 13232.0 [2024-08-05 22:44:01,410][52649] Sum rewards: 14.646, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.856', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'ARMOR': '0.060', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon2': '1.210', 'weapon3': '1.524', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:01,835][52820] DAMAGECOUNT value on done: 10693.0 [2024-08-05 22:44:01,837][52820] Sum rewards: 5.498, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.591', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.064', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.468', 'ARMOR': '0.497', 'HITCOUNT': '0.520', 'weapon3': '0.998', 'weapon2': '1.174', 'DAMAGECOUNT': '1.635', 'FRAGCOUNT': '5.000'} [2024-08-05 22:44:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.7, 300 sec: 16772.8). Total num frames: 79822848. Throughput: 0: 4229.4. Samples: 19957230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:44:02,794][52567] Avg episode reward: [(0, '11.308')] [2024-08-05 22:44:03,768][52658] DAMAGECOUNT value on done: 13366.0 [2024-08-05 22:44:03,770][52658] Sum rewards: 7.374, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.090', 'AMMO2': '0.020', 'AMMO3': '0.078', 'AMMO4': '0.101', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'ARMOR': '0.800', 'weapon3': '1.350', 'weapon2': '1.534', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '4.000'} [2024-08-05 22:44:03,956][52659] DAMAGECOUNT value on done: 12792.0 [2024-08-05 22:44:03,957][52659] Sum rewards: 12.129, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.065', 'AMMO2': '0.020', 'AMMO3': '0.055', 'AMMO4': '0.098', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.902', 'HITCOUNT': '0.980', 'weapon3': '1.046', 'weapon2': '1.352', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:04,060][52671] DAMAGECOUNT value on done: 14025.0 [2024-08-05 22:44:04,061][52671] Sum rewards: 10.241, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.816', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.103', 'weapon4': '0.248', 'WEAPON5': '0.250', 'ARMOR': '0.528', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.122', 'weapon3': '1.714', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:04,590][52664] DAMAGECOUNT value on done: 10153.0 [2024-08-05 22:44:04,591][52664] Sum rewards: 13.199, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.160', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.044', 'AMMO4': '0.045', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.490', 'HITCOUNT': '0.820', 'weapon2': '0.978', 'weapon3': '1.182', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:05,266][52649] DAMAGECOUNT value on done: 11013.0 [2024-08-05 22:44:05,267][52649] Sum rewards: 9.446, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.141', 'AMMO4': '-0.087', 'AMMO2': '-0.017', 'AMMO5': '0.003', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.268', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'ARMOR': '0.947', 'weapon3': '1.190', 'weapon2': '1.304', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:05,319][52820] DAMAGECOUNT value on done: 11049.0 [2024-08-05 22:44:05,319][52820] Sum rewards: 7.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.380', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.262', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.060', 'weapon3': '1.564', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:05,703][52650] Updated weights for policy 0, policy_version 9751 (0.0014) [2024-08-05 22:44:06,361][52658] DAMAGECOUNT value on done: 12187.0 [2024-08-05 22:44:06,361][52658] Sum rewards: 13.058, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.202', 'AMMO2': '0.005', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon5': '0.038', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'ARMOR': '0.424', 'WEAPON3': '1.000', 'weapon2': '1.050', 'HITCOUNT': '1.160', 'weapon3': '2.414', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '13.000'} [2024-08-05 22:44:06,728][52659] DAMAGECOUNT value on done: 12900.0 [2024-08-05 22:44:06,729][52659] Sum rewards: 13.306, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.040', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'ARMOR': '0.460', 'weapon2': '0.892', 'HITCOUNT': '1.020', 'WEAPON3': '1.050', 'weapon3': '2.248', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '14.000'} [2024-08-05 22:44:06,772][52671] DAMAGECOUNT value on done: 11061.0 [2024-08-05 22:44:06,772][52671] Sum rewards: 6.950, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.194', 'weapon4': '0.278', 'WEAPON3': '0.550', 'HITCOUNT': '0.620', 'ARMOR': '0.920', 'weapon2': '0.928', 'weapon3': '1.522', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '6.000'} [2024-08-05 22:44:07,386][52664] DAMAGECOUNT value on done: 12865.0 [2024-08-05 22:44:07,387][52664] Sum rewards: 22.078, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.234', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'WEAPON3': '0.700', 'ARMOR': '0.851', 'weapon2': '1.672', 'HITCOUNT': '1.680', 'weapon3': '1.826', 'DAMAGECOUNT': '6.135', 'FRAGCOUNT': '16.000'} [2024-08-05 22:44:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 79912960. Throughput: 0: 4223.6. Samples: 19982470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:44:07,794][52567] Avg episode reward: [(0, '11.290')] [2024-08-05 22:44:08,523][52649] DAMAGECOUNT value on done: 13728.0 [2024-08-05 22:44:08,523][52649] Sum rewards: 7.744, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.026', 'AMMO2': '0.005', 'weapon7': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.026', 'weapon5': '0.038', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.852', 'weapon2': '0.868', 'HITCOUNT': '1.020', 'WEAPON3': '1.150', 'weapon3': '2.642', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:08,741][52820] DAMAGECOUNT value on done: 12177.0 [2024-08-05 22:44:08,745][52820] Sum rewards: 5.869, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.082', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO3': '0.040', 'ARMOR': '0.068', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.212', 'WEAPON3': '0.250', 'HITCOUNT': '0.460', 'weapon4': '0.540', 'weapon2': '0.810', 'weapon3': '0.984', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '4.000'} [2024-08-05 22:44:09,266][52659] DAMAGECOUNT value on done: 12093.0 [2024-08-05 22:44:09,274][52659] Sum rewards: 9.247, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.358', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'ARMOR': '1.250', 'weapon2': '1.286', 'weapon3': '1.398', 'DAMAGECOUNT': '1.917', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:09,272][52671] DAMAGECOUNT value on done: 11982.0 [2024-08-05 22:44:09,278][52671] Sum rewards: 11.962, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.208', 'ARMOR': '0.491', 'WEAPON3': '0.800', 'HITCOUNT': '0.940', 'weapon2': '1.294', 'weapon3': '1.768', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:09,693][52658] DAMAGECOUNT value on done: 11333.0 [2024-08-05 22:44:09,693][52658] Sum rewards: 6.806, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.424', 'WEAPON3': '0.650', 'HITCOUNT': '0.750', 'weapon3': '1.262', 'weapon2': '1.546', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '6.000'} [2024-08-05 22:44:10,112][52650] Updated weights for policy 0, policy_version 9761 (0.0026) [2024-08-05 22:44:10,176][52664] DAMAGECOUNT value on done: 11201.0 [2024-08-05 22:44:10,177][52664] Sum rewards: 5.249, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.387', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.074', 'weapon5': '0.074', 'weapon7': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'HITCOUNT': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.521', 'WEAPON3': '0.650', 'weapon2': '0.658', 'weapon4': '0.824', 'DAMAGECOUNT': '1.239', 'weapon3': '1.554', 'FRAGCOUNT': '4.000'} [2024-08-05 22:44:11,926][52820] DAMAGECOUNT value on done: 11977.0 [2024-08-05 22:44:11,928][52820] Sum rewards: 16.915, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'HEALTH': '0.274', 'ARMOR': '0.538', 'WEAPON3': '0.600', 'HITCOUNT': '1.220', 'weapon2': '1.386', 'weapon3': '2.100', 'DAMAGECOUNT': '4.488', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:12,004][52649] DAMAGECOUNT value on done: 13047.0 [2024-08-05 22:44:12,005][52649] Sum rewards: 10.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.698', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon4': '0.244', 'weapon2': '0.870', 'ARMOR': '0.938', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon3': '2.242', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:12,421][52659] DAMAGECOUNT value on done: 11646.0 [2024-08-05 22:44:12,426][52659] Sum rewards: 6.340, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.210', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'ARMOR': '0.036', 'AMMO3': '0.055', 'weapon5': '0.078', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.528', 'HITCOUNT': '0.700', 'weapon2': '1.062', 'weapon3': '1.094', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '5.000'} [2024-08-05 22:44:12,435][52671] DAMAGECOUNT value on done: 12513.0 [2024-08-05 22:44:12,435][52671] Sum rewards: 8.641, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.206', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon4': '0.240', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'ARMOR': '0.964', 'weapon3': '1.610', 'weapon2': '1.688', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 79986688. Throughput: 0: 4239.1. Samples: 20008200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:44:12,794][52567] Avg episode reward: [(0, '10.982')] [2024-08-05 22:44:12,880][52658] DAMAGECOUNT value on done: 12944.0 [2024-08-05 22:44:12,881][52658] Sum rewards: 13.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.292', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.238', 'WEAPON3': '0.850', 'ARMOR': '0.888', 'HITCOUNT': '1.100', 'weapon2': '1.314', 'weapon3': '1.938', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:12,910][52664] DAMAGECOUNT value on done: 11954.0 [2024-08-05 22:44:12,914][52664] Sum rewards: 9.165, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.292', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon4': '0.252', 'WEAPON3': '0.850', 'ARMOR': '0.855', 'weapon2': '1.012', 'HITCOUNT': '1.110', 'weapon3': '1.986', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:14,634][52649] DAMAGECOUNT value on done: 12981.0 [2024-08-05 22:44:14,634][52649] Sum rewards: 8.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.958', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.036', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.444', 'weapon4': '0.476', 'HITCOUNT': '0.560', 'WEAPON3': '0.750', 'weapon2': '0.832', 'weapon3': '1.550', 'DAMAGECOUNT': '2.238', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:15,235][52820] DAMAGECOUNT value on done: 13334.0 [2024-08-05 22:44:15,236][52820] Sum rewards: 8.165, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.318', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.290', 'ARMOR': '0.469', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.300', 'weapon3': '1.932', 'DAMAGECOUNT': '2.439', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:15,910][52650] Updated weights for policy 0, policy_version 9771 (0.0028) [2024-08-05 22:44:15,915][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:44:15,929][52671] DAMAGECOUNT value on done: 11790.0 [2024-08-05 22:44:15,932][52671] Sum rewards: 10.759, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.492', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon4': '0.582', 'HITCOUNT': '0.740', 'ARMOR': '0.832', 'WEAPON3': '0.850', 'weapon2': '1.082', 'weapon3': '1.798', 'DAMAGECOUNT': '2.670', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:15,960][52659] DAMAGECOUNT value on done: 13225.0 [2024-08-05 22:44:15,962][52659] Sum rewards: 9.089, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.021', 'ARMOR': '0.024', 'weapon4': '0.058', 'HEALTH': '0.066', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.268', 'weapon3': '1.480', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:16,237][52664] DAMAGECOUNT value on done: 13201.0 [2024-08-05 22:44:16,237][52664] Sum rewards: 7.619, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.656', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.158', 'WEAPON3': '0.850', 'HITCOUNT': '0.900', 'ARMOR': '0.984', 'weapon2': '1.480', 'weapon3': '2.020', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 80084992. Throughput: 0: 4234.0. Samples: 20020720. Policy #0 lag: (min: 2.0, avg: 4.0, max: 9.0) [2024-08-05 22:44:17,794][52567] Avg episode reward: [(0, '10.838')] [2024-08-05 22:44:18,611][52820] DAMAGECOUNT value on done: 10499.0 [2024-08-05 22:44:18,612][52820] Sum rewards: 16.956, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.158', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.143', 'ARMOR': '0.917', 'WEAPON3': '0.950', 'HITCOUNT': '1.310', 'weapon2': '1.518', 'weapon3': '2.246', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '15.000'} [2024-08-05 22:44:18,766][52671] DAMAGECOUNT value on done: 14623.0 [2024-08-05 22:44:18,767][52671] Sum rewards: 24.047, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.960', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.028', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.338', 'WEAPON3': '0.600', 'weapon2': '0.954', 'HITCOUNT': '1.380', 'weapon3': '1.628', 'DAMAGECOUNT': '5.379', 'FRAGCOUNT': '19.000'} [2024-08-05 22:44:18,775][52659] DAMAGECOUNT value on done: 13153.0 [2024-08-05 22:44:18,775][52659] Sum rewards: 16.273, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'HEALTH': '0.015', 'weapon5': '0.056', 'AMMO4': '0.063', 'ARMOR': '0.068', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon2': '0.926', 'weapon3': '1.646', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '13.000'} [2024-08-05 22:44:19,974][52650] Updated weights for policy 0, policy_version 9781 (0.0019) [2024-08-05 22:44:21,877][52671] DAMAGECOUNT value on done: 11518.0 [2024-08-05 22:44:21,878][52671] Sum rewards: 9.570, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.386', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.130', 'weapon4': '0.222', 'HITCOUNT': '0.780', 'WEAPON3': '0.850', 'ARMOR': '0.909', 'weapon3': '1.482', 'weapon2': '1.664', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:21,930][52659] DAMAGECOUNT value on done: 13890.0 [2024-08-05 22:44:21,931][52659] Sum rewards: 9.314, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.214', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.266', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '1.190', 'weapon3': '1.504', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:21,987][52820] DAMAGECOUNT value on done: 11901.0 [2024-08-05 22:44:21,988][52820] Sum rewards: 11.247, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.404', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.128', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'ARMOR': '1.314', 'weapon2': '1.632', 'weapon3': '2.012', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:22,425][52668] DAMAGECOUNT value on done: 12096.0 [2024-08-05 22:44:22,427][52668] Sum rewards: 13.865, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.272', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'weapon7': '0.050', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.858', 'HITCOUNT': '1.230', 'weapon3': '1.564', 'weapon2': '1.804', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 80166912. Throughput: 0: 4222.0. Samples: 20045610. Policy #0 lag: (min: 2.0, avg: 4.0, max: 9.0) [2024-08-05 22:44:22,794][52567] Avg episode reward: [(0, '10.859')] [2024-08-05 22:44:24,159][52671] DAMAGECOUNT value on done: 13737.0 [2024-08-05 22:44:24,160][52671] Sum rewards: 10.871, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.529', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.028', 'AMMO4': '0.052', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.342', 'WEAPON3': '0.750', 'HITCOUNT': '1.000', 'ARMOR': '1.363', 'weapon2': '1.448', 'weapon3': '1.772', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:24,218][52659] DAMAGECOUNT value on done: 11814.0 [2024-08-05 22:44:24,219][52659] Sum rewards: 9.742, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.462', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.228', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'ARMOR': '0.952', 'weapon2': '1.272', 'weapon3': '1.612', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:24,949][52650] Updated weights for policy 0, policy_version 9791 (0.0017) [2024-08-05 22:44:25,311][52820] DAMAGECOUNT value on done: 10559.0 [2024-08-05 22:44:25,321][52820] Sum rewards: 3.813, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.979', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.011', 'ARMOR': '0.044', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.568', 'HITCOUNT': '0.580', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.072', 'DAMAGECOUNT': '2.145', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:25,440][52668] DAMAGECOUNT value on done: 14437.0 [2024-08-05 22:44:25,443][52668] Sum rewards: 13.271, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.122', 'AMMO4': '0.132', 'WEAPON4': '0.400', 'weapon4': '0.406', 'ARMOR': '0.468', 'weapon2': '0.802', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon3': '2.004', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:27,352][52666] DAMAGECOUNT value on done: 12549.0 [2024-08-05 22:44:27,354][52666] Sum rewards: 19.039, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.228', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon4': '0.226', 'ARMOR': '0.500', 'WEAPON3': '1.050', 'weapon2': '1.212', 'HITCOUNT': '1.500', 'weapon3': '2.086', 'DAMAGECOUNT': '5.301', 'FRAGCOUNT': '17.000'} [2024-08-05 22:44:27,476][52659] DAMAGECOUNT value on done: 12483.0 [2024-08-05 22:44:27,478][52659] Sum rewards: 14.292, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.316', 'HEALTH': '0.484', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon2': '1.198', 'ARMOR': '1.600', 'weapon3': '2.062', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 80248832. Throughput: 0: 4207.8. Samples: 20070500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 22:44:27,795][52567] Avg episode reward: [(0, '11.136')] [2024-08-05 22:44:27,816][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009797_80257024.pth... [2024-08-05 22:44:27,944][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009304_76218368.pth [2024-08-05 22:44:28,484][52668] DAMAGECOUNT value on done: 12111.0 [2024-08-05 22:44:28,485][52668] Sum rewards: 16.897, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.525', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.113', 'WEAPON3': '0.750', 'ARMOR': '1.344', 'HITCOUNT': '1.400', 'weapon2': '1.594', 'weapon3': '1.956', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:28,862][52820] DAMAGECOUNT value on done: 11740.0 [2024-08-05 22:44:28,863][52820] Sum rewards: 6.425, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon7': '0.046', 'AMMO3': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.258', 'HEALTH': '0.259', 'WEAPON3': '0.300', 'HITCOUNT': '0.420', 'weapon2': '0.934', 'weapon3': '1.060', 'DAMAGECOUNT': '1.353', 'FRAGCOUNT': '4.000'} [2024-08-05 22:44:28,938][52660] DAMAGECOUNT value on done: 13100.0 [2024-08-05 22:44:28,942][52660] Sum rewards: 13.436, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.260', 'weapon5': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.400', 'ARMOR': '0.500', 'weapon4': '0.686', 'weapon2': '0.730', 'WEAPON3': '1.000', 'HITCOUNT': '1.230', 'weapon3': '2.016', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:29,760][52670] DAMAGECOUNT value on done: 13736.0 [2024-08-05 22:44:29,760][52670] Sum rewards: 15.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.392', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon5': '0.144', 'weapon4': '0.216', 'ARMOR': '0.451', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon2': '1.518', 'weapon3': '1.728', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:29,979][52650] Updated weights for policy 0, policy_version 9801 (0.0022) [2024-08-05 22:44:30,314][52666] DAMAGECOUNT value on done: 11772.0 [2024-08-05 22:44:30,315][52666] Sum rewards: 15.896, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.715', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON3': '0.650', 'HITCOUNT': '1.310', 'weapon2': '1.486', 'weapon3': '1.692', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:31,126][52659] DAMAGECOUNT value on done: 10424.0 [2024-08-05 22:44:31,128][52659] Sum rewards: 5.812, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.339', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.234', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.296', 'weapon3': '1.318', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '3.500'} [2024-08-05 22:44:31,484][52668] DAMAGECOUNT value on done: 12019.0 [2024-08-05 22:44:31,485][52668] Sum rewards: 21.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.440', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon4': '0.348', 'ARMOR': '0.472', 'weapon2': '0.720', 'WEAPON3': '1.250', 'HITCOUNT': '1.580', 'weapon3': '2.514', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '22.000'} [2024-08-05 22:44:31,859][52660] DAMAGECOUNT value on done: 13856.0 [2024-08-05 22:44:31,859][52660] Sum rewards: 3.331, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.385', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.020', 'AMMO4': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'weapon3': '1.064', 'weapon2': '1.088', 'DAMAGECOUNT': '1.785', 'FRAGCOUNT': '2.000'} [2024-08-05 22:44:32,205][52820] DAMAGECOUNT value on done: 10921.0 [2024-08-05 22:44:32,205][52820] Sum rewards: 11.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.113', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.024', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.133', 'WEAPON4': '0.300', 'weapon4': '0.458', 'WEAPON3': '0.800', 'weapon2': '1.064', 'HITCOUNT': '1.120', 'weapon3': '1.806', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '13.000'} [2024-08-05 22:44:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16930.1, 300 sec: 16772.8). Total num frames: 80330752. Throughput: 0: 4213.1. Samples: 20083020. Policy #0 lag: (min: 0.0, avg: 3.3, max: 6.0) [2024-08-05 22:44:32,795][52567] Avg episode reward: [(0, '11.191')] [2024-08-05 22:44:33,029][52670] DAMAGECOUNT value on done: 11725.0 [2024-08-05 22:44:33,029][52670] Sum rewards: 10.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.334', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'weapon4': '0.504', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'HITCOUNT': '1.000', 'weapon2': '1.358', 'weapon3': '1.754', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:33,618][52666] DAMAGECOUNT value on done: 12363.0 [2024-08-05 22:44:33,618][52666] Sum rewards: 14.063, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.126', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon4': '0.266', 'ARMOR': '0.412', 'weapon2': '0.922', 'WEAPON3': '0.950', 'HITCOUNT': '1.250', 'weapon3': '2.388', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '13.000'} [2024-08-05 22:44:34,116][52659] DAMAGECOUNT value on done: 12516.0 [2024-08-05 22:44:34,117][52659] Sum rewards: 9.495, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.380', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.111', 'WEAPON3': '0.800', 'ARMOR': '0.905', 'HITCOUNT': '1.040', 'weapon3': '1.614', 'weapon2': '1.638', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:34,733][52668] DAMAGECOUNT value on done: 12656.0 [2024-08-05 22:44:34,733][52668] Sum rewards: 12.329, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.210', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO3': '0.110', 'ARMOR': '0.462', 'WEAPON3': '0.750', 'HITCOUNT': '1.170', 'weapon2': '1.464', 'weapon3': '1.528', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:34,963][52650] Updated weights for policy 0, policy_version 9811 (0.0040) [2024-08-05 22:44:35,124][52660] DAMAGECOUNT value on done: 11226.0 [2024-08-05 22:44:35,126][52660] Sum rewards: 16.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.813', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon5': '0.028', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.861', 'HITCOUNT': '1.050', 'weapon2': '1.568', 'weapon3': '1.852', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '13.000'} [2024-08-05 22:44:35,677][52820] DAMAGECOUNT value on done: 10825.0 [2024-08-05 22:44:35,679][52820] Sum rewards: 9.396, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '0.002', 'AMMO2': '0.010', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.066', 'weapon4': '0.072', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.820', 'ARMOR': '0.912', 'weapon2': '1.206', 'weapon3': '1.376', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '5.000'} [2024-08-05 22:44:36,456][52670] DAMAGECOUNT value on done: 11107.0 [2024-08-05 22:44:36,456][52670] Sum rewards: 13.964, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'HEALTH': '0.014', 'AMMO2': '0.028', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.141', 'weapon5': '0.316', 'ARMOR': '0.424', 'weapon4': '0.434', 'WEAPON3': '0.450', 'HITCOUNT': '0.920', 'weapon2': '1.360', 'weapon3': '1.414', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '8.500'} [2024-08-05 22:44:36,876][52666] DAMAGECOUNT value on done: 12023.0 [2024-08-05 22:44:36,877][52666] Sum rewards: 9.272, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.650', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon4': '0.064', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.508', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon2': '1.052', 'weapon3': '1.792', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.2, 300 sec: 16828.3). Total num frames: 80420864. Throughput: 0: 4207.6. Samples: 20108180. Policy #0 lag: (min: 0.0, avg: 3.3, max: 6.0) [2024-08-05 22:44:37,794][52567] Avg episode reward: [(0, '11.374')] [2024-08-05 22:44:38,193][52668] DAMAGECOUNT value on done: 12564.0 [2024-08-05 22:44:38,194][52668] Sum rewards: 12.881, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.234', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon3': '1.650', 'weapon2': '1.740', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:38,608][52660] DAMAGECOUNT value on done: 12617.0 [2024-08-05 22:44:38,609][52660] Sum rewards: 15.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.529', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'ARMOR': '0.498', 'WEAPON3': '1.000', 'weapon2': '1.226', 'HITCOUNT': '1.230', 'weapon3': '2.372', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '16.000'} [2024-08-05 22:44:38,998][52820] DAMAGECOUNT value on done: 11321.0 [2024-08-05 22:44:38,998][52820] Sum rewards: 10.158, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.022', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.616', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '0.726', 'ARMOR': '0.984', 'weapon3': '1.886', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:39,195][52670] DAMAGECOUNT value on done: 12310.0 [2024-08-05 22:44:39,196][52670] Sum rewards: 18.644, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.412', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.016', 'ARMOR': '0.024', 'weapon4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'WEAPON3': '0.650', 'HITCOUNT': '1.210', 'weapon2': '1.426', 'weapon3': '1.690', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '15.500'} [2024-08-05 22:44:39,304][52669] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-05 22:44:39,791][52666] DAMAGECOUNT value on done: 12050.0 [2024-08-05 22:44:39,791][52666] Sum rewards: 14.749, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.764', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'ARMOR': '0.412', 'WEAPON3': '0.950', 'HITCOUNT': '1.250', 'weapon2': '1.504', 'weapon3': '2.210', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '13.000'} [2024-08-05 22:44:40,123][52650] Updated weights for policy 0, policy_version 9821 (0.0026) [2024-08-05 22:44:41,020][52668] DAMAGECOUNT value on done: 13447.0 [2024-08-05 22:44:41,023][52668] Sum rewards: 8.943, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.115', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.129', 'weapon4': '0.234', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'ARMOR': '0.900', 'weapon2': '1.178', 'weapon3': '1.798', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:41,351][52660] DAMAGECOUNT value on done: 9401.0 [2024-08-05 22:44:41,352][52660] Sum rewards: 5.810, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.808', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon4': '0.166', 'ARMOR': '0.528', 'HITCOUNT': '0.690', 'WEAPON3': '1.050', 'weapon2': '1.100', 'weapon3': '1.914', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:42,391][52820] DAMAGECOUNT value on done: 10860.0 [2024-08-05 22:44:42,391][52820] Sum rewards: 19.474, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.727', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.168', 'WEAPON3': '0.500', 'ARMOR': '0.906', 'HITCOUNT': '1.270', 'weapon3': '1.556', 'weapon2': '1.830', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '15.000'} [2024-08-05 22:44:42,521][52670] DAMAGECOUNT value on done: 10736.0 [2024-08-05 22:44:42,522][52670] Sum rewards: 9.435, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.198', 'AMMO2': '0.027', 'ARMOR': '0.080', 'AMMO4': '0.135', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.826', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.364', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 80502784. Throughput: 0: 4200.2. Samples: 20133310. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:44:42,794][52567] Avg episode reward: [(0, '11.570')] [2024-08-05 22:44:43,040][52666] DAMAGECOUNT value on done: 10824.0 [2024-08-05 22:44:43,044][52666] Sum rewards: 8.284, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.014', 'AMMO4': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'ARMOR': '0.900', 'WEAPON3': '0.950', 'HITCOUNT': '1.160', 'weapon2': '1.288', 'weapon3': '2.210', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:43,703][52668] DAMAGECOUNT value on done: 12771.0 [2024-08-05 22:44:43,705][52668] Sum rewards: 11.436, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.979', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'weapon4': '0.260', 'WEAPON3': '0.500', 'HITCOUNT': '0.700', 'weapon2': '1.014', 'weapon3': '1.330', 'ARMOR': '1.347', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:43,988][52660] DAMAGECOUNT value on done: 13599.0 [2024-08-05 22:44:43,990][52660] Sum rewards: 7.821, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.159', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.412', 'ARMOR': '0.514', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.318', 'weapon3': '1.522', 'DAMAGECOUNT': '2.508', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:44,898][52650] Updated weights for policy 0, policy_version 9831 (0.0011) [2024-08-05 22:44:45,852][52820] DAMAGECOUNT value on done: 11084.0 [2024-08-05 22:44:45,853][52820] Sum rewards: 7.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.458', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.084', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.512', 'weapon4': '0.576', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'weapon2': '0.938', 'weapon3': '1.948', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '6.000'} [2024-08-05 22:44:46,060][52670] DAMAGECOUNT value on done: 12696.0 [2024-08-05 22:44:46,060][52670] Sum rewards: 13.362, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO3': '0.088', 'AMMO4': '0.093', 'weapon4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '1.472', 'weapon3': '1.772', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:46,548][52668] DAMAGECOUNT value on done: 11972.0 [2024-08-05 22:44:46,549][52668] Sum rewards: 13.934, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.254', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon7': '0.056', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '0.810', 'weapon2': '1.138', 'weapon3': '1.756', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:46,693][52666] DAMAGECOUNT value on done: 11894.0 [2024-08-05 22:44:46,694][52666] Sum rewards: 10.904, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.038', 'AMMO3': '0.080', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'HITCOUNT': '0.510', 'weapon4': '0.528', 'HEALTH': '0.588', 'weapon2': '1.204', 'weapon3': '1.556', 'DAMAGECOUNT': '1.905', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:47,022][52660] DAMAGECOUNT value on done: 11824.0 [2024-08-05 22:44:47,022][52660] Sum rewards: 13.960, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.903', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.080', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'AMMO4': '0.188', 'weapon4': '0.264', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'ARMOR': '1.330', 'weapon2': '1.606', 'weapon3': '1.730', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 80584704. Throughput: 0: 4198.9. Samples: 20146180. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:44:47,795][52567] Avg episode reward: [(0, '11.405')] [2024-08-05 22:44:49,099][52820] DAMAGECOUNT value on done: 12637.0 [2024-08-05 22:44:49,099][52820] Sum rewards: 11.691, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.087', 'AMMO2': '0.004', 'ARMOR': '0.020', 'AMMO4': '0.022', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'WEAPON3': '1.000', 'weapon2': '1.080', 'HITCOUNT': '1.230', 'weapon3': '2.246', 'DAMAGECOUNT': '4.593', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:49,218][52670] DAMAGECOUNT value on done: 10835.0 [2024-08-05 22:44:49,218][52670] Sum rewards: 9.220, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.220', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.107', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'weapon3': '1.520', 'weapon2': '1.696', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:49,249][52668] DAMAGECOUNT value on done: 14319.0 [2024-08-05 22:44:49,250][52668] Sum rewards: 22.446, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.236', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.022', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.168', 'ARMOR': '0.450', 'weapon2': '1.026', 'WEAPON3': '1.150', 'HITCOUNT': '1.680', 'weapon3': '2.568', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '21.000'} [2024-08-05 22:44:49,347][52650] Updated weights for policy 0, policy_version 9841 (0.0013) [2024-08-05 22:44:49,667][52660] DAMAGECOUNT value on done: 13434.0 [2024-08-05 22:44:49,671][52660] Sum rewards: 10.119, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.142', 'weapon4': '0.486', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'ARMOR': '0.864', 'weapon2': '0.988', 'weapon3': '1.610', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '7.500'} [2024-08-05 22:44:49,985][52666] DAMAGECOUNT value on done: 10860.0 [2024-08-05 22:44:49,987][52666] Sum rewards: 4.388, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.313', 'AMMO2': '0.004', 'AMMO5': '0.008', 'AMMO4': '0.021', 'AMMO3': '0.088', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HITCOUNT': '0.380', 'weapon4': '0.546', 'WEAPON3': '0.650', 'weapon2': '0.692', 'ARMOR': '0.844', 'weapon3': '1.212', 'DAMAGECOUNT': '1.881', 'FRAGCOUNT': '4.000'} [2024-08-05 22:44:52,464][52668] DAMAGECOUNT value on done: 10989.0 [2024-08-05 22:44:52,467][52668] Sum rewards: 11.894, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.731', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'HITCOUNT': '1.190', 'weapon2': '1.330', 'weapon3': '2.070', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '10.000'} [2024-08-05 22:44:52,712][52820] DAMAGECOUNT value on done: 9963.0 [2024-08-05 22:44:52,713][52820] Sum rewards: 6.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.466', 'ARMOR': '0.497', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '0.922', 'weapon3': '1.496', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:52,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.5, 300 sec: 16772.8). Total num frames: 80666624. Throughput: 0: 4202.9. Samples: 20171600. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:44:52,795][52567] Avg episode reward: [(0, '11.348')] [2024-08-05 22:44:52,910][52670] DAMAGECOUNT value on done: 11614.0 [2024-08-05 22:44:52,910][52670] Sum rewards: 11.345, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.254', 'ARMOR': '0.861', 'weapon2': '0.996', 'WEAPON3': '1.000', 'HITCOUNT': '1.220', 'weapon3': '2.524', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:53,016][52614] Signal inference workers to stop experience collection... (1850 times) [2024-08-05 22:44:53,025][52614] Signal inference workers to resume experience collection... (1850 times) [2024-08-05 22:44:53,057][52650] InferenceWorker_p0-w0: stopping experience collection (1850 times) [2024-08-05 22:44:53,057][52650] InferenceWorker_p0-w0: resuming experience collection (1850 times) [2024-08-05 22:44:53,061][52660] DAMAGECOUNT value on done: 12565.0 [2024-08-05 22:44:53,062][52660] Sum rewards: 10.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon7': '0.058', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.360', 'WEAPON3': '0.700', 'HITCOUNT': '0.950', 'weapon2': '1.024', 'weapon3': '1.398', 'ARMOR': '1.800', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '7.000'} [2024-08-05 22:44:53,590][52666] DAMAGECOUNT value on done: 12532.0 [2024-08-05 22:44:53,592][52666] Sum rewards: 8.820, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.458', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.114', 'WEAPON3': '0.800', 'ARMOR': '0.943', 'HITCOUNT': '0.990', 'weapon2': '1.320', 'weapon3': '1.772', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '8.000'} [2024-08-05 22:44:54,540][52650] Updated weights for policy 0, policy_version 9851 (0.0015) [2024-08-05 22:44:55,729][52668] DAMAGECOUNT value on done: 12307.0 [2024-08-05 22:44:55,730][52668] Sum rewards: 8.875, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.042', 'AMMO3': '0.086', 'HEALTH': '0.201', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'ARMOR': '0.896', 'weapon4': '0.928', 'weapon2': '1.054', 'weapon3': '1.496', 'DAMAGECOUNT': '2.901', 'FRAGCOUNT': '6.000'} [2024-08-05 22:44:55,986][52670] DAMAGECOUNT value on done: 11847.0 [2024-08-05 22:44:55,988][52670] Sum rewards: 12.807, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.288', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.354', 'WEAPON3': '0.750', 'ARMOR': '0.934', 'HITCOUNT': '0.970', 'weapon2': '1.406', 'weapon3': '1.500', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:56,025][52660] DAMAGECOUNT value on done: 13623.0 [2024-08-05 22:44:56,026][52660] Sum rewards: 15.601, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.408', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.012', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.800', 'ARMOR': '1.000', 'HITCOUNT': '1.070', 'weapon2': '1.296', 'weapon3': '1.822', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '14.000'} [2024-08-05 22:44:56,186][52820] DAMAGECOUNT value on done: 11360.0 [2024-08-05 22:44:56,186][52820] Sum rewards: 8.926, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.018', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.262', 'WEAPON3': '0.450', 'ARMOR': '0.489', 'HITCOUNT': '0.750', 'weapon3': '1.272', 'weapon2': '1.424', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '6.500'} [2024-08-05 22:44:56,515][52666] DAMAGECOUNT value on done: 12045.0 [2024-08-05 22:44:56,516][52666] Sum rewards: 16.076, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.486', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.232', 'WEAPON3': '0.750', 'ARMOR': '0.959', 'HITCOUNT': '1.060', 'weapon2': '1.594', 'weapon3': '1.814', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '14.000'} [2024-08-05 22:44:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 80748544. Throughput: 0: 4192.0. Samples: 20196840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:44:57,802][52567] Avg episode reward: [(0, '11.396')] [2024-08-05 22:44:58,148][52668] DAMAGECOUNT value on done: 12291.0 [2024-08-05 22:44:58,148][52668] Sum rewards: 11.854, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.114', 'HEALTH': '0.290', 'WEAPON3': '0.700', 'ARMOR': '0.882', 'HITCOUNT': '1.060', 'weapon2': '1.300', 'weapon3': '1.860', 'DAMAGECOUNT': '3.813', 'FRAGCOUNT': '9.000'} [2024-08-05 22:44:58,554][52660] DAMAGECOUNT value on done: 12232.0 [2024-08-05 22:44:58,555][52660] Sum rewards: 12.343, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.980', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.050', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.390', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '1.272', 'weapon3': '1.544', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '11.000'} [2024-08-05 22:44:59,083][52650] Updated weights for policy 0, policy_version 9861 (0.0023) [2024-08-05 22:44:59,310][52670] DAMAGECOUNT value on done: 10658.0 [2024-08-05 22:44:59,310][52670] Sum rewards: 4.088, reward structure: {'DEATHCOUNT': '-1.500', 'AMMO2': '0.010', 'AMMO3': '0.030', 'ARMOR': '0.044', 'AMMO4': '0.050', 'HEALTH': '0.063', 'WEAPON4': '0.100', 'WEAPON3': '0.200', 'HITCOUNT': '0.300', 'weapon4': '0.346', 'weapon2': '0.536', 'weapon3': '0.694', 'DAMAGECOUNT': '1.215', 'FRAGCOUNT': '2.000'} [2024-08-05 22:44:59,579][52820] DAMAGECOUNT value on done: 12766.0 [2024-08-05 22:44:59,579][52820] Sum rewards: 14.951, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.327', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.030', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.107', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'weapon2': '0.538', 'weapon4': '0.692', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'weapon3': '2.148', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '12.000'} [2024-08-05 22:44:59,723][52666] DAMAGECOUNT value on done: 10181.0 [2024-08-05 22:44:59,725][52666] Sum rewards: 6.754, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.482', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'ARMOR': '0.448', 'weapon4': '0.512', 'WEAPON3': '0.550', 'HITCOUNT': '0.720', 'weapon2': '1.276', 'weapon3': '1.586', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '4.000'} [2024-08-05 22:45:01,174][52668] DAMAGECOUNT value on done: 12029.0 [2024-08-05 22:45:01,174][52668] Sum rewards: 8.794, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'weapon4': '0.256', 'WEAPON3': '0.300', 'HITCOUNT': '0.520', 'HEALTH': '0.536', 'weapon2': '0.864', 'weapon3': '1.188', 'DAMAGECOUNT': '1.929', 'FRAGCOUNT': '6.000'} [2024-08-05 22:45:01,409][52660] DAMAGECOUNT value on done: 13004.0 [2024-08-05 22:45:01,410][52660] Sum rewards: 16.942, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.087', 'weapon5': '0.110', 'weapon4': '0.224', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon3': '1.706', 'weapon2': '1.752', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:02,413][52670] DAMAGECOUNT value on done: 12845.0 [2024-08-05 22:45:02,416][52670] Sum rewards: 12.633, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.012', 'AMMO4': '0.062', 'HEALTH': '0.076', 'AMMO3': '0.115', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.050', 'weapon3': '1.338', 'weapon2': '1.608', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 16800.6). Total num frames: 80838656. Throughput: 0: 4195.6. Samples: 20209520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:45:02,794][52567] Avg episode reward: [(0, '11.366')] [2024-08-05 22:45:02,966][52820] DAMAGECOUNT value on done: 11176.0 [2024-08-05 22:45:02,967][52820] Sum rewards: 8.723, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.490', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.362', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'weapon3': '1.584', 'weapon2': '1.734', 'ARMOR': '1.865', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:03,051][52666] DAMAGECOUNT value on done: 10777.0 [2024-08-05 22:45:03,051][52666] Sum rewards: 18.776, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.030', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.056', 'AMMO3': '0.080', 'HEALTH': '0.173', 'WEAPON3': '0.500', 'HITCOUNT': '0.950', 'weapon3': '1.756', 'weapon2': '1.778', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '16.000'} [2024-08-05 22:45:03,587][52668] DAMAGECOUNT value on done: 10913.0 [2024-08-05 22:45:03,589][52668] Sum rewards: 5.468, reward structure: {'DEATHCOUNT': '-3.000', 'weapon4': '0.006', 'AMMO2': '0.015', 'AMMO3': '0.050', 'HEALTH': '0.054', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON3': '0.350', 'ARMOR': '0.435', 'HITCOUNT': '0.550', 'weapon2': '1.152', 'weapon3': '1.254', 'DAMAGECOUNT': '1.428', 'FRAGCOUNT': '3.000'} [2024-08-05 22:45:03,937][52650] Updated weights for policy 0, policy_version 9871 (0.0038) [2024-08-05 22:45:04,004][52660] DAMAGECOUNT value on done: 12859.0 [2024-08-05 22:45:04,006][52660] Sum rewards: 9.055, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.755', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.125', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'weapon4': '0.546', 'WEAPON3': '0.900', 'HITCOUNT': '0.990', 'weapon2': '1.178', 'weapon3': '2.092', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:05,765][52670] DAMAGECOUNT value on done: 13231.0 [2024-08-05 22:45:05,767][52670] Sum rewards: 12.868, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.720', 'AMMO2': '0.015', 'ARMOR': '0.040', 'AMMO4': '0.073', 'AMMO3': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.240', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.294', 'weapon3': '1.490', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:06,358][52666] DAMAGECOUNT value on done: 11686.0 [2024-08-05 22:45:06,360][52666] Sum rewards: 13.052, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.388', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.184', 'weapon5': '0.194', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'HITCOUNT': '1.160', 'weapon2': '1.326', 'weapon3': '1.814', 'DAMAGECOUNT': '3.822', 'FRAGCOUNT': '11.000'} [2024-08-05 22:45:06,842][52668] DAMAGECOUNT value on done: 12299.0 [2024-08-05 22:45:06,843][52668] Sum rewards: 12.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.450', 'AMMO2': '0.001', 'weapon4': '0.004', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.800', 'HITCOUNT': '1.380', 'weapon2': '1.772', 'weapon3': '1.892', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '11.000'} [2024-08-05 22:45:07,137][52660] DAMAGECOUNT value on done: 13151.0 [2024-08-05 22:45:07,138][52660] Sum rewards: 22.086, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.487', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.133', 'weapon4': '0.144', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.865', 'WEAPON3': '1.000', 'weapon2': '1.290', 'HITCOUNT': '1.500', 'weapon3': '2.244', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '20.000'} [2024-08-05 22:45:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 80920576. Throughput: 0: 4204.2. Samples: 20234800. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:45:07,794][52567] Avg episode reward: [(0, '11.622')] [2024-08-05 22:45:07,804][52614] Saving new best policy, reward=11.622! [2024-08-05 22:45:08,917][52650] Updated weights for policy 0, policy_version 9881 (0.0034) [2024-08-05 22:45:09,006][52670] DAMAGECOUNT value on done: 13779.0 [2024-08-05 22:45:09,011][52670] Sum rewards: 15.111, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.289', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO3': '0.089', 'ARMOR': '0.462', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.294', 'weapon3': '1.538', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:09,540][52666] DAMAGECOUNT value on done: 12236.0 [2024-08-05 22:45:09,541][52666] Sum rewards: 14.648, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.575', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.244', 'WEAPON3': '0.500', 'ARMOR': '0.853', 'HITCOUNT': '1.000', 'weapon2': '1.198', 'weapon3': '1.290', 'DAMAGECOUNT': '3.777', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:09,649][52668] DAMAGECOUNT value on done: 11725.0 [2024-08-05 22:45:09,651][52668] Sum rewards: 5.987, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.750', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.012', 'weapon5': '0.046', 'AMMO3': '0.091', 'WEAPON5': '0.250', 'HITCOUNT': '0.560', 'WEAPON3': '0.650', 'weapon2': '1.540', 'weapon3': '1.614', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '5.000'} [2024-08-05 22:45:10,071][52660] DAMAGECOUNT value on done: 13640.0 [2024-08-05 22:45:10,074][52660] Sum rewards: 15.149, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.554', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.296', 'WEAPON3': '0.700', 'ARMOR': '0.856', 'HITCOUNT': '1.090', 'weapon2': '1.288', 'weapon3': '1.602', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:11,931][52670] DAMAGECOUNT value on done: 13705.0 [2024-08-05 22:45:11,931][52670] Sum rewards: 11.471, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.042', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.070', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.472', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon2': '1.198', 'ARMOR': '1.310', 'weapon3': '1.462', 'DAMAGECOUNT': '3.327', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:12,579][52666] DAMAGECOUNT value on done: 11909.0 [2024-08-05 22:45:12,580][52666] Sum rewards: 14.173, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.729', 'AMMO2': '0.003', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.017', 'weapon4': '0.086', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.871', 'WEAPON3': '1.100', 'HITCOUNT': '1.160', 'weapon2': '1.292', 'weapon3': '2.006', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:12,783][52668] DAMAGECOUNT value on done: 13475.0 [2024-08-05 22:45:12,784][52668] Sum rewards: 21.929, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.097', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.024', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.250', 'weapon4': '0.330', 'ARMOR': '0.548', 'WEAPON3': '0.700', 'weapon2': '1.062', 'HITCOUNT': '1.080', 'weapon3': '2.074', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '19.000'} [2024-08-05 22:45:12,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 16828.3). Total num frames: 81010688. Throughput: 0: 4209.5. Samples: 20259930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:45:12,795][52567] Avg episode reward: [(0, '11.662')] [2024-08-05 22:45:12,795][52614] Saving new best policy, reward=11.662! [2024-08-05 22:45:13,027][52660] DAMAGECOUNT value on done: 13140.0 [2024-08-05 22:45:13,028][52660] Sum rewards: 11.154, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.372', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.108', 'weapon4': '0.278', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'HITCOUNT': '1.000', 'weapon2': '1.468', 'weapon3': '1.610', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:13,717][52650] Updated weights for policy 0, policy_version 9891 (0.0019) [2024-08-05 22:45:15,544][52668] DAMAGECOUNT value on done: 13811.0 [2024-08-05 22:45:15,546][52668] Sum rewards: 20.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.369', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.120', 'ARMOR': '0.854', 'WEAPON3': '0.900', 'weapon2': '1.344', 'HITCOUNT': '1.510', 'weapon3': '2.088', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '17.000'} [2024-08-05 22:45:15,642][52670] DAMAGECOUNT value on done: 12594.0 [2024-08-05 22:45:15,642][52670] Sum rewards: 7.002, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.305', 'AMMO2': '0.021', 'ARMOR': '0.024', 'AMMO4': '0.105', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.314', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'weapon2': '1.224', 'weapon3': '1.980', 'DAMAGECOUNT': '2.946', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:15,947][52660] DAMAGECOUNT value on done: 13415.0 [2024-08-05 22:45:15,951][52660] Sum rewards: 8.049, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.119', 'WEAPON4': '0.350', 'ARMOR': '0.517', 'weapon4': '0.530', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '0.852', 'weapon3': '2.136', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '7.000'} [2024-08-05 22:45:16,333][52666] DAMAGECOUNT value on done: 12241.0 [2024-08-05 22:45:16,336][52666] Sum rewards: 10.086, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.466', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.388', 'WEAPON3': '0.650', 'ARMOR': '0.872', 'HITCOUNT': '0.970', 'weapon2': '1.208', 'weapon3': '1.748', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '7.000'} [2024-08-05 22:45:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 81092608. Throughput: 0: 4204.9. Samples: 20272240. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:45:17,794][52567] Avg episode reward: [(0, '11.889')] [2024-08-05 22:45:17,797][52614] Saving new best policy, reward=11.889! [2024-08-05 22:45:18,811][52650] Updated weights for policy 0, policy_version 9901 (0.0039) [2024-08-05 22:45:18,814][52668] DAMAGECOUNT value on done: 12630.0 [2024-08-05 22:45:18,814][52668] Sum rewards: 22.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.418', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'ARMOR': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.334', 'WEAPON3': '0.750', 'weapon2': '0.814', 'HITCOUNT': '1.270', 'weapon3': '2.180', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '19.000'} [2024-08-05 22:45:18,907][52670] DAMAGECOUNT value on done: 10484.0 [2024-08-05 22:45:18,907][52670] Sum rewards: 6.162, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.477', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.050', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'HITCOUNT': '0.410', 'ARMOR': '0.456', 'weapon4': '0.522', 'weapon2': '0.806', 'weapon3': '1.254', 'DAMAGECOUNT': '1.461', 'FRAGCOUNT': '4.000'} [2024-08-05 22:45:19,316][52660] DAMAGECOUNT value on done: 13020.0 [2024-08-05 22:45:19,318][52660] Sum rewards: 13.925, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon7': '0.052', 'HEALTH': '0.076', 'AMMO3': '0.089', 'AMMO4': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.260', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon2': '1.586', 'weapon3': '1.686', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:19,353][52666] DAMAGECOUNT value on done: 10453.0 [2024-08-05 22:45:19,353][52666] Sum rewards: 10.921, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.277', 'AMMO2': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.250', 'ARMOR': '0.480', 'WEAPON3': '0.550', 'HITCOUNT': '1.160', 'weapon2': '1.302', 'weapon3': '1.626', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:22,054][52670] DAMAGECOUNT value on done: 12550.0 [2024-08-05 22:45:22,055][52670] Sum rewards: 18.450, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'HEALTH': '0.060', 'AMMO4': '0.070', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON3': '0.650', 'ARMOR': '0.835', 'HITCOUNT': '1.190', 'weapon2': '1.390', 'weapon3': '2.230', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '15.000'} [2024-08-05 22:45:22,550][52660] DAMAGECOUNT value on done: 13189.0 [2024-08-05 22:45:22,551][52660] Sum rewards: 12.355, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.131', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.020', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.224', 'ARMOR': '0.489', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.500', 'weapon3': '2.038', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '11.000'} [2024-08-05 22:45:22,628][52666] DAMAGECOUNT value on done: 12655.0 [2024-08-05 22:45:22,628][52666] Sum rewards: 17.314, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon7': '0.072', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.750', 'ARMOR': '0.855', 'weapon2': '1.048', 'HITCOUNT': '1.240', 'weapon3': '1.958', 'DAMAGECOUNT': '5.127', 'FRAGCOUNT': '14.000'} [2024-08-05 22:45:22,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 81174528. Throughput: 0: 4213.3. Samples: 20297780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:45:22,795][52567] Avg episode reward: [(0, '12.259')] [2024-08-05 22:45:22,795][52614] Saving new best policy, reward=12.259! [2024-08-05 22:45:23,106][52794] DAMAGECOUNT value on done: 14351.0 [2024-08-05 22:45:23,106][52794] Sum rewards: 6.500, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.277', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.099', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'weapon4': '0.502', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '0.806', 'weapon3': '1.778', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '6.000'} [2024-08-05 22:45:23,787][52650] Updated weights for policy 0, policy_version 9911 (0.0016) [2024-08-05 22:45:24,550][52647] DAMAGECOUNT value on done: 14620.0 [2024-08-05 22:45:24,550][52647] Sum rewards: 10.370, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.147', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.124', 'weapon5': '0.234', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.890', 'weapon2': '1.048', 'ARMOR': '1.713', 'weapon3': '2.094', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:25,295][52794] DAMAGECOUNT value on done: 15684.0 [2024-08-05 22:45:25,297][52794] Sum rewards: 13.043, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.850', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.292', 'WEAPON3': '0.750', 'ARMOR': '0.828', 'HITCOUNT': '1.050', 'weapon2': '1.326', 'weapon3': '1.540', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '11.000'} [2024-08-05 22:45:25,357][52660] DAMAGECOUNT value on done: 12823.0 [2024-08-05 22:45:25,357][52660] Sum rewards: 11.561, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.570', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.135', 'WEAPON4': '0.300', 'weapon4': '0.434', 'ARMOR': '0.496', 'WEAPON3': '0.950', 'weapon2': '0.992', 'HITCOUNT': '1.300', 'weapon3': '2.214', 'DAMAGECOUNT': '4.476', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:25,454][52670] DAMAGECOUNT value on done: 12069.0 [2024-08-05 22:45:25,456][52670] Sum rewards: 3.487, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.711', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'ARMOR': '0.495', 'HITCOUNT': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.392', 'weapon3': '1.664', 'DAMAGECOUNT': '2.163', 'FRAGCOUNT': '4.000'} [2024-08-05 22:45:26,029][52666] DAMAGECOUNT value on done: 13533.0 [2024-08-05 22:45:26,032][52666] Sum rewards: 13.923, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.706', 'AMMO2': '0.002', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'weapon4': '0.258', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon3': '1.488', 'weapon2': '1.586', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '11.000'} [2024-08-05 22:45:27,384][52647] DAMAGECOUNT value on done: 12221.0 [2024-08-05 22:45:27,384][52647] Sum rewards: 11.802, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.576', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'ARMOR': '0.539', 'weapon2': '0.882', 'HITCOUNT': '0.960', 'WEAPON3': '1.000', 'weapon3': '2.686', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '12.000'} [2024-08-05 22:45:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 81256448. Throughput: 0: 4198.2. Samples: 20322230. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:45:27,794][52567] Avg episode reward: [(0, '12.023')] [2024-08-05 22:45:28,035][52794] DAMAGECOUNT value on done: 15876.0 [2024-08-05 22:45:28,035][52794] Sum rewards: 11.160, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.157', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.018', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.298', 'ARMOR': '0.528', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.050', 'weapon3': '1.888', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:28,168][52662] DAMAGECOUNT value on done: 13476.0 [2024-08-05 22:45:28,169][52662] Sum rewards: 4.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.466', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO3': '0.105', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'ARMOR': '1.330', 'weapon3': '1.800', 'weapon2': '1.876', 'DAMAGECOUNT': '3.126', 'FRAGCOUNT': '4.000'} [2024-08-05 22:45:28,400][52670] DAMAGECOUNT value on done: 12386.0 [2024-08-05 22:45:28,401][52670] Sum rewards: 4.345, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.378', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.069', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.390', 'HITCOUNT': '0.500', 'WEAPON3': '0.550', 'ARMOR': '0.865', 'weapon2': '0.988', 'weapon3': '1.138', 'DAMAGECOUNT': '1.650', 'FRAGCOUNT': '4.000'} [2024-08-05 22:45:28,643][52650] Updated weights for policy 0, policy_version 9921 (0.0026) [2024-08-05 22:45:29,006][52666] DAMAGECOUNT value on done: 12179.0 [2024-08-05 22:45:29,009][52666] Sum rewards: 10.262, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.195', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.072', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.382', 'weapon3': '1.590', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:30,312][52647] DAMAGECOUNT value on done: 15156.0 [2024-08-05 22:45:30,313][52647] Sum rewards: 8.651, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.105', 'weapon4': '0.144', 'WEAPON4': '0.150', 'ARMOR': '0.487', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon3': '1.760', 'weapon2': '1.768', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '6.000'} [2024-08-05 22:45:30,489][52794] DAMAGECOUNT value on done: 14116.0 [2024-08-05 22:45:30,490][52794] Sum rewards: 10.928, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.170', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon7': '0.064', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.312', 'WEAPON3': '0.650', 'ARMOR': '0.936', 'HITCOUNT': '0.970', 'weapon2': '1.344', 'weapon3': '1.752', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:30,662][52662] DAMAGECOUNT value on done: 14935.0 [2024-08-05 22:45:30,662][52662] Sum rewards: 10.152, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.826', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'ARMOR': '1.282', 'weapon3': '1.448', 'weapon2': '1.656', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:31,057][52669] DAMAGECOUNT value on done: 12991.0 [2024-08-05 22:45:31,059][52669] Sum rewards: 13.078, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.533', 'AMMO2': '0.013', 'weapon7': '0.038', 'AMMO4': '0.066', 'AMMO3': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.292', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.250', 'weapon3': '1.818', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:31,677][52670] DAMAGECOUNT value on done: 12703.0 [2024-08-05 22:45:31,678][52670] Sum rewards: 11.943, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.314', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.035', 'ARMOR': '0.071', 'AMMO3': '0.103', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '1.222', 'weapon3': '1.778', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 81346560. Throughput: 0: 4193.8. Samples: 20334900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:45:32,794][52567] Avg episode reward: [(0, '11.822')] [2024-08-05 22:45:33,045][52794] DAMAGECOUNT value on done: 16161.0 [2024-08-05 22:45:33,046][52794] Sum rewards: 11.203, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.359', 'AMMO2': '0.033', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'weapon4': '0.282', 'ARMOR': '0.546', 'weapon2': '0.840', 'HITCOUNT': '0.980', 'WEAPON3': '1.000', 'weapon3': '2.490', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '11.000'} [2024-08-05 22:45:33,282][52662] DAMAGECOUNT value on done: 16338.0 [2024-08-05 22:45:33,290][52662] Sum rewards: 9.986, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.238', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.106', 'ARMOR': '0.444', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.746', 'weapon3': '1.778', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '7.000'} [2024-08-05 22:45:33,309][52647] DAMAGECOUNT value on done: 10497.0 [2024-08-05 22:45:33,312][52647] Sum rewards: 10.326, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.696', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.222', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'ARMOR': '1.326', 'weapon2': '1.404', 'weapon3': '1.712', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '7.000'} [2024-08-05 22:45:33,512][52650] Updated weights for policy 0, policy_version 9931 (0.0020) [2024-08-05 22:45:34,128][52669] DAMAGECOUNT value on done: 13089.0 [2024-08-05 22:45:34,128][52669] Sum rewards: 12.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.984', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.010', 'WEAPON4': '0.050', 'weapon7': '0.066', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.847', 'weapon2': '1.018', 'HITCOUNT': '1.070', 'weapon3': '1.696', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:35,915][52794] DAMAGECOUNT value on done: 14631.0 [2024-08-05 22:45:35,917][52794] Sum rewards: 8.937, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.138', 'AMMO2': '0.020', 'AMMO3': '0.063', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'weapon2': '0.644', 'weapon4': '0.784', 'ARMOR': '0.967', 'weapon3': '1.234', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '6.000'} [2024-08-05 22:45:36,189][52662] DAMAGECOUNT value on done: 14586.0 [2024-08-05 22:45:36,191][52662] Sum rewards: 13.539, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.580', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.024', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.125', 'WEAPON3': '0.850', 'ARMOR': '0.879', 'HITCOUNT': '1.000', 'weapon2': '1.590', 'weapon3': '1.966', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '14.000'} [2024-08-05 22:45:36,237][52647] DAMAGECOUNT value on done: 13195.0 [2024-08-05 22:45:36,237][52647] Sum rewards: 13.306, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'HEALTH': '0.043', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.252', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.810', 'weapon2': '1.272', 'weapon3': '1.770', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '10.000'} [2024-08-05 22:45:37,172][52669] DAMAGECOUNT value on done: 13485.0 [2024-08-05 22:45:37,173][52669] Sum rewards: 11.520, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.809', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'AMMO3': '0.050', 'weapon7': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.132', 'weapon5': '0.138', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.457', 'HITCOUNT': '0.630', 'weapon3': '0.980', 'weapon2': '1.332', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 81428480. Throughput: 0: 4198.9. Samples: 20360550. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:45:37,794][52567] Avg episode reward: [(0, '11.751')] [2024-08-05 22:45:38,353][52794] DAMAGECOUNT value on done: 14622.0 [2024-08-05 22:45:38,360][52794] Sum rewards: 21.003, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.846', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.036', 'AMMO3': '0.164', 'WEAPON3': '0.950', 'HITCOUNT': '1.400', 'weapon2': '1.556', 'weapon3': '2.094', 'DAMAGECOUNT': '5.631', 'FRAGCOUNT': '19.000'} [2024-08-05 22:45:38,498][52650] Updated weights for policy 0, policy_version 9941 (0.0012) [2024-08-05 22:45:38,787][52662] DAMAGECOUNT value on done: 15807.0 [2024-08-05 22:45:38,790][52662] Sum rewards: 17.547, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.852', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'AMMO3': '0.098', 'WEAPON5': '0.150', 'weapon5': '0.438', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'ARMOR': '1.295', 'weapon2': '1.414', 'weapon3': '1.496', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:39,193][52647] DAMAGECOUNT value on done: 12970.0 [2024-08-05 22:45:39,194][52647] Sum rewards: 5.541, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.020', 'weapon5': '0.038', 'weapon7': '0.052', 'weapon4': '0.080', 'AMMO4': '0.083', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.130', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '0.680', 'weapon2': '1.196', 'weapon3': '1.604', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '3.500'} [2024-08-05 22:45:40,297][52669] DAMAGECOUNT value on done: 14718.0 [2024-08-05 22:45:40,298][52669] Sum rewards: 11.268, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.840', 'AMMO4': '-0.068', 'AMMO2': '-0.013', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.252', 'ARMOR': '0.525', 'WEAPON3': '0.700', 'weapon2': '1.084', 'HITCOUNT': '1.290', 'weapon3': '1.518', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:40,945][52794] DAMAGECOUNT value on done: 12586.0 [2024-08-05 22:45:40,947][52794] Sum rewards: 5.576, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.062', 'AMMO2': '0.016', 'weapon7': '0.038', 'AMMO4': '0.078', 'AMMO3': '0.108', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.282', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'ARMOR': '1.273', 'weapon2': '1.588', 'weapon3': '1.594', 'DAMAGECOUNT': '2.061', 'FRAGCOUNT': '4.000'} [2024-08-05 22:45:41,374][52662] DAMAGECOUNT value on done: 16708.0 [2024-08-05 22:45:41,374][52662] Sum rewards: 8.846, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.784', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'ARMOR': '0.948', 'weapon2': '1.104', 'weapon3': '1.582', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '7.000'} [2024-08-05 22:45:42,316][52647] DAMAGECOUNT value on done: 12486.0 [2024-08-05 22:45:42,316][52647] Sum rewards: 16.522, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.135', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'weapon7': '0.062', 'AMMO3': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '1.150', 'weapon2': '1.398', 'weapon3': '1.406', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:42,642][52669] DAMAGECOUNT value on done: 13213.0 [2024-08-05 22:45:42,642][52669] Sum rewards: 9.432, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.960', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'HITCOUNT': '1.030', 'WEAPON3': '1.050', 'ARMOR': '1.396', 'weapon2': '1.440', 'weapon3': '1.918', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16800.6). Total num frames: 81510400. Throughput: 0: 4195.3. Samples: 20385630. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:45:42,794][52567] Avg episode reward: [(0, '11.730')] [2024-08-05 22:45:43,177][52650] Updated weights for policy 0, policy_version 9951 (0.0012) [2024-08-05 22:45:43,650][52794] DAMAGECOUNT value on done: 16186.0 [2024-08-05 22:45:43,650][52794] Sum rewards: 5.431, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.584', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'WEAPON3': '1.100', 'HITCOUNT': '1.100', 'weapon2': '1.162', 'weapon3': '2.076', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '7.000'} [2024-08-05 22:45:43,824][52665] DAMAGECOUNT value on done: 12054.0 [2024-08-05 22:45:43,830][52665] Sum rewards: 8.874, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.130', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.114', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'ARMOR': '0.904', 'HITCOUNT': '0.980', 'weapon2': '1.370', 'weapon3': '1.962', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:44,013][52662] DAMAGECOUNT value on done: 15231.0 [2024-08-05 22:45:44,013][52662] Sum rewards: 11.612, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.666', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.360', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '0.869', 'weapon2': '1.344', 'weapon3': '1.624', 'DAMAGECOUNT': '2.649', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:45,446][52647] DAMAGECOUNT value on done: 13292.0 [2024-08-05 22:45:45,446][52647] Sum rewards: 15.504, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.505', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.046', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'weapon4': '0.170', 'WEAPON3': '0.800', 'weapon2': '1.050', 'HITCOUNT': '1.150', 'weapon3': '2.014', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:45,721][52669] DAMAGECOUNT value on done: 13600.0 [2024-08-05 22:45:45,723][52669] Sum rewards: 15.918, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.232', 'ARMOR': '0.455', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.434', 'weapon3': '1.580', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:46,202][52794] DAMAGECOUNT value on done: 14504.0 [2024-08-05 22:45:46,202][52794] Sum rewards: 16.129, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.025', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon5': '0.098', 'AMMO4': '0.126', 'HEALTH': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.462', 'WEAPON3': '0.500', 'weapon2': '0.948', 'HITCOUNT': '0.970', 'weapon3': '1.624', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '12.000'} [2024-08-05 22:45:46,618][52665] DAMAGECOUNT value on done: 12502.0 [2024-08-05 22:45:46,620][52665] Sum rewards: 14.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO2': '0.033', 'AMMO3': '0.145', 'weapon4': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.900', 'weapon2': '0.928', 'HITCOUNT': '1.230', 'weapon3': '2.362', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:46,744][52662] DAMAGECOUNT value on done: 16337.0 [2024-08-05 22:45:46,744][52662] Sum rewards: 17.328, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.424', 'AMMO2': '0.019', 'AMMO3': '0.091', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.282', 'WEAPON3': '0.600', 'ARMOR': '0.891', 'HITCOUNT': '1.020', 'weapon2': '1.316', 'weapon3': '1.616', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:47,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 81592320. Throughput: 0: 4192.9. Samples: 20398200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:45:47,794][52567] Avg episode reward: [(0, '11.827')] [2024-08-05 22:45:48,152][52650] Updated weights for policy 0, policy_version 9961 (0.0012) [2024-08-05 22:45:48,429][52647] DAMAGECOUNT value on done: 15098.0 [2024-08-05 22:45:48,430][52647] Sum rewards: 13.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.566', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.288', 'ARMOR': '0.870', 'weapon2': '1.010', 'WEAPON3': '1.150', 'HITCOUNT': '1.230', 'weapon3': '2.238', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '14.000'} [2024-08-05 22:45:48,785][52794] DAMAGECOUNT value on done: 14858.0 [2024-08-05 22:45:48,792][52794] Sum rewards: 14.126, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.178', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.272', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'weapon2': '1.208', 'HITCOUNT': '1.240', 'weapon3': '2.132', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '13.000'} [2024-08-05 22:45:48,894][52669] DAMAGECOUNT value on done: 13948.0 [2024-08-05 22:45:48,894][52669] Sum rewards: 9.406, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.864', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.009', 'weapon5': '0.052', 'weapon7': '0.064', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'ARMOR': '1.278', 'weapon2': '1.478', 'weapon3': '1.810', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '6.500'} [2024-08-05 22:45:49,066][52662] DAMAGECOUNT value on done: 14050.0 [2024-08-05 22:45:49,066][52662] Sum rewards: 9.076, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.268', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.542', 'WEAPON3': '0.700', 'ARMOR': '0.836', 'HITCOUNT': '0.950', 'weapon2': '1.166', 'weapon3': '1.694', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '7.500'} [2024-08-05 22:45:49,925][52665] DAMAGECOUNT value on done: 13852.0 [2024-08-05 22:45:49,925][52665] Sum rewards: 16.529, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.161', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.208', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'ARMOR': '1.407', 'weapon2': '1.540', 'weapon3': '1.558', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '12.000'} [2024-08-05 22:45:51,093][52794] DAMAGECOUNT value on done: 15146.0 [2024-08-05 22:45:51,096][52794] Sum rewards: 16.091, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.766', 'weapon4': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON3': '0.700', 'ARMOR': '0.881', 'HITCOUNT': '1.270', 'weapon2': '1.732', 'weapon3': '1.906', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '14.000'} [2024-08-05 22:45:51,346][52662] DAMAGECOUNT value on done: 15356.0 [2024-08-05 22:45:51,346][52662] Sum rewards: 15.174, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.296', 'ARMOR': '0.483', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'weapon2': '1.320', 'weapon3': '1.772', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '12.000'} [2024-08-05 22:45:51,423][52669] DAMAGECOUNT value on done: 12909.0 [2024-08-05 22:45:51,425][52669] Sum rewards: 10.385, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.555', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.026', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.278', 'ARMOR': '0.444', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon3': '1.544', 'weapon2': '1.644', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:52,022][52647] DAMAGECOUNT value on done: 13131.0 [2024-08-05 22:45:52,023][52647] Sum rewards: 12.377, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.360', 'AMMO2': '0.021', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO4': '0.104', 'WEAPON3': '0.550', 'HITCOUNT': '1.080', 'weapon3': '1.500', 'weapon2': '1.738', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:52,628][52665] DAMAGECOUNT value on done: 12926.0 [2024-08-05 22:45:52,628][52665] Sum rewards: 5.775, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.882', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.434', 'ARMOR': '0.496', 'WEAPON3': '0.900', 'weapon2': '1.002', 'HITCOUNT': '1.050', 'weapon3': '1.946', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '5.000'} [2024-08-05 22:45:52,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 81674240. Throughput: 0: 4190.7. Samples: 20423380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:45:52,795][52567] Avg episode reward: [(0, '11.888')] [2024-08-05 22:45:52,909][52650] Updated weights for policy 0, policy_version 9971 (0.0015) [2024-08-05 22:45:53,732][52794] DAMAGECOUNT value on done: 14723.0 [2024-08-05 22:45:53,733][52794] Sum rewards: 20.303, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.008', 'HEALTH': '0.013', 'weapon5': '0.032', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.256', 'WEAPON3': '0.550', 'ARMOR': '0.836', 'HITCOUNT': '1.120', 'weapon2': '1.388', 'weapon3': '1.710', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '16.000'} [2024-08-05 22:45:53,999][52662] DAMAGECOUNT value on done: 15912.0 [2024-08-05 22:45:54,009][52662] Sum rewards: 16.029, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.644', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.162', 'ARMOR': '0.482', 'WEAPON3': '1.100', 'weapon2': '1.100', 'HITCOUNT': '1.610', 'weapon3': '2.468', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '15.000'} [2024-08-05 22:45:54,801][52669] DAMAGECOUNT value on done: 12870.0 [2024-08-05 22:45:54,802][52669] Sum rewards: 6.409, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon5': '0.120', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.386', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'ARMOR': '1.312', 'weapon2': '1.416', 'weapon3': '1.504', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '6.000'} [2024-08-05 22:45:54,979][52647] DAMAGECOUNT value on done: 13732.0 [2024-08-05 22:45:54,980][52647] Sum rewards: 16.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.282', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'ARMOR': '0.437', 'WEAPON3': '0.900', 'HITCOUNT': '1.200', 'weapon2': '1.436', 'weapon3': '1.926', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '16.000'} [2024-08-05 22:45:55,817][52665] DAMAGECOUNT value on done: 12428.0 [2024-08-05 22:45:55,820][52665] Sum rewards: 10.230, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.594', 'HITCOUNT': '0.600', 'ARMOR': '1.001', 'weapon2': '1.080', 'weapon3': '1.080', 'DAMAGECOUNT': '2.100', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:56,408][52794] DAMAGECOUNT value on done: 16314.0 [2024-08-05 22:45:56,408][52794] Sum rewards: 12.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.042', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.095', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'ARMOR': '0.854', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon2': '1.396', 'weapon3': '1.806', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '11.500'} [2024-08-05 22:45:56,651][52662] DAMAGECOUNT value on done: 14053.0 [2024-08-05 22:45:56,651][52662] Sum rewards: 9.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.112', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.808', 'HITCOUNT': '0.810', 'ARMOR': '0.913', 'weapon2': '0.944', 'weapon3': '1.890', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:57,509][52650] Updated weights for policy 0, policy_version 9981 (0.0023) [2024-08-05 22:45:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 81764352. Throughput: 0: 4197.8. Samples: 20448830. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:45:57,794][52567] Avg episode reward: [(0, '12.035')] [2024-08-05 22:45:58,034][52669] DAMAGECOUNT value on done: 12507.0 [2024-08-05 22:45:58,035][52669] Sum rewards: 10.853, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.020', 'AMMO3': '0.053', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'HEALTH': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.616', 'HITCOUNT': '0.640', 'weapon2': '0.812', 'ARMOR': '0.835', 'weapon3': '1.104', 'DAMAGECOUNT': '1.974', 'FRAGCOUNT': '7.000'} [2024-08-05 22:45:58,043][52647] DAMAGECOUNT value on done: 12276.0 [2024-08-05 22:45:58,050][52647] Sum rewards: 5.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.018', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.116', 'weapon4': '0.156', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'ARMOR': '1.267', 'weapon2': '1.328', 'weapon3': '1.534', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '4.000'} [2024-08-05 22:45:58,797][52665] DAMAGECOUNT value on done: 12915.0 [2024-08-05 22:45:58,798][52665] Sum rewards: 14.742, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.012', 'AMMO2': '0.003', 'AMMO5': '0.013', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.076', 'weapon5': '0.094', 'AMMO3': '0.106', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.867', 'HITCOUNT': '0.930', 'weapon2': '1.670', 'weapon3': '1.804', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '12.000'} [2024-08-05 22:45:58,980][52803] DAMAGECOUNT value on done: 11775.0 [2024-08-05 22:45:58,981][52803] Sum rewards: 7.146, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.292', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon7': '0.068', 'AMMO4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'HITCOUNT': '0.680', 'weapon2': '0.688', 'WEAPON3': '0.900', 'weapon3': '2.152', 'DAMAGECOUNT': '2.337', 'FRAGCOUNT': '8.000'} [2024-08-05 22:45:59,224][52794] DAMAGECOUNT value on done: 14723.0 [2024-08-05 22:45:59,232][52794] Sum rewards: 8.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.010', 'ARMOR': '0.040', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.292', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.388', 'weapon3': '1.872', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '9.000'} [2024-08-05 22:45:59,429][52662] DAMAGECOUNT value on done: 14763.0 [2024-08-05 22:45:59,429][52662] Sum rewards: 8.977, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.368', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.082', 'WEAPON5': '0.150', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon3': '1.412', 'weapon2': '1.496', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:01,202][52669] DAMAGECOUNT value on done: 12967.0 [2024-08-05 22:46:01,204][52669] Sum rewards: 5.356, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.730', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'ARMOR': '0.036', 'weapon5': '0.044', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon2': '1.368', 'weapon3': '1.672', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '4.500'} [2024-08-05 22:46:01,289][52647] DAMAGECOUNT value on done: 12845.0 [2024-08-05 22:46:01,289][52647] Sum rewards: 9.520, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.168', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'ARMOR': '0.466', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.034', 'weapon3': '1.892', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:01,704][52665] DAMAGECOUNT value on done: 13747.0 [2024-08-05 22:46:01,706][52665] Sum rewards: 12.287, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.980', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon5': '0.032', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon2': '1.358', 'weapon3': '1.516', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:02,221][52794] DAMAGECOUNT value on done: 15733.0 [2024-08-05 22:46:02,223][52794] Sum rewards: 13.490, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.848', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.550', 'weapon2': '0.784', 'WEAPON3': '0.850', 'ARMOR': '0.939', 'HITCOUNT': '0.990', 'weapon3': '1.716', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:02,311][52803] DAMAGECOUNT value on done: 14684.0 [2024-08-05 22:46:02,314][52803] Sum rewards: 6.241, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.600', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.434', 'HITCOUNT': '0.710', 'WEAPON3': '0.800', 'weapon2': '0.810', 'ARMOR': '0.873', 'weapon3': '1.706', 'DAMAGECOUNT': '2.640', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:02,424][52662] DAMAGECOUNT value on done: 15079.0 [2024-08-05 22:46:02,424][52662] Sum rewards: 14.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.021', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.216', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '1.070', 'weapon2': '1.366', 'weapon3': '1.670', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:02,768][52663] DAMAGECOUNT value on done: 13857.0 [2024-08-05 22:46:02,769][52663] Sum rewards: 12.353, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.834', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon5': '0.038', 'AMMO3': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon3': '1.426', 'weapon2': '1.928', 'ARMOR': '2.160', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 81846272. Throughput: 0: 4205.1. Samples: 20461470. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:46:02,795][52567] Avg episode reward: [(0, '11.848')] [2024-08-05 22:46:02,806][52650] Updated weights for policy 0, policy_version 9991 (0.0027) [2024-08-05 22:46:03,947][52811] DAMAGECOUNT value on done: 13697.0 [2024-08-05 22:46:03,947][52811] Sum rewards: 19.626, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'HEALTH': '0.180', 'WEAPON3': '0.400', 'ARMOR': '0.428', 'weapon4': '0.620', 'weapon2': '1.296', 'HITCOUNT': '1.330', 'weapon3': '1.656', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '14.000'} [2024-08-05 22:46:04,195][52665] DAMAGECOUNT value on done: 12553.0 [2024-08-05 22:46:04,196][52665] Sum rewards: 12.197, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.800', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.104', 'WEAPON4': '0.350', 'weapon4': '0.644', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'ARMOR': '0.922', 'weapon2': '1.106', 'weapon3': '1.964', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:04,443][52669] DAMAGECOUNT value on done: 14582.0 [2024-08-05 22:46:04,444][52669] Sum rewards: 12.670, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.971', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon7': '0.056', 'AMMO3': '0.087', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'ARMOR': '1.010', 'HITCOUNT': '1.010', 'weapon2': '1.228', 'weapon3': '1.600', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:04,552][52647] DAMAGECOUNT value on done: 12196.0 [2024-08-05 22:46:04,552][52647] Sum rewards: 6.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.424', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.104', 'weapon4': '0.152', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'ARMOR': '1.002', 'weapon2': '1.560', 'weapon3': '1.844', 'DAMAGECOUNT': '2.454', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:04,680][52794] DAMAGECOUNT value on done: 16447.0 [2024-08-05 22:46:04,680][52794] Sum rewards: 21.519, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.918', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.306', 'WEAPON3': '0.900', 'HITCOUNT': '1.520', 'weapon2': '1.552', 'ARMOR': '1.794', 'weapon3': '1.806', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '17.000'} [2024-08-05 22:46:04,917][52662] DAMAGECOUNT value on done: 14437.0 [2024-08-05 22:46:04,917][52662] Sum rewards: 12.780, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.052', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO3': '0.105', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon3': '1.294', 'ARMOR': '1.327', 'weapon2': '1.994', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:05,560][52803] DAMAGECOUNT value on done: 12069.0 [2024-08-05 22:46:05,560][52803] Sum rewards: 8.403, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.810', 'ARMOR': '0.024', 'AMMO2': '0.029', 'AMMO3': '0.117', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '1.488', 'weapon3': '1.918', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:06,226][52663] DAMAGECOUNT value on done: 13133.0 [2024-08-05 22:46:06,227][52663] Sum rewards: 8.315, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.745', 'AMMO2': '0.023', 'AMMO3': '0.114', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.342', 'ARMOR': '0.480', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon2': '1.190', 'weapon3': '1.860', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:07,146][52650] Updated weights for policy 0, policy_version 10001 (0.0025) [2024-08-05 22:46:07,347][52811] DAMAGECOUNT value on done: 13015.0 [2024-08-05 22:46:07,350][52811] Sum rewards: 7.198, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.994', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.282', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.336', 'ARMOR': '1.382', 'weapon3': '1.600', 'DAMAGECOUNT': '2.781', 'FRAGCOUNT': '5.000'} [2024-08-05 22:46:07,451][52647] DAMAGECOUNT value on done: 15098.0 [2024-08-05 22:46:07,451][52647] Sum rewards: 15.743, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'HEALTH': '0.364', 'WEAPON3': '0.450', 'weapon4': '0.466', 'HITCOUNT': '0.770', 'ARMOR': '0.912', 'weapon2': '1.316', 'weapon3': '1.852', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:07,476][52665] DAMAGECOUNT value on done: 13085.0 [2024-08-05 22:46:07,477][52665] Sum rewards: 19.570, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.590', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'AMMO3': '0.102', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.909', 'HITCOUNT': '1.310', 'weapon2': '1.702', 'weapon3': '1.802', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '15.000'} [2024-08-05 22:46:07,541][52669] DAMAGECOUNT value on done: 12152.0 [2024-08-05 22:46:07,541][52669] Sum rewards: 14.376, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.964', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.252', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'ARMOR': '0.908', 'weapon2': '1.026', 'weapon3': '1.584', 'DAMAGECOUNT': '2.994', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:07,575][52794] DAMAGECOUNT value on done: 14839.0 [2024-08-05 22:46:07,576][52794] Sum rewards: 7.206, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.212', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'weapon4': '0.618', 'WEAPON3': '0.800', 'HITCOUNT': '0.870', 'weapon2': '0.978', 'weapon3': '1.942', 'DAMAGECOUNT': '2.838', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:07,740][52662] DAMAGECOUNT value on done: 16313.0 [2024-08-05 22:46:07,740][52662] Sum rewards: 14.094, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.604', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.336', 'ARMOR': '0.509', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon2': '1.374', 'weapon3': '1.948', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:07,795][52567] Fps is (10 sec: 16383.3, 60 sec: 16793.5, 300 sec: 16772.8). Total num frames: 81928192. Throughput: 0: 4195.7. Samples: 20486590. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:46:07,795][52567] Avg episode reward: [(0, '11.940')] [2024-08-05 22:46:09,045][52803] DAMAGECOUNT value on done: 12552.0 [2024-08-05 22:46:09,045][52803] Sum rewards: 7.938, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.023', 'AMMO3': '0.082', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'HEALTH': '0.354', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '0.560', 'weapon2': '0.686', 'weapon4': '0.696', 'weapon3': '1.366', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:09,160][52663] DAMAGECOUNT value on done: 12793.0 [2024-08-05 22:46:09,161][52663] Sum rewards: 10.748, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.494', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'ARMOR': '0.473', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'weapon3': '1.276', 'weapon2': '1.378', 'DAMAGECOUNT': '2.610', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:10,047][52665] DAMAGECOUNT value on done: 12727.0 [2024-08-05 22:46:10,055][52665] Sum rewards: 13.202, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.698', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.468', 'WEAPON3': '0.550', 'ARMOR': '0.858', 'HITCOUNT': '1.010', 'weapon2': '1.076', 'weapon3': '1.524', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:10,256][52794] DAMAGECOUNT value on done: 14632.0 [2024-08-05 22:46:10,256][52794] Sum rewards: 7.392, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.484', 'AMMO2': '0.011', 'weapon7': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.502', 'HITCOUNT': '0.530', 'WEAPON3': '0.550', 'weapon3': '1.012', 'weapon2': '1.086', 'ARMOR': '1.348', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '5.000'} [2024-08-05 22:46:10,468][52662] DAMAGECOUNT value on done: 14881.0 [2024-08-05 22:46:10,469][52662] Sum rewards: 8.910, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.632', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'ARMOR': '0.404', 'WEAPON3': '1.000', 'HITCOUNT': '1.180', 'weapon2': '1.518', 'weapon3': '2.202', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:10,502][52669] DAMAGECOUNT value on done: 15334.0 [2024-08-05 22:46:10,503][52669] Sum rewards: 11.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.470', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'WEAPON4': '0.050', 'weapon4': '0.118', 'AMMO3': '0.143', 'ARMOR': '0.854', 'WEAPON3': '1.000', 'HITCOUNT': '1.300', 'weapon2': '1.590', 'weapon3': '1.852', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:10,649][52811] DAMAGECOUNT value on done: 12948.0 [2024-08-05 22:46:10,649][52811] Sum rewards: 14.144, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'HITCOUNT': '1.090', 'weapon2': '1.374', 'weapon3': '1.934', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:10,722][52647] DAMAGECOUNT value on done: 11678.0 [2024-08-05 22:46:10,723][52647] Sum rewards: 4.188, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.359', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.067', 'weapon7': '0.086', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.248', 'HITCOUNT': '0.290', 'WEAPON3': '0.400', 'DAMAGECOUNT': '0.984', 'weapon3': '1.116', 'weapon2': '1.244', 'ARMOR': '1.283', 'FRAGCOUNT': '4.000'} [2024-08-05 22:46:12,139][52663] DAMAGECOUNT value on done: 15635.0 [2024-08-05 22:46:12,141][52663] Sum rewards: 18.513, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.585', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'HITCOUNT': '1.350', 'weapon3': '1.596', 'weapon2': '1.888', 'DAMAGECOUNT': '4.899', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:12,251][52650] Updated weights for policy 0, policy_version 10011 (0.0021) [2024-08-05 22:46:12,349][52803] DAMAGECOUNT value on done: 14025.0 [2024-08-05 22:46:12,352][52803] Sum rewards: 14.248, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.796', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.121', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'ARMOR': '1.316', 'weapon3': '1.674', 'weapon2': '1.696', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:12,525][52665] DAMAGECOUNT value on done: 14606.0 [2024-08-05 22:46:12,525][52665] Sum rewards: 10.099, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.924', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.238', 'ARMOR': '0.920', 'HITCOUNT': '1.060', 'WEAPON3': '1.100', 'weapon2': '1.378', 'weapon3': '1.764', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:12,723][52794] DAMAGECOUNT value on done: 14969.0 [2024-08-05 22:46:12,723][52794] Sum rewards: 7.318, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.240', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.022', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.352', 'ARMOR': '0.526', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'weapon2': '1.326', 'weapon3': '1.932', 'DAMAGECOUNT': '2.562', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:12,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 82010112. Throughput: 0: 4213.3. Samples: 20511830. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:46:12,794][52567] Avg episode reward: [(0, '11.595')] [2024-08-05 22:46:12,984][52662] DAMAGECOUNT value on done: 16072.0 [2024-08-05 22:46:12,985][52662] Sum rewards: 12.106, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.507', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO4': '0.086', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'ARMOR': '0.909', 'WEAPON3': '1.150', 'weapon2': '1.236', 'HITCOUNT': '1.250', 'weapon3': '2.440', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:13,319][52669] DAMAGECOUNT value on done: 13816.0 [2024-08-05 22:46:13,319][52669] Sum rewards: 14.781, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.479', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.024', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.250', 'weapon4': '0.380', 'ARMOR': '0.440', 'weapon2': '0.672', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon3': '1.894', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:13,890][52647] DAMAGECOUNT value on done: 14376.0 [2024-08-05 22:46:13,890][52647] Sum rewards: 11.628, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.513', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO3': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.484', 'weapon4': '0.510', 'HITCOUNT': '0.720', 'weapon2': '0.842', 'weapon3': '1.098', 'DAMAGECOUNT': '2.691', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:14,018][52811] DAMAGECOUNT value on done: 13490.0 [2024-08-05 22:46:14,018][52811] Sum rewards: 10.065, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.032', 'weapon7': '0.074', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'HEALTH': '0.255', 'HITCOUNT': '0.450', 'WEAPON3': '0.500', 'weapon2': '0.750', 'weapon4': '0.908', 'ARMOR': '0.924', 'weapon3': '1.428', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:14,439][52667] DAMAGECOUNT value on done: 13780.0 [2024-08-05 22:46:14,440][52667] Sum rewards: 11.465, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.332', 'AMMO5': '0.008', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.090', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.210', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon2': '1.378', 'weapon3': '1.562', 'DAMAGECOUNT': '2.799', 'FRAGCOUNT': '9.500'} [2024-08-05 22:46:14,945][52663] DAMAGECOUNT value on done: 12116.0 [2024-08-05 22:46:14,946][52663] Sum rewards: 12.195, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.220', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.477', 'HITCOUNT': '0.560', 'weapon2': '1.110', 'weapon3': '1.188', 'DAMAGECOUNT': '2.589', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:15,478][52662] DAMAGECOUNT value on done: 15252.0 [2024-08-05 22:46:15,478][52662] Sum rewards: 10.368, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.698', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO3': '0.060', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'HITCOUNT': '0.680', 'weapon2': '0.856', 'weapon4': '1.054', 'weapon3': '1.266', 'ARMOR': '1.344', 'DAMAGECOUNT': '2.616', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:15,601][52665] DAMAGECOUNT value on done: 13335.0 [2024-08-05 22:46:15,602][52665] Sum rewards: 17.795, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'weapon4': '0.094', 'AMMO4': '0.097', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HEALTH': '0.820', 'HITCOUNT': '1.520', 'weapon3': '1.622', 'weapon2': '1.800', 'DAMAGECOUNT': '5.448', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:15,701][52803] DAMAGECOUNT value on done: 12518.0 [2024-08-05 22:46:15,702][52803] Sum rewards: 16.687, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.151', 'AMMO2': '0.016', 'AMMO3': '0.069', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.490', 'ARMOR': '0.898', 'HITCOUNT': '1.220', 'weapon3': '1.250', 'weapon2': '1.468', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:16,381][52669] DAMAGECOUNT value on done: 13711.0 [2024-08-05 22:46:16,381][52669] Sum rewards: 8.430, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.266', 'HEALTH': '0.292', 'ARMOR': '0.420', 'weapon5': '0.438', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon2': '0.732', 'weapon3': '1.334', 'DAMAGECOUNT': '2.175', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:16,650][52647] DAMAGECOUNT value on done: 13712.0 [2024-08-05 22:46:16,652][52647] Sum rewards: 13.942, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'ARMOR': '0.478', 'weapon4': '0.516', 'WEAPON3': '0.800', 'weapon2': '1.120', 'HITCOUNT': '1.240', 'weapon3': '1.802', 'DAMAGECOUNT': '4.299', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:17,089][52650] Updated weights for policy 0, policy_version 10021 (0.0018) [2024-08-05 22:46:17,118][52667] DAMAGECOUNT value on done: 13520.0 [2024-08-05 22:46:17,118][52667] Sum rewards: 9.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'AMMO4': '0.186', 'weapon4': '0.212', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'HITCOUNT': '0.880', 'WEAPON3': '0.950', 'weapon2': '1.002', 'weapon3': '2.422', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:17,234][52811] DAMAGECOUNT value on done: 13507.0 [2024-08-05 22:46:17,234][52811] Sum rewards: 8.970, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.752', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'AMMO3': '0.060', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'ARMOR': '0.932', 'weapon2': '1.234', 'weapon3': '1.326', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:17,794][52567] Fps is (10 sec: 16384.5, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 82092032. Throughput: 0: 4215.1. Samples: 20524580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:46:17,795][52567] Avg episode reward: [(0, '11.714')] [2024-08-05 22:46:18,054][52663] DAMAGECOUNT value on done: 13508.0 [2024-08-05 22:46:18,054][52663] Sum rewards: 20.170, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.090', 'WEAPON3': '0.650', 'ARMOR': '0.897', 'HITCOUNT': '1.300', 'weapon3': '1.542', 'weapon2': '2.090', 'DAMAGECOUNT': '4.047', 'FRAGCOUNT': '16.000'} [2024-08-05 22:46:18,114][52662] DAMAGECOUNT value on done: 15278.0 [2024-08-05 22:46:18,115][52662] Sum rewards: 12.476, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.984', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon4': '0.232', 'ARMOR': '0.447', 'WEAPON3': '0.950', 'HITCOUNT': '1.100', 'weapon2': '1.188', 'weapon3': '2.126', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:18,814][52665] DAMAGECOUNT value on done: 13045.0 [2024-08-05 22:46:18,816][52665] Sum rewards: 8.965, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.194', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.020', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.716', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'weapon2': '0.962', 'weapon3': '1.796', 'DAMAGECOUNT': '2.856', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:19,148][52669] DAMAGECOUNT value on done: 13635.0 [2024-08-05 22:46:19,149][52669] Sum rewards: 14.721, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.038', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.118', 'ARMOR': '0.489', 'WEAPON3': '0.750', 'HITCOUNT': '1.110', 'weapon2': '1.146', 'weapon3': '1.694', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:19,211][52803] DAMAGECOUNT value on done: 14944.0 [2024-08-05 22:46:19,213][52803] Sum rewards: 13.021, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.018', 'weapon7': '0.046', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon3': '1.514', 'weapon2': '1.796', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:19,433][52647] DAMAGECOUNT value on done: 14092.0 [2024-08-05 22:46:19,435][52647] Sum rewards: 15.630, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon4': '0.414', 'WEAPON3': '0.750', 'ARMOR': '0.968', 'HITCOUNT': '1.290', 'weapon2': '1.302', 'weapon3': '1.890', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:20,055][52667] DAMAGECOUNT value on done: 13141.0 [2024-08-05 22:46:20,057][52667] Sum rewards: 10.473, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.006', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.097', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'ARMOR': '0.949', 'weapon2': '1.380', 'weapon3': '1.516', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:20,527][52811] DAMAGECOUNT value on done: 12149.0 [2024-08-05 22:46:20,528][52811] Sum rewards: 13.810, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.144', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.336', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'HITCOUNT': '0.910', 'HEALTH': '0.955', 'weapon2': '1.044', 'weapon3': '1.502', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:21,070][52663] DAMAGECOUNT value on done: 15745.0 [2024-08-05 22:46:21,074][52663] Sum rewards: 5.985, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.948', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.015', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon5': '0.262', 'ARMOR': '0.503', 'HITCOUNT': '0.640', 'weapon2': '1.016', 'WEAPON3': '1.050', 'weapon3': '1.978', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:21,428][52665] DAMAGECOUNT value on done: 13760.0 [2024-08-05 22:46:21,428][52665] Sum rewards: 7.712, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.809', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.224', 'WEAPON3': '0.450', 'weapon2': '0.474', 'HITCOUNT': '0.690', 'ARMOR': '0.964', 'weapon3': '1.066', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '5.000'} [2024-08-05 22:46:22,182][52650] Updated weights for policy 0, policy_version 10031 (0.0033) [2024-08-05 22:46:22,483][52669] DAMAGECOUNT value on done: 13817.0 [2024-08-05 22:46:22,484][52669] Sum rewards: 12.581, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.028', 'weapon5': '0.046', 'AMMO4': '0.096', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.272', 'weapon3': '1.906', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:22,501][52803] DAMAGECOUNT value on done: 10722.0 [2024-08-05 22:46:22,503][52803] Sum rewards: 4.561, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.102', 'HEALTH': '0.145', 'AMMO4': '0.165', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon4': '0.664', 'weapon2': '0.856', 'ARMOR': '0.884', 'weapon3': '1.692', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.217'} [2024-08-05 22:46:22,706][52647] DAMAGECOUNT value on done: 13424.0 [2024-08-05 22:46:22,706][52647] Sum rewards: 17.643, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.542', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.274', 'ARMOR': '0.484', 'WEAPON3': '0.600', 'HITCOUNT': '1.360', 'weapon3': '1.528', 'weapon2': '1.586', 'DAMAGECOUNT': '5.226', 'FRAGCOUNT': '13.500'} [2024-08-05 22:46:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 82190336. Throughput: 0: 4200.9. Samples: 20549590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:46:22,794][52567] Avg episode reward: [(0, '11.931')] [2024-08-05 22:46:22,893][52667] DAMAGECOUNT value on done: 13966.0 [2024-08-05 22:46:22,893][52667] Sum rewards: 4.098, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.095', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '0.470', 'HEALTH': '0.614', 'weapon2': '1.272', 'DAMAGECOUNT': '1.494', 'weapon3': '1.498', 'FRAGCOUNT': '3.000'} [2024-08-05 22:46:23,932][52811] DAMAGECOUNT value on done: 13053.0 [2024-08-05 22:46:23,932][52811] Sum rewards: 16.170, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.036', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'HEALTH': '0.154', 'AMMO4': '0.178', 'weapon4': '0.402', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'ARMOR': '0.992', 'weapon3': '1.364', 'weapon2': '1.526', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:23,977][52663] DAMAGECOUNT value on done: 12319.0 [2024-08-05 22:46:23,977][52663] Sum rewards: 16.251, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.010', 'ARMOR': '0.021', 'AMMO2': '0.021', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON3': '0.400', 'HEALTH': '0.554', 'weapon5': '0.566', 'HITCOUNT': '1.070', 'weapon2': '1.430', 'weapon3': '1.458', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '10.500'} [2024-08-05 22:46:23,997][52665] DAMAGECOUNT value on done: 13759.0 [2024-08-05 22:46:23,998][52665] Sum rewards: 7.136, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.764', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'ARMOR': '0.058', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.324', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '0.962', 'weapon3': '1.492', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '5.000'} [2024-08-05 22:46:25,560][52667] DAMAGECOUNT value on done: 14497.0 [2024-08-05 22:46:25,567][52669] DAMAGECOUNT value on done: 13513.0 [2024-08-05 22:46:25,569][52669] Sum rewards: 18.894, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.790', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'ARMOR': '0.452', 'WEAPON3': '0.900', 'HITCOUNT': '1.370', 'weapon2': '1.550', 'weapon3': '2.174', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '16.000'} [2024-08-05 22:46:25,568][52667] Sum rewards: 12.637, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.523', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.078', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'ARMOR': '1.275', 'weapon3': '1.370', 'weapon2': '1.650', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:25,932][52803] DAMAGECOUNT value on done: 13171.0 [2024-08-05 22:46:25,934][52803] Sum rewards: 23.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.366', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.016', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO3': '0.161', 'ARMOR': '0.899', 'WEAPON3': '1.000', 'weapon2': '1.134', 'HITCOUNT': '1.790', 'weapon3': '2.542', 'DAMAGECOUNT': '6.657', 'FRAGCOUNT': '20.000'} [2024-08-05 22:46:26,753][52665] DAMAGECOUNT value on done: 13593.0 [2024-08-05 22:46:26,755][52665] Sum rewards: 12.612, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.618', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.087', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON4': '0.250', 'ARMOR': '0.429', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon3': '1.438', 'weapon2': '1.510', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:27,003][52650] Updated weights for policy 0, policy_version 10041 (0.0026) [2024-08-05 22:46:27,179][52811] DAMAGECOUNT value on done: 9883.0 [2024-08-05 22:46:27,179][52811] Sum rewards: 7.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.588', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.192', 'weapon4': '0.246', 'WEAPON4': '0.300', 'ARMOR': '0.465', 'HITCOUNT': '1.040', 'weapon2': '1.108', 'WEAPON3': '1.400', 'weapon3': '2.360', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:27,362][52663] DAMAGECOUNT value on done: 13106.0 [2024-08-05 22:46:27,362][52663] Sum rewards: 5.590, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.447', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.072', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.222', 'WEAPON5': '0.300', 'ARMOR': '0.482', 'HITCOUNT': '0.790', 'weapon2': '0.940', 'WEAPON3': '0.950', 'weapon3': '2.148', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 82264064. Throughput: 0: 4207.1. Samples: 20574950. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:46:27,794][52567] Avg episode reward: [(0, '11.974')] [2024-08-05 22:46:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010042_82264064.pth... [2024-08-05 22:46:27,932][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009550_78233600.pth [2024-08-05 22:46:28,160][52667] DAMAGECOUNT value on done: 15078.0 [2024-08-05 22:46:28,162][52667] Sum rewards: 6.065, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.570', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO3': '0.096', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.446', 'weapon3': '1.770', 'DAMAGECOUNT': '3.084', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:28,713][52795] DAMAGECOUNT value on done: 10788.0 [2024-08-05 22:46:28,713][52795] Sum rewards: 7.359, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.836', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.110', 'WEAPON4': '0.300', 'weapon4': '0.506', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'weapon2': '1.152', 'ARMOR': '1.356', 'weapon3': '1.532', 'DAMAGECOUNT': '2.982', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:28,780][52669] DAMAGECOUNT value on done: 13802.0 [2024-08-05 22:46:28,783][52669] Sum rewards: 20.979, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.076', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.115', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.214', 'ARMOR': '0.494', 'WEAPON3': '0.750', 'weapon2': '1.318', 'HITCOUNT': '1.320', 'weapon3': '2.080', 'DAMAGECOUNT': '4.851', 'FRAGCOUNT': '17.000'} [2024-08-05 22:46:29,338][52803] DAMAGECOUNT value on done: 11194.0 [2024-08-05 22:46:29,341][52803] Sum rewards: 11.281, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.587', 'AMMO5': '0.015', 'AMMO2': '0.026', 'ARMOR': '0.044', 'AMMO4': '0.130', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.278', 'weapon4': '0.322', 'weapon2': '0.888', 'HITCOUNT': '0.980', 'WEAPON3': '1.050', 'weapon3': '1.886', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:29,565][52665] DAMAGECOUNT value on done: 13099.0 [2024-08-05 22:46:29,567][52665] Sum rewards: 12.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.612', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.198', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'HITCOUNT': '1.280', 'weapon2': '1.522', 'weapon3': '2.044', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:30,634][52663] DAMAGECOUNT value on done: 14954.0 [2024-08-05 22:46:30,638][52663] Sum rewards: 14.292, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.088', 'AMMO3': '0.134', 'WEAPON3': '0.850', 'ARMOR': '0.852', 'HITCOUNT': '1.210', 'weapon2': '1.330', 'weapon3': '1.812', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:30,711][52811] DAMAGECOUNT value on done: 12314.0 [2024-08-05 22:46:30,713][52811] Sum rewards: 12.883, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.875', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.236', 'ARMOR': '0.470', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'weapon2': '1.042', 'weapon3': '1.680', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:30,854][52667] DAMAGECOUNT value on done: 13893.0 [2024-08-05 22:46:30,854][52667] Sum rewards: 11.143, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.050', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.032', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'ARMOR': '1.344', 'weapon2': '1.682', 'weapon3': '1.752', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:31,717][52650] Updated weights for policy 0, policy_version 10051 (0.0034) [2024-08-05 22:46:32,050][52795] DAMAGECOUNT value on done: 11964.0 [2024-08-05 22:46:32,051][52795] Sum rewards: 19.215, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.982', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.123', 'weapon4': '0.146', 'WEAPON7': '0.200', 'ARMOR': '0.472', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon2': '1.600', 'weapon3': '1.728', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '16.000'} [2024-08-05 22:46:32,588][52803] DAMAGECOUNT value on done: 12519.0 [2024-08-05 22:46:32,588][52803] Sum rewards: 14.826, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.598', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.238', 'WEAPON3': '0.750', 'ARMOR': '0.828', 'HITCOUNT': '1.010', 'weapon3': '1.530', 'weapon2': '1.760', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 16800.6). Total num frames: 82354176. Throughput: 0: 4200.2. Samples: 20587210. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 22:46:32,794][52567] Avg episode reward: [(0, '11.943')] [2024-08-05 22:46:32,851][52665] DAMAGECOUNT value on done: 13967.0 [2024-08-05 22:46:32,851][52665] Sum rewards: 13.188, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon5': '0.194', 'ARMOR': '0.455', 'WEAPON3': '0.950', 'HITCOUNT': '1.080', 'weapon2': '1.236', 'weapon3': '2.262', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:33,933][52663] DAMAGECOUNT value on done: 13087.0 [2024-08-05 22:46:33,935][52663] Sum rewards: 13.211, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'HITCOUNT': '1.190', 'weapon2': '1.330', 'weapon3': '2.150', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:34,137][52667] DAMAGECOUNT value on done: 13015.0 [2024-08-05 22:46:34,138][52667] Sum rewards: 13.964, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.548', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon7': '0.050', 'weapon5': '0.056', 'AMMO3': '0.060', 'AMMO4': '0.063', 'ARMOR': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.808', 'HITCOUNT': '0.930', 'weapon2': '1.028', 'weapon3': '1.428', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:34,210][52811] DAMAGECOUNT value on done: 13236.0 [2024-08-05 22:46:34,214][52811] Sum rewards: 12.303, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.674', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'weapon7': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.188', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.170', 'weapon2': '1.556', 'weapon3': '1.644', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:34,650][52658] DAMAGECOUNT value on done: 13319.0 [2024-08-05 22:46:34,650][52658] Sum rewards: 14.520, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.414', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.090', 'AMMO4': '0.134', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon2': '0.902', 'weapon4': '1.022', 'HITCOUNT': '1.130', 'weapon3': '1.542', 'DAMAGECOUNT': '3.963', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:35,072][52649] DAMAGECOUNT value on done: 13713.0 [2024-08-05 22:46:35,075][52649] Sum rewards: 8.499, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.012', 'ARMOR': '0.032', 'AMMO4': '0.049', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.534', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '0.914', 'weapon3': '1.428', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:35,251][52795] DAMAGECOUNT value on done: 11875.0 [2024-08-05 22:46:35,253][52795] Sum rewards: 8.411, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.718', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon4': '0.056', 'AMMO3': '0.093', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'ARMOR': '0.930', 'weapon2': '1.054', 'weapon3': '1.838', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:35,304][52665] DAMAGECOUNT value on done: 11665.0 [2024-08-05 22:46:35,306][52665] Sum rewards: 6.617, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.403', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon7': '0.048', 'AMMO4': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.350', 'weapon2': '0.454', 'ARMOR': '0.512', 'HITCOUNT': '0.630', 'WEAPON3': '0.800', 'weapon4': '0.926', 'weapon3': '1.866', 'DAMAGECOUNT': '2.352', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:35,773][52664] DAMAGECOUNT value on done: 14939.0 [2024-08-05 22:46:35,773][52664] Sum rewards: 11.981, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.821', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.034', 'weapon7': '0.050', 'AMMO3': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.512', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon3': '1.416', 'weapon2': '1.538', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:35,998][52803] DAMAGECOUNT value on done: 13226.0 [2024-08-05 22:46:35,998][52803] Sum rewards: 18.187, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.033', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON3': '0.800', 'ARMOR': '0.864', 'weapon2': '1.478', 'HITCOUNT': '1.480', 'weapon3': '1.744', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '16.000'} [2024-08-05 22:46:36,484][52663] DAMAGECOUNT value on done: 12451.0 [2024-08-05 22:46:36,485][52663] Sum rewards: 11.195, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.021', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.206', 'WEAPON3': '0.650', 'ARMOR': '0.868', 'HITCOUNT': '0.970', 'weapon2': '1.158', 'weapon3': '1.836', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:36,737][52650] Updated weights for policy 0, policy_version 10061 (0.0011) [2024-08-05 22:46:37,008][52667] DAMAGECOUNT value on done: 13479.0 [2024-08-05 22:46:37,010][52667] Sum rewards: 16.481, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.406', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.550', 'WEAPON3': '0.600', 'ARMOR': '1.220', 'weapon2': '1.226', 'HITCOUNT': '1.290', 'weapon3': '1.864', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:37,715][52811] DAMAGECOUNT value on done: 14222.0 [2024-08-05 22:46:37,718][52811] Sum rewards: 16.239, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.898', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon4': '0.018', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'WEAPON3': '0.850', 'HITCOUNT': '1.160', 'weapon2': '1.312', 'weapon3': '1.860', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '15.000'} [2024-08-05 22:46:37,792][52658] DAMAGECOUNT value on done: 13595.0 [2024-08-05 22:46:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 82436096. Throughput: 0: 4204.2. Samples: 20612570. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:46:37,794][52567] Avg episode reward: [(0, '11.945')] [2024-08-05 22:46:37,794][52658] Sum rewards: 10.021, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.618', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.232', 'WEAPON3': '0.500', 'HITCOUNT': '0.960', 'weapon2': '1.248', 'weapon3': '1.388', 'DAMAGECOUNT': '2.913', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:37,919][52649] DAMAGECOUNT value on done: 12985.0 [2024-08-05 22:46:37,919][52649] Sum rewards: 17.165, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.696', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.127', 'weapon5': '0.128', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.899', 'HITCOUNT': '1.380', 'weapon2': '1.564', 'weapon3': '1.780', 'DAMAGECOUNT': '6.009', 'FRAGCOUNT': '13.500'} [2024-08-05 22:46:38,126][52665] DAMAGECOUNT value on done: 13016.0 [2024-08-05 22:46:38,126][52665] Sum rewards: 13.820, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.998', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.544', 'WEAPON3': '0.850', 'weapon2': '0.858', 'HITCOUNT': '0.930', 'ARMOR': '0.934', 'weapon3': '1.906', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:38,585][52795] DAMAGECOUNT value on done: 13394.0 [2024-08-05 22:46:38,587][52795] Sum rewards: 6.395, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.029', 'AMMO3': '0.070', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'weapon4': '0.620', 'HEALTH': '0.730', 'ARMOR': '0.840', 'weapon2': '1.062', 'weapon3': '1.438', 'DAMAGECOUNT': '1.878', 'FRAGCOUNT': '3.000'} [2024-08-05 22:46:38,752][52664] DAMAGECOUNT value on done: 12559.0 [2024-08-05 22:46:38,752][52664] Sum rewards: 7.385, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.264', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.065', 'WEAPON3': '0.400', 'HITCOUNT': '0.530', 'ARMOR': '0.832', 'weapon3': '0.836', 'weapon2': '1.168', 'DAMAGECOUNT': '1.791', 'FRAGCOUNT': '5.000'} [2024-08-05 22:46:39,399][52803] DAMAGECOUNT value on done: 11787.0 [2024-08-05 22:46:39,400][52803] Sum rewards: 11.645, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.342', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.072', 'weapon5': '0.112', 'AMMO3': '0.121', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.524', 'weapon2': '0.526', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon3': '2.244', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:39,529][52663] DAMAGECOUNT value on done: 13394.0 [2024-08-05 22:46:39,529][52663] Sum rewards: 13.392, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon5': '0.046', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.238', 'ARMOR': '0.514', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'weapon2': '1.396', 'weapon3': '1.444', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:40,056][52667] DAMAGECOUNT value on done: 14494.0 [2024-08-05 22:46:40,058][52667] Sum rewards: 12.815, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.005', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon5': '0.166', 'weapon4': '0.470', 'WEAPON3': '0.650', 'ARMOR': '0.905', 'HITCOUNT': '1.080', 'weapon2': '1.136', 'weapon3': '1.588', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:40,572][52649] DAMAGECOUNT value on done: 12381.0 [2024-08-05 22:46:40,573][52649] Sum rewards: 10.946, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.166', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'ARMOR': '0.905', 'weapon3': '1.510', 'weapon2': '1.794', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:40,948][52658] DAMAGECOUNT value on done: 11581.0 [2024-08-05 22:46:40,948][52658] Sum rewards: 7.409, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.248', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.384', 'ARMOR': '0.438', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '1.318', 'weapon3': '1.598', 'DAMAGECOUNT': '2.574', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:41,068][52811] DAMAGECOUNT value on done: 11447.0 [2024-08-05 22:46:41,069][52811] Sum rewards: 9.513, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.102', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon7': '0.052', 'AMMO3': '0.072', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'ARMOR': '0.474', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'weapon2': '0.946', 'weapon3': '1.180', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:41,866][52650] Updated weights for policy 0, policy_version 10071 (0.0025) [2024-08-05 22:46:41,877][52795] DAMAGECOUNT value on done: 14502.0 [2024-08-05 22:46:41,878][52795] Sum rewards: 22.406, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.030', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO4': '0.149', 'WEAPON3': '0.350', 'ARMOR': '0.494', 'HEALTH': '0.652', 'HITCOUNT': '1.350', 'weapon3': '1.560', 'weapon2': '1.890', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '16.000'} [2024-08-05 22:46:42,144][52664] DAMAGECOUNT value on done: 14066.0 [2024-08-05 22:46:42,154][52664] Sum rewards: 9.868, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'ARMOR': '0.032', 'weapon5': '0.064', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.900', 'HITCOUNT': '1.040', 'weapon2': '1.054', 'weapon3': '1.994', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:42,363][52663] DAMAGECOUNT value on done: 13352.0 [2024-08-05 22:46:42,363][52663] Sum rewards: 14.749, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.564', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO3': '0.062', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'ARMOR': '0.939', 'weapon3': '1.336', 'weapon2': '1.428', 'DAMAGECOUNT': '2.949', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:42,734][52667] DAMAGECOUNT value on done: 12721.0 [2024-08-05 22:46:42,735][52667] Sum rewards: 13.699, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.250', 'weapon4': '0.404', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'weapon2': '1.272', 'HITCOUNT': '1.290', 'weapon3': '2.068', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 82518016. Throughput: 0: 4196.9. Samples: 20637690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:46:42,794][52567] Avg episode reward: [(0, '12.248')] [2024-08-05 22:46:42,805][52803] DAMAGECOUNT value on done: 12125.0 [2024-08-05 22:46:42,805][52803] Sum rewards: 9.553, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.178', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.186', 'weapon4': '0.240', 'ARMOR': '0.526', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.432', 'weapon3': '1.642', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:43,523][52658] DAMAGECOUNT value on done: 12827.0 [2024-08-05 22:46:43,523][52658] Sum rewards: 9.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'weapon2': '1.152', 'ARMOR': '1.258', 'weapon3': '1.994', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:43,708][52649] DAMAGECOUNT value on done: 14680.0 [2024-08-05 22:46:43,717][52649] Sum rewards: 12.314, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.008', 'AMMO2': '0.005', 'AMMO5': '0.013', 'weapon5': '0.022', 'AMMO4': '0.026', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.139', 'WEAPON5': '0.250', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '1.328', 'weapon3': '1.954', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:44,282][52811] DAMAGECOUNT value on done: 12183.0 [2024-08-05 22:46:44,282][52811] Sum rewards: 11.754, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.092', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.062', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'weapon3': '1.222', 'weapon2': '1.388', 'DAMAGECOUNT': '2.241', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:45,072][52664] DAMAGECOUNT value on done: 12596.0 [2024-08-05 22:46:45,074][52664] Sum rewards: 8.562, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.861', 'AMMO2': '0.023', 'AMMO3': '0.096', 'AMMO4': '0.116', 'WEAPON4': '0.300', 'ARMOR': '0.522', 'weapon4': '0.610', 'WEAPON3': '0.700', 'weapon2': '0.728', 'HITCOUNT': '0.780', 'weapon3': '1.902', 'DAMAGECOUNT': '2.646', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:45,122][52663] DAMAGECOUNT value on done: 13362.0 [2024-08-05 22:46:45,124][52663] Sum rewards: 6.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.626', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.030', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.422', 'HITCOUNT': '0.590', 'WEAPON3': '0.750', 'weapon2': '0.886', 'DAMAGECOUNT': '1.803', 'weapon3': '1.916', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:45,177][52795] DAMAGECOUNT value on done: 14909.0 [2024-08-05 22:46:45,179][52795] Sum rewards: 12.311, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.045', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.022', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO4': '0.064', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon4': '0.780', 'weapon2': '1.014', 'weapon3': '1.394', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:45,351][52667] DAMAGECOUNT value on done: 13975.0 [2024-08-05 22:46:45,354][52667] Sum rewards: 11.451, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.470', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.182', 'ARMOR': '0.451', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon3': '1.434', 'weapon2': '1.560', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:46,051][52803] DAMAGECOUNT value on done: 13114.0 [2024-08-05 22:46:46,051][52803] Sum rewards: 10.115, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'ARMOR': '0.510', 'WEAPON3': '0.650', 'HEALTH': '0.656', 'HITCOUNT': '0.730', 'weapon2': '0.744', 'weapon4': '0.776', 'weapon3': '1.986', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:46,228][52658] DAMAGECOUNT value on done: 13772.0 [2024-08-05 22:46:46,228][52658] Sum rewards: 15.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.654', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'ARMOR': '0.876', 'WEAPON3': '1.200', 'weapon2': '1.316', 'HITCOUNT': '1.420', 'weapon3': '2.296', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '14.000'} [2024-08-05 22:46:46,696][52650] Updated weights for policy 0, policy_version 10081 (0.0011) [2024-08-05 22:46:46,780][52649] DAMAGECOUNT value on done: 12662.0 [2024-08-05 22:46:46,781][52649] Sum rewards: 6.765, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.524', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.016', 'AMMO4': '0.028', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.382', 'WEAPON3': '0.450', 'HITCOUNT': '0.480', 'ARMOR': '0.544', 'weapon2': '0.716', 'weapon3': '1.448', 'DAMAGECOUNT': '1.554', 'FRAGCOUNT': '5.000'} [2024-08-05 22:46:47,665][52811] DAMAGECOUNT value on done: 12190.0 [2024-08-05 22:46:47,665][52811] Sum rewards: 21.065, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.696', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.155', 'ARMOR': '0.455', 'WEAPON3': '1.000', 'weapon2': '1.204', 'HITCOUNT': '1.870', 'weapon3': '2.534', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '18.000'} [2024-08-05 22:46:47,789][52664] DAMAGECOUNT value on done: 13005.0 [2024-08-05 22:46:47,790][52664] Sum rewards: 14.433, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.024', 'ARMOR': '0.034', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'HEALTH': '0.204', 'WEAPON3': '0.500', 'HITCOUNT': '0.750', 'weapon2': '1.360', 'weapon3': '1.660', 'DAMAGECOUNT': '2.814', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 82608128. Throughput: 0: 4196.5. Samples: 20650310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:46:47,794][52567] Avg episode reward: [(0, '12.009')] [2024-08-05 22:46:48,019][52667] DAMAGECOUNT value on done: 13440.0 [2024-08-05 22:46:48,019][52667] Sum rewards: 9.999, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO2': '0.018', 'ARMOR': '0.020', 'AMMO4': '0.090', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.414', 'weapon3': '1.948', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:48,215][52663] DAMAGECOUNT value on done: 13496.0 [2024-08-05 22:46:48,217][52663] Sum rewards: 8.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.318', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.260', 'WEAPON3': '0.850', 'HITCOUNT': '0.880', 'weapon2': '1.614', 'ARMOR': '1.736', 'weapon3': '1.992', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:48,368][52671] DAMAGECOUNT value on done: 15361.0 [2024-08-05 22:46:48,370][52671] Sum rewards: 9.142, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.653', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'ARMOR': '0.036', 'weapon4': '0.042', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'HITCOUNT': '0.890', 'weapon2': '1.650', 'weapon3': '1.650', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:48,455][52795] DAMAGECOUNT value on done: 13643.0 [2024-08-05 22:46:48,458][52795] Sum rewards: 17.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.591', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.124', 'WEAPON5': '0.200', 'weapon4': '0.318', 'ARMOR': '0.852', 'WEAPON3': '0.900', 'weapon2': '1.164', 'HITCOUNT': '1.340', 'weapon3': '2.044', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '14.000'} [2024-08-05 22:46:48,879][52658] DAMAGECOUNT value on done: 11260.0 [2024-08-05 22:46:48,888][52658] Sum rewards: 9.704, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.953', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'ARMOR': '0.897', 'weapon2': '1.126', 'weapon3': '1.912', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:49,409][52803] DAMAGECOUNT value on done: 11574.0 [2024-08-05 22:46:49,409][52803] Sum rewards: 12.918, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.965', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon4': '0.252', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'weapon2': '1.156', 'ARMOR': '1.272', 'weapon3': '1.954', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:49,968][52649] DAMAGECOUNT value on done: 13563.0 [2024-08-05 22:46:49,972][52649] Sum rewards: 14.972, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.895', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.206', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon2': '1.328', 'weapon3': '1.734', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:50,429][52664] DAMAGECOUNT value on done: 13731.0 [2024-08-05 22:46:50,430][52664] Sum rewards: 6.137, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.450', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'weapon2': '0.458', 'weapon4': '0.636', 'HITCOUNT': '0.940', 'WEAPON3': '0.950', 'weapon3': '2.498', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:50,929][52811] DAMAGECOUNT value on done: 12629.0 [2024-08-05 22:46:50,931][52811] Sum rewards: 8.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.361', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.250', 'weapon4': '0.410', 'ARMOR': '0.465', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon2': '1.106', 'weapon3': '2.058', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:51,176][52663] DAMAGECOUNT value on done: 14146.0 [2024-08-05 22:46:51,179][52663] Sum rewards: 8.791, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.913', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.080', 'weapon5': '0.106', 'weapon7': '0.112', 'AMMO6': '0.220', 'AMMO7': '0.220', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON7': '0.300', 'ARMOR': '0.494', 'WEAPON3': '0.550', 'HITCOUNT': '0.730', 'weapon2': '0.854', 'weapon3': '1.302', 'DAMAGECOUNT': '2.601', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:51,188][52650] Updated weights for policy 0, policy_version 10091 (0.0013) [2024-08-05 22:46:51,251][52667] DAMAGECOUNT value on done: 14833.0 [2024-08-05 22:46:51,251][52667] Sum rewards: 9.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.092', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'ARMOR': '0.475', 'weapon2': '1.074', 'WEAPON3': '1.150', 'HITCOUNT': '1.220', 'weapon3': '2.622', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:51,326][52671] DAMAGECOUNT value on done: 12654.0 [2024-08-05 22:46:51,326][52671] Sum rewards: 6.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.524', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.134', 'WEAPON4': '0.300', 'weapon4': '0.682', 'HITCOUNT': '0.820', 'WEAPON3': '0.850', 'ARMOR': '0.940', 'weapon2': '0.986', 'weapon3': '1.594', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:51,656][52795] DAMAGECOUNT value on done: 12949.0 [2024-08-05 22:46:51,656][52795] Sum rewards: 11.397, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.466', 'AMMO5': '0.003', 'weapon7': '0.008', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO3': '0.080', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.556', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'ARMOR': '0.824', 'weapon2': '0.880', 'weapon3': '1.864', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:52,169][52658] DAMAGECOUNT value on done: 15029.0 [2024-08-05 22:46:52,170][52658] Sum rewards: 21.559, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.722', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.111', 'WEAPON3': '0.750', 'ARMOR': '0.857', 'HITCOUNT': '1.370', 'weapon2': '1.438', 'weapon3': '1.972', 'DAMAGECOUNT': '5.298', 'FRAGCOUNT': '17.000'} [2024-08-05 22:46:52,296][52649] DAMAGECOUNT value on done: 11522.0 [2024-08-05 22:46:52,299][52649] Sum rewards: 5.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.016', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.036', 'weapon7': '0.052', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'HITCOUNT': '0.500', 'weapon4': '0.626', 'weapon2': '0.644', 'WEAPON3': '0.850', 'weapon3': '1.662', 'DAMAGECOUNT': '2.220', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:52,800][52567] Fps is (10 sec: 16374.6, 60 sec: 16792.0, 300 sec: 16744.7). Total num frames: 82681856. Throughput: 0: 4202.8. Samples: 20675740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:46:52,800][52567] Avg episode reward: [(0, '11.996')] [2024-08-05 22:46:52,836][52803] DAMAGECOUNT value on done: 11814.0 [2024-08-05 22:46:52,838][52803] Sum rewards: 14.362, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.675', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.204', 'ARMOR': '0.457', 'WEAPON3': '1.000', 'weapon2': '1.304', 'HITCOUNT': '1.540', 'weapon3': '2.332', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:53,733][52664] DAMAGECOUNT value on done: 14282.0 [2024-08-05 22:46:53,733][52664] Sum rewards: 10.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.070', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.220', 'weapon3': '1.360', 'weapon2': '1.710', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:54,057][52667] DAMAGECOUNT value on done: 14481.0 [2024-08-05 22:46:54,059][52667] Sum rewards: 12.896, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.455', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.152', 'WEAPON3': '0.750', 'HITCOUNT': '1.120', 'weapon2': '1.656', 'ARMOR': '1.862', 'weapon3': '2.044', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:54,118][52811] DAMAGECOUNT value on done: 11539.0 [2024-08-05 22:46:54,120][52811] Sum rewards: 14.456, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.382', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.015', 'weapon4': '0.024', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.959', 'HITCOUNT': '1.030', 'weapon2': '1.568', 'weapon3': '1.666', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:54,306][52663] DAMAGECOUNT value on done: 12085.0 [2024-08-05 22:46:54,306][52663] Sum rewards: 13.439, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.007', 'HEALTH': '0.028', 'AMMO4': '0.036', 'AMMO3': '0.130', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.192', 'weapon3': '1.462', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:54,715][52671] DAMAGECOUNT value on done: 15146.0 [2024-08-05 22:46:54,715][52671] Sum rewards: 11.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.901', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.284', 'WEAPON3': '0.650', 'ARMOR': '0.953', 'HITCOUNT': '1.000', 'weapon2': '1.402', 'weapon3': '1.848', 'DAMAGECOUNT': '3.621', 'FRAGCOUNT': '8.000'} [2024-08-05 22:46:54,875][52658] DAMAGECOUNT value on done: 13076.0 [2024-08-05 22:46:54,875][52658] Sum rewards: 12.159, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.513', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO3': '0.071', 'AMMO4': '0.086', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.402', 'weapon3': '1.648', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:54,907][52795] DAMAGECOUNT value on done: 12460.0 [2024-08-05 22:46:54,909][52795] Sum rewards: 13.162, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'weapon4': '0.304', 'WEAPON3': '1.000', 'weapon2': '1.184', 'HITCOUNT': '1.200', 'ARMOR': '1.485', 'weapon3': '2.068', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:55,574][52649] DAMAGECOUNT value on done: 11944.0 [2024-08-05 22:46:55,576][52649] Sum rewards: 7.558, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.315', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.316', 'HITCOUNT': '0.810', 'WEAPON3': '0.850', 'ARMOR': '0.943', 'weapon2': '1.478', 'weapon3': '1.576', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '7.000'} [2024-08-05 22:46:56,252][52803] DAMAGECOUNT value on done: 11790.0 [2024-08-05 22:46:56,253][52803] Sum rewards: 13.887, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'AMMO2': '0.000', 'AMMO4': '0.001', 'ARMOR': '0.012', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.188', 'WEAPON3': '0.550', 'HITCOUNT': '1.020', 'weapon2': '1.242', 'weapon3': '1.526', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:56,342][52650] Updated weights for policy 0, policy_version 10101 (0.0027) [2024-08-05 22:46:56,805][52663] DAMAGECOUNT value on done: 11426.0 [2024-08-05 22:46:56,805][52663] Sum rewards: 4.099, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.868', 'AMMO2': '0.007', 'AMMO5': '0.018', 'AMMO4': '0.033', 'weapon5': '0.036', 'weapon4': '0.058', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon3': '1.732', 'ARMOR': '1.779', 'weapon2': '1.878', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '5.000'} [2024-08-05 22:46:57,070][52664] DAMAGECOUNT value on done: 13356.0 [2024-08-05 22:46:57,070][52664] Sum rewards: 16.774, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.907', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon4': '0.444', 'WEAPON3': '0.600', 'weapon2': '0.796', 'HITCOUNT': '1.240', 'weapon3': '1.320', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '13.000'} [2024-08-05 22:46:57,075][52667] DAMAGECOUNT value on done: 14416.0 [2024-08-05 22:46:57,077][52667] Sum rewards: 17.020, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.095', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.454', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'weapon2': '0.998', 'HITCOUNT': '1.250', 'weapon3': '1.530', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '12.000'} [2024-08-05 22:46:57,360][52811] DAMAGECOUNT value on done: 12269.0 [2024-08-05 22:46:57,360][52811] Sum rewards: 13.870, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.412', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'weapon4': '0.564', 'WEAPON3': '0.600', 'ARMOR': '0.855', 'weapon2': '0.912', 'HITCOUNT': '1.090', 'weapon3': '1.624', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '11.000'} [2024-08-05 22:46:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 82771968. Throughput: 0: 4200.7. Samples: 20700860. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:46:57,794][52567] Avg episode reward: [(0, '12.039')] [2024-08-05 22:46:57,985][52658] DAMAGECOUNT value on done: 12916.0 [2024-08-05 22:46:57,987][52658] Sum rewards: 12.102, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.501', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'weapon4': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '1.010', 'weapon2': '1.102', 'weapon3': '1.800', 'DAMAGECOUNT': '3.522', 'FRAGCOUNT': '10.000'} [2024-08-05 22:46:58,164][52671] DAMAGECOUNT value on done: 13481.0 [2024-08-05 22:46:58,164][52671] Sum rewards: 11.513, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.629', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.063', 'weapon4': '0.230', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'weapon3': '1.348', 'weapon2': '1.406', 'DAMAGECOUNT': '2.559', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:58,183][52795] DAMAGECOUNT value on done: 13589.0 [2024-08-05 22:46:58,183][52795] Sum rewards: 11.334, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.872', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.021', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon4': '0.378', 'WEAPON3': '0.600', 'HITCOUNT': '0.860', 'weapon2': '1.084', 'weapon3': '1.516', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '9.000'} [2024-08-05 22:46:58,354][52659] DAMAGECOUNT value on done: 13336.0 [2024-08-05 22:46:58,356][52659] Sum rewards: 9.351, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.269', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.072', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'weapon2': '1.358', 'weapon3': '1.442', 'DAMAGECOUNT': '3.360', 'FRAGCOUNT': '6.500'} [2024-08-05 22:46:58,563][52649] DAMAGECOUNT value on done: 11983.0 [2024-08-05 22:46:58,564][52649] Sum rewards: 4.259, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.284', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.560', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'ARMOR': '0.886', 'weapon2': '0.942', 'weapon3': '1.852', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '6.000'} [2024-08-05 22:46:58,644][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:46:59,499][52803] DAMAGECOUNT value on done: 12902.0 [2024-08-05 22:46:59,508][52803] Sum rewards: 16.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.814', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'ARMOR': '0.028', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'WEAPON5': '0.200', 'weapon5': '0.308', 'WEAPON3': '0.800', 'weapon2': '1.018', 'HITCOUNT': '1.110', 'weapon3': '2.072', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '14.000'} [2024-08-05 22:46:59,552][52663] DAMAGECOUNT value on done: 12328.0 [2024-08-05 22:46:59,553][52663] Sum rewards: 4.764, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.979', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'weapon4': '0.324', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'ARMOR': '0.509', 'weapon3': '1.204', 'weapon2': '1.292', 'DAMAGECOUNT': '1.668', 'FRAGCOUNT': '5.000'} [2024-08-05 22:47:00,225][52667] DAMAGECOUNT value on done: 14017.0 [2024-08-05 22:47:00,226][52667] Sum rewards: 9.973, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.945', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.210', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'weapon2': '1.262', 'weapon3': '1.564', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:00,363][52664] DAMAGECOUNT value on done: 15028.0 [2024-08-05 22:47:00,368][52664] Sum rewards: 16.691, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.187', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.091', 'WEAPON5': '0.200', 'ARMOR': '0.511', 'WEAPON3': '0.700', 'HITCOUNT': '1.180', 'weapon2': '1.552', 'weapon3': '1.880', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:00,814][52811] DAMAGECOUNT value on done: 12202.0 [2024-08-05 22:47:00,816][52811] Sum rewards: 12.669, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.342', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.302', 'WEAPON3': '0.850', 'ARMOR': '1.045', 'weapon2': '1.240', 'HITCOUNT': '1.290', 'weapon3': '1.972', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:01,154][52671] DAMAGECOUNT value on done: 13709.0 [2024-08-05 22:47:01,155][52671] Sum rewards: 10.731, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.422', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.048', 'ARMOR': '0.088', 'AMMO4': '0.110', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.540', 'HITCOUNT': '0.840', 'WEAPON3': '0.850', 'weapon4': '0.924', 'weapon3': '1.936', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:01,202][52650] Updated weights for policy 0, policy_version 10111 (0.0025) [2024-08-05 22:47:01,305][52658] DAMAGECOUNT value on done: 12591.0 [2024-08-05 22:47:01,306][52658] Sum rewards: 7.860, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.678', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.012', 'AMMO5': '0.015', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.234', 'weapon2': '1.026', 'WEAPON3': '1.050', 'HITCOUNT': '1.050', 'weapon3': '2.038', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:01,454][52795] DAMAGECOUNT value on done: 11697.0 [2024-08-05 22:47:01,458][52795] Sum rewards: 11.585, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.370', 'AMMO2': '0.015', 'ARMOR': '0.056', 'AMMO4': '0.076', 'AMMO3': '0.116', 'WEAPON4': '0.300', 'weapon4': '0.570', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon2': '0.994', 'weapon3': '1.832', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '12.000'} [2024-08-05 22:47:01,467][52659] DAMAGECOUNT value on done: 13757.0 [2024-08-05 22:47:01,467][52659] Sum rewards: 8.417, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.206', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'ARMOR': '0.487', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.414', 'weapon3': '1.862', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:01,701][52649] DAMAGECOUNT value on done: 13630.0 [2024-08-05 22:47:01,702][52649] Sum rewards: 17.421, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.718', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.370', 'WEAPON3': '0.650', 'ARMOR': '0.911', 'HITCOUNT': '1.180', 'weapon2': '1.422', 'weapon3': '1.532', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:02,794][52567] Fps is (10 sec: 17213.1, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 82853888. Throughput: 0: 4193.8. Samples: 20713300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:47:02,794][52567] Avg episode reward: [(0, '11.965')] [2024-08-05 22:47:02,993][52803] DAMAGECOUNT value on done: 13838.0 [2024-08-05 22:47:02,993][52803] Sum rewards: 23.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.680', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'weapon4': '0.176', 'ARMOR': '0.496', 'WEAPON3': '0.850', 'weapon2': '1.380', 'HITCOUNT': '1.540', 'weapon3': '2.104', 'DAMAGECOUNT': '5.949', 'FRAGCOUNT': '19.000'} [2024-08-05 22:47:03,312][52664] DAMAGECOUNT value on done: 13691.0 [2024-08-05 22:47:03,314][52664] Sum rewards: 6.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.138', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON3': '0.850', 'HITCOUNT': '1.220', 'ARMOR': '1.234', 'weapon2': '1.814', 'weapon3': '1.970', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:03,399][52667] DAMAGECOUNT value on done: 14083.0 [2024-08-05 22:47:03,400][52667] Sum rewards: 16.285, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.894', 'AMMO4': '-0.089', 'AMMO2': '-0.018', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON7': '0.200', 'ARMOR': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '1.390', 'weapon2': '1.556', 'weapon3': '1.778', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '15.000'} [2024-08-05 22:47:04,157][52811] DAMAGECOUNT value on done: 12304.0 [2024-08-05 22:47:04,159][52811] Sum rewards: 9.820, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.084', 'AMMO2': '0.016', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.110', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon3': '1.492', 'weapon2': '1.680', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:04,358][52671] DAMAGECOUNT value on done: 14254.0 [2024-08-05 22:47:04,358][52671] Sum rewards: 11.234, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.092', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon4': '0.186', 'ARMOR': '0.536', 'WEAPON3': '0.900', 'weapon2': '0.998', 'HITCOUNT': '1.240', 'weapon3': '2.068', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '11.500'} [2024-08-05 22:47:04,379][52658] DAMAGECOUNT value on done: 13945.0 [2024-08-05 22:47:04,380][52658] Sum rewards: 19.074, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.756', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.368', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '1.200', 'weapon2': '1.340', 'weapon3': '1.462', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:04,514][52659] DAMAGECOUNT value on done: 13514.0 [2024-08-05 22:47:04,514][52659] Sum rewards: 9.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon5': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'ARMOR': '0.914', 'weapon2': '0.998', 'weapon3': '1.612', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:04,857][52795] DAMAGECOUNT value on done: 12411.0 [2024-08-05 22:47:04,859][52795] Sum rewards: 13.833, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.380', 'ARMOR': '0.005', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '1.436', 'weapon3': '1.834', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '11.500'} [2024-08-05 22:47:04,991][52649] DAMAGECOUNT value on done: 13878.0 [2024-08-05 22:47:04,991][52649] Sum rewards: 16.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.104', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'AMMO4': '0.087', 'WEAPON3': '0.550', 'HITCOUNT': '1.190', 'ARMOR': '1.258', 'weapon2': '1.622', 'weapon3': '1.830', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '12.000'} [2024-08-05 22:47:05,990][52650] Updated weights for policy 0, policy_version 10121 (0.0021) [2024-08-05 22:47:06,414][52664] DAMAGECOUNT value on done: 14172.0 [2024-08-05 22:47:06,415][52664] Sum rewards: 20.718, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.598', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'ARMOR': '0.020', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'weapon2': '1.528', 'HITCOUNT': '1.540', 'weapon3': '1.846', 'DAMAGECOUNT': '5.979', 'FRAGCOUNT': '16.000'} [2024-08-05 22:47:06,746][52667] DAMAGECOUNT value on done: 12879.0 [2024-08-05 22:47:06,748][52667] Sum rewards: 8.775, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.406', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.076', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.468', 'HITCOUNT': '0.820', 'WEAPON3': '0.900', 'ARMOR': '0.929', 'weapon2': '1.068', 'weapon3': '2.040', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:07,198][52671] DAMAGECOUNT value on done: 13791.0 [2024-08-05 22:47:07,198][52671] Sum rewards: 11.005, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.682', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.101', 'WEAPON4': '0.250', 'weapon4': '0.530', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon2': '0.992', 'ARMOR': '1.442', 'weapon3': '1.900', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:07,457][52658] DAMAGECOUNT value on done: 13017.0 [2024-08-05 22:47:07,457][52658] Sum rewards: 9.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.855', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.346', 'ARMOR': '0.475', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.140', 'weapon3': '1.718', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:07,520][52659] DAMAGECOUNT value on done: 13569.0 [2024-08-05 22:47:07,523][52659] Sum rewards: 9.613, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.320', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.256', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon3': '1.228', 'weapon2': '1.422', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:07,591][52811] DAMAGECOUNT value on done: 12576.0 [2024-08-05 22:47:07,592][52811] Sum rewards: 16.330, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.374', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.212', 'weapon4': '0.406', 'WEAPON3': '0.450', 'HITCOUNT': '1.180', 'weapon2': '1.358', 'weapon3': '1.430', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:07,673][52649] DAMAGECOUNT value on done: 12623.0 [2024-08-05 22:47:07,674][52649] Sum rewards: 12.075, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.345', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON6': '0.200', 'weapon6': '0.204', 'weapon4': '0.230', 'ARMOR': '0.457', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'weapon2': '1.292', 'weapon3': '1.450', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 82935808. Throughput: 0: 4195.1. Samples: 20738370. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:47:07,794][52567] Avg episode reward: [(0, '11.994')] [2024-08-05 22:47:08,162][52795] DAMAGECOUNT value on done: 14970.0 [2024-08-05 22:47:08,162][52795] Sum rewards: 11.444, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.598', 'AMMO5': '0.008', 'weapon5': '0.008', 'AMMO2': '0.026', 'ARMOR': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.132', 'AMMO3': '0.152', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '1.130', 'weapon2': '1.302', 'weapon3': '2.312', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:09,480][52667] DAMAGECOUNT value on done: 13516.0 [2024-08-05 22:47:09,481][52667] Sum rewards: 10.209, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.470', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.164', 'ARMOR': '0.527', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'weapon2': '1.318', 'weapon3': '1.614', 'DAMAGECOUNT': '2.868', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:09,641][52664] DAMAGECOUNT value on done: 12602.0 [2024-08-05 22:47:09,650][52664] Sum rewards: 8.605, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.218', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.020', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.866', 'HITCOUNT': '1.150', 'weapon3': '1.338', 'weapon2': '1.926', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:10,112][52658] DAMAGECOUNT value on done: 13569.0 [2024-08-05 22:47:10,113][52658] Sum rewards: 14.498, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.130', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'WEAPON3': '0.650', 'ARMOR': '0.897', 'HITCOUNT': '1.200', 'weapon2': '1.612', 'weapon3': '1.824', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:10,309][52671] DAMAGECOUNT value on done: 13212.0 [2024-08-05 22:47:10,309][52671] Sum rewards: 10.706, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.317', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.164', 'WEAPON3': '0.900', 'ARMOR': '0.968', 'HITCOUNT': '1.120', 'weapon2': '1.134', 'weapon3': '2.170', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:10,721][52659] DAMAGECOUNT value on done: 12581.0 [2024-08-05 22:47:10,725][52659] Sum rewards: 6.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.518', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.063', 'weapon5': '0.082', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.464', 'HITCOUNT': '0.700', 'weapon2': '0.854', 'WEAPON3': '0.950', 'weapon3': '1.890', 'DAMAGECOUNT': '2.565', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:10,771][52650] Updated weights for policy 0, policy_version 10131 (0.0017) [2024-08-05 22:47:10,805][52649] DAMAGECOUNT value on done: 15095.0 [2024-08-05 22:47:10,806][52649] Sum rewards: 6.964, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.670', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.050', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.302', 'ARMOR': '0.447', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'weapon3': '1.156', 'weapon2': '1.408', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '3.500'} [2024-08-05 22:47:11,496][52795] DAMAGECOUNT value on done: 13412.0 [2024-08-05 22:47:11,496][52795] Sum rewards: 9.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.098', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.276', 'ARMOR': '0.824', 'WEAPON3': '0.850', 'weapon2': '1.140', 'HITCOUNT': '1.240', 'weapon3': '1.950', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:12,677][52664] DAMAGECOUNT value on done: 13096.0 [2024-08-05 22:47:12,679][52664] Sum rewards: 9.331, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.770', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.238', 'ARMOR': '0.444', 'WEAPON3': '0.700', 'HITCOUNT': '0.850', 'weapon2': '1.564', 'weapon3': '1.802', 'DAMAGECOUNT': '2.832', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:12,794][52567] Fps is (10 sec: 17202.7, 60 sec: 16930.0, 300 sec: 16800.5). Total num frames: 83025920. Throughput: 0: 4198.0. Samples: 20763860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:47:12,795][52567] Avg episode reward: [(0, '11.793')] [2024-08-05 22:47:12,857][52658] DAMAGECOUNT value on done: 14710.0 [2024-08-05 22:47:12,857][52658] Sum rewards: 17.193, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.543', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon2': '1.286', 'ARMOR': '1.308', 'weapon3': '2.222', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '15.000'} [2024-08-05 22:47:13,352][52671] DAMAGECOUNT value on done: 14524.0 [2024-08-05 22:47:13,352][52671] Sum rewards: 10.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.046', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO5': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.070', 'weapon4': '0.154', 'AMMO3': '0.156', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '1.120', 'ARMOR': '1.379', 'weapon2': '1.390', 'weapon3': '2.110', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:13,654][52659] DAMAGECOUNT value on done: 14486.0 [2024-08-05 22:47:13,656][52659] Sum rewards: 19.042, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.914', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.104', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON3': '0.900', 'weapon2': '1.226', 'ARMOR': '1.347', 'HITCOUNT': '1.450', 'weapon3': '1.956', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '15.000'} [2024-08-05 22:47:14,014][52649] DAMAGECOUNT value on done: 12029.0 [2024-08-05 22:47:14,015][52649] Sum rewards: 10.476, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.731', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.556', 'weapon3': '1.724', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:14,833][52795] DAMAGECOUNT value on done: 12001.0 [2024-08-05 22:47:14,835][52795] Sum rewards: 5.205, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.359', 'AMMO2': '0.026', 'ARMOR': '0.028', 'AMMO4': '0.130', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon2': '0.566', 'HITCOUNT': '0.710', 'weapon4': '0.732', 'WEAPON3': '0.800', 'weapon3': '2.138', 'DAMAGECOUNT': '2.400', 'FRAGCOUNT': '6.000'} [2024-08-05 22:47:15,467][52658] DAMAGECOUNT value on done: 13174.0 [2024-08-05 22:47:15,468][52658] Sum rewards: 6.950, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.048', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.384', 'WEAPON3': '0.400', 'HITCOUNT': '0.430', 'weapon2': '0.904', 'weapon3': '0.968', 'DAMAGECOUNT': '1.731', 'FRAGCOUNT': '5.000'} [2024-08-05 22:47:15,607][52650] Updated weights for policy 0, policy_version 10141 (0.0026) [2024-08-05 22:47:16,041][52664] DAMAGECOUNT value on done: 12280.0 [2024-08-05 22:47:16,043][52664] Sum rewards: 17.315, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.976', 'AMMO2': '0.029', 'weapon4': '0.038', 'AMMO4': '0.145', 'AMMO3': '0.146', 'WEAPON4': '0.350', 'ARMOR': '0.508', 'WEAPON3': '1.050', 'weapon2': '1.178', 'HITCOUNT': '1.420', 'weapon3': '2.390', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '16.000'} [2024-08-05 22:47:16,452][52671] DAMAGECOUNT value on done: 15408.0 [2024-08-05 22:47:16,452][52671] Sum rewards: 10.667, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.480', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.296', 'ARMOR': '0.486', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon3': '1.330', 'weapon2': '1.620', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:16,803][52659] DAMAGECOUNT value on done: 13603.0 [2024-08-05 22:47:16,804][52659] Sum rewards: 13.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.170', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'weapon3': '0.996', 'HITCOUNT': '1.170', 'weapon2': '1.402', 'ARMOR': '1.650', 'DAMAGECOUNT': '4.161', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:17,310][52649] DAMAGECOUNT value on done: 12080.0 [2024-08-05 22:47:17,310][52649] Sum rewards: 11.562, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.466', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.388', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'weapon2': '0.952', 'ARMOR': '0.982', 'weapon3': '2.076', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:17,798][52567] Fps is (10 sec: 17197.3, 60 sec: 16929.2, 300 sec: 16800.4). Total num frames: 83107840. Throughput: 0: 4205.9. Samples: 20776490. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 22:47:17,800][52567] Avg episode reward: [(0, '11.786')] [2024-08-05 22:47:18,183][52795] DAMAGECOUNT value on done: 14005.0 [2024-08-05 22:47:18,185][52795] Sum rewards: 16.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.220', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'ARMOR': '0.456', 'WEAPON3': '1.150', 'weapon2': '1.182', 'HITCOUNT': '1.670', 'weapon3': '2.522', 'DAMAGECOUNT': '5.733', 'FRAGCOUNT': '16.000'} [2024-08-05 22:47:18,623][52664] DAMAGECOUNT value on done: 13776.0 [2024-08-05 22:47:18,624][52664] Sum rewards: 11.710, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.029', 'AMMO2': '0.030', 'AMMO3': '0.086', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'HEALTH': '0.366', 'WEAPON3': '0.550', 'weapon4': '0.658', 'HITCOUNT': '0.870', 'weapon2': '1.198', 'weapon3': '1.736', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:18,825][52658] DAMAGECOUNT value on done: 15912.0 [2024-08-05 22:47:18,826][52658] Sum rewards: 10.730, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.122', 'ARMOR': '0.429', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'weapon3': '1.534', 'weapon2': '2.016', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:19,000][52671] DAMAGECOUNT value on done: 13709.0 [2024-08-05 22:47:19,016][52671] Sum rewards: 12.293, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.646', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.167', 'ARMOR': '0.876', 'WEAPON3': '1.000', 'HITCOUNT': '1.100', 'weapon2': '1.280', 'weapon3': '2.224', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '12.000'} [2024-08-05 22:47:19,276][52659] DAMAGECOUNT value on done: 11891.0 [2024-08-05 22:47:19,278][52659] Sum rewards: 8.816, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.090', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.089', 'WEAPON3': '0.600', 'ARMOR': '0.888', 'HITCOUNT': '0.920', 'weapon3': '1.544', 'weapon2': '2.106', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '6.000'} [2024-08-05 22:47:20,417][52650] Updated weights for policy 0, policy_version 10151 (0.0018) [2024-08-05 22:47:20,460][52649] DAMAGECOUNT value on done: 14182.0 [2024-08-05 22:47:20,462][52649] Sum rewards: 8.252, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.306', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.220', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'HITCOUNT': '0.700', 'weapon3': '0.920', 'weapon2': '0.968', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '6.000'} [2024-08-05 22:47:21,429][52795] DAMAGECOUNT value on done: 13543.0 [2024-08-05 22:47:21,432][52795] Sum rewards: 17.068, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.907', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'ARMOR': '0.472', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon2': '1.416', 'weapon3': '2.010', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '16.000'} [2024-08-05 22:47:21,633][52664] DAMAGECOUNT value on done: 11573.0 [2024-08-05 22:47:21,638][52664] Sum rewards: 13.627, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.230', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.354', 'ARMOR': '0.894', 'WEAPON3': '0.950', 'weapon2': '1.158', 'HITCOUNT': '1.320', 'weapon3': '1.826', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '13.000'} [2024-08-05 22:47:22,068][52671] DAMAGECOUNT value on done: 14106.0 [2024-08-05 22:47:22,069][52671] Sum rewards: 14.344, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.856', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.310', 'weapon3': '1.736', 'weapon2': '1.746', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:22,156][52658] DAMAGECOUNT value on done: 14347.0 [2024-08-05 22:47:22,157][52658] Sum rewards: 5.422, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.611', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.127', 'AMMO4': '0.138', 'WEAPON4': '0.300', 'HITCOUNT': '0.770', 'ARMOR': '0.864', 'WEAPON3': '0.900', 'weapon2': '1.500', 'weapon3': '1.978', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:22,268][52659] DAMAGECOUNT value on done: 13361.0 [2024-08-05 22:47:22,270][52659] Sum rewards: 10.416, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.541', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON3': '0.900', 'HITCOUNT': '0.950', 'weapon2': '1.354', 'weapon3': '2.078', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:22,794][52567] Fps is (10 sec: 16384.5, 60 sec: 16657.1, 300 sec: 16800.5). Total num frames: 83189760. Throughput: 0: 4212.0. Samples: 20802110. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 22:47:22,794][52567] Avg episode reward: [(0, '11.744')] [2024-08-05 22:47:22,848][52649] DAMAGECOUNT value on done: 12487.0 [2024-08-05 22:47:22,848][52649] Sum rewards: 14.335, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.874', 'AMMO2': '0.007', 'AMMO4': '0.034', 'ARMOR': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'weapon3': '1.710', 'weapon2': '1.810', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:24,725][52795] DAMAGECOUNT value on done: 13964.0 [2024-08-05 22:47:24,725][52795] Sum rewards: 14.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.399', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON3': '0.900', 'HITCOUNT': '1.110', 'ARMOR': '1.268', 'weapon2': '1.522', 'weapon3': '1.986', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '13.000'} [2024-08-05 22:47:24,986][52664] DAMAGECOUNT value on done: 14775.0 [2024-08-05 22:47:24,986][52664] Sum rewards: 16.943, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.524', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'WEAPON3': '1.200', 'ARMOR': '1.394', 'weapon2': '1.396', 'HITCOUNT': '1.650', 'weapon3': '2.228', 'DAMAGECOUNT': '5.730', 'FRAGCOUNT': '16.000'} [2024-08-05 22:47:25,046][52671] DAMAGECOUNT value on done: 15409.0 [2024-08-05 22:47:25,046][52671] Sum rewards: 12.547, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.245', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.230', 'ARMOR': '0.513', 'WEAPON3': '0.750', 'weapon2': '1.086', 'HITCOUNT': '1.230', 'weapon3': '1.876', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:25,202][52659] DAMAGECOUNT value on done: 14424.0 [2024-08-05 22:47:25,202][52659] Sum rewards: 14.065, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.144', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'ARMOR': '0.915', 'WEAPON3': '1.200', 'weapon2': '1.238', 'HITCOUNT': '1.390', 'weapon3': '2.390', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:25,353][52658] DAMAGECOUNT value on done: 13816.0 [2024-08-05 22:47:25,355][52658] Sum rewards: 19.225, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.208', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.370', 'ARMOR': '0.493', 'WEAPON3': '0.700', 'HITCOUNT': '1.190', 'weapon2': '1.408', 'weapon3': '1.810', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '15.000'} [2024-08-05 22:47:25,565][52650] Updated weights for policy 0, policy_version 10161 (0.0027) [2024-08-05 22:47:25,869][52649] DAMAGECOUNT value on done: 14617.0 [2024-08-05 22:47:25,870][52649] Sum rewards: 9.476, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.176', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon7': '0.118', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'weapon4': '0.310', 'ARMOR': '0.412', 'WEAPON3': '0.500', 'weapon2': '0.750', 'HITCOUNT': '0.820', 'weapon3': '1.620', 'DAMAGECOUNT': '2.667', 'FRAGCOUNT': '6.000'} [2024-08-05 22:47:26,351][52614] Signal inference workers to stop experience collection... (1900 times) [2024-08-05 22:47:26,352][52614] Signal inference workers to resume experience collection... (1900 times) [2024-08-05 22:47:26,441][52650] InferenceWorker_p0-w0: stopping experience collection (1900 times) [2024-08-05 22:47:26,442][52650] InferenceWorker_p0-w0: resuming experience collection (1900 times) [2024-08-05 22:47:27,614][52671] DAMAGECOUNT value on done: 12339.0 [2024-08-05 22:47:27,616][52671] Sum rewards: 13.960, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.706', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.090', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'ARMOR': '1.301', 'weapon3': '1.650', 'weapon2': '1.666', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:27,794][52567] Fps is (10 sec: 17208.9, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 83279872. Throughput: 0: 4210.9. Samples: 20827180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:47:27,795][52567] Avg episode reward: [(0, '12.072')] [2024-08-05 22:47:27,797][52659] DAMAGECOUNT value on done: 13675.0 [2024-08-05 22:47:27,797][52659] Sum rewards: 7.904, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.018', 'weapon4': '0.020', 'AMMO4': '0.037', 'AMMO3': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.467', 'HITCOUNT': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.660', 'weapon3': '1.690', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:28,180][52658] DAMAGECOUNT value on done: 12833.0 [2024-08-05 22:47:28,180][52658] Sum rewards: 12.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.552', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.113', 'weapon5': '0.358', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'ARMOR': '1.339', 'weapon2': '1.500', 'weapon3': '1.842', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '12.000'} [2024-08-05 22:47:28,191][52795] DAMAGECOUNT value on done: 12334.0 [2024-08-05 22:47:28,192][52795] Sum rewards: 18.252, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.452', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.851', 'HITCOUNT': '1.070', 'weapon2': '1.650', 'weapon3': '1.812', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:28,378][52664] DAMAGECOUNT value on done: 12078.0 [2024-08-05 22:47:28,379][52664] Sum rewards: 10.405, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'HEALTH': '0.063', 'AMMO3': '0.069', 'weapon5': '0.224', 'WEAPON3': '0.350', 'HITCOUNT': '0.700', 'weapon3': '0.996', 'weapon2': '1.338', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:28,933][52649] DAMAGECOUNT value on done: 13738.0 [2024-08-05 22:47:28,935][52649] Sum rewards: 10.321, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.347', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'HITCOUNT': '0.610', 'weapon3': '1.232', 'ARMOR': '1.316', 'weapon2': '1.448', 'DAMAGECOUNT': '2.073', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:29,971][52650] Updated weights for policy 0, policy_version 10171 (0.0033) [2024-08-05 22:47:30,644][52671] DAMAGECOUNT value on done: 12745.0 [2024-08-05 22:47:30,645][52671] Sum rewards: 7.838, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.066', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.032', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.322', 'HITCOUNT': '0.650', 'WEAPON3': '0.700', 'weapon2': '1.262', 'weapon3': '1.830', 'DAMAGECOUNT': '2.289', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:30,848][52659] DAMAGECOUNT value on done: 13103.0 [2024-08-05 22:47:30,850][52659] Sum rewards: 13.869, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'HEALTH': '0.179', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'weapon4': '0.514', 'HITCOUNT': '0.640', 'weapon2': '0.824', 'weapon3': '1.576', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:30,969][52658] DAMAGECOUNT value on done: 14491.0 [2024-08-05 22:47:30,979][52658] Sum rewards: 16.406, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.044', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.294', 'WEAPON3': '0.700', 'ARMOR': '0.828', 'HITCOUNT': '1.200', 'weapon2': '1.418', 'weapon3': '1.742', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '13.000'} [2024-08-05 22:47:31,051][52664] DAMAGECOUNT value on done: 13374.0 [2024-08-05 22:47:31,054][52664] Sum rewards: 18.508, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.053', 'AMMO3': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.902', 'HITCOUNT': '1.080', 'weapon2': '1.442', 'weapon3': '1.696', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:31,823][52795] DAMAGECOUNT value on done: 12996.0 [2024-08-05 22:47:31,827][52795] Sum rewards: 10.277, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.480', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.012', 'ARMOR': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.244', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'weapon2': '0.928', 'weapon3': '1.906', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:32,665][52649] DAMAGECOUNT value on done: 15200.0 [2024-08-05 22:47:32,667][52649] Sum rewards: 19.327, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.690', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'weapon7': '0.066', 'AMMO3': '0.091', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.422', 'WEAPON3': '0.700', 'weapon2': '1.318', 'HITCOUNT': '1.610', 'weapon3': '1.886', 'DAMAGECOUNT': '5.787', 'FRAGCOUNT': '15.000'} [2024-08-05 22:47:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 83361792. Throughput: 0: 4213.3. Samples: 20839910. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 22:47:32,795][52567] Avg episode reward: [(0, '12.199')] [2024-08-05 22:47:33,031][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:47:33,622][52664] DAMAGECOUNT value on done: 14156.0 [2024-08-05 22:47:33,626][52664] Sum rewards: 7.713, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.462', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.022', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'ARMOR': '0.404', 'HITCOUNT': '0.790', 'WEAPON3': '0.900', 'weapon2': '1.320', 'weapon3': '1.866', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:33,917][52671] DAMAGECOUNT value on done: 14119.0 [2024-08-05 22:47:33,917][52671] Sum rewards: 13.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.032', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'ARMOR': '0.851', 'WEAPON3': '1.000', 'HITCOUNT': '1.240', 'weapon2': '1.298', 'weapon3': '2.436', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '12.000'} [2024-08-05 22:47:34,174][52659] DAMAGECOUNT value on done: 12670.0 [2024-08-05 22:47:34,176][52659] Sum rewards: 7.148, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.996', 'AMMO2': '0.005', 'weapon7': '0.016', 'AMMO4': '0.027', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.334', 'HITCOUNT': '0.910', 'WEAPON3': '1.050', 'weapon2': '1.138', 'ARMOR': '1.273', 'weapon3': '1.858', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:35,010][52650] Updated weights for policy 0, policy_version 10181 (0.0025) [2024-08-05 22:47:35,048][52662] Large shaping reward 2.527 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon7', 0.002)] [2024-08-05 22:47:36,834][52671] DAMAGECOUNT value on done: 12991.0 [2024-08-05 22:47:36,836][52671] Sum rewards: 10.461, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO4': '0.153', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'HEALTH': '0.382', 'ARMOR': '0.520', 'weapon4': '0.640', 'weapon2': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.130', 'weapon3': '1.848', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:37,071][52659] DAMAGECOUNT value on done: 14638.0 [2024-08-05 22:47:37,072][52659] Sum rewards: 17.331, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.715', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.028', 'weapon5': '0.028', 'weapon4': '0.056', 'AMMO4': '0.080', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'weapon2': '1.112', 'HITCOUNT': '1.210', 'weapon3': '1.856', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '15.000'} [2024-08-05 22:47:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 83443712. Throughput: 0: 4213.2. Samples: 20865310. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 22:47:37,794][52567] Avg episode reward: [(0, '12.182')] [2024-08-05 22:47:38,132][52820] DAMAGECOUNT value on done: 10477.0 [2024-08-05 22:47:38,132][52820] Sum rewards: 8.164, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.262', 'AMMO2': '0.015', 'AMMO3': '0.062', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.440', 'ARMOR': '0.444', 'weapon2': '0.516', 'HITCOUNT': '0.710', 'weapon3': '0.920', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '5.000'} [2024-08-05 22:47:39,806][52671] DAMAGECOUNT value on done: 15532.0 [2024-08-05 22:47:39,808][52671] Sum rewards: 8.219, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.220', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.011', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.816', 'weapon2': '1.318', 'weapon3': '2.062', 'DAMAGECOUNT': '2.727', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:40,043][52650] Updated weights for policy 0, policy_version 10191 (0.0019) [2024-08-05 22:47:40,113][52659] DAMAGECOUNT value on done: 14223.0 [2024-08-05 22:47:40,116][52659] Sum rewards: 7.180, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.856', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.032', 'AMMO4': '0.058', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.358', 'ARMOR': '0.497', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.114', 'weapon3': '1.762', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:41,427][52820] DAMAGECOUNT value on done: 12776.0 [2024-08-05 22:47:41,430][52820] Sum rewards: 16.441, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.554', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.018', 'weapon7': '0.048', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.170', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.052', 'HITCOUNT': '1.170', 'weapon3': '1.974', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:42,738][52671] DAMAGECOUNT value on done: 12454.0 [2024-08-05 22:47:42,739][52671] Sum rewards: 1.806, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.438', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.131', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'ARMOR': '0.868', 'weapon3': '1.450', 'weapon2': '1.480', 'FRAGCOUNT': '2.000', 'DAMAGECOUNT': '2.808'} [2024-08-05 22:47:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 83533824. Throughput: 0: 4219.3. Samples: 20890730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:47:42,794][52567] Avg episode reward: [(0, '12.022')] [2024-08-05 22:47:42,910][52659] DAMAGECOUNT value on done: 15436.0 [2024-08-05 22:47:42,911][52659] Sum rewards: 19.808, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.315', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.071', 'weapon4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '1.130', 'weapon2': '1.408', 'weapon3': '1.464', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '15.000'} [2024-08-05 22:47:43,173][52668] DAMAGECOUNT value on done: 12988.0 [2024-08-05 22:47:43,173][52668] Sum rewards: 8.119, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'weapon4': '0.024', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'AMMO4': '0.135', 'weapon5': '0.136', 'WEAPON4': '0.150', 'ARMOR': '0.430', 'WEAPON3': '0.600', 'HITCOUNT': '0.800', 'weapon2': '1.570', 'weapon3': '1.592', 'DAMAGECOUNT': '2.676', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:44,749][52650] Updated weights for policy 0, policy_version 10201 (0.0027) [2024-08-05 22:47:44,861][52820] DAMAGECOUNT value on done: 12492.0 [2024-08-05 22:47:44,863][52820] Sum rewards: 13.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.400', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.133', 'WEAPON3': '0.850', 'weapon2': '1.134', 'HITCOUNT': '1.260', 'weapon3': '2.212', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '12.000'} [2024-08-05 22:47:45,696][52671] DAMAGECOUNT value on done: 15197.0 [2024-08-05 22:47:45,698][52671] Sum rewards: 13.344, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.385', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.123', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'HITCOUNT': '1.090', 'weapon2': '1.518', 'weapon3': '2.074', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:46,052][52659] DAMAGECOUNT value on done: 12767.0 [2024-08-05 22:47:46,052][52659] Sum rewards: 12.205, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.765', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'AMMO3': '0.051', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '0.820', 'weapon3': '1.152', 'weapon2': '1.536', 'DAMAGECOUNT': '2.859', 'FRAGCOUNT': '9.000'} [2024-08-05 22:47:46,400][52668] DAMAGECOUNT value on done: 15204.0 [2024-08-05 22:47:46,403][52668] Sum rewards: 4.960, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.815', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon7': '0.084', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.240', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'weapon3': '1.410', 'weapon2': '1.458', 'DAMAGECOUNT': '2.301', 'FRAGCOUNT': '4.000'} [2024-08-05 22:47:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 83615744. Throughput: 0: 4221.8. Samples: 20903280. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:47:47,804][52567] Avg episode reward: [(0, '12.018')] [2024-08-05 22:47:48,322][52820] DAMAGECOUNT value on done: 13085.0 [2024-08-05 22:47:48,323][52820] Sum rewards: 4.792, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.129', 'weapon4': '0.198', 'WEAPON4': '0.200', 'ARMOR': '0.518', 'HITCOUNT': '0.740', 'WEAPON3': '0.850', 'weapon2': '0.964', 'weapon3': '1.846', 'DAMAGECOUNT': '2.724', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:49,266][52659] DAMAGECOUNT value on done: 14115.0 [2024-08-05 22:47:49,266][52659] Sum rewards: 22.538, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.364', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'HITCOUNT': '1.330', 'weapon2': '1.338', 'weapon3': '1.792', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '20.000'} [2024-08-05 22:47:49,491][52668] DAMAGECOUNT value on done: 13442.0 [2024-08-05 22:47:49,491][52668] Sum rewards: 13.111, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.393', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon7': '0.086', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.404', 'WEAPON3': '0.600', 'ARMOR': '0.862', 'weapon2': '1.070', 'HITCOUNT': '1.080', 'weapon3': '1.556', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:50,029][52650] Updated weights for policy 0, policy_version 10211 (0.0016) [2024-08-05 22:47:50,794][52660] DAMAGECOUNT value on done: 14609.0 [2024-08-05 22:47:50,795][52660] Sum rewards: 17.879, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.245', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.086', 'weapon5': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.286', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.174', 'HITCOUNT': '1.210', 'weapon3': '1.650', 'DAMAGECOUNT': '4.527', 'FRAGCOUNT': '13.000'} [2024-08-05 22:47:51,657][52820] DAMAGECOUNT value on done: 13343.0 [2024-08-05 22:47:51,658][52820] Sum rewards: 12.251, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.031', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'weapon4': '0.274', 'ARMOR': '0.479', 'WEAPON3': '0.800', 'HITCOUNT': '1.180', 'weapon2': '1.344', 'weapon3': '2.028', 'DAMAGECOUNT': '4.098', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:51,836][52659] DAMAGECOUNT value on done: 11601.0 [2024-08-05 22:47:51,839][52659] Sum rewards: 12.805, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.267', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.051', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.274', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.910', 'weapon3': '1.216', 'weapon2': '1.266', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '8.500'} [2024-08-05 22:47:52,794][52567] Fps is (10 sec: 15564.8, 60 sec: 16795.2, 300 sec: 16800.5). Total num frames: 83689472. Throughput: 0: 4226.0. Samples: 20928540. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 22:47:52,794][52567] Avg episode reward: [(0, '12.098')] [2024-08-05 22:47:52,944][52668] DAMAGECOUNT value on done: 13135.0 [2024-08-05 22:47:52,945][52668] Sum rewards: 11.185, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.941', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.266', 'WEAPON3': '0.750', 'weapon2': '0.882', 'HITCOUNT': '0.930', 'ARMOR': '1.341', 'weapon3': '1.786', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '10.000'} [2024-08-05 22:47:54,207][52660] DAMAGECOUNT value on done: 14631.0 [2024-08-05 22:47:54,208][52660] Sum rewards: 5.979, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.500', 'ARMOR': '0.514', 'HITCOUNT': '0.690', 'WEAPON3': '0.950', 'weapon2': '1.020', 'weapon3': '1.934', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '8.000'} [2024-08-05 22:47:54,249][52650] Updated weights for policy 0, policy_version 10221 (0.0019) [2024-08-05 22:47:54,582][52659] DAMAGECOUNT value on done: 14360.0 [2024-08-05 22:47:54,583][52659] Sum rewards: 18.445, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.943', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'weapon4': '0.508', 'weapon2': '0.916', 'WEAPON3': '1.000', 'HITCOUNT': '1.530', 'weapon3': '2.254', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '16.000'} [2024-08-05 22:47:55,000][52820] DAMAGECOUNT value on done: 14123.0 [2024-08-05 22:47:55,002][52820] Sum rewards: 11.494, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.031', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'WEAPON3': '0.350', 'ARMOR': '0.484', 'weapon4': '0.632', 'HITCOUNT': '0.730', 'HEALTH': '0.813', 'weapon2': '1.030', 'weapon3': '1.442', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:55,966][52668] DAMAGECOUNT value on done: 13886.0 [2024-08-05 22:47:55,970][52668] Sum rewards: 13.679, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.592', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.314', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.486', 'weapon3': '1.506', 'ARMOR': '1.714', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '11.000'} [2024-08-05 22:47:56,955][52660] DAMAGECOUNT value on done: 12620.0 [2024-08-05 22:47:56,955][52660] Sum rewards: 13.666, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.216', 'ARMOR': '0.457', 'WEAPON3': '0.900', 'HITCOUNT': '1.220', 'weapon2': '1.734', 'weapon3': '1.750', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '13.000'} [2024-08-05 22:47:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 83787776. Throughput: 0: 4227.8. Samples: 20954110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:47:57,794][52567] Avg episode reward: [(0, '12.281')] [2024-08-05 22:47:57,797][52614] Saving new best policy, reward=12.281! [2024-08-05 22:47:58,254][52820] DAMAGECOUNT value on done: 11628.0 [2024-08-05 22:47:58,256][52820] Sum rewards: 11.328, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.008', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON3': '0.550', 'ARMOR': '0.876', 'HITCOUNT': '1.050', 'weapon2': '1.154', 'weapon3': '2.052', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '7.000'} [2024-08-05 22:47:58,758][52668] DAMAGECOUNT value on done: 13955.0 [2024-08-05 22:47:58,763][52668] Sum rewards: 15.347, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.025', 'AMMO2': '0.023', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.522', 'weapon2': '0.970', 'WEAPON3': '1.000', 'HITCOUNT': '1.130', 'ARMOR': '1.356', 'weapon3': '2.150', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '14.000'} [2024-08-05 22:47:59,578][52650] Updated weights for policy 0, policy_version 10231 (0.0011) [2024-08-05 22:47:59,644][52660] DAMAGECOUNT value on done: 13748.0 [2024-08-05 22:47:59,646][52660] Sum rewards: 15.510, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.365', 'AMMO2': '0.012', 'weapon7': '0.040', 'AMMO3': '0.060', 'AMMO4': '0.061', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.298', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'HITCOUNT': '0.920', 'weapon2': '1.122', 'weapon3': '1.444', 'DAMAGECOUNT': '3.393', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:00,045][52666] DAMAGECOUNT value on done: 13668.0 [2024-08-05 22:48:00,045][52666] Sum rewards: 10.492, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.275', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.138', 'WEAPON4': '0.300', 'weapon4': '0.580', 'WEAPON3': '0.800', 'ARMOR': '0.868', 'HITCOUNT': '0.970', 'weapon2': '1.378', 'weapon3': '1.598', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:01,365][52668] DAMAGECOUNT value on done: 14736.0 [2024-08-05 22:48:01,367][52668] Sum rewards: 10.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.937', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'ARMOR': '0.490', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.418', 'weapon3': '1.778', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:01,672][52820] DAMAGECOUNT value on done: 13048.0 [2024-08-05 22:48:01,672][52820] Sum rewards: 11.697, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.392', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.328', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'weapon2': '1.088', 'weapon3': '1.744', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:02,385][52660] DAMAGECOUNT value on done: 10389.0 [2024-08-05 22:48:02,385][52660] Sum rewards: 14.515, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.072', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.064', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.694', 'HITCOUNT': '0.830', 'weapon2': '0.858', 'ARMOR': '0.937', 'weapon3': '1.214', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:02,534][52670] DAMAGECOUNT value on done: 15060.0 [2024-08-05 22:48:02,534][52670] Sum rewards: 11.055, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.662', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.240', 'ARMOR': '0.912', 'weapon2': '0.922', 'WEAPON3': '1.050', 'HITCOUNT': '1.060', 'weapon3': '2.158', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16828.3). Total num frames: 83861504. Throughput: 0: 4221.2. Samples: 20966430. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:48:02,794][52567] Avg episode reward: [(0, '12.195')] [2024-08-05 22:48:03,513][52666] DAMAGECOUNT value on done: 12887.0 [2024-08-05 22:48:03,521][52666] Sum rewards: 11.116, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.049', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.316', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.216', 'weapon3': '1.720', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:04,033][52650] Updated weights for policy 0, policy_version 10241 (0.0029) [2024-08-05 22:48:04,281][52668] DAMAGECOUNT value on done: 14169.0 [2024-08-05 22:48:04,282][52668] Sum rewards: 14.304, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.792', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.850', 'weapon2': '1.090', 'HITCOUNT': '1.140', 'weapon3': '2.392', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:04,981][52820] DAMAGECOUNT value on done: 11901.0 [2024-08-05 22:48:04,982][52820] Sum rewards: 13.852, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.028', 'weapon7': '0.048', 'WEAPON5': '0.050', 'HEALTH': '0.066', 'AMMO4': '0.069', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.872', 'HITCOUNT': '1.160', 'weapon2': '1.270', 'weapon3': '1.666', 'DAMAGECOUNT': '4.026', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:05,285][52670] DAMAGECOUNT value on done: 12951.0 [2024-08-05 22:48:05,285][52670] Sum rewards: 12.581, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.470', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.860', 'HITCOUNT': '1.150', 'weapon2': '1.278', 'weapon3': '2.056', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:05,480][52660] DAMAGECOUNT value on done: 14599.0 [2024-08-05 22:48:05,483][52660] Sum rewards: 10.419, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.620', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon3': '1.486', 'weapon2': '1.578', 'DAMAGECOUNT': '3.000', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:06,112][52666] DAMAGECOUNT value on done: 13957.0 [2024-08-05 22:48:06,113][52666] Sum rewards: 17.728, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.696', 'weapon4': '0.004', 'AMMO2': '0.014', 'ARMOR': '0.032', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'weapon2': '1.708', 'weapon3': '1.990', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '15.000'} [2024-08-05 22:48:07,521][52668] DAMAGECOUNT value on done: 12887.0 [2024-08-05 22:48:07,522][52668] Sum rewards: 10.770, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.015', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.076', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HEALTH': '0.691', 'HITCOUNT': '0.900', 'weapon3': '1.338', 'weapon2': '1.602', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:07,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 83951616. Throughput: 0: 4215.1. Samples: 20991790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:48:07,795][52567] Avg episode reward: [(0, '12.239')] [2024-08-05 22:48:08,341][52820] DAMAGECOUNT value on done: 12771.0 [2024-08-05 22:48:08,341][52820] Sum rewards: 10.857, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.662', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.112', 'weapon5': '0.180', 'weapon4': '0.180', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon2': '1.284', 'weapon3': '1.546', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:08,429][52660] DAMAGECOUNT value on done: 12559.0 [2024-08-05 22:48:08,430][52660] Sum rewards: 5.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.942', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.109', 'weapon4': '0.384', 'ARMOR': '0.460', 'HITCOUNT': '0.590', 'WEAPON3': '0.700', 'weapon2': '1.054', 'weapon3': '1.398', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:08,672][52670] DAMAGECOUNT value on done: 12289.0 [2024-08-05 22:48:08,680][52670] Sum rewards: 7.549, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.720', 'AMMO5': '0.012', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon5': '0.072', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.548', 'weapon2': '0.854', 'HITCOUNT': '1.090', 'WEAPON3': '1.150', 'weapon3': '2.244', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:09,039][52650] Updated weights for policy 0, policy_version 10251 (0.0020) [2024-08-05 22:48:09,589][52666] DAMAGECOUNT value on done: 13026.0 [2024-08-05 22:48:09,591][52666] Sum rewards: 11.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.318', 'ARMOR': '0.461', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.434', 'weapon3': '1.738', 'DAMAGECOUNT': '3.009', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:10,858][52668] DAMAGECOUNT value on done: 15900.0 [2024-08-05 22:48:10,860][52668] Sum rewards: 18.604, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.386', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.010', 'AMMO4': '0.026', 'weapon7': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'HITCOUNT': '1.260', 'weapon2': '1.606', 'weapon3': '1.650', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '14.000'} [2024-08-05 22:48:11,822][52820] DAMAGECOUNT value on done: 12419.0 [2024-08-05 22:48:11,822][52820] Sum rewards: 19.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.218', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'weapon5': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon4': '0.438', 'WEAPON3': '0.700', 'weapon2': '0.838', 'HITCOUNT': '1.060', 'ARMOR': '1.300', 'weapon3': '1.662', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '17.000'} [2024-08-05 22:48:11,928][52660] DAMAGECOUNT value on done: 14472.0 [2024-08-05 22:48:11,929][52660] Sum rewards: 10.967, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.038', 'AMMO3': '0.108', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'HEALTH': '0.298', 'weapon4': '0.316', 'WEAPON3': '0.650', 'ARMOR': '0.884', 'HITCOUNT': '0.940', 'weapon2': '1.242', 'weapon3': '1.688', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:11,994][52670] DAMAGECOUNT value on done: 13806.0 [2024-08-05 22:48:11,995][52670] Sum rewards: 16.043, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.886', 'AMMO2': '0.014', 'ARMOR': '0.049', 'AMMO4': '0.069', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.800', 'HITCOUNT': '1.210', 'weapon2': '1.346', 'weapon3': '1.894', 'DAMAGECOUNT': '4.488', 'FRAGCOUNT': '14.000'} [2024-08-05 22:48:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16828.3). Total num frames: 84033536. Throughput: 0: 4213.3. Samples: 21016780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:48:12,794][52567] Avg episode reward: [(0, '12.199')] [2024-08-05 22:48:12,950][52666] DAMAGECOUNT value on done: 13392.0 [2024-08-05 22:48:12,950][52666] Sum rewards: 11.806, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO2': '0.004', 'AMMO5': '0.015', 'weapon4': '0.018', 'AMMO4': '0.019', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.816', 'HITCOUNT': '0.890', 'weapon3': '1.680', 'weapon2': '1.686', 'DAMAGECOUNT': '4.026', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:13,527][52794] DAMAGECOUNT value on done: 15426.0 [2024-08-05 22:48:13,528][52794] Sum rewards: 15.279, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.715', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'weapon5': '0.054', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'ARMOR': '1.314', 'weapon3': '1.334', 'weapon2': '1.900', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:13,543][52668] DAMAGECOUNT value on done: 11918.0 [2024-08-05 22:48:13,544][52668] Sum rewards: 12.303, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.029', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.144', 'weapon4': '0.344', 'ARMOR': '0.432', 'HEALTH': '0.478', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '1.306', 'weapon3': '1.528', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:14,216][52650] Updated weights for policy 0, policy_version 10261 (0.0048) [2024-08-05 22:48:14,598][52660] DAMAGECOUNT value on done: 13760.0 [2024-08-05 22:48:14,598][52660] Sum rewards: 11.467, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.326', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon3': '1.382', 'weapon2': '1.684', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:15,385][52820] DAMAGECOUNT value on done: 12500.0 [2024-08-05 22:48:15,386][52820] Sum rewards: 20.268, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.437', 'WEAPON3': '0.700', 'HITCOUNT': '1.380', 'weapon2': '1.616', 'weapon3': '1.862', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '16.000'} [2024-08-05 22:48:15,491][52670] DAMAGECOUNT value on done: 12607.0 [2024-08-05 22:48:15,493][52670] Sum rewards: 10.201, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.727', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.015', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'weapon4': '0.450', 'HITCOUNT': '0.940', 'weapon3': '1.186', 'weapon2': '1.354', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:15,972][52794] DAMAGECOUNT value on done: 16791.0 [2024-08-05 22:48:15,973][52794] Sum rewards: 7.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.118', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.110', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'weapon2': '0.298', 'weapon4': '0.750', 'WEAPON3': '0.800', 'HITCOUNT': '0.930', 'weapon3': '1.846', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '6.500'} [2024-08-05 22:48:16,278][52668] DAMAGECOUNT value on done: 13392.0 [2024-08-05 22:48:16,281][52668] Sum rewards: 11.220, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.930', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.212', 'ARMOR': '0.478', 'WEAPON3': '0.750', 'HITCOUNT': '0.980', 'weapon2': '1.496', 'weapon3': '1.696', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:16,496][52666] DAMAGECOUNT value on done: 12037.0 [2024-08-05 22:48:16,500][52666] Sum rewards: 15.680, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.129', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.394', 'ARMOR': '0.420', 'WEAPON3': '0.500', 'HITCOUNT': '1.100', 'weapon3': '1.176', 'weapon2': '1.634', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:17,588][52660] DAMAGECOUNT value on done: 14523.0 [2024-08-05 22:48:17,590][52660] Sum rewards: 12.075, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'AMMO4': '0.102', 'weapon4': '0.150', 'HEALTH': '0.255', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'weapon2': '1.304', 'weapon3': '1.776', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:17,794][52567] Fps is (10 sec: 15564.8, 60 sec: 16658.0, 300 sec: 16800.5). Total num frames: 84107264. Throughput: 0: 4208.9. Samples: 21029310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:48:17,795][52567] Avg episode reward: [(0, '12.427')] [2024-08-05 22:48:17,803][52614] Saving new best policy, reward=12.427! [2024-08-05 22:48:18,643][52670] DAMAGECOUNT value on done: 14692.0 [2024-08-05 22:48:18,645][52670] Sum rewards: 18.065, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.010', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.016', 'weapon5': '0.166', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.469', 'weapon4': '0.488', 'WEAPON3': '1.100', 'weapon2': '1.142', 'HITCOUNT': '1.150', 'weapon3': '1.884', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '16.000'} [2024-08-05 22:48:18,778][52794] DAMAGECOUNT value on done: 17430.0 [2024-08-05 22:48:18,780][52794] Sum rewards: 20.094, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.596', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.102', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.290', 'weapon2': '1.334', 'weapon3': '1.848', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '17.000'} [2024-08-05 22:48:18,825][52650] Updated weights for policy 0, policy_version 10271 (0.0012) [2024-08-05 22:48:18,892][52820] DAMAGECOUNT value on done: 12616.0 [2024-08-05 22:48:18,893][52820] Sum rewards: 9.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.418', 'AMMO2': '0.004', 'AMMO4': '0.019', 'ARMOR': '0.028', 'AMMO3': '0.108', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '0.850', 'weapon2': '1.074', 'HITCOUNT': '1.130', 'weapon3': '2.110', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:18,924][52662] DAMAGECOUNT value on done: 15506.0 [2024-08-05 22:48:18,925][52662] Sum rewards: 25.045, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.111', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.312', 'WEAPON3': '0.750', 'weapon2': '1.168', 'ARMOR': '1.336', 'HITCOUNT': '1.550', 'weapon3': '2.286', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '20.000'} [2024-08-05 22:48:19,175][52668] DAMAGECOUNT value on done: 13640.0 [2024-08-05 22:48:19,176][52668] Sum rewards: 15.361, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.926', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'WEAPON5': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon4': '0.168', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '1.080', 'weapon2': '1.132', 'weapon3': '2.116', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '15.000'} [2024-08-05 22:48:19,444][52666] DAMAGECOUNT value on done: 13574.0 [2024-08-05 22:48:19,444][52666] Sum rewards: 15.871, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.395', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.278', 'WEAPON3': '0.600', 'ARMOR': '0.876', 'HITCOUNT': '1.390', 'weapon3': '1.428', 'weapon2': '1.452', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:20,046][52660] DAMAGECOUNT value on done: 13084.0 [2024-08-05 22:48:20,046][52660] Sum rewards: 8.213, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.766', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.264', 'ARMOR': '0.516', 'HITCOUNT': '0.810', 'WEAPON3': '1.000', 'weapon2': '1.342', 'weapon3': '2.064', 'DAMAGECOUNT': '2.556', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:21,405][52670] DAMAGECOUNT value on done: 11878.0 [2024-08-05 22:48:21,407][52670] Sum rewards: 12.792, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.968', 'weapon5': '0.002', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.023', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.578', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'ARMOR': '0.883', 'weapon2': '1.310', 'weapon3': '1.408', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:21,676][52668] DAMAGECOUNT value on done: 12824.0 [2024-08-05 22:48:21,676][52668] Sum rewards: 7.432, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.625', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.416', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '0.650', 'weapon2': '0.914', 'weapon3': '1.992', 'DAMAGECOUNT': '2.385', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:21,755][52794] DAMAGECOUNT value on done: 14840.0 [2024-08-05 22:48:21,756][52794] Sum rewards: 6.149, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.990', 'ARMOR': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.120', 'AMMO4': '0.140', 'weapon2': '0.380', 'WEAPON4': '0.450', 'HITCOUNT': '0.620', 'weapon4': '0.734', 'WEAPON3': '0.750', 'weapon3': '1.724', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:21,920][52662] DAMAGECOUNT value on done: 15983.0 [2024-08-05 22:48:21,921][52662] Sum rewards: 6.538, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.772', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'ARMOR': '0.096', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.588', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.040', 'weapon3': '2.012', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:22,444][52666] DAMAGECOUNT value on done: 11707.0 [2024-08-05 22:48:22,448][52666] Sum rewards: 8.561, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.004', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'ARMOR': '0.915', 'weapon3': '1.412', 'weapon2': '1.590', 'DAMAGECOUNT': '2.541', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:22,454][52820] DAMAGECOUNT value on done: 11670.0 [2024-08-05 22:48:22,458][52820] Sum rewards: 7.649, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.508', 'WEAPON3': '0.700', 'weapon2': '0.758', 'HITCOUNT': '0.780', 'weapon3': '1.550', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16828.3). Total num frames: 84205568. Throughput: 0: 4192.9. Samples: 21053990. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:48:22,794][52567] Avg episode reward: [(0, '12.474')] [2024-08-05 22:48:22,795][52614] Saving new best policy, reward=12.474! [2024-08-05 22:48:23,092][52660] DAMAGECOUNT value on done: 13800.0 [2024-08-05 22:48:23,094][52660] Sum rewards: 6.878, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.702', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.366', 'ARMOR': '0.502', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.164', 'weapon3': '1.492', 'DAMAGECOUNT': '2.388', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:23,973][52794] DAMAGECOUNT value on done: 17213.0 [2024-08-05 22:48:23,973][52794] Sum rewards: 13.079, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.320', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon7': '0.054', 'AMMO3': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.166', 'weapon4': '0.340', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon2': '1.218', 'weapon3': '1.324', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:24,059][52650] Updated weights for policy 0, policy_version 10281 (0.0012) [2024-08-05 22:48:24,154][52662] DAMAGECOUNT value on done: 17587.0 [2024-08-05 22:48:24,154][52662] Sum rewards: 16.863, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.320', 'AMMO2': '0.044', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'AMMO4': '0.222', 'weapon4': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon2': '1.286', 'weapon3': '1.488', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:24,950][52670] DAMAGECOUNT value on done: 12679.0 [2024-08-05 22:48:24,952][52670] Sum rewards: 15.083, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.683', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.280', 'WEAPON3': '0.500', 'ARMOR': '0.844', 'HITCOUNT': '0.940', 'weapon2': '1.238', 'weapon3': '1.306', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:25,017][52668] DAMAGECOUNT value on done: 12173.0 [2024-08-05 22:48:25,017][52668] Sum rewards: 15.719, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.831', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.109', 'WEAPON3': '0.700', 'ARMOR': '0.856', 'HITCOUNT': '1.020', 'weapon3': '1.392', 'weapon2': '1.700', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:25,940][52820] DAMAGECOUNT value on done: 12159.0 [2024-08-05 22:48:25,940][52820] Sum rewards: 10.013, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.308', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.020', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.274', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.262', 'weapon3': '1.840', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:25,984][52666] DAMAGECOUNT value on done: 13627.0 [2024-08-05 22:48:25,985][52666] Sum rewards: 8.998, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.809', 'AMMO4': '-0.080', 'AMMO2': '-0.016', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon5': '0.154', 'weapon4': '0.222', 'WEAPON3': '0.800', 'ARMOR': '0.940', 'HITCOUNT': '1.030', 'weapon2': '1.452', 'weapon3': '1.714', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:26,409][52660] DAMAGECOUNT value on done: 13711.0 [2024-08-05 22:48:26,410][52660] Sum rewards: 9.740, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.103', 'weapon4': '0.326', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'ARMOR': '0.929', 'weapon2': '1.370', 'weapon3': '1.462', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:26,543][52794] DAMAGECOUNT value on done: 15128.0 [2024-08-05 22:48:26,544][52794] Sum rewards: 3.172, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.354', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.129', 'HITCOUNT': '0.460', 'WEAPON3': '0.750', 'ARMOR': '1.325', 'DAMAGECOUNT': '1.491', 'weapon2': '1.592', 'weapon3': '1.706', 'FRAGCOUNT': '4.000'} [2024-08-05 22:48:26,811][52662] DAMAGECOUNT value on done: 16040.0 [2024-08-05 22:48:26,813][52662] Sum rewards: 16.558, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.502', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.240', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon2': '1.304', 'ARMOR': '1.316', 'weapon3': '1.582', 'DAMAGECOUNT': '4.362', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 16793.6, 300 sec: 16856.1). Total num frames: 84287488. Throughput: 0: 4182.9. Samples: 21078960. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:48:27,794][52567] Avg episode reward: [(0, '12.393')] [2024-08-05 22:48:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010289_84287488.pth... [2024-08-05 22:48:27,895][52668] DAMAGECOUNT value on done: 13670.0 [2024-08-05 22:48:27,897][52668] Sum rewards: 18.326, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.877', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.012', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.560', 'WEAPON3': '0.650', 'weapon2': '0.966', 'HITCOUNT': '0.970', 'weapon3': '1.834', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '15.000'} [2024-08-05 22:48:27,920][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000009797_80257024.pth [2024-08-05 22:48:28,640][52670] DAMAGECOUNT value on done: 13138.0 [2024-08-05 22:48:28,641][52670] Sum rewards: 14.409, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.104', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.041', 'ARMOR': '0.056', 'weapon4': '0.122', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.044', 'HITCOUNT': '1.180', 'weapon3': '2.334', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '15.000'} [2024-08-05 22:48:28,825][52660] DAMAGECOUNT value on done: 14678.0 [2024-08-05 22:48:28,826][52660] Sum rewards: 17.217, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.805', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.088', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.264', 'ARMOR': '0.510', 'WEAPON3': '0.700', 'weapon2': '1.258', 'HITCOUNT': '1.280', 'weapon3': '1.952', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:28,950][52650] Updated weights for policy 0, policy_version 10291 (0.0029) [2024-08-05 22:48:29,234][52794] DAMAGECOUNT value on done: 15785.0 [2024-08-05 22:48:29,239][52794] Sum rewards: 11.850, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.885', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO4': '0.022', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.364', 'ARMOR': '0.475', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '0.996', 'weapon3': '1.800', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:29,421][52820] DAMAGECOUNT value on done: 13847.0 [2024-08-05 22:48:29,421][52820] Sum rewards: 11.853, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.158', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.176', 'weapon4': '0.252', 'WEAPON3': '0.350', 'HITCOUNT': '0.790', 'weapon3': '1.110', 'weapon2': '1.218', 'ARMOR': '1.247', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:29,543][52662] DAMAGECOUNT value on done: 16644.0 [2024-08-05 22:48:29,543][52662] Sum rewards: 6.426, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.444', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.028', 'AMMO4': '0.032', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'weapon4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'weapon2': '1.256', 'weapon3': '1.688', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '5.500'} [2024-08-05 22:48:29,619][52666] DAMAGECOUNT value on done: 13136.0 [2024-08-05 22:48:29,620][52666] Sum rewards: 12.207, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.636', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.018', 'weapon7': '0.052', 'AMMO3': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.910', 'ARMOR': '0.957', 'weapon3': '1.186', 'weapon2': '1.262', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:30,750][52668] DAMAGECOUNT value on done: 13233.0 [2024-08-05 22:48:30,755][52668] Sum rewards: 18.580, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.835', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.012', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.252', 'ARMOR': '0.467', 'WEAPON3': '0.600', 'HITCOUNT': '1.370', 'weapon2': '1.532', 'weapon3': '1.662', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '14.000'} [2024-08-05 22:48:31,699][52660] DAMAGECOUNT value on done: 14825.0 [2024-08-05 22:48:31,699][52660] Sum rewards: 9.098, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO2': '0.002', 'weapon5': '0.004', 'AMMO4': '0.008', 'AMMO5': '0.010', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.298', 'ARMOR': '0.481', 'WEAPON3': '0.500', 'HITCOUNT': '1.020', 'weapon2': '1.084', 'weapon3': '1.346', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '7.500'} [2024-08-05 22:48:31,709][52794] DAMAGECOUNT value on done: 13520.0 [2024-08-05 22:48:31,709][52794] Sum rewards: 11.056, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.040', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.146', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'weapon2': '1.166', 'weapon3': '1.218', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:31,946][52662] DAMAGECOUNT value on done: 17940.0 [2024-08-05 22:48:31,947][52662] Sum rewards: 13.773, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.680', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.140', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.622', 'weapon3': '1.752', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:32,172][52670] DAMAGECOUNT value on done: 11608.0 [2024-08-05 22:48:32,172][52670] Sum rewards: 13.919, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.641', 'AMMO2': '0.027', 'AMMO3': '0.098', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.492', 'WEAPON3': '0.700', 'HITCOUNT': '0.720', 'weapon2': '1.114', 'weapon3': '1.856', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16828.3). Total num frames: 84369408. Throughput: 0: 4184.0. Samples: 21091560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:48:32,794][52567] Avg episode reward: [(0, '12.476')] [2024-08-05 22:48:32,795][52614] Saving new best policy, reward=12.476! [2024-08-05 22:48:32,885][52820] DAMAGECOUNT value on done: 11274.0 [2024-08-05 22:48:32,886][52820] Sum rewards: 14.743, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.264', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO3': '0.064', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.326', 'WEAPON3': '0.400', 'HITCOUNT': '0.990', 'weapon2': '1.074', 'weapon3': '1.096', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:33,069][52666] DAMAGECOUNT value on done: 11406.0 [2024-08-05 22:48:33,069][52666] Sum rewards: 16.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.392', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.458', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.190', 'ARMOR': '1.275', 'weapon3': '1.824', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '14.000'} [2024-08-05 22:48:33,746][52650] Updated weights for policy 0, policy_version 10301 (0.0011) [2024-08-05 22:48:33,838][52668] DAMAGECOUNT value on done: 14868.0 [2024-08-05 22:48:33,840][52668] Sum rewards: 19.887, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.113', 'weapon4': '0.118', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'HITCOUNT': '1.140', 'weapon2': '1.308', 'weapon3': '1.898', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '17.000'} [2024-08-05 22:48:34,720][52660] DAMAGECOUNT value on done: 14507.0 [2024-08-05 22:48:34,721][52660] Sum rewards: 12.934, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.006', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'weapon4': '0.526', 'ARMOR': '1.004', 'WEAPON3': '1.050', 'weapon2': '1.076', 'HITCOUNT': '1.090', 'weapon3': '1.788', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:35,083][52794] DAMAGECOUNT value on done: 17891.0 [2024-08-05 22:48:35,084][52794] Sum rewards: 18.235, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.174', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.474', 'WEAPON3': '0.700', 'ARMOR': '0.901', 'weapon2': '1.044', 'HITCOUNT': '1.410', 'weapon3': '1.744', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:35,208][52670] DAMAGECOUNT value on done: 14395.0 [2024-08-05 22:48:35,211][52670] Sum rewards: 12.662, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.466', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'ARMOR': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '1.330', 'weapon2': '1.752', 'weapon3': '2.070', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:35,254][52662] DAMAGECOUNT value on done: 17053.0 [2024-08-05 22:48:35,255][52662] Sum rewards: 17.412, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.913', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'weapon4': '0.190', 'WEAPON3': '0.800', 'ARMOR': '0.890', 'weapon2': '1.402', 'HITCOUNT': '1.620', 'weapon3': '1.750', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '15.000'} [2024-08-05 22:48:36,045][52666] DAMAGECOUNT value on done: 11792.0 [2024-08-05 22:48:36,046][52666] Sum rewards: 10.418, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.256', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon7': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.140', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'ARMOR': '0.420', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '1.620', 'weapon3': '2.028', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:36,187][52820] DAMAGECOUNT value on done: 12827.0 [2024-08-05 22:48:36,187][52820] Sum rewards: 15.829, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.152', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.064', 'weapon3': '1.954', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:36,273][52668] DAMAGECOUNT value on done: 14824.0 [2024-08-05 22:48:36,273][52668] Sum rewards: 10.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.432', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.354', 'WEAPON3': '0.750', 'ARMOR': '0.980', 'HITCOUNT': '1.020', 'weapon2': '1.424', 'weapon3': '1.614', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:37,326][52660] DAMAGECOUNT value on done: 14793.0 [2024-08-05 22:48:37,326][52660] Sum rewards: 15.308, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.670', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.111', 'WEAPON3': '0.750', 'ARMOR': '0.876', 'HITCOUNT': '1.230', 'weapon3': '1.770', 'weapon2': '1.846', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:37,619][52794] DAMAGECOUNT value on done: 15409.0 [2024-08-05 22:48:37,619][52794] Sum rewards: 10.795, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.915', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.117', 'ARMOR': '0.471', 'WEAPON3': '0.750', 'HITCOUNT': '0.810', 'weapon2': '1.648', 'weapon3': '1.790', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:37,728][52662] DAMAGECOUNT value on done: 18157.0 [2024-08-05 22:48:37,734][52662] Sum rewards: 23.874, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.285', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.078', 'AMMO3': '0.082', 'WEAPON3': '0.550', 'ARMOR': '0.894', 'HITCOUNT': '1.440', 'weapon3': '1.638', 'weapon2': '1.904', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '18.000'} [2024-08-05 22:48:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16856.1). Total num frames: 84459520. Throughput: 0: 4177.8. Samples: 21116540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:48:37,794][52567] Avg episode reward: [(0, '12.785')] [2024-08-05 22:48:37,798][52614] Saving new best policy, reward=12.785! [2024-08-05 22:48:38,300][52670] DAMAGECOUNT value on done: 14130.0 [2024-08-05 22:48:38,301][52670] Sum rewards: 9.398, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.763', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.053', 'WEAPON3': '0.450', 'HITCOUNT': '0.770', 'weapon2': '1.108', 'weapon3': '1.114', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:38,582][52650] Updated weights for policy 0, policy_version 10311 (0.0021) [2024-08-05 22:48:38,705][52668] DAMAGECOUNT value on done: 13856.0 [2024-08-05 22:48:38,705][52668] Sum rewards: 10.956, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.769', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'weapon7': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.268', 'ARMOR': '0.836', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.148', 'weapon3': '1.994', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:39,149][52666] DAMAGECOUNT value on done: 12899.0 [2024-08-05 22:48:39,150][52666] Sum rewards: 7.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.795', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon4': '0.270', 'ARMOR': '0.460', 'weapon2': '0.976', 'HITCOUNT': '1.070', 'WEAPON3': '1.200', 'weapon3': '2.400', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:39,642][52660] DAMAGECOUNT value on done: 13961.0 [2024-08-05 22:48:39,642][52660] Sum rewards: 12.599, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.630', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.050', 'weapon7': '0.056', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.450', 'ARMOR': '0.452', 'HITCOUNT': '0.780', 'weapon3': '1.178', 'weapon2': '1.180', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:39,647][52820] DAMAGECOUNT value on done: 13991.0 [2024-08-05 22:48:39,650][52820] Sum rewards: 9.142, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.282', 'AMMO5': '0.007', 'weapon4': '0.008', 'AMMO2': '0.014', 'weapon5': '0.022', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.966', 'HITCOUNT': '1.020', 'WEAPON3': '1.050', 'weapon3': '2.410', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:39,789][52647] DAMAGECOUNT value on done: 15976.0 [2024-08-05 22:48:39,790][52647] Sum rewards: 13.357, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.597', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.078', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'weapon2': '1.330', 'weapon3': '1.922', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:40,563][52794] DAMAGECOUNT value on done: 16041.0 [2024-08-05 22:48:40,563][52794] Sum rewards: 14.135, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.686', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.032', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'ARMOR': '1.300', 'weapon3': '1.404', 'weapon2': '1.904', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:40,650][52662] DAMAGECOUNT value on done: 15490.0 [2024-08-05 22:48:40,654][52662] Sum rewards: 16.147, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.152', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'ARMOR': '1.365', 'weapon2': '1.498', 'weapon3': '1.556', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:41,139][52670] DAMAGECOUNT value on done: 14641.0 [2024-08-05 22:48:41,140][52670] Sum rewards: 9.127, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.951', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.013', 'weapon5': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.082', 'WEAPON5': '0.250', 'ARMOR': '0.477', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'weapon2': '1.190', 'weapon3': '1.434', 'DAMAGECOUNT': '2.586', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:41,732][52666] DAMAGECOUNT value on done: 12812.0 [2024-08-05 22:48:41,733][52666] Sum rewards: 9.882, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.065', 'WEAPON4': '0.200', 'HITCOUNT': '0.430', 'WEAPON3': '0.500', 'ARMOR': '0.530', 'weapon4': '0.536', 'weapon2': '0.820', 'weapon3': '1.352', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '8.000'} [2024-08-05 22:48:42,483][52660] DAMAGECOUNT value on done: 14346.0 [2024-08-05 22:48:42,483][52660] Sum rewards: 17.305, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.918', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.264', 'ARMOR': '0.509', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.168', 'weapon3': '1.660', 'DAMAGECOUNT': '3.471', 'FRAGCOUNT': '15.000'} [2024-08-05 22:48:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16828.3). Total num frames: 84533248. Throughput: 0: 4162.7. Samples: 21141430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:48:42,794][52567] Avg episode reward: [(0, '12.832')] [2024-08-05 22:48:42,795][52614] Saving new best policy, reward=12.832! [2024-08-05 22:48:43,112][52820] DAMAGECOUNT value on done: 12217.0 [2024-08-05 22:48:43,113][52820] Sum rewards: 6.870, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.931', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.865', 'HITCOUNT': '0.910', 'weapon2': '1.162', 'weapon3': '1.484', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:43,255][52647] DAMAGECOUNT value on done: 13195.0 [2024-08-05 22:48:43,255][52647] Sum rewards: 10.248, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.132', 'HEALTH': '0.466', 'WEAPON3': '0.750', 'ARMOR': '0.823', 'HITCOUNT': '0.860', 'weapon2': '1.246', 'weapon3': '1.990', 'DAMAGECOUNT': '2.922', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:43,410][52794] DAMAGECOUNT value on done: 16793.0 [2024-08-05 22:48:43,410][52794] Sum rewards: 20.817, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.398', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.055', 'AMMO3': '0.122', 'weapon5': '0.148', 'AMMO4': '0.170', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.096', 'HITCOUNT': '1.240', 'weapon3': '1.912', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '17.000'} [2024-08-05 22:48:43,502][52662] DAMAGECOUNT value on done: 16765.0 [2024-08-05 22:48:43,503][52662] Sum rewards: 14.940, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.119', 'HEALTH': '0.304', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.240', 'weapon2': '1.366', 'weapon3': '2.036', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:43,625][52650] Updated weights for policy 0, policy_version 10321 (0.0024) [2024-08-05 22:48:44,034][52670] DAMAGECOUNT value on done: 14759.0 [2024-08-05 22:48:44,037][52670] Sum rewards: 13.762, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.048', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.384', 'WEAPON3': '0.450', 'HITCOUNT': '0.910', 'weapon3': '1.416', 'weapon2': '1.776', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:44,954][52666] DAMAGECOUNT value on done: 12972.0 [2024-08-05 22:48:44,956][52666] Sum rewards: 6.917, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.566', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.140', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'weapon2': '1.212', 'weapon3': '2.002', 'DAMAGECOUNT': '3.189', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:45,641][52660] DAMAGECOUNT value on done: 14209.0 [2024-08-05 22:48:45,642][52660] Sum rewards: 15.124, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.998', 'weapon4': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.148', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.120', 'weapon2': '1.252', 'weapon3': '1.996', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:45,822][52794] DAMAGECOUNT value on done: 16469.0 [2024-08-05 22:48:45,823][52794] Sum rewards: 23.089, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.074', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.118', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.496', 'HITCOUNT': '1.650', 'weapon2': '1.662', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '17.000'} [2024-08-05 22:48:45,910][52662] DAMAGECOUNT value on done: 16827.0 [2024-08-05 22:48:45,912][52662] Sum rewards: 9.352, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.807', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO3': '0.094', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon4': '0.644', 'HITCOUNT': '0.840', 'ARMOR': '0.900', 'weapon2': '1.114', 'weapon3': '1.562', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:46,081][52647] DAMAGECOUNT value on done: 16101.0 [2024-08-05 22:48:46,081][52647] Sum rewards: 11.410, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.016', 'HEALTH': '0.030', 'AMMO4': '0.046', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.338', 'WEAPON3': '0.350', 'ARMOR': '0.515', 'HITCOUNT': '0.640', 'weapon2': '0.826', 'weapon3': '1.214', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:47,243][52670] DAMAGECOUNT value on done: 13331.0 [2024-08-05 22:48:47,247][52670] Sum rewards: 7.534, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.708', 'AMMO2': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.026', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON3': '0.550', 'HITCOUNT': '0.570', 'weapon3': '1.492', 'weapon2': '1.572', 'DAMAGECOUNT': '2.211', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:47,455][52669] DAMAGECOUNT value on done: 14277.0 [2024-08-05 22:48:47,458][52669] Sum rewards: 13.419, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.233', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.268', 'WEAPON3': '0.700', 'ARMOR': '0.940', 'HITCOUNT': '1.080', 'weapon2': '1.508', 'weapon3': '1.848', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:47,794][52567] Fps is (10 sec: 15564.6, 60 sec: 16657.1, 300 sec: 16800.5). Total num frames: 84615168. Throughput: 0: 4169.8. Samples: 21154070. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:48:47,794][52567] Avg episode reward: [(0, '12.845')] [2024-08-05 22:48:47,797][52614] Saving new best policy, reward=12.845! [2024-08-05 22:48:47,964][52666] DAMAGECOUNT value on done: 13396.0 [2024-08-05 22:48:47,966][52666] Sum rewards: 13.851, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.466', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'weapon4': '0.352', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'ARMOR': '0.992', 'weapon2': '1.174', 'weapon3': '2.194', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:48,453][52650] Updated weights for policy 0, policy_version 10331 (0.0024) [2024-08-05 22:48:48,478][52794] DAMAGECOUNT value on done: 17386.0 [2024-08-05 22:48:48,479][52794] Sum rewards: 9.092, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.118', 'HEALTH': '0.560', 'WEAPON3': '0.650', 'ARMOR': '0.804', 'HITCOUNT': '0.890', 'weapon2': '1.306', 'weapon3': '2.012', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:48,584][52662] DAMAGECOUNT value on done: 15249.0 [2024-08-05 22:48:48,584][52662] Sum rewards: 12.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.230', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.012', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.408', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '1.120', 'weapon3': '1.932', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:48,675][52647] DAMAGECOUNT value on done: 12242.0 [2024-08-05 22:48:48,676][52647] Sum rewards: 16.878, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.993', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.272', 'ARMOR': '0.470', 'weapon2': '0.660', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon3': '1.832', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '14.000'} [2024-08-05 22:48:50,434][52670] DAMAGECOUNT value on done: 12114.0 [2024-08-05 22:48:50,436][52670] Sum rewards: 20.408, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.986', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.912', 'HITCOUNT': '1.330', 'weapon2': '1.374', 'weapon3': '1.750', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '16.000'} [2024-08-05 22:48:50,519][52669] DAMAGECOUNT value on done: 13999.0 [2024-08-05 22:48:50,519][52669] Sum rewards: 6.368, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.782', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.014', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'HITCOUNT': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.254', 'ARMOR': '1.424', 'weapon3': '2.198', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:51,275][52666] DAMAGECOUNT value on done: 11605.0 [2024-08-05 22:48:51,275][52666] Sum rewards: 13.835, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.988', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.086', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.594', 'WEAPON3': '0.650', 'HITCOUNT': '1.090', 'weapon2': '1.334', 'ARMOR': '1.375', 'weapon3': '1.730', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:51,443][52794] DAMAGECOUNT value on done: 15940.0 [2024-08-05 22:48:51,451][52794] Sum rewards: 13.668, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.213', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.248', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'weapon2': '1.002', 'ARMOR': '1.236', 'weapon3': '2.012', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '11.000'} [2024-08-05 22:48:51,468][52662] DAMAGECOUNT value on done: 16700.0 [2024-08-05 22:48:51,468][52662] Sum rewards: 24.053, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.340', 'AMMO2': '0.011', 'weapon7': '0.054', 'AMMO4': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'ARMOR': '1.417', 'weapon2': '1.564', 'weapon3': '1.966', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '19.000'} [2024-08-05 22:48:51,607][52647] DAMAGECOUNT value on done: 14312.0 [2024-08-05 22:48:51,609][52647] Sum rewards: 10.636, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.776', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'ARMOR': '0.930', 'weapon2': '1.010', 'weapon3': '1.326', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:52,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 84697088. Throughput: 0: 4150.2. Samples: 21178550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:48:52,795][52567] Avg episode reward: [(0, '12.980')] [2024-08-05 22:48:52,821][52614] Saving new best policy, reward=12.980! [2024-08-05 22:48:53,626][52650] Updated weights for policy 0, policy_version 10341 (0.0013) [2024-08-05 22:48:53,674][52669] DAMAGECOUNT value on done: 14233.0 [2024-08-05 22:48:53,674][52669] Sum rewards: 7.129, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.512', 'AMMO2': '0.015', 'AMMO3': '0.069', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.198', 'WEAPON3': '0.400', 'HITCOUNT': '0.720', 'ARMOR': '0.800', 'weapon3': '1.046', 'weapon2': '1.224', 'DAMAGECOUNT': '2.244', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:53,713][52670] DAMAGECOUNT value on done: 13780.0 [2024-08-05 22:48:53,714][52670] Sum rewards: 16.265, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.332', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.122', 'weapon4': '0.438', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.270', 'ARMOR': '1.347', 'weapon3': '1.618', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:54,140][52794] DAMAGECOUNT value on done: 16695.0 [2024-08-05 22:48:54,141][52794] Sum rewards: 9.005, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.015', 'AMMO5': '0.003', 'weapon5': '0.006', 'weapon7': '0.008', 'AMMO2': '0.015', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.360', 'WEAPON3': '0.500', 'HITCOUNT': '0.900', 'weapon2': '1.438', 'weapon3': '1.858', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '6.000'} [2024-08-05 22:48:54,150][52662] DAMAGECOUNT value on done: 16222.0 [2024-08-05 22:48:54,150][52662] Sum rewards: 10.326, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.604', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'ARMOR': '0.440', 'weapon4': '0.444', 'HITCOUNT': '0.840', 'WEAPON3': '0.950', 'weapon2': '1.020', 'weapon3': '1.852', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:54,414][52666] DAMAGECOUNT value on done: 14059.0 [2024-08-05 22:48:54,415][52666] Sum rewards: 19.355, reward structure: {'DEATHCOUNT': '-8.250', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.125', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HEALTH': '0.300', 'weapon2': '0.594', 'WEAPON3': '0.750', 'weapon4': '0.836', 'ARMOR': '0.952', 'HITCOUNT': '1.210', 'weapon3': '2.064', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '16.000'} [2024-08-05 22:48:54,494][52647] DAMAGECOUNT value on done: 14206.0 [2024-08-05 22:48:54,495][52647] Sum rewards: 14.851, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.070', 'HEALTH': '0.182', 'WEAPON3': '0.450', 'HITCOUNT': '1.010', 'ARMOR': '1.300', 'weapon3': '1.558', 'weapon2': '1.788', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '10.000'} [2024-08-05 22:48:56,680][52670] DAMAGECOUNT value on done: 13001.0 [2024-08-05 22:48:56,682][52670] Sum rewards: 7.535, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.305', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.044', 'AMMO3': '0.114', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.496', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'weapon4': '0.756', 'weapon2': '0.846', 'weapon3': '1.916', 'DAMAGECOUNT': '2.796', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:56,698][52669] DAMAGECOUNT value on done: 15900.0 [2024-08-05 22:48:56,710][52669] Sum rewards: 12.785, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.165', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO4': '0.029', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.394', 'ARMOR': '0.454', 'WEAPON3': '0.850', 'HITCOUNT': '1.120', 'weapon2': '1.448', 'weapon3': '1.848', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:56,750][52794] DAMAGECOUNT value on done: 17953.0 [2024-08-05 22:48:56,750][52794] Sum rewards: 16.323, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.302', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.064', 'weapon5': '0.080', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'ARMOR': '0.424', 'WEAPON3': '0.750', 'HITCOUNT': '1.350', 'weapon2': '1.578', 'weapon3': '1.888', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '13.000'} [2024-08-05 22:48:56,782][52662] DAMAGECOUNT value on done: 16057.0 [2024-08-05 22:48:56,782][52662] Sum rewards: 14.194, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.813', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.310', 'ARMOR': '0.440', 'weapon2': '1.010', 'WEAPON3': '1.150', 'HITCOUNT': '1.350', 'weapon3': '2.432', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '14.000'} [2024-08-05 22:48:57,078][52647] DAMAGECOUNT value on done: 13584.0 [2024-08-05 22:48:57,078][52647] Sum rewards: 9.511, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.024', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '0.990', 'ARMOR': '1.328', 'weapon2': '1.730', 'weapon3': '1.800', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '7.000'} [2024-08-05 22:48:57,311][52666] DAMAGECOUNT value on done: 14836.0 [2024-08-05 22:48:57,312][52666] Sum rewards: 13.869, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.028', 'HEALTH': '0.036', 'AMMO3': '0.076', 'weapon7': '0.138', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.500', 'weapon4': '0.702', 'weapon2': '0.872', 'HITCOUNT': '0.920', 'ARMOR': '1.403', 'weapon3': '1.530', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16657.0, 300 sec: 16828.3). Total num frames: 84787200. Throughput: 0: 4154.6. Samples: 21203740. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:48:57,795][52567] Avg episode reward: [(0, '12.980')] [2024-08-05 22:48:58,452][52650] Updated weights for policy 0, policy_version 10351 (0.0019) [2024-08-05 22:48:59,136][52669] DAMAGECOUNT value on done: 15050.0 [2024-08-05 22:48:59,137][52669] Sum rewards: 16.750, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.008', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.268', 'WEAPON3': '0.700', 'ARMOR': '0.944', 'HITCOUNT': '1.430', 'weapon2': '1.662', 'weapon3': '1.788', 'DAMAGECOUNT': '5.511', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:59,480][52794] DAMAGECOUNT value on done: 16108.0 [2024-08-05 22:48:59,481][52794] Sum rewards: 9.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.116', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.452', 'weapon2': '0.902', 'HITCOUNT': '1.020', 'WEAPON3': '1.200', 'ARMOR': '1.400', 'weapon3': '2.234', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '12.000'} [2024-08-05 22:48:59,493][52662] DAMAGECOUNT value on done: 17515.0 [2024-08-05 22:48:59,493][52662] Sum rewards: 8.550, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.130', 'WEAPON3': '0.700', 'ARMOR': '0.820', 'HITCOUNT': '0.890', 'weapon2': '1.488', 'weapon3': '1.656', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '9.000'} [2024-08-05 22:48:59,571][52670] DAMAGECOUNT value on done: 13169.0 [2024-08-05 22:48:59,575][52670] Sum rewards: 5.913, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.050', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.048', 'WEAPON3': '0.300', 'HITCOUNT': '0.740', 'weapon3': '0.746', 'weapon2': '1.476', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '4.000'} [2024-08-05 22:49:00,090][52647] DAMAGECOUNT value on done: 14651.0 [2024-08-05 22:49:00,090][52647] Sum rewards: 14.284, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.748', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.013', 'weapon5': '0.020', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'ARMOR': '0.465', 'WEAPON3': '0.800', 'HITCOUNT': '1.170', 'weapon2': '1.388', 'weapon3': '1.618', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:00,324][52666] DAMAGECOUNT value on done: 12817.0 [2024-08-05 22:49:00,324][52666] Sum rewards: 7.006, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.276', 'HITCOUNT': '0.580', 'WEAPON3': '0.800', 'weapon2': '1.162', 'ARMOR': '1.373', 'DAMAGECOUNT': '1.914', 'weapon3': '1.940', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:01,411][52665] DAMAGECOUNT value on done: 12898.0 [2024-08-05 22:49:01,413][52665] Sum rewards: 11.498, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.050', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.480', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon2': '0.850', 'weapon3': '1.888', 'DAMAGECOUNT': '2.532', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:02,203][52794] DAMAGECOUNT value on done: 16007.0 [2024-08-05 22:49:02,206][52794] Sum rewards: 12.965, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.750', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.147', 'weapon4': '0.216', 'ARMOR': '0.536', 'WEAPON3': '0.900', 'weapon2': '1.008', 'HITCOUNT': '1.100', 'weapon3': '2.190', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:02,215][52662] DAMAGECOUNT value on done: 16427.0 [2024-08-05 22:49:02,217][52662] Sum rewards: 17.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.007', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.147', 'WEAPON3': '0.850', 'ARMOR': '0.895', 'HITCOUNT': '1.380', 'weapon2': '1.638', 'weapon3': '2.134', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '15.000'} [2024-08-05 22:49:02,329][52669] DAMAGECOUNT value on done: 14897.0 [2024-08-05 22:49:02,330][52669] Sum rewards: 12.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.356', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'WEAPON3': '0.750', 'HITCOUNT': '1.310', 'ARMOR': '1.348', 'weapon2': '1.766', 'weapon3': '1.786', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '9.000'} [2024-08-05 22:49:02,391][52670] DAMAGECOUNT value on done: 13671.0 [2024-08-05 22:49:02,393][52670] Sum rewards: 12.145, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.726', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.022', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon2': '0.414', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'ARMOR': '0.848', 'weapon4': '0.962', 'weapon3': '1.384', 'DAMAGECOUNT': '2.904', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.5, 300 sec: 16800.5). Total num frames: 84869120. Throughput: 0: 4161.3. Samples: 21216570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:49:02,795][52567] Avg episode reward: [(0, '12.653')] [2024-08-05 22:49:02,890][52647] DAMAGECOUNT value on done: 17069.0 [2024-08-05 22:49:02,893][52647] Sum rewards: 18.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon4': '0.206', 'ARMOR': '0.913', 'WEAPON3': '1.100', 'weapon2': '1.274', 'HITCOUNT': '1.520', 'weapon3': '2.100', 'DAMAGECOUNT': '5.913', 'FRAGCOUNT': '17.000'} [2024-08-05 22:49:03,141][52650] Updated weights for policy 0, policy_version 10361 (0.0010) [2024-08-05 22:49:04,116][52665] DAMAGECOUNT value on done: 13323.0 [2024-08-05 22:49:04,117][52665] Sum rewards: 10.258, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'HEALTH': '0.114', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '0.780', 'weapon2': '1.286', 'weapon3': '1.404', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:04,953][52794] DAMAGECOUNT value on done: 16340.0 [2024-08-05 22:49:04,954][52794] Sum rewards: 15.399, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.708', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.094', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.947', 'HITCOUNT': '1.230', 'weapon2': '1.572', 'weapon3': '1.782', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:04,987][52662] DAMAGECOUNT value on done: 17373.0 [2024-08-05 22:49:04,987][52662] Sum rewards: 17.938, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.018', 'AMMO3': '0.084', 'AMMO4': '0.089', 'HEALTH': '0.237', 'WEAPON3': '0.500', 'HITCOUNT': '1.130', 'ARMOR': '1.273', 'weapon3': '1.612', 'weapon2': '2.092', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:04,989][52669] DAMAGECOUNT value on done: 15196.0 [2024-08-05 22:49:04,991][52669] Sum rewards: 11.758, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.524', 'AMMO2': '0.015', 'ARMOR': '0.070', 'AMMO4': '0.076', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.432', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon2': '1.460', 'weapon3': '1.528', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '9.000'} [2024-08-05 22:49:05,759][52647] DAMAGECOUNT value on done: 14575.0 [2024-08-05 22:49:05,759][52647] Sum rewards: 15.418, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.008', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.815', 'HITCOUNT': '1.260', 'weapon2': '1.524', 'weapon3': '1.772', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:07,141][52665] DAMAGECOUNT value on done: 15189.0 [2024-08-05 22:49:07,142][52665] Sum rewards: 17.186, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon7': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.079', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.456', 'ARMOR': '0.471', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'weapon3': '1.426', 'weapon2': '1.432', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:07,552][52669] DAMAGECOUNT value on done: 14054.0 [2024-08-05 22:49:07,553][52669] Sum rewards: 17.686, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.157', 'AMMO2': '0.022', 'AMMO3': '0.088', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'weapon4': '0.466', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon2': '1.254', 'weapon3': '1.598', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '14.000'} [2024-08-05 22:49:07,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16657.1, 300 sec: 16828.3). Total num frames: 84951040. Throughput: 0: 4175.1. Samples: 21241870. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:49:07,794][52567] Avg episode reward: [(0, '13.090')] [2024-08-05 22:49:07,797][52614] Saving new best policy, reward=13.090! [2024-08-05 22:49:08,069][52650] Updated weights for policy 0, policy_version 10371 (0.0013) [2024-08-05 22:49:08,217][52662] DAMAGECOUNT value on done: 15976.0 [2024-08-05 22:49:08,217][52662] Sum rewards: 5.954, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.156', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'HITCOUNT': '0.650', 'WEAPON3': '0.800', 'ARMOR': '0.934', 'weapon2': '1.094', 'weapon3': '1.418', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '8.000'} [2024-08-05 22:49:08,564][52647] DAMAGECOUNT value on done: 14789.0 [2024-08-05 22:49:08,567][52647] Sum rewards: 11.811, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.629', 'AMMO2': '0.011', 'weapon4': '0.028', 'ARMOR': '0.036', 'AMMO4': '0.057', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.492', 'weapon3': '1.692', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:10,446][52665] DAMAGECOUNT value on done: 14629.0 [2024-08-05 22:49:10,448][52665] Sum rewards: 13.851, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO2': '0.019', 'ARMOR': '0.036', 'weapon4': '0.062', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.938', 'WEAPON3': '1.050', 'HITCOUNT': '1.380', 'weapon3': '2.798', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:10,835][52662] DAMAGECOUNT value on done: 17118.0 [2024-08-05 22:49:10,836][52662] Sum rewards: 17.892, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.350', 'AMMO4': '-0.113', 'AMMO2': '-0.023', 'AMMO5': '0.007', 'weapon5': '0.068', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.910', 'weapon3': '1.332', 'HITCOUNT': '1.410', 'weapon2': '1.800', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:10,999][52669] DAMAGECOUNT value on done: 13446.0 [2024-08-05 22:49:11,001][52669] Sum rewards: -0.433, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.382', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon7': '0.068', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'HITCOUNT': '0.570', 'weapon4': '0.680', 'WEAPON3': '0.750', 'weapon2': '1.124', 'weapon3': '1.500', 'DAMAGECOUNT': '1.728', 'FRAGCOUNT': '2.000'} [2024-08-05 22:49:11,326][52647] DAMAGECOUNT value on done: 13207.0 [2024-08-05 22:49:11,326][52647] Sum rewards: 6.107, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon4': '0.118', 'AMMO4': '0.131', 'WEAPON3': '0.300', 'HEALTH': '0.346', 'ARMOR': '0.400', 'HITCOUNT': '0.760', 'weapon3': '1.072', 'weapon2': '1.556', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '3.000'} [2024-08-05 22:49:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 85032960. Throughput: 0: 4183.5. Samples: 21267220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:49:12,795][52567] Avg episode reward: [(0, '12.880')] [2024-08-05 22:49:13,046][52650] Updated weights for policy 0, policy_version 10381 (0.0026) [2024-08-05 22:49:13,637][52665] DAMAGECOUNT value on done: 13653.0 [2024-08-05 22:49:13,639][52665] Sum rewards: 14.193, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.976', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.310', 'ARMOR': '0.444', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.460', 'weapon3': '1.634', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:13,658][52669] DAMAGECOUNT value on done: 14084.0 [2024-08-05 22:49:13,659][52669] Sum rewards: 17.144, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.308', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.092', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.440', 'weapon2': '1.546', 'weapon3': '1.590', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:14,554][52647] DAMAGECOUNT value on done: 14191.0 [2024-08-05 22:49:14,557][52647] Sum rewards: 17.662, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.328', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.062', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.536', 'weapon2': '0.996', 'HITCOUNT': '1.060', 'weapon3': '1.380', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:16,084][52665] DAMAGECOUNT value on done: 13794.0 [2024-08-05 22:49:16,084][52665] Sum rewards: 12.500, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.042', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon7': '0.070', 'AMMO3': '0.089', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'weapon4': '0.558', 'HITCOUNT': '0.650', 'weapon2': '0.918', 'ARMOR': '0.982', 'weapon3': '1.464', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:16,261][52669] DAMAGECOUNT value on done: 13770.0 [2024-08-05 22:49:16,262][52669] Sum rewards: 7.234, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.954', 'weapon5': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'AMMO3': '0.101', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.532', 'WEAPON3': '0.650', 'HITCOUNT': '0.680', 'ARMOR': '0.889', 'weapon2': '1.014', 'weapon3': '1.598', 'DAMAGECOUNT': '2.409', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:17,365][52647] DAMAGECOUNT value on done: 12931.0 [2024-08-05 22:49:17,367][52647] Sum rewards: 8.356, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.782', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.088', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon3': '1.226', 'ARMOR': '1.247', 'weapon2': '1.332', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16772.8). Total num frames: 85114880. Throughput: 0: 4181.6. Samples: 21279730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:49:17,794][52567] Avg episode reward: [(0, '12.982')] [2024-08-05 22:49:18,055][52650] Updated weights for policy 0, policy_version 10391 (0.0045) [2024-08-05 22:49:18,556][52663] DAMAGECOUNT value on done: 14959.0 [2024-08-05 22:49:18,556][52663] Sum rewards: 9.846, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.008', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.324', 'WEAPON3': '0.600', 'ARMOR': '0.945', 'HITCOUNT': '1.000', 'weapon2': '1.332', 'weapon3': '1.366', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:18,965][52665] DAMAGECOUNT value on done: 15275.0 [2024-08-05 22:49:18,966][52665] Sum rewards: 17.547, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.911', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.300', 'ARMOR': '0.540', 'weapon4': '0.716', 'WEAPON3': '0.850', 'weapon2': '1.138', 'HITCOUNT': '1.330', 'weapon3': '1.804', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '14.000'} [2024-08-05 22:49:18,995][52669] DAMAGECOUNT value on done: 15775.0 [2024-08-05 22:49:18,996][52669] Sum rewards: 13.449, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.780', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon7': '0.048', 'ARMOR': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.698', 'weapon4': '0.738', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon3': '1.930', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:20,053][52647] DAMAGECOUNT value on done: 16284.0 [2024-08-05 22:49:20,054][52647] Sum rewards: 13.989, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.586', 'AMMO2': '0.011', 'weapon4': '0.036', 'AMMO4': '0.053', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'ARMOR': '1.314', 'weapon3': '1.466', 'weapon2': '1.622', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:21,259][52663] DAMAGECOUNT value on done: 14998.0 [2024-08-05 22:49:21,260][52663] Sum rewards: 24.974, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.855', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.069', 'AMMO3': '0.127', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.474', 'HITCOUNT': '1.630', 'weapon3': '2.136', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '21.000'} [2024-08-05 22:49:21,487][52665] DAMAGECOUNT value on done: 13639.0 [2024-08-05 22:49:21,488][52665] Sum rewards: 9.577, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.322', 'AMMO2': '0.022', 'AMMO3': '0.073', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.386', 'ARMOR': '0.416', 'WEAPON3': '0.500', 'HITCOUNT': '1.000', 'weapon2': '1.426', 'weapon3': '1.560', 'DAMAGECOUNT': '3.258', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:21,620][52669] DAMAGECOUNT value on done: 12980.0 [2024-08-05 22:49:21,621][52669] Sum rewards: 8.245, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.610', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.212', 'WEAPON3': '0.550', 'HITCOUNT': '0.780', 'ARMOR': '0.907', 'weapon2': '0.968', 'weapon3': '1.320', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.0, 300 sec: 16800.5). Total num frames: 85204992. Throughput: 0: 4188.7. Samples: 21305030. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:49:22,794][52567] Avg episode reward: [(0, '13.033')] [2024-08-05 22:49:22,807][52650] Updated weights for policy 0, policy_version 10401 (0.0033) [2024-08-05 22:49:23,120][52647] DAMAGECOUNT value on done: 12468.0 [2024-08-05 22:49:23,122][52647] Sum rewards: 6.569, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.766', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.183', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'HITCOUNT': '0.740', 'weapon2': '0.776', 'weapon4': '0.856', 'weapon3': '1.714', 'DAMAGECOUNT': '2.370', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:24,190][52663] DAMAGECOUNT value on done: 14491.0 [2024-08-05 22:49:24,198][52663] Sum rewards: 16.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.862', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.032', 'AMMO4': '0.125', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.786', 'ARMOR': '0.862', 'WEAPON3': '1.100', 'HITCOUNT': '1.360', 'weapon3': '2.224', 'DAMAGECOUNT': '5.094', 'FRAGCOUNT': '15.000'} [2024-08-05 22:49:24,538][52669] DAMAGECOUNT value on done: 16249.0 [2024-08-05 22:49:24,539][52669] Sum rewards: 8.626, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.905', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.083', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.396', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '1.268', 'weapon3': '1.318', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:25,024][52665] DAMAGECOUNT value on done: 15136.0 [2024-08-05 22:49:25,024][52665] Sum rewards: 22.497, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'weapon4': '0.206', 'WEAPON3': '0.600', 'weapon3': '1.400', 'weapon2': '1.666', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '6.153', 'FRAGCOUNT': '17.000'} [2024-08-05 22:49:25,406][52647] DAMAGECOUNT value on done: 16149.0 [2024-08-05 22:49:25,408][52647] Sum rewards: 19.832, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.077', 'AMMO2': '0.019', 'weapon7': '0.046', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.300', 'weapon4': '0.494', 'WEAPON3': '0.750', 'ARMOR': '0.935', 'weapon2': '1.094', 'HITCOUNT': '1.560', 'weapon3': '2.142', 'DAMAGECOUNT': '5.319', 'FRAGCOUNT': '16.000'} [2024-08-05 22:49:27,011][52663] DAMAGECOUNT value on done: 16915.0 [2024-08-05 22:49:27,011][52663] Sum rewards: 14.292, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.744', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.020', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'weapon4': '0.364', 'ARMOR': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.114', 'HITCOUNT': '1.150', 'weapon3': '1.870', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:27,544][52669] DAMAGECOUNT value on done: 15355.0 [2024-08-05 22:49:27,545][52669] Sum rewards: 14.818, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.835', 'AMMO2': '0.015', 'ARMOR': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.095', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.650', 'weapon4': '0.750', 'HITCOUNT': '1.290', 'weapon3': '1.404', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:27,594][52650] Updated weights for policy 0, policy_version 10411 (0.0040) [2024-08-05 22:49:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16657.1, 300 sec: 16800.5). Total num frames: 85286912. Throughput: 0: 4200.4. Samples: 21330450. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 22:49:27,794][52567] Avg episode reward: [(0, '13.072')] [2024-08-05 22:49:27,856][52647] DAMAGECOUNT value on done: 14498.0 [2024-08-05 22:49:27,857][52647] Sum rewards: 8.258, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.133', 'AMMO2': '0.030', 'weapon7': '0.056', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.149', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.528', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon4': '1.116', 'ARMOR': '1.256', 'weapon3': '1.592', 'DAMAGECOUNT': '2.358', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:28,340][52665] DAMAGECOUNT value on done: 13614.0 [2024-08-05 22:49:28,343][52665] Sum rewards: 9.208, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.795', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'ARMOR': '0.040', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'weapon4': '0.462', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '0.768', 'weapon3': '1.602', 'DAMAGECOUNT': '2.661', 'FRAGCOUNT': '9.000'} [2024-08-05 22:49:29,985][52663] DAMAGECOUNT value on done: 13131.0 [2024-08-05 22:49:29,985][52663] Sum rewards: 14.397, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.072', 'HEALTH': '0.389', 'WEAPON3': '0.450', 'ARMOR': '0.483', 'HITCOUNT': '0.890', 'weapon2': '1.196', 'weapon3': '1.310', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:30,205][52669] DAMAGECOUNT value on done: 14656.0 [2024-08-05 22:49:30,207][52669] Sum rewards: 10.248, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.406', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.312', 'WEAPON3': '0.450', 'HITCOUNT': '0.790', 'ARMOR': '0.865', 'weapon3': '1.124', 'weapon2': '1.538', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:30,909][52647] DAMAGECOUNT value on done: 15412.0 [2024-08-05 22:49:30,911][52647] Sum rewards: 11.085, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.030', 'AMMO3': '0.091', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.652', 'HEALTH': '0.726', 'ARMOR': '0.904', 'weapon2': '1.008', 'HITCOUNT': '1.130', 'weapon3': '2.132', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:31,449][52665] DAMAGECOUNT value on done: 16001.0 [2024-08-05 22:49:31,450][52665] Sum rewards: 10.056, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.712', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon4': '0.094', 'AMMO3': '0.109', 'WEAPON4': '0.300', 'ARMOR': '0.422', 'WEAPON3': '0.900', 'HITCOUNT': '1.200', 'weapon2': '1.400', 'weapon3': '2.020', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:32,003][52667] DAMAGECOUNT value on done: 15277.0 [2024-08-05 22:49:32,006][52667] Sum rewards: 24.669, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.414', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'weapon4': '0.730', 'weapon2': '0.830', 'HITCOUNT': '1.110', 'ARMOR': '1.354', 'weapon3': '1.872', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '19.000'} [2024-08-05 22:49:32,380][52650] Updated weights for policy 0, policy_version 10421 (0.0015) [2024-08-05 22:49:32,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 85368832. Throughput: 0: 4198.5. Samples: 21343000. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:49:32,794][52567] Avg episode reward: [(0, '12.972')] [2024-08-05 22:49:33,052][52663] DAMAGECOUNT value on done: 15024.0 [2024-08-05 22:49:33,052][52663] Sum rewards: 19.758, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon4': '0.282', 'WEAPON3': '0.650', 'HITCOUNT': '1.190', 'weapon2': '1.214', 'weapon3': '1.734', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '16.000'} [2024-08-05 22:49:33,375][52669] DAMAGECOUNT value on done: 14615.0 [2024-08-05 22:49:33,375][52669] Sum rewards: 10.460, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.265', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.056', 'AMMO3': '0.060', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.360', 'WEAPON3': '0.450', 'HITCOUNT': '0.830', 'ARMOR': '0.911', 'weapon2': '1.096', 'weapon3': '1.472', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:33,968][52647] DAMAGECOUNT value on done: 14854.0 [2024-08-05 22:49:33,968][52647] Sum rewards: 12.665, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.812', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.250', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.952', 'HITCOUNT': '1.240', 'weapon2': '1.282', 'weapon3': '1.646', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:34,281][52665] DAMAGECOUNT value on done: 14311.0 [2024-08-05 22:49:34,283][52665] Sum rewards: 8.871, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon5': '0.036', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.376', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'ARMOR': '1.002', 'weapon2': '1.282', 'weapon3': '1.598', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:34,899][52667] DAMAGECOUNT value on done: 14482.0 [2024-08-05 22:49:34,900][52667] Sum rewards: 8.114, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.022', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'ARMOR': '0.404', 'HITCOUNT': '0.780', 'WEAPON3': '0.800', 'weapon2': '1.054', 'weapon3': '1.338', 'DAMAGECOUNT': '2.886', 'FRAGCOUNT': '9.000'} [2024-08-05 22:49:35,598][52803] DAMAGECOUNT value on done: 13005.0 [2024-08-05 22:49:35,599][52803] Sum rewards: 12.326, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO2': '0.008', 'AMMO4': '0.040', 'ARMOR': '0.060', 'weapon7': '0.070', 'AMMO3': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.352', 'WEAPON3': '0.750', 'HITCOUNT': '0.960', 'weapon2': '1.132', 'weapon3': '1.990', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:35,644][52614] Signal inference workers to stop experience collection... (1950 times) [2024-08-05 22:49:35,648][52614] Signal inference workers to resume experience collection... (1950 times) [2024-08-05 22:49:35,728][52650] InferenceWorker_p0-w0: stopping experience collection (1950 times) [2024-08-05 22:49:35,728][52650] InferenceWorker_p0-w0: resuming experience collection (1950 times) [2024-08-05 22:49:36,604][52663] DAMAGECOUNT value on done: 17017.0 [2024-08-05 22:49:36,604][52663] Sum rewards: 12.854, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.955', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.094', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.100', 'weapon2': '1.342', 'weapon3': '1.550', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:36,780][52669] DAMAGECOUNT value on done: 14777.0 [2024-08-05 22:49:36,781][52669] Sum rewards: 12.061, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.167', 'AMMO2': '0.010', 'AMMO3': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.104', 'WEAPON3': '0.400', 'ARMOR': '0.420', 'HITCOUNT': '0.850', 'weapon3': '1.176', 'weapon2': '1.186', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '8.000'} [2024-08-05 22:49:37,075][52650] Updated weights for policy 0, policy_version 10431 (0.0036) [2024-08-05 22:49:37,294][52665] DAMAGECOUNT value on done: 14207.0 [2024-08-05 22:49:37,295][52665] Sum rewards: 17.433, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.990', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'ARMOR': '0.020', 'weapon5': '0.022', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON3': '0.550', 'HITCOUNT': '0.880', 'weapon2': '1.274', 'weapon3': '1.356', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '14.000'} [2024-08-05 22:49:37,462][52667] DAMAGECOUNT value on done: 14119.0 [2024-08-05 22:49:37,463][52667] Sum rewards: 6.177, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.588', 'AMMO2': '0.000', 'AMMO4': '0.000', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.220', 'ARMOR': '0.434', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon2': '1.188', 'weapon3': '1.868', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '5.000'} [2024-08-05 22:49:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16520.5, 300 sec: 16772.8). Total num frames: 85450752. Throughput: 0: 4206.5. Samples: 21367840. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:49:37,794][52567] Avg episode reward: [(0, '12.913')] [2024-08-05 22:49:38,870][52803] DAMAGECOUNT value on done: 15584.0 [2024-08-05 22:49:38,870][52803] Sum rewards: 9.799, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.050', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.008', 'weapon7': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'WEAPON7': '0.200', 'HITCOUNT': '0.770', 'ARMOR': '0.866', 'WEAPON3': '0.900', 'weapon3': '1.184', 'weapon2': '1.328', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:39,154][52663] DAMAGECOUNT value on done: 13141.0 [2024-08-05 22:49:39,155][52663] Sum rewards: 9.722, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'HEALTH': '0.018', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon4': '0.204', 'WEAPON3': '0.450', 'ARMOR': '0.457', 'HITCOUNT': '0.670', 'weapon2': '1.064', 'weapon3': '1.218', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '8.000'} [2024-08-05 22:49:39,443][52669] DAMAGECOUNT value on done: 14675.0 [2024-08-05 22:49:39,445][52669] Sum rewards: 15.171, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.426', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.077', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.550', 'ARMOR': '0.916', 'HITCOUNT': '1.080', 'weapon2': '1.090', 'weapon3': '1.400', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:40,102][52665] DAMAGECOUNT value on done: 14895.0 [2024-08-05 22:49:40,102][52665] Sum rewards: 11.728, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.280', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.316', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'weapon2': '0.960', 'HITCOUNT': '0.990', 'weapon3': '1.252', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:40,121][52811] DAMAGECOUNT value on done: 15058.0 [2024-08-05 22:49:40,121][52811] Sum rewards: 17.141, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.264', 'AMMO5': '0.003', 'AMMO2': '0.025', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO3': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.062', 'weapon3': '1.838', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '15.000'} [2024-08-05 22:49:40,345][52667] DAMAGECOUNT value on done: 15221.0 [2024-08-05 22:49:40,345][52667] Sum rewards: 11.337, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.555', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon7': '0.048', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.448', 'WEAPON3': '0.850', 'weapon2': '0.884', 'HITCOUNT': '1.010', 'weapon3': '1.864', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:41,731][52663] DAMAGECOUNT value on done: 14344.0 [2024-08-05 22:49:41,732][52663] Sum rewards: 7.975, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.368', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'weapon5': '0.012', 'ARMOR': '0.048', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.750', 'weapon2': '0.952', 'HITCOUNT': '1.040', 'weapon3': '1.710', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '6.500'} [2024-08-05 22:49:41,912][52669] DAMAGECOUNT value on done: 15472.0 [2024-08-05 22:49:41,912][52669] Sum rewards: 21.277, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.060', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.124', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'ARMOR': '0.530', 'WEAPON3': '0.850', 'HITCOUNT': '1.350', 'weapon2': '1.486', 'weapon3': '2.118', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '18.000'} [2024-08-05 22:49:42,099][52650] Updated weights for policy 0, policy_version 10441 (0.0026) [2024-08-05 22:49:42,256][52803] DAMAGECOUNT value on done: 13175.0 [2024-08-05 22:49:42,258][52803] Sum rewards: 13.872, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.011', 'AMMO2': '0.013', 'ARMOR': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.087', 'weapon4': '0.228', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon2': '1.218', 'weapon3': '1.582', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.6). Total num frames: 85540864. Throughput: 0: 4201.8. Samples: 21392820. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:49:42,794][52567] Avg episode reward: [(0, '12.902')] [2024-08-05 22:49:43,294][52667] DAMAGECOUNT value on done: 16119.0 [2024-08-05 22:49:43,296][52667] Sum rewards: 14.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.155', 'WEAPON3': '1.000', 'HITCOUNT': '1.320', 'weapon2': '1.712', 'ARMOR': '1.758', 'weapon3': '1.862', 'DAMAGECOUNT': '4.866', 'FRAGCOUNT': '14.000'} [2024-08-05 22:49:43,391][52665] DAMAGECOUNT value on done: 14580.0 [2024-08-05 22:49:43,392][52665] Sum rewards: 10.099, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO2': '0.022', 'AMMO3': '0.070', 'AMMO4': '0.109', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '0.760', 'ARMOR': '0.927', 'weapon2': '1.170', 'weapon3': '1.672', 'DAMAGECOUNT': '2.463', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:43,655][52811] DAMAGECOUNT value on done: 14020.0 [2024-08-05 22:49:43,655][52811] Sum rewards: 9.738, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.310', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.126', 'WEAPON3': '0.650', 'ARMOR': '0.888', 'HITCOUNT': '1.020', 'weapon2': '1.560', 'weapon3': '1.586', 'DAMAGECOUNT': '3.015', 'FRAGCOUNT': '8.000'} [2024-08-05 22:49:44,611][52663] DAMAGECOUNT value on done: 16233.0 [2024-08-05 22:49:44,612][52663] Sum rewards: 10.838, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.029', 'ARMOR': '0.060', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'AMMO4': '0.145', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '1.120', 'weapon2': '1.332', 'weapon3': '2.042', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:45,557][52803] DAMAGECOUNT value on done: 13575.0 [2024-08-05 22:49:45,557][52803] Sum rewards: 9.137, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.008', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'AMMO3': '0.111', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'ARMOR': '1.304', 'weapon3': '1.384', 'weapon2': '1.588', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:45,704][52667] DAMAGECOUNT value on done: 16155.0 [2024-08-05 22:49:45,706][52667] Sum rewards: 11.854, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.050', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.266', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'ARMOR': '0.946', 'weapon2': '1.252', 'weapon3': '1.528', 'DAMAGECOUNT': '3.231', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:45,736][52665] DAMAGECOUNT value on done: 14592.0 [2024-08-05 22:49:45,738][52665] Sum rewards: 9.741, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'HEALTH': '0.094', 'AMMO3': '0.101', 'AMMO4': '0.146', 'weapon4': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.162', 'weapon3': '2.018', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '8.000'} [2024-08-05 22:49:46,943][52811] DAMAGECOUNT value on done: 13812.0 [2024-08-05 22:49:46,964][52811] Sum rewards: 7.549, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.162', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.226', 'ARMOR': '0.457', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon2': '1.652', 'weapon3': '1.746', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:47,183][52650] Updated weights for policy 0, policy_version 10451 (0.0021) [2024-08-05 22:49:47,707][52663] DAMAGECOUNT value on done: 14825.0 [2024-08-05 22:49:47,708][52663] Sum rewards: 23.495, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.208', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.288', 'WEAPON3': '0.800', 'ARMOR': '0.874', 'weapon2': '1.334', 'HITCOUNT': '1.540', 'weapon3': '2.020', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '19.000'} [2024-08-05 22:49:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.6). Total num frames: 85622784. Throughput: 0: 4198.2. Samples: 21405490. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:49:47,794][52567] Avg episode reward: [(0, '12.877')] [2024-08-05 22:49:48,204][52667] DAMAGECOUNT value on done: 15130.0 [2024-08-05 22:49:48,204][52667] Sum rewards: 11.302, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.845', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO3': '0.071', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'weapon3': '1.318', 'ARMOR': '1.332', 'weapon2': '2.072', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:48,370][52665] DAMAGECOUNT value on done: 14223.0 [2024-08-05 22:49:48,371][52665] Sum rewards: 10.122, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.786', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.116', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'ARMOR': '1.323', 'weapon3': '1.582', 'weapon2': '1.960', 'DAMAGECOUNT': '3.372', 'FRAGCOUNT': '9.000'} [2024-08-05 22:49:48,783][52803] DAMAGECOUNT value on done: 14920.0 [2024-08-05 22:49:48,785][52803] Sum rewards: 8.577, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.688', 'AMMO4': '-0.084', 'AMMO2': '-0.017', 'weapon7': '0.060', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'ARMOR': '0.972', 'weapon3': '1.362', 'weapon2': '1.588', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '7.000'} [2024-08-05 22:49:50,104][52811] DAMAGECOUNT value on done: 14281.0 [2024-08-05 22:49:50,108][52811] Sum rewards: 12.380, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.086', 'weapon7': '0.110', 'WEAPON4': '0.150', 'AMMO6': '0.220', 'AMMO7': '0.220', 'HEALTH': '0.249', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'weapon4': '0.476', 'ARMOR': '0.542', 'HITCOUNT': '0.590', 'weapon2': '0.872', 'weapon3': '1.192', 'DAMAGECOUNT': '2.373', 'FRAGCOUNT': '7.500'} [2024-08-05 22:49:50,843][52663] DAMAGECOUNT value on done: 13873.0 [2024-08-05 22:49:50,843][52663] Sum rewards: 17.387, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.427', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.040', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon3': '1.408', 'weapon2': '1.412', 'ARMOR': '1.752', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:51,066][52664] DAMAGECOUNT value on done: 16206.0 [2024-08-05 22:49:51,066][52664] Sum rewards: 15.645, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.282', 'AMMO2': '0.015', 'weapon7': '0.060', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.750', 'HITCOUNT': '0.970', 'ARMOR': '1.348', 'weapon2': '1.370', 'weapon3': '1.562', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:51,370][52667] DAMAGECOUNT value on done: 14305.0 [2024-08-05 22:49:51,372][52667] Sum rewards: 14.688, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.504', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.800', 'ARMOR': '0.881', 'HITCOUNT': '1.130', 'weapon2': '1.386', 'weapon3': '1.734', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '12.000'} [2024-08-05 22:49:51,602][52665] DAMAGECOUNT value on done: 14882.0 [2024-08-05 22:49:51,625][52665] Sum rewards: 5.650, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.012', 'AMMO4': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'ARMOR': '0.495', 'weapon4': '0.584', 'WEAPON3': '0.700', 'HITCOUNT': '0.820', 'weapon2': '1.204', 'weapon3': '1.266', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:51,765][52650] Updated weights for policy 0, policy_version 10461 (0.0014) [2024-08-05 22:49:52,145][52803] DAMAGECOUNT value on done: 13863.0 [2024-08-05 22:49:52,145][52803] Sum rewards: 12.936, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.750', 'HITCOUNT': '1.170', 'ARMOR': '1.425', 'weapon2': '1.566', 'weapon3': '1.766', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:52,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 85704704. Throughput: 0: 4197.8. Samples: 21430770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:49:52,794][52567] Avg episode reward: [(0, '12.713')] [2024-08-05 22:49:52,893][52658] DAMAGECOUNT value on done: 14564.0 [2024-08-05 22:49:52,897][52658] Sum rewards: 10.475, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.702', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.099', 'weapon7': '0.108', 'WEAPON4': '0.200', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon4': '0.398', 'WEAPON7': '0.400', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.282', 'weapon3': '1.444', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:53,498][52811] DAMAGECOUNT value on done: 14929.0 [2024-08-05 22:49:53,500][52811] Sum rewards: 14.555, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.037', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'HEALTH': '0.276', 'ARMOR': '0.428', 'weapon4': '0.462', 'WEAPON3': '0.700', 'weapon2': '0.886', 'HITCOUNT': '1.130', 'weapon3': '2.010', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '11.000'} [2024-08-05 22:49:53,940][52667] DAMAGECOUNT value on done: 15039.0 [2024-08-05 22:49:53,941][52667] Sum rewards: 14.157, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.176', 'WEAPON3': '0.800', 'ARMOR': '0.863', 'HITCOUNT': '1.420', 'weapon2': '1.650', 'weapon3': '1.842', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:54,110][52663] DAMAGECOUNT value on done: 14309.0 [2024-08-05 22:49:54,112][52663] Sum rewards: 12.384, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.028', 'AMMO4': '0.070', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon4': '0.478', 'HITCOUNT': '0.680', 'weapon2': '1.158', 'weapon3': '1.378', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:54,280][52665] DAMAGECOUNT value on done: 12714.0 [2024-08-05 22:49:54,281][52665] Sum rewards: 10.762, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.566', 'WEAPON3': '0.750', 'HITCOUNT': '0.790', 'ARMOR': '0.860', 'weapon2': '1.054', 'weapon3': '1.784', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '9.000'} [2024-08-05 22:49:54,349][52664] DAMAGECOUNT value on done: 13318.0 [2024-08-05 22:49:54,350][52664] Sum rewards: 4.080, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.201', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.204', 'ARMOR': '0.400', 'HITCOUNT': '0.710', 'WEAPON3': '0.900', 'weapon2': '1.476', 'weapon3': '1.918', 'DAMAGECOUNT': '2.277', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:55,437][52658] DAMAGECOUNT value on done: 14585.0 [2024-08-05 22:49:55,437][52658] Sum rewards: 8.516, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.542', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.366', 'HITCOUNT': '0.850', 'WEAPON3': '0.900', 'weapon2': '1.144', 'ARMOR': '1.260', 'weapon3': '1.778', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '8.000'} [2024-08-05 22:49:55,462][52803] DAMAGECOUNT value on done: 16404.0 [2024-08-05 22:49:55,462][52803] Sum rewards: 15.763, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.795', 'AMMO2': '0.003', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.015', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON3': '0.950', 'weapon2': '0.988', 'HITCOUNT': '1.180', 'weapon3': '2.118', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '15.000'} [2024-08-05 22:49:56,011][52649] DAMAGECOUNT value on done: 15017.0 [2024-08-05 22:49:56,012][52649] Sum rewards: 13.226, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.158', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '1.160', 'weapon3': '1.548', 'weapon2': '1.630', 'ARMOR': '1.715', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:56,748][52667] DAMAGECOUNT value on done: 15396.0 [2024-08-05 22:49:56,749][52667] Sum rewards: 8.816, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.959', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.064', 'WEAPON4': '0.200', 'weapon4': '0.496', 'WEAPON3': '0.500', 'HITCOUNT': '0.740', 'ARMOR': '0.933', 'weapon2': '1.290', 'weapon3': '1.310', 'DAMAGECOUNT': '2.706', 'FRAGCOUNT': '6.000'} [2024-08-05 22:49:56,752][52665] DAMAGECOUNT value on done: 14069.0 [2024-08-05 22:49:56,755][52665] Sum rewards: 12.856, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon4': '0.254', 'WEAPON3': '0.450', 'HEALTH': '0.732', 'HITCOUNT': '0.760', 'weapon2': '0.916', 'weapon3': '1.352', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '10.000'} [2024-08-05 22:49:56,902][52811] DAMAGECOUNT value on done: 13479.0 [2024-08-05 22:49:56,903][52811] Sum rewards: 18.336, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO2': '0.024', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'HEALTH': '0.205', 'WEAPON3': '0.500', 'weapon4': '0.520', 'weapon2': '1.118', 'HITCOUNT': '1.130', 'weapon3': '1.794', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '14.000'} [2024-08-05 22:49:56,976][52650] Updated weights for policy 0, policy_version 10471 (0.0023) [2024-08-05 22:49:57,427][52664] DAMAGECOUNT value on done: 15564.0 [2024-08-05 22:49:57,429][52664] Sum rewards: 15.890, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.708', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.016', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.364', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon2': '1.216', 'weapon3': '1.948', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:57,534][52663] DAMAGECOUNT value on done: 14517.0 [2024-08-05 22:49:57,536][52663] Sum rewards: 10.129, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.414', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.117', 'weapon4': '0.316', 'WEAPON3': '0.700', 'ARMOR': '0.844', 'weapon2': '0.912', 'HITCOUNT': '1.040', 'weapon3': '1.752', 'DAMAGECOUNT': '3.495', 'FRAGCOUNT': '8.000'} [2024-08-05 22:49:57,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 85786624. Throughput: 0: 4187.8. Samples: 21455670. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-05 22:49:57,795][52567] Avg episode reward: [(0, '12.627')] [2024-08-05 22:49:58,765][52803] DAMAGECOUNT value on done: 12259.0 [2024-08-05 22:49:58,765][52803] Sum rewards: 13.977, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.665', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.024', 'weapon4': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.044', 'AMMO3': '0.108', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '1.220', 'weapon2': '1.540', 'weapon3': '2.060', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '13.000'} [2024-08-05 22:49:58,996][52649] DAMAGECOUNT value on done: 14616.0 [2024-08-05 22:49:58,997][52649] Sum rewards: 19.566, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.315', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'weapon5': '0.134', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon3': '1.502', 'weapon2': '1.568', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '15.000'} [2024-08-05 22:49:59,005][52658] DAMAGECOUNT value on done: 12791.0 [2024-08-05 22:49:59,006][52658] Sum rewards: 14.751, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.402', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.436', 'ARMOR': '0.489', 'WEAPON3': '0.550', 'HITCOUNT': '1.140', 'weapon2': '1.472', 'weapon3': '1.618', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:00,278][52667] DAMAGECOUNT value on done: 13553.0 [2024-08-05 22:50:00,287][52667] Sum rewards: 11.178, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.405', 'AMMO5': '0.013', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.064', 'weapon4': '0.076', 'AMMO3': '0.105', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'weapon2': '1.456', 'weapon3': '1.710', 'DAMAGECOUNT': '2.496', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:00,315][52811] DAMAGECOUNT value on done: 14784.0 [2024-08-05 22:50:00,330][52811] Sum rewards: 19.535, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.538', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.144', 'WEAPON3': '0.750', 'ARMOR': '0.883', 'HITCOUNT': '1.400', 'weapon2': '1.682', 'weapon3': '1.936', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '16.000'} [2024-08-05 22:50:00,494][52664] DAMAGECOUNT value on done: 14025.0 [2024-08-05 22:50:00,498][52664] Sum rewards: 17.192, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.340', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.262', 'WEAPON3': '0.550', 'weapon2': '0.870', 'HITCOUNT': '1.090', 'weapon3': '1.456', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:00,762][52663] DAMAGECOUNT value on done: 14605.0 [2024-08-05 22:50:00,763][52663] Sum rewards: 12.544, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'HITCOUNT': '0.890', 'WEAPON3': '0.900', 'weapon2': '1.366', 'weapon3': '1.856', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:01,627][52650] Updated weights for policy 0, policy_version 10481 (0.0021) [2024-08-05 22:50:01,997][52658] DAMAGECOUNT value on done: 13805.0 [2024-08-05 22:50:01,999][52658] Sum rewards: 10.121, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'HEALTH': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.160', 'ARMOR': '0.447', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon3': '1.000', 'weapon2': '1.634', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '7.500'} [2024-08-05 22:50:02,108][52803] DAMAGECOUNT value on done: 14192.0 [2024-08-05 22:50:02,110][52803] Sum rewards: 8.857, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.545', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.032', 'weapon5': '0.036', 'AMMO4': '0.042', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'weapon4': '0.270', 'WEAPON4': '0.300', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'weapon2': '1.030', 'weapon3': '2.174', 'DAMAGECOUNT': '3.063', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:02,117][52649] DAMAGECOUNT value on done: 13860.0 [2024-08-05 22:50:02,118][52649] Sum rewards: 16.604, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'HEALTH': '0.194', 'weapon4': '0.298', 'ARMOR': '0.522', 'WEAPON3': '0.550', 'HITCOUNT': '1.150', 'weapon2': '1.482', 'weapon3': '1.684', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 85876736. Throughput: 0: 4184.6. Samples: 21468040. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:50:02,795][52567] Avg episode reward: [(0, '12.849')] [2024-08-05 22:50:03,259][52667] DAMAGECOUNT value on done: 15125.0 [2024-08-05 22:50:03,261][52667] Sum rewards: 10.618, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.408', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.034', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'WEAPON4': '0.350', 'weapon2': '0.512', 'ARMOR': '0.515', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon4': '1.024', 'weapon3': '1.626', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:03,327][52663] DAMAGECOUNT value on done: 14917.0 [2024-08-05 22:50:03,327][52663] Sum rewards: 11.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.252', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon7': '0.052', 'AMMO4': '0.089', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon4': '0.244', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'HITCOUNT': '1.250', 'weapon2': '1.606', 'weapon3': '1.918', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:03,621][52811] DAMAGECOUNT value on done: 10894.0 [2024-08-05 22:50:03,621][52811] Sum rewards: 10.701, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.174', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.470', 'WEAPON3': '0.500', 'ARMOR': '0.505', 'HITCOUNT': '0.780', 'weapon3': '0.848', 'weapon2': '0.886', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:03,938][52664] DAMAGECOUNT value on done: 14373.0 [2024-08-05 22:50:03,939][52664] Sum rewards: 9.916, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.715', 'AMMO2': '0.004', 'ARMOR': '0.020', 'AMMO4': '0.021', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.266', 'WEAPON3': '0.850', 'HITCOUNT': '1.270', 'weapon2': '1.458', 'weapon3': '1.890', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:04,942][52795] DAMAGECOUNT value on done: 11888.0 [2024-08-05 22:50:04,943][52795] Sum rewards: 13.252, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.142', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.134', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'ARMOR': '0.526', 'HITCOUNT': '0.980', 'WEAPON3': '1.150', 'weapon2': '1.442', 'weapon3': '2.174', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '15.000'} [2024-08-05 22:50:05,018][52649] DAMAGECOUNT value on done: 15251.0 [2024-08-05 22:50:05,019][52649] Sum rewards: 3.981, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.799', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.114', 'HITCOUNT': '0.590', 'WEAPON3': '0.650', 'weapon3': '1.202', 'weapon2': '1.304', 'DAMAGECOUNT': '1.713', 'FRAGCOUNT': '4.000'} [2024-08-05 22:50:05,079][52658] DAMAGECOUNT value on done: 14981.0 [2024-08-05 22:50:05,081][52658] Sum rewards: 10.239, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'HEALTH': '0.080', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'ARMOR': '0.468', 'WEAPON3': '0.550', 'weapon4': '0.632', 'HITCOUNT': '1.020', 'weapon2': '1.198', 'weapon3': '1.666', 'DAMAGECOUNT': '3.627', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:05,428][52803] DAMAGECOUNT value on done: 12324.0 [2024-08-05 22:50:05,437][52803] Sum rewards: 8.960, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.700', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO3': '0.089', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.844', 'HITCOUNT': '0.980', 'weapon3': '1.266', 'weapon2': '1.392', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:06,217][52667] DAMAGECOUNT value on done: 14262.0 [2024-08-05 22:50:06,231][52667] Sum rewards: 9.113, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.581', 'AMMO2': '0.029', 'AMMO3': '0.098', 'AMMO4': '0.143', 'WEAPON4': '0.450', 'ARMOR': '0.482', 'HITCOUNT': '0.700', 'WEAPON3': '0.800', 'weapon4': '0.864', 'weapon2': '0.984', 'weapon3': '1.678', 'DAMAGECOUNT': '2.466', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:06,570][52650] Updated weights for policy 0, policy_version 10491 (0.0026) [2024-08-05 22:50:06,668][52663] DAMAGECOUNT value on done: 14581.0 [2024-08-05 22:50:06,668][52663] Sum rewards: 3.604, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.454', 'AMMO2': '0.011', 'AMMO3': '0.043', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.280', 'WEAPON3': '0.300', 'HITCOUNT': '0.360', 'ARMOR': '0.480', 'weapon2': '0.692', 'weapon3': '0.884', 'DAMAGECOUNT': '1.305', 'FRAGCOUNT': '3.000'} [2024-08-05 22:50:06,827][52811] DAMAGECOUNT value on done: 13634.0 [2024-08-05 22:50:06,831][52811] Sum rewards: 18.152, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.563', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.338', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'weapon2': '0.950', 'HITCOUNT': '1.060', 'weapon3': '1.302', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:06,882][52664] DAMAGECOUNT value on done: 15544.0 [2024-08-05 22:50:06,883][52664] Sum rewards: 18.947, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.050', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.107', 'WEAPON3': '0.600', 'ARMOR': '1.277', 'HITCOUNT': '1.520', 'weapon3': '1.770', 'weapon2': '2.170', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '15.000'} [2024-08-05 22:50:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 85958656. Throughput: 0: 4183.8. Samples: 21493300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:50:07,794][52567] Avg episode reward: [(0, '12.632')] [2024-08-05 22:50:07,818][52658] DAMAGECOUNT value on done: 12378.0 [2024-08-05 22:50:07,819][52658] Sum rewards: 10.125, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.832', 'AMMO5': '0.003', 'weapon5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'HITCOUNT': '0.900', 'weapon2': '1.368', 'weapon3': '1.952', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:08,023][52649] DAMAGECOUNT value on done: 14274.0 [2024-08-05 22:50:08,023][52649] Sum rewards: 16.662, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.048', 'AMMO4': '0.062', 'AMMO3': '0.090', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.358', 'WEAPON3': '0.600', 'weapon2': '1.322', 'HITCOUNT': '1.360', 'weapon3': '1.866', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:08,202][52795] DAMAGECOUNT value on done: 12278.0 [2024-08-05 22:50:08,203][52795] Sum rewards: 2.847, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.146', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HITCOUNT': '0.270', 'WEAPON3': '0.350', 'weapon3': '0.788', 'ARMOR': '0.856', 'DAMAGECOUNT': '0.942', 'weapon2': '1.326', 'FRAGCOUNT': '2.000'} [2024-08-05 22:50:08,665][52803] DAMAGECOUNT value on done: 13157.0 [2024-08-05 22:50:08,666][52803] Sum rewards: 6.811, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO4': '0.099', 'weapon4': '0.242', 'HEALTH': '0.312', 'WEAPON3': '0.400', 'HITCOUNT': '0.540', 'weapon3': '1.356', 'weapon2': '1.536', 'DAMAGECOUNT': '1.914', 'FRAGCOUNT': '4.000'} [2024-08-05 22:50:08,921][52667] DAMAGECOUNT value on done: 15454.0 [2024-08-05 22:50:08,921][52667] Sum rewards: 4.471, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.068', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.342', 'HITCOUNT': '0.560', 'weapon2': '0.836', 'WEAPON3': '0.900', 'ARMOR': '0.977', 'weapon3': '1.782', 'DAMAGECOUNT': '1.863', 'FRAGCOUNT': '5.000'} [2024-08-05 22:50:09,424][52663] DAMAGECOUNT value on done: 13446.0 [2024-08-05 22:50:09,426][52663] Sum rewards: 13.192, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.028', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.324', 'HEALTH': '0.538', 'WEAPON3': '0.550', 'HITCOUNT': '1.180', 'weapon2': '1.324', 'weapon3': '1.710', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:09,997][52664] DAMAGECOUNT value on done: 15307.0 [2024-08-05 22:50:09,997][52664] Sum rewards: 9.099, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.082', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'ARMOR': '0.074', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.232', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.834', 'HITCOUNT': '0.920', 'weapon2': '1.068', 'weapon3': '1.598', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '6.500'} [2024-08-05 22:50:10,196][52811] DAMAGECOUNT value on done: 14511.0 [2024-08-05 22:50:10,198][52811] Sum rewards: 12.673, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.116', 'HEALTH': '0.178', 'weapon4': '0.290', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '1.010', 'weapon3': '1.372', 'weapon2': '1.494', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:10,224][52671] DAMAGECOUNT value on done: 16580.0 [2024-08-05 22:50:10,226][52671] Sum rewards: 11.994, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.450', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.085', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.485', 'weapon4': '0.614', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.142', 'weapon3': '1.782', 'DAMAGECOUNT': '3.657', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:11,113][52658] DAMAGECOUNT value on done: 16700.0 [2024-08-05 22:50:11,122][52658] Sum rewards: 17.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.924', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.086', 'WEAPON3': '0.650', 'HITCOUNT': '1.350', 'ARMOR': '1.437', 'weapon3': '1.590', 'weapon2': '1.866', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:11,167][52649] DAMAGECOUNT value on done: 14973.0 [2024-08-05 22:50:11,169][52649] Sum rewards: 16.513, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.052', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'ARMOR': '0.020', 'AMMO3': '0.060', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.454', 'WEAPON3': '0.500', 'weapon2': '1.018', 'HITCOUNT': '1.150', 'weapon3': '1.300', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '13.500'} [2024-08-05 22:50:11,448][52795] DAMAGECOUNT value on done: 12801.0 [2024-08-05 22:50:11,448][52795] Sum rewards: 2.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.803', 'AMMO2': '0.025', 'ARMOR': '0.028', 'AMMO4': '0.124', 'AMMO3': '0.141', 'weapon2': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.418', 'HITCOUNT': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.244', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '5.000'} [2024-08-05 22:50:11,764][52650] Updated weights for policy 0, policy_version 10501 (0.0025) [2024-08-05 22:50:12,092][52803] DAMAGECOUNT value on done: 14271.0 [2024-08-05 22:50:12,093][52803] Sum rewards: 10.290, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.249', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.426', 'ARMOR': '0.499', 'WEAPON3': '0.500', 'weapon2': '0.850', 'HITCOUNT': '0.860', 'weapon3': '1.330', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:12,133][52667] DAMAGECOUNT value on done: 15598.0 [2024-08-05 22:50:12,138][52667] Sum rewards: 10.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.920', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.198', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.244', 'weapon3': '1.520', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:12,693][52663] DAMAGECOUNT value on done: 13196.0 [2024-08-05 22:50:12,695][52663] Sum rewards: 22.314, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.597', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO3': '0.070', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'HITCOUNT': '1.590', 'weapon3': '1.618', 'weapon2': '1.910', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '16.000'} [2024-08-05 22:50:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 86048768. Throughput: 0: 4175.1. Samples: 21518330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:50:12,795][52567] Avg episode reward: [(0, '12.328')] [2024-08-05 22:50:12,846][52664] DAMAGECOUNT value on done: 14482.0 [2024-08-05 22:50:12,849][52664] Sum rewards: 13.996, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.410', 'AMMO2': '0.038', 'AMMO3': '0.096', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON3': '0.650', 'ARMOR': '0.883', 'HITCOUNT': '0.990', 'weapon2': '1.370', 'weapon3': '1.940', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:12,965][52671] DAMAGECOUNT value on done: 13834.0 [2024-08-05 22:50:12,967][52671] Sum rewards: 13.454, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.470', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO5': '0.010', 'weapon5': '0.042', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'HITCOUNT': '1.030', 'weapon2': '1.410', 'weapon3': '1.440', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:13,488][52811] DAMAGECOUNT value on done: 15414.0 [2024-08-05 22:50:13,488][52811] Sum rewards: 4.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.679', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'weapon4': '0.002', 'AMMO5': '0.010', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'ARMOR': '0.857', 'WEAPON3': '0.950', 'HITCOUNT': '1.040', 'weapon2': '1.502', 'weapon3': '1.524', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '6.000'} [2024-08-05 22:50:14,223][52658] DAMAGECOUNT value on done: 13956.0 [2024-08-05 22:50:14,223][52658] Sum rewards: 10.180, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.262', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.266', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'ARMOR': '0.958', 'weapon2': '1.174', 'weapon3': '1.478', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:14,506][52649] DAMAGECOUNT value on done: 12720.0 [2024-08-05 22:50:14,508][52649] Sum rewards: 15.074, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.224', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.222', 'WEAPON3': '0.600', 'ARMOR': '0.862', 'HITCOUNT': '1.020', 'weapon3': '1.494', 'weapon2': '1.576', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:14,746][52795] DAMAGECOUNT value on done: 14039.0 [2024-08-05 22:50:14,747][52795] Sum rewards: 6.851, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.846', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'HITCOUNT': '0.370', 'WEAPON3': '0.400', 'weapon4': '0.444', 'weapon2': '0.806', 'weapon3': '0.858', 'ARMOR': '0.881', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '5.000'} [2024-08-05 22:50:15,247][52667] DAMAGECOUNT value on done: 15993.0 [2024-08-05 22:50:15,247][52667] Sum rewards: 19.883, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.612', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon7': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.128', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon2': '1.368', 'weapon3': '1.838', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '16.000'} [2024-08-05 22:50:15,380][52803] DAMAGECOUNT value on done: 12522.0 [2024-08-05 22:50:15,381][52803] Sum rewards: 7.158, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.310', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.014', 'ARMOR': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'HITCOUNT': '0.680', 'WEAPON3': '0.750', 'weapon3': '1.284', 'weapon2': '1.286', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:15,485][52663] DAMAGECOUNT value on done: 14177.0 [2024-08-05 22:50:15,486][52663] Sum rewards: 22.851, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.242', 'AMMO2': '0.019', 'ARMOR': '0.028', 'AMMO3': '0.067', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'weapon3': '1.244', 'HITCOUNT': '1.610', 'weapon2': '1.684', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '16.000'} [2024-08-05 22:50:15,590][52671] DAMAGECOUNT value on done: 16556.0 [2024-08-05 22:50:15,590][52671] Sum rewards: 11.967, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.988', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon4': '0.324', 'weapon2': '0.960', 'WEAPON3': '1.050', 'HITCOUNT': '1.240', 'ARMOR': '1.257', 'weapon3': '1.730', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:15,640][52664] DAMAGECOUNT value on done: 16568.0 [2024-08-05 22:50:15,640][52664] Sum rewards: 14.894, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.643', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.125', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'ARMOR': '1.278', 'weapon2': '1.670', 'weapon3': '1.904', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:16,733][52650] Updated weights for policy 0, policy_version 10511 (0.0045) [2024-08-05 22:50:16,912][52811] DAMAGECOUNT value on done: 13112.0 [2024-08-05 22:50:16,912][52811] Sum rewards: 22.994, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.112', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.244', 'WEAPON3': '0.650', 'ARMOR': '0.857', 'weapon2': '1.222', 'weapon3': '1.592', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '18.000'} [2024-08-05 22:50:17,327][52658] DAMAGECOUNT value on done: 14018.0 [2024-08-05 22:50:17,328][52658] Sum rewards: 11.803, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.058', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.077', 'weapon4': '0.204', 'WEAPON3': '0.450', 'HITCOUNT': '0.950', 'weapon3': '1.030', 'weapon2': '1.358', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:17,431][52649] DAMAGECOUNT value on done: 13029.0 [2024-08-05 22:50:17,436][52649] Sum rewards: 8.757, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.004', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.246', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'ARMOR': '1.322', 'weapon2': '1.580', 'weapon3': '1.720', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 86122496. Throughput: 0: 4175.3. Samples: 21530890. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:50:17,795][52567] Avg episode reward: [(0, '12.194')] [2024-08-05 22:50:18,061][52795] DAMAGECOUNT value on done: 15888.0 [2024-08-05 22:50:18,061][52795] Sum rewards: 13.202, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.911', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'WEAPON3': '0.750', 'ARMOR': '0.855', 'HITCOUNT': '1.190', 'weapon3': '1.546', 'weapon2': '1.828', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:18,206][52667] DAMAGECOUNT value on done: 15489.0 [2024-08-05 22:50:18,206][52667] Sum rewards: 14.544, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.362', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.156', 'ARMOR': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '1.070', 'weapon2': '1.162', 'weapon3': '2.468', 'DAMAGECOUNT': '4.416', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:18,630][52803] DAMAGECOUNT value on done: 13194.0 [2024-08-05 22:50:18,631][52803] Sum rewards: 14.058, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.040', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON3': '0.250', 'HEALTH': '0.308', 'ARMOR': '0.900', 'HITCOUNT': '0.920', 'weapon3': '1.000', 'weapon2': '1.738', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:18,736][52671] DAMAGECOUNT value on done: 14659.0 [2024-08-05 22:50:18,738][52671] Sum rewards: 11.003, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'HEALTH': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.368', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'ARMOR': '0.918', 'weapon2': '1.578', 'weapon3': '1.756', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:18,853][52659] DAMAGECOUNT value on done: 14560.0 [2024-08-05 22:50:18,856][52659] Sum rewards: 6.830, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.859', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'ARMOR': '0.478', 'weapon4': '0.538', 'WEAPON3': '1.000', 'weapon2': '1.068', 'HITCOUNT': '1.090', 'weapon3': '2.104', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '6.500'} [2024-08-05 22:50:18,889][52664] DAMAGECOUNT value on done: 14547.0 [2024-08-05 22:50:18,890][52664] Sum rewards: 12.280, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.022', 'AMMO4': '0.058', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.424', 'ARMOR': '0.426', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon2': '0.952', 'weapon3': '1.404', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:20,089][52649] DAMAGECOUNT value on done: 13588.0 [2024-08-05 22:50:20,089][52649] Sum rewards: 20.710, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.372', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.298', 'ARMOR': '0.511', 'WEAPON3': '0.800', 'weapon2': '1.278', 'HITCOUNT': '1.370', 'weapon3': '1.850', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '17.000'} [2024-08-05 22:50:20,127][52658] DAMAGECOUNT value on done: 14117.0 [2024-08-05 22:50:20,129][52658] Sum rewards: 18.077, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.911', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.366', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'weapon2': '1.316', 'HITCOUNT': '1.340', 'weapon3': '1.906', 'DAMAGECOUNT': '4.578', 'FRAGCOUNT': '17.000'} [2024-08-05 22:50:20,309][52811] DAMAGECOUNT value on done: 13328.0 [2024-08-05 22:50:20,310][52811] Sum rewards: 11.824, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.032', 'AMMO5': '0.005', 'ARMOR': '0.015', 'AMMO2': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.910', 'weapon2': '1.414', 'weapon3': '1.506', 'DAMAGECOUNT': '3.435', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:21,242][52667] DAMAGECOUNT value on done: 15011.0 [2024-08-05 22:50:21,244][52667] Sum rewards: 5.035, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.926', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO3': '0.119', 'HITCOUNT': '0.810', 'WEAPON3': '0.900', 'ARMOR': '0.901', 'weapon2': '1.542', 'weapon3': '1.698', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '5.000'} [2024-08-05 22:50:21,301][52795] DAMAGECOUNT value on done: 16016.0 [2024-08-05 22:50:21,301][52795] Sum rewards: 10.419, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.777', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.126', 'weapon4': '0.188', 'WEAPON3': '0.700', 'ARMOR': '0.864', 'HITCOUNT': '1.030', 'weapon3': '1.608', 'weapon2': '2.002', 'DAMAGECOUNT': '3.321', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:21,320][52650] Updated weights for policy 0, policy_version 10521 (0.0030) [2024-08-05 22:50:21,489][52671] DAMAGECOUNT value on done: 14881.0 [2024-08-05 22:50:21,490][52671] Sum rewards: 14.775, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.077', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.008', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON3': '0.750', 'HITCOUNT': '0.940', 'ARMOR': '1.348', 'weapon2': '1.414', 'weapon3': '1.562', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:21,608][52659] DAMAGECOUNT value on done: 15041.0 [2024-08-05 22:50:21,609][52659] Sum rewards: 11.948, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.536', 'AMMO2': '0.015', 'AMMO3': '0.064', 'AMMO4': '0.075', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON3': '0.500', 'ARMOR': '0.892', 'weapon2': '1.060', 'HITCOUNT': '1.080', 'weapon3': '1.314', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:22,009][52803] DAMAGECOUNT value on done: 14057.0 [2024-08-05 22:50:22,019][52803] Sum rewards: 8.938, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.027', 'ARMOR': '0.044', 'AMMO3': '0.073', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'HEALTH': '0.203', 'WEAPON3': '0.450', 'weapon4': '0.808', 'HITCOUNT': '0.860', 'weapon2': '1.124', 'weapon3': '1.434', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '6.000'} [2024-08-05 22:50:22,195][52664] DAMAGECOUNT value on done: 16241.0 [2024-08-05 22:50:22,197][52664] Sum rewards: 24.843, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.814', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.094', 'HITCOUNT': '1.560', 'weapon3': '1.886', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '21.000'} [2024-08-05 22:50:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 86212608. Throughput: 0: 4189.6. Samples: 21556370. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 22:50:22,794][52567] Avg episode reward: [(0, '12.445')] [2024-08-05 22:50:23,217][52649] DAMAGECOUNT value on done: 14682.0 [2024-08-05 22:50:23,219][52649] Sum rewards: 7.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.590', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'ARMOR': '0.064', 'AMMO3': '0.118', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '1.304', 'weapon3': '1.764', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:23,357][52658] DAMAGECOUNT value on done: 14920.0 [2024-08-05 22:50:23,358][52658] Sum rewards: 9.239, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.195', 'AMMO4': '-0.090', 'AMMO2': '-0.018', 'AMMO3': '0.050', 'WEAPON3': '0.400', 'weapon3': '0.692', 'HITCOUNT': '0.820', 'ARMOR': '0.911', 'weapon2': '1.494', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:23,423][52811] DAMAGECOUNT value on done: 13235.0 [2024-08-05 22:50:23,425][52811] Sum rewards: 13.148, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.632', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.268', 'WEAPON3': '0.450', 'HITCOUNT': '0.840', 'ARMOR': '0.922', 'weapon3': '1.206', 'weapon2': '1.392', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:24,144][52667] DAMAGECOUNT value on done: 14324.0 [2024-08-05 22:50:24,144][52667] Sum rewards: 16.412, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.118', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.103', 'WEAPON4': '0.250', 'weapon4': '0.320', 'ARMOR': '0.496', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'weapon2': '1.274', 'weapon3': '1.586', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:24,406][52671] DAMAGECOUNT value on done: 15588.0 [2024-08-05 22:50:24,406][52671] Sum rewards: 14.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.050', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.224', 'ARMOR': '0.432', 'WEAPON3': '0.900', 'HITCOUNT': '1.070', 'weapon2': '1.220', 'weapon3': '1.878', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:24,501][52659] DAMAGECOUNT value on done: 14848.0 [2024-08-05 22:50:24,501][52659] Sum rewards: 12.967, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.532', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.174', 'ARMOR': '0.498', 'WEAPON3': '0.650', 'weapon2': '1.020', 'HITCOUNT': '1.100', 'weapon3': '1.672', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:24,554][52795] DAMAGECOUNT value on done: 15419.0 [2024-08-05 22:50:24,556][52795] Sum rewards: 17.873, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.201', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.280', 'ARMOR': '0.938', 'WEAPON3': '0.950', 'HITCOUNT': '1.070', 'weapon2': '1.198', 'weapon3': '2.070', 'DAMAGECOUNT': '5.328', 'FRAGCOUNT': '15.000'} [2024-08-05 22:50:24,638][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 22:50:25,092][52664] DAMAGECOUNT value on done: 13683.0 [2024-08-05 22:50:25,093][52664] Sum rewards: 12.902, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.271', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon7': '0.068', 'AMMO3': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.376', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'ARMOR': '0.975', 'weapon3': '1.700', 'weapon2': '1.736', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:25,309][52803] DAMAGECOUNT value on done: 12430.0 [2024-08-05 22:50:25,310][52803] Sum rewards: 9.503, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'weapon7': '0.136', 'WEAPON4': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON7': '0.400', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '0.570', 'weapon2': '0.842', 'weapon4': '0.864', 'weapon3': '1.034', 'DAMAGECOUNT': '2.568', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:25,931][52658] DAMAGECOUNT value on done: 13993.0 [2024-08-05 22:50:25,931][52658] Sum rewards: 10.471, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.050', 'HEALTH': '0.179', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.770', 'weapon3': '1.168', 'weapon2': '1.592', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '6.000'} [2024-08-05 22:50:26,117][52650] Updated weights for policy 0, policy_version 10531 (0.0036) [2024-08-05 22:50:26,228][52649] DAMAGECOUNT value on done: 15018.0 [2024-08-05 22:50:26,230][52649] Sum rewards: 10.226, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO2': '0.040', 'AMMO3': '0.089', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.726', 'HITCOUNT': '0.880', 'ARMOR': '0.912', 'weapon2': '0.916', 'weapon3': '1.562', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:26,615][52811] DAMAGECOUNT value on done: 14237.0 [2024-08-05 22:50:26,615][52811] Sum rewards: 13.613, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.934', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.370', 'ARMOR': '0.468', 'WEAPON3': '0.750', 'HITCOUNT': '1.300', 'weapon3': '1.540', 'weapon2': '1.866', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:26,671][52667] DAMAGECOUNT value on done: 15278.0 [2024-08-05 22:50:26,672][52667] Sum rewards: 18.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.411', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.310', 'ARMOR': '0.836', 'WEAPON3': '1.050', 'weapon2': '1.136', 'HITCOUNT': '1.460', 'weapon3': '2.068', 'DAMAGECOUNT': '5.286', 'FRAGCOUNT': '18.000'} [2024-08-05 22:50:27,748][52671] DAMAGECOUNT value on done: 15115.0 [2024-08-05 22:50:27,748][52671] Sum rewards: 12.747, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.500', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon4': '0.014', 'ARMOR': '0.020', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.674', 'weapon3': '1.850', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 86294528. Throughput: 0: 4203.3. Samples: 21581970. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 22:50:27,794][52567] Avg episode reward: [(0, '12.475')] [2024-08-05 22:50:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010534_86294528.pth... [2024-08-05 22:50:27,859][52795] DAMAGECOUNT value on done: 13914.0 [2024-08-05 22:50:27,860][52795] Sum rewards: 12.282, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.541', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon7': '0.048', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.362', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'weapon2': '1.204', 'weapon3': '1.386', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:27,893][52659] DAMAGECOUNT value on done: 15173.0 [2024-08-05 22:50:27,894][52659] Sum rewards: 10.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon4': '0.202', 'ARMOR': '0.416', 'WEAPON3': '0.950', 'weapon2': '1.240', 'HITCOUNT': '1.390', 'weapon3': '2.004', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:27,958][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010042_82264064.pth [2024-08-05 22:50:28,133][52664] DAMAGECOUNT value on done: 14072.0 [2024-08-05 22:50:28,133][52664] Sum rewards: 9.601, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.654', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.112', 'WEAPON3': '0.450', 'HITCOUNT': '0.840', 'weapon2': '1.158', 'weapon3': '1.208', 'ARMOR': '1.340', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:28,614][52658] DAMAGECOUNT value on done: 14349.0 [2024-08-05 22:50:28,616][52658] Sum rewards: 11.745, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.747', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '0.600', 'HITCOUNT': '0.620', 'weapon2': '0.766', 'ARMOR': '0.908', 'weapon3': '1.944', 'DAMAGECOUNT': '2.340', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:28,780][52803] DAMAGECOUNT value on done: 13028.0 [2024-08-05 22:50:28,785][52803] Sum rewards: 9.611, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.664', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon4': '0.226', 'ARMOR': '0.931', 'WEAPON3': '1.000', 'HITCOUNT': '1.040', 'weapon2': '1.370', 'weapon3': '1.636', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:29,157][52649] DAMAGECOUNT value on done: 14021.0 [2024-08-05 22:50:29,160][52649] Sum rewards: 14.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.061', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO4': '0.024', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.852', 'HITCOUNT': '1.230', 'weapon3': '1.596', 'weapon2': '1.826', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:30,089][52811] DAMAGECOUNT value on done: 12665.0 [2024-08-05 22:50:30,091][52811] Sum rewards: 18.425, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.086', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.054', 'WEAPON4': '0.150', 'weapon4': '0.218', 'WEAPON3': '0.400', 'ARMOR': '0.460', 'HITCOUNT': '1.010', 'weapon3': '1.064', 'weapon2': '1.398', 'DAMAGECOUNT': '3.378', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:30,791][52671] DAMAGECOUNT value on done: 14961.0 [2024-08-05 22:50:30,792][52671] Sum rewards: 22.383, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.671', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.174', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.388', 'HITCOUNT': '1.530', 'weapon3': '1.690', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '17.000'} [2024-08-05 22:50:30,858][52659] DAMAGECOUNT value on done: 14040.0 [2024-08-05 22:50:30,861][52659] Sum rewards: 16.771, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'AMMO4': '0.139', 'weapon4': '0.240', 'WEAPON3': '0.550', 'HEALTH': '0.750', 'ARMOR': '0.820', 'HITCOUNT': '1.110', 'weapon2': '1.622', 'weapon3': '1.726', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:30,884][52664] DAMAGECOUNT value on done: 13639.0 [2024-08-05 22:50:30,885][52664] Sum rewards: 14.859, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.102', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.010', 'weapon7': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.130', 'HITCOUNT': '1.180', 'weapon3': '1.974', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:31,143][52795] DAMAGECOUNT value on done: 13386.0 [2024-08-05 22:50:31,145][52795] Sum rewards: 13.134, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.022', 'AMMO3': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON3': '0.300', 'ARMOR': '0.400', 'weapon4': '0.428', 'HEALTH': '0.548', 'HITCOUNT': '0.850', 'weapon3': '1.210', 'weapon2': '1.288', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:31,225][52650] Updated weights for policy 0, policy_version 10541 (0.0029) [2024-08-05 22:50:31,856][52658] DAMAGECOUNT value on done: 15658.0 [2024-08-05 22:50:31,858][52658] Sum rewards: 10.535, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.010', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.141', 'weapon4': '0.170', 'WEAPON3': '0.400', 'HITCOUNT': '0.840', 'ARMOR': '0.928', 'weapon3': '1.276', 'weapon2': '1.904', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:32,015][52803] DAMAGECOUNT value on done: 12919.0 [2024-08-05 22:50:32,015][52803] Sum rewards: 12.753, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.444', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.010', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon3': '1.640', 'weapon2': '1.692', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '11.500'} [2024-08-05 22:50:32,349][52649] DAMAGECOUNT value on done: 16774.0 [2024-08-05 22:50:32,352][52649] Sum rewards: 21.847, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.652', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.099', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.290', 'weapon2': '1.640', 'weapon3': '1.704', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '18.000'} [2024-08-05 22:50:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 86376448. Throughput: 0: 4183.6. Samples: 21593750. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 22:50:32,794][52567] Avg episode reward: [(0, '12.815')] [2024-08-05 22:50:33,411][52811] DAMAGECOUNT value on done: 13425.0 [2024-08-05 22:50:33,414][52811] Sum rewards: 10.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.483', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.310', 'ARMOR': '0.412', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon3': '1.448', 'weapon2': '1.472', 'DAMAGECOUNT': '3.468', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:33,888][52664] DAMAGECOUNT value on done: 15356.0 [2024-08-05 22:50:33,891][52664] Sum rewards: 8.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.444', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '1.360', 'weapon2': '1.462', 'weapon3': '2.118', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:34,269][52671] DAMAGECOUNT value on done: 15494.0 [2024-08-05 22:50:34,269][52671] Sum rewards: 10.375, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.007', 'HEALTH': '0.026', 'AMMO4': '0.035', 'AMMO3': '0.070', 'WEAPON3': '0.450', 'HITCOUNT': '0.940', 'ARMOR': '1.226', 'weapon3': '1.280', 'weapon2': '1.680', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:34,300][52659] DAMAGECOUNT value on done: 15839.0 [2024-08-05 22:50:34,300][52659] Sum rewards: 16.612, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.822', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.118', 'WEAPON3': '0.750', 'HITCOUNT': '1.140', 'ARMOR': '1.276', 'weapon3': '1.738', 'weapon2': '1.834', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:34,429][52795] DAMAGECOUNT value on done: 15097.0 [2024-08-05 22:50:34,433][52795] Sum rewards: 13.655, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.484', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.133', 'weapon4': '0.230', 'WEAPON3': '0.850', 'HITCOUNT': '1.070', 'weapon2': '1.204', 'weapon3': '1.958', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:34,866][52649] DAMAGECOUNT value on done: 13357.0 [2024-08-05 22:50:34,875][52649] Sum rewards: 13.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO4': '-0.105', 'AMMO2': '-0.021', 'AMMO3': '0.087', 'WEAPON3': '0.700', 'ARMOR': '0.909', 'HITCOUNT': '1.060', 'weapon3': '1.588', 'weapon2': '1.626', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:34,898][52658] DAMAGECOUNT value on done: 14580.0 [2024-08-05 22:50:34,898][52658] Sum rewards: 14.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO2': '0.019', 'ARMOR': '0.045', 'AMMO4': '0.092', 'AMMO3': '0.114', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '0.800', 'HITCOUNT': '1.120', 'weapon2': '1.200', 'weapon3': '1.838', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:35,355][52803] DAMAGECOUNT value on done: 14016.0 [2024-08-05 22:50:35,357][52803] Sum rewards: 9.844, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.086', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.172', 'ARMOR': '1.264', 'weapon3': '2.084', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:36,351][52650] Updated weights for policy 0, policy_version 10551 (0.0013) [2024-08-05 22:50:36,561][52811] DAMAGECOUNT value on done: 13481.0 [2024-08-05 22:50:36,562][52811] Sum rewards: 12.981, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.792', 'AMMO2': '0.001', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.007', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon4': '0.234', 'WEAPON3': '0.900', 'weapon2': '0.984', 'HITCOUNT': '1.130', 'weapon3': '2.024', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:37,059][52664] DAMAGECOUNT value on done: 12834.0 [2024-08-05 22:50:37,059][52664] Sum rewards: 14.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.091', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon5': '0.238', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.050', 'weapon2': '1.512', 'weapon3': '1.910', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:37,541][52649] DAMAGECOUNT value on done: 13258.0 [2024-08-05 22:50:37,543][52649] Sum rewards: 10.793, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.130', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.300', 'ARMOR': '0.490', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'weapon2': '1.586', 'weapon3': '1.664', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:37,686][52671] DAMAGECOUNT value on done: 16525.0 [2024-08-05 22:50:37,688][52671] Sum rewards: 13.882, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.164', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO3': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.514', 'ARMOR': '0.544', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'weapon2': '1.244', 'weapon3': '1.596', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:37,699][52659] DAMAGECOUNT value on done: 14895.0 [2024-08-05 22:50:37,700][52659] Sum rewards: 16.820, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.360', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon4': '0.008', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon2': '1.362', 'weapon3': '1.632', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '15.000'} [2024-08-05 22:50:37,711][52795] DAMAGECOUNT value on done: 12652.0 [2024-08-05 22:50:37,716][52795] Sum rewards: 7.992, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.065', 'weapon4': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.032', 'ARMOR': '0.036', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon2': '1.158', 'weapon3': '1.562', 'DAMAGECOUNT': '2.865', 'FRAGCOUNT': '6.000'} [2024-08-05 22:50:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 86458368. Throughput: 0: 4185.3. Samples: 21619110. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:50:37,794][52567] Avg episode reward: [(0, '12.576')] [2024-08-05 22:50:37,965][52658] DAMAGECOUNT value on done: 17078.0 [2024-08-05 22:50:37,966][52658] Sum rewards: 14.081, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.029', 'ARMOR': '0.036', 'HEALTH': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.087', 'weapon7': '0.106', 'AMMO4': '0.145', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '0.670', 'weapon4': '0.754', 'weapon2': '0.812', 'weapon3': '1.486', 'DAMAGECOUNT': '3.498', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:38,781][52803] DAMAGECOUNT value on done: 15300.0 [2024-08-05 22:50:38,782][52803] Sum rewards: 20.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.866', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.272', 'WEAPON3': '0.850', 'HITCOUNT': '1.130', 'weapon2': '1.270', 'ARMOR': '1.336', 'weapon3': '1.880', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '17.000'} [2024-08-05 22:50:39,618][52811] DAMAGECOUNT value on done: 13602.0 [2024-08-05 22:50:39,622][52811] Sum rewards: 10.592, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.282', 'AMMO2': '0.036', 'AMMO3': '0.085', 'AMMO4': '0.178', 'weapon4': '0.284', 'WEAPON4': '0.450', 'ARMOR': '0.547', 'WEAPON3': '0.650', 'HITCOUNT': '1.130', 'weapon2': '1.586', 'weapon3': '1.784', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:40,082][52664] DAMAGECOUNT value on done: 16062.0 [2024-08-05 22:50:40,082][52664] Sum rewards: 11.162, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.218', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.328', 'ARMOR': '0.495', 'WEAPON3': '0.950', 'weapon2': '1.068', 'HITCOUNT': '1.130', 'weapon3': '2.190', 'DAMAGECOUNT': '3.861', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:40,547][52649] DAMAGECOUNT value on done: 15322.0 [2024-08-05 22:50:40,549][52649] Sum rewards: 16.828, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.122', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'weapon4': '0.376', 'ARMOR': '0.461', 'WEAPON3': '0.500', 'HITCOUNT': '1.060', 'weapon3': '1.358', 'weapon2': '1.486', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:40,657][52671] DAMAGECOUNT value on done: 14939.0 [2024-08-05 22:50:40,658][52671] Sum rewards: 13.981, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.654', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.086', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'HITCOUNT': '1.030', 'weapon2': '1.304', 'weapon3': '1.672', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:40,681][52659] DAMAGECOUNT value on done: 13063.0 [2024-08-05 22:50:40,682][52659] Sum rewards: 15.977, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.229', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.091', 'weapon4': '0.190', 'WEAPON3': '0.550', 'ARMOR': '0.887', 'HITCOUNT': '1.040', 'weapon3': '1.442', 'weapon2': '1.636', 'DAMAGECOUNT': '3.516', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:40,929][52650] Updated weights for policy 0, policy_version 10561 (0.0022) [2024-08-05 22:50:40,957][52658] DAMAGECOUNT value on done: 15536.0 [2024-08-05 22:50:40,958][52658] Sum rewards: 9.869, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.790', 'AMMO2': '0.018', 'ARMOR': '0.028', 'AMMO4': '0.089', 'AMMO3': '0.125', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '1.160', 'weapon2': '1.300', 'weapon3': '1.786', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:41,038][52795] DAMAGECOUNT value on done: 13101.0 [2024-08-05 22:50:41,039][52795] Sum rewards: 6.031, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.627', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'ARMOR': '0.004', 'weapon4': '0.008', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON3': '0.400', 'HITCOUNT': '0.590', 'weapon3': '1.202', 'weapon2': '1.294', 'DAMAGECOUNT': '2.070', 'FRAGCOUNT': '4.000'} [2024-08-05 22:50:42,535][52664] DAMAGECOUNT value on done: 12952.0 [2024-08-05 22:50:42,535][52664] Sum rewards: 7.681, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.945', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon4': '0.286', 'WEAPON3': '0.450', 'HITCOUNT': '0.780', 'weapon2': '1.216', 'weapon3': '1.232', 'DAMAGECOUNT': '2.622', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:42,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 86540288. Throughput: 0: 4198.5. Samples: 21644600. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:50:42,794][52567] Avg episode reward: [(0, '12.798')] [2024-08-05 22:50:42,865][52811] DAMAGECOUNT value on done: 13976.0 [2024-08-05 22:50:42,867][52811] Sum rewards: 15.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.816', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.066', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'ARMOR': '0.891', 'WEAPON3': '1.050', 'HITCOUNT': '1.140', 'weapon2': '1.498', 'weapon3': '1.864', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:43,570][52658] DAMAGECOUNT value on done: 14763.0 [2024-08-05 22:50:43,571][52658] Sum rewards: 5.867, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.446', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.122', 'AMMO4': '0.146', 'weapon4': '0.324', 'WEAPON4': '0.350', 'ARMOR': '0.556', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.346', 'weapon3': '2.022', 'DAMAGECOUNT': '2.841', 'FRAGCOUNT': '6.000'} [2024-08-05 22:50:43,656][52649] DAMAGECOUNT value on done: 13582.0 [2024-08-05 22:50:43,657][52649] Sum rewards: 11.761, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.153', 'HEALTH': '0.182', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'weapon4': '0.448', 'WEAPON3': '0.600', 'weapon2': '0.908', 'HITCOUNT': '0.920', 'weapon3': '1.626', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:44,231][52795] DAMAGECOUNT value on done: 16341.0 [2024-08-05 22:50:44,232][52795] Sum rewards: 16.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.611', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.280', 'weapon2': '1.472', 'weapon3': '1.680', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '15.000'} [2024-08-05 22:50:44,246][52671] DAMAGECOUNT value on done: 15067.0 [2024-08-05 22:50:44,249][52659] DAMAGECOUNT value on done: 14295.0 [2024-08-05 22:50:44,248][52671] Sum rewards: 10.592, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.677', 'AMMO2': '0.034', 'AMMO3': '0.095', 'AMMO4': '0.169', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '0.650', 'HITCOUNT': '0.790', 'ARMOR': '0.800', 'weapon2': '1.144', 'weapon3': '1.800', 'DAMAGECOUNT': '2.883', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:44,249][52659] Sum rewards: 11.091, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.304', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON3': '0.400', 'ARMOR': '0.471', 'HITCOUNT': '0.740', 'weapon3': '1.080', 'weapon2': '1.482', 'DAMAGECOUNT': '2.802', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:45,544][52664] DAMAGECOUNT value on done: 14848.0 [2024-08-05 22:50:45,544][52664] Sum rewards: 14.680, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.831', 'AMMO2': '0.032', 'ARMOR': '0.064', 'AMMO3': '0.129', 'AMMO4': '0.160', 'WEAPON4': '0.400', 'weapon4': '0.552', 'weapon2': '0.832', 'WEAPON3': '0.900', 'HITCOUNT': '1.160', 'weapon3': '2.110', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:45,938][52650] Updated weights for policy 0, policy_version 10571 (0.0043) [2024-08-05 22:50:46,460][52658] DAMAGECOUNT value on done: 13862.0 [2024-08-05 22:50:46,460][52658] Sum rewards: 8.665, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.666', 'AMMO2': '0.025', 'ARMOR': '0.052', 'weapon7': '0.054', 'AMMO3': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.690', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon2': '1.024', 'weapon3': '1.870', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:46,555][52649] DAMAGECOUNT value on done: 16012.0 [2024-08-05 22:50:46,556][52649] Sum rewards: 11.451, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.239', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon5': '0.014', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'weapon4': '0.558', 'HITCOUNT': '1.120', 'ARMOR': '1.355', 'weapon2': '1.396', 'weapon3': '1.442', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:47,146][52671] DAMAGECOUNT value on done: 16675.0 [2024-08-05 22:50:47,146][52671] Sum rewards: 14.679, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.158', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.302', 'WEAPON3': '0.650', 'weapon2': '1.076', 'HITCOUNT': '1.100', 'weapon3': '1.680', 'DAMAGECOUNT': '3.798', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:47,189][52659] DAMAGECOUNT value on done: 16475.0 [2024-08-05 22:50:47,189][52659] Sum rewards: 20.522, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.114', 'weapon4': '0.220', 'HEALTH': '0.328', 'ARMOR': '0.404', 'WEAPON3': '0.600', 'weapon2': '1.112', 'HITCOUNT': '1.440', 'weapon3': '1.764', 'DAMAGECOUNT': '6.153', 'FRAGCOUNT': '14.000'} [2024-08-05 22:50:47,671][52795] DAMAGECOUNT value on done: 14341.0 [2024-08-05 22:50:47,673][52795] Sum rewards: 7.927, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.120', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon7': '0.062', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'weapon4': '0.516', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon2': '1.096', 'weapon3': '1.774', 'DAMAGECOUNT': '2.787', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 86630400. Throughput: 0: 4204.5. Samples: 21657240. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:50:47,794][52567] Avg episode reward: [(0, '13.041')] [2024-08-05 22:50:48,697][52664] DAMAGECOUNT value on done: 15406.0 [2024-08-05 22:50:48,697][52664] Sum rewards: 13.174, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.052', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.048', 'AMMO4': '0.056', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.232', 'WEAPON3': '0.700', 'ARMOR': '0.856', 'weapon2': '0.922', 'HITCOUNT': '0.990', 'weapon3': '1.614', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:48,862][52658] DAMAGECOUNT value on done: 16181.0 [2024-08-05 22:50:48,864][52658] Sum rewards: 23.272, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.865', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.060', 'WEAPON3': '0.500', 'weapon2': '1.364', 'weapon3': '1.400', 'HITCOUNT': '1.480', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '18.000'} [2024-08-05 22:50:49,866][52649] DAMAGECOUNT value on done: 14617.0 [2024-08-05 22:50:49,867][52649] Sum rewards: 12.417, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.138', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.007', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.262', 'weapon5': '0.382', 'ARMOR': '0.408', 'WEAPON3': '0.450', 'HITCOUNT': '0.550', 'weapon2': '0.994', 'weapon3': '1.238', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '9.000'} [2024-08-05 22:50:50,294][52671] DAMAGECOUNT value on done: 13210.0 [2024-08-05 22:50:50,297][52671] Sum rewards: 7.017, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.345', 'AMMO5': '0.009', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon5': '0.034', 'AMMO4': '0.053', 'AMMO3': '0.123', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HITCOUNT': '0.770', 'WEAPON3': '0.900', 'weapon2': '1.122', 'weapon3': '2.132', 'DAMAGECOUNT': '2.598', 'FRAGCOUNT': '7.500'} [2024-08-05 22:50:50,346][52659] DAMAGECOUNT value on done: 14733.0 [2024-08-05 22:50:50,347][52659] Sum rewards: 6.671, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.348', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.948', 'HITCOUNT': '0.970', 'weapon2': '1.392', 'weapon3': '1.570', 'FRAGCOUNT': '3.000', 'DAMAGECOUNT': '3.174'} [2024-08-05 22:50:50,783][52650] Updated weights for policy 0, policy_version 10581 (0.0050) [2024-08-05 22:50:50,890][52795] DAMAGECOUNT value on done: 13383.0 [2024-08-05 22:50:50,894][52795] Sum rewards: 10.490, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.108', 'weapon4': '0.260', 'ARMOR': '0.487', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon3': '1.602', 'weapon2': '1.788', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:52,792][52649] DAMAGECOUNT value on done: 16638.0 [2024-08-05 22:50:52,793][52649] Sum rewards: 15.525, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.000', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.014', 'ARMOR': '0.040', 'weapon7': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'weapon2': '0.986', 'HITCOUNT': '1.020', 'weapon3': '1.362', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '13.000'} [2024-08-05 22:50:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 86712320. Throughput: 0: 4200.4. Samples: 21682320. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:50:52,794][52567] Avg episode reward: [(0, '13.076')] [2024-08-05 22:50:53,422][52671] DAMAGECOUNT value on done: 13710.0 [2024-08-05 22:50:53,422][52671] Sum rewards: 8.096, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.669', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.220', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'weapon2': '0.898', 'HITCOUNT': '0.920', 'weapon3': '1.488', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '6.000'} [2024-08-05 22:50:53,426][52659] DAMAGECOUNT value on done: 14263.0 [2024-08-05 22:50:53,428][52659] Sum rewards: 11.713, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.222', 'weapon7': '0.002', 'AMMO2': '0.009', 'AMMO4': '0.042', 'ARMOR': '0.052', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '1.000', 'HITCOUNT': '1.070', 'weapon2': '1.164', 'weapon3': '2.076', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '12.000'} [2024-08-05 22:50:54,273][52795] DAMAGECOUNT value on done: 14954.0 [2024-08-05 22:50:54,274][52795] Sum rewards: 6.947, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.680', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.119', 'WEAPON4': '0.350', 'weapon4': '0.598', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '0.856', 'ARMOR': '0.945', 'weapon3': '1.678', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '7.000'} [2024-08-05 22:50:55,397][52650] Updated weights for policy 0, policy_version 10591 (0.0025) [2024-08-05 22:50:56,582][52671] DAMAGECOUNT value on done: 15168.0 [2024-08-05 22:50:56,583][52671] Sum rewards: 8.411, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.096', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'AMMO4': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.356', 'ARMOR': '0.460', 'WEAPON3': '0.750', 'HITCOUNT': '0.930', 'weapon2': '1.096', 'weapon3': '1.672', 'DAMAGECOUNT': '3.147', 'FRAGCOUNT': '8.000'} [2024-08-05 22:50:56,591][52659] DAMAGECOUNT value on done: 14119.0 [2024-08-05 22:50:56,595][52659] Sum rewards: 11.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.288', 'weapon2': '0.852', 'WEAPON3': '0.950', 'HITCOUNT': '1.090', 'ARMOR': '1.330', 'weapon3': '1.852', 'DAMAGECOUNT': '4.347', 'FRAGCOUNT': '11.000'} [2024-08-05 22:50:57,608][52795] DAMAGECOUNT value on done: 14684.0 [2024-08-05 22:50:57,610][52795] Sum rewards: 13.249, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.659', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.054', 'weapon7': '0.060', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '1.020', 'weapon3': '1.534', 'weapon2': '1.856', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '10.000'} [2024-08-05 22:50:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 86794240. Throughput: 0: 4208.5. Samples: 21707710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:50:57,794][52567] Avg episode reward: [(0, '12.966')] [2024-08-05 22:50:59,359][52671] DAMAGECOUNT value on done: 14598.0 [2024-08-05 22:50:59,361][52671] Sum rewards: 20.759, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.080', 'HEALTH': '0.236', 'WEAPON3': '0.500', 'HITCOUNT': '1.160', 'ARMOR': '1.250', 'weapon2': '1.422', 'weapon3': '1.510', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '15.000'} [2024-08-05 22:50:59,378][52659] DAMAGECOUNT value on done: 15253.0 [2024-08-05 22:50:59,378][52659] Sum rewards: 8.782, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.514', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'ARMOR': '0.490', 'weapon4': '0.490', 'WEAPON3': '0.500', 'HITCOUNT': '0.500', 'weapon2': '0.832', 'weapon3': '1.100', 'DAMAGECOUNT': '1.845', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:00,167][52650] Updated weights for policy 0, policy_version 10601 (0.0036) [2024-08-05 22:51:00,916][52795] DAMAGECOUNT value on done: 15571.0 [2024-08-05 22:51:00,918][52795] Sum rewards: 12.856, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.094', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.030', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.162', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.100', 'weapon2': '1.142', 'HITCOUNT': '1.350', 'weapon3': '2.098', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:02,275][52659] DAMAGECOUNT value on done: 15736.0 [2024-08-05 22:51:02,283][52659] Sum rewards: 17.952, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.381', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.588', 'weapon2': '0.670', 'ARMOR': '0.882', 'WEAPON3': '1.000', 'HITCOUNT': '1.320', 'weapon3': '1.998', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '17.000'} [2024-08-05 22:51:02,286][52671] DAMAGECOUNT value on done: 16283.0 [2024-08-05 22:51:02,287][52671] Sum rewards: 7.200, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.387', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.053', 'WEAPON3': '0.400', 'ARMOR': '0.447', 'HITCOUNT': '0.670', 'weapon3': '1.102', 'weapon2': '1.672', 'DAMAGECOUNT': '2.253', 'FRAGCOUNT': '4.000'} [2024-08-05 22:51:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.7, 300 sec: 16800.6). Total num frames: 86884352. Throughput: 0: 4213.3. Samples: 21720490. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:51:02,796][52567] Avg episode reward: [(0, '12.874')] [2024-08-05 22:51:04,424][52795] DAMAGECOUNT value on done: 13816.0 [2024-08-05 22:51:04,424][52795] Sum rewards: 19.262, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.180', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.364', 'weapon5': '0.380', 'weapon2': '0.422', 'ARMOR': '0.504', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon3': '1.836', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:04,894][52650] Updated weights for policy 0, policy_version 10611 (0.0012) [2024-08-05 22:51:05,013][52659] DAMAGECOUNT value on done: 17002.0 [2024-08-05 22:51:05,013][52659] Sum rewards: 18.567, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.128', 'weapon5': '0.178', 'WEAPON4': '0.200', 'ARMOR': '0.468', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon2': '1.310', 'weapon3': '1.888', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:05,030][52671] DAMAGECOUNT value on done: 12878.0 [2024-08-05 22:51:05,030][52671] Sum rewards: 3.765, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.750', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.065', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'HITCOUNT': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.500', 'weapon2': '0.832', 'weapon3': '1.204', 'DAMAGECOUNT': '1.272', 'FRAGCOUNT': '3.000'} [2024-08-05 22:51:07,396][52668] DAMAGECOUNT value on done: 14619.0 [2024-08-05 22:51:07,398][52668] Sum rewards: 19.746, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.414', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.119', 'WEAPON4': '0.350', 'ARMOR': '0.522', 'weapon4': '0.594', 'weapon2': '0.936', 'WEAPON3': '0.950', 'HITCOUNT': '1.220', 'weapon3': '2.008', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '17.000'} [2024-08-05 22:51:07,760][52795] DAMAGECOUNT value on done: 14196.0 [2024-08-05 22:51:07,763][52795] Sum rewards: 11.832, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.126', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO3': '0.078', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'weapon2': '1.030', 'HITCOUNT': '1.050', 'weapon3': '1.318', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 86966272. Throughput: 0: 4214.4. Samples: 21746020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:51:07,794][52567] Avg episode reward: [(0, '12.920')] [2024-08-05 22:51:07,817][52794] DAMAGECOUNT value on done: 16874.0 [2024-08-05 22:51:07,817][52794] Sum rewards: 13.218, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.085', 'AMMO2': '0.001', 'AMMO4': '0.005', 'ARMOR': '0.036', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.316', 'WEAPON3': '0.950', 'HITCOUNT': '1.170', 'weapon2': '1.484', 'weapon3': '1.914', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:08,415][52659] DAMAGECOUNT value on done: 13493.0 [2024-08-05 22:51:08,417][52659] Sum rewards: 5.709, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.238', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.304', 'HITCOUNT': '0.640', 'WEAPON3': '0.700', 'weapon2': '1.176', 'ARMOR': '1.270', 'weapon3': '1.362', 'DAMAGECOUNT': '2.178', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:08,438][52671] DAMAGECOUNT value on done: 16098.0 [2024-08-05 22:51:08,439][52671] Sum rewards: 6.184, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.522', 'HITCOUNT': '0.770', 'WEAPON3': '0.800', 'weapon2': '1.298', 'weapon3': '2.034', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '6.000'} [2024-08-05 22:51:08,975][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:51:09,986][52650] Updated weights for policy 0, policy_version 10621 (0.0012) [2024-08-05 22:51:10,749][52794] DAMAGECOUNT value on done: 18340.0 [2024-08-05 22:51:10,749][52794] Sum rewards: 17.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.775', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.234', 'weapon5': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.883', 'weapon2': '0.966', 'HITCOUNT': '1.060', 'weapon3': '1.746', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '14.000'} [2024-08-05 22:51:10,956][52659] DAMAGECOUNT value on done: 15065.0 [2024-08-05 22:51:10,958][52659] Sum rewards: 8.919, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.669', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.002', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'ARMOR': '0.513', 'WEAPON3': '0.650', 'HITCOUNT': '0.840', 'weapon2': '1.276', 'weapon3': '1.578', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:11,161][52668] DAMAGECOUNT value on done: 15958.0 [2024-08-05 22:51:11,162][52668] Sum rewards: 8.284, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.024', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.440', 'WEAPON3': '0.450', 'HITCOUNT': '0.740', 'weapon2': '1.328', 'weapon3': '1.412', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 16800.5). Total num frames: 87048192. Throughput: 0: 4194.9. Samples: 21770740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:51:12,794][52567] Avg episode reward: [(0, '12.660')] [2024-08-05 22:51:12,831][52662] DAMAGECOUNT value on done: 16264.0 [2024-08-05 22:51:12,831][52662] Sum rewards: 7.719, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.374', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.044', 'AMMO3': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.324', 'WEAPON3': '0.400', 'ARMOR': '0.478', 'HITCOUNT': '0.700', 'weapon3': '0.952', 'weapon2': '1.382', 'DAMAGECOUNT': '2.274', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:13,288][52794] DAMAGECOUNT value on done: 18741.0 [2024-08-05 22:51:13,289][52794] Sum rewards: 18.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.684', 'AMMO2': '0.024', 'ARMOR': '0.063', 'AMMO4': '0.118', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.412', 'WEAPON3': '0.750', 'weapon2': '1.054', 'HITCOUNT': '1.110', 'weapon3': '1.706', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:13,969][52668] DAMAGECOUNT value on done: 14362.0 [2024-08-05 22:51:13,969][52668] Sum rewards: 6.861, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.691', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'weapon4': '0.078', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon3': '1.212', 'ARMOR': '1.369', 'weapon2': '1.814', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:14,106][52659] DAMAGECOUNT value on done: 13082.0 [2024-08-05 22:51:14,107][52659] Sum rewards: 13.310, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.842', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'ARMOR': '0.047', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'WEAPON3': '0.950', 'HITCOUNT': '1.290', 'weapon2': '1.620', 'weapon3': '1.910', 'DAMAGECOUNT': '4.443', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:14,802][52650] Updated weights for policy 0, policy_version 10631 (0.0013) [2024-08-05 22:51:14,879][52660] DAMAGECOUNT value on done: 15995.0 [2024-08-05 22:51:14,880][52660] Sum rewards: 16.550, reward structure: {'DEATHCOUNT': '-8.250', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'HEALTH': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.128', 'weapon5': '0.136', 'WEAPON3': '0.700', 'weapon2': '1.042', 'HITCOUNT': '1.140', 'weapon3': '1.952', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '15.000'} [2024-08-05 22:51:15,795][52662] DAMAGECOUNT value on done: 17575.0 [2024-08-05 22:51:15,795][52662] Sum rewards: 21.030, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'AMMO4': '0.208', 'ARMOR': '0.440', 'weapon4': '0.550', 'WEAPON3': '0.600', 'HEALTH': '0.732', 'weapon2': '1.042', 'HITCOUNT': '1.310', 'weapon3': '1.720', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:16,264][52794] DAMAGECOUNT value on done: 16154.0 [2024-08-05 22:51:16,265][52794] Sum rewards: 13.474, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.745', 'AMMO2': '0.013', 'weapon7': '0.052', 'AMMO4': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.338', 'ARMOR': '0.448', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'weapon2': '1.540', 'weapon3': '1.862', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:16,276][52668] DAMAGECOUNT value on done: 14719.0 [2024-08-05 22:51:16,277][52668] Sum rewards: 15.523, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.877', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'weapon4': '0.536', 'WEAPON3': '0.700', 'ARMOR': '0.832', 'weapon2': '1.042', 'HITCOUNT': '1.270', 'weapon3': '1.890', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:17,339][52659] DAMAGECOUNT value on done: 15683.0 [2024-08-05 22:51:17,350][52659] Sum rewards: 13.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.452', 'weapon4': '0.028', 'AMMO2': '0.036', 'AMMO3': '0.153', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'ARMOR': '0.887', 'WEAPON3': '0.900', 'HITCOUNT': '1.190', 'weapon2': '1.532', 'weapon3': '2.122', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:17,742][52660] DAMAGECOUNT value on done: 15821.0 [2024-08-05 22:51:17,744][52660] Sum rewards: 16.503, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.612', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'weapon5': '0.110', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'ARMOR': '1.253', 'weapon3': '1.304', 'weapon2': '1.770', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:17,782][52820] DAMAGECOUNT value on done: 11983.0 [2024-08-05 22:51:17,786][52820] Sum rewards: 18.237, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.247', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.410', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'HITCOUNT': '1.150', 'weapon2': '1.226', 'weapon3': '1.754', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '15.000'} [2024-08-05 22:51:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 87130112. Throughput: 0: 4214.0. Samples: 21783380. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:51:17,794][52567] Avg episode reward: [(0, '12.903')] [2024-08-05 22:51:18,678][52662] DAMAGECOUNT value on done: 19569.0 [2024-08-05 22:51:18,680][52662] Sum rewards: 25.398, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.589', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.238', 'WEAPON3': '0.600', 'ARMOR': '0.875', 'HITCOUNT': '1.410', 'weapon2': '1.510', 'weapon3': '1.652', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '20.000'} [2024-08-05 22:51:19,266][52794] DAMAGECOUNT value on done: 19003.0 [2024-08-05 22:51:19,266][52794] Sum rewards: 19.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.204', 'ARMOR': '0.854', 'weapon2': '1.054', 'WEAPON3': '1.150', 'HITCOUNT': '1.500', 'weapon3': '2.410', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '18.000'} [2024-08-05 22:51:19,421][52668] DAMAGECOUNT value on done: 15081.0 [2024-08-05 22:51:19,421][52668] Sum rewards: 13.059, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO3': '0.108', 'WEAPON3': '0.750', 'ARMOR': '0.930', 'HITCOUNT': '1.060', 'weapon2': '1.464', 'weapon3': '1.672', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:19,866][52650] Updated weights for policy 0, policy_version 10641 (0.0019) [2024-08-05 22:51:20,783][52660] DAMAGECOUNT value on done: 14342.0 [2024-08-05 22:51:20,783][52660] Sum rewards: 17.375, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.786', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.016', 'ARMOR': '0.016', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'weapon2': '1.274', 'HITCOUNT': '1.410', 'weapon3': '1.694', 'DAMAGECOUNT': '5.166', 'FRAGCOUNT': '14.500'} [2024-08-05 22:51:21,139][52820] DAMAGECOUNT value on done: 13707.0 [2024-08-05 22:51:21,139][52820] Sum rewards: 8.340, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.095', 'HEALTH': '0.270', 'WEAPON3': '0.550', 'ARMOR': '0.855', 'HITCOUNT': '0.860', 'weapon2': '1.116', 'weapon3': '1.502', 'DAMAGECOUNT': '2.793', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:21,407][52662] DAMAGECOUNT value on done: 17308.0 [2024-08-05 22:51:21,408][52662] Sum rewards: 13.816, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.029', 'HEALTH': '0.066', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon5': '0.190', 'WEAPON4': '0.300', 'ARMOR': '0.458', 'WEAPON3': '0.600', 'weapon4': '0.682', 'weapon2': '0.746', 'HITCOUNT': '1.200', 'weapon3': '1.896', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '9.500'} [2024-08-05 22:51:22,007][52794] DAMAGECOUNT value on done: 16768.0 [2024-08-05 22:51:22,008][52794] Sum rewards: 15.460, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.355', 'AMMO2': '0.005', 'AMMO5': '0.008', 'AMMO4': '0.027', 'weapon4': '0.084', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'ARMOR': '0.480', 'weapon2': '0.872', 'HITCOUNT': '1.270', 'WEAPON3': '1.350', 'weapon3': '2.646', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '17.000'} [2024-08-05 22:51:22,555][52668] DAMAGECOUNT value on done: 15292.0 [2024-08-05 22:51:22,556][52668] Sum rewards: 15.546, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.033', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.089', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.436', 'ARMOR': '0.490', 'WEAPON3': '0.650', 'weapon2': '1.000', 'HITCOUNT': '1.130', 'weapon3': '1.598', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 87220224. Throughput: 0: 4209.8. Samples: 21808550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:51:22,794][52567] Avg episode reward: [(0, '13.185')] [2024-08-05 22:51:22,795][52614] Saving new best policy, reward=13.185! [2024-08-05 22:51:23,683][52660] DAMAGECOUNT value on done: 14884.0 [2024-08-05 22:51:23,687][52660] Sum rewards: 16.100, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.029', 'AMMO3': '0.052', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON3': '0.300', 'HEALTH': '0.333', 'weapon4': '0.526', 'ARMOR': '0.828', 'HITCOUNT': '0.830', 'weapon2': '0.860', 'weapon3': '1.200', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:24,105][52662] DAMAGECOUNT value on done: 17419.0 [2024-08-05 22:51:24,105][52662] Sum rewards: 7.754, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.060', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon7': '0.154', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.300', 'WEAPON7': '0.400', 'ARMOR': '0.408', 'weapon2': '0.416', 'HITCOUNT': '0.620', 'weapon4': '0.632', 'WEAPON3': '0.700', 'weapon3': '1.366', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '8.000'} [2024-08-05 22:51:24,500][52820] DAMAGECOUNT value on done: 13732.0 [2024-08-05 22:51:24,502][52820] Sum rewards: 13.262, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.553', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.113', 'WEAPON3': '0.800', 'ARMOR': '0.912', 'HITCOUNT': '1.090', 'weapon3': '1.806', 'weapon2': '1.836', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:24,596][52794] DAMAGECOUNT value on done: 17794.0 [2024-08-05 22:51:24,596][52794] Sum rewards: 21.481, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.190', 'WEAPON3': '0.350', 'ARMOR': '0.800', 'HITCOUNT': '1.160', 'weapon3': '1.174', 'weapon2': '1.544', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '14.000'} [2024-08-05 22:51:24,816][52650] Updated weights for policy 0, policy_version 10651 (0.0012) [2024-08-05 22:51:25,536][52668] DAMAGECOUNT value on done: 16276.0 [2024-08-05 22:51:25,538][52668] Sum rewards: 19.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.136', 'WEAPON4': '0.350', 'weapon4': '0.456', 'WEAPON3': '0.900', 'ARMOR': '0.960', 'HITCOUNT': '1.170', 'weapon2': '1.244', 'weapon3': '2.082', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '19.000'} [2024-08-05 22:51:26,682][52662] DAMAGECOUNT value on done: 18935.0 [2024-08-05 22:51:26,682][52662] Sum rewards: 9.343, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.403', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.252', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'weapon2': '1.528', 'weapon3': '1.930', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:26,687][52660] DAMAGECOUNT value on done: 11451.0 [2024-08-05 22:51:26,690][52660] Sum rewards: 9.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.068', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.046', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.190', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'ARMOR': '0.904', 'weapon2': '1.098', 'weapon3': '1.502', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:27,106][52794] DAMAGECOUNT value on done: 14508.0 [2024-08-05 22:51:27,106][52794] Sum rewards: 12.990, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.018', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.070', 'WEAPON4': '0.250', 'weapon4': '0.502', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon2': '1.330', 'weapon3': '1.684', 'DAMAGECOUNT': '2.964', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:27,730][52820] DAMAGECOUNT value on done: 14329.0 [2024-08-05 22:51:27,732][52820] Sum rewards: 13.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.958', 'HITCOUNT': '1.150', 'weapon3': '1.708', 'weapon2': '1.858', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:27,801][52567] Fps is (10 sec: 16373.5, 60 sec: 16655.3, 300 sec: 16744.6). Total num frames: 87293952. Throughput: 0: 4203.6. Samples: 21833790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 22:51:27,801][52567] Avg episode reward: [(0, '13.233')] [2024-08-05 22:51:27,858][52614] Saving new best policy, reward=13.233! [2024-08-05 22:51:28,532][52668] DAMAGECOUNT value on done: 15441.0 [2024-08-05 22:51:28,533][52668] Sum rewards: 11.172, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.318', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'weapon5': '0.166', 'weapon4': '0.200', 'WEAPON3': '0.650', 'weapon2': '0.850', 'HITCOUNT': '0.990', 'weapon3': '1.394', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:29,290][52650] Updated weights for policy 0, policy_version 10661 (0.0062) [2024-08-05 22:51:29,482][52662] DAMAGECOUNT value on done: 18355.0 [2024-08-05 22:51:29,482][52662] Sum rewards: 13.974, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.230', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.133', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'HITCOUNT': '1.190', 'weapon3': '1.758', 'weapon2': '1.802', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:29,752][52660] DAMAGECOUNT value on done: 15625.0 [2024-08-05 22:51:29,753][52660] Sum rewards: 12.085, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.061', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.032', 'AMMO4': '0.055', 'weapon5': '0.056', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon2': '0.954', 'weapon3': '1.456', 'DAMAGECOUNT': '3.078', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:29,929][52794] DAMAGECOUNT value on done: 18794.0 [2024-08-05 22:51:29,930][52794] Sum rewards: 6.930, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.804', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon4': '0.056', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'ARMOR': '0.940', 'weapon2': '1.200', 'weapon3': '1.468', 'DAMAGECOUNT': '2.709', 'FRAGCOUNT': '6.000'} [2024-08-05 22:51:31,069][52666] DAMAGECOUNT value on done: 15205.0 [2024-08-05 22:51:31,071][52666] Sum rewards: 15.719, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.463', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.202', 'ARMOR': '0.951', 'WEAPON3': '1.100', 'HITCOUNT': '1.360', 'weapon2': '1.498', 'weapon3': '1.858', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:31,078][52820] DAMAGECOUNT value on done: 14746.0 [2024-08-05 22:51:31,078][52820] Sum rewards: 16.788, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.032', 'AMMO3': '0.076', 'HEALTH': '0.141', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'weapon4': '0.260', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'HITCOUNT': '1.200', 'weapon2': '1.326', 'weapon3': '1.554', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:31,782][52662] DAMAGECOUNT value on done: 19472.0 [2024-08-05 22:51:31,782][52662] Sum rewards: 10.429, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.280', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.136', 'weapon4': '0.256', 'WEAPON3': '0.900', 'HITCOUNT': '1.180', 'weapon2': '1.324', 'weapon3': '2.150', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:32,084][52668] DAMAGECOUNT value on done: 13995.0 [2024-08-05 22:51:32,086][52668] Sum rewards: 7.989, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'weapon5': '0.062', 'AMMO4': '0.065', 'weapon4': '0.232', 'WEAPON3': '0.450', 'ARMOR': '0.472', 'HITCOUNT': '0.880', 'weapon2': '1.318', 'weapon3': '1.418', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:32,281][52794] DAMAGECOUNT value on done: 17029.0 [2024-08-05 22:51:32,282][52794] Sum rewards: 20.502, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.520', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.312', 'ARMOR': '0.494', 'WEAPON3': '0.750', 'weapon2': '1.140', 'HITCOUNT': '1.220', 'weapon3': '2.096', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '18.000'} [2024-08-05 22:51:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 87392256. Throughput: 0: 4193.6. Samples: 21845950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 22:51:32,794][52567] Avg episode reward: [(0, '13.080')] [2024-08-05 22:51:33,016][52660] DAMAGECOUNT value on done: 13568.0 [2024-08-05 22:51:33,016][52660] Sum rewards: 9.798, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.890', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.154', 'ARMOR': '0.479', 'WEAPON3': '0.950', 'HITCOUNT': '0.950', 'weapon2': '1.530', 'weapon3': '1.912', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:33,612][52670] DAMAGECOUNT value on done: 15868.0 [2024-08-05 22:51:33,614][52670] Sum rewards: 9.214, reward structure: {'DEATHCOUNT': '-6.000', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.014', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'HEALTH': '0.185', 'ARMOR': '0.497', 'WEAPON3': '0.600', 'HITCOUNT': '0.650', 'weapon2': '0.948', 'weapon3': '1.666', 'DAMAGECOUNT': '2.424', 'FRAGCOUNT': '8.000'} [2024-08-05 22:51:33,980][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:51:34,019][52662] DAMAGECOUNT value on done: 17204.0 [2024-08-05 22:51:34,020][52662] Sum rewards: 12.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.737', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'ARMOR': '0.475', 'weapon2': '0.746', 'WEAPON3': '1.300', 'HITCOUNT': '1.370', 'weapon3': '2.516', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '15.000'} [2024-08-05 22:51:34,462][52668] DAMAGECOUNT value on done: 17719.0 [2024-08-05 22:51:34,463][52668] Sum rewards: 22.256, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.890', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON3': '0.750', 'weapon2': '1.420', 'HITCOUNT': '1.490', 'ARMOR': '1.672', 'weapon3': '1.798', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:34,507][52820] DAMAGECOUNT value on done: 15119.0 [2024-08-05 22:51:34,507][52820] Sum rewards: 11.188, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.192', 'WEAPON3': '0.450', 'HEALTH': '0.508', 'ARMOR': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.330', 'weapon3': '1.852', 'DAMAGECOUNT': '2.988', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:34,531][52666] DAMAGECOUNT value on done: 13803.0 [2024-08-05 22:51:34,531][52666] Sum rewards: 8.821, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.301', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.071', 'WEAPON3': '0.500', 'HITCOUNT': '0.820', 'ARMOR': '0.920', 'weapon3': '1.262', 'weapon2': '1.330', 'DAMAGECOUNT': '2.748', 'FRAGCOUNT': '6.000'} [2024-08-05 22:51:34,603][52794] DAMAGECOUNT value on done: 17582.0 [2024-08-05 22:51:34,604][52794] Sum rewards: 16.858, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.960', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.012', 'AMMO3': '0.070', 'weapon5': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.442', 'WEAPON3': '0.600', 'HITCOUNT': '1.150', 'weapon2': '1.166', 'weapon3': '1.536', 'DAMAGECOUNT': '4.623', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:34,625][52650] Updated weights for policy 0, policy_version 10671 (0.0041) [2024-08-05 22:51:35,766][52660] DAMAGECOUNT value on done: 15483.0 [2024-08-05 22:51:35,768][52660] Sum rewards: 11.157, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.980', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.096', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.840', 'weapon3': '1.250', 'weapon2': '1.336', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:36,698][52662] DAMAGECOUNT value on done: 17780.0 [2024-08-05 22:51:36,699][52662] Sum rewards: 10.145, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.814', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.282', 'WEAPON3': '0.800', 'ARMOR': '0.918', 'HITCOUNT': '0.960', 'weapon2': '1.286', 'weapon3': '1.826', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:36,993][52668] DAMAGECOUNT value on done: 13682.0 [2024-08-05 22:51:36,993][52668] Sum rewards: 23.773, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.331', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.432', 'ARMOR': '0.492', 'WEAPON3': '0.800', 'weapon2': '0.954', 'HITCOUNT': '1.390', 'weapon3': '2.050', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '20.000'} [2024-08-05 22:51:37,068][52670] DAMAGECOUNT value on done: 14202.0 [2024-08-05 22:51:37,071][52670] Sum rewards: 11.628, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.706', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon7': '0.086', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.507', 'WEAPON3': '0.600', 'weapon4': '0.640', 'weapon2': '0.818', 'HITCOUNT': '0.970', 'weapon3': '1.478', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '8.500'} [2024-08-05 22:51:37,677][52794] DAMAGECOUNT value on done: 18223.0 [2024-08-05 22:51:37,677][52794] Sum rewards: 16.572, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.694', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.047', 'weapon4': '0.048', 'weapon5': '0.062', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'weapon2': '0.986', 'HITCOUNT': '1.160', 'weapon3': '1.726', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '14.000'} [2024-08-05 22:51:37,794][52567] Fps is (10 sec: 17214.3, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 87465984. Throughput: 0: 4192.9. Samples: 21871000. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:51:37,794][52567] Avg episode reward: [(0, '13.165')] [2024-08-05 22:51:37,864][52666] DAMAGECOUNT value on done: 15186.0 [2024-08-05 22:51:37,865][52666] Sum rewards: 17.822, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.373', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '1.064', 'HITCOUNT': '1.100', 'weapon3': '1.458', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:38,034][52820] DAMAGECOUNT value on done: 12912.0 [2024-08-05 22:51:38,035][52820] Sum rewards: 13.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.527', 'AMMO2': '0.005', 'weapon7': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.025', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon4': '0.256', 'weapon2': '0.892', 'WEAPON3': '1.000', 'HITCOUNT': '1.060', 'weapon3': '2.178', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '14.000'} [2024-08-05 22:51:38,105][52660] DAMAGECOUNT value on done: 14861.0 [2024-08-05 22:51:38,106][52660] Sum rewards: 11.633, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.034', 'AMMO4': '0.053', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.370', 'ARMOR': '0.496', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.090', 'weapon3': '1.814', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:39,354][52650] Updated weights for policy 0, policy_version 10681 (0.0035) [2024-08-05 22:51:39,511][52662] DAMAGECOUNT value on done: 18204.0 [2024-08-05 22:51:39,512][52662] Sum rewards: 13.401, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.904', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON3': '0.800', 'HITCOUNT': '0.910', 'ARMOR': '1.288', 'weapon2': '1.344', 'weapon3': '1.632', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:39,930][52668] DAMAGECOUNT value on done: 14723.0 [2024-08-05 22:51:39,932][52668] Sum rewards: 9.612, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.392', 'WEAPON3': '0.850', 'ARMOR': '0.854', 'HITCOUNT': '1.270', 'weapon2': '1.346', 'weapon3': '1.900', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:40,165][52794] DAMAGECOUNT value on done: 17780.0 [2024-08-05 22:51:40,165][52794] Sum rewards: 16.425, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.339', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.256', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'HITCOUNT': '1.290', 'weapon2': '1.664', 'weapon3': '1.900', 'DAMAGECOUNT': '3.933', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:40,297][52670] DAMAGECOUNT value on done: 13388.0 [2024-08-05 22:51:40,297][52670] Sum rewards: 11.721, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.722', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO3': '0.090', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.778', 'weapon3': '1.928', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:41,035][52660] DAMAGECOUNT value on done: 15667.0 [2024-08-05 22:51:41,035][52660] Sum rewards: 12.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.865', 'AMMO2': '0.017', 'AMMO3': '0.077', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.204', 'ARMOR': '0.462', 'WEAPON3': '0.550', 'HITCOUNT': '0.940', 'weapon2': '1.312', 'weapon3': '1.540', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:41,072][52666] DAMAGECOUNT value on done: 13831.0 [2024-08-05 22:51:41,074][52666] Sum rewards: 9.332, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.302', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.075', 'weapon5': '0.128', 'WEAPON4': '0.250', 'weapon4': '0.410', 'ARMOR': '0.458', 'WEAPON3': '0.550', 'HITCOUNT': '0.660', 'weapon2': '1.186', 'weapon3': '1.612', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:41,279][52820] DAMAGECOUNT value on done: 13664.0 [2024-08-05 22:51:41,281][52820] Sum rewards: 6.616, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.793', 'AMMO5': '0.003', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.061', 'WEAPON4': '0.150', 'weapon4': '0.442', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'weapon2': '1.108', 'weapon3': '1.422', 'DAMAGECOUNT': '1.848', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:41,781][52662] DAMAGECOUNT value on done: 16084.0 [2024-08-05 22:51:41,782][52662] Sum rewards: 10.777, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.638', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.104', 'WEAPON3': '0.400', 'HITCOUNT': '0.710', 'weapon3': '1.120', 'ARMOR': '1.339', 'weapon2': '1.562', 'DAMAGECOUNT': '2.505', 'FRAGCOUNT': '8.000'} [2024-08-05 22:51:42,608][52794] DAMAGECOUNT value on done: 18406.0 [2024-08-05 22:51:42,611][52794] Sum rewards: 9.707, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.576', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'weapon4': '0.090', 'ARMOR': '0.457', 'WEAPON3': '0.650', 'HITCOUNT': '0.800', 'weapon2': '1.538', 'weapon3': '1.568', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '8.000'} [2024-08-05 22:51:42,794][52567] Fps is (10 sec: 15564.7, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 87547904. Throughput: 0: 4193.1. Samples: 21896400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:51:42,795][52567] Avg episode reward: [(0, '13.118')] [2024-08-05 22:51:43,040][52668] DAMAGECOUNT value on done: 14751.0 [2024-08-05 22:51:43,042][52668] Sum rewards: 13.340, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.064', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.376', 'WEAPON3': '0.550', 'ARMOR': '0.862', 'HITCOUNT': '0.900', 'weapon2': '0.990', 'weapon3': '1.454', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:43,261][52670] DAMAGECOUNT value on done: 14967.0 [2024-08-05 22:51:43,263][52670] Sum rewards: 14.024, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.745', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'weapon4': '0.040', 'AMMO3': '0.071', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.292', 'weapon3': '1.694', 'DAMAGECOUNT': '3.483', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:43,853][52666] DAMAGECOUNT value on done: 14555.0 [2024-08-05 22:51:43,854][52666] Sum rewards: 15.441, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.392', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.050', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '1.040', 'weapon2': '1.212', 'weapon3': '1.768', 'DAMAGECOUNT': '3.489', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:44,367][52660] DAMAGECOUNT value on done: 14464.0 [2024-08-05 22:51:44,367][52660] Sum rewards: 11.810, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.547', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON3': '0.800', 'ARMOR': '0.868', 'weapon2': '1.018', 'HITCOUNT': '1.030', 'weapon3': '2.054', 'DAMAGECOUNT': '4.140', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:44,485][52650] Updated weights for policy 0, policy_version 10691 (0.0014) [2024-08-05 22:51:44,514][52820] DAMAGECOUNT value on done: 13301.0 [2024-08-05 22:51:44,515][52820] Sum rewards: 16.061, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.544', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'weapon4': '0.284', 'WEAPON3': '0.700', 'ARMOR': '0.911', 'HITCOUNT': '1.090', 'weapon2': '1.352', 'weapon3': '1.626', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:44,970][52662] DAMAGECOUNT value on done: 17864.0 [2024-08-05 22:51:44,971][52662] Sum rewards: 12.962, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.383', 'AMMO2': '0.003', 'AMMO4': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'WEAPON3': '0.500', 'HITCOUNT': '1.000', 'weapon2': '1.326', 'weapon3': '1.376', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:45,584][52794] DAMAGECOUNT value on done: 16670.0 [2024-08-05 22:51:45,584][52794] Sum rewards: 7.810, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.292', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.070', 'WEAPON3': '0.500', 'HITCOUNT': '0.720', 'weapon3': '1.248', 'ARMOR': '1.324', 'weapon2': '1.552', 'DAMAGECOUNT': '2.190', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:45,899][52668] DAMAGECOUNT value on done: 14524.0 [2024-08-05 22:51:45,900][52668] Sum rewards: 14.966, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.228', 'weapon2': '0.988', 'WEAPON3': '1.150', 'HITCOUNT': '1.200', 'weapon3': '2.188', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '15.000'} [2024-08-05 22:51:46,388][52670] DAMAGECOUNT value on done: 13676.0 [2024-08-05 22:51:46,390][52670] Sum rewards: 13.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.644', 'weapon4': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.804', 'HITCOUNT': '0.920', 'weapon2': '1.196', 'weapon3': '1.660', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:47,111][52666] DAMAGECOUNT value on done: 13363.0 [2024-08-05 22:51:47,112][52666] Sum rewards: 9.856, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.046', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.136', 'WEAPON3': '0.850', 'HITCOUNT': '1.100', 'weapon2': '1.276', 'weapon3': '2.366', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:47,267][52660] DAMAGECOUNT value on done: 15045.0 [2024-08-05 22:51:47,267][52660] Sum rewards: 14.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.026', 'AMMO2': '0.022', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon4': '0.394', 'WEAPON3': '0.450', 'ARMOR': '0.812', 'HITCOUNT': '1.120', 'weapon2': '1.384', 'weapon3': '1.554', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:47,485][52662] DAMAGECOUNT value on done: 17698.0 [2024-08-05 22:51:47,485][52662] Sum rewards: 12.525, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.002', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.134', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.342', 'ARMOR': '0.957', 'WEAPON3': '1.000', 'weapon2': '1.082', 'HITCOUNT': '1.100', 'weapon3': '1.998', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16773.1). Total num frames: 87629824. Throughput: 0: 4184.2. Samples: 21908780. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 22:51:47,795][52567] Avg episode reward: [(0, '13.043')] [2024-08-05 22:51:47,893][52820] DAMAGECOUNT value on done: 13887.0 [2024-08-05 22:51:47,894][52820] Sum rewards: 9.182, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.280', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON3': '0.750', 'ARMOR': '0.804', 'HITCOUNT': '1.020', 'weapon2': '1.024', 'weapon3': '1.478', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:48,111][52794] DAMAGECOUNT value on done: 17847.0 [2024-08-05 22:51:48,111][52794] Sum rewards: 14.849, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.406', 'weapon4': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.824', 'HITCOUNT': '1.030', 'weapon2': '1.246', 'weapon3': '1.378', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:48,827][52650] Updated weights for policy 0, policy_version 10701 (0.0023) [2024-08-05 22:51:49,172][52668] DAMAGECOUNT value on done: 13360.0 [2024-08-05 22:51:49,174][52668] Sum rewards: 6.600, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.793', 'AMMO2': '0.025', 'AMMO3': '0.123', 'AMMO4': '0.125', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON3': '0.850', 'ARMOR': '0.936', 'HITCOUNT': '0.960', 'weapon2': '1.516', 'weapon3': '1.790', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '6.000'} [2024-08-05 22:51:49,589][52670] DAMAGECOUNT value on done: 16245.0 [2024-08-05 22:51:49,597][52670] Sum rewards: 20.004, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.931', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.272', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon2': '1.636', 'weapon3': '1.808', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:49,958][52662] DAMAGECOUNT value on done: 17398.0 [2024-08-05 22:51:49,959][52662] Sum rewards: 13.567, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.225', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.672', 'weapon2': '0.868', 'WEAPON3': '0.900', 'HITCOUNT': '1.020', 'ARMOR': '1.400', 'weapon3': '2.162', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '14.000'} [2024-08-05 22:51:50,259][52647] DAMAGECOUNT value on done: 17410.0 [2024-08-05 22:51:50,262][52647] Sum rewards: 16.018, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.664', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.408', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon2': '0.868', 'HITCOUNT': '1.240', 'weapon3': '1.810', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:50,446][52794] DAMAGECOUNT value on done: 19130.0 [2024-08-05 22:51:50,447][52794] Sum rewards: 10.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.472', 'WEAPON3': '0.750', 'HITCOUNT': '0.950', 'weapon2': '1.040', 'ARMOR': '1.865', 'weapon3': '2.028', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:50,452][52666] DAMAGECOUNT value on done: 14573.0 [2024-08-05 22:51:50,452][52666] Sum rewards: 11.585, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.020', 'AMMO3': '0.077', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'HEALTH': '0.320', 'weapon4': '0.328', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'weapon2': '1.298', 'weapon3': '1.526', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '8.000'} [2024-08-05 22:51:50,506][52660] DAMAGECOUNT value on done: 15375.0 [2024-08-05 22:51:50,508][52660] Sum rewards: 16.269, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.036', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON3': '0.750', 'ARMOR': '0.884', 'weapon2': '1.140', 'HITCOUNT': '1.270', 'weapon3': '1.978', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '15.000'} [2024-08-05 22:51:51,357][52820] DAMAGECOUNT value on done: 13840.0 [2024-08-05 22:51:51,357][52820] Sum rewards: 16.617, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.018', 'AMMO3': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'HEALTH': '0.525', 'WEAPON3': '0.550', 'weapon4': '0.594', 'weapon2': '0.794', 'ARMOR': '0.836', 'HITCOUNT': '1.070', 'weapon3': '1.586', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:52,223][52668] DAMAGECOUNT value on done: 14791.0 [2024-08-05 22:51:52,224][52668] Sum rewards: 6.722, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.730', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.004', 'weapon4': '0.020', 'weapon5': '0.056', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.489', 'WEAPON3': '0.750', 'HITCOUNT': '1.050', 'weapon3': '1.460', 'weapon2': '1.730', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '4.500'} [2024-08-05 22:51:52,613][52662] DAMAGECOUNT value on done: 19067.0 [2024-08-05 22:51:52,615][52662] Sum rewards: 19.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.409', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.474', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '0.990', 'HITCOUNT': '1.450', 'weapon3': '2.124', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '17.000'} [2024-08-05 22:51:52,754][52670] DAMAGECOUNT value on done: 13257.0 [2024-08-05 22:51:52,756][52670] Sum rewards: 14.327, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.330', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.144', 'weapon4': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.826', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon3': '1.492', 'weapon2': '1.610', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '15.000'} [2024-08-05 22:51:52,795][52567] Fps is (10 sec: 17202.3, 60 sec: 16793.4, 300 sec: 16772.7). Total num frames: 87719936. Throughput: 0: 4179.5. Samples: 21934100. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 22:51:52,795][52567] Avg episode reward: [(0, '13.326')] [2024-08-05 22:51:52,796][52614] Saving new best policy, reward=13.326! [2024-08-05 22:51:53,267][52660] DAMAGECOUNT value on done: 15753.0 [2024-08-05 22:51:53,269][52660] Sum rewards: 10.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.300', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'weapon7': '0.052', 'weapon4': '0.052', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'ARMOR': '0.854', 'weapon3': '1.290', 'weapon2': '1.670', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:53,280][52794] DAMAGECOUNT value on done: 17173.0 [2024-08-05 22:51:53,281][52794] Sum rewards: 13.296, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.831', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'weapon4': '0.328', 'ARMOR': '0.471', 'WEAPON3': '0.750', 'HITCOUNT': '0.910', 'weapon2': '1.082', 'weapon3': '1.898', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:53,414][52666] DAMAGECOUNT value on done: 13717.0 [2024-08-05 22:51:53,414][52666] Sum rewards: 18.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.099', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.077', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon2': '1.226', 'WEAPON3': '1.250', 'HITCOUNT': '1.740', 'weapon3': '2.366', 'DAMAGECOUNT': '6.030', 'FRAGCOUNT': '18.000'} [2024-08-05 22:51:53,636][52647] DAMAGECOUNT value on done: 14520.0 [2024-08-05 22:51:53,637][52647] Sum rewards: 20.013, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.374', 'ARMOR': '0.432', 'HEALTH': '0.561', 'WEAPON3': '0.600', 'weapon2': '1.038', 'HITCOUNT': '1.170', 'weapon3': '1.986', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '16.000'} [2024-08-05 22:51:54,447][52650] Updated weights for policy 0, policy_version 10711 (0.0020) [2024-08-05 22:51:54,909][52668] DAMAGECOUNT value on done: 14070.0 [2024-08-05 22:51:54,909][52668] Sum rewards: 5.545, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.034', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.018', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.606', 'HITCOUNT': '0.660', 'weapon2': '0.686', 'WEAPON3': '0.800', 'weapon3': '2.004', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '6.000'} [2024-08-05 22:51:55,028][52820] DAMAGECOUNT value on done: 14045.0 [2024-08-05 22:51:55,031][52820] Sum rewards: 17.065, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.846', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.070', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.899', 'weapon2': '1.196', 'HITCOUNT': '1.260', 'weapon3': '1.900', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:55,493][52670] DAMAGECOUNT value on done: 13592.0 [2024-08-05 22:51:55,495][52670] Sum rewards: 11.853, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.986', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.276', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.760', 'weapon2': '0.924', 'weapon3': '1.098', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:55,872][52662] DAMAGECOUNT value on done: 17499.0 [2024-08-05 22:51:55,872][52662] Sum rewards: 14.248, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.864', 'AMMO4': '-0.081', 'AMMO2': '-0.016', 'AMMO5': '0.006', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.600', 'ARMOR': '0.929', 'HITCOUNT': '0.940', 'weapon3': '1.116', 'weapon2': '1.220', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:56,171][52660] DAMAGECOUNT value on done: 16242.0 [2024-08-05 22:51:56,171][52660] Sum rewards: 14.290, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.231', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'weapon5': '0.140', 'ARMOR': '0.459', 'WEAPON3': '0.550', 'HITCOUNT': '1.300', 'weapon2': '1.468', 'weapon3': '1.474', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '11.000'} [2024-08-05 22:51:56,261][52666] DAMAGECOUNT value on done: 14737.0 [2024-08-05 22:51:56,265][52666] Sum rewards: 9.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.909', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.064', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.352', 'WEAPON3': '0.750', 'ARMOR': '0.864', 'HITCOUNT': '0.960', 'weapon2': '1.322', 'weapon3': '1.508', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '8.000'} [2024-08-05 22:51:56,308][52794] DAMAGECOUNT value on done: 16957.0 [2024-08-05 22:51:56,308][52794] Sum rewards: 9.885, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.452', 'AMMO2': '0.025', 'AMMO3': '0.120', 'AMMO4': '0.123', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.841', 'HITCOUNT': '0.850', 'weapon2': '1.314', 'weapon3': '1.620', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '9.000'} [2024-08-05 22:51:56,848][52647] DAMAGECOUNT value on done: 17355.0 [2024-08-05 22:51:56,851][52647] Sum rewards: 12.004, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.996', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.034', 'AMMO4': '0.035', 'weapon7': '0.056', 'AMMO3': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.202', 'WEAPON3': '0.450', 'ARMOR': '0.891', 'HITCOUNT': '0.970', 'weapon3': '1.474', 'weapon2': '2.042', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '10.000'} [2024-08-05 22:51:57,555][52668] DAMAGECOUNT value on done: 15624.0 [2024-08-05 22:51:57,556][52668] Sum rewards: 5.982, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'HEALTH': '0.330', 'weapon4': '0.334', 'WEAPON3': '0.600', 'weapon2': '0.646', 'HITCOUNT': '0.650', 'ARMOR': '0.832', 'weapon3': '1.636', 'DAMAGECOUNT': '2.268', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 87801856. Throughput: 0: 4184.2. Samples: 21959030. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:51:57,795][52567] Avg episode reward: [(0, '13.387')] [2024-08-05 22:51:57,847][52614] Saving new best policy, reward=13.387! [2024-08-05 22:51:58,245][52820] DAMAGECOUNT value on done: 13718.0 [2024-08-05 22:51:58,245][52820] Sum rewards: 9.543, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'weapon4': '0.244', 'ARMOR': '0.457', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.124', 'weapon3': '1.512', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:58,457][52662] DAMAGECOUNT value on done: 18386.0 [2024-08-05 22:51:58,457][52662] Sum rewards: 7.162, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.954', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.156', 'ARMOR': '0.421', 'WEAPON3': '0.600', 'HITCOUNT': '0.910', 'weapon2': '1.382', 'weapon3': '1.668', 'DAMAGECOUNT': '3.039', 'FRAGCOUNT': '5.000'} [2024-08-05 22:51:58,834][52650] Updated weights for policy 0, policy_version 10721 (0.0027) [2024-08-05 22:51:58,840][52670] DAMAGECOUNT value on done: 14011.0 [2024-08-05 22:51:58,844][52670] Sum rewards: 8.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.112', 'WEAPON3': '0.750', 'HITCOUNT': '0.750', 'ARMOR': '0.956', 'weapon3': '1.360', 'weapon2': '1.826', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'} [2024-08-05 22:51:58,875][52660] DAMAGECOUNT value on done: 15845.0 [2024-08-05 22:51:58,875][52660] Sum rewards: 13.583, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.502', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.090', 'weapon4': '0.092', 'WEAPON4': '0.100', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '1.100', 'weapon3': '1.470', 'weapon2': '1.842', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '12.000'} [2024-08-05 22:51:59,015][52794] DAMAGECOUNT value on done: 17629.0 [2024-08-05 22:51:59,017][52794] Sum rewards: 13.704, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.250', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.087', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'ARMOR': '0.924', 'WEAPON3': '0.950', 'HITCOUNT': '1.040', 'weapon2': '1.324', 'weapon3': '1.588', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '13.000'} [2024-08-05 22:51:59,585][52666] DAMAGECOUNT value on done: 14306.0 [2024-08-05 22:51:59,586][52666] Sum rewards: 10.050, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.122', 'WEAPON3': '0.750', 'ARMOR': '0.868', 'HITCOUNT': '1.050', 'weapon2': '1.148', 'weapon3': '1.738', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '8.000'} [2024-08-05 22:52:00,113][52647] DAMAGECOUNT value on done: 13859.0 [2024-08-05 22:52:00,114][52647] Sum rewards: 13.755, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.300', 'weapon4': '0.662', 'WEAPON3': '0.800', 'weapon2': '1.272', 'HITCOUNT': '1.460', 'weapon3': '1.852', 'DAMAGECOUNT': '4.851', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:00,336][52668] DAMAGECOUNT value on done: 16114.0 [2024-08-05 22:52:00,337][52668] Sum rewards: 12.033, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.498', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon4': '0.216', 'ARMOR': '0.458', 'WEAPON3': '0.550', 'HITCOUNT': '1.060', 'weapon3': '1.388', 'weapon2': '1.404', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '8.000'} [2024-08-05 22:52:00,897][52614] Signal inference workers to stop experience collection... (2000 times) [2024-08-05 22:52:00,898][52614] Signal inference workers to resume experience collection... (2000 times) [2024-08-05 22:52:00,982][52650] InferenceWorker_p0-w0: stopping experience collection (2000 times) [2024-08-05 22:52:00,982][52650] InferenceWorker_p0-w0: resuming experience collection (2000 times) [2024-08-05 22:52:01,169][52662] DAMAGECOUNT value on done: 17097.0 [2024-08-05 22:52:01,169][52662] Sum rewards: 14.128, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.704', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'ARMOR': '0.469', 'WEAPON3': '0.500', 'weapon4': '0.560', 'HITCOUNT': '1.040', 'weapon2': '1.064', 'weapon3': '1.392', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:01,609][52660] DAMAGECOUNT value on done: 16140.0 [2024-08-05 22:52:01,612][52660] Sum rewards: 10.187, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO2': '0.002', 'AMMO4': '0.007', 'ARMOR': '0.072', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'weapon4': '0.392', 'WEAPON3': '0.950', 'weapon2': '1.286', 'HITCOUNT': '1.320', 'weapon3': '1.948', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:01,799][52820] DAMAGECOUNT value on done: 13416.0 [2024-08-05 22:52:01,800][52820] Sum rewards: 16.926, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.220', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.124', 'weapon4': '0.220', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.286', 'HITCOUNT': '1.320', 'weapon3': '1.864', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '14.000'} [2024-08-05 22:52:01,863][52670] DAMAGECOUNT value on done: 12673.0 [2024-08-05 22:52:01,863][52670] Sum rewards: 11.471, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.449', 'AMMO4': '-0.095', 'AMMO2': '-0.019', 'AMMO3': '0.065', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon3': '1.280', 'ARMOR': '1.351', 'weapon2': '1.392', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '8.000'} [2024-08-05 22:52:02,633][52666] DAMAGECOUNT value on done: 12631.0 [2024-08-05 22:52:02,635][52666] Sum rewards: 14.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.252', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.036', 'weapon5': '0.056', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'ARMOR': '0.855', 'HITCOUNT': '0.950', 'weapon3': '1.670', 'weapon2': '1.692', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:02,794][52567] Fps is (10 sec: 17204.3, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 87891968. Throughput: 0: 4181.8. Samples: 21971560. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:52:02,795][52567] Avg episode reward: [(0, '13.000')] [2024-08-05 22:52:03,250][52668] DAMAGECOUNT value on done: 15309.0 [2024-08-05 22:52:03,259][52668] Sum rewards: 12.923, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.386', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.004', 'weapon5': '0.024', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.126', 'ARMOR': '0.439', 'WEAPON3': '0.850', 'HITCOUNT': '1.120', 'weapon2': '1.122', 'weapon3': '1.720', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '12.500'} [2024-08-05 22:52:03,592][52662] DAMAGECOUNT value on done: 18519.0 [2024-08-05 22:52:03,593][52662] Sum rewards: 12.553, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.381', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.258', 'weapon5': '0.260', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.110', 'weapon2': '1.374', 'weapon3': '1.452', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:03,601][52647] DAMAGECOUNT value on done: 15549.0 [2024-08-05 22:52:03,602][52647] Sum rewards: 12.478, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.127', 'HEALTH': '0.322', 'WEAPON3': '0.700', 'HITCOUNT': '1.090', 'weapon2': '1.372', 'weapon3': '2.318', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:04,194][52650] Updated weights for policy 0, policy_version 10731 (0.0035) [2024-08-05 22:52:04,517][52660] DAMAGECOUNT value on done: 14542.0 [2024-08-05 22:52:04,517][52660] Sum rewards: 6.476, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.418', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.063', 'WEAPON4': '0.150', 'weapon4': '0.460', 'ARMOR': '0.462', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.904', 'weapon3': '1.416', 'DAMAGECOUNT': '1.743', 'FRAGCOUNT': '6.000'} [2024-08-05 22:52:04,874][52670] DAMAGECOUNT value on done: 15380.0 [2024-08-05 22:52:04,876][52670] Sum rewards: 12.849, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.466', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.044', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.280', 'WEAPON3': '0.400', 'ARMOR': '0.425', 'HITCOUNT': '0.930', 'weapon3': '1.158', 'weapon2': '1.334', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:05,173][52820] DAMAGECOUNT value on done: 13204.0 [2024-08-05 22:52:05,173][52820] Sum rewards: 8.427, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.995', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.159', 'weapon4': '0.166', 'WEAPON4': '0.200', 'ARMOR': '0.448', 'HITCOUNT': '0.860', 'WEAPON3': '1.100', 'weapon2': '1.280', 'weapon3': '2.034', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:05,331][52666] DAMAGECOUNT value on done: 13195.0 [2024-08-05 22:52:05,331][52666] Sum rewards: 11.641, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.115', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'AMMO4': '0.183', 'WEAPON4': '0.300', 'weapon4': '0.560', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.224', 'ARMOR': '1.693', 'weapon3': '1.852', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:06,004][52669] DAMAGECOUNT value on done: 15252.0 [2024-08-05 22:52:06,005][52669] Sum rewards: 8.468, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.620', 'AMMO2': '0.045', 'ARMOR': '0.065', 'AMMO3': '0.095', 'AMMO4': '0.224', 'weapon4': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon2': '0.738', 'HITCOUNT': '0.860', 'weapon3': '1.126', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:06,819][52647] DAMAGECOUNT value on done: 15455.0 [2024-08-05 22:52:06,820][52647] Sum rewards: 15.020, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.130', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.016', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.146', 'WEAPON3': '0.550', 'HITCOUNT': '1.090', 'weapon2': '1.574', 'ARMOR': '1.702', 'weapon3': '1.792', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:07,661][52670] DAMAGECOUNT value on done: 16349.0 [2024-08-05 22:52:07,663][52670] Sum rewards: 22.012, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.263', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.120', 'AMMO3': '0.149', 'ARMOR': '0.812', 'WEAPON3': '1.000', 'weapon2': '1.310', 'HITCOUNT': '1.800', 'weapon3': '2.338', 'DAMAGECOUNT': '6.657', 'FRAGCOUNT': '18.000'} [2024-08-05 22:52:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 87973888. Throughput: 0: 4177.1. Samples: 21996520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:52:07,795][52567] Avg episode reward: [(0, '12.829')] [2024-08-05 22:52:08,241][52660] DAMAGECOUNT value on done: 15710.0 [2024-08-05 22:52:08,241][52660] Sum rewards: 11.292, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.098', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'weapon4': '0.120', 'WEAPON3': '0.800', 'HITCOUNT': '0.840', 'ARMOR': '0.917', 'weapon2': '1.010', 'weapon3': '1.714', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:08,452][52820] DAMAGECOUNT value on done: 14934.0 [2024-08-05 22:52:08,452][52820] Sum rewards: 10.187, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.810', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.528', 'WEAPON3': '0.700', 'ARMOR': '0.866', 'HITCOUNT': '0.890', 'weapon2': '1.208', 'weapon3': '1.272', 'DAMAGECOUNT': '3.261', 'FRAGCOUNT': '8.000'} [2024-08-05 22:52:08,527][52666] DAMAGECOUNT value on done: 14499.0 [2024-08-05 22:52:08,529][52666] Sum rewards: 13.858, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.146', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.232', 'WEAPON4': '0.250', 'ARMOR': '0.872', 'WEAPON3': '1.000', 'weapon2': '1.164', 'HITCOUNT': '1.220', 'weapon3': '2.356', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '15.000'} [2024-08-05 22:52:08,797][52650] Updated weights for policy 0, policy_version 10741 (0.0011) [2024-08-05 22:52:08,889][52669] DAMAGECOUNT value on done: 15493.0 [2024-08-05 22:52:08,891][52669] Sum rewards: 14.112, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.300', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.090', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.102', 'HITCOUNT': '1.160', 'weapon3': '1.850', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '12.000'} [2024-08-05 22:52:09,595][52647] DAMAGECOUNT value on done: 14457.0 [2024-08-05 22:52:09,596][52647] Sum rewards: 10.521, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.160', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.346', 'WEAPON3': '0.400', 'HITCOUNT': '0.750', 'weapon2': '0.874', 'weapon3': '0.956', 'ARMOR': '1.297', 'DAMAGECOUNT': '2.619', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:11,033][52670] DAMAGECOUNT value on done: 16313.0 [2024-08-05 22:52:11,037][52670] Sum rewards: 18.184, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.402', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.098', 'WEAPON3': '0.650', 'HITCOUNT': '1.500', 'weapon2': '1.596', 'weapon3': '1.712', 'DAMAGECOUNT': '5.016', 'FRAGCOUNT': '14.000'} [2024-08-05 22:52:11,654][52660] DAMAGECOUNT value on done: 15218.0 [2024-08-05 22:52:11,656][52660] Sum rewards: 13.429, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO2': '0.029', 'AMMO3': '0.096', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.342', 'WEAPON3': '0.650', 'HITCOUNT': '0.810', 'ARMOR': '0.883', 'weapon2': '0.924', 'weapon3': '1.972', 'DAMAGECOUNT': '3.027', 'FRAGCOUNT': '12.000'} [2024-08-05 22:52:11,752][52666] DAMAGECOUNT value on done: 14505.0 [2024-08-05 22:52:11,752][52666] Sum rewards: 21.913, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.615', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.574', 'WEAPON3': '0.650', 'weapon2': '0.896', 'ARMOR': '0.966', 'HITCOUNT': '1.210', 'weapon3': '1.702', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '17.000'} [2024-08-05 22:52:11,994][52820] DAMAGECOUNT value on done: 13171.0 [2024-08-05 22:52:11,996][52820] Sum rewards: 20.676, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.912', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.104', 'ARMOR': '0.441', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon2': '1.350', 'weapon3': '1.882', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '16.000'} [2024-08-05 22:52:12,170][52669] DAMAGECOUNT value on done: 15228.0 [2024-08-05 22:52:12,172][52669] Sum rewards: 13.027, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.822', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '1.164', 'ARMOR': '1.347', 'weapon3': '1.430', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:12,637][52647] DAMAGECOUNT value on done: 16642.0 [2024-08-05 22:52:12,638][52647] Sum rewards: 24.210, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.742', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.200', 'ARMOR': '0.420', 'weapon4': '0.490', 'WEAPON3': '0.650', 'weapon2': '0.798', 'weapon3': '1.524', 'HITCOUNT': '1.550', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '19.000'} [2024-08-05 22:52:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.5, 300 sec: 16773.0). Total num frames: 88055808. Throughput: 0: 4179.7. Samples: 22021850. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:52:12,795][52567] Avg episode reward: [(0, '13.086')] [2024-08-05 22:52:13,368][52650] Updated weights for policy 0, policy_version 10751 (0.0011) [2024-08-05 22:52:14,033][52670] DAMAGECOUNT value on done: 15445.0 [2024-08-05 22:52:14,041][52670] Sum rewards: 10.525, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.070', 'weapon7': '0.116', 'AMMO6': '0.240', 'AMMO7': '0.240', 'WEAPON4': '0.250', 'WEAPON7': '0.400', 'HEALTH': '0.406', 'WEAPON3': '0.450', 'HITCOUNT': '0.520', 'ARMOR': '0.561', 'weapon2': '0.648', 'weapon4': '0.768', 'weapon3': '1.230', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:14,920][52666] DAMAGECOUNT value on done: 13941.0 [2024-08-05 22:52:14,922][52666] Sum rewards: 9.784, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.004', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.851', 'HITCOUNT': '0.880', 'weapon2': '1.554', 'weapon3': '1.656', 'DAMAGECOUNT': '2.907', 'FRAGCOUNT': '8.000'} [2024-08-05 22:52:15,015][52669] DAMAGECOUNT value on done: 17262.0 [2024-08-05 22:52:15,015][52669] Sum rewards: 12.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.721', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON3': '0.700', 'HITCOUNT': '1.120', 'ARMOR': '1.312', 'weapon3': '1.350', 'weapon2': '1.924', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:15,338][52820] DAMAGECOUNT value on done: 14327.0 [2024-08-05 22:52:15,339][52820] Sum rewards: 14.330, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.926', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.020', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.382', 'WEAPON3': '0.900', 'ARMOR': '0.940', 'HITCOUNT': '1.160', 'weapon2': '1.244', 'weapon3': '1.890', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:15,427][52647] DAMAGECOUNT value on done: 18573.0 [2024-08-05 22:52:15,428][52647] Sum rewards: 18.095, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.027', 'AMMO3': '0.108', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.436', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'HEALTH': '0.751', 'weapon2': '1.120', 'HITCOUNT': '1.250', 'weapon3': '2.192', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:15,966][52665] DAMAGECOUNT value on done: 14389.0 [2024-08-05 22:52:15,967][52665] Sum rewards: 11.035, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.145', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.129', 'ARMOR': '0.455', 'WEAPON3': '0.850', 'HITCOUNT': '1.320', 'weapon2': '1.394', 'weapon3': '1.798', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:17,486][52670] DAMAGECOUNT value on done: 15686.0 [2024-08-05 22:52:17,489][52670] Sum rewards: 28.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.210', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.272', 'ARMOR': '0.483', 'WEAPON3': '1.000', 'weapon2': '1.134', 'HITCOUNT': '1.970', 'weapon3': '2.094', 'DAMAGECOUNT': '7.065', 'FRAGCOUNT': '24.000'} [2024-08-05 22:52:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 88137728. Throughput: 0: 4191.8. Samples: 22034580. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 22:52:17,795][52567] Avg episode reward: [(0, '13.265')] [2024-08-05 22:52:17,944][52669] DAMAGECOUNT value on done: 16251.0 [2024-08-05 22:52:17,945][52669] Sum rewards: 14.847, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.692', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.184', 'WEAPON3': '0.500', 'ARMOR': '0.896', 'HITCOUNT': '0.970', 'weapon3': '1.426', 'weapon2': '1.490', 'DAMAGECOUNT': '3.603', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:18,217][52647] DAMAGECOUNT value on done: 16073.0 [2024-08-05 22:52:18,218][52647] Sum rewards: 11.271, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.534', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon7': '0.050', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.516', 'weapon4': '0.570', 'weapon2': '0.906', 'WEAPON3': '1.000', 'HITCOUNT': '1.260', 'weapon3': '2.158', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:18,350][52666] DAMAGECOUNT value on done: 14751.0 [2024-08-05 22:52:18,351][52666] Sum rewards: 16.204, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.547', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.238', 'ARMOR': '0.424', 'WEAPON3': '0.450', 'HITCOUNT': '1.160', 'weapon3': '1.416', 'weapon2': '1.592', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:18,450][52650] Updated weights for policy 0, policy_version 10761 (0.0014) [2024-08-05 22:52:18,632][52820] DAMAGECOUNT value on done: 15835.0 [2024-08-05 22:52:18,635][52820] Sum rewards: 17.536, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.550', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.318', 'ARMOR': '0.954', 'WEAPON3': '1.000', 'weapon2': '1.006', 'HITCOUNT': '1.450', 'weapon3': '2.306', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '16.000'} [2024-08-05 22:52:19,326][52665] DAMAGECOUNT value on done: 15015.0 [2024-08-05 22:52:19,334][52665] Sum rewards: 22.651, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.414', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.114', 'weapon4': '0.178', 'WEAPON3': '0.700', 'weapon2': '1.254', 'HITCOUNT': '1.400', 'weapon3': '1.900', 'DAMAGECOUNT': '5.076', 'FRAGCOUNT': '19.000'} [2024-08-05 22:52:20,490][52670] DAMAGECOUNT value on done: 13519.0 [2024-08-05 22:52:20,490][52670] Sum rewards: 13.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.246', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.174', 'weapon4': '0.176', 'WEAPON4': '0.200', 'ARMOR': '0.924', 'weapon2': '0.940', 'WEAPON3': '1.100', 'HITCOUNT': '1.120', 'weapon3': '2.546', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:20,774][52669] DAMAGECOUNT value on done: 16132.0 [2024-08-05 22:52:20,778][52669] Sum rewards: 11.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.796', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.092', 'WEAPON3': '0.600', 'ARMOR': '0.815', 'HITCOUNT': '0.910', 'weapon3': '1.614', 'weapon2': '1.712', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:21,018][52647] DAMAGECOUNT value on done: 16656.0 [2024-08-05 22:52:21,019][52647] Sum rewards: 20.962, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.170', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.064', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'ARMOR': '0.483', 'WEAPON3': '0.650', 'HITCOUNT': '1.570', 'weapon2': '1.584', 'weapon3': '1.884', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '15.000'} [2024-08-05 22:52:21,358][52666] DAMAGECOUNT value on done: 12978.0 [2024-08-05 22:52:21,360][52666] Sum rewards: 14.308, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.322', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'ARMOR': '0.489', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon2': '1.468', 'weapon3': '1.790', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:22,152][52820] DAMAGECOUNT value on done: 14423.0 [2024-08-05 22:52:22,155][52820] Sum rewards: 26.576, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.321', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'weapon2': '1.512', 'HITCOUNT': '1.910', 'weapon3': '2.004', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '22.000'} [2024-08-05 22:52:22,448][52665] DAMAGECOUNT value on done: 16339.0 [2024-08-05 22:52:22,448][52665] Sum rewards: 14.155, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.540', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.302', 'WEAPON3': '0.700', 'ARMOR': '0.937', 'HITCOUNT': '0.990', 'weapon2': '1.302', 'weapon3': '1.606', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16657.0, 300 sec: 16745.0). Total num frames: 88219648. Throughput: 0: 4197.8. Samples: 22059900. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-05 22:52:22,795][52567] Avg episode reward: [(0, '13.468')] [2024-08-05 22:52:22,845][52614] Saving new best policy, reward=13.468! [2024-08-05 22:52:23,284][52650] Updated weights for policy 0, policy_version 10771 (0.0028) [2024-08-05 22:52:23,508][52669] DAMAGECOUNT value on done: 16586.0 [2024-08-05 22:52:23,508][52669] Sum rewards: 11.991, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.865', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.050', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon4': '0.304', 'WEAPON4': '0.400', 'ARMOR': '0.953', 'WEAPON3': '1.000', 'HITCOUNT': '1.080', 'weapon2': '1.608', 'weapon3': '1.656', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:24,007][52670] DAMAGECOUNT value on done: 14545.0 [2024-08-05 22:52:24,008][52670] Sum rewards: 9.802, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.061', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.216', 'WEAPON3': '0.300', 'HITCOUNT': '0.690', 'weapon3': '0.718', 'weapon2': '1.246', 'ARMOR': '1.354', 'DAMAGECOUNT': '2.295', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:24,058][52647] DAMAGECOUNT value on done: 13808.0 [2024-08-05 22:52:24,059][52647] Sum rewards: 8.489, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.261', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.053', 'WEAPON4': '0.100', 'weapon7': '0.114', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.510', 'weapon2': '0.684', 'weapon4': '0.720', 'weapon3': '1.176', 'DAMAGECOUNT': '1.803', 'FRAGCOUNT': '5.000'} [2024-08-05 22:52:24,815][52666] DAMAGECOUNT value on done: 15111.0 [2024-08-05 22:52:24,816][52666] Sum rewards: 7.824, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.400', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.043', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.350', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'HITCOUNT': '0.870', 'weapon2': '1.116', 'weapon3': '1.438', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '5.000'} [2024-08-05 22:52:25,780][52665] DAMAGECOUNT value on done: 16102.0 [2024-08-05 22:52:25,781][52665] Sum rewards: 17.982, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.941', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.140', 'ARMOR': '0.438', 'WEAPON3': '0.500', 'HITCOUNT': '0.880', 'weapon2': '1.076', 'weapon3': '1.182', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '14.000'} [2024-08-05 22:52:26,481][52647] DAMAGECOUNT value on done: 15076.0 [2024-08-05 22:52:26,481][52647] Sum rewards: 13.498, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.000', 'AMMO2': '0.027', 'AMMO3': '0.112', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.506', 'WEAPON3': '0.650', 'HITCOUNT': '0.890', 'ARMOR': '1.251', 'weapon2': '1.428', 'weapon3': '1.442', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:26,543][52669] DAMAGECOUNT value on done: 15521.0 [2024-08-05 22:52:26,544][52669] Sum rewards: 14.675, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.780', 'AMMO2': '0.002', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon3': '1.534', 'weapon2': '1.688', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '12.000'} [2024-08-05 22:52:26,745][52670] DAMAGECOUNT value on done: 14582.0 [2024-08-05 22:52:26,746][52670] Sum rewards: 23.597, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'HEALTH': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.956', 'HITCOUNT': '1.180', 'weapon2': '1.418', 'weapon3': '2.076', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '19.000'} [2024-08-05 22:52:27,563][52666] DAMAGECOUNT value on done: 16172.0 [2024-08-05 22:52:27,564][52666] Sum rewards: 14.537, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.222', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.320', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.112', 'HITCOUNT': '1.210', 'weapon3': '1.802', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16931.9, 300 sec: 16772.8). Total num frames: 88309760. Throughput: 0: 4191.1. Samples: 22085000. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:52:27,795][52567] Avg episode reward: [(0, '13.667')] [2024-08-05 22:52:27,809][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010780_88309760.pth... [2024-08-05 22:52:27,976][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010289_84287488.pth [2024-08-05 22:52:27,994][52614] Saving new best policy, reward=13.667! [2024-08-05 22:52:28,260][52650] Updated weights for policy 0, policy_version 10781 (0.0011) [2024-08-05 22:52:29,516][52665] DAMAGECOUNT value on done: 14710.0 [2024-08-05 22:52:29,516][52665] Sum rewards: 13.139, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.132', 'AMMO5': '0.013', 'AMMO2': '0.013', 'weapon5': '0.036', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon4': '0.148', 'WEAPON5': '0.150', 'ARMOR': '0.458', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'weapon2': '0.914', 'weapon3': '2.426', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:29,542][52647] DAMAGECOUNT value on done: 14608.0 [2024-08-05 22:52:29,549][52647] Sum rewards: 17.851, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'HEALTH': '0.120', 'weapon4': '0.182', 'ARMOR': '0.517', 'WEAPON3': '0.600', 'weapon3': '1.486', 'HITCOUNT': '1.540', 'weapon2': '1.838', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:29,936][52670] DAMAGECOUNT value on done: 14139.0 [2024-08-05 22:52:29,938][52670] Sum rewards: 10.282, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.214', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.610', 'WEAPON3': '0.650', 'HITCOUNT': '0.710', 'ARMOR': '0.885', 'weapon2': '0.896', 'weapon3': '1.544', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:30,045][52669] DAMAGECOUNT value on done: 14346.0 [2024-08-05 22:52:30,045][52669] Sum rewards: 8.677, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.472', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.108', 'weapon5': '0.172', 'WEAPON4': '0.200', 'ARMOR': '0.513', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '1.300', 'weapon3': '1.516', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '8.000'} [2024-08-05 22:52:30,747][52666] DAMAGECOUNT value on done: 14227.0 [2024-08-05 22:52:30,747][52666] Sum rewards: 17.664, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.152', 'AMMO2': '0.015', 'AMMO3': '0.070', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon4': '0.192', 'ARMOR': '0.448', 'WEAPON3': '0.500', 'HITCOUNT': '1.170', 'weapon2': '1.558', 'weapon3': '1.658', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:32,280][52647] DAMAGECOUNT value on done: 17583.0 [2024-08-05 22:52:32,281][52647] Sum rewards: 13.753, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.639', 'AMMO2': '0.011', 'ARMOR': '0.044', 'AMMO4': '0.055', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.546', 'WEAPON3': '0.800', 'weapon2': '0.856', 'HITCOUNT': '1.110', 'weapon3': '2.258', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '12.000'} [2024-08-05 22:52:32,567][52665] DAMAGECOUNT value on done: 14636.0 [2024-08-05 22:52:32,567][52665] Sum rewards: 9.491, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.936', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.256', 'ARMOR': '0.478', 'WEAPON3': '0.550', 'HITCOUNT': '0.810', 'weapon2': '1.042', 'weapon3': '1.422', 'DAMAGECOUNT': '2.526', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 88391680. Throughput: 0: 4199.1. Samples: 22097740. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 22:52:32,794][52567] Avg episode reward: [(0, '13.642')] [2024-08-05 22:52:32,817][52669] DAMAGECOUNT value on done: 15219.0 [2024-08-05 22:52:32,817][52669] Sum rewards: 12.115, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.236', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.077', 'WEAPON4': '0.250', 'weapon4': '0.254', 'ARMOR': '0.487', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'weapon2': '1.340', 'weapon3': '1.472', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:33,213][52650] Updated weights for policy 0, policy_version 10791 (0.0014) [2024-08-05 22:52:33,381][52670] DAMAGECOUNT value on done: 14950.0 [2024-08-05 22:52:33,381][52670] Sum rewards: 11.207, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.234', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.228', 'ARMOR': '0.556', 'WEAPON3': '1.000', 'HITCOUNT': '1.060', 'weapon2': '1.126', 'weapon3': '2.206', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:35,292][52665] DAMAGECOUNT value on done: 16281.0 [2024-08-05 22:52:35,292][52665] Sum rewards: 6.186, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.024', 'AMMO2': '0.027', 'AMMO3': '0.098', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.506', 'WEAPON3': '0.550', 'ARMOR': '0.864', 'HITCOUNT': '0.950', 'weapon2': '1.428', 'weapon3': '1.686', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '5.000'} [2024-08-05 22:52:35,390][52669] DAMAGECOUNT value on done: 14986.0 [2024-08-05 22:52:35,391][52669] Sum rewards: 5.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.065', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon7': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.187', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.428', 'ARMOR': '0.514', 'weapon2': '0.944', 'HITCOUNT': '0.970', 'WEAPON3': '1.300', 'weapon3': '2.234', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:35,420][52647] DAMAGECOUNT value on done: 13737.0 [2024-08-05 22:52:35,420][52647] Sum rewards: 15.183, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.021', 'AMMO3': '0.073', 'AMMO4': '0.102', 'WEAPON3': '0.400', 'HEALTH': '0.701', 'HITCOUNT': '1.140', 'ARMOR': '1.227', 'weapon3': '1.584', 'weapon2': '1.628', 'DAMAGECOUNT': '3.807', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:37,481][52650] Updated weights for policy 0, policy_version 10801 (0.0011) [2024-08-05 22:52:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16930.1, 300 sec: 16772.8). Total num frames: 88481792. Throughput: 0: 4199.6. Samples: 22123080. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:52:37,794][52567] Avg episode reward: [(0, '13.538')] [2024-08-05 22:52:38,146][52669] DAMAGECOUNT value on done: 16725.0 [2024-08-05 22:52:38,146][52669] Sum rewards: 10.079, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.750', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'ARMOR': '0.036', 'AMMO3': '0.050', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon3': '1.190', 'weapon2': '1.400', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:38,220][52665] DAMAGECOUNT value on done: 15126.0 [2024-08-05 22:52:38,220][52665] Sum rewards: 17.352, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'weapon5': '0.118', 'WEAPON3': '0.700', 'HITCOUNT': '1.060', 'weapon2': '1.532', 'weapon3': '1.796', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '15.000'} [2024-08-05 22:52:38,477][52647] DAMAGECOUNT value on done: 17379.0 [2024-08-05 22:52:38,485][52647] Sum rewards: 16.245, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.310', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.268', 'ARMOR': '0.505', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.276', 'weapon3': '1.598', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:39,093][52663] DAMAGECOUNT value on done: 17029.0 [2024-08-05 22:52:39,097][52663] Sum rewards: 28.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.913', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.107', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon3': '1.590', 'HITCOUNT': '1.840', 'weapon2': '2.038', 'DAMAGECOUNT': '6.210', 'FRAGCOUNT': '23.000'} [2024-08-05 22:52:41,065][52647] DAMAGECOUNT value on done: 15587.0 [2024-08-05 22:52:41,067][52647] Sum rewards: 11.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.923', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'ARMOR': '0.804', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon2': '1.608', 'weapon3': '1.968', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:41,435][52669] DAMAGECOUNT value on done: 14529.0 [2024-08-05 22:52:41,437][52669] Sum rewards: 15.852, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.064', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.897', 'HITCOUNT': '1.300', 'weapon2': '1.366', 'weapon3': '2.030', 'DAMAGECOUNT': '4.647', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:41,446][52665] DAMAGECOUNT value on done: 16687.0 [2024-08-05 22:52:41,448][52665] Sum rewards: 14.795, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'weapon4': '0.118', 'AMMO4': '0.135', 'HEALTH': '0.138', 'WEAPON3': '0.600', 'ARMOR': '0.804', 'HITCOUNT': '1.340', 'weapon2': '1.634', 'weapon3': '1.638', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:42,326][52663] DAMAGECOUNT value on done: 15921.0 [2024-08-05 22:52:42,328][52663] Sum rewards: 9.077, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.051', 'AMMO4': '0.084', 'weapon4': '0.306', 'HEALTH': '0.311', 'WEAPON3': '0.350', 'ARMOR': '0.445', 'HITCOUNT': '0.820', 'weapon3': '1.194', 'weapon2': '1.430', 'DAMAGECOUNT': '2.769', 'FRAGCOUNT': '5.000'} [2024-08-05 22:52:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 88555520. Throughput: 0: 4212.5. Samples: 22148590. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:52:42,794][52567] Avg episode reward: [(0, '13.734')] [2024-08-05 22:52:42,795][52614] Saving new best policy, reward=13.734! [2024-08-05 22:52:43,068][52650] Updated weights for policy 0, policy_version 10811 (0.0012) [2024-08-05 22:52:44,246][52647] DAMAGECOUNT value on done: 16390.0 [2024-08-05 22:52:44,247][52647] Sum rewards: 14.447, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.422', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.300', 'weapon4': '0.638', 'WEAPON3': '0.650', 'HITCOUNT': '0.690', 'ARMOR': '0.889', 'weapon2': '1.062', 'weapon3': '1.480', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '12.000'} [2024-08-05 22:52:44,328][52669] DAMAGECOUNT value on done: 17480.0 [2024-08-05 22:52:44,330][52669] Sum rewards: 11.174, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.130', 'ARMOR': '0.400', 'weapon5': '0.404', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.410', 'weapon3': '1.736', 'DAMAGECOUNT': '3.597', 'FRAGCOUNT': '9.000'} [2024-08-05 22:52:44,854][52665] DAMAGECOUNT value on done: 15089.0 [2024-08-05 22:52:44,856][52665] Sum rewards: 17.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.652', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.132', 'WEAPON4': '0.400', 'weapon4': '0.656', 'ARMOR': '0.975', 'WEAPON3': '1.000', 'weapon2': '1.080', 'HITCOUNT': '1.250', 'weapon3': '1.672', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '15.000'} [2024-08-05 22:52:45,260][52663] DAMAGECOUNT value on done: 15497.0 [2024-08-05 22:52:45,261][52663] Sum rewards: 11.133, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.585', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.040', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.466', 'weapon4': '0.646', 'HITCOUNT': '0.800', 'weapon3': '0.968', 'weapon2': '1.050', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '6.000'} [2024-08-05 22:52:47,091][52647] DAMAGECOUNT value on done: 15693.0 [2024-08-05 22:52:47,092][52647] Sum rewards: 10.176, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.795', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.236', 'ARMOR': '0.460', 'HITCOUNT': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.210', 'weapon3': '1.676', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:47,126][52669] DAMAGECOUNT value on done: 16703.0 [2024-08-05 22:52:47,127][52669] Sum rewards: 13.940, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.568', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.150', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.328', 'ARMOR': '0.445', 'weapon2': '0.976', 'WEAPON3': '1.000', 'HITCOUNT': '1.010', 'weapon3': '1.992', 'DAMAGECOUNT': '4.044', 'FRAGCOUNT': '13.000'} [2024-08-05 22:52:47,692][52650] Updated weights for policy 0, policy_version 10821 (0.0016) [2024-08-05 22:52:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 88645632. Throughput: 0: 4206.7. Samples: 22160860. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-05 22:52:47,795][52567] Avg episode reward: [(0, '13.664')] [2024-08-05 22:52:47,886][52663] DAMAGECOUNT value on done: 17971.0 [2024-08-05 22:52:47,886][52663] Sum rewards: 12.254, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.259', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'weapon4': '0.490', 'WEAPON3': '0.700', 'HITCOUNT': '0.870', 'weapon2': '1.154', 'weapon3': '2.046', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:48,047][52665] DAMAGECOUNT value on done: 16776.0 [2024-08-05 22:52:48,057][52665] Sum rewards: 3.529, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.396', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.106', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.478', 'WEAPON3': '0.650', 'HITCOUNT': '0.720', 'weapon2': '1.112', 'ARMOR': '1.216', 'weapon3': '1.646', 'DAMAGECOUNT': '2.325', 'FRAGCOUNT': '3.500'} [2024-08-05 22:52:49,299][52667] DAMAGECOUNT value on done: 16368.0 [2024-08-05 22:52:49,301][52667] Sum rewards: 9.077, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.746', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.076', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.314', 'HITCOUNT': '0.820', 'WEAPON3': '1.000', 'weapon2': '1.344', 'weapon3': '1.732', 'ARMOR': '1.761', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '10.000'} [2024-08-05 22:52:49,513][52669] DAMAGECOUNT value on done: 16130.0 [2024-08-05 22:52:49,513][52669] Sum rewards: 12.817, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.104', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'HITCOUNT': '1.290', 'weapon2': '1.474', 'weapon3': '2.112', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '12.000'} [2024-08-05 22:52:50,517][52663] DAMAGECOUNT value on done: 13875.0 [2024-08-05 22:52:50,518][52663] Sum rewards: 8.980, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.422', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.284', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon3': '1.146', 'ARMOR': '1.325', 'weapon2': '1.540', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '6.000'} [2024-08-05 22:52:50,964][52665] DAMAGECOUNT value on done: 15148.0 [2024-08-05 22:52:50,965][52665] Sum rewards: 8.943, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.476', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO3': '0.084', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'ARMOR': '0.843', 'weapon2': '1.336', 'weapon3': '1.524', 'DAMAGECOUNT': '2.511', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:52,677][52667] DAMAGECOUNT value on done: 15987.0 [2024-08-05 22:52:52,679][52667] Sum rewards: 19.198, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.401', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.093', 'ARMOR': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.650', 'HITCOUNT': '1.240', 'weapon2': '1.296', 'weapon3': '1.954', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '16.000'} [2024-08-05 22:52:52,684][52669] DAMAGECOUNT value on done: 16007.0 [2024-08-05 22:52:52,685][52669] Sum rewards: 17.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.118', 'weapon4': '0.142', 'WEAPON4': '0.150', 'ARMOR': '0.469', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon2': '1.568', 'weapon3': '1.780', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '15.000'} [2024-08-05 22:52:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.2, 300 sec: 16717.2). Total num frames: 88719360. Throughput: 0: 4202.9. Samples: 22185650. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-05 22:52:52,794][52567] Avg episode reward: [(0, '13.474')] [2024-08-05 22:52:52,891][52650] Updated weights for policy 0, policy_version 10831 (0.0012) [2024-08-05 22:52:53,686][52663] DAMAGECOUNT value on done: 15823.0 [2024-08-05 22:52:53,687][52663] Sum rewards: 8.406, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.780', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.396', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '0.955', 'weapon2': '1.278', 'weapon3': '1.610', 'DAMAGECOUNT': '2.397', 'FRAGCOUNT': '7.000'} [2024-08-05 22:52:54,024][52665] DAMAGECOUNT value on done: 15283.0 [2024-08-05 22:52:54,024][52665] Sum rewards: 13.748, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.980', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'ARMOR': '0.012', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.254', 'WEAPON3': '0.550', 'weapon2': '0.920', 'HITCOUNT': '1.030', 'weapon3': '1.330', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '11.000'} [2024-08-05 22:52:55,584][52669] DAMAGECOUNT value on done: 16561.0 [2024-08-05 22:52:55,585][52669] Sum rewards: 21.989, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.202', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.096', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.500', 'weapon3': '1.838', 'weapon2': '1.900', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '16.000'} [2024-08-05 22:52:55,908][52667] DAMAGECOUNT value on done: 15059.0 [2024-08-05 22:52:55,910][52667] Sum rewards: 6.799, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.162', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'weapon4': '0.316', 'ARMOR': '0.435', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.166', 'weapon3': '1.694', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '6.000'} [2024-08-05 22:52:56,670][52663] DAMAGECOUNT value on done: 17982.0 [2024-08-05 22:52:56,671][52663] Sum rewards: 7.888, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.449', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'WEAPON3': '0.450', 'HITCOUNT': '0.930', 'weapon3': '0.982', 'ARMOR': '1.346', 'weapon2': '1.360', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '4.000'} [2024-08-05 22:52:56,977][52665] DAMAGECOUNT value on done: 15680.0 [2024-08-05 22:52:56,978][52665] Sum rewards: 4.110, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO2': '0.035', 'weapon7': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.175', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'HITCOUNT': '0.630', 'weapon4': '0.658', 'WEAPON3': '0.750', 'weapon2': '1.020', 'weapon3': '1.530', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '4.000'} [2024-08-05 22:52:57,379][52650] Updated weights for policy 0, policy_version 10841 (0.0023) [2024-08-05 22:52:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 88817664. Throughput: 0: 4203.6. Samples: 22211010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:52:57,794][52567] Avg episode reward: [(0, '13.488')] [2024-08-05 22:52:58,565][52667] DAMAGECOUNT value on done: 15861.0 [2024-08-05 22:52:58,565][52667] Sum rewards: 6.380, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.874', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.374', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'weapon2': '1.262', 'ARMOR': '1.384', 'weapon3': '1.400', 'DAMAGECOUNT': '1.920', 'FRAGCOUNT': '4.000'} [2024-08-05 22:52:58,871][52669] DAMAGECOUNT value on done: 15418.0 [2024-08-05 22:52:58,882][52669] Sum rewards: 9.709, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.896', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON3': '0.700', 'HITCOUNT': '0.700', 'ARMOR': '0.981', 'weapon2': '1.214', 'weapon3': '1.838', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '8.000'} [2024-08-05 22:52:59,947][52663] DAMAGECOUNT value on done: 14159.0 [2024-08-05 22:52:59,949][52663] Sum rewards: 7.433, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.922', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.024', 'weapon4': '0.028', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.000', 'weapon2': '1.420', 'weapon3': '2.052', 'DAMAGECOUNT': '3.054', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:00,050][52665] DAMAGECOUNT value on done: 16095.0 [2024-08-05 22:53:00,052][52665] Sum rewards: 14.691, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.534', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.120', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'weapon2': '1.440', 'ARMOR': '1.668', 'weapon3': '1.848', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:01,328][52667] DAMAGECOUNT value on done: 16770.0 [2024-08-05 22:53:01,329][52667] Sum rewards: 6.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.875', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO5': '0.015', 'weapon5': '0.024', 'AMMO3': '0.073', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.532', 'HITCOUNT': '0.560', 'WEAPON3': '0.600', 'weapon4': '0.600', 'weapon2': '0.868', 'weapon3': '1.630', 'DAMAGECOUNT': '1.953', 'FRAGCOUNT': '5.000'} [2024-08-05 22:53:01,979][52669] DAMAGECOUNT value on done: 17015.0 [2024-08-05 22:53:01,979][52669] Sum rewards: 20.094, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.527', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.087', 'WEAPON4': '0.250', 'weapon4': '0.434', 'WEAPON3': '0.600', 'ARMOR': '0.888', 'HITCOUNT': '1.380', 'weapon2': '1.382', 'weapon3': '1.770', 'DAMAGECOUNT': '4.629', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:02,419][52650] Updated weights for policy 0, policy_version 10851 (0.0013) [2024-08-05 22:53:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 88891392. Throughput: 0: 4206.9. Samples: 22223890. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:53:02,794][52567] Avg episode reward: [(0, '13.476')] [2024-08-05 22:53:02,969][52663] DAMAGECOUNT value on done: 15476.0 [2024-08-05 22:53:02,969][52663] Sum rewards: 10.569, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.023', 'AMMO3': '0.091', 'weapon7': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.352', 'WEAPON3': '0.500', 'HEALTH': '0.554', 'ARMOR': '0.832', 'HITCOUNT': '0.860', 'weapon2': '0.912', 'weapon3': '1.638', 'DAMAGECOUNT': '3.396', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:03,353][52665] DAMAGECOUNT value on done: 15721.0 [2024-08-05 22:53:03,353][52665] Sum rewards: 16.701, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.432', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.310', 'WEAPON3': '0.400', 'HITCOUNT': '1.010', 'weapon3': '1.182', 'ARMOR': '1.334', 'weapon2': '1.402', 'DAMAGECOUNT': '3.387', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:04,235][52667] DAMAGECOUNT value on done: 17659.0 [2024-08-05 22:53:04,243][52667] Sum rewards: 17.184, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.472', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.124', 'ARMOR': '0.416', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'weapon2': '1.514', 'weapon3': '1.998', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '16.000'} [2024-08-05 22:53:05,503][52664] DAMAGECOUNT value on done: 17274.0 [2024-08-05 22:53:05,505][52664] Sum rewards: 9.350, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.808', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.125', 'weapon4': '0.192', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'WEAPON3': '0.850', 'HITCOUNT': '1.050', 'weapon2': '1.590', 'weapon3': '1.750', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:06,018][52665] DAMAGECOUNT value on done: 15088.0 [2024-08-05 22:53:06,019][52665] Sum rewards: 8.474, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.349', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.054', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.330', 'WEAPON3': '0.400', 'ARMOR': '0.509', 'HITCOUNT': '0.840', 'weapon2': '1.380', 'weapon3': '1.440', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '5.500'} [2024-08-05 22:53:06,228][52663] DAMAGECOUNT value on done: 18088.0 [2024-08-05 22:53:06,231][52663] Sum rewards: 21.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.109', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.128', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'weapon2': '1.506', 'HITCOUNT': '1.640', 'weapon3': '1.646', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '17.000'} [2024-08-05 22:53:07,029][52667] DAMAGECOUNT value on done: 16530.0 [2024-08-05 22:53:07,037][52667] Sum rewards: 12.653, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.559', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.384', 'WEAPON3': '0.600', 'ARMOR': '0.944', 'HITCOUNT': '1.070', 'weapon2': '1.292', 'weapon3': '1.414', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:07,075][52650] Updated weights for policy 0, policy_version 10861 (0.0012) [2024-08-05 22:53:07,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 88981504. Throughput: 0: 4209.3. Samples: 22249320. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:53:07,795][52567] Avg episode reward: [(0, '13.520')] [2024-08-05 22:53:08,228][52664] DAMAGECOUNT value on done: 14157.0 [2024-08-05 22:53:08,229][52664] Sum rewards: 8.750, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.628', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'ARMOR': '0.459', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'weapon3': '1.746', 'weapon2': '1.762', 'DAMAGECOUNT': '2.517', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:09,270][52663] DAMAGECOUNT value on done: 15261.0 [2024-08-05 22:53:09,279][52663] Sum rewards: 2.310, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.460', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.262', 'HITCOUNT': '0.440', 'WEAPON3': '0.450', 'ARMOR': '0.496', 'FRAGCOUNT': '1.000', 'weapon3': '1.090', 'weapon2': '1.234', 'DAMAGECOUNT': '1.308'} [2024-08-05 22:53:09,296][52665] DAMAGECOUNT value on done: 15725.0 [2024-08-05 22:53:09,301][52665] Sum rewards: 10.188, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.120', 'AMMO2': '0.002', 'AMMO4': '0.010', 'ARMOR': '0.071', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.450', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '1.114', 'weapon3': '1.818', 'DAMAGECOUNT': '2.529', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:09,742][52667] DAMAGECOUNT value on done: 15535.0 [2024-08-05 22:53:09,743][52667] Sum rewards: 13.953, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.911', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.012', 'AMMO4': '0.036', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.344', 'WEAPON3': '0.600', 'ARMOR': '0.854', 'weapon2': '0.878', 'HITCOUNT': '1.010', 'weapon3': '1.556', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:10,964][52664] DAMAGECOUNT value on done: 16409.0 [2024-08-05 22:53:10,967][52664] Sum rewards: 8.275, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.320', 'WEAPON3': '0.550', 'HITCOUNT': '0.770', 'ARMOR': '0.926', 'weapon2': '1.296', 'weapon3': '1.600', 'DAMAGECOUNT': '2.535', 'FRAGCOUNT': '6.000'} [2024-08-05 22:53:11,912][52803] DAMAGECOUNT value on done: 14368.0 [2024-08-05 22:53:11,912][52803] Sum rewards: 17.816, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.211', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.120', 'weapon4': '0.276', 'WEAPON3': '0.700', 'ARMOR': '0.871', 'weapon2': '1.144', 'HITCOUNT': '1.160', 'weapon3': '1.712', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:12,175][52658] DAMAGECOUNT value on done: 15908.0 [2024-08-05 22:53:12,177][52658] Sum rewards: 14.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.054', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.532', 'WEAPON3': '0.800', 'ARMOR': '0.808', 'weapon2': '0.992', 'HITCOUNT': '1.060', 'weapon3': '1.624', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:12,366][52663] DAMAGECOUNT value on done: 15241.0 [2024-08-05 22:53:12,367][52663] Sum rewards: 7.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'AMMO2': '0.030', 'AMMO3': '0.142', 'AMMO4': '0.151', 'weapon4': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.026', 'HITCOUNT': '1.080', 'ARMOR': '1.750', 'weapon3': '2.258', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:12,403][52650] Updated weights for policy 0, policy_version 10871 (0.0013) [2024-08-05 22:53:12,422][52667] DAMAGECOUNT value on done: 16275.0 [2024-08-05 22:53:12,423][52667] Sum rewards: 10.991, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.694', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.036', 'weapon7': '0.048', 'AMMO4': '0.058', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.460', 'WEAPON3': '0.750', 'HITCOUNT': '0.880', 'weapon2': '1.048', 'weapon3': '2.042', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:12,423][52665] DAMAGECOUNT value on done: 14106.0 [2024-08-05 22:53:12,429][52665] Sum rewards: 10.912, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.995', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.370', 'ARMOR': '0.481', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'weapon2': '1.458', 'weapon3': '1.512', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:12,794][52567] Fps is (10 sec: 16383.5, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 89055232. Throughput: 0: 4214.7. Samples: 22274660. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-05 22:53:12,795][52567] Avg episode reward: [(0, '13.356')] [2024-08-05 22:53:14,408][52664] DAMAGECOUNT value on done: 15456.0 [2024-08-05 22:53:14,416][52664] Sum rewards: 17.342, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.848', 'HITCOUNT': '0.980', 'weapon2': '1.080', 'weapon3': '1.632', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:14,921][52663] DAMAGECOUNT value on done: 14623.0 [2024-08-05 22:53:14,922][52663] Sum rewards: 7.351, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '0.008', 'AMMO2': '0.015', 'AMMO3': '0.047', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'weapon4': '0.262', 'HITCOUNT': '0.280', 'WEAPON3': '0.300', 'weapon2': '0.410', 'ARMOR': '0.432', 'weapon3': '0.780', 'DAMAGECOUNT': '0.942', 'FRAGCOUNT': '6.000'} [2024-08-05 22:53:14,972][52811] DAMAGECOUNT value on done: 16258.0 [2024-08-05 22:53:14,975][52811] Sum rewards: 11.981, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.060', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.072', 'weapon4': '0.274', 'WEAPON3': '0.450', 'ARMOR': '0.877', 'HITCOUNT': '0.900', 'weapon2': '1.354', 'weapon3': '1.388', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:15,276][52803] DAMAGECOUNT value on done: 17151.0 [2024-08-05 22:53:15,276][52803] Sum rewards: 16.555, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.443', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.092', 'weapon4': '0.114', 'WEAPON4': '0.200', 'ARMOR': '0.491', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'weapon2': '1.432', 'weapon3': '1.768', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:15,502][52658] DAMAGECOUNT value on done: 15743.0 [2024-08-05 22:53:15,503][52658] Sum rewards: 10.503, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.726', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'AMMO4': '0.122', 'weapon5': '0.154', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'weapon4': '0.510', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.116', 'weapon3': '1.768', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:15,691][52667] DAMAGECOUNT value on done: 16658.0 [2024-08-05 22:53:15,691][52667] Sum rewards: 15.252, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '0.800', 'ARMOR': '0.970', 'HITCOUNT': '1.080', 'weapon2': '1.274', 'weapon3': '1.954', 'DAMAGECOUNT': '3.786', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:15,915][52665] DAMAGECOUNT value on done: 15481.0 [2024-08-05 22:53:15,915][52665] Sum rewards: 12.393, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.316', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.073', 'WEAPON4': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.600', 'HITCOUNT': '1.210', 'ARMOR': '1.342', 'weapon2': '1.476', 'weapon3': '1.606', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:16,716][52650] Updated weights for policy 0, policy_version 10881 (0.0023) [2024-08-05 22:53:17,122][52664] DAMAGECOUNT value on done: 15197.0 [2024-08-05 22:53:17,123][52664] Sum rewards: 11.041, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.023', 'AMMO3': '0.075', 'AMMO4': '0.117', 'WEAPON3': '0.400', 'HITCOUNT': '0.630', 'HEALTH': '0.890', 'weapon3': '1.220', 'ARMOR': '1.224', 'weapon2': '1.740', 'DAMAGECOUNT': '2.472', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:17,623][52649] DAMAGECOUNT value on done: 16305.0 [2024-08-05 22:53:17,626][52649] Sum rewards: 15.096, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.228', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.119', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon2': '1.222', 'ARMOR': '1.273', 'weapon3': '1.818', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:17,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.2, 300 sec: 16772.8). Total num frames: 89153536. Throughput: 0: 4204.7. Samples: 22286950. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-05 22:53:17,794][52567] Avg episode reward: [(0, '13.172')] [2024-08-05 22:53:17,842][52663] DAMAGECOUNT value on done: 15058.0 [2024-08-05 22:53:17,842][52663] Sum rewards: 7.387, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.210', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.044', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.550', 'weapon3': '0.616', 'weapon2': '1.240', 'DAMAGECOUNT': '1.623', 'FRAGCOUNT': '5.000'} [2024-08-05 22:53:18,223][52811] DAMAGECOUNT value on done: 15383.0 [2024-08-05 22:53:18,223][52811] Sum rewards: 13.459, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.692', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'ARMOR': '0.436', 'weapon4': '0.572', 'WEAPON3': '0.650', 'HITCOUNT': '1.200', 'weapon2': '1.264', 'weapon3': '1.606', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:18,551][52803] DAMAGECOUNT value on done: 14810.0 [2024-08-05 22:53:18,553][52803] Sum rewards: 20.408, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.334', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.442', 'ARMOR': '0.459', 'WEAPON3': '0.600', 'weapon2': '1.076', 'HITCOUNT': '1.510', 'weapon3': '1.696', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:18,684][52658] DAMAGECOUNT value on done: 13511.0 [2024-08-05 22:53:18,684][52658] Sum rewards: 7.609, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.499', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.041', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.510', 'HITCOUNT': '0.690', 'weapon2': '0.780', 'ARMOR': '0.907', 'weapon3': '0.988', 'DAMAGECOUNT': '2.160', 'FRAGCOUNT': '4.000'} [2024-08-05 22:53:18,781][52667] DAMAGECOUNT value on done: 15053.0 [2024-08-05 22:53:18,781][52667] Sum rewards: 15.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.956', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.127', 'WEAPON3': '0.850', 'ARMOR': '1.347', 'HITCOUNT': '1.370', 'weapon2': '1.658', 'weapon3': '2.012', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:19,788][52664] DAMAGECOUNT value on done: 17285.0 [2024-08-05 22:53:19,788][52664] Sum rewards: 18.144, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.836', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.078', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'weapon3': '1.454', 'HITCOUNT': '1.590', 'weapon2': '1.704', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:20,758][52663] DAMAGECOUNT value on done: 15511.0 [2024-08-05 22:53:20,759][52663] Sum rewards: 8.725, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.925', 'AMMO2': '0.018', 'ARMOR': '0.049', 'AMMO3': '0.063', 'AMMO4': '0.088', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '0.974', 'weapon3': '1.390', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:21,159][52649] DAMAGECOUNT value on done: 15778.0 [2024-08-05 22:53:21,161][52649] Sum rewards: 12.282, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.050', 'HEALTH': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.252', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '1.010', 'weapon3': '1.136', 'weapon2': '1.162', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:21,198][52658] DAMAGECOUNT value on done: 14842.0 [2024-08-05 22:53:21,199][52658] Sum rewards: 12.114, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.696', 'weapon7': '0.016', 'AMMO2': '0.023', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.115', 'weapon4': '0.202', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.938', 'HITCOUNT': '0.980', 'weapon2': '1.262', 'weapon3': '1.954', 'DAMAGECOUNT': '3.111', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:21,275][52667] DAMAGECOUNT value on done: 16219.0 [2024-08-05 22:53:21,275][52667] Sum rewards: 9.634, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.801', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.116', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'ARMOR': '0.971', 'weapon2': '1.132', 'weapon3': '1.840', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:21,673][52811] DAMAGECOUNT value on done: 15260.0 [2024-08-05 22:53:21,675][52811] Sum rewards: 17.022, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.075', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'HEALTH': '0.226', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'weapon4': '0.512', 'weapon2': '0.846', 'HITCOUNT': '1.260', 'weapon3': '1.398', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:21,715][52803] DAMAGECOUNT value on done: 14515.0 [2024-08-05 22:53:21,715][52803] Sum rewards: 11.182, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.035', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.456', 'WEAPON3': '0.700', 'HITCOUNT': '0.900', 'ARMOR': '0.901', 'weapon2': '0.982', 'weapon3': '1.488', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:21,986][52650] Updated weights for policy 0, policy_version 10891 (0.0028) [2024-08-05 22:53:22,603][52664] DAMAGECOUNT value on done: 15979.0 [2024-08-05 22:53:22,605][52664] Sum rewards: 6.083, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.907', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '0.600', 'weapon2': '0.834', 'weapon3': '1.306', 'ARMOR': '1.406', 'DAMAGECOUNT': '2.016', 'FRAGCOUNT': '4.000'} [2024-08-05 22:53:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 89227264. Throughput: 0: 4202.9. Samples: 22312210. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 22:53:22,795][52567] Avg episode reward: [(0, '12.648')] [2024-08-05 22:53:24,022][52658] DAMAGECOUNT value on done: 15980.0 [2024-08-05 22:53:24,023][52658] Sum rewards: 9.066, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.264', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.082', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.256', 'WEAPON4': '0.300', 'ARMOR': '0.489', 'WEAPON3': '0.700', 'HITCOUNT': '0.830', 'weapon2': '1.194', 'weapon3': '1.440', 'DAMAGECOUNT': '2.997', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:24,113][52667] DAMAGECOUNT value on done: 15833.0 [2024-08-05 22:53:24,115][52667] Sum rewards: 15.774, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'HEALTH': '0.178', 'weapon4': '0.286', 'WEAPON3': '0.600', 'weapon2': '1.034', 'HITCOUNT': '1.140', 'weapon3': '1.534', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:24,566][52663] DAMAGECOUNT value on done: 16628.0 [2024-08-05 22:53:24,566][52663] Sum rewards: 16.580, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.363', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.200', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'HITCOUNT': '1.460', 'weapon2': '1.532', 'weapon3': '1.776', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:24,728][52649] DAMAGECOUNT value on done: 15618.0 [2024-08-05 22:53:24,728][52649] Sum rewards: 13.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'weapon4': '0.006', 'ARMOR': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon2': '1.206', 'WEAPON3': '1.250', 'HITCOUNT': '1.460', 'weapon3': '2.320', 'DAMAGECOUNT': '5.274', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:24,871][52803] DAMAGECOUNT value on done: 15990.0 [2024-08-05 22:53:24,882][52803] Sum rewards: 11.936, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.238', 'AMMO2': '0.006', 'weapon4': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'ARMOR': '0.520', 'WEAPON3': '0.700', 'HITCOUNT': '1.020', 'weapon2': '1.226', 'weapon3': '1.510', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:25,113][52664] DAMAGECOUNT value on done: 16155.0 [2024-08-05 22:53:25,114][52664] Sum rewards: 16.668, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'AMMO3': '0.101', 'WEAPON4': '0.400', 'weapon4': '0.590', 'WEAPON3': '0.800', 'ARMOR': '0.964', 'weapon2': '1.248', 'HITCOUNT': '1.420', 'weapon3': '1.784', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:25,132][52811] DAMAGECOUNT value on done: 16206.0 [2024-08-05 22:53:25,132][52811] Sum rewards: 23.933, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.961', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'WEAPON3': '0.900', 'weapon2': '1.412', 'HITCOUNT': '1.580', 'weapon3': '1.930', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '20.000'} [2024-08-05 22:53:26,441][52658] DAMAGECOUNT value on done: 13297.0 [2024-08-05 22:53:26,443][52658] Sum rewards: 9.845, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.532', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.059', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.416', 'ARMOR': '0.453', 'HITCOUNT': '0.710', 'weapon3': '0.976', 'weapon2': '1.028', 'DAMAGECOUNT': '2.757', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:26,509][52667] DAMAGECOUNT value on done: 16266.0 [2024-08-05 22:53:26,510][52667] Sum rewards: 6.834, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.744', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'ARMOR': '0.408', 'HITCOUNT': '0.660', 'WEAPON3': '0.700', 'weapon2': '1.340', 'weapon3': '1.716', 'DAMAGECOUNT': '2.436', 'FRAGCOUNT': '6.000'} [2024-08-05 22:53:26,660][52650] Updated weights for policy 0, policy_version 10901 (0.0012) [2024-08-05 22:53:27,320][52671] DAMAGECOUNT value on done: 18728.0 [2024-08-05 22:53:27,322][52671] Sum rewards: 24.417, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.127', 'weapon4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.220', 'ARMOR': '0.509', 'WEAPON3': '0.900', 'weapon2': '0.946', 'HITCOUNT': '1.670', 'weapon3': '2.462', 'DAMAGECOUNT': '6.444', 'FRAGCOUNT': '20.000'} [2024-08-05 22:53:27,747][52649] DAMAGECOUNT value on done: 15577.0 [2024-08-05 22:53:27,748][52649] Sum rewards: 4.766, reward structure: {'DEATHCOUNT': '-1.500', 'HEALTH': '-0.096', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.028', 'AMMO3': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.184', 'WEAPON3': '0.250', 'HITCOUNT': '0.310', 'weapon3': '0.718', 'weapon2': '0.738', 'DAMAGECOUNT': '0.978', 'FRAGCOUNT': '3.000'} [2024-08-05 22:53:27,795][52567] Fps is (10 sec: 16383.3, 60 sec: 16793.5, 300 sec: 16772.7). Total num frames: 89317376. Throughput: 0: 4191.7. Samples: 22337220. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-05 22:53:27,795][52567] Avg episode reward: [(0, '12.605')] [2024-08-05 22:53:28,096][52663] DAMAGECOUNT value on done: 16199.0 [2024-08-05 22:53:28,096][52663] Sum rewards: 16.691, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'WEAPON4': '0.050', 'AMMO3': '0.111', 'weapon4': '0.284', 'WEAPON3': '0.750', 'ARMOR': '0.937', 'weapon2': '1.222', 'HITCOUNT': '1.370', 'weapon3': '1.780', 'DAMAGECOUNT': '4.854', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:28,212][52803] DAMAGECOUNT value on done: 14804.0 [2024-08-05 22:53:28,212][52803] Sum rewards: 10.658, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO3': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'HEALTH': '0.248', 'WEAPON3': '0.300', 'ARMOR': '0.424', 'weapon4': '0.448', 'HITCOUNT': '0.900', 'weapon3': '1.194', 'weapon2': '1.328', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:28,435][52664] DAMAGECOUNT value on done: 18123.0 [2024-08-05 22:53:28,436][52664] Sum rewards: 15.661, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.398', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.086', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.300', 'weapon2': '1.418', 'weapon3': '1.574', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:28,464][52811] DAMAGECOUNT value on done: 16748.0 [2024-08-05 22:53:28,464][52811] Sum rewards: 17.673, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.076', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.062', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'ARMOR': '0.432', 'WEAPON3': '0.950', 'weapon2': '1.378', 'HITCOUNT': '1.530', 'weapon3': '2.142', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:28,865][52658] DAMAGECOUNT value on done: 18100.0 [2024-08-05 22:53:28,865][52658] Sum rewards: 16.566, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.213', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.288', 'WEAPON3': '0.600', 'ARMOR': '0.876', 'HITCOUNT': '1.210', 'weapon2': '1.496', 'weapon3': '1.678', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:28,958][52667] DAMAGECOUNT value on done: 17063.0 [2024-08-05 22:53:28,960][52667] Sum rewards: 14.787, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.054', 'AMMO2': '0.047', 'weapon4': '0.090', 'AMMO3': '0.131', 'AMMO4': '0.236', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'WEAPON3': '0.900', 'weapon2': '0.998', 'HITCOUNT': '1.140', 'weapon3': '2.076', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:30,596][52663] DAMAGECOUNT value on done: 15274.0 [2024-08-05 22:53:30,597][52663] Sum rewards: 13.522, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.747', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon7': '0.052', 'ARMOR': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.138', 'weapon4': '0.174', 'AMMO4': '0.198', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.204', 'HITCOUNT': '1.470', 'weapon3': '1.650', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '10.500'} [2024-08-05 22:53:30,622][52671] DAMAGECOUNT value on done: 15397.0 [2024-08-05 22:53:30,622][52671] Sum rewards: 8.560, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.208', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.016', 'AMMO4': '0.068', 'AMMO3': '0.117', 'WEAPON5': '0.200', 'ARMOR': '0.478', 'WEAPON4': '0.500', 'weapon4': '0.764', 'WEAPON3': '0.800', 'weapon2': '1.026', 'HITCOUNT': '1.210', 'weapon3': '1.876', 'DAMAGECOUNT': '4.689', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:31,179][52649] DAMAGECOUNT value on done: 15404.0 [2024-08-05 22:53:31,181][52649] Sum rewards: 10.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon3': '1.166', 'weapon2': '1.250', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:31,387][52650] Updated weights for policy 0, policy_version 10911 (0.0021) [2024-08-05 22:53:31,554][52803] DAMAGECOUNT value on done: 17538.0 [2024-08-05 22:53:31,556][52803] Sum rewards: 11.100, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.779', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'weapon4': '0.002', 'ARMOR': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.123', 'WEAPON3': '0.900', 'HITCOUNT': '1.020', 'weapon2': '1.272', 'weapon3': '1.852', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:31,713][52811] DAMAGECOUNT value on done: 14833.0 [2024-08-05 22:53:31,716][52811] Sum rewards: 15.590, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.021', 'AMMO4': '0.102', 'HEALTH': '0.112', 'AMMO3': '0.115', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon2': '1.538', 'weapon3': '1.900', 'ARMOR': '2.162', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:31,735][52658] DAMAGECOUNT value on done: 15152.0 [2024-08-05 22:53:31,737][52658] Sum rewards: 12.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.538', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.412', 'ARMOR': '0.509', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.004', 'weapon3': '1.456', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:31,823][52664] DAMAGECOUNT value on done: 15661.0 [2024-08-05 22:53:31,823][52664] Sum rewards: 11.915, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.024', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon5': '0.432', 'WEAPON3': '0.800', 'ARMOR': '0.848', 'HITCOUNT': '0.880', 'weapon2': '1.330', 'weapon3': '1.786', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:31,924][52667] DAMAGECOUNT value on done: 17802.0 [2024-08-05 22:53:31,925][52667] Sum rewards: 21.455, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.346', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.116', 'WEAPON3': '0.800', 'weapon2': '1.474', 'HITCOUNT': '1.520', 'weapon3': '1.546', 'ARMOR': '1.679', 'DAMAGECOUNT': '5.427', 'FRAGCOUNT': '17.000'} [2024-08-05 22:53:32,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16657.1, 300 sec: 16717.2). Total num frames: 89391104. Throughput: 0: 4199.6. Samples: 22349840. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 22:53:32,794][52567] Avg episode reward: [(0, '12.711')] [2024-08-05 22:53:33,009][52671] DAMAGECOUNT value on done: 18095.0 [2024-08-05 22:53:33,010][52671] Sum rewards: 13.985, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.856', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.344', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'weapon2': '1.168', 'HITCOUNT': '1.300', 'weapon3': '1.756', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:33,744][52663] DAMAGECOUNT value on done: 14527.0 [2024-08-05 22:53:33,745][52663] Sum rewards: 13.543, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.147', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.840', 'HITCOUNT': '1.100', 'weapon2': '1.494', 'weapon3': '1.714', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:34,332][52649] DAMAGECOUNT value on done: 16650.0 [2024-08-05 22:53:34,333][52649] Sum rewards: 19.171, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.248', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon7': '0.048', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.508', 'weapon4': '0.590', 'WEAPON3': '0.800', 'weapon2': '1.048', 'HITCOUNT': '1.390', 'weapon3': '1.996', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:34,935][52811] DAMAGECOUNT value on done: 16106.0 [2024-08-05 22:53:34,936][52811] Sum rewards: 12.118, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.364', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.216', 'WEAPON3': '0.700', 'ARMOR': '0.852', 'HITCOUNT': '1.220', 'weapon2': '1.692', 'weapon3': '1.774', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:34,971][52664] DAMAGECOUNT value on done: 17768.0 [2024-08-05 22:53:34,972][52664] Sum rewards: 15.196, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.092', 'weapon5': '0.230', 'WEAPON3': '0.500', 'HEALTH': '0.672', 'HITCOUNT': '1.220', 'weapon2': '1.496', 'weapon3': '1.722', 'ARMOR': '2.057', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:35,080][52803] DAMAGECOUNT value on done: 13806.0 [2024-08-05 22:53:35,082][52803] Sum rewards: 12.832, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.650', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.115', 'WEAPON4': '0.300', 'weapon4': '0.312', 'ARMOR': '0.491', 'WEAPON3': '0.750', 'weapon2': '1.214', 'HITCOUNT': '1.400', 'weapon3': '1.896', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:35,099][52658] DAMAGECOUNT value on done: 15649.0 [2024-08-05 22:53:35,099][52658] Sum rewards: 11.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.282', 'WEAPON3': '0.850', 'weapon2': '1.384', 'HITCOUNT': '1.430', 'weapon3': '1.722', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:35,201][52667] DAMAGECOUNT value on done: 16653.0 [2024-08-05 22:53:35,203][52667] Sum rewards: 9.746, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.956', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.121', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.899', 'HITCOUNT': '1.010', 'weapon3': '1.648', 'weapon2': '1.704', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:36,174][52671] DAMAGECOUNT value on done: 15686.0 [2024-08-05 22:53:36,181][52663] DAMAGECOUNT value on done: 15531.0 [2024-08-05 22:53:36,182][52671] Sum rewards: 12.798, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.082', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.038', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'weapon4': '0.550', 'weapon2': '0.660', 'HITCOUNT': '0.970', 'weapon3': '1.322', 'DAMAGECOUNT': '3.081', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:36,182][52663] Sum rewards: 10.750, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.052', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'HITCOUNT': '1.170', 'weapon2': '1.226', 'weapon3': '1.730', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:36,242][52659] DAMAGECOUNT value on done: 16279.0 [2024-08-05 22:53:36,243][52659] Sum rewards: 13.460, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.024', 'AMMO4': '0.031', 'weapon7': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.404', 'ARMOR': '0.459', 'WEAPON3': '0.800', 'weapon2': '1.044', 'HITCOUNT': '1.070', 'weapon3': '1.666', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:36,428][52650] Updated weights for policy 0, policy_version 10921 (0.0015) [2024-08-05 22:53:37,545][52649] DAMAGECOUNT value on done: 13706.0 [2024-08-05 22:53:37,545][52649] Sum rewards: 11.731, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.352', 'AMMO2': '0.026', 'AMMO3': '0.105', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'weapon4': '0.672', 'HITCOUNT': '0.860', 'weapon2': '0.902', 'ARMOR': '0.976', 'weapon3': '1.754', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16793.5, 300 sec: 16800.5). Total num frames: 89489408. Throughput: 0: 4204.4. Samples: 22374850. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 22:53:37,795][52567] Avg episode reward: [(0, '12.582')] [2024-08-05 22:53:38,063][52664] DAMAGECOUNT value on done: 15131.0 [2024-08-05 22:53:38,067][52664] Sum rewards: 13.897, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.302', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.104', 'WEAPON3': '0.750', 'ARMOR': '0.849', 'HITCOUNT': '1.150', 'weapon2': '1.380', 'weapon3': '1.624', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:38,255][52811] DAMAGECOUNT value on done: 12578.0 [2024-08-05 22:53:38,256][52811] Sum rewards: 15.972, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.046', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.128', 'weapon4': '0.270', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon2': '1.238', 'HITCOUNT': '1.330', 'weapon3': '2.086', 'DAMAGECOUNT': '5.052', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:38,322][52658] DAMAGECOUNT value on done: 15588.0 [2024-08-05 22:53:38,324][52658] Sum rewards: 19.369, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.338', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'WEAPON3': '0.900', 'HITCOUNT': '1.210', 'weapon2': '1.648', 'weapon3': '1.986', 'ARMOR': '2.799', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:38,493][52667] DAMAGECOUNT value on done: 15675.0 [2024-08-05 22:53:38,495][52667] Sum rewards: 4.516, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.478', 'AMMO2': '0.027', 'ARMOR': '0.065', 'AMMO3': '0.099', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.600', 'HITCOUNT': '0.630', 'weapon2': '0.764', 'weapon3': '1.770', 'DAMAGECOUNT': '1.992', 'FRAGCOUNT': '5.000'} [2024-08-05 22:53:38,524][52803] DAMAGECOUNT value on done: 15375.0 [2024-08-05 22:53:38,525][52803] Sum rewards: 15.803, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.543', 'weapon7': '0.010', 'AMMO2': '0.020', 'AMMO3': '0.066', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.402', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'weapon2': '0.852', 'HITCOUNT': '1.030', 'weapon3': '1.292', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:38,734][52671] DAMAGECOUNT value on done: 16043.0 [2024-08-05 22:53:38,734][52671] Sum rewards: 12.390, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.542', 'AMMO2': '0.000', 'AMMO4': '0.000', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.085', 'weapon4': '0.094', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.164', 'weapon3': '1.628', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:38,798][52659] DAMAGECOUNT value on done: 16331.0 [2024-08-05 22:53:38,799][52659] Sum rewards: 14.084, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.020', 'AMMO2': '0.027', 'AMMO3': '0.085', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.202', 'WEAPON3': '0.500', 'weapon2': '1.174', 'HITCOUNT': '1.240', 'weapon3': '1.722', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:40,632][52649] DAMAGECOUNT value on done: 14083.0 [2024-08-05 22:53:40,634][52649] Sum rewards: 12.214, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.489', 'AMMO5': '0.010', 'weapon5': '0.036', 'AMMO2': '0.036', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.911', 'HITCOUNT': '0.960', 'weapon2': '1.448', 'weapon3': '2.056', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:40,947][52664] DAMAGECOUNT value on done: 15511.0 [2024-08-05 22:53:40,947][52664] Sum rewards: 18.509, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.125', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.292', 'WEAPON3': '0.650', 'ARMOR': '0.863', 'HITCOUNT': '1.280', 'weapon2': '1.280', 'weapon3': '1.672', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:41,269][52671] DAMAGECOUNT value on done: 16243.0 [2024-08-05 22:53:41,279][52671] Sum rewards: 8.622, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.665', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.079', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon3': '1.150', 'weapon2': '1.182', 'ARMOR': '1.299', 'DAMAGECOUNT': '1.935', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:41,335][52659] DAMAGECOUNT value on done: 15771.0 [2024-08-05 22:53:41,337][52659] Sum rewards: 15.228, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.281', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.290', 'WEAPON3': '0.350', 'HITCOUNT': '0.850', 'ARMOR': '0.856', 'weapon3': '1.008', 'weapon2': '1.342', 'DAMAGECOUNT': '2.739', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:41,481][52658] DAMAGECOUNT value on done: 16799.0 [2024-08-05 22:53:41,483][52658] Sum rewards: 16.803, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.494', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'ARMOR': '0.420', 'WEAPON3': '1.050', 'weapon2': '1.256', 'HITCOUNT': '1.580', 'weapon3': '2.434', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '16.000'} [2024-08-05 22:53:41,617][52650] Updated weights for policy 0, policy_version 10931 (0.0030) [2024-08-05 22:53:41,643][52667] DAMAGECOUNT value on done: 15458.0 [2024-08-05 22:53:41,648][52667] Sum rewards: 10.319, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.785', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.402', 'ARMOR': '0.464', 'WEAPON3': '0.800', 'weapon2': '0.946', 'HITCOUNT': '0.990', 'weapon3': '1.776', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:41,659][52803] DAMAGECOUNT value on done: 14036.0 [2024-08-05 22:53:41,662][52803] Sum rewards: 19.655, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.506', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon5': '0.156', 'weapon4': '0.342', 'ARMOR': '0.481', 'WEAPON3': '0.750', 'weapon2': '1.262', 'HITCOUNT': '1.360', 'weapon3': '1.726', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:41,737][52811] DAMAGECOUNT value on done: 14331.0 [2024-08-05 22:53:41,737][52811] Sum rewards: 5.162, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO2': '0.026', 'weapon7': '0.046', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON3': '0.550', 'HITCOUNT': '0.590', 'weapon2': '0.868', 'ARMOR': '0.936', 'weapon3': '1.480', 'DAMAGECOUNT': '2.091', 'FRAGCOUNT': '4.000'} [2024-08-05 22:53:42,083][52795] DAMAGECOUNT value on done: 13262.0 [2024-08-05 22:53:42,085][52795] Sum rewards: 13.911, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.272', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.318', 'ARMOR': '0.518', 'WEAPON3': '0.700', 'weapon2': '1.038', 'HITCOUNT': '1.150', 'weapon3': '1.478', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:42,794][52567] Fps is (10 sec: 17202.7, 60 sec: 16793.5, 300 sec: 16772.8). Total num frames: 89563136. Throughput: 0: 4206.6. Samples: 22400310. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 22:53:42,795][52567] Avg episode reward: [(0, '12.793')] [2024-08-05 22:53:43,326][52649] DAMAGECOUNT value on done: 14811.0 [2024-08-05 22:53:43,326][52649] Sum rewards: 14.206, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.246', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.224', 'ARMOR': '0.466', 'WEAPON3': '0.650', 'HITCOUNT': '1.090', 'weapon2': '1.232', 'weapon3': '1.546', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:44,151][52671] DAMAGECOUNT value on done: 16693.0 [2024-08-05 22:53:44,152][52671] Sum rewards: 15.297, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.162', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon4': '0.344', 'ARMOR': '0.465', 'WEAPON3': '1.000', 'weapon2': '1.242', 'HITCOUNT': '1.330', 'weapon3': '1.670', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:44,168][52664] DAMAGECOUNT value on done: 14773.0 [2024-08-05 22:53:44,169][52664] Sum rewards: 8.529, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.900', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.122', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'HITCOUNT': '0.950', 'weapon2': '1.372', 'weapon3': '1.372', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:44,212][52659] DAMAGECOUNT value on done: 16261.0 [2024-08-05 22:53:44,213][52659] Sum rewards: 12.456, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.482', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.344', 'ARMOR': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.102', 'weapon3': '1.238', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:44,562][52658] DAMAGECOUNT value on done: 15179.0 [2024-08-05 22:53:44,562][52658] Sum rewards: 13.924, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.812', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'WEAPON3': '1.000', 'HITCOUNT': '1.020', 'weapon2': '1.118', 'weapon3': '2.172', 'DAMAGECOUNT': '3.558', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:44,679][52667] DAMAGECOUNT value on done: 16690.0 [2024-08-05 22:53:44,680][52667] Sum rewards: 16.764, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.670', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.092', 'WEAPON3': '0.600', 'ARMOR': '0.906', 'HITCOUNT': '1.040', 'weapon2': '1.172', 'weapon3': '1.420', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:44,779][52803] DAMAGECOUNT value on done: 14397.0 [2024-08-05 22:53:44,780][52803] Sum rewards: 11.101, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.637', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.083', 'weapon5': '0.096', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.242', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon2': '1.266', 'weapon3': '1.412', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:44,971][52811] DAMAGECOUNT value on done: 16053.0 [2024-08-05 22:53:44,971][52811] Sum rewards: 14.397, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.370', 'AMMO2': '0.033', 'weapon4': '0.056', 'AMMO3': '0.096', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'ARMOR': '0.427', 'WEAPON3': '0.650', 'HITCOUNT': '1.390', 'weapon3': '1.746', 'weapon2': '1.826', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:45,600][52795] DAMAGECOUNT value on done: 13190.0 [2024-08-05 22:53:45,604][52795] Sum rewards: 5.406, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.142', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'HITCOUNT': '0.820', 'ARMOR': '0.960', 'WEAPON3': '1.100', 'weapon2': '1.254', 'weapon3': '2.070', 'DAMAGECOUNT': '2.736', 'FRAGCOUNT': '7.000'} [2024-08-05 22:53:46,256][52650] Updated weights for policy 0, policy_version 10941 (0.0013) [2024-08-05 22:53:46,915][52649] DAMAGECOUNT value on done: 15907.0 [2024-08-05 22:53:46,916][52649] Sum rewards: 15.405, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.076', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.148', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.872', 'HITCOUNT': '1.060', 'weapon3': '1.430', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:46,965][52671] DAMAGECOUNT value on done: 16551.0 [2024-08-05 22:53:46,966][52671] Sum rewards: 17.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.903', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon2': '1.646', 'weapon3': '2.072', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '15.000'} [2024-08-05 22:53:47,043][52659] DAMAGECOUNT value on done: 15365.0 [2024-08-05 22:53:47,043][52659] Sum rewards: 14.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.302', 'AMMO2': '0.035', 'AMMO3': '0.112', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'weapon4': '0.534', 'WEAPON3': '0.650', 'ARMOR': '0.956', 'weapon2': '1.020', 'HITCOUNT': '1.210', 'weapon3': '1.918', 'DAMAGECOUNT': '3.975', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:47,561][52658] DAMAGECOUNT value on done: 15837.0 [2024-08-05 22:53:47,563][52658] Sum rewards: 17.469, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.630', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.061', 'ARMOR': '0.449', 'WEAPON3': '0.500', 'HITCOUNT': '1.340', 'weapon3': '1.442', 'weapon2': '1.612', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:47,634][52664] DAMAGECOUNT value on done: 16720.0 [2024-08-05 22:53:47,634][52664] Sum rewards: 14.588, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.680', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'ARMOR': '0.470', 'weapon4': '0.478', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon2': '1.278', 'weapon3': '1.680', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:47,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.6, 300 sec: 16800.6). Total num frames: 89653248. Throughput: 0: 4197.6. Samples: 22412780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:53:47,794][52567] Avg episode reward: [(0, '13.098')] [2024-08-05 22:53:47,847][52803] DAMAGECOUNT value on done: 15615.0 [2024-08-05 22:53:47,847][52803] Sum rewards: 17.486, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.154', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'WEAPON3': '0.500', 'weapon4': '0.588', 'HITCOUNT': '1.230', 'weapon2': '1.528', 'weapon3': '1.534', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:48,284][52811] DAMAGECOUNT value on done: 16824.0 [2024-08-05 22:53:48,286][52811] Sum rewards: 13.816, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.461', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.127', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '1.280', 'ARMOR': '1.398', 'weapon2': '1.444', 'weapon3': '2.020', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:48,812][52795] DAMAGECOUNT value on done: 13951.0 [2024-08-05 22:53:48,814][52795] Sum rewards: 12.763, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.294', 'weapon4': '0.002', 'AMMO2': '0.011', 'weapon7': '0.028', 'AMMO4': '0.055', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon3': '1.536', 'weapon2': '1.724', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:49,960][52671] DAMAGECOUNT value on done: 16609.0 [2024-08-05 22:53:49,964][52671] Sum rewards: 11.304, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.027', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.700', 'ARMOR': '0.878', 'HITCOUNT': '0.890', 'weapon2': '1.092', 'weapon3': '1.606', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:49,992][52649] DAMAGECOUNT value on done: 16062.0 [2024-08-05 22:53:49,992][52649] Sum rewards: 11.016, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.489', 'AMMO2': '0.034', 'AMMO3': '0.130', 'ARMOR': '0.136', 'AMMO4': '0.170', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON3': '0.800', 'HITCOUNT': '0.830', 'weapon2': '1.132', 'weapon3': '1.584', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:50,019][52664] DAMAGECOUNT value on done: 13329.0 [2024-08-05 22:53:50,020][52664] Sum rewards: 9.203, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.297', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'HITCOUNT': '0.480', 'WEAPON3': '0.500', 'ARMOR': '0.950', 'weapon2': '0.974', 'weapon3': '1.254', 'DAMAGECOUNT': '1.485', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:50,086][52659] DAMAGECOUNT value on done: 16704.0 [2024-08-05 22:53:50,088][52659] Sum rewards: 4.877, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.300', 'ARMOR': '0.511', 'HITCOUNT': '0.750', 'WEAPON3': '0.850', 'weapon2': '0.910', 'weapon3': '1.590', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '5.000'} [2024-08-05 22:53:50,866][52650] Updated weights for policy 0, policy_version 10951 (0.0020) [2024-08-05 22:53:51,035][52658] DAMAGECOUNT value on done: 16792.0 [2024-08-05 22:53:51,035][52658] Sum rewards: 8.888, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.586', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'weapon4': '0.216', 'ARMOR': '0.459', 'WEAPON3': '0.500', 'HITCOUNT': '0.990', 'weapon3': '1.254', 'weapon2': '1.328', 'DAMAGECOUNT': '3.402', 'FRAGCOUNT': '5.000'} [2024-08-05 22:53:51,170][52803] DAMAGECOUNT value on done: 13604.0 [2024-08-05 22:53:51,171][52803] Sum rewards: 7.438, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.649', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon4': '0.548', 'WEAPON3': '0.750', 'HITCOUNT': '0.900', 'weapon2': '0.990', 'weapon3': '1.562', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '6.000'} [2024-08-05 22:53:51,723][52811] DAMAGECOUNT value on done: 14341.0 [2024-08-05 22:53:51,724][52811] Sum rewards: 12.305, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.182', 'AMMO2': '0.043', 'weapon4': '0.146', 'AMMO3': '0.153', 'AMMO4': '0.217', 'WEAPON4': '0.400', 'ARMOR': '0.812', 'weapon2': '0.904', 'HITCOUNT': '0.990', 'WEAPON3': '1.000', 'weapon3': '2.134', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:51,977][52795] DAMAGECOUNT value on done: 14976.0 [2024-08-05 22:53:51,979][52795] Sum rewards: 14.747, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.618', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.065', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '0.780', 'weapon2': '1.280', 'weapon3': '1.304', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:52,655][52649] DAMAGECOUNT value on done: 15310.0 [2024-08-05 22:53:52,659][52649] Sum rewards: 13.265, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.018', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'WEAPON3': '0.700', 'HITCOUNT': '1.240', 'weapon2': '1.642', 'weapon3': '1.902', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 16772.8). Total num frames: 89735168. Throughput: 0: 4196.4. Samples: 22438160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:53:52,795][52567] Avg episode reward: [(0, '13.121')] [2024-08-05 22:53:52,934][52664] DAMAGECOUNT value on done: 17292.0 [2024-08-05 22:53:52,934][52664] Sum rewards: 10.028, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.358', 'HITCOUNT': '0.910', 'ARMOR': '0.944', 'WEAPON3': '0.950', 'weapon2': '1.484', 'weapon3': '1.874', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:52,978][52671] DAMAGECOUNT value on done: 18072.0 [2024-08-05 22:53:52,979][52671] Sum rewards: 18.341, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.104', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.134', 'WEAPON4': '0.350', 'weapon4': '0.570', 'WEAPON3': '0.850', 'weapon2': '1.150', 'ARMOR': '1.350', 'HITCOUNT': '1.350', 'weapon3': '1.962', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '16.000'} [2024-08-05 22:53:53,129][52659] DAMAGECOUNT value on done: 16440.0 [2024-08-05 22:53:53,130][52659] Sum rewards: 15.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO3': '0.096', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '1.311', 'weapon2': '1.342', 'HITCOUNT': '1.350', 'weapon3': '1.716', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '12.000'} [2024-08-05 22:53:53,468][52614] Signal inference workers to stop experience collection... (2050 times) [2024-08-05 22:53:53,480][52614] Signal inference workers to resume experience collection... (2050 times) [2024-08-05 22:53:53,554][52650] InferenceWorker_p0-w0: stopping experience collection (2050 times) [2024-08-05 22:53:53,554][52650] InferenceWorker_p0-w0: resuming experience collection (2050 times) [2024-08-05 22:53:54,178][52658] DAMAGECOUNT value on done: 15691.0 [2024-08-05 22:53:54,179][52658] Sum rewards: 10.553, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.030', 'AMMO3': '0.079', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'HEALTH': '0.288', 'WEAPON3': '0.450', 'weapon4': '0.874', 'weapon2': '0.974', 'HITCOUNT': '1.040', 'weapon3': '1.136', 'ARMOR': '1.301', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '6.000'} [2024-08-05 22:53:54,382][52803] DAMAGECOUNT value on done: 14710.0 [2024-08-05 22:53:54,383][52803] Sum rewards: 17.566, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.124', 'ARMOR': '0.474', 'WEAPON3': '0.550', 'HITCOUNT': '1.290', 'weapon3': '1.416', 'weapon2': '1.888', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:55,214][52811] DAMAGECOUNT value on done: 14178.0 [2024-08-05 22:53:55,215][52811] Sum rewards: 7.330, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.148', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.060', 'WEAPON3': '0.400', 'HITCOUNT': '0.790', 'weapon3': '1.118', 'weapon2': '1.322', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '5.000'} [2024-08-05 22:53:55,239][52795] DAMAGECOUNT value on done: 18029.0 [2024-08-05 22:53:55,241][52795] Sum rewards: 26.352, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.825', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.099', 'weapon4': '0.194', 'WEAPON4': '0.200', 'ARMOR': '0.429', 'WEAPON3': '0.700', 'HITCOUNT': '1.610', 'weapon2': '1.614', 'weapon3': '1.798', 'DAMAGECOUNT': '6.423', 'FRAGCOUNT': '20.000'} [2024-08-05 22:53:55,246][52664] DAMAGECOUNT value on done: 14182.0 [2024-08-05 22:53:55,248][52664] Sum rewards: 12.221, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.891', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'weapon4': '0.012', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.857', 'HITCOUNT': '1.120', 'weapon2': '1.456', 'weapon3': '1.832', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:55,581][52671] DAMAGECOUNT value on done: 16054.0 [2024-08-05 22:53:55,582][52671] Sum rewards: 13.780, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.491', 'AMMO2': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.392', 'WEAPON3': '0.450', 'HITCOUNT': '0.990', 'weapon2': '1.218', 'weapon3': '1.320', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:55,712][52659] DAMAGECOUNT value on done: 14498.0 [2024-08-05 22:53:55,712][52659] Sum rewards: 15.743, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.284', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.892', 'HITCOUNT': '1.190', 'weapon3': '1.482', 'weapon2': '1.754', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '14.000'} [2024-08-05 22:53:55,930][52649] DAMAGECOUNT value on done: 17803.0 [2024-08-05 22:53:55,931][52649] Sum rewards: 10.257, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.428', 'weapon4': '0.016', 'AMMO2': '0.031', 'AMMO3': '0.104', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'weapon2': '1.158', 'weapon3': '1.714', 'DAMAGECOUNT': '3.087', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:56,009][52650] Updated weights for policy 0, policy_version 10961 (0.0020) [2024-08-05 22:53:57,378][52658] DAMAGECOUNT value on done: 18292.0 [2024-08-05 22:53:57,386][52658] Sum rewards: 16.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.257', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.070', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.338', 'WEAPON3': '0.500', 'ARMOR': '0.925', 'HITCOUNT': '0.960', 'weapon2': '1.450', 'weapon3': '1.628', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '13.000'} [2024-08-05 22:53:57,651][52803] DAMAGECOUNT value on done: 15296.0 [2024-08-05 22:53:57,652][52803] Sum rewards: 13.651, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.032', 'AMMO4': '0.044', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON3': '0.600', 'HITCOUNT': '1.080', 'weapon2': '1.186', 'weapon3': '1.354', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.6). Total num frames: 89825280. Throughput: 0: 4193.4. Samples: 22463360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:53:57,794][52567] Avg episode reward: [(0, '13.355')] [2024-08-05 22:53:58,253][52794] DAMAGECOUNT value on done: 18483.0 [2024-08-05 22:53:58,254][52794] Sum rewards: 12.640, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.838', 'AMMO2': '0.035', 'AMMO3': '0.136', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.456', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.192', 'HITCOUNT': '1.360', 'weapon3': '2.148', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:58,301][52664] DAMAGECOUNT value on done: 15560.0 [2024-08-05 22:53:58,302][52664] Sum rewards: 5.489, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.082', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO3': '0.058', 'WEAPON4': '0.150', 'weapon4': '0.326', 'WEAPON3': '0.450', 'ARMOR': '0.506', 'HITCOUNT': '0.670', 'weapon3': '0.984', 'weapon2': '1.094', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '4.000'} [2024-08-05 22:53:58,422][52811] DAMAGECOUNT value on done: 14338.0 [2024-08-05 22:53:58,423][52811] Sum rewards: 9.475, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.438', 'AMMO2': '0.039', 'weapon4': '0.062', 'AMMO3': '0.153', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'ARMOR': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.000', 'weapon2': '1.190', 'weapon3': '2.214', 'DAMAGECOUNT': '3.309', 'FRAGCOUNT': '9.000'} [2024-08-05 22:53:58,479][52671] DAMAGECOUNT value on done: 16305.0 [2024-08-05 22:53:58,480][52671] Sum rewards: 14.051, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.117', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'weapon7': '0.046', 'AMMO3': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.436', 'ARMOR': '0.509', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.280', 'weapon3': '1.564', 'DAMAGECOUNT': '3.714', 'FRAGCOUNT': '10.000'} [2024-08-05 22:53:58,513][52795] DAMAGECOUNT value on done: 16921.0 [2024-08-05 22:53:58,514][52795] Sum rewards: 9.981, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.324', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.075', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.568', 'HITCOUNT': '0.700', 'weapon2': '1.014', 'weapon3': '1.320', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '8.000'} [2024-08-05 22:53:58,663][52659] DAMAGECOUNT value on done: 15875.0 [2024-08-05 22:53:58,664][52659] Sum rewards: 19.480, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.080', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.318', 'ARMOR': '0.435', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'weapon3': '1.698', 'weapon2': '1.720', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '17.000'} [2024-08-05 22:53:58,673][52649] DAMAGECOUNT value on done: 15038.0 [2024-08-05 22:53:58,674][52649] Sum rewards: 14.382, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.778', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon4': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON3': '0.750', 'HITCOUNT': '1.340', 'ARMOR': '1.344', 'weapon3': '1.370', 'weapon2': '1.452', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '11.000'} [2024-08-05 22:53:59,903][52658] DAMAGECOUNT value on done: 17193.0 [2024-08-05 22:53:59,908][52658] Sum rewards: 16.896, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.506', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON3': '0.900', 'ARMOR': '0.951', 'weapon2': '1.298', 'HITCOUNT': '1.330', 'weapon3': '1.926', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '15.000'} [2024-08-05 22:54:00,460][52650] Updated weights for policy 0, policy_version 10971 (0.0021) [2024-08-05 22:54:00,952][52803] DAMAGECOUNT value on done: 14005.0 [2024-08-05 22:54:00,954][52803] Sum rewards: 18.468, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.755', 'AMMO2': '0.002', 'weapon4': '0.010', 'AMMO4': '0.010', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'ARMOR': '0.441', 'WEAPON3': '0.600', 'HITCOUNT': '1.250', 'weapon3': '1.564', 'weapon2': '1.696', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:01,078][52794] DAMAGECOUNT value on done: 19442.0 [2024-08-05 22:54:01,079][52794] Sum rewards: 9.846, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.920', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.036', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'ARMOR': '0.488', 'WEAPON3': '0.550', 'HITCOUNT': '0.950', 'weapon3': '1.142', 'weapon2': '1.346', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '8.000'} [2024-08-05 22:54:01,146][52671] DAMAGECOUNT value on done: 18199.0 [2024-08-05 22:54:01,146][52671] Sum rewards: 16.242, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.932', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.120', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'weapon4': '0.358', 'ARMOR': '0.420', 'WEAPON3': '0.800', 'weapon2': '1.026', 'HITCOUNT': '1.260', 'weapon3': '1.592', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:01,253][52664] DAMAGECOUNT value on done: 16349.0 [2024-08-05 22:54:01,253][52664] Sum rewards: 5.900, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.770', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.129', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '0.940', 'ARMOR': '1.443', 'weapon2': '1.632', 'weapon3': '1.656', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '6.000'} [2024-08-05 22:54:01,272][52659] DAMAGECOUNT value on done: 17745.0 [2024-08-05 22:54:01,275][52659] Sum rewards: 14.029, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.912', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.074', 'AMMO3': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.174', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'ARMOR': '0.864', 'HITCOUNT': '0.900', 'weapon2': '1.118', 'weapon3': '1.458', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:01,802][52811] DAMAGECOUNT value on done: 15801.0 [2024-08-05 22:54:01,803][52811] Sum rewards: 15.284, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.140', 'AMMO4': '-0.105', 'AMMO2': '-0.021', 'AMMO3': '0.070', 'ARMOR': '0.446', 'WEAPON3': '0.600', 'HITCOUNT': '1.250', 'weapon3': '1.434', 'weapon2': '1.558', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:01,865][52649] DAMAGECOUNT value on done: 14454.0 [2024-08-05 22:54:01,865][52649] Sum rewards: 11.613, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.252', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO3': '0.055', 'AMMO4': '0.082', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.454', 'weapon4': '0.482', 'HITCOUNT': '0.870', 'weapon3': '1.086', 'weapon2': '1.170', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:01,895][52795] DAMAGECOUNT value on done: 16555.0 [2024-08-05 22:54:01,896][52795] Sum rewards: 15.861, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.951', 'AMMO2': '0.024', 'AMMO3': '0.082', 'weapon4': '0.088', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.944', 'HITCOUNT': '0.990', 'weapon2': '1.580', 'weapon3': '1.924', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 89907200. Throughput: 0: 4199.1. Samples: 22475910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:54:02,794][52567] Avg episode reward: [(0, '13.330')] [2024-08-05 22:54:03,213][52662] DAMAGECOUNT value on done: 17687.0 [2024-08-05 22:54:03,215][52662] Sum rewards: 17.729, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.001', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.089', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.338', 'WEAPON3': '0.650', 'ARMOR': '0.994', 'HITCOUNT': '1.150', 'weapon3': '1.522', 'weapon2': '1.670', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:03,288][52658] DAMAGECOUNT value on done: 16262.0 [2024-08-05 22:54:03,288][52658] Sum rewards: 14.370, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.374', 'ARMOR': '0.459', 'WEAPON3': '0.650', 'HITCOUNT': '1.260', 'weapon2': '1.324', 'weapon3': '1.782', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:03,805][52794] DAMAGECOUNT value on done: 19928.0 [2024-08-05 22:54:03,805][52794] Sum rewards: 4.830, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.135', 'WEAPON4': '0.300', 'ARMOR': '0.483', 'weapon4': '0.736', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.006', 'weapon3': '1.978', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '4.000'} [2024-08-05 22:54:04,272][52803] DAMAGECOUNT value on done: 13813.0 [2024-08-05 22:54:04,276][52803] Sum rewards: 5.895, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.455', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.015', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.122', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.300', 'ARMOR': '0.456', 'HITCOUNT': '0.720', 'WEAPON3': '0.800', 'weapon2': '1.066', 'weapon3': '1.608', 'DAMAGECOUNT': '2.355', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:04,393][52671] DAMAGECOUNT value on done: 14407.0 [2024-08-05 22:54:04,396][52671] Sum rewards: 13.292, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.080', 'ARMOR': '0.088', 'WEAPON4': '0.250', 'weapon4': '0.486', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.068', 'weapon3': '1.740', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:04,565][52649] DAMAGECOUNT value on done: 16934.0 [2024-08-05 22:54:04,567][52649] Sum rewards: 20.298, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.446', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.312', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'weapon2': '0.964', 'HITCOUNT': '1.160', 'weapon3': '1.702', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '16.000'} [2024-08-05 22:54:04,660][52659] DAMAGECOUNT value on done: 15749.0 [2024-08-05 22:54:04,660][52659] Sum rewards: 11.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.842', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.288', 'WEAPON3': '0.500', 'ARMOR': '0.812', 'HITCOUNT': '0.890', 'weapon3': '1.418', 'weapon2': '1.720', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:05,161][52795] DAMAGECOUNT value on done: 15114.0 [2024-08-05 22:54:05,164][52795] Sum rewards: 17.185, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.476', 'WEAPON3': '0.550', 'weapon2': '0.722', 'ARMOR': '0.996', 'HITCOUNT': '1.150', 'weapon3': '1.518', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:05,233][52811] DAMAGECOUNT value on done: 13823.0 [2024-08-05 22:54:05,233][52811] Sum rewards: 11.064, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.135', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.150', 'WEAPON3': '0.900', 'HITCOUNT': '1.020', 'weapon2': '1.204', 'weapon3': '2.022', 'DAMAGECOUNT': '3.474', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:05,544][52662] DAMAGECOUNT value on done: 19149.0 [2024-08-05 22:54:05,544][52662] Sum rewards: 17.223, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.460', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.101', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'HITCOUNT': '1.360', 'weapon2': '1.374', 'weapon3': '1.600', 'DAMAGECOUNT': '4.722', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:05,710][52650] Updated weights for policy 0, policy_version 10981 (0.0062) [2024-08-05 22:54:06,262][52658] DAMAGECOUNT value on done: 15011.0 [2024-08-05 22:54:06,267][52658] Sum rewards: 11.081, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.607', 'AMMO5': '0.013', 'AMMO2': '0.020', 'ARMOR': '0.036', 'weapon5': '0.036', 'AMMO3': '0.082', 'AMMO4': '0.100', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.556', 'HITCOUNT': '0.850', 'weapon3': '1.298', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:06,334][52794] DAMAGECOUNT value on done: 17838.0 [2024-08-05 22:54:06,334][52794] Sum rewards: 23.083, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.158', 'weapon4': '0.020', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.151', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.430', 'weapon2': '1.642', 'weapon3': '1.698', 'DAMAGECOUNT': '5.052', 'FRAGCOUNT': '19.000'} [2024-08-05 22:54:07,128][52671] DAMAGECOUNT value on done: 14614.0 [2024-08-05 22:54:07,130][52671] Sum rewards: 11.594, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.452', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon4': '0.010', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'ARMOR': '0.933', 'weapon2': '1.394', 'weapon3': '1.546', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:07,233][52659] DAMAGECOUNT value on done: 15351.0 [2024-08-05 22:54:07,233][52659] Sum rewards: 15.206, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.137', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.102', 'WEAPON4': '0.300', 'weapon4': '0.324', 'ARMOR': '0.554', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon2': '0.912', 'weapon3': '1.914', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:07,551][52803] DAMAGECOUNT value on done: 14536.0 [2024-08-05 22:54:07,552][52803] Sum rewards: 12.882, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.330', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'weapon4': '0.504', 'WEAPON3': '0.900', 'weapon2': '1.268', 'HITCOUNT': '1.320', 'weapon3': '1.770', 'DAMAGECOUNT': '4.851', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:07,728][52649] DAMAGECOUNT value on done: 14459.0 [2024-08-05 22:54:07,728][52649] Sum rewards: 9.720, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.444', 'WEAPON3': '0.650', 'HITCOUNT': '0.820', 'weapon2': '1.304', 'ARMOR': '1.362', 'weapon3': '1.454', 'DAMAGECOUNT': '2.631', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:07,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 89989120. Throughput: 0: 4198.4. Samples: 22501140. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 22:54:07,795][52567] Avg episode reward: [(0, '13.399')] [2024-08-05 22:54:08,048][52662] DAMAGECOUNT value on done: 20998.0 [2024-08-05 22:54:08,048][52662] Sum rewards: 22.713, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.255', 'AMMO4': '-0.105', 'AMMO2': '-0.021', 'AMMO3': '0.084', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon2': '1.612', 'weapon3': '1.640', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '19.000'} [2024-08-05 22:54:08,561][52795] DAMAGECOUNT value on done: 14402.0 [2024-08-05 22:54:08,563][52795] Sum rewards: 12.871, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.520', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.104', 'weapon4': '0.294', 'WEAPON4': '0.300', 'ARMOR': '0.491', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon3': '1.358', 'weapon2': '1.380', 'DAMAGECOUNT': '3.048', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:08,681][52794] DAMAGECOUNT value on done: 19899.0 [2024-08-05 22:54:08,682][52794] Sum rewards: 9.462, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO3': '0.064', 'weapon4': '0.084', 'AMMO4': '0.096', 'HEALTH': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'ARMOR': '0.444', 'HITCOUNT': '0.600', 'weapon3': '1.172', 'weapon2': '1.186', 'DAMAGECOUNT': '2.538', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:08,725][52811] DAMAGECOUNT value on done: 14506.0 [2024-08-05 22:54:08,725][52811] Sum rewards: 8.716, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.131', 'WEAPON4': '0.300', 'ARMOR': '0.506', 'weapon4': '0.624', 'WEAPON3': '0.800', 'HITCOUNT': '1.040', 'weapon2': '1.288', 'weapon3': '1.552', 'DAMAGECOUNT': '3.243', 'FRAGCOUNT': '8.000'} [2024-08-05 22:54:08,944][52658] DAMAGECOUNT value on done: 17077.0 [2024-08-05 22:54:08,944][52658] Sum rewards: 13.521, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.138', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.552', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '1.226', 'weapon3': '1.674', 'DAMAGECOUNT': '2.688', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:10,134][52671] DAMAGECOUNT value on done: 16684.0 [2024-08-05 22:54:10,138][52671] Sum rewards: 19.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'ARMOR': '0.495', 'WEAPON3': '0.950', 'HITCOUNT': '1.310', 'weapon2': '1.436', 'weapon3': '2.118', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '18.000'} [2024-08-05 22:54:10,292][52659] DAMAGECOUNT value on done: 15151.0 [2024-08-05 22:54:10,294][52659] Sum rewards: 11.458, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.306', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON3': '0.600', 'ARMOR': '0.848', 'HITCOUNT': '0.930', 'weapon3': '1.166', 'weapon2': '1.252', 'DAMAGECOUNT': '3.096', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:10,395][52662] DAMAGECOUNT value on done: 18462.0 [2024-08-05 22:54:10,398][52662] Sum rewards: 11.083, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.904', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.096', 'ARMOR': '0.486', 'WEAPON3': '0.700', 'HITCOUNT': '1.030', 'weapon2': '1.106', 'weapon3': '1.864', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:10,462][52650] Updated weights for policy 0, policy_version 10991 (0.0013) [2024-08-05 22:54:10,789][52803] DAMAGECOUNT value on done: 15149.0 [2024-08-05 22:54:10,790][52803] Sum rewards: 8.171, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.746', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.059', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon2': '1.306', 'weapon3': '1.706', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:11,107][52649] DAMAGECOUNT value on done: 17289.0 [2024-08-05 22:54:11,108][52649] Sum rewards: 9.710, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.134', 'weapon4': '0.194', 'WEAPON4': '0.250', 'ARMOR': '0.944', 'WEAPON3': '0.950', 'HITCOUNT': '1.080', 'weapon2': '1.146', 'weapon3': '1.790', 'DAMAGECOUNT': '3.831', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:11,224][52794] DAMAGECOUNT value on done: 17983.0 [2024-08-05 22:54:11,228][52794] Sum rewards: 13.851, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.186', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.004', 'AMMO4': '0.017', 'ARMOR': '0.059', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon3': '1.170', 'weapon2': '1.244', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:11,910][52795] DAMAGECOUNT value on done: 16820.0 [2024-08-05 22:54:11,910][52795] Sum rewards: 23.485, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.060', 'HEALTH': '0.095', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.244', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'weapon2': '1.206', 'HITCOUNT': '1.310', 'weapon3': '1.478', 'DAMAGECOUNT': '5.169', 'FRAGCOUNT': '16.000'} [2024-08-05 22:54:11,954][52811] DAMAGECOUNT value on done: 15144.0 [2024-08-05 22:54:11,955][52811] Sum rewards: 17.200, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.074', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'ARMOR': '0.463', 'weapon4': '0.584', 'WEAPON3': '0.750', 'weapon2': '0.970', 'HITCOUNT': '1.560', 'weapon3': '1.614', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 90071040. Throughput: 0: 4197.6. Samples: 22526110. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 22:54:12,794][52567] Avg episode reward: [(0, '13.417')] [2024-08-05 22:54:13,119][52671] DAMAGECOUNT value on done: 15859.0 [2024-08-05 22:54:13,119][52671] Sum rewards: 15.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.010', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'weapon5': '0.090', 'WEAPON3': '0.500', 'HITCOUNT': '1.170', 'weapon3': '1.278', 'ARMOR': '1.287', 'weapon2': '1.804', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:13,217][52659] DAMAGECOUNT value on done: 16401.0 [2024-08-05 22:54:13,217][52659] Sum rewards: 11.629, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.520', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.047', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.370', 'WEAPON3': '0.500', 'HITCOUNT': '0.840', 'weapon2': '1.114', 'weapon3': '1.352', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '8.000'} [2024-08-05 22:54:13,523][52662] DAMAGECOUNT value on done: 18537.0 [2024-08-05 22:54:13,526][52662] Sum rewards: 5.925, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon5': '0.038', 'weapon4': '0.050', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'HITCOUNT': '0.920', 'WEAPON3': '1.000', 'weapon2': '1.304', 'weapon3': '2.038', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '8.000'} [2024-08-05 22:54:13,900][52803] DAMAGECOUNT value on done: 16206.0 [2024-08-05 22:54:13,900][52803] Sum rewards: 8.819, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.229', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.070', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.850', 'ARMOR': '0.926', 'weapon2': '1.536', 'weapon3': '1.586', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '5.000'} [2024-08-05 22:54:14,099][52649] DAMAGECOUNT value on done: 15966.0 [2024-08-05 22:54:14,099][52649] Sum rewards: 11.843, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.248', 'ARMOR': '0.420', 'WEAPON3': '0.700', 'HITCOUNT': '1.140', 'weapon2': '1.400', 'weapon3': '1.484', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:14,460][52794] DAMAGECOUNT value on done: 19639.0 [2024-08-05 22:54:14,461][52794] Sum rewards: 23.975, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.306', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.119', 'WEAPON3': '0.800', 'ARMOR': '1.279', 'HITCOUNT': '1.430', 'weapon2': '1.736', 'weapon3': '1.914', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '20.000'} [2024-08-05 22:54:15,188][52795] DAMAGECOUNT value on done: 14300.0 [2024-08-05 22:54:15,189][52795] Sum rewards: 15.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-3.072', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.300', 'weapon4': '0.408', 'ARMOR': '0.484', 'weapon2': '0.804', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '2.034', 'DAMAGECOUNT': '4.944', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:15,433][52811] DAMAGECOUNT value on done: 14055.0 [2024-08-05 22:54:15,433][52811] Sum rewards: 5.609, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.456', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.020', 'WEAPON3': '0.150', 'HITCOUNT': '0.430', 'weapon3': '0.492', 'ARMOR': '0.853', 'weapon2': '1.036', 'DAMAGECOUNT': '1.359', 'FRAGCOUNT': '4.000'} [2024-08-05 22:54:15,588][52650] Updated weights for policy 0, policy_version 11001 (0.0024) [2024-08-05 22:54:15,628][52671] DAMAGECOUNT value on done: 17714.0 [2024-08-05 22:54:15,628][52671] Sum rewards: 19.148, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.020', 'AMMO3': '0.060', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'HEALTH': '0.256', 'WEAPON3': '0.400', 'weapon4': '0.758', 'weapon2': '0.974', 'HITCOUNT': '1.210', 'ARMOR': '1.246', 'weapon3': '1.432', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:15,934][52659] DAMAGECOUNT value on done: 17318.0 [2024-08-05 22:54:15,935][52659] Sum rewards: 15.749, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.740', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.130', 'weapon4': '0.248', 'WEAPON3': '0.750', 'weapon2': '1.050', 'HITCOUNT': '1.330', 'weapon3': '1.630', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:16,393][52649] DAMAGECOUNT value on done: 17471.0 [2024-08-05 22:54:16,395][52649] Sum rewards: 11.278, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.060', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'weapon4': '0.394', 'ARMOR': '0.465', 'WEAPON3': '0.500', 'HITCOUNT': '0.600', 'weapon3': '1.274', 'weapon2': '1.436', 'DAMAGECOUNT': '2.499', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:16,447][52662] DAMAGECOUNT value on done: 19966.0 [2024-08-05 22:54:16,448][52662] Sum rewards: 9.266, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.458', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon4': '0.126', 'ARMOR': '0.430', 'WEAPON3': '0.550', 'HITCOUNT': '0.910', 'weapon3': '1.126', 'weapon2': '1.570', 'DAMAGECOUNT': '3.093', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:17,224][52794] DAMAGECOUNT value on done: 15505.0 [2024-08-05 22:54:17,226][52794] Sum rewards: 10.525, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.365', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.061', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.788', 'ARMOR': '0.894', 'weapon2': '0.938', 'HITCOUNT': '0.940', 'weapon3': '1.378', 'DAMAGECOUNT': '2.991', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 90161152. Throughput: 0: 4198.0. Samples: 22538750. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:54:17,794][52567] Avg episode reward: [(0, '13.285')] [2024-08-05 22:54:18,545][52795] DAMAGECOUNT value on done: 14431.0 [2024-08-05 22:54:18,545][52795] Sum rewards: 14.537, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'HEALTH': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON3': '0.450', 'HITCOUNT': '1.210', 'ARMOR': '1.255', 'weapon3': '1.430', 'weapon2': '1.826', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:18,556][52811] DAMAGECOUNT value on done: 14560.0 [2024-08-05 22:54:18,558][52811] Sum rewards: 2.444, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.564', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.068', 'AMMO3': '0.106', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.474', 'HITCOUNT': '0.610', 'WEAPON3': '0.650', 'ARMOR': '0.896', 'weapon2': '1.036', 'weapon3': '1.648', 'DAMAGECOUNT': '1.752', 'FRAGCOUNT': '2.000'} [2024-08-05 22:54:18,943][52671] DAMAGECOUNT value on done: 13823.0 [2024-08-05 22:54:18,944][52671] Sum rewards: 5.561, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.114', 'AMMO4': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.726', 'WEAPON3': '0.750', 'HITCOUNT': '0.860', 'weapon2': '0.960', 'ARMOR': '0.991', 'weapon3': '1.942', 'DAMAGECOUNT': '2.835', 'FRAGCOUNT': '6.000'} [2024-08-05 22:54:18,985][52662] DAMAGECOUNT value on done: 20580.0 [2024-08-05 22:54:18,986][52662] Sum rewards: 24.594, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.116', 'WEAPON3': '0.800', 'weapon2': '1.626', 'HITCOUNT': '1.710', 'weapon3': '1.902', 'DAMAGECOUNT': '6.675', 'FRAGCOUNT': '20.000'} [2024-08-05 22:54:19,162][52659] DAMAGECOUNT value on done: 18451.0 [2024-08-05 22:54:19,164][52659] Sum rewards: 17.082, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.404', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.270', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'ARMOR': '1.270', 'weapon2': '1.422', 'weapon3': '1.712', 'DAMAGECOUNT': '4.347', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:19,734][52794] DAMAGECOUNT value on done: 19961.0 [2024-08-05 22:54:19,735][52794] Sum rewards: 9.749, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.705', 'AMMO2': '0.026', 'weapon7': '0.050', 'ARMOR': '0.096', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '1.054', 'weapon3': '1.556', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:20,164][52650] Updated weights for policy 0, policy_version 11011 (0.0012) [2024-08-05 22:54:21,600][52662] DAMAGECOUNT value on done: 21057.0 [2024-08-05 22:54:21,601][52662] Sum rewards: 8.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.328', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.072', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'ARMOR': '0.448', 'weapon2': '1.312', 'WEAPON3': '1.350', 'HITCOUNT': '1.390', 'weapon3': '2.206', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:21,798][52795] DAMAGECOUNT value on done: 17449.0 [2024-08-05 22:54:21,803][52795] Sum rewards: 6.759, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.293', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'weapon5': '0.194', 'WEAPON4': '0.250', 'ARMOR': '0.494', 'weapon4': '0.526', 'weapon2': '0.686', 'HITCOUNT': '0.870', 'WEAPON3': '1.000', 'weapon3': '1.878', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:21,894][52671] DAMAGECOUNT value on done: 17444.0 [2024-08-05 22:54:21,894][52671] Sum rewards: 11.955, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.475', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'WEAPON4': '0.050', 'weapon4': '0.106', 'AMMO3': '0.134', 'ARMOR': '0.845', 'WEAPON3': '0.900', 'HITCOUNT': '1.090', 'weapon2': '1.144', 'weapon3': '1.664', 'DAMAGECOUNT': '4.038', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:22,148][52659] DAMAGECOUNT value on done: 14695.0 [2024-08-05 22:54:22,150][52659] Sum rewards: 12.952, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.113', 'WEAPON4': '0.350', 'ARMOR': '0.549', 'weapon2': '0.660', 'WEAPON3': '0.800', 'weapon4': '0.838', 'HITCOUNT': '1.140', 'weapon3': '1.754', 'DAMAGECOUNT': '3.606', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:22,182][52794] DAMAGECOUNT value on done: 18960.0 [2024-08-05 22:54:22,182][52794] Sum rewards: 18.213, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.780', 'AMMO2': '0.014', 'AMMO4': '0.071', 'ARMOR': '0.072', 'AMMO3': '0.171', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.712', 'WEAPON3': '1.250', 'HITCOUNT': '1.420', 'weapon3': '2.516', 'DAMAGECOUNT': '5.793', 'FRAGCOUNT': '18.000'} [2024-08-05 22:54:22,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 90234880. Throughput: 0: 4208.4. Samples: 22564230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:54:22,802][52567] Avg episode reward: [(0, '13.156')] [2024-08-05 22:54:24,216][52662] DAMAGECOUNT value on done: 18421.0 [2024-08-05 22:54:24,217][52662] Sum rewards: 14.673, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.650', 'ARMOR': '0.951', 'HITCOUNT': '1.010', 'weapon2': '1.444', 'weapon3': '1.760', 'DAMAGECOUNT': '3.651', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:24,913][52794] DAMAGECOUNT value on done: 19003.0 [2024-08-05 22:54:24,914][52794] Sum rewards: 11.694, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.298', 'AMMO2': '0.003', 'ARMOR': '0.016', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.344', 'WEAPON3': '0.850', 'weapon2': '1.182', 'HITCOUNT': '1.250', 'weapon3': '2.080', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:24,955][52659] DAMAGECOUNT value on done: 16121.0 [2024-08-05 22:54:24,955][52659] Sum rewards: 14.968, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'HITCOUNT': '0.970', 'weapon2': '1.400', 'weapon3': '1.528', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:25,129][52795] DAMAGECOUNT value on done: 15682.0 [2024-08-05 22:54:25,129][52795] Sum rewards: 15.908, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.444', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.089', 'weapon4': '0.204', 'ARMOR': '0.480', 'WEAPON3': '0.550', 'weapon2': '1.124', 'HITCOUNT': '1.230', 'weapon3': '1.542', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:25,360][52650] Updated weights for policy 0, policy_version 11021 (0.0013) [2024-08-05 22:54:26,713][52662] DAMAGECOUNT value on done: 19285.0 [2024-08-05 22:54:26,714][52662] Sum rewards: 14.006, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.008', 'weapon4': '0.012', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.073', 'WEAPON3': '0.550', 'HITCOUNT': '1.280', 'ARMOR': '1.326', 'weapon3': '1.522', 'weapon2': '1.534', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:27,336][52794] DAMAGECOUNT value on done: 19658.0 [2024-08-05 22:54:27,338][52794] Sum rewards: 15.734, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.790', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO3': '0.073', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.230', 'weapon3': '1.286', 'weapon2': '1.726', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:27,348][52659] DAMAGECOUNT value on done: 14276.0 [2024-08-05 22:54:27,350][52659] Sum rewards: 14.772, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.668', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.700', 'HITCOUNT': '1.100', 'weapon2': '1.328', 'ARMOR': '1.337', 'weapon3': '1.800', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.7, 300 sec: 16800.5). Total num frames: 90324992. Throughput: 0: 4194.7. Samples: 22589070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 22:54:27,802][52567] Avg episode reward: [(0, '13.146')] [2024-08-05 22:54:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011026_90324992.pth... [2024-08-05 22:54:27,958][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010534_86294528.pth [2024-08-05 22:54:28,757][52795] DAMAGECOUNT value on done: 14394.0 [2024-08-05 22:54:28,757][52795] Sum rewards: 8.078, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.072', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon4': '0.232', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'HITCOUNT': '0.760', 'weapon3': '1.302', 'weapon2': '1.490', 'DAMAGECOUNT': '3.033', 'FRAGCOUNT': '6.000'} [2024-08-05 22:54:29,678][52662] DAMAGECOUNT value on done: 19109.0 [2024-08-05 22:54:29,678][52662] Sum rewards: 10.670, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.800', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.081', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'weapon2': '0.536', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon4': '0.806', 'weapon3': '1.520', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:29,857][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 22:54:29,951][52668] DAMAGECOUNT value on done: 15337.0 [2024-08-05 22:54:29,953][52668] Sum rewards: 13.180, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.186', 'ARMOR': '0.032', 'AMMO2': '0.032', 'AMMO3': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'WEAPON3': '0.350', 'HITCOUNT': '0.660', 'weapon2': '0.666', 'weapon4': '0.962', 'weapon3': '1.196', 'DAMAGECOUNT': '2.154', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:30,055][52659] DAMAGECOUNT value on done: 17310.0 [2024-08-05 22:54:30,055][52659] Sum rewards: 19.087, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.116', 'WEAPON3': '0.750', 'ARMOR': '0.899', 'HITCOUNT': '1.330', 'weapon2': '1.440', 'weapon3': '1.940', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '16.000'} [2024-08-05 22:54:30,227][52794] DAMAGECOUNT value on done: 19331.0 [2024-08-05 22:54:30,228][52794] Sum rewards: 9.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.286', 'weapon4': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.032', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'WEAPON3': '1.050', 'HITCOUNT': '1.260', 'weapon2': '1.286', 'weapon3': '2.086', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:30,346][52650] Updated weights for policy 0, policy_version 11031 (0.0011) [2024-08-05 22:54:32,053][52662] DAMAGECOUNT value on done: 17620.0 [2024-08-05 22:54:32,054][52662] Sum rewards: 21.308, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.984', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.324', 'WEAPON3': '0.750', 'ARMOR': '0.876', 'weapon2': '1.144', 'HITCOUNT': '1.350', 'weapon3': '1.984', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '18.000'} [2024-08-05 22:54:32,152][52795] DAMAGECOUNT value on done: 16397.0 [2024-08-05 22:54:32,152][52795] Sum rewards: 10.281, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.812', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.926', 'WEAPON3': '0.950', 'HITCOUNT': '1.130', 'weapon2': '1.194', 'weapon3': '1.748', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:32,643][52794] DAMAGECOUNT value on done: 20032.0 [2024-08-05 22:54:32,643][52794] Sum rewards: 17.529, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.030', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.157', 'ARMOR': '0.455', 'WEAPON3': '0.900', 'HITCOUNT': '1.230', 'weapon2': '1.362', 'weapon3': '1.648', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '15.000'} [2024-08-05 22:54:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.5, 300 sec: 16772.8). Total num frames: 90398720. Throughput: 0: 4190.9. Samples: 22601370. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 22:54:32,795][52567] Avg episode reward: [(0, '13.448')] [2024-08-05 22:54:32,856][52668] DAMAGECOUNT value on done: 17060.0 [2024-08-05 22:54:32,857][52668] Sum rewards: 9.668, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.496', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.101', 'WEAPON3': '0.750', 'HITCOUNT': '1.090', 'weapon2': '1.176', 'ARMOR': '1.366', 'weapon3': '1.778', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:34,717][52650] Updated weights for policy 0, policy_version 11041 (0.0031) [2024-08-05 22:54:34,994][52662] DAMAGECOUNT value on done: 20052.0 [2024-08-05 22:54:34,995][52662] Sum rewards: 22.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.864', 'AMMO2': '0.003', 'ARMOR': '0.012', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.166', 'AMMO3': '0.191', 'weapon2': '0.938', 'WEAPON3': '1.200', 'HITCOUNT': '1.630', 'weapon3': '2.566', 'DAMAGECOUNT': '6.564', 'FRAGCOUNT': '22.000'} [2024-08-05 22:54:35,537][52794] DAMAGECOUNT value on done: 17729.0 [2024-08-05 22:54:35,539][52794] Sum rewards: 11.454, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.021', 'ARMOR': '0.028', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.105', 'WEAPON3': '0.250', 'weapon4': '0.272', 'HEALTH': '0.646', 'HITCOUNT': '0.900', 'weapon3': '0.952', 'weapon2': '1.012', 'DAMAGECOUNT': '3.177', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:35,544][52795] DAMAGECOUNT value on done: 16364.0 [2024-08-05 22:54:35,545][52795] Sum rewards: 18.785, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.686', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon7': '0.052', 'AMMO3': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.230', 'ARMOR': '0.497', 'WEAPON3': '0.600', 'weapon2': '0.944', 'HITCOUNT': '1.190', 'weapon3': '1.688', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:35,835][52668] DAMAGECOUNT value on done: 14851.0 [2024-08-05 22:54:35,836][52668] Sum rewards: 4.895, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.240', 'AMMO2': '0.014', 'AMMO3': '0.065', 'AMMO4': '0.069', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon4': '0.526', 'HITCOUNT': '0.530', 'weapon2': '0.920', 'weapon3': '1.184', 'DAMAGECOUNT': '1.467', 'FRAGCOUNT': '3.000'} [2024-08-05 22:54:37,161][52660] DAMAGECOUNT value on done: 17336.0 [2024-08-05 22:54:37,171][52660] Sum rewards: 16.618, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.437', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'weapon4': '0.058', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'weapon2': '1.204', 'HITCOUNT': '1.210', 'weapon3': '1.956', 'DAMAGECOUNT': '4.023', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 90488832. Throughput: 0: 4184.0. Samples: 22626440. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 22:54:37,794][52567] Avg episode reward: [(0, '13.448')] [2024-08-05 22:54:37,932][52662] DAMAGECOUNT value on done: 19062.0 [2024-08-05 22:54:37,932][52662] Sum rewards: 14.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.016', 'weapon4': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'ARMOR': '0.962', 'HITCOUNT': '1.240', 'weapon2': '1.570', 'weapon3': '1.648', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:38,410][52794] DAMAGECOUNT value on done: 19537.0 [2024-08-05 22:54:38,410][52794] Sum rewards: 18.687, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.840', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.076', 'WEAPON3': '0.600', 'ARMOR': '0.949', 'HITCOUNT': '1.440', 'weapon2': '1.446', 'weapon3': '1.490', 'DAMAGECOUNT': '5.070', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:38,657][52668] DAMAGECOUNT value on done: 16802.0 [2024-08-05 22:54:38,657][52668] Sum rewards: 29.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.393', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO3': '0.092', 'ARMOR': '0.514', 'WEAPON3': '0.750', 'weapon2': '1.364', 'HITCOUNT': '1.710', 'weapon3': '1.986', 'DAMAGECOUNT': '6.249', 'FRAGCOUNT': '25.000'} [2024-08-05 22:54:38,959][52795] DAMAGECOUNT value on done: 16295.0 [2024-08-05 22:54:38,959][52795] Sum rewards: 6.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.824', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.081', 'WEAPON4': '0.250', 'weapon4': '0.402', 'HITCOUNT': '0.590', 'WEAPON3': '0.600', 'ARMOR': '0.867', 'weapon2': '1.216', 'weapon3': '1.424', 'DAMAGECOUNT': '2.172', 'FRAGCOUNT': '6.000'} [2024-08-05 22:54:39,548][52660] DAMAGECOUNT value on done: 16881.0 [2024-08-05 22:54:39,550][52660] Sum rewards: 14.352, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.002', 'AMMO4': '0.010', 'HEALTH': '0.025', 'AMMO3': '0.040', 'WEAPON3': '0.300', 'weapon3': '0.948', 'HITCOUNT': '0.970', 'ARMOR': '1.249', 'weapon2': '1.628', 'DAMAGECOUNT': '3.180', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:40,202][52650] Updated weights for policy 0, policy_version 11051 (0.0026) [2024-08-05 22:54:40,445][52662] DAMAGECOUNT value on done: 19459.0 [2024-08-05 22:54:40,446][52662] Sum rewards: 23.584, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.137', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.002', 'ARMOR': '1.376', 'HITCOUNT': '1.680', 'weapon3': '2.478', 'DAMAGECOUNT': '6.183', 'FRAGCOUNT': '21.000'} [2024-08-05 22:54:40,951][52794] DAMAGECOUNT value on done: 20815.0 [2024-08-05 22:54:40,953][52794] Sum rewards: 16.682, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.183', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.086', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.320', 'weapon3': '1.694', 'weapon2': '1.734', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:41,270][52668] DAMAGECOUNT value on done: 16312.0 [2024-08-05 22:54:41,270][52668] Sum rewards: 15.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.569', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.574', 'WEAPON3': '0.850', 'ARMOR': '0.905', 'weapon2': '1.016', 'HITCOUNT': '1.050', 'weapon3': '1.648', 'DAMAGECOUNT': '3.693', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:42,194][52660] DAMAGECOUNT value on done: 14997.0 [2024-08-05 22:54:42,202][52660] Sum rewards: 8.576, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.573', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.060', 'WEAPON4': '0.200', 'ARMOR': '0.471', 'WEAPON3': '0.500', 'HITCOUNT': '0.610', 'weapon4': '0.634', 'weapon2': '1.038', 'weapon3': '1.408', 'DAMAGECOUNT': '1.965', 'FRAGCOUNT': '6.000'} [2024-08-05 22:54:42,332][52795] DAMAGECOUNT value on done: 14881.0 [2024-08-05 22:54:42,335][52795] Sum rewards: 12.760, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.347', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon7': '0.008', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.128', 'weapon4': '0.216', 'WEAPON3': '0.450', 'ARMOR': '0.873', 'HITCOUNT': '0.880', 'weapon2': '1.210', 'weapon3': '1.346', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '8.000'} [2024-08-05 22:54:42,788][52662] DAMAGECOUNT value on done: 21229.0 [2024-08-05 22:54:42,788][52662] Sum rewards: 20.600, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.450', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon4': '0.010', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON3': '1.050', 'weapon2': '1.502', 'HITCOUNT': '1.640', 'weapon3': '2.274', 'DAMAGECOUNT': '6.486', 'FRAGCOUNT': '18.000'} [2024-08-05 22:54:42,794][52567] Fps is (10 sec: 17203.7, 60 sec: 16793.7, 300 sec: 16772.8). Total num frames: 90570752. Throughput: 0: 4187.6. Samples: 22651800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:54:42,794][52567] Avg episode reward: [(0, '13.622')] [2024-08-05 22:54:43,561][52794] DAMAGECOUNT value on done: 18438.0 [2024-08-05 22:54:43,562][52794] Sum rewards: 14.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.132', 'WEAPON3': '0.700', 'ARMOR': '0.873', 'HITCOUNT': '1.140', 'weapon3': '1.252', 'weapon2': '1.344', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:43,973][52668] DAMAGECOUNT value on done: 16963.0 [2024-08-05 22:54:43,973][52668] Sum rewards: 19.231, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.430', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO3': '0.099', 'WEAPON3': '0.800', 'ARMOR': '0.852', 'HITCOUNT': '1.330', 'weapon2': '1.810', 'weapon3': '1.840', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '15.000'} [2024-08-05 22:54:45,122][52650] Updated weights for policy 0, policy_version 11061 (0.0012) [2024-08-05 22:54:45,287][52660] DAMAGECOUNT value on done: 16346.0 [2024-08-05 22:54:45,289][52660] Sum rewards: 14.978, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.074', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon4': '0.002', 'WEAPON4': '0.050', 'AMMO3': '0.095', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'weapon2': '1.740', 'weapon3': '1.824', 'ARMOR': '1.859', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:45,576][52795] DAMAGECOUNT value on done: 15573.0 [2024-08-05 22:54:45,580][52795] Sum rewards: 13.360, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.962', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.091', 'weapon5': '0.106', 'weapon4': '0.244', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'weapon2': '1.102', 'ARMOR': '1.285', 'weapon3': '1.696', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '9.000'} [2024-08-05 22:54:45,879][52662] DAMAGECOUNT value on done: 18639.0 [2024-08-05 22:54:45,879][52662] Sum rewards: 13.928, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.092', 'AMMO3': '0.094', 'HEALTH': '0.116', 'WEAPON3': '0.600', 'ARMOR': '0.840', 'HITCOUNT': '1.040', 'weapon2': '1.592', 'weapon3': '1.954', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:46,568][52794] DAMAGECOUNT value on done: 18322.0 [2024-08-05 22:54:46,569][52794] Sum rewards: 16.406, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.787', 'AMMO2': '0.023', 'AMMO3': '0.105', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.518', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'ARMOR': '1.200', 'weapon2': '1.304', 'weapon3': '1.784', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:47,274][52668] DAMAGECOUNT value on done: 18196.0 [2024-08-05 22:54:47,286][52668] Sum rewards: 21.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.536', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon4': '0.470', 'weapon2': '0.806', 'ARMOR': '0.828', 'WEAPON3': '1.100', 'HITCOUNT': '1.440', 'weapon3': '2.370', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '20.000'} [2024-08-05 22:54:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.6). Total num frames: 90660864. Throughput: 0: 4185.8. Samples: 22664270. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:54:47,794][52567] Avg episode reward: [(0, '13.946')] [2024-08-05 22:54:47,797][52614] Saving new best policy, reward=13.946! [2024-08-05 22:54:48,539][52660] DAMAGECOUNT value on done: 13147.0 [2024-08-05 22:54:48,541][52660] Sum rewards: 20.711, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.564', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.133', 'ARMOR': '0.416', 'WEAPON3': '0.800', 'HITCOUNT': '1.450', 'weapon2': '1.652', 'weapon3': '2.226', 'DAMAGECOUNT': '5.088', 'FRAGCOUNT': '17.000'} [2024-08-05 22:54:48,635][52662] DAMAGECOUNT value on done: 19871.0 [2024-08-05 22:54:48,635][52662] Sum rewards: 22.421, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'HEALTH': '0.080', 'weapon4': '0.248', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '1.250', 'weapon3': '1.330', 'weapon2': '1.592', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '17.000'} [2024-08-05 22:54:49,299][52794] DAMAGECOUNT value on done: 18314.0 [2024-08-05 22:54:49,299][52794] Sum rewards: 6.869, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.485', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO3': '0.040', 'weapon5': '0.044', 'weapon7': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.350', 'HITCOUNT': '0.470', 'weapon3': '0.872', 'weapon2': '0.884', 'DAMAGECOUNT': '2.055', 'FRAGCOUNT': '4.000'} [2024-08-05 22:54:49,667][52650] Updated weights for policy 0, policy_version 11071 (0.0019) [2024-08-05 22:54:50,411][52668] DAMAGECOUNT value on done: 17093.0 [2024-08-05 22:54:50,412][52668] Sum rewards: 18.388, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.068', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '1.310', 'ARMOR': '1.411', 'weapon2': '1.434', 'weapon3': '1.846', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '16.000'} [2024-08-05 22:54:51,104][52662] DAMAGECOUNT value on done: 18591.0 [2024-08-05 22:54:51,107][52662] Sum rewards: 18.939, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.518', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.104', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'HITCOUNT': '1.210', 'weapon2': '1.434', 'weapon3': '1.546', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '14.000'} [2024-08-05 22:54:51,843][52660] DAMAGECOUNT value on done: 16825.0 [2024-08-05 22:54:51,846][52660] Sum rewards: 9.429, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.054', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON3': '0.850', 'HITCOUNT': '1.070', 'ARMOR': '1.651', 'weapon2': '1.832', 'weapon3': '1.854', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16800.6). Total num frames: 90742784. Throughput: 0: 4183.8. Samples: 22689410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:54:52,794][52567] Avg episode reward: [(0, '14.115')] [2024-08-05 22:54:52,795][52614] Saving new best policy, reward=14.115! [2024-08-05 22:54:53,687][52662] DAMAGECOUNT value on done: 19633.0 [2024-08-05 22:54:53,688][52662] Sum rewards: 11.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.142', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon7': '0.048', 'weapon5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.134', 'AMMO4': '0.138', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.690', 'weapon2': '0.722', 'ARMOR': '0.844', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon3': '2.030', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:53,733][52668] DAMAGECOUNT value on done: 14845.0 [2024-08-05 22:54:53,734][52668] Sum rewards: 8.697, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.960', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.069', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '0.650', 'weapon2': '1.012', 'weapon3': '1.194', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '7.000'} [2024-08-05 22:54:54,712][52650] Updated weights for policy 0, policy_version 11081 (0.0020) [2024-08-05 22:54:55,141][52660] DAMAGECOUNT value on done: 15008.0 [2024-08-05 22:54:55,146][52660] Sum rewards: 16.976, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.048', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'AMMO3': '0.071', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.258', 'WEAPON3': '0.600', 'ARMOR': '0.920', 'HITCOUNT': '1.090', 'weapon2': '1.222', 'weapon3': '1.532', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '13.000'} [2024-08-05 22:54:56,461][52668] DAMAGECOUNT value on done: 18935.0 [2024-08-05 22:54:56,461][52668] Sum rewards: 13.253, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.116', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.306', 'WEAPON3': '0.650', 'ARMOR': '0.734', 'HITCOUNT': '1.120', 'weapon2': '1.582', 'weapon3': '1.642', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '10.000'} [2024-08-05 22:54:57,550][52660] DAMAGECOUNT value on done: 16842.0 [2024-08-05 22:54:57,551][52660] Sum rewards: 14.770, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.638', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.192', 'WEAPON3': '0.750', 'ARMOR': '0.913', 'HITCOUNT': '1.280', 'weapon2': '1.392', 'weapon3': '1.908', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:57,794][52567] Fps is (10 sec: 15564.4, 60 sec: 16520.5, 300 sec: 16745.0). Total num frames: 90816512. Throughput: 0: 4182.9. Samples: 22714340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:54:57,795][52567] Avg episode reward: [(0, '14.126')] [2024-08-05 22:54:57,797][52614] Saving new best policy, reward=14.126! [2024-08-05 22:54:58,454][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:54:58,743][52820] DAMAGECOUNT value on done: 13359.0 [2024-08-05 22:54:58,745][52820] Sum rewards: 15.329, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.771', 'AMMO2': '0.026', 'AMMO3': '0.094', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.220', 'ARMOR': '0.518', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.516', 'weapon3': '1.556', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '12.000'} [2024-08-05 22:54:59,038][52668] DAMAGECOUNT value on done: 14746.0 [2024-08-05 22:54:59,039][52668] Sum rewards: 10.907, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.139', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.424', 'WEAPON3': '0.850', 'HITCOUNT': '0.870', 'weapon2': '1.000', 'ARMOR': '1.354', 'weapon3': '1.880', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '11.000'} [2024-08-05 22:54:59,559][52650] Updated weights for policy 0, policy_version 11091 (0.0014) [2024-08-05 22:55:00,260][52660] DAMAGECOUNT value on done: 16168.0 [2024-08-05 22:55:00,263][52660] Sum rewards: 11.413, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.102', 'AMMO3': '0.149', 'ARMOR': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '1.120', 'weapon2': '1.504', 'weapon3': '1.978', 'DAMAGECOUNT': '3.921', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:01,953][52668] DAMAGECOUNT value on done: 15664.0 [2024-08-05 22:55:01,953][52668] Sum rewards: 6.031, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.024', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'weapon4': '0.238', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.236', 'weapon3': '1.382', 'DAMAGECOUNT': '2.823', 'FRAGCOUNT': '7.000'} [2024-08-05 22:55:02,161][52820] DAMAGECOUNT value on done: 15170.0 [2024-08-05 22:55:02,161][52820] Sum rewards: 15.757, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.553', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'ARMOR': '0.016', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.358', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'weapon2': '1.632', 'weapon3': '1.848', 'DAMAGECOUNT': '4.389', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:02,257][52647] DAMAGECOUNT value on done: 18817.0 [2024-08-05 22:55:02,257][52647] Sum rewards: 17.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.001', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.028', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'AMMO4': '0.204', 'weapon4': '0.258', 'WEAPON3': '0.850', 'weapon2': '1.156', 'HITCOUNT': '1.190', 'weapon3': '2.234', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:02,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 90906624. Throughput: 0: 4175.5. Samples: 22726650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:55:02,795][52567] Avg episode reward: [(0, '14.103')] [2024-08-05 22:55:02,956][52660] DAMAGECOUNT value on done: 17214.0 [2024-08-05 22:55:02,958][52660] Sum rewards: 15.185, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.540', 'AMMO2': '0.004', 'weapon4': '0.010', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon2': '1.274', 'weapon3': '1.950', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:04,311][52650] Updated weights for policy 0, policy_version 11101 (0.0033) [2024-08-05 22:55:04,677][52668] DAMAGECOUNT value on done: 16000.0 [2024-08-05 22:55:04,677][52668] Sum rewards: 8.980, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.795', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.300', 'weapon4': '0.456', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'ARMOR': '0.903', 'weapon2': '1.298', 'weapon3': '1.586', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:05,104][52647] DAMAGECOUNT value on done: 15920.0 [2024-08-05 22:55:05,107][52647] Sum rewards: 15.198, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.435', 'AMMO4': '-0.086', 'AMMO2': '-0.017', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'ARMOR': '0.452', 'WEAPON3': '0.750', 'HITCOUNT': '1.220', 'weapon2': '1.276', 'weapon3': '1.620', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:05,757][52820] DAMAGECOUNT value on done: 14707.0 [2024-08-05 22:55:05,761][52820] Sum rewards: 6.732, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.177', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.042', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.408', 'WEAPON3': '0.750', 'HITCOUNT': '0.850', 'weapon2': '0.852', 'weapon3': '1.338', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '6.000'} [2024-08-05 22:55:05,780][52660] DAMAGECOUNT value on done: 15823.0 [2024-08-05 22:55:05,780][52660] Sum rewards: 12.358, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.742', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.950', 'HITCOUNT': '1.240', 'ARMOR': '1.376', 'weapon2': '1.552', 'weapon3': '1.704', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:05,806][52666] DAMAGECOUNT value on done: 16385.0 [2024-08-05 22:55:05,809][52666] Sum rewards: 15.548, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.072', 'AMMO2': '0.022', 'AMMO3': '0.098', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.490', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon2': '1.198', 'ARMOR': '1.260', 'weapon3': '1.830', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:07,156][52668] DAMAGECOUNT value on done: 16148.0 [2024-08-05 22:55:07,158][52668] Sum rewards: 22.069, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.685', 'AMMO4': '-0.065', 'AMMO2': '-0.013', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'ARMOR': '0.900', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon2': '1.522', 'weapon3': '1.844', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '20.000'} [2024-08-05 22:55:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 90996736. Throughput: 0: 4173.1. Samples: 22752020. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:55:07,795][52567] Avg episode reward: [(0, '14.056')] [2024-08-05 22:55:07,970][52647] DAMAGECOUNT value on done: 18649.0 [2024-08-05 22:55:07,970][52647] Sum rewards: 18.467, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.121', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.051', 'AMMO3': '0.062', 'WEAPON4': '0.100', 'ARMOR': '0.404', 'WEAPON3': '0.450', 'HITCOUNT': '1.130', 'weapon3': '1.390', 'weapon2': '1.590', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:08,438][52670] DAMAGECOUNT value on done: 17104.0 [2024-08-05 22:55:08,438][52670] Sum rewards: 12.355, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.200', 'WEAPON3': '1.000', 'HITCOUNT': '1.050', 'weapon2': '1.062', 'weapon3': '2.000', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:08,442][52660] DAMAGECOUNT value on done: 16520.0 [2024-08-05 22:55:08,443][52660] Sum rewards: 15.426, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'WEAPON3': '0.450', 'HITCOUNT': '1.380', 'weapon3': '1.426', 'weapon2': '1.502', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:08,988][52666] DAMAGECOUNT value on done: 14613.0 [2024-08-05 22:55:08,990][52666] Sum rewards: 10.179, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.078', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.178', 'ARMOR': '0.408', 'WEAPON3': '0.500', 'HITCOUNT': '0.640', 'weapon3': '1.364', 'weapon2': '1.764', 'DAMAGECOUNT': '2.430', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:09,135][52820] DAMAGECOUNT value on done: 15353.0 [2024-08-05 22:55:09,135][52820] Sum rewards: 10.635, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.068', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'HEALTH': '0.158', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'weapon4': '0.690', 'HITCOUNT': '0.840', 'weapon2': '0.900', 'weapon3': '1.570', 'DAMAGECOUNT': '3.072', 'FRAGCOUNT': '7.000'} [2024-08-05 22:55:09,619][52650] Updated weights for policy 0, policy_version 11111 (0.0011) [2024-08-05 22:55:09,990][52668] DAMAGECOUNT value on done: 15096.0 [2024-08-05 22:55:09,992][52668] Sum rewards: 17.046, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.744', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.452', 'WEAPON3': '0.900', 'weapon2': '1.164', 'HITCOUNT': '1.370', 'weapon3': '1.750', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:11,235][52647] DAMAGECOUNT value on done: 15470.0 [2024-08-05 22:55:11,236][52647] Sum rewards: 14.380, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.525', 'AMMO2': '0.021', 'weapon4': '0.082', 'AMMO3': '0.102', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.855', 'HITCOUNT': '1.360', 'weapon3': '1.524', 'weapon2': '1.624', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:11,247][52660] DAMAGECOUNT value on done: 16710.0 [2024-08-05 22:55:11,248][52660] Sum rewards: 14.688, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.100', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.110', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.312', 'weapon3': '1.678', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:11,388][52670] DAMAGECOUNT value on done: 15679.0 [2024-08-05 22:55:11,390][52670] Sum rewards: 15.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.166', 'weapon4': '0.278', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '1.280', 'weapon2': '1.442', 'weapon3': '1.998', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:11,938][52666] DAMAGECOUNT value on done: 16381.0 [2024-08-05 22:55:11,940][52666] Sum rewards: 16.180, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.620', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.304', 'ARMOR': '0.412', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.302', 'weapon3': '1.852', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:12,558][52820] DAMAGECOUNT value on done: 16167.0 [2024-08-05 22:55:12,559][52820] Sum rewards: 17.128, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.869', 'HITCOUNT': '1.210', 'weapon3': '1.440', 'weapon2': '1.480', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:12,793][52668] DAMAGECOUNT value on done: 15656.0 [2024-08-05 22:55:12,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 91070464. Throughput: 0: 4183.8. Samples: 22777340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:55:12,797][52567] Avg episode reward: [(0, '14.259')] [2024-08-05 22:55:12,793][52668] Sum rewards: 9.711, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.026', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'HEALTH': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.250', 'WEAPON3': '0.450', 'weapon4': '0.474', 'HITCOUNT': '0.810', 'ARMOR': '0.864', 'weapon3': '1.218', 'weapon2': '1.436', 'DAMAGECOUNT': '2.595', 'FRAGCOUNT': '7.000'} [2024-08-05 22:55:12,812][52614] Saving new best policy, reward=14.259! [2024-08-05 22:55:14,156][52650] Updated weights for policy 0, policy_version 11121 (0.0020) [2024-08-05 22:55:14,264][52660] DAMAGECOUNT value on done: 16702.0 [2024-08-05 22:55:14,266][52660] Sum rewards: 8.298, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.072', 'AMMO2': '0.025', 'AMMO3': '0.117', 'AMMO4': '0.123', 'weapon4': '0.190', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '0.820', 'weapon3': '1.512', 'weapon2': '1.854', 'DAMAGECOUNT': '2.847', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:14,590][52647] DAMAGECOUNT value on done: 17025.0 [2024-08-05 22:55:14,590][52647] Sum rewards: 12.656, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON3': '0.750', 'HITCOUNT': '1.150', 'weapon2': '1.398', 'weapon3': '1.878', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:14,840][52670] DAMAGECOUNT value on done: 14477.0 [2024-08-05 22:55:14,840][52670] Sum rewards: 11.037, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.002', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon5': '0.112', 'weapon4': '0.210', 'WEAPON3': '0.750', 'HITCOUNT': '0.770', 'ARMOR': '0.863', 'weapon2': '1.154', 'weapon3': '1.642', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '9.000'} [2024-08-05 22:55:15,414][52666] DAMAGECOUNT value on done: 15088.0 [2024-08-05 22:55:15,416][52666] Sum rewards: 14.634, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.294', 'WEAPON3': '0.550', 'ARMOR': '0.860', 'HITCOUNT': '1.130', 'weapon3': '1.438', 'weapon2': '1.440', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:15,923][52668] DAMAGECOUNT value on done: 14775.0 [2024-08-05 22:55:15,924][52668] Sum rewards: 1.963, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.005', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'weapon4': '0.340', 'HITCOUNT': '0.640', 'WEAPON3': '0.800', 'weapon2': '0.840', 'ARMOR': '0.930', 'weapon3': '1.486', 'DAMAGECOUNT': '2.115', 'FRAGCOUNT': '4.000'} [2024-08-05 22:55:16,070][52820] DAMAGECOUNT value on done: 16181.0 [2024-08-05 22:55:16,072][52820] Sum rewards: 9.328, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.680', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.129', 'weapon4': '0.280', 'WEAPON3': '0.850', 'ARMOR': '0.867', 'HITCOUNT': '0.870', 'weapon2': '1.312', 'weapon3': '1.938', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:17,187][52660] DAMAGECOUNT value on done: 17503.0 [2024-08-05 22:55:17,187][52660] Sum rewards: 16.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.226', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'weapon3': '1.330', 'weapon2': '1.622', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:17,305][52647] DAMAGECOUNT value on done: 16859.0 [2024-08-05 22:55:17,307][52647] Sum rewards: 15.733, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.734', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.246', 'WEAPON3': '0.500', 'ARMOR': '0.871', 'HITCOUNT': '1.210', 'weapon3': '1.264', 'weapon2': '1.694', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 91160576. Throughput: 0: 4189.8. Samples: 22789910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:55:17,795][52567] Avg episode reward: [(0, '13.919')] [2024-08-05 22:55:17,922][52670] DAMAGECOUNT value on done: 16526.0 [2024-08-05 22:55:17,922][52670] Sum rewards: 17.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.842', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.532', 'weapon2': '0.720', 'WEAPON3': '0.800', 'ARMOR': '0.844', 'HITCOUNT': '1.270', 'weapon3': '1.850', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:18,292][52666] DAMAGECOUNT value on done: 15627.0 [2024-08-05 22:55:18,299][52666] Sum rewards: 14.909, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.356', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.550', 'ARMOR': '0.830', 'weapon2': '0.872', 'HITCOUNT': '1.200', 'weapon3': '1.478', 'DAMAGECOUNT': '3.216', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:18,468][52668] DAMAGECOUNT value on done: 17183.0 [2024-08-05 22:55:18,468][52668] Sum rewards: 15.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.942', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.024', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.867', 'HITCOUNT': '1.350', 'weapon2': '1.432', 'weapon3': '1.924', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:18,749][52671] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:55:19,299][52650] Updated weights for policy 0, policy_version 11131 (0.0017) [2024-08-05 22:55:19,490][52647] DAMAGECOUNT value on done: 15740.0 [2024-08-05 22:55:19,490][52647] Sum rewards: 12.967, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.139', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'ARMOR': '0.048', 'AMMO3': '0.100', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon2': '0.986', 'weapon3': '1.902', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:19,500][52820] DAMAGECOUNT value on done: 14384.0 [2024-08-05 22:55:19,501][52820] Sum rewards: 16.281, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.929', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'ARMOR': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.240', 'WEAPON3': '0.500', 'HITCOUNT': '1.170', 'weapon2': '1.228', 'weapon3': '1.278', 'DAMAGECOUNT': '4.416', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:19,702][52660] DAMAGECOUNT value on done: 17271.0 [2024-08-05 22:55:19,705][52660] Sum rewards: 18.915, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.832', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.366', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.130', 'HITCOUNT': '1.300', 'weapon3': '1.560', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:20,899][52670] DAMAGECOUNT value on done: 15266.0 [2024-08-05 22:55:20,904][52670] Sum rewards: 20.894, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.078', 'HEALTH': '0.156', 'WEAPON3': '0.500', 'ARMOR': '0.855', 'weapon3': '1.314', 'HITCOUNT': '1.360', 'weapon2': '1.954', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:21,472][52666] DAMAGECOUNT value on done: 14463.0 [2024-08-05 22:55:21,472][52666] Sum rewards: 10.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.427', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.173', 'HITCOUNT': '0.900', 'WEAPON3': '1.050', 'weapon2': '1.456', 'weapon3': '1.746', 'ARMOR': '1.853', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:21,564][52668] DAMAGECOUNT value on done: 17416.0 [2024-08-05 22:55:21,566][52668] Sum rewards: 17.252, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon7': '0.056', 'HEALTH': '0.060', 'weapon5': '0.062', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.404', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon2': '1.306', 'weapon3': '1.468', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:21,897][52647] DAMAGECOUNT value on done: 17785.0 [2024-08-05 22:55:21,897][52647] Sum rewards: 9.414, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.250', 'AMMO2': '0.014', 'AMMO4': '0.071', 'ARMOR': '0.072', 'AMMO3': '0.082', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon2': '1.106', 'weapon3': '1.820', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '7.000'} [2024-08-05 22:55:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16772.8). Total num frames: 91242496. Throughput: 0: 4189.6. Samples: 22814970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 22:55:22,794][52567] Avg episode reward: [(0, '14.272')] [2024-08-05 22:55:22,795][52614] Saving new best policy, reward=14.272! [2024-08-05 22:55:22,880][52820] DAMAGECOUNT value on done: 14634.0 [2024-08-05 22:55:22,881][52820] Sum rewards: 10.680, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.025', 'AMMO4': '-0.079', 'AMMO2': '-0.016', 'AMMO5': '0.003', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.170', 'weapon5': '0.176', 'WEAPON3': '0.550', 'HITCOUNT': '0.840', 'ARMOR': '0.923', 'weapon3': '1.296', 'weapon2': '1.422', 'DAMAGECOUNT': '2.910', 'FRAGCOUNT': '7.000'} [2024-08-05 22:55:22,954][52660] DAMAGECOUNT value on done: 18065.0 [2024-08-05 22:55:22,954][52660] Sum rewards: 20.528, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.270', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'ARMOR': '0.492', 'WEAPON3': '0.900', 'weapon2': '1.240', 'HITCOUNT': '1.490', 'weapon3': '2.204', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '18.000'} [2024-08-05 22:55:24,113][52669] DAMAGECOUNT value on done: 17011.0 [2024-08-05 22:55:24,115][52669] Sum rewards: 22.521, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.022', 'weapon7': '0.046', 'weapon4': '0.058', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.108', 'HEALTH': '0.202', 'WEAPON3': '0.550', 'ARMOR': '0.852', 'weapon2': '1.328', 'HITCOUNT': '1.350', 'weapon3': '1.488', 'DAMAGECOUNT': '5.277', 'FRAGCOUNT': '16.000'} [2024-08-05 22:55:24,319][52650] Updated weights for policy 0, policy_version 11141 (0.0022) [2024-08-05 22:55:24,383][52668] DAMAGECOUNT value on done: 17202.0 [2024-08-05 22:55:24,383][52668] Sum rewards: 20.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.220', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon4': '0.018', 'weapon5': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'WEAPON3': '0.700', 'ARMOR': '0.848', 'weapon2': '1.472', 'HITCOUNT': '1.510', 'weapon3': '1.870', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '18.000'} [2024-08-05 22:55:24,388][52647] DAMAGECOUNT value on done: 19285.0 [2024-08-05 22:55:24,388][52647] Sum rewards: 8.689, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon5': '0.112', 'HEALTH': '0.216', 'weapon4': '0.246', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.660', 'weapon3': '0.930', 'weapon2': '1.038', 'DAMAGECOUNT': '2.136', 'FRAGCOUNT': '6.000'} [2024-08-05 22:55:24,438][52670] DAMAGECOUNT value on done: 17623.0 [2024-08-05 22:55:24,438][52670] Sum rewards: 11.791, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.130', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.014', 'ARMOR': '0.049', 'weapon7': '0.078', 'weapon5': '0.082', 'AMMO3': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.260', 'weapon3': '1.428', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '9.000'} [2024-08-05 22:55:25,077][52666] DAMAGECOUNT value on done: 15877.0 [2024-08-05 22:55:25,079][52666] Sum rewards: 14.325, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.270', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'ARMOR': '0.055', 'AMMO3': '0.084', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'HITCOUNT': '1.110', 'weapon2': '1.252', 'weapon3': '1.374', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:25,779][52660] DAMAGECOUNT value on done: 15702.0 [2024-08-05 22:55:25,800][52660] Sum rewards: 11.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.822', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon5': '0.044', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.750', 'ARMOR': '0.867', 'HITCOUNT': '1.000', 'weapon2': '1.200', 'weapon3': '1.520', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:26,549][52820] DAMAGECOUNT value on done: 14879.0 [2024-08-05 22:55:26,549][52820] Sum rewards: 15.159, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.558', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.252', 'ARMOR': '0.957', 'WEAPON3': '1.100', 'weapon2': '1.176', 'HITCOUNT': '1.390', 'weapon3': '2.014', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:26,872][52647] DAMAGECOUNT value on done: 17633.0 [2024-08-05 22:55:26,873][52647] Sum rewards: 18.724, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.418', 'ARMOR': '0.479', 'WEAPON3': '0.750', 'weapon2': '1.096', 'HITCOUNT': '1.250', 'weapon3': '1.938', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '16.000'} [2024-08-05 22:55:27,235][52669] DAMAGECOUNT value on done: 16861.0 [2024-08-05 22:55:27,237][52669] Sum rewards: 17.023, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.564', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon4': '0.168', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'HITCOUNT': '1.170', 'weapon3': '1.290', 'weapon2': '1.462', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:27,427][52670] DAMAGECOUNT value on done: 14569.0 [2024-08-05 22:55:27,427][52670] Sum rewards: 10.867, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.422', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'ARMOR': '0.100', 'AMMO3': '0.113', 'AMMO4': '0.126', 'WEAPON4': '0.450', 'weapon2': '0.692', 'weapon4': '0.762', 'WEAPON3': '0.800', 'HITCOUNT': '1.000', 'weapon3': '1.908', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '9.000'} [2024-08-05 22:55:27,794][52567] Fps is (10 sec: 16384.5, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 91324416. Throughput: 0: 4178.2. Samples: 22839820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:55:27,794][52567] Avg episode reward: [(0, '14.528')] [2024-08-05 22:55:27,797][52614] Saving new best policy, reward=14.528! [2024-08-05 22:55:28,006][52666] DAMAGECOUNT value on done: 15176.0 [2024-08-05 22:55:28,007][52666] Sum rewards: 17.921, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.495', 'AMMO2': '0.027', 'ARMOR': '0.072', 'AMMO4': '0.134', 'AMMO3': '0.152', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.166', 'HITCOUNT': '1.260', 'weapon3': '2.472', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '18.000'} [2024-08-05 22:55:28,552][52660] DAMAGECOUNT value on done: 17232.0 [2024-08-05 22:55:28,553][52660] Sum rewards: 22.884, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.726', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'HITCOUNT': '1.430', 'weapon3': '1.506', 'weapon2': '1.836', 'DAMAGECOUNT': '4.566', 'FRAGCOUNT': '19.000'} [2024-08-05 22:55:29,078][52650] Updated weights for policy 0, policy_version 11151 (0.0035) [2024-08-05 22:55:29,664][52647] DAMAGECOUNT value on done: 17713.0 [2024-08-05 22:55:29,665][52647] Sum rewards: 11.422, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.079', 'HEALTH': '0.256', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon3': '1.600', 'weapon2': '1.680', 'DAMAGECOUNT': '3.171', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:29,969][52820] DAMAGECOUNT value on done: 15666.0 [2024-08-05 22:55:29,969][52820] Sum rewards: 19.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.058', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON3': '0.800', 'ARMOR': '1.387', 'weapon2': '1.432', 'HITCOUNT': '1.460', 'weapon3': '1.728', 'DAMAGECOUNT': '5.337', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:30,370][52669] DAMAGECOUNT value on done: 17107.0 [2024-08-05 22:55:30,370][52669] Sum rewards: 21.540, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.835', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.095', 'ARMOR': '0.451', 'WEAPON3': '0.650', 'HITCOUNT': '1.420', 'weapon3': '1.842', 'weapon2': '2.030', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '17.000'} [2024-08-05 22:55:30,453][52670] DAMAGECOUNT value on done: 14752.0 [2024-08-05 22:55:30,454][52670] Sum rewards: 11.761, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.461', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.034', 'AMMO4': '0.043', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'ARMOR': '0.484', 'weapon4': '0.530', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon2': '1.498', 'weapon3': '1.616', 'DAMAGECOUNT': '3.480', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:30,956][52666] DAMAGECOUNT value on done: 15843.0 [2024-08-05 22:55:30,959][52666] Sum rewards: 9.636, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.298', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon7': '0.084', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.274', 'weapon4': '0.676', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon3': '1.602', 'DAMAGECOUNT': '3.318', 'FRAGCOUNT': '9.000'} [2024-08-05 22:55:31,666][52660] DAMAGECOUNT value on done: 16686.0 [2024-08-05 22:55:31,669][52660] Sum rewards: 20.517, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'HEALTH': '0.017', 'weapon5': '0.018', 'AMMO2': '0.027', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.676', 'ARMOR': '0.887', 'weapon2': '1.118', 'HITCOUNT': '1.230', 'weapon3': '1.760', 'DAMAGECOUNT': '4.404', 'FRAGCOUNT': '16.000'} [2024-08-05 22:55:32,720][52647] DAMAGECOUNT value on done: 14562.0 [2024-08-05 22:55:32,723][52647] Sum rewards: 0.758, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.328', 'HITCOUNT': '0.760', 'ARMOR': '0.978', 'weapon2': '1.034', 'WEAPON3': '1.100', 'weapon3': '1.792', 'DAMAGECOUNT': '2.262', 'FRAGCOUNT': '3.000'} [2024-08-05 22:55:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.2, 300 sec: 16800.5). Total num frames: 91414528. Throughput: 0: 4171.1. Samples: 22851970. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:55:32,794][52567] Avg episode reward: [(0, '14.660')] [2024-08-05 22:55:32,795][52614] Saving new best policy, reward=14.660! [2024-08-05 22:55:33,059][52669] DAMAGECOUNT value on done: 18457.0 [2024-08-05 22:55:33,060][52669] Sum rewards: 14.002, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.472', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon7': '0.076', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '0.600', 'weapon4': '0.804', 'HITCOUNT': '0.870', 'ARMOR': '0.888', 'weapon3': '1.620', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:33,464][52820] DAMAGECOUNT value on done: 15575.0 [2024-08-05 22:55:33,465][52820] Sum rewards: 17.088, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.370', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'ARMOR': '0.028', 'AMMO3': '0.138', 'WEAPON3': '1.050', 'HITCOUNT': '1.350', 'weapon2': '1.426', 'weapon3': '2.338', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '17.000'} [2024-08-05 22:55:33,816][52670] DAMAGECOUNT value on done: 15344.0 [2024-08-05 22:55:33,816][52670] Sum rewards: 16.492, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.190', 'AMMO2': '0.018', 'ARMOR': '0.056', 'AMMO4': '0.089', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.434', 'WEAPON3': '0.650', 'weapon2': '1.036', 'HITCOUNT': '1.350', 'weapon3': '1.806', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:34,041][52650] Updated weights for policy 0, policy_version 11161 (0.0014) [2024-08-05 22:55:34,406][52666] DAMAGECOUNT value on done: 15456.0 [2024-08-05 22:55:34,406][52666] Sum rewards: 10.182, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.080', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.057', 'WEAPON5': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.338', 'ARMOR': '0.481', 'WEAPON3': '0.500', 'HITCOUNT': '0.710', 'weapon2': '0.786', 'weapon3': '1.010', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '6.500'} [2024-08-05 22:55:36,057][52669] DAMAGECOUNT value on done: 17330.0 [2024-08-05 22:55:36,059][52669] Sum rewards: 9.929, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.035', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO4': '0.177', 'HEALTH': '0.384', 'ARMOR': '0.464', 'WEAPON3': '0.850', 'HITCOUNT': '0.990', 'weapon2': '1.116', 'weapon3': '1.972', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:36,166][52647] DAMAGECOUNT value on done: 16249.0 [2024-08-05 22:55:36,168][52647] Sum rewards: 9.599, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.272', 'ARMOR': '0.890', 'WEAPON3': '0.900', 'HITCOUNT': '1.120', 'weapon2': '1.550', 'weapon3': '1.618', 'DAMAGECOUNT': '3.519', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:37,081][52820] DAMAGECOUNT value on done: 16003.0 [2024-08-05 22:55:37,081][52820] Sum rewards: 19.440, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.872', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.472', 'ARMOR': '0.490', 'WEAPON3': '0.900', 'weapon2': '1.138', 'HITCOUNT': '1.670', 'weapon3': '1.778', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '17.000'} [2024-08-05 22:55:37,525][52670] DAMAGECOUNT value on done: 13657.0 [2024-08-05 22:55:37,525][52670] Sum rewards: 9.333, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.643', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon7': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.380', 'ARMOR': '0.480', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '1.106', 'weapon3': '1.652', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 91488256. Throughput: 0: 4169.8. Samples: 22877050. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 22:55:37,794][52567] Avg episode reward: [(0, '14.554')] [2024-08-05 22:55:38,037][52666] DAMAGECOUNT value on done: 13704.0 [2024-08-05 22:55:38,047][52666] Sum rewards: 13.021, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.032', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.432', 'WEAPON3': '0.500', 'HITCOUNT': '0.830', 'ARMOR': '0.893', 'weapon2': '1.350', 'weapon3': '1.422', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '9.000'} [2024-08-05 22:55:38,730][52650] Updated weights for policy 0, policy_version 11171 (0.0040) [2024-08-05 22:55:38,915][52647] DAMAGECOUNT value on done: 15784.0 [2024-08-05 22:55:38,917][52647] Sum rewards: 14.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.254', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'weapon4': '0.376', 'WEAPON3': '0.500', 'ARMOR': '0.860', 'weapon2': '0.864', 'HITCOUNT': '0.950', 'weapon3': '1.536', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:39,437][52669] DAMAGECOUNT value on done: 17435.0 [2024-08-05 22:55:39,438][52669] Sum rewards: 12.679, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.056', 'AMMO2': '0.012', 'ARMOR': '0.032', 'weapon4': '0.032', 'AMMO4': '0.061', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon2': '1.274', 'weapon3': '2.080', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:40,403][52820] DAMAGECOUNT value on done: 15339.0 [2024-08-05 22:55:40,405][52820] Sum rewards: 19.675, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.128', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.891', 'HITCOUNT': '1.350', 'weapon2': '1.414', 'weapon3': '2.036', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '17.000'} [2024-08-05 22:55:40,813][52670] DAMAGECOUNT value on done: 16879.0 [2024-08-05 22:55:40,814][52670] Sum rewards: 17.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.185', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.126', 'WEAPON3': '0.750', 'ARMOR': '0.880', 'HITCOUNT': '1.260', 'weapon3': '1.546', 'weapon2': '2.316', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:41,344][52666] DAMAGECOUNT value on done: 14338.0 [2024-08-05 22:55:41,346][52666] Sum rewards: 15.370, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.162', 'AMMO2': '0.025', 'AMMO3': '0.076', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.296', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'weapon2': '0.956', 'HITCOUNT': '0.970', 'weapon3': '1.418', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:41,858][52647] DAMAGECOUNT value on done: 19577.0 [2024-08-05 22:55:41,860][52647] Sum rewards: 19.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.376', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.004', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.139', 'WEAPON3': '0.900', 'weapon2': '1.484', 'HITCOUNT': '1.620', 'ARMOR': '1.763', 'weapon3': '1.898', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '17.000'} [2024-08-05 22:55:42,130][52665] DAMAGECOUNT value on done: 15634.0 [2024-08-05 22:55:42,131][52665] Sum rewards: 11.094, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.046', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON4': '0.400', 'weapon4': '0.504', 'WEAPON3': '0.850', 'ARMOR': '0.971', 'HITCOUNT': '1.070', 'weapon2': '1.082', 'weapon3': '1.962', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:42,485][52669] DAMAGECOUNT value on done: 18070.0 [2024-08-05 22:55:42,485][52669] Sum rewards: 13.336, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.582', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.408', 'ARMOR': '0.849', 'WEAPON3': '0.900', 'weapon2': '1.090', 'HITCOUNT': '1.240', 'weapon3': '1.986', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 91578368. Throughput: 0: 4169.4. Samples: 22901960. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:55:42,794][52567] Avg episode reward: [(0, '14.453')] [2024-08-05 22:55:43,235][52670] DAMAGECOUNT value on done: 17485.0 [2024-08-05 22:55:43,244][52670] Sum rewards: 15.234, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.130', 'AMMO2': '0.020', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.426', 'WEAPON3': '0.500', 'ARMOR': '0.872', 'HITCOUNT': '0.980', 'weapon3': '1.176', 'weapon2': '1.192', 'DAMAGECOUNT': '3.408', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:43,782][52650] Updated weights for policy 0, policy_version 11181 (0.0011) [2024-08-05 22:55:43,799][52666] DAMAGECOUNT value on done: 16240.0 [2024-08-05 22:55:43,801][52666] Sum rewards: 16.468, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.554', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.027', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.280', 'WEAPON3': '0.750', 'weapon2': '1.246', 'HITCOUNT': '1.310', 'weapon3': '1.644', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:43,995][52820] DAMAGECOUNT value on done: 15156.0 [2024-08-05 22:55:43,996][52820] Sum rewards: 15.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.348', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.085', 'ARMOR': '0.086', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '1.350', 'weapon2': '1.366', 'weapon3': '2.166', 'DAMAGECOUNT': '5.220', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:44,840][52647] DAMAGECOUNT value on done: 14663.0 [2024-08-05 22:55:44,841][52647] Sum rewards: 8.019, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.504', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.066', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'ARMOR': '0.901', 'weapon2': '1.218', 'weapon3': '1.734', 'DAMAGECOUNT': '2.778', 'FRAGCOUNT': '6.000'} [2024-08-05 22:55:45,094][52665] DAMAGECOUNT value on done: 16325.0 [2024-08-05 22:55:45,099][52665] Sum rewards: 11.063, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.688', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.148', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon2': '0.796', 'WEAPON3': '1.000', 'HITCOUNT': '1.020', 'weapon3': '2.260', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:45,523][52669] DAMAGECOUNT value on done: 16815.0 [2024-08-05 22:55:45,524][52669] Sum rewards: 12.351, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.966', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.342', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon3': '1.372', 'weapon2': '1.614', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:46,585][52670] DAMAGECOUNT value on done: 17141.0 [2024-08-05 22:55:46,585][52670] Sum rewards: 2.350, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.018', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon7': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.300', 'HITCOUNT': '0.730', 'ARMOR': '0.969', 'WEAPON3': '1.000', 'weapon2': '1.074', 'weapon3': '2.106', 'DAMAGECOUNT': '2.484', 'FRAGCOUNT': '4.000'} [2024-08-05 22:55:46,980][52666] DAMAGECOUNT value on done: 15406.0 [2024-08-05 22:55:46,981][52666] Sum rewards: 13.684, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.655', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'AMMO3': '0.050', 'weapon7': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.508', 'weapon4': '0.532', 'weapon2': '0.548', 'HITCOUNT': '0.680', 'weapon3': '1.102', 'DAMAGECOUNT': '2.703', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:47,348][52820] DAMAGECOUNT value on done: 14724.0 [2024-08-05 22:55:47,350][52820] Sum rewards: 17.030, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.666', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.012', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'weapon4': '0.226', 'WEAPON3': '0.750', 'weapon2': '1.326', 'HITCOUNT': '1.380', 'weapon3': '1.946', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:47,676][52647] DAMAGECOUNT value on done: 18757.0 [2024-08-05 22:55:47,677][52647] Sum rewards: 13.719, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.968', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.354', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.158', 'HITCOUNT': '1.170', 'weapon3': '1.756', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 91660288. Throughput: 0: 4180.5. Samples: 22914770. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 22:55:47,794][52567] Avg episode reward: [(0, '13.932')] [2024-08-05 22:55:48,216][52665] DAMAGECOUNT value on done: 17435.0 [2024-08-05 22:55:48,218][52665] Sum rewards: 11.906, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.910', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon4': '0.054', 'weapon7': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon2': '1.318', 'weapon3': '1.582', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:48,612][52650] Updated weights for policy 0, policy_version 11191 (0.0011) [2024-08-05 22:55:48,685][52669] DAMAGECOUNT value on done: 15484.0 [2024-08-05 22:55:48,688][52669] Sum rewards: 8.873, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.506', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.300', 'ARMOR': '0.473', 'weapon4': '0.632', 'WEAPON3': '0.800', 'HITCOUNT': '0.980', 'weapon2': '1.184', 'weapon3': '1.378', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:49,872][52670] DAMAGECOUNT value on done: 16746.0 [2024-08-05 22:55:49,874][52670] Sum rewards: 14.946, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'AMMO2': '0.041', 'AMMO3': '0.101', 'AMMO4': '0.204', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'ARMOR': '1.345', 'weapon2': '1.358', 'weapon3': '1.908', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:50,213][52666] DAMAGECOUNT value on done: 15189.0 [2024-08-05 22:55:50,215][52666] Sum rewards: 11.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.804', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.214', 'WEAPON3': '0.650', 'weapon2': '0.888', 'HITCOUNT': '1.220', 'weapon3': '1.596', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '9.000'} [2024-08-05 22:55:50,636][52647] DAMAGECOUNT value on done: 16896.0 [2024-08-05 22:55:50,638][52647] Sum rewards: 16.760, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.130', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.230', 'weapon4': '0.330', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.154', 'ARMOR': '1.359', 'weapon3': '1.538', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:50,675][52820] DAMAGECOUNT value on done: 16089.0 [2024-08-05 22:55:50,675][52820] Sum rewards: 14.130, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.210', 'AMMO2': '0.031', 'AMMO3': '0.141', 'AMMO4': '0.155', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '0.850', 'HITCOUNT': '0.930', 'weapon2': '1.066', 'ARMOR': '1.420', 'weapon3': '1.896', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '12.000'} [2024-08-05 22:55:51,215][52665] DAMAGECOUNT value on done: 17707.0 [2024-08-05 22:55:51,215][52665] Sum rewards: 15.491, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.517', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.212', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'HITCOUNT': '1.360', 'weapon3': '1.428', 'weapon2': '1.662', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:51,831][52669] DAMAGECOUNT value on done: 15784.0 [2024-08-05 22:55:51,856][52669] Sum rewards: 5.162, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.610', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON3': '0.350', 'ARMOR': '0.455', 'HITCOUNT': '0.540', 'weapon2': '0.892', 'weapon3': '0.934', 'DAMAGECOUNT': '1.695', 'FRAGCOUNT': '3.000'} [2024-08-05 22:55:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 16800.5). Total num frames: 91750400. Throughput: 0: 4179.3. Samples: 22940090. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:55:52,795][52567] Avg episode reward: [(0, '13.876')] [2024-08-05 22:55:53,153][52670] DAMAGECOUNT value on done: 16546.0 [2024-08-05 22:55:53,156][52670] Sum rewards: 6.621, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'weapon5': '0.120', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'HEALTH': '0.290', 'WEAPON3': '0.400', 'weapon4': '0.402', 'HITCOUNT': '0.760', 'ARMOR': '0.900', 'weapon2': '1.178', 'weapon3': '1.214', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '5.000'} [2024-08-05 22:55:53,497][52650] Updated weights for policy 0, policy_version 11201 (0.0018) [2024-08-05 22:55:53,549][52666] DAMAGECOUNT value on done: 15545.0 [2024-08-05 22:55:53,552][52666] Sum rewards: 6.700, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.829', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.167', 'WEAPON4': '0.300', 'ARMOR': '0.492', 'HITCOUNT': '0.640', 'weapon4': '0.758', 'WEAPON3': '0.800', 'weapon2': '0.922', 'weapon3': '1.698', 'DAMAGECOUNT': '2.382', 'FRAGCOUNT': '7.000'} [2024-08-05 22:55:53,676][52665] DAMAGECOUNT value on done: 15560.0 [2024-08-05 22:55:53,685][52665] Sum rewards: 7.329, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.473', 'AMMO5': '0.003', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.095', 'weapon5': '0.096', 'AMMO4': '0.213', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon2': '0.762', 'weapon4': '0.784', 'HITCOUNT': '0.810', 'weapon3': '1.316', 'DAMAGECOUNT': '2.550', 'FRAGCOUNT': '6.000'} [2024-08-05 22:55:53,963][52820] DAMAGECOUNT value on done: 14157.0 [2024-08-05 22:55:53,965][52820] Sum rewards: 11.343, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.472', 'AMMO2': '0.018', 'AMMO3': '0.060', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'ARMOR': '0.435', 'weapon4': '0.442', 'WEAPON3': '0.450', 'HITCOUNT': '0.900', 'weapon2': '1.294', 'weapon3': '1.466', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '8.000'} [2024-08-05 22:55:53,982][52647] DAMAGECOUNT value on done: 17960.0 [2024-08-05 22:55:53,982][52647] Sum rewards: 17.082, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.913', 'AMMO4': '-0.111', 'AMMO2': '-0.022', 'AMMO3': '0.080', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '1.310', 'weapon3': '1.556', 'weapon2': '1.620', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:54,937][52669] DAMAGECOUNT value on done: 16667.0 [2024-08-05 22:55:54,941][52669] Sum rewards: 20.985, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.798', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON3': '0.850', 'ARMOR': '0.888', 'HITCOUNT': '1.430', 'weapon2': '1.586', 'weapon3': '2.004', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '17.000'} [2024-08-05 22:55:56,331][52665] DAMAGECOUNT value on done: 16155.0 [2024-08-05 22:55:56,331][52665] Sum rewards: 16.898, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.124', 'AMMO2': '0.013', 'ARMOR': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.104', 'weapon4': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '1.220', 'weapon2': '1.430', 'weapon3': '1.788', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:56,346][52670] DAMAGECOUNT value on done: 14843.0 [2024-08-05 22:55:56,346][52670] Sum rewards: 14.633, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.272', 'ARMOR': '0.409', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.410', 'weapon3': '1.434', 'DAMAGECOUNT': '3.972', 'FRAGCOUNT': '11.000'} [2024-08-05 22:55:56,732][52666] DAMAGECOUNT value on done: 14191.0 [2024-08-05 22:55:56,735][52666] Sum rewards: 14.099, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.857', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'weapon4': '0.272', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.240', 'weapon3': '1.522', 'ARMOR': '1.808', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '13.000'} [2024-08-05 22:55:57,192][52820] DAMAGECOUNT value on done: 15595.0 [2024-08-05 22:55:57,194][52820] Sum rewards: 15.491, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.012', 'HEALTH': '0.014', 'AMMO3': '0.056', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.222', 'weapon5': '0.224', 'WEAPON3': '0.350', 'ARMOR': '0.420', 'HITCOUNT': '0.990', 'weapon2': '1.014', 'weapon3': '1.068', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '10.000'} [2024-08-05 22:55:57,434][52647] DAMAGECOUNT value on done: 17443.0 [2024-08-05 22:55:57,434][52647] Sum rewards: 15.204, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.954', 'AMMO2': '0.029', 'AMMO3': '0.136', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.270', 'ARMOR': '0.917', 'WEAPON3': '0.950', 'weapon2': '1.092', 'HITCOUNT': '1.500', 'weapon3': '2.420', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '14.000'} [2024-08-05 22:55:57,754][52669] DAMAGECOUNT value on done: 18068.0 [2024-08-05 22:55:57,755][52669] Sum rewards: 10.353, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.040', 'AMMO4': '0.061', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.270', 'weapon2': '1.318', 'weapon3': '1.692', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '9.000'} [2024-08-05 22:55:57,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 91824128. Throughput: 0: 4179.5. Samples: 22965420. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:55:57,795][52567] Avg episode reward: [(0, '13.910')] [2024-08-05 22:55:58,377][52650] Updated weights for policy 0, policy_version 11211 (0.0050) [2024-08-05 22:55:59,141][52665] DAMAGECOUNT value on done: 17723.0 [2024-08-05 22:55:59,152][52665] Sum rewards: 16.478, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.836', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'weapon4': '0.002', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'ARMOR': '0.929', 'WEAPON3': '0.950', 'HITCOUNT': '1.210', 'weapon2': '1.566', 'weapon3': '1.672', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '15.000'} [2024-08-05 22:55:59,471][52663] DAMAGECOUNT value on done: 17700.0 [2024-08-05 22:55:59,471][52663] Sum rewards: 9.622, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.887', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.046', 'WEAPON4': '0.200', 'weapon4': '0.368', 'WEAPON3': '0.400', 'HITCOUNT': '0.490', 'weapon2': '0.494', 'weapon3': '0.826', 'ARMOR': '0.922', 'DAMAGECOUNT': '2.013', 'FRAGCOUNT': '7.000'} [2024-08-05 22:55:59,693][52670] DAMAGECOUNT value on done: 15828.0 [2024-08-05 22:55:59,694][52670] Sum rewards: 6.996, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.228', 'AMMO2': '0.032', 'ARMOR': '0.052', 'weapon4': '0.064', 'AMMO3': '0.138', 'AMMO4': '0.160', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '0.930', 'weapon2': '1.398', 'weapon3': '2.150', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:00,176][52666] DAMAGECOUNT value on done: 15854.0 [2024-08-05 22:56:00,178][52666] Sum rewards: 6.541, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.288', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.053', 'AMMO3': '0.060', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'ARMOR': '0.539', 'HITCOUNT': '0.720', 'weapon2': '1.396', 'weapon3': '1.432', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '4.000'} [2024-08-05 22:56:00,417][52669] DAMAGECOUNT value on done: 15479.0 [2024-08-05 22:56:00,417][52669] Sum rewards: 4.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.520', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'HITCOUNT': '0.860', 'ARMOR': '0.871', 'weapon2': '1.332', 'weapon3': '1.762', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '5.000'} [2024-08-05 22:56:00,633][52820] DAMAGECOUNT value on done: 17720.0 [2024-08-05 22:56:00,633][52820] Sum rewards: 19.550, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.108', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.500', 'weapon2': '1.580', 'weapon3': '1.586', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '14.000'} [2024-08-05 22:56:02,096][52665] DAMAGECOUNT value on done: 15931.0 [2024-08-05 22:56:02,099][52665] Sum rewards: 8.272, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.072', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.248', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'ARMOR': '0.933', 'weapon3': '1.236', 'weapon2': '1.374', 'DAMAGECOUNT': '2.415', 'FRAGCOUNT': '6.000'} [2024-08-05 22:56:02,275][52663] DAMAGECOUNT value on done: 16835.0 [2024-08-05 22:56:02,277][52663] Sum rewards: 12.697, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.677', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.272', 'ARMOR': '0.435', 'WEAPON3': '0.500', 'HITCOUNT': '0.800', 'weapon2': '0.966', 'weapon3': '1.260', 'DAMAGECOUNT': '2.742', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:02,629][52670] DAMAGECOUNT value on done: 15752.0 [2024-08-05 22:56:02,631][52670] Sum rewards: 10.929, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.026', 'HEALTH': '0.030', 'ARMOR': '0.040', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'weapon5': '0.154', 'WEAPON3': '0.450', 'HITCOUNT': '0.950', 'weapon2': '1.308', 'weapon3': '1.524', 'DAMAGECOUNT': '3.510', 'FRAGCOUNT': '7.000'} [2024-08-05 22:56:02,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16793.7, 300 sec: 16772.8). Total num frames: 91914240. Throughput: 0: 4182.5. Samples: 22978120. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:56:02,794][52567] Avg episode reward: [(0, '13.537')] [2024-08-05 22:56:03,120][52666] DAMAGECOUNT value on done: 17807.0 [2024-08-05 22:56:03,122][52666] Sum rewards: 15.880, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.454', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.142', 'AMMO3': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.708', 'weapon2': '0.746', 'ARMOR': '0.897', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon3': '1.936', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '14.000'} [2024-08-05 22:56:03,472][52650] Updated weights for policy 0, policy_version 11221 (0.0026) [2024-08-05 22:56:03,602][52669] DAMAGECOUNT value on done: 18963.0 [2024-08-05 22:56:03,604][52669] Sum rewards: 16.324, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.692', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'ARMOR': '0.425', 'WEAPON3': '0.600', 'HITCOUNT': '1.190', 'weapon2': '1.554', 'weapon3': '1.842', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:03,966][52820] DAMAGECOUNT value on done: 16007.0 [2024-08-05 22:56:03,966][52820] Sum rewards: 15.135, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.575', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.113', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.470', 'weapon2': '1.604', 'weapon3': '2.028', 'DAMAGECOUNT': '4.752', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:05,126][52665] DAMAGECOUNT value on done: 18291.0 [2024-08-05 22:56:05,127][52665] Sum rewards: 19.004, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.008', 'AMMO4': '0.038', 'HEALTH': '0.046', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.360', 'WEAPON3': '0.500', 'ARMOR': '0.914', 'weapon2': '1.254', 'HITCOUNT': '1.390', 'weapon3': '1.662', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:05,500][52663] DAMAGECOUNT value on done: 16795.0 [2024-08-05 22:56:05,500][52663] Sum rewards: 9.640, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.222', 'ARMOR': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '1.140', 'weapon2': '1.526', 'weapon3': '1.924', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:05,523][52667] DAMAGECOUNT value on done: 16791.0 [2024-08-05 22:56:05,523][52667] Sum rewards: 7.535, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-1.030', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'AMMO3': '0.045', 'weapon5': '0.052', 'weapon7': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.440', 'ARMOR': '0.449', 'weapon4': '0.598', 'weapon2': '0.832', 'weapon3': '0.914', 'DAMAGECOUNT': '1.269', 'FRAGCOUNT': '5.000'} [2024-08-05 22:56:05,803][52670] DAMAGECOUNT value on done: 15448.0 [2024-08-05 22:56:05,805][52670] Sum rewards: 14.675, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.089', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.060', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON3': '0.400', 'ARMOR': '0.412', 'HITCOUNT': '1.060', 'weapon2': '1.342', 'weapon3': '1.410', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:06,227][52666] DAMAGECOUNT value on done: 15318.0 [2024-08-05 22:56:06,231][52666] Sum rewards: 13.058, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.310', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'AMMO4': '0.071', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.350', 'weapon4': '0.828', 'ARMOR': '0.880', 'HITCOUNT': '0.900', 'weapon3': '1.148', 'weapon2': '1.158', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:06,490][52669] DAMAGECOUNT value on done: 17678.0 [2024-08-05 22:56:06,491][52669] Sum rewards: 12.890, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.006', 'AMMO2': '0.012', 'weapon7': '0.052', 'AMMO4': '0.059', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.270', 'WEAPON3': '0.500', 'ARMOR': '0.527', 'weapon4': '0.632', 'HITCOUNT': '0.820', 'weapon3': '1.676', 'DAMAGECOUNT': '2.925', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 91996160. Throughput: 0: 4184.2. Samples: 23003260. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:56:07,794][52567] Avg episode reward: [(0, '13.587')] [2024-08-05 22:56:07,956][52650] Updated weights for policy 0, policy_version 11231 (0.0025) [2024-08-05 22:56:08,136][52665] DAMAGECOUNT value on done: 17010.0 [2024-08-05 22:56:08,136][52665] Sum rewards: 19.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.341', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.162', 'WEAPON3': '1.050', 'HITCOUNT': '1.480', 'weapon2': '1.536', 'weapon3': '2.282', 'DAMAGECOUNT': '5.763', 'FRAGCOUNT': '18.000'} [2024-08-05 22:56:08,517][52663] DAMAGECOUNT value on done: 19190.0 [2024-08-05 22:56:08,521][52663] Sum rewards: 13.586, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.758', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.060', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'ARMOR': '0.468', 'WEAPON3': '0.600', 'HITCOUNT': '0.940', 'weapon3': '1.302', 'weapon2': '1.322', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:08,766][52670] DAMAGECOUNT value on done: 16092.0 [2024-08-05 22:56:08,766][52670] Sum rewards: 12.769, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.538', 'AMMO2': '0.003', 'AMMO4': '0.015', 'ARMOR': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'weapon4': '0.326', 'WEAPON3': '0.500', 'HITCOUNT': '0.870', 'weapon2': '1.326', 'weapon3': '1.444', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '9.000'} [2024-08-05 22:56:08,897][52667] DAMAGECOUNT value on done: 17842.0 [2024-08-05 22:56:08,897][52667] Sum rewards: 19.415, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.458', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.157', 'weapon5': '0.168', 'weapon4': '0.220', 'WEAPON3': '1.000', 'weapon2': '1.120', 'ARMOR': '1.283', 'HITCOUNT': '1.520', 'weapon3': '2.116', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '18.000'} [2024-08-05 22:56:09,429][52669] DAMAGECOUNT value on done: 17636.0 [2024-08-05 22:56:09,430][52669] Sum rewards: 21.212, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.228', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.080', 'ARMOR': '0.416', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon3': '1.386', 'weapon2': '1.656', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '17.000'} [2024-08-05 22:56:11,377][52663] DAMAGECOUNT value on done: 16083.0 [2024-08-05 22:56:11,379][52663] Sum rewards: 22.064, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.092', 'AMMO4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.352', 'ARMOR': '0.464', 'WEAPON3': '0.700', 'weapon2': '1.062', 'weapon3': '1.500', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '17.000'} [2024-08-05 22:56:11,564][52665] DAMAGECOUNT value on done: 18551.0 [2024-08-05 22:56:11,565][52665] Sum rewards: 17.230, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon2': '0.666', 'weapon4': '0.736', 'ARMOR': '0.832', 'HITCOUNT': '1.480', 'weapon3': '1.602', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:11,884][52667] DAMAGECOUNT value on done: 16956.0 [2024-08-05 22:56:11,884][52667] Sum rewards: 19.793, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.594', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.290', 'weapon4': '0.312', 'weapon2': '0.886', 'WEAPON3': '0.900', 'HITCOUNT': '1.440', 'weapon3': '1.924', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '17.000'} [2024-08-05 22:56:12,002][52614] Signal inference workers to stop experience collection... (2100 times) [2024-08-05 22:56:12,004][52614] Signal inference workers to resume experience collection... (2100 times) [2024-08-05 22:56:12,092][52650] InferenceWorker_p0-w0: stopping experience collection (2100 times) [2024-08-05 22:56:12,098][52650] InferenceWorker_p0-w0: resuming experience collection (2100 times) [2024-08-05 22:56:12,718][52669] DAMAGECOUNT value on done: 17872.0 [2024-08-05 22:56:12,719][52669] Sum rewards: 20.116, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon4': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.119', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'weapon2': '1.196', 'HITCOUNT': '1.410', 'weapon3': '2.060', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '18.000'} [2024-08-05 22:56:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 92078080. Throughput: 0: 4191.8. Samples: 23028450. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 22:56:12,795][52567] Avg episode reward: [(0, '14.039')] [2024-08-05 22:56:13,000][52650] Updated weights for policy 0, policy_version 11241 (0.0019) [2024-08-05 22:56:14,334][52665] DAMAGECOUNT value on done: 16099.0 [2024-08-05 22:56:14,335][52665] Sum rewards: 5.817, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.516', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.118', 'ARMOR': '0.451', 'WEAPON3': '0.850', 'HITCOUNT': '0.880', 'weapon2': '1.186', 'weapon3': '1.684', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '6.000'} [2024-08-05 22:56:14,564][52663] DAMAGECOUNT value on done: 17531.0 [2024-08-05 22:56:14,564][52663] Sum rewards: 20.347, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.630', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.036', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.918', 'HITCOUNT': '1.390', 'weapon2': '1.656', 'weapon3': '1.840', 'DAMAGECOUNT': '5.094', 'FRAGCOUNT': '16.000'} [2024-08-05 22:56:14,939][52667] DAMAGECOUNT value on done: 17268.0 [2024-08-05 22:56:14,940][52667] Sum rewards: 11.828, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.285', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.021', 'weapon5': '0.088', 'AMMO3': '0.095', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.427', 'weapon4': '0.562', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon3': '1.432', 'weapon2': '1.504', 'DAMAGECOUNT': '4.221', 'FRAGCOUNT': '8.500'} [2024-08-05 22:56:15,557][52669] DAMAGECOUNT value on done: 17841.0 [2024-08-05 22:56:15,558][52669] Sum rewards: 15.978, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.865', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON3': '0.700', 'HITCOUNT': '1.140', 'weapon2': '1.238', 'ARMOR': '1.354', 'weapon3': '1.784', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:17,372][52663] DAMAGECOUNT value on done: 19663.0 [2024-08-05 22:56:17,374][52663] Sum rewards: 17.551, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.938', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.072', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.688', 'weapon2': '0.788', 'HITCOUNT': '1.260', 'ARMOR': '1.435', 'weapon3': '1.538', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '14.000'} [2024-08-05 22:56:17,429][52665] DAMAGECOUNT value on done: 16466.0 [2024-08-05 22:56:17,429][52665] Sum rewards: 11.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.280', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.122', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'weapon4': '0.616', 'WEAPON3': '0.750', 'weapon2': '0.766', 'HITCOUNT': '1.010', 'weapon3': '1.760', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '9.000'} [2024-08-05 22:56:17,649][52667] DAMAGECOUNT value on done: 17503.0 [2024-08-05 22:56:17,649][52667] Sum rewards: 9.680, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.706', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.060', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon2': '0.496', 'HITCOUNT': '0.780', 'weapon4': '0.986', 'ARMOR': '1.002', 'weapon3': '1.470', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '7.000'} [2024-08-05 22:56:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.2, 300 sec: 16745.0). Total num frames: 92160000. Throughput: 0: 4203.1. Samples: 23041110. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:56:17,794][52567] Avg episode reward: [(0, '13.883')] [2024-08-05 22:56:18,094][52650] Updated weights for policy 0, policy_version 11251 (0.0017) [2024-08-05 22:56:18,272][52669] DAMAGECOUNT value on done: 17187.0 [2024-08-05 22:56:18,272][52669] Sum rewards: 17.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.893', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON7': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.340', 'ARMOR': '1.354', 'weapon2': '1.510', 'weapon3': '1.878', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:19,499][52664] DAMAGECOUNT value on done: 18076.0 [2024-08-05 22:56:19,499][52664] Sum rewards: 7.383, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO3': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.546', 'HITCOUNT': '0.740', 'weapon3': '1.002', 'weapon2': '1.070', 'ARMOR': '1.304', 'DAMAGECOUNT': '2.406', 'FRAGCOUNT': '5.000'} [2024-08-05 22:56:20,071][52665] DAMAGECOUNT value on done: 16977.0 [2024-08-05 22:56:20,072][52665] Sum rewards: 14.208, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.069', 'AMMO2': '0.027', 'AMMO3': '0.118', 'AMMO4': '0.137', 'WEAPON4': '0.300', 'weapon4': '0.326', 'ARMOR': '0.404', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'weapon2': '1.128', 'weapon3': '1.846', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:20,389][52663] DAMAGECOUNT value on done: 15724.0 [2024-08-05 22:56:20,391][52663] Sum rewards: 15.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.350', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '1.300', 'weapon3': '1.590', 'weapon2': '1.870', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:20,871][52667] DAMAGECOUNT value on done: 19040.0 [2024-08-05 22:56:20,871][52667] Sum rewards: 17.721, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.285', 'weapon5': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.065', 'WEAPON5': '0.100', 'weapon4': '0.110', 'ARMOR': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '1.220', 'weapon3': '1.330', 'weapon2': '1.804', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:21,553][52669] DAMAGECOUNT value on done: 17993.0 [2024-08-05 22:56:21,554][52669] Sum rewards: 12.195, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.645', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.316', 'WEAPON3': '0.700', 'ARMOR': '0.856', 'HITCOUNT': '0.910', 'weapon2': '1.360', 'weapon3': '1.528', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:22,538][52650] Updated weights for policy 0, policy_version 11261 (0.0033) [2024-08-05 22:56:22,709][52664] DAMAGECOUNT value on done: 15611.0 [2024-08-05 22:56:22,709][52664] Sum rewards: 18.165, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.300', 'weapon4': '0.306', 'ARMOR': '0.463', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'weapon2': '1.440', 'weapon3': '1.998', 'DAMAGECOUNT': '4.362', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16800.9). Total num frames: 92250112. Throughput: 0: 4202.4. Samples: 23066160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:56:22,795][52567] Avg episode reward: [(0, '13.866')] [2024-08-05 22:56:23,166][52665] DAMAGECOUNT value on done: 16714.0 [2024-08-05 22:56:23,166][52665] Sum rewards: 6.281, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.070', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.060', 'AMMO3': '0.063', 'WEAPON3': '0.400', 'HITCOUNT': '0.500', 'ARMOR': '0.504', 'weapon2': '0.998', 'weapon3': '1.280', 'DAMAGECOUNT': '1.857', 'FRAGCOUNT': '5.000'} [2024-08-05 22:56:23,550][52667] DAMAGECOUNT value on done: 17620.0 [2024-08-05 22:56:23,555][52667] Sum rewards: 13.863, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.072', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.138', 'WEAPON3': '0.550', 'ARMOR': '0.840', 'HITCOUNT': '0.900', 'weapon2': '1.318', 'weapon3': '1.630', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:23,681][52663] DAMAGECOUNT value on done: 17201.0 [2024-08-05 22:56:23,682][52663] Sum rewards: 24.696, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO3': '0.070', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.441', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '1.410', 'weapon3': '1.626', 'weapon2': '1.760', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '17.000'} [2024-08-05 22:56:25,522][52664] DAMAGECOUNT value on done: 17928.0 [2024-08-05 22:56:25,522][52664] Sum rewards: 9.851, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.089', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'ARMOR': '0.914', 'WEAPON3': '1.000', 'HITCOUNT': '1.200', 'weapon2': '1.628', 'weapon3': '1.994', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '9.000'} [2024-08-05 22:56:26,224][52663] DAMAGECOUNT value on done: 19623.0 [2024-08-05 22:56:26,225][52663] Sum rewards: 14.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.008', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon5': '0.016', 'weapon4': '0.022', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon2': '1.320', 'weapon3': '1.796', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:26,614][52665] DAMAGECOUNT value on done: 16835.0 [2024-08-05 22:56:26,615][52665] Sum rewards: 6.645, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'weapon5': '0.126', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.466', 'ARMOR': '0.515', 'WEAPON3': '0.850', 'HITCOUNT': '0.920', 'weapon2': '0.930', 'weapon3': '1.648', 'DAMAGECOUNT': '3.342', 'FRAGCOUNT': '7.000'} [2024-08-05 22:56:27,061][52667] DAMAGECOUNT value on done: 16585.0 [2024-08-05 22:56:27,061][52667] Sum rewards: 11.167, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.754', 'AMMO2': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.049', 'weapon4': '0.066', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.970', 'weapon3': '1.128', 'weapon2': '1.352', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '9.000'} [2024-08-05 22:56:27,719][52650] Updated weights for policy 0, policy_version 11271 (0.0014) [2024-08-05 22:56:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 92332032. Throughput: 0: 4212.7. Samples: 23091530. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 22:56:27,794][52567] Avg episode reward: [(0, '13.553')] [2024-08-05 22:56:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011271_92332032.pth... [2024-08-05 22:56:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000010780_88309760.pth [2024-08-05 22:56:28,459][52664] DAMAGECOUNT value on done: 16603.0 [2024-08-05 22:56:28,459][52664] Sum rewards: 14.947, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.420', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO3': '0.089', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.264', 'ARMOR': '0.486', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.336', 'weapon3': '1.686', 'DAMAGECOUNT': '3.441', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:29,173][52663] DAMAGECOUNT value on done: 16630.0 [2024-08-05 22:56:29,174][52663] Sum rewards: 15.094, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.362', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.113', 'weapon4': '0.138', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.170', 'weapon2': '1.200', 'weapon3': '1.854', 'DAMAGECOUNT': '4.107', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:29,725][52665] DAMAGECOUNT value on done: 17076.0 [2024-08-05 22:56:29,725][52665] Sum rewards: 26.255, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.100', 'WEAPON3': '0.700', 'weapon2': '1.220', 'HITCOUNT': '1.720', 'weapon3': '1.888', 'DAMAGECOUNT': '5.964', 'FRAGCOUNT': '21.000'} [2024-08-05 22:56:30,174][52667] DAMAGECOUNT value on done: 17758.0 [2024-08-05 22:56:30,176][52667] Sum rewards: 14.673, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.278', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.268', 'WEAPON3': '0.700', 'ARMOR': '0.804', 'HITCOUNT': '1.350', 'weapon2': '1.606', 'weapon3': '1.940', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:30,374][52658] DAMAGECOUNT value on done: 17406.0 [2024-08-05 22:56:30,374][52658] Sum rewards: 12.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.414', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'ARMOR': '0.865', 'WEAPON3': '1.100', 'HITCOUNT': '1.260', 'weapon2': '1.306', 'weapon3': '1.910', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '14.000'} [2024-08-05 22:56:31,697][52664] DAMAGECOUNT value on done: 16140.0 [2024-08-05 22:56:31,699][52664] Sum rewards: 13.095, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.342', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.450', 'HITCOUNT': '0.870', 'ARMOR': '0.891', 'weapon3': '1.330', 'weapon2': '1.398', 'DAMAGECOUNT': '2.829', 'FRAGCOUNT': '9.000'} [2024-08-05 22:56:32,251][52650] Updated weights for policy 0, policy_version 11281 (0.0025) [2024-08-05 22:56:32,438][52665] DAMAGECOUNT value on done: 17087.0 [2024-08-05 22:56:32,438][52665] Sum rewards: 16.799, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO2': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.101', 'WEAPON4': '0.250', 'ARMOR': '0.481', 'weapon4': '0.510', 'WEAPON3': '0.550', 'HITCOUNT': '1.170', 'weapon2': '1.248', 'weapon3': '1.842', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:32,577][52663] DAMAGECOUNT value on done: 17091.0 [2024-08-05 22:56:32,578][52663] Sum rewards: 17.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.736', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.020', 'weapon4': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.142', 'ARMOR': '0.408', 'WEAPON3': '0.950', 'HITCOUNT': '1.380', 'weapon2': '1.452', 'weapon3': '2.074', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '18.000'} [2024-08-05 22:56:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 92413952. Throughput: 0: 4198.4. Samples: 23103700. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 22:56:32,794][52567] Avg episode reward: [(0, '13.744')] [2024-08-05 22:56:33,374][52667] DAMAGECOUNT value on done: 18096.0 [2024-08-05 22:56:33,376][52667] Sum rewards: 13.860, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.194', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.138', 'WEAPON3': '0.750', 'ARMOR': '0.950', 'HITCOUNT': '1.190', 'weapon2': '1.608', 'weapon3': '1.858', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:33,565][52658] DAMAGECOUNT value on done: 17201.0 [2024-08-05 22:56:33,567][52658] Sum rewards: 14.035, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.098', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.332', 'WEAPON3': '0.750', 'HITCOUNT': '1.260', 'weapon2': '1.340', 'ARMOR': '1.366', 'weapon3': '1.840', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:35,219][52664] DAMAGECOUNT value on done: 19061.0 [2024-08-05 22:56:35,219][52664] Sum rewards: 18.657, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.120', 'ARMOR': '0.452', 'HEALTH': '0.608', 'WEAPON3': '0.650', 'HITCOUNT': '1.380', 'weapon2': '1.562', 'weapon3': '1.996', 'DAMAGECOUNT': '5.328', 'FRAGCOUNT': '14.000'} [2024-08-05 22:56:35,291][52665] DAMAGECOUNT value on done: 15421.0 [2024-08-05 22:56:35,293][52665] Sum rewards: 18.716, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.633', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.214', 'WEAPON3': '0.500', 'ARMOR': '0.503', 'HITCOUNT': '1.100', 'weapon3': '1.384', 'weapon2': '1.574', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:35,886][52663] DAMAGECOUNT value on done: 16280.0 [2024-08-05 22:56:35,887][52663] Sum rewards: 17.045, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.899', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.076', 'AMMO3': '0.103', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon4': '0.594', 'WEAPON3': '0.700', 'weapon2': '0.952', 'HITCOUNT': '1.370', 'weapon3': '1.774', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:36,094][52667] DAMAGECOUNT value on done: 16416.0 [2024-08-05 22:56:36,094][52667] Sum rewards: 13.699, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.128', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.178', 'ARMOR': '0.496', 'WEAPON3': '0.750', 'HITCOUNT': '1.080', 'weapon2': '1.392', 'weapon3': '1.588', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:36,324][52658] DAMAGECOUNT value on done: 14709.0 [2024-08-05 22:56:36,325][52658] Sum rewards: 9.595, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.590', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.274', 'WEAPON3': '0.600', 'ARMOR': '0.902', 'HITCOUNT': '1.000', 'weapon2': '1.446', 'weapon3': '1.494', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '7.000'} [2024-08-05 22:56:37,375][52650] Updated weights for policy 0, policy_version 11291 (0.0015) [2024-08-05 22:56:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 92504064. Throughput: 0: 4195.6. Samples: 23128890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 22:56:37,794][52567] Avg episode reward: [(0, '13.936')] [2024-08-05 22:56:37,829][52665] DAMAGECOUNT value on done: 16875.0 [2024-08-05 22:56:37,829][52665] Sum rewards: 13.871, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon7': '0.060', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'weapon4': '0.228', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.166', 'weapon3': '1.568', 'DAMAGECOUNT': '4.182', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:38,601][52664] DAMAGECOUNT value on done: 17474.0 [2024-08-05 22:56:38,608][52664] Sum rewards: 20.809, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.347', 'AMMO2': '0.049', 'AMMO3': '0.123', 'weapon4': '0.178', 'AMMO4': '0.244', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.859', 'HITCOUNT': '1.240', 'weapon2': '1.332', 'weapon3': '2.296', 'DAMAGECOUNT': '4.485', 'FRAGCOUNT': '16.000'} [2024-08-05 22:56:38,989][52667] DAMAGECOUNT value on done: 17573.0 [2024-08-05 22:56:38,989][52667] Sum rewards: 16.795, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.479', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.093', 'weapon4': '0.286', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '1.160', 'weapon3': '1.364', 'weapon2': '1.392', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:38,995][52663] DAMAGECOUNT value on done: 16628.0 [2024-08-05 22:56:38,996][52663] Sum rewards: 20.161, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.548', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.070', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.498', 'weapon4': '0.694', 'weapon2': '1.010', 'HITCOUNT': '1.320', 'weapon3': '1.496', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '16.000'} [2024-08-05 22:56:39,127][52658] DAMAGECOUNT value on done: 16796.0 [2024-08-05 22:56:39,127][52658] Sum rewards: 22.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO2': '0.018', 'ARMOR': '0.052', 'AMMO4': '0.090', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.468', 'weapon2': '0.778', 'WEAPON3': '1.200', 'HITCOUNT': '1.590', 'weapon3': '2.458', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '21.000'} [2024-08-05 22:56:41,237][52649] DAMAGECOUNT value on done: 17542.0 [2024-08-05 22:56:41,239][52649] Sum rewards: 12.482, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.734', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.119', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.090', 'ARMOR': '1.265', 'weapon2': '1.502', 'weapon3': '1.766', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:41,393][52664] DAMAGECOUNT value on done: 17209.0 [2024-08-05 22:56:41,394][52664] Sum rewards: 7.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.545', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.272', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'weapon2': '1.130', 'weapon3': '1.824', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:41,781][52667] DAMAGECOUNT value on done: 17049.0 [2024-08-05 22:56:41,781][52667] Sum rewards: 9.976, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.965', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.095', 'weapon4': '0.098', 'WEAPON4': '0.300', 'ARMOR': '0.516', 'WEAPON3': '0.850', 'HITCOUNT': '1.100', 'weapon2': '1.266', 'weapon3': '2.004', 'DAMAGECOUNT': '3.648', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:41,934][52658] DAMAGECOUNT value on done: 17577.0 [2024-08-05 22:56:41,935][52658] Sum rewards: 16.076, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.988', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'ARMOR': '0.416', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.280', 'weapon3': '1.636', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:42,328][52663] DAMAGECOUNT value on done: 16416.0 [2024-08-05 22:56:42,329][52663] Sum rewards: 10.465, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.516', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.067', 'WEAPON3': '0.450', 'HITCOUNT': '0.690', 'weapon3': '1.080', 'weapon2': '1.388', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '9.000'} [2024-08-05 22:56:42,557][52650] Updated weights for policy 0, policy_version 11301 (0.0023) [2024-08-05 22:56:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 92577792. Throughput: 0: 4193.4. Samples: 23154120. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:56:42,794][52567] Avg episode reward: [(0, '13.880')] [2024-08-05 22:56:44,000][52664] DAMAGECOUNT value on done: 19704.0 [2024-08-05 22:56:44,008][52664] Sum rewards: 22.398, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.032', 'ARMOR': '0.040', 'HEALTH': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON3': '0.600', 'weapon2': '0.870', 'HITCOUNT': '1.310', 'weapon3': '1.840', 'DAMAGECOUNT': '4.743', 'FRAGCOUNT': '18.000'} [2024-08-05 22:56:44,675][52667] DAMAGECOUNT value on done: 17331.0 [2024-08-05 22:56:44,677][52667] Sum rewards: 9.950, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.186', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'ARMOR': '0.072', 'AMMO3': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.288', 'weapon3': '1.950', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:44,683][52671] DAMAGECOUNT value on done: 20143.0 [2024-08-05 22:56:44,683][52671] Sum rewards: 19.213, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.139', 'WEAPON4': '0.300', 'weapon4': '0.358', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon2': '1.400', 'weapon3': '1.778', 'DAMAGECOUNT': '4.245', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:44,818][52649] DAMAGECOUNT value on done: 17222.0 [2024-08-05 22:56:44,820][52649] Sum rewards: 12.485, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.062', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.048', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'ARMOR': '0.448', 'WEAPON3': '0.950', 'HITCOUNT': '1.270', 'weapon2': '1.512', 'weapon3': '1.926', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:44,883][52663] DAMAGECOUNT value on done: 18306.0 [2024-08-05 22:56:44,885][52663] Sum rewards: 19.134, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.730', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.408', 'WEAPON3': '0.900', 'HITCOUNT': '1.290', 'weapon2': '1.302', 'weapon3': '1.716', 'ARMOR': '1.782', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:44,929][52658] DAMAGECOUNT value on done: 15286.0 [2024-08-05 22:56:44,930][52658] Sum rewards: 24.417, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.506', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.238', 'ARMOR': '0.824', 'WEAPON3': '0.900', 'weapon2': '1.380', 'HITCOUNT': '1.600', 'weapon3': '2.168', 'DAMAGECOUNT': '5.967', 'FRAGCOUNT': '22.000'} [2024-08-05 22:56:46,950][52650] Updated weights for policy 0, policy_version 11311 (0.0012) [2024-08-05 22:56:47,124][52664] DAMAGECOUNT value on done: 17247.0 [2024-08-05 22:56:47,125][52664] Sum rewards: 15.505, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.335', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.172', 'WEAPON3': '0.850', 'ARMOR': '1.351', 'HITCOUNT': '1.420', 'weapon2': '1.548', 'weapon3': '1.778', 'DAMAGECOUNT': '4.758', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:47,273][52803] DAMAGECOUNT value on done: 15278.0 [2024-08-05 22:56:47,277][52803] Sum rewards: 6.338, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.249', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.011', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.274', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.810', 'weapon3': '1.130', 'weapon2': '1.312', 'DAMAGECOUNT': '2.730', 'FRAGCOUNT': '6.000'} [2024-08-05 22:56:47,526][52671] DAMAGECOUNT value on done: 16782.0 [2024-08-05 22:56:47,527][52671] Sum rewards: 11.562, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.872', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.107', 'WEAPON3': '0.700', 'ARMOR': '0.857', 'HITCOUNT': '1.270', 'weapon2': '1.734', 'weapon3': '1.826', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 92667904. Throughput: 0: 4186.2. Samples: 23166500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:56:47,794][52567] Avg episode reward: [(0, '14.300')] [2024-08-05 22:56:47,916][52649] DAMAGECOUNT value on done: 17111.0 [2024-08-05 22:56:47,917][52649] Sum rewards: 13.447, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.236', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.406', 'ARMOR': '0.919', 'WEAPON3': '1.050', 'weapon2': '1.124', 'HITCOUNT': '1.330', 'weapon3': '2.274', 'DAMAGECOUNT': '4.479', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:47,979][52667] DAMAGECOUNT value on done: 18361.0 [2024-08-05 22:56:47,980][52667] Sum rewards: 11.019, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.361', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.086', 'WEAPON3': '0.550', 'weapon2': '0.918', 'HITCOUNT': '1.060', 'weapon3': '1.300', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:48,161][52663] DAMAGECOUNT value on done: 17878.0 [2024-08-05 22:56:48,161][52663] Sum rewards: 14.550, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.192', 'weapon4': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.900', 'WEAPON3': '0.950', 'weapon2': '1.284', 'HITCOUNT': '1.340', 'weapon3': '2.060', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '14.000'} [2024-08-05 22:56:48,165][52658] DAMAGECOUNT value on done: 19747.0 [2024-08-05 22:56:48,165][52658] Sum rewards: 20.192, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.786', 'AMMO4': '-0.089', 'AMMO2': '-0.018', 'AMMO3': '0.107', 'WEAPON3': '0.800', 'HITCOUNT': '1.370', 'ARMOR': '1.376', 'weapon3': '1.458', 'weapon2': '1.782', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '17.000'} [2024-08-05 22:56:49,701][52664] DAMAGECOUNT value on done: 19837.0 [2024-08-05 22:56:49,702][52664] Sum rewards: 21.821, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.212', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.128', 'ARMOR': '0.849', 'WEAPON3': '0.850', 'weapon3': '1.508', 'weapon2': '1.618', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '17.000'} [2024-08-05 22:56:50,324][52671] DAMAGECOUNT value on done: 19262.0 [2024-08-05 22:56:50,325][52671] Sum rewards: 13.346, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.350', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.098', 'weapon4': '0.276', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '1.140', 'weapon3': '1.280', 'DAMAGECOUNT': '3.501', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:50,620][52803] DAMAGECOUNT value on done: 18509.0 [2024-08-05 22:56:50,621][52803] Sum rewards: 12.344, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.370', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.346', 'ARMOR': '0.459', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.318', 'weapon3': '1.494', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:50,856][52667] DAMAGECOUNT value on done: 18688.0 [2024-08-05 22:56:50,856][52667] Sum rewards: 5.739, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.188', 'AMMO2': '0.029', 'AMMO3': '0.095', 'AMMO4': '0.146', 'WEAPON4': '0.350', 'ARMOR': '0.516', 'WEAPON3': '0.650', 'weapon4': '0.652', 'HITCOUNT': '0.740', 'weapon2': '0.892', 'weapon3': '1.448', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '4.000'} [2024-08-05 22:56:51,063][52658] DAMAGECOUNT value on done: 16067.0 [2024-08-05 22:56:51,064][52658] Sum rewards: 10.705, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.024', 'AMMO2': '0.024', 'ARMOR': '0.060', 'AMMO3': '0.086', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.410', 'WEAPON3': '0.500', 'HITCOUNT': '0.790', 'weapon2': '1.168', 'weapon3': '1.174', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:51,187][52663] DAMAGECOUNT value on done: 16319.0 [2024-08-05 22:56:51,188][52663] Sum rewards: 12.600, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.856', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.282', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'HITCOUNT': '0.950', 'weapon2': '1.166', 'weapon3': '1.714', 'DAMAGECOUNT': '3.135', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:51,242][52649] DAMAGECOUNT value on done: 16366.0 [2024-08-05 22:56:51,247][52649] Sum rewards: 8.074, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.355', 'AMMO2': '0.017', 'AMMO3': '0.080', 'AMMO4': '0.085', 'WEAPON4': '0.250', 'weapon4': '0.464', 'ARMOR': '0.473', 'WEAPON3': '0.550', 'HITCOUNT': '0.700', 'weapon2': '0.954', 'weapon3': '1.988', 'DAMAGECOUNT': '2.367', 'FRAGCOUNT': '5.000'} [2024-08-05 22:56:51,316][52811] DAMAGECOUNT value on done: 17222.0 [2024-08-05 22:56:51,317][52811] Sum rewards: 4.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.052', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.054', 'AMMO3': '0.100', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'HITCOUNT': '0.770', 'ARMOR': '0.906', 'weapon3': '1.190', 'weapon2': '1.400', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '4.000'} [2024-08-05 22:56:51,671][52794] DAMAGECOUNT value on done: 19115.0 [2024-08-05 22:56:51,671][52794] Sum rewards: 7.177, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.241', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.054', 'weapon4': '0.366', 'WEAPON3': '0.400', 'HITCOUNT': '0.550', 'ARMOR': '0.939', 'weapon2': '1.046', 'weapon3': '1.080', 'DAMAGECOUNT': '1.896', 'FRAGCOUNT': '4.000'} [2024-08-05 22:56:52,041][52650] Updated weights for policy 0, policy_version 11321 (0.0013) [2024-08-05 22:56:52,749][52664] DAMAGECOUNT value on done: 16229.0 [2024-08-05 22:56:52,750][52664] Sum rewards: 10.761, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.482', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.027', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'weapon4': '0.688', 'HITCOUNT': '1.030', 'weapon2': '1.088', 'weapon3': '1.264', 'DAMAGECOUNT': '3.294', 'FRAGCOUNT': '7.000'} [2024-08-05 22:56:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 92749824. Throughput: 0: 4184.0. Samples: 23191540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:56:52,794][52567] Avg episode reward: [(0, '14.209')] [2024-08-05 22:56:53,393][52671] DAMAGECOUNT value on done: 16771.0 [2024-08-05 22:56:53,394][52671] Sum rewards: 13.627, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.935', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon4': '0.458', 'WEAPON3': '0.500', 'HITCOUNT': '0.960', 'weapon3': '1.260', 'ARMOR': '1.365', 'weapon2': '1.640', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '9.500'} [2024-08-05 22:56:53,720][52667] DAMAGECOUNT value on done: 18292.0 [2024-08-05 22:56:53,721][52667] Sum rewards: 17.581, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.481', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.847', 'HITCOUNT': '1.300', 'weapon2': '1.348', 'weapon3': '1.410', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:53,774][52659] DAMAGECOUNT value on done: 17641.0 [2024-08-05 22:56:53,775][52659] Sum rewards: 11.446, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.134', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.108', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'HITCOUNT': '1.180', 'weapon2': '1.494', 'ARMOR': '1.828', 'weapon3': '2.198', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '8.500'} [2024-08-05 22:56:53,790][52803] DAMAGECOUNT value on done: 15330.0 [2024-08-05 22:56:53,793][52803] Sum rewards: 4.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.022', 'weapon7': '0.068', 'AMMO3': '0.096', 'AMMO4': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.360', 'ARMOR': '0.432', 'HITCOUNT': '0.470', 'WEAPON3': '0.650', 'weapon2': '1.404', 'DAMAGECOUNT': '1.560', 'weapon3': '1.578', 'FRAGCOUNT': '4.000'} [2024-08-05 22:56:54,030][52658] DAMAGECOUNT value on done: 17558.0 [2024-08-05 22:56:54,030][52658] Sum rewards: 24.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.893', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.138', 'WEAPON3': '0.900', 'ARMOR': '1.323', 'weapon2': '1.476', 'HITCOUNT': '1.490', 'weapon3': '1.882', 'DAMAGECOUNT': '5.727', 'FRAGCOUNT': '21.000'} [2024-08-05 22:56:54,174][52649] DAMAGECOUNT value on done: 16660.0 [2024-08-05 22:56:54,174][52649] Sum rewards: 11.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.482', 'AMMO2': '0.031', 'ARMOR': '0.056', 'AMMO3': '0.105', 'AMMO4': '0.156', 'WEAPON4': '0.350', 'weapon2': '0.644', 'weapon4': '0.686', 'WEAPON3': '0.700', 'HITCOUNT': '1.130', 'weapon3': '1.816', 'DAMAGECOUNT': '3.768', 'FRAGCOUNT': '9.000'} [2024-08-05 22:56:54,320][52794] DAMAGECOUNT value on done: 21292.0 [2024-08-05 22:56:54,322][52794] Sum rewards: 20.711, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.924', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.096', 'ARMOR': '0.504', 'WEAPON3': '0.600', 'HITCOUNT': '1.540', 'weapon2': '1.676', 'weapon3': '1.730', 'DAMAGECOUNT': '5.550', 'FRAGCOUNT': '18.000'} [2024-08-05 22:56:54,510][52663] DAMAGECOUNT value on done: 16035.0 [2024-08-05 22:56:54,511][52663] Sum rewards: 17.780, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.196', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.294', 'WEAPON3': '0.650', 'weapon2': '1.128', 'HITCOUNT': '1.260', 'weapon3': '1.878', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '16.000'} [2024-08-05 22:56:54,597][52811] DAMAGECOUNT value on done: 16954.0 [2024-08-05 22:56:54,598][52811] Sum rewards: 17.509, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.522', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO3': '0.102', 'WEAPON3': '0.700', 'ARMOR': '0.910', 'HITCOUNT': '1.380', 'weapon2': '1.554', 'weapon3': '1.726', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:56,094][52664] DAMAGECOUNT value on done: 17257.0 [2024-08-05 22:56:56,095][52664] Sum rewards: 16.418, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.469', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.147', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.258', 'HITCOUNT': '1.580', 'weapon3': '1.982', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:56,190][52662] DAMAGECOUNT value on done: 19316.0 [2024-08-05 22:56:56,191][52662] Sum rewards: 18.691, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.022', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.436', 'ARMOR': '0.449', 'WEAPON3': '0.600', 'weapon2': '1.150', 'HITCOUNT': '1.330', 'weapon3': '1.888', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:56,267][52671] DAMAGECOUNT value on done: 17261.0 [2024-08-05 22:56:56,272][52671] Sum rewards: 12.306, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon7': '0.084', 'ARMOR': '0.088', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.848', 'WEAPON3': '0.850', 'weapon2': '0.968', 'HITCOUNT': '1.030', 'weapon3': '1.840', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:56,510][52667] DAMAGECOUNT value on done: 16851.0 [2024-08-05 22:56:56,510][52667] Sum rewards: 10.241, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.770', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.172', 'weapon4': '0.282', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '1.050', 'weapon2': '1.238', 'weapon3': '2.146', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:56,702][52658] DAMAGECOUNT value on done: 16965.0 [2024-08-05 22:56:56,704][52658] Sum rewards: 14.790, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon7': '0.048', 'weapon5': '0.050', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.660', 'weapon4': '0.928', 'HITCOUNT': '1.060', 'weapon3': '1.616', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '13.000'} [2024-08-05 22:56:56,716][52659] DAMAGECOUNT value on done: 18543.0 [2024-08-05 22:56:56,716][52659] Sum rewards: 23.421, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.554', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.256', 'ARMOR': '0.495', 'WEAPON3': '0.950', 'weapon2': '1.206', 'HITCOUNT': '1.740', 'weapon3': '2.248', 'DAMAGECOUNT': '6.636', 'FRAGCOUNT': '19.000'} [2024-08-05 22:56:57,072][52794] DAMAGECOUNT value on done: 21282.0 [2024-08-05 22:56:57,073][52794] Sum rewards: 15.302, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.075', 'HEALTH': '0.130', 'WEAPON3': '0.450', 'ARMOR': '0.893', 'HITCOUNT': '1.110', 'weapon2': '1.506', 'weapon3': '1.516', 'DAMAGECOUNT': '4.062', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:57,076][52650] Updated weights for policy 0, policy_version 11331 (0.0022) [2024-08-05 22:56:57,086][52649] DAMAGECOUNT value on done: 18313.0 [2024-08-05 22:56:57,086][52649] Sum rewards: 18.517, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.572', 'AMMO2': '0.010', 'ARMOR': '0.044', 'AMMO4': '0.051', 'weapon7': '0.064', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.518', 'weapon4': '0.764', 'WEAPON3': '0.800', 'HITCOUNT': '1.280', 'weapon3': '1.678', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:57,291][52803] DAMAGECOUNT value on done: 16145.0 [2024-08-05 22:56:57,292][52803] Sum rewards: 21.011, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.108', 'AMMO2': '0.041', 'AMMO3': '0.100', 'AMMO4': '0.203', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.957', 'HITCOUNT': '1.250', 'weapon2': '1.460', 'weapon3': '1.922', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '15.000'} [2024-08-05 22:56:57,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 92831744. Throughput: 0: 4180.2. Samples: 23216560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:56:57,795][52567] Avg episode reward: [(0, '14.799')] [2024-08-05 22:56:57,804][52614] Saving new best policy, reward=14.799! [2024-08-05 22:56:57,880][52663] DAMAGECOUNT value on done: 16630.0 [2024-08-05 22:56:57,882][52663] Sum rewards: 11.613, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.517', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO3': '0.095', 'WEAPON3': '0.750', 'ARMOR': '0.924', 'HITCOUNT': '0.970', 'weapon2': '1.384', 'weapon3': '1.808', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '10.000'} [2024-08-05 22:56:57,960][52811] DAMAGECOUNT value on done: 17558.0 [2024-08-05 22:56:57,962][52811] Sum rewards: 26.499, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.826', 'AMMO4': '-0.053', 'AMMO2': '-0.010', 'AMMO3': '0.097', 'WEAPON3': '0.700', 'ARMOR': '0.889', 'weapon3': '1.482', 'weapon2': '1.586', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '6.894', 'FRAGCOUNT': '20.000'} [2024-08-05 22:56:59,078][52662] DAMAGECOUNT value on done: 20388.0 [2024-08-05 22:56:59,078][52662] Sum rewards: 15.878, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.394', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.020', 'weapon4': '0.056', 'AMMO4': '0.086', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.490', 'weapon3': '1.724', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '12.000'} [2024-08-05 22:56:59,537][52667] DAMAGECOUNT value on done: 16984.0 [2024-08-05 22:56:59,539][52667] Sum rewards: 15.385, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.141', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.172', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'HITCOUNT': '1.300', 'weapon3': '1.510', 'weapon2': '1.788', 'DAMAGECOUNT': '4.578', 'FRAGCOUNT': '11.000'} [2024-08-05 22:56:59,682][52671] DAMAGECOUNT value on done: 17854.0 [2024-08-05 22:56:59,685][52671] Sum rewards: 18.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.993', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.076', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.206', 'WEAPON3': '0.850', 'weapon2': '1.386', 'HITCOUNT': '1.430', 'weapon3': '1.954', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '17.000'} [2024-08-05 22:56:59,708][52664] DAMAGECOUNT value on done: 16416.0 [2024-08-05 22:56:59,708][52664] Sum rewards: 12.768, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.273', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.040', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.250', 'weapon4': '0.258', 'HITCOUNT': '0.810', 'ARMOR': '0.877', 'weapon2': '0.888', 'weapon3': '0.998', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '8.000'} [2024-08-05 22:56:59,771][52658] DAMAGECOUNT value on done: 18744.0 [2024-08-05 22:56:59,771][52658] Sum rewards: 20.094, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.055', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon4': '0.306', 'WEAPON3': '0.650', 'HITCOUNT': '1.690', 'weapon3': '1.738', 'weapon2': '1.768', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:00,058][52649] DAMAGECOUNT value on done: 14627.0 [2024-08-05 22:57:00,059][52649] Sum rewards: 6.412, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.416', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.081', 'WEAPON4': '0.200', 'weapon4': '0.540', 'WEAPON3': '0.600', 'HITCOUNT': '0.850', 'weapon2': '1.246', 'weapon3': '1.704', 'ARMOR': '1.789', 'DAMAGECOUNT': '2.763', 'FRAGCOUNT': '3.000'} [2024-08-05 22:57:00,086][52794] DAMAGECOUNT value on done: 18957.0 [2024-08-05 22:57:00,086][52794] Sum rewards: 9.806, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.428', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.088', 'weapon5': '0.096', 'WEAPON4': '0.150', 'ARMOR': '0.525', 'WEAPON3': '0.600', 'weapon4': '0.668', 'HITCOUNT': '1.020', 'weapon2': '1.154', 'weapon3': '1.698', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '6.000'} [2024-08-05 22:57:00,107][52659] DAMAGECOUNT value on done: 17939.0 [2024-08-05 22:57:00,107][52659] Sum rewards: 21.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.005', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.094', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.262', 'ARMOR': '0.482', 'WEAPON3': '0.800', 'weapon2': '1.184', 'weapon3': '1.610', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '6.504', 'FRAGCOUNT': '17.000'} [2024-08-05 22:57:00,728][52803] DAMAGECOUNT value on done: 17842.0 [2024-08-05 22:57:00,728][52803] Sum rewards: 23.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.065', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'AMMO3': '0.116', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.526', 'WEAPON3': '0.800', 'weapon2': '0.996', 'ARMOR': '1.256', 'HITCOUNT': '1.450', 'weapon3': '1.764', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '20.000'} [2024-08-05 22:57:01,115][52811] DAMAGECOUNT value on done: 17666.0 [2024-08-05 22:57:01,115][52811] Sum rewards: 18.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON3': '0.850', 'ARMOR': '1.314', 'weapon2': '1.378', 'HITCOUNT': '1.430', 'weapon3': '1.880', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:01,698][52662] DAMAGECOUNT value on done: 22956.0 [2024-08-05 22:57:01,698][52662] Sum rewards: 21.544, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.150', 'ARMOR': '0.559', 'WEAPON3': '1.000', 'weapon2': '1.490', 'HITCOUNT': '1.540', 'weapon3': '1.934', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '21.000'} [2024-08-05 22:57:01,875][52650] Updated weights for policy 0, policy_version 11341 (0.0024) [2024-08-05 22:57:02,622][52794] DAMAGECOUNT value on done: 21121.0 [2024-08-05 22:57:02,625][52794] Sum rewards: 13.210, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'weapon7': '0.120', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'HEALTH': '0.286', 'weapon4': '0.338', 'WEAPON3': '0.450', 'ARMOR': '0.496', 'HITCOUNT': '0.870', 'weapon3': '1.124', 'weapon2': '1.244', 'DAMAGECOUNT': '3.666', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:02,698][52664] DAMAGECOUNT value on done: 17915.0 [2024-08-05 22:57:02,699][52664] Sum rewards: 7.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.746', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.093', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.000', 'weapon3': '1.424', 'weapon2': '2.004', 'DAMAGECOUNT': '3.585', 'FRAGCOUNT': '6.000'} [2024-08-05 22:57:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 92913664. Throughput: 0: 4175.6. Samples: 23229010. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:57:02,794][52567] Avg episode reward: [(0, '14.832')] [2024-08-05 22:57:02,795][52614] Saving new best policy, reward=14.832! [2024-08-05 22:57:02,902][52667] DAMAGECOUNT value on done: 18503.0 [2024-08-05 22:57:02,903][52667] Sum rewards: 19.796, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.962', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.290', 'weapon4': '0.428', 'WEAPON3': '0.800', 'ARMOR': '0.929', 'weapon2': '1.196', 'HITCOUNT': '1.320', 'weapon3': '1.668', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:02,933][52649] DAMAGECOUNT value on done: 15806.0 [2024-08-05 22:57:02,933][52649] Sum rewards: 15.475, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.862', 'AMMO2': '0.032', 'weapon4': '0.094', 'AMMO3': '0.157', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'ARMOR': '0.894', 'WEAPON3': '0.900', 'HITCOUNT': '1.350', 'weapon2': '1.722', 'weapon3': '1.860', 'DAMAGECOUNT': '5.169', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:02,987][52671] DAMAGECOUNT value on done: 17988.0 [2024-08-05 22:57:02,990][52671] Sum rewards: 14.855, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.647', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.112', 'weapon4': '0.196', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'WEAPON3': '0.750', 'HITCOUNT': '1.060', 'weapon2': '1.634', 'weapon3': '1.834', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:03,397][52658] DAMAGECOUNT value on done: 16989.0 [2024-08-05 22:57:03,398][52658] Sum rewards: 18.587, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.688', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.095', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.470', 'weapon3': '1.738', 'weapon2': '2.018', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:03,462][52659] DAMAGECOUNT value on done: 17965.0 [2024-08-05 22:57:03,462][52659] Sum rewards: 16.255, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.910', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.131', 'ARMOR': '0.428', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon2': '1.576', 'weapon3': '1.996', 'DAMAGECOUNT': '5.112', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:04,111][52803] DAMAGECOUNT value on done: 15952.0 [2024-08-05 22:57:04,111][52803] Sum rewards: 10.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.942', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.026', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.300', 'weapon4': '0.578', 'WEAPON3': '0.800', 'ARMOR': '0.909', 'HITCOUNT': '1.060', 'weapon2': '1.136', 'weapon3': '1.712', 'DAMAGECOUNT': '3.414', 'FRAGCOUNT': '7.500'} [2024-08-05 22:57:04,241][52662] DAMAGECOUNT value on done: 19807.0 [2024-08-05 22:57:04,243][52662] Sum rewards: 13.721, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.983', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.083', 'weapon4': '0.134', 'WEAPON4': '0.150', 'ARMOR': '0.559', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon2': '1.460', 'weapon3': '1.720', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:04,698][52811] DAMAGECOUNT value on done: 17936.0 [2024-08-05 22:57:04,698][52811] Sum rewards: 10.651, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.889', 'HITCOUNT': '1.110', 'weapon2': '1.396', 'weapon3': '2.154', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:05,141][52794] DAMAGECOUNT value on done: 18923.0 [2024-08-05 22:57:05,141][52794] Sum rewards: 4.325, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.744', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.136', 'weapon4': '0.176', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon3': '1.636', 'weapon2': '1.738', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '5.000'} [2024-08-05 22:57:05,391][52664] DAMAGECOUNT value on done: 15231.0 [2024-08-05 22:57:05,391][52664] Sum rewards: 19.763, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'HEALTH': '0.200', 'weapon4': '0.264', 'WEAPON3': '0.600', 'ARMOR': '0.887', 'HITCOUNT': '1.500', 'weapon3': '1.506', 'weapon2': '1.772', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:06,120][52671] DAMAGECOUNT value on done: 18099.0 [2024-08-05 22:57:06,122][52671] Sum rewards: 15.154, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.312', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.260', 'WEAPON3': '0.600', 'ARMOR': '0.892', 'HITCOUNT': '1.100', 'weapon2': '1.146', 'weapon3': '1.304', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:06,270][52649] DAMAGECOUNT value on done: 16298.0 [2024-08-05 22:57:06,270][52649] Sum rewards: 11.472, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.181', 'AMMO2': '0.029', 'weapon4': '0.130', 'AMMO3': '0.137', 'AMMO4': '0.145', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.948', 'HITCOUNT': '1.280', 'weapon3': '1.724', 'weapon2': '1.748', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:06,529][52662] DAMAGECOUNT value on done: 19765.0 [2024-08-05 22:57:06,529][52662] Sum rewards: 11.614, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.258', 'ARMOR': '0.452', 'weapon2': '0.868', 'WEAPON3': '1.000', 'HITCOUNT': '1.100', 'weapon3': '2.322', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:06,665][52659] DAMAGECOUNT value on done: 16876.0 [2024-08-05 22:57:06,667][52659] Sum rewards: 19.956, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.578', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.076', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'weapon3': '1.070', 'HITCOUNT': '1.320', 'weapon2': '1.824', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:06,681][52658] DAMAGECOUNT value on done: 17196.0 [2024-08-05 22:57:06,682][52658] Sum rewards: 12.516, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.398', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.028', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'weapon4': '0.562', 'WEAPON3': '0.700', 'weapon2': '1.074', 'HITCOUNT': '1.170', 'weapon3': '1.988', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:06,917][52650] Updated weights for policy 0, policy_version 11351 (0.0013) [2024-08-05 22:57:07,574][52794] DAMAGECOUNT value on done: 21309.0 [2024-08-05 22:57:07,575][52794] Sum rewards: 19.166, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.965', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO5': '0.004', 'weapon5': '0.044', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.891', 'weapon3': '1.410', 'HITCOUNT': '1.440', 'weapon2': '1.694', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '13.500'} [2024-08-05 22:57:07,597][52803] DAMAGECOUNT value on done: 19860.0 [2024-08-05 22:57:07,599][52803] Sum rewards: 16.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.976', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'ARMOR': '0.852', 'weapon2': '0.986', 'WEAPON3': '1.450', 'HITCOUNT': '1.920', 'weapon3': '2.704', 'DAMAGECOUNT': '6.966', 'FRAGCOUNT': '18.000'} [2024-08-05 22:57:07,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 92995584. Throughput: 0: 4165.1. Samples: 23253590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:57:07,794][52567] Avg episode reward: [(0, '14.954')] [2024-08-05 22:57:07,798][52614] Saving new best policy, reward=14.954! [2024-08-05 22:57:07,878][52664] DAMAGECOUNT value on done: 18919.0 [2024-08-05 22:57:07,878][52664] Sum rewards: 10.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.620', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.048', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '1.250', 'weapon2': '1.256', 'ARMOR': '1.381', 'HITCOUNT': '1.420', 'weapon3': '2.358', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:08,058][52811] DAMAGECOUNT value on done: 16333.0 [2024-08-05 22:57:08,058][52811] Sum rewards: 14.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'ARMOR': '0.520', 'WEAPON3': '0.700', 'HITCOUNT': '1.350', 'weapon2': '1.512', 'weapon3': '1.530', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:09,107][52662] DAMAGECOUNT value on done: 21137.0 [2024-08-05 22:57:09,110][52662] Sum rewards: 11.115, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.132', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.049', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO4': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.642', 'WEAPON3': '0.700', 'weapon2': '0.888', 'HITCOUNT': '1.020', 'weapon3': '1.784', 'DAMAGECOUNT': '3.513', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:09,223][52649] DAMAGECOUNT value on done: 17814.0 [2024-08-05 22:57:09,223][52649] Sum rewards: 19.295, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.035', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.173', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.070', 'ARMOR': '1.290', 'HITCOUNT': '1.560', 'weapon3': '2.264', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '17.000'} [2024-08-05 22:57:09,252][52671] DAMAGECOUNT value on done: 17664.0 [2024-08-05 22:57:09,253][52671] Sum rewards: 10.275, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.370', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.270', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.092', 'weapon3': '1.430', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:09,771][52659] DAMAGECOUNT value on done: 17922.0 [2024-08-05 22:57:09,774][52659] Sum rewards: 9.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO3': '0.090', 'weapon5': '0.136', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.280', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.190', 'weapon3': '1.646', 'DAMAGECOUNT': '3.654', 'FRAGCOUNT': '7.000'} [2024-08-05 22:57:10,010][52794] DAMAGECOUNT value on done: 17362.0 [2024-08-05 22:57:10,012][52794] Sum rewards: 24.937, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.945', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.138', 'WEAPON4': '0.300', 'ARMOR': '0.479', 'weapon2': '1.102', 'WEAPON3': '1.150', 'HITCOUNT': '1.480', 'weapon3': '2.366', 'DAMAGECOUNT': '5.571', 'FRAGCOUNT': '24.000'} [2024-08-05 22:57:10,066][52658] DAMAGECOUNT value on done: 18406.0 [2024-08-05 22:57:10,071][52658] Sum rewards: 22.460, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.646', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO3': '0.053', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.398', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon5': '0.756', 'weapon2': '0.958', 'weapon3': '1.204', 'HITCOUNT': '1.260', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:11,103][52803] DAMAGECOUNT value on done: 14704.0 [2024-08-05 22:57:11,105][52803] Sum rewards: 11.746, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.975', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.072', 'WEAPON3': '0.500', 'HITCOUNT': '0.660', 'ARMOR': '0.911', 'weapon3': '1.124', 'weapon2': '1.240', 'DAMAGECOUNT': '2.694', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:11,244][52664] DAMAGECOUNT value on done: 16152.0 [2024-08-05 22:57:11,246][52664] Sum rewards: 23.737, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.396', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.196', 'ARMOR': '0.461', 'WEAPON3': '0.800', 'weapon2': '1.138', 'HITCOUNT': '1.610', 'weapon3': '1.716', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '19.000'} [2024-08-05 22:57:11,385][52811] DAMAGECOUNT value on done: 17118.0 [2024-08-05 22:57:11,385][52811] Sum rewards: 11.271, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.503', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'weapon4': '0.138', 'WEAPON3': '0.600', 'HITCOUNT': '0.790', 'ARMOR': '1.271', 'weapon3': '1.452', 'weapon2': '1.600', 'DAMAGECOUNT': '3.036', 'FRAGCOUNT': '8.000'} [2024-08-05 22:57:11,639][52662] DAMAGECOUNT value on done: 21764.0 [2024-08-05 22:57:11,639][52662] Sum rewards: 13.055, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.021', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '0.650', 'weapon4': '0.980', 'ARMOR': '1.012', 'HITCOUNT': '1.080', 'weapon3': '1.642', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:11,743][52649] DAMAGECOUNT value on done: 17503.0 [2024-08-05 22:57:11,744][52649] Sum rewards: 15.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.571', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.008', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'weapon5': '0.122', 'WEAPON3': '0.800', 'ARMOR': '0.876', 'HITCOUNT': '1.140', 'weapon2': '1.406', 'weapon3': '1.982', 'DAMAGECOUNT': '4.323', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:11,899][52650] Updated weights for policy 0, policy_version 11361 (0.0024) [2024-08-05 22:57:12,011][52671] DAMAGECOUNT value on done: 19905.0 [2024-08-05 22:57:12,012][52671] Sum rewards: 14.289, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.022', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.074', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.330', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.180', 'HITCOUNT': '1.470', 'weapon3': '1.850', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:12,492][52659] DAMAGECOUNT value on done: 18732.0 [2024-08-05 22:57:12,494][52659] Sum rewards: 25.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.636', 'AMMO2': '0.002', 'weapon4': '0.004', 'AMMO4': '0.010', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'HITCOUNT': '1.740', 'weapon2': '1.892', 'weapon3': '1.908', 'DAMAGECOUNT': '6.876', 'FRAGCOUNT': '20.000'} [2024-08-05 22:57:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 93077504. Throughput: 0: 4160.4. Samples: 23278750. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:57:12,795][52567] Avg episode reward: [(0, '15.022')] [2024-08-05 22:57:12,795][52614] Saving new best policy, reward=15.022! [2024-08-05 22:57:12,800][52794] DAMAGECOUNT value on done: 21206.0 [2024-08-05 22:57:12,802][52794] Sum rewards: 17.668, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.112', 'HEALTH': '0.454', 'WEAPON3': '0.550', 'ARMOR': '0.900', 'HITCOUNT': '1.050', 'weapon2': '1.576', 'weapon3': '1.748', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:13,144][52658] DAMAGECOUNT value on done: 17150.0 [2024-08-05 22:57:13,144][52658] Sum rewards: 18.217, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.012', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon7': '0.066', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'HEALTH': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '1.230', 'weapon3': '1.538', 'weapon2': '1.554', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:14,418][52662] DAMAGECOUNT value on done: 22296.0 [2024-08-05 22:57:14,418][52662] Sum rewards: 12.816, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.090', 'HEALTH': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.408', 'WEAPON3': '0.550', 'ARMOR': '0.970', 'HITCOUNT': '0.970', 'weapon2': '1.018', 'weapon3': '1.686', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:14,525][52664] DAMAGECOUNT value on done: 17047.0 [2024-08-05 22:57:14,527][52664] Sum rewards: 17.783, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.205', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'WEAPON3': '0.550', 'HITCOUNT': '1.250', 'weapon2': '1.376', 'weapon3': '1.452', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:14,559][52803] DAMAGECOUNT value on done: 16055.0 [2024-08-05 22:57:14,560][52803] Sum rewards: 5.383, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.112', 'weapon4': '0.316', 'ARMOR': '0.536', 'HITCOUNT': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.792', 'weapon3': '1.084', 'DAMAGECOUNT': '2.040', 'FRAGCOUNT': '5.000'} [2024-08-05 22:57:14,618][52811] DAMAGECOUNT value on done: 14063.0 [2024-08-05 22:57:14,622][52811] Sum rewards: 12.179, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.908', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.081', 'WEAPON4': '0.150', 'ARMOR': '0.461', 'WEAPON3': '0.700', 'HITCOUNT': '1.340', 'weapon2': '1.746', 'weapon3': '1.888', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:14,875][52649] DAMAGECOUNT value on done: 16973.0 [2024-08-05 22:57:14,876][52649] Sum rewards: 15.777, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.663', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon4': '0.002', 'WEAPON4': '0.050', 'weapon7': '0.074', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.834', 'HITCOUNT': '1.380', 'weapon2': '1.546', 'weapon3': '1.686', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:15,344][52671] DAMAGECOUNT value on done: 17315.0 [2024-08-05 22:57:15,344][52671] Sum rewards: 14.536, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.865', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.036', 'AMMO4': '0.081', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON3': '0.950', 'HITCOUNT': '1.080', 'weapon2': '1.162', 'weapon3': '1.938', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:15,499][52794] DAMAGECOUNT value on done: 20825.0 [2024-08-05 22:57:15,499][52794] Sum rewards: 18.342, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.429', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.507', 'WEAPON3': '1.050', 'weapon2': '1.428', 'HITCOUNT': '1.580', 'weapon3': '2.022', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '17.000'} [2024-08-05 22:57:15,924][52659] DAMAGECOUNT value on done: 15834.0 [2024-08-05 22:57:15,926][52659] Sum rewards: 8.387, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.088', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'ARMOR': '0.499', 'WEAPON3': '0.950', 'HITCOUNT': '1.010', 'weapon2': '1.302', 'weapon3': '1.924', 'DAMAGECOUNT': '4.008', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:16,403][52658] DAMAGECOUNT value on done: 19958.0 [2024-08-05 22:57:16,403][52658] Sum rewards: 13.826, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.494', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.012', 'ARMOR': '0.044', 'AMMO4': '0.058', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON3': '1.050', 'weapon2': '1.162', 'HITCOUNT': '1.420', 'weapon3': '2.392', 'DAMAGECOUNT': '4.998', 'FRAGCOUNT': '12.500'} [2024-08-05 22:57:16,863][52662] DAMAGECOUNT value on done: 20619.0 [2024-08-05 22:57:16,863][52662] Sum rewards: 21.403, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.334', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon4': '0.192', 'WEAPON3': '1.150', 'weapon2': '1.460', 'HITCOUNT': '1.810', 'weapon3': '2.052', 'DAMAGECOUNT': '6.594', 'FRAGCOUNT': '20.000'} [2024-08-05 22:57:17,078][52650] Updated weights for policy 0, policy_version 11371 (0.0019) [2024-08-05 22:57:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 93167616. Throughput: 0: 4159.8. Samples: 23290890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 22:57:17,794][52567] Avg episode reward: [(0, '15.046')] [2024-08-05 22:57:17,797][52614] Saving new best policy, reward=15.046! [2024-08-05 22:57:17,820][52664] DAMAGECOUNT value on done: 17299.0 [2024-08-05 22:57:17,824][52664] Sum rewards: 10.320, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.574', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.264', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '0.914', 'weapon2': '1.416', 'weapon3': '1.668', 'DAMAGECOUNT': '2.850', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:17,909][52803] DAMAGECOUNT value on done: 14810.0 [2024-08-05 22:57:17,909][52803] Sum rewards: 10.153, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.380', 'AMMO2': '0.015', 'AMMO3': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'HITCOUNT': '0.660', 'weapon4': '0.690', 'weapon2': '0.892', 'weapon3': '1.228', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '7.000'} [2024-08-05 22:57:17,914][52794] DAMAGECOUNT value on done: 20598.0 [2024-08-05 22:57:17,914][52794] Sum rewards: 20.871, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.446', 'WEAPON3': '0.500', 'HEALTH': '0.510', 'ARMOR': '0.520', 'weapon2': '1.208', 'HITCOUNT': '1.460', 'weapon3': '1.722', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:17,923][52811] DAMAGECOUNT value on done: 15447.0 [2024-08-05 22:57:17,925][52811] Sum rewards: 7.559, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.210', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'ARMOR': '0.545', 'weapon4': '0.678', 'weapon2': '0.680', 'HITCOUNT': '0.940', 'WEAPON3': '1.050', 'weapon3': '2.060', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:18,409][52649] DAMAGECOUNT value on done: 19326.0 [2024-08-05 22:57:18,410][52649] Sum rewards: 12.902, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.922', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.163', 'weapon4': '0.246', 'WEAPON3': '0.950', 'HITCOUNT': '1.150', 'weapon2': '1.288', 'weapon3': '2.170', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:18,433][52671] DAMAGECOUNT value on done: 18092.0 [2024-08-05 22:57:18,433][52671] Sum rewards: 20.206, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.628', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'weapon2': '1.430', 'HITCOUNT': '1.470', 'weapon3': '1.532', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:18,891][52659] DAMAGECOUNT value on done: 17201.0 [2024-08-05 22:57:18,892][52659] Sum rewards: 18.377, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.048', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.276', 'WEAPON3': '0.450', 'HITCOUNT': '1.040', 'weapon3': '1.286', 'ARMOR': '1.436', 'weapon2': '1.498', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:19,730][52658] DAMAGECOUNT value on done: 18707.0 [2024-08-05 22:57:19,733][52658] Sum rewards: 17.118, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.336', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO3': '0.089', 'weapon5': '0.098', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'weapon2': '0.712', 'weapon4': '0.806', 'HITCOUNT': '1.270', 'weapon3': '1.578', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:19,793][52662] DAMAGECOUNT value on done: 20982.0 [2024-08-05 22:57:19,794][52662] Sum rewards: 20.285, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.106', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.218', 'WEAPON3': '0.600', 'ARMOR': '0.871', 'weapon2': '1.466', 'HITCOUNT': '1.500', 'weapon3': '1.640', 'DAMAGECOUNT': '5.091', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:20,202][52795] DAMAGECOUNT value on done: 14902.0 [2024-08-05 22:57:20,204][52795] Sum rewards: 13.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.768', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.042', 'AMMO3': '0.146', 'weapon5': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.300', 'ARMOR': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.124', 'HITCOUNT': '1.340', 'weapon3': '1.882', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:20,794][52794] DAMAGECOUNT value on done: 20949.0 [2024-08-05 22:57:20,794][52794] Sum rewards: 14.432, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.007', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.092', 'WEAPON3': '0.650', 'ARMOR': '0.816', 'HITCOUNT': '1.170', 'weapon3': '1.512', 'weapon2': '1.572', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:21,197][52811] DAMAGECOUNT value on done: 17194.0 [2024-08-05 22:57:21,197][52811] Sum rewards: 12.891, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.595', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.300', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'weapon4': '0.720', 'HITCOUNT': '0.850', 'weapon2': '0.898', 'weapon3': '1.800', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:21,381][52803] DAMAGECOUNT value on done: 16314.0 [2024-08-05 22:57:21,382][52803] Sum rewards: 22.841, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.266', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'weapon4': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.853', 'HITCOUNT': '1.500', 'weapon3': '1.712', 'weapon2': '1.736', 'DAMAGECOUNT': '5.751', 'FRAGCOUNT': '19.000'} [2024-08-05 22:57:21,557][52650] Updated weights for policy 0, policy_version 11381 (0.0013) [2024-08-05 22:57:21,585][52649] DAMAGECOUNT value on done: 16691.0 [2024-08-05 22:57:21,586][52649] Sum rewards: 16.001, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.036', 'AMMO3': '0.085', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.500', 'HEALTH': '0.691', 'weapon2': '1.148', 'HITCOUNT': '1.210', 'weapon3': '1.690', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:21,629][52671] DAMAGECOUNT value on done: 19378.0 [2024-08-05 22:57:21,629][52671] Sum rewards: 16.827, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.090', 'AMMO4': '-0.087', 'AMMO2': '-0.017', 'AMMO3': '0.072', 'WEAPON3': '0.600', 'HITCOUNT': '0.960', 'ARMOR': '1.352', 'weapon3': '1.380', 'weapon2': '1.620', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:22,100][52659] DAMAGECOUNT value on done: 18825.0 [2024-08-05 22:57:22,102][52659] Sum rewards: 14.524, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.076', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO3': '0.119', 'WEAPON3': '0.750', 'HITCOUNT': '0.870', 'ARMOR': '0.908', 'weapon2': '1.470', 'weapon3': '1.592', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:22,230][52658] DAMAGECOUNT value on done: 17746.0 [2024-08-05 22:57:22,232][52658] Sum rewards: 14.495, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.252', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.422', 'WEAPON3': '0.750', 'ARMOR': '0.866', 'weapon2': '0.990', 'HITCOUNT': '1.200', 'weapon3': '2.118', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:22,384][52662] DAMAGECOUNT value on done: 20003.0 [2024-08-05 22:57:22,384][52662] Sum rewards: 7.831, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.772', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'ARMOR': '0.420', 'HITCOUNT': '0.740', 'WEAPON3': '0.800', 'weapon2': '1.456', 'weapon3': '1.762', 'DAMAGECOUNT': '2.682', 'FRAGCOUNT': '8.000'} [2024-08-05 22:57:22,804][52567] Fps is (10 sec: 16368.1, 60 sec: 16517.9, 300 sec: 16716.7). Total num frames: 93241344. Throughput: 0: 4147.1. Samples: 23315550. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:57:22,804][52567] Avg episode reward: [(0, '15.111')] [2024-08-05 22:57:22,877][52614] Saving new best policy, reward=15.111! [2024-08-05 22:57:23,552][52794] DAMAGECOUNT value on done: 20411.0 [2024-08-05 22:57:23,553][52794] Sum rewards: 13.940, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.080', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.064', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '0.930', 'weapon3': '1.222', 'weapon2': '1.488', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:23,573][52795] DAMAGECOUNT value on done: 13933.0 [2024-08-05 22:57:23,574][52795] Sum rewards: 3.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.716', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.114', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'weapon4': '0.474', 'WEAPON3': '0.700', 'HITCOUNT': '0.790', 'weapon2': '1.228', 'weapon3': '1.584', 'DAMAGECOUNT': '2.229', 'FRAGCOUNT': '4.000'} [2024-08-05 22:57:24,421][52649] DAMAGECOUNT value on done: 16092.0 [2024-08-05 22:57:24,421][52649] Sum rewards: 17.876, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.162', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'ARMOR': '0.491', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon2': '1.510', 'weapon3': '2.024', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:24,662][52811] DAMAGECOUNT value on done: 18099.0 [2024-08-05 22:57:24,664][52811] Sum rewards: 12.751, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.446', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.130', 'weapon3': '1.712', 'weapon2': '1.796', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:24,844][52803] DAMAGECOUNT value on done: 16792.0 [2024-08-05 22:57:24,845][52803] Sum rewards: 8.850, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.330', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'weapon4': '0.472', 'WEAPON3': '0.650', 'ARMOR': '0.905', 'HITCOUNT': '1.060', 'weapon2': '1.250', 'weapon3': '1.596', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '5.000'} [2024-08-05 22:57:25,015][52662] DAMAGECOUNT value on done: 19130.0 [2024-08-05 22:57:25,016][52662] Sum rewards: 16.898, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.018', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.340', 'WEAPON3': '0.800', 'ARMOR': '0.933', 'weapon2': '1.278', 'HITCOUNT': '1.380', 'weapon3': '1.978', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:25,389][52671] DAMAGECOUNT value on done: 16163.0 [2024-08-05 22:57:25,391][52671] Sum rewards: 16.434, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'WEAPON3': '1.050', 'weapon2': '1.436', 'HITCOUNT': '1.550', 'weapon3': '2.194', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:25,479][52658] DAMAGECOUNT value on done: 16141.0 [2024-08-05 22:57:25,480][52658] Sum rewards: 9.506, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.039', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.854', 'HITCOUNT': '1.000', 'weapon2': '1.502', 'weapon3': '1.832', 'DAMAGECOUNT': '3.390', 'FRAGCOUNT': '8.000'} [2024-08-05 22:57:25,758][52659] DAMAGECOUNT value on done: 16891.0 [2024-08-05 22:57:25,758][52659] Sum rewards: 12.626, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.136', 'AMMO2': '0.012', 'weapon4': '0.020', 'AMMO4': '0.058', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'ARMOR': '1.281', 'weapon3': '1.458', 'weapon2': '1.708', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:26,029][52794] DAMAGECOUNT value on done: 21809.0 [2024-08-05 22:57:26,029][52794] Sum rewards: 18.326, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.576', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon4': '0.160', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'ARMOR': '1.309', 'HITCOUNT': '1.320', 'weapon2': '1.674', 'weapon3': '1.800', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:26,752][52650] Updated weights for policy 0, policy_version 11391 (0.0013) [2024-08-05 22:57:26,910][52795] DAMAGECOUNT value on done: 15288.0 [2024-08-05 22:57:26,913][52795] Sum rewards: 16.392, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.808', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'ARMOR': '0.472', 'WEAPON3': '0.900', 'HITCOUNT': '1.110', 'weapon2': '1.330', 'weapon3': '1.942', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:27,218][52649] DAMAGECOUNT value on done: 18189.0 [2024-08-05 22:57:27,221][52649] Sum rewards: 11.120, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.306', 'HEALTH': '0.358', 'WEAPON3': '0.500', 'ARMOR': '0.520', 'HITCOUNT': '1.230', 'weapon2': '1.410', 'weapon3': '1.550', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '7.000'} [2024-08-05 22:57:27,561][52662] DAMAGECOUNT value on done: 21519.0 [2024-08-05 22:57:27,561][52662] Sum rewards: 22.646, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.674', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.402', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '1.350', 'weapon3': '1.592', 'weapon2': '1.620', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '17.000'} [2024-08-05 22:57:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 93331456. Throughput: 0: 4146.0. Samples: 23340690. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:57:27,794][52567] Avg episode reward: [(0, '15.268')] [2024-08-05 22:57:27,886][52614] Saving new best policy, reward=15.268! [2024-08-05 22:57:27,946][52811] DAMAGECOUNT value on done: 15366.0 [2024-08-05 22:57:27,947][52811] Sum rewards: 15.589, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.824', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.310', 'ARMOR': '0.448', 'WEAPON3': '0.500', 'HITCOUNT': '0.890', 'weapon3': '1.294', 'weapon2': '1.502', 'DAMAGECOUNT': '3.075', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:27,968][52803] DAMAGECOUNT value on done: 14902.0 [2024-08-05 22:57:27,972][52803] Sum rewards: 11.751, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.914', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.026', 'ARMOR': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.262', 'WEAPON3': '0.850', 'weapon2': '1.000', 'HITCOUNT': '1.010', 'weapon3': '2.058', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:28,074][52671] DAMAGECOUNT value on done: 15600.0 [2024-08-05 22:57:28,074][52671] Sum rewards: 12.635, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.200', 'AMMO2': '0.059', 'AMMO3': '0.092', 'AMMO4': '0.295', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'ARMOR': '0.572', 'weapon2': '0.694', 'weapon4': '0.824', 'HITCOUNT': '0.940', 'weapon3': '1.650', 'DAMAGECOUNT': '2.958', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:28,572][52794] DAMAGECOUNT value on done: 19721.0 [2024-08-05 22:57:28,575][52794] Sum rewards: 23.020, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.583', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO3': '0.131', 'WEAPON3': '0.950', 'weapon2': '1.492', 'HITCOUNT': '1.650', 'weapon3': '1.972', 'DAMAGECOUNT': '5.976', 'FRAGCOUNT': '20.000'} [2024-08-05 22:57:28,702][52659] DAMAGECOUNT value on done: 17012.0 [2024-08-05 22:57:28,706][52659] Sum rewards: 19.147, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.827', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.033', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'weapon4': '0.380', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'weapon2': '1.014', 'HITCOUNT': '1.210', 'weapon3': '2.104', 'DAMAGECOUNT': '4.983', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:29,061][52658] DAMAGECOUNT value on done: 17607.0 [2024-08-05 22:57:29,062][52658] Sum rewards: 3.424, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'HITCOUNT': '0.450', 'weapon4': '0.684', 'WEAPON3': '0.750', 'weapon2': '0.978', 'ARMOR': '1.286', 'DAMAGECOUNT': '1.590', 'weapon3': '1.594', 'FRAGCOUNT': '5.000'} [2024-08-05 22:57:29,904][52649] DAMAGECOUNT value on done: 15229.0 [2024-08-05 22:57:29,906][52649] Sum rewards: 5.164, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.363', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.084', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.730', 'ARMOR': '0.855', 'weapon3': '1.168', 'weapon2': '1.538', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '4.000'} [2024-08-05 22:57:30,100][52662] DAMAGECOUNT value on done: 20636.0 [2024-08-05 22:57:30,102][52662] Sum rewards: 20.082, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.462', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'weapon4': '0.226', 'WEAPON3': '0.600', 'weapon3': '1.156', 'HITCOUNT': '1.300', 'weapon2': '1.498', 'DAMAGECOUNT': '4.722', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:30,351][52795] DAMAGECOUNT value on done: 16320.0 [2024-08-05 22:57:30,353][52795] Sum rewards: 18.651, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.918', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.003', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.474', 'WEAPON3': '0.750', 'HITCOUNT': '1.070', 'weapon2': '1.322', 'ARMOR': '1.329', 'weapon3': '1.412', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:30,956][52794] DAMAGECOUNT value on done: 21327.0 [2024-08-05 22:57:30,957][52794] Sum rewards: 23.283, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.250', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO3': '0.080', 'weapon5': '0.094', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'weapon2': '1.546', 'HITCOUNT': '1.570', 'weapon3': '1.764', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '19.000'} [2024-08-05 22:57:31,197][52811] DAMAGECOUNT value on done: 16067.0 [2024-08-05 22:57:31,199][52811] Sum rewards: 22.077, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.775', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.131', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.054', 'HITCOUNT': '1.440', 'weapon3': '2.142', 'DAMAGECOUNT': '5.667', 'FRAGCOUNT': '19.000'} [2024-08-05 22:57:31,214][52671] DAMAGECOUNT value on done: 17887.0 [2024-08-05 22:57:31,214][52671] Sum rewards: 11.565, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.742', 'AMMO2': '0.029', 'AMMO3': '0.135', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'weapon4': '0.590', 'weapon2': '0.822', 'WEAPON3': '0.850', 'ARMOR': '0.864', 'HITCOUNT': '0.940', 'weapon3': '2.022', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:31,272][52803] DAMAGECOUNT value on done: 15930.0 [2024-08-05 22:57:31,274][52803] Sum rewards: 13.183, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.897', 'AMMO2': '0.020', 'AMMO5': '0.022', 'AMMO4': '0.099', 'weapon5': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.280', 'ARMOR': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '0.960', 'weapon2': '1.138', 'weapon3': '1.752', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:31,479][52650] Updated weights for policy 0, policy_version 11401 (0.0022) [2024-08-05 22:57:31,712][52659] DAMAGECOUNT value on done: 16088.0 [2024-08-05 22:57:31,713][52659] Sum rewards: 10.249, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.174', 'AMMO2': '0.016', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.095', 'weapon4': '0.422', 'WEAPON3': '0.700', 'HITCOUNT': '0.780', 'weapon2': '1.116', 'weapon3': '1.574', 'DAMAGECOUNT': '2.811', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:32,510][52662] DAMAGECOUNT value on done: 21479.0 [2024-08-05 22:57:32,511][52662] Sum rewards: 22.231, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.368', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.074', 'ARMOR': '0.454', 'WEAPON3': '0.550', 'HITCOUNT': '1.500', 'weapon3': '1.550', 'weapon2': '1.922', 'DAMAGECOUNT': '6.060', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:32,764][52649] DAMAGECOUNT value on done: 18646.0 [2024-08-05 22:57:32,766][52649] Sum rewards: 12.763, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.704', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.113', 'AMMO3': '0.158', 'WEAPON4': '0.300', 'ARMOR': '0.912', 'WEAPON3': '1.100', 'HITCOUNT': '1.170', 'weapon2': '1.404', 'weapon3': '2.156', 'DAMAGECOUNT': '4.071', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:32,795][52567] Fps is (10 sec: 16399.5, 60 sec: 16520.4, 300 sec: 16689.4). Total num frames: 93405184. Throughput: 0: 4143.3. Samples: 23352950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 22:57:32,795][52567] Avg episode reward: [(0, '15.024')] [2024-08-05 22:57:33,297][52794] DAMAGECOUNT value on done: 21694.0 [2024-08-05 22:57:33,297][52794] Sum rewards: 5.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.575', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.018', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'HITCOUNT': '0.780', 'ARMOR': '0.884', 'WEAPON3': '0.950', 'weapon2': '1.528', 'weapon3': '1.652', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '8.000'} [2024-08-05 22:57:33,742][52795] DAMAGECOUNT value on done: 19618.0 [2024-08-05 22:57:33,743][52795] Sum rewards: 16.821, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.468', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.086', 'weapon4': '0.186', 'WEAPON3': '0.600', 'HITCOUNT': '1.280', 'ARMOR': '1.312', 'weapon2': '1.356', 'weapon3': '1.736', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:34,293][52671] DAMAGECOUNT value on done: 16902.0 [2024-08-05 22:57:34,293][52671] Sum rewards: 8.516, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.316', 'AMMO2': '0.049', 'weapon4': '0.080', 'AMMO3': '0.103', 'AMMO4': '0.243', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '0.800', 'ARMOR': '0.832', 'weapon2': '1.148', 'weapon3': '1.698', 'DAMAGECOUNT': '3.129', 'FRAGCOUNT': '8.000'} [2024-08-05 22:57:34,432][52803] DAMAGECOUNT value on done: 16786.0 [2024-08-05 22:57:34,432][52803] Sum rewards: 21.488, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.336', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'HITCOUNT': '1.280', 'weapon3': '1.388', 'weapon2': '1.670', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '17.000'} [2024-08-05 22:57:34,610][52659] DAMAGECOUNT value on done: 17325.0 [2024-08-05 22:57:34,612][52659] Sum rewards: 11.006, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.632', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON3': '0.450', 'ARMOR': '0.473', 'weapon2': '0.770', 'HITCOUNT': '0.800', 'weapon3': '0.966', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '8.000'} [2024-08-05 22:57:34,626][52811] DAMAGECOUNT value on done: 15866.0 [2024-08-05 22:57:34,626][52811] Sum rewards: 17.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.400', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'weapon4': '0.508', 'WEAPON3': '0.750', 'ARMOR': '0.887', 'weapon2': '1.092', 'HITCOUNT': '1.250', 'weapon3': '2.190', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:35,308][52662] DAMAGECOUNT value on done: 22189.0 [2024-08-05 22:57:35,308][52662] Sum rewards: 10.700, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.328', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.062', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.960', 'ARMOR': '1.243', 'weapon3': '1.438', 'weapon2': '1.510', 'DAMAGECOUNT': '2.880', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:36,137][52649] DAMAGECOUNT value on done: 17503.0 [2024-08-05 22:57:36,138][52649] Sum rewards: 15.666, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.572', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.102', 'AMMO3': '0.143', 'WEAPON4': '0.250', 'ARMOR': '0.533', 'WEAPON3': '1.000', 'weapon2': '1.278', 'HITCOUNT': '1.370', 'weapon3': '2.150', 'DAMAGECOUNT': '4.611', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:36,192][52794] DAMAGECOUNT value on done: 20208.0 [2024-08-05 22:57:36,192][52794] Sum rewards: 14.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.953', 'AMMO5': '0.020', 'AMMO2': '0.053', 'ARMOR': '0.072', 'AMMO3': '0.126', 'AMMO4': '0.264', 'weapon5': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.050', 'HITCOUNT': '1.240', 'weapon3': '1.858', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:36,551][52650] Updated weights for policy 0, policy_version 11411 (0.0023) [2024-08-05 22:57:36,969][52671] DAMAGECOUNT value on done: 18905.0 [2024-08-05 22:57:36,969][52671] Sum rewards: 13.587, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO3': '0.091', 'ARMOR': '0.449', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon3': '1.408', 'weapon2': '1.436', 'DAMAGECOUNT': '3.573', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:37,062][52795] DAMAGECOUNT value on done: 18624.0 [2024-08-05 22:57:37,064][52795] Sum rewards: 20.793, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.080', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON3': '0.450', 'HEALTH': '0.576', 'ARMOR': '0.828', 'HITCOUNT': '1.060', 'weapon3': '1.320', 'weapon2': '1.534', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:37,323][52659] DAMAGECOUNT value on done: 18611.0 [2024-08-05 22:57:37,323][52659] Sum rewards: 11.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'HITCOUNT': '1.000', 'weapon2': '1.264', 'weapon3': '2.204', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:37,720][52803] DAMAGECOUNT value on done: 15183.0 [2024-08-05 22:57:37,724][52803] Sum rewards: 10.564, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.750', 'ARMOR': '0.846', 'weapon2': '1.048', 'HITCOUNT': '1.080', 'weapon3': '1.742', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 16772.8). Total num frames: 93503488. Throughput: 0: 4147.6. Samples: 23378180. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 22:57:37,794][52567] Avg episode reward: [(0, '14.782')] [2024-08-05 22:57:37,907][52811] DAMAGECOUNT value on done: 17372.0 [2024-08-05 22:57:37,907][52811] Sum rewards: 15.550, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.866', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'ARMOR': '0.048', 'AMMO4': '0.055', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.286', 'HITCOUNT': '1.390', 'weapon3': '1.468', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:38,326][52662] DAMAGECOUNT value on done: 19874.0 [2024-08-05 22:57:38,334][52662] Sum rewards: 13.877, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.228', 'HEALTH': '0.326', 'WEAPON3': '0.500', 'ARMOR': '0.960', 'HITCOUNT': '1.050', 'weapon2': '1.372', 'weapon3': '1.424', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:39,117][52649] DAMAGECOUNT value on done: 18544.0 [2024-08-05 22:57:39,118][52649] Sum rewards: 13.291, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.650', 'AMMO2': '0.009', 'weapon4': '0.010', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'ARMOR': '0.877', 'WEAPON3': '0.900', 'HITCOUNT': '0.930', 'weapon2': '1.486', 'weapon3': '1.998', 'DAMAGECOUNT': '3.219', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:39,189][52794] DAMAGECOUNT value on done: 19695.0 [2024-08-05 22:57:39,190][52794] Sum rewards: 18.935, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.203', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.156', 'weapon4': '0.206', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '1.160', 'weapon2': '1.374', 'weapon3': '1.596', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:39,737][52671] DAMAGECOUNT value on done: 15208.0 [2024-08-05 22:57:39,740][52671] Sum rewards: 10.838, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.332', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.124', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.624', 'weapon2': '0.860', 'ARMOR': '0.907', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon3': '2.076', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '9.500'} [2024-08-05 22:57:40,104][52659] DAMAGECOUNT value on done: 19816.0 [2024-08-05 22:57:40,104][52659] Sum rewards: 14.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.743', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'AMMO3': '0.122', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'ARMOR': '1.267', 'weapon2': '1.598', 'weapon3': '1.716', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:40,537][52795] DAMAGECOUNT value on done: 19049.0 [2024-08-05 22:57:40,537][52795] Sum rewards: 26.404, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.306', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'ARMOR': '0.028', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.506', 'WEAPON3': '0.950', 'weapon2': '0.964', 'weapon3': '2.162', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '7.482', 'FRAGCOUNT': '21.000'} [2024-08-05 22:57:41,016][52662] DAMAGECOUNT value on done: 21316.0 [2024-08-05 22:57:41,018][52662] Sum rewards: 12.120, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'HITCOUNT': '1.210', 'weapon2': '1.646', 'weapon3': '1.700', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:41,049][52803] DAMAGECOUNT value on done: 14846.0 [2024-08-05 22:57:41,053][52803] Sum rewards: 12.305, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.960', 'weapon4': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.022', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'ARMOR': '1.292', 'weapon3': '1.602', 'weapon2': '1.782', 'DAMAGECOUNT': '3.099', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:41,156][52811] DAMAGECOUNT value on done: 15294.0 [2024-08-05 22:57:41,158][52811] Sum rewards: 15.979, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.493', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'AMMO4': '0.094', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '0.650', 'ARMOR': '0.898', 'HITCOUNT': '1.340', 'weapon2': '1.416', 'weapon3': '1.940', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:41,458][52650] Updated weights for policy 0, policy_version 11421 (0.0036) [2024-08-05 22:57:42,114][52794] DAMAGECOUNT value on done: 20452.0 [2024-08-05 22:57:42,115][52794] Sum rewards: 24.302, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.142', 'WEAPON5': '0.150', 'HEALTH': '0.166', 'WEAPON3': '0.700', 'ARMOR': '0.843', 'weapon2': '1.162', 'HITCOUNT': '1.630', 'weapon3': '1.982', 'DAMAGECOUNT': '6.414', 'FRAGCOUNT': '19.000'} [2024-08-05 22:57:42,542][52671] DAMAGECOUNT value on done: 18429.0 [2024-08-05 22:57:42,545][52671] Sum rewards: 11.126, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.291', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO3': '0.070', 'WEAPON4': '0.200', 'weapon4': '0.534', 'WEAPON3': '0.550', 'HITCOUNT': '0.860', 'weapon3': '1.242', 'weapon2': '1.252', 'ARMOR': '1.327', 'DAMAGECOUNT': '2.955', 'FRAGCOUNT': '8.000'} [2024-08-05 22:57:42,766][52659] DAMAGECOUNT value on done: 15743.0 [2024-08-05 22:57:42,766][52659] Sum rewards: 12.002, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON3': '0.450', 'ARMOR': '0.471', 'HITCOUNT': '0.920', 'weapon3': '1.124', 'weapon2': '1.554', 'DAMAGECOUNT': '3.144', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:42,794][52567] Fps is (10 sec: 17203.9, 60 sec: 16657.1, 300 sec: 16717.2). Total num frames: 93577216. Throughput: 0: 4149.4. Samples: 23403280. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-05 22:57:42,794][52567] Avg episode reward: [(0, '14.949')] [2024-08-05 22:57:43,859][52795] DAMAGECOUNT value on done: 16594.0 [2024-08-05 22:57:43,859][52795] Sum rewards: 14.598, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.658', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.036', 'AMMO4': '0.094', 'weapon5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.700', 'weapon2': '1.130', 'HITCOUNT': '1.260', 'weapon3': '1.872', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:43,961][52662] DAMAGECOUNT value on done: 19490.0 [2024-08-05 22:57:43,961][52662] Sum rewards: 9.584, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.020', 'ARMOR': '0.064', 'AMMO3': '0.086', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'HEALTH': '0.234', 'WEAPON3': '0.550', 'weapon4': '0.730', 'HITCOUNT': '0.760', 'weapon2': '0.922', 'weapon3': '1.474', 'DAMAGECOUNT': '2.697', 'FRAGCOUNT': '7.000'} [2024-08-05 22:57:44,306][52803] DAMAGECOUNT value on done: 16616.0 [2024-08-05 22:57:44,312][52803] Sum rewards: 24.371, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.462', 'AMMO4': '-0.090', 'AMMO2': '-0.018', 'AMMO3': '0.094', 'WEAPON3': '0.700', 'ARMOR': '0.841', 'HITCOUNT': '1.650', 'weapon2': '1.660', 'weapon3': '1.756', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '19.000'} [2024-08-05 22:57:44,503][52811] DAMAGECOUNT value on done: 16352.0 [2024-08-05 22:57:44,504][52811] Sum rewards: 21.510, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.962', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.116', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.476', 'ARMOR': '0.516', 'WEAPON3': '0.750', 'weapon2': '1.020', 'HITCOUNT': '1.430', 'weapon3': '1.766', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '17.000'} [2024-08-05 22:57:46,007][52659] DAMAGECOUNT value on done: 17056.0 [2024-08-05 22:57:46,009][52659] Sum rewards: 7.405, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.400', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.650', 'HITCOUNT': '0.870', 'ARMOR': '0.904', 'weapon2': '1.084', 'weapon3': '1.502', 'DAMAGECOUNT': '2.805', 'FRAGCOUNT': '5.000'} [2024-08-05 22:57:46,525][52650] Updated weights for policy 0, policy_version 11431 (0.0033) [2024-08-05 22:57:46,551][52662] DAMAGECOUNT value on done: 21202.0 [2024-08-05 22:57:46,551][52662] Sum rewards: 17.933, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.493', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.260', 'WEAPON3': '0.550', 'ARMOR': '0.908', 'HITCOUNT': '1.300', 'weapon3': '1.352', 'weapon2': '1.402', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '12.000'} [2024-08-05 22:57:47,047][52795] DAMAGECOUNT value on done: 15797.0 [2024-08-05 22:57:47,048][52795] Sum rewards: 12.111, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.072', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'AMMO3': '0.105', 'weapon4': '0.330', 'WEAPON3': '0.750', 'ARMOR': '0.983', 'HITCOUNT': '1.090', 'weapon2': '1.166', 'weapon3': '2.036', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '10.000'} [2024-08-05 22:57:47,521][52803] DAMAGECOUNT value on done: 17139.0 [2024-08-05 22:57:47,521][52803] Sum rewards: 22.117, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'weapon4': '0.140', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.444', 'WEAPON3': '0.750', 'HEALTH': '1.340', 'weapon2': '1.438', 'HITCOUNT': '1.680', 'weapon3': '2.074', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '18.000'} [2024-08-05 22:57:47,680][52811] DAMAGECOUNT value on done: 16399.0 [2024-08-05 22:57:47,680][52811] Sum rewards: 11.675, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.625', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'ARMOR': '0.060', 'AMMO3': '0.104', 'weapon4': '0.286', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon3': '1.590', 'weapon2': '1.698', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:47,794][52567] Fps is (10 sec: 16383.5, 60 sec: 16657.0, 300 sec: 16772.8). Total num frames: 93667328. Throughput: 0: 4151.5. Samples: 23415830. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:57:47,795][52567] Avg episode reward: [(0, '14.975')] [2024-08-05 22:57:48,674][52659] DAMAGECOUNT value on done: 15452.0 [2024-08-05 22:57:48,675][52659] Sum rewards: 13.212, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.037', 'weapon4': '0.066', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'AMMO4': '0.187', 'WEAPON3': '0.500', 'HEALTH': '0.544', 'ARMOR': '0.812', 'HITCOUNT': '0.980', 'weapon3': '1.490', 'weapon2': '1.826', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '9.000'} [2024-08-05 22:57:50,331][52668] DAMAGECOUNT value on done: 17556.0 [2024-08-05 22:57:50,336][52668] Sum rewards: 30.802, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.595', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON3': '0.650', 'weapon2': '1.604', 'HITCOUNT': '1.650', 'weapon3': '1.680', 'DAMAGECOUNT': '6.657', 'FRAGCOUNT': '25.000'} [2024-08-05 22:57:50,429][52795] DAMAGECOUNT value on done: 18209.0 [2024-08-05 22:57:50,429][52795] Sum rewards: 18.686, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.120', 'weapon2': '1.458', 'ARMOR': '1.822', 'weapon3': '1.974', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:50,786][52650] Updated weights for policy 0, policy_version 11441 (0.0014) [2024-08-05 22:57:50,887][52803] DAMAGECOUNT value on done: 17525.0 [2024-08-05 22:57:50,890][52803] Sum rewards: 13.357, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.973', 'AMMO2': '0.021', 'AMMO3': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.240', 'weapon2': '1.674', 'weapon3': '1.702', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:50,941][52811] DAMAGECOUNT value on done: 15439.0 [2024-08-05 22:57:50,943][52811] Sum rewards: 14.887, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.979', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.054', 'AMMO3': '0.127', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.464', 'weapon4': '0.666', 'weapon2': '0.826', 'WEAPON3': '0.850', 'HITCOUNT': '1.250', 'weapon3': '2.054', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:51,727][52659] DAMAGECOUNT value on done: 18798.0 [2024-08-05 22:57:51,728][52659] Sum rewards: 13.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.204', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.108', 'WEAPON3': '0.700', 'ARMOR': '1.306', 'HITCOUNT': '1.350', 'weapon3': '1.608', 'weapon2': '1.784', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '11.000'} [2024-08-05 22:57:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16657.0, 300 sec: 16717.2). Total num frames: 93749248. Throughput: 0: 4168.2. Samples: 23441160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 22:57:52,795][52567] Avg episode reward: [(0, '14.984')] [2024-08-05 22:57:53,369][52668] DAMAGECOUNT value on done: 19056.0 [2024-08-05 22:57:53,370][52668] Sum rewards: 23.681, reward structure: {'DEATHCOUNT': '-6.750', 'weapon4': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'HEALTH': '0.758', 'ARMOR': '0.899', 'weapon2': '1.518', 'HITCOUNT': '1.580', 'weapon3': '1.818', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '17.000'} [2024-08-05 22:57:53,894][52795] DAMAGECOUNT value on done: 16062.0 [2024-08-05 22:57:53,895][52795] Sum rewards: 19.921, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.950', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.135', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '0.950', 'ARMOR': '0.970', 'weapon2': '1.110', 'HITCOUNT': '1.620', 'weapon3': '2.156', 'DAMAGECOUNT': '5.286', 'FRAGCOUNT': '17.500'} [2024-08-05 22:57:54,228][52811] DAMAGECOUNT value on done: 16401.0 [2024-08-05 22:57:54,230][52811] Sum rewards: 20.151, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.060', 'AMMO3': '0.109', 'weapon4': '0.196', 'ARMOR': '0.408', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'weapon2': '1.330', 'weapon3': '1.928', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '16.000'} [2024-08-05 22:57:56,193][52650] Updated weights for policy 0, policy_version 11451 (0.0032) [2024-08-05 22:57:56,650][52668] DAMAGECOUNT value on done: 16296.0 [2024-08-05 22:57:56,651][52668] Sum rewards: 16.048, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.768', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.066', 'weapon4': '0.080', 'AMMO3': '0.128', 'AMMO4': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'ARMOR': '1.200', 'weapon2': '1.736', 'weapon3': '1.758', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '13.000'} [2024-08-05 22:57:57,255][52795] DAMAGECOUNT value on done: 16244.0 [2024-08-05 22:57:57,255][52795] Sum rewards: 18.507, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.359', 'AMMO2': '0.031', 'AMMO3': '0.122', 'AMMO4': '0.152', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'weapon2': '1.320', 'HITCOUNT': '1.420', 'weapon3': '2.252', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '15.000'} [2024-08-05 22:57:57,794][52567] Fps is (10 sec: 16384.5, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 93831168. Throughput: 0: 4168.5. Samples: 23466330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 22:57:57,794][52567] Avg episode reward: [(0, '15.181')] [2024-08-05 22:57:57,895][52660] DAMAGECOUNT value on done: 18868.0 [2024-08-05 22:57:57,895][52660] Sum rewards: 16.367, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.495', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.274', 'WEAPON3': '0.850', 'HITCOUNT': '1.280', 'weapon2': '1.354', 'weapon3': '1.848', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '14.000'} [2024-08-05 22:57:58,965][52668] DAMAGECOUNT value on done: 17935.0 [2024-08-05 22:57:58,966][52668] Sum rewards: 14.026, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.886', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.036', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'ARMOR': '0.841', 'weapon2': '1.192', 'weapon3': '1.320', 'DAMAGECOUNT': '3.399', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:00,443][52660] DAMAGECOUNT value on done: 18432.0 [2024-08-05 22:58:00,445][52660] Sum rewards: 16.867, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.967', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.032', 'weapon5': '0.054', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.352', 'WEAPON3': '0.750', 'weapon2': '0.966', 'HITCOUNT': '1.420', 'weapon3': '1.858', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:00,573][52650] Updated weights for policy 0, policy_version 11461 (0.0012) [2024-08-05 22:58:00,608][52795] DAMAGECOUNT value on done: 18902.0 [2024-08-05 22:58:00,610][52795] Sum rewards: 18.326, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.171', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.092', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'ARMOR': '0.424', 'WEAPON3': '0.750', 'HITCOUNT': '1.160', 'weapon2': '1.328', 'weapon3': '1.832', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '16.000'} [2024-08-05 22:58:01,678][52668] DAMAGECOUNT value on done: 17462.0 [2024-08-05 22:58:01,679][52668] Sum rewards: 8.757, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.124', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.060', 'AMMO3': '0.074', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.540', 'WEAPON3': '0.550', 'weapon4': '0.672', 'HITCOUNT': '0.940', 'weapon2': '0.960', 'weapon3': '1.454', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '6.500'} [2024-08-05 22:58:02,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16657.1, 300 sec: 16717.2). Total num frames: 93913088. Throughput: 0: 4176.7. Samples: 23478840. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-05 22:58:02,794][52567] Avg episode reward: [(0, '15.300')] [2024-08-05 22:58:02,796][52614] Saving new best policy, reward=15.300! [2024-08-05 22:58:03,372][52660] DAMAGECOUNT value on done: 17198.0 [2024-08-05 22:58:03,374][52660] Sum rewards: 27.384, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.285', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'weapon2': '1.578', 'HITCOUNT': '1.670', 'weapon3': '2.106', 'DAMAGECOUNT': '6.603', 'FRAGCOUNT': '21.000'} [2024-08-05 22:58:03,927][52795] DAMAGECOUNT value on done: 17063.0 [2024-08-05 22:58:03,927][52795] Sum rewards: 16.526, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.716', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.094', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'ARMOR': '1.351', 'weapon2': '1.624', 'weapon3': '1.630', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:05,020][52668] DAMAGECOUNT value on done: 18676.0 [2024-08-05 22:58:05,021][52668] Sum rewards: 18.855, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.164', 'AMMO2': '0.025', 'ARMOR': '0.036', 'AMMO4': '0.127', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.950', 'weapon2': '0.992', 'HITCOUNT': '1.340', 'weapon3': '2.054', 'DAMAGECOUNT': '5.139', 'FRAGCOUNT': '17.000'} [2024-08-05 22:58:05,627][52650] Updated weights for policy 0, policy_version 11471 (0.0020) [2024-08-05 22:58:06,918][52660] DAMAGECOUNT value on done: 17454.0 [2024-08-05 22:58:06,919][52660] Sum rewards: 14.530, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.036', 'weapon7': '0.048', 'AMMO3': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.270', 'WEAPON3': '0.350', 'weapon2': '0.846', 'HITCOUNT': '0.880', 'weapon3': '1.098', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '10.000'} [2024-08-05 22:58:07,304][52795] DAMAGECOUNT value on done: 15986.0 [2024-08-05 22:58:07,304][52795] Sum rewards: 18.492, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.201', 'AMMO5': '0.005', 'ARMOR': '0.024', 'weapon5': '0.028', 'AMMO2': '0.036', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.356', 'WEAPON3': '0.650', 'weapon2': '1.100', 'HITCOUNT': '1.300', 'weapon3': '1.842', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16772.8). Total num frames: 94003200. Throughput: 0: 4191.4. Samples: 23504120. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-05 22:58:07,795][52567] Avg episode reward: [(0, '15.518')] [2024-08-05 22:58:07,798][52614] Saving new best policy, reward=15.518! [2024-08-05 22:58:08,137][52668] DAMAGECOUNT value on done: 19904.0 [2024-08-05 22:58:08,137][52668] Sum rewards: 18.182, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.688', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'ARMOR': '1.257', 'HITCOUNT': '1.420', 'weapon2': '1.742', 'weapon3': '1.882', 'DAMAGECOUNT': '5.124', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:09,804][52660] DAMAGECOUNT value on done: 14291.0 [2024-08-05 22:58:09,807][52660] Sum rewards: 13.553, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.496', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.126', 'weapon5': '0.128', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.866', 'HITCOUNT': '0.940', 'weapon3': '1.354', 'weapon2': '1.426', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:10,434][52650] Updated weights for policy 0, policy_version 11481 (0.0024) [2024-08-05 22:58:10,686][52795] DAMAGECOUNT value on done: 17491.0 [2024-08-05 22:58:10,686][52795] Sum rewards: 11.549, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.777', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.091', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon3': '1.402', 'weapon2': '1.738', 'DAMAGECOUNT': '3.282', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:11,372][52668] DAMAGECOUNT value on done: 18951.0 [2024-08-05 22:58:11,374][52668] Sum rewards: 21.039, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.637', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.202', 'ARMOR': '0.897', 'WEAPON3': '1.000', 'weapon2': '1.578', 'HITCOUNT': '1.600', 'weapon3': '1.900', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '20.000'} [2024-08-05 22:58:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16717.2). Total num frames: 94085120. Throughput: 0: 4188.0. Samples: 23529150. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-05 22:58:12,794][52567] Avg episode reward: [(0, '15.545')] [2024-08-05 22:58:12,795][52614] Saving new best policy, reward=15.545! [2024-08-05 22:58:12,922][52660] DAMAGECOUNT value on done: 18162.0 [2024-08-05 22:58:12,923][52660] Sum rewards: 20.123, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.522', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO3': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.140', 'WEAPON3': '0.350', 'weapon3': '0.952', 'HITCOUNT': '1.030', 'weapon2': '1.138', 'DAMAGECOUNT': '4.011', 'FRAGCOUNT': '15.000'} [2024-08-05 22:58:14,078][52795] DAMAGECOUNT value on done: 17578.0 [2024-08-05 22:58:14,079][52795] Sum rewards: 14.264, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.383', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon7': '0.066', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.386', 'WEAPON3': '0.650', 'ARMOR': '0.867', 'HITCOUNT': '1.120', 'weapon2': '1.424', 'weapon3': '1.508', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:14,134][52647] DAMAGECOUNT value on done: 20236.0 [2024-08-05 22:58:14,137][52647] Sum rewards: 19.228, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.096', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.404', 'weapon4': '0.444', 'WEAPON3': '0.650', 'weapon2': '1.222', 'HITCOUNT': '1.310', 'weapon3': '1.698', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '15.000'} [2024-08-05 22:58:14,164][52668] DAMAGECOUNT value on done: 16679.0 [2024-08-05 22:58:14,165][52668] Sum rewards: 21.794, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.184', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'weapon4': '0.446', 'weapon2': '0.758', 'WEAPON3': '0.900', 'HITCOUNT': '1.520', 'weapon3': '2.184', 'DAMAGECOUNT': '5.502', 'FRAGCOUNT': '18.000'} [2024-08-05 22:58:15,642][52660] DAMAGECOUNT value on done: 16572.0 [2024-08-05 22:58:15,643][52660] Sum rewards: 14.844, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.682', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon4': '0.238', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'weapon2': '1.260', 'HITCOUNT': '1.270', 'weapon3': '1.694', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:15,678][52650] Updated weights for policy 0, policy_version 11491 (0.0025) [2024-08-05 22:58:16,692][52668] DAMAGECOUNT value on done: 19775.0 [2024-08-05 22:58:16,692][52668] Sum rewards: 8.768, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.892', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.070', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'ARMOR': '1.323', 'weapon3': '1.698', 'weapon2': '1.850', 'DAMAGECOUNT': '2.520', 'FRAGCOUNT': '8.000'} [2024-08-05 22:58:17,308][52647] DAMAGECOUNT value on done: 17627.0 [2024-08-05 22:58:17,310][52647] Sum rewards: 19.500, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.306', 'AMMO5': '0.004', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'weapon5': '0.106', 'AMMO3': '0.108', 'weapon4': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.006', 'HITCOUNT': '1.300', 'weapon3': '1.422', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '16.000'} [2024-08-05 22:58:17,488][52795] DAMAGECOUNT value on done: 17342.0 [2024-08-05 22:58:17,490][52795] Sum rewards: 12.243, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.011', 'AMMO3': '0.046', 'AMMO4': '0.053', 'WEAPON3': '0.300', 'HEALTH': '0.332', 'ARMOR': '0.800', 'weapon3': '0.806', 'HITCOUNT': '0.940', 'weapon2': '1.564', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '8.000'} [2024-08-05 22:58:17,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16657.0, 300 sec: 16745.0). Total num frames: 94167040. Throughput: 0: 4195.6. Samples: 23541750. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-05 22:58:17,795][52567] Avg episode reward: [(0, '15.518')] [2024-08-05 22:58:18,394][52660] DAMAGECOUNT value on done: 18087.0 [2024-08-05 22:58:18,394][52660] Sum rewards: 11.562, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.047', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.032', 'AMMO3': '0.124', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.374', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'weapon2': '0.872', 'HITCOUNT': '0.980', 'weapon3': '2.028', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '10.000'} [2024-08-05 22:58:19,411][52668] DAMAGECOUNT value on done: 16066.0 [2024-08-05 22:58:19,413][52668] Sum rewards: 12.788, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.898', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.324', 'WEAPON3': '0.600', 'weapon2': '0.888', 'ARMOR': '0.917', 'weapon3': '1.080', 'HITCOUNT': '1.230', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:20,081][52647] DAMAGECOUNT value on done: 20094.0 [2024-08-05 22:58:20,081][52647] Sum rewards: 15.887, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.482', 'WEAPON3': '0.750', 'ARMOR': '0.927', 'HITCOUNT': '1.210', 'weapon2': '1.368', 'weapon3': '1.674', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:20,353][52650] Updated weights for policy 0, policy_version 11501 (0.0018) [2024-08-05 22:58:20,738][52795] DAMAGECOUNT value on done: 16582.0 [2024-08-05 22:58:20,738][52795] Sum rewards: 17.967, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.934', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.056', 'AMMO3': '0.091', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.304', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'weapon2': '0.858', 'HITCOUNT': '1.150', 'weapon3': '1.754', 'DAMAGECOUNT': '5.103', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:21,000][52660] DAMAGECOUNT value on done: 17532.0 [2024-08-05 22:58:21,000][52660] Sum rewards: 15.720, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.256', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'WEAPON3': '0.700', 'ARMOR': '0.849', 'HITCOUNT': '1.170', 'weapon2': '1.670', 'weapon3': '1.818', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:22,494][52668] DAMAGECOUNT value on done: 17391.0 [2024-08-05 22:58:22,494][52668] Sum rewards: 17.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.771', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.105', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '1.350', 'weapon2': '1.358', 'weapon3': '1.830', 'DAMAGECOUNT': '5.181', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:22,780][52647] DAMAGECOUNT value on done: 16591.0 [2024-08-05 22:58:22,781][52647] Sum rewards: 9.837, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.003', 'AMMO2': '0.056', 'AMMO3': '0.147', 'weapon4': '0.184', 'AMMO4': '0.279', 'WEAPON4': '0.600', 'ARMOR': '0.929', 'WEAPON3': '1.000', 'HITCOUNT': '1.060', 'weapon2': '1.132', 'weapon3': '2.340', 'DAMAGECOUNT': '3.363', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16796.3, 300 sec: 16717.3). Total num frames: 94248960. Throughput: 0: 4193.5. Samples: 23566890. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:58:22,795][52567] Avg episode reward: [(0, '15.711')] [2024-08-05 22:58:22,859][52614] Saving new best policy, reward=15.711! [2024-08-05 22:58:23,957][52660] DAMAGECOUNT value on done: 18142.0 [2024-08-05 22:58:23,957][52660] Sum rewards: 10.684, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.381', 'AMMO5': '0.005', 'AMMO2': '0.025', 'ARMOR': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.123', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon2': '1.400', 'weapon3': '1.524', 'DAMAGECOUNT': '2.784', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:24,038][52795] DAMAGECOUNT value on done: 16801.0 [2024-08-05 22:58:24,040][52795] Sum rewards: 10.050, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.680', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.111', 'AMMO4': '0.182', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.816', 'HITCOUNT': '1.180', 'weapon3': '1.406', 'weapon2': '1.862', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:25,049][52650] Updated weights for policy 0, policy_version 11511 (0.0023) [2024-08-05 22:58:25,637][52668] DAMAGECOUNT value on done: 17510.0 [2024-08-05 22:58:25,637][52668] Sum rewards: 16.750, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.542', 'AMMO2': '0.013', 'weapon4': '0.048', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'WEAPON3': '0.800', 'ARMOR': '0.866', 'HITCOUNT': '1.260', 'weapon2': '1.572', 'weapon3': '1.910', 'DAMAGECOUNT': '4.530', 'FRAGCOUNT': '15.000'} [2024-08-05 22:58:25,665][52647] DAMAGECOUNT value on done: 19071.0 [2024-08-05 22:58:25,665][52647] Sum rewards: 21.858, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.080', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'HEALTH': '0.138', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.932', 'HITCOUNT': '1.590', 'weapon3': '1.826', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '16.000'} [2024-08-05 22:58:27,067][52660] DAMAGECOUNT value on done: 17810.0 [2024-08-05 22:58:27,067][52660] Sum rewards: 22.454, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.667', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.202', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'weapon2': '1.232', 'HITCOUNT': '1.790', 'weapon3': '1.992', 'DAMAGECOUNT': '5.961', 'FRAGCOUNT': '18.000'} [2024-08-05 22:58:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.0, 300 sec: 16745.0). Total num frames: 94330880. Throughput: 0: 4197.1. Samples: 23592150. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 22:58:27,795][52567] Avg episode reward: [(0, '15.857')] [2024-08-05 22:58:27,849][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011516_94339072.pth... [2024-08-05 22:58:28,022][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011026_90324992.pth [2024-08-05 22:58:28,027][52614] Saving new best policy, reward=15.857! [2024-08-05 22:58:28,520][52647] DAMAGECOUNT value on done: 18399.0 [2024-08-05 22:58:28,521][52647] Sum rewards: 16.130, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.727', 'AMMO5': '0.005', 'AMMO2': '0.030', 'ARMOR': '0.032', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.578', 'weapon2': '0.962', 'weapon3': '1.328', 'HITCOUNT': '1.370', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:28,720][52668] DAMAGECOUNT value on done: 17447.0 [2024-08-05 22:58:28,720][52668] Sum rewards: 15.691, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.499', 'AMMO2': '0.015', 'AMMO3': '0.074', 'AMMO4': '0.075', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.566', 'ARMOR': '0.914', 'HITCOUNT': '1.200', 'weapon2': '1.314', 'weapon3': '1.584', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:29,961][52660] DAMAGECOUNT value on done: 17444.0 [2024-08-05 22:58:29,962][52660] Sum rewards: 11.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.704', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO3': '0.086', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '0.650', 'HITCOUNT': '0.730', 'weapon2': '0.762', 'ARMOR': '0.932', 'weapon3': '1.656', 'DAMAGECOUNT': '2.772', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:30,477][52650] Updated weights for policy 0, policy_version 11521 (0.0042) [2024-08-05 22:58:31,010][52668] DAMAGECOUNT value on done: 16702.0 [2024-08-05 22:58:31,010][52668] Sum rewards: 16.571, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'AMMO2': '0.026', 'ARMOR': '0.090', 'AMMO3': '0.129', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.900', 'weapon2': '1.140', 'HITCOUNT': '1.410', 'weapon3': '2.080', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:31,774][52647] DAMAGECOUNT value on done: 17545.0 [2024-08-05 22:58:31,774][52647] Sum rewards: 20.686, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.863', 'AMMO4': '-0.095', 'AMMO2': '-0.019', 'AMMO5': '0.003', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'WEAPON3': '0.900', 'ARMOR': '0.906', 'HITCOUNT': '1.440', 'weapon3': '1.728', 'weapon2': '1.784', 'DAMAGECOUNT': '5.415', 'FRAGCOUNT': '17.000'} [2024-08-05 22:58:32,473][52660] DAMAGECOUNT value on done: 17849.0 [2024-08-05 22:58:32,474][52660] Sum rewards: 7.385, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.739', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.075', 'WEAPON4': '0.200', 'weapon4': '0.362', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '0.920', 'weapon2': '0.960', 'weapon3': '1.366', 'DAMAGECOUNT': '3.417', 'FRAGCOUNT': '5.000'} [2024-08-05 22:58:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16930.2, 300 sec: 16717.2). Total num frames: 94420992. Throughput: 0: 4187.8. Samples: 23604280. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-05 22:58:32,794][52567] Avg episode reward: [(0, '15.780')] [2024-08-05 22:58:33,636][52668] DAMAGECOUNT value on done: 16646.0 [2024-08-05 22:58:33,637][52668] Sum rewards: 14.457, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.442', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.040', 'weapon4': '0.042', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'HITCOUNT': '0.860', 'weapon3': '1.166', 'weapon2': '1.302', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:34,533][52647] DAMAGECOUNT value on done: 19455.0 [2024-08-05 22:58:34,534][52647] Sum rewards: 18.340, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.158', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.032', 'AMMO3': '0.081', 'AMMO4': '0.096', 'weapon5': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.534', 'WEAPON3': '0.600', 'weapon2': '0.608', 'HITCOUNT': '1.320', 'weapon3': '1.584', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:34,972][52614] Signal inference workers to stop experience collection... (2150 times) [2024-08-05 22:58:34,973][52614] Signal inference workers to resume experience collection... (2150 times) [2024-08-05 22:58:35,008][52650] InferenceWorker_p0-w0: stopping experience collection (2150 times) [2024-08-05 22:58:35,012][52650] InferenceWorker_p0-w0: resuming experience collection (2150 times) [2024-08-05 22:58:35,066][52650] Updated weights for policy 0, policy_version 11531 (0.0013) [2024-08-05 22:58:35,123][52660] DAMAGECOUNT value on done: 17899.0 [2024-08-05 22:58:35,129][52660] Sum rewards: 9.377, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.006', 'HEALTH': '0.031', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.340', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'weapon2': '0.996', 'HITCOUNT': '1.070', 'weapon3': '1.716', 'DAMAGECOUNT': '3.591', 'FRAGCOUNT': '7.000'} [2024-08-05 22:58:36,462][52668] DAMAGECOUNT value on done: 16892.0 [2024-08-05 22:58:36,462][52668] Sum rewards: 21.861, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.355', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon7': '0.044', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'weapon2': '1.382', 'weapon3': '1.628', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '6.351', 'FRAGCOUNT': '16.000'} [2024-08-05 22:58:36,701][52666] DAMAGECOUNT value on done: 17833.0 [2024-08-05 22:58:36,701][52666] Sum rewards: 16.184, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.015', 'AMMO2': '0.026', 'AMMO3': '0.119', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.130', 'weapon2': '1.148', 'weapon3': '1.752', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '16.000'} [2024-08-05 22:58:37,238][52647] DAMAGECOUNT value on done: 20733.0 [2024-08-05 22:58:37,238][52647] Sum rewards: 16.346, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.334', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.828', 'HITCOUNT': '1.410', 'weapon2': '1.438', 'weapon3': '1.532', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16657.1, 300 sec: 16745.0). Total num frames: 94502912. Throughput: 0: 4187.3. Samples: 23629590. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-05 22:58:37,794][52567] Avg episode reward: [(0, '15.911')] [2024-08-05 22:58:37,798][52614] Saving new best policy, reward=15.911! [2024-08-05 22:58:38,003][52660] DAMAGECOUNT value on done: 19028.0 [2024-08-05 22:58:38,005][52660] Sum rewards: 15.906, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO2': '0.034', 'AMMO3': '0.108', 'AMMO4': '0.171', 'WEAPON4': '0.350', 'weapon4': '0.478', 'WEAPON3': '0.800', 'weapon2': '1.114', 'HITCOUNT': '1.180', 'ARMOR': '1.668', 'weapon3': '2.078', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:38,757][52667] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon7', 0.002)] [2024-08-05 22:58:38,795][52820] DAMAGECOUNT value on done: 14430.0 [2024-08-05 22:58:38,797][52820] Sum rewards: 11.777, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon4': '0.272', 'WEAPON3': '0.500', 'ARMOR': '0.536', 'HITCOUNT': '0.940', 'weapon2': '1.282', 'weapon3': '1.348', 'DAMAGECOUNT': '3.213', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:39,480][52668] DAMAGECOUNT value on done: 18455.0 [2024-08-05 22:58:39,482][52668] Sum rewards: 14.164, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.464', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.111', 'AMMO3': '0.115', 'WEAPON4': '0.400', 'weapon4': '0.440', 'ARMOR': '0.479', 'WEAPON3': '0.850', 'weapon2': '1.002', 'HITCOUNT': '1.030', 'weapon3': '2.004', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:39,660][52670] DAMAGECOUNT value on done: 18179.0 [2024-08-05 22:58:39,660][52670] Sum rewards: 12.182, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.160', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO3': '0.053', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.200', 'weapon4': '0.496', 'WEAPON3': '0.500', 'weapon2': '0.650', 'HITCOUNT': '0.900', 'weapon3': '1.146', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:39,749][52666] DAMAGECOUNT value on done: 16277.0 [2024-08-05 22:58:39,753][52666] Sum rewards: 16.732, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.735', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.040', 'AMMO3': '0.081', 'weapon5': '0.086', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON3': '0.550', 'HITCOUNT': '1.360', 'weapon2': '1.398', 'weapon3': '1.444', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:40,136][52647] DAMAGECOUNT value on done: 19201.0 [2024-08-05 22:58:40,137][52647] Sum rewards: 14.837, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.014', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.402', 'ARMOR': '0.440', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon2': '1.288', 'weapon3': '2.100', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:40,277][52650] Updated weights for policy 0, policy_version 11541 (0.0013) [2024-08-05 22:58:41,496][52660] DAMAGECOUNT value on done: 18544.0 [2024-08-05 22:58:41,497][52660] Sum rewards: 13.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.376', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.422', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '1.010', 'weapon2': '1.158', 'weapon3': '1.670', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:42,055][52820] DAMAGECOUNT value on done: 16455.0 [2024-08-05 22:58:42,055][52820] Sum rewards: 17.833, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.029', 'HEALTH': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.144', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.040', 'weapon3': '1.460', 'weapon2': '1.626', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:42,419][52668] DAMAGECOUNT value on done: 18795.0 [2024-08-05 22:58:42,419][52668] Sum rewards: 7.958, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.036', 'AMMO2': '0.013', 'weapon4': '0.022', 'AMMO4': '0.065', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'ARMOR': '0.448', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'weapon3': '1.466', 'weapon2': '1.852', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '7.000'} [2024-08-05 22:58:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16717.2). Total num frames: 94584832. Throughput: 0: 4186.9. Samples: 23654740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 22:58:42,795][52567] Avg episode reward: [(0, '15.770')] [2024-08-05 22:58:42,842][52670] DAMAGECOUNT value on done: 17030.0 [2024-08-05 22:58:42,844][52670] Sum rewards: 13.248, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.477', 'AMMO2': '0.032', 'weapon7': '0.050', 'AMMO3': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '1.310', 'weapon2': '1.378', 'weapon3': '1.574', 'DAMAGECOUNT': '4.053', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:42,888][52666] DAMAGECOUNT value on done: 17949.0 [2024-08-05 22:58:42,889][52666] Sum rewards: 15.413, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.080', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'ARMOR': '0.451', 'WEAPON3': '0.550', 'HITCOUNT': '1.190', 'weapon2': '1.288', 'weapon3': '1.738', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:43,568][52647] DAMAGECOUNT value on done: 18863.0 [2024-08-05 22:58:43,570][52647] Sum rewards: 10.081, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.334', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon5': '0.086', 'AMMO3': '0.096', 'WEAPON3': '0.550', 'ARMOR': '0.804', 'HITCOUNT': '1.010', 'weapon3': '1.244', 'weapon2': '1.782', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '8.000'} [2024-08-05 22:58:44,311][52660] DAMAGECOUNT value on done: 19735.0 [2024-08-05 22:58:44,312][52660] Sum rewards: 19.178, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.212', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.322', 'WEAPON3': '0.750', 'ARMOR': '0.827', 'weapon2': '1.442', 'HITCOUNT': '1.480', 'weapon3': '1.626', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '16.000'} [2024-08-05 22:58:44,707][52650] Updated weights for policy 0, policy_version 11551 (0.0024) [2024-08-05 22:58:45,377][52820] DAMAGECOUNT value on done: 15775.0 [2024-08-05 22:58:45,377][52820] Sum rewards: 11.519, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.935', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.290', 'WEAPON3': '0.600', 'HITCOUNT': '0.780', 'weapon2': '1.152', 'weapon3': '1.524', 'DAMAGECOUNT': '3.204', 'FRAGCOUNT': '10.000'} [2024-08-05 22:58:45,669][52668] DAMAGECOUNT value on done: 18622.0 [2024-08-05 22:58:45,670][52668] Sum rewards: 14.547, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.385', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.014', 'weapon4': '0.068', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.472', 'WEAPON3': '0.700', 'HITCOUNT': '1.220', 'weapon2': '1.344', 'weapon3': '1.560', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:46,102][52669] DAMAGECOUNT value on done: 18303.0 [2024-08-05 22:58:46,102][52669] Sum rewards: 8.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon4': '0.448', 'weapon2': '1.022', 'WEAPON3': '1.050', 'HITCOUNT': '1.150', 'weapon3': '1.794', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '10.000'} [2024-08-05 22:58:46,228][52670] DAMAGECOUNT value on done: 15879.0 [2024-08-05 22:58:46,229][52670] Sum rewards: 19.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.801', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.050', 'AMMO3': '0.107', 'weapon5': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.700', 'ARMOR': '0.943', 'weapon3': '1.282', 'HITCOUNT': '1.290', 'weapon2': '1.580', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '15.000'} [2024-08-05 22:58:46,234][52647] DAMAGECOUNT value on done: 15814.0 [2024-08-05 22:58:46,235][52647] Sum rewards: 15.550, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'HEALTH': '0.091', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.444', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'weapon2': '0.958', 'HITCOUNT': '0.970', 'weapon3': '1.562', 'DAMAGECOUNT': '3.756', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:46,258][52666] DAMAGECOUNT value on done: 16723.0 [2024-08-05 22:58:46,258][52666] Sum rewards: 15.740, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.168', 'WEAPON3': '0.850', 'HITCOUNT': '1.250', 'ARMOR': '1.368', 'weapon2': '1.418', 'weapon3': '1.438', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:47,446][52660] DAMAGECOUNT value on done: 16866.0 [2024-08-05 22:58:47,449][52660] Sum rewards: 13.255, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.385', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.073', 'WEAPON3': '0.500', 'HITCOUNT': '1.000', 'weapon3': '1.358', 'ARMOR': '1.690', 'weapon2': '1.766', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16745.0). Total num frames: 94674944. Throughput: 0: 4191.1. Samples: 23667440. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:58:47,794][52567] Avg episode reward: [(0, '15.706')] [2024-08-05 22:58:48,737][52647] DAMAGECOUNT value on done: 17680.0 [2024-08-05 22:58:48,738][52647] Sum rewards: 11.362, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.902', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.061', 'AMMO3': '0.103', 'weapon4': '0.242', 'WEAPON3': '0.700', 'weapon2': '1.004', 'HITCOUNT': '1.030', 'weapon3': '1.638', 'DAMAGECOUNT': '4.293', 'FRAGCOUNT': '9.000'} [2024-08-05 22:58:48,806][52820] DAMAGECOUNT value on done: 16808.0 [2024-08-05 22:58:48,809][52820] Sum rewards: 17.200, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.499', 'AMMO5': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.084', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.410', 'WEAPON3': '0.600', 'ARMOR': '0.922', 'weapon2': '1.172', 'HITCOUNT': '1.200', 'weapon3': '1.592', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:49,500][52669] DAMAGECOUNT value on done: 18100.0 [2024-08-05 22:58:49,503][52669] Sum rewards: 13.981, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.562', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon4': '0.160', 'WEAPON3': '0.750', 'ARMOR': '0.900', 'HITCOUNT': '0.950', 'weapon2': '1.390', 'weapon3': '1.934', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:49,605][52670] DAMAGECOUNT value on done: 18313.0 [2024-08-05 22:58:49,607][52670] Sum rewards: 18.001, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.816', 'AMMO4': '-0.063', 'AMMO2': '-0.013', 'AMMO5': '0.009', 'AMMO3': '0.103', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.444', 'ARMOR': '0.462', 'WEAPON3': '0.850', 'weapon2': '1.032', 'HITCOUNT': '1.230', 'weapon3': '1.810', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:49,638][52666] DAMAGECOUNT value on done: 17480.0 [2024-08-05 22:58:49,640][52666] Sum rewards: 17.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.026', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.362', 'ARMOR': '0.887', 'WEAPON3': '1.000', 'weapon2': '1.170', 'HITCOUNT': '1.520', 'weapon3': '2.148', 'DAMAGECOUNT': '5.559', 'FRAGCOUNT': '15.000'} [2024-08-05 22:58:50,155][52650] Updated weights for policy 0, policy_version 11561 (0.0018) [2024-08-05 22:58:50,476][52660] DAMAGECOUNT value on done: 17993.0 [2024-08-05 22:58:50,478][52660] Sum rewards: 7.272, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.727', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.388', 'ARMOR': '0.465', 'HITCOUNT': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.138', 'weapon3': '1.946', 'DAMAGECOUNT': '2.283', 'FRAGCOUNT': '7.000'} [2024-08-05 22:58:51,493][52647] DAMAGECOUNT value on done: 17772.0 [2024-08-05 22:58:51,493][52647] Sum rewards: 20.786, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.413', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO3': '0.112', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.630', 'weapon2': '1.840', 'weapon3': '1.956', 'DAMAGECOUNT': '5.964', 'FRAGCOUNT': '17.000'} [2024-08-05 22:58:52,132][52820] DAMAGECOUNT value on done: 17882.0 [2024-08-05 22:58:52,134][52820] Sum rewards: 15.480, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.587', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.070', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.300', 'WEAPON3': '0.600', 'HITCOUNT': '1.230', 'ARMOR': '1.275', 'weapon2': '1.494', 'weapon3': '1.566', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '10.000'} [2024-08-05 22:58:52,366][52669] DAMAGECOUNT value on done: 17888.0 [2024-08-05 22:58:52,366][52669] Sum rewards: 8.173, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.065', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.004', 'weapon5': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.346', 'HITCOUNT': '0.680', 'WEAPON3': '0.700', 'ARMOR': '0.906', 'weapon3': '1.282', 'weapon2': '1.434', 'DAMAGECOUNT': '2.343', 'FRAGCOUNT': '8.000'} [2024-08-05 22:58:52,668][52670] DAMAGECOUNT value on done: 16381.0 [2024-08-05 22:58:52,670][52670] Sum rewards: 9.847, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.362', 'HEALTH': '0.388', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '1.010', 'weapon2': '1.076', 'weapon3': '1.770', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '7.000'} [2024-08-05 22:58:52,682][52666] DAMAGECOUNT value on done: 16064.0 [2024-08-05 22:58:52,687][52666] Sum rewards: 20.587, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO2': '0.020', 'HEALTH': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.100', 'weapon4': '0.318', 'WEAPON3': '0.550', 'HITCOUNT': '1.450', 'weapon2': '1.592', 'weapon3': '1.830', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '15.000'} [2024-08-05 22:58:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16689.5). Total num frames: 94748672. Throughput: 0: 4182.2. Samples: 23692320. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 22:58:52,794][52567] Avg episode reward: [(0, '15.662')] [2024-08-05 22:58:53,439][52660] DAMAGECOUNT value on done: 17676.0 [2024-08-05 22:58:53,442][52660] Sum rewards: 8.335, reward structure: {'DEATHCOUNT': '-5.250', 'weapon4': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'HEALTH': '0.130', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.534', 'weapon3': '1.618', 'DAMAGECOUNT': '2.970', 'FRAGCOUNT': '5.000'} [2024-08-05 22:58:54,738][52647] DAMAGECOUNT value on done: 20618.0 [2024-08-05 22:58:54,740][52647] Sum rewards: 12.421, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.560', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.116', 'AMMO3': '0.122', 'WEAPON4': '0.250', 'ARMOR': '0.541', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon2': '1.328', 'weapon3': '2.098', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:55,060][52650] Updated weights for policy 0, policy_version 11571 (0.0024) [2024-08-05 22:58:55,668][52669] DAMAGECOUNT value on done: 19831.0 [2024-08-05 22:58:55,668][52669] Sum rewards: 15.811, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.524', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.092', 'weapon5': '0.092', 'AMMO4': '0.153', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'weapon2': '1.238', 'ARMOR': '1.708', 'weapon3': '1.896', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:55,767][52820] DAMAGECOUNT value on done: 17366.0 [2024-08-05 22:58:55,769][52820] Sum rewards: 13.123, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.486', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.192', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.446', 'weapon3': '1.564', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '11.000'} [2024-08-05 22:58:55,953][52670] DAMAGECOUNT value on done: 19351.0 [2024-08-05 22:58:55,957][52670] Sum rewards: 20.657, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.524', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.164', 'ARMOR': '0.891', 'WEAPON3': '0.950', 'weapon2': '1.200', 'HITCOUNT': '1.320', 'weapon3': '2.150', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '19.000'} [2024-08-05 22:58:55,994][52666] DAMAGECOUNT value on done: 17566.0 [2024-08-05 22:58:55,995][52666] Sum rewards: 19.604, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.638', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.124', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.850', 'ARMOR': '0.947', 'weapon2': '1.358', 'HITCOUNT': '1.390', 'weapon3': '1.536', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '16.000'} [2024-08-05 22:58:57,794][52567] Fps is (10 sec: 15564.7, 60 sec: 16657.1, 300 sec: 16689.5). Total num frames: 94830592. Throughput: 0: 4197.1. Samples: 23718020. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:58:57,794][52567] Avg episode reward: [(0, '15.602')] [2024-08-05 22:58:58,047][52647] DAMAGECOUNT value on done: 16349.0 [2024-08-05 22:58:58,049][52647] Sum rewards: 17.629, reward structure: {'DEATHCOUNT': '-6.750', 'weapon4': '0.018', 'AMMO2': '0.022', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'HEALTH': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.438', 'HITCOUNT': '1.500', 'weapon3': '1.782', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '13.000'} [2024-08-05 22:58:58,475][52670] DAMAGECOUNT value on done: 16673.0 [2024-08-05 22:58:58,479][52670] Sum rewards: 26.383, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.089', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.110', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.238', 'ARMOR': '0.462', 'WEAPON3': '0.750', 'weapon2': '1.308', 'HITCOUNT': '1.480', 'weapon3': '1.710', 'DAMAGECOUNT': '6.312', 'FRAGCOUNT': '22.000'} [2024-08-05 22:58:58,513][52666] DAMAGECOUNT value on done: 16978.0 [2024-08-05 22:58:58,514][52666] Sum rewards: 17.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.189', 'weapon4': '0.208', 'WEAPON4': '0.400', 'ARMOR': '0.884', 'WEAPON3': '1.050', 'weapon2': '1.220', 'HITCOUNT': '1.370', 'weapon3': '2.342', 'DAMAGECOUNT': '5.406', 'FRAGCOUNT': '18.000'} [2024-08-05 22:58:58,574][52665] DAMAGECOUNT value on done: 17099.0 [2024-08-05 22:58:58,575][52665] Sum rewards: 15.882, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.698', 'AMMO2': '0.018', 'weapon4': '0.090', 'AMMO4': '0.090', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'ARMOR': '0.856', 'WEAPON3': '0.950', 'HITCOUNT': '1.160', 'weapon2': '1.382', 'weapon3': '2.342', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '14.000'} [2024-08-05 22:58:59,032][52669] DAMAGECOUNT value on done: 18563.0 [2024-08-05 22:58:59,033][52669] Sum rewards: 15.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.500', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.224', 'WEAPON3': '0.700', 'HITCOUNT': '1.030', 'weapon3': '1.504', 'ARMOR': '1.732', 'weapon2': '1.990', 'DAMAGECOUNT': '3.699', 'FRAGCOUNT': '12.000'} [2024-08-05 22:58:59,195][52820] DAMAGECOUNT value on done: 15863.0 [2024-08-05 22:58:59,195][52820] Sum rewards: 23.346, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.202', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.061', 'WEAPON5': '0.100', 'weapon5': '0.122', 'weapon4': '0.202', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'weapon2': '1.192', 'weapon3': '1.394', 'HITCOUNT': '1.410', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '17.000'} [2024-08-05 22:58:59,277][52650] Updated weights for policy 0, policy_version 11581 (0.0020) [2024-08-05 22:59:01,090][52647] DAMAGECOUNT value on done: 20689.0 [2024-08-05 22:59:01,090][52647] Sum rewards: 21.172, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.749', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.076', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.336', 'WEAPON3': '0.650', 'ARMOR': '0.920', 'weapon2': '0.936', 'HITCOUNT': '1.430', 'weapon3': '1.614', 'DAMAGECOUNT': '5.796', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:01,396][52665] DAMAGECOUNT value on done: 18005.0 [2024-08-05 22:59:01,396][52665] Sum rewards: 20.934, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.542', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.072', 'ARMOR': '0.446', 'WEAPON3': '0.550', 'HITCOUNT': '1.430', 'weapon3': '1.606', 'weapon2': '1.812', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:01,645][52669] DAMAGECOUNT value on done: 19074.0 [2024-08-05 22:59:01,646][52669] Sum rewards: 16.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'ARMOR': '0.898', 'WEAPON3': '1.150', 'HITCOUNT': '1.390', 'weapon2': '1.424', 'weapon3': '1.916', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '17.000'} [2024-08-05 22:59:02,033][52670] DAMAGECOUNT value on done: 16087.0 [2024-08-05 22:59:02,035][52670] Sum rewards: 13.670, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.583', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon7': '0.046', 'ARMOR': '0.048', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.372', 'WEAPON3': '0.550', 'weapon2': '0.682', 'HITCOUNT': '1.140', 'weapon3': '1.262', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:02,110][52666] DAMAGECOUNT value on done: 17741.0 [2024-08-05 22:59:02,111][52666] Sum rewards: 20.638, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.937', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.079', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.498', 'WEAPON3': '0.500', 'weapon2': '1.324', 'ARMOR': '1.333', 'weapon3': '1.350', 'HITCOUNT': '1.390', 'DAMAGECOUNT': '5.694', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:02,755][52820] DAMAGECOUNT value on done: 16301.0 [2024-08-05 22:59:02,757][52820] Sum rewards: 14.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.408', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'ARMOR': '0.472', 'weapon4': '0.686', 'weapon2': '0.920', 'WEAPON3': '1.000', 'HITCOUNT': '1.440', 'weapon3': '2.062', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16930.1, 300 sec: 16745.0). Total num frames: 94928896. Throughput: 0: 4193.8. Samples: 23730470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:59:02,794][52567] Avg episode reward: [(0, '15.860')] [2024-08-05 22:59:04,040][52647] DAMAGECOUNT value on done: 18049.0 [2024-08-05 22:59:04,040][52647] Sum rewards: 8.876, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.308', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.107', 'WEAPON3': '0.700', 'HITCOUNT': '0.980', 'ARMOR': '1.337', 'weapon2': '1.438', 'weapon3': '1.692', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:04,186][52665] DAMAGECOUNT value on done: 18839.0 [2024-08-05 22:59:04,187][52665] Sum rewards: 16.365, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.728', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.520', 'ARMOR': '0.544', 'WEAPON3': '0.700', 'weapon2': '0.972', 'HITCOUNT': '1.290', 'weapon3': '1.804', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:04,189][52650] Updated weights for policy 0, policy_version 11591 (0.0023) [2024-08-05 22:59:04,427][52669] DAMAGECOUNT value on done: 19808.0 [2024-08-05 22:59:04,427][52669] Sum rewards: 17.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.477', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.146', 'AMMO4': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.300', 'ARMOR': '0.898', 'WEAPON3': '0.950', 'weapon2': '1.226', 'HITCOUNT': '1.450', 'weapon3': '1.914', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '17.000'} [2024-08-05 22:59:05,310][52666] DAMAGECOUNT value on done: 16536.0 [2024-08-05 22:59:05,313][52666] Sum rewards: 16.526, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.270', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.040', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'HITCOUNT': '0.890', 'weapon3': '0.922', 'weapon2': '1.148', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:05,314][52670] DAMAGECOUNT value on done: 16025.0 [2024-08-05 22:59:05,316][52670] Sum rewards: 4.031, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.704', 'AMMO5': '0.012', 'weapon7': '0.016', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO3': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.143', 'weapon4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.444', 'WEAPON3': '0.550', 'HITCOUNT': '0.610', 'weapon2': '1.432', 'weapon3': '1.702', 'DAMAGECOUNT': '2.043', 'FRAGCOUNT': '4.000'} [2024-08-05 22:59:06,237][52820] DAMAGECOUNT value on done: 16168.0 [2024-08-05 22:59:06,247][52820] Sum rewards: 12.130, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO2': '0.004', 'AMMO4': '0.021', 'ARMOR': '0.032', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.470', 'WEAPON3': '0.600', 'HITCOUNT': '1.050', 'weapon2': '1.116', 'weapon3': '1.666', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:06,338][52647] DAMAGECOUNT value on done: 19199.0 [2024-08-05 22:59:06,338][52647] Sum rewards: 12.804, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon3': '1.602', 'weapon2': '1.610', 'DAMAGECOUNT': '3.717', 'FRAGCOUNT': '9.000'} [2024-08-05 22:59:07,425][52665] DAMAGECOUNT value on done: 19099.0 [2024-08-05 22:59:07,425][52665] Sum rewards: 14.222, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.112', 'weapon5': '0.126', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'ARMOR': '0.556', 'weapon4': '0.676', 'WEAPON3': '0.750', 'weapon2': '0.778', 'HITCOUNT': '1.160', 'weapon3': '1.766', 'DAMAGECOUNT': '4.131', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:07,773][52669] DAMAGECOUNT value on done: 18393.0 [2024-08-05 22:59:07,776][52669] Sum rewards: 14.128, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.130', 'AMMO4': '-0.108', 'AMMO2': '-0.022', 'AMMO3': '0.110', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon3': '1.606', 'weapon2': '1.708', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 95010816. Throughput: 0: 4199.6. Samples: 23755870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:59:07,794][52567] Avg episode reward: [(0, '15.442')] [2024-08-05 22:59:08,538][52647] DAMAGECOUNT value on done: 18863.0 [2024-08-05 22:59:08,539][52647] Sum rewards: 19.637, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.280', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'AMMO3': '0.060', 'ARMOR': '0.445', 'WEAPON3': '0.450', 'weapon3': '1.264', 'HITCOUNT': '1.280', 'weapon2': '1.934', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:08,676][52666] DAMAGECOUNT value on done: 15068.0 [2024-08-05 22:59:08,677][52666] Sum rewards: 16.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.462', 'AMMO2': '0.001', 'AMMO4': '0.003', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.210', 'WEAPON3': '0.850', 'ARMOR': '0.890', 'HITCOUNT': '1.210', 'weapon2': '1.348', 'weapon3': '2.076', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:08,683][52670] DAMAGECOUNT value on done: 15178.0 [2024-08-05 22:59:08,684][52670] Sum rewards: 19.273, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.417', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'weapon5': '0.114', 'weapon4': '0.254', 'WEAPON3': '0.750', 'weapon2': '1.134', 'HITCOUNT': '1.140', 'weapon3': '1.548', 'DAMAGECOUNT': '4.563', 'FRAGCOUNT': '17.000'} [2024-08-05 22:59:09,315][52650] Updated weights for policy 0, policy_version 11601 (0.0015) [2024-08-05 22:59:09,596][52820] DAMAGECOUNT value on done: 16961.0 [2024-08-05 22:59:09,598][52820] Sum rewards: 13.848, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.196', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon7': '0.072', 'AMMO3': '0.081', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.502', 'WEAPON3': '0.600', 'weapon2': '0.624', 'weapon4': '0.926', 'HITCOUNT': '1.010', 'weapon3': '1.124', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:10,709][52665] DAMAGECOUNT value on done: 16800.0 [2024-08-05 22:59:10,712][52665] Sum rewards: 13.084, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO4': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.434', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'HITCOUNT': '1.100', 'weapon2': '1.204', 'weapon3': '1.750', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '11.000'} [2024-08-05 22:59:10,969][52669] DAMAGECOUNT value on done: 16970.0 [2024-08-05 22:59:10,969][52669] Sum rewards: 22.204, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.504', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.068', 'weapon4': '0.330', 'WEAPON3': '0.500', 'ARMOR': '0.905', 'HITCOUNT': '1.240', 'weapon3': '1.244', 'weapon2': '1.664', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:11,749][52670] DAMAGECOUNT value on done: 17902.0 [2024-08-05 22:59:11,752][52670] Sum rewards: 7.941, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.130', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.350', 'weapon4': '0.400', 'ARMOR': '0.464', 'WEAPON3': '0.850', 'HITCOUNT': '1.030', 'weapon2': '1.214', 'weapon3': '1.648', 'DAMAGECOUNT': '3.069', 'FRAGCOUNT': '8.500'} [2024-08-05 22:59:11,790][52666] DAMAGECOUNT value on done: 15926.0 [2024-08-05 22:59:11,790][52666] Sum rewards: 11.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.817', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.374', 'ARMOR': '0.515', 'weapon2': '0.724', 'WEAPON3': '0.750', 'HITCOUNT': '1.420', 'weapon3': '1.796', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '9.000'} [2024-08-05 22:59:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16717.2). Total num frames: 95092736. Throughput: 0: 4197.6. Samples: 23781040. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 22:59:12,794][52567] Avg episode reward: [(0, '15.280')] [2024-08-05 22:59:12,878][52820] DAMAGECOUNT value on done: 16631.0 [2024-08-05 22:59:12,882][52820] Sum rewards: 11.259, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.535', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.374', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'ARMOR': '0.852', 'weapon3': '1.312', 'weapon2': '1.352', 'DAMAGECOUNT': '3.168', 'FRAGCOUNT': '7.000'} [2024-08-05 22:59:13,512][52665] DAMAGECOUNT value on done: 17762.0 [2024-08-05 22:59:13,512][52665] Sum rewards: 17.641, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'ARMOR': '0.074', 'AMMO3': '0.109', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.330', 'HEALTH': '0.458', 'WEAPON3': '0.600', 'weapon2': '1.056', 'HITCOUNT': '1.270', 'weapon3': '1.466', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:14,206][52650] Updated weights for policy 0, policy_version 11611 (0.0023) [2024-08-05 22:59:14,511][52669] DAMAGECOUNT value on done: 16953.0 [2024-08-05 22:59:14,512][52669] Sum rewards: 11.193, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.221', 'AMMO2': '0.006', 'weapon4': '0.010', 'AMMO4': '0.029', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.906', 'HITCOUNT': '1.000', 'weapon2': '1.450', 'weapon3': '2.002', 'DAMAGECOUNT': '3.507', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:14,656][52666] DAMAGECOUNT value on done: 17642.0 [2024-08-05 22:59:14,656][52666] Sum rewards: 19.192, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.170', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO3': '0.081', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'ARMOR': '0.800', 'HITCOUNT': '1.180', 'weapon2': '1.736', 'weapon3': '1.932', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:14,663][52670] DAMAGECOUNT value on done: 19039.0 [2024-08-05 22:59:14,665][52670] Sum rewards: 14.692, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.011', 'AMMO5': '0.005', 'AMMO2': '0.025', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.122', 'AMMO3': '0.149', 'weapon4': '0.154', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '1.120', 'weapon2': '1.264', 'weapon3': '1.820', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:16,134][52820] DAMAGECOUNT value on done: 17711.0 [2024-08-05 22:59:16,135][52820] Sum rewards: 20.162, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.689', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.004', 'weapon5': '0.038', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON3': '1.000', 'HITCOUNT': '1.420', 'weapon2': '1.718', 'weapon3': '2.082', 'ARMOR': '2.317', 'DAMAGECOUNT': '5.124', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:16,828][52665] DAMAGECOUNT value on done: 18917.0 [2024-08-05 22:59:16,836][52665] Sum rewards: 7.466, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.610', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon7': '0.066', 'AMMO3': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.856', 'HITCOUNT': '1.100', 'weapon3': '1.322', 'weapon2': '1.926', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:17,465][52666] DAMAGECOUNT value on done: 16782.0 [2024-08-05 22:59:17,468][52666] Sum rewards: 18.445, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.927', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.076', 'AMMO3': '0.079', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '0.600', 'weapon2': '0.712', 'HITCOUNT': '1.190', 'weapon3': '1.586', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:17,497][52670] DAMAGECOUNT value on done: 18961.0 [2024-08-05 22:59:17,499][52670] Sum rewards: 18.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.254', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.500', 'weapon3': '1.602', 'weapon2': '1.846', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:17,674][52649] Large shaping reward 3.291 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.24, 80.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 22:59:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 95174656. Throughput: 0: 4207.1. Samples: 23793600. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:59:17,794][52567] Avg episode reward: [(0, '15.156')] [2024-08-05 22:59:18,075][52669] DAMAGECOUNT value on done: 18348.0 [2024-08-05 22:59:18,077][52669] Sum rewards: 21.136, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.066', 'weapon5': '0.080', 'AMMO3': '0.121', 'WEAPON3': '0.800', 'ARMOR': '1.333', 'weapon2': '1.338', 'HITCOUNT': '1.340', 'weapon3': '1.846', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '17.000'} [2024-08-05 22:59:19,140][52650] Updated weights for policy 0, policy_version 11621 (0.0036) [2024-08-05 22:59:19,206][52665] DAMAGECOUNT value on done: 17634.0 [2024-08-05 22:59:19,207][52665] Sum rewards: 18.185, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.495', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.070', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.156', 'ARMOR': '0.460', 'WEAPON3': '0.650', 'weapon2': '1.340', 'HITCOUNT': '1.440', 'weapon3': '1.672', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:19,428][52820] DAMAGECOUNT value on done: 17195.0 [2024-08-05 22:59:19,428][52820] Sum rewards: 16.175, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.011', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.104', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.336', 'ARMOR': '0.892', 'WEAPON3': '0.900', 'weapon2': '1.092', 'HITCOUNT': '1.290', 'weapon3': '1.812', 'DAMAGECOUNT': '5.568', 'FRAGCOUNT': '12.500'} [2024-08-05 22:59:20,728][52666] DAMAGECOUNT value on done: 16926.0 [2024-08-05 22:59:20,729][52669] DAMAGECOUNT value on done: 19517.0 [2024-08-05 22:59:20,730][52669] Sum rewards: 20.855, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.308', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.308', 'WEAPON3': '0.600', 'HITCOUNT': '1.180', 'ARMOR': '1.386', 'weapon3': '1.516', 'weapon2': '1.776', 'DAMAGECOUNT': '4.347', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:20,729][52666] Sum rewards: 20.578, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.330', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO3': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.828', 'weapon2': '1.070', 'HITCOUNT': '1.350', 'weapon3': '1.408', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:20,785][52670] DAMAGECOUNT value on done: 18464.0 [2024-08-05 22:59:20,787][52670] Sum rewards: 14.670, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.634', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon4': '0.026', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.316', 'HITCOUNT': '1.400', 'weapon3': '1.814', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '11.000'} [2024-08-05 22:59:21,970][52665] DAMAGECOUNT value on done: 19514.0 [2024-08-05 22:59:21,980][52665] Sum rewards: 15.652, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.777', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO3': '0.073', 'AMMO4': '0.073', 'weapon5': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.899', 'HITCOUNT': '0.940', 'weapon2': '1.036', 'weapon3': '1.694', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '11.000'} [2024-08-05 22:59:22,688][52820] DAMAGECOUNT value on done: 16403.0 [2024-08-05 22:59:22,688][52820] Sum rewards: 10.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.778', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.123', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'ARMOR': '1.253', 'weapon2': '1.570', 'weapon3': '1.784', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '11.000'} [2024-08-05 22:59:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16717.2). Total num frames: 95256576. Throughput: 0: 4213.1. Samples: 23819180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 22:59:22,794][52567] Avg episode reward: [(0, '15.404')] [2024-08-05 22:59:23,596][52663] DAMAGECOUNT value on done: 18965.0 [2024-08-05 22:59:23,598][52663] Sum rewards: 15.122, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.110', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.087', 'weapon4': '0.440', 'WEAPON3': '0.550', 'ARMOR': '0.858', 'HITCOUNT': '0.950', 'weapon2': '1.142', 'weapon3': '1.528', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '11.000'} [2024-08-05 22:59:23,760][52650] Updated weights for policy 0, policy_version 11631 (0.0035) [2024-08-05 22:59:24,010][52669] DAMAGECOUNT value on done: 17192.0 [2024-08-05 22:59:24,010][52669] Sum rewards: 12.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.877', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'weapon5': '0.002', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon4': '0.174', 'WEAPON3': '1.100', 'ARMOR': '1.328', 'HITCOUNT': '1.450', 'weapon2': '1.756', 'weapon3': '1.912', 'DAMAGECOUNT': '5.139', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:24,257][52666] DAMAGECOUNT value on done: 16460.0 [2024-08-05 22:59:24,257][52666] Sum rewards: 8.580, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.910', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.040', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.394', 'ARMOR': '0.449', 'HITCOUNT': '0.800', 'weapon3': '0.982', 'weapon2': '1.114', 'DAMAGECOUNT': '2.715', 'FRAGCOUNT': '5.000'} [2024-08-05 22:59:24,361][52670] DAMAGECOUNT value on done: 17944.0 [2024-08-05 22:59:24,362][52670] Sum rewards: 17.317, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.980', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'weapon5': '0.084', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'weapon4': '0.466', 'WEAPON3': '0.800', 'weapon2': '1.170', 'HITCOUNT': '1.290', 'weapon3': '1.784', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:25,482][52665] DAMAGECOUNT value on done: 18736.0 [2024-08-05 22:59:25,482][52665] Sum rewards: 13.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.350', 'weapon4': '0.546', 'weapon2': '0.748', 'ARMOR': '0.937', 'WEAPON3': '1.000', 'HITCOUNT': '1.320', 'weapon3': '2.022', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:26,402][52820] DAMAGECOUNT value on done: 16239.0 [2024-08-05 22:59:26,403][52820] Sum rewards: 14.153, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.198', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'WEAPON3': '0.600', 'HITCOUNT': '1.320', 'weapon3': '1.422', 'weapon2': '1.922', 'ARMOR': '2.156', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:26,717][52667] DAMAGECOUNT value on done: 17733.0 [2024-08-05 22:59:26,718][52667] Sum rewards: 7.414, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.904', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon7': '0.062', 'AMMO4': '0.105', 'AMMO3': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'HITCOUNT': '0.760', 'weapon3': '1.190', 'weapon2': '1.480', 'DAMAGECOUNT': '2.826', 'FRAGCOUNT': '6.000'} [2024-08-05 22:59:27,794][52567] Fps is (10 sec: 15564.8, 60 sec: 16657.1, 300 sec: 16717.2). Total num frames: 95330304. Throughput: 0: 4134.7. Samples: 23840800. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 22:59:27,794][52567] Avg episode reward: [(0, '15.157')] [2024-08-05 22:59:27,819][52663] DAMAGECOUNT value on done: 18118.0 [2024-08-05 22:59:27,823][52663] Sum rewards: 18.245, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.102', 'AMMO2': '0.003', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon7': '0.064', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.392', 'ARMOR': '0.420', 'WEAPON3': '0.550', 'HITCOUNT': '1.040', 'weapon2': '1.106', 'weapon3': '1.426', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:27,989][52666] DAMAGECOUNT value on done: 15951.0 [2024-08-05 22:59:27,994][52666] Sum rewards: 19.421, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.861', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.122', 'ARMOR': '0.891', 'WEAPON3': '0.900', 'weapon2': '1.212', 'HITCOUNT': '1.540', 'weapon3': '2.618', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:28,114][52670] DAMAGECOUNT value on done: 16520.0 [2024-08-05 22:59:28,115][52670] Sum rewards: 19.602, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.672', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'ARMOR': '0.458', 'WEAPON3': '0.700', 'weapon4': '0.704', 'weapon2': '0.860', 'HITCOUNT': '1.430', 'weapon3': '1.550', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:28,195][52669] DAMAGECOUNT value on done: 20520.0 [2024-08-05 22:59:28,197][52669] Sum rewards: 22.164, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.722', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.456', 'ARMOR': '0.492', 'WEAPON3': '0.500', 'HITCOUNT': '1.340', 'weapon3': '1.428', 'weapon2': '1.462', 'DAMAGECOUNT': '4.671', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:28,617][52665] DAMAGECOUNT value on done: 19856.0 [2024-08-05 22:59:28,618][52665] Sum rewards: 7.754, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.224', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'AMMO3': '0.127', 'weapon4': '0.136', 'ARMOR': '0.457', 'WEAPON3': '0.850', 'HITCOUNT': '1.150', 'weapon2': '1.278', 'weapon3': '1.774', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '9.000'} [2024-08-05 22:59:30,034][52650] Updated weights for policy 0, policy_version 11641 (0.0015) [2024-08-05 22:59:30,146][52820] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon7', 0.002)] [2024-08-05 22:59:30,297][52820] DAMAGECOUNT value on done: 17422.0 [2024-08-05 22:59:30,300][52820] Sum rewards: 11.880, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.174', 'AMMO2': '0.014', 'weapon7': '0.046', 'AMMO4': '0.071', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON3': '0.850', 'ARMOR': '0.854', 'HITCOUNT': '1.190', 'weapon2': '1.470', 'weapon3': '1.802', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '11.000'} [2024-08-05 22:59:30,304][52667] DAMAGECOUNT value on done: 19319.0 [2024-08-05 22:59:30,308][52667] Sum rewards: 15.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.517', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.116', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'ARMOR': '0.453', 'WEAPON3': '1.100', 'HITCOUNT': '1.200', 'weapon2': '1.460', 'weapon3': '2.152', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:31,506][52666] DAMAGECOUNT value on done: 16628.0 [2024-08-05 22:59:31,507][52666] Sum rewards: 5.513, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.926', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.072', 'ARMOR': '0.076', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'WEAPON4': '0.350', 'weapon4': '0.598', 'WEAPON3': '0.600', 'HITCOUNT': '0.750', 'weapon2': '0.784', 'weapon3': '1.490', 'DAMAGECOUNT': '2.322', 'FRAGCOUNT': '5.000'} [2024-08-05 22:59:31,635][52670] DAMAGECOUNT value on done: 16563.0 [2024-08-05 22:59:31,636][52670] Sum rewards: 10.022, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.080', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'weapon4': '0.462', 'WEAPON3': '0.650', 'HITCOUNT': '0.670', 'weapon2': '0.894', 'weapon3': '1.532', 'DAMAGECOUNT': '2.205', 'FRAGCOUNT': '9.000'} [2024-08-05 22:59:31,725][52663] DAMAGECOUNT value on done: 18224.0 [2024-08-05 22:59:31,726][52663] Sum rewards: 9.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.628', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.044', 'AMMO3': '0.151', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.366', 'ARMOR': '0.472', 'WEAPON3': '0.900', 'weapon2': '1.008', 'HITCOUNT': '1.210', 'weapon3': '1.790', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:31,863][52665] DAMAGECOUNT value on done: 17704.0 [2024-08-05 22:59:31,864][52665] Sum rewards: 16.590, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.036', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.109', 'weapon4': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.495', 'WEAPON3': '0.800', 'weapon2': '1.222', 'HITCOUNT': '1.310', 'weapon3': '1.910', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:31,927][52669] DAMAGECOUNT value on done: 19149.0 [2024-08-05 22:59:31,930][52669] Sum rewards: 20.885, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.455', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON3': '0.800', 'ARMOR': '1.251', 'HITCOUNT': '1.310', 'weapon2': '1.740', 'weapon3': '1.870', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '17.000'} [2024-08-05 22:59:32,549][52669] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon5', 0.002)] [2024-08-05 22:59:32,794][52567] Fps is (10 sec: 14745.6, 60 sec: 16384.0, 300 sec: 16661.7). Total num frames: 95404032. Throughput: 0: 4091.3. Samples: 23851550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:59:32,794][52567] Avg episode reward: [(0, '15.121')] [2024-08-05 22:59:33,672][52667] DAMAGECOUNT value on done: 18306.0 [2024-08-05 22:59:33,672][52667] Sum rewards: 24.234, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.101', 'HEALTH': '0.134', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'ARMOR': '1.200', 'weapon2': '1.478', 'weapon3': '2.000', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '20.000'} [2024-08-05 22:59:33,933][52820] DAMAGECOUNT value on done: 16357.0 [2024-08-05 22:59:33,933][52820] Sum rewards: 24.596, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.932', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.068', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON3': '0.850', 'ARMOR': '0.884', 'weapon2': '1.636', 'HITCOUNT': '1.760', 'weapon3': '1.816', 'DAMAGECOUNT': '6.600', 'FRAGCOUNT': '21.000'} [2024-08-05 22:59:34,468][52665] DAMAGECOUNT value on done: 17571.0 [2024-08-05 22:59:34,468][52665] Sum rewards: 8.471, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.071', 'AMMO5': '0.020', 'AMMO2': '0.022', 'AMMO3': '0.066', 'AMMO4': '0.108', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON3': '0.450', 'HITCOUNT': '0.710', 'ARMOR': '0.909', 'weapon2': '0.996', 'weapon3': '1.414', 'DAMAGECOUNT': '3.315', 'FRAGCOUNT': '6.500'} [2024-08-05 22:59:34,544][52663] DAMAGECOUNT value on done: 20083.0 [2024-08-05 22:59:34,546][52663] Sum rewards: 14.067, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.056', 'AMMO2': '0.012', 'ARMOR': '0.052', 'AMMO4': '0.061', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'weapon4': '0.670', 'HITCOUNT': '0.940', 'weapon2': '1.106', 'weapon3': '1.374', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '11.000'} [2024-08-05 22:59:34,636][52650] Updated weights for policy 0, policy_version 11651 (0.0046) [2024-08-05 22:59:34,783][52666] DAMAGECOUNT value on done: 19135.0 [2024-08-05 22:59:34,783][52666] Sum rewards: 17.297, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.096', 'AMMO4': '0.177', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.068', 'HITCOUNT': '1.260', 'weapon3': '1.926', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:34,846][52670] DAMAGECOUNT value on done: 17344.0 [2024-08-05 22:59:34,846][52669] DAMAGECOUNT value on done: 19773.0 [2024-08-05 22:59:34,846][52670] Sum rewards: 16.081, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.049', 'weapon4': '0.058', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.098', 'HITCOUNT': '1.280', 'weapon3': '1.626', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:34,848][52669] Sum rewards: 22.065, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.843', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.850', 'ARMOR': '0.855', 'weapon2': '1.534', 'HITCOUNT': '1.820', 'weapon3': '1.864', 'DAMAGECOUNT': '6.411', 'FRAGCOUNT': '17.000'} [2024-08-05 22:59:36,691][52667] DAMAGECOUNT value on done: 18841.0 [2024-08-05 22:59:36,699][52667] Sum rewards: 16.666, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.333', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.024', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '1.136', 'WEAPON3': '1.150', 'HITCOUNT': '1.280', 'weapon3': '2.524', 'DAMAGECOUNT': '4.719', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:36,944][52665] DAMAGECOUNT value on done: 18482.0 [2024-08-05 22:59:36,945][52665] Sum rewards: 14.607, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.032', 'ARMOR': '0.040', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon4': '0.260', 'HEALTH': '0.320', 'WEAPON3': '0.500', 'HITCOUNT': '1.460', 'weapon2': '1.512', 'weapon3': '1.572', 'DAMAGECOUNT': '4.515', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:37,119][52820] DAMAGECOUNT value on done: 17665.0 [2024-08-05 22:59:37,120][52820] Sum rewards: 20.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.106', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.010', 'AMMO3': '0.101', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.308', 'WEAPON3': '0.800', 'ARMOR': '0.978', 'weapon2': '1.258', 'HITCOUNT': '1.590', 'weapon3': '1.986', 'DAMAGECOUNT': '6.210', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:37,162][52664] DAMAGECOUNT value on done: 18954.0 [2024-08-05 22:59:37,163][52664] Sum rewards: 5.343, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.590', 'AMMO2': '0.037', 'weapon4': '0.098', 'AMMO3': '0.140', 'AMMO4': '0.187', 'WEAPON4': '0.400', 'ARMOR': '0.535', 'HITCOUNT': '0.850', 'WEAPON3': '1.000', 'weapon2': '1.158', 'weapon3': '2.144', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '6.000'} [2024-08-05 22:59:37,188][52666] DAMAGECOUNT value on done: 17564.0 [2024-08-05 22:59:37,188][52666] Sum rewards: 28.364, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.433', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.116', 'weapon4': '0.384', 'WEAPON3': '0.600', 'ARMOR': '0.889', 'weapon2': '1.304', 'weapon3': '1.644', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '6.738', 'FRAGCOUNT': '21.000'} [2024-08-05 22:59:37,279][52670] DAMAGECOUNT value on done: 16509.0 [2024-08-05 22:59:37,283][52670] Sum rewards: 12.108, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.315', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'AMMO3': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.292', 'WEAPON3': '0.400', 'HITCOUNT': '0.800', 'weapon3': '1.170', 'ARMOR': '1.325', 'weapon2': '1.418', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:37,733][52663] DAMAGECOUNT value on done: 17371.0 [2024-08-05 22:59:37,734][52663] Sum rewards: 16.568, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.444', 'AMMO2': '0.023', 'weapon4': '0.086', 'AMMO3': '0.097', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.272', 'weapon3': '2.002', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16520.5, 300 sec: 16689.5). Total num frames: 95494144. Throughput: 0: 4100.7. Samples: 23876850. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 22:59:37,794][52567] Avg episode reward: [(0, '15.547')] [2024-08-05 22:59:38,103][52669] DAMAGECOUNT value on done: 19519.0 [2024-08-05 22:59:38,103][52669] Sum rewards: 11.554, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.054', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'weapon4': '0.256', 'ARMOR': '0.408', 'WEAPON3': '0.850', 'weapon2': '1.000', 'HITCOUNT': '1.300', 'weapon3': '2.396', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:39,413][52667] DAMAGECOUNT value on done: 18678.0 [2024-08-05 22:59:39,413][52667] Sum rewards: 11.307, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.214', 'AMMO2': '0.034', 'AMMO3': '0.103', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'ARMOR': '0.439', 'weapon4': '0.548', 'WEAPON3': '0.600', 'weapon2': '0.864', 'HITCOUNT': '0.980', 'weapon3': '1.560', 'DAMAGECOUNT': '3.525', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:39,694][52650] Updated weights for policy 0, policy_version 11661 (0.0012) [2024-08-05 22:59:39,865][52664] DAMAGECOUNT value on done: 16919.0 [2024-08-05 22:59:39,866][52664] Sum rewards: 16.177, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.096', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.550', 'ARMOR': '0.836', 'weapon2': '1.106', 'HITCOUNT': '1.130', 'weapon3': '1.788', 'DAMAGECOUNT': '3.924', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:40,021][52665] DAMAGECOUNT value on done: 17906.0 [2024-08-05 22:59:40,022][52665] Sum rewards: 16.691, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.260', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.083', 'WEAPON4': '0.300', 'weapon4': '0.446', 'WEAPON3': '0.700', 'ARMOR': '0.975', 'HITCOUNT': '1.140', 'weapon3': '1.432', 'weapon2': '1.574', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:40,097][52820] DAMAGECOUNT value on done: 19285.0 [2024-08-05 22:59:40,099][52820] Sum rewards: 18.860, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon4': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '1.280', 'weapon3': '1.336', 'weapon2': '1.718', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:40,181][52670] DAMAGECOUNT value on done: 17182.0 [2024-08-05 22:59:40,181][52670] Sum rewards: 11.040, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-1.095', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO3': '0.040', 'weapon7': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.122', 'WEAPON7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.433', 'weapon3': '0.922', 'HITCOUNT': '0.970', 'weapon2': '1.326', 'DAMAGECOUNT': '3.270', 'FRAGCOUNT': '7.000'} [2024-08-05 22:59:41,116][52663] DAMAGECOUNT value on done: 18896.0 [2024-08-05 22:59:41,116][52663] Sum rewards: 13.822, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.046', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.136', 'WEAPON3': '0.500', 'ARMOR': '0.851', 'HITCOUNT': '1.180', 'weapon3': '1.400', 'weapon2': '1.552', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '9.000'} [2024-08-05 22:59:41,469][52669] DAMAGECOUNT value on done: 19173.0 [2024-08-05 22:59:41,469][52669] Sum rewards: 10.923, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.480', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO3': '0.079', 'weapon4': '0.120', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'ARMOR': '0.460', 'WEAPON3': '0.500', 'HITCOUNT': '0.860', 'weapon2': '0.990', 'weapon3': '1.378', 'DAMAGECOUNT': '3.576', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:42,053][52664] DAMAGECOUNT value on done: 20140.0 [2024-08-05 22:59:42,055][52664] Sum rewards: 25.546, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.650', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.162', 'weapon4': '0.246', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.178', 'HITCOUNT': '1.450', 'weapon3': '1.558', 'DAMAGECOUNT': '6.636', 'FRAGCOUNT': '19.000'} [2024-08-05 22:59:42,101][52667] DAMAGECOUNT value on done: 20765.0 [2024-08-05 22:59:42,101][52667] Sum rewards: 22.847, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.221', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.089', 'WEAPON3': '0.650', 'ARMOR': '0.884', 'HITCOUNT': '1.440', 'weapon3': '1.694', 'weapon2': '2.152', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '18.000'} [2024-08-05 22:59:42,794][52567] Fps is (10 sec: 18021.7, 60 sec: 16657.0, 300 sec: 16689.4). Total num frames: 95584256. Throughput: 0: 4115.5. Samples: 23903220. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 22:59:42,795][52567] Avg episode reward: [(0, '15.721')] [2024-08-05 22:59:43,041][52820] DAMAGECOUNT value on done: 17748.0 [2024-08-05 22:59:43,041][52820] Sum rewards: 12.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.786', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.032', 'weapon4': '0.040', 'AMMO4': '0.076', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.970', 'WEAPON3': '1.050', 'HITCOUNT': '1.300', 'weapon3': '2.392', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:43,124][52665] DAMAGECOUNT value on done: 18582.0 [2024-08-05 22:59:43,125][52665] Sum rewards: 14.269, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'ARMOR': '0.048', 'AMMO3': '0.142', 'weapon5': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.538', 'weapon2': '0.730', 'WEAPON3': '0.950', 'HITCOUNT': '1.400', 'weapon3': '1.886', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:43,814][52794] DAMAGECOUNT value on done: 20880.0 [2024-08-05 22:59:43,817][52794] Sum rewards: 17.221, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.020', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON3': '0.950', 'weapon2': '1.340', 'HITCOUNT': '1.350', 'weapon3': '2.102', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:44,127][52650] Updated weights for policy 0, policy_version 11671 (0.0010) [2024-08-05 22:59:44,443][52663] DAMAGECOUNT value on done: 21231.0 [2024-08-05 22:59:44,446][52663] Sum rewards: 18.251, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.828', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.040', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.108', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '0.802', 'weapon2': '0.994', 'HITCOUNT': '1.370', 'weapon3': '1.644', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:44,618][52664] DAMAGECOUNT value on done: 17809.0 [2024-08-05 22:59:44,619][52664] Sum rewards: 15.755, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.010', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'weapon4': '0.148', 'WEAPON3': '0.500', 'ARMOR': '0.952', 'HITCOUNT': '1.030', 'weapon3': '1.464', 'weapon2': '1.610', 'DAMAGECOUNT': '3.618', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:44,649][52669] DAMAGECOUNT value on done: 18549.0 [2024-08-05 22:59:44,649][52669] Sum rewards: 18.922, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO4': '0.030', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'ARMOR': '1.294', 'weapon2': '1.514', 'weapon3': '1.778', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:45,138][52667] DAMAGECOUNT value on done: 19739.0 [2024-08-05 22:59:45,138][52667] Sum rewards: 21.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.226', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.034', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.226', 'ARMOR': '0.457', 'weapon2': '0.896', 'WEAPON3': '1.500', 'HITCOUNT': '1.730', 'weapon3': '2.716', 'DAMAGECOUNT': '6.357', 'FRAGCOUNT': '25.000'} [2024-08-05 22:59:46,078][52665] DAMAGECOUNT value on done: 18460.0 [2024-08-05 22:59:46,080][52665] Sum rewards: 12.285, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO2': '0.030', 'AMMO3': '0.105', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.875', 'HITCOUNT': '1.140', 'weapon2': '1.492', 'weapon3': '1.644', 'DAMAGECOUNT': '4.152', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:46,295][52794] DAMAGECOUNT value on done: 22497.0 [2024-08-05 22:59:46,295][52794] Sum rewards: 8.938, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.514', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.058', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON3': '0.800', 'HITCOUNT': '0.990', 'weapon2': '1.510', 'ARMOR': '1.653', 'weapon3': '1.896', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '7.000'} [2024-08-05 22:59:47,184][52664] DAMAGECOUNT value on done: 17903.0 [2024-08-05 22:59:47,192][52664] Sum rewards: 21.405, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.215', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'weapon5': '0.068', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.288', 'ARMOR': '0.485', 'WEAPON3': '0.700', 'HITCOUNT': '1.420', 'weapon2': '1.434', 'weapon3': '1.702', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:47,343][52663] DAMAGECOUNT value on done: 17389.0 [2024-08-05 22:59:47,346][52663] Sum rewards: 17.892, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.230', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.242', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.150', 'HITCOUNT': '1.420', 'weapon3': '1.506', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:47,561][52669] DAMAGECOUNT value on done: 19573.0 [2024-08-05 22:59:47,563][52669] Sum rewards: 14.452, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.700', 'HITCOUNT': '1.370', 'weapon3': '1.536', 'weapon2': '1.678', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16657.1, 300 sec: 16717.2). Total num frames: 95674368. Throughput: 0: 4136.7. Samples: 23916620. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 22:59:47,794][52567] Avg episode reward: [(0, '15.831')] [2024-08-05 22:59:47,923][52667] DAMAGECOUNT value on done: 17980.0 [2024-08-05 22:59:47,925][52667] Sum rewards: 16.137, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.116', 'WEAPON3': '0.800', 'ARMOR': '0.888', 'HITCOUNT': '1.050', 'weapon2': '1.894', 'weapon3': '1.958', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:48,156][52662] DAMAGECOUNT value on done: 21393.0 [2024-08-05 22:59:48,156][52662] Sum rewards: 23.315, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.232', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO3': '0.092', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.406', 'ARMOR': '0.408', 'WEAPON3': '0.550', 'HITCOUNT': '1.240', 'weapon2': '1.290', 'weapon3': '1.454', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '19.000'} [2024-08-05 22:59:48,888][52650] Updated weights for policy 0, policy_version 11681 (0.0019) [2024-08-05 22:59:49,027][52665] DAMAGECOUNT value on done: 18082.0 [2024-08-05 22:59:49,027][52665] Sum rewards: 10.707, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.049', 'HEALTH': '0.102', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'weapon5': '0.226', 'AMMO4': '0.245', 'WEAPON4': '0.350', 'ARMOR': '0.470', 'weapon4': '0.544', 'weapon2': '0.626', 'WEAPON3': '0.650', 'HITCOUNT': '0.910', 'weapon3': '2.030', 'DAMAGECOUNT': '2.985', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:49,287][52794] DAMAGECOUNT value on done: 23350.0 [2024-08-05 22:59:49,289][52794] Sum rewards: 18.706, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.546', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO3': '0.116', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.524', 'WEAPON3': '0.750', 'ARMOR': '0.939', 'weapon2': '1.254', 'weapon3': '1.500', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.204', 'FRAGCOUNT': '14.000'} [2024-08-05 22:59:50,086][52664] DAMAGECOUNT value on done: 20947.0 [2024-08-05 22:59:50,086][52664] Sum rewards: 21.455, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.108', 'HEALTH': '0.380', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.402', 'HITCOUNT': '1.560', 'weapon3': '1.962', 'DAMAGECOUNT': '5.658', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:50,353][52663] DAMAGECOUNT value on done: 18907.0 [2024-08-05 22:59:50,355][52663] Sum rewards: 21.079, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.288', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.432', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '1.282', 'HITCOUNT': '1.430', 'weapon3': '1.802', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:50,639][52667] DAMAGECOUNT value on done: 19513.0 [2024-08-05 22:59:50,640][52667] Sum rewards: 18.927, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.679', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.888', 'WEAPON3': '1.000', 'weapon2': '1.230', 'HITCOUNT': '1.470', 'weapon3': '1.900', 'DAMAGECOUNT': '5.265', 'FRAGCOUNT': '17.000'} [2024-08-05 22:59:51,055][52658] DAMAGECOUNT value on done: 19167.0 [2024-08-05 22:59:51,056][52658] Sum rewards: 17.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'ARMOR': '0.859', 'WEAPON3': '1.050', 'weapon2': '1.430', 'HITCOUNT': '1.600', 'weapon3': '2.256', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '18.000'} [2024-08-05 22:59:51,246][52662] DAMAGECOUNT value on done: 22554.0 [2024-08-05 22:59:51,247][52662] Sum rewards: 21.586, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.015', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.010', 'weapon5': '0.016', 'AMMO4': '0.041', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'ARMOR': '0.504', 'WEAPON3': '0.950', 'weapon2': '1.572', 'HITCOUNT': '1.610', 'weapon3': '1.878', 'DAMAGECOUNT': '6.498', 'FRAGCOUNT': '18.000'} [2024-08-05 22:59:52,124][52665] DAMAGECOUNT value on done: 16891.0 [2024-08-05 22:59:52,124][52665] Sum rewards: 15.660, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.981', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'weapon2': '1.656', 'weapon3': '1.910', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:52,347][52794] DAMAGECOUNT value on done: 20238.0 [2024-08-05 22:59:52,355][52794] Sum rewards: 10.748, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.528', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.111', 'WEAPON3': '0.800', 'HITCOUNT': '1.130', 'ARMOR': '1.252', 'weapon2': '1.522', 'weapon3': '1.612', 'DAMAGECOUNT': '3.843', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:52,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 95756288. Throughput: 0: 4162.9. Samples: 23943200. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:59:52,794][52567] Avg episode reward: [(0, '15.725')] [2024-08-05 22:59:52,926][52664] DAMAGECOUNT value on done: 18536.0 [2024-08-05 22:59:52,926][52664] Sum rewards: 11.907, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.035', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.266', 'WEAPON3': '0.450', 'ARMOR': '0.852', 'weapon2': '0.896', 'HITCOUNT': '0.920', 'weapon3': '0.964', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '9.000'} [2024-08-05 22:59:53,168][52650] Updated weights for policy 0, policy_version 11691 (0.0039) [2024-08-05 22:59:53,209][52663] DAMAGECOUNT value on done: 21210.0 [2024-08-05 22:59:53,210][52663] Sum rewards: 15.964, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.447', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '0.886', 'ARMOR': '0.893', 'weapon2': '1.004', 'HITCOUNT': '1.390', 'weapon3': '1.828', 'DAMAGECOUNT': '4.761', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:53,304][52667] DAMAGECOUNT value on done: 19292.0 [2024-08-05 22:59:53,306][52667] Sum rewards: 11.078, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.990', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO3': '0.096', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.853', 'HITCOUNT': '1.060', 'weapon3': '1.458', 'weapon2': '1.544', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:53,751][52658] DAMAGECOUNT value on done: 18447.0 [2024-08-05 22:59:53,751][52658] Sum rewards: 18.026, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.050', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.047', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.650', 'weapon2': '0.988', 'HITCOUNT': '1.180', 'weapon3': '1.884', 'DAMAGECOUNT': '3.738', 'FRAGCOUNT': '15.000'} [2024-08-05 22:59:54,346][52662] DAMAGECOUNT value on done: 24881.0 [2024-08-05 22:59:54,346][52662] Sum rewards: 21.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.731', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.117', 'weapon4': '0.120', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'weapon2': '1.166', 'ARMOR': '1.360', 'HITCOUNT': '1.490', 'weapon3': '1.654', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '16.000'} [2024-08-05 22:59:55,196][52665] DAMAGECOUNT value on done: 17619.0 [2024-08-05 22:59:55,197][52665] Sum rewards: 3.324, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.232', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.086', 'WEAPON3': '0.600', 'HITCOUNT': '0.640', 'ARMOR': '0.868', 'weapon3': '1.118', 'weapon2': '1.640', 'DAMAGECOUNT': '2.232', 'FRAGCOUNT': '4.000'} [2024-08-05 22:59:55,447][52664] DAMAGECOUNT value on done: 17895.0 [2024-08-05 22:59:55,447][52664] Sum rewards: 8.181, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.443', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.034', 'AMMO3': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'ARMOR': '0.440', 'WEAPON4': '0.550', 'HITCOUNT': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.830', 'weapon4': '0.870', 'weapon3': '1.758', 'DAMAGECOUNT': '2.058', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:55,497][52794] DAMAGECOUNT value on done: 22025.0 [2024-08-05 22:59:55,498][52794] Sum rewards: 11.415, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.203', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.052', 'weapon4': '0.246', 'WEAPON3': '0.350', 'ARMOR': '0.400', 'HITCOUNT': '0.830', 'weapon2': '0.850', 'weapon3': '1.008', 'DAMAGECOUNT': '2.712', 'FRAGCOUNT': '8.000'} [2024-08-05 22:59:55,884][52667] DAMAGECOUNT value on done: 17978.0 [2024-08-05 22:59:55,885][52667] Sum rewards: 11.278, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon7': '0.052', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.174', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.851', 'weapon2': '0.860', 'WEAPON3': '1.050', 'HITCOUNT': '1.300', 'weapon3': '2.092', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '10.000'} [2024-08-05 22:59:56,031][52663] DAMAGECOUNT value on done: 18109.0 [2024-08-05 22:59:56,031][52663] Sum rewards: 16.198, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.466', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.092', 'AMMO3': '0.103', 'weapon4': '0.212', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon3': '1.352', 'weapon2': '1.432', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:56,421][52658] DAMAGECOUNT value on done: 16395.0 [2024-08-05 22:59:56,423][52658] Sum rewards: 17.777, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.115', 'weapon4': '0.276', 'HEALTH': '0.398', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'HITCOUNT': '1.330', 'weapon2': '1.396', 'weapon3': '1.598', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '13.000'} [2024-08-05 22:59:57,074][52662] DAMAGECOUNT value on done: 20887.0 [2024-08-05 22:59:57,076][52662] Sum rewards: 9.204, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.594', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO3': '0.064', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.880', 'weapon3': '1.114', 'weapon2': '1.150', 'DAMAGECOUNT': '3.240', 'FRAGCOUNT': '7.000'} [2024-08-05 22:59:57,795][52567] Fps is (10 sec: 16382.3, 60 sec: 16793.3, 300 sec: 16717.2). Total num frames: 95838208. Throughput: 0: 4192.1. Samples: 23969690. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 22:59:57,796][52567] Avg episode reward: [(0, '15.560')] [2024-08-05 22:59:57,894][52664] DAMAGECOUNT value on done: 20881.0 [2024-08-05 22:59:57,895][52664] Sum rewards: 10.469, reward structure: {'DEATHCOUNT': '-5.250', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'HEALTH': '0.184', 'WEAPON3': '0.550', 'ARMOR': '0.836', 'HITCOUNT': '1.000', 'weapon2': '1.242', 'weapon3': '1.746', 'DAMAGECOUNT': '3.531', 'FRAGCOUNT': '6.000'} [2024-08-05 22:59:58,116][52794] DAMAGECOUNT value on done: 21019.0 [2024-08-05 22:59:58,119][52794] Sum rewards: 24.800, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.842', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.234', 'WEAPON3': '0.850', 'ARMOR': '0.916', 'weapon2': '0.942', 'HITCOUNT': '1.560', 'weapon3': '1.916', 'DAMAGECOUNT': '6.288', 'FRAGCOUNT': '21.000'} [2024-08-05 22:59:58,313][52650] Updated weights for policy 0, policy_version 11701 (0.0026) [2024-08-05 22:59:58,344][52667] DAMAGECOUNT value on done: 18658.0 [2024-08-05 22:59:58,345][52667] Sum rewards: 7.741, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO2': '0.001', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.007', 'ARMOR': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'weapon4': '0.314', 'WEAPON3': '0.850', 'HITCOUNT': '1.040', 'weapon2': '1.134', 'weapon3': '2.026', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '7.000'} [2024-08-05 22:59:58,862][52658] DAMAGECOUNT value on done: 18127.0 [2024-08-05 22:59:58,862][52658] Sum rewards: 14.917, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.500', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.103', 'WEAPON3': '0.650', 'HITCOUNT': '1.110', 'weapon2': '1.714', 'weapon3': '1.746', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '12.000'} [2024-08-05 22:59:59,056][52663] DAMAGECOUNT value on done: 18796.0 [2024-08-05 22:59:59,057][52663] Sum rewards: 21.188, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.140', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.102', 'WEAPON4': '0.250', 'weapon4': '0.404', 'ARMOR': '0.513', 'WEAPON3': '0.700', 'HITCOUNT': '1.410', 'weapon2': '1.550', 'weapon3': '1.746', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '19.000'} [2024-08-05 23:00:00,085][52662] DAMAGECOUNT value on done: 21360.0 [2024-08-05 23:00:00,085][52662] Sum rewards: 13.011, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.555', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon4': '0.016', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.906', 'HITCOUNT': '1.320', 'weapon2': '1.650', 'weapon3': '1.712', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:00,510][52664] DAMAGECOUNT value on done: 19160.0 [2024-08-05 23:00:00,512][52664] Sum rewards: 23.563, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.090', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO5': '0.003', 'weapon5': '0.046', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'weapon2': '1.498', 'HITCOUNT': '1.650', 'weapon3': '1.718', 'DAMAGECOUNT': '5.739', 'FRAGCOUNT': '18.000'} [2024-08-05 23:00:01,033][52794] DAMAGECOUNT value on done: 22893.0 [2024-08-05 23:00:01,033][52794] Sum rewards: 12.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.754', 'AMMO2': '0.040', 'AMMO3': '0.116', 'AMMO4': '0.201', 'weapon4': '0.268', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.290', 'ARMOR': '1.328', 'weapon2': '1.542', 'weapon3': '1.946', 'DAMAGECOUNT': '4.752', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:01,321][52649] DAMAGECOUNT value on done: 18840.0 [2024-08-05 23:00:01,322][52649] Sum rewards: 16.681, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.508', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.300', 'weapon4': '0.342', 'ARMOR': '0.480', 'WEAPON3': '0.600', 'weapon2': '1.094', 'HITCOUNT': '1.250', 'weapon3': '1.700', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:01,496][52663] DAMAGECOUNT value on done: 17614.0 [2024-08-05 23:00:01,497][52663] Sum rewards: 8.011, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.576', 'weapon4': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.164', 'AMMO4': '0.212', 'WEAPON4': '0.450', 'ARMOR': '0.498', 'WEAPON3': '1.050', 'HITCOUNT': '1.050', 'weapon2': '1.190', 'weapon3': '1.914', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:01,704][52667] DAMAGECOUNT value on done: 18721.0 [2024-08-05 23:00:01,705][52667] Sum rewards: 18.893, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.278', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.314', 'WEAPON3': '0.700', 'ARMOR': '0.850', 'HITCOUNT': '1.290', 'weapon2': '1.332', 'weapon3': '1.812', 'DAMAGECOUNT': '5.016', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:02,246][52658] DAMAGECOUNT value on done: 19047.0 [2024-08-05 23:00:02,247][52658] Sum rewards: 16.830, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.592', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'weapon4': '0.006', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'ARMOR': '1.326', 'weapon2': '1.600', 'weapon3': '1.608', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:02,731][52650] Updated weights for policy 0, policy_version 11711 (0.0027) [2024-08-05 23:00:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16793.6, 300 sec: 16745.0). Total num frames: 95936512. Throughput: 0: 4207.6. Samples: 23982940. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:00:02,794][52567] Avg episode reward: [(0, '15.739')] [2024-08-05 23:00:02,818][52662] DAMAGECOUNT value on done: 22545.0 [2024-08-05 23:00:02,818][52662] Sum rewards: 14.821, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.914', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.032', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon4': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.854', 'WEAPON3': '0.950', 'weapon2': '1.172', 'HITCOUNT': '1.330', 'weapon3': '2.192', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:03,631][52664] DAMAGECOUNT value on done: 21708.0 [2024-08-05 23:00:03,631][52664] Sum rewards: 15.911, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.552', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.054', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'ARMOR': '0.852', 'weapon2': '1.376', 'HITCOUNT': '1.530', 'weapon3': '1.848', 'DAMAGECOUNT': '5.613', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:03,926][52794] DAMAGECOUNT value on done: 18339.0 [2024-08-05 23:00:03,930][52794] Sum rewards: 4.367, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.204', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.058', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'HITCOUNT': '0.850', 'weapon2': '1.286', 'weapon3': '1.954', 'DAMAGECOUNT': '2.931', 'FRAGCOUNT': '4.000'} [2024-08-05 23:00:04,374][52667] DAMAGECOUNT value on done: 18216.0 [2024-08-05 23:00:04,376][52667] Sum rewards: 10.185, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.355', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'weapon5': '0.070', 'AMMO3': '0.083', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.432', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'HITCOUNT': '0.740', 'weapon2': '0.844', 'weapon3': '1.240', 'DAMAGECOUNT': '2.655', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:04,419][52649] DAMAGECOUNT value on done: 18520.0 [2024-08-05 23:00:04,420][52649] Sum rewards: 15.673, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.094', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.200', 'ARMOR': '0.449', 'WEAPON3': '0.650', 'weapon4': '0.738', 'weapon2': '0.836', 'HITCOUNT': '1.090', 'weapon3': '1.660', 'DAMAGECOUNT': '3.894', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:04,589][52663] DAMAGECOUNT value on done: 18413.0 [2024-08-05 23:00:04,591][52663] Sum rewards: 19.496, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.053', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.228', 'ARMOR': '0.974', 'WEAPON3': '1.050', 'weapon2': '1.252', 'HITCOUNT': '1.660', 'weapon3': '1.846', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '17.000'} [2024-08-05 23:00:05,070][52658] DAMAGECOUNT value on done: 16561.0 [2024-08-05 23:00:05,070][52658] Sum rewards: 10.087, reward structure: {'DEATHCOUNT': '-9.000', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.157', 'HEALTH': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.498', 'WEAPON3': '0.800', 'HITCOUNT': '0.850', 'weapon2': '1.090', 'weapon3': '1.872', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:05,699][52662] DAMAGECOUNT value on done: 23831.0 [2024-08-05 23:00:05,699][52662] Sum rewards: 22.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.025', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.208', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.220', 'HITCOUNT': '1.490', 'weapon3': '2.126', 'DAMAGECOUNT': '6.201', 'FRAGCOUNT': '17.000'} [2024-08-05 23:00:06,433][52794] DAMAGECOUNT value on done: 22268.0 [2024-08-05 23:00:06,434][52794] Sum rewards: 11.861, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.090', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon4': '0.014', 'weapon5': '0.024', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '0.820', 'ARMOR': '0.904', 'weapon2': '1.214', 'weapon3': '1.450', 'DAMAGECOUNT': '3.186', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:06,521][52664] DAMAGECOUNT value on done: 17916.0 [2024-08-05 23:00:06,522][52664] Sum rewards: 16.233, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.722', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.286', 'ARMOR': '0.428', 'WEAPON3': '0.850', 'weapon2': '1.194', 'HITCOUNT': '1.290', 'weapon3': '1.876', 'DAMAGECOUNT': '5.061', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:06,981][52671] DAMAGECOUNT value on done: 21832.0 [2024-08-05 23:00:06,981][52671] Sum rewards: 18.000, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.610', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.070', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.436', 'HITCOUNT': '1.510', 'weapon2': '1.828', 'DAMAGECOUNT': '5.067', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:07,160][52663] DAMAGECOUNT value on done: 17745.0 [2024-08-05 23:00:07,161][52663] Sum rewards: 11.949, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.152', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.022', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.386', 'ARMOR': '0.571', 'WEAPON3': '0.600', 'HITCOUNT': '1.090', 'weapon2': '1.500', 'weapon3': '1.704', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:07,265][52667] DAMAGECOUNT value on done: 19773.0 [2024-08-05 23:00:07,265][52667] Sum rewards: 8.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.238', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.018', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'weapon4': '0.480', 'WEAPON3': '0.950', 'HITCOUNT': '1.190', 'weapon2': '1.504', 'weapon3': '1.630', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '9.500'} [2024-08-05 23:00:07,292][52650] Updated weights for policy 0, policy_version 11721 (0.0012) [2024-08-05 23:00:07,612][52649] DAMAGECOUNT value on done: 17922.0 [2024-08-05 23:00:07,612][52649] Sum rewards: 10.013, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.026', 'AMMO2': '0.023', 'AMMO3': '0.073', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'weapon4': '0.530', 'HITCOUNT': '0.800', 'ARMOR': '0.948', 'weapon2': '1.138', 'weapon3': '1.332', 'DAMAGECOUNT': '2.433', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:07,762][52658] DAMAGECOUNT value on done: 21393.0 [2024-08-05 23:00:07,763][52658] Sum rewards: 10.096, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'weapon5': '0.008', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.486', 'WEAPON3': '0.950', 'HITCOUNT': '1.330', 'weapon2': '1.420', 'weapon3': '1.870', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:07,794][52567] Fps is (10 sec: 18843.6, 60 sec: 16930.1, 300 sec: 16800.5). Total num frames: 96026624. Throughput: 0: 4223.8. Samples: 24009250. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:00:07,794][52567] Avg episode reward: [(0, '15.344')] [2024-08-05 23:00:08,213][52662] DAMAGECOUNT value on done: 24346.0 [2024-08-05 23:00:08,213][52662] Sum rewards: 24.150, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.732', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.006', 'WEAPON4': '0.050', 'weapon5': '0.086', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.240', 'WEAPON3': '0.700', 'weapon2': '1.526', 'weapon3': '1.670', 'HITCOUNT': '1.740', 'ARMOR': '1.762', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '19.000'} [2024-08-05 23:00:09,146][52664] DAMAGECOUNT value on done: 18369.0 [2024-08-05 23:00:09,147][52664] Sum rewards: 11.975, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.270', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.550', 'weapon4': '0.608', 'HITCOUNT': '0.980', 'weapon2': '1.072', 'weapon3': '1.638', 'DAMAGECOUNT': '3.336', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:09,216][52794] DAMAGECOUNT value on done: 22145.0 [2024-08-05 23:00:09,217][52794] Sum rewards: 21.188, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.198', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.246', 'WEAPON3': '0.350', 'weapon3': '1.012', 'HITCOUNT': '1.130', 'ARMOR': '1.237', 'weapon2': '1.264', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:09,730][52667] DAMAGECOUNT value on done: 20241.0 [2024-08-05 23:00:09,733][52667] Sum rewards: 20.207, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.551', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.342', 'WEAPON3': '0.650', 'ARMOR': '0.899', 'HITCOUNT': '1.340', 'weapon2': '1.500', 'weapon3': '1.842', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '16.000'} [2024-08-05 23:00:09,978][52671] DAMAGECOUNT value on done: 18033.0 [2024-08-05 23:00:09,979][52671] Sum rewards: 10.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'weapon4': '0.006', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '1.170', 'ARMOR': '1.341', 'weapon2': '1.496', 'weapon3': '2.062', 'DAMAGECOUNT': '3.753', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:10,062][52663] DAMAGECOUNT value on done: 19192.0 [2024-08-05 23:00:10,063][52663] Sum rewards: 11.018, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.118', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'AMMO3': '0.067', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.214', 'ARMOR': '0.435', 'WEAPON3': '0.450', 'HITCOUNT': '0.640', 'weapon2': '1.024', 'weapon3': '1.084', 'DAMAGECOUNT': '2.658', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:10,345][52658] DAMAGECOUNT value on done: 17257.0 [2024-08-05 23:00:10,345][52658] Sum rewards: 14.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.380', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO3': '0.098', 'ARMOR': '0.451', 'WEAPON3': '0.700', 'HITCOUNT': '1.030', 'weapon3': '1.320', 'weapon2': '1.522', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:10,818][52649] DAMAGECOUNT value on done: 17339.0 [2024-08-05 23:00:10,820][52649] Sum rewards: 11.999, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.715', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.162', 'weapon4': '0.336', 'WEAPON3': '0.550', 'ARMOR': '0.583', 'HITCOUNT': '0.780', 'weapon2': '1.054', 'weapon3': '1.146', 'DAMAGECOUNT': '2.919', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:11,342][52662] DAMAGECOUNT value on done: 22056.0 [2024-08-05 23:00:11,344][52662] Sum rewards: 15.542, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.701', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.070', 'weapon4': '0.244', 'WEAPON3': '0.550', 'HITCOUNT': '1.260', 'weapon3': '1.478', 'weapon2': '1.726', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '12.500'} [2024-08-05 23:00:12,126][52664] DAMAGECOUNT value on done: 17341.0 [2024-08-05 23:00:12,127][52664] Sum rewards: 9.077, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.174', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.456', 'WEAPON3': '0.650', 'HITCOUNT': '0.880', 'ARMOR': '1.281', 'weapon2': '1.466', 'weapon3': '1.534', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '6.000'} [2024-08-05 23:00:12,143][52794] DAMAGECOUNT value on done: 21959.0 [2024-08-05 23:00:12,145][52794] Sum rewards: 12.679, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.025', 'HEALTH': '0.040', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon4': '0.134', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '1.370', 'weapon2': '1.672', 'weapon3': '1.748', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:12,360][52650] Updated weights for policy 0, policy_version 11731 (0.0016) [2024-08-05 23:00:12,551][52671] DAMAGECOUNT value on done: 20331.0 [2024-08-05 23:00:12,551][52671] Sum rewards: 10.685, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.190', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'weapon5': '0.052', 'weapon7': '0.072', 'AMMO3': '0.090', 'ARMOR': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.522', 'WEAPON3': '0.650', 'weapon2': '0.736', 'HITCOUNT': '0.940', 'weapon3': '1.530', 'DAMAGECOUNT': '3.207', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 16772.8). Total num frames: 96108544. Throughput: 0: 4329.6. Samples: 24035630. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-05 23:00:12,794][52567] Avg episode reward: [(0, '15.427')] [2024-08-05 23:00:12,922][52667] DAMAGECOUNT value on done: 19886.0 [2024-08-05 23:00:12,923][52667] Sum rewards: 21.009, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.195', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO4': '0.008', 'weapon5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'WEAPON3': '0.600', 'HITCOUNT': '1.180', 'weapon3': '1.668', 'weapon2': '1.762', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '17.000'} [2024-08-05 23:00:13,015][52663] DAMAGECOUNT value on done: 19447.0 [2024-08-05 23:00:13,016][52663] Sum rewards: 18.806, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.099', 'AMMO3': '0.101', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.518', 'ARMOR': '0.533', 'WEAPON3': '0.700', 'weapon2': '1.188', 'HITCOUNT': '1.290', 'weapon3': '1.716', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:13,643][52658] DAMAGECOUNT value on done: 19380.0 [2024-08-05 23:00:13,645][52658] Sum rewards: 19.338, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.669', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon5': '0.112', 'AMMO3': '0.126', 'WEAPON3': '0.750', 'HITCOUNT': '1.210', 'ARMOR': '1.258', 'weapon2': '1.366', 'weapon3': '1.840', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '16.000'} [2024-08-05 23:00:13,862][52662] DAMAGECOUNT value on done: 22260.0 [2024-08-05 23:00:13,863][52662] Sum rewards: 16.849, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.062', 'weapon4': '0.170', 'HEALTH': '0.304', 'WEAPON3': '0.400', 'HITCOUNT': '1.220', 'weapon3': '1.262', 'ARMOR': '1.294', 'weapon2': '1.930', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:14,002][52649] DAMAGECOUNT value on done: 18764.0 [2024-08-05 23:00:14,002][52649] Sum rewards: 21.824, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.757', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon4': '0.152', 'WEAPON3': '0.700', 'weapon2': '1.462', 'weapon3': '1.624', 'HITCOUNT': '1.630', 'ARMOR': '1.776', 'DAMAGECOUNT': '6.312', 'FRAGCOUNT': '18.000'} [2024-08-05 23:00:14,599][52664] DAMAGECOUNT value on done: 18783.0 [2024-08-05 23:00:14,601][52664] Sum rewards: 6.530, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.119', 'AMMO2': '0.026', 'AMMO3': '0.123', 'AMMO4': '0.127', 'WEAPON4': '0.300', 'weapon4': '0.594', 'HITCOUNT': '0.680', 'WEAPON3': '0.800', 'ARMOR': '0.927', 'weapon2': '1.018', 'weapon3': '1.700', 'DAMAGECOUNT': '2.604', 'FRAGCOUNT': '7.000'} [2024-08-05 23:00:14,780][52794] DAMAGECOUNT value on done: 22340.0 [2024-08-05 23:00:14,781][52794] Sum rewards: 14.398, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.703', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.306', 'weapon2': '0.790', 'WEAPON3': '0.950', 'HITCOUNT': '1.270', 'weapon3': '2.290', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:15,554][52671] DAMAGECOUNT value on done: 17541.0 [2024-08-05 23:00:15,554][52671] Sum rewards: 8.654, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '0.600', 'HITCOUNT': '0.720', 'weapon2': '0.874', 'ARMOR': '0.972', 'weapon3': '1.364', 'DAMAGECOUNT': '2.310', 'FRAGCOUNT': '7.000'} [2024-08-05 23:00:15,555][52663] DAMAGECOUNT value on done: 18203.0 [2024-08-05 23:00:15,555][52663] Sum rewards: 21.844, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.457', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.054', 'AMMO3': '0.095', 'weapon4': '0.224', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'weapon2': '1.410', 'HITCOUNT': '1.430', 'weapon3': '1.888', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '17.000'} [2024-08-05 23:00:16,082][52667] DAMAGECOUNT value on done: 18168.0 [2024-08-05 23:00:16,093][52667] Sum rewards: 11.706, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.190', 'weapon4': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.540', 'WEAPON3': '0.600', 'HITCOUNT': '0.890', 'weapon2': '1.382', 'weapon3': '1.776', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:16,315][52659] DAMAGECOUNT value on done: 18901.0 [2024-08-05 23:00:16,316][52659] Sum rewards: 13.699, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.526', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon7': '0.050', 'weapon5': '0.076', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon2': '1.216', 'ARMOR': '1.285', 'weapon3': '1.326', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:16,646][52650] Updated weights for policy 0, policy_version 11741 (0.0020) [2024-08-05 23:00:16,706][52662] DAMAGECOUNT value on done: 21303.0 [2024-08-05 23:00:16,707][52662] Sum rewards: 13.632, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.027', 'AMMO3': '0.092', 'weapon4': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'HEALTH': '0.378', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.130', 'weapon3': '1.736', 'weapon2': '1.782', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:16,812][52658] DAMAGECOUNT value on done: 17913.0 [2024-08-05 23:00:16,813][52658] Sum rewards: 9.143, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.576', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.114', 'weapon7': '0.124', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.300', 'WEAPON7': '0.300', 'ARMOR': '0.485', 'weapon2': '0.538', 'WEAPON3': '0.600', 'weapon4': '0.722', 'HITCOUNT': '0.860', 'weapon3': '0.950', 'DAMAGECOUNT': '2.844', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:16,842][52649] DAMAGECOUNT value on done: 19793.0 [2024-08-05 23:00:16,842][52649] Sum rewards: 19.041, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.863', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.154', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '1.230', 'weapon3': '1.448', 'weapon2': '1.838', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '16.000'} [2024-08-05 23:00:17,623][52664] DAMAGECOUNT value on done: 16900.0 [2024-08-05 23:00:17,624][52664] Sum rewards: 19.194, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.099', 'ARMOR': '0.499', 'WEAPON3': '0.750', 'HITCOUNT': '1.430', 'weapon3': '1.766', 'weapon2': '1.822', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:17,689][52794] DAMAGECOUNT value on done: 21811.0 [2024-08-05 23:00:17,692][52794] Sum rewards: 10.221, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.073', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.816', 'HITCOUNT': '1.200', 'weapon3': '1.640', 'weapon2': '1.760', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 16800.5). Total num frames: 96198656. Throughput: 0: 4385.3. Samples: 24048890. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-05 23:00:17,794][52567] Avg episode reward: [(0, '15.105')] [2024-08-05 23:00:18,246][52663] DAMAGECOUNT value on done: 17278.0 [2024-08-05 23:00:18,246][52663] Sum rewards: 13.309, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.505', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.402', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.192', 'weapon3': '1.702', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:18,253][52671] DAMAGECOUNT value on done: 18378.0 [2024-08-05 23:00:18,253][52671] Sum rewards: 11.268, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.032', 'AMMO4': '0.044', 'AMMO3': '0.087', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.460', 'WEAPON3': '0.600', 'HITCOUNT': '1.000', 'weapon2': '1.132', 'weapon3': '1.284', 'DAMAGECOUNT': '3.351', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:18,386][52670] Large shaping reward -2.552 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.002, -2.0), ('AMMO5', -0.0005, -1.0)] [2024-08-05 23:00:18,806][52659] DAMAGECOUNT value on done: 19960.0 [2024-08-05 23:00:18,806][52659] Sum rewards: 11.896, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.648', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.104', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'weapon4': '0.280', 'WEAPON4': '0.300', 'ARMOR': '0.871', 'WEAPON3': '0.900', 'HITCOUNT': '1.030', 'weapon2': '1.038', 'weapon3': '1.612', 'DAMAGECOUNT': '4.251', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:19,187][52667] DAMAGECOUNT value on done: 18254.0 [2024-08-05 23:00:19,188][52667] Sum rewards: 11.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.283', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '1.050', 'weapon2': '1.538', 'weapon3': '1.662', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:19,388][52662] DAMAGECOUNT value on done: 20563.0 [2024-08-05 23:00:19,389][52662] Sum rewards: 12.979, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.986', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.163', 'weapon4': '0.164', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '1.330', 'weapon2': '1.440', 'ARMOR': '1.795', 'weapon3': '2.180', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:19,521][52649] DAMAGECOUNT value on done: 16229.0 [2024-08-05 23:00:19,523][52649] Sum rewards: 16.551, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO2': '0.036', 'AMMO3': '0.131', 'AMMO4': '0.178', 'WEAPON4': '0.400', 'ARMOR': '0.454', 'weapon4': '0.748', 'weapon2': '0.754', 'WEAPON3': '0.850', 'HITCOUNT': '1.350', 'weapon3': '1.734', 'DAMAGECOUNT': '4.806', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:19,842][52658] DAMAGECOUNT value on done: 19926.0 [2024-08-05 23:00:19,842][52658] Sum rewards: 11.142, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO2': '0.028', 'ARMOR': '0.084', 'AMMO3': '0.112', 'AMMO4': '0.138', 'WEAPON4': '0.350', 'weapon4': '0.690', 'WEAPON3': '0.750', 'weapon2': '0.800', 'HITCOUNT': '0.960', 'weapon3': '1.984', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:20,391][52794] DAMAGECOUNT value on done: 24058.0 [2024-08-05 23:00:20,391][52794] Sum rewards: 20.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.587', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.254', 'ARMOR': '0.486', 'weapon2': '0.698', 'WEAPON3': '1.150', 'HITCOUNT': '1.780', 'weapon3': '2.572', 'DAMAGECOUNT': '6.747', 'FRAGCOUNT': '19.000'} [2024-08-05 23:00:20,557][52664] DAMAGECOUNT value on done: 20019.0 [2024-08-05 23:00:20,558][52664] Sum rewards: 15.109, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.258', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'ARMOR': '0.420', 'weapon4': '0.594', 'WEAPON3': '0.600', 'HITCOUNT': '0.990', 'weapon2': '1.000', 'weapon3': '1.376', 'DAMAGECOUNT': '3.300', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:20,834][52671] DAMAGECOUNT value on done: 19330.0 [2024-08-05 23:00:20,835][52671] Sum rewards: 19.790, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.181', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'WEAPON4': '0.050', 'AMMO3': '0.077', 'weapon4': '0.316', 'WEAPON3': '0.600', 'ARMOR': '0.962', 'weapon2': '1.282', 'HITCOUNT': '1.400', 'weapon3': '1.412', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:21,239][52650] Updated weights for policy 0, policy_version 11751 (0.0016) [2024-08-05 23:00:21,265][52663] DAMAGECOUNT value on done: 18163.0 [2024-08-05 23:00:21,266][52663] Sum rewards: 15.413, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.170', 'weapon4': '0.290', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'HEALTH': '0.894', 'weapon2': '0.896', 'HITCOUNT': '1.310', 'weapon3': '2.142', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:21,309][52659] DAMAGECOUNT value on done: 19302.0 [2024-08-05 23:00:21,309][52659] Sum rewards: 15.856, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.746', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.052', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'ARMOR': '0.532', 'WEAPON3': '0.850', 'HITCOUNT': '1.140', 'weapon2': '1.272', 'weapon3': '1.860', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:21,577][52803] DAMAGECOUNT value on done: 17179.0 [2024-08-05 23:00:21,579][52803] Sum rewards: 12.885, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.334', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.144', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.471', 'WEAPON3': '0.950', 'HITCOUNT': '1.470', 'weapon2': '1.602', 'weapon3': '2.044', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:22,084][52667] DAMAGECOUNT value on done: 19602.0 [2024-08-05 23:00:22,086][52667] Sum rewards: 7.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.496', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.134', 'ARMOR': '0.463', 'weapon4': '0.466', 'WEAPON3': '0.750', 'HITCOUNT': '0.980', 'weapon2': '1.074', 'weapon3': '1.994', 'DAMAGECOUNT': '3.297', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:22,257][52662] DAMAGECOUNT value on done: 23362.0 [2024-08-05 23:00:22,259][52662] Sum rewards: 16.049, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.096', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.017', 'weapon5': '0.062', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.252', 'ARMOR': '0.416', 'WEAPON3': '0.850', 'weapon2': '1.324', 'HITCOUNT': '1.480', 'weapon3': '1.986', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:22,417][52649] DAMAGECOUNT value on done: 17513.0 [2024-08-05 23:00:22,417][52649] Sum rewards: 11.664, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.052', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'weapon4': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'ARMOR': '0.930', 'WEAPON3': '0.950', 'weapon2': '1.362', 'HITCOUNT': '1.600', 'weapon3': '2.184', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17203.2, 300 sec: 16828.3). Total num frames: 96288768. Throughput: 0: 4416.9. Samples: 24075610. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:00:22,794][52567] Avg episode reward: [(0, '14.784')] [2024-08-05 23:00:22,923][52658] DAMAGECOUNT value on done: 18173.0 [2024-08-05 23:00:22,927][52658] Sum rewards: 12.731, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.340', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'weapon5': '0.050', 'AMMO3': '0.077', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.336', 'ARMOR': '0.532', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'weapon3': '1.598', 'weapon2': '1.632', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:23,302][52664] DAMAGECOUNT value on done: 17613.0 [2024-08-05 23:00:23,302][52664] Sum rewards: 13.960, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.618', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.058', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '1.180', 'weapon2': '1.486', 'weapon3': '1.876', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:23,385][52671] DAMAGECOUNT value on done: 19356.0 [2024-08-05 23:00:23,387][52671] Sum rewards: 15.368, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.540', 'WEAPON3': '0.600', 'weapon2': '0.716', 'HITCOUNT': '1.160', 'weapon3': '1.540', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:23,396][52794] DAMAGECOUNT value on done: 20926.0 [2024-08-05 23:00:23,397][52794] Sum rewards: 11.929, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.195', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon5': '0.178', 'WEAPON4': '0.400', 'ARMOR': '0.487', 'WEAPON3': '0.600', 'weapon4': '0.610', 'HITCOUNT': '0.950', 'weapon2': '0.972', 'weapon3': '1.630', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:23,952][52659] DAMAGECOUNT value on done: 19315.0 [2024-08-05 23:00:23,960][52659] Sum rewards: 13.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.283', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.272', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'ARMOR': '1.282', 'weapon2': '1.366', 'weapon3': '1.442', 'DAMAGECOUNT': '3.960', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:24,759][52803] DAMAGECOUNT value on done: 20294.0 [2024-08-05 23:00:24,760][52803] Sum rewards: 19.845, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.000', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'ARMOR': '0.451', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon2': '1.626', 'weapon3': '1.868', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '18.000'} [2024-08-05 23:00:25,201][52649] DAMAGECOUNT value on done: 17538.0 [2024-08-05 23:00:25,201][52649] Sum rewards: 14.439, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.841', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.020', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.520', 'WEAPON3': '0.550', 'ARMOR': '0.965', 'HITCOUNT': '1.140', 'weapon2': '1.222', 'weapon3': '1.488', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:25,492][52662] DAMAGECOUNT value on done: 21922.0 [2024-08-05 23:00:25,494][52662] Sum rewards: 11.848, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.524', 'AMMO2': '0.003', 'weapon4': '0.012', 'AMMO4': '0.014', 'weapon7': '0.072', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '0.980', 'weapon2': '1.440', 'weapon3': '1.708', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:25,755][52658] DAMAGECOUNT value on done: 18960.0 [2024-08-05 23:00:25,755][52658] Sum rewards: 11.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.415', 'AMMO2': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.029', 'weapon5': '0.066', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'WEAPON3': '0.850', 'weapon2': '1.368', 'HITCOUNT': '1.570', 'weapon3': '1.834', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:25,770][52811] DAMAGECOUNT value on done: 18804.0 [2024-08-05 23:00:25,770][52811] Sum rewards: 14.987, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.346', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.138', 'ARMOR': '0.428', 'WEAPON3': '0.950', 'HITCOUNT': '1.260', 'weapon2': '1.358', 'weapon3': '1.708', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:26,103][52671] DAMAGECOUNT value on done: 20115.0 [2024-08-05 23:00:26,104][52671] Sum rewards: 22.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.759', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'ARMOR': '0.892', 'WEAPON3': '0.900', 'weapon2': '1.314', 'HITCOUNT': '1.390', 'weapon3': '2.104', 'DAMAGECOUNT': '6.048', 'FRAGCOUNT': '18.000'} [2024-08-05 23:00:26,107][52650] Updated weights for policy 0, policy_version 11761 (0.0011) [2024-08-05 23:00:26,340][52664] DAMAGECOUNT value on done: 17611.0 [2024-08-05 23:00:26,343][52664] Sum rewards: 6.804, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.698', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO3': '0.040', 'WEAPON4': '0.100', 'WEAPON3': '0.350', 'weapon4': '0.400', 'HITCOUNT': '0.550', 'weapon3': '0.804', 'weapon2': '0.872', 'DAMAGECOUNT': '1.692', 'FRAGCOUNT': '5.000'} [2024-08-05 23:00:26,641][52794] DAMAGECOUNT value on done: 22003.0 [2024-08-05 23:00:26,644][52794] Sum rewards: 6.299, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.410', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.081', 'weapon4': '0.100', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.374', 'HITCOUNT': '0.510', 'WEAPON3': '0.550', 'ARMOR': '0.874', 'weapon2': '1.392', 'weapon3': '1.426', 'DAMAGECOUNT': '2.028', 'FRAGCOUNT': '4.000'} [2024-08-05 23:00:26,944][52614] Signal inference workers to stop experience collection... (2200 times) [2024-08-05 23:00:26,945][52614] Signal inference workers to resume experience collection... (2200 times) [2024-08-05 23:00:26,999][52650] InferenceWorker_p0-w0: stopping experience collection (2200 times) [2024-08-05 23:00:27,000][52650] InferenceWorker_p0-w0: resuming experience collection (2200 times) [2024-08-05 23:00:27,057][52659] DAMAGECOUNT value on done: 18295.0 [2024-08-05 23:00:27,057][52659] Sum rewards: 11.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.040', 'ARMOR': '0.092', 'weapon4': '0.104', 'AMMO3': '0.172', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '1.078', 'WEAPON3': '1.100', 'HITCOUNT': '1.240', 'weapon3': '2.562', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:27,792][52649] DAMAGECOUNT value on done: 19259.0 [2024-08-05 23:00:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 16828.3). Total num frames: 96378880. Throughput: 0: 4414.5. Samples: 24101870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:00:27,794][52567] Avg episode reward: [(0, '14.205')] [2024-08-05 23:00:27,794][52649] Sum rewards: 14.501, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.873', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.040', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'ARMOR': '0.914', 'HITCOUNT': '1.220', 'weapon2': '1.608', 'weapon3': '2.092', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011765_96378880.pth... [2024-08-05 23:00:27,922][52803] DAMAGECOUNT value on done: 16821.0 [2024-08-05 23:00:27,923][52803] Sum rewards: 10.939, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.027', 'HEALTH': '0.033', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'ARMOR': '0.408', 'weapon4': '0.642', 'WEAPON3': '0.750', 'weapon2': '0.870', 'HITCOUNT': '1.210', 'weapon3': '1.606', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011271_92332032.pth [2024-08-05 23:00:28,742][52662] DAMAGECOUNT value on done: 23754.0 [2024-08-05 23:00:28,742][52662] Sum rewards: 22.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.063', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.156', 'weapon4': '0.174', 'WEAPON4': '0.350', 'ARMOR': '0.504', 'WEAPON3': '1.050', 'weapon2': '1.254', 'HITCOUNT': '1.860', 'weapon3': '1.982', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '18.000'} [2024-08-05 23:00:28,785][52658] DAMAGECOUNT value on done: 20206.0 [2024-08-05 23:00:28,786][52658] Sum rewards: 14.965, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'WEAPON3': '0.750', 'HITCOUNT': '1.330', 'weapon2': '1.406', 'weapon3': '1.964', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:28,921][52811] DAMAGECOUNT value on done: 17964.0 [2024-08-05 23:00:28,922][52811] Sum rewards: 10.450, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.545', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'ARMOR': '0.482', 'WEAPON3': '0.600', 'HITCOUNT': '0.880', 'weapon2': '1.190', 'weapon3': '1.232', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:29,294][52671] DAMAGECOUNT value on done: 19711.0 [2024-08-05 23:00:29,296][52671] Sum rewards: 24.765, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.098', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.526', 'ARMOR': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.186', 'HITCOUNT': '1.670', 'weapon3': '1.890', 'DAMAGECOUNT': '6.141', 'FRAGCOUNT': '20.000'} [2024-08-05 23:00:29,395][52664] DAMAGECOUNT value on done: 18915.0 [2024-08-05 23:00:29,397][52664] Sum rewards: 17.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.408', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.119', 'weapon4': '0.208', 'ARMOR': '0.527', 'WEAPON3': '0.700', 'weapon2': '1.400', 'HITCOUNT': '1.430', 'weapon3': '1.762', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:29,855][52659] DAMAGECOUNT value on done: 19819.0 [2024-08-05 23:00:29,857][52659] Sum rewards: 18.370, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.635', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.086', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'WEAPON4': '0.500', 'ARMOR': '0.533', 'WEAPON3': '0.550', 'weapon4': '0.814', 'weapon2': '1.036', 'weapon3': '1.500', 'HITCOUNT': '1.530', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:29,944][52794] DAMAGECOUNT value on done: 23389.0 [2024-08-05 23:00:29,945][52794] Sum rewards: 14.664, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.064', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO3': '0.134', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.420', 'weapon2': '1.544', 'weapon3': '2.216', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:30,372][52650] Updated weights for policy 0, policy_version 11771 (0.0039) [2024-08-05 23:00:30,425][52649] DAMAGECOUNT value on done: 19053.0 [2024-08-05 23:00:30,427][52649] Sum rewards: 15.175, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.176', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.086', 'AMMO4': '0.093', 'weapon5': '0.094', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.897', 'HITCOUNT': '1.290', 'weapon2': '1.440', 'weapon3': '1.802', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:31,005][52803] DAMAGECOUNT value on done: 17253.0 [2024-08-05 23:00:31,006][52803] Sum rewards: 13.460, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.118', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'HEALTH': '0.190', 'ARMOR': '0.481', 'weapon4': '0.490', 'WEAPON3': '0.650', 'weapon2': '0.780', 'HITCOUNT': '0.950', 'weapon3': '1.816', 'DAMAGECOUNT': '3.324', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:31,866][52662] DAMAGECOUNT value on done: 24040.0 [2024-08-05 23:00:31,867][52662] Sum rewards: 20.573, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.182', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '0.900', 'ARMOR': '1.005', 'weapon2': '1.298', 'HITCOUNT': '1.530', 'weapon3': '1.896', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '19.000'} [2024-08-05 23:00:31,903][52658] DAMAGECOUNT value on done: 18385.0 [2024-08-05 23:00:31,904][52658] Sum rewards: 15.464, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.284', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.238', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'HITCOUNT': '1.060', 'weapon2': '1.296', 'weapon3': '1.444', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:31,917][52671] DAMAGECOUNT value on done: 21172.0 [2024-08-05 23:00:31,919][52671] Sum rewards: 15.172, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.409', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'AMMO3': '0.083', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.442', 'WEAPON3': '0.650', 'ARMOR': '0.915', 'HITCOUNT': '1.010', 'weapon2': '1.272', 'weapon3': '1.382', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:32,062][52811] DAMAGECOUNT value on done: 19298.0 [2024-08-05 23:00:32,063][52811] Sum rewards: 21.557, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.046', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.085', 'AMMO4': '0.089', 'WEAPON4': '0.250', 'weapon4': '0.544', 'WEAPON3': '0.550', 'ARMOR': '0.883', 'weapon2': '1.144', 'HITCOUNT': '1.330', 'weapon3': '1.616', 'DAMAGECOUNT': '5.220', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:32,539][52659] DAMAGECOUNT value on done: 20363.0 [2024-08-05 23:00:32,541][52659] Sum rewards: 21.638, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'weapon4': '0.122', 'WEAPON3': '0.700', 'ARMOR': '0.851', 'HITCOUNT': '1.450', 'weapon3': '1.608', 'weapon2': '1.738', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '18.000'} [2024-08-05 23:00:32,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 16883.8). Total num frames: 96468992. Throughput: 0: 4407.7. Samples: 24114970. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:00:32,795][52567] Avg episode reward: [(0, '14.780')] [2024-08-05 23:00:33,103][52794] DAMAGECOUNT value on done: 23044.0 [2024-08-05 23:00:33,112][52794] Sum rewards: 27.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.209', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '1.218', 'WEAPON3': '1.300', 'ARMOR': '1.335', 'HITCOUNT': '2.280', 'weapon3': '2.608', 'DAMAGECOUNT': '8.508', 'FRAGCOUNT': '25.000'} [2024-08-05 23:00:33,426][52649] DAMAGECOUNT value on done: 18378.0 [2024-08-05 23:00:33,426][52649] Sum rewards: 17.107, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.220', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.266', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'ARMOR': '1.340', 'weapon2': '1.418', 'weapon3': '1.810', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:34,178][52803] DAMAGECOUNT value on done: 19417.0 [2024-08-05 23:00:34,180][52803] Sum rewards: 17.775, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '0.009', 'weapon4': '0.010', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.109', 'WEAPON3': '0.400', 'HITCOUNT': '1.340', 'weapon3': '1.374', 'weapon2': '1.394', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:34,715][52671] DAMAGECOUNT value on done: 18833.0 [2024-08-05 23:00:34,715][52671] Sum rewards: 20.005, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.582', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.027', 'ARMOR': '0.044', 'AMMO3': '0.110', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon4': '0.748', 'weapon2': '0.844', 'HITCOUNT': '1.270', 'weapon3': '1.738', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '16.000'} [2024-08-05 23:00:34,984][52658] DAMAGECOUNT value on done: 21610.0 [2024-08-05 23:00:34,984][52658] Sum rewards: 8.844, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.282', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO4': '0.027', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.438', 'ARMOR': '0.895', 'WEAPON3': '1.150', 'weapon2': '1.278', 'HITCOUNT': '1.340', 'weapon3': '1.994', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:35,012][52662] DAMAGECOUNT value on done: 21197.0 [2024-08-05 23:00:35,014][52662] Sum rewards: 12.349, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.086', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'AMMO3': '0.141', 'weapon4': '0.274', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'ARMOR': '1.379', 'weapon2': '1.446', 'weapon3': '2.010', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:35,157][52811] DAMAGECOUNT value on done: 19109.0 [2024-08-05 23:00:35,158][52811] Sum rewards: 18.121, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.090', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.294', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'HEALTH': '0.640', 'HITCOUNT': '1.020', 'weapon2': '1.288', 'weapon3': '1.774', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:35,319][52650] Updated weights for policy 0, policy_version 11781 (0.0012) [2024-08-05 23:00:35,423][52659] DAMAGECOUNT value on done: 16996.0 [2024-08-05 23:00:35,425][52659] Sum rewards: 9.515, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.295', 'weapon4': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.092', 'weapon5': '0.116', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.513', 'WEAPON3': '0.650', 'weapon2': '0.764', 'HITCOUNT': '0.830', 'weapon3': '1.640', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:36,244][52794] DAMAGECOUNT value on done: 20974.0 [2024-08-05 23:00:36,246][52794] Sum rewards: 14.342, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.842', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.012', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.112', 'WEAPON3': '0.650', 'HITCOUNT': '1.190', 'weapon3': '1.422', 'weapon2': '1.600', 'ARMOR': '1.825', 'DAMAGECOUNT': '3.837', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:36,309][52649] DAMAGECOUNT value on done: 21347.0 [2024-08-05 23:00:36,309][52649] Sum rewards: 23.718, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.331', 'AMMO2': '0.027', 'weapon4': '0.036', 'AMMO4': '0.136', 'AMMO3': '0.137', 'WEAPON4': '0.250', 'ARMOR': '0.475', 'WEAPON3': '0.950', 'weapon2': '1.320', 'HITCOUNT': '1.690', 'weapon3': '2.214', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '20.000'} [2024-08-05 23:00:37,195][52803] DAMAGECOUNT value on done: 17047.0 [2024-08-05 23:00:37,197][52803] Sum rewards: 13.261, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.024', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon5': '0.126', 'weapon4': '0.140', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.950', 'weapon2': '1.318', 'weapon3': '1.756', 'DAMAGECOUNT': '3.285', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 16828.3). Total num frames: 96542720. Throughput: 0: 4406.0. Samples: 24141470. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:00:37,795][52567] Avg episode reward: [(0, '14.830')] [2024-08-05 23:00:37,822][52662] DAMAGECOUNT value on done: 22588.0 [2024-08-05 23:00:37,825][52662] Sum rewards: 10.928, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.400', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.027', 'weapon4': '0.068', 'AMMO3': '0.090', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon3': '1.580', 'weapon2': '1.726', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:37,931][52671] DAMAGECOUNT value on done: 19814.0 [2024-08-05 23:00:37,932][52671] Sum rewards: 19.997, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.025', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'weapon4': '0.456', 'WEAPON3': '0.500', 'weapon2': '1.118', 'HITCOUNT': '1.430', 'weapon3': '1.538', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '14.500'} [2024-08-05 23:00:37,947][52658] DAMAGECOUNT value on done: 20290.0 [2024-08-05 23:00:37,947][52658] Sum rewards: 20.701, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.764', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.344', 'WEAPON3': '0.500', 'HITCOUNT': '1.330', 'weapon3': '1.506', 'weapon2': '1.516', 'ARMOR': '2.279', 'DAMAGECOUNT': '4.749', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:38,221][52811] DAMAGECOUNT value on done: 19286.0 [2024-08-05 23:00:38,224][52811] Sum rewards: 15.563, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.425', 'AMMO4': '-0.077', 'AMMO2': '-0.015', 'AMMO3': '0.081', 'ARMOR': '0.451', 'WEAPON3': '0.650', 'HITCOUNT': '1.230', 'weapon3': '1.402', 'weapon2': '1.716', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:38,556][52659] DAMAGECOUNT value on done: 18605.0 [2024-08-05 23:00:38,557][52659] Sum rewards: 15.369, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.176', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.080', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'HITCOUNT': '1.210', 'weapon3': '1.256', 'ARMOR': '1.272', 'weapon2': '1.710', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:39,109][52794] DAMAGECOUNT value on done: 22262.0 [2024-08-05 23:00:39,110][52794] Sum rewards: 16.872, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.829', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.050', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.226', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '1.520', 'weapon2': '1.580', 'weapon3': '1.692', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:39,310][52649] DAMAGECOUNT value on done: 18321.0 [2024-08-05 23:00:39,311][52649] Sum rewards: 16.434, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.604', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.152', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.292', 'HITCOUNT': '1.370', 'weapon3': '1.776', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:39,860][52650] Updated weights for policy 0, policy_version 11791 (0.0031) [2024-08-05 23:00:40,195][52803] DAMAGECOUNT value on done: 21272.0 [2024-08-05 23:00:40,195][52803] Sum rewards: 11.805, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.292', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.216', 'WEAPON3': '0.600', 'ARMOR': '0.900', 'HITCOUNT': '1.320', 'weapon3': '1.558', 'weapon2': '1.820', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '7.000'} [2024-08-05 23:00:40,929][52658] DAMAGECOUNT value on done: 18390.0 [2024-08-05 23:00:40,931][52658] Sum rewards: 8.236, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.015', 'AMMO3': '0.060', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'HEALTH': '0.435', 'weapon4': '0.442', 'ARMOR': '0.500', 'HITCOUNT': '0.560', 'weapon2': '0.992', 'weapon3': '1.424', 'DAMAGECOUNT': '1.932', 'FRAGCOUNT': '5.000'} [2024-08-05 23:00:41,091][52662] DAMAGECOUNT value on done: 20753.0 [2024-08-05 23:00:41,091][52662] Sum rewards: 10.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.687', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.030', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.143', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.405', 'WEAPON3': '0.850', 'HITCOUNT': '1.060', 'weapon2': '1.286', 'weapon3': '1.490', 'DAMAGECOUNT': '3.789', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:41,117][52671] DAMAGECOUNT value on done: 21651.0 [2024-08-05 23:00:41,119][52671] Sum rewards: 21.440, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.381', 'weapon5': '0.002', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.485', 'WEAPON3': '0.850', 'weapon2': '1.560', 'HITCOUNT': '1.860', 'weapon3': '2.246', 'DAMAGECOUNT': '6.819', 'FRAGCOUNT': '16.000'} [2024-08-05 23:00:41,270][52811] DAMAGECOUNT value on done: 18237.0 [2024-08-05 23:00:41,273][52811] Sum rewards: 21.412, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.463', 'AMMO2': '0.030', 'AMMO3': '0.136', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.678', 'weapon2': '0.740', 'WEAPON3': '0.850', 'ARMOR': '0.901', 'HITCOUNT': '1.530', 'weapon3': '2.248', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '17.000'} [2024-08-05 23:00:41,776][52659] DAMAGECOUNT value on done: 20604.0 [2024-08-05 23:00:41,776][52659] Sum rewards: 17.282, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.646', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.136', 'WEAPON3': '0.850', 'ARMOR': '0.938', 'HITCOUNT': '1.580', 'weapon3': '1.698', 'weapon2': '1.730', 'DAMAGECOUNT': '5.337', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:42,011][52649] DAMAGECOUNT value on done: 16952.0 [2024-08-05 23:00:42,012][52649] Sum rewards: 10.139, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.124', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.036', 'weapon4': '0.066', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.860', 'ARMOR': '0.919', 'weapon3': '1.374', 'weapon2': '1.612', 'DAMAGECOUNT': '2.580', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:42,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17612.9, 300 sec: 16883.9). Total num frames: 96641024. Throughput: 0: 4406.3. Samples: 24167970. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:00:42,794][52567] Avg episode reward: [(0, '15.108')] [2024-08-05 23:00:43,276][52803] DAMAGECOUNT value on done: 16875.0 [2024-08-05 23:00:43,284][52803] Sum rewards: 21.195, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.686', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.226', 'ARMOR': '0.457', 'WEAPON3': '1.050', 'weapon2': '1.170', 'HITCOUNT': '1.650', 'weapon3': '2.194', 'DAMAGECOUNT': '6.513', 'FRAGCOUNT': '19.000'} [2024-08-05 23:00:43,729][52658] DAMAGECOUNT value on done: 17682.0 [2024-08-05 23:00:43,729][52658] Sum rewards: 18.078, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.614', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.086', 'WEAPON3': '0.650', 'ARMOR': '1.220', 'HITCOUNT': '1.400', 'weapon3': '1.788', 'weapon2': '1.866', 'DAMAGECOUNT': '4.623', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:44,085][52671] DAMAGECOUNT value on done: 17510.0 [2024-08-05 23:00:44,085][52671] Sum rewards: 11.408, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.320', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.238', 'ARMOR': '0.506', 'WEAPON3': '0.950', 'HITCOUNT': '1.140', 'weapon2': '1.382', 'weapon3': '1.948', 'DAMAGECOUNT': '4.041', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:44,238][52662] DAMAGECOUNT value on done: 22736.0 [2024-08-05 23:00:44,240][52662] Sum rewards: 15.584, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.612', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.296', 'ARMOR': '0.420', 'WEAPON3': '0.900', 'HITCOUNT': '1.200', 'weapon2': '1.210', 'weapon3': '2.182', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:44,377][52811] DAMAGECOUNT value on done: 19292.0 [2024-08-05 23:00:44,378][52811] Sum rewards: 26.412, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.016', 'HEALTH': '0.021', 'AMMO4': '0.060', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.580', 'HITCOUNT': '1.830', 'weapon3': '1.902', 'DAMAGECOUNT': '6.522', 'FRAGCOUNT': '19.000'} [2024-08-05 23:00:44,601][52650] Updated weights for policy 0, policy_version 11801 (0.0023) [2024-08-05 23:00:44,721][52659] DAMAGECOUNT value on done: 18431.0 [2024-08-05 23:00:44,725][52659] Sum rewards: 11.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.028', 'AMMO4': '0.075', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'ARMOR': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '1.290', 'weapon2': '1.296', 'weapon3': '1.926', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:44,929][52649] DAMAGECOUNT value on done: 20660.0 [2024-08-05 23:00:44,930][52649] Sum rewards: 28.624, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.575', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.127', 'weapon5': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.324', 'WEAPON4': '0.400', 'weapon2': '0.850', 'WEAPON3': '1.050', 'HITCOUNT': '1.590', 'weapon3': '2.202', 'DAMAGECOUNT': '7.413', 'FRAGCOUNT': '25.000'} [2024-08-05 23:00:46,399][52803] DAMAGECOUNT value on done: 17692.0 [2024-08-05 23:00:46,399][52803] Sum rewards: 15.567, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.440', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.118', 'ARMOR': '0.489', 'WEAPON3': '0.750', 'HITCOUNT': '1.300', 'weapon2': '1.556', 'weapon3': '1.806', 'DAMAGECOUNT': '4.911', 'FRAGCOUNT': '12.500'} [2024-08-05 23:00:46,402][52658] DAMAGECOUNT value on done: 18972.0 [2024-08-05 23:00:46,403][52658] Sum rewards: 13.771, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.126', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'HITCOUNT': '1.270', 'weapon2': '1.438', 'weapon3': '1.646', 'DAMAGECOUNT': '4.095', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:47,042][52671] DAMAGECOUNT value on done: 16661.0 [2024-08-05 23:00:47,045][52671] Sum rewards: 12.073, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.072', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.166', 'ARMOR': '0.459', 'WEAPON3': '0.500', 'HITCOUNT': '1.000', 'weapon3': '1.328', 'weapon2': '1.522', 'DAMAGECOUNT': '3.183', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:47,386][52811] DAMAGECOUNT value on done: 15492.0 [2024-08-05 23:00:47,387][52811] Sum rewards: 15.014, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.112', 'AMMO2': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'ARMOR': '0.439', 'WEAPON3': '0.550', 'HITCOUNT': '1.220', 'weapon3': '1.642', 'weapon2': '1.678', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:47,527][52659] DAMAGECOUNT value on done: 18896.0 [2024-08-05 23:00:47,529][52659] Sum rewards: 23.952, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.880', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.024', 'weapon5': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'weapon2': '1.472', 'HITCOUNT': '1.500', 'weapon3': '1.672', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '19.000'} [2024-08-05 23:00:47,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 16883.9). Total num frames: 96731136. Throughput: 0: 4407.8. Samples: 24181290. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:00:47,795][52567] Avg episode reward: [(0, '15.512')] [2024-08-05 23:00:47,979][52649] DAMAGECOUNT value on done: 16534.0 [2024-08-05 23:00:47,980][52649] Sum rewards: 14.271, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.234', 'WEAPON3': '0.950', 'ARMOR': '0.961', 'HITCOUNT': '1.280', 'weapon2': '1.366', 'weapon3': '1.944', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:49,399][52650] Updated weights for policy 0, policy_version 11811 (0.0012) [2024-08-05 23:00:49,470][52803] DAMAGECOUNT value on done: 16200.0 [2024-08-05 23:00:49,472][52803] Sum rewards: 13.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.192', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.226', 'WEAPON3': '0.750', 'ARMOR': '0.854', 'weapon2': '1.108', 'HITCOUNT': '1.250', 'weapon3': '2.106', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:49,657][52671] DAMAGECOUNT value on done: 19417.0 [2024-08-05 23:00:49,657][52671] Sum rewards: 16.617, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.615', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'WEAPON4': '0.050', 'AMMO3': '0.066', 'weapon4': '0.204', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.282', 'HITCOUNT': '1.400', 'weapon2': '1.684', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '14.000'} [2024-08-05 23:00:50,099][52659] DAMAGECOUNT value on done: 17266.0 [2024-08-05 23:00:50,101][52659] Sum rewards: 17.434, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.146', 'AMMO5': '0.003', 'AMMO2': '0.023', 'ARMOR': '0.032', 'AMMO3': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'weapon4': '0.388', 'HITCOUNT': '0.920', 'weapon3': '1.266', 'weapon2': '1.350', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:50,421][52811] DAMAGECOUNT value on done: 16180.0 [2024-08-05 23:00:50,421][52811] Sum rewards: 10.462, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.029', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.144', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'weapon4': '0.438', 'HITCOUNT': '0.770', 'HEALTH': '0.834', 'weapon2': '1.190', 'weapon3': '1.388', 'DAMAGECOUNT': '2.199', 'FRAGCOUNT': '7.000'} [2024-08-05 23:00:51,022][52649] DAMAGECOUNT value on done: 19698.0 [2024-08-05 23:00:51,022][52649] Sum rewards: 11.401, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.022', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.032', 'weapon5': '0.048', 'AMMO3': '0.062', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'weapon4': '0.492', 'HITCOUNT': '1.040', 'weapon2': '1.334', 'weapon3': '1.448', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '8.000'} [2024-08-05 23:00:51,771][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:00:52,270][52671] DAMAGECOUNT value on done: 19147.0 [2024-08-05 23:00:52,270][52671] Sum rewards: 23.077, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.336', 'weapon4': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'ARMOR': '0.881', 'WEAPON3': '1.050', 'weapon2': '1.128', 'HITCOUNT': '1.710', 'weapon3': '2.476', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '21.000'} [2024-08-05 23:00:52,630][52803] DAMAGECOUNT value on done: 17700.0 [2024-08-05 23:00:52,631][52803] Sum rewards: 15.584, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.541', 'AMMO2': '0.002', 'weapon4': '0.004', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'HITCOUNT': '1.300', 'weapon3': '1.752', 'weapon2': '1.888', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '13.000'} [2024-08-05 23:00:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 16911.6). Total num frames: 96813056. Throughput: 0: 4415.3. Samples: 24207940. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:00:52,794][52567] Avg episode reward: [(0, '15.439')] [2024-08-05 23:00:52,873][52659] DAMAGECOUNT value on done: 18668.0 [2024-08-05 23:00:52,875][52659] Sum rewards: 12.664, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.108', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.118', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.487', 'weapon4': '0.576', 'WEAPON3': '0.750', 'weapon2': '1.088', 'HITCOUNT': '1.110', 'weapon3': '1.474', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '9.500'} [2024-08-05 23:00:53,354][52795] DAMAGECOUNT value on done: 16051.0 [2024-08-05 23:00:53,355][52795] Sum rewards: 11.092, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.600', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.334', 'WEAPON3': '0.500', 'ARMOR': '0.532', 'HITCOUNT': '0.780', 'weapon3': '1.036', 'weapon2': '1.462', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '7.000'} [2024-08-05 23:00:53,510][52811] DAMAGECOUNT value on done: 18497.0 [2024-08-05 23:00:53,510][52811] Sum rewards: 11.743, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.087', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'weapon5': '0.082', 'AMMO4': '0.134', 'WEAPON4': '0.350', 'ARMOR': '0.477', 'WEAPON3': '0.550', 'weapon4': '0.616', 'weapon2': '0.824', 'HITCOUNT': '1.290', 'weapon3': '1.444', 'DAMAGECOUNT': '3.909', 'FRAGCOUNT': '9.000'} [2024-08-05 23:00:53,821][52650] Updated weights for policy 0, policy_version 11821 (0.0023) [2024-08-05 23:00:54,066][52649] DAMAGECOUNT value on done: 19597.0 [2024-08-05 23:00:54,066][52649] Sum rewards: 28.348, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO3': '0.080', 'AMMO4': '0.101', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'HEALTH': '0.399', 'WEAPON3': '0.500', 'weapon4': '0.676', 'weapon2': '0.824', 'ARMOR': '0.836', 'weapon3': '1.580', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '6.282', 'FRAGCOUNT': '20.000'} [2024-08-05 23:00:55,323][52671] DAMAGECOUNT value on done: 19830.0 [2024-08-05 23:00:55,327][52671] Sum rewards: 10.002, reward structure: {'DEATHCOUNT': '-3.000', 'weapon4': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.053', 'HEALTH': '0.162', 'WEAPON3': '0.350', 'ARMOR': '0.532', 'HITCOUNT': '0.770', 'weapon3': '1.044', 'weapon2': '1.196', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '6.000'} [2024-08-05 23:00:55,692][52803] DAMAGECOUNT value on done: 17714.0 [2024-08-05 23:00:55,703][52803] Sum rewards: 13.842, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.076', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.067', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'HITCOUNT': '0.860', 'weapon3': '1.322', 'weapon2': '1.424', 'DAMAGECOUNT': '2.766', 'FRAGCOUNT': '10.000'} [2024-08-05 23:00:55,979][52659] DAMAGECOUNT value on done: 19799.0 [2024-08-05 23:00:55,980][52659] Sum rewards: 14.398, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.043', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.920', 'HITCOUNT': '1.020', 'weapon2': '1.280', 'weapon3': '1.870', 'DAMAGECOUNT': '3.564', 'FRAGCOUNT': '11.000'} [2024-08-05 23:00:56,605][52811] DAMAGECOUNT value on done: 20054.0 [2024-08-05 23:00:56,607][52811] Sum rewards: 18.741, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.083', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.115', 'weapon4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.832', 'WEAPON3': '0.900', 'weapon2': '1.308', 'HITCOUNT': '1.440', 'weapon3': '1.918', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '16.000'} [2024-08-05 23:00:56,753][52795] DAMAGECOUNT value on done: 15376.0 [2024-08-05 23:00:56,756][52795] Sum rewards: 15.941, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.299', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon5': '0.080', 'AMMO3': '0.088', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.820', 'weapon2': '1.096', 'HITCOUNT': '1.200', 'weapon3': '1.492', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:57,049][52649] DAMAGECOUNT value on done: 21103.0 [2024-08-05 23:00:57,051][52649] Sum rewards: 30.686, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'HEALTH': '0.204', 'weapon4': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.178', 'weapon3': '2.044', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '7.677', 'FRAGCOUNT': '25.000'} [2024-08-05 23:00:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17886.2, 300 sec: 16939.4). Total num frames: 96911360. Throughput: 0: 4415.6. Samples: 24234330. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:00:57,794][52567] Avg episode reward: [(0, '15.729')] [2024-08-05 23:00:58,374][52671] DAMAGECOUNT value on done: 16858.0 [2024-08-05 23:00:58,376][52671] Sum rewards: 19.074, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.256', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.220', 'ARMOR': '0.912', 'WEAPON3': '0.950', 'weapon2': '1.032', 'HITCOUNT': '1.280', 'weapon3': '1.758', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '17.000'} [2024-08-05 23:00:58,378][52650] Updated weights for policy 0, policy_version 11831 (0.0011) [2024-08-05 23:00:58,846][52659] DAMAGECOUNT value on done: 21714.0 [2024-08-05 23:00:58,847][52659] Sum rewards: 17.461, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.100', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.914', 'HITCOUNT': '1.470', 'weapon2': '1.576', 'weapon3': '1.774', 'DAMAGECOUNT': '5.694', 'FRAGCOUNT': '12.000'} [2024-08-05 23:00:58,883][52803] DAMAGECOUNT value on done: 16215.0 [2024-08-05 23:00:58,883][52803] Sum rewards: 20.028, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.537', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.004', 'ARMOR': '0.032', 'weapon7': '0.068', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.250', 'WEAPON3': '0.550', 'weapon2': '0.876', 'HITCOUNT': '0.950', 'weapon3': '1.470', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '16.000'} [2024-08-05 23:00:59,632][52811] DAMAGECOUNT value on done: 16997.0 [2024-08-05 23:00:59,634][52811] Sum rewards: 18.188, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.123', 'WEAPON4': '0.400', 'weapon4': '0.618', 'WEAPON3': '0.850', 'ARMOR': '0.884', 'weapon2': '1.004', 'HITCOUNT': '1.560', 'weapon3': '1.910', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '15.000'} [2024-08-05 23:00:59,950][52795] DAMAGECOUNT value on done: 16933.0 [2024-08-05 23:00:59,950][52795] Sum rewards: 15.704, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.139', 'weapon4': '0.216', 'WEAPON4': '0.400', 'ARMOR': '0.484', 'WEAPON3': '0.800', 'HITCOUNT': '1.330', 'weapon2': '1.504', 'weapon3': '1.718', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '14.000'} [2024-08-05 23:01:01,131][52671] DAMAGECOUNT value on done: 19514.0 [2024-08-05 23:01:01,132][52671] Sum rewards: 14.492, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.275', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.040', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'HITCOUNT': '0.860', 'weapon3': '0.940', 'weapon2': '1.162', 'DAMAGECOUNT': '3.255', 'FRAGCOUNT': '10.000'} [2024-08-05 23:01:01,524][52659] DAMAGECOUNT value on done: 17334.0 [2024-08-05 23:01:01,525][52659] Sum rewards: 17.469, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.922', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.033', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon4': '0.172', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.913', 'HITCOUNT': '1.290', 'weapon2': '1.530', 'weapon3': '1.778', 'DAMAGECOUNT': '4.773', 'FRAGCOUNT': '12.500'} [2024-08-05 23:01:01,981][52803] DAMAGECOUNT value on done: 18143.0 [2024-08-05 23:01:01,982][52803] Sum rewards: 21.712, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.214', 'ARMOR': '0.461', 'WEAPON3': '0.950', 'weapon2': '1.556', 'weapon3': '1.674', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '18.000'} [2024-08-05 23:01:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16939.4). Total num frames: 96993280. Throughput: 0: 4413.6. Samples: 24247500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:01:02,794][52567] Avg episode reward: [(0, '16.043')] [2024-08-05 23:01:02,861][52614] Saving new best policy, reward=16.043! [2024-08-05 23:01:02,863][52650] Updated weights for policy 0, policy_version 11841 (0.0029) [2024-08-05 23:01:02,932][52811] DAMAGECOUNT value on done: 17661.0 [2024-08-05 23:01:02,934][52811] Sum rewards: 12.742, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.816', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.137', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.668', 'weapon4': '0.702', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon3': '1.862', 'DAMAGECOUNT': '4.782', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:03,015][52795] DAMAGECOUNT value on done: 17523.0 [2024-08-05 23:01:03,015][52795] Sum rewards: 9.466, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.895', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.042', 'weapon7': '0.046', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.457', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'weapon2': '0.972', 'weapon3': '1.780', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '10.000'} [2024-08-05 23:01:04,044][52659] DAMAGECOUNT value on done: 18988.0 [2024-08-05 23:01:04,045][52659] Sum rewards: 25.499, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.865', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.011', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO3': '0.117', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '1.290', 'weapon2': '1.634', 'weapon3': '1.898', 'DAMAGECOUNT': '5.796', 'FRAGCOUNT': '22.000'} [2024-08-05 23:01:05,278][52803] DAMAGECOUNT value on done: 18171.0 [2024-08-05 23:01:05,280][52803] Sum rewards: 15.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.594', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.118', 'WEAPON3': '0.700', 'HITCOUNT': '1.120', 'ARMOR': '1.250', 'weapon3': '1.328', 'weapon2': '1.544', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:05,475][52668] DAMAGECOUNT value on done: 18889.0 [2024-08-05 23:01:05,478][52668] Sum rewards: 17.011, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.785', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.276', 'ARMOR': '0.455', 'WEAPON3': '0.800', 'HITCOUNT': '1.150', 'weapon2': '1.174', 'weapon3': '1.510', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '16.000'} [2024-08-05 23:01:06,115][52795] DAMAGECOUNT value on done: 20956.0 [2024-08-05 23:01:06,115][52795] Sum rewards: 13.932, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.160', 'AMMO2': '0.034', 'weapon4': '0.046', 'AMMO3': '0.119', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'weapon2': '1.548', 'weapon3': '1.920', 'DAMAGECOUNT': '4.014', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:06,168][52811] DAMAGECOUNT value on done: 17021.0 [2024-08-05 23:01:06,169][52811] Sum rewards: 14.189, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.905', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.290', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '1.060', 'weapon3': '1.502', 'weapon2': '1.696', 'DAMAGECOUNT': '3.465', 'FRAGCOUNT': '11.000'} [2024-08-05 23:01:06,463][52659] DAMAGECOUNT value on done: 17492.0 [2024-08-05 23:01:06,465][52659] Sum rewards: 25.152, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.267', 'AMMO5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.036', 'weapon5': '0.060', 'AMMO3': '0.100', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.512', 'WEAPON3': '0.650', 'weapon2': '0.962', 'HITCOUNT': '1.600', 'weapon3': '1.772', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '19.000'} [2024-08-05 23:01:07,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17476.2, 300 sec: 16939.4). Total num frames: 97075200. Throughput: 0: 4410.8. Samples: 24274100. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-05 23:01:07,795][52567] Avg episode reward: [(0, '16.258')] [2024-08-05 23:01:07,797][52614] Saving new best policy, reward=16.258! [2024-08-05 23:01:08,032][52650] Updated weights for policy 0, policy_version 11851 (0.0011) [2024-08-05 23:01:08,441][52668] DAMAGECOUNT value on done: 21143.0 [2024-08-05 23:01:08,441][52668] Sum rewards: 23.628, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.993', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.066', 'AMMO3': '0.135', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.204', 'WEAPON4': '0.300', 'ARMOR': '0.549', 'WEAPON3': '0.950', 'weapon2': '0.958', 'HITCOUNT': '1.510', 'weapon3': '1.888', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '20.000'} [2024-08-05 23:01:08,508][52803] DAMAGECOUNT value on done: 16345.0 [2024-08-05 23:01:08,509][52803] Sum rewards: 10.678, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.755', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO3': '0.091', 'weapon5': '0.136', 'AMMO4': '0.143', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '0.650', 'weapon2': '0.782', 'ARMOR': '0.916', 'HITCOUNT': '0.940', 'weapon3': '1.644', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '9.000'} [2024-08-05 23:01:09,249][52795] DAMAGECOUNT value on done: 20151.0 [2024-08-05 23:01:09,249][52795] Sum rewards: 13.733, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.089', 'HEALTH': '0.166', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.280', 'weapon2': '1.296', 'weapon3': '1.626', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '9.000'} [2024-08-05 23:01:09,279][52811] DAMAGECOUNT value on done: 19065.0 [2024-08-05 23:01:09,281][52811] Sum rewards: 16.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.942', 'AMMO2': '0.004', 'AMMO5': '0.013', 'AMMO4': '0.022', 'weapon5': '0.042', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.384', 'ARMOR': '0.480', 'WEAPON3': '0.800', 'weapon2': '1.168', 'HITCOUNT': '1.420', 'weapon3': '1.820', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:09,621][52659] DAMAGECOUNT value on done: 20301.0 [2024-08-05 23:01:09,624][52659] Sum rewards: 18.314, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.343', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'WEAPON3': '0.900', 'ARMOR': '0.903', 'HITCOUNT': '1.210', 'weapon2': '1.450', 'weapon3': '1.766', 'DAMAGECOUNT': '4.509', 'FRAGCOUNT': '17.000'} [2024-08-05 23:01:11,383][52668] DAMAGECOUNT value on done: 17582.0 [2024-08-05 23:01:11,385][52668] Sum rewards: 11.767, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.346', 'WEAPON3': '0.600', 'ARMOR': '0.820', 'HITCOUNT': '1.220', 'weapon2': '1.450', 'weapon3': '1.616', 'DAMAGECOUNT': '3.858', 'FRAGCOUNT': '8.000'} [2024-08-05 23:01:11,443][52803] DAMAGECOUNT value on done: 16412.0 [2024-08-05 23:01:11,444][52803] Sum rewards: 14.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.100', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.400', 'ARMOR': '0.524', 'WEAPON3': '0.750', 'weapon4': '0.794', 'weapon2': '0.934', 'HITCOUNT': '1.210', 'weapon3': '1.572', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '10.000'} [2024-08-05 23:01:12,325][52650] Updated weights for policy 0, policy_version 11861 (0.0012) [2024-08-05 23:01:12,328][52811] DAMAGECOUNT value on done: 16862.0 [2024-08-05 23:01:12,329][52811] Sum rewards: 19.293, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.071', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'HEALTH': '0.453', 'weapon4': '0.676', 'ARMOR': '0.931', 'weapon2': '1.068', 'HITCOUNT': '1.150', 'weapon3': '1.376', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:12,394][52795] DAMAGECOUNT value on done: 21165.0 [2024-08-05 23:01:12,395][52795] Sum rewards: 23.499, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.003', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'weapon4': '0.468', 'ARMOR': '0.492', 'WEAPON3': '0.800', 'weapon2': '1.074', 'weapon3': '1.722', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '6.348', 'FRAGCOUNT': '19.000'} [2024-08-05 23:01:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 16967.2). Total num frames: 97165312. Throughput: 0: 4407.3. Samples: 24300200. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-05 23:01:12,794][52567] Avg episode reward: [(0, '16.497')] [2024-08-05 23:01:12,795][52614] Saving new best policy, reward=16.497! [2024-08-05 23:01:13,701][52660] DAMAGECOUNT value on done: 20383.0 [2024-08-05 23:01:13,701][52660] Sum rewards: 18.735, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.250', 'weapon2': '0.496', 'ARMOR': '0.541', 'weapon4': '0.690', 'WEAPON3': '0.850', 'HITCOUNT': '1.250', 'weapon3': '1.952', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '16.000'} [2024-08-05 23:01:14,514][52668] DAMAGECOUNT value on done: 19760.0 [2024-08-05 23:01:14,514][52668] Sum rewards: 16.152, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.418', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.080', 'weapon4': '0.206', 'WEAPON3': '0.550', 'HITCOUNT': '1.470', 'weapon3': '1.632', 'weapon2': '1.710', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:14,556][52803] DAMAGECOUNT value on done: 18279.0 [2024-08-05 23:01:14,556][52803] Sum rewards: 21.419, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.147', 'HEALTH': '0.285', 'weapon4': '0.334', 'weapon2': '0.590', 'WEAPON3': '0.750', 'ARMOR': '0.884', 'HITCOUNT': '1.300', 'weapon3': '2.264', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '18.000'} [2024-08-05 23:01:15,436][52811] DAMAGECOUNT value on done: 17606.0 [2024-08-05 23:01:15,439][52811] Sum rewards: 14.826, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.601', 'AMMO4': '-0.096', 'AMMO2': '-0.019', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON3': '0.750', 'HITCOUNT': '1.100', 'ARMOR': '1.310', 'weapon3': '1.582', 'weapon2': '1.814', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:15,546][52795] DAMAGECOUNT value on done: 18333.0 [2024-08-05 23:01:15,546][52795] Sum rewards: 13.242, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.336', 'AMMO2': '0.012', 'AMMO5': '0.013', 'weapon4': '0.054', 'AMMO4': '0.059', 'weapon5': '0.068', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.868', 'HITCOUNT': '1.410', 'weapon2': '1.576', 'weapon3': '1.894', 'DAMAGECOUNT': '5.217', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:16,515][52660] DAMAGECOUNT value on done: 20346.0 [2024-08-05 23:01:16,516][52660] Sum rewards: 27.567, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.143', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.081', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON3': '0.700', 'ARMOR': '0.898', 'weapon2': '1.370', 'HITCOUNT': '1.740', 'weapon3': '1.888', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '21.000'} [2024-08-05 23:01:17,350][52650] Updated weights for policy 0, policy_version 11871 (0.0012) [2024-08-05 23:01:17,492][52668] DAMAGECOUNT value on done: 18845.0 [2024-08-05 23:01:17,493][52668] Sum rewards: 11.230, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.745', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.436', 'WEAPON3': '1.050', 'HITCOUNT': '1.140', 'weapon2': '1.572', 'weapon3': '1.924', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:17,530][52803] DAMAGECOUNT value on done: 19137.0 [2024-08-05 23:01:17,532][52803] Sum rewards: 19.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.128', 'AMMO2': '0.042', 'AMMO3': '0.138', 'AMMO4': '0.209', 'weapon4': '0.392', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.238', 'HITCOUNT': '1.690', 'weapon3': '2.054', 'DAMAGECOUNT': '5.994', 'FRAGCOUNT': '19.000'} [2024-08-05 23:01:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 16967.2). Total num frames: 97255424. Throughput: 0: 4405.4. Samples: 24313210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:01:17,794][52567] Avg episode reward: [(0, '16.832')] [2024-08-05 23:01:17,797][52614] Saving new best policy, reward=16.832! [2024-08-05 23:01:18,739][52795] DAMAGECOUNT value on done: 16940.0 [2024-08-05 23:01:18,740][52795] Sum rewards: 10.187, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.836', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon3': '1.568', 'weapon2': '1.890', 'DAMAGECOUNT': '3.429', 'FRAGCOUNT': '8.000'} [2024-08-05 23:01:18,747][52811] DAMAGECOUNT value on done: 18472.0 [2024-08-05 23:01:18,747][52811] Sum rewards: 24.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.578', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon4': '0.218', 'WEAPON3': '0.750', 'ARMOR': '1.307', 'weapon2': '1.402', 'HITCOUNT': '1.650', 'weapon3': '1.658', 'DAMAGECOUNT': '6.219', 'FRAGCOUNT': '20.000'} [2024-08-05 23:01:18,946][52647] DAMAGECOUNT value on done: 21280.0 [2024-08-05 23:01:18,946][52647] Sum rewards: 10.447, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.622', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO3': '0.080', 'WEAPON3': '0.550', 'HITCOUNT': '0.870', 'ARMOR': '0.926', 'weapon3': '1.368', 'weapon2': '1.682', 'DAMAGECOUNT': '3.132', 'FRAGCOUNT': '7.000'} [2024-08-05 23:01:19,681][52660] DAMAGECOUNT value on done: 18838.0 [2024-08-05 23:01:19,681][52660] Sum rewards: 20.716, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.255', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.137', 'weapon4': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.896', 'weapon2': '1.390', 'HITCOUNT': '1.440', 'weapon3': '2.136', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '17.000'} [2024-08-05 23:01:20,539][52668] DAMAGECOUNT value on done: 20546.0 [2024-08-05 23:01:20,543][52668] Sum rewards: 20.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.025', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.198', 'HITCOUNT': '1.590', 'weapon3': '2.530', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '17.000'} [2024-08-05 23:01:20,726][52803] DAMAGECOUNT value on done: 18440.0 [2024-08-05 23:01:20,728][52803] Sum rewards: 5.839, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.073', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon5': '0.024', 'weapon4': '0.046', 'AMMO4': '0.068', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.840', 'WEAPON3': '0.850', 'HITCOUNT': '0.910', 'weapon3': '1.580', 'weapon2': '1.590', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '6.000'} [2024-08-05 23:01:21,884][52795] DAMAGECOUNT value on done: 19255.0 [2024-08-05 23:01:21,887][52795] Sum rewards: 6.879, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.146', 'weapon4': '0.154', 'WEAPON4': '0.200', 'ARMOR': '0.453', 'HITCOUNT': '0.910', 'WEAPON3': '0.950', 'weapon2': '1.374', 'weapon3': '1.914', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '8.000'} [2024-08-05 23:01:21,890][52811] DAMAGECOUNT value on done: 17529.0 [2024-08-05 23:01:21,891][52811] Sum rewards: 22.862, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'weapon5': '0.032', 'AMMO2': '0.033', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'HEALTH': '0.139', 'AMMO3': '0.149', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.494', 'weapon2': '0.738', 'WEAPON3': '0.900', 'HITCOUNT': '1.820', 'weapon3': '2.282', 'DAMAGECOUNT': '6.270', 'FRAGCOUNT': '20.000'} [2024-08-05 23:01:22,013][52650] Updated weights for policy 0, policy_version 11881 (0.0037) [2024-08-05 23:01:22,013][52647] DAMAGECOUNT value on done: 18673.0 [2024-08-05 23:01:22,013][52647] Sum rewards: 9.836, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.155', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'weapon4': '0.574', 'HITCOUNT': '0.900', 'weapon2': '0.920', 'weapon3': '1.076', 'DAMAGECOUNT': '3.138', 'FRAGCOUNT': '6.500'} [2024-08-05 23:01:22,183][52660] DAMAGECOUNT value on done: 19053.0 [2024-08-05 23:01:22,186][52660] Sum rewards: 16.547, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.552', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.085', 'AMMO4': '0.087', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.509', 'WEAPON3': '0.550', 'HITCOUNT': '1.270', 'weapon3': '1.338', 'weapon2': '1.756', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 16967.2). Total num frames: 97337344. Throughput: 0: 4399.3. Samples: 24339440. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:01:22,795][52567] Avg episode reward: [(0, '16.652')] [2024-08-05 23:01:23,119][52668] DAMAGECOUNT value on done: 21370.0 [2024-08-05 23:01:23,130][52668] Sum rewards: 15.340, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.098', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.082', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.220', 'WEAPON3': '0.550', 'ARMOR': '0.873', 'HITCOUNT': '1.290', 'weapon2': '1.678', 'weapon3': '1.900', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '10.000'} [2024-08-05 23:01:24,916][52647] DAMAGECOUNT value on done: 21822.0 [2024-08-05 23:01:24,917][52647] Sum rewards: 16.990, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON3': '0.800', 'ARMOR': '0.898', 'HITCOUNT': '1.400', 'weapon3': '1.430', 'weapon2': '1.716', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '14.000'} [2024-08-05 23:01:24,940][52811] DAMAGECOUNT value on done: 17659.0 [2024-08-05 23:01:24,943][52811] Sum rewards: 14.059, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.228', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.100', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.208', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '0.912', 'HITCOUNT': '1.020', 'weapon3': '1.336', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:24,992][52795] DAMAGECOUNT value on done: 17701.0 [2024-08-05 23:01:24,992][52795] Sum rewards: 19.701, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.501', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON3': '0.700', 'ARMOR': '0.856', 'HITCOUNT': '1.370', 'weapon3': '1.582', 'weapon2': '1.908', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '17.000'} [2024-08-05 23:01:25,345][52660] DAMAGECOUNT value on done: 16477.0 [2024-08-05 23:01:25,345][52660] Sum rewards: 24.932, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.032', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'ARMOR': '0.451', 'WEAPON3': '1.000', 'weapon2': '1.198', 'HITCOUNT': '1.730', 'weapon3': '2.626', 'DAMAGECOUNT': '6.558', 'FRAGCOUNT': '21.000'} [2024-08-05 23:01:26,203][52668] DAMAGECOUNT value on done: 20649.0 [2024-08-05 23:01:26,203][52668] Sum rewards: 20.360, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.950', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.090', 'weapon4': '0.146', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.390', 'weapon2': '1.590', 'weapon3': '1.748', 'DAMAGECOUNT': '5.094', 'FRAGCOUNT': '16.000'} [2024-08-05 23:01:26,556][52650] Updated weights for policy 0, policy_version 11891 (0.0022) [2024-08-05 23:01:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 16994.9). Total num frames: 97427456. Throughput: 0: 4395.1. Samples: 24365750. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 23:01:27,794][52567] Avg episode reward: [(0, '16.507')] [2024-08-05 23:01:27,872][52660] DAMAGECOUNT value on done: 19878.0 [2024-08-05 23:01:27,873][52660] Sum rewards: 18.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.526', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.424', 'WEAPON3': '0.750', 'ARMOR': '0.885', 'weapon2': '1.030', 'HITCOUNT': '1.320', 'weapon3': '1.700', 'DAMAGECOUNT': '5.148', 'FRAGCOUNT': '15.000'} [2024-08-05 23:01:27,889][52647] DAMAGECOUNT value on done: 18366.0 [2024-08-05 23:01:27,891][52647] Sum rewards: 18.611, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.382', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.014', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.320', 'weapon3': '1.568', 'weapon2': '1.892', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '15.000'} [2024-08-05 23:01:28,154][52795] DAMAGECOUNT value on done: 17748.0 [2024-08-05 23:01:28,156][52795] Sum rewards: 17.741, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.062', 'WEAPON4': '0.200', 'AMMO4': '0.217', 'WEAPON3': '0.350', 'weapon4': '0.406', 'ARMOR': '0.436', 'HEALTH': '0.587', 'weapon2': '1.436', 'HITCOUNT': '1.440', 'weapon3': '1.478', 'DAMAGECOUNT': '4.512', 'FRAGCOUNT': '11.000'} [2024-08-05 23:01:28,933][52668] DAMAGECOUNT value on done: 17563.0 [2024-08-05 23:01:28,933][52668] Sum rewards: 6.125, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.690', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO3': '0.068', 'WEAPON3': '0.500', 'HITCOUNT': '0.680', 'weapon3': '1.002', 'weapon2': '1.272', 'DAMAGECOUNT': '2.652', 'FRAGCOUNT': '5.000'} [2024-08-05 23:01:30,330][52647] DAMAGECOUNT value on done: 20485.0 [2024-08-05 23:01:30,332][52647] Sum rewards: 18.622, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.123', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.064', 'WEAPON3': '0.550', 'HITCOUNT': '1.150', 'weapon3': '1.312', 'weapon2': '2.158', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '14.000'} [2024-08-05 23:01:31,090][52660] DAMAGECOUNT value on done: 17894.0 [2024-08-05 23:01:31,090][52660] Sum rewards: 15.257, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO3': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'HEALTH': '0.178', 'WEAPON3': '0.300', 'ARMOR': '0.440', 'weapon4': '0.554', 'weapon2': '1.102', 'HITCOUNT': '1.280', 'weapon3': '1.282', 'DAMAGECOUNT': '3.966', 'FRAGCOUNT': '9.500'} [2024-08-05 23:01:31,200][52650] Updated weights for policy 0, policy_version 11901 (0.0030) [2024-08-05 23:01:31,314][52795] DAMAGECOUNT value on done: 19878.0 [2024-08-05 23:01:31,315][52795] Sum rewards: 9.428, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.056', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.258', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'HITCOUNT': '0.950', 'weapon2': '1.196', 'weapon3': '1.364', 'DAMAGECOUNT': '2.928', 'FRAGCOUNT': '8.000'} [2024-08-05 23:01:31,966][52668] DAMAGECOUNT value on done: 21598.0 [2024-08-05 23:01:31,967][52668] Sum rewards: 15.074, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.788', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.248', 'ARMOR': '0.516', 'WEAPON3': '1.000', 'weapon2': '1.038', 'HITCOUNT': '1.440', 'weapon3': '1.968', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 16994.9). Total num frames: 97517568. Throughput: 0: 4388.0. Samples: 24378750. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 23:01:32,794][52567] Avg episode reward: [(0, '16.588')] [2024-08-05 23:01:32,892][52647] DAMAGECOUNT value on done: 19874.0 [2024-08-05 23:01:32,892][52647] Sum rewards: 19.096, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.868', 'AMMO2': '0.009', 'AMMO4': '0.047', 'ARMOR': '0.080', 'AMMO3': '0.091', 'WEAPON4': '0.250', 'weapon4': '0.410', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'weapon2': '1.344', 'weapon3': '1.738', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '15.000'} [2024-08-05 23:01:33,740][52660] DAMAGECOUNT value on done: 19529.0 [2024-08-05 23:01:33,741][52660] Sum rewards: 14.455, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.649', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.097', 'AMMO4': '0.146', 'weapon4': '0.338', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '1.210', 'weapon2': '1.300', 'weapon3': '1.596', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '10.500'} [2024-08-05 23:01:34,429][52795] DAMAGECOUNT value on done: 18539.0 [2024-08-05 23:01:34,429][52795] Sum rewards: 17.758, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.357', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.414', 'WEAPON3': '0.550', 'ARMOR': '0.888', 'HITCOUNT': '1.230', 'weapon3': '1.598', 'weapon2': '1.738', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:34,675][52668] DAMAGECOUNT value on done: 18518.0 [2024-08-05 23:01:34,676][52668] Sum rewards: 30.294, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.850', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.224', 'ARMOR': '0.408', 'WEAPON3': '0.950', 'weapon2': '1.302', 'HITCOUNT': '1.800', 'weapon3': '1.848', 'DAMAGECOUNT': '7.356', 'FRAGCOUNT': '26.000'} [2024-08-05 23:01:36,017][52650] Updated weights for policy 0, policy_version 11911 (0.0024) [2024-08-05 23:01:36,036][52647] DAMAGECOUNT value on done: 19183.0 [2024-08-05 23:01:36,036][52647] Sum rewards: 13.896, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.319', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.224', 'ARMOR': '0.404', 'WEAPON3': '0.750', 'HITCOUNT': '1.470', 'weapon2': '1.470', 'weapon3': '1.648', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '10.000'} [2024-08-05 23:01:36,775][52660] DAMAGECOUNT value on done: 19473.0 [2024-08-05 23:01:36,775][52660] Sum rewards: 19.543, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.169', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'ARMOR': '0.479', 'WEAPON3': '1.050', 'weapon2': '1.232', 'HITCOUNT': '1.530', 'weapon3': '2.416', 'DAMAGECOUNT': '5.823', 'FRAGCOUNT': '17.000'} [2024-08-05 23:01:37,552][52795] DAMAGECOUNT value on done: 17325.0 [2024-08-05 23:01:37,556][52795] Sum rewards: 16.547, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'HEALTH': '0.073', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.432', 'ARMOR': '0.528', 'WEAPON3': '0.550', 'weapon2': '0.932', 'HITCOUNT': '1.190', 'weapon3': '1.704', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:37,707][52668] DAMAGECOUNT value on done: 18876.0 [2024-08-05 23:01:37,708][52668] Sum rewards: 14.930, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.870', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.468', 'weapon2': '0.948', 'WEAPON3': '0.950', 'HITCOUNT': '1.300', 'weapon3': '1.730', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '14.000'} [2024-08-05 23:01:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17050.5). Total num frames: 97607680. Throughput: 0: 4380.4. Samples: 24405060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:01:37,794][52567] Avg episode reward: [(0, '16.803')] [2024-08-05 23:01:38,798][52647] DAMAGECOUNT value on done: 21472.0 [2024-08-05 23:01:38,798][52647] Sum rewards: 28.173, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.725', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.040', 'weapon5': '0.086', 'AMMO3': '0.092', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.554', 'WEAPON3': '0.750', 'weapon2': '0.946', 'HITCOUNT': '1.580', 'weapon3': '1.634', 'DAMAGECOUNT': '6.051', 'FRAGCOUNT': '23.000'} [2024-08-05 23:01:39,715][52660] DAMAGECOUNT value on done: 19501.0 [2024-08-05 23:01:39,715][52660] Sum rewards: 10.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.272', 'weapon4': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'ARMOR': '0.808', 'WEAPON3': '1.000', 'HITCOUNT': '1.070', 'weapon2': '1.290', 'weapon3': '2.062', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '10.000'} [2024-08-05 23:01:40,362][52650] Updated weights for policy 0, policy_version 11921 (0.0021) [2024-08-05 23:01:40,528][52668] DAMAGECOUNT value on done: 18850.0 [2024-08-05 23:01:40,528][52668] Sum rewards: 10.077, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.182', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.161', 'ARMOR': '0.836', 'WEAPON3': '0.950', 'HITCOUNT': '1.160', 'weapon2': '1.422', 'weapon3': '2.212', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '9.000'} [2024-08-05 23:01:40,743][52795] DAMAGECOUNT value on done: 18773.0 [2024-08-05 23:01:40,744][52795] Sum rewards: 14.603, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.451', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.332', 'WEAPON3': '0.800', 'ARMOR': '0.864', 'HITCOUNT': '1.180', 'weapon2': '1.284', 'weapon3': '1.968', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:41,309][52647] DAMAGECOUNT value on done: 21953.0 [2024-08-05 23:01:41,310][52647] Sum rewards: 11.424, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.410', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO3': '0.061', 'WEAPON3': '0.450', 'ARMOR': '0.875', 'HITCOUNT': '0.950', 'weapon3': '1.202', 'weapon2': '1.434', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '7.000'} [2024-08-05 23:01:42,252][52660] DAMAGECOUNT value on done: 19170.0 [2024-08-05 23:01:42,253][52660] Sum rewards: 17.084, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.549', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon4': '0.174', 'ARMOR': '0.453', 'WEAPON3': '1.050', 'HITCOUNT': '1.150', 'weapon2': '1.578', 'weapon3': '1.844', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '17.000'} [2024-08-05 23:01:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17022.7). Total num frames: 97689600. Throughput: 0: 4381.6. Samples: 24431500. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:01:42,794][52567] Avg episode reward: [(0, '16.696')] [2024-08-05 23:01:43,263][52668] DAMAGECOUNT value on done: 18770.0 [2024-08-05 23:01:43,263][52668] Sum rewards: 12.061, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.598', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.096', 'weapon4': '0.208', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.110', 'weapon2': '1.130', 'weapon3': '1.574', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '9.000'} [2024-08-05 23:01:43,927][52795] DAMAGECOUNT value on done: 19039.0 [2024-08-05 23:01:43,927][52795] Sum rewards: 17.373, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.243', 'AMMO2': '0.001', 'weapon4': '0.006', 'AMMO4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO3': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '1.010', 'weapon2': '1.234', 'ARMOR': '1.282', 'weapon3': '1.392', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:44,191][52647] DAMAGECOUNT value on done: 20496.0 [2024-08-05 23:01:44,191][52647] Sum rewards: 11.327, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.985', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.022', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'ARMOR': '0.451', 'weapon4': '0.490', 'WEAPON3': '0.900', 'weapon2': '1.246', 'HITCOUNT': '1.250', 'weapon3': '1.542', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '10.500'} [2024-08-05 23:01:45,138][52650] Updated weights for policy 0, policy_version 11931 (0.0025) [2024-08-05 23:01:45,344][52660] DAMAGECOUNT value on done: 19082.0 [2024-08-05 23:01:45,345][52660] Sum rewards: 18.343, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.012', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.138', 'ARMOR': '0.883', 'WEAPON3': '0.900', 'HITCOUNT': '1.370', 'weapon2': '1.590', 'weapon3': '1.792', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '16.000'} [2024-08-05 23:01:46,340][52668] DAMAGECOUNT value on done: 18085.0 [2024-08-05 23:01:46,341][52668] Sum rewards: 19.486, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.654', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.586', 'ARMOR': '0.863', 'weapon2': '0.962', 'HITCOUNT': '1.210', 'weapon3': '1.530', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '14.000'} [2024-08-05 23:01:47,010][52647] DAMAGECOUNT value on done: 20777.0 [2024-08-05 23:01:47,011][52647] Sum rewards: 17.772, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.756', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon4': '0.466', 'ARMOR': '0.892', 'weapon2': '0.906', 'WEAPON3': '1.150', 'HITCOUNT': '1.500', 'weapon3': '2.164', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '16.000'} [2024-08-05 23:01:47,091][52795] DAMAGECOUNT value on done: 18458.0 [2024-08-05 23:01:47,093][52795] Sum rewards: 11.798, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.646', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.454', 'ARMOR': '0.495', 'HITCOUNT': '0.940', 'weapon2': '0.952', 'WEAPON3': '1.000', 'weapon3': '2.020', 'DAMAGECOUNT': '3.348', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:47,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17050.4). Total num frames: 97779712. Throughput: 0: 4381.3. Samples: 24444660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:01:47,795][52567] Avg episode reward: [(0, '16.509')] [2024-08-05 23:01:48,350][52666] DAMAGECOUNT value on done: 19172.0 [2024-08-05 23:01:48,353][52666] Sum rewards: 16.008, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.233', 'AMMO5': '0.005', 'weapon7': '0.006', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'weapon4': '0.590', 'WEAPON3': '0.600', 'weapon2': '0.978', 'HITCOUNT': '1.240', 'weapon3': '1.618', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '12.500'} [2024-08-05 23:01:48,552][52660] DAMAGECOUNT value on done: 18902.0 [2024-08-05 23:01:48,553][52660] Sum rewards: 4.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.334', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon5': '0.038', 'AMMO4': '0.119', 'AMMO3': '0.154', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON4': '0.400', 'ARMOR': '0.504', 'HITCOUNT': '0.890', 'weapon2': '1.070', 'WEAPON3': '1.100', 'weapon3': '2.048', 'DAMAGECOUNT': '3.159', 'FRAGCOUNT': '6.500'} [2024-08-05 23:01:49,466][52668] DAMAGECOUNT value on done: 18244.0 [2024-08-05 23:01:49,474][52668] Sum rewards: 15.478, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.358', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.850', 'ARMOR': '1.259', 'HITCOUNT': '1.380', 'weapon2': '1.706', 'weapon3': '1.768', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:49,827][52647] DAMAGECOUNT value on done: 17188.0 [2024-08-05 23:01:49,828][52647] Sum rewards: 17.623, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.156', 'weapon4': '0.170', 'WEAPON4': '0.200', 'HEALTH': '0.308', 'ARMOR': '0.437', 'WEAPON3': '0.600', 'HITCOUNT': '1.150', 'weapon2': '1.608', 'weapon3': '1.632', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:49,878][52650] Updated weights for policy 0, policy_version 11941 (0.0012) [2024-08-05 23:01:50,226][52795] DAMAGECOUNT value on done: 18109.0 [2024-08-05 23:01:50,226][52795] Sum rewards: 15.241, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.129', 'HEALTH': '0.684', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.112', 'HITCOUNT': '1.370', 'weapon3': '1.978', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:50,297][52647] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:01:51,096][52666] DAMAGECOUNT value on done: 18191.0 [2024-08-05 23:01:51,096][52666] Sum rewards: 18.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.060', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'WEAPON3': '0.800', 'ARMOR': '0.907', 'weapon2': '1.502', 'HITCOUNT': '1.680', 'weapon3': '1.818', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '16.000'} [2024-08-05 23:01:51,171][52670] DAMAGECOUNT value on done: 19143.0 [2024-08-05 23:01:51,174][52670] Sum rewards: 15.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.491', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.082', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.496', 'WEAPON3': '0.600', 'HITCOUNT': '0.970', 'weapon2': '1.344', 'ARMOR': '1.375', 'weapon3': '1.468', 'DAMAGECOUNT': '2.892', 'FRAGCOUNT': '12.000'} [2024-08-05 23:01:51,418][52660] DAMAGECOUNT value on done: 19001.0 [2024-08-05 23:01:51,419][52660] Sum rewards: 12.864, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.568', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.126', 'AMMO3': '0.166', 'weapon5': '0.174', 'WEAPON4': '0.200', 'ARMOR': '0.848', 'WEAPON3': '0.950', 'HITCOUNT': '0.960', 'weapon2': '1.476', 'weapon3': '1.736', 'DAMAGECOUNT': '3.306', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:52,247][52668] DAMAGECOUNT value on done: 18107.0 [2024-08-05 23:01:52,253][52668] Sum rewards: 16.407, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.018', 'HEALTH': '0.082', 'AMMO4': '0.085', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON3': '0.600', 'ARMOR': '0.894', 'HITCOUNT': '1.000', 'weapon2': '1.508', 'weapon3': '1.616', 'DAMAGECOUNT': '3.645', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:52,390][52647] DAMAGECOUNT value on done: 19059.0 [2024-08-05 23:01:52,390][52647] Sum rewards: 10.766, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.750', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.028', 'weapon4': '0.042', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.877', 'HITCOUNT': '1.160', 'weapon3': '1.442', 'weapon2': '1.664', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '8.000'} [2024-08-05 23:01:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17078.3). Total num frames: 97869824. Throughput: 0: 4378.0. Samples: 24471110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:01:52,794][52567] Avg episode reward: [(0, '16.452')] [2024-08-05 23:01:53,369][52795] DAMAGECOUNT value on done: 18606.0 [2024-08-05 23:01:53,370][52795] Sum rewards: 18.970, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'AMMO4': '0.137', 'weapon5': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.479', 'weapon4': '0.512', 'WEAPON3': '0.850', 'weapon2': '0.982', 'HITCOUNT': '1.500', 'weapon3': '1.922', 'DAMAGECOUNT': '5.415', 'FRAGCOUNT': '15.000'} [2024-08-05 23:01:54,045][52666] DAMAGECOUNT value on done: 19060.0 [2024-08-05 23:01:54,046][52666] Sum rewards: 5.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.674', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.116', 'AMMO3': '0.131', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon4': '0.278', 'ARMOR': '0.469', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '0.990', 'weapon2': '1.236', 'weapon3': '2.120', 'DAMAGECOUNT': '3.333', 'FRAGCOUNT': '9.000'} [2024-08-05 23:01:54,089][52670] DAMAGECOUNT value on done: 19164.0 [2024-08-05 23:01:54,089][52670] Sum rewards: 25.875, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.777', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'weapon4': '0.202', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.434', 'HITCOUNT': '1.690', 'weapon3': '1.760', 'DAMAGECOUNT': '6.402', 'FRAGCOUNT': '19.000'} [2024-08-05 23:01:54,096][52660] DAMAGECOUNT value on done: 20727.0 [2024-08-05 23:01:54,098][52660] Sum rewards: 21.634, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.094', 'AMMO4': '0.106', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.418', 'WEAPON3': '0.800', 'ARMOR': '0.940', 'weapon2': '1.242', 'HITCOUNT': '1.430', 'weapon3': '1.980', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '18.000'} [2024-08-05 23:01:54,821][52647] DAMAGECOUNT value on done: 19526.0 [2024-08-05 23:01:54,831][52647] Sum rewards: 19.761, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'HEALTH': '0.017', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'AMMO4': '0.115', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.288', 'ARMOR': '0.506', 'WEAPON3': '0.600', 'weapon2': '1.314', 'HITCOUNT': '1.320', 'weapon3': '1.618', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '15.000'} [2024-08-05 23:01:54,832][52650] Updated weights for policy 0, policy_version 11951 (0.0022) [2024-08-05 23:01:54,932][52668] DAMAGECOUNT value on done: 19461.0 [2024-08-05 23:01:54,933][52668] Sum rewards: 6.576, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.017', 'ARMOR': '0.044', 'AMMO4': '0.085', 'AMMO3': '0.094', 'WEAPON4': '0.200', 'HEALTH': '0.230', 'weapon4': '0.230', 'WEAPON3': '0.600', 'HITCOUNT': '0.910', 'weapon2': '1.394', 'weapon3': '1.754', 'DAMAGECOUNT': '3.018', 'FRAGCOUNT': '4.000'} [2024-08-05 23:01:56,678][52660] DAMAGECOUNT value on done: 19369.0 [2024-08-05 23:01:56,678][52660] Sum rewards: 8.680, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.421', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.024', 'ARMOR': '0.040', 'AMMO4': '0.073', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.430', 'WEAPON3': '0.550', 'HITCOUNT': '0.790', 'weapon2': '1.242', 'weapon3': '1.532', 'DAMAGECOUNT': '2.475', 'FRAGCOUNT': '6.000'} [2024-08-05 23:01:57,107][52647] DAMAGECOUNT value on done: 22338.0 [2024-08-05 23:01:57,109][52647] Sum rewards: 15.897, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.359', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.139', 'weapon4': '0.160', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'WEAPON3': '1.100', 'weapon2': '1.426', 'HITCOUNT': '1.430', 'weapon3': '2.116', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '15.000'} [2024-08-05 23:01:57,195][52666] DAMAGECOUNT value on done: 18207.0 [2024-08-05 23:01:57,196][52666] Sum rewards: 16.954, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.180', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.138', 'ARMOR': '0.472', 'WEAPON3': '0.700', 'HITCOUNT': '1.310', 'weapon3': '1.424', 'weapon2': '1.704', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:57,270][52670] DAMAGECOUNT value on done: 17842.0 [2024-08-05 23:01:57,270][52670] Sum rewards: 18.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.599', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.094', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'HITCOUNT': '1.500', 'weapon3': '1.722', 'weapon2': '1.734', 'DAMAGECOUNT': '5.889', 'FRAGCOUNT': '14.000'} [2024-08-05 23:01:57,492][52668] DAMAGECOUNT value on done: 20130.0 [2024-08-05 23:01:57,494][52668] Sum rewards: 16.149, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.700', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.046', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.392', 'ARMOR': '0.481', 'WEAPON3': '0.500', 'weapon2': '1.132', 'HITCOUNT': '1.290', 'weapon3': '1.390', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '11.000'} [2024-08-05 23:01:57,802][52567] Fps is (10 sec: 17190.3, 60 sec: 17337.5, 300 sec: 17077.8). Total num frames: 97951744. Throughput: 0: 4378.1. Samples: 24497250. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:01:57,802][52567] Avg episode reward: [(0, '16.450')] [2024-08-05 23:01:59,133][52660] DAMAGECOUNT value on done: 21254.0 [2024-08-05 23:01:59,136][52660] Sum rewards: 17.742, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.561', 'AMMO2': '0.002', 'AMMO4': '0.010', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'WEAPON3': '0.650', 'ARMOR': '1.239', 'HITCOUNT': '1.370', 'weapon2': '1.602', 'weapon3': '1.728', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '13.000'} [2024-08-05 23:01:59,271][52650] Updated weights for policy 0, policy_version 11961 (0.0014) [2024-08-05 23:01:59,456][52647] DAMAGECOUNT value on done: 17778.0 [2024-08-05 23:01:59,457][52647] Sum rewards: 14.688, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.254', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.076', 'WEAPON3': '0.550', 'ARMOR': '0.851', 'HITCOUNT': '1.140', 'weapon3': '1.512', 'weapon2': '1.738', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '10.000'} [2024-08-05 23:01:59,515][52669] Large shaping reward 2.596 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon7', 0.002)] [2024-08-05 23:02:00,010][52668] DAMAGECOUNT value on done: 20737.0 [2024-08-05 23:02:00,018][52668] Sum rewards: 21.373, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.105', 'weapon5': '0.116', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'HEALTH': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.314', 'WEAPON3': '0.650', 'weapon2': '1.222', 'ARMOR': '1.313', 'HITCOUNT': '1.770', 'weapon3': '2.100', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '15.000'} [2024-08-05 23:02:00,407][52669] DAMAGECOUNT value on done: 19843.0 [2024-08-05 23:02:00,407][52669] Sum rewards: 20.567, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.598', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'ARMOR': '0.479', 'WEAPON3': '0.800', 'HITCOUNT': '1.280', 'weapon2': '1.344', 'weapon3': '1.788', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:00,412][52666] DAMAGECOUNT value on done: 18799.0 [2024-08-05 23:02:00,413][52666] Sum rewards: 18.285, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.134', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.060', 'AMMO3': '0.065', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '0.484', 'weapon2': '0.598', 'weapon4': '0.674', 'HITCOUNT': '0.960', 'weapon3': '1.392', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:00,491][52670] DAMAGECOUNT value on done: 20519.0 [2024-08-05 23:02:00,494][52670] Sum rewards: 23.448, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.276', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'ARMOR': '0.032', 'AMMO3': '0.122', 'WEAPON4': '0.300', 'weapon4': '0.512', 'WEAPON3': '0.900', 'weapon2': '1.038', 'weapon3': '1.846', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '20.000'} [2024-08-05 23:02:02,053][52647] DAMAGECOUNT value on done: 22238.0 [2024-08-05 23:02:02,053][52647] Sum rewards: 19.059, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.464', 'WEAPON3': '0.650', 'weapon2': '1.276', 'HITCOUNT': '1.350', 'weapon3': '1.556', 'ARMOR': '1.638', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:02,126][52660] DAMAGECOUNT value on done: 18586.0 [2024-08-05 23:02:02,127][52660] Sum rewards: 17.945, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.172', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'ARMOR': '0.454', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon2': '1.594', 'weapon3': '2.210', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:02,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17106.0). Total num frames: 98041856. Throughput: 0: 4381.5. Samples: 24510380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:02:02,795][52567] Avg episode reward: [(0, '16.450')] [2024-08-05 23:02:03,291][52666] DAMAGECOUNT value on done: 17459.0 [2024-08-05 23:02:03,291][52666] Sum rewards: 11.925, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.352', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'ARMOR': '0.036', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.306', 'WEAPON3': '0.700', 'weapon2': '1.022', 'HITCOUNT': '1.160', 'weapon3': '1.680', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '9.000'} [2024-08-05 23:02:03,347][52670] DAMAGECOUNT value on done: 17896.0 [2024-08-05 23:02:03,349][52670] Sum rewards: 14.780, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.935', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'AMMO3': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'weapon2': '1.308', 'weapon3': '1.596', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '11.500'} [2024-08-05 23:02:03,371][52669] DAMAGECOUNT value on done: 19692.0 [2024-08-05 23:02:03,371][52669] Sum rewards: 15.675, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.682', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon7': '0.060', 'AMMO3': '0.076', 'AMMO4': '0.103', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON3': '0.550', 'weapon2': '1.026', 'HITCOUNT': '1.290', 'weapon3': '1.572', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '11.000'} [2024-08-05 23:02:03,877][52650] Updated weights for policy 0, policy_version 11971 (0.0021) [2024-08-05 23:02:04,606][52647] DAMAGECOUNT value on done: 19871.0 [2024-08-05 23:02:04,607][52647] Sum rewards: 17.671, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.296', 'WEAPON3': '0.850', 'weapon2': '1.280', 'HITCOUNT': '1.580', 'weapon3': '2.050', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:05,272][52660] DAMAGECOUNT value on done: 19865.0 [2024-08-05 23:02:05,282][52660] Sum rewards: 24.623, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.242', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.320', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '0.926', 'HITCOUNT': '1.600', 'weapon3': '2.532', 'DAMAGECOUNT': '5.616', 'FRAGCOUNT': '20.000'} [2024-08-05 23:02:05,688][52669] DAMAGECOUNT value on done: 19657.0 [2024-08-05 23:02:05,688][52669] Sum rewards: 15.352, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.936', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon2': '1.404', 'HITCOUNT': '1.480', 'weapon3': '1.852', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:06,158][52666] DAMAGECOUNT value on done: 19284.0 [2024-08-05 23:02:06,159][52666] Sum rewards: 15.475, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.414', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.380', 'weapon2': '1.652', 'weapon3': '1.958', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:06,250][52670] DAMAGECOUNT value on done: 20902.0 [2024-08-05 23:02:06,252][52670] Sum rewards: 14.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.116', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '1.310', 'weapon2': '1.536', 'weapon3': '1.762', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:07,603][52820] DAMAGECOUNT value on done: 15785.0 [2024-08-05 23:02:07,606][52820] Sum rewards: 16.966, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.854', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon7': '0.058', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon4': '0.260', 'WEAPON3': '0.600', 'ARMOR': '0.935', 'HITCOUNT': '0.950', 'weapon3': '1.134', 'weapon2': '1.490', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:07,674][52647] DAMAGECOUNT value on done: 20831.0 [2024-08-05 23:02:07,677][52647] Sum rewards: 18.109, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.216', 'ARMOR': '0.400', 'HEALTH': '0.402', 'WEAPON3': '0.500', 'weapon2': '1.334', 'HITCOUNT': '1.420', 'weapon3': '1.602', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:07,794][52567] Fps is (10 sec: 18036.6, 60 sec: 17612.9, 300 sec: 17133.8). Total num frames: 98131968. Throughput: 0: 4385.3. Samples: 24536780. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:02:07,794][52567] Avg episode reward: [(0, '16.309')] [2024-08-05 23:02:08,382][52660] DAMAGECOUNT value on done: 18865.0 [2024-08-05 23:02:08,383][52660] Sum rewards: 12.011, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.580', 'AMMO2': '0.020', 'AMMO3': '0.089', 'AMMO4': '0.097', 'WEAPON4': '0.350', 'weapon4': '0.374', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '1.010', 'weapon2': '1.380', 'weapon3': '1.544', 'DAMAGECOUNT': '3.567', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:08,518][52650] Updated weights for policy 0, policy_version 11981 (0.0019) [2024-08-05 23:02:08,744][52669] DAMAGECOUNT value on done: 21065.0 [2024-08-05 23:02:08,745][52669] Sum rewards: 10.332, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.096', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.430', 'WEAPON3': '0.750', 'HITCOUNT': '1.180', 'weapon2': '1.544', 'weapon3': '1.570', 'DAMAGECOUNT': '3.702', 'FRAGCOUNT': '10.500'} [2024-08-05 23:02:08,845][52666] DAMAGECOUNT value on done: 18648.0 [2024-08-05 23:02:08,847][52666] Sum rewards: 15.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.023', 'ARMOR': '0.028', 'weapon5': '0.066', 'AMMO4': '0.115', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.122', 'HITCOUNT': '1.310', 'weapon3': '1.688', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:08,987][52670] DAMAGECOUNT value on done: 17783.0 [2024-08-05 23:02:08,990][52670] Sum rewards: 9.642, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.079', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO3': '0.085', 'WEAPON3': '0.650', 'HITCOUNT': '0.940', 'weapon3': '1.456', 'weapon2': '1.578', 'DAMAGECOUNT': '3.330', 'FRAGCOUNT': '8.000'} [2024-08-05 23:02:10,359][52647] DAMAGECOUNT value on done: 20750.0 [2024-08-05 23:02:10,359][52647] Sum rewards: 17.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.055', 'AMMO2': '0.016', 'ARMOR': '0.036', 'AMMO4': '0.079', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON3': '0.850', 'weapon2': '1.006', 'HITCOUNT': '1.490', 'weapon3': '1.968', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:10,684][52820] DAMAGECOUNT value on done: 18259.0 [2024-08-05 23:02:10,686][52820] Sum rewards: 16.816, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.370', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'weapon4': '0.434', 'WEAPON3': '0.700', 'weapon2': '1.042', 'HITCOUNT': '1.600', 'weapon3': '1.842', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:10,712][52665] DAMAGECOUNT value on done: 18319.0 [2024-08-05 23:02:10,713][52665] Sum rewards: 12.078, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.136', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.228', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'ARMOR': '1.344', 'weapon2': '1.526', 'weapon3': '1.654', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:11,815][52669] DAMAGECOUNT value on done: 21075.0 [2024-08-05 23:02:11,815][52669] Sum rewards: 28.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.340', 'ARMOR': '0.495', 'WEAPON3': '0.850', 'weapon2': '0.926', 'HITCOUNT': '1.820', 'weapon3': '1.938', 'DAMAGECOUNT': '7.536', 'FRAGCOUNT': '22.500'} [2024-08-05 23:02:12,243][52666] DAMAGECOUNT value on done: 19536.0 [2024-08-05 23:02:12,244][52666] Sum rewards: 17.614, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.204', 'AMMO5': '0.010', 'AMMO2': '0.029', 'ARMOR': '0.080', 'weapon4': '0.104', 'AMMO3': '0.111', 'AMMO4': '0.143', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'weapon2': '1.058', 'HITCOUNT': '1.370', 'weapon3': '2.108', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '14.500'} [2024-08-05 23:02:12,349][52670] DAMAGECOUNT value on done: 17532.0 [2024-08-05 23:02:12,350][52670] Sum rewards: 21.884, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.377', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.093', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'ARMOR': '1.365', 'weapon2': '1.604', 'weapon3': '1.964', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:12,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.8, 300 sec: 17133.8). Total num frames: 98222080. Throughput: 0: 4386.7. Samples: 24563150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:02:12,794][52567] Avg episode reward: [(0, '16.293')] [2024-08-05 23:02:13,197][52650] Updated weights for policy 0, policy_version 11991 (0.0029) [2024-08-05 23:02:13,363][52665] DAMAGECOUNT value on done: 19173.0 [2024-08-05 23:02:13,363][52665] Sum rewards: 11.511, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.536', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'WEAPON3': '0.800', 'HITCOUNT': '0.980', 'ARMOR': '1.382', 'weapon2': '1.560', 'weapon3': '1.574', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '9.000'} [2024-08-05 23:02:13,854][52820] DAMAGECOUNT value on done: 17015.0 [2024-08-05 23:02:13,855][52820] Sum rewards: 14.077, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.010', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.060', 'AMMO3': '0.138', 'AMMO4': '0.145', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.450', 'ARMOR': '0.948', 'WEAPON3': '0.950', 'HITCOUNT': '1.060', 'weapon2': '1.460', 'weapon3': '1.840', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:14,676][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:02:14,904][52669] DAMAGECOUNT value on done: 20416.0 [2024-08-05 23:02:14,906][52669] Sum rewards: 10.923, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.366', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'weapon5': '0.010', 'weapon7': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.468', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'ARMOR': '1.255', 'weapon2': '1.464', 'weapon3': '1.656', 'DAMAGECOUNT': '4.026', 'FRAGCOUNT': '9.000'} [2024-08-05 23:02:14,970][52666] DAMAGECOUNT value on done: 18466.0 [2024-08-05 23:02:14,973][52666] Sum rewards: 19.325, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.388', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.118', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'weapon2': '1.260', 'HITCOUNT': '1.380', 'weapon3': '1.984', 'DAMAGECOUNT': '5.790', 'FRAGCOUNT': '14.500'} [2024-08-05 23:02:15,150][52670] DAMAGECOUNT value on done: 17107.0 [2024-08-05 23:02:15,152][52670] Sum rewards: 8.150, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.957', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon4': '0.588', 'WEAPON3': '0.800', 'HITCOUNT': '0.890', 'weapon2': '0.956', 'ARMOR': '1.380', 'weapon3': '1.642', 'DAMAGECOUNT': '3.246', 'FRAGCOUNT': '6.000'} [2024-08-05 23:02:16,480][52665] DAMAGECOUNT value on done: 19759.0 [2024-08-05 23:02:16,481][52665] Sum rewards: 8.683, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.512', 'AMMO4': '-0.119', 'AMMO2': '-0.024', 'AMMO3': '0.097', 'WEAPON3': '0.750', 'HITCOUNT': '0.780', 'ARMOR': '0.956', 'weapon3': '1.316', 'weapon2': '1.928', 'DAMAGECOUNT': '2.760', 'FRAGCOUNT': '7.000'} [2024-08-05 23:02:16,899][52820] DAMAGECOUNT value on done: 18038.0 [2024-08-05 23:02:16,901][52820] Sum rewards: 11.126, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.265', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.070', 'weapon4': '0.072', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '1.130', 'weapon3': '1.672', 'weapon2': '1.980', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '7.000'} [2024-08-05 23:02:17,714][52650] Updated weights for policy 0, policy_version 12001 (0.0021) [2024-08-05 23:02:17,774][52669] DAMAGECOUNT value on done: 21257.0 [2024-08-05 23:02:17,777][52669] Sum rewards: 13.775, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.029', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.250', 'weapon4': '0.262', 'ARMOR': '0.459', 'WEAPON3': '0.800', 'weapon2': '0.930', 'HITCOUNT': '1.150', 'weapon3': '1.850', 'DAMAGECOUNT': '4.347', 'FRAGCOUNT': '11.000'} [2024-08-05 23:02:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17189.9). Total num frames: 98312192. Throughput: 0: 4397.8. Samples: 24576650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:02:17,794][52567] Avg episode reward: [(0, '15.951')] [2024-08-05 23:02:17,834][52666] DAMAGECOUNT value on done: 16289.0 [2024-08-05 23:02:17,836][52666] Sum rewards: 17.807, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.088', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.206', 'WEAPON3': '0.500', 'ARMOR': '0.985', 'HITCOUNT': '1.080', 'weapon2': '1.194', 'weapon3': '1.494', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:17,971][52670] DAMAGECOUNT value on done: 16360.0 [2024-08-05 23:02:17,972][52670] Sum rewards: 12.714, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon7': '0.052', 'weapon5': '0.064', 'AMMO3': '0.067', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.840', 'weapon2': '1.022', 'weapon3': '1.320', 'DAMAGECOUNT': '3.546', 'FRAGCOUNT': '8.000'} [2024-08-05 23:02:19,099][52665] DAMAGECOUNT value on done: 20501.0 [2024-08-05 23:02:19,099][52665] Sum rewards: 12.674, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.152', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon2': '0.642', 'weapon4': '1.026', 'HITCOUNT': '1.110', 'weapon3': '1.514', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:20,004][52820] DAMAGECOUNT value on done: 19467.0 [2024-08-05 23:02:20,004][52820] Sum rewards: 20.547, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.294', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.013', 'AMMO3': '0.099', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.428', 'ARMOR': '0.440', 'weapon2': '0.712', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'weapon3': '1.900', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:20,739][52666] DAMAGECOUNT value on done: 17061.0 [2024-08-05 23:02:20,740][52666] Sum rewards: 11.777, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.494', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.372', 'WEAPON3': '0.750', 'ARMOR': '0.905', 'HITCOUNT': '0.990', 'weapon2': '1.342', 'weapon3': '1.830', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:20,855][52670] DAMAGECOUNT value on done: 19497.0 [2024-08-05 23:02:20,855][52670] Sum rewards: 20.351, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.560', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '1.280', 'weapon3': '1.376', 'weapon2': '1.872', 'DAMAGECOUNT': '4.785', 'FRAGCOUNT': '15.000'} [2024-08-05 23:02:20,933][52669] DAMAGECOUNT value on done: 19068.0 [2024-08-05 23:02:20,936][52669] Sum rewards: 1.855, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.142', 'weapon4': '0.188', 'WEAPON4': '0.200', 'HITCOUNT': '0.700', 'WEAPON3': '0.900', 'ARMOR': '1.251', 'weapon2': '1.506', 'weapon3': '1.964', 'DAMAGECOUNT': '2.025', 'FRAGCOUNT': '4.000'} [2024-08-05 23:02:21,646][52665] DAMAGECOUNT value on done: 18131.0 [2024-08-05 23:02:21,654][52665] Sum rewards: 13.495, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.291', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.012', 'ARMOR': '0.044', 'AMMO3': '0.050', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.400', 'weapon4': '0.518', 'weapon2': '0.950', 'HITCOUNT': '1.000', 'weapon3': '1.218', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '8.000'} [2024-08-05 23:02:22,349][52650] Updated weights for policy 0, policy_version 12011 (0.0011) [2024-08-05 23:02:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17161.5). Total num frames: 98394112. Throughput: 0: 4398.7. Samples: 24603000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-05 23:02:22,794][52567] Avg episode reward: [(0, '15.822')] [2024-08-05 23:02:23,087][52820] DAMAGECOUNT value on done: 18553.0 [2024-08-05 23:02:23,089][52820] Sum rewards: 12.056, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.588', 'AMMO2': '0.002', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'ARMOR': '0.487', 'WEAPON3': '0.750', 'HITCOUNT': '0.830', 'weapon3': '1.350', 'weapon2': '1.468', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:23,417][52666] DAMAGECOUNT value on done: 19211.0 [2024-08-05 23:02:23,417][52666] Sum rewards: 15.967, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.644', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.097', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.926', 'HITCOUNT': '1.290', 'weapon2': '1.454', 'weapon3': '1.712', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:23,557][52670] DAMAGECOUNT value on done: 20814.0 [2024-08-05 23:02:23,557][52670] Sum rewards: 20.637, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.865', 'AMMO2': '0.029', 'ARMOR': '0.032', 'AMMO3': '0.086', 'AMMO4': '0.144', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON3': '0.600', 'HITCOUNT': '1.370', 'weapon2': '1.578', 'weapon3': '1.586', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:24,073][52669] DAMAGECOUNT value on done: 18863.0 [2024-08-05 23:02:24,074][52669] Sum rewards: 21.018, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.618', 'weapon5': '0.002', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.700', 'ARMOR': '0.885', 'HITCOUNT': '1.540', 'weapon2': '1.762', 'weapon3': '1.940', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:24,637][52665] DAMAGECOUNT value on done: 19409.0 [2024-08-05 23:02:24,639][52665] Sum rewards: 21.570, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.922', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.087', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.876', 'weapon3': '1.552', 'HITCOUNT': '1.580', 'weapon2': '1.590', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:26,078][52820] DAMAGECOUNT value on done: 17748.0 [2024-08-05 23:02:26,078][52820] Sum rewards: 23.481, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.092', 'WEAPON4': '0.350', 'ARMOR': '0.562', 'weapon4': '0.622', 'WEAPON3': '0.700', 'weapon2': '0.988', 'HITCOUNT': '1.640', 'weapon3': '1.772', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '19.000'} [2024-08-05 23:02:26,454][52666] DAMAGECOUNT value on done: 18690.0 [2024-08-05 23:02:26,454][52666] Sum rewards: 24.393, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.389', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO3': '0.063', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.364', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'weapon2': '1.272', 'weapon3': '1.378', 'HITCOUNT': '1.420', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:26,760][52670] DAMAGECOUNT value on done: 20687.0 [2024-08-05 23:02:26,771][52670] Sum rewards: 22.346, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'HEALTH': '0.069', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.945', 'HITCOUNT': '1.330', 'weapon3': '1.598', 'weapon2': '1.606', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:27,192][52650] Updated weights for policy 0, policy_version 12021 (0.0010) [2024-08-05 23:02:27,227][52669] DAMAGECOUNT value on done: 18764.0 [2024-08-05 23:02:27,231][52669] Sum rewards: 24.451, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.500', 'ARMOR': '0.825', 'HITCOUNT': '1.360', 'weapon2': '1.476', 'weapon3': '1.580', 'DAMAGECOUNT': '5.433', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:27,344][52665] DAMAGECOUNT value on done: 20285.0 [2024-08-05 23:02:27,344][52665] Sum rewards: 17.297, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.964', 'AMMO2': '0.017', 'AMMO3': '0.075', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.472', 'WEAPON3': '0.550', 'ARMOR': '0.858', 'weapon2': '1.052', 'HITCOUNT': '1.320', 'weapon3': '1.578', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17189.3). Total num frames: 98476032. Throughput: 0: 4395.6. Samples: 24629300. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-05 23:02:27,794][52567] Avg episode reward: [(0, '16.132')] [2024-08-05 23:02:27,887][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012022_98484224.pth... [2024-08-05 23:02:28,030][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011516_94339072.pth [2024-08-05 23:02:28,687][52614] Signal inference workers to stop experience collection... (2250 times) [2024-08-05 23:02:28,694][52614] Signal inference workers to resume experience collection... (2250 times) [2024-08-05 23:02:28,777][52650] InferenceWorker_p0-w0: stopping experience collection (2250 times) [2024-08-05 23:02:28,777][52650] InferenceWorker_p0-w0: resuming experience collection (2250 times) [2024-08-05 23:02:29,270][52820] DAMAGECOUNT value on done: 18065.0 [2024-08-05 23:02:29,273][52820] Sum rewards: 12.500, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.694', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.097', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'WEAPON3': '1.000', 'HITCOUNT': '1.360', 'weapon2': '1.390', 'weapon3': '1.928', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:29,493][52666] DAMAGECOUNT value on done: 18781.0 [2024-08-05 23:02:29,494][52666] Sum rewards: 17.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.654', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.164', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'ARMOR': '1.367', 'weapon2': '1.374', 'HITCOUNT': '1.400', 'weapon3': '1.726', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:29,724][52670] DAMAGECOUNT value on done: 20187.0 [2024-08-05 23:02:29,725][52670] Sum rewards: 18.639, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.372', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.168', 'weapon4': '0.198', 'WEAPON4': '0.200', 'ARMOR': '0.926', 'WEAPON3': '1.000', 'HITCOUNT': '1.400', 'weapon2': '1.606', 'weapon3': '1.898', 'DAMAGECOUNT': '5.169', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:30,341][52665] DAMAGECOUNT value on done: 19789.0 [2024-08-05 23:02:30,341][52665] Sum rewards: 27.830, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.076', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON3': '0.750', 'weapon2': '1.652', 'HITCOUNT': '1.870', 'weapon3': '1.962', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '22.000'} [2024-08-05 23:02:30,480][52669] DAMAGECOUNT value on done: 19578.0 [2024-08-05 23:02:30,481][52669] Sum rewards: 9.893, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.561', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.060', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon2': '1.512', 'weapon3': '1.962', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '7.000'} [2024-08-05 23:02:31,617][52650] Updated weights for policy 0, policy_version 12031 (0.0031) [2024-08-05 23:02:32,552][52820] DAMAGECOUNT value on done: 17269.0 [2024-08-05 23:02:32,554][52820] Sum rewards: 11.633, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.254', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.161', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.756', 'weapon2': '0.780', 'HITCOUNT': '0.930', 'weapon3': '1.414', 'DAMAGECOUNT': '3.303', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:32,641][52666] DAMAGECOUNT value on done: 18706.0 [2024-08-05 23:02:32,642][52666] Sum rewards: 29.525, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.211', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.071', 'weapon4': '0.232', 'WEAPON3': '0.600', 'ARMOR': '0.907', 'weapon3': '1.680', 'weapon2': '1.752', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.738', 'FRAGCOUNT': '22.000'} [2024-08-05 23:02:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17189.3). Total num frames: 98574336. Throughput: 0: 4386.3. Samples: 24642040. Policy #0 lag: (min: 1.0, avg: 4.6, max: 9.0) [2024-08-05 23:02:32,794][52567] Avg episode reward: [(0, '16.314')] [2024-08-05 23:02:32,818][52670] DAMAGECOUNT value on done: 19596.0 [2024-08-05 23:02:32,820][52670] Sum rewards: 19.175, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'HEALTH': '0.020', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.318', 'ARMOR': '0.520', 'WEAPON3': '0.550', 'HITCOUNT': '1.310', 'weapon2': '1.320', 'weapon3': '1.460', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '13.500'} [2024-08-05 23:02:33,092][52665] DAMAGECOUNT value on done: 21697.0 [2024-08-05 23:02:33,092][52665] Sum rewards: 23.680, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON3': '0.900', 'weapon2': '1.060', 'HITCOUNT': '1.750', 'weapon3': '2.024', 'DAMAGECOUNT': '6.549', 'FRAGCOUNT': '21.000'} [2024-08-05 23:02:33,487][52669] DAMAGECOUNT value on done: 21870.0 [2024-08-05 23:02:33,497][52669] Sum rewards: 27.710, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.555', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.153', 'ARMOR': '0.873', 'WEAPON3': '1.000', 'weapon2': '1.668', 'weapon3': '1.700', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '7.059', 'FRAGCOUNT': '23.000'} [2024-08-05 23:02:34,960][52667] DAMAGECOUNT value on done: 19791.0 [2024-08-05 23:02:34,962][52667] Sum rewards: 30.107, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.021', 'AMMO3': '0.090', 'weapon4': '0.092', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '1.258', 'weapon2': '1.536', 'HITCOUNT': '1.670', 'weapon3': '1.858', 'DAMAGECOUNT': '6.174', 'FRAGCOUNT': '24.500'} [2024-08-05 23:02:35,139][52666] DAMAGECOUNT value on done: 17307.0 [2024-08-05 23:02:35,139][52666] Sum rewards: 14.347, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.176', 'weapon5': '0.368', 'HEALTH': '0.392', 'WEAPON3': '0.400', 'HITCOUNT': '1.100', 'weapon2': '1.362', 'weapon3': '1.384', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '8.500'} [2024-08-05 23:02:35,314][52670] DAMAGECOUNT value on done: 18517.0 [2024-08-05 23:02:35,315][52670] Sum rewards: 22.649, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.705', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.208', 'ARMOR': '0.454', 'WEAPON3': '0.750', 'HITCOUNT': '1.500', 'weapon3': '1.576', 'weapon2': '1.602', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:35,584][52665] DAMAGECOUNT value on done: 20079.0 [2024-08-05 23:02:35,584][52665] Sum rewards: 17.003, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'weapon5': '0.084', 'AMMO3': '0.086', 'AMMO4': '0.192', 'HEALTH': '0.251', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.570', 'weapon2': '1.026', 'HITCOUNT': '1.250', 'weapon3': '1.472', 'DAMAGECOUNT': '4.029', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:35,739][52820] DAMAGECOUNT value on done: 18411.0 [2024-08-05 23:02:35,741][52820] Sum rewards: 14.000, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.360', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'ARMOR': '0.913', 'WEAPON3': '0.950', 'HITCOUNT': '1.240', 'weapon3': '1.726', 'weapon2': '1.848', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:36,092][52663] DAMAGECOUNT value on done: 20721.0 [2024-08-05 23:02:36,092][52663] Sum rewards: 19.342, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.940', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.136', 'WEAPON3': '1.000', 'weapon2': '1.218', 'HITCOUNT': '1.380', 'weapon3': '2.328', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:36,221][52669] DAMAGECOUNT value on done: 19391.0 [2024-08-05 23:02:36,222][52669] Sum rewards: 22.669, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.184', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.220', 'ARMOR': '0.484', 'WEAPON3': '1.000', 'weapon2': '1.198', 'HITCOUNT': '1.760', 'weapon3': '2.296', 'DAMAGECOUNT': '6.597', 'FRAGCOUNT': '19.000'} [2024-08-05 23:02:36,487][52650] Updated weights for policy 0, policy_version 12041 (0.0011) [2024-08-05 23:02:37,754][52667] DAMAGECOUNT value on done: 21010.0 [2024-08-05 23:02:37,755][52667] Sum rewards: 21.250, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.088', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HEALTH': '0.446', 'HITCOUNT': '1.370', 'weapon3': '1.496', 'weapon2': '1.816', 'DAMAGECOUNT': '5.073', 'FRAGCOUNT': '14.500'} [2024-08-05 23:02:37,758][52666] DAMAGECOUNT value on done: 18356.0 [2024-08-05 23:02:37,758][52666] Sum rewards: 23.090, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon7': '0.052', 'HEALTH': '0.058', 'AMMO3': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.550', 'ARMOR': '1.298', 'weapon3': '1.498', 'HITCOUNT': '1.520', 'weapon2': '1.778', 'DAMAGECOUNT': '5.184', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:37,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17244.9). Total num frames: 98664448. Throughput: 0: 4384.9. Samples: 24668430. Policy #0 lag: (min: 1.0, avg: 4.6, max: 9.0) [2024-08-05 23:02:37,794][52567] Avg episode reward: [(0, '16.767')] [2024-08-05 23:02:38,043][52670] DAMAGECOUNT value on done: 18311.0 [2024-08-05 23:02:38,043][52670] Sum rewards: 23.033, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.376', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.254', 'ARMOR': '0.877', 'WEAPON3': '0.900', 'HITCOUNT': '1.370', 'weapon2': '1.392', 'weapon3': '2.036', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '21.000'} [2024-08-05 23:02:38,362][52664] DAMAGECOUNT value on done: 20788.0 [2024-08-05 23:02:38,364][52664] Sum rewards: 20.381, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.267', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.650', 'ARMOR': '0.936', 'HITCOUNT': '1.640', 'weapon3': '1.650', 'weapon2': '1.698', 'DAMAGECOUNT': '5.502', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:38,670][52665] DAMAGECOUNT value on done: 20991.0 [2024-08-05 23:02:38,678][52665] Sum rewards: 13.487, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.774', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'ARMOR': '0.478', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon3': '1.558', 'weapon2': '1.704', 'DAMAGECOUNT': '3.405', 'FRAGCOUNT': '11.000'} [2024-08-05 23:02:38,902][52820] DAMAGECOUNT value on done: 18420.0 [2024-08-05 23:02:38,903][52820] Sum rewards: 17.707, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.042', 'ARMOR': '0.048', 'AMMO3': '0.084', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.516', 'WEAPON3': '0.600', 'weapon2': '0.862', 'HITCOUNT': '1.490', 'weapon3': '1.786', 'DAMAGECOUNT': '5.367', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:39,287][52663] DAMAGECOUNT value on done: 19739.0 [2024-08-05 23:02:39,288][52663] Sum rewards: 21.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.030', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.071', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon3': '1.350', 'HITCOUNT': '1.370', 'weapon2': '1.510', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:39,384][52669] DAMAGECOUNT value on done: 21838.0 [2024-08-05 23:02:39,385][52669] Sum rewards: 14.241, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.646', 'AMMO5': '0.003', 'AMMO2': '0.023', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.097', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.216', 'WEAPON3': '0.650', 'HITCOUNT': '1.030', 'weapon2': '1.166', 'weapon3': '1.560', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '11.000'} [2024-08-05 23:02:40,219][52667] DAMAGECOUNT value on done: 19361.0 [2024-08-05 23:02:40,220][52667] Sum rewards: 8.993, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.493', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.084', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'ARMOR': '0.416', 'WEAPON3': '0.650', 'HITCOUNT': '0.850', 'weapon2': '1.150', 'weapon3': '1.576', 'DAMAGECOUNT': '3.165', 'FRAGCOUNT': '8.000'} [2024-08-05 23:02:40,728][52664] DAMAGECOUNT value on done: 18404.0 [2024-08-05 23:02:40,731][52664] Sum rewards: 17.942, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.530', 'AMMO4': '-0.040', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'weapon4': '0.094', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'weapon3': '1.364', 'weapon2': '1.444', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:40,928][52666] DAMAGECOUNT value on done: 20035.0 [2024-08-05 23:02:40,928][52666] Sum rewards: 14.902, reward structure: {'DEATHCOUNT': '-2.250', 'AMMO2': '0.020', 'AMMO3': '0.048', 'WEAPON4': '0.050', 'weapon7': '0.060', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.230', 'WEAPON3': '0.250', 'ARMOR': '0.440', 'HEALTH': '0.600', 'HITCOUNT': '0.730', 'weapon3': '0.772', 'weapon2': '0.852', 'DAMAGECOUNT': '2.700', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:41,274][52670] DAMAGECOUNT value on done: 19086.0 [2024-08-05 23:02:41,275][52670] Sum rewards: 19.644, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.518', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.134', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'ARMOR': '0.875', 'WEAPON3': '0.900', 'weapon2': '1.348', 'HITCOUNT': '1.460', 'weapon3': '2.296', 'DAMAGECOUNT': '5.226', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:41,494][52650] Updated weights for policy 0, policy_version 12051 (0.0032) [2024-08-05 23:02:41,934][52665] DAMAGECOUNT value on done: 19600.0 [2024-08-05 23:02:41,936][52665] Sum rewards: 19.477, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.721', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.125', 'weapon4': '0.342', 'WEAPON4': '0.350', 'ARMOR': '0.453', 'WEAPON3': '0.850', 'HITCOUNT': '1.490', 'weapon3': '1.540', 'weapon2': '1.608', 'DAMAGECOUNT': '5.688', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:42,138][52820] DAMAGECOUNT value on done: 18851.0 [2024-08-05 23:02:42,143][52820] Sum rewards: 12.881, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon5': '0.144', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.704', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon3': '1.606', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:42,408][52663] DAMAGECOUNT value on done: 20286.0 [2024-08-05 23:02:42,408][52663] Sum rewards: 16.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'ARMOR': '0.498', 'WEAPON3': '1.000', 'weapon2': '1.172', 'HITCOUNT': '1.510', 'weapon3': '2.178', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:42,427][52669] DAMAGECOUNT value on done: 21078.0 [2024-08-05 23:02:42,427][52669] Sum rewards: 26.154, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.060', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.446', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'weapon2': '0.910', 'weapon3': '1.330', 'HITCOUNT': '1.390', 'DAMAGECOUNT': '5.787', 'FRAGCOUNT': '20.000'} [2024-08-05 23:02:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17217.1). Total num frames: 98746368. Throughput: 0: 4384.1. Samples: 24694500. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 23:02:42,795][52567] Avg episode reward: [(0, '17.230')] [2024-08-05 23:02:42,795][52614] Saving new best policy, reward=17.230! [2024-08-05 23:02:43,071][52667] DAMAGECOUNT value on done: 20278.0 [2024-08-05 23:02:43,071][52667] Sum rewards: 14.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.755', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'ARMOR': '0.033', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.332', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon2': '1.238', 'weapon3': '1.646', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:43,453][52664] DAMAGECOUNT value on done: 21999.0 [2024-08-05 23:02:43,454][52664] Sum rewards: 19.040, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.208', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.590', 'weapon2': '1.590', 'weapon3': '1.892', 'DAMAGECOUNT': '5.577', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:43,679][52666] DAMAGECOUNT value on done: 19214.0 [2024-08-05 23:02:43,679][52666] Sum rewards: 17.940, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.879', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.113', 'weapon4': '0.296', 'WEAPON4': '0.350', 'ARMOR': '0.480', 'WEAPON3': '0.850', 'weapon2': '0.954', 'HITCOUNT': '1.510', 'weapon3': '1.660', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:43,958][52670] DAMAGECOUNT value on done: 18093.0 [2024-08-05 23:02:43,960][52670] Sum rewards: 16.277, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.070', 'weapon5': '0.104', 'WEAPON5': '0.200', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.880', 'ARMOR': '0.969', 'HITCOUNT': '1.270', 'weapon3': '1.590', 'DAMAGECOUNT': '4.752', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:44,456][52665] DAMAGECOUNT value on done: 18921.0 [2024-08-05 23:02:44,457][52665] Sum rewards: 17.912, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.106', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.500', 'ARMOR': '0.851', 'weapon2': '1.118', 'HITCOUNT': '1.140', 'weapon3': '1.678', 'DAMAGECOUNT': '4.050', 'FRAGCOUNT': '12.500'} [2024-08-05 23:02:45,219][52820] DAMAGECOUNT value on done: 18420.0 [2024-08-05 23:02:45,219][52820] Sum rewards: 11.735, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.242', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.147', 'weapon4': '0.272', 'WEAPON3': '0.500', 'ARMOR': '0.506', 'HITCOUNT': '1.200', 'weapon3': '1.322', 'weapon2': '1.442', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '8.000'} [2024-08-05 23:02:45,705][52663] DAMAGECOUNT value on done: 21133.0 [2024-08-05 23:02:45,706][52663] Sum rewards: 9.384, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.102', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.264', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon2': '1.220', 'weapon3': '1.840', 'DAMAGECOUNT': '3.150', 'FRAGCOUNT': '9.000'} [2024-08-05 23:02:45,739][52669] DAMAGECOUNT value on done: 21053.0 [2024-08-05 23:02:45,739][52669] Sum rewards: 15.563, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.900', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.206', 'WEAPON3': '0.900', 'HITCOUNT': '0.970', 'weapon2': '1.126', 'ARMOR': '1.325', 'weapon3': '1.620', 'DAMAGECOUNT': '3.840', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:45,764][52650] Updated weights for policy 0, policy_version 12061 (0.0011) [2024-08-05 23:02:46,133][52667] DAMAGECOUNT value on done: 20335.0 [2024-08-05 23:02:46,134][52667] Sum rewards: 20.541, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.268', 'WEAPON3': '0.750', 'ARMOR': '1.249', 'HITCOUNT': '1.400', 'weapon2': '1.700', 'weapon3': '1.766', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:46,488][52670] DAMAGECOUNT value on done: 18906.0 [2024-08-05 23:02:46,488][52670] Sum rewards: 19.162, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.054', 'AMMO3': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.204', 'WEAPON3': '0.700', 'HITCOUNT': '1.420', 'weapon3': '1.436', 'weapon2': '1.932', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:46,596][52664] DAMAGECOUNT value on done: 19822.0 [2024-08-05 23:02:46,598][52664] Sum rewards: 27.493, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.793', 'AMMO2': '0.015', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.137', 'WEAPON3': '0.850', 'ARMOR': '0.897', 'HITCOUNT': '1.570', 'weapon3': '1.758', 'weapon2': '1.874', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '24.000'} [2024-08-05 23:02:47,178][52665] DAMAGECOUNT value on done: 20253.0 [2024-08-05 23:02:47,179][52665] Sum rewards: 23.152, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.032', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon7': '0.066', 'weapon5': '0.070', 'AMMO3': '0.080', 'HEALTH': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'weapon2': '0.618', 'weapon4': '0.646', 'HITCOUNT': '1.490', 'weapon3': '1.744', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17244.9). Total num frames: 98836480. Throughput: 0: 4377.6. Samples: 24707370. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 23:02:47,794][52567] Avg episode reward: [(0, '17.495')] [2024-08-05 23:02:47,797][52614] Saving new best policy, reward=17.495! [2024-08-05 23:02:48,593][52820] DAMAGECOUNT value on done: 17938.0 [2024-08-05 23:02:48,595][52820] Sum rewards: 14.545, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.460', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.174', 'WEAPON3': '0.800', 'HITCOUNT': '1.300', 'ARMOR': '1.321', 'weapon2': '1.366', 'weapon3': '1.750', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:48,819][52669] DAMAGECOUNT value on done: 21414.0 [2024-08-05 23:02:48,820][52669] Sum rewards: 19.919, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.876', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.266', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'weapon2': '0.994', 'HITCOUNT': '1.370', 'weapon3': '2.290', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:48,824][52663] DAMAGECOUNT value on done: 18763.0 [2024-08-05 23:02:48,825][52663] Sum rewards: 15.318, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.254', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'HEALTH': '0.708', 'HITCOUNT': '1.200', 'weapon2': '1.308', 'weapon3': '1.566', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:49,018][52667] DAMAGECOUNT value on done: 22104.0 [2024-08-05 23:02:49,018][52667] Sum rewards: 13.836, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.086', 'weapon5': '0.146', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.901', 'weapon2': '1.258', 'HITCOUNT': '1.280', 'weapon3': '1.604', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '9.500'} [2024-08-05 23:02:49,771][52664] DAMAGECOUNT value on done: 19380.0 [2024-08-05 23:02:49,772][52664] Sum rewards: 12.968, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.149', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon7': '0.050', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.346', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon2': '0.982', 'HITCOUNT': '1.200', 'weapon3': '1.668', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '9.000'} [2024-08-05 23:02:50,201][52665] DAMAGECOUNT value on done: 20091.0 [2024-08-05 23:02:50,201][52665] Sum rewards: 20.091, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.783', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.131', 'weapon4': '0.208', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'weapon2': '1.420', 'HITCOUNT': '1.850', 'weapon3': '2.050', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '15.000'} [2024-08-05 23:02:50,811][52650] Updated weights for policy 0, policy_version 12071 (0.0024) [2024-08-05 23:02:51,582][52669] DAMAGECOUNT value on done: 20963.0 [2024-08-05 23:02:51,583][52669] Sum rewards: 16.872, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.400', 'weapon4': '0.400', 'ARMOR': '0.416', 'WEAPON3': '0.900', 'weapon2': '1.334', 'HITCOUNT': '1.620', 'weapon3': '1.910', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '15.000'} [2024-08-05 23:02:51,608][52663] DAMAGECOUNT value on done: 20552.0 [2024-08-05 23:02:51,608][52663] Sum rewards: 12.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.586', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'ARMOR': '0.958', 'WEAPON3': '1.050', 'HITCOUNT': '1.230', 'weapon2': '1.422', 'weapon3': '2.238', 'DAMAGECOUNT': '4.968', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:51,645][52820] DAMAGECOUNT value on done: 18206.0 [2024-08-05 23:02:51,645][52820] Sum rewards: 24.791, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.250', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.082', 'weapon4': '0.154', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'HITCOUNT': '1.640', 'weapon3': '1.658', 'weapon2': '1.740', 'DAMAGECOUNT': '5.901', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:52,208][52667] DAMAGECOUNT value on done: 21739.0 [2024-08-05 23:02:52,210][52667] Sum rewards: 25.381, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.822', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.048', 'AMMO4': '0.049', 'weapon5': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.862', 'weapon2': '1.502', 'HITCOUNT': '1.520', 'weapon3': '1.694', 'DAMAGECOUNT': '6.000', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:52,549][52665] DAMAGECOUNT value on done: 19852.0 [2024-08-05 23:02:52,551][52665] Sum rewards: 12.794, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.955', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon7': '0.068', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon5': '0.204', 'ARMOR': '0.476', 'weapon4': '0.598', 'WEAPON3': '0.750', 'weapon2': '0.852', 'HITCOUNT': '0.980', 'weapon3': '1.478', 'DAMAGECOUNT': '3.810', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17244.9). Total num frames: 98918400. Throughput: 0: 4374.2. Samples: 24733620. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-05 23:02:52,794][52567] Avg episode reward: [(0, '17.423')] [2024-08-05 23:02:52,808][52664] DAMAGECOUNT value on done: 23242.0 [2024-08-05 23:02:52,811][52664] Sum rewards: 22.661, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.017', 'HEALTH': '0.060', 'AMMO4': '0.083', 'weapon5': '0.084', 'AMMO3': '0.108', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.392', 'ARMOR': '0.532', 'WEAPON3': '0.600', 'weapon2': '1.140', 'HITCOUNT': '1.810', 'weapon3': '1.990', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '17.500'} [2024-08-05 23:02:54,099][52669] DAMAGECOUNT value on done: 19984.0 [2024-08-05 23:02:54,101][52669] Sum rewards: 15.703, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.463', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.013', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.062', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '1.320', 'weapon3': '1.548', 'weapon2': '1.676', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:54,138][52663] DAMAGECOUNT value on done: 22751.0 [2024-08-05 23:02:54,139][52663] Sum rewards: 18.216, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.452', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.094', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.564', 'WEAPON3': '0.650', 'ARMOR': '0.914', 'weapon2': '0.976', 'HITCOUNT': '1.370', 'weapon3': '1.736', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:54,799][52820] DAMAGECOUNT value on done: 19174.0 [2024-08-05 23:02:54,801][52820] Sum rewards: 18.687, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.168', 'HEALTH': '0.425', 'WEAPON3': '0.600', 'ARMOR': '1.297', 'HITCOUNT': '1.320', 'weapon2': '1.386', 'weapon3': '1.952', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:54,880][52667] DAMAGECOUNT value on done: 19238.0 [2024-08-05 23:02:54,880][52667] Sum rewards: 15.440, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.734', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.078', 'AMMO4': '0.085', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.492', 'weapon4': '0.602', 'WEAPON3': '0.650', 'weapon2': '0.906', 'HITCOUNT': '1.050', 'weapon3': '1.676', 'DAMAGECOUNT': '3.774', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:55,032][52794] DAMAGECOUNT value on done: 22686.0 [2024-08-05 23:02:55,032][52794] Sum rewards: 24.140, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.084', 'AMMO2': '0.021', 'ARMOR': '0.044', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon4': '0.442', 'WEAPON3': '0.550', 'weapon2': '1.334', 'HITCOUNT': '1.570', 'weapon3': '1.808', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:55,197][52650] Updated weights for policy 0, policy_version 12081 (0.0032) [2024-08-05 23:02:55,565][52665] DAMAGECOUNT value on done: 19551.0 [2024-08-05 23:02:55,567][52665] Sum rewards: 10.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.931', 'weapon4': '0.002', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.820', 'HITCOUNT': '1.050', 'weapon3': '1.388', 'weapon2': '1.874', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '9.000'} [2024-08-05 23:02:55,572][52664] DAMAGECOUNT value on done: 20182.0 [2024-08-05 23:02:55,573][52664] Sum rewards: 11.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.844', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.167', 'ARMOR': '0.420', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon2': '1.204', 'HITCOUNT': '1.370', 'weapon3': '2.120', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '10.000'} [2024-08-05 23:02:56,516][52669] DAMAGECOUNT value on done: 21523.0 [2024-08-05 23:02:56,517][52669] Sum rewards: 24.275, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.932', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'ARMOR': '0.408', 'weapon2': '0.758', 'WEAPON3': '0.900', 'HITCOUNT': '1.540', 'weapon3': '2.080', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '21.000'} [2024-08-05 23:02:56,555][52663] DAMAGECOUNT value on done: 19189.0 [2024-08-05 23:02:56,557][52663] Sum rewards: 21.407, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.506', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.094', 'AMMO3': '0.110', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.882', 'HITCOUNT': '1.440', 'weapon2': '1.464', 'weapon3': '1.738', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '17.000'} [2024-08-05 23:02:57,620][52667] DAMAGECOUNT value on done: 21049.0 [2024-08-05 23:02:57,627][52667] Sum rewards: 24.017, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.080', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.106', 'weapon4': '0.232', 'ARMOR': '0.416', 'WEAPON3': '0.600', 'HITCOUNT': '1.340', 'weapon2': '1.558', 'weapon3': '1.628', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '20.000'} [2024-08-05 23:02:57,793][52820] DAMAGECOUNT value on done: 18138.0 [2024-08-05 23:02:57,793][52820] Sum rewards: 23.969, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.647', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'AMMO3': '0.066', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.204', 'WEAPON3': '0.500', 'ARMOR': '0.515', 'weapon2': '1.088', 'HITCOUNT': '1.180', 'weapon3': '1.210', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '18.000'} [2024-08-05 23:02:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17615.1, 300 sec: 17272.6). Total num frames: 99008512. Throughput: 0: 4374.4. Samples: 24760000. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:02:57,794][52567] Avg episode reward: [(0, '17.733')] [2024-08-05 23:02:57,797][52614] Saving new best policy, reward=17.733! [2024-08-05 23:02:57,918][52794] DAMAGECOUNT value on done: 23956.0 [2024-08-05 23:02:57,919][52794] Sum rewards: 19.819, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.398', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.390', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.016', 'HITCOUNT': '1.300', 'weapon3': '1.654', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '16.000'} [2024-08-05 23:02:58,496][52664] DAMAGECOUNT value on done: 18899.0 [2024-08-05 23:02:58,498][52664] Sum rewards: 10.376, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.146', 'WEAPON7': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.300', 'ARMOR': '0.525', 'WEAPON3': '0.650', 'HITCOUNT': '0.830', 'weapon2': '1.344', 'weapon3': '1.922', 'DAMAGECOUNT': '3.012', 'FRAGCOUNT': '9.000'} [2024-08-05 23:02:58,905][52658] DAMAGECOUNT value on done: 20609.0 [2024-08-05 23:02:58,910][52658] Sum rewards: 18.239, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.352', 'AMMO2': '0.017', 'weapon7': '0.048', 'AMMO4': '0.084', 'AMMO3': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.378', 'WEAPON3': '0.600', 'HITCOUNT': '1.190', 'ARMOR': '1.208', 'weapon2': '1.506', 'weapon3': '1.750', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '13.000'} [2024-08-05 23:02:58,937][52665] DAMAGECOUNT value on done: 19830.0 [2024-08-05 23:02:58,938][52665] Sum rewards: 18.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.082', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '1.430', 'ARMOR': '1.628', 'weapon3': '1.658', 'weapon2': '1.914', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '14.000'} [2024-08-05 23:02:59,302][52662] DAMAGECOUNT value on done: 23307.0 [2024-08-05 23:02:59,303][52662] Sum rewards: 16.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.120', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'ARMOR': '0.860', 'WEAPON3': '0.900', 'HITCOUNT': '1.630', 'weapon2': '1.780', 'weapon3': '1.934', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:59,781][52663] DAMAGECOUNT value on done: 20476.0 [2024-08-05 23:02:59,782][52663] Sum rewards: 13.595, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.785', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'ARMOR': '0.484', 'weapon4': '0.578', 'WEAPON3': '0.800', 'weapon2': '1.076', 'HITCOUNT': '1.210', 'weapon3': '1.546', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '12.000'} [2024-08-05 23:02:59,964][52650] Updated weights for policy 0, policy_version 12091 (0.0022) [2024-08-05 23:03:00,592][52667] DAMAGECOUNT value on done: 20665.0 [2024-08-05 23:03:00,593][52667] Sum rewards: 14.595, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.208', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.850', 'ARMOR': '0.911', 'HITCOUNT': '1.150', 'weapon2': '1.158', 'weapon3': '1.778', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:00,598][52794] DAMAGECOUNT value on done: 24322.0 [2024-08-05 23:03:00,599][52794] Sum rewards: 9.011, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.194', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.048', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.170', 'weapon4': '0.344', 'WEAPON3': '0.700', 'HITCOUNT': '0.760', 'ARMOR': '1.279', 'weapon3': '1.372', 'weapon2': '1.458', 'DAMAGECOUNT': '2.916', 'FRAGCOUNT': '7.000'} [2024-08-05 23:03:00,933][52820] DAMAGECOUNT value on done: 19768.0 [2024-08-05 23:03:00,937][52820] Sum rewards: 25.140, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.174', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon5': '0.138', 'weapon4': '0.196', 'WEAPON3': '0.800', 'ARMOR': '0.952', 'weapon2': '1.464', 'HITCOUNT': '1.620', 'weapon3': '1.786', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '21.000'} [2024-08-05 23:03:01,037][52664] DAMAGECOUNT value on done: 22390.0 [2024-08-05 23:03:01,037][52664] Sum rewards: 17.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.940', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.056', 'AMMO3': '0.070', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.576', 'weapon2': '0.770', 'HITCOUNT': '1.310', 'weapon3': '1.460', 'DAMAGECOUNT': '4.482', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:01,911][52658] DAMAGECOUNT value on done: 19936.0 [2024-08-05 23:03:01,911][52658] Sum rewards: 17.940, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.069', 'WEAPON5': '0.100', 'HEALTH': '0.237', 'WEAPON3': '0.400', 'ARMOR': '0.885', 'HITCOUNT': '1.210', 'weapon3': '1.214', 'weapon2': '2.008', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:01,975][52665] DAMAGECOUNT value on done: 18825.0 [2024-08-05 23:03:01,976][52665] Sum rewards: 23.475, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.026', 'ARMOR': '0.050', 'weapon5': '0.058', 'AMMO3': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '0.500', 'weapon2': '1.138', 'HITCOUNT': '1.470', 'weapon3': '1.476', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:02,148][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:03:02,227][52662] DAMAGECOUNT value on done: 24867.0 [2024-08-05 23:03:02,227][52662] Sum rewards: 25.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.566', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon4': '0.076', 'AMMO3': '0.192', 'WEAPON3': '1.300', 'weapon2': '1.306', 'ARMOR': '1.790', 'HITCOUNT': '1.810', 'weapon3': '2.250', 'DAMAGECOUNT': '6.939', 'FRAGCOUNT': '24.000'} [2024-08-05 23:03:02,563][52663] DAMAGECOUNT value on done: 23078.0 [2024-08-05 23:03:02,567][52663] Sum rewards: 20.321, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.670', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.129', 'weapon5': '0.130', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'ARMOR': '0.467', 'WEAPON4': '0.600', 'weapon4': '0.606', 'weapon2': '0.888', 'WEAPON3': '0.900', 'HITCOUNT': '1.480', 'weapon3': '1.626', 'DAMAGECOUNT': '5.604', 'FRAGCOUNT': '19.000'} [2024-08-05 23:03:02,795][52567] Fps is (10 sec: 17201.4, 60 sec: 17476.1, 300 sec: 17244.8). Total num frames: 99090432. Throughput: 0: 4361.0. Samples: 24772900. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:03:02,795][52567] Avg episode reward: [(0, '18.266')] [2024-08-05 23:03:02,796][52614] Saving new best policy, reward=18.266! [2024-08-05 23:03:03,662][52667] DAMAGECOUNT value on done: 19528.0 [2024-08-05 23:03:03,663][52667] Sum rewards: 15.494, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.433', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.080', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.300', 'weapon2': '1.746', 'weapon3': '1.908', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:03,727][52794] DAMAGECOUNT value on done: 21883.0 [2024-08-05 23:03:03,727][52794] Sum rewards: 16.272, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.600', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.040', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.266', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon2': '1.578', 'ARMOR': '1.659', 'weapon3': '1.786', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:04,023][52820] DAMAGECOUNT value on done: 20874.0 [2024-08-05 23:03:04,026][52820] Sum rewards: 14.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.840', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'ARMOR': '0.020', 'weapon4': '0.028', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON3': '0.850', 'HITCOUNT': '1.300', 'weapon2': '1.362', 'weapon3': '1.832', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:04,033][52664] DAMAGECOUNT value on done: 20598.0 [2024-08-05 23:03:04,033][52664] Sum rewards: 18.856, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.818', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'ARMOR': '0.064', 'AMMO3': '0.070', 'weapon5': '0.098', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon2': '0.552', 'weapon4': '0.594', 'HITCOUNT': '1.190', 'weapon3': '1.368', 'DAMAGECOUNT': '4.314', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:04,537][52658] DAMAGECOUNT value on done: 17884.0 [2024-08-05 23:03:04,539][52658] Sum rewards: 12.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.078', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.026', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '1.400', 'weapon2': '1.538', 'weapon3': '1.944', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:04,821][52650] Updated weights for policy 0, policy_version 12101 (0.0035) [2024-08-05 23:03:04,982][52662] DAMAGECOUNT value on done: 26974.0 [2024-08-05 23:03:04,983][52662] Sum rewards: 19.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.226', 'weapon5': '0.266', 'weapon2': '0.756', 'ARMOR': '0.883', 'WEAPON3': '1.200', 'HITCOUNT': '1.630', 'weapon3': '2.394', 'DAMAGECOUNT': '6.279', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:05,057][52665] DAMAGECOUNT value on done: 18707.0 [2024-08-05 23:03:05,057][52665] Sum rewards: 7.616, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.616', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.524', 'WEAPON3': '0.600', 'ARMOR': '0.896', 'HITCOUNT': '0.930', 'weapon3': '1.372', 'weapon2': '1.386', 'DAMAGECOUNT': '3.264', 'FRAGCOUNT': '5.000'} [2024-08-05 23:03:05,878][52663] DAMAGECOUNT value on done: 20782.0 [2024-08-05 23:03:05,879][52663] Sum rewards: 26.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.142', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.340', 'ARMOR': '0.456', 'WEAPON3': '0.900', 'weapon2': '1.138', 'HITCOUNT': '1.730', 'weapon3': '2.118', 'DAMAGECOUNT': '8.019', 'FRAGCOUNT': '22.000'} [2024-08-05 23:03:05,892][52667] DAMAGECOUNT value on done: 19913.0 [2024-08-05 23:03:05,893][52667] Sum rewards: 11.392, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.859', 'AMMO5': '0.005', 'weapon7': '0.012', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.800', 'weapon2': '1.000', 'HITCOUNT': '1.210', 'weapon3': '1.618', 'DAMAGECOUNT': '3.765', 'FRAGCOUNT': '9.000'} [2024-08-05 23:03:06,489][52794] DAMAGECOUNT value on done: 23954.0 [2024-08-05 23:03:06,491][52794] Sum rewards: 22.596, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.118', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon4': '0.482', 'HEALTH': '0.608', 'WEAPON3': '0.650', 'weapon2': '1.090', 'HITCOUNT': '1.400', 'weapon3': '1.602', 'DAMAGECOUNT': '5.787', 'FRAGCOUNT': '18.000'} [2024-08-05 23:03:06,734][52664] DAMAGECOUNT value on done: 23438.0 [2024-08-05 23:03:06,734][52664] Sum rewards: 22.781, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.692', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.091', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon2': '1.392', 'weapon3': '1.532', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '18.000'} [2024-08-05 23:03:07,041][52658] DAMAGECOUNT value on done: 19744.0 [2024-08-05 23:03:07,042][52658] Sum rewards: 17.140, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.232', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.123', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'ARMOR': '0.504', 'weapon4': '0.582', 'WEAPON3': '0.950', 'weapon2': '1.012', 'HITCOUNT': '1.430', 'weapon3': '1.952', 'DAMAGECOUNT': '4.851', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:07,123][52820] DAMAGECOUNT value on done: 19080.0 [2024-08-05 23:03:07,123][52820] Sum rewards: 10.327, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.737', 'AMMO5': '0.007', 'weapon7': '0.050', 'AMMO2': '0.050', 'weapon5': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'AMMO4': '0.251', 'WEAPON4': '0.350', 'weapon4': '0.482', 'WEAPON3': '0.650', 'weapon2': '0.822', 'ARMOR': '0.840', 'HITCOUNT': '1.170', 'weapon3': '1.276', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '8.000'} [2024-08-05 23:03:07,691][52662] DAMAGECOUNT value on done: 22151.0 [2024-08-05 23:03:07,693][52662] Sum rewards: 12.115, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.655', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.181', 'WEAPON4': '0.400', 'weapon4': '0.446', 'WEAPON3': '0.850', 'weapon2': '0.960', 'ARMOR': '0.973', 'HITCOUNT': '1.060', 'weapon3': '1.808', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17272.6). Total num frames: 99180544. Throughput: 0: 4355.3. Samples: 24798990. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:03:07,794][52567] Avg episode reward: [(0, '18.284')] [2024-08-05 23:03:07,798][52614] Saving new best policy, reward=18.284! [2024-08-05 23:03:08,894][52794] DAMAGECOUNT value on done: 23107.0 [2024-08-05 23:03:08,895][52794] Sum rewards: 24.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.943', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'ARMOR': '1.204', 'weapon2': '1.232', 'HITCOUNT': '1.750', 'weapon3': '1.890', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '22.000'} [2024-08-05 23:03:08,945][52663] DAMAGECOUNT value on done: 20168.0 [2024-08-05 23:03:08,947][52663] Sum rewards: 16.070, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.998', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.086', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.254', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'weapon2': '1.368', 'weapon3': '1.634', 'DAMAGECOUNT': '4.116', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:08,994][52667] DAMAGECOUNT value on done: 20805.0 [2024-08-05 23:03:08,997][52667] Sum rewards: 21.155, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.237', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.036', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.465', 'weapon4': '0.520', 'WEAPON3': '0.650', 'weapon2': '0.854', 'HITCOUNT': '1.640', 'weapon3': '1.874', 'DAMAGECOUNT': '6.252', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:09,331][52650] Updated weights for policy 0, policy_version 12111 (0.0019) [2024-08-05 23:03:09,831][52664] DAMAGECOUNT value on done: 19601.0 [2024-08-05 23:03:09,831][52664] Sum rewards: 18.543, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.339', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.085', 'WEAPON3': '0.700', 'ARMOR': '0.848', 'HITCOUNT': '1.440', 'weapon3': '1.782', 'weapon2': '1.948', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:10,206][52658] DAMAGECOUNT value on done: 20987.0 [2024-08-05 23:03:10,207][52658] Sum rewards: 21.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.840', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO3': '0.107', 'WEAPON3': '0.750', 'HITCOUNT': '1.530', 'weapon3': '1.602', 'weapon2': '1.654', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:10,349][52662] DAMAGECOUNT value on done: 22929.0 [2024-08-05 23:03:10,350][52662] Sum rewards: 17.891, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.125', 'AMMO4': '0.129', 'weapon4': '0.176', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.908', 'HITCOUNT': '1.250', 'weapon2': '1.390', 'weapon3': '2.044', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:11,654][52667] DAMAGECOUNT value on done: 19747.0 [2024-08-05 23:03:11,655][52667] Sum rewards: 16.995, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.442', 'AMMO2': '0.014', 'AMMO5': '0.019', 'AMMO4': '0.068', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.240', 'weapon4': '0.258', 'WEAPON5': '0.300', 'ARMOR': '0.405', 'WEAPON3': '0.650', 'HITCOUNT': '1.390', 'weapon3': '1.492', 'weapon2': '1.562', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:11,961][52794] DAMAGECOUNT value on done: 24573.0 [2024-08-05 23:03:11,962][52794] Sum rewards: 19.976, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.524', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'weapon5': '0.066', 'weapon4': '0.080', 'AMMO3': '0.091', 'WEAPON5': '0.150', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '1.460', 'weapon2': '1.712', 'weapon3': '1.778', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:12,140][52663] DAMAGECOUNT value on done: 19271.0 [2024-08-05 23:03:12,142][52663] Sum rewards: 16.422, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.214', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.030', 'ARMOR': '0.045', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'weapon4': '0.370', 'WEAPON3': '0.700', 'weapon2': '1.058', 'HITCOUNT': '1.490', 'weapon3': '1.970', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:12,543][52658] DAMAGECOUNT value on done: 18295.0 [2024-08-05 23:03:12,545][52658] Sum rewards: 16.346, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.115', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.308', 'HITCOUNT': '1.350', 'weapon3': '1.706', 'DAMAGECOUNT': '5.202', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:12,594][52664] DAMAGECOUNT value on done: 19679.0 [2024-08-05 23:03:12,594][52664] Sum rewards: 16.719, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.797', 'AMMO2': '0.020', 'AMMO3': '0.091', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.650', 'ARMOR': '0.895', 'HITCOUNT': '1.170', 'weapon2': '1.240', 'weapon3': '1.946', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:12,794][52567] Fps is (10 sec: 17205.0, 60 sec: 17339.7, 300 sec: 17272.6). Total num frames: 99262464. Throughput: 0: 4341.6. Samples: 24824670. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:03:12,794][52567] Avg episode reward: [(0, '18.181')] [2024-08-05 23:03:13,452][52662] DAMAGECOUNT value on done: 24068.0 [2024-08-05 23:03:13,452][52662] Sum rewards: 18.065, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.509', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'ARMOR': '0.044', 'AMMO3': '0.079', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'weapon3': '1.462', 'weapon2': '1.656', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:13,968][52649] DAMAGECOUNT value on done: 19891.0 [2024-08-05 23:03:13,968][52649] Sum rewards: 12.296, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.113', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.312', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'HITCOUNT': '0.900', 'weapon2': '1.086', 'weapon3': '1.638', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:13,994][52667] DAMAGECOUNT value on done: 21884.0 [2024-08-05 23:03:13,995][52667] Sum rewards: 24.330, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.401', 'weapon4': '0.012', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.150', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.512', 'HITCOUNT': '1.680', 'weapon3': '2.068', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:14,238][52650] Updated weights for policy 0, policy_version 12121 (0.0024) [2024-08-05 23:03:14,560][52794] DAMAGECOUNT value on done: 19679.0 [2024-08-05 23:03:14,560][52794] Sum rewards: 14.046, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.436', 'AMMO2': '0.029', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.146', 'weapon4': '0.398', 'WEAPON4': '0.400', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '1.130', 'weapon2': '1.200', 'weapon3': '1.726', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:15,131][52664] DAMAGECOUNT value on done: 19091.0 [2024-08-05 23:03:15,132][52664] Sum rewards: 16.870, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.396', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.100', 'WEAPON3': '0.650', 'ARMOR': '1.258', 'HITCOUNT': '1.460', 'weapon3': '1.624', 'weapon2': '1.948', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:15,542][52663] DAMAGECOUNT value on done: 20233.0 [2024-08-05 23:03:15,544][52663] Sum rewards: 20.537, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.096', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'weapon4': '0.300', 'WEAPON3': '0.600', 'ARMOR': '0.976', 'weapon2': '1.386', 'weapon3': '1.522', 'HITCOUNT': '1.550', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:15,789][52658] DAMAGECOUNT value on done: 23307.0 [2024-08-05 23:03:15,790][52658] Sum rewards: 17.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.082', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.171', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.400', 'ARMOR': '0.440', 'WEAPON3': '1.000', 'weapon2': '1.190', 'HITCOUNT': '1.600', 'weapon3': '2.134', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:16,275][52671] DAMAGECOUNT value on done: 23141.0 [2024-08-05 23:03:16,280][52671] Sum rewards: 12.278, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.999', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon5': '0.028', 'AMMO4': '0.053', 'weapon4': '0.066', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.896', 'HITCOUNT': '1.190', 'weapon2': '1.594', 'weapon3': '1.762', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '9.500'} [2024-08-05 23:03:16,350][52662] DAMAGECOUNT value on done: 25899.0 [2024-08-05 23:03:16,352][52662] Sum rewards: 23.169, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.538', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.250', 'weapon4': '0.434', 'WEAPON3': '0.650', 'ARMOR': '0.922', 'weapon2': '1.058', 'HITCOUNT': '1.710', 'weapon3': '2.056', 'DAMAGECOUNT': '6.204', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:17,224][52667] DAMAGECOUNT value on done: 22084.0 [2024-08-05 23:03:17,226][52667] Sum rewards: 29.401, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'HEALTH': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.060', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.550', 'weapon3': '1.268', 'ARMOR': '1.330', 'HITCOUNT': '1.390', 'weapon2': '1.924', 'DAMAGECOUNT': '5.529', 'FRAGCOUNT': '22.000'} [2024-08-05 23:03:17,527][52794] DAMAGECOUNT value on done: 23850.0 [2024-08-05 23:03:17,529][52794] Sum rewards: 12.784, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.043', 'ARMOR': '0.064', 'weapon5': '0.122', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.458', 'weapon2': '0.810', 'WEAPON3': '0.950', 'HITCOUNT': '1.310', 'weapon3': '2.310', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:17,610][52649] DAMAGECOUNT value on done: 19668.0 [2024-08-05 23:03:17,611][52649] Sum rewards: 9.749, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.407', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.183', 'WEAPON4': '0.450', 'weapon4': '0.492', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.004', 'ARMOR': '1.299', 'weapon3': '1.464', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '8.000'} [2024-08-05 23:03:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17272.6). Total num frames: 99344384. Throughput: 0: 4328.2. Samples: 24836810. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:03:17,794][52567] Avg episode reward: [(0, '17.745')] [2024-08-05 23:03:18,350][52658] DAMAGECOUNT value on done: 19215.0 [2024-08-05 23:03:18,352][52658] Sum rewards: 20.082, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.497', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'ARMOR': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON3': '0.900', 'HITCOUNT': '1.560', 'weapon2': '1.610', 'weapon3': '1.882', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:18,540][52663] DAMAGECOUNT value on done: 20149.0 [2024-08-05 23:03:18,540][52663] Sum rewards: 23.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.614', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.170', 'ARMOR': '0.853', 'WEAPON3': '1.050', 'weapon2': '1.494', 'HITCOUNT': '1.830', 'weapon3': '2.320', 'DAMAGECOUNT': '7.212', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:18,702][52662] DAMAGECOUNT value on done: 26525.0 [2024-08-05 23:03:18,703][52662] Sum rewards: 21.589, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.682', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.033', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'weapon4': '0.362', 'WEAPON3': '0.900', 'weapon2': '1.238', 'HITCOUNT': '1.910', 'weapon3': '1.976', 'DAMAGECOUNT': '6.537', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:18,905][52664] DAMAGECOUNT value on done: 20202.0 [2024-08-05 23:03:18,905][52664] Sum rewards: 12.758, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.084', 'WEAPON3': '0.650', 'HITCOUNT': '1.230', 'weapon3': '1.294', 'ARMOR': '1.309', 'weapon2': '1.958', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:19,365][52650] Updated weights for policy 0, policy_version 12131 (0.0021) [2024-08-05 23:03:19,649][52671] DAMAGECOUNT value on done: 19457.0 [2024-08-05 23:03:19,656][52671] Sum rewards: 12.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.224', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '1.040', 'weapon2': '1.144', 'weapon3': '2.182', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:19,825][52667] DAMAGECOUNT value on done: 21375.0 [2024-08-05 23:03:19,827][52667] Sum rewards: 17.369, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.880', 'weapon4': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.040', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.430', 'weapon3': '1.588', 'weapon2': '1.852', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:19,832][52794] DAMAGECOUNT value on done: 23923.0 [2024-08-05 23:03:19,833][52794] Sum rewards: 18.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.038', 'AMMO4': '0.112', 'weapon4': '0.112', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.900', 'weapon2': '1.530', 'HITCOUNT': '1.560', 'weapon3': '2.018', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:20,741][52649] DAMAGECOUNT value on done: 19927.0 [2024-08-05 23:03:20,750][52649] Sum rewards: 28.261, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.403', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.284', 'WEAPON3': '0.750', 'ARMOR': '0.878', 'weapon2': '1.454', 'HITCOUNT': '1.520', 'weapon3': '1.842', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '23.000'} [2024-08-05 23:03:20,933][52658] DAMAGECOUNT value on done: 21091.0 [2024-08-05 23:03:20,935][52658] Sum rewards: 19.816, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.442', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.290', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '1.440', 'weapon2': '1.616', 'weapon3': '1.730', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:21,000][52662] DAMAGECOUNT value on done: 23097.0 [2024-08-05 23:03:21,001][52662] Sum rewards: 10.296, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.074', 'weapon7': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.302', 'ARMOR': '0.483', 'WEAPON3': '0.600', 'weapon2': '0.878', 'HITCOUNT': '0.920', 'weapon3': '1.108', 'DAMAGECOUNT': '3.123', 'FRAGCOUNT': '8.000'} [2024-08-05 23:03:21,469][52663] DAMAGECOUNT value on done: 21009.0 [2024-08-05 23:03:21,470][52663] Sum rewards: 21.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.148', 'weapon4': '0.220', 'WEAPON4': '0.300', 'ARMOR': '0.941', 'WEAPON3': '1.050', 'weapon2': '1.212', 'HITCOUNT': '1.510', 'weapon3': '2.266', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '19.000'} [2024-08-05 23:03:22,176][52794] DAMAGECOUNT value on done: 24128.0 [2024-08-05 23:03:22,176][52794] Sum rewards: 23.115, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.199', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'weapon5': '0.040', 'weapon4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON3': '1.150', 'ARMOR': '1.306', 'weapon2': '1.570', 'HITCOUNT': '1.870', 'weapon3': '2.148', 'DAMAGECOUNT': '6.507', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:22,365][52664] DAMAGECOUNT value on done: 18308.0 [2024-08-05 23:03:22,366][52664] Sum rewards: 16.349, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.656', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.140', 'weapon4': '0.210', 'WEAPON3': '0.950', 'weapon2': '1.264', 'HITCOUNT': '1.270', 'ARMOR': '1.406', 'weapon3': '1.646', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:22,522][52667] DAMAGECOUNT value on done: 19550.0 [2024-08-05 23:03:22,524][52667] Sum rewards: 11.559, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.114', 'AMMO2': '0.002', 'AMMO4': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.212', 'WEAPON3': '0.800', 'HITCOUNT': '1.250', 'weapon2': '1.284', 'ARMOR': '1.290', 'weapon3': '1.708', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17300.4). Total num frames: 99434496. Throughput: 0: 4286.9. Samples: 24861340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:03:22,795][52567] Avg episode reward: [(0, '17.853')] [2024-08-05 23:03:22,816][52671] DAMAGECOUNT value on done: 21737.0 [2024-08-05 23:03:22,818][52671] Sum rewards: 14.270, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.610', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.476', 'WEAPON3': '0.700', 'weapon2': '0.996', 'HITCOUNT': '1.180', 'ARMOR': '1.423', 'weapon3': '1.634', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:23,434][52662] DAMAGECOUNT value on done: 23587.0 [2024-08-05 23:03:23,434][52662] Sum rewards: 10.210, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.912', 'AMMO2': '0.023', 'AMMO3': '0.104', 'AMMO4': '0.114', 'weapon4': '0.216', 'WEAPON4': '0.350', 'ARMOR': '0.474', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon3': '1.194', 'weapon2': '1.666', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '8.000'} [2024-08-05 23:03:23,783][52658] DAMAGECOUNT value on done: 19927.0 [2024-08-05 23:03:23,784][52658] Sum rewards: 26.165, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.627', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.123', 'WEAPON3': '0.800', 'ARMOR': '0.927', 'weapon2': '1.610', 'HITCOUNT': '1.700', 'weapon3': '2.026', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '21.000'} [2024-08-05 23:03:24,224][52649] DAMAGECOUNT value on done: 19260.0 [2024-08-05 23:03:24,228][52649] Sum rewards: 19.511, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.340', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO4': '0.033', 'AMMO3': '0.151', 'weapon4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.505', 'WEAPON3': '1.100', 'weapon2': '1.136', 'HITCOUNT': '1.730', 'weapon3': '2.030', 'DAMAGECOUNT': '5.763', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:24,336][52650] Updated weights for policy 0, policy_version 12141 (0.0029) [2024-08-05 23:03:24,656][52794] DAMAGECOUNT value on done: 23740.0 [2024-08-05 23:03:24,656][52794] Sum rewards: 23.796, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.580', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.063', 'weapon7': '0.096', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.454', 'WEAPON3': '0.500', 'HITCOUNT': '1.270', 'weapon3': '1.334', 'weapon2': '1.500', 'DAMAGECOUNT': '4.200', 'FRAGCOUNT': '18.000'} [2024-08-05 23:03:24,826][52663] DAMAGECOUNT value on done: 20780.0 [2024-08-05 23:03:24,828][52663] Sum rewards: 14.562, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.115', 'AMMO4': '-0.056', 'AMMO2': '-0.011', 'AMMO3': '0.085', 'WEAPON3': '0.700', 'HITCOUNT': '1.220', 'weapon3': '1.776', 'weapon2': '1.964', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:25,255][52667] DAMAGECOUNT value on done: 20514.0 [2024-08-05 23:03:25,255][52667] Sum rewards: 24.362, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.642', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.214', 'WEAPON3': '0.800', 'ARMOR': '0.824', 'weapon2': '1.528', 'HITCOUNT': '1.950', 'weapon3': '2.038', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:25,681][52671] DAMAGECOUNT value on done: 19126.0 [2024-08-05 23:03:25,683][52671] Sum rewards: 22.072, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO2': '0.006', 'weapon4': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'WEAPON3': '0.600', 'HITCOUNT': '1.390', 'weapon2': '1.678', 'weapon3': '1.776', 'ARMOR': '1.855', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:25,777][52664] DAMAGECOUNT value on done: 21914.0 [2024-08-05 23:03:25,785][52664] Sum rewards: 21.370, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.370', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.210', 'weapon5': '0.286', 'WEAPON3': '0.750', 'ARMOR': '1.300', 'HITCOUNT': '1.330', 'weapon2': '1.404', 'weapon3': '1.418', 'DAMAGECOUNT': '5.685', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:26,051][52662] DAMAGECOUNT value on done: 23058.0 [2024-08-05 23:03:26,051][52662] Sum rewards: 16.535, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.068', 'AMMO3': '0.099', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'HITCOUNT': '1.440', 'weapon2': '1.440', 'weapon3': '1.800', 'DAMAGECOUNT': '5.265', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:26,511][52659] DAMAGECOUNT value on done: 20233.0 [2024-08-05 23:03:26,512][52659] Sum rewards: 14.178, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.845', 'AMMO4': '-0.023', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.058', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.226', 'WEAPON3': '0.650', 'ARMOR': '0.906', 'HITCOUNT': '1.150', 'weapon2': '1.392', 'weapon3': '1.580', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:26,701][52658] DAMAGECOUNT value on done: 21589.0 [2024-08-05 23:03:26,702][52658] Sum rewards: 18.402, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.055', 'weapon4': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'ARMOR': '0.412', 'WEAPON3': '0.850', 'HITCOUNT': '1.400', 'weapon3': '1.620', 'weapon2': '1.826', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:27,162][52794] DAMAGECOUNT value on done: 22762.0 [2024-08-05 23:03:27,163][52794] Sum rewards: 10.080, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'ARMOR': '0.472', 'WEAPON3': '0.550', 'weapon4': '0.570', 'HITCOUNT': '0.830', 'weapon2': '1.072', 'weapon3': '1.462', 'DAMAGECOUNT': '2.853', 'FRAGCOUNT': '7.000'} [2024-08-05 23:03:27,515][52649] DAMAGECOUNT value on done: 20007.0 [2024-08-05 23:03:27,516][52649] Sum rewards: 13.784, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.370', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.072', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.298', 'WEAPON3': '0.600', 'ARMOR': '0.871', 'HITCOUNT': '0.970', 'weapon2': '1.210', 'weapon3': '1.622', 'DAMAGECOUNT': '3.729', 'FRAGCOUNT': '9.000'} [2024-08-05 23:03:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17272.6). Total num frames: 99516416. Throughput: 0: 4265.3. Samples: 24886440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:03:27,794][52567] Avg episode reward: [(0, '17.921')] [2024-08-05 23:03:28,174][52663] DAMAGECOUNT value on done: 19408.0 [2024-08-05 23:03:28,176][52663] Sum rewards: 9.843, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.166', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon2': '1.176', 'weapon3': '2.226', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:28,239][52662] DAMAGECOUNT value on done: 21860.0 [2024-08-05 23:03:28,239][52662] Sum rewards: 12.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.896', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.086', 'WEAPON4': '0.250', 'ARMOR': '0.446', 'weapon4': '0.520', 'WEAPON3': '0.550', 'HITCOUNT': '1.190', 'weapon2': '1.396', 'weapon3': '1.424', 'DAMAGECOUNT': '3.891', 'FRAGCOUNT': '9.000'} [2024-08-05 23:03:28,364][52671] DAMAGECOUNT value on done: 19878.0 [2024-08-05 23:03:28,364][52671] Sum rewards: 12.731, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.691', 'AMMO5': '0.005', 'weapon5': '0.018', 'ARMOR': '0.036', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.208', 'WEAPON4': '0.750', 'weapon4': '0.762', 'weapon2': '0.822', 'WEAPON3': '0.900', 'HITCOUNT': '1.430', 'weapon3': '1.732', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:28,504][52667] DAMAGECOUNT value on done: 20580.0 [2024-08-05 23:03:28,505][52667] Sum rewards: 8.573, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.334', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.052', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.898', 'HITCOUNT': '0.940', 'weapon2': '1.632', 'weapon3': '1.744', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '6.000'} [2024-08-05 23:03:28,807][52664] DAMAGECOUNT value on done: 19686.0 [2024-08-05 23:03:28,807][52664] Sum rewards: 23.994, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.745', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.016', 'ARMOR': '0.016', 'weapon5': '0.140', 'AMMO3': '0.142', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.122', 'HITCOUNT': '1.690', 'weapon3': '2.052', 'DAMAGECOUNT': '6.219', 'FRAGCOUNT': '21.000'} [2024-08-05 23:03:29,073][52659] DAMAGECOUNT value on done: 21498.0 [2024-08-05 23:03:29,073][52659] Sum rewards: 20.853, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.866', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon7': '0.056', 'AMMO3': '0.095', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.206', 'WEAPON3': '0.750', 'HITCOUNT': '1.250', 'weapon2': '1.294', 'ARMOR': '1.371', 'weapon3': '1.712', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:29,228][52650] Updated weights for policy 0, policy_version 12151 (0.0027) [2024-08-05 23:03:29,660][52794] DAMAGECOUNT value on done: 26907.0 [2024-08-05 23:03:29,660][52794] Sum rewards: 29.153, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.722', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.136', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.250', 'ARMOR': '0.456', 'weapon2': '1.100', 'WEAPON3': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.236', 'DAMAGECOUNT': '8.547', 'FRAGCOUNT': '24.000'} [2024-08-05 23:03:29,793][52658] DAMAGECOUNT value on done: 20153.0 [2024-08-05 23:03:29,797][52658] Sum rewards: 21.402, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.364', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.370', 'WEAPON3': '0.700', 'ARMOR': '0.898', 'weapon3': '1.598', 'weapon2': '1.602', 'HITCOUNT': '1.620', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:30,846][52662] DAMAGECOUNT value on done: 24637.0 [2024-08-05 23:03:30,847][52662] Sum rewards: 13.986, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.514', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.075', 'WEAPON3': '0.500', 'ARMOR': '0.906', 'HITCOUNT': '0.990', 'weapon3': '1.372', 'weapon2': '1.822', 'DAMAGECOUNT': '3.825', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:30,866][52649] DAMAGECOUNT value on done: 21223.0 [2024-08-05 23:03:30,867][52649] Sum rewards: 17.025, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.412', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.109', 'WEAPON3': '0.750', 'ARMOR': '0.879', 'HITCOUNT': '1.220', 'weapon3': '1.364', 'weapon2': '1.754', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:30,882][52663] DAMAGECOUNT value on done: 19165.0 [2024-08-05 23:03:30,884][52663] Sum rewards: 16.873, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.538', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon7': '0.048', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.362', 'weapon2': '0.760', 'WEAPON3': '1.000', 'HITCOUNT': '1.440', 'weapon3': '2.218', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:31,317][52671] DAMAGECOUNT value on done: 21802.0 [2024-08-05 23:03:31,319][52671] Sum rewards: 28.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.298', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.138', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.340', 'ARMOR': '0.828', 'WEAPON3': '0.850', 'weapon2': '0.928', 'HITCOUNT': '1.900', 'weapon3': '2.184', 'DAMAGECOUNT': '7.416', 'FRAGCOUNT': '22.000'} [2024-08-05 23:03:31,702][52664] DAMAGECOUNT value on done: 19166.0 [2024-08-05 23:03:31,705][52664] Sum rewards: 18.637, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.426', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.056', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.300', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'HITCOUNT': '1.340', 'weapon2': '1.392', 'weapon3': '1.536', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:32,019][52659] DAMAGECOUNT value on done: 20947.0 [2024-08-05 23:03:32,020][52659] Sum rewards: 16.237, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.989', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.058', 'weapon4': '0.072', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '1.430', 'weapon2': '1.622', 'ARMOR': '1.719', 'weapon3': '1.902', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:32,340][52794] DAMAGECOUNT value on done: 22249.0 [2024-08-05 23:03:32,340][52794] Sum rewards: 13.388, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.982', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.060', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'HITCOUNT': '1.190', 'weapon3': '1.430', 'weapon2': '1.512', 'DAMAGECOUNT': '3.969', 'FRAGCOUNT': '9.000'} [2024-08-05 23:03:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17066.7, 300 sec: 17272.6). Total num frames: 99598336. Throughput: 0: 4264.7. Samples: 24899280. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:03:32,794][52567] Avg episode reward: [(0, '17.817')] [2024-08-05 23:03:33,202][52658] DAMAGECOUNT value on done: 20586.0 [2024-08-05 23:03:33,203][52658] Sum rewards: 15.341, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.022', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.097', 'weapon5': '0.164', 'weapon4': '0.222', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'weapon2': '1.336', 'weapon3': '1.468', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '10.500'} [2024-08-05 23:03:33,373][52649] DAMAGECOUNT value on done: 18099.0 [2024-08-05 23:03:33,373][52649] Sum rewards: 23.516, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.079', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.700', 'weapon2': '1.426', 'weapon3': '1.552', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:33,538][52662] DAMAGECOUNT value on done: 22786.0 [2024-08-05 23:03:33,540][52662] Sum rewards: 9.017, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.204', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon7': '0.052', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.282', 'ARMOR': '0.424', 'HITCOUNT': '0.660', 'WEAPON3': '0.750', 'weapon2': '0.918', 'weapon3': '1.580', 'DAMAGECOUNT': '2.592', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:33,680][52663] DAMAGECOUNT value on done: 19128.0 [2024-08-05 23:03:33,681][52663] Sum rewards: 6.936, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.566', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.038', 'weapon5': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'WEAPON3': '0.900', 'HITCOUNT': '0.900', 'ARMOR': '1.295', 'weapon2': '1.498', 'weapon3': '1.526', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'} [2024-08-05 23:03:34,132][52650] Updated weights for policy 0, policy_version 12161 (0.0033) [2024-08-05 23:03:34,709][52671] DAMAGECOUNT value on done: 20834.0 [2024-08-05 23:03:34,709][52671] Sum rewards: 15.205, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.464', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.038', 'ARMOR': '0.088', 'AMMO3': '0.107', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.380', 'HITCOUNT': '1.460', 'weapon3': '1.620', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:34,865][52794] DAMAGECOUNT value on done: 23252.0 [2024-08-05 23:03:34,865][52794] Sum rewards: 11.681, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.682', 'AMMO2': '0.028', 'AMMO3': '0.126', 'AMMO4': '0.142', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.844', 'HITCOUNT': '1.040', 'weapon2': '1.368', 'weapon3': '1.974', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:35,043][52664] DAMAGECOUNT value on done: 20672.0 [2024-08-05 23:03:35,044][52664] Sum rewards: 19.656, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.078', 'AMMO4': '0.124', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.885', 'HITCOUNT': '1.390', 'weapon2': '1.518', 'weapon3': '1.786', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '17.500'} [2024-08-05 23:03:35,323][52659] DAMAGECOUNT value on done: 20280.0 [2024-08-05 23:03:35,323][52659] Sum rewards: 8.201, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.099', 'WEAPON4': '0.300', 'weapon2': '0.596', 'weapon4': '0.652', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon3': '1.638', 'DAMAGECOUNT': '2.895', 'FRAGCOUNT': '8.000'} [2024-08-05 23:03:35,759][52649] DAMAGECOUNT value on done: 19466.0 [2024-08-05 23:03:35,759][52649] Sum rewards: 19.223, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.299', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO3': '0.095', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.306', 'WEAPON3': '0.600', 'weapon2': '1.338', 'HITCOUNT': '1.480', 'weapon3': '1.572', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:36,182][52662] DAMAGECOUNT value on done: 25110.0 [2024-08-05 23:03:36,182][52662] Sum rewards: 14.642, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.046', 'AMMO3': '0.078', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon2': '1.398', 'weapon3': '1.490', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:36,300][52658] DAMAGECOUNT value on done: 21964.0 [2024-08-05 23:03:36,303][52658] Sum rewards: 23.933, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.770', 'AMMO2': '0.025', 'AMMO3': '0.073', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'weapon4': '0.282', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon2': '1.396', 'weapon3': '1.630', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '5.274', 'FRAGCOUNT': '19.000'} [2024-08-05 23:03:37,375][52671] DAMAGECOUNT value on done: 21674.0 [2024-08-05 23:03:37,377][52671] Sum rewards: 14.649, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.770', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'ARMOR': '0.490', 'WEAPON3': '0.800', 'HITCOUNT': '1.290', 'weapon3': '1.744', 'weapon2': '1.878', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:37,569][52794] DAMAGECOUNT value on done: 24618.0 [2024-08-05 23:03:37,570][52794] Sum rewards: 16.439, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.187', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO3': '0.080', 'AMMO4': '0.119', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'ARMOR': '0.828', 'HITCOUNT': '0.960', 'weapon2': '1.314', 'weapon3': '1.500', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 17272.6). Total num frames: 99680256. Throughput: 0: 4237.1. Samples: 24924290. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:03:37,794][52567] Avg episode reward: [(0, '17.588')] [2024-08-05 23:03:37,992][52659] DAMAGECOUNT value on done: 19994.0 [2024-08-05 23:03:38,000][52659] Sum rewards: 19.153, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.085', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'AMMO3': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.316', 'ARMOR': '0.429', 'WEAPON3': '0.450', 'HITCOUNT': '1.220', 'weapon3': '1.228', 'weapon2': '1.710', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:38,519][52662] DAMAGECOUNT value on done: 25576.0 [2024-08-05 23:03:38,520][52662] Sum rewards: 14.118, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.628', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'weapon5': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.112', 'ARMOR': '0.487', 'WEAPON3': '0.800', 'weapon2': '1.362', 'HITCOUNT': '1.370', 'weapon3': '1.690', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:38,643][52649] DAMAGECOUNT value on done: 19191.0 [2024-08-05 23:03:38,643][52649] Sum rewards: 15.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.198', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO4': '0.017', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.236', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'HITCOUNT': '1.410', 'weapon2': '1.586', 'weapon3': '1.940', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:39,061][52650] Updated weights for policy 0, policy_version 12171 (0.0018) [2024-08-05 23:03:39,573][52658] DAMAGECOUNT value on done: 19504.0 [2024-08-05 23:03:39,573][52658] Sum rewards: 9.715, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.134', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.139', 'ARMOR': '0.445', 'WEAPON3': '0.850', 'HITCOUNT': '0.960', 'weapon3': '1.690', 'weapon2': '1.880', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '9.000'} [2024-08-05 23:03:39,821][52794] DAMAGECOUNT value on done: 24913.0 [2024-08-05 23:03:39,821][52794] Sum rewards: 23.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.310', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.382', 'HITCOUNT': '1.480', 'weapon3': '1.834', 'DAMAGECOUNT': '5.607', 'FRAGCOUNT': '19.000'} [2024-08-05 23:03:40,303][52671] DAMAGECOUNT value on done: 21396.0 [2024-08-05 23:03:40,304][52671] Sum rewards: 12.926, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.349', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.141', 'ARMOR': '0.463', 'WEAPON3': '1.050', 'HITCOUNT': '1.350', 'weapon2': '1.594', 'weapon3': '1.854', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:41,005][52662] DAMAGECOUNT value on done: 22892.0 [2024-08-05 23:03:41,012][52662] Sum rewards: 15.975, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.027', 'ARMOR': '0.060', 'weapon5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.250', 'HEALTH': '0.443', 'WEAPON3': '0.750', 'weapon2': '1.432', 'HITCOUNT': '1.470', 'weapon3': '2.000', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:41,141][52659] DAMAGECOUNT value on done: 21632.0 [2024-08-05 23:03:41,142][52659] Sum rewards: 26.450, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.042', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.840', 'weapon3': '1.530', 'HITCOUNT': '1.590', 'weapon2': '1.854', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:41,347][52649] DAMAGECOUNT value on done: 20611.0 [2024-08-05 23:03:41,355][52649] Sum rewards: 13.566, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.458', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.024', 'AMMO4': '0.084', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.348', 'WEAPON3': '0.650', 'ARMOR': '0.890', 'HITCOUNT': '1.060', 'weapon2': '1.318', 'weapon3': '1.606', 'DAMAGECOUNT': '4.056', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:42,468][52794] DAMAGECOUNT value on done: 22867.0 [2024-08-05 23:03:42,468][52794] Sum rewards: 26.506, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.256', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.052', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.436', 'WEAPON3': '0.450', 'ARMOR': '0.489', 'weapon2': '1.276', 'weapon3': '1.552', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17066.7, 300 sec: 17272.6). Total num frames: 99770368. Throughput: 0: 4206.2. Samples: 24949280. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:03:42,794][52567] Avg episode reward: [(0, '17.447')] [2024-08-05 23:03:42,899][52658] DAMAGECOUNT value on done: 22752.0 [2024-08-05 23:03:42,901][52658] Sum rewards: 12.001, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.148', 'AMMO5': '0.007', 'AMMO2': '0.045', 'ARMOR': '0.075', 'weapon5': '0.076', 'AMMO3': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'weapon2': '0.476', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.802', 'HITCOUNT': '1.010', 'weapon3': '1.514', 'DAMAGECOUNT': '3.426', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:42,933][52671] DAMAGECOUNT value on done: 22762.0 [2024-08-05 23:03:42,933][52671] Sum rewards: 16.749, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.436', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.328', 'WEAPON3': '0.700', 'ARMOR': '0.942', 'weapon2': '1.362', 'HITCOUNT': '1.500', 'weapon3': '1.818', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:43,472][52662] DAMAGECOUNT value on done: 23975.0 [2024-08-05 23:03:43,472][52662] Sum rewards: 16.744, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.807', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.058', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '0.800', 'ARMOR': '0.931', 'weapon2': '1.220', 'HITCOUNT': '1.240', 'weapon3': '1.894', 'DAMAGECOUNT': '4.161', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:43,656][52659] DAMAGECOUNT value on done: 22255.0 [2024-08-05 23:03:43,656][52659] Sum rewards: 18.255, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.137', 'HEALTH': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.800', 'weapon2': '1.164', 'HITCOUNT': '1.560', 'weapon3': '2.176', 'DAMAGECOUNT': '5.676', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:43,919][52650] Updated weights for policy 0, policy_version 12181 (0.0024) [2024-08-05 23:03:44,522][52649] DAMAGECOUNT value on done: 20504.0 [2024-08-05 23:03:44,522][52649] Sum rewards: 17.569, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'ARMOR': '0.468', 'weapon4': '0.588', 'weapon2': '0.598', 'WEAPON3': '0.900', 'HITCOUNT': '1.540', 'weapon3': '2.116', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:44,725][52794] DAMAGECOUNT value on done: 23997.0 [2024-08-05 23:03:44,727][52794] Sum rewards: 16.462, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.531', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'ARMOR': '1.423', 'weapon2': '1.506', 'weapon3': '1.764', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:45,347][52671] DAMAGECOUNT value on done: 20325.0 [2024-08-05 23:03:45,347][52671] Sum rewards: 13.750, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.055', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON4': '0.300', 'ARMOR': '0.526', 'WEAPON3': '0.900', 'weapon2': '1.266', 'HITCOUNT': '1.350', 'weapon3': '2.000', 'DAMAGECOUNT': '4.476', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:46,126][52662] DAMAGECOUNT value on done: 22644.0 [2024-08-05 23:03:46,127][52662] Sum rewards: 25.691, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.810', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.122', 'ARMOR': '0.455', 'WEAPON3': '0.550', 'weapon3': '1.516', 'weapon2': '1.538', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '5.673', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:46,147][52658] DAMAGECOUNT value on done: 22152.0 [2024-08-05 23:03:46,148][52658] Sum rewards: 18.742, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.074', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO3': '0.095', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '1.283', 'weapon2': '1.326', 'HITCOUNT': '1.480', 'weapon3': '1.582', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:46,453][52659] DAMAGECOUNT value on done: 18541.0 [2024-08-05 23:03:46,461][52659] Sum rewards: 12.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.502', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon5': '0.022', 'weapon4': '0.034', 'AMMO4': '0.073', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'weapon2': '1.704', 'weapon3': '1.726', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:47,100][52803] DAMAGECOUNT value on done: 19215.0 [2024-08-05 23:03:47,102][52803] Sum rewards: 22.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.016', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.238', 'ARMOR': '0.872', 'weapon2': '0.944', 'WEAPON3': '1.250', 'HITCOUNT': '1.680', 'weapon3': '2.428', 'DAMAGECOUNT': '6.108', 'FRAGCOUNT': '21.000'} [2024-08-05 23:03:47,746][52649] DAMAGECOUNT value on done: 20262.0 [2024-08-05 23:03:47,746][52649] Sum rewards: 23.195, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.024', 'HEALTH': '0.063', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon4': '0.472', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '1.132', 'weapon3': '1.572', 'HITCOUNT': '1.620', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 17300.4). Total num frames: 99852288. Throughput: 0: 4199.4. Samples: 24961870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:03:47,795][52567] Avg episode reward: [(0, '17.521')] [2024-08-05 23:03:48,613][52650] Updated weights for policy 0, policy_version 12191 (0.0032) [2024-08-05 23:03:48,730][52671] DAMAGECOUNT value on done: 21123.0 [2024-08-05 23:03:48,732][52671] Sum rewards: 17.582, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.023', 'HEALTH': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.117', 'weapon4': '0.118', 'weapon5': '0.140', 'WEAPON4': '0.150', 'ARMOR': '0.438', 'WEAPON3': '0.500', 'HITCOUNT': '1.170', 'weapon3': '1.496', 'weapon2': '1.586', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:48,756][52658] DAMAGECOUNT value on done: 19771.0 [2024-08-05 23:03:48,757][52658] Sum rewards: 15.919, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO3': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.178', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'HITCOUNT': '1.220', 'weapon3': '1.508', 'weapon2': '1.568', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '13.000'} [2024-08-05 23:03:48,795][52662] DAMAGECOUNT value on done: 23814.0 [2024-08-05 23:03:48,796][52662] Sum rewards: 9.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.811', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'weapon7': '0.056', 'AMMO3': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.332', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '0.740', 'weapon2': '1.570', 'weapon3': '1.640', 'DAMAGECOUNT': '3.234', 'FRAGCOUNT': '9.000'} [2024-08-05 23:03:49,728][52659] DAMAGECOUNT value on done: 19899.0 [2024-08-05 23:03:49,728][52659] Sum rewards: 13.340, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.028', 'AMMO4': '0.062', 'AMMO3': '0.086', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.300', 'ARMOR': '0.496', 'WEAPON3': '0.750', 'HITCOUNT': '1.190', 'weapon2': '1.416', 'weapon3': '1.768', 'DAMAGECOUNT': '3.882', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:50,363][52803] DAMAGECOUNT value on done: 22592.0 [2024-08-05 23:03:50,365][52803] Sum rewards: 24.209, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.212', 'AMMO5': '0.003', 'weapon5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.114', 'weapon4': '0.140', 'AMMO4': '0.145', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.680', 'weapon3': '1.718', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '6.894', 'FRAGCOUNT': '20.000'} [2024-08-05 23:03:50,725][52649] DAMAGECOUNT value on done: 22678.0 [2024-08-05 23:03:50,730][52649] Sum rewards: 17.536, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.718', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.088', 'AMMO3': '0.098', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'ARMOR': '1.300', 'weapon3': '1.634', 'weapon2': '1.806', 'DAMAGECOUNT': '3.993', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:51,944][52811] DAMAGECOUNT value on done: 19858.0 [2024-08-05 23:03:51,954][52811] Sum rewards: 13.273, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.738', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon5': '0.028', 'weapon7': '0.052', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.412', 'WEAPON3': '0.550', 'HITCOUNT': '0.760', 'ARMOR': '1.254', 'weapon3': '1.384', 'weapon2': '1.660', 'DAMAGECOUNT': '3.162', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:52,118][52658] DAMAGECOUNT value on done: 19397.0 [2024-08-05 23:03:52,122][52658] Sum rewards: 16.292, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'ARMOR': '0.040', 'weapon5': '0.058', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'HEALTH': '0.176', 'weapon4': '0.460', 'WEAPON3': '0.600', 'weapon2': '0.988', 'HITCOUNT': '1.320', 'weapon3': '1.752', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '12.000'} [2024-08-05 23:03:52,254][52671] DAMAGECOUNT value on done: 23229.0 [2024-08-05 23:03:52,254][52671] Sum rewards: 12.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.435', 'AMMO5': '0.021', 'weapon5': '0.038', 'AMMO2': '0.064', 'ARMOR': '0.072', 'AMMO3': '0.218', 'weapon4': '0.264', 'AMMO4': '0.319', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon2': '1.270', 'HITCOUNT': '1.310', 'weapon3': '2.122', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16930.1, 300 sec: 17300.4). Total num frames: 99934208. Throughput: 0: 4181.8. Samples: 24987170. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:03:52,794][52567] Avg episode reward: [(0, '17.281')] [2024-08-05 23:03:52,967][52659] DAMAGECOUNT value on done: 22486.0 [2024-08-05 23:03:52,967][52659] Sum rewards: 22.468, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.484', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'weapon4': '0.486', 'WEAPON3': '0.700', 'weapon2': '1.318', 'weapon3': '1.650', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:53,372][52649] DAMAGECOUNT value on done: 19719.0 [2024-08-05 23:03:53,374][52649] Sum rewards: 20.590, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.736', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.080', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'weapon4': '0.600', 'WEAPON3': '0.650', 'weapon2': '1.068', 'HITCOUNT': '1.160', 'weapon3': '1.734', 'DAMAGECOUNT': '4.179', 'FRAGCOUNT': '17.000'} [2024-08-05 23:03:53,563][52803] DAMAGECOUNT value on done: 17891.0 [2024-08-05 23:03:53,566][52803] Sum rewards: 7.782, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'AMMO2': '0.056', 'weapon5': '0.070', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.281', 'weapon4': '0.544', 'ARMOR': '0.545', 'WEAPON4': '0.650', 'weapon2': '0.674', 'WEAPON3': '0.800', 'HITCOUNT': '0.920', 'weapon3': '1.742', 'DAMAGECOUNT': '3.210', 'FRAGCOUNT': '8.000'} [2024-08-05 23:03:53,799][52650] Updated weights for policy 0, policy_version 12201 (0.0025) [2024-08-05 23:03:54,669][52671] DAMAGECOUNT value on done: 18814.0 [2024-08-05 23:03:54,673][52671] Sum rewards: 14.518, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.462', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.097', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.250', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'HITCOUNT': '1.080', 'weapon2': '1.456', 'weapon3': '1.598', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '11.000'} [2024-08-05 23:03:55,178][52811] DAMAGECOUNT value on done: 19463.0 [2024-08-05 23:03:55,182][52811] Sum rewards: 23.457, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon4': '0.490', 'WEAPON3': '0.600', 'weapon2': '0.972', 'HITCOUNT': '1.300', 'weapon3': '1.702', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '19.000'} [2024-08-05 23:03:55,422][52659] DAMAGECOUNT value on done: 19611.0 [2024-08-05 23:03:55,422][52659] Sum rewards: 7.792, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.036', 'ARMOR': '0.052', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon3': '1.360', 'weapon2': '1.414', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '6.500'} [2024-08-05 23:03:55,711][52658] DAMAGECOUNT value on done: 20953.0 [2024-08-05 23:03:55,712][52658] Sum rewards: 21.403, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.986', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.468', 'WEAPON3': '0.800', 'weapon2': '1.082', 'HITCOUNT': '1.710', 'weapon3': '2.034', 'DAMAGECOUNT': '5.943', 'FRAGCOUNT': '18.000'} [2024-08-05 23:03:56,468][52649] DAMAGECOUNT value on done: 18537.0 [2024-08-05 23:03:56,469][52649] Sum rewards: 15.597, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'weapon5': '0.118', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.320', 'weapon2': '1.486', 'weapon3': '1.518', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '14.000'} [2024-08-05 23:03:56,955][52803] DAMAGECOUNT value on done: 18546.0 [2024-08-05 23:03:56,965][52803] Sum rewards: 13.561, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.514', 'AMMO5': '0.018', 'weapon5': '0.024', 'AMMO2': '0.032', 'AMMO3': '0.115', 'weapon4': '0.144', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.897', 'HITCOUNT': '1.050', 'weapon2': '1.570', 'weapon3': '1.684', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '10.000'} [2024-08-05 23:03:57,285][52671] DAMAGECOUNT value on done: 18510.0 [2024-08-05 23:03:57,285][52671] Sum rewards: 21.012, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.196', 'ARMOR': '0.481', 'HEALTH': '0.492', 'WEAPON3': '0.600', 'HITCOUNT': '1.480', 'weapon2': '1.538', 'weapon3': '1.582', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '16.000'} [2024-08-05 23:03:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 17244.9). Total num frames: 100016128. Throughput: 0: 4171.1. Samples: 25012370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:03:57,794][52567] Avg episode reward: [(0, '17.201')] [2024-08-05 23:03:58,117][52659] DAMAGECOUNT value on done: 20478.0 [2024-08-05 23:03:58,117][52659] Sum rewards: 20.586, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.276', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.010', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON3': '0.450', 'weapon3': '1.240', 'HITCOUNT': '1.370', 'weapon2': '1.636', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '15.000'} [2024-08-05 23:03:58,447][52650] Updated weights for policy 0, policy_version 12211 (0.0026) [2024-08-05 23:03:58,462][52811] DAMAGECOUNT value on done: 21089.0 [2024-08-05 23:03:58,463][52811] Sum rewards: 18.970, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.088', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON3': '0.750', 'ARMOR': '0.879', 'HITCOUNT': '1.520', 'weapon2': '1.768', 'weapon3': '1.854', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '14.500'} [2024-08-05 23:03:59,728][52649] DAMAGECOUNT value on done: 22239.0 [2024-08-05 23:03:59,728][52649] Sum rewards: 16.836, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.622', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'weapon4': '0.110', 'AMMO4': '0.148', 'WEAPON4': '0.400', 'ARMOR': '0.545', 'WEAPON3': '0.750', 'weapon2': '1.378', 'HITCOUNT': '1.390', 'weapon3': '2.048', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:00,188][52803] DAMAGECOUNT value on done: 21207.0 [2024-08-05 23:04:00,190][52803] Sum rewards: 20.271, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'ARMOR': '0.404', 'weapon4': '0.440', 'WEAPON3': '0.800', 'weapon2': '1.128', 'HITCOUNT': '1.600', 'weapon3': '1.992', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '17.000'} [2024-08-05 23:04:00,450][52671] DAMAGECOUNT value on done: 20718.0 [2024-08-05 23:04:00,450][52671] Sum rewards: 18.080, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'ARMOR': '0.932', 'HITCOUNT': '1.080', 'weapon2': '1.248', 'weapon3': '1.360', 'DAMAGECOUNT': '3.903', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:01,457][52659] DAMAGECOUNT value on done: 18444.0 [2024-08-05 23:04:01,457][52659] Sum rewards: 13.133, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.730', 'AMMO5': '0.013', 'AMMO2': '0.015', 'ARMOR': '0.040', 'AMMO4': '0.074', 'AMMO3': '0.074', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '1.170', 'weapon2': '1.316', 'weapon3': '1.330', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '11.000'} [2024-08-05 23:04:01,755][52811] DAMAGECOUNT value on done: 20366.0 [2024-08-05 23:04:01,757][52811] Sum rewards: 14.068, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.850', 'HITCOUNT': '1.160', 'weapon2': '1.264', 'ARMOR': '1.282', 'weapon3': '1.778', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '12.000'} [2024-08-05 23:04:02,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16793.8, 300 sec: 17244.8). Total num frames: 100098048. Throughput: 0: 4182.4. Samples: 25025020. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:04:02,795][52567] Avg episode reward: [(0, '17.118')] [2024-08-05 23:04:02,814][52649] DAMAGECOUNT value on done: 17978.0 [2024-08-05 23:04:02,817][52649] Sum rewards: 13.999, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.550', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.204', 'ARMOR': '0.461', 'WEAPON3': '0.750', 'HITCOUNT': '1.450', 'weapon2': '1.520', 'weapon3': '1.790', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '10.000'} [2024-08-05 23:04:03,373][52650] Updated weights for policy 0, policy_version 12221 (0.0036) [2024-08-05 23:04:03,533][52803] DAMAGECOUNT value on done: 18304.0 [2024-08-05 23:04:03,535][52803] Sum rewards: 10.931, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.850', 'ARMOR': '0.891', 'HITCOUNT': '0.940', 'weapon3': '1.630', 'weapon2': '1.652', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '9.000'} [2024-08-05 23:04:03,902][52671] DAMAGECOUNT value on done: 20925.0 [2024-08-05 23:04:03,902][52671] Sum rewards: 22.555, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.154', 'AMMO5': '0.005', 'AMMO2': '0.044', 'AMMO3': '0.109', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'ARMOR': '0.468', 'weapon4': '0.674', 'WEAPON3': '0.700', 'weapon2': '0.730', 'HITCOUNT': '1.510', 'weapon3': '2.064', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '18.000'} [2024-08-05 23:04:04,555][52659] DAMAGECOUNT value on done: 19757.0 [2024-08-05 23:04:04,555][52659] Sum rewards: 13.670, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.022', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO5': '0.012', 'weapon5': '0.054', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.518', 'ARMOR': '0.536', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon3': '1.258', 'weapon2': '1.526', 'DAMAGECOUNT': '3.267', 'FRAGCOUNT': '10.000'} [2024-08-05 23:04:05,140][52811] DAMAGECOUNT value on done: 20571.0 [2024-08-05 23:04:05,140][52811] Sum rewards: 17.941, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'HEALTH': '0.281', 'weapon4': '0.520', 'WEAPON3': '0.550', 'weapon2': '0.904', 'HITCOUNT': '1.090', 'ARMOR': '1.375', 'weapon3': '1.782', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:05,976][52649] DAMAGECOUNT value on done: 21151.0 [2024-08-05 23:04:05,978][52649] Sum rewards: 15.427, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.124', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.042', 'weapon7': '0.080', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.114', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.886', 'HITCOUNT': '1.270', 'weapon2': '1.388', 'weapon3': '1.844', 'DAMAGECOUNT': '4.359', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:06,766][52803] DAMAGECOUNT value on done: 22707.0 [2024-08-05 23:04:06,769][52803] Sum rewards: 17.843, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.526', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.090', 'AMMO3': '0.096', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.070', 'weapon2': '1.600', 'weapon3': '1.726', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '14.500'} [2024-08-05 23:04:06,940][52671] DAMAGECOUNT value on done: 21731.0 [2024-08-05 23:04:06,941][52671] Sum rewards: 17.375, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'ARMOR': '0.068', 'weapon5': '0.108', 'AMMO4': '0.124', 'AMMO3': '0.132', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.190', 'HITCOUNT': '1.490', 'weapon3': '2.142', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '13.500'} [2024-08-05 23:04:07,705][52659] DAMAGECOUNT value on done: 21506.0 [2024-08-05 23:04:07,705][52659] Sum rewards: 19.907, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.758', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.280', 'weapon3': '1.392', 'weapon2': '1.402', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '16.000'} [2024-08-05 23:04:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 17244.9). Total num frames: 100179968. Throughput: 0: 4193.6. Samples: 25050050. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:04:07,802][52567] Avg episode reward: [(0, '16.937')] [2024-08-05 23:04:08,294][52650] Updated weights for policy 0, policy_version 12231 (0.0025) [2024-08-05 23:04:08,364][52811] DAMAGECOUNT value on done: 19890.0 [2024-08-05 23:04:08,366][52811] Sum rewards: 16.692, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.107', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'weapon4': '0.204', 'ARMOR': '0.452', 'WEAPON3': '0.700', 'HITCOUNT': '1.360', 'weapon3': '1.442', 'weapon2': '1.476', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:09,347][52649] DAMAGECOUNT value on done: 21227.0 [2024-08-05 23:04:09,348][52649] Sum rewards: 17.100, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.389', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.028', 'AMMO4': '0.028', 'weapon4': '0.128', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '1.150', 'weapon2': '1.310', 'HITCOUNT': '1.350', 'weapon3': '2.232', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '17.000'} [2024-08-05 23:04:09,428][52671] DAMAGECOUNT value on done: 18811.0 [2024-08-05 23:04:09,429][52671] Sum rewards: 19.666, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.092', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon5': '0.030', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.850', 'HITCOUNT': '1.630', 'weapon3': '1.734', 'weapon2': '1.870', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '13.500'} [2024-08-05 23:04:10,176][52803] DAMAGECOUNT value on done: 18478.0 [2024-08-05 23:04:10,177][52803] Sum rewards: 15.960, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.110', 'weapon5': '0.148', 'AMMO4': '0.180', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.468', 'WEAPON3': '0.750', 'HITCOUNT': '1.300', 'weapon2': '1.506', 'weapon3': '1.580', 'DAMAGECOUNT': '4.809', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:10,205][52659] DAMAGECOUNT value on done: 22971.0 [2024-08-05 23:04:10,207][52659] Sum rewards: 14.602, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.040', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon7': '0.064', 'AMMO4': '0.084', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.650', 'ARMOR': '0.931', 'weapon2': '1.022', 'HITCOUNT': '1.030', 'weapon3': '1.674', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '11.000'} [2024-08-05 23:04:11,660][52811] DAMAGECOUNT value on done: 21433.0 [2024-08-05 23:04:11,662][52811] Sum rewards: 27.906, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.749', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.073', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.925', 'weapon2': '1.396', 'HITCOUNT': '1.850', 'weapon3': '2.234', 'DAMAGECOUNT': '6.423', 'FRAGCOUNT': '22.000'} [2024-08-05 23:04:12,236][52671] DAMAGECOUNT value on done: 20897.0 [2024-08-05 23:04:12,236][52671] Sum rewards: 13.109, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.473', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.023', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'weapon2': '1.160', 'HITCOUNT': '1.190', 'weapon3': '1.842', 'DAMAGECOUNT': '4.149', 'FRAGCOUNT': '9.000'} [2024-08-05 23:04:12,559][52649] DAMAGECOUNT value on done: 22464.0 [2024-08-05 23:04:12,560][52649] Sum rewards: 9.901, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.940', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'ARMOR': '0.028', 'AMMO3': '0.161', 'HITCOUNT': '1.090', 'WEAPON3': '1.100', 'weapon2': '1.570', 'weapon3': '1.894', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '12.000'} [2024-08-05 23:04:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16793.6, 300 sec: 17272.6). Total num frames: 100270080. Throughput: 0: 4199.6. Samples: 25075420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:04:12,794][52567] Avg episode reward: [(0, '16.842')] [2024-08-05 23:04:12,964][52659] DAMAGECOUNT value on done: 19253.0 [2024-08-05 23:04:12,964][52659] Sum rewards: 18.337, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.570', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon5': '0.120', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'weapon2': '1.408', 'weapon3': '1.424', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '5.757', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:13,138][52650] Updated weights for policy 0, policy_version 12241 (0.0012) [2024-08-05 23:04:13,725][52803] DAMAGECOUNT value on done: 19189.0 [2024-08-05 23:04:13,726][52803] Sum rewards: 15.441, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.985', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO3': '0.051', 'WEAPON3': '0.450', 'ARMOR': '0.460', 'weapon3': '1.180', 'HITCOUNT': '1.330', 'weapon2': '1.528', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '10.000'} [2024-08-05 23:04:14,862][52811] DAMAGECOUNT value on done: 17392.0 [2024-08-05 23:04:14,864][52811] Sum rewards: 22.331, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.118', 'weapon4': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'WEAPON3': '0.850', 'weapon2': '1.452', 'HITCOUNT': '1.470', 'weapon3': '1.846', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '19.000'} [2024-08-05 23:04:16,201][52659] DAMAGECOUNT value on done: 20538.0 [2024-08-05 23:04:16,202][52659] Sum rewards: 15.603, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.813', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.320', 'ARMOR': '0.937', 'WEAPON3': '1.000', 'weapon2': '1.006', 'HITCOUNT': '1.190', 'weapon3': '1.964', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:17,164][52803] DAMAGECOUNT value on done: 17970.0 [2024-08-05 23:04:17,165][52803] Sum rewards: 20.028, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.463', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.066', 'AMMO3': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.284', 'ARMOR': '0.426', 'WEAPON3': '0.550', 'HITCOUNT': '1.370', 'weapon3': '1.524', 'weapon2': '1.612', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '15.000'} [2024-08-05 23:04:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 17272.6). Total num frames: 100352000. Throughput: 0: 4200.7. Samples: 25088310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:04:17,794][52567] Avg episode reward: [(0, '16.834')] [2024-08-05 23:04:18,086][52650] Updated weights for policy 0, policy_version 12251 (0.0017) [2024-08-05 23:04:18,120][52811] DAMAGECOUNT value on done: 18786.0 [2024-08-05 23:04:18,120][52811] Sum rewards: 30.010, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.982', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON3': '1.100', 'weapon2': '1.330', 'ARMOR': '1.405', 'HITCOUNT': '2.090', 'weapon3': '2.330', 'DAMAGECOUNT': '7.818', 'FRAGCOUNT': '26.000'} [2024-08-05 23:04:18,788][52659] DAMAGECOUNT value on done: 19359.0 [2024-08-05 23:04:18,789][52659] Sum rewards: 21.246, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.571', 'weapon4': '0.002', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.850', 'ARMOR': '0.855', 'HITCOUNT': '1.370', 'weapon2': '1.638', 'weapon3': '2.030', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '17.000'} [2024-08-05 23:04:20,247][52668] DAMAGECOUNT value on done: 20471.0 [2024-08-05 23:04:20,247][52668] Sum rewards: 17.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.310', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon4': '0.118', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'ARMOR': '0.481', 'WEAPON3': '1.050', 'HITCOUNT': '1.220', 'weapon2': '1.228', 'weapon3': '1.796', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '17.000'} [2024-08-05 23:04:20,371][52803] DAMAGECOUNT value on done: 19999.0 [2024-08-05 23:04:20,375][52803] Sum rewards: 25.186, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.026', 'AMMO4': '-0.070', 'AMMO2': '-0.014', 'AMMO3': '0.121', 'ARMOR': '0.462', 'WEAPON3': '0.900', 'weapon3': '1.854', 'HITCOUNT': '1.860', 'weapon2': '1.952', 'DAMAGECOUNT': '6.897', 'FRAGCOUNT': '20.000'} [2024-08-05 23:04:21,444][52811] DAMAGECOUNT value on done: 19779.0 [2024-08-05 23:04:21,444][52811] Sum rewards: 17.267, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.098', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.372', 'WEAPON3': '0.550', 'HITCOUNT': '1.120', 'weapon3': '1.130', 'ARMOR': '1.273', 'weapon2': '1.510', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:21,980][52659] DAMAGECOUNT value on done: 21424.0 [2024-08-05 23:04:21,981][52659] Sum rewards: 13.807, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.650', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.024', 'weapon5': '0.054', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.224', 'WEAPON4': '0.300', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon3': '1.580', 'weapon2': '1.710', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '11.000'} [2024-08-05 23:04:22,747][52795] DAMAGECOUNT value on done: 17511.0 [2024-08-05 23:04:22,748][52795] Sum rewards: 11.814, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.510', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'ARMOR': '0.470', 'WEAPON3': '0.750', 'HITCOUNT': '1.180', 'weapon3': '1.514', 'weapon2': '1.822', 'DAMAGECOUNT': '4.380', 'FRAGCOUNT': '9.000'} [2024-08-05 23:04:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 17300.4). Total num frames: 100433920. Throughput: 0: 4204.2. Samples: 25113480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:04:22,795][52567] Avg episode reward: [(0, '17.292')] [2024-08-05 23:04:22,881][52650] Updated weights for policy 0, policy_version 12261 (0.0013) [2024-08-05 23:04:23,581][52668] DAMAGECOUNT value on done: 22840.0 [2024-08-05 23:04:23,582][52668] Sum rewards: 20.749, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'HEALTH': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'weapon5': '0.122', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.226', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'weapon2': '1.190', 'HITCOUNT': '1.570', 'weapon3': '1.836', 'DAMAGECOUNT': '5.091', 'FRAGCOUNT': '16.000'} [2024-08-05 23:04:23,693][52803] DAMAGECOUNT value on done: 19227.0 [2024-08-05 23:04:23,696][52803] Sum rewards: 21.968, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.021', 'weapon5': '0.042', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'HEALTH': '0.402', 'WEAPON3': '0.500', 'ARMOR': '0.847', 'HITCOUNT': '1.210', 'weapon3': '1.496', 'weapon2': '1.756', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '16.000'} [2024-08-05 23:04:24,819][52811] DAMAGECOUNT value on done: 22174.0 [2024-08-05 23:04:24,820][52811] Sum rewards: 28.850, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.532', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.068', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.514', 'WEAPON3': '0.700', 'weapon2': '0.706', 'ARMOR': '0.986', 'HITCOUNT': '1.710', 'weapon3': '1.760', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '23.000'} [2024-08-05 23:04:25,658][52647] DAMAGECOUNT value on done: 22719.0 [2024-08-05 23:04:25,658][52647] Sum rewards: 13.085, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.164', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '1.220', 'weapon3': '1.380', 'weapon2': '1.654', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '9.000'} [2024-08-05 23:04:26,022][52795] DAMAGECOUNT value on done: 16581.0 [2024-08-05 23:04:26,026][52795] Sum rewards: 14.474, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.052', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.400', 'ARMOR': '0.460', 'HITCOUNT': '0.980', 'weapon3': '1.194', 'weapon2': '1.376', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '10.000'} [2024-08-05 23:04:26,492][52668] DAMAGECOUNT value on done: 19297.0 [2024-08-05 23:04:26,494][52668] Sum rewards: 19.260, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.110', 'HEALTH': '0.280', 'WEAPON3': '0.650', 'weapon2': '1.292', 'HITCOUNT': '1.490', 'weapon3': '1.984', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '15.000'} [2024-08-05 23:04:26,950][52803] DAMAGECOUNT value on done: 17850.0 [2024-08-05 23:04:26,951][52803] Sum rewards: 17.415, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.114', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.244', 'WEAPON3': '0.850', 'ARMOR': '1.303', 'HITCOUNT': '1.320', 'weapon2': '1.508', 'weapon3': '1.724', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:27,792][52650] Updated weights for policy 0, policy_version 12271 (0.0050) [2024-08-05 23:04:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.5, 300 sec: 17355.9). Total num frames: 100524032. Throughput: 0: 4210.4. Samples: 25138750. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:04:27,795][52567] Avg episode reward: [(0, '17.170')] [2024-08-05 23:04:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012271_100524032.pth... [2024-08-05 23:04:27,922][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000011765_96378880.pth [2024-08-05 23:04:28,213][52811] DAMAGECOUNT value on done: 18758.0 [2024-08-05 23:04:28,214][52811] Sum rewards: 18.447, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.536', 'weapon5': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO3': '0.106', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'WEAPON3': '0.750', 'weapon2': '1.262', 'HITCOUNT': '1.440', 'weapon3': '1.616', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '15.000'} [2024-08-05 23:04:28,344][52660] DAMAGECOUNT value on done: 21933.0 [2024-08-05 23:04:28,345][52660] Sum rewards: 14.772, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.430', 'weapon5': '0.002', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.024', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'HITCOUNT': '1.380', 'weapon3': '1.698', 'weapon2': '1.766', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '11.000'} [2024-08-05 23:04:28,983][52647] DAMAGECOUNT value on done: 21669.0 [2024-08-05 23:04:28,983][52647] Sum rewards: 34.345, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.627', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.518', 'ARMOR': '0.532', 'WEAPON3': '0.800', 'weapon2': '1.166', 'weapon3': '2.076', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '8.988', 'FRAGCOUNT': '26.000'} [2024-08-05 23:04:29,374][52668] DAMAGECOUNT value on done: 21307.0 [2024-08-05 23:04:29,376][52668] Sum rewards: 16.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.412', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.127', 'weapon4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.945', 'HITCOUNT': '1.360', 'weapon2': '1.730', 'weapon3': '1.954', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:29,576][52795] DAMAGECOUNT value on done: 18503.0 [2024-08-05 23:04:29,578][52795] Sum rewards: 17.722, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.025', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'HEALTH': '0.177', 'weapon4': '0.290', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'weapon2': '1.116', 'HITCOUNT': '1.370', 'weapon3': '1.822', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '15.000'} [2024-08-05 23:04:30,286][52803] DAMAGECOUNT value on done: 19533.0 [2024-08-05 23:04:30,287][52803] Sum rewards: 18.794, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.822', 'weapon4': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.932', 'HITCOUNT': '1.130', 'weapon2': '1.408', 'weapon3': '1.578', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:31,284][52660] DAMAGECOUNT value on done: 22083.0 [2024-08-05 23:04:31,286][52660] Sum rewards: 20.841, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.926', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.059', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.474', 'WEAPON3': '0.750', 'HITCOUNT': '1.430', 'weapon2': '1.500', 'weapon3': '1.652', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '18.000'} [2024-08-05 23:04:31,321][52811] DAMAGECOUNT value on done: 19146.0 [2024-08-05 23:04:31,321][52811] Sum rewards: 18.515, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.756', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.266', 'ARMOR': '0.483', 'WEAPON3': '0.650', 'HITCOUNT': '1.270', 'weapon2': '1.316', 'weapon3': '1.722', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:32,125][52668] DAMAGECOUNT value on done: 20113.0 [2024-08-05 23:04:32,125][52668] Sum rewards: 15.782, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.726', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.160', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '0.900', 'weapon3': '1.366', 'weapon2': '1.552', 'DAMAGECOUNT': '3.804', 'FRAGCOUNT': '12.000'} [2024-08-05 23:04:32,395][52659] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:04:32,511][52650] Updated weights for policy 0, policy_version 12281 (0.0026) [2024-08-05 23:04:32,563][52647] DAMAGECOUNT value on done: 23475.0 [2024-08-05 23:04:32,564][52647] Sum rewards: 17.142, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.708', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon7': '0.050', 'weapon5': '0.050', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.500', 'weapon2': '0.668', 'WEAPON3': '0.750', 'HITCOUNT': '1.370', 'ARMOR': '1.400', 'weapon3': '1.530', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '12.000'} [2024-08-05 23:04:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 17328.2). Total num frames: 100605952. Throughput: 0: 4199.1. Samples: 25150830. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:04:32,794][52567] Avg episode reward: [(0, '17.607')] [2024-08-05 23:04:33,114][52795] DAMAGECOUNT value on done: 19082.0 [2024-08-05 23:04:33,114][52795] Sum rewards: 9.858, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.099', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.800', 'weapon2': '0.904', 'HITCOUNT': '1.400', 'weapon3': '1.916', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '8.000'} [2024-08-05 23:04:33,637][52803] DAMAGECOUNT value on done: 19470.0 [2024-08-05 23:04:33,642][52803] Sum rewards: 16.971, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.628', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'weapon4': '0.218', 'WEAPON3': '0.550', 'ARMOR': '0.853', 'HITCOUNT': '1.230', 'weapon3': '1.348', 'weapon2': '1.574', 'DAMAGECOUNT': '3.897', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:34,532][52660] DAMAGECOUNT value on done: 20244.0 [2024-08-05 23:04:34,535][52660] Sum rewards: 13.652, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.144', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON3': '0.750', 'weapon2': '1.138', 'HITCOUNT': '1.280', 'ARMOR': '1.315', 'weapon3': '1.600', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '10.000'} [2024-08-05 23:04:34,665][52811] DAMAGECOUNT value on done: 18935.0 [2024-08-05 23:04:34,667][52811] Sum rewards: 20.287, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.859', 'AMMO2': '0.017', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.142', 'ARMOR': '0.486', 'WEAPON3': '0.850', 'HITCOUNT': '1.370', 'weapon2': '1.634', 'weapon3': '1.728', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '18.000'} [2024-08-05 23:04:35,495][52647] DAMAGECOUNT value on done: 20226.0 [2024-08-05 23:04:35,495][52647] Sum rewards: 21.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.636', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO3': '0.140', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'ARMOR': '1.316', 'HITCOUNT': '1.610', 'weapon2': '1.662', 'weapon3': '1.972', 'DAMAGECOUNT': '5.580', 'FRAGCOUNT': '19.000'} [2024-08-05 23:04:35,616][52668] DAMAGECOUNT value on done: 22686.0 [2024-08-05 23:04:35,620][52668] Sum rewards: 20.297, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.457', 'AMMO2': '0.014', 'weapon7': '0.048', 'weapon4': '0.056', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'weapon2': '1.230', 'HITCOUNT': '1.240', 'weapon3': '1.578', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '17.000'} [2024-08-05 23:04:36,428][52795] DAMAGECOUNT value on done: 22377.0 [2024-08-05 23:04:36,430][52795] Sum rewards: 17.520, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.282', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.076', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.480', 'WEAPON3': '0.600', 'HITCOUNT': '1.180', 'weapon2': '1.294', 'weapon3': '1.460', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:36,960][52803] DAMAGECOUNT value on done: 17260.0 [2024-08-05 23:04:36,961][52803] Sum rewards: 7.279, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.667', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.014', 'weapon4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.905', 'HITCOUNT': '0.940', 'weapon3': '1.474', 'weapon2': '2.034', 'DAMAGECOUNT': '2.745', 'FRAGCOUNT': '7.000'} [2024-08-05 23:04:37,308][52660] DAMAGECOUNT value on done: 20031.0 [2024-08-05 23:04:37,310][52660] Sum rewards: 14.608, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.066', 'AMMO2': '0.028', 'AMMO3': '0.080', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'WEAPON3': '0.450', 'weapon2': '0.660', 'weapon4': '0.666', 'ARMOR': '0.897', 'HITCOUNT': '1.000', 'weapon3': '1.066', 'DAMAGECOUNT': '2.934', 'FRAGCOUNT': '11.000'} [2024-08-05 23:04:37,791][52650] Updated weights for policy 0, policy_version 12291 (0.0021) [2024-08-05 23:04:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.5, 300 sec: 17300.4). Total num frames: 100687872. Throughput: 0: 4194.9. Samples: 25175940. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:04:37,795][52567] Avg episode reward: [(0, '17.573')] [2024-08-05 23:04:37,949][52811] DAMAGECOUNT value on done: 21171.0 [2024-08-05 23:04:37,951][52811] Sum rewards: 24.474, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON3': '0.650', 'ARMOR': '0.824', 'weapon3': '1.536', 'HITCOUNT': '1.620', 'weapon2': '1.662', 'DAMAGECOUNT': '6.318', 'FRAGCOUNT': '20.000'} [2024-08-05 23:04:38,291][52668] DAMAGECOUNT value on done: 23618.0 [2024-08-05 23:04:38,291][52668] Sum rewards: 22.564, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.642', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.028', 'AMMO4': '0.028', 'weapon5': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON3': '0.850', 'ARMOR': '0.867', 'weapon2': '1.718', 'HITCOUNT': '1.730', 'weapon3': '1.920', 'DAMAGECOUNT': '6.744', 'FRAGCOUNT': '19.000'} [2024-08-05 23:04:38,837][52647] DAMAGECOUNT value on done: 21965.0 [2024-08-05 23:04:38,837][52647] Sum rewards: 14.891, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'AMMO2': '0.017', 'AMMO5': '0.025', 'AMMO4': '0.084', 'weapon5': '0.098', 'AMMO3': '0.156', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.956', 'WEAPON3': '1.000', 'ARMOR': '1.019', 'HITCOUNT': '1.190', 'weapon3': '2.270', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:39,883][52795] DAMAGECOUNT value on done: 21392.0 [2024-08-05 23:04:39,883][52795] Sum rewards: 10.842, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.905', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'WEAPON3': '0.600', 'ARMOR': '0.851', 'HITCOUNT': '1.080', 'weapon2': '1.598', 'weapon3': '1.744', 'DAMAGECOUNT': '3.723', 'FRAGCOUNT': '8.000'} [2024-08-05 23:04:40,314][52803] DAMAGECOUNT value on done: 18216.0 [2024-08-05 23:04:40,316][52803] Sum rewards: 19.209, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.224', 'WEAPON3': '0.800', 'ARMOR': '0.913', 'weapon2': '1.380', 'HITCOUNT': '1.520', 'weapon3': '2.080', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '16.000'} [2024-08-05 23:04:40,646][52660] DAMAGECOUNT value on done: 17712.0 [2024-08-05 23:04:40,648][52660] Sum rewards: 12.429, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.957', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon5': '0.050', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.424', 'weapon4': '0.518', 'WEAPON3': '0.650', 'HITCOUNT': '1.070', 'weapon2': '1.286', 'weapon3': '1.516', 'DAMAGECOUNT': '3.705', 'FRAGCOUNT': '9.000'} [2024-08-05 23:04:41,210][52811] DAMAGECOUNT value on done: 18541.0 [2024-08-05 23:04:41,211][52811] Sum rewards: 19.225, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.482', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'ARMOR': '0.039', 'weapon5': '0.074', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'weapon4': '0.582', 'weapon2': '0.742', 'HITCOUNT': '1.330', 'weapon3': '1.482', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:41,553][52647] DAMAGECOUNT value on done: 21266.0 [2024-08-05 23:04:41,561][52647] Sum rewards: 14.328, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.847', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO3': '0.077', 'AMMO4': '0.078', 'WEAPON4': '0.250', 'weapon4': '0.364', 'WEAPON3': '0.550', 'ARMOR': '0.985', 'HITCOUNT': '1.040', 'weapon2': '1.404', 'weapon3': '1.480', 'DAMAGECOUNT': '4.176', 'FRAGCOUNT': '10.000'} [2024-08-05 23:04:41,587][52668] DAMAGECOUNT value on done: 22369.0 [2024-08-05 23:04:41,588][52668] Sum rewards: 19.302, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.452', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.093', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.440', 'weapon3': '1.552', 'weapon2': '1.704', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:42,521][52650] Updated weights for policy 0, policy_version 12301 (0.0020) [2024-08-05 23:04:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 17300.4). Total num frames: 100777984. Throughput: 0: 4186.7. Samples: 25200770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:04:42,794][52567] Avg episode reward: [(0, '17.570')] [2024-08-05 23:04:43,177][52795] DAMAGECOUNT value on done: 23071.0 [2024-08-05 23:04:43,178][52795] Sum rewards: 24.441, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.274', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '1.360', 'weapon3': '1.396', 'weapon2': '1.436', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '18.000'} [2024-08-05 23:04:43,402][52803] DAMAGECOUNT value on done: 19539.0 [2024-08-05 23:04:43,402][52803] Sum rewards: 9.644, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.238', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.112', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '0.350', 'ARMOR': '0.412', 'HITCOUNT': '1.010', 'weapon3': '1.126', 'weapon2': '1.190', 'DAMAGECOUNT': '3.780', 'FRAGCOUNT': '7.000'} [2024-08-05 23:04:43,829][52660] DAMAGECOUNT value on done: 22069.0 [2024-08-05 23:04:43,831][52660] Sum rewards: 26.357, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.868', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.194', 'WEAPON3': '0.700', 'ARMOR': '0.872', 'weapon2': '1.324', 'HITCOUNT': '1.690', 'weapon3': '2.014', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '21.000'} [2024-08-05 23:04:44,429][52668] DAMAGECOUNT value on done: 19320.0 [2024-08-05 23:04:44,430][52668] Sum rewards: 21.967, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'HEALTH': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.086', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.692', 'ARMOR': '0.828', 'weapon2': '0.918', 'HITCOUNT': '1.420', 'weapon3': '1.732', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '15.000'} [2024-08-05 23:04:44,571][52811] DAMAGECOUNT value on done: 19665.0 [2024-08-05 23:04:44,573][52811] Sum rewards: 26.782, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.997', 'AMMO2': '0.028', 'AMMO3': '0.073', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.550', 'ARMOR': '0.904', 'weapon2': '1.020', 'weapon3': '1.638', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '20.000'} [2024-08-05 23:04:44,643][52647] DAMAGECOUNT value on done: 20455.0 [2024-08-05 23:04:44,646][52647] Sum rewards: 12.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'ARMOR': '0.497', 'WEAPON3': '0.800', 'HITCOUNT': '1.130', 'weapon3': '1.596', 'weapon2': '1.832', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '11.000'} [2024-08-05 23:04:45,187][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:04:46,570][52795] DAMAGECOUNT value on done: 19930.0 [2024-08-05 23:04:46,579][52795] Sum rewards: 20.639, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.123', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.140', 'WEAPON3': '0.550', 'ARMOR': '1.200', 'HITCOUNT': '1.440', 'weapon3': '1.474', 'weapon2': '1.864', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '15.000'} [2024-08-05 23:04:46,724][52803] DAMAGECOUNT value on done: 20945.0 [2024-08-05 23:04:46,725][52803] Sum rewards: 24.456, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.145', 'AMMO4': '-0.044', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'weapon4': '0.254', 'WEAPON3': '0.800', 'ARMOR': '0.881', 'weapon2': '1.306', 'HITCOUNT': '1.440', 'weapon3': '1.946', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '20.000'} [2024-08-05 23:04:46,812][52660] DAMAGECOUNT value on done: 19870.0 [2024-08-05 23:04:46,814][52660] Sum rewards: 17.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.576', 'AMMO5': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.036', 'AMMO4': '0.057', 'weapon5': '0.060', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.546', 'WEAPON3': '0.800', 'weapon2': '1.116', 'HITCOUNT': '1.550', 'weapon3': '1.978', 'DAMAGECOUNT': '5.928', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:47,224][52647] DAMAGECOUNT value on done: 22858.0 [2024-08-05 23:04:47,225][52647] Sum rewards: 13.787, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.033', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.256', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon2': '1.216', 'ARMOR': '1.331', 'weapon3': '1.534', 'DAMAGECOUNT': '4.158', 'FRAGCOUNT': '9.500'} [2024-08-05 23:04:47,477][52650] Updated weights for policy 0, policy_version 12311 (0.0024) [2024-08-05 23:04:47,722][52668] DAMAGECOUNT value on done: 23273.0 [2024-08-05 23:04:47,723][52668] Sum rewards: 22.547, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.628', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.098', 'AMMO3': '0.140', 'AMMO4': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.376', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'weapon2': '1.034', 'HITCOUNT': '1.300', 'weapon3': '1.998', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '20.000'} [2024-08-05 23:04:47,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.0, 300 sec: 17272.6). Total num frames: 100851712. Throughput: 0: 4187.8. Samples: 25213470. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:04:47,795][52567] Avg episode reward: [(0, '17.703')] [2024-08-05 23:04:47,866][52811] DAMAGECOUNT value on done: 20773.0 [2024-08-05 23:04:47,868][52811] Sum rewards: 24.386, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.673', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.560', 'WEAPON3': '0.700', 'weapon2': '0.930', 'ARMOR': '0.945', 'weapon3': '1.662', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '17.000'} [2024-08-05 23:04:49,802][52795] DAMAGECOUNT value on done: 18180.0 [2024-08-05 23:04:49,805][52795] Sum rewards: 12.514, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.404', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.526', 'WEAPON3': '0.550', 'HITCOUNT': '0.990', 'weapon2': '1.250', 'weapon3': '1.610', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '10.000'} [2024-08-05 23:04:50,013][52803] DAMAGECOUNT value on done: 19318.0 [2024-08-05 23:04:50,013][52803] Sum rewards: 10.637, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.226', 'ARMOR': '0.436', 'WEAPON3': '0.500', 'HITCOUNT': '0.730', 'weapon2': '0.902', 'weapon3': '1.448', 'DAMAGECOUNT': '2.634', 'FRAGCOUNT': '8.000'} [2024-08-05 23:04:50,250][52660] DAMAGECOUNT value on done: 20980.0 [2024-08-05 23:04:50,251][52660] Sum rewards: 16.033, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.347', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'ARMOR': '0.495', 'weapon4': '0.562', 'WEAPON3': '0.700', 'weapon2': '0.810', 'HITCOUNT': '1.170', 'weapon3': '1.976', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:50,379][52647] DAMAGECOUNT value on done: 23823.0 [2024-08-05 23:04:50,382][52647] Sum rewards: 17.081, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.139', 'HEALTH': '0.186', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.246', 'HITCOUNT': '1.400', 'weapon3': '1.988', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:50,975][52668] DAMAGECOUNT value on done: 19742.0 [2024-08-05 23:04:50,978][52668] Sum rewards: 12.100, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.411', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.250', 'weapon4': '0.408', 'WEAPON3': '0.550', 'ARMOR': '0.890', 'HITCOUNT': '1.110', 'weapon3': '1.266', 'weapon2': '1.364', 'DAMAGECOUNT': '3.672', 'FRAGCOUNT': '8.000'} [2024-08-05 23:04:51,072][52811] DAMAGECOUNT value on done: 18948.0 [2024-08-05 23:04:51,074][52811] Sum rewards: 19.266, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.388', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO3': '0.060', 'WEAPON3': '0.500', 'ARMOR': '0.947', 'HITCOUNT': '1.160', 'weapon3': '1.418', 'weapon2': '2.100', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:52,163][52650] Updated weights for policy 0, policy_version 12321 (0.0022) [2024-08-05 23:04:52,795][52567] Fps is (10 sec: 15563.9, 60 sec: 16656.9, 300 sec: 17272.6). Total num frames: 100933632. Throughput: 0: 4193.9. Samples: 25238780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:04:52,795][52567] Avg episode reward: [(0, '17.770')] [2024-08-05 23:04:52,957][52647] DAMAGECOUNT value on done: 22461.0 [2024-08-05 23:04:52,957][52647] Sum rewards: 21.595, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.760', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.236', 'ARMOR': '0.439', 'WEAPON3': '0.800', 'weapon2': '1.208', 'HITCOUNT': '1.700', 'weapon3': '1.892', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '18.000'} [2024-08-05 23:04:53,244][52795] DAMAGECOUNT value on done: 21054.0 [2024-08-05 23:04:53,245][52795] Sum rewards: 12.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.970', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.120', 'AMMO4': '0.180', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'weapon4': '0.388', 'WEAPON4': '0.500', 'weapon2': '0.816', 'WEAPON3': '1.300', 'ARMOR': '1.367', 'HITCOUNT': '1.480', 'weapon3': '2.336', 'DAMAGECOUNT': '5.397', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:53,328][52660] DAMAGECOUNT value on done: 21126.0 [2024-08-05 23:04:53,330][52660] Sum rewards: 21.176, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.984', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.212', 'ARMOR': '0.445', 'weapon4': '0.598', 'WEAPON4': '0.600', 'weapon2': '0.778', 'WEAPON3': '0.900', 'HITCOUNT': '1.420', 'weapon3': '1.974', 'DAMAGECOUNT': '4.944', 'FRAGCOUNT': '20.000'} [2024-08-05 23:04:54,204][52668] DAMAGECOUNT value on done: 20332.0 [2024-08-05 23:04:54,205][52668] Sum rewards: 13.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.477', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.031', 'AMMO3': '0.115', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '1.260', 'weapon2': '1.422', 'ARMOR': '1.729', 'weapon3': '2.088', 'DAMAGECOUNT': '4.368', 'FRAGCOUNT': '12.000'} [2024-08-05 23:04:54,306][52811] DAMAGECOUNT value on done: 18842.0 [2024-08-05 23:04:54,308][52811] Sum rewards: 16.214, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.256', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.077', 'weapon5': '0.100', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'WEAPON3': '0.500', 'weapon4': '0.654', 'weapon2': '0.746', 'HITCOUNT': '1.080', 'weapon3': '1.436', 'DAMAGECOUNT': '3.549', 'FRAGCOUNT': '12.500'} [2024-08-05 23:04:55,922][52660] DAMAGECOUNT value on done: 21071.0 [2024-08-05 23:04:55,924][52660] Sum rewards: 18.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.740', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.116', 'WEAPON4': '0.250', 'weapon4': '0.410', 'WEAPON3': '0.700', 'weapon2': '1.022', 'HITCOUNT': '1.290', 'weapon3': '1.924', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '16.000'} [2024-08-05 23:04:55,968][52647] DAMAGECOUNT value on done: 22337.0 [2024-08-05 23:04:55,970][52647] Sum rewards: 17.944, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.099', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'ARMOR': '0.036', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON3': '0.650', 'weapon2': '1.246', 'HITCOUNT': '1.320', 'weapon3': '1.706', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '14.000'} [2024-08-05 23:04:56,607][52668] DAMAGECOUNT value on done: 20470.0 [2024-08-05 23:04:56,608][52668] Sum rewards: 19.798, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.156', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO2': '0.037', 'AMMO3': '0.100', 'AMMO4': '0.183', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.440', 'weapon3': '1.610', 'ARMOR': '1.684', 'weapon2': '1.756', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '16.000'} [2024-08-05 23:04:56,732][52795] DAMAGECOUNT value on done: 19216.0 [2024-08-05 23:04:56,733][52795] Sum rewards: 17.024, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.107', 'HEALTH': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON3': '0.600', 'ARMOR': '0.849', 'HITCOUNT': '1.340', 'weapon2': '1.490', 'weapon3': '2.032', 'DAMAGECOUNT': '4.545', 'FRAGCOUNT': '13.000'} [2024-08-05 23:04:56,949][52650] Updated weights for policy 0, policy_version 12331 (0.0012) [2024-08-05 23:04:57,794][52567] Fps is (10 sec: 16384.6, 60 sec: 16657.1, 300 sec: 17217.1). Total num frames: 101015552. Throughput: 0: 4186.7. Samples: 25263820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:04:57,794][52567] Avg episode reward: [(0, '17.890')] [2024-08-05 23:04:58,115][52660] DAMAGECOUNT value on done: 21704.0 [2024-08-05 23:04:58,115][52660] Sum rewards: 25.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.086', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.096', 'weapon4': '0.144', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon2': '1.146', 'HITCOUNT': '1.910', 'weapon3': '2.360', 'DAMAGECOUNT': '7.602', 'FRAGCOUNT': '22.000'} [2024-08-05 23:04:58,684][52668] DAMAGECOUNT value on done: 20531.0 [2024-08-05 23:04:58,685][52668] Sum rewards: 21.159, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.584', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.750', 'weapon2': '1.400', 'weapon3': '1.438', 'HITCOUNT': '1.440', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '17.000'} [2024-08-05 23:04:59,005][52647] DAMAGECOUNT value on done: 19449.0 [2024-08-05 23:04:59,005][52647] Sum rewards: 28.688, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.029', 'HEALTH': '0.116', 'AMMO3': '0.132', 'weapon5': '0.132', 'weapon4': '0.136', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'weapon2': '1.272', 'ARMOR': '1.640', 'HITCOUNT': '1.900', 'weapon3': '2.046', 'DAMAGECOUNT': '6.783', 'FRAGCOUNT': '23.000'} [2024-08-05 23:05:00,244][52795] DAMAGECOUNT value on done: 19458.0 [2024-08-05 23:05:00,247][52795] Sum rewards: 10.622, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO3': '0.155', 'AMMO4': '0.160', 'WEAPON4': '0.450', 'ARMOR': '0.515', 'WEAPON3': '1.100', 'HITCOUNT': '1.390', 'weapon2': '1.482', 'weapon3': '2.012', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:00,639][52660] DAMAGECOUNT value on done: 21008.0 [2024-08-05 23:05:00,641][52660] Sum rewards: 15.941, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.870', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'HITCOUNT': '1.550', 'weapon3': '1.696', 'weapon2': '1.754', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:01,167][52668] DAMAGECOUNT value on done: 19412.0 [2024-08-05 23:05:01,169][52668] Sum rewards: 15.731, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.457', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.012', 'weapon5': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'ARMOR': '1.308', 'weapon2': '1.676', 'weapon3': '1.778', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:01,739][52647] DAMAGECOUNT value on done: 20525.0 [2024-08-05 23:05:01,739][52647] Sum rewards: 14.929, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.372', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'AMMO3': '0.091', 'weapon5': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON5': '0.250', 'ARMOR': '0.458', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'weapon2': '1.436', 'weapon3': '1.478', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:02,300][52650] Updated weights for policy 0, policy_version 12341 (0.0029) [2024-08-05 23:05:02,794][52567] Fps is (10 sec: 17204.2, 60 sec: 16793.6, 300 sec: 17217.1). Total num frames: 101105664. Throughput: 0: 4168.9. Samples: 25275910. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:05:02,802][52567] Avg episode reward: [(0, '17.923')] [2024-08-05 23:05:03,486][52660] DAMAGECOUNT value on done: 20864.0 [2024-08-05 23:05:03,487][52660] Sum rewards: 21.445, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.860', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.024', 'ARMOR': '0.064', 'AMMO4': '0.118', 'AMMO3': '0.132', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.326', 'HITCOUNT': '1.690', 'weapon3': '2.058', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:03,651][52795] DAMAGECOUNT value on done: 22099.0 [2024-08-05 23:05:03,653][52795] Sum rewards: 19.437, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO4': '0.029', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'WEAPON3': '1.100', 'weapon2': '1.334', 'HITCOUNT': '1.790', 'weapon3': '2.320', 'DAMAGECOUNT': '6.663', 'FRAGCOUNT': '19.000'} [2024-08-05 23:05:03,919][52668] DAMAGECOUNT value on done: 19679.0 [2024-08-05 23:05:03,920][52668] Sum rewards: 13.449, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.216', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'WEAPON3': '0.800', 'ARMOR': '1.079', 'HITCOUNT': '1.200', 'weapon3': '1.590', 'weapon2': '1.866', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:04,582][52647] DAMAGECOUNT value on done: 21066.0 [2024-08-05 23:05:04,582][52647] Sum rewards: 14.152, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.030', 'AMMO3': '0.114', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.995', 'weapon2': '1.036', 'HITCOUNT': '1.300', 'weapon3': '1.848', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:06,118][52660] DAMAGECOUNT value on done: 20606.0 [2024-08-05 23:05:06,119][52660] Sum rewards: 19.797, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.458', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.034', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.820', 'HITCOUNT': '1.400', 'weapon2': '1.494', 'weapon3': '1.700', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '17.000'} [2024-08-05 23:05:06,705][52668] DAMAGECOUNT value on done: 19527.0 [2024-08-05 23:05:06,707][52668] Sum rewards: 17.041, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.215', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'ARMOR': '0.020', 'weapon5': '0.058', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.422', 'WEAPON3': '0.650', 'weapon2': '1.040', 'HITCOUNT': '1.270', 'weapon3': '1.398', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '14.000'} [2024-08-05 23:05:06,877][52650] Updated weights for policy 0, policy_version 12351 (0.0013) [2024-08-05 23:05:07,035][52795] DAMAGECOUNT value on done: 19975.0 [2024-08-05 23:05:07,037][52795] Sum rewards: 15.470, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.333', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon7': '0.054', 'AMMO3': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.398', 'weapon2': '0.712', 'WEAPON3': '0.750', 'ARMOR': '0.860', 'HITCOUNT': '1.260', 'weapon3': '1.736', 'DAMAGECOUNT': '4.308', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 17217.1). Total num frames: 101187584. Throughput: 0: 4166.9. Samples: 25300990. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:05:07,802][52567] Avg episode reward: [(0, '18.068')] [2024-08-05 23:05:07,799][52647] DAMAGECOUNT value on done: 23740.0 [2024-08-05 23:05:07,803][52647] Sum rewards: 12.644, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.041', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'weapon5': '0.194', 'AMMO4': '0.207', 'weapon4': '0.358', 'WEAPON4': '0.400', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'weapon2': '0.850', 'HITCOUNT': '1.150', 'weapon3': '1.584', 'DAMAGECOUNT': '4.206', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:08,640][52660] DAMAGECOUNT value on done: 22259.0 [2024-08-05 23:05:08,641][52660] Sum rewards: 19.114, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.014', 'WEAPON4': '0.050', 'HEALTH': '0.062', 'AMMO4': '0.068', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.900', 'HITCOUNT': '1.460', 'weapon3': '1.724', 'weapon2': '1.808', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:09,355][52668] DAMAGECOUNT value on done: 21020.0 [2024-08-05 23:05:09,355][52668] Sum rewards: 22.467, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.096', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.050', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'ARMOR': '0.451', 'WEAPON3': '0.550', 'HITCOUNT': '1.280', 'weapon3': '1.540', 'weapon2': '2.026', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '17.000'} [2024-08-05 23:05:10,404][52795] DAMAGECOUNT value on done: 19331.0 [2024-08-05 23:05:10,404][52795] Sum rewards: 22.008, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.316', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO3': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.454', 'WEAPON3': '0.650', 'weapon2': '1.304', 'weapon3': '1.548', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '6.018', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:10,683][52647] DAMAGECOUNT value on done: 19295.0 [2024-08-05 23:05:10,683][52647] Sum rewards: 18.438, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO3': '0.109', 'WEAPON3': '0.800', 'ARMOR': '0.916', 'HITCOUNT': '1.400', 'weapon2': '1.700', 'weapon3': '1.914', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:11,362][52660] DAMAGECOUNT value on done: 21226.0 [2024-08-05 23:05:11,363][52660] Sum rewards: 18.384, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.030', 'ARMOR': '0.032', 'AMMO4': '0.064', 'AMMO3': '0.095', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'weapon2': '1.342', 'HITCOUNT': '1.390', 'weapon3': '1.520', 'DAMAGECOUNT': '5.571', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:11,789][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:05:11,941][52668] DAMAGECOUNT value on done: 21188.0 [2024-08-05 23:05:11,941][52668] Sum rewards: 10.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.039', 'weapon5': '0.084', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.900', 'HITCOUNT': '0.920', 'weapon2': '1.276', 'weapon3': '1.844', 'DAMAGECOUNT': '3.174', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:12,324][52650] Updated weights for policy 0, policy_version 12361 (0.0013) [2024-08-05 23:05:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 17217.1). Total num frames: 101277696. Throughput: 0: 4162.2. Samples: 25326050. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-05 23:05:12,794][52567] Avg episode reward: [(0, '18.062')] [2024-08-05 23:05:13,261][52647] DAMAGECOUNT value on done: 22998.0 [2024-08-05 23:05:13,262][52647] Sum rewards: -0.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.262', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.128', 'AMMO4': '0.157', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.400', 'ARMOR': '0.461', 'WEAPON3': '0.750', 'HITCOUNT': '0.760', 'weapon2': '1.280', 'weapon3': '1.496', 'DAMAGECOUNT': '2.280', 'FRAGCOUNT': '4.000'} [2024-08-05 23:05:13,770][52795] DAMAGECOUNT value on done: 20568.0 [2024-08-05 23:05:13,772][52795] Sum rewards: 21.610, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.006', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.228', 'ARMOR': '0.409', 'WEAPON3': '0.600', 'weapon2': '1.366', 'HITCOUNT': '1.380', 'weapon3': '1.842', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:14,449][52660] DAMAGECOUNT value on done: 22588.0 [2024-08-05 23:05:14,452][52660] Sum rewards: 15.564, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.426', 'weapon4': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO4': '0.020', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.947', 'HITCOUNT': '1.210', 'weapon2': '1.406', 'weapon3': '1.636', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:15,273][52668] DAMAGECOUNT value on done: 22202.0 [2024-08-05 23:05:15,274][52668] Sum rewards: 12.658, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.173', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.061', 'weapon5': '0.144', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'ARMOR': '0.513', 'weapon4': '0.516', 'weapon2': '0.776', 'HITCOUNT': '1.060', 'weapon3': '1.456', 'DAMAGECOUNT': '4.395', 'FRAGCOUNT': '9.500'} [2024-08-05 23:05:15,829][52666] DAMAGECOUNT value on done: 20435.0 [2024-08-05 23:05:15,831][52666] Sum rewards: 16.936, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO3': '0.089', 'HEALTH': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.112', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon2': '1.078', 'HITCOUNT': '1.160', 'weapon3': '1.674', 'DAMAGECOUNT': '3.789', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:16,417][52647] DAMAGECOUNT value on done: 21198.0 [2024-08-05 23:05:16,418][52647] Sum rewards: 15.991, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.730', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.446', 'WEAPON3': '0.600', 'weapon2': '0.676', 'ARMOR': '0.960', 'HITCOUNT': '1.140', 'weapon3': '1.526', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:16,744][52650] Updated weights for policy 0, policy_version 12371 (0.0029) [2024-08-05 23:05:17,152][52795] DAMAGECOUNT value on done: 21149.0 [2024-08-05 23:05:17,154][52795] Sum rewards: 24.702, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.985', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.296', 'ARMOR': '0.472', 'WEAPON3': '0.700', 'weapon2': '1.226', 'HITCOUNT': '1.630', 'weapon3': '1.740', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '20.000'} [2024-08-05 23:05:17,219][52660] DAMAGECOUNT value on done: 20333.0 [2024-08-05 23:05:17,219][52660] Sum rewards: 23.994, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.087', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.036', 'weapon5': '0.044', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.282', 'WEAPON3': '0.550', 'weapon3': '1.436', 'HITCOUNT': '1.450', 'weapon2': '1.486', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 17161.5). Total num frames: 101351424. Throughput: 0: 4170.7. Samples: 25338510. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-05 23:05:17,802][52567] Avg episode reward: [(0, '17.998')] [2024-08-05 23:05:19,028][52647] DAMAGECOUNT value on done: 21856.0 [2024-08-05 23:05:19,028][52647] Sum rewards: 9.300, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.132', 'WEAPON3': '0.650', 'HITCOUNT': '0.930', 'weapon3': '1.602', 'weapon2': '1.656', 'ARMOR': '1.741', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '7.000'} [2024-08-05 23:05:19,238][52666] DAMAGECOUNT value on done: 19991.0 [2024-08-05 23:05:19,238][52666] Sum rewards: 19.396, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.808', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.036', 'weapon4': '0.092', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'weapon2': '1.344', 'HITCOUNT': '1.460', 'weapon3': '2.154', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:19,921][52670] DAMAGECOUNT value on done: 20988.0 [2024-08-05 23:05:19,922][52670] Sum rewards: 24.886, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.758', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO3': '0.109', 'WEAPON3': '0.750', 'ARMOR': '0.860', 'weapon2': '1.298', 'HITCOUNT': '1.490', 'weapon3': '2.172', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '20.000'} [2024-08-05 23:05:19,953][52669] DAMAGECOUNT value on done: 21041.0 [2024-08-05 23:05:19,953][52669] Sum rewards: 14.556, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.417', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.038', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'HITCOUNT': '1.110', 'ARMOR': '1.273', 'weapon3': '1.410', 'weapon2': '1.550', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:20,288][52660] DAMAGECOUNT value on done: 22057.0 [2024-08-05 23:05:20,288][52660] Sum rewards: 19.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.297', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.112', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'ARMOR': '0.424', 'WEAPON3': '1.000', 'weapon2': '1.548', 'HITCOUNT': '1.720', 'weapon3': '1.942', 'DAMAGECOUNT': '6.576', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:20,418][52795] DAMAGECOUNT value on done: 19598.0 [2024-08-05 23:05:20,419][52795] Sum rewards: 11.244, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.956', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.020', 'AMMO3': '0.067', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '1.070', 'weapon3': '1.244', 'weapon2': '1.714', 'ARMOR': '1.737', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '8.000'} [2024-08-05 23:05:21,875][52650] Updated weights for policy 0, policy_version 12381 (0.0019) [2024-08-05 23:05:22,256][52647] DAMAGECOUNT value on done: 22394.0 [2024-08-05 23:05:22,256][52647] Sum rewards: 16.090, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.282', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.027', 'weapon5': '0.040', 'AMMO3': '0.115', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon2': '1.430', 'weapon3': '1.856', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '12.500'} [2024-08-05 23:05:22,444][52666] DAMAGECOUNT value on done: 20605.0 [2024-08-05 23:05:22,446][52666] Sum rewards: 19.176, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.892', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'weapon4': '0.102', 'AMMO3': '0.119', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'ARMOR': '1.353', 'weapon3': '1.586', 'weapon2': '1.856', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:22,773][52660] DAMAGECOUNT value on done: 20777.0 [2024-08-05 23:05:22,774][52660] Sum rewards: 24.058, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.062', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'weapon4': '0.220', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'HEALTH': '0.481', 'weapon2': '1.314', 'weapon3': '1.640', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 17161.5). Total num frames: 101441536. Throughput: 0: 4171.1. Samples: 25363640. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:05:22,794][52567] Avg episode reward: [(0, '17.733')] [2024-08-05 23:05:23,127][52670] DAMAGECOUNT value on done: 21445.0 [2024-08-05 23:05:23,127][52670] Sum rewards: 29.714, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.754', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.099', 'weapon4': '0.110', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.860', 'weapon2': '1.482', 'HITCOUNT': '1.800', 'weapon3': '1.970', 'DAMAGECOUNT': '6.843', 'FRAGCOUNT': '22.000'} [2024-08-05 23:05:23,272][52669] DAMAGECOUNT value on done: 21067.0 [2024-08-05 23:05:23,272][52669] Sum rewards: 15.829, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.200', 'AMMO4': '-0.073', 'AMMO2': '-0.015', 'AMMO5': '0.005', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.128', 'WEAPON3': '0.700', 'ARMOR': '0.851', 'HITCOUNT': '1.120', 'weapon3': '1.356', 'weapon2': '1.636', 'DAMAGECOUNT': '4.125', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:23,598][52795] DAMAGECOUNT value on done: 19887.0 [2024-08-05 23:05:23,602][52795] Sum rewards: 17.032, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.815', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO5': '0.022', 'AMMO4': '0.067', 'ARMOR': '0.080', 'AMMO3': '0.112', 'weapon5': '0.160', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.612', 'weapon2': '0.802', 'WEAPON3': '0.850', 'HITCOUNT': '1.370', 'weapon3': '1.714', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '13.500'} [2024-08-05 23:05:25,601][52614] Signal inference workers to stop experience collection... (2300 times) [2024-08-05 23:05:25,601][52614] Signal inference workers to resume experience collection... (2300 times) [2024-08-05 23:05:25,658][52650] InferenceWorker_p0-w0: stopping experience collection (2300 times) [2024-08-05 23:05:25,659][52650] InferenceWorker_p0-w0: resuming experience collection (2300 times) [2024-08-05 23:05:25,950][52666] DAMAGECOUNT value on done: 19817.0 [2024-08-05 23:05:25,952][52666] Sum rewards: 16.356, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.097', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.494', 'WEAPON3': '0.700', 'HITCOUNT': '1.220', 'weapon2': '1.528', 'weapon3': '1.934', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '14.000'} [2024-08-05 23:05:26,429][52665] DAMAGECOUNT value on done: 19767.0 [2024-08-05 23:05:26,429][52665] Sum rewards: 14.416, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.435', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.097', 'weapon4': '0.154', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.903', 'HITCOUNT': '1.310', 'weapon3': '1.542', 'weapon2': '1.764', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '9.500'} [2024-08-05 23:05:26,629][52670] DAMAGECOUNT value on done: 20097.0 [2024-08-05 23:05:26,631][52670] Sum rewards: 26.326, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon5': '0.068', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'HEALTH': '0.313', 'weapon4': '0.548', 'WEAPON3': '0.800', 'weapon2': '1.004', 'ARMOR': '1.333', 'HITCOUNT': '1.890', 'weapon3': '1.912', 'DAMAGECOUNT': '6.765', 'FRAGCOUNT': '21.000'} [2024-08-05 23:05:26,643][52669] DAMAGECOUNT value on done: 21430.0 [2024-08-05 23:05:26,643][52669] Sum rewards: 15.428, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO5': '0.011', 'AMMO2': '0.028', 'ARMOR': '0.052', 'AMMO3': '0.117', 'AMMO4': '0.138', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.750', 'weapon2': '1.412', 'HITCOUNT': '1.440', 'weapon3': '1.562', 'DAMAGECOUNT': '5.319', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:26,665][52650] Updated weights for policy 0, policy_version 12391 (0.0014) [2024-08-05 23:05:26,931][52795] DAMAGECOUNT value on done: 20132.0 [2024-08-05 23:05:26,933][52795] Sum rewards: 13.599, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.186', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.020', 'weapon4': '0.078', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.900', 'HITCOUNT': '1.220', 'ARMOR': '1.380', 'weapon3': '1.800', 'weapon2': '1.864', 'DAMAGECOUNT': '4.578', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16520.6, 300 sec: 17106.0). Total num frames: 101515264. Throughput: 0: 4184.9. Samples: 25389090. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:05:27,795][52567] Avg episode reward: [(0, '17.800')] [2024-08-05 23:05:29,330][52666] DAMAGECOUNT value on done: 20129.0 [2024-08-05 23:05:29,331][52666] Sum rewards: 20.706, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.114', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.069', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.160', 'WEAPON3': '0.450', 'ARMOR': '0.533', 'HITCOUNT': '0.980', 'weapon3': '1.270', 'weapon2': '1.824', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:29,535][52665] DAMAGECOUNT value on done: 20569.0 [2024-08-05 23:05:29,537][52665] Sum rewards: 16.838, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.456', 'weapon4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'ARMOR': '0.514', 'WEAPON3': '0.700', 'HITCOUNT': '1.170', 'weapon2': '1.414', 'weapon3': '1.742', 'DAMAGECOUNT': '4.188', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:29,743][52669] DAMAGECOUNT value on done: 22046.0 [2024-08-05 23:05:29,743][52669] Sum rewards: 13.393, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.168', 'weapon5': '0.170', 'WEAPON3': '0.350', 'ARMOR': '0.412', 'HEALTH': '0.534', 'HITCOUNT': '0.850', 'weapon3': '1.294', 'weapon2': '1.456', 'DAMAGECOUNT': '2.943', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:30,084][52670] DAMAGECOUNT value on done: 22097.0 [2024-08-05 23:05:30,085][52670] Sum rewards: 16.743, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.346', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.372', 'ARMOR': '0.438', 'WEAPON3': '0.700', 'HITCOUNT': '1.340', 'weapon2': '1.414', 'weapon3': '1.720', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:31,523][52650] Updated weights for policy 0, policy_version 12401 (0.0018) [2024-08-05 23:05:31,949][52665] DAMAGECOUNT value on done: 21661.0 [2024-08-05 23:05:31,949][52665] Sum rewards: 24.354, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.110', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'weapon2': '1.410', 'HITCOUNT': '1.670', 'weapon3': '1.754', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:32,549][52669] DAMAGECOUNT value on done: 22284.0 [2024-08-05 23:05:32,551][52669] Sum rewards: 14.224, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.186', 'AMMO4': '-0.107', 'AMMO2': '-0.021', 'AMMO3': '0.062', 'WEAPON3': '0.550', 'ARMOR': '0.913', 'HITCOUNT': '1.130', 'weapon3': '1.330', 'weapon2': '1.676', 'DAMAGECOUNT': '3.627', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:32,782][52666] DAMAGECOUNT value on done: 19025.0 [2024-08-05 23:05:32,783][52666] Sum rewards: 21.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.120', 'AMMO3': '0.130', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.484', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon2': '1.576', 'weapon3': '1.890', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '19.000'} [2024-08-05 23:05:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 17189.3). Total num frames: 101613568. Throughput: 0: 4180.5. Samples: 25401590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:05:32,794][52567] Avg episode reward: [(0, '17.629')] [2024-08-05 23:05:33,410][52670] DAMAGECOUNT value on done: 19385.0 [2024-08-05 23:05:33,413][52670] Sum rewards: 16.968, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.916', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO3': '0.086', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'ARMOR': '1.247', 'weapon3': '1.566', 'weapon2': '1.624', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:35,346][52665] DAMAGECOUNT value on done: 21863.0 [2024-08-05 23:05:35,347][52665] Sum rewards: 10.327, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.733', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.091', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.944', 'HITCOUNT': '1.120', 'weapon2': '1.408', 'weapon3': '1.544', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '8.000'} [2024-08-05 23:05:35,970][52669] DAMAGECOUNT value on done: 22520.0 [2024-08-05 23:05:35,970][52669] Sum rewards: 22.280, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.262', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.320', 'HITCOUNT': '1.740', 'weapon3': '2.012', 'DAMAGECOUNT': '6.312', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:36,170][52666] DAMAGECOUNT value on done: 20774.0 [2024-08-05 23:05:36,172][52666] Sum rewards: 17.456, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.448', 'AMMO2': '0.031', 'AMMO3': '0.127', 'AMMO4': '0.154', 'WEAPON4': '0.350', 'weapon4': '0.422', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.250', 'HITCOUNT': '1.270', 'weapon3': '1.790', 'DAMAGECOUNT': '4.470', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:36,284][52650] Updated weights for policy 0, policy_version 12411 (0.0031) [2024-08-05 23:05:36,911][52670] DAMAGECOUNT value on done: 22105.0 [2024-08-05 23:05:36,914][52670] Sum rewards: 13.086, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'weapon4': '0.214', 'ARMOR': '0.412', 'WEAPON3': '0.450', 'HEALTH': '0.616', 'HITCOUNT': '1.150', 'weapon2': '1.296', 'weapon3': '2.006', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '8.000'} [2024-08-05 23:05:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16657.1, 300 sec: 17106.0). Total num frames: 101687296. Throughput: 0: 4178.9. Samples: 25426830. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:05:37,802][52567] Avg episode reward: [(0, '17.729')] [2024-08-05 23:05:38,275][52665] DAMAGECOUNT value on done: 19961.0 [2024-08-05 23:05:38,275][52665] Sum rewards: 19.359, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.456', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.440', 'weapon2': '1.654', 'weapon3': '1.982', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:39,015][52669] DAMAGECOUNT value on done: 23132.0 [2024-08-05 23:05:39,017][52669] Sum rewards: 23.241, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.015', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.058', 'AMMO3': '0.085', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'weapon4': '0.730', 'weapon2': '1.342', 'weapon3': '1.596', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:39,424][52666] DAMAGECOUNT value on done: 20463.0 [2024-08-05 23:05:39,425][52666] Sum rewards: 14.224, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO2': '0.029', 'weapon4': '0.050', 'AMMO3': '0.136', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon2': '1.538', 'weapon3': '2.080', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:40,021][52670] DAMAGECOUNT value on done: 19212.0 [2024-08-05 23:05:40,021][52670] Sum rewards: 15.532, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.534', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.066', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '1.160', 'weapon3': '1.330', 'weapon2': '1.340', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:41,203][52650] Updated weights for policy 0, policy_version 12421 (0.0018) [2024-08-05 23:05:41,585][52665] DAMAGECOUNT value on done: 20697.0 [2024-08-05 23:05:41,586][52665] Sum rewards: 15.299, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon5': '0.078', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.138', 'weapon4': '0.254', 'WEAPON3': '0.600', 'ARMOR': '0.891', 'HITCOUNT': '1.120', 'weapon2': '1.396', 'weapon3': '1.624', 'DAMAGECOUNT': '3.864', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:41,733][52669] DAMAGECOUNT value on done: 20517.0 [2024-08-05 23:05:41,733][52669] Sum rewards: 15.139, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.034', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'ARMOR': '0.447', 'WEAPON3': '0.650', 'weapon2': '1.106', 'HITCOUNT': '1.170', 'weapon3': '1.802', 'DAMAGECOUNT': '4.347', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:42,563][52666] DAMAGECOUNT value on done: 21259.0 [2024-08-05 23:05:42,567][52666] Sum rewards: 13.962, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'ARMOR': '0.481', 'WEAPON3': '0.900', 'weapon2': '1.262', 'HITCOUNT': '1.380', 'weapon3': '2.120', 'DAMAGECOUNT': '5.169', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 17106.0). Total num frames: 101777408. Throughput: 0: 4186.2. Samples: 25452200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:05:42,794][52567] Avg episode reward: [(0, '17.636')] [2024-08-05 23:05:43,224][52820] DAMAGECOUNT value on done: 17672.0 [2024-08-05 23:05:43,224][52820] Sum rewards: 21.825, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.575', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.258', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.316', 'HITCOUNT': '1.650', 'weapon3': '1.710', 'DAMAGECOUNT': '5.661', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:43,235][52670] DAMAGECOUNT value on done: 19527.0 [2024-08-05 23:05:43,235][52670] Sum rewards: 21.631, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.397', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.213', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon4': '0.650', 'weapon2': '1.010', 'ARMOR': '1.309', 'HITCOUNT': '1.790', 'weapon3': '1.866', 'DAMAGECOUNT': '5.985', 'FRAGCOUNT': '17.000'} [2024-08-05 23:05:43,772][52794] DAMAGECOUNT value on done: 24576.0 [2024-08-05 23:05:43,773][52794] Sum rewards: 19.725, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.150', 'weapon4': '0.208', 'WEAPON3': '0.650', 'weapon2': '1.392', 'HITCOUNT': '1.580', 'weapon3': '1.948', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '14.000'} [2024-08-05 23:05:44,408][52665] DAMAGECOUNT value on done: 21578.0 [2024-08-05 23:05:44,408][52665] Sum rewards: 12.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.814', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.099', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.480', 'weapon4': '0.548', 'weapon2': '0.698', 'WEAPON3': '0.850', 'HITCOUNT': '0.980', 'weapon3': '1.620', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:44,462][52669] DAMAGECOUNT value on done: 20050.0 [2024-08-05 23:05:44,464][52669] Sum rewards: 13.192, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.364', 'AMMO5': '0.003', 'AMMO2': '0.025', 'AMMO3': '0.085', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.490', 'WEAPON3': '0.550', 'weapon2': '0.778', 'ARMOR': '0.850', 'HITCOUNT': '0.920', 'weapon3': '1.418', 'DAMAGECOUNT': '3.561', 'FRAGCOUNT': '9.000'} [2024-08-05 23:05:45,413][52666] DAMAGECOUNT value on done: 19924.0 [2024-08-05 23:05:45,414][52666] Sum rewards: 20.192, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.573', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO4': '0.043', 'AMMO3': '0.065', 'weapon5': '0.086', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.418', 'WEAPON3': '0.500', 'weapon2': '1.108', 'HITCOUNT': '1.290', 'weapon3': '1.334', 'DAMAGECOUNT': '4.374', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:45,893][52650] Updated weights for policy 0, policy_version 12431 (0.0016) [2024-08-05 23:05:45,944][52670] DAMAGECOUNT value on done: 18585.0 [2024-08-05 23:05:45,945][52670] Sum rewards: 15.619, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.240', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO3': '0.087', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.440', 'WEAPON3': '0.650', 'weapon2': '0.844', 'HITCOUNT': '1.080', 'weapon3': '1.244', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:46,977][52820] DAMAGECOUNT value on done: 19423.0 [2024-08-05 23:05:46,977][52820] Sum rewards: 10.450, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.328', 'ARMOR': '0.424', 'WEAPON3': '0.950', 'weapon2': '1.024', 'HITCOUNT': '1.110', 'weapon3': '1.698', 'DAMAGECOUNT': '3.492', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:47,217][52794] DAMAGECOUNT value on done: 25832.0 [2024-08-05 23:05:47,220][52794] Sum rewards: 19.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.752', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.154', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.424', 'HITCOUNT': '1.590', 'weapon3': '1.754', 'DAMAGECOUNT': '5.628', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:47,295][52669] DAMAGECOUNT value on done: 20698.0 [2024-08-05 23:05:47,295][52669] Sum rewards: 20.922, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.564', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.125', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.446', 'WEAPON3': '0.850', 'HITCOUNT': '1.520', 'weapon3': '1.540', 'weapon2': '1.728', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:47,763][52662] DAMAGECOUNT value on done: 24863.0 [2024-08-05 23:05:47,765][52662] Sum rewards: 15.370, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.810', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'ARMOR': '0.032', 'weapon7': '0.048', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'weapon5': '0.126', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon3': '1.288', 'weapon2': '1.308', 'DAMAGECOUNT': '4.668', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 17106.0). Total num frames: 101859328. Throughput: 0: 4195.6. Samples: 25464710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:05:47,802][52567] Avg episode reward: [(0, '17.617')] [2024-08-05 23:05:47,937][52665] DAMAGECOUNT value on done: 21684.0 [2024-08-05 23:05:47,938][52665] Sum rewards: 17.424, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.634', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.094', 'AMMO3': '0.116', 'WEAPON4': '0.250', 'weapon4': '0.506', 'WEAPON3': '0.750', 'weapon2': '0.824', 'HITCOUNT': '1.640', 'weapon3': '2.076', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:48,573][52666] DAMAGECOUNT value on done: 17368.0 [2024-08-05 23:05:48,575][52666] Sum rewards: 15.459, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.411', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.400', 'WEAPON3': '0.400', 'HITCOUNT': '1.000', 'weapon3': '1.148', 'weapon2': '1.562', 'DAMAGECOUNT': '3.237', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:49,314][52670] DAMAGECOUNT value on done: 17965.0 [2024-08-05 23:05:49,316][52670] Sum rewards: 18.200, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.764', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.288', 'WEAPON3': '0.600', 'HITCOUNT': '0.830', 'ARMOR': '0.955', 'weapon3': '1.376', 'weapon2': '1.676', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '14.000'} [2024-08-05 23:05:49,808][52794] DAMAGECOUNT value on done: 25418.0 [2024-08-05 23:05:49,810][52794] Sum rewards: 15.143, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.434', 'weapon4': '0.014', 'AMMO2': '0.015', 'AMMO3': '0.063', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON3': '0.450', 'ARMOR': '0.886', 'HITCOUNT': '0.980', 'weapon3': '1.418', 'weapon2': '2.036', 'DAMAGECOUNT': '3.288', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:50,289][52820] DAMAGECOUNT value on done: 18461.0 [2024-08-05 23:05:50,290][52820] Sum rewards: 15.080, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.100', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.082', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.650', 'ARMOR': '0.910', 'HITCOUNT': '1.090', 'weapon2': '1.220', 'weapon3': '1.250', 'DAMAGECOUNT': '4.338', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:50,446][52662] DAMAGECOUNT value on done: 26151.0 [2024-08-05 23:05:50,446][52662] Sum rewards: 15.450, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.995', 'AMMO4': '-0.060', 'AMMO2': '-0.012', 'AMMO3': '0.050', 'WEAPON3': '0.450', 'HITCOUNT': '1.050', 'weapon3': '1.194', 'ARMOR': '1.375', 'weapon2': '2.046', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:50,655][52669] DAMAGECOUNT value on done: 21848.0 [2024-08-05 23:05:50,655][52669] Sum rewards: 26.382, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.617', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.086', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.416', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.232', 'weapon3': '1.650', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '20.000'} [2024-08-05 23:05:50,781][52650] Updated weights for policy 0, policy_version 12441 (0.0051) [2024-08-05 23:05:51,270][52665] DAMAGECOUNT value on done: 22859.0 [2024-08-05 23:05:51,272][52665] Sum rewards: 14.846, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.767', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'ARMOR': '1.200', 'weapon3': '1.486', 'weapon2': '1.840', 'DAMAGECOUNT': '3.486', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:51,801][52666] DAMAGECOUNT value on done: 19110.0 [2024-08-05 23:05:51,803][52666] Sum rewards: 25.252, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.996', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'weapon4': '0.044', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.949', 'weapon3': '1.520', 'HITCOUNT': '1.750', 'weapon2': '2.008', 'DAMAGECOUNT': '6.147', 'FRAGCOUNT': '19.000'} [2024-08-05 23:05:52,457][52670] DAMAGECOUNT value on done: 20995.0 [2024-08-05 23:05:52,457][52670] Sum rewards: 13.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.954', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.258', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'weapon2': '1.128', 'HITCOUNT': '1.170', 'weapon3': '1.502', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:52,605][52667] DAMAGECOUNT value on done: 21436.0 [2024-08-05 23:05:52,605][52667] Sum rewards: 23.096, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.864', 'AMMO4': '-0.119', 'AMMO2': '-0.024', 'AMMO3': '0.078', 'WEAPON3': '0.700', 'ARMOR': '0.880', 'HITCOUNT': '1.420', 'weapon3': '1.486', 'weapon2': '2.104', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '18.000'} [2024-08-05 23:05:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16930.3, 300 sec: 17078.2). Total num frames: 101949440. Throughput: 0: 4199.5. Samples: 25489970. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:05:52,795][52567] Avg episode reward: [(0, '17.536')] [2024-08-05 23:05:52,927][52794] DAMAGECOUNT value on done: 23515.0 [2024-08-05 23:05:52,928][52794] Sum rewards: 14.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.255', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'ARMOR': '0.024', 'AMMO3': '0.093', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '0.750', 'weapon2': '1.280', 'HITCOUNT': '1.340', 'weapon3': '1.692', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:53,077][52664] DAMAGECOUNT value on done: 21768.0 [2024-08-05 23:05:53,078][52664] Sum rewards: 8.018, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.036', 'weapon4': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'HITCOUNT': '0.870', 'WEAPON3': '0.900', 'weapon2': '1.216', 'weapon3': '1.704', 'DAMAGECOUNT': '2.940', 'FRAGCOUNT': '9.000'} [2024-08-05 23:05:53,389][52662] DAMAGECOUNT value on done: 28454.0 [2024-08-05 23:05:53,389][52662] Sum rewards: 14.588, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.086', 'HEALTH': '0.086', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.262', 'WEAPON3': '0.550', 'weapon2': '0.954', 'HITCOUNT': '1.120', 'weapon3': '1.610', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '11.000'} [2024-08-05 23:05:53,400][52669] DAMAGECOUNT value on done: 23756.0 [2024-08-05 23:05:53,403][52669] Sum rewards: 21.156, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.366', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'AMMO3': '0.065', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.260', 'WEAPON3': '0.500', 'weapon4': '0.508', 'weapon2': '1.026', 'HITCOUNT': '1.200', 'weapon3': '1.354', 'ARMOR': '1.809', 'DAMAGECOUNT': '5.658', 'FRAGCOUNT': '15.000'} [2024-08-05 23:05:53,544][52820] DAMAGECOUNT value on done: 19593.0 [2024-08-05 23:05:53,547][52820] Sum rewards: 15.430, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.818', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.458', 'WEAPON3': '0.600', 'weapon2': '1.214', 'HITCOUNT': '1.350', 'ARMOR': '1.458', 'weapon3': '1.544', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '9.000'} [2024-08-05 23:05:54,414][52665] DAMAGECOUNT value on done: 21729.0 [2024-08-05 23:05:54,416][52665] Sum rewards: 14.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.519', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.650', 'weapon2': '0.924', 'HITCOUNT': '1.300', 'weapon3': '1.448', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:55,074][52666] DAMAGECOUNT value on done: 20551.0 [2024-08-05 23:05:55,075][52666] Sum rewards: 9.668, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.198', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.010', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'ARMOR': '0.447', 'WEAPON3': '0.800', 'HITCOUNT': '1.140', 'weapon3': '1.574', 'weapon2': '1.622', 'DAMAGECOUNT': '4.020', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:55,419][52667] DAMAGECOUNT value on done: 22842.0 [2024-08-05 23:05:55,420][52667] Sum rewards: 23.395, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.141', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.024', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.104', 'WEAPON3': '0.550', 'ARMOR': '0.854', 'weapon3': '1.682', 'weapon2': '1.686', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '5.496', 'FRAGCOUNT': '17.000'} [2024-08-05 23:05:55,763][52794] DAMAGECOUNT value on done: 25918.0 [2024-08-05 23:05:55,764][52794] Sum rewards: 22.186, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'weapon4': '0.002', 'AMMO5': '0.013', 'weapon5': '0.016', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.396', 'HITCOUNT': '1.520', 'weapon3': '2.210', 'DAMAGECOUNT': '5.892', 'FRAGCOUNT': '21.000'} [2024-08-05 23:05:55,773][52670] DAMAGECOUNT value on done: 22747.0 [2024-08-05 23:05:55,776][52670] Sum rewards: 21.012, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.524', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.050', 'AMMO3': '0.124', 'AMMO4': '0.137', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.386', 'ARMOR': '0.468', 'WEAPON3': '0.800', 'weapon2': '1.008', 'HITCOUNT': '1.730', 'weapon3': '1.944', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '16.000'} [2024-08-05 23:05:55,846][52650] Updated weights for policy 0, policy_version 12451 (0.0024) [2024-08-05 23:05:56,019][52664] DAMAGECOUNT value on done: 20055.0 [2024-08-05 23:05:56,020][52664] Sum rewards: 15.478, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'HEALTH': '0.132', 'WEAPON3': '0.650', 'ARMOR': '1.200', 'HITCOUNT': '1.460', 'weapon2': '1.802', 'weapon3': '1.946', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:56,318][52662] DAMAGECOUNT value on done: 23844.0 [2024-08-05 23:05:56,319][52662] Sum rewards: 15.182, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.636', 'WEAPON3': '0.850', 'weapon2': '1.258', 'HITCOUNT': '1.500', 'weapon3': '1.742', 'DAMAGECOUNT': '5.034', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:56,354][52669] DAMAGECOUNT value on done: 21222.0 [2024-08-05 23:05:56,355][52669] Sum rewards: 25.930, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.428', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.226', 'WEAPON3': '0.650', 'ARMOR': '0.918', 'weapon2': '1.330', 'HITCOUNT': '1.540', 'weapon3': '1.906', 'DAMAGECOUNT': '5.493', 'FRAGCOUNT': '20.000'} [2024-08-05 23:05:56,927][52820] DAMAGECOUNT value on done: 21208.0 [2024-08-05 23:05:56,929][52820] Sum rewards: 18.328, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.446', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.034', 'ARMOR': '0.052', 'AMMO3': '0.086', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.392', 'WEAPON3': '0.600', 'weapon2': '1.282', 'HITCOUNT': '1.520', 'weapon3': '1.748', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '12.500'} [2024-08-05 23:05:57,038][52665] DAMAGECOUNT value on done: 22083.0 [2024-08-05 23:05:57,039][52665] Sum rewards: 12.356, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.240', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.050', 'ARMOR': '1.360', 'weapon2': '1.572', 'weapon3': '1.830', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:57,306][52663] DAMAGECOUNT value on done: 22254.0 [2024-08-05 23:05:57,307][52663] Sum rewards: 14.592, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.430', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.103', 'weapon4': '0.124', 'WEAPON4': '0.250', 'ARMOR': '0.426', 'WEAPON3': '0.700', 'HITCOUNT': '1.340', 'weapon3': '1.648', 'weapon2': '1.978', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '13.000'} [2024-08-05 23:05:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 17050.5). Total num frames: 102023168. Throughput: 0: 4196.9. Samples: 25514910. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-05 23:05:57,794][52567] Avg episode reward: [(0, '17.221')] [2024-08-05 23:05:58,027][52666] DAMAGECOUNT value on done: 19834.0 [2024-08-05 23:05:58,027][52666] Sum rewards: 12.748, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.004', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.650', 'HITCOUNT': '0.780', 'weapon2': '0.808', 'ARMOR': '0.820', 'weapon3': '1.694', 'DAMAGECOUNT': '3.432', 'FRAGCOUNT': '10.000'} [2024-08-05 23:05:58,441][52794] DAMAGECOUNT value on done: 25202.0 [2024-08-05 23:05:58,441][52794] Sum rewards: 26.511, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.510', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.322', 'HITCOUNT': '1.680', 'weapon3': '1.752', 'DAMAGECOUNT': '6.285', 'FRAGCOUNT': '22.000'} [2024-08-05 23:05:58,731][52670] DAMAGECOUNT value on done: 22313.0 [2024-08-05 23:05:58,733][52670] Sum rewards: 15.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.229', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.050', 'weapon4': '0.112', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.898', 'HITCOUNT': '1.270', 'weapon2': '1.612', 'weapon3': '1.708', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '12.000'} [2024-08-05 23:05:58,942][52667] DAMAGECOUNT value on done: 20885.0 [2024-08-05 23:05:58,942][52667] Sum rewards: 15.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.318', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.135', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'WEAPON3': '0.900', 'HITCOUNT': '1.220', 'weapon2': '1.466', 'weapon3': '1.682', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '14.000'} [2024-08-05 23:05:59,004][52662] DAMAGECOUNT value on done: 23939.0 [2024-08-05 23:05:59,005][52662] Sum rewards: 10.797, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.865', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON3': '0.700', 'HITCOUNT': '0.800', 'ARMOR': '0.849', 'weapon2': '1.494', 'weapon3': '1.554', 'DAMAGECOUNT': '3.030', 'FRAGCOUNT': '9.000'} [2024-08-05 23:05:59,284][52664] DAMAGECOUNT value on done: 23700.0 [2024-08-05 23:05:59,286][52664] Sum rewards: 18.731, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.849', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.018', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.908', 'HITCOUNT': '1.500', 'weapon2': '1.734', 'weapon3': '1.874', 'DAMAGECOUNT': '5.103', 'FRAGCOUNT': '14.000'} [2024-08-05 23:05:59,758][52669] DAMAGECOUNT value on done: 22878.0 [2024-08-05 23:05:59,760][52669] Sum rewards: 10.744, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.058', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.139', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '0.930', 'ARMOR': '0.961', 'weapon2': '1.236', 'weapon3': '1.990', 'DAMAGECOUNT': '3.120', 'FRAGCOUNT': '10.000'} [2024-08-05 23:06:00,117][52665] DAMAGECOUNT value on done: 20779.0 [2024-08-05 23:06:00,121][52665] Sum rewards: 9.958, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.560', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO3': '0.115', 'WEAPON3': '0.800', 'HITCOUNT': '1.030', 'weapon3': '1.528', 'weapon2': '1.562', 'DAMAGECOUNT': '3.537', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:00,215][52820] DAMAGECOUNT value on done: 20207.0 [2024-08-05 23:06:00,218][52820] Sum rewards: 17.643, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.295', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.006', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.310', 'weapon3': '1.624', 'weapon2': '1.992', 'DAMAGECOUNT': '4.962', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:00,623][52663] DAMAGECOUNT value on done: 21359.0 [2024-08-05 23:06:00,626][52663] Sum rewards: 19.034, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.422', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.100', 'weapon5': '0.128', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.554', 'WEAPON3': '0.600', 'ARMOR': '0.852', 'weapon2': '1.240', 'HITCOUNT': '1.240', 'weapon3': '1.348', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:01,083][52794] DAMAGECOUNT value on done: 25982.0 [2024-08-05 23:06:01,084][52794] Sum rewards: 13.399, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.017', 'AMMO2': '0.023', 'ARMOR': '0.028', 'AMMO3': '0.110', 'AMMO4': '0.112', 'HEALTH': '0.114', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.526', 'weapon2': '1.008', 'HITCOUNT': '1.310', 'weapon3': '1.484', 'DAMAGECOUNT': '4.227', 'FRAGCOUNT': '10.000'} [2024-08-05 23:06:01,277][52666] DAMAGECOUNT value on done: 20913.0 [2024-08-05 23:06:01,278][52666] Sum rewards: 20.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.033', 'ARMOR': '0.040', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.176', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon2': '1.396', 'HITCOUNT': '1.720', 'weapon3': '2.114', 'DAMAGECOUNT': '6.396', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:01,284][52650] Updated weights for policy 0, policy_version 12461 (0.0020) [2024-08-05 23:06:01,859][52667] DAMAGECOUNT value on done: 21578.0 [2024-08-05 23:06:01,861][52667] Sum rewards: 12.454, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.020', 'weapon4': '0.022', 'HEALTH': '0.030', 'weapon7': '0.052', 'AMMO3': '0.078', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '0.980', 'weapon2': '1.196', 'weapon3': '1.376', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:01,878][52662] DAMAGECOUNT value on done: 25453.0 [2024-08-05 23:06:01,878][52662] Sum rewards: 15.198, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.591', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO3': '0.125', 'ARMOR': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '1.230', 'weapon2': '1.530', 'weapon3': '1.738', 'DAMAGECOUNT': '4.155', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:02,117][52670] DAMAGECOUNT value on done: 22285.0 [2024-08-05 23:06:02,117][52670] Sum rewards: 21.417, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.108', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.642', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '1.640', 'weapon3': '2.342', 'DAMAGECOUNT': '6.294', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:02,594][52664] DAMAGECOUNT value on done: 21243.0 [2024-08-05 23:06:02,595][52664] Sum rewards: 16.527, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.775', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.090', 'weapon4': '0.180', 'WEAPON5': '0.200', 'ARMOR': '0.440', 'WEAPON3': '0.500', 'HITCOUNT': '1.070', 'weapon2': '1.390', 'weapon3': '1.570', 'DAMAGECOUNT': '4.263', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16793.6, 300 sec: 17078.3). Total num frames: 102113280. Throughput: 0: 4198.2. Samples: 25527430. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-05 23:06:02,794][52567] Avg episode reward: [(0, '17.057')] [2024-08-05 23:06:02,804][52669] DAMAGECOUNT value on done: 22989.0 [2024-08-05 23:06:02,805][52669] Sum rewards: 18.935, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.460', 'AMMO5': '0.012', 'weapon5': '0.018', 'AMMO2': '0.018', 'weapon7': '0.054', 'weapon4': '0.060', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'weapon2': '1.330', 'HITCOUNT': '1.580', 'weapon3': '1.830', 'DAMAGECOUNT': '5.733', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:02,942][52665] DAMAGECOUNT value on done: 20456.0 [2024-08-05 23:06:02,942][52665] Sum rewards: 10.792, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.300', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.210', 'ARMOR': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '1.350', 'weapon2': '1.512', 'weapon3': '1.930', 'DAMAGECOUNT': '4.605', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:03,561][52820] DAMAGECOUNT value on done: 19178.0 [2024-08-05 23:06:03,561][52820] Sum rewards: 17.298, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.403', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.022', 'weapon4': '0.064', 'weapon5': '0.080', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.300', 'ARMOR': '0.481', 'WEAPON3': '0.650', 'HITCOUNT': '1.250', 'weapon2': '1.428', 'weapon3': '1.514', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:03,683][52663] DAMAGECOUNT value on done: 22452.0 [2024-08-05 23:06:03,684][52663] Sum rewards: 23.829, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.004', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.012', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON3': '0.950', 'ARMOR': '0.957', 'weapon2': '1.002', 'HITCOUNT': '1.620', 'weapon3': '1.918', 'DAMAGECOUNT': '6.498', 'FRAGCOUNT': '21.000'} [2024-08-05 23:06:04,253][52794] DAMAGECOUNT value on done: 21869.0 [2024-08-05 23:06:04,253][52794] Sum rewards: 22.716, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon5': '0.030', 'AMMO4': '0.059', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.308', 'ARMOR': '0.428', 'WEAPON3': '0.700', 'weapon2': '1.086', 'weapon3': '1.708', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '6.570', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:04,655][52666] DAMAGECOUNT value on done: 20954.0 [2024-08-05 23:06:04,656][52666] Sum rewards: 25.211, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.123', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.650', 'ARMOR': '1.283', 'weapon3': '1.672', 'HITCOUNT': '1.860', 'weapon2': '1.970', 'DAMAGECOUNT': '6.744', 'FRAGCOUNT': '19.000'} [2024-08-05 23:06:04,902][52662] DAMAGECOUNT value on done: 27842.0 [2024-08-05 23:06:04,903][52662] Sum rewards: 23.968, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.469', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.071', 'AMMO3': '0.087', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.390', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'weapon2': '1.022', 'HITCOUNT': '1.540', 'weapon3': '1.682', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '19.000'} [2024-08-05 23:06:04,923][52667] DAMAGECOUNT value on done: 22290.0 [2024-08-05 23:06:04,923][52667] Sum rewards: 23.181, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.162', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'weapon4': '0.142', 'WEAPON4': '0.150', 'ARMOR': '0.416', 'WEAPON3': '0.800', 'weapon2': '1.296', 'HITCOUNT': '1.520', 'weapon3': '2.084', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '19.000'} [2024-08-05 23:06:05,409][52650] Updated weights for policy 0, policy_version 12471 (0.0026) [2024-08-05 23:06:05,440][52670] DAMAGECOUNT value on done: 21630.0 [2024-08-05 23:06:05,440][52670] Sum rewards: 25.069, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.600', 'ARMOR': '1.272', 'weapon2': '1.294', 'HITCOUNT': '1.790', 'weapon3': '1.794', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:05,806][52664] DAMAGECOUNT value on done: 21046.0 [2024-08-05 23:06:05,806][52664] Sum rewards: 19.658, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.619', 'AMMO2': '0.024', 'AMMO3': '0.092', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'weapon4': '0.536', 'ARMOR': '0.550', 'WEAPON3': '0.600', 'weapon2': '1.058', 'HITCOUNT': '1.480', 'weapon3': '1.706', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:05,858][52665] DAMAGECOUNT value on done: 21844.0 [2024-08-05 23:06:05,858][52665] Sum rewards: 24.768, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.208', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.020', 'weapon5': '0.022', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON3': '0.700', 'ARMOR': '0.881', 'HITCOUNT': '1.430', 'weapon3': '1.626', 'weapon2': '1.662', 'DAMAGECOUNT': '4.773', 'FRAGCOUNT': '21.000'} [2024-08-05 23:06:05,905][52669] DAMAGECOUNT value on done: 22429.0 [2024-08-05 23:06:05,906][52669] Sum rewards: 12.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.904', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.098', 'AMMO4': '0.114', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.600', 'HITCOUNT': '1.200', 'weapon3': '1.232', 'ARMOR': '1.380', 'weapon2': '1.446', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '10.000'} [2024-08-05 23:06:06,927][52663] DAMAGECOUNT value on done: 22854.0 [2024-08-05 23:06:06,928][52663] Sum rewards: 25.716, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.080', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.266', 'ARMOR': '0.850', 'WEAPON3': '0.900', 'weapon2': '1.252', 'weapon3': '1.498', 'HITCOUNT': '1.620', 'DAMAGECOUNT': '5.163', 'FRAGCOUNT': '23.000'} [2024-08-05 23:06:06,951][52794] DAMAGECOUNT value on done: 25321.0 [2024-08-05 23:06:06,952][52794] Sum rewards: 13.733, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.662', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.398', 'WEAPON3': '0.850', 'weapon2': '1.166', 'ARMOR': '1.341', 'HITCOUNT': '1.370', 'weapon3': '1.794', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:07,069][52820] DAMAGECOUNT value on done: 19367.0 [2024-08-05 23:06:07,070][52820] Sum rewards: 13.216, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.060', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.031', 'weapon5': '0.094', 'AMMO3': '0.112', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.748', 'WEAPON3': '0.850', 'ARMOR': '0.944', 'HITCOUNT': '1.240', 'weapon3': '2.040', 'DAMAGECOUNT': '3.906', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:07,594][52662] DAMAGECOUNT value on done: 27770.0 [2024-08-05 23:06:07,595][52662] Sum rewards: 15.735, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.124', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.228', 'ARMOR': '0.488', 'WEAPON3': '0.500', 'HITCOUNT': '1.100', 'weapon2': '1.450', 'weapon3': '1.460', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '11.000'} [2024-08-05 23:06:07,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16657.0, 300 sec: 17022.7). Total num frames: 102187008. Throughput: 0: 4198.4. Samples: 25552570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 23:06:07,795][52567] Avg episode reward: [(0, '17.632')] [2024-08-05 23:06:07,828][52667] DAMAGECOUNT value on done: 23815.0 [2024-08-05 23:06:07,829][52667] Sum rewards: 18.981, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.655', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.149', 'WEAPON3': '1.100', 'HITCOUNT': '1.350', 'ARMOR': '1.803', 'weapon2': '1.818', 'weapon3': '1.956', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:08,086][52666] DAMAGECOUNT value on done: 18548.0 [2024-08-05 23:06:08,087][52666] Sum rewards: 14.323, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.755', 'AMMO4': '-0.096', 'AMMO2': '-0.019', 'AMMO3': '0.075', 'WEAPON3': '0.700', 'HITCOUNT': '1.190', 'weapon3': '1.524', 'weapon2': '1.526', 'DAMAGECOUNT': '3.678', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:08,574][52665] DAMAGECOUNT value on done: 21751.0 [2024-08-05 23:06:08,576][52665] Sum rewards: 16.227, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon7': '0.004', 'ARMOR': '0.010', 'weapon5': '0.022', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO3': '0.094', 'HEALTH': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'weapon2': '1.362', 'HITCOUNT': '1.440', 'weapon3': '1.630', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:08,808][52670] DAMAGECOUNT value on done: 20425.0 [2024-08-05 23:06:08,810][52670] Sum rewards: 18.715, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.868', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.026', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.153', 'WEAPON3': '1.000', 'weapon2': '1.292', 'HITCOUNT': '1.590', 'weapon3': '2.160', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:08,863][52664] DAMAGECOUNT value on done: 24667.0 [2024-08-05 23:06:08,865][52664] Sum rewards: 20.017, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.458', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.050', 'AMMO3': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'HITCOUNT': '1.230', 'weapon2': '1.418', 'weapon3': '1.578', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:09,430][52669] DAMAGECOUNT value on done: 22819.0 [2024-08-05 23:06:09,431][52669] Sum rewards: 15.570, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.446', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.136', 'ARMOR': '0.415', 'WEAPON3': '0.750', 'HITCOUNT': '1.100', 'weapon3': '1.314', 'weapon2': '1.732', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:10,042][52794] DAMAGECOUNT value on done: 25281.0 [2024-08-05 23:06:10,044][52794] Sum rewards: 14.729, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'weapon5': '0.088', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'HEALTH': '0.208', 'WEAPON3': '0.400', 'weapon4': '0.554', 'weapon3': '0.990', 'HITCOUNT': '1.230', 'weapon2': '1.412', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:10,250][52820] DAMAGECOUNT value on done: 18965.0 [2024-08-05 23:06:10,253][52820] Sum rewards: 19.849, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'weapon4': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'ARMOR': '0.868', 'WEAPON3': '0.950', 'HITCOUNT': '1.360', 'weapon2': '1.616', 'weapon3': '2.132', 'DAMAGECOUNT': '5.088', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:10,439][52663] DAMAGECOUNT value on done: 20509.0 [2024-08-05 23:06:10,441][52663] Sum rewards: 18.423, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.335', 'AMMO4': '-0.038', 'AMMO2': '-0.007', 'AMMO5': '0.020', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.172', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'ARMOR': '0.907', 'HITCOUNT': '1.280', 'weapon2': '1.342', 'weapon3': '1.922', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:10,637][52662] DAMAGECOUNT value on done: 24779.0 [2024-08-05 23:06:10,637][52662] Sum rewards: 17.484, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.221', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.204', 'weapon4': '0.382', 'WEAPON4': '0.450', 'ARMOR': '0.855', 'WEAPON3': '0.950', 'weapon2': '1.242', 'HITCOUNT': '1.350', 'weapon3': '1.966', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:10,774][52667] DAMAGECOUNT value on done: 23473.0 [2024-08-05 23:06:10,774][52667] Sum rewards: 14.365, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.360', 'AMMO2': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.026', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.220', 'weapon2': '0.954', 'WEAPON3': '1.050', 'HITCOUNT': '1.430', 'weapon3': '2.264', 'DAMAGECOUNT': '5.202', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:10,824][52650] Updated weights for policy 0, policy_version 12481 (0.0028) [2024-08-05 23:06:10,960][52666] DAMAGECOUNT value on done: 19818.0 [2024-08-05 23:06:10,962][52666] Sum rewards: 12.733, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.774', 'weapon4': '0.002', 'AMMO2': '0.008', 'AMMO4': '0.039', 'ARMOR': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON3': '0.950', 'HITCOUNT': '1.180', 'weapon2': '1.612', 'weapon3': '2.050', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:11,096][52665] DAMAGECOUNT value on done: 21081.0 [2024-08-05 23:06:11,096][52665] Sum rewards: 16.065, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.098', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'ARMOR': '0.416', 'WEAPON3': '0.550', 'HEALTH': '0.718', 'HITCOUNT': '1.010', 'weapon3': '1.522', 'weapon2': '1.524', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:11,779][52670] DAMAGECOUNT value on done: 20316.0 [2024-08-05 23:06:11,781][52670] Sum rewards: 19.877, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.736', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.080', 'WEAPON3': '0.600', 'ARMOR': '0.907', 'HITCOUNT': '1.580', 'weapon3': '1.620', 'weapon2': '1.846', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:12,251][52664] DAMAGECOUNT value on done: 21674.0 [2024-08-05 23:06:12,252][52664] Sum rewards: 18.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.149', 'WEAPON4': '0.350', 'ARMOR': '0.976', 'WEAPON3': '1.000', 'HITCOUNT': '1.230', 'weapon2': '1.550', 'weapon3': '1.706', 'DAMAGECOUNT': '4.476', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:12,716][52794] DAMAGECOUNT value on done: 25519.0 [2024-08-05 23:06:12,717][52794] Sum rewards: 11.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.815', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon4': '0.002', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.176', 'HITCOUNT': '1.060', 'WEAPON3': '1.150', 'weapon2': '1.470', 'weapon3': '2.102', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16657.1, 300 sec: 17022.7). Total num frames: 102277120. Throughput: 0: 4183.3. Samples: 25577340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 23:06:12,795][52567] Avg episode reward: [(0, '17.302')] [2024-08-05 23:06:12,834][52669] DAMAGECOUNT value on done: 22451.0 [2024-08-05 23:06:12,838][52669] Sum rewards: 10.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.365', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.416', 'WEAPON3': '1.150', 'HITCOUNT': '1.280', 'weapon2': '1.398', 'weapon3': '1.866', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:13,254][52667] DAMAGECOUNT value on done: 20714.0 [2024-08-05 23:06:13,256][52667] Sum rewards: 15.963, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.154', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.039', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.196', 'WEAPON3': '0.650', 'ARMOR': '0.804', 'HITCOUNT': '1.260', 'weapon3': '1.772', 'weapon2': '1.862', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:13,299][52662] DAMAGECOUNT value on done: 25757.0 [2024-08-05 23:06:13,302][52662] Sum rewards: 26.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.098', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO4': '0.031', 'weapon4': '0.068', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.923', 'WEAPON3': '1.050', 'weapon2': '1.344', 'HITCOUNT': '1.660', 'weapon3': '2.150', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '25.000'} [2024-08-05 23:06:13,710][52820] DAMAGECOUNT value on done: 19806.0 [2024-08-05 23:06:13,714][52820] Sum rewards: 12.597, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.076', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.212', 'weapon4': '0.212', 'WEAPON3': '0.700', 'HITCOUNT': '0.910', 'weapon2': '0.972', 'weapon3': '1.468', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '10.000'} [2024-08-05 23:06:13,780][52663] DAMAGECOUNT value on done: 22269.0 [2024-08-05 23:06:13,780][52663] Sum rewards: 17.318, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.210', 'AMMO2': '0.034', 'AMMO3': '0.113', 'AMMO4': '0.169', 'WEAPON4': '0.400', 'ARMOR': '0.485', 'weapon4': '0.602', 'WEAPON3': '0.700', 'weapon2': '1.376', 'weapon3': '1.488', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '5.151', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:14,024][52665] DAMAGECOUNT value on done: 21025.0 [2024-08-05 23:06:14,027][52665] Sum rewards: 15.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.930', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.078', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.216', 'ARMOR': '0.448', 'WEAPON3': '0.700', 'weapon2': '1.250', 'HITCOUNT': '1.340', 'weapon3': '1.692', 'DAMAGECOUNT': '4.422', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:14,152][52666] DAMAGECOUNT value on done: 21562.0 [2024-08-05 23:06:14,152][52666] Sum rewards: 21.756, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.384', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.085', 'weapon5': '0.128', 'WEAPON3': '0.550', 'HITCOUNT': '1.150', 'weapon3': '1.162', 'ARMOR': '1.371', 'weapon2': '1.568', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:14,925][52670] DAMAGECOUNT value on done: 20630.0 [2024-08-05 23:06:14,929][52670] Sum rewards: 16.708, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.345', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'AMMO5': '0.012', 'weapon4': '0.014', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'weapon2': '1.534', 'weapon3': '1.718', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:15,114][52664] DAMAGECOUNT value on done: 19919.0 [2024-08-05 23:06:15,114][52664] Sum rewards: 14.601, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.834', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.060', 'AMMO3': '0.062', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.528', 'ARMOR': '0.604', 'HITCOUNT': '0.930', 'weapon3': '1.298', 'weapon2': '1.324', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:15,191][52794] DAMAGECOUNT value on done: 25620.0 [2024-08-05 23:06:15,192][52794] Sum rewards: 16.611, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.033', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.125', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.302', 'HITCOUNT': '1.470', 'weapon3': '2.126', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:15,345][52650] Updated weights for policy 0, policy_version 12491 (0.0032) [2024-08-05 23:06:15,764][52669] DAMAGECOUNT value on done: 21949.0 [2024-08-05 23:06:15,765][52669] Sum rewards: 25.023, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.061', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.103', 'weapon4': '0.166', 'WEAPON4': '0.200', 'ARMOR': '0.440', 'WEAPON3': '0.750', 'HITCOUNT': '1.490', 'weapon2': '1.548', 'weapon3': '1.840', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '21.000'} [2024-08-05 23:06:15,799][52662] DAMAGECOUNT value on done: 24088.0 [2024-08-05 23:06:15,803][52662] Sum rewards: 12.065, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.682', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.051', 'weapon4': '0.248', 'WEAPON3': '0.450', 'ARMOR': '0.476', 'HITCOUNT': '0.850', 'weapon3': '1.200', 'weapon2': '1.264', 'DAMAGECOUNT': '3.090', 'FRAGCOUNT': '8.000'} [2024-08-05 23:06:16,088][52667] DAMAGECOUNT value on done: 22477.0 [2024-08-05 23:06:16,089][52667] Sum rewards: 14.134, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.753', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.086', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.881', 'HITCOUNT': '1.310', 'weapon2': '1.582', 'weapon3': '1.622', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '10.000'} [2024-08-05 23:06:16,698][52663] DAMAGECOUNT value on done: 24778.0 [2024-08-05 23:06:16,698][52663] Sum rewards: 22.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.113', 'AMMO4': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.442', 'WEAPON3': '0.700', 'weapon2': '1.138', 'HITCOUNT': '1.590', 'weapon3': '1.874', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:16,956][52820] DAMAGECOUNT value on done: 20362.0 [2024-08-05 23:06:16,956][52820] Sum rewards: 20.050, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.964', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.080', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.457', 'weapon4': '0.462', 'weapon2': '0.920', 'WEAPON3': '1.050', 'HITCOUNT': '1.530', 'weapon3': '1.756', 'DAMAGECOUNT': '5.826', 'FRAGCOUNT': '19.000'} [2024-08-05 23:06:16,984][52658] DAMAGECOUNT value on done: 22012.0 [2024-08-05 23:06:16,985][52658] Sum rewards: 19.256, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.689', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO3': '0.060', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.408', 'WEAPON3': '0.500', 'HITCOUNT': '1.250', 'weapon2': '1.300', 'weapon3': '1.360', 'DAMAGECOUNT': '4.209', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:17,298][52665] DAMAGECOUNT value on done: 21450.0 [2024-08-05 23:06:17,298][52665] Sum rewards: 13.415, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.032', 'weapon4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.137', 'ARMOR': '0.432', 'HEALTH': '0.473', 'WEAPON3': '0.600', 'HITCOUNT': '1.100', 'weapon3': '1.372', 'weapon2': '1.748', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:17,300][52666] DAMAGECOUNT value on done: 20765.0 [2024-08-05 23:06:17,303][52666] Sum rewards: 20.749, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.437', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.123', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'weapon2': '1.278', 'weapon3': '2.056', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '16.500'} [2024-08-05 23:06:17,619][52794] DAMAGECOUNT value on done: 24046.0 [2024-08-05 23:06:17,620][52794] Sum rewards: 15.042, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.679', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'AMMO4': '0.131', 'weapon4': '0.172', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.010', 'weapon3': '1.542', 'weapon2': '1.590', 'DAMAGECOUNT': '3.852', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16793.6, 300 sec: 17022.7). Total num frames: 102359040. Throughput: 0: 4183.6. Samples: 25589850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:06:17,794][52567] Avg episode reward: [(0, '17.393')] [2024-08-05 23:06:18,143][52670] DAMAGECOUNT value on done: 20039.0 [2024-08-05 23:06:18,145][52670] Sum rewards: 16.430, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.430', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.286', 'ARMOR': '0.495', 'WEAPON3': '0.800', 'weapon2': '1.508', 'HITCOUNT': '1.750', 'weapon3': '1.822', 'DAMAGECOUNT': '5.838', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:18,236][52662] DAMAGECOUNT value on done: 23408.0 [2024-08-05 23:06:18,237][52662] Sum rewards: 16.725, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.909', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'HITCOUNT': '1.270', 'ARMOR': '1.292', 'weapon2': '1.392', 'weapon3': '1.902', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:18,369][52664] DAMAGECOUNT value on done: 24490.0 [2024-08-05 23:06:18,369][52664] Sum rewards: 22.426, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO2': '0.003', 'AMMO5': '0.015', 'AMMO4': '0.016', 'ARMOR': '0.036', 'weapon5': '0.080', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.206', 'HITCOUNT': '1.760', 'weapon3': '1.834', 'DAMAGECOUNT': '6.300', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:18,574][52667] DAMAGECOUNT value on done: 22148.0 [2024-08-05 23:06:18,576][52667] Sum rewards: 16.070, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.127', 'weapon5': '0.146', 'WEAPON4': '0.350', 'ARMOR': '0.490', 'weapon4': '0.546', 'WEAPON3': '0.750', 'weapon2': '0.928', 'HITCOUNT': '1.200', 'weapon3': '1.758', 'DAMAGECOUNT': '4.449', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:19,027][52669] DAMAGECOUNT value on done: 23569.0 [2024-08-05 23:06:19,027][52669] Sum rewards: 19.428, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.969', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.124', 'weapon5': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.302', 'WEAPON4': '0.350', 'ARMOR': '0.498', 'WEAPON3': '0.800', 'weapon2': '1.238', 'HITCOUNT': '1.480', 'weapon3': '1.674', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:19,524][52658] DAMAGECOUNT value on done: 21318.0 [2024-08-05 23:06:19,525][52658] Sum rewards: 15.304, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.106', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO3': '0.095', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'WEAPON3': '0.550', 'HITCOUNT': '1.180', 'weapon3': '1.604', 'weapon2': '1.680', 'DAMAGECOUNT': '4.146', 'FRAGCOUNT': '11.000'} [2024-08-05 23:06:19,669][52663] DAMAGECOUNT value on done: 20874.0 [2024-08-05 23:06:19,669][52663] Sum rewards: 21.361, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.619', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon4': '0.024', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.410', 'weapon3': '1.418', 'weapon2': '2.122', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:19,971][52665] DAMAGECOUNT value on done: 20469.0 [2024-08-05 23:06:19,971][52665] Sum rewards: 16.139, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.376', 'AMMO5': '0.007', 'weapon5': '0.048', 'AMMO2': '0.057', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.256', 'AMMO4': '0.283', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'ARMOR': '1.228', 'HITCOUNT': '1.570', 'weapon2': '1.644', 'weapon3': '1.682', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:20,145][52794] DAMAGECOUNT value on done: 28553.0 [2024-08-05 23:06:20,145][52794] Sum rewards: 15.572, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.636', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.095', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.298', 'WEAPON3': '0.650', 'weapon2': '1.238', 'HITCOUNT': '1.500', 'weapon3': '1.676', 'DAMAGECOUNT': '4.938', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:20,223][52820] DAMAGECOUNT value on done: 20561.0 [2024-08-05 23:06:20,225][52820] Sum rewards: 18.934, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.054', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.358', 'WEAPON3': '0.500', 'HEALTH': '0.862', 'ARMOR': '0.956', 'weapon2': '1.508', 'HITCOUNT': '1.560', 'weapon3': '1.704', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '12.500'} [2024-08-05 23:06:20,852][52650] Updated weights for policy 0, policy_version 12501 (0.0025) [2024-08-05 23:06:22,795][52567] Fps is (10 sec: 13106.8, 60 sec: 16110.8, 300 sec: 16883.8). Total num frames: 102408192. Throughput: 0: 4075.3. Samples: 25610220. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:06:22,795][52567] Avg episode reward: [(0, '17.491')] [2024-08-05 23:06:26,708][52662] DAMAGECOUNT value on done: 25644.0 [2024-08-05 23:06:26,717][52662] Sum rewards: 11.977, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.800', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'ARMOR': '0.447', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon3': '1.434', 'weapon2': '1.540', 'DAMAGECOUNT': '3.021', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:27,466][52667] DAMAGECOUNT value on done: 21172.0 [2024-08-05 23:06:27,466][52667] Sum rewards: 15.050, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.050', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'weapon4': '0.204', 'ARMOR': '0.457', 'WEAPON3': '0.700', 'HITCOUNT': '1.280', 'weapon3': '1.496', 'weapon2': '1.586', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:27,485][52670] DAMAGECOUNT value on done: 20758.0 [2024-08-05 23:06:27,485][52670] Sum rewards: 25.527, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.625', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon5': '0.120', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.444', 'ARMOR': '0.911', 'WEAPON3': '1.000', 'weapon2': '1.124', 'HITCOUNT': '1.480', 'weapon3': '1.814', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '23.000'} [2024-08-05 23:06:27,794][52567] Fps is (10 sec: 7372.8, 60 sec: 15291.8, 300 sec: 16661.7). Total num frames: 102432768. Throughput: 0: 3615.8. Samples: 25614910. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:06:27,794][52567] Avg episode reward: [(0, '17.447')] [2024-08-05 23:06:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012504_102432768.pth... [2024-08-05 23:06:27,933][52664] DAMAGECOUNT value on done: 22071.0 [2024-08-05 23:06:27,934][52664] Sum rewards: 15.167, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.136', 'AMMO5': '0.010', 'AMMO2': '0.019', 'ARMOR': '0.028', 'AMMO4': '0.096', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.346', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'weapon2': '1.428', 'weapon3': '1.778', 'DAMAGECOUNT': '4.419', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:27,955][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012022_98484224.pth [2024-08-05 23:06:28,537][52663] DAMAGECOUNT value on done: 21690.0 [2024-08-05 23:06:28,538][52663] Sum rewards: 8.586, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.911', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.076', 'AMMO4': '0.097', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.845', 'HITCOUNT': '1.200', 'weapon3': '1.436', 'weapon2': '1.762', 'DAMAGECOUNT': '3.642', 'FRAGCOUNT': '6.000'} [2024-08-05 23:06:28,596][52658] DAMAGECOUNT value on done: 19711.0 [2024-08-05 23:06:28,597][52658] Sum rewards: 18.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.722', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon4': '0.194', 'WEAPON4': '0.200', 'ARMOR': '0.464', 'WEAPON3': '0.700', 'HITCOUNT': '1.530', 'weapon3': '1.554', 'weapon2': '1.778', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:28,774][52794] DAMAGECOUNT value on done: 23673.0 [2024-08-05 23:06:28,775][52794] Sum rewards: 10.254, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.045', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'weapon4': '0.012', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.143', 'WEAPON5': '0.300', 'ARMOR': '0.889', 'WEAPON3': '0.950', 'HITCOUNT': '1.170', 'weapon3': '1.386', 'weapon2': '1.438', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:29,448][52665] DAMAGECOUNT value on done: 20213.0 [2024-08-05 23:06:29,448][52665] Sum rewards: 17.208, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.447', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.095', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.230', 'weapon2': '1.528', 'weapon3': '1.730', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:29,501][52662] DAMAGECOUNT value on done: 24262.0 [2024-08-05 23:06:29,502][52662] Sum rewards: 17.388, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'HEALTH': '0.116', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '1.220', 'weapon3': '1.328', 'weapon2': '2.194', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:29,748][52667] DAMAGECOUNT value on done: 21895.0 [2024-08-05 23:06:29,748][52667] Sum rewards: 21.681, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.703', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON3': '0.850', 'ARMOR': '0.902', 'weapon2': '1.414', 'HITCOUNT': '1.540', 'weapon3': '1.850', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:29,926][52820] DAMAGECOUNT value on done: 19136.0 [2024-08-05 23:06:29,927][52820] Sum rewards: 7.023, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.037', 'ARMOR': '0.048', 'AMMO3': '0.098', 'weapon4': '0.112', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'HEALTH': '0.564', 'HITCOUNT': '0.660', 'weapon2': '1.376', 'weapon3': '1.744', 'DAMAGECOUNT': '2.148', 'FRAGCOUNT': '6.000'} [2024-08-05 23:06:31,609][52658] DAMAGECOUNT value on done: 21508.0 [2024-08-05 23:06:31,609][52658] Sum rewards: 17.049, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.423', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.112', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON3': '0.850', 'ARMOR': '0.871', 'weapon2': '1.220', 'HITCOUNT': '1.290', 'weapon3': '1.918', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:31,673][52794] DAMAGECOUNT value on done: 24266.0 [2024-08-05 23:06:31,680][52794] Sum rewards: 8.468, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'ARMOR': '0.056', 'AMMO3': '0.063', 'HEALTH': '0.115', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON3': '0.400', 'weapon4': '0.434', 'HITCOUNT': '1.000', 'weapon2': '1.074', 'weapon3': '1.474', 'DAMAGECOUNT': '3.042', 'FRAGCOUNT': '5.000'} [2024-08-05 23:06:32,185][52664] DAMAGECOUNT value on done: 25373.0 [2024-08-05 23:06:32,185][52664] Sum rewards: 20.505, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.556', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon4': '0.192', 'ARMOR': '0.530', 'WEAPON3': '0.900', 'weapon2': '1.096', 'HITCOUNT': '1.700', 'weapon3': '1.914', 'DAMAGECOUNT': '5.805', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:32,426][52650] Updated weights for policy 0, policy_version 12511 (0.0013) [2024-08-05 23:06:32,566][52662] DAMAGECOUNT value on done: 26795.0 [2024-08-05 23:06:32,566][52662] Sum rewards: 18.098, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.482', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON3': '0.700', 'ARMOR': '0.851', 'HITCOUNT': '1.470', 'weapon3': '1.482', 'weapon2': '1.780', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:32,794][52567] Fps is (10 sec: 9011.6, 60 sec: 14745.6, 300 sec: 16578.4). Total num frames: 102498304. Throughput: 0: 3574.7. Samples: 25625570. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:06:32,794][52567] Avg episode reward: [(0, '17.262')] [2024-08-05 23:06:33,201][52663] DAMAGECOUNT value on done: 24318.0 [2024-08-05 23:06:33,203][52663] Sum rewards: 12.979, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'weapon4': '0.162', 'AMMO4': '0.180', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.800', 'HITCOUNT': '1.090', 'weapon2': '1.378', 'weapon3': '1.578', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '11.000'} [2024-08-05 23:06:33,591][52820] DAMAGECOUNT value on done: 19231.0 [2024-08-05 23:06:33,595][52820] Sum rewards: 5.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.592', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.022', 'AMMO4': '0.081', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'ARMOR': '0.828', 'WEAPON3': '1.200', 'HITCOUNT': '1.210', 'weapon2': '1.500', 'weapon3': '1.878', 'DAMAGECOUNT': '3.879', 'FRAGCOUNT': '8.500'} [2024-08-05 23:06:34,053][52667] DAMAGECOUNT value on done: 23514.0 [2024-08-05 23:06:34,053][52667] Sum rewards: 32.030, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.035', 'ARMOR': '0.052', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.176', 'WEAPON4': '0.350', 'weapon4': '0.670', 'weapon2': '0.692', 'WEAPON3': '1.050', 'HITCOUNT': '2.220', 'weapon3': '2.246', 'DAMAGECOUNT': '8.127', 'FRAGCOUNT': '27.000'} [2024-08-05 23:06:34,843][52794] DAMAGECOUNT value on done: 26332.0 [2024-08-05 23:06:34,843][52794] Sum rewards: 13.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.080', 'AMMO4': '0.116', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '1.086', 'WEAPON3': '1.200', 'HITCOUNT': '1.290', 'ARMOR': '1.323', 'weapon3': '2.380', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:35,329][52662] DAMAGECOUNT value on done: 27100.0 [2024-08-05 23:06:35,330][52662] Sum rewards: 17.559, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.856', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'ARMOR': '0.416', 'WEAPON3': '0.850', 'HITCOUNT': '1.470', 'weapon2': '1.656', 'weapon3': '1.754', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:35,858][52658] DAMAGECOUNT value on done: 22967.0 [2024-08-05 23:06:35,859][52658] Sum rewards: 19.092, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.584', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.099', 'WEAPON4': '0.300', 'weapon4': '0.420', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'weapon2': '0.998', 'HITCOUNT': '1.730', 'weapon3': '1.910', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:36,231][52664] DAMAGECOUNT value on done: 21437.0 [2024-08-05 23:06:36,232][52664] Sum rewards: 23.643, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.464', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon7': '0.070', 'AMMO3': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.250', 'ARMOR': '0.527', 'WEAPON3': '0.700', 'weapon2': '0.944', 'HITCOUNT': '1.510', 'weapon3': '1.706', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:36,829][52663] DAMAGECOUNT value on done: 22450.0 [2024-08-05 23:06:36,829][52663] Sum rewards: 17.037, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.813', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'ARMOR': '0.436', 'WEAPON3': '1.050', 'HITCOUNT': '1.370', 'weapon2': '1.408', 'weapon3': '2.018', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:37,385][52794] DAMAGECOUNT value on done: 26727.0 [2024-08-05 23:06:37,385][52794] Sum rewards: 18.246, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON3': '0.950', 'weapon2': '1.182', 'HITCOUNT': '1.460', 'weapon3': '1.794', 'DAMAGECOUNT': '5.442', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:37,462][52820] DAMAGECOUNT value on done: 20327.0 [2024-08-05 23:06:37,466][52820] Sum rewards: 24.829, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.234', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'ARMOR': '0.405', 'WEAPON3': '0.750', 'weapon2': '1.390', 'HITCOUNT': '1.830', 'weapon3': '2.036', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '20.000'} [2024-08-05 23:06:37,794][52567] Fps is (10 sec: 12288.0, 60 sec: 14472.5, 300 sec: 16495.1). Total num frames: 102555648. Throughput: 0: 3461.1. Samples: 25645720. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:06:37,794][52567] Avg episode reward: [(0, '17.263')] [2024-08-05 23:06:38,058][52662] DAMAGECOUNT value on done: 24311.0 [2024-08-05 23:06:38,059][52662] Sum rewards: 11.211, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'weapon4': '0.184', 'AMMO3': '0.207', 'ARMOR': '0.444', 'weapon2': '1.092', 'WEAPON3': '1.200', 'HITCOUNT': '1.240', 'weapon3': '2.210', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:38,127][52667] DAMAGECOUNT value on done: 21537.0 [2024-08-05 23:06:38,130][52667] Sum rewards: 20.803, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'weapon4': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.419', 'WEAPON3': '0.850', 'weapon2': '1.224', 'HITCOUNT': '1.490', 'weapon3': '1.928', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:38,472][52650] Updated weights for policy 0, policy_version 12521 (0.0014) [2024-08-05 23:06:39,296][52664] DAMAGECOUNT value on done: 21523.0 [2024-08-05 23:06:39,297][52664] Sum rewards: 21.092, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.226', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.274', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.012', 'HITCOUNT': '1.640', 'weapon3': '2.052', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:39,623][52658] DAMAGECOUNT value on done: 19717.0 [2024-08-05 23:06:39,624][52658] Sum rewards: 12.718, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.152', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.150', 'weapon4': '0.246', 'ARMOR': '0.448', 'WEAPON3': '0.900', 'HITCOUNT': '1.100', 'weapon2': '1.354', 'weapon3': '2.012', 'DAMAGECOUNT': '4.266', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:40,714][52794] DAMAGECOUNT value on done: 24483.0 [2024-08-05 23:06:40,717][52794] Sum rewards: 14.798, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.149', 'AMMO4': '0.170', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.330', 'ARMOR': '0.436', 'weapon2': '0.722', 'WEAPON3': '1.050', 'HITCOUNT': '1.260', 'weapon3': '2.260', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:41,002][52663] DAMAGECOUNT value on done: 21733.0 [2024-08-05 23:06:41,005][52663] Sum rewards: 14.942, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.504', 'AMMO5': '0.003', 'AMMO2': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.160', 'AMMO4': '0.242', 'weapon4': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.865', 'WEAPON3': '0.950', 'weapon2': '1.306', 'HITCOUNT': '1.360', 'weapon3': '1.648', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:41,147][52662] DAMAGECOUNT value on done: 25521.0 [2024-08-05 23:06:41,149][52662] Sum rewards: 17.976, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.351', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.063', 'AMMO4': '0.085', 'weapon5': '0.164', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '0.550', 'ARMOR': '0.555', 'weapon2': '0.712', 'HITCOUNT': '1.320', 'weapon3': '1.482', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:41,205][52820] DAMAGECOUNT value on done: 20754.0 [2024-08-05 23:06:41,206][52820] Sum rewards: 24.671, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.079', 'weapon4': '0.216', 'HEALTH': '0.362', 'WEAPON3': '0.450', 'HITCOUNT': '1.250', 'weapon3': '1.424', 'weapon2': '1.490', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '19.000'} [2024-08-05 23:06:41,871][52667] DAMAGECOUNT value on done: 23520.0 [2024-08-05 23:06:41,872][52667] Sum rewards: 15.941, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.970', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.024', 'AMMO3': '0.077', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.501', 'WEAPON3': '0.600', 'weapon4': '0.826', 'weapon2': '0.936', 'HITCOUNT': '1.230', 'weapon3': '1.532', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '11.000'} [2024-08-05 23:06:42,507][52664] DAMAGECOUNT value on done: 20435.0 [2024-08-05 23:06:42,507][52664] Sum rewards: 11.074, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.014', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'weapon4': '0.320', 'ARMOR': '0.444', 'WEAPON3': '0.800', 'HITCOUNT': '1.150', 'weapon2': '1.182', 'weapon3': '1.736', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:42,794][52567] Fps is (10 sec: 13926.5, 60 sec: 14336.0, 300 sec: 16467.3). Total num frames: 102637568. Throughput: 0: 3385.1. Samples: 25667240. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:06:42,794][52567] Avg episode reward: [(0, '17.401')] [2024-08-05 23:06:43,303][52649] DAMAGECOUNT value on done: 21173.0 [2024-08-05 23:06:43,304][52649] Sum rewards: 12.020, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.038', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.078', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'HITCOUNT': '0.910', 'WEAPON3': '1.000', 'weapon2': '1.094', 'ARMOR': '1.390', 'weapon3': '1.738', 'DAMAGECOUNT': '3.846', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:43,533][52658] DAMAGECOUNT value on done: 25378.0 [2024-08-05 23:06:43,545][52658] Sum rewards: 29.310, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.090', 'HEALTH': '0.310', 'WEAPON3': '0.550', 'HITCOUNT': '1.580', 'weapon3': '1.656', 'weapon2': '1.842', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '23.000'} [2024-08-05 23:06:43,687][52650] Updated weights for policy 0, policy_version 12531 (0.0014) [2024-08-05 23:06:43,998][52663] DAMAGECOUNT value on done: 21170.0 [2024-08-05 23:06:44,002][52663] Sum rewards: 24.704, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.382', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon5': '0.016', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.120', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.530', 'HITCOUNT': '1.600', 'weapon3': '1.800', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '20.500'} [2024-08-05 23:06:44,152][52794] DAMAGECOUNT value on done: 25867.0 [2024-08-05 23:06:44,152][52794] Sum rewards: 23.767, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.530', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.011', 'AMMO3': '0.070', 'weapon5': '0.112', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.522', 'WEAPON3': '0.650', 'weapon2': '0.800', 'ARMOR': '0.938', 'HITCOUNT': '1.620', 'weapon3': '1.734', 'DAMAGECOUNT': '5.580', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:44,476][52671] DAMAGECOUNT value on done: 24570.0 [2024-08-05 23:06:44,476][52671] Sum rewards: 14.804, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.059', 'AMMO2': '0.010', 'AMMO3': '0.040', 'ARMOR': '0.044', 'AMMO4': '0.050', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.300', 'weapon4': '0.508', 'weapon2': '0.806', 'HITCOUNT': '0.920', 'weapon3': '0.994', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:44,840][52662] DAMAGECOUNT value on done: 23763.0 [2024-08-05 23:06:44,840][52662] Sum rewards: 8.566, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.522', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon4': '0.068', 'weapon5': '0.080', 'AMMO3': '0.119', 'WEAPON5': '0.300', 'AMMO4': '0.332', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'HITCOUNT': '0.920', 'ARMOR': '1.232', 'weapon3': '1.348', 'weapon2': '1.548', 'DAMAGECOUNT': '3.357', 'FRAGCOUNT': '7.500'} [2024-08-05 23:06:45,404][52820] DAMAGECOUNT value on done: 19638.0 [2024-08-05 23:06:45,408][52667] DAMAGECOUNT value on done: 24574.0 [2024-08-05 23:06:45,407][52820] Sum rewards: 17.430, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.112', 'WEAPON3': '0.700', 'ARMOR': '0.882', 'HITCOUNT': '1.350', 'weapon2': '1.586', 'weapon3': '1.916', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:45,410][52667] Sum rewards: 31.109, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.938', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.152', 'ARMOR': '0.857', 'WEAPON3': '1.050', 'weapon2': '1.750', 'HITCOUNT': '1.910', 'weapon3': '2.100', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '26.000'} [2024-08-05 23:06:45,842][52664] DAMAGECOUNT value on done: 21781.0 [2024-08-05 23:06:45,842][52664] Sum rewards: 20.686, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.035', 'AMMO4': '-0.069', 'AMMO2': '-0.014', 'AMMO3': '0.076', 'WEAPON3': '0.600', 'ARMOR': '0.878', 'weapon3': '1.356', 'HITCOUNT': '1.470', 'weapon2': '1.936', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:46,596][52658] DAMAGECOUNT value on done: 20605.0 [2024-08-05 23:06:46,599][52658] Sum rewards: 18.647, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.030', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.070', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.558', 'weapon2': '0.780', 'ARMOR': '0.996', 'HITCOUNT': '1.090', 'weapon3': '1.444', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:46,866][52649] DAMAGECOUNT value on done: 22135.0 [2024-08-05 23:06:46,867][52649] Sum rewards: 21.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.332', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'ARMOR': '0.483', 'weapon2': '0.978', 'WEAPON3': '1.000', 'HITCOUNT': '1.840', 'weapon3': '2.542', 'DAMAGECOUNT': '7.401', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:47,677][52671] DAMAGECOUNT value on done: 20941.0 [2024-08-05 23:06:47,680][52671] Sum rewards: 22.519, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.061', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.524', 'HITCOUNT': '1.190', 'weapon2': '1.214', 'weapon3': '1.526', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:47,794][52567] Fps is (10 sec: 15564.3, 60 sec: 14199.4, 300 sec: 16411.7). Total num frames: 102711296. Throughput: 0: 3350.0. Samples: 25678180. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:06:47,795][52567] Avg episode reward: [(0, '17.536')] [2024-08-05 23:06:48,195][52662] DAMAGECOUNT value on done: 25558.0 [2024-08-05 23:06:48,195][52662] Sum rewards: 16.921, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.020', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.362', 'ARMOR': '0.494', 'weapon2': '0.796', 'WEAPON3': '0.800', 'HITCOUNT': '1.260', 'weapon3': '1.704', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:48,231][52663] DAMAGECOUNT value on done: 22218.0 [2024-08-05 23:06:48,236][52663] Sum rewards: 21.688, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.450', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.075', 'WEAPON4': '0.150', 'weapon4': '0.370', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'weapon3': '1.482', 'HITCOUNT': '1.600', 'weapon2': '1.702', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:48,531][52667] DAMAGECOUNT value on done: 22776.0 [2024-08-05 23:06:48,531][52667] Sum rewards: 16.673, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.248', 'AMMO2': '0.017', 'weapon4': '0.056', 'AMMO4': '0.085', 'AMMO3': '0.098', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.868', 'HITCOUNT': '1.150', 'weapon2': '1.612', 'weapon3': '1.632', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:49,094][52820] DAMAGECOUNT value on done: 22139.0 [2024-08-05 23:06:49,104][52820] Sum rewards: 31.943, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'AMMO2': '0.025', 'AMMO3': '0.112', 'AMMO4': '0.123', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.092', 'HITCOUNT': '1.890', 'weapon3': '2.296', 'DAMAGECOUNT': '7.113', 'FRAGCOUNT': '27.000'} [2024-08-05 23:06:49,151][52664] DAMAGECOUNT value on done: 19671.0 [2024-08-05 23:06:49,152][52664] Sum rewards: 16.604, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.469', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.326', 'WEAPON3': '0.650', 'ARMOR': '0.815', 'HITCOUNT': '1.190', 'weapon2': '1.388', 'weapon3': '1.822', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:49,193][52650] Updated weights for policy 0, policy_version 12541 (0.0024) [2024-08-05 23:06:49,229][52662] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:06:49,511][52658] DAMAGECOUNT value on done: 22718.0 [2024-08-05 23:06:49,513][52658] Sum rewards: 13.761, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.009', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.076', 'AMMO4': '0.102', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.853', 'weapon2': '1.208', 'HITCOUNT': '1.240', 'weapon3': '1.826', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '11.000'} [2024-08-05 23:06:50,024][52649] DAMAGECOUNT value on done: 21412.0 [2024-08-05 23:06:50,024][52649] Sum rewards: 22.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.471', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.066', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.943', 'HITCOUNT': '0.960', 'weapon3': '1.418', 'weapon2': '1.608', 'DAMAGECOUNT': '4.455', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:51,266][52671] DAMAGECOUNT value on done: 23238.0 [2024-08-05 23:06:51,274][52671] Sum rewards: 21.523, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.026', 'AMMO2': '0.033', 'ARMOR': '0.056', 'AMMO3': '0.090', 'AMMO4': '0.163', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.652', 'weapon2': '0.888', 'HITCOUNT': '1.220', 'weapon3': '1.744', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:51,478][52667] DAMAGECOUNT value on done: 20771.0 [2024-08-05 23:06:51,481][52667] Sum rewards: 15.868, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.119', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.012', 'AMMO4': '0.032', 'weapon4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon3': '1.336', 'weapon2': '1.390', 'DAMAGECOUNT': '3.663', 'FRAGCOUNT': '14.000'} [2024-08-05 23:06:51,927][52663] DAMAGECOUNT value on done: 21561.0 [2024-08-05 23:06:51,930][52663] Sum rewards: 16.639, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.109', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'ARMOR': '0.454', 'weapon4': '0.474', 'WEAPON3': '0.700', 'weapon2': '1.132', 'HITCOUNT': '1.150', 'weapon3': '1.528', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:51,939][52664] DAMAGECOUNT value on done: 23804.0 [2024-08-05 23:06:51,939][52664] Sum rewards: 18.946, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.766', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.103', 'weapon5': '0.104', 'WEAPON5': '0.200', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '1.580', 'weapon2': '1.630', 'weapon3': '1.680', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:52,794][52567] Fps is (10 sec: 14745.6, 60 sec: 13926.4, 300 sec: 16384.4). Total num frames: 102785024. Throughput: 0: 3286.9. Samples: 25700480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:06:52,794][52567] Avg episode reward: [(0, '17.663')] [2024-08-05 23:06:53,204][52820] DAMAGECOUNT value on done: 23082.0 [2024-08-05 23:06:53,205][52820] Sum rewards: 20.399, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.478', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon5': '0.262', 'WEAPON3': '0.800', 'weapon2': '1.008', 'weapon3': '1.714', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:53,280][52658] DAMAGECOUNT value on done: 21594.0 [2024-08-05 23:06:53,282][52658] Sum rewards: 16.932, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.262', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'WEAPON3': '0.700', 'HITCOUNT': '1.460', 'weapon3': '1.522', 'weapon2': '1.650', 'DAMAGECOUNT': '5.001', 'FRAGCOUNT': '13.000'} [2024-08-05 23:06:53,528][52649] DAMAGECOUNT value on done: 20661.0 [2024-08-05 23:06:53,528][52649] Sum rewards: 14.584, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.239', 'AMMO5': '0.007', 'weapon5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'ARMOR': '0.935', 'HITCOUNT': '1.200', 'weapon2': '1.330', 'weapon3': '2.380', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:54,650][52650] Updated weights for policy 0, policy_version 12551 (0.0013) [2024-08-05 23:06:54,867][52671] DAMAGECOUNT value on done: 20948.0 [2024-08-05 23:06:54,871][52671] Sum rewards: 26.382, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.066', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.044', 'ARMOR': '0.060', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'weapon4': '0.214', 'WEAPON3': '0.600', 'weapon2': '1.022', 'HITCOUNT': '1.440', 'weapon3': '1.982', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '21.000'} [2024-08-05 23:06:54,951][52664] DAMAGECOUNT value on done: 21594.0 [2024-08-05 23:06:54,953][52664] Sum rewards: 22.391, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.665', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.178', 'WEAPON3': '0.650', 'HITCOUNT': '1.520', 'weapon2': '1.570', 'weapon3': '1.906', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '17.000'} [2024-08-05 23:06:55,020][52663] DAMAGECOUNT value on done: 22559.0 [2024-08-05 23:06:55,021][52663] Sum rewards: 13.100, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.690', 'AMMO5': '0.013', 'weapon5': '0.022', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.350', 'ARMOR': '0.481', 'weapon2': '0.996', 'WEAPON3': '1.050', 'HITCOUNT': '1.210', 'weapon3': '2.096', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:55,246][52667] DAMAGECOUNT value on done: 22021.0 [2024-08-05 23:06:55,246][52667] Sum rewards: 13.534, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.556', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.366', 'ARMOR': '0.432', 'WEAPON3': '0.600', 'weapon2': '1.056', 'HITCOUNT': '1.360', 'weapon3': '1.600', 'DAMAGECOUNT': '4.521', 'FRAGCOUNT': '9.000'} [2024-08-05 23:06:55,988][52659] DAMAGECOUNT value on done: 22004.0 [2024-08-05 23:06:55,988][52659] Sum rewards: 18.347, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.147', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.880', 'WEAPON3': '0.950', 'HITCOUNT': '1.500', 'weapon2': '1.556', 'weapon3': '1.912', 'DAMAGECOUNT': '5.313', 'FRAGCOUNT': '16.000'} [2024-08-05 23:06:56,902][52658] DAMAGECOUNT value on done: 23464.0 [2024-08-05 23:06:56,906][52658] Sum rewards: 16.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.210', 'WEAPON3': '0.900', 'ARMOR': '1.251', 'weapon2': '1.514', 'HITCOUNT': '1.560', 'weapon3': '1.902', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:57,067][52649] DAMAGECOUNT value on done: 21581.0 [2024-08-05 23:06:57,069][52649] Sum rewards: 17.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.748', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.360', 'ARMOR': '0.453', 'WEAPON3': '0.650', 'HITCOUNT': '1.200', 'weapon2': '1.426', 'weapon3': '1.494', 'DAMAGECOUNT': '4.722', 'FRAGCOUNT': '15.000'} [2024-08-05 23:06:57,452][52820] DAMAGECOUNT value on done: 20743.0 [2024-08-05 23:06:57,452][52820] Sum rewards: 16.905, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.808', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.076', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'weapon4': '0.668', 'weapon2': '1.020', 'weapon3': '1.388', 'HITCOUNT': '1.430', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '12.000'} [2024-08-05 23:06:57,694][52664] DAMAGECOUNT value on done: 21200.0 [2024-08-05 23:06:57,695][52664] Sum rewards: 23.451, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.217', 'AMMO4': '-0.075', 'AMMO2': '-0.015', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'ARMOR': '0.412', 'WEAPON3': '0.850', 'weapon2': '1.674', 'HITCOUNT': '1.730', 'weapon3': '1.786', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '19.000'} [2024-08-05 23:06:57,794][52567] Fps is (10 sec: 14746.1, 60 sec: 13926.4, 300 sec: 16328.5). Total num frames: 102858752. Throughput: 0: 3230.2. Samples: 25722700. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:06:57,794][52567] Avg episode reward: [(0, '17.805')] [2024-08-05 23:06:58,016][52671] DAMAGECOUNT value on done: 21512.0 [2024-08-05 23:06:58,017][52671] Sum rewards: 17.610, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.262', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.082', 'AMMO4': '0.083', 'weapon4': '0.232', 'WEAPON3': '0.550', 'HITCOUNT': '1.280', 'weapon3': '1.442', 'ARMOR': '1.660', 'weapon2': '1.760', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '11.000'} [2024-08-05 23:06:58,416][52663] DAMAGECOUNT value on done: 22560.0 [2024-08-05 23:06:58,416][52663] Sum rewards: 24.205, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.071', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.079', 'weapon7': '0.082', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.166', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'ARMOR': '1.250', 'weapon2': '1.480', 'weapon3': '1.482', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '18.000'} [2024-08-05 23:06:59,068][52667] DAMAGECOUNT value on done: 22209.0 [2024-08-05 23:06:59,070][52667] Sum rewards: 14.462, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.660', 'AMMO2': '0.001', 'AMMO4': '0.006', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.128', 'WEAPON3': '0.850', 'ARMOR': '0.871', 'HITCOUNT': '1.240', 'weapon2': '1.708', 'weapon3': '1.868', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '11.000'} [2024-08-05 23:06:59,076][52659] DAMAGECOUNT value on done: 23062.0 [2024-08-05 23:06:59,076][52659] Sum rewards: 19.462, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.673', 'weapon4': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'ARMOR': '0.845', 'HITCOUNT': '1.250', 'weapon3': '1.300', 'weapon2': '1.804', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '14.000'} [2024-08-05 23:07:00,187][52658] DAMAGECOUNT value on done: 21389.0 [2024-08-05 23:07:00,199][52658] Sum rewards: 12.145, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.964', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.073', 'WEAPON3': '0.600', 'ARMOR': '0.922', 'HITCOUNT': '1.030', 'weapon3': '1.390', 'weapon2': '1.560', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '9.000'} [2024-08-05 23:07:00,370][52650] Updated weights for policy 0, policy_version 12561 (0.0013) [2024-08-05 23:07:00,375][52649] DAMAGECOUNT value on done: 22870.0 [2024-08-05 23:07:00,376][52649] Sum rewards: 17.831, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.104', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.292', 'ARMOR': '0.448', 'WEAPON3': '0.800', 'weapon2': '1.324', 'HITCOUNT': '1.480', 'weapon3': '1.894', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '14.000'} [2024-08-05 23:07:00,992][52671] DAMAGECOUNT value on done: 23846.0 [2024-08-05 23:07:00,994][52671] Sum rewards: 22.529, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.649', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.103', 'weapon4': '0.220', 'WEAPON3': '0.650', 'weapon2': '1.394', 'HITCOUNT': '1.730', 'weapon3': '1.792', 'DAMAGECOUNT': '6.132', 'FRAGCOUNT': '17.000'} [2024-08-05 23:07:01,299][52664] DAMAGECOUNT value on done: 22413.0 [2024-08-05 23:07:01,301][52664] Sum rewards: 14.588, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'AMMO4': '0.147', 'weapon4': '0.168', 'WEAPON4': '0.300', 'ARMOR': '0.477', 'WEAPON3': '0.750', 'HITCOUNT': '1.510', 'weapon3': '1.594', 'weapon2': '1.644', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:01,686][52663] DAMAGECOUNT value on done: 20997.0 [2024-08-05 23:07:01,687][52663] Sum rewards: 13.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.030', 'AMMO4': '0.116', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.334', 'WEAPON3': '0.850', 'ARMOR': '0.955', 'HITCOUNT': '1.170', 'weapon2': '1.296', 'weapon3': '1.754', 'DAMAGECOUNT': '4.767', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:02,511][52659] DAMAGECOUNT value on done: 22676.0 [2024-08-05 23:07:02,518][52659] Sum rewards: 16.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.956', 'weapon5': '0.002', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'weapon4': '0.112', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.831', 'WEAPON3': '0.900', 'HITCOUNT': '1.460', 'weapon2': '1.580', 'weapon3': '2.026', 'DAMAGECOUNT': '5.187', 'FRAGCOUNT': '16.000'} [2024-08-05 23:07:02,794][52567] Fps is (10 sec: 14745.6, 60 sec: 13653.3, 300 sec: 16272.9). Total num frames: 102932480. Throughput: 0: 3198.7. Samples: 25733790. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:07:02,794][52567] Avg episode reward: [(0, '17.894')] [2024-08-05 23:07:03,309][52649] DAMAGECOUNT value on done: 19623.0 [2024-08-05 23:07:03,309][52649] Sum rewards: 16.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.573', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO3': '0.090', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.500', 'ARMOR': '0.534', 'WEAPON3': '0.600', 'weapon2': '1.174', 'HITCOUNT': '1.280', 'weapon3': '1.596', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:04,052][52658] DAMAGECOUNT value on done: 22525.0 [2024-08-05 23:07:04,052][52658] Sum rewards: 22.453, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.030', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.040', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.232', 'WEAPON3': '0.750', 'weapon2': '1.350', 'HITCOUNT': '1.500', 'weapon3': '1.776', 'DAMAGECOUNT': '5.817', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:04,785][52671] DAMAGECOUNT value on done: 21727.0 [2024-08-05 23:07:04,787][52671] Sum rewards: 13.181, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.224', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon5': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.450', 'ARMOR': '0.456', 'HITCOUNT': '0.830', 'weapon2': '1.198', 'weapon3': '1.436', 'DAMAGECOUNT': '2.679', 'FRAGCOUNT': '9.000'} [2024-08-05 23:07:05,729][52663] DAMAGECOUNT value on done: 20905.0 [2024-08-05 23:07:05,729][52663] Sum rewards: 20.815, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.146', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.286', 'ARMOR': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.280', 'HITCOUNT': '1.380', 'weapon3': '1.860', 'DAMAGECOUNT': '5.220', 'FRAGCOUNT': '19.000'} [2024-08-05 23:07:05,858][52650] Updated weights for policy 0, policy_version 12571 (0.0031) [2024-08-05 23:07:06,323][52659] DAMAGECOUNT value on done: 21638.0 [2024-08-05 23:07:06,323][52659] Sum rewards: 16.639, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.522', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.112', 'AMMO3': '0.122', 'AMMO4': '0.185', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON4': '0.350', 'ARMOR': '0.542', 'WEAPON3': '0.700', 'HITCOUNT': '1.050', 'weapon2': '1.130', 'weapon3': '1.484', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:06,860][52649] DAMAGECOUNT value on done: 21164.0 [2024-08-05 23:07:06,863][52649] Sum rewards: 22.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.002', 'AMMO2': '0.014', 'weapon7': '0.046', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.450', 'ARMOR': '0.526', 'WEAPON3': '0.900', 'weapon2': '1.042', 'HITCOUNT': '1.290', 'weapon3': '1.738', 'DAMAGECOUNT': '5.094', 'FRAGCOUNT': '20.000'} [2024-08-05 23:07:07,292][52658] DAMAGECOUNT value on done: 23409.0 [2024-08-05 23:07:07,294][52658] Sum rewards: 15.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.122', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'ARMOR': '1.304', 'weapon3': '1.716', 'weapon2': '1.928', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:07,794][52567] Fps is (10 sec: 14745.6, 60 sec: 13653.4, 300 sec: 16217.4). Total num frames: 103006208. Throughput: 0: 3234.9. Samples: 25755790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:07:07,795][52567] Avg episode reward: [(0, '17.880')] [2024-08-05 23:07:08,070][52671] DAMAGECOUNT value on done: 23150.0 [2024-08-05 23:07:08,071][52671] Sum rewards: 18.444, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.772', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO3': '0.099', 'WEAPON3': '0.700', 'ARMOR': '1.252', 'HITCOUNT': '1.270', 'weapon3': '1.658', 'weapon2': '1.868', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '14.000'} [2024-08-05 23:07:09,068][52663] DAMAGECOUNT value on done: 20400.0 [2024-08-05 23:07:09,070][52663] Sum rewards: 12.743, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'HEALTH': '0.242', 'weapon4': '0.324', 'WEAPON3': '0.750', 'ARMOR': '0.808', 'HITCOUNT': '1.130', 'weapon2': '1.258', 'weapon3': '1.810', 'DAMAGECOUNT': '3.816', 'FRAGCOUNT': '11.000'} [2024-08-05 23:07:09,305][52659] DAMAGECOUNT value on done: 21829.0 [2024-08-05 23:07:09,307][52659] Sum rewards: 21.860, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.402', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.026', 'AMMO3': '0.092', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'weapon4': '0.384', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon2': '1.296', 'HITCOUNT': '1.550', 'weapon3': '1.956', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:10,195][52649] DAMAGECOUNT value on done: 21184.0 [2024-08-05 23:07:10,198][52649] Sum rewards: 20.438, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.130', 'weapon4': '0.144', 'WEAPON5': '0.200', 'ARMOR': '0.454', 'WEAPON3': '0.650', 'HITCOUNT': '1.410', 'weapon2': '1.592', 'weapon3': '1.698', 'DAMAGECOUNT': '5.979', 'FRAGCOUNT': '14.000'} [2024-08-05 23:07:10,404][52658] DAMAGECOUNT value on done: 20955.0 [2024-08-05 23:07:10,406][52658] Sum rewards: 15.420, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.368', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.130', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'WEAPON3': '0.900', 'ARMOR': '0.973', 'HITCOUNT': '1.290', 'weapon3': '1.566', 'weapon2': '1.618', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '13.000'} [2024-08-05 23:07:11,516][52671] DAMAGECOUNT value on done: 22826.0 [2024-08-05 23:07:11,526][52671] Sum rewards: 16.255, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'HEALTH': '0.539', 'ARMOR': '0.816', 'HITCOUNT': '1.150', 'weapon2': '1.544', 'weapon3': '1.626', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '10.500'} [2024-08-05 23:07:11,618][52650] Updated weights for policy 0, policy_version 12581 (0.0022) [2024-08-05 23:07:12,794][52567] Fps is (10 sec: 14745.6, 60 sec: 13380.3, 300 sec: 16161.8). Total num frames: 103079936. Throughput: 0: 3623.6. Samples: 25777970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:07:12,794][52567] Avg episode reward: [(0, '17.884')] [2024-08-05 23:07:12,967][52659] DAMAGECOUNT value on done: 23549.0 [2024-08-05 23:07:12,967][52659] Sum rewards: 23.136, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.434', 'AMMO2': '0.005', 'AMMO5': '0.019', 'AMMO4': '0.026', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.190', 'weapon4': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.830', 'weapon3': '1.168', 'HITCOUNT': '1.370', 'weapon2': '1.816', 'DAMAGECOUNT': '5.751', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:13,687][52658] DAMAGECOUNT value on done: 23946.0 [2024-08-05 23:07:13,690][52658] Sum rewards: 14.385, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.144', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.076', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.110', 'weapon3': '1.612', 'weapon2': '1.726', 'DAMAGECOUNT': '3.582', 'FRAGCOUNT': '10.000'} [2024-08-05 23:07:13,966][52649] DAMAGECOUNT value on done: 21992.0 [2024-08-05 23:07:13,966][52649] Sum rewards: 14.334, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.936', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'weapon4': '0.348', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'weapon2': '1.184', 'HITCOUNT': '1.190', 'weapon3': '1.688', 'DAMAGECOUNT': '4.143', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:15,084][52671] DAMAGECOUNT value on done: 24803.0 [2024-08-05 23:07:15,084][52671] Sum rewards: 19.802, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.946', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.097', 'WEAPON4': '0.250', 'weapon4': '0.266', 'ARMOR': '0.440', 'WEAPON3': '0.700', 'weapon2': '1.224', 'HITCOUNT': '1.730', 'weapon3': '1.750', 'DAMAGECOUNT': '6.123', 'FRAGCOUNT': '15.500'} [2024-08-05 23:07:16,377][52659] DAMAGECOUNT value on done: 23856.0 [2024-08-05 23:07:16,378][52659] Sum rewards: 16.279, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.166', 'weapon4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '1.250', 'weapon3': '1.264', 'weapon2': '1.624', 'DAMAGECOUNT': '4.803', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:16,760][52658] DAMAGECOUNT value on done: 23710.0 [2024-08-05 23:07:16,761][52658] Sum rewards: 19.090, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.284', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.948', 'HITCOUNT': '1.290', 'ARMOR': '1.313', 'weapon3': '2.012', 'DAMAGECOUNT': '4.674', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:17,061][52820] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 23:07:17,064][52650] Updated weights for policy 0, policy_version 12591 (0.0012) [2024-08-05 23:07:17,706][52649] DAMAGECOUNT value on done: 22073.0 [2024-08-05 23:07:17,708][52649] Sum rewards: 17.055, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.961', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.080', 'weapon4': '0.206', 'WEAPON3': '0.650', 'weapon2': '1.292', 'HITCOUNT': '1.370', 'weapon3': '1.772', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '13.000'} [2024-08-05 23:07:17,794][52567] Fps is (10 sec: 14745.6, 60 sec: 13243.7, 300 sec: 16134.1). Total num frames: 103153664. Throughput: 0: 3634.7. Samples: 25789130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:07:17,794][52567] Avg episode reward: [(0, '17.897')] [2024-08-05 23:07:17,998][52671] DAMAGECOUNT value on done: 21960.0 [2024-08-05 23:07:17,999][52671] Sum rewards: 12.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.842', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.800', 'ARMOR': '0.902', 'weapon2': '1.192', 'HITCOUNT': '1.390', 'weapon3': '1.920', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '10.000'} [2024-08-05 23:07:18,979][52659] DAMAGECOUNT value on done: 20061.0 [2024-08-05 23:07:18,979][52659] Sum rewards: 20.478, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.073', 'HEALTH': '0.118', 'ARMOR': '0.499', 'WEAPON3': '0.500', 'HITCOUNT': '1.170', 'weapon3': '1.402', 'weapon2': '1.544', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:20,023][52658] DAMAGECOUNT value on done: 22046.0 [2024-08-05 23:07:20,024][52658] Sum rewards: 23.048, reward structure: {'DEATHCOUNT': '-9.000', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.051', 'AMMO4': '0.093', 'AMMO3': '0.131', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.658', 'HITCOUNT': '1.850', 'weapon3': '2.116', 'DAMAGECOUNT': '6.825', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:21,367][52671] DAMAGECOUNT value on done: 23603.0 [2024-08-05 23:07:21,368][52671] Sum rewards: 26.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.861', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon4': '0.232', 'WEAPON3': '1.000', 'ARMOR': '1.248', 'weapon2': '1.476', 'weapon3': '2.060', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '21.000'} [2024-08-05 23:07:21,530][52649] DAMAGECOUNT value on done: 21798.0 [2024-08-05 23:07:21,531][52649] Sum rewards: 20.504, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.188', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.258', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'HITCOUNT': '1.120', 'weapon2': '1.228', 'weapon3': '1.632', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:22,559][52650] Updated weights for policy 0, policy_version 12601 (0.0023) [2024-08-05 23:07:22,794][52567] Fps is (10 sec: 14745.5, 60 sec: 13653.4, 300 sec: 16106.3). Total num frames: 103227392. Throughput: 0: 3673.6. Samples: 25811030. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:07:22,795][52567] Avg episode reward: [(0, '18.163')] [2024-08-05 23:07:22,826][52659] DAMAGECOUNT value on done: 21948.0 [2024-08-05 23:07:22,832][52659] Sum rewards: 25.926, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.088', 'HEALTH': '0.122', 'AMMO4': '0.129', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.466', 'ARMOR': '0.487', 'WEAPON3': '0.550', 'weapon2': '1.208', 'weapon3': '1.624', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '6.147', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:23,296][52658] DAMAGECOUNT value on done: 21052.0 [2024-08-05 23:07:23,299][52658] Sum rewards: 15.662, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.396', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.010', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'weapon2': '1.382', 'weapon3': '1.806', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:24,426][52671] DAMAGECOUNT value on done: 24473.0 [2024-08-05 23:07:24,427][52671] Sum rewards: 15.214, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.936', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.062', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.060', 'weapon2': '1.298', 'weapon3': '1.308', 'DAMAGECOUNT': '3.732', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:24,760][52649] DAMAGECOUNT value on done: 23828.0 [2024-08-05 23:07:24,763][52649] Sum rewards: 16.959, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.350', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.050', 'WEAPON3': '0.400', 'HITCOUNT': '1.010', 'weapon3': '1.200', 'ARMOR': '1.333', 'weapon2': '1.896', 'DAMAGECOUNT': '3.450', 'FRAGCOUNT': '11.000'} [2024-08-05 23:07:26,034][52659] DAMAGECOUNT value on done: 24481.0 [2024-08-05 23:07:26,034][52659] Sum rewards: 21.386, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.310', 'weapon5': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.040', 'AMMO4': '0.106', 'AMMO3': '0.127', 'weapon4': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.108', 'HITCOUNT': '1.740', 'weapon3': '2.312', 'DAMAGECOUNT': '5.985', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:26,754][52658] DAMAGECOUNT value on done: 22815.0 [2024-08-05 23:07:26,757][52658] Sum rewards: 24.827, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.992', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.296', 'WEAPON3': '0.450', 'weapon3': '1.270', 'weapon2': '1.272', 'ARMOR': '1.301', 'HITCOUNT': '1.460', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '20.000'} [2024-08-05 23:07:27,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14472.5, 300 sec: 16023.0). Total num frames: 103301120. Throughput: 0: 3686.0. Samples: 25833110. Policy #0 lag: (min: 0.0, avg: 3.0, max: 6.0) [2024-08-05 23:07:27,802][52567] Avg episode reward: [(0, '18.446')] [2024-08-05 23:07:27,805][52614] Saving new best policy, reward=18.446! [2024-08-05 23:07:28,183][52650] Updated weights for policy 0, policy_version 12611 (0.0013) [2024-08-05 23:07:28,187][52671] DAMAGECOUNT value on done: 21071.0 [2024-08-05 23:07:28,188][52671] Sum rewards: 21.218, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.339', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.132', 'WEAPON4': '0.350', 'weapon4': '0.506', 'WEAPON3': '0.950', 'weapon2': '0.978', 'HITCOUNT': '1.810', 'weapon3': '1.912', 'DAMAGECOUNT': '6.771', 'FRAGCOUNT': '19.000'} [2024-08-05 23:07:28,322][52649] DAMAGECOUNT value on done: 21225.0 [2024-08-05 23:07:28,322][52649] Sum rewards: 19.111, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.236', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.102', 'AMMO3': '0.114', 'AMMO4': '0.178', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.230', 'weapon2': '1.304', 'weapon3': '1.810', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '17.000'} [2024-08-05 23:07:30,049][52659] DAMAGECOUNT value on done: 21550.0 [2024-08-05 23:07:30,050][52659] Sum rewards: 22.370, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.200', 'AMMO4': '0.224', 'weapon4': '0.238', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'ARMOR': '1.025', 'weapon2': '1.046', 'HITCOUNT': '1.370', 'weapon3': '2.180', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '18.000'} [2024-08-05 23:07:31,323][52649] DAMAGECOUNT value on done: 20266.0 [2024-08-05 23:07:31,324][52649] Sum rewards: 16.958, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.381', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon5': '0.116', 'weapon4': '0.240', 'WEAPON3': '0.750', 'ARMOR': '0.911', 'HITCOUNT': '1.460', 'weapon2': '1.628', 'weapon3': '1.724', 'DAMAGECOUNT': '5.187', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:32,239][52671] DAMAGECOUNT value on done: 19586.0 [2024-08-05 23:07:32,240][52671] Sum rewards: 13.763, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.103', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.065', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '0.550', 'weapon4': '0.680', 'HITCOUNT': '0.890', 'weapon3': '1.358', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '11.000'} [2024-08-05 23:07:32,794][52567] Fps is (10 sec: 14745.7, 60 sec: 14609.1, 300 sec: 15967.5). Total num frames: 103374848. Throughput: 0: 3684.7. Samples: 25843990. Policy #0 lag: (min: 0.0, avg: 3.0, max: 6.0) [2024-08-05 23:07:32,794][52567] Avg episode reward: [(0, '18.609')] [2024-08-05 23:07:32,795][52614] Saving new best policy, reward=18.609! [2024-08-05 23:07:33,582][52659] DAMAGECOUNT value on done: 22283.0 [2024-08-05 23:07:33,590][52659] Sum rewards: 23.900, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.650', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.003', 'weapon5': '0.054', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.252', 'WEAPON3': '0.750', 'ARMOR': '0.851', 'weapon2': '1.314', 'HITCOUNT': '1.350', 'weapon3': '1.676', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '19.000'} [2024-08-05 23:07:33,791][52650] Updated weights for policy 0, policy_version 12621 (0.0025) [2024-08-05 23:07:34,659][52649] DAMAGECOUNT value on done: 23231.0 [2024-08-05 23:07:34,663][52649] Sum rewards: 9.200, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.348', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.067', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'ARMOR': '0.853', 'WEAPON3': '0.900', 'HITCOUNT': '0.930', 'weapon2': '1.110', 'weapon3': '1.788', 'DAMAGECOUNT': '2.976', 'FRAGCOUNT': '10.000'} [2024-08-05 23:07:35,967][52671] DAMAGECOUNT value on done: 22977.0 [2024-08-05 23:07:35,967][52671] Sum rewards: 22.514, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO5': '0.013', 'AMMO2': '0.023', 'ARMOR': '0.032', 'weapon5': '0.064', 'AMMO4': '0.115', 'AMMO3': '0.133', 'weapon4': '0.154', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.260', 'HITCOUNT': '1.660', 'weapon3': '2.214', 'DAMAGECOUNT': '6.777', 'FRAGCOUNT': '19.000'} [2024-08-05 23:07:37,410][52659] DAMAGECOUNT value on done: 20435.0 [2024-08-05 23:07:37,412][52659] Sum rewards: 18.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.110', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.068', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'AMMO4': '0.277', 'weapon4': '0.556', 'WEAPON4': '0.700', 'weapon2': '0.738', 'ARMOR': '0.906', 'WEAPON3': '1.100', 'HITCOUNT': '1.510', 'weapon3': '2.282', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '19.000'} [2024-08-05 23:07:37,794][52567] Fps is (10 sec: 14745.7, 60 sec: 14882.1, 300 sec: 15939.7). Total num frames: 103448576. Throughput: 0: 3677.6. Samples: 25865970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:07:37,794][52567] Avg episode reward: [(0, '18.664')] [2024-08-05 23:07:37,797][52614] Saving new best policy, reward=18.664! [2024-08-05 23:07:38,163][52803] DAMAGECOUNT value on done: 21312.0 [2024-08-05 23:07:38,166][52803] Sum rewards: 26.540, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.209', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.050', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'ARMOR': '1.204', 'weapon3': '1.866', 'weapon2': '1.868', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '6.291', 'FRAGCOUNT': '21.000'} [2024-08-05 23:07:38,164][52649] DAMAGECOUNT value on done: 19658.0 [2024-08-05 23:07:38,169][52649] Sum rewards: 19.952, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.470', 'WEAPON3': '0.550', 'weapon2': '1.052', 'HITCOUNT': '1.440', 'weapon3': '1.448', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:39,552][52650] Updated weights for policy 0, policy_version 12631 (0.0055) [2024-08-05 23:07:39,760][52671] DAMAGECOUNT value on done: 23578.0 [2024-08-05 23:07:39,762][52671] Sum rewards: 25.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'ARMOR': '0.868', 'WEAPON3': '1.200', 'weapon2': '1.284', 'HITCOUNT': '2.040', 'weapon3': '2.264', 'DAMAGECOUNT': '7.959', 'FRAGCOUNT': '22.000'} [2024-08-05 23:07:41,289][52659] DAMAGECOUNT value on done: 21492.0 [2024-08-05 23:07:41,290][52659] Sum rewards: 17.904, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.122', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.750', 'ARMOR': '0.808', 'weapon3': '1.480', 'weapon2': '1.490', 'HITCOUNT': '1.550', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '13.000'} [2024-08-05 23:07:41,767][52649] DAMAGECOUNT value on done: 22916.0 [2024-08-05 23:07:41,767][52649] Sum rewards: 18.633, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'AMMO2': '0.004', 'weapon4': '0.010', 'AMMO4': '0.018', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.910', 'HITCOUNT': '1.500', 'weapon2': '1.718', 'weapon3': '1.750', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '13.000'} [2024-08-05 23:07:42,034][52803] DAMAGECOUNT value on done: 24032.0 [2024-08-05 23:07:42,037][52803] Sum rewards: 14.202, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.874', 'AMMO5': '0.009', 'weapon5': '0.022', 'AMMO2': '0.039', 'weapon4': '0.094', 'AMMO3': '0.151', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.480', 'WEAPON3': '0.950', 'HITCOUNT': '1.280', 'weapon2': '1.578', 'weapon3': '1.856', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '13.500'} [2024-08-05 23:07:42,794][52567] Fps is (10 sec: 13926.4, 60 sec: 14609.1, 300 sec: 15856.4). Total num frames: 103514112. Throughput: 0: 3671.3. Samples: 25887910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:07:42,794][52567] Avg episode reward: [(0, '18.750')] [2024-08-05 23:07:42,795][52614] Saving new best policy, reward=18.750! [2024-08-05 23:07:43,127][52671] DAMAGECOUNT value on done: 23270.0 [2024-08-05 23:07:43,130][52671] Sum rewards: 8.617, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.290', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.142', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'weapon2': '1.332', 'ARMOR': '1.339', 'HITCOUNT': '1.350', 'weapon3': '1.754', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '9.000'} [2024-08-05 23:07:44,218][52659] DAMAGECOUNT value on done: 22834.0 [2024-08-05 23:07:44,219][52659] Sum rewards: 18.077, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.022', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'HEALTH': '0.150', 'weapon4': '0.184', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon2': '1.402', 'weapon3': '1.792', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:45,026][52811] DAMAGECOUNT value on done: 21513.0 [2024-08-05 23:07:45,028][52811] Sum rewards: 15.530, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.800', 'AMMO2': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.208', 'weapon4': '0.234', 'WEAPON3': '0.900', 'HITCOUNT': '0.980', 'weapon2': '1.092', 'weapon3': '2.070', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '14.000'} [2024-08-05 23:07:45,316][52650] Updated weights for policy 0, policy_version 12641 (0.0027) [2024-08-05 23:07:45,827][52803] DAMAGECOUNT value on done: 19418.0 [2024-08-05 23:07:45,828][52803] Sum rewards: 16.960, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.915', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.037', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'ARMOR': '1.266', 'HITCOUNT': '1.390', 'weapon3': '1.484', 'weapon2': '1.566', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:46,013][52649] DAMAGECOUNT value on done: 23360.0 [2024-08-05 23:07:46,014][52649] Sum rewards: 27.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'weapon4': '0.146', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.566', 'HITCOUNT': '1.950', 'weapon3': '1.962', 'DAMAGECOUNT': '6.399', 'FRAGCOUNT': '22.000'} [2024-08-05 23:07:46,414][52671] DAMAGECOUNT value on done: 20689.0 [2024-08-05 23:07:46,416][52671] Sum rewards: 22.491, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.210', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.015', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'ARMOR': '0.474', 'WEAPON3': '0.900', 'HITCOUNT': '1.390', 'weapon3': '1.654', 'weapon2': '1.656', 'DAMAGECOUNT': '5.634', 'FRAGCOUNT': '20.000'} [2024-08-05 23:07:47,751][52659] DAMAGECOUNT value on done: 24344.0 [2024-08-05 23:07:47,753][52659] Sum rewards: 9.007, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.485', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.438', 'ARMOR': '0.464', 'WEAPON3': '0.900', 'weapon2': '1.122', 'HITCOUNT': '1.200', 'weapon3': '1.842', 'DAMAGECOUNT': '4.119', 'FRAGCOUNT': '10.000'} [2024-08-05 23:07:47,794][52567] Fps is (10 sec: 13926.3, 60 sec: 14609.1, 300 sec: 15828.6). Total num frames: 103587840. Throughput: 0: 3661.3. Samples: 25898550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:07:47,795][52567] Avg episode reward: [(0, '18.819')] [2024-08-05 23:07:47,798][52614] Saving new best policy, reward=18.819! [2024-08-05 23:07:48,740][52811] DAMAGECOUNT value on done: 21238.0 [2024-08-05 23:07:48,740][52811] Sum rewards: 15.793, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.024', 'ARMOR': '0.044', 'AMMO4': '0.121', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.908', 'WEAPON3': '1.000', 'HITCOUNT': '1.390', 'weapon3': '2.208', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '14.000'} [2024-08-05 23:07:49,354][52803] DAMAGECOUNT value on done: 20126.0 [2024-08-05 23:07:49,355][52803] Sum rewards: 20.191, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.665', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.154', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.400', 'HITCOUNT': '1.460', 'weapon3': '1.710', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '16.000'} [2024-08-05 23:07:49,424][52649] DAMAGECOUNT value on done: 23968.0 [2024-08-05 23:07:49,425][52649] Sum rewards: 14.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.620', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.048', 'AMMO3': '0.079', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.354', 'WEAPON3': '0.650', 'HITCOUNT': '1.090', 'weapon2': '1.454', 'weapon3': '1.558', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:49,889][52671] DAMAGECOUNT value on done: 23251.0 [2024-08-05 23:07:49,889][52671] Sum rewards: 26.632, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'weapon4': '0.002', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'AMMO3': '0.151', 'ARMOR': '0.458', 'WEAPON3': '1.050', 'weapon2': '1.154', 'HITCOUNT': '1.810', 'weapon3': '2.370', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '24.000'} [2024-08-05 23:07:50,769][52650] Updated weights for policy 0, policy_version 12651 (0.0026) [2024-08-05 23:07:51,211][52659] DAMAGECOUNT value on done: 21350.0 [2024-08-05 23:07:51,212][52659] Sum rewards: 24.828, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.872', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.078', 'AMMO3': '0.117', 'weapon4': '0.296', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'weapon2': '1.158', 'HITCOUNT': '1.710', 'weapon3': '1.938', 'DAMAGECOUNT': '6.291', 'FRAGCOUNT': '21.000'} [2024-08-05 23:07:52,715][52803] DAMAGECOUNT value on done: 22737.0 [2024-08-05 23:07:52,719][52803] Sum rewards: 20.113, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.172', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.088', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.828', 'HITCOUNT': '1.300', 'weapon2': '1.518', 'weapon3': '1.590', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:52,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14609.1, 300 sec: 15773.1). Total num frames: 103661568. Throughput: 0: 3657.8. Samples: 25920390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:07:52,795][52567] Avg episode reward: [(0, '18.750')] [2024-08-05 23:07:52,900][52811] DAMAGECOUNT value on done: 22696.0 [2024-08-05 23:07:52,901][52811] Sum rewards: 16.837, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.107', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.478', 'ARMOR': '0.490', 'WEAPON3': '0.700', 'weapon2': '1.254', 'HITCOUNT': '1.400', 'weapon3': '1.630', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '12.000'} [2024-08-05 23:07:54,427][52659] DAMAGECOUNT value on done: 21926.0 [2024-08-05 23:07:54,429][52659] Sum rewards: 18.991, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.217', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.061', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.200', 'ARMOR': '0.450', 'WEAPON3': '0.450', 'weapon4': '0.466', 'weapon2': '0.928', 'HITCOUNT': '1.290', 'weapon3': '1.374', 'DAMAGECOUNT': '4.164', 'FRAGCOUNT': '14.000'} [2024-08-05 23:07:55,572][52647] DAMAGECOUNT value on done: 24545.0 [2024-08-05 23:07:55,575][52647] Sum rewards: 17.327, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.578', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.137', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'weapon2': '1.428', 'HITCOUNT': '1.430', 'weapon3': '1.584', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '15.000'} [2024-08-05 23:07:56,389][52650] Updated weights for policy 0, policy_version 12661 (0.0026) [2024-08-05 23:07:56,611][52811] DAMAGECOUNT value on done: 21685.0 [2024-08-05 23:07:56,614][52811] Sum rewards: 12.821, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.070', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'AMMO3': '0.074', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'weapon3': '1.588', 'weapon2': '1.778', 'DAMAGECOUNT': '3.957', 'FRAGCOUNT': '9.000'} [2024-08-05 23:07:56,848][52803] DAMAGECOUNT value on done: 19244.0 [2024-08-05 23:07:56,848][52803] Sum rewards: 9.526, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.732', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'HITCOUNT': '0.690', 'WEAPON3': '0.700', 'weapon3': '1.522', 'weapon2': '1.664', 'DAMAGECOUNT': '2.820', 'FRAGCOUNT': '8.000'} [2024-08-05 23:07:57,355][52668] DAMAGECOUNT value on done: 21694.0 [2024-08-05 23:07:57,356][52668] Sum rewards: 15.308, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO3': '0.056', 'weapon7': '0.058', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.114', 'HEALTH': '0.184', 'weapon4': '0.244', 'WEAPON3': '0.350', 'weapon2': '0.906', 'HITCOUNT': '0.970', 'ARMOR': '0.987', 'weapon3': '1.166', 'DAMAGECOUNT': '3.669', 'FRAGCOUNT': '9.000'} [2024-08-05 23:07:57,794][52567] Fps is (10 sec: 15564.5, 60 sec: 14745.5, 300 sec: 15773.1). Total num frames: 103743488. Throughput: 0: 3654.4. Samples: 25942420. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:07:57,795][52567] Avg episode reward: [(0, '18.509')] [2024-08-05 23:07:58,231][52659] DAMAGECOUNT value on done: 21034.0 [2024-08-05 23:07:58,232][52659] Sum rewards: 22.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.973', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.056', 'ARMOR': '0.092', 'AMMO3': '0.121', 'AMMO4': '0.182', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.182', 'HITCOUNT': '1.410', 'weapon3': '2.190', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '20.000'} [2024-08-05 23:07:59,036][52647] DAMAGECOUNT value on done: 22899.0 [2024-08-05 23:07:59,036][52647] Sum rewards: 10.192, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.277', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.324', 'ARMOR': '0.461', 'WEAPON3': '0.650', 'HITCOUNT': '1.050', 'weapon2': '1.182', 'weapon3': '1.566', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '7.000'} [2024-08-05 23:08:00,085][52811] DAMAGECOUNT value on done: 21501.0 [2024-08-05 23:08:00,098][52811] Sum rewards: 5.172, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.304', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.206', 'AMMO4': '0.226', 'WEAPON4': '0.400', 'HITCOUNT': '0.800', 'ARMOR': '0.909', 'WEAPON3': '0.950', 'weapon2': '1.144', 'weapon3': '1.640', 'DAMAGECOUNT': '2.790', 'FRAGCOUNT': '6.000'} [2024-08-05 23:08:00,485][52803] DAMAGECOUNT value on done: 23887.0 [2024-08-05 23:08:00,486][52803] Sum rewards: 12.972, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.273', 'weapon4': '0.006', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.108', 'ARMOR': '0.448', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.442', 'weapon3': '1.502', 'DAMAGECOUNT': '3.540', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:00,760][52668] DAMAGECOUNT value on done: 24193.0 [2024-08-05 23:08:00,763][52668] Sum rewards: 15.458, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.634', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.264', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.130', 'weapon2': '1.436', 'weapon3': '1.840', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '12.000'} [2024-08-05 23:08:02,058][52647] DAMAGECOUNT value on done: 25465.0 [2024-08-05 23:08:02,060][52647] Sum rewards: 25.398, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.645', 'AMMO2': '0.013', 'ARMOR': '0.040', 'AMMO4': '0.064', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.800', 'weapon2': '1.192', 'HITCOUNT': '1.600', 'weapon3': '1.724', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '21.000'} [2024-08-05 23:08:02,129][52659] DAMAGECOUNT value on done: 23847.0 [2024-08-05 23:08:02,134][52659] Sum rewards: 26.885, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon5': '0.028', 'weapon4': '0.040', 'AMMO4': '0.110', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.946', 'WEAPON3': '1.000', 'weapon2': '1.066', 'HITCOUNT': '1.850', 'weapon3': '1.974', 'DAMAGECOUNT': '7.119', 'FRAGCOUNT': '23.000'} [2024-08-05 23:08:02,257][52650] Updated weights for policy 0, policy_version 12671 (0.0016) [2024-08-05 23:08:02,794][52567] Fps is (10 sec: 14745.5, 60 sec: 14609.1, 300 sec: 15689.8). Total num frames: 103809024. Throughput: 0: 3650.0. Samples: 25953380. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:08:02,794][52567] Avg episode reward: [(0, '18.211')] [2024-08-05 23:08:03,728][52811] DAMAGECOUNT value on done: 21294.0 [2024-08-05 23:08:03,728][52811] Sum rewards: 14.877, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.846', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon4': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'HITCOUNT': '1.240', 'ARMOR': '1.375', 'weapon2': '1.472', 'weapon3': '1.746', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '13.000'} [2024-08-05 23:08:04,357][52668] DAMAGECOUNT value on done: 21015.0 [2024-08-05 23:08:04,360][52668] Sum rewards: 20.800, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '0.004', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.023', 'weapon5': '0.040', 'AMMO3': '0.072', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'ARMOR': '0.856', 'HITCOUNT': '1.320', 'weapon3': '1.656', 'weapon2': '1.780', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:04,390][52803] DAMAGECOUNT value on done: 20217.0 [2024-08-05 23:08:04,392][52803] Sum rewards: 20.198, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.928', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon7': '0.058', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.238', 'WEAPON3': '0.650', 'ARMOR': '0.852', 'weapon2': '1.096', 'HITCOUNT': '1.270', 'weapon3': '1.588', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:05,196][52647] DAMAGECOUNT value on done: 22080.0 [2024-08-05 23:08:05,206][52647] Sum rewards: 19.107, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.574', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.358', 'HITCOUNT': '1.470', 'weapon3': '1.668', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '14.000'} [2024-08-05 23:08:07,745][52650] Updated weights for policy 0, policy_version 12681 (0.0019) [2024-08-05 23:08:07,757][52660] DAMAGECOUNT value on done: 23957.0 [2024-08-05 23:08:07,759][52660] Sum rewards: 21.616, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.510', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO5': '0.019', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.300', 'ARMOR': '0.532', 'WEAPON3': '0.650', 'weapon2': '1.346', 'HITCOUNT': '1.410', 'weapon3': '1.726', 'DAMAGECOUNT': '6.072', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:07,794][52567] Fps is (10 sec: 13926.8, 60 sec: 14609.1, 300 sec: 15662.0). Total num frames: 103882752. Throughput: 0: 3651.3. Samples: 25975340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:08:07,794][52567] Avg episode reward: [(0, '18.230')] [2024-08-05 23:08:07,862][52647] DAMAGECOUNT value on done: 24319.0 [2024-08-05 23:08:07,862][52647] Sum rewards: 25.543, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.433', 'AMMO2': '0.007', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.034', 'ARMOR': '0.040', 'AMMO3': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon3': '1.506', 'weapon2': '1.698', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '20.000'} [2024-08-05 23:08:08,121][52811] DAMAGECOUNT value on done: 22974.0 [2024-08-05 23:08:08,123][52811] Sum rewards: 10.819, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.398', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '1.110', 'weapon2': '1.620', 'weapon3': '1.686', 'ARMOR': '1.710', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '10.000'} [2024-08-05 23:08:08,294][52668] DAMAGECOUNT value on done: 23302.0 [2024-08-05 23:08:08,294][52668] Sum rewards: 21.104, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.561', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.111', 'WEAPON3': '0.650', 'ARMOR': '1.338', 'HITCOUNT': '1.470', 'weapon2': '1.482', 'weapon3': '1.490', 'DAMAGECOUNT': '5.985', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:08,307][52803] DAMAGECOUNT value on done: 21876.0 [2024-08-05 23:08:08,307][52803] Sum rewards: 35.052, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.169', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.076', 'WEAPON5': '0.150', 'weapon5': '0.178', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'weapon2': '1.464', 'weapon3': '1.490', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '8.061', 'FRAGCOUNT': '25.000'} [2024-08-05 23:08:11,631][52647] DAMAGECOUNT value on done: 22901.0 [2024-08-05 23:08:11,633][52647] Sum rewards: 15.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.683', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.143', 'weapon5': '0.144', 'AMMO4': '0.169', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.913', 'weapon2': '1.130', 'HITCOUNT': '1.130', 'weapon3': '1.724', 'DAMAGECOUNT': '4.905', 'FRAGCOUNT': '14.000'} [2024-08-05 23:08:12,219][52803] DAMAGECOUNT value on done: 19743.0 [2024-08-05 23:08:12,219][52803] Sum rewards: 14.274, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.714', 'AMMO2': '0.012', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.170', 'ARMOR': '0.964', 'WEAPON3': '1.000', 'HITCOUNT': '1.420', 'weapon2': '1.558', 'weapon3': '2.170', 'DAMAGECOUNT': '5.319', 'FRAGCOUNT': '12.000'} [2024-08-05 23:08:12,236][52660] DAMAGECOUNT value on done: 23903.0 [2024-08-05 23:08:12,237][52660] Sum rewards: 19.008, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.259', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.116', 'AMMO3': '0.163', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.930', 'WEAPON3': '1.050', 'HITCOUNT': '1.370', 'weapon3': '2.392', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:12,601][52811] DAMAGECOUNT value on done: 19744.0 [2024-08-05 23:08:12,602][52811] Sum rewards: 25.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.161', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.094', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'ARMOR': '0.470', 'WEAPON3': '1.100', 'weapon2': '1.340', 'HITCOUNT': '2.010', 'weapon3': '2.362', 'DAMAGECOUNT': '7.056', 'FRAGCOUNT': '23.000'} [2024-08-05 23:08:12,744][52668] DAMAGECOUNT value on done: 21574.0 [2024-08-05 23:08:12,745][52668] Sum rewards: 13.816, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.399', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'weapon3': '1.606', 'weapon2': '1.632', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:12,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14609.1, 300 sec: 15634.2). Total num frames: 103956480. Throughput: 0: 3617.6. Samples: 25995900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:08:12,794][52567] Avg episode reward: [(0, '18.483')] [2024-08-05 23:08:13,696][52650] Updated weights for policy 0, policy_version 12691 (0.0014) [2024-08-05 23:08:15,078][52647] DAMAGECOUNT value on done: 22391.0 [2024-08-05 23:08:15,078][52647] Sum rewards: 25.383, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.100', 'AMMO5': '0.003', 'AMMO2': '0.031', 'ARMOR': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'AMMO4': '0.154', 'weapon4': '0.164', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'HITCOUNT': '1.540', 'weapon2': '1.552', 'weapon3': '1.736', 'DAMAGECOUNT': '5.808', 'FRAGCOUNT': '20.000'} [2024-08-05 23:08:15,678][52660] DAMAGECOUNT value on done: 22088.0 [2024-08-05 23:08:15,679][52660] Sum rewards: 18.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.246', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.089', 'weapon5': '0.092', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON3': '0.550', 'ARMOR': '1.342', 'HITCOUNT': '1.470', 'weapon3': '1.472', 'weapon2': '1.618', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '12.000'} [2024-08-05 23:08:15,905][52614] Signal inference workers to stop experience collection... (2350 times) [2024-08-05 23:08:15,906][52614] Signal inference workers to resume experience collection... (2350 times) [2024-08-05 23:08:15,974][52650] InferenceWorker_p0-w0: stopping experience collection (2350 times) [2024-08-05 23:08:15,974][52650] InferenceWorker_p0-w0: resuming experience collection (2350 times) [2024-08-05 23:08:16,082][52811] DAMAGECOUNT value on done: 21216.0 [2024-08-05 23:08:16,086][52811] Sum rewards: 23.776, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.140', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'ARMOR': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.338', 'weapon2': '0.814', 'WEAPON3': '1.000', 'HITCOUNT': '1.810', 'weapon3': '2.118', 'DAMAGECOUNT': '7.290', 'FRAGCOUNT': '21.000'} [2024-08-05 23:08:16,109][52803] DAMAGECOUNT value on done: 21824.0 [2024-08-05 23:08:16,113][52803] Sum rewards: 19.903, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.586', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.021', 'weapon7': '0.072', 'AMMO3': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.850', 'ARMOR': '0.937', 'weapon2': '1.036', 'HITCOUNT': '1.420', 'weapon3': '1.982', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:16,176][52668] DAMAGECOUNT value on done: 24406.0 [2024-08-05 23:08:16,183][52668] Sum rewards: 17.554, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.035', 'weapon5': '0.036', 'HEALTH': '0.094', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.400', 'weapon2': '1.422', 'weapon3': '1.836', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '14.500'} [2024-08-05 23:08:17,795][52567] Fps is (10 sec: 13925.8, 60 sec: 14472.4, 300 sec: 15550.9). Total num frames: 104022016. Throughput: 0: 3626.9. Samples: 26007200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:08:17,796][52567] Avg episode reward: [(0, '18.570')] [2024-08-05 23:08:18,820][52647] DAMAGECOUNT value on done: 25062.0 [2024-08-05 23:08:18,820][52647] Sum rewards: 24.714, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.828', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon4': '0.484', 'WEAPON3': '0.650', 'ARMOR': '0.832', 'weapon2': '1.302', 'weapon3': '1.578', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '6.612', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:18,863][52660] DAMAGECOUNT value on done: 21977.0 [2024-08-05 23:08:18,868][52660] Sum rewards: 18.441, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.428', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'weapon5': '0.002', 'weapon4': '0.006', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.911', 'HITCOUNT': '1.480', 'weapon2': '1.754', 'weapon3': '1.884', 'DAMAGECOUNT': '5.838', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:19,217][52650] Updated weights for policy 0, policy_version 12701 (0.0013) [2024-08-05 23:08:19,228][52668] DAMAGECOUNT value on done: 25330.0 [2024-08-05 23:08:19,230][52668] Sum rewards: 14.141, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.329', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.176', 'weapon4': '0.332', 'ARMOR': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.304', 'HITCOUNT': '1.480', 'weapon3': '1.774', 'DAMAGECOUNT': '5.136', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:19,579][52803] DAMAGECOUNT value on done: 20506.0 [2024-08-05 23:08:19,582][52803] Sum rewards: 13.770, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.119', 'weapon4': '0.258', 'HEALTH': '0.450', 'WEAPON3': '0.450', 'HITCOUNT': '0.990', 'weapon3': '1.228', 'ARMOR': '1.299', 'weapon2': '1.530', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '8.000'} [2024-08-05 23:08:20,101][52811] DAMAGECOUNT value on done: 21525.0 [2024-08-05 23:08:20,103][52811] Sum rewards: 19.324, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.578', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'AMMO3': '0.098', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.440', 'weapon4': '0.514', 'WEAPON3': '0.700', 'weapon2': '1.090', 'HITCOUNT': '1.210', 'weapon3': '1.418', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:21,550][52795] DAMAGECOUNT value on done: 19049.0 [2024-08-05 23:08:21,554][52795] Sum rewards: 14.313, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.550', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'weapon5': '0.140', 'weapon4': '0.198', 'ARMOR': '0.448', 'WEAPON3': '0.700', 'HITCOUNT': '1.310', 'weapon2': '1.560', 'weapon3': '1.752', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:21,850][52647] DAMAGECOUNT value on done: 25267.0 [2024-08-05 23:08:21,852][52647] Sum rewards: 11.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.314', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'ARMOR': '0.493', 'weapon4': '0.656', 'weapon2': '0.906', 'WEAPON3': '0.950', 'HITCOUNT': '1.240', 'weapon3': '1.898', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '12.000'} [2024-08-05 23:08:22,339][52660] DAMAGECOUNT value on done: 18671.0 [2024-08-05 23:08:22,342][52660] Sum rewards: 6.422, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon5': '0.034', 'AMMO4': '0.054', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '0.810', 'weapon2': '1.440', 'weapon3': '1.592', 'DAMAGECOUNT': '2.877', 'FRAGCOUNT': '6.000'} [2024-08-05 23:08:22,622][52668] DAMAGECOUNT value on done: 24369.0 [2024-08-05 23:08:22,626][52668] Sum rewards: 18.861, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'ARMOR': '0.441', 'weapon4': '0.528', 'WEAPON3': '0.750', 'weapon2': '1.114', 'HITCOUNT': '1.670', 'weapon3': '1.752', 'DAMAGECOUNT': '6.000', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:22,794][52567] Fps is (10 sec: 13926.4, 60 sec: 14472.5, 300 sec: 15523.1). Total num frames: 104095744. Throughput: 0: 3624.0. Samples: 26029050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:08:22,795][52567] Avg episode reward: [(0, '18.434')] [2024-08-05 23:08:23,482][52803] DAMAGECOUNT value on done: 19830.0 [2024-08-05 23:08:23,485][52803] Sum rewards: 21.919, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.312', 'weapon5': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.023', 'ARMOR': '0.056', 'AMMO4': '0.112', 'AMMO3': '0.137', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.220', 'HITCOUNT': '1.580', 'weapon3': '2.070', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '18.000'} [2024-08-05 23:08:23,865][52811] Large shaping reward -2.522 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.234, -78.0), ('ARMOR', -0.039, -39.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:08:23,895][52811] DAMAGECOUNT value on done: 24160.0 [2024-08-05 23:08:23,899][52811] Sum rewards: 22.800, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.050', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.093', 'AMMO3': '0.138', 'WEAPON3': '0.800', 'ARMOR': '0.808', 'weapon2': '1.370', 'HITCOUNT': '1.580', 'weapon3': '2.120', 'DAMAGECOUNT': '5.958', 'FRAGCOUNT': '18.000'} [2024-08-05 23:08:24,830][52650] Updated weights for policy 0, policy_version 12711 (0.0018) [2024-08-05 23:08:25,068][52795] DAMAGECOUNT value on done: 17665.0 [2024-08-05 23:08:25,070][52795] Sum rewards: 8.468, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.301', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon7': '0.050', 'weapon5': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.131', 'weapon4': '0.234', 'ARMOR': '0.497', 'WEAPON3': '0.700', 'HITCOUNT': '0.750', 'weapon2': '0.824', 'weapon3': '1.414', 'DAMAGECOUNT': '3.252', 'FRAGCOUNT': '7.000'} [2024-08-05 23:08:25,354][52647] DAMAGECOUNT value on done: 23598.0 [2024-08-05 23:08:25,355][52647] Sum rewards: 11.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.462', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.108', 'AMMO4': '0.127', 'weapon4': '0.262', 'WEAPON4': '0.350', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'HITCOUNT': '0.970', 'weapon3': '1.442', 'weapon2': '1.876', 'DAMAGECOUNT': '3.411', 'FRAGCOUNT': '10.000'} [2024-08-05 23:08:26,239][52660] DAMAGECOUNT value on done: 24063.0 [2024-08-05 23:08:26,242][52660] Sum rewards: 20.172, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.375', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO3': '0.126', 'WEAPON3': '0.900', 'weapon2': '1.616', 'HITCOUNT': '1.730', 'weapon3': '1.758', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:26,430][52668] DAMAGECOUNT value on done: 20734.0 [2024-08-05 23:08:26,435][52668] Sum rewards: 10.907, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.072', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'ARMOR': '0.856', 'WEAPON3': '1.050', 'HITCOUNT': '1.170', 'weapon2': '1.608', 'weapon3': '1.834', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '10.000'} [2024-08-05 23:08:27,147][52803] DAMAGECOUNT value on done: 21159.0 [2024-08-05 23:08:27,150][52803] Sum rewards: 21.334, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.090', 'HEALTH': '0.353', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '1.270', 'weapon3': '1.524', 'weapon2': '1.700', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:27,794][52567] Fps is (10 sec: 14746.1, 60 sec: 14472.5, 300 sec: 15495.4). Total num frames: 104169472. Throughput: 0: 3623.3. Samples: 26050960. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:08:27,802][52567] Avg episode reward: [(0, '18.331')] [2024-08-05 23:08:27,818][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012717_104177664.pth... [2024-08-05 23:08:27,868][52811] DAMAGECOUNT value on done: 20317.0 [2024-08-05 23:08:27,870][52811] Sum rewards: 18.566, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.630', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.092', 'WEAPON4': '0.300', 'weapon4': '0.566', 'WEAPON3': '0.700', 'ARMOR': '0.920', 'weapon2': '0.958', 'HITCOUNT': '1.410', 'weapon3': '1.562', 'DAMAGECOUNT': '4.677', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:27,984][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012271_100524032.pth [2024-08-05 23:08:28,701][52647] DAMAGECOUNT value on done: 24089.0 [2024-08-05 23:08:28,701][52647] Sum rewards: 12.153, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.464', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'ARMOR': '0.428', 'WEAPON3': '1.050', 'weapon2': '1.236', 'HITCOUNT': '1.340', 'weapon3': '2.270', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '11.500'} [2024-08-05 23:08:28,992][52795] DAMAGECOUNT value on done: 20085.0 [2024-08-05 23:08:28,993][52795] Sum rewards: 17.193, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.540', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.064', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'weapon4': '0.460', 'WEAPON3': '0.750', 'weapon2': '1.140', 'weapon3': '1.454', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '4.746', 'FRAGCOUNT': '13.000'} [2024-08-05 23:08:29,551][52660] DAMAGECOUNT value on done: 21281.0 [2024-08-05 23:08:29,552][52660] Sum rewards: 15.503, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.116', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon7': '0.096', 'AMMO4': '0.113', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.398', 'ARMOR': '0.424', 'WEAPON3': '0.800', 'HITCOUNT': '1.110', 'weapon2': '1.300', 'weapon3': '1.708', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '13.000'} [2024-08-05 23:08:29,606][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:08:29,768][52668] DAMAGECOUNT value on done: 25547.0 [2024-08-05 23:08:29,769][52668] Sum rewards: 23.013, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.568', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.028', 'weapon4': '0.074', 'AMMO4': '0.079', 'AMMO3': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.626', 'HITCOUNT': '1.860', 'weapon3': '1.906', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '18.000'} [2024-08-05 23:08:30,449][52650] Updated weights for policy 0, policy_version 12721 (0.0023) [2024-08-05 23:08:30,851][52803] DAMAGECOUNT value on done: 20945.0 [2024-08-05 23:08:30,853][52803] Sum rewards: 16.507, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.100', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.062', 'AMMO4': '0.069', 'AMMO3': '0.099', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.498', 'WEAPON3': '0.750', 'HITCOUNT': '1.330', 'weapon2': '1.564', 'weapon3': '1.778', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '14.000'} [2024-08-05 23:08:31,311][52811] DAMAGECOUNT value on done: 21077.0 [2024-08-05 23:08:31,313][52811] Sum rewards: 22.333, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.459', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'ARMOR': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.081', 'weapon4': '0.156', 'WEAPON3': '0.600', 'weapon2': '1.612', 'HITCOUNT': '1.720', 'weapon3': '1.766', 'DAMAGECOUNT': '5.793', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:32,034][52647] DAMAGECOUNT value on done: 21136.0 [2024-08-05 23:08:32,034][52647] Sum rewards: 19.297, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.104', 'weapon4': '0.232', 'WEAPON4': '0.250', 'ARMOR': '0.495', 'WEAPON3': '0.650', 'HITCOUNT': '1.370', 'weapon2': '1.444', 'weapon3': '1.820', 'DAMAGECOUNT': '5.061', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:32,617][52660] DAMAGECOUNT value on done: 22799.0 [2024-08-05 23:08:32,617][52660] Sum rewards: 12.404, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.890', 'WEAPON3': '1.300', 'HITCOUNT': '1.370', 'weapon3': '2.264', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '13.000'} [2024-08-05 23:08:32,677][52795] DAMAGECOUNT value on done: 20895.0 [2024-08-05 23:08:32,677][52795] Sum rewards: 24.941, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.125', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.077', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'ARMOR': '0.416', 'weapon4': '0.418', 'WEAPON3': '0.500', 'weapon3': '1.346', 'weapon2': '1.434', 'HITCOUNT': '1.460', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '18.000'} [2024-08-05 23:08:32,794][52567] Fps is (10 sec: 14745.7, 60 sec: 14472.5, 300 sec: 15467.6). Total num frames: 104243200. Throughput: 0: 3627.1. Samples: 26061770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:08:32,794][52567] Avg episode reward: [(0, '18.382')] [2024-08-05 23:08:32,886][52668] DAMAGECOUNT value on done: 20888.0 [2024-08-05 23:08:32,886][52668] Sum rewards: 10.443, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.402', 'WEAPON3': '0.600', 'weapon2': '0.844', 'ARMOR': '0.912', 'HITCOUNT': '0.970', 'weapon3': '1.506', 'DAMAGECOUNT': '3.438', 'FRAGCOUNT': '9.000'} [2024-08-05 23:08:34,481][52803] DAMAGECOUNT value on done: 18556.0 [2024-08-05 23:08:34,490][52803] Sum rewards: 13.676, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.604', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.268', 'weapon3': '1.440', 'DAMAGECOUNT': '3.888', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:34,786][52811] DAMAGECOUNT value on done: 20756.0 [2024-08-05 23:08:34,786][52811] Sum rewards: 18.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.926', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.227', 'weapon4': '0.230', 'WEAPON4': '0.350', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'weapon2': '1.562', 'weapon3': '1.618', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '15.500'} [2024-08-05 23:08:35,460][52660] DAMAGECOUNT value on done: 22363.0 [2024-08-05 23:08:35,460][52660] Sum rewards: 11.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.029', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.160', 'WEAPON4': '0.300', 'ARMOR': '0.444', 'weapon4': '0.494', 'WEAPON3': '0.750', 'weapon2': '1.028', 'HITCOUNT': '1.060', 'weapon3': '1.552', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '10.000'} [2024-08-05 23:08:35,762][52647] DAMAGECOUNT value on done: 22380.0 [2024-08-05 23:08:35,767][52647] Sum rewards: 22.349, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.094', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.060', 'weapon5': '0.072', 'weapon7': '0.082', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.450', 'ARMOR': '0.978', 'HITCOUNT': '0.980', 'weapon3': '1.514', 'weapon2': '1.594', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:35,846][52668] DAMAGECOUNT value on done: 22397.0 [2024-08-05 23:08:35,850][52668] Sum rewards: 22.709, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.358', 'weapon5': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.247', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'ARMOR': '0.860', 'weapon2': '1.200', 'weapon3': '1.826', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '18.000'} [2024-08-05 23:08:36,133][52650] Updated weights for policy 0, policy_version 12731 (0.0033) [2024-08-05 23:08:36,681][52795] DAMAGECOUNT value on done: 24107.0 [2024-08-05 23:08:36,683][52795] Sum rewards: 21.411, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.436', 'AMMO5': '0.005', 'weapon7': '0.006', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.135', 'weapon4': '0.168', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.844', 'weapon2': '1.460', 'HITCOUNT': '1.590', 'weapon3': '2.056', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:37,796][52567] Fps is (10 sec: 13924.5, 60 sec: 14335.7, 300 sec: 15384.2). Total num frames: 104308736. Throughput: 0: 3626.3. Samples: 26083580. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:08:37,796][52567] Avg episode reward: [(0, '18.242')] [2024-08-05 23:08:38,133][52803] DAMAGECOUNT value on done: 20474.0 [2024-08-05 23:08:38,137][52803] Sum rewards: 21.187, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.574', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.154', 'weapon5': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.451', 'WEAPON3': '1.150', 'weapon2': '1.178', 'HITCOUNT': '1.900', 'weapon3': '2.376', 'DAMAGECOUNT': '6.774', 'FRAGCOUNT': '18.000'} [2024-08-05 23:08:38,579][52811] DAMAGECOUNT value on done: 21954.0 [2024-08-05 23:08:38,591][52811] Sum rewards: 9.887, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.687', 'AMMO2': '0.020', 'ARMOR': '0.060', 'AMMO3': '0.075', 'AMMO4': '0.098', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON3': '0.550', 'HITCOUNT': '0.640', 'weapon2': '1.054', 'weapon3': '1.426', 'DAMAGECOUNT': '2.349', 'FRAGCOUNT': '8.000'} [2024-08-05 23:08:39,242][52660] DAMAGECOUNT value on done: 22795.0 [2024-08-05 23:08:39,244][52660] Sum rewards: 22.202, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.659', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.326', 'WEAPON3': '0.650', 'ARMOR': '1.331', 'HITCOUNT': '1.360', 'weapon3': '1.474', 'weapon2': '1.508', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:39,508][52647] DAMAGECOUNT value on done: 22656.0 [2024-08-05 23:08:39,508][52647] Sum rewards: 20.745, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.396', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.210', 'WEAPON3': '0.700', 'HITCOUNT': '1.240', 'weapon2': '1.280', 'weapon3': '1.650', 'DAMAGECOUNT': '4.770', 'FRAGCOUNT': '18.000'} [2024-08-05 23:08:39,535][52668] DAMAGECOUNT value on done: 22780.0 [2024-08-05 23:08:39,536][52668] Sum rewards: 24.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.550', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.020', 'weapon5': '0.080', 'AMMO3': '0.109', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.839', 'weapon2': '1.154', 'HITCOUNT': '1.610', 'weapon3': '1.862', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '19.000'} [2024-08-05 23:08:40,291][52795] DAMAGECOUNT value on done: 23296.0 [2024-08-05 23:08:40,293][52795] Sum rewards: 20.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.034', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.093', 'weapon5': '0.110', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.354', 'HITCOUNT': '1.390', 'weapon3': '1.768', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:41,687][52650] Updated weights for policy 0, policy_version 12741 (0.0025) [2024-08-05 23:08:41,937][52803] DAMAGECOUNT value on done: 21798.0 [2024-08-05 23:08:41,944][52803] Sum rewards: 28.368, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.427', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.109', 'WEAPON3': '0.700', 'ARMOR': '1.254', 'weapon2': '1.666', 'HITCOUNT': '1.980', 'weapon3': '1.994', 'DAMAGECOUNT': '6.777', 'FRAGCOUNT': '21.000'} [2024-08-05 23:08:42,249][52811] DAMAGECOUNT value on done: 20708.0 [2024-08-05 23:08:42,254][52811] Sum rewards: 27.476, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.062', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.023', 'AMMO3': '0.094', 'ARMOR': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.416', 'HITCOUNT': '1.900', 'weapon3': '1.980', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '21.000'} [2024-08-05 23:08:42,794][52567] Fps is (10 sec: 14745.5, 60 sec: 14609.1, 300 sec: 15384.3). Total num frames: 104390656. Throughput: 0: 3626.7. Samples: 26105620. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:08:42,794][52567] Avg episode reward: [(0, '18.372')] [2024-08-05 23:08:42,844][52660] DAMAGECOUNT value on done: 23345.0 [2024-08-05 23:08:42,846][52660] Sum rewards: 24.216, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.253', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.085', 'weapon4': '0.110', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'ARMOR': '0.808', 'HITCOUNT': '1.320', 'weapon3': '1.420', 'weapon2': '1.702', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '19.000'} [2024-08-05 23:08:43,008][52647] DAMAGECOUNT value on done: 25164.0 [2024-08-05 23:08:43,008][52647] Sum rewards: 12.603, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'AMMO3': '0.142', 'weapon4': '0.158', 'WEAPON4': '0.350', 'HITCOUNT': '0.940', 'WEAPON3': '1.000', 'weapon2': '1.134', 'weapon3': '2.254', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '13.000'} [2024-08-05 23:08:43,103][52668] DAMAGECOUNT value on done: 21928.0 [2024-08-05 23:08:43,103][52668] Sum rewards: 16.502, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.074', 'AMMO2': '0.023', 'AMMO3': '0.089', 'AMMO4': '0.112', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon4': '0.554', 'ARMOR': '0.945', 'HITCOUNT': '1.300', 'weapon3': '1.404', 'weapon2': '1.408', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:43,938][52795] DAMAGECOUNT value on done: 24298.0 [2024-08-05 23:08:43,946][52795] Sum rewards: 14.081, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.234', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '0.860', 'ARMOR': '1.297', 'weapon3': '1.710', 'weapon2': '1.798', 'DAMAGECOUNT': '3.681', 'FRAGCOUNT': '10.000'} [2024-08-05 23:08:45,185][52660] DAMAGECOUNT value on done: 22297.0 [2024-08-05 23:08:45,186][52660] Sum rewards: 15.302, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.859', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon7': '0.056', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.171', 'weapon4': '0.194', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.176', 'weapon3': '1.514', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '12.000'} [2024-08-05 23:08:45,663][52668] DAMAGECOUNT value on done: 21359.0 [2024-08-05 23:08:45,665][52668] Sum rewards: 17.329, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.552', 'AMMO5': '0.015', 'AMMO2': '0.049', 'ARMOR': '0.056', 'weapon5': '0.076', 'AMMO3': '0.110', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon2': '0.862', 'HITCOUNT': '1.440', 'weapon3': '1.972', 'DAMAGECOUNT': '5.841', 'FRAGCOUNT': '13.000'} [2024-08-05 23:08:45,742][52803] DAMAGECOUNT value on done: 22764.0 [2024-08-05 23:08:45,744][52803] Sum rewards: 17.282, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.382', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.020', 'AMMO4': '0.083', 'weapon5': '0.120', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'ARMOR': '1.306', 'HITCOUNT': '1.310', 'weapon3': '1.782', 'weapon2': '1.862', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:46,043][52811] DAMAGECOUNT value on done: 21390.0 [2024-08-05 23:08:46,044][52811] Sum rewards: 18.933, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.942', 'AMMO2': '0.004', 'AMMO5': '0.004', 'AMMO4': '0.019', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.262', 'WEAPON3': '0.800', 'ARMOR': '1.253', 'HITCOUNT': '1.440', 'weapon2': '1.652', 'weapon3': '1.822', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '14.500'} [2024-08-05 23:08:46,211][52647] DAMAGECOUNT value on done: 20903.0 [2024-08-05 23:08:46,213][52647] Sum rewards: 16.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.372', 'AMMO4': '-0.082', 'AMMO2': '-0.016', 'AMMO5': '0.005', 'weapon4': '0.008', 'weapon5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'WEAPON3': '1.150', 'ARMOR': '1.360', 'HITCOUNT': '1.370', 'weapon2': '1.664', 'weapon3': '1.870', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:46,781][52650] Updated weights for policy 0, policy_version 12751 (0.0014) [2024-08-05 23:08:47,582][52795] DAMAGECOUNT value on done: 21134.0 [2024-08-05 23:08:47,584][52795] Sum rewards: 13.362, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.028', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.080', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'ARMOR': '0.930', 'HITCOUNT': '1.000', 'weapon3': '1.464', 'weapon2': '1.840', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '9.000'} [2024-08-05 23:08:47,794][52567] Fps is (10 sec: 15567.0, 60 sec: 14609.1, 300 sec: 15356.5). Total num frames: 104464384. Throughput: 0: 3629.8. Samples: 26116720. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:08:47,794][52567] Avg episode reward: [(0, '18.102')] [2024-08-05 23:08:48,671][52660] DAMAGECOUNT value on done: 22452.0 [2024-08-05 23:08:48,682][52660] Sum rewards: 13.880, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.148', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'ARMOR': '0.491', 'WEAPON3': '0.750', 'HITCOUNT': '1.260', 'weapon2': '1.508', 'weapon3': '2.100', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:48,945][52668] DAMAGECOUNT value on done: 22209.0 [2024-08-05 23:08:48,955][52668] Sum rewards: 24.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.024', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon2': '1.316', 'HITCOUNT': '2.030', 'weapon3': '2.062', 'DAMAGECOUNT': '7.590', 'FRAGCOUNT': '21.000'} [2024-08-05 23:08:49,310][52647] DAMAGECOUNT value on done: 23879.0 [2024-08-05 23:08:49,310][52647] Sum rewards: 1.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.576', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.192', 'AMMO4': '0.218', 'AMMO3': '0.234', 'WEAPON4': '0.500', 'HITCOUNT': '0.820', 'ARMOR': '0.887', 'weapon2': '1.230', 'WEAPON3': '1.400', 'weapon3': '2.148', 'DAMAGECOUNT': '2.643', 'FRAGCOUNT': '6.000'} [2024-08-05 23:08:49,874][52803] DAMAGECOUNT value on done: 21298.0 [2024-08-05 23:08:49,875][52803] Sum rewards: 16.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.771', 'AMMO2': '0.039', 'AMMO3': '0.163', 'AMMO4': '0.196', 'weapon4': '0.256', 'WEAPON4': '0.400', 'ARMOR': '0.542', 'weapon2': '1.022', 'WEAPON3': '1.100', 'HITCOUNT': '1.590', 'weapon3': '2.176', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:49,975][52811] DAMAGECOUNT value on done: 23273.0 [2024-08-05 23:08:49,976][52811] Sum rewards: 31.035, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.529', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.038', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.558', 'ARMOR': '1.779', 'weapon3': '1.894', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '23.000'} [2024-08-05 23:08:51,150][52795] DAMAGECOUNT value on done: 19894.0 [2024-08-05 23:08:51,151][52795] Sum rewards: 23.229, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.148', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.700', 'ARMOR': '1.304', 'weapon3': '1.456', 'weapon2': '1.498', 'HITCOUNT': '1.540', 'DAMAGECOUNT': '5.142', 'FRAGCOUNT': '19.000'} [2024-08-05 23:08:51,594][52660] DAMAGECOUNT value on done: 22791.0 [2024-08-05 23:08:51,594][52660] Sum rewards: 28.016, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.024', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.700', 'ARMOR': '0.855', 'weapon2': '1.364', 'HITCOUNT': '1.710', 'weapon3': '1.932', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '22.000'} [2024-08-05 23:08:52,005][52668] DAMAGECOUNT value on done: 21496.0 [2024-08-05 23:08:52,008][52668] Sum rewards: 25.104, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.654', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.116', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon5': '0.254', 'ARMOR': '0.400', 'weapon4': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.036', 'HITCOUNT': '1.340', 'weapon3': '1.458', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '21.000'} [2024-08-05 23:08:52,656][52647] DAMAGECOUNT value on done: 22970.0 [2024-08-05 23:08:52,659][52647] Sum rewards: 18.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.976', 'weapon4': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.448', 'HITCOUNT': '1.670', 'weapon3': '1.898', 'DAMAGECOUNT': '5.316', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:52,677][52650] Updated weights for policy 0, policy_version 12761 (0.0012) [2024-08-05 23:08:52,794][52567] Fps is (10 sec: 14745.7, 60 sec: 14609.1, 300 sec: 15328.8). Total num frames: 104538112. Throughput: 0: 3631.6. Samples: 26138760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:08:52,794][52567] Avg episode reward: [(0, '18.303')] [2024-08-05 23:08:53,775][52811] DAMAGECOUNT value on done: 19927.0 [2024-08-05 23:08:53,775][52811] Sum rewards: 14.535, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.470', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.070', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'HITCOUNT': '0.990', 'weapon3': '1.200', 'weapon2': '1.598', 'DAMAGECOUNT': '2.937', 'FRAGCOUNT': '11.000'} [2024-08-05 23:08:54,266][52660] DAMAGECOUNT value on done: 23455.0 [2024-08-05 23:08:54,268][52660] Sum rewards: 10.096, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.428', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.073', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.130', 'weapon3': '1.470', 'weapon2': '1.562', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '7.000'} [2024-08-05 23:08:54,576][52668] DAMAGECOUNT value on done: 22394.0 [2024-08-05 23:08:54,576][52668] Sum rewards: 13.067, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.849', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.116', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'weapon4': '0.712', 'weapon2': '0.814', 'HITCOUNT': '1.330', 'weapon3': '1.742', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '12.000'} [2024-08-05 23:08:55,089][52795] DAMAGECOUNT value on done: 22532.0 [2024-08-05 23:08:55,089][52795] Sum rewards: 15.025, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.024', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.040', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.000', 'HITCOUNT': '1.110', 'ARMOR': '1.378', 'weapon3': '1.926', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '13.000'} [2024-08-05 23:08:56,435][52647] DAMAGECOUNT value on done: 23594.0 [2024-08-05 23:08:56,436][52647] Sum rewards: 19.859, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.565', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.028', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.470', 'weapon2': '1.588', 'weapon3': '1.810', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:57,535][52811] DAMAGECOUNT value on done: 20458.0 [2024-08-05 23:08:57,535][52811] Sum rewards: 19.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.474', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.352', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'weapon2': '1.326', 'HITCOUNT': '1.400', 'weapon3': '1.732', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '15.000'} [2024-08-05 23:08:57,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14472.6, 300 sec: 15301.0). Total num frames: 104611840. Throughput: 0: 3667.3. Samples: 26160930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:08:57,794][52567] Avg episode reward: [(0, '18.136')] [2024-08-05 23:08:57,990][52660] DAMAGECOUNT value on done: 22825.0 [2024-08-05 23:08:57,990][52660] Sum rewards: 21.914, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.985', 'AMMO4': '-0.076', 'AMMO2': '-0.015', 'AMMO3': '0.060', 'ARMOR': '0.453', 'WEAPON3': '0.550', 'HITCOUNT': '1.370', 'weapon3': '1.432', 'weapon2': '2.078', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '16.000'} [2024-08-05 23:08:58,116][52650] Updated weights for policy 0, policy_version 12771 (0.0020) [2024-08-05 23:08:58,393][52668] DAMAGECOUNT value on done: 23193.0 [2024-08-05 23:08:58,395][52668] Sum rewards: 20.951, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.756', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.104', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'ARMOR': '0.490', 'WEAPON3': '0.700', 'HITCOUNT': '1.580', 'weapon2': '1.750', 'weapon3': '1.830', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '17.000'} [2024-08-05 23:08:58,785][52795] DAMAGECOUNT value on done: 21296.0 [2024-08-05 23:08:58,787][52795] Sum rewards: 24.949, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.720', 'AMMO4': '-0.088', 'AMMO2': '-0.018', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.232', 'ARMOR': '0.466', 'WEAPON3': '0.800', 'weapon3': '1.546', 'weapon2': '1.616', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '20.000'} [2024-08-05 23:08:59,077][52794] DAMAGECOUNT value on done: 26144.0 [2024-08-05 23:08:59,077][52794] Sum rewards: 13.006, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.568', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO3': '0.080', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.460', 'weapon5': '0.512', 'WEAPON3': '0.550', 'HITCOUNT': '1.220', 'weapon2': '1.248', 'weapon3': '1.434', 'ARMOR': '1.767', 'DAMAGECOUNT': '4.704', 'FRAGCOUNT': '10.000'} [2024-08-05 23:08:59,256][52647] DAMAGECOUNT value on done: 23893.0 [2024-08-05 23:08:59,256][52647] Sum rewards: 18.470, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.410', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'AMMO3': '0.075', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.312', 'WEAPON3': '0.650', 'ARMOR': '0.906', 'HITCOUNT': '1.400', 'weapon3': '1.430', 'weapon2': '1.490', 'DAMAGECOUNT': '4.497', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:00,961][52660] DAMAGECOUNT value on done: 24561.0 [2024-08-05 23:09:00,962][52660] Sum rewards: 21.078, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.716', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.007', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'WEAPON3': '0.600', 'weapon3': '1.490', 'HITCOUNT': '1.500', 'weapon2': '1.926', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '15.500'} [2024-08-05 23:09:01,281][52668] DAMAGECOUNT value on done: 23992.0 [2024-08-05 23:09:01,281][52668] Sum rewards: 21.225, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.945', 'weapon5': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.046', 'AMMO3': '0.134', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.416', 'WEAPON3': '0.850', 'HITCOUNT': '1.430', 'weapon2': '1.584', 'weapon3': '1.992', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '17.000'} [2024-08-05 23:09:02,031][52794] DAMAGECOUNT value on done: 27042.0 [2024-08-05 23:09:02,031][52794] Sum rewards: 7.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.448', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.164', 'AMMO3': '0.168', 'WEAPON4': '0.400', 'ARMOR': '0.945', 'HITCOUNT': '0.970', 'WEAPON3': '1.000', 'weapon2': '1.614', 'weapon3': '1.688', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '10.000'} [2024-08-05 23:09:02,143][52662] DAMAGECOUNT value on done: 26731.0 [2024-08-05 23:09:02,147][52662] Sum rewards: 19.029, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.428', 'AMMO5': '0.015', 'AMMO2': '0.045', 'ARMOR': '0.048', 'AMMO3': '0.153', 'weapon5': '0.200', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON4': '0.600', 'weapon2': '0.962', 'WEAPON3': '1.000', 'weapon3': '1.620', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '5.604', 'FRAGCOUNT': '19.000'} [2024-08-05 23:09:02,319][52795] DAMAGECOUNT value on done: 21396.0 [2024-08-05 23:09:02,323][52795] Sum rewards: 21.361, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.995', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.036', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.640', 'weapon3': '1.756', 'weapon2': '1.906', 'DAMAGECOUNT': '5.814', 'FRAGCOUNT': '17.000'} [2024-08-05 23:09:02,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14609.1, 300 sec: 15273.2). Total num frames: 104685568. Throughput: 0: 3665.4. Samples: 26172140. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:09:02,794][52567] Avg episode reward: [(0, '18.351')] [2024-08-05 23:09:03,697][52650] Updated weights for policy 0, policy_version 12781 (0.0022) [2024-08-05 23:09:03,709][52660] DAMAGECOUNT value on done: 22189.0 [2024-08-05 23:09:03,709][52660] Sum rewards: 26.890, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.226', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.122', 'weapon4': '0.440', 'WEAPON3': '0.600', 'ARMOR': '0.856', 'weapon2': '1.162', 'HITCOUNT': '1.470', 'weapon3': '1.874', 'DAMAGECOUNT': '5.568', 'FRAGCOUNT': '20.000'} [2024-08-05 23:09:04,815][52794] DAMAGECOUNT value on done: 26731.0 [2024-08-05 23:09:04,816][52794] Sum rewards: 14.009, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.990', 'AMMO4': '-0.096', 'AMMO2': '-0.019', 'AMMO3': '0.093', 'WEAPON3': '0.750', 'HITCOUNT': '1.120', 'ARMOR': '1.326', 'weapon3': '1.516', 'weapon2': '1.620', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:04,985][52662] DAMAGECOUNT value on done: 27931.0 [2024-08-05 23:09:04,985][52662] Sum rewards: 20.741, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO2': '0.042', 'AMMO3': '0.102', 'AMMO4': '0.212', 'weapon4': '0.354', 'WEAPON4': '0.450', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'weapon2': '0.902', 'HITCOUNT': '1.420', 'weapon3': '2.098', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:06,238][52795] DAMAGECOUNT value on done: 23904.0 [2024-08-05 23:09:06,239][52795] Sum rewards: 16.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.760', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.013', 'weapon4': '0.028', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON3': '0.950', 'ARMOR': '1.312', 'HITCOUNT': '1.440', 'weapon2': '1.818', 'weapon3': '1.868', 'DAMAGECOUNT': '5.415', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:07,009][52660] DAMAGECOUNT value on done: 23821.0 [2024-08-05 23:09:07,011][52660] Sum rewards: 20.383, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.871', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.073', 'weapon5': '0.116', 'AMMO4': '0.163', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.502', 'WEAPON3': '0.550', 'weapon4': '0.724', 'weapon2': '1.214', 'HITCOUNT': '1.520', 'weapon3': '1.702', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:07,795][52567] Fps is (10 sec: 14744.8, 60 sec: 14608.9, 300 sec: 15217.7). Total num frames: 104759296. Throughput: 0: 3671.5. Samples: 26194270. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:09:07,795][52567] Avg episode reward: [(0, '18.479')] [2024-08-05 23:09:08,327][52794] DAMAGECOUNT value on done: 24779.0 [2024-08-05 23:09:08,330][52794] Sum rewards: 10.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.056', 'weapon5': '0.082', 'AMMO3': '0.111', 'AMMO4': '0.113', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.500', 'weapon4': '0.710', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon3': '1.724', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '9.000'} [2024-08-05 23:09:08,502][52662] DAMAGECOUNT value on done: 29719.0 [2024-08-05 23:09:08,503][52662] Sum rewards: 13.149, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.028', 'weapon4': '0.056', 'AMMO3': '0.103', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.860', 'HITCOUNT': '1.120', 'weapon2': '1.592', 'weapon3': '1.634', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '9.000'} [2024-08-05 23:09:09,200][52650] Updated weights for policy 0, policy_version 12791 (0.0031) [2024-08-05 23:09:10,185][52795] DAMAGECOUNT value on done: 21599.0 [2024-08-05 23:09:10,185][52795] Sum rewards: 18.155, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.822', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.082', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.879', 'weapon3': '1.374', 'HITCOUNT': '1.400', 'weapon2': '1.960', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:10,559][52660] DAMAGECOUNT value on done: 22091.0 [2024-08-05 23:09:10,560][52660] Sum rewards: 15.320, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.365', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.034', 'weapon4': '0.066', 'AMMO3': '0.095', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon3': '1.640', 'weapon2': '2.002', 'DAMAGECOUNT': '3.942', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:10,709][52669] DAMAGECOUNT value on done: 23068.0 [2024-08-05 23:09:10,710][52669] Sum rewards: 19.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.561', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.440', 'HITCOUNT': '1.640', 'weapon3': '1.988', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:11,387][52794] DAMAGECOUNT value on done: 27740.0 [2024-08-05 23:09:11,387][52794] Sum rewards: 17.812, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.032', 'WEAPON5': '0.050', 'HEALTH': '0.082', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO4': '0.130', 'WEAPON3': '0.550', 'ARMOR': '0.968', 'HITCOUNT': '1.280', 'weapon2': '1.530', 'weapon3': '1.872', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:11,500][52662] DAMAGECOUNT value on done: 25310.0 [2024-08-05 23:09:11,500][52662] Sum rewards: 16.985, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.311', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.062', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.500', 'weapon4': '0.656', 'weapon2': '0.774', 'WEAPON3': '0.850', 'ARMOR': '0.933', 'HITCOUNT': '1.240', 'weapon3': '1.806', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:12,794][52567] Fps is (10 sec: 13926.3, 60 sec: 14472.5, 300 sec: 15162.1). Total num frames: 104824832. Throughput: 0: 3680.7. Samples: 26216590. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:09:12,795][52567] Avg episode reward: [(0, '18.269')] [2024-08-05 23:09:14,142][52669] DAMAGECOUNT value on done: 23136.0 [2024-08-05 23:09:14,143][52669] Sum rewards: 24.899, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.075', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.336', 'ARMOR': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.318', 'HITCOUNT': '1.660', 'weapon3': '1.842', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '21.000'} [2024-08-05 23:09:14,212][52795] DAMAGECOUNT value on done: 20891.0 [2024-08-05 23:09:14,213][52795] Sum rewards: 13.034, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.910', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.006', 'weapon5': '0.036', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.454', 'WEAPON3': '0.900', 'weapon2': '1.104', 'ARMOR': '1.295', 'HITCOUNT': '1.350', 'weapon3': '1.808', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '9.500'} [2024-08-05 23:09:14,479][52650] Updated weights for policy 0, policy_version 12801 (0.0026) [2024-08-05 23:09:14,909][52794] DAMAGECOUNT value on done: 26903.0 [2024-08-05 23:09:14,915][52794] Sum rewards: 18.842, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '1.312', 'weapon2': '1.476', 'HITCOUNT': '1.490', 'weapon3': '1.716', 'DAMAGECOUNT': '5.103', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:15,031][52662] DAMAGECOUNT value on done: 25337.0 [2024-08-05 23:09:15,032][52662] Sum rewards: 15.209, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.076', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO3': '0.073', 'WEAPON4': '0.200', 'weapon4': '0.388', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.150', 'weapon2': '1.326', 'weapon3': '1.494', 'DAMAGECOUNT': '4.194', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:16,180][52666] DAMAGECOUNT value on done: 21995.0 [2024-08-05 23:09:16,183][52666] Sum rewards: 15.938, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.540', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'weapon5': '0.182', 'weapon4': '0.304', 'WEAPON3': '0.500', 'weapon2': '0.926', 'HITCOUNT': '1.100', 'weapon3': '1.286', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:16,231][52665] DAMAGECOUNT value on done: 21084.0 [2024-08-05 23:09:16,232][52665] Sum rewards: 14.311, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.070', 'weapon5': '0.072', 'WEAPON5': '0.150', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.946', 'HITCOUNT': '1.110', 'weapon2': '1.432', 'weapon3': '1.516', 'DAMAGECOUNT': '3.951', 'FRAGCOUNT': '10.000'} [2024-08-05 23:09:17,786][52794] DAMAGECOUNT value on done: 27749.0 [2024-08-05 23:09:17,786][52794] Sum rewards: 19.811, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.950', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.176', 'ARMOR': '0.448', 'WEAPON3': '0.800', 'HITCOUNT': '1.400', 'weapon2': '1.460', 'weapon3': '1.772', 'DAMAGECOUNT': '5.301', 'FRAGCOUNT': '17.000'} [2024-08-05 23:09:17,794][52567] Fps is (10 sec: 14746.2, 60 sec: 14745.7, 300 sec: 15162.1). Total num frames: 104906752. Throughput: 0: 3685.3. Samples: 26227610. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:09:17,795][52567] Avg episode reward: [(0, '17.988')] [2024-08-05 23:09:17,800][52669] DAMAGECOUNT value on done: 23621.0 [2024-08-05 23:09:17,801][52669] Sum rewards: 23.695, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.044', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.432', 'HITCOUNT': '1.830', 'weapon3': '1.908', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '17.000'} [2024-08-05 23:09:17,802][52795] DAMAGECOUNT value on done: 22508.0 [2024-08-05 23:09:17,804][52795] Sum rewards: 22.989, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'HEALTH': '0.130', 'weapon5': '0.138', 'WEAPON3': '0.400', 'ARMOR': '0.455', 'weapon3': '1.226', 'HITCOUNT': '1.490', 'weapon2': '1.662', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:17,827][52662] DAMAGECOUNT value on done: 27251.0 [2024-08-05 23:09:17,828][52662] Sum rewards: 21.234, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.598', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.106', 'AMMO3': '0.111', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon4': '0.508', 'WEAPON3': '0.700', 'weapon2': '1.162', 'HITCOUNT': '1.460', 'weapon3': '1.704', 'DAMAGECOUNT': '5.394', 'FRAGCOUNT': '15.500'} [2024-08-05 23:09:19,882][52666] DAMAGECOUNT value on done: 21883.0 [2024-08-05 23:09:19,886][52666] Sum rewards: 20.066, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.784', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.097', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.546', 'HITCOUNT': '1.580', 'weapon3': '1.826', 'DAMAGECOUNT': '5.676', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:19,968][52665] DAMAGECOUNT value on done: 22613.0 [2024-08-05 23:09:19,968][52665] Sum rewards: 22.689, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.365', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'weapon4': '0.256', 'WEAPON4': '0.300', 'ARMOR': '0.472', 'WEAPON3': '1.000', 'weapon2': '1.392', 'HITCOUNT': '1.580', 'weapon3': '2.052', 'DAMAGECOUNT': '6.132', 'FRAGCOUNT': '19.000'} [2024-08-05 23:09:20,109][52650] Updated weights for policy 0, policy_version 12811 (0.0020) [2024-08-05 23:09:20,320][52794] DAMAGECOUNT value on done: 23179.0 [2024-08-05 23:09:20,321][52794] Sum rewards: 13.945, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.230', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.084', 'weapon4': '0.294', 'ARMOR': '0.428', 'WEAPON3': '0.550', 'HITCOUNT': '1.170', 'weapon2': '1.258', 'weapon3': '1.626', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '10.000'} [2024-08-05 23:09:20,366][52662] DAMAGECOUNT value on done: 29276.0 [2024-08-05 23:09:20,366][52662] Sum rewards: 14.343, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.044', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.078', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'weapon4': '0.550', 'WEAPON3': '0.600', 'weapon2': '0.802', 'HITCOUNT': '1.250', 'weapon3': '1.530', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '10.000'} [2024-08-05 23:09:20,967][52670] DAMAGECOUNT value on done: 22375.0 [2024-08-05 23:09:20,971][52670] Sum rewards: 16.257, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.082', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'ARMOR': '0.028', 'AMMO3': '0.067', 'WEAPON4': '0.100', 'weapon4': '0.278', 'WEAPON3': '0.550', 'HITCOUNT': '1.260', 'weapon3': '1.298', 'weapon2': '1.380', 'DAMAGECOUNT': '4.161', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:21,383][52669] DAMAGECOUNT value on done: 23402.0 [2024-08-05 23:09:21,388][52669] Sum rewards: 14.498, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.208', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.104', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.392', 'WEAPON3': '0.950', 'ARMOR': '0.956', 'weapon2': '1.004', 'HITCOUNT': '1.160', 'weapon3': '1.644', 'DAMAGECOUNT': '4.068', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:21,482][52795] DAMAGECOUNT value on done: 23183.0 [2024-08-05 23:09:21,483][52795] Sum rewards: 25.244, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.014', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'weapon4': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '1.316', 'HITCOUNT': '1.760', 'weapon3': '1.898', 'weapon2': '1.984', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '19.000'} [2024-08-05 23:09:22,794][52567] Fps is (10 sec: 15564.8, 60 sec: 14745.6, 300 sec: 15106.6). Total num frames: 104980480. Throughput: 0: 3687.2. Samples: 26249500. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:09:22,794][52567] Avg episode reward: [(0, '18.041')] [2024-08-05 23:09:22,810][52794] DAMAGECOUNT value on done: 27193.0 [2024-08-05 23:09:22,811][52794] Sum rewards: 18.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.322', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '1.020', 'WEAPON3': '1.050', 'HITCOUNT': '1.600', 'ARMOR': '1.851', 'weapon3': '2.412', 'DAMAGECOUNT': '5.616', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:22,824][52662] DAMAGECOUNT value on done: 29585.0 [2024-08-05 23:09:22,825][52662] Sum rewards: 19.534, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.090', 'weapon5': '0.110', 'WEAPON5': '0.150', 'HEALTH': '0.306', 'WEAPON3': '0.600', 'ARMOR': '0.949', 'HITCOUNT': '1.410', 'weapon3': '1.670', 'weapon2': '1.828', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:23,384][52665] DAMAGECOUNT value on done: 23631.0 [2024-08-05 23:09:23,384][52665] Sum rewards: 22.435, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.641', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO3': '0.141', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON3': '0.900', 'ARMOR': '0.977', 'weapon2': '1.404', 'HITCOUNT': '1.480', 'weapon3': '1.682', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:23,707][52666] DAMAGECOUNT value on done: 22456.0 [2024-08-05 23:09:23,711][52666] Sum rewards: 20.320, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.464', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.142', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'weapon4': '0.528', 'weapon2': '0.808', 'WEAPON3': '1.000', 'HITCOUNT': '1.470', 'weapon3': '2.240', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:24,640][52670] DAMAGECOUNT value on done: 23092.0 [2024-08-05 23:09:24,644][52670] Sum rewards: 21.303, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.103', 'weapon4': '0.344', 'WEAPON3': '0.450', 'HEALTH': '0.682', 'ARMOR': '1.292', 'HITCOUNT': '1.350', 'weapon3': '1.456', 'weapon2': '1.794', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:24,992][52669] DAMAGECOUNT value on done: 24290.0 [2024-08-05 23:09:24,993][52669] Sum rewards: 20.937, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON3': '0.900', 'ARMOR': '1.350', 'weapon2': '1.440', 'HITCOUNT': '1.620', 'weapon3': '2.142', 'DAMAGECOUNT': '6.018', 'FRAGCOUNT': '17.000'} [2024-08-05 23:09:25,031][52795] DAMAGECOUNT value on done: 21256.0 [2024-08-05 23:09:25,034][52795] Sum rewards: 15.359, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.801', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.032', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON3': '0.700', 'weapon2': '1.324', 'HITCOUNT': '1.470', 'weapon3': '1.742', 'DAMAGECOUNT': '4.974', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:25,268][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:09:25,887][52794] DAMAGECOUNT value on done: 27223.0 [2024-08-05 23:09:25,888][52794] Sum rewards: 17.984, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.752', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.057', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.935', 'weapon2': '1.096', 'weapon3': '1.552', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '5.826', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:25,908][52662] DAMAGECOUNT value on done: 25933.0 [2024-08-05 23:09:25,909][52662] Sum rewards: 14.219, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.988', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.068', 'AMMO3': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.851', 'HITCOUNT': '0.970', 'weapon3': '1.470', 'weapon2': '1.476', 'DAMAGECOUNT': '3.462', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:25,915][52650] Updated weights for policy 0, policy_version 12821 (0.0022) [2024-08-05 23:09:26,987][52665] DAMAGECOUNT value on done: 23656.0 [2024-08-05 23:09:26,988][52665] Sum rewards: 13.293, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.524', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.137', 'weapon4': '0.184', 'WEAPON4': '0.200', 'ARMOR': '0.812', 'WEAPON3': '0.950', 'weapon2': '1.438', 'HITCOUNT': '1.590', 'weapon3': '2.090', 'DAMAGECOUNT': '5.379', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:27,695][52666] DAMAGECOUNT value on done: 21580.0 [2024-08-05 23:09:27,699][52666] Sum rewards: 18.664, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '1.342', 'weapon3': '1.484', 'HITCOUNT': '1.510', 'weapon2': '2.042', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:27,794][52567] Fps is (10 sec: 15564.8, 60 sec: 14882.1, 300 sec: 15106.6). Total num frames: 105062400. Throughput: 0: 3685.8. Samples: 26271480. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:09:27,795][52567] Avg episode reward: [(0, '18.376')] [2024-08-05 23:09:28,418][52669] DAMAGECOUNT value on done: 25055.0 [2024-08-05 23:09:28,420][52669] Sum rewards: 24.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.912', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.040', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'ARMOR': '0.880', 'weapon2': '1.144', 'WEAPON3': '1.400', 'HITCOUNT': '1.720', 'weapon3': '2.508', 'DAMAGECOUNT': '7.605', 'FRAGCOUNT': '24.000'} [2024-08-05 23:09:28,574][52794] DAMAGECOUNT value on done: 26719.0 [2024-08-05 23:09:28,575][52794] Sum rewards: 12.884, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.072', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '0.550', 'ARMOR': '0.964', 'HITCOUNT': '1.100', 'weapon2': '1.632', 'weapon3': '1.636', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '9.000'} [2024-08-05 23:09:28,623][52662] DAMAGECOUNT value on done: 27120.0 [2024-08-05 23:09:28,622][52795] DAMAGECOUNT value on done: 21275.0 [2024-08-05 23:09:28,624][52662] Sum rewards: 16.891, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.064', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.078', 'ARMOR': '0.084', 'AMMO3': '0.104', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.580', 'WEAPON3': '0.600', 'weapon2': '1.080', 'HITCOUNT': '1.090', 'weapon3': '1.478', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:28,624][52795] Sum rewards: 15.781, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.086', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.286', 'ARMOR': '0.412', 'HITCOUNT': '1.070', 'WEAPON3': '1.100', 'weapon2': '1.176', 'weapon3': '1.910', 'DAMAGECOUNT': '4.164', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:28,706][52670] DAMAGECOUNT value on done: 21552.0 [2024-08-05 23:09:28,712][52670] Sum rewards: 13.481, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.389', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'weapon4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.126', 'AMMO3': '0.127', 'WEAPON5': '0.300', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'HITCOUNT': '1.140', 'weapon2': '1.496', 'weapon3': '1.876', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:30,518][52665] DAMAGECOUNT value on done: 21923.0 [2024-08-05 23:09:30,520][52665] Sum rewards: 20.690, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.124', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.544', 'WEAPON3': '0.900', 'weapon2': '1.074', 'ARMOR': '1.389', 'HITCOUNT': '1.650', 'weapon3': '1.742', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:31,407][52650] Updated weights for policy 0, policy_version 12831 (0.0023) [2024-08-05 23:09:31,412][52666] DAMAGECOUNT value on done: 21811.0 [2024-08-05 23:09:31,413][52666] Sum rewards: 18.916, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.878', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.084', 'AMMO3': '0.130', 'AMMO4': '0.159', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'weapon2': '1.150', 'HITCOUNT': '1.350', 'weapon3': '1.912', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:31,559][52794] DAMAGECOUNT value on done: 27294.0 [2024-08-05 23:09:31,560][52794] Sum rewards: 15.757, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.905', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.510', 'WEAPON3': '0.650', 'weapon2': '1.378', 'HITCOUNT': '1.420', 'weapon3': '1.494', 'DAMAGECOUNT': '5.022', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:31,621][52662] DAMAGECOUNT value on done: 26209.0 [2024-08-05 23:09:31,621][52662] Sum rewards: 24.012, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.606', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.024', 'AMMO4': '0.075', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.304', 'WEAPON3': '0.650', 'weapon2': '1.054', 'HITCOUNT': '1.700', 'weapon3': '1.928', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:32,181][52669] DAMAGECOUNT value on done: 24796.0 [2024-08-05 23:09:32,182][52669] Sum rewards: 17.215, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.260', 'ARMOR': '0.481', 'WEAPON3': '0.600', 'HITCOUNT': '1.360', 'weapon2': '1.566', 'weapon3': '1.746', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:32,244][52795] DAMAGECOUNT value on done: 21699.0 [2024-08-05 23:09:32,250][52795] Sum rewards: 17.641, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.512', 'AMMO2': '0.009', 'AMMO5': '0.019', 'AMMO4': '0.046', 'AMMO3': '0.104', 'weapon5': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.521', 'weapon4': '0.530', 'WEAPON3': '0.750', 'weapon2': '0.934', 'HITCOUNT': '1.200', 'weapon3': '1.686', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '14.500'} [2024-08-05 23:09:32,556][52670] DAMAGECOUNT value on done: 23561.0 [2024-08-05 23:09:32,557][52670] Sum rewards: 17.293, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.671', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'HITCOUNT': '1.340', 'weapon3': '1.404', 'weapon2': '1.702', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:32,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14745.6, 300 sec: 15051.1). Total num frames: 105127936. Throughput: 0: 3684.7. Samples: 26282530. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:09:32,795][52567] Avg episode reward: [(0, '18.462')] [2024-08-05 23:09:33,953][52665] DAMAGECOUNT value on done: 22812.0 [2024-08-05 23:09:33,954][52665] Sum rewards: 19.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.109', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.350', 'weapon4': '0.442', 'ARMOR': '0.457', 'weapon2': '0.744', 'WEAPON3': '0.750', 'weapon3': '1.492', 'HITCOUNT': '1.520', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:34,611][52669] DAMAGECOUNT value on done: 22039.0 [2024-08-05 23:09:34,612][52669] Sum rewards: 13.431, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.641', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'WEAPON4': '0.450', 'weapon4': '0.738', 'WEAPON3': '0.850', 'weapon2': '0.918', 'ARMOR': '0.929', 'HITCOUNT': '1.230', 'weapon3': '1.858', 'DAMAGECOUNT': '4.566', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:35,135][52666] DAMAGECOUNT value on done: 21702.0 [2024-08-05 23:09:35,136][52666] Sum rewards: 30.640, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.579', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.258', 'ARMOR': '0.879', 'WEAPON3': '0.950', 'weapon2': '1.242', 'HITCOUNT': '1.920', 'weapon3': '2.188', 'DAMAGECOUNT': '8.031', 'FRAGCOUNT': '24.000'} [2024-08-05 23:09:35,299][52794] DAMAGECOUNT value on done: 25712.0 [2024-08-05 23:09:35,299][52794] Sum rewards: 19.399, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.252', 'WEAPON3': '0.600', 'HITCOUNT': '1.540', 'weapon3': '1.560', 'weapon2': '1.740', 'DAMAGECOUNT': '4.998', 'FRAGCOUNT': '15.500'} [2024-08-05 23:09:35,309][52662] DAMAGECOUNT value on done: 25472.0 [2024-08-05 23:09:35,309][52662] Sum rewards: 23.933, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.766', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'weapon5': '0.024', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'ARMOR': '0.852', 'WEAPON3': '0.950', 'HITCOUNT': '1.540', 'weapon2': '1.588', 'weapon3': '2.102', 'DAMAGECOUNT': '6.192', 'FRAGCOUNT': '21.000'} [2024-08-05 23:09:36,330][52670] DAMAGECOUNT value on done: 21080.0 [2024-08-05 23:09:36,333][52670] Sum rewards: 16.998, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.283', 'weapon5': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.082', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'ARMOR': '0.424', 'WEAPON3': '0.900', 'weapon2': '1.314', 'HITCOUNT': '1.490', 'weapon3': '2.074', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:37,395][52650] Updated weights for policy 0, policy_version 12841 (0.0012) [2024-08-05 23:09:37,794][52567] Fps is (10 sec: 13107.3, 60 sec: 14745.9, 300 sec: 14967.8). Total num frames: 105193472. Throughput: 0: 3681.6. Samples: 26304430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:09:37,795][52567] Avg episode reward: [(0, '18.520')] [2024-08-05 23:09:38,167][52665] DAMAGECOUNT value on done: 23544.0 [2024-08-05 23:09:38,171][52665] Sum rewards: 26.375, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.616', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'WEAPON3': '0.950', 'ARMOR': '0.978', 'weapon2': '1.608', 'HITCOUNT': '1.720', 'weapon3': '1.796', 'DAMAGECOUNT': '5.898', 'FRAGCOUNT': '23.000'} [2024-08-05 23:09:38,376][52669] DAMAGECOUNT value on done: 22765.0 [2024-08-05 23:09:38,378][52669] Sum rewards: 24.612, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.775', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.018', 'AMMO4': '0.080', 'weapon7': '0.082', 'AMMO3': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.442', 'WEAPON3': '0.700', 'weapon2': '1.166', 'HITCOUNT': '1.580', 'weapon3': '1.892', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:38,536][52664] DAMAGECOUNT value on done: 22979.0 [2024-08-05 23:09:38,537][52664] Sum rewards: 16.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.500', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.096', 'AMMO3': '0.103', 'ARMOR': '0.460', 'WEAPON3': '0.800', 'HITCOUNT': '1.110', 'weapon3': '1.748', 'weapon2': '1.878', 'DAMAGECOUNT': '3.633', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:38,607][52666] DAMAGECOUNT value on done: 22431.0 [2024-08-05 23:09:38,608][52666] Sum rewards: 19.169, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.068', 'HEALTH': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'ARMOR': '0.412', 'WEAPON3': '0.700', 'HITCOUNT': '1.430', 'weapon2': '1.648', 'weapon3': '1.828', 'DAMAGECOUNT': '4.971', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:39,264][52662] DAMAGECOUNT value on done: 27648.0 [2024-08-05 23:09:39,264][52662] Sum rewards: 24.025, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.570', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon7': '0.042', 'AMMO3': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.372', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'weapon2': '0.660', 'weapon4': '0.756', 'HITCOUNT': '1.320', 'weapon3': '1.506', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '18.500'} [2024-08-05 23:09:39,277][52794] DAMAGECOUNT value on done: 30192.0 [2024-08-05 23:09:39,277][52794] Sum rewards: 20.722, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.165', 'AMMO5': '0.009', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.074', 'weapon5': '0.080', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.466', 'WEAPON3': '0.550', 'weapon2': '1.298', 'HITCOUNT': '1.320', 'weapon3': '1.480', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '15.500'} [2024-08-05 23:09:39,454][52670] DAMAGECOUNT value on done: 24145.0 [2024-08-05 23:09:39,455][52670] Sum rewards: 23.286, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.811', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.008', 'weapon4': '0.012', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '1.610', 'weapon2': '1.740', 'weapon3': '1.948', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '19.000'} [2024-08-05 23:09:40,053][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:09:41,700][52665] DAMAGECOUNT value on done: 23438.0 [2024-08-05 23:09:41,700][52665] Sum rewards: 19.950, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.045', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'AMMO4': '0.121', 'weapon4': '0.148', 'WEAPON4': '0.200', 'ARMOR': '0.503', 'WEAPON3': '0.750', 'weapon2': '1.284', 'HITCOUNT': '1.570', 'weapon3': '2.198', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:41,817][52662] DAMAGECOUNT value on done: 26124.0 [2024-08-05 23:09:41,817][52662] Sum rewards: 16.132, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.410', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon5': '0.014', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.440', 'weapon2': '1.576', 'weapon3': '1.702', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:41,842][52794] DAMAGECOUNT value on done: 25018.0 [2024-08-05 23:09:41,844][52794] Sum rewards: 15.226, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.216', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.118', 'AMMO3': '0.126', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.875', 'HITCOUNT': '1.170', 'weapon2': '1.368', 'weapon3': '1.820', 'DAMAGECOUNT': '4.035', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:41,900][52669] DAMAGECOUNT value on done: 22431.0 [2024-08-05 23:09:41,901][52669] Sum rewards: 19.296, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.467', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.430', 'WEAPON3': '0.550', 'ARMOR': '0.828', 'weapon2': '1.158', 'HITCOUNT': '1.300', 'weapon3': '1.484', 'DAMAGECOUNT': '5.199', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:42,178][52666] DAMAGECOUNT value on done: 22583.0 [2024-08-05 23:09:42,179][52666] Sum rewards: 23.835, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.710', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.109', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.418', 'HITCOUNT': '1.590', 'weapon3': '1.964', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:42,424][52664] DAMAGECOUNT value on done: 21671.0 [2024-08-05 23:09:42,426][52664] Sum rewards: 18.637, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.823', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.800', 'ARMOR': '0.878', 'HITCOUNT': '1.340', 'weapon2': '1.492', 'weapon3': '1.804', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:42,649][52650] Updated weights for policy 0, policy_version 12851 (0.0018) [2024-08-05 23:09:42,794][52567] Fps is (10 sec: 14745.7, 60 sec: 14745.6, 300 sec: 14995.5). Total num frames: 105275392. Throughput: 0: 3673.1. Samples: 26326220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:09:42,794][52567] Avg episode reward: [(0, '18.663')] [2024-08-05 23:09:42,983][52670] DAMAGECOUNT value on done: 21137.0 [2024-08-05 23:09:42,984][52670] Sum rewards: 15.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.532', 'AMMO5': '0.003', 'AMMO2': '0.028', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.134', 'AMMO4': '0.140', 'weapon4': '0.148', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'HITCOUNT': '1.520', 'weapon3': '1.592', 'weapon2': '1.820', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '12.500'} [2024-08-05 23:09:44,976][52666] DAMAGECOUNT value on done: 22689.0 [2024-08-05 23:09:44,976][52666] Sum rewards: 15.233, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.640', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.092', 'weapon4': '0.218', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'HITCOUNT': '1.150', 'weapon3': '1.446', 'weapon2': '1.466', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:45,104][52667] DAMAGECOUNT value on done: 23177.0 [2024-08-05 23:09:45,106][52667] Sum rewards: 19.587, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon7': '0.052', 'HEALTH': '0.060', 'AMMO4': '0.082', 'weapon4': '0.084', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON3': '0.550', 'weapon2': '0.950', 'ARMOR': '1.200', 'HITCOUNT': '1.490', 'weapon3': '1.690', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:45,127][52662] DAMAGECOUNT value on done: 29312.0 [2024-08-05 23:09:45,128][52662] Sum rewards: 20.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.177', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.428', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '1.976', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '7.551', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:45,154][52794] DAMAGECOUNT value on done: 26589.0 [2024-08-05 23:09:45,154][52794] Sum rewards: 21.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.926', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'AMMO4': '0.180', 'WEAPON4': '0.450', 'ARMOR': '0.469', 'weapon2': '0.772', 'weapon4': '0.872', 'WEAPON3': '0.900', 'weapon3': '1.800', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '6.969', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:45,466][52665] DAMAGECOUNT value on done: 24837.0 [2024-08-05 23:09:45,467][52665] Sum rewards: 22.359, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.106', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'ARMOR': '0.032', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.278', 'WEAPON3': '0.700', 'weapon2': '1.376', 'weapon3': '1.554', 'HITCOUNT': '1.610', 'DAMAGECOUNT': '5.934', 'FRAGCOUNT': '17.000'} [2024-08-05 23:09:45,799][52669] DAMAGECOUNT value on done: 23886.0 [2024-08-05 23:09:45,800][52669] Sum rewards: 25.314, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'weapon5': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.034', 'ARMOR': '0.040', 'weapon4': '0.074', 'AMMO3': '0.109', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.606', 'HITCOUNT': '1.940', 'weapon3': '1.952', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '20.000'} [2024-08-05 23:09:46,113][52670] DAMAGECOUNT value on done: 21242.0 [2024-08-05 23:09:46,114][52670] Sum rewards: 15.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.204', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.104', 'AMMO3': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'ARMOR': '1.282', 'HITCOUNT': '1.570', 'weapon2': '1.596', 'weapon3': '1.822', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '13.500'} [2024-08-05 23:09:46,373][52664] DAMAGECOUNT value on done: 25132.0 [2024-08-05 23:09:46,374][52664] Sum rewards: 21.402, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.420', 'AMMO2': '0.014', 'AMMO3': '0.065', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON3': '0.450', 'weapon4': '0.454', 'ARMOR': '0.880', 'HITCOUNT': '1.270', 'weapon2': '1.334', 'weapon3': '1.338', 'DAMAGECOUNT': '4.296', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:47,794][52567] Fps is (10 sec: 15564.8, 60 sec: 14745.6, 300 sec: 14967.8). Total num frames: 105349120. Throughput: 0: 3668.0. Samples: 26337200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:09:47,794][52567] Avg episode reward: [(0, '18.893')] [2024-08-05 23:09:47,801][52614] Saving new best policy, reward=18.893! [2024-08-05 23:09:48,024][52662] DAMAGECOUNT value on done: 29490.0 [2024-08-05 23:09:48,026][52662] Sum rewards: 26.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.853', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.060', 'AMMO4': '0.107', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '1.312', 'weapon2': '1.538', 'HITCOUNT': '1.920', 'weapon3': '1.984', 'DAMAGECOUNT': '7.170', 'FRAGCOUNT': '22.000'} [2024-08-05 23:09:48,049][52794] DAMAGECOUNT value on done: 28083.0 [2024-08-05 23:09:48,050][52794] Sum rewards: 19.784, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.382', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO3': '0.114', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.852', 'HITCOUNT': '1.400', 'weapon2': '1.656', 'weapon3': '1.914', 'DAMAGECOUNT': '5.253', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:48,366][52650] Updated weights for policy 0, policy_version 12861 (0.0020) [2024-08-05 23:09:48,584][52667] DAMAGECOUNT value on done: 25167.0 [2024-08-05 23:09:48,584][52667] Sum rewards: 22.550, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'weapon2': '1.514', 'HITCOUNT': '1.760', 'weapon3': '1.860', 'ARMOR': '2.116', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:49,031][52665] DAMAGECOUNT value on done: 24083.0 [2024-08-05 23:09:49,034][52665] Sum rewards: 25.196, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.128', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.850', 'weapon2': '0.926', 'HITCOUNT': '1.960', 'weapon3': '1.968', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '19.000'} [2024-08-05 23:09:49,183][52666] DAMAGECOUNT value on done: 21177.0 [2024-08-05 23:09:49,183][52666] Sum rewards: 14.242, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.387', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.750', 'ARMOR': '0.857', 'HITCOUNT': '0.960', 'weapon2': '1.380', 'weapon3': '1.886', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:49,406][52669] DAMAGECOUNT value on done: 26157.0 [2024-08-05 23:09:49,407][52669] Sum rewards: 27.885, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.932', 'AMMO2': '0.001', 'AMMO4': '0.002', 'weapon4': '0.024', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'weapon2': '1.774', 'HITCOUNT': '1.880', 'weapon3': '1.940', 'DAMAGECOUNT': '7.203', 'FRAGCOUNT': '22.000'} [2024-08-05 23:09:49,972][52664] DAMAGECOUNT value on done: 23709.0 [2024-08-05 23:09:49,973][52664] Sum rewards: 25.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.430', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.016', 'weapon5': '0.056', 'AMMO4': '0.066', 'AMMO3': '0.100', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.096', 'HITCOUNT': '1.720', 'weapon3': '1.812', 'DAMAGECOUNT': '7.398', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:50,542][52670] DAMAGECOUNT value on done: 20051.0 [2024-08-05 23:09:50,544][52670] Sum rewards: 13.561, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.757', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.092', 'weapon4': '0.194', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'HITCOUNT': '1.280', 'weapon2': '1.556', 'weapon3': '1.956', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '10.000'} [2024-08-05 23:09:50,676][52662] DAMAGECOUNT value on done: 26349.0 [2024-08-05 23:09:50,676][52662] Sum rewards: 24.957, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.729', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'ARMOR': '0.451', 'WEAPON3': '0.650', 'weapon2': '1.490', 'HITCOUNT': '1.560', 'weapon3': '1.804', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '20.000'} [2024-08-05 23:09:50,708][52794] DAMAGECOUNT value on done: 27912.0 [2024-08-05 23:09:50,708][52794] Sum rewards: 16.108, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.022', 'HEALTH': '0.031', 'ARMOR': '0.048', 'AMMO3': '0.060', 'weapon7': '0.072', 'AMMO4': '0.111', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.544', 'weapon2': '0.866', 'HITCOUNT': '1.020', 'weapon3': '1.288', 'DAMAGECOUNT': '3.555', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:51,995][52667] DAMAGECOUNT value on done: 21869.0 [2024-08-05 23:09:52,001][52667] Sum rewards: 9.124, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.043', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.091', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.306', 'WEAPON3': '0.500', 'ARMOR': '0.800', 'HITCOUNT': '0.930', 'weapon3': '1.360', 'weapon2': '1.394', 'DAMAGECOUNT': '2.952', 'FRAGCOUNT': '7.000'} [2024-08-05 23:09:52,426][52665] DAMAGECOUNT value on done: 23417.0 [2024-08-05 23:09:52,428][52665] Sum rewards: 11.897, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.342', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.450', 'ARMOR': '0.550', 'weapon4': '0.630', 'WEAPON3': '0.750', 'weapon2': '0.812', 'HITCOUNT': '1.230', 'weapon3': '1.354', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '9.000'} [2024-08-05 23:09:52,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14745.6, 300 sec: 14940.0). Total num frames: 105422848. Throughput: 0: 3658.0. Samples: 26358880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:09:52,795][52567] Avg episode reward: [(0, '18.969')] [2024-08-05 23:09:52,796][52614] Saving new best policy, reward=18.969! [2024-08-05 23:09:53,112][52662] DAMAGECOUNT value on done: 27246.0 [2024-08-05 23:09:53,116][52794] DAMAGECOUNT value on done: 26797.0 [2024-08-05 23:09:53,116][52662] Sum rewards: 21.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.926', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.184', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'ARMOR': '1.013', 'HITCOUNT': '1.490', 'weapon2': '1.552', 'weapon3': '2.020', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '21.000'} [2024-08-05 23:09:53,116][52794] Sum rewards: 25.155, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON3': '0.650', 'ARMOR': '0.864', 'weapon3': '1.642', 'HITCOUNT': '1.810', 'weapon2': '2.062', 'DAMAGECOUNT': '6.942', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:53,149][52666] DAMAGECOUNT value on done: 18807.0 [2024-08-05 23:09:53,151][52666] Sum rewards: 13.659, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.933', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.007', 'weapon5': '0.054', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.152', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.861', 'HITCOUNT': '1.200', 'weapon2': '1.674', 'weapon3': '1.758', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:53,812][52669] DAMAGECOUNT value on done: 23052.0 [2024-08-05 23:09:53,813][52669] Sum rewards: 20.651, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.482', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.092', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'ARMOR': '0.444', 'WEAPON3': '0.850', 'HITCOUNT': '1.430', 'weapon2': '1.612', 'weapon3': '1.838', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:53,856][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:09:54,038][52664] DAMAGECOUNT value on done: 22666.0 [2024-08-05 23:09:54,038][52664] Sum rewards: 22.574, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.071', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.250', 'HEALTH': '0.260', 'weapon4': '0.260', 'WEAPON3': '0.450', 'ARMOR': '0.892', 'HITCOUNT': '1.300', 'weapon3': '1.310', 'weapon2': '1.496', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '16.000'} [2024-08-05 23:09:54,168][52670] DAMAGECOUNT value on done: 19412.0 [2024-08-05 23:09:54,168][52670] Sum rewards: 15.983, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.902', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'weapon5': '0.042', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.266', 'ARMOR': '0.451', 'WEAPON3': '0.750', 'HITCOUNT': '1.090', 'weapon2': '1.126', 'weapon3': '1.784', 'DAMAGECOUNT': '4.341', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:54,288][52820] DAMAGECOUNT value on done: 19252.0 [2024-08-05 23:09:54,291][52820] Sum rewards: 19.346, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.092', 'AMMO2': '0.022', 'weapon7': '0.054', 'AMMO3': '0.066', 'weapon4': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON3': '0.450', 'ARMOR': '1.149', 'HITCOUNT': '1.310', 'weapon2': '1.344', 'weapon3': '1.378', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:54,307][52650] Updated weights for policy 0, policy_version 12871 (0.0019) [2024-08-05 23:09:55,035][52667] DAMAGECOUNT value on done: 22783.0 [2024-08-05 23:09:55,036][52667] Sum rewards: 14.485, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.925', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.087', 'WEAPON3': '0.600', 'ARMOR': '0.905', 'HITCOUNT': '0.960', 'weapon3': '1.612', 'weapon2': '1.632', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:55,463][52665] DAMAGECOUNT value on done: 22567.0 [2024-08-05 23:09:55,464][52665] Sum rewards: 10.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.092', 'weapon4': '0.112', 'AMMO3': '0.193', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'ARMOR': '0.447', 'WEAPON4': '0.450', 'weapon2': '0.800', 'WEAPON3': '1.200', 'HITCOUNT': '1.450', 'weapon3': '2.326', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '11.500'} [2024-08-05 23:09:55,835][52663] DAMAGECOUNT value on done: 23721.0 [2024-08-05 23:09:55,839][52663] Sum rewards: 13.775, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.492', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'ARMOR': '0.024', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.220', 'WEAPON3': '0.500', 'weapon2': '1.152', 'HITCOUNT': '1.310', 'weapon3': '1.698', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '10.000'} [2024-08-05 23:09:56,279][52662] DAMAGECOUNT value on done: 25342.0 [2024-08-05 23:09:56,280][52662] Sum rewards: 15.748, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.925', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON3': '0.950', 'HITCOUNT': '1.310', 'weapon2': '1.760', 'weapon3': '2.088', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '14.000'} [2024-08-05 23:09:56,298][52794] DAMAGECOUNT value on done: 27685.0 [2024-08-05 23:09:56,298][52794] Sum rewards: 19.914, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.528', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO3': '0.174', 'AMMO4': '0.198', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'ARMOR': '1.315', 'HITCOUNT': '1.320', 'weapon2': '1.588', 'weapon3': '1.644', 'DAMAGECOUNT': '5.454', 'FRAGCOUNT': '18.000'} [2024-08-05 23:09:56,481][52666] DAMAGECOUNT value on done: 20347.0 [2024-08-05 23:09:56,483][52666] Sum rewards: 13.233, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.076', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.069', 'AMMO4': '0.084', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'ARMOR': '0.400', 'HITCOUNT': '1.020', 'weapon3': '1.110', 'weapon2': '1.750', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '9.000'} [2024-08-05 23:09:57,312][52669] DAMAGECOUNT value on done: 24523.0 [2024-08-05 23:09:57,314][52669] Sum rewards: 15.971, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.726', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO3': '0.119', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.885', 'weapon2': '1.366', 'HITCOUNT': '1.440', 'weapon3': '1.812', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '13.000'} [2024-08-05 23:09:57,367][52664] DAMAGECOUNT value on done: 25997.0 [2024-08-05 23:09:57,367][52664] Sum rewards: 15.751, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.056', 'weapon5': '0.056', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.854', 'HITCOUNT': '1.130', 'weapon3': '1.140', 'weapon2': '1.748', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:57,497][52670] DAMAGECOUNT value on done: 22592.0 [2024-08-05 23:09:57,499][52670] Sum rewards: 20.133, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.062', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.200', 'weapon4': '0.206', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon3': '1.626', 'weapon2': '1.628', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '15.000'} [2024-08-05 23:09:57,794][52567] Fps is (10 sec: 13926.4, 60 sec: 14609.1, 300 sec: 14856.7). Total num frames: 105488384. Throughput: 0: 3660.0. Samples: 26381290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:09:57,794][52567] Avg episode reward: [(0, '18.886')] [2024-08-05 23:09:57,977][52820] DAMAGECOUNT value on done: 20956.0 [2024-08-05 23:09:57,979][52820] Sum rewards: 15.964, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.394', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon4': '0.218', 'WEAPON3': '0.550', 'weapon3': '1.386', 'weapon2': '1.410', 'HITCOUNT': '1.460', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:58,304][52667] DAMAGECOUNT value on done: 23942.0 [2024-08-05 23:09:58,305][52667] Sum rewards: 15.835, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.373', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.004', 'weapon5': '0.058', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.448', 'WEAPON3': '0.700', 'ARMOR': '0.868', 'weapon2': '1.108', 'HITCOUNT': '1.290', 'weapon3': '1.664', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '11.000'} [2024-08-05 23:09:58,751][52665] DAMAGECOUNT value on done: 21713.0 [2024-08-05 23:09:58,751][52665] Sum rewards: 12.816, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.794', 'AMMO5': '0.007', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'weapon4': '0.166', 'AMMO4': '0.224', 'WEAPON4': '0.450', 'ARMOR': '0.512', 'WEAPON3': '0.700', 'HITCOUNT': '1.150', 'weapon3': '1.654', 'weapon2': '1.716', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '12.000'} [2024-08-05 23:09:58,863][52662] DAMAGECOUNT value on done: 27771.0 [2024-08-05 23:09:58,864][52662] Sum rewards: 28.101, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.542', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.032', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon5': '0.342', 'ARMOR': '0.499', 'WEAPON3': '0.700', 'weapon2': '1.314', 'weapon3': '1.504', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '21.000'} [2024-08-05 23:09:58,924][52663] DAMAGECOUNT value on done: 23164.0 [2024-08-05 23:09:58,925][52663] Sum rewards: 21.967, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.924', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.071', 'WEAPON3': '0.550', 'ARMOR': '1.245', 'weapon3': '1.354', 'HITCOUNT': '1.420', 'weapon2': '1.708', 'DAMAGECOUNT': '5.415', 'FRAGCOUNT': '17.000'} [2024-08-05 23:09:59,331][52650] Updated weights for policy 0, policy_version 12881 (0.0027) [2024-08-05 23:09:59,835][52666] DAMAGECOUNT value on done: 22018.0 [2024-08-05 23:09:59,837][52666] Sum rewards: 11.758, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.906', 'AMMO5': '0.017', 'weapon5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO3': '0.136', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.832', 'WEAPON3': '0.850', 'HITCOUNT': '1.120', 'weapon2': '1.226', 'weapon3': '1.864', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '9.000'} [2024-08-05 23:10:00,246][52669] DAMAGECOUNT value on done: 24489.0 [2024-08-05 23:10:00,246][52669] Sum rewards: 18.453, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.612', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'ARMOR': '0.489', 'WEAPON3': '0.700', 'weapon2': '1.330', 'HITCOUNT': '1.350', 'weapon3': '2.100', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:00,460][52664] DAMAGECOUNT value on done: 23907.0 [2024-08-05 23:10:00,467][52664] Sum rewards: 27.129, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.556', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.240', 'ARMOR': '0.416', 'WEAPON3': '0.900', 'weapon2': '1.052', 'HITCOUNT': '1.730', 'weapon3': '2.264', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '23.000'} [2024-08-05 23:10:00,907][52667] DAMAGECOUNT value on done: 25386.0 [2024-08-05 23:10:00,908][52667] Sum rewards: 19.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.973', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO3': '0.103', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'HITCOUNT': '1.250', 'weapon2': '1.484', 'weapon3': '1.826', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:00,910][52670] DAMAGECOUNT value on done: 24367.0 [2024-08-05 23:10:00,911][52670] Sum rewards: 18.251, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.984', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.244', 'WEAPON3': '0.700', 'ARMOR': '0.855', 'weapon2': '1.178', 'HITCOUNT': '1.220', 'weapon3': '1.652', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:01,322][52820] DAMAGECOUNT value on done: 19671.0 [2024-08-05 23:10:01,325][52820] Sum rewards: 9.954, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.548', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.004', 'weapon5': '0.036', 'weapon7': '0.084', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.320', 'ARMOR': '0.412', 'WEAPON3': '0.750', 'HITCOUNT': '1.010', 'weapon2': '1.058', 'weapon3': '1.892', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '9.000'} [2024-08-05 23:10:01,690][52665] DAMAGECOUNT value on done: 23215.0 [2024-08-05 23:10:01,692][52665] Sum rewards: 16.008, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.604', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.090', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.550', 'ARMOR': '0.910', 'HITCOUNT': '1.020', 'weapon3': '1.500', 'weapon2': '1.526', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:02,126][52663] DAMAGECOUNT value on done: 23472.0 [2024-08-05 23:10:02,126][52663] Sum rewards: 10.313, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'HEALTH': '0.124', 'weapon4': '0.344', 'WEAPON3': '0.450', 'HITCOUNT': '0.800', 'weapon3': '1.202', 'weapon2': '1.216', 'DAMAGECOUNT': '3.060', 'FRAGCOUNT': '8.000'} [2024-08-05 23:10:02,794][52567] Fps is (10 sec: 14745.6, 60 sec: 14745.6, 300 sec: 14856.7). Total num frames: 105570304. Throughput: 0: 3686.2. Samples: 26393490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:10:02,795][52567] Avg episode reward: [(0, '18.781')] [2024-08-05 23:10:03,080][52666] DAMAGECOUNT value on done: 21534.0 [2024-08-05 23:10:03,083][52666] Sum rewards: 22.288, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.459', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.101', 'weapon5': '0.170', 'weapon4': '0.204', 'WEAPON3': '0.650', 'HITCOUNT': '1.360', 'weapon2': '1.410', 'weapon3': '1.548', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:03,414][52667] DAMAGECOUNT value on done: 25117.0 [2024-08-05 23:10:03,414][52667] Sum rewards: 22.634, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.336', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'WEAPON3': '0.600', 'ARMOR': '0.853', 'weapon3': '1.376', 'HITCOUNT': '1.390', 'weapon2': '1.898', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:03,776][52669] DAMAGECOUNT value on done: 24245.0 [2024-08-05 23:10:03,776][52669] Sum rewards: 20.968, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.645', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.100', 'weapon4': '0.254', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'weapon2': '1.236', 'HITCOUNT': '1.450', 'weapon3': '1.474', 'DAMAGECOUNT': '5.448', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:03,790][52664] DAMAGECOUNT value on done: 21909.0 [2024-08-05 23:10:03,792][52664] Sum rewards: 22.548, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'HEALTH': '0.328', 'weapon4': '0.334', 'WEAPON3': '0.550', 'weapon2': '1.268', 'ARMOR': '1.294', 'HITCOUNT': '1.720', 'weapon3': '1.736', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:04,218][52650] Updated weights for policy 0, policy_version 12891 (0.0023) [2024-08-05 23:10:04,302][52670] DAMAGECOUNT value on done: 23553.0 [2024-08-05 23:10:04,304][52670] Sum rewards: 16.576, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.194', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.081', 'weapon5': '0.100', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.544', 'ARMOR': '0.812', 'HITCOUNT': '1.090', 'weapon2': '1.254', 'weapon3': '1.508', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:04,622][52665] DAMAGECOUNT value on done: 24023.0 [2024-08-05 23:10:04,624][52665] Sum rewards: 27.414, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.708', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.009', 'AMMO3': '0.104', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.236', 'ARMOR': '0.532', 'WEAPON3': '0.800', 'weapon2': '0.956', 'HITCOUNT': '1.660', 'weapon3': '2.094', 'DAMAGECOUNT': '6.816', 'FRAGCOUNT': '22.000'} [2024-08-05 23:10:04,724][52820] DAMAGECOUNT value on done: 21680.0 [2024-08-05 23:10:04,728][52820] Sum rewards: 26.701, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.462', 'AMMO4': '-0.068', 'AMMO2': '-0.014', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.800', 'ARMOR': '1.271', 'weapon3': '1.704', 'HITCOUNT': '1.770', 'weapon2': '1.934', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '21.000'} [2024-08-05 23:10:05,228][52663] DAMAGECOUNT value on done: 24183.0 [2024-08-05 23:10:05,228][52663] Sum rewards: 13.934, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.906', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.062', 'weapon7': '0.080', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.226', 'ARMOR': '0.479', 'WEAPON3': '0.650', 'HITCOUNT': '1.020', 'weapon2': '1.250', 'weapon3': '1.476', 'DAMAGECOUNT': '3.987', 'FRAGCOUNT': '10.000'} [2024-08-05 23:10:06,248][52669] DAMAGECOUNT value on done: 23959.0 [2024-08-05 23:10:06,248][52669] Sum rewards: 12.020, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.010', 'weapon5': '0.014', 'AMMO4': '0.029', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'HITCOUNT': '1.000', 'ARMOR': '1.208', 'weapon3': '1.568', 'weapon2': '1.978', 'DAMAGECOUNT': '3.420', 'FRAGCOUNT': '8.000'} [2024-08-05 23:10:06,486][52666] DAMAGECOUNT value on done: 22339.0 [2024-08-05 23:10:06,488][52666] Sum rewards: 11.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.596', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.448', 'WEAPON3': '0.600', 'ARMOR': '0.820', 'HITCOUNT': '1.280', 'weapon2': '1.348', 'weapon3': '1.462', 'DAMAGECOUNT': '4.278', 'FRAGCOUNT': '7.000'} [2024-08-05 23:10:07,132][52664] DAMAGECOUNT value on done: 26288.0 [2024-08-05 23:10:07,133][52664] Sum rewards: 22.033, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.238', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'weapon3': '1.416', 'HITCOUNT': '1.420', 'weapon2': '1.436', 'DAMAGECOUNT': '5.394', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:07,273][52667] DAMAGECOUNT value on done: 22697.0 [2024-08-05 23:10:07,273][52667] Sum rewards: 19.003, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.283', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.368', 'ARMOR': '0.456', 'WEAPON3': '0.900', 'weapon2': '1.288', 'HITCOUNT': '1.490', 'weapon3': '2.064', 'DAMAGECOUNT': '5.949', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:07,551][52665] DAMAGECOUNT value on done: 22749.0 [2024-08-05 23:10:07,551][52665] Sum rewards: 13.364, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.786', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO2': '0.032', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'ARMOR': '0.938', 'weapon3': '1.512', 'HITCOUNT': '1.520', 'weapon2': '1.774', 'DAMAGECOUNT': '5.004', 'FRAGCOUNT': '12.500'} [2024-08-05 23:10:07,688][52670] DAMAGECOUNT value on done: 23680.0 [2024-08-05 23:10:07,689][52670] Sum rewards: 14.607, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.765', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO3': '0.090', 'weapon4': '0.198', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '1.170', 'weapon2': '1.710', 'weapon3': '1.728', 'DAMAGECOUNT': '4.185', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 14882.3, 300 sec: 14828.9). Total num frames: 105652224. Throughput: 0: 3742.2. Samples: 26417900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:10:07,794][52567] Avg episode reward: [(0, '18.705')] [2024-08-05 23:10:07,888][52663] DAMAGECOUNT value on done: 22122.0 [2024-08-05 23:10:07,888][52663] Sum rewards: 20.307, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.430', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.022', 'ARMOR': '1.306', 'HITCOUNT': '1.310', 'weapon3': '1.752', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:08,123][52820] DAMAGECOUNT value on done: 22675.0 [2024-08-05 23:10:08,125][52820] Sum rewards: 16.558, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.169', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon4': '0.028', 'ARMOR': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.800', 'HITCOUNT': '1.240', 'weapon2': '1.578', 'weapon3': '2.004', 'DAMAGECOUNT': '4.401', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:09,214][52669] DAMAGECOUNT value on done: 23827.0 [2024-08-05 23:10:09,222][52669] Sum rewards: 18.387, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'ARMOR': '0.040', 'AMMO3': '0.050', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.400', 'weapon2': '0.480', 'weapon4': '0.780', 'HITCOUNT': '1.120', 'weapon3': '1.248', 'DAMAGECOUNT': '4.128', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:09,572][52650] Updated weights for policy 0, policy_version 12901 (0.0014) [2024-08-05 23:10:09,628][52666] DAMAGECOUNT value on done: 22216.0 [2024-08-05 23:10:09,628][52666] Sum rewards: 14.841, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'weapon4': '0.328', 'WEAPON3': '0.700', 'ARMOR': '0.851', 'HITCOUNT': '1.140', 'weapon2': '1.452', 'weapon3': '1.570', 'DAMAGECOUNT': '3.786', 'FRAGCOUNT': '13.500'} [2024-08-05 23:10:09,720][52664] DAMAGECOUNT value on done: 23792.0 [2024-08-05 23:10:09,721][52664] Sum rewards: 18.008, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.384', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.020', 'AMMO4': '0.052', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'ARMOR': '0.428', 'WEAPON3': '0.750', 'weapon2': '1.328', 'HITCOUNT': '1.380', 'weapon3': '1.792', 'DAMAGECOUNT': '5.163', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:10,497][52667] DAMAGECOUNT value on done: 24687.0 [2024-08-05 23:10:10,500][52667] Sum rewards: 21.785, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.612', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'weapon5': '0.092', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.290', 'HITCOUNT': '1.780', 'weapon3': '1.982', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:10,736][52670] DAMAGECOUNT value on done: 23822.0 [2024-08-05 23:10:10,736][52670] Sum rewards: 28.809, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.851', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.855', 'weapon2': '1.718', 'HITCOUNT': '1.740', 'weapon3': '1.954', 'DAMAGECOUNT': '6.576', 'FRAGCOUNT': '23.000'} [2024-08-05 23:10:10,777][52663] DAMAGECOUNT value on done: 23931.0 [2024-08-05 23:10:10,778][52663] Sum rewards: 17.529, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.002', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'HITCOUNT': '1.580', 'weapon2': '1.590', 'weapon3': '1.892', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:10,854][52665] DAMAGECOUNT value on done: 22629.0 [2024-08-05 23:10:10,856][52665] Sum rewards: 15.755, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.019', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.105', 'weapon5': '0.168', 'weapon4': '0.204', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'weapon2': '1.054', 'HITCOUNT': '1.190', 'weapon3': '1.746', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:11,456][52820] DAMAGECOUNT value on done: 21525.0 [2024-08-05 23:10:11,456][52820] Sum rewards: 15.870, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.500', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.214', 'WEAPON3': '0.750', 'ARMOR': '0.921', 'HITCOUNT': '1.050', 'weapon2': '1.178', 'weapon3': '1.620', 'DAMAGECOUNT': '3.954', 'FRAGCOUNT': '12.500'} [2024-08-05 23:10:11,757][52658] DAMAGECOUNT value on done: 23454.0 [2024-08-05 23:10:11,759][52658] Sum rewards: 11.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.014', 'ARMOR': '0.024', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON3': '1.050', 'HITCOUNT': '1.300', 'weapon2': '1.380', 'weapon3': '2.188', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:12,247][52669] DAMAGECOUNT value on done: 23394.0 [2024-08-05 23:10:12,247][52669] Sum rewards: 17.663, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.810', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'AMMO3': '0.079', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.424', 'ARMOR': '0.450', 'WEAPON3': '0.700', 'weapon2': '1.268', 'HITCOUNT': '1.370', 'weapon3': '1.544', 'DAMAGECOUNT': '4.335', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:12,794][52567] Fps is (10 sec: 16383.5, 60 sec: 15155.1, 300 sec: 14856.7). Total num frames: 105734144. Throughput: 0: 3800.0. Samples: 26442480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:10:12,795][52567] Avg episode reward: [(0, '18.856')] [2024-08-05 23:10:12,812][52664] DAMAGECOUNT value on done: 27265.0 [2024-08-05 23:10:12,813][52664] Sum rewards: 24.167, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.030', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'AMMO3': '0.063', 'weapon4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'ARMOR': '1.311', 'weapon3': '1.338', 'HITCOUNT': '1.450', 'weapon2': '1.612', 'DAMAGECOUNT': '5.676', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:13,004][52666] DAMAGECOUNT value on done: 20580.0 [2024-08-05 23:10:13,009][52666] Sum rewards: 21.725, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.102', 'AMMO3': '0.116', 'weapon4': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon2': '1.494', 'HITCOUNT': '1.740', 'weapon3': '1.928', 'DAMAGECOUNT': '6.096', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:13,186][52667] DAMAGECOUNT value on done: 24184.0 [2024-08-05 23:10:13,187][52667] Sum rewards: 19.680, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.286', 'HEALTH': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.852', 'HITCOUNT': '1.610', 'weapon3': '1.638', 'weapon2': '1.662', 'DAMAGECOUNT': '6.108', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:13,493][52665] DAMAGECOUNT value on done: 23315.0 [2024-08-05 23:10:13,496][52665] Sum rewards: 21.651, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.228', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.584', 'HITCOUNT': '1.660', 'weapon3': '1.936', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:13,641][52663] DAMAGECOUNT value on done: 26363.0 [2024-08-05 23:10:13,641][52663] Sum rewards: 16.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.267', 'AMMO2': '0.013', 'AMMO5': '0.022', 'AMMO4': '0.063', 'AMMO3': '0.071', 'WEAPON4': '0.150', 'weapon5': '0.306', 'WEAPON5': '0.450', 'weapon4': '0.454', 'WEAPON3': '0.500', 'ARMOR': '0.532', 'weapon2': '0.888', 'HITCOUNT': '1.360', 'weapon3': '1.512', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:14,266][52658] DAMAGECOUNT value on done: 23338.0 [2024-08-05 23:10:14,274][52658] Sum rewards: 23.899, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.687', 'AMMO5': '0.009', 'AMMO2': '0.014', 'ARMOR': '0.036', 'AMMO3': '0.070', 'AMMO4': '0.072', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'weapon4': '0.560', 'weapon2': '0.690', 'weapon3': '1.584', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '6.060', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:14,318][52670] DAMAGECOUNT value on done: 21670.0 [2024-08-05 23:10:14,320][52670] Sum rewards: 13.315, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.270', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'weapon4': '0.048', 'AMMO3': '0.104', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.476', 'WEAPON3': '0.700', 'HITCOUNT': '0.970', 'weapon3': '1.338', 'weapon2': '1.614', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:14,439][52650] Updated weights for policy 0, policy_version 12911 (0.0031) [2024-08-05 23:10:14,805][52669] DAMAGECOUNT value on done: 25852.0 [2024-08-05 23:10:14,807][52669] Sum rewards: 24.908, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.065', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.039', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.197', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '0.900', 'weapon2': '0.926', 'HITCOUNT': '1.820', 'weapon3': '2.134', 'DAMAGECOUNT': '6.849', 'FRAGCOUNT': '20.000'} [2024-08-05 23:10:15,154][52820] DAMAGECOUNT value on done: 21102.0 [2024-08-05 23:10:15,156][52820] Sum rewards: 20.411, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.886', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.130', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.874', 'HITCOUNT': '1.450', 'weapon2': '1.634', 'weapon3': '1.704', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:15,787][52667] DAMAGECOUNT value on done: 22551.0 [2024-08-05 23:10:15,787][52667] Sum rewards: 15.006, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.257', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.152', 'weapon5': '0.224', 'WEAPON3': '0.600', 'ARMOR': '0.886', 'HITCOUNT': '1.220', 'weapon2': '1.316', 'weapon3': '1.480', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:16,103][52664] DAMAGECOUNT value on done: 24321.0 [2024-08-05 23:10:16,103][52664] Sum rewards: 25.953, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.011', 'AMMO2': '0.013', 'HEALTH': '0.032', 'AMMO4': '0.064', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.386', 'WEAPON3': '0.800', 'ARMOR': '0.822', 'weapon2': '1.186', 'weapon3': '1.944', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '8.652', 'FRAGCOUNT': '18.500'} [2024-08-05 23:10:16,330][52666] DAMAGECOUNT value on done: 21252.0 [2024-08-05 23:10:16,332][52666] Sum rewards: 17.290, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.921', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon7': '0.046', 'weapon5': '0.064', 'AMMO3': '0.077', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '0.550', 'HITCOUNT': '1.180', 'weapon2': '1.318', 'weapon3': '1.572', 'DAMAGECOUNT': '4.302', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:16,401][52665] DAMAGECOUNT value on done: 22013.0 [2024-08-05 23:10:16,401][52665] Sum rewards: 12.437, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.775', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.031', 'ARMOR': '0.064', 'AMMO3': '0.095', 'weapon5': '0.110', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.382', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon2': '1.336', 'weapon3': '1.836', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '9.000'} [2024-08-05 23:10:16,562][52663] DAMAGECOUNT value on done: 22653.0 [2024-08-05 23:10:16,563][52663] Sum rewards: 18.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'weapon5': '0.004', 'weapon4': '0.006', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.874', 'HITCOUNT': '1.480', 'weapon2': '1.662', 'weapon3': '1.958', 'DAMAGECOUNT': '5.337', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:16,789][52658] DAMAGECOUNT value on done: 21390.0 [2024-08-05 23:10:16,789][52658] Sum rewards: 14.814, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'ARMOR': '1.320', 'HITCOUNT': '1.460', 'weapon2': '1.762', 'weapon3': '1.766', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:17,518][52670] DAMAGECOUNT value on done: 21683.0 [2024-08-05 23:10:17,518][52670] Sum rewards: 14.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.743', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO3': '0.089', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon5': '0.332', 'ARMOR': '0.508', 'WEAPON3': '0.600', 'HITCOUNT': '1.140', 'weapon2': '1.316', 'weapon3': '1.768', 'DAMAGECOUNT': '4.101', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 15291.8, 300 sec: 14856.7). Total num frames: 105824256. Throughput: 0: 3830.9. Samples: 26454920. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:10:17,794][52567] Avg episode reward: [(0, '18.648')] [2024-08-05 23:10:18,568][52667] DAMAGECOUNT value on done: 23794.0 [2024-08-05 23:10:18,569][52667] Sum rewards: 26.457, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.401', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.224', 'WEAPON3': '0.500', 'weapon3': '1.574', 'HITCOUNT': '1.690', 'weapon2': '1.780', 'DAMAGECOUNT': '5.697', 'FRAGCOUNT': '21.000'} [2024-08-05 23:10:18,654][52820] DAMAGECOUNT value on done: 21198.0 [2024-08-05 23:10:18,654][52820] Sum rewards: 17.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.944', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.110', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.542', 'HITCOUNT': '1.600', 'weapon3': '2.040', 'DAMAGECOUNT': '5.493', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:19,312][52664] DAMAGECOUNT value on done: 23566.0 [2024-08-05 23:10:19,312][52664] Sum rewards: 29.844, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'weapon4': '0.232', 'WEAPON3': '0.700', 'ARMOR': '0.893', 'weapon2': '1.662', 'weapon3': '1.720', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '6.129', 'FRAGCOUNT': '23.000'} [2024-08-05 23:10:19,446][52665] DAMAGECOUNT value on done: 21783.0 [2024-08-05 23:10:19,447][52665] Sum rewards: 14.659, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.892', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'AMMO3': '0.097', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.600', 'HITCOUNT': '1.300', 'weapon3': '1.426', 'weapon2': '1.520', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:19,575][52666] DAMAGECOUNT value on done: 22811.0 [2024-08-05 23:10:19,575][52666] Sum rewards: 8.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.393', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.103', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'WEAPON3': '0.950', 'HITCOUNT': '1.120', 'weapon2': '1.394', 'weapon3': '2.246', 'DAMAGECOUNT': '3.747', 'FRAGCOUNT': '9.000'} [2024-08-05 23:10:19,584][52650] Updated weights for policy 0, policy_version 12921 (0.0011) [2024-08-05 23:10:19,662][52663] DAMAGECOUNT value on done: 22999.0 [2024-08-05 23:10:19,662][52663] Sum rewards: 13.378, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.846', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.500', 'weapon3': '1.250', 'HITCOUNT': '1.260', 'ARMOR': '1.386', 'weapon2': '1.688', 'DAMAGECOUNT': '3.927', 'FRAGCOUNT': '8.000'} [2024-08-05 23:10:19,944][52658] DAMAGECOUNT value on done: 23493.0 [2024-08-05 23:10:19,947][52658] Sum rewards: 16.771, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.268', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO5': '0.015', 'weapon4': '0.024', 'AMMO4': '0.047', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'ARMOR': '0.892', 'WEAPON3': '1.150', 'weapon2': '1.440', 'HITCOUNT': '1.660', 'weapon3': '1.922', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:20,907][52670] DAMAGECOUNT value on done: 21811.0 [2024-08-05 23:10:20,909][52670] Sum rewards: 15.201, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'WEAPON3': '0.400', 'HEALTH': '0.554', 'HITCOUNT': '1.160', 'ARMOR': '1.228', 'weapon3': '1.290', 'weapon2': '2.210', 'DAMAGECOUNT': '3.543', 'FRAGCOUNT': '9.000'} [2024-08-05 23:10:21,909][52667] DAMAGECOUNT value on done: 24885.0 [2024-08-05 23:10:21,912][52667] Sum rewards: 19.692, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.350', 'ARMOR': '0.529', 'WEAPON3': '0.550', 'HITCOUNT': '1.140', 'weapon2': '1.242', 'weapon3': '1.500', 'DAMAGECOUNT': '4.113', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:22,072][52820] DAMAGECOUNT value on done: 19871.0 [2024-08-05 23:10:22,072][52820] Sum rewards: 10.845, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.299', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'weapon7': '0.050', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '0.810', 'weapon3': '1.408', 'weapon2': '1.592', 'DAMAGECOUNT': '2.718', 'FRAGCOUNT': '7.000'} [2024-08-05 23:10:22,670][52663] DAMAGECOUNT value on done: 26253.0 [2024-08-05 23:10:22,672][52663] Sum rewards: 18.045, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.295', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.182', 'HITCOUNT': '1.480', 'weapon3': '1.974', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:22,725][52666] DAMAGECOUNT value on done: 23015.0 [2024-08-05 23:10:22,729][52666] Sum rewards: 25.534, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.000', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon4': '0.020', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'ARMOR': '0.955', 'WEAPON3': '1.050', 'weapon2': '1.664', 'HITCOUNT': '1.890', 'weapon3': '2.164', 'DAMAGECOUNT': '6.750', 'FRAGCOUNT': '21.000'} [2024-08-05 23:10:22,794][52567] Fps is (10 sec: 17203.7, 60 sec: 15428.3, 300 sec: 14884.5). Total num frames: 105906176. Throughput: 0: 3895.6. Samples: 26479730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:10:22,795][52567] Avg episode reward: [(0, '18.478')] [2024-08-05 23:10:23,056][52658] DAMAGECOUNT value on done: 24957.0 [2024-08-05 23:10:23,057][52658] Sum rewards: 24.320, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.451', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.099', 'WEAPON4': '0.250', 'weapon4': '0.590', 'WEAPON3': '0.650', 'weapon2': '0.752', 'HITCOUNT': '1.690', 'weapon3': '1.702', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '19.000'} [2024-08-05 23:10:23,174][52664] DAMAGECOUNT value on done: 23025.0 [2024-08-05 23:10:23,174][52664] Sum rewards: 27.209, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.666', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.304', 'ARMOR': '0.482', 'WEAPON3': '0.800', 'weapon2': '1.498', 'weapon3': '1.788', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '7.770', 'FRAGCOUNT': '22.000'} [2024-08-05 23:10:24,121][52670] DAMAGECOUNT value on done: 21179.0 [2024-08-05 23:10:24,121][52670] Sum rewards: 5.075, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.641', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.030', 'weapon5': '0.058', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'weapon2': '1.246', 'weapon3': '1.334', 'ARMOR': '1.386', 'DAMAGECOUNT': '3.375', 'FRAGCOUNT': '4.000'} [2024-08-05 23:10:24,149][52650] Updated weights for policy 0, policy_version 12931 (0.0033) [2024-08-05 23:10:24,387][52667] DAMAGECOUNT value on done: 23651.0 [2024-08-05 23:10:24,396][52667] Sum rewards: 21.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '0.012', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.110', 'weapon4': '0.118', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '1.636', 'weapon3': '1.726', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '6.342', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:25,558][52820] DAMAGECOUNT value on done: 21404.0 [2024-08-05 23:10:25,560][52820] Sum rewards: 17.986, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.545', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.052', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.442', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'HITCOUNT': '1.420', 'weapon2': '1.474', 'weapon3': '1.800', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:25,584][52658] DAMAGECOUNT value on done: 21507.0 [2024-08-05 23:10:25,584][52658] Sum rewards: 19.381, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.153', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'ARMOR': '0.852', 'WEAPON3': '0.950', 'weapon2': '1.496', 'HITCOUNT': '1.610', 'weapon3': '2.190', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:25,628][52663] DAMAGECOUNT value on done: 25080.0 [2024-08-05 23:10:25,629][52663] Sum rewards: 26.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.348', 'AMMO2': '0.012', 'AMMO5': '0.018', 'weapon5': '0.038', 'AMMO4': '0.061', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon2': '1.288', 'ARMOR': '1.877', 'HITCOUNT': '2.030', 'weapon3': '2.072', 'DAMAGECOUNT': '7.890', 'FRAGCOUNT': '22.000'} [2024-08-05 23:10:26,234][52664] DAMAGECOUNT value on done: 23740.0 [2024-08-05 23:10:26,234][52664] Sum rewards: 23.366, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.247', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.600', 'ARMOR': '0.967', 'weapon3': '1.594', 'HITCOUNT': '1.730', 'weapon2': '1.744', 'DAMAGECOUNT': '5.877', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:27,626][52667] DAMAGECOUNT value on done: 24613.0 [2024-08-05 23:10:27,628][52667] Sum rewards: 8.449, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.616', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.074', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.450', 'weapon3': '1.596', 'DAMAGECOUNT': '3.279', 'FRAGCOUNT': '9.000'} [2024-08-05 23:10:27,794][52567] Fps is (10 sec: 16383.7, 60 sec: 15428.2, 300 sec: 14828.9). Total num frames: 105988096. Throughput: 0: 3945.8. Samples: 26503780. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:10:27,795][52567] Avg episode reward: [(0, '18.271')] [2024-08-05 23:10:27,800][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012938_105988096.pth... [2024-08-05 23:10:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012504_102432768.pth [2024-08-05 23:10:27,971][52670] DAMAGECOUNT value on done: 22568.0 [2024-08-05 23:10:27,971][52670] Sum rewards: 22.054, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.228', 'WEAPON3': '0.750', 'HITCOUNT': '1.580', 'weapon3': '1.648', 'weapon2': '1.932', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:28,509][52663] DAMAGECOUNT value on done: 23573.0 [2024-08-05 23:10:28,509][52663] Sum rewards: 21.090, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.267', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.700', 'ARMOR': '0.927', 'weapon3': '1.462', 'HITCOUNT': '1.520', 'weapon2': '1.692', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:28,850][52671] DAMAGECOUNT value on done: 26052.0 [2024-08-05 23:10:28,851][52671] Sum rewards: 13.866, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.230', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'weapon7': '0.080', 'AMMO3': '0.099', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.246', 'WEAPON3': '0.850', 'HITCOUNT': '1.170', 'weapon2': '1.194', 'ARMOR': '1.350', 'weapon3': '2.072', 'DAMAGECOUNT': '4.446', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:29,069][52658] DAMAGECOUNT value on done: 27919.0 [2024-08-05 23:10:29,069][52658] Sum rewards: 23.551, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.030', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON3': '0.900', 'ARMOR': '0.951', 'weapon2': '1.672', 'weapon3': '1.738', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '7.623', 'FRAGCOUNT': '19.000'} [2024-08-05 23:10:29,122][52820] DAMAGECOUNT value on done: 22047.0 [2024-08-05 23:10:29,123][52820] Sum rewards: 17.753, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.699', 'AMMO5': '0.003', 'AMMO2': '0.036', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'AMMO4': '0.179', 'WEAPON4': '0.600', 'WEAPON3': '0.600', 'weapon4': '0.600', 'weapon2': '1.248', 'HITCOUNT': '1.450', 'weapon3': '1.754', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:29,182][52664] DAMAGECOUNT value on done: 20789.0 [2024-08-05 23:10:29,182][52664] Sum rewards: 11.921, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.084', 'AMMO5': '0.005', 'weapon5': '0.044', 'AMMO2': '0.045', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'AMMO4': '0.224', 'weapon4': '0.242', 'WEAPON4': '0.500', 'HITCOUNT': '0.790', 'WEAPON3': '0.850', 'ARMOR': '0.860', 'weapon2': '1.362', 'weapon3': '1.950', 'DAMAGECOUNT': '3.354', 'FRAGCOUNT': '10.000'} [2024-08-05 23:10:29,480][52650] Updated weights for policy 0, policy_version 12941 (0.0029) [2024-08-05 23:10:31,010][52667] DAMAGECOUNT value on done: 26556.0 [2024-08-05 23:10:31,010][52667] Sum rewards: 12.621, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'AMMO4': '0.219', 'weapon4': '0.242', 'ARMOR': '0.456', 'WEAPON4': '0.500', 'weapon2': '0.874', 'WEAPON3': '1.150', 'HITCOUNT': '1.610', 'weapon3': '2.462', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '11.500'} [2024-08-05 23:10:31,502][52663] DAMAGECOUNT value on done: 22912.0 [2024-08-05 23:10:31,503][52663] Sum rewards: 17.533, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.890', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.009', 'AMMO3': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.364', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'weapon3': '1.224', 'HITCOUNT': '1.230', 'weapon2': '1.414', 'DAMAGECOUNT': '5.226', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:31,870][52664] DAMAGECOUNT value on done: 25411.0 [2024-08-05 23:10:31,870][52664] Sum rewards: 17.736, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.550', 'AMMO5': '0.012', 'AMMO2': '0.038', 'ARMOR': '0.040', 'weapon5': '0.078', 'AMMO3': '0.091', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.260', 'weapon2': '1.346', 'weapon3': '1.758', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '14.500'} [2024-08-05 23:10:32,234][52671] DAMAGECOUNT value on done: 22954.0 [2024-08-05 23:10:32,236][52671] Sum rewards: 23.508, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.464', 'AMMO4': '-0.072', 'AMMO2': '-0.014', 'AMMO5': '0.010', 'weapon5': '0.100', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.864', 'HITCOUNT': '1.540', 'weapon3': '1.592', 'weapon2': '1.610', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '19.000'} [2024-08-05 23:10:32,492][52820] DAMAGECOUNT value on done: 22822.0 [2024-08-05 23:10:32,493][52820] Sum rewards: 24.810, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.252', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO3': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'weapon4': '0.496', 'WEAPON3': '0.600', 'weapon2': '1.026', 'HITCOUNT': '1.510', 'weapon3': '1.576', 'DAMAGECOUNT': '6.609', 'FRAGCOUNT': '18.500'} [2024-08-05 23:10:32,514][52658] DAMAGECOUNT value on done: 22789.0 [2024-08-05 23:10:32,514][52658] Sum rewards: 23.454, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.182', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON3': '0.600', 'ARMOR': '1.200', 'weapon2': '1.510', 'weapon3': '1.576', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '6.552', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 15701.3, 300 sec: 14856.7). Total num frames: 106070016. Throughput: 0: 3973.3. Samples: 26516000. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:10:32,794][52567] Avg episode reward: [(0, '18.327')] [2024-08-05 23:10:33,571][52649] DAMAGECOUNT value on done: 23190.0 [2024-08-05 23:10:33,572][52649] Sum rewards: 22.219, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.197', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.800', 'ARMOR': '0.812', 'weapon2': '1.478', 'HITCOUNT': '1.830', 'weapon3': '1.936', 'DAMAGECOUNT': '6.051', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:33,932][52663] DAMAGECOUNT value on done: 23711.0 [2024-08-05 23:10:33,933][52663] Sum rewards: 20.821, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.091', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.039', 'ARMOR': '0.052', 'AMMO3': '0.070', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.752', 'weapon2': '0.930', 'HITCOUNT': '1.090', 'weapon3': '1.508', 'DAMAGECOUNT': '4.479', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:34,144][52667] DAMAGECOUNT value on done: 24385.0 [2024-08-05 23:10:34,144][52667] Sum rewards: 19.770, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.593', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.010', 'AMMO3': '0.060', 'weapon5': '0.114', 'WEAPON5': '0.200', 'WEAPON3': '0.500', 'ARMOR': '0.876', 'HITCOUNT': '1.230', 'weapon3': '1.462', 'weapon2': '2.126', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '13.500'} [2024-08-05 23:10:34,433][52650] Updated weights for policy 0, policy_version 12951 (0.0019) [2024-08-05 23:10:34,941][52664] DAMAGECOUNT value on done: 23582.0 [2024-08-05 23:10:34,942][52664] Sum rewards: 20.850, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.616', 'AMMO2': '0.006', 'AMMO5': '0.015', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.170', 'WEAPON5': '0.200', 'weapon5': '0.252', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.062', 'HITCOUNT': '1.320', 'weapon3': '1.732', 'DAMAGECOUNT': '5.964', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:35,082][52671] DAMAGECOUNT value on done: 24818.0 [2024-08-05 23:10:35,083][52671] Sum rewards: 15.924, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.188', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'AMMO3': '0.080', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON3': '0.600', 'HITCOUNT': '1.110', 'ARMOR': '1.341', 'weapon2': '1.528', 'weapon3': '1.876', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:35,618][52658] DAMAGECOUNT value on done: 25389.0 [2024-08-05 23:10:35,618][52658] Sum rewards: 28.993, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.068', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.540', 'weapon2': '0.712', 'ARMOR': '0.857', 'WEAPON3': '1.150', 'HITCOUNT': '2.130', 'weapon3': '2.320', 'DAMAGECOUNT': '8.013', 'FRAGCOUNT': '25.000'} [2024-08-05 23:10:35,994][52820] DAMAGECOUNT value on done: 20748.0 [2024-08-05 23:10:35,994][52820] Sum rewards: 15.584, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.604', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon5': '0.276', 'weapon4': '0.304', 'ARMOR': '0.455', 'WEAPON3': '0.600', 'HITCOUNT': '1.160', 'weapon2': '1.294', 'weapon3': '1.644', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:36,979][52667] DAMAGECOUNT value on done: 22821.0 [2024-08-05 23:10:36,981][52667] Sum rewards: 21.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.063', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'ARMOR': '0.533', 'WEAPON3': '1.200', 'HITCOUNT': '1.680', 'weapon2': '1.760', 'weapon3': '1.932', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '22.000'} [2024-08-05 23:10:37,272][52664] DAMAGECOUNT value on done: 24031.0 [2024-08-05 23:10:37,272][52664] Sum rewards: 38.451, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.766', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.047', 'weapon5': '0.092', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.412', 'weapon2': '0.690', 'weapon4': '0.796', 'WEAPON3': '0.900', 'weapon3': '2.070', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '8.493', 'FRAGCOUNT': '31.000'} [2024-08-05 23:10:37,317][52649] DAMAGECOUNT value on done: 23060.0 [2024-08-05 23:10:37,318][52649] Sum rewards: 11.511, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.612', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.087', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'weapon4': '0.650', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'weapon2': '1.064', 'weapon3': '1.716', 'DAMAGECOUNT': '2.775', 'FRAGCOUNT': '10.000'} [2024-08-05 23:10:37,375][52663] DAMAGECOUNT value on done: 23475.0 [2024-08-05 23:10:37,378][52663] Sum rewards: 23.799, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.653', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.078', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'weapon4': '0.752', 'weapon2': '0.912', 'HITCOUNT': '1.510', 'weapon3': '1.758', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:37,794][52567] Fps is (10 sec: 16384.3, 60 sec: 15974.4, 300 sec: 14828.9). Total num frames: 106151936. Throughput: 0: 4046.2. Samples: 26540960. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:10:37,794][52567] Avg episode reward: [(0, '18.945')] [2024-08-05 23:10:38,315][52671] DAMAGECOUNT value on done: 22533.0 [2024-08-05 23:10:38,323][52671] Sum rewards: 15.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.125', 'AMMO3': '0.163', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '1.400', 'ARMOR': '1.816', 'weapon2': '1.816', 'weapon3': '1.912', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:38,471][52658] DAMAGECOUNT value on done: 23868.0 [2024-08-05 23:10:38,472][52658] Sum rewards: 25.055, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.051', 'AMMO3': '0.094', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.750', 'weapon2': '1.050', 'HITCOUNT': '1.790', 'weapon3': '1.830', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '19.000'} [2024-08-05 23:10:39,328][52820] DAMAGECOUNT value on done: 20651.0 [2024-08-05 23:10:39,333][52820] Sum rewards: 14.699, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.026', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON3': '0.900', 'ARMOR': '0.998', 'HITCOUNT': '1.120', 'weapon2': '1.286', 'weapon3': '2.022', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:39,406][52650] Updated weights for policy 0, policy_version 12961 (0.0028) [2024-08-05 23:10:39,502][52659] DAMAGECOUNT value on done: 23679.0 [2024-08-05 23:10:39,503][52659] Sum rewards: 22.041, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.022', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.086', 'HEALTH': '0.224', 'WEAPON3': '0.550', 'ARMOR': '1.248', 'HITCOUNT': '1.460', 'weapon3': '1.576', 'weapon2': '2.016', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:39,877][52667] DAMAGECOUNT value on done: 24020.0 [2024-08-05 23:10:39,877][52667] Sum rewards: 18.113, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'AMMO4': '0.112', 'HEALTH': '0.120', 'weapon4': '0.294', 'WEAPON3': '0.600', 'weapon2': '1.246', 'weapon3': '1.592', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:40,071][52663] DAMAGECOUNT value on done: 24119.0 [2024-08-05 23:10:40,072][52663] Sum rewards: 19.753, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.427', 'weapon4': '0.002', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.865', 'HITCOUNT': '1.420', 'weapon3': '1.702', 'weapon2': '1.934', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:40,160][52664] DAMAGECOUNT value on done: 23899.0 [2024-08-05 23:10:40,162][52664] Sum rewards: 18.443, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.064', 'weapon7': '0.068', 'AMMO3': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.700', 'HITCOUNT': '1.070', 'weapon2': '1.116', 'weapon3': '1.670', 'DAMAGECOUNT': '4.458', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:40,354][52649] DAMAGECOUNT value on done: 22775.0 [2024-08-05 23:10:40,356][52649] Sum rewards: 13.342, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.020', 'HEALTH': '0.024', 'AMMO4': '0.099', 'AMMO3': '0.128', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.200', 'weapon2': '1.576', 'weapon3': '1.604', 'DAMAGECOUNT': '4.089', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:41,163][52671] DAMAGECOUNT value on done: 22827.0 [2024-08-05 23:10:41,163][52671] Sum rewards: 17.503, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'weapon4': '0.018', 'AMMO2': '0.027', 'weapon5': '0.074', 'AMMO4': '0.132', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.844', 'HITCOUNT': '1.060', 'weapon3': '1.734', 'weapon2': '1.802', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:41,407][52658] DAMAGECOUNT value on done: 25137.0 [2024-08-05 23:10:41,408][52658] Sum rewards: 18.455, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'weapon4': '0.588', 'WEAPON3': '0.750', 'weapon2': '0.906', 'HITCOUNT': '1.450', 'weapon3': '1.708', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:42,415][52659] DAMAGECOUNT value on done: 24661.0 [2024-08-05 23:10:42,419][52659] Sum rewards: 16.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.490', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'WEAPON3': '0.800', 'HITCOUNT': '1.400', 'weapon3': '1.706', 'weapon2': '1.918', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:42,642][52667] DAMAGECOUNT value on done: 24539.0 [2024-08-05 23:10:42,642][52667] Sum rewards: 22.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.164', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.018', 'weapon5': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.450', 'ARMOR': '1.767', 'HITCOUNT': '1.880', 'weapon3': '2.338', 'DAMAGECOUNT': '6.990', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:42,700][52820] DAMAGECOUNT value on done: 21841.0 [2024-08-05 23:10:42,704][52820] Sum rewards: 13.801, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.268', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.316', 'ARMOR': '0.424', 'WEAPON3': '0.950', 'weapon2': '1.064', 'HITCOUNT': '1.270', 'weapon3': '2.272', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:42,794][52567] Fps is (10 sec: 15564.8, 60 sec: 15837.9, 300 sec: 14801.1). Total num frames: 106225664. Throughput: 0: 4104.0. Samples: 26565970. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:10:42,794][52567] Avg episode reward: [(0, '18.942')] [2024-08-05 23:10:42,975][52649] DAMAGECOUNT value on done: 22539.0 [2024-08-05 23:10:42,975][52649] Sum rewards: 25.286, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.670', 'AMMO5': '0.012', 'AMMO2': '0.033', 'ARMOR': '0.038', 'weapon5': '0.126', 'AMMO4': '0.166', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon2': '1.298', 'HITCOUNT': '1.580', 'weapon3': '2.124', 'DAMAGECOUNT': '5.604', 'FRAGCOUNT': '24.000'} [2024-08-05 23:10:43,428][52663] DAMAGECOUNT value on done: 24117.0 [2024-08-05 23:10:43,436][52663] Sum rewards: 16.443, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.280', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.234', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'HITCOUNT': '1.250', 'weapon3': '1.308', 'weapon2': '1.564', 'DAMAGECOUNT': '4.671', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:43,500][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:10:43,909][52658] DAMAGECOUNT value on done: 22679.0 [2024-08-05 23:10:43,910][52658] Sum rewards: 11.855, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.110', 'WEAPON4': '0.300', 'ARMOR': '0.482', 'weapon4': '0.738', 'WEAPON3': '0.750', 'weapon2': '0.974', 'HITCOUNT': '1.110', 'weapon3': '1.482', 'DAMAGECOUNT': '3.870', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:44,081][52650] Updated weights for policy 0, policy_version 12971 (0.0035) [2024-08-05 23:10:44,195][52671] DAMAGECOUNT value on done: 25585.0 [2024-08-05 23:10:44,196][52671] Sum rewards: 20.868, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.113', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.054', 'ARMOR': '0.056', 'AMMO3': '0.088', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'weapon4': '0.584', 'weapon2': '1.220', 'weapon3': '1.428', 'HITCOUNT': '1.430', 'DAMAGECOUNT': '5.217', 'FRAGCOUNT': '16.000'} [2024-08-05 23:10:45,342][52659] DAMAGECOUNT value on done: 24741.0 [2024-08-05 23:10:45,344][52659] Sum rewards: 24.788, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.400', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'weapon5': '0.006', 'AMMO5': '0.009', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.124', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'weapon2': '1.260', 'HITCOUNT': '1.740', 'weapon3': '1.910', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '20.500'} [2024-08-05 23:10:45,940][52820] DAMAGECOUNT value on done: 23143.0 [2024-08-05 23:10:45,942][52820] Sum rewards: 24.080, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.187', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.153', 'weapon4': '0.258', 'WEAPON4': '0.350', 'ARMOR': '0.920', 'weapon2': '0.928', 'WEAPON3': '1.100', 'HITCOUNT': '1.920', 'weapon3': '2.274', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '20.000'} [2024-08-05 23:10:46,310][52649] DAMAGECOUNT value on done: 23312.0 [2024-08-05 23:10:46,310][52649] Sum rewards: 19.307, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.432', 'WEAPON3': '0.650', 'ARMOR': '0.908', 'HITCOUNT': '1.510', 'weapon2': '1.534', 'weapon3': '1.654', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:46,709][52663] DAMAGECOUNT value on done: 22841.0 [2024-08-05 23:10:46,710][52663] Sum rewards: 18.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.501', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon4': '0.268', 'WEAPON4': '0.300', 'ARMOR': '0.903', 'WEAPON3': '1.000', 'weapon2': '1.180', 'HITCOUNT': '1.390', 'weapon3': '2.062', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:47,117][52658] DAMAGECOUNT value on done: 24373.0 [2024-08-05 23:10:47,120][52658] Sum rewards: 22.071, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.235', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.066', 'AMMO3': '0.094', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.750', 'weapon2': '1.076', 'HITCOUNT': '1.470', 'ARMOR': '1.848', 'weapon3': '2.038', 'DAMAGECOUNT': '5.544', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:47,131][52671] DAMAGECOUNT value on done: 22991.0 [2024-08-05 23:10:47,132][52671] Sum rewards: 15.232, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.723', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.466', 'WEAPON3': '0.650', 'ARMOR': '0.947', 'HITCOUNT': '1.010', 'weapon2': '1.380', 'weapon3': '1.648', 'DAMAGECOUNT': '3.792', 'FRAGCOUNT': '11.000'} [2024-08-05 23:10:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16110.9, 300 sec: 14801.1). Total num frames: 106315776. Throughput: 0: 4111.5. Samples: 26578510. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:10:47,795][52567] Avg episode reward: [(0, '18.976')] [2024-08-05 23:10:47,798][52614] Saving new best policy, reward=18.976! [2024-08-05 23:10:48,683][52659] DAMAGECOUNT value on done: 22868.0 [2024-08-05 23:10:48,684][52659] Sum rewards: 11.496, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.076', 'AMMO5': '0.004', 'weapon4': '0.010', 'weapon5': '0.020', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.130', 'WEAPON3': '0.650', 'HITCOUNT': '1.140', 'ARMOR': '1.256', 'weapon3': '1.616', 'weapon2': '1.718', 'DAMAGECOUNT': '3.690', 'FRAGCOUNT': '8.500'} [2024-08-05 23:10:49,174][52650] Updated weights for policy 0, policy_version 12981 (0.0012) [2024-08-05 23:10:49,256][52820] DAMAGECOUNT value on done: 21039.0 [2024-08-05 23:10:49,261][52820] Sum rewards: 15.267, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.610', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO4': '0.048', 'AMMO3': '0.063', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'ARMOR': '0.899', 'HITCOUNT': '0.930', 'weapon2': '1.258', 'weapon3': '1.280', 'DAMAGECOUNT': '4.203', 'FRAGCOUNT': '10.000'} [2024-08-05 23:10:49,445][52649] DAMAGECOUNT value on done: 23909.0 [2024-08-05 23:10:49,447][52649] Sum rewards: 13.192, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.702', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.085', 'WEAPON3': '0.550', 'HITCOUNT': '0.920', 'weapon3': '1.288', 'ARMOR': '1.349', 'weapon2': '1.832', 'DAMAGECOUNT': '3.117', 'FRAGCOUNT': '10.000'} [2024-08-05 23:10:50,041][52663] DAMAGECOUNT value on done: 22361.0 [2024-08-05 23:10:50,043][52663] Sum rewards: 19.667, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.071', 'AMMO4': '0.082', 'HEALTH': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.280', 'ARMOR': '0.424', 'WEAPON3': '0.500', 'HITCOUNT': '1.400', 'weapon2': '1.544', 'weapon3': '1.612', 'DAMAGECOUNT': '4.368', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:50,207][52671] DAMAGECOUNT value on done: 24876.0 [2024-08-05 23:10:50,207][52671] Sum rewards: 17.726, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.260', 'AMMO2': '0.024', 'AMMO3': '0.099', 'AMMO4': '0.122', 'ARMOR': '0.461', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '0.754', 'weapon2': '0.760', 'HITCOUNT': '1.400', 'weapon3': '1.638', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:50,446][52658] DAMAGECOUNT value on done: 24934.0 [2024-08-05 23:10:50,448][52658] Sum rewards: 23.056, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.497', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.073', 'AMMO4': '0.088', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.856', 'weapon2': '1.022', 'HITCOUNT': '1.340', 'weapon3': '1.620', 'DAMAGECOUNT': '4.575', 'FRAGCOUNT': '18.000'} [2024-08-05 23:10:51,693][52659] DAMAGECOUNT value on done: 23759.0 [2024-08-05 23:10:51,694][52659] Sum rewards: 22.292, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'weapon4': '0.322', 'WEAPON3': '0.750', 'ARMOR': '0.926', 'weapon3': '1.542', 'HITCOUNT': '1.580', 'weapon2': '1.580', 'DAMAGECOUNT': '5.790', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:52,740][52820] DAMAGECOUNT value on done: 23781.0 [2024-08-05 23:10:52,745][52820] Sum rewards: 17.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.082', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'ARMOR': '1.121', 'HITCOUNT': '1.420', 'weapon2': '1.640', 'weapon3': '1.734', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16247.4, 300 sec: 14828.9). Total num frames: 106397696. Throughput: 0: 4122.2. Samples: 26603400. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:10:52,795][52567] Avg episode reward: [(0, '19.032')] [2024-08-05 23:10:52,802][52614] Saving new best policy, reward=19.032! [2024-08-05 23:10:52,814][52649] DAMAGECOUNT value on done: 21252.0 [2024-08-05 23:10:52,815][52649] Sum rewards: 16.053, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.746', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'ARMOR': '0.404', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'weapon2': '1.626', 'weapon3': '1.820', 'DAMAGECOUNT': '4.887', 'FRAGCOUNT': '12.000'} [2024-08-05 23:10:52,975][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:10:53,067][52671] DAMAGECOUNT value on done: 24772.0 [2024-08-05 23:10:53,068][52671] Sum rewards: 18.378, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.326', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.168', 'ARMOR': '0.458', 'WEAPON3': '0.900', 'weapon2': '1.428', 'HITCOUNT': '1.700', 'weapon3': '1.740', 'DAMAGECOUNT': '5.838', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:53,211][52663] DAMAGECOUNT value on done: 22353.0 [2024-08-05 23:10:53,214][52663] Sum rewards: 18.843, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.927', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon5': '0.176', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon4': '0.592', 'weapon2': '0.742', 'WEAPON3': '1.000', 'HITCOUNT': '1.520', 'weapon3': '2.064', 'DAMAGECOUNT': '5.859', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:53,794][52658] DAMAGECOUNT value on done: 23025.0 [2024-08-05 23:10:53,794][52658] Sum rewards: 19.568, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.148', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.426', 'ARMOR': '0.893', 'WEAPON3': '0.900', 'weapon2': '1.188', 'weapon3': '1.806', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '6.210', 'FRAGCOUNT': '17.000'} [2024-08-05 23:10:53,914][52650] Updated weights for policy 0, policy_version 12991 (0.0021) [2024-08-05 23:10:54,302][52659] DAMAGECOUNT value on done: 25222.0 [2024-08-05 23:10:54,303][52659] Sum rewards: 17.077, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'weapon4': '0.198', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.316', 'HITCOUNT': '1.410', 'weapon3': '1.598', 'DAMAGECOUNT': '5.019', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:55,729][52671] DAMAGECOUNT value on done: 26373.0 [2024-08-05 23:10:55,729][52671] Sum rewards: 15.240, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.178', 'weapon5': '0.006', 'weapon4': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.458', 'WEAPON3': '0.750', 'HITCOUNT': '1.330', 'weapon3': '1.646', 'weapon2': '1.904', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:55,862][52649] DAMAGECOUNT value on done: 22836.0 [2024-08-05 23:10:55,863][52649] Sum rewards: 18.968, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.062', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.426', 'ARMOR': '0.480', 'WEAPON3': '0.650', 'weapon2': '1.262', 'HITCOUNT': '1.310', 'weapon3': '1.454', 'DAMAGECOUNT': '5.016', 'FRAGCOUNT': '14.000'} [2024-08-05 23:10:56,134][52820] DAMAGECOUNT value on done: 24752.0 [2024-08-05 23:10:56,134][52820] Sum rewards: 13.488, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.628', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.121', 'weapon5': '0.164', 'weapon4': '0.206', 'WEAPON3': '0.750', 'ARMOR': '0.855', 'HITCOUNT': '1.340', 'weapon2': '1.350', 'weapon3': '1.636', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '10.000'} [2024-08-05 23:10:56,987][52658] DAMAGECOUNT value on done: 25203.0 [2024-08-05 23:10:56,988][52658] Sum rewards: 10.927, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.058', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.881', 'HITCOUNT': '1.160', 'weapon3': '1.470', 'weapon2': '1.616', 'DAMAGECOUNT': '3.771', 'FRAGCOUNT': '9.000'} [2024-08-05 23:10:57,395][52659] DAMAGECOUNT value on done: 25712.0 [2024-08-05 23:10:57,395][52659] Sum rewards: 18.691, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.204', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon5': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '0.800', 'ARMOR': '0.981', 'weapon2': '1.266', 'HITCOUNT': '1.460', 'weapon3': '1.880', 'DAMAGECOUNT': '5.568', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16657.1, 300 sec: 14828.9). Total num frames: 106487808. Throughput: 0: 4124.7. Samples: 26628090. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:10:57,795][52567] Avg episode reward: [(0, '18.830')] [2024-08-05 23:10:58,763][52649] DAMAGECOUNT value on done: 22981.0 [2024-08-05 23:10:58,766][52649] Sum rewards: 19.298, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.829', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon4': '0.166', 'WEAPON3': '0.700', 'ARMOR': '0.821', 'HITCOUNT': '1.320', 'weapon2': '1.418', 'weapon3': '1.524', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '15.000'} [2024-08-05 23:10:59,208][52671] DAMAGECOUNT value on done: 23292.0 [2024-08-05 23:10:59,210][52671] Sum rewards: 14.654, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.292', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO3': '0.107', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '1.040', 'ARMOR': '1.208', 'weapon2': '1.410', 'weapon3': '1.636', 'DAMAGECOUNT': '3.996', 'FRAGCOUNT': '13.000'} [2024-08-05 23:10:59,266][52650] Updated weights for policy 0, policy_version 13001 (0.0050) [2024-08-05 23:10:59,353][52820] DAMAGECOUNT value on done: 22298.0 [2024-08-05 23:10:59,353][52820] Sum rewards: 14.969, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.214', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.087', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.226', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon2': '1.580', 'weapon3': '1.702', 'DAMAGECOUNT': '4.665', 'FRAGCOUNT': '12.000'} [2024-08-05 23:11:00,570][52658] DAMAGECOUNT value on done: 26159.0 [2024-08-05 23:11:00,570][52658] Sum rewards: 24.130, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.360', 'AMMO4': '-0.096', 'AMMO2': '-0.019', 'AMMO5': '0.003', 'AMMO3': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.214', 'ARMOR': '0.470', 'WEAPON3': '0.600', 'weapon3': '1.578', 'weapon2': '1.584', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '7.347', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:00,837][52659] DAMAGECOUNT value on done: 21628.0 [2024-08-05 23:11:00,840][52659] Sum rewards: 18.646, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.370', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.014', 'weapon5': '0.032', 'ARMOR': '0.036', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.448', 'WEAPON3': '0.650', 'weapon2': '1.204', 'weapon3': '1.414', 'HITCOUNT': '1.420', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:01,967][52649] DAMAGECOUNT value on done: 23692.0 [2024-08-05 23:11:01,967][52649] Sum rewards: 19.428, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.075', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.146', 'WEAPON3': '0.650', 'weapon2': '1.418', 'HITCOUNT': '1.450', 'weapon3': '1.608', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:02,398][52671] DAMAGECOUNT value on done: 24806.0 [2024-08-05 23:11:02,399][52671] Sum rewards: 15.078, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.018', 'HEALTH': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.061', 'weapon5': '0.072', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.270', 'WEAPON3': '0.450', 'HITCOUNT': '1.080', 'weapon2': '1.362', 'ARMOR': '1.383', 'weapon3': '1.452', 'DAMAGECOUNT': '3.609', 'FRAGCOUNT': '11.000'} [2024-08-05 23:11:02,795][52567] Fps is (10 sec: 16382.3, 60 sec: 16520.2, 300 sec: 14828.9). Total num frames: 106561536. Throughput: 0: 4130.8. Samples: 26640810. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:11:02,796][52567] Avg episode reward: [(0, '18.672')] [2024-08-05 23:11:03,660][52650] Updated weights for policy 0, policy_version 13011 (0.0036) [2024-08-05 23:11:03,972][52658] DAMAGECOUNT value on done: 23613.0 [2024-08-05 23:11:03,973][52658] Sum rewards: 21.602, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.462', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.022', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.332', 'ARMOR': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '1.390', 'weapon2': '1.472', 'weapon3': '1.478', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '16.000'} [2024-08-05 23:11:04,058][52659] DAMAGECOUNT value on done: 23377.0 [2024-08-05 23:11:04,063][52659] Sum rewards: 15.431, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.017', 'AMMO2': '0.034', 'HEALTH': '0.056', 'AMMO3': '0.098', 'weapon5': '0.162', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.416', 'ARMOR': '0.444', 'WEAPON3': '0.600', 'weapon2': '0.940', 'HITCOUNT': '1.030', 'weapon3': '1.626', 'DAMAGECOUNT': '4.287', 'FRAGCOUNT': '11.000'} [2024-08-05 23:11:05,307][52649] DAMAGECOUNT value on done: 24012.0 [2024-08-05 23:11:05,309][52649] Sum rewards: 18.149, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.458', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.446', 'WEAPON3': '0.850', 'weapon2': '1.226', 'weapon3': '1.458', 'HITCOUNT': '1.660', 'ARMOR': '1.709', 'DAMAGECOUNT': '5.817', 'FRAGCOUNT': '13.500'} [2024-08-05 23:11:05,604][52671] DAMAGECOUNT value on done: 26620.0 [2024-08-05 23:11:05,605][52671] Sum rewards: 24.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.132', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.132', 'weapon4': '0.162', 'WEAPON5': '0.200', 'ARMOR': '0.420', 'WEAPON3': '0.850', 'weapon2': '1.242', 'HITCOUNT': '1.660', 'weapon3': '1.958', 'DAMAGECOUNT': '6.441', 'FRAGCOUNT': '20.000'} [2024-08-05 23:11:06,805][52658] DAMAGECOUNT value on done: 22597.0 [2024-08-05 23:11:06,807][52658] Sum rewards: 14.063, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.701', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.472', 'weapon4': '0.494', 'WEAPON3': '0.750', 'weapon2': '1.036', 'HITCOUNT': '1.420', 'weapon3': '2.048', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '10.000'} [2024-08-05 23:11:07,314][52659] DAMAGECOUNT value on done: 26318.0 [2024-08-05 23:11:07,315][52659] Sum rewards: 19.440, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.110', 'weapon4': '0.298', 'WEAPON3': '0.750', 'ARMOR': '0.882', 'weapon2': '1.298', 'HITCOUNT': '1.600', 'weapon3': '1.750', 'DAMAGECOUNT': '5.511', 'FRAGCOUNT': '16.000'} [2024-08-05 23:11:07,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16657.0, 300 sec: 14828.9). Total num frames: 106651648. Throughput: 0: 4134.6. Samples: 26665790. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 23:11:07,795][52567] Avg episode reward: [(0, '18.709')] [2024-08-05 23:11:08,816][52649] DAMAGECOUNT value on done: 23539.0 [2024-08-05 23:11:08,817][52649] Sum rewards: 23.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.034', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.024', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.168', 'WEAPON3': '0.550', 'HITCOUNT': '1.490', 'weapon2': '1.656', 'weapon3': '1.660', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:08,915][52671] DAMAGECOUNT value on done: 22947.0 [2024-08-05 23:11:08,916][52671] Sum rewards: 19.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.062', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon4': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.004', 'HITCOUNT': '1.490', 'weapon3': '2.062', 'DAMAGECOUNT': '5.628', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:09,157][52650] Updated weights for policy 0, policy_version 13021 (0.0018) [2024-08-05 23:11:09,967][52658] DAMAGECOUNT value on done: 24571.0 [2024-08-05 23:11:09,972][52658] Sum rewards: 21.077, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.430', 'weapon2': '1.536', 'weapon3': '1.760', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:10,361][52659] DAMAGECOUNT value on done: 23672.0 [2024-08-05 23:11:10,361][52659] Sum rewards: 27.297, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.620', 'AMMO2': '0.001', 'weapon4': '0.004', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'ARMOR': '0.464', 'WEAPON3': '0.900', 'weapon2': '1.338', 'HITCOUNT': '1.690', 'weapon3': '2.004', 'DAMAGECOUNT': '6.366', 'FRAGCOUNT': '24.000'} [2024-08-05 23:11:11,522][52671] DAMAGECOUNT value on done: 20847.0 [2024-08-05 23:11:11,523][52671] Sum rewards: 13.116, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.778', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO3': '0.080', 'AMMO4': '0.096', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.442', 'ARMOR': '0.468', 'WEAPON3': '0.650', 'weapon2': '1.154', 'HITCOUNT': '1.190', 'weapon3': '1.772', 'DAMAGECOUNT': '3.783', 'FRAGCOUNT': '9.000'} [2024-08-05 23:11:11,649][52649] DAMAGECOUNT value on done: 25948.0 [2024-08-05 23:11:11,650][52649] Sum rewards: 21.671, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.025', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'ARMOR': '0.882', 'WEAPON3': '1.000', 'weapon2': '1.392', 'HITCOUNT': '1.620', 'weapon3': '1.926', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:12,794][52567] Fps is (10 sec: 17205.3, 60 sec: 16657.2, 300 sec: 14828.9). Total num frames: 106733568. Throughput: 0: 4166.2. Samples: 26691260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:11:12,794][52567] Avg episode reward: [(0, '18.785')] [2024-08-05 23:11:12,964][52659] DAMAGECOUNT value on done: 24544.0 [2024-08-05 23:11:12,965][52659] Sum rewards: 23.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'WEAPON1': '0.010', 'AMMO3': '0.145', 'ARMOR': '0.524', 'WEAPON3': '0.950', 'weapon2': '1.354', 'HITCOUNT': '1.870', 'weapon3': '2.204', 'DAMAGECOUNT': '6.783', 'FRAGCOUNT': '22.000'} [2024-08-05 23:11:13,273][52614] Signal inference workers to stop experience collection... (2400 times) [2024-08-05 23:11:13,280][52614] Signal inference workers to resume experience collection... (2400 times) [2024-08-05 23:11:13,357][52650] InferenceWorker_p0-w0: stopping experience collection (2400 times) [2024-08-05 23:11:13,357][52650] InferenceWorker_p0-w0: resuming experience collection (2400 times) [2024-08-05 23:11:13,359][52650] Updated weights for policy 0, policy_version 13031 (0.0012) [2024-08-05 23:11:14,646][52671] DAMAGECOUNT value on done: 24665.0 [2024-08-05 23:11:14,647][52671] Sum rewards: 23.909, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.112', 'weapon5': '0.116', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.942', 'HITCOUNT': '1.310', 'weapon2': '1.348', 'weapon3': '1.562', 'DAMAGECOUNT': '5.064', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:15,159][52649] DAMAGECOUNT value on done: 23454.0 [2024-08-05 23:11:15,159][52649] Sum rewards: 27.151, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.055', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.118', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon2': '0.510', 'weapon4': '0.772', 'WEAPON3': '0.800', 'HITCOUNT': '1.820', 'weapon3': '2.020', 'DAMAGECOUNT': '6.687', 'FRAGCOUNT': '22.000'} [2024-08-05 23:11:15,826][52659] DAMAGECOUNT value on done: 22310.0 [2024-08-05 23:11:15,827][52659] Sum rewards: 23.906, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.526', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.131', 'AMMO4': '0.140', 'WEAPON4': '0.350', 'ARMOR': '0.507', 'weapon4': '0.696', 'weapon2': '0.820', 'WEAPON3': '0.900', 'HITCOUNT': '1.640', 'weapon3': '2.042', 'DAMAGECOUNT': '5.625', 'FRAGCOUNT': '20.000'} [2024-08-05 23:11:17,302][52671] DAMAGECOUNT value on done: 25174.0 [2024-08-05 23:11:17,305][52671] Sum rewards: 19.703, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.617', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.085', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.558', 'WEAPON3': '0.600', 'weapon2': '1.014', 'HITCOUNT': '1.490', 'weapon3': '1.708', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:17,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16657.1, 300 sec: 14967.8). Total num frames: 106823680. Throughput: 0: 4176.0. Samples: 26703920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:11:17,794][52567] Avg episode reward: [(0, '19.230')] [2024-08-05 23:11:17,797][52614] Saving new best policy, reward=19.230! [2024-08-05 23:11:18,209][52649] DAMAGECOUNT value on done: 21998.0 [2024-08-05 23:11:18,210][52649] Sum rewards: 25.872, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.212', 'weapon4': '0.002', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.013', 'weapon7': '0.048', 'AMMO4': '0.065', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.230', 'weapon3': '1.532', 'weapon2': '1.556', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '20.000'} [2024-08-05 23:11:19,056][52650] Updated weights for policy 0, policy_version 13041 (0.0018) [2024-08-05 23:11:19,062][52659] DAMAGECOUNT value on done: 23016.0 [2024-08-05 23:11:19,064][52659] Sum rewards: 19.523, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.105', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.076', 'AMMO3': '0.092', 'WEAPON4': '0.100', 'ARMOR': '0.404', 'WEAPON3': '0.700', 'HITCOUNT': '1.300', 'weapon3': '1.666', 'weapon2': '1.926', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:19,651][52649] Large shaping reward -2.554 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.006, -6.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:11:20,776][52671] DAMAGECOUNT value on done: 25270.0 [2024-08-05 23:11:20,777][52671] Sum rewards: 24.352, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.480', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.122', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.600', 'HITCOUNT': '1.760', 'weapon2': '1.876', 'DAMAGECOUNT': '6.000', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:21,035][52649] DAMAGECOUNT value on done: 25000.0 [2024-08-05 23:11:21,036][52649] Sum rewards: 19.486, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.284', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.113', 'AMMO4': '0.183', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.392', 'WEAPON3': '0.650', 'ARMOR': '0.808', 'weapon2': '1.372', 'HITCOUNT': '1.430', 'weapon3': '1.630', 'DAMAGECOUNT': '5.307', 'FRAGCOUNT': '15.500'} [2024-08-05 23:11:22,461][52659] DAMAGECOUNT value on done: 24874.0 [2024-08-05 23:11:22,464][52659] Sum rewards: 16.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.955', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.141', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.490', 'WEAPON3': '0.850', 'weapon2': '1.252', 'HITCOUNT': '1.510', 'weapon3': '2.028', 'DAMAGECOUNT': '6.120', 'FRAGCOUNT': '13.500'} [2024-08-05 23:11:22,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16520.5, 300 sec: 15134.4). Total num frames: 106897408. Throughput: 0: 4177.3. Samples: 26728940. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-05 23:11:22,795][52567] Avg episode reward: [(0, '19.229')] [2024-08-05 23:11:23,121][52650] Updated weights for policy 0, policy_version 13051 (0.0017) [2024-08-05 23:11:23,799][52647] DAMAGECOUNT value on done: 25765.0 [2024-08-05 23:11:23,800][52647] Sum rewards: 13.813, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.638', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.012', 'ARMOR': '0.028', 'weapon5': '0.052', 'AMMO3': '0.101', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '0.950', 'weapon2': '1.388', 'weapon3': '1.874', 'DAMAGECOUNT': '3.660', 'FRAGCOUNT': '12.000'} [2024-08-05 23:11:23,890][52649] DAMAGECOUNT value on done: 21224.0 [2024-08-05 23:11:23,891][52649] Sum rewards: 12.494, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.100', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'weapon4': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'ARMOR': '0.500', 'WEAPON3': '0.700', 'HITCOUNT': '1.460', 'weapon3': '1.570', 'weapon2': '2.116', 'DAMAGECOUNT': '4.698', 'FRAGCOUNT': '9.000'} [2024-08-05 23:11:24,049][52671] DAMAGECOUNT value on done: 22559.0 [2024-08-05 23:11:24,049][52671] Sum rewards: 22.497, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.120', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO3': '0.060', 'weapon5': '0.060', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'WEAPON3': '0.450', 'ARMOR': '0.895', 'weapon3': '1.406', 'HITCOUNT': '1.500', 'weapon2': '1.632', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:25,675][52659] DAMAGECOUNT value on done: 25808.0 [2024-08-05 23:11:25,675][52659] Sum rewards: 16.664, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.135', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'ARMOR': '0.477', 'WEAPON3': '0.600', 'HITCOUNT': '1.280', 'weapon3': '1.354', 'weapon2': '1.636', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '12.000'} [2024-08-05 23:11:26,467][52647] DAMAGECOUNT value on done: 24704.0 [2024-08-05 23:11:26,468][52647] Sum rewards: 21.752, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.050', 'AMMO3': '0.104', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon2': '1.318', 'HITCOUNT': '1.480', 'weapon3': '1.774', 'DAMAGECOUNT': '5.415', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:27,056][52649] DAMAGECOUNT value on done: 24395.0 [2024-08-05 23:11:27,058][52649] Sum rewards: 17.852, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.437', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon5': '0.048', 'AMMO3': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.210', 'WEAPON3': '0.500', 'ARMOR': '0.920', 'HITCOUNT': '1.310', 'weapon3': '1.378', 'weapon2': '1.860', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '12.500'} [2024-08-05 23:11:27,077][52671] DAMAGECOUNT value on done: 25096.0 [2024-08-05 23:11:27,081][52671] Sum rewards: 16.799, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.630', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.136', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'weapon3': '1.580', 'HITCOUNT': '1.620', 'weapon2': '1.628', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '13.000'} [2024-08-05 23:11:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 15217.7). Total num frames: 106987520. Throughput: 0: 4176.9. Samples: 26753930. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-05 23:11:27,794][52567] Avg episode reward: [(0, '19.223')] [2024-08-05 23:11:28,628][52650] Updated weights for policy 0, policy_version 13061 (0.0029) [2024-08-05 23:11:28,653][52647] DAMAGECOUNT value on done: 27502.0 [2024-08-05 23:11:28,653][52647] Sum rewards: 20.240, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.953', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon4': '0.254', 'WEAPON3': '0.400', 'ARMOR': '0.492', 'weapon2': '1.370', 'weapon3': '1.468', 'HITCOUNT': '1.580', 'DAMAGECOUNT': '6.111', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:28,832][52659] DAMAGECOUNT value on done: 23146.0 [2024-08-05 23:11:28,834][52659] Sum rewards: 19.133, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.843', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.614', 'WEAPON3': '0.700', 'weapon2': '1.018', 'HITCOUNT': '1.420', 'weapon3': '1.600', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:30,329][52649] DAMAGECOUNT value on done: 24861.0 [2024-08-05 23:11:30,331][52649] Sum rewards: 17.368, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.112', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.800', 'ARMOR': '0.890', 'HITCOUNT': '1.290', 'weapon2': '1.302', 'weapon3': '1.894', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '14.000'} [2024-08-05 23:11:31,422][52647] DAMAGECOUNT value on done: 23896.0 [2024-08-05 23:11:31,422][52647] Sum rewards: 17.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.344', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'WEAPON4': '0.350', 'ARMOR': '0.450', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon2': '1.194', 'HITCOUNT': '1.570', 'weapon3': '1.848', 'DAMAGECOUNT': '5.448', 'FRAGCOUNT': '16.000'} [2024-08-05 23:11:31,630][52659] DAMAGECOUNT value on done: 24186.0 [2024-08-05 23:11:31,632][52659] Sum rewards: 29.324, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.060', 'weapon4': '0.066', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.341', 'WEAPON3': '0.550', 'HITCOUNT': '1.620', 'weapon2': '1.644', 'weapon3': '1.936', 'DAMAGECOUNT': '6.780', 'FRAGCOUNT': '22.000'} [2024-08-05 23:11:31,758][52803] DAMAGECOUNT value on done: 23424.0 [2024-08-05 23:11:31,758][52803] Sum rewards: 23.928, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.866', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.194', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.164', 'HITCOUNT': '2.010', 'weapon3': '2.288', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 16520.5, 300 sec: 15273.2). Total num frames: 107061248. Throughput: 0: 4179.6. Samples: 26766590. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 23:11:32,802][52567] Avg episode reward: [(0, '19.393')] [2024-08-05 23:11:32,820][52614] Saving new best policy, reward=19.393! [2024-08-05 23:11:33,145][52650] Updated weights for policy 0, policy_version 13071 (0.0032) [2024-08-05 23:11:33,606][52649] DAMAGECOUNT value on done: 25457.0 [2024-08-05 23:11:33,608][52649] Sum rewards: 11.279, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'weapon5': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'ARMOR': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON3': '1.150', 'HITCOUNT': '1.180', 'weapon2': '1.434', 'weapon3': '1.844', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '13.000'} [2024-08-05 23:11:34,443][52647] DAMAGECOUNT value on done: 25932.0 [2024-08-05 23:11:34,443][52647] Sum rewards: 14.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.948', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.052', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'weapon4': '0.350', 'ARMOR': '0.468', 'WEAPON4': '0.550', 'weapon2': '0.910', 'WEAPON3': '0.950', 'HITCOUNT': '1.450', 'weapon3': '2.108', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '14.000'} [2024-08-05 23:11:35,107][52803] DAMAGECOUNT value on done: 25437.0 [2024-08-05 23:11:35,111][52803] Sum rewards: 14.563, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.345', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'weapon5': '0.082', 'AMMO3': '0.102', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.890', 'HITCOUNT': '1.150', 'weapon3': '1.662', 'weapon2': '1.768', 'DAMAGECOUNT': '4.215', 'FRAGCOUNT': '11.000'} [2024-08-05 23:11:35,248][52659] DAMAGECOUNT value on done: 23821.0 [2024-08-05 23:11:35,249][52659] Sum rewards: 26.903, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.413', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.218', 'weapon5': '0.232', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.274', 'HITCOUNT': '2.010', 'weapon3': '2.074', 'DAMAGECOUNT': '8.361', 'FRAGCOUNT': '21.000'} [2024-08-05 23:11:37,662][52647] DAMAGECOUNT value on done: 25088.0 [2024-08-05 23:11:37,663][52647] Sum rewards: 20.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.616', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon5': '0.208', 'WEAPON3': '1.000', 'ARMOR': '1.311', 'weapon2': '1.464', 'HITCOUNT': '1.630', 'weapon3': '2.064', 'DAMAGECOUNT': '6.561', 'FRAGCOUNT': '18.000'} [2024-08-05 23:11:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 15301.0). Total num frames: 107151360. Throughput: 0: 4177.4. Samples: 26791380. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 23:11:37,794][52567] Avg episode reward: [(0, '19.312')] [2024-08-05 23:11:38,360][52803] DAMAGECOUNT value on done: 21040.0 [2024-08-05 23:11:38,360][52803] Sum rewards: 17.326, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.832', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon7': '0.058', 'AMMO4': '0.105', 'AMMO3': '0.141', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.350', 'ARMOR': '0.855', 'WEAPON3': '1.000', 'weapon2': '1.158', 'HITCOUNT': '1.220', 'weapon3': '2.086', 'DAMAGECOUNT': '4.866', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:38,393][52650] Updated weights for policy 0, policy_version 13081 (0.0021) [2024-08-05 23:11:38,396][52811] DAMAGECOUNT value on done: 23673.0 [2024-08-05 23:11:38,397][52811] Sum rewards: 27.418, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.410', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.105', 'weapon4': '0.214', 'WEAPON3': '0.700', 'ARMOR': '1.405', 'weapon2': '1.530', 'HITCOUNT': '1.700', 'weapon3': '1.938', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '21.000'} [2024-08-05 23:11:38,583][52668] DAMAGECOUNT value on done: 23810.0 [2024-08-05 23:11:38,584][52668] Sum rewards: 19.527, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'AMMO5': '0.007', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon5': '0.160', 'AMMO4': '0.254', 'weapon4': '0.352', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon2': '1.272', 'HITCOUNT': '1.440', 'weapon3': '1.522', 'DAMAGECOUNT': '6.348', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:38,598][52659] DAMAGECOUNT value on done: 25770.0 [2024-08-05 23:11:38,598][52659] Sum rewards: 18.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.259', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'AMMO4': '0.202', 'weapon4': '0.210', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'WEAPON3': '0.850', 'weapon2': '1.538', 'HITCOUNT': '1.660', 'weapon3': '1.964', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:40,382][52647] DAMAGECOUNT value on done: 24871.0 [2024-08-05 23:11:40,383][52647] Sum rewards: 28.113, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.315', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'AMMO3': '0.084', 'WEAPON3': '0.600', 'weapon3': '1.642', 'weapon2': '1.756', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '20.000'} [2024-08-05 23:11:41,654][52811] DAMAGECOUNT value on done: 22523.0 [2024-08-05 23:11:41,655][52811] Sum rewards: 11.677, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.410', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.206', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon2': '1.618', 'weapon3': '1.694', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '10.000'} [2024-08-05 23:11:41,678][52803] DAMAGECOUNT value on done: 22011.0 [2024-08-05 23:11:41,679][52803] Sum rewards: 20.039, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.318', 'HITCOUNT': '1.590', 'weapon3': '2.154', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '18.000'} [2024-08-05 23:11:42,054][52668] DAMAGECOUNT value on done: 26208.0 [2024-08-05 23:11:42,054][52668] Sum rewards: 21.772, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.050', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.012', 'AMMO3': '0.135', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.144', 'HITCOUNT': '1.590', 'weapon3': '2.006', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16793.6, 300 sec: 15328.8). Total num frames: 107233280. Throughput: 0: 4191.3. Samples: 26816700. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 23:11:42,794][52567] Avg episode reward: [(0, '19.280')] [2024-08-05 23:11:42,940][52650] Updated weights for policy 0, policy_version 13091 (0.0012) [2024-08-05 23:11:43,048][52647] DAMAGECOUNT value on done: 26684.0 [2024-08-05 23:11:43,050][52647] Sum rewards: 21.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.175', 'AMMO5': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.032', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.860', 'HITCOUNT': '1.500', 'weapon3': '1.570', 'weapon2': '1.674', 'DAMAGECOUNT': '4.866', 'FRAGCOUNT': '18.000'} [2024-08-05 23:11:44,799][52669] Large shaping reward 3.291 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.24, 80.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:11:44,819][52668] DAMAGECOUNT value on done: 23026.0 [2024-08-05 23:11:44,819][52668] Sum rewards: 27.205, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.331', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON3': '0.800', 'ARMOR': '0.852', 'weapon2': '1.404', 'HITCOUNT': '1.490', 'weapon3': '1.916', 'DAMAGECOUNT': '6.033', 'FRAGCOUNT': '22.000'} [2024-08-05 23:11:44,897][52803] DAMAGECOUNT value on done: 24540.0 [2024-08-05 23:11:44,898][52803] Sum rewards: 19.686, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.158', 'AMMO2': '0.006', 'AMMO5': '0.009', 'AMMO4': '0.028', 'weapon5': '0.102', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.800', 'ARMOR': '0.943', 'weapon2': '1.332', 'HITCOUNT': '1.410', 'weapon3': '1.806', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:44,909][52811] DAMAGECOUNT value on done: 24449.0 [2024-08-05 23:11:44,910][52811] Sum rewards: 21.787, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.194', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.086', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'HITCOUNT': '1.360', 'weapon2': '1.686', 'weapon3': '1.852', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:45,664][52647] DAMAGECOUNT value on done: 27329.0 [2024-08-05 23:11:45,667][52647] Sum rewards: 22.422, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.255', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.028', 'AMMO3': '0.109', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.497', 'weapon4': '0.620', 'WEAPON3': '0.800', 'weapon2': '0.826', 'HITCOUNT': '1.700', 'weapon3': '2.098', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:47,724][52660] DAMAGECOUNT value on done: 25272.0 [2024-08-05 23:11:47,725][52660] Sum rewards: 9.901, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.018', 'AMMO4': '0.056', 'weapon5': '0.074', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.449', 'WEAPON3': '0.700', 'HITCOUNT': '1.080', 'weapon3': '1.678', 'weapon2': '1.694', 'DAMAGECOUNT': '3.945', 'FRAGCOUNT': '7.500'} [2024-08-05 23:11:47,794][52567] Fps is (10 sec: 16383.4, 60 sec: 16657.0, 300 sec: 15356.5). Total num frames: 107315200. Throughput: 0: 4193.0. Samples: 26829490. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 23:11:47,795][52567] Avg episode reward: [(0, '19.153')] [2024-08-05 23:11:47,964][52650] Updated weights for policy 0, policy_version 13101 (0.0026) [2024-08-05 23:11:48,112][52811] DAMAGECOUNT value on done: 23273.0 [2024-08-05 23:11:48,114][52811] Sum rewards: 17.128, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'ARMOR': '0.836', 'WEAPON3': '0.850', 'HITCOUNT': '1.350', 'weapon2': '1.656', 'weapon3': '1.814', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '14.000'} [2024-08-05 23:11:48,319][52668] DAMAGECOUNT value on done: 24927.0 [2024-08-05 23:11:48,320][52668] Sum rewards: 18.331, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.176', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.116', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'ARMOR': '0.936', 'HITCOUNT': '1.320', 'weapon2': '1.616', 'weapon3': '1.976', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:48,446][52803] DAMAGECOUNT value on done: 20903.0 [2024-08-05 23:11:48,446][52803] Sum rewards: 15.822, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'ARMOR': '0.020', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.230', 'weapon2': '1.372', 'weapon3': '1.894', 'DAMAGECOUNT': '4.977', 'FRAGCOUNT': '14.000'} [2024-08-05 23:11:48,483][52647] DAMAGECOUNT value on done: 25364.0 [2024-08-05 23:11:48,483][52647] Sum rewards: 21.023, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.310', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon5': '0.076', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.442', 'ARMOR': '0.512', 'WEAPON3': '0.700', 'weapon2': '1.068', 'HITCOUNT': '1.330', 'weapon3': '1.566', 'DAMAGECOUNT': '5.298', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:50,794][52660] DAMAGECOUNT value on done: 25422.0 [2024-08-05 23:11:50,797][52660] Sum rewards: 21.403, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.704', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.247', 'weapon4': '0.392', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon2': '1.380', 'weapon3': '1.420', 'DAMAGECOUNT': '4.557', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:51,073][52668] DAMAGECOUNT value on done: 23995.0 [2024-08-05 23:11:51,074][52668] Sum rewards: 21.265, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.986', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.112', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.452', 'WEAPON3': '0.800', 'ARMOR': '0.936', 'weapon2': '1.292', 'weapon3': '1.598', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.263', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:51,165][52647] DAMAGECOUNT value on done: 25513.0 [2024-08-05 23:11:51,167][52647] Sum rewards: 14.454, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.826', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO3': '0.074', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'ARMOR': '0.472', 'weapon4': '0.476', 'WEAPON3': '0.550', 'weapon2': '0.886', 'HITCOUNT': '1.290', 'weapon3': '1.590', 'DAMAGECOUNT': '4.272', 'FRAGCOUNT': '10.500'} [2024-08-05 23:11:51,350][52811] DAMAGECOUNT value on done: 23341.0 [2024-08-05 23:11:51,352][52811] Sum rewards: 22.295, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.690', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'ARMOR': '0.846', 'WEAPON3': '0.850', 'weapon2': '1.444', 'HITCOUNT': '1.490', 'weapon3': '1.970', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '20.000'} [2024-08-05 23:11:52,048][52803] DAMAGECOUNT value on done: 26518.0 [2024-08-05 23:11:52,058][52803] Sum rewards: 26.579, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.738', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'weapon5': '0.090', 'AMMO3': '0.106', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'weapon2': '1.602', 'weapon3': '2.028', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '7.893', 'FRAGCOUNT': '20.000'} [2024-08-05 23:11:52,795][52567] Fps is (10 sec: 16382.5, 60 sec: 16656.9, 300 sec: 15384.3). Total num frames: 107397120. Throughput: 0: 4186.2. Samples: 26854170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:11:52,796][52567] Avg episode reward: [(0, '19.343')] [2024-08-05 23:11:52,870][52650] Updated weights for policy 0, policy_version 13111 (0.0021) [2024-08-05 23:11:53,217][52660] DAMAGECOUNT value on done: 23967.0 [2024-08-05 23:11:53,217][52660] Sum rewards: 23.253, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.964', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO3': '0.088', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon4': '0.706', 'weapon2': '0.890', 'ARMOR': '1.423', 'weapon3': '1.636', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:53,486][52668] DAMAGECOUNT value on done: 26568.0 [2024-08-05 23:11:53,487][52668] Sum rewards: 24.802, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.370', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'AMMO3': '0.068', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon4': '0.556', 'weapon2': '0.828', 'weapon3': '1.284', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.486', 'FRAGCOUNT': '18.000'} [2024-08-05 23:11:54,062][52647] DAMAGECOUNT value on done: 23218.0 [2024-08-05 23:11:54,062][52647] Sum rewards: 24.226, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.107', 'weapon4': '0.108', 'weapon5': '0.114', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'WEAPON3': '0.700', 'HITCOUNT': '1.440', 'weapon3': '1.598', 'weapon2': '1.600', 'DAMAGECOUNT': '6.246', 'FRAGCOUNT': '19.000'} [2024-08-05 23:11:54,671][52811] DAMAGECOUNT value on done: 23212.0 [2024-08-05 23:11:54,673][52811] Sum rewards: 15.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.201', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.126', 'AMMO3': '0.184', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.984', 'WEAPON3': '1.100', 'HITCOUNT': '1.560', 'weapon3': '1.970', 'DAMAGECOUNT': '5.754', 'FRAGCOUNT': '14.000'} [2024-08-05 23:11:55,771][52803] DAMAGECOUNT value on done: 22614.0 [2024-08-05 23:11:55,772][52803] Sum rewards: 28.899, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.006', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.216', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.064', 'weapon3': '1.698', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '7.191', 'FRAGCOUNT': '23.000'} [2024-08-05 23:11:55,984][52660] DAMAGECOUNT value on done: 23616.0 [2024-08-05 23:11:55,985][52660] Sum rewards: 21.189, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.649', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.083', 'ARMOR': '0.468', 'WEAPON3': '0.600', 'HITCOUNT': '1.420', 'weapon2': '1.434', 'weapon3': '1.554', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '16.500'} [2024-08-05 23:11:56,472][52668] DAMAGECOUNT value on done: 27505.0 [2024-08-05 23:11:56,472][52668] Sum rewards: 26.731, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.326', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON3': '0.850', 'ARMOR': '0.851', 'HITCOUNT': '1.680', 'weapon3': '1.684', 'weapon2': '1.812', 'DAMAGECOUNT': '6.525', 'FRAGCOUNT': '21.000'} [2024-08-05 23:11:56,726][52647] DAMAGECOUNT value on done: 24461.0 [2024-08-05 23:11:56,727][52647] Sum rewards: 29.300, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.740', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.156', 'WEAPON3': '0.750', 'weapon2': '1.596', 'HITCOUNT': '1.780', 'weapon3': '1.914', 'DAMAGECOUNT': '6.243', 'FRAGCOUNT': '24.000'} [2024-08-05 23:11:57,794][52567] Fps is (10 sec: 16384.6, 60 sec: 16520.5, 300 sec: 15412.1). Total num frames: 107479040. Throughput: 0: 4176.0. Samples: 26879180. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:11:57,794][52567] Avg episode reward: [(0, '19.689')] [2024-08-05 23:11:57,850][52614] Saving new best policy, reward=19.689! [2024-08-05 23:11:57,856][52650] Updated weights for policy 0, policy_version 13121 (0.0017) [2024-08-05 23:11:57,988][52811] DAMAGECOUNT value on done: 24552.0 [2024-08-05 23:11:57,988][52811] Sum rewards: 19.538, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.971', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'weapon5': '0.042', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.358', 'ARMOR': '0.489', 'WEAPON3': '0.650', 'weapon2': '1.214', 'HITCOUNT': '1.230', 'weapon3': '1.558', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:59,183][52803] DAMAGECOUNT value on done: 23633.0 [2024-08-05 23:11:59,186][52803] Sum rewards: 15.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'ARMOR': '0.456', 'WEAPON3': '1.350', 'HITCOUNT': '1.370', 'weapon2': '1.522', 'weapon3': '2.186', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '17.000'} [2024-08-05 23:11:59,435][52660] DAMAGECOUNT value on done: 20675.0 [2024-08-05 23:11:59,439][52660] Sum rewards: 20.662, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.042', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.070', 'ARMOR': '0.076', 'AMMO3': '0.097', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.520', 'WEAPON3': '0.650', 'weapon2': '1.028', 'weapon3': '1.728', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '15.000'} [2024-08-05 23:11:59,698][52647] DAMAGECOUNT value on done: 24180.0 [2024-08-05 23:11:59,698][52647] Sum rewards: 14.383, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.474', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.280', 'WEAPON3': '0.750', 'ARMOR': '0.900', 'weapon2': '1.028', 'HITCOUNT': '1.320', 'weapon3': '1.746', 'DAMAGECOUNT': '4.572', 'FRAGCOUNT': '11.000'} [2024-08-05 23:12:00,017][52668] DAMAGECOUNT value on done: 25997.0 [2024-08-05 23:12:00,018][52668] Sum rewards: 19.949, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.024', 'AMMO3': '0.098', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '1.306', 'HITCOUNT': '1.360', 'weapon3': '1.610', 'weapon2': '1.658', 'DAMAGECOUNT': '4.884', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:00,326][52794] DAMAGECOUNT value on done: 28342.0 [2024-08-05 23:12:00,326][52794] Sum rewards: 24.197, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.825', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'weapon5': '0.054', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.242', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '1.088', 'HITCOUNT': '1.700', 'weapon3': '1.830', 'DAMAGECOUNT': '6.564', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:01,494][52811] DAMAGECOUNT value on done: 21441.0 [2024-08-05 23:12:01,494][52811] Sum rewards: 18.793, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.205', 'AMMO2': '0.025', 'AMMO3': '0.099', 'AMMO4': '0.123', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'weapon4': '0.620', 'WEAPON3': '0.650', 'weapon2': '1.092', 'HITCOUNT': '1.610', 'weapon3': '1.678', 'DAMAGECOUNT': '5.091', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:02,311][52660] DAMAGECOUNT value on done: 26036.0 [2024-08-05 23:12:02,311][52660] Sum rewards: 22.070, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.218', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO3': '0.083', 'AMMO4': '0.117', 'weapon5': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '0.550', 'ARMOR': '1.320', 'HITCOUNT': '1.350', 'weapon2': '1.378', 'weapon3': '1.476', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '16.500'} [2024-08-05 23:12:02,412][52803] DAMAGECOUNT value on done: 21795.0 [2024-08-05 23:12:02,415][52803] Sum rewards: 23.786, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.110', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.116', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.520', 'WEAPON3': '1.150', 'weapon2': '1.410', 'HITCOUNT': '1.690', 'weapon3': '1.830', 'DAMAGECOUNT': '6.156', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:02,523][52647] DAMAGECOUNT value on done: 27036.0 [2024-08-05 23:12:02,523][52647] Sum rewards: 16.722, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.393', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '1.166', 'WEAPON3': '1.200', 'HITCOUNT': '1.520', 'weapon3': '2.162', 'DAMAGECOUNT': '5.616', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:02,575][52662] DAMAGECOUNT value on done: 29201.0 [2024-08-05 23:12:02,576][52662] Sum rewards: 25.134, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.130', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.066', 'AMMO3': '0.127', 'AMMO4': '0.202', 'WEAPON5': '0.350', 'ARMOR': '0.546', 'WEAPON4': '0.700', 'weapon2': '0.806', 'weapon4': '0.888', 'WEAPON3': '0.900', 'weapon3': '1.804', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.410', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:02,709][52668] DAMAGECOUNT value on done: 22414.0 [2024-08-05 23:12:02,711][52668] Sum rewards: 15.631, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.548', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.474', 'weapon2': '0.758', 'WEAPON3': '0.850', 'HITCOUNT': '1.470', 'weapon3': '1.890', 'DAMAGECOUNT': '5.040', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:02,794][52567] Fps is (10 sec: 16385.5, 60 sec: 16657.4, 300 sec: 15439.8). Total num frames: 107560960. Throughput: 0: 4165.1. Samples: 26891350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:12:02,794][52567] Avg episode reward: [(0, '19.897')] [2024-08-05 23:12:02,892][52614] Saving new best policy, reward=19.897! [2024-08-05 23:12:02,896][52650] Updated weights for policy 0, policy_version 13131 (0.0012) [2024-08-05 23:12:02,993][52794] DAMAGECOUNT value on done: 28758.0 [2024-08-05 23:12:02,993][52794] Sum rewards: 16.591, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.136', 'weapon4': '0.202', 'WEAPON3': '0.800', 'ARMOR': '0.907', 'HITCOUNT': '1.450', 'weapon2': '1.612', 'weapon3': '1.870', 'DAMAGECOUNT': '5.148', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:04,834][52811] DAMAGECOUNT value on done: 23038.0 [2024-08-05 23:12:04,835][52811] Sum rewards: 19.077, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.062', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.143', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.328', 'ARMOR': '0.891', 'WEAPON3': '0.950', 'weapon2': '1.326', 'HITCOUNT': '1.540', 'weapon3': '1.810', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:05,060][52662] DAMAGECOUNT value on done: 30022.0 [2024-08-05 23:12:05,060][52662] Sum rewards: 17.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.197', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.159', 'WEAPON4': '0.350', 'weapon4': '0.484', 'ARMOR': '0.872', 'WEAPON3': '1.100', 'weapon2': '1.342', 'HITCOUNT': '1.780', 'weapon3': '1.790', 'DAMAGECOUNT': '6.273', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:05,119][52660] DAMAGECOUNT value on done: 23606.0 [2024-08-05 23:12:05,121][52660] Sum rewards: 27.343, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.623', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'ARMOR': '0.036', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.136', 'HITCOUNT': '1.820', 'weapon3': '2.048', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:05,462][52647] DAMAGECOUNT value on done: 22974.0 [2024-08-05 23:12:05,464][52647] Sum rewards: 17.428, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.189', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.800', 'weapon2': '1.070', 'HITCOUNT': '1.580', 'weapon3': '1.830', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:05,469][52794] DAMAGECOUNT value on done: 28394.0 [2024-08-05 23:12:05,469][52794] Sum rewards: 21.500, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.222', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO3': '0.076', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.342', 'ARMOR': '0.457', 'WEAPON3': '0.500', 'weapon2': '1.454', 'weapon3': '1.466', 'HITCOUNT': '1.520', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:05,678][52803] DAMAGECOUNT value on done: 23837.0 [2024-08-05 23:12:05,681][52803] Sum rewards: 27.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.082', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.310', 'WEAPON3': '0.550', 'ARMOR': '0.942', 'weapon2': '1.600', 'HITCOUNT': '1.750', 'weapon3': '1.750', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:05,716][52668] DAMAGECOUNT value on done: 27886.0 [2024-08-05 23:12:05,717][52668] Sum rewards: 26.777, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.178', 'AMMO5': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.035', 'AMMO3': '0.138', 'AMMO4': '0.173', 'weapon5': '0.200', 'weapon4': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.714', 'WEAPON3': '0.950', 'HITCOUNT': '1.790', 'weapon3': '2.274', 'DAMAGECOUNT': '7.017', 'FRAGCOUNT': '24.000'} [2024-08-05 23:12:07,773][52650] Updated weights for policy 0, policy_version 13141 (0.0012) [2024-08-05 23:12:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.2, 300 sec: 15495.4). Total num frames: 107651072. Throughput: 0: 4161.3. Samples: 26916200. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:12:07,794][52567] Avg episode reward: [(0, '20.260')] [2024-08-05 23:12:07,797][52614] Saving new best policy, reward=20.260! [2024-08-05 23:12:08,064][52662] DAMAGECOUNT value on done: 31522.0 [2024-08-05 23:12:08,065][52662] Sum rewards: 21.590, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.137', 'weapon5': '0.196', 'WEAPON4': '0.200', 'HEALTH': '0.218', 'WEAPON3': '0.350', 'weapon4': '0.356', 'weapon3': '1.040', 'weapon2': '1.294', 'HITCOUNT': '1.500', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:08,132][52811] DAMAGECOUNT value on done: 23231.0 [2024-08-05 23:12:08,136][52811] Sum rewards: 23.195, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.814', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'ARMOR': '0.420', 'weapon4': '0.420', 'WEAPON3': '0.800', 'weapon2': '1.096', 'HITCOUNT': '1.490', 'weapon3': '1.884', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:08,188][52660] DAMAGECOUNT value on done: 24564.0 [2024-08-05 23:12:08,192][52660] Sum rewards: 16.025, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.194', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.140', 'weapon4': '0.236', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'WEAPON3': '0.850', 'weapon2': '1.470', 'HITCOUNT': '1.490', 'weapon3': '1.758', 'DAMAGECOUNT': '5.295', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:08,525][52647] DAMAGECOUNT value on done: 26180.0 [2024-08-05 23:12:08,526][52647] Sum rewards: 30.575, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.365', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO3': '0.089', 'AMMO4': '0.112', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.514', 'WEAPON3': '0.550', 'weapon2': '1.098', 'ARMOR': '1.289', 'weapon3': '1.662', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '23.000'} [2024-08-05 23:12:08,606][52794] DAMAGECOUNT value on done: 26964.0 [2024-08-05 23:12:08,606][52794] Sum rewards: 20.210, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.629', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.250', 'ARMOR': '0.836', 'weapon2': '0.892', 'WEAPON3': '1.050', 'HITCOUNT': '1.820', 'weapon3': '2.472', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:08,710][52668] DAMAGECOUNT value on done: 22944.0 [2024-08-05 23:12:08,712][52668] Sum rewards: 19.584, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.846', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.156', 'weapon4': '0.252', 'ARMOR': '0.452', 'WEAPON3': '0.700', 'weapon2': '1.376', 'HITCOUNT': '1.590', 'weapon3': '1.870', 'DAMAGECOUNT': '6.168', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:09,060][52803] DAMAGECOUNT value on done: 22158.0 [2024-08-05 23:12:09,060][52803] Sum rewards: 18.256, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO3': '0.119', 'AMMO4': '0.126', 'weapon5': '0.154', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.634', 'WEAPON3': '0.800', 'weapon2': '0.952', 'HITCOUNT': '1.410', 'weapon3': '1.694', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:10,874][52660] DAMAGECOUNT value on done: 24343.0 [2024-08-05 23:12:10,874][52660] Sum rewards: 18.838, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.794', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.052', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON3': '0.650', 'ARMOR': '0.917', 'weapon3': '1.312', 'weapon2': '1.628', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '12.000'} [2024-08-05 23:12:11,217][52662] DAMAGECOUNT value on done: 26844.0 [2024-08-05 23:12:11,217][52662] Sum rewards: 20.232, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.710', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.284', 'ARMOR': '0.408', 'WEAPON3': '0.500', 'weapon3': '1.292', 'HITCOUNT': '1.310', 'weapon2': '1.538', 'DAMAGECOUNT': '4.602', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:11,393][52668] DAMAGECOUNT value on done: 24407.0 [2024-08-05 23:12:11,394][52668] Sum rewards: 25.219, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.243', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.080', 'weapon4': '0.234', 'WEAPON3': '0.550', 'ARMOR': '0.812', 'weapon2': '1.422', 'weapon3': '1.542', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '6.030', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:11,536][52647] DAMAGECOUNT value on done: 24665.0 [2024-08-05 23:12:11,536][52647] Sum rewards: 18.112, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.368', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO5': '0.015', 'weapon5': '0.082', 'AMMO3': '0.086', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '1.150', 'weapon3': '1.570', 'weapon2': '1.578', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:11,623][52794] DAMAGECOUNT value on done: 29054.0 [2024-08-05 23:12:11,624][52794] Sum rewards: 11.399, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO5': '0.010', 'AMMO2': '0.059', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.296', 'WEAPON4': '0.550', 'ARMOR': '0.552', 'weapon2': '0.760', 'weapon4': '0.814', 'WEAPON3': '0.950', 'HITCOUNT': '1.170', 'weapon3': '1.722', 'DAMAGECOUNT': '3.849', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:11,664][52811] DAMAGECOUNT value on done: 25648.0 [2024-08-05 23:12:11,666][52811] Sum rewards: 17.438, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.256', 'AMMO2': '0.007', 'AMMO5': '0.012', 'AMMO4': '0.036', 'weapon5': '0.074', 'AMMO3': '0.112', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON3': '0.750', 'ARMOR': '0.868', 'HITCOUNT': '1.370', 'weapon2': '1.506', 'weapon3': '1.716', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:11,942][52795] DAMAGECOUNT value on done: 21171.0 [2024-08-05 23:12:11,942][52795] Sum rewards: 23.678, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.389', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.137', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'weapon2': '1.144', 'ARMOR': '1.294', 'HITCOUNT': '1.800', 'weapon3': '2.268', 'DAMAGECOUNT': '6.366', 'FRAGCOUNT': '18.500'} [2024-08-05 23:12:12,348][52803] DAMAGECOUNT value on done: 21416.0 [2024-08-05 23:12:12,351][52803] Sum rewards: 16.157, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.626', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'weapon4': '0.580', 'ARMOR': '0.842', 'WEAPON3': '0.900', 'weapon2': '1.104', 'HITCOUNT': '1.340', 'weapon3': '2.022', 'DAMAGECOUNT': '4.758', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:12,774][52650] Updated weights for policy 0, policy_version 13151 (0.0029) [2024-08-05 23:12:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 15523.1). Total num frames: 107732992. Throughput: 0: 4161.3. Samples: 26941190. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:12:12,794][52567] Avg episode reward: [(0, '20.573')] [2024-08-05 23:12:12,795][52614] Saving new best policy, reward=20.573! [2024-08-05 23:12:13,698][52660] DAMAGECOUNT value on done: 24650.0 [2024-08-05 23:12:13,698][52660] Sum rewards: 22.921, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'weapon4': '0.008', 'AMMO2': '0.023', 'AMMO3': '0.105', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'weapon3': '1.498', 'HITCOUNT': '1.500', 'weapon2': '1.722', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:13,812][52662] DAMAGECOUNT value on done: 27099.0 [2024-08-05 23:12:13,812][52662] Sum rewards: 15.189, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'ARMOR': '0.473', 'WEAPON3': '0.850', 'HITCOUNT': '1.490', 'weapon2': '1.764', 'weapon3': '2.008', 'DAMAGECOUNT': '5.286', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:14,034][52668] DAMAGECOUNT value on done: 24356.0 [2024-08-05 23:12:14,040][52668] Sum rewards: 14.388, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'weapon4': '0.648', 'WEAPON3': '0.800', 'weapon2': '1.000', 'HITCOUNT': '1.220', 'weapon3': '1.844', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '11.000'} [2024-08-05 23:12:14,194][52794] DAMAGECOUNT value on done: 29527.0 [2024-08-05 23:12:14,196][52794] Sum rewards: 28.163, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.512', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.154', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'ARMOR': '0.517', 'WEAPON3': '1.100', 'weapon2': '1.134', 'HITCOUNT': '2.070', 'weapon3': '2.314', 'DAMAGECOUNT': '7.872', 'FRAGCOUNT': '24.000'} [2024-08-05 23:12:14,552][52647] DAMAGECOUNT value on done: 26100.0 [2024-08-05 23:12:14,556][52647] Sum rewards: 22.820, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.665', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON3': '1.000', 'ARMOR': '1.311', 'weapon2': '1.590', 'HITCOUNT': '1.880', 'weapon3': '2.116', 'DAMAGECOUNT': '7.518', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:14,991][52811] DAMAGECOUNT value on done: 22598.0 [2024-08-05 23:12:14,991][52811] Sum rewards: 26.409, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.988', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.091', 'AMMO4': '0.164', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.650', 'weapon4': '0.666', 'weapon2': '1.082', 'weapon3': '1.642', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '6.843', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:15,175][52795] DAMAGECOUNT value on done: 19614.0 [2024-08-05 23:12:15,176][52795] Sum rewards: 25.447, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.987', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'weapon5': '0.050', 'AMMO3': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.478', 'WEAPON3': '0.600', 'ARMOR': '0.933', 'weapon2': '1.318', 'weapon3': '1.600', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:15,851][52803] DAMAGECOUNT value on done: 22859.0 [2024-08-05 23:12:15,852][52803] Sum rewards: 15.058, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.290', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.314', 'ARMOR': '0.481', 'WEAPON3': '0.850', 'HITCOUNT': '1.460', 'weapon2': '1.526', 'weapon3': '1.714', 'DAMAGECOUNT': '5.100', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:16,300][52662] DAMAGECOUNT value on done: 29459.0 [2024-08-05 23:12:16,302][52662] Sum rewards: 24.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.822', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO3': '0.120', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '1.464', 'HITCOUNT': '1.680', 'weapon3': '1.924', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '22.000'} [2024-08-05 23:12:16,798][52794] DAMAGECOUNT value on done: 29833.0 [2024-08-05 23:12:16,798][52794] Sum rewards: 18.813, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.094', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.520', 'HITCOUNT': '1.560', 'weapon3': '2.062', 'DAMAGECOUNT': '6.252', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:17,449][52660] DAMAGECOUNT value on done: 24832.0 [2024-08-05 23:12:17,449][52660] Sum rewards: 15.670, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.984', 'weapon7': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.102', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.314', 'WEAPON3': '0.800', 'ARMOR': '0.921', 'HITCOUNT': '1.160', 'weapon2': '1.252', 'weapon3': '1.702', 'DAMAGECOUNT': '4.461', 'FRAGCOUNT': '12.000'} [2024-08-05 23:12:17,733][52647] DAMAGECOUNT value on done: 25868.0 [2024-08-05 23:12:17,737][52647] Sum rewards: 21.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.138', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'weapon4': '0.002', 'weapon5': '0.002', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.568', 'HITCOUNT': '1.730', 'weapon3': '1.946', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:17,766][52650] Updated weights for policy 0, policy_version 13161 (0.0036) [2024-08-05 23:12:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16520.5, 300 sec: 15550.9). Total num frames: 107814912. Throughput: 0: 4150.7. Samples: 26953370. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:12:17,794][52567] Avg episode reward: [(0, '20.427')] [2024-08-05 23:12:17,896][52668] DAMAGECOUNT value on done: 23933.0 [2024-08-05 23:12:17,899][52668] Sum rewards: 24.174, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.204', 'ARMOR': '0.443', 'WEAPON3': '0.700', 'weapon2': '1.472', 'HITCOUNT': '1.610', 'weapon3': '1.650', 'DAMAGECOUNT': '6.015', 'FRAGCOUNT': '18.500'} [2024-08-05 23:12:18,213][52811] DAMAGECOUNT value on done: 23050.0 [2024-08-05 23:12:18,214][52811] Sum rewards: 20.503, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO3': '0.101', 'AMMO4': '0.117', 'WEAPON4': '0.300', 'weapon4': '0.388', 'WEAPON3': '0.750', 'weapon2': '1.282', 'ARMOR': '1.316', 'HITCOUNT': '1.780', 'weapon3': '1.942', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:18,416][52795] DAMAGECOUNT value on done: 21870.0 [2024-08-05 23:12:18,417][52795] Sum rewards: 18.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'ARMOR': '1.397', 'HITCOUNT': '1.520', 'weapon2': '1.544', 'weapon3': '2.166', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:19,022][52662] DAMAGECOUNT value on done: 31147.0 [2024-08-05 23:12:19,022][52662] Sum rewards: 19.944, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.893', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.056', 'AMMO4': '0.115', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.750', 'weapon2': '0.854', 'HITCOUNT': '1.260', 'weapon3': '1.870', 'DAMAGECOUNT': '5.613', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:19,114][52803] DAMAGECOUNT value on done: 23010.0 [2024-08-05 23:12:19,117][52803] Sum rewards: 18.337, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.836', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.079', 'AMMO3': '0.125', 'WEAPON4': '0.300', 'weapon4': '0.524', 'weapon2': '0.780', 'WEAPON3': '0.900', 'HITCOUNT': '1.450', 'weapon3': '1.908', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:19,581][52794] DAMAGECOUNT value on done: 25241.0 [2024-08-05 23:12:19,581][52794] Sum rewards: 26.315, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.511', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'weapon4': '0.544', 'WEAPON3': '0.700', 'weapon2': '1.228', 'weapon3': '1.794', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:20,593][52660] DAMAGECOUNT value on done: 24644.0 [2024-08-05 23:12:20,596][52660] Sum rewards: 25.278, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.739', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'weapon2': '1.662', 'HITCOUNT': '1.980', 'weapon3': '2.092', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:20,901][52668] DAMAGECOUNT value on done: 23332.0 [2024-08-05 23:12:20,902][52668] Sum rewards: 22.101, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.094', 'AMMO4': '0.144', 'weapon5': '0.150', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'ARMOR': '0.556', 'WEAPON3': '0.650', 'weapon4': '0.980', 'weapon3': '1.588', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:21,401][52811] DAMAGECOUNT value on done: 22959.0 [2024-08-05 23:12:21,406][52811] Sum rewards: 20.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.652', 'weapon4': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'WEAPON3': '1.100', 'weapon2': '1.184', 'HITCOUNT': '1.640', 'weapon3': '2.538', 'DAMAGECOUNT': '6.609', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:21,690][52795] DAMAGECOUNT value on done: 22797.0 [2024-08-05 23:12:21,694][52795] Sum rewards: 22.999, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.795', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.480', 'weapon3': '1.696', 'weapon2': '1.852', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:22,128][52662] DAMAGECOUNT value on done: 31505.0 [2024-08-05 23:12:22,129][52662] Sum rewards: 21.261, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.766', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.125', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.850', 'ARMOR': '0.998', 'weapon2': '1.094', 'HITCOUNT': '1.530', 'weapon3': '1.852', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:22,469][52803] DAMAGECOUNT value on done: 20616.0 [2024-08-05 23:12:22,473][52803] Sum rewards: 18.811, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.308', 'WEAPON3': '0.600', 'ARMOR': '0.840', 'weapon2': '1.254', 'HITCOUNT': '1.700', 'weapon3': '1.742', 'DAMAGECOUNT': '6.180', 'FRAGCOUNT': '12.500'} [2024-08-05 23:12:22,610][52650] Updated weights for policy 0, policy_version 13171 (0.0051) [2024-08-05 23:12:22,759][52794] DAMAGECOUNT value on done: 28528.0 [2024-08-05 23:12:22,759][52794] Sum rewards: 11.786, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.078', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.304', 'ARMOR': '0.404', 'WEAPON3': '0.950', 'weapon2': '1.028', 'HITCOUNT': '1.120', 'weapon3': '2.084', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '11.000'} [2024-08-05 23:12:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16657.1, 300 sec: 15578.7). Total num frames: 107896832. Throughput: 0: 4152.9. Samples: 26978260. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:12:22,795][52567] Avg episode reward: [(0, '20.743')] [2024-08-05 23:12:22,795][52614] Saving new best policy, reward=20.743! [2024-08-05 23:12:23,222][52660] DAMAGECOUNT value on done: 24051.0 [2024-08-05 23:12:23,222][52660] Sum rewards: 17.645, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.980', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.130', 'WEAPON3': '0.800', 'HITCOUNT': '1.240', 'weapon3': '1.306', 'ARMOR': '1.411', 'weapon2': '1.694', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:23,843][52668] DAMAGECOUNT value on done: 23962.0 [2024-08-05 23:12:23,844][52668] Sum rewards: 18.344, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.220', 'weapon4': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.013', 'weapon5': '0.040', 'AMMO4': '0.065', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.474', 'WEAPON3': '1.000', 'weapon2': '1.464', 'HITCOUNT': '1.580', 'weapon3': '2.172', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '15.500'} [2024-08-05 23:12:24,515][52811] DAMAGECOUNT value on done: 23767.0 [2024-08-05 23:12:24,515][52811] Sum rewards: 18.429, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.444', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON3': '0.900', 'ARMOR': '0.937', 'weapon2': '1.252', 'HITCOUNT': '1.500', 'weapon3': '1.988', 'DAMAGECOUNT': '5.439', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:24,957][52662] DAMAGECOUNT value on done: 28167.0 [2024-08-05 23:12:24,958][52662] Sum rewards: 27.855, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.898', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.091', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.348', 'WEAPON3': '0.800', 'ARMOR': '1.354', 'weapon2': '1.442', 'HITCOUNT': '1.480', 'weapon3': '1.752', 'DAMAGECOUNT': '6.702', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:24,981][52795] DAMAGECOUNT value on done: 25336.0 [2024-08-05 23:12:24,982][52795] Sum rewards: 11.721, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.110', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.232', 'ARMOR': '0.443', 'WEAPON3': '0.550', 'HITCOUNT': '1.010', 'weapon2': '1.300', 'weapon3': '1.604', 'DAMAGECOUNT': '3.687', 'FRAGCOUNT': '8.000'} [2024-08-05 23:12:25,378][52794] DAMAGECOUNT value on done: 28771.0 [2024-08-05 23:12:25,380][52794] Sum rewards: 21.305, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.485', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.014', 'AMMO3': '0.070', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.462', 'WEAPON3': '0.550', 'weapon2': '1.168', 'HITCOUNT': '1.190', 'weapon3': '1.652', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:25,684][52803] DAMAGECOUNT value on done: 22390.0 [2024-08-05 23:12:25,686][52803] Sum rewards: 24.606, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.810', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.048', 'AMMO3': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.646', 'WEAPON3': '0.650', 'ARMOR': '0.886', 'weapon2': '0.954', 'weapon3': '1.298', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:26,118][52660] DAMAGECOUNT value on done: 24422.0 [2024-08-05 23:12:26,122][52660] Sum rewards: 18.191, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.935', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon7': '0.068', 'AMMO3': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.304', 'ARMOR': '0.471', 'WEAPON3': '0.600', 'weapon2': '1.000', 'HITCOUNT': '1.230', 'weapon3': '1.570', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '12.500'} [2024-08-05 23:12:26,700][52668] DAMAGECOUNT value on done: 23359.0 [2024-08-05 23:12:26,700][52668] Sum rewards: 22.442, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.886', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.124', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.294', 'WEAPON3': '0.800', 'ARMOR': '0.886', 'weapon2': '0.974', 'HITCOUNT': '1.500', 'weapon3': '1.978', 'DAMAGECOUNT': '5.589', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:27,329][52650] Updated weights for policy 0, policy_version 13181 (0.0030) [2024-08-05 23:12:27,365][52662] DAMAGECOUNT value on done: 28668.0 [2024-08-05 23:12:27,366][52662] Sum rewards: 22.167, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'AMMO2': '0.016', 'ARMOR': '0.032', 'HEALTH': '0.044', 'weapon5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '1.300', 'weapon2': '1.518', 'weapon3': '1.624', 'DAMAGECOUNT': '4.644', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:27,740][52811] DAMAGECOUNT value on done: 22457.0 [2024-08-05 23:12:27,741][52811] Sum rewards: 23.363, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.236', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'weapon4': '0.306', 'ARMOR': '0.454', 'WEAPON3': '0.900', 'weapon2': '0.994', 'HITCOUNT': '1.660', 'weapon3': '2.026', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.1, 300 sec: 15634.2). Total num frames: 107986944. Throughput: 0: 4141.1. Samples: 27003050. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:12:27,794][52567] Avg episode reward: [(0, '20.763')] [2024-08-05 23:12:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013182_107986944.pth... [2024-08-05 23:12:27,919][52794] DAMAGECOUNT value on done: 28778.0 [2024-08-05 23:12:27,920][52794] Sum rewards: 26.662, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.574', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.316', 'ARMOR': '0.543', 'WEAPON3': '0.750', 'weapon2': '1.294', 'HITCOUNT': '1.610', 'weapon3': '1.846', 'DAMAGECOUNT': '6.177', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:27,930][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012717_104177664.pth [2024-08-05 23:12:27,938][52614] Saving new best policy, reward=20.763! [2024-08-05 23:12:28,252][52795] DAMAGECOUNT value on done: 24662.0 [2024-08-05 23:12:28,254][52795] Sum rewards: 17.110, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.806', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'weapon7': '0.068', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.160', 'WEAPON7': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.951', 'HITCOUNT': '0.990', 'weapon2': '1.072', 'weapon3': '1.502', 'DAMAGECOUNT': '4.098', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:28,994][52803] DAMAGECOUNT value on done: 23772.0 [2024-08-05 23:12:28,994][52803] Sum rewards: 26.994, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.033', 'HEALTH': '0.054', 'weapon4': '0.066', 'AMMO3': '0.123', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'ARMOR': '0.980', 'HITCOUNT': '1.510', 'weapon2': '1.610', 'weapon3': '1.858', 'DAMAGECOUNT': '5.922', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:29,308][52660] DAMAGECOUNT value on done: 25435.0 [2024-08-05 23:12:29,309][52660] Sum rewards: 23.376, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.131', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon7': '0.068', 'AMMO4': '0.069', 'weapon4': '0.072', 'AMMO3': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'ARMOR': '1.260', 'weapon2': '1.424', 'HITCOUNT': '1.780', 'weapon3': '1.886', 'DAMAGECOUNT': '5.940', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:29,678][52662] DAMAGECOUNT value on done: 27619.0 [2024-08-05 23:12:29,679][52662] Sum rewards: 13.558, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.074', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.128', 'weapon4': '0.210', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '1.060', 'weapon2': '1.250', 'weapon3': '1.596', 'DAMAGECOUNT': '4.230', 'FRAGCOUNT': '11.000'} [2024-08-05 23:12:29,793][52668] DAMAGECOUNT value on done: 23926.0 [2024-08-05 23:12:29,794][52668] Sum rewards: 15.969, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.291', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.136', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.200', 'ARMOR': '1.616', 'weapon3': '1.636', 'weapon2': '1.836', 'DAMAGECOUNT': '4.596', 'FRAGCOUNT': '12.000'} [2024-08-05 23:12:30,223][52794] DAMAGECOUNT value on done: 29168.0 [2024-08-05 23:12:30,223][52794] Sum rewards: 24.708, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.875', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.017', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.304', 'ARMOR': '0.536', 'WEAPON3': '0.800', 'weapon2': '1.500', 'HITCOUNT': '1.520', 'weapon3': '1.870', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:31,115][52811] DAMAGECOUNT value on done: 23411.0 [2024-08-05 23:12:31,117][52811] Sum rewards: 20.414, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.075', 'weapon5': '0.154', 'weapon4': '0.194', 'WEAPON3': '0.600', 'ARMOR': '0.848', 'weapon3': '1.540', 'weapon2': '1.576', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:31,587][52795] DAMAGECOUNT value on done: 26203.0 [2024-08-05 23:12:31,589][52795] Sum rewards: 18.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.646', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.160', 'WEAPON4': '0.400', 'weapon4': '0.496', 'weapon2': '0.870', 'ARMOR': '0.924', 'WEAPON3': '1.100', 'HITCOUNT': '1.600', 'weapon3': '2.288', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:31,796][52660] DAMAGECOUNT value on done: 25085.0 [2024-08-05 23:12:31,796][52660] Sum rewards: 27.732, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.301', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON3': '0.900', 'ARMOR': '0.919', 'HITCOUNT': '1.740', 'weapon2': '1.754', 'weapon3': '1.818', 'DAMAGECOUNT': '6.780', 'FRAGCOUNT': '23.000'} [2024-08-05 23:12:32,180][52662] DAMAGECOUNT value on done: 27044.0 [2024-08-05 23:12:32,180][52662] Sum rewards: 10.828, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO2': '0.003', 'weapon4': '0.006', 'AMMO4': '0.017', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'WEAPON3': '0.850', 'HITCOUNT': '1.300', 'weapon2': '1.396', 'weapon3': '1.686', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '11.000'} [2024-08-05 23:12:32,234][52668] DAMAGECOUNT value on done: 25010.0 [2024-08-05 23:12:32,236][52668] Sum rewards: 17.489, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.690', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.012', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.222', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '1.330', 'weapon2': '1.406', 'weapon3': '1.562', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '13.500'} [2024-08-05 23:12:32,375][52803] DAMAGECOUNT value on done: 24225.0 [2024-08-05 23:12:32,376][52803] Sum rewards: 15.180, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.808', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.750', 'ARMOR': '0.840', 'HITCOUNT': '1.230', 'weapon2': '1.664', 'weapon3': '1.914', 'DAMAGECOUNT': '4.383', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:32,604][52650] Updated weights for policy 0, policy_version 13191 (0.0011) [2024-08-05 23:12:32,782][52794] DAMAGECOUNT value on done: 27751.0 [2024-08-05 23:12:32,786][52794] Sum rewards: 27.752, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.454', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.086', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.368', 'ARMOR': '0.472', 'WEAPON3': '0.850', 'weapon2': '1.024', 'HITCOUNT': '1.530', 'weapon3': '2.014', 'DAMAGECOUNT': '6.117', 'FRAGCOUNT': '23.000'} [2024-08-05 23:12:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 15634.2). Total num frames: 108060672. Throughput: 0: 4126.9. Samples: 27015200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:12:32,794][52567] Avg episode reward: [(0, '20.712')] [2024-08-05 23:12:34,385][52811] DAMAGECOUNT value on done: 25063.0 [2024-08-05 23:12:34,389][52811] Sum rewards: 19.415, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.136', 'AMMO5': '0.007', 'AMMO2': '0.032', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.130', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'weapon4': '0.528', 'WEAPON3': '0.850', 'weapon2': '1.002', 'HITCOUNT': '1.470', 'weapon3': '1.934', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:34,805][52662] DAMAGECOUNT value on done: 30389.0 [2024-08-05 23:12:34,805][52662] Sum rewards: 32.948, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.825', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.021', 'ARMOR': '0.040', 'AMMO4': '0.106', 'AMMO3': '0.139', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.000', 'weapon2': '1.140', 'weapon3': '2.082', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.223', 'FRAGCOUNT': '27.000'} [2024-08-05 23:12:34,844][52795] DAMAGECOUNT value on done: 23224.0 [2024-08-05 23:12:34,846][52795] Sum rewards: 19.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon4': '0.182', 'WEAPON4': '0.250', 'ARMOR': '0.928', 'WEAPON3': '1.050', 'weapon2': '1.062', 'HITCOUNT': '1.640', 'weapon3': '2.158', 'DAMAGECOUNT': '6.270', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:34,902][52660] DAMAGECOUNT value on done: 26194.0 [2024-08-05 23:12:34,903][52660] Sum rewards: 18.207, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.638', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.210', 'ARMOR': '0.889', 'WEAPON3': '0.950', 'weapon2': '0.966', 'HITCOUNT': '1.390', 'weapon3': '1.756', 'DAMAGECOUNT': '4.899', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:35,477][52668] DAMAGECOUNT value on done: 25841.0 [2024-08-05 23:12:35,478][52668] Sum rewards: 23.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.183', 'weapon4': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.954', 'weapon2': '1.232', 'HITCOUNT': '1.450', 'weapon3': '1.944', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:35,502][52794] DAMAGECOUNT value on done: 32019.0 [2024-08-05 23:12:35,503][52794] Sum rewards: 22.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.512', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.050', 'AMMO3': '0.144', 'AMMO4': '0.252', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.454', 'HITCOUNT': '1.650', 'weapon3': '1.906', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:35,724][52803] DAMAGECOUNT value on done: 23030.0 [2024-08-05 23:12:35,728][52803] Sum rewards: 23.721, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.201', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.068', 'weapon5': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.358', 'WEAPON3': '0.450', 'ARMOR': '0.867', 'weapon3': '1.244', 'HITCOUNT': '1.370', 'weapon2': '1.766', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:37,480][52650] Updated weights for policy 0, policy_version 13201 (0.0017) [2024-08-05 23:12:37,508][52811] DAMAGECOUNT value on done: 21642.0 [2024-08-05 23:12:37,509][52811] Sum rewards: 20.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.326', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.163', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'ARMOR': '1.355', 'HITCOUNT': '1.530', 'weapon2': '1.606', 'weapon3': '1.714', 'DAMAGECOUNT': '5.145', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:37,655][52669] DAMAGECOUNT value on done: 25487.0 [2024-08-05 23:12:37,655][52669] Sum rewards: 25.846, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.826', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.062', 'weapon4': '0.088', 'AMMO3': '0.110', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.879', 'weapon2': '1.480', 'weapon3': '1.610', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '7.257', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:37,794][52567] Fps is (10 sec: 15564.8, 60 sec: 16520.5, 300 sec: 15689.8). Total num frames: 108142592. Throughput: 0: 4140.3. Samples: 27040480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:12:37,794][52662] DAMAGECOUNT value on done: 28166.0 [2024-08-05 23:12:37,798][52567] Avg episode reward: [(0, '20.955')] [2024-08-05 23:12:37,799][52662] Sum rewards: 24.802, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.627', 'AMMO5': '0.005', 'AMMO2': '0.025', 'ARMOR': '0.029', 'AMMO3': '0.100', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.572', 'weapon2': '0.640', 'WEAPON3': '0.700', 'weapon3': '1.690', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:37,801][52614] Saving new best policy, reward=20.955! [2024-08-05 23:12:37,957][52660] DAMAGECOUNT value on done: 24400.0 [2024-08-05 23:12:37,961][52660] Sum rewards: 25.106, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.358', 'WEAPON3': '0.850', 'weapon2': '0.910', 'HITCOUNT': '1.590', 'weapon3': '2.194', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:38,186][52795] DAMAGECOUNT value on done: 21479.0 [2024-08-05 23:12:38,187][52795] Sum rewards: 17.267, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.402', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon4': '0.230', 'WEAPON3': '0.600', 'ARMOR': '0.853', 'weapon2': '1.216', 'HITCOUNT': '1.230', 'weapon3': '1.652', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:38,535][52794] DAMAGECOUNT value on done: 27125.0 [2024-08-05 23:12:38,537][52794] Sum rewards: 21.217, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.593', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.206', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'weapon2': '1.024', 'HITCOUNT': '1.690', 'weapon3': '2.160', 'DAMAGECOUNT': '6.321', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:40,566][52662] DAMAGECOUNT value on done: 31041.0 [2024-08-05 23:12:40,569][52662] Sum rewards: 18.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.905', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon4': '0.112', 'AMMO4': '0.117', 'AMMO3': '0.138', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '1.410', 'weapon2': '1.570', 'ARMOR': '1.714', 'weapon3': '1.944', 'DAMAGECOUNT': '5.187', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:40,744][52669] DAMAGECOUNT value on done: 25007.0 [2024-08-05 23:12:40,747][52669] Sum rewards: 20.496, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.739', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.302', 'ARMOR': '0.420', 'WEAPON3': '0.700', 'weapon2': '1.556', 'HITCOUNT': '1.650', 'weapon3': '1.660', 'DAMAGECOUNT': '5.613', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:40,820][52811] DAMAGECOUNT value on done: 22023.0 [2024-08-05 23:12:40,820][52811] Sum rewards: 18.818, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.280', 'ARMOR': '1.289', 'weapon2': '1.822', 'weapon3': '1.906', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:41,137][52794] DAMAGECOUNT value on done: 28773.0 [2024-08-05 23:12:41,137][52794] Sum rewards: 21.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.155', 'AMMO5': '0.007', 'AMMO2': '0.046', 'ARMOR': '0.068', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.232', 'WEAPON4': '0.450', 'weapon4': '0.514', 'weapon2': '0.640', 'WEAPON3': '1.100', 'HITCOUNT': '1.750', 'weapon3': '2.068', 'DAMAGECOUNT': '6.552', 'FRAGCOUNT': '22.000'} [2024-08-05 23:12:41,388][52660] DAMAGECOUNT value on done: 25154.0 [2024-08-05 23:12:41,389][52660] Sum rewards: 16.172, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.010', 'weapon5': '0.010', 'AMMO4': '0.049', 'ARMOR': '0.060', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'HITCOUNT': '1.160', 'weapon3': '1.446', 'weapon2': '1.526', 'DAMAGECOUNT': '3.999', 'FRAGCOUNT': '13.000'} [2024-08-05 23:12:41,700][52795] DAMAGECOUNT value on done: 24235.0 [2024-08-05 23:12:41,701][52795] Sum rewards: 16.056, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.339', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon4': '0.026', 'weapon5': '0.050', 'AMMO3': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.865', 'HITCOUNT': '1.220', 'weapon3': '1.438', 'weapon2': '1.888', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '12.000'} [2024-08-05 23:12:42,191][52650] Updated weights for policy 0, policy_version 13211 (0.0015) [2024-08-05 23:12:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16520.5, 300 sec: 15717.5). Total num frames: 108224512. Throughput: 0: 4146.2. Samples: 27065760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:12:42,794][52567] Avg episode reward: [(0, '20.802')] [2024-08-05 23:12:42,978][52662] DAMAGECOUNT value on done: 31610.0 [2024-08-05 23:12:42,979][52662] Sum rewards: 24.323, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.865', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon4': '0.024', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON3': '0.850', 'ARMOR': '0.928', 'HITCOUNT': '1.520', 'weapon3': '1.668', 'weapon2': '1.944', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:43,645][52794] DAMAGECOUNT value on done: 30171.0 [2024-08-05 23:12:43,645][52794] Sum rewards: 22.702, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.906', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.128', 'AMMO3': '0.130', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.546', 'weapon2': '0.680', 'WEAPON3': '0.850', 'HITCOUNT': '1.690', 'weapon3': '1.772', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:43,646][52669] DAMAGECOUNT value on done: 25265.0 [2024-08-05 23:12:43,646][52669] Sum rewards: 25.100, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.824', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.042', 'weapon4': '0.046', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.889', 'HITCOUNT': '1.370', 'weapon2': '1.798', 'weapon3': '1.834', 'DAMAGECOUNT': '4.932', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:44,095][52660] DAMAGECOUNT value on done: 24305.0 [2024-08-05 23:12:44,095][52660] Sum rewards: 25.715, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.032', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.005', 'AMMO3': '0.098', 'WEAPON3': '0.800', 'weapon2': '1.720', 'weapon3': '1.722', 'ARMOR': '1.748', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '6.642', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:44,852][52665] DAMAGECOUNT value on done: 22780.0 [2024-08-05 23:12:44,855][52665] Sum rewards: 21.529, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.423', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.146', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'HITCOUNT': '1.340', 'weapon3': '1.478', 'weapon2': '1.834', 'DAMAGECOUNT': '5.088', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:45,141][52795] DAMAGECOUNT value on done: 23838.0 [2024-08-05 23:12:45,142][52795] Sum rewards: 35.906, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.536', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon4': '0.232', 'WEAPON3': '0.850', 'weapon2': '1.228', 'HITCOUNT': '2.010', 'weapon3': '2.310', 'DAMAGECOUNT': '7.626', 'FRAGCOUNT': '30.000'} [2024-08-05 23:12:45,714][52662] DAMAGECOUNT value on done: 28172.0 [2024-08-05 23:12:45,716][52662] Sum rewards: 19.531, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.536', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon7': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO3': '0.116', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.230', 'ARMOR': '0.520', 'WEAPON3': '0.750', 'weapon2': '0.924', 'HITCOUNT': '1.540', 'weapon3': '1.966', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:46,298][52794] DAMAGECOUNT value on done: 29884.0 [2024-08-05 23:12:46,300][52794] Sum rewards: 20.460, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.598', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'weapon5': '0.012', 'AMMO3': '0.103', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.472', 'WEAPON3': '0.800', 'weapon2': '1.336', 'HITCOUNT': '1.570', 'weapon3': '1.852', 'DAMAGECOUNT': '5.916', 'FRAGCOUNT': '17.000'} [2024-08-05 23:12:46,510][52669] DAMAGECOUNT value on done: 25127.0 [2024-08-05 23:12:46,511][52669] Sum rewards: 22.359, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.765', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.088', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon2': '1.188', 'weapon3': '1.444', 'HITCOUNT': '1.580', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:47,210][52650] Updated weights for policy 0, policy_version 13221 (0.0019) [2024-08-05 23:12:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 16657.1, 300 sec: 15773.1). Total num frames: 108314624. Throughput: 0: 4152.9. Samples: 27078230. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:12:47,795][52567] Avg episode reward: [(0, '21.149')] [2024-08-05 23:12:47,797][52614] Saving new best policy, reward=21.149! [2024-08-05 23:12:48,153][52665] DAMAGECOUNT value on done: 24532.0 [2024-08-05 23:12:48,154][52665] Sum rewards: 20.917, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.200', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.202', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'weapon2': '1.388', 'HITCOUNT': '1.600', 'weapon3': '1.708', 'DAMAGECOUNT': '5.757', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:48,470][52795] DAMAGECOUNT value on done: 23149.0 [2024-08-05 23:12:48,473][52795] Sum rewards: 19.371, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.250', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO3': '0.076', 'ARMOR': '0.455', 'WEAPON3': '0.650', 'HITCOUNT': '1.430', 'weapon3': '1.526', 'weapon2': '1.794', 'DAMAGECOUNT': '5.259', 'FRAGCOUNT': '14.000'} [2024-08-05 23:12:48,495][52662] DAMAGECOUNT value on done: 29580.0 [2024-08-05 23:12:48,496][52662] Sum rewards: 25.907, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.074', 'ARMOR': '0.004', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.051', 'AMMO3': '0.137', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.342', 'HITCOUNT': '1.870', 'weapon3': '2.230', 'DAMAGECOUNT': '7.002', 'FRAGCOUNT': '23.000'} [2024-08-05 23:12:49,308][52794] DAMAGECOUNT value on done: 28489.0 [2024-08-05 23:12:49,308][52794] Sum rewards: 14.033, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.028', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.109', 'AMMO4': '0.139', 'WEAPON4': '0.400', 'weapon4': '0.564', 'WEAPON3': '0.700', 'weapon2': '1.110', 'weapon3': '1.232', 'HITCOUNT': '1.300', 'DAMAGECOUNT': '5.076', 'FRAGCOUNT': '11.000'} [2024-08-05 23:12:49,421][52669] DAMAGECOUNT value on done: 26275.0 [2024-08-05 23:12:49,424][52669] Sum rewards: 18.529, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.244', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.095', 'ARMOR': '0.500', 'WEAPON3': '0.650', 'HITCOUNT': '1.640', 'weapon3': '1.850', 'weapon2': '2.028', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '12.000'} [2024-08-05 23:12:51,398][52662] DAMAGECOUNT value on done: 27492.0 [2024-08-05 23:12:51,401][52665] DAMAGECOUNT value on done: 25905.0 [2024-08-05 23:12:51,400][52662] Sum rewards: 27.417, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.129', 'WEAPON3': '0.650', 'HEALTH': '0.729', 'ARMOR': '1.200', 'HITCOUNT': '1.740', 'weapon2': '1.804', 'weapon3': '1.862', 'DAMAGECOUNT': '6.450', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:51,404][52665] Sum rewards: 28.011, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.026', 'HEALTH': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.145', 'weapon4': '0.392', 'WEAPON3': '0.800', 'ARMOR': '0.924', 'weapon2': '1.056', 'HITCOUNT': '1.900', 'weapon3': '1.904', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '22.000'} [2024-08-05 23:12:51,727][52795] DAMAGECOUNT value on done: 25750.0 [2024-08-05 23:12:51,731][52795] Sum rewards: 22.020, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.970', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.292', 'ARMOR': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.468', 'HITCOUNT': '1.520', 'weapon3': '1.642', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:51,868][52650] Updated weights for policy 0, policy_version 13231 (0.0013) [2024-08-05 23:12:52,021][52794] DAMAGECOUNT value on done: 29467.0 [2024-08-05 23:12:52,022][52794] Sum rewards: 17.317, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.094', 'AMMO2': '0.005', 'AMMO5': '0.008', 'AMMO4': '0.027', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.318', 'ARMOR': '0.404', 'WEAPON3': '0.800', 'HITCOUNT': '1.390', 'weapon2': '1.410', 'weapon3': '1.546', 'DAMAGECOUNT': '5.346', 'FRAGCOUNT': '13.500'} [2024-08-05 23:12:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16657.3, 300 sec: 15773.1). Total num frames: 108396544. Throughput: 0: 4158.2. Samples: 27103320. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:12:52,794][52567] Avg episode reward: [(0, '21.136')] [2024-08-05 23:12:52,819][52669] DAMAGECOUNT value on done: 27082.0 [2024-08-05 23:12:52,819][52669] Sum rewards: 21.362, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.408', 'weapon4': '0.008', 'AMMO2': '0.017', 'AMMO5': '0.018', 'weapon5': '0.062', 'AMMO4': '0.086', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.481', 'WEAPON3': '0.800', 'HITCOUNT': '1.400', 'weapon2': '1.430', 'weapon3': '1.856', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '18.000'} [2024-08-05 23:12:52,895][52664] DAMAGECOUNT value on done: 24716.0 [2024-08-05 23:12:52,896][52664] Sum rewards: 15.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.347', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.180', 'weapon4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.858', 'weapon2': '1.094', 'WEAPON3': '1.150', 'HITCOUNT': '1.430', 'weapon3': '1.866', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:53,914][52662] DAMAGECOUNT value on done: 29066.0 [2024-08-05 23:12:53,914][52662] Sum rewards: 14.068, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.766', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.116', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.130', 'ARMOR': '1.250', 'weapon3': '1.618', 'weapon2': '1.846', 'DAMAGECOUNT': '3.885', 'FRAGCOUNT': '10.500'} [2024-08-05 23:12:54,631][52665] DAMAGECOUNT value on done: 25989.0 [2024-08-05 23:12:54,631][52665] Sum rewards: 25.390, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.344', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.106', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.202', 'ARMOR': '1.390', 'HITCOUNT': '1.740', 'weapon3': '2.232', 'DAMAGECOUNT': '6.999', 'FRAGCOUNT': '21.000'} [2024-08-05 23:12:55,101][52795] DAMAGECOUNT value on done: 23410.0 [2024-08-05 23:12:55,101][52795] Sum rewards: 17.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.085', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.560', 'weapon2': '1.744', 'weapon3': '1.746', 'DAMAGECOUNT': '5.433', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:55,940][52664] DAMAGECOUNT value on done: 23800.0 [2024-08-05 23:12:55,941][52664] Sum rewards: 27.049, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.356', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.022', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.510', 'weapon2': '1.674', 'weapon3': '2.008', 'DAMAGECOUNT': '6.387', 'FRAGCOUNT': '23.000'} [2024-08-05 23:12:56,139][52669] DAMAGECOUNT value on done: 26531.0 [2024-08-05 23:12:56,142][52669] Sum rewards: 17.260, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.965', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO3': '0.126', 'WEAPON4': '0.250', 'ARMOR': '0.894', 'WEAPON3': '0.950', 'HITCOUNT': '1.490', 'weapon2': '1.516', 'weapon3': '1.944', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '15.000'} [2024-08-05 23:12:56,277][52666] DAMAGECOUNT value on done: 23403.0 [2024-08-05 23:12:56,278][52666] Sum rewards: 16.499, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.162', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.079', 'WEAPON3': '0.600', 'ARMOR': '0.879', 'HITCOUNT': '1.100', 'weapon3': '1.476', 'weapon2': '1.730', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '12.000'} [2024-08-05 23:12:56,795][52650] Updated weights for policy 0, policy_version 13241 (0.0031) [2024-08-05 23:12:57,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16657.1, 300 sec: 15828.6). Total num frames: 108478464. Throughput: 0: 4163.6. Samples: 27128550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:12:57,794][52567] Avg episode reward: [(0, '20.920')] [2024-08-05 23:12:57,912][52665] DAMAGECOUNT value on done: 23320.0 [2024-08-05 23:12:57,916][52665] Sum rewards: 14.996, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.366', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.052', 'weapon7': '0.066', 'AMMO4': '0.076', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.900', 'HITCOUNT': '1.150', 'weapon3': '1.502', 'weapon2': '1.556', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '12.000'} [2024-08-05 23:12:58,299][52795] DAMAGECOUNT value on done: 23177.0 [2024-08-05 23:12:58,301][52795] Sum rewards: 25.292, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'ARMOR': '0.945', 'weapon3': '1.710', 'HITCOUNT': '1.720', 'weapon2': '1.800', 'DAMAGECOUNT': '6.858', 'FRAGCOUNT': '20.000'} [2024-08-05 23:12:58,727][52664] DAMAGECOUNT value on done: 27047.0 [2024-08-05 23:12:58,728][52664] Sum rewards: 19.266, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon5': '0.106', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.485', 'WEAPON3': '0.950', 'weapon2': '1.120', 'HITCOUNT': '1.600', 'weapon3': '1.924', 'DAMAGECOUNT': '5.745', 'FRAGCOUNT': '16.000'} [2024-08-05 23:12:59,517][52669] DAMAGECOUNT value on done: 24098.0 [2024-08-05 23:12:59,519][52669] Sum rewards: 26.453, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.555', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.062', 'AMMO3': '0.089', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.893', 'HITCOUNT': '1.600', 'weapon3': '1.668', 'weapon2': '1.912', 'DAMAGECOUNT': '6.084', 'FRAGCOUNT': '19.000'} [2024-08-05 23:12:59,782][52666] DAMAGECOUNT value on done: 23522.0 [2024-08-05 23:12:59,782][52666] Sum rewards: 17.462, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.585', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.072', 'AMMO3': '0.085', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'HITCOUNT': '1.330', 'weapon3': '1.448', 'weapon2': '1.498', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:01,132][52665] DAMAGECOUNT value on done: 24024.0 [2024-08-05 23:13:01,134][52665] Sum rewards: 11.095, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.248', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.080', 'WEAPON3': '0.450', 'HITCOUNT': '1.220', 'ARMOR': '1.251', 'weapon3': '1.276', 'weapon2': '2.010', 'DAMAGECOUNT': '3.636', 'FRAGCOUNT': '8.000'} [2024-08-05 23:13:01,138][52670] DAMAGECOUNT value on done: 24219.0 [2024-08-05 23:13:01,141][52670] Sum rewards: 21.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.686', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.119', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.264', 'ARMOR': '0.424', 'WEAPON3': '0.750', 'weapon2': '1.528', 'weapon3': '1.634', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:01,581][52795] DAMAGECOUNT value on done: 24546.0 [2024-08-05 23:13:01,582][52795] Sum rewards: 28.287, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.663', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.087', 'WEAPON3': '0.600', 'ARMOR': '0.822', 'weapon3': '1.446', 'weapon2': '1.516', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '22.000'} [2024-08-05 23:13:01,656][52664] DAMAGECOUNT value on done: 25447.0 [2024-08-05 23:13:01,659][52664] Sum rewards: 24.316, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.898', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.048', 'AMMO3': '0.115', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.678', 'WEAPON3': '0.750', 'ARMOR': '0.977', 'weapon2': '1.088', 'HITCOUNT': '1.360', 'weapon3': '1.724', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:01,799][52650] Updated weights for policy 0, policy_version 13251 (0.0040) [2024-08-05 23:13:02,489][52667] DAMAGECOUNT value on done: 24862.0 [2024-08-05 23:13:02,490][52667] Sum rewards: 20.624, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.018', 'weapon7': '0.070', 'AMMO4': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.103', 'HEALTH': '0.160', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon3': '1.538', 'HITCOUNT': '1.560', 'weapon2': '1.732', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:02,507][52669] DAMAGECOUNT value on done: 24925.0 [2024-08-05 23:13:02,507][52669] Sum rewards: 12.469, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.500', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.048', 'weapon5': '0.060', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'ARMOR': '0.820', 'weapon2': '1.328', 'WEAPON3': '1.500', 'HITCOUNT': '1.610', 'weapon3': '2.190', 'DAMAGECOUNT': '6.480', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 15856.4). Total num frames: 108560384. Throughput: 0: 4169.8. Samples: 27141010. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:13:02,794][52567] Avg episode reward: [(0, '20.969')] [2024-08-05 23:13:03,276][52666] DAMAGECOUNT value on done: 23979.0 [2024-08-05 23:13:03,276][52666] Sum rewards: 15.040, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.914', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO3': '0.116', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.258', 'WEAPON3': '0.750', 'ARMOR': '0.804', 'HITCOUNT': '1.170', 'weapon2': '1.394', 'weapon3': '1.670', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:03,863][52665] DAMAGECOUNT value on done: 25771.0 [2024-08-05 23:13:03,865][52665] Sum rewards: 29.998, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.526', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.139', 'weapon5': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.712', 'weapon4': '0.752', 'WEAPON3': '0.900', 'ARMOR': '0.909', 'weapon3': '1.664', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '6.681', 'FRAGCOUNT': '25.000'} [2024-08-05 23:13:04,452][52670] DAMAGECOUNT value on done: 25622.0 [2024-08-05 23:13:04,452][52670] Sum rewards: 28.772, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.720', 'AMMO2': '0.024', 'AMMO3': '0.110', 'AMMO4': '0.118', 'WEAPON4': '0.450', 'ARMOR': '0.564', 'weapon4': '0.638', 'WEAPON3': '0.750', 'weapon2': '0.966', 'weapon3': '1.622', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.590', 'FRAGCOUNT': '24.000'} [2024-08-05 23:13:04,531][52664] DAMAGECOUNT value on done: 23966.0 [2024-08-05 23:13:04,532][52664] Sum rewards: 13.841, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.284', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.122', 'weapon5': '0.134', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '0.700', 'HITCOUNT': '0.990', 'ARMOR': '1.240', 'weapon3': '1.404', 'weapon2': '1.624', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:04,990][52795] DAMAGECOUNT value on done: 25041.0 [2024-08-05 23:13:04,991][52795] Sum rewards: 17.757, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.022', 'AMMO3': '0.075', 'AMMO4': '0.105', 'weapon4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.500', 'ARMOR': '0.500', 'weapon3': '1.346', 'HITCOUNT': '1.550', 'weapon2': '1.840', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '12.500'} [2024-08-05 23:13:05,081][52669] DAMAGECOUNT value on done: 24634.0 [2024-08-05 23:13:05,082][52669] Sum rewards: 24.502, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.498', 'AMMO5': '0.025', 'weapon5': '0.026', 'AMMO2': '0.043', 'weapon4': '0.110', 'AMMO3': '0.150', 'AMMO4': '0.217', 'WEAPON4': '0.450', 'ARMOR': '0.466', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.300', 'HITCOUNT': '1.740', 'weapon3': '2.114', 'DAMAGECOUNT': '6.609', 'FRAGCOUNT': '21.000'} [2024-08-05 23:13:05,308][52667] DAMAGECOUNT value on done: 26414.0 [2024-08-05 23:13:05,308][52667] Sum rewards: 15.645, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.942', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.027', 'AMMO3': '0.098', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.384', 'WEAPON3': '0.650', 'HITCOUNT': '0.980', 'weapon2': '1.282', 'weapon3': '1.782', 'ARMOR': '2.285', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:06,376][52650] Updated weights for policy 0, policy_version 13261 (0.0011) [2024-08-05 23:13:06,505][52666] DAMAGECOUNT value on done: 23890.0 [2024-08-05 23:13:06,505][52666] Sum rewards: 27.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.529', 'AMMO5': '0.015', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.158', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'ARMOR': '0.859', 'weapon2': '0.896', 'WEAPON3': '1.250', 'HITCOUNT': '1.890', 'weapon3': '2.452', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '26.000'} [2024-08-05 23:13:07,117][52665] DAMAGECOUNT value on done: 25990.0 [2024-08-05 23:13:07,119][52665] Sum rewards: 32.175, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO5': '0.021', 'AMMO2': '0.024', 'ARMOR': '0.076', 'weapon5': '0.088', 'AMMO4': '0.118', 'AMMO3': '0.130', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON3': '0.800', 'weapon2': '1.090', 'HITCOUNT': '1.990', 'weapon3': '2.010', 'DAMAGECOUNT': '7.656', 'FRAGCOUNT': '27.000'} [2024-08-05 23:13:07,254][52664] DAMAGECOUNT value on done: 27729.0 [2024-08-05 23:13:07,255][52664] Sum rewards: 19.913, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.184', 'weapon4': '0.214', 'WEAPON3': '0.450', 'HEALTH': '0.495', 'weapon3': '1.436', 'HITCOUNT': '1.460', 'weapon2': '1.618', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:07,794][52567] Fps is (10 sec: 16383.8, 60 sec: 16520.5, 300 sec: 15884.1). Total num frames: 108642304. Throughput: 0: 4179.8. Samples: 27166350. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:13:07,795][52567] Avg episode reward: [(0, '21.182')] [2024-08-05 23:13:07,832][52614] Saving new best policy, reward=21.182! [2024-08-05 23:13:07,844][52669] DAMAGECOUNT value on done: 25526.0 [2024-08-05 23:13:07,845][52669] Sum rewards: 22.826, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.074', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'ARMOR': '0.489', 'WEAPON3': '0.550', 'HITCOUNT': '1.370', 'weapon3': '1.432', 'weapon2': '1.670', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:08,010][52670] DAMAGECOUNT value on done: 23348.0 [2024-08-05 23:13:08,012][52670] Sum rewards: 15.781, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.351', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON4': '0.400', 'ARMOR': '0.864', 'WEAPON3': '1.000', 'weapon2': '1.202', 'HITCOUNT': '1.350', 'weapon3': '1.770', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:08,221][52795] DAMAGECOUNT value on done: 22348.0 [2024-08-05 23:13:08,222][52795] Sum rewards: 10.319, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.604', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'weapon4': '0.222', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'HITCOUNT': '1.010', 'weapon2': '1.366', 'weapon3': '1.784', 'DAMAGECOUNT': '3.276', 'FRAGCOUNT': '9.000'} [2024-08-05 23:13:08,457][52667] DAMAGECOUNT value on done: 24023.0 [2024-08-05 23:13:08,458][52667] Sum rewards: 23.323, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.105', 'AMMO4': '-0.050', 'AMMO2': '-0.010', 'AMMO5': '0.005', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.244', 'WEAPON3': '0.800', 'ARMOR': '0.849', 'weapon2': '1.444', 'HITCOUNT': '1.710', 'weapon3': '1.792', 'DAMAGECOUNT': '6.462', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:10,033][52666] DAMAGECOUNT value on done: 22706.0 [2024-08-05 23:13:10,033][52666] Sum rewards: 12.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.106', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.250', 'HITCOUNT': '0.830', 'WEAPON3': '0.850', 'ARMOR': '1.284', 'weapon3': '1.580', 'weapon2': '1.662', 'DAMAGECOUNT': '2.685', 'FRAGCOUNT': '12.000'} [2024-08-05 23:13:10,181][52664] DAMAGECOUNT value on done: 26101.0 [2024-08-05 23:13:10,181][52664] Sum rewards: 22.708, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.026', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.117', 'weapon5': '0.184', 'weapon4': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.066', 'HITCOUNT': '1.640', 'ARMOR': '1.778', 'weapon3': '1.864', 'DAMAGECOUNT': '6.582', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:10,488][52665] DAMAGECOUNT value on done: 26648.0 [2024-08-05 23:13:10,488][52665] Sum rewards: 17.606, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.010', 'AMMO3': '0.102', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.854', 'HITCOUNT': '1.240', 'weapon3': '1.346', 'weapon2': '1.892', 'DAMAGECOUNT': '5.433', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:10,678][52669] DAMAGECOUNT value on done: 27800.0 [2024-08-05 23:13:10,678][52669] Sum rewards: 14.854, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.774', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.024', 'ARMOR': '0.052', 'weapon5': '0.094', 'AMMO4': '0.102', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '1.220', 'weapon2': '1.314', 'weapon3': '1.866', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:11,100][52670] DAMAGECOUNT value on done: 25286.0 [2024-08-05 23:13:11,101][52670] Sum rewards: 18.464, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.097', 'HEALTH': '0.152', 'WEAPON3': '0.550', 'ARMOR': '1.271', 'HITCOUNT': '1.400', 'weapon3': '1.694', 'weapon2': '1.822', 'DAMAGECOUNT': '5.130', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:11,516][52795] DAMAGECOUNT value on done: 23110.0 [2024-08-05 23:13:11,517][52795] Sum rewards: 21.211, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.158', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.096', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.234', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.334', 'HITCOUNT': '1.580', 'weapon3': '1.702', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:11,597][52667] DAMAGECOUNT value on done: 24522.0 [2024-08-05 23:13:11,597][52667] Sum rewards: 18.802, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.611', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.556', 'WEAPON3': '1.000', 'ARMOR': '1.248', 'weapon2': '1.320', 'HITCOUNT': '1.410', 'weapon3': '1.536', 'DAMAGECOUNT': '5.217', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:11,929][52650] Updated weights for policy 0, policy_version 13271 (0.0022) [2024-08-05 23:13:12,642][52614] Signal inference workers to stop experience collection... (2450 times) [2024-08-05 23:13:12,659][52614] Signal inference workers to resume experience collection... (2450 times) [2024-08-05 23:13:12,731][52650] InferenceWorker_p0-w0: stopping experience collection (2450 times) [2024-08-05 23:13:12,739][52650] InferenceWorker_p0-w0: resuming experience collection (2450 times) [2024-08-05 23:13:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 16793.6, 300 sec: 15995.3). Total num frames: 108740608. Throughput: 0: 4180.0. Samples: 27191150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:13:12,794][52567] Avg episode reward: [(0, '20.940')] [2024-08-05 23:13:13,071][52666] DAMAGECOUNT value on done: 22898.0 [2024-08-05 23:13:13,082][52666] Sum rewards: 13.039, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.144', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.006', 'AMMO3': '0.068', 'weapon5': '0.086', 'WEAPON5': '0.150', 'WEAPON3': '0.450', 'HITCOUNT': '1.050', 'weapon3': '1.104', 'ARMOR': '1.310', 'weapon2': '1.628', 'DAMAGECOUNT': '3.588', 'FRAGCOUNT': '7.500'} [2024-08-05 23:13:13,342][52664] DAMAGECOUNT value on done: 23647.0 [2024-08-05 23:13:13,342][52664] Sum rewards: 14.542, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.213', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.086', 'AMMO3': '0.147', 'AMMO4': '0.189', 'WEAPON5': '0.350', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'weapon2': '0.470', 'weapon4': '0.504', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '2.196', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:13,694][52665] DAMAGECOUNT value on done: 25906.0 [2024-08-05 23:13:13,696][52665] Sum rewards: 19.419, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.630', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.020', 'AMMO4': '0.085', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.900', 'HITCOUNT': '1.310', 'weapon2': '1.724', 'weapon3': '2.064', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:13,847][52669] DAMAGECOUNT value on done: 24449.0 [2024-08-05 23:13:13,847][52669] Sum rewards: 17.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.034', 'AMMO4': '0.084', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.344', 'WEAPON3': '0.600', 'HITCOUNT': '1.230', 'ARMOR': '1.362', 'weapon3': '1.474', 'weapon2': '1.650', 'DAMAGECOUNT': '4.191', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:14,457][52670] DAMAGECOUNT value on done: 22229.0 [2024-08-05 23:13:14,459][52670] Sum rewards: 14.870, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.282', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO3': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.087', 'weapon7': '0.134', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.300', 'weapon4': '0.336', 'weapon2': '0.764', 'HITCOUNT': '0.910', 'weapon3': '1.004', 'DAMAGECOUNT': '3.447', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:14,759][52795] DAMAGECOUNT value on done: 24196.0 [2024-08-05 23:13:14,760][52795] Sum rewards: 25.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.260', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.040', 'AMMO3': '0.094', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon2': '1.686', 'weapon3': '1.784', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '7.491', 'FRAGCOUNT': '18.500'} [2024-08-05 23:13:14,789][52667] DAMAGECOUNT value on done: 25950.0 [2024-08-05 23:13:14,789][52667] Sum rewards: 20.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon4': '0.236', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.048', 'HITCOUNT': '1.690', 'weapon3': '2.072', 'DAMAGECOUNT': '6.024', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:16,081][52666] DAMAGECOUNT value on done: 23897.0 [2024-08-05 23:13:16,081][52666] Sum rewards: 16.251, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.328', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.107', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.650', 'ARMOR': '0.914', 'HITCOUNT': '1.360', 'weapon3': '1.402', 'weapon2': '1.532', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '12.000'} [2024-08-05 23:13:16,109][52664] DAMAGECOUNT value on done: 28367.0 [2024-08-05 23:13:16,110][52664] Sum rewards: 27.110, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.354', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.020', 'AMMO4': '0.061', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.394', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'weapon2': '1.344', 'HITCOUNT': '1.830', 'weapon3': '1.902', 'DAMAGECOUNT': '6.237', 'FRAGCOUNT': '21.000'} [2024-08-05 23:13:16,215][52650] Updated weights for policy 0, policy_version 13281 (0.0014) [2024-08-05 23:13:16,676][52663] DAMAGECOUNT value on done: 25776.0 [2024-08-05 23:13:16,677][52663] Sum rewards: 26.609, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.405', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'weapon4': '0.002', 'AMMO5': '0.004', 'weapon5': '0.058', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'ARMOR': '0.902', 'weapon3': '1.586', 'weapon2': '1.798', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '20.000'} [2024-08-05 23:13:16,804][52665] DAMAGECOUNT value on done: 25564.0 [2024-08-05 23:13:16,805][52665] Sum rewards: 23.345, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.136', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON3': '0.850', 'ARMOR': '0.892', 'weapon2': '1.096', 'HITCOUNT': '1.610', 'weapon3': '1.908', 'DAMAGECOUNT': '6.441', 'FRAGCOUNT': '19.500'} [2024-08-05 23:13:16,912][52669] DAMAGECOUNT value on done: 26524.0 [2024-08-05 23:13:16,912][52669] Sum rewards: 21.859, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.268', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.094', 'WEAPON4': '0.200', 'weapon4': '0.326', 'WEAPON3': '0.750', 'ARMOR': '0.927', 'weapon2': '1.136', 'HITCOUNT': '1.790', 'weapon3': '1.916', 'DAMAGECOUNT': '6.003', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:17,164][52670] DAMAGECOUNT value on done: 26470.0 [2024-08-05 23:13:17,164][52670] Sum rewards: 21.788, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.046', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.108', 'weapon5': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.360', 'WEAPON3': '0.800', 'weapon2': '1.226', 'weapon3': '1.846', 'HITCOUNT': '1.920', 'DAMAGECOUNT': '6.960', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16520.5, 300 sec: 15967.5). Total num frames: 108806144. Throughput: 0: 4186.0. Samples: 27203570. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:13:17,794][52567] Avg episode reward: [(0, '20.716')] [2024-08-05 23:13:17,906][52667] DAMAGECOUNT value on done: 27744.0 [2024-08-05 23:13:17,908][52667] Sum rewards: 28.583, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.276', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.067', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.504', 'WEAPON3': '0.550', 'weapon2': '1.372', 'weapon3': '1.392', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '7.074', 'FRAGCOUNT': '21.000'} [2024-08-05 23:13:19,005][52666] DAMAGECOUNT value on done: 24288.0 [2024-08-05 23:13:19,007][52666] Sum rewards: 20.029, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.062', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.246', 'HEALTH': '0.262', 'ARMOR': '0.484', 'WEAPON3': '0.500', 'weapon2': '1.444', 'HITCOUNT': '1.520', 'weapon3': '1.762', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:19,389][52663] DAMAGECOUNT value on done: 24368.0 [2024-08-05 23:13:19,389][52663] Sum rewards: 10.340, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.310', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon3': '1.534', 'weapon2': '1.752', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '7.000'} [2024-08-05 23:13:19,431][52664] DAMAGECOUNT value on done: 25529.0 [2024-08-05 23:13:19,431][52664] Sum rewards: 20.584, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.706', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'weapon4': '0.292', 'ARMOR': '0.470', 'WEAPON3': '0.700', 'weapon2': '0.958', 'HITCOUNT': '1.440', 'weapon3': '1.852', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:19,591][52669] DAMAGECOUNT value on done: 26306.0 [2024-08-05 23:13:19,592][52669] Sum rewards: 19.526, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.546', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.136', 'WEAPON3': '0.850', 'HITCOUNT': '1.530', 'weapon3': '1.826', 'weapon2': '1.866', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '16.500'} [2024-08-05 23:13:19,649][52665] DAMAGECOUNT value on done: 24324.0 [2024-08-05 23:13:19,650][52665] Sum rewards: 25.528, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.112', 'weapon4': '0.232', 'WEAPON3': '0.400', 'HEALTH': '0.743', 'ARMOR': '1.220', 'HITCOUNT': '1.520', 'weapon3': '1.688', 'weapon2': '1.700', 'DAMAGECOUNT': '5.271', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:20,138][52670] DAMAGECOUNT value on done: 22495.0 [2024-08-05 23:13:20,138][52670] Sum rewards: 16.428, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'HEALTH': '0.014', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.326', 'WEAPON3': '0.600', 'ARMOR': '0.935', 'HITCOUNT': '1.120', 'weapon2': '1.526', 'weapon3': '1.702', 'DAMAGECOUNT': '4.074', 'FRAGCOUNT': '12.500'} [2024-08-05 23:13:21,160][52667] DAMAGECOUNT value on done: 26684.0 [2024-08-05 23:13:21,160][52667] Sum rewards: 20.738, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO3': '0.113', 'AMMO4': '0.121', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.244', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'HITCOUNT': '1.160', 'weapon2': '1.224', 'weapon3': '1.832', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:21,351][52650] Updated weights for policy 0, policy_version 13291 (0.0027) [2024-08-05 23:13:21,903][52666] DAMAGECOUNT value on done: 24195.0 [2024-08-05 23:13:21,906][52666] Sum rewards: 17.812, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.719', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.018', 'AMMO3': '0.071', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.448', 'weapon4': '0.488', 'WEAPON3': '0.550', 'HITCOUNT': '1.260', 'weapon2': '1.476', 'weapon3': '1.550', 'DAMAGECOUNT': '4.518', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:22,349][52663] DAMAGECOUNT value on done: 24799.0 [2024-08-05 23:13:22,349][52663] Sum rewards: 10.514, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.318', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.488', 'WEAPON3': '0.600', 'ARMOR': '0.875', 'weapon2': '1.082', 'HITCOUNT': '1.270', 'weapon3': '1.338', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '6.000'} [2024-08-05 23:13:22,721][52669] DAMAGECOUNT value on done: 26435.0 [2024-08-05 23:13:22,721][52669] Sum rewards: 25.491, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.215', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO3': '0.139', 'ARMOR': '0.458', 'WEAPON3': '0.950', 'weapon2': '1.558', 'HITCOUNT': '1.900', 'weapon3': '2.182', 'DAMAGECOUNT': '6.570', 'FRAGCOUNT': '21.000'} [2024-08-05 23:13:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16050.8). Total num frames: 108904448. Throughput: 0: 4179.6. Samples: 27228560. Policy #0 lag: (min: 0.0, avg: 4.5, max: 10.0) [2024-08-05 23:13:22,794][52567] Avg episode reward: [(0, '20.755')] [2024-08-05 23:13:22,955][52664] DAMAGECOUNT value on done: 28656.0 [2024-08-05 23:13:22,956][52664] Sum rewards: 15.881, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.824', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'weapon4': '0.604', 'WEAPON3': '0.700', 'weapon2': '1.054', 'HITCOUNT': '1.200', 'weapon3': '1.626', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '12.000'} [2024-08-05 23:13:23,000][52665] DAMAGECOUNT value on done: 24231.0 [2024-08-05 23:13:23,001][52665] Sum rewards: 34.409, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.612', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.064', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.867', 'weapon3': '1.806', 'weapon2': '1.848', 'HITCOUNT': '1.970', 'DAMAGECOUNT': '7.554', 'FRAGCOUNT': '26.000'} [2024-08-05 23:13:23,059][52670] DAMAGECOUNT value on done: 23531.0 [2024-08-05 23:13:23,059][52670] Sum rewards: 26.451, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.629', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.104', 'AMMO3': '0.115', 'AMMO4': '0.158', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.508', 'ARMOR': '0.515', 'WEAPON3': '0.800', 'weapon2': '1.142', 'weapon3': '1.746', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '6.867', 'FRAGCOUNT': '21.000'} [2024-08-05 23:13:23,915][52667] DAMAGECOUNT value on done: 24296.0 [2024-08-05 23:13:23,916][52667] Sum rewards: 23.851, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.185', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO3': '0.063', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.386', 'WEAPON3': '0.400', 'weapon3': '1.194', 'HITCOUNT': '1.380', 'weapon2': '1.526', 'DAMAGECOUNT': '4.797', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:24,453][52666] DAMAGECOUNT value on done: 22750.0 [2024-08-05 23:13:24,461][52666] Sum rewards: 15.968, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.777', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.086', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.232', 'ARMOR': '0.408', 'WEAPON3': '0.600', 'weapon2': '1.268', 'HITCOUNT': '1.370', 'weapon3': '1.442', 'DAMAGECOUNT': '4.719', 'FRAGCOUNT': '12.000'} [2024-08-05 23:13:25,554][52663] DAMAGECOUNT value on done: 25701.0 [2024-08-05 23:13:25,558][52663] Sum rewards: 13.359, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.212', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.312', 'ARMOR': '0.501', 'WEAPON3': '1.000', 'HITCOUNT': '1.220', 'weapon2': '1.412', 'weapon3': '1.836', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '12.000'} [2024-08-05 23:13:25,747][52670] DAMAGECOUNT value on done: 21692.0 [2024-08-05 23:13:25,749][52670] Sum rewards: 15.433, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.610', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.073', 'WEAPON3': '0.600', 'HITCOUNT': '1.340', 'weapon3': '1.578', 'weapon2': '1.796', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:25,884][52669] DAMAGECOUNT value on done: 25499.0 [2024-08-05 23:13:25,886][52669] Sum rewards: 13.973, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'AMMO4': '0.134', 'WEAPON4': '0.350', 'weapon4': '0.394', 'ARMOR': '0.468', 'WEAPON3': '0.700', 'weapon2': '1.236', 'HITCOUNT': '1.280', 'weapon3': '1.712', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '11.500'} [2024-08-05 23:13:26,068][52664] DAMAGECOUNT value on done: 26304.0 [2024-08-05 23:13:26,069][52664] Sum rewards: 19.579, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON3': '1.150', 'ARMOR': '1.297', 'weapon2': '1.356', 'HITCOUNT': '1.580', 'weapon3': '2.286', 'DAMAGECOUNT': '5.949', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:26,391][52665] DAMAGECOUNT value on done: 24816.0 [2024-08-05 23:13:26,396][52665] Sum rewards: 16.740, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.230', 'ARMOR': '0.424', 'HEALTH': '0.520', 'WEAPON3': '0.600', 'HITCOUNT': '1.390', 'weapon2': '1.468', 'weapon3': '1.700', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:26,435][52650] Updated weights for policy 0, policy_version 13301 (0.0018) [2024-08-05 23:13:26,530][52667] DAMAGECOUNT value on done: 26483.0 [2024-08-05 23:13:26,530][52667] Sum rewards: 17.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.598', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO3': '0.079', 'AMMO4': '0.082', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'ARMOR': '1.287', 'HITCOUNT': '1.480', 'weapon3': '1.524', 'weapon2': '1.846', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16520.5, 300 sec: 16050.8). Total num frames: 108978176. Throughput: 0: 4182.7. Samples: 27253980. Policy #0 lag: (min: 0.0, avg: 4.5, max: 10.0) [2024-08-05 23:13:27,794][52567] Avg episode reward: [(0, '20.348')] [2024-08-05 23:13:27,839][52666] DAMAGECOUNT value on done: 20379.0 [2024-08-05 23:13:27,843][52666] Sum rewards: 15.754, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.017', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.082', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HEALTH': '0.183', 'WEAPON3': '0.550', 'HITCOUNT': '1.320', 'weapon3': '1.660', 'weapon2': '1.940', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:28,199][52663] DAMAGECOUNT value on done: 24347.0 [2024-08-05 23:13:28,199][52663] Sum rewards: 23.517, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.292', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.044', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.338', 'WEAPON3': '0.600', 'ARMOR': '0.950', 'weapon3': '1.584', 'weapon2': '1.642', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '6.675', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:28,383][52669] DAMAGECOUNT value on done: 25673.0 [2024-08-05 23:13:28,383][52669] Sum rewards: 23.770, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.572', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.024', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.184', 'WEAPON3': '0.750', 'ARMOR': '0.862', 'weapon2': '1.388', 'HITCOUNT': '1.610', 'weapon3': '2.026', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:28,715][52664] DAMAGECOUNT value on done: 25231.0 [2024-08-05 23:13:28,716][52664] Sum rewards: 18.294, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.912', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.028', 'AMMO4': '0.033', 'weapon5': '0.064', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.588', 'WEAPON3': '0.650', 'weapon2': '0.870', 'HITCOUNT': '1.430', 'weapon3': '1.840', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:28,888][52670] DAMAGECOUNT value on done: 20535.0 [2024-08-05 23:13:28,888][52670] Sum rewards: 11.889, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.420', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.044', 'AMMO3': '0.122', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.453', 'WEAPON3': '0.850', 'HITCOUNT': '1.000', 'weapon2': '1.624', 'weapon3': '1.950', 'DAMAGECOUNT': '3.369', 'FRAGCOUNT': '10.000'} [2024-08-05 23:13:29,023][52658] DAMAGECOUNT value on done: 25062.0 [2024-08-05 23:13:29,024][52658] Sum rewards: 18.253, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.375', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.086', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.332', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '1.370', 'weapon2': '1.418', 'weapon3': '1.638', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:29,689][52665] DAMAGECOUNT value on done: 26289.0 [2024-08-05 23:13:29,697][52665] Sum rewards: 27.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.460', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.118', 'WEAPON3': '0.700', 'ARMOR': '0.940', 'weapon2': '1.714', 'weapon3': '1.764', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '6.798', 'FRAGCOUNT': '22.000'} [2024-08-05 23:13:29,722][52667] DAMAGECOUNT value on done: 26485.0 [2024-08-05 23:13:29,725][52667] Sum rewards: 30.878, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'ARMOR': '0.451', 'weapon4': '0.458', 'WEAPON3': '0.750', 'weapon2': '1.186', 'weapon3': '1.958', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '6.873', 'FRAGCOUNT': '24.000'} [2024-08-05 23:13:30,582][52663] DAMAGECOUNT value on done: 26019.0 [2024-08-05 23:13:30,582][52663] Sum rewards: 20.243, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.104', 'WEAPON4': '0.350', 'ARMOR': '0.444', 'weapon2': '0.592', 'WEAPON3': '0.700', 'weapon4': '0.842', 'HITCOUNT': '1.680', 'weapon3': '1.852', 'DAMAGECOUNT': '6.264', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:30,661][52669] DAMAGECOUNT value on done: 24849.0 [2024-08-05 23:13:30,661][52669] Sum rewards: 13.319, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.645', 'AMMO5': '0.016', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.096', 'AMMO3': '0.106', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.493', 'WEAPON3': '0.750', 'HITCOUNT': '1.280', 'weapon2': '1.600', 'weapon3': '1.644', 'DAMAGECOUNT': '4.365', 'FRAGCOUNT': '10.500'} [2024-08-05 23:13:30,796][52666] DAMAGECOUNT value on done: 22186.0 [2024-08-05 23:13:30,798][52666] Sum rewards: 23.369, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.272', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.090', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.282', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'weapon2': '1.286', 'HITCOUNT': '1.410', 'weapon3': '1.804', 'DAMAGECOUNT': '5.517', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:31,287][52650] Updated weights for policy 0, policy_version 13311 (0.0020) [2024-08-05 23:13:31,904][52658] DAMAGECOUNT value on done: 24955.0 [2024-08-05 23:13:31,904][52658] Sum rewards: 15.303, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.346', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'weapon5': '0.052', 'AMMO3': '0.131', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.448', 'WEAPON3': '0.850', 'HITCOUNT': '1.270', 'weapon2': '1.418', 'weapon3': '1.548', 'DAMAGECOUNT': '4.851', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:31,967][52664] DAMAGECOUNT value on done: 24719.0 [2024-08-05 23:13:31,967][52664] Sum rewards: 22.674, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.168', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.064', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.270', 'WEAPON3': '0.750', 'weapon2': '1.244', 'HITCOUNT': '1.480', 'ARMOR': '1.763', 'weapon3': '1.914', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:32,117][52670] DAMAGECOUNT value on done: 24594.0 [2024-08-05 23:13:32,119][52670] Sum rewards: 23.460, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.350', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'WEAPON5': '0.050', 'weapon4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON3': '0.700', 'ARMOR': '1.350', 'weapon2': '1.572', 'HITCOUNT': '1.670', 'weapon3': '1.814', 'DAMAGECOUNT': '6.006', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:32,371][52667] DAMAGECOUNT value on done: 24640.0 [2024-08-05 23:13:32,372][52667] Sum rewards: 25.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.366', 'AMMO5': '0.009', 'AMMO2': '0.069', 'ARMOR': '0.078', 'AMMO3': '0.105', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.346', 'WEAPON4': '0.550', 'weapon4': '0.568', 'WEAPON3': '0.600', 'weapon2': '0.950', 'HITCOUNT': '1.680', 'weapon3': '1.890', 'DAMAGECOUNT': '6.267', 'FRAGCOUNT': '22.000'} [2024-08-05 23:13:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16134.2). Total num frames: 109068288. Throughput: 0: 4182.9. Samples: 27266460. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:13:32,794][52567] Avg episode reward: [(0, '20.199')] [2024-08-05 23:13:32,801][52665] DAMAGECOUNT value on done: 24824.0 [2024-08-05 23:13:32,802][52665] Sum rewards: 25.222, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.304', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.192', 'WEAPON3': '0.700', 'ARMOR': '1.255', 'weapon2': '1.492', 'weapon3': '1.630', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.225', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:33,971][52663] DAMAGECOUNT value on done: 28146.0 [2024-08-05 23:13:33,971][52663] Sum rewards: 20.435, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.322', 'HEALTH': '0.406', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'weapon2': '1.224', 'HITCOUNT': '1.460', 'weapon3': '1.844', 'DAMAGECOUNT': '5.349', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:34,008][52666] DAMAGECOUNT value on done: 23756.0 [2024-08-05 23:13:34,009][52666] Sum rewards: 18.131, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.975', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.073', 'AMMO3': '0.086', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.600', 'weapon2': '1.452', 'weapon3': '1.500', 'HITCOUNT': '1.560', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:34,015][52669] DAMAGECOUNT value on done: 27474.0 [2024-08-05 23:13:34,015][52669] Sum rewards: 18.628, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.035', 'AMMO2': '0.029', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'ARMOR': '0.428', 'WEAPON3': '0.450', 'weapon4': '0.508', 'HITCOUNT': '1.360', 'weapon2': '1.374', 'weapon3': '1.576', 'DAMAGECOUNT': '4.866', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:34,903][52658] DAMAGECOUNT value on done: 23120.0 [2024-08-05 23:13:34,911][52658] Sum rewards: 22.049, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO3': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON3': '0.400', 'HEALTH': '0.872', 'HITCOUNT': '1.250', 'weapon3': '1.420', 'weapon2': '1.810', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:35,278][52670] DAMAGECOUNT value on done: 26006.0 [2024-08-05 23:13:35,278][52670] Sum rewards: 18.453, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.100', 'weapon4': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.482', 'WEAPON3': '0.650', 'HITCOUNT': '1.440', 'weapon2': '1.518', 'weapon3': '1.604', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:35,301][52667] DAMAGECOUNT value on done: 25601.0 [2024-08-05 23:13:35,301][52667] Sum rewards: 18.750, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.016', 'AMMO2': '0.006', 'AMMO5': '0.013', 'weapon4': '0.014', 'weapon5': '0.018', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'ARMOR': '0.447', 'WEAPON3': '0.750', 'HITCOUNT': '1.420', 'weapon2': '1.496', 'weapon3': '1.892', 'DAMAGECOUNT': '5.421', 'FRAGCOUNT': '15.500'} [2024-08-05 23:13:35,397][52664] DAMAGECOUNT value on done: 25836.0 [2024-08-05 23:13:35,397][52664] Sum rewards: 24.213, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.957', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.099', 'weapon4': '0.106', 'WEAPON4': '0.150', 'ARMOR': '0.449', 'WEAPON3': '0.750', 'weapon3': '1.474', 'HITCOUNT': '1.810', 'weapon2': '2.052', 'DAMAGECOUNT': '6.288', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:35,597][52665] DAMAGECOUNT value on done: 24462.0 [2024-08-05 23:13:35,598][52665] Sum rewards: 20.781, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.346', 'WEAPON3': '0.800', 'ARMOR': '0.824', 'weapon2': '1.206', 'HITCOUNT': '1.620', 'weapon3': '1.894', 'DAMAGECOUNT': '5.499', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:36,195][52650] Updated weights for policy 0, policy_version 13321 (0.0014) [2024-08-05 23:13:36,830][52663] DAMAGECOUNT value on done: 24141.0 [2024-08-05 23:13:36,830][52663] Sum rewards: 15.906, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.305', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'weapon5': '0.084', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'HITCOUNT': '1.220', 'ARMOR': '1.376', 'weapon3': '1.730', 'weapon2': '1.752', 'DAMAGECOUNT': '4.464', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:37,107][52820] DAMAGECOUNT value on done: 20689.0 [2024-08-05 23:13:37,110][52820] Sum rewards: 10.680, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.708', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'ARMOR': '0.036', 'weapon5': '0.072', 'AMMO3': '0.087', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON3': '0.700', 'HITCOUNT': '1.160', 'weapon3': '1.408', 'weapon2': '1.624', 'DAMAGECOUNT': '4.311', 'FRAGCOUNT': '9.000'} [2024-08-05 23:13:37,244][52666] DAMAGECOUNT value on done: 22913.0 [2024-08-05 23:13:37,244][52666] Sum rewards: 18.922, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.392', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.076', 'weapon5': '0.102', 'weapon4': '0.124', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.469', 'WEAPON3': '0.500', 'HITCOUNT': '1.150', 'weapon3': '1.260', 'weapon2': '1.300', 'DAMAGECOUNT': '4.137', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:37,380][52658] DAMAGECOUNT value on done: 25302.0 [2024-08-05 23:13:37,381][52658] Sum rewards: 20.311, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.534', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO4': '0.088', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.901', 'HITCOUNT': '1.500', 'weapon3': '1.536', 'weapon2': '1.872', 'DAMAGECOUNT': '5.427', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16793.5, 300 sec: 16134.1). Total num frames: 109150208. Throughput: 0: 4180.0. Samples: 27291420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:13:37,795][52567] Avg episode reward: [(0, '20.052')] [2024-08-05 23:13:37,980][52667] DAMAGECOUNT value on done: 26532.0 [2024-08-05 23:13:37,984][52667] Sum rewards: 22.068, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.024', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.065', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.424', 'WEAPON3': '0.450', 'weapon2': '0.830', 'ARMOR': '0.968', 'HITCOUNT': '1.230', 'weapon3': '1.394', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:38,302][52664] DAMAGECOUNT value on done: 21808.0 [2024-08-05 23:13:38,304][52664] Sum rewards: 7.047, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.020', 'weapon5': '0.034', 'AMMO3': '0.095', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'HEALTH': '0.195', 'WEAPON3': '0.600', 'ARMOR': '0.828', 'HITCOUNT': '0.920', 'weapon3': '1.656', 'weapon2': '1.774', 'DAMAGECOUNT': '3.057', 'FRAGCOUNT': '5.000'} [2024-08-05 23:13:38,584][52665] DAMAGECOUNT value on done: 25240.0 [2024-08-05 23:13:38,586][52665] Sum rewards: 19.534, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.731', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.101', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.650', 'HITCOUNT': '1.500', 'weapon3': '1.632', 'weapon2': '1.642', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:38,787][52670] DAMAGECOUNT value on done: 24781.0 [2024-08-05 23:13:38,787][52670] Sum rewards: 14.006, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.790', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.008', 'weapon7': '0.050', 'AMMO3': '0.073', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '1.020', 'weapon2': '1.256', 'weapon3': '1.558', 'DAMAGECOUNT': '3.684', 'FRAGCOUNT': '10.000'} [2024-08-05 23:13:39,687][52663] DAMAGECOUNT value on done: 24749.0 [2024-08-05 23:13:39,690][52663] Sum rewards: 17.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.536', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.420', 'weapon2': '0.946', 'WEAPON3': '1.250', 'HITCOUNT': '1.500', 'weapon3': '2.266', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:40,494][52820] DAMAGECOUNT value on done: 23001.0 [2024-08-05 23:13:40,498][52820] Sum rewards: 20.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.714', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.204', 'WEAPON3': '1.100', 'ARMOR': '1.372', 'weapon2': '1.554', 'HITCOUNT': '1.630', 'weapon3': '1.972', 'DAMAGECOUNT': '6.135', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:40,670][52666] DAMAGECOUNT value on done: 23639.0 [2024-08-05 23:13:40,671][52666] Sum rewards: 18.726, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'AMMO4': '0.072', 'HEALTH': '0.143', 'weapon4': '0.352', 'WEAPON3': '0.400', 'HITCOUNT': '0.920', 'weapon2': '1.236', 'weapon3': '1.322', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:40,673][52658] DAMAGECOUNT value on done: 25958.0 [2024-08-05 23:13:40,676][52658] Sum rewards: 11.318, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.520', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'AMMO3': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.154', 'weapon4': '0.272', 'WEAPON3': '0.650', 'ARMOR': '0.857', 'HITCOUNT': '1.020', 'weapon2': '1.342', 'weapon3': '1.496', 'DAMAGECOUNT': '3.003', 'FRAGCOUNT': '9.000'} [2024-08-05 23:13:41,057][52650] Updated weights for policy 0, policy_version 13331 (0.0011) [2024-08-05 23:13:41,251][52664] DAMAGECOUNT value on done: 27217.0 [2024-08-05 23:13:41,251][52664] Sum rewards: 18.980, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.026', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.095', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'HEALTH': '0.202', 'WEAPON3': '0.550', 'weapon4': '0.604', 'weapon2': '1.426', 'HITCOUNT': '1.430', 'weapon3': '1.542', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:41,335][52667] DAMAGECOUNT value on done: 25092.0 [2024-08-05 23:13:41,337][52667] Sum rewards: 18.704, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.824', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.135', 'AMMO4': '0.148', 'weapon4': '0.244', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'WEAPON3': '0.850', 'weapon2': '1.108', 'HITCOUNT': '1.190', 'weapon3': '1.938', 'DAMAGECOUNT': '4.323', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:41,344][52665] DAMAGECOUNT value on done: 23329.0 [2024-08-05 23:13:41,345][52665] Sum rewards: 13.367, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.208', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '0.842', 'HITCOUNT': '1.230', 'weapon3': '1.826', 'DAMAGECOUNT': '3.948', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:41,958][52670] DAMAGECOUNT value on done: 25956.0 [2024-08-05 23:13:41,958][52670] Sum rewards: 23.828, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.686', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.090', 'WEAPON4': '0.300', 'ARMOR': '0.481', 'weapon4': '0.532', 'WEAPON3': '0.650', 'weapon2': '1.346', 'weapon3': '1.804', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '6.828', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:42,715][52663] DAMAGECOUNT value on done: 27885.0 [2024-08-05 23:13:42,716][52663] Sum rewards: 20.401, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.530', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'weapon4': '0.172', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.500', 'weapon2': '1.612', 'weapon3': '1.900', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:42,794][52567] Fps is (10 sec: 16383.6, 60 sec: 16793.5, 300 sec: 16161.8). Total num frames: 109232128. Throughput: 0: 4176.9. Samples: 27316510. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:13:42,795][52567] Avg episode reward: [(0, '19.640')] [2024-08-05 23:13:43,581][52658] DAMAGECOUNT value on done: 23636.0 [2024-08-05 23:13:43,581][52658] Sum rewards: 22.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.152', 'weapon7': '0.048', 'AMMO2': '0.050', 'weapon4': '0.098', 'AMMO3': '0.152', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.493', 'WEAPON3': '0.900', 'weapon2': '1.262', 'HITCOUNT': '1.640', 'weapon3': '2.212', 'DAMAGECOUNT': '6.387', 'FRAGCOUNT': '21.000'} [2024-08-05 23:13:43,717][52820] DAMAGECOUNT value on done: 21304.0 [2024-08-05 23:13:43,722][52820] Sum rewards: 15.504, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.486', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'weapon5': '0.088', 'AMMO3': '0.104', 'ARMOR': '0.481', 'WEAPON3': '0.700', 'HITCOUNT': '1.320', 'weapon2': '1.504', 'weapon3': '1.688', 'DAMAGECOUNT': '4.899', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:43,897][52666] DAMAGECOUNT value on done: 24784.0 [2024-08-05 23:13:43,899][52666] Sum rewards: 28.525, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.142', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO3': '0.080', 'AMMO4': '0.089', 'weapon5': '0.120', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.432', 'ARMOR': '0.476', 'WEAPON3': '0.600', 'weapon2': '1.002', 'HITCOUNT': '1.840', 'weapon3': '1.998', 'DAMAGECOUNT': '7.704', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:44,070][52665] DAMAGECOUNT value on done: 23627.0 [2024-08-05 23:13:44,071][52665] Sum rewards: 22.516, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.280', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon2': '1.172', 'HITCOUNT': '1.430', 'weapon3': '1.752', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:44,214][52667] DAMAGECOUNT value on done: 26201.0 [2024-08-05 23:13:44,214][52667] Sum rewards: 20.497, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.426', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.025', 'ARMOR': '0.028', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.400', 'weapon4': '0.412', 'WEAPON3': '0.650', 'weapon2': '1.270', 'HITCOUNT': '1.320', 'weapon3': '1.712', 'DAMAGECOUNT': '4.764', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:44,458][52664] DAMAGECOUNT value on done: 25230.0 [2024-08-05 23:13:44,460][52664] Sum rewards: 15.219, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.366', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.194', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.420', 'HITCOUNT': '1.450', 'weapon3': '1.916', 'DAMAGECOUNT': '4.944', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:45,335][52670] DAMAGECOUNT value on done: 25376.0 [2024-08-05 23:13:45,337][52670] Sum rewards: 21.376, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.871', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.332', 'WEAPON3': '0.700', 'ARMOR': '0.905', 'weapon2': '1.246', 'HITCOUNT': '1.340', 'weapon3': '1.706', 'DAMAGECOUNT': '4.662', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:45,757][52650] Updated weights for policy 0, policy_version 13341 (0.0014) [2024-08-05 23:13:46,287][52663] DAMAGECOUNT value on done: 26515.0 [2024-08-05 23:13:46,290][52663] Sum rewards: 13.852, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.814', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.050', 'AMMO3': '0.117', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.328', 'ARMOR': '0.451', 'WEAPON3': '0.800', 'weapon2': '1.002', 'HITCOUNT': '1.150', 'weapon3': '1.554', 'DAMAGECOUNT': '4.305', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:46,808][52658] DAMAGECOUNT value on done: 29977.0 [2024-08-05 23:13:46,813][52658] Sum rewards: 22.685, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.574', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.151', 'weapon4': '0.210', 'WEAPON4': '0.250', 'ARMOR': '0.890', 'WEAPON3': '1.000', 'weapon2': '1.396', 'HITCOUNT': '1.770', 'weapon3': '2.100', 'DAMAGECOUNT': '6.174', 'FRAGCOUNT': '20.000'} [2024-08-05 23:13:46,861][52666] DAMAGECOUNT value on done: 22678.0 [2024-08-05 23:13:46,862][52666] Sum rewards: 22.373, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.128', 'AMMO3': '0.135', 'WEAPON4': '0.400', 'ARMOR': '0.424', 'WEAPON3': '1.000', 'weapon2': '1.264', 'HITCOUNT': '1.840', 'weapon3': '2.316', 'DAMAGECOUNT': '6.294', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:47,041][52664] DAMAGECOUNT value on done: 26060.0 [2024-08-05 23:13:47,041][52664] Sum rewards: 19.650, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.143', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.478', 'HITCOUNT': '1.740', 'weapon3': '2.016', 'DAMAGECOUNT': '6.087', 'FRAGCOUNT': '17.000'} [2024-08-05 23:13:47,045][52820] DAMAGECOUNT value on done: 23473.0 [2024-08-05 23:13:47,046][52820] Sum rewards: 20.541, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.066', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon4': '0.006', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'ARMOR': '0.853', 'WEAPON3': '1.000', 'HITCOUNT': '1.410', 'weapon3': '1.642', 'weapon2': '1.892', 'DAMAGECOUNT': '5.379', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:47,377][52667] DAMAGECOUNT value on done: 28109.0 [2024-08-05 23:13:47,377][52667] Sum rewards: 17.074, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.560', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'ARMOR': '1.255', 'HITCOUNT': '1.360', 'weapon3': '1.368', 'weapon2': '2.054', 'DAMAGECOUNT': '4.659', 'FRAGCOUNT': '12.000'} [2024-08-05 23:13:47,794][52567] Fps is (10 sec: 16384.3, 60 sec: 16657.1, 300 sec: 16189.6). Total num frames: 109314048. Throughput: 0: 4178.7. Samples: 27329050. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:13:47,794][52567] Avg episode reward: [(0, '19.437')] [2024-08-05 23:13:47,991][52670] DAMAGECOUNT value on done: 23585.0 [2024-08-05 23:13:47,993][52670] Sum rewards: 22.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.192', 'AMMO2': '0.013', 'ARMOR': '0.028', 'AMMO4': '0.066', 'AMMO3': '0.114', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'weapon2': '1.628', 'weapon3': '1.682', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '5.745', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:49,742][52666] DAMAGECOUNT value on done: 23040.0 [2024-08-05 23:13:49,744][52666] Sum rewards: 18.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.130', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'WEAPON3': '1.000', 'weapon2': '1.250', 'HITCOUNT': '1.570', 'weapon3': '1.990', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:49,821][52663] DAMAGECOUNT value on done: 25663.0 [2024-08-05 23:13:49,822][52663] Sum rewards: 24.472, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.981', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.103', 'weapon5': '0.110', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.916', 'WEAPON3': '1.150', 'weapon2': '1.354', 'HITCOUNT': '1.440', 'weapon3': '2.062', 'DAMAGECOUNT': '6.270', 'FRAGCOUNT': '22.000'} [2024-08-05 23:13:49,837][52664] DAMAGECOUNT value on done: 25427.0 [2024-08-05 23:13:49,838][52664] Sum rewards: 19.573, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.080', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'weapon4': '0.124', 'WEAPON3': '0.550', 'HITCOUNT': '1.370', 'weapon2': '1.584', 'weapon3': '1.596', 'DAMAGECOUNT': '4.584', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:49,846][52658] DAMAGECOUNT value on done: 24619.0 [2024-08-05 23:13:49,850][52658] Sum rewards: 17.046, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.054', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'ARMOR': '0.903', 'WEAPON3': '1.050', 'weapon2': '1.114', 'HITCOUNT': '1.460', 'weapon3': '2.104', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '15.000'} [2024-08-05 23:13:50,216][52667] DAMAGECOUNT value on done: 26023.0 [2024-08-05 23:13:50,216][52667] Sum rewards: 25.088, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO2': '0.034', 'AMMO3': '0.064', 'WEAPON4': '0.150', 'AMMO4': '0.170', 'weapon4': '0.244', 'HEALTH': '0.333', 'WEAPON3': '0.400', 'ARMOR': '0.428', 'weapon2': '1.322', 'weapon3': '1.378', 'HITCOUNT': '1.400', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:50,287][52820] DAMAGECOUNT value on done: 24422.0 [2024-08-05 23:13:50,290][52820] Sum rewards: 20.594, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.180', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.198', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'HITCOUNT': '1.370', 'weapon3': '1.492', 'weapon2': '1.520', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:50,654][52670] DAMAGECOUNT value on done: 23172.0 [2024-08-05 23:13:50,655][52670] Sum rewards: 12.614, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.776', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.021', 'weapon5': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.116', 'weapon4': '0.492', 'WEAPON3': '0.750', 'weapon2': '1.026', 'HITCOUNT': '1.270', 'weapon3': '1.702', 'DAMAGECOUNT': '4.467', 'FRAGCOUNT': '10.000'} [2024-08-05 23:13:51,135][52650] Updated weights for policy 0, policy_version 13351 (0.0021) [2024-08-05 23:13:52,069][52671] DAMAGECOUNT value on done: 27977.0 [2024-08-05 23:13:52,070][52671] Sum rewards: 24.474, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'weapon5': '0.020', 'HEALTH': '0.033', 'AMMO2': '0.034', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.650', 'ARMOR': '0.917', 'weapon2': '1.178', 'HITCOUNT': '1.630', 'weapon3': '1.858', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:52,593][52666] DAMAGECOUNT value on done: 24288.0 [2024-08-05 23:13:52,593][52666] Sum rewards: 8.491, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.186', 'weapon4': '0.236', 'ARMOR': '0.913', 'weapon2': '1.070', 'WEAPON3': '1.150', 'HITCOUNT': '1.240', 'weapon3': '2.222', 'DAMAGECOUNT': '4.431', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:52,678][52658] DAMAGECOUNT value on done: 27253.0 [2024-08-05 23:13:52,679][52658] Sum rewards: 24.859, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.452', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.236', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.500', 'weapon2': '1.528', 'weapon3': '1.598', 'DAMAGECOUNT': '5.592', 'FRAGCOUNT': '20.000'} [2024-08-05 23:13:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 16793.6, 300 sec: 16245.1). Total num frames: 109404160. Throughput: 0: 4176.0. Samples: 27354270. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:13:52,795][52567] Avg episode reward: [(0, '19.636')] [2024-08-05 23:13:52,958][52663] DAMAGECOUNT value on done: 24972.0 [2024-08-05 23:13:52,961][52663] Sum rewards: 22.734, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.042', 'weapon4': '0.054', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'ARMOR': '1.256', 'weapon2': '1.510', 'HITCOUNT': '1.880', 'weapon3': '2.178', 'DAMAGECOUNT': '6.180', 'FRAGCOUNT': '20.000'} [2024-08-05 23:13:53,047][52667] DAMAGECOUNT value on done: 24836.0 [2024-08-05 23:13:53,048][52667] Sum rewards: 21.599, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.004', 'AMMO4': '-0.074', 'AMMO2': '-0.015', 'AMMO5': '0.003', 'weapon5': '0.010', 'weapon4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'ARMOR': '0.424', 'WEAPON3': '0.750', 'HITCOUNT': '1.600', 'weapon3': '1.760', 'weapon2': '1.868', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:53,578][52820] DAMAGECOUNT value on done: 23361.0 [2024-08-05 23:13:53,578][52820] Sum rewards: 18.058, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.424', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO3': '0.112', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.416', 'ARMOR': '0.492', 'WEAPON3': '0.800', 'weapon2': '1.160', 'HITCOUNT': '1.550', 'weapon3': '1.656', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:53,856][52670] DAMAGECOUNT value on done: 23513.0 [2024-08-05 23:13:53,857][52670] Sum rewards: 20.765, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.332', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.044', 'AMMO4': '0.073', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon4': '0.246', 'WEAPON3': '0.700', 'weapon2': '1.226', 'HITCOUNT': '1.260', 'weapon3': '1.508', 'DAMAGECOUNT': '5.106', 'FRAGCOUNT': '18.000'} [2024-08-05 23:13:55,188][52671] DAMAGECOUNT value on done: 24107.0 [2024-08-05 23:13:55,191][52671] Sum rewards: 11.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.944', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.080', 'AMMO3': '0.111', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'HITCOUNT': '1.030', 'weapon2': '1.210', 'weapon3': '1.410', 'DAMAGECOUNT': '3.459', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:55,414][52658] DAMAGECOUNT value on done: 25788.0 [2024-08-05 23:13:55,414][52658] Sum rewards: 20.809, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.870', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'AMMO3': '0.096', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.236', 'WEAPON3': '0.750', 'ARMOR': '0.910', 'weapon2': '1.340', 'HITCOUNT': '1.430', 'weapon3': '1.536', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:55,552][52650] Updated weights for policy 0, policy_version 13361 (0.0014) [2024-08-05 23:13:55,819][52667] DAMAGECOUNT value on done: 26093.0 [2024-08-05 23:13:55,820][52667] Sum rewards: 23.853, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.196', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'weapon4': '0.234', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.910', 'weapon2': '1.470', 'HITCOUNT': '1.680', 'weapon3': '1.684', 'DAMAGECOUNT': '6.219', 'FRAGCOUNT': '19.000'} [2024-08-05 23:13:56,192][52666] DAMAGECOUNT value on done: 25113.0 [2024-08-05 23:13:56,203][52666] Sum rewards: 22.777, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.109', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.056', 'AMMO4': '0.099', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.384', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'weapon2': '1.264', 'HITCOUNT': '1.680', 'weapon3': '1.836', 'DAMAGECOUNT': '6.294', 'FRAGCOUNT': '16.500'} [2024-08-05 23:13:56,261][52663] DAMAGECOUNT value on done: 25286.0 [2024-08-05 23:13:56,263][52663] Sum rewards: 15.097, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.062', 'AMMO5': '0.015', 'weapon5': '0.024', 'AMMO2': '0.060', 'AMMO3': '0.134', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.370', 'ARMOR': '0.509', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.044', 'HITCOUNT': '1.210', 'weapon3': '1.970', 'DAMAGECOUNT': '4.725', 'FRAGCOUNT': '14.000'} [2024-08-05 23:13:56,977][52820] DAMAGECOUNT value on done: 23212.0 [2024-08-05 23:13:56,977][52820] Sum rewards: 23.667, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.396', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'weapon4': '0.074', 'AMMO3': '0.111', 'ARMOR': '0.448', 'WEAPON3': '0.700', 'weapon3': '1.666', 'weapon2': '1.754', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '20.000'} [2024-08-05 23:13:57,421][52670] DAMAGECOUNT value on done: 23544.0 [2024-08-05 23:13:57,426][52670] Sum rewards: 27.319, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.109', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.710', 'HITCOUNT': '1.780', 'weapon3': '1.920', 'DAMAGECOUNT': '7.095', 'FRAGCOUNT': '21.000'} [2024-08-05 23:13:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.6, 300 sec: 16272.9). Total num frames: 109486080. Throughput: 0: 4184.0. Samples: 27379430. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:13:57,794][52567] Avg episode reward: [(0, '19.738')] [2024-08-05 23:13:58,520][52671] DAMAGECOUNT value on done: 26354.0 [2024-08-05 23:13:58,520][52671] Sum rewards: 16.682, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.696', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.060', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON3': '0.600', 'ARMOR': '0.862', 'HITCOUNT': '1.240', 'weapon2': '1.420', 'weapon3': '1.536', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:58,546][52658] DAMAGECOUNT value on done: 26543.0 [2024-08-05 23:13:58,546][52658] Sum rewards: 16.126, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.695', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.095', 'WEAPON4': '0.250', 'weapon4': '0.386', 'ARMOR': '0.446', 'WEAPON3': '0.550', 'HITCOUNT': '1.120', 'weapon2': '1.286', 'weapon3': '1.290', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '13.000'} [2024-08-05 23:13:58,930][52667] DAMAGECOUNT value on done: 26408.0 [2024-08-05 23:13:58,930][52667] Sum rewards: 15.193, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.118', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '1.520', 'weapon2': '1.604', 'weapon3': '1.738', 'DAMAGECOUNT': '5.607', 'FRAGCOUNT': '11.000'} [2024-08-05 23:13:59,361][52666] Large shaping reward 3.636 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:13:59,482][52663] DAMAGECOUNT value on done: 25081.0 [2024-08-05 23:13:59,484][52663] Sum rewards: 20.257, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.730', 'AMMO4': '-0.042', 'AMMO2': '-0.008', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.072', 'WEAPON3': '0.600', 'ARMOR': '0.841', 'HITCOUNT': '1.310', 'weapon3': '1.512', 'weapon2': '1.824', 'DAMAGECOUNT': '4.818', 'FRAGCOUNT': '16.000'} [2024-08-05 23:13:59,853][52649] DAMAGECOUNT value on done: 24770.0 [2024-08-05 23:13:59,855][52649] Sum rewards: 18.105, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.595', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'weapon4': '0.230', 'WEAPON3': '0.650', 'weapon2': '1.362', 'HITCOUNT': '1.370', 'weapon3': '1.788', 'DAMAGECOUNT': '4.740', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:00,303][52820] DAMAGECOUNT value on done: 23374.0 [2024-08-05 23:14:00,303][52820] Sum rewards: 21.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.769', 'AMMO2': '0.002', 'weapon4': '0.004', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.147', 'ARMOR': '0.925', 'WEAPON3': '1.000', 'weapon2': '1.322', 'HITCOUNT': '1.720', 'weapon3': '2.472', 'DAMAGECOUNT': '6.528', 'FRAGCOUNT': '20.000'} [2024-08-05 23:14:00,722][52670] DAMAGECOUNT value on done: 24038.0 [2024-08-05 23:14:00,725][52670] Sum rewards: 15.938, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.293', 'AMMO2': '0.034', 'AMMO3': '0.107', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.360', 'ARMOR': '0.485', 'WEAPON3': '0.650', 'weapon2': '0.924', 'HITCOUNT': '1.200', 'weapon3': '2.090', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '13.000'} [2024-08-05 23:14:00,802][52650] Updated weights for policy 0, policy_version 13371 (0.0011) [2024-08-05 23:14:01,025][52658] DAMAGECOUNT value on done: 24093.0 [2024-08-05 23:14:01,026][52658] Sum rewards: 19.445, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.334', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'ARMOR': '0.436', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon3': '1.498', 'weapon2': '2.012', 'DAMAGECOUNT': '4.242', 'FRAGCOUNT': '15.000'} [2024-08-05 23:14:01,743][52671] DAMAGECOUNT value on done: 24046.0 [2024-08-05 23:14:01,743][52671] Sum rewards: 18.074, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.807', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.010', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'HITCOUNT': '1.220', 'weapon3': '1.412', 'weapon2': '1.510', 'DAMAGECOUNT': '4.539', 'FRAGCOUNT': '15.000'} [2024-08-05 23:14:02,448][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:14:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.5, 300 sec: 16300.7). Total num frames: 109568000. Throughput: 0: 4188.0. Samples: 27392030. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:14:02,795][52567] Avg episode reward: [(0, '19.509')] [2024-08-05 23:14:02,873][52663] DAMAGECOUNT value on done: 25544.0 [2024-08-05 23:14:02,875][52663] Sum rewards: 16.295, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.814', 'AMMO2': '0.021', 'AMMO3': '0.085', 'AMMO4': '0.105', 'weapon4': '0.110', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.944', 'HITCOUNT': '1.390', 'weapon2': '1.560', 'weapon3': '1.818', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '12.000'} [2024-08-05 23:14:03,012][52649] DAMAGECOUNT value on done: 24900.0 [2024-08-05 23:14:03,012][52649] Sum rewards: 17.914, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.773', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.336', 'ARMOR': '0.489', 'WEAPON3': '0.850', 'weapon2': '1.028', 'HITCOUNT': '1.550', 'weapon3': '1.968', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '15.000'} [2024-08-05 23:14:03,659][52659] DAMAGECOUNT value on done: 25041.0 [2024-08-05 23:14:03,660][52659] Sum rewards: 14.982, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.073', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.136', 'weapon4': '0.244', 'WEAPON3': '0.850', 'ARMOR': '0.861', 'HITCOUNT': '1.190', 'weapon2': '1.432', 'weapon3': '1.620', 'DAMAGECOUNT': '4.086', 'FRAGCOUNT': '13.000'} [2024-08-05 23:14:03,781][52820] DAMAGECOUNT value on done: 21350.0 [2024-08-05 23:14:03,784][52820] Sum rewards: 17.727, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.117', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'ARMOR': '0.544', 'weapon4': '0.592', 'WEAPON3': '0.800', 'weapon2': '0.962', 'HITCOUNT': '1.280', 'weapon3': '1.918', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:04,459][52658] DAMAGECOUNT value on done: 26236.0 [2024-08-05 23:14:04,461][52658] Sum rewards: 18.974, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.890', 'AMMO2': '0.002', 'AMMO5': '0.010', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon5': '0.112', 'weapon4': '0.226', 'ARMOR': '0.495', 'WEAPON3': '0.700', 'HITCOUNT': '1.400', 'weapon3': '1.526', 'weapon2': '1.580', 'DAMAGECOUNT': '5.544', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:05,016][52671] DAMAGECOUNT value on done: 24670.0 [2024-08-05 23:14:05,016][52671] Sum rewards: 19.843, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.129', 'weapon4': '0.164', 'WEAPON4': '0.200', 'ARMOR': '0.496', 'WEAPON3': '0.800', 'weapon2': '1.260', 'HITCOUNT': '1.630', 'weapon3': '1.952', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '17.000'} [2024-08-05 23:14:05,402][52650] Updated weights for policy 0, policy_version 13381 (0.0012) [2024-08-05 23:14:06,005][52663] DAMAGECOUNT value on done: 25635.0 [2024-08-05 23:14:06,005][52663] Sum rewards: 14.086, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'ARMOR': '0.453', 'weapon4': '0.582', 'WEAPON3': '0.750', 'weapon2': '1.172', 'HITCOUNT': '1.220', 'weapon3': '1.942', 'DAMAGECOUNT': '4.554', 'FRAGCOUNT': '12.000'} [2024-08-05 23:14:06,234][52649] DAMAGECOUNT value on done: 24986.0 [2024-08-05 23:14:06,237][52649] Sum rewards: 27.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.662', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON3': '0.950', 'HITCOUNT': '1.690', 'ARMOR': '1.706', 'weapon3': '1.784', 'weapon2': '1.864', 'DAMAGECOUNT': '6.588', 'FRAGCOUNT': '24.000'} [2024-08-05 23:14:06,900][52658] DAMAGECOUNT value on done: 26499.0 [2024-08-05 23:14:06,901][52658] Sum rewards: 17.619, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.140', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'ARMOR': '0.849', 'WEAPON3': '0.900', 'HITCOUNT': '1.320', 'weapon2': '1.686', 'weapon3': '1.838', 'DAMAGECOUNT': '4.695', 'FRAGCOUNT': '15.000'} [2024-08-05 23:14:06,997][52659] DAMAGECOUNT value on done: 26546.0 [2024-08-05 23:14:06,999][52659] Sum rewards: 19.103, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.666', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'ARMOR': '0.855', 'WEAPON3': '1.000', 'weapon2': '1.400', 'HITCOUNT': '1.520', 'weapon3': '2.098', 'DAMAGECOUNT': '5.655', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:07,190][52820] DAMAGECOUNT value on done: 22827.0 [2024-08-05 23:14:07,193][52820] Sum rewards: 13.525, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.819', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.109', 'WEAPON3': '0.650', 'ARMOR': '1.287', 'HITCOUNT': '1.370', 'weapon3': '1.806', 'weapon2': '1.994', 'DAMAGECOUNT': '4.269', 'FRAGCOUNT': '11.000'} [2024-08-05 23:14:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16793.6, 300 sec: 16356.2). Total num frames: 109649920. Throughput: 0: 4191.3. Samples: 27417170. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:14:07,794][52567] Avg episode reward: [(0, '19.289')] [2024-08-05 23:14:08,503][52671] DAMAGECOUNT value on done: 27685.0 [2024-08-05 23:14:08,505][52671] Sum rewards: 22.683, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.922', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.254', 'ARMOR': '0.845', 'WEAPON3': '1.000', 'weapon2': '1.492', 'HITCOUNT': '1.730', 'weapon3': '1.934', 'DAMAGECOUNT': '6.300', 'FRAGCOUNT': '20.000'} [2024-08-05 23:14:08,786][52663] DAMAGECOUNT value on done: 24675.0 [2024-08-05 23:14:08,786][52663] Sum rewards: 20.377, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.861', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON3': '0.900', 'ARMOR': '0.906', 'weapon2': '1.328', 'HITCOUNT': '1.590', 'weapon3': '2.112', 'DAMAGECOUNT': '5.502', 'FRAGCOUNT': '17.000'} [2024-08-05 23:14:09,551][52649] DAMAGECOUNT value on done: 25037.0 [2024-08-05 23:14:09,552][52649] Sum rewards: 30.226, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.533', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.079', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon5': '0.220', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'WEAPON3': '0.650', 'weapon2': '1.506', 'weapon3': '1.512', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '7.494', 'FRAGCOUNT': '22.000'} [2024-08-05 23:14:09,941][52658] DAMAGECOUNT value on done: 24592.0 [2024-08-05 23:14:09,941][52658] Sum rewards: 21.072, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.254', 'weapon5': '0.270', 'weapon4': '0.478', 'WEAPON3': '0.650', 'HITCOUNT': '1.240', 'weapon3': '1.592', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '18.000'} [2024-08-05 23:14:10,290][52659] DAMAGECOUNT value on done: 26603.0 [2024-08-05 23:14:10,291][52659] Sum rewards: 20.647, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.610', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.330', 'weapon2': '1.474', 'weapon3': '2.000', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '18.000'} [2024-08-05 23:14:10,381][52650] Updated weights for policy 0, policy_version 13391 (0.0045) [2024-08-05 23:14:10,404][52820] DAMAGECOUNT value on done: 23848.0 [2024-08-05 23:14:10,404][52820] Sum rewards: 16.574, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.865', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.220', 'ARMOR': '0.475', 'WEAPON3': '0.800', 'weapon3': '1.528', 'weapon2': '1.538', 'HITCOUNT': '1.610', 'DAMAGECOUNT': '5.403', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:11,223][52671] DAMAGECOUNT value on done: 24840.0 [2024-08-05 23:14:11,224][52671] Sum rewards: 19.465, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.777', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.028', 'AMMO3': '0.077', 'AMMO4': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.453', 'WEAPON3': '0.600', 'weapon4': '0.650', 'weapon2': '1.228', 'weapon3': '1.580', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '5.547', 'FRAGCOUNT': '13.500'} [2024-08-05 23:14:11,725][52663] DAMAGECOUNT value on done: 23667.0 [2024-08-05 23:14:11,726][52663] Sum rewards: 7.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.650', 'AMMO2': '0.033', 'weapon4': '0.112', 'AMMO4': '0.167', 'AMMO3': '0.175', 'WEAPON4': '0.450', 'ARMOR': '0.491', 'HITCOUNT': '1.100', 'WEAPON3': '1.150', 'weapon2': '1.504', 'weapon3': '2.154', 'DAMAGECOUNT': '3.918', 'FRAGCOUNT': '10.000'} [2024-08-05 23:14:12,748][52649] DAMAGECOUNT value on done: 25897.0 [2024-08-05 23:14:12,752][52649] Sum rewards: 25.611, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.272', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.186', 'WEAPON3': '0.450', 'weapon4': '0.514', 'weapon2': '0.962', 'weapon3': '1.454', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '7.755', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 16657.1, 300 sec: 16384.0). Total num frames: 109740032. Throughput: 0: 4185.6. Samples: 27442330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:14:12,794][52567] Avg episode reward: [(0, '19.384')] [2024-08-05 23:14:13,083][52658] DAMAGECOUNT value on done: 26906.0 [2024-08-05 23:14:13,083][52658] Sum rewards: 22.820, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.901', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.131', 'weapon5': '0.138', 'WEAPON4': '0.300', 'ARMOR': '0.465', 'weapon4': '0.566', 'WEAPON3': '0.800', 'weapon2': '0.958', 'HITCOUNT': '1.300', 'weapon3': '1.474', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '19.000'} [2024-08-05 23:14:13,278][52659] DAMAGECOUNT value on done: 24641.0 [2024-08-05 23:14:13,280][52659] Sum rewards: 22.968, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.162', 'weapon4': '0.222', 'WEAPON4': '0.350', 'ARMOR': '0.517', 'WEAPON3': '0.950', 'weapon2': '1.178', 'HITCOUNT': '1.340', 'weapon3': '2.204', 'DAMAGECOUNT': '5.319', 'FRAGCOUNT': '20.000'} [2024-08-05 23:14:13,727][52820] DAMAGECOUNT value on done: 24812.0 [2024-08-05 23:14:13,728][52820] Sum rewards: 20.108, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.987', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.013', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.923', 'HITCOUNT': '1.560', 'weapon2': '1.752', 'weapon3': '1.910', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:14,105][52671] DAMAGECOUNT value on done: 27063.0 [2024-08-05 23:14:14,107][52671] Sum rewards: 27.961, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.750', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.016', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON3': '0.800', 'weapon2': '1.370', 'HITCOUNT': '1.760', 'weapon3': '1.882', 'DAMAGECOUNT': '6.561', 'FRAGCOUNT': '24.000'} [2024-08-05 23:14:14,907][52663] DAMAGECOUNT value on done: 24657.0 [2024-08-05 23:14:14,908][52663] Sum rewards: 24.613, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'ARMOR': '0.416', 'WEAPON3': '0.800', 'weapon2': '1.558', 'HITCOUNT': '1.800', 'weapon3': '2.154', 'DAMAGECOUNT': '6.912', 'FRAGCOUNT': '19.000'} [2024-08-05 23:14:14,963][52650] Updated weights for policy 0, policy_version 13401 (0.0031) [2024-08-05 23:14:15,932][52649] DAMAGECOUNT value on done: 25154.0 [2024-08-05 23:14:15,934][52649] Sum rewards: 16.064, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.085', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.069', 'WEAPON4': '0.200', 'weapon4': '0.390', 'WEAPON3': '0.550', 'HITCOUNT': '1.030', 'weapon3': '1.272', 'weapon2': '1.622', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '12.000'} [2024-08-05 23:14:16,114][52659] DAMAGECOUNT value on done: 25894.0 [2024-08-05 23:14:16,115][52659] Sum rewards: 21.829, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.298', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.014', 'AMMO4': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon4': '0.218', 'WEAPON3': '1.050', 'ARMOR': '1.461', 'weapon2': '1.490', 'HITCOUNT': '1.600', 'weapon3': '2.012', 'DAMAGECOUNT': '6.405', 'FRAGCOUNT': '19.000'} [2024-08-05 23:14:16,286][52658] DAMAGECOUNT value on done: 28201.0 [2024-08-05 23:14:16,287][52658] Sum rewards: 26.200, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.054', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.418', 'WEAPON3': '0.650', 'weapon2': '1.034', 'weapon3': '1.620', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.126', 'FRAGCOUNT': '20.000'} [2024-08-05 23:14:17,109][52820] DAMAGECOUNT value on done: 21993.0 [2024-08-05 23:14:17,109][52820] Sum rewards: 9.127, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.292', 'ARMOR': '0.459', 'WEAPON3': '0.900', 'HITCOUNT': '1.050', 'weapon2': '1.306', 'weapon3': '1.770', 'DAMAGECOUNT': '3.735', 'FRAGCOUNT': '8.000'} [2024-08-05 23:14:17,325][52671] DAMAGECOUNT value on done: 26678.0 [2024-08-05 23:14:17,327][52671] Sum rewards: 19.560, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.912', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.118', 'WEAPON3': '0.800', 'ARMOR': '1.354', 'HITCOUNT': '1.520', 'weapon2': '1.814', 'weapon3': '1.900', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16793.6, 300 sec: 16384.0). Total num frames: 109813760. Throughput: 0: 4189.8. Samples: 27455000. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:14:17,794][52567] Avg episode reward: [(0, '19.428')] [2024-08-05 23:14:18,837][52649] DAMAGECOUNT value on done: 22691.0 [2024-08-05 23:14:18,838][52649] Sum rewards: 14.559, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.205', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.845', 'HITCOUNT': '1.260', 'weapon2': '1.646', 'weapon3': '1.966', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '11.000'} [2024-08-05 23:14:19,182][52659] DAMAGECOUNT value on done: 27448.0 [2024-08-05 23:14:19,184][52659] Sum rewards: 20.169, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.206', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.990', 'WEAPON3': '1.400', 'HITCOUNT': '1.630', 'ARMOR': '1.792', 'weapon3': '2.718', 'DAMAGECOUNT': '6.678', 'FRAGCOUNT': '22.000'} [2024-08-05 23:14:19,641][52658] DAMAGECOUNT value on done: 25348.0 [2024-08-05 23:14:19,643][52658] Sum rewards: 16.628, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.067', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.342', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'weapon2': '1.126', 'HITCOUNT': '1.550', 'weapon3': '1.636', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:19,921][52671] DAMAGECOUNT value on done: 28566.0 [2024-08-05 23:14:19,921][52671] Sum rewards: 21.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.031', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'ARMOR': '0.488', 'WEAPON3': '1.300', 'weapon2': '1.322', 'HITCOUNT': '1.800', 'weapon3': '2.384', 'DAMAGECOUNT': '6.579', 'FRAGCOUNT': '21.000'} [2024-08-05 23:14:20,185][52650] Updated weights for policy 0, policy_version 13411 (0.0026) [2024-08-05 23:14:20,523][52820] DAMAGECOUNT value on done: 22722.0 [2024-08-05 23:14:20,525][52820] Sum rewards: 28.190, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.072', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.252', 'WEAPON3': '0.450', 'ARMOR': '0.500', 'weapon4': '0.516', 'weapon2': '0.874', 'weapon3': '1.664', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '21.000'} [2024-08-05 23:14:21,932][52649] DAMAGECOUNT value on done: 24171.0 [2024-08-05 23:14:21,933][52649] Sum rewards: 14.039, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.986', 'weapon5': '0.006', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.118', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.465', 'WEAPON3': '0.800', 'weapon4': '0.874', 'weapon2': '0.962', 'HITCOUNT': '1.050', 'weapon3': '1.708', 'DAMAGECOUNT': '4.005', 'FRAGCOUNT': '11.000'} [2024-08-05 23:14:22,063][52659] DAMAGECOUNT value on done: 27980.0 [2024-08-05 23:14:22,065][52659] Sum rewards: 27.074, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.791', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon4': '0.112', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'ARMOR': '0.467', 'WEAPON3': '0.850', 'weapon2': '1.118', 'HITCOUNT': '1.820', 'weapon3': '2.256', 'DAMAGECOUNT': '6.804', 'FRAGCOUNT': '23.000'} [2024-08-05 23:14:22,221][52658] DAMAGECOUNT value on done: 24712.0 [2024-08-05 23:14:22,221][52658] Sum rewards: 27.830, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.148', 'HEALTH': '0.175', 'WEAPON4': '0.200', 'AMMO4': '0.204', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'weapon4': '0.514', 'weapon2': '1.212', 'weapon3': '1.550', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '6.300', 'FRAGCOUNT': '20.000'} [2024-08-05 23:14:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 16657.1, 300 sec: 16411.8). Total num frames: 109903872. Throughput: 0: 4197.4. Samples: 27480300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:14:22,794][52567] Avg episode reward: [(0, '19.473')] [2024-08-05 23:14:23,193][52671] DAMAGECOUNT value on done: 25383.0 [2024-08-05 23:14:23,193][52671] Sum rewards: 23.180, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.629', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.110', 'WEAPON4': '0.350', 'weapon4': '0.416', 'WEAPON3': '0.750', 'ARMOR': '0.892', 'weapon2': '1.532', 'weapon3': '1.738', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '6.273', 'FRAGCOUNT': '18.000'} [2024-08-05 23:14:23,966][52820] DAMAGECOUNT value on done: 23585.0 [2024-08-05 23:14:23,966][52820] Sum rewards: 23.766, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.132', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.056', 'weapon5': '0.066', 'AMMO3': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'ARMOR': '0.836', 'HITCOUNT': '1.510', 'weapon3': '1.696', 'weapon2': '1.878', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '17.000'} [2024-08-05 23:14:24,340][52658] DAMAGECOUNT value on done: 26019.0 [2024-08-05 23:14:24,341][52658] Sum rewards: 15.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.734', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.134', 'weapon4': '0.210', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.192', 'HITCOUNT': '1.300', 'weapon3': '1.524', 'DAMAGECOUNT': '4.344', 'FRAGCOUNT': '13.000'} [2024-08-05 23:14:24,901][52650] Updated weights for policy 0, policy_version 13421 (0.0011) [2024-08-05 23:14:25,254][52649] DAMAGECOUNT value on done: 24294.0 [2024-08-05 23:14:25,256][52649] Sum rewards: 8.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.515', 'AMMO5': '0.010', 'ARMOR': '0.052', 'AMMO2': '0.054', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.269', 'weapon2': '0.580', 'WEAPON4': '0.600', 'weapon4': '0.686', 'HITCOUNT': '1.060', 'WEAPON3': '1.250', 'weapon3': '1.928', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '11.000'} [2024-08-05 23:14:25,324][52659] DAMAGECOUNT value on done: 23588.0 [2024-08-05 23:14:25,324][52659] Sum rewards: 25.230, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.561', 'AMMO2': '0.016', 'AMMO3': '0.072', 'weapon4': '0.078', 'AMMO4': '0.079', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'ARMOR': '1.340', 'weapon3': '1.390', 'HITCOUNT': '1.660', 'weapon2': '1.776', 'DAMAGECOUNT': '5.880', 'FRAGCOUNT': '18.000'} [2024-08-05 23:14:26,403][52671] DAMAGECOUNT value on done: 26350.0 [2024-08-05 23:14:26,403][52671] Sum rewards: 20.267, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.566', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'WEAPON3': '0.800', 'ARMOR': '0.863', 'HITCOUNT': '1.340', 'weapon2': '1.690', 'weapon3': '1.806', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '17.000'} [2024-08-05 23:14:27,283][52820] DAMAGECOUNT value on done: 25289.0 [2024-08-05 23:14:27,284][52820] Sum rewards: 22.563, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.739', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.145', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '1.810', 'weapon3': '1.810', 'weapon2': '1.980', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '19.000'} [2024-08-05 23:14:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16793.6, 300 sec: 16467.3). Total num frames: 109985792. Throughput: 0: 4203.8. Samples: 27505680. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:14:27,794][52567] Avg episode reward: [(0, '19.707')] [2024-08-05 23:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013426_109985792.pth... [2024-08-05 23:14:27,942][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000012938_105988096.pth [2024-08-05 23:14:28,306][52659] DAMAGECOUNT value on done: 24492.0 [2024-08-05 23:14:28,306][52659] Sum rewards: 15.315, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.325', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon4': '0.054', 'weapon5': '0.054', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'HITCOUNT': '0.960', 'weapon3': '1.372', 'weapon2': '1.710', 'DAMAGECOUNT': '3.345', 'FRAGCOUNT': '13.000'} [2024-08-05 23:14:28,828][52649] DAMAGECOUNT value on done: 24571.0 [2024-08-05 23:14:28,830][52649] Sum rewards: 7.654, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.770', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO3': '0.077', 'AMMO4': '0.151', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'weapon4': '0.470', 'WEAPON3': '0.550', 'HITCOUNT': '0.690', 'weapon2': '0.754', 'weapon3': '1.444', 'DAMAGECOUNT': '2.637', 'FRAGCOUNT': '5.000'} [2024-08-05 23:14:29,562][52671] DAMAGECOUNT value on done: 29110.0 [2024-08-05 23:14:29,563][52671] Sum rewards: 29.873, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.310', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO3': '0.105', 'WEAPON3': '0.800', 'ARMOR': '0.905', 'weapon2': '1.668', 'HITCOUNT': '1.970', 'weapon3': '2.064', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '23.000'} [2024-08-05 23:14:29,926][52650] Updated weights for policy 0, policy_version 13431 (0.0029) [2024-08-05 23:14:30,379][52647] DAMAGECOUNT value on done: 27469.0 [2024-08-05 23:14:30,379][52647] Sum rewards: 20.821, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.819', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.426', 'WEAPON3': '0.550', 'ARMOR': '0.941', 'weapon2': '1.398', 'weapon3': '1.498', 'HITCOUNT': '1.550', 'DAMAGECOUNT': '5.112', 'FRAGCOUNT': '15.000'} [2024-08-05 23:14:30,575][52820] DAMAGECOUNT value on done: 22581.0 [2024-08-05 23:14:30,576][52820] Sum rewards: 14.033, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.713', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.036', 'weapon4': '0.070', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'WEAPON3': '0.900', 'ARMOR': '0.935', 'HITCOUNT': '1.290', 'weapon3': '1.756', 'weapon2': '1.890', 'DAMAGECOUNT': '4.626', 'FRAGCOUNT': '12.500'} [2024-08-05 23:14:31,449][52659] DAMAGECOUNT value on done: 28067.0 [2024-08-05 23:14:31,450][52659] Sum rewards: 18.729, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.142', 'AMMO5': '0.020', 'weapon5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.107', 'AMMO4': '0.204', 'WEAPON5': '0.400', 'ARMOR': '0.430', 'WEAPON4': '0.500', 'weapon4': '0.662', 'weapon2': '0.738', 'WEAPON3': '0.750', 'HITCOUNT': '1.420', 'weapon3': '2.080', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '15.500'} [2024-08-05 23:14:31,969][52649] DAMAGECOUNT value on done: 25755.0 [2024-08-05 23:14:31,969][52649] Sum rewards: 19.930, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.396', 'ARMOR': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.150', 'HITCOUNT': '1.560', 'weapon3': '1.834', 'DAMAGECOUNT': '5.229', 'FRAGCOUNT': '19.000'} [2024-08-05 23:14:32,560][52671] DAMAGECOUNT value on done: 24854.0 [2024-08-05 23:14:32,561][52671] Sum rewards: 24.356, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.670', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.075', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon3': '1.546', 'HITCOUNT': '1.680', 'weapon2': '1.700', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '18.000'} [2024-08-05 23:14:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 16793.6, 300 sec: 16550.6). Total num frames: 110075904. Throughput: 0: 4197.8. Samples: 27517950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:14:32,795][52567] Avg episode reward: [(0, '19.819')] [2024-08-05 23:14:32,983][52647] DAMAGECOUNT value on done: 26926.0 [2024-08-05 23:14:32,983][52647] Sum rewards: 27.039, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.341', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO3': '0.070', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon4': '0.528', 'weapon2': '1.104', 'weapon3': '1.528', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '6.666', 'FRAGCOUNT': '20.000'} [2024-08-05 23:14:33,882][52820] DAMAGECOUNT value on done: 25740.0 [2024-08-05 23:14:33,884][52820] Sum rewards: 21.152, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.126', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon4': '0.212', 'ARMOR': '0.485', 'WEAPON3': '0.800', 'weapon2': '1.268', 'HITCOUNT': '1.580', 'weapon3': '1.970', 'DAMAGECOUNT': '5.877', 'FRAGCOUNT': '16.500'} [2024-08-05 23:14:34,485][52659] DAMAGECOUNT value on done: 25685.0 [2024-08-05 23:14:34,485][52659] Sum rewards: 24.423, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.101', 'weapon4': '0.212', 'WEAPON4': '0.350', 'ARMOR': '0.465', 'WEAPON3': '0.750', 'weapon2': '1.468', 'HITCOUNT': '1.580', 'weapon3': '1.728', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '21.000'} [2024-08-05 23:14:34,807][52650] Updated weights for policy 0, policy_version 13441 (0.0019) [2024-08-05 23:14:35,183][52649] DAMAGECOUNT value on done: 24899.0 [2024-08-05 23:14:35,183][52649] Sum rewards: 9.824, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.068', 'AMMO3': '0.089', 'WEAPON4': '0.200', 'weapon4': '0.542', 'WEAPON3': '0.650', 'ARMOR': '0.986', 'HITCOUNT': '1.000', 'weapon2': '1.172', 'weapon3': '1.710', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '5.500'} [2024-08-05 23:14:35,424][52671] DAMAGECOUNT value on done: 22551.0 [2024-08-05 23:14:35,425][52671] Sum rewards: 17.945, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.029', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.093', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.480', 'weapon3': '1.720', 'weapon2': '1.922', 'DAMAGECOUNT': '5.112', 'FRAGCOUNT': '12.500'} [2024-08-05 23:14:36,063][52647] DAMAGECOUNT value on done: 29493.0 [2024-08-05 23:14:36,063][52647] Sum rewards: 20.756, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.726', 'AMMO5': '0.004', 'weapon5': '0.028', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.145', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'weapon2': '1.482', 'HITCOUNT': '1.520', 'weapon3': '1.794', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:37,289][52820] DAMAGECOUNT value on done: 26177.0 [2024-08-05 23:14:37,289][52820] Sum rewards: 16.652, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.434', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.048', 'AMMO3': '0.080', 'WEAPON5': '0.100', 'ARMOR': '0.490', 'WEAPON3': '0.600', 'HITCOUNT': '1.230', 'weapon3': '1.624', 'weapon2': '1.896', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '12.000'} [2024-08-05 23:14:37,366][52659] DAMAGECOUNT value on done: 26274.0 [2024-08-05 23:14:37,367][52659] Sum rewards: 14.096, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.740', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.071', 'weapon5': '0.092', 'AMMO3': '0.133', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.502', 'weapon4': '0.518', 'WEAPON3': '1.000', 'weapon2': '1.124', 'HITCOUNT': '1.240', 'weapon3': '1.834', 'DAMAGECOUNT': '5.190', 'FRAGCOUNT': '12.500'} [2024-08-05 23:14:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16793.7, 300 sec: 16550.6). Total num frames: 110157824. Throughput: 0: 4199.6. Samples: 27543250. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:14:37,794][52567] Avg episode reward: [(0, '19.667')] [2024-08-05 23:14:37,985][52649] DAMAGECOUNT value on done: 27909.0 [2024-08-05 23:14:37,988][52649] Sum rewards: 18.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.116', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.026', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.360', 'HITCOUNT': '1.630', 'weapon3': '2.144', 'DAMAGECOUNT': '5.883', 'FRAGCOUNT': '17.000'} [2024-08-05 23:14:38,394][52671] DAMAGECOUNT value on done: 26914.0 [2024-08-05 23:14:38,395][52671] Sum rewards: 27.779, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.860', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'weapon5': '0.104', 'weapon4': '0.206', 'WEAPON3': '0.650', 'weapon2': '1.296', 'weapon3': '1.854', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '6.747', 'FRAGCOUNT': '21.000'} [2024-08-05 23:14:38,984][52647] DAMAGECOUNT value on done: 25975.0 [2024-08-05 23:14:38,985][52647] Sum rewards: 22.498, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.659', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'weapon4': '0.260', 'ARMOR': '0.854', 'WEAPON3': '0.950', 'weapon2': '1.132', 'weapon3': '1.604', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '6.237', 'FRAGCOUNT': '19.000'} [2024-08-05 23:14:39,509][52650] Updated weights for policy 0, policy_version 13451 (0.0023) [2024-08-05 23:14:39,982][52659] DAMAGECOUNT value on done: 24322.0 [2024-08-05 23:14:39,982][52659] Sum rewards: 27.989, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.464', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'weapon4': '0.378', 'WEAPON3': '0.750', 'ARMOR': '0.849', 'weapon2': '1.072', 'HITCOUNT': '1.640', 'weapon3': '1.996', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '22.000'} [2024-08-05 23:14:40,467][52820] DAMAGECOUNT value on done: 24616.0 [2024-08-05 23:14:40,467][52820] Sum rewards: 21.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.540', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '1.232', 'WEAPON3': '1.400', 'HITCOUNT': '1.820', 'ARMOR': '1.901', 'weapon3': '2.508', 'DAMAGECOUNT': '6.954', 'FRAGCOUNT': '22.000'} [2024-08-05 23:14:40,899][52671] DAMAGECOUNT value on done: 27079.0 [2024-08-05 23:14:40,901][52671] Sum rewards: 21.729, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.468', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.110', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'ARMOR': '0.489', 'WEAPON3': '0.800', 'weapon2': '1.288', 'HITCOUNT': '1.580', 'weapon3': '2.168', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '17.000'} [2024-08-05 23:14:41,056][52649] DAMAGECOUNT value on done: 24945.0 [2024-08-05 23:14:41,057][52649] Sum rewards: 13.714, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.110', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO3': '0.144', 'ARMOR': '0.449', 'WEAPON3': '1.000', 'HITCOUNT': '1.290', 'weapon2': '1.656', 'weapon3': '1.870', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:42,268][52647] DAMAGECOUNT value on done: 27237.0 [2024-08-05 23:14:42,268][52647] Sum rewards: 14.202, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.889', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.109', 'weapon4': '0.130', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '1.130', 'weapon3': '1.636', 'weapon2': '1.868', 'DAMAGECOUNT': '3.915', 'FRAGCOUNT': '12.000'} [2024-08-05 23:14:42,794][52567] Fps is (10 sec: 16383.9, 60 sec: 16793.6, 300 sec: 16578.4). Total num frames: 110239744. Throughput: 0: 4203.5. Samples: 27568590. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:14:42,787][52659] DAMAGECOUNT value on done: 24320.0 [2024-08-05 23:14:42,798][52567] Avg episode reward: [(0, '19.821')] [2024-08-05 23:14:42,798][52659] Sum rewards: 14.388, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.130', 'AMMO4': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '0.750', 'HITCOUNT': '0.920', 'weapon2': '1.168', 'ARMOR': '1.374', 'weapon3': '1.900', 'DAMAGECOUNT': '3.912', 'FRAGCOUNT': '12.000'} [2024-08-05 23:14:43,765][52649] DAMAGECOUNT value on done: 23768.0 [2024-08-05 23:14:43,766][52649] Sum rewards: 20.990, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.676', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.114', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.464', 'weapon4': '0.532', 'WEAPON3': '0.800', 'weapon2': '0.842', 'HITCOUNT': '1.540', 'weapon3': '2.094', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:43,856][52671] DAMAGECOUNT value on done: 26920.0 [2024-08-05 23:14:43,857][52671] Sum rewards: 20.917, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.241', 'AMMO4': '-0.038', 'AMMO2': '-0.008', 'weapon4': '0.018', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'ARMOR': '1.065', 'HITCOUNT': '1.230', 'weapon2': '1.496', 'weapon3': '1.498', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '17.000'} [2024-08-05 23:14:44,495][52650] Updated weights for policy 0, policy_version 13461 (0.0035) [2024-08-05 23:14:44,886][52647] DAMAGECOUNT value on done: 27016.0 [2024-08-05 23:14:44,886][52647] Sum rewards: 15.819, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.260', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.172', 'ARMOR': '0.452', 'WEAPON3': '1.000', 'HITCOUNT': '1.590', 'weapon2': '1.602', 'weapon3': '1.960', 'DAMAGECOUNT': '5.784', 'FRAGCOUNT': '13.000'} [2024-08-05 23:14:46,096][52659] DAMAGECOUNT value on done: 26187.0 [2024-08-05 23:14:46,096][52659] Sum rewards: 18.929, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.325', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.069', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.126', 'ARMOR': '0.444', 'WEAPON3': '0.500', 'HITCOUNT': '1.260', 'weapon3': '1.494', 'weapon2': '1.586', 'DAMAGECOUNT': '3.939', 'FRAGCOUNT': '14.000'} [2024-08-05 23:14:46,880][52649] DAMAGECOUNT value on done: 26916.0 [2024-08-05 23:14:46,880][52649] Sum rewards: 18.531, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.288', 'ARMOR': '0.440', 'WEAPON3': '0.950', 'weapon2': '1.132', 'HITCOUNT': '1.620', 'weapon3': '1.984', 'DAMAGECOUNT': '5.748', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:47,000][52671] DAMAGECOUNT value on done: 25172.0 [2024-08-05 23:14:47,001][52671] Sum rewards: 33.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.062', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.103', 'weapon5': '0.108', 'AMMO4': '0.142', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON3': '0.700', 'weapon4': '0.946', 'weapon3': '1.706', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '7.839', 'FRAGCOUNT': '26.000'} [2024-08-05 23:14:47,314][52647] DAMAGECOUNT value on done: 26433.0 [2024-08-05 23:14:47,326][52647] Sum rewards: 19.513, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.889', 'weapon2': '1.136', 'HITCOUNT': '1.320', 'weapon3': '1.696', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 16633.9). Total num frames: 110329856. Throughput: 0: 4196.5. Samples: 27580870. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:14:47,794][52567] Avg episode reward: [(0, '19.840')] [2024-08-05 23:14:49,363][52659] DAMAGECOUNT value on done: 28466.0 [2024-08-05 23:14:49,364][52659] Sum rewards: 28.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.958', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.168', 'ARMOR': '0.416', 'WEAPON3': '1.000', 'weapon2': '1.186', 'HITCOUNT': '1.970', 'weapon3': '2.340', 'DAMAGECOUNT': '7.974', 'FRAGCOUNT': '23.000'} [2024-08-05 23:14:49,500][52650] Updated weights for policy 0, policy_version 13471 (0.0024) [2024-08-05 23:14:49,982][52649] DAMAGECOUNT value on done: 23094.0 [2024-08-05 23:14:49,982][52649] Sum rewards: 24.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'weapon5': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.592', 'WEAPON3': '0.800', 'ARMOR': '0.914', 'weapon2': '1.000', 'weapon3': '1.456', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '21.000'} [2024-08-05 23:14:50,044][52671] DAMAGECOUNT value on done: 26143.0 [2024-08-05 23:14:50,044][52671] Sum rewards: 10.157, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.228', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.083', 'WEAPON3': '0.550', 'HITCOUNT': '0.970', 'weapon3': '1.234', 'ARMOR': '1.339', 'weapon2': '2.054', 'DAMAGECOUNT': '3.141', 'FRAGCOUNT': '7.000'} [2024-08-05 23:14:50,298][52647] DAMAGECOUNT value on done: 28767.0 [2024-08-05 23:14:50,305][52647] Sum rewards: 22.116, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.470', 'AMMO2': '0.029', 'AMMO3': '0.085', 'AMMO4': '0.147', 'WEAPON4': '0.300', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'weapon4': '0.782', 'weapon2': '1.222', 'weapon3': '1.698', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '6.249', 'FRAGCOUNT': '16.000'} [2024-08-05 23:14:52,224][52659] DAMAGECOUNT value on done: 25079.0 [2024-08-05 23:14:52,224][52659] Sum rewards: 21.489, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.074', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.300', 'weapon4': '0.448', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'weapon2': '0.948', 'HITCOUNT': '1.480', 'weapon3': '1.582', 'DAMAGECOUNT': '5.799', 'FRAGCOUNT': '15.000'} [2024-08-05 23:14:52,687][52649] DAMAGECOUNT value on done: 26342.0 [2024-08-05 23:14:52,688][52649] Sum rewards: 17.377, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.979', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO3': '0.097', 'AMMO4': '0.098', 'weapon4': '0.098', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.420', 'WEAPON3': '0.650', 'weapon2': '1.536', 'HITCOUNT': '1.660', 'weapon3': '1.820', 'DAMAGECOUNT': '5.841', 'FRAGCOUNT': '13.000'} [2024-08-05 23:14:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 16657.1, 300 sec: 16661.7). Total num frames: 110403584. Throughput: 0: 4200.2. Samples: 27606180. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:14:52,795][52567] Avg episode reward: [(0, '19.890')] [2024-08-05 23:14:53,480][52647] DAMAGECOUNT value on done: 28519.0 [2024-08-05 23:14:53,480][52647] Sum rewards: 6.836, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.628', 'AMMO2': '0.042', 'AMMO3': '0.166', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'weapon4': '0.446', 'ARMOR': '0.485', 'weapon2': '0.628', 'WEAPON3': '1.100', 'HITCOUNT': '1.100', 'weapon3': '2.068', 'DAMAGECOUNT': '3.570', 'FRAGCOUNT': '8.000'} [2024-08-05 23:14:54,409][52650] Updated weights for policy 0, policy_version 13481 (0.0028) [2024-08-05 23:14:57,795][52567] Fps is (10 sec: 10649.0, 60 sec: 15837.7, 300 sec: 16495.1). Total num frames: 110436352. Throughput: 0: 3841.3. Samples: 27615190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:14:57,796][52567] Avg episode reward: [(0, '19.744')] [2024-08-05 23:15:00,735][52794] DAMAGECOUNT value on done: 30579.0 [2024-08-05 23:15:00,736][52794] Sum rewards: 22.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.914', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.080', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'weapon2': '1.508', 'HITCOUNT': '1.870', 'weapon3': '1.978', 'DAMAGECOUNT': '6.711', 'FRAGCOUNT': '19.000'} [2024-08-05 23:15:00,824][52659] DAMAGECOUNT value on done: 25839.0 [2024-08-05 23:15:00,825][52659] Sum rewards: 16.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.668', 'AMMO2': '0.021', 'weapon4': '0.072', 'AMMO4': '0.104', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'ARMOR': '0.464', 'WEAPON3': '0.750', 'HITCOUNT': '1.380', 'weapon3': '1.612', 'weapon2': '1.944', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:01,128][52649] DAMAGECOUNT value on done: 26771.0 [2024-08-05 23:15:01,129][52649] Sum rewards: 21.886, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.389', 'AMMO5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.044', 'weapon5': '0.062', 'AMMO4': '0.065', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.850', 'weapon2': '1.274', 'HITCOUNT': '1.560', 'weapon3': '1.716', 'DAMAGECOUNT': '5.730', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:02,473][52647] DAMAGECOUNT value on done: 27652.0 [2024-08-05 23:15:02,475][52647] Sum rewards: 27.216, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.428', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.056', 'AMMO3': '0.098', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '0.750', 'ARMOR': '0.941', 'weapon2': '1.106', 'HITCOUNT': '1.880', 'weapon3': '2.014', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:02,571][52662] DAMAGECOUNT value on done: 30884.0 [2024-08-05 23:15:02,571][52662] Sum rewards: 22.130, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.614', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO3': '0.091', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.527', 'WEAPON3': '0.650', 'HITCOUNT': '1.410', 'weapon2': '1.554', 'weapon3': '1.692', 'DAMAGECOUNT': '5.049', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:02,794][52567] Fps is (10 sec: 6553.7, 60 sec: 15018.7, 300 sec: 16328.5). Total num frames: 110469120. Throughput: 0: 3643.6. Samples: 27618960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:15:02,794][52567] Avg episode reward: [(0, '19.904')] [2024-08-05 23:15:03,219][52794] DAMAGECOUNT value on done: 30322.0 [2024-08-05 23:15:03,219][52794] Sum rewards: 13.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.162', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.227', 'WEAPON4': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.650', 'ARMOR': '0.894', 'weapon2': '1.280', 'HITCOUNT': '1.430', 'weapon3': '1.808', 'DAMAGECOUNT': '4.692', 'FRAGCOUNT': '11.000'} [2024-08-05 23:15:03,731][52659] DAMAGECOUNT value on done: 25287.0 [2024-08-05 23:15:03,733][52659] Sum rewards: 11.374, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.650', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON3': '1.050', 'HITCOUNT': '1.200', 'weapon2': '1.358', 'weapon3': '1.918', 'DAMAGECOUNT': '4.398', 'FRAGCOUNT': '11.000'} [2024-08-05 23:15:04,190][52649] DAMAGECOUNT value on done: 27261.0 [2024-08-05 23:15:04,192][52649] Sum rewards: 18.980, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.192', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.030', 'AMMO3': '0.144', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.616', 'weapon2': '0.742', 'ARMOR': '0.861', 'WEAPON3': '0.900', 'HITCOUNT': '1.590', 'weapon3': '2.056', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:05,046][52650] Updated weights for policy 0, policy_version 13491 (0.0024) [2024-08-05 23:15:05,114][52662] DAMAGECOUNT value on done: 31774.0 [2024-08-05 23:15:05,117][52662] Sum rewards: 20.946, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.555', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'weapon5': '0.006', 'AMMO5': '0.009', 'AMMO3': '0.060', 'WEAPON5': '0.200', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'HITCOUNT': '1.470', 'weapon3': '1.512', 'weapon2': '2.048', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '14.500'} [2024-08-05 23:15:05,263][52647] DAMAGECOUNT value on done: 27499.0 [2024-08-05 23:15:05,263][52647] Sum rewards: 24.097, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.020', 'weapon5': '0.034', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'weapon4': '0.152', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.520', 'HITCOUNT': '1.660', 'weapon3': '1.986', 'DAMAGECOUNT': '5.958', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:05,774][52794] DAMAGECOUNT value on done: 30871.0 [2024-08-05 23:15:05,784][52794] Sum rewards: 28.400, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.064', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.858', 'weapon2': '1.630', 'weapon3': '2.050', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '7.431', 'FRAGCOUNT': '21.000'} [2024-08-05 23:15:06,907][52659] DAMAGECOUNT value on done: 27589.0 [2024-08-05 23:15:06,908][52659] Sum rewards: 24.254, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.306', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.089', 'WEAPON3': '0.600', 'ARMOR': '0.857', 'HITCOUNT': '1.500', 'weapon2': '1.600', 'weapon3': '1.668', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:07,794][52567] Fps is (10 sec: 12288.7, 60 sec: 15155.2, 300 sec: 16356.3). Total num frames: 110559232. Throughput: 0: 3629.8. Samples: 27643640. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 23:15:07,794][52567] Avg episode reward: [(0, '19.948')] [2024-08-05 23:15:07,895][52668] DAMAGECOUNT value on done: 25449.0 [2024-08-05 23:15:07,896][52668] Sum rewards: 16.766, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.815', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon5': '0.140', 'weapon4': '0.166', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.300', 'weapon2': '1.560', 'weapon3': '1.672', 'DAMAGECOUNT': '4.917', 'FRAGCOUNT': '14.000'} [2024-08-05 23:15:07,925][52662] DAMAGECOUNT value on done: 33127.0 [2024-08-05 23:15:07,926][52662] Sum rewards: 18.630, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.625', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.074', 'weapon5': '0.186', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'WEAPON4': '0.500', 'WEAPON3': '0.550', 'weapon4': '0.696', 'weapon2': '1.026', 'HITCOUNT': '1.190', 'weapon3': '1.628', 'DAMAGECOUNT': '4.815', 'FRAGCOUNT': '14.000'} [2024-08-05 23:15:08,323][52647] DAMAGECOUNT value on done: 25304.0 [2024-08-05 23:15:08,323][52647] Sum rewards: 23.507, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.101', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.096', 'WEAPON3': '0.750', 'HITCOUNT': '1.710', 'weapon2': '1.724', 'weapon3': '1.826', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '19.000'} [2024-08-05 23:15:08,483][52794] DAMAGECOUNT value on done: 28625.0 [2024-08-05 23:15:08,486][52794] Sum rewards: 19.751, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.861', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.548', 'WEAPON3': '0.700', 'weapon2': '1.118', 'ARMOR': '1.333', 'HITCOUNT': '1.530', 'weapon3': '1.876', 'DAMAGECOUNT': '4.983', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:09,953][52650] Updated weights for policy 0, policy_version 13501 (0.0029) [2024-08-05 23:15:10,317][52662] DAMAGECOUNT value on done: 29766.0 [2024-08-05 23:15:10,320][52662] Sum rewards: 36.578, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.759', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon4': '0.170', 'WEAPON3': '0.850', 'ARMOR': '1.341', 'weapon2': '1.740', 'weapon3': '1.798', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.721', 'FRAGCOUNT': '28.000'} [2024-08-05 23:15:10,887][52794] DAMAGECOUNT value on done: 30989.0 [2024-08-05 23:15:10,889][52794] Sum rewards: 21.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.550', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.102', 'AMMO3': '0.183', 'ARMOR': '0.832', 'WEAPON3': '1.050', 'weapon2': '1.598', 'HITCOUNT': '1.620', 'weapon3': '1.898', 'DAMAGECOUNT': '5.805', 'FRAGCOUNT': '19.000'} [2024-08-05 23:15:11,056][52647] DAMAGECOUNT value on done: 26748.0 [2024-08-05 23:15:11,056][52647] Sum rewards: 20.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.384', 'AMMO2': '0.005', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.023', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON3': '0.800', 'ARMOR': '0.816', 'weapon2': '1.732', 'weapon3': '1.814', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '6.846', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:11,195][52668] DAMAGECOUNT value on done: 28199.0 [2024-08-05 23:15:11,195][52668] Sum rewards: 21.475, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.185', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.094', 'weapon4': '0.224', 'ARMOR': '0.416', 'WEAPON3': '0.600', 'HITCOUNT': '1.630', 'weapon2': '1.714', 'weapon3': '1.882', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 15018.7, 300 sec: 16328.5). Total num frames: 110641152. Throughput: 0: 3629.1. Samples: 27668990. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 23:15:12,794][52567] Avg episode reward: [(0, '20.314')] [2024-08-05 23:15:12,908][52662] DAMAGECOUNT value on done: 29134.0 [2024-08-05 23:15:12,909][52662] Sum rewards: 23.009, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.042', 'AMMO4': '-0.046', 'AMMO2': '-0.009', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.202', 'WEAPON3': '0.950', 'weapon2': '1.546', 'HITCOUNT': '1.750', 'ARMOR': '1.845', 'weapon3': '1.930', 'DAMAGECOUNT': '6.105', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:13,488][52794] DAMAGECOUNT value on done: 31369.0 [2024-08-05 23:15:13,488][52794] Sum rewards: 20.633, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.632', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.034', 'AMMO4': '0.060', 'AMMO3': '0.070', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'ARMOR': '0.875', 'weapon3': '1.470', 'HITCOUNT': '1.550', 'weapon2': '1.838', 'DAMAGECOUNT': '5.526', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:13,961][52647] DAMAGECOUNT value on done: 26272.0 [2024-08-05 23:15:13,962][52647] Sum rewards: 19.332, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.630', 'AMMO4': '-0.066', 'AMMO2': '-0.013', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'ARMOR': '0.910', 'WEAPON3': '0.950', 'weapon2': '1.508', 'HITCOUNT': '1.710', 'weapon3': '1.910', 'DAMAGECOUNT': '6.276', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:14,558][52668] DAMAGECOUNT value on done: 24701.0 [2024-08-05 23:15:14,562][52668] Sum rewards: 24.864, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.951', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.300', 'ARMOR': '0.610', 'weapon4': '0.648', 'WEAPON3': '0.700', 'weapon2': '0.770', 'HITCOUNT': '1.370', 'weapon3': '2.024', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:14,674][52803] DAMAGECOUNT value on done: 25734.0 [2024-08-05 23:15:14,674][52803] Sum rewards: 26.275, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.272', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon5': '0.130', 'weapon4': '0.226', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.420', 'weapon3': '1.614', 'HITCOUNT': '1.620', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:14,857][52650] Updated weights for policy 0, policy_version 13511 (0.0026) [2024-08-05 23:15:15,252][52662] DAMAGECOUNT value on done: 31333.0 [2024-08-05 23:15:15,253][52662] Sum rewards: 23.016, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.842', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'ARMOR': '1.304', 'weapon2': '1.622', 'HITCOUNT': '1.640', 'weapon3': '1.736', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:15,955][52794] DAMAGECOUNT value on done: 31532.0 [2024-08-05 23:15:15,965][52794] Sum rewards: 19.730, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.328', 'weapon4': '0.002', 'AMMO2': '0.013', 'ARMOR': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.106', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon2': '1.474', 'weapon3': '2.040', 'DAMAGECOUNT': '5.097', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:17,456][52660] DAMAGECOUNT value on done: 27237.0 [2024-08-05 23:15:17,458][52660] Sum rewards: 22.220, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.553', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.125', 'WEAPON4': '0.250', 'weapon4': '0.334', 'ARMOR': '0.454', 'WEAPON3': '0.750', 'weapon2': '1.126', 'HITCOUNT': '1.690', 'weapon3': '2.064', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:17,554][52647] DAMAGECOUNT value on done: 29011.0 [2024-08-05 23:15:17,554][52647] Sum rewards: 23.795, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.450', 'weapon4': '0.458', 'ARMOR': '0.490', 'WEAPON3': '0.750', 'weapon2': '1.150', 'weapon3': '1.552', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '5.925', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:17,735][52662] DAMAGECOUNT value on done: 32677.0 [2024-08-05 23:15:17,736][52662] Sum rewards: 18.151, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.220', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.352', 'WEAPON3': '0.750', 'ARMOR': '0.911', 'HITCOUNT': '1.340', 'weapon2': '1.430', 'weapon3': '1.606', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '14.000'} [2024-08-05 23:15:17,770][52668] DAMAGECOUNT value on done: 26765.0 [2024-08-05 23:15:17,774][52668] Sum rewards: 21.518, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.401', 'weapon7': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.138', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.280', 'WEAPON4': '0.300', 'ARMOR': '0.464', 'WEAPON3': '0.900', 'weapon2': '1.338', 'HITCOUNT': '1.580', 'weapon3': '1.902', 'DAMAGECOUNT': '5.514', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 15155.2, 300 sec: 16328.5). Total num frames: 110723072. Throughput: 0: 3635.1. Samples: 27681530. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:15:17,794][52567] Avg episode reward: [(0, '20.482')] [2024-08-05 23:15:17,933][52803] DAMAGECOUNT value on done: 27703.0 [2024-08-05 23:15:17,935][52803] Sum rewards: 25.982, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.270', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.288', 'WEAPON3': '0.800', 'weapon2': '0.932', 'HITCOUNT': '1.790', 'weapon3': '2.382', 'DAMAGECOUNT': '6.798', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:18,493][52794] DAMAGECOUNT value on done: 26738.0 [2024-08-05 23:15:18,494][52794] Sum rewards: 15.108, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.288', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO3': '0.097', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON3': '0.800', 'ARMOR': '0.838', 'HITCOUNT': '1.260', 'weapon2': '1.532', 'weapon3': '1.808', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '11.500'} [2024-08-05 23:15:19,742][52650] Updated weights for policy 0, policy_version 13521 (0.0013) [2024-08-05 23:15:20,163][52662] DAMAGECOUNT value on done: 33405.0 [2024-08-05 23:15:20,165][52662] Sum rewards: 22.132, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.098', 'weapon5': '0.114', 'AMMO3': '0.119', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.256', 'ARMOR': '0.540', 'WEAPON3': '0.700', 'HITCOUNT': '1.340', 'weapon3': '1.780', 'weapon2': '1.866', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '16.500'} [2024-08-05 23:15:20,289][52660] DAMAGECOUNT value on done: 27898.0 [2024-08-05 23:15:20,289][52660] Sum rewards: 17.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.026', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'ARMOR': '0.800', 'WEAPON3': '1.350', 'weapon2': '1.796', 'HITCOUNT': '1.830', 'weapon3': '1.992', 'DAMAGECOUNT': '7.428', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:20,481][52647] DAMAGECOUNT value on done: 24766.0 [2024-08-05 23:15:20,481][52647] Sum rewards: 18.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.126', 'weapon4': '0.148', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'HITCOUNT': '1.500', 'weapon2': '1.518', 'ARMOR': '1.848', 'weapon3': '2.132', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:20,592][52811] DAMAGECOUNT value on done: 25303.0 [2024-08-05 23:15:20,592][52811] Sum rewards: 20.883, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.406', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.302', 'WEAPON3': '0.800', 'ARMOR': '1.308', 'weapon3': '1.344', 'weapon2': '1.460', 'HITCOUNT': '1.470', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:20,633][52668] DAMAGECOUNT value on done: 26355.0 [2024-08-05 23:15:20,634][52668] Sum rewards: 30.378, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.008', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.076', 'AMMO3': '0.115', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.426', 'ARMOR': '0.482', 'weapon2': '0.836', 'WEAPON3': '0.850', 'HITCOUNT': '1.940', 'weapon3': '2.378', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '24.000'} [2024-08-05 23:15:20,754][52794] DAMAGECOUNT value on done: 30421.0 [2024-08-05 23:15:20,755][52794] Sum rewards: 22.476, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.421', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon7': '0.056', 'weapon5': '0.068', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.310', 'ARMOR': '0.449', 'WEAPON3': '0.550', 'weapon2': '1.304', 'weapon3': '1.666', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:21,373][52803] DAMAGECOUNT value on done: 23199.0 [2024-08-05 23:15:21,381][52803] Sum rewards: 24.206, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.345', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'weapon5': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'ARMOR': '0.891', 'WEAPON3': '1.000', 'weapon2': '1.680', 'HITCOUNT': '1.750', 'weapon3': '1.828', 'DAMAGECOUNT': '6.477', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:22,458][52662] DAMAGECOUNT value on done: 29607.0 [2024-08-05 23:15:22,459][52662] Sum rewards: 17.186, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.062', 'AMMO3': '0.105', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.994', 'HITCOUNT': '1.270', 'weapon2': '1.628', 'weapon3': '1.824', 'DAMAGECOUNT': '4.320', 'FRAGCOUNT': '13.000'} [2024-08-05 23:15:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 15155.2, 300 sec: 16356.2). Total num frames: 110813184. Throughput: 0: 3631.6. Samples: 27706670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:15:22,794][52567] Avg episode reward: [(0, '20.551')] [2024-08-05 23:15:22,858][52647] DAMAGECOUNT value on done: 27927.0 [2024-08-05 23:15:22,859][52647] Sum rewards: 15.615, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.116', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'weapon2': '1.396', 'HITCOUNT': '1.440', 'weapon3': '1.724', 'DAMAGECOUNT': '5.241', 'FRAGCOUNT': '11.000'} [2024-08-05 23:15:23,367][52794] DAMAGECOUNT value on done: 30569.0 [2024-08-05 23:15:23,368][52794] Sum rewards: 21.124, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO3': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.298', 'WEAPON3': '0.550', 'weapon3': '1.268', 'ARMOR': '1.426', 'HITCOUNT': '1.520', 'weapon2': '1.950', 'DAMAGECOUNT': '5.394', 'FRAGCOUNT': '15.500'} [2024-08-05 23:15:23,445][52811] Large shaping reward 2.578 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon5', 0.002)] [2024-08-05 23:15:23,570][52660] DAMAGECOUNT value on done: 26200.0 [2024-08-05 23:15:23,571][52660] Sum rewards: 26.865, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.049', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.120', 'WEAPON4': '0.300', 'weapon2': '0.510', 'weapon4': '0.714', 'WEAPON3': '0.850', 'HITCOUNT': '1.770', 'weapon3': '2.132', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:24,003][52668] DAMAGECOUNT value on done: 27912.0 [2024-08-05 23:15:24,003][52668] Sum rewards: 14.638, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.185', 'AMMO5': '0.006', 'AMMO2': '0.022', 'AMMO3': '0.075', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.236', 'ARMOR': '0.427', 'WEAPON3': '0.450', 'HITCOUNT': '1.040', 'weapon3': '1.122', 'weapon2': '1.214', 'DAMAGECOUNT': '4.032', 'FRAGCOUNT': '9.500'} [2024-08-05 23:15:24,292][52811] DAMAGECOUNT value on done: 24655.0 [2024-08-05 23:15:24,294][52811] Sum rewards: 22.716, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'weapon4': '0.482', 'WEAPON3': '0.750', 'weapon2': '1.116', 'weapon3': '1.664', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.396', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:24,774][52650] Updated weights for policy 0, policy_version 13531 (0.0021) [2024-08-05 23:15:24,877][52803] DAMAGECOUNT value on done: 24026.0 [2024-08-05 23:15:24,879][52803] Sum rewards: 22.724, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.673', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.073', 'AMMO3': '0.084', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.472', 'WEAPON3': '0.600', 'weapon2': '1.068', 'HITCOUNT': '1.730', 'weapon3': '1.908', 'DAMAGECOUNT': '6.030', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:25,288][52662] DAMAGECOUNT value on done: 30573.0 [2024-08-05 23:15:25,288][52662] Sum rewards: 23.459, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.116', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'HEALTH': '0.286', 'WEAPON3': '0.750', 'weapon2': '1.172', 'ARMOR': '1.200', 'HITCOUNT': '1.490', 'weapon3': '2.522', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:25,422][52647] DAMAGECOUNT value on done: 26411.0 [2024-08-05 23:15:25,423][52647] Sum rewards: 19.763, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.008', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.106', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.238', 'WEAPON3': '0.800', 'ARMOR': '0.928', 'HITCOUNT': '1.460', 'weapon2': '1.490', 'weapon3': '1.828', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:25,951][52794] DAMAGECOUNT value on done: 30968.0 [2024-08-05 23:15:25,952][52794] Sum rewards: 27.768, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.055', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.372', 'ARMOR': '0.452', 'WEAPON3': '0.700', 'weapon2': '1.036', 'HITCOUNT': '1.760', 'weapon3': '1.924', 'DAMAGECOUNT': '6.570', 'FRAGCOUNT': '21.000'} [2024-08-05 23:15:26,360][52660] DAMAGECOUNT value on done: 25701.0 [2024-08-05 23:15:26,363][52660] Sum rewards: 20.119, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.919', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'weapon5': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'ARMOR': '1.308', 'weapon2': '1.516', 'weapon3': '1.614', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '6.255', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:26,687][52668] DAMAGECOUNT value on done: 29067.0 [2024-08-05 23:15:26,687][52668] Sum rewards: 12.111, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.027', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.170', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '1.250', 'weapon2': '1.488', 'weapon3': '1.840', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '11.000'} [2024-08-05 23:15:27,633][52811] DAMAGECOUNT value on done: 26342.0 [2024-08-05 23:15:27,633][52811] Sum rewards: 22.261, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'HITCOUNT': '1.550', 'weapon2': '1.594', 'weapon3': '2.058', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 15155.2, 300 sec: 16356.2). Total num frames: 110895104. Throughput: 0: 3620.0. Samples: 27731490. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:15:27,794][52567] Avg episode reward: [(0, '20.689')] [2024-08-05 23:15:27,939][52647] DAMAGECOUNT value on done: 27791.0 [2024-08-05 23:15:27,940][52647] Sum rewards: 16.887, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.488', 'WEAPON3': '0.600', 'ARMOR': '0.881', 'weapon2': '1.096', 'HITCOUNT': '1.470', 'weapon3': '1.764', 'DAMAGECOUNT': '5.073', 'FRAGCOUNT': '13.000'} [2024-08-05 23:15:27,962][52662] DAMAGECOUNT value on done: 29809.0 [2024-08-05 23:15:27,962][52662] Sum rewards: 20.427, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.287', 'AMMO5': '0.014', 'ARMOR': '0.032', 'AMMO2': '0.038', 'weapon5': '0.060', 'AMMO3': '0.123', 'AMMO4': '0.192', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.406', 'HITCOUNT': '1.550', 'weapon3': '2.022', 'DAMAGECOUNT': '6.570', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:28,162][52803] DAMAGECOUNT value on done: 26519.0 [2024-08-05 23:15:28,162][52803] Sum rewards: 19.766, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.339', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon4': '0.498', 'WEAPON3': '0.800', 'weapon2': '1.242', 'HITCOUNT': '1.740', 'weapon3': '1.866', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:28,660][52794] DAMAGECOUNT value on done: 30779.0 [2024-08-05 23:15:28,661][52794] Sum rewards: 17.504, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.494', 'AMMO5': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.064', 'AMMO4': '0.114', 'AMMO3': '0.114', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.312', 'HITCOUNT': '1.350', 'weapon3': '1.990', 'DAMAGECOUNT': '4.833', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:29,585][52660] DAMAGECOUNT value on done: 22371.0 [2024-08-05 23:15:29,586][52660] Sum rewards: 20.447, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO3': '0.065', 'HEALTH': '0.068', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.360', 'WEAPON3': '0.400', 'ARMOR': '0.433', 'weapon2': '1.072', 'weapon3': '1.176', 'HITCOUNT': '1.290', 'DAMAGECOUNT': '5.088', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:29,803][52650] Updated weights for policy 0, policy_version 13541 (0.0013) [2024-08-05 23:15:29,962][52668] DAMAGECOUNT value on done: 27662.0 [2024-08-05 23:15:29,964][52668] Sum rewards: 16.144, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.511', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.103', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.310', 'weapon2': '1.390', 'weapon3': '1.792', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '13.000'} [2024-08-05 23:15:30,499][52662] DAMAGECOUNT value on done: 29142.0 [2024-08-05 23:15:30,500][52662] Sum rewards: 24.473, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.484', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.081', 'AMMO4': '0.126', 'weapon4': '0.216', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'weapon2': '1.576', 'HITCOUNT': '1.600', 'weapon3': '1.854', 'DAMAGECOUNT': '6.294', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:30,975][52811] DAMAGECOUNT value on done: 24743.0 [2024-08-05 23:15:30,976][52811] Sum rewards: 18.070, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.013', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'weapon5': '0.124', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'ARMOR': '0.404', 'WEAPON3': '0.650', 'HITCOUNT': '1.240', 'weapon2': '1.430', 'weapon3': '1.772', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:30,978][52647] DAMAGECOUNT value on done: 27758.0 [2024-08-05 23:15:30,979][52647] Sum rewards: 18.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.782', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.406', 'WEAPON3': '0.900', 'ARMOR': '0.980', 'weapon2': '1.204', 'HITCOUNT': '1.710', 'weapon3': '2.036', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:31,360][52794] DAMAGECOUNT value on done: 29845.0 [2024-08-05 23:15:31,361][52794] Sum rewards: 27.711, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.025', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.462', 'HITCOUNT': '1.640', 'weapon3': '1.848', 'DAMAGECOUNT': '6.282', 'FRAGCOUNT': '24.000'} [2024-08-05 23:15:31,401][52803] DAMAGECOUNT value on done: 22449.0 [2024-08-05 23:15:31,402][52803] Sum rewards: 19.707, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.561', 'AMMO2': '0.041', 'weapon4': '0.100', 'AMMO3': '0.140', 'AMMO4': '0.203', 'WEAPON4': '0.450', 'ARMOR': '0.476', 'WEAPON3': '0.950', 'weapon2': '1.200', 'HITCOUNT': '1.290', 'weapon3': '2.030', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 15018.7, 300 sec: 16356.2). Total num frames: 110977024. Throughput: 0: 3627.3. Samples: 27744100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:15:32,794][52567] Avg episode reward: [(0, '20.685')] [2024-08-05 23:15:32,889][52662] DAMAGECOUNT value on done: 32473.0 [2024-08-05 23:15:32,890][52662] Sum rewards: 24.677, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.023', 'HEALTH': '0.039', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.112', 'weapon4': '0.248', 'WEAPON3': '0.600', 'ARMOR': '1.276', 'weapon3': '1.464', 'weapon2': '1.526', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '6.252', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:32,904][52660] DAMAGECOUNT value on done: 27836.0 [2024-08-05 23:15:32,905][52660] Sum rewards: 18.633, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.530', 'AMMO5': '0.012', 'ARMOR': '0.016', 'weapon5': '0.022', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO3': '0.103', 'AMMO4': '0.128', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'HITCOUNT': '1.540', 'weapon3': '1.712', 'weapon2': '1.744', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '14.000'} [2024-08-05 23:15:33,236][52668] DAMAGECOUNT value on done: 24021.0 [2024-08-05 23:15:33,240][52668] Sum rewards: 21.305, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.536', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO3': '0.116', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.772', 'ARMOR': '0.960', 'HITCOUNT': '1.290', 'weapon3': '1.838', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:33,693][52794] DAMAGECOUNT value on done: 33569.0 [2024-08-05 23:15:33,694][52794] Sum rewards: 14.837, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.238', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.406', 'ARMOR': '0.558', 'WEAPON3': '0.850', 'HITCOUNT': '1.290', 'weapon2': '1.506', 'weapon3': '1.716', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '13.000'} [2024-08-05 23:15:34,279][52811] DAMAGECOUNT value on done: 24393.0 [2024-08-05 23:15:34,281][52811] Sum rewards: 13.224, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.492', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon4': '0.228', 'WEAPON4': '0.250', 'ARMOR': '0.512', 'HITCOUNT': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.446', 'weapon3': '1.564', 'DAMAGECOUNT': '3.156', 'FRAGCOUNT': '13.000'} [2024-08-05 23:15:34,536][52650] Updated weights for policy 0, policy_version 13551 (0.0033) [2024-08-05 23:15:34,813][52803] DAMAGECOUNT value on done: 28473.0 [2024-08-05 23:15:34,814][52803] Sum rewards: 20.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.379', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON3': '0.900', 'ARMOR': '1.316', 'weapon2': '1.518', 'HITCOUNT': '1.580', 'weapon3': '1.738', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:35,355][52662] DAMAGECOUNT value on done: 30165.0 [2024-08-05 23:15:35,356][52662] Sum rewards: 20.130, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.164', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.524', 'WEAPON3': '0.800', 'weapon2': '1.026', 'ARMOR': '1.322', 'HITCOUNT': '1.750', 'weapon3': '1.800', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:35,964][52794] DAMAGECOUNT value on done: 29086.0 [2024-08-05 23:15:35,965][52794] Sum rewards: 25.247, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.684', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.072', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.200', 'HITCOUNT': '1.470', 'weapon2': '1.544', 'ARMOR': '1.828', 'weapon3': '1.860', 'DAMAGECOUNT': '5.883', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:36,264][52660] DAMAGECOUNT value on done: 24897.0 [2024-08-05 23:15:36,266][52660] Sum rewards: 13.373, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.841', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon7': '0.070', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'ARMOR': '0.108', 'AMMO3': '0.125', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.678', 'HITCOUNT': '0.730', 'WEAPON3': '0.750', 'weapon3': '1.526', 'DAMAGECOUNT': '3.273', 'FRAGCOUNT': '12.000'} [2024-08-05 23:15:36,505][52668] DAMAGECOUNT value on done: 29932.0 [2024-08-05 23:15:36,508][52668] Sum rewards: 24.528, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.156', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.012', 'weapon5': '0.012', 'AMMO3': '0.050', 'weapon7': '0.050', 'AMMO4': '0.051', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.284', 'WEAPON3': '0.350', 'weapon3': '0.980', 'weapon2': '1.202', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '16.500'} [2024-08-05 23:15:37,623][52662] DAMAGECOUNT value on done: 32919.0 [2024-08-05 23:15:37,623][52662] Sum rewards: 24.786, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.018', 'AMMO4': '0.053', 'weapon4': '0.110', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.950', 'HITCOUNT': '1.530', 'weapon2': '1.608', 'ARMOR': '1.804', 'weapon3': '2.060', 'DAMAGECOUNT': '5.634', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:37,662][52811] DAMAGECOUNT value on done: 25455.0 [2024-08-05 23:15:37,666][52811] Sum rewards: 27.982, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.018', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.054', 'AMMO3': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'weapon4': '0.438', 'WEAPON3': '0.550', 'weapon2': '0.994', 'weapon3': '1.384', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.729', 'FRAGCOUNT': '21.000'} [2024-08-05 23:15:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 15018.7, 300 sec: 16384.0). Total num frames: 111058944. Throughput: 0: 3624.0. Samples: 27769260. Policy #0 lag: (min: 1.0, avg: 3.6, max: 9.0) [2024-08-05 23:15:37,802][52567] Avg episode reward: [(0, '20.817')] [2024-08-05 23:15:37,982][52803] DAMAGECOUNT value on done: 24516.0 [2024-08-05 23:15:37,983][52803] Sum rewards: 27.296, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.172', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'weapon4': '0.214', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.436', 'HITCOUNT': '1.520', 'weapon3': '1.654', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:38,426][52794] DAMAGECOUNT value on done: 30818.0 [2024-08-05 23:15:38,427][52794] Sum rewards: 24.279, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.585', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.088', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.898', 'WEAPON3': '1.050', 'weapon2': '1.266', 'HITCOUNT': '1.480', 'weapon3': '2.202', 'DAMAGECOUNT': '6.135', 'FRAGCOUNT': '21.000'} [2024-08-05 23:15:39,321][52660] DAMAGECOUNT value on done: 26219.0 [2024-08-05 23:15:39,323][52660] Sum rewards: 20.338, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon5': '0.088', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.644', 'WEAPON3': '0.750', 'weapon2': '0.880', 'HITCOUNT': '1.240', 'weapon3': '1.778', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:39,408][52650] Updated weights for policy 0, policy_version 13561 (0.0032) [2024-08-05 23:15:39,581][52668] DAMAGECOUNT value on done: 24881.0 [2024-08-05 23:15:39,582][52668] Sum rewards: 21.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.886', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.036', 'AMMO3': '0.141', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'weapon2': '1.504', 'HITCOUNT': '1.660', 'weapon3': '2.162', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:40,470][52662] DAMAGECOUNT value on done: 32860.0 [2024-08-05 23:15:40,470][52662] Sum rewards: 13.850, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.516', 'AMMO5': '0.009', 'weapon4': '0.016', 'weapon5': '0.018', 'AMMO2': '0.029', 'weapon7': '0.056', 'AMMO3': '0.091', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.880', 'HITCOUNT': '1.040', 'weapon3': '1.286', 'weapon2': '1.494', 'DAMAGECOUNT': '3.750', 'FRAGCOUNT': '11.000'} [2024-08-05 23:15:40,940][52811] DAMAGECOUNT value on done: 27111.0 [2024-08-05 23:15:40,941][52811] Sum rewards: 32.031, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.302', 'AMMO4': '-0.043', 'AMMO2': '-0.009', 'AMMO3': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.248', 'WEAPON3': '0.700', 'ARMOR': '1.303', 'weapon2': '1.674', 'weapon3': '1.772', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '7.677', 'FRAGCOUNT': '23.000'} [2024-08-05 23:15:41,076][52803] DAMAGECOUNT value on done: 25906.0 [2024-08-05 23:15:41,076][52803] Sum rewards: 29.471, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.826', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.042', 'weapon5': '0.056', 'ARMOR': '0.064', 'AMMO3': '0.086', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.480', 'WEAPON3': '0.750', 'weapon2': '0.854', 'weapon3': '1.808', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '6.819', 'FRAGCOUNT': '24.000'} [2024-08-05 23:15:41,216][52794] DAMAGECOUNT value on done: 31662.0 [2024-08-05 23:15:41,216][52794] Sum rewards: 21.830, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.888', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'weapon4': '0.504', 'WEAPON3': '0.750', 'HITCOUNT': '1.280', 'weapon2': '1.368', 'weapon3': '1.624', 'DAMAGECOUNT': '4.473', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:42,072][52660] DAMAGECOUNT value on done: 26142.0 [2024-08-05 23:15:42,076][52660] Sum rewards: 24.623, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.204', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'weapon5': '0.066', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '1.286', 'HITCOUNT': '1.350', 'weapon2': '1.510', 'weapon3': '1.810', 'DAMAGECOUNT': '5.397', 'FRAGCOUNT': '19.000'} [2024-08-05 23:15:42,592][52668] DAMAGECOUNT value on done: 26435.0 [2024-08-05 23:15:42,594][52668] Sum rewards: 23.466, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.024', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'ARMOR': '0.918', 'WEAPON3': '0.950', 'HITCOUNT': '1.540', 'weapon2': '1.594', 'weapon3': '1.816', 'DAMAGECOUNT': '6.084', 'FRAGCOUNT': '21.000'} [2024-08-05 23:15:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 15018.7, 300 sec: 16356.2). Total num frames: 111140864. Throughput: 0: 4000.5. Samples: 27795210. Policy #0 lag: (min: 1.0, avg: 3.6, max: 9.0) [2024-08-05 23:15:42,794][52567] Avg episode reward: [(0, '21.235')] [2024-08-05 23:15:42,802][52614] Saving new best policy, reward=21.235! [2024-08-05 23:15:43,308][52662] DAMAGECOUNT value on done: 30304.0 [2024-08-05 23:15:43,310][52662] Sum rewards: 19.943, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.645', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.012', 'AMMO4': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON3': '1.150', 'weapon2': '1.350', 'HITCOUNT': '1.830', 'weapon3': '2.420', 'DAMAGECOUNT': '6.396', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:44,049][52811] DAMAGECOUNT value on done: 23152.0 [2024-08-05 23:15:44,050][52811] Sum rewards: 19.939, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.640', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'AMMO3': '0.092', 'weapon5': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.471', 'weapon4': '0.474', 'WEAPON3': '0.750', 'weapon2': '1.088', 'HITCOUNT': '1.400', 'weapon3': '1.662', 'DAMAGECOUNT': '5.133', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:44,062][52794] DAMAGECOUNT value on done: 32094.0 [2024-08-05 23:15:44,063][52794] Sum rewards: 27.316, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.477', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'AMMO3': '0.102', 'WEAPON3': '0.800', 'weapon3': '1.698', 'weapon2': '1.738', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:44,325][52650] Updated weights for policy 0, policy_version 13571 (0.0014) [2024-08-05 23:15:44,334][52803] DAMAGECOUNT value on done: 23648.0 [2024-08-05 23:15:44,335][52803] Sum rewards: 17.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.118', 'WEAPON4': '0.500', 'weapon2': '0.652', 'weapon4': '0.842', 'WEAPON3': '0.850', 'HITCOUNT': '1.760', 'weapon3': '2.050', 'DAMAGECOUNT': '5.559', 'FRAGCOUNT': '14.000'} [2024-08-05 23:15:45,085][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:15:45,231][52660] DAMAGECOUNT value on done: 26434.0 [2024-08-05 23:15:45,231][52660] Sum rewards: 22.428, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.732', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'weapon5': '0.170', 'WEAPON3': '0.700', 'ARMOR': '1.285', 'HITCOUNT': '1.400', 'weapon2': '1.632', 'weapon3': '1.962', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:45,707][52668] DAMAGECOUNT value on done: 25187.0 [2024-08-05 23:15:45,710][52668] Sum rewards: 13.121, reward structure: {'DEATHCOUNT': '-2.250', 'HEALTH': '-0.599', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.250', 'WEAPON3': '0.350', 'weapon2': '0.444', 'ARMOR': '0.520', 'HITCOUNT': '0.690', 'weapon4': '0.902', 'weapon3': '1.018', 'DAMAGECOUNT': '2.493', 'FRAGCOUNT': '9.000'} [2024-08-05 23:15:46,236][52662] DAMAGECOUNT value on done: 32388.0 [2024-08-05 23:15:46,236][52662] Sum rewards: 28.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.076', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.084', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.536', 'WEAPON3': '1.300', 'HITCOUNT': '2.160', 'weapon3': '2.634', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '26.000'} [2024-08-05 23:15:46,938][52794] DAMAGECOUNT value on done: 30740.0 [2024-08-05 23:15:46,939][52794] Sum rewards: 23.488, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.246', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.700', 'ARMOR': '1.258', 'weapon2': '1.478', 'HITCOUNT': '1.770', 'weapon3': '1.774', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '16.000'} [2024-08-05 23:15:47,179][52811] DAMAGECOUNT value on done: 25950.0 [2024-08-05 23:15:47,181][52811] Sum rewards: 36.075, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.154', 'weapon3': '1.964', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '8.736', 'FRAGCOUNT': '31.000'} [2024-08-05 23:15:47,604][52803] DAMAGECOUNT value on done: 25813.0 [2024-08-05 23:15:47,605][52803] Sum rewards: 24.421, reward structure: {'DEATHCOUNT': '-5.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON3': '0.450', 'HEALTH': '0.945', 'HITCOUNT': '1.400', 'weapon3': '1.520', 'weapon2': '1.580', 'DAMAGECOUNT': '5.928', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 15155.2, 300 sec: 16411.8). Total num frames: 111239168. Throughput: 0: 4196.2. Samples: 27807790. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:15:47,794][52567] Avg episode reward: [(0, '21.448')] [2024-08-05 23:15:47,797][52614] Saving new best policy, reward=21.448! [2024-08-05 23:15:48,355][52660] DAMAGECOUNT value on done: 27158.0 [2024-08-05 23:15:48,355][52660] Sum rewards: 29.541, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.728', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'ARMOR': '0.048', 'weapon5': '0.076', 'AMMO3': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.392', 'WEAPON3': '0.650', 'weapon2': '1.476', 'weapon3': '1.568', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '6.978', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:48,656][52668] DAMAGECOUNT value on done: 24997.0 [2024-08-05 23:15:48,658][52668] Sum rewards: 17.228, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO4': '0.074', 'AMMO3': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'HEALTH': '0.264', 'WEAPON3': '0.500', 'HITCOUNT': '1.010', 'ARMOR': '1.204', 'weapon3': '1.538', 'weapon2': '1.624', 'DAMAGECOUNT': '3.192', 'FRAGCOUNT': '12.500'} [2024-08-05 23:15:49,070][52662] DAMAGECOUNT value on done: 29471.0 [2024-08-05 23:15:49,073][52662] Sum rewards: 21.668, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'weapon5': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon4': '0.558', 'weapon2': '0.706', 'WEAPON3': '0.900', 'HITCOUNT': '1.690', 'weapon3': '2.024', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:49,228][52650] Updated weights for policy 0, policy_version 13581 (0.0015) [2024-08-05 23:15:49,921][52794] DAMAGECOUNT value on done: 31761.0 [2024-08-05 23:15:49,922][52794] Sum rewards: 27.993, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.133', 'AMMO3': '0.134', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.824', 'weapon2': '1.478', 'HITCOUNT': '1.650', 'weapon3': '1.718', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:50,246][52811] DAMAGECOUNT value on done: 24621.0 [2024-08-05 23:15:50,247][52811] Sum rewards: 15.408, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.860', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.134', 'WEAPON3': '0.800', 'ARMOR': '0.954', 'HITCOUNT': '1.240', 'weapon2': '1.604', 'weapon3': '1.756', 'DAMAGECOUNT': '4.170', 'FRAGCOUNT': '13.000'} [2024-08-05 23:15:50,949][52803] DAMAGECOUNT value on done: 24227.0 [2024-08-05 23:15:50,949][52803] Sum rewards: 25.524, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.094', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.146', 'WEAPON3': '0.850', 'ARMOR': '1.355', 'HITCOUNT': '1.550', 'weapon3': '1.576', 'weapon2': '2.050', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:51,321][52660] DAMAGECOUNT value on done: 26299.0 [2024-08-05 23:15:51,322][52660] Sum rewards: 18.062, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.750', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.080', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.350', 'ARMOR': '0.478', 'WEAPON3': '0.600', 'weapon3': '1.338', 'HITCOUNT': '1.360', 'weapon2': '1.728', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '14.000'} [2024-08-05 23:15:51,617][52668] DAMAGECOUNT value on done: 24948.0 [2024-08-05 23:15:51,617][52668] Sum rewards: 13.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.888', 'ARMOR': '0.949', 'WEAPON3': '1.100', 'HITCOUNT': '1.100', 'weapon3': '2.144', 'DAMAGECOUNT': '4.848', 'FRAGCOUNT': '14.000'} [2024-08-05 23:15:52,205][52662] DAMAGECOUNT value on done: 31078.0 [2024-08-05 23:15:52,207][52662] Sum rewards: 24.413, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.374', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon5': '0.096', 'AMMO3': '0.128', 'WEAPON3': '0.800', 'ARMOR': '1.294', 'HITCOUNT': '1.390', 'weapon2': '1.398', 'weapon3': '1.950', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '19.000'} [2024-08-05 23:15:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 15155.2, 300 sec: 16356.2). Total num frames: 111312896. Throughput: 0: 4226.2. Samples: 27833820. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:15:52,794][52567] Avg episode reward: [(0, '21.596')] [2024-08-05 23:15:52,890][52614] Saving new best policy, reward=21.596! [2024-08-05 23:15:53,320][52614] Signal inference workers to stop experience collection... (2500 times) [2024-08-05 23:15:53,320][52614] Signal inference workers to resume experience collection... (2500 times) [2024-08-05 23:15:53,364][52650] InferenceWorker_p0-w0: stopping experience collection (2500 times) [2024-08-05 23:15:53,370][52650] InferenceWorker_p0-w0: resuming experience collection (2500 times) [2024-08-05 23:15:53,435][52650] Updated weights for policy 0, policy_version 13591 (0.0013) [2024-08-05 23:15:53,454][52811] DAMAGECOUNT value on done: 27766.0 [2024-08-05 23:15:53,454][52811] Sum rewards: 16.716, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.645', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'weapon4': '0.010', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.913', 'weapon2': '1.612', 'HITCOUNT': '1.770', 'weapon3': '2.038', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '14.500'} [2024-08-05 23:15:53,617][52795] DAMAGECOUNT value on done: 23301.0 [2024-08-05 23:15:53,618][52795] Sum rewards: 21.411, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.605', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.026', 'AMMO4': '0.089', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.454', 'WEAPON3': '0.800', 'HITCOUNT': '1.590', 'weapon3': '1.654', 'weapon2': '1.792', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '19.000'} [2024-08-05 23:15:54,189][52803] DAMAGECOUNT value on done: 23036.0 [2024-08-05 23:15:54,191][52803] Sum rewards: 17.512, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.204', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.290', 'weapon3': '1.666', 'weapon2': '1.892', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '15.000'} [2024-08-05 23:15:54,354][52660] DAMAGECOUNT value on done: 25611.0 [2024-08-05 23:15:54,355][52660] Sum rewards: 20.703, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.104', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'weapon7': '0.048', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.272', 'ARMOR': '0.448', 'WEAPON3': '0.750', 'weapon2': '1.042', 'HITCOUNT': '1.180', 'weapon3': '1.714', 'DAMAGECOUNT': '4.680', 'FRAGCOUNT': '17.000'} [2024-08-05 23:15:54,776][52668] DAMAGECOUNT value on done: 26152.0 [2024-08-05 23:15:54,778][52668] Sum rewards: 27.294, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.454', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.240', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.452', 'HITCOUNT': '1.740', 'weapon3': '1.750', 'DAMAGECOUNT': '6.540', 'FRAGCOUNT': '22.000'} [2024-08-05 23:15:56,308][52811] DAMAGECOUNT value on done: 24722.0 [2024-08-05 23:15:56,308][52811] Sum rewards: 25.203, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO3': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.500', 'HEALTH': '0.593', 'weapon2': '1.322', 'HITCOUNT': '1.590', 'weapon3': '1.754', 'DAMAGECOUNT': '6.372', 'FRAGCOUNT': '18.000'} [2024-08-05 23:15:56,814][52795] DAMAGECOUNT value on done: 22082.0 [2024-08-05 23:15:56,815][52795] Sum rewards: 26.657, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.750', 'weapon2': '1.420', 'weapon3': '1.670', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '7.404', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:57,349][52803] DAMAGECOUNT value on done: 25107.0 [2024-08-05 23:15:57,351][52803] Sum rewards: 26.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.804', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.160', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'WEAPON3': '0.950', 'weapon2': '1.380', 'HITCOUNT': '1.790', 'weapon3': '1.844', 'DAMAGECOUNT': '6.744', 'FRAGCOUNT': '24.000'} [2024-08-05 23:15:57,492][52660] DAMAGECOUNT value on done: 26394.0 [2024-08-05 23:15:57,493][52660] Sum rewards: 28.053, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.677', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'AMMO3': '0.060', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.432', 'weapon4': '0.452', 'WEAPON3': '0.500', 'weapon2': '1.424', 'weapon3': '1.446', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.916', 'FRAGCOUNT': '20.000'} [2024-08-05 23:15:57,794][52567] Fps is (10 sec: 16383.7, 60 sec: 16111.0, 300 sec: 16411.8). Total num frames: 111403008. Throughput: 0: 4244.2. Samples: 27859980. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:15:57,795][52567] Avg episode reward: [(0, '21.929')] [2024-08-05 23:15:57,798][52614] Saving new best policy, reward=21.929! [2024-08-05 23:15:58,054][52668] DAMAGECOUNT value on done: 25283.0 [2024-08-05 23:15:58,054][52668] Sum rewards: 24.869, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.040', 'AMMO3': '0.089', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.188', 'AMMO4': '0.200', 'HEALTH': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.485', 'WEAPON3': '0.500', 'weapon4': '0.504', 'weapon2': '1.034', 'HITCOUNT': '1.330', 'weapon3': '1.448', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '19.000'} [2024-08-05 23:15:58,742][52650] Updated weights for policy 0, policy_version 13601 (0.0011) [2024-08-05 23:15:59,714][52811] DAMAGECOUNT value on done: 25072.0 [2024-08-05 23:15:59,716][52811] Sum rewards: 22.001, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.044', 'AMMO3': '0.103', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'ARMOR': '0.482', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '0.700', 'weapon2': '1.258', 'weapon3': '1.712', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '6.066', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:00,047][52795] DAMAGECOUNT value on done: 23707.0 [2024-08-05 23:16:00,047][52795] Sum rewards: 19.836, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.890', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO3': '0.086', 'WEAPON4': '0.150', 'ARMOR': '0.490', 'weapon4': '0.538', 'WEAPON3': '0.650', 'weapon2': '1.258', 'HITCOUNT': '1.600', 'weapon3': '1.660', 'DAMAGECOUNT': '5.511', 'FRAGCOUNT': '14.000'} [2024-08-05 23:16:00,341][52669] DAMAGECOUNT value on done: 27540.0 [2024-08-05 23:16:00,341][52669] Sum rewards: 26.374, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.468', 'AMMO2': '0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '1.560', 'weapon3': '1.660', 'weapon2': '1.912', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:00,390][52803] DAMAGECOUNT value on done: 25395.0 [2024-08-05 23:16:00,391][52803] Sum rewards: 26.255, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.027', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.064', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '0.900', 'weapon2': '1.536', 'HITCOUNT': '1.800', 'weapon3': '1.938', 'DAMAGECOUNT': '7.155', 'FRAGCOUNT': '22.000'} [2024-08-05 23:16:00,391][52660] DAMAGECOUNT value on done: 27731.0 [2024-08-05 23:16:00,393][52660] Sum rewards: 25.261, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.900', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.028', 'ARMOR': '0.036', 'AMMO3': '0.101', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.382', 'WEAPON3': '0.850', 'weapon2': '1.236', 'weapon3': '1.958', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '6.888', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:00,693][52668] DAMAGECOUNT value on done: 26522.0 [2024-08-05 23:16:00,693][52668] Sum rewards: 27.982, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.736', 'AMMO4': '-0.055', 'AMMO2': '-0.011', 'AMMO3': '0.182', 'WEAPON3': '1.300', 'weapon2': '1.350', 'ARMOR': '1.357', 'HITCOUNT': '1.920', 'weapon3': '2.386', 'DAMAGECOUNT': '7.788', 'FRAGCOUNT': '25.000'} [2024-08-05 23:16:02,780][52811] DAMAGECOUNT value on done: 25132.0 [2024-08-05 23:16:02,783][52811] Sum rewards: 24.957, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.160', 'weapon4': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'weapon3': '1.792', 'HITCOUNT': '1.840', 'weapon2': '1.974', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17066.6, 300 sec: 16411.8). Total num frames: 111493120. Throughput: 0: 4254.4. Samples: 27872980. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:16:02,794][52567] Avg episode reward: [(0, '21.990')] [2024-08-05 23:16:02,795][52614] Saving new best policy, reward=21.990! [2024-08-05 23:16:02,800][52660] DAMAGECOUNT value on done: 26745.0 [2024-08-05 23:16:02,800][52660] Sum rewards: 18.708, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.193', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO3': '0.060', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON3': '0.450', 'ARMOR': '0.820', 'HITCOUNT': '1.390', 'weapon3': '1.512', 'weapon2': '1.782', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:03,022][52650] Updated weights for policy 0, policy_version 13611 (0.0012) [2024-08-05 23:16:03,087][52795] DAMAGECOUNT value on done: 24034.0 [2024-08-05 23:16:03,089][52795] Sum rewards: 14.008, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.611', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.099', 'WEAPON4': '0.200', 'weapon4': '0.446', 'WEAPON3': '0.750', 'ARMOR': '0.939', 'HITCOUNT': '1.070', 'weapon2': '1.540', 'weapon3': '1.634', 'DAMAGECOUNT': '3.711', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:03,154][52668] DAMAGECOUNT value on done: 26494.0 [2024-08-05 23:16:03,156][52668] Sum rewards: 10.895, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.480', 'WEAPON3': '0.900', 'weapon2': '0.966', 'ARMOR': '0.969', 'HITCOUNT': '1.240', 'weapon3': '1.670', 'DAMAGECOUNT': '4.452', 'FRAGCOUNT': '10.000'} [2024-08-05 23:16:03,455][52669] DAMAGECOUNT value on done: 27044.0 [2024-08-05 23:16:03,457][52669] Sum rewards: 28.737, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon7': '0.040', 'AMMO3': '0.086', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.166', 'WEAPON7': '0.200', 'HEALTH': '0.238', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '0.450', 'ARMOR': '0.478', 'weapon2': '1.118', 'HITCOUNT': '1.520', 'weapon3': '1.736', 'DAMAGECOUNT': '6.111', 'FRAGCOUNT': '22.000'} [2024-08-05 23:16:03,482][52803] DAMAGECOUNT value on done: 22620.0 [2024-08-05 23:16:03,482][52803] Sum rewards: 24.846, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.950', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'WEAPON4': '0.250', 'weapon4': '0.368', 'WEAPON3': '0.900', 'weapon2': '1.174', 'weapon3': '1.778', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '6.012', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:05,390][52660] DAMAGECOUNT value on done: 27772.0 [2024-08-05 23:16:05,392][52660] Sum rewards: 17.515, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.586', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.093', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.430', 'weapon3': '1.634', 'weapon2': '1.862', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '14.000'} [2024-08-05 23:16:05,970][52811] DAMAGECOUNT value on done: 25268.0 [2024-08-05 23:16:05,970][52811] Sum rewards: 22.224, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.782', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.070', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'HITCOUNT': '1.360', 'weapon2': '1.612', 'weapon3': '1.806', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:05,991][52668] DAMAGECOUNT value on done: 27747.0 [2024-08-05 23:16:05,993][52668] Sum rewards: 21.834, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.548', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.115', 'weapon4': '0.230', 'WEAPON3': '0.750', 'weapon2': '1.348', 'ARMOR': '1.600', 'HITCOUNT': '1.690', 'weapon3': '2.028', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:06,169][52795] DAMAGECOUNT value on done: 27616.0 [2024-08-05 23:16:06,169][52795] Sum rewards: 24.874, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.956', 'AMMO2': '0.010', 'weapon4': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.949', 'weapon3': '1.726', 'weapon2': '1.868', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:06,356][52803] DAMAGECOUNT value on done: 23941.0 [2024-08-05 23:16:06,356][52803] Sum rewards: 15.714, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.878', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon4': '0.028', 'ARMOR': '0.036', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'HITCOUNT': '1.360', 'weapon3': '1.464', 'weapon2': '1.650', 'DAMAGECOUNT': '4.653', 'FRAGCOUNT': '11.000'} [2024-08-05 23:16:06,705][52669] DAMAGECOUNT value on done: 27340.0 [2024-08-05 23:16:06,706][52669] Sum rewards: 21.858, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.672', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO4': '0.026', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.908', 'WEAPON3': '0.950', 'HITCOUNT': '1.360', 'weapon2': '1.724', 'weapon3': '1.870', 'DAMAGECOUNT': '6.225', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:07,664][52650] Updated weights for policy 0, policy_version 13621 (0.0027) [2024-08-05 23:16:07,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17066.7, 300 sec: 16439.5). Total num frames: 111583232. Throughput: 0: 4280.7. Samples: 27899300. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:16:07,794][52567] Avg episode reward: [(0, '21.846')] [2024-08-05 23:16:08,561][52660] DAMAGECOUNT value on done: 26888.0 [2024-08-05 23:16:08,563][52660] Sum rewards: 26.762, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.975', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon5': '0.006', 'AMMO5': '0.007', 'weapon4': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'WEAPON3': '0.850', 'ARMOR': '1.374', 'weapon2': '1.644', 'HITCOUNT': '1.700', 'weapon3': '1.886', 'DAMAGECOUNT': '7.464', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:08,968][52811] DAMAGECOUNT value on done: 24078.0 [2024-08-05 23:16:08,970][52811] Sum rewards: 18.694, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.260', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.616', 'WEAPON3': '0.650', 'weapon2': '0.728', 'HITCOUNT': '1.480', 'weapon3': '1.908', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '14.000'} [2024-08-05 23:16:09,269][52795] DAMAGECOUNT value on done: 26626.0 [2024-08-05 23:16:09,269][52795] Sum rewards: 22.558, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.508', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.356', 'WEAPON3': '0.750', 'ARMOR': '1.324', 'weapon2': '1.448', 'HITCOUNT': '1.820', 'weapon3': '1.862', 'DAMAGECOUNT': '5.892', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:09,374][52803] DAMAGECOUNT value on done: 25802.0 [2024-08-05 23:16:09,374][52803] Sum rewards: 24.473, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.806', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.044', 'AMMO3': '0.133', 'AMMO4': '0.178', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.468', 'WEAPON3': '0.850', 'weapon2': '1.362', 'HITCOUNT': '1.570', 'weapon3': '1.742', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:09,810][52669] DAMAGECOUNT value on done: 27212.0 [2024-08-05 23:16:09,810][52669] Sum rewards: 29.766, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.831', 'AMMO5': '0.022', 'AMMO2': '0.022', 'weapon5': '0.044', 'AMMO4': '0.112', 'AMMO3': '0.136', 'weapon4': '0.142', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.898', 'WEAPON3': '0.900', 'weapon3': '1.696', 'HITCOUNT': '1.770', 'weapon2': '1.850', 'DAMAGECOUNT': '6.255', 'FRAGCOUNT': '26.000'} [2024-08-05 23:16:10,051][52664] DAMAGECOUNT value on done: 26390.0 [2024-08-05 23:16:10,051][52664] Sum rewards: 21.941, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.209', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.178', 'weapon4': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.494', 'WEAPON3': '0.700', 'weapon2': '0.916', 'HITCOUNT': '1.490', 'weapon3': '2.052', 'DAMAGECOUNT': '5.022', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:11,368][52660] DAMAGECOUNT value on done: 27188.0 [2024-08-05 23:16:11,368][52660] Sum rewards: 29.561, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.002', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'WEAPON3': '0.700', 'ARMOR': '0.876', 'HITCOUNT': '1.460', 'weapon3': '1.760', 'weapon2': '1.814', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '23.000'} [2024-08-05 23:16:11,732][52665] DAMAGECOUNT value on done: 24560.0 [2024-08-05 23:16:11,733][52665] Sum rewards: 22.062, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.190', 'AMMO5': '0.006', 'weapon4': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.086', 'weapon5': '0.098', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.370', 'weapon2': '1.680', 'weapon3': '1.688', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:12,046][52811] DAMAGECOUNT value on done: 25365.0 [2024-08-05 23:16:12,047][52811] Sum rewards: 23.491, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.825', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.096', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.208', 'ARMOR': '0.458', 'WEAPON3': '0.700', 'weapon2': '1.156', 'HITCOUNT': '1.550', 'weapon3': '1.940', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:12,346][52795] DAMAGECOUNT value on done: 28303.0 [2024-08-05 23:16:12,349][52795] Sum rewards: 21.924, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.298', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.500', 'HITCOUNT': '1.560', 'weapon3': '2.078', 'DAMAGECOUNT': '6.300', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:12,478][52650] Updated weights for policy 0, policy_version 13631 (0.0023) [2024-08-05 23:16:12,534][52803] DAMAGECOUNT value on done: 26003.0 [2024-08-05 23:16:12,536][52803] Sum rewards: 25.096, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.317', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.095', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.542', 'HITCOUNT': '1.610', 'weapon2': '1.736', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17203.2, 300 sec: 16439.5). Total num frames: 111673344. Throughput: 0: 4309.3. Samples: 27925410. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:16:12,794][52567] Avg episode reward: [(0, '22.138')] [2024-08-05 23:16:12,795][52614] Saving new best policy, reward=22.138! [2024-08-05 23:16:12,921][52669] DAMAGECOUNT value on done: 27747.0 [2024-08-05 23:16:12,924][52669] Sum rewards: 14.058, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.394', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.071', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'HITCOUNT': '1.100', 'weapon3': '1.474', 'weapon2': '1.480', 'DAMAGECOUNT': '4.416', 'FRAGCOUNT': '11.000'} [2024-08-05 23:16:13,089][52664] DAMAGECOUNT value on done: 25574.0 [2024-08-05 23:16:13,091][52664] Sum rewards: 17.508, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.200', 'ARMOR': '0.500', 'WEAPON3': '0.600', 'weapon3': '1.242', 'HITCOUNT': '1.490', 'weapon2': '1.670', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:14,078][52660] DAMAGECOUNT value on done: 25457.0 [2024-08-05 23:16:14,079][52660] Sum rewards: 18.690, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.070', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon7': '0.064', 'AMMO3': '0.074', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.420', 'WEAPON3': '0.450', 'ARMOR': '0.816', 'weapon3': '1.090', 'weapon2': '1.130', 'HITCOUNT': '1.150', 'DAMAGECOUNT': '3.456', 'FRAGCOUNT': '13.500'} [2024-08-05 23:16:14,841][52665] DAMAGECOUNT value on done: 25779.0 [2024-08-05 23:16:14,842][52665] Sum rewards: 11.293, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.228', 'HEALTH': '0.400', 'WEAPON3': '0.450', 'HITCOUNT': '1.100', 'weapon3': '1.370', 'weapon2': '1.728', 'DAMAGECOUNT': '3.741', 'FRAGCOUNT': '7.000'} [2024-08-05 23:16:15,260][52811] DAMAGECOUNT value on done: 26932.0 [2024-08-05 23:16:15,261][52811] Sum rewards: 21.829, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.022', 'HEALTH': '0.065', 'weapon4': '0.078', 'AMMO3': '0.098', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'ARMOR': '0.458', 'WEAPON3': '0.550', 'HITCOUNT': '1.610', 'weapon3': '1.614', 'weapon2': '1.966', 'DAMAGECOUNT': '5.607', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:15,520][52795] DAMAGECOUNT value on done: 25183.0 [2024-08-05 23:16:15,521][52795] Sum rewards: 25.771, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.188', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.095', 'ARMOR': '0.457', 'WEAPON3': '0.550', 'HITCOUNT': '1.750', 'weapon3': '1.774', 'weapon2': '1.850', 'DAMAGECOUNT': '5.877', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:15,657][52669] DAMAGECOUNT value on done: 29061.0 [2024-08-05 23:16:15,657][52669] Sum rewards: 29.203, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'weapon4': '0.434', 'WEAPON3': '0.550', 'weapon2': '1.212', 'weapon3': '1.426', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '22.000'} [2024-08-05 23:16:15,692][52803] DAMAGECOUNT value on done: 24780.0 [2024-08-05 23:16:15,694][52803] Sum rewards: 13.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.846', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.020', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.380', 'weapon2': '1.436', 'weapon3': '2.074', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '12.500'} [2024-08-05 23:16:15,993][52664] DAMAGECOUNT value on done: 29009.0 [2024-08-05 23:16:15,994][52664] Sum rewards: 20.536, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.639', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.157', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.454', 'weapon2': '0.936', 'ARMOR': '0.953', 'WEAPON3': '1.100', 'HITCOUNT': '1.610', 'weapon3': '1.868', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:17,218][52650] Updated weights for policy 0, policy_version 13641 (0.0014) [2024-08-05 23:16:17,606][52665] DAMAGECOUNT value on done: 27170.0 [2024-08-05 23:16:17,608][52665] Sum rewards: 11.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.433', 'weapon7': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.350', 'ARMOR': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '1.070', 'weapon2': '1.214', 'weapon3': '1.828', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 16467.3). Total num frames: 111755264. Throughput: 0: 4316.9. Samples: 27938360. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:16:17,794][52567] Avg episode reward: [(0, '21.953')] [2024-08-05 23:16:18,349][52669] DAMAGECOUNT value on done: 28123.0 [2024-08-05 23:16:18,350][52669] Sum rewards: 18.392, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.020', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'weapon4': '0.294', 'WEAPON4': '0.300', 'ARMOR': '0.538', 'WEAPON3': '0.900', 'weapon2': '1.278', 'HITCOUNT': '1.370', 'weapon3': '1.930', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:18,411][52811] DAMAGECOUNT value on done: 23688.0 [2024-08-05 23:16:18,415][52811] Sum rewards: 19.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.146', 'AMMO3': '0.156', 'AMMO4': '0.220', 'WEAPON4': '0.500', 'ARMOR': '0.906', 'WEAPON3': '1.000', 'weapon2': '1.372', 'HITCOUNT': '1.590', 'weapon3': '2.082', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:18,633][52795] DAMAGECOUNT value on done: 23385.0 [2024-08-05 23:16:18,633][52795] Sum rewards: 25.182, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.029', 'AMMO3': '0.090', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.194', 'WEAPON3': '0.500', 'HEALTH': '0.896', 'ARMOR': '1.600', 'weapon3': '1.680', 'HITCOUNT': '1.710', 'weapon2': '1.972', 'DAMAGECOUNT': '5.718', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:19,216][52664] DAMAGECOUNT value on done: 27414.0 [2024-08-05 23:16:19,216][52664] Sum rewards: 22.958, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.520', 'AMMO2': '0.022', 'AMMO3': '0.091', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.226', 'WEAPON3': '0.600', 'weapon2': '1.252', 'weapon3': '1.676', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '5.901', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:20,117][52665] DAMAGECOUNT value on done: 27512.0 [2024-08-05 23:16:20,118][52665] Sum rewards: 22.562, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.350', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'ARMOR': '0.491', 'weapon4': '0.606', 'WEAPON3': '0.800', 'weapon2': '1.012', 'HITCOUNT': '1.340', 'weapon3': '1.618', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:21,302][52669] DAMAGECOUNT value on done: 25854.0 [2024-08-05 23:16:21,302][52669] Sum rewards: 20.855, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.041', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.107', 'WEAPON3': '0.800', 'ARMOR': '1.338', 'HITCOUNT': '1.350', 'weapon2': '1.550', 'weapon3': '1.886', 'DAMAGECOUNT': '5.268', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:21,556][52811] DAMAGECOUNT value on done: 24148.0 [2024-08-05 23:16:21,559][52811] Sum rewards: 26.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.068', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO3': '0.114', 'AMMO4': '0.149', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.883', 'weapon2': '1.402', 'weapon3': '1.692', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:21,711][52650] Updated weights for policy 0, policy_version 13651 (0.0013) [2024-08-05 23:16:21,850][52795] DAMAGECOUNT value on done: 25562.0 [2024-08-05 23:16:21,850][52795] Sum rewards: 14.362, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.229', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.025', 'weapon4': '0.026', 'weapon5': '0.036', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'HITCOUNT': '1.130', 'weapon2': '1.466', 'weapon3': '1.480', 'DAMAGECOUNT': '3.981', 'FRAGCOUNT': '11.000'} [2024-08-05 23:16:22,112][52664] DAMAGECOUNT value on done: 26053.0 [2024-08-05 23:16:22,113][52664] Sum rewards: 22.654, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'weapon5': '0.160', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '0.700', 'weapon3': '1.220', 'weapon2': '1.436', 'HITCOUNT': '1.620', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:22,580][52667] DAMAGECOUNT value on done: 26961.0 [2024-08-05 23:16:22,583][52667] Sum rewards: 21.107, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.576', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.034', 'weapon4': '0.070', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '1.258', 'weapon3': '1.644', 'weapon2': '1.710', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 16467.3). Total num frames: 111845376. Throughput: 0: 4348.4. Samples: 27964940. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:16:22,794][52567] Avg episode reward: [(0, '22.059')] [2024-08-05 23:16:23,290][52665] DAMAGECOUNT value on done: 24994.0 [2024-08-05 23:16:23,291][52665] Sum rewards: 25.948, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.018', 'ARMOR': '0.036', 'AMMO3': '0.090', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'HEALTH': '0.242', 'weapon4': '0.286', 'WEAPON3': '0.550', 'weapon2': '1.326', 'HITCOUNT': '1.570', 'weapon3': '1.616', 'DAMAGECOUNT': '5.022', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:24,377][52669] DAMAGECOUNT value on done: 26375.0 [2024-08-05 23:16:24,378][52669] Sum rewards: 18.171, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.383', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.288', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.160', 'weapon2': '1.476', 'weapon3': '1.532', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:25,048][52795] DAMAGECOUNT value on done: 25561.0 [2024-08-05 23:16:25,048][52795] Sum rewards: 20.820, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.182', 'HEALTH': '0.223', 'WEAPON3': '0.600', 'ARMOR': '0.932', 'weapon2': '1.030', 'HITCOUNT': '1.400', 'weapon3': '1.754', 'DAMAGECOUNT': '5.169', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:25,175][52664] DAMAGECOUNT value on done: 29723.0 [2024-08-05 23:16:25,177][52664] Sum rewards: 24.656, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.065', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'WEAPON3': '0.600', 'weapon2': '1.598', 'weapon3': '1.608', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:25,543][52667] DAMAGECOUNT value on done: 28647.0 [2024-08-05 23:16:25,545][52667] Sum rewards: 24.238, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.978', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.133', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon3': '1.700', 'weapon2': '1.888', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:25,922][52665] DAMAGECOUNT value on done: 25594.0 [2024-08-05 23:16:25,922][52665] Sum rewards: 15.238, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.112', 'AMMO2': '0.003', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.015', 'weapon5': '0.052', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.448', 'WEAPON3': '1.000', 'weapon2': '1.052', 'HITCOUNT': '1.400', 'weapon3': '1.812', 'DAMAGECOUNT': '4.710', 'FRAGCOUNT': '14.500'} [2024-08-05 23:16:26,758][52650] Updated weights for policy 0, policy_version 13661 (0.0012) [2024-08-05 23:16:27,450][52669] DAMAGECOUNT value on done: 26559.0 [2024-08-05 23:16:27,451][52669] Sum rewards: 18.625, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon2': '1.402', 'HITCOUNT': '1.510', 'weapon3': '1.642', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17339.7, 300 sec: 16522.8). Total num frames: 111935488. Throughput: 0: 4353.8. Samples: 27991130. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:16:27,795][52567] Avg episode reward: [(0, '22.207')] [2024-08-05 23:16:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013664_111935488.pth... [2024-08-05 23:16:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013182_107986944.pth [2024-08-05 23:16:27,941][52614] Saving new best policy, reward=22.207! [2024-08-05 23:16:28,031][52664] DAMAGECOUNT value on done: 27495.0 [2024-08-05 23:16:28,033][52664] Sum rewards: 17.954, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.221', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.026', 'AMMO3': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.304', 'WEAPON3': '0.500', 'ARMOR': '0.851', 'HITCOUNT': '1.120', 'weapon3': '1.584', 'weapon2': '1.720', 'DAMAGECOUNT': '4.092', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:28,113][52795] DAMAGECOUNT value on done: 24368.0 [2024-08-05 23:16:28,114][52795] Sum rewards: 11.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.240', 'AMMO2': '0.023', 'weapon4': '0.028', 'AMMO4': '0.112', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'HITCOUNT': '0.960', 'weapon2': '1.582', 'weapon3': '1.614', 'DAMAGECOUNT': '3.612', 'FRAGCOUNT': '10.000'} [2024-08-05 23:16:28,504][52667] DAMAGECOUNT value on done: 25772.0 [2024-08-05 23:16:28,506][52667] Sum rewards: 13.388, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.680', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'weapon4': '0.104', 'AMMO3': '0.111', 'WEAPON3': '0.750', 'weapon2': '1.578', 'HITCOUNT': '1.620', 'weapon3': '1.630', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:28,892][52665] DAMAGECOUNT value on done: 27497.0 [2024-08-05 23:16:28,892][52665] Sum rewards: 25.414, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.074', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '1.460', 'weapon3': '1.646', 'weapon2': '1.846', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:28,940][52666] DAMAGECOUNT value on done: 24688.0 [2024-08-05 23:16:28,940][52666] Sum rewards: 9.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.104', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.126', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.090', 'weapon2': '1.476', 'weapon3': '2.192', 'DAMAGECOUNT': '3.855', 'FRAGCOUNT': '8.000'} [2024-08-05 23:16:30,366][52669] DAMAGECOUNT value on done: 27276.0 [2024-08-05 23:16:30,366][52669] Sum rewards: 14.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.692', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.358', 'weapon2': '1.008', 'WEAPON3': '1.050', 'HITCOUNT': '1.480', 'weapon3': '2.104', 'DAMAGECOUNT': '5.250', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:30,861][52650] Updated weights for policy 0, policy_version 13671 (0.0018) [2024-08-05 23:16:31,002][52667] DAMAGECOUNT value on done: 26617.0 [2024-08-05 23:16:31,004][52667] Sum rewards: 27.174, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.090', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.738', 'weapon2': '0.972', 'weapon3': '1.682', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '6.285', 'FRAGCOUNT': '22.000'} [2024-08-05 23:16:31,173][52664] DAMAGECOUNT value on done: 24900.0 [2024-08-05 23:16:31,173][52664] Sum rewards: 17.984, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.174', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.044', 'AMMO3': '0.089', 'AMMO4': '0.153', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.846', 'HITCOUNT': '1.090', 'weapon2': '1.512', 'weapon3': '1.704', 'DAMAGECOUNT': '3.759', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:31,240][52795] DAMAGECOUNT value on done: 27704.0 [2024-08-05 23:16:31,241][52795] Sum rewards: 18.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.834', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'ARMOR': '0.455', 'WEAPON3': '0.900', 'HITCOUNT': '1.510', 'weapon2': '1.630', 'weapon3': '1.968', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:31,924][52665] DAMAGECOUNT value on done: 27771.0 [2024-08-05 23:16:31,925][52665] Sum rewards: 12.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.636', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.225', 'weapon4': '0.314', 'WEAPON4': '0.500', 'ARMOR': '0.940', 'weapon2': '1.040', 'WEAPON3': '1.200', 'HITCOUNT': '1.280', 'weapon3': '2.220', 'DAMAGECOUNT': '5.343', 'FRAGCOUNT': '14.000'} [2024-08-05 23:16:32,176][52666] DAMAGECOUNT value on done: 25450.0 [2024-08-05 23:16:32,177][52666] Sum rewards: 20.629, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.818', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.038', 'weapon5': '0.062', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.426', 'HITCOUNT': '1.500', 'weapon3': '1.574', 'DAMAGECOUNT': '5.784', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 16495.1). Total num frames: 112017408. Throughput: 0: 4362.0. Samples: 28004080. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:16:32,794][52567] Avg episode reward: [(0, '21.559')] [2024-08-05 23:16:33,165][52669] DAMAGECOUNT value on done: 29587.0 [2024-08-05 23:16:33,165][52669] Sum rewards: 22.281, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.070', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.068', 'weapon5': '0.126', 'WEAPON4': '0.150', 'ARMOR': '0.428', 'weapon4': '0.436', 'WEAPON3': '0.450', 'weapon3': '1.178', 'HITCOUNT': '1.250', 'weapon2': '1.520', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:33,721][52670] DAMAGECOUNT value on done: 26245.0 [2024-08-05 23:16:33,722][52670] Sum rewards: 23.880, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.465', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.078', 'AMMO4': '0.087', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'weapon2': '1.420', 'HITCOUNT': '1.580', 'weapon3': '1.990', 'DAMAGECOUNT': '6.078', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:33,779][52667] DAMAGECOUNT value on done: 27303.0 [2024-08-05 23:16:33,780][52667] Sum rewards: 19.705, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.308', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.075', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.463', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon3': '1.446', 'weapon2': '2.004', 'DAMAGECOUNT': '4.059', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:34,188][52664] DAMAGECOUNT value on done: 29845.0 [2024-08-05 23:16:34,189][52664] Sum rewards: 14.855, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.805', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'ARMOR': '0.040', 'weapon5': '0.050', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '0.650', 'HITCOUNT': '1.230', 'weapon2': '1.394', 'weapon3': '1.654', 'DAMAGECOUNT': '4.434', 'FRAGCOUNT': '11.000'} [2024-08-05 23:16:34,420][52795] DAMAGECOUNT value on done: 25357.0 [2024-08-05 23:16:34,421][52795] Sum rewards: 19.165, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.347', 'AMMO2': '0.018', 'ARMOR': '0.036', 'AMMO4': '0.088', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.700', 'weapon2': '1.444', 'weapon3': '1.752', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '5.841', 'FRAGCOUNT': '14.000'} [2024-08-05 23:16:34,538][52665] DAMAGECOUNT value on done: 28329.0 [2024-08-05 23:16:34,540][52665] Sum rewards: 21.093, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.517', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.032', 'AMMO3': '0.093', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.455', 'weapon4': '0.532', 'WEAPON3': '0.650', 'weapon2': '1.194', 'HITCOUNT': '1.400', 'weapon3': '1.774', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:34,962][52666] DAMAGECOUNT value on done: 25357.0 [2024-08-05 23:16:34,963][52666] Sum rewards: 15.146, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.416', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'ARMOR': '0.454', 'weapon4': '0.614', 'WEAPON3': '0.700', 'weapon2': '1.022', 'HITCOUNT': '1.210', 'weapon3': '1.458', 'DAMAGECOUNT': '4.104', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:35,899][52650] Updated weights for policy 0, policy_version 13681 (0.0026) [2024-08-05 23:16:36,203][52669] DAMAGECOUNT value on done: 25617.0 [2024-08-05 23:16:36,205][52669] Sum rewards: 15.139, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.507', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'weapon7': '0.056', 'AMMO3': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.266', 'ARMOR': '0.480', 'WEAPON3': '0.500', 'HITCOUNT': '1.160', 'weapon2': '1.414', 'weapon3': '1.494', 'DAMAGECOUNT': '3.504', 'FRAGCOUNT': '10.000'} [2024-08-05 23:16:36,457][52670] DAMAGECOUNT value on done: 27344.0 [2024-08-05 23:16:36,458][52670] Sum rewards: 17.419, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.090', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'ARMOR': '0.434', 'WEAPON3': '0.950', 'weapon2': '1.240', 'HITCOUNT': '1.340', 'weapon3': '2.464', 'DAMAGECOUNT': '5.166', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:36,994][52667] DAMAGECOUNT value on done: 29242.0 [2024-08-05 23:16:36,995][52667] Sum rewards: 16.729, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'ARMOR': '0.450', 'WEAPON3': '0.700', 'HITCOUNT': '1.420', 'weapon2': '1.508', 'weapon3': '1.568', 'DAMAGECOUNT': '4.494', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:37,283][52665] DAMAGECOUNT value on done: 27718.0 [2024-08-05 23:16:37,284][52665] Sum rewards: 17.398, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.043', 'weapon4': '0.064', 'AMMO3': '0.110', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'ARMOR': '0.952', 'weapon2': '1.150', 'HITCOUNT': '1.290', 'weapon3': '1.998', 'DAMAGECOUNT': '5.436', 'FRAGCOUNT': '14.500'} [2024-08-05 23:16:37,389][52664] DAMAGECOUNT value on done: 27686.0 [2024-08-05 23:16:37,389][52664] Sum rewards: 27.411, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.363', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'weapon3': '1.578', 'HITCOUNT': '1.730', 'weapon2': '1.766', 'DAMAGECOUNT': '6.471', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:37,520][52795] DAMAGECOUNT value on done: 24796.0 [2024-08-05 23:16:37,520][52795] Sum rewards: 14.887, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.058', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.346', 'ARMOR': '0.464', 'weapon2': '0.974', 'WEAPON3': '1.200', 'HITCOUNT': '1.320', 'weapon3': '1.810', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 16522.8). Total num frames: 112107520. Throughput: 0: 4378.2. Samples: 28030840. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:16:37,795][52567] Avg episode reward: [(0, '20.927')] [2024-08-05 23:16:38,240][52666] DAMAGECOUNT value on done: 25245.0 [2024-08-05 23:16:38,241][52666] Sum rewards: 13.704, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'AMMO4': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.500', 'HEALTH': '0.623', 'HITCOUNT': '1.200', 'weapon3': '1.484', 'weapon2': '1.806', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '9.000'} [2024-08-05 23:16:39,255][52669] DAMAGECOUNT value on done: 27599.0 [2024-08-05 23:16:39,263][52669] Sum rewards: 12.418, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.610', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON3': '0.700', 'HITCOUNT': '0.920', 'weapon2': '1.284', 'ARMOR': '1.356', 'weapon3': '1.596', 'DAMAGECOUNT': '3.225', 'FRAGCOUNT': '10.000'} [2024-08-05 23:16:39,395][52667] DAMAGECOUNT value on done: 28760.0 [2024-08-05 23:16:39,396][52667] Sum rewards: 19.441, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.685', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'ARMOR': '0.470', 'WEAPON3': '0.850', 'HITCOUNT': '1.600', 'weapon2': '1.662', 'weapon3': '1.780', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:39,661][52665] DAMAGECOUNT value on done: 27498.0 [2024-08-05 23:16:39,662][52665] Sum rewards: 20.466, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.194', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.107', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'weapon3': '1.490', 'HITCOUNT': '1.610', 'weapon2': '2.080', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '14.000'} [2024-08-05 23:16:39,845][52670] DAMAGECOUNT value on done: 25660.0 [2024-08-05 23:16:39,847][52670] Sum rewards: 26.137, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.644', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.036', 'ARMOR': '0.072', 'AMMO3': '0.142', 'weapon4': '0.142', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.026', 'HITCOUNT': '1.890', 'weapon3': '2.378', 'DAMAGECOUNT': '6.936', 'FRAGCOUNT': '21.500'} [2024-08-05 23:16:40,118][52650] Updated weights for policy 0, policy_version 13691 (0.0012) [2024-08-05 23:16:40,357][52663] DAMAGECOUNT value on done: 27489.0 [2024-08-05 23:16:40,357][52663] Sum rewards: 17.415, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.044', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'weapon5': '0.024', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON3': '0.800', 'ARMOR': '0.839', 'HITCOUNT': '1.440', 'weapon2': '1.666', 'weapon3': '1.676', 'DAMAGECOUNT': '5.139', 'FRAGCOUNT': '14.000'} [2024-08-05 23:16:40,466][52664] DAMAGECOUNT value on done: 30507.0 [2024-08-05 23:16:40,468][52664] Sum rewards: 17.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.985', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.122', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.338', 'ARMOR': '0.463', 'WEAPON3': '0.950', 'HITCOUNT': '1.270', 'weapon2': '1.494', 'weapon3': '1.714', 'DAMAGECOUNT': '5.553', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:40,601][52795] DAMAGECOUNT value on done: 25924.0 [2024-08-05 23:16:40,601][52795] Sum rewards: 13.421, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.467', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.127', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'weapon2': '0.912', 'HITCOUNT': '1.210', 'weapon3': '1.494', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '10.500'} [2024-08-05 23:16:41,422][52666] DAMAGECOUNT value on done: 24382.0 [2024-08-05 23:16:41,422][52666] Sum rewards: 15.804, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.584', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.058', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.380', 'HITCOUNT': '1.430', 'weapon3': '1.544', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:41,800][52667] DAMAGECOUNT value on done: 26597.0 [2024-08-05 23:16:41,800][52667] Sum rewards: 25.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.386', 'AMMO2': '0.016', 'ARMOR': '0.040', 'AMMO4': '0.077', 'AMMO3': '0.124', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.446', 'weapon3': '1.696', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '22.000'} [2024-08-05 23:16:42,194][52669] DAMAGECOUNT value on done: 27785.0 [2024-08-05 23:16:42,194][52669] Sum rewards: 17.531, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.047', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.348', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon2': '1.428', 'weapon3': '1.924', 'DAMAGECOUNT': '4.437', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:42,617][52665] DAMAGECOUNT value on done: 25863.0 [2024-08-05 23:16:42,617][52665] Sum rewards: 14.583, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.833', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.420', 'ARMOR': '0.916', 'WEAPON3': '1.000', 'weapon2': '1.076', 'HITCOUNT': '1.240', 'weapon3': '1.742', 'DAMAGECOUNT': '4.617', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 16550.6). Total num frames: 112197632. Throughput: 0: 4382.9. Samples: 28057210. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:16:42,794][52567] Avg episode reward: [(0, '20.506')] [2024-08-05 23:16:42,804][52670] DAMAGECOUNT value on done: 27165.0 [2024-08-05 23:16:42,805][52670] Sum rewards: 20.897, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.586', 'AMMO2': '0.042', 'AMMO3': '0.185', 'AMMO4': '0.210', 'weapon4': '0.388', 'WEAPON4': '0.650', 'ARMOR': '0.940', 'weapon2': '1.118', 'WEAPON3': '1.200', 'HITCOUNT': '1.700', 'weapon3': '1.912', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:43,302][52664] DAMAGECOUNT value on done: 27108.0 [2024-08-05 23:16:43,302][52664] Sum rewards: 7.069, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO3': '0.123', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.234', 'WEAPON4': '0.400', 'HITCOUNT': '0.750', 'WEAPON3': '0.800', 'ARMOR': '0.869', 'weapon3': '1.460', 'weapon2': '1.556', 'DAMAGECOUNT': '2.412', 'FRAGCOUNT': '7.000'} [2024-08-05 23:16:43,332][52663] DAMAGECOUNT value on done: 26649.0 [2024-08-05 23:16:43,332][52663] Sum rewards: 29.215, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.586', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.418', 'WEAPON3': '0.700', 'ARMOR': '0.865', 'weapon2': '0.872', 'HITCOUNT': '1.840', 'weapon3': '1.938', 'DAMAGECOUNT': '6.843', 'FRAGCOUNT': '22.000'} [2024-08-05 23:16:43,655][52795] DAMAGECOUNT value on done: 27586.0 [2024-08-05 23:16:43,655][52795] Sum rewards: 27.102, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.574', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.133', 'WEAPON4': '0.400', 'weapon4': '0.404', 'ARMOR': '0.456', 'WEAPON3': '0.900', 'weapon2': '1.282', 'weapon3': '1.818', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '7.635', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:44,343][52667] DAMAGECOUNT value on done: 28302.0 [2024-08-05 23:16:44,353][52667] Sum rewards: 20.150, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.694', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.442', 'WEAPON3': '0.800', 'weapon2': '1.218', 'ARMOR': '1.304', 'HITCOUNT': '1.660', 'weapon3': '1.860', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:44,387][52666] DAMAGECOUNT value on done: 25014.0 [2024-08-05 23:16:44,388][52666] Sum rewards: 25.073, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.260', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.107', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'HITCOUNT': '1.590', 'weapon2': '1.676', 'weapon3': '1.892', 'DAMAGECOUNT': '6.348', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:44,980][52669] DAMAGECOUNT value on done: 28476.0 [2024-08-05 23:16:44,981][52669] Sum rewards: 17.876, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.032', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.146', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.498', 'WEAPON3': '0.900', 'weapon2': '1.002', 'HITCOUNT': '1.600', 'weapon3': '1.854', 'DAMAGECOUNT': '6.123', 'FRAGCOUNT': '16.500'} [2024-08-05 23:16:45,163][52650] Updated weights for policy 0, policy_version 13701 (0.0012) [2024-08-05 23:16:45,680][52665] DAMAGECOUNT value on done: 25871.0 [2024-08-05 23:16:45,684][52665] Sum rewards: 14.560, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.470', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.402', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'weapon2': '1.062', 'HITCOUNT': '1.490', 'weapon3': '1.686', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '11.000'} [2024-08-05 23:16:45,896][52670] DAMAGECOUNT value on done: 24326.0 [2024-08-05 23:16:45,901][52670] Sum rewards: 26.743, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.895', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.066', 'AMMO3': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '0.600', 'weapon4': '0.812', 'weapon3': '1.630', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '6.291', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:46,027][52663] DAMAGECOUNT value on done: 26623.0 [2024-08-05 23:16:46,028][52663] Sum rewards: 22.945, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.505', 'AMMO4': '-0.112', 'AMMO2': '-0.022', 'weapon7': '0.006', 'AMMO3': '0.060', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.906', 'weapon3': '1.436', 'HITCOUNT': '1.470', 'weapon2': '1.784', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:46,067][52664] DAMAGECOUNT value on done: 27244.0 [2024-08-05 23:16:46,067][52664] Sum rewards: 19.667, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.166', 'WEAPON3': '0.750', 'ARMOR': '0.857', 'weapon2': '1.450', 'HITCOUNT': '1.700', 'weapon3': '1.948', 'DAMAGECOUNT': '6.039', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:46,749][52795] DAMAGECOUNT value on done: 24240.0 [2024-08-05 23:16:46,749][52795] Sum rewards: 16.185, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.808', 'AMMO5': '0.015', 'weapon5': '0.022', 'AMMO2': '0.052', 'AMMO3': '0.145', 'weapon4': '0.148', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'ARMOR': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon3': '1.580', 'HITCOUNT': '1.660', 'weapon2': '1.904', 'DAMAGECOUNT': '5.676', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:47,342][52658] DAMAGECOUNT value on done: 26883.0 [2024-08-05 23:16:47,345][52658] Sum rewards: 13.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.082', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.062', 'ARMOR': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.289', 'weapon4': '0.346', 'weapon2': '0.518', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '1.310', 'weapon3': '2.272', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '14.500'} [2024-08-05 23:16:47,407][52666] DAMAGECOUNT value on done: 25583.0 [2024-08-05 23:16:47,410][52666] Sum rewards: 22.534, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '0.002', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.013', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'HITCOUNT': '1.380', 'weapon3': '1.582', 'weapon2': '2.048', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:47,553][52667] DAMAGECOUNT value on done: 28519.0 [2024-08-05 23:16:47,554][52667] Sum rewards: 25.503, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.402', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.484', 'WEAPON3': '0.700', 'weapon2': '0.830', 'ARMOR': '0.864', 'HITCOUNT': '1.440', 'weapon3': '2.086', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:47,688][52669] DAMAGECOUNT value on done: 27464.0 [2024-08-05 23:16:47,688][52669] Sum rewards: 27.029, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.916', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.212', 'WEAPON3': '0.900', 'ARMOR': '1.369', 'weapon2': '1.388', 'HITCOUNT': '1.850', 'weapon3': '1.900', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '22.000'} [2024-08-05 23:16:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 16550.7). Total num frames: 112279552. Throughput: 0: 4385.8. Samples: 28070340. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 23:16:47,794][52567] Avg episode reward: [(0, '19.983')] [2024-08-05 23:16:48,537][52670] DAMAGECOUNT value on done: 28297.0 [2024-08-05 23:16:48,539][52670] Sum rewards: 21.753, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.375', 'AMMO2': '0.035', 'AMMO3': '0.127', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.320', 'ARMOR': '0.519', 'WEAPON3': '0.850', 'weapon2': '1.292', 'HITCOUNT': '1.600', 'weapon3': '1.930', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:48,736][52665] DAMAGECOUNT value on done: 26806.0 [2024-08-05 23:16:48,738][52665] Sum rewards: 23.754, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.088', 'AMMO2': '0.002', 'AMMO4': '0.007', 'ARMOR': '0.028', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.268', 'WEAPON3': '0.700', 'weapon2': '1.580', 'weapon3': '1.604', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:48,851][52663] DAMAGECOUNT value on done: 27598.0 [2024-08-05 23:16:48,852][52663] Sum rewards: 24.722, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.269', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'ARMOR': '0.040', 'weapon7': '0.048', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.556', 'WEAPON3': '0.650', 'weapon4': '0.672', 'weapon3': '1.340', 'HITCOUNT': '1.490', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '19.000'} [2024-08-05 23:16:49,123][52664] DAMAGECOUNT value on done: 25959.0 [2024-08-05 23:16:49,123][52664] Sum rewards: 12.567, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'weapon4': '0.438', 'HEALTH': '0.558', 'HITCOUNT': '1.060', 'weapon2': '1.108', 'ARMOR': '1.204', 'weapon3': '1.512', 'DAMAGECOUNT': '3.720', 'FRAGCOUNT': '6.500'} [2024-08-05 23:16:49,764][52650] Updated weights for policy 0, policy_version 13711 (0.0022) [2024-08-05 23:16:49,947][52795] DAMAGECOUNT value on done: 25125.0 [2024-08-05 23:16:49,948][52795] Sum rewards: 21.110, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.664', 'AMMO5': '0.011', 'weapon5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.147', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'weapon4': '0.354', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.720', 'WEAPON3': '1.050', 'HITCOUNT': '1.700', 'weapon3': '2.544', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '18.500'} [2024-08-05 23:16:50,013][52666] DAMAGECOUNT value on done: 25799.0 [2024-08-05 23:16:50,014][52666] Sum rewards: 8.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.732', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon4': '0.444', 'ARMOR': '0.928', 'weapon2': '1.078', 'WEAPON3': '1.100', 'HITCOUNT': '1.300', 'weapon3': '2.210', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '10.000'} [2024-08-05 23:16:50,312][52658] DAMAGECOUNT value on done: 27018.0 [2024-08-05 23:16:50,314][52658] Sum rewards: 27.759, reward structure: {'DEATHCOUNT': '-6.750', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.108', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.364', 'ARMOR': '0.420', 'HEALTH': '0.514', 'WEAPON3': '0.600', 'weapon2': '1.104', 'HITCOUNT': '1.760', 'weapon3': '1.890', 'DAMAGECOUNT': '6.189', 'FRAGCOUNT': '21.000'} [2024-08-05 23:16:50,414][52668] Large shaping reward -2.533 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('weapon5', 0.002)] [2024-08-05 23:16:50,581][52667] DAMAGECOUNT value on done: 27113.0 [2024-08-05 23:16:50,581][52667] Sum rewards: 32.466, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.036', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'weapon4': '0.362', 'WEAPON3': '0.800', 'weapon2': '1.278', 'weapon3': '1.926', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '7.419', 'FRAGCOUNT': '26.000'} [2024-08-05 23:16:50,799][52669] DAMAGECOUNT value on done: 27323.0 [2024-08-05 23:16:50,799][52669] Sum rewards: 20.669, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.691', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.079', 'AMMO3': '0.089', 'WEAPON5': '0.200', 'weapon4': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.700', 'HITCOUNT': '1.170', 'weapon2': '1.396', 'weapon3': '1.692', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:51,157][52670] DAMAGECOUNT value on done: 23688.0 [2024-08-05 23:16:51,157][52670] Sum rewards: 15.956, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.548', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.600', 'ARMOR': '0.969', 'HITCOUNT': '1.080', 'weapon2': '1.332', 'weapon3': '1.954', 'DAMAGECOUNT': '3.579', 'FRAGCOUNT': '13.000'} [2024-08-05 23:16:51,459][52665] DAMAGECOUNT value on done: 28111.0 [2024-08-05 23:16:51,461][52665] Sum rewards: 21.979, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.902', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.030', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.188', 'WEAPON3': '0.800', 'ARMOR': '0.941', 'weapon2': '1.138', 'HITCOUNT': '1.550', 'weapon3': '2.068', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:51,949][52663] DAMAGECOUNT value on done: 26040.0 [2024-08-05 23:16:51,950][52663] Sum rewards: 16.194, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.011', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.070', 'AMMO4': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.450', 'ARMOR': '0.696', 'weapon2': '1.316', 'weapon3': '1.416', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '10.000'} [2024-08-05 23:16:52,253][52664] DAMAGECOUNT value on done: 28327.0 [2024-08-05 23:16:52,254][52664] Sum rewards: 29.963, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.745', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.074', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'weapon2': '1.766', 'weapon3': '1.842', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '7.473', 'FRAGCOUNT': '23.000'} [2024-08-05 23:16:52,625][52666] DAMAGECOUNT value on done: 26826.0 [2024-08-05 23:16:52,625][52666] Sum rewards: 31.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.165', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.968', 'WEAPON3': '1.200', 'ARMOR': '1.276', 'HITCOUNT': '2.020', 'weapon3': '2.638', 'DAMAGECOUNT': '7.893', 'FRAGCOUNT': '29.000'} [2024-08-05 23:16:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 16578.4). Total num frames: 112369664. Throughput: 0: 4391.8. Samples: 28096930. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 23:16:52,794][52567] Avg episode reward: [(0, '20.127')] [2024-08-05 23:16:53,035][52795] DAMAGECOUNT value on done: 26234.0 [2024-08-05 23:16:53,036][52795] Sum rewards: 24.933, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.339', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon5': '0.080', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.274', 'WEAPON3': '0.900', 'ARMOR': '0.931', 'weapon2': '1.486', 'HITCOUNT': '1.560', 'weapon3': '1.936', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:53,158][52658] DAMAGECOUNT value on done: 24660.0 [2024-08-05 23:16:53,160][52658] Sum rewards: 11.143, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.284', 'AMMO5': '0.005', 'AMMO2': '0.031', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'AMMO4': '0.153', 'WEAPON4': '0.500', 'weapon4': '0.562', 'weapon2': '0.930', 'WEAPON3': '1.050', 'HITCOUNT': '1.420', 'weapon3': '1.856', 'DAMAGECOUNT': '4.620', 'FRAGCOUNT': '11.000'} [2024-08-05 23:16:53,443][52667] DAMAGECOUNT value on done: 27344.0 [2024-08-05 23:16:53,445][52667] Sum rewards: 14.201, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.841', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.270', 'ARMOR': '0.985', 'WEAPON3': '1.050', 'weapon2': '1.262', 'HITCOUNT': '1.500', 'weapon3': '2.042', 'DAMAGECOUNT': '5.229', 'FRAGCOUNT': '13.500'} [2024-08-05 23:16:53,784][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:16:53,916][52669] DAMAGECOUNT value on done: 26542.0 [2024-08-05 23:16:53,918][52669] Sum rewards: 15.795, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.460', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO3': '0.081', 'AMMO4': '0.094', 'weapon5': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'weapon2': '1.050', 'HITCOUNT': '1.170', 'weapon3': '1.836', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '11.000'} [2024-08-05 23:16:53,949][52670] DAMAGECOUNT value on done: 25144.0 [2024-08-05 23:16:53,964][52670] Sum rewards: 15.095, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.520', 'AMMO5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.054', 'AMMO3': '0.080', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.424', 'WEAPON3': '0.550', 'HITCOUNT': '1.340', 'weapon2': '1.522', 'weapon3': '1.608', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '11.500'} [2024-08-05 23:16:54,177][52650] Updated weights for policy 0, policy_version 13721 (0.0012) [2024-08-05 23:16:54,364][52665] DAMAGECOUNT value on done: 26340.0 [2024-08-05 23:16:54,371][52665] Sum rewards: 20.675, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.389', 'AMMO2': '0.011', 'AMMO5': '0.014', 'AMMO4': '0.057', 'AMMO3': '0.076', 'weapon4': '0.088', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.550', 'ARMOR': '0.897', 'HITCOUNT': '1.310', 'weapon3': '1.598', 'weapon2': '1.646', 'DAMAGECOUNT': '4.548', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:54,940][52663] DAMAGECOUNT value on done: 28298.0 [2024-08-05 23:16:54,949][52663] Sum rewards: 21.711, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.356', 'WEAPON3': '0.750', 'HITCOUNT': '1.670', 'weapon2': '1.680', 'weapon3': '1.696', 'DAMAGECOUNT': '6.834', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:55,284][52666] DAMAGECOUNT value on done: 24613.0 [2024-08-05 23:16:55,284][52666] Sum rewards: 18.523, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.674', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon4': '0.304', 'ARMOR': '0.456', 'WEAPON3': '0.800', 'weapon2': '1.158', 'HITCOUNT': '1.530', 'weapon3': '1.874', 'DAMAGECOUNT': '5.589', 'FRAGCOUNT': '14.500'} [2024-08-05 23:16:55,498][52664] DAMAGECOUNT value on done: 23371.0 [2024-08-05 23:16:55,498][52664] Sum rewards: 21.350, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.415', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.218', 'ARMOR': '0.463', 'WEAPON3': '0.500', 'HITCOUNT': '1.410', 'weapon3': '1.454', 'weapon2': '1.526', 'DAMAGECOUNT': '4.689', 'FRAGCOUNT': '15.000'} [2024-08-05 23:16:56,131][52658] DAMAGECOUNT value on done: 27072.0 [2024-08-05 23:16:56,132][52658] Sum rewards: 20.806, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.412', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'WEAPON3': '0.700', 'ARMOR': '1.283', 'HITCOUNT': '1.580', 'weapon2': '1.688', 'weapon3': '1.850', 'DAMAGECOUNT': '5.310', 'FRAGCOUNT': '16.000'} [2024-08-05 23:16:56,236][52667] DAMAGECOUNT value on done: 28597.0 [2024-08-05 23:16:56,237][52667] Sum rewards: 22.065, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.954', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.089', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '0.700', 'weapon2': '0.984', 'ARMOR': '1.404', 'HITCOUNT': '1.450', 'weapon3': '1.514', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:56,485][52669] DAMAGECOUNT value on done: 29136.0 [2024-08-05 23:16:56,485][52669] Sum rewards: 17.812, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.576', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'ARMOR': '0.911', 'WEAPON3': '1.050', 'weapon2': '1.214', 'HITCOUNT': '1.510', 'weapon3': '2.070', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '17.000'} [2024-08-05 23:16:56,800][52670] DAMAGECOUNT value on done: 23081.0 [2024-08-05 23:16:56,802][52670] Sum rewards: 16.208, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '0.007', 'AMMO2': '0.012', 'AMMO3': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'WEAPON3': '0.350', 'weapon4': '0.770', 'ARMOR': '0.871', 'weapon2': '1.080', 'weapon3': '1.220', 'HITCOUNT': '1.220', 'DAMAGECOUNT': '4.167', 'FRAGCOUNT': '10.000'} [2024-08-05 23:16:56,982][52665] DAMAGECOUNT value on done: 25963.0 [2024-08-05 23:16:56,983][52665] Sum rewards: 16.130, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.015', 'ARMOR': '0.036', 'weapon5': '0.040', 'AMMO2': '0.042', 'HEALTH': '0.096', 'AMMO3': '0.104', 'AMMO4': '0.211', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon2': '1.230', 'HITCOUNT': '1.330', 'weapon3': '1.762', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:57,511][52663] DAMAGECOUNT value on done: 30270.0 [2024-08-05 23:16:57,513][52663] Sum rewards: 23.960, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.760', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.180', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.312', 'weapon3': '1.684', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '6.372', 'FRAGCOUNT': '18.000'} [2024-08-05 23:16:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 16606.2). Total num frames: 112459776. Throughput: 0: 4398.2. Samples: 28123330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:16:57,795][52567] Avg episode reward: [(0, '19.670')] [2024-08-05 23:16:57,891][52666] DAMAGECOUNT value on done: 22659.0 [2024-08-05 23:16:57,892][52666] Sum rewards: 24.729, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.978', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.148', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.590', 'HITCOUNT': '1.600', 'weapon3': '1.928', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '20.000'} [2024-08-05 23:16:58,655][52664] DAMAGECOUNT value on done: 28676.0 [2024-08-05 23:16:58,657][52664] Sum rewards: 15.481, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.269', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.070', 'AMMO3': '0.110', 'AMMO4': '0.218', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'ARMOR': '0.910', 'HITCOUNT': '1.210', 'weapon2': '1.344', 'weapon3': '1.432', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '12.000'} [2024-08-05 23:16:58,778][52650] Updated weights for policy 0, policy_version 13731 (0.0030) [2024-08-05 23:16:58,962][52658] DAMAGECOUNT value on done: 28492.0 [2024-08-05 23:16:58,964][52658] Sum rewards: 27.768, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.145', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.044', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.242', 'weapon2': '0.880', 'WEAPON3': '1.000', 'HITCOUNT': '1.970', 'weapon3': '2.460', 'DAMAGECOUNT': '7.602', 'FRAGCOUNT': '24.000'} [2024-08-05 23:16:58,966][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:16:59,131][52667] DAMAGECOUNT value on done: 26600.0 [2024-08-05 23:16:59,133][52667] Sum rewards: 14.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.023', 'weapon4': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.926', 'HITCOUNT': '1.300', 'weapon2': '1.742', 'weapon3': '1.748', 'DAMAGECOUNT': '4.524', 'FRAGCOUNT': '10.500'} [2024-08-05 23:16:59,236][52670] DAMAGECOUNT value on done: 21586.0 [2024-08-05 23:16:59,237][52670] Sum rewards: 9.803, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.017', 'weapon7': '0.048', 'AMMO4': '0.083', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '0.840', 'ARMOR': '0.879', 'weapon2': '1.530', 'weapon3': '1.704', 'DAMAGECOUNT': '3.153', 'FRAGCOUNT': '9.000'} [2024-08-05 23:16:59,930][52663] DAMAGECOUNT value on done: 26092.0 [2024-08-05 23:16:59,931][52663] Sum rewards: 19.386, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.845', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.060', 'AMMO3': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.578', 'WEAPON3': '0.600', 'weapon2': '1.340', 'HITCOUNT': '1.480', 'weapon3': '1.510', 'DAMAGECOUNT': '5.853', 'FRAGCOUNT': '15.000'} [2024-08-05 23:17:00,064][52665] DAMAGECOUNT value on done: 27036.0 [2024-08-05 23:17:00,072][52665] Sum rewards: 24.854, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.584', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON3': '0.800', 'weapon2': '1.114', 'ARMOR': '1.427', 'HITCOUNT': '1.630', 'weapon3': '1.900', 'DAMAGECOUNT': '5.388', 'FRAGCOUNT': '20.000'} [2024-08-05 23:17:00,702][52666] DAMAGECOUNT value on done: 23917.0 [2024-08-05 23:17:00,705][52666] Sum rewards: 20.811, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.273', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.068', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.550', 'weapon2': '0.602', 'weapon4': '1.036', 'weapon3': '1.264', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '15.000'} [2024-08-05 23:17:01,090][52664] DAMAGECOUNT value on done: 27409.0 [2024-08-05 23:17:01,091][52664] Sum rewards: 25.522, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.681', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.032', 'AMMO3': '0.079', 'AMMO4': '0.100', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon4': '0.640', 'weapon2': '0.876', 'weapon3': '1.400', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.537', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:02,031][52658] DAMAGECOUNT value on done: 24893.0 [2024-08-05 23:17:02,032][52658] Sum rewards: 16.045, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.010', 'weapon5': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.061', 'HEALTH': '0.133', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.400', 'HITCOUNT': '0.850', 'ARMOR': '0.879', 'weapon3': '1.448', 'weapon2': '1.536', 'DAMAGECOUNT': '3.696', 'FRAGCOUNT': '10.000'} [2024-08-05 23:17:02,125][52667] DAMAGECOUNT value on done: 28459.0 [2024-08-05 23:17:02,126][52667] Sum rewards: 28.792, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.923', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.024', 'AMMO4': '0.029', 'weapon7': '0.052', 'AMMO3': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'WEAPON3': '0.750', 'weapon2': '1.692', 'HITCOUNT': '1.740', 'weapon3': '1.828', 'DAMAGECOUNT': '6.774', 'FRAGCOUNT': '23.000'} [2024-08-05 23:17:02,491][52670] DAMAGECOUNT value on done: 26243.0 [2024-08-05 23:17:02,491][52670] Sum rewards: 18.076, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.905', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.086', 'WEAPON4': '0.200', 'weapon4': '0.348', 'WEAPON3': '0.550', 'weapon3': '1.322', 'HITCOUNT': '1.360', 'ARMOR': '1.381', 'weapon2': '1.808', 'DAMAGECOUNT': '4.947', 'FRAGCOUNT': '14.000'} [2024-08-05 23:17:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16606.2). Total num frames: 112549888. Throughput: 0: 4403.8. Samples: 28136530. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:17:02,794][52567] Avg episode reward: [(0, '19.677')] [2024-08-05 23:17:03,007][52663] DAMAGECOUNT value on done: 26779.0 [2024-08-05 23:17:03,009][52663] Sum rewards: 23.709, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.265', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.123', 'weapon4': '0.338', 'ARMOR': '0.850', 'WEAPON3': '0.850', 'weapon2': '1.316', 'HITCOUNT': '1.680', 'weapon3': '1.948', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:03,229][52665] DAMAGECOUNT value on done: 25194.0 [2024-08-05 23:17:03,231][52665] Sum rewards: 18.056, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.422', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.042', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.322', 'WEAPON4': '0.350', 'ARMOR': '0.458', 'WEAPON3': '1.050', 'weapon2': '1.210', 'HITCOUNT': '1.630', 'weapon3': '2.010', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '15.000'} [2024-08-05 23:17:03,536][52650] Updated weights for policy 0, policy_version 13741 (0.0034) [2024-08-05 23:17:03,590][52664] DAMAGECOUNT value on done: 27997.0 [2024-08-05 23:17:03,591][52664] Sum rewards: 18.138, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.479', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.466', 'HITCOUNT': '1.610', 'weapon3': '1.848', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '14.000'} [2024-08-05 23:17:03,946][52666] DAMAGECOUNT value on done: 25973.0 [2024-08-05 23:17:03,947][52666] Sum rewards: 20.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.671', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon5': '0.020', 'AMMO4': '0.046', 'weapon4': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'ARMOR': '0.978', 'WEAPON3': '1.350', 'weapon2': '1.400', 'HITCOUNT': '1.630', 'weapon3': '2.246', 'DAMAGECOUNT': '6.651', 'FRAGCOUNT': '20.000'} [2024-08-05 23:17:05,251][52658] DAMAGECOUNT value on done: 31703.0 [2024-08-05 23:17:05,260][52658] Sum rewards: 19.212, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.167', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.016', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.103', 'WEAPON3': '0.700', 'ARMOR': '1.256', 'HITCOUNT': '1.560', 'weapon2': '1.640', 'weapon3': '2.094', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '13.500'} [2024-08-05 23:17:05,348][52670] DAMAGECOUNT value on done: 27933.0 [2024-08-05 23:17:05,349][52670] Sum rewards: 18.570, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.432', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.105', 'WEAPON3': '0.700', 'ARMOR': '0.844', 'HITCOUNT': '1.700', 'weapon3': '1.770', 'weapon2': '1.820', 'DAMAGECOUNT': '5.781', 'FRAGCOUNT': '13.000'} [2024-08-05 23:17:05,396][52667] DAMAGECOUNT value on done: 29915.0 [2024-08-05 23:17:05,397][52667] Sum rewards: 19.737, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.060', 'AMMO2': '0.011', 'AMMO5': '0.024', 'weapon5': '0.034', 'weapon4': '0.042', 'AMMO4': '0.056', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.458', 'WEAPON3': '0.850', 'HITCOUNT': '1.520', 'weapon2': '1.684', 'weapon3': '1.726', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '17.500'} [2024-08-05 23:17:06,044][52664] DAMAGECOUNT value on done: 27632.0 [2024-08-05 23:17:06,045][52664] Sum rewards: 22.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.474', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.109', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.408', 'HITCOUNT': '1.790', 'weapon3': '2.010', 'DAMAGECOUNT': '6.615', 'FRAGCOUNT': '17.000'} [2024-08-05 23:17:06,221][52663] DAMAGECOUNT value on done: 30124.0 [2024-08-05 23:17:06,223][52663] Sum rewards: 25.654, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.698', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.550', 'weapon2': '1.682', 'weapon3': '1.804', 'DAMAGECOUNT': '6.717', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:06,283][52665] DAMAGECOUNT value on done: 25173.0 [2024-08-05 23:17:06,283][52665] Sum rewards: 17.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.588', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.812', 'weapon2': '1.152', 'HITCOUNT': '1.240', 'weapon3': '1.956', 'DAMAGECOUNT': '4.638', 'FRAGCOUNT': '14.000'} [2024-08-05 23:17:06,826][52666] DAMAGECOUNT value on done: 24664.0 [2024-08-05 23:17:06,827][52666] Sum rewards: 22.012, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.091', 'weapon5': '0.092', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'HEALTH': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'weapon4': '0.522', 'WEAPON3': '0.550', 'weapon2': '1.026', 'HITCOUNT': '1.440', 'weapon3': '1.512', 'DAMAGECOUNT': '5.253', 'FRAGCOUNT': '15.500'} [2024-08-05 23:17:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 16606.2). Total num frames: 112631808. Throughput: 0: 4396.7. Samples: 28162790. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:17:07,795][52567] Avg episode reward: [(0, '19.767')] [2024-08-05 23:17:08,198][52650] Updated weights for policy 0, policy_version 13751 (0.0015) [2024-08-05 23:17:08,345][52658] DAMAGECOUNT value on done: 26146.0 [2024-08-05 23:17:08,347][52658] Sum rewards: 15.787, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.159', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.044', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.310', 'weapon2': '1.526', 'weapon3': '2.194', 'DAMAGECOUNT': '4.581', 'FRAGCOUNT': '11.000'} [2024-08-05 23:17:08,362][52670] DAMAGECOUNT value on done: 26870.0 [2024-08-05 23:17:08,363][52670] Sum rewards: 23.775, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.816', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.968', 'ARMOR': '1.003', 'WEAPON3': '1.050', 'HITCOUNT': '1.870', 'weapon3': '2.102', 'DAMAGECOUNT': '6.267', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:08,484][52667] DAMAGECOUNT value on done: 27904.0 [2024-08-05 23:17:08,484][52667] Sum rewards: 19.359, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.028', 'AMMO3': '0.090', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.464', 'WEAPON3': '0.600', 'weapon4': '0.806', 'weapon2': '0.940', 'weapon3': '1.592', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '13.500'} [2024-08-05 23:17:09,106][52663] DAMAGECOUNT value on done: 27671.0 [2024-08-05 23:17:09,108][52663] Sum rewards: 12.541, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.180', 'weapon5': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.099', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.917', 'HITCOUNT': '0.980', 'weapon2': '1.014', 'weapon3': '1.822', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '10.000'} [2024-08-05 23:17:09,775][52666] DAMAGECOUNT value on done: 25890.0 [2024-08-05 23:17:09,776][52666] Sum rewards: 23.083, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.245', 'AMMO5': '0.008', 'weapon5': '0.048', 'AMMO2': '0.056', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.282', 'weapon2': '0.740', 'weapon4': '0.744', 'WEAPON4': '0.750', 'ARMOR': '0.859', 'WEAPON3': '1.000', 'HITCOUNT': '1.630', 'weapon3': '2.096', 'DAMAGECOUNT': '6.273', 'FRAGCOUNT': '19.500'} [2024-08-05 23:17:11,245][52670] DAMAGECOUNT value on done: 27782.0 [2024-08-05 23:17:11,247][52670] Sum rewards: 17.328, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.978', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'ARMOR': '0.853', 'WEAPON3': '0.900', 'weapon2': '1.406', 'HITCOUNT': '1.440', 'weapon3': '1.936', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:11,371][52658] DAMAGECOUNT value on done: 29565.0 [2024-08-05 23:17:11,371][52658] Sum rewards: 27.169, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.487', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.592', 'HITCOUNT': '1.850', 'weapon3': '2.084', 'DAMAGECOUNT': '6.936', 'FRAGCOUNT': '20.000'} [2024-08-05 23:17:11,571][52667] DAMAGECOUNT value on done: 27813.0 [2024-08-05 23:17:11,574][52667] Sum rewards: 34.698, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.928', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon5': '0.040', 'AMMO4': '0.050', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.508', 'WEAPON3': '0.700', 'ARMOR': '0.932', 'weapon2': '1.212', 'weapon3': '1.942', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '8.931', 'FRAGCOUNT': '24.500'} [2024-08-05 23:17:12,109][52663] DAMAGECOUNT value on done: 27688.0 [2024-08-05 23:17:12,109][52663] Sum rewards: 24.808, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.250', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.068', 'AMMO3': '0.078', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '1.430', 'weapon3': '1.468', 'weapon2': '1.710', 'DAMAGECOUNT': '6.075', 'FRAGCOUNT': '18.500'} [2024-08-05 23:17:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 16633.9). Total num frames: 112721920. Throughput: 0: 4404.7. Samples: 28189340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:17:12,794][52567] Avg episode reward: [(0, '20.071')] [2024-08-05 23:17:12,888][52666] DAMAGECOUNT value on done: 26112.0 [2024-08-05 23:17:12,890][52666] Sum rewards: 10.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.168', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'weapon5': '0.032', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.070', 'ARMOR': '1.269', 'weapon3': '1.630', 'weapon2': '1.714', 'DAMAGECOUNT': '3.984', 'FRAGCOUNT': '10.000'} [2024-08-05 23:17:13,107][52650] Updated weights for policy 0, policy_version 13761 (0.0012) [2024-08-05 23:17:13,165][52671] DAMAGECOUNT value on done: 29801.0 [2024-08-05 23:17:13,166][52671] Sum rewards: 15.752, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.203', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.075', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'WEAPON3': '0.800', 'HITCOUNT': '1.620', 'weapon2': '1.688', 'weapon3': '1.810', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:14,097][52658] DAMAGECOUNT value on done: 27498.0 [2024-08-05 23:17:14,099][52658] Sum rewards: 18.850, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.914', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.052', 'ARMOR': '0.060', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.223', 'weapon4': '0.286', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon2': '1.334', 'HITCOUNT': '1.460', 'weapon3': '1.902', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:14,248][52667] DAMAGECOUNT value on done: 28441.0 [2024-08-05 23:17:14,250][52667] Sum rewards: 22.604, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.852', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.084', 'AMMO3': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.348', 'HITCOUNT': '1.570', 'weapon3': '1.600', 'DAMAGECOUNT': '7.044', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:14,466][52670] DAMAGECOUNT value on done: 26806.0 [2024-08-05 23:17:14,469][52670] Sum rewards: 15.355, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.194', 'AMMO5': '0.005', 'ARMOR': '0.028', 'weapon5': '0.030', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.098', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.648', 'weapon2': '1.092', 'HITCOUNT': '1.200', 'weapon3': '1.796', 'DAMAGECOUNT': '4.290', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:15,164][52663] DAMAGECOUNT value on done: 26170.0 [2024-08-05 23:17:15,164][52663] Sum rewards: 10.173, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.262', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.012', 'weapon5': '0.026', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'WEAPON3': '0.700', 'ARMOR': '0.836', 'HITCOUNT': '0.940', 'weapon2': '1.374', 'weapon3': '1.688', 'DAMAGECOUNT': '3.594', 'FRAGCOUNT': '8.500'} [2024-08-05 23:17:15,248][52820] DAMAGECOUNT value on done: 23265.0 [2024-08-05 23:17:15,250][52820] Sum rewards: 27.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.681', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.032', 'AMMO4': '0.047', 'weapon5': '0.134', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.912', 'WEAPON3': '1.150', 'HITCOUNT': '1.770', 'weapon3': '2.292', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '26.000'} [2024-08-05 23:17:15,924][52666] DAMAGECOUNT value on done: 24612.0 [2024-08-05 23:17:15,924][52666] Sum rewards: 18.910, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.518', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.576', 'WEAPON3': '0.600', 'weapon2': '1.022', 'HITCOUNT': '1.450', 'weapon3': '1.866', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '13.000'} [2024-08-05 23:17:16,167][52671] DAMAGECOUNT value on done: 26144.0 [2024-08-05 23:17:16,167][52671] Sum rewards: 26.704, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.252', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.168', 'WEAPON3': '0.550', 'ARMOR': '1.212', 'weapon2': '1.642', 'weapon3': '1.676', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '6.111', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:16,838][52658] DAMAGECOUNT value on done: 28692.0 [2024-08-05 23:17:16,838][52658] Sum rewards: 24.384, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.898', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.011', 'weapon5': '0.082', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'ARMOR': '0.471', 'WEAPON3': '0.700', 'weapon3': '1.690', 'HITCOUNT': '1.810', 'weapon2': '1.836', 'DAMAGECOUNT': '6.447', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:16,921][52667] DAMAGECOUNT value on done: 28479.0 [2024-08-05 23:17:16,924][52667] Sum rewards: 22.966, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.230', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'AMMO3': '0.116', 'weapon4': '0.182', 'WEAPON3': '0.800', 'weapon2': '1.646', 'HITCOUNT': '1.730', 'weapon3': '1.886', 'DAMAGECOUNT': '6.213', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:17,416][52670] DAMAGECOUNT value on done: 25725.0 [2024-08-05 23:17:17,417][52670] Sum rewards: 21.841, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.007', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.092', 'weapon5': '0.106', 'AMMO3': '0.141', 'ARMOR': '0.863', 'WEAPON3': '0.950', 'weapon2': '1.442', 'HITCOUNT': '1.790', 'weapon3': '1.860', 'DAMAGECOUNT': '6.420', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:17,708][52650] Updated weights for policy 0, policy_version 13771 (0.0031) [2024-08-05 23:17:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 16661.7). Total num frames: 112812032. Throughput: 0: 4410.9. Samples: 28202570. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:17:17,794][52567] Avg episode reward: [(0, '20.309')] [2024-08-05 23:17:18,308][52663] DAMAGECOUNT value on done: 26806.0 [2024-08-05 23:17:18,308][52663] Sum rewards: 15.451, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.555', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.152', 'weapon5': '0.160', 'ARMOR': '0.545', 'WEAPON3': '0.800', 'HITCOUNT': '1.240', 'weapon2': '1.512', 'weapon3': '1.586', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '14.000'} [2024-08-05 23:17:18,309][52820] DAMAGECOUNT value on done: 24761.0 [2024-08-05 23:17:18,309][52820] Sum rewards: 19.639, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.178', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'weapon5': '0.006', 'AMMO5': '0.017', 'AMMO3': '0.070', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.718', 'ARMOR': '0.887', 'weapon2': '1.226', 'weapon3': '1.554', 'HITCOUNT': '1.590', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '13.500'} [2024-08-05 23:17:18,496][52666] DAMAGECOUNT value on done: 24920.0 [2024-08-05 23:17:18,498][52666] Sum rewards: 15.002, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.480', 'ARMOR': '0.492', 'WEAPON3': '0.750', 'weapon2': '1.352', 'HITCOUNT': '1.640', 'weapon3': '1.824', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '11.500'} [2024-08-05 23:17:19,146][52671] DAMAGECOUNT value on done: 28291.0 [2024-08-05 23:17:19,146][52671] Sum rewards: 23.445, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.831', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.032', 'weapon5': '0.062', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'weapon2': '1.482', 'HITCOUNT': '1.580', 'weapon3': '1.824', 'DAMAGECOUNT': '5.811', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:19,489][52658] DAMAGECOUNT value on done: 25640.0 [2024-08-05 23:17:19,492][52658] Sum rewards: 16.522, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon4': '0.194', 'ARMOR': '0.436', 'HEALTH': '0.442', 'WEAPON3': '0.500', 'HITCOUNT': '1.260', 'weapon2': '1.340', 'weapon3': '1.828', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '11.500'} [2024-08-05 23:17:19,863][52670] DAMAGECOUNT value on done: 25945.0 [2024-08-05 23:17:19,864][52670] Sum rewards: 34.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.020', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.228', 'ARMOR': '0.854', 'WEAPON3': '1.050', 'weapon2': '1.254', 'HITCOUNT': '2.240', 'weapon3': '2.280', 'DAMAGECOUNT': '8.319', 'FRAGCOUNT': '29.000'} [2024-08-05 23:17:20,753][52663] DAMAGECOUNT value on done: 27154.0 [2024-08-05 23:17:20,753][52663] Sum rewards: 21.968, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.810', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'weapon4': '0.312', 'ARMOR': '0.440', 'WEAPON3': '0.950', 'weapon2': '1.336', 'HITCOUNT': '1.690', 'weapon3': '2.128', 'DAMAGECOUNT': '6.219', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:21,023][52666] DAMAGECOUNT value on done: 26230.0 [2024-08-05 23:17:21,025][52666] Sum rewards: 22.713, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.562', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.040', 'AMMO3': '0.113', 'weapon4': '0.128', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.848', 'weapon2': '1.434', 'HITCOUNT': '1.560', 'weapon3': '2.024', 'DAMAGECOUNT': '5.826', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:21,430][52820] DAMAGECOUNT value on done: 23340.0 [2024-08-05 23:17:21,432][52820] Sum rewards: 25.381, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.304', 'AMMO2': '0.027', 'AMMO3': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'WEAPON3': '0.400', 'ARMOR': '0.404', 'weapon4': '0.772', 'weapon2': '1.118', 'weapon3': '1.410', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '6.108', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:22,114][52650] Updated weights for policy 0, policy_version 13781 (0.0028) [2024-08-05 23:17:22,133][52671] DAMAGECOUNT value on done: 25867.0 [2024-08-05 23:17:22,135][52671] Sum rewards: 21.939, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.017', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.139', 'WEAPON4': '0.300', 'weapon4': '0.316', 'ARMOR': '0.515', 'WEAPON3': '0.800', 'weapon2': '1.532', 'HITCOUNT': '1.550', 'weapon3': '1.842', 'DAMAGECOUNT': '5.463', 'FRAGCOUNT': '17.000'} [2024-08-05 23:17:22,334][52670] DAMAGECOUNT value on done: 25420.0 [2024-08-05 23:17:22,334][52670] Sum rewards: 21.126, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.310', 'weapon5': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON3': '0.800', 'ARMOR': '0.889', 'weapon2': '1.186', 'HITCOUNT': '1.370', 'weapon3': '1.926', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '17.000'} [2024-08-05 23:17:22,345][52658] DAMAGECOUNT value on done: 28440.0 [2024-08-05 23:17:22,345][52658] Sum rewards: 21.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.031', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.161', 'weapon4': '0.172', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.126', 'HITCOUNT': '1.920', 'weapon3': '2.340', 'DAMAGECOUNT': '6.612', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 16661.7). Total num frames: 112902144. Throughput: 0: 4401.6. Samples: 28228910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:17:22,794][52567] Avg episode reward: [(0, '20.697')] [2024-08-05 23:17:23,475][52649] DAMAGECOUNT value on done: 26859.0 [2024-08-05 23:17:23,476][52649] Sum rewards: 20.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.124', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.098', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.438', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.266', 'weapon3': '1.784', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '6.267', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:23,600][52666] DAMAGECOUNT value on done: 26624.0 [2024-08-05 23:17:23,601][52666] Sum rewards: 12.724, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.038', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.126', 'AMMO4': '0.130', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.468', 'weapon2': '1.144', 'WEAPON3': '1.150', 'HITCOUNT': '1.280', 'weapon3': '2.220', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '13.000'} [2024-08-05 23:17:23,816][52659] DAMAGECOUNT value on done: 26692.0 [2024-08-05 23:17:23,817][52659] Sum rewards: 15.566, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.502', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.022', 'AMMO4': '0.074', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon4': '0.560', 'WEAPON3': '0.650', 'ARMOR': '1.293', 'HITCOUNT': '1.400', 'weapon3': '1.434', 'weapon2': '1.616', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:23,983][52663] DAMAGECOUNT value on done: 27652.0 [2024-08-05 23:17:23,983][52663] Sum rewards: 23.271, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'ARMOR': '0.852', 'WEAPON3': '0.950', 'weapon2': '1.476', 'HITCOUNT': '1.640', 'weapon3': '2.198', 'DAMAGECOUNT': '6.324', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:24,502][52820] DAMAGECOUNT value on done: 25197.0 [2024-08-05 23:17:24,505][52820] Sum rewards: 19.538, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.730', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO3': '0.120', 'ARMOR': '0.449', 'WEAPON3': '0.800', 'HITCOUNT': '1.480', 'weapon2': '1.872', 'weapon3': '1.872', 'DAMAGECOUNT': '5.172', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:24,670][52671] DAMAGECOUNT value on done: 26247.0 [2024-08-05 23:17:24,670][52671] Sum rewards: 16.058, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.470', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.278', 'ARMOR': '0.500', 'WEAPON3': '0.750', 'HITCOUNT': '1.450', 'weapon2': '1.686', 'weapon3': '1.692', 'DAMAGECOUNT': '4.731', 'FRAGCOUNT': '13.000'} [2024-08-05 23:17:25,041][52670] DAMAGECOUNT value on done: 25446.0 [2024-08-05 23:17:25,041][52670] Sum rewards: 26.494, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.060', 'AMMO4': '0.110', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.350', 'weapon4': '0.434', 'ARMOR': '0.460', 'HEALTH': '0.738', 'weapon2': '1.206', 'HITCOUNT': '1.300', 'weapon3': '1.380', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:25,311][52658] DAMAGECOUNT value on done: 28814.0 [2024-08-05 23:17:25,313][52658] Sum rewards: 25.045, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.355', 'AMMO2': '0.014', 'AMMO5': '0.014', 'weapon5': '0.044', 'AMMO4': '0.072', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.850', 'ARMOR': '0.920', 'weapon2': '1.524', 'weapon3': '1.830', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.945', 'FRAGCOUNT': '19.500'} [2024-08-05 23:17:26,641][52649] DAMAGECOUNT value on done: 27201.0 [2024-08-05 23:17:26,641][52649] Sum rewards: 29.372, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO3': '0.080', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.246', 'WEAPON3': '0.500', 'HEALTH': '0.684', 'weapon3': '1.660', 'weapon2': '1.680', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:26,768][52659] DAMAGECOUNT value on done: 29062.0 [2024-08-05 23:17:26,768][52659] Sum rewards: 31.029, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.625', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.094', 'WEAPON4': '0.300', 'weapon4': '0.438', 'ARMOR': '0.457', 'WEAPON3': '0.800', 'weapon2': '1.052', 'HITCOUNT': '1.940', 'weapon3': '2.024', 'DAMAGECOUNT': '7.548', 'FRAGCOUNT': '24.000'} [2024-08-05 23:17:26,809][52650] Updated weights for policy 0, policy_version 13791 (0.0012) [2024-08-05 23:17:27,173][52663] DAMAGECOUNT value on done: 27879.0 [2024-08-05 23:17:27,183][52663] Sum rewards: 24.341, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.810', 'AMMO4': '-0.057', 'AMMO2': '-0.011', 'AMMO5': '0.007', 'WEAPON5': '0.050', 'AMMO3': '0.090', 'WEAPON3': '0.700', 'ARMOR': '0.953', 'weapon3': '1.780', 'HITCOUNT': '1.880', 'weapon2': '2.026', 'DAMAGECOUNT': '6.732', 'FRAGCOUNT': '17.000'} [2024-08-05 23:17:27,525][52671] DAMAGECOUNT value on done: 29920.0 [2024-08-05 23:17:27,525][52671] Sum rewards: 24.502, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'weapon4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.900', 'weapon2': '1.560', 'HITCOUNT': '1.730', 'weapon3': '1.926', 'DAMAGECOUNT': '6.615', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:27,717][52670] DAMAGECOUNT value on done: 25449.0 [2024-08-05 23:17:27,718][52670] Sum rewards: 14.194, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.002', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.064', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.328', 'ARMOR': '0.452', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon2': '1.468', 'weapon3': '1.520', 'DAMAGECOUNT': '4.233', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:27,756][52820] DAMAGECOUNT value on done: 26029.0 [2024-08-05 23:17:27,759][52820] Sum rewards: 17.293, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.090', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON3': '0.850', 'ARMOR': '0.953', 'weapon2': '1.122', 'HITCOUNT': '1.290', 'weapon3': '2.058', 'DAMAGECOUNT': '4.821', 'FRAGCOUNT': '14.000'} [2024-08-05 23:17:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 16689.5). Total num frames: 112984064. Throughput: 0: 4410.4. Samples: 28255680. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:17:27,794][52567] Avg episode reward: [(0, '20.896')] [2024-08-05 23:17:28,273][52658] DAMAGECOUNT value on done: 26242.0 [2024-08-05 23:17:28,273][52658] Sum rewards: 16.934, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.392', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'ARMOR': '0.404', 'weapon4': '0.404', 'WEAPON3': '0.750', 'weapon2': '1.114', 'HITCOUNT': '1.300', 'weapon3': '1.728', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '13.000'} [2024-08-05 23:17:29,641][52649] DAMAGECOUNT value on done: 26921.0 [2024-08-05 23:17:29,641][52649] Sum rewards: 23.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.338', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.151', 'WEAPON4': '0.400', 'weapon4': '0.800', 'weapon2': '0.816', 'WEAPON3': '1.000', 'ARMOR': '1.429', 'HITCOUNT': '1.560', 'weapon3': '2.132', 'DAMAGECOUNT': '5.805', 'FRAGCOUNT': '20.000'} [2024-08-05 23:17:29,670][52659] DAMAGECOUNT value on done: 28335.0 [2024-08-05 23:17:29,670][52659] Sum rewards: 21.449, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.054', 'AMMO4': '0.055', 'HEALTH': '0.069', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.232', 'ARMOR': '0.404', 'WEAPON3': '0.550', 'HITCOUNT': '1.320', 'weapon2': '1.420', 'weapon3': '1.548', 'DAMAGECOUNT': '5.196', 'FRAGCOUNT': '15.500'} [2024-08-05 23:17:30,570][52671] DAMAGECOUNT value on done: 26766.0 [2024-08-05 23:17:30,571][52671] Sum rewards: 25.579, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.574', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.113', 'AMMO4': '0.138', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'WEAPON3': '0.850', 'weapon2': '1.334', 'HITCOUNT': '1.610', 'weapon3': '2.078', 'DAMAGECOUNT': '5.763', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:30,578][52663] DAMAGECOUNT value on done: 26811.0 [2024-08-05 23:17:30,578][52663] Sum rewards: 23.042, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.399', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.100', 'AMMO4': '0.132', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.362', 'ARMOR': '0.428', 'WEAPON3': '0.650', 'weapon2': '1.526', 'HITCOUNT': '1.600', 'weapon3': '1.672', 'DAMAGECOUNT': '6.408', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:30,717][52658] DAMAGECOUNT value on done: 29251.0 [2024-08-05 23:17:30,719][52658] Sum rewards: 23.833, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.016', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.032', 'AMMO3': '0.108', 'AMMO4': '0.133', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.534', 'weapon3': '1.588', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '17.500'} [2024-08-05 23:17:30,970][52820] DAMAGECOUNT value on done: 25435.0 [2024-08-05 23:17:30,971][52820] Sum rewards: 26.643, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.115', 'weapon5': '0.012', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO3': '0.090', 'AMMO4': '0.133', 'weapon4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.514', 'HITCOUNT': '1.610', 'weapon3': '1.656', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '21.000'} [2024-08-05 23:17:31,315][52650] Updated weights for policy 0, policy_version 13801 (0.0018) [2024-08-05 23:17:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 16717.2). Total num frames: 113074176. Throughput: 0: 4406.7. Samples: 28268640. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-05 23:17:32,794][52567] Avg episode reward: [(0, '21.023')] [2024-08-05 23:17:32,801][52659] DAMAGECOUNT value on done: 27248.0 [2024-08-05 23:17:32,802][52659] Sum rewards: 27.727, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.009', 'HEALTH': '0.034', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.134', 'ARMOR': '0.449', 'WEAPON3': '0.600', 'weapon3': '1.564', 'weapon2': '2.004', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '7.821', 'FRAGCOUNT': '19.500'} [2024-08-05 23:17:32,810][52649] DAMAGECOUNT value on done: 26479.0 [2024-08-05 23:17:32,810][52649] Sum rewards: 11.400, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.482', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'weapon4': '0.006', 'WEAPON4': '0.050', 'AMMO3': '0.104', 'WEAPON3': '0.700', 'HITCOUNT': '1.180', 'weapon3': '1.756', 'weapon2': '1.782', 'DAMAGECOUNT': '4.326', 'FRAGCOUNT': '8.000'} [2024-08-05 23:17:33,599][52658] DAMAGECOUNT value on done: 29560.0 [2024-08-05 23:17:33,601][52658] Sum rewards: 11.928, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.067', 'AMMO4': '-0.058', 'AMMO2': '-0.012', 'AMMO5': '0.006', 'AMMO3': '0.066', 'weapon5': '0.084', 'WEAPON5': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '1.080', 'ARMOR': '1.273', 'weapon3': '1.300', 'weapon2': '1.678', 'DAMAGECOUNT': '4.077', 'FRAGCOUNT': '6.500'} [2024-08-05 23:17:33,623][52663] DAMAGECOUNT value on done: 26141.0 [2024-08-05 23:17:33,623][52663] Sum rewards: 31.854, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.730', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.234', 'ARMOR': '0.449', 'WEAPON3': '0.900', 'weapon2': '1.220', 'weapon3': '2.054', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '7.422', 'FRAGCOUNT': '26.000'} [2024-08-05 23:17:33,737][52671] DAMAGECOUNT value on done: 29024.0 [2024-08-05 23:17:33,738][52671] Sum rewards: 20.403, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.995', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.850', 'weapon2': '1.346', 'HITCOUNT': '1.690', 'weapon3': '2.212', 'DAMAGECOUNT': '5.883', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:34,025][52820] DAMAGECOUNT value on done: 25970.0 [2024-08-05 23:17:34,028][52820] Sum rewards: 33.316, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO3': '0.093', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.300', 'ARMOR': '0.424', 'weapon2': '0.574', 'WEAPON3': '0.650', 'weapon4': '0.954', 'weapon3': '1.890', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '8.274', 'FRAGCOUNT': '24.000'} [2024-08-05 23:17:35,891][52659] DAMAGECOUNT value on done: 27635.0 [2024-08-05 23:17:35,892][52659] Sum rewards: 20.864, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.428', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.032', 'AMMO4': '0.075', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.288', 'weapon5': '0.294', 'WEAPON3': '0.650', 'weapon2': '1.348', 'HITCOUNT': '1.440', 'weapon3': '1.572', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:36,023][52649] DAMAGECOUNT value on done: 27164.0 [2024-08-05 23:17:36,023][52649] Sum rewards: 13.548, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.544', 'AMMO5': '0.015', 'AMMO2': '0.022', 'ARMOR': '0.040', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.350', 'weapon4': '0.622', 'WEAPON3': '0.750', 'weapon2': '0.786', 'HITCOUNT': '1.100', 'weapon3': '1.546', 'DAMAGECOUNT': '3.801', 'FRAGCOUNT': '11.000'} [2024-08-05 23:17:36,207][52650] Updated weights for policy 0, policy_version 13811 (0.0012) [2024-08-05 23:17:36,331][52663] DAMAGECOUNT value on done: 26666.0 [2024-08-05 23:17:36,331][52663] Sum rewards: 24.243, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.085', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.134', 'weapon7': '0.162', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'weapon4': '0.548', 'WEAPON3': '0.750', 'weapon2': '0.776', 'HITCOUNT': '1.640', 'weapon3': '2.162', 'DAMAGECOUNT': '6.027', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:36,465][52658] DAMAGECOUNT value on done: 27067.0 [2024-08-05 23:17:36,465][52658] Sum rewards: 22.161, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.906', 'weapon7': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.032', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.282', 'ARMOR': '0.583', 'WEAPON3': '0.750', 'weapon2': '1.118', 'HITCOUNT': '1.350', 'weapon3': '1.762', 'DAMAGECOUNT': '5.157', 'FRAGCOUNT': '17.000'} [2024-08-05 23:17:36,732][52671] DAMAGECOUNT value on done: 28493.0 [2024-08-05 23:17:36,732][52671] Sum rewards: 17.796, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.151', 'AMMO4': '0.187', 'weapon4': '0.342', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'WEAPON3': '0.900', 'weapon2': '1.172', 'HITCOUNT': '1.380', 'weapon3': '1.656', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '15.000'} [2024-08-05 23:17:37,144][52820] DAMAGECOUNT value on done: 25046.0 [2024-08-05 23:17:37,146][52820] Sum rewards: 17.461, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.489', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.070', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.328', 'WEAPON3': '0.650', 'ARMOR': '0.854', 'HITCOUNT': '1.330', 'weapon2': '1.494', 'weapon3': '1.808', 'DAMAGECOUNT': '5.016', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 16745.0). Total num frames: 113164288. Throughput: 0: 4402.0. Samples: 28295020. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-05 23:17:37,795][52567] Avg episode reward: [(0, '20.930')] [2024-08-05 23:17:38,510][52659] DAMAGECOUNT value on done: 29193.0 [2024-08-05 23:17:38,510][52659] Sum rewards: 23.409, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.572', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.062', 'AMMO3': '0.101', 'AMMO4': '0.193', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'ARMOR': '0.850', 'weapon3': '1.346', 'weapon2': '1.478', 'HITCOUNT': '1.520', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:38,536][52649] DAMAGECOUNT value on done: 27387.0 [2024-08-05 23:17:38,538][52649] Sum rewards: 24.957, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.572', 'weapon5': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.440', 'ARMOR': '0.500', 'weapon2': '0.832', 'WEAPON3': '0.950', 'HITCOUNT': '1.820', 'weapon3': '2.300', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:39,188][52671] DAMAGECOUNT value on done: 30350.0 [2024-08-05 23:17:39,190][52671] Sum rewards: 23.216, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.905', 'AMMO4': '-0.033', 'AMMO2': '-0.006', 'AMMO5': '0.010', 'WEAPON4': '0.100', 'AMMO3': '0.101', 'weapon4': '0.116', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.903', 'weapon3': '1.392', 'HITCOUNT': '1.420', 'weapon2': '1.666', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:39,613][52658] DAMAGECOUNT value on done: 26187.0 [2024-08-05 23:17:39,614][52658] Sum rewards: 13.223, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.198', 'AMMO2': '0.028', 'AMMO3': '0.108', 'AMMO4': '0.140', 'weapon4': '0.258', 'WEAPON4': '0.300', 'ARMOR': '0.482', 'WEAPON3': '0.650', 'HITCOUNT': '1.250', 'weapon2': '1.608', 'weapon3': '1.672', 'DAMAGECOUNT': '4.425', 'FRAGCOUNT': '10.000'} [2024-08-05 23:17:40,350][52820] DAMAGECOUNT value on done: 22900.0 [2024-08-05 23:17:40,354][52820] Sum rewards: 15.817, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.742', 'AMMO2': '0.052', 'AMMO3': '0.121', 'AMMO4': '0.258', 'ARMOR': '0.432', 'WEAPON4': '0.550', 'weapon4': '0.648', 'WEAPON3': '0.800', 'weapon2': '1.160', 'HITCOUNT': '1.360', 'weapon3': '1.778', 'DAMAGECOUNT': '4.650', 'FRAGCOUNT': '13.000'} [2024-08-05 23:17:40,689][52650] Updated weights for policy 0, policy_version 13821 (0.0020) [2024-08-05 23:17:41,182][52659] DAMAGECOUNT value on done: 29999.0 [2024-08-05 23:17:41,182][52659] Sum rewards: 29.434, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.312', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO3': '0.094', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'ARMOR': '1.282', 'HITCOUNT': '1.620', 'weapon2': '1.688', 'weapon3': '1.942', 'DAMAGECOUNT': '6.057', 'FRAGCOUNT': '24.000'} [2024-08-05 23:17:41,618][52649] DAMAGECOUNT value on done: 24368.0 [2024-08-05 23:17:41,620][52649] Sum rewards: 19.635, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.186', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.324', 'WEAPON3': '0.650', 'weapon2': '1.174', 'HITCOUNT': '1.360', 'weapon3': '1.642', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '16.000'} [2024-08-05 23:17:41,632][52647] DAMAGECOUNT value on done: 29512.0 [2024-08-05 23:17:41,633][52647] Sum rewards: 24.909, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.840', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'ARMOR': '0.850', 'WEAPON3': '0.900', 'weapon2': '1.600', 'HITCOUNT': '1.750', 'weapon3': '1.790', 'DAMAGECOUNT': '6.129', 'FRAGCOUNT': '20.000'} [2024-08-05 23:17:42,094][52671] DAMAGECOUNT value on done: 28007.0 [2024-08-05 23:17:42,095][52671] Sum rewards: 31.479, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.631', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.528', 'WEAPON3': '0.700', 'weapon2': '1.210', 'ARMOR': '1.393', 'HITCOUNT': '1.990', 'weapon3': '2.052', 'DAMAGECOUNT': '7.872', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:42,518][52658] DAMAGECOUNT value on done: 28296.0 [2024-08-05 23:17:42,520][52658] Sum rewards: 26.280, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.851', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.180', 'WEAPON4': '0.450', 'weapon4': '0.538', 'ARMOR': '0.909', 'WEAPON3': '1.000', 'weapon2': '1.220', 'HITCOUNT': '1.800', 'weapon3': '1.820', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16745.0). Total num frames: 113254400. Throughput: 0: 4401.8. Samples: 28321410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:17:42,794][52567] Avg episode reward: [(0, '21.343')] [2024-08-05 23:17:43,497][52820] DAMAGECOUNT value on done: 23903.0 [2024-08-05 23:17:43,497][52820] Sum rewards: 8.333, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.675', 'AMMO2': '0.028', 'AMMO3': '0.110', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.626', 'WEAPON3': '0.700', 'weapon2': '0.710', 'ARMOR': '0.800', 'HITCOUNT': '0.960', 'weapon3': '1.958', 'DAMAGECOUNT': '3.228', 'FRAGCOUNT': '7.000'} [2024-08-05 23:17:44,204][52659] DAMAGECOUNT value on done: 25770.0 [2024-08-05 23:17:44,204][52659] Sum rewards: 25.773, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.210', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.472', 'WEAPON3': '0.700', 'HITCOUNT': '1.540', 'weapon2': '1.554', 'weapon3': '1.622', 'DAMAGECOUNT': '6.546', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:44,551][52647] DAMAGECOUNT value on done: 28953.0 [2024-08-05 23:17:44,552][52647] Sum rewards: 24.575, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.044', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.111', 'WEAPON4': '0.250', 'weapon4': '0.380', 'WEAPON3': '0.800', 'ARMOR': '0.880', 'weapon2': '1.236', 'HITCOUNT': '1.770', 'weapon3': '1.824', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:44,796][52649] DAMAGECOUNT value on done: 25786.0 [2024-08-05 23:17:44,797][52649] Sum rewards: 15.934, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.684', 'AMMO5': '0.007', 'AMMO2': '0.031', 'ARMOR': '0.036', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.160', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.340', 'weapon2': '1.730', 'weapon3': '1.768', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '15.000'} [2024-08-05 23:17:45,119][52671] DAMAGECOUNT value on done: 29412.0 [2024-08-05 23:17:45,121][52671] Sum rewards: 32.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.678', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon2': '1.124', 'WEAPON3': '1.300', 'weapon3': '2.254', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '9.186', 'FRAGCOUNT': '28.000'} [2024-08-05 23:17:45,284][52650] Updated weights for policy 0, policy_version 13831 (0.0024) [2024-08-05 23:17:46,591][52820] DAMAGECOUNT value on done: 26163.0 [2024-08-05 23:17:46,592][52820] Sum rewards: 30.927, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.432', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.108', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.682', 'HITCOUNT': '1.920', 'weapon3': '1.958', 'DAMAGECOUNT': '6.945', 'FRAGCOUNT': '25.000'} [2024-08-05 23:17:47,242][52659] DAMAGECOUNT value on done: 26536.0 [2024-08-05 23:17:47,244][52659] Sum rewards: 21.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.406', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.424', 'WEAPON3': '0.850', 'weapon2': '1.214', 'HITCOUNT': '1.480', 'weapon3': '1.922', 'DAMAGECOUNT': '6.132', 'FRAGCOUNT': '17.000'} [2024-08-05 23:17:47,291][52647] DAMAGECOUNT value on done: 31538.0 [2024-08-05 23:17:47,291][52647] Sum rewards: 25.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.332', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.262', 'WEAPON3': '0.750', 'ARMOR': '1.232', 'weapon2': '1.282', 'HITCOUNT': '1.680', 'weapon3': '1.918', 'DAMAGECOUNT': '6.135', 'FRAGCOUNT': '19.000'} [2024-08-05 23:17:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 16772.8). Total num frames: 113344512. Throughput: 0: 4402.0. Samples: 28334620. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:17:47,794][52567] Avg episode reward: [(0, '21.590')] [2024-08-05 23:17:47,953][52649] DAMAGECOUNT value on done: 25359.0 [2024-08-05 23:17:47,953][52649] Sum rewards: 11.972, reward structure: {'DEATHCOUNT': '-3.000', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'HEALTH': '0.228', 'weapon4': '0.320', 'WEAPON3': '0.350', 'HITCOUNT': '1.040', 'weapon3': '1.254', 'weapon2': '1.646', 'ARMOR': '1.779', 'DAMAGECOUNT': '3.195', 'FRAGCOUNT': '5.000'} [2024-08-05 23:17:48,110][52671] DAMAGECOUNT value on done: 31317.0 [2024-08-05 23:17:48,111][52671] Sum rewards: 26.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.173', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'ARMOR': '0.867', 'WEAPON3': '0.950', 'weapon2': '1.474', 'HITCOUNT': '1.770', 'weapon3': '2.284', 'DAMAGECOUNT': '6.621', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:49,714][52820] DAMAGECOUNT value on done: 26332.0 [2024-08-05 23:17:49,718][52820] Sum rewards: 16.800, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.432', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.260', 'WEAPON3': '0.700', 'weapon2': '0.822', 'ARMOR': '0.846', 'HITCOUNT': '1.230', 'weapon3': '1.532', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '14.000'} [2024-08-05 23:17:50,002][52647] DAMAGECOUNT value on done: 28335.0 [2024-08-05 23:17:50,002][52647] Sum rewards: 23.617, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.285', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.026', 'weapon5': '0.040', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON3': '1.050', 'weapon2': '1.512', 'HITCOUNT': '1.980', 'weapon3': '2.164', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '21.000'} [2024-08-05 23:17:50,167][52650] Updated weights for policy 0, policy_version 13841 (0.0016) [2024-08-05 23:17:50,358][52659] DAMAGECOUNT value on done: 29570.0 [2024-08-05 23:17:50,359][52659] Sum rewards: 16.794, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.204', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'weapon5': '0.076', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.196', 'WEAPON3': '0.550', 'ARMOR': '0.893', 'HITCOUNT': '1.160', 'weapon3': '1.316', 'weapon2': '1.954', 'DAMAGECOUNT': '4.509', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:50,972][52649] DAMAGECOUNT value on done: 25979.0 [2024-08-05 23:17:50,972][52649] Sum rewards: 17.573, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.756', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON3': '0.550', 'ARMOR': '0.902', 'HITCOUNT': '1.230', 'weapon3': '1.478', 'weapon2': '1.938', 'DAMAGECOUNT': '4.224', 'FRAGCOUNT': '13.000'} [2024-08-05 23:17:51,257][52671] DAMAGECOUNT value on done: 26533.0 [2024-08-05 23:17:51,261][52671] Sum rewards: 12.494, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.540', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'ARMOR': '0.416', 'WEAPON3': '0.800', 'HITCOUNT': '1.470', 'weapon3': '1.682', 'weapon2': '1.852', 'DAMAGECOUNT': '5.037', 'FRAGCOUNT': '10.000'} [2024-08-05 23:17:52,165][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:17:52,351][52647] DAMAGECOUNT value on done: 30113.0 [2024-08-05 23:17:52,352][52647] Sum rewards: 30.030, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.315', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.042', 'AMMO3': '0.115', 'weapon2': '0.264', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.720', 'WEAPON3': '0.850', 'HITCOUNT': '1.920', 'weapon3': '2.214', 'DAMAGECOUNT': '8.628', 'FRAGCOUNT': '23.000'} [2024-08-05 23:17:52,715][52820] DAMAGECOUNT value on done: 24423.0 [2024-08-05 23:17:52,716][52820] Sum rewards: 30.351, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.163', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.021', 'AMMO3': '0.098', 'AMMO4': '0.107', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.550', 'ARMOR': '0.800', 'weapon3': '1.664', 'weapon2': '1.920', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '7.290', 'FRAGCOUNT': '23.000'} [2024-08-05 23:17:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 16772.8). Total num frames: 113426432. Throughput: 0: 4408.9. Samples: 28361190. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:17:52,795][52567] Avg episode reward: [(0, '21.556')] [2024-08-05 23:17:53,336][52659] DAMAGECOUNT value on done: 27765.0 [2024-08-05 23:17:53,338][52659] Sum rewards: 24.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.116', 'weapon5': '0.134', 'WEAPON3': '0.700', 'ARMOR': '0.818', 'weapon2': '1.324', 'HITCOUNT': '1.560', 'weapon3': '1.818', 'DAMAGECOUNT': '6.240', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:53,929][52671] DAMAGECOUNT value on done: 24773.0 [2024-08-05 23:17:53,929][52671] Sum rewards: 23.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO4': '0.151', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON3': '1.000', 'weapon2': '1.152', 'ARMOR': '1.293', 'HITCOUNT': '1.700', 'weapon3': '2.056', 'DAMAGECOUNT': '6.666', 'FRAGCOUNT': '20.000'} [2024-08-05 23:17:54,146][52649] DAMAGECOUNT value on done: 27664.0 [2024-08-05 23:17:54,146][52649] Sum rewards: 22.449, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.080', 'weapon5': '0.108', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'HEALTH': '0.371', 'WEAPON3': '0.450', 'weapon4': '0.654', 'weapon2': '0.840', 'ARMOR': '0.853', 'HITCOUNT': '1.490', 'weapon3': '1.634', 'DAMAGECOUNT': '5.727', 'FRAGCOUNT': '15.500'} [2024-08-05 23:17:54,802][52650] Updated weights for policy 0, policy_version 13851 (0.0012) [2024-08-05 23:17:54,890][52647] DAMAGECOUNT value on done: 28923.0 [2024-08-05 23:17:54,892][52647] Sum rewards: 21.415, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.036', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'ARMOR': '0.458', 'WEAPON3': '0.800', 'HITCOUNT': '1.550', 'weapon3': '1.564', 'weapon2': '1.620', 'DAMAGECOUNT': '5.721', 'FRAGCOUNT': '18.000'} [2024-08-05 23:17:55,179][52794] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-05 23:17:55,815][52820] DAMAGECOUNT value on done: 24749.0 [2024-08-05 23:17:55,816][52820] Sum rewards: 27.380, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.879', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'WEAPON3': '0.750', 'weapon2': '1.566', 'HITCOUNT': '1.650', 'weapon3': '1.872', 'DAMAGECOUNT': '6.081', 'FRAGCOUNT': '22.000'} [2024-08-05 23:17:56,090][52659] DAMAGECOUNT value on done: 28060.0 [2024-08-05 23:17:56,090][52659] Sum rewards: 15.362, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.718', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.270', 'WEAPON3': '0.850', 'weapon2': '1.340', 'HITCOUNT': '1.590', 'weapon3': '1.680', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:56,715][52671] DAMAGECOUNT value on done: 29149.0 [2024-08-05 23:17:56,717][52671] Sum rewards: 26.057, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.533', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.127', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.722', 'HITCOUNT': '1.940', 'weapon3': '1.970', 'DAMAGECOUNT': '6.705', 'FRAGCOUNT': '23.000'} [2024-08-05 23:17:57,085][52649] DAMAGECOUNT value on done: 26361.0 [2024-08-05 23:17:57,085][52649] Sum rewards: 14.146, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.571', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.324', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.014', 'HITCOUNT': '1.250', 'weapon3': '1.820', 'DAMAGECOUNT': '4.386', 'FRAGCOUNT': '12.000'} [2024-08-05 23:17:57,711][52647] DAMAGECOUNT value on done: 28043.0 [2024-08-05 23:17:57,712][52647] Sum rewards: 21.073, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.232', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'AMMO3': '0.087', 'ARMOR': '0.447', 'WEAPON3': '0.700', 'HITCOUNT': '1.260', 'weapon2': '1.516', 'weapon3': '1.766', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '17.000'} [2024-08-05 23:17:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 16800.5). Total num frames: 113516544. Throughput: 0: 4400.4. Samples: 28387360. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:17:57,794][52567] Avg episode reward: [(0, '21.671')] [2024-08-05 23:17:58,922][52820] DAMAGECOUNT value on done: 25215.0 [2024-08-05 23:17:58,923][52820] Sum rewards: 18.055, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.195', 'AMMO4': '-0.087', 'AMMO2': '-0.017', 'AMMO5': '0.008', 'weapon5': '0.048', 'AMMO3': '0.086', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.360', 'weapon3': '1.574', 'weapon2': '1.838', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '14.000'} [2024-08-05 23:17:59,302][52659] DAMAGECOUNT value on done: 25972.0 [2024-08-05 23:17:59,302][52659] Sum rewards: 19.806, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.176', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.095', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.270', 'ARMOR': '1.293', 'weapon2': '1.458', 'weapon3': '1.702', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '15.000'} [2024-08-05 23:17:59,338][52650] Updated weights for policy 0, policy_version 13861 (0.0013) [2024-08-05 23:17:59,892][52671] DAMAGECOUNT value on done: 29095.0 [2024-08-05 23:17:59,892][52671] Sum rewards: 20.109, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.014', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.068', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'ARMOR': '0.853', 'WEAPON3': '0.900', 'HITCOUNT': '1.610', 'weapon2': '1.724', 'weapon3': '1.944', 'DAMAGECOUNT': '6.048', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:00,283][52649] DAMAGECOUNT value on done: 29634.0 [2024-08-05 23:18:00,283][52649] Sum rewards: 17.649, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.635', 'AMMO4': '-0.059', 'AMMO2': '-0.012', 'AMMO5': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON3': '0.900', 'ARMOR': '0.901', 'HITCOUNT': '1.300', 'weapon2': '1.350', 'weapon3': '1.944', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:00,347][52647] DAMAGECOUNT value on done: 31084.0 [2024-08-05 23:18:00,348][52647] Sum rewards: 29.280, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.335', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.086', 'AMMO3': '0.110', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.352', 'HITCOUNT': '1.800', 'weapon3': '2.066', 'DAMAGECOUNT': '6.951', 'FRAGCOUNT': '24.000'} [2024-08-05 23:18:01,911][52614] Signal inference workers to stop experience collection... (2550 times) [2024-08-05 23:18:01,912][52614] Signal inference workers to resume experience collection... (2550 times) [2024-08-05 23:18:01,939][52820] DAMAGECOUNT value on done: 27133.0 [2024-08-05 23:18:01,939][52820] Sum rewards: 21.877, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.227', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.240', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.378', 'HITCOUNT': '1.570', 'weapon3': '1.628', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:01,987][52650] InferenceWorker_p0-w0: stopping experience collection (2550 times) [2024-08-05 23:18:01,987][52650] InferenceWorker_p0-w0: resuming experience collection (2550 times) [2024-08-05 23:18:02,328][52659] DAMAGECOUNT value on done: 26306.0 [2024-08-05 23:18:02,329][52659] Sum rewards: 16.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.030', 'weapon4': '0.050', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON3': '1.250', 'weapon2': '1.354', 'HITCOUNT': '1.470', 'weapon3': '1.890', 'DAMAGECOUNT': '5.958', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16828.3). Total num frames: 113606656. Throughput: 0: 4402.4. Samples: 28400680. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 23:18:02,802][52567] Avg episode reward: [(0, '21.514')] [2024-08-05 23:18:02,962][52647] DAMAGECOUNT value on done: 30081.0 [2024-08-05 23:18:02,962][52647] Sum rewards: 18.330, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.612', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.022', 'AMMO3': '0.097', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.654', 'weapon2': '1.332', 'ARMOR': '1.372', 'weapon3': '1.386', 'HITCOUNT': '1.410', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:03,208][52649] DAMAGECOUNT value on done: 26829.0 [2024-08-05 23:18:03,208][52649] Sum rewards: 20.821, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.434', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO3': '0.067', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.274', 'ARMOR': '0.515', 'WEAPON3': '0.550', 'weapon3': '1.286', 'HITCOUNT': '1.480', 'weapon2': '1.710', 'DAMAGECOUNT': '5.652', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:03,229][52671] DAMAGECOUNT value on done: 28530.0 [2024-08-05 23:18:03,229][52671] Sum rewards: 14.035, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.581', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.058', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.152', 'weapon4': '0.172', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'ARMOR': '1.256', 'HITCOUNT': '1.270', 'weapon2': '1.470', 'weapon3': '1.824', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '10.500'} [2024-08-05 23:18:03,680][52794] DAMAGECOUNT value on done: 32376.0 [2024-08-05 23:18:03,682][52794] Sum rewards: 13.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.884', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.076', 'AMMO3': '0.154', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'weapon4': '0.472', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'ARMOR': '1.005', 'weapon2': '1.258', 'HITCOUNT': '1.280', 'weapon3': '1.792', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '12.000'} [2024-08-05 23:18:04,357][52650] Updated weights for policy 0, policy_version 13871 (0.0014) [2024-08-05 23:18:04,952][52820] DAMAGECOUNT value on done: 24618.0 [2024-08-05 23:18:04,952][52820] Sum rewards: 17.975, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.314', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.112', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.500', 'WEAPON3': '1.000', 'weapon2': '1.346', 'ARMOR': '1.350', 'HITCOUNT': '1.380', 'weapon3': '1.680', 'DAMAGECOUNT': '5.925', 'FRAGCOUNT': '15.500'} [2024-08-05 23:18:05,496][52659] DAMAGECOUNT value on done: 27852.0 [2024-08-05 23:18:05,496][52659] Sum rewards: 15.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.028', 'weapon4': '0.076', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.270', 'weapon2': '1.300', 'weapon3': '2.250', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:05,629][52662] DAMAGECOUNT value on done: 32522.0 [2024-08-05 23:18:05,629][52662] Sum rewards: 17.851, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.728', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.118', 'AMMO4': '0.125', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'ARMOR': '1.309', 'weapon2': '1.562', 'HITCOUNT': '1.620', 'weapon3': '1.990', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:05,686][52649] DAMAGECOUNT value on done: 25372.0 [2024-08-05 23:18:05,686][52649] Sum rewards: 18.688, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.277', 'AMMO5': '0.013', 'weapon5': '0.026', 'AMMO2': '0.046', 'AMMO3': '0.125', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.886', 'weapon2': '1.270', 'HITCOUNT': '1.300', 'weapon3': '1.674', 'DAMAGECOUNT': '4.812', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:06,028][52671] DAMAGECOUNT value on done: 27623.0 [2024-08-05 23:18:06,028][52671] Sum rewards: 22.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.725', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'ARMOR': '0.880', 'WEAPON3': '1.000', 'weapon2': '1.524', 'weapon3': '2.034', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '7.353', 'FRAGCOUNT': '20.000'} [2024-08-05 23:18:06,099][52647] DAMAGECOUNT value on done: 29397.0 [2024-08-05 23:18:06,099][52647] Sum rewards: 17.857, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.402', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'weapon4': '0.268', 'ARMOR': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '1.440', 'weapon2': '1.470', 'weapon3': '1.786', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:06,744][52794] DAMAGECOUNT value on done: 32157.0 [2024-08-05 23:18:06,744][52794] Sum rewards: 18.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.096', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'ARMOR': '0.480', 'WEAPON3': '0.900', 'weapon2': '1.424', 'HITCOUNT': '1.490', 'weapon3': '2.000', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 16772.8). Total num frames: 113688576. Throughput: 0: 4403.1. Samples: 28427050. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 23:18:07,795][52567] Avg episode reward: [(0, '21.323')] [2024-08-05 23:18:08,100][52820] DAMAGECOUNT value on done: 27688.0 [2024-08-05 23:18:08,100][52820] Sum rewards: 20.240, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.296', 'WEAPON3': '0.600', 'weapon2': '1.410', 'weapon3': '1.462', 'HITCOUNT': '1.500', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '15.500'} [2024-08-05 23:18:08,217][52649] DAMAGECOUNT value on done: 28726.0 [2024-08-05 23:18:08,218][52649] Sum rewards: 21.327, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.450', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.012', 'ARMOR': '0.040', 'AMMO3': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.116', 'weapon5': '0.152', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.396', 'HITCOUNT': '1.570', 'weapon3': '1.802', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:08,351][52659] DAMAGECOUNT value on done: 30786.0 [2024-08-05 23:18:08,352][52659] Sum rewards: 29.985, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.162', 'WEAPON4': '0.300', 'weapon4': '0.460', 'WEAPON3': '0.750', 'ARMOR': '0.973', 'weapon2': '1.266', 'HITCOUNT': '1.610', 'weapon3': '1.780', 'DAMAGECOUNT': '6.960', 'FRAGCOUNT': '24.000'} [2024-08-05 23:18:08,456][52662] DAMAGECOUNT value on done: 33218.0 [2024-08-05 23:18:08,459][52662] Sum rewards: 15.391, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'ARMOR': '0.036', 'AMMO2': '0.037', 'weapon5': '0.062', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'WEAPON4': '0.400', 'weapon4': '0.608', 'WEAPON3': '0.650', 'weapon2': '1.126', 'HITCOUNT': '1.210', 'weapon3': '1.396', 'DAMAGECOUNT': '4.332', 'FRAGCOUNT': '11.000'} [2024-08-05 23:18:08,681][52650] Updated weights for policy 0, policy_version 13881 (0.0024) [2024-08-05 23:18:09,027][52671] DAMAGECOUNT value on done: 27676.0 [2024-08-05 23:18:09,027][52671] Sum rewards: 17.086, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.155', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon7': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON3': '0.750', 'weapon2': '1.336', 'HITCOUNT': '1.340', 'weapon3': '1.482', 'DAMAGECOUNT': '4.599', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:09,093][52647] DAMAGECOUNT value on done: 29234.0 [2024-08-05 23:18:09,093][52647] Sum rewards: 18.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.146', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.141', 'weapon4': '0.332', 'WEAPON4': '0.350', 'ARMOR': '0.468', 'WEAPON3': '0.900', 'weapon2': '1.318', 'HITCOUNT': '1.390', 'weapon3': '1.986', 'DAMAGECOUNT': '5.205', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:09,440][52794] DAMAGECOUNT value on done: 32696.0 [2024-08-05 23:18:09,442][52794] Sum rewards: 20.526, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.317', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.310', 'ARMOR': '0.436', 'WEAPON3': '0.700', 'weapon2': '1.506', 'HITCOUNT': '1.510', 'weapon3': '1.636', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:11,045][52662] DAMAGECOUNT value on done: 35031.0 [2024-08-05 23:18:11,045][52662] Sum rewards: 20.902, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.612', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.017', 'AMMO3': '0.070', 'AMMO4': '0.087', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '0.500', 'ARMOR': '1.398', 'weapon3': '1.418', 'weapon2': '1.474', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:11,147][52659] DAMAGECOUNT value on done: 26825.0 [2024-08-05 23:18:11,149][52659] Sum rewards: 16.468, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.494', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.128', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'ARMOR': '1.310', 'weapon2': '1.380', 'HITCOUNT': '1.500', 'weapon3': '1.726', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:11,194][52820] DAMAGECOUNT value on done: 28129.0 [2024-08-05 23:18:11,199][52820] Sum rewards: 19.443, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.902', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.104', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'weapon4': '0.544', 'WEAPON3': '0.750', 'weapon2': '1.178', 'weapon3': '1.612', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:11,350][52649] DAMAGECOUNT value on done: 25156.0 [2024-08-05 23:18:11,351][52649] Sum rewards: 22.595, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.056', 'AMMO3': '0.163', 'HEALTH': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'weapon4': '0.564', 'weapon2': '0.798', 'WEAPON3': '0.900', 'HITCOUNT': '1.720', 'weapon3': '1.906', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:11,736][52647] DAMAGECOUNT value on done: 26695.0 [2024-08-05 23:18:11,736][52647] Sum rewards: 14.732, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.695', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'ARMOR': '0.040', 'AMMO3': '0.060', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '1.260', 'weapon3': '1.448', 'weapon2': '2.258', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '10.000'} [2024-08-05 23:18:12,146][52794] DAMAGECOUNT value on done: 29640.0 [2024-08-05 23:18:12,148][52794] Sum rewards: 9.057, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.043', 'AMMO5': '0.003', 'weapon5': '0.042', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.124', 'AMMO4': '0.245', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'HITCOUNT': '0.930', 'weapon2': '1.500', 'weapon3': '1.902', 'DAMAGECOUNT': '3.045', 'FRAGCOUNT': '8.000'} [2024-08-05 23:18:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 16856.1). Total num frames: 113778688. Throughput: 0: 4402.4. Samples: 28453790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 23:18:12,795][52567] Avg episode reward: [(0, '20.973')] [2024-08-05 23:18:13,416][52650] Updated weights for policy 0, policy_version 13891 (0.0013) [2024-08-05 23:18:13,696][52659] DAMAGECOUNT value on done: 27677.0 [2024-08-05 23:18:13,697][52659] Sum rewards: 23.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.039', 'AMMO3': '0.149', 'AMMO4': '0.195', 'weapon4': '0.282', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.294', 'HITCOUNT': '1.510', 'weapon3': '1.896', 'DAMAGECOUNT': '5.514', 'FRAGCOUNT': '23.000'} [2024-08-05 23:18:13,707][52662] DAMAGECOUNT value on done: 30804.0 [2024-08-05 23:18:13,710][52662] Sum rewards: 16.673, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.253', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO3': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'WEAPON3': '0.400', 'HITCOUNT': '0.990', 'weapon3': '1.184', 'weapon2': '1.768', 'DAMAGECOUNT': '3.114', 'FRAGCOUNT': '13.000'} [2024-08-05 23:18:14,277][52647] DAMAGECOUNT value on done: 28673.0 [2024-08-05 23:18:14,278][52647] Sum rewards: 25.808, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.005', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.344', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.368', 'HITCOUNT': '1.720', 'weapon3': '1.866', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '21.000'} [2024-08-05 23:18:14,413][52820] DAMAGECOUNT value on done: 26291.0 [2024-08-05 23:18:14,415][52820] Sum rewards: 18.671, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.022', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'weapon4': '0.228', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'weapon2': '1.328', 'HITCOUNT': '1.620', 'weapon3': '1.626', 'DAMAGECOUNT': '5.025', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:14,430][52649] DAMAGECOUNT value on done: 28205.0 [2024-08-05 23:18:14,430][52649] Sum rewards: 20.581, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.017', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.108', 'weapon5': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.122', 'HITCOUNT': '1.490', 'weapon3': '1.934', 'DAMAGECOUNT': '5.589', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:15,100][52794] DAMAGECOUNT value on done: 32414.0 [2024-08-05 23:18:15,100][52794] Sum rewards: 13.952, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.498', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.062', 'AMMO4': '0.064', 'AMMO3': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.500', 'ARMOR': '0.929', 'HITCOUNT': '1.000', 'weapon3': '1.464', 'weapon2': '1.500', 'DAMAGECOUNT': '3.876', 'FRAGCOUNT': '10.000'} [2024-08-05 23:18:16,110][52668] DAMAGECOUNT value on done: 27174.0 [2024-08-05 23:18:16,110][52668] Sum rewards: 17.967, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.665', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.224', 'WEAPON3': '0.700', 'ARMOR': '0.893', 'HITCOUNT': '1.550', 'weapon3': '1.576', 'weapon2': '1.964', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:16,877][52659] DAMAGECOUNT value on done: 27553.0 [2024-08-05 23:18:16,878][52659] Sum rewards: 20.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.676', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.054', 'AMMO3': '0.130', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'ARMOR': '0.909', 'weapon2': '1.460', 'weapon3': '1.700', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.798', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:16,878][52662] DAMAGECOUNT value on done: 31104.0 [2024-08-05 23:18:16,879][52662] Sum rewards: 25.950, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.340', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.089', 'weapon5': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'WEAPON3': '0.550', 'weapon2': '0.778', 'weapon4': '0.818', 'HITCOUNT': '1.550', 'weapon3': '1.582', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '20.000'} [2024-08-05 23:18:17,056][52647] DAMAGECOUNT value on done: 28049.0 [2024-08-05 23:18:17,056][52647] Sum rewards: 21.600, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.062', 'AMMO3': '0.087', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '0.700', 'weapon2': '0.768', 'ARMOR': '0.872', 'HITCOUNT': '1.420', 'weapon3': '1.760', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:17,099][52649] DAMAGECOUNT value on done: 28654.0 [2024-08-05 23:18:17,100][52649] Sum rewards: 21.306, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.971', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.034', 'weapon5': '0.034', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'HITCOUNT': '1.570', 'weapon2': '1.758', 'weapon3': '1.866', 'DAMAGECOUNT': '5.649', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:17,315][52668] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.111, -37.0), ('weapon5', 0.002)] [2024-08-05 23:18:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16828.3). Total num frames: 113868800. Throughput: 0: 4403.3. Samples: 28466790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 23:18:17,794][52567] Avg episode reward: [(0, '20.797')] [2024-08-05 23:18:17,836][52650] Updated weights for policy 0, policy_version 13901 (0.0023) [2024-08-05 23:18:17,989][52794] DAMAGECOUNT value on done: 33246.0 [2024-08-05 23:18:17,989][52794] Sum rewards: 17.986, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.108', 'weapon4': '0.108', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.522', 'HITCOUNT': '1.590', 'weapon3': '1.616', 'DAMAGECOUNT': '5.631', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:19,107][52668] DAMAGECOUNT value on done: 29831.0 [2024-08-05 23:18:19,109][52668] Sum rewards: 14.639, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.028', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'ARMOR': '0.471', 'weapon4': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.794', 'HITCOUNT': '1.420', 'weapon3': '1.868', 'DAMAGECOUNT': '4.896', 'FRAGCOUNT': '12.000'} [2024-08-05 23:18:19,296][52662] DAMAGECOUNT value on done: 33524.0 [2024-08-05 23:18:19,298][52662] Sum rewards: 28.649, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.672', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.230', 'ARMOR': '0.453', 'WEAPON3': '0.700', 'weapon2': '1.394', 'HITCOUNT': '1.800', 'weapon3': '1.922', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '22.000'} [2024-08-05 23:18:19,857][52659] DAMAGECOUNT value on done: 29580.0 [2024-08-05 23:18:19,857][52659] Sum rewards: 21.723, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.512', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.092', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON3': '0.700', 'ARMOR': '0.906', 'weapon3': '1.452', 'HITCOUNT': '1.660', 'weapon2': '1.920', 'DAMAGECOUNT': '5.973', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:20,162][52649] DAMAGECOUNT value on done: 29100.0 [2024-08-05 23:18:20,162][52649] Sum rewards: 21.425, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO3': '0.079', 'HEALTH': '0.106', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.776', 'weapon2': '0.998', 'weapon3': '1.416', 'HITCOUNT': '1.580', 'DAMAGECOUNT': '5.442', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:20,201][52647] DAMAGECOUNT value on done: 31040.0 [2024-08-05 23:18:20,201][52647] Sum rewards: 24.001, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.193', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.077', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.440', 'WEAPON3': '0.600', 'weapon3': '1.530', 'HITCOUNT': '1.790', 'weapon2': '2.216', 'DAMAGECOUNT': '6.087', 'FRAGCOUNT': '18.000'} [2024-08-05 23:18:20,716][52794] DAMAGECOUNT value on done: 32952.0 [2024-08-05 23:18:20,716][52794] Sum rewards: 14.721, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.021', 'HEALTH': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.107', 'weapon4': '0.376', 'WEAPON3': '0.550', 'HITCOUNT': '1.150', 'weapon3': '1.510', 'weapon2': '1.820', 'DAMAGECOUNT': '4.260', 'FRAGCOUNT': '10.000'} [2024-08-05 23:18:22,062][52662] DAMAGECOUNT value on done: 34924.0 [2024-08-05 23:18:22,063][52662] Sum rewards: 26.479, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.816', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.046', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.224', 'WEAPON3': '0.550', 'ARMOR': '0.864', 'weapon3': '1.528', 'weapon2': '1.590', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '6.741', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:22,269][52668] DAMAGECOUNT value on done: 26399.0 [2024-08-05 23:18:22,269][52668] Sum rewards: 19.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.945', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.306', 'ARMOR': '0.948', 'WEAPON3': '0.950', 'weapon2': '1.184', 'HITCOUNT': '1.240', 'weapon3': '1.960', 'DAMAGECOUNT': '5.094', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:22,697][52650] Updated weights for policy 0, policy_version 13911 (0.0016) [2024-08-05 23:18:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16883.8). Total num frames: 113958912. Throughput: 0: 4407.5. Samples: 28493360. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-05 23:18:22,794][52567] Avg episode reward: [(0, '20.786')] [2024-08-05 23:18:23,300][52647] DAMAGECOUNT value on done: 27128.0 [2024-08-05 23:18:23,302][52647] Sum rewards: 19.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO5': '0.025', 'AMMO2': '0.042', 'weapon5': '0.052', 'AMMO3': '0.149', 'AMMO4': '0.212', 'weapon4': '0.348', 'WEAPON5': '0.350', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.114', 'weapon3': '1.766', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.086', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:23,623][52794] DAMAGECOUNT value on done: 29000.0 [2024-08-05 23:18:23,623][52794] Sum rewards: 23.497, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.764', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.210', 'ARMOR': '0.432', 'WEAPON3': '0.850', 'weapon2': '1.306', 'HITCOUNT': '1.880', 'weapon3': '1.908', 'DAMAGECOUNT': '6.786', 'FRAGCOUNT': '18.000'} [2024-08-05 23:18:25,118][52662] DAMAGECOUNT value on done: 35316.0 [2024-08-05 23:18:25,118][52662] Sum rewards: 21.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.012', 'weapon5': '0.024', 'AMMO2': '0.035', 'AMMO3': '0.136', 'weapon4': '0.138', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'ARMOR': '1.324', 'weapon2': '1.476', 'HITCOUNT': '1.610', 'weapon3': '1.884', 'DAMAGECOUNT': '5.733', 'FRAGCOUNT': '20.000'} [2024-08-05 23:18:25,139][52660] DAMAGECOUNT value on done: 28378.0 [2024-08-05 23:18:25,139][52660] Sum rewards: 12.592, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.088', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.946', 'HITCOUNT': '1.040', 'weapon3': '1.712', 'weapon2': '2.000', 'DAMAGECOUNT': '3.423', 'FRAGCOUNT': '11.000'} [2024-08-05 23:18:25,390][52668] DAMAGECOUNT value on done: 29212.0 [2024-08-05 23:18:25,390][52668] Sum rewards: 28.045, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.085', 'weapon4': '0.216', 'WEAPON3': '0.650', 'ARMOR': '0.859', 'weapon2': '1.476', 'HITCOUNT': '1.700', 'weapon3': '1.784', 'DAMAGECOUNT': '7.341', 'FRAGCOUNT': '20.000'} [2024-08-05 23:18:25,653][52647] DAMAGECOUNT value on done: 29398.0 [2024-08-05 23:18:25,653][52647] Sum rewards: 18.002, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.480', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.067', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.220', 'weapon2': '1.472', 'weapon3': '2.162', 'DAMAGECOUNT': '4.413', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:26,659][52794] DAMAGECOUNT value on done: 32250.0 [2024-08-05 23:18:26,659][52794] Sum rewards: 18.536, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.968', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.109', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.218', 'WEAPON5': '0.250', 'ARMOR': '0.441', 'WEAPON3': '0.750', 'HITCOUNT': '1.390', 'weapon2': '1.562', 'weapon3': '1.706', 'DAMAGECOUNT': '5.472', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:27,356][52650] Updated weights for policy 0, policy_version 13921 (0.0016) [2024-08-05 23:18:27,728][52660] DAMAGECOUNT value on done: 29323.0 [2024-08-05 23:18:27,729][52660] Sum rewards: 15.560, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.542', 'AMMO5': '0.007', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.146', 'AMMO4': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.466', 'ARMOR': '0.484', 'WEAPON3': '0.950', 'weapon2': '0.992', 'HITCOUNT': '1.300', 'weapon3': '1.812', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 16856.1). Total num frames: 114040832. Throughput: 0: 4409.8. Samples: 28519850. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-05 23:18:27,794][52567] Avg episode reward: [(0, '20.514')] [2024-08-05 23:18:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013921_114040832.pth... [2024-08-05 23:18:27,823][52668] DAMAGECOUNT value on done: 27902.0 [2024-08-05 23:18:27,823][52668] Sum rewards: 14.894, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.718', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.076', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.550', 'HITCOUNT': '1.310', 'weapon2': '1.442', 'weapon3': '1.594', 'DAMAGECOUNT': '4.641', 'FRAGCOUNT': '10.000'} [2024-08-05 23:18:27,871][52662] DAMAGECOUNT value on done: 31178.0 [2024-08-05 23:18:27,873][52662] Sum rewards: 20.847, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.022', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.474', 'WEAPON3': '0.650', 'ARMOR': '0.836', 'weapon2': '1.368', 'HITCOUNT': '1.370', 'weapon3': '1.568', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013426_109985792.pth [2024-08-05 23:18:28,081][52647] DAMAGECOUNT value on done: 28359.0 [2024-08-05 23:18:28,083][52647] Sum rewards: 27.459, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.557', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.955', 'weapon2': '1.582', 'HITCOUNT': '1.670', 'weapon3': '1.788', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '21.000'} [2024-08-05 23:18:29,219][52794] DAMAGECOUNT value on done: 32694.0 [2024-08-05 23:18:29,219][52794] Sum rewards: 26.879, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.442', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.824', 'weapon2': '1.430', 'weapon3': '1.538', 'HITCOUNT': '1.570', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '21.000'} [2024-08-05 23:18:30,391][52662] DAMAGECOUNT value on done: 32674.0 [2024-08-05 23:18:30,391][52662] Sum rewards: 25.346, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.619', 'AMMO2': '0.007', 'AMMO5': '0.011', 'AMMO4': '0.033', 'AMMO3': '0.078', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.338', 'ARMOR': '0.445', 'weapon4': '0.496', 'WEAPON3': '0.650', 'weapon2': '1.054', 'weapon3': '1.520', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:30,892][52660] DAMAGECOUNT value on done: 28604.0 [2024-08-05 23:18:30,893][52660] Sum rewards: 29.063, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.159', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.094', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.450', 'HITCOUNT': '1.880', 'weapon3': '2.028', 'DAMAGECOUNT': '7.212', 'FRAGCOUNT': '22.000'} [2024-08-05 23:18:31,039][52668] DAMAGECOUNT value on done: 29766.0 [2024-08-05 23:18:31,039][52668] Sum rewards: 24.176, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.097', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.064', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.362', 'WEAPON3': '0.650', 'ARMOR': '0.891', 'weapon2': '1.202', 'weapon3': '1.576', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '5.562', 'FRAGCOUNT': '18.000'} [2024-08-05 23:18:31,097][52647] DAMAGECOUNT value on done: 29530.0 [2024-08-05 23:18:31,097][52647] Sum rewards: 18.255, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.133', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'ARMOR': '0.472', 'WEAPON4': '0.500', 'weapon4': '0.728', 'weapon2': '0.758', 'WEAPON3': '0.950', 'HITCOUNT': '1.440', 'weapon3': '2.028', 'DAMAGECOUNT': '5.217', 'FRAGCOUNT': '15.000'} [2024-08-05 23:18:31,819][52794] DAMAGECOUNT value on done: 32638.0 [2024-08-05 23:18:31,819][52794] Sum rewards: 17.409, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.852', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.030', 'AMMO4': '0.060', 'weapon4': '0.070', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.876', 'HITCOUNT': '1.400', 'weapon2': '1.826', 'weapon3': '1.938', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:31,911][52650] Updated weights for policy 0, policy_version 13931 (0.0012) [2024-08-05 23:18:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 16911.6). Total num frames: 114139136. Throughput: 0: 4400.7. Samples: 28532650. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:18:32,794][52567] Avg episode reward: [(0, '20.757')] [2024-08-05 23:18:33,007][52662] DAMAGECOUNT value on done: 31980.0 [2024-08-05 23:18:33,015][52662] Sum rewards: 23.522, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.020', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.095', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.150', 'weapon4': '0.402', 'ARMOR': '0.495', 'WEAPON3': '0.550', 'weapon2': '1.144', 'weapon3': '1.366', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.513', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:33,632][52647] DAMAGECOUNT value on done: 29718.0 [2024-08-05 23:18:33,633][52647] Sum rewards: 27.090, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.745', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.230', 'WEAPON3': '0.700', 'ARMOR': '0.855', 'weapon2': '1.436', 'HITCOUNT': '1.610', 'weapon3': '1.810', 'DAMAGECOUNT': '5.880', 'FRAGCOUNT': '21.000'} [2024-08-05 23:18:34,037][52660] DAMAGECOUNT value on done: 27363.0 [2024-08-05 23:18:34,038][52660] Sum rewards: 19.743, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.535', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.012', 'AMMO3': '0.123', 'weapon5': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.372', 'WEAPON3': '0.850', 'ARMOR': '0.886', 'weapon2': '1.190', 'HITCOUNT': '1.290', 'weapon3': '1.736', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:34,079][52668] DAMAGECOUNT value on done: 31209.0 [2024-08-05 23:18:34,079][52668] Sum rewards: 26.253, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.135', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.850', 'weapon2': '1.328', 'HITCOUNT': '1.660', 'weapon3': '1.704', 'DAMAGECOUNT': '6.426', 'FRAGCOUNT': '23.000'} [2024-08-05 23:18:34,241][52794] DAMAGECOUNT value on done: 32827.0 [2024-08-05 23:18:34,242][52794] Sum rewards: 22.608, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.485', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.480', 'WEAPON3': '0.550', 'ARMOR': '0.901', 'weapon2': '1.172', 'HITCOUNT': '1.730', 'weapon3': '1.838', 'DAMAGECOUNT': '6.144', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:34,274][52664] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:18:35,658][52662] DAMAGECOUNT value on done: 30797.0 [2024-08-05 23:18:35,659][52662] Sum rewards: 20.579, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.230', 'weapon4': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'HITCOUNT': '1.320', 'weapon3': '1.564', 'weapon2': '1.750', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '18.000'} [2024-08-05 23:18:36,635][52650] Updated weights for policy 0, policy_version 13941 (0.0016) [2024-08-05 23:18:37,037][52660] DAMAGECOUNT value on done: 24097.0 [2024-08-05 23:18:37,037][52660] Sum rewards: 20.947, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.757', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.078', 'WEAPON4': '0.200', 'weapon4': '0.280', 'ARMOR': '0.465', 'WEAPON3': '0.550', 'weapon3': '1.514', 'HITCOUNT': '1.580', 'weapon2': '1.794', 'DAMAGECOUNT': '5.178', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:37,059][52668] DAMAGECOUNT value on done: 29659.0 [2024-08-05 23:18:37,059][52668] Sum rewards: 24.883, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.394', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon4': '0.286', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'weapon2': '1.470', 'HITCOUNT': '1.560', 'weapon3': '1.810', 'DAMAGECOUNT': '5.991', 'FRAGCOUNT': '18.000'} [2024-08-05 23:18:37,179][52794] DAMAGECOUNT value on done: 31829.0 [2024-08-05 23:18:37,181][52794] Sum rewards: 25.627, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.023', 'HEALTH': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.081', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON3': '0.450', 'ARMOR': '0.464', 'weapon3': '1.442', 'HITCOUNT': '1.480', 'weapon2': '1.516', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 16911.6). Total num frames: 114221056. Throughput: 0: 4396.2. Samples: 28559020. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:18:37,794][52567] Avg episode reward: [(0, '20.808')] [2024-08-05 23:18:38,454][52803] DAMAGECOUNT value on done: 27332.0 [2024-08-05 23:18:38,457][52803] Sum rewards: 14.584, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.781', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO3': '0.081', 'WEAPON5': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'HITCOUNT': '1.380', 'weapon3': '1.768', 'weapon2': '1.808', 'DAMAGECOUNT': '4.794', 'FRAGCOUNT': '10.000'} [2024-08-05 23:18:38,666][52662] DAMAGECOUNT value on done: 34280.0 [2024-08-05 23:18:38,666][52662] Sum rewards: 19.396, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'HEALTH': '0.005', 'AMMO2': '0.044', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'WEAPON3': '0.650', 'weapon4': '0.754', 'weapon2': '0.860', 'HITCOUNT': '1.460', 'weapon3': '1.694', 'DAMAGECOUNT': '5.421', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:40,051][52660] DAMAGECOUNT value on done: 28827.0 [2024-08-05 23:18:40,051][52660] Sum rewards: 10.537, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.466', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.080', 'AMMO4': '0.128', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.412', 'WEAPON3': '0.550', 'weapon2': '0.596', 'HITCOUNT': '0.670', 'ARMOR': '0.915', 'weapon3': '1.224', 'DAMAGECOUNT': '2.973', 'FRAGCOUNT': '7.000'} [2024-08-05 23:18:40,074][52668] DAMAGECOUNT value on done: 26138.0 [2024-08-05 23:18:40,075][52668] Sum rewards: 22.906, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.637', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.115', 'weapon4': '0.162', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'WEAPON3': '0.800', 'weapon2': '1.256', 'HITCOUNT': '1.780', 'weapon3': '2.188', 'DAMAGECOUNT': '6.351', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:40,281][52794] DAMAGECOUNT value on done: 35709.0 [2024-08-05 23:18:40,281][52794] Sum rewards: 20.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.354', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon4': '0.178', 'WEAPON3': '1.000', 'ARMOR': '1.702', 'weapon2': '1.728', 'HITCOUNT': '1.780', 'weapon3': '1.878', 'DAMAGECOUNT': '6.420', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:41,408][52662] DAMAGECOUNT value on done: 31739.0 [2024-08-05 23:18:41,410][52662] Sum rewards: 16.400, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.330', 'AMMO4': '-0.084', 'AMMO2': '-0.017', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'AMMO3': '0.076', 'weapon5': '0.076', 'WEAPON5': '0.150', 'ARMOR': '0.465', 'WEAPON3': '0.600', 'weapon3': '1.184', 'HITCOUNT': '1.290', 'weapon2': '1.712', 'DAMAGECOUNT': '4.722', 'FRAGCOUNT': '12.000'} [2024-08-05 23:18:41,476][52650] Updated weights for policy 0, policy_version 13951 (0.0017) [2024-08-05 23:18:41,598][52803] DAMAGECOUNT value on done: 29272.0 [2024-08-05 23:18:41,599][52803] Sum rewards: 17.091, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.432', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.101', 'AMMO4': '0.150', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.935', 'HITCOUNT': '1.320', 'weapon2': '1.404', 'weapon3': '1.578', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '12.000'} [2024-08-05 23:18:42,212][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:18:42,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 16939.4). Total num frames: 114311168. Throughput: 0: 4399.8. Samples: 28585350. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:18:42,795][52567] Avg episode reward: [(0, '20.381')] [2024-08-05 23:18:42,846][52794] DAMAGECOUNT value on done: 30678.0 [2024-08-05 23:18:42,846][52794] Sum rewards: 16.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.273', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.105', 'weapon5': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.584', 'WEAPON3': '0.750', 'weapon2': '0.776', 'HITCOUNT': '1.380', 'weapon3': '1.870', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '13.000'} [2024-08-05 23:18:43,071][52668] DAMAGECOUNT value on done: 31435.0 [2024-08-05 23:18:43,071][52668] Sum rewards: 17.575, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.115', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON3': '0.750', 'weapon2': '1.198', 'HITCOUNT': '1.390', 'weapon3': '1.982', 'DAMAGECOUNT': '4.509', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:43,072][52660] DAMAGECOUNT value on done: 26562.0 [2024-08-05 23:18:43,073][52660] Sum rewards: 15.485, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.754', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.120', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.174', 'WEAPON4': '0.200', 'ARMOR': '0.857', 'WEAPON3': '0.900', 'HITCOUNT': '1.290', 'weapon3': '1.638', 'weapon2': '1.692', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:44,309][52662] DAMAGECOUNT value on done: 34516.0 [2024-08-05 23:18:44,317][52662] Sum rewards: 17.691, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.205', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'ARMOR': '0.486', 'WEAPON3': '0.800', 'HITCOUNT': '1.150', 'weapon2': '1.594', 'weapon3': '1.850', 'DAMAGECOUNT': '4.791', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:44,594][52803] DAMAGECOUNT value on done: 24829.0 [2024-08-05 23:18:44,594][52803] Sum rewards: 16.344, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.347', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.038', 'AMMO4': '0.103', 'AMMO3': '0.120', 'weapon4': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.410', 'weapon3': '1.598', 'weapon2': '1.652', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '13.500'} [2024-08-05 23:18:44,726][52811] DAMAGECOUNT value on done: 26966.0 [2024-08-05 23:18:44,728][52811] Sum rewards: 14.189, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.551', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '1.440', 'weapon2': '1.508', 'weapon3': '1.914', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '12.500'} [2024-08-05 23:18:45,617][52660] DAMAGECOUNT value on done: 28365.0 [2024-08-05 23:18:45,617][52660] Sum rewards: 25.834, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.318', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.098', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.214', 'ARMOR': '0.436', 'weapon2': '0.480', 'WEAPON3': '0.650', 'weapon4': '0.712', 'HITCOUNT': '1.530', 'weapon3': '1.804', 'DAMAGECOUNT': '6.438', 'FRAGCOUNT': '20.000'} [2024-08-05 23:18:45,662][52668] DAMAGECOUNT value on done: 27146.0 [2024-08-05 23:18:45,663][52668] Sum rewards: 21.002, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.585', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.151', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'weapon2': '1.270', 'HITCOUNT': '1.740', 'weapon3': '1.920', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:45,679][52650] Updated weights for policy 0, policy_version 13961 (0.0021) [2024-08-05 23:18:45,933][52794] DAMAGECOUNT value on done: 32988.0 [2024-08-05 23:18:45,933][52794] Sum rewards: 27.714, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.595', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'ARMOR': '0.460', 'WEAPON3': '0.550', 'weapon3': '1.384', 'HITCOUNT': '1.620', 'weapon2': '2.008', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '20.000'} [2024-08-05 23:18:47,226][52662] DAMAGECOUNT value on done: 34431.0 [2024-08-05 23:18:47,228][52662] Sum rewards: 14.597, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.479', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO4': '0.098', 'AMMO3': '0.111', 'WEAPON4': '0.450', 'weapon4': '0.506', 'WEAPON3': '0.850', 'weapon2': '1.346', 'HITCOUNT': '1.440', 'weapon3': '1.922', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '12.000'} [2024-08-05 23:18:47,738][52803] DAMAGECOUNT value on done: 26269.0 [2024-08-05 23:18:47,740][52803] Sum rewards: 27.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.808', 'AMMO4': '-0.052', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.516', 'WEAPON3': '0.800', 'ARMOR': '0.888', 'weapon2': '1.306', 'weapon3': '1.430', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '6.729', 'FRAGCOUNT': '22.000'} [2024-08-05 23:18:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 16911.6). Total num frames: 114393088. Throughput: 0: 4396.2. Samples: 28598510. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:18:47,795][52567] Avg episode reward: [(0, '20.131')] [2024-08-05 23:18:48,014][52811] DAMAGECOUNT value on done: 26033.0 [2024-08-05 23:18:48,018][52811] Sum rewards: 16.787, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.119', 'weapon4': '0.228', 'HEALTH': '0.409', 'WEAPON3': '0.650', 'ARMOR': '0.816', 'HITCOUNT': '1.220', 'weapon2': '1.622', 'weapon3': '1.800', 'DAMAGECOUNT': '4.134', 'FRAGCOUNT': '13.000'} [2024-08-05 23:18:48,498][52660] DAMAGECOUNT value on done: 28084.0 [2024-08-05 23:18:48,499][52660] Sum rewards: 22.720, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.124', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.496', 'WEAPON3': '0.850', 'weapon2': '1.160', 'ARMOR': '1.280', 'HITCOUNT': '1.600', 'weapon3': '1.608', 'DAMAGECOUNT': '5.826', 'FRAGCOUNT': '18.000'} [2024-08-05 23:18:48,525][52668] DAMAGECOUNT value on done: 28369.0 [2024-08-05 23:18:48,526][52668] Sum rewards: 19.583, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.866', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.070', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.318', 'HITCOUNT': '1.530', 'ARMOR': '1.703', 'weapon3': '2.040', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:48,761][52794] DAMAGECOUNT value on done: 33824.0 [2024-08-05 23:18:48,761][52794] Sum rewards: 27.648, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.782', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.370', 'ARMOR': '0.907', 'WEAPON3': '0.950', 'weapon2': '1.216', 'HITCOUNT': '1.640', 'weapon3': '1.980', 'DAMAGECOUNT': '6.486', 'FRAGCOUNT': '23.000'} [2024-08-05 23:18:49,918][52662] DAMAGECOUNT value on done: 32104.0 [2024-08-05 23:18:49,920][52662] Sum rewards: 19.216, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.038', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon3': '1.526', 'weapon2': '1.868', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:50,843][52803] DAMAGECOUNT value on done: 28827.0 [2024-08-05 23:18:50,846][52803] Sum rewards: 24.280, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.148', 'AMMO4': '0.178', 'weapon4': '0.242', 'WEAPON4': '0.450', 'ARMOR': '0.876', 'weapon2': '1.022', 'WEAPON3': '1.100', 'HITCOUNT': '1.860', 'weapon3': '2.440', 'DAMAGECOUNT': '6.924', 'FRAGCOUNT': '21.000'} [2024-08-05 23:18:51,018][52650] Updated weights for policy 0, policy_version 13971 (0.0021) [2024-08-05 23:18:51,258][52811] DAMAGECOUNT value on done: 28667.0 [2024-08-05 23:18:51,259][52811] Sum rewards: 26.730, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.411', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.051', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'weapon3': '1.734', 'HITCOUNT': '1.770', 'weapon2': '2.004', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:51,296][52794] DAMAGECOUNT value on done: 33775.0 [2024-08-05 23:18:51,298][52794] Sum rewards: 22.415, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.800', 'weapon2': '1.332', 'HITCOUNT': '1.440', 'weapon3': '1.912', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '19.000'} [2024-08-05 23:18:51,412][52660] DAMAGECOUNT value on done: 28042.0 [2024-08-05 23:18:51,413][52660] Sum rewards: 16.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.983', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.254', 'ARMOR': '0.855', 'weapon2': '0.942', 'WEAPON3': '1.050', 'HITCOUNT': '1.430', 'weapon3': '2.388', 'DAMAGECOUNT': '4.824', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:51,431][52668] DAMAGECOUNT value on done: 26823.0 [2024-08-05 23:18:51,432][52668] Sum rewards: 15.102, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.996', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.014', 'weapon4': '0.032', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.850', 'HITCOUNT': '1.400', 'weapon3': '1.728', 'weapon2': '1.740', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '12.500'} [2024-08-05 23:18:52,625][52662] DAMAGECOUNT value on done: 34174.0 [2024-08-05 23:18:52,626][52662] Sum rewards: 17.245, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.984', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.128', 'weapon4': '0.168', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.056', 'HITCOUNT': '1.460', 'weapon3': '2.404', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '17.000'} [2024-08-05 23:18:52,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 16939.4). Total num frames: 114483200. Throughput: 0: 4393.8. Samples: 28624770. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 23:18:52,794][52567] Avg episode reward: [(0, '20.104')] [2024-08-05 23:18:53,830][52794] DAMAGECOUNT value on done: 32834.0 [2024-08-05 23:18:53,830][52794] Sum rewards: 22.021, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.969', 'AMMO2': '0.024', 'AMMO3': '0.111', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON3': '0.750', 'ARMOR': '0.934', 'weapon2': '1.204', 'HITCOUNT': '1.640', 'weapon3': '2.068', 'DAMAGECOUNT': '6.282', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:54,030][52660] DAMAGECOUNT value on done: 28659.0 [2024-08-05 23:18:54,033][52660] Sum rewards: 15.422, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.652', 'AMMO4': '-0.043', 'AMMO2': '-0.008', 'weapon4': '0.016', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.951', 'HITCOUNT': '1.210', 'weapon3': '1.574', 'weapon2': '1.808', 'DAMAGECOUNT': '4.503', 'FRAGCOUNT': '12.000'} [2024-08-05 23:18:54,064][52668] DAMAGECOUNT value on done: 26931.0 [2024-08-05 23:18:54,065][52668] Sum rewards: 20.649, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.653', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.095', 'AMMO3': '0.143', 'WEAPON4': '0.250', 'ARMOR': '0.489', 'WEAPON3': '0.950', 'weapon2': '1.268', 'HITCOUNT': '1.510', 'weapon3': '2.404', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '18.000'} [2024-08-05 23:18:54,138][52811] DAMAGECOUNT value on done: 26273.0 [2024-08-05 23:18:54,139][52811] Sum rewards: 14.246, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.860', 'AMMO4': '-0.071', 'AMMO2': '-0.014', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon4': '0.234', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.304', 'HITCOUNT': '1.320', 'weapon3': '1.656', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '13.000'} [2024-08-05 23:18:54,199][52803] DAMAGECOUNT value on done: 24659.0 [2024-08-05 23:18:54,199][52803] Sum rewards: 28.821, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'ARMOR': '1.273', 'weapon2': '1.472', 'weapon3': '1.596', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '21.000'} [2024-08-05 23:18:55,042][52662] DAMAGECOUNT value on done: 31316.0 [2024-08-05 23:18:55,063][52662] Sum rewards: 21.231, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.974', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.804', 'HITCOUNT': '1.600', 'weapon2': '1.640', 'weapon3': '1.676', 'DAMAGECOUNT': '5.535', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:55,134][52650] Updated weights for policy 0, policy_version 13981 (0.0012) [2024-08-05 23:18:56,254][52794] DAMAGECOUNT value on done: 33087.0 [2024-08-05 23:18:56,254][52794] Sum rewards: 14.784, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.846', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.362', 'WEAPON3': '0.750', 'ARMOR': '0.859', 'HITCOUNT': '1.140', 'weapon3': '1.488', 'weapon2': '1.680', 'DAMAGECOUNT': '3.978', 'FRAGCOUNT': '11.000'} [2024-08-05 23:18:56,817][52660] DAMAGECOUNT value on done: 28137.0 [2024-08-05 23:18:56,817][52660] Sum rewards: 15.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.775', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.087', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.457', 'WEAPON3': '1.100', 'HITCOUNT': '1.380', 'weapon2': '1.392', 'weapon3': '2.122', 'DAMAGECOUNT': '5.514', 'FRAGCOUNT': '14.000'} [2024-08-05 23:18:56,860][52668] DAMAGECOUNT value on done: 26612.0 [2024-08-05 23:18:56,861][52668] Sum rewards: 13.356, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO3': '0.132', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'ARMOR': '0.528', 'WEAPON3': '0.850', 'HITCOUNT': '1.300', 'weapon2': '1.736', 'weapon3': '1.856', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '11.000'} [2024-08-05 23:18:57,381][52803] DAMAGECOUNT value on done: 30064.0 [2024-08-05 23:18:57,383][52803] Sum rewards: 13.987, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.850', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'WEAPON3': '0.550', 'weapon4': '0.646', 'ARMOR': '0.867', 'HITCOUNT': '1.400', 'weapon2': '1.454', 'weapon3': '1.590', 'DAMAGECOUNT': '4.773', 'FRAGCOUNT': '10.000'} [2024-08-05 23:18:57,384][52811] DAMAGECOUNT value on done: 26740.0 [2024-08-05 23:18:57,385][52811] Sum rewards: 28.428, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.801', 'weapon4': '0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON3': '0.750', 'weapon2': '1.880', 'HITCOUNT': '1.950', 'weapon3': '1.994', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '22.000'} [2024-08-05 23:18:57,585][52662] DAMAGECOUNT value on done: 32639.0 [2024-08-05 23:18:57,586][52662] Sum rewards: 19.340, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.031', 'weapon7': '0.096', 'AMMO3': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'WEAPON4': '0.300', 'weapon4': '0.548', 'WEAPON3': '0.600', 'ARMOR': '1.014', 'HITCOUNT': '1.290', 'weapon2': '1.322', 'weapon3': '1.522', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '16.000'} [2024-08-05 23:18:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16967.2). Total num frames: 114573312. Throughput: 0: 4380.7. Samples: 28650920. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 23:18:57,795][52567] Avg episode reward: [(0, '20.267')] [2024-08-05 23:18:59,654][52660] DAMAGECOUNT value on done: 27036.0 [2024-08-05 23:18:59,656][52660] Sum rewards: 16.056, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.250', 'ARMOR': '0.426', 'weapon4': '0.510', 'WEAPON3': '0.700', 'HITCOUNT': '1.250', 'weapon2': '1.482', 'weapon3': '1.618', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '12.000'} [2024-08-05 23:18:59,683][52668] DAMAGECOUNT value on done: 27907.0 [2024-08-05 23:18:59,683][52668] Sum rewards: 16.873, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.854', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.032', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'ARMOR': '0.449', 'WEAPON3': '0.700', 'HITCOUNT': '1.300', 'weapon3': '1.862', 'weapon2': '1.974', 'DAMAGECOUNT': '4.890', 'FRAGCOUNT': '13.000'} [2024-08-05 23:18:59,969][52650] Updated weights for policy 0, policy_version 13991 (0.0011) [2024-08-05 23:19:00,406][52811] DAMAGECOUNT value on done: 27643.0 [2024-08-05 23:19:00,409][52811] Sum rewards: 25.456, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.850', 'ARMOR': '0.933', 'weapon2': '1.432', 'HITCOUNT': '1.680', 'weapon3': '2.002', 'DAMAGECOUNT': '6.564', 'FRAGCOUNT': '20.000'} [2024-08-05 23:19:00,457][52803] DAMAGECOUNT value on done: 26651.0 [2024-08-05 23:19:00,459][52803] Sum rewards: 22.480, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.144', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.126', 'weapon4': '0.132', 'WEAPON4': '0.150', 'ARMOR': '0.500', 'WEAPON3': '0.800', 'weapon3': '1.666', 'HITCOUNT': '1.780', 'weapon2': '1.846', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:02,605][52660] DAMAGECOUNT value on done: 27846.0 [2024-08-05 23:19:02,605][52660] Sum rewards: 11.713, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.206', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon4': '0.044', 'weapon5': '0.070', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.880', 'WEAPON3': '0.900', 'HITCOUNT': '1.190', 'weapon3': '1.550', 'weapon2': '1.912', 'DAMAGECOUNT': '4.356', 'FRAGCOUNT': '10.000'} [2024-08-05 23:19:02,640][52668] DAMAGECOUNT value on done: 26852.0 [2024-08-05 23:19:02,643][52668] Sum rewards: 18.960, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.295', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.056', 'AMMO4': '0.059', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '1.430', 'weapon3': '1.464', 'weapon2': '1.758', 'DAMAGECOUNT': '4.707', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 16994.9). Total num frames: 114663424. Throughput: 0: 4391.3. Samples: 28664400. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 23:19:02,794][52567] Avg episode reward: [(0, '20.158')] [2024-08-05 23:19:03,385][52811] DAMAGECOUNT value on done: 28734.0 [2024-08-05 23:19:03,386][52811] Sum rewards: 17.512, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.138', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO3': '0.094', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.256', 'ARMOR': '0.428', 'WEAPON3': '0.600', 'HITCOUNT': '1.230', 'weapon2': '1.624', 'weapon3': '1.638', 'DAMAGECOUNT': '4.869', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:03,499][52803] DAMAGECOUNT value on done: 27386.0 [2024-08-05 23:19:03,501][52803] Sum rewards: 19.279, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.836', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'weapon5': '0.056', 'AMMO3': '0.073', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.232', 'ARMOR': '0.507', 'WEAPON3': '0.550', 'HITCOUNT': '1.210', 'weapon2': '1.430', 'weapon3': '1.436', 'DAMAGECOUNT': '4.440', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:04,928][52650] Updated weights for policy 0, policy_version 14001 (0.0012) [2024-08-05 23:19:05,544][52660] DAMAGECOUNT value on done: 30151.0 [2024-08-05 23:19:05,546][52660] Sum rewards: 23.379, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.637', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'weapon5': '0.040', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.800', 'ARMOR': '0.944', 'weapon2': '1.444', 'HITCOUNT': '1.870', 'weapon3': '2.010', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:05,592][52668] DAMAGECOUNT value on done: 27722.0 [2024-08-05 23:19:05,592][52668] Sum rewards: 9.625, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'ARMOR': '1.258', 'weapon2': '1.384', 'weapon3': '1.972', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '7.000'} [2024-08-05 23:19:06,464][52811] DAMAGECOUNT value on done: 25267.0 [2024-08-05 23:19:06,466][52811] Sum rewards: 26.808, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.877', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.056', 'weapon4': '0.070', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'ARMOR': '1.415', 'HITCOUNT': '1.660', 'weapon2': '1.740', 'weapon3': '1.940', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '23.000'} [2024-08-05 23:19:06,606][52803] DAMAGECOUNT value on done: 25200.0 [2024-08-05 23:19:06,607][52803] Sum rewards: 19.596, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.208', 'WEAPON3': '0.500', 'ARMOR': '0.924', 'HITCOUNT': '1.280', 'weapon3': '1.580', 'weapon2': '1.744', 'DAMAGECOUNT': '4.656', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 16967.2). Total num frames: 114745344. Throughput: 0: 4389.3. Samples: 28690880. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 23:19:07,794][52567] Avg episode reward: [(0, '20.173')] [2024-08-05 23:19:08,287][52660] DAMAGECOUNT value on done: 28493.0 [2024-08-05 23:19:08,290][52660] Sum rewards: 21.739, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.121', 'ARMOR': '0.447', 'WEAPON3': '0.750', 'HITCOUNT': '1.590', 'weapon2': '1.844', 'weapon3': '1.866', 'DAMAGECOUNT': '5.244', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:08,343][52668] DAMAGECOUNT value on done: 28428.0 [2024-08-05 23:19:08,343][52668] Sum rewards: 23.891, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.546', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.114', 'weapon5': '0.174', 'WEAPON3': '0.850', 'ARMOR': '0.858', 'HITCOUNT': '1.330', 'weapon2': '1.616', 'weapon3': '1.912', 'DAMAGECOUNT': '5.802', 'FRAGCOUNT': '19.500'} [2024-08-05 23:19:09,421][52650] Updated weights for policy 0, policy_version 14011 (0.0021) [2024-08-05 23:19:09,597][52811] DAMAGECOUNT value on done: 28114.0 [2024-08-05 23:19:09,598][52811] Sum rewards: 22.077, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.239', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.250', 'weapon4': '0.534', 'WEAPON3': '0.800', 'weapon2': '0.926', 'ARMOR': '0.942', 'HITCOUNT': '1.810', 'weapon3': '1.960', 'DAMAGECOUNT': '6.492', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:09,615][52803] DAMAGECOUNT value on done: 27740.0 [2024-08-05 23:19:09,615][52803] Sum rewards: 19.581, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.244', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'HITCOUNT': '1.630', 'weapon3': '1.712', 'weapon2': '1.784', 'DAMAGECOUNT': '5.781', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:10,891][52660] DAMAGECOUNT value on done: 29742.0 [2024-08-05 23:19:10,900][52660] Sum rewards: 20.212, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'AMMO2': '0.030', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.096', 'AMMO4': '0.148', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '0.750', 'weapon2': '0.994', 'HITCOUNT': '1.620', 'weapon3': '1.914', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:10,933][52668] DAMAGECOUNT value on done: 29953.0 [2024-08-05 23:19:10,937][52668] Sum rewards: 28.419, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.547', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO3': '0.095', 'weapon4': '0.102', 'AMMO4': '0.119', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.330', 'HITCOUNT': '1.810', 'weapon3': '2.044', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '21.500'} [2024-08-05 23:19:11,569][52669] DAMAGECOUNT value on done: 29037.0 [2024-08-05 23:19:11,570][52669] Sum rewards: 18.716, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.905', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.268', 'WEAPON3': '0.650', 'ARMOR': '0.893', 'HITCOUNT': '1.280', 'weapon2': '1.290', 'weapon3': '1.696', 'DAMAGECOUNT': '4.491', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:12,582][52811] DAMAGECOUNT value on done: 26357.0 [2024-08-05 23:19:12,583][52811] Sum rewards: 16.817, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.161', 'AMMO5': '0.020', 'AMMO2': '0.050', 'ARMOR': '0.064', 'AMMO3': '0.107', 'weapon5': '0.154', 'AMMO4': '0.250', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon2': '1.558', 'HITCOUNT': '1.660', 'weapon3': '1.742', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:12,761][52803] DAMAGECOUNT value on done: 26024.0 [2024-08-05 23:19:12,761][52803] Sum rewards: 13.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.448', 'AMMO2': '0.008', 'AMMO5': '0.017', 'weapon4': '0.032', 'AMMO4': '0.040', 'weapon5': '0.062', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.280', 'ARMOR': '1.412', 'HITCOUNT': '1.500', 'weapon3': '2.282', 'DAMAGECOUNT': '5.391', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17022.7). Total num frames: 114835456. Throughput: 0: 4386.2. Samples: 28717230. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:19:12,795][52567] Avg episode reward: [(0, '20.421')] [2024-08-05 23:19:13,805][52650] Updated weights for policy 0, policy_version 14021 (0.0011) [2024-08-05 23:19:13,837][52660] DAMAGECOUNT value on done: 28465.0 [2024-08-05 23:19:13,838][52660] Sum rewards: 20.523, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO2': '0.005', 'AMMO5': '0.011', 'weapon5': '0.014', 'AMMO4': '0.026', 'AMMO3': '0.080', 'HEALTH': '0.094', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'HITCOUNT': '1.350', 'weapon3': '1.598', 'weapon2': '1.828', 'DAMAGECOUNT': '4.566', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:14,015][52669] DAMAGECOUNT value on done: 29296.0 [2024-08-05 23:19:14,018][52669] Sum rewards: 25.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon2': '1.582', 'HITCOUNT': '1.900', 'weapon3': '1.904', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '22.000'} [2024-08-05 23:19:15,731][52811] DAMAGECOUNT value on done: 29385.0 [2024-08-05 23:19:15,735][52811] Sum rewards: 17.559, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.160', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'weapon5': '0.042', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.228', 'WEAPON3': '0.700', 'ARMOR': '0.879', 'HITCOUNT': '1.380', 'weapon3': '1.394', 'weapon2': '1.876', 'DAMAGECOUNT': '4.857', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:15,769][52803] DAMAGECOUNT value on done: 25102.0 [2024-08-05 23:19:15,771][52803] Sum rewards: 29.699, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.394', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'weapon4': '0.518', 'WEAPON3': '0.650', 'ARMOR': '1.380', 'weapon3': '1.490', 'weapon2': '1.576', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '23.000'} [2024-08-05 23:19:15,981][52664] DAMAGECOUNT value on done: 27834.0 [2024-08-05 23:19:15,982][52664] Sum rewards: 9.813, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.078', 'AMMO3': '0.100', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.314', 'WEAPON4': '0.450', 'ARMOR': '0.479', 'WEAPON3': '0.700', 'HITCOUNT': '1.000', 'weapon2': '1.358', 'weapon3': '1.630', 'DAMAGECOUNT': '3.867', 'FRAGCOUNT': '9.000'} [2024-08-05 23:19:16,431][52660] DAMAGECOUNT value on done: 29205.0 [2024-08-05 23:19:16,433][52660] Sum rewards: 24.575, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.084', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'HEALTH': '0.169', 'weapon4': '0.182', 'WEAPON3': '0.550', 'ARMOR': '0.836', 'weapon3': '1.768', 'HITCOUNT': '1.790', 'weapon2': '1.822', 'DAMAGECOUNT': '6.051', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:17,061][52669] DAMAGECOUNT value on done: 28987.0 [2024-08-05 23:19:17,065][52669] Sum rewards: 15.624, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.846', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'WEAPON4': '0.350', 'ARMOR': '0.457', 'weapon4': '0.684', 'WEAPON3': '0.750', 'weapon2': '0.956', 'HITCOUNT': '1.340', 'weapon3': '1.490', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:17,585][52795] DAMAGECOUNT value on done: 25807.0 [2024-08-05 23:19:17,585][52795] Sum rewards: 27.302, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.122', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.125', 'weapon4': '0.220', 'WEAPON3': '0.850', 'ARMOR': '0.955', 'weapon2': '1.254', 'HITCOUNT': '1.700', 'weapon3': '2.120', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '21.000'} [2024-08-05 23:19:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17022.7). Total num frames: 114925568. Throughput: 0: 4394.9. Samples: 28730420. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:19:17,794][52567] Avg episode reward: [(0, '20.322')] [2024-08-05 23:19:18,787][52811] DAMAGECOUNT value on done: 26236.0 [2024-08-05 23:19:18,788][52811] Sum rewards: 12.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.454', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.092', 'AMMO3': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.848', 'HITCOUNT': '1.190', 'weapon3': '1.584', 'weapon2': '1.720', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '9.000'} [2024-08-05 23:19:18,792][52803] DAMAGECOUNT value on done: 27114.0 [2024-08-05 23:19:18,793][52803] Sum rewards: 21.133, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.101', 'AMMO5': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.036', 'weapon5': '0.056', 'AMMO4': '0.121', 'AMMO3': '0.143', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.186', 'HITCOUNT': '1.570', 'weapon3': '1.872', 'DAMAGECOUNT': '6.021', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:18,834][52664] DAMAGECOUNT value on done: 27229.0 [2024-08-05 23:19:18,834][52664] Sum rewards: 18.916, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.240', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.009', 'weapon5': '0.104', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'ARMOR': '0.970', 'HITCOUNT': '1.360', 'weapon2': '1.366', 'weapon3': '1.928', 'DAMAGECOUNT': '4.965', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:19,150][52650] Updated weights for policy 0, policy_version 14031 (0.0022) [2024-08-05 23:19:19,742][52660] DAMAGECOUNT value on done: 27138.0 [2024-08-05 23:19:19,744][52660] Sum rewards: 19.100, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.610', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'weapon4': '0.226', 'WEAPON3': '0.700', 'ARMOR': '0.845', 'HITCOUNT': '1.460', 'weapon2': '1.528', 'weapon3': '1.768', 'DAMAGECOUNT': '5.043', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:19,964][52669] DAMAGECOUNT value on done: 29102.0 [2024-08-05 23:19:19,966][52669] Sum rewards: 24.895, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.115', 'weapon4': '0.148', 'weapon5': '0.162', 'WEAPON5': '0.200', 'ARMOR': '0.441', 'WEAPON3': '0.800', 'weapon2': '1.356', 'HITCOUNT': '1.660', 'weapon3': '1.980', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '20.000'} [2024-08-05 23:19:20,853][52795] DAMAGECOUNT value on done: 24681.0 [2024-08-05 23:19:20,854][52795] Sum rewards: 28.408, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.252', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.442', 'WEAPON3': '0.900', 'weapon2': '0.994', 'ARMOR': '1.356', 'HITCOUNT': '1.990', 'weapon3': '2.220', 'DAMAGECOUNT': '7.782', 'FRAGCOUNT': '21.000'} [2024-08-05 23:19:21,814][52664] DAMAGECOUNT value on done: 30680.0 [2024-08-05 23:19:21,814][52664] Sum rewards: 16.039, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.025', 'AMMO2': '0.009', 'AMMO5': '0.015', 'AMMO4': '0.045', 'AMMO3': '0.067', 'weapon5': '0.078', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.600', 'weapon4': '0.700', 'ARMOR': '0.919', 'HITCOUNT': '1.280', 'weapon3': '1.282', 'weapon2': '1.356', 'DAMAGECOUNT': '5.013', 'FRAGCOUNT': '12.000'} [2024-08-05 23:19:21,883][52803] DAMAGECOUNT value on done: 26971.0 [2024-08-05 23:19:21,885][52803] Sum rewards: 18.209, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.074', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'ARMOR': '1.766', 'weapon2': '1.768', 'weapon3': '1.894', 'DAMAGECOUNT': '4.728', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:21,924][52811] DAMAGECOUNT value on done: 27002.0 [2024-08-05 23:19:21,926][52811] Sum rewards: 20.519, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.278', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.192', 'WEAPON7': '0.200', 'WEAPON3': '0.900', 'weapon2': '0.998', 'HITCOUNT': '1.600', 'weapon3': '1.982', 'DAMAGECOUNT': '5.790', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:22,020][52665] DAMAGECOUNT value on done: 26252.0 [2024-08-05 23:19:22,021][52665] Sum rewards: 17.868, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.778', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.040', 'weapon5': '0.098', 'AMMO4': '0.098', 'AMMO3': '0.140', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.154', 'HITCOUNT': '1.320', 'weapon3': '1.744', 'DAMAGECOUNT': '5.076', 'FRAGCOUNT': '15.500'} [2024-08-05 23:19:22,375][52669] DAMAGECOUNT value on done: 29535.0 [2024-08-05 23:19:22,375][52669] Sum rewards: 19.463, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.244', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.232', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon2': '1.474', 'weapon3': '1.958', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17050.5). Total num frames: 115015680. Throughput: 0: 4394.9. Samples: 28756790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:19:22,794][52567] Avg episode reward: [(0, '20.233')] [2024-08-05 23:19:22,995][52650] Updated weights for policy 0, policy_version 14041 (0.0012) [2024-08-05 23:19:24,008][52795] DAMAGECOUNT value on done: 25334.0 [2024-08-05 23:19:24,008][52795] Sum rewards: 16.067, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.548', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.169', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'HITCOUNT': '1.280', 'weapon2': '1.350', 'weapon3': '1.992', 'DAMAGECOUNT': '4.881', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:24,425][52665] DAMAGECOUNT value on done: 28292.0 [2024-08-05 23:19:24,426][52665] Sum rewards: 28.441, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.802', 'ARMOR': '0.028', 'AMMO2': '0.040', 'AMMO3': '0.112', 'AMMO4': '0.202', 'WEAPON4': '0.450', 'weapon4': '0.686', 'weapon2': '0.738', 'WEAPON3': '0.900', 'HITCOUNT': '2.100', 'weapon3': '2.198', 'DAMAGECOUNT': '7.539', 'FRAGCOUNT': '22.000'} [2024-08-05 23:19:24,950][52664] DAMAGECOUNT value on done: 29385.0 [2024-08-05 23:19:24,950][52664] Sum rewards: 24.499, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'HEALTH': '0.234', 'weapon4': '0.328', 'WEAPON3': '0.600', 'ARMOR': '0.924', 'weapon2': '1.464', 'HITCOUNT': '1.560', 'weapon3': '1.748', 'DAMAGECOUNT': '5.913', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:25,026][52803] DAMAGECOUNT value on done: 24722.0 [2024-08-05 23:19:25,029][52803] Sum rewards: 27.223, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.274', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO3': '0.060', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'weapon5': '0.186', 'WEAPON4': '0.200', 'ARMOR': '0.416', 'WEAPON3': '0.450', 'weapon4': '0.648', 'weapon2': '0.716', 'weapon3': '1.420', 'HITCOUNT': '1.580', 'DAMAGECOUNT': '6.306', 'FRAGCOUNT': '19.000'} [2024-08-05 23:19:25,088][52811] DAMAGECOUNT value on done: 26809.0 [2024-08-05 23:19:25,089][52811] Sum rewards: 18.866, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.132', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '0.850', 'ARMOR': '0.897', 'weapon4': '1.096', 'HITCOUNT': '1.450', 'weapon3': '1.570', 'DAMAGECOUNT': '5.031', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:25,120][52669] DAMAGECOUNT value on done: 31013.0 [2024-08-05 23:19:25,120][52669] Sum rewards: 23.119, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.032', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO3': '0.096', 'WEAPON4': '0.250', 'weapon4': '0.434', 'WEAPON3': '0.750', 'weapon2': '1.492', 'weapon3': '1.582', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:27,140][52795] DAMAGECOUNT value on done: 26609.0 [2024-08-05 23:19:27,142][52795] Sum rewards: 29.092, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'HEALTH': '0.156', 'WEAPON3': '0.750', 'ARMOR': '0.850', 'weapon2': '1.440', 'HITCOUNT': '2.010', 'weapon3': '2.282', 'DAMAGECOUNT': '7.725', 'FRAGCOUNT': '21.000'} [2024-08-05 23:19:27,555][52665] DAMAGECOUNT value on done: 29553.0 [2024-08-05 23:19:27,557][52665] Sum rewards: 26.357, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.306', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'ARMOR': '0.462', 'weapon4': '0.496', 'WEAPON3': '0.700', 'weapon2': '1.244', 'weapon3': '1.782', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '7.149', 'FRAGCOUNT': '19.000'} [2024-08-05 23:19:27,744][52664] DAMAGECOUNT value on done: 27478.0 [2024-08-05 23:19:27,745][52664] Sum rewards: 14.743, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO3': '0.135', 'AMMO4': '0.176', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'HITCOUNT': '1.240', 'ARMOR': '1.283', 'weapon3': '1.354', 'weapon2': '1.812', 'DAMAGECOUNT': '4.275', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 16994.9). Total num frames: 115089408. Throughput: 0: 4391.4. Samples: 28782960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:19:27,794][52567] Avg episode reward: [(0, '20.327')] [2024-08-05 23:19:28,096][52650] Updated weights for policy 0, policy_version 14051 (0.0024) [2024-08-05 23:19:28,194][52669] DAMAGECOUNT value on done: 30148.0 [2024-08-05 23:19:28,195][52669] Sum rewards: 22.232, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.367', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'weapon4': '0.160', 'WEAPON4': '0.200', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'weapon3': '1.640', 'weapon2': '1.672', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '6.075', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:28,196][52803] DAMAGECOUNT value on done: 25989.0 [2024-08-05 23:19:28,196][52803] Sum rewards: 19.672, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.666', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon5': '0.062', 'AMMO3': '0.112', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'HITCOUNT': '1.330', 'ARMOR': '1.350', 'weapon2': '1.424', 'weapon3': '1.906', 'DAMAGECOUNT': '6.144', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:28,199][52811] DAMAGECOUNT value on done: 27323.0 [2024-08-05 23:19:28,199][52811] Sum rewards: 23.228, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.255', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.478', 'WEAPON3': '0.850', 'ARMOR': '0.947', 'weapon2': '1.024', 'HITCOUNT': '1.670', 'weapon3': '2.082', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:30,063][52665] DAMAGECOUNT value on done: 29159.0 [2024-08-05 23:19:30,063][52665] Sum rewards: 21.897, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.234', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.060', 'weapon5': '0.096', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'WEAPON3': '0.450', 'weapon4': '0.568', 'weapon2': '1.096', 'weapon3': '1.354', 'HITCOUNT': '1.530', 'DAMAGECOUNT': '4.941', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:30,322][52795] DAMAGECOUNT value on done: 29007.0 [2024-08-05 23:19:30,324][52795] Sum rewards: 17.372, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-1.080', 'AMMO4': '-0.102', 'AMMO2': '-0.020', 'AMMO5': '0.005', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON3': '0.550', 'HITCOUNT': '1.060', 'weapon3': '1.442', 'weapon2': '1.820', 'DAMAGECOUNT': '4.173', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:31,024][52664] DAMAGECOUNT value on done: 31527.0 [2024-08-05 23:19:31,025][52664] Sum rewards: 22.851, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.535', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.132', 'weapon4': '0.156', 'WEAPON4': '0.200', 'ARMOR': '0.899', 'WEAPON3': '0.900', 'HITCOUNT': '1.580', 'weapon2': '1.624', 'weapon3': '1.842', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '19.000'} [2024-08-05 23:19:31,266][52669] DAMAGECOUNT value on done: 27693.0 [2024-08-05 23:19:31,266][52669] Sum rewards: 26.745, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.435', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'AMMO3': '0.081', 'WEAPON3': '0.550', 'HITCOUNT': '1.450', 'weapon2': '1.924', 'weapon3': '1.970', 'ARMOR': '2.198', 'DAMAGECOUNT': '5.517', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:31,297][52811] DAMAGECOUNT value on done: 25969.0 [2024-08-05 23:19:31,300][52811] Sum rewards: 24.545, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.711', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.095', 'weapon5': '0.102', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.834', 'weapon2': '0.972', 'weapon3': '1.430', 'HITCOUNT': '1.440', 'DAMAGECOUNT': '5.673', 'FRAGCOUNT': '19.000'} [2024-08-05 23:19:31,368][52667] DAMAGECOUNT value on done: 28295.0 [2024-08-05 23:19:31,368][52667] Sum rewards: 16.957, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.604', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.067', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.292', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'HITCOUNT': '1.210', 'weapon3': '1.418', 'weapon2': '1.480', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:31,587][52803] DAMAGECOUNT value on done: 27332.0 [2024-08-05 23:19:31,588][52803] Sum rewards: 11.714, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.094', 'weapon5': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.090', 'weapon4': '0.122', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.464', 'WEAPON3': '0.650', 'HITCOUNT': '1.350', 'weapon3': '1.508', 'weapon2': '1.836', 'DAMAGECOUNT': '4.590', 'FRAGCOUNT': '8.000'} [2024-08-05 23:19:32,727][52650] Updated weights for policy 0, policy_version 14061 (0.0016) [2024-08-05 23:19:32,762][52665] DAMAGECOUNT value on done: 27383.0 [2024-08-05 23:19:32,764][52665] Sum rewards: 26.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.068', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'WEAPON3': '0.900', 'ARMOR': '0.939', 'weapon2': '1.428', 'HITCOUNT': '1.970', 'weapon3': '2.256', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '21.500'} [2024-08-05 23:19:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17050.5). Total num frames: 115187712. Throughput: 0: 4385.1. Samples: 28795840. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-05 23:19:32,794][52567] Avg episode reward: [(0, '20.078')] [2024-08-05 23:19:33,461][52795] DAMAGECOUNT value on done: 28257.0 [2024-08-05 23:19:33,463][52795] Sum rewards: 25.138, reward structure: {'DEATHCOUNT': '-6.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO3': '0.086', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.120', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'HITCOUNT': '1.330', 'weapon3': '1.346', 'weapon2': '2.044', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '20.000'} [2024-08-05 23:19:33,701][52664] DAMAGECOUNT value on done: 30062.0 [2024-08-05 23:19:33,701][52664] Sum rewards: 31.707, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.374', 'weapon4': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.455', 'WEAPON3': '0.800', 'weapon2': '1.510', 'weapon3': '1.880', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '25.000'} [2024-08-05 23:19:34,180][52669] DAMAGECOUNT value on done: 28548.0 [2024-08-05 23:19:34,200][52669] Sum rewards: 24.915, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO3': '0.135', 'AMMO4': '0.137', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON3': '0.850', 'ARMOR': '0.884', 'weapon2': '1.152', 'HITCOUNT': '1.790', 'weapon3': '2.054', 'DAMAGECOUNT': '6.519', 'FRAGCOUNT': '20.000'} [2024-08-05 23:19:34,348][52811] DAMAGECOUNT value on done: 27464.0 [2024-08-05 23:19:34,348][52811] Sum rewards: 24.970, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.450', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.101', 'AMMO4': '0.141', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.520', 'weapon3': '1.758', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '6.297', 'FRAGCOUNT': '20.000'} [2024-08-05 23:19:34,599][52667] DAMAGECOUNT value on done: 30332.0 [2024-08-05 23:19:34,600][52667] Sum rewards: 22.604, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.543', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.077', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.474', 'WEAPON3': '0.550', 'weapon2': '1.076', 'HITCOUNT': '1.520', 'weapon3': '1.524', 'DAMAGECOUNT': '5.055', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:34,811][52803] DAMAGECOUNT value on done: 27955.0 [2024-08-05 23:19:34,812][52803] Sum rewards: 17.700, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.104', 'AMMO3': '0.132', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.382', 'ARMOR': '0.516', 'WEAPON3': '0.850', 'HITCOUNT': '1.310', 'weapon2': '1.350', 'weapon3': '1.714', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:35,773][52665] DAMAGECOUNT value on done: 26842.0 [2024-08-05 23:19:35,780][52665] Sum rewards: 16.580, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.862', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.166', 'WEAPON3': '0.650', 'HITCOUNT': '1.170', 'ARMOR': '1.324', 'weapon3': '1.638', 'weapon2': '1.802', 'DAMAGECOUNT': '3.744', 'FRAGCOUNT': '12.000'} [2024-08-05 23:19:36,604][52795] DAMAGECOUNT value on done: 30537.0 [2024-08-05 23:19:36,604][52795] Sum rewards: 23.472, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.050', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.070', 'AMMO4': '0.109', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.450', 'weapon2': '1.448', 'weapon3': '1.592', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '6.702', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:36,752][52664] DAMAGECOUNT value on done: 26782.0 [2024-08-05 23:19:36,752][52664] Sum rewards: 21.999, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.029', 'AMMO3': '0.117', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.656', 'WEAPON3': '0.700', 'weapon2': '1.122', 'ARMOR': '1.240', 'HITCOUNT': '1.530', 'weapon3': '1.830', 'DAMAGECOUNT': '5.646', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:36,934][52669] DAMAGECOUNT value on done: 27952.0 [2024-08-05 23:19:36,934][52669] Sum rewards: 16.651, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.414', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon5': '0.128', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'ARMOR': '0.436', 'weapon4': '0.606', 'WEAPON3': '0.700', 'weapon2': '0.880', 'HITCOUNT': '0.970', 'weapon3': '1.534', 'DAMAGECOUNT': '4.164', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:37,168][52667] DAMAGECOUNT value on done: 28192.0 [2024-08-05 23:19:37,168][52667] Sum rewards: 23.376, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.937', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO3': '0.114', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.762', 'weapon3': '1.802', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '17.500'} [2024-08-05 23:19:37,385][52811] DAMAGECOUNT value on done: 29780.0 [2024-08-05 23:19:37,385][52811] Sum rewards: 31.362, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.817', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'weapon5': '0.102', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'weapon2': '1.282', 'HITCOUNT': '1.810', 'weapon3': '2.378', 'DAMAGECOUNT': '8.544', 'FRAGCOUNT': '25.000'} [2024-08-05 23:19:37,434][52650] Updated weights for policy 0, policy_version 14071 (0.0021) [2024-08-05 23:19:37,674][52803] DAMAGECOUNT value on done: 26343.0 [2024-08-05 23:19:37,675][52803] Sum rewards: 14.760, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.111', 'HEALTH': '0.174', 'weapon4': '0.438', 'WEAPON3': '0.650', 'ARMOR': '1.251', 'HITCOUNT': '1.320', 'weapon2': '1.388', 'weapon3': '1.866', 'DAMAGECOUNT': '4.689', 'FRAGCOUNT': '11.500'} [2024-08-05 23:19:37,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17078.2). Total num frames: 115277824. Throughput: 0: 4385.1. Samples: 28822100. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-05 23:19:37,794][52567] Avg episode reward: [(0, '20.838')] [2024-08-05 23:19:38,571][52665] DAMAGECOUNT value on done: 29608.0 [2024-08-05 23:19:38,571][52665] Sum rewards: 27.629, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.360', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'weapon5': '0.062', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.290', 'ARMOR': '0.432', 'WEAPON3': '0.800', 'weapon2': '1.314', 'weapon3': '1.602', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.333', 'FRAGCOUNT': '22.000'} [2024-08-05 23:19:39,537][52666] DAMAGECOUNT value on done: 26642.0 [2024-08-05 23:19:39,537][52666] Sum rewards: 22.754, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.119', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.066', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.232', 'WEAPON3': '0.700', 'ARMOR': '1.261', 'weapon2': '1.594', 'HITCOUNT': '1.690', 'weapon3': '1.728', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:39,848][52795] DAMAGECOUNT value on done: 26903.0 [2024-08-05 23:19:39,849][52795] Sum rewards: 19.618, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.729', 'AMMO5': '0.018', 'AMMO2': '0.023', 'AMMO3': '0.085', 'weapon5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.884', 'HITCOUNT': '1.330', 'weapon2': '1.474', 'weapon3': '1.734', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:39,904][52669] DAMAGECOUNT value on done: 29416.0 [2024-08-05 23:19:39,906][52669] Sum rewards: 23.174, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.185', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.135', 'AMMO3': '0.161', 'weapon4': '0.486', 'WEAPON4': '0.500', 'ARMOR': '0.941', 'weapon2': '1.038', 'WEAPON3': '1.100', 'HITCOUNT': '1.580', 'weapon3': '1.852', 'DAMAGECOUNT': '6.420', 'FRAGCOUNT': '20.000'} [2024-08-05 23:19:39,953][52664] DAMAGECOUNT value on done: 32831.0 [2024-08-05 23:19:39,953][52664] Sum rewards: 34.620, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.152', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.020', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.248', 'ARMOR': '0.877', 'WEAPON3': '0.950', 'weapon2': '1.204', 'HITCOUNT': '2.190', 'weapon3': '2.300', 'DAMAGECOUNT': '8.958', 'FRAGCOUNT': '28.000'} [2024-08-05 23:19:39,987][52667] DAMAGECOUNT value on done: 28904.0 [2024-08-05 23:19:39,988][52667] Sum rewards: 22.278, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.870', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'weapon5': '0.026', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON3': '0.950', 'ARMOR': '1.279', 'HITCOUNT': '1.710', 'weapon2': '1.732', 'weapon3': '1.932', 'DAMAGECOUNT': '6.861', 'FRAGCOUNT': '19.000'} [2024-08-05 23:19:40,394][52811] DAMAGECOUNT value on done: 25476.0 [2024-08-05 23:19:40,396][52811] Sum rewards: 23.568, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.637', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.092', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.892', 'HITCOUNT': '1.440', 'weapon2': '1.448', 'weapon3': '1.894', 'DAMAGECOUNT': '5.364', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:41,270][52665] DAMAGECOUNT value on done: 29596.0 [2024-08-05 23:19:41,274][52665] Sum rewards: 19.822, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.696', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.137', 'WEAPON4': '0.500', 'weapon4': '0.686', 'weapon2': '0.948', 'WEAPON3': '0.950', 'ARMOR': '1.295', 'HITCOUNT': '1.610', 'weapon3': '1.822', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:41,963][52650] Updated weights for policy 0, policy_version 14081 (0.0026) [2024-08-05 23:19:42,462][52666] DAMAGECOUNT value on done: 27899.0 [2024-08-05 23:19:42,462][52666] Sum rewards: 28.166, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.965', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.080', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'ARMOR': '0.453', 'WEAPON3': '0.950', 'weapon2': '1.536', 'HITCOUNT': '1.910', 'weapon3': '2.038', 'DAMAGECOUNT': '7.347', 'FRAGCOUNT': '23.000'} [2024-08-05 23:19:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17050.5). Total num frames: 115359744. Throughput: 0: 4392.0. Samples: 28848560. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-05 23:19:42,794][52567] Avg episode reward: [(0, '21.087')] [2024-08-05 23:19:42,850][52664] DAMAGECOUNT value on done: 29098.0 [2024-08-05 23:19:42,851][52664] Sum rewards: 10.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.318', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.042', 'AMMO3': '0.107', 'weapon5': '0.112', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'HITCOUNT': '1.280', 'ARMOR': '1.323', 'weapon2': '1.638', 'weapon3': '1.830', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '7.000'} [2024-08-05 23:19:42,997][52795] DAMAGECOUNT value on done: 25498.0 [2024-08-05 23:19:42,998][52795] Sum rewards: 18.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.683', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.020', 'weapon7': '0.078', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.368', 'ARMOR': '0.913', 'weapon2': '0.964', 'WEAPON3': '1.000', 'HITCOUNT': '1.570', 'weapon3': '2.064', 'DAMAGECOUNT': '6.339', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:43,062][52669] DAMAGECOUNT value on done: 31927.0 [2024-08-05 23:19:43,063][52669] Sum rewards: 25.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'weapon5': '0.002', 'AMMO2': '0.009', 'AMMO5': '0.013', 'AMMO4': '0.043', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'ARMOR': '0.872', 'weapon2': '1.108', 'WEAPON3': '1.200', 'HITCOUNT': '1.860', 'weapon3': '2.496', 'DAMAGECOUNT': '7.020', 'FRAGCOUNT': '23.000'} [2024-08-05 23:19:43,176][52667] DAMAGECOUNT value on done: 28803.0 [2024-08-05 23:19:43,176][52667] Sum rewards: 18.043, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.812', 'AMMO2': '0.023', 'ARMOR': '0.044', 'AMMO3': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '0.700', 'HITCOUNT': '1.280', 'weapon2': '1.294', 'weapon3': '1.766', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:43,425][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:19:43,695][52811] DAMAGECOUNT value on done: 26038.0 [2024-08-05 23:19:43,695][52811] Sum rewards: 22.612, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.735', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.888', 'HITCOUNT': '1.390', 'weapon2': '1.520', 'weapon3': '1.906', 'DAMAGECOUNT': '5.670', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:44,496][52665] DAMAGECOUNT value on done: 29908.0 [2024-08-05 23:19:44,496][52665] Sum rewards: 19.076, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'ARMOR': '0.412', 'WEAPON3': '0.750', 'HITCOUNT': '1.250', 'weapon2': '1.696', 'weapon3': '1.764', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:44,646][52670] DAMAGECOUNT value on done: 28906.0 [2024-08-05 23:19:44,646][52670] Sum rewards: 28.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.813', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.516', 'weapon2': '0.800', 'ARMOR': '0.870', 'WEAPON3': '1.250', 'weapon3': '2.046', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '7.983', 'FRAGCOUNT': '27.000'} [2024-08-05 23:19:45,422][52664] DAMAGECOUNT value on done: 32462.0 [2024-08-05 23:19:45,424][52664] Sum rewards: 24.483, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.655', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'ARMOR': '0.032', 'weapon7': '0.064', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.270', 'weapon5': '0.348', 'WEAPON3': '0.500', 'weapon2': '1.386', 'HITCOUNT': '1.480', 'weapon3': '1.658', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:45,567][52666] DAMAGECOUNT value on done: 27398.0 [2024-08-05 23:19:45,570][52666] Sum rewards: 18.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.708', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.176', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'weapon4': '0.336', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.460', 'HITCOUNT': '1.700', 'weapon3': '1.934', 'DAMAGECOUNT': '6.018', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:45,760][52667] DAMAGECOUNT value on done: 31150.0 [2024-08-05 23:19:45,761][52667] Sum rewards: 18.072, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.766', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.144', 'WEAPON3': '1.000', 'ARMOR': '1.339', 'weapon2': '1.434', 'HITCOUNT': '1.590', 'weapon3': '2.136', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:45,884][52669] DAMAGECOUNT value on done: 27538.0 [2024-08-05 23:19:45,884][52669] Sum rewards: 17.129, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.270', 'AMMO4': '-0.091', 'AMMO2': '-0.018', 'AMMO3': '0.130', 'ARMOR': '0.865', 'WEAPON3': '1.000', 'HITCOUNT': '1.530', 'weapon2': '1.678', 'weapon3': '2.042', 'DAMAGECOUNT': '5.763', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:46,154][52795] DAMAGECOUNT value on done: 27227.0 [2024-08-05 23:19:46,154][52795] Sum rewards: 15.894, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.042', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'ARMOR': '1.258', 'weapon3': '1.392', 'HITCOUNT': '1.580', 'weapon2': '1.928', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '12.000'} [2024-08-05 23:19:46,742][52650] Updated weights for policy 0, policy_version 14091 (0.0025) [2024-08-05 23:19:47,032][52666] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:19:47,304][52670] DAMAGECOUNT value on done: 29164.0 [2024-08-05 23:19:47,305][52670] Sum rewards: 21.388, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.912', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.076', 'weapon5': '0.084', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.256', 'ARMOR': '0.451', 'WEAPON3': '0.750', 'weapon2': '1.402', 'HITCOUNT': '1.630', 'weapon3': '1.652', 'DAMAGECOUNT': '5.460', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:47,314][52665] DAMAGECOUNT value on done: 29513.0 [2024-08-05 23:19:47,315][52665] Sum rewards: 21.340, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.776', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.004', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon4': '0.186', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.446', 'HITCOUNT': '1.460', 'weapon3': '1.580', 'DAMAGECOUNT': '5.370', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:47,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17106.0). Total num frames: 115449856. Throughput: 0: 4385.3. Samples: 28861740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-05 23:19:47,795][52567] Avg episode reward: [(0, '21.138')] [2024-08-05 23:19:48,156][52666] DAMAGECOUNT value on done: 27310.0 [2024-08-05 23:19:48,157][52666] Sum rewards: 27.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.496', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.031', 'AMMO3': '0.136', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.406', 'ARMOR': '0.477', 'WEAPON3': '0.850', 'weapon2': '1.024', 'HITCOUNT': '1.690', 'weapon3': '1.978', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '23.000'} [2024-08-05 23:19:48,426][52664] DAMAGECOUNT value on done: 28888.0 [2024-08-05 23:19:48,426][52664] Sum rewards: 17.666, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.189', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon4': '0.436', 'ARMOR': '0.876', 'WEAPON3': '0.900', 'weapon2': '1.296', 'HITCOUNT': '1.670', 'weapon3': '1.892', 'DAMAGECOUNT': '5.340', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:48,708][52669] DAMAGECOUNT value on done: 29499.0 [2024-08-05 23:19:48,710][52669] Sum rewards: 20.373, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.300', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO3': '0.081', 'weapon5': '0.116', 'AMMO4': '0.122', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.413', 'WEAPON3': '0.600', 'weapon4': '0.748', 'weapon2': '0.790', 'HITCOUNT': '1.500', 'weapon3': '1.966', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:48,834][52667] DAMAGECOUNT value on done: 29985.0 [2024-08-05 23:19:48,834][52667] Sum rewards: 15.297, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.914', 'AMMO4': '-0.085', 'AMMO2': '-0.017', 'AMMO5': '0.003', 'AMMO3': '0.076', 'weapon5': '0.076', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'HITCOUNT': '1.030', 'weapon3': '1.354', 'weapon2': '1.430', 'ARMOR': '1.469', 'DAMAGECOUNT': '3.675', 'FRAGCOUNT': '11.000'} [2024-08-05 23:19:49,319][52795] DAMAGECOUNT value on done: 27463.0 [2024-08-05 23:19:49,320][52795] Sum rewards: 19.658, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.899', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.128', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.604', 'HITCOUNT': '1.720', 'weapon3': '2.144', 'DAMAGECOUNT': '5.706', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:49,389][52614] Signal inference workers to stop experience collection... (2600 times) [2024-08-05 23:19:49,389][52614] Signal inference workers to resume experience collection... (2600 times) [2024-08-05 23:19:49,438][52650] InferenceWorker_p0-w0: stopping experience collection (2600 times) [2024-08-05 23:19:49,439][52650] InferenceWorker_p0-w0: resuming experience collection (2600 times) [2024-08-05 23:19:50,028][52670] DAMAGECOUNT value on done: 27781.0 [2024-08-05 23:19:50,030][52670] Sum rewards: 20.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.423', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.222', 'ARMOR': '0.474', 'WEAPON3': '0.900', 'HITCOUNT': '1.710', 'weapon3': '1.744', 'weapon2': '1.818', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:50,084][52665] DAMAGECOUNT value on done: 29679.0 [2024-08-05 23:19:50,085][52665] Sum rewards: 30.647, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.685', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'weapon4': '0.246', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.446', 'weapon3': '1.746', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.543', 'FRAGCOUNT': '24.000'} [2024-08-05 23:19:50,725][52663] DAMAGECOUNT value on done: 29333.0 [2024-08-05 23:19:50,725][52663] Sum rewards: 20.100, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.189', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon4': '0.714', 'ARMOR': '0.941', 'weapon2': '1.032', 'HITCOUNT': '1.570', 'weapon3': '1.944', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:50,872][52664] DAMAGECOUNT value on done: 29420.0 [2024-08-05 23:19:50,873][52664] Sum rewards: 24.381, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.662', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.116', 'WEAPON4': '0.300', 'weapon4': '0.610', 'WEAPON3': '0.750', 'ARMOR': '0.809', 'weapon2': '1.154', 'weapon3': '1.566', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '6.528', 'FRAGCOUNT': '18.000'} [2024-08-05 23:19:50,965][52666] DAMAGECOUNT value on done: 26517.0 [2024-08-05 23:19:50,966][52666] Sum rewards: 23.320, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.836', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'weapon5': '0.096', 'AMMO3': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.346', 'ARMOR': '0.465', 'WEAPON3': '0.750', 'weapon2': '1.294', 'HITCOUNT': '1.670', 'weapon3': '1.734', 'DAMAGECOUNT': '6.405', 'FRAGCOUNT': '19.000'} [2024-08-05 23:19:51,313][52650] Updated weights for policy 0, policy_version 14101 (0.0025) [2024-08-05 23:19:51,573][52669] DAMAGECOUNT value on done: 29197.0 [2024-08-05 23:19:51,574][52669] Sum rewards: 18.688, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.060', 'weapon4': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.857', 'HITCOUNT': '1.250', 'weapon3': '1.752', 'weapon2': '1.984', 'DAMAGECOUNT': '4.236', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:51,805][52667] DAMAGECOUNT value on done: 28477.0 [2024-08-05 23:19:51,807][52667] Sum rewards: 17.487, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.746', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.124', 'WEAPON3': '0.750', 'ARMOR': '0.857', 'HITCOUNT': '1.590', 'weapon2': '1.708', 'weapon3': '1.772', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:52,394][52795] DAMAGECOUNT value on done: 25641.0 [2024-08-05 23:19:52,394][52795] Sum rewards: 15.704, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.696', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'AMMO3': '0.098', 'weapon4': '0.234', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'weapon2': '1.160', 'HITCOUNT': '1.180', 'weapon3': '1.662', 'DAMAGECOUNT': '3.819', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:52,674][52665] DAMAGECOUNT value on done: 27787.0 [2024-08-05 23:19:52,674][52665] Sum rewards: 20.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.504', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.119', 'weapon4': '0.154', 'WEAPON3': '0.750', 'ARMOR': '1.249', 'weapon2': '1.440', 'HITCOUNT': '1.600', 'weapon3': '1.964', 'DAMAGECOUNT': '5.772', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17300.4). Total num frames: 115539968. Throughput: 0: 4379.3. Samples: 28887950. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-05 23:19:52,794][52567] Avg episode reward: [(0, '21.483')] [2024-08-05 23:19:53,044][52670] DAMAGECOUNT value on done: 29273.0 [2024-08-05 23:19:53,044][52670] Sum rewards: 27.275, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.505', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.060', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.208', 'ARMOR': '0.428', 'WEAPON3': '0.900', 'weapon2': '1.244', 'HITCOUNT': '1.690', 'weapon3': '1.992', 'DAMAGECOUNT': '6.324', 'FRAGCOUNT': '23.000'} [2024-08-05 23:19:53,365][52663] DAMAGECOUNT value on done: 28960.0 [2024-08-05 23:19:53,368][52663] Sum rewards: 24.569, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.937', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.024', 'AMMO4': '0.094', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '1.404', 'weapon2': '1.584', 'HITCOUNT': '1.950', 'weapon3': '2.156', 'DAMAGECOUNT': '6.933', 'FRAGCOUNT': '19.000'} [2024-08-05 23:19:53,924][52666] DAMAGECOUNT value on done: 26650.0 [2024-08-05 23:19:53,928][52666] Sum rewards: 19.520, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.286', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.087', 'weapon5': '0.170', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.529', 'weapon2': '0.576', 'WEAPON3': '0.650', 'weapon4': '1.044', 'HITCOUNT': '1.210', 'weapon3': '1.648', 'DAMAGECOUNT': '4.908', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:53,980][52664] DAMAGECOUNT value on done: 28280.0 [2024-08-05 23:19:53,980][52664] Sum rewards: 28.566, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.474', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.072', 'AMMO3': '0.102', 'AMMO4': '0.144', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '1.548', 'weapon3': '1.856', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '6.963', 'FRAGCOUNT': '21.000'} [2024-08-05 23:19:54,132][52669] DAMAGECOUNT value on done: 30043.0 [2024-08-05 23:19:54,133][52669] Sum rewards: 19.189, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.191', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO3': '0.064', 'AMMO4': '0.074', 'WEAPON5': '0.150', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.436', 'WEAPON3': '0.450', 'ARMOR': '0.497', 'weapon3': '1.328', 'HITCOUNT': '1.340', 'weapon2': '1.342', 'DAMAGECOUNT': '4.701', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:54,488][52667] DAMAGECOUNT value on done: 30420.0 [2024-08-05 23:19:54,488][52667] Sum rewards: 32.096, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.218', 'AMMO5': '0.011', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.065', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.468', 'WEAPON3': '0.750', 'ARMOR': '0.823', 'weapon2': '1.372', 'weapon3': '1.730', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '6.354', 'FRAGCOUNT': '25.000'} [2024-08-05 23:19:55,523][52665] DAMAGECOUNT value on done: 27535.0 [2024-08-05 23:19:55,524][52665] Sum rewards: 20.195, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.275', 'AMMO2': '0.028', 'weapon4': '0.112', 'AMMO3': '0.115', 'AMMO4': '0.139', 'WEAPON4': '0.300', 'ARMOR': '0.498', 'WEAPON3': '0.800', 'HITCOUNT': '1.510', 'weapon2': '1.730', 'weapon3': '1.996', 'DAMAGECOUNT': '4.992', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:55,542][52795] DAMAGECOUNT value on done: 29330.0 [2024-08-05 23:19:55,542][52795] Sum rewards: 15.956, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.050', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.036', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.674', 'weapon2': '1.016', 'HITCOUNT': '1.450', 'weapon3': '1.836', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '12.500'} [2024-08-05 23:19:55,719][52670] DAMAGECOUNT value on done: 26249.0 [2024-08-05 23:19:55,720][52670] Sum rewards: 20.772, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.369', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.117', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.871', 'HITCOUNT': '1.460', 'weapon2': '1.576', 'weapon3': '1.870', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:56,234][52650] Updated weights for policy 0, policy_version 14111 (0.0025) [2024-08-05 23:19:56,319][52663] DAMAGECOUNT value on done: 28785.0 [2024-08-05 23:19:56,319][52663] Sum rewards: 24.552, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'HEALTH': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.070', 'weapon5': '0.070', 'AMMO4': '0.084', 'weapon4': '0.206', 'WEAPON3': '0.500', 'ARMOR': '1.351', 'HITCOUNT': '1.550', 'weapon3': '1.680', 'weapon2': '1.912', 'DAMAGECOUNT': '6.486', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:56,484][52666] DAMAGECOUNT value on done: 27526.0 [2024-08-05 23:19:56,487][52666] Sum rewards: 21.806, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.068', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.124', 'weapon4': '0.230', 'WEAPON3': '0.750', 'ARMOR': '0.927', 'weapon2': '1.602', 'HITCOUNT': '1.750', 'weapon3': '1.928', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '16.000'} [2024-08-05 23:19:56,741][52664] DAMAGECOUNT value on done: 30009.0 [2024-08-05 23:19:56,741][52664] Sum rewards: 22.437, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.565', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.224', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'HITCOUNT': '1.330', 'weapon3': '1.480', 'weapon2': '1.770', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:56,757][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:19:57,112][52669] DAMAGECOUNT value on done: 29729.0 [2024-08-05 23:19:57,112][52669] Sum rewards: 26.235, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO4': '0.092', 'AMMO3': '0.135', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.690', 'WEAPON3': '0.950', 'weapon2': '1.094', 'HITCOUNT': '1.660', 'weapon3': '1.854', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '22.000'} [2024-08-05 23:19:57,115][52667] DAMAGECOUNT value on done: 29732.0 [2024-08-05 23:19:57,116][52667] Sum rewards: 15.841, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.285', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO5': '0.013', 'weapon5': '0.040', 'AMMO3': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.208', 'WEAPON3': '0.700', 'ARMOR': '0.854', 'HITCOUNT': '1.060', 'weapon2': '1.556', 'weapon3': '1.712', 'DAMAGECOUNT': '3.639', 'FRAGCOUNT': '13.000'} [2024-08-05 23:19:57,760][52658] DAMAGECOUNT value on done: 28915.0 [2024-08-05 23:19:57,762][52658] Sum rewards: 23.980, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.974', 'weapon5': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.134', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'weapon4': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon2': '0.962', 'HITCOUNT': '1.620', 'weapon3': '2.004', 'DAMAGECOUNT': '6.096', 'FRAGCOUNT': '22.000'} [2024-08-05 23:19:57,795][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 115621888. Throughput: 0: 4375.3. Samples: 28914120. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:19:57,795][52567] Avg episode reward: [(0, '21.673')] [2024-08-05 23:19:58,225][52670] DAMAGECOUNT value on done: 30164.0 [2024-08-05 23:19:58,225][52670] Sum rewards: 21.140, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.390', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.064', 'weapon4': '0.122', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.340', 'WEAPON3': '0.400', 'ARMOR': '0.800', 'weapon3': '1.346', 'HITCOUNT': '1.530', 'weapon2': '1.918', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '15.000'} [2024-08-05 23:19:58,539][52665] DAMAGECOUNT value on done: 28580.0 [2024-08-05 23:19:58,541][52665] Sum rewards: 23.427, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.385', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'HITCOUNT': '1.480', 'weapon2': '1.770', 'weapon3': '1.954', 'DAMAGECOUNT': '5.322', 'FRAGCOUNT': '21.000'} [2024-08-05 23:19:58,583][52795] DAMAGECOUNT value on done: 27735.0 [2024-08-05 23:19:58,586][52795] Sum rewards: 24.839, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.802', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'WEAPON3': '0.700', 'ARMOR': '0.853', 'weapon2': '1.820', 'HITCOUNT': '1.900', 'weapon3': '2.038', 'DAMAGECOUNT': '7.134', 'FRAGCOUNT': '20.000'} [2024-08-05 23:19:59,034][52663] DAMAGECOUNT value on done: 29054.0 [2024-08-05 23:19:59,036][52663] Sum rewards: 17.165, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.735', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.532', 'WEAPON3': '0.650', 'weapon2': '1.164', 'HITCOUNT': '1.360', 'weapon3': '1.428', 'DAMAGECOUNT': '4.368', 'FRAGCOUNT': '14.000'} [2024-08-05 23:19:59,095][52666] DAMAGECOUNT value on done: 28309.0 [2024-08-05 23:19:59,095][52666] Sum rewards: 33.057, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.230', 'AMMO2': '0.028', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.312', 'ARMOR': '0.853', 'WEAPON3': '0.900', 'weapon2': '1.286', 'weapon3': '1.764', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '28.000'} [2024-08-05 23:19:59,212][52664] DAMAGECOUNT value on done: 25274.0 [2024-08-05 23:19:59,215][52664] Sum rewards: 22.191, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.916', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.085', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.488', 'WEAPON3': '0.650', 'weapon4': '0.696', 'weapon2': '0.904', 'weapon3': '1.294', 'HITCOUNT': '1.520', 'DAMAGECOUNT': '5.709', 'FRAGCOUNT': '17.000'} [2024-08-05 23:19:59,934][52669] DAMAGECOUNT value on done: 29956.0 [2024-08-05 23:19:59,936][52669] Sum rewards: 29.490, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.937', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.060', 'AMMO3': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '0.750', 'weapon2': '1.264', 'weapon3': '1.844', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '7.899', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:00,340][52667] DAMAGECOUNT value on done: 28474.0 [2024-08-05 23:20:00,340][52667] Sum rewards: 12.376, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.078', 'AMMO3': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.400', 'ARMOR': '0.450', 'WEAPON3': '0.600', 'HITCOUNT': '1.200', 'weapon3': '1.256', 'weapon2': '1.556', 'DAMAGECOUNT': '4.083', 'FRAGCOUNT': '11.000'} [2024-08-05 23:20:00,664][52658] DAMAGECOUNT value on done: 28518.0 [2024-08-05 23:20:00,665][52658] Sum rewards: 19.351, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.109', 'AMMO4': '0.137', 'weapon4': '0.256', 'WEAPON4': '0.350', 'ARMOR': '0.468', 'WEAPON3': '0.750', 'HITCOUNT': '1.330', 'weapon2': '1.504', 'weapon3': '1.788', 'DAMAGECOUNT': '4.500', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:00,923][52650] Updated weights for policy 0, policy_version 14121 (0.0044) [2024-08-05 23:20:00,931][52670] DAMAGECOUNT value on done: 26374.0 [2024-08-05 23:20:00,933][52670] Sum rewards: 31.226, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.466', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.212', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.390', 'HITCOUNT': '2.090', 'weapon3': '2.114', 'DAMAGECOUNT': '8.058', 'FRAGCOUNT': '27.000'} [2024-08-05 23:20:01,625][52665] DAMAGECOUNT value on done: 29466.0 [2024-08-05 23:20:01,626][52665] Sum rewards: 10.317, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'ARMOR': '0.808', 'HITCOUNT': '0.990', 'WEAPON3': '1.050', 'weapon2': '1.220', 'weapon3': '2.276', 'DAMAGECOUNT': '4.065', 'FRAGCOUNT': '10.500'} [2024-08-05 23:20:01,680][52666] DAMAGECOUNT value on done: 28670.0 [2024-08-05 23:20:01,682][52666] Sum rewards: 18.932, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.785', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.073', 'AMMO3': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.490', 'WEAPON3': '0.550', 'weapon2': '1.396', 'HITCOUNT': '1.420', 'weapon3': '1.560', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '13.500'} [2024-08-05 23:20:01,690][52795] DAMAGECOUNT value on done: 27578.0 [2024-08-05 23:20:01,691][52795] Sum rewards: 37.813, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.078', 'AMMO4': '0.101', 'weapon5': '0.124', 'WEAPON4': '0.250', 'ARMOR': '0.475', 'weapon4': '0.524', 'WEAPON3': '0.550', 'weapon2': '1.162', 'weapon3': '1.470', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '8.346', 'FRAGCOUNT': '28.000'} [2024-08-05 23:20:01,708][52664] DAMAGECOUNT value on done: 30901.0 [2024-08-05 23:20:01,709][52664] Sum rewards: 20.953, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.103', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.128', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.286', 'ARMOR': '0.491', 'WEAPON3': '0.750', 'weapon2': '1.244', 'HITCOUNT': '1.590', 'weapon3': '1.614', 'DAMAGECOUNT': '6.675', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:02,179][52663] DAMAGECOUNT value on done: 27294.0 [2024-08-05 23:20:02,180][52663] Sum rewards: 13.936, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.649', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.083', 'weapon4': '0.088', 'weapon5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'HITCOUNT': '1.100', 'ARMOR': '1.277', 'weapon2': '1.346', 'weapon3': '1.382', 'DAMAGECOUNT': '3.762', 'FRAGCOUNT': '9.000'} [2024-08-05 23:20:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 115712000. Throughput: 0: 4376.9. Samples: 28927380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:20:02,794][52567] Avg episode reward: [(0, '22.094')] [2024-08-05 23:20:02,917][52667] DAMAGECOUNT value on done: 28678.0 [2024-08-05 23:20:02,918][52667] Sum rewards: 12.613, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.716', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.232', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.220', 'weapon2': '1.240', 'weapon3': '1.822', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '11.000'} [2024-08-05 23:20:03,151][52669] DAMAGECOUNT value on done: 28267.0 [2024-08-05 23:20:03,151][52669] Sum rewards: 19.565, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.030', 'AMMO3': '0.101', 'AMMO4': '0.152', 'WEAPON4': '0.350', 'weapon4': '0.424', 'WEAPON3': '0.650', 'ARMOR': '0.850', 'weapon2': '1.452', 'HITCOUNT': '1.470', 'weapon3': '1.668', 'DAMAGECOUNT': '5.175', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:03,359][52658] DAMAGECOUNT value on done: 26474.0 [2024-08-05 23:20:03,360][52658] Sum rewards: 26.552, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.042', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon4': '0.300', 'WEAPON3': '0.500', 'ARMOR': '0.824', 'HEALTH': '1.050', 'HITCOUNT': '1.540', 'weapon2': '1.564', 'weapon3': '1.802', 'DAMAGECOUNT': '5.442', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:03,590][52670] DAMAGECOUNT value on done: 26614.0 [2024-08-05 23:20:03,591][52670] Sum rewards: 12.765, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.026', 'AMMO5': '0.003', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.145', 'WEAPON4': '0.450', 'weapon4': '0.452', 'WEAPON3': '0.950', 'weapon2': '1.276', 'HITCOUNT': '1.290', 'weapon3': '1.310', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:04,495][52666] DAMAGECOUNT value on done: 26717.0 [2024-08-05 23:20:04,497][52666] Sum rewards: 24.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.496', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.121', 'WEAPON3': '0.750', 'weapon3': '1.656', 'HITCOUNT': '1.740', 'ARMOR': '1.750', 'weapon2': '2.010', 'DAMAGECOUNT': '6.312', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:04,631][52665] DAMAGECOUNT value on done: 28574.0 [2024-08-05 23:20:04,632][52665] Sum rewards: 28.406, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.031', 'AMMO3': '0.079', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'weapon4': '0.212', 'HEALTH': '0.326', 'WEAPON3': '0.450', 'ARMOR': '0.869', 'weapon3': '1.340', 'HITCOUNT': '1.880', 'weapon2': '1.960', 'DAMAGECOUNT': '6.702', 'FRAGCOUNT': '21.000'} [2024-08-05 23:20:04,671][52664] DAMAGECOUNT value on done: 29462.0 [2024-08-05 23:20:04,671][52664] Sum rewards: 23.922, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.734', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'weapon5': '0.090', 'weapon4': '0.218', 'WEAPON3': '0.650', 'ARMOR': '0.845', 'HITCOUNT': '1.580', 'weapon2': '1.586', 'weapon3': '1.596', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '17.000'} [2024-08-05 23:20:04,900][52795] DAMAGECOUNT value on done: 28432.0 [2024-08-05 23:20:04,900][52795] Sum rewards: 31.982, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.805', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'WEAPON3': '0.800', 'ARMOR': '0.836', 'weapon2': '1.702', 'HITCOUNT': '1.970', 'weapon3': '2.140', 'DAMAGECOUNT': '7.524', 'FRAGCOUNT': '25.000'} [2024-08-05 23:20:05,535][52663] DAMAGECOUNT value on done: 29762.0 [2024-08-05 23:20:05,537][52663] Sum rewards: 19.648, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.140', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO3': '0.095', 'ARMOR': '0.472', 'WEAPON3': '0.750', 'HITCOUNT': '1.230', 'weapon2': '1.894', 'weapon3': '1.952', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:05,541][52650] Updated weights for policy 0, policy_version 14131 (0.0034) [2024-08-05 23:20:05,643][52667] DAMAGECOUNT value on done: 30802.0 [2024-08-05 23:20:05,643][52667] Sum rewards: 22.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.199', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '1.222', 'WEAPON3': '1.300', 'HITCOUNT': '1.890', 'weapon3': '2.412', 'DAMAGECOUNT': '6.600', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:06,078][52670] DAMAGECOUNT value on done: 25468.0 [2024-08-05 23:20:06,078][52670] Sum rewards: 20.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.631', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.049', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON3': '1.200', 'ARMOR': '1.313', 'weapon2': '1.318', 'HITCOUNT': '1.820', 'weapon3': '2.380', 'DAMAGECOUNT': '7.161', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:06,142][52658] DAMAGECOUNT value on done: 29074.0 [2024-08-05 23:20:06,143][52658] Sum rewards: 20.750, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.010', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'HITCOUNT': '1.760', 'weapon2': '1.922', 'weapon3': '1.954', 'DAMAGECOUNT': '6.006', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:06,634][52669] DAMAGECOUNT value on done: 30346.0 [2024-08-05 23:20:06,645][52669] Sum rewards: 10.160, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.068', 'AMMO2': '0.002', 'AMMO5': '0.009', 'AMMO4': '0.010', 'weapon5': '0.032', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.182', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.070', 'weapon3': '1.410', 'weapon2': '1.852', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '7.000'} [2024-08-05 23:20:06,828][52666] DAMAGECOUNT value on done: 24345.0 [2024-08-05 23:20:06,830][52666] Sum rewards: 17.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'ARMOR': '0.479', 'WEAPON3': '1.150', 'weapon2': '1.236', 'HITCOUNT': '1.290', 'weapon3': '2.196', 'DAMAGECOUNT': '5.058', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:07,144][52664] DAMAGECOUNT value on done: 29826.0 [2024-08-05 23:20:07,146][52664] Sum rewards: 18.790, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.382', 'AMMO5': '0.007', 'AMMO2': '0.051', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'AMMO4': '0.257', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '0.700', 'weapon2': '0.812', 'HITCOUNT': '1.500', 'weapon3': '1.854', 'DAMAGECOUNT': '5.487', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:07,596][52665] DAMAGECOUNT value on done: 27899.0 [2024-08-05 23:20:07,596][52665] Sum rewards: 24.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.615', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.230', 'ARMOR': '0.481', 'weapon2': '0.964', 'WEAPON3': '1.000', 'HITCOUNT': '1.580', 'weapon3': '2.216', 'DAMAGECOUNT': '5.808', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:07,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 115793920. Throughput: 0: 4376.9. Samples: 28953750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:20:07,794][52567] Avg episode reward: [(0, '21.828')] [2024-08-05 23:20:07,989][52795] DAMAGECOUNT value on done: 30292.0 [2024-08-05 23:20:07,991][52795] Sum rewards: 28.140, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.068', 'AMMO3': '0.137', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'HEALTH': '0.370', 'WEAPON4': '0.400', 'ARMOR': '0.444', 'weapon4': '0.576', 'WEAPON3': '0.800', 'weapon2': '0.888', 'weapon3': '1.970', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '8.118', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:08,553][52667] DAMAGECOUNT value on done: 28210.0 [2024-08-05 23:20:08,556][52667] Sum rewards: 23.754, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.032', 'AMMO3': '0.081', 'HEALTH': '0.090', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.902', 'weapon2': '0.952', 'HITCOUNT': '1.420', 'weapon3': '1.536', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:08,773][52663] DAMAGECOUNT value on done: 31793.0 [2024-08-05 23:20:08,773][52663] Sum rewards: 21.201, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.709', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.097', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'HITCOUNT': '1.280', 'ARMOR': '1.308', 'weapon2': '1.814', 'weapon3': '1.960', 'DAMAGECOUNT': '4.569', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:08,819][52670] DAMAGECOUNT value on done: 23036.0 [2024-08-05 23:20:08,821][52670] Sum rewards: 17.048, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.014', 'AMMO2': '0.023', 'ARMOR': '0.023', 'weapon5': '0.034', 'AMMO3': '0.060', 'HEALTH': '0.072', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.432', 'WEAPON3': '0.450', 'HITCOUNT': '1.170', 'weapon2': '1.384', 'weapon3': '1.472', 'DAMAGECOUNT': '4.350', 'FRAGCOUNT': '11.500'} [2024-08-05 23:20:09,194][52658] DAMAGECOUNT value on done: 30199.0 [2024-08-05 23:20:09,195][52658] Sum rewards: 17.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.015', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.340', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'weapon2': '0.992', 'HITCOUNT': '1.350', 'weapon3': '2.060', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:09,629][52666] DAMAGECOUNT value on done: 25715.0 [2024-08-05 23:20:09,631][52666] Sum rewards: 21.167, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.026', 'weapon4': '0.036', 'AMMO3': '0.092', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'HEALTH': '0.404', 'WEAPON3': '0.550', 'ARMOR': '0.816', 'HITCOUNT': '1.620', 'weapon3': '1.732', 'weapon2': '1.970', 'DAMAGECOUNT': '5.394', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:09,718][52664] DAMAGECOUNT value on done: 29170.0 [2024-08-05 23:20:09,719][52664] Sum rewards: 16.480, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.686', 'AMMO5': '0.007', 'AMMO2': '0.021', 'ARMOR': '0.040', 'AMMO4': '0.103', 'AMMO3': '0.137', 'weapon5': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '0.900', 'weapon2': '1.168', 'HITCOUNT': '1.360', 'weapon3': '1.534', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:10,346][52650] Updated weights for policy 0, policy_version 14141 (0.0024) [2024-08-05 23:20:10,629][52665] DAMAGECOUNT value on done: 28689.0 [2024-08-05 23:20:10,629][52665] Sum rewards: 19.493, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.903', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.090', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.879', 'HITCOUNT': '1.370', 'weapon2': '1.592', 'weapon3': '1.838', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:11,272][52795] DAMAGECOUNT value on done: 25932.0 [2024-08-05 23:20:11,274][52795] Sum rewards: 17.682, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.048', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.256', 'WEAPON4': '0.350', 'ARMOR': '0.444', 'WEAPON3': '0.750', 'HITCOUNT': '1.190', 'weapon3': '1.514', 'weapon2': '1.602', 'DAMAGECOUNT': '5.076', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:11,690][52667] DAMAGECOUNT value on done: 30788.0 [2024-08-05 23:20:11,698][52667] Sum rewards: 25.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.436', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.454', 'ARMOR': '0.512', 'weapon2': '0.782', 'WEAPON3': '1.000', 'HITCOUNT': '1.790', 'weapon3': '1.888', 'DAMAGECOUNT': '6.987', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:11,775][52670] DAMAGECOUNT value on done: 28435.0 [2024-08-05 23:20:11,775][52670] Sum rewards: 25.540, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.370', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'WEAPON3': '0.900', 'ARMOR': '1.380', 'weapon2': '1.594', 'HITCOUNT': '1.680', 'weapon3': '2.080', 'DAMAGECOUNT': '6.546', 'FRAGCOUNT': '21.000'} [2024-08-05 23:20:11,832][52663] DAMAGECOUNT value on done: 27898.0 [2024-08-05 23:20:11,834][52663] Sum rewards: 24.848, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.930', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.056', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.360', 'WEAPON3': '0.600', 'ARMOR': '0.924', 'weapon3': '1.466', 'HITCOUNT': '1.500', 'weapon2': '1.562', 'DAMAGECOUNT': '5.418', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:12,331][52658] DAMAGECOUNT value on done: 27063.0 [2024-08-05 23:20:12,334][52658] Sum rewards: 26.826, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.735', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.388', 'WEAPON3': '0.650', 'weapon2': '1.374', 'weapon3': '1.726', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:12,739][52666] DAMAGECOUNT value on done: 28184.0 [2024-08-05 23:20:12,741][52666] Sum rewards: 24.291, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.652', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.004', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON3': '1.000', 'weapon2': '1.656', 'HITCOUNT': '1.760', 'ARMOR': '1.789', 'weapon3': '2.008', 'DAMAGECOUNT': '6.633', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 115884032. Throughput: 0: 4378.7. Samples: 28980000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:20:12,794][52567] Avg episode reward: [(0, '21.875')] [2024-08-05 23:20:13,627][52665] DAMAGECOUNT value on done: 26633.0 [2024-08-05 23:20:13,627][52665] Sum rewards: 10.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.359', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.090', 'AMMO3': '0.122', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.902', 'HITCOUNT': '1.270', 'weapon2': '1.610', 'weapon3': '1.650', 'DAMAGECOUNT': '4.317', 'FRAGCOUNT': '9.000'} [2024-08-05 23:20:14,308][52795] DAMAGECOUNT value on done: 26874.0 [2024-08-05 23:20:14,308][52795] Sum rewards: 15.471, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.721', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.090', 'WEAPON4': '0.200', 'ARMOR': '0.478', 'weapon4': '0.596', 'WEAPON3': '0.650', 'weapon2': '1.340', 'HITCOUNT': '1.630', 'weapon3': '1.918', 'DAMAGECOUNT': '5.247', 'FRAGCOUNT': '10.000'} [2024-08-05 23:20:14,639][52650] Updated weights for policy 0, policy_version 14151 (0.0021) [2024-08-05 23:20:14,827][52663] DAMAGECOUNT value on done: 29162.0 [2024-08-05 23:20:14,828][52663] Sum rewards: 29.355, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.054', 'AMMO3': '0.141', 'weapon4': '0.142', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.408', 'HEALTH': '0.578', 'WEAPON3': '0.750', 'weapon2': '1.408', 'HITCOUNT': '1.830', 'weapon3': '2.164', 'DAMAGECOUNT': '7.149', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:14,839][52670] DAMAGECOUNT value on done: 29602.0 [2024-08-05 23:20:14,839][52670] Sum rewards: 17.460, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.426', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.093', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.516', 'ARMOR': '0.520', 'WEAPON3': '0.550', 'weapon2': '0.820', 'HITCOUNT': '1.040', 'weapon3': '1.168', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '12.000'} [2024-08-05 23:20:14,866][52667] DAMAGECOUNT value on done: 31384.0 [2024-08-05 23:20:14,867][52667] Sum rewards: 15.533, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.699', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.486', 'WEAPON3': '0.750', 'HITCOUNT': '1.200', 'weapon2': '1.444', 'weapon3': '1.562', 'ARMOR': '1.714', 'DAMAGECOUNT': '4.407', 'FRAGCOUNT': '11.000'} [2024-08-05 23:20:15,526][52658] DAMAGECOUNT value on done: 33618.0 [2024-08-05 23:20:15,527][52658] Sum rewards: 24.038, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.520', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon4': '0.110', 'AMMO3': '0.129', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '1.500', 'weapon2': '1.506', 'weapon3': '1.892', 'DAMAGECOUNT': '5.745', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:16,093][52666] DAMAGECOUNT value on done: 25942.0 [2024-08-05 23:20:16,095][52666] Sum rewards: 13.863, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.182', 'ARMOR': '0.404', 'WEAPON3': '0.900', 'HITCOUNT': '1.130', 'weapon3': '1.628', 'weapon2': '1.788', 'DAMAGECOUNT': '3.834', 'FRAGCOUNT': '13.000'} [2024-08-05 23:20:16,624][52665] DAMAGECOUNT value on done: 27033.0 [2024-08-05 23:20:16,625][52665] Sum rewards: 25.336, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.078', 'HEALTH': '0.430', 'WEAPON3': '0.450', 'weapon3': '1.454', 'HITCOUNT': '1.580', 'weapon2': '2.130', 'DAMAGECOUNT': '5.580', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:17,411][52795] DAMAGECOUNT value on done: 28355.0 [2024-08-05 23:20:17,421][52795] Sum rewards: 26.308, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.098', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.032', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.234', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'WEAPON3': '0.600', 'weapon2': '1.596', 'HITCOUNT': '1.760', 'weapon3': '1.820', 'DAMAGECOUNT': '6.363', 'FRAGCOUNT': '20.500'} [2024-08-05 23:20:17,483][52663] DAMAGECOUNT value on done: 31876.0 [2024-08-05 23:20:17,484][52663] Sum rewards: 14.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.168', 'weapon4': '0.262', 'WEAPON4': '0.400', 'ARMOR': '0.436', 'WEAPON3': '1.050', 'HITCOUNT': '1.510', 'weapon2': '1.570', 'weapon3': '1.796', 'DAMAGECOUNT': '5.256', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 115974144. Throughput: 0: 4386.0. Samples: 28993210. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:20:17,795][52567] Avg episode reward: [(0, '21.375')] [2024-08-05 23:20:17,943][52670] DAMAGECOUNT value on done: 28877.0 [2024-08-05 23:20:17,944][52670] Sum rewards: 16.379, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.770', 'ARMOR': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.136', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON3': '0.900', 'weapon2': '1.118', 'HITCOUNT': '1.590', 'weapon3': '1.936', 'DAMAGECOUNT': '6.021', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:17,982][52667] DAMAGECOUNT value on done: 29839.0 [2024-08-05 23:20:17,983][52667] Sum rewards: 21.586, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.494', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon4': '0.006', 'AMMO3': '0.088', 'WEAPON4': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.827', 'weapon3': '1.764', 'HITCOUNT': '1.780', 'weapon2': '1.962', 'DAMAGECOUNT': '5.805', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:18,620][52658] DAMAGECOUNT value on done: 27506.0 [2024-08-05 23:20:18,620][52658] Sum rewards: 16.391, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.916', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.066', 'weapon4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.500', 'HITCOUNT': '0.960', 'weapon3': '1.336', 'weapon2': '1.738', 'DAMAGECOUNT': '4.080', 'FRAGCOUNT': '12.000'} [2024-08-05 23:20:18,971][52666] DAMAGECOUNT value on done: 27410.0 [2024-08-05 23:20:18,971][52666] Sum rewards: 15.360, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.572', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.137', 'weapon4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.498', 'WEAPON3': '1.000', 'HITCOUNT': '1.430', 'weapon2': '1.676', 'weapon3': '1.894', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:19,184][52650] Updated weights for policy 0, policy_version 14161 (0.0043) [2024-08-05 23:20:20,303][52663] DAMAGECOUNT value on done: 29743.0 [2024-08-05 23:20:20,304][52663] Sum rewards: 15.049, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.548', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'ARMOR': '0.849', 'WEAPON3': '1.250', 'HITCOUNT': '1.570', 'weapon2': '1.746', 'weapon3': '2.008', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:20,971][52670] DAMAGECOUNT value on done: 29582.0 [2024-08-05 23:20:20,971][52670] Sum rewards: 17.778, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.058', 'weapon5': '0.128', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.288', 'weapon4': '0.362', 'ARMOR': '0.455', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.964', 'HITCOUNT': '1.370', 'weapon3': '1.950', 'DAMAGECOUNT': '5.400', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:21,066][52671] DAMAGECOUNT value on done: 31847.0 [2024-08-05 23:20:21,066][52671] Sum rewards: 22.913, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.510', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon7': '0.046', 'weapon5': '0.054', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.372', 'WEAPON3': '0.650', 'ARMOR': '0.918', 'weapon2': '1.062', 'weapon3': '1.286', 'HITCOUNT': '1.440', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '17.000'} [2024-08-05 23:20:21,278][52667] DAMAGECOUNT value on done: 29914.0 [2024-08-05 23:20:21,278][52667] Sum rewards: 20.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO5': '0.014', 'weapon5': '0.018', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.092', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.500', 'weapon2': '0.704', 'weapon4': '0.728', 'WEAPON3': '0.950', 'HITCOUNT': '1.640', 'weapon3': '2.090', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '17.500'} [2024-08-05 23:20:21,918][52658] DAMAGECOUNT value on done: 30830.0 [2024-08-05 23:20:21,918][52658] Sum rewards: 11.181, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.880', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon4': '0.030', 'weapon7': '0.066', 'weapon5': '0.080', 'AMMO3': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'HITCOUNT': '1.060', 'weapon3': '1.334', 'ARMOR': '1.365', 'weapon2': '1.838', 'DAMAGECOUNT': '3.795', 'FRAGCOUNT': '11.000'} [2024-08-05 23:20:21,937][52666] DAMAGECOUNT value on done: 27271.0 [2024-08-05 23:20:21,940][52666] Sum rewards: 10.376, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.602', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon5': '0.040', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'AMMO4': '0.149', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'ARMOR': '0.505', 'weapon4': '0.538', 'WEAPON3': '0.900', 'HITCOUNT': '1.150', 'weapon2': '1.190', 'weapon3': '1.796', 'DAMAGECOUNT': '3.477', 'FRAGCOUNT': '10.000'} [2024-08-05 23:20:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 116064256. Throughput: 0: 4385.1. Samples: 29019430. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:20:22,802][52567] Avg episode reward: [(0, '20.889')] [2024-08-05 23:20:23,294][52663] DAMAGECOUNT value on done: 29280.0 [2024-08-05 23:20:23,295][52663] Sum rewards: 15.961, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.325', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.214', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '1.380', 'weapon2': '1.590', 'weapon3': '1.984', 'DAMAGECOUNT': '4.776', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:23,956][52671] DAMAGECOUNT value on done: 28413.0 [2024-08-05 23:20:23,956][52671] Sum rewards: 21.053, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.778', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon4': '0.330', 'ARMOR': '0.455', 'WEAPON3': '1.150', 'weapon2': '1.606', 'weapon3': '1.696', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.807', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:24,070][52670] DAMAGECOUNT value on done: 28860.0 [2024-08-05 23:20:24,070][52670] Sum rewards: 18.297, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.405', 'AMMO4': '-0.107', 'AMMO2': '-0.021', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.116', 'WEAPON3': '0.900', 'ARMOR': '1.370', 'HITCOUNT': '1.730', 'weapon3': '1.814', 'weapon2': '1.928', 'DAMAGECOUNT': '6.162', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:24,263][52650] Updated weights for policy 0, policy_version 14171 (0.0014) [2024-08-05 23:20:24,478][52667] DAMAGECOUNT value on done: 30912.0 [2024-08-05 23:20:24,478][52667] Sum rewards: 26.506, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.058', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.090', 'AMMO3': '0.095', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.412', 'WEAPON3': '0.700', 'weapon2': '0.822', 'weapon4': '0.906', 'weapon3': '1.494', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '7.383', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:24,848][52666] DAMAGECOUNT value on done: 26482.0 [2024-08-05 23:20:24,850][52666] Sum rewards: 20.622, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.422', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'ARMOR': '0.893', 'WEAPON3': '1.050', 'weapon2': '1.322', 'HITCOUNT': '1.350', 'weapon3': '2.326', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:25,185][52658] DAMAGECOUNT value on done: 29849.0 [2024-08-05 23:20:25,186][52658] Sum rewards: 31.086, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.662', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.100', 'WEAPON3': '0.700', 'ARMOR': '1.310', 'weapon3': '1.802', 'weapon2': '1.866', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.053', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:26,321][52663] DAMAGECOUNT value on done: 28243.0 [2024-08-05 23:20:26,324][52663] Sum rewards: 23.270, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.420', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.122', 'WEAPON4': '0.300', 'weapon4': '0.526', 'WEAPON3': '0.950', 'weapon2': '1.282', 'weapon3': '1.842', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '6.219', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:27,138][52671] DAMAGECOUNT value on done: 30068.0 [2024-08-05 23:20:27,140][52671] Sum rewards: 15.232, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.238', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.120', 'WEAPON3': '0.850', 'HITCOUNT': '1.270', 'ARMOR': '1.376', 'weapon3': '1.734', 'weapon2': '1.998', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '10.500'} [2024-08-05 23:20:27,218][52670] DAMAGECOUNT value on done: 27936.0 [2024-08-05 23:20:27,221][52670] Sum rewards: 22.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.135', 'weapon4': '0.234', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'ARMOR': '0.995', 'weapon2': '1.504', 'weapon3': '1.694', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '6.612', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:27,303][52667] DAMAGECOUNT value on done: 30734.0 [2024-08-05 23:20:27,304][52667] Sum rewards: 25.010, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.765', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.024', 'AMMO4': '0.053', 'AMMO3': '0.080', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON3': '0.600', 'HITCOUNT': '1.620', 'weapon2': '1.652', 'weapon3': '1.714', 'DAMAGECOUNT': '6.762', 'FRAGCOUNT': '18.500'} [2024-08-05 23:20:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 116146176. Throughput: 0: 4375.6. Samples: 29045460. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 23:20:27,794][52567] Avg episode reward: [(0, '21.152')] [2024-08-05 23:20:27,812][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014179_116154368.pth... [2024-08-05 23:20:27,892][52658] DAMAGECOUNT value on done: 30317.0 [2024-08-05 23:20:27,893][52658] Sum rewards: 22.684, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.342', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.468', 'ARMOR': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '1.470', 'weapon2': '1.478', 'weapon3': '1.718', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:27,959][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013664_111935488.pth [2024-08-05 23:20:28,205][52666] DAMAGECOUNT value on done: 28004.0 [2024-08-05 23:20:28,205][52666] Sum rewards: 35.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.323', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'ARMOR': '0.918', 'WEAPON3': '1.150', 'weapon2': '1.440', 'weapon3': '2.154', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '30.000'} [2024-08-05 23:20:28,787][52650] Updated weights for policy 0, policy_version 14181 (0.0013) [2024-08-05 23:20:29,554][52663] DAMAGECOUNT value on done: 29313.0 [2024-08-05 23:20:29,555][52663] Sum rewards: 26.937, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.764', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.151', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.694', 'weapon2': '0.724', 'WEAPON3': '0.850', 'weapon3': '1.690', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '7.521', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:30,227][52671] DAMAGECOUNT value on done: 28377.0 [2024-08-05 23:20:30,229][52671] Sum rewards: 28.145, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.399', 'AMMO5': '0.015', 'weapon4': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.284', 'WEAPON3': '0.650', 'ARMOR': '1.255', 'HITCOUNT': '1.610', 'weapon2': '1.612', 'weapon3': '1.726', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:30,519][52670] DAMAGECOUNT value on done: 27554.0 [2024-08-05 23:20:30,523][52670] Sum rewards: 24.712, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.416', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.117', 'WEAPON4': '0.250', 'weapon4': '0.566', 'WEAPON3': '0.700', 'ARMOR': '0.884', 'weapon2': '1.298', 'HITCOUNT': '1.330', 'weapon3': '1.454', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '21.000'} [2024-08-05 23:20:30,600][52658] DAMAGECOUNT value on done: 27477.0 [2024-08-05 23:20:30,601][52658] Sum rewards: 15.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.456', 'weapon5': '0.008', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'ARMOR': '1.403', 'weapon2': '1.440', 'HITCOUNT': '1.520', 'weapon3': '2.030', 'DAMAGECOUNT': '5.511', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:30,993][52811] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-05 23:20:31,300][52666] DAMAGECOUNT value on done: 28242.0 [2024-08-05 23:20:31,301][52666] Sum rewards: 24.022, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.524', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.057', 'weapon4': '0.064', 'weapon5': '0.092', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.508', 'WEAPON3': '1.050', 'weapon2': '1.458', 'HITCOUNT': '1.560', 'weapon3': '2.050', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:32,570][52663] DAMAGECOUNT value on done: 29033.0 [2024-08-05 23:20:32,570][52663] Sum rewards: 21.026, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.029', 'ARMOR': '0.040', 'weapon5': '0.048', 'AMMO3': '0.132', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.734', 'WEAPON3': '0.750', 'weapon2': '1.096', 'weapon3': '1.386', 'HITCOUNT': '1.610', 'DAMAGECOUNT': '5.592', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 116236288. Throughput: 0: 4362.5. Samples: 29058050. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 23:20:32,794][52567] Avg episode reward: [(0, '21.392')] [2024-08-05 23:20:32,928][52659] DAMAGECOUNT value on done: 28720.0 [2024-08-05 23:20:32,929][52659] Sum rewards: 22.395, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.303', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.306', 'WEAPON3': '0.850', 'weapon2': '0.980', 'ARMOR': '1.337', 'HITCOUNT': '1.550', 'weapon3': '1.888', 'DAMAGECOUNT': '6.084', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:33,163][52671] DAMAGECOUNT value on done: 27840.0 [2024-08-05 23:20:33,165][52671] Sum rewards: 16.167, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.290', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'ARMOR': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'WEAPON4': '0.200', 'weapon4': '0.306', 'WEAPON3': '0.750', 'HITCOUNT': '1.270', 'weapon2': '1.292', 'weapon3': '1.564', 'DAMAGECOUNT': '4.779', 'FRAGCOUNT': '13.000'} [2024-08-05 23:20:33,373][52670] DAMAGECOUNT value on done: 27442.0 [2024-08-05 23:20:33,373][52670] Sum rewards: 24.631, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.966', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.025', 'weapon5': '0.026', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.142', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.370', 'weapon3': '1.574', 'weapon2': '1.792', 'DAMAGECOUNT': '6.066', 'FRAGCOUNT': '18.500'} [2024-08-05 23:20:33,603][52650] Updated weights for policy 0, policy_version 14191 (0.0022) [2024-08-05 23:20:33,749][52658] DAMAGECOUNT value on done: 30484.0 [2024-08-05 23:20:33,749][52658] Sum rewards: 20.163, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.164', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.109', 'WEAPON4': '0.250', 'weapon4': '0.334', 'ARMOR': '0.412', 'WEAPON3': '0.750', 'weapon2': '1.110', 'weapon3': '1.698', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.132', 'FRAGCOUNT': '17.000'} [2024-08-05 23:20:34,329][52666] DAMAGECOUNT value on done: 28067.0 [2024-08-05 23:20:34,332][52666] Sum rewards: 11.167, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.090', 'weapon4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.239', 'WEAPON4': '0.550', 'ARMOR': '0.980', 'WEAPON3': '1.050', 'HITCOUNT': '1.250', 'weapon2': '1.452', 'weapon3': '1.768', 'DAMAGECOUNT': '4.329', 'FRAGCOUNT': '11.000'} [2024-08-05 23:20:35,183][52663] DAMAGECOUNT value on done: 29324.0 [2024-08-05 23:20:35,183][52663] Sum rewards: 23.904, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.809', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.046', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'WEAPON3': '0.550', 'weapon4': '0.606', 'weapon2': '1.182', 'ARMOR': '1.256', 'HITCOUNT': '1.500', 'weapon3': '1.696', 'DAMAGECOUNT': '5.016', 'FRAGCOUNT': '17.000'} [2024-08-05 23:20:35,953][52659] DAMAGECOUNT value on done: 30468.0 [2024-08-05 23:20:35,955][52659] Sum rewards: 20.348, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.015', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.020', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.097', 'ARMOR': '0.435', 'WEAPON3': '0.600', 'HITCOUNT': '1.260', 'weapon3': '1.656', 'weapon2': '1.852', 'DAMAGECOUNT': '4.218', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:36,208][52671] DAMAGECOUNT value on done: 31985.0 [2024-08-05 23:20:36,209][52671] Sum rewards: 18.457, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'weapon7': '0.042', 'AMMO2': '0.044', 'weapon4': '0.054', 'ARMOR': '0.063', 'AMMO3': '0.134', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.219', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.546', 'weapon3': '1.800', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:36,276][52649] DAMAGECOUNT value on done: 29158.0 [2024-08-05 23:20:36,279][52649] Sum rewards: 26.038, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.542', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'WEAPON3': '0.950', 'weapon2': '1.550', 'ARMOR': '1.743', 'HITCOUNT': '1.920', 'weapon3': '2.246', 'DAMAGECOUNT': '6.897', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:36,549][52670] DAMAGECOUNT value on done: 27237.0 [2024-08-05 23:20:36,551][52670] Sum rewards: 23.961, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.966', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'ARMOR': '0.505', 'WEAPON3': '0.750', 'HITCOUNT': '1.480', 'weapon3': '1.690', 'weapon2': '1.870', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:36,687][52658] DAMAGECOUNT value on done: 30560.0 [2024-08-05 23:20:36,688][52658] Sum rewards: 17.374, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.666', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.402', 'ARMOR': '0.897', 'WEAPON3': '1.050', 'weapon2': '1.188', 'HITCOUNT': '1.470', 'weapon3': '2.198', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 116326400. Throughput: 0: 4371.1. Samples: 29084650. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:20:37,794][52567] Avg episode reward: [(0, '21.197')] [2024-08-05 23:20:38,060][52650] Updated weights for policy 0, policy_version 14201 (0.0010) [2024-08-05 23:20:38,201][52663] DAMAGECOUNT value on done: 30885.0 [2024-08-05 23:20:38,202][52663] Sum rewards: 35.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.295', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'ARMOR': '0.457', 'WEAPON3': '0.950', 'weapon2': '1.520', 'HITCOUNT': '2.210', 'weapon3': '2.330', 'DAMAGECOUNT': '9.018', 'FRAGCOUNT': '29.000'} [2024-08-05 23:20:38,587][52659] DAMAGECOUNT value on done: 29913.0 [2024-08-05 23:20:38,589][52659] Sum rewards: 17.487, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.442', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON3': '0.700', 'weapon2': '1.192', 'HITCOUNT': '1.320', 'weapon3': '1.692', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:38,722][52671] DAMAGECOUNT value on done: 29099.0 [2024-08-05 23:20:38,722][52671] Sum rewards: 24.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.921', 'AMMO5': '0.013', 'weapon4': '0.016', 'AMMO2': '0.037', 'weapon5': '0.054', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'ARMOR': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.418', 'HITCOUNT': '1.640', 'weapon3': '2.208', 'DAMAGECOUNT': '6.849', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:39,366][52820] DAMAGECOUNT value on done: 25888.0 [2024-08-05 23:20:39,369][52820] Sum rewards: 32.699, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.142', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.123', 'weapon4': '0.200', 'WEAPON3': '0.750', 'weapon2': '1.262', 'HITCOUNT': '1.960', 'weapon3': '2.134', 'DAMAGECOUNT': '7.869', 'FRAGCOUNT': '26.500'} [2024-08-05 23:20:39,421][52649] DAMAGECOUNT value on done: 29179.0 [2024-08-05 23:20:39,422][52649] Sum rewards: 20.218, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.109', 'AMMO3': '0.164', 'weapon4': '0.254', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'weapon2': '0.960', 'WEAPON3': '1.050', 'HITCOUNT': '1.440', 'weapon3': '2.136', 'DAMAGECOUNT': '5.934', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:39,721][52670] DAMAGECOUNT value on done: 27350.0 [2024-08-05 23:20:39,723][52670] Sum rewards: 22.245, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.600', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'WEAPON4': '0.250', 'weapon4': '0.624', 'weapon2': '0.798', 'WEAPON3': '0.850', 'ARMOR': '0.860', 'HITCOUNT': '1.380', 'weapon3': '1.976', 'DAMAGECOUNT': '5.703', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:39,810][52658] DAMAGECOUNT value on done: 28462.0 [2024-08-05 23:20:39,812][52658] Sum rewards: 28.235, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.950', 'AMMO4': '-0.078', 'AMMO2': '-0.016', 'AMMO3': '0.096', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'weapon3': '1.852', 'HITCOUNT': '1.870', 'weapon2': '1.896', 'DAMAGECOUNT': '6.660', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:41,059][52663] DAMAGECOUNT value on done: 29461.0 [2024-08-05 23:20:41,060][52663] Sum rewards: 26.315, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.330', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'ARMOR': '0.913', 'WEAPON3': '0.950', 'weapon2': '1.594', 'HITCOUNT': '1.940', 'weapon3': '2.184', 'DAMAGECOUNT': '7.950', 'FRAGCOUNT': '21.000'} [2024-08-05 23:20:41,574][52659] DAMAGECOUNT value on done: 28998.0 [2024-08-05 23:20:41,574][52659] Sum rewards: 16.718, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.202', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.109', 'WEAPON4': '0.400', 'weapon4': '0.598', 'WEAPON3': '0.700', 'ARMOR': '0.873', 'weapon2': '1.390', 'HITCOUNT': '1.480', 'weapon3': '1.596', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '12.000'} [2024-08-05 23:20:41,697][52647] DAMAGECOUNT value on done: 31271.0 [2024-08-05 23:20:41,698][52647] Sum rewards: 17.501, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.602', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.032', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'weapon4': '0.528', 'weapon2': '0.836', 'WEAPON3': '0.950', 'HITCOUNT': '1.480', 'weapon3': '1.960', 'DAMAGECOUNT': '5.277', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:41,783][52671] DAMAGECOUNT value on done: 31847.0 [2024-08-05 23:20:41,786][52671] Sum rewards: 29.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO3': '0.130', 'AMMO4': '0.133', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'ARMOR': '0.939', 'weapon2': '1.478', 'weapon3': '2.096', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '8.469', 'FRAGCOUNT': '25.000'} [2024-08-05 23:20:42,206][52658] DAMAGECOUNT value on done: 31451.0 [2024-08-05 23:20:42,206][52658] Sum rewards: 25.033, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.078', 'AMMO4': '0.104', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'ARMOR': '1.260', 'HITCOUNT': '1.570', 'weapon3': '1.584', 'weapon2': '1.920', 'DAMAGECOUNT': '6.600', 'FRAGCOUNT': '21.000'} [2024-08-05 23:20:42,519][52820] DAMAGECOUNT value on done: 26958.0 [2024-08-05 23:20:42,521][52820] Sum rewards: 21.499, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.297', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'weapon4': '0.412', 'ARMOR': '0.457', 'WEAPON3': '0.800', 'weapon2': '1.066', 'HITCOUNT': '1.770', 'weapon3': '1.972', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:42,535][52649] DAMAGECOUNT value on done: 29014.0 [2024-08-05 23:20:42,535][52649] Sum rewards: 24.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.135', 'AMMO3': '0.136', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'ARMOR': '1.275', 'weapon2': '1.464', 'HITCOUNT': '1.610', 'weapon3': '1.698', 'DAMAGECOUNT': '6.279', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:42,739][52650] Updated weights for policy 0, policy_version 14211 (0.0069) [2024-08-05 23:20:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 116416512. Throughput: 0: 4372.9. Samples: 29110900. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:20:42,795][52567] Avg episode reward: [(0, '21.430')] [2024-08-05 23:20:44,031][52663] DAMAGECOUNT value on done: 28156.0 [2024-08-05 23:20:44,033][52663] Sum rewards: 17.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO2': '0.007', 'AMMO5': '0.013', 'AMMO4': '0.032', 'weapon5': '0.048', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.000', 'weapon2': '1.032', 'ARMOR': '1.327', 'HITCOUNT': '1.600', 'weapon3': '2.090', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '17.500'} [2024-08-05 23:20:44,234][52647] DAMAGECOUNT value on done: 31071.0 [2024-08-05 23:20:44,235][52647] Sum rewards: 21.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.794', 'weapon4': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'ARMOR': '0.856', 'WEAPON3': '1.100', 'weapon2': '1.552', 'HITCOUNT': '1.670', 'weapon3': '2.260', 'DAMAGECOUNT': '6.354', 'FRAGCOUNT': '21.000'} [2024-08-05 23:20:44,508][52659] DAMAGECOUNT value on done: 29443.0 [2024-08-05 23:20:44,508][52659] Sum rewards: 21.129, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.534', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.238', 'weapon4': '0.346', 'WEAPON3': '0.700', 'ARMOR': '0.808', 'HITCOUNT': '1.260', 'weapon2': '1.436', 'weapon3': '1.668', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:44,616][52671] DAMAGECOUNT value on done: 30828.0 [2024-08-05 23:20:44,617][52671] Sum rewards: 23.481, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.526', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.137', 'WEAPON4': '0.300', 'ARMOR': '0.529', 'weapon4': '0.700', 'weapon2': '0.726', 'WEAPON3': '0.950', 'HITCOUNT': '1.780', 'weapon3': '2.194', 'DAMAGECOUNT': '7.005', 'FRAGCOUNT': '21.000'} [2024-08-05 23:20:44,921][52658] DAMAGECOUNT value on done: 31840.0 [2024-08-05 23:20:44,923][52658] Sum rewards: 24.292, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.206', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.272', 'weapon4': '0.368', 'WEAPON3': '0.700', 'weapon2': '0.956', 'ARMOR': '1.305', 'weapon3': '1.678', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:45,604][52649] DAMAGECOUNT value on done: 29284.0 [2024-08-05 23:20:45,604][52649] Sum rewards: 27.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.976', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.129', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.484', 'weapon2': '1.088', 'WEAPON3': '1.200', 'HITCOUNT': '2.120', 'weapon3': '2.526', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:45,673][52820] DAMAGECOUNT value on done: 25415.0 [2024-08-05 23:20:45,673][52820] Sum rewards: 18.133, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.942', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.098', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.700', 'ARMOR': '0.808', 'weapon3': '1.324', 'HITCOUNT': '1.640', 'weapon2': '1.770', 'DAMAGECOUNT': '6.225', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:46,589][52663] DAMAGECOUNT value on done: 28494.0 [2024-08-05 23:20:46,590][52663] Sum rewards: 21.977, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.159', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'weapon4': '0.310', 'WEAPON3': '0.650', 'ARMOR': '0.848', 'weapon3': '1.332', 'HITCOUNT': '1.430', 'weapon2': '1.618', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:46,918][52647] DAMAGECOUNT value on done: 33868.0 [2024-08-05 23:20:46,919][52647] Sum rewards: 33.976, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.084', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'HEALTH': '0.544', 'WEAPON3': '0.700', 'ARMOR': '0.852', 'weapon2': '1.412', 'HITCOUNT': '1.840', 'weapon3': '2.078', 'DAMAGECOUNT': '6.990', 'FRAGCOUNT': '27.000'} [2024-08-05 23:20:47,123][52659] DAMAGECOUNT value on done: 31058.0 [2024-08-05 23:20:47,127][52659] Sum rewards: 16.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'ARMOR': '0.851', 'WEAPON3': '1.000', 'weapon2': '1.190', 'HITCOUNT': '1.550', 'weapon3': '2.474', 'DAMAGECOUNT': '5.595', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:47,205][52671] DAMAGECOUNT value on done: 32587.0 [2024-08-05 23:20:47,205][52671] Sum rewards: 18.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.999', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON3': '1.200', 'ARMOR': '1.358', 'weapon2': '1.376', 'HITCOUNT': '1.900', 'weapon3': '2.154', 'DAMAGECOUNT': '6.711', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:47,640][52650] Updated weights for policy 0, policy_version 14221 (0.0033) [2024-08-05 23:20:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 116498432. Throughput: 0: 4375.3. Samples: 29124270. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 23:20:47,795][52567] Avg episode reward: [(0, '21.628')] [2024-08-05 23:20:48,175][52658] DAMAGECOUNT value on done: 29143.0 [2024-08-05 23:20:48,175][52658] Sum rewards: 25.495, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.572', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO3': '0.111', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.276', 'WEAPON3': '0.750', 'ARMOR': '1.286', 'weapon2': '1.286', 'HITCOUNT': '1.710', 'weapon3': '1.728', 'DAMAGECOUNT': '6.228', 'FRAGCOUNT': '19.000'} [2024-08-05 23:20:48,773][52649] DAMAGECOUNT value on done: 29005.0 [2024-08-05 23:20:48,773][52649] Sum rewards: 20.771, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.005', 'AMMO2': '0.034', 'AMMO3': '0.070', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'WEAPON3': '0.400', 'HEALTH': '0.430', 'weapon4': '0.558', 'weapon2': '0.960', 'HITCOUNT': '1.060', 'weapon3': '1.298', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:48,937][52820] DAMAGECOUNT value on done: 27161.0 [2024-08-05 23:20:48,939][52820] Sum rewards: 26.094, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.007', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.159', 'weapon4': '0.168', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'WEAPON3': '0.850', 'weapon2': '1.616', 'HITCOUNT': '1.640', 'weapon3': '1.662', 'DAMAGECOUNT': '5.892', 'FRAGCOUNT': '23.000'} [2024-08-05 23:20:49,150][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:20:49,824][52647] DAMAGECOUNT value on done: 30069.0 [2024-08-05 23:20:49,824][52647] Sum rewards: 20.068, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.887', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'AMMO3': '0.084', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.630', 'WEAPON3': '0.650', 'weapon2': '0.728', 'HITCOUNT': '1.330', 'weapon3': '1.528', 'DAMAGECOUNT': '5.202', 'FRAGCOUNT': '15.000'} [2024-08-05 23:20:50,100][52659] DAMAGECOUNT value on done: 31762.0 [2024-08-05 23:20:50,102][52659] Sum rewards: 22.826, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.906', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.016', 'weapon5': '0.046', 'AMMO3': '0.070', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '0.550', 'weapon2': '1.470', 'weapon3': '1.610', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '5.289', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:50,215][52671] DAMAGECOUNT value on done: 29622.0 [2024-08-05 23:20:50,216][52671] Sum rewards: 17.231, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.314', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.109', 'WEAPON4': '0.300', 'weapon4': '0.570', 'WEAPON3': '0.700', 'weapon2': '1.130', 'HITCOUNT': '1.560', 'weapon3': '1.898', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '13.000'} [2024-08-05 23:20:50,730][52658] DAMAGECOUNT value on done: 27976.0 [2024-08-05 23:20:50,731][52658] Sum rewards: 21.872, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.817', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.012', 'weapon5': '0.046', 'weapon4': '0.048', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.650', 'ARMOR': '1.364', 'HITCOUNT': '1.400', 'weapon3': '1.502', 'weapon2': '1.592', 'DAMAGECOUNT': '5.367', 'FRAGCOUNT': '17.000'} [2024-08-05 23:20:51,871][52649] DAMAGECOUNT value on done: 29284.0 [2024-08-05 23:20:51,880][52649] Sum rewards: 22.942, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.040', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.700', 'HITCOUNT': '1.330', 'weapon2': '1.536', 'weapon3': '1.924', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:52,043][52820] DAMAGECOUNT value on done: 28093.0 [2024-08-05 23:20:52,044][52820] Sum rewards: 23.423, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.635', 'AMMO2': '0.005', 'AMMO5': '0.020', 'AMMO4': '0.024', 'weapon5': '0.058', 'AMMO3': '0.090', 'weapon4': '0.156', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'ARMOR': '0.935', 'weapon3': '1.648', 'HITCOUNT': '1.670', 'weapon2': '1.760', 'DAMAGECOUNT': '6.192', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:52,256][52650] Updated weights for policy 0, policy_version 14231 (0.0036) [2024-08-05 23:20:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 116588544. Throughput: 0: 4375.1. Samples: 29150630. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 23:20:52,794][52567] Avg episode reward: [(0, '21.608')] [2024-08-05 23:20:53,198][52647] DAMAGECOUNT value on done: 31785.0 [2024-08-05 23:20:53,200][52647] Sum rewards: 17.871, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'AMMO4': '0.191', 'weapon4': '0.310', 'HEALTH': '0.498', 'WEAPON3': '0.600', 'ARMOR': '0.840', 'HITCOUNT': '1.310', 'weapon2': '1.560', 'weapon3': '1.918', 'DAMAGECOUNT': '5.016', 'FRAGCOUNT': '12.000'} [2024-08-05 23:20:53,214][52659] DAMAGECOUNT value on done: 28089.0 [2024-08-05 23:20:53,214][52659] Sum rewards: 24.842, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.098', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'weapon2': '1.610', 'weapon3': '1.874', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.957', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:53,245][52658] DAMAGECOUNT value on done: 30377.0 [2024-08-05 23:20:53,245][52658] Sum rewards: 26.082, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.165', 'WEAPON3': '1.000', 'ARMOR': '1.200', 'weapon2': '1.488', 'HITCOUNT': '1.680', 'weapon3': '2.072', 'DAMAGECOUNT': '6.243', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:53,305][52671] DAMAGECOUNT value on done: 31429.0 [2024-08-05 23:20:53,305][52671] Sum rewards: 24.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.716', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.040', 'AMMO4': '0.069', 'AMMO3': '0.094', 'weapon4': '0.108', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon2': '1.470', 'weapon3': '1.582', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.051', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:54,992][52649] DAMAGECOUNT value on done: 26180.0 [2024-08-05 23:20:54,993][52649] Sum rewards: 19.884, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.245', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'WEAPON4': '0.050', 'AMMO3': '0.101', 'weapon4': '0.130', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.578', 'HITCOUNT': '1.590', 'weapon3': '1.876', 'DAMAGECOUNT': '5.406', 'FRAGCOUNT': '16.000'} [2024-08-05 23:20:55,132][52820] DAMAGECOUNT value on done: 27390.0 [2024-08-05 23:20:55,132][52820] Sum rewards: 23.549, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.599', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'weapon4': '0.728', 'WEAPON3': '0.800', 'weapon2': '1.078', 'HITCOUNT': '1.610', 'weapon3': '1.742', 'DAMAGECOUNT': '5.865', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:56,064][52647] DAMAGECOUNT value on done: 31036.0 [2024-08-05 23:20:56,064][52647] Sum rewards: 24.482, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.042', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.085', 'weapon5': '0.116', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.500', 'WEAPON3': '0.500', 'weapon4': '0.562', 'weapon2': '1.204', 'weapon3': '1.452', 'HITCOUNT': '1.660', 'DAMAGECOUNT': '6.339', 'FRAGCOUNT': '17.500'} [2024-08-05 23:20:56,289][52659] DAMAGECOUNT value on done: 28189.0 [2024-08-05 23:20:56,291][52659] Sum rewards: 17.481, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO3': '0.112', 'HEALTH': '0.129', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.180', 'weapon2': '1.348', 'weapon3': '1.496', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '14.000'} [2024-08-05 23:20:56,361][52671] DAMAGECOUNT value on done: 33826.0 [2024-08-05 23:20:56,363][52671] Sum rewards: 26.721, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.264', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.070', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'ARMOR': '0.808', 'WEAPON3': '0.850', 'weapon2': '1.352', 'HITCOUNT': '1.990', 'weapon3': '2.282', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '20.000'} [2024-08-05 23:20:56,805][52650] Updated weights for policy 0, policy_version 14241 (0.0019) [2024-08-05 23:20:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 116670464. Throughput: 0: 4376.2. Samples: 29176930. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:20:57,795][52567] Avg episode reward: [(0, '21.758')] [2024-08-05 23:20:57,987][52649] DAMAGECOUNT value on done: 28102.0 [2024-08-05 23:20:57,988][52649] Sum rewards: 29.817, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.711', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.008', 'WEAPON4': '0.050', 'AMMO3': '0.083', 'weapon5': '0.086', 'weapon4': '0.148', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.436', 'weapon3': '1.822', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.948', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:58,399][52820] DAMAGECOUNT value on done: 28037.0 [2024-08-05 23:20:58,401][52820] Sum rewards: 28.516, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.179', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.388', 'WEAPON3': '0.650', 'ARMOR': '0.942', 'weapon2': '1.390', 'weapon3': '1.730', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '6.201', 'FRAGCOUNT': '22.000'} [2024-08-05 23:20:58,410][52647] DAMAGECOUNT value on done: 30233.0 [2024-08-05 23:20:58,411][52647] Sum rewards: 23.142, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.906', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.850', 'weapon2': '1.604', 'HITCOUNT': '1.650', 'weapon3': '1.752', 'DAMAGECOUNT': '6.570', 'FRAGCOUNT': '17.000'} [2024-08-05 23:20:58,882][52659] DAMAGECOUNT value on done: 31277.0 [2024-08-05 23:20:58,882][52659] Sum rewards: 19.837, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.694', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.010', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '1.360', 'weapon2': '1.526', 'ARMOR': '1.810', 'weapon3': '2.186', 'DAMAGECOUNT': '5.121', 'FRAGCOUNT': '18.000'} [2024-08-05 23:20:58,946][52671] DAMAGECOUNT value on done: 28497.0 [2024-08-05 23:20:58,946][52671] Sum rewards: 22.906, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.800', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'AMMO3': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.750', 'ARMOR': '0.971', 'weapon2': '1.530', 'HITCOUNT': '1.650', 'weapon3': '1.932', 'DAMAGECOUNT': '5.892', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:00,890][52647] DAMAGECOUNT value on done: 33048.0 [2024-08-05 23:21:00,891][52647] Sum rewards: 16.325, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.246', 'ARMOR': '0.479', 'WEAPON3': '0.700', 'weapon2': '1.492', 'HITCOUNT': '1.620', 'weapon3': '1.722', 'DAMAGECOUNT': '5.892', 'FRAGCOUNT': '12.000'} [2024-08-05 23:21:01,233][52649] DAMAGECOUNT value on done: 27151.0 [2024-08-05 23:21:01,233][52649] Sum rewards: 19.393, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.900', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.072', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'HITCOUNT': '1.510', 'weapon3': '1.606', 'weapon2': '1.734', 'DAMAGECOUNT': '5.376', 'FRAGCOUNT': '16.500'} [2024-08-05 23:21:01,545][52659] DAMAGECOUNT value on done: 30005.0 [2024-08-05 23:21:01,546][52659] Sum rewards: 26.867, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.381', 'AMMO4': '-0.028', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.366', 'WEAPON3': '0.750', 'ARMOR': '0.835', 'weapon2': '1.446', 'weapon3': '1.530', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '6.720', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:01,585][52671] DAMAGECOUNT value on done: 26640.0 [2024-08-05 23:21:01,585][52671] Sum rewards: 21.782, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.324', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.081', 'WEAPON4': '0.250', 'weapon4': '0.572', 'WEAPON3': '0.650', 'ARMOR': '0.917', 'weapon2': '0.946', 'HITCOUNT': '1.520', 'weapon3': '1.894', 'DAMAGECOUNT': '5.601', 'FRAGCOUNT': '16.500'} [2024-08-05 23:21:01,591][52820] DAMAGECOUNT value on done: 26667.0 [2024-08-05 23:21:01,591][52820] Sum rewards: 11.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.165', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.380', 'WEAPON3': '0.800', 'ARMOR': '0.896', 'HITCOUNT': '1.310', 'weapon3': '1.334', 'weapon2': '2.074', 'DAMAGECOUNT': '4.863', 'FRAGCOUNT': '10.000'} [2024-08-05 23:21:01,831][52650] Updated weights for policy 0, policy_version 14251 (0.0013) [2024-08-05 23:21:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 116768768. Throughput: 0: 4371.3. Samples: 29189920. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:21:02,794][52567] Avg episode reward: [(0, '21.890')] [2024-08-05 23:21:03,429][52647] DAMAGECOUNT value on done: 32388.0 [2024-08-05 23:21:03,430][52647] Sum rewards: 21.605, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.040', 'weapon4': '0.122', 'AMMO4': '0.137', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.428', 'HITCOUNT': '1.810', 'weapon3': '2.116', 'DAMAGECOUNT': '6.921', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:04,075][52659] DAMAGECOUNT value on done: 29530.0 [2024-08-05 23:21:04,080][52659] Sum rewards: 15.324, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.071', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.013', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.072', 'weapon4': '0.104', 'WEAPON5': '0.250', 'ARMOR': '0.420', 'WEAPON3': '0.600', 'HITCOUNT': '1.200', 'weapon3': '1.658', 'weapon2': '1.864', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '11.000'} [2024-08-05 23:21:04,101][52671] DAMAGECOUNT value on done: 31417.0 [2024-08-05 23:21:04,101][52671] Sum rewards: 25.457, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.073', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.374', 'ARMOR': '0.481', 'WEAPON3': '0.700', 'weapon2': '1.332', 'weapon3': '1.842', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '6.804', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:04,379][52649] DAMAGECOUNT value on done: 27712.0 [2024-08-05 23:21:04,380][52649] Sum rewards: 15.958, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.798', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.171', 'weapon4': '0.286', 'WEAPON4': '0.300', 'ARMOR': '0.929', 'weapon2': '1.074', 'WEAPON3': '1.200', 'HITCOUNT': '1.430', 'weapon3': '2.136', 'DAMAGECOUNT': '5.199', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:04,719][52820] DAMAGECOUNT value on done: 24890.0 [2024-08-05 23:21:04,721][52820] Sum rewards: 21.683, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.210', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.282', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.148', 'HITCOUNT': '1.700', 'weapon3': '1.910', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:06,145][52647] DAMAGECOUNT value on done: 31059.0 [2024-08-05 23:21:06,147][52647] Sum rewards: 23.380, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.560', 'AMMO2': '0.034', 'AMMO3': '0.111', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'ARMOR': '0.453', 'weapon4': '0.644', 'WEAPON3': '0.650', 'weapon2': '1.220', 'HITCOUNT': '1.490', 'weapon3': '1.684', 'DAMAGECOUNT': '4.986', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:06,888][52650] Updated weights for policy 0, policy_version 14261 (0.0028) [2024-08-05 23:21:06,950][52659] DAMAGECOUNT value on done: 27631.0 [2024-08-05 23:21:06,950][52659] Sum rewards: 20.863, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.430', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.063', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.450', 'weapon4': '0.812', 'weapon2': '0.840', 'weapon3': '1.394', 'HITCOUNT': '1.400', 'DAMAGECOUNT': '4.977', 'FRAGCOUNT': '15.000'} [2024-08-05 23:21:06,963][52671] DAMAGECOUNT value on done: 30777.0 [2024-08-05 23:21:06,963][52671] Sum rewards: 14.996, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'HEALTH': '0.122', 'WEAPON3': '0.700', 'ARMOR': '0.812', 'HITCOUNT': '1.450', 'weapon3': '1.694', 'weapon2': '2.024', 'DAMAGECOUNT': '5.046', 'FRAGCOUNT': '11.000'} [2024-08-05 23:21:07,273][52649] DAMAGECOUNT value on done: 30178.0 [2024-08-05 23:21:07,273][52649] Sum rewards: 26.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.986', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.460', 'WEAPON3': '1.200', 'ARMOR': '1.300', 'weapon2': '1.390', 'weapon3': '1.926', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '7.542', 'FRAGCOUNT': '23.000'} [2024-08-05 23:21:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 116850688. Throughput: 0: 4382.7. Samples: 29216650. Policy #0 lag: (min: 0.0, avg: 5.0, max: 10.0) [2024-08-05 23:21:07,795][52567] Avg episode reward: [(0, '21.915')] [2024-08-05 23:21:07,849][52820] DAMAGECOUNT value on done: 25389.0 [2024-08-05 23:21:07,853][52820] Sum rewards: 14.405, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.902', 'AMMO2': '0.003', 'AMMO5': '0.006', 'weapon4': '0.010', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON3': '0.600', 'ARMOR': '1.073', 'HITCOUNT': '1.100', 'weapon3': '1.386', 'weapon2': '1.722', 'DAMAGECOUNT': '4.428', 'FRAGCOUNT': '10.500'} [2024-08-05 23:21:08,699][52647] DAMAGECOUNT value on done: 31093.0 [2024-08-05 23:21:08,701][52647] Sum rewards: 19.911, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.658', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.137', 'AMMO3': '0.181', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.366', 'ARMOR': '0.490', 'WEAPON3': '1.100', 'weapon2': '1.318', 'HITCOUNT': '1.560', 'weapon3': '1.842', 'DAMAGECOUNT': '5.532', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:09,772][52659] DAMAGECOUNT value on done: 28905.0 [2024-08-05 23:21:09,788][52659] Sum rewards: 20.979, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.060', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO3': '0.139', 'AMMO4': '0.162', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.400', 'ARMOR': '0.474', 'WEAPON3': '1.050', 'weapon2': '1.074', 'HITCOUNT': '1.680', 'weapon3': '2.266', 'DAMAGECOUNT': '7.797', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:09,795][52671] DAMAGECOUNT value on done: 30866.0 [2024-08-05 23:21:09,799][52671] Sum rewards: 28.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.318', 'WEAPON3': '0.850', 'ARMOR': '0.899', 'weapon2': '0.998', 'HITCOUNT': '1.800', 'weapon3': '2.150', 'DAMAGECOUNT': '7.008', 'FRAGCOUNT': '23.000'} [2024-08-05 23:21:09,806][52794] DAMAGECOUNT value on done: 33686.0 [2024-08-05 23:21:09,806][52794] Sum rewards: 11.942, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.086', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.102', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.414', 'ARMOR': '0.479', 'WEAPON3': '0.750', 'HITCOUNT': '1.040', 'weapon2': '1.512', 'weapon3': '1.890', 'DAMAGECOUNT': '3.930', 'FRAGCOUNT': '9.000'} [2024-08-05 23:21:10,365][52649] DAMAGECOUNT value on done: 28235.0 [2024-08-05 23:21:10,366][52649] Sum rewards: 23.646, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.395', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.089', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'HITCOUNT': '1.640', 'weapon3': '1.684', 'weapon2': '1.750', 'DAMAGECOUNT': '5.622', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:10,749][52662] DAMAGECOUNT value on done: 34704.0 [2024-08-05 23:21:10,749][52662] Sum rewards: 21.006, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.040', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.072', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon3': '1.562', 'HITCOUNT': '1.670', 'weapon2': '1.688', 'DAMAGECOUNT': '6.546', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:10,848][52650] Updated weights for policy 0, policy_version 14271 (0.0015) [2024-08-05 23:21:11,013][52820] DAMAGECOUNT value on done: 28042.0 [2024-08-05 23:21:11,013][52820] Sum rewards: 20.848, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.420', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.014', 'weapon7': '0.058', 'AMMO4': '0.068', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'WEAPON3': '0.600', 'weapon2': '1.500', 'weapon3': '1.586', 'HITCOUNT': '1.650', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:11,195][52647] DAMAGECOUNT value on done: 27900.0 [2024-08-05 23:21:11,197][52647] Sum rewards: 12.665, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.416', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.062', 'AMMO3': '0.090', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'ARMOR': '0.836', 'HITCOUNT': '0.970', 'weapon3': '1.244', 'weapon2': '2.056', 'DAMAGECOUNT': '3.615', 'FRAGCOUNT': '9.000'} [2024-08-05 23:21:12,678][52794] DAMAGECOUNT value on done: 34207.0 [2024-08-05 23:21:12,678][52794] Sum rewards: 19.963, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.091', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.526', 'WEAPON3': '0.800', 'ARMOR': '1.357', 'weapon2': '1.546', 'weapon3': '1.550', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:12,794][52567] Fps is (10 sec: 15564.7, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 116924416. Throughput: 0: 4386.2. Samples: 29242840. Policy #0 lag: (min: 0.0, avg: 5.0, max: 10.0) [2024-08-05 23:21:12,802][52567] Avg episode reward: [(0, '22.181')] [2024-08-05 23:21:12,839][52649] DAMAGECOUNT value on done: 31977.0 [2024-08-05 23:21:12,840][52649] Sum rewards: 30.624, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.183', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon7': '0.048', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.622', 'HITCOUNT': '1.860', 'weapon3': '1.938', 'DAMAGECOUNT': '7.029', 'FRAGCOUNT': '25.000'} [2024-08-05 23:21:12,970][52659] DAMAGECOUNT value on done: 29865.0 [2024-08-05 23:21:12,974][52659] Sum rewards: 27.432, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.337', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon5': '0.062', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'WEAPON3': '0.600', 'ARMOR': '1.264', 'weapon3': '1.400', 'HITCOUNT': '1.510', 'weapon2': '1.932', 'DAMAGECOUNT': '6.033', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:13,002][52671] DAMAGECOUNT value on done: 29720.0 [2024-08-05 23:21:13,003][52671] Sum rewards: 23.967, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.096', 'AMMO3': '0.112', 'WEAPON4': '0.300', 'ARMOR': '0.839', 'WEAPON3': '0.850', 'weapon2': '1.450', 'HITCOUNT': '1.640', 'weapon3': '1.946', 'DAMAGECOUNT': '6.291', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:13,390][52662] DAMAGECOUNT value on done: 35247.0 [2024-08-05 23:21:13,391][52662] Sum rewards: 21.152, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.023', 'weapon4': '0.028', 'AMMO4': '0.114', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HITCOUNT': '1.580', 'weapon2': '1.820', 'weapon3': '1.926', 'DAMAGECOUNT': '6.087', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:14,029][52647] DAMAGECOUNT value on done: 31079.0 [2024-08-05 23:21:14,030][52647] Sum rewards: 24.980, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.891', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'AMMO3': '0.080', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.480', 'WEAPON3': '0.600', 'ARMOR': '0.953', 'weapon2': '1.394', 'weapon3': '1.590', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.218', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:14,115][52820] DAMAGECOUNT value on done: 27995.0 [2024-08-05 23:21:14,116][52820] Sum rewards: 20.055, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.099', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.083', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.650', 'HITCOUNT': '1.390', 'weapon3': '1.506', 'weapon2': '1.828', 'DAMAGECOUNT': '4.989', 'FRAGCOUNT': '15.000'} [2024-08-05 23:21:15,442][52794] DAMAGECOUNT value on done: 34653.0 [2024-08-05 23:21:15,442][52794] Sum rewards: 19.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.641', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.042', 'AMMO3': '0.133', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon2': '0.444', 'WEAPON4': '0.550', 'weapon4': '0.784', 'WEAPON3': '0.900', 'HITCOUNT': '1.720', 'weapon3': '1.924', 'DAMAGECOUNT': '5.871', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:15,601][52659] DAMAGECOUNT value on done: 32717.0 [2024-08-05 23:21:15,603][52659] Sum rewards: 22.097, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.260', 'weapon5': '0.004', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.040', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.100', 'WEAPON3': '0.700', 'weapon3': '1.560', 'HITCOUNT': '1.580', 'weapon2': '1.700', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '17.000'} [2024-08-05 23:21:15,613][52671] DAMAGECOUNT value on done: 29089.0 [2024-08-05 23:21:15,614][52671] Sum rewards: 19.366, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.754', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.832', 'HITCOUNT': '1.200', 'weapon2': '1.490', 'weapon3': '1.566', 'DAMAGECOUNT': '4.239', 'FRAGCOUNT': '17.000'} [2024-08-05 23:21:15,764][52650] Updated weights for policy 0, policy_version 14281 (0.0012) [2024-08-05 23:21:16,038][52649] DAMAGECOUNT value on done: 28441.0 [2024-08-05 23:21:16,042][52649] Sum rewards: 16.919, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.526', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.066', 'AMMO3': '0.112', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.662', 'WEAPON3': '0.700', 'ARMOR': '0.888', 'weapon2': '0.978', 'HITCOUNT': '1.350', 'weapon3': '1.356', 'DAMAGECOUNT': '4.836', 'FRAGCOUNT': '13.000'} [2024-08-05 23:21:16,314][52662] DAMAGECOUNT value on done: 37558.0 [2024-08-05 23:21:16,318][52662] Sum rewards: 28.888, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.936', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon4': '0.034', 'weapon5': '0.062', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.988', 'WEAPON3': '1.050', 'weapon2': '1.412', 'HITCOUNT': '1.970', 'weapon3': '2.276', 'DAMAGECOUNT': '7.581', 'FRAGCOUNT': '24.000'} [2024-08-05 23:21:16,688][52647] DAMAGECOUNT value on done: 29875.0 [2024-08-05 23:21:16,688][52647] Sum rewards: 20.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.149', 'AMMO5': '0.012', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'ARMOR': '1.310', 'weapon2': '1.438', 'HITCOUNT': '1.460', 'weapon3': '1.924', 'DAMAGECOUNT': '5.478', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:17,384][52820] DAMAGECOUNT value on done: 26284.0 [2024-08-05 23:21:17,384][52820] Sum rewards: 24.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.360', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.058', 'AMMO3': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.466', 'WEAPON3': '0.700', 'ARMOR': '0.903', 'HITCOUNT': '1.400', 'weapon3': '1.476', 'weapon2': '1.648', 'DAMAGECOUNT': '5.568', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 117030912. Throughput: 0: 4393.6. Samples: 29255760. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-05 23:21:17,794][52567] Avg episode reward: [(0, '22.014')] [2024-08-05 23:21:18,562][52794] DAMAGECOUNT value on done: 30940.0 [2024-08-05 23:21:18,563][52794] Sum rewards: 18.370, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.070', 'weapon5': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON3': '0.550', 'ARMOR': '0.933', 'HITCOUNT': '1.060', 'weapon2': '1.456', 'weapon3': '1.550', 'DAMAGECOUNT': '3.900', 'FRAGCOUNT': '14.000'} [2024-08-05 23:21:18,810][52659] DAMAGECOUNT value on done: 29052.0 [2024-08-05 23:21:18,810][52659] Sum rewards: 27.658, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.829', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.200', 'weapon4': '0.392', 'WEAPON3': '0.700', 'weapon2': '1.460', 'weapon3': '1.706', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '6.681', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:19,233][52649] DAMAGECOUNT value on done: 27042.0 [2024-08-05 23:21:19,235][52649] Sum rewards: 15.806, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.256', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.700', 'ARMOR': '0.852', 'HITCOUNT': '1.450', 'weapon2': '1.660', 'weapon3': '1.764', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '11.000'} [2024-08-05 23:21:19,246][52647] DAMAGECOUNT value on done: 32683.0 [2024-08-05 23:21:19,247][52647] Sum rewards: 24.331, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.194', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.300', 'weapon3': '1.690', 'weapon2': '1.910', 'DAMAGECOUNT': '4.929', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:19,305][52662] DAMAGECOUNT value on done: 32623.0 [2024-08-05 23:21:19,307][52662] Sum rewards: 26.379, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.311', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.356', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'HITCOUNT': '1.560', 'weapon2': '1.566', 'weapon3': '1.718', 'DAMAGECOUNT': '5.457', 'FRAGCOUNT': '21.000'} [2024-08-05 23:21:20,164][52650] Updated weights for policy 0, policy_version 14291 (0.0012) [2024-08-05 23:21:20,532][52820] DAMAGECOUNT value on done: 26689.0 [2024-08-05 23:21:20,535][52820] Sum rewards: 20.877, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.853', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.218', 'WEAPON3': '0.850', 'ARMOR': '0.874', 'weapon2': '1.590', 'weapon3': '1.640', 'HITCOUNT': '1.640', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '16.500'} [2024-08-05 23:21:21,532][52794] DAMAGECOUNT value on done: 34467.0 [2024-08-05 23:21:21,533][52794] Sum rewards: 28.532, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.263', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.115', 'weapon4': '0.258', 'WEAPON3': '0.700', 'ARMOR': '1.249', 'weapon2': '1.366', 'weapon3': '1.750', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:21,963][52659] DAMAGECOUNT value on done: 29361.0 [2024-08-05 23:21:21,964][52659] Sum rewards: 17.309, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.118', 'weapon5': '0.172', 'weapon4': '0.246', 'WEAPON3': '0.800', 'HITCOUNT': '1.360', 'weapon2': '1.580', 'weapon3': '1.594', 'DAMAGECOUNT': '5.052', 'FRAGCOUNT': '14.000'} [2024-08-05 23:21:22,042][52649] DAMAGECOUNT value on done: 30297.0 [2024-08-05 23:21:22,042][52649] Sum rewards: 15.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.613', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.085', 'weapon5': '0.114', 'AMMO3': '0.154', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon4': '0.550', 'WEAPON3': '1.050', 'weapon2': '1.260', 'HITCOUNT': '1.420', 'weapon3': '1.586', 'DAMAGECOUNT': '4.713', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:22,169][52647] DAMAGECOUNT value on done: 29229.0 [2024-08-05 23:21:22,170][52647] Sum rewards: 19.117, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.760', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.080', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'ARMOR': '1.303', 'HITCOUNT': '1.610', 'weapon3': '1.798', 'weapon2': '1.810', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '13.000'} [2024-08-05 23:21:22,256][52662] DAMAGECOUNT value on done: 33027.0 [2024-08-05 23:21:22,257][52662] Sum rewards: 23.501, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.139', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.080', 'weapon4': '0.090', 'AMMO3': '0.125', 'AMMO4': '0.165', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'ARMOR': '1.319', 'HITCOUNT': '1.430', 'weapon2': '1.630', 'weapon3': '1.886', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:22,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 117112832. Throughput: 0: 4386.9. Samples: 29282060. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-05 23:21:22,795][52567] Avg episode reward: [(0, '22.154')] [2024-08-05 23:21:23,264][52614] Signal inference workers to stop experience collection... (2650 times) [2024-08-05 23:21:23,265][52614] Signal inference workers to resume experience collection... (2650 times) [2024-08-05 23:21:23,343][52650] InferenceWorker_p0-w0: stopping experience collection (2650 times) [2024-08-05 23:21:23,343][52650] InferenceWorker_p0-w0: resuming experience collection (2650 times) [2024-08-05 23:21:23,696][52820] DAMAGECOUNT value on done: 27248.0 [2024-08-05 23:21:23,697][52820] Sum rewards: 28.187, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.346', 'AMMO2': '0.021', 'AMMO3': '0.084', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'weapon4': '0.268', 'WEAPON3': '0.550', 'ARMOR': '1.333', 'weapon3': '1.740', 'weapon2': '1.742', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '6.099', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:24,084][52794] DAMAGECOUNT value on done: 35639.0 [2024-08-05 23:21:24,084][52794] Sum rewards: 24.233, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.180', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'weapon5': '0.004', 'AMMO5': '0.005', 'weapon4': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.544', 'HITCOUNT': '1.890', 'weapon3': '2.250', 'DAMAGECOUNT': '7.179', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:24,800][52662] DAMAGECOUNT value on done: 36030.0 [2024-08-05 23:21:24,800][52662] Sum rewards: 28.253, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.133', 'weapon5': '0.144', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.436', 'WEAPON3': '0.800', 'ARMOR': '0.866', 'weapon2': '1.108', 'HITCOUNT': '1.770', 'weapon3': '1.980', 'DAMAGECOUNT': '7.518', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:24,886][52659] DAMAGECOUNT value on done: 30037.0 [2024-08-05 23:21:24,886][52659] Sum rewards: 31.303, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.360', 'AMMO4': '-0.039', 'AMMO2': '-0.008', 'AMMO5': '0.005', 'weapon4': '0.006', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'ARMOR': '0.967', 'WEAPON3': '1.200', 'weapon2': '1.468', 'HITCOUNT': '1.870', 'weapon3': '2.076', 'DAMAGECOUNT': '7.452', 'FRAGCOUNT': '28.000'} [2024-08-05 23:21:24,927][52647] DAMAGECOUNT value on done: 30546.0 [2024-08-05 23:21:24,928][52647] Sum rewards: 8.692, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.142', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.109', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.302', 'ARMOR': '0.469', 'WEAPON3': '0.850', 'HITCOUNT': '1.090', 'weapon2': '1.568', 'weapon3': '1.716', 'DAMAGECOUNT': '3.444', 'FRAGCOUNT': '8.000'} [2024-08-05 23:21:25,100][52649] DAMAGECOUNT value on done: 27436.0 [2024-08-05 23:21:25,101][52649] Sum rewards: 23.736, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.428', 'AMMO2': '0.004', 'weapon4': '0.010', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON3': '0.850', 'ARMOR': '1.357', 'HITCOUNT': '1.800', 'weapon3': '1.862', 'weapon2': '1.952', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:25,247][52650] Updated weights for policy 0, policy_version 14301 (0.0013) [2024-08-05 23:21:26,282][52668] DAMAGECOUNT value on done: 28822.0 [2024-08-05 23:21:26,284][52668] Sum rewards: 23.665, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.080', 'AMMO4': '0.097', 'weapon4': '0.178', 'HEALTH': '0.198', 'WEAPON3': '0.550', 'ARMOR': '0.951', 'HITCOUNT': '1.450', 'weapon2': '1.608', 'weapon3': '1.722', 'DAMAGECOUNT': '4.944', 'FRAGCOUNT': '17.000'} [2024-08-05 23:21:26,442][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:21:26,791][52794] DAMAGECOUNT value on done: 34933.0 [2024-08-05 23:21:26,792][52794] Sum rewards: 19.455, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.602', 'AMMO2': '0.008', 'AMMO5': '0.011', 'weapon5': '0.026', 'AMMO4': '0.039', 'AMMO3': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'ARMOR': '0.850', 'weapon2': '1.462', 'weapon3': '1.488', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '5.943', 'FRAGCOUNT': '14.000'} [2024-08-05 23:21:26,804][52820] DAMAGECOUNT value on done: 28311.0 [2024-08-05 23:21:26,806][52820] Sum rewards: 6.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.109', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.086', 'weapon4': '0.088', 'AMMO3': '0.110', 'AMMO4': '0.127', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.823', 'HITCOUNT': '1.110', 'weapon2': '1.562', 'weapon3': '1.696', 'DAMAGECOUNT': '3.534', 'FRAGCOUNT': '6.000'} [2024-08-05 23:21:27,417][52647] DAMAGECOUNT value on done: 30274.0 [2024-08-05 23:21:27,417][52647] Sum rewards: 22.636, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.054', 'weapon7': '0.076', 'AMMO3': '0.090', 'HEALTH': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'ARMOR': '0.450', 'WEAPON3': '0.550', 'weapon3': '1.346', 'weapon2': '1.388', 'HITCOUNT': '1.420', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:27,671][52659] DAMAGECOUNT value on done: 32253.0 [2024-08-05 23:21:27,673][52659] Sum rewards: 31.441, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.020', 'weapon4': '0.076', 'AMMO4': '0.078', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'ARMOR': '1.258', 'weapon2': '1.682', 'HITCOUNT': '1.800', 'weapon3': '1.874', 'DAMAGECOUNT': '8.019', 'FRAGCOUNT': '25.000'} [2024-08-05 23:21:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 117194752. Throughput: 0: 4392.2. Samples: 29308550. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-05 23:21:27,795][52567] Avg episode reward: [(0, '21.972')] [2024-08-05 23:21:27,800][52662] DAMAGECOUNT value on done: 36566.0 [2024-08-05 23:21:27,801][52662] Sum rewards: 20.349, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.488', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.095', 'WEAPON4': '0.250', 'weapon4': '0.540', 'WEAPON3': '0.650', 'ARMOR': '0.873', 'weapon2': '1.274', 'weapon3': '1.526', 'HITCOUNT': '1.590', 'DAMAGECOUNT': '4.926', 'FRAGCOUNT': '15.000'} [2024-08-05 23:21:28,274][52649] DAMAGECOUNT value on done: 30051.0 [2024-08-05 23:21:28,275][52649] Sum rewards: 19.973, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.048', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO4': '0.097', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '1.360', 'weapon3': '1.630', 'weapon2': '1.768', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:29,089][52668] DAMAGECOUNT value on done: 32435.0 [2024-08-05 23:21:29,091][52668] Sum rewards: 35.046, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.096', 'HEALTH': '0.373', 'ARMOR': '0.470', 'WEAPON3': '0.550', 'weapon3': '1.768', 'weapon2': '1.856', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '7.812', 'FRAGCOUNT': '26.000'} [2024-08-05 23:21:29,372][52650] Updated weights for policy 0, policy_version 14311 (0.0022) [2024-08-05 23:21:29,655][52647] DAMAGECOUNT value on done: 31050.0 [2024-08-05 23:21:29,657][52647] Sum rewards: 18.129, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.308', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.036', 'AMMO3': '0.106', 'weapon4': '0.176', 'WEAPON4': '0.200', 'ARMOR': '0.447', 'WEAPON3': '0.750', 'HITCOUNT': '1.370', 'weapon3': '1.530', 'weapon2': '1.984', 'DAMAGECOUNT': '4.560', 'FRAGCOUNT': '15.000'} [2024-08-05 23:21:29,807][52794] DAMAGECOUNT value on done: 31484.0 [2024-08-05 23:21:29,808][52794] Sum rewards: 27.826, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.537', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.118', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'ARMOR': '0.849', 'weapon3': '1.602', 'weapon2': '1.694', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '7.452', 'FRAGCOUNT': '23.000'} [2024-08-05 23:21:29,941][52820] DAMAGECOUNT value on done: 27144.0 [2024-08-05 23:21:29,943][52820] Sum rewards: 31.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.108', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.119', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.360', 'weapon3': '1.968', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '7.578', 'FRAGCOUNT': '24.000'} [2024-08-05 23:21:30,663][52662] DAMAGECOUNT value on done: 37670.0 [2024-08-05 23:21:30,663][52662] Sum rewards: 26.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.155', 'weapon4': '0.186', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.118', 'HITCOUNT': '1.820', 'weapon3': '2.460', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '24.000'} [2024-08-05 23:21:31,484][52649] DAMAGECOUNT value on done: 30559.0 [2024-08-05 23:21:31,485][52649] Sum rewards: 22.273, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.121', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.083', 'AMMO3': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.847', 'HITCOUNT': '1.450', 'weapon2': '1.646', 'weapon3': '1.686', 'DAMAGECOUNT': '5.715', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:32,211][52668] DAMAGECOUNT value on done: 28105.0 [2024-08-05 23:21:32,213][52668] Sum rewards: 21.252, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.674', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.074', 'AMMO3': '0.085', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON3': '0.600', 'ARMOR': '0.824', 'HITCOUNT': '1.490', 'weapon2': '1.564', 'weapon3': '1.622', 'DAMAGECOUNT': '5.118', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:32,477][52794] DAMAGECOUNT value on done: 34823.0 [2024-08-05 23:21:32,477][52794] Sum rewards: 26.261, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.664', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.138', 'weapon4': '0.194', 'WEAPON3': '0.900', 'ARMOR': '0.908', 'weapon2': '1.050', 'HITCOUNT': '1.780', 'weapon3': '2.282', 'DAMAGECOUNT': '7.719', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:32,519][52647] DAMAGECOUNT value on done: 31522.0 [2024-08-05 23:21:32,520][52647] Sum rewards: 18.030, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO3': '0.099', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'weapon2': '0.698', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '0.986', 'HITCOUNT': '1.590', 'weapon3': '1.722', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 117284864. Throughput: 0: 4385.8. Samples: 29321630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:21:32,795][52567] Avg episode reward: [(0, '22.191')] [2024-08-05 23:21:33,100][52820] DAMAGECOUNT value on done: 30100.0 [2024-08-05 23:21:33,102][52820] Sum rewards: 23.172, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.136', 'HEALTH': '0.148', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON3': '0.800', 'weapon2': '1.244', 'weapon3': '1.766', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '7.236', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:33,555][52662] DAMAGECOUNT value on done: 33040.0 [2024-08-05 23:21:33,555][52662] Sum rewards: 16.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.163', 'weapon4': '0.334', 'WEAPON4': '0.400', 'ARMOR': '0.443', 'WEAPON3': '1.100', 'weapon2': '1.222', 'HITCOUNT': '1.710', 'weapon3': '2.016', 'DAMAGECOUNT': '5.586', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:34,153][52650] Updated weights for policy 0, policy_version 14321 (0.0011) [2024-08-05 23:21:34,448][52649] DAMAGECOUNT value on done: 31460.0 [2024-08-05 23:21:34,448][52649] Sum rewards: 25.087, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'AMMO2': '0.006', 'AMMO5': '0.009', 'weapon5': '0.012', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'ARMOR': '0.880', 'WEAPON3': '0.950', 'HITCOUNT': '1.670', 'weapon2': '1.678', 'weapon3': '1.986', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:34,902][52668] DAMAGECOUNT value on done: 30791.0 [2024-08-05 23:21:34,903][52668] Sum rewards: 14.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.784', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.028', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'weapon4': '0.680', 'weapon2': '0.904', 'WEAPON3': '1.000', 'HITCOUNT': '1.370', 'weapon3': '1.904', 'DAMAGECOUNT': '4.737', 'FRAGCOUNT': '13.000'} [2024-08-05 23:21:34,935][52660] DAMAGECOUNT value on done: 29950.0 [2024-08-05 23:21:34,935][52660] Sum rewards: 14.822, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.300', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'weapon5': '0.058', 'AMMO3': '0.092', 'AMMO4': '0.261', 'WEAPON4': '0.400', 'ARMOR': '0.511', 'WEAPON3': '0.550', 'weapon4': '0.748', 'weapon2': '1.342', 'HITCOUNT': '1.380', 'weapon3': '1.456', 'DAMAGECOUNT': '4.716', 'FRAGCOUNT': '11.000'} [2024-08-05 23:21:35,379][52794] DAMAGECOUNT value on done: 34804.0 [2024-08-05 23:21:35,380][52794] Sum rewards: 23.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.058', 'AMMO4': '0.126', 'AMMO3': '0.176', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.132', 'HITCOUNT': '1.710', 'weapon3': '2.216', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '21.000'} [2024-08-05 23:21:36,183][52820] DAMAGECOUNT value on done: 30392.0 [2024-08-05 23:21:36,183][52820] Sum rewards: 24.544, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.414', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.050', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.598', 'HITCOUNT': '1.610', 'weapon3': '2.080', 'DAMAGECOUNT': '6.789', 'FRAGCOUNT': '18.000'} [2024-08-05 23:21:36,469][52662] DAMAGECOUNT value on done: 34469.0 [2024-08-05 23:21:36,470][52662] Sum rewards: 17.992, reward structure: {'DEATHCOUNT': '-3.000', 'HEALTH': '-0.791', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'AMMO5': '0.014', 'AMMO3': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.240', 'weapon4': '0.312', 'WEAPON3': '0.450', 'ARMOR': '0.950', 'HITCOUNT': '1.140', 'weapon3': '1.226', 'weapon2': '1.264', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '10.500'} [2024-08-05 23:21:37,520][52668] DAMAGECOUNT value on done: 29914.0 [2024-08-05 23:21:37,528][52668] Sum rewards: 26.172, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.645', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'ARMOR': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'weapon4': '0.406', 'WEAPON3': '0.850', 'weapon2': '1.424', 'HITCOUNT': '1.640', 'weapon3': '1.788', 'DAMAGECOUNT': '6.036', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:37,767][52660] DAMAGECOUNT value on done: 30972.0 [2024-08-05 23:21:37,767][52660] Sum rewards: 19.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.826', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.804', 'HITCOUNT': '1.390', 'weapon3': '1.858', 'weapon2': '1.892', 'DAMAGECOUNT': '4.947', 'FRAGCOUNT': '17.000'} [2024-08-05 23:21:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 117374976. Throughput: 0: 4386.7. Samples: 29348030. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:21:37,796][52567] Avg episode reward: [(0, '21.923')] [2024-08-05 23:21:38,191][52794] DAMAGECOUNT value on done: 34915.0 [2024-08-05 23:21:38,193][52794] Sum rewards: 23.457, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.588', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.036', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'HITCOUNT': '1.680', 'weapon3': '1.706', 'weapon2': '1.750', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:38,857][52650] Updated weights for policy 0, policy_version 14331 (0.0011) [2024-08-05 23:21:38,945][52662] DAMAGECOUNT value on done: 34090.0 [2024-08-05 23:21:38,947][52662] Sum rewards: 24.690, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.546', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.089', 'weapon5': '0.126', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.564', 'ARMOR': '0.812', 'weapon3': '1.320', 'weapon2': '1.726', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:39,289][52820] DAMAGECOUNT value on done: 28365.0 [2024-08-05 23:21:39,291][52820] Sum rewards: 25.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.470', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.148', 'ARMOR': '0.847', 'WEAPON3': '0.950', 'HITCOUNT': '1.600', 'weapon2': '1.724', 'weapon3': '1.922', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:40,572][52668] DAMAGECOUNT value on done: 31596.0 [2024-08-05 23:21:40,572][52668] Sum rewards: 18.624, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO4': '0.064', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.202', 'HEALTH': '0.433', 'WEAPON3': '0.550', 'ARMOR': '1.255', 'HITCOUNT': '1.490', 'weapon2': '1.598', 'weapon3': '1.620', 'DAMAGECOUNT': '5.490', 'FRAGCOUNT': '11.500'} [2024-08-05 23:21:40,715][52660] DAMAGECOUNT value on done: 31120.0 [2024-08-05 23:21:40,715][52660] Sum rewards: 30.505, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.024', 'weapon7': '0.058', 'AMMO4': '0.083', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.300', 'weapon4': '0.482', 'WEAPON3': '0.750', 'weapon2': '1.050', 'weapon3': '1.758', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '7.548', 'FRAGCOUNT': '25.000'} [2024-08-05 23:21:40,816][52794] DAMAGECOUNT value on done: 35572.0 [2024-08-05 23:21:40,817][52794] Sum rewards: 39.179, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO2': '0.017', 'ARMOR': '0.028', 'AMMO4': '0.084', 'AMMO3': '0.092', 'HEALTH': '0.161', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.766', 'weapon2': '0.778', 'weapon3': '2.038', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '8.235', 'FRAGCOUNT': '30.000'} [2024-08-05 23:21:41,646][52662] DAMAGECOUNT value on done: 33429.0 [2024-08-05 23:21:41,648][52662] Sum rewards: 33.560, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.263', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.282', 'ARMOR': '0.457', 'WEAPON3': '0.800', 'weapon2': '1.518', 'weapon3': '1.920', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '7.896', 'FRAGCOUNT': '27.000'} [2024-08-05 23:21:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 117465088. Throughput: 0: 4389.6. Samples: 29374460. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:21:42,802][52567] Avg episode reward: [(0, '22.412')] [2024-08-05 23:21:42,802][52614] Saving new best policy, reward=22.412! [2024-08-05 23:21:43,638][52650] Updated weights for policy 0, policy_version 14341 (0.0022) [2024-08-05 23:21:43,683][52794] DAMAGECOUNT value on done: 34079.0 [2024-08-05 23:21:43,686][52794] Sum rewards: 26.974, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.020', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'WEAPON3': '0.950', 'ARMOR': '1.306', 'weapon2': '1.620', 'HITCOUNT': '1.780', 'weapon3': '1.966', 'DAMAGECOUNT': '6.750', 'FRAGCOUNT': '23.000'} [2024-08-05 23:21:43,822][52668] DAMAGECOUNT value on done: 32583.0 [2024-08-05 23:21:43,824][52668] Sum rewards: 11.885, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.110', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.495', 'WEAPON3': '1.050', 'HITCOUNT': '1.170', 'weapon3': '1.614', 'weapon2': '1.982', 'DAMAGECOUNT': '4.122', 'FRAGCOUNT': '11.000'} [2024-08-05 23:21:43,955][52660] DAMAGECOUNT value on done: 29802.0 [2024-08-05 23:21:43,955][52660] Sum rewards: 31.798, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.574', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.092', 'WEAPON4': '0.300', 'ARMOR': '0.484', 'weapon4': '0.566', 'WEAPON3': '0.700', 'weapon2': '1.090', 'weapon3': '1.858', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '7.317', 'FRAGCOUNT': '24.000'} [2024-08-05 23:21:44,331][52795] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:21:44,570][52662] DAMAGECOUNT value on done: 35893.0 [2024-08-05 23:21:44,572][52662] Sum rewards: 16.564, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.795', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO3': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon5': '0.108', 'WEAPON4': '0.200', 'weapon4': '0.312', 'ARMOR': '0.453', 'WEAPON3': '0.500', 'HITCOUNT': '1.370', 'weapon3': '1.448', 'weapon2': '1.572', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '11.500'} [2024-08-05 23:21:46,287][52794] DAMAGECOUNT value on done: 37933.0 [2024-08-05 23:21:46,290][52794] Sum rewards: 27.419, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.241', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.139', 'ARMOR': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.560', 'HITCOUNT': '1.910', 'weapon3': '2.200', 'DAMAGECOUNT': '6.672', 'FRAGCOUNT': '23.000'} [2024-08-05 23:21:47,200][52668] DAMAGECOUNT value on done: 31255.0 [2024-08-05 23:21:47,200][52668] Sum rewards: 18.436, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon4': '0.130', 'HEALTH': '0.155', 'AMMO4': '0.294', 'WEAPON4': '0.450', 'ARMOR': '0.460', 'WEAPON3': '0.700', 'HITCOUNT': '1.230', 'weapon3': '1.554', 'weapon2': '1.618', 'DAMAGECOUNT': '4.788', 'FRAGCOUNT': '15.000'} [2024-08-05 23:21:47,221][52660] DAMAGECOUNT value on done: 25711.0 [2024-08-05 23:21:47,222][52660] Sum rewards: 14.064, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.400', 'AMMO4': '-0.064', 'AMMO2': '-0.013', 'AMMO5': '0.005', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.388', 'WEAPON3': '0.900', 'ARMOR': '0.965', 'HITCOUNT': '1.390', 'weapon2': '1.588', 'weapon3': '1.700', 'DAMAGECOUNT': '4.842', 'FRAGCOUNT': '12.000'} [2024-08-05 23:21:47,264][52662] DAMAGECOUNT value on done: 33283.0 [2024-08-05 23:21:47,266][52662] Sum rewards: 13.234, reward structure: {'DEATHCOUNT': '-9.750', 'weapon5': '0.002', 'AMMO5': '0.003', 'weapon4': '0.030', 'AMMO2': '0.031', 'HEALTH': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON3': '0.700', 'ARMOR': '0.900', 'HITCOUNT': '1.390', 'weapon2': '1.642', 'weapon3': '2.086', 'DAMAGECOUNT': '4.632', 'FRAGCOUNT': '11.000'} [2024-08-05 23:21:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 117547008. Throughput: 0: 4392.0. Samples: 29387560. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:21:47,795][52567] Avg episode reward: [(0, '22.138')] [2024-08-05 23:21:48,005][52650] Updated weights for policy 0, policy_version 14351 (0.0011) [2024-08-05 23:21:49,504][52794] DAMAGECOUNT value on done: 33249.0 [2024-08-05 23:21:49,504][52794] Sum rewards: 28.580, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.055', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.192', 'WEAPON3': '0.700', 'weapon2': '1.702', 'weapon3': '1.798', 'HITCOUNT': '1.940', 'DAMAGECOUNT': '7.713', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:50,230][52668] DAMAGECOUNT value on done: 28537.0 [2024-08-05 23:21:50,231][52668] Sum rewards: 23.972, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.224', 'AMMO5': '0.010', 'weapon5': '0.034', 'ARMOR': '0.036', 'AMMO2': '0.039', 'AMMO3': '0.158', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.572', 'WEAPON3': '0.950', 'weapon2': '1.220', 'weapon3': '1.872', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.197', 'FRAGCOUNT': '20.000'} [2024-08-05 23:21:50,249][52660] DAMAGECOUNT value on done: 30690.0 [2024-08-05 23:21:50,250][52660] Sum rewards: 22.939, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO3': '0.105', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.282', 'WEAPON3': '0.650', 'ARMOR': '0.861', 'weapon2': '1.432', 'HITCOUNT': '1.570', 'weapon3': '1.692', 'DAMAGECOUNT': '5.589', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:50,361][52662] DAMAGECOUNT value on done: 36146.0 [2024-08-05 23:21:50,365][52662] Sum rewards: 16.236, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.193', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.108', 'ARMOR': '0.445', 'WEAPON3': '0.850', 'HITCOUNT': '1.360', 'weapon2': '1.704', 'weapon3': '1.726', 'DAMAGECOUNT': '4.860', 'FRAGCOUNT': '14.000'} [2024-08-05 23:21:52,344][52794] DAMAGECOUNT value on done: 35703.0 [2024-08-05 23:21:52,352][52794] Sum rewards: 28.497, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'ARMOR': '0.436', 'WEAPON3': '1.050', 'weapon2': '1.492', 'HITCOUNT': '1.990', 'weapon3': '2.224', 'DAMAGECOUNT': '8.145', 'FRAGCOUNT': '24.000'} [2024-08-05 23:21:52,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 117637120. Throughput: 0: 4385.1. Samples: 29413980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:21:52,795][52567] Avg episode reward: [(0, '22.098')] [2024-08-05 23:21:52,856][52650] Updated weights for policy 0, policy_version 14361 (0.0024) [2024-08-05 23:21:53,095][52668] DAMAGECOUNT value on done: 32644.0 [2024-08-05 23:21:53,097][52668] Sum rewards: 10.079, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.088', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.088', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.576', 'WEAPON3': '0.650', 'HITCOUNT': '1.060', 'weapon3': '1.322', 'weapon2': '1.380', 'ARMOR': '1.904', 'DAMAGECOUNT': '3.627', 'FRAGCOUNT': '8.000'} [2024-08-05 23:21:53,128][52660] DAMAGECOUNT value on done: 29030.0 [2024-08-05 23:21:53,130][52660] Sum rewards: 28.667, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.381', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.080', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON3': '0.850', 'weapon2': '1.264', 'ARMOR': '1.317', 'HITCOUNT': '1.920', 'weapon3': '2.012', 'DAMAGECOUNT': '7.404', 'FRAGCOUNT': '24.000'} [2024-08-05 23:21:53,154][52662] DAMAGECOUNT value on done: 36851.0 [2024-08-05 23:21:53,154][52662] Sum rewards: 31.712, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO3': '0.108', 'HEALTH': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON3': '0.650', 'weapon4': '0.806', 'ARMOR': '0.820', 'weapon2': '1.066', 'weapon3': '1.796', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '24.000'} [2024-08-05 23:21:55,190][52794] DAMAGECOUNT value on done: 35862.0 [2024-08-05 23:21:55,192][52794] Sum rewards: 19.027, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.604', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.090', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'weapon4': '0.582', 'WEAPON3': '0.600', 'weapon2': '1.262', 'HITCOUNT': '1.750', 'weapon3': '1.778', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '14.000'} [2024-08-05 23:21:55,787][52662] DAMAGECOUNT value on done: 34508.0 [2024-08-05 23:21:55,789][52662] Sum rewards: 25.696, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.242', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.015', 'AMMO3': '0.073', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.488', 'weapon4': '0.522', 'WEAPON3': '0.700', 'weapon2': '1.040', 'weapon3': '1.624', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.212', 'FRAGCOUNT': '19.000'} [2024-08-05 23:21:56,028][52668] DAMAGECOUNT value on done: 28854.0 [2024-08-05 23:21:56,029][52668] Sum rewards: 19.983, reward structure: {'DEATHCOUNT': '-3.750', 'AMMO5': '0.003', 'weapon7': '0.020', 'AMMO2': '0.023', 'AMMO3': '0.060', 'weapon5': '0.080', 'WEAPON5': '0.100', 'HEALTH': '0.101', 'AMMO4': '0.115', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '0.400', 'ARMOR': '0.424', 'weapon4': '0.602', 'weapon3': '1.316', 'HITCOUNT': '1.320', 'weapon2': '1.370', 'DAMAGECOUNT': '5.079', 'FRAGCOUNT': '12.000'} [2024-08-05 23:21:56,129][52660] DAMAGECOUNT value on done: 30485.0 [2024-08-05 23:21:56,130][52660] Sum rewards: 18.473, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.156', 'weapon4': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.859', 'WEAPON3': '0.950', 'weapon2': '1.500', 'HITCOUNT': '1.590', 'weapon3': '2.036', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:57,666][52650] Updated weights for policy 0, policy_version 14371 (0.0011) [2024-08-05 23:21:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 117727232. Throughput: 0: 4387.6. Samples: 29440280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:21:57,794][52567] Avg episode reward: [(0, '22.303')] [2024-08-05 23:21:57,990][52794] DAMAGECOUNT value on done: 35470.0 [2024-08-05 23:21:57,990][52794] Sum rewards: 19.063, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.086', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.494', 'weapon4': '0.690', 'WEAPON3': '0.700', 'weapon2': '1.138', 'HITCOUNT': '1.540', 'weapon3': '1.560', 'DAMAGECOUNT': '5.085', 'FRAGCOUNT': '16.000'} [2024-08-05 23:21:58,774][52662] DAMAGECOUNT value on done: 36158.0 [2024-08-05 23:21:58,775][52662] Sum rewards: 26.259, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.203', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.350', 'WEAPON3': '0.850', 'ARMOR': '0.940', 'weapon2': '1.246', 'HITCOUNT': '1.830', 'weapon3': '2.122', 'DAMAGECOUNT': '5.952', 'FRAGCOUNT': '22.000'} [2024-08-05 23:21:58,781][52668] DAMAGECOUNT value on done: 29579.0 [2024-08-05 23:21:58,781][52668] Sum rewards: 8.118, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.143', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.388', 'ARMOR': '0.420', 'WEAPON3': '0.850', 'HITCOUNT': '1.020', 'weapon2': '1.414', 'weapon3': '1.544', 'DAMAGECOUNT': '3.630', 'FRAGCOUNT': '8.000'} [2024-08-05 23:21:58,846][52660] DAMAGECOUNT value on done: 29778.0 [2024-08-05 23:21:58,846][52660] Sum rewards: 18.427, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.335', 'AMMO4': '-0.061', 'AMMO2': '-0.012', 'AMMO3': '0.081', 'WEAPON3': '0.650', 'HITCOUNT': '1.480', 'weapon3': '1.678', 'weapon2': '1.864', 'DAMAGECOUNT': '5.082', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:00,980][52803] DAMAGECOUNT value on done: 29226.0 [2024-08-05 23:22:00,981][52803] Sum rewards: 19.521, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.898', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.089', 'AMMO3': '0.092', 'weapon5': '0.146', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON3': '0.650', 'weapon2': '1.334', 'HITCOUNT': '1.520', 'weapon3': '1.526', 'DAMAGECOUNT': '5.682', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:01,073][52794] DAMAGECOUNT value on done: 34920.0 [2024-08-05 23:22:01,074][52794] Sum rewards: 20.416, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.074', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.117', 'WEAPON3': '0.800', 'ARMOR': '0.848', 'HITCOUNT': '1.580', 'weapon2': '1.780', 'weapon3': '1.962', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:01,516][52668] DAMAGECOUNT value on done: 28681.0 [2024-08-05 23:22:01,516][52668] Sum rewards: 18.052, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.512', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.090', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.270', 'ARMOR': '0.848', 'WEAPON3': '0.950', 'HITCOUNT': '1.300', 'weapon2': '1.304', 'weapon3': '1.814', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:01,599][52660] DAMAGECOUNT value on done: 30027.0 [2024-08-05 23:22:01,601][52660] Sum rewards: 20.317, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.237', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON3': '0.950', 'weapon2': '1.642', 'HITCOUNT': '1.670', 'weapon3': '2.092', 'DAMAGECOUNT': '5.955', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:01,756][52662] DAMAGECOUNT value on done: 33265.0 [2024-08-05 23:22:01,757][52662] Sum rewards: 17.107, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.133', 'AMMO4': '0.153', 'weapon4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'ARMOR': '0.894', 'weapon2': '1.468', 'HITCOUNT': '1.590', 'weapon3': '2.128', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:02,287][52650] Updated weights for policy 0, policy_version 14381 (0.0011) [2024-08-05 23:22:02,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 117817344. Throughput: 0: 4398.2. Samples: 29453680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:22:02,794][52567] Avg episode reward: [(0, '22.146')] [2024-08-05 23:22:04,087][52803] DAMAGECOUNT value on done: 31761.0 [2024-08-05 23:22:04,088][52803] Sum rewards: 23.773, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.522', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.156', 'weapon4': '0.180', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'weapon2': '0.934', 'WEAPON3': '1.050', 'HITCOUNT': '1.760', 'weapon3': '2.420', 'DAMAGECOUNT': '7.467', 'FRAGCOUNT': '21.500'} [2024-08-05 23:22:04,242][52794] DAMAGECOUNT value on done: 34919.0 [2024-08-05 23:22:04,243][52794] Sum rewards: 22.139, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.485', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.482', 'WEAPON3': '0.700', 'ARMOR': '0.908', 'weapon2': '1.394', 'HITCOUNT': '1.520', 'weapon3': '1.574', 'DAMAGECOUNT': '5.496', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:04,377][52668] DAMAGECOUNT value on done: 29012.0 [2024-08-05 23:22:04,377][52668] Sum rewards: 23.204, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.380', 'AMMO2': '0.025', 'weapon4': '0.110', 'AMMO4': '0.125', 'AMMO3': '0.129', 'WEAPON4': '0.400', 'ARMOR': '0.871', 'WEAPON3': '0.950', 'weapon2': '1.522', 'HITCOUNT': '1.680', 'weapon3': '1.778', 'DAMAGECOUNT': '6.243', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:04,552][52660] DAMAGECOUNT value on done: 30679.0 [2024-08-05 23:22:04,552][52660] Sum rewards: 20.573, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.014', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon4': '0.146', 'WEAPON4': '0.300', 'ARMOR': '0.481', 'WEAPON3': '0.900', 'HITCOUNT': '1.530', 'weapon3': '1.626', 'weapon2': '1.764', 'DAMAGECOUNT': '6.060', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:04,735][52662] DAMAGECOUNT value on done: 34058.0 [2024-08-05 23:22:04,737][52662] Sum rewards: 14.451, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.384', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO3': '0.076', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.050', 'weapon3': '1.588', 'weapon2': '1.802', 'DAMAGECOUNT': '4.257', 'FRAGCOUNT': '10.500'} [2024-08-05 23:22:06,809][52650] Updated weights for policy 0, policy_version 14391 (0.0031) [2024-08-05 23:22:07,097][52803] DAMAGECOUNT value on done: 27090.0 [2024-08-05 23:22:07,102][52803] Sum rewards: 22.747, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.334', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON3': '0.850', 'ARMOR': '1.305', 'weapon2': '1.662', 'HITCOUNT': '1.730', 'weapon3': '1.784', 'DAMAGECOUNT': '6.783', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:07,471][52668] DAMAGECOUNT value on done: 28863.0 [2024-08-05 23:22:07,471][52668] Sum rewards: 27.622, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.556', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.650', 'ARMOR': '0.850', 'weapon2': '1.438', 'HITCOUNT': '1.790', 'weapon3': '1.850', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:07,642][52660] DAMAGECOUNT value on done: 30282.0 [2024-08-05 23:22:07,647][52660] Sum rewards: 24.203, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.611', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.054', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'WEAPON3': '0.600', 'weapon4': '0.810', 'ARMOR': '0.882', 'weapon2': '1.136', 'weapon3': '1.474', 'HITCOUNT': '1.980', 'DAMAGECOUNT': '6.435', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:07,700][52811] DAMAGECOUNT value on done: 29278.0 [2024-08-05 23:22:07,700][52811] Sum rewards: 20.391, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'weapon5': '0.044', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.229', 'weapon4': '0.288', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'ARMOR': '1.240', 'weapon2': '1.600', 'weapon3': '1.894', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '6.936', 'FRAGCOUNT': '16.000'} [2024-08-05 23:22:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 117907456. Throughput: 0: 4402.9. Samples: 29480190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:22:07,794][52567] Avg episode reward: [(0, '22.238')] [2024-08-05 23:22:10,238][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:22:10,316][52803] DAMAGECOUNT value on done: 27608.0 [2024-08-05 23:22:10,317][52803] Sum rewards: 18.242, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.304', 'AMMO2': '0.009', 'AMMO5': '0.015', 'weapon4': '0.038', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'AMMO3': '0.079', 'WEAPON5': '0.100', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.230', 'weapon3': '1.232', 'weapon2': '1.830', 'DAMAGECOUNT': '4.017', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:10,603][52668] DAMAGECOUNT value on done: 30251.0 [2024-08-05 23:22:10,605][52668] Sum rewards: 26.429, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.731', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'WEAPON3': '1.250', 'weapon2': '1.664', 'ARMOR': '1.769', 'HITCOUNT': '1.860', 'weapon3': '1.896', 'DAMAGECOUNT': '7.032', 'FRAGCOUNT': '23.000'} [2024-08-05 23:22:10,722][52660] DAMAGECOUNT value on done: 29462.0 [2024-08-05 23:22:10,723][52660] Sum rewards: 22.025, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.374', 'WEAPON3': '0.900', 'ARMOR': '0.906', 'weapon2': '0.938', 'weapon3': '1.840', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '7.278', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:10,809][52811] DAMAGECOUNT value on done: 27702.0 [2024-08-05 23:22:10,809][52811] Sum rewards: 15.469, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.094', 'AMMO2': '0.021', 'AMMO3': '0.100', 'AMMO4': '0.104', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON3': '0.600', 'ARMOR': '0.863', 'HITCOUNT': '1.400', 'weapon3': '1.584', 'weapon2': '2.008', 'DAMAGECOUNT': '5.007', 'FRAGCOUNT': '11.000'} [2024-08-05 23:22:11,565][52650] Updated weights for policy 0, policy_version 14401 (0.0014) [2024-08-05 23:22:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17885.8, 300 sec: 17578.1). Total num frames: 117997568. Throughput: 0: 4396.4. Samples: 29506390. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:22:12,795][52567] Avg episode reward: [(0, '22.085')] [2024-08-05 23:22:12,973][52668] DAMAGECOUNT value on done: 29049.0 [2024-08-05 23:22:12,973][52668] Sum rewards: 21.174, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.121', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.314', 'HITCOUNT': '1.770', 'weapon3': '1.852', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:13,173][52660] DAMAGECOUNT value on done: 29564.0 [2024-08-05 23:22:13,174][52660] Sum rewards: 18.622, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.194', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.070', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.354', 'ARMOR': '0.420', 'WEAPON3': '0.450', 'HITCOUNT': '1.270', 'weapon2': '1.446', 'weapon3': '1.528', 'DAMAGECOUNT': '5.154', 'FRAGCOUNT': '13.000'} [2024-08-05 23:22:13,524][52803] DAMAGECOUNT value on done: 31142.0 [2024-08-05 23:22:13,526][52803] Sum rewards: 22.848, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.120', 'AMMO4': '0.122', 'weapon4': '0.324', 'WEAPON3': '0.550', 'ARMOR': '0.856', 'weapon2': '1.594', 'weapon3': '1.840', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.945', 'FRAGCOUNT': '16.500'} [2024-08-05 23:22:14,020][52811] DAMAGECOUNT value on done: 30918.0 [2024-08-05 23:22:14,020][52811] Sum rewards: 22.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.442', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.034', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'ARMOR': '1.246', 'WEAPON3': '1.300', 'weapon2': '1.462', 'HITCOUNT': '1.620', 'weapon3': '2.304', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '22.000'} [2024-08-05 23:22:15,479][52664] DAMAGECOUNT value on done: 30678.0 [2024-08-05 23:22:15,479][52664] Sum rewards: 30.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.927', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.416', 'ARMOR': '0.479', 'weapon2': '0.812', 'WEAPON3': '1.050', 'HITCOUNT': '2.010', 'weapon3': '2.548', 'DAMAGECOUNT': '8.532', 'FRAGCOUNT': '26.000'} [2024-08-05 23:22:15,973][52668] DAMAGECOUNT value on done: 29260.0 [2024-08-05 23:22:15,973][52668] Sum rewards: 15.904, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-2.026', 'AMMO4': '-0.051', 'AMMO2': '-0.010', 'AMMO5': '0.015', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.904', 'HITCOUNT': '1.260', 'weapon3': '1.486', 'weapon2': '1.548', 'DAMAGECOUNT': '4.614', 'FRAGCOUNT': '12.000'} [2024-08-05 23:22:16,075][52660] DAMAGECOUNT value on done: 31963.0 [2024-08-05 23:22:16,076][52660] Sum rewards: 20.036, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.279', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'ARMOR': '0.488', 'weapon4': '0.512', 'WEAPON3': '0.800', 'weapon2': '1.050', 'HITCOUNT': '1.510', 'weapon3': '1.694', 'DAMAGECOUNT': '5.436', 'FRAGCOUNT': '16.000'} [2024-08-05 23:22:16,351][52650] Updated weights for policy 0, policy_version 14411 (0.0013) [2024-08-05 23:22:16,635][52803] DAMAGECOUNT value on done: 26667.0 [2024-08-05 23:22:16,638][52803] Sum rewards: 24.393, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.758', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.024', 'weapon4': '0.032', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.220', 'HITCOUNT': '1.650', 'weapon3': '2.236', 'DAMAGECOUNT': '6.024', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:17,035][52811] DAMAGECOUNT value on done: 28338.0 [2024-08-05 23:22:17,037][52811] Sum rewards: 19.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'ARMOR': '0.008', 'AMMO5': '0.013', 'weapon5': '0.026', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.160', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.240', 'HITCOUNT': '1.580', 'weapon3': '1.964', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 118079488. Throughput: 0: 4396.2. Samples: 29519460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:22:17,794][52567] Avg episode reward: [(0, '22.138')] [2024-08-05 23:22:18,385][52664] DAMAGECOUNT value on done: 29383.0 [2024-08-05 23:22:18,387][52664] Sum rewards: 19.538, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.268', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.035', 'weapon5': '0.102', 'AMMO3': '0.119', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON3': '0.900', 'ARMOR': '0.902', 'weapon2': '1.124', 'HITCOUNT': '1.720', 'weapon3': '1.826', 'DAMAGECOUNT': '6.462', 'FRAGCOUNT': '16.500'} [2024-08-05 23:22:19,180][52668] DAMAGECOUNT value on done: 30251.0 [2024-08-05 23:22:19,181][52668] Sum rewards: 20.439, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.634', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'ARMOR': '1.299', 'HITCOUNT': '1.490', 'weapon2': '1.668', 'weapon3': '1.992', 'DAMAGECOUNT': '5.424', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:19,250][52660] DAMAGECOUNT value on done: 30567.0 [2024-08-05 23:22:19,251][52660] Sum rewards: 18.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.107', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.356', 'ARMOR': '0.865', 'WEAPON3': '1.200', 'weapon2': '1.234', 'HITCOUNT': '1.660', 'weapon3': '1.934', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:19,739][52803] DAMAGECOUNT value on done: 32249.0 [2024-08-05 23:22:19,740][52803] Sum rewards: 27.273, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.292', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'weapon4': '0.356', 'ARMOR': '0.416', 'WEAPON3': '0.700', 'weapon2': '1.192', 'HITCOUNT': '1.750', 'weapon3': '1.928', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:20,196][52811] DAMAGECOUNT value on done: 28654.0 [2024-08-05 23:22:20,197][52811] Sum rewards: 21.635, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.684', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.123', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON3': '0.800', 'weapon2': '1.168', 'HITCOUNT': '1.530', 'weapon3': '1.840', 'DAMAGECOUNT': '5.742', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:20,603][52650] Updated weights for policy 0, policy_version 14421 (0.0013) [2024-08-05 23:22:21,086][52669] DAMAGECOUNT value on done: 30945.0 [2024-08-05 23:22:21,088][52669] Sum rewards: 17.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.118', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon5': '0.098', 'AMMO3': '0.152', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'weapon4': '0.480', 'WEAPON3': '0.950', 'weapon2': '1.270', 'HITCOUNT': '1.520', 'weapon3': '1.654', 'DAMAGECOUNT': '5.724', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:21,564][52664] DAMAGECOUNT value on done: 32871.0 [2024-08-05 23:22:21,564][52664] Sum rewards: 21.987, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.593', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon4': '0.222', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'WEAPON3': '0.850', 'weapon2': '1.370', 'HITCOUNT': '1.770', 'weapon3': '2.012', 'DAMAGECOUNT': '6.573', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:22,488][52668] DAMAGECOUNT value on done: 31819.0 [2024-08-05 23:22:22,488][52668] Sum rewards: 16.477, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.276', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.080', 'weapon5': '0.100', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.527', 'WEAPON3': '0.600', 'weapon2': '1.416', 'HITCOUNT': '1.470', 'weapon3': '1.742', 'DAMAGECOUNT': '5.598', 'FRAGCOUNT': '10.500'} [2024-08-05 23:22:22,541][52660] DAMAGECOUNT value on done: 31686.0 [2024-08-05 23:22:22,541][52660] Sum rewards: 18.309, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.542', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.056', 'AMMO3': '0.125', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '1.620', 'weapon2': '1.626', 'weapon3': '1.666', 'DAMAGECOUNT': '5.832', 'FRAGCOUNT': '14.500'} [2024-08-05 23:22:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 118169600. Throughput: 0: 4394.0. Samples: 29545760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:22:22,794][52567] Avg episode reward: [(0, '21.992')] [2024-08-05 23:22:22,820][52803] DAMAGECOUNT value on done: 29057.0 [2024-08-05 23:22:22,822][52803] Sum rewards: 29.003, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.028', 'AMMO2': '0.027', 'ARMOR': '0.040', 'AMMO3': '0.109', 'AMMO4': '0.133', 'WEAPON4': '0.500', 'weapon4': '0.552', 'WEAPON3': '0.800', 'weapon2': '1.150', 'weapon3': '1.912', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '7.218', 'FRAGCOUNT': '23.000'} [2024-08-05 23:22:23,312][52811] DAMAGECOUNT value on done: 29404.0 [2024-08-05 23:22:23,313][52811] Sum rewards: 19.070, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.203', 'HEALTH': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.356', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '1.580', 'weapon2': '1.584', 'weapon3': '1.766', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:23,561][52669] DAMAGECOUNT value on done: 30841.0 [2024-08-05 23:22:23,565][52669] Sum rewards: 14.642, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.077', 'AMMO4': '0.112', 'WEAPON4': '0.300', 'weapon4': '0.340', 'ARMOR': '0.457', 'WEAPON3': '0.600', 'HITCOUNT': '1.360', 'weapon3': '1.498', 'weapon2': '1.754', 'DAMAGECOUNT': '4.635', 'FRAGCOUNT': '11.500'} [2024-08-05 23:22:24,639][52664] DAMAGECOUNT value on done: 31446.0 [2024-08-05 23:22:24,639][52664] Sum rewards: 27.021, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.470', 'AMMO5': '0.008', 'weapon5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.078', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'weapon4': '0.708', 'weapon2': '1.338', 'weapon3': '1.488', 'HITCOUNT': '1.600', 'DAMAGECOUNT': '6.183', 'FRAGCOUNT': '20.500'} [2024-08-05 23:22:25,505][52660] DAMAGECOUNT value on done: 30566.0 [2024-08-05 23:22:25,507][52660] Sum rewards: 21.443, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.106', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.326', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.184', 'HITCOUNT': '1.350', 'weapon3': '2.048', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '18.500'} [2024-08-05 23:22:25,594][52650] Updated weights for policy 0, policy_version 14431 (0.0020) [2024-08-05 23:22:25,895][52803] DAMAGECOUNT value on done: 29708.0 [2024-08-05 23:22:25,897][52803] Sum rewards: 23.412, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.400', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.131', 'WEAPON4': '0.300', 'weapon4': '0.366', 'ARMOR': '0.467', 'WEAPON3': '0.900', 'weapon2': '1.328', 'weapon3': '1.772', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '6.966', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:26,527][52811] DAMAGECOUNT value on done: 31299.0 [2024-08-05 23:22:26,527][52811] Sum rewards: 31.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.172', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon5': '0.016', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'ARMOR': '0.926', 'WEAPON3': '0.950', 'weapon2': '1.334', 'HITCOUNT': '2.010', 'weapon3': '2.264', 'DAMAGECOUNT': '7.695', 'FRAGCOUNT': '27.000'} [2024-08-05 23:22:26,805][52669] DAMAGECOUNT value on done: 30472.0 [2024-08-05 23:22:26,805][52669] Sum rewards: 18.245, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.096', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.110', 'WEAPON4': '0.150', 'ARMOR': '0.424', 'weapon4': '0.470', 'WEAPON3': '0.750', 'weapon2': '0.992', 'HITCOUNT': '1.300', 'weapon3': '1.670', 'DAMAGECOUNT': '4.410', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:27,274][52664] DAMAGECOUNT value on done: 29242.0 [2024-08-05 23:22:27,276][52664] Sum rewards: 13.846, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.299', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon5': '0.092', 'weapon4': '0.118', 'AMMO4': '0.167', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.902', 'HITCOUNT': '1.250', 'WEAPON3': '1.300', 'weapon2': '1.316', 'weapon3': '2.126', 'DAMAGECOUNT': '5.292', 'FRAGCOUNT': '16.000'} [2024-08-05 23:22:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 118251520. Throughput: 0: 4389.8. Samples: 29572000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:22:27,802][52567] Avg episode reward: [(0, '21.859')] [2024-08-05 23:22:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014435_118251520.pth... [2024-08-05 23:22:27,936][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000013921_114040832.pth [2024-08-05 23:22:28,549][52660] DAMAGECOUNT value on done: 30830.0 [2024-08-05 23:22:28,551][52660] Sum rewards: 17.598, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.870', 'AMMO5': '0.009', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.200', 'weapon4': '0.306', 'ARMOR': '0.404', 'WEAPON3': '0.750', 'weapon2': '1.258', 'HITCOUNT': '1.330', 'weapon3': '1.768', 'DAMAGECOUNT': '4.875', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:28,979][52803] DAMAGECOUNT value on done: 27317.0 [2024-08-05 23:22:28,980][52803] Sum rewards: 25.466, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.084', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON3': '0.600', 'HEALTH': '0.877', 'ARMOR': '0.901', 'weapon2': '1.308', 'HITCOUNT': '1.590', 'weapon3': '1.894', 'DAMAGECOUNT': '6.321', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:29,725][52669] DAMAGECOUNT value on done: 31308.0 [2024-08-05 23:22:29,726][52669] Sum rewards: 27.890, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.667', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO4': '0.062', 'weapon5': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'ARMOR': '1.281', 'weapon2': '1.378', 'HITCOUNT': '1.610', 'weapon3': '1.834', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '22.000'} [2024-08-05 23:22:29,805][52811] DAMAGECOUNT value on done: 27276.0 [2024-08-05 23:22:29,805][52811] Sum rewards: 21.227, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.906', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.066', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.610', 'weapon2': '1.892', 'weapon3': '1.920', 'DAMAGECOUNT': '6.027', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:29,877][52664] DAMAGECOUNT value on done: 33503.0 [2024-08-05 23:22:29,877][52664] Sum rewards: 25.092, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.404', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO3': '0.078', 'AMMO4': '0.086', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.256', 'ARMOR': '0.476', 'WEAPON3': '0.500', 'weapon3': '1.276', 'HITCOUNT': '1.500', 'weapon2': '1.778', 'DAMAGECOUNT': '5.928', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:30,458][52650] Updated weights for policy 0, policy_version 14441 (0.0033) [2024-08-05 23:22:31,752][52660] DAMAGECOUNT value on done: 29471.0 [2024-08-05 23:22:31,754][52660] Sum rewards: 22.764, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.119', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon4': '0.640', 'WEAPON3': '0.800', 'weapon2': '0.918', 'weapon3': '1.870', 'HITCOUNT': '1.890', 'DAMAGECOUNT': '6.999', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:32,104][52669] DAMAGECOUNT value on done: 31734.0 [2024-08-05 23:22:32,104][52669] Sum rewards: 22.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.837', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.318', 'ARMOR': '0.496', 'weapon2': '0.954', 'WEAPON3': '1.050', 'HITCOUNT': '1.830', 'weapon3': '2.434', 'DAMAGECOUNT': '6.597', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:32,142][52803] DAMAGECOUNT value on done: 30726.0 [2024-08-05 23:22:32,142][52803] Sum rewards: 36.274, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.165', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.094', 'WEAPON4': '0.300', 'weapon4': '0.556', 'WEAPON3': '0.700', 'weapon2': '1.246', 'ARMOR': '1.251', 'weapon3': '2.004', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '8.958', 'FRAGCOUNT': '29.000'} [2024-08-05 23:22:32,453][52664] DAMAGECOUNT value on done: 31955.0 [2024-08-05 23:22:32,453][52664] Sum rewards: 23.538, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO3': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.594', 'WEAPON3': '0.600', 'weapon2': '1.326', 'HITCOUNT': '1.570', 'weapon3': '1.636', 'DAMAGECOUNT': '5.679', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 118341632. Throughput: 0: 4386.0. Samples: 29584930. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 23:22:32,794][52567] Avg episode reward: [(0, '21.950')] [2024-08-05 23:22:33,009][52811] DAMAGECOUNT value on done: 29898.0 [2024-08-05 23:22:33,011][52811] Sum rewards: 20.423, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.729', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.069', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.504', 'ARMOR': '0.800', 'weapon3': '1.164', 'HITCOUNT': '1.440', 'weapon2': '1.690', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:34,141][52665] DAMAGECOUNT value on done: 28466.0 [2024-08-05 23:22:34,142][52665] Sum rewards: 25.779, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.410', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.118', 'weapon4': '0.308', 'ARMOR': '0.453', 'WEAPON3': '0.850', 'weapon2': '1.134', 'HITCOUNT': '1.820', 'weapon3': '2.072', 'DAMAGECOUNT': '6.642', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:34,803][52650] Updated weights for policy 0, policy_version 14451 (0.0015) [2024-08-05 23:22:34,891][52669] DAMAGECOUNT value on done: 33325.0 [2024-08-05 23:22:34,891][52669] Sum rewards: 23.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.814', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'WEAPON3': '1.250', 'weapon2': '1.544', 'ARMOR': '1.777', 'HITCOUNT': '1.910', 'weapon3': '2.152', 'DAMAGECOUNT': '6.936', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:35,176][52803] DAMAGECOUNT value on done: 28327.0 [2024-08-05 23:22:35,177][52803] Sum rewards: 26.827, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.040', 'AMMO3': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '0.450', 'ARMOR': '0.482', 'weapon2': '0.746', 'weapon4': '0.840', 'weapon3': '1.288', 'HITCOUNT': '1.710', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:35,195][52664] DAMAGECOUNT value on done: 28293.0 [2024-08-05 23:22:35,195][52664] Sum rewards: 18.355, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.966', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.097', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'ARMOR': '0.937', 'HITCOUNT': '1.260', 'weapon3': '1.376', 'weapon2': '1.830', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:36,088][52811] DAMAGECOUNT value on done: 28008.0 [2024-08-05 23:22:36,090][52811] Sum rewards: 16.321, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.070', 'AMMO2': '0.030', 'AMMO3': '0.099', 'weapon4': '0.136', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'HITCOUNT': '1.380', 'weapon3': '1.650', 'weapon2': '1.894', 'DAMAGECOUNT': '4.953', 'FRAGCOUNT': '12.000'} [2024-08-05 23:22:37,066][52665] DAMAGECOUNT value on done: 30115.0 [2024-08-05 23:22:37,067][52665] Sum rewards: 23.098, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.556', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.262', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.410', 'weapon2': '1.478', 'weapon3': '1.924', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 118431744. Throughput: 0: 4384.9. Samples: 29611300. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 23:22:37,794][52567] Avg episode reward: [(0, '21.954')] [2024-08-05 23:22:38,065][52664] DAMAGECOUNT value on done: 35047.0 [2024-08-05 23:22:38,067][52664] Sum rewards: 27.150, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.056', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.082', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.412', 'weapon4': '0.514', 'WEAPON3': '0.600', 'weapon2': '0.878', 'weapon3': '1.406', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.648', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:38,141][52669] DAMAGECOUNT value on done: 32027.0 [2024-08-05 23:22:38,144][52669] Sum rewards: 27.448, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.337', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.125', 'AMMO4': '0.156', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.760', 'weapon4': '0.814', 'WEAPON3': '0.850', 'ARMOR': '0.912', 'HITCOUNT': '1.490', 'weapon3': '1.890', 'DAMAGECOUNT': '5.637', 'FRAGCOUNT': '22.000'} [2024-08-05 23:22:38,353][52803] DAMAGECOUNT value on done: 27419.0 [2024-08-05 23:22:38,354][52803] Sum rewards: 28.158, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.458', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.106', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.576', 'HITCOUNT': '1.790', 'weapon3': '2.152', 'DAMAGECOUNT': '6.951', 'FRAGCOUNT': '23.000'} [2024-08-05 23:22:38,826][52667] DAMAGECOUNT value on done: 30593.0 [2024-08-05 23:22:38,826][52667] Sum rewards: 27.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'weapon5': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.080', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.440', 'weapon2': '1.038', 'WEAPON3': '1.300', 'HITCOUNT': '1.930', 'weapon3': '2.354', 'DAMAGECOUNT': '6.894', 'FRAGCOUNT': '26.000'} [2024-08-05 23:22:39,358][52811] DAMAGECOUNT value on done: 31009.0 [2024-08-05 23:22:39,366][52811] Sum rewards: 18.782, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.190', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.324', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon2': '1.378', 'HITCOUNT': '1.520', 'weapon3': '1.766', 'DAMAGECOUNT': '4.872', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:39,725][52650] Updated weights for policy 0, policy_version 14461 (0.0025) [2024-08-05 23:22:39,880][52665] DAMAGECOUNT value on done: 31473.0 [2024-08-05 23:22:39,880][52665] Sum rewards: 24.402, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.598', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.092', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.912', 'weapon2': '1.352', 'HITCOUNT': '1.590', 'weapon3': '1.634', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:40,774][52664] DAMAGECOUNT value on done: 31367.0 [2024-08-05 23:22:40,774][52664] Sum rewards: 19.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.806', 'AMMO5': '0.012', 'weapon5': '0.052', 'AMMO2': '0.052', 'weapon4': '0.104', 'AMMO3': '0.122', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'WEAPON4': '0.450', 'WEAPON3': '0.700', 'ARMOR': '0.914', 'HITCOUNT': '1.630', 'weapon2': '1.808', 'weapon3': '1.820', 'DAMAGECOUNT': '6.807', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:41,181][52669] DAMAGECOUNT value on done: 30594.0 [2024-08-05 23:22:41,182][52669] Sum rewards: 29.750, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.475', 'AMMO5': '0.015', 'AMMO2': '0.016', 'ARMOR': '0.048', 'AMMO4': '0.077', 'AMMO3': '0.142', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.490', 'weapon2': '0.846', 'WEAPON3': '1.150', 'HITCOUNT': '2.380', 'weapon3': '2.408', 'DAMAGECOUNT': '8.703', 'FRAGCOUNT': '26.000'} [2024-08-05 23:22:41,331][52667] DAMAGECOUNT value on done: 32173.0 [2024-08-05 23:22:41,331][52667] Sum rewards: 17.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.152', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.146', 'WEAPON3': '0.850', 'ARMOR': '0.853', 'weapon2': '1.354', 'HITCOUNT': '1.520', 'weapon3': '1.864', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:41,343][52803] DAMAGECOUNT value on done: 28845.0 [2024-08-05 23:22:41,344][52803] Sum rewards: 17.086, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.982', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.189', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'weapon4': '0.726', 'WEAPON3': '0.850', 'weapon2': '1.202', 'HITCOUNT': '1.380', 'weapon3': '1.582', 'DAMAGECOUNT': '5.193', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:42,596][52811] DAMAGECOUNT value on done: 28228.0 [2024-08-05 23:22:42,598][52811] Sum rewards: 22.465, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.167', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.452', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'weapon2': '1.190', 'HITCOUNT': '1.580', 'weapon3': '1.812', 'DAMAGECOUNT': '5.976', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 118513664. Throughput: 0: 4383.6. Samples: 29637540. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:22:42,794][52567] Avg episode reward: [(0, '22.160')] [2024-08-05 23:22:42,818][52795] DAMAGECOUNT value on done: 27917.0 [2024-08-05 23:22:42,822][52795] Sum rewards: 21.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.578', 'AMMO2': '0.031', 'weapon4': '0.110', 'AMMO3': '0.138', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.885', 'weapon2': '1.384', 'HITCOUNT': '1.630', 'weapon3': '2.044', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:42,912][52665] DAMAGECOUNT value on done: 31104.0 [2024-08-05 23:22:42,913][52665] Sum rewards: 20.429, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.152', 'weapon4': '0.170', 'WEAPON4': '0.300', 'ARMOR': '0.483', 'WEAPON3': '1.000', 'weapon2': '1.536', 'HITCOUNT': '1.630', 'weapon3': '1.784', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:43,765][52664] DAMAGECOUNT value on done: 33913.0 [2024-08-05 23:22:43,766][52664] Sum rewards: 13.031, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.424', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'weapon5': '0.064', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.404', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.170', 'HITCOUNT': '1.280', 'weapon3': '1.780', 'DAMAGECOUNT': '4.353', 'FRAGCOUNT': '12.000'} [2024-08-05 23:22:43,897][52667] DAMAGECOUNT value on done: 30422.0 [2024-08-05 23:22:43,897][52667] Sum rewards: 25.399, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.039', 'HEALTH': '0.120', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'weapon4': '0.222', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'ARMOR': '0.869', 'weapon2': '1.336', 'HITCOUNT': '1.910', 'weapon3': '2.052', 'DAMAGECOUNT': '6.690', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:44,078][52650] Updated weights for policy 0, policy_version 14471 (0.0024) [2024-08-05 23:22:44,298][52669] DAMAGECOUNT value on done: 30109.0 [2024-08-05 23:22:44,299][52669] Sum rewards: 18.951, reward structure: {'DEATHCOUNT': '-4.500', 'AMMO5': '0.003', 'AMMO2': '0.034', 'HEALTH': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.068', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON3': '0.400', 'ARMOR': '0.487', 'weapon3': '1.228', 'HITCOUNT': '1.240', 'weapon2': '1.444', 'DAMAGECOUNT': '4.683', 'FRAGCOUNT': '13.000'} [2024-08-05 23:22:44,340][52803] DAMAGECOUNT value on done: 29272.0 [2024-08-05 23:22:44,340][52803] Sum rewards: 25.676, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.097', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.123', 'weapon4': '0.198', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.566', 'HITCOUNT': '1.710', 'weapon3': '2.064', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:45,631][52811] DAMAGECOUNT value on done: 29393.0 [2024-08-05 23:22:45,633][52811] Sum rewards: 21.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'ARMOR': '0.432', 'weapon2': '1.240', 'WEAPON3': '1.350', 'HITCOUNT': '2.000', 'weapon3': '2.398', 'DAMAGECOUNT': '7.173', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:45,901][52665] DAMAGECOUNT value on done: 29394.0 [2024-08-05 23:22:45,904][52665] Sum rewards: 19.308, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.899', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.117', 'weapon4': '0.326', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'WEAPON3': '0.900', 'weapon2': '1.464', 'HITCOUNT': '1.480', 'weapon3': '1.854', 'DAMAGECOUNT': '6.033', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:46,062][52795] DAMAGECOUNT value on done: 26476.0 [2024-08-05 23:22:46,065][52795] Sum rewards: 17.735, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.845', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.108', 'weapon5': '0.148', 'AMMO4': '0.174', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.519', 'WEAPON3': '0.750', 'weapon2': '1.474', 'HITCOUNT': '1.490', 'weapon3': '1.602', 'DAMAGECOUNT': '5.385', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:46,451][52664] DAMAGECOUNT value on done: 30292.0 [2024-08-05 23:22:46,452][52664] Sum rewards: 18.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.472', 'AMMO2': '0.012', 'weapon4': '0.040', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'WEAPON3': '0.750', 'ARMOR': '0.824', 'HITCOUNT': '1.210', 'weapon2': '1.652', 'weapon3': '1.812', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '16.000'} [2024-08-05 23:22:46,657][52667] DAMAGECOUNT value on done: 30762.0 [2024-08-05 23:22:46,660][52667] Sum rewards: 20.340, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.532', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.154', 'weapon4': '0.162', 'WEAPON4': '0.350', 'ARMOR': '0.883', 'WEAPON3': '0.950', 'weapon2': '1.238', 'HITCOUNT': '1.480', 'weapon3': '1.636', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:47,036][52669] DAMAGECOUNT value on done: 29863.0 [2024-08-05 23:22:47,037][52669] Sum rewards: 21.449, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.118', 'AMMO4': '0.135', 'AMMO3': '0.141', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'ARMOR': '1.380', 'weapon2': '1.396', 'HITCOUNT': '1.670', 'weapon3': '2.216', 'DAMAGECOUNT': '5.733', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:47,439][52803] DAMAGECOUNT value on done: 27272.0 [2024-08-05 23:22:47,440][52803] Sum rewards: 22.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO3': '0.139', 'WEAPON3': '1.000', 'ARMOR': '1.308', 'weapon2': '1.432', 'HITCOUNT': '1.860', 'weapon3': '2.422', 'DAMAGECOUNT': '7.650', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 118603776. Throughput: 0: 4373.6. Samples: 29650490. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:22:47,794][52567] Avg episode reward: [(0, '21.716')] [2024-08-05 23:22:48,674][52811] DAMAGECOUNT value on done: 28655.0 [2024-08-05 23:22:48,676][52811] Sum rewards: 15.669, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.044', 'ARMOR': '0.056', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.222', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon4': '0.826', 'weapon2': '1.152', 'weapon3': '1.486', 'HITCOUNT': '1.570', 'DAMAGECOUNT': '5.538', 'FRAGCOUNT': '12.500'} [2024-08-05 23:22:48,881][52650] Updated weights for policy 0, policy_version 14481 (0.0022) [2024-08-05 23:22:48,981][52665] DAMAGECOUNT value on done: 28667.0 [2024-08-05 23:22:48,982][52665] Sum rewards: 22.926, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.132', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.122', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.258', 'ARMOR': '0.465', 'WEAPON3': '0.800', 'weapon2': '1.350', 'HITCOUNT': '1.610', 'weapon3': '1.918', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:49,152][52664] DAMAGECOUNT value on done: 31707.0 [2024-08-05 23:22:49,153][52664] Sum rewards: 20.748, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.905', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.007', 'weapon5': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon4': '0.258', 'ARMOR': '0.455', 'weapon2': '0.900', 'WEAPON3': '1.250', 'HITCOUNT': '1.770', 'weapon3': '2.416', 'DAMAGECOUNT': '6.861', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:49,181][52795] DAMAGECOUNT value on done: 27282.0 [2024-08-05 23:22:49,183][52795] Sum rewards: 22.696, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.911', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'ARMOR': '0.451', 'WEAPON3': '0.800', 'HITCOUNT': '1.580', 'weapon3': '1.680', 'weapon2': '1.718', 'DAMAGECOUNT': '5.844', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:49,831][52667] DAMAGECOUNT value on done: 30975.0 [2024-08-05 23:22:49,832][52667] Sum rewards: 28.665, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.870', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.108', 'WEAPON3': '0.750', 'ARMOR': '0.845', 'weapon3': '1.704', 'HITCOUNT': '1.770', 'weapon2': '1.850', 'DAMAGECOUNT': '6.516', 'FRAGCOUNT': '22.000'} [2024-08-05 23:22:49,852][52669] DAMAGECOUNT value on done: 31575.0 [2024-08-05 23:22:49,853][52669] Sum rewards: 23.240, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.101', 'WEAPON4': '0.150', 'weapon4': '0.364', 'WEAPON3': '0.650', 'ARMOR': '0.884', 'weapon2': '1.672', 'HITCOUNT': '1.680', 'weapon3': '1.684', 'DAMAGECOUNT': '6.477', 'FRAGCOUNT': '17.000'} [2024-08-05 23:22:50,533][52803] DAMAGECOUNT value on done: 28506.0 [2024-08-05 23:22:50,534][52803] Sum rewards: 31.608, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.522', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.650', 'ARMOR': '0.894', 'weapon3': '1.660', 'weapon2': '1.826', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '7.551', 'FRAGCOUNT': '24.000'} [2024-08-05 23:22:51,681][52811] DAMAGECOUNT value on done: 29415.0 [2024-08-05 23:22:51,682][52811] Sum rewards: 18.942, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.648', 'weapon5': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.037', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'weapon4': '0.212', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.936', 'HITCOUNT': '1.680', 'weapon2': '1.686', 'weapon3': '1.788', 'DAMAGECOUNT': '6.276', 'FRAGCOUNT': '16.000'} [2024-08-05 23:22:51,740][52664] DAMAGECOUNT value on done: 30675.0 [2024-08-05 23:22:51,741][52664] Sum rewards: 24.891, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.992', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.326', 'ARMOR': '0.900', 'WEAPON3': '1.000', 'weapon2': '1.332', 'HITCOUNT': '1.810', 'weapon3': '2.108', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:51,978][52665] DAMAGECOUNT value on done: 31383.0 [2024-08-05 23:22:51,978][52665] Sum rewards: 24.830, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.647', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.034', 'AMMO4': '0.044', 'weapon4': '0.048', 'AMMO3': '0.070', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.404', 'WEAPON3': '0.500', 'HITCOUNT': '1.470', 'weapon3': '1.478', 'weapon2': '1.988', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:52,385][52795] DAMAGECOUNT value on done: 28737.0 [2024-08-05 23:22:52,389][52795] Sum rewards: 23.517, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.984', 'AMMO2': '0.009', 'AMMO5': '0.014', 'weapon5': '0.042', 'AMMO4': '0.043', 'weapon4': '0.072', 'AMMO3': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.750', 'ARMOR': '0.922', 'weapon2': '1.676', 'HITCOUNT': '1.700', 'weapon3': '1.932', 'DAMAGECOUNT': '6.384', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:52,395][52669] DAMAGECOUNT value on done: 33870.0 [2024-08-05 23:22:52,398][52669] Sum rewards: 20.588, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.918', 'AMMO2': '0.003', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO4': '0.015', 'weapon5': '0.082', 'AMMO3': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.242', 'WEAPON3': '0.850', 'weapon2': '1.136', 'HITCOUNT': '1.460', 'weapon3': '1.956', 'DAMAGECOUNT': '5.829', 'FRAGCOUNT': '18.000'} [2024-08-05 23:22:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 118693888. Throughput: 0: 4368.7. Samples: 29676780. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:22:52,794][52567] Avg episode reward: [(0, '21.856')] [2024-08-05 23:22:52,846][52667] DAMAGECOUNT value on done: 32826.0 [2024-08-05 23:22:52,847][52667] Sum rewards: 15.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.198', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'weapon4': '0.376', 'ARMOR': '0.424', 'WEAPON3': '1.000', 'weapon2': '1.304', 'HITCOUNT': '1.410', 'weapon3': '1.900', 'DAMAGECOUNT': '5.028', 'FRAGCOUNT': '15.000'} [2024-08-05 23:22:53,470][52666] DAMAGECOUNT value on done: 28580.0 [2024-08-05 23:22:53,471][52666] Sum rewards: 21.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.024', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.102', 'AMMO4': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.908', 'WEAPON3': '1.150', 'weapon2': '1.254', 'HITCOUNT': '1.540', 'weapon3': '2.196', 'DAMAGECOUNT': '5.814', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:53,627][52803] DAMAGECOUNT value on done: 29179.0 [2024-08-05 23:22:53,629][52803] Sum rewards: 18.572, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.784', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.071', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '1.436', 'HITCOUNT': '1.470', 'weapon3': '1.874', 'DAMAGECOUNT': '5.541', 'FRAGCOUNT': '16.000'} [2024-08-05 23:22:53,815][52650] Updated weights for policy 0, policy_version 14491 (0.0022) [2024-08-05 23:22:54,387][52664] DAMAGECOUNT value on done: 33227.0 [2024-08-05 23:22:54,387][52664] Sum rewards: 37.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.182', 'ARMOR': '0.470', 'weapon4': '0.486', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.496', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.654', 'FRAGCOUNT': '31.000'} [2024-08-05 23:22:54,794][52811] DAMAGECOUNT value on done: 27959.0 [2024-08-05 23:22:54,796][52811] Sum rewards: 25.083, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.318', 'ARMOR': '0.464', 'WEAPON3': '0.700', 'HITCOUNT': '1.560', 'weapon3': '1.600', 'weapon2': '1.618', 'DAMAGECOUNT': '5.970', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:55,118][52665] DAMAGECOUNT value on done: 31205.0 [2024-08-05 23:22:55,118][52665] Sum rewards: 15.347, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.088', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '1.330', 'ARMOR': '1.653', 'weapon2': '1.712', 'weapon3': '1.928', 'DAMAGECOUNT': '4.827', 'FRAGCOUNT': '12.000'} [2024-08-05 23:22:55,489][52669] DAMAGECOUNT value on done: 29821.0 [2024-08-05 23:22:55,493][52669] Sum rewards: 31.260, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.888', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.330', 'WEAPON3': '0.700', 'ARMOR': '1.336', 'weapon2': '1.478', 'weapon3': '1.790', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.849', 'FRAGCOUNT': '24.000'} [2024-08-05 23:22:55,525][52667] DAMAGECOUNT value on done: 31570.0 [2024-08-05 23:22:55,527][52667] Sum rewards: 17.103, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.020', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.268', 'ARMOR': '0.400', 'WEAPON3': '0.600', 'HITCOUNT': '1.120', 'weapon2': '1.566', 'weapon3': '1.728', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '12.000'} [2024-08-05 23:22:55,615][52795] DAMAGECOUNT value on done: 31275.0 [2024-08-05 23:22:55,616][52795] Sum rewards: 24.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.973', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.126', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'ARMOR': '0.454', 'WEAPON3': '1.000', 'weapon2': '1.158', 'HITCOUNT': '1.810', 'weapon3': '2.468', 'DAMAGECOUNT': '6.804', 'FRAGCOUNT': '22.000'} [2024-08-05 23:22:56,561][52666] DAMAGECOUNT value on done: 30606.0 [2024-08-05 23:22:56,564][52666] Sum rewards: 30.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.126', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.054', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'ARMOR': '0.857', 'WEAPON3': '1.000', 'weapon2': '1.676', 'weapon3': '1.974', 'HITCOUNT': '2.040', 'DAMAGECOUNT': '8.121', 'FRAGCOUNT': '25.000'} [2024-08-05 23:22:56,715][52803] DAMAGECOUNT value on done: 30258.0 [2024-08-05 23:22:56,723][52803] Sum rewards: 24.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.568', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.181', 'WEAPON3': '1.150', 'ARMOR': '1.257', 'weapon2': '1.582', 'HITCOUNT': '1.740', 'weapon3': '2.246', 'DAMAGECOUNT': '6.909', 'FRAGCOUNT': '22.000'} [2024-08-05 23:22:56,964][52664] DAMAGECOUNT value on done: 28258.0 [2024-08-05 23:22:56,964][52664] Sum rewards: 38.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.263', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'WEAPON3': '0.900', 'ARMOR': '0.924', 'weapon2': '1.462', 'weapon3': '2.070', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '8.952', 'FRAGCOUNT': '31.000'} [2024-08-05 23:22:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 118784000. Throughput: 0: 4370.0. Samples: 29703040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:22:57,795][52567] Avg episode reward: [(0, '22.464')] [2024-08-05 23:22:57,800][52614] Saving new best policy, reward=22.464! [2024-08-05 23:22:57,912][52811] DAMAGECOUNT value on done: 29727.0 [2024-08-05 23:22:57,912][52811] Sum rewards: 26.543, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'ARMOR': '0.491', 'WEAPON3': '1.100', 'weapon2': '1.686', 'HITCOUNT': '1.930', 'weapon3': '2.018', 'DAMAGECOUNT': '6.789', 'FRAGCOUNT': '23.000'} [2024-08-05 23:22:58,037][52650] Updated weights for policy 0, policy_version 14501 (0.0014) [2024-08-05 23:22:58,168][52665] DAMAGECOUNT value on done: 32343.0 [2024-08-05 23:22:58,168][52665] Sum rewards: 21.202, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.795', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.465', 'WEAPON3': '1.200', 'weapon2': '1.524', 'HITCOUNT': '1.910', 'weapon3': '2.096', 'DAMAGECOUNT': '7.305', 'FRAGCOUNT': '19.000'} [2024-08-05 23:22:58,211][52667] DAMAGECOUNT value on done: 30733.0 [2024-08-05 23:22:58,212][52667] Sum rewards: 25.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.170', 'AMMO2': '0.004', 'AMMO5': '0.015', 'AMMO4': '0.020', 'weapon5': '0.028', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON3': '0.900', 'ARMOR': '0.900', 'weapon2': '1.410', 'HITCOUNT': '1.640', 'weapon3': '2.138', 'DAMAGECOUNT': '6.768', 'FRAGCOUNT': '21.000'} [2024-08-05 23:22:58,553][52669] DAMAGECOUNT value on done: 31696.0 [2024-08-05 23:22:58,555][52669] Sum rewards: 27.144, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.631', 'AMMO5': '0.008', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'weapon4': '0.336', 'WEAPON3': '0.700', 'weapon2': '1.248', 'HITCOUNT': '1.700', 'weapon3': '2.068', 'DAMAGECOUNT': '6.591', 'FRAGCOUNT': '21.500'} [2024-08-05 23:22:58,798][52795] DAMAGECOUNT value on done: 29661.0 [2024-08-05 23:22:58,798][52795] Sum rewards: 18.762, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.545', 'AMMO5': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.075', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.230', 'ARMOR': '0.412', 'WEAPON3': '0.550', 'HITCOUNT': '1.110', 'weapon3': '1.408', 'weapon2': '1.418', 'DAMAGECOUNT': '4.212', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:59,194][52670] DAMAGECOUNT value on done: 31436.0 [2024-08-05 23:22:59,194][52670] Sum rewards: 25.278, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.561', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.138', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.448', 'ARMOR': '0.871', 'WEAPON3': '0.950', 'weapon2': '1.206', 'weapon3': '1.744', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '7.590', 'FRAGCOUNT': '20.000'} [2024-08-05 23:22:59,555][52666] DAMAGECOUNT value on done: 29819.0 [2024-08-05 23:22:59,557][52666] Sum rewards: 31.065, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.201', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.092', 'WEAPON3': '0.750', 'ARMOR': '1.309', 'weapon2': '1.774', 'HITCOUNT': '1.930', 'weapon3': '2.108', 'DAMAGECOUNT': '7.263', 'FRAGCOUNT': '23.000'} [2024-08-05 23:22:59,823][52664] DAMAGECOUNT value on done: 32656.0 [2024-08-05 23:22:59,826][52664] Sum rewards: 17.348, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.540', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.120', 'weapon5': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.722', 'weapon4': '0.818', 'ARMOR': '0.824', 'WEAPON3': '0.850', 'HITCOUNT': '1.410', 'weapon3': '1.572', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '14.000'} [2024-08-05 23:22:59,928][52803] DAMAGECOUNT value on done: 28062.0 [2024-08-05 23:22:59,932][52803] Sum rewards: 19.943, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.556', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'weapon5': '0.052', 'AMMO3': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.443', 'WEAPON3': '0.750', 'HITCOUNT': '1.420', 'weapon3': '1.670', 'weapon2': '1.716', 'DAMAGECOUNT': '5.157', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:01,022][52665] DAMAGECOUNT value on done: 31803.0 [2024-08-05 23:23:01,023][52665] Sum rewards: 22.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.652', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.032', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.314', 'ARMOR': '0.400', 'weapon2': '1.110', 'WEAPON3': '1.250', 'HITCOUNT': '1.850', 'weapon3': '2.316', 'DAMAGECOUNT': '6.870', 'FRAGCOUNT': '22.000'} [2024-08-05 23:23:01,049][52811] DAMAGECOUNT value on done: 31615.0 [2024-08-05 23:23:01,051][52667] DAMAGECOUNT value on done: 32550.0 [2024-08-05 23:23:01,051][52667] Sum rewards: 23.420, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.195', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.012', 'weapon5': '0.014', 'AMMO4': '0.031', 'AMMO3': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'WEAPON3': '0.600', 'ARMOR': '0.800', 'HITCOUNT': '1.560', 'weapon2': '1.700', 'weapon3': '1.904', 'DAMAGECOUNT': '6.390', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:01,051][52811] Sum rewards: 16.371, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.360', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'HITCOUNT': '1.340', 'weapon2': '1.388', 'weapon3': '1.986', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '13.000'} [2024-08-05 23:23:01,393][52669] DAMAGECOUNT value on done: 31706.0 [2024-08-05 23:23:01,394][52669] Sum rewards: 31.901, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.707', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.145', 'weapon4': '0.346', 'WEAPON4': '0.350', 'ARMOR': '0.966', 'WEAPON3': '1.000', 'weapon2': '1.282', 'HITCOUNT': '1.920', 'weapon3': '2.050', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '26.000'} [2024-08-05 23:23:01,635][52663] DAMAGECOUNT value on done: 31783.0 [2024-08-05 23:23:01,639][52663] Sum rewards: 28.244, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.432', 'WEAPON3': '0.800', 'ARMOR': '1.304', 'weapon2': '1.456', 'weapon3': '1.600', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.350', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:01,816][52795] DAMAGECOUNT value on done: 31871.0 [2024-08-05 23:23:01,816][52795] Sum rewards: 12.199, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.682', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.058', 'AMMO3': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.230', 'WEAPON4': '0.250', 'ARMOR': '0.515', 'WEAPON3': '0.550', 'HITCOUNT': '1.180', 'weapon2': '1.218', 'weapon3': '1.444', 'DAMAGECOUNT': '4.002', 'FRAGCOUNT': '9.000'} [2024-08-05 23:23:02,042][52670] DAMAGECOUNT value on done: 31367.0 [2024-08-05 23:23:02,045][52670] Sum rewards: 21.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.040', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.514', 'weapon2': '0.534', 'WEAPON3': '0.850', 'HITCOUNT': '1.810', 'weapon3': '2.426', 'DAMAGECOUNT': '6.609', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:02,323][52664] DAMAGECOUNT value on done: 31451.0 [2024-08-05 23:23:02,323][52664] Sum rewards: 21.906, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.878', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.052', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'HITCOUNT': '1.350', 'weapon2': '1.542', 'weapon3': '1.924', 'DAMAGECOUNT': '5.967', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:02,373][52666] DAMAGECOUNT value on done: 29366.0 [2024-08-05 23:23:02,374][52666] Sum rewards: 22.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.027', 'ARMOR': '0.040', 'AMMO4': '0.137', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.474', 'WEAPON3': '0.900', 'weapon2': '1.048', 'HITCOUNT': '1.490', 'weapon3': '1.958', 'DAMAGECOUNT': '6.168', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 118865920. Throughput: 0: 4361.6. Samples: 29715730. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:23:02,794][52567] Avg episode reward: [(0, '22.727')] [2024-08-05 23:23:02,795][52614] Saving new best policy, reward=22.727! [2024-08-05 23:23:03,274][52650] Updated weights for policy 0, policy_version 14511 (0.0011) [2024-08-05 23:23:03,771][52665] DAMAGECOUNT value on done: 32073.0 [2024-08-05 23:23:03,771][52665] Sum rewards: 33.666, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.690', 'AMMO5': '0.007', 'AMMO2': '0.031', 'ARMOR': '0.075', 'AMMO3': '0.111', 'weapon5': '0.116', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.486', 'weapon2': '0.744', 'WEAPON3': '0.750', 'HITCOUNT': '1.830', 'weapon3': '2.070', 'DAMAGECOUNT': '7.182', 'FRAGCOUNT': '27.000'} [2024-08-05 23:23:04,050][52667] DAMAGECOUNT value on done: 31435.0 [2024-08-05 23:23:04,051][52667] Sum rewards: 18.238, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.014', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON3': '1.000', 'HITCOUNT': '1.320', 'ARMOR': '1.656', 'weapon2': '1.662', 'weapon3': '2.114', 'DAMAGECOUNT': '5.109', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:04,285][52811] DAMAGECOUNT value on done: 27646.0 [2024-08-05 23:23:04,287][52811] Sum rewards: 24.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.650', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.286', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'weapon2': '1.428', 'HITCOUNT': '1.660', 'weapon3': '1.892', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:04,621][52669] DAMAGECOUNT value on done: 32585.0 [2024-08-05 23:23:04,622][52669] Sum rewards: 28.637, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.096', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.344', 'weapon3': '1.978', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '7.626', 'FRAGCOUNT': '25.000'} [2024-08-05 23:23:04,818][52658] DAMAGECOUNT value on done: 31686.0 [2024-08-05 23:23:04,821][52658] Sum rewards: 34.444, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.702', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.134', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.246', 'ARMOR': '0.404', 'WEAPON3': '0.900', 'weapon2': '1.082', 'HITCOUNT': '2.330', 'weapon3': '2.400', 'DAMAGECOUNT': '8.313', 'FRAGCOUNT': '27.000'} [2024-08-05 23:23:04,907][52663] DAMAGECOUNT value on done: 31128.0 [2024-08-05 23:23:04,908][52663] Sum rewards: 20.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.324', 'AMMO5': '0.007', 'weapon5': '0.052', 'AMMO2': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon4': '0.266', 'AMMO4': '0.278', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'ARMOR': '0.971', 'weapon2': '1.228', 'HITCOUNT': '1.520', 'weapon3': '2.010', 'DAMAGECOUNT': '6.504', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:05,003][52670] DAMAGECOUNT value on done: 30536.0 [2024-08-05 23:23:05,003][52670] Sum rewards: 30.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.604', 'AMMO5': '0.007', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon4': '0.640', 'weapon2': '0.910', 'WEAPON3': '0.950', 'weapon3': '2.128', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '8.265', 'FRAGCOUNT': '24.000'} [2024-08-05 23:23:05,198][52795] DAMAGECOUNT value on done: 28857.0 [2024-08-05 23:23:05,199][52795] Sum rewards: 18.950, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.140', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO3': '0.070', 'weapon5': '0.104', 'AMMO4': '0.147', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon2': '1.416', 'weapon3': '1.530', 'HITCOUNT': '1.580', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '14.500'} [2024-08-05 23:23:05,204][52666] DAMAGECOUNT value on done: 28744.0 [2024-08-05 23:23:05,205][52666] Sum rewards: 22.938, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.054', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.124', 'weapon5': '0.132', 'WEAPON4': '0.200', 'ARMOR': '0.440', 'WEAPON3': '0.800', 'weapon2': '1.394', 'HITCOUNT': '1.500', 'weapon3': '2.156', 'DAMAGECOUNT': '6.681', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:05,476][52664] DAMAGECOUNT value on done: 32238.0 [2024-08-05 23:23:05,476][52664] Sum rewards: 27.081, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.137', 'weapon4': '0.154', 'HEALTH': '0.270', 'ARMOR': '0.457', 'WEAPON3': '0.750', 'weapon2': '1.424', 'HITCOUNT': '1.880', 'weapon3': '2.202', 'DAMAGECOUNT': '7.236', 'FRAGCOUNT': '22.000'} [2024-08-05 23:23:06,378][52665] DAMAGECOUNT value on done: 29926.0 [2024-08-05 23:23:06,379][52665] Sum rewards: 21.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.726', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon5': '0.064', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.198', 'WEAPON7': '0.200', 'AMMO4': '0.220', 'weapon4': '0.382', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'WEAPON4': '0.550', 'weapon2': '0.922', 'WEAPON3': '1.200', 'HITCOUNT': '1.600', 'weapon3': '2.104', 'DAMAGECOUNT': '6.417', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:06,749][52667] DAMAGECOUNT value on done: 30134.0 [2024-08-05 23:23:06,749][52667] Sum rewards: 11.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.699', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'AMMO4': '0.250', 'ARMOR': '0.468', 'WEAPON4': '0.850', 'weapon2': '0.936', 'weapon4': '1.142', 'WEAPON3': '1.150', 'HITCOUNT': '1.410', 'weapon3': '1.448', 'DAMAGECOUNT': '4.980', 'FRAGCOUNT': '12.000'} [2024-08-05 23:23:07,460][52658] DAMAGECOUNT value on done: 30202.0 [2024-08-05 23:23:07,460][52658] Sum rewards: 20.155, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.656', 'AMMO5': '0.020', 'AMMO2': '0.030', 'weapon4': '0.088', 'AMMO3': '0.120', 'AMMO4': '0.151', 'weapon5': '0.182', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '1.310', 'weapon2': '1.450', 'weapon3': '1.568', 'DAMAGECOUNT': '5.052', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:07,656][52650] Updated weights for policy 0, policy_version 14521 (0.0014) [2024-08-05 23:23:07,657][52669] DAMAGECOUNT value on done: 31285.0 [2024-08-05 23:23:07,657][52669] Sum rewards: 17.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.357', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.322', 'WEAPON4': '0.350', 'ARMOR': '0.498', 'WEAPON3': '0.850', 'HITCOUNT': '1.390', 'weapon2': '1.630', 'weapon3': '1.696', 'DAMAGECOUNT': '4.668', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:07,661][52811] DAMAGECOUNT value on done: 28053.0 [2024-08-05 23:23:07,661][52811] Sum rewards: 25.249, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.115', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.260', 'ARMOR': '0.471', 'WEAPON3': '0.800', 'HITCOUNT': '1.570', 'weapon2': '1.638', 'weapon3': '1.754', 'DAMAGECOUNT': '6.045', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 118956032. Throughput: 0: 4363.5. Samples: 29742120. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:23:07,795][52567] Avg episode reward: [(0, '23.113')] [2024-08-05 23:23:07,797][52614] Saving new best policy, reward=23.113! [2024-08-05 23:23:07,851][52663] DAMAGECOUNT value on done: 30729.0 [2024-08-05 23:23:07,853][52663] Sum rewards: 17.772, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.146', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.088', 'weapon5': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.310', 'ARMOR': '0.424', 'WEAPON3': '0.650', 'HITCOUNT': '1.430', 'weapon2': '1.574', 'weapon3': '1.582', 'DAMAGECOUNT': '5.832', 'FRAGCOUNT': '12.000'} [2024-08-05 23:23:07,876][52670] DAMAGECOUNT value on done: 31480.0 [2024-08-05 23:23:07,878][52670] Sum rewards: 23.274, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.684', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.119', 'AMMO4': '0.137', 'weapon5': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.498', 'weapon2': '0.812', 'WEAPON3': '0.900', 'HITCOUNT': '1.620', 'weapon3': '1.980', 'DAMAGECOUNT': '6.621', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:08,298][52795] DAMAGECOUNT value on done: 27880.0 [2024-08-05 23:23:08,298][52795] Sum rewards: 26.323, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.915', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.136', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.320', 'ARMOR': '1.346', 'weapon3': '2.014', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '7.146', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:08,343][52666] DAMAGECOUNT value on done: 28176.0 [2024-08-05 23:23:08,344][52666] Sum rewards: 18.117, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.922', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.120', 'WEAPON3': '0.750', 'ARMOR': '0.901', 'HITCOUNT': '1.270', 'weapon3': '1.642', 'weapon2': '2.018', 'DAMAGECOUNT': '4.578', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:08,663][52664] DAMAGECOUNT value on done: 31710.0 [2024-08-05 23:23:08,663][52664] Sum rewards: 27.352, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.862', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.151', 'weapon4': '0.366', 'WEAPON4': '0.400', 'ARMOR': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.072', 'HITCOUNT': '2.080', 'weapon3': '2.138', 'DAMAGECOUNT': '7.620', 'FRAGCOUNT': '23.000'} [2024-08-05 23:23:09,394][52665] DAMAGECOUNT value on done: 29296.0 [2024-08-05 23:23:09,396][52665] Sum rewards: 13.246, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.208', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.054', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.400', 'ARMOR': '0.479', 'weapon4': '0.596', 'WEAPON3': '0.750', 'weapon2': '1.202', 'HITCOUNT': '1.590', 'weapon3': '1.614', 'DAMAGECOUNT': '5.283', 'FRAGCOUNT': '11.000'} [2024-08-05 23:23:09,701][52667] DAMAGECOUNT value on done: 30582.0 [2024-08-05 23:23:09,702][52667] Sum rewards: 20.108, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO3': '0.125', 'AMMO4': '0.187', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.871', 'weapon3': '1.600', 'HITCOUNT': '1.610', 'weapon2': '1.650', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:10,354][52669] DAMAGECOUNT value on done: 32296.0 [2024-08-05 23:23:10,354][52669] Sum rewards: 23.142, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'weapon4': '0.278', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'WEAPON3': '0.950', 'weapon2': '1.614', 'weapon3': '1.828', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '7.020', 'FRAGCOUNT': '18.500'} [2024-08-05 23:23:10,460][52658] DAMAGECOUNT value on done: 28861.0 [2024-08-05 23:23:10,460][52658] Sum rewards: 27.914, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO2': '0.023', 'AMMO3': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon4': '0.124', 'WEAPON3': '0.500', 'HEALTH': '0.578', 'ARMOR': '0.800', 'weapon2': '1.662', 'HITCOUNT': '1.740', 'weapon3': '1.766', 'DAMAGECOUNT': '7.161', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:10,819][52663] DAMAGECOUNT value on done: 31164.0 [2024-08-05 23:23:10,819][52663] Sum rewards: 24.894, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.052', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.430', 'ARMOR': '0.933', 'WEAPON3': '0.950', 'weapon2': '1.242', 'HITCOUNT': '1.650', 'weapon3': '1.670', 'DAMAGECOUNT': '6.330', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:10,919][52670] DAMAGECOUNT value on done: 28035.0 [2024-08-05 23:23:10,920][52670] Sum rewards: 19.709, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.094', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'HITCOUNT': '1.560', 'weapon2': '1.684', 'weapon3': '1.752', 'DAMAGECOUNT': '5.358', 'FRAGCOUNT': '17.500'} [2024-08-05 23:23:11,144][52666] DAMAGECOUNT value on done: 29582.0 [2024-08-05 23:23:11,145][52666] Sum rewards: 25.829, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.402', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO3': '0.100', 'WEAPON3': '0.700', 'ARMOR': '1.209', 'HITCOUNT': '1.810', 'weapon3': '1.832', 'weapon2': '1.940', 'DAMAGECOUNT': '6.168', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:11,494][52795] DAMAGECOUNT value on done: 29382.0 [2024-08-05 23:23:11,494][52795] Sum rewards: 19.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.050', 'AMMO2': '0.042', 'ARMOR': '0.072', 'AMMO3': '0.154', 'weapon4': '0.188', 'AMMO4': '0.209', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon2': '1.590', 'HITCOUNT': '1.700', 'weapon3': '1.834', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:12,171][52667] DAMAGECOUNT value on done: 32978.0 [2024-08-05 23:23:12,171][52667] Sum rewards: 19.870, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.478', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.148', 'weapon4': '0.158', 'WEAPON4': '0.200', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.416', 'HITCOUNT': '1.540', 'weapon3': '2.046', 'DAMAGECOUNT': '6.528', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:12,519][52665] DAMAGECOUNT value on done: 30964.0 [2024-08-05 23:23:12,520][52665] Sum rewards: 26.159, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.150', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.250', 'ARMOR': '0.495', 'weapon2': '1.036', 'WEAPON3': '1.300', 'HITCOUNT': '1.880', 'weapon3': '2.302', 'DAMAGECOUNT': '7.152', 'FRAGCOUNT': '24.000'} [2024-08-05 23:23:12,634][52650] Updated weights for policy 0, policy_version 14531 (0.0015) [2024-08-05 23:23:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 119037952. Throughput: 0: 4355.8. Samples: 29768010. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:23:12,794][52567] Avg episode reward: [(0, '22.891')] [2024-08-05 23:23:12,981][52658] DAMAGECOUNT value on done: 31410.0 [2024-08-05 23:23:12,984][52658] Sum rewards: 27.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.854', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'ARMOR': '0.900', 'WEAPON3': '1.100', 'weapon2': '1.448', 'HITCOUNT': '1.770', 'weapon3': '2.212', 'DAMAGECOUNT': '7.008', 'FRAGCOUNT': '26.000'} [2024-08-05 23:23:13,511][52670] DAMAGECOUNT value on done: 32547.0 [2024-08-05 23:23:13,519][52670] Sum rewards: 24.037, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.038', 'AMMO3': '0.098', 'AMMO4': '0.102', 'ARMOR': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '0.750', 'weapon2': '1.104', 'weapon3': '1.736', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.149', 'FRAGCOUNT': '17.500'} [2024-08-05 23:23:13,661][52669] DAMAGECOUNT value on done: 30504.0 [2024-08-05 23:23:13,661][52669] Sum rewards: 23.363, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.406', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.414', 'WEAPON3': '0.850', 'weapon2': '1.274', 'ARMOR': '1.313', 'HITCOUNT': '1.960', 'weapon3': '1.974', 'DAMAGECOUNT': '6.711', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:13,804][52666] DAMAGECOUNT value on done: 30172.0 [2024-08-05 23:23:13,805][52666] Sum rewards: 17.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.152', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'ARMOR': '1.309', 'HITCOUNT': '1.610', 'weapon2': '1.622', 'weapon3': '1.770', 'DAMAGECOUNT': '5.589', 'FRAGCOUNT': '17.500'} [2024-08-05 23:23:13,952][52663] DAMAGECOUNT value on done: 29388.0 [2024-08-05 23:23:13,953][52663] Sum rewards: 27.463, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.180', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.047', 'AMMO3': '0.088', 'WEAPON5': '0.100', 'WEAPON3': '0.550', 'ARMOR': '0.852', 'HITCOUNT': '1.550', 'weapon3': '1.604', 'weapon2': '1.788', 'DAMAGECOUNT': '6.282', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:14,538][52667] DAMAGECOUNT value on done: 30091.0 [2024-08-05 23:23:14,539][52667] Sum rewards: 22.433, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.662', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.116', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '0.750', 'ARMOR': '0.888', 'weapon2': '1.008', 'HITCOUNT': '1.650', 'weapon3': '2.012', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:14,713][52795] DAMAGECOUNT value on done: 29409.0 [2024-08-05 23:23:14,714][52795] Sum rewards: 23.633, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.470', 'AMMO5': '0.004', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.146', 'weapon4': '0.236', 'WEAPON3': '0.600', 'ARMOR': '1.286', 'weapon3': '1.366', 'HITCOUNT': '1.480', 'weapon2': '1.822', 'DAMAGECOUNT': '5.838', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:15,134][52658] DAMAGECOUNT value on done: 31974.0 [2024-08-05 23:23:15,135][52658] Sum rewards: 25.765, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.546', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.396', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.314', 'HITCOUNT': '1.370', 'weapon3': '1.908', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:15,651][52665] DAMAGECOUNT value on done: 31551.0 [2024-08-05 23:23:15,651][52665] Sum rewards: 27.506, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.635', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.036', 'weapon4': '0.036', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'WEAPON3': '0.650', 'ARMOR': '0.901', 'weapon2': '1.336', 'HITCOUNT': '1.570', 'weapon3': '2.052', 'DAMAGECOUNT': '6.255', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:16,408][52669] DAMAGECOUNT value on done: 32651.0 [2024-08-05 23:23:16,408][52669] Sum rewards: 24.285, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.010', 'weapon5': '0.038', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'WEAPON3': '0.700', 'ARMOR': '0.890', 'weapon3': '1.694', 'HITCOUNT': '1.830', 'weapon2': '1.862', 'DAMAGECOUNT': '6.915', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:16,489][52670] DAMAGECOUNT value on done: 29297.0 [2024-08-05 23:23:16,489][52670] Sum rewards: 36.654, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.006', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon4': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.424', 'weapon3': '2.150', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '8.769', 'FRAGCOUNT': '30.000'} [2024-08-05 23:23:16,747][52663] DAMAGECOUNT value on done: 32392.0 [2024-08-05 23:23:16,747][52663] Sum rewards: 24.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.116', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.348', 'ARMOR': '0.871', 'WEAPON3': '1.000', 'weapon2': '1.062', 'HITCOUNT': '1.750', 'weapon3': '1.954', 'DAMAGECOUNT': '7.890', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:16,822][52666] DAMAGECOUNT value on done: 29961.0 [2024-08-05 23:23:16,824][52666] Sum rewards: 15.203, reward structure: {'DEATHCOUNT': '-3.750', 'HEALTH': '-0.866', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.007', 'weapon5': '0.030', 'AMMO4': '0.035', 'weapon4': '0.044', 'AMMO3': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.500', 'HITCOUNT': '1.100', 'weapon2': '1.442', 'weapon3': '1.470', 'DAMAGECOUNT': '3.873', 'FRAGCOUNT': '11.000'} [2024-08-05 23:23:16,834][52650] Updated weights for policy 0, policy_version 14541 (0.0011) [2024-08-05 23:23:17,163][52667] DAMAGECOUNT value on done: 33180.0 [2024-08-05 23:23:17,163][52667] Sum rewards: 26.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.132', 'weapon4': '0.206', 'ARMOR': '0.851', 'WEAPON3': '0.900', 'weapon2': '1.262', 'HITCOUNT': '1.940', 'weapon3': '2.060', 'DAMAGECOUNT': '7.176', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 119119872. Throughput: 0: 4362.2. Samples: 29781230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:23:17,794][52567] Avg episode reward: [(0, '23.137')] [2024-08-05 23:23:17,798][52614] Saving new best policy, reward=23.137! [2024-08-05 23:23:17,803][52795] DAMAGECOUNT value on done: 27878.0 [2024-08-05 23:23:17,803][52795] Sum rewards: 23.184, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon5': '0.180', 'weapon4': '0.406', 'ARMOR': '0.832', 'WEAPON3': '0.950', 'weapon2': '1.214', 'HITCOUNT': '1.780', 'weapon3': '1.894', 'DAMAGECOUNT': '6.711', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:17,814][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:23:18,013][52659] Large shaping reward -2.515 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.225, -75.0), ('ARMOR', -0.041, -41.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:23:18,014][52658] DAMAGECOUNT value on done: 29083.0 [2024-08-05 23:23:18,014][52658] Sum rewards: 21.123, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.344', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.167', 'weapon4': '0.296', 'WEAPON5': '0.300', 'ARMOR': '0.491', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon2': '1.288', 'HITCOUNT': '1.700', 'weapon3': '2.088', 'DAMAGECOUNT': '6.060', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:18,710][52665] DAMAGECOUNT value on done: 30524.0 [2024-08-05 23:23:18,710][52665] Sum rewards: 18.320, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.792', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.163', 'weapon4': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.511', 'WEAPON3': '0.900', 'weapon2': '1.202', 'HITCOUNT': '1.410', 'weapon3': '2.236', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:19,126][52670] DAMAGECOUNT value on done: 29055.0 [2024-08-05 23:23:19,127][52670] Sum rewards: 25.184, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO3': '0.106', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'ARMOR': '0.844', 'weapon2': '1.320', 'weapon3': '1.740', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '7.323', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:19,359][52666] DAMAGECOUNT value on done: 28629.0 [2024-08-05 23:23:19,359][52666] Sum rewards: 24.438, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.408', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon4': '0.706', 'ARMOR': '0.904', 'WEAPON3': '0.950', 'weapon2': '1.098', 'HITCOUNT': '1.610', 'weapon3': '1.810', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '22.000'} [2024-08-05 23:23:20,150][52667] DAMAGECOUNT value on done: 33454.0 [2024-08-05 23:23:20,150][52667] Sum rewards: 21.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.036', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.064', 'weapon4': '0.076', 'AMMO3': '0.175', 'AMMO4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'ARMOR': '0.824', 'WEAPON3': '1.100', 'HITCOUNT': '1.520', 'weapon2': '1.684', 'weapon3': '1.922', 'DAMAGECOUNT': '6.210', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:20,298][52663] DAMAGECOUNT value on done: 34002.0 [2024-08-05 23:23:20,299][52663] Sum rewards: 27.956, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.064', 'AMMO3': '0.114', 'HEALTH': '0.141', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '1.530', 'HITCOUNT': '1.710', 'weapon3': '1.868', 'DAMAGECOUNT': '6.627', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:21,008][52658] DAMAGECOUNT value on done: 35263.0 [2024-08-05 23:23:21,009][52658] Sum rewards: 10.522, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.131', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.024', 'AMMO4': '0.039', 'weapon5': '0.082', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.208', 'WEAPON3': '0.850', 'HITCOUNT': '1.210', 'weapon2': '1.350', 'weapon3': '1.770', 'DAMAGECOUNT': '4.935', 'FRAGCOUNT': '10.000'} [2024-08-05 23:23:21,011][52795] DAMAGECOUNT value on done: 31069.0 [2024-08-05 23:23:21,013][52795] Sum rewards: 20.208, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.622', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.171', 'ARMOR': '0.416', 'weapon4': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon2': '1.094', 'HITCOUNT': '1.510', 'weapon3': '2.102', 'DAMAGECOUNT': '5.217', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:21,718][52670] DAMAGECOUNT value on done: 27733.0 [2024-08-05 23:23:21,718][52670] Sum rewards: 24.550, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO5': '0.007', 'AMMO2': '0.057', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.170', 'AMMO4': '0.287', 'ARMOR': '0.521', 'WEAPON4': '0.550', 'weapon2': '0.672', 'weapon4': '0.698', 'WEAPON3': '0.800', 'weapon3': '1.810', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:21,878][52650] Updated weights for policy 0, policy_version 14551 (0.0011) [2024-08-05 23:23:21,905][52665] DAMAGECOUNT value on done: 29881.0 [2024-08-05 23:23:21,907][52665] Sum rewards: 20.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.190', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'ARMOR': '0.852', 'WEAPON3': '0.900', 'weapon2': '1.396', 'HITCOUNT': '1.570', 'weapon3': '2.100', 'DAMAGECOUNT': '5.946', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:21,985][52666] DAMAGECOUNT value on done: 25997.0 [2024-08-05 23:23:21,988][52666] Sum rewards: 14.131, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO3': '0.090', 'AMMO4': '0.136', 'weapon4': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'HITCOUNT': '1.340', 'weapon2': '1.518', 'weapon3': '1.846', 'DAMAGECOUNT': '4.956', 'FRAGCOUNT': '14.000'} [2024-08-05 23:23:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 119218176. Throughput: 0: 4352.0. Samples: 29807140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:23:22,794][52567] Avg episode reward: [(0, '23.209')] [2024-08-05 23:23:22,795][52614] Saving new best policy, reward=23.209! [2024-08-05 23:23:22,929][52663] DAMAGECOUNT value on done: 29536.0 [2024-08-05 23:23:22,931][52663] Sum rewards: 17.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.962', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.366', 'ARMOR': '0.468', 'WEAPON3': '0.900', 'weapon2': '1.258', 'HITCOUNT': '1.470', 'weapon3': '1.934', 'DAMAGECOUNT': '4.914', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:23,251][52667] DAMAGECOUNT value on done: 32490.0 [2024-08-05 23:23:23,254][52667] Sum rewards: 29.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.146', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.106', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.528', 'ARMOR': '0.866', 'weapon2': '1.044', 'WEAPON3': '1.150', 'HITCOUNT': '1.860', 'weapon3': '1.878', 'DAMAGECOUNT': '7.953', 'FRAGCOUNT': '27.000'} [2024-08-05 23:23:24,218][52795] DAMAGECOUNT value on done: 30029.0 [2024-08-05 23:23:24,219][52795] Sum rewards: 26.958, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.142', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO3': '0.070', 'AMMO4': '0.075', 'weapon5': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.500', 'weapon4': '0.614', 'ARMOR': '0.842', 'weapon2': '1.294', 'weapon3': '1.482', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:24,406][52658] DAMAGECOUNT value on done: 29309.0 [2024-08-05 23:23:24,406][52658] Sum rewards: 18.796, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.873', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.068', 'AMMO3': '0.093', 'WEAPON4': '0.100', 'ARMOR': '0.451', 'WEAPON3': '0.750', 'HITCOUNT': '1.630', 'weapon2': '1.748', 'weapon3': '1.880', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:24,425][52670] DAMAGECOUNT value on done: 25737.0 [2024-08-05 23:23:24,426][52670] Sum rewards: 30.113, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.998', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO3': '0.115', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.408', 'WEAPON3': '0.750', 'ARMOR': '0.877', 'weapon2': '1.022', 'weapon3': '1.732', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '8.103', 'FRAGCOUNT': '23.000'} [2024-08-05 23:23:24,696][52666] DAMAGECOUNT value on done: 27492.0 [2024-08-05 23:23:24,696][52666] Sum rewards: 14.006, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.198', 'ARMOR': '0.424', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.106', 'HITCOUNT': '1.520', 'weapon3': '2.136', 'DAMAGECOUNT': '5.331', 'FRAGCOUNT': '12.000'} [2024-08-05 23:23:24,916][52665] DAMAGECOUNT value on done: 30639.0 [2024-08-05 23:23:24,916][52665] Sum rewards: 24.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'AMMO4': '0.128', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.880', 'weapon3': '1.452', 'weapon2': '1.610', 'HITCOUNT': '1.670', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:25,808][52663] DAMAGECOUNT value on done: 31196.0 [2024-08-05 23:23:25,812][52663] Sum rewards: 22.137, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.186', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.062', 'AMMO3': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.149', 'WEAPON7': '0.200', 'weapon4': '0.278', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.828', 'ARMOR': '0.995', 'HITCOUNT': '1.520', 'weapon3': '2.006', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:26,238][52667] DAMAGECOUNT value on done: 32175.0 [2024-08-05 23:23:26,239][52667] Sum rewards: 21.545, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.236', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.119', 'AMMO4': '0.151', 'WEAPON4': '0.400', 'weapon4': '0.464', 'WEAPON3': '0.800', 'ARMOR': '0.891', 'weapon2': '0.940', 'HITCOUNT': '1.770', 'weapon3': '1.880', 'DAMAGECOUNT': '6.783', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:27,044][52650] Updated weights for policy 0, policy_version 14561 (0.0012) [2024-08-05 23:23:27,314][52658] DAMAGECOUNT value on done: 33390.0 [2024-08-05 23:23:27,315][52658] Sum rewards: 28.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.251', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.237', 'weapon4': '0.246', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.318', 'ARMOR': '1.742', 'HITCOUNT': '1.930', 'weapon3': '2.110', 'DAMAGECOUNT': '7.680', 'FRAGCOUNT': '23.000'} [2024-08-05 23:23:27,409][52795] DAMAGECOUNT value on done: 29795.0 [2024-08-05 23:23:27,411][52795] Sum rewards: 20.349, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.812', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.125', 'WEAPON4': '0.250', 'weapon4': '0.410', 'ARMOR': '0.465', 'WEAPON3': '0.950', 'weapon2': '1.220', 'HITCOUNT': '1.910', 'weapon3': '2.190', 'DAMAGECOUNT': '6.621', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:27,598][52670] DAMAGECOUNT value on done: 30725.0 [2024-08-05 23:23:27,598][52670] Sum rewards: 25.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.737', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.034', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'weapon5': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.292', 'ARMOR': '0.476', 'weapon2': '0.972', 'WEAPON3': '1.000', 'HITCOUNT': '1.590', 'weapon3': '2.002', 'DAMAGECOUNT': '6.870', 'FRAGCOUNT': '24.000'} [2024-08-05 23:23:27,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 119300096. Throughput: 0: 4347.1. Samples: 29833160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:23:27,795][52567] Avg episode reward: [(0, '23.230')] [2024-08-05 23:23:27,853][52614] Saving new best policy, reward=23.230! [2024-08-05 23:23:27,870][52666] DAMAGECOUNT value on done: 30011.0 [2024-08-05 23:23:27,871][52666] Sum rewards: 20.691, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.520', 'AMMO4': '-0.047', 'AMMO2': '-0.009', 'AMMO5': '0.007', 'weapon4': '0.014', 'weapon5': '0.060', 'AMMO3': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'ARMOR': '1.371', 'HITCOUNT': '1.500', 'weapon3': '1.742', 'weapon2': '2.008', 'DAMAGECOUNT': '5.481', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:27,994][52665] DAMAGECOUNT value on done: 29062.0 [2024-08-05 23:23:27,994][52665] Sum rewards: 23.831, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.204', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.100', 'weapon5': '0.150', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '0.700', 'ARMOR': '0.840', 'weapon2': '1.110', 'HITCOUNT': '1.710', 'weapon3': '1.766', 'DAMAGECOUNT': '7.278', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:28,606][52663] DAMAGECOUNT value on done: 34678.0 [2024-08-05 23:23:28,606][52663] Sum rewards: 32.549, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.020', 'AMMO4': '-0.058', 'AMMO2': '-0.011', 'AMMO3': '0.153', 'WEAPON3': '1.100', 'weapon2': '1.454', 'ARMOR': '1.761', 'HITCOUNT': '2.200', 'weapon3': '2.314', 'DAMAGECOUNT': '8.406', 'FRAGCOUNT': '27.000'} [2024-08-05 23:23:28,681][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:23:29,461][52667] DAMAGECOUNT value on done: 32512.0 [2024-08-05 23:23:29,462][52667] Sum rewards: 16.448, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.034', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.958', 'HITCOUNT': '1.390', 'weapon2': '1.790', 'weapon3': '1.828', 'DAMAGECOUNT': '4.800', 'FRAGCOUNT': '14.000'} [2024-08-05 23:23:29,977][52614] Signal inference workers to stop experience collection... (2700 times) [2024-08-05 23:23:29,980][52614] Signal inference workers to resume experience collection... (2700 times) [2024-08-05 23:23:30,065][52650] InferenceWorker_p0-w0: stopping experience collection (2700 times) [2024-08-05 23:23:30,065][52650] InferenceWorker_p0-w0: resuming experience collection (2700 times) [2024-08-05 23:23:30,138][52670] DAMAGECOUNT value on done: 32387.0 [2024-08-05 23:23:30,140][52670] Sum rewards: 30.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.028', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.280', 'WEAPON3': '1.050', 'weapon2': '1.222', 'ARMOR': '1.307', 'HITCOUNT': '2.170', 'weapon3': '2.212', 'DAMAGECOUNT': '8.355', 'FRAGCOUNT': '27.000'} [2024-08-05 23:23:30,374][52666] DAMAGECOUNT value on done: 28685.0 [2024-08-05 23:23:30,374][52666] Sum rewards: 31.053, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.124', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'weapon4': '0.516', 'WEAPON3': '0.800', 'weapon2': '1.082', 'weapon3': '2.072', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '8.229', 'FRAGCOUNT': '24.000'} [2024-08-05 23:23:30,464][52658] DAMAGECOUNT value on done: 32174.0 [2024-08-05 23:23:30,466][52658] Sum rewards: 23.699, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.453', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'ARMOR': '0.436', 'WEAPON3': '0.600', 'HITCOUNT': '1.640', 'weapon3': '1.724', 'weapon2': '1.988', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:30,601][52795] DAMAGECOUNT value on done: 30799.0 [2024-08-05 23:23:30,601][52795] Sum rewards: 23.800, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON3': '0.900', 'weapon2': '1.126', 'HITCOUNT': '1.800', 'weapon3': '2.326', 'DAMAGECOUNT': '7.101', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:30,876][52665] DAMAGECOUNT value on done: 29119.0 [2024-08-05 23:23:30,877][52665] Sum rewards: 23.049, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.268', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.145', 'weapon4': '0.292', 'ARMOR': '0.408', 'WEAPON3': '0.850', 'weapon2': '1.310', 'HITCOUNT': '1.710', 'weapon3': '2.096', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:30,937][52671] DAMAGECOUNT value on done: 34657.0 [2024-08-05 23:23:30,939][52671] Sum rewards: 29.113, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.695', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.109', 'WEAPON3': '0.750', 'weapon2': '1.608', 'HITCOUNT': '2.020', 'weapon3': '2.140', 'DAMAGECOUNT': '8.430', 'FRAGCOUNT': '22.000'} [2024-08-05 23:23:31,173][52663] DAMAGECOUNT value on done: 31789.0 [2024-08-05 23:23:31,173][52663] Sum rewards: 20.770, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.529', 'AMMO5': '0.016', 'AMMO2': '0.021', 'weapon4': '0.044', 'weapon5': '0.076', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.350', 'ARMOR': '0.904', 'weapon2': '1.048', 'WEAPON3': '1.100', 'HITCOUNT': '1.410', 'weapon3': '2.520', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:31,382][52650] Updated weights for policy 0, policy_version 14571 (0.0013) [2024-08-05 23:23:32,305][52667] DAMAGECOUNT value on done: 33243.0 [2024-08-05 23:23:32,306][52667] Sum rewards: 28.724, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.992', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.160', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'ARMOR': '1.312', 'weapon2': '1.580', 'HITCOUNT': '1.870', 'weapon3': '1.996', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '24.000'} [2024-08-05 23:23:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 119390208. Throughput: 0: 4350.0. Samples: 29846240. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:23:32,794][52567] Avg episode reward: [(0, '23.464')] [2024-08-05 23:23:32,795][52614] Saving new best policy, reward=23.464! [2024-08-05 23:23:33,066][52670] DAMAGECOUNT value on done: 31361.0 [2024-08-05 23:23:33,067][52670] Sum rewards: 24.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.606', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'ARMOR': '0.929', 'WEAPON3': '1.200', 'weapon2': '1.514', 'HITCOUNT': '1.830', 'weapon3': '2.132', 'DAMAGECOUNT': '7.452', 'FRAGCOUNT': '23.000'} [2024-08-05 23:23:33,145][52658] DAMAGECOUNT value on done: 32304.0 [2024-08-05 23:23:33,145][52658] Sum rewards: 22.794, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.617', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON3': '0.850', 'ARMOR': '0.902', 'weapon2': '1.046', 'HITCOUNT': '1.680', 'weapon3': '1.710', 'DAMAGECOUNT': '5.961', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:33,418][52666] DAMAGECOUNT value on done: 28610.0 [2024-08-05 23:23:33,421][52666] Sum rewards: 12.525, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.808', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.220', 'WEAPON4': '0.400', 'weapon4': '0.410', 'ARMOR': '0.456', 'WEAPON3': '0.600', 'HITCOUNT': '1.080', 'weapon2': '1.260', 'weapon3': '1.612', 'DAMAGECOUNT': '3.600', 'FRAGCOUNT': '11.000'} [2024-08-05 23:23:33,806][52795] DAMAGECOUNT value on done: 32211.0 [2024-08-05 23:23:33,806][52795] Sum rewards: 22.496, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO3': '0.106', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.282', 'HEALTH': '0.328', 'WEAPON3': '0.650', 'ARMOR': '0.828', 'weapon2': '1.408', 'HITCOUNT': '1.600', 'weapon3': '1.994', 'DAMAGECOUNT': '5.757', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:33,929][52663] DAMAGECOUNT value on done: 31090.0 [2024-08-05 23:23:33,931][52663] Sum rewards: 23.605, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.032', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON3': '0.650', 'HITCOUNT': '1.350', 'weapon2': '1.620', 'ARMOR': '1.653', 'weapon3': '2.106', 'DAMAGECOUNT': '5.430', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:34,168][52671] DAMAGECOUNT value on done: 30228.0 [2024-08-05 23:23:34,169][52671] Sum rewards: 20.217, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.554', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.018', 'AMMO4': '0.061', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon2': '0.976', 'WEAPON3': '1.050', 'HITCOUNT': '1.480', 'weapon3': '2.254', 'DAMAGECOUNT': '5.445', 'FRAGCOUNT': '18.500'} [2024-08-05 23:23:35,933][52658] DAMAGECOUNT value on done: 29584.0 [2024-08-05 23:23:35,935][52658] Sum rewards: 25.381, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.731', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.098', 'AMMO3': '0.109', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'WEAPON4': '0.400', 'ARMOR': '0.516', 'weapon2': '0.724', 'weapon4': '0.724', 'WEAPON3': '0.750', 'HITCOUNT': '1.710', 'weapon3': '1.910', 'DAMAGECOUNT': '6.321', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:35,984][52650] Updated weights for policy 0, policy_version 14581 (0.0028) [2024-08-05 23:23:36,383][52670] DAMAGECOUNT value on done: 31685.0 [2024-08-05 23:23:36,385][52670] Sum rewards: 22.593, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.150', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.338', 'HITCOUNT': '1.670', 'weapon3': '1.672', 'DAMAGECOUNT': '6.309', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:36,621][52666] DAMAGECOUNT value on done: 29244.0 [2024-08-05 23:23:36,623][52666] Sum rewards: 23.967, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.382', 'AMMO4': '-0.048', 'AMMO2': '-0.010', 'AMMO5': '0.003', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'ARMOR': '0.444', 'WEAPON3': '0.800', 'HITCOUNT': '1.390', 'weapon3': '1.654', 'weapon2': '1.920', 'DAMAGECOUNT': '5.919', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:36,815][52663] DAMAGECOUNT value on done: 30183.0 [2024-08-05 23:23:36,815][52663] Sum rewards: 18.241, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.300', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.110', 'WEAPON3': '0.700', 'ARMOR': '0.935', 'HITCOUNT': '1.610', 'weapon2': '1.624', 'weapon3': '2.006', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '14.000'} [2024-08-05 23:23:36,887][52795] DAMAGECOUNT value on done: 27602.0 [2024-08-05 23:23:36,888][52795] Sum rewards: 21.342, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.396', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.070', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.214', 'ARMOR': '0.458', 'WEAPON3': '0.500', 'HITCOUNT': '1.390', 'weapon2': '1.616', 'weapon3': '1.676', 'DAMAGECOUNT': '5.010', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:37,101][52671] DAMAGECOUNT value on done: 31788.0 [2024-08-05 23:23:37,101][52671] Sum rewards: 10.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.350', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon5': '0.052', 'AMMO3': '0.142', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.640', 'WEAPON3': '0.900', 'weapon2': '1.260', 'HITCOUNT': '1.400', 'ARMOR': '1.433', 'weapon3': '1.768', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '9.000'} [2024-08-05 23:23:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 119472128. Throughput: 0: 4351.7. Samples: 29872610. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:23:37,795][52567] Avg episode reward: [(0, '22.964')] [2024-08-05 23:23:38,916][52658] DAMAGECOUNT value on done: 32612.0 [2024-08-05 23:23:38,917][52658] Sum rewards: 24.965, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.087', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.147', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'weapon4': '0.490', 'WEAPON3': '0.850', 'weapon2': '1.040', 'HITCOUNT': '1.700', 'weapon3': '1.892', 'DAMAGECOUNT': '6.384', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:39,141][52670] DAMAGECOUNT value on done: 30525.0 [2024-08-05 23:23:39,142][52670] Sum rewards: 20.624, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.220', 'HEALTH': '0.337', 'weapon4': '0.380', 'WEAPON3': '0.500', 'HITCOUNT': '1.170', 'weapon2': '1.308', 'ARMOR': '1.335', 'weapon3': '1.668', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:39,327][52666] DAMAGECOUNT value on done: 28352.0 [2024-08-05 23:23:39,329][52666] Sum rewards: 18.235, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon4': '0.390', 'ARMOR': '0.483', 'WEAPON3': '1.050', 'weapon2': '1.078', 'HITCOUNT': '1.690', 'weapon3': '1.944', 'DAMAGECOUNT': '5.610', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:39,728][52663] DAMAGECOUNT value on done: 31499.0 [2024-08-05 23:23:39,728][52663] Sum rewards: 28.086, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.736', 'AMMO4': '-0.054', 'AMMO2': '-0.011', 'AMMO3': '0.135', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'weapon2': '1.428', 'HITCOUNT': '1.780', 'weapon3': '2.080', 'DAMAGECOUNT': '6.558', 'FRAGCOUNT': '24.000'} [2024-08-05 23:23:39,947][52671] DAMAGECOUNT value on done: 30666.0 [2024-08-05 23:23:39,948][52671] Sum rewards: 22.088, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.310', 'weapon4': '0.002', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'ARMOR': '1.220', 'weapon2': '1.324', 'HITCOUNT': '1.850', 'weapon3': '2.460', 'DAMAGECOUNT': '6.867', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:40,014][52795] DAMAGECOUNT value on done: 28843.0 [2024-08-05 23:23:40,014][52795] Sum rewards: 21.148, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.430', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.005', 'AMMO3': '0.113', 'weapon5': '0.120', 'WEAPON5': '0.150', 'ARMOR': '0.456', 'WEAPON3': '0.700', 'weapon2': '1.472', 'HITCOUNT': '1.570', 'weapon3': '1.828', 'DAMAGECOUNT': '5.907', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:40,387][52647] DAMAGECOUNT value on done: 33407.0 [2024-08-05 23:23:40,388][52647] Sum rewards: 19.646, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.028', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon5': '0.154', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.002', 'HITCOUNT': '1.570', 'weapon3': '1.840', 'DAMAGECOUNT': '6.078', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:40,933][52650] Updated weights for policy 0, policy_version 14591 (0.0012) [2024-08-05 23:23:41,858][52670] DAMAGECOUNT value on done: 30134.0 [2024-08-05 23:23:41,858][52670] Sum rewards: 20.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.596', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon5': '0.048', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.386', 'ARMOR': '0.424', 'weapon2': '1.036', 'WEAPON3': '1.050', 'HITCOUNT': '1.660', 'weapon3': '2.052', 'DAMAGECOUNT': '6.594', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:42,091][52658] DAMAGECOUNT value on done: 33113.0 [2024-08-05 23:23:42,091][52658] Sum rewards: 32.488, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.072', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'weapon5': '0.056', 'AMMO3': '0.093', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.455', 'weapon4': '0.562', 'WEAPON3': '0.750', 'weapon2': '1.290', 'weapon3': '1.810', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '7.659', 'FRAGCOUNT': '25.000'} [2024-08-05 23:23:42,179][52666] DAMAGECOUNT value on done: 29795.0 [2024-08-05 23:23:42,179][52666] Sum rewards: 21.404, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.054', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'ARMOR': '0.840', 'WEAPON3': '1.050', 'weapon2': '1.334', 'HITCOUNT': '1.480', 'weapon3': '2.272', 'DAMAGECOUNT': '5.373', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:42,697][52663] DAMAGECOUNT value on done: 30698.0 [2024-08-05 23:23:42,698][52663] Sum rewards: 14.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon4': '0.422', 'ARMOR': '0.472', 'weapon2': '1.028', 'WEAPON3': '1.100', 'HITCOUNT': '1.360', 'weapon3': '2.116', 'DAMAGECOUNT': '4.995', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 119562240. Throughput: 0: 4353.1. Samples: 29898930. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:23:42,794][52567] Avg episode reward: [(0, '22.856')] [2024-08-05 23:23:42,874][52659] DAMAGECOUNT value on done: 30857.0 [2024-08-05 23:23:42,874][52659] Sum rewards: 25.288, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.094', 'weapon5': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.172', 'ARMOR': '0.472', 'WEAPON3': '0.650', 'weapon3': '1.452', 'HITCOUNT': '1.570', 'weapon2': '1.904', 'DAMAGECOUNT': '6.411', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:42,973][52671] DAMAGECOUNT value on done: 29732.0 [2024-08-05 23:23:42,974][52671] Sum rewards: 17.620, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.172', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.105', 'AMMO4': '0.155', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.490', 'WEAPON3': '0.700', 'weapon2': '0.904', 'ARMOR': '0.944', 'HITCOUNT': '1.580', 'weapon3': '2.024', 'DAMAGECOUNT': '5.676', 'FRAGCOUNT': '13.500'} [2024-08-05 23:23:43,055][52647] DAMAGECOUNT value on done: 33558.0 [2024-08-05 23:23:43,056][52647] Sum rewards: 33.581, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.882', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.119', 'WEAPON3': '0.800', 'ARMOR': '1.200', 'HITCOUNT': '1.900', 'weapon2': '1.904', 'weapon3': '1.970', 'DAMAGECOUNT': '7.461', 'FRAGCOUNT': '28.000'} [2024-08-05 23:23:43,156][52795] DAMAGECOUNT value on done: 30172.0 [2024-08-05 23:23:43,156][52795] Sum rewards: 22.375, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.612', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.052', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.855', 'HITCOUNT': '1.160', 'weapon2': '1.348', 'weapon3': '2.154', 'DAMAGECOUNT': '5.451', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:45,000][52658] DAMAGECOUNT value on done: 30434.0 [2024-08-05 23:23:45,000][52658] Sum rewards: 20.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.420', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon5': '0.094', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'weapon4': '0.272', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.254', 'HITCOUNT': '1.560', 'weapon3': '1.854', 'DAMAGECOUNT': '5.916', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:45,079][52670] DAMAGECOUNT value on done: 29422.0 [2024-08-05 23:23:45,081][52670] Sum rewards: 21.094, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.070', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'AMMO3': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.328', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.422', 'weapon3': '1.494', 'HITCOUNT': '1.510', 'DAMAGECOUNT': '5.604', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:45,267][52666] DAMAGECOUNT value on done: 30408.0 [2024-08-05 23:23:45,267][52666] Sum rewards: 21.297, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.630', 'AMMO2': '0.002', 'AMMO5': '0.004', 'AMMO4': '0.008', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'weapon4': '0.318', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.376', 'HITCOUNT': '1.760', 'weapon3': '1.824', 'DAMAGECOUNT': '6.498', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:45,514][52650] Updated weights for policy 0, policy_version 14601 (0.0022) [2024-08-05 23:23:45,576][52659] DAMAGECOUNT value on done: 32970.0 [2024-08-05 23:23:45,577][52659] Sum rewards: 28.804, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.989', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.174', 'weapon4': '0.274', 'ARMOR': '0.855', 'WEAPON3': '1.150', 'weapon2': '1.238', 'weapon3': '2.064', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '7.506', 'FRAGCOUNT': '25.000'} [2024-08-05 23:23:45,676][52671] DAMAGECOUNT value on done: 34085.0 [2024-08-05 23:23:45,678][52671] Sum rewards: 24.750, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.406', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.060', 'WEAPON3': '0.450', 'weapon3': '1.488', 'weapon2': '1.662', 'HITCOUNT': '1.780', 'ARMOR': '1.832', 'DAMAGECOUNT': '6.300', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:45,802][52663] DAMAGECOUNT value on done: 31944.0 [2024-08-05 23:23:45,803][52663] Sum rewards: 33.890, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.821', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.132', 'weapon4': '0.216', 'WEAPON4': '0.250', 'ARMOR': '0.485', 'WEAPON3': '0.850', 'weapon2': '1.682', 'weapon3': '1.910', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '7.860', 'FRAGCOUNT': '28.000'} [2024-08-05 23:23:45,919][52647] DAMAGECOUNT value on done: 36461.0 [2024-08-05 23:23:45,919][52647] Sum rewards: 32.465, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.707', 'AMMO4': '-0.048', 'AMMO2': '-0.009', 'AMMO5': '0.005', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON3': '0.800', 'ARMOR': '1.365', 'weapon2': '1.710', 'weapon3': '1.910', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '7.779', 'FRAGCOUNT': '25.000'} [2024-08-05 23:23:47,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 119652352. Throughput: 0: 4356.4. Samples: 29911770. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:23:47,794][52567] Avg episode reward: [(0, '23.145')] [2024-08-05 23:23:47,922][52658] DAMAGECOUNT value on done: 32962.0 [2024-08-05 23:23:47,924][52658] Sum rewards: 17.915, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'WEAPON4': '0.250', 'ARMOR': '0.464', 'weapon4': '0.540', 'WEAPON3': '0.750', 'weapon2': '1.204', 'HITCOUNT': '1.380', 'weapon3': '1.706', 'DAMAGECOUNT': '4.533', 'FRAGCOUNT': '14.000'} [2024-08-05 23:23:48,134][52670] DAMAGECOUNT value on done: 29658.0 [2024-08-05 23:23:48,136][52670] Sum rewards: 19.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.238', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.046', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON3': '1.200', 'ARMOR': '1.282', 'weapon2': '1.476', 'HITCOUNT': '1.790', 'weapon3': '2.104', 'DAMAGECOUNT': '6.648', 'FRAGCOUNT': '19.500'} [2024-08-05 23:23:48,363][52666] DAMAGECOUNT value on done: 30041.0 [2024-08-05 23:23:48,365][52666] Sum rewards: 20.249, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.088', 'AMMO4': '-0.032', 'AMMO2': '-0.006', 'AMMO5': '0.015', 'weapon4': '0.034', 'AMMO3': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.350', 'ARMOR': '0.453', 'WEAPON3': '0.750', 'HITCOUNT': '1.410', 'weapon3': '1.626', 'weapon2': '1.792', 'DAMAGECOUNT': '5.922', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:48,381][52659] DAMAGECOUNT value on done: 31449.0 [2024-08-05 23:23:48,382][52659] Sum rewards: 15.837, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.204', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.052', 'AMMO3': '0.087', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'WEAPON3': '0.650', 'weapon4': '0.680', 'weapon2': '1.236', 'HITCOUNT': '1.280', 'weapon3': '1.666', 'DAMAGECOUNT': '4.608', 'FRAGCOUNT': '14.000'} [2024-08-05 23:23:48,518][52663] DAMAGECOUNT value on done: 32774.0 [2024-08-05 23:23:48,518][52663] Sum rewards: 20.015, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.397', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'ARMOR': '0.454', 'WEAPON3': '0.600', 'HITCOUNT': '1.730', 'weapon3': '1.788', 'weapon2': '1.870', 'DAMAGECOUNT': '5.667', 'FRAGCOUNT': '14.000'} [2024-08-05 23:23:48,536][52671] DAMAGECOUNT value on done: 31354.0 [2024-08-05 23:23:48,536][52671] Sum rewards: 23.067, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.138', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON3': '0.850', 'weapon2': '1.208', 'ARMOR': '1.343', 'HITCOUNT': '1.580', 'weapon3': '1.932', 'DAMAGECOUNT': '6.765', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:48,794][52647] DAMAGECOUNT value on done: 32873.0 [2024-08-05 23:23:48,795][52647] Sum rewards: 31.396, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'AMMO5': '0.006', 'ARMOR': '0.036', 'weapon5': '0.046', 'AMMO2': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.238', 'weapon4': '0.420', 'WEAPON4': '0.650', 'weapon2': '0.938', 'WEAPON3': '1.300', 'weapon3': '2.290', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '8.412', 'FRAGCOUNT': '28.000'} [2024-08-05 23:23:50,353][52650] Updated weights for policy 0, policy_version 14611 (0.0014) [2024-08-05 23:23:50,439][52658] DAMAGECOUNT value on done: 34213.0 [2024-08-05 23:23:50,440][52658] Sum rewards: 31.109, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.772', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'AMMO3': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.348', 'HITCOUNT': '1.920', 'weapon3': '1.930', 'DAMAGECOUNT': '7.119', 'FRAGCOUNT': '23.000'} [2024-08-05 23:23:50,836][52670] DAMAGECOUNT value on done: 29251.0 [2024-08-05 23:23:50,837][52670] Sum rewards: 16.563, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.705', 'weapon4': '0.006', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'weapon2': '1.536', 'HITCOUNT': '1.630', 'weapon3': '2.206', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '14.000'} [2024-08-05 23:23:50,931][52649] DAMAGECOUNT value on done: 31333.0 [2024-08-05 23:23:50,932][52649] Sum rewards: 21.267, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.720', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.126', 'weapon4': '0.156', 'WEAPON3': '0.800', 'ARMOR': '0.918', 'weapon2': '1.376', 'HITCOUNT': '1.560', 'weapon3': '1.628', 'DAMAGECOUNT': '6.525', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:51,348][52663] DAMAGECOUNT value on done: 31302.0 [2024-08-05 23:23:51,348][52663] Sum rewards: 23.575, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.286', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.038', 'AMMO3': '0.139', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.388', 'ARMOR': '0.875', 'WEAPON3': '0.900', 'weapon2': '1.334', 'HITCOUNT': '1.520', 'weapon3': '1.964', 'DAMAGECOUNT': '5.523', 'FRAGCOUNT': '22.000'} [2024-08-05 23:23:51,507][52659] DAMAGECOUNT value on done: 32205.0 [2024-08-05 23:23:51,508][52659] Sum rewards: 33.488, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.467', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.136', 'HITCOUNT': '2.390', 'weapon3': '2.636', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '27.000'} [2024-08-05 23:23:51,622][52671] DAMAGECOUNT value on done: 33988.0 [2024-08-05 23:23:51,622][52671] Sum rewards: 24.079, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.006', 'AMMO2': '0.031', 'AMMO3': '0.106', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.232', 'ARMOR': '0.432', 'HEALTH': '0.449', 'WEAPON3': '0.600', 'weapon2': '1.550', 'HITCOUNT': '1.610', 'weapon3': '1.796', 'DAMAGECOUNT': '6.423', 'FRAGCOUNT': '17.000'} [2024-08-05 23:23:51,890][52647] DAMAGECOUNT value on done: 33398.0 [2024-08-05 23:23:51,891][52647] Sum rewards: 17.396, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.208', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.041', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'weapon4': '0.386', 'WEAPON4': '0.400', 'ARMOR': '0.466', 'WEAPON3': '0.800', 'HITCOUNT': '1.300', 'weapon2': '1.508', 'weapon3': '1.598', 'DAMAGECOUNT': '4.839', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 119734272. Throughput: 0: 4352.5. Samples: 29937980. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:23:52,794][52567] Avg episode reward: [(0, '23.173')] [2024-08-05 23:23:52,946][52658] DAMAGECOUNT value on done: 31573.0 [2024-08-05 23:23:52,948][52658] Sum rewards: 25.938, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.188', 'AMMO2': '0.032', 'AMMO3': '0.111', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.494', 'WEAPON3': '0.650', 'ARMOR': '0.876', 'weapon2': '1.576', 'weapon3': '1.676', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '7.290', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:53,919][52649] DAMAGECOUNT value on done: 31455.0 [2024-08-05 23:23:53,919][52649] Sum rewards: 21.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.558', 'AMMO5': '0.010', 'AMMO2': '0.052', 'AMMO3': '0.138', 'weapon5': '0.140', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.260', 'ARMOR': '0.444', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon2': '1.384', 'HITCOUNT': '1.670', 'weapon3': '1.872', 'DAMAGECOUNT': '6.828', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:54,100][52670] DAMAGECOUNT value on done: 29490.0 [2024-08-05 23:23:54,103][52670] Sum rewards: 21.183, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.265', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.095', 'WEAPON4': '0.250', 'ARMOR': '0.420', 'weapon4': '0.466', 'WEAPON3': '0.750', 'weapon2': '1.070', 'HITCOUNT': '1.790', 'weapon3': '2.074', 'DAMAGECOUNT': '6.420', 'FRAGCOUNT': '15.000'} [2024-08-05 23:23:54,165][52663] DAMAGECOUNT value on done: 30734.0 [2024-08-05 23:23:54,167][52663] Sum rewards: 31.697, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO3': '0.070', 'AMMO4': '0.078', 'HEALTH': '0.080', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.274', 'WEAPON3': '0.500', 'weapon2': '1.294', 'weapon3': '1.714', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '7.734', 'FRAGCOUNT': '23.000'} [2024-08-05 23:23:54,455][52647] DAMAGECOUNT value on done: 33766.0 [2024-08-05 23:23:54,457][52647] Sum rewards: 28.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'ARMOR': '0.858', 'WEAPON3': '1.200', 'weapon2': '1.534', 'HITCOUNT': '2.190', 'weapon3': '2.206', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '26.000'} [2024-08-05 23:23:54,576][52650] Updated weights for policy 0, policy_version 14621 (0.0039) [2024-08-05 23:23:54,846][52659] DAMAGECOUNT value on done: 31714.0 [2024-08-05 23:23:54,847][52659] Sum rewards: 21.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.062', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'ARMOR': '0.858', 'WEAPON3': '1.250', 'weapon2': '1.252', 'HITCOUNT': '1.780', 'weapon3': '2.326', 'DAMAGECOUNT': '6.813', 'FRAGCOUNT': '20.000'} [2024-08-05 23:23:54,874][52671] DAMAGECOUNT value on done: 32572.0 [2024-08-05 23:23:54,874][52671] Sum rewards: 20.023, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.945', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.087', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.466', 'WEAPON3': '0.650', 'weapon2': '1.142', 'HITCOUNT': '1.450', 'weapon3': '1.708', 'DAMAGECOUNT': '5.232', 'FRAGCOUNT': '16.000'} [2024-08-05 23:23:55,444][52658] DAMAGECOUNT value on done: 30851.0 [2024-08-05 23:23:55,452][52658] Sum rewards: 30.076, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.198', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.120', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.878', 'weapon2': '1.444', 'HITCOUNT': '2.050', 'weapon3': '2.086', 'DAMAGECOUNT': '8.625', 'FRAGCOUNT': '23.000'} [2024-08-05 23:23:56,595][52663] DAMAGECOUNT value on done: 30902.0 [2024-08-05 23:23:56,596][52663] Sum rewards: 21.330, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.218', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon4': '0.176', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon2': '1.174', 'ARMOR': '1.349', 'HITCOUNT': '1.860', 'weapon3': '2.316', 'DAMAGECOUNT': '7.224', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:56,890][52649] DAMAGECOUNT value on done: 31001.0 [2024-08-05 23:23:56,892][52649] Sum rewards: 24.480, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.474', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.028', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'WEAPON3': '0.650', 'ARMOR': '0.856', 'HITCOUNT': '1.670', 'weapon3': '1.776', 'weapon2': '1.960', 'DAMAGECOUNT': '5.961', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:57,487][52647] DAMAGECOUNT value on done: 32573.0 [2024-08-05 23:23:57,489][52647] Sum rewards: 25.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.994', 'AMMO2': '0.003', 'weapon4': '0.012', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.139', 'ARMOR': '0.456', 'WEAPON3': '0.900', 'weapon2': '1.654', 'HITCOUNT': '1.700', 'weapon3': '2.172', 'DAMAGECOUNT': '7.020', 'FRAGCOUNT': '22.000'} [2024-08-05 23:23:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 119832576. Throughput: 0: 4355.1. Samples: 29963990. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:23:57,795][52567] Avg episode reward: [(0, '23.236')] [2024-08-05 23:23:57,879][52659] DAMAGECOUNT value on done: 33642.0 [2024-08-05 23:23:57,880][52659] Sum rewards: 26.410, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.783', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.082', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.528', 'WEAPON3': '0.650', 'weapon2': '1.138', 'weapon3': '1.884', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '7.752', 'FRAGCOUNT': '18.000'} [2024-08-05 23:23:57,892][52671] DAMAGECOUNT value on done: 34774.0 [2024-08-05 23:23:57,892][52671] Sum rewards: 24.833, reward structure: {'DEATHCOUNT': '-10.500', 'weapon5': '0.002', 'HEALTH': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.157', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'WEAPON3': '0.950', 'weapon2': '1.084', 'HITCOUNT': '1.700', 'weapon3': '2.380', 'DAMAGECOUNT': '6.561', 'FRAGCOUNT': '21.000'} [2024-08-05 23:23:58,150][52658] DAMAGECOUNT value on done: 32590.0 [2024-08-05 23:23:58,151][52658] Sum rewards: 23.262, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.644', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.000', 'weapon2': '1.280', 'ARMOR': '1.310', 'HITCOUNT': '1.620', 'weapon3': '2.092', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '19.000'} [2024-08-05 23:23:59,707][52650] Updated weights for policy 0, policy_version 14631 (0.0014) [2024-08-05 23:23:59,791][52649] DAMAGECOUNT value on done: 31431.0 [2024-08-05 23:23:59,792][52649] Sum rewards: 20.031, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.093', 'HEALTH': '0.170', 'weapon4': '0.226', 'WEAPON3': '0.550', 'weapon2': '1.316', 'HITCOUNT': '1.750', 'weapon3': '1.994', 'DAMAGECOUNT': '6.441', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:00,379][52647] DAMAGECOUNT value on done: 35242.0 [2024-08-05 23:24:00,381][52647] Sum rewards: 24.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '1.018', 'WEAPON3': '1.200', 'ARMOR': '1.285', 'HITCOUNT': '1.660', 'weapon3': '2.454', 'DAMAGECOUNT': '6.582', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:01,000][52671] DAMAGECOUNT value on done: 31503.0 [2024-08-05 23:24:01,009][52671] Sum rewards: 21.741, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.087', 'AMMO4': '0.107', 'weapon4': '0.232', 'WEAPON3': '0.500', 'HEALTH': '0.643', 'ARMOR': '0.800', 'weapon2': '1.490', 'HITCOUNT': '1.680', 'weapon3': '1.684', 'DAMAGECOUNT': '5.643', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:01,034][52659] DAMAGECOUNT value on done: 32998.0 [2024-08-05 23:24:01,035][52659] Sum rewards: 9.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.170', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.202', 'weapon4': '0.332', 'WEAPON4': '0.350', 'ARMOR': '0.828', 'WEAPON3': '0.900', 'weapon2': '1.106', 'HITCOUNT': '1.110', 'weapon3': '2.198', 'DAMAGECOUNT': '3.708', 'FRAGCOUNT': '10.000'} [2024-08-05 23:24:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 119906304. Throughput: 0: 4354.7. Samples: 29977190. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:24:02,794][52567] Avg episode reward: [(0, '23.013')] [2024-08-05 23:24:02,855][52647] DAMAGECOUNT value on done: 34547.0 [2024-08-05 23:24:02,855][52647] Sum rewards: 23.993, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.071', 'AMMO4': '-0.049', 'AMMO2': '-0.010', 'AMMO5': '0.010', 'weapon5': '0.028', 'AMMO3': '0.076', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon4': '0.700', 'ARMOR': '0.944', 'weapon2': '1.524', 'weapon3': '1.570', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '6.261', 'FRAGCOUNT': '18.000'} [2024-08-05 23:24:02,903][52649] DAMAGECOUNT value on done: 31300.0 [2024-08-05 23:24:02,903][52649] Sum rewards: 23.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.229', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.041', 'weapon4': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.204', 'WEAPON4': '0.450', 'ARMOR': '0.495', 'WEAPON3': '1.000', 'weapon2': '1.158', 'HITCOUNT': '1.800', 'weapon3': '2.522', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:03,921][52650] Updated weights for policy 0, policy_version 14641 (0.0013) [2024-08-05 23:24:04,303][52671] DAMAGECOUNT value on done: 33170.0 [2024-08-05 23:24:04,304][52671] Sum rewards: 16.607, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.642', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.129', 'ARMOR': '0.440', 'WEAPON3': '0.850', 'HITCOUNT': '1.380', 'weapon2': '1.480', 'weapon3': '2.148', 'DAMAGECOUNT': '5.223', 'FRAGCOUNT': '15.000'} [2024-08-05 23:24:04,318][52659] DAMAGECOUNT value on done: 30501.0 [2024-08-05 23:24:04,318][52659] Sum rewards: 28.011, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.274', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.106', 'AMMO3': '0.117', 'WEAPON5': '0.200', 'weapon4': '0.372', 'WEAPON4': '0.400', 'ARMOR': '0.498', 'WEAPON3': '0.900', 'weapon2': '0.970', 'HITCOUNT': '1.870', 'weapon3': '2.258', 'DAMAGECOUNT': '7.236', 'FRAGCOUNT': '25.000'} [2024-08-05 23:24:04,993][52820] DAMAGECOUNT value on done: 27957.0 [2024-08-05 23:24:04,993][52820] Sum rewards: 22.266, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.482', 'WEAPON3': '0.800', 'ARMOR': '0.849', 'weapon3': '1.518', 'weapon2': '1.536', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '6.207', 'FRAGCOUNT': '18.000'} [2024-08-05 23:24:05,487][52647] DAMAGECOUNT value on done: 32755.0 [2024-08-05 23:24:05,487][52647] Sum rewards: 20.468, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.092', 'AMMO3': '0.094', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '0.700', 'ARMOR': '0.859', 'weapon2': '1.136', 'HITCOUNT': '1.180', 'weapon3': '1.660', 'DAMAGECOUNT': '5.088', 'FRAGCOUNT': '15.000'} [2024-08-05 23:24:05,736][52649] DAMAGECOUNT value on done: 31604.0 [2024-08-05 23:24:05,737][52649] Sum rewards: 25.784, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.820', 'weapon2': '1.396', 'HITCOUNT': '1.760', 'weapon3': '2.034', 'DAMAGECOUNT': '6.960', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:06,974][52671] DAMAGECOUNT value on done: 35872.0 [2024-08-05 23:24:06,976][52671] Sum rewards: 23.035, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.141', 'weapon4': '0.190', 'WEAPON4': '0.300', 'ARMOR': '0.539', 'WEAPON3': '1.000', 'weapon2': '1.408', 'HITCOUNT': '1.640', 'weapon3': '2.106', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:07,039][52659] DAMAGECOUNT value on done: 30298.0 [2024-08-05 23:24:07,040][52659] Sum rewards: 20.236, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.265', 'AMMO2': '0.028', 'AMMO3': '0.092', 'AMMO4': '0.141', 'weapon4': '0.410', 'ARMOR': '0.459', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon2': '1.510', 'weapon3': '1.734', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '6.327', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 119996416. Throughput: 0: 4363.1. Samples: 30003480. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:24:07,795][52567] Avg episode reward: [(0, '23.111')] [2024-08-05 23:24:08,048][52820] DAMAGECOUNT value on done: 29125.0 [2024-08-05 23:24:08,050][52820] Sum rewards: 24.218, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.876', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.031', 'AMMO3': '0.110', 'AMMO4': '0.157', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.524', 'WEAPON3': '0.750', 'weapon2': '1.374', 'HITCOUNT': '1.800', 'weapon3': '2.040', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:08,224][52649] DAMAGECOUNT value on done: 28412.0 [2024-08-05 23:24:08,224][52649] Sum rewards: 22.998, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.862', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'weapon4': '0.148', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'ARMOR': '0.897', 'weapon2': '1.078', 'WEAPON3': '1.100', 'HITCOUNT': '1.700', 'weapon3': '2.436', 'DAMAGECOUNT': '6.696', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:08,685][52647] DAMAGECOUNT value on done: 33955.0 [2024-08-05 23:24:08,685][52647] Sum rewards: 29.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.068', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon4': '0.212', 'WEAPON4': '0.250', 'ARMOR': '0.872', 'WEAPON3': '1.150', 'weapon2': '1.294', 'weapon3': '2.022', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '8.586', 'FRAGCOUNT': '24.000'} [2024-08-05 23:24:08,731][52650] Updated weights for policy 0, policy_version 14651 (0.0035) [2024-08-05 23:24:09,757][52671] DAMAGECOUNT value on done: 30657.0 [2024-08-05 23:24:09,758][52671] Sum rewards: 23.704, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.129', 'AMMO4': '0.141', 'weapon4': '0.144', 'HEALTH': '0.234', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.062', 'HITCOUNT': '1.730', 'weapon3': '2.268', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:09,873][52659] DAMAGECOUNT value on done: 33355.0 [2024-08-05 23:24:09,877][52659] Sum rewards: 22.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.996', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'weapon4': '0.440', 'ARMOR': '0.849', 'WEAPON3': '0.900', 'weapon2': '1.140', 'HITCOUNT': '1.530', 'weapon3': '2.150', 'DAMAGECOUNT': '6.234', 'FRAGCOUNT': '18.500'} [2024-08-05 23:24:11,019][52649] DAMAGECOUNT value on done: 30076.0 [2024-08-05 23:24:11,020][52649] Sum rewards: 16.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.168', 'AMMO5': '0.015', 'weapon5': '0.038', 'AMMO2': '0.059', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon4': '0.276', 'AMMO4': '0.296', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'ARMOR': '1.277', 'weapon2': '1.366', 'HITCOUNT': '1.660', 'weapon3': '2.024', 'DAMAGECOUNT': '5.922', 'FRAGCOUNT': '18.000'} [2024-08-05 23:24:11,108][52820] DAMAGECOUNT value on done: 27637.0 [2024-08-05 23:24:11,109][52820] Sum rewards: 23.045, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.334', 'WEAPON3': '0.700', 'weapon2': '1.578', 'HITCOUNT': '1.710', 'weapon3': '1.768', 'DAMAGECOUNT': '6.666', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:11,467][52647] DAMAGECOUNT value on done: 30554.0 [2024-08-05 23:24:11,468][52647] Sum rewards: 30.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.188', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'ARMOR': '0.409', 'weapon4': '0.604', 'weapon2': '1.092', 'WEAPON3': '1.150', 'weapon3': '1.914', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '7.962', 'FRAGCOUNT': '27.000'} [2024-08-05 23:24:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 120086528. Throughput: 0: 4373.8. Samples: 30029980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 23:24:12,794][52567] Avg episode reward: [(0, '23.273')] [2024-08-05 23:24:13,146][52671] DAMAGECOUNT value on done: 28552.0 [2024-08-05 23:24:13,146][52671] Sum rewards: 19.767, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.050', 'AMMO3': '0.082', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'WEAPON3': '0.600', 'ARMOR': '0.857', 'weapon3': '1.612', 'HITCOUNT': '1.630', 'weapon2': '1.722', 'DAMAGECOUNT': '5.736', 'FRAGCOUNT': '15.000'} [2024-08-05 23:24:13,220][52659] DAMAGECOUNT value on done: 32004.0 [2024-08-05 23:24:13,224][52659] Sum rewards: 20.020, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.611', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.081', 'AMMO3': '0.089', 'weapon4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '1.341', 'HITCOUNT': '1.640', 'weapon3': '1.678', 'weapon2': '1.714', 'DAMAGECOUNT': '5.997', 'FRAGCOUNT': '14.500'} [2024-08-05 23:24:13,530][52650] Updated weights for policy 0, policy_version 14661 (0.0012) [2024-08-05 23:24:13,837][52647] DAMAGECOUNT value on done: 33701.0 [2024-08-05 23:24:13,837][52647] Sum rewards: 27.875, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.040', 'weapon5': '0.054', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.238', 'weapon2': '0.772', 'WEAPON3': '1.050', 'HITCOUNT': '2.010', 'weapon3': '2.568', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:14,312][52820] DAMAGECOUNT value on done: 28926.0 [2024-08-05 23:24:14,314][52820] Sum rewards: 15.405, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.624', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.131', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.330', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.250', 'HITCOUNT': '1.360', 'weapon3': '1.708', 'DAMAGECOUNT': '5.280', 'FRAGCOUNT': '13.000'} [2024-08-05 23:24:14,331][52649] DAMAGECOUNT value on done: 29503.0 [2024-08-05 23:24:14,332][52649] Sum rewards: 19.019, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.892', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'weapon5': '0.060', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.254', 'HITCOUNT': '1.700', 'weapon3': '2.136', 'DAMAGECOUNT': '7.056', 'FRAGCOUNT': '16.000'} [2024-08-05 23:24:15,786][52671] DAMAGECOUNT value on done: 33847.0 [2024-08-05 23:24:15,787][52671] Sum rewards: 29.014, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.001', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.131', 'weapon4': '0.386', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.358', 'weapon3': '1.982', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:15,938][52659] DAMAGECOUNT value on done: 31267.0 [2024-08-05 23:24:15,939][52659] Sum rewards: 17.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.228', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '0.774', 'ARMOR': '0.937', 'weapon2': '1.106', 'weapon3': '1.282', 'HITCOUNT': '1.480', 'DAMAGECOUNT': '5.211', 'FRAGCOUNT': '16.000'} [2024-08-05 23:24:17,150][52647] DAMAGECOUNT value on done: 32134.0 [2024-08-05 23:24:17,150][52647] Sum rewards: 27.939, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.579', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.024', 'AMMO3': '0.101', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.460', 'WEAPON3': '0.700', 'ARMOR': '0.891', 'weapon2': '1.520', 'weapon3': '1.738', 'HITCOUNT': '1.770', 'DAMAGECOUNT': '6.777', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:17,345][52649] DAMAGECOUNT value on done: 29362.0 [2024-08-05 23:24:17,345][52649] Sum rewards: 18.679, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.085', 'AMMO4': '0.173', 'WEAPON4': '0.400', 'WEAPON3': '0.600', 'weapon2': '0.670', 'weapon4': '1.292', 'weapon3': '1.372', 'HITCOUNT': '1.480', 'DAMAGECOUNT': '4.950', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:17,371][52820] DAMAGECOUNT value on done: 30151.0 [2024-08-05 23:24:17,371][52820] Sum rewards: 22.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.362', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'weapon4': '0.276', 'ARMOR': '0.448', 'WEAPON3': '0.800', 'weapon2': '1.432', 'HITCOUNT': '1.680', 'weapon3': '1.794', 'DAMAGECOUNT': '6.174', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 120176640. Throughput: 0: 4375.3. Samples: 30043130. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 23:24:17,802][52567] Avg episode reward: [(0, '23.029')] [2024-08-05 23:24:18,410][52650] Updated weights for policy 0, policy_version 14671 (0.0056) [2024-08-05 23:24:18,680][52671] DAMAGECOUNT value on done: 32417.0 [2024-08-05 23:24:18,680][52671] Sum rewards: 19.266, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.716', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.088', 'weapon5': '0.090', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '0.600', 'weapon4': '1.036', 'HITCOUNT': '1.120', 'weapon3': '1.350', 'DAMAGECOUNT': '4.920', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:18,742][52659] DAMAGECOUNT value on done: 29849.0 [2024-08-05 23:24:18,743][52659] Sum rewards: 26.153, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.745', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'weapon4': '0.216', 'WEAPON4': '0.250', 'ARMOR': '0.866', 'WEAPON3': '0.900', 'weapon2': '1.476', 'HITCOUNT': '1.810', 'weapon3': '1.854', 'DAMAGECOUNT': '6.654', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:19,656][52647] DAMAGECOUNT value on done: 34729.0 [2024-08-05 23:24:19,658][52647] Sum rewards: 19.758, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.764', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.124', 'AMMO3': '0.154', 'weapon4': '0.242', 'WEAPON3': '0.900', 'weapon2': '1.186', 'HITCOUNT': '1.540', 'weapon3': '1.892', 'DAMAGECOUNT': '6.138', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:20,304][52649] DAMAGECOUNT value on done: 32437.0 [2024-08-05 23:24:20,305][52649] Sum rewards: 22.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.220', 'WEAPON3': '1.000', 'weapon2': '1.414', 'ARMOR': '1.617', 'HITCOUNT': '1.890', 'weapon3': '2.120', 'DAMAGECOUNT': '6.777', 'FRAGCOUNT': '18.500'} [2024-08-05 23:24:20,583][52820] DAMAGECOUNT value on done: 29451.0 [2024-08-05 23:24:20,594][52820] Sum rewards: 21.188, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.470', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO4': '0.141', 'AMMO3': '0.142', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.376', 'ARMOR': '0.404', 'weapon2': '0.948', 'WEAPON3': '1.050', 'HITCOUNT': '1.670', 'weapon3': '2.028', 'DAMAGECOUNT': '6.183', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:21,491][52671] DAMAGECOUNT value on done: 33365.0 [2024-08-05 23:24:21,493][52671] Sum rewards: 32.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.200', 'WEAPON3': '0.850', 'weapon2': '1.464', 'ARMOR': '1.695', 'HITCOUNT': '1.870', 'weapon3': '2.144', 'DAMAGECOUNT': '7.497', 'FRAGCOUNT': '26.000'} [2024-08-05 23:24:21,600][52659] DAMAGECOUNT value on done: 31315.0 [2024-08-05 23:24:21,603][52659] Sum rewards: 29.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.490', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.150', 'AMMO3': '0.188', 'ARMOR': '0.456', 'weapon2': '1.208', 'WEAPON3': '1.250', 'HITCOUNT': '1.910', 'weapon3': '2.060', 'DAMAGECOUNT': '7.230', 'FRAGCOUNT': '27.000'} [2024-08-05 23:24:22,053][52647] DAMAGECOUNT value on done: 31463.0 [2024-08-05 23:24:22,053][52647] Sum rewards: 26.477, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.846', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.146', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'ARMOR': '1.252', 'weapon2': '1.482', 'weapon3': '1.564', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '6.702', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17522.5). Total num frames: 120258560. Throughput: 0: 4377.8. Samples: 30069610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:24:22,794][52567] Avg episode reward: [(0, '22.956')] [2024-08-05 23:24:22,951][52650] Updated weights for policy 0, policy_version 14681 (0.0031) [2024-08-05 23:24:23,487][52649] DAMAGECOUNT value on done: 30251.0 [2024-08-05 23:24:23,487][52649] Sum rewards: 23.275, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.064', 'AMMO3': '0.101', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.467', 'weapon4': '0.610', 'WEAPON3': '0.700', 'weapon2': '0.776', 'HITCOUNT': '1.580', 'weapon3': '2.036', 'DAMAGECOUNT': '6.048', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:23,669][52794] DAMAGECOUNT value on done: 36482.0 [2024-08-05 23:24:23,670][52794] Sum rewards: 31.344, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.956', 'ARMOR': '0.032', 'AMMO2': '0.034', 'AMMO3': '0.126', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '0.850', 'weapon2': '0.980', 'HITCOUNT': '2.220', 'weapon3': '2.254', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '24.000'} [2024-08-05 23:24:23,731][52820] DAMAGECOUNT value on done: 30311.0 [2024-08-05 23:24:23,731][52820] Sum rewards: 26.019, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.663', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.133', 'ARMOR': '0.886', 'WEAPON3': '0.900', 'weapon2': '1.568', 'HITCOUNT': '1.880', 'weapon3': '1.978', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:23,868][52662] DAMAGECOUNT value on done: 36809.0 [2024-08-05 23:24:23,869][52662] Sum rewards: 22.320, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.378', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'weapon4': '0.432', 'WEAPON3': '1.050', 'weapon2': '1.102', 'HITCOUNT': '1.610', 'weapon3': '2.146', 'DAMAGECOUNT': '6.315', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:24,037][52671] DAMAGECOUNT value on done: 31811.0 [2024-08-05 23:24:24,042][52671] Sum rewards: 24.680, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.013', 'AMMO2': '0.014', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.127', 'WEAPON3': '0.900', 'weapon2': '1.636', 'ARMOR': '1.714', 'HITCOUNT': '1.740', 'weapon3': '2.156', 'DAMAGECOUNT': '6.273', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:24,171][52659] DAMAGECOUNT value on done: 32165.0 [2024-08-05 23:24:24,176][52659] Sum rewards: 27.904, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.965', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'weapon5': '0.108', 'AMMO4': '0.138', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '0.700', 'weapon2': '1.208', 'weapon3': '1.710', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.900', 'FRAGCOUNT': '22.000'} [2024-08-05 23:24:24,419][52647] DAMAGECOUNT value on done: 32156.0 [2024-08-05 23:24:24,420][52647] Sum rewards: 18.032, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.185', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.280', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'HITCOUNT': '1.490', 'weapon3': '1.582', 'weapon2': '1.728', 'DAMAGECOUNT': '4.830', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:26,454][52649] DAMAGECOUNT value on done: 33761.0 [2024-08-05 23:24:26,460][52649] Sum rewards: 21.463, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.380', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'ARMOR': '0.020', 'WEAPON4': '0.050', 'AMMO3': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.288', 'WEAPON3': '0.750', 'HITCOUNT': '1.460', 'weapon2': '1.654', 'weapon3': '1.802', 'DAMAGECOUNT': '5.352', 'FRAGCOUNT': '18.000'} [2024-08-05 23:24:26,842][52794] DAMAGECOUNT value on done: 36427.0 [2024-08-05 23:24:26,842][52794] Sum rewards: 28.178, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.499', 'AMMO2': '0.032', 'AMMO3': '0.158', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.392', 'WEAPON3': '0.900', 'ARMOR': '0.911', 'weapon2': '1.408', 'HITCOUNT': '1.720', 'weapon3': '1.888', 'DAMAGECOUNT': '6.660', 'FRAGCOUNT': '24.000'} [2024-08-05 23:24:26,920][52820] DAMAGECOUNT value on done: 28852.0 [2024-08-05 23:24:26,920][52820] Sum rewards: 27.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.040', 'weapon4': '0.068', 'AMMO4': '0.091', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'ARMOR': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.272', 'HITCOUNT': '1.740', 'weapon3': '2.262', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '24.500'} [2024-08-05 23:24:26,975][52647] DAMAGECOUNT value on done: 32429.0 [2024-08-05 23:24:26,977][52647] Sum rewards: 25.691, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.146', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.616', 'ARMOR': '0.946', 'WEAPON3': '1.000', 'weapon2': '1.046', 'HITCOUNT': '1.760', 'weapon3': '1.876', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '22.000'} [2024-08-05 23:24:27,016][52662] DAMAGECOUNT value on done: 37963.0 [2024-08-05 23:24:27,018][52662] Sum rewards: 31.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.732', 'AMMO5': '0.023', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO4': '0.133', 'weapon4': '0.152', 'AMMO3': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.852', 'WEAPON3': '1.000', 'weapon2': '1.036', 'HITCOUNT': '1.960', 'weapon3': '2.450', 'DAMAGECOUNT': '8.148', 'FRAGCOUNT': '27.000'} [2024-08-05 23:24:27,256][52671] DAMAGECOUNT value on done: 31140.0 [2024-08-05 23:24:27,256][52671] Sum rewards: 22.059, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.428', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.131', 'weapon5': '0.208', 'WEAPON5': '0.400', 'ARMOR': '0.416', 'WEAPON4': '0.450', 'weapon4': '0.630', 'WEAPON3': '0.900', 'weapon2': '0.906', 'HITCOUNT': '1.710', 'weapon3': '1.910', 'DAMAGECOUNT': '6.153', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:27,473][52659] DAMAGECOUNT value on done: 34931.0 [2024-08-05 23:24:27,475][52659] Sum rewards: 29.654, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.089', 'AMMO4': '0.137', 'WEAPON4': '0.300', 'HEALTH': '0.386', 'WEAPON3': '0.550', 'weapon4': '0.752', 'ARMOR': '0.820', 'weapon2': '0.882', 'weapon3': '1.668', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '6.642', 'FRAGCOUNT': '21.500'} [2024-08-05 23:24:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 120340480. Throughput: 0: 4372.7. Samples: 30095700. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:24:27,794][52567] Avg episode reward: [(0, '23.682')] [2024-08-05 23:24:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014690_120340480.pth... [2024-08-05 23:24:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014179_116154368.pth [2024-08-05 23:24:27,947][52614] Saving new best policy, reward=23.682! [2024-08-05 23:24:28,233][52650] Updated weights for policy 0, policy_version 14691 (0.0026) [2024-08-05 23:24:29,426][52647] DAMAGECOUNT value on done: 32665.0 [2024-08-05 23:24:29,426][52647] Sum rewards: 16.773, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.713', 'AMMO4': '-0.067', 'AMMO2': '-0.013', 'AMMO5': '0.004', 'weapon5': '0.034', 'AMMO3': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.202', 'WEAPON3': '0.650', 'ARMOR': '0.855', 'weapon3': '1.390', 'HITCOUNT': '1.490', 'weapon2': '1.820', 'DAMAGECOUNT': '4.845', 'FRAGCOUNT': '13.000'} [2024-08-05 23:24:29,582][52649] DAMAGECOUNT value on done: 30873.0 [2024-08-05 23:24:29,584][52649] Sum rewards: 25.536, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.078', 'AMMO3': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.250', 'ARMOR': '0.462', 'WEAPON3': '0.850', 'weapon2': '1.410', 'HITCOUNT': '1.710', 'weapon3': '1.882', 'DAMAGECOUNT': '7.296', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:29,982][52794] DAMAGECOUNT value on done: 37112.0 [2024-08-05 23:24:29,984][52794] Sum rewards: 25.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.614', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.348', 'weapon2': '0.826', 'WEAPON3': '1.150', 'ARMOR': '1.310', 'HITCOUNT': '2.080', 'weapon3': '2.526', 'DAMAGECOUNT': '7.377', 'FRAGCOUNT': '22.000'} [2024-08-05 23:24:30,098][52820] DAMAGECOUNT value on done: 26745.0 [2024-08-05 23:24:30,098][52820] Sum rewards: 18.334, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.754', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.039', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.468', 'weapon4': '0.526', 'weapon2': '0.856', 'WEAPON3': '1.200', 'HITCOUNT': '1.450', 'weapon3': '2.196', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:30,108][52662] DAMAGECOUNT value on done: 40460.0 [2024-08-05 23:24:30,111][52662] Sum rewards: 32.745, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.348', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'weapon4': '0.428', 'WEAPON3': '0.950', 'weapon2': '1.226', 'ARMOR': '1.677', 'weapon3': '2.020', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.706', 'FRAGCOUNT': '26.000'} [2024-08-05 23:24:30,229][52659] DAMAGECOUNT value on done: 31752.0 [2024-08-05 23:24:30,229][52659] Sum rewards: 30.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.998', 'AMMO2': '0.011', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.141', 'WEAPON3': '0.900', 'ARMOR': '1.324', 'weapon2': '1.682', 'HITCOUNT': '1.970', 'weapon3': '2.142', 'DAMAGECOUNT': '8.100', 'FRAGCOUNT': '25.000'} [2024-08-05 23:24:32,270][52647] DAMAGECOUNT value on done: 33611.0 [2024-08-05 23:24:32,271][52647] Sum rewards: 27.764, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.869', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'AMMO3': '0.110', 'weapon5': '0.110', 'WEAPON5': '0.200', 'ARMOR': '0.412', 'WEAPON3': '0.700', 'HITCOUNT': '1.660', 'weapon3': '1.774', 'weapon2': '1.844', 'DAMAGECOUNT': '6.267', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:32,326][52650] Updated weights for policy 0, policy_version 14701 (0.0014) [2024-08-05 23:24:32,537][52649] DAMAGECOUNT value on done: 29053.0 [2024-08-05 23:24:32,537][52649] Sum rewards: 19.130, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.812', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.137', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.336', 'ARMOR': '0.847', 'WEAPON3': '1.100', 'weapon2': '1.206', 'HITCOUNT': '1.500', 'weapon3': '1.996', 'DAMAGECOUNT': '6.033', 'FRAGCOUNT': '16.000'} [2024-08-05 23:24:32,662][52794] DAMAGECOUNT value on done: 33144.0 [2024-08-05 23:24:32,663][52794] Sum rewards: 25.490, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.201', 'AMMO2': '0.031', 'AMMO3': '0.108', 'AMMO4': '0.152', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.488', 'WEAPON3': '0.700', 'weapon2': '0.924', 'HITCOUNT': '1.750', 'weapon3': '1.976', 'DAMAGECOUNT': '6.612', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 120438784. Throughput: 0: 4368.9. Samples: 30108370. Policy #0 lag: (min: 0.0, avg: 5.0, max: 9.0) [2024-08-05 23:24:32,794][52567] Avg episode reward: [(0, '23.853')] [2024-08-05 23:24:32,818][52614] Saving new best policy, reward=23.853! [2024-08-05 23:24:32,926][52662] DAMAGECOUNT value on done: 34427.0 [2024-08-05 23:24:32,926][52662] Sum rewards: 24.492, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.953', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.068', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.302', 'ARMOR': '0.408', 'WEAPON3': '0.700', 'weapon2': '1.272', 'HITCOUNT': '1.460', 'weapon3': '1.734', 'DAMAGECOUNT': '5.412', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:33,113][52820] DAMAGECOUNT value on done: 27312.0 [2024-08-05 23:24:33,114][52820] Sum rewards: 15.638, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.842', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.250', 'ARMOR': '0.483', 'WEAPON3': '0.950', 'HITCOUNT': '1.380', 'weapon2': '1.454', 'weapon3': '1.658', 'DAMAGECOUNT': '5.769', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:33,355][52659] DAMAGECOUNT value on done: 31959.0 [2024-08-05 23:24:33,355][52659] Sum rewards: 31.119, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.024', 'weapon5': '0.026', 'AMMO4': '0.041', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON3': '1.050', 'weapon2': '1.094', 'HITCOUNT': '2.050', 'weapon3': '2.606', 'DAMAGECOUNT': '7.794', 'FRAGCOUNT': '28.000'} [2024-08-05 23:24:35,603][52794] DAMAGECOUNT value on done: 36794.0 [2024-08-05 23:24:35,604][52794] Sum rewards: 24.504, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.482', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'weapon4': '0.416', 'ARMOR': '0.494', 'WEAPON3': '0.700', 'weapon2': '1.062', 'weapon3': '1.942', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '6.981', 'FRAGCOUNT': '19.500'} [2024-08-05 23:24:35,716][52662] DAMAGECOUNT value on done: 35396.0 [2024-08-05 23:24:35,719][52662] Sum rewards: 23.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.451', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.022', 'weapon5': '0.038', 'weapon4': '0.110', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.861', 'WEAPON3': '1.050', 'weapon2': '1.492', 'HITCOUNT': '1.780', 'weapon3': '2.188', 'DAMAGECOUNT': '7.107', 'FRAGCOUNT': '24.000'} [2024-08-05 23:24:35,775][52649] DAMAGECOUNT value on done: 32863.0 [2024-08-05 23:24:35,776][52649] Sum rewards: 24.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.016', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.192', 'ARMOR': '0.924', 'weapon2': '1.064', 'WEAPON3': '1.250', 'HITCOUNT': '2.000', 'weapon3': '2.530', 'DAMAGECOUNT': '7.698', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:36,068][52659] DAMAGECOUNT value on done: 32250.0 [2024-08-05 23:24:36,069][52659] Sum rewards: 23.789, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.166', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.070', 'weapon5': '0.074', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.488', 'HITCOUNT': '1.870', 'weapon3': '2.152', 'DAMAGECOUNT': '6.639', 'FRAGCOUNT': '20.500'} [2024-08-05 23:24:36,183][52668] DAMAGECOUNT value on done: 31622.0 [2024-08-05 23:24:36,184][52668] Sum rewards: 30.332, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.614', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.100', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.432', 'ARMOR': '0.867', 'WEAPON3': '0.900', 'weapon2': '0.992', 'weapon3': '2.022', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '8.400', 'FRAGCOUNT': '24.000'} [2024-08-05 23:24:36,189][52820] DAMAGECOUNT value on done: 30143.0 [2024-08-05 23:24:36,189][52820] Sum rewards: 20.870, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon5': '0.022', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '0.750', 'ARMOR': '0.929', 'weapon2': '0.958', 'HITCOUNT': '1.730', 'weapon3': '1.936', 'DAMAGECOUNT': '6.303', 'FRAGCOUNT': '17.500'} [2024-08-05 23:24:37,346][52650] Updated weights for policy 0, policy_version 14711 (0.0021) [2024-08-05 23:24:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 120520704. Throughput: 0: 4366.0. Samples: 30134450. Policy #0 lag: (min: 0.0, avg: 5.0, max: 9.0) [2024-08-05 23:24:37,795][52567] Avg episode reward: [(0, '23.794')] [2024-08-05 23:24:38,210][52794] DAMAGECOUNT value on done: 38101.0 [2024-08-05 23:24:38,218][52794] Sum rewards: 29.338, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.613', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.186', 'ARMOR': '0.491', 'WEAPON3': '0.750', 'weapon2': '1.512', 'HITCOUNT': '2.000', 'weapon3': '2.002', 'DAMAGECOUNT': '7.386', 'FRAGCOUNT': '22.000'} [2024-08-05 23:24:38,395][52662] DAMAGECOUNT value on done: 37750.0 [2024-08-05 23:24:38,395][52662] Sum rewards: 13.748, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.838', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.548', 'ARMOR': '0.927', 'weapon2': '1.098', 'WEAPON3': '1.100', 'HITCOUNT': '1.280', 'weapon3': '1.958', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '12.500'} [2024-08-05 23:24:38,718][52649] DAMAGECOUNT value on done: 29276.0 [2024-08-05 23:24:38,718][52649] Sum rewards: 16.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.075', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'ARMOR': '1.312', 'HITCOUNT': '1.420', 'weapon2': '1.644', 'weapon3': '2.148', 'DAMAGECOUNT': '5.520', 'FRAGCOUNT': '16.000'} [2024-08-05 23:24:39,007][52668] DAMAGECOUNT value on done: 34502.0 [2024-08-05 23:24:39,007][52668] Sum rewards: 19.457, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.624', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.137', 'weapon4': '0.188', 'WEAPON5': '0.300', 'ARMOR': '0.899', 'WEAPON3': '0.900', 'weapon2': '1.314', 'HITCOUNT': '1.520', 'weapon3': '2.072', 'DAMAGECOUNT': '6.201', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:39,056][52659] DAMAGECOUNT value on done: 34807.0 [2024-08-05 23:24:39,057][52659] Sum rewards: 35.957, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.159', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.029', 'AMMO3': '0.102', 'weapon5': '0.118', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.438', 'WEAPON3': '0.700', 'weapon2': '0.796', 'HITCOUNT': '1.990', 'weapon3': '2.148', 'DAMAGECOUNT': '7.662', 'FRAGCOUNT': '29.000'} [2024-08-05 23:24:39,376][52820] DAMAGECOUNT value on done: 30950.0 [2024-08-05 23:24:39,377][52820] Sum rewards: 31.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.770', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.540', 'WEAPON3': '0.900', 'ARMOR': '0.909', 'weapon2': '1.036', 'HITCOUNT': '2.010', 'weapon3': '2.022', 'DAMAGECOUNT': '8.865', 'FRAGCOUNT': '26.000'} [2024-08-05 23:24:41,005][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:24:41,289][52794] DAMAGECOUNT value on done: 37784.0 [2024-08-05 23:24:41,290][52794] Sum rewards: 32.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.632', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.446', 'ARMOR': '0.869', 'WEAPON3': '1.050', 'weapon2': '1.080', 'HITCOUNT': '2.030', 'weapon3': '2.166', 'DAMAGECOUNT': '8.553', 'FRAGCOUNT': '28.000'} [2024-08-05 23:24:41,461][52662] DAMAGECOUNT value on done: 39002.0 [2024-08-05 23:24:41,462][52662] Sum rewards: 28.723, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.664', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO3': '0.106', 'AMMO4': '0.121', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON3': '0.700', 'ARMOR': '0.854', 'weapon2': '1.196', 'weapon3': '1.812', 'HITCOUNT': '1.840', 'DAMAGECOUNT': '7.308', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:41,503][52650] Updated weights for policy 0, policy_version 14721 (0.0013) [2024-08-05 23:24:41,535][52649] DAMAGECOUNT value on done: 33170.0 [2024-08-05 23:24:41,536][52649] Sum rewards: 39.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.676', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.172', 'WEAPON3': '1.150', 'weapon2': '1.158', 'ARMOR': '1.702', 'HITCOUNT': '2.140', 'weapon3': '2.546', 'DAMAGECOUNT': '9.357', 'FRAGCOUNT': '32.000'} [2024-08-05 23:24:42,176][52668] DAMAGECOUNT value on done: 30155.0 [2024-08-05 23:24:42,177][52668] Sum rewards: 23.605, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.040', 'weapon5': '0.068', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.328', 'HEALTH': '0.440', 'WEAPON3': '0.750', 'weapon2': '1.300', 'HITCOUNT': '1.530', 'weapon3': '1.930', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '20.000'} [2024-08-05 23:24:42,477][52820] DAMAGECOUNT value on done: 28631.0 [2024-08-05 23:24:42,480][52820] Sum rewards: 23.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.247', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon4': '0.080', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'ARMOR': '0.872', 'WEAPON3': '1.150', 'weapon2': '1.456', 'HITCOUNT': '1.820', 'weapon3': '2.090', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '21.000'} [2024-08-05 23:24:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 120602624. Throughput: 0: 4373.3. Samples: 30160790. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-05 23:24:42,794][52567] Avg episode reward: [(0, '24.243')] [2024-08-05 23:24:42,868][52614] Saving new best policy, reward=24.243! [2024-08-05 23:24:44,042][52794] DAMAGECOUNT value on done: 33764.0 [2024-08-05 23:24:44,042][52794] Sum rewards: 20.917, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.539', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.334', 'ARMOR': '0.464', 'weapon2': '0.688', 'WEAPON3': '1.200', 'HITCOUNT': '1.650', 'weapon3': '2.734', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:44,175][52662] DAMAGECOUNT value on done: 40006.0 [2024-08-05 23:24:44,177][52662] Sum rewards: 28.956, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.452', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.107', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.270', 'ARMOR': '0.484', 'WEAPON3': '0.650', 'weapon2': '1.234', 'HITCOUNT': '1.830', 'weapon3': '1.934', 'DAMAGECOUNT': '7.008', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:44,181][52649] DAMAGECOUNT value on done: 33101.0 [2024-08-05 23:24:44,185][52649] Sum rewards: 20.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.658', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.020', 'WEAPON1': '0.020', 'ARMOR': '0.040', 'weapon5': '0.156', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.940', 'WEAPON3': '1.200', 'HITCOUNT': '1.640', 'weapon3': '1.910', 'DAMAGECOUNT': '7.626', 'FRAGCOUNT': '18.000'} [2024-08-05 23:24:45,401][52668] DAMAGECOUNT value on done: 33585.0 [2024-08-05 23:24:45,402][52668] Sum rewards: 29.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.791', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.181', 'weapon4': '0.260', 'WEAPON4': '0.350', 'ARMOR': '0.448', 'weapon2': '1.082', 'WEAPON3': '1.150', 'HITCOUNT': '2.190', 'weapon3': '2.376', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '25.500'} [2024-08-05 23:24:45,657][52660] DAMAGECOUNT value on done: 32800.0 [2024-08-05 23:24:45,660][52660] Sum rewards: 28.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.371', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.862', 'ARMOR': '0.954', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '2.222', 'DAMAGECOUNT': '8.550', 'FRAGCOUNT': '26.000'} [2024-08-05 23:24:45,705][52820] DAMAGECOUNT value on done: 28983.0 [2024-08-05 23:24:45,706][52820] Sum rewards: 16.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.524', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '1.150', 'WEAPON3': '1.550', 'HITCOUNT': '1.940', 'weapon3': '2.564', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '18.000'} [2024-08-05 23:24:46,547][52650] Updated weights for policy 0, policy_version 14731 (0.0021) [2024-08-05 23:24:46,964][52794] DAMAGECOUNT value on done: 37149.0 [2024-08-05 23:24:46,965][52794] Sum rewards: 29.063, reward structure: {'DEATHCOUNT': '-6.750', 'ARMOR': '0.032', 'AMMO2': '0.035', 'AMMO3': '0.097', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'weapon4': '0.306', 'HEALTH': '0.425', 'WEAPON3': '0.550', 'weapon2': '1.486', 'weapon3': '1.748', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '6.978', 'FRAGCOUNT': '22.000'} [2024-08-05 23:24:47,026][52649] DAMAGECOUNT value on done: 33795.0 [2024-08-05 23:24:47,026][52649] Sum rewards: 24.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.391', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.115', 'AMMO3': '0.129', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'ARMOR': '1.359', 'weapon2': '1.644', 'HITCOUNT': '1.750', 'weapon3': '2.022', 'DAMAGECOUNT': '7.005', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:47,047][52662] DAMAGECOUNT value on done: 34992.0 [2024-08-05 23:24:47,048][52662] Sum rewards: 18.727, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.029', 'AMMO3': '0.140', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'ARMOR': '0.478', 'WEAPON4': '0.550', 'weapon2': '0.570', 'weapon4': '0.852', 'WEAPON3': '1.050', 'HITCOUNT': '1.660', 'weapon3': '2.082', 'DAMAGECOUNT': '5.856', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 120700928. Throughput: 0: 4360.4. Samples: 30173410. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-05 23:24:47,795][52567] Avg episode reward: [(0, '24.141')] [2024-08-05 23:24:48,244][52668] DAMAGECOUNT value on done: 31814.0 [2024-08-05 23:24:48,252][52668] Sum rewards: 20.430, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.614', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO3': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'WEAPON3': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.708', 'weapon4': '0.820', 'weapon3': '1.272', 'HITCOUNT': '1.500', 'DAMAGECOUNT': '5.700', 'FRAGCOUNT': '15.000'} [2024-08-05 23:24:48,344][52660] DAMAGECOUNT value on done: 33312.0 [2024-08-05 23:24:48,345][52660] Sum rewards: 32.003, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.444', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.358', 'ARMOR': '0.509', 'WEAPON3': '0.750', 'weapon2': '1.322', 'weapon3': '1.794', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '7.020', 'FRAGCOUNT': '26.000'} [2024-08-05 23:24:48,823][52820] DAMAGECOUNT value on done: 29556.0 [2024-08-05 23:24:48,823][52820] Sum rewards: 22.923, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.195', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.054', 'AMMO4': '0.105', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.234', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.434', 'weapon3': '1.764', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '6.924', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:50,116][52794] DAMAGECOUNT value on done: 37991.0 [2024-08-05 23:24:50,117][52794] Sum rewards: 38.442, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.363', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'AMMO4': '0.153', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'weapon4': '0.444', 'WEAPON3': '0.900', 'weapon2': '1.192', 'weapon3': '2.116', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '31.000'} [2024-08-05 23:24:50,168][52662] DAMAGECOUNT value on done: 36031.0 [2024-08-05 23:24:50,170][52662] Sum rewards: 17.056, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.845', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON3': '0.750', 'weapon2': '1.294', 'HITCOUNT': '1.340', 'weapon3': '1.746', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:51,030][52668] DAMAGECOUNT value on done: 33227.0 [2024-08-05 23:24:51,030][52668] Sum rewards: 17.941, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.026', 'weapon4': '0.036', 'HEALTH': '0.080', 'AMMO3': '0.109', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.492', 'WEAPON3': '0.650', 'HITCOUNT': '1.400', 'weapon2': '1.538', 'weapon3': '1.776', 'DAMAGECOUNT': '4.893', 'FRAGCOUNT': '14.000'} [2024-08-05 23:24:51,146][52650] Updated weights for policy 0, policy_version 14741 (0.0017) [2024-08-05 23:24:51,187][52660] DAMAGECOUNT value on done: 32972.0 [2024-08-05 23:24:51,187][52660] Sum rewards: 21.196, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO3': '0.118', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'HITCOUNT': '1.580', 'weapon2': '1.784', 'weapon3': '1.848', 'DAMAGECOUNT': '5.556', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:51,895][52820] DAMAGECOUNT value on done: 30608.0 [2024-08-05 23:24:51,895][52820] Sum rewards: 25.322, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.914', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.154', 'ARMOR': '0.462', 'weapon4': '0.490', 'WEAPON3': '0.900', 'weapon2': '1.192', 'weapon3': '1.768', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '6.891', 'FRAGCOUNT': '20.500'} [2024-08-05 23:24:52,581][52794] DAMAGECOUNT value on done: 36980.0 [2024-08-05 23:24:52,582][52794] Sum rewards: 20.880, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.908', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon5': '0.066', 'AMMO3': '0.133', 'WEAPON3': '0.800', 'ARMOR': '1.350', 'weapon2': '1.618', 'HITCOUNT': '1.620', 'weapon3': '1.818', 'DAMAGECOUNT': '6.195', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:52,692][52662] DAMAGECOUNT value on done: 36651.0 [2024-08-05 23:24:52,694][52662] Sum rewards: 27.895, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.134', 'ARMOR': '0.447', 'WEAPON3': '0.850', 'weapon2': '1.472', 'weapon3': '1.790', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.683', 'FRAGCOUNT': '22.000'} [2024-08-05 23:24:52,794][52567] Fps is (10 sec: 18841.0, 60 sec: 17612.7, 300 sec: 17522.6). Total num frames: 120791040. Throughput: 0: 4363.8. Samples: 30199850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:24:52,795][52567] Avg episode reward: [(0, '24.211')] [2024-08-05 23:24:53,458][52668] DAMAGECOUNT value on done: 34806.0 [2024-08-05 23:24:53,458][52668] Sum rewards: 30.702, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.806', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.088', 'AMMO3': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.204', 'WEAPON3': '0.650', 'ARMOR': '0.882', 'weapon2': '1.466', 'weapon3': '1.704', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '6.669', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:53,698][52660] DAMAGECOUNT value on done: 32240.0 [2024-08-05 23:24:53,699][52660] Sum rewards: 29.909, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.102', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'WEAPON4': '0.050', 'AMMO3': '0.143', 'ARMOR': '0.907', 'WEAPON3': '1.050', 'weapon2': '1.688', 'HITCOUNT': '1.980', 'weapon3': '2.160', 'DAMAGECOUNT': '7.314', 'FRAGCOUNT': '25.000'} [2024-08-05 23:24:55,061][52820] DAMAGECOUNT value on done: 29208.0 [2024-08-05 23:24:55,062][52820] Sum rewards: 27.928, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.096', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.113', 'WEAPON3': '0.800', 'ARMOR': '0.900', 'HITCOUNT': '1.770', 'weapon2': '1.828', 'weapon3': '1.944', 'DAMAGECOUNT': '6.192', 'FRAGCOUNT': '23.000'} [2024-08-05 23:24:55,568][52650] Updated weights for policy 0, policy_version 14751 (0.0022) [2024-08-05 23:24:55,728][52794] DAMAGECOUNT value on done: 38012.0 [2024-08-05 23:24:55,729][52794] Sum rewards: 22.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.014', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.029', 'AMMO3': '0.130', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.226', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.900', 'weapon2': '1.450', 'HITCOUNT': '1.740', 'weapon3': '1.914', 'DAMAGECOUNT': '7.245', 'FRAGCOUNT': '19.000'} [2024-08-05 23:24:55,773][52662] DAMAGECOUNT value on done: 35391.0 [2024-08-05 23:24:55,774][52662] Sum rewards: 20.632, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.708', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.060', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'WEAPON4': '0.400', 'weapon4': '0.566', 'WEAPON3': '0.650', 'ARMOR': '0.963', 'weapon2': '1.250', 'HITCOUNT': '1.500', 'weapon3': '1.848', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '16.000'} [2024-08-05 23:24:56,645][52668] DAMAGECOUNT value on done: 34239.0 [2024-08-05 23:24:56,645][52668] Sum rewards: 36.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO2': '0.043', 'weapon5': '0.068', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'weapon2': '0.432', 'WEAPON4': '0.600', 'weapon4': '0.810', 'WEAPON3': '0.850', 'weapon3': '2.090', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.952', 'FRAGCOUNT': '31.000'} [2024-08-05 23:24:56,897][52660] DAMAGECOUNT value on done: 28363.0 [2024-08-05 23:24:56,898][52660] Sum rewards: 31.388, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.499', 'AMMO2': '0.007', 'AMMO5': '0.008', 'AMMO4': '0.032', 'weapon5': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'ARMOR': '0.856', 'WEAPON3': '0.950', 'weapon2': '1.528', 'HITCOUNT': '2.090', 'weapon3': '2.122', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '27.500'} [2024-08-05 23:24:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 120872960. Throughput: 0: 4357.8. Samples: 30226080. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:24:57,794][52567] Avg episode reward: [(0, '24.741')] [2024-08-05 23:24:57,797][52614] Saving new best policy, reward=24.741! [2024-08-05 23:24:58,241][52820] DAMAGECOUNT value on done: 32533.0 [2024-08-05 23:24:58,244][52820] Sum rewards: 27.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO3': '0.194', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'ARMOR': '0.940', 'WEAPON3': '1.150', 'weapon2': '1.338', 'HITCOUNT': '1.830', 'weapon3': '2.134', 'DAMAGECOUNT': '7.299', 'FRAGCOUNT': '26.000'} [2024-08-05 23:24:59,071][52794] DAMAGECOUNT value on done: 36049.0 [2024-08-05 23:24:59,072][52794] Sum rewards: 22.559, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.199', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.196', 'WEAPON3': '0.850', 'weapon2': '1.474', 'HITCOUNT': '1.720', 'ARMOR': '1.738', 'weapon3': '2.100', 'DAMAGECOUNT': '5.910', 'FRAGCOUNT': '17.000'} [2024-08-05 23:24:59,205][52662] DAMAGECOUNT value on done: 37773.0 [2024-08-05 23:24:59,205][52662] Sum rewards: 19.346, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.060', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.366', 'WEAPON3': '0.650', 'weapon2': '1.040', 'HITCOUNT': '1.700', 'weapon3': '1.928', 'DAMAGECOUNT': '5.640', 'FRAGCOUNT': '16.000'} [2024-08-05 23:24:59,531][52668] DAMAGECOUNT value on done: 31027.0 [2024-08-05 23:24:59,531][52668] Sum rewards: 30.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'WEAPON3': '0.950', 'weapon2': '1.420', 'HITCOUNT': '2.000', 'weapon3': '2.302', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '26.000'} [2024-08-05 23:24:59,725][52660] DAMAGECOUNT value on done: 32502.0 [2024-08-05 23:24:59,726][52660] Sum rewards: 11.003, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.028', 'AMMO5': '0.005', 'AMMO2': '0.028', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.290', 'weapon2': '0.896', 'WEAPON3': '1.100', 'HITCOUNT': '1.440', 'weapon3': '2.488', 'DAMAGECOUNT': '5.436', 'FRAGCOUNT': '11.000'} [2024-08-05 23:25:00,492][52650] Updated weights for policy 0, policy_version 14761 (0.0013) [2024-08-05 23:25:01,468][52820] DAMAGECOUNT value on done: 33150.0 [2024-08-05 23:25:01,468][52820] Sum rewards: 30.107, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.490', 'AMMO2': '0.003', 'AMMO5': '0.010', 'AMMO4': '0.015', 'AMMO3': '0.109', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.476', 'WEAPON3': '0.850', 'weapon2': '1.022', 'weapon3': '1.948', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.274', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:02,127][52662] DAMAGECOUNT value on done: 36442.0 [2024-08-05 23:25:02,128][52662] Sum rewards: 30.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.029', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '1.016', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.730', 'DAMAGECOUNT': '9.477', 'FRAGCOUNT': '26.000'} [2024-08-05 23:25:02,144][52794] DAMAGECOUNT value on done: 40183.0 [2024-08-05 23:25:02,146][52794] Sum rewards: 23.001, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.434', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'weapon5': '0.024', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.528', 'HITCOUNT': '1.680', 'weapon3': '1.984', 'DAMAGECOUNT': '6.750', 'FRAGCOUNT': '19.000'} [2024-08-05 23:25:02,419][52668] DAMAGECOUNT value on done: 35327.0 [2024-08-05 23:25:02,423][52668] Sum rewards: 32.713, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.143', 'HEALTH': '0.256', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.498', 'HITCOUNT': '2.150', 'weapon3': '2.384', 'DAMAGECOUNT': '8.049', 'FRAGCOUNT': '27.000'} [2024-08-05 23:25:02,636][52660] DAMAGECOUNT value on done: 32110.0 [2024-08-05 23:25:02,637][52660] Sum rewards: 33.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO3': '0.207', 'weapon4': '0.282', 'ARMOR': '0.440', 'WEAPON4': '0.500', 'weapon2': '1.174', 'WEAPON3': '1.200', 'weapon3': '2.234', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.240', 'FRAGCOUNT': '29.000'} [2024-08-05 23:25:02,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 120954880. Throughput: 0: 4352.5. Samples: 30238990. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:25:02,794][52567] Avg episode reward: [(0, '25.010')] [2024-08-05 23:25:02,795][52614] Saving new best policy, reward=25.010! [2024-08-05 23:25:04,837][52820] DAMAGECOUNT value on done: 30570.0 [2024-08-05 23:25:04,838][52820] Sum rewards: 26.385, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.404', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.474', 'WEAPON3': '0.700', 'ARMOR': '0.924', 'weapon2': '1.316', 'HITCOUNT': '1.830', 'weapon3': '1.956', 'DAMAGECOUNT': '6.615', 'FRAGCOUNT': '20.000'} [2024-08-05 23:25:05,367][52650] Updated weights for policy 0, policy_version 14771 (0.0045) [2024-08-05 23:25:05,396][52668] DAMAGECOUNT value on done: 31528.0 [2024-08-05 23:25:05,397][52668] Sum rewards: 34.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.592', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.172', 'WEAPON3': '1.100', 'ARMOR': '1.301', 'weapon2': '1.356', 'HITCOUNT': '2.080', 'weapon3': '2.310', 'DAMAGECOUNT': '8.022', 'FRAGCOUNT': '30.000'} [2024-08-05 23:25:05,503][52794] DAMAGECOUNT value on done: 34995.0 [2024-08-05 23:25:05,503][52794] Sum rewards: 16.994, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.134', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'ARMOR': '1.200', 'HITCOUNT': '1.470', 'weapon2': '1.602', 'weapon3': '1.602', 'DAMAGECOUNT': '5.238', 'FRAGCOUNT': '14.000'} [2024-08-05 23:25:05,514][52662] DAMAGECOUNT value on done: 37605.0 [2024-08-05 23:25:05,515][52662] Sum rewards: 12.764, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.015', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.026', 'weapon4': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.200', 'ARMOR': '0.821', 'WEAPON3': '0.900', 'HITCOUNT': '1.250', 'weapon3': '1.744', 'weapon2': '1.918', 'DAMAGECOUNT': '4.377', 'FRAGCOUNT': '14.000'} [2024-08-05 23:25:05,555][52660] DAMAGECOUNT value on done: 32450.0 [2024-08-05 23:25:05,557][52660] Sum rewards: 21.754, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.486', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'weapon4': '0.554', 'WEAPON3': '0.850', 'weapon2': '0.882', 'HITCOUNT': '1.710', 'weapon3': '1.924', 'DAMAGECOUNT': '5.895', 'FRAGCOUNT': '19.000'} [2024-08-05 23:25:06,345][52614] Signal inference workers to stop experience collection... (2750 times) [2024-08-05 23:25:06,346][52614] Signal inference workers to resume experience collection... (2750 times) [2024-08-05 23:25:06,425][52650] InferenceWorker_p0-w0: stopping experience collection (2750 times) [2024-08-05 23:25:06,435][52650] InferenceWorker_p0-w0: resuming experience collection (2750 times) [2024-08-05 23:25:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 121044992. Throughput: 0: 4347.1. Samples: 30265230. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:25:07,794][52567] Avg episode reward: [(0, '25.029')] [2024-08-05 23:25:07,797][52614] Saving new best policy, reward=25.029! [2024-08-05 23:25:07,943][52668] DAMAGECOUNT value on done: 31734.0 [2024-08-05 23:25:07,944][52668] Sum rewards: 26.697, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.371', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.096', 'weapon4': '0.222', 'ARMOR': '0.412', 'WEAPON3': '0.650', 'weapon2': '1.366', 'HITCOUNT': '1.640', 'weapon3': '2.054', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '20.000'} [2024-08-05 23:25:08,253][52660] DAMAGECOUNT value on done: 31723.0 [2024-08-05 23:25:08,255][52660] Sum rewards: 19.169, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.094', 'AMMO5': '0.009', 'weapon7': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.110', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.202', 'ARMOR': '0.860', 'WEAPON3': '0.900', 'weapon2': '1.444', 'HITCOUNT': '1.470', 'weapon3': '1.976', 'DAMAGECOUNT': '5.835', 'FRAGCOUNT': '17.000'} [2024-08-05 23:25:08,370][52662] DAMAGECOUNT value on done: 38783.0 [2024-08-05 23:25:08,372][52662] Sum rewards: 14.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.484', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'ARMOR': '0.076', 'AMMO3': '0.135', 'AMMO4': '0.197', 'WEAPON4': '0.500', 'weapon4': '0.502', 'WEAPON3': '0.900', 'weapon2': '0.990', 'HITCOUNT': '1.480', 'weapon3': '2.266', 'DAMAGECOUNT': '5.796', 'FRAGCOUNT': '14.000'} [2024-08-05 23:25:08,388][52794] DAMAGECOUNT value on done: 38446.0 [2024-08-05 23:25:08,389][52794] Sum rewards: 34.337, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'HEALTH': '0.167', 'ARMOR': '0.851', 'WEAPON3': '0.950', 'weapon2': '1.108', 'HITCOUNT': '2.100', 'weapon3': '2.256', 'DAMAGECOUNT': '8.229', 'FRAGCOUNT': '28.000'} [2024-08-05 23:25:09,855][52650] Updated weights for policy 0, policy_version 14781 (0.0013) [2024-08-05 23:25:10,659][52668] DAMAGECOUNT value on done: 31595.0 [2024-08-05 23:25:10,661][52668] Sum rewards: 36.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.094', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.392', 'ARMOR': '0.828', 'WEAPON3': '1.050', 'weapon2': '1.130', 'weapon3': '2.196', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '8.742', 'FRAGCOUNT': '30.000'} [2024-08-05 23:25:10,849][52660] DAMAGECOUNT value on done: 32582.0 [2024-08-05 23:25:10,851][52660] Sum rewards: 27.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.638', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.143', 'WEAPON3': '0.950', 'ARMOR': '1.299', 'weapon2': '1.546', 'HITCOUNT': '2.090', 'weapon3': '2.316', 'DAMAGECOUNT': '7.665', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:10,984][52662] DAMAGECOUNT value on done: 36663.0 [2024-08-05 23:25:10,987][52662] Sum rewards: 25.936, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'ARMOR': '0.854', 'WEAPON3': '1.050', 'weapon2': '1.292', 'HITCOUNT': '1.700', 'weapon3': '2.256', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:11,040][52794] DAMAGECOUNT value on done: 38691.0 [2024-08-05 23:25:11,042][52794] Sum rewards: 26.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.453', 'AMMO5': '0.005', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'AMMO4': '0.249', 'weapon4': '0.324', 'WEAPON4': '0.550', 'ARMOR': '0.930', 'weapon2': '0.930', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '2.516', 'DAMAGECOUNT': '8.487', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 121135104. Throughput: 0: 4344.2. Samples: 30291190. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:25:12,794][52567] Avg episode reward: [(0, '25.374')] [2024-08-05 23:25:12,860][52614] Saving new best policy, reward=25.374! [2024-08-05 23:25:13,708][52668] DAMAGECOUNT value on done: 31754.0 [2024-08-05 23:25:13,708][52668] Sum rewards: 28.915, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.257', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO4': '0.175', 'ARMOR': '0.483', 'WEAPON3': '0.750', 'weapon2': '1.508', 'weapon3': '2.082', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.226', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:14,009][52660] DAMAGECOUNT value on done: 32801.0 [2024-08-05 23:25:14,009][52660] Sum rewards: 21.520, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.317', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.021', 'AMMO3': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'weapon4': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.056', 'ARMOR': '1.306', 'HITCOUNT': '1.710', 'weapon3': '2.046', 'DAMAGECOUNT': '6.366', 'FRAGCOUNT': '16.000'} [2024-08-05 23:25:14,162][52794] DAMAGECOUNT value on done: 37717.0 [2024-08-05 23:25:14,162][52794] Sum rewards: 26.571, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.883', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.078', 'AMMO3': '0.133', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.548', 'WEAPON3': '0.850', 'ARMOR': '0.947', 'weapon2': '1.012', 'weapon3': '1.668', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.741', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:14,218][52662] DAMAGECOUNT value on done: 38253.0 [2024-08-05 23:25:14,218][52662] Sum rewards: 26.108, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.774', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.022', 'AMMO3': '0.082', 'weapon5': '0.124', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'ARMOR': '0.854', 'HITCOUNT': '1.500', 'weapon3': '1.778', 'weapon2': '1.874', 'DAMAGECOUNT': '6.285', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:15,043][52650] Updated weights for policy 0, policy_version 14791 (0.0026) [2024-08-05 23:25:16,350][52668] DAMAGECOUNT value on done: 31030.0 [2024-08-05 23:25:16,350][52668] Sum rewards: 26.444, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.893', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'weapon4': '0.660', 'weapon2': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '1.880', 'weapon3': '2.006', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:16,619][52660] DAMAGECOUNT value on done: 32464.0 [2024-08-05 23:25:16,619][52660] Sum rewards: 23.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.173', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.052', 'AMMO4': '0.187', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon4': '0.304', 'ARMOR': '0.503', 'WEAPON4': '0.550', 'weapon2': '0.748', 'WEAPON3': '1.300', 'HITCOUNT': '1.600', 'weapon3': '2.584', 'DAMAGECOUNT': '6.546', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:17,368][52662] DAMAGECOUNT value on done: 35223.0 [2024-08-05 23:25:17,369][52662] Sum rewards: 23.558, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.792', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.314', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.164', 'HITCOUNT': '1.510', 'weapon3': '2.100', 'DAMAGECOUNT': '5.874', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:17,417][52794] DAMAGECOUNT value on done: 37246.0 [2024-08-05 23:25:17,418][52794] Sum rewards: 25.867, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.110', 'AMMO3': '0.122', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.318', 'weapon4': '0.420', 'ARMOR': '0.444', 'WEAPON3': '0.750', 'weapon2': '1.230', 'HITCOUNT': '1.640', 'weapon3': '1.940', 'DAMAGECOUNT': '6.978', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:17,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 121208832. Throughput: 0: 4346.2. Samples: 30303950. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-05 23:25:17,795][52567] Avg episode reward: [(0, '25.421')] [2024-08-05 23:25:17,812][52614] Saving new best policy, reward=25.421! [2024-08-05 23:25:19,042][52650] Updated weights for policy 0, policy_version 14801 (0.0012) [2024-08-05 23:25:19,125][52668] DAMAGECOUNT value on done: 32394.0 [2024-08-05 23:25:19,126][52668] Sum rewards: 22.356, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.404', 'AMMO2': '0.010', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO4': '0.049', 'weapon4': '0.132', 'AMMO3': '0.140', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.499', 'WEAPON3': '0.950', 'weapon2': '1.378', 'HITCOUNT': '1.700', 'weapon3': '2.196', 'DAMAGECOUNT': '6.429', 'FRAGCOUNT': '18.000'} [2024-08-05 23:25:19,138][52664] DAMAGECOUNT value on done: 32513.0 [2024-08-05 23:25:19,139][52664] Sum rewards: 22.262, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.588', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.316', 'WEAPON3': '1.050', 'weapon2': '1.312', 'ARMOR': '1.335', 'HITCOUNT': '1.630', 'weapon3': '2.138', 'DAMAGECOUNT': '5.505', 'FRAGCOUNT': '19.000'} [2024-08-05 23:25:19,587][52660] DAMAGECOUNT value on done: 31824.0 [2024-08-05 23:25:19,587][52660] Sum rewards: 26.634, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.706', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.096', 'AMMO3': '0.127', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.900', 'ARMOR': '0.909', 'weapon2': '1.206', 'HITCOUNT': '1.840', 'weapon3': '1.964', 'DAMAGECOUNT': '7.086', 'FRAGCOUNT': '21.500'} [2024-08-05 23:25:19,877][52662] DAMAGECOUNT value on done: 36089.0 [2024-08-05 23:25:19,877][52662] Sum rewards: 25.763, reward structure: {'DEATHCOUNT': '-13.500', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.190', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'HEALTH': '0.682', 'WEAPON3': '1.000', 'weapon2': '1.064', 'ARMOR': '1.208', 'HITCOUNT': '1.640', 'weapon3': '2.482', 'DAMAGECOUNT': '6.093', 'FRAGCOUNT': '24.000'} [2024-08-05 23:25:19,940][52794] DAMAGECOUNT value on done: 37066.0 [2024-08-05 23:25:19,941][52794] Sum rewards: 27.073, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.306', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.052', 'ARMOR': '0.059', 'AMMO4': '0.075', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon3': '1.628', 'HITCOUNT': '1.740', 'weapon2': '1.820', 'DAMAGECOUNT': '6.441', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:21,797][52664] DAMAGECOUNT value on done: 31858.0 [2024-08-05 23:25:21,797][52664] Sum rewards: 24.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.011', 'weapon5': '0.040', 'AMMO2': '0.042', 'AMMO3': '0.161', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.324', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.730', 'WEAPON3': '1.150', 'HITCOUNT': '1.900', 'weapon3': '2.572', 'DAMAGECOUNT': '7.425', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:21,854][52668] DAMAGECOUNT value on done: 31607.0 [2024-08-05 23:25:21,856][52668] Sum rewards: 21.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.672', 'AMMO5': '0.005', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.254', 'ARMOR': '0.468', 'weapon2': '0.592', 'weapon4': '0.608', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'HITCOUNT': '2.050', 'weapon3': '2.280', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:22,265][52660] DAMAGECOUNT value on done: 32096.0 [2024-08-05 23:25:22,266][52660] Sum rewards: 29.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.546', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.123', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.112', 'HITCOUNT': '1.780', 'weapon3': '2.280', 'DAMAGECOUNT': '7.566', 'FRAGCOUNT': '26.000'} [2024-08-05 23:25:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 121307136. Throughput: 0: 4348.0. Samples: 30330110. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-05 23:25:22,795][52567] Avg episode reward: [(0, '25.465')] [2024-08-05 23:25:22,795][52614] Saving new best policy, reward=25.465! [2024-08-05 23:25:24,191][52668] DAMAGECOUNT value on done: 31689.0 [2024-08-05 23:25:24,193][52668] Sum rewards: 24.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.036', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.061', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'ARMOR': '0.447', 'weapon2': '1.044', 'WEAPON3': '1.400', 'HITCOUNT': '1.990', 'weapon3': '2.576', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '24.500'} [2024-08-05 23:25:24,490][52650] Updated weights for policy 0, policy_version 14811 (0.0019) [2024-08-05 23:25:24,717][52660] DAMAGECOUNT value on done: 35191.0 [2024-08-05 23:25:24,718][52660] Sum rewards: 37.607, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.858', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.133', 'AMMO4': '0.157', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '0.800', 'weapon2': '1.354', 'weapon3': '1.834', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.684', 'FRAGCOUNT': '31.000'} [2024-08-05 23:25:24,777][52803] DAMAGECOUNT value on done: 31175.0 [2024-08-05 23:25:24,778][52803] Sum rewards: 18.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.238', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.018', 'weapon4': '0.022', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'ARMOR': '0.855', 'WEAPON3': '1.000', 'HITCOUNT': '1.620', 'weapon2': '1.646', 'weapon3': '1.980', 'DAMAGECOUNT': '5.847', 'FRAGCOUNT': '18.000'} [2024-08-05 23:25:25,030][52664] DAMAGECOUNT value on done: 35333.0 [2024-08-05 23:25:25,030][52664] Sum rewards: 23.926, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.494', 'AMMO5': '0.007', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO2': '0.051', 'AMMO3': '0.161', 'AMMO4': '0.257', 'weapon4': '0.316', 'ARMOR': '0.499', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.454', 'weapon3': '1.710', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '7.386', 'FRAGCOUNT': '20.000'} [2024-08-05 23:25:27,441][52668] DAMAGECOUNT value on done: 32787.0 [2024-08-05 23:25:27,442][52668] Sum rewards: 25.564, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.040', 'weapon5': '0.068', 'AMMO4': '0.079', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.056', 'HITCOUNT': '1.570', 'weapon3': '1.602', 'DAMAGECOUNT': '7.608', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:27,704][52664] DAMAGECOUNT value on done: 33655.0 [2024-08-05 23:25:27,704][52664] Sum rewards: 22.738, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.734', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.075', 'AMMO3': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.350', 'ARMOR': '0.424', 'WEAPON3': '0.700', 'weapon2': '0.728', 'weapon4': '0.804', 'weapon3': '1.432', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '6.627', 'FRAGCOUNT': '18.000'} [2024-08-05 23:25:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 121389056. Throughput: 0: 4344.0. Samples: 30356270. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 23:25:27,795][52567] Avg episode reward: [(0, '25.353')] [2024-08-05 23:25:27,858][52660] DAMAGECOUNT value on done: 32692.0 [2024-08-05 23:25:27,871][52660] Sum rewards: 26.671, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.342', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.142', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.420', 'ARMOR': '0.883', 'WEAPON3': '0.900', 'weapon2': '1.284', 'HITCOUNT': '1.540', 'weapon3': '1.878', 'DAMAGECOUNT': '6.375', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:27,913][52803] DAMAGECOUNT value on done: 33548.0 [2024-08-05 23:25:27,915][52803] Sum rewards: 18.961, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.090', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.165', 'weapon4': '0.228', 'WEAPON4': '0.300', 'ARMOR': '0.495', 'weapon2': '0.834', 'WEAPON3': '0.900', 'HITCOUNT': '1.400', 'weapon3': '2.628', 'DAMAGECOUNT': '5.361', 'FRAGCOUNT': '17.000'} [2024-08-05 23:25:28,915][52650] Updated weights for policy 0, policy_version 14821 (0.0042) [2024-08-05 23:25:30,251][52668] DAMAGECOUNT value on done: 34900.0 [2024-08-05 23:25:30,253][52668] Sum rewards: 32.583, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.182', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.140', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.000', 'weapon2': '1.498', 'weapon3': '1.778', 'ARMOR': '1.812', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.243', 'FRAGCOUNT': '26.000'} [2024-08-05 23:25:30,624][52660] DAMAGECOUNT value on done: 33974.0 [2024-08-05 23:25:30,625][52660] Sum rewards: 20.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.818', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.400', 'weapon4': '0.466', 'ARMOR': '0.487', 'WEAPON3': '0.850', 'weapon2': '1.164', 'HITCOUNT': '1.820', 'weapon3': '1.864', 'DAMAGECOUNT': '6.864', 'FRAGCOUNT': '18.000'} [2024-08-05 23:25:30,851][52664] DAMAGECOUNT value on done: 32213.0 [2024-08-05 23:25:30,852][52664] Sum rewards: 32.198, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.032', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon4': '0.188', 'WEAPON3': '0.800', 'weapon2': '1.238', 'HITCOUNT': '2.330', 'weapon3': '2.348', 'DAMAGECOUNT': '8.913', 'FRAGCOUNT': '25.000'} [2024-08-05 23:25:31,037][52803] DAMAGECOUNT value on done: 29666.0 [2024-08-05 23:25:31,037][52803] Sum rewards: 36.911, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.000', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.103', 'AMMO4': '0.118', 'weapon4': '0.454', 'WEAPON3': '0.750', 'ARMOR': '0.844', 'weapon2': '1.532', 'weapon3': '1.818', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '29.000'} [2024-08-05 23:25:31,552][52811] DAMAGECOUNT value on done: 32047.0 [2024-08-05 23:25:31,553][52811] Sum rewards: 29.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.879', 'AMMO5': '0.003', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.160', 'AMMO4': '0.203', 'weapon4': '0.252', 'WEAPON4': '0.300', 'ARMOR': '0.828', 'WEAPON3': '1.000', 'weapon2': '1.198', 'weapon3': '1.926', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '8.307', 'FRAGCOUNT': '26.000'} [2024-08-05 23:25:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 121479168. Throughput: 0: 4355.8. Samples: 30369420. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-05 23:25:32,794][52567] Avg episode reward: [(0, '25.558')] [2024-08-05 23:25:32,795][52614] Saving new best policy, reward=25.558! [2024-08-05 23:25:33,565][52664] DAMAGECOUNT value on done: 36086.0 [2024-08-05 23:25:33,566][52664] Sum rewards: 33.323, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.958', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.007', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.350', 'ARMOR': '0.856', 'WEAPON3': '1.050', 'weapon2': '1.182', 'HITCOUNT': '1.820', 'weapon3': '2.094', 'DAMAGECOUNT': '7.749', 'FRAGCOUNT': '28.000'} [2024-08-05 23:25:33,669][52660] DAMAGECOUNT value on done: 33546.0 [2024-08-05 23:25:33,671][52660] Sum rewards: 34.274, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.098', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO4': '0.113', 'AMMO3': '0.181', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.858', 'weapon2': '0.972', 'WEAPON3': '1.200', 'HITCOUNT': '1.930', 'weapon3': '2.448', 'DAMAGECOUNT': '8.940', 'FRAGCOUNT': '30.000'} [2024-08-05 23:25:33,698][52650] Updated weights for policy 0, policy_version 14831 (0.0045) [2024-08-05 23:25:33,965][52669] DAMAGECOUNT value on done: 33367.0 [2024-08-05 23:25:33,968][52669] Sum rewards: 22.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.848', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'ARMOR': '0.466', 'WEAPON3': '1.050', 'weapon2': '1.708', 'HITCOUNT': '1.840', 'weapon3': '2.122', 'DAMAGECOUNT': '7.077', 'FRAGCOUNT': '20.000'} [2024-08-05 23:25:34,429][52803] DAMAGECOUNT value on done: 30007.0 [2024-08-05 23:25:34,429][52803] Sum rewards: 22.003, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.185', 'WEAPON4': '0.450', 'ARMOR': '0.459', 'weapon2': '0.540', 'weapon4': '0.718', 'WEAPON3': '1.200', 'HITCOUNT': '1.870', 'weapon3': '2.318', 'DAMAGECOUNT': '7.197', 'FRAGCOUNT': '20.000'} [2024-08-05 23:25:34,677][52811] DAMAGECOUNT value on done: 30226.0 [2024-08-05 23:25:34,679][52811] Sum rewards: 33.604, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.904', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.121', 'WEAPON4': '0.400', 'weapon4': '0.444', 'ARMOR': '0.904', 'WEAPON3': '0.950', 'weapon2': '1.200', 'HITCOUNT': '2.160', 'weapon3': '2.186', 'DAMAGECOUNT': '7.572', 'FRAGCOUNT': '27.000'} [2024-08-05 23:25:36,033][52664] DAMAGECOUNT value on done: 33744.0 [2024-08-05 23:25:36,035][52664] Sum rewards: 24.218, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-0.649', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.076', 'ARMOR': '0.463', 'WEAPON3': '0.550', 'HITCOUNT': '1.290', 'weapon3': '1.534', 'weapon2': '1.968', 'DAMAGECOUNT': '5.367', 'FRAGCOUNT': '18.000'} [2024-08-05 23:25:36,822][52660] DAMAGECOUNT value on done: 33120.0 [2024-08-05 23:25:36,824][52660] Sum rewards: 29.156, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.332', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.058', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'ARMOR': '0.452', 'WEAPON3': '0.800', 'weapon2': '1.570', 'HITCOUNT': '1.620', 'weapon3': '2.220', 'DAMAGECOUNT': '6.870', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:37,136][52669] DAMAGECOUNT value on done: 33455.0 [2024-08-05 23:25:37,136][52669] Sum rewards: 30.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.916', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.131', 'weapon4': '0.140', 'WEAPON4': '0.350', 'ARMOR': '0.875', 'WEAPON3': '0.900', 'weapon2': '1.662', 'weapon3': '1.982', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '7.842', 'FRAGCOUNT': '27.000'} [2024-08-05 23:25:37,515][52803] DAMAGECOUNT value on done: 34052.0 [2024-08-05 23:25:37,515][52803] Sum rewards: 37.168, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.145', 'AMMO2': '0.010', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.047', 'weapon5': '0.076', 'AMMO3': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.552', 'weapon2': '0.844', 'WEAPON3': '0.900', 'weapon3': '2.264', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.730', 'FRAGCOUNT': '31.000'} [2024-08-05 23:25:37,770][52811] DAMAGECOUNT value on done: 33124.0 [2024-08-05 23:25:37,770][52811] Sum rewards: 22.227, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'ARMOR': '0.444', 'weapon4': '0.492', 'WEAPON3': '0.800', 'weapon2': '1.268', 'weapon3': '1.648', 'HITCOUNT': '1.730', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '17.000'} [2024-08-05 23:25:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 121569280. Throughput: 0: 4344.5. Samples: 30395350. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 23:25:37,795][52567] Avg episode reward: [(0, '26.109')] [2024-08-05 23:25:37,798][52614] Saving new best policy, reward=26.109! [2024-08-05 23:25:38,219][52650] Updated weights for policy 0, policy_version 14841 (0.0026) [2024-08-05 23:25:38,796][52664] DAMAGECOUNT value on done: 30738.0 [2024-08-05 23:25:38,796][52664] Sum rewards: 24.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.072', 'AMMO3': '0.179', 'weapon4': '0.236', 'WEAPON3': '1.100', 'weapon2': '1.114', 'ARMOR': '1.236', 'HITCOUNT': '1.840', 'weapon3': '2.408', 'DAMAGECOUNT': '7.335', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:39,550][52660] DAMAGECOUNT value on done: 31791.0 [2024-08-05 23:25:39,550][52660] Sum rewards: 30.108, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'AMMO4': '0.216', 'weapon4': '0.348', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'HEALTH': '0.480', 'WEAPON3': '0.650', 'weapon2': '1.352', 'HITCOUNT': '1.780', 'weapon3': '2.054', 'DAMAGECOUNT': '6.960', 'FRAGCOUNT': '25.000'} [2024-08-05 23:25:39,741][52669] DAMAGECOUNT value on done: 32217.0 [2024-08-05 23:25:39,742][52669] Sum rewards: 16.030, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.262', 'AMMO2': '0.018', 'weapon4': '0.062', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'ARMOR': '0.886', 'WEAPON3': '0.950', 'HITCOUNT': '1.420', 'weapon2': '1.616', 'weapon3': '2.020', 'DAMAGECOUNT': '5.235', 'FRAGCOUNT': '13.000'} [2024-08-05 23:25:40,756][52803] DAMAGECOUNT value on done: 28917.0 [2024-08-05 23:25:40,756][52803] Sum rewards: 20.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.455', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.056', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'ARMOR': '0.861', 'WEAPON3': '1.100', 'weapon2': '1.612', 'HITCOUNT': '1.760', 'weapon3': '1.956', 'DAMAGECOUNT': '6.750', 'FRAGCOUNT': '18.000'} [2024-08-05 23:25:40,779][52811] DAMAGECOUNT value on done: 30931.0 [2024-08-05 23:25:40,779][52811] Sum rewards: 28.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.183', 'WEAPON3': '1.200', 'ARMOR': '1.301', 'weapon2': '1.302', 'HITCOUNT': '1.830', 'weapon3': '2.444', 'DAMAGECOUNT': '7.779', 'FRAGCOUNT': '25.000'} [2024-08-05 23:25:41,921][52664] DAMAGECOUNT value on done: 37372.0 [2024-08-05 23:25:41,921][52664] Sum rewards: 26.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.679', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.172', 'weapon4': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'WEAPON3': '0.900', 'weapon2': '1.228', 'HITCOUNT': '1.740', 'weapon3': '2.156', 'DAMAGECOUNT': '6.975', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:42,726][52669] DAMAGECOUNT value on done: 33156.0 [2024-08-05 23:25:42,728][52669] Sum rewards: 15.542, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.124', 'weapon5': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.101', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.530', 'HITCOUNT': '1.620', 'weapon3': '2.106', 'DAMAGECOUNT': '5.544', 'FRAGCOUNT': '14.000'} [2024-08-05 23:25:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 121651200. Throughput: 0: 4345.1. Samples: 30421610. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 23:25:42,794][52567] Avg episode reward: [(0, '25.968')] [2024-08-05 23:25:43,325][52650] Updated weights for policy 0, policy_version 14851 (0.0015) [2024-08-05 23:25:43,895][52811] DAMAGECOUNT value on done: 30509.0 [2024-08-05 23:25:43,898][52811] Sum rewards: 21.661, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'weapon5': '0.036', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'HEALTH': '0.092', 'AMMO3': '0.113', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.440', 'WEAPON3': '0.700', 'ARMOR': '0.891', 'weapon2': '1.266', 'HITCOUNT': '1.450', 'weapon3': '1.770', 'DAMAGECOUNT': '5.565', 'FRAGCOUNT': '17.000'} [2024-08-05 23:25:43,906][52803] DAMAGECOUNT value on done: 34903.0 [2024-08-05 23:25:43,907][52803] Sum rewards: 30.714, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.968', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.360', 'WEAPON3': '1.150', 'weapon2': '1.450', 'HITCOUNT': '1.850', 'weapon3': '2.002', 'ARMOR': '2.160', 'DAMAGECOUNT': '7.962', 'FRAGCOUNT': '27.000'} [2024-08-05 23:25:43,930][52665] DAMAGECOUNT value on done: 31515.0 [2024-08-05 23:25:43,931][52665] Sum rewards: 30.166, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.860', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.308', 'DAMAGECOUNT': '9.117', 'FRAGCOUNT': '25.000'} [2024-08-05 23:25:44,792][52664] DAMAGECOUNT value on done: 33886.0 [2024-08-05 23:25:44,792][52664] Sum rewards: 27.257, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.775', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.153', 'ARMOR': '0.454', 'WEAPON3': '1.100', 'weapon2': '1.428', 'HITCOUNT': '1.850', 'weapon3': '2.430', 'DAMAGECOUNT': '7.557', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:45,463][52669] DAMAGECOUNT value on done: 34004.0 [2024-08-05 23:25:45,463][52669] Sum rewards: 19.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.618', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.119', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '1.126', 'ARMOR': '1.346', 'WEAPON3': '1.400', 'HITCOUNT': '1.770', 'weapon3': '2.366', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '20.000'} [2024-08-05 23:25:46,359][52667] DAMAGECOUNT value on done: 32589.0 [2024-08-05 23:25:46,362][52667] Sum rewards: 26.976, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.010', 'AMMO5': '0.010', 'ARMOR': '0.019', 'weapon5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.400', 'weapon4': '0.510', 'WEAPON3': '0.650', 'weapon2': '1.374', 'HITCOUNT': '1.650', 'weapon3': '1.788', 'DAMAGECOUNT': '5.988', 'FRAGCOUNT': '23.000'} [2024-08-05 23:25:46,476][52665] DAMAGECOUNT value on done: 33197.0 [2024-08-05 23:25:46,480][52665] Sum rewards: 34.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.744', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon4': '0.222', 'ARMOR': '0.481', 'weapon2': '0.622', 'WEAPON3': '1.000', 'HITCOUNT': '2.270', 'weapon3': '2.626', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '29.000'} [2024-08-05 23:25:46,914][52803] DAMAGECOUNT value on done: 31980.0 [2024-08-05 23:25:46,915][52803] Sum rewards: 33.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.312', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon4': '0.198', 'ARMOR': '0.424', 'WEAPON3': '0.950', 'weapon2': '1.044', 'weapon3': '2.318', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '8.769', 'FRAGCOUNT': '29.000'} [2024-08-05 23:25:47,016][52811] DAMAGECOUNT value on done: 31696.0 [2024-08-05 23:25:47,019][52811] Sum rewards: 30.238, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.183', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'ARMOR': '0.024', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon5': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.346', 'weapon3': '1.642', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '6.876', 'FRAGCOUNT': '24.000'} [2024-08-05 23:25:47,494][52650] Updated weights for policy 0, policy_version 14861 (0.0012) [2024-08-05 23:25:47,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 121741312. Throughput: 0: 4351.5. Samples: 30434810. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 23:25:47,795][52567] Avg episode reward: [(0, '26.050')] [2024-08-05 23:25:47,981][52664] DAMAGECOUNT value on done: 36492.0 [2024-08-05 23:25:47,981][52664] Sum rewards: 28.817, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'AMMO4': '0.179', 'WEAPON4': '0.400', 'weapon4': '0.578', 'ARMOR': '0.886', 'weapon2': '1.046', 'WEAPON3': '1.100', 'weapon3': '2.134', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '7.737', 'FRAGCOUNT': '26.000'} [2024-08-05 23:25:48,535][52669] DAMAGECOUNT value on done: 35644.0 [2024-08-05 23:25:48,536][52669] Sum rewards: 19.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.015', 'weapon5': '0.028', 'AMMO2': '0.052', 'ARMOR': '0.057', 'AMMO3': '0.171', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.550', 'weapon2': '0.922', 'WEAPON3': '1.050', 'HITCOUNT': '1.800', 'weapon3': '2.398', 'DAMAGECOUNT': '6.957', 'FRAGCOUNT': '18.000'} [2024-08-05 23:25:49,065][52667] DAMAGECOUNT value on done: 34437.0 [2024-08-05 23:25:49,073][52667] Sum rewards: 21.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.336', 'ARMOR': '0.454', 'WEAPON3': '1.000', 'weapon2': '1.344', 'HITCOUNT': '1.720', 'weapon3': '1.838', 'DAMAGECOUNT': '6.792', 'FRAGCOUNT': '19.500'} [2024-08-05 23:25:49,597][52665] DAMAGECOUNT value on done: 34555.0 [2024-08-05 23:25:49,597][52665] Sum rewards: 32.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.071', 'AMMO5': '0.005', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.164', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.936', 'WEAPON3': '1.350', 'HITCOUNT': '2.360', 'weapon3': '2.656', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '30.000'} [2024-08-05 23:25:49,930][52803] DAMAGECOUNT value on done: 32289.0 [2024-08-05 23:25:49,931][52803] Sum rewards: 27.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.842', 'weapon4': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'WEAPON3': '1.000', 'weapon2': '1.254', 'ARMOR': '1.332', 'HITCOUNT': '1.820', 'weapon3': '2.556', 'DAMAGECOUNT': '7.743', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:50,021][52811] DAMAGECOUNT value on done: 33775.0 [2024-08-05 23:25:50,023][52811] Sum rewards: 25.058, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.122', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.070', 'weapon4': '0.092', 'AMMO4': '0.111', 'AMMO3': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.990', 'WEAPON3': '1.150', 'HITCOUNT': '1.800', 'weapon3': '2.426', 'DAMAGECOUNT': '7.428', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:50,617][52664] DAMAGECOUNT value on done: 32632.0 [2024-08-05 23:25:50,617][52664] Sum rewards: 27.124, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.853', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO3': '0.104', 'weapon5': '0.110', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '0.650', 'weapon2': '1.428', 'weapon3': '1.732', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.020', 'FRAGCOUNT': '21.000'} [2024-08-05 23:25:51,099][52669] DAMAGECOUNT value on done: 33981.0 [2024-08-05 23:25:51,100][52669] Sum rewards: 21.484, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.260', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.110', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'weapon2': '1.220', 'HITCOUNT': '1.530', 'weapon3': '1.858', 'DAMAGECOUNT': '5.862', 'FRAGCOUNT': '19.000'} [2024-08-05 23:25:51,886][52667] DAMAGECOUNT value on done: 33207.0 [2024-08-05 23:25:51,886][52667] Sum rewards: 28.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon4': '0.332', 'ARMOR': '0.456', 'weapon2': '0.972', 'WEAPON3': '1.050', 'HITCOUNT': '2.240', 'weapon3': '2.382', 'DAMAGECOUNT': '8.355', 'FRAGCOUNT': '25.000'} [2024-08-05 23:25:52,494][52650] Updated weights for policy 0, policy_version 14871 (0.0012) [2024-08-05 23:25:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 121831424. Throughput: 0: 4354.9. Samples: 30461200. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 23:25:52,794][52567] Avg episode reward: [(0, '26.053')] [2024-08-05 23:25:52,858][52665] DAMAGECOUNT value on done: 32824.0 [2024-08-05 23:25:52,861][52665] Sum rewards: 14.782, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.802', 'AMMO5': '0.010', 'ARMOR': '0.049', 'AMMO2': '0.053', 'weapon5': '0.084', 'AMMO3': '0.141', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'WEAPON4': '0.550', 'weapon4': '0.572', 'weapon2': '0.762', 'WEAPON3': '0.850', 'HITCOUNT': '1.330', 'weapon3': '1.510', 'DAMAGECOUNT': '5.160', 'FRAGCOUNT': '13.000'} [2024-08-05 23:25:53,001][52803] DAMAGECOUNT value on done: 30220.0 [2024-08-05 23:25:53,004][52803] Sum rewards: 34.763, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.106', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.700', 'ARMOR': '0.854', 'weapon2': '1.252', 'weapon3': '1.914', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '8.709', 'FRAGCOUNT': '29.000'} [2024-08-05 23:25:53,174][52811] DAMAGECOUNT value on done: 29685.0 [2024-08-05 23:25:53,174][52811] Sum rewards: 25.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'weapon5': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.182', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.898', 'WEAPON3': '0.950', 'ARMOR': '1.002', 'HITCOUNT': '1.740', 'weapon3': '2.316', 'DAMAGECOUNT': '7.227', 'FRAGCOUNT': '25.000'} [2024-08-05 23:25:53,418][52664] DAMAGECOUNT value on done: 33849.0 [2024-08-05 23:25:53,420][52664] Sum rewards: 29.998, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.675', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.103', 'AMMO3': '0.139', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.238', 'HITCOUNT': '1.770', 'weapon3': '1.850', 'DAMAGECOUNT': '6.426', 'FRAGCOUNT': '26.000'} [2024-08-05 23:25:53,881][52669] DAMAGECOUNT value on done: 32629.0 [2024-08-05 23:25:53,882][52669] Sum rewards: 19.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.638', 'AMMO2': '0.032', 'AMMO3': '0.156', 'AMMO4': '0.160', 'weapon4': '0.326', 'WEAPON4': '0.450', 'ARMOR': '0.876', 'WEAPON3': '1.000', 'weapon2': '1.038', 'HITCOUNT': '1.650', 'weapon3': '2.240', 'DAMAGECOUNT': '6.105', 'FRAGCOUNT': '19.000'} [2024-08-05 23:25:54,338][52667] DAMAGECOUNT value on done: 33212.0 [2024-08-05 23:25:54,346][52667] Sum rewards: 25.762, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.165', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO3': '0.146', 'AMMO4': '0.167', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'weapon4': '0.608', 'weapon2': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '1.960', 'weapon3': '2.030', 'DAMAGECOUNT': '7.350', 'FRAGCOUNT': '20.000'} [2024-08-05 23:25:55,922][52664] DAMAGECOUNT value on done: 32988.0 [2024-08-05 23:25:55,922][52664] Sum rewards: 26.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.632', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO2': '0.036', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'ARMOR': '0.847', 'WEAPON3': '1.150', 'weapon2': '1.200', 'HITCOUNT': '1.730', 'weapon3': '2.320', 'DAMAGECOUNT': '6.939', 'FRAGCOUNT': '24.000'} [2024-08-05 23:25:55,986][52665] DAMAGECOUNT value on done: 31838.0 [2024-08-05 23:25:55,987][52665] Sum rewards: 26.497, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.153', 'weapon4': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'HEALTH': '0.944', 'weapon2': '0.960', 'HITCOUNT': '2.070', 'weapon3': '2.626', 'DAMAGECOUNT': '7.302', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:56,103][52803] DAMAGECOUNT value on done: 33371.0 [2024-08-05 23:25:56,104][52803] Sum rewards: 31.921, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'ARMOR': '0.455', 'WEAPON3': '0.950', 'weapon2': '1.314', 'HITCOUNT': '1.950', 'weapon3': '2.258', 'DAMAGECOUNT': '7.935', 'FRAGCOUNT': '27.000'} [2024-08-05 23:25:56,321][52811] DAMAGECOUNT value on done: 32363.0 [2024-08-05 23:25:56,323][52811] Sum rewards: 25.792, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon4': '0.550', 'weapon2': '0.858', 'ARMOR': '0.974', 'WEAPON3': '1.050', 'HITCOUNT': '1.950', 'weapon3': '2.240', 'DAMAGECOUNT': '7.395', 'FRAGCOUNT': '22.000'} [2024-08-05 23:25:56,559][52650] Updated weights for policy 0, policy_version 14881 (0.0020) [2024-08-05 23:25:56,717][52669] DAMAGECOUNT value on done: 33084.0 [2024-08-05 23:25:56,719][52669] Sum rewards: 33.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.341', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.398', 'WEAPON3': '0.850', 'ARMOR': '1.370', 'weapon2': '1.396', 'weapon3': '1.814', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '8.925', 'FRAGCOUNT': '27.000'} [2024-08-05 23:25:57,484][52667] DAMAGECOUNT value on done: 33227.0 [2024-08-05 23:25:57,486][52667] Sum rewards: 22.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.624', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.218', 'weapon4': '0.574', 'WEAPON4': '0.650', 'weapon2': '0.658', 'ARMOR': '0.906', 'WEAPON3': '1.100', 'HITCOUNT': '1.750', 'weapon3': '2.080', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '24.000'} [2024-08-05 23:25:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 121913344. Throughput: 0: 4359.1. Samples: 30487350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:25:57,795][52567] Avg episode reward: [(0, '26.240')] [2024-08-05 23:25:57,798][52614] Saving new best policy, reward=26.240! [2024-08-05 23:25:58,701][52664] DAMAGECOUNT value on done: 36183.0 [2024-08-05 23:25:58,702][52664] Sum rewards: 34.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.719', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.566', 'weapon2': '1.092', 'ARMOR': '1.220', 'WEAPON3': '1.250', 'weapon3': '2.066', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '8.733', 'FRAGCOUNT': '31.000'} [2024-08-05 23:25:58,980][52665] DAMAGECOUNT value on done: 31239.0 [2024-08-05 23:25:58,980][52665] Sum rewards: 31.204, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.028', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.090', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'ARMOR': '0.430', 'weapon4': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.892', 'HITCOUNT': '1.940', 'weapon3': '2.038', 'DAMAGECOUNT': '7.716', 'FRAGCOUNT': '24.000'} [2024-08-05 23:25:59,226][52803] DAMAGECOUNT value on done: 31037.0 [2024-08-05 23:25:59,226][52803] Sum rewards: 32.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.392', 'AMMO2': '0.025', 'ARMOR': '0.028', 'AMMO3': '0.114', 'AMMO4': '0.123', 'WEAPON4': '0.350', 'weapon4': '0.670', 'WEAPON3': '0.700', 'weapon2': '0.862', 'HITCOUNT': '2.140', 'weapon3': '2.174', 'DAMAGECOUNT': '8.130', 'FRAGCOUNT': '26.000'} [2024-08-05 23:25:59,414][52811] DAMAGECOUNT value on done: 30667.0 [2024-08-05 23:25:59,414][52811] Sum rewards: 30.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.933', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon2': '1.212', 'HITCOUNT': '2.210', 'weapon3': '2.406', 'DAMAGECOUNT': '7.977', 'FRAGCOUNT': '27.000'} [2024-08-05 23:25:59,717][52669] DAMAGECOUNT value on done: 31938.0 [2024-08-05 23:25:59,719][52669] Sum rewards: 21.615, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.870', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.070', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.614', 'ARMOR': '0.886', 'weapon2': '1.358', 'HITCOUNT': '1.640', 'weapon3': '1.684', 'DAMAGECOUNT': '6.225', 'FRAGCOUNT': '16.000'} [2024-08-05 23:26:00,097][52666] DAMAGECOUNT value on done: 30857.0 [2024-08-05 23:26:00,097][52666] Sum rewards: 24.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'ARMOR': '0.451', 'weapon2': '1.096', 'WEAPON3': '1.250', 'HITCOUNT': '1.870', 'weapon3': '2.482', 'DAMAGECOUNT': '6.801', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:00,158][52667] DAMAGECOUNT value on done: 35291.0 [2024-08-05 23:26:00,160][52667] Sum rewards: 24.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.133', 'weapon4': '0.040', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.207', 'WEAPON4': '0.450', 'ARMOR': '0.925', 'weapon2': '1.262', 'WEAPON3': '1.300', 'HITCOUNT': '1.930', 'weapon3': '2.384', 'DAMAGECOUNT': '7.395', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:01,550][52664] DAMAGECOUNT value on done: 31503.0 [2024-08-05 23:26:01,550][52664] Sum rewards: 32.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.042', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon2': '1.238', 'ARMOR': '1.311', 'WEAPON3': '1.350', 'HITCOUNT': '2.490', 'weapon3': '2.520', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '28.000'} [2024-08-05 23:26:01,890][52650] Updated weights for policy 0, policy_version 14891 (0.0029) [2024-08-05 23:26:02,024][52665] DAMAGECOUNT value on done: 33372.0 [2024-08-05 23:26:02,025][52665] Sum rewards: 16.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.934', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'ARMOR': '0.877', 'weapon2': '1.146', 'WEAPON3': '1.250', 'HITCOUNT': '1.530', 'weapon3': '2.294', 'DAMAGECOUNT': '5.967', 'FRAGCOUNT': '15.000'} [2024-08-05 23:26:02,357][52803] DAMAGECOUNT value on done: 29593.0 [2024-08-05 23:26:02,357][52803] Sum rewards: 18.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.948', 'AMMO5': '0.013', 'AMMO2': '0.028', 'ARMOR': '0.028', 'weapon5': '0.060', 'AMMO4': '0.139', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.408', 'WEAPON3': '0.950', 'weapon2': '0.976', 'HITCOUNT': '1.700', 'weapon3': '2.122', 'DAMAGECOUNT': '6.522', 'FRAGCOUNT': '15.000'} [2024-08-05 23:26:02,603][52666] DAMAGECOUNT value on done: 33137.0 [2024-08-05 23:26:02,605][52666] Sum rewards: 29.191, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.016', 'AMMO4': '0.027', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON4': '0.250', 'weapon4': '0.374', 'WEAPON3': '0.750', 'weapon2': '1.474', 'weapon3': '1.810', 'HITCOUNT': '1.900', 'DAMAGECOUNT': '7.593', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:02,640][52811] DAMAGECOUNT value on done: 33221.0 [2024-08-05 23:26:02,640][52811] Sum rewards: 23.116, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.909', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '0.950', 'weapon2': '1.196', 'ARMOR': '1.351', 'weapon3': '1.872', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '6.636', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:02,797][52567] Fps is (10 sec: 17198.9, 60 sec: 17475.5, 300 sec: 17466.9). Total num frames: 122003456. Throughput: 0: 4361.6. Samples: 30500230. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:26:02,797][52567] Avg episode reward: [(0, '26.242')] [2024-08-05 23:26:02,797][52614] Saving new best policy, reward=26.242! [2024-08-05 23:26:02,961][52669] DAMAGECOUNT value on done: 34002.0 [2024-08-05 23:26:02,962][52669] Sum rewards: 27.771, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.405', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'AMMO3': '0.072', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.446', 'WEAPON3': '0.600', 'ARMOR': '0.912', 'weapon2': '1.292', 'weapon3': '1.630', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.251', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:03,530][52667] DAMAGECOUNT value on done: 33813.0 [2024-08-05 23:26:03,530][52667] Sum rewards: 27.199, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.146', 'weapon4': '0.234', 'WEAPON3': '0.600', 'ARMOR': '1.268', 'weapon2': '1.430', 'HITCOUNT': '1.700', 'weapon3': '1.814', 'DAMAGECOUNT': '6.729', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:04,328][52664] DAMAGECOUNT value on done: 34811.0 [2024-08-05 23:26:04,330][52664] Sum rewards: 21.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '0.900', 'ARMOR': '1.296', 'weapon2': '1.356', 'HITCOUNT': '1.870', 'weapon3': '2.158', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '18.000'} [2024-08-05 23:26:05,102][52665] DAMAGECOUNT value on done: 33999.0 [2024-08-05 23:26:05,107][52665] Sum rewards: 27.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.272', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.060', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.280', 'ARMOR': '0.444', 'WEAPON3': '1.200', 'weapon2': '1.256', 'HITCOUNT': '2.060', 'weapon3': '2.120', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:05,304][52670] DAMAGECOUNT value on done: 33322.0 [2024-08-05 23:26:05,307][52670] Sum rewards: 18.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.456', 'AMMO5': '0.017', 'ARMOR': '0.032', 'AMMO2': '0.034', 'AMMO3': '0.156', 'AMMO4': '0.169', 'weapon5': '0.234', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.666', 'weapon2': '0.772', 'WEAPON3': '0.950', 'HITCOUNT': '1.340', 'weapon3': '1.656', 'DAMAGECOUNT': '5.658', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:05,426][52803] DAMAGECOUNT value on done: 31719.0 [2024-08-05 23:26:05,430][52803] Sum rewards: 31.607, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.645', 'AMMO2': '0.003', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'AMMO3': '0.120', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'weapon2': '1.616', 'weapon3': '2.084', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.622', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:05,494][52666] DAMAGECOUNT value on done: 32187.0 [2024-08-05 23:26:05,497][52666] Sum rewards: 27.321, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.792', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.089', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'ARMOR': '0.471', 'WEAPON3': '0.850', 'weapon2': '1.400', 'HITCOUNT': '1.850', 'weapon3': '2.238', 'DAMAGECOUNT': '7.104', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:05,748][52811] DAMAGECOUNT value on done: 30064.0 [2024-08-05 23:26:05,753][52811] Sum rewards: 17.950, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.326', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.276', 'ARMOR': '0.836', 'WEAPON3': '0.950', 'weapon2': '1.090', 'HITCOUNT': '1.740', 'weapon3': '2.098', 'DAMAGECOUNT': '5.508', 'FRAGCOUNT': '15.000'} [2024-08-05 23:26:05,858][52669] DAMAGECOUNT value on done: 36328.0 [2024-08-05 23:26:05,859][52669] Sum rewards: 26.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.402', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon4': '0.144', 'AMMO4': '0.163', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'ARMOR': '0.524', 'WEAPON3': '1.200', 'weapon2': '1.280', 'HITCOUNT': '1.710', 'weapon3': '2.300', 'DAMAGECOUNT': '7.374', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:06,142][52650] Updated weights for policy 0, policy_version 14901 (0.0017) [2024-08-05 23:26:06,260][52667] DAMAGECOUNT value on done: 32740.0 [2024-08-05 23:26:06,260][52667] Sum rewards: 23.979, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.436', 'AMMO5': '0.017', 'AMMO2': '0.022', 'ARMOR': '0.048', 'weapon5': '0.102', 'AMMO4': '0.110', 'AMMO3': '0.149', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.096', 'HITCOUNT': '1.530', 'weapon3': '2.038', 'DAMAGECOUNT': '6.021', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:06,766][52664] DAMAGECOUNT value on done: 33236.0 [2024-08-05 23:26:06,766][52664] Sum rewards: 23.766, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.027', 'AMMO2': '0.020', 'AMMO3': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.302', 'ARMOR': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.234', 'HITCOUNT': '1.490', 'weapon3': '1.790', 'DAMAGECOUNT': '5.355', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 122085376. Throughput: 0: 4353.6. Samples: 30526020. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:26:07,794][52567] Avg episode reward: [(0, '26.275')] [2024-08-05 23:26:07,797][52614] Saving new best policy, reward=26.275! [2024-08-05 23:26:08,164][52670] DAMAGECOUNT value on done: 33817.0 [2024-08-05 23:26:08,164][52670] Sum rewards: 30.477, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.412', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.276', 'ARMOR': '0.481', 'WEAPON3': '0.900', 'weapon2': '1.120', 'HITCOUNT': '1.780', 'weapon3': '1.990', 'DAMAGECOUNT': '7.350', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:08,249][52665] DAMAGECOUNT value on done: 34568.0 [2024-08-05 23:26:08,250][52665] Sum rewards: 20.038, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.046', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.478', 'ARMOR': '0.856', 'WEAPON3': '0.900', 'weapon2': '1.122', 'HITCOUNT': '1.840', 'weapon3': '1.948', 'DAMAGECOUNT': '6.675', 'FRAGCOUNT': '16.000'} [2024-08-05 23:26:08,410][52666] DAMAGECOUNT value on done: 31646.0 [2024-08-05 23:26:08,411][52666] Sum rewards: 23.315, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.968', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.125', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '0.850', 'weapon2': '1.084', 'HITCOUNT': '1.700', 'weapon3': '1.910', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '18.000'} [2024-08-05 23:26:08,723][52667] DAMAGECOUNT value on done: 35235.0 [2024-08-05 23:26:08,725][52667] Sum rewards: 32.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO4': '-0.031', 'AMMO2': '-0.006', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'weapon4': '0.216', 'ARMOR': '0.454', 'weapon2': '0.970', 'WEAPON3': '1.350', 'HITCOUNT': '2.170', 'weapon3': '2.608', 'DAMAGECOUNT': '8.055', 'FRAGCOUNT': '30.000'} [2024-08-05 23:26:08,810][52803] DAMAGECOUNT value on done: 32128.0 [2024-08-05 23:26:08,810][52803] Sum rewards: 27.403, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.099', 'AMMO3': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.356', 'ARMOR': '0.454', 'weapon2': '0.790', 'WEAPON3': '1.050', 'HITCOUNT': '2.030', 'weapon3': '2.530', 'DAMAGECOUNT': '8.568', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:08,854][52811] DAMAGECOUNT value on done: 31415.0 [2024-08-05 23:26:08,854][52811] Sum rewards: 26.139, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.501', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON3': '0.850', 'ARMOR': '1.324', 'HITCOUNT': '1.600', 'weapon2': '1.682', 'weapon3': '1.908', 'DAMAGECOUNT': '6.066', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:08,918][52795] DAMAGECOUNT value on done: 30525.0 [2024-08-05 23:26:08,918][52795] Sum rewards: 28.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.058', 'weapon5': '0.062', 'AMMO3': '0.134', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.258', 'HITCOUNT': '2.010', 'weapon3': '2.394', 'DAMAGECOUNT': '7.824', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:09,071][52669] DAMAGECOUNT value on done: 31883.0 [2024-08-05 23:26:09,072][52669] Sum rewards: 25.738, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'ARMOR': '0.512', 'weapon4': '0.630', 'WEAPON3': '0.750', 'weapon2': '0.874', 'HITCOUNT': '1.710', 'weapon3': '2.050', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:09,602][52664] DAMAGECOUNT value on done: 35187.0 [2024-08-05 23:26:09,602][52664] Sum rewards: 32.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.064', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon4': '0.288', 'weapon2': '0.580', 'WEAPON3': '1.600', 'HITCOUNT': '2.100', 'weapon3': '2.714', 'DAMAGECOUNT': '8.847', 'FRAGCOUNT': '32.500'} [2024-08-05 23:26:11,340][52650] Updated weights for policy 0, policy_version 14911 (0.0018) [2024-08-05 23:26:11,362][52665] DAMAGECOUNT value on done: 34009.0 [2024-08-05 23:26:11,364][52665] Sum rewards: 29.896, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon5': '0.164', 'weapon4': '0.224', 'HEALTH': '0.379', 'ARMOR': '0.440', 'WEAPON3': '0.550', 'weapon3': '1.640', 'weapon2': '1.674', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:11,381][52670] DAMAGECOUNT value on done: 32916.0 [2024-08-05 23:26:11,381][52670] Sum rewards: 23.385, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.490', 'weapon2': '1.076', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.140', 'DAMAGECOUNT': '7.140', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:11,445][52667] DAMAGECOUNT value on done: 33429.0 [2024-08-05 23:26:11,445][52667] Sum rewards: 20.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.637', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.036', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.282', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon2': '0.882', 'WEAPON3': '1.200', 'HITCOUNT': '1.570', 'weapon3': '2.372', 'DAMAGECOUNT': '5.982', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:11,495][52669] DAMAGECOUNT value on done: 34081.0 [2024-08-05 23:26:11,498][52669] Sum rewards: 25.204, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.055', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON3': '1.000', 'weapon2': '1.242', 'ARMOR': '1.358', 'HITCOUNT': '1.710', 'weapon3': '2.066', 'DAMAGECOUNT': '7.155', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:11,545][52666] DAMAGECOUNT value on done: 31312.0 [2024-08-05 23:26:11,573][52666] Sum rewards: 22.969, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.115', 'AMMO4': '0.118', 'WEAPON4': '0.450', 'ARMOR': '0.544', 'weapon2': '0.588', 'weapon4': '0.846', 'WEAPON3': '0.850', 'HITCOUNT': '1.810', 'weapon3': '2.024', 'DAMAGECOUNT': '7.704', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:11,914][52803] DAMAGECOUNT value on done: 29785.0 [2024-08-05 23:26:11,917][52803] Sum rewards: 26.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.278', 'ARMOR': '0.408', 'WEAPON3': '0.950', 'weapon2': '1.480', 'weapon3': '1.940', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.539', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:12,006][52811] DAMAGECOUNT value on done: 31382.0 [2024-08-05 23:26:12,007][52811] Sum rewards: 29.102, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.223', 'AMMO4': '-0.023', 'AMMO2': '-0.005', 'AMMO5': '0.010', 'weapon5': '0.100', 'AMMO3': '0.121', 'WEAPON5': '0.250', 'ARMOR': '0.452', 'WEAPON3': '0.900', 'weapon2': '1.530', 'weapon3': '2.148', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '8.181', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:12,038][52795] DAMAGECOUNT value on done: 28781.0 [2024-08-05 23:26:12,038][52795] Sum rewards: 30.115, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.826', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon4': '0.482', 'ARMOR': '0.921', 'weapon2': '0.978', 'WEAPON3': '1.150', 'weapon3': '1.706', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.915', 'FRAGCOUNT': '27.000'} [2024-08-05 23:26:12,426][52664] DAMAGECOUNT value on done: 33997.0 [2024-08-05 23:26:12,428][52664] Sum rewards: 25.756, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.568', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.222', 'ARMOR': '0.850', 'WEAPON3': '0.950', 'weapon2': '1.124', 'HITCOUNT': '1.820', 'weapon3': '2.234', 'DAMAGECOUNT': '6.861', 'FRAGCOUNT': '21.500'} [2024-08-05 23:26:12,727][52658] DAMAGECOUNT value on done: 35037.0 [2024-08-05 23:26:12,727][52658] Sum rewards: 35.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.446', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.284', 'weapon2': '0.950', 'WEAPON3': '1.150', 'weapon3': '2.382', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.023', 'FRAGCOUNT': '30.000'} [2024-08-05 23:26:12,794][52567] Fps is (10 sec: 17207.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 122175488. Throughput: 0: 4343.1. Samples: 30551710. Policy #0 lag: (min: 2.0, avg: 4.4, max: 8.0) [2024-08-05 23:26:12,794][52567] Avg episode reward: [(0, '26.508')] [2024-08-05 23:26:12,795][52614] Saving new best policy, reward=26.508! [2024-08-05 23:26:14,186][52670] DAMAGECOUNT value on done: 33420.0 [2024-08-05 23:26:14,194][52669] DAMAGECOUNT value on done: 34001.0 [2024-08-05 23:26:14,194][52669] Sum rewards: 28.424, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.551', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon5': '0.082', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'weapon4': '0.544', 'weapon2': '0.818', 'WEAPON3': '1.000', 'HITCOUNT': '1.790', 'weapon3': '2.068', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:14,196][52670] Sum rewards: 24.799, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.048', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon4': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON3': '0.750', 'ARMOR': '0.856', 'weapon2': '1.392', 'HITCOUNT': '1.410', 'weapon3': '1.652', 'DAMAGECOUNT': '5.820', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:14,346][52666] DAMAGECOUNT value on done: 31258.0 [2024-08-05 23:26:14,346][52666] Sum rewards: 25.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.526', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.168', 'weapon4': '0.360', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'WEAPON3': '1.050', 'weapon2': '1.174', 'weapon3': '2.170', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:14,394][52665] DAMAGECOUNT value on done: 34342.0 [2024-08-05 23:26:14,394][52665] Sum rewards: 22.425, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.427', 'weapon5': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.086', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'ARMOR': '1.343', 'weapon2': '1.576', 'HITCOUNT': '1.810', 'weapon3': '1.994', 'DAMAGECOUNT': '6.807', 'FRAGCOUNT': '18.500'} [2024-08-05 23:26:14,426][52667] DAMAGECOUNT value on done: 32191.0 [2024-08-05 23:26:14,426][52667] Sum rewards: 24.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'weapon4': '0.462', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.176', 'HITCOUNT': '1.570', 'weapon3': '1.926', 'DAMAGECOUNT': '6.171', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:15,025][52803] DAMAGECOUNT value on done: 30328.0 [2024-08-05 23:26:15,026][52803] Sum rewards: 18.743, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.058', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.548', 'WEAPON3': '0.850', 'ARMOR': '0.943', 'weapon2': '1.060', 'HITCOUNT': '1.520', 'weapon3': '2.004', 'DAMAGECOUNT': '5.466', 'FRAGCOUNT': '14.000'} [2024-08-05 23:26:15,077][52795] DAMAGECOUNT value on done: 29934.0 [2024-08-05 23:26:15,077][52795] Sum rewards: 31.090, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.482', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.164', 'ARMOR': '0.868', 'WEAPON3': '1.050', 'weapon2': '1.380', 'HITCOUNT': '2.090', 'weapon3': '2.266', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:15,133][52811] DAMAGECOUNT value on done: 32300.0 [2024-08-05 23:26:15,133][52811] Sum rewards: 27.339, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.244', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.052', 'weapon4': '0.094', 'AMMO3': '0.123', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.386', 'HITCOUNT': '2.210', 'weapon3': '2.232', 'DAMAGECOUNT': '8.655', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:15,347][52663] DAMAGECOUNT value on done: 34000.0 [2024-08-05 23:26:15,348][52663] Sum rewards: 25.412, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.542', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.108', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.294', 'HITCOUNT': '1.820', 'weapon3': '2.162', 'DAMAGECOUNT': '6.651', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:15,547][52658] DAMAGECOUNT value on done: 32535.0 [2024-08-05 23:26:15,549][52658] Sum rewards: 25.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.672', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.185', 'weapon4': '0.188', 'weapon2': '0.860', 'ARMOR': '0.896', 'WEAPON3': '1.150', 'HITCOUNT': '2.000', 'weapon3': '2.574', 'DAMAGECOUNT': '6.999', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:16,568][52650] Updated weights for policy 0, policy_version 14921 (0.0040) [2024-08-05 23:26:16,781][52670] DAMAGECOUNT value on done: 30917.0 [2024-08-05 23:26:16,784][52670] Sum rewards: 32.164, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.240', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO3': '0.156', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.428', 'WEAPON3': '0.950', 'weapon2': '0.998', 'ARMOR': '1.255', 'weapon3': '2.132', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '8.646', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:16,916][52669] DAMAGECOUNT value on done: 35037.0 [2024-08-05 23:26:16,916][52669] Sum rewards: 25.475, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.616', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.406', 'ARMOR': '0.487', 'WEAPON3': '1.050', 'weapon2': '1.130', 'HITCOUNT': '2.140', 'weapon3': '2.234', 'DAMAGECOUNT': '7.356', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:16,991][52666] DAMAGECOUNT value on done: 32011.0 [2024-08-05 23:26:16,993][52666] Sum rewards: 28.495, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.218', 'WEAPON3': '1.100', 'weapon2': '1.174', 'HITCOUNT': '1.900', 'weapon3': '2.294', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '27.000'} [2024-08-05 23:26:17,062][52667] DAMAGECOUNT value on done: 32865.0 [2024-08-05 23:26:17,066][52667] Sum rewards: 28.665, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.025', 'weapon5': '0.054', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.400', 'weapon2': '0.570', 'weapon4': '0.608', 'WEAPON3': '0.800', 'HITCOUNT': '1.770', 'weapon3': '2.096', 'DAMAGECOUNT': '6.849', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:17,423][52665] DAMAGECOUNT value on done: 31987.0 [2024-08-05 23:26:17,424][52665] Sum rewards: 22.345, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO2': '0.012', 'AMMO5': '0.017', 'AMMO4': '0.062', 'AMMO3': '0.107', 'weapon4': '0.172', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'ARMOR': '0.853', 'weapon2': '1.226', 'HITCOUNT': '1.570', 'weapon3': '2.046', 'DAMAGECOUNT': '6.183', 'FRAGCOUNT': '17.000'} [2024-08-05 23:26:17,708][52614] Signal inference workers to stop experience collection... (2800 times) [2024-08-05 23:26:17,710][52614] Signal inference workers to resume experience collection... (2800 times) [2024-08-05 23:26:17,750][52650] InferenceWorker_p0-w0: stopping experience collection (2800 times) [2024-08-05 23:26:17,760][52650] InferenceWorker_p0-w0: resuming experience collection (2800 times) [2024-08-05 23:26:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 122257408. Throughput: 0: 4338.0. Samples: 30564630. Policy #0 lag: (min: 2.0, avg: 4.4, max: 8.0) [2024-08-05 23:26:17,794][52567] Avg episode reward: [(0, '26.401')] [2024-08-05 23:26:18,140][52811] DAMAGECOUNT value on done: 30476.0 [2024-08-05 23:26:18,141][52811] Sum rewards: 20.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.139', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.088', 'AMMO3': '0.181', 'AMMO4': '0.205', 'WEAPON5': '0.300', 'ARMOR': '0.463', 'WEAPON4': '0.550', 'weapon2': '0.608', 'weapon4': '0.614', 'WEAPON3': '1.200', 'HITCOUNT': '1.910', 'weapon3': '2.318', 'DAMAGECOUNT': '7.551', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:18,145][52795] DAMAGECOUNT value on done: 31736.0 [2024-08-05 23:26:18,149][52795] Sum rewards: 25.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.082', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon4': '0.210', 'ARMOR': '0.820', 'weapon2': '1.056', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'weapon3': '2.554', 'DAMAGECOUNT': '8.997', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:18,163][52803] DAMAGECOUNT value on done: 31925.0 [2024-08-05 23:26:18,165][52803] Sum rewards: 33.271, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.367', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'weapon2': '1.718', 'weapon3': '1.892', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '8.238', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:18,203][52658] DAMAGECOUNT value on done: 31482.0 [2024-08-05 23:26:18,204][52658] Sum rewards: 29.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.483', 'weapon5': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.038', 'AMMO4': '0.165', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon2': '1.016', 'WEAPON3': '1.150', 'HITCOUNT': '1.990', 'weapon3': '2.670', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:18,337][52663] DAMAGECOUNT value on done: 33642.0 [2024-08-05 23:26:18,338][52663] Sum rewards: 28.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.050', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.238', 'HITCOUNT': '1.900', 'weapon3': '2.404', 'DAMAGECOUNT': '7.542', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:19,579][52667] DAMAGECOUNT value on done: 35434.0 [2024-08-05 23:26:19,579][52667] Sum rewards: 27.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.421', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.097', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '1.100', 'WEAPON3': '1.150', 'ARMOR': '1.373', 'HITCOUNT': '1.940', 'weapon3': '2.368', 'DAMAGECOUNT': '7.278', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:19,944][52670] DAMAGECOUNT value on done: 35199.0 [2024-08-05 23:26:19,945][52670] Sum rewards: 26.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.201', 'AMMO5': '0.022', 'AMMO2': '0.037', 'weapon5': '0.048', 'AMMO3': '0.154', 'weapon4': '0.168', 'AMMO4': '0.186', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.492', 'WEAPON3': '1.000', 'weapon2': '1.028', 'HITCOUNT': '2.050', 'weapon3': '2.506', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:20,165][52665] DAMAGECOUNT value on done: 31633.0 [2024-08-05 23:26:20,166][52665] Sum rewards: 23.502, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.406', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.121', 'WEAPON4': '0.350', 'weapon4': '0.362', 'ARMOR': '0.449', 'WEAPON3': '0.900', 'weapon2': '1.432', 'HITCOUNT': '1.710', 'weapon3': '1.946', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:20,171][52666] DAMAGECOUNT value on done: 32999.0 [2024-08-05 23:26:20,172][52666] Sum rewards: 36.265, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.525', 'AMMO5': '0.006', 'AMMO2': '0.040', 'AMMO3': '0.102', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'ARMOR': '0.479', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.722', 'weapon2': '0.848', 'weapon3': '1.804', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.481', 'FRAGCOUNT': '29.000'} [2024-08-05 23:26:20,262][52669] DAMAGECOUNT value on done: 34198.0 [2024-08-05 23:26:20,263][52669] Sum rewards: 32.079, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.066', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.138', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.592', 'weapon3': '2.088', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:20,570][52650] Updated weights for policy 0, policy_version 14931 (0.0014) [2024-08-05 23:26:20,951][52658] DAMAGECOUNT value on done: 33501.0 [2024-08-05 23:26:20,951][52658] Sum rewards: 24.699, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.750', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.106', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon4': '0.416', 'ARMOR': '0.425', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.368', 'HITCOUNT': '1.850', 'weapon3': '1.924', 'DAMAGECOUNT': '6.273', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:21,140][52795] DAMAGECOUNT value on done: 34206.0 [2024-08-05 23:26:21,141][52795] Sum rewards: 34.247, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.715', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.300', 'weapon4': '0.386', 'ARMOR': '0.906', 'WEAPON3': '1.000', 'weapon2': '1.036', 'HITCOUNT': '2.040', 'weapon3': '2.354', 'DAMAGECOUNT': '8.793', 'FRAGCOUNT': '27.000'} [2024-08-05 23:26:21,185][52803] DAMAGECOUNT value on done: 32373.0 [2024-08-05 23:26:21,185][52803] Sum rewards: 23.942, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.479', 'AMMO5': '0.003', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.484', 'WEAPON3': '0.800', 'ARMOR': '0.808', 'weapon2': '1.236', 'HITCOUNT': '1.610', 'weapon3': '1.934', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:21,444][52811] DAMAGECOUNT value on done: 31817.0 [2024-08-05 23:26:21,445][52811] Sum rewards: 21.803, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.122', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.109', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'weapon4': '0.544', 'WEAPON3': '0.850', 'weapon2': '1.106', 'weapon3': '1.826', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '6.270', 'FRAGCOUNT': '17.000'} [2024-08-05 23:26:21,555][52663] DAMAGECOUNT value on done: 33200.0 [2024-08-05 23:26:21,556][52663] Sum rewards: 27.164, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.749', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.468', 'weapon2': '0.756', 'ARMOR': '0.930', 'WEAPON3': '1.000', 'HITCOUNT': '2.000', 'weapon3': '2.346', 'DAMAGECOUNT': '7.413', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:22,349][52667] DAMAGECOUNT value on done: 32520.0 [2024-08-05 23:26:22,350][52667] Sum rewards: 28.218, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.512', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.174', 'weapon4': '0.190', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon2': '1.206', 'ARMOR': '1.356', 'HITCOUNT': '1.730', 'weapon3': '2.388', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 122347520. Throughput: 0: 4345.3. Samples: 30590890. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:26:22,795][52567] Avg episode reward: [(0, '26.624')] [2024-08-05 23:26:22,797][52614] Saving new best policy, reward=26.624! [2024-08-05 23:26:22,887][52665] DAMAGECOUNT value on done: 33694.0 [2024-08-05 23:26:22,888][52665] Sum rewards: 33.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'ARMOR': '0.800', 'weapon2': '1.130', 'WEAPON3': '1.250', 'HITCOUNT': '1.920', 'weapon3': '2.454', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '33.000'} [2024-08-05 23:26:23,063][52670] DAMAGECOUNT value on done: 31421.0 [2024-08-05 23:26:23,064][52670] Sum rewards: 19.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'WEAPON4': '0.450', 'weapon4': '0.452', 'ARMOR': '0.483', 'WEAPON3': '0.950', 'weapon2': '1.036', 'HITCOUNT': '1.790', 'weapon3': '2.260', 'DAMAGECOUNT': '6.372', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:23,256][52666] DAMAGECOUNT value on done: 32824.0 [2024-08-05 23:26:23,256][52666] Sum rewards: 27.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.200', 'weapon2': '1.268', 'ARMOR': '1.411', 'weapon3': '2.130', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '8.589', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:23,480][52658] DAMAGECOUNT value on done: 35513.0 [2024-08-05 23:26:23,481][52658] Sum rewards: 42.765, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.619', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.022', 'weapon5': '0.034', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.118', 'HITCOUNT': '2.350', 'weapon3': '2.552', 'DAMAGECOUNT': '10.617', 'FRAGCOUNT': '35.000'} [2024-08-05 23:26:23,564][52669] DAMAGECOUNT value on done: 34865.0 [2024-08-05 23:26:23,564][52669] Sum rewards: 24.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.804', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.124', 'AMMO3': '0.192', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.740', 'WEAPON3': '1.250', 'HITCOUNT': '1.860', 'weapon3': '2.548', 'DAMAGECOUNT': '7.707', 'FRAGCOUNT': '21.500'} [2024-08-05 23:26:24,151][52795] DAMAGECOUNT value on done: 32343.0 [2024-08-05 23:26:24,153][52795] Sum rewards: 26.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.474', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.134', 'AMMO3': '0.144', 'AMMO4': '0.148', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon2': '1.286', 'ARMOR': '1.332', 'HITCOUNT': '2.000', 'weapon3': '2.392', 'DAMAGECOUNT': '8.046', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:24,399][52803] DAMAGECOUNT value on done: 30419.0 [2024-08-05 23:26:24,402][52803] Sum rewards: 23.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.177', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.690', 'weapon2': '0.710', 'WEAPON3': '1.000', 'weapon3': '1.894', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '7.071', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:24,632][52663] DAMAGECOUNT value on done: 34287.0 [2024-08-05 23:26:24,632][52663] Sum rewards: 36.085, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.450', 'AMMO2': '0.041', 'ARMOR': '0.044', 'AMMO3': '0.136', 'AMMO4': '0.206', 'weapon4': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon2': '0.980', 'weapon3': '2.000', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.369', 'FRAGCOUNT': '30.000'} [2024-08-05 23:26:24,836][52811] DAMAGECOUNT value on done: 33895.0 [2024-08-05 23:26:24,836][52811] Sum rewards: 20.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.766', 'AMMO2': '0.025', 'ARMOR': '0.028', 'AMMO4': '0.124', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.566', 'WEAPON3': '1.350', 'HITCOUNT': '1.890', 'weapon3': '2.262', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:25,164][52667] DAMAGECOUNT value on done: 35675.0 [2024-08-05 23:26:25,164][52667] Sum rewards: 23.900, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.616', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon5': '0.096', 'AMMO3': '0.136', 'AMMO4': '0.331', 'WEAPON5': '0.400', 'ARMOR': '0.501', 'WEAPON4': '0.600', 'weapon4': '0.730', 'WEAPON3': '0.800', 'weapon2': '1.098', 'weapon3': '1.634', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '7.065', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:25,639][52650] Updated weights for policy 0, policy_version 14941 (0.0024) [2024-08-05 23:26:25,768][52665] DAMAGECOUNT value on done: 33797.0 [2024-08-05 23:26:25,769][52665] Sum rewards: 25.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.372', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.262', 'ARMOR': '0.535', 'WEAPON3': '1.000', 'weapon2': '1.282', 'HITCOUNT': '1.900', 'weapon3': '2.132', 'DAMAGECOUNT': '6.738', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:25,790][52670] DAMAGECOUNT value on done: 31575.0 [2024-08-05 23:26:25,790][52670] Sum rewards: 26.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.576', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.121', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.550', 'weapon4': '0.728', 'weapon2': '0.802', 'WEAPON3': '0.900', 'weapon3': '1.860', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.560', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:26,022][52666] DAMAGECOUNT value on done: 31150.0 [2024-08-05 23:26:26,023][52666] Sum rewards: 32.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.102', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.163', 'WEAPON4': '0.400', 'weapon4': '0.586', 'weapon2': '0.868', 'WEAPON3': '0.950', 'weapon3': '1.902', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '7.563', 'FRAGCOUNT': '28.000'} [2024-08-05 23:26:26,368][52669] DAMAGECOUNT value on done: 32209.0 [2024-08-05 23:26:26,368][52669] Sum rewards: 14.745, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.370', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.026', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'HITCOUNT': '1.310', 'weapon2': '1.434', 'weapon3': '2.102', 'DAMAGECOUNT': '5.115', 'FRAGCOUNT': '14.000'} [2024-08-05 23:26:26,571][52658] DAMAGECOUNT value on done: 31564.0 [2024-08-05 23:26:26,573][52658] Sum rewards: 29.673, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.719', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.058', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.562', 'ARMOR': '0.973', 'WEAPON3': '1.000', 'weapon2': '1.016', 'weapon3': '2.042', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '7.413', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:27,235][52795] DAMAGECOUNT value on done: 34634.0 [2024-08-05 23:26:27,239][52795] Sum rewards: 27.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'weapon4': '0.002', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon2': '1.182', 'HITCOUNT': '1.770', 'weapon3': '2.422', 'DAMAGECOUNT': '8.289', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:27,620][52663] DAMAGECOUNT value on done: 32075.0 [2024-08-05 23:26:27,624][52663] Sum rewards: 33.966, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'HEALTH': '0.164', 'weapon4': '0.172', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'WEAPON3': '0.750', 'weapon2': '1.336', 'weapon3': '2.096', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '8.061', 'FRAGCOUNT': '27.000'} [2024-08-05 23:26:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 122437632. Throughput: 0: 4340.9. Samples: 30616950. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:26:27,794][52567] Avg episode reward: [(0, '26.759')] [2024-08-05 23:26:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014946_122437632.pth... [2024-08-05 23:26:27,888][52811] DAMAGECOUNT value on done: 29737.0 [2024-08-05 23:26:27,888][52811] Sum rewards: 24.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.862', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.027', 'weapon4': '0.066', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON3': '0.950', 'ARMOR': '1.390', 'weapon2': '1.430', 'HITCOUNT': '1.500', 'weapon3': '2.124', 'DAMAGECOUNT': '6.273', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:27,916][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014435_118251520.pth [2024-08-05 23:26:27,931][52614] Saving new best policy, reward=26.759! [2024-08-05 23:26:28,062][52667] DAMAGECOUNT value on done: 35559.0 [2024-08-05 23:26:28,064][52667] Sum rewards: 16.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.595', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '1.240', 'WEAPON3': '1.400', 'HITCOUNT': '1.750', 'weapon3': '2.532', 'DAMAGECOUNT': '6.315', 'FRAGCOUNT': '17.000'} [2024-08-05 23:26:28,702][52670] DAMAGECOUNT value on done: 30310.0 [2024-08-05 23:26:28,702][52670] Sum rewards: 31.858, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.259', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.121', 'ARMOR': '0.857', 'WEAPON3': '0.900', 'weapon2': '1.100', 'HITCOUNT': '1.940', 'weapon3': '2.694', 'DAMAGECOUNT': '7.731', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:28,826][52666] DAMAGECOUNT value on done: 28818.0 [2024-08-05 23:26:28,829][52666] Sum rewards: 30.634, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.121', 'AMMO3': '0.123', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'weapon4': '0.564', 'weapon2': '0.796', 'WEAPON3': '0.850', 'weapon3': '2.016', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.463', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:28,852][52665] DAMAGECOUNT value on done: 32909.0 [2024-08-05 23:26:28,853][52665] Sum rewards: 25.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.045', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'AMMO3': '0.180', 'ARMOR': '0.847', 'WEAPON3': '1.200', 'weapon2': '1.266', 'HITCOUNT': '1.680', 'weapon3': '2.500', 'DAMAGECOUNT': '7.155', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:29,438][52658] DAMAGECOUNT value on done: 38413.0 [2024-08-05 23:26:29,440][52658] Sum rewards: 33.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.072', 'AMMO5': '0.005', 'ARMOR': '0.025', 'AMMO2': '0.028', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.194', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '1.012', 'WEAPON3': '1.250', 'HITCOUNT': '2.230', 'weapon3': '2.284', 'DAMAGECOUNT': '9.450', 'FRAGCOUNT': '30.500'} [2024-08-05 23:26:29,475][52669] DAMAGECOUNT value on done: 35111.0 [2024-08-05 23:26:29,477][52669] Sum rewards: 26.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.776', 'weapon5': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.185', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.502', 'WEAPON4': '0.600', 'ARMOR': '0.930', 'weapon2': '0.950', 'WEAPON3': '1.100', 'HITCOUNT': '1.970', 'weapon3': '2.212', 'DAMAGECOUNT': '7.380', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:29,962][52650] Updated weights for policy 0, policy_version 14951 (0.0012) [2024-08-05 23:26:30,466][52795] DAMAGECOUNT value on done: 31463.0 [2024-08-05 23:26:30,466][52795] Sum rewards: 27.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.372', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO3': '0.146', 'AMMO4': '0.151', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.598', 'weapon4': '0.652', 'WEAPON3': '1.000', 'HITCOUNT': '2.010', 'weapon3': '2.194', 'DAMAGECOUNT': '7.818', 'FRAGCOUNT': '23.500'} [2024-08-05 23:26:30,708][52663] DAMAGECOUNT value on done: 35007.0 [2024-08-05 23:26:30,708][52663] Sum rewards: 31.919, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.809', 'AMMO2': '0.036', 'AMMO3': '0.154', 'AMMO4': '0.179', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'weapon4': '0.738', 'WEAPON3': '0.950', 'weapon2': '0.968', 'weapon3': '1.916', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '7.845', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:30,805][52667] DAMAGECOUNT value on done: 34313.0 [2024-08-05 23:26:30,805][52667] Sum rewards: 23.286, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.276', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.130', 'weapon4': '0.178', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '1.360', 'weapon2': '1.592', 'ARMOR': '1.755', 'weapon3': '1.942', 'DAMAGECOUNT': '5.469', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:30,948][52811] DAMAGECOUNT value on done: 30522.0 [2024-08-05 23:26:30,948][52811] Sum rewards: 26.101, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.024', 'HEALTH': '0.050', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.178', 'ARMOR': '0.800', 'weapon2': '0.862', 'WEAPON3': '1.000', 'HITCOUNT': '1.880', 'weapon3': '2.708', 'DAMAGECOUNT': '7.407', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:31,053][52666] Large shaping reward 2.519 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.468, 156.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:26:31,588][52670] DAMAGECOUNT value on done: 28571.0 [2024-08-05 23:26:31,589][52670] Sum rewards: 34.373, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.801', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.084', 'weapon4': '0.102', 'AMMO3': '0.121', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'ARMOR': '0.876', 'weapon2': '1.472', 'HITCOUNT': '1.920', 'weapon3': '2.160', 'DAMAGECOUNT': '8.502', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:31,747][52666] DAMAGECOUNT value on done: 30120.0 [2024-08-05 23:26:31,747][52666] Sum rewards: 38.599, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.106', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.102', 'AMMO4': '0.128', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.374', 'ARMOR': '0.471', 'WEAPON3': '0.650', 'weapon2': '1.004', 'HITCOUNT': '1.900', 'weapon3': '1.970', 'DAMAGECOUNT': '7.884', 'FRAGCOUNT': '31.000'} [2024-08-05 23:26:32,122][52665] DAMAGECOUNT value on done: 32427.0 [2024-08-05 23:26:32,122][52665] Sum rewards: 31.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.129', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.121', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.464', 'ARMOR': '0.898', 'WEAPON3': '0.900', 'weapon2': '0.958', 'HITCOUNT': '1.970', 'weapon3': '2.056', 'DAMAGECOUNT': '7.638', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:32,242][52658] DAMAGECOUNT value on done: 31587.0 [2024-08-05 23:26:32,243][52658] Sum rewards: 27.307, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.978', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.035', 'AMMO3': '0.122', 'AMMO4': '0.174', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'ARMOR': '0.848', 'weapon2': '1.676', 'weapon3': '1.730', 'HITCOUNT': '1.790', 'DAMAGECOUNT': '6.834', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 122519552. Throughput: 0: 4332.5. Samples: 30629770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:26:32,794][52567] Avg episode reward: [(0, '26.869')] [2024-08-05 23:26:32,795][52614] Saving new best policy, reward=26.869! [2024-08-05 23:26:33,045][52663] DAMAGECOUNT value on done: 36582.0 [2024-08-05 23:26:33,046][52663] Sum rewards: 21.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.594', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.048', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'AMMO4': '0.242', 'weapon4': '0.280', 'ARMOR': '0.500', 'WEAPON4': '0.650', 'weapon2': '0.770', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'weapon3': '2.654', 'DAMAGECOUNT': '7.725', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:33,627][52795] DAMAGECOUNT value on done: 30103.0 [2024-08-05 23:26:33,627][52795] Sum rewards: 27.685, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.372', 'AMMO5': '0.005', 'AMMO2': '0.034', 'ARMOR': '0.072', 'weapon5': '0.096', 'AMMO3': '0.097', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'weapon4': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.958', 'HITCOUNT': '1.680', 'weapon3': '1.716', 'DAMAGECOUNT': '6.669', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:33,995][52667] DAMAGECOUNT value on done: 35034.0 [2024-08-05 23:26:33,997][52667] Sum rewards: 30.975, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.146', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.095', 'AMMO3': '0.145', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.440', 'weapon2': '0.966', 'WEAPON3': '1.050', 'weapon3': '2.226', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '8.577', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:34,867][52650] Updated weights for policy 0, policy_version 14961 (0.0022) [2024-08-05 23:26:34,916][52670] DAMAGECOUNT value on done: 32945.0 [2024-08-05 23:26:34,917][52670] Sum rewards: 23.127, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.920', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.336', 'WEAPON4': '0.350', 'ARMOR': '0.853', 'weapon2': '1.118', 'WEAPON3': '1.300', 'HITCOUNT': '1.920', 'weapon3': '2.286', 'DAMAGECOUNT': '6.660', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:34,942][52665] DAMAGECOUNT value on done: 32664.0 [2024-08-05 23:26:34,943][52665] Sum rewards: 26.186, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.685', 'AMMO5': '0.013', 'weapon5': '0.024', 'AMMO2': '0.047', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO4': '0.234', 'WEAPON4': '0.400', 'ARMOR': '0.464', 'WEAPON3': '0.750', 'weapon2': '1.358', 'HITCOUNT': '1.600', 'weapon3': '1.894', 'DAMAGECOUNT': '6.075', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:35,155][52666] DAMAGECOUNT value on done: 32847.0 [2024-08-05 23:26:35,155][52666] Sum rewards: 31.177, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.577', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.550', 'WEAPON3': '0.850', 'weapon2': '0.878', 'ARMOR': '0.881', 'HITCOUNT': '2.240', 'weapon3': '2.380', 'DAMAGECOUNT': '8.508', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:35,399][52658] DAMAGECOUNT value on done: 35637.0 [2024-08-05 23:26:35,399][52658] Sum rewards: 25.091, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.111', 'weapon5': '0.152', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'ARMOR': '0.906', 'HITCOUNT': '1.550', 'weapon3': '1.656', 'weapon2': '1.740', 'DAMAGECOUNT': '6.741', 'FRAGCOUNT': '18.000'} [2024-08-05 23:26:35,623][52663] DAMAGECOUNT value on done: 32631.0 [2024-08-05 23:26:35,623][52663] Sum rewards: 33.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.884', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'ARMOR': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.464', 'HITCOUNT': '2.160', 'weapon3': '2.182', 'DAMAGECOUNT': '9.285', 'FRAGCOUNT': '27.000'} [2024-08-05 23:26:36,709][52795] DAMAGECOUNT value on done: 32174.0 [2024-08-05 23:26:36,709][52795] Sum rewards: 33.984, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.676', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon2': '0.878', 'WEAPON3': '1.000', 'HITCOUNT': '1.800', 'weapon3': '2.322', 'DAMAGECOUNT': '8.376', 'FRAGCOUNT': '29.000'} [2024-08-05 23:26:37,128][52667] DAMAGECOUNT value on done: 34937.0 [2024-08-05 23:26:37,130][52667] Sum rewards: 31.694, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.359', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'AMMO3': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.216', 'ARMOR': '0.404', 'WEAPON3': '0.750', 'weapon2': '1.568', 'HITCOUNT': '1.810', 'weapon3': '1.902', 'DAMAGECOUNT': '7.275', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:37,776][52670] DAMAGECOUNT value on done: 35117.0 [2024-08-05 23:26:37,776][52670] Sum rewards: 28.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.688', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.161', 'WEAPON4': '0.350', 'weapon4': '0.502', 'ARMOR': '0.564', 'weapon2': '0.886', 'WEAPON3': '1.000', 'HITCOUNT': '1.990', 'weapon3': '2.308', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '24.500'} [2024-08-05 23:26:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 122609664. Throughput: 0: 4325.1. Samples: 30655830. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:26:37,794][52567] Avg episode reward: [(0, '27.254')] [2024-08-05 23:26:37,797][52614] Saving new best policy, reward=27.254! [2024-08-05 23:26:37,852][52665] DAMAGECOUNT value on done: 31957.0 [2024-08-05 23:26:37,852][52665] Sum rewards: 32.781, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.337', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.106', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.274', 'weapon2': '0.848', 'WEAPON3': '1.050', 'HITCOUNT': '1.940', 'weapon3': '2.416', 'DAMAGECOUNT': '8.685', 'FRAGCOUNT': '28.000'} [2024-08-05 23:26:37,906][52666] DAMAGECOUNT value on done: 30895.0 [2024-08-05 23:26:37,906][52666] Sum rewards: 21.317, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.092', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.175', 'weapon4': '0.180', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'WEAPON3': '1.200', 'weapon2': '1.358', 'HITCOUNT': '1.830', 'weapon3': '2.100', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:38,290][52658] DAMAGECOUNT value on done: 35039.0 [2024-08-05 23:26:38,290][52658] Sum rewards: 28.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON3': '1.000', 'weapon2': '1.122', 'ARMOR': '1.200', 'HITCOUNT': '2.190', 'weapon3': '2.424', 'DAMAGECOUNT': '8.595', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:38,739][52663] DAMAGECOUNT value on done: 33903.0 [2024-08-05 23:26:38,741][52663] Sum rewards: 24.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.322', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.160', 'AMMO4': '0.163', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.854', 'WEAPON3': '1.250', 'weapon2': '1.392', 'HITCOUNT': '2.000', 'weapon3': '2.186', 'DAMAGECOUNT': '8.121', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:39,650][52667] DAMAGECOUNT value on done: 36114.0 [2024-08-05 23:26:39,651][52667] Sum rewards: 31.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.025', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon4': '0.084', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'ARMOR': '0.937', 'WEAPON3': '0.950', 'weapon2': '1.142', 'HITCOUNT': '2.190', 'weapon3': '2.368', 'DAMAGECOUNT': '8.613', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:39,839][52650] Updated weights for policy 0, policy_version 14971 (0.0013) [2024-08-05 23:26:39,905][52795] DAMAGECOUNT value on done: 32234.0 [2024-08-05 23:26:39,906][52795] Sum rewards: 32.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.209', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.171', 'WEAPON4': '0.350', 'ARMOR': '0.448', 'weapon4': '0.496', 'WEAPON3': '0.850', 'weapon2': '1.182', 'weapon3': '2.022', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '8.475', 'FRAGCOUNT': '28.000'} [2024-08-05 23:26:40,849][52647] DAMAGECOUNT value on done: 36025.0 [2024-08-05 23:26:40,850][52647] Sum rewards: 29.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.062', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'ARMOR': '0.412', 'WEAPON3': '1.050', 'weapon2': '1.268', 'HITCOUNT': '1.980', 'weapon3': '2.420', 'DAMAGECOUNT': '7.854', 'FRAGCOUNT': '27.000'} [2024-08-05 23:26:40,913][52665] DAMAGECOUNT value on done: 31570.0 [2024-08-05 23:26:40,914][52665] Sum rewards: 32.238, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.120', 'weapon4': '0.154', 'HEALTH': '0.174', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.106', 'HITCOUNT': '1.790', 'weapon3': '2.442', 'DAMAGECOUNT': '7.353', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:40,948][52670] DAMAGECOUNT value on done: 34060.0 [2024-08-05 23:26:40,949][52670] Sum rewards: 30.326, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.624', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'weapon7': '0.070', 'weapon5': '0.094', 'AMMO3': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.462', 'weapon4': '0.596', 'WEAPON3': '0.850', 'weapon2': '1.140', 'weapon3': '1.424', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '8.097', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:40,959][52658] DAMAGECOUNT value on done: 34823.0 [2024-08-05 23:26:40,959][52658] Sum rewards: 25.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.167', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'ARMOR': '0.432', 'weapon4': '0.482', 'WEAPON4': '0.550', 'weapon2': '0.794', 'WEAPON3': '1.100', 'HITCOUNT': '1.990', 'weapon3': '2.476', 'DAMAGECOUNT': '7.557', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:41,110][52666] DAMAGECOUNT value on done: 30833.0 [2024-08-05 23:26:41,111][52666] Sum rewards: 28.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.384', 'ARMOR': '0.482', 'WEAPON3': '0.950', 'weapon2': '1.096', 'HITCOUNT': '1.860', 'weapon3': '2.156', 'DAMAGECOUNT': '6.669', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:41,485][52663] DAMAGECOUNT value on done: 36727.0 [2024-08-05 23:26:41,485][52663] Sum rewards: 24.062, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.007', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'WEAPON3': '0.900', 'ARMOR': '0.913', 'HITCOUNT': '1.710', 'weapon2': '1.716', 'weapon3': '2.028', 'DAMAGECOUNT': '6.147', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 122691584. Throughput: 0: 4319.1. Samples: 30681710. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:26:42,794][52567] Avg episode reward: [(0, '27.639')] [2024-08-05 23:26:42,795][52614] Saving new best policy, reward=27.639! [2024-08-05 23:26:43,069][52795] DAMAGECOUNT value on done: 29964.0 [2024-08-05 23:26:43,075][52795] Sum rewards: 23.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.030', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.226', 'ARMOR': '0.448', 'WEAPON3': '0.800', 'weapon2': '1.348', 'HITCOUNT': '1.750', 'weapon3': '2.094', 'DAMAGECOUNT': '6.258', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:43,542][52647] DAMAGECOUNT value on done: 36378.0 [2024-08-05 23:26:43,542][52647] Sum rewards: 32.519, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.112', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON3': '0.950', 'weapon2': '1.138', 'HITCOUNT': '2.180', 'weapon3': '2.608', 'DAMAGECOUNT': '8.460', 'FRAGCOUNT': '28.000'} [2024-08-05 23:26:43,957][52663] DAMAGECOUNT value on done: 34038.0 [2024-08-05 23:26:43,959][52663] Sum rewards: 24.425, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'HEALTH': '0.024', 'AMMO2': '0.045', 'weapon5': '0.064', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.272', 'WEAPON3': '0.750', 'ARMOR': '1.212', 'HITCOUNT': '1.650', 'weapon3': '1.686', 'weapon2': '1.708', 'DAMAGECOUNT': '6.747', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:44,063][52650] Updated weights for policy 0, policy_version 14981 (0.0012) [2024-08-05 23:26:44,095][52658] DAMAGECOUNT value on done: 32325.0 [2024-08-05 23:26:44,099][52658] Sum rewards: 27.710, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.017', 'ARMOR': '0.020', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.226', 'HITCOUNT': '2.220', 'weapon3': '2.400', 'DAMAGECOUNT': '8.223', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:44,141][52670] DAMAGECOUNT value on done: 34447.0 [2024-08-05 23:26:44,143][52670] Sum rewards: 35.385, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.235', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.060', 'AMMO4': '0.110', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON3': '0.900', 'weapon2': '1.166', 'weapon3': '2.066', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '8.286', 'FRAGCOUNT': '30.000'} [2024-08-05 23:26:44,252][52666] DAMAGECOUNT value on done: 31959.0 [2024-08-05 23:26:44,252][52666] Sum rewards: 21.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.808', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.181', 'WEAPON4': '0.400', 'weapon4': '0.556', 'ARMOR': '0.825', 'weapon2': '1.072', 'WEAPON3': '1.200', 'HITCOUNT': '1.910', 'weapon3': '2.092', 'DAMAGECOUNT': '8.145', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:46,188][52795] DAMAGECOUNT value on done: 33745.0 [2024-08-05 23:26:46,188][52795] Sum rewards: 31.250, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.497', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon4': '0.040', 'AMMO3': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'WEAPON3': '0.750', 'ARMOR': '0.818', 'weapon2': '1.716', 'weapon3': '1.730', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.028', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:46,277][52647] DAMAGECOUNT value on done: 39027.0 [2024-08-05 23:26:46,277][52647] Sum rewards: 29.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.678', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO3': '0.136', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '0.850', 'ARMOR': '0.857', 'weapon2': '1.228', 'HITCOUNT': '2.080', 'weapon3': '2.144', 'DAMAGECOUNT': '7.698', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:46,288][52663] DAMAGECOUNT value on done: 33678.0 [2024-08-05 23:26:46,288][52663] Sum rewards: 23.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.058', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.086', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.324', 'ARMOR': '0.400', 'weapon2': '0.834', 'WEAPON3': '1.150', 'HITCOUNT': '1.850', 'weapon3': '2.282', 'DAMAGECOUNT': '7.764', 'FRAGCOUNT': '21.000'} [2024-08-05 23:26:46,460][52671] DAMAGECOUNT value on done: 36810.0 [2024-08-05 23:26:46,460][52671] Sum rewards: 29.117, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.087', 'weapon5': '0.098', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'HEALTH': '0.241', 'ARMOR': '0.455', 'WEAPON3': '0.500', 'weapon4': '0.676', 'weapon2': '0.796', 'weapon3': '1.682', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '6.459', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:47,120][52658] DAMAGECOUNT value on done: 34708.0 [2024-08-05 23:26:47,121][52658] Sum rewards: 24.112, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.038', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.282', 'ARMOR': '0.444', 'WEAPON3': '0.850', 'weapon2': '1.212', 'HITCOUNT': '1.600', 'weapon3': '2.100', 'DAMAGECOUNT': '6.288', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:47,134][52670] DAMAGECOUNT value on done: 33365.0 [2024-08-05 23:26:47,135][52670] Sum rewards: 35.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.705', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO3': '0.141', 'weapon4': '0.166', 'WEAPON5': '0.250', 'ARMOR': '0.876', 'WEAPON3': '0.900', 'weapon2': '0.950', 'HITCOUNT': '2.090', 'weapon3': '2.512', 'DAMAGECOUNT': '8.520', 'FRAGCOUNT': '29.000'} [2024-08-05 23:26:47,340][52666] DAMAGECOUNT value on done: 31539.0 [2024-08-05 23:26:47,340][52666] Sum rewards: 39.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.004', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.200', 'ARMOR': '0.503', 'weapon2': '1.102', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '2.460', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '35.000'} [2024-08-05 23:26:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.9, 300 sec: 17439.3). Total num frames: 122781696. Throughput: 0: 4323.1. Samples: 30694760. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:26:47,794][52567] Avg episode reward: [(0, '27.971')] [2024-08-05 23:26:47,798][52614] Saving new best policy, reward=27.971! [2024-08-05 23:26:49,049][52650] Updated weights for policy 0, policy_version 14991 (0.0011) [2024-08-05 23:26:49,077][52663] DAMAGECOUNT value on done: 32439.0 [2024-08-05 23:26:49,079][52663] Sum rewards: 20.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.208', 'weapon4': '0.276', 'WEAPON4': '0.400', 'ARMOR': '0.963', 'weapon2': '1.204', 'WEAPON3': '1.250', 'HITCOUNT': '1.700', 'weapon3': '2.216', 'DAMAGECOUNT': '6.768', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:49,271][52647] DAMAGECOUNT value on done: 35495.0 [2024-08-05 23:26:49,271][52647] Sum rewards: 26.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.847', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.187', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.298', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.906', 'WEAPON3': '1.250', 'HITCOUNT': '1.950', 'weapon3': '2.042', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:49,509][52795] DAMAGECOUNT value on done: 32946.0 [2024-08-05 23:26:49,509][52795] Sum rewards: 35.068, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.020', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.100', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'weapon2': '1.334', 'HITCOUNT': '2.180', 'weapon3': '2.384', 'DAMAGECOUNT': '8.751', 'FRAGCOUNT': '29.000'} [2024-08-05 23:26:49,539][52671] DAMAGECOUNT value on done: 32777.0 [2024-08-05 23:26:49,539][52671] Sum rewards: 27.375, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.938', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.060', 'AMMO3': '0.105', 'AMMO4': '0.107', 'weapon4': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'weapon2': '1.288', 'ARMOR': '1.312', 'weapon3': '1.634', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '7.647', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:50,136][52658] DAMAGECOUNT value on done: 34766.0 [2024-08-05 23:26:50,139][52658] Sum rewards: 14.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.446', 'AMMO2': '0.042', 'AMMO3': '0.134', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '0.800', 'weapon2': '1.202', 'ARMOR': '1.294', 'HITCOUNT': '1.450', 'weapon3': '1.742', 'DAMAGECOUNT': '4.959', 'FRAGCOUNT': '13.000'} [2024-08-05 23:26:50,331][52670] DAMAGECOUNT value on done: 32359.0 [2024-08-05 23:26:50,332][52670] Sum rewards: 25.000, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.142', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.102', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.628', 'HITCOUNT': '1.850', 'weapon3': '2.164', 'DAMAGECOUNT': '6.675', 'FRAGCOUNT': '19.000'} [2024-08-05 23:26:50,441][52666] DAMAGECOUNT value on done: 32065.0 [2024-08-05 23:26:50,443][52666] Sum rewards: 31.304, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.406', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.091', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.366', 'WEAPON3': '0.800', 'weapon2': '1.120', 'ARMOR': '1.319', 'HITCOUNT': '1.680', 'weapon3': '2.180', 'DAMAGECOUNT': '6.810', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:51,928][52647] DAMAGECOUNT value on done: 36584.0 [2024-08-05 23:26:51,928][52647] Sum rewards: 41.952, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.543', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.588', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '2.712', 'DAMAGECOUNT': '9.513', 'FRAGCOUNT': '37.000'} [2024-08-05 23:26:52,086][52663] DAMAGECOUNT value on done: 34032.0 [2024-08-05 23:26:52,086][52663] Sum rewards: 29.541, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.210', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.146', 'weapon4': '0.218', 'weapon5': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.473', 'weapon2': '0.928', 'WEAPON3': '1.000', 'weapon3': '1.982', 'HITCOUNT': '2.020', 'DAMAGECOUNT': '7.599', 'FRAGCOUNT': '26.000'} [2024-08-05 23:26:52,394][52671] DAMAGECOUNT value on done: 34196.0 [2024-08-05 23:26:52,395][52671] Sum rewards: 30.449, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.192', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.142', 'AMMO4': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.332', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.348', 'HITCOUNT': '1.980', 'weapon3': '2.002', 'DAMAGECOUNT': '7.224', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:52,698][52795] DAMAGECOUNT value on done: 32124.0 [2024-08-05 23:26:52,700][52795] Sum rewards: 25.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.934', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.126', 'AMMO3': '0.175', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.861', 'WEAPON3': '1.050', 'weapon2': '1.266', 'HITCOUNT': '1.740', 'weapon3': '2.110', 'DAMAGECOUNT': '6.987', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 122871808. Throughput: 0: 4332.0. Samples: 30720960. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 23:26:52,795][52567] Avg episode reward: [(0, '28.156')] [2024-08-05 23:26:52,795][52614] Saving new best policy, reward=28.156! [2024-08-05 23:26:52,878][52670] DAMAGECOUNT value on done: 31716.0 [2024-08-05 23:26:52,878][52670] Sum rewards: 27.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.264', 'ARMOR': '0.854', 'weapon2': '0.948', 'WEAPON3': '1.350', 'HITCOUNT': '1.690', 'weapon3': '2.512', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '27.000'} [2024-08-05 23:26:52,983][52666] DAMAGECOUNT value on done: 33762.0 [2024-08-05 23:26:52,983][52666] Sum rewards: 29.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.077', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.688', 'WEAPON3': '1.500', 'HITCOUNT': '2.160', 'weapon3': '2.822', 'DAMAGECOUNT': '10.062', 'FRAGCOUNT': '28.000'} [2024-08-05 23:26:53,146][52658] DAMAGECOUNT value on done: 33188.0 [2024-08-05 23:26:53,147][52658] Sum rewards: 26.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.814', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon5': '0.080', 'AMMO3': '0.180', 'AMMO4': '0.194', 'weapon2': '0.368', 'WEAPON5': '0.400', 'weapon4': '0.414', 'ARMOR': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.170', 'weapon3': '2.526', 'DAMAGECOUNT': '8.262', 'FRAGCOUNT': '25.000'} [2024-08-05 23:26:53,658][52650] Updated weights for policy 0, policy_version 15001 (0.0013) [2024-08-05 23:26:54,459][52647] DAMAGECOUNT value on done: 35948.0 [2024-08-05 23:26:54,459][52647] Sum rewards: 23.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.994', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO3': '0.152', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.686', 'WEAPON3': '0.950', 'HITCOUNT': '1.790', 'weapon3': '2.320', 'DAMAGECOUNT': '6.546', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:55,013][52671] DAMAGECOUNT value on done: 33164.0 [2024-08-05 23:26:55,013][52671] Sum rewards: 30.408, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.458', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.068', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon4': '0.284', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'weapon2': '0.704', 'WEAPON3': '0.850', 'HITCOUNT': '2.030', 'weapon3': '2.452', 'DAMAGECOUNT': '7.494', 'FRAGCOUNT': '24.000'} [2024-08-05 23:26:55,114][52663] DAMAGECOUNT value on done: 33207.0 [2024-08-05 23:26:55,119][52663] Sum rewards: 29.863, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.264', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO3': '0.093', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.356', 'WEAPON3': '0.600', 'weapon2': '1.152', 'ARMOR': '1.228', 'weapon3': '1.796', 'HITCOUNT': '1.870', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:55,767][52670] DAMAGECOUNT value on done: 32816.0 [2024-08-05 23:26:55,768][52670] Sum rewards: 35.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.630', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.181', 'weapon4': '0.254', 'ARMOR': '0.447', 'weapon2': '1.186', 'WEAPON3': '1.200', 'weapon3': '2.048', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.474', 'FRAGCOUNT': '31.000'} [2024-08-05 23:26:55,907][52658] DAMAGECOUNT value on done: 35967.0 [2024-08-05 23:26:55,909][52658] Sum rewards: 27.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.155', 'weapon5': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.056', 'ARMOR': '0.064', 'AMMO3': '0.164', 'AMMO4': '0.279', 'weapon4': '0.344', 'WEAPON5': '0.400', 'weapon2': '0.572', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.768', 'DAMAGECOUNT': '9.015', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:55,917][52795] DAMAGECOUNT value on done: 33629.0 [2024-08-05 23:26:55,918][52795] Sum rewards: 29.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.036', 'AMMO4': '0.143', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.450', 'ARMOR': '0.904', 'weapon2': '1.018', 'WEAPON3': '1.200', 'HITCOUNT': '2.090', 'weapon3': '2.386', 'DAMAGECOUNT': '8.490', 'FRAGCOUNT': '26.500'} [2024-08-05 23:26:56,086][52666] DAMAGECOUNT value on done: 32409.0 [2024-08-05 23:26:56,086][52666] Sum rewards: 26.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.344', 'HITCOUNT': '1.830', 'weapon3': '1.898', 'ARMOR': '1.907', 'DAMAGECOUNT': '7.104', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:57,031][52647] DAMAGECOUNT value on done: 35193.0 [2024-08-05 23:26:57,031][52647] Sum rewards: 29.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.443', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.358', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '1.358', 'weapon3': '2.054', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '7.860', 'FRAGCOUNT': '23.500'} [2024-08-05 23:26:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 122961920. Throughput: 0: 4342.0. Samples: 30747100. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 23:26:57,794][52567] Avg episode reward: [(0, '28.295')] [2024-08-05 23:26:57,798][52614] Saving new best policy, reward=28.295! [2024-08-05 23:26:57,824][52671] DAMAGECOUNT value on done: 32377.0 [2024-08-05 23:26:57,825][52671] Sum rewards: 23.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.912', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.024', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.084', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon4': '0.482', 'weapon2': '0.808', 'WEAPON3': '1.450', 'HITCOUNT': '2.050', 'weapon3': '2.418', 'DAMAGECOUNT': '7.935', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:57,888][52659] DAMAGECOUNT value on done: 33202.0 [2024-08-05 23:26:57,890][52659] Sum rewards: 24.269, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.880', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.264', 'ARMOR': '0.428', 'WEAPON3': '0.850', 'weapon2': '1.530', 'weapon3': '1.554', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '20.000'} [2024-08-05 23:26:58,066][52663] DAMAGECOUNT value on done: 34154.0 [2024-08-05 23:26:58,066][52663] Sum rewards: 27.816, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'HEALTH': '0.112', 'AMMO3': '0.146', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.398', 'HITCOUNT': '1.800', 'weapon3': '2.312', 'DAMAGECOUNT': '6.630', 'FRAGCOUNT': '23.000'} [2024-08-05 23:26:58,564][52650] Updated weights for policy 0, policy_version 15011 (0.0011) [2024-08-05 23:26:58,616][52658] DAMAGECOUNT value on done: 36938.0 [2024-08-05 23:26:58,618][52658] Sum rewards: 29.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.844', 'AMMO5': '0.005', 'AMMO2': '0.034', 'ARMOR': '0.040', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.168', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.878', 'WEAPON3': '1.050', 'HITCOUNT': '1.870', 'weapon3': '2.678', 'DAMAGECOUNT': '8.175', 'FRAGCOUNT': '28.000'} [2024-08-05 23:26:58,922][52670] DAMAGECOUNT value on done: 32131.0 [2024-08-05 23:26:58,922][52670] Sum rewards: 31.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.352', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.011', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.208', 'ARMOR': '0.429', 'weapon2': '0.896', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.316', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '26.500'} [2024-08-05 23:26:59,130][52795] DAMAGECOUNT value on done: 34455.0 [2024-08-05 23:26:59,133][52795] Sum rewards: 22.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.828', 'weapon5': '0.008', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.044', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'AMMO4': '0.218', 'WEAPON4': '0.350', 'ARMOR': '0.875', 'weapon2': '1.226', 'WEAPON3': '1.400', 'HITCOUNT': '1.750', 'weapon3': '2.456', 'DAMAGECOUNT': '6.732', 'FRAGCOUNT': '22.000'} [2024-08-05 23:26:59,973][52647] DAMAGECOUNT value on done: 37723.0 [2024-08-05 23:26:59,974][52647] Sum rewards: 22.136, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.378', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.070', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'AMMO4': '0.262', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.564', 'WEAPON3': '0.850', 'weapon2': '0.876', 'HITCOUNT': '1.870', 'weapon3': '2.036', 'DAMAGECOUNT': '7.443', 'FRAGCOUNT': '19.000'} [2024-08-05 23:27:00,353][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:27:00,566][52671] DAMAGECOUNT value on done: 36587.0 [2024-08-05 23:27:00,566][52671] Sum rewards: 28.872, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'HEALTH': '0.168', 'weapon4': '0.242', 'WEAPON3': '0.850', 'weapon2': '1.286', 'ARMOR': '1.319', 'HITCOUNT': '1.940', 'weapon3': '2.166', 'DAMAGECOUNT': '7.506', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:00,624][52659] DAMAGECOUNT value on done: 35743.0 [2024-08-05 23:27:00,625][52659] Sum rewards: 25.538, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'ARMOR': '0.041', 'AMMO2': '0.047', 'AMMO3': '0.137', 'weapon5': '0.156', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'HEALTH': '0.564', 'WEAPON3': '0.750', 'weapon4': '0.784', 'weapon2': '0.920', 'weapon3': '1.846', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '8.304', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:00,776][52663] DAMAGECOUNT value on done: 34859.0 [2024-08-05 23:27:00,776][52663] Sum rewards: 24.860, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.130', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.236', 'HITCOUNT': '1.600', 'weapon3': '2.360', 'DAMAGECOUNT': '6.234', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:01,614][52670] DAMAGECOUNT value on done: 32180.0 [2024-08-05 23:27:01,616][52670] Sum rewards: 26.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.057', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'weapon2': '1.228', 'HITCOUNT': '1.860', 'weapon3': '2.504', 'DAMAGECOUNT': '8.070', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:01,788][52658] DAMAGECOUNT value on done: 33697.0 [2024-08-05 23:27:01,789][52658] Sum rewards: 18.213, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.106', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.128', 'AMMO4': '0.153', 'weapon4': '0.168', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'ARMOR': '1.236', 'HITCOUNT': '1.410', 'weapon2': '1.536', 'weapon3': '1.814', 'DAMAGECOUNT': '6.372', 'FRAGCOUNT': '15.000'} [2024-08-05 23:27:02,245][52795] DAMAGECOUNT value on done: 30338.0 [2024-08-05 23:27:02,245][52795] Sum rewards: 37.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.042', 'AMMO2': '0.041', 'ARMOR': '0.064', 'AMMO3': '0.124', 'AMMO4': '0.207', 'WEAPON4': '0.450', 'weapon4': '0.608', 'weapon2': '0.848', 'WEAPON3': '0.850', 'weapon3': '2.206', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '8.208', 'FRAGCOUNT': '30.000'} [2024-08-05 23:27:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17340.5, 300 sec: 17411.5). Total num frames: 123043840. Throughput: 0: 4341.1. Samples: 30759980. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 23:27:02,794][52567] Avg episode reward: [(0, '28.116')] [2024-08-05 23:27:02,954][52647] DAMAGECOUNT value on done: 37122.0 [2024-08-05 23:27:02,954][52647] Sum rewards: 24.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.462', 'weapon4': '0.018', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'ARMOR': '0.487', 'weapon2': '0.998', 'WEAPON3': '1.200', 'HITCOUNT': '2.030', 'weapon3': '2.750', 'DAMAGECOUNT': '7.725', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:03,294][52650] Updated weights for policy 0, policy_version 15021 (0.0029) [2024-08-05 23:27:03,299][52663] DAMAGECOUNT value on done: 33930.0 [2024-08-05 23:27:03,303][52663] Sum rewards: 27.523, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'AMMO5': '0.004', 'AMMO2': '0.031', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.152', 'WEAPON4': '0.300', 'ARMOR': '0.469', 'weapon4': '0.606', 'WEAPON3': '0.700', 'weapon2': '0.884', 'weapon3': '1.704', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '7.884', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:03,511][52671] DAMAGECOUNT value on done: 33910.0 [2024-08-05 23:27:03,511][52671] Sum rewards: 23.033, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.829', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.113', 'weapon4': '0.148', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.244', 'ARMOR': '1.335', 'HITCOUNT': '1.950', 'weapon3': '2.206', 'DAMAGECOUNT': '7.488', 'FRAGCOUNT': '19.000'} [2024-08-05 23:27:03,549][52659] DAMAGECOUNT value on done: 33819.0 [2024-08-05 23:27:03,549][52659] Sum rewards: 27.401, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.128', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon4': '0.268', 'WEAPON3': '0.850', 'weapon2': '1.020', 'ARMOR': '1.272', 'HITCOUNT': '1.880', 'weapon3': '2.418', 'DAMAGECOUNT': '7.065', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:04,158][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:27:04,540][52658] DAMAGECOUNT value on done: 33304.0 [2024-08-05 23:27:04,542][52658] Sum rewards: 31.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'weapon4': '0.142', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.866', 'WEAPON3': '0.950', 'weapon2': '1.482', 'HITCOUNT': '1.880', 'weapon3': '2.132', 'DAMAGECOUNT': '7.359', 'FRAGCOUNT': '27.000'} [2024-08-05 23:27:05,385][52795] DAMAGECOUNT value on done: 30896.0 [2024-08-05 23:27:05,386][52795] Sum rewards: 22.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.892', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.086', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.484', 'weapon2': '1.088', 'WEAPON3': '1.200', 'ARMOR': '1.254', 'HITCOUNT': '1.590', 'weapon3': '1.936', 'DAMAGECOUNT': '6.159', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:05,735][52649] DAMAGECOUNT value on done: 33193.0 [2024-08-05 23:27:05,737][52649] Sum rewards: 18.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO3': '0.140', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.446', 'WEAPON3': '0.900', 'ARMOR': '1.236', 'HITCOUNT': '1.270', 'weapon2': '1.368', 'weapon3': '1.492', 'DAMAGECOUNT': '5.580', 'FRAGCOUNT': '18.000'} [2024-08-05 23:27:05,949][52671] DAMAGECOUNT value on done: 36498.0 [2024-08-05 23:27:05,950][52671] Sum rewards: 24.052, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.199', 'weapon4': '0.426', 'WEAPON4': '0.500', 'ARMOR': '0.971', 'weapon2': '0.990', 'WEAPON3': '1.300', 'HITCOUNT': '1.950', 'weapon3': '2.308', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:05,970][52647] DAMAGECOUNT value on done: 35500.0 [2024-08-05 23:27:05,971][52647] Sum rewards: 30.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.099', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.388', 'ARMOR': '0.448', 'WEAPON3': '1.100', 'weapon2': '1.198', 'weapon3': '1.976', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '8.235', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:06,052][52659] DAMAGECOUNT value on done: 35096.0 [2024-08-05 23:27:06,053][52659] Sum rewards: 30.778, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.893', 'WEAPON3': '0.900', 'weapon2': '1.014', 'HITCOUNT': '1.810', 'weapon3': '2.326', 'DAMAGECOUNT': '8.658', 'FRAGCOUNT': '23.500'} [2024-08-05 23:27:06,174][52663] DAMAGECOUNT value on done: 33180.0 [2024-08-05 23:27:06,175][52663] Sum rewards: 26.952, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.041', 'ARMOR': '0.072', 'weapon5': '0.138', 'AMMO3': '0.151', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.540', 'weapon2': '0.652', 'WEAPON3': '1.100', 'HITCOUNT': '1.970', 'weapon3': '2.264', 'DAMAGECOUNT': '7.338', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:07,347][52658] DAMAGECOUNT value on done: 35979.0 [2024-08-05 23:27:07,348][52658] Sum rewards: 38.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.181', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'ARMOR': '0.899', 'weapon2': '0.906', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.806', 'DAMAGECOUNT': '10.167', 'FRAGCOUNT': '34.000'} [2024-08-05 23:27:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17383.7). Total num frames: 123125760. Throughput: 0: 4342.0. Samples: 30786280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:27:07,794][52567] Avg episode reward: [(0, '28.119')] [2024-08-05 23:27:08,105][52650] Updated weights for policy 0, policy_version 15031 (0.0023) [2024-08-05 23:27:08,523][52795] DAMAGECOUNT value on done: 32589.0 [2024-08-05 23:27:08,531][52795] Sum rewards: 28.998, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.125', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.128', 'weapon4': '0.132', 'WEAPON4': '0.150', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon3': '1.820', 'weapon2': '1.890', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '7.251', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:08,668][52649] DAMAGECOUNT value on done: 34184.0 [2024-08-05 23:27:08,670][52649] Sum rewards: 32.633, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.008', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.032', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON3': '1.050', 'weapon2': '1.298', 'ARMOR': '1.394', 'HITCOUNT': '2.180', 'weapon3': '2.224', 'DAMAGECOUNT': '8.187', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:08,936][52663] DAMAGECOUNT value on done: 33502.0 [2024-08-05 23:27:08,938][52663] Sum rewards: 25.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.618', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.090', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.256', 'weapon4': '0.342', 'WEAPON4': '0.600', 'ARMOR': '0.800', 'weapon2': '0.968', 'WEAPON3': '1.050', 'HITCOUNT': '2.000', 'weapon3': '2.288', 'DAMAGECOUNT': '7.800', 'FRAGCOUNT': '21.500'} [2024-08-05 23:27:08,963][52671] DAMAGECOUNT value on done: 35001.0 [2024-08-05 23:27:08,963][52671] Sum rewards: 33.881, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.238', 'ARMOR': '0.485', 'WEAPON3': '0.900', 'weapon2': '1.284', 'HITCOUNT': '1.900', 'weapon3': '2.510', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '30.000'} [2024-08-05 23:27:09,010][52647] DAMAGECOUNT value on done: 36384.0 [2024-08-05 23:27:09,010][52647] Sum rewards: 18.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.364', 'ARMOR': '0.874', 'weapon2': '0.938', 'WEAPON3': '1.250', 'HITCOUNT': '1.890', 'weapon3': '2.054', 'DAMAGECOUNT': '7.287', 'FRAGCOUNT': '16.000'} [2024-08-05 23:27:09,031][52659] DAMAGECOUNT value on done: 33691.0 [2024-08-05 23:27:09,031][52659] Sum rewards: 20.836, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.054', 'AMMO2': '0.013', 'weapon5': '0.016', 'AMMO5': '0.017', 'AMMO4': '0.067', 'AMMO3': '0.121', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'ARMOR': '0.942', 'weapon2': '0.964', 'HITCOUNT': '1.530', 'weapon3': '1.758', 'DAMAGECOUNT': '5.931', 'FRAGCOUNT': '18.000'} [2024-08-05 23:27:11,440][52647] DAMAGECOUNT value on done: 33412.0 [2024-08-05 23:27:11,440][52647] Sum rewards: 31.416, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.589', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'ARMOR': '0.804', 'WEAPON3': '1.050', 'weapon2': '1.348', 'HITCOUNT': '2.060', 'weapon3': '2.180', 'DAMAGECOUNT': '8.574', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:11,734][52649] DAMAGECOUNT value on done: 33267.0 [2024-08-05 23:27:11,736][52649] Sum rewards: 19.065, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.982', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.188', 'weapon4': '0.246', 'WEAPON4': '0.250', 'ARMOR': '0.924', 'WEAPON3': '1.100', 'weapon2': '1.458', 'HITCOUNT': '1.620', 'weapon3': '1.868', 'DAMAGECOUNT': '6.798', 'FRAGCOUNT': '17.000'} [2024-08-05 23:27:12,174][52671] DAMAGECOUNT value on done: 37329.0 [2024-08-05 23:27:12,175][52671] Sum rewards: 24.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.826', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.066', 'weapon4': '0.098', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'ARMOR': '0.804', 'WEAPON3': '1.100', 'weapon2': '1.254', 'HITCOUNT': '1.950', 'weapon3': '2.282', 'DAMAGECOUNT': '7.665', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:12,204][52650] Updated weights for policy 0, policy_version 15041 (0.0011) [2024-08-05 23:27:12,278][52659] DAMAGECOUNT value on done: 36044.0 [2024-08-05 23:27:12,282][52659] Sum rewards: 19.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.315', 'AMMO5': '0.010', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.178', 'AMMO4': '0.191', 'WEAPON4': '0.400', 'ARMOR': '0.836', 'WEAPON3': '1.000', 'weapon2': '1.182', 'HITCOUNT': '1.720', 'weapon3': '2.172', 'DAMAGECOUNT': '7.191', 'FRAGCOUNT': '19.000'} [2024-08-05 23:27:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 123224064. Throughput: 0: 4349.1. Samples: 30812660. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:27:12,794][52567] Avg episode reward: [(0, '27.893')] [2024-08-05 23:27:14,030][52647] DAMAGECOUNT value on done: 35618.0 [2024-08-05 23:27:14,031][52647] Sum rewards: 17.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.242', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.058', 'AMMO4': '0.136', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.350', 'ARMOR': '0.511', 'WEAPON3': '1.050', 'weapon2': '1.256', 'HITCOUNT': '1.550', 'weapon3': '2.048', 'DAMAGECOUNT': '5.751', 'FRAGCOUNT': '18.000'} [2024-08-05 23:27:15,029][52649] DAMAGECOUNT value on done: 34466.0 [2024-08-05 23:27:15,030][52649] Sum rewards: 28.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.716', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon4': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '1.114', 'WEAPON3': '1.150', 'ARMOR': '1.200', 'HITCOUNT': '2.380', 'weapon3': '2.486', 'DAMAGECOUNT': '9.105', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:15,264][52794] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-05 23:27:15,295][52671] DAMAGECOUNT value on done: 33241.0 [2024-08-05 23:27:15,295][52671] Sum rewards: 19.187, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'weapon5': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.150', 'weapon4': '0.166', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.852', 'WEAPON3': '0.900', 'HITCOUNT': '1.390', 'weapon2': '1.636', 'weapon3': '1.748', 'DAMAGECOUNT': '5.214', 'FRAGCOUNT': '17.000'} [2024-08-05 23:27:15,425][52659] DAMAGECOUNT value on done: 35650.0 [2024-08-05 23:27:15,426][52659] Sum rewards: 26.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.493', 'weapon4': '0.556', 'weapon2': '0.816', 'WEAPON3': '0.950', 'HITCOUNT': '1.840', 'weapon3': '2.178', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '23.500'} [2024-08-05 23:27:16,552][52647] DAMAGECOUNT value on done: 35148.0 [2024-08-05 23:27:16,554][52647] Sum rewards: 30.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.415', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.170', 'weapon4': '0.276', 'WEAPON4': '0.300', 'ARMOR': '0.800', 'WEAPON3': '1.100', 'weapon2': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.334', 'DAMAGECOUNT': '9.042', 'FRAGCOUNT': '27.000'} [2024-08-05 23:27:17,175][52650] Updated weights for policy 0, policy_version 15051 (0.0024) [2024-08-05 23:27:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 123305984. Throughput: 0: 4360.9. Samples: 30826010. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:27:17,794][52567] Avg episode reward: [(0, '27.569')] [2024-08-05 23:27:18,120][52649] DAMAGECOUNT value on done: 33317.0 [2024-08-05 23:27:18,122][52649] Sum rewards: 23.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.110', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.312', 'ARMOR': '0.404', 'WEAPON3': '0.800', 'weapon2': '1.468', 'HITCOUNT': '1.530', 'weapon3': '1.992', 'DAMAGECOUNT': '6.051', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:18,433][52671] DAMAGECOUNT value on done: 35552.0 [2024-08-05 23:27:18,434][52671] Sum rewards: 27.196, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.318', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.198', 'ARMOR': '0.861', 'WEAPON3': '1.000', 'weapon2': '1.240', 'HITCOUNT': '1.860', 'weapon3': '2.142', 'DAMAGECOUNT': '7.146', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:18,499][52659] DAMAGECOUNT value on done: 32609.0 [2024-08-05 23:27:18,499][52659] Sum rewards: 21.366, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.696', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.108', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'weapon4': '0.566', 'WEAPON3': '0.750', 'weapon2': '1.052', 'HITCOUNT': '1.670', 'weapon3': '1.876', 'DAMAGECOUNT': '6.324', 'FRAGCOUNT': '19.000'} [2024-08-05 23:27:19,193][52647] DAMAGECOUNT value on done: 37533.0 [2024-08-05 23:27:19,194][52647] Sum rewards: 26.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.198', 'weapon2': '0.714', 'ARMOR': '0.923', 'WEAPON3': '1.250', 'HITCOUNT': '2.250', 'weapon3': '2.770', 'DAMAGECOUNT': '8.412', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:20,961][52649] DAMAGECOUNT value on done: 33803.0 [2024-08-05 23:27:20,961][52649] Sum rewards: 15.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.003', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.190', 'weapon4': '0.278', 'WEAPON4': '0.350', 'ARMOR': '0.493', 'WEAPON3': '1.100', 'weapon2': '1.250', 'HITCOUNT': '1.720', 'weapon3': '2.240', 'DAMAGECOUNT': '6.597', 'FRAGCOUNT': '15.000'} [2024-08-05 23:27:21,552][52650] Updated weights for policy 0, policy_version 15061 (0.0028) [2024-08-05 23:27:21,568][52671] DAMAGECOUNT value on done: 38430.0 [2024-08-05 23:27:21,569][52671] Sum rewards: 24.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO3': '0.161', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.812', 'ARMOR': '0.860', 'WEAPON3': '1.050', 'HITCOUNT': '2.110', 'weapon3': '2.460', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:21,611][52659] DAMAGECOUNT value on done: 32633.0 [2024-08-05 23:27:21,613][52659] Sum rewards: 26.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.808', 'AMMO5': '0.003', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '1.042', 'WEAPON3': '1.150', 'ARMOR': '1.351', 'HITCOUNT': '1.880', 'weapon3': '2.326', 'DAMAGECOUNT': '7.005', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:21,892][52647] DAMAGECOUNT value on done: 33542.0 [2024-08-05 23:27:21,892][52647] Sum rewards: 21.239, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.844', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon4': '0.296', 'ARMOR': '0.845', 'WEAPON3': '0.900', 'weapon2': '1.258', 'HITCOUNT': '1.630', 'weapon3': '1.790', 'DAMAGECOUNT': '6.237', 'FRAGCOUNT': '18.000'} [2024-08-05 23:27:22,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 123387904. Throughput: 0: 4368.4. Samples: 30852410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:27:22,795][52567] Avg episode reward: [(0, '27.252')] [2024-08-05 23:27:23,311][52649] DAMAGECOUNT value on done: 31042.0 [2024-08-05 23:27:23,315][52649] Sum rewards: 25.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.524', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.237', 'weapon4': '0.278', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon2': '0.810', 'WEAPON3': '1.500', 'HITCOUNT': '1.800', 'weapon3': '2.668', 'DAMAGECOUNT': '7.890', 'FRAGCOUNT': '27.000'} [2024-08-05 23:27:24,316][52671] DAMAGECOUNT value on done: 34112.0 [2024-08-05 23:27:24,318][52671] Sum rewards: 30.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.156', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.018', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.236', 'AMMO3': '0.242', 'weapon2': '0.602', 'WEAPON3': '1.600', 'HITCOUNT': '2.410', 'weapon3': '2.936', 'DAMAGECOUNT': '10.365', 'FRAGCOUNT': '31.000'} [2024-08-05 23:27:24,407][52659] DAMAGECOUNT value on done: 35931.0 [2024-08-05 23:27:24,407][52659] Sum rewards: 25.348, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.219', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.016', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.198', 'ARMOR': '0.953', 'weapon2': '1.014', 'WEAPON3': '1.250', 'HITCOUNT': '1.980', 'weapon3': '2.430', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:24,566][52647] DAMAGECOUNT value on done: 34195.0 [2024-08-05 23:27:24,566][52647] Sum rewards: 19.838, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.442', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.178', 'weapon4': '0.286', 'WEAPON4': '0.450', 'ARMOR': '0.524', 'weapon2': '1.182', 'WEAPON3': '1.200', 'HITCOUNT': '1.480', 'weapon3': '2.318', 'DAMAGECOUNT': '6.102', 'FRAGCOUNT': '18.000'} [2024-08-05 23:27:26,310][52649] DAMAGECOUNT value on done: 32528.0 [2024-08-05 23:27:26,324][52649] Sum rewards: 26.470, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.074', 'weapon5': '0.082', 'AMMO3': '0.132', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.320', 'ARMOR': '0.457', 'WEAPON3': '0.750', 'weapon2': '1.498', 'HITCOUNT': '1.750', 'weapon3': '2.116', 'DAMAGECOUNT': '7.356', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:26,421][52650] Updated weights for policy 0, policy_version 15071 (0.0028) [2024-08-05 23:27:27,166][52647] DAMAGECOUNT value on done: 34839.0 [2024-08-05 23:27:27,166][52647] Sum rewards: 21.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.713', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.183', 'ARMOR': '0.948', 'WEAPON3': '1.200', 'weapon2': '1.270', 'HITCOUNT': '1.910', 'weapon3': '2.348', 'DAMAGECOUNT': '7.230', 'FRAGCOUNT': '19.000'} [2024-08-05 23:27:27,579][52671] DAMAGECOUNT value on done: 31067.0 [2024-08-05 23:27:27,580][52671] Sum rewards: 24.781, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.632', 'AMMO2': '0.034', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.169', 'ARMOR': '0.520', 'weapon4': '0.680', 'weapon2': '0.718', 'WEAPON3': '0.900', 'HITCOUNT': '2.070', 'weapon3': '2.226', 'DAMAGECOUNT': '7.545', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:27,657][52659] DAMAGECOUNT value on done: 34236.0 [2024-08-05 23:27:27,660][52659] Sum rewards: 28.538, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.556', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'AMMO3': '0.131', 'weapon4': '0.152', 'WEAPON3': '0.900', 'weapon2': '1.286', 'HITCOUNT': '1.720', 'ARMOR': '1.799', 'weapon3': '2.344', 'DAMAGECOUNT': '6.696', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 123486208. Throughput: 0: 4381.1. Samples: 30878860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:27:27,794][52567] Avg episode reward: [(0, '26.940')] [2024-08-05 23:27:29,445][52649] DAMAGECOUNT value on done: 32313.0 [2024-08-05 23:27:29,454][52649] Sum rewards: 27.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.369', 'AMMO4': '-0.063', 'AMMO2': '-0.012', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'ARMOR': '0.454', 'weapon2': '1.084', 'WEAPON3': '1.250', 'HITCOUNT': '2.090', 'weapon3': '2.414', 'DAMAGECOUNT': '8.430', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:29,687][52647] DAMAGECOUNT value on done: 34823.0 [2024-08-05 23:27:29,687][52647] Sum rewards: 25.120, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.417', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.186', 'weapon4': '0.284', 'WEAPON4': '0.300', 'ARMOR': '0.408', 'weapon2': '0.756', 'WEAPON3': '1.100', 'HITCOUNT': '1.710', 'weapon3': '2.710', 'DAMAGECOUNT': '6.474', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:30,541][52671] DAMAGECOUNT value on done: 36167.0 [2024-08-05 23:27:30,543][52671] Sum rewards: 26.388, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.890', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'AMMO3': '0.114', 'weapon5': '0.122', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'ARMOR': '0.460', 'WEAPON3': '0.800', 'weapon2': '1.332', 'HITCOUNT': '1.780', 'weapon3': '1.916', 'DAMAGECOUNT': '6.960', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:30,602][52659] DAMAGECOUNT value on done: 33909.0 [2024-08-05 23:27:30,603][52659] Sum rewards: 30.120, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.526', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.242', 'ARMOR': '0.400', 'weapon2': '1.042', 'WEAPON3': '1.050', 'HITCOUNT': '2.070', 'weapon3': '2.376', 'DAMAGECOUNT': '7.926', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:31,017][52820] DAMAGECOUNT value on done: 30764.0 [2024-08-05 23:27:31,017][52820] Sum rewards: 27.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.260', 'weapon4': '0.330', 'ARMOR': '0.457', 'WEAPON4': '0.650', 'weapon2': '1.078', 'WEAPON3': '1.400', 'weapon3': '2.182', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.421', 'FRAGCOUNT': '27.000'} [2024-08-05 23:27:31,142][52650] Updated weights for policy 0, policy_version 15081 (0.0027) [2024-08-05 23:27:32,226][52647] DAMAGECOUNT value on done: 36038.0 [2024-08-05 23:27:32,226][52647] Sum rewards: 25.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon2': '1.184', 'HITCOUNT': '1.870', 'weapon3': '2.192', 'DAMAGECOUNT': '7.281', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:32,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 123568128. Throughput: 0: 4387.8. Samples: 30892210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:27:32,794][52567] Avg episode reward: [(0, '26.750')] [2024-08-05 23:27:32,851][52649] DAMAGECOUNT value on done: 31876.0 [2024-08-05 23:27:32,853][52649] Sum rewards: 24.861, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.300', 'weapon4': '0.610', 'WEAPON3': '0.800', 'ARMOR': '0.908', 'weapon2': '1.196', 'weapon3': '1.730', 'HITCOUNT': '1.850', 'DAMAGECOUNT': '7.497', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:33,200][52671] DAMAGECOUNT value on done: 35075.0 [2024-08-05 23:27:33,201][52671] Sum rewards: 27.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.162', 'weapon4': '0.176', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.238', 'ARMOR': '1.394', 'HITCOUNT': '1.970', 'weapon3': '2.374', 'DAMAGECOUNT': '7.974', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:33,253][52659] DAMAGECOUNT value on done: 32434.0 [2024-08-05 23:27:33,254][52659] Sum rewards: 31.427, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.526', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.268', 'ARMOR': '0.858', 'WEAPON3': '0.900', 'weapon2': '1.150', 'HITCOUNT': '2.030', 'weapon3': '2.262', 'DAMAGECOUNT': '7.755', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:34,225][52820] DAMAGECOUNT value on done: 31882.0 [2024-08-05 23:27:34,226][52820] Sum rewards: 28.815, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.031', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.155', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.112', 'weapon3': '2.074', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.271', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:35,470][52649] DAMAGECOUNT value on done: 34357.0 [2024-08-05 23:27:35,478][52649] Sum rewards: 23.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.676', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.090', 'AMMO3': '0.140', 'weapon4': '0.184', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.911', 'WEAPON3': '0.950', 'weapon2': '0.998', 'HITCOUNT': '1.800', 'weapon3': '2.470', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:35,662][52662] DAMAGECOUNT value on done: 39237.0 [2024-08-05 23:27:35,665][52662] Sum rewards: 26.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.152', 'AMMO3': '0.161', 'AMMO4': '0.252', 'weapon4': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.262', 'HITCOUNT': '1.870', 'weapon3': '1.978', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:35,713][52650] Updated weights for policy 0, policy_version 15091 (0.0013) [2024-08-05 23:27:35,994][52794] DAMAGECOUNT value on done: 38720.0 [2024-08-05 23:27:35,997][52794] Sum rewards: 23.169, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.202', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.132', 'WEAPON4': '0.300', 'ARMOR': '0.496', 'weapon4': '0.512', 'WEAPON3': '0.950', 'weapon2': '1.016', 'weapon3': '1.728', 'HITCOUNT': '1.750', 'DAMAGECOUNT': '6.714', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:36,309][52671] DAMAGECOUNT value on done: 35691.0 [2024-08-05 23:27:36,309][52671] Sum rewards: 25.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON3': '1.050', 'ARMOR': '1.249', 'weapon2': '1.590', 'HITCOUNT': '1.730', 'weapon3': '2.216', 'DAMAGECOUNT': '6.978', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:36,422][52659] DAMAGECOUNT value on done: 34117.0 [2024-08-05 23:27:36,422][52659] Sum rewards: 22.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.034', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.230', 'weapon2': '0.872', 'WEAPON3': '1.250', 'ARMOR': '1.300', 'HITCOUNT': '2.060', 'weapon3': '2.576', 'DAMAGECOUNT': '8.406', 'FRAGCOUNT': '20.500'} [2024-08-05 23:27:37,372][52820] DAMAGECOUNT value on done: 30167.0 [2024-08-05 23:27:37,373][52820] Sum rewards: 33.451, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.175', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.146', 'WEAPON4': '0.300', 'weapon4': '0.470', 'weapon2': '0.788', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'HITCOUNT': '1.890', 'weapon3': '2.490', 'DAMAGECOUNT': '7.590', 'FRAGCOUNT': '28.000'} [2024-08-05 23:27:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 123650048. Throughput: 0: 4387.1. Samples: 30918380. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-05 23:27:37,794][52567] Avg episode reward: [(0, '26.684')] [2024-08-05 23:27:38,058][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:27:38,424][52649] DAMAGECOUNT value on done: 32898.0 [2024-08-05 23:27:38,425][52649] Sum rewards: 25.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.216', 'AMMO5': '0.020', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.103', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.770', 'ARMOR': '0.896', 'WEAPON3': '1.300', 'HITCOUNT': '1.720', 'weapon3': '2.500', 'DAMAGECOUNT': '7.941', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:38,652][52671] DAMAGECOUNT value on done: 34092.0 [2024-08-05 23:27:38,654][52671] Sum rewards: 21.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO3': '0.114', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon3': '1.586', 'weapon2': '1.590', 'HITCOUNT': '1.630', 'DAMAGECOUNT': '6.843', 'FRAGCOUNT': '17.000'} [2024-08-05 23:27:38,786][52659] DAMAGECOUNT value on done: 35517.0 [2024-08-05 23:27:38,787][52659] Sum rewards: 32.051, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.588', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.072', 'AMMO3': '0.136', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.374', 'ARMOR': '0.488', 'WEAPON3': '0.850', 'weapon2': '0.870', 'weapon3': '2.414', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.056', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:38,871][52662] DAMAGECOUNT value on done: 40982.0 [2024-08-05 23:27:38,871][52662] Sum rewards: 30.629, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'HEALTH': '0.084', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'ARMOR': '0.412', 'weapon2': '0.708', 'WEAPON3': '1.000', 'HITCOUNT': '2.130', 'weapon3': '2.880', 'DAMAGECOUNT': '9.057', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:39,191][52794] DAMAGECOUNT value on done: 38582.0 [2024-08-05 23:27:39,191][52794] Sum rewards: 23.321, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.033', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'HEALTH': '0.225', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.876', 'weapon2': '1.126', 'HITCOUNT': '1.920', 'weapon3': '2.126', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '19.000'} [2024-08-05 23:27:39,777][52794] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:27:40,590][52650] Updated weights for policy 0, policy_version 15101 (0.0024) [2024-08-05 23:27:40,703][52820] DAMAGECOUNT value on done: 31619.0 [2024-08-05 23:27:40,703][52820] Sum rewards: 30.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.195', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.058', 'weapon4': '0.096', 'AMMO4': '0.137', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'ARMOR': '1.351', 'weapon2': '1.364', 'HITCOUNT': '1.810', 'weapon3': '2.248', 'DAMAGECOUNT': '8.079', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:41,210][52671] DAMAGECOUNT value on done: 33915.0 [2024-08-05 23:27:41,211][52671] Sum rewards: 32.790, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'HEALTH': '0.110', 'AMMO3': '0.120', 'weapon4': '0.204', 'WEAPON3': '0.700', 'ARMOR': '0.858', 'weapon2': '1.252', 'HITCOUNT': '2.070', 'weapon3': '2.268', 'DAMAGECOUNT': '8.325', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:41,432][52659] DAMAGECOUNT value on done: 37523.0 [2024-08-05 23:27:41,432][52659] Sum rewards: 28.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.191', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.477', 'WEAPON3': '1.000', 'weapon2': '1.056', 'HITCOUNT': '1.980', 'weapon3': '2.216', 'DAMAGECOUNT': '7.776', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:41,585][52649] DAMAGECOUNT value on done: 36350.0 [2024-08-05 23:27:41,586][52649] Sum rewards: 30.535, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.045', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.056', 'AMMO3': '0.128', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.492', 'WEAPON4': '0.550', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon4': '0.904', 'weapon3': '2.064', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '7.767', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:41,950][52662] DAMAGECOUNT value on done: 43727.0 [2024-08-05 23:27:41,951][52662] Sum rewards: 34.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.196', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'ARMOR': '0.858', 'WEAPON3': '1.100', 'weapon2': '1.114', 'HITCOUNT': '2.310', 'weapon3': '2.566', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '29.000'} [2024-08-05 23:27:42,279][52794] DAMAGECOUNT value on done: 39869.0 [2024-08-05 23:27:42,280][52794] Sum rewards: 27.939, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.022', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'ARMOR': '0.857', 'WEAPON3': '1.000', 'weapon2': '1.204', 'HITCOUNT': '2.120', 'weapon3': '2.518', 'DAMAGECOUNT': '8.271', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 123740160. Throughput: 0: 4395.3. Samples: 30944890. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-05 23:27:42,794][52567] Avg episode reward: [(0, '26.821')] [2024-08-05 23:27:43,742][52820] DAMAGECOUNT value on done: 32481.0 [2024-08-05 23:27:43,745][52820] Sum rewards: 22.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.396', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.274', 'ARMOR': '0.435', 'weapon2': '1.022', 'WEAPON3': '1.150', 'HITCOUNT': '1.680', 'weapon3': '2.386', 'DAMAGECOUNT': '6.990', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:44,088][52659] DAMAGECOUNT value on done: 33744.0 [2024-08-05 23:27:44,088][52659] Sum rewards: 19.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.551', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'ARMOR': '0.812', 'WEAPON3': '1.150', 'HITCOUNT': '1.450', 'weapon2': '1.456', 'weapon3': '2.274', 'DAMAGECOUNT': '5.976', 'FRAGCOUNT': '18.000'} [2024-08-05 23:27:44,787][52649] DAMAGECOUNT value on done: 33745.0 [2024-08-05 23:27:44,799][52649] Sum rewards: 33.270, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.728', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.023', 'weapon4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.172', 'WEAPON5': '0.300', 'ARMOR': '0.452', 'weapon2': '0.996', 'WEAPON3': '1.150', 'HITCOUNT': '2.130', 'weapon3': '2.526', 'DAMAGECOUNT': '8.616', 'FRAGCOUNT': '28.000'} [2024-08-05 23:27:44,863][52650] Updated weights for policy 0, policy_version 15111 (0.0013) [2024-08-05 23:27:44,917][52662] DAMAGECOUNT value on done: 37105.0 [2024-08-05 23:27:44,918][52662] Sum rewards: 26.933, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'HEALTH': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.198', 'weapon2': '0.780', 'WEAPON3': '1.100', 'HITCOUNT': '1.940', 'weapon3': '2.708', 'DAMAGECOUNT': '8.034', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:45,064][52794] DAMAGECOUNT value on done: 36030.0 [2024-08-05 23:27:45,066][52794] Sum rewards: 30.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.533', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.428', 'ARMOR': '0.898', 'weapon2': '1.126', 'WEAPON3': '1.300', 'weapon3': '2.022', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '8.658', 'FRAGCOUNT': '28.000'} [2024-08-05 23:27:46,955][52820] DAMAGECOUNT value on done: 32441.0 [2024-08-05 23:27:46,955][52820] Sum rewards: 28.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.467', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.070', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.432', 'ARMOR': '0.471', 'weapon2': '0.888', 'WEAPON3': '1.100', 'HITCOUNT': '2.270', 'weapon3': '2.370', 'DAMAGECOUNT': '8.970', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:47,129][52659] DAMAGECOUNT value on done: 35145.0 [2024-08-05 23:27:47,130][52659] Sum rewards: 29.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon4': '0.028', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'ARMOR': '0.869', 'weapon2': '0.878', 'WEAPON3': '1.150', 'HITCOUNT': '2.200', 'weapon3': '2.718', 'DAMAGECOUNT': '9.558', 'FRAGCOUNT': '28.000'} [2024-08-05 23:27:47,282][52649] DAMAGECOUNT value on done: 31138.0 [2024-08-05 23:27:47,282][52649] Sum rewards: 26.865, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.462', 'WEAPON3': '0.850', 'weapon2': '1.266', 'HITCOUNT': '1.830', 'weapon3': '1.850', 'DAMAGECOUNT': '6.255', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:47,713][52662] DAMAGECOUNT value on done: 37957.0 [2024-08-05 23:27:47,715][52662] Sum rewards: 29.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.688', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON3': '0.900', 'ARMOR': '1.300', 'weapon2': '1.402', 'HITCOUNT': '2.000', 'weapon3': '2.058', 'DAMAGECOUNT': '7.683', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 123838464. Throughput: 0: 4398.0. Samples: 30957890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:27:47,794][52567] Avg episode reward: [(0, '26.626')] [2024-08-05 23:27:47,939][52794] DAMAGECOUNT value on done: 39444.0 [2024-08-05 23:27:47,941][52794] Sum rewards: 25.745, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.870', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'ARMOR': '0.903', 'weapon2': '1.412', 'HITCOUNT': '2.100', 'weapon3': '2.134', 'DAMAGECOUNT': '7.950', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:49,879][52650] Updated weights for policy 0, policy_version 15121 (0.0037) [2024-08-05 23:27:49,976][52820] DAMAGECOUNT value on done: 32332.0 [2024-08-05 23:27:49,977][52820] Sum rewards: 22.287, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.383', 'AMMO5': '0.007', 'AMMO2': '0.055', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.240', 'AMMO4': '0.273', 'weapon4': '0.436', 'WEAPON4': '0.550', 'ARMOR': '0.853', 'WEAPON3': '0.900', 'weapon2': '0.934', 'HITCOUNT': '1.500', 'weapon3': '2.080', 'DAMAGECOUNT': '6.063', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:50,277][52659] DAMAGECOUNT value on done: 35910.0 [2024-08-05 23:27:50,277][52659] Sum rewards: 42.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.696', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.159', 'weapon4': '0.212', 'ARMOR': '0.855', 'weapon2': '0.976', 'WEAPON3': '1.050', 'weapon3': '2.582', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '34.000'} [2024-08-05 23:27:50,364][52649] DAMAGECOUNT value on done: 35425.0 [2024-08-05 23:27:50,365][52649] Sum rewards: 20.296, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.382', 'AMMO5': '0.023', 'ARMOR': '0.032', 'AMMO2': '0.044', 'weapon5': '0.060', 'weapon4': '0.144', 'AMMO4': '0.220', 'AMMO3': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.550', 'HITCOUNT': '1.800', 'weapon3': '2.850', 'DAMAGECOUNT': '7.686', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:50,512][52668] DAMAGECOUNT value on done: 34007.0 [2024-08-05 23:27:50,512][52668] Sum rewards: 26.958, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.552', 'WEAPON3': '0.650', 'ARMOR': '0.895', 'weapon2': '1.230', 'weapon3': '1.648', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '7.155', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:50,777][52662] DAMAGECOUNT value on done: 40902.0 [2024-08-05 23:27:50,779][52662] Sum rewards: 38.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.240', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.900', 'ARMOR': '0.900', 'weapon2': '1.252', 'weapon3': '2.234', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.456', 'FRAGCOUNT': '31.000'} [2024-08-05 23:27:51,022][52794] DAMAGECOUNT value on done: 40356.0 [2024-08-05 23:27:51,024][52794] Sum rewards: 20.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.194', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'ARMOR': '0.927', 'WEAPON3': '1.100', 'weapon2': '1.292', 'HITCOUNT': '1.520', 'weapon3': '2.160', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 123920384. Throughput: 0: 4397.3. Samples: 30984160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:27:52,795][52567] Avg episode reward: [(0, '26.566')] [2024-08-05 23:27:52,802][52668] DAMAGECOUNT value on done: 37106.0 [2024-08-05 23:27:52,803][52668] Sum rewards: 30.030, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.032', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon5': '0.112', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.208', 'ARMOR': '0.450', 'weapon2': '1.024', 'WEAPON3': '1.050', 'HITCOUNT': '1.880', 'weapon3': '2.188', 'DAMAGECOUNT': '7.812', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:52,941][52659] DAMAGECOUNT value on done: 37631.0 [2024-08-05 23:27:52,942][52659] Sum rewards: 21.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.702', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.034', 'ARMOR': '0.040', 'AMMO4': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '1.030', 'WEAPON3': '1.350', 'HITCOUNT': '2.170', 'weapon3': '2.270', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:53,098][52820] DAMAGECOUNT value on done: 31718.0 [2024-08-05 23:27:53,098][52820] Sum rewards: 32.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.891', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO3': '0.144', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.476', 'weapon2': '0.592', 'ARMOR': '0.849', 'WEAPON3': '0.950', 'HITCOUNT': '1.920', 'weapon3': '2.420', 'DAMAGECOUNT': '8.598', 'FRAGCOUNT': '27.000'} [2024-08-05 23:27:53,488][52649] DAMAGECOUNT value on done: 31779.0 [2024-08-05 23:27:53,489][52649] Sum rewards: 20.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.222', 'AMMO2': '0.006', 'AMMO5': '0.013', 'AMMO4': '0.028', 'weapon4': '0.034', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'ARMOR': '0.466', 'weapon2': '0.852', 'WEAPON3': '1.400', 'HITCOUNT': '1.980', 'weapon3': '2.798', 'DAMAGECOUNT': '7.509', 'FRAGCOUNT': '21.000'} [2024-08-05 23:27:53,868][52662] DAMAGECOUNT value on done: 41924.0 [2024-08-05 23:27:53,869][52662] Sum rewards: 33.355, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.680', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'weapon4': '0.268', 'ARMOR': '0.458', 'WEAPON3': '1.000', 'weapon2': '1.186', 'HITCOUNT': '2.310', 'weapon3': '2.368', 'DAMAGECOUNT': '8.766', 'FRAGCOUNT': '29.000'} [2024-08-05 23:27:54,102][52794] DAMAGECOUNT value on done: 40217.0 [2024-08-05 23:27:54,102][52794] Sum rewards: 24.285, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO3': '0.124', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.453', 'weapon4': '0.534', 'WEAPON3': '0.850', 'weapon2': '0.884', 'HITCOUNT': '1.790', 'weapon3': '1.790', 'DAMAGECOUNT': '7.299', 'FRAGCOUNT': '20.000'} [2024-08-05 23:27:54,403][52650] Updated weights for policy 0, policy_version 15131 (0.0015) [2024-08-05 23:27:55,273][52668] DAMAGECOUNT value on done: 32663.0 [2024-08-05 23:27:55,273][52668] Sum rewards: 30.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.368', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.900', 'weapon2': '1.228', 'ARMOR': '1.339', 'weapon3': '1.958', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '7.299', 'FRAGCOUNT': '24.000'} [2024-08-05 23:27:56,113][52820] DAMAGECOUNT value on done: 29654.0 [2024-08-05 23:27:56,113][52820] Sum rewards: 30.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.072', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.095', 'weapon5': '0.108', 'AMMO3': '0.191', 'WEAPON3': '1.150', 'ARMOR': '1.251', 'weapon2': '1.376', 'HITCOUNT': '2.000', 'weapon3': '2.274', 'DAMAGECOUNT': '8.727', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:56,200][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:27:56,297][52649] DAMAGECOUNT value on done: 36019.0 [2024-08-05 23:27:56,299][52649] Sum rewards: 32.486, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.792', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.120', 'AMMO3': '0.153', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.206', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.404', 'weapon3': '1.878', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '8.547', 'FRAGCOUNT': '26.000'} [2024-08-05 23:27:56,708][52662] DAMAGECOUNT value on done: 43317.0 [2024-08-05 23:27:56,710][52662] Sum rewards: 38.090, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.272', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.182', 'ARMOR': '0.428', 'WEAPON3': '0.900', 'weapon2': '1.240', 'weapon3': '2.314', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.933', 'FRAGCOUNT': '31.000'} [2024-08-05 23:27:56,851][52794] DAMAGECOUNT value on done: 36508.0 [2024-08-05 23:27:56,853][52794] Sum rewards: 22.951, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.174', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.199', 'ARMOR': '0.416', 'weapon2': '1.182', 'WEAPON3': '1.200', 'HITCOUNT': '2.050', 'weapon3': '2.456', 'DAMAGECOUNT': '8.232', 'FRAGCOUNT': '23.000'} [2024-08-05 23:27:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 124010496. Throughput: 0: 4395.5. Samples: 31010460. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:27:57,795][52567] Avg episode reward: [(0, '26.840')] [2024-08-05 23:27:58,100][52668] DAMAGECOUNT value on done: 35733.0 [2024-08-05 23:27:58,100][52668] Sum rewards: 18.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.392', 'AMMO5': '0.005', 'ARMOR': '0.032', 'AMMO2': '0.044', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.221', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon2': '1.340', 'HITCOUNT': '1.630', 'weapon3': '2.374', 'DAMAGECOUNT': '6.444', 'FRAGCOUNT': '18.000'} [2024-08-05 23:27:58,485][52660] DAMAGECOUNT value on done: 35663.0 [2024-08-05 23:27:58,486][52660] Sum rewards: 23.282, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.198', 'weapon5': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.156', 'AMMO4': '0.256', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'ARMOR': '0.448', 'WEAPON4': '0.600', 'weapon2': '0.792', 'WEAPON3': '1.650', 'HITCOUNT': '2.150', 'weapon3': '2.712', 'DAMAGECOUNT': '8.589', 'FRAGCOUNT': '25.000'} [2024-08-05 23:27:58,951][52650] Updated weights for policy 0, policy_version 15141 (0.0021) [2024-08-05 23:27:58,982][52649] DAMAGECOUNT value on done: 34756.0 [2024-08-05 23:27:58,984][52649] Sum rewards: 15.423, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.215', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO3': '0.118', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.274', 'ARMOR': '0.502', 'WEAPON3': '0.700', 'weapon2': '1.310', 'HITCOUNT': '1.390', 'weapon3': '1.740', 'DAMAGECOUNT': '4.923', 'FRAGCOUNT': '13.000'} [2024-08-05 23:27:59,279][52820] DAMAGECOUNT value on done: 30253.0 [2024-08-05 23:27:59,280][52820] Sum rewards: 30.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.408', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.060', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon2': '1.322', 'ARMOR': '1.332', 'HITCOUNT': '2.020', 'weapon3': '2.202', 'DAMAGECOUNT': '8.823', 'FRAGCOUNT': '24.500'} [2024-08-05 23:27:59,663][52662] DAMAGECOUNT value on done: 37506.0 [2024-08-05 23:27:59,664][52662] Sum rewards: 21.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.924', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.268', 'ARMOR': '0.800', 'weapon2': '0.982', 'WEAPON3': '1.500', 'HITCOUNT': '2.000', 'weapon3': '2.586', 'DAMAGECOUNT': '7.542', 'FRAGCOUNT': '22.000'} [2024-08-05 23:27:59,938][52794] DAMAGECOUNT value on done: 39885.0 [2024-08-05 23:27:59,939][52794] Sum rewards: 31.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.311', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon4': '0.166', 'WEAPON3': '0.900', 'weapon2': '1.272', 'HITCOUNT': '2.200', 'weapon3': '2.220', 'DAMAGECOUNT': '8.208', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:00,710][52668] DAMAGECOUNT value on done: 35118.0 [2024-08-05 23:28:00,710][52668] Sum rewards: 42.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.485', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'weapon4': '0.140', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.624', 'ARMOR': '0.828', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '2.904', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '37.000'} [2024-08-05 23:28:01,075][52660] DAMAGECOUNT value on done: 35730.0 [2024-08-05 23:28:01,075][52660] Sum rewards: 30.280, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon4': '0.516', 'WEAPON3': '0.850', 'weapon2': '0.954', 'HITCOUNT': '1.990', 'weapon3': '2.206', 'DAMAGECOUNT': '7.254', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:01,731][52649] DAMAGECOUNT value on done: 36522.0 [2024-08-05 23:28:01,732][52649] Sum rewards: 27.832, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.070', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.232', 'ARMOR': '0.456', 'WEAPON3': '0.950', 'weapon2': '1.274', 'HITCOUNT': '2.190', 'weapon3': '2.210', 'DAMAGECOUNT': '8.181', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:01,834][52614] Signal inference workers to stop experience collection... (2850 times) [2024-08-05 23:28:01,834][52614] Signal inference workers to resume experience collection... (2850 times) [2024-08-05 23:28:01,876][52650] InferenceWorker_p0-w0: stopping experience collection (2850 times) [2024-08-05 23:28:01,877][52650] InferenceWorker_p0-w0: resuming experience collection (2850 times) [2024-08-05 23:28:02,391][52820] DAMAGECOUNT value on done: 33432.0 [2024-08-05 23:28:02,392][52820] Sum rewards: 38.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'AMMO4': '0.189', 'WEAPON4': '0.400', 'weapon4': '0.698', 'weapon2': '0.882', 'WEAPON3': '0.950', 'ARMOR': '1.256', 'weapon3': '2.228', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '9.867', 'FRAGCOUNT': '32.000'} [2024-08-05 23:28:02,419][52662] DAMAGECOUNT value on done: 39016.0 [2024-08-05 23:28:02,421][52662] Sum rewards: 35.405, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.048', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.064', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'ARMOR': '0.891', 'WEAPON3': '1.050', 'weapon2': '1.272', 'HITCOUNT': '2.200', 'weapon3': '2.202', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '29.000'} [2024-08-05 23:28:02,749][52794] DAMAGECOUNT value on done: 40431.0 [2024-08-05 23:28:02,752][52794] Sum rewards: 29.968, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.818', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.074', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'ARMOR': '0.856', 'WEAPON3': '1.050', 'weapon2': '1.372', 'HITCOUNT': '1.800', 'weapon3': '2.168', 'DAMAGECOUNT': '7.320', 'FRAGCOUNT': '26.000'} [2024-08-05 23:28:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 124100608. Throughput: 0: 4390.7. Samples: 31023590. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:28:02,794][52567] Avg episode reward: [(0, '27.182')] [2024-08-05 23:28:03,763][52650] Updated weights for policy 0, policy_version 15151 (0.0014) [2024-08-05 23:28:03,923][52668] DAMAGECOUNT value on done: 36478.0 [2024-08-05 23:28:03,923][52668] Sum rewards: 37.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.584', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.022', 'ARMOR': '0.024', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'weapon4': '0.460', 'weapon2': '0.770', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.482', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '32.000'} [2024-08-05 23:28:04,271][52660] DAMAGECOUNT value on done: 35692.0 [2024-08-05 23:28:04,271][52660] Sum rewards: 19.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.013', 'weapon5': '0.034', 'ARMOR': '0.040', 'AMMO2': '0.052', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'AMMO4': '0.261', 'weapon4': '0.492', 'weapon2': '0.574', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'HITCOUNT': '2.070', 'weapon3': '2.598', 'DAMAGECOUNT': '8.160', 'FRAGCOUNT': '20.500'} [2024-08-05 23:28:05,040][52662] DAMAGECOUNT value on done: 39770.0 [2024-08-05 23:28:05,041][52662] Sum rewards: 38.819, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.372', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon5': '0.024', 'ARMOR': '0.044', 'AMMO4': '0.048', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.902', 'WEAPON3': '1.150', 'HITCOUNT': '2.330', 'weapon3': '2.626', 'DAMAGECOUNT': '9.357', 'FRAGCOUNT': '33.000'} [2024-08-05 23:28:05,276][52794] DAMAGECOUNT value on done: 39727.0 [2024-08-05 23:28:05,277][52794] Sum rewards: 30.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.297', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.326', 'WEAPON3': '1.150', 'weapon2': '1.226', 'ARMOR': '1.280', 'HITCOUNT': '1.940', 'weapon3': '2.150', 'DAMAGECOUNT': '8.241', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:05,538][52820] DAMAGECOUNT value on done: 33602.0 [2024-08-05 23:28:05,541][52820] Sum rewards: 28.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.923', 'AMMO5': '0.007', 'AMMO2': '0.031', 'ARMOR': '0.044', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.181', 'weapon4': '0.210', 'WEAPON4': '0.400', 'weapon2': '1.026', 'WEAPON3': '1.200', 'HITCOUNT': '2.000', 'weapon3': '2.476', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '26.000'} [2024-08-05 23:28:06,350][52668] DAMAGECOUNT value on done: 37976.0 [2024-08-05 23:28:06,350][52668] Sum rewards: 38.572, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.081', 'weapon5': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.146', 'AMMO3': '0.148', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.736', 'ARMOR': '0.854', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.792', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '31.000'} [2024-08-05 23:28:06,666][52660] DAMAGECOUNT value on done: 34934.0 [2024-08-05 23:28:06,667][52660] Sum rewards: 28.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.698', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.342', 'WEAPON3': '0.950', 'ARMOR': '1.332', 'weapon2': '1.496', 'weapon3': '2.010', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.082', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 124190720. Throughput: 0: 4391.8. Samples: 31050040. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:28:07,795][52567] Avg episode reward: [(0, '27.236')] [2024-08-05 23:28:07,955][52662] DAMAGECOUNT value on done: 38649.0 [2024-08-05 23:28:07,955][52662] Sum rewards: 39.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.932', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.086', 'AMMO3': '0.163', 'weapon4': '0.254', 'WEAPON4': '0.300', 'ARMOR': '0.489', 'weapon2': '0.712', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.746', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '35.000'} [2024-08-05 23:28:08,179][52650] Updated weights for policy 0, policy_version 15161 (0.0023) [2024-08-05 23:28:08,259][52794] DAMAGECOUNT value on done: 40703.0 [2024-08-05 23:28:08,262][52794] Sum rewards: 29.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.967', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.062', 'AMMO3': '0.186', 'AMMO4': '0.223', 'weapon4': '0.322', 'WEAPON5': '0.400', 'ARMOR': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.820', 'WEAPON3': '1.200', 'HITCOUNT': '1.800', 'weapon3': '2.498', 'DAMAGECOUNT': '8.073', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:08,617][52820] DAMAGECOUNT value on done: 30723.0 [2024-08-05 23:28:08,619][52820] Sum rewards: 17.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.118', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon5': '0.040', 'weapon4': '0.044', 'AMMO4': '0.054', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'ARMOR': '0.889', 'WEAPON3': '1.250', 'weapon2': '1.418', 'HITCOUNT': '1.610', 'weapon3': '2.270', 'DAMAGECOUNT': '6.276', 'FRAGCOUNT': '17.000'} [2024-08-05 23:28:09,321][52668] DAMAGECOUNT value on done: 37375.0 [2024-08-05 23:28:09,321][52668] Sum rewards: 38.475, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.404', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'weapon2': '0.994', 'WEAPON3': '1.000', 'HITCOUNT': '2.180', 'weapon3': '2.748', 'DAMAGECOUNT': '9.408', 'FRAGCOUNT': '32.000'} [2024-08-05 23:28:09,825][52660] DAMAGECOUNT value on done: 30637.0 [2024-08-05 23:28:09,825][52660] Sum rewards: 24.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO2': '0.011', 'weapon4': '0.014', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.205', 'WEAPON3': '1.250', 'weapon2': '1.538', 'ARMOR': '1.713', 'HITCOUNT': '1.830', 'weapon3': '2.292', 'DAMAGECOUNT': '6.822', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:10,753][52662] DAMAGECOUNT value on done: 39677.0 [2024-08-05 23:28:10,755][52662] Sum rewards: 23.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.495', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.310', 'ARMOR': '0.906', 'WEAPON3': '1.000', 'weapon2': '1.052', 'HITCOUNT': '1.570', 'weapon3': '2.264', 'DAMAGECOUNT': '5.712', 'FRAGCOUNT': '21.000'} [2024-08-05 23:28:11,123][52794] DAMAGECOUNT value on done: 38554.0 [2024-08-05 23:28:11,123][52794] Sum rewards: 30.314, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.006', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.076', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.244', 'weapon4': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'ARMOR': '0.832', 'weapon2': '1.068', 'HITCOUNT': '1.920', 'weapon3': '1.950', 'DAMAGECOUNT': '7.515', 'FRAGCOUNT': '26.000'} [2024-08-05 23:28:11,680][52820] DAMAGECOUNT value on done: 32065.0 [2024-08-05 23:28:11,684][52820] Sum rewards: 27.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.433', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.016', 'weapon5': '0.016', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.364', 'weapon2': '0.828', 'WEAPON3': '1.400', 'weapon3': '2.512', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:12,432][52668] DAMAGECOUNT value on done: 33686.0 [2024-08-05 23:28:12,432][52668] Sum rewards: 25.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.994', 'AMMO2': '0.025', 'ARMOR': '0.036', 'AMMO4': '0.123', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.370', 'weapon2': '0.784', 'WEAPON3': '1.150', 'HITCOUNT': '2.050', 'weapon3': '2.364', 'DAMAGECOUNT': '7.977', 'FRAGCOUNT': '22.000'} [2024-08-05 23:28:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 124264448. Throughput: 0: 4387.8. Samples: 31076310. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:28:12,794][52567] Avg episode reward: [(0, '27.807')] [2024-08-05 23:28:12,844][52660] DAMAGECOUNT value on done: 34833.0 [2024-08-05 23:28:12,846][52660] Sum rewards: 26.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.048', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.161', 'weapon4': '0.206', 'WEAPON4': '0.300', 'ARMOR': '0.824', 'WEAPON3': '0.950', 'weapon2': '1.208', 'HITCOUNT': '1.830', 'weapon3': '2.372', 'DAMAGECOUNT': '6.993', 'FRAGCOUNT': '23.000'} [2024-08-05 23:28:13,131][52650] Updated weights for policy 0, policy_version 15171 (0.0023) [2024-08-05 23:28:13,500][52662] DAMAGECOUNT value on done: 39253.0 [2024-08-05 23:28:13,501][52662] Sum rewards: 29.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.309', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.038', 'weapon4': '0.130', 'AMMO3': '0.163', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.424', 'WEAPON3': '1.050', 'weapon2': '1.124', 'HITCOUNT': '1.970', 'weapon3': '2.452', 'DAMAGECOUNT': '8.433', 'FRAGCOUNT': '26.000'} [2024-08-05 23:28:13,863][52794] DAMAGECOUNT value on done: 43074.0 [2024-08-05 23:28:13,864][52794] Sum rewards: 20.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.094', 'AMMO5': '0.017', 'weapon5': '0.038', 'AMMO2': '0.050', 'AMMO3': '0.230', 'AMMO4': '0.251', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '1.082', 'ARMOR': '1.270', 'WEAPON3': '1.400', 'HITCOUNT': '2.070', 'weapon3': '2.338', 'DAMAGECOUNT': '8.673', 'FRAGCOUNT': '19.500'} [2024-08-05 23:28:14,808][52820] DAMAGECOUNT value on done: 32583.0 [2024-08-05 23:28:14,809][52820] Sum rewards: 35.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.506', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO4': '0.172', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.814', 'weapon2': '0.926', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '2.656', 'DAMAGECOUNT': '9.081', 'FRAGCOUNT': '33.000'} [2024-08-05 23:28:15,190][52668] DAMAGECOUNT value on done: 38182.0 [2024-08-05 23:28:15,191][52668] Sum rewards: 32.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.215', 'weapon4': '0.336', 'WEAPON4': '0.350', 'ARMOR': '0.491', 'weapon2': '0.896', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '2.432', 'DAMAGECOUNT': '8.565', 'FRAGCOUNT': '29.000'} [2024-08-05 23:28:15,585][52660] DAMAGECOUNT value on done: 34884.0 [2024-08-05 23:28:15,587][52660] Sum rewards: 29.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon5': '0.028', 'AMMO4': '0.040', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON3': '1.100', 'weapon2': '1.130', 'ARMOR': '1.734', 'HITCOUNT': '1.910', 'weapon3': '2.548', 'DAMAGECOUNT': '8.322', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:16,384][52662] DAMAGECOUNT value on done: 40035.0 [2024-08-05 23:28:16,384][52662] Sum rewards: 24.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.424', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.148', 'AMMO3': '0.192', 'WEAPON4': '0.400', 'ARMOR': '0.861', 'weapon2': '1.018', 'WEAPON3': '1.350', 'HITCOUNT': '1.670', 'weapon3': '2.672', 'DAMAGECOUNT': '6.990', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:16,629][52794] DAMAGECOUNT value on done: 37769.0 [2024-08-05 23:28:16,630][52794] Sum rewards: 23.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.775', 'weapon5': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.322', 'ARMOR': '0.907', 'weapon2': '1.132', 'WEAPON3': '1.250', 'HITCOUNT': '2.160', 'weapon3': '2.292', 'DAMAGECOUNT': '8.322', 'FRAGCOUNT': '21.000'} [2024-08-05 23:28:17,789][52668] DAMAGECOUNT value on done: 34918.0 [2024-08-05 23:28:17,790][52668] Sum rewards: 41.050, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.533', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.126', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.471', 'weapon4': '0.642', 'weapon2': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.156', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.170', 'FRAGCOUNT': '33.000'} [2024-08-05 23:28:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 124354560. Throughput: 0: 4382.7. Samples: 31089430. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:28:17,794][52567] Avg episode reward: [(0, '28.078')] [2024-08-05 23:28:18,025][52820] DAMAGECOUNT value on done: 33385.0 [2024-08-05 23:28:18,031][52820] Sum rewards: 27.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.388', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '1.090', 'ARMOR': '1.351', 'WEAPON3': '1.400', 'HITCOUNT': '2.050', 'weapon3': '2.532', 'DAMAGECOUNT': '8.331', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:18,097][52650] Updated weights for policy 0, policy_version 15181 (0.0011) [2024-08-05 23:28:18,361][52660] DAMAGECOUNT value on done: 34857.0 [2024-08-05 23:28:18,361][52660] Sum rewards: 25.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.204', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.203', 'ARMOR': '0.400', 'weapon2': '1.104', 'WEAPON3': '1.400', 'HITCOUNT': '1.840', 'weapon3': '2.690', 'DAMAGECOUNT': '7.221', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:19,482][52662] DAMAGECOUNT value on done: 41628.0 [2024-08-05 23:28:19,493][52662] Sum rewards: 28.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.678', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.112', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.754', 'ARMOR': '0.956', 'WEAPON3': '1.050', 'HITCOUNT': '2.070', 'weapon3': '2.384', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:19,831][52794] DAMAGECOUNT value on done: 42065.0 [2024-08-05 23:28:19,832][52794] Sum rewards: 39.226, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.039', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.104', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'weapon2': '0.974', 'WEAPON3': '1.600', 'HITCOUNT': '2.540', 'weapon3': '2.634', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '37.000'} [2024-08-05 23:28:20,495][52668] DAMAGECOUNT value on done: 34911.0 [2024-08-05 23:28:20,496][52668] Sum rewards: 40.191, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.317', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.058', 'weapon5': '0.072', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'ARMOR': '0.890', 'WEAPON3': '0.950', 'weapon2': '1.032', 'HITCOUNT': '2.480', 'weapon3': '2.632', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '32.000'} [2024-08-05 23:28:21,096][52660] DAMAGECOUNT value on done: 34412.0 [2024-08-05 23:28:21,098][52660] Sum rewards: 32.782, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'HEALTH': '0.131', 'AMMO3': '0.140', 'weapon5': '0.148', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.368', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.096', 'HITCOUNT': '1.890', 'weapon3': '1.930', 'DAMAGECOUNT': '8.067', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:21,126][52820] DAMAGECOUNT value on done: 31788.0 [2024-08-05 23:28:21,128][52820] Sum rewards: 22.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.988', 'AMMO5': '0.012', 'weapon5': '0.058', 'AMMO2': '0.065', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'AMMO4': '0.327', 'weapon4': '0.422', 'WEAPON4': '0.600', 'ARMOR': '0.921', 'weapon2': '1.008', 'WEAPON3': '1.050', 'HITCOUNT': '1.900', 'weapon3': '2.108', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '18.000'} [2024-08-05 23:28:22,193][52650] Updated weights for policy 0, policy_version 15191 (0.0022) [2024-08-05 23:28:22,348][52662] DAMAGECOUNT value on done: 38560.0 [2024-08-05 23:28:22,350][52662] Sum rewards: 22.471, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.984', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.060', 'AMMO3': '0.105', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.866', 'weapon2': '1.594', 'HITCOUNT': '1.600', 'weapon3': '2.064', 'DAMAGECOUNT': '5.691', 'FRAGCOUNT': '18.000'} [2024-08-05 23:28:22,694][52794] DAMAGECOUNT value on done: 41604.0 [2024-08-05 23:28:22,695][52794] Sum rewards: 32.621, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.973', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'weapon4': '0.040', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'ARMOR': '0.897', 'weapon2': '0.980', 'WEAPON3': '1.100', 'HITCOUNT': '2.030', 'weapon3': '2.754', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '28.000'} [2024-08-05 23:28:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17467.0). Total num frames: 124452864. Throughput: 0: 4385.8. Samples: 31115740. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:28:22,794][52567] Avg episode reward: [(0, '28.688')] [2024-08-05 23:28:22,802][52614] Saving new best policy, reward=28.688! [2024-08-05 23:28:23,466][52668] DAMAGECOUNT value on done: 34110.0 [2024-08-05 23:28:23,467][52668] Sum rewards: 20.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.218', 'weapon5': '0.002', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.096', 'AMMO3': '0.133', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'weapon2': '1.554', 'ARMOR': '1.775', 'HITCOUNT': '1.890', 'weapon3': '2.176', 'DAMAGECOUNT': '7.545', 'FRAGCOUNT': '20.000'} [2024-08-05 23:28:23,607][52664] DAMAGECOUNT value on done: 35023.0 [2024-08-05 23:28:23,608][52664] Sum rewards: 32.663, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'ARMOR': '0.400', 'HEALTH': '0.547', 'WEAPON3': '0.850', 'weapon2': '1.142', 'HITCOUNT': '1.950', 'weapon3': '2.516', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:24,083][52660] DAMAGECOUNT value on done: 34833.0 [2024-08-05 23:28:24,085][52660] Sum rewards: 24.754, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.609', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.078', 'AMMO4': '0.113', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.922', 'weapon2': '1.248', 'HITCOUNT': '1.650', 'weapon3': '2.102', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '20.000'} [2024-08-05 23:28:24,271][52820] DAMAGECOUNT value on done: 35139.0 [2024-08-05 23:28:24,274][52820] Sum rewards: 26.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.278', 'ARMOR': '0.501', 'weapon2': '0.900', 'WEAPON3': '1.250', 'HITCOUNT': '2.010', 'weapon3': '2.526', 'DAMAGECOUNT': '7.818', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:25,338][52662] DAMAGECOUNT value on done: 40961.0 [2024-08-05 23:28:25,339][52662] Sum rewards: 30.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO3': '0.113', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.382', 'WEAPON3': '0.800', 'ARMOR': '1.270', 'weapon2': '1.276', 'HITCOUNT': '1.910', 'weapon3': '1.928', 'DAMAGECOUNT': '8.124', 'FRAGCOUNT': '24.500'} [2024-08-05 23:28:25,629][52794] DAMAGECOUNT value on done: 40537.0 [2024-08-05 23:28:25,632][52794] Sum rewards: 23.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.112', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon2': '1.440', 'ARMOR': '1.728', 'HITCOUNT': '2.100', 'weapon3': '2.326', 'DAMAGECOUNT': '8.460', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:26,381][52668] DAMAGECOUNT value on done: 34571.0 [2024-08-05 23:28:26,381][52668] Sum rewards: 28.809, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.597', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.578', 'ARMOR': '0.854', 'weapon2': '0.992', 'WEAPON3': '1.200', 'HITCOUNT': '2.010', 'weapon3': '2.016', 'DAMAGECOUNT': '8.451', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:26,770][52664] DAMAGECOUNT value on done: 34652.0 [2024-08-05 23:28:26,770][52664] Sum rewards: 32.278, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.124', 'AMMO3': '0.146', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.610', 'weapon2': '0.686', 'ARMOR': '0.816', 'WEAPON3': '0.900', 'weapon3': '1.962', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.382', 'FRAGCOUNT': '27.500'} [2024-08-05 23:28:27,142][52660] DAMAGECOUNT value on done: 35391.0 [2024-08-05 23:28:27,143][52660] Sum rewards: 33.135, reward structure: {'DEATHCOUNT': '-9.750', 'weapon4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'AMMO4': '0.215', 'HEALTH': '0.240', 'WEAPON3': '0.800', 'weapon2': '1.304', 'ARMOR': '1.616', 'HITCOUNT': '1.920', 'weapon3': '2.530', 'DAMAGECOUNT': '7.755', 'FRAGCOUNT': '26.000'} [2024-08-05 23:28:27,172][52650] Updated weights for policy 0, policy_version 15201 (0.0018) [2024-08-05 23:28:27,303][52820] DAMAGECOUNT value on done: 35511.0 [2024-08-05 23:28:27,303][52820] Sum rewards: 25.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.173', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'WEAPON3': '1.000', 'weapon2': '1.098', 'HITCOUNT': '2.040', 'weapon3': '2.464', 'DAMAGECOUNT': '7.083', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 124534784. Throughput: 0: 4378.2. Samples: 31141910. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:28:27,795][52567] Avg episode reward: [(0, '28.732')] [2024-08-05 23:28:27,880][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015203_124542976.pth... [2024-08-05 23:28:28,001][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014690_120340480.pth [2024-08-05 23:28:28,006][52614] Saving new best policy, reward=28.732! [2024-08-05 23:28:28,448][52662] DAMAGECOUNT value on done: 38509.0 [2024-08-05 23:28:28,449][52662] Sum rewards: 35.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.626', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.022', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon4': '0.396', 'ARMOR': '0.456', 'weapon2': '0.898', 'WEAPON3': '1.300', 'weapon3': '2.290', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.858', 'FRAGCOUNT': '34.000'} [2024-08-05 23:28:28,951][52794] DAMAGECOUNT value on done: 40516.0 [2024-08-05 23:28:28,951][52794] Sum rewards: 38.553, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.276', 'ARMOR': '1.301', 'HITCOUNT': '2.310', 'weapon3': '2.364', 'DAMAGECOUNT': '9.708', 'FRAGCOUNT': '31.000'} [2024-08-05 23:28:29,396][52664] DAMAGECOUNT value on done: 37492.0 [2024-08-05 23:28:29,398][52664] Sum rewards: 25.344, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.167', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO3': '0.162', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.582', 'weapon4': '0.630', 'ARMOR': '0.880', 'WEAPON3': '1.000', 'HITCOUNT': '1.730', 'weapon3': '1.966', 'DAMAGECOUNT': '6.477', 'FRAGCOUNT': '21.000'} [2024-08-05 23:28:29,452][52668] DAMAGECOUNT value on done: 34297.0 [2024-08-05 23:28:29,452][52668] Sum rewards: 35.590, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon4': '0.322', 'ARMOR': '0.479', 'weapon2': '0.718', 'WEAPON3': '1.150', 'HITCOUNT': '2.450', 'weapon3': '2.510', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '29.000'} [2024-08-05 23:28:30,129][52660] DAMAGECOUNT value on done: 35168.0 [2024-08-05 23:28:30,129][52660] Sum rewards: 30.860, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.518', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.050', 'AMMO3': '0.112', 'AMMO4': '0.126', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.903', 'weapon2': '1.458', 'weapon3': '2.032', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '8.112', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:30,572][52820] DAMAGECOUNT value on done: 33825.0 [2024-08-05 23:28:30,572][52820] Sum rewards: 39.148, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.043', 'HEALTH': '0.090', 'weapon5': '0.106', 'AMMO3': '0.154', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.878', 'WEAPON3': '0.950', 'ARMOR': '2.207', 'HITCOUNT': '2.290', 'weapon3': '2.336', 'DAMAGECOUNT': '9.765', 'FRAGCOUNT': '29.000'} [2024-08-05 23:28:31,728][52662] DAMAGECOUNT value on done: 38965.0 [2024-08-05 23:28:31,730][52662] Sum rewards: 30.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.532', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.500', 'weapon2': '0.726', 'weapon4': '0.748', 'WEAPON3': '1.000', 'ARMOR': '1.411', 'weapon3': '2.102', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '8.628', 'FRAGCOUNT': '26.500'} [2024-08-05 23:28:31,863][52668] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:28:31,953][52650] Updated weights for policy 0, policy_version 15211 (0.0013) [2024-08-05 23:28:31,997][52664] DAMAGECOUNT value on done: 36810.0 [2024-08-05 23:28:31,997][52664] Sum rewards: 32.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'weapon5': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.487', 'weapon2': '1.106', 'WEAPON3': '1.450', 'HITCOUNT': '2.360', 'weapon3': '2.584', 'DAMAGECOUNT': '9.465', 'FRAGCOUNT': '30.000'} [2024-08-05 23:28:32,047][52794] DAMAGECOUNT value on done: 40227.0 [2024-08-05 23:28:32,049][52794] Sum rewards: 34.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.624', 'weapon4': '0.646', 'WEAPON3': '1.150', 'ARMOR': '1.306', 'HITCOUNT': '2.410', 'weapon3': '2.526', 'DAMAGECOUNT': '9.483', 'FRAGCOUNT': '28.000'} [2024-08-05 23:28:32,673][52668] DAMAGECOUNT value on done: 34405.0 [2024-08-05 23:28:32,674][52668] Sum rewards: 22.245, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.754', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.099', 'AMMO3': '0.126', 'WEAPON3': '0.800', 'ARMOR': '1.200', 'HITCOUNT': '1.560', 'weapon2': '1.752', 'weapon3': '1.804', 'DAMAGECOUNT': '6.033', 'FRAGCOUNT': '17.000'} [2024-08-05 23:28:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 124616704. Throughput: 0: 4371.1. Samples: 31154590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:28:32,794][52567] Avg episode reward: [(0, '29.333')] [2024-08-05 23:28:32,795][52614] Saving new best policy, reward=29.333! [2024-08-05 23:28:33,424][52660] DAMAGECOUNT value on done: 34317.0 [2024-08-05 23:28:33,425][52660] Sum rewards: 29.050, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.637', 'AMMO5': '0.005', 'AMMO2': '0.046', 'ARMOR': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.134', 'AMMO4': '0.230', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.934', 'HITCOUNT': '1.810', 'weapon3': '2.252', 'DAMAGECOUNT': '7.479', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:34,616][52664] DAMAGECOUNT value on done: 35166.0 [2024-08-05 23:28:34,616][52664] Sum rewards: 25.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.618', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.858', 'ARMOR': '0.877', 'WEAPON3': '1.500', 'HITCOUNT': '2.180', 'weapon3': '2.544', 'DAMAGECOUNT': '8.859', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:36,213][52650] Updated weights for policy 0, policy_version 15221 (0.0018) [2024-08-05 23:28:36,238][52668] DAMAGECOUNT value on done: 33432.0 [2024-08-05 23:28:36,238][52668] Sum rewards: 17.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.961', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon5': '0.068', 'weapon4': '0.152', 'AMMO3': '0.170', 'AMMO4': '0.181', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.462', 'WEAPON3': '1.200', 'weapon2': '1.224', 'HITCOUNT': '1.350', 'weapon3': '2.274', 'DAMAGECOUNT': '5.475', 'FRAGCOUNT': '17.000'} [2024-08-05 23:28:36,605][52660] DAMAGECOUNT value on done: 35174.0 [2024-08-05 23:28:36,605][52660] Sum rewards: 31.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.489', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.306', 'ARMOR': '0.404', 'weapon2': '1.074', 'WEAPON3': '1.250', 'weapon3': '2.374', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '9.234', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:37,288][52664] DAMAGECOUNT value on done: 38989.0 [2024-08-05 23:28:37,290][52664] Sum rewards: 25.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.544', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.108', 'AMMO4': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'ARMOR': '0.480', 'weapon2': '0.492', 'WEAPON3': '1.600', 'HITCOUNT': '2.170', 'weapon3': '2.972', 'DAMAGECOUNT': '8.709', 'FRAGCOUNT': '26.000'} [2024-08-05 23:28:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 124715008. Throughput: 0: 4372.9. Samples: 31180940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:28:37,794][52567] Avg episode reward: [(0, '29.173')] [2024-08-05 23:28:38,681][52668] DAMAGECOUNT value on done: 33464.0 [2024-08-05 23:28:38,681][52668] Sum rewards: 18.757, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.631', 'AMMO5': '0.017', 'AMMO2': '0.038', 'ARMOR': '0.072', 'AMMO3': '0.091', 'weapon5': '0.116', 'AMMO4': '0.190', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.476', 'WEAPON3': '0.700', 'weapon2': '1.498', 'HITCOUNT': '1.560', 'weapon3': '1.704', 'DAMAGECOUNT': '5.325', 'FRAGCOUNT': '16.000'} [2024-08-05 23:28:39,209][52660] DAMAGECOUNT value on done: 38423.0 [2024-08-05 23:28:39,209][52660] Sum rewards: 35.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.808', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.209', 'ARMOR': '0.400', 'weapon4': '0.416', 'WEAPON4': '0.450', 'weapon2': '0.876', 'WEAPON3': '1.350', 'weapon3': '2.362', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '33.000'} [2024-08-05 23:28:40,026][52664] DAMAGECOUNT value on done: 36904.0 [2024-08-05 23:28:40,028][52664] Sum rewards: 33.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.226', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.108', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'ARMOR': '0.908', 'weapon2': '1.230', 'WEAPON3': '1.500', 'weapon3': '2.296', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.480', 'FRAGCOUNT': '32.000'} [2024-08-05 23:28:41,346][52650] Updated weights for policy 0, policy_version 15231 (0.0013) [2024-08-05 23:28:41,410][52668] DAMAGECOUNT value on done: 35596.0 [2024-08-05 23:28:41,412][52668] Sum rewards: 25.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.189', 'weapon4': '0.204', 'WEAPON4': '0.350', 'ARMOR': '0.853', 'weapon2': '1.056', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '2.496', 'DAMAGECOUNT': '8.427', 'FRAGCOUNT': '23.000'} [2024-08-05 23:28:41,834][52660] DAMAGECOUNT value on done: 35087.0 [2024-08-05 23:28:41,835][52660] Sum rewards: 23.095, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.098', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.156', 'AMMO4': '0.161', 'weapon4': '0.220', 'WEAPON4': '0.250', 'ARMOR': '0.444', 'WEAPON3': '1.000', 'weapon2': '1.404', 'HITCOUNT': '1.850', 'weapon3': '2.170', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '19.000'} [2024-08-05 23:28:42,370][52669] DAMAGECOUNT value on done: 36361.0 [2024-08-05 23:28:42,372][52669] Sum rewards: 33.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.052', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.179', 'ARMOR': '0.853', 'WEAPON3': '1.050', 'weapon2': '1.184', 'HITCOUNT': '2.220', 'weapon3': '2.638', 'DAMAGECOUNT': '8.982', 'FRAGCOUNT': '28.000'} [2024-08-05 23:28:42,658][52664] DAMAGECOUNT value on done: 33795.0 [2024-08-05 23:28:42,660][52664] Sum rewards: 28.758, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.546', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.116', 'AMMO3': '0.233', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'ARMOR': '0.878', 'weapon2': '0.970', 'WEAPON3': '1.500', 'HITCOUNT': '2.300', 'weapon3': '2.568', 'DAMAGECOUNT': '9.171', 'FRAGCOUNT': '30.000'} [2024-08-05 23:28:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 124796928. Throughput: 0: 4376.2. Samples: 31207390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:28:42,794][52567] Avg episode reward: [(0, '29.195')] [2024-08-05 23:28:44,390][52668] DAMAGECOUNT value on done: 37518.0 [2024-08-05 23:28:44,399][52668] Sum rewards: 25.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'ARMOR': '0.504', 'weapon2': '0.788', 'WEAPON3': '1.350', 'HITCOUNT': '2.110', 'weapon3': '2.720', 'DAMAGECOUNT': '7.854', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:45,007][52660] DAMAGECOUNT value on done: 37154.0 [2024-08-05 23:28:45,009][52660] Sum rewards: 35.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.012', 'AMMO4': '0.059', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.310', 'ARMOR': '0.475', 'weapon2': '0.858', 'WEAPON3': '1.000', 'HITCOUNT': '2.210', 'weapon3': '2.412', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '30.000'} [2024-08-05 23:28:45,125][52664] DAMAGECOUNT value on done: 39980.0 [2024-08-05 23:28:45,125][52664] Sum rewards: 28.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.482', 'AMMO5': '0.018', 'weapon5': '0.038', 'AMMO2': '0.041', 'AMMO3': '0.201', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.410', 'weapon2': '1.146', 'WEAPON3': '1.300', 'ARMOR': '1.352', 'HITCOUNT': '2.040', 'weapon3': '2.076', 'DAMAGECOUNT': '7.824', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:45,185][52669] DAMAGECOUNT value on done: 36290.0 [2024-08-05 23:28:45,187][52669] Sum rewards: 34.497, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.060', 'AMMO3': '0.105', 'AMMO4': '0.112', 'weapon5': '0.112', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.394', 'WEAPON3': '0.800', 'weapon2': '0.816', 'HITCOUNT': '1.970', 'weapon3': '2.226', 'DAMAGECOUNT': '8.505', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:45,847][52650] Updated weights for policy 0, policy_version 15241 (0.0011) [2024-08-05 23:28:47,039][52803] DAMAGECOUNT value on done: 34570.0 [2024-08-05 23:28:47,043][52803] Sum rewards: 31.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.628', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.193', 'weapon4': '0.206', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'weapon2': '0.730', 'WEAPON3': '1.350', 'HITCOUNT': '2.210', 'weapon3': '2.636', 'DAMAGECOUNT': '10.149', 'FRAGCOUNT': '29.500'} [2024-08-05 23:28:47,174][52666] Large shaping reward 2.534 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.483, 161.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:28:47,569][52660] DAMAGECOUNT value on done: 36026.0 [2024-08-05 23:28:47,569][52660] Sum rewards: 23.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.836', 'weapon5': '0.018', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.166', 'weapon4': '0.182', 'AMMO4': '0.269', 'WEAPON5': '0.450', 'ARMOR': '0.488', 'WEAPON4': '0.550', 'weapon2': '0.990', 'WEAPON3': '1.050', 'HITCOUNT': '1.830', 'weapon3': '2.460', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '22.000'} [2024-08-05 23:28:47,663][52664] DAMAGECOUNT value on done: 36863.0 [2024-08-05 23:28:47,664][52664] Sum rewards: 29.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO2': '0.033', 'AMMO3': '0.095', 'weapon5': '0.146', 'AMMO4': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.636', 'WEAPON3': '0.700', 'weapon2': '1.172', 'weapon3': '1.772', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '8.931', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 124887040. Throughput: 0: 4377.1. Samples: 31220560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 23:28:47,795][52567] Avg episode reward: [(0, '29.220')] [2024-08-05 23:28:48,055][52669] DAMAGECOUNT value on done: 34722.0 [2024-08-05 23:28:48,055][52669] Sum rewards: 25.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.791', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon4': '0.170', 'ARMOR': '0.848', 'WEAPON3': '1.150', 'weapon2': '1.220', 'HITCOUNT': '1.980', 'weapon3': '2.404', 'DAMAGECOUNT': '7.515', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:49,981][52803] DAMAGECOUNT value on done: 36135.0 [2024-08-05 23:28:49,989][52803] Sum rewards: 33.081, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.145', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.384', 'ARMOR': '0.424', 'weapon2': '0.868', 'WEAPON3': '0.900', 'HITCOUNT': '2.020', 'weapon3': '2.398', 'DAMAGECOUNT': '7.761', 'FRAGCOUNT': '28.000'} [2024-08-05 23:28:50,533][52650] Updated weights for policy 0, policy_version 15251 (0.0010) [2024-08-05 23:28:50,534][52660] DAMAGECOUNT value on done: 35977.0 [2024-08-05 23:28:50,540][52660] Sum rewards: 28.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'ARMOR': '0.509', 'weapon4': '0.572', 'weapon2': '0.850', 'WEAPON3': '1.150', 'HITCOUNT': '2.220', 'weapon3': '2.344', 'DAMAGECOUNT': '8.571', 'FRAGCOUNT': '25.000'} [2024-08-05 23:28:50,648][52664] DAMAGECOUNT value on done: 38727.0 [2024-08-05 23:28:50,649][52664] Sum rewards: 21.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.312', 'ARMOR': '0.800', 'weapon2': '0.918', 'WEAPON3': '1.200', 'HITCOUNT': '1.650', 'weapon3': '2.514', 'DAMAGECOUNT': '6.705', 'FRAGCOUNT': '21.000'} [2024-08-05 23:28:51,002][52669] DAMAGECOUNT value on done: 35658.0 [2024-08-05 23:28:51,002][52669] Sum rewards: 29.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.823', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.142', 'weapon4': '0.158', 'WEAPON4': '0.250', 'WEAPON3': '1.000', 'weapon2': '1.396', 'ARMOR': '1.616', 'HITCOUNT': '2.010', 'weapon3': '2.182', 'DAMAGECOUNT': '7.506', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 124968960. Throughput: 0: 4375.8. Samples: 31246950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 23:28:52,794][52567] Avg episode reward: [(0, '29.251')] [2024-08-05 23:28:53,063][52803] DAMAGECOUNT value on done: 32566.0 [2024-08-05 23:28:53,065][52803] Sum rewards: 33.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.201', 'AMMO5': '0.015', 'weapon5': '0.036', 'AMMO2': '0.046', 'AMMO3': '0.225', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON4': '0.600', 'weapon2': '0.896', 'WEAPON3': '1.450', 'ARMOR': '1.764', 'HITCOUNT': '2.210', 'weapon3': '2.416', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '30.000'} [2024-08-05 23:28:53,348][52660] DAMAGECOUNT value on done: 34361.0 [2024-08-05 23:28:53,350][52660] Sum rewards: 30.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.032', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.462', 'ARMOR': '0.527', 'WEAPON3': '0.950', 'weapon2': '1.060', 'HITCOUNT': '2.010', 'weapon3': '2.140', 'DAMAGECOUNT': '7.710', 'FRAGCOUNT': '28.000'} [2024-08-05 23:28:53,871][52664] DAMAGECOUNT value on done: 35155.0 [2024-08-05 23:28:53,871][52664] Sum rewards: 21.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.933', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.298', 'ARMOR': '0.433', 'weapon2': '0.940', 'WEAPON3': '1.150', 'HITCOUNT': '1.990', 'weapon3': '2.488', 'DAMAGECOUNT': '7.569', 'FRAGCOUNT': '19.000'} [2024-08-05 23:28:54,043][52669] DAMAGECOUNT value on done: 37071.0 [2024-08-05 23:28:54,043][52669] Sum rewards: 30.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.790', 'AMMO2': '0.024', 'weapon4': '0.068', 'AMMO4': '0.120', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'ARMOR': '0.851', 'WEAPON3': '1.100', 'weapon2': '1.300', 'HITCOUNT': '2.210', 'weapon3': '2.376', 'DAMAGECOUNT': '9.201', 'FRAGCOUNT': '28.000'} [2024-08-05 23:28:54,677][52667] DAMAGECOUNT value on done: 36169.0 [2024-08-05 23:28:54,679][52667] Sum rewards: 40.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.532', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.156', 'weapon4': '0.156', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon2': '1.452', 'weapon3': '2.238', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '35.000'} [2024-08-05 23:28:55,395][52650] Updated weights for policy 0, policy_version 15261 (0.0012) [2024-08-05 23:28:55,537][52811] DAMAGECOUNT value on done: 34666.0 [2024-08-05 23:28:55,537][52811] Sum rewards: 33.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.246', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'ARMOR': '0.854', 'WEAPON3': '1.100', 'weapon2': '1.372', 'HITCOUNT': '1.990', 'weapon3': '2.358', 'DAMAGECOUNT': '7.857', 'FRAGCOUNT': '30.000'} [2024-08-05 23:28:55,797][52665] DAMAGECOUNT value on done: 34236.0 [2024-08-05 23:28:55,798][52665] Sum rewards: 29.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.916', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.182', 'weapon4': '0.360', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.300', 'HITCOUNT': '1.970', 'weapon3': '2.692', 'DAMAGECOUNT': '8.163', 'FRAGCOUNT': '28.000'} [2024-08-05 23:28:56,083][52803] DAMAGECOUNT value on done: 32941.0 [2024-08-05 23:28:56,084][52803] Sum rewards: 32.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.184', 'AMMO3': '0.191', 'ARMOR': '0.800', 'weapon2': '0.806', 'WEAPON3': '1.150', 'HITCOUNT': '2.040', 'weapon3': '2.648', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '29.000'} [2024-08-05 23:28:56,983][52664] DAMAGECOUNT value on done: 36777.0 [2024-08-05 23:28:56,984][52664] Sum rewards: 34.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.726', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.154', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '1.164', 'WEAPON3': '1.250', 'HITCOUNT': '2.300', 'weapon3': '2.508', 'DAMAGECOUNT': '8.784', 'FRAGCOUNT': '31.000'} [2024-08-05 23:28:57,022][52669] DAMAGECOUNT value on done: 38251.0 [2024-08-05 23:28:57,024][52669] Sum rewards: 26.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.848', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon2': '1.030', 'WEAPON3': '1.550', 'HITCOUNT': '2.000', 'weapon3': '2.496', 'DAMAGECOUNT': '7.821', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:57,744][52667] DAMAGECOUNT value on done: 37391.0 [2024-08-05 23:28:57,747][52667] Sum rewards: 32.206, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.589', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.254', 'weapon2': '0.866', 'ARMOR': '0.867', 'WEAPON3': '1.150', 'weapon3': '2.330', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '8.862', 'FRAGCOUNT': '27.000'} [2024-08-05 23:28:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 125059072. Throughput: 0: 4374.7. Samples: 31273170. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:28:57,794][52567] Avg episode reward: [(0, '29.654')] [2024-08-05 23:28:57,797][52614] Saving new best policy, reward=29.654! [2024-08-05 23:28:58,658][52665] DAMAGECOUNT value on done: 36269.0 [2024-08-05 23:28:58,659][52665] Sum rewards: 32.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO4': '0.175', 'AMMO3': '0.199', 'weapon4': '0.376', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.668', 'DAMAGECOUNT': '9.216', 'FRAGCOUNT': '29.000'} [2024-08-05 23:28:58,673][52811] DAMAGECOUNT value on done: 32558.0 [2024-08-05 23:28:58,673][52811] Sum rewards: 22.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.821', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'weapon4': '0.340', 'ARMOR': '0.837', 'WEAPON3': '1.000', 'weapon2': '1.026', 'HITCOUNT': '1.790', 'weapon3': '2.180', 'DAMAGECOUNT': '6.996', 'FRAGCOUNT': '19.000'} [2024-08-05 23:28:59,283][52803] DAMAGECOUNT value on done: 37006.0 [2024-08-05 23:28:59,285][52803] Sum rewards: 32.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.062', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.173', 'WEAPON4': '0.450', 'weapon4': '0.606', 'weapon2': '0.898', 'WEAPON3': '1.100', 'weapon3': '2.308', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '8.862', 'FRAGCOUNT': '29.000'} [2024-08-05 23:28:59,685][52664] DAMAGECOUNT value on done: 35625.0 [2024-08-05 23:28:59,685][52664] Sum rewards: 27.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.131', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON3': '1.000', 'weapon2': '1.232', 'ARMOR': '1.278', 'HITCOUNT': '1.820', 'weapon3': '2.274', 'DAMAGECOUNT': '7.911', 'FRAGCOUNT': '24.000'} [2024-08-05 23:28:59,853][52650] Updated weights for policy 0, policy_version 15271 (0.0012) [2024-08-05 23:28:59,999][52669] DAMAGECOUNT value on done: 36894.0 [2024-08-05 23:29:00,000][52669] Sum rewards: 27.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.215', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.254', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'ARMOR': '0.454', 'weapon2': '0.598', 'WEAPON3': '1.650', 'HITCOUNT': '2.210', 'weapon3': '2.744', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:00,579][52667] DAMAGECOUNT value on done: 35795.0 [2024-08-05 23:29:00,583][52667] Sum rewards: 30.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.504', 'weapon2': '0.640', 'ARMOR': '0.869', 'WEAPON3': '1.300', 'HITCOUNT': '2.220', 'weapon3': '2.498', 'DAMAGECOUNT': '7.764', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:01,778][52811] DAMAGECOUNT value on done: 35174.0 [2024-08-05 23:29:01,778][52811] Sum rewards: 21.615, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.068', 'AMMO3': '0.159', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.362', 'ARMOR': '0.454', 'WEAPON4': '0.500', 'weapon2': '0.856', 'WEAPON3': '0.950', 'HITCOUNT': '1.750', 'weapon3': '2.294', 'DAMAGECOUNT': '6.150', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:02,044][52665] DAMAGECOUNT value on done: 37275.0 [2024-08-05 23:29:02,045][52665] Sum rewards: 30.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon4': '0.208', 'weapon2': '1.034', 'WEAPON3': '1.200', 'ARMOR': '1.371', 'HITCOUNT': '1.980', 'weapon3': '2.432', 'DAMAGECOUNT': '8.160', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:02,359][52803] DAMAGECOUNT value on done: 31303.0 [2024-08-05 23:29:02,361][52803] Sum rewards: 25.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO2': '0.035', 'weapon4': '0.118', 'AMMO3': '0.174', 'AMMO4': '0.175', 'WEAPON4': '0.300', 'ARMOR': '0.872', 'WEAPON3': '1.100', 'weapon2': '1.256', 'HITCOUNT': '1.780', 'weapon3': '2.402', 'DAMAGECOUNT': '7.158', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:02,364][52664] DAMAGECOUNT value on done: 38623.0 [2024-08-05 23:29:02,367][52664] Sum rewards: 23.843, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.504', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.147', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON3': '0.900', 'weapon2': '0.940', 'HITCOUNT': '1.890', 'weapon3': '2.270', 'DAMAGECOUNT': '7.320', 'FRAGCOUNT': '20.500'} [2024-08-05 23:29:02,653][52669] DAMAGECOUNT value on done: 35537.0 [2024-08-05 23:29:02,653][52669] Sum rewards: 34.927, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.692', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.115', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.262', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.254', 'weapon3': '2.176', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '8.724', 'FRAGCOUNT': '27.500'} [2024-08-05 23:29:02,795][52567] Fps is (10 sec: 17202.2, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 125140992. Throughput: 0: 4367.9. Samples: 31285990. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:29:02,795][52567] Avg episode reward: [(0, '29.464')] [2024-08-05 23:29:03,420][52667] DAMAGECOUNT value on done: 36296.0 [2024-08-05 23:29:03,422][52667] Sum rewards: 35.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.528', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.234', 'ARMOR': '0.453', 'weapon2': '0.848', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.748', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:04,673][52650] Updated weights for policy 0, policy_version 15281 (0.0012) [2024-08-05 23:29:04,732][52665] DAMAGECOUNT value on done: 36050.0 [2024-08-05 23:29:04,734][52665] Sum rewards: 37.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.428', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'AMMO4': '0.191', 'WEAPON4': '0.350', 'weapon4': '0.518', 'weapon2': '0.582', 'ARMOR': '0.936', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '2.362', 'DAMAGECOUNT': '9.678', 'FRAGCOUNT': '32.000'} [2024-08-05 23:29:04,875][52811] DAMAGECOUNT value on done: 33508.0 [2024-08-05 23:29:04,876][52811] Sum rewards: 21.896, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.644', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.076', 'AMMO4': '0.181', 'AMMO3': '0.205', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'ARMOR': '0.974', 'weapon2': '1.100', 'WEAPON3': '1.250', 'HITCOUNT': '1.710', 'weapon3': '2.238', 'DAMAGECOUNT': '7.707', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:05,100][52664] DAMAGECOUNT value on done: 34658.0 [2024-08-05 23:29:05,101][52664] Sum rewards: 29.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.452', 'weapon2': '0.738', 'WEAPON3': '1.250', 'HITCOUNT': '2.180', 'weapon3': '2.570', 'DAMAGECOUNT': '9.465', 'FRAGCOUNT': '25.500'} [2024-08-05 23:29:05,397][52803] DAMAGECOUNT value on done: 36637.0 [2024-08-05 23:29:05,397][52803] Sum rewards: 12.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO3': '0.153', 'weapon4': '0.156', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.425', 'WEAPON3': '1.000', 'HITCOUNT': '1.260', 'weapon2': '1.460', 'weapon3': '1.628', 'DAMAGECOUNT': '5.202', 'FRAGCOUNT': '13.000'} [2024-08-05 23:29:05,549][52669] DAMAGECOUNT value on done: 35952.0 [2024-08-05 23:29:05,550][52669] Sum rewards: 30.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.034', 'AMMO4': '0.118', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.278', 'ARMOR': '0.500', 'weapon2': '0.972', 'WEAPON3': '1.050', 'HITCOUNT': '2.170', 'weapon3': '2.436', 'DAMAGECOUNT': '8.604', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:06,343][52667] DAMAGECOUNT value on done: 36316.0 [2024-08-05 23:29:06,344][52667] Sum rewards: 34.733, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.154', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.068', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.134', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.334', 'weapon3': '2.314', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.267', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 125231104. Throughput: 0: 4368.4. Samples: 31312320. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:29:07,794][52567] Avg episode reward: [(0, '29.261')] [2024-08-05 23:29:07,825][52665] DAMAGECOUNT value on done: 34538.0 [2024-08-05 23:29:07,829][52665] Sum rewards: 28.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.478', 'AMMO5': '0.020', 'weapon5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.172', 'AMMO4': '0.240', 'WEAPON5': '0.400', 'ARMOR': '0.477', 'weapon4': '0.570', 'WEAPON4': '0.600', 'weapon2': '0.744', 'WEAPON3': '1.200', 'HITCOUNT': '2.190', 'weapon3': '2.364', 'DAMAGECOUNT': '8.100', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:07,847][52664] DAMAGECOUNT value on done: 37137.0 [2024-08-05 23:29:07,847][52664] Sum rewards: 27.148, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.927', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.122', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon2': '1.142', 'WEAPON3': '1.150', 'ARMOR': '1.294', 'HITCOUNT': '1.750', 'weapon3': '2.178', 'DAMAGECOUNT': '6.978', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:07,892][52811] DAMAGECOUNT value on done: 32962.0 [2024-08-05 23:29:07,892][52811] Sum rewards: 30.490, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.009', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.032', 'ARMOR': '0.068', 'AMMO3': '0.109', 'AMMO4': '0.127', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.324', 'HITCOUNT': '1.890', 'weapon3': '2.086', 'DAMAGECOUNT': '7.359', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:08,014][52669] DAMAGECOUNT value on done: 34174.0 [2024-08-05 23:29:08,068][52669] Sum rewards: 29.351, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.148', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon4': '0.576', 'WEAPON3': '0.850', 'weapon2': '1.338', 'weapon3': '1.728', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '6.708', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:08,253][52666] DAMAGECOUNT value on done: 34006.0 [2024-08-05 23:29:08,255][52666] Sum rewards: 32.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.773', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.040', 'weapon4': '0.046', 'weapon5': '0.052', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'weapon2': '0.806', 'ARMOR': '0.859', 'WEAPON3': '1.350', 'HITCOUNT': '2.180', 'weapon3': '2.808', 'DAMAGECOUNT': '9.447', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:08,564][52803] DAMAGECOUNT value on done: 34160.0 [2024-08-05 23:29:08,568][52803] Sum rewards: 22.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON3': '1.200', 'weapon2': '1.214', 'ARMOR': '1.413', 'HITCOUNT': '1.540', 'weapon3': '1.802', 'DAMAGECOUNT': '6.540', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:09,146][52650] Updated weights for policy 0, policy_version 15291 (0.0025) [2024-08-05 23:29:09,463][52667] DAMAGECOUNT value on done: 38822.0 [2024-08-05 23:29:09,463][52667] Sum rewards: 33.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.206', 'weapon4': '0.210', 'ARMOR': '0.457', 'weapon2': '0.796', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.562', 'DAMAGECOUNT': '10.593', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:10,659][52664] DAMAGECOUNT value on done: 36073.0 [2024-08-05 23:29:10,661][52664] Sum rewards: 34.599, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'HEALTH': '0.032', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.146', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.496', 'ARMOR': '0.505', 'WEAPON3': '0.900', 'weapon2': '1.050', 'weapon3': '2.194', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '8.511', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:10,736][52665] DAMAGECOUNT value on done: 34207.0 [2024-08-05 23:29:10,737][52665] Sum rewards: 29.545, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.474', 'weapon2': '0.916', 'WEAPON3': '1.050', 'HITCOUNT': '2.300', 'weapon3': '2.334', 'DAMAGECOUNT': '8.904', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:10,761][52669] DAMAGECOUNT value on done: 36692.0 [2024-08-05 23:29:10,765][52669] Sum rewards: 31.327, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.068', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'AMMO4': '0.231', 'ARMOR': '0.448', 'WEAPON4': '0.450', 'weapon4': '0.488', 'HEALTH': '0.508', 'WEAPON3': '0.750', 'weapon2': '1.136', 'weapon3': '2.150', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '8.070', 'FRAGCOUNT': '23.500'} [2024-08-05 23:29:11,020][52811] DAMAGECOUNT value on done: 34942.0 [2024-08-05 23:29:11,021][52811] Sum rewards: 34.435, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.129', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO3': '0.108', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.446', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'weapon2': '0.922', 'weapon3': '2.112', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:11,178][52666] DAMAGECOUNT value on done: 35632.0 [2024-08-05 23:29:11,178][52666] Sum rewards: 19.014, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.248', 'ARMOR': '0.400', 'weapon2': '0.936', 'WEAPON3': '1.100', 'HITCOUNT': '1.980', 'weapon3': '2.488', 'DAMAGECOUNT': '7.485', 'FRAGCOUNT': '15.000'} [2024-08-05 23:29:11,634][52803] DAMAGECOUNT value on done: 35526.0 [2024-08-05 23:29:11,635][52803] Sum rewards: 39.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.854', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.172', 'ARMOR': '0.856', 'WEAPON3': '1.100', 'weapon2': '1.302', 'weapon3': '2.460', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.666', 'FRAGCOUNT': '33.000'} [2024-08-05 23:29:12,624][52667] DAMAGECOUNT value on done: 36717.0 [2024-08-05 23:29:12,628][52667] Sum rewards: 31.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.084', 'AMMO2': '0.011', 'weapon5': '0.014', 'AMMO5': '0.014', 'AMMO4': '0.055', 'weapon4': '0.154', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.460', 'weapon2': '0.842', 'WEAPON3': '1.350', 'HITCOUNT': '2.140', 'weapon3': '2.764', 'DAMAGECOUNT': '8.712', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:12,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 125321216. Throughput: 0: 4370.2. Samples: 31338570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:29:12,794][52567] Avg episode reward: [(0, '29.490')] [2024-08-05 23:29:13,168][52664] DAMAGECOUNT value on done: 37894.0 [2024-08-05 23:29:13,168][52664] Sum rewards: 23.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.130', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'ARMOR': '0.871', 'WEAPON3': '1.150', 'weapon2': '1.606', 'HITCOUNT': '1.830', 'weapon3': '2.022', 'DAMAGECOUNT': '8.121', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:13,762][52665] DAMAGECOUNT value on done: 36777.0 [2024-08-05 23:29:13,764][52665] Sum rewards: 38.052, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.810', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.144', 'ARMOR': '0.454', 'WEAPON3': '0.950', 'weapon2': '1.450', 'HITCOUNT': '2.250', 'weapon3': '2.398', 'DAMAGECOUNT': '10.215', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:13,915][52650] Updated weights for policy 0, policy_version 15301 (0.0012) [2024-08-05 23:29:13,950][52669] DAMAGECOUNT value on done: 38064.0 [2024-08-05 23:29:13,950][52669] Sum rewards: 13.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.018', 'weapon5': '0.036', 'AMMO2': '0.044', 'AMMO3': '0.188', 'weapon4': '0.214', 'AMMO4': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'ARMOR': '0.920', 'WEAPON3': '1.200', 'weapon2': '1.272', 'HITCOUNT': '1.320', 'weapon3': '2.138', 'DAMAGECOUNT': '5.208', 'FRAGCOUNT': '14.000'} [2024-08-05 23:29:14,120][52811] DAMAGECOUNT value on done: 36433.0 [2024-08-05 23:29:14,125][52811] Sum rewards: 29.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.060', 'AMMO3': '0.182', 'ARMOR': '0.424', 'weapon2': '1.012', 'WEAPON3': '1.200', 'HITCOUNT': '2.220', 'weapon3': '2.744', 'DAMAGECOUNT': '7.974', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:14,286][52666] DAMAGECOUNT value on done: 34772.0 [2024-08-05 23:29:14,288][52666] Sum rewards: 29.487, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.588', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.326', 'ARMOR': '0.891', 'WEAPON3': '1.000', 'weapon2': '1.124', 'HITCOUNT': '1.870', 'weapon3': '2.242', 'DAMAGECOUNT': '7.755', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:14,381][52670] DAMAGECOUNT value on done: 35627.0 [2024-08-05 23:29:14,382][52670] Sum rewards: 23.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.418', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.092', 'AMMO4': '0.187', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.542', 'ARMOR': '0.905', 'weapon2': '1.124', 'WEAPON3': '1.250', 'HITCOUNT': '1.670', 'weapon3': '1.868', 'DAMAGECOUNT': '6.915', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:14,558][52803] DAMAGECOUNT value on done: 33146.0 [2024-08-05 23:29:14,558][52803] Sum rewards: 31.126, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.034', 'AMMO3': '0.134', 'weapon5': '0.152', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HEALTH': '0.666', 'weapon4': '0.666', 'weapon2': '0.726', 'WEAPON3': '0.750', 'weapon3': '2.042', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '8.778', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:15,566][52664] DAMAGECOUNT value on done: 37177.0 [2024-08-05 23:29:15,566][52664] Sum rewards: 33.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.264', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.146', 'AMMO3': '0.197', 'WEAPON4': '0.400', 'weapon2': '1.116', 'WEAPON3': '1.150', 'ARMOR': '1.298', 'HITCOUNT': '2.270', 'weapon3': '2.500', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:15,598][52667] DAMAGECOUNT value on done: 35279.0 [2024-08-05 23:29:15,598][52667] Sum rewards: 30.651, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.033', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'weapon5': '0.054', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.310', 'ARMOR': '0.924', 'weapon2': '1.072', 'WEAPON3': '1.150', 'HITCOUNT': '1.920', 'weapon3': '2.270', 'DAMAGECOUNT': '7.617', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:16,701][52665] DAMAGECOUNT value on done: 36338.0 [2024-08-05 23:29:16,701][52665] Sum rewards: 27.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.028', 'weapon4': '0.052', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.896', 'ARMOR': '1.253', 'WEAPON3': '1.300', 'HITCOUNT': '1.610', 'weapon3': '2.428', 'DAMAGECOUNT': '7.017', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:17,105][52666] DAMAGECOUNT value on done: 33572.0 [2024-08-05 23:29:17,107][52666] Sum rewards: 12.442, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.643', 'AMMO5': '0.005', 'ARMOR': '0.024', 'weapon5': '0.028', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon4': '0.158', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'weapon2': '1.142', 'WEAPON3': '1.250', 'HITCOUNT': '1.520', 'weapon3': '2.282', 'DAMAGECOUNT': '5.778', 'FRAGCOUNT': '16.000'} [2024-08-05 23:29:17,175][52670] DAMAGECOUNT value on done: 37071.0 [2024-08-05 23:29:17,175][52670] Sum rewards: 38.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.784', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '2.578', 'DAMAGECOUNT': '9.762', 'FRAGCOUNT': '33.000'} [2024-08-05 23:29:17,210][52669] DAMAGECOUNT value on done: 34997.0 [2024-08-05 23:29:17,210][52669] Sum rewards: 34.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.176', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.350', 'ARMOR': '0.454', 'weapon2': '0.796', 'WEAPON3': '1.200', 'HITCOUNT': '2.240', 'weapon3': '2.678', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '32.000'} [2024-08-05 23:29:17,248][52811] DAMAGECOUNT value on done: 32088.0 [2024-08-05 23:29:17,250][52811] Sum rewards: 23.188, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.804', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO3': '0.135', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.400', 'ARMOR': '0.488', 'WEAPON3': '0.950', 'weapon2': '1.208', 'HITCOUNT': '1.750', 'weapon3': '2.248', 'DAMAGECOUNT': '7.209', 'FRAGCOUNT': '19.500'} [2024-08-05 23:29:17,700][52803] DAMAGECOUNT value on done: 36176.0 [2024-08-05 23:29:17,701][52803] Sum rewards: 34.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.848', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon4': '0.164', 'AMMO4': '0.195', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.050', 'HITCOUNT': '2.100', 'weapon3': '2.482', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 125411328. Throughput: 0: 4383.3. Samples: 31351840. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 23:29:17,794][52567] Avg episode reward: [(0, '29.284')] [2024-08-05 23:29:18,211][52667] DAMAGECOUNT value on done: 37420.0 [2024-08-05 23:29:18,212][52667] Sum rewards: 18.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.016', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON3': '0.950', 'weapon2': '1.102', 'HITCOUNT': '1.550', 'weapon3': '1.890', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '17.000'} [2024-08-05 23:29:18,884][52650] Updated weights for policy 0, policy_version 15311 (0.0013) [2024-08-05 23:29:19,513][52665] DAMAGECOUNT value on done: 36886.0 [2024-08-05 23:29:19,513][52665] Sum rewards: 25.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.026', 'AMMO3': '0.120', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.356', 'ARMOR': '0.824', 'WEAPON3': '0.850', 'weapon2': '1.296', 'HITCOUNT': '1.880', 'weapon3': '2.022', 'DAMAGECOUNT': '6.954', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:20,165][52666] DAMAGECOUNT value on done: 34269.0 [2024-08-05 23:29:20,167][52666] Sum rewards: 35.041, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.469', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.097', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'weapon4': '0.390', 'WEAPON3': '0.900', 'weapon2': '0.904', 'ARMOR': '0.948', 'HITCOUNT': '2.260', 'weapon3': '2.364', 'DAMAGECOUNT': '8.871', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:20,210][52811] DAMAGECOUNT value on done: 34907.0 [2024-08-05 23:29:20,213][52811] Sum rewards: 27.814, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.632', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.088', 'AMMO3': '0.129', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.496', 'WEAPON3': '0.800', 'weapon2': '1.230', 'HITCOUNT': '1.790', 'weapon3': '2.056', 'DAMAGECOUNT': '7.632', 'FRAGCOUNT': '22.500'} [2024-08-05 23:29:20,243][52669] DAMAGECOUNT value on done: 36520.0 [2024-08-05 23:29:20,243][52669] Sum rewards: 20.531, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.570', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'AMMO4': '0.213', 'WEAPON4': '0.400', 'weapon4': '0.418', 'ARMOR': '0.444', 'weapon2': '0.582', 'WEAPON3': '1.200', 'HITCOUNT': '1.610', 'weapon3': '2.394', 'DAMAGECOUNT': '7.317', 'FRAGCOUNT': '21.000'} [2024-08-05 23:29:20,317][52670] DAMAGECOUNT value on done: 35816.0 [2024-08-05 23:29:20,318][52670] Sum rewards: 31.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.170', 'AMMO3': '0.200', 'AMMO4': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.394', 'WEAPON4': '0.550', 'weapon2': '0.716', 'ARMOR': '0.890', 'WEAPON3': '1.150', 'HITCOUNT': '1.920', 'weapon3': '2.352', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:20,891][52658] Large shaping reward 2.506 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.504, 168.0), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2024-08-05 23:29:20,980][52803] DAMAGECOUNT value on done: 33595.0 [2024-08-05 23:29:20,980][52803] Sum rewards: 23.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'AMMO4': '0.238', 'weapon4': '0.316', 'WEAPON4': '0.500', 'weapon2': '0.612', 'ARMOR': '0.836', 'WEAPON3': '1.300', 'HITCOUNT': '1.980', 'weapon3': '2.676', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:21,119][52667] DAMAGECOUNT value on done: 36357.0 [2024-08-05 23:29:21,121][52667] Sum rewards: 35.100, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.815', 'AMMO5': '0.005', 'weapon5': '0.038', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.291', 'WEAPON4': '0.400', 'weapon4': '0.578', 'WEAPON3': '0.850', 'weapon2': '0.976', 'weapon3': '1.990', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '8.784', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:22,271][52658] DAMAGECOUNT value on done: 37815.0 [2024-08-05 23:29:22,272][52658] Sum rewards: 27.274, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'weapon5': '0.022', 'AMMO2': '0.040', 'AMMO3': '0.130', 'AMMO4': '0.202', 'HEALTH': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.416', 'ARMOR': '0.489', 'WEAPON3': '0.800', 'weapon2': '1.082', 'HITCOUNT': '1.970', 'weapon3': '2.202', 'DAMAGECOUNT': '8.334', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:22,301][52665] DAMAGECOUNT value on done: 37175.0 [2024-08-05 23:29:22,304][52665] Sum rewards: 31.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.500', 'weapon2': '0.784', 'WEAPON3': '1.550', 'HITCOUNT': '2.310', 'weapon3': '2.582', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 125501440. Throughput: 0: 4382.2. Samples: 31378140. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 23:29:22,794][52567] Avg episode reward: [(0, '29.045')] [2024-08-05 23:29:23,150][52650] Updated weights for policy 0, policy_version 15321 (0.0030) [2024-08-05 23:29:23,172][52669] DAMAGECOUNT value on done: 36784.0 [2024-08-05 23:29:23,174][52669] Sum rewards: 24.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'ARMOR': '0.040', 'AMMO2': '0.045', 'weapon5': '0.066', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'AMMO4': '0.225', 'weapon4': '0.430', 'WEAPON4': '0.550', 'weapon2': '0.920', 'WEAPON3': '1.350', 'HITCOUNT': '2.090', 'weapon3': '2.296', 'DAMAGECOUNT': '8.349', 'FRAGCOUNT': '24.500'} [2024-08-05 23:29:23,216][52811] DAMAGECOUNT value on done: 33099.0 [2024-08-05 23:29:23,224][52811] Sum rewards: 30.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'weapon4': '0.360', 'ARMOR': '0.897', 'WEAPON3': '0.950', 'weapon2': '1.062', 'HITCOUNT': '2.000', 'weapon3': '2.350', 'DAMAGECOUNT': '7.296', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:23,257][52666] DAMAGECOUNT value on done: 34243.0 [2024-08-05 23:29:23,257][52666] Sum rewards: 33.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.988', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.224', 'AMMO3': '0.228', 'weapon2': '1.088', 'WEAPON3': '1.400', 'ARMOR': '1.657', 'HITCOUNT': '2.250', 'weapon3': '2.374', 'DAMAGECOUNT': '8.940', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:23,323][52670] DAMAGECOUNT value on done: 35987.0 [2024-08-05 23:29:23,324][52670] Sum rewards: 28.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.158', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'ARMOR': '0.460', 'weapon4': '0.498', 'weapon2': '0.738', 'WEAPON3': '1.050', 'HITCOUNT': '2.020', 'weapon3': '2.174', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:23,860][52667] DAMAGECOUNT value on done: 34700.0 [2024-08-05 23:29:23,862][52667] Sum rewards: 34.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.074', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.132', 'AMMO4': '0.151', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'ARMOR': '0.876', 'weapon2': '1.064', 'WEAPON3': '1.100', 'HITCOUNT': '1.880', 'weapon3': '2.168', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:24,147][52803] DAMAGECOUNT value on done: 32967.0 [2024-08-05 23:29:24,148][52803] Sum rewards: 38.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.752', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.062', 'weapon5': '0.072', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'ARMOR': '0.908', 'weapon2': '1.552', 'weapon3': '2.110', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:24,324][52663] DAMAGECOUNT value on done: 36900.0 [2024-08-05 23:29:24,325][52663] Sum rewards: 31.167, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.900', 'AMMO2': '0.028', 'ARMOR': '0.030', 'AMMO3': '0.130', 'AMMO4': '0.140', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.326', 'HITCOUNT': '2.110', 'weapon3': '2.250', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:25,036][52665] DAMAGECOUNT value on done: 37566.0 [2024-08-05 23:29:25,037][52665] Sum rewards: 35.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.340', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.048', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.253', 'WEAPON4': '0.500', 'weapon2': '0.654', 'WEAPON3': '1.650', 'HITCOUNT': '2.320', 'weapon3': '2.790', 'DAMAGECOUNT': '9.672', 'FRAGCOUNT': '34.000'} [2024-08-05 23:29:25,140][52658] DAMAGECOUNT value on done: 34844.0 [2024-08-05 23:29:25,140][52658] Sum rewards: 23.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.831', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.155', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.904', 'WEAPON3': '1.050', 'weapon2': '1.544', 'HITCOUNT': '1.870', 'weapon3': '1.958', 'DAMAGECOUNT': '6.927', 'FRAGCOUNT': '21.000'} [2024-08-05 23:29:25,648][52666] DAMAGECOUNT value on done: 35257.0 [2024-08-05 23:29:25,651][52666] Sum rewards: 30.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.129', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.136', 'AMMO3': '0.167', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.450', 'weapon2': '0.904', 'ARMOR': '0.951', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '2.314', 'DAMAGECOUNT': '9.738', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:25,778][52670] DAMAGECOUNT value on done: 33995.0 [2024-08-05 23:29:25,782][52670] Sum rewards: 38.286, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'weapon5': '0.024', 'ARMOR': '0.032', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.124', 'AMMO4': '0.224', 'weapon4': '0.298', 'WEAPON4': '0.300', 'HEALTH': '0.336', 'WEAPON3': '0.650', 'weapon2': '1.464', 'weapon3': '1.942', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.234', 'FRAGCOUNT': '34.000'} [2024-08-05 23:29:25,789][52669] DAMAGECOUNT value on done: 37111.0 [2024-08-05 23:29:25,792][52669] Sum rewards: 21.495, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.672', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.123', 'weapon4': '0.152', 'WEAPON4': '0.300', 'ARMOR': '0.864', 'WEAPON3': '0.950', 'weapon2': '1.402', 'HITCOUNT': '1.740', 'weapon3': '2.088', 'DAMAGECOUNT': '6.222', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:26,315][52811] DAMAGECOUNT value on done: 36006.0 [2024-08-05 23:29:26,315][52811] Sum rewards: 20.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.596', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.024', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '1.150', 'ARMOR': '1.313', 'WEAPON3': '1.450', 'HITCOUNT': '2.010', 'weapon3': '2.520', 'DAMAGECOUNT': '8.355', 'FRAGCOUNT': '19.500'} [2024-08-05 23:29:26,771][52667] DAMAGECOUNT value on done: 35305.0 [2024-08-05 23:29:26,772][52667] Sum rewards: 26.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.566', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'WEAPON3': '1.000', 'weapon2': '1.174', 'ARMOR': '1.767', 'HITCOUNT': '1.810', 'weapon3': '2.544', 'DAMAGECOUNT': '7.320', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:27,332][52663] DAMAGECOUNT value on done: 36264.0 [2024-08-05 23:29:27,333][52663] Sum rewards: 26.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.231', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.314', 'ARMOR': '0.444', 'weapon2': '0.922', 'WEAPON3': '1.400', 'HITCOUNT': '2.030', 'weapon3': '2.388', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:27,418][52803] DAMAGECOUNT value on done: 33874.0 [2024-08-05 23:29:27,418][52803] Sum rewards: 19.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.488', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.010', 'weapon5': '0.020', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'ARMOR': '0.855', 'weapon2': '1.226', 'WEAPON3': '1.400', 'HITCOUNT': '1.700', 'weapon3': '2.506', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 125583360. Throughput: 0: 4383.1. Samples: 31404630. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-05 23:29:27,794][52567] Avg episode reward: [(0, '28.997')] [2024-08-05 23:29:27,891][52658] DAMAGECOUNT value on done: 33840.0 [2024-08-05 23:29:27,892][52658] Sum rewards: 22.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.204', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'AMMO4': '0.252', 'weapon4': '0.360', 'WEAPON4': '0.500', 'ARMOR': '0.511', 'weapon2': '0.620', 'WEAPON3': '1.300', 'HITCOUNT': '1.860', 'weapon3': '2.578', 'DAMAGECOUNT': '7.074', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:27,948][52650] Updated weights for policy 0, policy_version 15331 (0.0011) [2024-08-05 23:29:28,261][52665] DAMAGECOUNT value on done: 34921.0 [2024-08-05 23:29:28,269][52665] Sum rewards: 34.479, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.096', 'weapon5': '0.112', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.929', 'WEAPON3': '1.000', 'weapon2': '1.230', 'weapon3': '2.324', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:28,535][52666] DAMAGECOUNT value on done: 35294.0 [2024-08-05 23:29:28,536][52666] Sum rewards: 29.178, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.303', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO2': '0.025', 'weapon5': '0.054', 'AMMO4': '0.122', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '0.800', 'ARMOR': '0.848', 'weapon2': '1.390', 'HITCOUNT': '1.610', 'weapon3': '1.962', 'DAMAGECOUNT': '6.885', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:28,635][52670] DAMAGECOUNT value on done: 38307.0 [2024-08-05 23:29:28,636][52670] Sum rewards: 32.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.554', 'WEAPON3': '1.450', 'HITCOUNT': '2.300', 'weapon3': '2.740', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:28,839][52669] DAMAGECOUNT value on done: 36891.0 [2024-08-05 23:29:28,840][52669] Sum rewards: 30.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.782', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.032', 'ARMOR': '0.056', 'AMMO4': '0.079', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.900', 'weapon2': '0.900', 'HITCOUNT': '2.090', 'weapon3': '2.378', 'DAMAGECOUNT': '8.079', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:29,349][52811] DAMAGECOUNT value on done: 32583.0 [2024-08-05 23:29:29,350][52811] Sum rewards: 26.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.546', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'AMMO3': '0.186', 'weapon4': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'WEAPON3': '1.050', 'weapon2': '1.266', 'HITCOUNT': '2.110', 'weapon3': '2.278', 'DAMAGECOUNT': '7.557', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:29,479][52667] DAMAGECOUNT value on done: 37604.0 [2024-08-05 23:29:29,479][52667] Sum rewards: 18.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.040', 'AMMO4': '0.082', 'weapon5': '0.086', 'AMMO3': '0.121', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '0.850', 'weapon2': '1.022', 'HITCOUNT': '1.640', 'weapon3': '2.166', 'DAMAGECOUNT': '6.510', 'FRAGCOUNT': '16.000'} [2024-08-05 23:29:29,992][52663] DAMAGECOUNT value on done: 36344.0 [2024-08-05 23:29:29,993][52663] Sum rewards: 34.304, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.685', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon4': '0.304', 'ARMOR': '0.481', 'weapon2': '0.748', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.692', 'DAMAGECOUNT': '9.432', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:30,487][52803] DAMAGECOUNT value on done: 34053.0 [2024-08-05 23:29:30,488][52803] Sum rewards: 19.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.114', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.162', 'weapon4': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon2': '1.250', 'ARMOR': '1.394', 'HITCOUNT': '1.500', 'weapon3': '1.924', 'DAMAGECOUNT': '5.775', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:30,684][52658] DAMAGECOUNT value on done: 35943.0 [2024-08-05 23:29:30,686][52658] Sum rewards: 19.688, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.892', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.162', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'ARMOR': '1.303', 'weapon2': '1.322', 'HITCOUNT': '1.720', 'weapon3': '2.124', 'DAMAGECOUNT': '7.311', 'FRAGCOUNT': '17.000'} [2024-08-05 23:29:30,751][52665] DAMAGECOUNT value on done: 34370.0 [2024-08-05 23:29:30,751][52665] Sum rewards: 26.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.218', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon4': '0.458', 'WEAPON4': '0.550', 'weapon2': '0.946', 'WEAPON3': '1.150', 'ARMOR': '1.355', 'HITCOUNT': '1.960', 'weapon3': '2.066', 'DAMAGECOUNT': '8.211', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:31,057][52669] DAMAGECOUNT value on done: 37301.0 [2024-08-05 23:29:31,058][52669] Sum rewards: 21.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.173', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.202', 'weapon2': '0.794', 'ARMOR': '0.872', 'WEAPON3': '1.300', 'HITCOUNT': '1.910', 'weapon3': '2.742', 'DAMAGECOUNT': '7.308', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:31,289][52666] DAMAGECOUNT value on done: 36274.0 [2024-08-05 23:29:31,289][52666] Sum rewards: 31.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.997', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.170', 'WEAPON3': '1.050', 'ARMOR': '1.262', 'weapon2': '1.306', 'HITCOUNT': '2.260', 'weapon3': '2.356', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:31,387][52670] DAMAGECOUNT value on done: 33782.0 [2024-08-05 23:29:31,388][52670] Sum rewards: 21.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.724', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.118', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.885', 'weapon2': '1.702', 'HITCOUNT': '1.820', 'weapon3': '1.984', 'DAMAGECOUNT': '7.083', 'FRAGCOUNT': '19.000'} [2024-08-05 23:29:32,372][52811] DAMAGECOUNT value on done: 33807.0 [2024-08-05 23:29:32,375][52811] Sum rewards: 28.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.119', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon5': '0.094', 'weapon4': '0.122', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'WEAPON4': '0.450', 'ARMOR': '0.816', 'WEAPON3': '1.050', 'weapon2': '1.204', 'HITCOUNT': '1.680', 'weapon3': '2.312', 'DAMAGECOUNT': '7.176', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:32,443][52667] DAMAGECOUNT value on done: 35934.0 [2024-08-05 23:29:32,446][52667] Sum rewards: 33.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.216', 'ARMOR': '0.522', 'weapon2': '0.674', 'WEAPON3': '1.500', 'HITCOUNT': '2.190', 'weapon3': '2.846', 'DAMAGECOUNT': '9.927', 'FRAGCOUNT': '32.000'} [2024-08-05 23:29:32,547][52650] Updated weights for policy 0, policy_version 15341 (0.0010) [2024-08-05 23:29:32,624][52663] DAMAGECOUNT value on done: 36922.0 [2024-08-05 23:29:32,625][52663] Sum rewards: 29.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.012', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon4': '0.476', 'WEAPON3': '1.000', 'weapon2': '1.140', 'ARMOR': '1.268', 'HITCOUNT': '1.940', 'weapon3': '2.196', 'DAMAGECOUNT': '7.905', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 125673472. Throughput: 0: 4384.7. Samples: 31417870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:29:32,794][52567] Avg episode reward: [(0, '28.693')] [2024-08-05 23:29:33,318][52665] DAMAGECOUNT value on done: 36845.0 [2024-08-05 23:29:33,320][52665] Sum rewards: 30.630, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.194', 'AMMO3': '0.242', 'weapon4': '0.342', 'ARMOR': '0.441', 'WEAPON4': '0.500', 'weapon2': '0.764', 'WEAPON3': '1.450', 'HITCOUNT': '2.400', 'weapon3': '2.630', 'DAMAGECOUNT': '9.453', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:33,485][52795] DAMAGECOUNT value on done: 33636.0 [2024-08-05 23:29:33,486][52795] Sum rewards: 36.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.128', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'ARMOR': '1.200', 'weapon2': '1.474', 'weapon3': '2.172', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.333', 'FRAGCOUNT': '29.500'} [2024-08-05 23:29:33,575][52803] DAMAGECOUNT value on done: 32644.0 [2024-08-05 23:29:33,575][52803] Sum rewards: 31.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.692', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO2': '0.033', 'weapon4': '0.084', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon2': '0.754', 'WEAPON3': '1.350', 'HITCOUNT': '1.910', 'weapon3': '2.860', 'DAMAGECOUNT': '8.577', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:33,693][52658] DAMAGECOUNT value on done: 38332.0 [2024-08-05 23:29:33,693][52658] Sum rewards: 32.315, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.005', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.092', 'AMMO3': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'HEALTH': '0.660', 'WEAPON3': '0.750', 'weapon2': '1.274', 'HITCOUNT': '2.110', 'weapon3': '2.192', 'DAMAGECOUNT': '8.457', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:33,789][52669] DAMAGECOUNT value on done: 34744.0 [2024-08-05 23:29:33,789][52669] Sum rewards: 23.781, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.021', 'weapon4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'ARMOR': '0.400', 'weapon2': '1.036', 'WEAPON3': '1.100', 'HITCOUNT': '1.840', 'weapon3': '2.548', 'DAMAGECOUNT': '7.605', 'FRAGCOUNT': '21.000'} [2024-08-05 23:29:34,414][52666] DAMAGECOUNT value on done: 34140.0 [2024-08-05 23:29:34,416][52666] Sum rewards: 29.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'weapon5': '0.002', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon4': '0.338', 'WEAPON4': '0.350', 'ARMOR': '0.890', 'weapon2': '0.890', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '2.498', 'DAMAGECOUNT': '8.970', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:34,633][52670] DAMAGECOUNT value on done: 34923.0 [2024-08-05 23:29:34,633][52670] Sum rewards: 33.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.512', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO4': '0.039', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.422', 'ARMOR': '0.491', 'weapon2': '0.830', 'WEAPON3': '1.500', 'weapon3': '2.416', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.044', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:35,274][52667] DAMAGECOUNT value on done: 38781.0 [2024-08-05 23:29:35,275][52667] Sum rewards: 31.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.896', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.218', 'ARMOR': '0.906', 'weapon2': '1.098', 'WEAPON3': '1.200', 'weapon3': '2.428', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.318', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:35,447][52663] DAMAGECOUNT value on done: 34230.0 [2024-08-05 23:29:35,448][52663] Sum rewards: 19.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.807', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.231', 'weapon4': '0.334', 'WEAPON4': '0.500', 'ARMOR': '0.954', 'WEAPON3': '1.150', 'weapon2': '1.268', 'HITCOUNT': '1.640', 'weapon3': '2.092', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '17.000'} [2024-08-05 23:29:35,452][52811] DAMAGECOUNT value on done: 34245.0 [2024-08-05 23:29:35,452][52811] Sum rewards: 39.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.821', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'ARMOR': '0.847', 'WEAPON3': '1.100', 'weapon2': '1.170', 'HITCOUNT': '1.970', 'weapon3': '2.368', 'DAMAGECOUNT': '8.589', 'FRAGCOUNT': '35.000'} [2024-08-05 23:29:36,177][52658] DAMAGECOUNT value on done: 34991.0 [2024-08-05 23:29:36,177][52658] Sum rewards: 38.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.904', 'ARMOR': '0.905', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.700', 'DAMAGECOUNT': '10.266', 'FRAGCOUNT': '32.000'} [2024-08-05 23:29:36,295][52665] DAMAGECOUNT value on done: 35924.0 [2024-08-05 23:29:36,295][52665] Sum rewards: 24.114, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.505', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.868', 'WEAPON3': '1.050', 'HITCOUNT': '1.700', 'weapon3': '2.190', 'DAMAGECOUNT': '6.381', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:36,591][52803] DAMAGECOUNT value on done: 32950.0 [2024-08-05 23:29:36,593][52803] Sum rewards: 30.067, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.294', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.202', 'ARMOR': '0.845', 'WEAPON3': '0.950', 'weapon2': '1.070', 'HITCOUNT': '1.870', 'weapon3': '2.452', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:36,611][52795] DAMAGECOUNT value on done: 31741.0 [2024-08-05 23:29:36,613][52795] Sum rewards: 32.194, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.518', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.038', 'AMMO4': '0.178', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.538', 'weapon4': '0.734', 'WEAPON3': '1.100', 'HITCOUNT': '2.300', 'weapon3': '2.364', 'DAMAGECOUNT': '8.880', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:36,834][52669] DAMAGECOUNT value on done: 37554.0 [2024-08-05 23:29:36,836][52669] Sum rewards: 26.206, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.512', 'AMMO5': '0.007', 'weapon5': '0.030', 'AMMO2': '0.034', 'weapon4': '0.104', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.350', 'ARMOR': '0.897', 'WEAPON3': '0.900', 'weapon2': '1.440', 'HITCOUNT': '1.950', 'weapon3': '2.232', 'DAMAGECOUNT': '7.329', 'FRAGCOUNT': '22.500'} [2024-08-05 23:29:37,159][52666] DAMAGECOUNT value on done: 32007.0 [2024-08-05 23:29:37,160][52666] Sum rewards: 34.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'weapon4': '0.164', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.888', 'ARMOR': '0.945', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.666', 'DAMAGECOUNT': '9.567', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:37,318][52650] Updated weights for policy 0, policy_version 15351 (0.0012) [2024-08-05 23:29:37,407][52670] DAMAGECOUNT value on done: 33209.0 [2024-08-05 23:29:37,409][52670] Sum rewards: 36.362, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.635', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon5': '0.074', 'AMMO3': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.330', 'WEAPON3': '0.750', 'weapon2': '1.202', 'weapon3': '2.102', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.697', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:37,730][52667] DAMAGECOUNT value on done: 38980.0 [2024-08-05 23:29:37,732][52667] Sum rewards: 38.959, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.080', 'AMMO3': '0.153', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.566', 'weapon2': '0.796', 'ARMOR': '0.925', 'WEAPON3': '1.100', 'weapon3': '2.276', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.263', 'FRAGCOUNT': '32.000'} [2024-08-05 23:29:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 125763584. Throughput: 0: 4384.9. Samples: 31444270. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:29:37,794][52567] Avg episode reward: [(0, '29.020')] [2024-08-05 23:29:38,443][52663] DAMAGECOUNT value on done: 37667.0 [2024-08-05 23:29:38,443][52663] Sum rewards: 27.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'ARMOR': '0.893', 'weapon2': '0.898', 'WEAPON3': '1.400', 'HITCOUNT': '2.180', 'weapon3': '2.822', 'DAMAGECOUNT': '7.980', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:38,599][52811] DAMAGECOUNT value on done: 35122.0 [2024-08-05 23:29:38,599][52811] Sum rewards: 29.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.215', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.804', 'ARMOR': '0.905', 'WEAPON3': '1.200', 'HITCOUNT': '2.040', 'weapon3': '2.520', 'DAMAGECOUNT': '8.466', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:38,969][52658] DAMAGECOUNT value on done: 40858.0 [2024-08-05 23:29:38,972][52658] Sum rewards: 23.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.257', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.114', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'ARMOR': '0.824', 'WEAPON3': '0.950', 'weapon2': '1.228', 'HITCOUNT': '1.920', 'weapon3': '2.246', 'DAMAGECOUNT': '7.335', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:39,572][52665] DAMAGECOUNT value on done: 35817.0 [2024-08-05 23:29:39,574][52665] Sum rewards: 32.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.588', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.066', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'ARMOR': '0.432', 'weapon4': '0.524', 'WEAPON4': '0.600', 'weapon2': '0.770', 'WEAPON3': '1.000', 'HITCOUNT': '2.040', 'weapon3': '2.344', 'DAMAGECOUNT': '8.724', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:39,704][52803] DAMAGECOUNT value on done: 34836.0 [2024-08-05 23:29:39,706][52803] Sum rewards: 32.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.216', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.149', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.498', 'weapon4': '0.520', 'weapon2': '1.056', 'WEAPON3': '1.100', 'weapon3': '1.984', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '8.733', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:39,865][52795] DAMAGECOUNT value on done: 32244.0 [2024-08-05 23:29:39,868][52795] Sum rewards: 22.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.294', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.334', 'WEAPON3': '1.150', 'weapon2': '1.338', 'ARMOR': '1.800', 'HITCOUNT': '1.820', 'weapon3': '1.878', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '19.000'} [2024-08-05 23:29:40,171][52666] DAMAGECOUNT value on done: 32573.0 [2024-08-05 23:29:40,173][52666] Sum rewards: 27.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.214', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.060', 'HITCOUNT': '1.860', 'weapon3': '2.492', 'DAMAGECOUNT': '7.314', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:40,207][52647] DAMAGECOUNT value on done: 38284.0 [2024-08-05 23:29:40,207][52647] Sum rewards: 27.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.161', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.422', 'ARMOR': '0.855', 'weapon2': '0.908', 'WEAPON3': '1.100', 'HITCOUNT': '1.830', 'weapon3': '2.312', 'DAMAGECOUNT': '6.777', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:40,358][52667] DAMAGECOUNT value on done: 37148.0 [2024-08-05 23:29:40,359][52670] DAMAGECOUNT value on done: 30726.0 [2024-08-05 23:29:40,359][52670] Sum rewards: 25.561, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.730', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.159', 'WEAPON3': '1.100', 'weapon2': '1.370', 'HITCOUNT': '1.610', 'ARMOR': '1.775', 'weapon3': '2.496', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:40,359][52667] Sum rewards: 35.891, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.700', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.015', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.133', 'WEAPON5': '0.400', 'ARMOR': '0.875', 'WEAPON3': '0.950', 'weapon2': '1.702', 'weapon3': '2.026', 'HITCOUNT': '2.040', 'DAMAGECOUNT': '8.505', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:41,299][52663] DAMAGECOUNT value on done: 39805.0 [2024-08-05 23:29:41,307][52663] Sum rewards: 31.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.247', 'ARMOR': '0.800', 'weapon2': '1.038', 'WEAPON3': '1.450', 'HITCOUNT': '2.330', 'weapon3': '2.528', 'DAMAGECOUNT': '9.669', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:41,469][52658] DAMAGECOUNT value on done: 34028.0 [2024-08-05 23:29:41,470][52658] Sum rewards: 24.938, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.054', 'weapon5': '0.058', 'AMMO3': '0.144', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'ARMOR': '1.314', 'weapon2': '1.460', 'HITCOUNT': '1.680', 'weapon3': '2.224', 'DAMAGECOUNT': '7.323', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:41,667][52811] DAMAGECOUNT value on done: 33609.0 [2024-08-05 23:29:41,667][52811] Sum rewards: 38.126, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'AMMO4': '0.183', 'WEAPON4': '0.300', 'weapon4': '0.356', 'WEAPON3': '0.850', 'ARMOR': '0.903', 'weapon2': '1.118', 'weapon3': '1.802', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:42,048][52650] Updated weights for policy 0, policy_version 15361 (0.0014) [2024-08-05 23:29:42,111][52671] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:29:42,652][52803] DAMAGECOUNT value on done: 35209.0 [2024-08-05 23:29:42,652][52803] Sum rewards: 26.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.396', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.097', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.286', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon2': '0.906', 'WEAPON3': '1.400', 'HITCOUNT': '2.240', 'weapon3': '2.486', 'DAMAGECOUNT': '8.508', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:42,742][52665] DAMAGECOUNT value on done: 35586.0 [2024-08-05 23:29:42,742][52665] Sum rewards: 33.823, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.489', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.040', 'AMMO3': '0.119', 'AMMO4': '0.129', 'weapon5': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.558', 'weapon2': '0.678', 'WEAPON3': '0.800', 'HITCOUNT': '2.230', 'weapon3': '2.260', 'DAMAGECOUNT': '9.477', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 125853696. Throughput: 0: 4378.7. Samples: 31470210. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:29:42,794][52567] Avg episode reward: [(0, '29.064')] [2024-08-05 23:29:42,986][52647] DAMAGECOUNT value on done: 38595.0 [2024-08-05 23:29:42,986][52647] Sum rewards: 26.669, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.042', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'HEALTH': '0.158', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.516', 'weapon4': '0.714', 'WEAPON3': '0.800', 'HITCOUNT': '1.720', 'weapon3': '2.230', 'DAMAGECOUNT': '6.651', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:43,067][52795] DAMAGECOUNT value on done: 34888.0 [2024-08-05 23:29:43,068][52795] Sum rewards: 34.899, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.061', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.140', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'weapon4': '0.454', 'weapon2': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.286', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.456', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:43,108][52667] DAMAGECOUNT value on done: 37643.0 [2024-08-05 23:29:43,108][52667] Sum rewards: 30.567, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.094', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.186', 'WEAPON5': '0.300', 'HEALTH': '0.304', 'WEAPON3': '0.800', 'weapon2': '1.184', 'ARMOR': '1.348', 'HITCOUNT': '2.050', 'weapon3': '2.332', 'DAMAGECOUNT': '7.827', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:43,219][52666] DAMAGECOUNT value on done: 35207.0 [2024-08-05 23:29:43,220][52666] Sum rewards: 26.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.156', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.156', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'weapon4': '0.474', 'weapon2': '0.994', 'WEAPON3': '1.100', 'HITCOUNT': '1.680', 'weapon3': '2.122', 'DAMAGECOUNT': '6.927', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:43,433][52670] DAMAGECOUNT value on done: 35573.0 [2024-08-05 23:29:43,433][52670] Sum rewards: 24.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.964', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.056', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'ARMOR': '0.855', 'WEAPON3': '0.950', 'weapon2': '1.280', 'HITCOUNT': '1.990', 'weapon3': '2.316', 'DAMAGECOUNT': '7.884', 'FRAGCOUNT': '21.000'} [2024-08-05 23:29:44,054][52663] DAMAGECOUNT value on done: 35046.0 [2024-08-05 23:29:44,054][52663] Sum rewards: 28.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.017', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.030', 'weapon4': '0.114', 'AMMO4': '0.131', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.836', 'WEAPON3': '1.050', 'ARMOR': '1.301', 'HITCOUNT': '1.740', 'weapon3': '2.724', 'DAMAGECOUNT': '7.245', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:44,162][52658] DAMAGECOUNT value on done: 38397.0 [2024-08-05 23:29:44,163][52658] Sum rewards: 26.195, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.220', 'ARMOR': '0.440', 'WEAPON4': '0.550', 'weapon4': '0.630', 'WEAPON3': '0.800', 'weapon2': '1.386', 'weapon3': '1.784', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.280', 'FRAGCOUNT': '21.500'} [2024-08-05 23:29:44,849][52811] DAMAGECOUNT value on done: 34677.0 [2024-08-05 23:29:44,852][52811] Sum rewards: 30.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.898', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.336', 'ARMOR': '0.467', 'weapon2': '0.854', 'WEAPON3': '1.050', 'HITCOUNT': '2.180', 'weapon3': '2.540', 'DAMAGECOUNT': '8.580', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:45,615][52647] DAMAGECOUNT value on done: 41625.0 [2024-08-05 23:29:45,616][52647] Sum rewards: 26.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.678', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.108', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon4': '0.624', 'WEAPON3': '0.950', 'ARMOR': '0.990', 'weapon2': '1.116', 'weapon3': '1.828', 'HITCOUNT': '1.830', 'DAMAGECOUNT': '7.794', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:45,751][52803] DAMAGECOUNT value on done: 33007.0 [2024-08-05 23:29:45,753][52803] Sum rewards: 29.017, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.034', 'ARMOR': '0.048', 'weapon5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.564', 'weapon4': '0.736', 'WEAPON3': '0.900', 'HITCOUNT': '1.890', 'weapon3': '2.250', 'DAMAGECOUNT': '7.764', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:45,760][52665] DAMAGECOUNT value on done: 35258.0 [2024-08-05 23:29:45,761][52665] Sum rewards: 26.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.313', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.334', 'ARMOR': '0.458', 'weapon2': '0.896', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.508', 'DAMAGECOUNT': '7.782', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:45,820][52667] DAMAGECOUNT value on done: 37237.0 [2024-08-05 23:29:45,822][52667] Sum rewards: 23.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.044', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.068', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '1.048', 'WEAPON3': '1.100', 'HITCOUNT': '1.780', 'weapon3': '2.652', 'DAMAGECOUNT': '6.900', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:46,273][52795] DAMAGECOUNT value on done: 36856.0 [2024-08-05 23:29:46,273][52795] Sum rewards: 26.406, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.149', 'WEAPON4': '0.450', 'weapon4': '0.498', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.258', 'HITCOUNT': '1.940', 'weapon3': '2.028', 'DAMAGECOUNT': '7.950', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:46,574][52666] DAMAGECOUNT value on done: 33902.0 [2024-08-05 23:29:46,574][52666] Sum rewards: 32.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.424', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.116', 'AMMO3': '0.156', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'weapon4': '0.386', 'WEAPON4': '0.450', 'weapon2': '0.622', 'ARMOR': '0.804', 'WEAPON3': '1.100', 'HITCOUNT': '2.060', 'weapon3': '2.548', 'DAMAGECOUNT': '9.021', 'FRAGCOUNT': '28.000'} [2024-08-05 23:29:46,674][52670] DAMAGECOUNT value on done: 38007.0 [2024-08-05 23:29:46,674][52670] Sum rewards: 29.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.364', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon4': '0.224', 'ARMOR': '0.452', 'weapon2': '0.698', 'WEAPON3': '1.300', 'HITCOUNT': '2.060', 'weapon3': '2.812', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:46,851][52650] Updated weights for policy 0, policy_version 15371 (0.0021) [2024-08-05 23:29:47,067][52658] DAMAGECOUNT value on done: 37746.0 [2024-08-05 23:29:47,068][52658] Sum rewards: 27.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.540', 'weapon4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'ARMOR': '0.458', 'weapon2': '1.110', 'WEAPON3': '1.350', 'HITCOUNT': '1.780', 'weapon3': '2.572', 'DAMAGECOUNT': '8.118', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:47,117][52663] DAMAGECOUNT value on done: 36758.0 [2024-08-05 23:29:47,118][52663] Sum rewards: 21.239, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.328', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO4': '0.205', 'AMMO3': '0.277', 'WEAPON4': '0.450', 'ARMOR': '0.460', 'weapon2': '0.706', 'WEAPON3': '1.750', 'HITCOUNT': '2.210', 'weapon3': '2.798', 'DAMAGECOUNT': '8.565', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 125935616. Throughput: 0: 4388.3. Samples: 31483460. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:29:47,794][52567] Avg episode reward: [(0, '28.785')] [2024-08-05 23:29:47,856][52811] DAMAGECOUNT value on done: 37369.0 [2024-08-05 23:29:47,857][52811] Sum rewards: 35.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.739', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.053', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.263', 'ARMOR': '0.479', 'weapon4': '0.600', 'WEAPON4': '0.700', 'weapon2': '0.898', 'WEAPON3': '1.250', 'weapon3': '2.112', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.422', 'FRAGCOUNT': '32.000'} [2024-08-05 23:29:48,337][52647] DAMAGECOUNT value on done: 38303.0 [2024-08-05 23:29:48,337][52647] Sum rewards: 31.731, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'weapon5': '0.012', 'HEALTH': '0.022', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'ARMOR': '0.412', 'weapon4': '0.424', 'WEAPON3': '0.800', 'weapon2': '1.130', 'HITCOUNT': '2.160', 'weapon3': '2.216', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:48,832][52667] DAMAGECOUNT value on done: 38460.0 [2024-08-05 23:29:48,832][52667] Sum rewards: 20.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.151', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.171', 'weapon4': '0.286', 'ARMOR': '0.453', 'WEAPON3': '1.050', 'weapon2': '1.276', 'HITCOUNT': '1.970', 'weapon3': '2.226', 'DAMAGECOUNT': '7.038', 'FRAGCOUNT': '17.000'} [2024-08-05 23:29:48,940][52665] DAMAGECOUNT value on done: 34462.0 [2024-08-05 23:29:48,943][52665] Sum rewards: 24.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.139', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.300', 'ARMOR': '1.384', 'HITCOUNT': '1.900', 'weapon3': '1.952', 'DAMAGECOUNT': '7.515', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:49,107][52666] DAMAGECOUNT value on done: 33717.0 [2024-08-05 23:29:49,107][52666] Sum rewards: 30.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.563', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.125', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON3': '0.800', 'ARMOR': '0.911', 'weapon2': '1.180', 'weapon3': '2.240', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.652', 'FRAGCOUNT': '26.000'} [2024-08-05 23:29:49,201][52670] DAMAGECOUNT value on done: 36909.0 [2024-08-05 23:29:49,201][52670] Sum rewards: 26.684, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.378', 'AMMO5': '0.005', 'weapon5': '0.054', 'AMMO2': '0.061', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.304', 'WEAPON4': '0.650', 'weapon4': '0.670', 'WEAPON3': '0.750', 'weapon2': '0.864', 'weapon3': '1.990', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '8.547', 'FRAGCOUNT': '21.000'} [2024-08-05 23:29:49,403][52795] DAMAGECOUNT value on done: 35865.0 [2024-08-05 23:29:49,406][52795] Sum rewards: 38.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.616', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.262', 'ARMOR': '0.906', 'weapon2': '0.974', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.566', 'FRAGCOUNT': '33.000'} [2024-08-05 23:29:50,145][52663] DAMAGECOUNT value on done: 39424.0 [2024-08-05 23:29:50,147][52663] Sum rewards: 28.117, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.264', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.122', 'AMMO4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'weapon4': '0.464', 'WEAPON3': '0.800', 'weapon2': '0.826', 'HITCOUNT': '2.130', 'weapon3': '2.162', 'DAMAGECOUNT': '8.091', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:50,301][52658] DAMAGECOUNT value on done: 37477.0 [2024-08-05 23:29:50,301][52658] Sum rewards: 27.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.907', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon4': '0.588', 'weapon2': '0.628', 'ARMOR': '0.941', 'WEAPON3': '1.200', 'HITCOUNT': '2.150', 'weapon3': '2.360', 'DAMAGECOUNT': '7.962', 'FRAGCOUNT': '27.000'} [2024-08-05 23:29:50,888][52647] DAMAGECOUNT value on done: 39717.0 [2024-08-05 23:29:50,889][52647] Sum rewards: 33.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.757', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'weapon4': '0.500', 'weapon2': '0.896', 'WEAPON3': '0.950', 'weapon3': '2.296', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '27.500'} [2024-08-05 23:29:50,931][52811] DAMAGECOUNT value on done: 31946.0 [2024-08-05 23:29:50,931][52811] Sum rewards: 24.384, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.822', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.117', 'weapon4': '0.198', 'WEAPON3': '0.800', 'ARMOR': '0.873', 'weapon2': '1.296', 'HITCOUNT': '1.570', 'weapon3': '1.952', 'DAMAGECOUNT': '6.627', 'FRAGCOUNT': '19.000'} [2024-08-05 23:29:51,197][52650] Updated weights for policy 0, policy_version 15381 (0.0038) [2024-08-05 23:29:51,853][52666] DAMAGECOUNT value on done: 34743.0 [2024-08-05 23:29:51,861][52666] Sum rewards: 29.131, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.397', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.167', 'weapon4': '0.168', 'WEAPON4': '0.350', 'ARMOR': '0.435', 'WEAPON3': '1.000', 'weapon2': '1.202', 'HITCOUNT': '2.170', 'weapon3': '2.268', 'DAMAGECOUNT': '8.352', 'FRAGCOUNT': '23.000'} [2024-08-05 23:29:52,017][52670] DAMAGECOUNT value on done: 37211.0 [2024-08-05 23:29:52,017][52670] Sum rewards: 30.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.172', 'weapon5': '0.006', 'weapon4': '0.006', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'ARMOR': '0.902', 'weapon2': '1.042', 'WEAPON3': '1.550', 'HITCOUNT': '2.050', 'weapon3': '2.650', 'DAMAGECOUNT': '8.292', 'FRAGCOUNT': '30.000'} [2024-08-05 23:29:52,143][52665] DAMAGECOUNT value on done: 34851.0 [2024-08-05 23:29:52,143][52665] Sum rewards: 34.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.040', 'weapon5': '0.056', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon4': '0.290', 'weapon2': '0.576', 'WEAPON3': '1.550', 'HITCOUNT': '2.450', 'weapon3': '2.710', 'DAMAGECOUNT': '9.843', 'FRAGCOUNT': '33.000'} [2024-08-05 23:29:52,480][52795] DAMAGECOUNT value on done: 37463.0 [2024-08-05 23:29:52,480][52795] Sum rewards: 30.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.672', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO2': '0.041', 'weapon5': '0.068', 'AMMO4': '0.203', 'AMMO3': '0.212', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.840', 'WEAPON3': '1.250', 'HITCOUNT': '1.990', 'weapon3': '2.544', 'DAMAGECOUNT': '8.487', 'FRAGCOUNT': '29.000'} [2024-08-05 23:29:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 126025728. Throughput: 0: 4389.8. Samples: 31509860. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:29:52,795][52567] Avg episode reward: [(0, '29.083')] [2024-08-05 23:29:52,845][52658] DAMAGECOUNT value on done: 34442.0 [2024-08-05 23:29:52,845][52658] Sum rewards: 15.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.085', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.124', 'AMMO4': '0.182', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'weapon4': '0.444', 'WEAPON4': '0.500', 'weapon2': '0.928', 'ARMOR': '0.952', 'WEAPON3': '1.200', 'HITCOUNT': '1.410', 'weapon3': '2.144', 'DAMAGECOUNT': '6.351', 'FRAGCOUNT': '17.000'} [2024-08-05 23:29:53,027][52663] DAMAGECOUNT value on done: 36548.0 [2024-08-05 23:29:53,029][52663] Sum rewards: 25.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.762', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.164', 'weapon5': '0.188', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.654', 'weapon2': '0.694', 'WEAPON3': '0.950', 'ARMOR': '1.333', 'weapon3': '2.006', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '25.000'} [2024-08-05 23:29:53,733][52647] DAMAGECOUNT value on done: 38598.0 [2024-08-05 23:29:53,733][52647] Sum rewards: 30.959, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.456', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.062', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'ARMOR': '0.892', 'weapon2': '0.932', 'HITCOUNT': '2.080', 'weapon3': '2.162', 'DAMAGECOUNT': '7.950', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:53,774][52671] DAMAGECOUNT value on done: 39702.0 [2024-08-05 23:29:53,774][52671] Sum rewards: 31.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.266', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.178', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.498', 'ARMOR': '0.508', 'weapon2': '0.760', 'WEAPON3': '1.000', 'HITCOUNT': '2.170', 'weapon3': '2.230', 'DAMAGECOUNT': '8.676', 'FRAGCOUNT': '25.500'} [2024-08-05 23:29:53,872][52811] DAMAGECOUNT value on done: 32913.0 [2024-08-05 23:29:53,873][52811] Sum rewards: 21.679, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.146', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'ARMOR': '0.499', 'weapon2': '0.632', 'WEAPON3': '1.550', 'HITCOUNT': '1.900', 'weapon3': '2.864', 'DAMAGECOUNT': '7.173', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:54,841][52666] DAMAGECOUNT value on done: 35194.0 [2024-08-05 23:29:54,842][52666] Sum rewards: 38.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.762', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.187', 'ARMOR': '0.404', 'weapon2': '1.080', 'WEAPON3': '1.300', 'weapon3': '2.588', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.965', 'FRAGCOUNT': '33.000'} [2024-08-05 23:29:55,016][52670] DAMAGECOUNT value on done: 36463.0 [2024-08-05 23:29:55,017][52670] Sum rewards: 32.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.222', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'weapon4': '0.180', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.636', 'WEAPON3': '1.450', 'HITCOUNT': '2.440', 'weapon3': '2.934', 'DAMAGECOUNT': '9.294', 'FRAGCOUNT': '31.000'} [2024-08-05 23:29:55,584][52795] DAMAGECOUNT value on done: 33920.0 [2024-08-05 23:29:55,584][52795] Sum rewards: 28.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO4': '0.153', 'weapon4': '0.176', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.947', 'weapon2': '1.164', 'WEAPON3': '1.200', 'HITCOUNT': '1.930', 'weapon3': '2.258', 'DAMAGECOUNT': '7.371', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:55,683][52658] DAMAGECOUNT value on done: 37077.0 [2024-08-05 23:29:55,683][52658] Sum rewards: 21.588, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.518', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.153', 'ARMOR': '0.850', 'WEAPON3': '0.950', 'weapon2': '1.210', 'HITCOUNT': '1.840', 'weapon3': '2.268', 'DAMAGECOUNT': '7.107', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:55,968][52663] DAMAGECOUNT value on done: 36245.0 [2024-08-05 23:29:55,968][52663] Sum rewards: 24.169, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.647', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.038', 'AMMO4': '0.122', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.446', 'WEAPON3': '1.150', 'weapon2': '1.202', 'HITCOUNT': '2.050', 'weapon3': '2.412', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '20.000'} [2024-08-05 23:29:56,204][52650] Updated weights for policy 0, policy_version 15391 (0.0011) [2024-08-05 23:29:56,622][52671] DAMAGECOUNT value on done: 36472.0 [2024-08-05 23:29:56,624][52671] Sum rewards: 42.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.032', 'ARMOR': '0.076', 'AMMO4': '0.141', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.450', 'weapon2': '0.690', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.760', 'DAMAGECOUNT': '11.085', 'FRAGCOUNT': '36.000'} [2024-08-05 23:29:56,635][52647] DAMAGECOUNT value on done: 37265.0 [2024-08-05 23:29:56,635][52647] Sum rewards: 23.459, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.601', 'AMMO2': '0.028', 'weapon7': '0.052', 'AMMO3': '0.085', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.506', 'WEAPON3': '0.600', 'ARMOR': '0.954', 'weapon2': '1.324', 'weapon3': '1.538', 'HITCOUNT': '1.680', 'DAMAGECOUNT': '6.216', 'FRAGCOUNT': '17.000'} [2024-08-05 23:29:57,467][52666] DAMAGECOUNT value on done: 34900.0 [2024-08-05 23:29:57,468][52666] Sum rewards: 25.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.332', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'ARMOR': '0.857', 'weapon2': '0.862', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.886', 'DAMAGECOUNT': '8.505', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:57,672][52670] DAMAGECOUNT value on done: 33944.0 [2024-08-05 23:29:57,674][52670] Sum rewards: 17.134, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.545', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.076', 'AMMO4': '0.104', 'weapon4': '0.244', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.500', 'HITCOUNT': '1.360', 'weapon3': '1.446', 'weapon2': '1.464', 'DAMAGECOUNT': '4.755', 'FRAGCOUNT': '13.000'} [2024-08-05 23:29:57,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 126115840. Throughput: 0: 4393.8. Samples: 31536290. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:29:57,795][52567] Avg episode reward: [(0, '28.587')] [2024-08-05 23:29:58,537][52658] DAMAGECOUNT value on done: 37118.0 [2024-08-05 23:29:58,541][52658] Sum rewards: 25.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.485', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.036', 'AMMO3': '0.156', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.302', 'ARMOR': '0.400', 'weapon2': '0.890', 'WEAPON3': '0.950', 'HITCOUNT': '1.800', 'weapon3': '2.512', 'DAMAGECOUNT': '7.056', 'FRAGCOUNT': '22.000'} [2024-08-05 23:29:58,721][52795] DAMAGECOUNT value on done: 32381.0 [2024-08-05 23:29:58,723][52795] Sum rewards: 25.336, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.164', 'AMMO5': '0.007', 'weapon5': '0.030', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.568', 'ARMOR': '0.816', 'weapon2': '0.882', 'WEAPON3': '0.900', 'HITCOUNT': '1.900', 'weapon3': '2.256', 'DAMAGECOUNT': '6.834', 'FRAGCOUNT': '21.000'} [2024-08-05 23:29:58,955][52663] DAMAGECOUNT value on done: 34308.0 [2024-08-05 23:29:58,955][52663] Sum rewards: 17.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.359', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.114', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.314', 'ARMOR': '0.863', 'WEAPON3': '1.050', 'weapon2': '1.106', 'HITCOUNT': '1.510', 'weapon3': '1.892', 'DAMAGECOUNT': '5.607', 'FRAGCOUNT': '17.000'} [2024-08-05 23:29:59,098][52671] DAMAGECOUNT value on done: 36567.0 [2024-08-05 23:29:59,098][52671] Sum rewards: 30.832, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.224', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.056', 'AMMO3': '0.097', 'WEAPON5': '0.200', 'AMMO4': '0.232', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON3': '0.550', 'weapon2': '1.152', 'HITCOUNT': '1.880', 'weapon3': '1.972', 'DAMAGECOUNT': '7.113', 'FRAGCOUNT': '24.000'} [2024-08-05 23:29:59,662][52647] DAMAGECOUNT value on done: 40375.0 [2024-08-05 23:29:59,662][52647] Sum rewards: 32.973, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.984', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.296', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'WEAPON3': '1.100', 'weapon2': '1.364', 'weapon3': '1.930', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '7.956', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:00,442][52666] DAMAGECOUNT value on done: 36061.0 [2024-08-05 23:30:00,444][52666] Sum rewards: 21.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.200', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO3': '0.162', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.300', 'ARMOR': '0.816', 'WEAPON3': '0.950', 'weapon2': '1.256', 'HITCOUNT': '1.620', 'weapon3': '2.090', 'DAMAGECOUNT': '6.897', 'FRAGCOUNT': '17.500'} [2024-08-05 23:30:00,579][52650] Updated weights for policy 0, policy_version 15401 (0.0017) [2024-08-05 23:30:00,639][52670] DAMAGECOUNT value on done: 34971.0 [2024-08-05 23:30:00,640][52670] Sum rewards: 37.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.026', 'AMMO2': '0.028', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.706', 'WEAPON3': '1.100', 'HITCOUNT': '2.290', 'weapon3': '2.622', 'DAMAGECOUNT': '9.765', 'FRAGCOUNT': '33.000'} [2024-08-05 23:30:01,468][52658] DAMAGECOUNT value on done: 36158.0 [2024-08-05 23:30:01,469][52658] Sum rewards: 34.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.488', 'AMMO5': '0.007', 'AMMO2': '0.054', 'ARMOR': '0.084', 'weapon5': '0.178', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.268', 'weapon4': '0.368', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.090', 'weapon3': '2.500', 'DAMAGECOUNT': '8.910', 'FRAGCOUNT': '31.000'} [2024-08-05 23:30:01,562][52663] DAMAGECOUNT value on done: 36741.0 [2024-08-05 23:30:01,563][52663] Sum rewards: 26.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.038', 'weapon4': '0.110', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.878', 'ARMOR': '0.948', 'WEAPON3': '1.350', 'HITCOUNT': '1.850', 'weapon3': '2.428', 'DAMAGECOUNT': '8.127', 'FRAGCOUNT': '25.500'} [2024-08-05 23:30:01,684][52671] DAMAGECOUNT value on done: 35516.0 [2024-08-05 23:30:01,685][52671] Sum rewards: 23.376, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.092', 'HEALTH': '0.128', 'AMMO3': '0.159', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.846', 'WEAPON3': '0.950', 'HITCOUNT': '1.900', 'weapon3': '2.326', 'DAMAGECOUNT': '7.056', 'FRAGCOUNT': '18.500'} [2024-08-05 23:30:01,803][52795] DAMAGECOUNT value on done: 34994.0 [2024-08-05 23:30:01,803][52795] Sum rewards: 36.018, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.024', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.124', 'HEALTH': '0.193', 'ARMOR': '0.476', 'WEAPON3': '0.750', 'weapon2': '0.932', 'HITCOUNT': '2.230', 'weapon3': '2.726', 'DAMAGECOUNT': '8.460', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:02,649][52647] DAMAGECOUNT value on done: 40073.0 [2024-08-05 23:30:02,649][52647] Sum rewards: 32.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.373', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'AMMO4': '0.176', 'weapon4': '0.394', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'ARMOR': '1.352', 'weapon2': '1.394', 'weapon3': '2.022', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.853', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.5, 300 sec: 17494.8). Total num frames: 126205952. Throughput: 0: 4398.7. Samples: 31549780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:30:02,795][52567] Avg episode reward: [(0, '28.799')] [2024-08-05 23:30:03,848][52666] DAMAGECOUNT value on done: 35583.0 [2024-08-05 23:30:03,848][52666] Sum rewards: 40.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.477', 'weapon2': '0.878', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.530', 'DAMAGECOUNT': '9.522', 'FRAGCOUNT': '37.000'} [2024-08-05 23:30:03,979][52663] DAMAGECOUNT value on done: 35926.0 [2024-08-05 23:30:03,980][52663] Sum rewards: 33.863, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.174', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.132', 'AMMO3': '0.138', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.981', 'WEAPON3': '1.000', 'weapon2': '1.112', 'HITCOUNT': '1.930', 'weapon3': '2.402', 'DAMAGECOUNT': '8.157', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:03,983][52670] DAMAGECOUNT value on done: 35129.0 [2024-08-05 23:30:03,985][52670] Sum rewards: 23.952, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.497', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon4': '0.532', 'weapon2': '0.748', 'WEAPON3': '1.250', 'HITCOUNT': '1.570', 'weapon3': '2.262', 'DAMAGECOUNT': '6.939', 'FRAGCOUNT': '22.000'} [2024-08-05 23:30:04,365][52658] DAMAGECOUNT value on done: 38173.0 [2024-08-05 23:30:04,366][52658] Sum rewards: 23.962, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.922', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.054', 'ARMOR': '0.060', 'AMMO3': '0.116', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.650', 'weapon2': '0.716', 'weapon4': '0.758', 'WEAPON3': '0.850', 'weapon3': '1.896', 'HITCOUNT': '2.040', 'DAMAGECOUNT': '6.618', 'FRAGCOUNT': '20.000'} [2024-08-05 23:30:04,404][52671] DAMAGECOUNT value on done: 34967.0 [2024-08-05 23:30:04,404][52671] Sum rewards: 28.796, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.557', 'AMMO5': '0.011', 'weapon5': '0.038', 'AMMO2': '0.045', 'ARMOR': '0.096', 'AMMO3': '0.163', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON4': '0.500', 'weapon2': '0.628', 'WEAPON3': '1.100', 'HITCOUNT': '1.760', 'weapon3': '2.618', 'DAMAGECOUNT': '7.770', 'FRAGCOUNT': '26.000'} [2024-08-05 23:30:04,630][52811] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:30:04,840][52795] DAMAGECOUNT value on done: 34362.0 [2024-08-05 23:30:04,840][52795] Sum rewards: 16.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.001', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'AMMO4': '0.198', 'weapon4': '0.222', 'ARMOR': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.308', 'HITCOUNT': '1.580', 'weapon3': '2.022', 'DAMAGECOUNT': '6.384', 'FRAGCOUNT': '18.000'} [2024-08-05 23:30:05,362][52659] DAMAGECOUNT value on done: 36019.0 [2024-08-05 23:30:05,363][52659] Sum rewards: 25.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.618', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.014', 'ARMOR': '0.028', 'AMMO4': '0.068', 'weapon4': '0.164', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.886', 'WEAPON3': '1.300', 'HITCOUNT': '2.140', 'weapon3': '2.688', 'DAMAGECOUNT': '8.451', 'FRAGCOUNT': '22.000'} [2024-08-05 23:30:05,378][52650] Updated weights for policy 0, policy_version 15411 (0.0039) [2024-08-05 23:30:05,428][52647] DAMAGECOUNT value on done: 38155.0 [2024-08-05 23:30:05,429][52647] Sum rewards: 33.844, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO2': '0.003', 'AMMO4': '0.012', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'WEAPON3': '0.850', 'ARMOR': '0.915', 'weapon2': '1.526', 'HITCOUNT': '2.070', 'weapon3': '2.196', 'DAMAGECOUNT': '7.965', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:06,780][52663] DAMAGECOUNT value on done: 37250.0 [2024-08-05 23:30:06,783][52663] Sum rewards: 34.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.252', 'ARMOR': '0.400', 'weapon2': '0.862', 'WEAPON3': '1.050', 'HITCOUNT': '2.210', 'weapon3': '2.508', 'DAMAGECOUNT': '9.288', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:07,048][52670] DAMAGECOUNT value on done: 34936.0 [2024-08-05 23:30:07,049][52670] Sum rewards: 33.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.248', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.098', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'ARMOR': '0.420', 'WEAPON4': '0.450', 'weapon4': '0.684', 'weapon2': '0.934', 'WEAPON3': '1.000', 'HITCOUNT': '1.980', 'weapon3': '2.032', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:07,079][52671] DAMAGECOUNT value on done: 39695.0 [2024-08-05 23:30:07,080][52671] Sum rewards: 36.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.074', 'AMMO3': '0.168', 'weapon4': '0.168', 'AMMO4': '0.172', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.800', 'weapon2': '0.936', 'WEAPON3': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.538', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '32.000'} [2024-08-05 23:30:07,535][52658] DAMAGECOUNT value on done: 39971.0 [2024-08-05 23:30:07,537][52658] Sum rewards: 30.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.146', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.414', 'ARMOR': '0.492', 'weapon2': '1.130', 'WEAPON3': '1.200', 'HITCOUNT': '2.050', 'weapon3': '2.188', 'DAMAGECOUNT': '9.099', 'FRAGCOUNT': '26.000'} [2024-08-05 23:30:07,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 126287872. Throughput: 0: 4397.3. Samples: 31576020. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:30:07,794][52567] Avg episode reward: [(0, '29.111')] [2024-08-05 23:30:07,997][52647] DAMAGECOUNT value on done: 38162.0 [2024-08-05 23:30:07,997][52647] Sum rewards: 23.428, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.639', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.125', 'AMMO4': '0.135', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'weapon4': '0.672', 'WEAPON3': '0.800', 'weapon2': '0.854', 'HITCOUNT': '1.460', 'weapon3': '1.868', 'DAMAGECOUNT': '5.334', 'FRAGCOUNT': '19.000'} [2024-08-05 23:30:08,011][52795] DAMAGECOUNT value on done: 32286.0 [2024-08-05 23:30:08,012][52795] Sum rewards: 18.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.138', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.780', 'ARMOR': '0.866', 'WEAPON3': '1.200', 'HITCOUNT': '1.650', 'weapon3': '2.826', 'DAMAGECOUNT': '6.966', 'FRAGCOUNT': '19.000'} [2024-08-05 23:30:08,021][52659] DAMAGECOUNT value on done: 39260.0 [2024-08-05 23:30:08,022][52659] Sum rewards: 37.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.156', 'AMMO3': '0.205', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.466', 'weapon2': '0.796', 'WEAPON3': '1.300', 'weapon3': '2.486', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.551', 'FRAGCOUNT': '35.000'} [2024-08-05 23:30:09,490][52663] DAMAGECOUNT value on done: 37865.0 [2024-08-05 23:30:09,491][52663] Sum rewards: 36.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.755', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.324', 'ARMOR': '0.851', 'weapon2': '0.852', 'WEAPON3': '1.100', 'HITCOUNT': '2.110', 'weapon3': '2.668', 'DAMAGECOUNT': '9.018', 'FRAGCOUNT': '31.000'} [2024-08-05 23:30:09,812][52650] Updated weights for policy 0, policy_version 15421 (0.0017) [2024-08-05 23:30:09,825][52671] DAMAGECOUNT value on done: 37080.0 [2024-08-05 23:30:09,825][52671] Sum rewards: 34.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.484', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.052', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'ARMOR': '0.805', 'weapon2': '0.908', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '2.782', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '31.000'} [2024-08-05 23:30:10,026][52670] DAMAGECOUNT value on done: 35175.0 [2024-08-05 23:30:10,028][52670] Sum rewards: 32.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.461', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.668', 'ARMOR': '0.951', 'WEAPON3': '1.300', 'HITCOUNT': '2.340', 'weapon3': '2.832', 'DAMAGECOUNT': '8.985', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:10,512][52658] DAMAGECOUNT value on done: 36769.0 [2024-08-05 23:30:10,512][52658] Sum rewards: 29.045, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.109', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.217', 'weapon4': '0.238', 'WEAPON4': '0.400', 'ARMOR': '0.855', 'weapon2': '1.098', 'WEAPON3': '1.350', 'weapon3': '2.404', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.216', 'FRAGCOUNT': '30.000'} [2024-08-05 23:30:10,544][52647] DAMAGECOUNT value on done: 36007.0 [2024-08-05 23:30:10,544][52647] Sum rewards: 32.678, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.166', 'ARMOR': '0.450', 'WEAPON3': '1.050', 'weapon2': '1.308', 'HITCOUNT': '1.860', 'weapon3': '2.238', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:10,980][52795] DAMAGECOUNT value on done: 36010.0 [2024-08-05 23:30:10,983][52795] Sum rewards: 20.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.728', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.110', 'AMMO3': '0.203', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.406', 'ARMOR': '0.544', 'WEAPON4': '0.550', 'weapon2': '0.878', 'WEAPON3': '1.350', 'HITCOUNT': '1.980', 'weapon3': '2.262', 'DAMAGECOUNT': '6.795', 'FRAGCOUNT': '23.500'} [2024-08-05 23:30:11,027][52659] DAMAGECOUNT value on done: 36536.0 [2024-08-05 23:30:11,029][52659] Sum rewards: 21.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.353', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.187', 'weapon4': '0.214', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'weapon2': '1.004', 'WEAPON3': '1.400', 'HITCOUNT': '2.080', 'weapon3': '2.288', 'DAMAGECOUNT': '8.151', 'FRAGCOUNT': '20.000'} [2024-08-05 23:30:11,176][52614] Signal inference workers to stop experience collection... (2900 times) [2024-08-05 23:30:11,176][52614] Signal inference workers to resume experience collection... (2900 times) [2024-08-05 23:30:11,258][52650] InferenceWorker_p0-w0: stopping experience collection (2900 times) [2024-08-05 23:30:11,258][52650] InferenceWorker_p0-w0: resuming experience collection (2900 times) [2024-08-05 23:30:12,022][52663] DAMAGECOUNT value on done: 36962.0 [2024-08-05 23:30:12,024][52663] Sum rewards: 37.684, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.259', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO3': '0.161', 'weapon2': '0.902', 'ARMOR': '0.934', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '2.748', 'DAMAGECOUNT': '9.096', 'FRAGCOUNT': '32.000'} [2024-08-05 23:30:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 126377984. Throughput: 0: 4398.6. Samples: 31602570. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:30:12,795][52567] Avg episode reward: [(0, '29.004')] [2024-08-05 23:30:12,904][52671] DAMAGECOUNT value on done: 39938.0 [2024-08-05 23:30:12,904][52671] Sum rewards: 40.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.148', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.044', 'AMMO4': '0.108', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.300', 'ARMOR': '0.516', 'weapon2': '0.782', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.630', 'DAMAGECOUNT': '10.320', 'FRAGCOUNT': '34.000'} [2024-08-05 23:30:13,277][52647] DAMAGECOUNT value on done: 39053.0 [2024-08-05 23:30:13,278][52647] Sum rewards: 37.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.933', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.250', 'ARMOR': '0.462', 'weapon2': '0.896', 'WEAPON3': '1.150', 'HITCOUNT': '2.450', 'weapon3': '2.636', 'DAMAGECOUNT': '10.305', 'FRAGCOUNT': '32.000'} [2024-08-05 23:30:13,548][52658] DAMAGECOUNT value on done: 35825.0 [2024-08-05 23:30:13,553][52658] Sum rewards: 29.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.132', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.070', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'ARMOR': '0.400', 'weapon2': '0.856', 'WEAPON3': '1.200', 'HITCOUNT': '1.920', 'weapon3': '2.774', 'DAMAGECOUNT': '7.563', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:14,030][52795] DAMAGECOUNT value on done: 35686.0 [2024-08-05 23:30:14,030][52795] Sum rewards: 35.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.868', 'AMMO2': '0.006', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO4': '0.029', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.294', 'ARMOR': '0.449', 'WEAPON3': '0.950', 'weapon2': '0.988', 'HITCOUNT': '2.010', 'weapon3': '2.482', 'DAMAGECOUNT': '8.220', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:14,177][52659] DAMAGECOUNT value on done: 37040.0 [2024-08-05 23:30:14,179][52659] Sum rewards: 19.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon4': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'ARMOR': '0.900', 'WEAPON3': '1.300', 'weapon2': '1.540', 'HITCOUNT': '1.590', 'weapon3': '2.170', 'DAMAGECOUNT': '5.832', 'FRAGCOUNT': '19.000'} [2024-08-05 23:30:14,440][52663] DAMAGECOUNT value on done: 36703.0 [2024-08-05 23:30:14,442][52663] Sum rewards: 39.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.514', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.174', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'weapon2': '0.934', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.582', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '35.000'} [2024-08-05 23:30:14,516][52650] Updated weights for policy 0, policy_version 15431 (0.0012) [2024-08-05 23:30:15,778][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:30:15,811][52647] DAMAGECOUNT value on done: 37562.0 [2024-08-05 23:30:15,812][52647] Sum rewards: 24.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.402', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.138', 'AMMO3': '0.141', 'weapon4': '0.166', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon2': '1.198', 'HITCOUNT': '1.920', 'weapon3': '2.128', 'DAMAGECOUNT': '7.242', 'FRAGCOUNT': '21.000'} [2024-08-05 23:30:16,074][52671] DAMAGECOUNT value on done: 37233.0 [2024-08-05 23:30:16,076][52671] Sum rewards: 23.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.273', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.082', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.230', 'WEAPON4': '0.450', 'ARMOR': '0.904', 'WEAPON3': '1.100', 'weapon2': '1.172', 'HITCOUNT': '1.670', 'weapon3': '2.386', 'DAMAGECOUNT': '6.696', 'FRAGCOUNT': '22.000'} [2024-08-05 23:30:16,436][52649] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:30:16,569][52658] DAMAGECOUNT value on done: 39264.0 [2024-08-05 23:30:16,569][52658] Sum rewards: 31.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO2': '0.052', 'AMMO3': '0.246', 'AMMO4': '0.257', 'ARMOR': '0.508', 'weapon4': '0.542', 'WEAPON4': '0.550', 'weapon2': '0.766', 'WEAPON3': '1.600', 'weapon3': '2.370', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '30.000'} [2024-08-05 23:30:16,909][52659] DAMAGECOUNT value on done: 36155.0 [2024-08-05 23:30:16,909][52659] Sum rewards: 29.223, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.185', 'weapon7': '0.016', 'AMMO5': '0.016', 'AMMO2': '0.052', 'ARMOR': '0.060', 'AMMO3': '0.112', 'weapon5': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.261', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.928', 'HITCOUNT': '1.630', 'weapon3': '1.878', 'DAMAGECOUNT': '7.392', 'FRAGCOUNT': '22.500'} [2024-08-05 23:30:17,072][52663] DAMAGECOUNT value on done: 36362.0 [2024-08-05 23:30:17,072][52663] Sum rewards: 32.861, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.712', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.226', 'ARMOR': '0.519', 'WEAPON3': '0.950', 'weapon2': '1.238', 'HITCOUNT': '2.110', 'weapon3': '2.168', 'DAMAGECOUNT': '8.580', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:17,182][52795] DAMAGECOUNT value on done: 34513.0 [2024-08-05 23:30:17,183][52795] Sum rewards: 28.366, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'weapon5': '0.030', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.182', 'WEAPON4': '0.450', 'weapon4': '0.512', 'WEAPON3': '1.000', 'weapon2': '1.020', 'ARMOR': '1.256', 'HITCOUNT': '1.560', 'weapon3': '2.112', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '24.000'} [2024-08-05 23:30:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 126468096. Throughput: 0: 4400.2. Samples: 31615880. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:30:17,795][52567] Avg episode reward: [(0, '29.136')] [2024-08-05 23:30:18,491][52647] DAMAGECOUNT value on done: 39901.0 [2024-08-05 23:30:18,492][52647] Sum rewards: 23.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.196', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.010', 'weapon5': '0.028', 'AMMO4': '0.041', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'ARMOR': '0.854', 'weapon2': '1.054', 'WEAPON3': '1.250', 'HITCOUNT': '1.800', 'weapon3': '2.670', 'DAMAGECOUNT': '7.104', 'FRAGCOUNT': '22.000'} [2024-08-05 23:30:18,981][52671] DAMAGECOUNT value on done: 40636.0 [2024-08-05 23:30:18,981][52671] Sum rewards: 34.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.614', 'AMMO5': '0.004', 'weapon5': '0.030', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.155', 'weapon4': '0.386', 'ARMOR': '0.464', 'WEAPON4': '0.500', 'weapon2': '0.904', 'WEAPON3': '1.050', 'weapon3': '2.432', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '30.000'} [2024-08-05 23:30:19,298][52649] DAMAGECOUNT value on done: 36317.0 [2024-08-05 23:30:19,300][52649] Sum rewards: 33.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.335', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.169', 'weapon4': '0.322', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.690', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.714', 'DAMAGECOUNT': '9.372', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:19,420][52650] Updated weights for policy 0, policy_version 15441 (0.0026) [2024-08-05 23:30:19,927][52659] DAMAGECOUNT value on done: 38466.0 [2024-08-05 23:30:19,928][52659] Sum rewards: 27.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.577', 'AMMO5': '0.005', 'weapon4': '0.010', 'weapon5': '0.014', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'ARMOR': '0.440', 'WEAPON3': '1.150', 'weapon2': '1.274', 'HITCOUNT': '1.890', 'weapon3': '2.476', 'DAMAGECOUNT': '7.266', 'FRAGCOUNT': '25.000'} [2024-08-05 23:30:20,377][52795] DAMAGECOUNT value on done: 36773.0 [2024-08-05 23:30:20,378][52795] Sum rewards: 32.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.683', 'AMMO2': '0.011', 'weapon4': '0.014', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'ARMOR': '0.800', 'weapon2': '0.944', 'WEAPON3': '1.350', 'HITCOUNT': '2.380', 'weapon3': '2.792', 'DAMAGECOUNT': '9.432', 'FRAGCOUNT': '31.000'} [2024-08-05 23:30:21,113][52647] DAMAGECOUNT value on done: 36656.0 [2024-08-05 23:30:21,115][52647] Sum rewards: 33.786, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.021', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.091', 'weapon5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.294', 'weapon2': '0.972', 'WEAPON3': '1.000', 'HITCOUNT': '2.130', 'weapon3': '2.158', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:21,739][52671] DAMAGECOUNT value on done: 36715.0 [2024-08-05 23:30:21,739][52671] Sum rewards: 42.309, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.555', 'AMMO2': '0.001', 'AMMO4': '0.006', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.165', 'weapon2': '0.772', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '3.008', 'DAMAGECOUNT': '10.422', 'FRAGCOUNT': '37.000'} [2024-08-05 23:30:22,535][52649] DAMAGECOUNT value on done: 36989.0 [2024-08-05 23:30:22,536][52649] Sum rewards: 28.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'ARMOR': '0.458', 'weapon2': '1.028', 'WEAPON3': '1.450', 'HITCOUNT': '2.010', 'weapon3': '2.630', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:22,635][52659] DAMAGECOUNT value on done: 38455.0 [2024-08-05 23:30:22,636][52659] Sum rewards: 24.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.110', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'weapon4': '0.162', 'AMMO3': '0.201', 'WEAPON4': '0.400', 'weapon2': '1.296', 'WEAPON3': '1.350', 'ARMOR': '1.356', 'HITCOUNT': '2.200', 'weapon3': '2.336', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '26.000'} [2024-08-05 23:30:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 126550016. Throughput: 0: 4399.8. Samples: 31642260. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:30:22,802][52567] Avg episode reward: [(0, '29.158')] [2024-08-05 23:30:23,400][52795] DAMAGECOUNT value on done: 37514.0 [2024-08-05 23:30:23,402][52795] Sum rewards: 29.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.882', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.034', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.740', 'WEAPON3': '1.300', 'HITCOUNT': '2.050', 'weapon3': '2.862', 'DAMAGECOUNT': '9.177', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:23,484][52650] Updated weights for policy 0, policy_version 15451 (0.0017) [2024-08-05 23:30:23,918][52647] DAMAGECOUNT value on done: 36730.0 [2024-08-05 23:30:23,919][52647] Sum rewards: 24.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.740', 'AMMO5': '0.010', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon4': '0.178', 'AMMO4': '0.188', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'ARMOR': '0.860', 'weapon2': '1.036', 'WEAPON3': '1.600', 'HITCOUNT': '1.820', 'weapon3': '2.524', 'DAMAGECOUNT': '7.605', 'FRAGCOUNT': '25.000'} [2024-08-05 23:30:24,261][52671] DAMAGECOUNT value on done: 38004.0 [2024-08-05 23:30:24,261][52671] Sum rewards: 28.473, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.363', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.106', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.300', 'ARMOR': '0.874', 'WEAPON3': '1.000', 'weapon2': '1.258', 'HITCOUNT': '1.820', 'weapon3': '2.196', 'DAMAGECOUNT': '7.356', 'FRAGCOUNT': '24.000'} [2024-08-05 23:30:25,138][52659] DAMAGECOUNT value on done: 35227.0 [2024-08-05 23:30:25,139][52659] Sum rewards: 26.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.464', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.400', 'weapon4': '0.490', 'ARMOR': '0.972', 'weapon2': '1.012', 'WEAPON3': '1.150', 'HITCOUNT': '1.850', 'weapon3': '2.252', 'DAMAGECOUNT': '7.854', 'FRAGCOUNT': '25.000'} [2024-08-05 23:30:25,485][52649] DAMAGECOUNT value on done: 36282.0 [2024-08-05 23:30:25,486][52649] Sum rewards: 31.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.068', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.181', 'ARMOR': '0.956', 'weapon2': '1.060', 'WEAPON3': '1.300', 'HITCOUNT': '2.380', 'weapon3': '2.574', 'DAMAGECOUNT': '9.045', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:26,616][52795] DAMAGECOUNT value on done: 32666.0 [2024-08-05 23:30:26,616][52795] Sum rewards: 26.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.525', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO3': '0.150', 'AMMO4': '0.167', 'weapon4': '0.202', 'WEAPON5': '0.250', 'ARMOR': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon2': '1.464', 'HITCOUNT': '1.860', 'weapon3': '1.950', 'DAMAGECOUNT': '6.984', 'FRAGCOUNT': '25.000'} [2024-08-05 23:30:26,799][52647] DAMAGECOUNT value on done: 37781.0 [2024-08-05 23:30:26,800][52647] Sum rewards: 27.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.672', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.032', 'AMMO4': '0.053', 'weapon4': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'ARMOR': '0.907', 'WEAPON3': '1.200', 'weapon2': '1.258', 'HITCOUNT': '2.260', 'weapon3': '2.420', 'DAMAGECOUNT': '8.721', 'FRAGCOUNT': '24.000'} [2024-08-05 23:30:27,375][52671] DAMAGECOUNT value on done: 42337.0 [2024-08-05 23:30:27,375][52671] Sum rewards: 43.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.500', 'weapon4': '0.542', 'weapon2': '0.622', 'ARMOR': '0.858', 'WEAPON3': '1.200', 'weapon3': '2.422', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '37.000'} [2024-08-05 23:30:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 126640128. Throughput: 0: 4415.6. Samples: 31668910. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 23:30:27,794][52567] Avg episode reward: [(0, '29.316')] [2024-08-05 23:30:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015459_126640128.pth... [2024-08-05 23:30:27,831][52659] DAMAGECOUNT value on done: 35113.0 [2024-08-05 23:30:27,832][52659] Sum rewards: 26.710, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.882', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.286', 'WEAPON3': '0.850', 'ARMOR': '0.856', 'weapon2': '1.236', 'HITCOUNT': '1.920', 'weapon3': '2.262', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '22.000'} [2024-08-05 23:30:27,964][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000014946_122437632.pth [2024-08-05 23:30:28,687][52650] Updated weights for policy 0, policy_version 15461 (0.0010) [2024-08-05 23:30:28,770][52649] DAMAGECOUNT value on done: 37376.0 [2024-08-05 23:30:28,772][52649] Sum rewards: 31.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.083', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon4': '0.236', 'weapon2': '1.020', 'WEAPON3': '1.150', 'ARMOR': '1.773', 'HITCOUNT': '2.270', 'weapon3': '2.558', 'DAMAGECOUNT': '8.730', 'FRAGCOUNT': '26.000'} [2024-08-05 23:30:29,570][52647] DAMAGECOUNT value on done: 37080.0 [2024-08-05 23:30:29,570][52647] Sum rewards: 23.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.222', 'AMMO2': '0.038', 'weapon4': '0.156', 'AMMO3': '0.178', 'AMMO4': '0.192', 'WEAPON4': '0.400', 'ARMOR': '0.881', 'weapon2': '0.972', 'WEAPON3': '1.100', 'HITCOUNT': '1.540', 'weapon3': '2.612', 'DAMAGECOUNT': '6.771', 'FRAGCOUNT': '21.000'} [2024-08-05 23:30:29,734][52795] DAMAGECOUNT value on done: 33481.0 [2024-08-05 23:30:29,736][52795] Sum rewards: 28.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.030', 'AMMO4': '0.132', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.356', 'weapon2': '0.846', 'WEAPON3': '1.150', 'ARMOR': '1.260', 'HITCOUNT': '1.970', 'weapon3': '2.538', 'DAMAGECOUNT': '7.755', 'FRAGCOUNT': '24.000'} [2024-08-05 23:30:29,926][52671] DAMAGECOUNT value on done: 37157.0 [2024-08-05 23:30:29,926][52671] Sum rewards: 38.020, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.534', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'WEAPON3': '0.900', 'ARMOR': '1.258', 'weapon2': '1.588', 'HITCOUNT': '2.130', 'weapon3': '2.252', 'DAMAGECOUNT': '9.135', 'FRAGCOUNT': '30.000'} [2024-08-05 23:30:30,480][52659] DAMAGECOUNT value on done: 38098.0 [2024-08-05 23:30:30,480][52659] Sum rewards: 17.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.344', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.064', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.264', 'AMMO4': '0.268', 'WEAPON4': '0.500', 'ARMOR': '0.900', 'WEAPON3': '1.100', 'weapon2': '1.298', 'HITCOUNT': '1.630', 'weapon3': '2.032', 'DAMAGECOUNT': '6.501', 'FRAGCOUNT': '17.000'} [2024-08-05 23:30:31,338][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:30:31,453][52649] DAMAGECOUNT value on done: 35895.0 [2024-08-05 23:30:31,454][52649] Sum rewards: 26.445, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.678', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon5': '0.068', 'AMMO4': '0.130', 'AMMO3': '0.175', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON4': '0.450', 'ARMOR': '0.484', 'weapon2': '0.732', 'WEAPON3': '1.150', 'HITCOUNT': '1.920', 'weapon3': '2.494', 'DAMAGECOUNT': '7.734', 'FRAGCOUNT': '25.000'} [2024-08-05 23:30:32,422][52647] DAMAGECOUNT value on done: 38412.0 [2024-08-05 23:30:32,422][52647] Sum rewards: 31.321, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.842', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'weapon5': '0.172', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.883', 'WEAPON3': '0.900', 'weapon2': '0.956', 'HITCOUNT': '1.540', 'weapon3': '1.956', 'DAMAGECOUNT': '7.122', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:32,639][52671] DAMAGECOUNT value on done: 33702.0 [2024-08-05 23:30:32,640][52671] Sum rewards: 28.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.696', 'weapon4': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.173', 'AMMO4': '0.248', 'ARMOR': '0.479', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon2': '1.356', 'HITCOUNT': '2.020', 'weapon3': '2.296', 'DAMAGECOUNT': '7.905', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:32,804][52567] Fps is (10 sec: 18004.7, 60 sec: 17609.9, 300 sec: 17494.2). Total num frames: 126730240. Throughput: 0: 4405.9. Samples: 31681770. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 23:30:32,804][52567] Avg episode reward: [(0, '29.302')] [2024-08-05 23:30:32,881][52795] DAMAGECOUNT value on done: 35359.0 [2024-08-05 23:30:32,881][52795] Sum rewards: 31.645, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.149', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.418', 'WEAPON4': '0.450', 'ARMOR': '0.887', 'weapon2': '0.938', 'WEAPON3': '1.050', 'HITCOUNT': '1.740', 'weapon3': '1.986', 'DAMAGECOUNT': '8.310', 'FRAGCOUNT': '25.500'} [2024-08-05 23:30:33,055][52650] Updated weights for policy 0, policy_version 15471 (0.0022) [2024-08-05 23:30:33,339][52659] DAMAGECOUNT value on done: 36725.0 [2024-08-05 23:30:33,347][52659] Sum rewards: 24.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.148', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'weapon4': '0.246', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'weapon2': '1.024', 'WEAPON3': '1.250', 'HITCOUNT': '1.820', 'weapon3': '2.458', 'DAMAGECOUNT': '7.467', 'FRAGCOUNT': '24.000'} [2024-08-05 23:30:34,525][52649] DAMAGECOUNT value on done: 36224.0 [2024-08-05 23:30:34,528][52649] Sum rewards: 23.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.564', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.366', 'ARMOR': '0.440', 'weapon2': '0.722', 'WEAPON3': '1.350', 'HITCOUNT': '1.800', 'weapon3': '2.662', 'DAMAGECOUNT': '7.263', 'FRAGCOUNT': '23.000'} [2024-08-05 23:30:35,176][52671] DAMAGECOUNT value on done: 38753.0 [2024-08-05 23:30:35,178][52671] Sum rewards: 28.691, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.424', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.062', 'AMMO3': '0.123', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon4': '0.640', 'WEAPON4': '0.650', 'weapon2': '0.660', 'WEAPON3': '0.950', 'HITCOUNT': '1.890', 'weapon3': '2.066', 'DAMAGECOUNT': '7.758', 'FRAGCOUNT': '25.000'} [2024-08-05 23:30:35,953][52659] DAMAGECOUNT value on done: 36817.0 [2024-08-05 23:30:35,955][52659] Sum rewards: 27.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.829', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.624', 'weapon2': '0.982', 'ARMOR': '1.304', 'WEAPON3': '1.400', 'HITCOUNT': '1.890', 'weapon3': '1.994', 'DAMAGECOUNT': '8.724', 'FRAGCOUNT': '27.500'} [2024-08-05 23:30:37,239][52649] DAMAGECOUNT value on done: 34439.0 [2024-08-05 23:30:37,239][52649] Sum rewards: 39.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.386', 'AMMO5': '0.003', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.145', 'WEAPON4': '0.300', 'weapon4': '0.526', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '2.170', 'weapon3': '2.344', 'DAMAGECOUNT': '10.191', 'FRAGCOUNT': '33.000'} [2024-08-05 23:30:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 126812160. Throughput: 0: 4408.7. Samples: 31708250. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:30:37,795][52567] Avg episode reward: [(0, '29.371')] [2024-08-05 23:30:37,840][52650] Updated weights for policy 0, policy_version 15481 (0.0021) [2024-08-05 23:30:38,075][52671] DAMAGECOUNT value on done: 38463.0 [2024-08-05 23:30:38,075][52671] Sum rewards: 41.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.272', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.056', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'ARMOR': '0.903', 'WEAPON3': '0.950', 'weapon2': '1.048', 'HITCOUNT': '2.470', 'weapon3': '2.622', 'DAMAGECOUNT': '10.164', 'FRAGCOUNT': '35.000'} [2024-08-05 23:30:38,892][52659] DAMAGECOUNT value on done: 35316.0 [2024-08-05 23:30:38,892][52659] Sum rewards: 35.997, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.925', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.120', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON3': '0.850', 'weapon2': '0.924', 'weapon3': '2.246', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '8.646', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:40,528][52649] DAMAGECOUNT value on done: 35744.0 [2024-08-05 23:30:40,529][52649] Sum rewards: 31.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.948', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon4': '0.388', 'ARMOR': '0.804', 'weapon2': '1.130', 'WEAPON3': '1.150', 'weapon3': '2.232', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '9.648', 'FRAGCOUNT': '29.500'} [2024-08-05 23:30:41,000][52671] DAMAGECOUNT value on done: 38400.0 [2024-08-05 23:30:41,000][52671] Sum rewards: 32.647, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.024', 'AMMO4': '0.066', 'AMMO3': '0.153', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.660', 'weapon4': '0.736', 'WEAPON3': '1.000', 'weapon3': '1.902', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '8.127', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:41,875][52659] DAMAGECOUNT value on done: 36482.0 [2024-08-05 23:30:41,877][52659] Sum rewards: 29.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.890', 'WEAPON3': '1.150', 'ARMOR': '1.718', 'HITCOUNT': '1.930', 'weapon3': '2.306', 'DAMAGECOUNT': '7.095', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:42,647][52650] Updated weights for policy 0, policy_version 15491 (0.0018) [2024-08-05 23:30:42,794][52567] Fps is (10 sec: 17220.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 126902272. Throughput: 0: 4409.6. Samples: 31734720. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:30:42,794][52567] Avg episode reward: [(0, '29.641')] [2024-08-05 23:30:43,705][52649] DAMAGECOUNT value on done: 35055.0 [2024-08-05 23:30:43,706][52649] Sum rewards: 26.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.019', 'AMMO2': '0.028', 'weapon4': '0.074', 'AMMO4': '0.140', 'weapon5': '0.176', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.489', 'weapon2': '0.964', 'WEAPON3': '1.200', 'HITCOUNT': '1.870', 'weapon3': '2.482', 'DAMAGECOUNT': '8.226', 'FRAGCOUNT': '26.000'} [2024-08-05 23:30:44,061][52671] DAMAGECOUNT value on done: 36882.0 [2024-08-05 23:30:44,072][52671] Sum rewards: 25.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.245', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.180', 'AMMO3': '0.186', 'ARMOR': '0.470', 'weapon2': '0.716', 'WEAPON3': '1.300', 'HITCOUNT': '2.030', 'weapon3': '2.722', 'DAMAGECOUNT': '8.370', 'FRAGCOUNT': '24.000'} [2024-08-05 23:30:44,927][52659] DAMAGECOUNT value on done: 38319.0 [2024-08-05 23:30:44,930][52659] Sum rewards: 31.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.027', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.144', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'WEAPON4': '0.400', 'ARMOR': '0.424', 'weapon2': '0.690', 'weapon4': '0.806', 'WEAPON3': '0.950', 'weapon3': '1.866', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '8.406', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:46,777][52649] DAMAGECOUNT value on done: 34806.0 [2024-08-05 23:30:46,778][52649] Sum rewards: 27.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.276', 'AMMO5': '0.003', 'AMMO2': '0.032', 'ARMOR': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.155', 'AMMO4': '0.159', 'weapon4': '0.186', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.266', 'HITCOUNT': '2.160', 'weapon3': '2.248', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '23.000'} [2024-08-05 23:30:47,048][52650] Updated weights for policy 0, policy_version 15501 (0.0012) [2024-08-05 23:30:47,144][52671] DAMAGECOUNT value on done: 36886.0 [2024-08-05 23:30:47,145][52671] Sum rewards: 33.046, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.794', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.020', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.272', 'WEAPON3': '0.950', 'weapon2': '1.210', 'ARMOR': '1.741', 'weapon3': '2.160', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '8.898', 'FRAGCOUNT': '25.000'} [2024-08-05 23:30:47,195][52662] DAMAGECOUNT value on done: 42632.0 [2024-08-05 23:30:47,195][52662] Sum rewards: 40.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.219', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.195', 'weapon4': '0.244', 'WEAPON4': '0.300', 'ARMOR': '0.424', 'weapon2': '0.704', 'WEAPON3': '1.150', 'HITCOUNT': '2.350', 'weapon3': '2.724', 'DAMAGECOUNT': '10.185', 'FRAGCOUNT': '34.000'} [2024-08-05 23:30:47,720][52794] DAMAGECOUNT value on done: 41981.0 [2024-08-05 23:30:47,720][52794] Sum rewards: 36.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.464', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.068', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.600', 'ARMOR': '0.820', 'WEAPON3': '1.350', 'HITCOUNT': '2.310', 'weapon3': '2.620', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '32.000'} [2024-08-05 23:30:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 126992384. Throughput: 0: 4400.7. Samples: 31747810. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:30:47,794][52567] Avg episode reward: [(0, '29.800')] [2024-08-05 23:30:47,820][52614] Saving new best policy, reward=29.800! [2024-08-05 23:30:48,069][52659] DAMAGECOUNT value on done: 40590.0 [2024-08-05 23:30:48,072][52659] Sum rewards: 31.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.394', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'AMMO3': '0.180', 'weapon4': '0.210', 'ARMOR': '0.856', 'WEAPON3': '1.100', 'weapon2': '1.424', 'weapon3': '2.144', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.201', 'FRAGCOUNT': '27.000'} [2024-08-05 23:30:49,675][52649] DAMAGECOUNT value on done: 37161.0 [2024-08-05 23:30:49,675][52649] Sum rewards: 38.937, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.202', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.032', 'AMMO4': '0.079', 'weapon4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'ARMOR': '0.912', 'WEAPON3': '1.050', 'weapon2': '1.170', 'HITCOUNT': '2.190', 'weapon3': '2.478', 'DAMAGECOUNT': '8.412', 'FRAGCOUNT': '33.000'} [2024-08-05 23:30:49,846][52662] DAMAGECOUNT value on done: 43790.0 [2024-08-05 23:30:49,847][52662] Sum rewards: 22.532, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.046', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.562', 'weapon2': '0.574', 'WEAPON3': '1.150', 'HITCOUNT': '1.900', 'weapon3': '2.356', 'DAMAGECOUNT': '8.394', 'FRAGCOUNT': '19.000'} [2024-08-05 23:30:50,595][52794] DAMAGECOUNT value on done: 41594.0 [2024-08-05 23:30:50,596][52794] Sum rewards: 36.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.614', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'AMMO4': '0.169', 'WEAPON4': '0.300', 'weapon4': '0.564', 'ARMOR': '0.881', 'weapon2': '0.920', 'WEAPON3': '0.950', 'weapon3': '2.234', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '9.036', 'FRAGCOUNT': '29.000'} [2024-08-05 23:30:50,822][52659] DAMAGECOUNT value on done: 36170.0 [2024-08-05 23:30:50,822][52659] Sum rewards: 22.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.309', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.177', 'weapon4': '0.262', 'WEAPON4': '0.300', 'ARMOR': '0.869', 'weapon2': '1.132', 'WEAPON3': '1.150', 'HITCOUNT': '1.880', 'weapon3': '2.320', 'DAMAGECOUNT': '7.278', 'FRAGCOUNT': '20.000'} [2024-08-05 23:30:51,693][52650] Updated weights for policy 0, policy_version 15511 (0.0026) [2024-08-05 23:30:52,509][52649] DAMAGECOUNT value on done: 36030.0 [2024-08-05 23:30:52,511][52649] Sum rewards: 31.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.828', 'AMMO5': '0.003', 'AMMO2': '0.034', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.169', 'AMMO3': '0.174', 'WEAPON4': '0.550', 'weapon4': '0.562', 'weapon2': '0.838', 'WEAPON3': '1.150', 'weapon3': '2.286', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.396', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:52,696][52662] DAMAGECOUNT value on done: 46269.0 [2024-08-05 23:30:52,698][52662] Sum rewards: 22.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.050', 'AMMO3': '0.180', 'AMMO4': '0.249', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'ARMOR': '0.894', 'weapon2': '1.022', 'WEAPON3': '1.100', 'HITCOUNT': '1.920', 'weapon3': '2.274', 'DAMAGECOUNT': '7.086', 'FRAGCOUNT': '21.000'} [2024-08-05 23:30:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 127082496. Throughput: 0: 4400.9. Samples: 31774060. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:30:52,794][52567] Avg episode reward: [(0, '29.889')] [2024-08-05 23:30:52,795][52614] Saving new best policy, reward=29.889! [2024-08-05 23:30:53,464][52659] DAMAGECOUNT value on done: 37056.0 [2024-08-05 23:30:53,465][52659] Sum rewards: 19.289, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.978', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.120', 'weapon5': '0.120', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '0.950', 'weapon2': '1.006', 'HITCOUNT': '1.640', 'ARMOR': '1.800', 'weapon3': '2.040', 'DAMAGECOUNT': '5.733', 'FRAGCOUNT': '15.000'} [2024-08-05 23:30:53,533][52794] DAMAGECOUNT value on done: 42229.0 [2024-08-05 23:30:53,534][52794] Sum rewards: 33.805, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.116', 'AMMO4': '0.117', 'WEAPON3': '0.600', 'weapon2': '1.168', 'HEALTH': '1.178', 'HITCOUNT': '1.850', 'weapon3': '2.100', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '27.500'} [2024-08-05 23:30:55,507][52649] DAMAGECOUNT value on done: 39006.0 [2024-08-05 23:30:55,507][52649] Sum rewards: 32.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.579', 'AMMO2': '0.031', 'weapon4': '0.082', 'AMMO4': '0.153', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'ARMOR': '0.812', 'WEAPON3': '1.200', 'weapon2': '1.350', 'HITCOUNT': '2.010', 'weapon3': '2.288', 'DAMAGECOUNT': '7.968', 'FRAGCOUNT': '32.000'} [2024-08-05 23:30:55,902][52662] DAMAGECOUNT value on done: 40282.0 [2024-08-05 23:30:55,902][52662] Sum rewards: 39.544, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.022', 'ARMOR': '0.060', 'weapon5': '0.062', 'AMMO4': '0.108', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.664', 'WEAPON3': '1.000', 'HITCOUNT': '2.290', 'weapon3': '2.324', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '34.000'} [2024-08-05 23:30:56,354][52659] DAMAGECOUNT value on done: 38778.0 [2024-08-05 23:30:56,354][52659] Sum rewards: 27.848, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.077', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO4': '0.147', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'weapon2': '0.602', 'WEAPON3': '1.450', 'HITCOUNT': '2.040', 'weapon3': '3.020', 'DAMAGECOUNT': '8.604', 'FRAGCOUNT': '28.000'} [2024-08-05 23:30:56,395][52820] DAMAGECOUNT value on done: 32714.0 [2024-08-05 23:30:56,396][52820] Sum rewards: 18.052, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.988', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.248', 'ARMOR': '0.424', 'weapon2': '1.012', 'WEAPON3': '1.100', 'HITCOUNT': '1.360', 'weapon3': '2.248', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '16.500'} [2024-08-05 23:30:56,409][52650] Updated weights for policy 0, policy_version 15521 (0.0012) [2024-08-05 23:30:56,637][52794] DAMAGECOUNT value on done: 37608.0 [2024-08-05 23:30:56,639][52794] Sum rewards: 11.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.256', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.157', 'WEAPON4': '0.400', 'weapon4': '0.622', 'ARMOR': '0.900', 'WEAPON3': '1.050', 'weapon2': '1.100', 'HITCOUNT': '1.450', 'weapon3': '1.620', 'DAMAGECOUNT': '4.734', 'FRAGCOUNT': '12.000'} [2024-08-05 23:30:57,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17494.9). Total num frames: 127164416. Throughput: 0: 4394.6. Samples: 31800330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:30:57,796][52567] Avg episode reward: [(0, '29.966')] [2024-08-05 23:30:57,805][52614] Saving new best policy, reward=29.966! [2024-08-05 23:30:58,398][52649] DAMAGECOUNT value on done: 37193.0 [2024-08-05 23:30:58,399][52649] Sum rewards: 44.690, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.097', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.210', 'WEAPON3': '0.850', 'weapon2': '1.152', 'weapon3': '2.222', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.344', 'FRAGCOUNT': '37.000'} [2024-08-05 23:30:58,742][52662] DAMAGECOUNT value on done: 40560.0 [2024-08-05 23:30:58,743][52662] Sum rewards: 27.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.848', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.252', 'ARMOR': '0.845', 'weapon2': '0.944', 'WEAPON3': '1.100', 'HITCOUNT': '1.960', 'weapon3': '2.576', 'DAMAGECOUNT': '7.809', 'FRAGCOUNT': '24.000'} [2024-08-05 23:30:59,523][52820] DAMAGECOUNT value on done: 34997.0 [2024-08-05 23:30:59,523][52820] Sum rewards: 36.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.592', 'AMMO5': '0.019', 'weapon5': '0.036', 'AMMO2': '0.045', 'AMMO3': '0.194', 'AMMO4': '0.225', 'weapon4': '0.274', 'WEAPON5': '0.400', 'ARMOR': '0.481', 'WEAPON4': '0.550', 'weapon2': '0.900', 'WEAPON3': '1.200', 'HITCOUNT': '2.260', 'weapon3': '2.456', 'DAMAGECOUNT': '9.345', 'FRAGCOUNT': '33.000'} [2024-08-05 23:30:59,526][52659] DAMAGECOUNT value on done: 40173.0 [2024-08-05 23:30:59,526][52659] Sum rewards: 27.096, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon4': '0.174', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'WEAPON3': '1.050', 'weapon2': '1.092', 'HITCOUNT': '1.860', 'weapon3': '2.416', 'DAMAGECOUNT': '7.626', 'FRAGCOUNT': '22.500'} [2024-08-05 23:30:59,712][52794] DAMAGECOUNT value on done: 42277.0 [2024-08-05 23:30:59,714][52794] Sum rewards: 30.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.924', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.356', 'WEAPON3': '0.900', 'ARMOR': '0.920', 'weapon2': '1.142', 'weapon3': '1.970', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '8.499', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:01,310][52650] Updated weights for policy 0, policy_version 15531 (0.0038) [2024-08-05 23:31:01,367][52668] DAMAGECOUNT value on done: 37056.0 [2024-08-05 23:31:01,367][52668] Sum rewards: 34.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.037', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'ARMOR': '0.849', 'weapon2': '1.132', 'WEAPON3': '1.150', 'HITCOUNT': '2.230', 'weapon3': '2.488', 'DAMAGECOUNT': '9.147', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:01,566][52649] DAMAGECOUNT value on done: 33730.0 [2024-08-05 23:31:01,566][52649] Sum rewards: 27.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.194', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.450', 'weapon2': '1.044', 'WEAPON3': '1.150', 'HITCOUNT': '1.870', 'weapon3': '2.550', 'DAMAGECOUNT': '7.776', 'FRAGCOUNT': '26.500'} [2024-08-05 23:31:01,885][52662] DAMAGECOUNT value on done: 43484.0 [2024-08-05 23:31:01,886][52662] Sum rewards: 31.281, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.254', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.370', 'WEAPON3': '0.750', 'ARMOR': '0.860', 'weapon2': '1.446', 'weapon3': '1.950', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '7.746', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:02,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 127254528. Throughput: 0: 4381.7. Samples: 31813060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:31:02,796][52567] Avg episode reward: [(0, '30.041')] [2024-08-05 23:31:02,826][52614] Saving new best policy, reward=30.041! [2024-08-05 23:31:02,866][52820] DAMAGECOUNT value on done: 33182.0 [2024-08-05 23:31:02,868][52820] Sum rewards: 30.229, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.102', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.790', 'WEAPON3': '1.450', 'HITCOUNT': '2.310', 'weapon3': '2.756', 'DAMAGECOUNT': '9.045', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:02,971][52794] DAMAGECOUNT value on done: 43074.0 [2024-08-05 23:31:02,974][52794] Sum rewards: 24.788, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.572', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.250', 'HITCOUNT': '2.100', 'weapon3': '2.612', 'DAMAGECOUNT': '8.139', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:03,897][52668] DAMAGECOUNT value on done: 40056.0 [2024-08-05 23:31:03,897][52668] Sum rewards: 32.645, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon4': '0.030', 'AMMO4': '0.063', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'WEAPON5': '0.350', 'weapon2': '0.896', 'WEAPON3': '1.200', 'HITCOUNT': '2.080', 'weapon3': '2.666', 'DAMAGECOUNT': '8.850', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:04,891][52649] DAMAGECOUNT value on done: 38580.0 [2024-08-05 23:31:04,891][52649] Sum rewards: 41.405, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.258', 'AMMO5': '0.005', 'AMMO2': '0.033', 'ARMOR': '0.040', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.166', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.596', 'WEAPON3': '1.000', 'HITCOUNT': '2.140', 'weapon3': '2.504', 'DAMAGECOUNT': '9.465', 'FRAGCOUNT': '36.000'} [2024-08-05 23:31:05,068][52662] DAMAGECOUNT value on done: 44324.0 [2024-08-05 23:31:05,069][52662] Sum rewards: 25.286, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.160', 'weapon2': '0.848', 'WEAPON3': '1.000', 'ARMOR': '1.303', 'HITCOUNT': '1.690', 'weapon3': '2.102', 'DAMAGECOUNT': '7.200', 'FRAGCOUNT': '21.000'} [2024-08-05 23:31:05,743][52650] Updated weights for policy 0, policy_version 15541 (0.0012) [2024-08-05 23:31:05,980][52820] DAMAGECOUNT value on done: 34758.0 [2024-08-05 23:31:05,982][52820] Sum rewards: 34.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.652', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.147', 'weapon4': '0.218', 'WEAPON4': '0.400', 'ARMOR': '0.516', 'weapon2': '0.928', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.628', 'DAMAGECOUNT': '9.417', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:06,107][52794] DAMAGECOUNT value on done: 43108.0 [2024-08-05 23:31:06,108][52794] Sum rewards: 31.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.793', 'AMMO5': '0.007', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.227', 'weapon4': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.925', 'weapon2': '1.082', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '2.336', 'DAMAGECOUNT': '8.673', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:06,347][52668] DAMAGECOUNT value on done: 35796.0 [2024-08-05 23:31:06,349][52668] Sum rewards: 26.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.735', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO4': '0.133', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon2': '1.186', 'WEAPON3': '1.500', 'ARMOR': '1.747', 'HITCOUNT': '2.220', 'weapon3': '2.476', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:07,298][52649] DAMAGECOUNT value on done: 34319.0 [2024-08-05 23:31:07,299][52649] Sum rewards: 21.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.151', 'AMMO5': '0.015', 'weapon5': '0.058', 'AMMO2': '0.065', 'AMMO3': '0.168', 'WEAPON5': '0.300', 'AMMO4': '0.324', 'ARMOR': '0.491', 'weapon4': '0.532', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.028', 'HITCOUNT': '1.890', 'weapon3': '2.048', 'DAMAGECOUNT': '7.620', 'FRAGCOUNT': '20.000'} [2024-08-05 23:31:07,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 127344640. Throughput: 0: 4382.0. Samples: 31839450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:31:07,794][52567] Avg episode reward: [(0, '30.184')] [2024-08-05 23:31:07,797][52614] Saving new best policy, reward=30.184! [2024-08-05 23:31:08,402][52662] DAMAGECOUNT value on done: 46514.0 [2024-08-05 23:31:08,406][52662] Sum rewards: 34.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.292', 'AMMO5': '0.015', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.040', 'AMMO4': '0.141', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '1.126', 'WEAPON3': '1.200', 'ARMOR': '1.248', 'HITCOUNT': '2.300', 'weapon3': '2.528', 'DAMAGECOUNT': '9.591', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:09,277][52820] DAMAGECOUNT value on done: 35036.0 [2024-08-05 23:31:09,279][52820] Sum rewards: 27.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.093', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.054', 'AMMO3': '0.109', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'ARMOR': '1.232', 'weapon2': '1.400', 'HITCOUNT': '1.920', 'weapon3': '2.034', 'DAMAGECOUNT': '7.665', 'FRAGCOUNT': '22.500'} [2024-08-05 23:31:09,454][52794] DAMAGECOUNT value on done: 39401.0 [2024-08-05 23:31:09,454][52794] Sum rewards: 29.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.501', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.024', 'ARMOR': '0.040', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.340', 'weapon4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.010', 'weapon3': '2.744', 'DAMAGECOUNT': '8.679', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:09,547][52668] DAMAGECOUNT value on done: 38743.0 [2024-08-05 23:31:09,548][52668] Sum rewards: 30.191, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.422', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.183', 'weapon4': '0.264', 'WEAPON4': '0.300', 'ARMOR': '0.856', 'weapon2': '0.922', 'WEAPON3': '1.300', 'HITCOUNT': '2.170', 'weapon3': '2.578', 'DAMAGECOUNT': '9.030', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:09,694][52649] DAMAGECOUNT value on done: 39274.0 [2024-08-05 23:31:09,694][52649] Sum rewards: 34.123, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.932', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon4': '0.186', 'WEAPON5': '0.200', 'ARMOR': '0.455', 'WEAPON3': '1.100', 'weapon2': '1.162', 'HITCOUNT': '2.200', 'weapon3': '2.394', 'DAMAGECOUNT': '9.765', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:10,095][52660] DAMAGECOUNT value on done: 38386.0 [2024-08-05 23:31:10,098][52660] Sum rewards: 30.691, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.699', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.096', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'ARMOR': '0.909', 'WEAPON3': '0.950', 'weapon2': '1.450', 'weapon3': '2.132', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.169', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:10,580][52650] Updated weights for policy 0, policy_version 15551 (0.0020) [2024-08-05 23:31:11,466][52662] DAMAGECOUNT value on done: 40719.0 [2024-08-05 23:31:11,466][52662] Sum rewards: 34.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.669', 'AMMO5': '0.023', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.078', 'AMMO4': '0.172', 'AMMO3': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.947', 'weapon2': '1.206', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '2.380', 'DAMAGECOUNT': '9.639', 'FRAGCOUNT': '31.000'} [2024-08-05 23:31:12,082][52668] DAMAGECOUNT value on done: 38610.0 [2024-08-05 23:31:12,082][52668] Sum rewards: 38.812, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.906', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.103', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon5': '0.218', 'WEAPON4': '0.350', 'ARMOR': '0.445', 'weapon2': '0.478', 'WEAPON3': '0.650', 'weapon4': '0.952', 'weapon3': '1.772', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:12,401][52820] DAMAGECOUNT value on done: 35981.0 [2024-08-05 23:31:12,402][52820] Sum rewards: 37.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.797', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'ARMOR': '0.496', 'weapon2': '0.730', 'WEAPON3': '1.550', 'HITCOUNT': '2.650', 'weapon3': '3.028', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '34.000'} [2024-08-05 23:31:12,500][52794] DAMAGECOUNT value on done: 42611.0 [2024-08-05 23:31:12,500][52794] Sum rewards: 25.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.633', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.140', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'weapon2': '1.282', 'WEAPON3': '1.350', 'HITCOUNT': '1.940', 'weapon3': '2.308', 'DAMAGECOUNT': '8.178', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:12,559][52660] DAMAGECOUNT value on done: 38656.0 [2024-08-05 23:31:12,559][52660] Sum rewards: 30.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.514', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.186', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.260', 'ARMOR': '0.400', 'weapon2': '0.892', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.560', 'DAMAGECOUNT': '8.778', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:12,786][52649] DAMAGECOUNT value on done: 37630.0 [2024-08-05 23:31:12,786][52649] Sum rewards: 28.146, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'HEALTH': '0.516', 'WEAPON3': '0.950', 'weapon2': '0.982', 'ARMOR': '1.257', 'HITCOUNT': '2.070', 'weapon3': '2.554', 'DAMAGECOUNT': '8.622', 'FRAGCOUNT': '24.000'} [2024-08-05 23:31:12,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 127426560. Throughput: 0: 4368.7. Samples: 31865500. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:31:12,794][52567] Avg episode reward: [(0, '30.400')] [2024-08-05 23:31:12,795][52614] Saving new best policy, reward=30.400! [2024-08-05 23:31:14,620][52662] DAMAGECOUNT value on done: 41561.0 [2024-08-05 23:31:14,624][52662] Sum rewards: 27.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO2': '0.021', 'weapon4': '0.086', 'AMMO4': '0.105', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '1.116', 'WEAPON3': '1.200', 'ARMOR': '1.873', 'HITCOUNT': '2.000', 'weapon3': '2.588', 'DAMAGECOUNT': '7.635', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:15,200][52668] DAMAGECOUNT value on done: 39275.0 [2024-08-05 23:31:15,200][52668] Sum rewards: 33.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon4': '0.364', 'ARMOR': '0.464', 'weapon2': '0.766', 'WEAPON3': '1.200', 'HITCOUNT': '2.200', 'weapon3': '2.550', 'DAMAGECOUNT': '8.391', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:15,459][52794] DAMAGECOUNT value on done: 43251.0 [2024-08-05 23:31:15,460][52794] Sum rewards: 25.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.170', 'weapon4': '0.244', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'WEAPON3': '1.100', 'weapon2': '1.180', 'HITCOUNT': '2.120', 'weapon3': '2.318', 'DAMAGECOUNT': '8.460', 'FRAGCOUNT': '23.000'} [2024-08-05 23:31:15,477][52820] DAMAGECOUNT value on done: 35049.0 [2024-08-05 23:31:15,477][52820] Sum rewards: 28.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.879', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon4': '0.042', 'AMMO4': '0.069', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon2': '1.120', 'WEAPON3': '1.150', 'ARMOR': '1.264', 'HITCOUNT': '2.030', 'weapon3': '2.456', 'DAMAGECOUNT': '8.070', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:15,535][52650] Updated weights for policy 0, policy_version 15561 (0.0018) [2024-08-05 23:31:15,573][52660] DAMAGECOUNT value on done: 38212.0 [2024-08-05 23:31:15,573][52660] Sum rewards: 24.881, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.921', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.098', 'AMMO4': '0.099', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.851', 'WEAPON3': '0.950', 'weapon2': '1.274', 'HITCOUNT': '1.930', 'weapon3': '2.252', 'DAMAGECOUNT': '7.560', 'FRAGCOUNT': '20.000'} [2024-08-05 23:31:15,976][52649] DAMAGECOUNT value on done: 39491.0 [2024-08-05 23:31:15,978][52649] Sum rewards: 34.217, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.248', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.106', 'AMMO3': '0.131', 'AMMO4': '0.209', 'weapon4': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.236', 'weapon3': '2.088', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '8.907', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:17,339][52662] DAMAGECOUNT value on done: 42500.0 [2024-08-05 23:31:17,340][52662] Sum rewards: 28.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.068', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.500', 'weapon4': '0.586', 'weapon2': '0.708', 'ARMOR': '0.949', 'WEAPON3': '1.100', 'HITCOUNT': '1.900', 'weapon3': '2.308', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 127516672. Throughput: 0: 4371.6. Samples: 31878450. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:31:17,795][52567] Avg episode reward: [(0, '30.074')] [2024-08-05 23:31:18,125][52668] DAMAGECOUNT value on done: 40820.0 [2024-08-05 23:31:18,134][52668] Sum rewards: 34.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.088', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.226', 'WEAPON3': '1.000', 'weapon2': '1.142', 'ARMOR': '1.340', 'HITCOUNT': '2.200', 'weapon3': '2.452', 'DAMAGECOUNT': '8.532', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:18,184][52794] DAMAGECOUNT value on done: 42660.0 [2024-08-05 23:31:18,185][52794] Sum rewards: 30.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.672', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.078', 'AMMO4': '0.226', 'AMMO3': '0.257', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.830', 'ARMOR': '0.880', 'WEAPON3': '1.550', 'HITCOUNT': '2.200', 'weapon3': '2.368', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:18,414][52660] DAMAGECOUNT value on done: 37536.0 [2024-08-05 23:31:18,415][52660] Sum rewards: 27.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.681', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.066', 'AMMO4': '0.099', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.278', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'weapon2': '0.976', 'WEAPON3': '1.100', 'HITCOUNT': '1.870', 'weapon3': '2.130', 'DAMAGECOUNT': '7.806', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:18,490][52820] DAMAGECOUNT value on done: 34930.0 [2024-08-05 23:31:18,490][52820] Sum rewards: 32.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.992', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO2': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'AMMO4': '0.300', 'weapon4': '0.482', 'WEAPON4': '0.650', 'weapon2': '0.980', 'ARMOR': '1.340', 'WEAPON3': '1.450', 'weapon3': '2.222', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '32.000'} [2024-08-05 23:31:19,877][52662] DAMAGECOUNT value on done: 41473.0 [2024-08-05 23:31:19,878][52662] Sum rewards: 27.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.288', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.190', 'weapon4': '0.310', 'WEAPON4': '0.400', 'ARMOR': '0.852', 'weapon2': '1.062', 'WEAPON3': '1.200', 'HITCOUNT': '2.200', 'weapon3': '2.260', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:20,009][52650] Updated weights for policy 0, policy_version 15571 (0.0011) [2024-08-05 23:31:20,762][52794] DAMAGECOUNT value on done: 43669.0 [2024-08-05 23:31:20,763][52794] Sum rewards: 32.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'AMMO5': '0.003', 'AMMO2': '0.048', 'AMMO3': '0.180', 'AMMO4': '0.241', 'weapon4': '0.348', 'WEAPON4': '0.450', 'ARMOR': '0.485', 'weapon2': '0.844', 'WEAPON3': '1.200', 'HITCOUNT': '2.150', 'weapon3': '2.620', 'DAMAGECOUNT': '8.898', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:20,870][52668] DAMAGECOUNT value on done: 40582.0 [2024-08-05 23:31:20,872][52668] Sum rewards: 38.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.029', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'ARMOR': '0.490', 'WEAPON3': '1.100', 'weapon2': '1.106', 'HITCOUNT': '2.550', 'weapon3': '2.666', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '32.000'} [2024-08-05 23:31:21,484][52660] DAMAGECOUNT value on done: 34095.0 [2024-08-05 23:31:21,486][52660] Sum rewards: 41.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.524', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'weapon5': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'weapon2': '0.832', 'ARMOR': '0.918', 'WEAPON3': '1.400', 'HITCOUNT': '2.420', 'weapon3': '2.836', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '36.000'} [2024-08-05 23:31:21,579][52820] DAMAGECOUNT value on done: 32918.0 [2024-08-05 23:31:21,580][52820] Sum rewards: 36.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.114', 'AMMO3': '0.194', 'AMMO4': '0.220', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.530', 'weapon2': '0.760', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.482', 'DAMAGECOUNT': '9.792', 'FRAGCOUNT': '31.000'} [2024-08-05 23:31:22,658][52662] DAMAGECOUNT value on done: 41779.0 [2024-08-05 23:31:22,660][52662] Sum rewards: 16.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.141', 'weapon5': '0.146', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'weapon4': '0.486', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'ARMOR': '0.886', 'weapon2': '1.100', 'HITCOUNT': '1.510', 'weapon3': '1.828', 'DAMAGECOUNT': '6.306', 'FRAGCOUNT': '17.000'} [2024-08-05 23:31:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 127606784. Throughput: 0: 4365.6. Samples: 31904700. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:31:22,794][52567] Avg episode reward: [(0, '30.380')] [2024-08-05 23:31:23,625][52794] DAMAGECOUNT value on done: 42073.0 [2024-08-05 23:31:23,627][52794] Sum rewards: 41.272, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.145', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.192', 'weapon3': '2.632', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '33.000'} [2024-08-05 23:31:24,242][52668] DAMAGECOUNT value on done: 36756.0 [2024-08-05 23:31:24,242][52668] Sum rewards: 35.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.381', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.066', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'ARMOR': '0.880', 'weapon2': '0.976', 'WEAPON3': '1.350', 'HITCOUNT': '1.980', 'weapon3': '2.566', 'DAMAGECOUNT': '9.210', 'FRAGCOUNT': '32.000'} [2024-08-05 23:31:24,487][52664] DAMAGECOUNT value on done: 37939.0 [2024-08-05 23:31:24,487][52664] Sum rewards: 32.299, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.508', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.178', 'ARMOR': '0.461', 'weapon2': '0.884', 'WEAPON3': '0.950', 'HITCOUNT': '2.070', 'weapon3': '2.434', 'DAMAGECOUNT': '8.748', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:24,603][52820] DAMAGECOUNT value on done: 33275.0 [2024-08-05 23:31:24,604][52820] Sum rewards: 23.465, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.806', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.416', 'ARMOR': '0.483', 'weapon2': '0.768', 'WEAPON3': '1.600', 'HITCOUNT': '2.340', 'weapon3': '2.466', 'DAMAGECOUNT': '9.066', 'FRAGCOUNT': '24.000'} [2024-08-05 23:31:24,606][52660] DAMAGECOUNT value on done: 38082.0 [2024-08-05 23:31:24,606][52660] Sum rewards: 36.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.609', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.025', 'weapon5': '0.068', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '1.222', 'WEAPON3': '1.250', 'ARMOR': '1.770', 'HITCOUNT': '2.220', 'weapon3': '2.452', 'DAMAGECOUNT': '9.699', 'FRAGCOUNT': '31.000'} [2024-08-05 23:31:24,758][52650] Updated weights for policy 0, policy_version 15581 (0.0019) [2024-08-05 23:31:25,319][52662] DAMAGECOUNT value on done: 42249.0 [2024-08-05 23:31:25,320][52662] Sum rewards: 33.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.209', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.163', 'ARMOR': '0.480', 'WEAPON4': '0.500', 'weapon4': '0.538', 'weapon2': '0.844', 'WEAPON3': '1.050', 'HITCOUNT': '2.380', 'weapon3': '2.428', 'DAMAGECOUNT': '8.988', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:26,329][52794] DAMAGECOUNT value on done: 46394.0 [2024-08-05 23:31:26,330][52794] Sum rewards: 38.003, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.459', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.135', 'WEAPON4': '0.350', 'weapon4': '0.502', 'ARMOR': '0.512', 'WEAPON3': '0.950', 'weapon2': '0.960', 'weapon3': '2.268', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '9.960', 'FRAGCOUNT': '30.500'} [2024-08-05 23:31:26,944][52668] DAMAGECOUNT value on done: 40337.0 [2024-08-05 23:31:26,946][52668] Sum rewards: 24.999, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'HEALTH': '0.426', 'WEAPON3': '0.750', 'weapon2': '0.778', 'weapon4': '0.792', 'HITCOUNT': '1.950', 'weapon3': '2.092', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '19.000'} [2024-08-05 23:31:27,076][52664] DAMAGECOUNT value on done: 37847.0 [2024-08-05 23:31:27,077][52664] Sum rewards: 36.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.064', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'ARMOR': '0.481', 'weapon2': '1.036', 'WEAPON3': '1.200', 'HITCOUNT': '2.380', 'weapon3': '2.526', 'DAMAGECOUNT': '9.585', 'FRAGCOUNT': '32.000'} [2024-08-05 23:31:27,312][52660] DAMAGECOUNT value on done: 38110.0 [2024-08-05 23:31:27,313][52660] Sum rewards: 32.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon7': '0.032', 'AMMO4': '0.082', 'weapon4': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'ARMOR': '0.827', 'WEAPON3': '1.000', 'weapon2': '1.042', 'HITCOUNT': '2.130', 'weapon3': '2.522', 'DAMAGECOUNT': '9.678', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 127688704. Throughput: 0: 4365.6. Samples: 31931170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:31:27,794][52567] Avg episode reward: [(0, '30.702')] [2024-08-05 23:31:27,795][52820] DAMAGECOUNT value on done: 36338.0 [2024-08-05 23:31:27,797][52820] Sum rewards: 27.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.184', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.210', 'WEAPON4': '0.550', 'weapon4': '0.576', 'ARMOR': '0.872', 'WEAPON3': '1.050', 'weapon2': '1.158', 'weapon3': '1.778', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '8.718', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:27,871][52614] Saving new best policy, reward=30.702! [2024-08-05 23:31:28,431][52662] DAMAGECOUNT value on done: 42930.0 [2024-08-05 23:31:28,431][52662] Sum rewards: 28.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.269', 'AMMO5': '0.011', 'AMMO2': '0.030', 'ARMOR': '0.032', 'weapon5': '0.040', 'AMMO4': '0.151', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.470', 'weapon2': '0.670', 'WEAPON3': '1.050', 'HITCOUNT': '1.860', 'weapon3': '2.534', 'DAMAGECOUNT': '8.550', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:29,180][52650] Updated weights for policy 0, policy_version 15591 (0.0014) [2024-08-05 23:31:29,432][52668] DAMAGECOUNT value on done: 37842.0 [2024-08-05 23:31:29,434][52668] Sum rewards: 29.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.742', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.164', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '1.010', 'ARMOR': '1.294', 'WEAPON3': '1.350', 'HITCOUNT': '2.040', 'weapon3': '2.426', 'DAMAGECOUNT': '8.772', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:29,472][52794] DAMAGECOUNT value on done: 40704.0 [2024-08-05 23:31:29,475][52794] Sum rewards: 27.633, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.706', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'ARMOR': '0.886', 'weapon2': '1.064', 'WEAPON3': '1.600', 'HITCOUNT': '2.080', 'weapon3': '2.512', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:29,827][52660] DAMAGECOUNT value on done: 37687.0 [2024-08-05 23:31:29,829][52660] Sum rewards: 32.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.229', 'ARMOR': '0.400', 'weapon2': '0.904', 'WEAPON3': '1.350', 'HITCOUNT': '2.100', 'weapon3': '2.658', 'DAMAGECOUNT': '8.490', 'FRAGCOUNT': '31.000'} [2024-08-05 23:31:29,999][52664] DAMAGECOUNT value on done: 39887.0 [2024-08-05 23:31:30,000][52664] Sum rewards: 20.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.803', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON3': '1.100', 'weapon2': '1.228', 'ARMOR': '1.751', 'HITCOUNT': '1.940', 'weapon3': '2.212', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '17.000'} [2024-08-05 23:31:30,906][52820] DAMAGECOUNT value on done: 36821.0 [2024-08-05 23:31:30,906][52820] Sum rewards: 37.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.101', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.312', 'ARMOR': '0.933', 'WEAPON3': '1.100', 'weapon2': '1.102', 'weapon3': '2.316', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.657', 'FRAGCOUNT': '31.000'} [2024-08-05 23:31:31,141][52662] DAMAGECOUNT value on done: 44627.0 [2024-08-05 23:31:31,141][52662] Sum rewards: 32.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.036', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'ARMOR': '0.881', 'weapon2': '1.146', 'WEAPON3': '1.350', 'HITCOUNT': '2.150', 'weapon3': '2.462', 'DAMAGECOUNT': '8.997', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:32,156][52668] DAMAGECOUNT value on done: 38146.0 [2024-08-05 23:31:32,157][52668] Sum rewards: 32.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.177', 'weapon4': '0.248', 'WEAPON4': '0.350', 'ARMOR': '0.955', 'WEAPON3': '1.100', 'weapon2': '1.324', 'weapon3': '2.246', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '9.705', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:32,296][52794] DAMAGECOUNT value on done: 44266.0 [2024-08-05 23:31:32,296][52794] Sum rewards: 22.493, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.212', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'ARMOR': '0.855', 'WEAPON3': '1.100', 'weapon2': '1.484', 'HITCOUNT': '1.810', 'weapon3': '2.348', 'DAMAGECOUNT': '6.603', 'FRAGCOUNT': '22.000'} [2024-08-05 23:31:32,443][52664] DAMAGECOUNT value on done: 39173.0 [2024-08-05 23:31:32,444][52664] Sum rewards: 26.545, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.538', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.036', 'AMMO4': '0.054', 'weapon5': '0.056', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.508', 'WEAPON3': '0.850', 'weapon2': '1.580', 'HITCOUNT': '1.750', 'weapon3': '1.962', 'DAMAGECOUNT': '7.089', 'FRAGCOUNT': '21.000'} [2024-08-05 23:31:32,743][52660] DAMAGECOUNT value on done: 37576.0 [2024-08-05 23:31:32,745][52660] Sum rewards: 33.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.828', 'AMMO5': '0.003', 'weapon7': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.201', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon2': '1.428', 'ARMOR': '1.436', 'weapon3': '2.132', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.492', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17479.1, 300 sec: 17522.5). Total num frames: 127778816. Throughput: 0: 4363.8. Samples: 31944180. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:31:32,794][52567] Avg episode reward: [(0, '30.661')] [2024-08-05 23:31:33,832][52650] Updated weights for policy 0, policy_version 15601 (0.0017) [2024-08-05 23:31:33,905][52820] DAMAGECOUNT value on done: 33093.0 [2024-08-05 23:31:33,907][52820] Sum rewards: 24.175, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.084', 'weapon5': '0.110', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'ARMOR': '1.313', 'weapon2': '1.610', 'HITCOUNT': '1.710', 'weapon3': '2.022', 'DAMAGECOUNT': '7.110', 'FRAGCOUNT': '19.000'} [2024-08-05 23:31:34,026][52662] DAMAGECOUNT value on done: 41060.0 [2024-08-05 23:31:34,026][52662] Sum rewards: 22.242, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.963', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.794', 'ARMOR': '0.945', 'WEAPON3': '1.400', 'HITCOUNT': '1.990', 'weapon3': '2.542', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '24.000'} [2024-08-05 23:31:34,917][52794] DAMAGECOUNT value on done: 44501.0 [2024-08-05 23:31:34,918][52794] Sum rewards: 30.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.137', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.048', 'AMMO4': '0.210', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon2': '0.780', 'ARMOR': '0.860', 'WEAPON3': '1.250', 'HITCOUNT': '2.200', 'weapon3': '2.530', 'DAMAGECOUNT': '8.691', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:35,277][52668] DAMAGECOUNT value on done: 36284.0 [2024-08-05 23:31:35,279][52668] Sum rewards: 17.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.445', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.008', 'weapon5': '0.046', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.214', 'ARMOR': '0.900', 'weapon2': '1.122', 'WEAPON3': '1.500', 'HITCOUNT': '1.640', 'weapon3': '2.418', 'DAMAGECOUNT': '6.522', 'FRAGCOUNT': '17.500'} [2024-08-05 23:31:35,561][52664] DAMAGECOUNT value on done: 37880.0 [2024-08-05 23:31:35,562][52664] Sum rewards: 28.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.544', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon5': '0.054', 'AMMO3': '0.188', 'AMMO4': '0.225', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'ARMOR': '0.970', 'weapon2': '1.006', 'WEAPON3': '1.150', 'HITCOUNT': '2.060', 'weapon3': '2.366', 'DAMAGECOUNT': '8.142', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:35,845][52660] DAMAGECOUNT value on done: 37458.0 [2024-08-05 23:31:35,846][52660] Sum rewards: 29.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.184', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.215', 'weapon4': '0.332', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon2': '0.596', 'WEAPON3': '1.300', 'HITCOUNT': '2.010', 'weapon3': '2.744', 'DAMAGECOUNT': '7.875', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:36,791][52662] DAMAGECOUNT value on done: 43705.0 [2024-08-05 23:31:36,791][52662] Sum rewards: 27.355, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.694', 'AMMO2': '0.021', 'weapon4': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.918', 'ARMOR': '1.270', 'WEAPON3': '1.350', 'HITCOUNT': '1.910', 'weapon3': '2.772', 'DAMAGECOUNT': '8.232', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:37,041][52820] DAMAGECOUNT value on done: 35096.0 [2024-08-05 23:31:37,045][52820] Sum rewards: 33.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.828', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO3': '0.177', 'AMMO4': '0.186', 'weapon4': '0.208', 'WEAPON4': '0.350', 'ARMOR': '0.464', 'weapon2': '0.954', 'WEAPON3': '1.250', 'HITCOUNT': '2.300', 'weapon3': '2.412', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 127868928. Throughput: 0: 4374.9. Samples: 31970930. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:31:37,794][52567] Avg episode reward: [(0, '30.291')] [2024-08-05 23:31:37,907][52668] DAMAGECOUNT value on done: 37874.0 [2024-08-05 23:31:37,909][52668] Sum rewards: 35.475, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.182', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'ARMOR': '0.460', 'weapon2': '0.994', 'WEAPON3': '1.100', 'HITCOUNT': '2.330', 'weapon3': '2.628', 'DAMAGECOUNT': '9.909', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:37,967][52664] DAMAGECOUNT value on done: 41770.0 [2024-08-05 23:31:37,967][52664] Sum rewards: 33.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.253', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'weapon4': '0.616', 'weapon2': '0.848', 'ARMOR': '0.911', 'WEAPON3': '0.950', 'weapon3': '2.078', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '8.343', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:37,986][52794] DAMAGECOUNT value on done: 42860.0 [2024-08-05 23:31:37,989][52794] Sum rewards: 26.445, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.485', 'weapon2': '0.856', 'WEAPON3': '1.050', 'HITCOUNT': '1.650', 'weapon3': '1.660', 'DAMAGECOUNT': '6.969', 'FRAGCOUNT': '24.000'} [2024-08-05 23:31:38,529][52660] DAMAGECOUNT value on done: 37904.0 [2024-08-05 23:31:38,529][52660] Sum rewards: 24.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'AMMO2': '0.023', 'ARMOR': '0.030', 'AMMO4': '0.112', 'weapon5': '0.148', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.604', 'weapon4': '0.630', 'WEAPON3': '0.950', 'HITCOUNT': '1.930', 'weapon3': '2.244', 'DAMAGECOUNT': '7.539', 'FRAGCOUNT': '21.000'} [2024-08-05 23:31:38,757][52650] Updated weights for policy 0, policy_version 15611 (0.0011) [2024-08-05 23:31:39,808][52662] DAMAGECOUNT value on done: 41739.0 [2024-08-05 23:31:39,808][52662] Sum rewards: 36.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.097', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'ARMOR': '0.812', 'weapon2': '1.082', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.676', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '32.000'} [2024-08-05 23:31:40,378][52820] DAMAGECOUNT value on done: 35891.0 [2024-08-05 23:31:40,381][52820] Sum rewards: 42.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.706', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.704', 'ARMOR': '0.877', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.892', 'DAMAGECOUNT': '9.924', 'FRAGCOUNT': '36.000'} [2024-08-05 23:31:40,675][52664] DAMAGECOUNT value on done: 39306.0 [2024-08-05 23:31:40,676][52664] Sum rewards: 22.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.579', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon4': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'WEAPON3': '1.150', 'weapon2': '1.278', 'HITCOUNT': '1.820', 'weapon3': '2.122', 'DAMAGECOUNT': '7.206', 'FRAGCOUNT': '19.000'} [2024-08-05 23:31:40,761][52794] DAMAGECOUNT value on done: 43759.0 [2024-08-05 23:31:40,761][52794] Sum rewards: 33.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.146', 'weapon5': '0.150', 'weapon4': '0.238', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'ARMOR': '1.004', 'weapon2': '1.102', 'weapon3': '2.250', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:41,105][52668] DAMAGECOUNT value on done: 37132.0 [2024-08-05 23:31:41,106][52668] Sum rewards: 26.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.915', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.116', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon2': '1.208', 'HITCOUNT': '2.240', 'weapon3': '2.494', 'DAMAGECOUNT': '8.505', 'FRAGCOUNT': '24.000'} [2024-08-05 23:31:41,762][52660] DAMAGECOUNT value on done: 37866.0 [2024-08-05 23:31:41,763][52660] Sum rewards: 28.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.746', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.044', 'weapon4': '0.084', 'AMMO4': '0.173', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon2': '0.656', 'WEAPON3': '1.200', 'HITCOUNT': '2.050', 'weapon3': '2.864', 'DAMAGECOUNT': '8.094', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:42,390][52662] DAMAGECOUNT value on done: 41810.0 [2024-08-05 23:31:42,390][52662] Sum rewards: 29.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.348', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.396', 'weapon2': '1.192', 'WEAPON3': '1.350', 'ARMOR': '1.353', 'weapon3': '2.118', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '26.000'} [2024-08-05 23:31:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 127959040. Throughput: 0: 4368.5. Samples: 31996910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:31:42,794][52567] Avg episode reward: [(0, '30.214')] [2024-08-05 23:31:43,279][52664] DAMAGECOUNT value on done: 36913.0 [2024-08-05 23:31:43,280][52664] Sum rewards: 36.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.556', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.352', 'ARMOR': '0.432', 'weapon2': '1.074', 'WEAPON3': '1.250', 'weapon3': '2.328', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.354', 'FRAGCOUNT': '31.000'} [2024-08-05 23:31:43,371][52650] Updated weights for policy 0, policy_version 15621 (0.0013) [2024-08-05 23:31:43,432][52794] DAMAGECOUNT value on done: 43355.0 [2024-08-05 23:31:43,434][52794] Sum rewards: 31.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.062', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.210', 'weapon4': '0.442', 'WEAPON4': '0.500', 'weapon2': '0.708', 'ARMOR': '0.880', 'WEAPON3': '1.050', 'HITCOUNT': '2.180', 'weapon3': '2.570', 'DAMAGECOUNT': '9.384', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:43,727][52820] DAMAGECOUNT value on done: 36051.0 [2024-08-05 23:31:43,730][52820] Sum rewards: 24.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.418', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.450', 'weapon4': '0.478', 'ARMOR': '0.909', 'weapon2': '0.912', 'WEAPON3': '1.500', 'HITCOUNT': '2.040', 'weapon3': '2.234', 'DAMAGECOUNT': '7.998', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:44,312][52668] DAMAGECOUNT value on done: 37477.0 [2024-08-05 23:31:44,314][52668] Sum rewards: 38.216, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.457', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.152', 'AMMO4': '0.155', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'ARMOR': '0.412', 'weapon2': '0.812', 'WEAPON3': '1.250', 'HITCOUNT': '2.310', 'weapon3': '2.690', 'DAMAGECOUNT': '9.216', 'FRAGCOUNT': '34.000'} [2024-08-05 23:31:44,942][52660] DAMAGECOUNT value on done: 36803.0 [2024-08-05 23:31:44,950][52660] Sum rewards: 24.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.538', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.016', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON3': '1.250', 'weapon2': '1.274', 'ARMOR': '1.373', 'HITCOUNT': '1.890', 'weapon3': '2.372', 'DAMAGECOUNT': '7.458', 'FRAGCOUNT': '21.000'} [2024-08-05 23:31:46,290][52664] DAMAGECOUNT value on done: 43415.0 [2024-08-05 23:31:46,290][52664] Sum rewards: 31.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.346', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.554', 'weapon2': '0.836', 'ARMOR': '0.864', 'WEAPON3': '1.250', 'weapon3': '2.270', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.305', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:46,843][52820] DAMAGECOUNT value on done: 34978.0 [2024-08-05 23:31:46,844][52820] Sum rewards: 33.328, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.068', 'AMMO2': '0.011', 'AMMO5': '0.019', 'AMMO4': '0.053', 'weapon5': '0.094', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.532', 'weapon2': '0.900', 'WEAPON3': '1.250', 'ARMOR': '1.361', 'weapon3': '2.192', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '9.570', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:47,193][52668] DAMAGECOUNT value on done: 36565.0 [2024-08-05 23:31:47,195][52668] Sum rewards: 34.368, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'ARMOR': '0.048', 'AMMO2': '0.049', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.246', 'WEAPON4': '0.400', 'HEALTH': '0.406', 'weapon4': '0.428', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '2.410', 'weapon3': '2.586', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:47,610][52660] DAMAGECOUNT value on done: 38537.0 [2024-08-05 23:31:47,612][52660] Sum rewards: 36.693, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'HEALTH': '0.042', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon4': '0.206', 'ARMOR': '0.852', 'WEAPON3': '0.950', 'weapon2': '1.068', 'HITCOUNT': '2.210', 'weapon3': '2.384', 'DAMAGECOUNT': '10.089', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 128040960. Throughput: 0: 4383.4. Samples: 32010310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:31:47,794][52567] Avg episode reward: [(0, '30.524')] [2024-08-05 23:31:48,023][52650] Updated weights for policy 0, policy_version 15631 (0.0023) [2024-08-05 23:31:48,671][52669] DAMAGECOUNT value on done: 39725.0 [2024-08-05 23:31:48,673][52669] Sum rewards: 41.212, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.039', 'weapon5': '0.064', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.258', 'HEALTH': '0.397', 'WEAPON3': '0.700', 'ARMOR': '0.832', 'weapon2': '0.944', 'weapon3': '2.150', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '30.000'} [2024-08-05 23:31:49,200][52664] DAMAGECOUNT value on done: 39168.0 [2024-08-05 23:31:49,201][52664] Sum rewards: 26.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.278', 'WEAPON4': '0.350', 'ARMOR': '0.848', 'WEAPON3': '0.850', 'weapon2': '1.256', 'HITCOUNT': '1.890', 'weapon3': '2.174', 'DAMAGECOUNT': '6.915', 'FRAGCOUNT': '24.000'} [2024-08-05 23:31:49,811][52668] DAMAGECOUNT value on done: 35852.0 [2024-08-05 23:31:49,812][52668] Sum rewards: 27.955, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.326', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO3': '0.122', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.422', 'ARMOR': '0.495', 'weapon2': '0.874', 'WEAPON3': '0.900', 'HITCOUNT': '1.850', 'weapon3': '2.184', 'DAMAGECOUNT': '7.164', 'FRAGCOUNT': '22.000'} [2024-08-05 23:31:50,023][52820] DAMAGECOUNT value on done: 38002.0 [2024-08-05 23:31:50,024][52820] Sum rewards: 29.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.114', 'AMMO5': '0.022', 'weapon5': '0.050', 'AMMO2': '0.067', 'AMMO3': '0.212', 'AMMO4': '0.337', 'WEAPON5': '0.500', 'weapon4': '0.582', 'WEAPON4': '0.650', 'weapon2': '0.806', 'ARMOR': '0.948', 'WEAPON3': '1.300', 'weapon3': '2.196', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '8.589', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:50,212][52660] DAMAGECOUNT value on done: 41671.0 [2024-08-05 23:31:50,214][52660] Sum rewards: 40.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.383', 'AMMO5': '0.012', 'AMMO2': '0.054', 'ARMOR': '0.096', 'AMMO3': '0.122', 'weapon5': '0.176', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.740', 'weapon4': '0.798', 'WEAPON3': '0.850', 'weapon3': '1.986', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.744', 'FRAGCOUNT': '34.500'} [2024-08-05 23:31:51,631][52669] DAMAGECOUNT value on done: 38539.0 [2024-08-05 23:31:51,631][52669] Sum rewards: 15.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.473', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'AMMO4': '0.181', 'weapon4': '0.370', 'WEAPON4': '0.450', 'ARMOR': '0.497', 'weapon2': '0.710', 'WEAPON3': '1.200', 'HITCOUNT': '1.620', 'weapon3': '2.424', 'DAMAGECOUNT': '6.747', 'FRAGCOUNT': '14.500'} [2024-08-05 23:31:52,408][52664] DAMAGECOUNT value on done: 41523.0 [2024-08-05 23:31:52,411][52664] Sum rewards: 30.813, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.753', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.089', 'weapon4': '0.126', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'ARMOR': '1.282', 'weapon2': '1.348', 'HITCOUNT': '2.080', 'weapon3': '2.228', 'DAMAGECOUNT': '8.388', 'FRAGCOUNT': '25.000'} [2024-08-05 23:31:52,435][52668] DAMAGECOUNT value on done: 38743.0 [2024-08-05 23:31:52,438][52668] Sum rewards: 37.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.910', 'weapon2': '0.986', 'WEAPON3': '1.350', 'HITCOUNT': '2.290', 'weapon3': '2.540', 'DAMAGECOUNT': '9.441', 'FRAGCOUNT': '34.000'} [2024-08-05 23:31:52,498][52650] Updated weights for policy 0, policy_version 15641 (0.0016) [2024-08-05 23:31:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 128131072. Throughput: 0: 4381.6. Samples: 32036620. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:31:52,794][52567] Avg episode reward: [(0, '30.704')] [2024-08-05 23:31:52,795][52614] Saving new best policy, reward=30.704! [2024-08-05 23:31:53,290][52820] DAMAGECOUNT value on done: 38689.0 [2024-08-05 23:31:53,290][52820] Sum rewards: 32.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.946', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.169', 'ARMOR': '0.437', 'weapon2': '0.922', 'WEAPON3': '1.200', 'HITCOUNT': '2.290', 'weapon3': '2.724', 'DAMAGECOUNT': '9.534', 'FRAGCOUNT': '27.000'} [2024-08-05 23:31:53,337][52660] DAMAGECOUNT value on done: 38130.0 [2024-08-05 23:31:53,340][52660] Sum rewards: 31.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.043', 'ARMOR': '0.064', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.213', 'weapon4': '0.320', 'WEAPON4': '0.550', 'weapon2': '0.648', 'WEAPON3': '1.350', 'HITCOUNT': '2.240', 'weapon3': '2.598', 'DAMAGECOUNT': '9.129', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:55,093][52664] DAMAGECOUNT value on done: 37765.0 [2024-08-05 23:31:55,094][52664] Sum rewards: 24.588, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.586', 'weapon5': '0.006', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.450', 'ARMOR': '1.000', 'WEAPON3': '1.100', 'weapon2': '1.204', 'HITCOUNT': '1.950', 'weapon3': '2.270', 'DAMAGECOUNT': '7.830', 'FRAGCOUNT': '21.000'} [2024-08-05 23:31:55,212][52669] DAMAGECOUNT value on done: 37760.0 [2024-08-05 23:31:55,215][52669] Sum rewards: 31.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.030', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.238', 'ARMOR': '0.836', 'WEAPON3': '1.200', 'weapon2': '1.254', 'weapon3': '2.098', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.114', 'FRAGCOUNT': '29.000'} [2024-08-05 23:31:55,346][52668] DAMAGECOUNT value on done: 41152.0 [2024-08-05 23:31:55,347][52668] Sum rewards: 42.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.219', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '1.066', 'WEAPON3': '1.150', 'ARMOR': '1.253', 'HITCOUNT': '2.470', 'weapon3': '2.614', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '35.000'} [2024-08-05 23:31:55,909][52660] DAMAGECOUNT value on done: 39326.0 [2024-08-05 23:31:55,909][52660] Sum rewards: 23.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.202', 'ARMOR': '0.456', 'weapon2': '1.006', 'WEAPON3': '1.200', 'HITCOUNT': '1.660', 'weapon3': '2.588', 'DAMAGECOUNT': '6.516', 'FRAGCOUNT': '23.000'} [2024-08-05 23:31:56,526][52820] DAMAGECOUNT value on done: 36536.0 [2024-08-05 23:31:56,526][52820] Sum rewards: 30.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.244', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon2': '1.242', 'ARMOR': '1.334', 'HITCOUNT': '2.070', 'weapon3': '2.492', 'DAMAGECOUNT': '8.133', 'FRAGCOUNT': '28.000'} [2024-08-05 23:31:57,435][52650] Updated weights for policy 0, policy_version 15651 (0.0022) [2024-08-05 23:31:57,670][52664] DAMAGECOUNT value on done: 39971.0 [2024-08-05 23:31:57,672][52664] Sum rewards: 40.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.273', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.198', 'WEAPON4': '0.200', 'ARMOR': '0.869', 'weapon2': '0.918', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.588', 'DAMAGECOUNT': '9.582', 'FRAGCOUNT': '35.000'} [2024-08-05 23:31:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 128221184. Throughput: 0: 4384.4. Samples: 32062800. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 23:31:57,794][52567] Avg episode reward: [(0, '30.746')] [2024-08-05 23:31:57,797][52614] Saving new best policy, reward=30.746! [2024-08-05 23:31:58,467][52669] DAMAGECOUNT value on done: 37985.0 [2024-08-05 23:31:58,468][52669] Sum rewards: 18.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.322', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.888', 'WEAPON3': '1.150', 'weapon2': '1.232', 'HITCOUNT': '1.590', 'weapon3': '2.094', 'DAMAGECOUNT': '6.621', 'FRAGCOUNT': '17.000'} [2024-08-05 23:31:58,526][52660] DAMAGECOUNT value on done: 38621.0 [2024-08-05 23:31:58,527][52660] Sum rewards: 25.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.366', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.142', 'AMMO4': '0.154', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'ARMOR': '1.284', 'weapon2': '1.350', 'HITCOUNT': '1.960', 'weapon3': '2.340', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '20.000'} [2024-08-05 23:31:58,708][52671] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:31:59,029][52649] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:32:00,597][52669] DAMAGECOUNT value on done: 40238.0 [2024-08-05 23:32:00,598][52669] Sum rewards: 34.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.622', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.178', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.150', 'weapon3': '2.372', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:00,911][52664] DAMAGECOUNT value on done: 39248.0 [2024-08-05 23:32:00,911][52664] Sum rewards: 38.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.132', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.802', 'ARMOR': '0.844', 'WEAPON3': '1.450', 'HITCOUNT': '2.590', 'weapon3': '2.886', 'DAMAGECOUNT': '10.869', 'FRAGCOUNT': '34.000'} [2024-08-05 23:32:01,546][52660] DAMAGECOUNT value on done: 39060.0 [2024-08-05 23:32:01,547][52660] Sum rewards: 29.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.933', 'AMMO5': '0.019', 'weapon5': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.241', 'AMMO4': '0.278', 'weapon4': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon2': '1.020', 'ARMOR': '1.325', 'WEAPON3': '1.550', 'HITCOUNT': '2.220', 'weapon3': '2.354', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '27.500'} [2024-08-05 23:32:01,876][52650] Updated weights for policy 0, policy_version 15661 (0.0016) [2024-08-05 23:32:02,292][52667] DAMAGECOUNT value on done: 39014.0 [2024-08-05 23:32:02,293][52667] Sum rewards: 29.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.118', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.103', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.400', 'ARMOR': '0.487', 'weapon2': '1.120', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '2.438', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '28.500'} [2024-08-05 23:32:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 128303104. Throughput: 0: 4382.9. Samples: 32075680. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 23:32:02,794][52567] Avg episode reward: [(0, '30.770')] [2024-08-05 23:32:02,795][52614] Saving new best policy, reward=30.770! [2024-08-05 23:32:03,552][52669] DAMAGECOUNT value on done: 40940.0 [2024-08-05 23:32:03,553][52669] Sum rewards: 29.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.202', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.152', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'AMMO4': '0.296', 'ARMOR': '0.436', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon2': '1.272', 'HITCOUNT': '2.190', 'weapon3': '2.346', 'DAMAGECOUNT': '8.067', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:04,047][52664] DAMAGECOUNT value on done: 42106.0 [2024-08-05 23:32:04,048][52664] Sum rewards: 42.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.190', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.186', 'ARMOR': '0.954', 'WEAPON3': '1.050', 'weapon2': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.548', 'DAMAGECOUNT': '10.449', 'FRAGCOUNT': '36.000'} [2024-08-05 23:32:04,566][52660] DAMAGECOUNT value on done: 38010.0 [2024-08-05 23:32:04,569][52660] Sum rewards: 40.493, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.022', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.028', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.756', 'WEAPON3': '1.050', 'weapon3': '2.564', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '10.947', 'FRAGCOUNT': '32.000'} [2024-08-05 23:32:05,713][52667] DAMAGECOUNT value on done: 40047.0 [2024-08-05 23:32:05,714][52667] Sum rewards: 25.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.788', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'AMMO4': '0.214', 'weapon4': '0.224', 'WEAPON4': '0.450', 'ARMOR': '0.860', 'weapon2': '1.100', 'WEAPON3': '1.250', 'HITCOUNT': '1.930', 'weapon3': '2.264', 'DAMAGECOUNT': '7.968', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:05,966][52669] DAMAGECOUNT value on done: 39473.0 [2024-08-05 23:32:05,968][52669] Sum rewards: 30.420, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.227', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.008', 'weapon5': '0.036', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon2': '0.940', 'WEAPON3': '1.050', 'ARMOR': '1.293', 'HITCOUNT': '1.840', 'weapon3': '2.792', 'DAMAGECOUNT': '7.737', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:06,981][52650] Updated weights for policy 0, policy_version 15671 (0.0034) [2024-08-05 23:32:06,986][52664] DAMAGECOUNT value on done: 37614.0 [2024-08-05 23:32:06,988][52664] Sum rewards: 30.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.084', 'AMMO5': '0.007', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'ARMOR': '0.080', 'AMMO3': '0.207', 'AMMO4': '0.248', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.692', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.578', 'DAMAGECOUNT': '8.868', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 128393216. Throughput: 0: 4372.7. Samples: 32101470. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:32:07,794][52567] Avg episode reward: [(0, '30.891')] [2024-08-05 23:32:07,798][52614] Saving new best policy, reward=30.891! [2024-08-05 23:32:08,264][52665] DAMAGECOUNT value on done: 37653.0 [2024-08-05 23:32:08,265][52665] Sum rewards: 42.154, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.336', 'weapon7': '0.002', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.128', 'AMMO4': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.318', 'WEAPON4': '0.500', 'weapon2': '0.998', 'WEAPON3': '1.000', 'ARMOR': '1.352', 'weapon3': '2.344', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:08,385][52667] DAMAGECOUNT value on done: 38421.0 [2024-08-05 23:32:08,388][52667] Sum rewards: 19.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.120', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.806', 'ARMOR': '0.872', 'WEAPON3': '1.400', 'HITCOUNT': '1.930', 'weapon3': '2.540', 'DAMAGECOUNT': '7.878', 'FRAGCOUNT': '20.500'} [2024-08-05 23:32:08,599][52669] DAMAGECOUNT value on done: 38516.0 [2024-08-05 23:32:08,601][52669] Sum rewards: 31.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.182', 'weapon4': '0.330', 'WEAPON4': '0.450', 'ARMOR': '0.882', 'weapon2': '1.128', 'WEAPON3': '1.200', 'HITCOUNT': '2.260', 'weapon3': '2.304', 'DAMAGECOUNT': '8.937', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:08,660][52803] DAMAGECOUNT value on done: 37153.0 [2024-08-05 23:32:08,660][52803] Sum rewards: 28.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.028', 'AMMO3': '0.137', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.542', 'ARMOR': '0.894', 'weapon2': '0.944', 'WEAPON3': '0.950', 'HITCOUNT': '2.060', 'weapon3': '2.212', 'DAMAGECOUNT': '7.749', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:09,445][52664] DAMAGECOUNT value on done: 40185.0 [2024-08-05 23:32:09,445][52664] Sum rewards: 36.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.080', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'weapon5': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'ARMOR': '0.898', 'weapon2': '0.994', 'WEAPON3': '1.000', 'HITCOUNT': '2.220', 'weapon3': '2.550', 'DAMAGECOUNT': '9.144', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:11,370][52665] DAMAGECOUNT value on done: 39873.0 [2024-08-05 23:32:11,371][52665] Sum rewards: 38.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.092', 'weapon4': '0.102', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'ARMOR': '0.454', 'weapon2': '0.686', 'WEAPON3': '1.550', 'HITCOUNT': '2.480', 'weapon3': '2.802', 'DAMAGECOUNT': '10.812', 'FRAGCOUNT': '37.000'} [2024-08-05 23:32:11,442][52667] DAMAGECOUNT value on done: 39044.0 [2024-08-05 23:32:11,444][52667] Sum rewards: 26.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.652', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.176', 'weapon5': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.382', 'ARMOR': '0.518', 'weapon2': '0.898', 'WEAPON3': '1.200', 'HITCOUNT': '1.860', 'weapon3': '2.230', 'DAMAGECOUNT': '8.244', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:11,509][52650] Updated weights for policy 0, policy_version 15681 (0.0028) [2024-08-05 23:32:11,733][52803] DAMAGECOUNT value on done: 38922.0 [2024-08-05 23:32:11,736][52803] Sum rewards: 28.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.038', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.227', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.916', 'WEAPON3': '1.300', 'HITCOUNT': '2.200', 'weapon3': '2.468', 'DAMAGECOUNT': '8.361', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:11,774][52669] DAMAGECOUNT value on done: 38837.0 [2024-08-05 23:32:11,776][52669] Sum rewards: 31.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.828', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.142', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.364', 'ARMOR': '0.903', 'WEAPON3': '1.100', 'weapon2': '1.100', 'weapon3': '2.056', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '8.655', 'FRAGCOUNT': '28.500'} [2024-08-05 23:32:12,260][52664] DAMAGECOUNT value on done: 39589.0 [2024-08-05 23:32:12,262][52664] Sum rewards: 41.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.205', 'ARMOR': '0.519', 'weapon2': '0.948', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '2.690', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '37.000'} [2024-08-05 23:32:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 128475136. Throughput: 0: 4368.0. Samples: 32127730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:32:12,794][52567] Avg episode reward: [(0, '31.144')] [2024-08-05 23:32:12,795][52614] Saving new best policy, reward=31.144! [2024-08-05 23:32:14,018][52665] DAMAGECOUNT value on done: 39917.0 [2024-08-05 23:32:14,018][52665] Sum rewards: 27.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.876', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.442', 'weapon2': '0.960', 'WEAPON3': '1.200', 'HITCOUNT': '2.100', 'weapon3': '2.340', 'DAMAGECOUNT': '7.926', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:14,689][52669] DAMAGECOUNT value on done: 36878.0 [2024-08-05 23:32:14,690][52669] Sum rewards: 26.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.110', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.638', 'ARMOR': '0.924', 'WEAPON3': '1.350', 'HITCOUNT': '1.920', 'weapon3': '2.558', 'DAMAGECOUNT': '8.112', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:14,729][52803] DAMAGECOUNT value on done: 35682.0 [2024-08-05 23:32:14,730][52803] Sum rewards: 39.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.353', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'ARMOR': '0.898', 'weapon2': '0.940', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '2.864', 'DAMAGECOUNT': '9.348', 'FRAGCOUNT': '34.000'} [2024-08-05 23:32:14,767][52667] DAMAGECOUNT value on done: 39129.0 [2024-08-05 23:32:14,767][52667] Sum rewards: 32.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.704', 'AMMO2': '0.010', 'weapon4': '0.020', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.256', 'HITCOUNT': '2.050', 'weapon3': '2.306', 'DAMAGECOUNT': '8.439', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:15,535][52664] DAMAGECOUNT value on done: 40833.0 [2024-08-05 23:32:15,535][52664] Sum rewards: 29.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.922', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.066', 'AMMO4': '0.139', 'AMMO3': '0.215', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.941', 'weapon2': '1.082', 'WEAPON3': '1.350', 'HITCOUNT': '2.100', 'weapon3': '2.284', 'DAMAGECOUNT': '8.817', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:16,108][52650] Updated weights for policy 0, policy_version 15691 (0.0011) [2024-08-05 23:32:16,688][52665] DAMAGECOUNT value on done: 39229.0 [2024-08-05 23:32:16,690][52665] Sum rewards: 37.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.074', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon2': '1.052', 'WEAPON3': '1.350', 'ARMOR': '1.815', 'HITCOUNT': '2.100', 'weapon3': '2.636', 'DAMAGECOUNT': '9.537', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:17,023][52811] DAMAGECOUNT value on done: 37274.0 [2024-08-05 23:32:17,023][52811] Sum rewards: 24.438, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.189', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.194', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.990', 'WEAPON3': '1.500', 'HITCOUNT': '2.170', 'weapon3': '2.526', 'DAMAGECOUNT': '7.824', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:17,234][52669] DAMAGECOUNT value on done: 39298.0 [2024-08-05 23:32:17,236][52669] Sum rewards: 29.110, reward structure: {'DEATHCOUNT': '-12.750', 'weapon5': '0.008', 'AMMO5': '0.010', 'HEALTH': '0.036', 'AMMO2': '0.040', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '0.850', 'weapon2': '0.972', 'ARMOR': '1.236', 'HITCOUNT': '2.090', 'weapon3': '2.362', 'DAMAGECOUNT': '7.818', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:17,495][52667] DAMAGECOUNT value on done: 41186.0 [2024-08-05 23:32:17,496][52667] Sum rewards: 24.802, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.383', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.068', 'AMMO3': '0.147', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.400', 'ARMOR': '0.436', 'WEAPON3': '0.950', 'weapon2': '1.298', 'HITCOUNT': '1.770', 'weapon3': '2.002', 'DAMAGECOUNT': '7.092', 'FRAGCOUNT': '21.000'} [2024-08-05 23:32:17,713][52803] DAMAGECOUNT value on done: 35478.0 [2024-08-05 23:32:17,714][52803] Sum rewards: 27.437, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.332', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.121', 'weapon5': '0.144', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.416', 'weapon4': '0.572', 'WEAPON3': '0.750', 'weapon2': '1.058', 'weapon3': '1.820', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '7.611', 'FRAGCOUNT': '20.000'} [2024-08-05 23:32:17,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 128565248. Throughput: 0: 4366.9. Samples: 32140690. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:32:17,795][52567] Avg episode reward: [(0, '30.837')] [2024-08-05 23:32:18,292][52664] DAMAGECOUNT value on done: 39953.0 [2024-08-05 23:32:18,292][52664] Sum rewards: 25.505, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.128', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.156', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.500', 'ARMOR': '0.858', 'WEAPON3': '1.150', 'weapon2': '1.298', 'HITCOUNT': '1.970', 'weapon3': '2.030', 'DAMAGECOUNT': '8.328', 'FRAGCOUNT': '22.000'} [2024-08-05 23:32:19,715][52665] DAMAGECOUNT value on done: 37049.0 [2024-08-05 23:32:19,715][52665] Sum rewards: 26.988, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.089', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.026', 'weapon4': '0.044', 'AMMO4': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'ARMOR': '1.328', 'weapon2': '1.590', 'HITCOUNT': '1.940', 'weapon3': '2.156', 'DAMAGECOUNT': '7.533', 'FRAGCOUNT': '24.000'} [2024-08-05 23:32:20,003][52669] DAMAGECOUNT value on done: 40473.0 [2024-08-05 23:32:20,004][52669] Sum rewards: 26.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.262', 'ARMOR': '0.481', 'WEAPON3': '1.000', 'weapon2': '1.066', 'HITCOUNT': '2.070', 'weapon3': '2.302', 'DAMAGECOUNT': '7.227', 'FRAGCOUNT': '24.500'} [2024-08-05 23:32:20,325][52811] DAMAGECOUNT value on done: 35491.0 [2024-08-05 23:32:20,325][52811] Sum rewards: 28.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'AMMO4': '0.140', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon2': '1.260', 'ARMOR': '1.327', 'weapon3': '2.224', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:20,594][52667] DAMAGECOUNT value on done: 39806.0 [2024-08-05 23:32:20,596][52667] Sum rewards: 34.502, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.123', 'weapon4': '0.158', 'WEAPON4': '0.300', 'ARMOR': '0.888', 'WEAPON3': '0.950', 'weapon2': '1.368', 'HITCOUNT': '2.180', 'weapon3': '2.212', 'DAMAGECOUNT': '9.267', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:20,806][52803] DAMAGECOUNT value on done: 39175.0 [2024-08-05 23:32:20,810][52803] Sum rewards: 19.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.101', 'AMMO3': '0.145', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.540', 'WEAPON3': '0.950', 'weapon2': '1.178', 'HITCOUNT': '1.480', 'weapon3': '2.338', 'DAMAGECOUNT': '6.507', 'FRAGCOUNT': '16.500'} [2024-08-05 23:32:20,907][52650] Updated weights for policy 0, policy_version 15701 (0.0013) [2024-08-05 23:32:21,464][52666] DAMAGECOUNT value on done: 36239.0 [2024-08-05 23:32:21,467][52666] Sum rewards: 28.734, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.568', 'AMMO2': '0.027', 'AMMO3': '0.125', 'AMMO4': '0.135', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '0.900', 'ARMOR': '1.378', 'weapon2': '1.396', 'HITCOUNT': '1.920', 'weapon3': '2.074', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '24.000'} [2024-08-05 23:32:22,496][52665] DAMAGECOUNT value on done: 36744.0 [2024-08-05 23:32:22,500][52665] Sum rewards: 22.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.280', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO4': '0.179', 'AMMO3': '0.211', 'WEAPON4': '0.500', 'ARMOR': '0.883', 'weapon2': '1.086', 'WEAPON3': '1.400', 'HITCOUNT': '1.840', 'weapon3': '2.438', 'DAMAGECOUNT': '7.611', 'FRAGCOUNT': '22.000'} [2024-08-05 23:32:22,764][52669] DAMAGECOUNT value on done: 37449.0 [2024-08-05 23:32:22,765][52669] Sum rewards: 20.716, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.113', 'weapon4': '0.140', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'ARMOR': '0.855', 'weapon2': '1.344', 'HITCOUNT': '1.710', 'weapon3': '2.000', 'DAMAGECOUNT': '7.356', 'FRAGCOUNT': '16.000'} [2024-08-05 23:32:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 128655360. Throughput: 0: 4357.1. Samples: 32167000. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:32:22,794][52567] Avg episode reward: [(0, '30.420')] [2024-08-05 23:32:23,298][52811] DAMAGECOUNT value on done: 37919.0 [2024-08-05 23:32:23,302][52811] Sum rewards: 30.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.270', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.062', 'weapon3': '2.034', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '8.235', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:23,713][52667] DAMAGECOUNT value on done: 38224.0 [2024-08-05 23:32:23,713][52667] Sum rewards: 29.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.628', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'ARMOR': '0.490', 'weapon2': '0.724', 'WEAPON3': '1.600', 'HITCOUNT': '2.210', 'weapon3': '3.046', 'DAMAGECOUNT': '8.835', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:23,720][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:32:23,957][52803] DAMAGECOUNT value on done: 34222.0 [2024-08-05 23:32:23,958][52803] Sum rewards: 37.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.422', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.076', 'AMMO4': '0.170', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.366', 'ARMOR': '0.498', 'WEAPON4': '0.550', 'weapon2': '1.032', 'WEAPON3': '1.350', 'HITCOUNT': '1.960', 'weapon3': '2.192', 'DAMAGECOUNT': '8.757', 'FRAGCOUNT': '34.000'} [2024-08-05 23:32:24,566][52666] DAMAGECOUNT value on done: 38569.0 [2024-08-05 23:32:24,567][52666] Sum rewards: 35.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.040', 'weapon7': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.682', 'ARMOR': '0.820', 'WEAPON3': '0.950', 'weapon2': '0.986', 'weapon3': '1.960', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '8.811', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:25,265][52665] DAMAGECOUNT value on done: 40622.0 [2024-08-05 23:32:25,266][52665] Sum rewards: 38.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.009', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.246', 'ARMOR': '0.455', 'weapon2': '0.590', 'WEAPON3': '1.650', 'HITCOUNT': '2.780', 'weapon3': '3.202', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '36.000'} [2024-08-05 23:32:25,386][52650] Updated weights for policy 0, policy_version 15711 (0.0034) [2024-08-05 23:32:25,673][52669] DAMAGECOUNT value on done: 39873.0 [2024-08-05 23:32:25,675][52669] Sum rewards: 38.213, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'ARMOR': '0.440', 'weapon2': '0.852', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '2.880', 'DAMAGECOUNT': '10.059', 'FRAGCOUNT': '32.000'} [2024-08-05 23:32:26,459][52811] DAMAGECOUNT value on done: 35864.0 [2024-08-05 23:32:26,459][52811] Sum rewards: 26.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.561', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.456', 'weapon2': '0.822', 'ARMOR': '0.881', 'WEAPON3': '1.150', 'HITCOUNT': '1.800', 'weapon3': '2.340', 'DAMAGECOUNT': '7.068', 'FRAGCOUNT': '24.000'} [2024-08-05 23:32:26,662][52667] DAMAGECOUNT value on done: 40024.0 [2024-08-05 23:32:26,665][52667] Sum rewards: 29.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.628', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.064', 'AMMO4': '0.136', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.438', 'ARMOR': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.010', 'weapon3': '2.898', 'DAMAGECOUNT': '7.812', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:27,048][52803] DAMAGECOUNT value on done: 39390.0 [2024-08-05 23:32:27,050][52803] Sum rewards: 35.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.566', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.690', 'HITCOUNT': '1.910', 'weapon3': '2.026', 'ARMOR': '2.062', 'DAMAGECOUNT': '8.259', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:27,540][52666] DAMAGECOUNT value on done: 37592.0 [2024-08-05 23:32:27,542][52666] Sum rewards: 27.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.876', 'WEAPON3': '1.050', 'weapon2': '1.140', 'HITCOUNT': '2.100', 'weapon3': '2.186', 'DAMAGECOUNT': '8.460', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:27,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 128745472. Throughput: 0: 4368.4. Samples: 32193490. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:32:27,802][52567] Avg episode reward: [(0, '30.559')] [2024-08-05 23:32:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015716_128745472.pth... [2024-08-05 23:32:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015203_124542976.pth [2024-08-05 23:32:28,236][52670] DAMAGECOUNT value on done: 38045.0 [2024-08-05 23:32:28,237][52670] Sum rewards: 23.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.118', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.836', 'ARMOR': '0.874', 'WEAPON3': '1.150', 'HITCOUNT': '1.880', 'weapon3': '2.238', 'DAMAGECOUNT': '7.254', 'FRAGCOUNT': '21.000'} [2024-08-05 23:32:28,328][52669] DAMAGECOUNT value on done: 40049.0 [2024-08-05 23:32:28,331][52669] Sum rewards: 32.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.558', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.036', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON3': '1.050', 'weapon2': '1.106', 'HITCOUNT': '2.490', 'weapon3': '2.562', 'DAMAGECOUNT': '9.795', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:28,665][52665] DAMAGECOUNT value on done: 39886.0 [2024-08-05 23:32:28,666][52665] Sum rewards: 44.376, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.006', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.139', 'weapon4': '0.186', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.316', 'weapon3': '2.356', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.644', 'FRAGCOUNT': '37.000'} [2024-08-05 23:32:29,523][52667] DAMAGECOUNT value on done: 39166.0 [2024-08-05 23:32:29,524][52667] Sum rewards: 28.632, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.485', 'weapon4': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'ARMOR': '0.491', 'weapon2': '0.852', 'WEAPON3': '1.650', 'HITCOUNT': '2.200', 'weapon3': '2.928', 'DAMAGECOUNT': '8.427', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:29,566][52811] DAMAGECOUNT value on done: 35748.0 [2024-08-05 23:32:29,567][52811] Sum rewards: 33.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.484', 'AMMO5': '0.023', 'AMMO2': '0.039', 'weapon5': '0.096', 'AMMO3': '0.171', 'AMMO4': '0.197', 'weapon4': '0.216', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.796', 'ARMOR': '0.853', 'WEAPON3': '1.200', 'HITCOUNT': '2.120', 'weapon3': '2.572', 'DAMAGECOUNT': '8.358', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:30,094][52803] DAMAGECOUNT value on done: 37001.0 [2024-08-05 23:32:30,097][52803] Sum rewards: 31.489, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.120', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.406', 'ARMOR': '0.432', 'weapon2': '0.898', 'WEAPON3': '0.950', 'HITCOUNT': '1.980', 'weapon3': '2.212', 'DAMAGECOUNT': '8.523', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:30,152][52666] DAMAGECOUNT value on done: 35780.0 [2024-08-05 23:32:30,154][52666] Sum rewards: 24.388, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.354', 'AMMO5': '0.010', 'AMMO2': '0.052', 'ARMOR': '0.060', 'AMMO3': '0.149', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.262', 'WEAPON4': '0.500', 'weapon4': '0.772', 'weapon2': '0.788', 'WEAPON3': '0.950', 'weapon3': '1.750', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '22.000'} [2024-08-05 23:32:30,385][52650] Updated weights for policy 0, policy_version 15721 (0.0027) [2024-08-05 23:32:30,794][52670] DAMAGECOUNT value on done: 39712.0 [2024-08-05 23:32:30,795][52670] Sum rewards: 32.415, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.020', 'HEALTH': '0.083', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'ARMOR': '0.412', 'WEAPON3': '0.950', 'weapon2': '0.968', 'HITCOUNT': '2.130', 'weapon3': '2.644', 'DAMAGECOUNT': '7.923', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:31,160][52665] DAMAGECOUNT value on done: 40401.0 [2024-08-05 23:32:31,162][52665] Sum rewards: 35.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.706', 'AMMO2': '0.028', 'ARMOR': '0.044', 'AMMO4': '0.142', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.776', 'WEAPON3': '1.200', 'weapon3': '2.512', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.545', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:31,179][52663] DAMAGECOUNT value on done: 40291.0 [2024-08-05 23:32:31,179][52663] Sum rewards: 30.021, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.411', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.208', 'weapon4': '0.242', 'AMMO3': '0.262', 'ARMOR': '0.502', 'WEAPON4': '0.550', 'weapon2': '1.006', 'WEAPON3': '1.550', 'weapon3': '2.482', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.173', 'FRAGCOUNT': '31.000'} [2024-08-05 23:32:31,470][52669] DAMAGECOUNT value on done: 40778.0 [2024-08-05 23:32:31,472][52669] Sum rewards: 41.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.183', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.832', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '36.000'} [2024-08-05 23:32:31,538][52658] DAMAGECOUNT value on done: 40220.0 [2024-08-05 23:32:31,539][52658] Sum rewards: 28.934, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.214', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.084', 'AMMO3': '0.128', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '1.312', 'weapon2': '1.580', 'HITCOUNT': '1.780', 'weapon3': '2.002', 'DAMAGECOUNT': '7.215', 'FRAGCOUNT': '22.000'} [2024-08-05 23:32:32,431][52667] DAMAGECOUNT value on done: 37627.0 [2024-08-05 23:32:32,432][52667] Sum rewards: 31.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.056', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.906', 'ARMOR': '0.914', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.582', 'DAMAGECOUNT': '8.781', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:32,659][52811] DAMAGECOUNT value on done: 37601.0 [2024-08-05 23:32:32,659][52811] Sum rewards: 29.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.778', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.197', 'weapon4': '0.232', 'WEAPON4': '0.350', 'ARMOR': '0.911', 'weapon2': '1.166', 'WEAPON3': '1.200', 'HITCOUNT': '1.890', 'weapon3': '2.254', 'DAMAGECOUNT': '7.977', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 128827392. Throughput: 0: 4355.8. Samples: 32206320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:32:32,795][52567] Avg episode reward: [(0, '31.096')] [2024-08-05 23:32:32,901][52666] DAMAGECOUNT value on done: 37039.0 [2024-08-05 23:32:32,902][52666] Sum rewards: 31.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.868', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO4': '0.192', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'ARMOR': '0.452', 'WEAPON4': '0.550', 'weapon4': '0.566', 'weapon2': '0.780', 'WEAPON3': '1.300', 'weapon3': '2.212', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '8.310', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:33,093][52803] DAMAGECOUNT value on done: 38852.0 [2024-08-05 23:32:33,093][52803] Sum rewards: 39.246, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO3': '0.149', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.474', 'ARMOR': '0.476', 'weapon2': '0.636', 'HEALTH': '0.804', 'WEAPON3': '0.850', 'HITCOUNT': '2.030', 'weapon3': '2.408', 'DAMAGECOUNT': '9.978', 'FRAGCOUNT': '31.000'} [2024-08-05 23:32:33,427][52670] DAMAGECOUNT value on done: 38796.0 [2024-08-05 23:32:33,427][52670] Sum rewards: 25.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.336', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.214', 'weapon4': '0.220', 'WEAPON4': '0.450', 'ARMOR': '0.453', 'weapon2': '0.844', 'WEAPON3': '1.400', 'HITCOUNT': '2.110', 'weapon3': '2.588', 'DAMAGECOUNT': '8.940', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:33,980][52665] DAMAGECOUNT value on done: 40273.0 [2024-08-05 23:32:33,980][52665] Sum rewards: 35.387, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.454', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.101', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.040', 'HITCOUNT': '2.170', 'weapon3': '2.316', 'DAMAGECOUNT': '9.294', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:34,235][52663] DAMAGECOUNT value on done: 38330.0 [2024-08-05 23:32:34,236][52663] Sum rewards: 16.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.238', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.060', 'weapon4': '0.068', 'AMMO3': '0.180', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'ARMOR': '0.966', 'weapon2': '1.018', 'WEAPON3': '1.200', 'HITCOUNT': '1.480', 'weapon3': '2.464', 'DAMAGECOUNT': '6.198', 'FRAGCOUNT': '17.000'} [2024-08-05 23:32:34,362][52658] DAMAGECOUNT value on done: 38957.0 [2024-08-05 23:32:34,365][52658] Sum rewards: 50.288, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon4': '0.226', 'HEALTH': '0.316', 'weapon2': '0.784', 'WEAPON3': '1.250', 'ARMOR': '1.282', 'weapon3': '2.704', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '43.000'} [2024-08-05 23:32:34,473][52669] DAMAGECOUNT value on done: 40410.0 [2024-08-05 23:32:34,473][52669] Sum rewards: 40.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.773', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.143', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.352', 'ARMOR': '0.400', 'weapon2': '0.938', 'WEAPON3': '1.150', 'weapon3': '2.284', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:34,970][52650] Updated weights for policy 0, policy_version 15731 (0.0011) [2024-08-05 23:32:35,335][52667] DAMAGECOUNT value on done: 37440.0 [2024-08-05 23:32:35,335][52667] Sum rewards: 23.355, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.704', 'AMMO5': '0.005', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'weapon5': '0.156', 'AMMO3': '0.165', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'weapon2': '0.512', 'weapon4': '0.582', 'WEAPON3': '0.950', 'HITCOUNT': '1.530', 'weapon3': '2.004', 'DAMAGECOUNT': '6.405', 'FRAGCOUNT': '21.000'} [2024-08-05 23:32:35,693][52811] DAMAGECOUNT value on done: 38973.0 [2024-08-05 23:32:35,695][52811] Sum rewards: 30.611, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.022', 'ARMOR': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.119', 'weapon5': '0.122', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon4': '0.882', 'weapon2': '0.934', 'weapon3': '1.688', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '7.620', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:35,844][52666] DAMAGECOUNT value on done: 36959.0 [2024-08-05 23:32:35,845][52666] Sum rewards: 35.430, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'HEALTH': '0.300', 'WEAPON3': '0.800', 'weapon2': '0.828', 'weapon4': '0.842', 'HITCOUNT': '1.980', 'weapon3': '2.124', 'DAMAGECOUNT': '8.043', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:36,242][52803] DAMAGECOUNT value on done: 36195.0 [2024-08-05 23:32:36,242][52803] Sum rewards: 38.103, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.616', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.138', 'AMMO4': '0.176', 'weapon4': '0.390', 'WEAPON4': '0.400', 'weapon2': '0.770', 'WEAPON3': '0.950', 'ARMOR': '0.977', 'weapon3': '2.302', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.147', 'FRAGCOUNT': '31.000'} [2024-08-05 23:32:36,465][52614] Signal inference workers to stop experience collection... (2950 times) [2024-08-05 23:32:36,469][52614] Signal inference workers to resume experience collection... (2950 times) [2024-08-05 23:32:36,552][52650] InferenceWorker_p0-w0: stopping experience collection (2950 times) [2024-08-05 23:32:36,552][52650] InferenceWorker_p0-w0: resuming experience collection (2950 times) [2024-08-05 23:32:36,585][52670] DAMAGECOUNT value on done: 38909.0 [2024-08-05 23:32:36,585][52670] Sum rewards: 30.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.044', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO3': '0.133', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.000', 'weapon2': '1.100', 'ARMOR': '1.254', 'weapon3': '2.104', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '8.766', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:37,078][52665] DAMAGECOUNT value on done: 40456.0 [2024-08-05 23:32:37,079][52665] Sum rewards: 27.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.041', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.076', 'AMMO3': '0.163', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.442', 'WEAPON4': '0.500', 'ARMOR': '0.867', 'WEAPON3': '1.050', 'weapon2': '1.088', 'HITCOUNT': '2.030', 'weapon3': '2.096', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '24.500'} [2024-08-05 23:32:37,358][52658] DAMAGECOUNT value on done: 37410.0 [2024-08-05 23:32:37,361][52658] Sum rewards: 41.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.785', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.055', 'weapon4': '0.084', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.468', 'WEAPON3': '1.100', 'weapon2': '1.260', 'HITCOUNT': '2.320', 'weapon3': '2.472', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '35.000'} [2024-08-05 23:32:37,374][52663] DAMAGECOUNT value on done: 39635.0 [2024-08-05 23:32:37,374][52663] Sum rewards: 34.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.876', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.666', 'ARMOR': '0.889', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '2.698', 'DAMAGECOUNT': '9.873', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:37,572][52669] DAMAGECOUNT value on done: 39546.0 [2024-08-05 23:32:37,574][52669] Sum rewards: 21.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO3': '0.180', 'AMMO4': '0.235', 'ARMOR': '0.440', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '1.160', 'WEAPON3': '1.200', 'HITCOUNT': '1.610', 'weapon3': '2.208', 'DAMAGECOUNT': '6.735', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 128917504. Throughput: 0: 4354.0. Samples: 32232550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:32:37,794][52567] Avg episode reward: [(0, '31.421')] [2024-08-05 23:32:37,798][52614] Saving new best policy, reward=31.421! [2024-08-05 23:32:38,346][52667] DAMAGECOUNT value on done: 40709.0 [2024-08-05 23:32:38,346][52667] Sum rewards: 37.433, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.036', 'weapon4': '0.122', 'AMMO4': '0.148', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon2': '1.206', 'ARMOR': '1.294', 'HITCOUNT': '2.180', 'weapon3': '2.394', 'DAMAGECOUNT': '9.315', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:38,577][52666] DAMAGECOUNT value on done: 38192.0 [2024-08-05 23:32:38,579][52666] Sum rewards: 36.134, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.700', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.076', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'ARMOR': '0.428', 'weapon4': '0.578', 'weapon2': '0.834', 'WEAPON3': '0.900', 'HITCOUNT': '2.120', 'weapon3': '2.270', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:38,729][52811] DAMAGECOUNT value on done: 34584.0 [2024-08-05 23:32:38,729][52811] Sum rewards: 31.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.304', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.118', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.408', 'WEAPON3': '0.800', 'weapon2': '1.010', 'HITCOUNT': '1.850', 'weapon3': '2.208', 'DAMAGECOUNT': '7.488', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:39,172][52670] DAMAGECOUNT value on done: 36801.0 [2024-08-05 23:32:39,173][52670] Sum rewards: 29.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.615', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'ARMOR': '0.908', 'weapon2': '1.146', 'WEAPON3': '1.300', 'HITCOUNT': '2.100', 'weapon3': '2.630', 'DAMAGECOUNT': '8.418', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:39,436][52650] Updated weights for policy 0, policy_version 15741 (0.0026) [2024-08-05 23:32:39,571][52803] DAMAGECOUNT value on done: 38735.0 [2024-08-05 23:32:39,575][52803] Sum rewards: 27.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.211', 'weapon4': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.588', 'ARMOR': '0.872', 'WEAPON3': '1.250', 'HITCOUNT': '1.810', 'weapon3': '2.746', 'DAMAGECOUNT': '7.677', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:39,964][52663] DAMAGECOUNT value on done: 39612.0 [2024-08-05 23:32:39,966][52663] Sum rewards: 25.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.523', 'weapon5': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.144', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.262', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon2': '1.100', 'ARMOR': '1.276', 'HITCOUNT': '2.050', 'weapon3': '2.498', 'DAMAGECOUNT': '8.070', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:40,057][52669] DAMAGECOUNT value on done: 37781.0 [2024-08-05 23:32:40,057][52669] Sum rewards: 37.105, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'HEALTH': '0.012', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.074', 'AMMO3': '0.153', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.100', 'HITCOUNT': '2.250', 'weapon3': '2.570', 'DAMAGECOUNT': '9.111', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:40,516][52658] DAMAGECOUNT value on done: 38826.0 [2024-08-05 23:32:40,517][52658] Sum rewards: 30.761, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.760', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon2': '1.036', 'WEAPON3': '1.050', 'ARMOR': '1.257', 'HITCOUNT': '2.010', 'weapon3': '2.618', 'DAMAGECOUNT': '8.649', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:40,519][52665] DAMAGECOUNT value on done: 37829.0 [2024-08-05 23:32:40,519][52665] Sum rewards: 30.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.595', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.122', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.492', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.300', 'weapon3': '2.528', 'DAMAGECOUNT': '8.724', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:40,598][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:32:41,310][52666] DAMAGECOUNT value on done: 37918.0 [2024-08-05 23:32:41,313][52666] Sum rewards: 27.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.612', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.022', 'AMMO4': '0.074', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon2': '1.222', 'ARMOR': '1.380', 'HITCOUNT': '2.100', 'weapon3': '2.192', 'DAMAGECOUNT': '7.872', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:41,513][52647] DAMAGECOUNT value on done: 41237.0 [2024-08-05 23:32:41,513][52647] Sum rewards: 32.202, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.575', 'AMMO5': '0.012', 'AMMO2': '0.042', 'ARMOR': '0.060', 'weapon5': '0.070', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.200', 'HITCOUNT': '2.240', 'weapon3': '2.622', 'DAMAGECOUNT': '8.859', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:41,579][52667] DAMAGECOUNT value on done: 39112.0 [2024-08-05 23:32:41,580][52667] Sum rewards: 36.628, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.353', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.192', 'weapon4': '0.344', 'WEAPON4': '0.350', 'ARMOR': '0.880', 'weapon2': '1.010', 'WEAPON3': '1.300', 'weapon3': '2.364', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.534', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:41,890][52811] DAMAGECOUNT value on done: 37468.0 [2024-08-05 23:32:41,893][52811] Sum rewards: 24.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.798', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.050', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.370', 'ARMOR': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.350', 'HITCOUNT': '1.870', 'weapon3': '2.762', 'DAMAGECOUNT': '7.683', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:41,967][52670] DAMAGECOUNT value on done: 41243.0 [2024-08-05 23:32:41,968][52670] Sum rewards: 29.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.182', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.154', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon2': '1.226', 'HITCOUNT': '2.110', 'weapon3': '2.304', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:42,261][52663] DAMAGECOUNT value on done: 37290.0 [2024-08-05 23:32:42,261][52663] Sum rewards: 29.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.204', 'AMMO3': '0.245', 'weapon2': '0.928', 'ARMOR': '1.330', 'WEAPON3': '1.400', 'HITCOUNT': '2.280', 'weapon3': '2.554', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:42,376][52669] DAMAGECOUNT value on done: 40175.0 [2024-08-05 23:32:42,378][52669] Sum rewards: 25.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.796', 'weapon5': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.422', 'WEAPON4': '0.500', 'ARMOR': '0.824', 'weapon2': '1.010', 'WEAPON3': '1.400', 'HITCOUNT': '2.050', 'weapon3': '2.256', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:42,796][52803] DAMAGECOUNT value on done: 36766.0 [2024-08-05 23:32:42,800][52567] Fps is (10 sec: 17193.2, 60 sec: 17338.0, 300 sec: 17494.4). Total num frames: 128999424. Throughput: 0: 4350.1. Samples: 32258580. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:32:42,800][52803] Sum rewards: 31.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.038', 'weapon4': '0.066', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'ARMOR': '0.844', 'weapon2': '0.962', 'WEAPON3': '1.100', 'HITCOUNT': '1.970', 'weapon3': '2.702', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:42,802][52567] Avg episode reward: [(0, '31.170')] [2024-08-05 23:32:43,694][52665] DAMAGECOUNT value on done: 37035.0 [2024-08-05 23:32:43,702][52665] Sum rewards: 32.302, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.446', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.167', 'weapon5': '0.174', 'AMMO4': '0.186', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.204', 'HITCOUNT': '2.100', 'weapon3': '2.178', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:43,938][52658] DAMAGECOUNT value on done: 41146.0 [2024-08-05 23:32:43,940][52658] Sum rewards: 29.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'WEAPON3': '1.100', 'ARMOR': '1.321', 'weapon2': '1.374', 'HITCOUNT': '1.900', 'weapon3': '2.294', 'DAMAGECOUNT': '8.442', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:43,998][52647] DAMAGECOUNT value on done: 41351.0 [2024-08-05 23:32:43,998][52647] Sum rewards: 30.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.116', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.194', 'weapon4': '0.342', 'WEAPON4': '0.450', 'ARMOR': '0.500', 'weapon2': '1.000', 'WEAPON3': '1.300', 'HITCOUNT': '2.300', 'weapon3': '2.428', 'DAMAGECOUNT': '8.268', 'FRAGCOUNT': '29.500'} [2024-08-05 23:32:44,320][52666] DAMAGECOUNT value on done: 38931.0 [2024-08-05 23:32:44,320][52666] Sum rewards: 28.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.767', 'AMMO5': '0.008', 'weapon5': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.150', 'ARMOR': '0.851', 'weapon2': '0.898', 'WEAPON3': '0.950', 'HITCOUNT': '1.940', 'weapon3': '2.726', 'DAMAGECOUNT': '7.971', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:44,424][52650] Updated weights for policy 0, policy_version 15751 (0.0024) [2024-08-05 23:32:44,648][52667] DAMAGECOUNT value on done: 41556.0 [2024-08-05 23:32:44,649][52667] Sum rewards: 21.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.654', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.860', 'ARMOR': '0.864', 'WEAPON3': '1.400', 'HITCOUNT': '2.270', 'weapon3': '2.712', 'DAMAGECOUNT': '8.325', 'FRAGCOUNT': '22.000'} [2024-08-05 23:32:44,883][52670] DAMAGECOUNT value on done: 36827.0 [2024-08-05 23:32:44,883][52670] Sum rewards: 34.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.157', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.141', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.846', 'ARMOR': '0.907', 'WEAPON3': '0.950', 'HITCOUNT': '2.250', 'weapon3': '2.464', 'DAMAGECOUNT': '9.135', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:45,076][52811] DAMAGECOUNT value on done: 36732.0 [2024-08-05 23:32:45,076][52811] Sum rewards: 38.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.958', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.115', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.332', 'ARMOR': '0.881', 'weapon2': '1.004', 'WEAPON3': '1.200', 'weapon3': '2.326', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.854', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:45,268][52663] DAMAGECOUNT value on done: 40529.0 [2024-08-05 23:32:45,268][52663] Sum rewards: 30.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.331', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.157', 'AMMO4': '0.196', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON4': '0.500', 'ARMOR': '0.920', 'WEAPON3': '1.000', 'weapon2': '1.160', 'weapon3': '1.972', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '8.586', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:45,809][52803] DAMAGECOUNT value on done: 36385.0 [2024-08-05 23:32:45,811][52803] Sum rewards: 42.480, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.471', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.396', 'ARMOR': '0.416', 'weapon2': '0.972', 'WEAPON3': '1.000', 'weapon3': '2.274', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '35.000'} [2024-08-05 23:32:46,545][52647] DAMAGECOUNT value on done: 44450.0 [2024-08-05 23:32:46,545][52647] Sum rewards: 27.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.218', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.824', 'weapon2': '0.978', 'WEAPON3': '1.300', 'HITCOUNT': '2.060', 'weapon3': '2.380', 'DAMAGECOUNT': '8.475', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:46,608][52658] DAMAGECOUNT value on done: 37320.0 [2024-08-05 23:32:46,609][52658] Sum rewards: 24.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'weapon5': '0.034', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.219', 'weapon4': '0.362', 'WEAPON4': '0.450', 'ARMOR': '0.499', 'weapon2': '0.546', 'WEAPON3': '1.150', 'HITCOUNT': '1.880', 'weapon3': '2.532', 'DAMAGECOUNT': '6.987', 'FRAGCOUNT': '22.000'} [2024-08-05 23:32:46,703][52665] DAMAGECOUNT value on done: 38824.0 [2024-08-05 23:32:46,703][52665] Sum rewards: 22.301, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.111', 'weapon5': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.568', 'WEAPON3': '0.800', 'weapon2': '1.024', 'ARMOR': '1.336', 'HITCOUNT': '1.400', 'weapon3': '1.952', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '18.000'} [2024-08-05 23:32:47,237][52666] DAMAGECOUNT value on done: 38436.0 [2024-08-05 23:32:47,238][52666] Sum rewards: 50.689, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon4': '0.110', 'AMMO3': '0.165', 'AMMO4': '0.186', 'HEALTH': '0.228', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'WEAPON3': '0.950', 'weapon2': '1.458', 'weapon3': '2.174', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '40.000'} [2024-08-05 23:32:47,381][52667] DAMAGECOUNT value on done: 42298.0 [2024-08-05 23:32:47,383][52667] Sum rewards: 28.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.524', 'AMMO5': '0.010', 'weapon5': '0.036', 'AMMO2': '0.049', 'weapon4': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'AMMO4': '0.247', 'ARMOR': '0.440', 'WEAPON4': '0.500', 'weapon2': '0.740', 'WEAPON3': '1.450', 'HITCOUNT': '2.350', 'weapon3': '2.830', 'DAMAGECOUNT': '9.954', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 129089536. Throughput: 0: 4350.2. Samples: 32271440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:32:47,794][52567] Avg episode reward: [(0, '31.221')] [2024-08-05 23:32:47,975][52670] DAMAGECOUNT value on done: 38064.0 [2024-08-05 23:32:47,976][52670] Sum rewards: 33.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.382', 'ARMOR': '0.891', 'WEAPON3': '1.150', 'weapon2': '1.262', 'weapon3': '2.220', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:48,108][52811] DAMAGECOUNT value on done: 39467.0 [2024-08-05 23:32:48,110][52811] Sum rewards: 37.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.141', 'weapon4': '0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.962', 'WEAPON3': '1.300', 'ARMOR': '1.346', 'HITCOUNT': '2.310', 'weapon3': '2.656', 'DAMAGECOUNT': '10.293', 'FRAGCOUNT': '32.000'} [2024-08-05 23:32:48,127][52663] DAMAGECOUNT value on done: 42485.0 [2024-08-05 23:32:48,128][52663] Sum rewards: 28.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.094', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.120', 'weapon4': '0.124', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.576', 'weapon2': '1.040', 'WEAPON3': '1.150', 'HITCOUNT': '2.090', 'weapon3': '2.500', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:48,891][52803] DAMAGECOUNT value on done: 36562.0 [2024-08-05 23:32:48,892][52803] Sum rewards: 24.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.562', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.010', 'AMMO4': '0.034', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '1.102', 'WEAPON3': '1.350', 'ARMOR': '1.429', 'HITCOUNT': '2.090', 'weapon3': '2.490', 'DAMAGECOUNT': '8.064', 'FRAGCOUNT': '22.000'} [2024-08-05 23:32:48,893][52650] Updated weights for policy 0, policy_version 15761 (0.0011) [2024-08-05 23:32:49,226][52647] DAMAGECOUNT value on done: 40784.0 [2024-08-05 23:32:49,227][52647] Sum rewards: 32.352, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.072', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.149', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.176', 'HITCOUNT': '1.760', 'weapon3': '2.266', 'DAMAGECOUNT': '7.443', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:49,316][52658] DAMAGECOUNT value on done: 43873.0 [2024-08-05 23:32:49,317][52658] Sum rewards: 36.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.315', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.050', 'weapon4': '0.126', 'AMMO3': '0.158', 'AMMO4': '0.220', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.078', 'HITCOUNT': '2.350', 'weapon3': '2.474', 'DAMAGECOUNT': '9.045', 'FRAGCOUNT': '32.000'} [2024-08-05 23:32:49,693][52665] DAMAGECOUNT value on done: 38171.0 [2024-08-05 23:32:49,693][52665] Sum rewards: 27.550, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.372', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon7': '0.088', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.138', 'weapon5': '0.178', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON5': '0.400', 'ARMOR': '0.816', 'WEAPON3': '0.900', 'weapon2': '1.038', 'HITCOUNT': '1.910', 'weapon3': '1.954', 'DAMAGECOUNT': '6.741', 'FRAGCOUNT': '21.000'} [2024-08-05 23:32:50,350][52666] DAMAGECOUNT value on done: 35455.0 [2024-08-05 23:32:50,352][52666] Sum rewards: 32.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.172', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.828', 'WEAPON3': '1.350', 'weapon3': '2.302', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.344', 'FRAGCOUNT': '31.000'} [2024-08-05 23:32:50,422][52667] DAMAGECOUNT value on done: 40310.0 [2024-08-05 23:32:50,424][52667] Sum rewards: 37.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.360', 'AMMO5': '0.019', 'AMMO2': '0.037', 'ARMOR': '0.040', 'weapon5': '0.058', 'AMMO3': '0.152', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON5': '0.400', 'weapon2': '0.762', 'WEAPON3': '0.950', 'weapon3': '2.588', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '9.486', 'FRAGCOUNT': '30.500'} [2024-08-05 23:32:51,066][52663] DAMAGECOUNT value on done: 38103.0 [2024-08-05 23:32:51,067][52663] Sum rewards: 37.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon2': '1.234', 'ARMOR': '1.693', 'HITCOUNT': '2.290', 'weapon3': '2.602', 'DAMAGECOUNT': '9.171', 'FRAGCOUNT': '31.000'} [2024-08-05 23:32:51,194][52670] DAMAGECOUNT value on done: 36486.0 [2024-08-05 23:32:51,194][52670] Sum rewards: 35.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.937', 'AMMO2': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.036', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.912', 'DAMAGECOUNT': '9.831', 'FRAGCOUNT': '31.000'} [2024-08-05 23:32:51,197][52811] DAMAGECOUNT value on done: 35278.0 [2024-08-05 23:32:51,198][52811] Sum rewards: 30.805, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.732', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon7': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon4': '0.196', 'WEAPON7': '0.200', 'ARMOR': '0.852', 'WEAPON3': '1.000', 'weapon2': '1.544', 'weapon3': '1.878', 'HITCOUNT': '1.990', 'DAMAGECOUNT': '8.085', 'FRAGCOUNT': '25.000'} [2024-08-05 23:32:52,002][52647] DAMAGECOUNT value on done: 42772.0 [2024-08-05 23:32:52,003][52647] Sum rewards: 27.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.143', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.432', 'ARMOR': '0.459', 'weapon2': '0.808', 'WEAPON3': '1.000', 'HITCOUNT': '2.170', 'weapon3': '2.364', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:52,010][52803] DAMAGECOUNT value on done: 36951.0 [2024-08-05 23:32:52,011][52803] Sum rewards: 28.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.306', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.892', 'ARMOR': '0.924', 'WEAPON3': '1.350', 'HITCOUNT': '2.030', 'weapon3': '2.406', 'DAMAGECOUNT': '8.694', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:52,344][52658] DAMAGECOUNT value on done: 37364.0 [2024-08-05 23:32:52,344][52658] Sum rewards: 32.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.238', 'AMMO5': '0.008', 'ARMOR': '0.020', 'weapon5': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.796', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.636', 'DAMAGECOUNT': '10.008', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:52,657][52665] DAMAGECOUNT value on done: 38512.0 [2024-08-05 23:32:52,658][52665] Sum rewards: 35.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'weapon5': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.142', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.374', 'ARMOR': '0.481', 'WEAPON3': '1.000', 'weapon2': '1.016', 'HITCOUNT': '2.040', 'weapon3': '2.354', 'DAMAGECOUNT': '8.085', 'FRAGCOUNT': '32.000'} [2024-08-05 23:32:52,800][52567] Fps is (10 sec: 17203.7, 60 sec: 17338.1, 300 sec: 17494.5). Total num frames: 129171456. Throughput: 0: 4365.4. Samples: 32297940. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:32:52,800][52567] Avg episode reward: [(0, '31.245')] [2024-08-05 23:32:53,228][52666] DAMAGECOUNT value on done: 35453.0 [2024-08-05 23:32:53,229][52666] Sum rewards: 33.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.636', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.062', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'ARMOR': '0.800', 'weapon2': '0.850', 'WEAPON3': '1.050', 'HITCOUNT': '2.180', 'weapon3': '2.854', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '28.000'} [2024-08-05 23:32:53,321][52667] DAMAGECOUNT value on done: 41040.0 [2024-08-05 23:32:53,322][52667] Sum rewards: 38.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO4': '0.194', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'ARMOR': '0.496', 'weapon2': '1.038', 'WEAPON3': '1.300', 'weapon3': '2.492', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.191', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:53,570][52663] DAMAGECOUNT value on done: 40066.0 [2024-08-05 23:32:53,572][52663] Sum rewards: 36.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'ARMOR': '0.822', 'weapon2': '1.092', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '2.706', 'DAMAGECOUNT': '9.924', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:53,663][52670] DAMAGECOUNT value on done: 33334.0 [2024-08-05 23:32:53,663][52670] Sum rewards: 24.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.935', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.020', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.224', 'ARMOR': '0.924', 'WEAPON3': '1.050', 'weapon2': '1.130', 'HITCOUNT': '1.980', 'weapon3': '2.368', 'DAMAGECOUNT': '7.824', 'FRAGCOUNT': '23.000'} [2024-08-05 23:32:53,839][52650] Updated weights for policy 0, policy_version 15771 (0.0013) [2024-08-05 23:32:54,199][52647] DAMAGECOUNT value on done: 42316.0 [2024-08-05 23:32:54,203][52647] Sum rewards: 40.718, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'weapon4': '0.504', 'weapon2': '0.968', 'WEAPON3': '1.050', 'weapon3': '2.208', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:54,462][52811] DAMAGECOUNT value on done: 37302.0 [2024-08-05 23:32:54,463][52811] Sum rewards: 31.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'weapon5': '0.002', 'AMMO5': '0.013', 'weapon4': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'ARMOR': '0.451', 'weapon2': '0.870', 'WEAPON3': '1.600', 'HITCOUNT': '2.510', 'weapon3': '2.694', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:55,090][52803] DAMAGECOUNT value on done: 35784.0 [2024-08-05 23:32:55,092][52803] Sum rewards: 34.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.478', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '1.138', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'ARMOR': '2.319', 'weapon3': '2.570', 'DAMAGECOUNT': '9.420', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:55,313][52658] DAMAGECOUNT value on done: 41897.0 [2024-08-05 23:32:55,329][52658] Sum rewards: 41.494, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.122', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.249', 'weapon2': '0.800', 'WEAPON3': '1.600', 'ARMOR': '1.746', 'HITCOUNT': '2.590', 'weapon3': '2.722', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '38.000'} [2024-08-05 23:32:55,900][52665] DAMAGECOUNT value on done: 38476.0 [2024-08-05 23:32:55,900][52665] Sum rewards: 35.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.466', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.192', 'WEAPON4': '0.400', 'ARMOR': '0.463', 'weapon2': '0.528', 'weapon4': '0.794', 'WEAPON3': '1.250', 'weapon3': '2.260', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:56,037][52666] DAMAGECOUNT value on done: 37509.0 [2024-08-05 23:32:56,038][52666] Sum rewards: 26.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.152', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.050', 'weapon2': '1.428', 'ARMOR': '1.690', 'HITCOUNT': '1.790', 'weapon3': '1.838', 'DAMAGECOUNT': '6.906', 'FRAGCOUNT': '24.000'} [2024-08-05 23:32:56,260][52663] DAMAGECOUNT value on done: 42413.0 [2024-08-05 23:32:56,261][52663] Sum rewards: 34.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.802', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.330', 'ARMOR': '0.838', 'WEAPON3': '1.150', 'weapon2': '1.162', 'HITCOUNT': '2.280', 'weapon3': '2.368', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:56,271][52667] DAMAGECOUNT value on done: 39187.0 [2024-08-05 23:32:56,272][52667] Sum rewards: 19.292, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.092', 'AMMO3': '0.123', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '0.800', 'weapon2': '0.986', 'ARMOR': '1.228', 'HITCOUNT': '1.620', 'weapon3': '1.674', 'DAMAGECOUNT': '5.850', 'FRAGCOUNT': '16.000'} [2024-08-05 23:32:56,524][52647] DAMAGECOUNT value on done: 40829.0 [2024-08-05 23:32:56,525][52647] Sum rewards: 32.588, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.360', 'AMMO5': '0.008', 'AMMO2': '0.020', 'ARMOR': '0.036', 'weapon5': '0.070', 'AMMO4': '0.102', 'weapon4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.290', 'weapon2': '0.584', 'WEAPON3': '1.800', 'HITCOUNT': '2.410', 'weapon3': '2.910', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '33.000'} [2024-08-05 23:32:56,658][52670] DAMAGECOUNT value on done: 38632.0 [2024-08-05 23:32:56,659][52670] Sum rewards: 32.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.838', 'ARMOR': '0.875', 'WEAPON3': '1.500', 'HITCOUNT': '2.230', 'weapon3': '2.772', 'DAMAGECOUNT': '9.177', 'FRAGCOUNT': '31.000'} [2024-08-05 23:32:57,550][52811] DAMAGECOUNT value on done: 36979.0 [2024-08-05 23:32:57,552][52811] Sum rewards: 28.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.576', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '1.058', 'WEAPON3': '1.250', 'HITCOUNT': '1.870', 'weapon3': '2.632', 'DAMAGECOUNT': '8.202', 'FRAGCOUNT': '26.000'} [2024-08-05 23:32:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 129269760. Throughput: 0: 4365.8. Samples: 32324190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:32:57,794][52567] Avg episode reward: [(0, '32.159')] [2024-08-05 23:32:57,807][52614] Saving new best policy, reward=32.159! [2024-08-05 23:32:58,005][52658] DAMAGECOUNT value on done: 40796.0 [2024-08-05 23:32:58,007][52658] Sum rewards: 32.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'weapon4': '0.006', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'weapon2': '1.026', 'WEAPON3': '1.350', 'HITCOUNT': '2.150', 'weapon3': '2.666', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '29.000'} [2024-08-05 23:32:58,058][52803] DAMAGECOUNT value on done: 36543.0 [2024-08-05 23:32:58,060][52803] Sum rewards: 43.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.256', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.228', 'ARMOR': '0.450', 'weapon2': '1.044', 'WEAPON3': '1.200', 'weapon3': '2.576', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '38.000'} [2024-08-05 23:32:58,364][52650] Updated weights for policy 0, policy_version 15781 (0.0014) [2024-08-05 23:32:58,611][52665] DAMAGECOUNT value on done: 37527.0 [2024-08-05 23:32:58,613][52665] Sum rewards: 22.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.855', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.072', 'weapon5': '0.084', 'AMMO4': '0.104', 'AMMO3': '0.137', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.858', 'WEAPON3': '1.000', 'weapon2': '1.210', 'HITCOUNT': '1.770', 'weapon3': '2.422', 'DAMAGECOUNT': '6.762', 'FRAGCOUNT': '18.000'} [2024-08-05 23:32:58,880][52666] DAMAGECOUNT value on done: 36522.0 [2024-08-05 23:32:58,882][52666] Sum rewards: 26.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.176', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.089', 'weapon4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'ARMOR': '0.425', 'weapon2': '0.704', 'WEAPON3': '1.300', 'HITCOUNT': '1.830', 'weapon3': '2.832', 'DAMAGECOUNT': '7.860', 'FRAGCOUNT': '25.500'} [2024-08-05 23:32:58,943][52795] DAMAGECOUNT value on done: 37441.0 [2024-08-05 23:32:58,944][52795] Sum rewards: 38.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.476', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.176', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'ARMOR': '0.473', 'weapon2': '0.670', 'WEAPON3': '1.700', 'HITCOUNT': '2.560', 'weapon3': '2.884', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '35.500'} [2024-08-05 23:32:59,156][52663] DAMAGECOUNT value on done: 38848.0 [2024-08-05 23:32:59,158][52663] Sum rewards: 24.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.484', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.023', 'weapon4': '0.084', 'AMMO4': '0.115', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.887', 'WEAPON3': '0.950', 'weapon2': '1.376', 'HITCOUNT': '1.810', 'weapon3': '2.220', 'DAMAGECOUNT': '6.900', 'FRAGCOUNT': '21.000'} [2024-08-05 23:32:59,180][52667] DAMAGECOUNT value on done: 41140.0 [2024-08-05 23:32:59,184][52667] Sum rewards: 32.692, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.613', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.068', 'AMMO3': '0.140', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.426', 'weapon2': '0.656', 'WEAPON3': '0.850', 'ARMOR': '0.860', 'HITCOUNT': '1.820', 'weapon3': '2.492', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '27.000'} [2024-08-05 23:32:59,523][52670] DAMAGECOUNT value on done: 40687.0 [2024-08-05 23:32:59,525][52670] Sum rewards: 33.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.064', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '1.052', 'WEAPON3': '1.150', 'HITCOUNT': '2.130', 'weapon3': '2.524', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '30.000'} [2024-08-05 23:32:59,554][52647] DAMAGECOUNT value on done: 44025.0 [2024-08-05 23:32:59,555][52647] Sum rewards: 38.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.988', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.068', 'AMMO3': '0.214', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.754', 'ARMOR': '0.848', 'WEAPON3': '1.250', 'weapon3': '2.450', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '33.000'} [2024-08-05 23:33:00,421][52671] DAMAGECOUNT value on done: 42602.0 [2024-08-05 23:33:00,423][52671] Sum rewards: 34.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.548', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.064', 'AMMO4': '0.216', 'AMMO3': '0.226', 'WEAPON5': '0.400', 'weapon4': '0.400', 'ARMOR': '0.408', 'WEAPON4': '0.550', 'weapon2': '0.680', 'WEAPON3': '1.350', 'HITCOUNT': '2.100', 'weapon3': '2.468', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:00,520][52811] DAMAGECOUNT value on done: 38097.0 [2024-08-05 23:33:00,520][52811] Sum rewards: 33.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.562', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.194', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'weapon2': '1.120', 'WEAPON3': '1.400', 'HITCOUNT': '2.200', 'weapon3': '2.462', 'DAMAGECOUNT': '8.925', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:01,156][52658] DAMAGECOUNT value on done: 40055.0 [2024-08-05 23:33:01,161][52658] Sum rewards: 25.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'AMMO4': '0.217', 'WEAPON4': '0.450', 'weapon2': '0.822', 'WEAPON3': '1.300', 'ARMOR': '1.330', 'HITCOUNT': '1.810', 'weapon3': '2.808', 'DAMAGECOUNT': '7.734', 'FRAGCOUNT': '23.000'} [2024-08-05 23:33:01,224][52803] DAMAGECOUNT value on done: 37401.0 [2024-08-05 23:33:01,225][52803] Sum rewards: 26.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.614', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.201', 'weapon4': '0.388', 'ARMOR': '0.536', 'WEAPON4': '0.550', 'weapon2': '0.628', 'WEAPON3': '1.400', 'HITCOUNT': '1.960', 'weapon3': '2.572', 'DAMAGECOUNT': '7.695', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:01,384][52666] DAMAGECOUNT value on done: 36711.0 [2024-08-05 23:33:01,386][52666] Sum rewards: 28.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.323', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.218', 'weapon2': '0.886', 'ARMOR': '0.932', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.486', 'DAMAGECOUNT': '8.982', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:01,731][52665] DAMAGECOUNT value on done: 37645.0 [2024-08-05 23:33:01,733][52665] Sum rewards: 36.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.799', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.156', 'AMMO3': '0.160', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.412', 'weapon2': '0.892', 'WEAPON3': '1.100', 'weapon3': '2.278', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '9.549', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:02,117][52670] DAMAGECOUNT value on done: 39606.0 [2024-08-05 23:33:02,118][52670] Sum rewards: 26.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.226', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.774', 'WEAPON3': '1.300', 'HITCOUNT': '2.040', 'weapon3': '2.400', 'DAMAGECOUNT': '8.091', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:02,207][52795] DAMAGECOUNT value on done: 34398.0 [2024-08-05 23:33:02,211][52795] Sum rewards: 27.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.171', 'weapon4': '0.236', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon2': '1.184', 'ARMOR': '1.321', 'HITCOUNT': '2.130', 'weapon3': '2.366', 'DAMAGECOUNT': '7.971', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:02,282][52663] DAMAGECOUNT value on done: 39488.0 [2024-08-05 23:33:02,282][52663] Sum rewards: 32.671, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.198', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.190', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.716', 'WEAPON3': '1.450', 'HITCOUNT': '2.290', 'weapon3': '2.766', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:02,794][52567] Fps is (10 sec: 18032.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 129351680. Throughput: 0: 4365.8. Samples: 32337150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:33:02,794][52567] Avg episode reward: [(0, '31.932')] [2024-08-05 23:33:02,805][52647] DAMAGECOUNT value on done: 43017.0 [2024-08-05 23:33:02,805][52647] Sum rewards: 34.294, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.084', 'AMMO4': '0.154', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.336', 'ARMOR': '0.472', 'weapon2': '0.926', 'WEAPON3': '1.200', 'HITCOUNT': '2.170', 'weapon3': '2.368', 'DAMAGECOUNT': '8.832', 'FRAGCOUNT': '30.000'} [2024-08-05 23:33:02,994][52671] DAMAGECOUNT value on done: 39902.0 [2024-08-05 23:33:02,995][52671] Sum rewards: 40.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.444', 'weapon4': '0.002', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon5': '0.026', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'ARMOR': '0.468', 'weapon2': '0.914', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.792', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '35.500'} [2024-08-05 23:33:03,205][52650] Updated weights for policy 0, policy_version 15791 (0.0026) [2024-08-05 23:33:03,645][52811] DAMAGECOUNT value on done: 36538.0 [2024-08-05 23:33:03,647][52811] Sum rewards: 32.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.464', 'weapon4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.927', 'weapon2': '1.162', 'WEAPON3': '1.350', 'HITCOUNT': '2.280', 'weapon3': '2.586', 'DAMAGECOUNT': '8.772', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:04,261][52666] DAMAGECOUNT value on done: 37868.0 [2024-08-05 23:33:04,263][52666] Sum rewards: 34.417, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.268', 'HEALTH': '0.308', 'ARMOR': '0.412', 'WEAPON3': '0.950', 'weapon2': '1.164', 'weapon3': '2.356', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.375', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:04,298][52658] DAMAGECOUNT value on done: 37861.0 [2024-08-05 23:33:04,301][52658] Sum rewards: 37.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.245', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.205', 'weapon4': '0.340', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'weapon2': '0.618', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.680', 'DAMAGECOUNT': '10.257', 'FRAGCOUNT': '33.000'} [2024-08-05 23:33:04,418][52803] DAMAGECOUNT value on done: 38444.0 [2024-08-05 23:33:04,419][52803] Sum rewards: 36.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.434', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'ARMOR': '0.424', 'weapon2': '0.984', 'WEAPON3': '1.150', 'HITCOUNT': '2.330', 'weapon3': '2.384', 'DAMAGECOUNT': '9.705', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:04,452][52665] DAMAGECOUNT value on done: 37400.0 [2024-08-05 23:33:04,453][52665] Sum rewards: 29.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.843', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.136', 'AMMO3': '0.144', 'AMMO4': '0.258', 'WEAPON5': '0.300', 'ARMOR': '0.456', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon2': '1.056', 'weapon3': '1.954', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '7.647', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:05,000][52670] DAMAGECOUNT value on done: 40038.0 [2024-08-05 23:33:05,000][52670] Sum rewards: 34.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.066', 'AMMO4': '0.165', 'AMMO3': '0.191', 'weapon4': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.857', 'weapon2': '0.916', 'WEAPON3': '1.200', 'HITCOUNT': '2.060', 'weapon3': '2.552', 'DAMAGECOUNT': '8.466', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:05,203][52663] DAMAGECOUNT value on done: 36947.0 [2024-08-05 23:33:05,206][52663] Sum rewards: 25.059, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.025', 'ARMOR': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.152', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON3': '1.050', 'weapon2': '1.294', 'HITCOUNT': '1.920', 'weapon3': '2.246', 'DAMAGECOUNT': '7.917', 'FRAGCOUNT': '22.000'} [2024-08-05 23:33:05,341][52795] DAMAGECOUNT value on done: 35265.0 [2024-08-05 23:33:05,342][52795] Sum rewards: 32.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.056', 'AMMO4': '0.120', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'ARMOR': '0.800', 'weapon2': '0.906', 'WEAPON3': '1.300', 'HITCOUNT': '2.210', 'weapon3': '2.638', 'DAMAGECOUNT': '9.063', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:05,706][52671] DAMAGECOUNT value on done: 39748.0 [2024-08-05 23:33:05,706][52671] Sum rewards: 34.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.512', 'weapon5': '0.014', 'AMMO5': '0.015', 'ARMOR': '0.044', 'AMMO2': '0.057', 'AMMO3': '0.223', 'weapon4': '0.238', 'AMMO4': '0.283', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'weapon2': '0.794', 'WEAPON3': '1.400', 'weapon3': '2.498', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '9.543', 'FRAGCOUNT': '33.000'} [2024-08-05 23:33:05,765][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:33:05,921][52647] DAMAGECOUNT value on done: 40987.0 [2024-08-05 23:33:05,922][52647] Sum rewards: 26.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.632', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon4': '0.314', 'weapon2': '0.820', 'ARMOR': '0.918', 'WEAPON3': '1.400', 'HITCOUNT': '2.310', 'weapon3': '2.610', 'DAMAGECOUNT': '8.496', 'FRAGCOUNT': '27.000'} [2024-08-05 23:33:06,785][52811] DAMAGECOUNT value on done: 37458.0 [2024-08-05 23:33:06,786][52811] Sum rewards: 27.344, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.534', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.237', 'weapon4': '0.276', 'WEAPON4': '0.450', 'weapon2': '0.654', 'ARMOR': '1.318', 'WEAPON3': '1.500', 'HITCOUNT': '2.110', 'weapon3': '2.764', 'DAMAGECOUNT': '8.343', 'FRAGCOUNT': '27.000'} [2024-08-05 23:33:07,291][52666] DAMAGECOUNT value on done: 37868.0 [2024-08-05 23:33:07,293][52666] Sum rewards: 28.855, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.286', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.014', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.898', 'ARMOR': '0.953', 'WEAPON3': '1.050', 'HITCOUNT': '2.020', 'weapon3': '2.474', 'DAMAGECOUNT': '8.022', 'FRAGCOUNT': '24.000'} [2024-08-05 23:33:07,307][52658] DAMAGECOUNT value on done: 40423.0 [2024-08-05 23:33:07,307][52658] Sum rewards: 37.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.051', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon4': '0.198', 'weapon2': '0.892', 'ARMOR': '0.917', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '2.608', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '33.000'} [2024-08-05 23:33:07,423][52803] DAMAGECOUNT value on done: 36064.0 [2024-08-05 23:33:07,423][52803] Sum rewards: 37.969, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.076', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'WEAPON3': '0.950', 'weapon2': '1.168', 'ARMOR': '1.307', 'HITCOUNT': '2.300', 'weapon3': '2.554', 'DAMAGECOUNT': '9.171', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:07,793][52650] Updated weights for policy 0, policy_version 15801 (0.0017) [2024-08-05 23:33:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 129441792. Throughput: 0: 4360.7. Samples: 32363230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:33:07,794][52567] Avg episode reward: [(0, '31.953')] [2024-08-05 23:33:07,919][52670] DAMAGECOUNT value on done: 39705.0 [2024-08-05 23:33:07,921][52670] Sum rewards: 31.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon4': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.100', 'ARMOR': '1.257', 'HITCOUNT': '2.200', 'weapon3': '2.478', 'DAMAGECOUNT': '9.717', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:08,324][52663] DAMAGECOUNT value on done: 39677.0 [2024-08-05 23:33:08,325][52663] Sum rewards: 27.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.696', 'AMMO5': '0.012', 'weapon5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.400', 'ARMOR': '0.844', 'weapon2': '0.906', 'WEAPON3': '1.250', 'HITCOUNT': '2.230', 'weapon3': '2.554', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '25.500'} [2024-08-05 23:33:08,462][52795] DAMAGECOUNT value on done: 38031.0 [2024-08-05 23:33:08,462][52795] Sum rewards: 35.494, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.128', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.188', 'WEAPON3': '0.800', 'weapon2': '1.212', 'ARMOR': '1.711', 'HITCOUNT': '2.110', 'weapon3': '2.394', 'DAMAGECOUNT': '9.174', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:08,777][52647] DAMAGECOUNT value on done: 40784.0 [2024-08-05 23:33:08,777][52647] Sum rewards: 29.775, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.946', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.129', 'weapon5': '0.146', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.382', 'WEAPON3': '0.900', 'weapon2': '1.166', 'HITCOUNT': '1.700', 'ARMOR': '1.775', 'weapon3': '1.974', 'DAMAGECOUNT': '7.866', 'FRAGCOUNT': '24.000'} [2024-08-05 23:33:08,845][52671] DAMAGECOUNT value on done: 38242.0 [2024-08-05 23:33:08,847][52671] Sum rewards: 27.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.548', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.173', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.338', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.826', 'WEAPON3': '1.150', 'HITCOUNT': '1.820', 'weapon3': '2.590', 'DAMAGECOUNT': '8.178', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:09,791][52666] DAMAGECOUNT value on done: 37275.0 [2024-08-05 23:33:09,793][52666] Sum rewards: 18.488, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '1.156', 'WEAPON3': '1.500', 'HITCOUNT': '1.570', 'weapon3': '2.540', 'DAMAGECOUNT': '7.125', 'FRAGCOUNT': '22.000'} [2024-08-05 23:33:09,822][52811] DAMAGECOUNT value on done: 40716.0 [2024-08-05 23:33:09,823][52811] Sum rewards: 35.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.904', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.166', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'ARMOR': '0.473', 'weapon2': '0.488', 'WEAPON3': '1.350', 'HITCOUNT': '2.300', 'weapon3': '2.946', 'DAMAGECOUNT': '10.041', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:09,947][52658] DAMAGECOUNT value on done: 39316.0 [2024-08-05 23:33:09,947][52658] Sum rewards: 24.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.317', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'ARMOR': '0.478', 'WEAPON3': '1.000', 'weapon2': '1.392', 'HITCOUNT': '1.580', 'weapon3': '2.116', 'DAMAGECOUNT': '6.594', 'FRAGCOUNT': '22.000'} [2024-08-05 23:33:10,489][52670] DAMAGECOUNT value on done: 36355.0 [2024-08-05 23:33:10,490][52670] Sum rewards: 27.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.596', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.034', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.228', 'ARMOR': '0.487', 'WEAPON3': '1.150', 'weapon2': '1.168', 'HITCOUNT': '1.760', 'weapon3': '2.342', 'DAMAGECOUNT': '7.233', 'FRAGCOUNT': '25.500'} [2024-08-05 23:33:11,317][52663] DAMAGECOUNT value on done: 39156.0 [2024-08-05 23:33:11,319][52663] Sum rewards: 33.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.207', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.086', 'AMMO4': '0.152', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'weapon2': '0.574', 'WEAPON3': '1.250', 'HITCOUNT': '2.310', 'weapon3': '2.566', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:11,609][52795] DAMAGECOUNT value on done: 39501.0 [2024-08-05 23:33:11,609][52795] Sum rewards: 28.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.506', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon5': '0.120', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'weapon4': '0.330', 'ARMOR': '0.467', 'WEAPON4': '0.500', 'weapon2': '0.848', 'WEAPON3': '1.350', 'HITCOUNT': '2.000', 'weapon3': '2.308', 'DAMAGECOUNT': '7.935', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:11,754][52671] DAMAGECOUNT value on done: 37547.0 [2024-08-05 23:33:11,754][52671] Sum rewards: 32.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.096', 'AMMO3': '0.162', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'weapon4': '0.404', 'WEAPON4': '0.450', 'ARMOR': '0.485', 'weapon2': '0.738', 'WEAPON3': '1.050', 'HITCOUNT': '2.080', 'weapon3': '2.458', 'DAMAGECOUNT': '7.740', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:11,966][52647] DAMAGECOUNT value on done: 38815.0 [2024-08-05 23:33:11,966][52647] Sum rewards: 38.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.565', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO3': '0.120', 'AMMO4': '0.127', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.464', 'WEAPON3': '0.800', 'ARMOR': '0.857', 'weapon2': '1.032', 'weapon3': '1.910', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '30.500'} [2024-08-05 23:33:12,494][52650] Updated weights for policy 0, policy_version 15811 (0.0013) [2024-08-05 23:33:12,626][52666] DAMAGECOUNT value on done: 38814.0 [2024-08-05 23:33:12,628][52666] Sum rewards: 23.341, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.305', 'weapon5': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'ARMOR': '0.428', 'weapon2': '0.672', 'WEAPON3': '1.650', 'HITCOUNT': '1.950', 'weapon3': '2.836', 'DAMAGECOUNT': '8.259', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:12,656][52659] DAMAGECOUNT value on done: 38770.0 [2024-08-05 23:33:12,657][52659] Sum rewards: 28.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.230', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'ARMOR': '0.458', 'weapon2': '1.056', 'WEAPON3': '1.300', 'HITCOUNT': '2.310', 'weapon3': '2.420', 'DAMAGECOUNT': '8.253', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:12,675][52658] DAMAGECOUNT value on done: 39208.0 [2024-08-05 23:33:12,678][52658] Sum rewards: 32.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.708', 'WEAPON3': '1.500', 'HITCOUNT': '2.300', 'weapon3': '2.960', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 129531904. Throughput: 0: 4360.2. Samples: 32389700. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:33:12,794][52567] Avg episode reward: [(0, '31.621')] [2024-08-05 23:33:12,913][52811] DAMAGECOUNT value on done: 35501.0 [2024-08-05 23:33:12,914][52811] Sum rewards: 35.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.194', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.118', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon2': '0.904', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.716', 'DAMAGECOUNT': '10.665', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:13,536][52670] DAMAGECOUNT value on done: 37922.0 [2024-08-05 23:33:13,536][52670] Sum rewards: 35.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.528', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.034', 'AMMO4': '0.124', 'AMMO3': '0.150', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.464', 'weapon4': '0.504', 'weapon2': '0.644', 'WEAPON3': '0.950', 'HITCOUNT': '2.100', 'weapon3': '2.560', 'DAMAGECOUNT': '8.853', 'FRAGCOUNT': '30.000'} [2024-08-05 23:33:13,968][52663] DAMAGECOUNT value on done: 39446.0 [2024-08-05 23:33:13,970][52663] Sum rewards: 23.010, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.127', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'weapon4': '0.362', 'ARMOR': '0.460', 'WEAPON3': '0.950', 'weapon2': '1.352', 'HITCOUNT': '1.800', 'weapon3': '1.988', 'DAMAGECOUNT': '6.588', 'FRAGCOUNT': '19.500'} [2024-08-05 23:33:14,031][52671] DAMAGECOUNT value on done: 41815.0 [2024-08-05 23:33:14,033][52671] Sum rewards: 21.234, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.078', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.072', 'AMMO3': '0.141', 'AMMO4': '0.159', 'weapon4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.895', 'WEAPON3': '0.900', 'weapon2': '0.972', 'HITCOUNT': '1.710', 'weapon3': '2.462', 'DAMAGECOUNT': '6.360', 'FRAGCOUNT': '19.000'} [2024-08-05 23:33:14,594][52647] DAMAGECOUNT value on done: 41949.0 [2024-08-05 23:33:14,594][52647] Sum rewards: 39.466, reward structure: {'DEATHCOUNT': '-9.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'HEALTH': '0.019', 'AMMO2': '0.040', 'weapon7': '0.072', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'AMMO4': '0.199', 'WEAPON7': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '0.850', 'ARMOR': '0.890', 'HITCOUNT': '2.110', 'weapon3': '2.770', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:14,752][52795] DAMAGECOUNT value on done: 38312.0 [2024-08-05 23:33:14,752][52795] Sum rewards: 26.093, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.068', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.450', 'weapon2': '1.176', 'WEAPON3': '1.400', 'HITCOUNT': '1.750', 'weapon3': '2.530', 'DAMAGECOUNT': '7.341', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:15,020][52659] DAMAGECOUNT value on done: 42211.0 [2024-08-05 23:33:15,020][52659] Sum rewards: 31.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.472', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.164', 'weapon2': '0.958', 'WEAPON3': '1.050', 'ARMOR': '1.307', 'HITCOUNT': '2.150', 'weapon3': '2.852', 'DAMAGECOUNT': '8.853', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:15,542][52658] DAMAGECOUNT value on done: 41643.0 [2024-08-05 23:33:15,543][52658] Sum rewards: 40.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.744', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.342', 'weapon2': '0.616', 'WEAPON3': '1.250', 'HITCOUNT': '2.290', 'weapon3': '2.628', 'DAMAGECOUNT': '10.050', 'FRAGCOUNT': '36.000'} [2024-08-05 23:33:15,753][52666] DAMAGECOUNT value on done: 38040.0 [2024-08-05 23:33:15,754][52666] Sum rewards: 24.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.044', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.221', 'WEAPON4': '0.500', 'weapon4': '0.780', 'ARMOR': '0.816', 'WEAPON3': '1.000', 'weapon2': '1.104', 'weapon3': '1.776', 'HITCOUNT': '1.800', 'DAMAGECOUNT': '7.371', 'FRAGCOUNT': '20.000'} [2024-08-05 23:33:16,034][52811] DAMAGECOUNT value on done: 36244.0 [2024-08-05 23:33:16,037][52811] Sum rewards: 41.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.914', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.214', 'weapon2': '0.746', 'ARMOR': '0.804', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.818', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '37.000'} [2024-08-05 23:33:16,675][52670] DAMAGECOUNT value on done: 38059.0 [2024-08-05 23:33:16,676][52670] Sum rewards: 33.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'ARMOR': '0.400', 'weapon2': '1.004', 'WEAPON3': '1.150', 'HITCOUNT': '2.280', 'weapon3': '2.618', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '30.500'} [2024-08-05 23:33:16,833][52671] DAMAGECOUNT value on done: 40287.0 [2024-08-05 23:33:16,835][52671] Sum rewards: 33.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.732', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'ARMOR': '0.832', 'WEAPON3': '1.150', 'weapon2': '1.376', 'weapon3': '2.236', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:16,869][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:33:16,953][52663] DAMAGECOUNT value on done: 40820.0 [2024-08-05 23:33:16,956][52663] Sum rewards: 31.470, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.308', 'AMMO2': '0.004', 'AMMO5': '0.006', 'AMMO4': '0.018', 'WEAPON1': '0.020', 'AMMO3': '0.125', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'weapon4': '0.522', 'weapon2': '0.948', 'WEAPON3': '1.000', 'weapon3': '2.066', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '8.865', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:17,363][52647] DAMAGECOUNT value on done: 39761.0 [2024-08-05 23:33:17,364][52647] Sum rewards: 21.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.623', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO3': '0.152', 'AMMO4': '0.162', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.112', 'ARMOR': '1.351', 'HITCOUNT': '1.720', 'weapon3': '2.324', 'DAMAGECOUNT': '6.597', 'FRAGCOUNT': '19.000'} [2024-08-05 23:33:17,369][52650] Updated weights for policy 0, policy_version 15821 (0.0015) [2024-08-05 23:33:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 129613824. Throughput: 0: 4364.5. Samples: 32402720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 23:33:17,794][52567] Avg episode reward: [(0, '31.712')] [2024-08-05 23:33:18,010][52795] DAMAGECOUNT value on done: 40620.0 [2024-08-05 23:33:18,011][52795] Sum rewards: 33.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.268', 'ARMOR': '0.812', 'WEAPON3': '0.950', 'weapon2': '1.268', 'weapon3': '2.162', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.471', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:18,115][52659] DAMAGECOUNT value on done: 39298.0 [2024-08-05 23:33:18,118][52659] Sum rewards: 26.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.332', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.350', 'ARMOR': '0.448', 'weapon2': '1.156', 'WEAPON3': '1.300', 'HITCOUNT': '2.020', 'weapon3': '2.348', 'DAMAGECOUNT': '8.286', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:18,308][52658] DAMAGECOUNT value on done: 43451.0 [2024-08-05 23:33:18,308][52658] Sum rewards: 39.982, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.224', 'AMMO2': '0.011', 'AMMO5': '0.013', 'AMMO4': '0.057', 'weapon5': '0.060', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon2': '1.360', 'ARMOR': '1.729', 'weapon3': '2.202', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '31.500'} [2024-08-05 23:33:19,346][52670] DAMAGECOUNT value on done: 37755.0 [2024-08-05 23:33:19,347][52670] Sum rewards: 25.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.156', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'WEAPON3': '1.000', 'weapon2': '1.002', 'HITCOUNT': '1.820', 'weapon3': '2.358', 'DAMAGECOUNT': '8.457', 'FRAGCOUNT': '23.000'} [2024-08-05 23:33:19,846][52671] DAMAGECOUNT value on done: 42958.0 [2024-08-05 23:33:19,846][52671] Sum rewards: 32.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.312', 'AMMO5': '0.015', 'weapon5': '0.034', 'AMMO2': '0.041', 'weapon4': '0.164', 'AMMO3': '0.168', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'weapon2': '1.094', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.376', 'DAMAGECOUNT': '9.060', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:20,021][52663] DAMAGECOUNT value on done: 41109.0 [2024-08-05 23:33:20,022][52663] Sum rewards: 45.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.026', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.279', 'ARMOR': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.700', 'HITCOUNT': '2.990', 'weapon3': '3.226', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '42.000'} [2024-08-05 23:33:20,528][52647] DAMAGECOUNT value on done: 42806.0 [2024-08-05 23:33:20,529][52647] Sum rewards: 27.869, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.182', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon4': '0.268', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon2': '0.566', 'WEAPON3': '1.600', 'HITCOUNT': '2.200', 'weapon3': '2.844', 'DAMAGECOUNT': '8.715', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:20,979][52659] DAMAGECOUNT value on done: 39878.0 [2024-08-05 23:33:20,979][52659] Sum rewards: 31.196, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.756', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.106', 'AMMO3': '0.138', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.574', 'WEAPON3': '0.950', 'weapon2': '1.244', 'ARMOR': '1.259', 'weapon3': '1.802', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '8.514', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:21,019][52658] DAMAGECOUNT value on done: 39804.0 [2024-08-05 23:33:21,020][52658] Sum rewards: 32.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.878', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.089', 'weapon4': '0.128', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.734', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '2.832', 'DAMAGECOUNT': '9.105', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:21,226][52795] DAMAGECOUNT value on done: 37264.0 [2024-08-05 23:33:21,226][52795] Sum rewards: 39.800, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.045', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.020', 'ARMOR': '0.048', 'AMMO4': '0.086', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.494', 'WEAPON3': '0.900', 'HITCOUNT': '2.480', 'weapon3': '2.654', 'DAMAGECOUNT': '10.032', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:21,798][52650] Updated weights for policy 0, policy_version 15831 (0.0044) [2024-08-05 23:33:22,112][52670] DAMAGECOUNT value on done: 38290.0 [2024-08-05 23:33:22,114][52670] Sum rewards: 38.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.316', 'ARMOR': '0.467', 'WEAPON3': '1.100', 'weapon2': '1.110', 'HITCOUNT': '2.260', 'weapon3': '2.334', 'DAMAGECOUNT': '9.345', 'FRAGCOUNT': '34.000'} [2024-08-05 23:33:22,734][52671] DAMAGECOUNT value on done: 39691.0 [2024-08-05 23:33:22,734][52671] Sum rewards: 24.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO4': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon2': '1.262', 'HITCOUNT': '1.830', 'weapon3': '2.218', 'DAMAGECOUNT': '7.374', 'FRAGCOUNT': '24.000'} [2024-08-05 23:33:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 129695744. Throughput: 0: 4372.4. Samples: 32429310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 23:33:22,794][52567] Avg episode reward: [(0, '31.947')] [2024-08-05 23:33:23,237][52647] DAMAGECOUNT value on done: 40286.0 [2024-08-05 23:33:23,239][52647] Sum rewards: 37.411, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon5': '0.024', 'AMMO4': '0.117', 'weapon4': '0.118', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.958', 'ARMOR': '1.306', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '2.590', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:23,349][52663] DAMAGECOUNT value on done: 39498.0 [2024-08-05 23:33:23,350][52663] Sum rewards: 33.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.054', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.169', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'weapon4': '0.524', 'weapon2': '0.874', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.316', 'DAMAGECOUNT': '8.385', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:23,636][52659] DAMAGECOUNT value on done: 39590.0 [2024-08-05 23:33:23,638][52659] Sum rewards: 38.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.183', 'WEAPON4': '0.350', 'ARMOR': '0.444', 'WEAPON3': '1.050', 'weapon2': '1.148', 'HITCOUNT': '2.350', 'weapon3': '2.496', 'DAMAGECOUNT': '10.305', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:23,847][52658] DAMAGECOUNT value on done: 39010.0 [2024-08-05 23:33:23,847][52658] Sum rewards: 33.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.771', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'ARMOR': '0.873', 'weapon2': '0.998', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.688', 'DAMAGECOUNT': '9.555', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:24,312][52795] DAMAGECOUNT value on done: 34536.0 [2024-08-05 23:33:24,312][52795] Sum rewards: 29.886, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.029', 'weapon7': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.491', 'WEAPON3': '0.750', 'weapon4': '0.800', 'weapon2': '0.872', 'HITCOUNT': '1.620', 'weapon3': '1.870', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '24.500'} [2024-08-05 23:33:25,183][52671] DAMAGECOUNT value on done: 43076.0 [2024-08-05 23:33:25,191][52671] Sum rewards: 28.074, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.138', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'ARMOR': '0.812', 'WEAPON3': '1.000', 'weapon2': '1.114', 'HITCOUNT': '1.830', 'weapon3': '2.484', 'DAMAGECOUNT': '7.320', 'FRAGCOUNT': '23.000'} [2024-08-05 23:33:25,949][52647] DAMAGECOUNT value on done: 40123.0 [2024-08-05 23:33:25,950][52647] Sum rewards: 38.828, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.144', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.270', 'ARMOR': '0.400', 'weapon2': '0.836', 'WEAPON3': '1.000', 'HITCOUNT': '2.340', 'weapon3': '2.604', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:26,061][52659] DAMAGECOUNT value on done: 41767.0 [2024-08-05 23:33:26,064][52659] Sum rewards: 39.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.438', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.106', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.570', 'weapon2': '0.628', 'ARMOR': '0.890', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '34.000'} [2024-08-05 23:33:26,217][52663] DAMAGECOUNT value on done: 39553.0 [2024-08-05 23:33:26,217][52663] Sum rewards: 34.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.488', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.090', 'AMMO3': '0.189', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'weapon4': '0.416', 'WEAPON4': '0.550', 'weapon2': '0.896', 'WEAPON3': '1.300', 'ARMOR': '1.311', 'HITCOUNT': '2.230', 'weapon3': '2.304', 'DAMAGECOUNT': '9.573', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:26,556][52650] Updated weights for policy 0, policy_version 15841 (0.0013) [2024-08-05 23:33:26,838][52658] DAMAGECOUNT value on done: 42343.0 [2024-08-05 23:33:26,839][52658] Sum rewards: 32.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.265', 'AMMO5': '0.012', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.022', 'weapon4': '0.044', 'AMMO4': '0.081', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon2': '1.364', 'ARMOR': '1.749', 'HITCOUNT': '2.220', 'weapon3': '2.328', 'DAMAGECOUNT': '9.237', 'FRAGCOUNT': '30.500'} [2024-08-05 23:33:27,569][52795] DAMAGECOUNT value on done: 37735.0 [2024-08-05 23:33:27,569][52795] Sum rewards: 29.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.726', 'weapon5': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.185', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'ARMOR': '0.500', 'weapon4': '0.662', 'WEAPON4': '0.750', 'weapon2': '0.788', 'WEAPON3': '1.150', 'weapon3': '2.232', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.223', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 129785856. Throughput: 0: 4381.7. Samples: 32455730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:33:27,794][52567] Avg episode reward: [(0, '32.021')] [2024-08-05 23:33:27,927][52671] DAMAGECOUNT value on done: 39900.0 [2024-08-05 23:33:27,927][52671] Sum rewards: 37.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.066', 'AMMO4': '0.122', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.432', 'weapon2': '1.122', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '2.482', 'DAMAGECOUNT': '9.555', 'FRAGCOUNT': '35.000'} [2024-08-05 23:33:28,518][52647] DAMAGECOUNT value on done: 41501.0 [2024-08-05 23:33:28,520][52647] Sum rewards: 49.081, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.346', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.124', 'weapon4': '0.140', 'AMMO3': '0.152', 'ARMOR': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.056', 'weapon3': '2.450', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '39.000'} [2024-08-05 23:33:29,095][52659] DAMAGECOUNT value on done: 40929.0 [2024-08-05 23:33:29,095][52659] Sum rewards: 26.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.006', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.228', 'weapon2': '1.086', 'WEAPON3': '1.200', 'HITCOUNT': '1.880', 'weapon3': '2.318', 'DAMAGECOUNT': '7.422', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:30,701][52795] DAMAGECOUNT value on done: 37719.0 [2024-08-05 23:33:30,702][52795] Sum rewards: 36.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.726', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'ARMOR': '0.866', 'weapon2': '1.054', 'WEAPON3': '1.250', 'weapon3': '2.538', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '33.000'} [2024-08-05 23:33:30,873][52671] DAMAGECOUNT value on done: 40611.0 [2024-08-05 23:33:30,874][52671] Sum rewards: 30.043, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.195', 'AMMO4': '0.235', 'HEALTH': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.362', 'weapon2': '0.958', 'WEAPON3': '1.100', 'HITCOUNT': '1.980', 'weapon3': '2.256', 'DAMAGECOUNT': '7.821', 'FRAGCOUNT': '27.000'} [2024-08-05 23:33:31,117][52650] Updated weights for policy 0, policy_version 15851 (0.0019) [2024-08-05 23:33:31,500][52647] DAMAGECOUNT value on done: 40540.0 [2024-08-05 23:33:31,502][52647] Sum rewards: 35.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.776', 'AMMO2': '0.027', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.276', 'weapon2': '0.938', 'WEAPON3': '1.200', 'ARMOR': '1.244', 'HITCOUNT': '2.490', 'weapon3': '2.546', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:31,913][52659] DAMAGECOUNT value on done: 38121.0 [2024-08-05 23:33:31,916][52659] Sum rewards: 28.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.842', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.036', 'weapon4': '0.058', 'AMMO4': '0.169', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.918', 'WEAPON3': '1.150', 'weapon2': '1.262', 'HITCOUNT': '2.160', 'weapon3': '2.408', 'DAMAGECOUNT': '8.682', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:32,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 129884160. Throughput: 0: 4393.1. Samples: 32469130. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:33:32,794][52567] Avg episode reward: [(0, '31.988')] [2024-08-05 23:33:33,634][52671] DAMAGECOUNT value on done: 44776.0 [2024-08-05 23:33:33,636][52671] Sum rewards: 26.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.605', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.400', 'weapon4': '0.420', 'ARMOR': '0.480', 'weapon2': '1.104', 'WEAPON3': '1.150', 'HITCOUNT': '1.790', 'weapon3': '2.032', 'DAMAGECOUNT': '7.047', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:33,761][52649] DAMAGECOUNT value on done: 39119.0 [2024-08-05 23:33:33,762][52649] Sum rewards: 26.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'AMMO4': '0.199', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.444', 'weapon2': '0.940', 'WEAPON3': '1.050', 'HITCOUNT': '2.150', 'weapon3': '2.274', 'DAMAGECOUNT': '8.406', 'FRAGCOUNT': '24.000'} [2024-08-05 23:33:33,982][52795] DAMAGECOUNT value on done: 35720.0 [2024-08-05 23:33:33,982][52795] Sum rewards: 36.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.587', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.201', 'weapon2': '1.014', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '2.494', 'DAMAGECOUNT': '10.302', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:34,580][52647] DAMAGECOUNT value on done: 41014.0 [2024-08-05 23:33:34,580][52647] Sum rewards: 29.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.303', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.102', 'AMMO3': '0.193', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.278', 'HITCOUNT': '1.970', 'weapon3': '2.358', 'DAMAGECOUNT': '7.806', 'FRAGCOUNT': '27.000'} [2024-08-05 23:33:34,834][52659] DAMAGECOUNT value on done: 37904.0 [2024-08-05 23:33:34,837][52659] Sum rewards: 32.803, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.816', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.168', 'weapon4': '0.178', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'AMMO4': '0.269', 'WEAPON4': '0.500', 'weapon2': '1.072', 'WEAPON3': '1.150', 'HITCOUNT': '1.880', 'ARMOR': '2.250', 'weapon3': '2.258', 'DAMAGECOUNT': '8.373', 'FRAGCOUNT': '30.000'} [2024-08-05 23:33:35,834][52650] Updated weights for policy 0, policy_version 15861 (0.0025) [2024-08-05 23:33:36,571][52671] DAMAGECOUNT value on done: 39776.0 [2024-08-05 23:33:36,571][52671] Sum rewards: 25.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.496', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.178', 'weapon4': '0.208', 'WEAPON4': '0.450', 'ARMOR': '0.907', 'weapon2': '1.064', 'WEAPON3': '1.250', 'HITCOUNT': '1.830', 'weapon3': '2.364', 'DAMAGECOUNT': '7.857', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:36,742][52649] DAMAGECOUNT value on done: 39623.0 [2024-08-05 23:33:36,742][52649] Sum rewards: 27.986, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.271', 'AMMO5': '0.012', 'AMMO2': '0.038', 'ARMOR': '0.040', 'AMMO3': '0.103', 'weapon5': '0.116', 'AMMO4': '0.191', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.168', 'weapon3': '2.118', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '7.902', 'FRAGCOUNT': '22.000'} [2024-08-05 23:33:37,056][52795] DAMAGECOUNT value on done: 38065.0 [2024-08-05 23:33:37,058][52795] Sum rewards: 20.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.304', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.166', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.826', 'WEAPON3': '1.100', 'ARMOR': '1.272', 'HITCOUNT': '1.750', 'weapon3': '2.648', 'DAMAGECOUNT': '6.165', 'FRAGCOUNT': '20.000'} [2024-08-05 23:33:37,634][52659] DAMAGECOUNT value on done: 41717.0 [2024-08-05 23:33:37,636][52659] Sum rewards: 37.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.032', 'weapon4': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'ARMOR': '0.478', 'WEAPON3': '1.100', 'weapon2': '1.302', 'HITCOUNT': '2.370', 'weapon3': '2.416', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '30.000'} [2024-08-05 23:33:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 129966080. Throughput: 0: 4389.0. Samples: 32495420. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:33:37,794][52567] Avg episode reward: [(0, '31.913')] [2024-08-05 23:33:39,535][52671] DAMAGECOUNT value on done: 36945.0 [2024-08-05 23:33:39,538][52671] Sum rewards: 37.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.678', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.179', 'weapon4': '0.330', 'WEAPON4': '0.450', 'ARMOR': '0.834', 'weapon2': '0.840', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.558', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '34.000'} [2024-08-05 23:33:39,869][52649] DAMAGECOUNT value on done: 39077.0 [2024-08-05 23:33:39,869][52649] Sum rewards: 29.702, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.428', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'weapon2': '1.136', 'WEAPON3': '1.400', 'ARMOR': '1.439', 'HITCOUNT': '1.990', 'weapon3': '2.644', 'DAMAGECOUNT': '8.385', 'FRAGCOUNT': '30.000'} [2024-08-05 23:33:40,217][52795] DAMAGECOUNT value on done: 38746.0 [2024-08-05 23:33:40,219][52795] Sum rewards: 31.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.714', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'weapon4': '0.442', 'ARMOR': '0.505', 'weapon2': '0.912', 'WEAPON3': '1.300', 'weapon3': '2.334', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:40,269][52650] Updated weights for policy 0, policy_version 15871 (0.0025) [2024-08-05 23:33:40,422][52659] DAMAGECOUNT value on done: 39542.0 [2024-08-05 23:33:40,422][52659] Sum rewards: 34.291, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.150', 'weapon4': '0.372', 'WEAPON4': '0.400', 'weapon2': '0.736', 'ARMOR': '0.908', 'WEAPON3': '1.000', 'HITCOUNT': '2.290', 'weapon3': '2.684', 'DAMAGECOUNT': '8.436', 'FRAGCOUNT': '29.000'} [2024-08-05 23:33:42,001][52671] DAMAGECOUNT value on done: 42066.0 [2024-08-05 23:33:42,005][52671] Sum rewards: 40.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.561', 'AMMO5': '0.007', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.193', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'ARMOR': '0.494', 'weapon2': '0.810', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '2.794', 'DAMAGECOUNT': '9.939', 'FRAGCOUNT': '35.000'} [2024-08-05 23:33:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17614.6, 300 sec: 17522.6). Total num frames: 130056192. Throughput: 0: 4386.4. Samples: 32521580. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 23:33:42,794][52567] Avg episode reward: [(0, '32.088')] [2024-08-05 23:33:42,813][52649] DAMAGECOUNT value on done: 40591.0 [2024-08-05 23:33:42,814][52649] Sum rewards: 36.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'ARMOR': '0.473', 'weapon2': '0.912', 'WEAPON3': '1.250', 'HITCOUNT': '2.230', 'weapon3': '2.796', 'DAMAGECOUNT': '9.645', 'FRAGCOUNT': '33.000'} [2024-08-05 23:33:43,254][52659] DAMAGECOUNT value on done: 39752.0 [2024-08-05 23:33:43,255][52659] Sum rewards: 35.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.938', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.035', 'ARMOR': '0.056', 'AMMO4': '0.177', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.604', 'weapon2': '0.932', 'WEAPON3': '1.200', 'weapon3': '2.112', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '32.000'} [2024-08-05 23:33:43,320][52795] DAMAGECOUNT value on done: 36941.0 [2024-08-05 23:33:43,321][52795] Sum rewards: 31.470, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.040', 'weapon5': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon4': '1.100', 'weapon3': '1.726', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '25.000'} [2024-08-05 23:33:44,918][52671] DAMAGECOUNT value on done: 41414.0 [2024-08-05 23:33:44,918][52671] Sum rewards: 36.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.585', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.028', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.466', 'weapon4': '0.474', 'WEAPON3': '1.300', 'HITCOUNT': '2.190', 'weapon3': '2.500', 'DAMAGECOUNT': '8.844', 'FRAGCOUNT': '34.000'} [2024-08-05 23:33:45,208][52650] Updated weights for policy 0, policy_version 15881 (0.0014) [2024-08-05 23:33:45,511][52649] DAMAGECOUNT value on done: 38866.0 [2024-08-05 23:33:45,511][52649] Sum rewards: 30.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.122', 'AMMO2': '0.042', 'weapon4': '0.110', 'AMMO4': '0.210', 'AMMO3': '0.260', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '1.016', 'WEAPON3': '1.550', 'HITCOUNT': '2.260', 'weapon3': '2.596', 'DAMAGECOUNT': '8.913', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:46,008][52659] DAMAGECOUNT value on done: 38435.0 [2024-08-05 23:33:46,009][52659] Sum rewards: 30.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.222', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.028', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.984', 'WEAPON3': '1.200', 'ARMOR': '1.309', 'HITCOUNT': '2.260', 'weapon3': '2.496', 'DAMAGECOUNT': '9.357', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:46,428][52795] DAMAGECOUNT value on done: 40008.0 [2024-08-05 23:33:46,429][52795] Sum rewards: 34.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.552', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.588', 'ARMOR': '0.920', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.744', 'DAMAGECOUNT': '9.705', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:47,429][52671] DAMAGECOUNT value on done: 41724.0 [2024-08-05 23:33:47,438][52671] Sum rewards: 32.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'AMMO2': '0.023', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.184', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.770', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '2.746', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 130138112. Throughput: 0: 4391.3. Samples: 32534760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-05 23:33:47,794][52567] Avg episode reward: [(0, '32.271')] [2024-08-05 23:33:47,806][52614] Saving new best policy, reward=32.271! [2024-08-05 23:33:48,568][52649] DAMAGECOUNT value on done: 38879.0 [2024-08-05 23:33:48,568][52649] Sum rewards: 30.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.343', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.194', 'WEAPON5': '0.250', 'ARMOR': '0.800', 'WEAPON3': '1.100', 'weapon2': '1.246', 'HITCOUNT': '1.920', 'weapon3': '2.226', 'DAMAGECOUNT': '7.965', 'FRAGCOUNT': '27.000'} [2024-08-05 23:33:48,594][52659] DAMAGECOUNT value on done: 38594.0 [2024-08-05 23:33:48,595][52659] Sum rewards: 22.915, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.532', 'AMMO5': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.117', 'AMMO3': '0.180', 'weapon4': '0.308', 'WEAPON4': '0.400', 'ARMOR': '0.931', 'WEAPON3': '1.150', 'weapon2': '1.464', 'weapon3': '1.628', 'HITCOUNT': '1.690', 'DAMAGECOUNT': '6.336', 'FRAGCOUNT': '23.000'} [2024-08-05 23:33:49,488][52795] DAMAGECOUNT value on done: 40523.0 [2024-08-05 23:33:49,488][52795] Sum rewards: 35.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.362', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.039', 'weapon5': '0.078', 'AMMO4': '0.195', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.600', 'HITCOUNT': '2.220', 'weapon3': '2.756', 'DAMAGECOUNT': '9.027', 'FRAGCOUNT': '35.000'} [2024-08-05 23:33:49,558][52650] Updated weights for policy 0, policy_version 15891 (0.0037) [2024-08-05 23:33:49,946][52671] DAMAGECOUNT value on done: 39442.0 [2024-08-05 23:33:49,948][52671] Sum rewards: 23.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.514', 'AMMO5': '0.005', 'weapon5': '0.018', 'weapon4': '0.034', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO4': '0.204', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '1.116', 'ARMOR': '1.250', 'WEAPON3': '1.300', 'HITCOUNT': '1.930', 'weapon3': '2.560', 'DAMAGECOUNT': '7.680', 'FRAGCOUNT': '22.000'} [2024-08-05 23:33:51,079][52659] DAMAGECOUNT value on done: 40916.0 [2024-08-05 23:33:51,080][52659] Sum rewards: 25.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.454', 'AMMO5': '0.018', 'ARMOR': '0.068', 'AMMO2': '0.076', 'weapon5': '0.104', 'AMMO3': '0.222', 'AMMO4': '0.378', 'weapon4': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.750', 'weapon2': '0.804', 'WEAPON3': '1.450', 'HITCOUNT': '1.830', 'weapon3': '2.360', 'DAMAGECOUNT': '7.791', 'FRAGCOUNT': '26.000'} [2024-08-05 23:33:51,214][52649] DAMAGECOUNT value on done: 37477.0 [2024-08-05 23:33:51,215][52649] Sum rewards: 32.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.502', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.020', 'AMMO4': '0.093', 'weapon4': '0.118', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.408', 'weapon2': '1.012', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.646', 'DAMAGECOUNT': '9.114', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:51,608][52664] Large shaping reward 3.321 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.27, 90.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:33:52,604][52671] DAMAGECOUNT value on done: 40406.0 [2024-08-05 23:33:52,606][52671] Sum rewards: 39.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.506', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.768', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.888', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '35.000'} [2024-08-05 23:33:52,652][52795] DAMAGECOUNT value on done: 35231.0 [2024-08-05 23:33:52,652][52795] Sum rewards: 31.665, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.212', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.126', 'AMMO3': '0.138', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.920', 'WEAPON3': '0.950', 'weapon2': '1.510', 'weapon3': '1.702', 'HITCOUNT': '1.720', 'DAMAGECOUNT': '7.695', 'FRAGCOUNT': '27.000'} [2024-08-05 23:33:52,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17614.4, 300 sec: 17522.5). Total num frames: 130228224. Throughput: 0: 4394.9. Samples: 32561000. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:33:52,795][52567] Avg episode reward: [(0, '31.924')] [2024-08-05 23:33:53,681][52659] DAMAGECOUNT value on done: 44226.0 [2024-08-05 23:33:53,683][52659] Sum rewards: 43.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.660', 'AMMO5': '0.007', 'AMMO2': '0.074', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.368', 'ARMOR': '0.531', 'weapon2': '0.688', 'WEAPON4': '0.800', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '2.794', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '41.000'} [2024-08-05 23:33:53,782][52649] DAMAGECOUNT value on done: 39647.0 [2024-08-05 23:33:53,782][52649] Sum rewards: 43.719, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.034', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.172', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'weapon2': '0.786', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.728', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '36.000'} [2024-08-05 23:33:54,592][52650] Updated weights for policy 0, policy_version 15901 (0.0018) [2024-08-05 23:33:55,782][52795] DAMAGECOUNT value on done: 37155.0 [2024-08-05 23:33:55,785][52795] Sum rewards: 40.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.772', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.074', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.205', 'AMMO3': '0.207', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'weapon2': '0.872', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.598', 'DAMAGECOUNT': '11.022', 'FRAGCOUNT': '36.000'} [2024-08-05 23:33:56,066][52649] DAMAGECOUNT value on done: 37239.0 [2024-08-05 23:33:56,067][52649] Sum rewards: 21.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.494', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '1.132', 'WEAPON3': '1.150', 'ARMOR': '1.307', 'HITCOUNT': '1.630', 'weapon3': '2.206', 'DAMAGECOUNT': '6.552', 'FRAGCOUNT': '21.000'} [2024-08-05 23:33:56,909][52659] DAMAGECOUNT value on done: 39351.0 [2024-08-05 23:33:56,909][52659] Sum rewards: 29.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.700', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'weapon4': '0.214', 'AMMO3': '0.249', 'ARMOR': '0.886', 'weapon2': '1.076', 'WEAPON3': '1.650', 'HITCOUNT': '2.330', 'weapon3': '2.518', 'DAMAGECOUNT': '9.543', 'FRAGCOUNT': '28.000'} [2024-08-05 23:33:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 130310144. Throughput: 0: 4389.3. Samples: 32587220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:33:57,795][52567] Avg episode reward: [(0, '32.156')] [2024-08-05 23:33:58,687][52649] DAMAGECOUNT value on done: 38036.0 [2024-08-05 23:33:58,687][52649] Sum rewards: 36.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.468', 'AMMO5': '0.012', 'weapon5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.190', 'weapon4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.937', 'WEAPON3': '1.250', 'weapon2': '1.256', 'weapon3': '2.314', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '31.000'} [2024-08-05 23:33:58,911][52795] DAMAGECOUNT value on done: 38342.0 [2024-08-05 23:33:58,911][52795] Sum rewards: 31.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.448', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.108', 'AMMO3': '0.191', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON4': '0.450', 'weapon2': '0.666', 'ARMOR': '0.873', 'WEAPON3': '1.200', 'HITCOUNT': '2.060', 'weapon3': '2.564', 'DAMAGECOUNT': '8.949', 'FRAGCOUNT': '27.000'} [2024-08-05 23:33:59,150][52650] Updated weights for policy 0, policy_version 15911 (0.0019) [2024-08-05 23:33:59,264][52662] DAMAGECOUNT value on done: 45281.0 [2024-08-05 23:33:59,265][52662] Sum rewards: 29.711, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.398', 'ARMOR': '0.428', 'WEAPON3': '0.950', 'weapon2': '1.230', 'weapon3': '2.052', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '7.947', 'FRAGCOUNT': '24.500'} [2024-08-05 23:33:59,525][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:33:59,847][52659] DAMAGECOUNT value on done: 40334.0 [2024-08-05 23:33:59,849][52659] Sum rewards: 37.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.722', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.076', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.372', 'ARMOR': '0.400', 'weapon2': '0.636', 'WEAPON3': '1.150', 'HITCOUNT': '1.990', 'weapon3': '2.478', 'DAMAGECOUNT': '9.834', 'FRAGCOUNT': '33.000'} [2024-08-05 23:34:00,263][52794] DAMAGECOUNT value on done: 46199.0 [2024-08-05 23:34:00,263][52794] Sum rewards: 45.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.006', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.220', 'ARMOR': '0.868', 'weapon2': '1.020', 'WEAPON3': '1.350', 'weapon3': '2.514', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '41.000'} [2024-08-05 23:34:01,735][52649] DAMAGECOUNT value on done: 40311.0 [2024-08-05 23:34:01,738][52649] Sum rewards: 32.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.214', 'AMMO3': '0.227', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'ARMOR': '0.453', 'WEAPON4': '0.550', 'weapon2': '1.212', 'WEAPON3': '1.400', 'HITCOUNT': '2.200', 'weapon3': '2.264', 'DAMAGECOUNT': '9.450', 'FRAGCOUNT': '31.000'} [2024-08-05 23:34:01,941][52662] DAMAGECOUNT value on done: 47150.0 [2024-08-05 23:34:01,941][52662] Sum rewards: 35.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.370', 'ARMOR': '0.412', 'weapon2': '0.976', 'WEAPON3': '1.300', 'weapon3': '2.342', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '31.000'} [2024-08-05 23:34:02,685][52659] DAMAGECOUNT value on done: 40532.0 [2024-08-05 23:34:02,687][52659] Sum rewards: 24.362, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.062', 'HEALTH': '0.067', 'AMMO3': '0.118', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.418', 'WEAPON3': '0.700', 'ARMOR': '0.808', 'weapon2': '1.116', 'HITCOUNT': '1.540', 'weapon3': '1.902', 'DAMAGECOUNT': '5.262', 'FRAGCOUNT': '20.000'} [2024-08-05 23:34:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 130400256. Throughput: 0: 4390.0. Samples: 32600270. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:34:02,794][52567] Avg episode reward: [(0, '32.352')] [2024-08-05 23:34:02,817][52614] Saving new best policy, reward=32.352! [2024-08-05 23:34:03,597][52794] DAMAGECOUNT value on done: 44845.0 [2024-08-05 23:34:03,598][52794] Sum rewards: 28.874, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.499', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.076', 'weapon5': '0.076', 'AMMO4': '0.147', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.416', 'weapon2': '1.018', 'WEAPON3': '1.150', 'HITCOUNT': '2.400', 'weapon3': '2.530', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '24.000'} [2024-08-05 23:34:03,995][52650] Updated weights for policy 0, policy_version 15921 (0.0013) [2024-08-05 23:34:04,902][52649] DAMAGECOUNT value on done: 39777.0 [2024-08-05 23:34:04,903][52649] Sum rewards: 46.319, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.020', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.180', 'ARMOR': '0.875', 'weapon2': '0.948', 'WEAPON3': '1.100', 'weapon3': '2.596', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '38.000'} [2024-08-05 23:34:05,268][52659] DAMAGECOUNT value on done: 43168.0 [2024-08-05 23:34:05,269][52659] Sum rewards: 32.634, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO3': '0.146', 'AMMO4': '0.172', 'weapon5': '0.192', 'weapon4': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.284', 'ARMOR': '1.455', 'HITCOUNT': '1.970', 'weapon3': '2.044', 'DAMAGECOUNT': '8.985', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:05,317][52662] DAMAGECOUNT value on done: 49291.0 [2024-08-05 23:34:05,318][52662] Sum rewards: 35.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.488', 'weapon5': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.118', 'AMMO4': '0.168', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.934', 'weapon2': '1.058', 'WEAPON3': '1.350', 'HITCOUNT': '2.410', 'weapon3': '2.544', 'DAMAGECOUNT': '9.066', 'FRAGCOUNT': '32.000'} [2024-08-05 23:34:06,263][52794] DAMAGECOUNT value on done: 45232.0 [2024-08-05 23:34:06,263][52794] Sum rewards: 31.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.106', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon4': '0.214', 'weapon2': '0.772', 'ARMOR': '1.341', 'WEAPON3': '1.350', 'HITCOUNT': '2.460', 'weapon3': '2.652', 'DAMAGECOUNT': '9.009', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:07,795][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 130490368. Throughput: 0: 4383.1. Samples: 32626550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:34:07,795][52567] Avg episode reward: [(0, '32.734')] [2024-08-05 23:34:07,798][52614] Saving new best policy, reward=32.734! [2024-08-05 23:34:07,991][52649] DAMAGECOUNT value on done: 41356.0 [2024-08-05 23:34:07,991][52649] Sum rewards: 28.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.092', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'weapon4': '0.566', 'ARMOR': '0.880', 'WEAPON3': '0.900', 'weapon2': '1.132', 'HITCOUNT': '1.870', 'weapon3': '1.938', 'DAMAGECOUNT': '7.050', 'FRAGCOUNT': '25.000'} [2024-08-05 23:34:08,090][52662] DAMAGECOUNT value on done: 41458.0 [2024-08-05 23:34:08,091][52662] Sum rewards: 11.431, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.250', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.097', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.110', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'weapon4': '0.790', 'HITCOUNT': '0.950', 'weapon2': '0.970', 'weapon3': '1.726', 'DAMAGECOUNT': '3.528', 'FRAGCOUNT': '10.000'} [2024-08-05 23:34:08,725][52650] Updated weights for policy 0, policy_version 15931 (0.0026) [2024-08-05 23:34:09,343][52794] DAMAGECOUNT value on done: 40967.0 [2024-08-05 23:34:09,345][52794] Sum rewards: 30.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.172', 'weapon5': '0.016', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.450', 'ARMOR': '0.509', 'weapon2': '0.748', 'WEAPON3': '1.350', 'weapon3': '2.494', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.077', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:10,075][52668] DAMAGECOUNT value on done: 40254.0 [2024-08-05 23:34:10,075][52668] Sum rewards: 39.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.564', 'AMMO2': '0.037', 'AMMO3': '0.177', 'AMMO4': '0.186', 'weapon4': '0.356', 'ARMOR': '0.490', 'WEAPON4': '0.500', 'weapon2': '0.750', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '2.612', 'DAMAGECOUNT': '9.594', 'FRAGCOUNT': '35.000'} [2024-08-05 23:34:10,965][52662] DAMAGECOUNT value on done: 42765.0 [2024-08-05 23:34:10,966][52662] Sum rewards: 20.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.015', 'weapon5': '0.032', 'AMMO2': '0.039', 'ARMOR': '0.048', 'AMMO3': '0.177', 'AMMO4': '0.195', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.974', 'WEAPON3': '1.150', 'HITCOUNT': '1.540', 'weapon3': '2.470', 'DAMAGECOUNT': '6.615', 'FRAGCOUNT': '18.500'} [2024-08-05 23:34:11,339][52649] DAMAGECOUNT value on done: 39972.0 [2024-08-05 23:34:11,340][52649] Sum rewards: 25.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.847', 'AMMO2': '0.041', 'weapon4': '0.090', 'AMMO4': '0.202', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'ARMOR': '0.938', 'weapon2': '1.132', 'WEAPON3': '1.250', 'HITCOUNT': '2.130', 'weapon3': '2.530', 'DAMAGECOUNT': '8.337', 'FRAGCOUNT': '25.000'} [2024-08-05 23:34:12,016][52794] DAMAGECOUNT value on done: 44966.0 [2024-08-05 23:34:12,016][52794] Sum rewards: 30.543, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.996', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon7': '0.054', 'weapon5': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.292', 'weapon2': '0.796', 'WEAPON3': '1.150', 'HITCOUNT': '1.850', 'weapon3': '2.084', 'DAMAGECOUNT': '8.067', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:12,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 130580480. Throughput: 0: 4373.7. Samples: 32652550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:34:12,795][52567] Avg episode reward: [(0, '32.489')] [2024-08-05 23:34:13,298][52668] DAMAGECOUNT value on done: 43249.0 [2024-08-05 23:34:13,306][52668] Sum rewards: 38.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.312', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.088', 'AMMO4': '0.179', 'weapon4': '0.190', 'AMMO3': '0.196', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.752', 'ARMOR': '0.845', 'WEAPON3': '1.350', 'HITCOUNT': '2.300', 'weapon3': '2.616', 'DAMAGECOUNT': '9.579', 'FRAGCOUNT': '33.000'} [2024-08-05 23:34:13,315][52650] Updated weights for policy 0, policy_version 15941 (0.0019) [2024-08-05 23:34:13,823][52662] DAMAGECOUNT value on done: 45887.0 [2024-08-05 23:34:13,825][52662] Sum rewards: 24.447, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.291', 'AMMO5': '0.009', 'weapon4': '0.014', 'weapon5': '0.022', 'AMMO2': '0.033', 'ARMOR': '0.052', 'AMMO3': '0.148', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.488', 'HITCOUNT': '1.800', 'weapon3': '2.146', 'DAMAGECOUNT': '7.209', 'FRAGCOUNT': '21.000'} [2024-08-05 23:34:14,098][52649] DAMAGECOUNT value on done: 36395.0 [2024-08-05 23:34:14,099][52649] Sum rewards: 20.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.730', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.014', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'ARMOR': '0.885', 'weapon2': '1.106', 'WEAPON3': '1.350', 'HITCOUNT': '2.100', 'weapon3': '2.614', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '22.000'} [2024-08-05 23:34:15,023][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-05 23:34:15,161][52794] DAMAGECOUNT value on done: 45561.0 [2024-08-05 23:34:15,161][52794] Sum rewards: 28.336, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'ARMOR': '0.458', 'weapon4': '0.576', 'weapon2': '1.048', 'WEAPON3': '1.100', 'weapon3': '2.088', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '7.461', 'FRAGCOUNT': '24.000'} [2024-08-05 23:34:16,313][52668] DAMAGECOUNT value on done: 38831.0 [2024-08-05 23:34:16,313][52668] Sum rewards: 36.920, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.894', 'weapon4': '0.006', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.314', 'ARMOR': '1.651', 'HITCOUNT': '2.320', 'weapon3': '2.476', 'DAMAGECOUNT': '9.105', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:16,439][52649] DAMAGECOUNT value on done: 42191.0 [2024-08-05 23:34:16,439][52649] Sum rewards: 35.870, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.796', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.050', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'AMMO3': '0.294', 'weapon2': '0.778', 'ARMOR': '1.320', 'WEAPON3': '1.850', 'HITCOUNT': '2.380', 'weapon3': '2.814', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '35.000'} [2024-08-05 23:34:16,717][52662] DAMAGECOUNT value on done: 47671.0 [2024-08-05 23:34:16,719][52662] Sum rewards: 36.754, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.441', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'WEAPON3': '1.100', 'weapon2': '1.118', 'HITCOUNT': '2.300', 'weapon3': '2.644', 'DAMAGECOUNT': '10.041', 'FRAGCOUNT': '31.000'} [2024-08-05 23:34:17,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 130662400. Throughput: 0: 4366.9. Samples: 32665640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:34:17,795][52567] Avg episode reward: [(0, '32.564')] [2024-08-05 23:34:17,853][52650] Updated weights for policy 0, policy_version 15951 (0.0023) [2024-08-05 23:34:17,900][52794] DAMAGECOUNT value on done: 46879.0 [2024-08-05 23:34:17,900][52794] Sum rewards: 41.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'ARMOR': '0.949', 'WEAPON3': '1.100', 'weapon2': '1.204', 'weapon3': '2.332', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '35.000'} [2024-08-05 23:34:19,153][52649] DAMAGECOUNT value on done: 37386.0 [2024-08-05 23:34:19,153][52649] Sum rewards: 34.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.877', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.110', 'AMMO3': '0.153', 'weapon4': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.861', 'WEAPON3': '0.950', 'weapon2': '1.134', 'HITCOUNT': '1.920', 'weapon3': '2.174', 'DAMAGECOUNT': '9.201', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:19,424][52668] DAMAGECOUNT value on done: 40601.0 [2024-08-05 23:34:19,424][52668] Sum rewards: 25.272, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.596', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.110', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.911', 'HITCOUNT': '1.440', 'weapon2': '1.758', 'weapon3': '1.938', 'DAMAGECOUNT': '5.574', 'FRAGCOUNT': '21.000'} [2024-08-05 23:34:19,463][52662] DAMAGECOUNT value on done: 49408.0 [2024-08-05 23:34:19,465][52662] Sum rewards: 24.167, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.500', 'AMMO5': '0.015', 'weapon5': '0.026', 'AMMO2': '0.038', 'AMMO4': '0.188', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.326', 'ARMOR': '0.464', 'WEAPON4': '0.550', 'weapon2': '0.578', 'WEAPON3': '1.500', 'HITCOUNT': '2.100', 'weapon3': '2.722', 'DAMAGECOUNT': '8.682', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:20,522][52660] DAMAGECOUNT value on done: 41282.0 [2024-08-05 23:34:20,525][52660] Sum rewards: 29.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.256', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.066', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'ARMOR': '0.404', 'WEAPON3': '1.200', 'weapon2': '1.606', 'HITCOUNT': '2.110', 'weapon3': '2.188', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:20,605][52794] DAMAGECOUNT value on done: 42095.0 [2024-08-05 23:34:20,607][52794] Sum rewards: 26.967, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.119', 'weapon5': '0.196', 'AMMO4': '0.283', 'ARMOR': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON3': '0.750', 'weapon4': '0.942', 'weapon3': '1.848', 'HITCOUNT': '2.000', 'DAMAGECOUNT': '8.082', 'FRAGCOUNT': '22.000'} [2024-08-05 23:34:21,629][52649] DAMAGECOUNT value on done: 40791.0 [2024-08-05 23:34:21,630][52649] Sum rewards: 11.941, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.244', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.156', 'weapon5': '0.158', 'AMMO3': '0.173', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.432', 'WEAPON4': '0.450', 'weapon2': '0.558', 'weapon4': '0.836', 'WEAPON3': '1.050', 'HITCOUNT': '1.170', 'weapon3': '1.760', 'DAMAGECOUNT': '4.551', 'FRAGCOUNT': '11.500'} [2024-08-05 23:34:22,160][52820] DAMAGECOUNT value on done: 35095.0 [2024-08-05 23:34:22,161][52820] Sum rewards: 25.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.895', 'AMMO2': '0.007', 'weapon4': '0.012', 'weapon7': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.168', 'weapon2': '0.844', 'WEAPON3': '1.000', 'HITCOUNT': '1.670', 'weapon3': '2.718', 'DAMAGECOUNT': '7.143', 'FRAGCOUNT': '22.000'} [2024-08-05 23:34:22,346][52668] DAMAGECOUNT value on done: 41213.0 [2024-08-05 23:34:22,348][52668] Sum rewards: 27.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.452', 'AMMO5': '0.012', 'weapon5': '0.050', 'AMMO2': '0.055', 'weapon4': '0.072', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.277', 'WEAPON4': '0.550', 'ARMOR': '0.863', 'weapon2': '1.130', 'WEAPON3': '1.200', 'HITCOUNT': '1.990', 'weapon3': '2.320', 'DAMAGECOUNT': '7.809', 'FRAGCOUNT': '25.000'} [2024-08-05 23:34:22,360][52662] DAMAGECOUNT value on done: 43689.0 [2024-08-05 23:34:22,362][52662] Sum rewards: 33.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.536', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.270', 'ARMOR': '0.400', 'weapon2': '0.916', 'WEAPON3': '1.000', 'HITCOUNT': '2.260', 'weapon3': '2.446', 'DAMAGECOUNT': '8.910', 'FRAGCOUNT': '27.500'} [2024-08-05 23:34:22,622][52650] Updated weights for policy 0, policy_version 15961 (0.0022) [2024-08-05 23:34:22,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 130752512. Throughput: 0: 4372.0. Samples: 32692160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:34:22,794][52567] Avg episode reward: [(0, '32.184')] [2024-08-05 23:34:23,326][52794] DAMAGECOUNT value on done: 45741.0 [2024-08-05 23:34:23,328][52794] Sum rewards: 33.177, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.522', 'AMMO5': '0.007', 'weapon5': '0.008', 'weapon4': '0.024', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO4': '0.223', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon2': '0.832', 'WEAPON3': '1.500', 'HITCOUNT': '2.360', 'weapon3': '2.836', 'DAMAGECOUNT': '9.390', 'FRAGCOUNT': '32.000'} [2024-08-05 23:34:23,575][52660] DAMAGECOUNT value on done: 41907.0 [2024-08-05 23:34:23,575][52660] Sum rewards: 33.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.556', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon4': '0.194', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.718', 'ARMOR': '0.948', 'WEAPON3': '1.300', 'HITCOUNT': '2.380', 'weapon3': '2.846', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '31.000'} [2024-08-05 23:34:24,414][52649] DAMAGECOUNT value on done: 40543.0 [2024-08-05 23:34:24,426][52649] Sum rewards: 27.799, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.229', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'weapon4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.602', 'ARMOR': '0.853', 'WEAPON3': '1.600', 'HITCOUNT': '2.100', 'weapon3': '2.888', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:25,179][52662] DAMAGECOUNT value on done: 44798.0 [2024-08-05 23:34:25,180][52662] Sum rewards: 34.955, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.128', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon2': '1.072', 'WEAPON3': '1.100', 'HITCOUNT': '2.250', 'weapon3': '2.562', 'DAMAGECOUNT': '9.711', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:25,414][52820] DAMAGECOUNT value on done: 37732.0 [2024-08-05 23:34:25,415][52820] Sum rewards: 32.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.055', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.062', 'AMMO4': '0.121', 'AMMO3': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.018', 'HITCOUNT': '2.120', 'weapon3': '2.318', 'DAMAGECOUNT': '8.205', 'FRAGCOUNT': '26.000'} [2024-08-05 23:34:25,472][52668] DAMAGECOUNT value on done: 42661.0 [2024-08-05 23:34:25,473][52668] Sum rewards: 36.479, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.884', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.034', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.230', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.860', 'WEAPON3': '1.450', 'HITCOUNT': '2.350', 'weapon3': '2.702', 'DAMAGECOUNT': '10.158', 'FRAGCOUNT': '36.000'} [2024-08-05 23:34:26,440][52794] DAMAGECOUNT value on done: 46858.0 [2024-08-05 23:34:26,442][52794] Sum rewards: 39.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.526', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.028', 'AMMO4': '0.058', 'weapon5': '0.138', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.886', 'WEAPON3': '1.150', 'weapon3': '2.024', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '10.821', 'FRAGCOUNT': '35.000'} [2024-08-05 23:34:26,862][52660] DAMAGECOUNT value on done: 40985.0 [2024-08-05 23:34:26,863][52660] Sum rewards: 29.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.212', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon4': '0.330', 'weapon2': '0.584', 'WEAPON3': '1.250', 'HITCOUNT': '1.740', 'weapon3': '2.692', 'DAMAGECOUNT': '8.319', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:26,984][52650] Updated weights for policy 0, policy_version 15971 (0.0019) [2024-08-05 23:34:27,383][52649] DAMAGECOUNT value on done: 42971.0 [2024-08-05 23:34:27,385][52649] Sum rewards: 39.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'ARMOR': '0.400', 'weapon2': '0.894', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.724', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '34.000'} [2024-08-05 23:34:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 130842624. Throughput: 0: 4373.8. Samples: 32718400. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:34:27,795][52567] Avg episode reward: [(0, '32.093')] [2024-08-05 23:34:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015972_130842624.pth... [2024-08-05 23:34:27,924][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015459_126640128.pth [2024-08-05 23:34:28,311][52662] DAMAGECOUNT value on done: 44810.0 [2024-08-05 23:34:28,314][52662] Sum rewards: 29.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.661', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.030', 'AMMO4': '0.124', 'AMMO3': '0.164', 'weapon4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.901', 'weapon2': '0.922', 'WEAPON3': '1.050', 'HITCOUNT': '1.820', 'weapon3': '2.646', 'DAMAGECOUNT': '6.930', 'FRAGCOUNT': '25.000'} [2024-08-05 23:34:28,594][52820] DAMAGECOUNT value on done: 36127.0 [2024-08-05 23:34:28,596][52820] Sum rewards: 35.608, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.973', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.138', 'WEAPON3': '0.950', 'ARMOR': '1.306', 'weapon2': '1.364', 'HITCOUNT': '2.180', 'weapon3': '2.388', 'DAMAGECOUNT': '8.835', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:28,646][52668] DAMAGECOUNT value on done: 43540.0 [2024-08-05 23:34:28,647][52668] Sum rewards: 28.560, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.044', 'HEALTH': '0.075', 'AMMO3': '0.109', 'weapon5': '0.118', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon2': '0.884', 'weapon4': '1.030', 'weapon3': '1.692', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '8.160', 'FRAGCOUNT': '21.000'} [2024-08-05 23:34:29,578][52794] DAMAGECOUNT value on done: 46185.0 [2024-08-05 23:34:29,580][52794] Sum rewards: 44.531, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.178', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.388', 'ARMOR': '0.507', 'weapon2': '1.086', 'WEAPON3': '1.100', 'weapon3': '2.298', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '37.000'} [2024-08-05 23:34:29,653][52660] DAMAGECOUNT value on done: 40686.0 [2024-08-05 23:34:29,653][52660] Sum rewards: 39.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon5': '0.052', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.197', 'weapon2': '0.626', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.872', 'DAMAGECOUNT': '9.450', 'FRAGCOUNT': '36.000'} [2024-08-05 23:34:31,294][52668] DAMAGECOUNT value on done: 43400.0 [2024-08-05 23:34:31,294][52668] Sum rewards: 30.268, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.894', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.312', 'WEAPON4': '0.400', 'ARMOR': '0.955', 'WEAPON3': '1.250', 'weapon2': '1.268', 'HITCOUNT': '2.100', 'weapon3': '2.196', 'DAMAGECOUNT': '8.454', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:31,353][52662] DAMAGECOUNT value on done: 44012.0 [2024-08-05 23:34:31,356][52662] Sum rewards: 32.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.929', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.040', 'weapon4': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'ARMOR': '1.318', 'weapon2': '1.440', 'HITCOUNT': '1.720', 'weapon3': '2.228', 'DAMAGECOUNT': '7.617', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:31,817][52820] DAMAGECOUNT value on done: 36272.0 [2024-08-05 23:34:31,817][52820] Sum rewards: 21.085, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.086', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.604', 'WEAPON3': '0.800', 'ARMOR': '0.910', 'weapon4': '0.944', 'HITCOUNT': '1.110', 'weapon3': '1.704', 'DAMAGECOUNT': '4.542', 'FRAGCOUNT': '19.000'} [2024-08-05 23:34:32,141][52650] Updated weights for policy 0, policy_version 15981 (0.0012) [2024-08-05 23:34:32,402][52660] DAMAGECOUNT value on done: 36725.0 [2024-08-05 23:34:32,402][52660] Sum rewards: 29.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.199', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '1.242', 'WEAPON3': '1.250', 'ARMOR': '1.401', 'HITCOUNT': '1.780', 'weapon3': '2.240', 'DAMAGECOUNT': '7.890', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:32,536][52794] DAMAGECOUNT value on done: 47117.0 [2024-08-05 23:34:32,536][52794] Sum rewards: 37.878, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.662', 'weapon4': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.300', 'ARMOR': '0.476', 'WEAPON3': '0.900', 'weapon2': '1.132', 'HITCOUNT': '2.080', 'weapon3': '2.440', 'DAMAGECOUNT': '10.344', 'FRAGCOUNT': '30.000'} [2024-08-05 23:34:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 130932736. Throughput: 0: 4366.4. Samples: 32731250. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-05 23:34:32,795][52567] Avg episode reward: [(0, '32.004')] [2024-08-05 23:34:33,002][52664] DAMAGECOUNT value on done: 41650.0 [2024-08-05 23:34:33,002][52664] Sum rewards: 39.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.688', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.942', 'WEAPON3': '1.250', 'weapon3': '2.420', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.133', 'FRAGCOUNT': '34.500'} [2024-08-05 23:34:34,353][52668] DAMAGECOUNT value on done: 40088.0 [2024-08-05 23:34:34,354][52668] Sum rewards: 37.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.244', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.051', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'ARMOR': '0.404', 'WEAPON3': '1.200', 'weapon2': '1.404', 'HITCOUNT': '2.120', 'weapon3': '2.240', 'DAMAGECOUNT': '9.996', 'FRAGCOUNT': '33.000'} [2024-08-05 23:34:34,487][52662] DAMAGECOUNT value on done: 45613.0 [2024-08-05 23:34:34,488][52662] Sum rewards: 36.703, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.773', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.054', 'weapon4': '0.072', 'AMMO4': '0.256', 'AMMO3': '0.293', 'WEAPON5': '0.400', 'ARMOR': '0.518', 'WEAPON4': '0.550', 'weapon2': '0.642', 'WEAPON3': '1.850', 'HITCOUNT': '2.570', 'weapon3': '2.948', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '36.000'} [2024-08-05 23:34:34,972][52820] DAMAGECOUNT value on done: 37409.0 [2024-08-05 23:34:34,974][52820] Sum rewards: 24.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.282', 'AMMO2': '0.033', 'AMMO3': '0.147', 'AMMO4': '0.165', 'weapon4': '0.222', 'WEAPON4': '0.250', 'ARMOR': '0.828', 'WEAPON3': '0.900', 'weapon2': '0.986', 'HITCOUNT': '1.800', 'weapon3': '2.422', 'DAMAGECOUNT': '7.119', 'FRAGCOUNT': '21.000'} [2024-08-05 23:34:35,562][52660] DAMAGECOUNT value on done: 42065.0 [2024-08-05 23:34:35,563][52660] Sum rewards: 42.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.516', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.243', 'weapon2': '0.440', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '3.320', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '39.000'} [2024-08-05 23:34:35,724][52794] DAMAGECOUNT value on done: 44506.0 [2024-08-05 23:34:35,735][52794] Sum rewards: 22.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.226', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'weapon4': '0.204', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'ARMOR': '0.876', 'weapon2': '1.222', 'WEAPON3': '1.250', 'HITCOUNT': '1.830', 'weapon3': '2.202', 'DAMAGECOUNT': '7.299', 'FRAGCOUNT': '21.000'} [2024-08-05 23:34:36,103][52664] DAMAGECOUNT value on done: 40535.0 [2024-08-05 23:34:36,103][52664] Sum rewards: 29.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.823', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon5': '0.176', 'AMMO3': '0.177', 'AMMO4': '0.284', 'weapon4': '0.364', 'WEAPON5': '0.500', 'ARMOR': '0.511', 'WEAPON4': '0.550', 'weapon2': '0.850', 'WEAPON3': '1.100', 'HITCOUNT': '2.040', 'weapon3': '2.296', 'DAMAGECOUNT': '8.019', 'FRAGCOUNT': '26.000'} [2024-08-05 23:34:36,868][52650] Updated weights for policy 0, policy_version 15991 (0.0012) [2024-08-05 23:34:37,538][52668] DAMAGECOUNT value on done: 43510.0 [2024-08-05 23:34:37,539][52668] Sum rewards: 34.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon2': '1.244', 'ARMOR': '2.114', 'HITCOUNT': '2.360', 'weapon3': '2.472', 'DAMAGECOUNT': '9.519', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:37,740][52662] DAMAGECOUNT value on done: 44767.0 [2024-08-05 23:34:37,743][52662] Sum rewards: 26.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.146', 'weapon5': '0.162', 'AMMO4': '0.203', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.489', 'weapon4': '0.622', 'WEAPON3': '0.900', 'weapon2': '1.062', 'weapon3': '1.614', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '7.554', 'FRAGCOUNT': '23.000'} [2024-08-05 23:34:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 131014656. Throughput: 0: 4375.6. Samples: 32757900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:34:37,794][52567] Avg episode reward: [(0, '31.875')] [2024-08-05 23:34:38,231][52820] DAMAGECOUNT value on done: 37981.0 [2024-08-05 23:34:38,231][52820] Sum rewards: 18.145, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.975', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.122', 'AMMO4': '0.188', 'WEAPON4': '0.400', 'weapon2': '0.688', 'WEAPON3': '0.800', 'weapon4': '0.888', 'HITCOUNT': '1.690', 'weapon3': '1.900', 'DAMAGECOUNT': '6.000', 'FRAGCOUNT': '16.000'} [2024-08-05 23:34:38,545][52664] DAMAGECOUNT value on done: 42674.0 [2024-08-05 23:34:38,546][52664] Sum rewards: 34.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.236', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.172', 'weapon4': '0.386', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'weapon2': '0.568', 'WEAPON3': '1.050', 'HITCOUNT': '1.970', 'weapon3': '2.498', 'DAMAGECOUNT': '8.361', 'FRAGCOUNT': '30.500'} [2024-08-05 23:34:38,754][52660] DAMAGECOUNT value on done: 41575.0 [2024-08-05 23:34:38,755][52660] Sum rewards: 34.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.752', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.750', 'ARMOR': '0.800', 'WEAPON3': '1.550', 'HITCOUNT': '2.270', 'weapon3': '2.642', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '32.000'} [2024-08-05 23:34:38,811][52794] DAMAGECOUNT value on done: 49495.0 [2024-08-05 23:34:38,814][52794] Sum rewards: 30.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.320', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.061', 'AMMO3': '0.191', 'WEAPON3': '1.100', 'ARMOR': '1.220', 'weapon2': '1.446', 'HITCOUNT': '2.330', 'weapon3': '2.348', 'DAMAGECOUNT': '9.303', 'FRAGCOUNT': '25.000'} [2024-08-05 23:34:40,425][52662] DAMAGECOUNT value on done: 45733.0 [2024-08-05 23:34:40,426][52662] Sum rewards: 30.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.746', 'AMMO2': '0.017', 'weapon4': '0.078', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'ARMOR': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.182', 'HITCOUNT': '2.060', 'weapon3': '2.506', 'DAMAGECOUNT': '8.409', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:40,541][52668] DAMAGECOUNT value on done: 40242.0 [2024-08-05 23:34:40,542][52668] Sum rewards: 20.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.316', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.296', 'ARMOR': '0.995', 'weapon2': '1.350', 'WEAPON3': '1.400', 'HITCOUNT': '1.890', 'weapon3': '1.928', 'DAMAGECOUNT': '7.200', 'FRAGCOUNT': '21.000'} [2024-08-05 23:34:41,063][52650] Updated weights for policy 0, policy_version 16001 (0.0012) [2024-08-05 23:34:41,347][52820] DAMAGECOUNT value on done: 39106.0 [2024-08-05 23:34:41,347][52820] Sum rewards: 46.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.968', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.138', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'ARMOR': '0.455', 'weapon2': '0.946', 'WEAPON3': '1.200', 'weapon3': '2.558', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '39.000'} [2024-08-05 23:34:41,493][52794] DAMAGECOUNT value on done: 43508.0 [2024-08-05 23:34:41,493][52794] Sum rewards: 31.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.124', 'AMMO3': '0.127', 'weapon4': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.496', 'WEAPON3': '0.900', 'weapon2': '1.408', 'weapon3': '1.898', 'HITCOUNT': '1.980', 'DAMAGECOUNT': '8.412', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:41,507][52664] DAMAGECOUNT value on done: 42301.0 [2024-08-05 23:34:41,508][52664] Sum rewards: 35.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.020', 'AMMO2': '0.004', 'AMMO5': '0.008', 'AMMO4': '0.019', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.364', 'weapon2': '0.614', 'ARMOR': '0.939', 'WEAPON3': '1.000', 'weapon3': '2.306', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.384', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:41,749][52660] DAMAGECOUNT value on done: 41257.0 [2024-08-05 23:34:41,750][52660] Sum rewards: 37.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.264', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.228', 'weapon4': '0.262', 'WEAPON4': '0.400', 'ARMOR': '0.432', 'weapon2': '1.004', 'WEAPON3': '1.450', 'weapon3': '2.422', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '34.000'} [2024-08-05 23:34:42,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 131096576. Throughput: 0: 4377.3. Samples: 32784200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:34:42,794][52567] Avg episode reward: [(0, '32.047')] [2024-08-05 23:34:43,129][52662] DAMAGECOUNT value on done: 47568.0 [2024-08-05 23:34:43,129][52662] Sum rewards: 29.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.119', 'AMMO2': '0.045', 'AMMO4': '0.223', 'AMMO3': '0.233', 'weapon4': '0.316', 'WEAPON4': '0.550', 'ARMOR': '0.840', 'weapon2': '0.870', 'WEAPON3': '1.400', 'HITCOUNT': '2.160', 'weapon3': '2.516', 'DAMAGECOUNT': '8.823', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:43,477][52668] DAMAGECOUNT value on done: 40970.0 [2024-08-05 23:34:43,477][52668] Sum rewards: 30.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.097', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'ARMOR': '0.453', 'weapon2': '0.844', 'WEAPON3': '1.350', 'HITCOUNT': '2.090', 'weapon3': '2.892', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:44,190][52794] DAMAGECOUNT value on done: 47201.0 [2024-08-05 23:34:44,190][52794] Sum rewards: 29.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.498', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon5': '0.114', 'weapon4': '0.152', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'ARMOR': '0.862', 'weapon2': '1.006', 'WEAPON3': '1.350', 'HITCOUNT': '2.120', 'weapon3': '2.482', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:44,299][52664] DAMAGECOUNT value on done: 41749.0 [2024-08-05 23:34:44,300][52664] Sum rewards: 39.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.108', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.054', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'weapon2': '1.150', 'WEAPON3': '1.200', 'weapon3': '2.492', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '33.000'} [2024-08-05 23:34:44,493][52820] DAMAGECOUNT value on done: 37573.0 [2024-08-05 23:34:44,495][52820] Sum rewards: 26.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.826', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.196', 'WEAPON4': '0.450', 'weapon4': '0.520', 'ARMOR': '0.978', 'weapon2': '1.060', 'WEAPON3': '1.250', 'HITCOUNT': '2.030', 'weapon3': '2.206', 'DAMAGECOUNT': '7.929', 'FRAGCOUNT': '24.000'} [2024-08-05 23:34:44,833][52660] DAMAGECOUNT value on done: 40717.0 [2024-08-05 23:34:44,835][52660] Sum rewards: 34.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.927', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.045', 'weapon5': '0.110', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.258', 'ARMOR': '0.467', 'weapon2': '0.652', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.642', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '30.500'} [2024-08-05 23:34:45,710][52662] DAMAGECOUNT value on done: 43649.0 [2024-08-05 23:34:45,712][52662] Sum rewards: 28.206, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.908', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.135', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.376', 'ARMOR': '0.862', 'weapon2': '0.892', 'WEAPON3': '0.900', 'HITCOUNT': '1.990', 'weapon3': '2.164', 'DAMAGECOUNT': '7.767', 'FRAGCOUNT': '21.500'} [2024-08-05 23:34:45,915][52650] Updated weights for policy 0, policy_version 16011 (0.0011) [2024-08-05 23:34:46,597][52668] DAMAGECOUNT value on done: 38805.0 [2024-08-05 23:34:46,600][52668] Sum rewards: 26.037, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.902', 'AMMO5': '0.006', 'weapon5': '0.030', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.214', 'WEAPON4': '0.400', 'weapon4': '0.704', 'weapon2': '0.864', 'WEAPON3': '1.150', 'HITCOUNT': '2.030', 'weapon3': '2.090', 'DAMAGECOUNT': '7.563', 'FRAGCOUNT': '22.000'} [2024-08-05 23:34:46,686][52794] DAMAGECOUNT value on done: 46752.0 [2024-08-05 23:34:46,687][52794] Sum rewards: 23.829, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.712', 'AMMO5': '0.025', 'AMMO2': '0.042', 'AMMO3': '0.107', 'weapon5': '0.152', 'AMMO4': '0.209', 'ARMOR': '0.507', 'weapon4': '0.540', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.700', 'weapon2': '1.204', 'HITCOUNT': '1.710', 'weapon3': '1.742', 'DAMAGECOUNT': '6.753', 'FRAGCOUNT': '19.000'} [2024-08-05 23:34:46,945][52664] DAMAGECOUNT value on done: 44904.0 [2024-08-05 23:34:46,945][52664] Sum rewards: 35.324, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.652', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.842', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.804', 'DAMAGECOUNT': '9.402', 'FRAGCOUNT': '33.000'} [2024-08-05 23:34:47,669][52660] DAMAGECOUNT value on done: 41151.0 [2024-08-05 23:34:47,670][52660] Sum rewards: 44.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.996', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.102', 'AMMO4': '0.157', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.424', 'weapon2': '0.982', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.580', 'DAMAGECOUNT': '11.079', 'FRAGCOUNT': '37.000'} [2024-08-05 23:34:47,717][52820] DAMAGECOUNT value on done: 36294.0 [2024-08-05 23:34:47,718][52820] Sum rewards: 36.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'weapon4': '0.010', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.191', 'ARMOR': '0.400', 'weapon2': '0.834', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.926', 'DAMAGECOUNT': '10.128', 'FRAGCOUNT': '32.000'} [2024-08-05 23:34:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 131194880. Throughput: 0: 4380.2. Samples: 32797380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:34:47,794][52567] Avg episode reward: [(0, '31.857')] [2024-08-05 23:34:48,456][52662] DAMAGECOUNT value on done: 46460.0 [2024-08-05 23:34:48,456][52662] Sum rewards: 31.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.758', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '1.082', 'WEAPON3': '1.250', 'HITCOUNT': '2.050', 'weapon3': '2.562', 'DAMAGECOUNT': '8.265', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:49,459][52668] DAMAGECOUNT value on done: 40777.0 [2024-08-05 23:34:49,459][52668] Sum rewards: 29.717, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.322', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO4': '0.188', 'weapon4': '0.210', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.638', 'ARMOR': '1.333', 'WEAPON3': '1.500', 'HITCOUNT': '1.990', 'weapon3': '2.612', 'DAMAGECOUNT': '8.709', 'FRAGCOUNT': '28.000'} [2024-08-05 23:34:49,478][52794] DAMAGECOUNT value on done: 45574.0 [2024-08-05 23:34:49,479][52794] Sum rewards: 29.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.104', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.462', 'weapon2': '0.602', 'ARMOR': '1.004', 'WEAPON3': '1.050', 'HITCOUNT': '2.090', 'weapon3': '2.556', 'DAMAGECOUNT': '8.142', 'FRAGCOUNT': '24.000'} [2024-08-05 23:34:50,132][52664] DAMAGECOUNT value on done: 43081.0 [2024-08-05 23:34:50,135][52664] Sum rewards: 43.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.011', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.160', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.684', 'WEAPON3': '1.050', 'weapon3': '2.538', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '36.000'} [2024-08-05 23:34:50,343][52650] Updated weights for policy 0, policy_version 16021 (0.0012) [2024-08-05 23:34:50,577][52660] DAMAGECOUNT value on done: 40539.0 [2024-08-05 23:34:50,580][52660] Sum rewards: 25.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.254', 'weapon4': '0.312', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'weapon2': '0.936', 'WEAPON3': '1.100', 'HITCOUNT': '2.170', 'weapon3': '2.456', 'DAMAGECOUNT': '7.905', 'FRAGCOUNT': '24.000'} [2024-08-05 23:34:50,810][52820] DAMAGECOUNT value on done: 37311.0 [2024-08-05 23:34:50,811][52820] Sum rewards: 47.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.124', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'ARMOR': '0.400', 'weapon2': '0.738', 'WEAPON3': '1.500', 'HITCOUNT': '2.680', 'weapon3': '2.886', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '44.000'} [2024-08-05 23:34:51,136][52662] DAMAGECOUNT value on done: 45205.0 [2024-08-05 23:34:51,136][52662] Sum rewards: 41.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.972', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon4': '0.296', 'ARMOR': '0.476', 'weapon2': '0.916', 'WEAPON3': '1.100', 'weapon3': '2.378', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '37.000'} [2024-08-05 23:34:52,225][52794] DAMAGECOUNT value on done: 46658.0 [2024-08-05 23:34:52,233][52794] Sum rewards: 32.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.958', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.086', 'AMMO3': '0.151', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.464', 'weapon2': '0.842', 'WEAPON3': '1.000', 'HITCOUNT': '2.040', 'weapon3': '2.544', 'DAMAGECOUNT': '8.697', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:52,417][52668] DAMAGECOUNT value on done: 40535.0 [2024-08-05 23:34:52,418][52668] Sum rewards: 38.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.239', 'AMMO5': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO3': '0.184', 'AMMO4': '0.219', 'WEAPON5': '0.450', 'weapon4': '0.516', 'WEAPON4': '0.550', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.102', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.209', 'FRAGCOUNT': '33.000'} [2024-08-05 23:34:52,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 131284992. Throughput: 0: 4382.5. Samples: 32823760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:34:52,794][52567] Avg episode reward: [(0, '32.222')] [2024-08-05 23:34:53,324][52664] DAMAGECOUNT value on done: 39681.0 [2024-08-05 23:34:53,324][52664] Sum rewards: 31.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.166', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.066', 'weapon4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON3': '1.100', 'weapon2': '1.174', 'ARMOR': '1.718', 'HITCOUNT': '1.910', 'weapon3': '2.464', 'DAMAGECOUNT': '8.304', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:53,514][52660] DAMAGECOUNT value on done: 41148.0 [2024-08-05 23:34:53,515][52660] Sum rewards: 36.247, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.997', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.119', 'weapon4': '0.216', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'weapon2': '1.232', 'HITCOUNT': '2.200', 'weapon3': '2.224', 'DAMAGECOUNT': '9.816', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:53,981][52820] DAMAGECOUNT value on done: 39024.0 [2024-08-05 23:34:53,982][52820] Sum rewards: 28.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'weapon5': '0.018', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.158', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.942', 'weapon2': '1.128', 'WEAPON3': '1.150', 'HITCOUNT': '2.070', 'weapon3': '2.520', 'DAMAGECOUNT': '8.058', 'FRAGCOUNT': '25.000'} [2024-08-05 23:34:54,117][52662] DAMAGECOUNT value on done: 45567.0 [2024-08-05 23:34:54,118][52662] Sum rewards: 42.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.504', 'AMMO2': '0.014', 'AMMO5': '0.014', 'weapon5': '0.030', 'weapon4': '0.052', 'AMMO4': '0.069', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.636', 'ARMOR': '0.967', 'WEAPON3': '1.700', 'HITCOUNT': '2.420', 'weapon3': '3.012', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '39.000'} [2024-08-05 23:34:55,200][52650] Updated weights for policy 0, policy_version 16031 (0.0020) [2024-08-05 23:34:55,357][52668] DAMAGECOUNT value on done: 40665.0 [2024-08-05 23:34:55,358][52668] Sum rewards: 32.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.347', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'AMMO3': '0.217', 'AMMO4': '0.258', 'weapon4': '0.308', 'WEAPON4': '0.600', 'ARMOR': '0.906', 'weapon2': '1.022', 'WEAPON3': '1.350', 'HITCOUNT': '2.200', 'weapon3': '2.382', 'DAMAGECOUNT': '9.564', 'FRAGCOUNT': '31.000'} [2024-08-05 23:34:55,405][52794] DAMAGECOUNT value on done: 46140.0 [2024-08-05 23:34:55,406][52794] Sum rewards: 31.649, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.060', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.132', 'weapon4': '0.310', 'WEAPON3': '0.800', 'weapon2': '0.974', 'HITCOUNT': '1.990', 'weapon3': '2.498', 'DAMAGECOUNT': '8.355', 'FRAGCOUNT': '24.500'} [2024-08-05 23:34:56,284][52664] DAMAGECOUNT value on done: 46907.0 [2024-08-05 23:34:56,285][52664] Sum rewards: 33.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.508', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon4': '0.432', 'weapon2': '0.752', 'ARMOR': '0.899', 'WEAPON3': '1.450', 'weapon3': '2.392', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '30.000'} [2024-08-05 23:34:56,606][52660] DAMAGECOUNT value on done: 39617.0 [2024-08-05 23:34:56,606][52660] Sum rewards: 31.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.118', 'AMMO5': '0.005', 'weapon4': '0.010', 'weapon5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'ARMOR': '1.256', 'WEAPON3': '1.300', 'weapon2': '1.416', 'HITCOUNT': '2.280', 'weapon3': '2.362', 'DAMAGECOUNT': '8.442', 'FRAGCOUNT': '30.000'} [2024-08-05 23:34:56,758][52669] DAMAGECOUNT value on done: 41667.0 [2024-08-05 23:34:56,758][52669] Sum rewards: 25.430, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.089', 'weapon5': '0.016', 'AMMO5': '0.030', 'AMMO2': '0.071', 'ARMOR': '0.080', 'AMMO3': '0.116', 'AMMO4': '0.357', 'WEAPON5': '0.600', 'weapon4': '0.638', 'WEAPON3': '0.750', 'weapon2': '0.776', 'WEAPON4': '0.800', 'HITCOUNT': '1.530', 'weapon3': '2.178', 'DAMAGECOUNT': '5.826', 'FRAGCOUNT': '21.000'} [2024-08-05 23:34:57,100][52820] DAMAGECOUNT value on done: 40139.0 [2024-08-05 23:34:57,104][52820] Sum rewards: 36.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.256', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.134', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'ARMOR': '0.882', 'WEAPON3': '1.050', 'weapon2': '1.252', 'weapon3': '2.420', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '9.954', 'FRAGCOUNT': '29.000'} [2024-08-05 23:34:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 131366912. Throughput: 0: 4389.1. Samples: 32850060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:34:57,794][52567] Avg episode reward: [(0, '32.017')] [2024-08-05 23:34:58,090][52668] DAMAGECOUNT value on done: 39946.0 [2024-08-05 23:34:58,090][52668] Sum rewards: 37.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.208', 'AMMO5': '0.015', 'ARMOR': '0.024', 'weapon5': '0.024', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.178', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.780', 'WEAPON3': '1.350', 'HITCOUNT': '2.260', 'weapon3': '2.672', 'DAMAGECOUNT': '10.143', 'FRAGCOUNT': '34.500'} [2024-08-05 23:34:58,764][52659] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:34:59,133][52664] DAMAGECOUNT value on done: 42677.0 [2024-08-05 23:34:59,134][52664] Sum rewards: 37.724, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO2': '0.040', 'AMMO3': '0.165', 'AMMO4': '0.198', 'WEAPON4': '0.450', 'weapon4': '0.460', 'ARMOR': '0.500', 'weapon2': '0.822', 'WEAPON3': '1.050', 'weapon3': '2.472', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.527', 'FRAGCOUNT': '32.000'} [2024-08-05 23:34:59,223][52660] DAMAGECOUNT value on done: 41313.0 [2024-08-05 23:34:59,224][52660] Sum rewards: 30.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon4': '0.292', 'ARMOR': '0.455', 'weapon2': '0.986', 'WEAPON3': '1.200', 'HITCOUNT': '2.120', 'weapon3': '2.414', 'DAMAGECOUNT': '8.328', 'FRAGCOUNT': '27.000'} [2024-08-05 23:34:59,713][52669] DAMAGECOUNT value on done: 41331.0 [2024-08-05 23:34:59,714][52669] Sum rewards: 27.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.354', 'ARMOR': '0.800', 'weapon2': '1.078', 'WEAPON3': '1.100', 'HITCOUNT': '1.920', 'weapon3': '1.954', 'DAMAGECOUNT': '8.376', 'FRAGCOUNT': '24.000'} [2024-08-05 23:35:00,007][52650] Updated weights for policy 0, policy_version 16041 (0.0012) [2024-08-05 23:35:00,305][52820] DAMAGECOUNT value on done: 35898.0 [2024-08-05 23:35:00,305][52820] Sum rewards: 25.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.134', 'AMMO3': '0.215', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'ARMOR': '1.320', 'weapon2': '1.360', 'weapon3': '1.904', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '23.000'} [2024-08-05 23:35:00,989][52668] DAMAGECOUNT value on done: 38557.0 [2024-08-05 23:35:00,989][52668] Sum rewards: 29.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.928', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.078', 'AMMO3': '0.196', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.460', 'weapon2': '0.886', 'ARMOR': '0.911', 'WEAPON3': '1.150', 'HITCOUNT': '1.900', 'weapon3': '2.020', 'DAMAGECOUNT': '8.115', 'FRAGCOUNT': '26.000'} [2024-08-05 23:35:02,171][52664] DAMAGECOUNT value on done: 45018.0 [2024-08-05 23:35:02,171][52664] Sum rewards: 41.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.331', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.149', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.796', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '37.000'} [2024-08-05 23:35:02,349][52660] DAMAGECOUNT value on done: 45102.0 [2024-08-05 23:35:02,350][52660] Sum rewards: 35.620, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.517', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.662', 'ARMOR': '0.928', 'WEAPON3': '1.400', 'HITCOUNT': '2.480', 'weapon3': '2.558', 'DAMAGECOUNT': '10.293', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:02,697][52669] DAMAGECOUNT value on done: 40868.0 [2024-08-05 23:35:02,697][52669] Sum rewards: 39.103, reward structure: {'DEATHCOUNT': '-9.000', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.184', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'HEALTH': '0.666', 'WEAPON3': '0.850', 'weapon2': '1.056', 'HITCOUNT': '2.300', 'weapon3': '2.534', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 131448832. Throughput: 0: 4387.8. Samples: 32863090. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:35:02,794][52567] Avg episode reward: [(0, '32.314')] [2024-08-05 23:35:03,461][52820] DAMAGECOUNT value on done: 37978.0 [2024-08-05 23:35:03,464][52820] Sum rewards: 26.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.204', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'ARMOR': '0.415', 'WEAPON3': '1.200', 'weapon2': '1.414', 'HITCOUNT': '2.070', 'weapon3': '2.308', 'DAMAGECOUNT': '8.646', 'FRAGCOUNT': '25.000'} [2024-08-05 23:35:04,251][52668] DAMAGECOUNT value on done: 41661.0 [2024-08-05 23:35:04,254][52668] Sum rewards: 30.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'weapon5': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.171', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.424', 'WEAPON3': '1.050', 'weapon2': '1.118', 'ARMOR': '1.297', 'weapon3': '2.184', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '8.754', 'FRAGCOUNT': '25.000'} [2024-08-05 23:35:04,555][52647] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:35:04,714][52650] Updated weights for policy 0, policy_version 16051 (0.0022) [2024-08-05 23:35:04,745][52664] DAMAGECOUNT value on done: 40680.0 [2024-08-05 23:35:04,748][52664] Sum rewards: 32.938, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.004', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon5': '0.074', 'AMMO3': '0.142', 'AMMO4': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '0.850', 'ARMOR': '0.912', 'weapon2': '1.404', 'weapon3': '1.818', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '8.745', 'FRAGCOUNT': '26.000'} [2024-08-05 23:35:05,339][52669] DAMAGECOUNT value on done: 40494.0 [2024-08-05 23:35:05,339][52669] Sum rewards: 25.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.234', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'ARMOR': '0.471', 'weapon2': '0.886', 'WEAPON3': '1.550', 'HITCOUNT': '1.910', 'weapon3': '2.736', 'DAMAGECOUNT': '7.527', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:05,345][52660] DAMAGECOUNT value on done: 40755.0 [2024-08-05 23:35:05,349][52660] Sum rewards: 29.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.902', 'AMMO5': '0.023', 'AMMO2': '0.031', 'weapon5': '0.054', 'AMMO4': '0.157', 'AMMO3': '0.196', 'weapon4': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.923', 'weapon2': '0.962', 'WEAPON3': '1.350', 'HITCOUNT': '1.950', 'weapon3': '2.482', 'DAMAGECOUNT': '7.875', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:06,592][52820] DAMAGECOUNT value on done: 38781.0 [2024-08-05 23:35:06,593][52820] Sum rewards: 31.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.154', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'WEAPON3': '0.950', 'weapon2': '1.202', 'HITCOUNT': '2.030', 'weapon3': '2.326', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:07,178][52664] DAMAGECOUNT value on done: 42441.0 [2024-08-05 23:35:07,178][52664] Sum rewards: 20.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.831', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.018', 'AMMO4': '0.041', 'weapon7': '0.060', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.195', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.396', 'ARMOR': '0.442', 'weapon2': '1.062', 'WEAPON3': '1.150', 'HITCOUNT': '1.790', 'weapon3': '2.076', 'DAMAGECOUNT': '7.395', 'FRAGCOUNT': '20.000'} [2024-08-05 23:35:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 131538944. Throughput: 0: 4380.8. Samples: 32889300. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:35:07,795][52567] Avg episode reward: [(0, '32.205')] [2024-08-05 23:35:07,812][52668] DAMAGECOUNT value on done: 44238.0 [2024-08-05 23:35:07,812][52668] Sum rewards: 31.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.198', 'weapon4': '0.224', 'WEAPON4': '0.250', 'ARMOR': '0.435', 'weapon2': '1.092', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '2.436', 'DAMAGECOUNT': '9.258', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:08,408][52669] DAMAGECOUNT value on done: 42921.0 [2024-08-05 23:35:08,408][52669] Sum rewards: 24.841, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'weapon5': '0.036', 'AMMO2': '0.051', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.255', 'HEALTH': '0.282', 'WEAPON4': '0.400', 'ARMOR': '0.464', 'weapon4': '0.734', 'WEAPON3': '0.850', 'weapon2': '0.944', 'weapon3': '2.002', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '8.049', 'FRAGCOUNT': '21.000'} [2024-08-05 23:35:08,919][52660] DAMAGECOUNT value on done: 42316.0 [2024-08-05 23:35:08,921][52660] Sum rewards: 35.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.954', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.050', 'AMMO4': '0.121', 'weapon4': '0.180', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.503', 'weapon2': '0.506', 'WEAPON3': '1.300', 'HITCOUNT': '2.050', 'weapon3': '2.892', 'DAMAGECOUNT': '8.970', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:09,161][52650] Updated weights for policy 0, policy_version 16061 (0.0018) [2024-08-05 23:35:09,671][52820] DAMAGECOUNT value on done: 39221.0 [2024-08-05 23:35:09,672][52820] Sum rewards: 29.207, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.486', 'weapon5': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.030', 'ARMOR': '0.040', 'weapon4': '0.044', 'AMMO4': '0.148', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.850', 'HITCOUNT': '2.250', 'weapon3': '3.134', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:09,974][52664] DAMAGECOUNT value on done: 41816.0 [2024-08-05 23:35:09,975][52664] Sum rewards: 28.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.405', 'AMMO2': '0.021', 'weapon4': '0.026', 'AMMO4': '0.103', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '1.050', 'WEAPON3': '1.150', 'HITCOUNT': '1.930', 'weapon3': '2.714', 'DAMAGECOUNT': '7.704', 'FRAGCOUNT': '27.000'} [2024-08-05 23:35:11,390][52660] DAMAGECOUNT value on done: 41948.0 [2024-08-05 23:35:11,390][52649] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon7', 0.002)] [2024-08-05 23:35:11,391][52660] Sum rewards: 36.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.859', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.088', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'ARMOR': '0.400', 'weapon2': '0.890', 'WEAPON3': '1.100', 'weapon3': '2.404', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '9.981', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:11,423][52669] DAMAGECOUNT value on done: 43745.0 [2024-08-05 23:35:11,424][52669] Sum rewards: 31.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.208', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'weapon4': '0.436', 'ARMOR': '0.855', 'WEAPON3': '0.950', 'weapon2': '1.084', 'weapon3': '2.084', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '8.415', 'FRAGCOUNT': '28.500'} [2024-08-05 23:35:12,323][52667] DAMAGECOUNT value on done: 42411.0 [2024-08-05 23:35:12,323][52667] Sum rewards: 36.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.044', 'AMMO4': '0.118', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.934', 'WEAPON3': '1.400', 'weapon3': '2.378', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.191', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:12,793][52820] DAMAGECOUNT value on done: 38306.0 [2024-08-05 23:35:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 131637248. Throughput: 0: 4376.9. Samples: 32915360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:35:12,794][52567] Avg episode reward: [(0, '32.151')] [2024-08-05 23:35:12,796][52820] Sum rewards: 35.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.036', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.160', 'weapon5': '0.194', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.505', 'weapon2': '0.564', 'weapon4': '0.612', 'WEAPON3': '1.000', 'HITCOUNT': '2.060', 'weapon3': '2.266', 'DAMAGECOUNT': '9.984', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:12,831][52664] DAMAGECOUNT value on done: 45439.0 [2024-08-05 23:35:12,832][52664] Sum rewards: 41.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.058', 'AMMO4': '0.218', 'AMMO3': '0.224', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'weapon2': '1.024', 'WEAPON3': '1.350', 'weapon3': '2.396', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '9.999', 'FRAGCOUNT': '36.500'} [2024-08-05 23:35:14,124][52669] DAMAGECOUNT value on done: 42127.0 [2024-08-05 23:35:14,127][52669] Sum rewards: 27.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.814', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'weapon4': '0.114', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.922', 'weapon2': '1.126', 'WEAPON3': '1.350', 'HITCOUNT': '2.000', 'weapon3': '2.520', 'DAMAGECOUNT': '7.947', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:14,246][52650] Updated weights for policy 0, policy_version 16071 (0.0012) [2024-08-05 23:35:14,368][52660] DAMAGECOUNT value on done: 41978.0 [2024-08-05 23:35:14,369][52660] Sum rewards: 27.456, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.142', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.233', 'weapon4': '0.352', 'WEAPON4': '0.400', 'ARMOR': '0.404', 'weapon2': '0.850', 'WEAPON3': '1.400', 'HITCOUNT': '2.280', 'weapon3': '2.514', 'DAMAGECOUNT': '8.754', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:15,179][52667] DAMAGECOUNT value on done: 43727.0 [2024-08-05 23:35:15,188][52667] Sum rewards: 45.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.012', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.678', 'ARMOR': '1.376', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.948', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '40.000'} [2024-08-05 23:35:15,670][52820] DAMAGECOUNT value on done: 41217.0 [2024-08-05 23:35:15,671][52820] Sum rewards: 34.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.222', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.084', 'AMMO3': '0.173', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '1.002', 'WEAPON3': '1.150', 'ARMOR': '1.255', 'HITCOUNT': '2.250', 'weapon3': '2.508', 'DAMAGECOUNT': '9.645', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:16,076][52664] DAMAGECOUNT value on done: 41280.0 [2024-08-05 23:35:16,077][52664] Sum rewards: 40.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.438', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.028', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.628', 'WEAPON3': '1.250', 'ARMOR': '1.392', 'HITCOUNT': '2.770', 'weapon3': '2.854', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:16,714][52669] DAMAGECOUNT value on done: 41154.0 [2024-08-05 23:35:16,717][52669] Sum rewards: 26.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.378', 'weapon2': '0.558', 'WEAPON3': '1.150', 'HITCOUNT': '2.050', 'weapon3': '2.710', 'DAMAGECOUNT': '7.914', 'FRAGCOUNT': '24.000'} [2024-08-05 23:35:16,769][52665] DAMAGECOUNT value on done: 40220.0 [2024-08-05 23:35:16,770][52665] Sum rewards: 26.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO2': '0.024', 'ARMOR': '0.044', 'weapon4': '0.068', 'AMMO4': '0.120', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '1.046', 'WEAPON3': '1.200', 'HITCOUNT': '2.030', 'weapon3': '2.690', 'DAMAGECOUNT': '7.701', 'FRAGCOUNT': '25.000'} [2024-08-05 23:35:17,359][52660] DAMAGECOUNT value on done: 41054.0 [2024-08-05 23:35:17,359][52660] Sum rewards: 33.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.863', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon2': '0.892', 'WEAPON3': '1.250', 'ARMOR': '1.282', 'HITCOUNT': '2.220', 'weapon3': '2.842', 'DAMAGECOUNT': '9.132', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 131719168. Throughput: 0: 4383.8. Samples: 32928520. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:35:17,794][52567] Avg episode reward: [(0, '32.815')] [2024-08-05 23:35:17,797][52614] Saving new best policy, reward=32.815! [2024-08-05 23:35:17,993][52667] DAMAGECOUNT value on done: 41554.0 [2024-08-05 23:35:17,994][52667] Sum rewards: 33.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.066', 'weapon5': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.132', 'AMMO4': '0.171', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.784', 'ARMOR': '1.375', 'WEAPON3': '1.400', 'HITCOUNT': '2.130', 'weapon3': '2.838', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:18,579][52650] Updated weights for policy 0, policy_version 16081 (0.0028) [2024-08-05 23:35:18,728][52664] DAMAGECOUNT value on done: 43457.0 [2024-08-05 23:35:18,729][52664] Sum rewards: 41.437, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.129', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.147', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.916', 'ARMOR': '0.939', 'WEAPON3': '1.000', 'HITCOUNT': '2.360', 'weapon3': '2.386', 'DAMAGECOUNT': '9.816', 'FRAGCOUNT': '33.000'} [2024-08-05 23:35:18,820][52820] DAMAGECOUNT value on done: 42015.0 [2024-08-05 23:35:18,820][52820] Sum rewards: 33.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.847', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.054', 'AMMO4': '0.156', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.940', 'WEAPON3': '1.150', 'ARMOR': '1.297', 'weapon3': '2.256', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.978', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:19,355][52669] DAMAGECOUNT value on done: 41947.0 [2024-08-05 23:35:19,356][52669] Sum rewards: 34.067, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.684', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.054', 'AMMO3': '0.111', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'ARMOR': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.614', 'WEAPON3': '0.750', 'weapon2': '0.858', 'weapon3': '2.146', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.330', 'FRAGCOUNT': '27.500'} [2024-08-05 23:35:19,730][52665] DAMAGECOUNT value on done: 43515.0 [2024-08-05 23:35:19,731][52665] Sum rewards: 32.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.048', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon4': '0.108', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'ARMOR': '0.460', 'weapon2': '0.680', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.822', 'DAMAGECOUNT': '10.926', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:20,131][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:35:20,613][52667] DAMAGECOUNT value on done: 42262.0 [2024-08-05 23:35:20,614][52667] Sum rewards: 35.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.176', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.338', 'WEAPON4': '0.350', 'ARMOR': '0.859', 'WEAPON3': '1.050', 'weapon2': '1.152', 'weapon3': '2.224', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.654', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:21,877][52664] DAMAGECOUNT value on done: 43075.0 [2024-08-05 23:35:21,877][52664] Sum rewards: 39.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.106', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'ARMOR': '0.412', 'weapon2': '0.934', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.752', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:22,011][52820] DAMAGECOUNT value on done: 40093.0 [2024-08-05 23:35:22,013][52820] Sum rewards: 33.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.406', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.010', 'ARMOR': '0.032', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.206', 'weapon2': '0.648', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.882', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '28.500'} [2024-08-05 23:35:22,093][52669] DAMAGECOUNT value on done: 39520.0 [2024-08-05 23:35:22,093][52669] Sum rewards: 31.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.764', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.123', 'AMMO3': '0.168', 'weapon2': '0.856', 'WEAPON3': '1.100', 'HITCOUNT': '1.820', 'weapon3': '2.806', 'DAMAGECOUNT': '7.926', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:22,559][52665] DAMAGECOUNT value on done: 43073.0 [2024-08-05 23:35:22,559][52665] Sum rewards: 33.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.328', 'ARMOR': '0.400', 'weapon2': '0.646', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.838', 'DAMAGECOUNT': '9.468', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 131801088. Throughput: 0: 4372.9. Samples: 32954680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:35:22,795][52567] Avg episode reward: [(0, '32.802')] [2024-08-05 23:35:23,341][52650] Updated weights for policy 0, policy_version 16091 (0.0012) [2024-08-05 23:35:23,534][52666] Large shaping reward 3.426 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.375, 125.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:35:23,577][52667] DAMAGECOUNT value on done: 42268.0 [2024-08-05 23:35:23,578][52667] Sum rewards: 34.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.041', 'AMMO3': '0.164', 'weapon5': '0.198', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.150', 'HITCOUNT': '2.220', 'weapon3': '2.382', 'DAMAGECOUNT': '9.417', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:24,486][52664] DAMAGECOUNT value on done: 43990.0 [2024-08-05 23:35:24,488][52664] Sum rewards: 40.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.479', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.166', 'WEAPON4': '0.350', 'ARMOR': '0.448', 'weapon4': '0.474', 'weapon2': '0.730', 'WEAPON3': '1.150', 'weapon3': '2.408', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.471', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:25,230][52669] DAMAGECOUNT value on done: 43178.0 [2024-08-05 23:35:25,235][52669] Sum rewards: 50.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.022', 'AMMO2': '0.023', 'weapon4': '0.088', 'AMMO4': '0.117', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.968', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '42.000'} [2024-08-05 23:35:25,608][52665] DAMAGECOUNT value on done: 41314.0 [2024-08-05 23:35:25,609][52665] Sum rewards: 29.393, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.431', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.136', 'weapon5': '0.138', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.788', 'WEAPON3': '0.850', 'HITCOUNT': '1.560', 'weapon3': '2.152', 'DAMAGECOUNT': '6.255', 'FRAGCOUNT': '25.000'} [2024-08-05 23:35:26,500][52667] DAMAGECOUNT value on done: 44168.0 [2024-08-05 23:35:26,500][52667] Sum rewards: 26.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.263', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.034', 'ARMOR': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.195', 'weapon4': '0.240', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.300', 'HITCOUNT': '2.210', 'weapon3': '2.836', 'DAMAGECOUNT': '8.946', 'FRAGCOUNT': '25.000'} [2024-08-05 23:35:27,639][52664] DAMAGECOUNT value on done: 44109.0 [2024-08-05 23:35:27,640][52664] Sum rewards: 39.243, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.247', 'HEALTH': '0.385', 'ARMOR': '0.440', 'weapon2': '0.854', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.916', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17495.4). Total num frames: 131891200. Throughput: 0: 4373.1. Samples: 32980990. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:35:27,794][52567] Avg episode reward: [(0, '33.089')] [2024-08-05 23:35:27,803][52614] Saving new best policy, reward=33.089! [2024-08-05 23:35:28,182][52650] Updated weights for policy 0, policy_version 16101 (0.0026) [2024-08-05 23:35:28,266][52669] DAMAGECOUNT value on done: 43533.0 [2024-08-05 23:35:28,267][52669] Sum rewards: 30.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.953', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.086', 'weapon5': '0.098', 'AMMO4': '0.144', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.485', 'weapon2': '0.848', 'WEAPON3': '1.550', 'HITCOUNT': '2.220', 'weapon3': '2.662', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:28,692][52665] DAMAGECOUNT value on done: 39209.0 [2024-08-05 23:35:28,694][52665] Sum rewards: 28.780, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.680', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.070', 'AMMO3': '0.136', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'ARMOR': '1.308', 'weapon2': '1.468', 'HITCOUNT': '1.660', 'weapon3': '2.040', 'DAMAGECOUNT': '6.480', 'FRAGCOUNT': '23.000'} [2024-08-05 23:35:29,222][52667] DAMAGECOUNT value on done: 43433.0 [2024-08-05 23:35:29,223][52667] Sum rewards: 37.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.614', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.213', 'weapon4': '0.402', 'WEAPON4': '0.500', 'weapon2': '0.518', 'ARMOR': '0.918', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '2.804', 'DAMAGECOUNT': '10.881', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:30,294][52666] DAMAGECOUNT value on done: 39608.0 [2024-08-05 23:35:30,296][52666] Sum rewards: 39.112, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.352', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.184', 'WEAPON4': '0.200', 'ARMOR': '0.481', 'weapon2': '1.116', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.414', 'DAMAGECOUNT': '10.107', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:31,281][52669] DAMAGECOUNT value on done: 40153.0 [2024-08-05 23:35:31,283][52669] Sum rewards: 31.600, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.030', 'AMMO4': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.278', 'ARMOR': '0.420', 'WEAPON3': '1.000', 'weapon2': '1.386', 'HITCOUNT': '2.050', 'weapon3': '2.094', 'DAMAGECOUNT': '8.112', 'FRAGCOUNT': '27.000'} [2024-08-05 23:35:31,442][52803] DAMAGECOUNT value on done: 40137.0 [2024-08-05 23:35:31,442][52803] Sum rewards: 26.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO3': '0.169', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'ARMOR': '0.452', 'WEAPON4': '0.500', 'weapon2': '0.580', 'weapon4': '0.802', 'WEAPON3': '1.050', 'HITCOUNT': '1.920', 'weapon3': '2.062', 'DAMAGECOUNT': '8.832', 'FRAGCOUNT': '23.000'} [2024-08-05 23:35:31,547][52665] DAMAGECOUNT value on done: 39884.0 [2024-08-05 23:35:31,549][52665] Sum rewards: 35.781, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.965', 'weapon4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.864', 'WEAPON3': '1.650', 'ARMOR': '1.687', 'HITCOUNT': '2.470', 'weapon3': '2.862', 'DAMAGECOUNT': '9.420', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:32,062][52667] DAMAGECOUNT value on done: 41701.0 [2024-08-05 23:35:32,062][52667] Sum rewards: 32.189, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.862', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.270', 'weapon4': '0.282', 'WEAPON4': '0.400', 'weapon2': '0.758', 'ARMOR': '0.812', 'WEAPON3': '1.650', 'weapon3': '2.606', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.431', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:32,667][52650] Updated weights for policy 0, policy_version 16111 (0.0011) [2024-08-05 23:35:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 131981312. Throughput: 0: 4368.4. Samples: 32993960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:35:32,794][52567] Avg episode reward: [(0, '33.055')] [2024-08-05 23:35:33,531][52666] DAMAGECOUNT value on done: 41435.0 [2024-08-05 23:35:33,531][52666] Sum rewards: 30.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.120', 'weapon4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'ARMOR': '0.465', 'WEAPON3': '1.100', 'weapon2': '1.216', 'HITCOUNT': '2.120', 'weapon3': '2.260', 'DAMAGECOUNT': '8.598', 'FRAGCOUNT': '26.000'} [2024-08-05 23:35:34,193][52665] DAMAGECOUNT value on done: 43872.0 [2024-08-05 23:35:34,193][52665] Sum rewards: 36.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.049', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.138', 'AMMO3': '0.173', 'ARMOR': '0.400', 'weapon2': '0.922', 'WEAPON3': '1.200', 'HITCOUNT': '2.270', 'weapon3': '2.732', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '31.000'} [2024-08-05 23:35:34,401][52803] DAMAGECOUNT value on done: 42700.0 [2024-08-05 23:35:34,402][52803] Sum rewards: 45.006, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.086', 'AMMO3': '0.173', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.380', 'HEALTH': '0.602', 'weapon2': '0.708', 'ARMOR': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.490', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:34,411][52669] DAMAGECOUNT value on done: 43299.0 [2024-08-05 23:35:34,411][52669] Sum rewards: 36.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.764', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'AMMO4': '0.165', 'weapon4': '0.272', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'ARMOR': '0.808', 'weapon2': '1.066', 'HITCOUNT': '2.350', 'weapon3': '2.378', 'DAMAGECOUNT': '10.278', 'FRAGCOUNT': '31.000'} [2024-08-05 23:35:34,488][52614] Signal inference workers to stop experience collection... (3000 times) [2024-08-05 23:35:34,488][52614] Signal inference workers to resume experience collection... (3000 times) [2024-08-05 23:35:34,569][52650] InferenceWorker_p0-w0: stopping experience collection (3000 times) [2024-08-05 23:35:34,569][52650] InferenceWorker_p0-w0: resuming experience collection (3000 times) [2024-08-05 23:35:34,847][52667] DAMAGECOUNT value on done: 43204.0 [2024-08-05 23:35:34,849][52667] Sum rewards: 32.229, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.366', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.320', 'ARMOR': '0.478', 'weapon2': '0.870', 'WEAPON3': '1.950', 'HITCOUNT': '2.300', 'weapon3': '2.836', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:36,555][52666] DAMAGECOUNT value on done: 40264.0 [2024-08-05 23:35:36,557][52666] Sum rewards: 30.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.024', 'AMMO5': '0.015', 'weapon5': '0.044', 'AMMO2': '0.055', 'AMMO3': '0.194', 'weapon4': '0.216', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'ARMOR': '0.420', 'WEAPON4': '0.600', 'weapon2': '0.846', 'WEAPON3': '1.100', 'HITCOUNT': '1.980', 'weapon3': '2.598', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:36,795][52669] DAMAGECOUNT value on done: 43966.0 [2024-08-05 23:35:36,795][52669] Sum rewards: 40.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.650', 'AMMO2': '0.002', 'AMMO5': '0.009', 'AMMO4': '0.011', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.436', 'weapon2': '0.686', 'ARMOR': '0.904', 'WEAPON3': '1.450', 'weapon3': '2.432', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '37.000'} [2024-08-05 23:35:37,126][52670] DAMAGECOUNT value on done: 40761.0 [2024-08-05 23:35:37,126][52670] Sum rewards: 28.313, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.904', 'AMMO2': '0.012', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO4': '0.059', 'weapon4': '0.064', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '1.050', 'weapon2': '1.092', 'ARMOR': '1.269', 'HITCOUNT': '2.160', 'weapon3': '2.638', 'DAMAGECOUNT': '8.148', 'FRAGCOUNT': '23.000'} [2024-08-05 23:35:37,371][52665] DAMAGECOUNT value on done: 43084.0 [2024-08-05 23:35:37,371][52665] Sum rewards: 34.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.884', 'AMMO5': '0.005', 'AMMO2': '0.034', 'ARMOR': '0.048', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'AMMO4': '0.169', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.110', 'weapon3': '2.180', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.594', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:37,419][52650] Updated weights for policy 0, policy_version 16121 (0.0012) [2024-08-05 23:35:37,480][52803] DAMAGECOUNT value on done: 38582.0 [2024-08-05 23:35:37,480][52803] Sum rewards: 32.382, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'AMMO2': '0.028', 'weapon4': '0.040', 'AMMO4': '0.142', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'ARMOR': '1.220', 'weapon2': '1.448', 'HITCOUNT': '2.100', 'weapon3': '2.324', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '27.000'} [2024-08-05 23:35:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 132063232. Throughput: 0: 4368.0. Samples: 33020320. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 23:35:37,794][52567] Avg episode reward: [(0, '33.447')] [2024-08-05 23:35:37,832][52614] Saving new best policy, reward=33.447! [2024-08-05 23:35:37,929][52667] DAMAGECOUNT value on done: 42736.0 [2024-08-05 23:35:37,929][52667] Sum rewards: 39.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.398', 'AMMO2': '0.011', 'AMMO4': '0.053', 'ARMOR': '0.056', 'AMMO3': '0.158', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.552', 'weapon3': '2.102', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:39,318][52811] DAMAGECOUNT value on done: 40536.0 [2024-08-05 23:35:39,318][52811] Sum rewards: 36.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.802', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon5': '0.042', 'weapon4': '0.112', 'AMMO4': '0.207', 'AMMO3': '0.209', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'WEAPON4': '0.450', 'weapon2': '0.632', 'WEAPON3': '1.400', 'HITCOUNT': '2.360', 'weapon3': '2.946', 'DAMAGECOUNT': '9.786', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:39,607][52669] DAMAGECOUNT value on done: 43623.0 [2024-08-05 23:35:39,607][52669] Sum rewards: 33.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.908', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.176', 'weapon4': '0.302', 'ARMOR': '0.858', 'WEAPON3': '0.950', 'weapon2': '1.334', 'weapon3': '1.894', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:39,965][52666] DAMAGECOUNT value on done: 38943.0 [2024-08-05 23:35:39,968][52666] Sum rewards: 44.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.039', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.030', 'AMMO4': '0.110', 'weapon4': '0.122', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.490', 'weapon2': '0.910', 'WEAPON3': '1.000', 'HITCOUNT': '2.640', 'weapon3': '2.660', 'DAMAGECOUNT': '9.489', 'FRAGCOUNT': '36.000'} [2024-08-05 23:35:40,200][52658] DAMAGECOUNT value on done: 42988.0 [2024-08-05 23:35:40,201][52658] Sum rewards: 33.191, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.394', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.128', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.578', 'ARMOR': '0.824', 'weapon2': '1.008', 'WEAPON3': '1.100', 'weapon3': '1.966', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '8.304', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:40,330][52665] DAMAGECOUNT value on done: 43743.0 [2024-08-05 23:35:40,330][52665] Sum rewards: 35.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.086', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'ARMOR': '0.484', 'weapon2': '1.114', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '2.534', 'DAMAGECOUNT': '10.026', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:40,532][52803] DAMAGECOUNT value on done: 38397.0 [2024-08-05 23:35:40,533][52803] Sum rewards: 35.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO2': '0.037', 'AMMO3': '0.167', 'AMMO4': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.418', 'WEAPON3': '1.050', 'weapon2': '1.140', 'ARMOR': '1.316', 'HITCOUNT': '2.200', 'weapon3': '2.286', 'DAMAGECOUNT': '8.757', 'FRAGCOUNT': '31.000'} [2024-08-05 23:35:40,611][52670] DAMAGECOUNT value on done: 42045.0 [2024-08-05 23:35:40,613][52670] Sum rewards: 18.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.128', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'ARMOR': '0.493', 'WEAPON4': '0.550', 'weapon4': '0.618', 'weapon2': '0.762', 'WEAPON3': '1.050', 'HITCOUNT': '1.840', 'weapon3': '2.080', 'DAMAGECOUNT': '6.999', 'FRAGCOUNT': '17.000'} [2024-08-05 23:35:40,743][52663] DAMAGECOUNT value on done: 43790.0 [2024-08-05 23:35:40,743][52663] Sum rewards: 35.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.396', 'AMMO5': '0.018', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.060', 'AMMO4': '0.208', 'weapon4': '0.268', 'AMMO3': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.592', 'WEAPON3': '1.650', 'HITCOUNT': '2.370', 'weapon3': '2.758', 'DAMAGECOUNT': '10.497', 'FRAGCOUNT': '33.000'} [2024-08-05 23:35:40,923][52667] DAMAGECOUNT value on done: 40755.0 [2024-08-05 23:35:40,926][52667] Sum rewards: 33.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.294', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.052', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.235', 'weapon4': '0.266', 'WEAPON4': '0.400', 'weapon2': '1.026', 'WEAPON3': '1.250', 'ARMOR': '1.316', 'HITCOUNT': '2.210', 'weapon3': '2.428', 'DAMAGECOUNT': '9.384', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:42,154][52650] Updated weights for policy 0, policy_version 16131 (0.0036) [2024-08-05 23:35:42,297][52811] DAMAGECOUNT value on done: 37511.0 [2024-08-05 23:35:42,301][52811] Sum rewards: 19.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'ARMOR': '0.400', 'weapon2': '0.996', 'WEAPON3': '1.300', 'HITCOUNT': '1.500', 'weapon3': '2.654', 'DAMAGECOUNT': '6.060', 'FRAGCOUNT': '21.000'} [2024-08-05 23:35:42,416][52669] DAMAGECOUNT value on done: 42996.0 [2024-08-05 23:35:42,418][52669] Sum rewards: 23.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.474', 'weapon5': '0.002', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.183', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.250', 'AMMO4': '0.273', 'weapon4': '0.540', 'WEAPON4': '0.550', 'ARMOR': '0.929', 'WEAPON3': '1.000', 'weapon2': '1.132', 'weapon3': '2.040', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '7.758', 'FRAGCOUNT': '22.000'} [2024-08-05 23:35:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 132153344. Throughput: 0: 4359.6. Samples: 33046240. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-05 23:35:42,795][52567] Avg episode reward: [(0, '33.484')] [2024-08-05 23:35:42,795][52614] Saving new best policy, reward=33.484! [2024-08-05 23:35:43,106][52658] DAMAGECOUNT value on done: 42241.0 [2024-08-05 23:35:43,107][52658] Sum rewards: 41.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.675', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.042', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.894', 'WEAPON3': '1.100', 'HITCOUNT': '2.270', 'weapon3': '2.674', 'DAMAGECOUNT': '9.852', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:43,156][52663] DAMAGECOUNT value on done: 41434.0 [2024-08-05 23:35:43,156][52663] Sum rewards: 35.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.941', 'weapon7': '0.022', 'AMMO2': '0.041', 'weapon4': '0.064', 'AMMO3': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'weapon2': '0.808', 'WEAPON3': '1.300', 'HITCOUNT': '2.250', 'weapon3': '2.828', 'DAMAGECOUNT': '9.312', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:43,214][52666] DAMAGECOUNT value on done: 40280.0 [2024-08-05 23:35:43,214][52666] Sum rewards: 38.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.829', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.156', 'weapon4': '0.206', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.776', 'ARMOR': '0.864', 'WEAPON3': '1.000', 'HITCOUNT': '2.250', 'weapon3': '2.656', 'DAMAGECOUNT': '9.723', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:43,484][52665] DAMAGECOUNT value on done: 43280.0 [2024-08-05 23:35:43,488][52665] Sum rewards: 36.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.894', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.157', 'weapon4': '0.238', 'WEAPON4': '0.250', 'ARMOR': '0.912', 'WEAPON3': '1.000', 'weapon2': '1.280', 'weapon3': '2.264', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.021', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:43,661][52667] DAMAGECOUNT value on done: 40700.0 [2024-08-05 23:35:43,662][52667] Sum rewards: 38.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon4': '0.144', 'AMMO4': '0.154', 'WEAPON4': '0.350', 'ARMOR': '0.504', 'WEAPON3': '0.900', 'weapon2': '1.012', 'HITCOUNT': '2.300', 'weapon3': '2.628', 'DAMAGECOUNT': '9.780', 'FRAGCOUNT': '33.000'} [2024-08-05 23:35:43,709][52803] DAMAGECOUNT value on done: 42223.0 [2024-08-05 23:35:43,709][52803] Sum rewards: 38.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.469', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.364', 'ARMOR': '0.461', 'weapon2': '0.990', 'WEAPON3': '1.100', 'HITCOUNT': '2.300', 'weapon3': '2.450', 'DAMAGECOUNT': '9.144', 'FRAGCOUNT': '33.000'} [2024-08-05 23:35:43,846][52670] DAMAGECOUNT value on done: 42135.0 [2024-08-05 23:35:43,848][52670] Sum rewards: 37.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.785', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.354', 'ARMOR': '0.428', 'weapon2': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.220', 'weapon3': '2.680', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '33.000'} [2024-08-05 23:35:45,030][52669] DAMAGECOUNT value on done: 43460.0 [2024-08-05 23:35:45,033][52669] Sum rewards: 48.472, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.154', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.076', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'ARMOR': '0.505', 'weapon4': '0.544', 'WEAPON3': '0.850', 'weapon2': '0.866', 'weapon3': '2.124', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '37.000'} [2024-08-05 23:35:45,411][52811] DAMAGECOUNT value on done: 40950.0 [2024-08-05 23:35:45,412][52811] Sum rewards: 38.859, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.478', 'AMMO2': '0.018', 'weapon4': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'ARMOR': '0.857', 'WEAPON3': '1.100', 'weapon2': '1.162', 'HITCOUNT': '2.130', 'weapon3': '2.590', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:45,679][52658] DAMAGECOUNT value on done: 41436.0 [2024-08-05 23:35:45,679][52658] Sum rewards: 47.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.776', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.240', 'ARMOR': '0.434', 'weapon2': '0.874', 'WEAPON3': '1.600', 'weapon3': '2.762', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '43.000'} [2024-08-05 23:35:45,920][52663] DAMAGECOUNT value on done: 43254.0 [2024-08-05 23:35:45,921][52663] Sum rewards: 37.210, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.209', 'AMMO5': '0.020', 'ARMOR': '0.036', 'weapon5': '0.036', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.260', 'weapon4': '0.282', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.620', 'weapon3': '2.788', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '36.000'} [2024-08-05 23:35:46,003][52666] DAMAGECOUNT value on done: 40589.0 [2024-08-05 23:35:46,004][52666] Sum rewards: 35.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.666', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon4': '0.226', 'WEAPON4': '0.300', 'ARMOR': '0.804', 'weapon2': '0.990', 'WEAPON3': '1.400', 'weapon3': '2.554', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:46,390][52647] DAMAGECOUNT value on done: 44140.0 [2024-08-05 23:35:46,391][52647] Sum rewards: 27.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.732', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.024', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'ARMOR': '0.874', 'WEAPON3': '1.050', 'weapon2': '1.158', 'HITCOUNT': '2.000', 'weapon3': '2.644', 'DAMAGECOUNT': '8.604', 'FRAGCOUNT': '24.000'} [2024-08-05 23:35:46,443][52667] DAMAGECOUNT value on done: 43085.0 [2024-08-05 23:35:46,444][52667] Sum rewards: 24.224, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.351', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.122', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'ARMOR': '1.285', 'weapon2': '1.474', 'HITCOUNT': '1.830', 'weapon3': '2.146', 'DAMAGECOUNT': '7.128', 'FRAGCOUNT': '19.000'} [2024-08-05 23:35:46,585][52665] DAMAGECOUNT value on done: 43972.0 [2024-08-05 23:35:46,586][52665] Sum rewards: 38.453, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.244', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.016', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.722', 'ARMOR': '0.970', 'WEAPON3': '1.450', 'HITCOUNT': '2.410', 'weapon3': '2.852', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '36.000'} [2024-08-05 23:35:46,717][52670] DAMAGECOUNT value on done: 40093.0 [2024-08-05 23:35:46,717][52670] Sum rewards: 12.996, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.484', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.156', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.404', 'ARMOR': '0.440', 'HITCOUNT': '0.790', 'WEAPON3': '0.950', 'weapon4': '1.220', 'weapon3': '1.686', 'DAMAGECOUNT': '3.552', 'FRAGCOUNT': '13.000'} [2024-08-05 23:35:46,882][52650] Updated weights for policy 0, policy_version 16141 (0.0021) [2024-08-05 23:35:46,888][52803] DAMAGECOUNT value on done: 37611.0 [2024-08-05 23:35:46,890][52803] Sum rewards: 35.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.986', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'ARMOR': '0.836', 'weapon2': '1.182', 'WEAPON3': '1.250', 'HITCOUNT': '2.300', 'weapon3': '2.384', 'DAMAGECOUNT': '10.167', 'FRAGCOUNT': '31.000'} [2024-08-05 23:35:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 132235264. Throughput: 0: 4354.9. Samples: 33059060. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:35:47,795][52567] Avg episode reward: [(0, '33.668')] [2024-08-05 23:35:47,829][52614] Saving new best policy, reward=33.668! [2024-08-05 23:35:47,922][52669] DAMAGECOUNT value on done: 40983.0 [2024-08-05 23:35:47,922][52669] Sum rewards: 34.279, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.129', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.710', 'ARMOR': '0.800', 'WEAPON3': '1.400', 'HITCOUNT': '2.270', 'weapon3': '2.542', 'DAMAGECOUNT': '9.606', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:48,440][52811] DAMAGECOUNT value on done: 38749.0 [2024-08-05 23:35:48,440][52811] Sum rewards: 27.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.190', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO3': '0.193', 'AMMO4': '0.221', 'WEAPON5': '0.400', 'ARMOR': '0.532', 'WEAPON4': '0.600', 'weapon2': '0.694', 'weapon4': '0.808', 'WEAPON3': '1.250', 'weapon3': '1.956', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.655', 'FRAGCOUNT': '24.000'} [2024-08-05 23:35:48,792][52647] DAMAGECOUNT value on done: 43628.0 [2024-08-05 23:35:48,793][52647] Sum rewards: 19.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.092', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.040', 'AMMO4': '0.160', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.432', 'WEAPON3': '1.100', 'weapon2': '1.520', 'HITCOUNT': '1.720', 'weapon3': '1.964', 'DAMAGECOUNT': '6.831', 'FRAGCOUNT': '20.000'} [2024-08-05 23:35:48,942][52663] DAMAGECOUNT value on done: 42282.0 [2024-08-05 23:35:48,943][52663] Sum rewards: 28.194, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.277', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.140', 'AMMO3': '0.148', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'weapon2': '0.990', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.674', 'DAMAGECOUNT': '8.010', 'FRAGCOUNT': '24.000'} [2024-08-05 23:35:48,964][52658] DAMAGECOUNT value on done: 40498.0 [2024-08-05 23:35:48,966][52658] Sum rewards: 17.123, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.018', 'HEALTH': '0.074', 'AMMO4': '0.091', 'AMMO3': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.162', 'WEAPON3': '0.550', 'weapon2': '0.886', 'ARMOR': '0.900', 'weapon4': '0.910', 'HITCOUNT': '1.210', 'weapon3': '1.390', 'DAMAGECOUNT': '4.686', 'FRAGCOUNT': '14.000'} [2024-08-05 23:35:49,337][52666] DAMAGECOUNT value on done: 40925.0 [2024-08-05 23:35:49,338][52666] Sum rewards: 28.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.696', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.038', 'AMMO4': '0.157', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.450', 'ARMOR': '0.468', 'weapon2': '1.074', 'WEAPON3': '1.100', 'HITCOUNT': '2.090', 'weapon3': '2.298', 'DAMAGECOUNT': '8.199', 'FRAGCOUNT': '26.000'} [2024-08-05 23:35:49,655][52667] DAMAGECOUNT value on done: 41719.0 [2024-08-05 23:35:49,655][52667] Sum rewards: 28.071, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '0.007', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.136', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.534', 'weapon2': '0.820', 'WEAPON3': '0.850', 'HITCOUNT': '1.850', 'weapon3': '2.134', 'DAMAGECOUNT': '7.821', 'FRAGCOUNT': '22.000'} [2024-08-05 23:35:49,660][52665] DAMAGECOUNT value on done: 40501.0 [2024-08-05 23:35:49,660][52665] Sum rewards: 27.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.768', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.428', 'ARMOR': '0.969', 'WEAPON3': '1.050', 'weapon2': '1.054', 'HITCOUNT': '2.110', 'weapon3': '2.246', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '23.500'} [2024-08-05 23:35:49,788][52670] DAMAGECOUNT value on done: 40048.0 [2024-08-05 23:35:49,790][52670] Sum rewards: 33.925, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.606', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.020', 'ARMOR': '0.032', 'weapon4': '0.080', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.784', 'WEAPON3': '1.550', 'HITCOUNT': '2.230', 'weapon3': '2.828', 'DAMAGECOUNT': '9.741', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:50,359][52803] DAMAGECOUNT value on done: 42506.0 [2024-08-05 23:35:50,359][52803] Sum rewards: 33.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.402', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.418', 'ARMOR': '0.428', 'WEAPON3': '1.150', 'weapon2': '1.212', 'weapon3': '2.140', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.348', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:50,980][52669] DAMAGECOUNT value on done: 43148.0 [2024-08-05 23:35:50,984][52669] Sum rewards: 29.045, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.021', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.600', 'HITCOUNT': '2.150', 'weapon3': '3.020', 'DAMAGECOUNT': '8.919', 'FRAGCOUNT': '31.000'} [2024-08-05 23:35:51,325][52647] DAMAGECOUNT value on done: 47794.0 [2024-08-05 23:35:51,325][52647] Sum rewards: 38.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.201', 'weapon2': '0.862', 'ARMOR': '0.880', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '2.628', 'DAMAGECOUNT': '10.032', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:51,536][52811] DAMAGECOUNT value on done: 39224.0 [2024-08-05 23:35:51,539][52811] Sum rewards: 39.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.782', 'AMMO5': '0.005', 'ARMOR': '0.040', 'AMMO2': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'AMMO4': '0.287', 'weapon2': '0.506', 'weapon4': '0.538', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.706', 'DAMAGECOUNT': '10.428', 'FRAGCOUNT': '36.000'} [2024-08-05 23:35:51,943][52658] DAMAGECOUNT value on done: 43773.0 [2024-08-05 23:35:51,943][52658] Sum rewards: 18.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.576', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.126', 'weapon4': '0.158', 'AMMO3': '0.251', 'AMMO4': '0.285', 'WEAPON5': '0.350', 'ARMOR': '0.553', 'WEAPON4': '0.600', 'weapon2': '0.870', 'WEAPON3': '1.600', 'HITCOUNT': '1.790', 'weapon3': '2.520', 'DAMAGECOUNT': '7.881', 'FRAGCOUNT': '20.500'} [2024-08-05 23:35:51,990][52666] DAMAGECOUNT value on done: 41005.0 [2024-08-05 23:35:51,990][52666] Sum rewards: 31.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.446', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.043', 'weapon5': '0.050', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'WEAPON4': '0.450', 'weapon2': '0.514', 'weapon4': '0.588', 'WEAPON3': '1.150', 'HITCOUNT': '2.250', 'weapon3': '2.494', 'DAMAGECOUNT': '9.261', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:51,994][52650] Updated weights for policy 0, policy_version 16151 (0.0018) [2024-08-05 23:35:52,141][52663] DAMAGECOUNT value on done: 40654.0 [2024-08-05 23:35:52,143][52663] Sum rewards: 36.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.603', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.060', 'ARMOR': '0.064', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'AMMO4': '0.239', 'weapon4': '0.514', 'WEAPON4': '0.550', 'weapon2': '0.578', 'WEAPON3': '1.500', 'HITCOUNT': '2.300', 'weapon3': '2.484', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:52,641][52667] DAMAGECOUNT value on done: 44500.0 [2024-08-05 23:35:52,644][52667] Sum rewards: 36.600, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.204', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'ARMOR': '0.482', 'weapon4': '0.734', 'weapon2': '0.916', 'WEAPON3': '0.950', 'HITCOUNT': '1.850', 'weapon3': '1.928', 'DAMAGECOUNT': '8.832', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:52,664][52670] DAMAGECOUNT value on done: 43991.0 [2024-08-05 23:35:52,665][52670] Sum rewards: 35.401, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.034', 'ARMOR': '0.035', 'weapon5': '0.054', 'AMMO3': '0.103', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.548', 'WEAPON3': '0.750', 'weapon4': '1.108', 'weapon3': '2.010', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '8.244', 'FRAGCOUNT': '27.000'} [2024-08-05 23:35:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 132325376. Throughput: 0: 4354.5. Samples: 33085250. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:35:52,795][52567] Avg episode reward: [(0, '33.366')] [2024-08-05 23:35:52,855][52665] DAMAGECOUNT value on done: 39794.0 [2024-08-05 23:35:52,857][52665] Sum rewards: 24.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.112', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.208', 'weapon4': '0.286', 'WEAPON4': '0.450', 'ARMOR': '0.488', 'weapon2': '0.726', 'WEAPON3': '1.200', 'HITCOUNT': '2.240', 'weapon3': '2.694', 'DAMAGECOUNT': '8.277', 'FRAGCOUNT': '23.000'} [2024-08-05 23:35:53,449][52803] DAMAGECOUNT value on done: 40421.0 [2024-08-05 23:35:53,451][52803] Sum rewards: 35.104, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.562', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.852', 'ARMOR': '1.374', 'WEAPON3': '1.700', 'HITCOUNT': '2.480', 'weapon3': '2.636', 'DAMAGECOUNT': '10.260', 'FRAGCOUNT': '35.000'} [2024-08-05 23:35:53,697][52647] DAMAGECOUNT value on done: 43958.0 [2024-08-05 23:35:53,698][52647] Sum rewards: 36.608, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.040', 'AMMO4': '0.146', 'weapon5': '0.148', 'weapon4': '0.158', 'AMMO3': '0.187', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.728', 'WEAPON3': '1.200', 'HITCOUNT': '2.100', 'weapon3': '2.618', 'DAMAGECOUNT': '9.522', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:54,723][52811] DAMAGECOUNT value on done: 40844.0 [2024-08-05 23:35:54,726][52811] Sum rewards: 33.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.024', 'AMMO4': '0.049', 'weapon4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.782', 'ARMOR': '1.299', 'WEAPON3': '1.600', 'HITCOUNT': '2.420', 'weapon3': '2.854', 'DAMAGECOUNT': '9.729', 'FRAGCOUNT': '31.000'} [2024-08-05 23:35:54,968][52658] DAMAGECOUNT value on done: 39915.0 [2024-08-05 23:35:54,969][52658] Sum rewards: 25.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'ARMOR': '0.432', 'weapon2': '1.206', 'WEAPON3': '1.350', 'HITCOUNT': '1.860', 'weapon3': '2.558', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '24.000'} [2024-08-05 23:35:55,235][52666] DAMAGECOUNT value on done: 41383.0 [2024-08-05 23:35:55,236][52666] Sum rewards: 26.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.158', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.928', 'ARMOR': '1.368', 'WEAPON3': '1.500', 'HITCOUNT': '1.700', 'weapon3': '2.698', 'DAMAGECOUNT': '7.356', 'FRAGCOUNT': '26.000'} [2024-08-05 23:35:55,240][52663] DAMAGECOUNT value on done: 44463.0 [2024-08-05 23:35:55,242][52663] Sum rewards: 41.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.068', 'AMMO5': '0.013', 'AMMO2': '0.050', 'ARMOR': '0.056', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'AMMO4': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.450', 'weapon2': '0.676', 'WEAPON3': '1.400', 'weapon3': '2.604', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '37.000'} [2024-08-05 23:35:55,703][52667] DAMAGECOUNT value on done: 45736.0 [2024-08-05 23:35:55,705][52667] Sum rewards: 37.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.021', 'ARMOR': '0.048', 'AMMO4': '0.106', 'weapon5': '0.168', 'AMMO3': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.492', 'weapon4': '0.842', 'WEAPON3': '1.200', 'weapon3': '1.976', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.314', 'FRAGCOUNT': '31.500'} [2024-08-05 23:35:55,709][52665] DAMAGECOUNT value on done: 41991.0 [2024-08-05 23:35:55,716][52665] Sum rewards: 36.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.148', 'AMMO3': '0.249', 'ARMOR': '0.452', 'weapon2': '0.970', 'WEAPON3': '1.650', 'HITCOUNT': '2.500', 'weapon3': '2.660', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '36.000'} [2024-08-05 23:35:55,935][52670] DAMAGECOUNT value on done: 39253.0 [2024-08-05 23:35:55,937][52670] Sum rewards: 26.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.106', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'ARMOR': '1.256', 'weapon2': '1.668', 'HITCOUNT': '1.830', 'weapon3': '2.050', 'DAMAGECOUNT': '7.278', 'FRAGCOUNT': '22.000'} [2024-08-05 23:35:56,063][52650] Updated weights for policy 0, policy_version 16161 (0.0021) [2024-08-05 23:35:56,339][52647] DAMAGECOUNT value on done: 45817.0 [2024-08-05 23:35:56,340][52647] Sum rewards: 35.538, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.031', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon5': '0.052', 'AMMO4': '0.060', 'weapon4': '0.140', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'ARMOR': '0.483', 'WEAPON3': '0.950', 'weapon2': '1.108', 'HITCOUNT': '2.370', 'weapon3': '2.402', 'DAMAGECOUNT': '9.135', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:56,507][52803] DAMAGECOUNT value on done: 41497.0 [2024-08-05 23:35:56,507][52803] Sum rewards: 31.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.015', 'AMMO2': '0.020', 'ARMOR': '0.052', 'AMMO4': '0.101', 'weapon5': '0.108', 'AMMO3': '0.161', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.614', 'weapon4': '0.684', 'WEAPON3': '1.150', 'HITCOUNT': '2.080', 'weapon3': '2.256', 'DAMAGECOUNT': '7.935', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 132415488. Throughput: 0: 4353.3. Samples: 33111260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:35:57,794][52567] Avg episode reward: [(0, '33.487')] [2024-08-05 23:35:57,865][52811] DAMAGECOUNT value on done: 41963.0 [2024-08-05 23:35:57,865][52811] Sum rewards: 31.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.032', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.492', 'WEAPON3': '1.300', 'HITCOUNT': '2.180', 'weapon3': '2.828', 'DAMAGECOUNT': '8.970', 'FRAGCOUNT': '29.000'} [2024-08-05 23:35:57,872][52663] DAMAGECOUNT value on done: 45640.0 [2024-08-05 23:35:57,872][52663] Sum rewards: 32.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.040', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'ARMOR': '0.428', 'weapon2': '0.920', 'WEAPON3': '1.200', 'HITCOUNT': '2.340', 'weapon3': '2.734', 'DAMAGECOUNT': '9.465', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:58,044][52666] DAMAGECOUNT value on done: 41487.0 [2024-08-05 23:35:58,045][52666] Sum rewards: 34.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO2': '0.024', 'ARMOR': '0.032', 'AMMO4': '0.120', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.624', 'WEAPON3': '1.400', 'HITCOUNT': '2.280', 'weapon3': '2.816', 'DAMAGECOUNT': '9.153', 'FRAGCOUNT': '32.000'} [2024-08-05 23:35:58,053][52658] DAMAGECOUNT value on done: 46804.0 [2024-08-05 23:35:58,053][52658] Sum rewards: 34.267, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.065', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.358', 'ARMOR': '0.889', 'WEAPON3': '1.100', 'weapon2': '1.140', 'HITCOUNT': '2.040', 'weapon3': '2.276', 'DAMAGECOUNT': '8.793', 'FRAGCOUNT': '30.000'} [2024-08-05 23:35:58,609][52670] DAMAGECOUNT value on done: 40595.0 [2024-08-05 23:35:58,609][52670] Sum rewards: 21.922, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.792', 'AMMO5': '0.010', 'weapon5': '0.038', 'AMMO2': '0.078', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.389', 'WEAPON4': '0.850', 'weapon2': '1.064', 'WEAPON3': '1.300', 'ARMOR': '1.344', 'HITCOUNT': '1.690', 'weapon3': '2.332', 'DAMAGECOUNT': '7.548', 'FRAGCOUNT': '24.000'} [2024-08-05 23:35:58,696][52667] DAMAGECOUNT value on done: 43425.0 [2024-08-05 23:35:58,699][52667] Sum rewards: 35.649, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.323', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.119', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'ARMOR': '0.892', 'WEAPON3': '1.000', 'weapon2': '1.006', 'HITCOUNT': '2.220', 'weapon3': '2.354', 'DAMAGECOUNT': '9.300', 'FRAGCOUNT': '28.000'} [2024-08-05 23:35:58,783][52665] DAMAGECOUNT value on done: 40927.0 [2024-08-05 23:35:58,786][52665] Sum rewards: 30.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.931', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO2': '0.042', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.209', 'AMMO4': '0.210', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.810', 'WEAPON3': '1.350', 'HITCOUNT': '2.160', 'weapon3': '2.666', 'DAMAGECOUNT': '8.268', 'FRAGCOUNT': '27.000'} [2024-08-05 23:35:58,939][52647] DAMAGECOUNT value on done: 45967.0 [2024-08-05 23:35:58,939][52647] Sum rewards: 38.667, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.102', 'AMMO3': '0.168', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'ARMOR': '0.480', 'weapon4': '0.614', 'weapon2': '0.692', 'WEAPON4': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.220', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.953', 'FRAGCOUNT': '34.000'} [2024-08-05 23:35:59,679][52803] DAMAGECOUNT value on done: 38590.0 [2024-08-05 23:35:59,680][52803] Sum rewards: 20.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.930', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.368', 'ARMOR': '0.476', 'weapon2': '0.544', 'WEAPON3': '1.550', 'HITCOUNT': '1.690', 'weapon3': '2.738', 'DAMAGECOUNT': '7.185', 'FRAGCOUNT': '23.000'} [2024-08-05 23:36:00,525][52666] DAMAGECOUNT value on done: 38813.0 [2024-08-05 23:36:00,526][52666] Sum rewards: 36.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.300', 'weapon4': '0.426', 'WEAPON4': '0.500', 'weapon2': '0.766', 'ARMOR': '0.976', 'WEAPON3': '1.150', 'weapon3': '2.264', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '10.074', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:00,881][52811] DAMAGECOUNT value on done: 37025.0 [2024-08-05 23:36:00,887][52663] DAMAGECOUNT value on done: 40776.0 [2024-08-05 23:36:00,885][52811] Sum rewards: 20.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.592', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.195', 'AMMO4': '0.221', 'WEAPON4': '0.450', 'ARMOR': '0.500', 'weapon4': '0.536', 'weapon2': '1.072', 'WEAPON3': '1.200', 'weapon3': '1.798', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '7.323', 'FRAGCOUNT': '20.000'} [2024-08-05 23:36:00,888][52663] Sum rewards: 29.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.566', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.225', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '1.152', 'WEAPON3': '1.350', 'ARMOR': '1.808', 'HITCOUNT': '2.060', 'weapon3': '2.254', 'DAMAGECOUNT': '8.019', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:01,141][52650] Updated weights for policy 0, policy_version 16171 (0.0014) [2024-08-05 23:36:01,187][52670] DAMAGECOUNT value on done: 39253.0 [2024-08-05 23:36:01,187][52670] Sum rewards: 29.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.687', 'AMMO5': '0.003', 'weapon5': '0.038', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'ARMOR': '0.052', 'AMMO3': '0.173', 'AMMO4': '0.211', 'weapon4': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.200', 'HITCOUNT': '1.940', 'weapon3': '2.518', 'DAMAGECOUNT': '8.301', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:01,253][52658] DAMAGECOUNT value on done: 40970.0 [2024-08-05 23:36:01,253][52658] Sum rewards: 42.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'weapon2': '0.752', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.768', 'DAMAGECOUNT': '10.818', 'FRAGCOUNT': '36.000'} [2024-08-05 23:36:01,307][52647] DAMAGECOUNT value on done: 43722.0 [2024-08-05 23:36:01,309][52647] Sum rewards: 32.630, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.196', 'AMMO5': '0.015', 'AMMO2': '0.026', 'ARMOR': '0.060', 'AMMO4': '0.129', 'AMMO3': '0.152', 'weapon5': '0.180', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.868', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.412', 'DAMAGECOUNT': '8.574', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:01,844][52665] DAMAGECOUNT value on done: 41541.0 [2024-08-05 23:36:01,848][52665] Sum rewards: 31.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'AMMO2': '0.023', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.214', 'weapon2': '0.902', 'WEAPON3': '1.400', 'HITCOUNT': '2.220', 'weapon3': '2.676', 'DAMAGECOUNT': '9.087', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:01,860][52667] DAMAGECOUNT value on done: 44641.0 [2024-08-05 23:36:01,860][52667] Sum rewards: 42.166, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.060', 'weapon4': '0.120', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'HEALTH': '0.274', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.294', 'ARMOR': '1.654', 'weapon3': '2.336', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.803', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 132505600. Throughput: 0: 4353.5. Samples: 33124430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:36:02,795][52567] Avg episode reward: [(0, '33.117')] [2024-08-05 23:36:02,817][52803] DAMAGECOUNT value on done: 41898.0 [2024-08-05 23:36:02,817][52803] Sum rewards: 32.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.276', 'ARMOR': '0.442', 'weapon2': '1.126', 'WEAPON3': '1.200', 'weapon3': '2.290', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '9.489', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:03,468][52666] DAMAGECOUNT value on done: 38860.0 [2024-08-05 23:36:03,469][52666] Sum rewards: 42.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.917', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.160', 'weapon4': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.916', 'WEAPON3': '1.000', 'weapon2': '1.004', 'weapon3': '2.450', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.221', 'FRAGCOUNT': '35.000'} [2024-08-05 23:36:03,674][52647] DAMAGECOUNT value on done: 46905.0 [2024-08-05 23:36:03,675][52647] Sum rewards: 28.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.380', 'weapon2': '0.976', 'ARMOR': '1.200', 'WEAPON3': '1.250', 'HITCOUNT': '2.160', 'weapon3': '2.464', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:03,721][52663] DAMAGECOUNT value on done: 42591.0 [2024-08-05 23:36:03,722][52663] Sum rewards: 27.961, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'HEALTH': '0.043', 'weapon5': '0.050', 'weapon4': '0.134', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'ARMOR': '0.852', 'weapon2': '0.854', 'WEAPON3': '1.100', 'HITCOUNT': '1.720', 'weapon3': '2.654', 'DAMAGECOUNT': '7.575', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:03,928][52811] DAMAGECOUNT value on done: 39714.0 [2024-08-05 23:36:03,929][52811] Sum rewards: 24.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.161', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'ARMOR': '0.454', 'weapon4': '0.552', 'weapon2': '0.902', 'WEAPON3': '1.050', 'HITCOUNT': '1.770', 'weapon3': '2.094', 'DAMAGECOUNT': '6.738', 'FRAGCOUNT': '23.000'} [2024-08-05 23:36:03,978][52670] DAMAGECOUNT value on done: 36618.0 [2024-08-05 23:36:03,978][52670] Sum rewards: 31.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'ARMOR': '0.863', 'weapon2': '1.172', 'WEAPON3': '1.450', 'HITCOUNT': '2.360', 'weapon3': '2.482', 'DAMAGECOUNT': '9.852', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:04,129][52658] DAMAGECOUNT value on done: 44729.0 [2024-08-05 23:36:04,131][52658] Sum rewards: 30.673, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.332', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.145', 'weapon5': '0.160', 'weapon4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.210', 'weapon3': '2.186', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '8.496', 'FRAGCOUNT': '25.500'} [2024-08-05 23:36:04,727][52667] DAMAGECOUNT value on done: 42859.0 [2024-08-05 23:36:04,728][52667] Sum rewards: 38.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.415', 'weapon4': '0.006', 'AMMO2': '0.012', 'AMMO5': '0.015', 'weapon5': '0.046', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'ARMOR': '0.404', 'weapon2': '0.740', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.868', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:04,848][52665] DAMAGECOUNT value on done: 40820.0 [2024-08-05 23:36:04,848][52665] Sum rewards: 22.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon5': '0.086', 'weapon4': '0.168', 'AMMO4': '0.178', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.891', 'weapon2': '1.312', 'WEAPON3': '1.450', 'HITCOUNT': '1.860', 'weapon3': '2.044', 'DAMAGECOUNT': '7.032', 'FRAGCOUNT': '22.000'} [2024-08-05 23:36:05,452][52650] Updated weights for policy 0, policy_version 16181 (0.0028) [2024-08-05 23:36:05,901][52803] DAMAGECOUNT value on done: 40127.0 [2024-08-05 23:36:05,901][52803] Sum rewards: 37.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.034', 'AMMO4': '0.164', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.808', 'WEAPON3': '1.150', 'ARMOR': '1.288', 'HITCOUNT': '2.400', 'weapon3': '2.564', 'DAMAGECOUNT': '10.083', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:06,400][52647] DAMAGECOUNT value on done: 46590.0 [2024-08-05 23:36:06,401][52647] Sum rewards: 41.291, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.278', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.062', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.240', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'ARMOR': '0.476', 'weapon2': '0.700', 'WEAPON3': '1.750', 'HITCOUNT': '2.630', 'weapon3': '2.640', 'DAMAGECOUNT': '10.719', 'FRAGCOUNT': '40.000'} [2024-08-05 23:36:06,431][52666] DAMAGECOUNT value on done: 40495.0 [2024-08-05 23:36:06,433][52666] Sum rewards: 33.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.183', 'ARMOR': '0.400', 'weapon2': '0.922', 'WEAPON3': '1.200', 'HITCOUNT': '2.320', 'weapon3': '2.676', 'DAMAGECOUNT': '8.958', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:06,727][52671] DAMAGECOUNT value on done: 46177.0 [2024-08-05 23:36:06,727][52671] Sum rewards: 37.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.108', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon2': '0.942', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.678', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:06,927][52811] DAMAGECOUNT value on done: 39905.0 [2024-08-05 23:36:06,928][52811] Sum rewards: 38.534, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.314', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.072', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon2': '1.200', 'HITCOUNT': '2.190', 'weapon3': '2.472', 'DAMAGECOUNT': '9.519', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:07,015][52658] DAMAGECOUNT value on done: 44339.0 [2024-08-05 23:36:07,015][52658] Sum rewards: 36.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.404', 'weapon2': '0.760', 'ARMOR': '0.881', 'WEAPON3': '1.350', 'weapon3': '2.366', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '10.629', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:07,048][52663] DAMAGECOUNT value on done: 46457.0 [2024-08-05 23:36:07,048][52663] Sum rewards: 46.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.783', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'ARMOR': '0.404', 'weapon2': '0.972', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.802', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '40.000'} [2024-08-05 23:36:07,064][52670] DAMAGECOUNT value on done: 41608.0 [2024-08-05 23:36:07,067][52670] Sum rewards: 26.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.285', 'AMMO5': '0.012', 'AMMO2': '0.062', 'weapon5': '0.066', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'AMMO4': '0.310', 'ARMOR': '0.480', 'WEAPON4': '0.500', 'weapon4': '0.602', 'weapon2': '0.794', 'WEAPON3': '1.100', 'HITCOUNT': '2.110', 'weapon3': '2.158', 'DAMAGECOUNT': '8.928', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:07,587][52667] DAMAGECOUNT value on done: 44049.0 [2024-08-05 23:36:07,588][52667] Sum rewards: 29.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.631', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO4': '0.189', 'AMMO3': '0.208', 'weapon4': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.836', 'WEAPON3': '1.400', 'HITCOUNT': '2.300', 'weapon3': '2.518', 'DAMAGECOUNT': '8.727', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 132587520. Throughput: 0: 4367.1. Samples: 33151200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:36:07,794][52567] Avg episode reward: [(0, '32.876')] [2024-08-05 23:36:07,821][52665] DAMAGECOUNT value on done: 40265.0 [2024-08-05 23:36:07,822][52665] Sum rewards: 31.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.188', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON3': '1.150', 'ARMOR': '1.279', 'weapon2': '1.308', 'HITCOUNT': '2.220', 'weapon3': '2.272', 'DAMAGECOUNT': '8.214', 'FRAGCOUNT': '27.000'} [2024-08-05 23:36:08,920][52803] DAMAGECOUNT value on done: 39362.0 [2024-08-05 23:36:08,931][52803] Sum rewards: 36.040, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.096', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'AMMO4': '0.165', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.254', 'ARMOR': '1.773', 'weapon3': '2.288', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '8.931', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:09,266][52666] DAMAGECOUNT value on done: 39694.0 [2024-08-05 23:36:09,266][52666] Sum rewards: 39.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.776', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.155', 'weapon4': '0.246', 'WEAPON4': '0.300', 'ARMOR': '0.859', 'weapon2': '0.950', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.626', 'DAMAGECOUNT': '9.516', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:09,334][52647] DAMAGECOUNT value on done: 45006.0 [2024-08-05 23:36:09,334][52647] Sum rewards: 48.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'ARMOR': '0.472', 'weapon2': '0.794', 'WEAPON3': '1.400', 'HITCOUNT': '2.730', 'weapon3': '2.834', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '42.000'} [2024-08-05 23:36:09,607][52671] DAMAGECOUNT value on done: 42899.0 [2024-08-05 23:36:09,608][52671] Sum rewards: 33.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.197', 'WEAPON4': '0.350', 'ARMOR': '0.489', 'weapon2': '0.550', 'weapon4': '0.556', 'WEAPON3': '1.000', 'HITCOUNT': '2.110', 'weapon3': '2.408', 'DAMAGECOUNT': '8.991', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:09,806][52658] DAMAGECOUNT value on done: 43225.0 [2024-08-05 23:36:09,807][52658] Sum rewards: 39.214, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.155', 'weapon4': '0.202', 'WEAPON4': '0.250', 'ARMOR': '0.888', 'weapon2': '0.916', 'WEAPON3': '1.050', 'HITCOUNT': '2.310', 'weapon3': '2.638', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '32.000'} [2024-08-05 23:36:09,873][52670] DAMAGECOUNT value on done: 43424.0 [2024-08-05 23:36:09,875][52670] Sum rewards: 38.787, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.387', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.134', 'AMMO3': '0.146', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.258', 'WEAPON4': '0.500', 'ARMOR': '0.824', 'WEAPON3': '1.000', 'weapon2': '1.066', 'HITCOUNT': '1.970', 'weapon3': '2.368', 'DAMAGECOUNT': '8.211', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:09,902][52811] DAMAGECOUNT value on done: 42897.0 [2024-08-05 23:36:09,906][52811] Sum rewards: 41.232, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.906', 'ARMOR': '0.949', 'WEAPON3': '1.150', 'HITCOUNT': '2.280', 'weapon3': '2.446', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:10,190][52663] DAMAGECOUNT value on done: 41955.0 [2024-08-05 23:36:10,190][52663] Sum rewards: 31.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.380', 'ARMOR': '0.489', 'weapon2': '0.622', 'WEAPON3': '1.500', 'HITCOUNT': '2.210', 'weapon3': '2.416', 'DAMAGECOUNT': '9.321', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:10,329][52650] Updated weights for policy 0, policy_version 16191 (0.0019) [2024-08-05 23:36:10,582][52665] DAMAGECOUNT value on done: 40805.0 [2024-08-05 23:36:10,583][52665] Sum rewards: 37.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.426', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.130', 'AMMO3': '0.199', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '1.016', 'WEAPON3': '1.250', 'HITCOUNT': '2.220', 'weapon3': '2.512', 'DAMAGECOUNT': '9.480', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:11,978][52803] DAMAGECOUNT value on done: 39968.0 [2024-08-05 23:36:11,979][52803] Sum rewards: 38.494, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'weapon5': '0.102', 'weapon4': '0.130', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon2': '1.214', 'weapon3': '2.248', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:12,026][52666] DAMAGECOUNT value on done: 40781.0 [2024-08-05 23:36:12,028][52666] Sum rewards: 43.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.231', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.207', 'weapon2': '1.198', 'ARMOR': '1.220', 'WEAPON3': '1.400', 'weapon3': '2.642', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '37.000'} [2024-08-05 23:36:12,161][52647] DAMAGECOUNT value on done: 44599.0 [2024-08-05 23:36:12,161][52647] Sum rewards: 38.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.566', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.818', 'ARMOR': '1.252', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '2.742', 'DAMAGECOUNT': '11.445', 'FRAGCOUNT': '32.000'} [2024-08-05 23:36:12,283][52658] DAMAGECOUNT value on done: 40325.0 [2024-08-05 23:36:12,284][52658] Sum rewards: 23.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.385', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.342', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.088', 'HITCOUNT': '1.780', 'weapon3': '2.166', 'DAMAGECOUNT': '7.392', 'FRAGCOUNT': '21.000'} [2024-08-05 23:36:12,444][52670] DAMAGECOUNT value on done: 42550.0 [2024-08-05 23:36:12,445][52670] Sum rewards: 33.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.698', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.206', 'ARMOR': '0.800', 'WEAPON3': '1.100', 'weapon2': '1.214', 'HITCOUNT': '2.170', 'weapon3': '2.326', 'DAMAGECOUNT': '8.832', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:12,726][52671] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:36:12,744][52671] DAMAGECOUNT value on done: 43056.0 [2024-08-05 23:36:12,747][52671] Sum rewards: 40.670, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.514', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.096', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'weapon4': '0.326', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'weapon2': '1.292', 'weapon3': '2.140', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.924', 'FRAGCOUNT': '32.000'} [2024-08-05 23:36:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 132677632. Throughput: 0: 4374.9. Samples: 33177860. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:36:12,795][52567] Avg episode reward: [(0, '33.382')] [2024-08-05 23:36:12,910][52811] DAMAGECOUNT value on done: 38317.0 [2024-08-05 23:36:12,911][52811] Sum rewards: 27.984, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.838', 'AMMO5': '0.007', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.210', 'AMMO3': '0.213', 'weapon4': '0.348', 'WEAPON4': '0.600', 'ARMOR': '0.877', 'weapon2': '0.986', 'WEAPON3': '1.350', 'HITCOUNT': '2.270', 'weapon3': '2.402', 'DAMAGECOUNT': '9.117', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:13,093][52663] DAMAGECOUNT value on done: 42968.0 [2024-08-05 23:36:13,095][52663] Sum rewards: 35.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.254', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon5': '0.020', 'ARMOR': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'weapon2': '0.798', 'WEAPON3': '1.600', 'HITCOUNT': '2.480', 'weapon3': '2.958', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:13,529][52665] DAMAGECOUNT value on done: 40652.0 [2024-08-05 23:36:13,530][52665] Sum rewards: 36.997, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.449', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'ARMOR': '0.847', 'WEAPON3': '1.050', 'weapon2': '1.382', 'weapon3': '2.370', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '9.756', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:14,695][52666] DAMAGECOUNT value on done: 41199.0 [2024-08-05 23:36:14,696][52666] Sum rewards: 39.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.276', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.078', 'weapon4': '0.188', 'AMMO3': '0.197', 'AMMO4': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.714', 'ARMOR': '0.950', 'WEAPON3': '1.350', 'HITCOUNT': '2.400', 'weapon3': '2.696', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:14,931][52650] Updated weights for policy 0, policy_version 16201 (0.0024) [2024-08-05 23:36:14,952][52658] DAMAGECOUNT value on done: 43294.0 [2024-08-05 23:36:14,953][52658] Sum rewards: 32.029, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO2': '0.017', 'AMMO5': '0.020', 'weapon7': '0.062', 'AMMO4': '0.084', 'weapon5': '0.132', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.163', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON5': '0.450', 'weapon2': '0.774', 'ARMOR': '0.954', 'WEAPON3': '1.100', 'HITCOUNT': '1.770', 'weapon3': '2.280', 'DAMAGECOUNT': '8.613', 'FRAGCOUNT': '27.000'} [2024-08-05 23:36:14,976][52803] DAMAGECOUNT value on done: 40021.0 [2024-08-05 23:36:14,976][52803] Sum rewards: 35.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.362', 'ARMOR': '0.428', 'weapon2': '0.920', 'WEAPON3': '1.250', 'weapon3': '2.294', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '9.210', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:15,105][52647] DAMAGECOUNT value on done: 41532.0 [2024-08-05 23:36:15,106][52647] Sum rewards: 29.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.193', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon2': '0.634', 'weapon4': '0.694', 'WEAPON3': '1.200', 'HITCOUNT': '2.150', 'weapon3': '2.390', 'DAMAGECOUNT': '8.151', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:15,156][52670] DAMAGECOUNT value on done: 42713.0 [2024-08-05 23:36:15,156][52670] Sum rewards: 26.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.134', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.738', 'WEAPON3': '1.050', 'ARMOR': '1.228', 'HITCOUNT': '2.160', 'weapon3': '2.574', 'DAMAGECOUNT': '8.025', 'FRAGCOUNT': '23.000'} [2024-08-05 23:36:15,807][52671] DAMAGECOUNT value on done: 40652.0 [2024-08-05 23:36:15,809][52671] Sum rewards: 27.383, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.715', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO3': '0.116', 'AMMO4': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.534', 'WEAPON3': '0.800', 'ARMOR': '0.900', 'weapon2': '1.140', 'weapon3': '1.890', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '7.230', 'FRAGCOUNT': '21.000'} [2024-08-05 23:36:15,819][52811] DAMAGECOUNT value on done: 40761.0 [2024-08-05 23:36:15,820][52811] Sum rewards: 35.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon5': '0.082', 'AMMO4': '0.207', 'AMMO3': '0.210', 'weapon4': '0.238', 'WEAPON5': '0.350', 'ARMOR': '0.495', 'WEAPON4': '0.500', 'weapon2': '0.540', 'WEAPON3': '1.350', 'HITCOUNT': '2.280', 'weapon3': '2.820', 'DAMAGECOUNT': '10.377', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:16,171][52663] DAMAGECOUNT value on done: 40193.0 [2024-08-05 23:36:16,172][52663] Sum rewards: 25.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.846', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.038', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'ARMOR': '0.502', 'weapon2': '1.106', 'WEAPON3': '1.400', 'HITCOUNT': '2.410', 'weapon3': '2.470', 'DAMAGECOUNT': '9.738', 'FRAGCOUNT': '23.000'} [2024-08-05 23:36:17,136][52666] DAMAGECOUNT value on done: 40169.0 [2024-08-05 23:36:17,138][52666] Sum rewards: 23.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.888', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON3': '1.100', 'weapon2': '1.346', 'ARMOR': '1.368', 'HITCOUNT': '1.880', 'weapon3': '2.352', 'DAMAGECOUNT': '6.903', 'FRAGCOUNT': '21.000'} [2024-08-05 23:36:17,667][52670] DAMAGECOUNT value on done: 42414.0 [2024-08-05 23:36:17,669][52670] Sum rewards: 27.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'weapon5': '0.046', 'AMMO2': '0.062', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.312', 'weapon4': '0.390', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon2': '1.078', 'ARMOR': '1.343', 'HITCOUNT': '1.980', 'weapon3': '2.184', 'DAMAGECOUNT': '8.127', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 132767744. Throughput: 0: 4378.4. Samples: 33190990. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:36:17,794][52567] Avg episode reward: [(0, '32.595')] [2024-08-05 23:36:17,845][52647] DAMAGECOUNT value on done: 44657.0 [2024-08-05 23:36:17,846][52647] Sum rewards: 32.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.939', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.044', 'AMMO4': '0.089', 'weapon4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.612', 'WEAPON3': '1.300', 'HITCOUNT': '2.160', 'weapon3': '3.044', 'DAMAGECOUNT': '8.124', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:17,890][52658] DAMAGECOUNT value on done: 42729.0 [2024-08-05 23:36:17,891][52658] Sum rewards: 33.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.226', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'ARMOR': '0.800', 'weapon2': '0.874', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '2.792', 'DAMAGECOUNT': '10.239', 'FRAGCOUNT': '27.500'} [2024-08-05 23:36:18,209][52803] DAMAGECOUNT value on done: 37212.0 [2024-08-05 23:36:18,211][52803] Sum rewards: 19.661, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'HEALTH': '0.396', 'WEAPON3': '0.650', 'weapon4': '0.670', 'ARMOR': '0.816', 'HITCOUNT': '1.030', 'weapon2': '1.126', 'weapon3': '1.880', 'DAMAGECOUNT': '4.284', 'FRAGCOUNT': '16.000'} [2024-08-05 23:36:18,669][52663] DAMAGECOUNT value on done: 43379.0 [2024-08-05 23:36:18,670][52663] Sum rewards: 41.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.311', 'AMMO5': '0.006', 'weapon5': '0.046', 'AMMO2': '0.047', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'AMMO4': '0.237', 'weapon4': '0.474', 'WEAPON4': '0.600', 'weapon2': '0.812', 'ARMOR': '1.290', 'WEAPON3': '1.450', 'weapon3': '2.384', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.106', 'FRAGCOUNT': '39.000'} [2024-08-05 23:36:18,775][52671] DAMAGECOUNT value on done: 39937.0 [2024-08-05 23:36:18,776][52671] Sum rewards: 23.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.201', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon2': '1.152', 'ARMOR': '1.329', 'HITCOUNT': '1.930', 'weapon3': '2.310', 'DAMAGECOUNT': '7.170', 'FRAGCOUNT': '22.000'} [2024-08-05 23:36:18,850][52811] DAMAGECOUNT value on done: 39708.0 [2024-08-05 23:36:18,852][52811] Sum rewards: 28.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.357', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.082', 'AMMO4': '0.149', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.616', 'ARMOR': '1.325', 'WEAPON3': '1.500', 'HITCOUNT': '1.840', 'weapon3': '2.954', 'DAMAGECOUNT': '8.187', 'FRAGCOUNT': '27.000'} [2024-08-05 23:36:19,175][52650] Updated weights for policy 0, policy_version 16211 (0.0013) [2024-08-05 23:36:19,898][52666] DAMAGECOUNT value on done: 40293.0 [2024-08-05 23:36:19,906][52666] Sum rewards: 28.497, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.104', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'ARMOR': '0.800', 'weapon2': '1.128', 'WEAPON3': '1.500', 'HITCOUNT': '2.130', 'weapon3': '2.286', 'DAMAGECOUNT': '9.054', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:20,185][52647] DAMAGECOUNT value on done: 43534.0 [2024-08-05 23:36:20,186][52647] Sum rewards: 45.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.032', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.072', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.522', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.692', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '39.000'} [2024-08-05 23:36:20,358][52670] DAMAGECOUNT value on done: 39420.0 [2024-08-05 23:36:20,359][52670] Sum rewards: 33.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.976', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.194', 'weapon2': '0.856', 'ARMOR': '1.239', 'WEAPON3': '1.250', 'HITCOUNT': '2.310', 'weapon3': '2.598', 'DAMAGECOUNT': '9.195', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:20,560][52658] DAMAGECOUNT value on done: 42354.0 [2024-08-05 23:36:20,561][52658] Sum rewards: 34.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.146', 'WEAPON4': '0.400', 'weapon2': '0.626', 'weapon4': '0.912', 'WEAPON3': '0.950', 'ARMOR': '0.951', 'weapon3': '2.132', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '9.438', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:21,011][52659] DAMAGECOUNT value on done: 42781.0 [2024-08-05 23:36:21,013][52659] Sum rewards: 48.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.076', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.832', 'ARMOR': '0.855', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '2.952', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '43.000'} [2024-08-05 23:36:21,314][52803] DAMAGECOUNT value on done: 39950.0 [2024-08-05 23:36:21,316][52803] Sum rewards: 38.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.948', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.178', 'weapon4': '0.310', 'ARMOR': '0.461', 'WEAPON4': '0.500', 'weapon2': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.612', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.221', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:21,445][52663] DAMAGECOUNT value on done: 42906.0 [2024-08-05 23:36:21,445][52663] Sum rewards: 37.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.238', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.286', 'weapon2': '0.908', 'ARMOR': '1.278', 'WEAPON3': '1.300', 'weapon3': '2.548', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:21,758][52671] DAMAGECOUNT value on done: 44108.0 [2024-08-05 23:36:21,758][52671] Sum rewards: 26.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.009', 'ARMOR': '0.010', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO3': '0.139', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON3': '0.900', 'weapon2': '0.924', 'HITCOUNT': '1.930', 'weapon3': '2.098', 'DAMAGECOUNT': '6.879', 'FRAGCOUNT': '24.500'} [2024-08-05 23:36:22,059][52811] DAMAGECOUNT value on done: 40488.0 [2024-08-05 23:36:22,059][52811] Sum rewards: 25.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.602', 'AMMO5': '0.010', 'AMMO2': '0.061', 'weapon5': '0.068', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.303', 'weapon4': '0.350', 'ARMOR': '0.444', 'WEAPON4': '0.550', 'weapon2': '0.768', 'WEAPON3': '1.250', 'HITCOUNT': '1.900', 'weapon3': '2.494', 'DAMAGECOUNT': '7.173', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:22,375][52666] DAMAGECOUNT value on done: 41376.0 [2024-08-05 23:36:22,377][52666] Sum rewards: 26.991, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.778', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'ARMOR': '0.496', 'weapon4': '0.640', 'weapon2': '0.666', 'WEAPON3': '1.250', 'HITCOUNT': '1.860', 'weapon3': '2.434', 'DAMAGECOUNT': '7.686', 'FRAGCOUNT': '27.000'} [2024-08-05 23:36:22,683][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:36:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 132857856. Throughput: 0: 4390.0. Samples: 33217870. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-05 23:36:22,794][52567] Avg episode reward: [(0, '33.335')] [2024-08-05 23:36:22,989][52670] DAMAGECOUNT value on done: 40892.0 [2024-08-05 23:36:22,990][52670] Sum rewards: 27.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.611', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'WEAPON3': '1.250', 'weapon2': '1.320', 'HITCOUNT': '2.150', 'weapon3': '2.368', 'DAMAGECOUNT': '8.910', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:23,212][52647] DAMAGECOUNT value on done: 46054.0 [2024-08-05 23:36:23,212][52647] Sum rewards: 35.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'weapon5': '0.030', 'AMMO2': '0.036', 'weapon4': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.172', 'HITCOUNT': '2.380', 'weapon3': '2.554', 'DAMAGECOUNT': '9.744', 'FRAGCOUNT': '28.500'} [2024-08-05 23:36:23,383][52658] DAMAGECOUNT value on done: 44922.0 [2024-08-05 23:36:23,384][52658] Sum rewards: 32.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.951', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.110', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.460', 'weapon2': '0.908', 'WEAPON3': '1.050', 'HITCOUNT': '2.150', 'weapon3': '2.382', 'DAMAGECOUNT': '9.837', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:23,635][52795] DAMAGECOUNT value on done: 40697.0 [2024-08-05 23:36:23,635][52795] Sum rewards: 33.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.170', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.810', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.530', 'DAMAGECOUNT': '9.768', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:23,896][52659] DAMAGECOUNT value on done: 45270.0 [2024-08-05 23:36:23,896][52659] Sum rewards: 26.377, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.136', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'AMMO3': '0.317', 'weapon2': '0.992', 'ARMOR': '1.255', 'WEAPON3': '1.900', 'HITCOUNT': '2.060', 'weapon3': '2.746', 'DAMAGECOUNT': '9.177', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:24,090][52650] Updated weights for policy 0, policy_version 16221 (0.0012) [2024-08-05 23:36:24,232][52663] DAMAGECOUNT value on done: 43081.0 [2024-08-05 23:36:24,235][52663] Sum rewards: 39.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'ARMOR': '0.440', 'weapon2': '1.010', 'WEAPON3': '1.200', 'HITCOUNT': '2.270', 'weapon3': '2.640', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:24,258][52803] DAMAGECOUNT value on done: 40331.0 [2024-08-05 23:36:24,260][52803] Sum rewards: 31.879, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.639', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.132', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'weapon2': '1.444', 'ARMOR': '1.680', 'HITCOUNT': '2.070', 'weapon3': '2.254', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:24,648][52671] DAMAGECOUNT value on done: 43038.0 [2024-08-05 23:36:24,650][52671] Sum rewards: 29.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.384', 'ARMOR': '0.441', 'weapon2': '0.948', 'WEAPON3': '1.500', 'HITCOUNT': '2.200', 'weapon3': '2.388', 'DAMAGECOUNT': '8.253', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:24,986][52811] DAMAGECOUNT value on done: 40039.0 [2024-08-05 23:36:24,994][52811] Sum rewards: 42.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.905', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '1.122', 'WEAPON3': '1.300', 'ARMOR': '1.373', 'weapon3': '2.420', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.503', 'FRAGCOUNT': '38.000'} [2024-08-05 23:36:25,392][52666] DAMAGECOUNT value on done: 41049.0 [2024-08-05 23:36:25,394][52666] Sum rewards: 30.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.031', 'ARMOR': '0.068', 'AMMO4': '0.153', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.486', 'weapon2': '1.032', 'WEAPON3': '1.100', 'HITCOUNT': '2.130', 'weapon3': '2.182', 'DAMAGECOUNT': '9.027', 'FRAGCOUNT': '27.000'} [2024-08-05 23:36:25,889][52670] DAMAGECOUNT value on done: 40561.0 [2024-08-05 23:36:25,891][52670] Sum rewards: 27.809, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.882', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon5': '0.088', 'AMMO3': '0.143', 'weapon4': '0.186', 'WEAPON3': '0.900', 'weapon2': '1.132', 'ARMOR': '1.350', 'HITCOUNT': '1.810', 'weapon3': '2.402', 'DAMAGECOUNT': '7.506', 'FRAGCOUNT': '22.000'} [2024-08-05 23:36:26,070][52647] DAMAGECOUNT value on done: 43312.0 [2024-08-05 23:36:26,070][52647] Sum rewards: 33.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.296', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.098', 'AMMO3': '0.175', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.394', 'WEAPON4': '0.400', 'weapon2': '0.814', 'ARMOR': '0.914', 'WEAPON3': '1.100', 'HITCOUNT': '2.290', 'weapon3': '2.352', 'DAMAGECOUNT': '9.078', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:26,428][52658] DAMAGECOUNT value on done: 46775.0 [2024-08-05 23:36:26,430][52658] Sum rewards: 46.257, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'HEALTH': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.119', 'weapon5': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON3': '0.700', 'ARMOR': '0.932', 'weapon2': '1.312', 'weapon3': '2.142', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '36.500'} [2024-08-05 23:36:26,483][52659] DAMAGECOUNT value on done: 41855.0 [2024-08-05 23:36:26,485][52659] Sum rewards: 27.485, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.708', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.132', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.350', 'ARMOR': '0.503', 'weapon2': '0.852', 'WEAPON3': '1.100', 'HITCOUNT': '1.840', 'weapon3': '2.408', 'DAMAGECOUNT': '7.671', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:26,730][52795] DAMAGECOUNT value on done: 37500.0 [2024-08-05 23:36:26,731][52795] Sum rewards: 30.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.139', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.400', 'weapon2': '0.626', 'weapon4': '0.716', 'WEAPON3': '1.350', 'weapon3': '2.160', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.306', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:27,102][52671] DAMAGECOUNT value on done: 46254.0 [2024-08-05 23:36:27,104][52671] Sum rewards: 37.855, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.314', 'AMMO5': '0.007', 'AMMO2': '0.048', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.189', 'AMMO4': '0.238', 'weapon2': '0.504', 'ARMOR': '0.552', 'WEAPON4': '0.600', 'weapon4': '0.690', 'WEAPON3': '1.250', 'weapon3': '1.994', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.888', 'FRAGCOUNT': '32.000'} [2024-08-05 23:36:27,248][52803] DAMAGECOUNT value on done: 41482.0 [2024-08-05 23:36:27,249][52803] Sum rewards: 34.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.248', 'weapon5': '0.006', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.720', 'ARMOR': '0.993', 'WEAPON3': '1.300', 'HITCOUNT': '2.140', 'weapon3': '2.954', 'DAMAGECOUNT': '9.114', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:27,328][52663] DAMAGECOUNT value on done: 44258.0 [2024-08-05 23:36:27,330][52663] Sum rewards: 38.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.472', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.136', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.822', 'ARMOR': '0.874', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.318', 'DAMAGECOUNT': '10.314', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 132947968. Throughput: 0: 4410.0. Samples: 33244690. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-05 23:36:27,794][52567] Avg episode reward: [(0, '33.481')] [2024-08-05 23:36:27,894][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000016230_132956160.pth... [2024-08-05 23:36:28,002][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015716_128745472.pth [2024-08-05 23:36:28,131][52811] DAMAGECOUNT value on done: 40163.0 [2024-08-05 23:36:28,134][52811] Sum rewards: 31.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'AMMO2': '0.039', 'ARMOR': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO3': '0.216', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.100', 'weapon3': '2.824', 'DAMAGECOUNT': '8.115', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:28,766][52650] Updated weights for policy 0, policy_version 16231 (0.0026) [2024-08-05 23:36:28,929][52670] DAMAGECOUNT value on done: 40939.0 [2024-08-05 23:36:28,931][52670] Sum rewards: 33.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.228', 'weapon4': '0.260', 'WEAPON4': '0.400', 'ARMOR': '0.900', 'weapon2': '0.938', 'WEAPON3': '1.450', 'HITCOUNT': '2.400', 'weapon3': '2.542', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:29,010][52659] DAMAGECOUNT value on done: 43073.0 [2024-08-05 23:36:29,011][52659] Sum rewards: 37.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.709', 'weapon5': '0.024', 'AMMO5': '0.025', 'AMMO2': '0.043', 'weapon4': '0.114', 'AMMO3': '0.198', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '1.088', 'ARMOR': '1.200', 'WEAPON3': '1.250', 'HITCOUNT': '2.460', 'weapon3': '2.532', 'DAMAGECOUNT': '9.585', 'FRAGCOUNT': '35.000'} [2024-08-05 23:36:29,074][52647] DAMAGECOUNT value on done: 42964.0 [2024-08-05 23:36:29,076][52647] Sum rewards: 31.936, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.412', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.132', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon2': '1.284', 'ARMOR': '1.355', 'HITCOUNT': '2.240', 'weapon3': '2.390', 'DAMAGECOUNT': '8.523', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:29,524][52658] DAMAGECOUNT value on done: 42289.0 [2024-08-05 23:36:29,526][52658] Sum rewards: 30.870, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.256', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'WEAPON3': '0.900', 'ARMOR': '1.330', 'weapon2': '1.610', 'HITCOUNT': '1.820', 'weapon3': '2.176', 'DAMAGECOUNT': '7.455', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:29,762][52795] DAMAGECOUNT value on done: 38216.0 [2024-08-05 23:36:29,763][52795] Sum rewards: 33.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.809', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.181', 'weapon4': '0.238', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'weapon2': '1.002', 'WEAPON3': '1.100', 'HITCOUNT': '2.170', 'weapon3': '2.538', 'DAMAGECOUNT': '8.853', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:29,908][52671] DAMAGECOUNT value on done: 41763.0 [2024-08-05 23:36:29,908][52671] Sum rewards: 21.060, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.553', 'AMMO2': '0.015', 'ARMOR': '0.036', 'AMMO4': '0.073', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon2': '0.366', 'WEAPON3': '0.900', 'weapon4': '0.918', 'HITCOUNT': '1.450', 'weapon3': '2.288', 'DAMAGECOUNT': '6.186', 'FRAGCOUNT': '17.000'} [2024-08-05 23:36:30,167][52663] DAMAGECOUNT value on done: 43785.0 [2024-08-05 23:36:30,167][52663] Sum rewards: 31.929, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.238', 'AMMO5': '0.009', 'weapon7': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.129', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.352', 'ARMOR': '0.416', 'WEAPON3': '0.950', 'weapon2': '1.034', 'HITCOUNT': '1.850', 'weapon3': '2.132', 'DAMAGECOUNT': '8.028', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:30,336][52803] DAMAGECOUNT value on done: 39684.0 [2024-08-05 23:36:30,337][52803] Sum rewards: 41.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.532', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.234', 'weapon2': '0.940', 'ARMOR': '1.283', 'WEAPON3': '1.300', 'weapon3': '2.490', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '36.000'} [2024-08-05 23:36:31,232][52811] DAMAGECOUNT value on done: 43023.0 [2024-08-05 23:36:31,233][52811] Sum rewards: 26.176, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon5': '0.086', 'AMMO3': '0.175', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'ARMOR': '0.497', 'WEAPON4': '0.650', 'weapon4': '0.654', 'weapon2': '0.760', 'WEAPON3': '1.100', 'HITCOUNT': '1.750', 'weapon3': '2.148', 'DAMAGECOUNT': '6.921', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:31,657][52647] DAMAGECOUNT value on done: 44467.0 [2024-08-05 23:36:31,657][52647] Sum rewards: 36.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.602', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.452', 'ARMOR': '0.891', 'weapon2': '0.958', 'WEAPON3': '1.050', 'HITCOUNT': '2.290', 'weapon3': '2.326', 'DAMAGECOUNT': '8.898', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:31,825][52659] DAMAGECOUNT value on done: 42739.0 [2024-08-05 23:36:31,825][52659] Sum rewards: 30.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.601', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.634', 'WEAPON3': '1.450', 'HITCOUNT': '2.510', 'weapon3': '3.036', 'DAMAGECOUNT': '9.447', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:31,981][52670] DAMAGECOUNT value on done: 41170.0 [2024-08-05 23:36:31,984][52670] Sum rewards: 32.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.101', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.258', 'ARMOR': '0.484', 'weapon2': '0.564', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '2.914', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:32,471][52658] DAMAGECOUNT value on done: 41541.0 [2024-08-05 23:36:32,471][52658] Sum rewards: 26.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.444', 'AMMO5': '0.027', 'AMMO2': '0.067', 'weapon5': '0.104', 'AMMO3': '0.222', 'AMMO4': '0.333', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON4': '0.700', 'ARMOR': '0.958', 'weapon2': '1.150', 'WEAPON3': '1.300', 'weapon3': '1.922', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '7.593', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:32,598][52671] DAMAGECOUNT value on done: 45807.0 [2024-08-05 23:36:32,600][52671] Sum rewards: 26.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.578', 'weapon2': '0.602', 'ARMOR': '0.859', 'WEAPON3': '1.100', 'HITCOUNT': '2.240', 'weapon3': '2.398', 'DAMAGECOUNT': '8.193', 'FRAGCOUNT': '23.000'} [2024-08-05 23:36:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 133029888. Throughput: 0: 4415.8. Samples: 33257770. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-05 23:36:32,794][52567] Avg episode reward: [(0, '33.570')] [2024-08-05 23:36:32,812][52795] DAMAGECOUNT value on done: 41089.0 [2024-08-05 23:36:32,812][52795] Sum rewards: 34.298, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.426', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'ARMOR': '0.424', 'weapon4': '0.494', 'weapon2': '0.662', 'WEAPON3': '1.050', 'HITCOUNT': '2.380', 'weapon3': '2.630', 'DAMAGECOUNT': '9.174', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:32,861][52663] DAMAGECOUNT value on done: 43095.0 [2024-08-05 23:36:32,864][52663] Sum rewards: 41.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.918', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.145', 'weapon4': '0.196', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'ARMOR': '0.496', 'weapon2': '0.878', 'WEAPON3': '1.200', 'weapon3': '2.436', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '38.000'} [2024-08-05 23:36:33,195][52650] Updated weights for policy 0, policy_version 16241 (0.0012) [2024-08-05 23:36:34,181][52811] DAMAGECOUNT value on done: 37515.0 [2024-08-05 23:36:34,182][52811] Sum rewards: 21.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.890', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.472', 'WEAPON3': '0.900', 'weapon2': '1.116', 'HITCOUNT': '1.500', 'weapon3': '1.826', 'DAMAGECOUNT': '6.042', 'FRAGCOUNT': '19.000'} [2024-08-05 23:36:34,566][52659] DAMAGECOUNT value on done: 44681.0 [2024-08-05 23:36:34,566][52659] Sum rewards: 34.979, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.156', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.078', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.428', 'weapon2': '0.926', 'WEAPON3': '1.050', 'HITCOUNT': '2.260', 'weapon3': '2.330', 'DAMAGECOUNT': '8.742', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:34,668][52647] DAMAGECOUNT value on done: 43492.0 [2024-08-05 23:36:34,669][52647] Sum rewards: 29.535, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.355', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.096', 'AMMO3': '0.117', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.486', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon2': '1.302', 'weapon3': '1.900', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '8.856', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:35,068][52671] DAMAGECOUNT value on done: 43827.0 [2024-08-05 23:36:35,068][52671] Sum rewards: 48.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.638', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '3.066', 'DAMAGECOUNT': '11.781', 'FRAGCOUNT': '42.000'} [2024-08-05 23:36:35,616][52658] DAMAGECOUNT value on done: 45138.0 [2024-08-05 23:36:35,620][52658] Sum rewards: 28.746, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.124', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.352', 'weapon2': '1.160', 'WEAPON3': '1.350', 'ARMOR': '2.079', 'HITCOUNT': '2.090', 'weapon3': '2.272', 'DAMAGECOUNT': '8.385', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:35,745][52663] DAMAGECOUNT value on done: 42018.0 [2024-08-05 23:36:35,746][52663] Sum rewards: 30.236, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.386', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.886', 'weapon2': '1.418', 'HITCOUNT': '1.830', 'weapon3': '2.276', 'DAMAGECOUNT': '7.395', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:35,928][52795] DAMAGECOUNT value on done: 42567.0 [2024-08-05 23:36:35,929][52795] Sum rewards: 30.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.593', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon4': '0.380', 'ARMOR': '0.448', 'WEAPON3': '1.000', 'weapon2': '1.018', 'weapon3': '2.040', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '25.000'} [2024-08-05 23:36:37,161][52811] DAMAGECOUNT value on done: 39199.0 [2024-08-05 23:36:37,161][52811] Sum rewards: 31.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.772', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.062', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.650', 'weapon2': '0.760', 'weapon4': '0.766', 'ARMOR': '0.870', 'WEAPON3': '1.000', 'weapon3': '2.168', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '8.865', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:37,393][52659] DAMAGECOUNT value on done: 43878.0 [2024-08-05 23:36:37,393][52659] Sum rewards: 29.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.428', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.155', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon2': '0.596', 'WEAPON3': '1.350', 'HITCOUNT': '1.970', 'weapon3': '2.542', 'DAMAGECOUNT': '8.847', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:37,616][52647] DAMAGECOUNT value on done: 43377.0 [2024-08-05 23:36:37,618][52647] Sum rewards: 25.104, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.379', 'AMMO5': '0.008', 'weapon5': '0.024', 'AMMO2': '0.036', 'ARMOR': '0.040', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.630', 'WEAPON3': '0.850', 'HITCOUNT': '1.730', 'weapon3': '2.696', 'DAMAGECOUNT': '7.089', 'FRAGCOUNT': '21.000'} [2024-08-05 23:36:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 133120000. Throughput: 0: 4427.6. Samples: 33284490. Policy #0 lag: (min: 1.0, avg: 4.6, max: 9.0) [2024-08-05 23:36:37,794][52567] Avg episode reward: [(0, '33.349')] [2024-08-05 23:36:37,838][52671] DAMAGECOUNT value on done: 43674.0 [2024-08-05 23:36:37,839][52671] Sum rewards: 37.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.050', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.450', 'ARMOR': '0.552', 'weapon2': '0.850', 'WEAPON3': '1.600', 'HITCOUNT': '2.290', 'weapon3': '2.688', 'DAMAGECOUNT': '9.189', 'FRAGCOUNT': '37.000'} [2024-08-05 23:36:38,127][52650] Updated weights for policy 0, policy_version 16251 (0.0043) [2024-08-05 23:36:39,111][52795] DAMAGECOUNT value on done: 42280.0 [2024-08-05 23:36:39,111][52795] Sum rewards: 50.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.141', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.332', 'ARMOR': '0.479', 'weapon2': '0.580', 'WEAPON3': '1.050', 'HITCOUNT': '2.440', 'weapon3': '2.500', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '43.000'} [2024-08-05 23:36:40,530][52659] DAMAGECOUNT value on done: 40966.0 [2024-08-05 23:36:40,530][52659] Sum rewards: 28.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.027', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'ARMOR': '0.474', 'weapon4': '0.496', 'weapon2': '0.612', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.540', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:41,214][52671] DAMAGECOUNT value on done: 48599.0 [2024-08-05 23:36:41,217][52671] Sum rewards: 41.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.944', 'AMMO2': '0.010', 'AMMO5': '0.015', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'ARMOR': '0.918', 'WEAPON3': '1.050', 'weapon2': '1.234', 'weapon3': '2.368', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:42,298][52795] DAMAGECOUNT value on done: 44325.0 [2024-08-05 23:36:42,299][52795] Sum rewards: 40.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.302', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.092', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.622', 'ARMOR': '0.922', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '2.758', 'DAMAGECOUNT': '11.115', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:42,703][52650] Updated weights for policy 0, policy_version 16261 (0.0013) [2024-08-05 23:36:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 133210112. Throughput: 0: 4442.4. Samples: 33311170. Policy #0 lag: (min: 1.0, avg: 4.6, max: 9.0) [2024-08-05 23:36:42,794][52567] Avg episode reward: [(0, '33.601')] [2024-08-05 23:36:43,484][52659] DAMAGECOUNT value on done: 41385.0 [2024-08-05 23:36:43,485][52659] Sum rewards: 32.685, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.431', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'weapon4': '0.192', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'ARMOR': '0.451', 'weapon2': '0.772', 'WEAPON3': '1.550', 'HITCOUNT': '2.590', 'weapon3': '2.696', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '32.000'} [2024-08-05 23:36:44,132][52671] DAMAGECOUNT value on done: 43335.0 [2024-08-05 23:36:44,134][52671] Sum rewards: 41.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.867', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.058', 'AMMO3': '0.156', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.436', 'weapon2': '0.748', 'ARMOR': '0.855', 'WEAPON3': '1.050', 'weapon3': '2.246', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '35.000'} [2024-08-05 23:36:44,953][52649] DAMAGECOUNT value on done: 42501.0 [2024-08-05 23:36:44,955][52649] Sum rewards: 32.698, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.442', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.066', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'ARMOR': '0.853', 'weapon2': '1.130', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.146', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:45,411][52795] DAMAGECOUNT value on done: 40226.0 [2024-08-05 23:36:45,413][52795] Sum rewards: 31.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.674', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.400', 'weapon4': '0.442', 'ARMOR': '0.476', 'weapon2': '0.986', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.346', 'DAMAGECOUNT': '8.886', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:46,586][52659] DAMAGECOUNT value on done: 44098.0 [2024-08-05 23:36:46,586][52659] Sum rewards: 20.090, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.062', 'weapon4': '0.092', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'weapon2': '1.136', 'ARMOR': '1.358', 'WEAPON3': '1.400', 'HITCOUNT': '1.690', 'weapon3': '2.268', 'DAMAGECOUNT': '7.143', 'FRAGCOUNT': '21.000'} [2024-08-05 23:36:46,972][52671] DAMAGECOUNT value on done: 40080.0 [2024-08-05 23:36:46,972][52671] Sum rewards: 25.931, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.152', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'weapon4': '0.176', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'ARMOR': '0.429', 'weapon2': '0.990', 'WEAPON3': '1.400', 'HITCOUNT': '2.190', 'weapon3': '2.516', 'DAMAGECOUNT': '9.405', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:47,324][52650] Updated weights for policy 0, policy_version 16271 (0.0012) [2024-08-05 23:36:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17522.5). Total num frames: 133300224. Throughput: 0: 4441.8. Samples: 33324310. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:36:47,794][52567] Avg episode reward: [(0, '33.370')] [2024-08-05 23:36:48,038][52649] DAMAGECOUNT value on done: 42501.0 [2024-08-05 23:36:48,038][52649] Sum rewards: 25.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.886', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon5': '0.132', 'AMMO3': '0.212', 'AMMO4': '0.309', 'WEAPON5': '0.350', 'weapon4': '0.592', 'weapon2': '0.608', 'WEAPON4': '0.750', 'ARMOR': '0.800', 'WEAPON3': '1.400', 'weapon3': '2.200', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '8.634', 'FRAGCOUNT': '24.000'} [2024-08-05 23:36:48,494][52795] DAMAGECOUNT value on done: 37766.0 [2024-08-05 23:36:48,494][52795] Sum rewards: 34.126, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.189', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'weapon4': '0.662', 'weapon2': '0.704', 'ARMOR': '0.904', 'WEAPON3': '1.000', 'HITCOUNT': '2.210', 'weapon3': '2.354', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:49,141][52659] DAMAGECOUNT value on done: 42522.0 [2024-08-05 23:36:49,143][52659] Sum rewards: 35.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.036', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.380', 'ARMOR': '0.844', 'weapon2': '0.888', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.454', 'DAMAGECOUNT': '8.940', 'FRAGCOUNT': '30.000'} [2024-08-05 23:36:49,817][52671] DAMAGECOUNT value on done: 45664.0 [2024-08-05 23:36:49,819][52671] Sum rewards: 37.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.143', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '2.676', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '32.000'} [2024-08-05 23:36:50,894][52649] DAMAGECOUNT value on done: 42022.0 [2024-08-05 23:36:50,894][52649] Sum rewards: 32.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.746', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.015', 'weapon4': '0.028', 'WEAPON5': '0.050', 'ARMOR': '0.062', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON3': '1.100', 'weapon2': '1.156', 'HITCOUNT': '2.040', 'weapon3': '2.576', 'DAMAGECOUNT': '8.835', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:51,567][52795] DAMAGECOUNT value on done: 40506.0 [2024-08-05 23:36:51,567][52795] Sum rewards: 28.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.072', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'ARMOR': '0.472', 'weapon2': '1.032', 'WEAPON3': '1.200', 'HITCOUNT': '2.120', 'weapon3': '2.408', 'DAMAGECOUNT': '8.313', 'FRAGCOUNT': '25.000'} [2024-08-05 23:36:51,838][52650] Updated weights for policy 0, policy_version 16281 (0.0021) [2024-08-05 23:36:52,251][52659] DAMAGECOUNT value on done: 43322.0 [2024-08-05 23:36:52,251][52659] Sum rewards: 41.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.322', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.179', 'weapon4': '0.208', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.074', 'weapon3': '2.434', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '34.000'} [2024-08-05 23:36:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17522.5). Total num frames: 133390336. Throughput: 0: 4441.8. Samples: 33351080. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:36:52,794][52567] Avg episode reward: [(0, '32.939')] [2024-08-05 23:36:52,930][52671] DAMAGECOUNT value on done: 44967.0 [2024-08-05 23:36:52,932][52671] Sum rewards: 38.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO4': '-0.041', 'AMMO2': '-0.008', 'WEAPON1': '0.020', 'AMMO3': '0.211', 'weapon2': '0.970', 'WEAPON3': '1.350', 'ARMOR': '1.821', 'HITCOUNT': '2.550', 'weapon3': '2.800', 'DAMAGECOUNT': '10.659', 'FRAGCOUNT': '33.000'} [2024-08-05 23:36:53,819][52649] DAMAGECOUNT value on done: 43206.0 [2024-08-05 23:36:53,819][52649] Sum rewards: 24.140, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.588', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.210', 'weapon4': '0.308', 'WEAPON4': '0.500', 'weapon2': '0.986', 'ARMOR': '1.313', 'WEAPON3': '1.350', 'HITCOUNT': '2.030', 'weapon3': '2.310', 'DAMAGECOUNT': '7.845', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:54,668][52795] DAMAGECOUNT value on done: 40670.0 [2024-08-05 23:36:54,669][52795] Sum rewards: 32.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.183', 'weapon4': '0.202', 'WEAPON4': '0.400', 'ARMOR': '0.880', 'WEAPON3': '1.100', 'weapon2': '1.312', 'HITCOUNT': '1.960', 'weapon3': '2.250', 'DAMAGECOUNT': '8.853', 'FRAGCOUNT': '28.000'} [2024-08-05 23:36:54,964][52659] DAMAGECOUNT value on done: 41501.0 [2024-08-05 23:36:54,965][52659] Sum rewards: 35.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.534', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.122', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.404', 'WEAPON3': '0.800', 'ARMOR': '0.890', 'weapon2': '1.164', 'weapon3': '1.992', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '29.000'} [2024-08-05 23:36:55,630][52671] DAMAGECOUNT value on done: 45484.0 [2024-08-05 23:36:55,632][52671] Sum rewards: 36.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.880', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.550', 'HITCOUNT': '2.670', 'weapon3': '2.838', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '31.500'} [2024-08-05 23:36:56,400][52650] Updated weights for policy 0, policy_version 16291 (0.0045) [2024-08-05 23:36:56,487][52649] DAMAGECOUNT value on done: 42081.0 [2024-08-05 23:36:56,487][52649] Sum rewards: 34.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.016', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.686', 'ARMOR': '0.902', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '2.950', 'DAMAGECOUNT': '9.645', 'FRAGCOUNT': '29.500'} [2024-08-05 23:36:57,616][52659] DAMAGECOUNT value on done: 42187.0 [2024-08-05 23:36:57,616][52659] Sum rewards: 43.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.985', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.031', 'weapon5': '0.058', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.224', 'weapon2': '0.696', 'WEAPON3': '0.950', 'HITCOUNT': '2.510', 'weapon3': '2.822', 'DAMAGECOUNT': '10.779', 'FRAGCOUNT': '36.000'} [2024-08-05 23:36:57,731][52795] DAMAGECOUNT value on done: 38863.0 [2024-08-05 23:36:57,731][52795] Sum rewards: 30.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.774', 'weapon5': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.326', 'ARMOR': '0.476', 'weapon2': '0.848', 'WEAPON3': '1.400', 'HITCOUNT': '2.340', 'weapon3': '2.530', 'DAMAGECOUNT': '9.429', 'FRAGCOUNT': '26.000'} [2024-08-05 23:36:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 133472256. Throughput: 0: 4437.8. Samples: 33377560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:36:57,802][52567] Avg episode reward: [(0, '32.822')] [2024-08-05 23:36:58,283][52671] DAMAGECOUNT value on done: 42767.0 [2024-08-05 23:36:58,285][52671] Sum rewards: 35.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'ARMOR': '0.485', 'weapon2': '0.958', 'WEAPON3': '1.050', 'HITCOUNT': '2.240', 'weapon3': '2.380', 'DAMAGECOUNT': '9.975', 'FRAGCOUNT': '31.000'} [2024-08-05 23:36:59,406][52649] DAMAGECOUNT value on done: 41758.0 [2024-08-05 23:36:59,406][52649] Sum rewards: 37.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.878', 'WEAPON3': '1.150', 'ARMOR': '1.257', 'HITCOUNT': '1.990', 'weapon3': '2.756', 'DAMAGECOUNT': '8.637', 'FRAGCOUNT': '33.000'} [2024-08-05 23:37:00,215][52659] DAMAGECOUNT value on done: 44323.0 [2024-08-05 23:37:00,215][52659] Sum rewards: 35.327, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.154', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.078', 'AMMO4': '0.110', 'weapon5': '0.154', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.907', 'WEAPON3': '0.950', 'weapon2': '1.432', 'weapon3': '2.084', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '10.221', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:00,826][52671] DAMAGECOUNT value on done: 43082.0 [2024-08-05 23:37:00,827][52671] Sum rewards: 31.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'weapon5': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'ARMOR': '0.433', 'weapon2': '0.922', 'WEAPON3': '1.400', 'HITCOUNT': '2.020', 'weapon3': '2.682', 'DAMAGECOUNT': '8.028', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:00,978][52795] DAMAGECOUNT value on done: 41012.0 [2024-08-05 23:37:00,981][52795] Sum rewards: 33.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.426', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.028', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.177', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.050', 'HITCOUNT': '2.160', 'weapon3': '2.756', 'DAMAGECOUNT': '8.841', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:01,001][52650] Updated weights for policy 0, policy_version 16301 (0.0030) [2024-08-05 23:37:01,981][52649] DAMAGECOUNT value on done: 40150.0 [2024-08-05 23:37:01,983][52649] Sum rewards: 26.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.268', 'AMMO2': '0.000', 'AMMO4': '0.002', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'WEAPON3': '1.050', 'ARMOR': '1.252', 'weapon2': '1.394', 'HITCOUNT': '2.010', 'weapon3': '2.276', 'DAMAGECOUNT': '8.019', 'FRAGCOUNT': '25.000'} [2024-08-05 23:37:02,671][52659] DAMAGECOUNT value on done: 47922.0 [2024-08-05 23:37:02,671][52659] Sum rewards: 38.358, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.543', 'AMMO5': '0.006', 'ARMOR': '0.028', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.225', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '2.710', 'DAMAGECOUNT': '10.848', 'FRAGCOUNT': '38.000'} [2024-08-05 23:37:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 133562368. Throughput: 0: 4439.6. Samples: 33390770. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:37:02,802][52567] Avg episode reward: [(0, '32.824')] [2024-08-05 23:37:04,291][52795] DAMAGECOUNT value on done: 42161.0 [2024-08-05 23:37:04,292][52795] Sum rewards: 40.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.611', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.024', 'weapon4': '0.052', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'WEAPON3': '0.950', 'weapon2': '1.112', 'HITCOUNT': '2.390', 'weapon3': '2.614', 'DAMAGECOUNT': '10.245', 'FRAGCOUNT': '34.000'} [2024-08-05 23:37:05,105][52649] DAMAGECOUNT value on done: 43245.0 [2024-08-05 23:37:05,105][52649] Sum rewards: 42.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.952', 'AMMO5': '0.012', 'weapon5': '0.026', 'AMMO2': '0.041', 'weapon4': '0.158', 'AMMO4': '0.206', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.640', 'ARMOR': '0.940', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '2.866', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '37.000'} [2024-08-05 23:37:05,525][52659] DAMAGECOUNT value on done: 43209.0 [2024-08-05 23:37:05,526][52659] Sum rewards: 44.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.139', 'weapon5': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'ARMOR': '0.986', 'weapon2': '1.104', 'weapon3': '2.172', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '36.000'} [2024-08-05 23:37:05,708][52650] Updated weights for policy 0, policy_version 16311 (0.0016) [2024-08-05 23:37:07,585][52795] DAMAGECOUNT value on done: 39182.0 [2024-08-05 23:37:07,588][52795] Sum rewards: 27.851, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.278', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.077', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'ARMOR': '0.428', 'WEAPON3': '0.800', 'weapon2': '1.240', 'HITCOUNT': '1.780', 'weapon3': '2.416', 'DAMAGECOUNT': '6.723', 'FRAGCOUNT': '24.000'} [2024-08-05 23:37:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 133652480. Throughput: 0: 4430.7. Samples: 33417250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:37:07,794][52567] Avg episode reward: [(0, '33.238')] [2024-08-05 23:37:07,875][52659] DAMAGECOUNT value on done: 43355.0 [2024-08-05 23:37:07,875][52659] Sum rewards: 29.198, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.389', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.158', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.368', 'ARMOR': '0.444', 'weapon2': '0.746', 'WEAPON3': '1.000', 'HITCOUNT': '2.250', 'weapon3': '2.498', 'DAMAGECOUNT': '9.063', 'FRAGCOUNT': '23.000'} [2024-08-05 23:37:08,101][52649] DAMAGECOUNT value on done: 40061.0 [2024-08-05 23:37:08,102][52649] Sum rewards: 29.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.554', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.078', 'AMMO3': '0.195', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.879', 'weapon2': '0.934', 'WEAPON3': '1.250', 'HITCOUNT': '2.250', 'weapon3': '2.380', 'DAMAGECOUNT': '8.466', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:08,222][52662] DAMAGECOUNT value on done: 48194.0 [2024-08-05 23:37:08,222][52662] Sum rewards: 27.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.501', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.048', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.752', 'ARMOR': '0.934', 'WEAPON3': '1.400', 'HITCOUNT': '2.290', 'weapon3': '2.592', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:09,404][52794] DAMAGECOUNT value on done: 49170.0 [2024-08-05 23:37:09,406][52794] Sum rewards: 31.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.072', 'AMMO4': '0.162', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.982', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.610', 'DAMAGECOUNT': '8.913', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:09,926][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:37:10,489][52650] Updated weights for policy 0, policy_version 16321 (0.0011) [2024-08-05 23:37:10,560][52662] DAMAGECOUNT value on done: 50146.0 [2024-08-05 23:37:10,561][52662] Sum rewards: 32.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.636', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.203', 'ARMOR': '0.400', 'weapon2': '1.012', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.606', 'DAMAGECOUNT': '8.988', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:10,659][52795] DAMAGECOUNT value on done: 43187.0 [2024-08-05 23:37:10,660][52795] Sum rewards: 29.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.530', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.262', 'weapon4': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.644', 'WEAPON3': '1.750', 'HITCOUNT': '2.340', 'weapon3': '2.632', 'DAMAGECOUNT': '9.537', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:11,049][52659] DAMAGECOUNT value on done: 43616.0 [2024-08-05 23:37:11,050][52659] Sum rewards: 35.124, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.169', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.148', 'AMMO3': '0.149', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.436', 'ARMOR': '0.871', 'WEAPON3': '0.900', 'weapon2': '1.044', 'weapon3': '2.028', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:11,135][52803] Large shaping reward 2.548 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0)] [2024-08-05 23:37:11,188][52649] DAMAGECOUNT value on done: 41136.0 [2024-08-05 23:37:11,188][52649] Sum rewards: 34.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.028', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.174', 'weapon2': '1.048', 'WEAPON3': '1.050', 'ARMOR': '1.257', 'HITCOUNT': '2.160', 'weapon3': '2.726', 'DAMAGECOUNT': '9.300', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:11,833][52794] DAMAGECOUNT value on done: 47922.0 [2024-08-05 23:37:11,834][52794] Sum rewards: 33.628, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.558', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.056', 'ARMOR': '0.064', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '3.090', 'DAMAGECOUNT': '9.231', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 133742592. Throughput: 0: 4422.0. Samples: 33443680. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-05 23:37:12,794][52567] Avg episode reward: [(0, '33.477')] [2024-08-05 23:37:13,156][52662] DAMAGECOUNT value on done: 52345.0 [2024-08-05 23:37:13,157][52662] Sum rewards: 35.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.428', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'ARMOR': '0.493', 'weapon2': '0.518', 'weapon4': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.290', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.162', 'FRAGCOUNT': '32.000'} [2024-08-05 23:37:13,763][52659] DAMAGECOUNT value on done: 46717.0 [2024-08-05 23:37:13,764][52659] Sum rewards: 40.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.772', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.098', 'weapon5': '0.110', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.786', 'ARMOR': '0.840', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.738', 'DAMAGECOUNT': '10.647', 'FRAGCOUNT': '37.000'} [2024-08-05 23:37:13,848][52795] DAMAGECOUNT value on done: 44200.0 [2024-08-05 23:37:13,851][52795] Sum rewards: 42.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.998', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.171', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.504', 'weapon2': '0.564', 'weapon4': '0.630', 'WEAPON3': '1.050', 'weapon3': '2.036', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '37.000'} [2024-08-05 23:37:14,274][52649] DAMAGECOUNT value on done: 43092.0 [2024-08-05 23:37:14,274][52649] Sum rewards: 25.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.638', 'AMMO5': '0.003', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.202', 'weapon4': '0.204', 'AMMO3': '0.221', 'WEAPON4': '0.450', 'ARMOR': '0.526', 'weapon2': '0.962', 'WEAPON3': '1.300', 'HITCOUNT': '1.930', 'weapon3': '2.584', 'DAMAGECOUNT': '8.343', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:14,624][52794] DAMAGECOUNT value on done: 48647.0 [2024-08-05 23:37:14,624][52794] Sum rewards: 39.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.920', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.072', 'weapon5': '0.112', 'AMMO3': '0.181', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.822', 'ARMOR': '0.876', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.684', 'DAMAGECOUNT': '10.020', 'FRAGCOUNT': '35.000'} [2024-08-05 23:37:14,799][52650] Updated weights for policy 0, policy_version 16331 (0.0011) [2024-08-05 23:37:16,224][52662] DAMAGECOUNT value on done: 44580.0 [2024-08-05 23:37:16,226][52662] Sum rewards: 31.302, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.102', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO4': '0.185', 'AMMO3': '0.223', 'WEAPON4': '0.400', 'ARMOR': '0.424', 'weapon2': '1.070', 'WEAPON3': '1.400', 'HITCOUNT': '2.310', 'weapon3': '2.556', 'DAMAGECOUNT': '9.366', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:16,755][52649] DAMAGECOUNT value on done: 43850.0 [2024-08-05 23:37:16,757][52649] Sum rewards: 38.212, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon4': '0.262', 'ARMOR': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.600', 'weapon3': '2.724', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '34.000'} [2024-08-05 23:37:16,908][52795] DAMAGECOUNT value on done: 38681.0 [2024-08-05 23:37:16,909][52795] Sum rewards: 30.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.074', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon4': '0.070', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.742', 'WEAPON3': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.840', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '26.500'} [2024-08-05 23:37:17,748][52794] DAMAGECOUNT value on done: 44617.0 [2024-08-05 23:37:17,750][52794] Sum rewards: 43.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.166', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.656', 'ARMOR': '0.816', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '3.042', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '38.000'} [2024-08-05 23:37:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 133832704. Throughput: 0: 4428.9. Samples: 33457070. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-05 23:37:17,795][52567] Avg episode reward: [(0, '33.580')] [2024-08-05 23:37:19,338][52662] DAMAGECOUNT value on done: 45999.0 [2024-08-05 23:37:19,339][52662] Sum rewards: 37.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.551', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.380', 'ARMOR': '0.434', 'weapon2': '0.674', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.686', 'DAMAGECOUNT': '9.702', 'FRAGCOUNT': '33.000'} [2024-08-05 23:37:19,500][52650] Updated weights for policy 0, policy_version 16341 (0.0022) [2024-08-05 23:37:19,707][52649] DAMAGECOUNT value on done: 44536.0 [2024-08-05 23:37:19,708][52649] Sum rewards: 28.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.036', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'AMMO4': '0.254', 'WEAPON4': '0.450', 'weapon2': '0.900', 'WEAPON3': '1.500', 'HITCOUNT': '2.230', 'weapon3': '2.664', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:20,170][52795] DAMAGECOUNT value on done: 40237.0 [2024-08-05 23:37:20,170][52795] Sum rewards: 37.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.191', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.712', 'WEAPON3': '0.950', 'HITCOUNT': '2.300', 'weapon3': '2.422', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '32.000'} [2024-08-05 23:37:20,761][52794] DAMAGECOUNT value on done: 48162.0 [2024-08-05 23:37:20,762][52794] Sum rewards: 32.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.216', 'AMMO5': '0.011', 'ARMOR': '0.036', 'AMMO2': '0.045', 'weapon5': '0.050', 'AMMO3': '0.198', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.416', 'weapon2': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.544', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '27.000'} [2024-08-05 23:37:21,076][52668] DAMAGECOUNT value on done: 43078.0 [2024-08-05 23:37:21,077][52668] Sum rewards: 29.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.434', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.146', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon2': '1.178', 'ARMOR': '1.252', 'WEAPON3': '1.400', 'HITCOUNT': '2.110', 'weapon3': '2.444', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:21,887][52662] DAMAGECOUNT value on done: 48333.0 [2024-08-05 23:37:21,889][52662] Sum rewards: 22.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.967', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '1.070', 'WEAPON3': '1.200', 'ARMOR': '1.708', 'HITCOUNT': '1.740', 'weapon3': '2.276', 'DAMAGECOUNT': '7.338', 'FRAGCOUNT': '19.000'} [2024-08-05 23:37:22,429][52649] DAMAGECOUNT value on done: 42947.0 [2024-08-05 23:37:22,429][52649] Sum rewards: 32.668, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.979', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO4': '0.055', 'weapon5': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.448', 'ARMOR': '0.966', 'weapon2': '1.022', 'WEAPON3': '1.050', 'weapon3': '1.940', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '8.925', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 133922816. Throughput: 0: 4427.6. Samples: 33483730. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:37:22,794][52567] Avg episode reward: [(0, '33.519')] [2024-08-05 23:37:23,220][52795] DAMAGECOUNT value on done: 41852.0 [2024-08-05 23:37:23,221][52795] Sum rewards: 40.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.654', 'WEAPON3': '1.400', 'HITCOUNT': '2.380', 'weapon3': '3.032', 'DAMAGECOUNT': '10.530', 'FRAGCOUNT': '36.000'} [2024-08-05 23:37:23,381][52794] DAMAGECOUNT value on done: 48304.0 [2024-08-05 23:37:23,384][52794] Sum rewards: 36.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.342', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.096', 'AMMO4': '0.205', 'AMMO3': '0.222', 'weapon4': '0.288', 'WEAPON5': '0.350', 'ARMOR': '0.494', 'WEAPON4': '0.500', 'weapon2': '1.142', 'WEAPON3': '1.400', 'weapon3': '2.190', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '8.229', 'FRAGCOUNT': '35.000'} [2024-08-05 23:37:23,436][52667] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-05 23:37:23,610][52668] DAMAGECOUNT value on done: 46789.0 [2024-08-05 23:37:23,612][52668] Sum rewards: 42.763, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.214', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '1.098', 'WEAPON3': '1.250', 'ARMOR': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.620', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '37.000'} [2024-08-05 23:37:24,614][52650] Updated weights for policy 0, policy_version 16351 (0.0024) [2024-08-05 23:37:24,938][52662] DAMAGECOUNT value on done: 49968.0 [2024-08-05 23:37:24,938][52662] Sum rewards: 24.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.644', 'AMMO5': '0.015', 'weapon5': '0.044', 'AMMO2': '0.077', 'AMMO3': '0.195', 'WEAPON5': '0.300', 'AMMO4': '0.385', 'weapon4': '0.422', 'ARMOR': '0.553', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon2': '1.138', 'HITCOUNT': '1.580', 'weapon3': '2.094', 'DAMAGECOUNT': '6.891', 'FRAGCOUNT': '24.000'} [2024-08-05 23:37:25,069][52649] DAMAGECOUNT value on done: 39574.0 [2024-08-05 23:37:25,070][52649] Sum rewards: 36.981, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.133', 'weapon5': '0.146', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.882', 'ARMOR': '0.883', 'WEAPON3': '0.900', 'weapon2': '0.962', 'weapon3': '1.600', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.537', 'FRAGCOUNT': '30.000'} [2024-08-05 23:37:26,465][52794] DAMAGECOUNT value on done: 49519.0 [2024-08-05 23:37:26,467][52794] Sum rewards: 31.829, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.120', 'weapon4': '0.132', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.936', 'WEAPON3': '0.950', 'weapon2': '1.210', 'HITCOUNT': '2.000', 'weapon3': '2.264', 'DAMAGECOUNT': '7.920', 'FRAGCOUNT': '27.000'} [2024-08-05 23:37:26,508][52668] DAMAGECOUNT value on done: 41783.0 [2024-08-05 23:37:26,509][52668] Sum rewards: 34.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.211', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon5': '0.184', 'AMMO3': '0.215', 'AMMO4': '0.220', 'weapon4': '0.308', 'WEAPON5': '0.400', 'ARMOR': '0.483', 'WEAPON4': '0.500', 'weapon2': '0.620', 'WEAPON3': '1.250', 'HITCOUNT': '2.210', 'weapon3': '2.560', 'DAMAGECOUNT': '8.856', 'FRAGCOUNT': '32.000'} [2024-08-05 23:37:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 134004736. Throughput: 0: 4419.3. Samples: 33510040. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:37:27,794][52567] Avg episode reward: [(0, '33.631')] [2024-08-05 23:37:27,840][52662] DAMAGECOUNT value on done: 52635.0 [2024-08-05 23:37:27,842][52662] Sum rewards: 40.592, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon5': '0.020', 'weapon4': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.154', 'HEALTH': '0.166', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.334', 'HITCOUNT': '2.210', 'weapon3': '2.310', 'DAMAGECOUNT': '9.681', 'FRAGCOUNT': '33.000'} [2024-08-05 23:37:28,127][52649] DAMAGECOUNT value on done: 45559.0 [2024-08-05 23:37:28,127][52649] Sum rewards: 36.713, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.104', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'ARMOR': '0.852', 'WEAPON3': '1.000', 'weapon2': '1.318', 'HITCOUNT': '2.180', 'weapon3': '2.372', 'DAMAGECOUNT': '10.104', 'FRAGCOUNT': '30.000'} [2024-08-05 23:37:28,531][52650] Updated weights for policy 0, policy_version 16361 (0.0022) [2024-08-05 23:37:29,006][52668] DAMAGECOUNT value on done: 43527.0 [2024-08-05 23:37:29,008][52668] Sum rewards: 33.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.146', 'AMMO5': '0.009', 'weapon5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.125', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'ARMOR': '1.256', 'weapon2': '1.302', 'HITCOUNT': '2.060', 'weapon3': '2.350', 'DAMAGECOUNT': '8.775', 'FRAGCOUNT': '30.000'} [2024-08-05 23:37:29,300][52794] DAMAGECOUNT value on done: 45889.0 [2024-08-05 23:37:29,304][52794] Sum rewards: 38.891, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.517', 'AMMO5': '0.014', 'weapon5': '0.028', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon4': '0.262', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.634', 'ARMOR': '0.938', 'WEAPON3': '1.700', 'weapon3': '2.756', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '35.000'} [2024-08-05 23:37:30,027][52660] DAMAGECOUNT value on done: 44842.0 [2024-08-05 23:37:30,027][52660] Sum rewards: 40.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.951', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.078', 'weapon4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'ARMOR': '0.440', 'weapon2': '0.808', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.764', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '35.000'} [2024-08-05 23:37:30,757][52662] DAMAGECOUNT value on done: 46662.0 [2024-08-05 23:37:30,760][52662] Sum rewards: 32.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.082', 'weapon4': '0.146', 'AMMO3': '0.225', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'ARMOR': '0.460', 'WEAPON4': '0.500', 'weapon2': '0.748', 'WEAPON3': '1.500', 'HITCOUNT': '2.110', 'weapon3': '2.730', 'DAMAGECOUNT': '8.919', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:31,172][52649] DAMAGECOUNT value on done: 39730.0 [2024-08-05 23:37:31,174][52649] Sum rewards: 21.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.924', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.192', 'AMMO3': '0.210', 'AMMO4': '0.224', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon2': '1.280', 'ARMOR': '1.292', 'HITCOUNT': '1.600', 'weapon3': '2.184', 'DAMAGECOUNT': '7.032', 'FRAGCOUNT': '21.000'} [2024-08-05 23:37:31,964][52668] DAMAGECOUNT value on done: 44027.0 [2024-08-05 23:37:31,968][52668] Sum rewards: 31.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.012', 'weapon4': '0.024', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO4': '0.124', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.898', 'weapon2': '1.088', 'WEAPON3': '1.400', 'HITCOUNT': '2.140', 'weapon3': '2.558', 'DAMAGECOUNT': '8.442', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:32,308][52794] DAMAGECOUNT value on done: 48899.0 [2024-08-05 23:37:32,309][52794] Sum rewards: 36.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.393', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO4': '0.177', 'AMMO3': '0.199', 'weapon5': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.896', 'ARMOR': '1.247', 'WEAPON3': '1.300', 'HITCOUNT': '2.160', 'weapon3': '2.374', 'DAMAGECOUNT': '9.474', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 134094848. Throughput: 0: 4426.4. Samples: 33523500. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:37:32,802][52567] Avg episode reward: [(0, '33.681')] [2024-08-05 23:37:32,802][52614] Saving new best policy, reward=33.681! [2024-08-05 23:37:33,219][52660] DAMAGECOUNT value on done: 45717.0 [2024-08-05 23:37:33,219][52660] Sum rewards: 39.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.024', 'weapon4': '0.036', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'ARMOR': '0.954', 'weapon2': '0.972', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.728', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '34.000'} [2024-08-05 23:37:33,656][52650] Updated weights for policy 0, policy_version 16371 (0.0023) [2024-08-05 23:37:33,771][52662] DAMAGECOUNT value on done: 48496.0 [2024-08-05 23:37:33,774][52662] Sum rewards: 48.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.169', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.348', 'ARMOR': '0.475', 'weapon2': '0.656', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.716', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '42.000'} [2024-08-05 23:37:34,220][52649] DAMAGECOUNT value on done: 43204.0 [2024-08-05 23:37:34,221][52649] Sum rewards: 29.467, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.229', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.108', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'ARMOR': '0.890', 'weapon2': '1.516', 'HITCOUNT': '1.970', 'weapon3': '2.144', 'DAMAGECOUNT': '7.239', 'FRAGCOUNT': '23.000'} [2024-08-05 23:37:35,242][52668] DAMAGECOUNT value on done: 45856.0 [2024-08-05 23:37:35,242][52668] Sum rewards: 37.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.341', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.099', 'AMMO3': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'WEAPON3': '1.000', 'weapon2': '1.112', 'weapon3': '2.278', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.585', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:35,496][52794] DAMAGECOUNT value on done: 50466.0 [2024-08-05 23:37:35,499][52794] Sum rewards: 46.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO2': '0.028', 'ARMOR': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon2': '0.482', 'weapon4': '0.624', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.622', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '39.000'} [2024-08-05 23:37:35,769][52664] DAMAGECOUNT value on done: 44552.0 [2024-08-05 23:37:35,769][52664] Sum rewards: 33.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.018', 'weapon5': '0.028', 'AMMO2': '0.034', 'AMMO4': '0.167', 'AMMO3': '0.177', 'weapon4': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.854', 'weapon2': '1.020', 'WEAPON3': '1.050', 'HITCOUNT': '2.170', 'weapon3': '2.350', 'DAMAGECOUNT': '8.706', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:36,422][52660] DAMAGECOUNT value on done: 43595.0 [2024-08-05 23:37:36,423][52660] Sum rewards: 29.866, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.536', 'weapon4': '0.782', 'ARMOR': '0.885', 'WEAPON3': '1.050', 'HITCOUNT': '2.000', 'weapon3': '2.340', 'DAMAGECOUNT': '7.830', 'FRAGCOUNT': '25.000'} [2024-08-05 23:37:36,894][52662] DAMAGECOUNT value on done: 47960.0 [2024-08-05 23:37:36,894][52662] Sum rewards: 37.552, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.908', 'ARMOR': '0.935', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.772', 'DAMAGECOUNT': '9.450', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:37,044][52649] DAMAGECOUNT value on done: 43208.0 [2024-08-05 23:37:37,045][52649] Sum rewards: 28.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO3': '0.149', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'weapon2': '0.874', 'WEAPON3': '1.100', 'HITCOUNT': '1.940', 'weapon3': '2.352', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '24.000'} [2024-08-05 23:37:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.5). Total num frames: 134184960. Throughput: 0: 4414.9. Samples: 33549750. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:37:37,794][52567] Avg episode reward: [(0, '34.181')] [2024-08-05 23:37:37,797][52614] Saving new best policy, reward=34.181! [2024-08-05 23:37:38,134][52668] DAMAGECOUNT value on done: 46387.0 [2024-08-05 23:37:38,136][52668] Sum rewards: 22.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.583', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.070', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'ARMOR': '0.484', 'weapon4': '0.528', 'WEAPON4': '0.550', 'weapon2': '0.726', 'WEAPON3': '1.350', 'HITCOUNT': '2.240', 'weapon3': '2.306', 'DAMAGECOUNT': '8.526', 'FRAGCOUNT': '24.500'} [2024-08-05 23:37:38,286][52794] DAMAGECOUNT value on done: 50230.0 [2024-08-05 23:37:38,289][52794] Sum rewards: 48.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'ARMOR': '0.412', 'weapon2': '0.820', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '42.000'} [2024-08-05 23:37:38,328][52650] Updated weights for policy 0, policy_version 16381 (0.0020) [2024-08-05 23:37:39,092][52664] DAMAGECOUNT value on done: 42829.0 [2024-08-05 23:37:39,103][52664] Sum rewards: 22.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.255', 'AMMO5': '0.016', 'AMMO2': '0.019', 'weapon5': '0.034', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.828', 'ARMOR': '0.910', 'WEAPON3': '1.500', 'HITCOUNT': '1.630', 'weapon3': '2.700', 'DAMAGECOUNT': '6.882', 'FRAGCOUNT': '25.000'} [2024-08-05 23:37:39,103][52660] DAMAGECOUNT value on done: 44043.0 [2024-08-05 23:37:39,103][52660] Sum rewards: 41.301, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.633', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.118', 'weapon4': '0.182', 'WEAPON4': '0.200', 'ARMOR': '0.424', 'WEAPON3': '0.800', 'weapon2': '1.524', 'weapon3': '2.126', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:39,108][52659] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:37:39,380][52662] DAMAGECOUNT value on done: 47816.0 [2024-08-05 23:37:39,382][52662] Sum rewards: 41.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.742', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.197', 'ARMOR': '0.404', 'weapon4': '0.418', 'WEAPON4': '0.450', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.688', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.412', 'FRAGCOUNT': '36.000'} [2024-08-05 23:37:40,210][52649] DAMAGECOUNT value on done: 46889.0 [2024-08-05 23:37:40,210][52649] Sum rewards: 45.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.652', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.446', 'weapon2': '0.718', 'ARMOR': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '36.000'} [2024-08-05 23:37:40,740][52668] DAMAGECOUNT value on done: 46341.0 [2024-08-05 23:37:40,742][52668] Sum rewards: 32.054, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.933', 'AMMO5': '0.005', 'AMMO2': '0.034', 'ARMOR': '0.040', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.183', 'weapon2': '0.532', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.100', 'HITCOUNT': '2.250', 'weapon3': '2.500', 'DAMAGECOUNT': '8.823', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:40,987][52794] DAMAGECOUNT value on done: 50644.0 [2024-08-05 23:37:40,988][52794] Sum rewards: 40.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.566', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.368', 'ARMOR': '0.879', 'WEAPON3': '1.000', 'weapon2': '1.078', 'weapon3': '2.174', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '10.581', 'FRAGCOUNT': '34.000'} [2024-08-05 23:37:41,904][52660] DAMAGECOUNT value on done: 40293.0 [2024-08-05 23:37:41,906][52660] Sum rewards: 38.931, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.048', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.078', 'AMMO4': '0.138', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.578', 'weapon2': '0.722', 'ARMOR': '0.963', 'WEAPON3': '1.050', 'weapon3': '2.302', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.704', 'FRAGCOUNT': '33.000'} [2024-08-05 23:37:42,015][52662] DAMAGECOUNT value on done: 49354.0 [2024-08-05 23:37:42,016][52662] Sum rewards: 48.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.315', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon2': '0.746', 'WEAPON3': '1.200', 'ARMOR': '1.895', 'weapon3': '2.652', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.223', 'FRAGCOUNT': '40.000'} [2024-08-05 23:37:42,198][52664] DAMAGECOUNT value on done: 47007.0 [2024-08-05 23:37:42,199][52664] Sum rewards: 52.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.308', 'AMMO5': '0.015', 'AMMO2': '0.017', 'ARMOR': '0.036', 'weapon4': '0.046', 'weapon5': '0.082', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.168', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '46.000'} [2024-08-05 23:37:42,693][52650] Updated weights for policy 0, policy_version 16391 (0.0024) [2024-08-05 23:37:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 134275072. Throughput: 0: 4405.6. Samples: 33575810. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:37:42,794][52567] Avg episode reward: [(0, '34.945')] [2024-08-05 23:37:42,795][52614] Saving new best policy, reward=34.945! [2024-08-05 23:37:43,729][52794] DAMAGECOUNT value on done: 48104.0 [2024-08-05 23:37:43,730][52794] Sum rewards: 36.046, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.215', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.111', 'AMMO3': '0.139', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'weapon4': '0.426', 'WEAPON3': '0.950', 'weapon2': '1.068', 'weapon3': '2.162', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '27.000'} [2024-08-05 23:37:43,734][52668] DAMAGECOUNT value on done: 43493.0 [2024-08-05 23:37:43,734][52668] Sum rewards: 37.396, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.346', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.052', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.313', 'weapon2': '0.630', 'ARMOR': '0.892', 'WEAPON3': '1.750', 'HITCOUNT': '2.280', 'weapon3': '2.996', 'DAMAGECOUNT': '10.215', 'FRAGCOUNT': '39.000'} [2024-08-05 23:37:44,589][52664] DAMAGECOUNT value on done: 45384.0 [2024-08-05 23:37:44,592][52664] Sum rewards: 26.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.654', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.030', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.708', 'ARMOR': '0.897', 'WEAPON3': '1.400', 'HITCOUNT': '2.270', 'weapon3': '2.866', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '24.500'} [2024-08-05 23:37:44,649][52660] DAMAGECOUNT value on done: 45179.0 [2024-08-05 23:37:44,651][52660] Sum rewards: 36.820, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.032', 'AMMO4': '0.131', 'AMMO3': '0.153', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon2': '1.070', 'ARMOR': '1.253', 'HITCOUNT': '2.210', 'weapon3': '2.420', 'DAMAGECOUNT': '9.342', 'FRAGCOUNT': '30.500'} [2024-08-05 23:37:44,657][52662] DAMAGECOUNT value on done: 47627.0 [2024-08-05 23:37:44,657][52662] Sum rewards: 28.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.133', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'ARMOR': '0.882', 'weapon2': '1.160', 'WEAPON3': '1.300', 'HITCOUNT': '1.960', 'weapon3': '2.508', 'DAMAGECOUNT': '8.580', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:46,179][52668] DAMAGECOUNT value on done: 46537.0 [2024-08-05 23:37:46,180][52668] Sum rewards: 37.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.141', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.018', 'AMMO4': '0.070', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.202', 'ARMOR': '0.404', 'weapon2': '0.796', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '2.710', 'DAMAGECOUNT': '9.081', 'FRAGCOUNT': '32.000'} [2024-08-05 23:37:46,198][52614] Signal inference workers to stop experience collection... (3050 times) [2024-08-05 23:37:46,208][52614] Signal inference workers to resume experience collection... (3050 times) [2024-08-05 23:37:46,239][52650] InferenceWorker_p0-w0: stopping experience collection (3050 times) [2024-08-05 23:37:46,239][52650] InferenceWorker_p0-w0: resuming experience collection (3050 times) [2024-08-05 23:37:46,392][52820] DAMAGECOUNT value on done: 38434.0 [2024-08-05 23:37:46,395][52820] Sum rewards: 39.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'ARMOR': '0.880', 'weapon2': '0.880', 'WEAPON3': '1.300', 'HITCOUNT': '2.230', 'weapon3': '2.764', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '35.000'} [2024-08-05 23:37:46,492][52794] DAMAGECOUNT value on done: 52905.0 [2024-08-05 23:37:46,493][52794] Sum rewards: 40.342, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.020', 'AMMO4': '0.093', 'HEALTH': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'ARMOR': '0.459', 'weapon2': '0.692', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.782', 'DAMAGECOUNT': '10.230', 'FRAGCOUNT': '33.000'} [2024-08-05 23:37:47,286][52664] DAMAGECOUNT value on done: 44191.0 [2024-08-05 23:37:47,287][52664] Sum rewards: 25.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'ARMOR': '0.039', 'weapon5': '0.040', 'AMMO2': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.259', 'WEAPON4': '0.500', 'weapon2': '0.550', 'weapon4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '1.900', 'weapon3': '2.436', 'DAMAGECOUNT': '7.326', 'FRAGCOUNT': '25.000'} [2024-08-05 23:37:47,369][52662] DAMAGECOUNT value on done: 49056.0 [2024-08-05 23:37:47,369][52662] Sum rewards: 28.966, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.749', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.602', 'ARMOR': '0.881', 'WEAPON3': '1.600', 'HITCOUNT': '2.210', 'weapon3': '2.658', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:47,420][52660] DAMAGECOUNT value on done: 45310.0 [2024-08-05 23:37:47,422][52660] Sum rewards: 41.830, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.826', 'AMMO5': '0.018', 'weapon5': '0.018', 'AMMO2': '0.058', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'AMMO4': '0.292', 'weapon4': '0.414', 'WEAPON4': '0.650', 'ARMOR': '0.873', 'weapon2': '0.904', 'WEAPON3': '1.500', 'weapon3': '2.360', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '40.000'} [2024-08-05 23:37:47,642][52650] Updated weights for policy 0, policy_version 16401 (0.0029) [2024-08-05 23:37:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.4). Total num frames: 134356992. Throughput: 0: 4406.9. Samples: 33589080. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 23:37:47,794][52567] Avg episode reward: [(0, '34.821')] [2024-08-05 23:37:48,855][52668] DAMAGECOUNT value on done: 42935.0 [2024-08-05 23:37:48,858][52668] Sum rewards: 38.927, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.139', 'ARMOR': '0.400', 'weapon4': '0.446', 'WEAPON3': '0.550', 'HEALTH': '0.890', 'weapon2': '1.250', 'HITCOUNT': '1.960', 'weapon3': '2.106', 'DAMAGECOUNT': '8.079', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:49,118][52794] DAMAGECOUNT value on done: 46286.0 [2024-08-05 23:37:49,149][52794] Sum rewards: 35.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.756', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.210', 'weapon4': '0.420', 'WEAPON4': '0.550', 'weapon2': '0.738', 'ARMOR': '0.879', 'WEAPON3': '0.950', 'HITCOUNT': '2.120', 'weapon3': '2.516', 'DAMAGECOUNT': '8.334', 'FRAGCOUNT': '30.000'} [2024-08-05 23:37:49,613][52820] DAMAGECOUNT value on done: 41234.0 [2024-08-05 23:37:49,613][52820] Sum rewards: 35.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.545', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'AMMO3': '0.198', 'weapon4': '0.332', 'WEAPON4': '0.350', 'ARMOR': '0.444', 'weapon2': '0.846', 'WEAPON3': '1.250', 'weapon3': '2.572', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.506', 'FRAGCOUNT': '33.000'} [2024-08-05 23:37:50,011][52660] DAMAGECOUNT value on done: 44305.0 [2024-08-05 23:37:50,011][52660] Sum rewards: 28.860, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.288', 'weapon5': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'AMMO4': '0.223', 'weapon4': '0.458', 'WEAPON4': '0.650', 'ARMOR': '0.970', 'weapon2': '0.990', 'WEAPON3': '1.150', 'HITCOUNT': '2.180', 'weapon3': '2.278', 'DAMAGECOUNT': '9.144', 'FRAGCOUNT': '28.500'} [2024-08-05 23:37:50,208][52664] DAMAGECOUNT value on done: 48275.0 [2024-08-05 23:37:50,209][52664] Sum rewards: 33.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.519', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.032', 'AMMO4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.372', 'WEAPON4': '0.400', 'ARMOR': '0.816', 'weapon2': '0.862', 'WEAPON3': '1.200', 'weapon3': '2.452', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:50,721][52662] DAMAGECOUNT value on done: 50465.0 [2024-08-05 23:37:50,721][52662] Sum rewards: 35.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.064', 'AMMO3': '0.146', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'ARMOR': '0.949', 'WEAPON3': '1.000', 'weapon2': '1.318', 'HITCOUNT': '2.140', 'weapon3': '2.252', 'DAMAGECOUNT': '8.691', 'FRAGCOUNT': '31.000'} [2024-08-05 23:37:51,936][52668] DAMAGECOUNT value on done: 43776.0 [2024-08-05 23:37:51,940][52668] Sum rewards: 30.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.054', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.207', 'weapon4': '0.264', 'WEAPON4': '0.450', 'ARMOR': '0.539', 'weapon2': '0.880', 'WEAPON3': '1.200', 'HITCOUNT': '2.010', 'weapon3': '2.288', 'DAMAGECOUNT': '8.418', 'FRAGCOUNT': '27.000'} [2024-08-05 23:37:52,073][52650] Updated weights for policy 0, policy_version 16411 (0.0011) [2024-08-05 23:37:52,295][52794] DAMAGECOUNT value on done: 49796.0 [2024-08-05 23:37:52,295][52794] Sum rewards: 31.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.938', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO3': '0.137', 'WEAPON3': '0.900', 'weapon2': '1.542', 'HITCOUNT': '2.080', 'weapon3': '2.324', 'ARMOR': '2.653', 'DAMAGECOUNT': '7.785', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:52,768][52820] DAMAGECOUNT value on done: 38776.0 [2024-08-05 23:37:52,768][52820] Sum rewards: 29.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.672', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.052', 'AMMO3': '0.200', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.412', 'WEAPON4': '0.550', 'weapon2': '0.744', 'ARMOR': '0.804', 'WEAPON3': '1.350', 'HITCOUNT': '2.020', 'weapon3': '2.506', 'DAMAGECOUNT': '7.947', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 134447104. Throughput: 0: 4406.7. Samples: 33615550. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-05 23:37:52,794][52567] Avg episode reward: [(0, '35.133')] [2024-08-05 23:37:52,795][52614] Saving new best policy, reward=35.133! [2024-08-05 23:37:52,931][52660] DAMAGECOUNT value on done: 43595.0 [2024-08-05 23:37:52,932][52660] Sum rewards: 37.460, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.473', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.366', 'ARMOR': '0.457', 'weapon2': '1.042', 'WEAPON3': '1.100', 'HITCOUNT': '2.170', 'weapon3': '2.268', 'DAMAGECOUNT': '8.634', 'FRAGCOUNT': '32.000'} [2024-08-05 23:37:53,002][52664] DAMAGECOUNT value on done: 45726.0 [2024-08-05 23:37:53,003][52664] Sum rewards: 30.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.029', 'weapon4': '0.084', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'ARMOR': '0.495', 'weapon2': '1.144', 'WEAPON3': '1.200', 'HITCOUNT': '2.030', 'weapon3': '2.464', 'DAMAGECOUNT': '7.935', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:53,310][52662] DAMAGECOUNT value on done: 46508.0 [2024-08-05 23:37:53,312][52662] Sum rewards: 29.557, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.631', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.452', 'ARMOR': '0.483', 'weapon2': '0.660', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '2.538', 'DAMAGECOUNT': '8.577', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:54,658][52668] DAMAGECOUNT value on done: 41295.0 [2024-08-05 23:37:54,658][52668] Sum rewards: 28.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.560', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'ARMOR': '0.460', 'weapon4': '0.688', 'weapon2': '0.840', 'WEAPON3': '1.050', 'HITCOUNT': '1.910', 'weapon3': '2.278', 'DAMAGECOUNT': '7.470', 'FRAGCOUNT': '24.000'} [2024-08-05 23:37:54,662][52794] DAMAGECOUNT value on done: 50976.0 [2024-08-05 23:37:54,664][52794] Sum rewards: 45.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.882', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon5': '0.064', 'AMMO4': '0.104', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '2.994', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '42.000'} [2024-08-05 23:37:55,676][52660] DAMAGECOUNT value on done: 44011.0 [2024-08-05 23:37:55,677][52660] Sum rewards: 30.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.185', 'weapon4': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.424', 'weapon2': '0.854', 'WEAPON3': '1.250', 'HITCOUNT': '2.060', 'weapon3': '2.534', 'DAMAGECOUNT': '8.580', 'FRAGCOUNT': '29.000'} [2024-08-05 23:37:55,808][52662] DAMAGECOUNT value on done: 49242.0 [2024-08-05 23:37:55,808][52662] Sum rewards: 33.771, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.058', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon4': '0.590', 'WEAPON3': '0.750', 'weapon2': '0.914', 'weapon3': '1.708', 'HITCOUNT': '1.860', 'DAMAGECOUNT': '8.346', 'FRAGCOUNT': '28.000'} [2024-08-05 23:37:55,836][52820] DAMAGECOUNT value on done: 38972.0 [2024-08-05 23:37:55,837][52820] Sum rewards: 28.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.972', 'AMMO5': '0.011', 'weapon5': '0.032', 'AMMO2': '0.038', 'AMMO3': '0.187', 'AMMO4': '0.191', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.880', 'WEAPON3': '1.300', 'ARMOR': '1.762', 'HITCOUNT': '1.910', 'weapon3': '2.644', 'DAMAGECOUNT': '8.100', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:56,174][52664] DAMAGECOUNT value on done: 42917.0 [2024-08-05 23:37:56,175][52664] Sum rewards: 34.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.105', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.016', 'AMMO4': '0.068', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'ARMOR': '0.400', 'WEAPON3': '1.150', 'weapon2': '1.186', 'HITCOUNT': '2.340', 'weapon3': '2.544', 'DAMAGECOUNT': '9.708', 'FRAGCOUNT': '29.500'} [2024-08-05 23:37:57,051][52650] Updated weights for policy 0, policy_version 16421 (0.0012) [2024-08-05 23:37:57,204][52794] DAMAGECOUNT value on done: 49964.0 [2024-08-05 23:37:57,206][52794] Sum rewards: 50.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.784', 'AMMO5': '0.003', 'AMMO2': '0.029', 'ARMOR': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.096', 'weapon4': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'weapon2': '0.840', 'WEAPON3': '1.200', 'weapon3': '2.644', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '44.000'} [2024-08-05 23:37:57,208][52668] DAMAGECOUNT value on done: 44565.0 [2024-08-05 23:37:57,210][52668] Sum rewards: 41.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.561', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'ARMOR': '0.912', 'weapon2': '1.048', 'WEAPON3': '1.450', 'weapon3': '2.704', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '37.000'} [2024-08-05 23:37:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 134537216. Throughput: 0: 4400.2. Samples: 33641690. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:37:57,794][52567] Avg episode reward: [(0, '35.096')] [2024-08-05 23:37:58,364][52660] DAMAGECOUNT value on done: 43751.0 [2024-08-05 23:37:58,364][52660] Sum rewards: 37.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.867', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.108', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON5': '0.350', 'ARMOR': '0.880', 'WEAPON3': '1.100', 'weapon2': '1.276', 'weapon3': '2.124', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '9.636', 'FRAGCOUNT': '33.000'} [2024-08-05 23:37:58,677][52662] DAMAGECOUNT value on done: 48847.0 [2024-08-05 23:37:58,677][52662] Sum rewards: 38.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.220', 'weapon4': '0.304', 'WEAPON4': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.794', 'DAMAGECOUNT': '10.926', 'FRAGCOUNT': '35.000'} [2024-08-05 23:37:58,829][52664] DAMAGECOUNT value on done: 50555.0 [2024-08-05 23:37:58,829][52664] Sum rewards: 40.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.681', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'ARMOR': '1.204', 'weapon2': '1.222', 'WEAPON3': '1.350', 'HITCOUNT': '2.330', 'weapon3': '2.428', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '35.000'} [2024-08-05 23:37:58,900][52820] DAMAGECOUNT value on done: 40007.0 [2024-08-05 23:37:58,901][52820] Sum rewards: 27.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.114', 'AMMO3': '0.208', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.406', 'ARMOR': '0.485', 'WEAPON4': '0.550', 'weapon2': '0.896', 'WEAPON3': '1.200', 'HITCOUNT': '2.100', 'weapon3': '2.198', 'DAMAGECOUNT': '7.794', 'FRAGCOUNT': '26.000'} [2024-08-05 23:37:59,958][52668] DAMAGECOUNT value on done: 44434.0 [2024-08-05 23:37:59,960][52668] Sum rewards: 48.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.662', 'weapon2': '0.818', 'WEAPON3': '1.000', 'ARMOR': '1.335', 'weapon3': '2.256', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '40.000'} [2024-08-05 23:38:00,072][52794] DAMAGECOUNT value on done: 50138.0 [2024-08-05 23:38:00,083][52794] Sum rewards: 46.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.046', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'weapon2': '1.012', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.646', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '41.000'} [2024-08-05 23:38:01,037][52660] DAMAGECOUNT value on done: 43446.0 [2024-08-05 23:38:01,039][52660] Sum rewards: 26.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon4': '0.236', 'AMMO4': '0.252', 'ARMOR': '0.432', 'WEAPON4': '0.450', 'weapon2': '0.820', 'WEAPON3': '1.250', 'HITCOUNT': '1.760', 'weapon3': '2.618', 'DAMAGECOUNT': '6.894', 'FRAGCOUNT': '25.000'} [2024-08-05 23:38:01,366][52650] Updated weights for policy 0, policy_version 16431 (0.0043) [2024-08-05 23:38:01,369][52664] DAMAGECOUNT value on done: 45855.0 [2024-08-05 23:38:01,370][52664] Sum rewards: 31.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.570', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon5': '0.064', 'weapon4': '0.096', 'AMMO4': '0.164', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.485', 'weapon2': '0.992', 'WEAPON3': '1.650', 'HITCOUNT': '2.390', 'weapon3': '2.550', 'DAMAGECOUNT': '9.534', 'FRAGCOUNT': '29.500'} [2024-08-05 23:38:01,589][52662] DAMAGECOUNT value on done: 48631.0 [2024-08-05 23:38:01,589][52662] Sum rewards: 36.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.264', 'AMMO5': '0.007', 'weapon5': '0.046', 'AMMO2': '0.049', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.246', 'ARMOR': '0.544', 'WEAPON4': '0.550', 'weapon2': '0.590', 'weapon4': '0.664', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '2.450', 'DAMAGECOUNT': '9.192', 'FRAGCOUNT': '32.000'} [2024-08-05 23:38:02,046][52820] DAMAGECOUNT value on done: 41121.0 [2024-08-05 23:38:02,046][52820] Sum rewards: 37.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.758', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon4': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.164', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'ARMOR': '0.888', 'weapon2': '1.098', 'WEAPON3': '1.350', 'HITCOUNT': '2.500', 'weapon3': '2.600', 'DAMAGECOUNT': '9.420', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:02,386][52668] DAMAGECOUNT value on done: 44737.0 [2024-08-05 23:38:02,388][52668] Sum rewards: 48.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.962', 'ARMOR': '1.333', 'WEAPON3': '1.400', 'weapon3': '2.480', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '41.000'} [2024-08-05 23:38:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 134619136. Throughput: 0: 4398.0. Samples: 33654980. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:38:02,795][52567] Avg episode reward: [(0, '35.563')] [2024-08-05 23:38:02,856][52614] Saving new best policy, reward=35.563! [2024-08-05 23:38:03,172][52794] DAMAGECOUNT value on done: 49179.0 [2024-08-05 23:38:03,173][52794] Sum rewards: 32.908, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.802', 'WEAPON3': '1.050', 'HITCOUNT': '2.170', 'weapon3': '2.650', 'DAMAGECOUNT': '9.117', 'FRAGCOUNT': '27.000'} [2024-08-05 23:38:03,558][52660] DAMAGECOUNT value on done: 42674.0 [2024-08-05 23:38:03,559][52660] Sum rewards: 36.116, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.211', 'HEALTH': '0.282', 'weapon4': '0.348', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.902', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '2.424', 'DAMAGECOUNT': '9.171', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:04,411][52664] DAMAGECOUNT value on done: 48325.0 [2024-08-05 23:38:04,411][52664] Sum rewards: 35.003, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.704', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.070', 'weapon4': '0.208', 'AMMO4': '0.219', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.562', 'ARMOR': '0.804', 'WEAPON3': '1.550', 'HITCOUNT': '2.270', 'weapon3': '2.806', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '34.000'} [2024-08-05 23:38:05,039][52820] DAMAGECOUNT value on done: 42492.0 [2024-08-05 23:38:05,040][52820] Sum rewards: 38.727, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.347', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.158', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.932', 'ARMOR': '1.287', 'HITCOUNT': '2.410', 'weapon3': '2.442', 'DAMAGECOUNT': '10.158', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:05,308][52668] DAMAGECOUNT value on done: 43204.0 [2024-08-05 23:38:05,312][52668] Sum rewards: 37.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.102', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.022', 'weapon4': '0.028', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'ARMOR': '0.800', 'weapon2': '0.888', 'WEAPON3': '1.500', 'HITCOUNT': '2.290', 'weapon3': '2.832', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:05,711][52669] DAMAGECOUNT value on done: 44251.0 [2024-08-05 23:38:05,711][52669] Sum rewards: 33.106, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.784', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON3': '0.900', 'weapon2': '1.186', 'ARMOR': '1.200', 'HITCOUNT': '1.860', 'weapon3': '2.658', 'DAMAGECOUNT': '7.752', 'FRAGCOUNT': '27.000'} [2024-08-05 23:38:06,137][52650] Updated weights for policy 0, policy_version 16441 (0.0024) [2024-08-05 23:38:06,672][52660] DAMAGECOUNT value on done: 45298.0 [2024-08-05 23:38:06,674][52660] Sum rewards: 46.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.462', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.215', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.806', 'WEAPON3': '1.250', 'ARMOR': '1.657', 'weapon3': '2.654', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '38.000'} [2024-08-05 23:38:07,264][52664] DAMAGECOUNT value on done: 44650.0 [2024-08-05 23:38:07,264][52664] Sum rewards: 41.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.054', 'weapon7': '0.072', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.400', 'weapon2': '0.798', 'WEAPON3': '1.200', 'ARMOR': '1.322', 'weapon3': '2.370', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 134709248. Throughput: 0: 4387.6. Samples: 33681170. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:38:07,794][52567] Avg episode reward: [(0, '35.846')] [2024-08-05 23:38:07,797][52614] Saving new best policy, reward=35.846! [2024-08-05 23:38:08,165][52820] DAMAGECOUNT value on done: 40664.0 [2024-08-05 23:38:08,166][52820] Sum rewards: 35.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.318', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO4': '0.131', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.776', 'ARMOR': '0.934', 'WEAPON3': '1.500', 'HITCOUNT': '2.130', 'weapon3': '2.802', 'DAMAGECOUNT': '9.273', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:08,183][52669] DAMAGECOUNT value on done: 44521.0 [2024-08-05 23:38:08,185][52669] Sum rewards: 38.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.356', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.980', 'WEAPON3': '1.200', 'HITCOUNT': '2.370', 'weapon3': '2.676', 'DAMAGECOUNT': '9.570', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:08,433][52668] DAMAGECOUNT value on done: 41934.0 [2024-08-05 23:38:08,434][52668] Sum rewards: 38.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO5': '0.010', 'AMMO2': '0.036', 'ARMOR': '0.052', 'weapon5': '0.070', 'AMMO3': '0.152', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.648', 'weapon2': '0.734', 'WEAPON3': '0.950', 'weapon3': '2.072', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.131', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:09,635][52660] DAMAGECOUNT value on done: 48393.0 [2024-08-05 23:38:09,637][52660] Sum rewards: 36.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.309', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.074', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.650', 'ARMOR': '0.914', 'WEAPON3': '1.450', 'HITCOUNT': '2.170', 'weapon3': '2.998', 'DAMAGECOUNT': '9.873', 'FRAGCOUNT': '34.000'} [2024-08-05 23:38:09,887][52664] DAMAGECOUNT value on done: 44959.0 [2024-08-05 23:38:09,888][52664] Sum rewards: 28.745, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.031', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.149', 'weapon5': '0.178', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.192', 'HITCOUNT': '1.850', 'weapon3': '2.024', 'DAMAGECOUNT': '7.554', 'FRAGCOUNT': '24.000'} [2024-08-05 23:38:11,158][52668] DAMAGECOUNT value on done: 45393.0 [2024-08-05 23:38:11,159][52668] Sum rewards: 40.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.153', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.440', 'ARMOR': '0.472', 'weapon2': '0.526', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '2.734', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '34.000'} [2024-08-05 23:38:11,174][52650] Updated weights for policy 0, policy_version 16451 (0.0012) [2024-08-05 23:38:11,243][52669] DAMAGECOUNT value on done: 44568.0 [2024-08-05 23:38:11,245][52669] Sum rewards: 41.814, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.167', 'ARMOR': '0.457', 'weapon2': '0.788', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '2.762', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '34.000'} [2024-08-05 23:38:11,344][52820] DAMAGECOUNT value on done: 38989.0 [2024-08-05 23:38:11,345][52820] Sum rewards: 20.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '1.024', 'WEAPON3': '1.200', 'HITCOUNT': '1.960', 'weapon3': '2.368', 'DAMAGECOUNT': '8.085', 'FRAGCOUNT': '20.000'} [2024-08-05 23:38:12,475][52664] DAMAGECOUNT value on done: 44982.0 [2024-08-05 23:38:12,477][52664] Sum rewards: 33.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'weapon5': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.094', 'AMMO3': '0.226', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'ARMOR': '0.889', 'weapon2': '0.900', 'WEAPON3': '1.450', 'HITCOUNT': '2.100', 'weapon3': '2.676', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:12,575][52660] DAMAGECOUNT value on done: 43629.0 [2024-08-05 23:38:12,575][52660] Sum rewards: 33.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.253', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.178', 'ARMOR': '0.852', 'WEAPON3': '1.150', 'weapon2': '1.256', 'HITCOUNT': '2.170', 'weapon3': '2.298', 'DAMAGECOUNT': '8.622', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 134799360. Throughput: 0: 4385.6. Samples: 33707390. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:38:12,794][52567] Avg episode reward: [(0, '35.767')] [2024-08-05 23:38:13,738][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:38:13,799][52669] DAMAGECOUNT value on done: 43487.0 [2024-08-05 23:38:13,800][52669] Sum rewards: 39.501, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.113', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon5': '0.240', 'WEAPON5': '0.250', 'ARMOR': '0.486', 'HEALTH': '0.494', 'weapon4': '0.588', 'WEAPON3': '0.650', 'weapon2': '1.092', 'weapon3': '1.668', 'HITCOUNT': '2.160', 'DAMAGECOUNT': '8.934', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:14,261][52668] DAMAGECOUNT value on done: 47062.0 [2024-08-05 23:38:14,263][52668] Sum rewards: 37.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.471', 'AMMO5': '0.015', 'weapon5': '0.024', 'AMMO2': '0.047', 'AMMO3': '0.193', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.418', 'weapon2': '0.800', 'WEAPON3': '1.150', 'ARMOR': '1.287', 'HITCOUNT': '2.270', 'weapon3': '2.468', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:14,459][52820] DAMAGECOUNT value on done: 40457.0 [2024-08-05 23:38:14,461][52820] Sum rewards: 34.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.165', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.280', 'WEAPON4': '0.300', 'ARMOR': '0.886', 'weapon2': '1.122', 'WEAPON3': '1.150', 'weapon3': '2.258', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.438', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:14,861][52666] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:38:15,035][52664] DAMAGECOUNT value on done: 48312.0 [2024-08-05 23:38:15,035][52664] Sum rewards: 27.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'ARMOR': '0.880', 'weapon2': '1.054', 'WEAPON3': '1.250', 'HITCOUNT': '1.940', 'weapon3': '2.598', 'DAMAGECOUNT': '8.619', 'FRAGCOUNT': '24.000'} [2024-08-05 23:38:15,362][52650] Updated weights for policy 0, policy_version 16461 (0.0015) [2024-08-05 23:38:15,440][52660] DAMAGECOUNT value on done: 45131.0 [2024-08-05 23:38:15,440][52660] Sum rewards: 36.541, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'HEALTH': '0.307', 'weapon2': '0.928', 'WEAPON3': '1.100', 'ARMOR': '1.257', 'HITCOUNT': '2.060', 'weapon3': '2.752', 'DAMAGECOUNT': '8.445', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:16,754][52669] DAMAGECOUNT value on done: 45977.0 [2024-08-05 23:38:16,754][52669] Sum rewards: 31.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.074', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.191', 'weapon4': '0.218', 'WEAPON4': '0.250', 'ARMOR': '0.833', 'weapon2': '1.102', 'WEAPON3': '1.150', 'HITCOUNT': '2.160', 'weapon3': '2.458', 'DAMAGECOUNT': '9.168', 'FRAGCOUNT': '27.000'} [2024-08-05 23:38:17,736][52820] DAMAGECOUNT value on done: 42262.0 [2024-08-05 23:38:17,738][52820] Sum rewards: 34.910, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.504', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.060', 'weapon4': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'ARMOR': '0.852', 'WEAPON3': '1.050', 'weapon2': '1.144', 'HITCOUNT': '2.440', 'weapon3': '2.536', 'DAMAGECOUNT': '9.714', 'FRAGCOUNT': '28.500'} [2024-08-05 23:38:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 134889472. Throughput: 0: 4382.2. Samples: 33720700. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:38:17,794][52567] Avg episode reward: [(0, '35.821')] [2024-08-05 23:38:18,136][52664] DAMAGECOUNT value on done: 44521.0 [2024-08-05 23:38:18,137][52664] Sum rewards: 36.398, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'HEALTH': '0.032', 'AMMO2': '0.037', 'weapon5': '0.056', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.398', 'ARMOR': '0.445', 'WEAPON3': '0.800', 'weapon2': '0.958', 'weapon3': '2.272', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '9.678', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:18,307][52660] DAMAGECOUNT value on done: 44795.0 [2024-08-05 23:38:18,318][52660] Sum rewards: 32.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.106', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.029', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon4': '0.372', 'weapon2': '0.732', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.628', 'DAMAGECOUNT': '8.541', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:19,206][52669] DAMAGECOUNT value on done: 46554.0 [2024-08-05 23:38:19,207][52669] Sum rewards: 31.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.904', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.186', 'AMMO3': '0.199', 'WEAPON4': '0.400', 'ARMOR': '0.481', 'weapon4': '0.488', 'weapon2': '0.608', 'WEAPON3': '1.250', 'HITCOUNT': '2.070', 'weapon3': '2.600', 'DAMAGECOUNT': '8.427', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:20,351][52650] Updated weights for policy 0, policy_version 16471 (0.0026) [2024-08-05 23:38:20,771][52820] DAMAGECOUNT value on done: 43899.0 [2024-08-05 23:38:20,771][52820] Sum rewards: 43.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.676', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.044', 'AMMO4': '0.164', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.450', 'weapon2': '0.722', 'ARMOR': '1.363', 'WEAPON3': '1.400', 'weapon3': '2.614', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '38.000'} [2024-08-05 23:38:21,063][52664] DAMAGECOUNT value on done: 46216.0 [2024-08-05 23:38:21,064][52664] Sum rewards: 33.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.664', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.300', 'weapon4': '0.498', 'WEAPON3': '0.800', 'ARMOR': '0.824', 'weapon2': '1.124', 'weapon3': '2.056', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '8.277', 'FRAGCOUNT': '28.000'} [2024-08-05 23:38:21,517][52660] DAMAGECOUNT value on done: 45398.0 [2024-08-05 23:38:21,517][52660] Sum rewards: 40.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.607', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon4': '0.232', 'weapon2': '0.604', 'ARMOR': '0.856', 'WEAPON3': '1.450', 'HITCOUNT': '2.370', 'weapon3': '2.954', 'DAMAGECOUNT': '10.260', 'FRAGCOUNT': '38.000'} [2024-08-05 23:38:21,728][52667] DAMAGECOUNT value on done: 45515.0 [2024-08-05 23:38:21,728][52667] Sum rewards: 30.772, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.149', 'AMMO3': '0.151', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.836', 'weapon2': '0.990', 'WEAPON3': '1.050', 'HITCOUNT': '2.000', 'weapon3': '2.490', 'DAMAGECOUNT': '9.312', 'FRAGCOUNT': '24.000'} [2024-08-05 23:38:21,939][52669] DAMAGECOUNT value on done: 45673.0 [2024-08-05 23:38:21,942][52669] Sum rewards: 34.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.173', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.644', 'WEAPON3': '1.200', 'HITCOUNT': '2.500', 'weapon3': '3.006', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 134971392. Throughput: 0: 4387.1. Samples: 33747170. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:38:22,794][52567] Avg episode reward: [(0, '35.880')] [2024-08-05 23:38:22,795][52614] Saving new best policy, reward=35.880! [2024-08-05 23:38:23,749][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:38:23,879][52820] DAMAGECOUNT value on done: 39249.0 [2024-08-05 23:38:23,881][52820] Sum rewards: 43.579, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.771', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.154', 'AMMO3': '0.171', 'AMMO4': '0.181', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon2': '0.706', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.876', 'DAMAGECOUNT': '10.053', 'FRAGCOUNT': '37.000'} [2024-08-05 23:38:24,378][52667] DAMAGECOUNT value on done: 47094.0 [2024-08-05 23:38:24,380][52667] Sum rewards: 37.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.414', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.056', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.232', 'HITCOUNT': '2.150', 'weapon3': '2.448', 'DAMAGECOUNT': '10.101', 'FRAGCOUNT': '32.000'} [2024-08-05 23:38:24,381][52664] DAMAGECOUNT value on done: 46054.0 [2024-08-05 23:38:24,383][52664] Sum rewards: 35.583, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.052', 'AMMO3': '0.158', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'ARMOR': '0.448', 'WEAPON4': '0.500', 'weapon2': '0.754', 'weapon4': '0.880', 'WEAPON3': '1.000', 'weapon3': '1.952', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.937', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:24,546][52660] DAMAGECOUNT value on done: 44230.0 [2024-08-05 23:38:24,546][52660] Sum rewards: 40.221, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.140', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'ARMOR': '0.500', 'weapon2': '0.830', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.876', 'DAMAGECOUNT': '9.528', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:24,633][52669] DAMAGECOUNT value on done: 44232.0 [2024-08-05 23:38:24,633][52669] Sum rewards: 35.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.075', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.940', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '2.798', 'DAMAGECOUNT': '9.234', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:25,074][52650] Updated weights for policy 0, policy_version 16481 (0.0010) [2024-08-05 23:38:26,660][52664] DAMAGECOUNT value on done: 47187.0 [2024-08-05 23:38:26,662][52664] Sum rewards: 36.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.891', 'weapon5': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.166', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '1.140', 'WEAPON3': '1.200', 'ARMOR': '1.314', 'HITCOUNT': '2.390', 'weapon3': '2.410', 'DAMAGECOUNT': '9.591', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:27,011][52667] DAMAGECOUNT value on done: 44843.0 [2024-08-05 23:38:27,011][52667] Sum rewards: 36.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.405', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'ARMOR': '0.456', 'weapon2': '0.864', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.722', 'DAMAGECOUNT': '9.867', 'FRAGCOUNT': '32.000'} [2024-08-05 23:38:27,057][52820] DAMAGECOUNT value on done: 40625.0 [2024-08-05 23:38:27,058][52820] Sum rewards: 31.881, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.543', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'AMMO3': '0.141', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.410', 'ARMOR': '0.880', 'WEAPON3': '0.950', 'weapon2': '0.956', 'HITCOUNT': '2.030', 'weapon3': '2.168', 'DAMAGECOUNT': '7.941', 'FRAGCOUNT': '26.000'} [2024-08-05 23:38:27,504][52669] DAMAGECOUNT value on done: 44913.0 [2024-08-05 23:38:27,505][52669] Sum rewards: 30.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.106', 'AMMO4': '0.198', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'ARMOR': '0.484', 'weapon4': '0.522', 'WEAPON4': '0.550', 'weapon2': '0.894', 'WEAPON3': '1.250', 'HITCOUNT': '2.040', 'weapon3': '2.248', 'DAMAGECOUNT': '8.898', 'FRAGCOUNT': '28.000'} [2024-08-05 23:38:27,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 135053312. Throughput: 0: 4393.5. Samples: 33773520. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:38:27,795][52567] Avg episode reward: [(0, '36.006')] [2024-08-05 23:38:27,807][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000016487_135061504.pth... [2024-08-05 23:38:27,951][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000015972_130842624.pth [2024-08-05 23:38:27,956][52614] Saving new best policy, reward=36.006! [2024-08-05 23:38:28,671][52665] DAMAGECOUNT value on done: 43303.0 [2024-08-05 23:38:28,672][52665] Sum rewards: 35.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.302', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.150', 'ARMOR': '0.400', 'weapon2': '0.780', 'WEAPON3': '0.850', 'HITCOUNT': '2.470', 'weapon3': '2.806', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:29,411][52650] Updated weights for policy 0, policy_version 16491 (0.0010) [2024-08-05 23:38:29,692][52664] DAMAGECOUNT value on done: 47220.0 [2024-08-05 23:38:29,694][52664] Sum rewards: 29.984, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.550', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.022', 'weapon4': '0.036', 'AMMO4': '0.110', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.680', 'ARMOR': '1.354', 'WEAPON3': '1.500', 'HITCOUNT': '2.200', 'weapon3': '3.036', 'DAMAGECOUNT': '9.333', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:30,129][52667] DAMAGECOUNT value on done: 45126.0 [2024-08-05 23:38:30,129][52667] Sum rewards: 32.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.146', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.552', 'weapon2': '0.686', 'WEAPON3': '0.950', 'HITCOUNT': '1.950', 'weapon3': '2.416', 'DAMAGECOUNT': '8.592', 'FRAGCOUNT': '26.000'} [2024-08-05 23:38:30,198][52820] DAMAGECOUNT value on done: 42467.0 [2024-08-05 23:38:30,199][52820] Sum rewards: 44.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.222', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.136', 'WEAPON3': '0.850', 'weapon2': '1.462', 'ARMOR': '2.100', 'weapon3': '2.378', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.058', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:30,533][52669] DAMAGECOUNT value on done: 42730.0 [2024-08-05 23:38:30,534][52669] Sum rewards: 36.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO2': '0.002', 'AMMO4': '0.012', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.186', 'ARMOR': '0.457', 'weapon2': '1.036', 'WEAPON3': '1.200', 'weapon3': '2.680', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '9.630', 'FRAGCOUNT': '32.000'} [2024-08-05 23:38:31,615][52665] DAMAGECOUNT value on done: 47409.0 [2024-08-05 23:38:31,618][52665] Sum rewards: 44.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.371', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.021', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.674', 'ARMOR': '0.953', 'WEAPON3': '1.450', 'HITCOUNT': '2.650', 'weapon3': '2.962', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '40.000'} [2024-08-05 23:38:32,562][52667] DAMAGECOUNT value on done: 46101.0 [2024-08-05 23:38:32,563][52667] Sum rewards: 43.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.022', 'weapon4': '0.056', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.546', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.086', 'DAMAGECOUNT': '11.499', 'FRAGCOUNT': '38.000'} [2024-08-05 23:38:32,795][52567] Fps is (10 sec: 18021.4, 60 sec: 17612.6, 300 sec: 17578.1). Total num frames: 135151616. Throughput: 0: 4384.0. Samples: 33786360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:38:32,795][52567] Avg episode reward: [(0, '36.203')] [2024-08-05 23:38:32,795][52614] Saving new best policy, reward=36.203! [2024-08-05 23:38:32,885][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:38:33,365][52669] DAMAGECOUNT value on done: 46954.0 [2024-08-05 23:38:33,369][52669] Sum rewards: 45.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.164', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'weapon2': '0.890', 'WEAPON3': '1.250', 'ARMOR': '1.718', 'weapon3': '2.090', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.328', 'FRAGCOUNT': '39.000'} [2024-08-05 23:38:33,596][52820] DAMAGECOUNT value on done: 41826.0 [2024-08-05 23:38:33,597][52820] Sum rewards: 25.581, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.494', 'weapon2': '0.896', 'WEAPON3': '1.250', 'HITCOUNT': '2.020', 'weapon3': '2.354', 'DAMAGECOUNT': '7.815', 'FRAGCOUNT': '25.000'} [2024-08-05 23:38:34,355][52650] Updated weights for policy 0, policy_version 16501 (0.0026) [2024-08-05 23:38:34,373][52665] DAMAGECOUNT value on done: 46050.0 [2024-08-05 23:38:34,375][52665] Sum rewards: 32.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.234', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.064', 'AMMO3': '0.192', 'weapon4': '0.238', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.496', 'weapon2': '0.674', 'WEAPON3': '1.250', 'HITCOUNT': '2.310', 'weapon3': '2.732', 'DAMAGECOUNT': '8.931', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:34,753][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:38:35,943][52667] DAMAGECOUNT value on done: 47540.0 [2024-08-05 23:38:35,946][52667] Sum rewards: 36.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.998', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.058', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.226', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.834', 'ARMOR': '0.858', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '2.614', 'DAMAGECOUNT': '10.095', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:36,410][52669] DAMAGECOUNT value on done: 47120.0 [2024-08-05 23:38:36,411][52669] Sum rewards: 38.102, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.434', 'weapon4': '0.006', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'ARMOR': '0.400', 'weapon2': '0.766', 'WEAPON3': '1.450', 'HITCOUNT': '2.470', 'weapon3': '2.784', 'DAMAGECOUNT': '10.761', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:36,753][52820] DAMAGECOUNT value on done: 41689.0 [2024-08-05 23:38:36,754][52820] Sum rewards: 38.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.100', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.940', 'WEAPON3': '1.350', 'ARMOR': '1.712', 'HITCOUNT': '2.520', 'weapon3': '2.652', 'DAMAGECOUNT': '10.149', 'FRAGCOUNT': '34.000'} [2024-08-05 23:38:37,510][52665] DAMAGECOUNT value on done: 44023.0 [2024-08-05 23:38:37,512][52665] Sum rewards: 28.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.032', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'ARMOR': '0.424', 'weapon2': '1.120', 'WEAPON3': '1.250', 'HITCOUNT': '1.970', 'weapon3': '2.642', 'DAMAGECOUNT': '8.127', 'FRAGCOUNT': '28.000'} [2024-08-05 23:38:37,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 135241728. Throughput: 0: 4372.4. Samples: 33812310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:38:37,794][52567] Avg episode reward: [(0, '36.029')] [2024-08-05 23:38:38,884][52650] Updated weights for policy 0, policy_version 16511 (0.0023) [2024-08-05 23:38:38,977][52667] DAMAGECOUNT value on done: 45913.0 [2024-08-05 23:38:38,979][52667] Sum rewards: 21.331, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.670', 'AMMO5': '0.005', 'AMMO2': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon4': '0.300', 'AMMO4': '0.351', 'ARMOR': '0.448', 'WEAPON4': '0.700', 'weapon2': '1.056', 'WEAPON3': '1.550', 'HITCOUNT': '1.890', 'weapon3': '2.342', 'DAMAGECOUNT': '7.440', 'FRAGCOUNT': '25.000'} [2024-08-05 23:38:39,502][52669] DAMAGECOUNT value on done: 42568.0 [2024-08-05 23:38:39,503][52669] Sum rewards: 25.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon4': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.903', 'WEAPON3': '1.050', 'weapon2': '1.286', 'HITCOUNT': '1.780', 'weapon3': '2.328', 'DAMAGECOUNT': '7.245', 'FRAGCOUNT': '23.000'} [2024-08-05 23:38:39,818][52665] DAMAGECOUNT value on done: 42249.0 [2024-08-05 23:38:39,818][52665] Sum rewards: 33.166, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'ARMOR': '0.800', 'weapon2': '1.028', 'WEAPON3': '1.150', 'HITCOUNT': '2.220', 'weapon3': '2.556', 'DAMAGECOUNT': '9.120', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:39,891][52820] DAMAGECOUNT value on done: 44076.0 [2024-08-05 23:38:39,891][52820] Sum rewards: 35.873, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.364', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon5': '0.080', 'AMMO3': '0.145', 'WEAPON4': '0.350', 'ARMOR': '0.463', 'weapon4': '0.558', 'weapon2': '0.988', 'WEAPON3': '1.000', 'weapon3': '2.142', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.577', 'FRAGCOUNT': '32.000'} [2024-08-05 23:38:42,129][52667] DAMAGECOUNT value on done: 44952.0 [2024-08-05 23:38:42,130][52667] Sum rewards: 28.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.496', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.070', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.211', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '1.134', 'WEAPON3': '1.400', 'weapon3': '2.266', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '25.000'} [2024-08-05 23:38:42,476][52669] DAMAGECOUNT value on done: 46613.0 [2024-08-05 23:38:42,478][52669] Sum rewards: 32.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.042', 'ARMOR': '0.080', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.400', 'weapon4': '0.708', 'weapon2': '0.980', 'WEAPON3': '1.050', 'weapon3': '2.028', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '9.942', 'FRAGCOUNT': '28.000'} [2024-08-05 23:38:42,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.6, 300 sec: 17550.3). Total num frames: 135315456. Throughput: 0: 4378.2. Samples: 33838710. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:38:42,795][52567] Avg episode reward: [(0, '35.415')] [2024-08-05 23:38:42,938][52820] DAMAGECOUNT value on done: 45603.0 [2024-08-05 23:38:42,940][52820] Sum rewards: 40.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.257', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.040', 'weapon4': '0.046', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '1.192', 'WEAPON3': '1.200', 'ARMOR': '1.275', 'HITCOUNT': '2.410', 'weapon3': '2.518', 'DAMAGECOUNT': '10.764', 'FRAGCOUNT': '34.000'} [2024-08-05 23:38:43,088][52665] DAMAGECOUNT value on done: 43039.0 [2024-08-05 23:38:43,092][52665] Sum rewards: 33.656, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.035', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.205', 'weapon4': '0.240', 'WEAPON4': '0.400', 'weapon2': '1.034', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.452', 'DAMAGECOUNT': '9.465', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:43,623][52650] Updated weights for policy 0, policy_version 16521 (0.0042) [2024-08-05 23:38:44,464][52666] DAMAGECOUNT value on done: 43219.0 [2024-08-05 23:38:44,467][52666] Sum rewards: 43.908, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.033', 'AMMO3': '0.131', 'AMMO4': '0.163', 'weapon4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.528', 'WEAPON3': '0.850', 'weapon2': '1.056', 'weapon3': '2.434', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:44,950][52669] DAMAGECOUNT value on done: 47464.0 [2024-08-05 23:38:44,952][52669] Sum rewards: 40.769, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.353', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.490', 'WEAPON3': '0.800', 'weapon2': '0.854', 'ARMOR': '0.895', 'weapon3': '2.278', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.494', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:44,978][52647] DAMAGECOUNT value on done: 46009.0 [2024-08-05 23:38:44,978][52647] Sum rewards: 26.311, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.094', 'AMMO3': '0.097', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.650', 'ARMOR': '0.945', 'weapon2': '1.060', 'HITCOUNT': '1.440', 'weapon3': '1.784', 'DAMAGECOUNT': '5.607', 'FRAGCOUNT': '20.000'} [2024-08-05 23:38:45,573][52667] DAMAGECOUNT value on done: 46604.0 [2024-08-05 23:38:45,574][52667] Sum rewards: 34.754, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.074', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.068', 'AMMO4': '0.136', 'AMMO3': '0.172', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.498', 'ARMOR': '0.512', 'weapon4': '0.808', 'WEAPON3': '1.050', 'weapon3': '2.364', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.200', 'FRAGCOUNT': '28.000'} [2024-08-05 23:38:46,236][52665] DAMAGECOUNT value on done: 47036.0 [2024-08-05 23:38:46,237][52665] Sum rewards: 35.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.009', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '1.006', 'WEAPON3': '1.050', 'ARMOR': '1.697', 'HITCOUNT': '2.180', 'weapon3': '2.426', 'DAMAGECOUNT': '9.492', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:46,358][52820] DAMAGECOUNT value on done: 43163.0 [2024-08-05 23:38:46,361][52820] Sum rewards: 28.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.268', 'WEAPON4': '0.300', 'ARMOR': '0.491', 'weapon2': '1.022', 'WEAPON3': '1.150', 'HITCOUNT': '2.220', 'weapon3': '2.356', 'DAMAGECOUNT': '9.210', 'FRAGCOUNT': '26.500'} [2024-08-05 23:38:47,668][52666] DAMAGECOUNT value on done: 44518.0 [2024-08-05 23:38:47,669][52666] Sum rewards: 29.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.078', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.450', 'HITCOUNT': '2.240', 'weapon3': '2.772', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '28.000'} [2024-08-05 23:38:47,719][52647] DAMAGECOUNT value on done: 46992.0 [2024-08-05 23:38:47,719][52647] Sum rewards: 38.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'ARMOR': '0.910', 'weapon2': '0.970', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.718', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:47,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 135413760. Throughput: 0: 4365.3. Samples: 33851420. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:38:47,795][52567] Avg episode reward: [(0, '35.431')] [2024-08-05 23:38:47,966][52669] DAMAGECOUNT value on done: 47237.0 [2024-08-05 23:38:47,969][52669] Sum rewards: 43.220, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'ARMOR': '0.474', 'weapon2': '1.120', 'WEAPON3': '1.200', 'weapon3': '2.624', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '10.842', 'FRAGCOUNT': '36.000'} [2024-08-05 23:38:48,184][52650] Updated weights for policy 0, policy_version 16531 (0.0019) [2024-08-05 23:38:48,432][52667] DAMAGECOUNT value on done: 46484.0 [2024-08-05 23:38:48,434][52667] Sum rewards: 44.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.400', 'weapon4': '0.540', 'weapon2': '0.832', 'ARMOR': '0.864', 'WEAPON3': '1.100', 'weapon3': '2.306', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '39.000'} [2024-08-05 23:38:49,161][52665] DAMAGECOUNT value on done: 47403.0 [2024-08-05 23:38:49,162][52665] Sum rewards: 52.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.629', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon4': '0.146', 'AMMO3': '0.195', 'weapon2': '0.636', 'WEAPON3': '1.250', 'ARMOR': '1.255', 'weapon3': '2.994', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '44.000'} [2024-08-05 23:38:49,746][52663] DAMAGECOUNT value on done: 46732.0 [2024-08-05 23:38:49,747][52663] Sum rewards: 29.084, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.296', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon4': '0.308', 'WEAPON3': '0.900', 'weapon2': '1.134', 'ARMOR': '1.358', 'weapon3': '2.266', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '8.826', 'FRAGCOUNT': '25.000'} [2024-08-05 23:38:50,334][52647] DAMAGECOUNT value on done: 51254.0 [2024-08-05 23:38:50,334][52647] Sum rewards: 42.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.566', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.122', 'AMMO4': '0.132', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'ARMOR': '0.879', 'weapon2': '0.914', 'WEAPON3': '1.400', 'HITCOUNT': '2.290', 'weapon3': '2.696', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '39.000'} [2024-08-05 23:38:50,573][52666] DAMAGECOUNT value on done: 43125.0 [2024-08-05 23:38:50,576][52666] Sum rewards: 31.005, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.879', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.179', 'AMMO4': '0.205', 'weapon5': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.544', 'weapon2': '0.612', 'ARMOR': '0.850', 'WEAPON3': '1.050', 'HITCOUNT': '1.900', 'weapon3': '2.150', 'DAMAGECOUNT': '8.583', 'FRAGCOUNT': '27.000'} [2024-08-05 23:38:50,981][52669] DAMAGECOUNT value on done: 45867.0 [2024-08-05 23:38:50,982][52669] Sum rewards: 31.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.082', 'AMMO5': '0.007', 'weapon5': '0.044', 'AMMO2': '0.049', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.244', 'weapon4': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'ARMOR': '0.876', 'weapon2': '1.460', 'weapon3': '1.918', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '8.613', 'FRAGCOUNT': '27.000'} [2024-08-05 23:38:51,247][52658] DAMAGECOUNT value on done: 46352.0 [2024-08-05 23:38:51,247][52658] Sum rewards: 32.492, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.786', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.165', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'ARMOR': '0.462', 'weapon2': '0.620', 'WEAPON3': '1.550', 'HITCOUNT': '2.450', 'weapon3': '3.042', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:51,416][52667] DAMAGECOUNT value on done: 44955.0 [2024-08-05 23:38:51,418][52667] Sum rewards: 47.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.056', 'AMMO4': '0.184', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'ARMOR': '0.442', 'WEAPON4': '0.500', 'weapon2': '0.526', 'weapon4': '0.746', 'WEAPON3': '1.450', 'weapon3': '2.352', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '42.000'} [2024-08-05 23:38:51,495][52670] DAMAGECOUNT value on done: 44359.0 [2024-08-05 23:38:51,497][52670] Sum rewards: 44.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.145', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'ARMOR': '0.415', 'weapon2': '1.014', 'WEAPON3': '1.050', 'HITCOUNT': '2.410', 'weapon3': '2.674', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '37.000'} [2024-08-05 23:38:51,693][52665] DAMAGECOUNT value on done: 47153.0 [2024-08-05 23:38:51,694][52665] Sum rewards: 41.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.650', 'weapon2': '0.748', 'ARMOR': '0.943', 'WEAPON3': '1.150', 'weapon3': '2.372', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.230', 'FRAGCOUNT': '36.000'} [2024-08-05 23:38:52,306][52803] DAMAGECOUNT value on done: 43636.0 [2024-08-05 23:38:52,316][52803] Sum rewards: 42.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.867', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.014', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.153', 'weapon4': '0.204', 'WEAPON4': '0.350', 'weapon2': '0.640', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '2.872', 'DAMAGECOUNT': '10.497', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:52,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 135495680. Throughput: 0: 4375.8. Samples: 33878080. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:38:52,794][52567] Avg episode reward: [(0, '36.340')] [2024-08-05 23:38:52,795][52614] Saving new best policy, reward=36.340! [2024-08-05 23:38:52,939][52663] DAMAGECOUNT value on done: 45178.0 [2024-08-05 23:38:52,939][52663] Sum rewards: 38.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.237', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.602', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '2.684', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:53,020][52650] Updated weights for policy 0, policy_version 16541 (0.0016) [2024-08-05 23:38:53,389][52666] DAMAGECOUNT value on done: 42287.0 [2024-08-05 23:38:53,391][52666] Sum rewards: 41.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.959', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.142', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.388', 'WEAPON3': '0.900', 'weapon2': '1.186', 'weapon3': '2.240', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.032', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:53,500][52647] DAMAGECOUNT value on done: 47290.0 [2024-08-05 23:38:53,501][52647] Sum rewards: 38.071, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.941', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.194', 'ARMOR': '0.484', 'weapon2': '1.096', 'WEAPON3': '1.250', 'weapon3': '2.390', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '9.996', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:54,170][52669] DAMAGECOUNT value on done: 46760.0 [2024-08-05 23:38:54,172][52669] Sum rewards: 35.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.212', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon4': '0.210', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'ARMOR': '0.905', 'weapon2': '0.912', 'WEAPON3': '1.450', 'HITCOUNT': '2.310', 'weapon3': '2.634', 'DAMAGECOUNT': '9.900', 'FRAGCOUNT': '34.000'} [2024-08-05 23:38:54,217][52670] DAMAGECOUNT value on done: 45605.0 [2024-08-05 23:38:54,221][52670] Sum rewards: 35.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.554', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon4': '0.116', 'AMMO3': '0.230', 'ARMOR': '0.870', 'weapon2': '1.258', 'WEAPON3': '1.350', 'weapon3': '2.282', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '32.000'} [2024-08-05 23:38:54,322][52658] DAMAGECOUNT value on done: 44858.0 [2024-08-05 23:38:54,322][52658] Sum rewards: 25.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.919', 'AMMO5': '0.004', 'AMMO2': '0.033', 'weapon5': '0.042', 'weapon7': '0.076', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.165', 'WEAPON7': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.450', 'weapon4': '0.606', 'weapon2': '0.738', 'ARMOR': '0.932', 'WEAPON3': '1.400', 'HITCOUNT': '2.080', 'weapon3': '2.332', 'DAMAGECOUNT': '7.851', 'FRAGCOUNT': '25.000'} [2024-08-05 23:38:54,501][52667] DAMAGECOUNT value on done: 43456.0 [2024-08-05 23:38:54,502][52667] Sum rewards: 29.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.476', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.165', 'AMMO3': '0.182', 'weapon4': '0.286', 'ARMOR': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.922', 'WEAPON3': '1.150', 'HITCOUNT': '1.920', 'weapon3': '2.340', 'DAMAGECOUNT': '8.268', 'FRAGCOUNT': '27.000'} [2024-08-05 23:38:54,628][52665] DAMAGECOUNT value on done: 46473.0 [2024-08-05 23:38:54,628][52665] Sum rewards: 34.929, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'weapon5': '0.006', 'weapon4': '0.022', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON3': '1.200', 'ARMOR': '1.345', 'weapon2': '1.356', 'weapon3': '2.418', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.579', 'FRAGCOUNT': '29.000'} [2024-08-05 23:38:55,463][52803] DAMAGECOUNT value on done: 46491.0 [2024-08-05 23:38:55,463][52803] Sum rewards: 39.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.364', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.181', 'ARMOR': '0.920', 'WEAPON3': '1.100', 'weapon2': '1.290', 'weapon3': '2.278', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.373', 'FRAGCOUNT': '33.000'} [2024-08-05 23:38:56,090][52663] DAMAGECOUNT value on done: 46783.0 [2024-08-05 23:38:56,090][52663] Sum rewards: 42.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.239', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'ARMOR': '0.400', 'weapon4': '0.440', 'weapon2': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.650', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '37.000'} [2024-08-05 23:38:56,096][52666] DAMAGECOUNT value on done: 43880.0 [2024-08-05 23:38:56,098][52666] Sum rewards: 42.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.652', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.234', 'ARMOR': '0.800', 'weapon2': '1.168', 'WEAPON3': '1.400', 'weapon3': '2.618', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '38.000'} [2024-08-05 23:38:56,619][52647] DAMAGECOUNT value on done: 48640.0 [2024-08-05 23:38:56,619][52647] Sum rewards: 33.479, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.505', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.189', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '1.044', 'WEAPON3': '1.250', 'HITCOUNT': '2.130', 'weapon3': '2.450', 'DAMAGECOUNT': '8.469', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:56,982][52658] DAMAGECOUNT value on done: 45021.0 [2024-08-05 23:38:56,983][52658] Sum rewards: 41.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.383', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.480', 'weapon2': '0.792', 'ARMOR': '0.856', 'WEAPON3': '1.300', 'weapon3': '2.446', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '36.000'} [2024-08-05 23:38:57,053][52670] DAMAGECOUNT value on done: 45716.0 [2024-08-05 23:38:57,053][52670] Sum rewards: 46.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.866', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.189', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.410', 'weapon2': '0.536', 'ARMOR': '0.856', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '2.676', 'DAMAGECOUNT': '10.743', 'FRAGCOUNT': '40.000'} [2024-08-05 23:38:57,146][52667] DAMAGECOUNT value on done: 46149.0 [2024-08-05 23:38:57,148][52667] Sum rewards: 30.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.096', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.388', 'weapon2': '0.572', 'WEAPON3': '1.200', 'ARMOR': '1.311', 'HITCOUNT': '2.240', 'weapon3': '2.388', 'DAMAGECOUNT': '9.192', 'FRAGCOUNT': '27.500'} [2024-08-05 23:38:57,324][52669] DAMAGECOUNT value on done: 43895.0 [2024-08-05 23:38:57,326][52669] Sum rewards: 30.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.388', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.056', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'ARMOR': '0.444', 'weapon2': '0.478', 'WEAPON4': '0.600', 'weapon4': '0.764', 'WEAPON3': '1.150', 'weapon3': '2.094', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.736', 'FRAGCOUNT': '28.000'} [2024-08-05 23:38:57,535][52650] Updated weights for policy 0, policy_version 16551 (0.0012) [2024-08-05 23:38:57,593][52665] DAMAGECOUNT value on done: 46806.0 [2024-08-05 23:38:57,594][52665] Sum rewards: 35.740, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.182', 'WEAPON5': '0.200', 'ARMOR': '0.442', 'WEAPON3': '1.100', 'weapon2': '1.166', 'HITCOUNT': '2.040', 'weapon3': '2.368', 'DAMAGECOUNT': '8.502', 'FRAGCOUNT': '31.000'} [2024-08-05 23:38:57,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 135585792. Throughput: 0: 4373.8. Samples: 33904210. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 23:38:57,794][52567] Avg episode reward: [(0, '36.167')] [2024-08-05 23:38:58,535][52803] DAMAGECOUNT value on done: 42290.0 [2024-08-05 23:38:58,537][52803] Sum rewards: 37.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'ARMOR': '0.040', 'AMMO2': '0.041', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'AMMO4': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.678', 'weapon4': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.270', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:58,812][52666] DAMAGECOUNT value on done: 43862.0 [2024-08-05 23:38:58,812][52666] Sum rewards: 39.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.567', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.082', 'weapon4': '0.112', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'weapon2': '0.882', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.636', 'DAMAGECOUNT': '9.819', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:59,036][52647] DAMAGECOUNT value on done: 49341.0 [2024-08-05 23:38:59,036][52647] Sum rewards: 37.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.158', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.225', 'ARMOR': '0.930', 'weapon2': '0.962', 'WEAPON3': '1.400', 'HITCOUNT': '2.490', 'weapon3': '2.654', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '35.000'} [2024-08-05 23:38:59,180][52663] DAMAGECOUNT value on done: 46390.0 [2024-08-05 23:38:59,182][52663] Sum rewards: 45.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.332', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.122', 'AMMO4': '0.143', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON4': '0.450', 'ARMOR': '0.493', 'weapon2': '0.514', 'WEAPON3': '1.400', 'HITCOUNT': '2.470', 'weapon3': '2.628', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '41.000'} [2024-08-05 23:38:59,325][52811] DAMAGECOUNT value on done: 43723.0 [2024-08-05 23:38:59,325][52811] Sum rewards: 29.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.577', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'AMMO4': '0.193', 'weapon4': '0.198', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'ARMOR': '1.229', 'weapon2': '1.258', 'weapon3': '2.336', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '26.000'} [2024-08-05 23:38:59,913][52658] DAMAGECOUNT value on done: 43525.0 [2024-08-05 23:38:59,917][52658] Sum rewards: 34.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.503', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.172', 'weapon4': '0.192', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon2': '1.224', 'ARMOR': '1.255', 'weapon3': '2.062', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '9.081', 'FRAGCOUNT': '30.000'} [2024-08-05 23:38:59,987][52670] DAMAGECOUNT value on done: 42761.0 [2024-08-05 23:38:59,988][52670] Sum rewards: 26.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.304', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.086', 'AMMO4': '0.111', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '1.026', 'ARMOR': '1.292', 'WEAPON3': '1.300', 'HITCOUNT': '1.880', 'weapon3': '2.482', 'DAMAGECOUNT': '8.004', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:00,146][52667] DAMAGECOUNT value on done: 44360.0 [2024-08-05 23:39:00,146][52667] Sum rewards: 30.750, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'HEALTH': '0.020', 'weapon5': '0.052', 'ARMOR': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.236', 'WEAPON3': '0.850', 'weapon2': '0.914', 'HITCOUNT': '2.040', 'weapon3': '2.118', 'DAMAGECOUNT': '7.923', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:00,427][52669] DAMAGECOUNT value on done: 46508.0 [2024-08-05 23:39:00,429][52669] Sum rewards: 38.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO2': '0.014', 'ARMOR': '0.024', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.432', 'weapon2': '0.746', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.614', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:00,628][52665] DAMAGECOUNT value on done: 43499.0 [2024-08-05 23:39:00,629][52665] Sum rewards: 32.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.289', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '1.082', 'WEAPON3': '1.250', 'ARMOR': '1.315', 'HITCOUNT': '2.110', 'weapon3': '2.554', 'DAMAGECOUNT': '8.994', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:01,322][52647] DAMAGECOUNT value on done: 46678.0 [2024-08-05 23:39:01,322][52647] Sum rewards: 37.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.662', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.140', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.462', 'weapon2': '0.796', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '2.350', 'DAMAGECOUNT': '8.868', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:01,611][52803] DAMAGECOUNT value on done: 41529.0 [2024-08-05 23:39:01,611][52803] Sum rewards: 33.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.232', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.097', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.394', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '1.172', 'weapon3': '2.048', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '9.396', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:01,657][52666] DAMAGECOUNT value on done: 42887.0 [2024-08-05 23:39:01,658][52666] Sum rewards: 19.586, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.131', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'HEALTH': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.438', 'ARMOR': '0.479', 'WEAPON3': '0.700', 'weapon2': '1.280', 'HITCOUNT': '1.420', 'weapon3': '1.854', 'DAMAGECOUNT': '5.886', 'FRAGCOUNT': '16.000'} [2024-08-05 23:39:02,187][52663] DAMAGECOUNT value on done: 44321.0 [2024-08-05 23:39:02,188][52663] Sum rewards: 42.778, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.051', 'weapon4': '0.058', 'weapon5': '0.076', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.460', 'weapon2': '0.842', 'WEAPON3': '1.300', 'HITCOUNT': '2.460', 'weapon3': '2.722', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:02,421][52811] DAMAGECOUNT value on done: 40988.0 [2024-08-05 23:39:02,424][52811] Sum rewards: 36.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.671', 'AMMO5': '0.012', 'weapon5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.168', 'AMMO4': '0.213', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.874', 'ARMOR': '0.972', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.692', 'DAMAGECOUNT': '10.431', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:02,503][52650] Updated weights for policy 0, policy_version 16561 (0.0022) [2024-08-05 23:39:02,711][52670] DAMAGECOUNT value on done: 42948.0 [2024-08-05 23:39:02,711][52670] Sum rewards: 34.585, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.134', 'weapon4': '0.152', 'ARMOR': '0.408', 'HEALTH': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.462', 'HITCOUNT': '2.050', 'weapon3': '2.194', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 135675904. Throughput: 0: 4374.9. Samples: 33917570. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 23:39:02,794][52567] Avg episode reward: [(0, '35.905')] [2024-08-05 23:39:02,863][52658] DAMAGECOUNT value on done: 47036.0 [2024-08-05 23:39:02,865][52658] Sum rewards: 40.497, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.512', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO3': '0.151', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.706', 'WEAPON3': '1.000', 'weapon3': '2.496', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.789', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:03,161][52667] DAMAGECOUNT value on done: 47314.0 [2024-08-05 23:39:03,161][52667] Sum rewards: 31.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.044', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'AMMO4': '0.290', 'weapon4': '0.364', 'ARMOR': '0.512', 'WEAPON4': '0.600', 'weapon2': '0.790', 'WEAPON3': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.562', 'DAMAGECOUNT': '8.442', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:03,293][52665] DAMAGECOUNT value on done: 43262.0 [2024-08-05 23:39:03,294][52665] Sum rewards: 47.415, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.124', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.932', 'WEAPON3': '1.100', 'ARMOR': '1.312', 'weapon3': '2.546', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.404', 'FRAGCOUNT': '39.000'} [2024-08-05 23:39:04,144][52665] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:39:04,343][52647] DAMAGECOUNT value on done: 50229.0 [2024-08-05 23:39:04,344][52647] Sum rewards: 41.977, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.080', 'AMMO3': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.614', 'WEAPON3': '0.800', 'weapon2': '1.018', 'weapon3': '2.004', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '9.912', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:04,751][52803] DAMAGECOUNT value on done: 45734.0 [2024-08-05 23:39:04,751][52803] Sum rewards: 36.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.722', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.110', 'weapon4': '0.118', 'AMMO4': '0.194', 'AMMO3': '0.203', 'WEAPON5': '0.350', 'ARMOR': '0.422', 'WEAPON4': '0.450', 'weapon2': '0.602', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '2.886', 'DAMAGECOUNT': '10.533', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:04,811][52666] DAMAGECOUNT value on done: 43865.0 [2024-08-05 23:39:04,812][52666] Sum rewards: 36.336, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.898', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon5': '0.152', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.414', 'weapon2': '0.922', 'WEAPON3': '1.000', 'ARMOR': '1.356', 'HITCOUNT': '2.100', 'weapon3': '2.220', 'DAMAGECOUNT': '8.580', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:05,242][52663] DAMAGECOUNT value on done: 47543.0 [2024-08-05 23:39:05,242][52663] Sum rewards: 38.274, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.156', 'ARMOR': '0.447', 'weapon2': '0.860', 'WEAPON3': '1.050', 'HITCOUNT': '2.190', 'weapon3': '2.628', 'DAMAGECOUNT': '9.240', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:05,436][52811] DAMAGECOUNT value on done: 42980.0 [2024-08-05 23:39:05,436][52811] Sum rewards: 25.028, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.729', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon7': '0.058', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.175', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'WEAPON3': '0.500', 'weapon2': '0.510', 'weapon4': '0.656', 'HITCOUNT': '1.450', 'weapon3': '1.490', 'DAMAGECOUNT': '6.090', 'FRAGCOUNT': '20.000'} [2024-08-05 23:39:05,663][52658] DAMAGECOUNT value on done: 42950.0 [2024-08-05 23:39:05,665][52658] Sum rewards: 34.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.192', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.150', 'WEAPON3': '1.050', 'ARMOR': '1.289', 'weapon2': '1.296', 'HITCOUNT': '2.200', 'weapon3': '2.278', 'DAMAGECOUNT': '9.105', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:05,781][52670] DAMAGECOUNT value on done: 47387.0 [2024-08-05 23:39:05,782][52670] Sum rewards: 41.539, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.352', 'ARMOR': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.278', 'weapon2': '0.856', 'WEAPON3': '1.000', 'HITCOUNT': '2.230', 'weapon3': '2.650', 'DAMAGECOUNT': '10.188', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:05,938][52667] DAMAGECOUNT value on done: 49059.0 [2024-08-05 23:39:05,939][52667] Sum rewards: 38.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.056', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.756', 'WEAPON3': '1.400', 'HITCOUNT': '2.310', 'weapon3': '2.884', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:06,504][52665] DAMAGECOUNT value on done: 45436.0 [2024-08-05 23:39:06,506][52665] Sum rewards: 36.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.548', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'weapon4': '0.194', 'AMMO3': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.698', 'ARMOR': '0.909', 'WEAPON3': '1.350', 'HITCOUNT': '2.430', 'weapon3': '2.722', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:06,928][52650] Updated weights for policy 0, policy_version 16571 (0.0014) [2024-08-05 23:39:07,294][52647] DAMAGECOUNT value on done: 50194.0 [2024-08-05 23:39:07,295][52647] Sum rewards: 40.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.021', 'ARMOR': '0.040', 'weapon4': '0.074', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.742', 'WEAPON3': '1.400', 'HITCOUNT': '2.290', 'weapon3': '2.890', 'DAMAGECOUNT': '10.812', 'FRAGCOUNT': '36.000'} [2024-08-05 23:39:07,326][52666] DAMAGECOUNT value on done: 44665.0 [2024-08-05 23:39:07,328][52666] Sum rewards: 35.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.114', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.330', 'WEAPON4': '0.350', 'ARMOR': '0.487', 'weapon2': '0.744', 'WEAPON3': '1.150', 'HITCOUNT': '2.230', 'weapon3': '2.458', 'DAMAGECOUNT': '9.846', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:07,719][52803] DAMAGECOUNT value on done: 40341.0 [2024-08-05 23:39:07,722][52803] Sum rewards: 33.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.902', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'weapon4': '0.482', 'WEAPON3': '0.950', 'weapon2': '0.964', 'HITCOUNT': '2.150', 'weapon3': '2.284', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '27.000'} [2024-08-05 23:39:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 135757824. Throughput: 0: 4375.6. Samples: 33944070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 23:39:07,794][52567] Avg episode reward: [(0, '36.244')] [2024-08-05 23:39:08,290][52670] DAMAGECOUNT value on done: 42887.0 [2024-08-05 23:39:08,291][52670] Sum rewards: 44.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.192', 'weapon4': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'ARMOR': '0.894', 'WEAPON3': '1.000', 'weapon2': '1.396', 'weapon3': '2.432', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '38.000'} [2024-08-05 23:39:08,414][52663] DAMAGECOUNT value on done: 49346.0 [2024-08-05 23:39:08,414][52663] Sum rewards: 44.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.216', 'ARMOR': '0.436', 'weapon2': '0.684', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.118', 'FRAGCOUNT': '39.000'} [2024-08-05 23:39:08,745][52811] DAMAGECOUNT value on done: 41509.0 [2024-08-05 23:39:08,747][52811] Sum rewards: 31.222, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.074', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon5': '0.046', 'weapon4': '0.140', 'AMMO4': '0.165', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.764', 'ARMOR': '0.870', 'WEAPON3': '1.400', 'HITCOUNT': '2.020', 'weapon3': '2.720', 'DAMAGECOUNT': '8.280', 'FRAGCOUNT': '30.000'} [2024-08-05 23:39:08,904][52658] DAMAGECOUNT value on done: 49827.0 [2024-08-05 23:39:08,904][52658] Sum rewards: 31.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.056', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'AMMO3': '0.235', 'weapon4': '0.288', 'WEAPON4': '0.300', 'ARMOR': '0.477', 'weapon2': '0.948', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '2.430', 'DAMAGECOUNT': '9.069', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:09,109][52667] DAMAGECOUNT value on done: 46691.0 [2024-08-05 23:39:09,112][52667] Sum rewards: 37.779, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.390', 'ARMOR': '0.440', 'weapon2': '0.768', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '2.468', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '36.000'} [2024-08-05 23:39:09,508][52665] DAMAGECOUNT value on done: 43937.0 [2024-08-05 23:39:09,512][52665] Sum rewards: 30.737, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.062', 'AMMO4': '0.175', 'AMMO3': '0.232', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.876', 'ARMOR': '0.912', 'WEAPON3': '1.450', 'HITCOUNT': '2.110', 'weapon3': '2.520', 'DAMAGECOUNT': '9.030', 'FRAGCOUNT': '30.000'} [2024-08-05 23:39:09,959][52666] DAMAGECOUNT value on done: 45426.0 [2024-08-05 23:39:09,959][52666] Sum rewards: 50.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.118', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.088', 'AMMO3': '0.185', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '1.020', 'WEAPON3': '1.150', 'weapon3': '2.442', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '44.000'} [2024-08-05 23:39:09,977][52647] DAMAGECOUNT value on done: 48105.0 [2024-08-05 23:39:09,978][52647] Sum rewards: 36.312, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.154', 'weapon4': '0.184', 'WEAPON3': '0.950', 'ARMOR': '1.306', 'weapon2': '1.332', 'HITCOUNT': '2.260', 'weapon3': '2.326', 'DAMAGECOUNT': '9.297', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:10,766][52803] DAMAGECOUNT value on done: 46175.0 [2024-08-05 23:39:10,767][52803] Sum rewards: 40.340, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.882', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.094', 'ARMOR': '1.320', 'weapon3': '2.544', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:10,969][52670] DAMAGECOUNT value on done: 43528.0 [2024-08-05 23:39:10,969][52670] Sum rewards: 28.982, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.026', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'WEAPON3': '1.000', 'ARMOR': '1.250', 'weapon2': '1.362', 'HITCOUNT': '2.090', 'weapon3': '2.332', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '23.500'} [2024-08-05 23:39:11,117][52663] DAMAGECOUNT value on done: 45034.0 [2024-08-05 23:39:11,118][52663] Sum rewards: 53.673, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.816', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon4': '0.474', 'weapon2': '0.496', 'ARMOR': '0.877', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '47.000'} [2024-08-05 23:39:11,579][52650] Updated weights for policy 0, policy_version 16581 (0.0026) [2024-08-05 23:39:11,587][52658] DAMAGECOUNT value on done: 44229.0 [2024-08-05 23:39:11,589][52658] Sum rewards: 36.449, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.004', 'weapon5': '0.026', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.214', 'weapon4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.798', 'ARMOR': '0.800', 'WEAPON3': '1.150', 'HITCOUNT': '2.420', 'weapon3': '2.652', 'DAMAGECOUNT': '9.732', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:11,746][52667] DAMAGECOUNT value on done: 48358.0 [2024-08-05 23:39:11,748][52667] Sum rewards: 46.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.741', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon4': '0.294', 'weapon2': '0.646', 'WEAPON3': '1.250', 'ARMOR': '1.272', 'HITCOUNT': '2.780', 'weapon3': '2.836', 'DAMAGECOUNT': '11.151', 'FRAGCOUNT': '41.000'} [2024-08-05 23:39:11,791][52811] DAMAGECOUNT value on done: 42524.0 [2024-08-05 23:39:11,793][52811] Sum rewards: 37.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.181', 'weapon4': '0.226', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'weapon2': '0.714', 'ARMOR': '1.279', 'WEAPON3': '1.500', 'HITCOUNT': '2.370', 'weapon3': '2.740', 'DAMAGECOUNT': '9.900', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:12,280][52665] DAMAGECOUNT value on done: 44663.0 [2024-08-05 23:39:12,282][52665] Sum rewards: 29.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.790', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.221', 'weapon2': '0.972', 'ARMOR': '1.381', 'WEAPON3': '1.500', 'HITCOUNT': '2.390', 'weapon3': '2.638', 'DAMAGECOUNT': '9.366', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:12,512][52671] DAMAGECOUNT value on done: 50150.0 [2024-08-05 23:39:12,512][52671] Sum rewards: 43.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.052', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.192', 'WEAPON4': '0.450', 'weapon4': '0.484', 'weapon2': '0.608', 'WEAPON3': '1.200', 'ARMOR': '1.837', 'weapon3': '2.560', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '36.000'} [2024-08-05 23:39:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 135847936. Throughput: 0: 4376.2. Samples: 33970450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 23:39:12,794][52567] Avg episode reward: [(0, '36.609')] [2024-08-05 23:39:12,795][52614] Saving new best policy, reward=36.609! [2024-08-05 23:39:12,887][52647] DAMAGECOUNT value on done: 47515.0 [2024-08-05 23:39:12,887][52647] Sum rewards: 33.061, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.401', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'ARMOR': '0.884', 'weapon2': '0.916', 'WEAPON3': '0.950', 'HITCOUNT': '2.130', 'weapon3': '2.788', 'DAMAGECOUNT': '8.436', 'FRAGCOUNT': '27.000'} [2024-08-05 23:39:13,347][52666] DAMAGECOUNT value on done: 42189.0 [2024-08-05 23:39:13,350][52666] Sum rewards: 37.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.178', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.062', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '1.034', 'WEAPON3': '1.550', 'ARMOR': '1.752', 'HITCOUNT': '2.440', 'weapon3': '2.588', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:13,823][52803] DAMAGECOUNT value on done: 42849.0 [2024-08-05 23:39:13,824][52803] Sum rewards: 24.894, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.642', 'ARMOR': '0.028', 'AMMO2': '0.036', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.550', 'weapon4': '0.560', 'weapon2': '0.738', 'WEAPON3': '1.350', 'HITCOUNT': '1.780', 'weapon3': '2.312', 'DAMAGECOUNT': '7.284', 'FRAGCOUNT': '27.000'} [2024-08-05 23:39:14,347][52663] DAMAGECOUNT value on done: 45718.0 [2024-08-05 23:39:14,347][52663] Sum rewards: 30.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.442', 'AMMO5': '0.010', 'AMMO2': '0.040', 'ARMOR': '0.052', 'weapon5': '0.056', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon4': '0.280', 'WEAPON4': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.450', 'HITCOUNT': '2.340', 'weapon3': '2.658', 'DAMAGECOUNT': '9.381', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:14,493][52658] DAMAGECOUNT value on done: 47447.0 [2024-08-05 23:39:14,494][52658] Sum rewards: 26.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.538', 'AMMO5': '0.003', 'weapon7': '0.038', 'weapon5': '0.046', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.143', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.264', 'ARMOR': '0.472', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon2': '1.344', 'HITCOUNT': '2.060', 'weapon3': '2.130', 'DAMAGECOUNT': '8.154', 'FRAGCOUNT': '24.000'} [2024-08-05 23:39:14,539][52670] DAMAGECOUNT value on done: 42722.0 [2024-08-05 23:39:14,540][52670] Sum rewards: 46.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.415', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.210', 'ARMOR': '0.448', 'weapon2': '0.940', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '2.784', 'DAMAGECOUNT': '10.407', 'FRAGCOUNT': '44.000'} [2024-08-05 23:39:14,595][52667] DAMAGECOUNT value on done: 45556.0 [2024-08-05 23:39:14,595][52667] Sum rewards: 29.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO3': '0.157', 'AMMO4': '0.204', 'WEAPON4': '0.450', 'weapon4': '0.460', 'weapon2': '0.620', 'WEAPON3': '1.000', 'HITCOUNT': '2.190', 'weapon3': '2.710', 'DAMAGECOUNT': '8.091', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:14,948][52671] DAMAGECOUNT value on done: 46967.0 [2024-08-05 23:39:14,950][52671] Sum rewards: 44.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.730', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '2.860', 'DAMAGECOUNT': '11.889', 'FRAGCOUNT': '39.000'} [2024-08-05 23:39:14,966][52811] DAMAGECOUNT value on done: 44145.0 [2024-08-05 23:39:14,966][52811] Sum rewards: 30.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.035', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'ARMOR': '0.400', 'weapon2': '0.966', 'WEAPON3': '1.400', 'HITCOUNT': '2.410', 'weapon3': '2.738', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:15,136][52665] DAMAGECOUNT value on done: 43491.0 [2024-08-05 23:39:15,136][52665] Sum rewards: 29.668, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.946', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon7': '0.068', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.164', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'weapon2': '0.742', 'WEAPON3': '1.050', 'HITCOUNT': '1.730', 'weapon3': '2.600', 'DAMAGECOUNT': '8.013', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:15,758][52647] DAMAGECOUNT value on done: 44493.0 [2024-08-05 23:39:15,760][52647] Sum rewards: 32.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.554', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'ARMOR': '0.951', 'WEAPON3': '1.000', 'weapon2': '1.468', 'HITCOUNT': '2.070', 'weapon3': '2.238', 'DAMAGECOUNT': '8.883', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:16,189][52650] Updated weights for policy 0, policy_version 16591 (0.0025) [2024-08-05 23:39:16,673][52666] DAMAGECOUNT value on done: 41932.0 [2024-08-05 23:39:16,673][52666] Sum rewards: 36.536, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.097', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.238', 'WEAPON5': '0.250', 'ARMOR': '0.448', 'weapon2': '0.574', 'WEAPON3': '0.950', 'HITCOUNT': '2.120', 'weapon3': '2.520', 'DAMAGECOUNT': '9.216', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:16,847][52803] DAMAGECOUNT value on done: 45200.0 [2024-08-05 23:39:16,847][52803] Sum rewards: 35.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.816', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.183', 'weapon4': '0.322', 'ARMOR': '0.496', 'WEAPON4': '0.500', 'weapon2': '1.028', 'WEAPON3': '1.250', 'weapon3': '2.424', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.109', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:17,102][52658] DAMAGECOUNT value on done: 47660.0 [2024-08-05 23:39:17,102][52658] Sum rewards: 33.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.044', 'weapon7': '0.074', 'AMMO4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.202', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.642', 'WEAPON3': '1.250', 'HITCOUNT': '2.250', 'weapon3': '2.432', 'DAMAGECOUNT': '9.963', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:17,113][52663] DAMAGECOUNT value on done: 48901.0 [2024-08-05 23:39:17,114][52663] Sum rewards: 22.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.605', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.142', 'weapon4': '0.148', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.918', 'weapon2': '0.924', 'WEAPON3': '1.250', 'HITCOUNT': '1.750', 'weapon3': '2.516', 'DAMAGECOUNT': '7.332', 'FRAGCOUNT': '22.000'} [2024-08-05 23:39:17,187][52667] DAMAGECOUNT value on done: 47270.0 [2024-08-05 23:39:17,188][52667] Sum rewards: 34.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO5': '0.008', 'AMMO2': '0.027', 'ARMOR': '0.036', 'weapon5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.090', 'HITCOUNT': '2.490', 'weapon3': '2.518', 'DAMAGECOUNT': '9.663', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:17,661][52670] DAMAGECOUNT value on done: 39486.0 [2024-08-05 23:39:17,661][52670] Sum rewards: 29.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.956', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.070', 'weapon4': '0.076', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'WEAPON3': '1.000', 'ARMOR': '1.200', 'weapon2': '1.436', 'HITCOUNT': '2.050', 'weapon3': '2.262', 'DAMAGECOUNT': '8.604', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 135929856. Throughput: 0: 4383.6. Samples: 33983620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 23:39:17,795][52567] Avg episode reward: [(0, '36.385')] [2024-08-05 23:39:17,809][52671] DAMAGECOUNT value on done: 45848.0 [2024-08-05 23:39:17,811][52671] Sum rewards: 24.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.418', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.896', 'WEAPON3': '1.300', 'HITCOUNT': '1.970', 'weapon3': '2.476', 'DAMAGECOUNT': '8.376', 'FRAGCOUNT': '24.500'} [2024-08-05 23:39:18,083][52811] DAMAGECOUNT value on done: 45195.0 [2024-08-05 23:39:18,093][52811] Sum rewards: 35.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.180', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.778', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '2.566', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:18,188][52647] DAMAGECOUNT value on done: 47672.0 [2024-08-05 23:39:18,188][52647] Sum rewards: 27.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.112', 'AMMO4': '0.131', 'weapon4': '0.146', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.937', 'weapon2': '1.108', 'WEAPON3': '1.200', 'HITCOUNT': '2.010', 'weapon3': '2.390', 'DAMAGECOUNT': '8.958', 'FRAGCOUNT': '27.000'} [2024-08-05 23:39:18,242][52665] DAMAGECOUNT value on done: 43400.0 [2024-08-05 23:39:18,244][52665] Sum rewards: 35.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.516', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.270', 'ARMOR': '0.420', 'weapon2': '0.770', 'WEAPON3': '1.350', 'HITCOUNT': '2.210', 'weapon3': '2.672', 'DAMAGECOUNT': '9.405', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:19,546][52658] DAMAGECOUNT value on done: 46526.0 [2024-08-05 23:39:19,548][52658] Sum rewards: 37.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.346', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.126', 'AMMO3': '0.219', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.776', 'ARMOR': '0.903', 'WEAPON3': '1.350', 'HITCOUNT': '2.320', 'weapon3': '2.510', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:19,797][52666] DAMAGECOUNT value on done: 43230.0 [2024-08-05 23:39:19,797][52666] Sum rewards: 26.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.295', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.177', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.550', 'weapon2': '0.768', 'ARMOR': '0.909', 'WEAPON3': '1.250', 'HITCOUNT': '2.110', 'weapon3': '2.620', 'DAMAGECOUNT': '8.205', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:19,839][52803] DAMAGECOUNT value on done: 41591.0 [2024-08-05 23:39:19,839][52803] Sum rewards: 32.989, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.779', 'AMMO5': '0.006', 'AMMO2': '0.053', 'weapon5': '0.104', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon4': '0.506', 'WEAPON4': '0.600', 'ARMOR': '0.840', 'weapon2': '1.002', 'WEAPON3': '1.100', 'weapon3': '2.164', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.003', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:20,010][52663] DAMAGECOUNT value on done: 45310.0 [2024-08-05 23:39:20,012][52663] Sum rewards: 38.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.180', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.736', 'ARMOR': '0.936', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '2.740', 'DAMAGECOUNT': '10.065', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:20,634][52670] DAMAGECOUNT value on done: 44825.0 [2024-08-05 23:39:20,637][52670] Sum rewards: 30.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.396', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon4': '0.320', 'ARMOR': '0.804', 'weapon2': '0.828', 'WEAPON3': '1.650', 'HITCOUNT': '2.140', 'weapon3': '2.514', 'DAMAGECOUNT': '9.651', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:20,815][52671] DAMAGECOUNT value on done: 43736.0 [2024-08-05 23:39:20,815][52671] Sum rewards: 32.437, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.792', 'AMMO5': '0.011', 'ARMOR': '0.036', 'AMMO2': '0.055', 'weapon5': '0.118', 'AMMO3': '0.227', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.650', 'weapon2': '0.666', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '2.506', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:20,848][52650] Updated weights for policy 0, policy_version 16601 (0.0018) [2024-08-05 23:39:21,091][52647] DAMAGECOUNT value on done: 46754.0 [2024-08-05 23:39:21,091][52647] Sum rewards: 35.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'weapon5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.546', 'WEAPON3': '1.400', 'HITCOUNT': '2.370', 'weapon3': '3.070', 'DAMAGECOUNT': '9.660', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:21,133][52811] DAMAGECOUNT value on done: 40767.0 [2024-08-05 23:39:21,133][52811] Sum rewards: 33.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.054', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.032', 'weapon5': '0.066', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'weapon2': '0.418', 'weapon4': '0.418', 'WEAPON3': '1.450', 'HITCOUNT': '2.620', 'weapon3': '2.808', 'DAMAGECOUNT': '11.226', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:21,378][52665] DAMAGECOUNT value on done: 43982.0 [2024-08-05 23:39:21,379][52665] Sum rewards: 41.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.544', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'ARMOR': '0.800', 'weapon2': '0.996', 'WEAPON3': '1.250', 'HITCOUNT': '2.330', 'weapon3': '2.602', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:22,408][52658] DAMAGECOUNT value on done: 43834.0 [2024-08-05 23:39:22,408][52658] Sum rewards: 39.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.082', 'AMMO4': '0.113', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.250', 'ARMOR': '0.479', 'weapon2': '0.968', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '2.386', 'DAMAGECOUNT': '10.527', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:22,459][52666] DAMAGECOUNT value on done: 43111.0 [2024-08-05 23:39:22,459][52666] Sum rewards: 41.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.472', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO4': '0.107', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.254', 'WEAPON4': '0.350', 'weapon2': '1.088', 'WEAPON3': '1.200', 'ARMOR': '1.200', 'HITCOUNT': '2.280', 'weapon3': '2.348', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 136028160. Throughput: 0: 4390.7. Samples: 34009890. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 23:39:22,794][52567] Avg episode reward: [(0, '36.118')] [2024-08-05 23:39:22,810][52663] DAMAGECOUNT value on done: 45663.0 [2024-08-05 23:39:22,813][52663] Sum rewards: 26.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.438', 'ARMOR': '0.452', 'weapon2': '0.880', 'WEAPON3': '1.100', 'HITCOUNT': '1.980', 'weapon3': '2.406', 'DAMAGECOUNT': '8.085', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:22,880][52803] DAMAGECOUNT value on done: 45295.0 [2024-08-05 23:39:22,881][52803] Sum rewards: 43.685, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.872', 'AMMO5': '0.003', 'weapon5': '0.030', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.143', 'AMMO4': '0.172', 'WEAPON4': '0.400', 'ARMOR': '0.444', 'weapon4': '0.528', 'weapon2': '0.630', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '2.502', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '36.000'} [2024-08-05 23:39:23,155][52670] DAMAGECOUNT value on done: 46102.0 [2024-08-05 23:39:23,164][52670] Sum rewards: 26.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.913', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.026', 'weapon5': '0.038', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '1.234', 'WEAPON3': '1.350', 'ARMOR': '1.746', 'HITCOUNT': '1.900', 'weapon3': '2.514', 'DAMAGECOUNT': '8.034', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:23,404][52671] DAMAGECOUNT value on done: 43861.0 [2024-08-05 23:39:23,404][52671] Sum rewards: 45.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.342', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO4': '0.227', 'weapon4': '0.236', 'AMMO3': '0.262', 'WEAPON4': '0.450', 'ARMOR': '0.509', 'weapon2': '0.636', 'WEAPON3': '1.700', 'HITCOUNT': '2.630', 'weapon3': '2.830', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '42.000'} [2024-08-05 23:39:24,068][52647] DAMAGECOUNT value on done: 48816.0 [2024-08-05 23:39:24,071][52647] Sum rewards: 33.984, reward structure: {'DEATHCOUNT': '-10.500', 'weapon5': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.028', 'HEALTH': '0.030', 'AMMO3': '0.132', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.426', 'WEAPON3': '0.750', 'ARMOR': '0.924', 'weapon2': '0.924', 'HITCOUNT': '1.970', 'weapon3': '2.452', 'DAMAGECOUNT': '8.286', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:24,174][52811] DAMAGECOUNT value on done: 42867.0 [2024-08-05 23:39:24,178][52811] Sum rewards: 36.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.222', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '1.040', 'WEAPON3': '1.200', 'ARMOR': '1.423', 'weapon3': '2.284', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '9.444', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:24,521][52665] DAMAGECOUNT value on done: 44162.0 [2024-08-05 23:39:24,521][52665] Sum rewards: 39.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.365', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.114', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.416', 'weapon2': '0.864', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.672', 'DAMAGECOUNT': '10.530', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:25,085][52666] DAMAGECOUNT value on done: 44072.0 [2024-08-05 23:39:25,085][52666] Sum rewards: 35.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.688', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'ARMOR': '0.860', 'weapon2': '0.996', 'WEAPON3': '1.450', 'HITCOUNT': '2.310', 'weapon3': '2.776', 'DAMAGECOUNT': '9.873', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:25,266][52650] Updated weights for policy 0, policy_version 16611 (0.0011) [2024-08-05 23:39:25,298][52658] DAMAGECOUNT value on done: 46423.0 [2024-08-05 23:39:25,298][52658] Sum rewards: 30.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.470', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.064', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.229', 'WEAPON4': '0.450', 'ARMOR': '0.479', 'weapon2': '1.132', 'WEAPON3': '1.500', 'weapon3': '2.404', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.387', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:25,314][52663] DAMAGECOUNT value on done: 43413.0 [2024-08-05 23:39:25,314][52663] Sum rewards: 35.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.396', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'WEAPON4': '0.400', 'weapon4': '0.510', 'WEAPON3': '0.800', 'weapon2': '1.016', 'weapon3': '2.244', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.660', 'FRAGCOUNT': '27.000'} [2024-08-05 23:39:25,804][52670] DAMAGECOUNT value on done: 45638.0 [2024-08-05 23:39:25,804][52670] Sum rewards: 36.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.192', 'ARMOR': '0.847', 'weapon2': '0.986', 'WEAPON3': '1.000', 'HITCOUNT': '2.280', 'weapon3': '2.554', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:25,949][52803] DAMAGECOUNT value on done: 43263.0 [2024-08-05 23:39:25,949][52803] Sum rewards: 34.435, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.854', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.094', 'AMMO3': '0.135', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.475', 'weapon2': '0.852', 'WEAPON3': '1.000', 'HITCOUNT': '2.110', 'weapon3': '2.542', 'DAMAGECOUNT': '9.408', 'FRAGCOUNT': '30.000'} [2024-08-05 23:39:26,606][52671] DAMAGECOUNT value on done: 47481.0 [2024-08-05 23:39:26,606][52671] Sum rewards: 36.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.036', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.028', 'AMMO4': '0.130', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'ARMOR': '0.414', 'weapon4': '0.444', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '2.730', 'DAMAGECOUNT': '10.119', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:26,641][52659] DAMAGECOUNT value on done: 46078.0 [2024-08-05 23:39:26,641][52659] Sum rewards: 41.411, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.947', 'AMMO2': '0.029', 'AMMO3': '0.125', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'weapon2': '0.732', 'weapon4': '0.766', 'WEAPON3': '0.800', 'ARMOR': '0.899', 'weapon3': '2.260', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.891', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:27,134][52647] DAMAGECOUNT value on done: 46404.0 [2024-08-05 23:39:27,134][52647] Sum rewards: 32.617, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.056', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.140', 'AMMO4': '0.140', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.586', 'weapon2': '0.776', 'WEAPON3': '1.050', 'HITCOUNT': '2.000', 'weapon3': '2.018', 'DAMAGECOUNT': '9.276', 'FRAGCOUNT': '28.500'} [2024-08-05 23:39:27,241][52811] DAMAGECOUNT value on done: 43071.0 [2024-08-05 23:39:27,244][52811] Sum rewards: 34.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.306', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.076', 'AMMO4': '0.082', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.258', 'WEAPON4': '0.300', 'ARMOR': '0.405', 'weapon2': '0.630', 'WEAPON3': '1.450', 'HITCOUNT': '2.210', 'weapon3': '2.758', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:27,519][52666] DAMAGECOUNT value on done: 44190.0 [2024-08-05 23:39:27,520][52666] Sum rewards: 35.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.636', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO3': '0.153', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.510', 'WEAPON3': '0.950', 'ARMOR': '0.952', 'weapon2': '0.974', 'weapon3': '2.098', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.973', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:27,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 136118272. Throughput: 0: 4399.8. Samples: 34036700. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 23:39:27,794][52567] Avg episode reward: [(0, '35.608')] [2024-08-05 23:39:27,965][52658] DAMAGECOUNT value on done: 46236.0 [2024-08-05 23:39:27,965][52658] Sum rewards: 37.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.185', 'AMMO3': '0.248', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.562', 'weapon2': '0.614', 'WEAPON3': '1.550', 'HITCOUNT': '2.440', 'weapon3': '2.458', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:28,379][52663] DAMAGECOUNT value on done: 46357.0 [2024-08-05 23:39:28,380][52663] Sum rewards: 31.062, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.226', 'AMMO5': '0.017', 'AMMO2': '0.024', 'ARMOR': '0.036', 'weapon5': '0.114', 'AMMO4': '0.122', 'AMMO3': '0.152', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.676', 'WEAPON3': '1.150', 'HITCOUNT': '2.170', 'weapon3': '2.652', 'DAMAGECOUNT': '8.934', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:28,405][52670] DAMAGECOUNT value on done: 45997.0 [2024-08-05 23:39:28,406][52670] Sum rewards: 40.224, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.162', 'AMMO3': '0.170', 'weapon2': '0.796', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '2.830', 'DAMAGECOUNT': '9.852', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:29,166][52803] DAMAGECOUNT value on done: 42295.0 [2024-08-05 23:39:29,167][52803] Sum rewards: 31.228, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.246', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.066', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'ARMOR': '0.412', 'WEAPON3': '0.900', 'weapon2': '1.588', 'weapon3': '2.104', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '27.000'} [2024-08-05 23:39:29,206][52671] DAMAGECOUNT value on done: 46669.0 [2024-08-05 23:39:29,207][52671] Sum rewards: 38.498, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.040', 'AMMO4': '0.060', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.730', 'ARMOR': '0.928', 'WEAPON3': '1.450', 'HITCOUNT': '2.590', 'weapon3': '2.742', 'DAMAGECOUNT': '10.893', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:29,242][52659] DAMAGECOUNT value on done: 48345.0 [2024-08-05 23:39:29,243][52659] Sum rewards: 34.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.318', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.818', 'ARMOR': '0.856', 'WEAPON3': '1.400', 'HITCOUNT': '2.130', 'weapon3': '2.896', 'DAMAGECOUNT': '9.225', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:29,946][52647] DAMAGECOUNT value on done: 46845.0 [2024-08-05 23:39:29,948][52647] Sum rewards: 49.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.368', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.084', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'ARMOR': '0.416', 'WEAPON4': '0.450', 'weapon2': '0.504', 'weapon4': '0.894', 'WEAPON3': '0.900', 'weapon3': '2.194', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.643', 'FRAGCOUNT': '41.000'} [2024-08-05 23:39:30,190][52811] DAMAGECOUNT value on done: 45278.0 [2024-08-05 23:39:30,191][52811] Sum rewards: 24.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.678', 'AMMO5': '0.025', 'weapon4': '0.058', 'AMMO2': '0.065', 'weapon5': '0.116', 'AMMO3': '0.215', 'AMMO4': '0.324', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'ARMOR': '0.874', 'weapon2': '0.948', 'WEAPON3': '1.300', 'HITCOUNT': '1.460', 'weapon3': '2.554', 'DAMAGECOUNT': '7.098', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:30,269][52650] Updated weights for policy 0, policy_version 16621 (0.0011) [2024-08-05 23:39:30,539][52666] DAMAGECOUNT value on done: 43321.0 [2024-08-05 23:39:30,539][52666] Sum rewards: 40.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.659', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.019', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'ARMOR': '0.400', 'weapon2': '0.898', 'WEAPON3': '1.050', 'HITCOUNT': '2.200', 'weapon3': '2.832', 'DAMAGECOUNT': '9.456', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:30,719][52658] DAMAGECOUNT value on done: 45139.0 [2024-08-05 23:39:30,720][52658] Sum rewards: 27.029, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.056', 'AMMO4': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'HEALTH': '0.182', 'weapon4': '0.354', 'ARMOR': '0.420', 'WEAPON3': '0.850', 'weapon2': '0.896', 'HITCOUNT': '1.990', 'weapon3': '2.478', 'DAMAGECOUNT': '8.355', 'FRAGCOUNT': '20.500'} [2024-08-05 23:39:30,943][52663] DAMAGECOUNT value on done: 46916.0 [2024-08-05 23:39:30,944][52663] Sum rewards: 49.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.006', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.203', 'ARMOR': '0.400', 'weapon2': '0.884', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '42.000'} [2024-08-05 23:39:31,275][52670] DAMAGECOUNT value on done: 46116.0 [2024-08-05 23:39:31,276][52670] Sum rewards: 41.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.066', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.066', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'ARMOR': '0.922', 'WEAPON3': '1.000', 'weapon2': '1.198', 'weapon3': '2.410', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:31,496][52669] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-05 23:39:31,794][52671] DAMAGECOUNT value on done: 49767.0 [2024-08-05 23:39:31,794][52671] Sum rewards: 43.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.074', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'ARMOR': '0.869', 'weapon2': '0.958', 'WEAPON3': '1.100', 'HITCOUNT': '2.380', 'weapon3': '2.718', 'DAMAGECOUNT': '10.539', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:31,837][52659] DAMAGECOUNT value on done: 45052.0 [2024-08-05 23:39:31,837][52659] Sum rewards: 33.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.693', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.185', 'weapon4': '0.248', 'WEAPON4': '0.300', 'ARMOR': '0.962', 'weapon2': '1.060', 'WEAPON3': '1.100', 'weapon3': '2.362', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.591', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:32,210][52803] DAMAGECOUNT value on done: 42932.0 [2024-08-05 23:39:32,210][52803] Sum rewards: 31.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.135', 'AMMO2': '0.015', 'AMMO5': '0.019', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon4': '0.284', 'WEAPON5': '0.350', 'weapon2': '0.372', 'ARMOR': '0.911', 'WEAPON3': '1.650', 'HITCOUNT': '2.080', 'weapon3': '2.906', 'DAMAGECOUNT': '8.844', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:32,526][52647] DAMAGECOUNT value on done: 48198.0 [2024-08-05 23:39:32,527][52647] Sum rewards: 43.172, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.837', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.083', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon2': '1.384', 'ARMOR': '1.387', 'weapon3': '2.302', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.193', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 136200192. Throughput: 0: 4408.7. Samples: 34049810. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:39:32,794][52567] Avg episode reward: [(0, '35.908')] [2024-08-05 23:39:33,010][52666] DAMAGECOUNT value on done: 43401.0 [2024-08-05 23:39:33,013][52666] Sum rewards: 32.264, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.034', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.149', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.932', 'ARMOR': '1.311', 'WEAPON3': '1.600', 'HITCOUNT': '2.150', 'weapon3': '2.544', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '30.000'} [2024-08-05 23:39:33,302][52811] DAMAGECOUNT value on done: 41358.0 [2024-08-05 23:39:33,303][52811] Sum rewards: 35.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.364', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.064', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'ARMOR': '1.200', 'weapon2': '1.208', 'HITCOUNT': '2.240', 'weapon3': '2.492', 'DAMAGECOUNT': '9.123', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:33,662][52658] DAMAGECOUNT value on done: 47743.0 [2024-08-05 23:39:33,666][52658] Sum rewards: 31.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.491', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.066', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO4': '0.163', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.754', 'ARMOR': '0.890', 'WEAPON3': '1.250', 'HITCOUNT': '1.960', 'weapon3': '2.816', 'DAMAGECOUNT': '8.463', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:33,787][52670] DAMAGECOUNT value on done: 42602.0 [2024-08-05 23:39:33,788][52670] Sum rewards: 38.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.594', 'ARMOR': '0.855', 'WEAPON3': '1.000', 'weapon2': '1.122', 'weapon3': '2.054', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '9.546', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:33,827][52663] DAMAGECOUNT value on done: 45705.0 [2024-08-05 23:39:33,829][52663] Sum rewards: 23.964, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.138', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon4': '0.098', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO3': '0.186', 'ARMOR': '0.859', 'WEAPON3': '1.150', 'weapon2': '1.418', 'HITCOUNT': '1.570', 'weapon3': '2.096', 'DAMAGECOUNT': '7.797', 'FRAGCOUNT': '21.500'} [2024-08-05 23:39:34,234][52671] DAMAGECOUNT value on done: 45259.0 [2024-08-05 23:39:34,235][52671] Sum rewards: 41.936, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.104', 'ARMOR': '0.004', 'weapon5': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON3': '0.800', 'weapon2': '1.008', 'weapon3': '2.490', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:34,331][52659] DAMAGECOUNT value on done: 45843.0 [2024-08-05 23:39:34,332][52659] Sum rewards: 35.719, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.134', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'weapon4': '0.538', 'weapon2': '0.720', 'WEAPON3': '0.800', 'HITCOUNT': '2.140', 'weapon3': '2.360', 'DAMAGECOUNT': '8.310', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:34,915][52650] Updated weights for policy 0, policy_version 16631 (0.0021) [2024-08-05 23:39:35,257][52803] DAMAGECOUNT value on done: 42521.0 [2024-08-05 23:39:35,257][52803] Sum rewards: 25.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.789', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.130', 'WEAPON5': '0.200', 'ARMOR': '0.808', 'WEAPON3': '0.850', 'weapon2': '1.352', 'HITCOUNT': '1.850', 'weapon3': '2.270', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '22.000'} [2024-08-05 23:39:35,329][52666] DAMAGECOUNT value on done: 44556.0 [2024-08-05 23:39:35,333][52666] Sum rewards: 34.531, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.283', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.550', 'weapon2': '0.646', 'ARMOR': '0.909', 'WEAPON3': '1.250', 'weapon3': '2.402', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:35,579][52647] DAMAGECOUNT value on done: 47086.0 [2024-08-05 23:39:35,591][52647] Sum rewards: 35.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'weapon7': '0.010', 'AMMO2': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.185', 'AMMO4': '0.189', 'weapon4': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.772', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.696', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:36,297][52670] DAMAGECOUNT value on done: 43977.0 [2024-08-05 23:39:36,299][52670] Sum rewards: 35.010, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.278', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.176', 'weapon4': '0.580', 'ARMOR': '0.800', 'weapon2': '0.930', 'WEAPON3': '1.050', 'weapon3': '2.256', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.255', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:36,572][52811] DAMAGECOUNT value on done: 44641.0 [2024-08-05 23:39:36,572][52811] Sum rewards: 51.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.148', 'WEAPON3': '0.950', 'weapon2': '1.158', 'ARMOR': '1.654', 'weapon3': '2.700', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '40.000'} [2024-08-05 23:39:36,723][52658] DAMAGECOUNT value on done: 50141.0 [2024-08-05 23:39:36,724][52658] Sum rewards: 36.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.518', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.056', 'weapon5': '0.062', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.400', 'weapon4': '0.410', 'weapon2': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.562', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.098', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:36,789][52663] DAMAGECOUNT value on done: 47377.0 [2024-08-05 23:39:36,791][52663] Sum rewards: 36.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.738', 'AMMO2': '0.013', 'AMMO5': '0.026', 'AMMO4': '0.067', 'weapon5': '0.090', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.468', 'weapon2': '0.558', 'WEAPON3': '1.000', 'ARMOR': '1.411', 'HITCOUNT': '2.390', 'weapon3': '2.614', 'DAMAGECOUNT': '9.357', 'FRAGCOUNT': '30.000'} [2024-08-05 23:39:36,901][52671] DAMAGECOUNT value on done: 48179.0 [2024-08-05 23:39:36,901][52671] Sum rewards: 27.363, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.058', 'AMMO3': '0.135', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.502', 'HITCOUNT': '1.820', 'weapon3': '2.292', 'DAMAGECOUNT': '7.116', 'FRAGCOUNT': '23.000'} [2024-08-05 23:39:36,970][52659] DAMAGECOUNT value on done: 46160.0 [2024-08-05 23:39:36,971][52659] Sum rewards: 42.067, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.071', 'AMMO3': '0.151', 'weapon4': '0.396', 'ARMOR': '0.400', 'weapon2': '0.498', 'HEALTH': '0.831', 'WEAPON3': '0.850', 'HITCOUNT': '2.540', 'weapon3': '2.634', 'DAMAGECOUNT': '10.263', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 136290304. Throughput: 0: 4402.2. Samples: 34076180. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:39:37,794][52567] Avg episode reward: [(0, '35.711')] [2024-08-05 23:39:38,111][52647] DAMAGECOUNT value on done: 46544.0 [2024-08-05 23:39:38,112][52647] Sum rewards: 32.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.728', 'AMMO5': '0.014', 'weapon5': '0.032', 'AMMO2': '0.052', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO3': '0.246', 'AMMO4': '0.262', 'WEAPON4': '0.550', 'weapon2': '0.802', 'WEAPON3': '1.350', 'ARMOR': '1.397', 'HITCOUNT': '2.230', 'weapon3': '2.632', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '30.000'} [2024-08-05 23:39:38,384][52803] DAMAGECOUNT value on done: 40786.0 [2024-08-05 23:39:38,385][52803] Sum rewards: 37.131, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.993', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'ARMOR': '0.946', 'weapon2': '1.194', 'WEAPON3': '1.300', 'weapon3': '2.314', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.722', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:38,398][52666] DAMAGECOUNT value on done: 45199.0 [2024-08-05 23:39:38,398][52666] Sum rewards: 42.453, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.581', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.048', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.194', 'AMMO4': '0.242', 'WEAPON4': '0.550', 'weapon2': '0.762', 'ARMOR': '0.812', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '2.758', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:39,141][52670] DAMAGECOUNT value on done: 43407.0 [2024-08-05 23:39:39,141][52670] Sum rewards: 28.403, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.912', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon4': '0.162', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '1.112', 'WEAPON3': '1.300', 'ARMOR': '1.384', 'HITCOUNT': '2.100', 'weapon3': '2.534', 'DAMAGECOUNT': '8.238', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:39,523][52671] DAMAGECOUNT value on done: 47148.0 [2024-08-05 23:39:39,525][52671] Sum rewards: 35.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'weapon4': '0.580', 'weapon2': '0.628', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.332', 'DAMAGECOUNT': '9.963', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:39,537][52663] DAMAGECOUNT value on done: 48029.0 [2024-08-05 23:39:39,538][52663] Sum rewards: 52.039, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.576', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon4': '0.318', 'weapon2': '0.480', 'ARMOR': '1.300', 'WEAPON3': '1.350', 'weapon3': '2.764', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '46.000'} [2024-08-05 23:39:39,566][52659] DAMAGECOUNT value on done: 47711.0 [2024-08-05 23:39:39,566][52659] Sum rewards: 31.369, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.924', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.162', 'ARMOR': '0.454', 'WEAPON3': '1.000', 'weapon2': '1.400', 'HITCOUNT': '2.240', 'weapon3': '2.396', 'DAMAGECOUNT': '9.090', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:39,590][52811] DAMAGECOUNT value on done: 42746.0 [2024-08-05 23:39:39,591][52811] Sum rewards: 32.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.156', 'AMMO3': '0.225', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.590', 'ARMOR': '0.902', 'WEAPON3': '1.350', 'HITCOUNT': '2.270', 'weapon3': '2.652', 'DAMAGECOUNT': '9.114', 'FRAGCOUNT': '30.500'} [2024-08-05 23:39:39,797][52650] Updated weights for policy 0, policy_version 16641 (0.0011) [2024-08-05 23:39:39,940][52658] DAMAGECOUNT value on done: 45386.0 [2024-08-05 23:39:39,940][52658] Sum rewards: 35.496, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.025', 'HEALTH': '0.040', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.228', 'WEAPON3': '0.800', 'weapon2': '1.138', 'ARMOR': '1.275', 'HITCOUNT': '2.050', 'weapon3': '2.326', 'DAMAGECOUNT': '9.291', 'FRAGCOUNT': '26.000'} [2024-08-05 23:39:41,471][52803] DAMAGECOUNT value on done: 42678.0 [2024-08-05 23:39:41,482][52803] Sum rewards: 29.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.244', 'AMMO2': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.039', 'weapon5': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.188', 'WEAPON5': '0.200', 'ARMOR': '0.498', 'WEAPON3': '1.050', 'weapon2': '1.194', 'HITCOUNT': '1.900', 'weapon3': '2.356', 'DAMAGECOUNT': '8.184', 'FRAGCOUNT': '25.500'} [2024-08-05 23:39:41,496][52670] DAMAGECOUNT value on done: 44302.0 [2024-08-05 23:39:41,497][52670] Sum rewards: 31.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.884', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO4': '0.211', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON4': '0.450', 'weapon2': '0.960', 'ARMOR': '1.309', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'weapon3': '2.278', 'DAMAGECOUNT': '10.089', 'FRAGCOUNT': '29.000'} [2024-08-05 23:39:42,567][52671] DAMAGECOUNT value on done: 45829.0 [2024-08-05 23:39:42,571][52671] Sum rewards: 25.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.098', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.116', 'weapon7': '0.124', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON7': '0.300', 'ARMOR': '0.408', 'weapon4': '0.452', 'WEAPON3': '0.750', 'weapon2': '0.874', 'HITCOUNT': '1.510', 'weapon3': '1.990', 'DAMAGECOUNT': '6.465', 'FRAGCOUNT': '21.000'} [2024-08-05 23:39:42,598][52658] DAMAGECOUNT value on done: 44912.0 [2024-08-05 23:39:42,600][52658] Sum rewards: 35.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.654', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.054', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.254', 'WEAPON4': '0.350', 'ARMOR': '0.895', 'WEAPON3': '1.050', 'weapon2': '1.150', 'weapon3': '2.356', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:42,632][52659] DAMAGECOUNT value on done: 46941.0 [2024-08-05 23:39:42,633][52659] Sum rewards: 28.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon5': '0.106', 'weapon4': '0.108', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'ARMOR': '0.478', 'weapon2': '1.034', 'WEAPON3': '1.200', 'HITCOUNT': '2.060', 'weapon3': '2.526', 'DAMAGECOUNT': '9.189', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:42,641][52811] DAMAGECOUNT value on done: 43403.0 [2024-08-05 23:39:42,641][52811] Sum rewards: 38.550, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.815', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.510', 'weapon2': '0.552', 'WEAPON3': '0.900', 'HITCOUNT': '2.230', 'weapon3': '2.570', 'DAMAGECOUNT': '8.745', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:42,654][52663] DAMAGECOUNT value on done: 47036.0 [2024-08-05 23:39:42,656][52663] Sum rewards: 42.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.144', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.208', 'weapon2': '1.024', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.704', 'DAMAGECOUNT': '11.823', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 136372224. Throughput: 0: 4414.2. Samples: 34102850. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:39:42,794][52567] Avg episode reward: [(0, '35.068')] [2024-08-05 23:39:43,937][52650] Updated weights for policy 0, policy_version 16651 (0.0023) [2024-08-05 23:39:44,311][52670] DAMAGECOUNT value on done: 44878.0 [2024-08-05 23:39:44,313][52670] Sum rewards: 31.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.178', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.450', 'weapon2': '1.064', 'WEAPON3': '1.100', 'ARMOR': '1.339', 'HITCOUNT': '2.170', 'weapon3': '2.172', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '25.500'} [2024-08-05 23:39:44,607][52803] DAMAGECOUNT value on done: 43186.0 [2024-08-05 23:39:44,609][52803] Sum rewards: 30.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.181', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.396', 'ARMOR': '1.794', 'weapon3': '2.086', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '8.565', 'FRAGCOUNT': '28.000'} [2024-08-05 23:39:45,172][52658] DAMAGECOUNT value on done: 48455.0 [2024-08-05 23:39:45,173][52658] Sum rewards: 38.477, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.554', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.064', 'ARMOR': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.222', 'weapon2': '0.750', 'WEAPON3': '1.200', 'HITCOUNT': '2.390', 'weapon3': '2.682', 'DAMAGECOUNT': '9.945', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:45,367][52663] DAMAGECOUNT value on done: 44543.0 [2024-08-05 23:39:45,368][52663] Sum rewards: 25.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.763', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.190', 'weapon4': '0.472', 'WEAPON4': '0.550', 'weapon2': '0.988', 'WEAPON3': '1.250', 'ARMOR': '1.368', 'HITCOUNT': '1.940', 'weapon3': '2.276', 'DAMAGECOUNT': '7.575', 'FRAGCOUNT': '22.000'} [2024-08-05 23:39:45,626][52811] DAMAGECOUNT value on done: 43340.0 [2024-08-05 23:39:45,629][52811] Sum rewards: 33.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.212', 'AMMO3': '0.232', 'WEAPON4': '0.450', 'ARMOR': '0.470', 'weapon2': '0.910', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '2.748', 'DAMAGECOUNT': '9.903', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:45,759][52671] DAMAGECOUNT value on done: 52063.0 [2024-08-05 23:39:45,759][52671] Sum rewards: 40.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.172', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.024', 'weapon5': '0.026', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.432', 'weapon4': '0.534', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.790', 'DAMAGECOUNT': '10.392', 'FRAGCOUNT': '36.000'} [2024-08-05 23:39:45,890][52659] DAMAGECOUNT value on done: 44657.0 [2024-08-05 23:39:45,892][52659] Sum rewards: 40.019, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.898', 'AMMO4': '-0.036', 'AMMO2': '-0.007', 'AMMO5': '0.003', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'ARMOR': '0.468', 'weapon4': '0.564', 'WEAPON3': '0.850', 'weapon2': '0.990', 'weapon3': '2.160', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.073', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:47,604][52803] DAMAGECOUNT value on done: 45022.0 [2024-08-05 23:39:47,606][52803] Sum rewards: 41.775, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.196', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.336', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.038', 'weapon3': '2.458', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '34.000'} [2024-08-05 23:39:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 136470528. Throughput: 0: 4410.2. Samples: 34116030. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:39:47,794][52567] Avg episode reward: [(0, '35.253')] [2024-08-05 23:39:48,515][52795] DAMAGECOUNT value on done: 43551.0 [2024-08-05 23:39:48,515][52795] Sum rewards: 24.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'ARMOR': '0.458', 'weapon2': '1.102', 'WEAPON3': '1.250', 'HITCOUNT': '1.990', 'weapon3': '2.202', 'DAMAGECOUNT': '8.535', 'FRAGCOUNT': '23.000'} [2024-08-05 23:39:48,619][52671] DAMAGECOUNT value on done: 46585.0 [2024-08-05 23:39:48,619][52671] Sum rewards: 39.069, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.535', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.006', 'weapon4': '0.010', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.158', 'weapon2': '0.912', 'WEAPON3': '1.050', 'HITCOUNT': '2.280', 'weapon3': '2.810', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '33.000'} [2024-08-05 23:39:48,644][52811] DAMAGECOUNT value on done: 43806.0 [2024-08-05 23:39:48,645][52811] Sum rewards: 44.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.837', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.131', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'ARMOR': '0.914', 'weapon2': '1.202', 'WEAPON3': '1.250', 'weapon3': '2.308', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '38.000'} [2024-08-05 23:39:48,736][52659] DAMAGECOUNT value on done: 45484.0 [2024-08-05 23:39:48,738][52659] Sum rewards: 47.768, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.168', 'weapon5': '0.170', 'HEALTH': '0.310', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.108', 'weapon3': '2.346', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:48,922][52650] Updated weights for policy 0, policy_version 16661 (0.0020) [2024-08-05 23:39:50,610][52803] DAMAGECOUNT value on done: 42595.0 [2024-08-05 23:39:50,611][52803] Sum rewards: 38.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.959', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.050', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.606', 'WEAPON3': '0.950', 'weapon2': '0.966', 'ARMOR': '1.731', 'weapon3': '2.162', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.733', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:51,566][52811] DAMAGECOUNT value on done: 46468.0 [2024-08-05 23:39:51,566][52811] Sum rewards: 33.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.036', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.234', 'weapon2': '0.586', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '2.920', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '31.000'} [2024-08-05 23:39:51,641][52795] DAMAGECOUNT value on done: 39752.0 [2024-08-05 23:39:51,641][52795] Sum rewards: 27.261, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.798', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.148', 'AMMO4': '0.215', 'WEAPON4': '0.500', 'weapon4': '0.632', 'WEAPON3': '0.900', 'weapon2': '1.134', 'ARMOR': '1.228', 'HITCOUNT': '1.670', 'weapon3': '1.774', 'DAMAGECOUNT': '6.756', 'FRAGCOUNT': '22.000'} [2024-08-05 23:39:51,883][52671] DAMAGECOUNT value on done: 43870.0 [2024-08-05 23:39:51,884][52671] Sum rewards: 43.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO4': '0.168', 'weapon4': '0.198', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.898', 'weapon2': '0.906', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '38.000'} [2024-08-05 23:39:52,075][52659] DAMAGECOUNT value on done: 47904.0 [2024-08-05 23:39:52,076][52659] Sum rewards: 36.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.107', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.432', 'weapon2': '0.752', 'ARMOR': '0.824', 'WEAPON3': '1.500', 'weapon3': '2.574', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.418', 'FRAGCOUNT': '32.000'} [2024-08-05 23:39:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 136552448. Throughput: 0: 4410.7. Samples: 34142550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:39:52,802][52567] Avg episode reward: [(0, '35.406')] [2024-08-05 23:39:53,224][52650] Updated weights for policy 0, policy_version 16671 (0.0012) [2024-08-05 23:39:54,839][52811] DAMAGECOUNT value on done: 41410.0 [2024-08-05 23:39:54,839][52811] Sum rewards: 37.658, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.695', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.022', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.634', 'ARMOR': '1.334', 'WEAPON3': '1.500', 'HITCOUNT': '2.660', 'weapon3': '3.024', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '33.500'} [2024-08-05 23:39:54,847][52671] DAMAGECOUNT value on done: 49524.0 [2024-08-05 23:39:54,847][52671] Sum rewards: 45.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.107', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.146', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.452', 'ARMOR': '0.475', 'weapon2': '0.670', 'WEAPON3': '0.900', 'weapon3': '2.380', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '37.000'} [2024-08-05 23:39:54,869][52795] DAMAGECOUNT value on done: 41349.0 [2024-08-05 23:39:54,869][52795] Sum rewards: 28.948, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.495', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.246', 'weapon4': '0.514', 'WEAPON4': '0.600', 'weapon2': '0.622', 'WEAPON3': '1.450', 'HITCOUNT': '2.360', 'weapon3': '2.524', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '30.000'} [2024-08-05 23:39:54,974][52659] DAMAGECOUNT value on done: 45780.0 [2024-08-05 23:39:54,976][52659] Sum rewards: 43.022, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.004', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.346', 'ARMOR': '0.938', 'WEAPON3': '1.150', 'weapon2': '1.256', 'weapon3': '2.204', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '36.000'} [2024-08-05 23:39:56,254][52649] DAMAGECOUNT value on done: 46103.0 [2024-08-05 23:39:56,256][52649] Sum rewards: 38.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.369', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon4': '0.652', 'weapon2': '0.716', 'WEAPON3': '1.300', 'ARMOR': '1.305', 'weapon3': '2.180', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:56,308][52614] Signal inference workers to stop experience collection... (3100 times) [2024-08-05 23:39:56,309][52614] Signal inference workers to resume experience collection... (3100 times) [2024-08-05 23:39:56,395][52650] InferenceWorker_p0-w0: stopping experience collection (3100 times) [2024-08-05 23:39:56,403][52650] InferenceWorker_p0-w0: resuming experience collection (3100 times) [2024-08-05 23:39:57,542][52671] DAMAGECOUNT value on done: 48084.0 [2024-08-05 23:39:57,544][52671] Sum rewards: 36.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.438', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'ARMOR': '0.927', 'weapon2': '1.228', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '2.516', 'DAMAGECOUNT': '9.351', 'FRAGCOUNT': '35.000'} [2024-08-05 23:39:57,701][52659] DAMAGECOUNT value on done: 47071.0 [2024-08-05 23:39:57,701][52659] Sum rewards: 45.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.268', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon4': '0.118', 'AMMO3': '0.224', 'weapon2': '1.124', 'WEAPON3': '1.300', 'ARMOR': '1.652', 'HITCOUNT': '2.500', 'weapon3': '2.586', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '39.000'} [2024-08-05 23:39:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 136642560. Throughput: 0: 4407.8. Samples: 34168800. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:39:57,794][52567] Avg episode reward: [(0, '36.062')] [2024-08-05 23:39:57,921][52811] DAMAGECOUNT value on done: 42681.0 [2024-08-05 23:39:57,922][52811] Sum rewards: 32.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.543', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.100', 'AMMO3': '0.128', 'weapon5': '0.218', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'ARMOR': '1.259', 'weapon2': '1.498', 'weapon3': '1.944', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '10.446', 'FRAGCOUNT': '25.000'} [2024-08-05 23:39:58,146][52795] DAMAGECOUNT value on done: 43727.0 [2024-08-05 23:39:58,147][52795] Sum rewards: 27.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.802', 'AMMO5': '0.006', 'weapon5': '0.028', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.256', 'ARMOR': '0.484', 'weapon2': '0.892', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.580', 'DAMAGECOUNT': '7.914', 'FRAGCOUNT': '24.000'} [2024-08-05 23:39:58,313][52650] Updated weights for policy 0, policy_version 16681 (0.0015) [2024-08-05 23:39:59,132][52649] DAMAGECOUNT value on done: 45540.0 [2024-08-05 23:39:59,133][52649] Sum rewards: 34.557, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.135', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.960', 'ARMOR': '1.395', 'WEAPON3': '1.400', 'HITCOUNT': '2.380', 'weapon3': '2.502', 'DAMAGECOUNT': '9.117', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:00,686][52671] DAMAGECOUNT value on done: 48506.0 [2024-08-05 23:40:00,688][52671] Sum rewards: 26.866, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.684', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.104', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'ARMOR': '1.335', 'weapon2': '1.386', 'HITCOUNT': '2.280', 'weapon3': '2.380', 'DAMAGECOUNT': '9.066', 'FRAGCOUNT': '21.000'} [2024-08-05 23:40:00,892][52659] DAMAGECOUNT value on done: 45019.0 [2024-08-05 23:40:00,894][52659] Sum rewards: 43.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.764', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.182', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'ARMOR': '0.866', 'weapon2': '1.016', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.458', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '37.000'} [2024-08-05 23:40:01,246][52795] DAMAGECOUNT value on done: 45720.0 [2024-08-05 23:40:01,247][52795] Sum rewards: 32.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.276', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.028', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.248', 'ARMOR': '0.400', 'weapon2': '1.120', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '2.406', 'DAMAGECOUNT': '9.459', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:01,969][52649] DAMAGECOUNT value on done: 45021.0 [2024-08-05 23:40:01,970][52649] Sum rewards: 36.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.119', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon4': '0.688', 'WEAPON3': '0.900', 'weapon2': '1.054', 'weapon3': '1.966', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '8.997', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:02,482][52650] Updated weights for policy 0, policy_version 16691 (0.0028) [2024-08-05 23:40:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 136732672. Throughput: 0: 4408.0. Samples: 34181980. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:40:02,794][52567] Avg episode reward: [(0, '36.062')] [2024-08-05 23:40:03,803][52671] DAMAGECOUNT value on done: 46536.0 [2024-08-05 23:40:03,804][52671] Sum rewards: 40.916, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'weapon5': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.203', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon4': '0.322', 'ARMOR': '0.469', 'WEAPON4': '0.500', 'weapon2': '0.814', 'WEAPON3': '1.500', 'weapon3': '2.560', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.307', 'FRAGCOUNT': '38.000'} [2024-08-05 23:40:03,934][52659] DAMAGECOUNT value on done: 45475.0 [2024-08-05 23:40:03,935][52659] Sum rewards: 35.715, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.208', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.426', 'ARMOR': '0.428', 'weapon2': '0.642', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.678', 'DAMAGECOUNT': '9.864', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:04,285][52795] DAMAGECOUNT value on done: 44169.0 [2024-08-05 23:40:04,286][52795] Sum rewards: 18.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.434', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.038', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.176', 'WEAPON4': '0.300', 'ARMOR': '0.970', 'WEAPON3': '1.000', 'weapon2': '1.184', 'HITCOUNT': '1.470', 'weapon3': '2.354', 'DAMAGECOUNT': '5.667', 'FRAGCOUNT': '18.000'} [2024-08-05 23:40:04,756][52649] DAMAGECOUNT value on done: 46127.0 [2024-08-05 23:40:04,756][52649] Sum rewards: 29.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.179', 'weapon4': '0.182', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.752', 'ARMOR': '0.898', 'WEAPON3': '1.250', 'HITCOUNT': '2.230', 'weapon3': '2.762', 'DAMAGECOUNT': '8.763', 'FRAGCOUNT': '26.000'} [2024-08-05 23:40:06,760][52671] DAMAGECOUNT value on done: 46201.0 [2024-08-05 23:40:06,760][52671] Sum rewards: 38.204, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.738', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.019', 'weapon7': '0.058', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.200', 'ARMOR': '0.483', 'weapon4': '0.604', 'weapon2': '0.744', 'WEAPON3': '0.750', 'weapon3': '2.210', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '30.000'} [2024-08-05 23:40:06,964][52659] DAMAGECOUNT value on done: 47257.0 [2024-08-05 23:40:06,964][52659] Sum rewards: 27.990, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO4': '0.184', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON4': '0.450', 'weapon2': '0.734', 'ARMOR': '0.894', 'WEAPON3': '1.300', 'HITCOUNT': '2.070', 'weapon3': '2.424', 'DAMAGECOUNT': '8.802', 'FRAGCOUNT': '25.000'} [2024-08-05 23:40:07,364][52795] DAMAGECOUNT value on done: 46304.0 [2024-08-05 23:40:07,365][52795] Sum rewards: 15.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'ARMOR': '0.439', 'weapon4': '0.532', 'weapon2': '0.544', 'WEAPON3': '1.400', 'HITCOUNT': '1.470', 'weapon3': '2.472', 'DAMAGECOUNT': '5.937', 'FRAGCOUNT': '16.000'} [2024-08-05 23:40:07,577][52650] Updated weights for policy 0, policy_version 16701 (0.0023) [2024-08-05 23:40:07,631][52649] DAMAGECOUNT value on done: 44797.0 [2024-08-05 23:40:07,634][52649] Sum rewards: 28.367, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO2': '0.057', 'AMMO3': '0.139', 'AMMO4': '0.284', 'weapon4': '0.370', 'HEALTH': '0.394', 'ARMOR': '0.428', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon2': '1.046', 'HITCOUNT': '2.180', 'weapon3': '2.350', 'DAMAGECOUNT': '8.148', 'FRAGCOUNT': '22.000'} [2024-08-05 23:40:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 136814592. Throughput: 0: 4417.5. Samples: 34208680. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-05 23:40:07,795][52567] Avg episode reward: [(0, '35.425')] [2024-08-05 23:40:09,261][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:40:09,968][52659] DAMAGECOUNT value on done: 51032.0 [2024-08-05 23:40:09,969][52659] Sum rewards: 34.967, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.599', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'ARMOR': '0.060', 'weapon5': '0.066', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.476', 'weapon2': '0.800', 'WEAPON3': '0.950', 'weapon3': '2.066', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '9.330', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:10,477][52795] DAMAGECOUNT value on done: 43456.0 [2024-08-05 23:40:10,478][52795] Sum rewards: 33.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.624', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '2.720', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '30.000'} [2024-08-05 23:40:10,676][52649] DAMAGECOUNT value on done: 44759.0 [2024-08-05 23:40:10,677][52649] Sum rewards: 35.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.804', 'AMMO5': '0.003', 'weapon5': '0.034', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'AMMO4': '0.178', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.984', 'WEAPON3': '1.000', 'ARMOR': '1.224', 'HITCOUNT': '2.120', 'weapon3': '2.504', 'DAMAGECOUNT': '9.003', 'FRAGCOUNT': '30.000'} [2024-08-05 23:40:11,708][52650] Updated weights for policy 0, policy_version 16711 (0.0015) [2024-08-05 23:40:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 136904704. Throughput: 0: 4406.9. Samples: 34235010. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-05 23:40:12,794][52567] Avg episode reward: [(0, '35.364')] [2024-08-05 23:40:12,896][52659] DAMAGECOUNT value on done: 46706.0 [2024-08-05 23:40:12,899][52659] Sum rewards: 42.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.318', 'HITCOUNT': '2.390', 'weapon3': '2.416', 'DAMAGECOUNT': '10.281', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:13,738][52795] DAMAGECOUNT value on done: 40754.0 [2024-08-05 23:40:13,739][52795] Sum rewards: 32.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.420', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'weapon4': '0.186', 'AMMO4': '0.280', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon2': '1.048', 'ARMOR': '1.295', 'HITCOUNT': '2.180', 'weapon3': '2.450', 'DAMAGECOUNT': '8.964', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:13,900][52649] DAMAGECOUNT value on done: 43209.0 [2024-08-05 23:40:13,900][52649] Sum rewards: 33.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.108', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.842', 'ARMOR': '0.897', 'WEAPON3': '1.450', 'HITCOUNT': '2.300', 'weapon3': '2.834', 'DAMAGECOUNT': '9.177', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:15,964][52659] DAMAGECOUNT value on done: 46812.0 [2024-08-05 23:40:15,965][52659] Sum rewards: 38.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.015', 'weapon5': '0.032', 'AMMO2': '0.056', 'ARMOR': '0.056', 'AMMO3': '0.181', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.600', 'weapon2': '0.638', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '2.682', 'DAMAGECOUNT': '10.371', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:16,763][52650] Updated weights for policy 0, policy_version 16721 (0.0013) [2024-08-05 23:40:16,777][52795] DAMAGECOUNT value on done: 43686.0 [2024-08-05 23:40:16,779][52795] Sum rewards: 31.800, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.044', 'weapon4': '0.054', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'WEAPON4': '0.400', 'ARMOR': '0.992', 'weapon2': '1.018', 'WEAPON3': '1.700', 'HITCOUNT': '2.230', 'weapon3': '2.536', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '32.000'} [2024-08-05 23:40:16,815][52649] DAMAGECOUNT value on done: 46862.0 [2024-08-05 23:40:16,818][52649] Sum rewards: 44.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.996', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.678', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.880', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '39.000'} [2024-08-05 23:40:17,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 137003008. Throughput: 0: 4411.6. Samples: 34248330. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-05 23:40:17,794][52567] Avg episode reward: [(0, '35.465')] [2024-08-05 23:40:18,938][52659] DAMAGECOUNT value on done: 45698.0 [2024-08-05 23:40:18,939][52659] Sum rewards: 18.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.060', 'ARMOR': '0.072', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'weapon2': '0.682', 'weapon4': '0.730', 'WEAPON3': '1.200', 'HITCOUNT': '1.680', 'weapon3': '2.218', 'DAMAGECOUNT': '6.246', 'FRAGCOUNT': '18.000'} [2024-08-05 23:40:19,062][52662] DAMAGECOUNT value on done: 51061.0 [2024-08-05 23:40:19,063][52662] Sum rewards: 33.551, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.973', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.136', 'WEAPON4': '0.250', 'ARMOR': '0.428', 'weapon4': '0.560', 'weapon2': '0.572', 'WEAPON3': '1.050', 'HITCOUNT': '2.270', 'weapon3': '2.580', 'DAMAGECOUNT': '8.601', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:19,724][52649] DAMAGECOUNT value on done: 43078.0 [2024-08-05 23:40:19,727][52649] Sum rewards: 27.684, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.042', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.210', 'WEAPON4': '0.450', 'weapon4': '0.552', 'weapon2': '0.820', 'ARMOR': '0.887', 'WEAPON3': '1.300', 'HITCOUNT': '2.220', 'weapon3': '2.242', 'DAMAGECOUNT': '9.051', 'FRAGCOUNT': '27.000'} [2024-08-05 23:40:19,843][52795] DAMAGECOUNT value on done: 43390.0 [2024-08-05 23:40:19,846][52795] Sum rewards: 26.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO2': '0.014', 'weapon7': '0.018', 'weapon4': '0.058', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.215', 'weapon2': '0.646', 'WEAPON3': '1.450', 'HITCOUNT': '2.110', 'weapon3': '2.998', 'DAMAGECOUNT': '8.160', 'FRAGCOUNT': '26.000'} [2024-08-05 23:40:21,049][52650] Updated weights for policy 0, policy_version 16731 (0.0021) [2024-08-05 23:40:21,315][52794] DAMAGECOUNT value on done: 52055.0 [2024-08-05 23:40:21,316][52794] Sum rewards: 31.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.343', 'AMMO5': '0.017', 'ARMOR': '0.040', 'AMMO2': '0.043', 'weapon5': '0.056', 'AMMO3': '0.177', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.354', 'WEAPON4': '0.500', 'weapon2': '0.726', 'WEAPON3': '1.050', 'HITCOUNT': '1.950', 'weapon3': '2.580', 'DAMAGECOUNT': '8.655', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:21,608][52659] DAMAGECOUNT value on done: 49389.0 [2024-08-05 23:40:21,609][52659] Sum rewards: 29.783, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.226', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.116', 'weapon5': '0.156', 'AMMO4': '0.237', 'weapon4': '0.354', 'WEAPON5': '0.450', 'ARMOR': '0.481', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon2': '1.370', 'weapon3': '1.860', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '8.016', 'FRAGCOUNT': '25.000'} [2024-08-05 23:40:21,910][52662] DAMAGECOUNT value on done: 53159.0 [2024-08-05 23:40:21,914][52662] Sum rewards: 37.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.186', 'weapon2': '0.754', 'WEAPON3': '1.050', 'HITCOUNT': '2.170', 'weapon3': '2.692', 'DAMAGECOUNT': '9.039', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:22,612][52649] DAMAGECOUNT value on done: 44412.0 [2024-08-05 23:40:22,613][52649] Sum rewards: 34.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.514', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.068', 'AMMO3': '0.193', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'weapon4': '0.368', 'WEAPON4': '0.550', 'ARMOR': '0.800', 'weapon2': '0.942', 'WEAPON3': '1.300', 'weapon3': '2.328', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '9.828', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:22,804][52567] Fps is (10 sec: 18004.7, 60 sec: 17609.9, 300 sec: 17605.3). Total num frames: 137084928. Throughput: 0: 4416.8. Samples: 34274980. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 23:40:22,804][52567] Avg episode reward: [(0, '35.067')] [2024-08-05 23:40:23,052][52795] DAMAGECOUNT value on done: 42565.0 [2024-08-05 23:40:23,053][52795] Sum rewards: 44.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.531', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.850', 'ARMOR': '0.858', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '2.822', 'DAMAGECOUNT': '11.106', 'FRAGCOUNT': '38.000'} [2024-08-05 23:40:24,408][52794] DAMAGECOUNT value on done: 51457.0 [2024-08-05 23:40:24,408][52794] Sum rewards: 39.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.324', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'weapon4': '0.008', 'AMMO5': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '1.202', 'WEAPON3': '1.250', 'ARMOR': '1.775', 'HITCOUNT': '2.470', 'weapon3': '2.574', 'DAMAGECOUNT': '10.605', 'FRAGCOUNT': '33.000'} [2024-08-05 23:40:24,960][52662] DAMAGECOUNT value on done: 54815.0 [2024-08-05 23:40:24,963][52662] Sum rewards: 24.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.168', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'WEAPON3': '1.100', 'weapon2': '1.118', 'HITCOUNT': '2.040', 'weapon3': '2.470', 'DAMAGECOUNT': '7.410', 'FRAGCOUNT': '22.000'} [2024-08-05 23:40:25,157][52668] DAMAGECOUNT value on done: 46458.0 [2024-08-05 23:40:25,157][52668] Sum rewards: 36.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.174', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.224', 'ARMOR': '0.859', 'weapon2': '0.886', 'WEAPON3': '1.350', 'HITCOUNT': '2.460', 'weapon3': '2.888', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '33.000'} [2024-08-05 23:40:25,576][52649] DAMAGECOUNT value on done: 46969.0 [2024-08-05 23:40:25,577][52649] Sum rewards: 42.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.286', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'weapon4': '0.182', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.916', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '38.000'} [2024-08-05 23:40:25,795][52650] Updated weights for policy 0, policy_version 16741 (0.0028) [2024-08-05 23:40:26,305][52795] DAMAGECOUNT value on done: 44202.0 [2024-08-05 23:40:26,306][52795] Sum rewards: 28.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.162', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.070', 'weapon4': '0.124', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'weapon2': '0.626', 'WEAPON3': '1.500', 'HITCOUNT': '2.130', 'weapon3': '2.878', 'DAMAGECOUNT': '9.570', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:27,356][52794] DAMAGECOUNT value on done: 52055.0 [2024-08-05 23:40:27,359][52794] Sum rewards: 38.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.535', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.216', 'ARMOR': '0.894', 'weapon2': '0.976', 'WEAPON3': '1.100', 'HITCOUNT': '2.390', 'weapon3': '2.608', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:27,768][52662] DAMAGECOUNT value on done: 47974.0 [2024-08-05 23:40:27,768][52662] Sum rewards: 39.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'ARMOR': '0.468', 'weapon2': '0.924', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.752', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 137166848. Throughput: 0: 4406.4. Samples: 34301140. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-05 23:40:27,794][52567] Avg episode reward: [(0, '34.976')] [2024-08-05 23:40:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000016744_137166848.pth... [2024-08-05 23:40:27,914][52668] DAMAGECOUNT value on done: 50397.0 [2024-08-05 23:40:27,917][52668] Sum rewards: 38.789, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.184', 'AMMO4': '0.204', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '3.182', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '32.000'} [2024-08-05 23:40:27,955][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000016230_132956160.pth [2024-08-05 23:40:28,815][52649] DAMAGECOUNT value on done: 46960.0 [2024-08-05 23:40:28,816][52649] Sum rewards: 35.590, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.329', 'weapon4': '0.342', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'ARMOR': '1.316', 'weapon2': '1.320', 'weapon3': '2.006', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '9.330', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:29,291][52820] Large shaping reward 2.537 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.486, 162.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:40:29,481][52795] DAMAGECOUNT value on done: 44671.0 [2024-08-05 23:40:29,482][52795] Sum rewards: 22.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.902', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.038', 'weapon4': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.189', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'ARMOR': '0.857', 'weapon2': '0.862', 'WEAPON3': '1.600', 'HITCOUNT': '1.710', 'weapon3': '2.782', 'DAMAGECOUNT': '7.530', 'FRAGCOUNT': '24.000'} [2024-08-05 23:40:30,400][52794] DAMAGECOUNT value on done: 47561.0 [2024-08-05 23:40:30,402][52794] Sum rewards: 33.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.775', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.116', 'AMMO4': '0.175', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.560', 'WEAPON3': '1.450', 'HITCOUNT': '2.360', 'weapon3': '2.748', 'DAMAGECOUNT': '8.832', 'FRAGCOUNT': '32.000'} [2024-08-05 23:40:30,741][52662] DAMAGECOUNT value on done: 49824.0 [2024-08-05 23:40:30,741][52662] Sum rewards: 37.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.300', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon4': '0.208', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'ARMOR': '0.496', 'weapon2': '0.634', 'WEAPON3': '1.600', 'HITCOUNT': '2.640', 'weapon3': '2.910', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:30,755][52668] DAMAGECOUNT value on done: 44344.0 [2024-08-05 23:40:30,759][52668] Sum rewards: 22.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.569', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO2': '0.047', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO4': '0.233', 'ARMOR': '0.416', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon2': '1.152', 'HITCOUNT': '1.950', 'weapon3': '2.370', 'DAMAGECOUNT': '7.683', 'FRAGCOUNT': '22.000'} [2024-08-05 23:40:31,021][52650] Updated weights for policy 0, policy_version 16751 (0.0023) [2024-08-05 23:40:31,986][52649] DAMAGECOUNT value on done: 47838.0 [2024-08-05 23:40:31,990][52649] Sum rewards: 36.167, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.918', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.300', 'ARMOR': '0.512', 'weapon2': '0.764', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '2.636', 'DAMAGECOUNT': '9.906', 'FRAGCOUNT': '30.000'} [2024-08-05 23:40:32,666][52795] DAMAGECOUNT value on done: 42766.0 [2024-08-05 23:40:32,670][52795] Sum rewards: 38.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.118', 'AMMO3': '0.172', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.384', 'ARMOR': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.712', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '32.000'} [2024-08-05 23:40:32,794][52567] Fps is (10 sec: 17219.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 137256960. Throughput: 0: 4405.5. Samples: 34314280. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:40:32,795][52567] Avg episode reward: [(0, '34.721')] [2024-08-05 23:40:33,104][52794] DAMAGECOUNT value on done: 50675.0 [2024-08-05 23:40:33,113][52794] Sum rewards: 20.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.444', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.116', 'AMMO4': '0.118', 'weapon5': '0.154', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.966', 'ARMOR': '1.333', 'WEAPON3': '1.350', 'HITCOUNT': '1.900', 'weapon3': '2.464', 'DAMAGECOUNT': '7.539', 'FRAGCOUNT': '21.000'} [2024-08-05 23:40:33,452][52668] DAMAGECOUNT value on done: 46470.0 [2024-08-05 23:40:33,452][52668] Sum rewards: 29.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.194', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.722', 'weapon2': '1.014', 'WEAPON3': '1.100', 'weapon3': '1.876', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.829', 'FRAGCOUNT': '25.000'} [2024-08-05 23:40:33,596][52662] DAMAGECOUNT value on done: 51450.0 [2024-08-05 23:40:33,596][52662] Sum rewards: 39.421, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.152', 'AMMO2': '0.018', 'weapon7': '0.028', 'AMMO4': '0.090', 'weapon4': '0.116', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'AMMO6': '0.300', 'WEAPON7': '0.300', 'AMMO7': '0.300', 'ARMOR': '0.482', 'weapon2': '0.774', 'WEAPON3': '1.050', 'HITCOUNT': '2.260', 'weapon3': '2.842', 'DAMAGECOUNT': '9.351', 'FRAGCOUNT': '32.000'} [2024-08-05 23:40:34,916][52650] Updated weights for policy 0, policy_version 16761 (0.0013) [2024-08-05 23:40:35,089][52649] DAMAGECOUNT value on done: 46308.0 [2024-08-05 23:40:35,092][52649] Sum rewards: 36.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.182', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.406', 'ARMOR': '0.911', 'weapon2': '1.036', 'WEAPON3': '1.200', 'weapon3': '2.230', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '10.083', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:35,174][52660] DAMAGECOUNT value on done: 47930.0 [2024-08-05 23:40:35,174][52660] Sum rewards: 33.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.106', 'AMMO4': '0.168', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.764', 'WEAPON3': '1.500', 'HITCOUNT': '2.120', 'weapon3': '2.850', 'DAMAGECOUNT': '9.114', 'FRAGCOUNT': '33.000'} [2024-08-05 23:40:35,843][52795] DAMAGECOUNT value on done: 46335.0 [2024-08-05 23:40:35,844][52795] Sum rewards: 32.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.402', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'AMMO4': '0.260', 'weapon4': '0.338', 'WEAPON4': '0.400', 'ARMOR': '0.476', 'WEAPON3': '1.300', 'weapon2': '1.350', 'weapon3': '1.956', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '9.444', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:36,121][52794] DAMAGECOUNT value on done: 52014.0 [2024-08-05 23:40:36,123][52794] Sum rewards: 42.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.212', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon5': '0.104', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'ARMOR': '0.400', 'weapon2': '1.090', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.474', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:36,284][52668] DAMAGECOUNT value on done: 47624.0 [2024-08-05 23:40:36,284][52668] Sum rewards: 42.340, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.547', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.338', 'weapon2': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '35.000'} [2024-08-05 23:40:36,718][52662] DAMAGECOUNT value on done: 53109.0 [2024-08-05 23:40:36,718][52662] Sum rewards: 34.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.168', 'AMMO3': '0.209', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.974', 'WEAPON3': '1.250', 'weapon3': '2.296', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:37,539][52649] DAMAGECOUNT value on done: 43396.0 [2024-08-05 23:40:37,541][52649] Sum rewards: 44.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.060', 'weapon4': '0.134', 'AMMO4': '0.157', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.960', 'weapon2': '1.046', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.478', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '38.000'} [2024-08-05 23:40:37,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 137355264. Throughput: 0: 4403.1. Samples: 34340690. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:40:37,794][52567] Avg episode reward: [(0, '34.712')] [2024-08-05 23:40:38,094][52660] DAMAGECOUNT value on done: 49097.0 [2024-08-05 23:40:38,094][52660] Sum rewards: 34.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.336', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.167', 'ARMOR': '0.455', 'weapon2': '0.970', 'WEAPON3': '1.000', 'HITCOUNT': '2.280', 'weapon3': '2.740', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:38,944][52795] DAMAGECOUNT value on done: 47686.0 [2024-08-05 23:40:38,945][52795] Sum rewards: 38.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.518', 'AMMO2': '0.037', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.182', 'WEAPON7': '0.200', 'AMMO3': '0.220', 'ARMOR': '0.444', 'WEAPON4': '0.500', 'weapon4': '0.504', 'weapon2': '0.736', 'WEAPON3': '1.350', 'HITCOUNT': '2.320', 'weapon3': '2.458', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:39,150][52794] DAMAGECOUNT value on done: 52129.0 [2024-08-05 23:40:39,151][52794] Sum rewards: 26.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.492', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.217', 'weapon4': '0.256', 'WEAPON4': '0.400', 'ARMOR': '0.855', 'weapon2': '0.888', 'WEAPON3': '1.300', 'HITCOUNT': '1.980', 'weapon3': '2.632', 'DAMAGECOUNT': '7.830', 'FRAGCOUNT': '26.000'} [2024-08-05 23:40:39,151][52668] DAMAGECOUNT value on done: 48248.0 [2024-08-05 23:40:39,153][52668] Sum rewards: 29.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO3': '0.125', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'ARMOR': '1.345', 'weapon2': '1.472', 'HITCOUNT': '2.000', 'weapon3': '2.204', 'DAMAGECOUNT': '7.176', 'FRAGCOUNT': '24.000'} [2024-08-05 23:40:39,698][52662] DAMAGECOUNT value on done: 55737.0 [2024-08-05 23:40:39,699][52662] Sum rewards: 41.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.771', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.138', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'ARMOR': '0.852', 'WEAPON3': '1.150', 'weapon2': '1.238', 'HITCOUNT': '2.360', 'weapon3': '2.468', 'DAMAGECOUNT': '9.306', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:39,874][52650] Updated weights for policy 0, policy_version 16771 (0.0011) [2024-08-05 23:40:40,219][52664] DAMAGECOUNT value on done: 47750.0 [2024-08-05 23:40:40,220][52664] Sum rewards: 37.223, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.260', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO3': '0.142', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.256', 'ARMOR': '0.404', 'WEAPON3': '0.850', 'weapon2': '0.982', 'HITCOUNT': '2.380', 'weapon3': '2.436', 'DAMAGECOUNT': '9.594', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:40,348][52649] DAMAGECOUNT value on done: 48639.0 [2024-08-05 23:40:40,349][52649] Sum rewards: 32.276, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.082', 'AMMO3': '0.150', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.892', 'WEAPON3': '1.000', 'weapon2': '1.174', 'HITCOUNT': '2.040', 'weapon3': '2.462', 'DAMAGECOUNT': '9.240', 'FRAGCOUNT': '26.000'} [2024-08-05 23:40:40,722][52660] DAMAGECOUNT value on done: 46847.0 [2024-08-05 23:40:40,723][52660] Sum rewards: 32.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.516', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.032', 'weapon4': '0.138', 'AMMO4': '0.162', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.200', 'ARMOR': '1.348', 'HITCOUNT': '2.540', 'weapon3': '2.892', 'DAMAGECOUNT': '9.756', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:41,670][52668] DAMAGECOUNT value on done: 48424.0 [2024-08-05 23:40:41,672][52668] Sum rewards: 18.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.032', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.161', 'WEAPON4': '0.350', 'ARMOR': '0.472', 'WEAPON3': '0.950', 'weapon2': '1.386', 'HITCOUNT': '1.650', 'weapon3': '2.178', 'DAMAGECOUNT': '6.111', 'FRAGCOUNT': '19.000'} [2024-08-05 23:40:41,730][52794] DAMAGECOUNT value on done: 49654.0 [2024-08-05 23:40:41,730][52794] Sum rewards: 46.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon4': '0.076', 'AMMO3': '0.164', 'WEAPON3': '1.050', 'ARMOR': '1.256', 'weapon2': '1.302', 'weapon3': '2.346', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '39.000'} [2024-08-05 23:40:42,076][52662] DAMAGECOUNT value on done: 49917.0 [2024-08-05 23:40:42,076][52662] Sum rewards: 36.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.261', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.454', 'WEAPON3': '1.000', 'weapon2': '1.038', 'ARMOR': '1.371', 'weapon3': '2.120', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '9.765', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:42,107][52795] DAMAGECOUNT value on done: 42131.0 [2024-08-05 23:40:42,107][52795] Sum rewards: 36.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.160', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'weapon4': '0.480', 'WEAPON3': '1.000', 'weapon2': '1.120', 'weapon3': '2.060', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.299', 'FRAGCOUNT': '30.000'} [2024-08-05 23:40:42,773][52649] DAMAGECOUNT value on done: 42670.0 [2024-08-05 23:40:42,774][52649] Sum rewards: 26.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.406', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.172', 'AMMO3': '0.235', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON4': '0.500', 'ARMOR': '0.915', 'weapon2': '1.008', 'WEAPON3': '1.450', 'weapon3': '2.054', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '8.820', 'FRAGCOUNT': '24.000'} [2024-08-05 23:40:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 137437184. Throughput: 0: 4403.3. Samples: 34366950. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:40:42,794][52567] Avg episode reward: [(0, '34.557')] [2024-08-05 23:40:42,996][52658] Large shaping reward 3.303 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.252, 84.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:40:43,309][52664] DAMAGECOUNT value on done: 47689.0 [2024-08-05 23:40:43,309][52664] Sum rewards: 53.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.642', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO3': '0.165', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'weapon4': '0.448', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.658', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '44.000'} [2024-08-05 23:40:43,631][52660] DAMAGECOUNT value on done: 47529.0 [2024-08-05 23:40:43,631][52660] Sum rewards: 35.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.237', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.070', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'weapon4': '0.312', 'ARMOR': '0.424', 'WEAPON4': '0.500', 'weapon2': '0.734', 'WEAPON3': '1.450', 'HITCOUNT': '2.390', 'weapon3': '2.596', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:44,570][52794] DAMAGECOUNT value on done: 51819.0 [2024-08-05 23:40:44,570][52794] Sum rewards: 37.791, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.129', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'WEAPON3': '0.750', 'weapon2': '1.060', 'HITCOUNT': '2.240', 'weapon3': '2.682', 'DAMAGECOUNT': '8.760', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:44,727][52668] DAMAGECOUNT value on done: 49167.0 [2024-08-05 23:40:44,730][52668] Sum rewards: 28.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.934', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.062', 'AMMO3': '0.176', 'weapon4': '0.244', 'weapon2': '0.622', 'ARMOR': '0.800', 'WEAPON3': '1.100', 'HITCOUNT': '1.950', 'weapon3': '2.422', 'DAMAGECOUNT': '8.478', 'FRAGCOUNT': '24.000'} [2024-08-05 23:40:44,760][52650] Updated weights for policy 0, policy_version 16781 (0.0011) [2024-08-05 23:40:44,884][52662] DAMAGECOUNT value on done: 51682.0 [2024-08-05 23:40:44,885][52662] Sum rewards: 38.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.102', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.074', 'AMMO3': '0.182', 'AMMO4': '0.257', 'weapon4': '0.290', 'WEAPON5': '0.300', 'ARMOR': '0.487', 'WEAPON4': '0.500', 'weapon2': '0.726', 'WEAPON3': '1.150', 'HITCOUNT': '2.320', 'weapon3': '2.594', 'DAMAGECOUNT': '9.558', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:45,338][52795] DAMAGECOUNT value on done: 43565.0 [2024-08-05 23:40:45,338][52795] Sum rewards: 43.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'ARMOR': '0.489', 'weapon2': '1.136', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '2.476', 'DAMAGECOUNT': '9.984', 'FRAGCOUNT': '39.000'} [2024-08-05 23:40:45,744][52664] DAMAGECOUNT value on done: 50274.0 [2024-08-05 23:40:45,745][52664] Sum rewards: 35.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon7': '0.060', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.518', 'weapon2': '0.702', 'WEAPON3': '1.150', 'HITCOUNT': '2.160', 'weapon3': '2.432', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:45,883][52649] DAMAGECOUNT value on done: 46961.0 [2024-08-05 23:40:45,883][52649] Sum rewards: 39.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.631', 'AMMO2': '0.014', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.233', 'ARMOR': '0.800', 'weapon2': '0.986', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '2.774', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:46,690][52660] DAMAGECOUNT value on done: 43219.0 [2024-08-05 23:40:46,691][52660] Sum rewards: 37.723, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.406', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO5': '0.021', 'AMMO4': '0.069', 'weapon5': '0.074', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'ARMOR': '0.896', 'weapon2': '1.060', 'WEAPON3': '1.100', 'HITCOUNT': '2.330', 'weapon3': '2.560', 'DAMAGECOUNT': '8.778', 'FRAGCOUNT': '32.000'} [2024-08-05 23:40:47,366][52794] DAMAGECOUNT value on done: 54201.0 [2024-08-05 23:40:47,367][52794] Sum rewards: 44.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.746', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.186', 'AMMO4': '0.205', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.864', 'ARMOR': '0.884', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '2.588', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:47,606][52668] DAMAGECOUNT value on done: 47078.0 [2024-08-05 23:40:47,617][52668] Sum rewards: 40.577, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'HEALTH': '0.311', 'weapon2': '0.424', 'ARMOR': '0.820', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '3.078', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 137519104. Throughput: 0: 4403.3. Samples: 34380130. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:40:47,795][52567] Avg episode reward: [(0, '35.166')] [2024-08-05 23:40:47,837][52662] DAMAGECOUNT value on done: 51116.0 [2024-08-05 23:40:47,837][52662] Sum rewards: 37.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.406', 'WEAPON3': '0.950', 'weapon2': '1.042', 'ARMOR': '1.779', 'HITCOUNT': '2.190', 'weapon3': '2.214', 'DAMAGECOUNT': '9.468', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:48,271][52664] DAMAGECOUNT value on done: 49113.0 [2024-08-05 23:40:48,271][52664] Sum rewards: 39.193, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.122', 'AMMO5': '0.010', 'ARMOR': '0.028', 'weapon4': '0.030', 'weapon5': '0.036', 'AMMO2': '0.040', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.660', 'WEAPON3': '1.500', 'HITCOUNT': '2.580', 'weapon3': '2.990', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '37.000'} [2024-08-05 23:40:48,403][52795] DAMAGECOUNT value on done: 45522.0 [2024-08-05 23:40:48,404][52795] Sum rewards: 40.419, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.230', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.058', 'weapon5': '0.068', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.284', 'ARMOR': '0.455', 'weapon2': '0.722', 'WEAPON3': '1.650', 'HITCOUNT': '2.460', 'weapon3': '2.820', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '39.000'} [2024-08-05 23:40:48,940][52650] Updated weights for policy 0, policy_version 16791 (0.0032) [2024-08-05 23:40:49,014][52649] DAMAGECOUNT value on done: 45703.0 [2024-08-05 23:40:49,015][52649] Sum rewards: 28.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.785', 'AMMO5': '0.021', 'AMMO2': '0.079', 'AMMO3': '0.179', 'weapon5': '0.212', 'AMMO4': '0.394', 'WEAPON5': '0.450', 'ARMOR': '0.460', 'weapon4': '0.478', 'weapon2': '0.518', 'WEAPON4': '0.950', 'WEAPON3': '1.200', 'HITCOUNT': '1.640', 'weapon3': '2.384', 'DAMAGECOUNT': '7.485', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:49,325][52660] DAMAGECOUNT value on done: 48558.0 [2024-08-05 23:40:49,325][52660] Sum rewards: 34.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.028', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.024', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.564', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '2.816', 'DAMAGECOUNT': '10.137', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:50,298][52794] DAMAGECOUNT value on done: 53234.0 [2024-08-05 23:40:50,308][52794] Sum rewards: 33.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'weapon5': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.192', 'weapon4': '0.226', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '1.010', 'WEAPON3': '1.200', 'ARMOR': '1.248', 'HITCOUNT': '2.210', 'weapon3': '2.536', 'DAMAGECOUNT': '9.012', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:50,418][52668] DAMAGECOUNT value on done: 49502.0 [2024-08-05 23:40:50,418][52668] Sum rewards: 28.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'ARMOR': '0.857', 'weapon2': '1.116', 'WEAPON3': '1.150', 'HITCOUNT': '2.160', 'weapon3': '2.608', 'DAMAGECOUNT': '8.895', 'FRAGCOUNT': '26.000'} [2024-08-05 23:40:50,549][52662] DAMAGECOUNT value on done: 50871.0 [2024-08-05 23:40:50,551][52662] Sum rewards: 28.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.305', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.185', 'AMMO4': '0.259', 'ARMOR': '0.516', 'WEAPON4': '0.600', 'weapon2': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.080', 'weapon3': '2.972', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '27.000'} [2024-08-05 23:40:51,353][52664] DAMAGECOUNT value on done: 47046.0 [2024-08-05 23:40:51,353][52664] Sum rewards: 22.230, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.864', 'AMMO5': '0.007', 'weapon5': '0.020', 'weapon4': '0.036', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO4': '0.224', 'AMMO3': '0.297', 'WEAPON4': '0.350', 'ARMOR': '0.454', 'weapon2': '0.860', 'WEAPON3': '1.750', 'HITCOUNT': '2.080', 'weapon3': '2.756', 'DAMAGECOUNT': '8.565', 'FRAGCOUNT': '24.000'} [2024-08-05 23:40:51,845][52649] DAMAGECOUNT value on done: 50249.0 [2024-08-05 23:40:51,847][52649] Sum rewards: 34.240, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.158', 'AMMO5': '0.023', 'weapon5': '0.030', 'AMMO2': '0.052', 'AMMO3': '0.221', 'AMMO4': '0.261', 'weapon4': '0.266', 'WEAPON5': '0.350', 'ARMOR': '0.489', 'WEAPON4': '0.600', 'weapon2': '0.910', 'WEAPON3': '1.350', 'weapon3': '2.506', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '35.000'} [2024-08-05 23:40:52,566][52660] DAMAGECOUNT value on done: 49265.0 [2024-08-05 23:40:52,567][52660] Sum rewards: 49.862, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'HEALTH': '0.554', 'weapon2': '0.714', 'ARMOR': '0.871', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.976', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '42.000'} [2024-08-05 23:40:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 137617408. Throughput: 0: 4402.7. Samples: 34406800. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:40:52,794][52567] Avg episode reward: [(0, '34.750')] [2024-08-05 23:40:53,435][52794] DAMAGECOUNT value on done: 53895.0 [2024-08-05 23:40:53,436][52794] Sum rewards: 33.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.836', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.237', 'weapon4': '0.302', 'WEAPON4': '0.350', 'ARMOR': '0.417', 'weapon2': '0.598', 'WEAPON3': '1.550', 'HITCOUNT': '2.360', 'weapon3': '2.784', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '33.000'} [2024-08-05 23:40:53,625][52668] DAMAGECOUNT value on done: 46323.0 [2024-08-05 23:40:53,625][52668] Sum rewards: 36.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.062', 'weapon5': '0.094', 'AMMO3': '0.216', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'ARMOR': '0.448', 'WEAPON4': '0.500', 'weapon2': '0.772', 'WEAPON3': '1.400', 'HITCOUNT': '2.240', 'weapon3': '2.772', 'DAMAGECOUNT': '10.164', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:53,798][52662] DAMAGECOUNT value on done: 53417.0 [2024-08-05 23:40:53,799][52662] Sum rewards: 43.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.097', 'weapon4': '0.164', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '1.010', 'WEAPON3': '1.200', 'ARMOR': '1.921', 'weapon3': '2.528', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '37.000'} [2024-08-05 23:40:54,016][52650] Updated weights for policy 0, policy_version 16801 (0.0052) [2024-08-05 23:40:54,451][52664] DAMAGECOUNT value on done: 51668.0 [2024-08-05 23:40:54,453][52664] Sum rewards: 37.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.276', 'AMMO5': '0.005', 'weapon4': '0.036', 'AMMO2': '0.047', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.237', 'WEAPON4': '0.450', 'ARMOR': '0.921', 'weapon2': '1.088', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.544', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '30.500'} [2024-08-05 23:40:55,750][52660] DAMAGECOUNT value on done: 47348.0 [2024-08-05 23:40:55,752][52660] Sum rewards: 34.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.336', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'weapon4': '0.448', 'weapon2': '0.638', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.688', 'DAMAGECOUNT': '9.129', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:56,331][52794] DAMAGECOUNT value on done: 50915.0 [2024-08-05 23:40:56,332][52794] Sum rewards: 36.095, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.120', 'HEALTH': '0.562', 'WEAPON3': '0.700', 'ARMOR': '1.200', 'weapon2': '1.284', 'HITCOUNT': '2.190', 'weapon3': '2.584', 'DAMAGECOUNT': '8.433', 'FRAGCOUNT': '28.000'} [2024-08-05 23:40:56,561][52662] DAMAGECOUNT value on done: 50977.0 [2024-08-05 23:40:56,563][52662] Sum rewards: 40.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'ARMOR': '0.400', 'weapon2': '0.840', 'WEAPON3': '1.400', 'HITCOUNT': '2.430', 'weapon3': '2.944', 'DAMAGECOUNT': '10.050', 'FRAGCOUNT': '36.000'} [2024-08-05 23:40:56,651][52668] DAMAGECOUNT value on done: 46646.0 [2024-08-05 23:40:56,651][52668] Sum rewards: 26.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.605', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '1.178', 'WEAPON3': '1.200', 'ARMOR': '1.204', 'HITCOUNT': '2.180', 'weapon3': '2.430', 'DAMAGECOUNT': '8.610', 'FRAGCOUNT': '24.000'} [2024-08-05 23:40:56,776][52664] DAMAGECOUNT value on done: 49217.0 [2024-08-05 23:40:56,778][52664] Sum rewards: 38.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.080', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.820', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '2.556', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '34.000'} [2024-08-05 23:40:57,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 137707520. Throughput: 0: 4398.0. Samples: 34432920. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 23:40:57,794][52567] Avg episode reward: [(0, '34.667')] [2024-08-05 23:40:58,590][52650] Updated weights for policy 0, policy_version 16811 (0.0016) [2024-08-05 23:40:58,816][52660] DAMAGECOUNT value on done: 46928.0 [2024-08-05 23:40:58,819][52660] Sum rewards: 35.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.874', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.048', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.886', 'ARMOR': '0.906', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '2.738', 'DAMAGECOUNT': '9.924', 'FRAGCOUNT': '29.000'} [2024-08-05 23:40:59,296][52794] DAMAGECOUNT value on done: 56550.0 [2024-08-05 23:40:59,297][52794] Sum rewards: 38.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.022', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon4': '0.366', 'ARMOR': '0.531', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.464', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.935', 'FRAGCOUNT': '33.000'} [2024-08-05 23:40:59,582][52662] DAMAGECOUNT value on done: 51890.0 [2024-08-05 23:40:59,584][52664] DAMAGECOUNT value on done: 46763.0 [2024-08-05 23:40:59,582][52662] Sum rewards: 34.536, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.046', 'weapon4': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.933', 'weapon2': '0.952', 'WEAPON3': '1.200', 'HITCOUNT': '2.170', 'weapon3': '2.504', 'DAMAGECOUNT': '8.502', 'FRAGCOUNT': '31.000'} [2024-08-05 23:40:59,585][52664] Sum rewards: 40.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.017', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.260', 'AMMO3': '0.272', 'weapon2': '0.502', 'ARMOR': '1.347', 'WEAPON3': '1.600', 'HITCOUNT': '2.580', 'weapon3': '2.946', 'DAMAGECOUNT': '11.538', 'FRAGCOUNT': '37.000'} [2024-08-05 23:40:59,786][52668] DAMAGECOUNT value on done: 44235.0 [2024-08-05 23:40:59,786][52668] Sum rewards: 29.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.214', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.038', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.182', 'ARMOR': '0.858', 'weapon2': '1.056', 'WEAPON3': '1.150', 'HITCOUNT': '2.000', 'weapon3': '2.562', 'DAMAGECOUNT': '8.820', 'FRAGCOUNT': '25.500'} [2024-08-05 23:41:01,403][52660] DAMAGECOUNT value on done: 47671.0 [2024-08-05 23:41:01,405][52660] Sum rewards: 37.545, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.013', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'WEAPON3': '0.850', 'weapon2': '1.546', 'ARMOR': '1.703', 'weapon3': '2.194', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '30.000'} [2024-08-05 23:41:02,435][52794] DAMAGECOUNT value on done: 49937.0 [2024-08-05 23:41:02,436][52794] Sum rewards: 37.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.154', 'AMMO3': '0.187', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.788', 'WEAPON3': '1.200', 'HITCOUNT': '2.550', 'weapon3': '2.654', 'DAMAGECOUNT': '10.953', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:02,451][52668] DAMAGECOUNT value on done: 47556.0 [2024-08-05 23:41:02,453][52668] Sum rewards: 28.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.961', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.222', 'weapon4': '0.308', 'WEAPON4': '0.400', 'weapon2': '0.592', 'WEAPON3': '1.150', 'HITCOUNT': '2.070', 'weapon3': '2.690', 'DAMAGECOUNT': '8.973', 'FRAGCOUNT': '26.000'} [2024-08-05 23:41:02,579][52662] DAMAGECOUNT value on done: 53363.0 [2024-08-05 23:41:02,579][52662] Sum rewards: 33.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.659', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.028', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'WEAPON7': '0.200', 'weapon2': '0.428', 'weapon4': '0.690', 'WEAPON3': '1.000', 'HITCOUNT': '2.140', 'weapon3': '2.150', 'DAMAGECOUNT': '8.694', 'FRAGCOUNT': '29.000'} [2024-08-05 23:41:02,580][52664] DAMAGECOUNT value on done: 54368.0 [2024-08-05 23:41:02,580][52664] Sum rewards: 41.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.372', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.040', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.830', 'ARMOR': '0.854', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '2.790', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 137789440. Throughput: 0: 4399.1. Samples: 34446290. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-05 23:41:02,794][52567] Avg episode reward: [(0, '34.866')] [2024-08-05 23:41:03,138][52667] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:41:03,176][52650] Updated weights for policy 0, policy_version 16821 (0.0030) [2024-08-05 23:41:04,411][52660] DAMAGECOUNT value on done: 46905.0 [2024-08-05 23:41:04,412][52660] Sum rewards: 36.830, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.804', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.602', 'ARMOR': '0.882', 'WEAPON3': '1.000', 'weapon2': '1.020', 'weapon3': '2.114', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.462', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:04,916][52794] DAMAGECOUNT value on done: 52843.0 [2024-08-05 23:41:04,916][52794] Sum rewards: 29.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.838', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon4': '0.176', 'weapon5': '0.278', 'weapon2': '0.906', 'ARMOR': '0.984', 'WEAPON3': '1.050', 'HITCOUNT': '2.140', 'weapon3': '2.380', 'DAMAGECOUNT': '9.141', 'FRAGCOUNT': '25.000'} [2024-08-05 23:41:05,106][52662] DAMAGECOUNT value on done: 49754.0 [2024-08-05 23:41:05,108][52662] Sum rewards: 39.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'AMMO2': '0.038', 'ARMOR': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon4': '0.176', 'AMMO4': '0.188', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon2': '1.158', 'HITCOUNT': '2.340', 'weapon3': '2.446', 'DAMAGECOUNT': '9.738', 'FRAGCOUNT': '34.000'} [2024-08-05 23:41:05,460][52668] DAMAGECOUNT value on done: 47528.0 [2024-08-05 23:41:05,461][52668] Sum rewards: 33.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.768', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.248', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.908', 'WEAPON3': '1.300', 'HITCOUNT': '2.260', 'weapon3': '2.490', 'DAMAGECOUNT': '9.282', 'FRAGCOUNT': '30.000'} [2024-08-05 23:41:05,650][52664] DAMAGECOUNT value on done: 48881.0 [2024-08-05 23:41:05,650][52664] Sum rewards: 27.717, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.233', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon5': '0.060', 'weapon4': '0.172', 'AMMO3': '0.191', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'ARMOR': '0.921', 'weapon2': '1.218', 'WEAPON3': '1.250', 'HITCOUNT': '2.150', 'weapon3': '2.274', 'DAMAGECOUNT': '9.078', 'FRAGCOUNT': '28.000'} [2024-08-05 23:41:07,348][52660] DAMAGECOUNT value on done: 47291.0 [2024-08-05 23:41:07,358][52660] Sum rewards: 42.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.788', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.212', 'weapon4': '0.344', 'weapon2': '0.784', 'ARMOR': '0.915', 'WEAPON3': '1.350', 'weapon3': '2.608', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:07,602][52794] DAMAGECOUNT value on done: 54836.0 [2024-08-05 23:41:07,604][52794] Sum rewards: 47.400, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.137', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.159', 'weapon4': '0.428', 'weapon2': '0.772', 'WEAPON3': '1.050', 'ARMOR': '1.741', 'weapon3': '2.314', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '38.000'} [2024-08-05 23:41:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 137871360. Throughput: 0: 4396.5. Samples: 34472780. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 23:41:07,794][52567] Avg episode reward: [(0, '35.250')] [2024-08-05 23:41:07,812][52650] Updated weights for policy 0, policy_version 16831 (0.0011) [2024-08-05 23:41:07,867][52662] DAMAGECOUNT value on done: 52759.0 [2024-08-05 23:41:07,869][52662] Sum rewards: 38.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.232', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.660', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '10.551', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:07,980][52668] DAMAGECOUNT value on done: 48090.0 [2024-08-05 23:41:07,982][52668] Sum rewards: 37.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.136', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.090', 'AMMO4': '0.167', 'AMMO3': '0.174', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.732', 'ARMOR': '0.878', 'WEAPON3': '1.050', 'HITCOUNT': '2.290', 'weapon3': '2.670', 'DAMAGECOUNT': '10.059', 'FRAGCOUNT': '32.000'} [2024-08-05 23:41:08,726][52664] DAMAGECOUNT value on done: 51463.0 [2024-08-05 23:41:08,728][52664] Sum rewards: 31.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.911', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.760', 'ARMOR': '0.800', 'WEAPON3': '1.400', 'HITCOUNT': '2.300', 'weapon3': '3.004', 'DAMAGECOUNT': '9.414', 'FRAGCOUNT': '28.000'} [2024-08-05 23:41:09,721][52660] DAMAGECOUNT value on done: 46154.0 [2024-08-05 23:41:09,722][52660] Sum rewards: 39.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.321', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.202', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'ARMOR': '0.450', 'weapon2': '1.162', 'WEAPON3': '1.400', 'weapon3': '2.160', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:10,325][52794] DAMAGECOUNT value on done: 53345.0 [2024-08-05 23:41:10,328][52794] Sum rewards: 34.862, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.656', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.297', 'weapon2': '1.168', 'WEAPON3': '1.750', 'ARMOR': '2.139', 'HITCOUNT': '2.400', 'weapon3': '2.578', 'DAMAGECOUNT': '10.128', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:10,550][52662] DAMAGECOUNT value on done: 52446.0 [2024-08-05 23:41:10,550][52662] Sum rewards: 39.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.067', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'ARMOR': '0.867', 'weapon2': '0.906', 'WEAPON3': '1.150', 'HITCOUNT': '2.430', 'weapon3': '2.674', 'DAMAGECOUNT': '10.797', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:10,777][52668] DAMAGECOUNT value on done: 46053.0 [2024-08-05 23:41:10,777][52668] Sum rewards: 33.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.754', 'weapon5': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.104', 'AMMO3': '0.200', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'ARMOR': '0.444', 'WEAPON4': '0.500', 'weapon2': '0.860', 'WEAPON3': '1.100', 'HITCOUNT': '2.020', 'weapon3': '2.744', 'DAMAGECOUNT': '8.547', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:11,595][52820] DAMAGECOUNT value on done: 41694.0 [2024-08-05 23:41:11,595][52820] Sum rewards: 36.821, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO4': '0.127', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon4': '0.368', 'ARMOR': '0.408', 'weapon2': '0.732', 'WEAPON3': '1.100', 'HITCOUNT': '2.340', 'weapon3': '2.632', 'DAMAGECOUNT': '9.780', 'FRAGCOUNT': '32.000'} [2024-08-05 23:41:11,671][52664] DAMAGECOUNT value on done: 47936.0 [2024-08-05 23:41:11,673][52664] Sum rewards: 43.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.578', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon2': '0.878', 'WEAPON3': '1.000', 'ARMOR': '1.253', 'HITCOUNT': '2.600', 'weapon3': '2.876', 'DAMAGECOUNT': '9.858', 'FRAGCOUNT': '37.500'} [2024-08-05 23:41:12,552][52650] Updated weights for policy 0, policy_version 16841 (0.0028) [2024-08-05 23:41:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 137961472. Throughput: 0: 4409.1. Samples: 34499550. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 23:41:12,795][52567] Avg episode reward: [(0, '35.717')] [2024-08-05 23:41:12,880][52660] DAMAGECOUNT value on done: 47571.0 [2024-08-05 23:41:12,883][52660] Sum rewards: 25.989, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.050', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.040', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.104', 'WEAPON4': '0.200', 'ARMOR': '0.454', 'WEAPON3': '0.700', 'weapon3': '1.606', 'HITCOUNT': '1.650', 'weapon2': '2.192', 'DAMAGECOUNT': '6.819', 'FRAGCOUNT': '19.000'} [2024-08-05 23:41:13,156][52794] DAMAGECOUNT value on done: 54015.0 [2024-08-05 23:41:13,159][52794] Sum rewards: 48.531, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO2': '0.021', 'weapon4': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.904', 'ARMOR': '0.913', 'WEAPON3': '1.550', 'HITCOUNT': '2.730', 'weapon3': '2.802', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '46.000'} [2024-08-05 23:41:13,407][52662] DAMAGECOUNT value on done: 52365.0 [2024-08-05 23:41:13,410][52662] Sum rewards: 42.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.482', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.114', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.590', 'weapon4': '0.670', 'ARMOR': '0.842', 'WEAPON3': '1.150', 'weapon3': '2.364', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.202', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:13,882][52669] DAMAGECOUNT value on done: 48156.0 [2024-08-05 23:41:13,883][52669] Sum rewards: 45.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.214', 'ARMOR': '0.956', 'weapon2': '1.052', 'WEAPON3': '1.150', 'weapon3': '2.530', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '39.000'} [2024-08-05 23:41:13,887][52668] DAMAGECOUNT value on done: 44986.0 [2024-08-05 23:41:13,887][52668] Sum rewards: 34.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO4': '0.123', 'weapon4': '0.198', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.768', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.730', 'DAMAGECOUNT': '9.156', 'FRAGCOUNT': '30.000'} [2024-08-05 23:41:14,052][52664] DAMAGECOUNT value on done: 48949.0 [2024-08-05 23:41:14,052][52664] Sum rewards: 44.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'ARMOR': '0.440', 'weapon2': '0.906', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:14,747][52820] DAMAGECOUNT value on done: 44333.0 [2024-08-05 23:41:14,747][52820] Sum rewards: 36.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.052', 'weapon4': '0.128', 'AMMO4': '0.161', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '1.052', 'WEAPON3': '1.100', 'ARMOR': '1.200', 'HITCOUNT': '2.070', 'weapon3': '2.570', 'DAMAGECOUNT': '9.297', 'FRAGCOUNT': '32.000'} [2024-08-05 23:41:15,943][52660] DAMAGECOUNT value on done: 51334.0 [2024-08-05 23:41:15,945][52660] Sum rewards: 31.050, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.268', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.288', 'ARMOR': '0.822', 'weapon2': '1.078', 'WEAPON3': '1.600', 'HITCOUNT': '2.150', 'weapon3': '2.658', 'DAMAGECOUNT': '8.823', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:16,184][52794] DAMAGECOUNT value on done: 52953.0 [2024-08-05 23:41:16,187][52794] Sum rewards: 43.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.952', 'weapon5': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.169', 'ARMOR': '0.507', 'weapon2': '1.016', 'WEAPON3': '1.100', 'HITCOUNT': '2.630', 'weapon3': '2.738', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:16,460][52669] DAMAGECOUNT value on done: 48358.0 [2024-08-05 23:41:16,461][52669] Sum rewards: 44.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.475', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.148', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon4': '0.536', 'weapon2': '0.596', 'WEAPON3': '0.850', 'weapon3': '2.556', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:16,962][52664] DAMAGECOUNT value on done: 48601.0 [2024-08-05 23:41:16,962][52664] Sum rewards: 36.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.182', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.254', 'ARMOR': '0.855', 'weapon2': '0.906', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.620', 'DAMAGECOUNT': '10.857', 'FRAGCOUNT': '32.000'} [2024-08-05 23:41:16,983][52668] DAMAGECOUNT value on done: 49094.0 [2024-08-05 23:41:16,984][52668] Sum rewards: 43.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.514', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.026', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.208', 'ARMOR': '0.857', 'weapon2': '1.102', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '38.000'} [2024-08-05 23:41:17,288][52650] Updated weights for policy 0, policy_version 16851 (0.0012) [2024-08-05 23:41:17,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 138059776. Throughput: 0: 4410.0. Samples: 34512730. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-05 23:41:17,795][52567] Avg episode reward: [(0, '36.212')] [2024-08-05 23:41:18,000][52820] DAMAGECOUNT value on done: 42989.0 [2024-08-05 23:41:18,004][52820] Sum rewards: 45.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.710', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '39.000'} [2024-08-05 23:41:19,315][52669] DAMAGECOUNT value on done: 47972.0 [2024-08-05 23:41:19,315][52669] Sum rewards: 39.188, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.012', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.048', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.131', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.672', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '2.522', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '32.000'} [2024-08-05 23:41:19,604][52660] DAMAGECOUNT value on done: 45837.0 [2024-08-05 23:41:19,606][52660] Sum rewards: 28.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.936', 'AMMO2': '0.023', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.164', 'WEAPON3': '1.150', 'weapon2': '1.150', 'ARMOR': '1.200', 'HITCOUNT': '1.720', 'weapon3': '2.534', 'DAMAGECOUNT': '6.624', 'FRAGCOUNT': '26.000'} [2024-08-05 23:41:19,975][52664] DAMAGECOUNT value on done: 52246.0 [2024-08-05 23:41:19,975][52664] Sum rewards: 41.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.072', 'weapon5': '0.100', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'weapon2': '0.664', 'ARMOR': '0.948', 'WEAPON3': '1.450', 'HITCOUNT': '2.630', 'weapon3': '2.912', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:20,266][52668] DAMAGECOUNT value on done: 48738.0 [2024-08-05 23:41:20,267][52668] Sum rewards: 12.431, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.697', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.036', 'weapon7': '0.054', 'weapon5': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '0.850', 'HITCOUNT': '0.980', 'weapon4': '1.474', 'weapon3': '1.598', 'DAMAGECOUNT': '4.878', 'FRAGCOUNT': '11.000'} [2024-08-05 23:41:21,164][52820] DAMAGECOUNT value on done: 42122.0 [2024-08-05 23:41:21,166][52820] Sum rewards: 40.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.972', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.052', 'weapon4': '0.056', 'AMMO3': '0.186', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.800', 'WEAPON3': '1.100', 'weapon2': '1.106', 'HITCOUNT': '2.410', 'weapon3': '2.542', 'DAMAGECOUNT': '9.450', 'FRAGCOUNT': '34.000'} [2024-08-05 23:41:21,767][52650] Updated weights for policy 0, policy_version 16861 (0.0014) [2024-08-05 23:41:22,242][52669] DAMAGECOUNT value on done: 46945.0 [2024-08-05 23:41:22,243][52669] Sum rewards: 34.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.531', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.136', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.300', 'ARMOR': '0.436', 'weapon2': '1.008', 'WEAPON3': '1.200', 'weapon3': '2.326', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:22,427][52660] DAMAGECOUNT value on done: 47653.0 [2024-08-05 23:41:22,431][52660] Sum rewards: 27.254, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.677', 'AMMO5': '0.012', 'weapon5': '0.014', 'weapon7': '0.032', 'AMMO2': '0.045', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.120', 'AMMO3': '0.155', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.990', 'WEAPON3': '1.000', 'ARMOR': '1.332', 'HITCOUNT': '1.740', 'weapon3': '2.448', 'DAMAGECOUNT': '7.566', 'FRAGCOUNT': '22.000'} [2024-08-05 23:41:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17615.7, 300 sec: 17605.9). Total num frames: 138141696. Throughput: 0: 4406.2. Samples: 34538970. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-05 23:41:22,802][52567] Avg episode reward: [(0, '36.247')] [2024-08-05 23:41:23,011][52664] DAMAGECOUNT value on done: 47708.0 [2024-08-05 23:41:23,013][52664] Sum rewards: 34.205, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.926', 'weapon5': '0.008', 'AMMO5': '0.025', 'ARMOR': '0.040', 'AMMO2': '0.061', 'weapon4': '0.104', 'AMMO3': '0.263', 'AMMO4': '0.303', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'HITCOUNT': '2.190', 'weapon3': '3.120', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:24,298][52820] DAMAGECOUNT value on done: 42352.0 [2024-08-05 23:41:24,298][52820] Sum rewards: 22.854, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.852', 'AMMO2': '0.025', 'weapon7': '0.086', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.168', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.402', 'weapon2': '0.848', 'WEAPON3': '1.150', 'HITCOUNT': '1.540', 'weapon3': '2.436', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '22.000'} [2024-08-05 23:41:25,294][52669] DAMAGECOUNT value on done: 48727.0 [2024-08-05 23:41:25,294][52669] Sum rewards: 31.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.562', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.296', 'WEAPON3': '1.100', 'weapon2': '1.122', 'ARMOR': '1.714', 'HITCOUNT': '1.940', 'weapon3': '2.390', 'DAMAGECOUNT': '8.250', 'FRAGCOUNT': '30.000'} [2024-08-05 23:41:25,638][52660] DAMAGECOUNT value on done: 48104.0 [2024-08-05 23:41:25,639][52660] Sum rewards: 43.696, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.052', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.476', 'DAMAGECOUNT': '9.927', 'FRAGCOUNT': '37.000'} [2024-08-05 23:41:26,133][52664] DAMAGECOUNT value on done: 49575.0 [2024-08-05 23:41:26,134][52664] Sum rewards: 37.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.208', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.068', 'AMMO3': '0.157', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.628', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.682', 'DAMAGECOUNT': '10.077', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:26,369][52650] Updated weights for policy 0, policy_version 16871 (0.0011) [2024-08-05 23:41:27,331][52820] DAMAGECOUNT value on done: 44431.0 [2024-08-05 23:41:27,334][52820] Sum rewards: 35.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.454', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.876', 'ARMOR': '0.956', 'WEAPON3': '1.400', 'weapon3': '2.300', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.930', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 138223616. Throughput: 0: 4408.2. Samples: 34565320. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-05 23:41:27,794][52567] Avg episode reward: [(0, '36.385')] [2024-08-05 23:41:28,240][52669] DAMAGECOUNT value on done: 49339.0 [2024-08-05 23:41:28,243][52669] Sum rewards: 24.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.425', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.196', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'weapon2': '0.668', 'WEAPON3': '1.600', 'HITCOUNT': '2.080', 'weapon3': '2.820', 'DAMAGECOUNT': '8.355', 'FRAGCOUNT': '25.000'} [2024-08-05 23:41:28,283][52660] DAMAGECOUNT value on done: 49133.0 [2024-08-05 23:41:28,283][52660] Sum rewards: 39.670, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.242', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.188', 'ARMOR': '0.863', 'weapon2': '0.890', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '2.788', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:29,245][52664] DAMAGECOUNT value on done: 48382.0 [2024-08-05 23:41:29,246][52664] Sum rewards: 23.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.328', 'ARMOR': '0.036', 'AMMO2': '0.037', 'weapon4': '0.128', 'AMMO4': '0.187', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '1.122', 'WEAPON3': '1.450', 'HITCOUNT': '1.950', 'weapon3': '2.532', 'DAMAGECOUNT': '6.984', 'FRAGCOUNT': '24.000'} [2024-08-05 23:41:29,512][52667] DAMAGECOUNT value on done: 48561.0 [2024-08-05 23:41:29,514][52667] Sum rewards: 35.736, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.020', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.072', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON3': '0.700', 'ARMOR': '0.800', 'weapon2': '1.284', 'HITCOUNT': '2.190', 'weapon3': '2.508', 'DAMAGECOUNT': '9.138', 'FRAGCOUNT': '27.000'} [2024-08-05 23:41:30,455][52820] DAMAGECOUNT value on done: 46542.0 [2024-08-05 23:41:30,457][52820] Sum rewards: 43.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon5': '0.084', 'weapon4': '0.146', 'AMMO3': '0.185', 'AMMO4': '0.256', 'ARMOR': '0.416', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.692', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '2.664', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:31,025][52650] Updated weights for policy 0, policy_version 16881 (0.0013) [2024-08-05 23:41:31,264][52660] DAMAGECOUNT value on done: 47279.0 [2024-08-05 23:41:31,266][52660] Sum rewards: 34.613, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'ARMOR': '0.404', 'HEALTH': '0.404', 'weapon2': '0.980', 'WEAPON3': '1.150', 'HITCOUNT': '2.240', 'weapon3': '2.732', 'DAMAGECOUNT': '9.147', 'FRAGCOUNT': '32.000'} [2024-08-05 23:41:31,398][52669] DAMAGECOUNT value on done: 48962.0 [2024-08-05 23:41:31,400][52669] Sum rewards: 35.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.050', 'AMMO3': '0.199', 'AMMO4': '0.214', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.750', 'ARMOR': '0.904', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.648', 'DAMAGECOUNT': '9.867', 'FRAGCOUNT': '30.000'} [2024-08-05 23:41:31,981][52664] DAMAGECOUNT value on done: 50391.0 [2024-08-05 23:41:31,981][52664] Sum rewards: 33.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.136', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'weapon5': '0.054', 'AMMO2': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'AMMO4': '0.276', 'WEAPON4': '0.400', 'weapon4': '0.446', 'weapon2': '0.826', 'ARMOR': '0.855', 'WEAPON3': '1.400', 'weapon3': '2.368', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '9.612', 'FRAGCOUNT': '29.000'} [2024-08-05 23:41:32,520][52667] DAMAGECOUNT value on done: 50166.0 [2024-08-05 23:41:32,520][52667] Sum rewards: 30.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.144', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.097', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.696', 'WEAPON3': '1.300', 'ARMOR': '1.433', 'HITCOUNT': '2.310', 'weapon3': '2.518', 'DAMAGECOUNT': '9.216', 'FRAGCOUNT': '27.000'} [2024-08-05 23:41:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 138313728. Throughput: 0: 4405.3. Samples: 34578370. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 23:41:32,794][52567] Avg episode reward: [(0, '36.066')] [2024-08-05 23:41:33,596][52820] DAMAGECOUNT value on done: 44060.0 [2024-08-05 23:41:33,599][52820] Sum rewards: 37.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.013', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.086', 'AMMO3': '0.176', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.372', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.612', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.716', 'DAMAGECOUNT': '10.188', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:33,742][52669] DAMAGECOUNT value on done: 48449.0 [2024-08-05 23:41:33,742][52669] Sum rewards: 46.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.802', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.189', 'ARMOR': '0.400', 'weapon2': '1.158', 'WEAPON3': '1.300', 'weapon3': '2.712', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '39.000'} [2024-08-05 23:41:34,864][52664] DAMAGECOUNT value on done: 49567.0 [2024-08-05 23:41:34,866][52664] Sum rewards: 25.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.884', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.104', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.550', 'ARMOR': '0.967', 'weapon2': '1.024', 'WEAPON3': '1.200', 'HITCOUNT': '1.860', 'weapon3': '2.644', 'DAMAGECOUNT': '7.041', 'FRAGCOUNT': '27.000'} [2024-08-05 23:41:35,500][52667] DAMAGECOUNT value on done: 47398.0 [2024-08-05 23:41:35,500][52667] Sum rewards: 28.275, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'AMMO2': '0.027', 'ARMOR': '0.049', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.136', 'AMMO3': '0.153', 'WEAPON4': '0.350', 'weapon4': '0.640', 'weapon2': '0.666', 'WEAPON3': '0.950', 'HITCOUNT': '1.810', 'weapon3': '2.336', 'DAMAGECOUNT': '7.500', 'FRAGCOUNT': '24.000'} [2024-08-05 23:41:35,858][52650] Updated weights for policy 0, policy_version 16891 (0.0030) [2024-08-05 23:41:36,329][52669] DAMAGECOUNT value on done: 48427.0 [2024-08-05 23:41:36,330][52669] Sum rewards: 39.279, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.272', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.384', 'ARMOR': '0.970', 'WEAPON3': '1.100', 'weapon2': '1.250', 'weapon3': '2.198', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.542', 'FRAGCOUNT': '34.000'} [2024-08-05 23:41:36,886][52820] DAMAGECOUNT value on done: 42285.0 [2024-08-05 23:41:36,887][52820] Sum rewards: 35.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.358', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.052', 'weapon4': '0.058', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.831', 'weapon2': '0.950', 'WEAPON3': '1.450', 'HITCOUNT': '2.410', 'weapon3': '2.648', 'DAMAGECOUNT': '9.888', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 138403840. Throughput: 0: 4391.1. Samples: 34604400. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 23:41:37,794][52567] Avg episode reward: [(0, '36.156')] [2024-08-05 23:41:37,905][52665] DAMAGECOUNT value on done: 46633.0 [2024-08-05 23:41:37,906][52665] Sum rewards: 38.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.521', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.181', 'WEAPON4': '0.400', 'ARMOR': '0.448', 'weapon2': '0.684', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.852', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:38,277][52667] DAMAGECOUNT value on done: 48716.0 [2024-08-05 23:41:38,279][52667] Sum rewards: 39.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.298', 'AMMO5': '0.003', 'weapon5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'ARMOR': '0.903', 'weapon2': '0.966', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '2.828', 'DAMAGECOUNT': '10.770', 'FRAGCOUNT': '34.000'} [2024-08-05 23:41:38,981][52669] DAMAGECOUNT value on done: 46615.0 [2024-08-05 23:41:38,992][52669] Sum rewards: 47.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.388', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon4': '0.116', 'AMMO3': '0.211', 'weapon2': '0.560', 'ARMOR': '0.891', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.064', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '41.000'} [2024-08-05 23:41:39,975][52820] DAMAGECOUNT value on done: 44338.0 [2024-08-05 23:41:39,977][52820] Sum rewards: 44.985, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.249', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.176', 'weapon4': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.484', 'weapon2': '0.790', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.643', 'FRAGCOUNT': '37.000'} [2024-08-05 23:41:40,418][52650] Updated weights for policy 0, policy_version 16901 (0.0015) [2024-08-05 23:41:40,728][52667] DAMAGECOUNT value on done: 49895.0 [2024-08-05 23:41:40,728][52667] Sum rewards: 44.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.734', 'ARMOR': '0.860', 'WEAPON3': '1.300', 'weapon3': '2.594', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '37.000'} [2024-08-05 23:41:41,089][52665] DAMAGECOUNT value on done: 50827.0 [2024-08-05 23:41:41,089][52665] Sum rewards: 33.675, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'AMMO4': '0.200', 'weapon4': '0.302', 'WEAPON4': '0.500', 'ARMOR': '0.855', 'weapon2': '1.012', 'WEAPON3': '1.100', 'HITCOUNT': '2.400', 'weapon3': '2.446', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '30.000'} [2024-08-05 23:41:41,584][52669] Large shaping reward -2.552 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.003, -3.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:41:42,208][52669] DAMAGECOUNT value on done: 50672.0 [2024-08-05 23:41:42,209][52669] Sum rewards: 43.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.488', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.054', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'ARMOR': '0.459', 'weapon2': '1.010', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.662', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:42,259][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:41:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 138493952. Throughput: 0: 4398.0. Samples: 34630830. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-05 23:41:42,795][52567] Avg episode reward: [(0, '36.497')] [2024-08-05 23:41:43,028][52820] DAMAGECOUNT value on done: 45954.0 [2024-08-05 23:41:43,029][52820] Sum rewards: 42.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.380', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.175', 'weapon4': '0.192', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon2': '1.206', 'ARMOR': '1.383', 'weapon3': '2.376', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.076', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:43,624][52667] DAMAGECOUNT value on done: 51244.0 [2024-08-05 23:41:43,625][52667] Sum rewards: 41.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.362', 'AMMO5': '0.015', 'AMMO2': '0.032', 'ARMOR': '0.056', 'weapon5': '0.104', 'AMMO3': '0.151', 'AMMO4': '0.159', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON4': '0.400', 'weapon2': '0.662', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '2.622', 'DAMAGECOUNT': '11.112', 'FRAGCOUNT': '34.000'} [2024-08-05 23:41:44,320][52665] DAMAGECOUNT value on done: 49826.0 [2024-08-05 23:41:44,330][52665] Sum rewards: 36.228, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.423', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.172', 'weapon4': '0.262', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'weapon2': '0.746', 'ARMOR': '0.861', 'WEAPON3': '1.700', 'weapon3': '2.578', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.328', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:44,959][52669] DAMAGECOUNT value on done: 50105.0 [2024-08-05 23:41:44,960][52669] Sum rewards: 31.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.933', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.062', 'AMMO3': '0.173', 'AMMO4': '0.296', 'WEAPON5': '0.350', 'ARMOR': '0.473', 'weapon4': '0.518', 'WEAPON4': '0.700', 'weapon2': '0.740', 'WEAPON3': '1.050', 'HITCOUNT': '2.110', 'weapon3': '2.298', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '27.000'} [2024-08-05 23:41:45,065][52650] Updated weights for policy 0, policy_version 16911 (0.0039) [2024-08-05 23:41:45,413][52647] DAMAGECOUNT value on done: 49637.0 [2024-08-05 23:41:45,413][52647] Sum rewards: 42.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.244', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.980', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.682', 'DAMAGECOUNT': '10.884', 'FRAGCOUNT': '37.000'} [2024-08-05 23:41:46,109][52820] DAMAGECOUNT value on done: 47264.0 [2024-08-05 23:41:46,110][52820] Sum rewards: 32.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.485', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.172', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.354', 'ARMOR': '0.868', 'weapon2': '1.014', 'WEAPON3': '1.100', 'weapon3': '2.140', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.095', 'FRAGCOUNT': '28.000'} [2024-08-05 23:41:46,666][52667] DAMAGECOUNT value on done: 49570.0 [2024-08-05 23:41:46,668][52667] Sum rewards: 42.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO5': '0.003', 'AMMO2': '0.059', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.294', 'weapon4': '0.550', 'WEAPON4': '0.650', 'weapon2': '0.790', 'ARMOR': '0.849', 'WEAPON3': '1.150', 'weapon3': '2.304', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '36.000'} [2024-08-05 23:41:47,180][52665] DAMAGECOUNT value on done: 46377.0 [2024-08-05 23:41:47,181][52665] Sum rewards: 27.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.256', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.068', 'weapon4': '0.130', 'AMMO3': '0.173', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.887', 'WEAPON3': '1.100', 'weapon2': '1.328', 'HITCOUNT': '2.000', 'weapon3': '2.256', 'DAMAGECOUNT': '7.062', 'FRAGCOUNT': '23.000'} [2024-08-05 23:41:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 138575872. Throughput: 0: 4398.9. Samples: 34644240. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 23:41:47,794][52567] Avg episode reward: [(0, '36.278')] [2024-08-05 23:41:47,850][52669] DAMAGECOUNT value on done: 45448.0 [2024-08-05 23:41:47,851][52669] Sum rewards: 34.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.612', 'ARMOR': '0.902', 'WEAPON3': '1.250', 'HITCOUNT': '2.110', 'weapon3': '2.726', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '32.000'} [2024-08-05 23:41:47,865][52647] DAMAGECOUNT value on done: 50409.0 [2024-08-05 23:41:47,865][52647] Sum rewards: 36.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.514', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.828', 'ARMOR': '0.887', 'WEAPON3': '1.300', 'weapon3': '2.632', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:48,569][52614] Signal inference workers to stop experience collection... (3150 times) [2024-08-05 23:41:48,569][52614] Signal inference workers to resume experience collection... (3150 times) [2024-08-05 23:41:48,649][52650] InferenceWorker_p0-w0: stopping experience collection (3150 times) [2024-08-05 23:41:48,649][52650] InferenceWorker_p0-w0: resuming experience collection (3150 times) [2024-08-05 23:41:49,330][52820] DAMAGECOUNT value on done: 42688.0 [2024-08-05 23:41:49,331][52820] Sum rewards: 37.036, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.963', 'AMMO5': '0.012', 'weapon5': '0.042', 'AMMO2': '0.051', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon4': '0.340', 'ARMOR': '0.451', 'weapon2': '0.522', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.430', 'weapon3': '2.790', 'DAMAGECOUNT': '10.317', 'FRAGCOUNT': '35.000'} [2024-08-05 23:41:49,651][52667] DAMAGECOUNT value on done: 49042.0 [2024-08-05 23:41:49,655][52667] Sum rewards: 49.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.010', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.181', 'ARMOR': '0.400', 'weapon2': '1.032', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '42.000'} [2024-08-05 23:41:49,702][52650] Updated weights for policy 0, policy_version 16921 (0.0019) [2024-08-05 23:41:50,363][52665] DAMAGECOUNT value on done: 45173.0 [2024-08-05 23:41:50,364][52665] Sum rewards: 34.483, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.842', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'weapon4': '0.262', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.180', 'HITCOUNT': '2.120', 'weapon3': '2.394', 'DAMAGECOUNT': '8.772', 'FRAGCOUNT': '28.000'} [2024-08-05 23:41:50,962][52669] DAMAGECOUNT value on done: 50498.0 [2024-08-05 23:41:50,964][52669] Sum rewards: 36.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.823', 'AMMO5': '0.011', 'AMMO2': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.073', 'weapon5': '0.086', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '2.936', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '32.500'} [2024-08-05 23:41:51,021][52647] DAMAGECOUNT value on done: 54979.0 [2024-08-05 23:41:51,022][52647] Sum rewards: 46.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.242', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.048', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'weapon4': '0.270', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.814', 'WEAPON3': '0.950', 'weapon3': '2.654', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.175', 'FRAGCOUNT': '37.000'} [2024-08-05 23:41:52,368][52820] DAMAGECOUNT value on done: 43670.0 [2024-08-05 23:41:52,370][52820] Sum rewards: 31.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.762', 'ARMOR': '0.820', 'WEAPON3': '1.000', 'HITCOUNT': '2.040', 'weapon3': '2.922', 'DAMAGECOUNT': '9.135', 'FRAGCOUNT': '27.000'} [2024-08-05 23:41:52,777][52667] DAMAGECOUNT value on done: 49137.0 [2024-08-05 23:41:52,779][52667] Sum rewards: 27.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.158', 'weapon4': '0.210', 'AMMO4': '0.212', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.656', 'ARMOR': '0.997', 'WEAPON3': '1.450', 'HITCOUNT': '2.050', 'weapon3': '2.600', 'DAMAGECOUNT': '7.599', 'FRAGCOUNT': '27.000'} [2024-08-05 23:41:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 138665984. Throughput: 0: 4401.1. Samples: 34670830. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-05 23:41:52,794][52567] Avg episode reward: [(0, '36.854')] [2024-08-05 23:41:52,795][52614] Saving new best policy, reward=36.854! [2024-08-05 23:41:53,073][52666] DAMAGECOUNT value on done: 46553.0 [2024-08-05 23:41:53,074][52666] Sum rewards: 32.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.176', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.676', 'ARMOR': '0.867', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.758', 'DAMAGECOUNT': '10.002', 'FRAGCOUNT': '29.500'} [2024-08-05 23:41:53,181][52665] DAMAGECOUNT value on done: 46890.0 [2024-08-05 23:41:53,182][52665] Sum rewards: 35.941, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.318', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.704', 'WEAPON3': '1.550', 'HITCOUNT': '2.490', 'weapon3': '2.968', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:53,800][52669] DAMAGECOUNT value on done: 50750.0 [2024-08-05 23:41:53,800][52669] Sum rewards: 39.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.048', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.850', 'ARMOR': '0.992', 'WEAPON3': '1.250', 'weapon3': '2.496', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '9.858', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:54,151][52647] DAMAGECOUNT value on done: 51215.0 [2024-08-05 23:41:54,151][52647] Sum rewards: 37.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.060', 'weapon4': '0.094', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.844', 'ARMOR': '0.866', 'WEAPON3': '1.400', 'HITCOUNT': '2.570', 'weapon3': '2.724', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:54,468][52650] Updated weights for policy 0, policy_version 16931 (0.0030) [2024-08-05 23:41:55,558][52820] DAMAGECOUNT value on done: 46504.0 [2024-08-05 23:41:55,560][52820] Sum rewards: 49.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.034', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon4': '0.170', 'WEAPON4': '0.200', 'ARMOR': '0.467', 'weapon2': '0.730', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '42.000'} [2024-08-05 23:41:55,574][52667] DAMAGECOUNT value on done: 50188.0 [2024-08-05 23:41:55,575][52667] Sum rewards: 42.127, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.452', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO2': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'AMMO4': '0.326', 'ARMOR': '0.481', 'weapon4': '0.644', 'weapon2': '0.652', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.364', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.112', 'FRAGCOUNT': '38.500'} [2024-08-05 23:41:55,824][52665] DAMAGECOUNT value on done: 49682.0 [2024-08-05 23:41:55,826][52665] Sum rewards: 22.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.354', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.157', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'ARMOR': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.478', 'weapon2': '0.916', 'WEAPON3': '1.200', 'HITCOUNT': '2.180', 'weapon3': '2.298', 'DAMAGECOUNT': '7.938', 'FRAGCOUNT': '21.000'} [2024-08-05 23:41:56,430][52666] DAMAGECOUNT value on done: 48711.0 [2024-08-05 23:41:56,430][52666] Sum rewards: 50.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.290', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'ARMOR': '0.453', 'weapon2': '0.648', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '2.992', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '45.000'} [2024-08-05 23:41:56,855][52647] DAMAGECOUNT value on done: 51873.0 [2024-08-05 23:41:56,857][52647] Sum rewards: 36.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.828', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.153', 'AMMO3': '0.183', 'weapon4': '0.184', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.250', 'HITCOUNT': '2.070', 'weapon3': '2.750', 'DAMAGECOUNT': '9.699', 'FRAGCOUNT': '33.000'} [2024-08-05 23:41:56,878][52669] DAMAGECOUNT value on done: 51001.0 [2024-08-05 23:41:56,879][52669] Sum rewards: 44.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.534', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.842', 'ARMOR': '0.900', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '2.888', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '40.000'} [2024-08-05 23:41:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 138756096. Throughput: 0: 4393.6. Samples: 34697260. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:41:57,794][52567] Avg episode reward: [(0, '36.915')] [2024-08-05 23:41:57,797][52614] Saving new best policy, reward=36.915! [2024-08-05 23:41:58,621][52820] DAMAGECOUNT value on done: 45058.0 [2024-08-05 23:41:58,621][52820] Sum rewards: 33.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.853', 'AMMO5': '0.008', 'weapon5': '0.032', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.208', 'AMMO4': '0.249', 'WEAPON4': '0.550', 'ARMOR': '0.836', 'WEAPON3': '1.100', 'weapon2': '1.248', 'weapon3': '2.286', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '29.500'} [2024-08-05 23:41:58,751][52665] DAMAGECOUNT value on done: 50273.0 [2024-08-05 23:41:58,752][52665] Sum rewards: 33.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.646', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.852', 'ARMOR': '0.879', 'WEAPON3': '1.100', 'HITCOUNT': '2.250', 'weapon3': '2.738', 'DAMAGECOUNT': '8.610', 'FRAGCOUNT': '29.000'} [2024-08-05 23:41:58,760][52667] DAMAGECOUNT value on done: 47635.0 [2024-08-05 23:41:58,763][52667] Sum rewards: 27.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.392', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.018', 'weapon7': '0.070', 'AMMO4': '0.087', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.508', 'weapon4': '0.624', 'WEAPON3': '1.100', 'ARMOR': '1.404', 'HITCOUNT': '1.820', 'weapon3': '2.284', 'DAMAGECOUNT': '7.770', 'FRAGCOUNT': '24.000'} [2024-08-05 23:41:58,813][52658] DAMAGECOUNT value on done: 49443.0 [2024-08-05 23:41:58,816][52658] Sum rewards: 37.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.136', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.078', 'AMMO4': '0.157', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.510', 'weapon2': '0.682', 'ARMOR': '0.898', 'WEAPON3': '1.050', 'HITCOUNT': '2.050', 'weapon3': '2.404', 'DAMAGECOUNT': '9.273', 'FRAGCOUNT': '31.000'} [2024-08-05 23:41:58,944][52650] Updated weights for policy 0, policy_version 16941 (0.0011) [2024-08-05 23:41:59,527][52666] DAMAGECOUNT value on done: 47901.0 [2024-08-05 23:41:59,530][52666] Sum rewards: 53.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.832', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.229', 'ARMOR': '0.455', 'weapon2': '0.724', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '45.000'} [2024-08-05 23:41:59,577][52647] DAMAGECOUNT value on done: 52299.0 [2024-08-05 23:41:59,577][52647] Sum rewards: 24.745, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.561', 'AMMO5': '0.014', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon5': '0.064', 'AMMO4': '0.077', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.806', 'WEAPON3': '1.500', 'HITCOUNT': '2.230', 'weapon3': '2.746', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '26.000'} [2024-08-05 23:41:59,692][52663] DAMAGECOUNT value on done: 50622.0 [2024-08-05 23:41:59,692][52663] Sum rewards: 46.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.135', 'AMMO5': '0.003', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.482', 'weapon4': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.640', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:00,055][52669] DAMAGECOUNT value on done: 49241.0 [2024-08-05 23:42:00,055][52669] Sum rewards: 30.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.240', 'ARMOR': '0.453', 'weapon2': '0.852', 'WEAPON3': '1.450', 'HITCOUNT': '2.200', 'weapon3': '2.482', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '27.500'} [2024-08-05 23:42:00,544][52670] DAMAGECOUNT value on done: 47239.0 [2024-08-05 23:42:00,545][52670] Sum rewards: 31.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.072', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.396', 'ARMOR': '0.416', 'weapon4': '0.474', 'WEAPON3': '1.400', 'HITCOUNT': '2.260', 'weapon3': '2.754', 'DAMAGECOUNT': '8.640', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:01,379][52665] DAMAGECOUNT value on done: 51331.0 [2024-08-05 23:42:01,381][52665] Sum rewards: 53.912, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.011', 'HEALTH': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon5': '0.090', 'AMMO3': '0.187', 'ARMOR': '0.400', 'weapon2': '0.914', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.734', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '45.000'} [2024-08-05 23:42:01,722][52820] DAMAGECOUNT value on done: 44884.0 [2024-08-05 23:42:01,723][52820] Sum rewards: 34.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.562', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'AMMO4': '0.213', 'WEAPON4': '0.400', 'weapon4': '0.636', 'weapon2': '0.642', 'WEAPON3': '1.150', 'ARMOR': '1.256', 'weapon3': '2.430', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '9.585', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:01,763][52667] DAMAGECOUNT value on done: 46848.0 [2024-08-05 23:42:01,763][52667] Sum rewards: 35.445, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.064', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.273', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.846', 'ARMOR': '0.961', 'WEAPON3': '1.600', 'HITCOUNT': '2.360', 'weapon3': '2.490', 'DAMAGECOUNT': '10.176', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:01,826][52658] DAMAGECOUNT value on done: 48196.0 [2024-08-05 23:42:01,828][52658] Sum rewards: 40.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.131', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.556', 'WEAPON3': '0.900', 'weapon2': '0.906', 'weapon3': '2.232', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:02,519][52647] DAMAGECOUNT value on done: 49565.0 [2024-08-05 23:42:02,519][52647] Sum rewards: 31.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.899', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO4': '0.215', 'AMMO3': '0.216', 'weapon4': '0.232', 'WEAPON4': '0.400', 'ARMOR': '0.804', 'weapon2': '0.896', 'WEAPON3': '1.200', 'HITCOUNT': '2.130', 'weapon3': '2.606', 'DAMAGECOUNT': '8.661', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:02,739][52663] DAMAGECOUNT value on done: 48444.0 [2024-08-05 23:42:02,740][52663] Sum rewards: 36.857, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.733', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon2': '0.668', 'ARMOR': '0.889', 'WEAPON3': '1.650', 'HITCOUNT': '2.260', 'weapon3': '2.958', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '37.000'} [2024-08-05 23:42:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 138846208. Throughput: 0: 4390.5. Samples: 34710300. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:42:02,794][52567] Avg episode reward: [(0, '37.133')] [2024-08-05 23:42:02,795][52614] Saving new best policy, reward=37.133! [2024-08-05 23:42:02,839][52666] DAMAGECOUNT value on done: 46642.0 [2024-08-05 23:42:02,840][52666] Sum rewards: 45.273, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.195', 'weapon4': '0.342', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.592', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '40.000'} [2024-08-05 23:42:03,175][52669] DAMAGECOUNT value on done: 49796.0 [2024-08-05 23:42:03,177][52669] Sum rewards: 30.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'ARMOR': '0.855', 'WEAPON3': '1.100', 'weapon2': '1.128', 'HITCOUNT': '2.150', 'weapon3': '2.730', 'DAMAGECOUNT': '9.108', 'FRAGCOUNT': '26.000'} [2024-08-05 23:42:03,783][52650] Updated weights for policy 0, policy_version 16951 (0.0019) [2024-08-05 23:42:03,956][52670] DAMAGECOUNT value on done: 48653.0 [2024-08-05 23:42:03,956][52670] Sum rewards: 38.301, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.356', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO3': '0.149', 'AMMO4': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.497', 'weapon2': '0.666', 'weapon4': '0.814', 'WEAPON3': '0.950', 'weapon3': '2.112', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.144', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:04,107][52667] DAMAGECOUNT value on done: 49649.0 [2024-08-05 23:42:04,110][52667] Sum rewards: 44.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.204', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '1.034', 'WEAPON3': '1.450', 'ARMOR': '1.759', 'HITCOUNT': '2.480', 'weapon3': '2.634', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:04,240][52658] DAMAGECOUNT value on done: 48026.0 [2024-08-05 23:42:04,241][52658] Sum rewards: 32.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.026', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'ARMOR': '0.455', 'weapon2': '0.594', 'WEAPON3': '1.400', 'HITCOUNT': '2.470', 'weapon3': '3.014', 'DAMAGECOUNT': '9.015', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:04,367][52665] DAMAGECOUNT value on done: 49953.0 [2024-08-05 23:42:04,373][52665] Sum rewards: 41.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.213', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.014', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.174', 'AMMO3': '0.189', 'weapon2': '0.898', 'WEAPON3': '1.250', 'ARMOR': '1.321', 'HITCOUNT': '2.470', 'weapon3': '2.656', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:05,022][52820] DAMAGECOUNT value on done: 48584.0 [2024-08-05 23:42:05,023][52820] Sum rewards: 56.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'AMMO3': '0.219', 'ARMOR': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.114', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '49.000'} [2024-08-05 23:42:05,617][52663] DAMAGECOUNT value on done: 50268.0 [2024-08-05 23:42:05,620][52663] Sum rewards: 34.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.164', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'ARMOR': '0.848', 'weapon2': '0.916', 'WEAPON3': '1.450', 'weapon3': '2.626', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.455', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:05,748][52647] DAMAGECOUNT value on done: 53195.0 [2024-08-05 23:42:05,749][52647] Sum rewards: 34.820, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.042', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON3': '0.950', 'ARMOR': '1.308', 'weapon2': '1.608', 'weapon3': '2.208', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '8.898', 'FRAGCOUNT': '28.500'} [2024-08-05 23:42:05,816][52666] DAMAGECOUNT value on done: 47406.0 [2024-08-05 23:42:05,816][52666] Sum rewards: 31.350, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.381', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.060', 'weapon4': '0.066', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.888', 'ARMOR': '1.378', 'WEAPON3': '1.500', 'HITCOUNT': '2.260', 'weapon3': '2.718', 'DAMAGECOUNT': '10.578', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:05,831][52669] DAMAGECOUNT value on done: 47941.0 [2024-08-05 23:42:05,832][52669] Sum rewards: 58.267, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '3.292', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '49.000'} [2024-08-05 23:42:06,568][52667] DAMAGECOUNT value on done: 47111.0 [2024-08-05 23:42:06,571][52667] Sum rewards: 29.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.120', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'ARMOR': '0.893', 'weapon2': '0.982', 'HITCOUNT': '2.210', 'weapon3': '2.458', 'DAMAGECOUNT': '8.253', 'FRAGCOUNT': '23.000'} [2024-08-05 23:42:06,653][52658] DAMAGECOUNT value on done: 47061.0 [2024-08-05 23:42:06,655][52658] Sum rewards: 33.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.614', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.085', 'weapon4': '0.094', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.452', 'weapon2': '0.872', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.698', 'DAMAGECOUNT': '10.608', 'FRAGCOUNT': '30.500'} [2024-08-05 23:42:06,665][52670] DAMAGECOUNT value on done: 48860.0 [2024-08-05 23:42:06,667][52670] Sum rewards: 36.144, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.744', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.332', 'ARMOR': '0.456', 'WEAPON3': '0.900', 'weapon2': '1.244', 'weapon3': '2.158', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '9.432', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 138936320. Throughput: 0: 4392.9. Samples: 34736650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:42:07,794][52567] Avg episode reward: [(0, '37.155')] [2024-08-05 23:42:07,797][52614] Saving new best policy, reward=37.155! [2024-08-05 23:42:07,888][52665] DAMAGECOUNT value on done: 50445.0 [2024-08-05 23:42:07,888][52665] Sum rewards: 45.559, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.208', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon4': '0.160', 'ARMOR': '0.432', 'weapon2': '1.014', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.917', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:08,218][52647] DAMAGECOUNT value on done: 53970.0 [2024-08-05 23:42:08,218][52647] Sum rewards: 45.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.048', 'weapon4': '0.050', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'ARMOR': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '3.154', 'DAMAGECOUNT': '11.328', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:08,219][52666] DAMAGECOUNT value on done: 47099.0 [2024-08-05 23:42:08,219][52666] Sum rewards: 36.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.197', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.089', 'AMMO3': '0.167', 'weapon4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.478', 'weapon2': '0.760', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.760', 'DAMAGECOUNT': '9.711', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:08,289][52820] DAMAGECOUNT value on done: 48675.0 [2024-08-05 23:42:08,289][52820] Sum rewards: 38.192, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.532', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.162', 'WEAPON3': '0.950', 'ARMOR': '1.254', 'weapon2': '1.580', 'HITCOUNT': '2.200', 'weapon3': '2.236', 'DAMAGECOUNT': '9.216', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:08,458][52650] Updated weights for policy 0, policy_version 16961 (0.0016) [2024-08-05 23:42:08,892][52663] DAMAGECOUNT value on done: 49749.0 [2024-08-05 23:42:08,894][52663] Sum rewards: 43.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.665', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO3': '0.126', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'weapon4': '0.384', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.992', 'weapon3': '2.284', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.077', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:09,267][52669] DAMAGECOUNT value on done: 49398.0 [2024-08-05 23:42:09,269][52669] Sum rewards: 32.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.159', 'WEAPON4': '0.350', 'weapon4': '0.410', 'ARMOR': '0.428', 'weapon2': '0.882', 'WEAPON3': '1.150', 'HITCOUNT': '2.150', 'weapon3': '2.456', 'DAMAGECOUNT': '8.670', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:09,289][52670] DAMAGECOUNT value on done: 45758.0 [2024-08-05 23:42:09,289][52670] Sum rewards: 24.337, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.900', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.062', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.630', 'ARMOR': '0.913', 'WEAPON3': '1.550', 'HITCOUNT': '2.270', 'weapon3': '2.708', 'DAMAGECOUNT': '8.991', 'FRAGCOUNT': '25.000'} [2024-08-05 23:42:09,770][52667] DAMAGECOUNT value on done: 50939.0 [2024-08-05 23:42:09,770][52667] Sum rewards: 45.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.661', 'AMMO2': '0.012', 'weapon4': '0.018', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'ARMOR': '0.800', 'weapon2': '1.012', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.748', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:09,823][52658] DAMAGECOUNT value on done: 51243.0 [2024-08-05 23:42:09,825][52658] Sum rewards: 48.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.532', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon2': '0.636', 'ARMOR': '0.903', 'WEAPON3': '1.000', 'HITCOUNT': '2.960', 'weapon3': '2.986', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '41.000'} [2024-08-05 23:42:10,693][52665] DAMAGECOUNT value on done: 46905.0 [2024-08-05 23:42:10,696][52665] Sum rewards: 37.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.598', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.134', 'AMMO3': '0.181', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.442', 'ARMOR': '0.455', 'weapon2': '0.772', 'WEAPON3': '1.050', 'weapon3': '2.388', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:10,698][52647] DAMAGECOUNT value on done: 51319.0 [2024-08-05 23:42:10,700][52647] Sum rewards: 38.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.209', 'weapon2': '0.766', 'WEAPON3': '1.250', 'HITCOUNT': '2.250', 'weapon3': '2.974', 'DAMAGECOUNT': '9.642', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:11,228][52666] DAMAGECOUNT value on done: 45973.0 [2024-08-05 23:42:11,230][52666] Sum rewards: 28.370, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.544', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'weapon4': '0.170', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'ARMOR': '0.857', 'weapon2': '0.980', 'WEAPON3': '1.450', 'HITCOUNT': '2.230', 'weapon3': '2.542', 'DAMAGECOUNT': '9.258', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:11,544][52820] DAMAGECOUNT value on done: 46433.0 [2024-08-05 23:42:11,545][52820] Sum rewards: 38.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'ARMOR': '1.313', 'weapon2': '1.522', 'weapon3': '2.216', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '33.000'} [2024-08-05 23:42:11,638][52663] DAMAGECOUNT value on done: 47230.0 [2024-08-05 23:42:11,640][52663] Sum rewards: 35.836, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.043', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'WEAPON4': '0.300', 'weapon4': '0.372', 'ARMOR': '0.455', 'weapon2': '0.872', 'WEAPON3': '1.000', 'HITCOUNT': '2.240', 'weapon3': '2.582', 'DAMAGECOUNT': '8.727', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:11,716][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:42:12,362][52667] DAMAGECOUNT value on done: 52786.0 [2024-08-05 23:42:12,362][52667] Sum rewards: 42.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.892', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.187', 'ARMOR': '0.420', 'weapon2': '1.038', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.770', 'DAMAGECOUNT': '11.181', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:12,395][52670] DAMAGECOUNT value on done: 45853.0 [2024-08-05 23:42:12,397][52670] Sum rewards: 35.603, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.086', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.526', 'weapon4': '0.716', 'ARMOR': '0.824', 'WEAPON3': '1.000', 'HITCOUNT': '2.030', 'weapon3': '2.470', 'DAMAGECOUNT': '8.715', 'FRAGCOUNT': '29.000'} [2024-08-05 23:42:12,415][52658] DAMAGECOUNT value on done: 46146.0 [2024-08-05 23:42:12,417][52658] Sum rewards: 37.558, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'ARMOR': '0.435', 'WEAPON3': '0.900', 'weapon2': '1.070', 'HITCOUNT': '2.340', 'weapon3': '2.554', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 139018240. Throughput: 0: 4392.0. Samples: 34762960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:42:12,794][52567] Avg episode reward: [(0, '37.528')] [2024-08-05 23:42:12,795][52614] Saving new best policy, reward=37.528! [2024-08-05 23:42:13,096][52650] Updated weights for policy 0, policy_version 16971 (0.0012) [2024-08-05 23:42:13,234][52647] DAMAGECOUNT value on done: 51005.0 [2024-08-05 23:42:13,234][52647] Sum rewards: 42.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.144', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.864', 'ARMOR': '0.934', 'WEAPON3': '1.400', 'weapon3': '2.618', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:13,535][52665] DAMAGECOUNT value on done: 46567.0 [2024-08-05 23:42:13,535][52665] Sum rewards: 37.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.008', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.172', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.504', 'weapon2': '0.602', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '3.012', 'DAMAGECOUNT': '9.915', 'FRAGCOUNT': '33.000'} [2024-08-05 23:42:13,861][52803] DAMAGECOUNT value on done: 46882.0 [2024-08-05 23:42:13,861][52803] Sum rewards: 34.166, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.516', 'AMMO5': '0.007', 'AMMO2': '0.024', 'ARMOR': '0.044', 'AMMO4': '0.117', 'AMMO3': '0.140', 'weapon5': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.820', 'WEAPON3': '1.050', 'HITCOUNT': '2.080', 'weapon3': '2.342', 'DAMAGECOUNT': '9.738', 'FRAGCOUNT': '29.000'} [2024-08-05 23:42:14,245][52663] DAMAGECOUNT value on done: 51473.0 [2024-08-05 23:42:14,246][52663] Sum rewards: 46.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.035', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.176', 'WEAPON4': '0.400', 'weapon4': '0.526', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '40.000'} [2024-08-05 23:42:14,405][52666] DAMAGECOUNT value on done: 47286.0 [2024-08-05 23:42:14,407][52666] Sum rewards: 35.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.155', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.136', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.600', 'HITCOUNT': '2.360', 'weapon3': '2.858', 'DAMAGECOUNT': '10.263', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:15,204][52670] DAMAGECOUNT value on done: 50540.0 [2024-08-05 23:42:15,205][52670] Sum rewards: 34.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.563', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.802', 'ARMOR': '1.249', 'WEAPON3': '1.500', 'HITCOUNT': '2.320', 'weapon3': '2.526', 'DAMAGECOUNT': '9.459', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:15,386][52667] DAMAGECOUNT value on done: 50102.0 [2024-08-05 23:42:15,387][52667] Sum rewards: 38.936, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.046', 'AMMO5': '0.007', 'weapon5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.786', 'WEAPON3': '0.950', 'ARMOR': '1.208', 'HITCOUNT': '2.380', 'weapon3': '2.564', 'DAMAGECOUNT': '10.233', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:15,468][52658] DAMAGECOUNT value on done: 53889.0 [2024-08-05 23:42:15,470][52658] Sum rewards: 41.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.584', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'weapon4': '0.180', 'AMMO3': '0.211', 'WEAPON4': '0.400', 'ARMOR': '0.853', 'weapon2': '0.876', 'WEAPON3': '1.350', 'weapon3': '2.666', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:15,641][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:42:15,702][52647] DAMAGECOUNT value on done: 48213.0 [2024-08-05 23:42:15,703][52647] Sum rewards: 42.855, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.571', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.133', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.348', 'ARMOR': '0.400', 'weapon2': '0.744', 'WEAPON3': '0.900', 'HITCOUNT': '2.370', 'weapon3': '2.678', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:16,572][52665] DAMAGECOUNT value on done: 48793.0 [2024-08-05 23:42:16,572][52665] Sum rewards: 32.202, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.402', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.046', 'AMMO4': '0.115', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.932', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:16,986][52803] DAMAGECOUNT value on done: 50270.0 [2024-08-05 23:42:16,986][52803] Sum rewards: 39.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.991', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.816', 'ARMOR': '0.855', 'WEAPON3': '1.100', 'weapon3': '2.550', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:17,015][52666] DAMAGECOUNT value on done: 48394.0 [2024-08-05 23:42:17,015][52666] Sum rewards: 48.545, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.889', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.050', 'weapon5': '0.078', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.058', 'ARMOR': '1.329', 'HITCOUNT': '2.480', 'weapon3': '2.618', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:17,137][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:42:17,360][52663] DAMAGECOUNT value on done: 53361.0 [2024-08-05 23:42:17,364][52663] Sum rewards: 49.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.824', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.155', 'weapon4': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.502', 'ARMOR': '1.016', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.006', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '41.000'} [2024-08-05 23:42:17,400][52650] Updated weights for policy 0, policy_version 16981 (0.0029) [2024-08-05 23:42:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 139108352. Throughput: 0: 4394.9. Samples: 34776140. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:42:17,794][52567] Avg episode reward: [(0, '38.347')] [2024-08-05 23:42:17,797][52614] Saving new best policy, reward=38.347! [2024-08-05 23:42:17,916][52670] DAMAGECOUNT value on done: 46821.0 [2024-08-05 23:42:17,917][52670] Sum rewards: 44.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.306', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.072', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'ARMOR': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '3.096', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:18,651][52667] DAMAGECOUNT value on done: 52453.0 [2024-08-05 23:42:18,651][52667] Sum rewards: 51.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.085', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.070', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.888', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '42.000'} [2024-08-05 23:42:18,671][52647] DAMAGECOUNT value on done: 50695.0 [2024-08-05 23:42:18,671][52647] Sum rewards: 31.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.679', 'AMMO5': '0.012', 'weapon5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.334', 'AMMO4': '0.341', 'WEAPON4': '0.650', 'weapon2': '0.810', 'ARMOR': '0.922', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.384', 'DAMAGECOUNT': '9.069', 'FRAGCOUNT': '29.000'} [2024-08-05 23:42:18,747][52658] DAMAGECOUNT value on done: 47829.0 [2024-08-05 23:42:18,747][52658] Sum rewards: 38.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.822', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'ARMOR': '0.468', 'weapon2': '0.704', 'WEAPON3': '1.350', 'HITCOUNT': '2.500', 'weapon3': '2.890', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '33.000'} [2024-08-05 23:42:19,673][52665] DAMAGECOUNT value on done: 47621.0 [2024-08-05 23:42:19,673][52665] Sum rewards: 42.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.438', 'weapon5': '0.002', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.652', 'WEAPON3': '1.250', 'ARMOR': '1.340', 'HITCOUNT': '2.480', 'weapon3': '3.156', 'DAMAGECOUNT': '11.052', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:19,846][52671] DAMAGECOUNT value on done: 53933.0 [2024-08-05 23:42:19,846][52671] Sum rewards: 40.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.978', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.778', 'ARMOR': '0.800', 'WEAPON3': '1.450', 'HITCOUNT': '2.700', 'weapon3': '2.880', 'DAMAGECOUNT': '11.349', 'FRAGCOUNT': '37.000'} [2024-08-05 23:42:20,052][52663] DAMAGECOUNT value on done: 48710.0 [2024-08-05 23:42:20,052][52663] Sum rewards: 40.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.780', 'ARMOR': '0.836', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '2.924', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:20,091][52666] DAMAGECOUNT value on done: 48377.0 [2024-08-05 23:42:20,091][52666] Sum rewards: 34.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.166', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'ARMOR': '0.808', 'weapon2': '0.818', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '2.842', 'DAMAGECOUNT': '8.853', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:20,130][52803] DAMAGECOUNT value on done: 45884.0 [2024-08-05 23:42:20,131][52803] Sum rewards: 31.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.072', 'AMMO5': '0.007', 'weapon5': '0.054', 'AMMO2': '0.069', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.345', 'ARMOR': '0.458', 'weapon4': '0.630', 'weapon2': '0.726', 'WEAPON4': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.298', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '29.000'} [2024-08-05 23:42:20,887][52811] DAMAGECOUNT value on done: 46820.0 [2024-08-05 23:42:20,888][52811] Sum rewards: 37.378, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.900', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.162', 'ARMOR': '0.467', 'WEAPON3': '1.000', 'weapon2': '1.194', 'HITCOUNT': '2.340', 'weapon3': '2.498', 'DAMAGECOUNT': '9.291', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:20,995][52670] DAMAGECOUNT value on done: 47445.0 [2024-08-05 23:42:20,995][52670] Sum rewards: 44.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.868', 'AMMO5': '0.018', 'AMMO2': '0.023', 'ARMOR': '0.036', 'weapon5': '0.072', 'AMMO4': '0.114', 'AMMO3': '0.176', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.440', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.304', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:21,618][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:42:21,689][52667] DAMAGECOUNT value on done: 48944.0 [2024-08-05 23:42:21,690][52667] Sum rewards: 40.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.316', 'weapon5': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.216', 'AMMO4': '0.224', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'weapon2': '0.588', 'WEAPON3': '1.250', 'HITCOUNT': '2.310', 'weapon3': '2.916', 'DAMAGECOUNT': '10.164', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:21,748][52647] DAMAGECOUNT value on done: 50383.0 [2024-08-05 23:42:21,749][52647] Sum rewards: 44.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.738', 'AMMO5': '0.012', 'weapon5': '0.030', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.344', 'WEAPON4': '0.350', 'ARMOR': '0.832', 'weapon2': '1.006', 'WEAPON3': '1.350', 'weapon3': '2.396', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:21,752][52658] DAMAGECOUNT value on done: 50538.0 [2024-08-05 23:42:21,752][52658] Sum rewards: 35.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.644', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.226', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.518', 'weapon2': '0.638', 'WEAPON3': '1.200', 'HITCOUNT': '2.370', 'weapon3': '2.484', 'DAMAGECOUNT': '9.273', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:22,124][52665] DAMAGECOUNT value on done: 48097.0 [2024-08-05 23:42:22,127][52665] Sum rewards: 43.680, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.617', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.146', 'WEAPON4': '0.350', 'weapon4': '0.388', 'ARMOR': '0.468', 'weapon2': '0.816', 'WEAPON3': '1.000', 'weapon3': '2.554', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '10.302', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:22,388][52671] DAMAGECOUNT value on done: 49557.0 [2024-08-05 23:42:22,389][52671] Sum rewards: 30.144, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.928', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.200', 'weapon4': '0.328', 'WEAPON4': '0.400', 'ARMOR': '0.866', 'weapon2': '1.046', 'WEAPON3': '1.250', 'HITCOUNT': '2.010', 'weapon3': '2.022', 'DAMAGECOUNT': '7.770', 'FRAGCOUNT': '27.000'} [2024-08-05 23:42:22,394][52650] Updated weights for policy 0, policy_version 16991 (0.0010) [2024-08-05 23:42:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 139198464. Throughput: 0: 4399.1. Samples: 34802360. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:42:22,794][52567] Avg episode reward: [(0, '38.462')] [2024-08-05 23:42:22,795][52614] Saving new best policy, reward=38.462! [2024-08-05 23:42:22,880][52666] DAMAGECOUNT value on done: 45075.0 [2024-08-05 23:42:22,880][52666] Sum rewards: 27.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.416', 'ARMOR': '0.455', 'WEAPON3': '1.050', 'weapon2': '1.162', 'HITCOUNT': '2.100', 'weapon3': '2.110', 'DAMAGECOUNT': '8.658', 'FRAGCOUNT': '27.000'} [2024-08-05 23:42:22,951][52663] DAMAGECOUNT value on done: 49268.0 [2024-08-05 23:42:22,952][52663] Sum rewards: 36.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.751', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.552', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '2.964', 'DAMAGECOUNT': '10.650', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:23,200][52803] DAMAGECOUNT value on done: 45277.0 [2024-08-05 23:42:23,201][52803] Sum rewards: 45.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.102', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.185', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.606', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.934', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:23,986][52811] DAMAGECOUNT value on done: 44434.0 [2024-08-05 23:42:23,986][52811] Sum rewards: 33.153, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.206', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.220', 'AMMO3': '0.244', 'ARMOR': '0.424', 'weapon2': '0.822', 'WEAPON3': '1.550', 'HITCOUNT': '2.530', 'weapon3': '2.616', 'DAMAGECOUNT': '10.338', 'FRAGCOUNT': '31.500'} [2024-08-05 23:42:24,017][52670] DAMAGECOUNT value on done: 45704.0 [2024-08-05 23:42:24,019][52670] Sum rewards: 31.425, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.019', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.104', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'weapon4': '0.412', 'ARMOR': '0.553', 'WEAPON3': '0.950', 'weapon2': '1.068', 'HITCOUNT': '1.970', 'weapon3': '2.204', 'DAMAGECOUNT': '8.946', 'FRAGCOUNT': '25.000'} [2024-08-05 23:42:24,457][52667] DAMAGECOUNT value on done: 51239.0 [2024-08-05 23:42:24,457][52667] Sum rewards: 46.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.849', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.718', 'ARMOR': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '40.000'} [2024-08-05 23:42:24,476][52658] DAMAGECOUNT value on done: 50760.0 [2024-08-05 23:42:24,477][52658] Sum rewards: 30.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.391', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.184', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon2': '0.714', 'ARMOR': '0.845', 'WEAPON3': '1.300', 'HITCOUNT': '2.260', 'weapon3': '2.842', 'DAMAGECOUNT': '9.300', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:24,721][52647] DAMAGECOUNT value on done: 51878.0 [2024-08-05 23:42:24,721][52647] Sum rewards: 38.444, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.360', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.028', 'ARMOR': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.216', 'weapon3': '2.256', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '9.186', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:25,388][52671] DAMAGECOUNT value on done: 49692.0 [2024-08-05 23:42:25,389][52671] Sum rewards: 49.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.121', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.034', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.796', 'ARMOR': '0.916', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.794', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '42.000'} [2024-08-05 23:42:25,499][52665] DAMAGECOUNT value on done: 47307.0 [2024-08-05 23:42:25,499][52665] Sum rewards: 45.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.078', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.202', 'weapon2': '0.632', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '3.016', 'DAMAGECOUNT': '11.448', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:25,527][52663] DAMAGECOUNT value on done: 51600.0 [2024-08-05 23:42:25,528][52663] Sum rewards: 27.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.549', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.014', 'AMMO4': '0.056', 'weapon4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '1.274', 'ARMOR': '1.373', 'WEAPON3': '1.400', 'HITCOUNT': '2.060', 'weapon3': '2.404', 'DAMAGECOUNT': '8.097', 'FRAGCOUNT': '26.000'} [2024-08-05 23:42:26,075][52803] DAMAGECOUNT value on done: 49065.0 [2024-08-05 23:42:26,075][52803] Sum rewards: 41.414, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.149', 'weapon4': '0.166', 'AMMO3': '0.169', 'HEALTH': '0.295', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.857', 'weapon2': '0.860', 'WEAPON3': '1.000', 'HITCOUNT': '2.370', 'weapon3': '2.574', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:26,147][52666] DAMAGECOUNT value on done: 45902.0 [2024-08-05 23:42:26,148][52666] Sum rewards: 46.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.129', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.588', 'ARMOR': '0.925', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '42.000'} [2024-08-05 23:42:26,864][52670] DAMAGECOUNT value on done: 42971.0 [2024-08-05 23:42:26,865][52670] Sum rewards: 39.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.008', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'ARMOR': '0.484', 'weapon2': '0.784', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '2.616', 'DAMAGECOUNT': '10.455', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:27,001][52811] DAMAGECOUNT value on done: 46485.0 [2024-08-05 23:42:27,004][52811] Sum rewards: 39.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.172', 'AMMO5': '0.010', 'AMMO2': '0.037', 'ARMOR': '0.059', 'weapon5': '0.130', 'AMMO3': '0.178', 'AMMO4': '0.184', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:27,062][52650] Updated weights for policy 0, policy_version 17001 (0.0024) [2024-08-05 23:42:27,290][52658] DAMAGECOUNT value on done: 50127.0 [2024-08-05 23:42:27,292][52658] Sum rewards: 41.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.146', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.050', 'weapon4': '0.232', 'AMMO3': '0.234', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'ARMOR': '0.472', 'WEAPON4': '0.500', 'weapon2': '0.694', 'WEAPON3': '1.450', 'HITCOUNT': '2.310', 'weapon3': '2.686', 'DAMAGECOUNT': '10.803', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:27,784][52647] DAMAGECOUNT value on done: 50469.0 [2024-08-05 23:42:27,785][52647] Sum rewards: 42.643, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.240', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.558', 'WEAPON3': '1.800', 'weapon3': '2.794', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '41.000'} [2024-08-05 23:42:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 139280384. Throughput: 0: 4392.7. Samples: 34828500. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:42:27,795][52567] Avg episode reward: [(0, '38.861')] [2024-08-05 23:42:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017002_139280384.pth... [2024-08-05 23:42:27,963][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000016487_135061504.pth [2024-08-05 23:42:27,968][52614] Saving new best policy, reward=38.861! [2024-08-05 23:42:28,350][52665] DAMAGECOUNT value on done: 47350.0 [2024-08-05 23:42:28,350][52665] Sum rewards: 47.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.020', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO3': '0.179', 'AMMO4': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.434', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.448', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:28,434][52671] DAMAGECOUNT value on done: 46077.0 [2024-08-05 23:42:28,434][52671] Sum rewards: 29.837, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-0.995', 'AMMO2': '0.021', 'AMMO3': '0.078', 'AMMO4': '0.104', 'WEAPON4': '0.250', 'weapon4': '0.532', 'WEAPON3': '0.600', 'weapon2': '1.064', 'weapon3': '1.600', 'HITCOUNT': '1.810', 'DAMAGECOUNT': '7.023', 'FRAGCOUNT': '23.000'} [2024-08-05 23:42:28,474][52663] DAMAGECOUNT value on done: 48847.0 [2024-08-05 23:42:28,476][52663] Sum rewards: 44.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.863', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.064', 'AMMO4': '0.135', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.498', 'WEAPON3': '1.000', 'weapon2': '1.250', 'weapon3': '2.398', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:28,787][52666] DAMAGECOUNT value on done: 46933.0 [2024-08-05 23:42:28,788][52666] Sum rewards: 41.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.452', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon4': '0.094', 'AMMO4': '0.143', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'ARMOR': '0.832', 'weapon2': '0.892', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.838', 'DAMAGECOUNT': '11.109', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:29,245][52803] DAMAGECOUNT value on done: 43868.0 [2024-08-05 23:42:29,248][52803] Sum rewards: 39.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.223', 'AMMO2': '0.017', 'weapon4': '0.068', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'ARMOR': '0.400', 'weapon2': '1.042', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '2.686', 'DAMAGECOUNT': '10.581', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:29,600][52670] DAMAGECOUNT value on done: 48469.0 [2024-08-05 23:42:29,600][52670] Sum rewards: 43.315, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.033', 'AMMO3': '0.151', 'HEALTH': '0.166', 'AMMO4': '0.167', 'weapon4': '0.348', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'weapon2': '0.896', 'WEAPON3': '0.900', 'weapon3': '2.530', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:30,169][52811] DAMAGECOUNT value on done: 44900.0 [2024-08-05 23:42:30,170][52811] Sum rewards: 38.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.148', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.300', 'ARMOR': '0.436', 'weapon2': '0.838', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '2.436', 'DAMAGECOUNT': '10.173', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:30,239][52658] DAMAGECOUNT value on done: 47874.0 [2024-08-05 23:42:30,240][52658] Sum rewards: 40.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.470', 'weapon2': '0.702', 'ARMOR': '0.861', 'WEAPON3': '1.150', 'weapon3': '2.326', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:30,589][52647] DAMAGECOUNT value on done: 50510.0 [2024-08-05 23:42:30,589][52647] Sum rewards: 44.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.625', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.152', 'AMMO4': '0.155', 'weapon4': '0.204', 'WEAPON4': '0.350', 'weapon2': '0.722', 'WEAPON3': '0.950', 'HITCOUNT': '2.520', 'weapon3': '2.786', 'DAMAGECOUNT': '10.995', 'FRAGCOUNT': '37.000'} [2024-08-05 23:42:30,913][52665] DAMAGECOUNT value on done: 47284.0 [2024-08-05 23:42:30,913][52665] Sum rewards: 30.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'ARMOR': '0.856', 'weapon2': '1.096', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.514', 'DAMAGECOUNT': '9.906', 'FRAGCOUNT': '26.500'} [2024-08-05 23:42:31,120][52666] DAMAGECOUNT value on done: 46886.0 [2024-08-05 23:42:31,120][52666] Sum rewards: 41.058, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.880', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.251', 'weapon2': '0.378', 'WEAPON3': '1.550', 'HITCOUNT': '2.660', 'weapon3': '3.344', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:31,269][52663] DAMAGECOUNT value on done: 48714.0 [2024-08-05 23:42:31,269][52663] Sum rewards: 27.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.268', 'AMMO5': '0.017', 'ARMOR': '0.036', 'AMMO2': '0.040', 'weapon5': '0.060', 'weapon4': '0.190', 'AMMO3': '0.201', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.794', 'WEAPON3': '1.250', 'HITCOUNT': '2.220', 'weapon3': '2.604', 'DAMAGECOUNT': '9.153', 'FRAGCOUNT': '25.000'} [2024-08-05 23:42:31,595][52671] DAMAGECOUNT value on done: 47218.0 [2024-08-05 23:42:31,596][52671] Sum rewards: 33.499, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.358', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.239', 'weapon2': '1.112', 'ARMOR': '1.305', 'WEAPON3': '1.450', 'HITCOUNT': '2.270', 'weapon3': '2.566', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '33.000'} [2024-08-05 23:42:31,878][52650] Updated weights for policy 0, policy_version 17011 (0.0013) [2024-08-05 23:42:32,150][52670] DAMAGECOUNT value on done: 49940.0 [2024-08-05 23:42:32,150][52670] Sum rewards: 44.399, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.104', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'weapon2': '1.006', 'WEAPON3': '1.050', 'ARMOR': '1.340', 'weapon3': '2.504', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:32,393][52803] DAMAGECOUNT value on done: 49222.0 [2024-08-05 23:42:32,394][52803] Sum rewards: 32.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.014', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.169', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.106', 'ARMOR': '1.216', 'HITCOUNT': '2.300', 'weapon3': '2.384', 'DAMAGECOUNT': '9.141', 'FRAGCOUNT': '26.000'} [2024-08-05 23:42:32,699][52647] DAMAGECOUNT value on done: 51751.0 [2024-08-05 23:42:32,699][52647] Sum rewards: 49.122, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.407', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON3': '0.850', 'ARMOR': '0.853', 'weapon2': '1.266', 'weapon3': '2.254', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '10.659', 'FRAGCOUNT': '41.000'} [2024-08-05 23:42:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 139370496. Throughput: 0: 4382.2. Samples: 34841440. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:42:32,794][52567] Avg episode reward: [(0, '39.087')] [2024-08-05 23:42:32,795][52614] Saving new best policy, reward=39.087! [2024-08-05 23:42:33,170][52658] DAMAGECOUNT value on done: 49345.0 [2024-08-05 23:42:33,172][52658] Sum rewards: 33.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.149', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.195', 'weapon4': '0.434', 'WEAPON4': '0.550', 'ARMOR': '0.890', 'WEAPON3': '1.000', 'weapon2': '1.178', 'weapon3': '2.100', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.766', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:33,302][52811] DAMAGECOUNT value on done: 45641.0 [2024-08-05 23:42:33,302][52811] Sum rewards: 30.874, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.768', 'ARMOR': '1.285', 'WEAPON3': '1.300', 'HITCOUNT': '2.150', 'weapon3': '2.860', 'DAMAGECOUNT': '9.351', 'FRAGCOUNT': '26.500'} [2024-08-05 23:42:33,779][52665] DAMAGECOUNT value on done: 47165.0 [2024-08-05 23:42:33,779][52665] Sum rewards: 32.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.886', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.097', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'ARMOR': '0.915', 'weapon2': '1.086', 'WEAPON3': '1.350', 'HITCOUNT': '2.270', 'weapon3': '2.468', 'DAMAGECOUNT': '9.009', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:34,184][52666] DAMAGECOUNT value on done: 46819.0 [2024-08-05 23:42:34,186][52666] Sum rewards: 29.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.298', 'weapon5': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.181', 'weapon4': '0.184', 'AMMO4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.464', 'WEAPON4': '0.550', 'weapon2': '1.014', 'WEAPON3': '1.050', 'HITCOUNT': '1.880', 'weapon3': '2.462', 'DAMAGECOUNT': '8.241', 'FRAGCOUNT': '24.000'} [2024-08-05 23:42:34,238][52663] DAMAGECOUNT value on done: 46375.0 [2024-08-05 23:42:34,240][52663] Sum rewards: 36.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.730', 'weapon5': '0.002', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.422', 'WEAPON4': '0.450', 'ARMOR': '0.929', 'weapon2': '0.960', 'WEAPON3': '1.400', 'weapon3': '2.414', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '8.886', 'FRAGCOUNT': '33.000'} [2024-08-05 23:42:34,272][52671] DAMAGECOUNT value on done: 51626.0 [2024-08-05 23:42:34,273][52671] Sum rewards: 46.349, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.796', 'weapon5': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'ARMOR': '0.039', 'weapon4': '0.118', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.130', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '43.000'} [2024-08-05 23:42:35,022][52659] DAMAGECOUNT value on done: 49551.0 [2024-08-05 23:42:35,025][52659] Sum rewards: 38.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.157', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'weapon2': '1.018', 'WEAPON3': '1.200', 'HITCOUNT': '2.220', 'weapon3': '2.602', 'DAMAGECOUNT': '10.419', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:35,241][52670] DAMAGECOUNT value on done: 48951.0 [2024-08-05 23:42:35,242][52670] Sum rewards: 39.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.978', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.172', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.200', 'ARMOR': '1.337', 'HITCOUNT': '2.270', 'weapon3': '2.756', 'DAMAGECOUNT': '9.939', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:35,500][52803] DAMAGECOUNT value on done: 46026.0 [2024-08-05 23:42:35,502][52803] Sum rewards: 35.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.284', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.088', 'AMMO4': '0.180', 'weapon5': '0.180', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.855', 'weapon2': '0.950', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'weapon3': '2.548', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:35,731][52647] DAMAGECOUNT value on done: 50147.0 [2024-08-05 23:42:35,734][52647] Sum rewards: 23.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.096', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.042', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'ARMOR': '0.535', 'weapon2': '0.950', 'WEAPON3': '1.450', 'HITCOUNT': '2.330', 'weapon3': '2.548', 'DAMAGECOUNT': '9.183', 'FRAGCOUNT': '24.000'} [2024-08-05 23:42:36,156][52658] DAMAGECOUNT value on done: 49503.0 [2024-08-05 23:42:36,158][52658] Sum rewards: 37.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.340', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.164', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'ARMOR': '0.420', 'weapon2': '0.864', 'WEAPON3': '1.100', 'HITCOUNT': '2.390', 'weapon3': '2.688', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:36,420][52650] Updated weights for policy 0, policy_version 17021 (0.0019) [2024-08-05 23:42:36,451][52811] DAMAGECOUNT value on done: 47453.0 [2024-08-05 23:42:36,451][52811] Sum rewards: 34.150, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.192', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.234', 'ARMOR': '0.471', 'WEAPON3': '1.000', 'weapon2': '1.088', 'weapon3': '2.508', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '9.924', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:36,805][52663] DAMAGECOUNT value on done: 48927.0 [2024-08-05 23:42:36,807][52663] Sum rewards: 27.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.028', 'AMMO2': '0.036', 'weapon4': '0.162', 'AMMO3': '0.176', 'AMMO4': '0.177', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon2': '1.026', 'WEAPON3': '1.100', 'HITCOUNT': '1.820', 'weapon3': '2.616', 'DAMAGECOUNT': '7.710', 'FRAGCOUNT': '25.000'} [2024-08-05 23:42:37,010][52671] DAMAGECOUNT value on done: 50348.0 [2024-08-05 23:42:37,010][52671] Sum rewards: 44.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.643', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.018', 'weapon4': '0.078', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '1.024', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.664', 'DAMAGECOUNT': '11.037', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:37,343][52666] DAMAGECOUNT value on done: 47250.0 [2024-08-05 23:42:37,343][52666] Sum rewards: 34.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.584', 'ARMOR': '0.029', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.482', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.676', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 139452416. Throughput: 0: 4377.1. Samples: 34867800. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:42:37,794][52567] Avg episode reward: [(0, '38.467')] [2024-08-05 23:42:37,846][52659] DAMAGECOUNT value on done: 51974.0 [2024-08-05 23:42:37,846][52659] Sum rewards: 33.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.272', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.118', 'AMMO3': '0.181', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'weapon4': '0.382', 'WEAPON4': '0.500', 'weapon2': '0.684', 'ARMOR': '0.951', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.580', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '28.500'} [2024-08-05 23:42:38,188][52670] DAMAGECOUNT value on done: 49212.0 [2024-08-05 23:42:38,196][52670] Sum rewards: 30.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.920', 'weapon5': '0.002', 'weapon4': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.041', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.864', 'ARMOR': '0.932', 'WEAPON3': '1.600', 'HITCOUNT': '2.280', 'weapon3': '2.886', 'DAMAGECOUNT': '9.645', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:38,198][52647] DAMAGECOUNT value on done: 49629.0 [2024-08-05 23:42:38,198][52647] Sum rewards: 32.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.123', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'ARMOR': '0.938', 'weapon2': '1.004', 'WEAPON3': '1.250', 'HITCOUNT': '2.290', 'weapon3': '2.710', 'DAMAGECOUNT': '9.255', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:38,423][52803] DAMAGECOUNT value on done: 49234.0 [2024-08-05 23:42:38,425][52803] Sum rewards: 43.523, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.005', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.338', 'ARMOR': '0.456', 'weapon2': '0.882', 'WEAPON3': '1.150', 'weapon3': '2.518', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:38,819][52658] DAMAGECOUNT value on done: 48239.0 [2024-08-05 23:42:38,821][52658] Sum rewards: 32.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.430', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'AMMO4': '0.290', 'ARMOR': '0.481', 'weapon4': '0.708', 'WEAPON4': '0.750', 'weapon2': '0.840', 'WEAPON3': '1.350', 'weapon3': '2.186', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.300', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:39,506][52811] DAMAGECOUNT value on done: 49570.0 [2024-08-05 23:42:39,506][52811] Sum rewards: 51.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.566', 'ARMOR': '0.020', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.213', 'weapon4': '0.260', 'WEAPON4': '0.450', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '43.000'} [2024-08-05 23:42:39,601][52663] DAMAGECOUNT value on done: 50926.0 [2024-08-05 23:42:39,603][52663] Sum rewards: 47.974, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.501', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.372', 'ARMOR': '0.400', 'weapon4': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:39,943][52671] DAMAGECOUNT value on done: 52617.0 [2024-08-05 23:42:39,945][52671] Sum rewards: 30.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.031', 'weapon5': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon4': '0.210', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.984', 'WEAPON3': '1.150', 'ARMOR': '1.256', 'HITCOUNT': '1.920', 'weapon3': '2.528', 'DAMAGECOUNT': '8.550', 'FRAGCOUNT': '26.000'} [2024-08-05 23:42:40,339][52666] DAMAGECOUNT value on done: 46368.0 [2024-08-05 23:42:40,339][52666] Sum rewards: 36.295, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.148', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'weapon4': '0.314', 'HEALTH': '0.470', 'WEAPON3': '0.850', 'weapon2': '0.998', 'ARMOR': '1.240', 'HITCOUNT': '2.290', 'weapon3': '2.520', 'DAMAGECOUNT': '9.141', 'FRAGCOUNT': '29.000'} [2024-08-05 23:42:40,554][52659] DAMAGECOUNT value on done: 48460.0 [2024-08-05 23:42:40,556][52659] Sum rewards: 41.970, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.548', 'weapon2': '0.774', 'ARMOR': '0.943', 'WEAPON3': '1.100', 'HITCOUNT': '2.430', 'weapon3': '2.456', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:41,046][52650] Updated weights for policy 0, policy_version 17031 (0.0014) [2024-08-05 23:42:41,257][52670] DAMAGECOUNT value on done: 48877.0 [2024-08-05 23:42:41,257][52670] Sum rewards: 21.062, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.140', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.062', 'weapon4': '0.160', 'AMMO3': '0.191', 'AMMO4': '0.303', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'ARMOR': '0.899', 'weapon2': '1.194', 'WEAPON3': '1.250', 'HITCOUNT': '1.980', 'weapon3': '2.302', 'DAMAGECOUNT': '8.283', 'FRAGCOUNT': '22.500'} [2024-08-05 23:42:41,353][52803] DAMAGECOUNT value on done: 45128.0 [2024-08-05 23:42:41,353][52803] Sum rewards: 41.225, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.435', 'AMMO2': '0.004', 'WEAPON1': '0.020', 'AMMO4': '0.021', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.404', 'ARMOR': '0.418', 'weapon2': '0.638', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.644', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:41,372][52658] DAMAGECOUNT value on done: 50927.0 [2024-08-05 23:42:41,373][52658] Sum rewards: 41.463, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'HEALTH': '0.263', 'weapon4': '0.278', 'WEAPON3': '0.850', 'ARMOR': '0.868', 'weapon2': '0.974', 'HITCOUNT': '2.290', 'weapon3': '2.634', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '33.000'} [2024-08-05 23:42:42,592][52811] DAMAGECOUNT value on done: 45014.0 [2024-08-05 23:42:42,593][52811] Sum rewards: 50.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.946', 'AMMO5': '0.010', 'AMMO2': '0.021', 'ARMOR': '0.024', 'weapon5': '0.076', 'AMMO4': '0.102', 'weapon4': '0.146', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.680', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '2.808', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '45.000'} [2024-08-05 23:42:42,621][52663] DAMAGECOUNT value on done: 48798.0 [2024-08-05 23:42:42,623][52663] Sum rewards: 39.160, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.108', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.115', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON3': '0.700', 'weapon2': '0.718', 'ARMOR': '0.808', 'HITCOUNT': '2.060', 'weapon3': '2.790', 'DAMAGECOUNT': '9.279', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 139542528. Throughput: 0: 4380.7. Samples: 34894390. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:42:42,794][52567] Avg episode reward: [(0, '38.386')] [2024-08-05 23:42:42,867][52671] DAMAGECOUNT value on done: 49011.0 [2024-08-05 23:42:42,870][52671] Sum rewards: 43.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.134', 'AMMO5': '0.004', 'AMMO2': '0.030', 'weapon5': '0.038', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'ARMOR': '0.470', 'weapon2': '0.666', 'WEAPON3': '1.300', 'HITCOUNT': '2.420', 'weapon3': '3.012', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:43,142][52666] DAMAGECOUNT value on done: 46885.0 [2024-08-05 23:42:43,143][52666] Sum rewards: 37.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.469', 'AMMO2': '0.025', 'weapon4': '0.036', 'AMMO4': '0.127', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.714', 'ARMOR': '1.327', 'WEAPON3': '1.400', 'HITCOUNT': '2.380', 'weapon3': '3.022', 'DAMAGECOUNT': '10.452', 'FRAGCOUNT': '33.000'} [2024-08-05 23:42:43,760][52659] DAMAGECOUNT value on done: 50046.0 [2024-08-05 23:42:43,760][52659] Sum rewards: 46.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.783', 'AMMO5': '0.022', 'AMMO2': '0.038', 'AMMO3': '0.145', 'AMMO4': '0.192', 'weapon5': '0.212', 'WEAPON5': '0.450', 'ARMOR': '0.470', 'weapon2': '0.536', 'WEAPON4': '0.550', 'weapon4': '0.736', 'WEAPON3': '1.000', 'weapon3': '2.216', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '39.500'} [2024-08-05 23:42:43,957][52658] DAMAGECOUNT value on done: 53157.0 [2024-08-05 23:42:43,960][52658] Sum rewards: 25.902, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.080', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'ARMOR': '0.404', 'weapon2': '0.938', 'WEAPON3': '1.400', 'HITCOUNT': '2.230', 'weapon3': '2.598', 'DAMAGECOUNT': '9.048', 'FRAGCOUNT': '25.000'} [2024-08-05 23:42:44,092][52670] DAMAGECOUNT value on done: 45732.0 [2024-08-05 23:42:44,093][52670] Sum rewards: 33.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.345', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.186', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'ARMOR': '0.870', 'weapon2': '1.026', 'WEAPON3': '1.150', 'HITCOUNT': '2.160', 'weapon3': '2.598', 'DAMAGECOUNT': '9.390', 'FRAGCOUNT': '29.000'} [2024-08-05 23:42:44,455][52803] DAMAGECOUNT value on done: 49224.0 [2024-08-05 23:42:44,457][52803] Sum rewards: 48.642, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.360', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.178', 'weapon2': '0.892', 'WEAPON3': '1.150', 'ARMOR': '1.300', 'weapon3': '2.708', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '41.000'} [2024-08-05 23:42:45,392][52663] DAMAGECOUNT value on done: 50866.0 [2024-08-05 23:42:45,392][52663] Sum rewards: 41.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.018', 'ARMOR': '0.024', 'weapon5': '0.044', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.570', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.948', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:45,562][52811] DAMAGECOUNT value on done: 46437.0 [2024-08-05 23:42:45,562][52811] Sum rewards: 42.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.230', 'ARMOR': '0.473', 'weapon2': '0.802', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.774', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:45,660][52671] DAMAGECOUNT value on done: 51691.0 [2024-08-05 23:42:45,660][52671] Sum rewards: 35.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.678', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon5': '0.036', 'weapon4': '0.066', 'AMMO4': '0.093', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.946', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.692', 'DAMAGECOUNT': '10.536', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:45,890][52650] Updated weights for policy 0, policy_version 17041 (0.0011) [2024-08-05 23:42:45,985][52666] DAMAGECOUNT value on done: 48185.0 [2024-08-05 23:42:45,985][52666] Sum rewards: 41.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.294', 'weapon2': '0.730', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.782', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:46,541][52659] DAMAGECOUNT value on done: 49498.0 [2024-08-05 23:42:46,541][52659] Sum rewards: 37.659, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.775', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO4': '0.030', 'AMMO3': '0.152', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.454', 'weapon2': '0.796', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '2.830', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '31.000'} [2024-08-05 23:42:46,745][52658] DAMAGECOUNT value on done: 48759.0 [2024-08-05 23:42:46,745][52658] Sum rewards: 42.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.778', 'AMMO5': '0.010', 'AMMO2': '0.051', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.257', 'weapon4': '0.464', 'WEAPON4': '0.550', 'weapon2': '0.652', 'WEAPON3': '1.300', 'ARMOR': '1.343', 'HITCOUNT': '2.510', 'weapon3': '2.634', 'DAMAGECOUNT': '10.119', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:46,910][52670] DAMAGECOUNT value on done: 48197.0 [2024-08-05 23:42:46,910][52670] Sum rewards: 46.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.200', 'AMMO3': '0.224', 'ARMOR': '0.840', 'weapon2': '1.116', 'WEAPON3': '1.400', 'weapon3': '2.474', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '40.000'} [2024-08-05 23:42:47,480][52803] DAMAGECOUNT value on done: 46782.0 [2024-08-05 23:42:47,480][52803] Sum rewards: 40.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.608', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.052', 'weapon4': '0.132', 'AMMO4': '0.178', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.768', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.776', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 139632640. Throughput: 0: 4384.9. Samples: 34907620. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:42:47,794][52567] Avg episode reward: [(0, '38.757')] [2024-08-05 23:42:48,435][52663] DAMAGECOUNT value on done: 51927.0 [2024-08-05 23:42:48,436][52663] Sum rewards: 39.532, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.944', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.682', 'ARMOR': '1.317', 'WEAPON3': '1.600', 'HITCOUNT': '2.640', 'weapon3': '3.040', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '36.000'} [2024-08-05 23:42:48,565][52666] DAMAGECOUNT value on done: 48348.0 [2024-08-05 23:42:48,566][52666] Sum rewards: 34.469, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.069', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.099', 'AMMO3': '0.129', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'ARMOR': '0.848', 'weapon2': '1.154', 'HITCOUNT': '2.120', 'weapon3': '2.446', 'DAMAGECOUNT': '9.447', 'FRAGCOUNT': '26.000'} [2024-08-05 23:42:48,647][52811] DAMAGECOUNT value on done: 46164.0 [2024-08-05 23:42:48,649][52811] Sum rewards: 30.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.558', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.161', 'WEAPON4': '0.400', 'weapon4': '0.636', 'weapon2': '0.804', 'ARMOR': '0.890', 'WEAPON3': '1.000', 'weapon3': '2.186', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '9.279', 'FRAGCOUNT': '25.000'} [2024-08-05 23:42:48,806][52671] DAMAGECOUNT value on done: 50384.0 [2024-08-05 23:42:48,814][52671] Sum rewards: 33.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.854', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'weapon4': '0.188', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.500', 'HITCOUNT': '2.250', 'weapon3': '2.972', 'DAMAGECOUNT': '9.708', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:49,414][52670] DAMAGECOUNT value on done: 46856.0 [2024-08-05 23:42:49,414][52670] Sum rewards: 39.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.518', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.117', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon2': '1.084', 'WEAPON3': '1.250', 'ARMOR': '1.254', 'HITCOUNT': '2.470', 'weapon3': '2.690', 'DAMAGECOUNT': '10.347', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:49,529][52659] DAMAGECOUNT value on done: 51777.0 [2024-08-05 23:42:49,529][52659] Sum rewards: 47.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.258', 'weapon2': '0.962', 'WEAPON3': '1.200', 'weapon3': '2.640', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:49,736][52658] DAMAGECOUNT value on done: 48563.0 [2024-08-05 23:42:49,736][52658] Sum rewards: 48.204, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.304', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.159', 'WEAPON3': '1.000', 'weapon2': '1.172', 'ARMOR': '1.867', 'HITCOUNT': '2.440', 'weapon3': '2.472', 'DAMAGECOUNT': '10.953', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:50,452][52803] DAMAGECOUNT value on done: 45585.0 [2024-08-05 23:42:50,457][52803] Sum rewards: 28.422, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.182', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.243', 'AMMO3': '0.263', 'weapon2': '0.534', 'weapon4': '0.548', 'WEAPON4': '0.650', 'ARMOR': '0.959', 'WEAPON3': '1.550', 'HITCOUNT': '2.470', 'weapon3': '2.482', 'DAMAGECOUNT': '9.870', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:50,490][52650] Updated weights for policy 0, policy_version 17051 (0.0023) [2024-08-05 23:42:51,578][52663] DAMAGECOUNT value on done: 51096.0 [2024-08-05 23:42:51,581][52663] Sum rewards: 42.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon4': '0.238', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:51,779][52671] DAMAGECOUNT value on done: 48973.0 [2024-08-05 23:42:51,779][52671] Sum rewards: 33.710, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.953', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.140', 'weapon4': '0.178', 'AMMO3': '0.256', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.660', 'ARMOR': '0.832', 'WEAPON3': '1.600', 'HITCOUNT': '2.210', 'weapon3': '2.716', 'DAMAGECOUNT': '9.432', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:51,784][52811] DAMAGECOUNT value on done: 49655.0 [2024-08-05 23:42:51,784][52811] Sum rewards: 48.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.814', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.180', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.706', 'ARMOR': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.482', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '41.000'} [2024-08-05 23:42:52,157][52658] DAMAGECOUNT value on done: 51971.0 [2024-08-05 23:42:52,159][52658] Sum rewards: 38.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.987', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.157', 'WEAPON4': '0.350', 'weapon4': '0.354', 'weapon2': '0.808', 'WEAPON3': '1.150', 'weapon3': '2.456', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:52,342][52670] DAMAGECOUNT value on done: 47430.0 [2024-08-05 23:42:52,342][52670] Sum rewards: 36.930, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.194', 'ARMOR': '0.859', 'weapon2': '0.954', 'WEAPON3': '1.100', 'HITCOUNT': '2.110', 'weapon3': '2.680', 'DAMAGECOUNT': '9.384', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:52,475][52659] DAMAGECOUNT value on done: 50411.0 [2024-08-05 23:42:52,476][52659] Sum rewards: 35.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.413', 'AMMO5': '0.019', 'weapon5': '0.034', 'AMMO2': '0.040', 'AMMO3': '0.183', 'AMMO4': '0.198', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.150', 'HITCOUNT': '2.460', 'weapon3': '2.816', 'DAMAGECOUNT': '10.410', 'FRAGCOUNT': '30.000'} [2024-08-05 23:42:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 139722752. Throughput: 0: 4392.2. Samples: 34934300. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:42:52,794][52567] Avg episode reward: [(0, '38.304')] [2024-08-05 23:42:53,424][52803] DAMAGECOUNT value on done: 46667.0 [2024-08-05 23:42:53,424][52803] Sum rewards: 36.740, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.024', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'ARMOR': '0.504', 'weapon2': '0.986', 'WEAPON3': '1.600', 'weapon3': '2.666', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '35.000'} [2024-08-05 23:42:54,567][52663] DAMAGECOUNT value on done: 48782.0 [2024-08-05 23:42:54,568][52663] Sum rewards: 45.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.026', 'weapon5': '0.050', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'ARMOR': '0.800', 'weapon2': '0.898', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '39.000'} [2024-08-05 23:42:54,755][52671] DAMAGECOUNT value on done: 55048.0 [2024-08-05 23:42:54,755][52671] Sum rewards: 29.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO2': '0.011', 'weapon4': '0.038', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'ARMOR': '0.948', 'WEAPON3': '1.200', 'weapon2': '1.508', 'weapon3': '2.274', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '26.000'} [2024-08-05 23:42:54,843][52811] DAMAGECOUNT value on done: 44277.0 [2024-08-05 23:42:54,844][52811] Sum rewards: 29.670, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.516', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.048', 'weapon7': '0.054', 'weapon4': '0.066', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.218', 'weapon2': '1.054', 'WEAPON3': '1.300', 'ARMOR': '1.328', 'HITCOUNT': '2.060', 'weapon3': '2.522', 'DAMAGECOUNT': '8.757', 'FRAGCOUNT': '28.000'} [2024-08-05 23:42:54,875][52650] Updated weights for policy 0, policy_version 17061 (0.0018) [2024-08-05 23:42:55,072][52670] DAMAGECOUNT value on done: 47533.0 [2024-08-05 23:42:55,073][52670] Sum rewards: 32.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.711', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.223', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.000', 'HITCOUNT': '2.120', 'weapon3': '2.608', 'DAMAGECOUNT': '7.965', 'FRAGCOUNT': '27.000'} [2024-08-05 23:42:55,456][52659] DAMAGECOUNT value on done: 47088.0 [2024-08-05 23:42:55,458][52659] Sum rewards: 23.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.273', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.147', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'ARMOR': '0.832', 'weapon2': '1.044', 'WEAPON3': '1.200', 'HITCOUNT': '1.850', 'weapon3': '2.574', 'DAMAGECOUNT': '7.293', 'FRAGCOUNT': '22.000'} [2024-08-05 23:42:56,441][52803] DAMAGECOUNT value on done: 45813.0 [2024-08-05 23:42:56,441][52803] Sum rewards: 36.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.728', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'ARMOR': '0.412', 'weapon2': '0.690', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '3.080', 'DAMAGECOUNT': '9.876', 'FRAGCOUNT': '32.000'} [2024-08-05 23:42:57,699][52671] DAMAGECOUNT value on done: 50478.0 [2024-08-05 23:42:57,699][52671] Sum rewards: 43.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO2': '0.048', 'weapon5': '0.072', 'weapon4': '0.172', 'AMMO3': '0.201', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon2': '0.868', 'WEAPON3': '1.350', 'weapon3': '2.588', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '38.000'} [2024-08-05 23:42:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 139812864. Throughput: 0: 4394.2. Samples: 34960700. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:42:57,795][52567] Avg episode reward: [(0, '37.967')] [2024-08-05 23:42:58,018][52811] DAMAGECOUNT value on done: 48277.0 [2024-08-05 23:42:58,018][52811] Sum rewards: 42.436, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.380', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.948', 'WEAPON3': '1.000', 'HITCOUNT': '2.470', 'weapon3': '2.744', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '34.000'} [2024-08-05 23:42:58,250][52659] DAMAGECOUNT value on done: 48463.0 [2024-08-05 23:42:58,251][52659] Sum rewards: 37.952, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.454', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.223', 'weapon4': '0.308', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.136', 'HITCOUNT': '2.240', 'weapon3': '2.380', 'DAMAGECOUNT': '8.937', 'FRAGCOUNT': '29.000'} [2024-08-05 23:42:59,549][52803] DAMAGECOUNT value on done: 44235.0 [2024-08-05 23:42:59,551][52803] Sum rewards: 32.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.900', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.143', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'weapon4': '0.442', 'WEAPON4': '0.450', 'weapon2': '0.782', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.390', 'DAMAGECOUNT': '10.347', 'FRAGCOUNT': '28.500'} [2024-08-05 23:42:59,667][52650] Updated weights for policy 0, policy_version 17071 (0.0016) [2024-08-05 23:43:00,563][52671] DAMAGECOUNT value on done: 46803.0 [2024-08-05 23:43:00,563][52671] Sum rewards: 27.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.328', 'ARMOR': '0.971', 'weapon2': '1.174', 'WEAPON3': '1.450', 'HITCOUNT': '2.140', 'weapon3': '2.342', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '28.000'} [2024-08-05 23:43:01,030][52811] DAMAGECOUNT value on done: 45983.0 [2024-08-05 23:43:01,030][52811] Sum rewards: 34.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.953', 'AMMO2': '0.053', 'weapon4': '0.116', 'AMMO3': '0.225', 'AMMO4': '0.264', 'ARMOR': '0.448', 'WEAPON4': '0.500', 'weapon2': '0.790', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '2.862', 'DAMAGECOUNT': '9.711', 'FRAGCOUNT': '30.000'} [2024-08-05 23:43:01,183][52659] DAMAGECOUNT value on done: 51464.0 [2024-08-05 23:43:01,183][52659] Sum rewards: 36.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.033', 'ARMOR': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.234', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.816', 'WEAPON3': '1.300', 'weapon3': '2.544', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:02,673][52803] DAMAGECOUNT value on done: 46321.0 [2024-08-05 23:43:02,673][52803] Sum rewards: 43.233, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.068', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.308', 'ARMOR': '0.476', 'WEAPON3': '0.850', 'weapon2': '0.858', 'HITCOUNT': '2.440', 'weapon3': '2.550', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 139894784. Throughput: 0: 4395.3. Samples: 34973930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:43:02,795][52567] Avg episode reward: [(0, '37.999')] [2024-08-05 23:43:03,789][52671] DAMAGECOUNT value on done: 52708.0 [2024-08-05 23:43:03,791][52671] Sum rewards: 40.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.133', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'weapon4': '0.410', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'weapon2': '0.884', 'WEAPON3': '1.000', 'weapon3': '2.354', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:04,084][52811] DAMAGECOUNT value on done: 46881.0 [2024-08-05 23:43:04,084][52811] Sum rewards: 41.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.854', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'ARMOR': '0.820', 'weapon2': '0.930', 'WEAPON3': '1.200', 'HITCOUNT': '2.380', 'weapon3': '2.846', 'DAMAGECOUNT': '10.434', 'FRAGCOUNT': '36.000'} [2024-08-05 23:43:04,180][52650] Updated weights for policy 0, policy_version 17081 (0.0040) [2024-08-05 23:43:04,236][52659] DAMAGECOUNT value on done: 48902.0 [2024-08-05 23:43:04,239][52659] Sum rewards: 39.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.952', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon5': '0.076', 'AMMO3': '0.132', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.454', 'WEAPON3': '1.000', 'weapon2': '1.016', 'HITCOUNT': '2.210', 'weapon3': '2.590', 'DAMAGECOUNT': '9.366', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:05,896][52803] DAMAGECOUNT value on done: 46274.0 [2024-08-05 23:43:05,898][52803] Sum rewards: 34.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'AMMO2': '0.053', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'AMMO4': '0.266', 'weapon4': '0.330', 'ARMOR': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon2': '1.490', 'weapon3': '1.932', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.264', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:06,256][52671] DAMAGECOUNT value on done: 51533.0 [2024-08-05 23:43:06,256][52671] Sum rewards: 41.114, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.433', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon5': '0.242', 'weapon4': '0.248', 'weapon2': '0.536', 'ARMOR': '0.823', 'WEAPON3': '0.950', 'HITCOUNT': '2.600', 'weapon3': '2.756', 'DAMAGECOUNT': '10.347', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:06,762][52659] DAMAGECOUNT value on done: 50386.0 [2024-08-05 23:43:06,762][52659] Sum rewards: 41.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.986', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.726', 'WEAPON3': '1.250', 'ARMOR': '1.266', 'HITCOUNT': '2.370', 'weapon3': '2.968', 'DAMAGECOUNT': '9.945', 'FRAGCOUNT': '35.000'} [2024-08-05 23:43:07,221][52811] DAMAGECOUNT value on done: 47490.0 [2024-08-05 23:43:07,222][52811] Sum rewards: 50.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.012', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.145', 'weapon5': '0.152', 'AMMO4': '0.170', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.870', 'ARMOR': '1.306', 'weapon3': '2.428', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '41.000'} [2024-08-05 23:43:07,424][52649] DAMAGECOUNT value on done: 49463.0 [2024-08-05 23:43:07,424][52649] Sum rewards: 40.459, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.942', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.027', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.940', 'WEAPON3': '1.100', 'HITCOUNT': '2.550', 'weapon3': '2.804', 'DAMAGECOUNT': '10.080', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 139976704. Throughput: 0: 4392.9. Samples: 35000040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:43:07,795][52567] Avg episode reward: [(0, '38.092')] [2024-08-05 23:43:08,751][52803] DAMAGECOUNT value on done: 48418.0 [2024-08-05 23:43:08,751][52803] Sum rewards: 39.932, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.134', 'AMMO3': '0.145', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.670', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '2.576', 'DAMAGECOUNT': '10.188', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:08,903][52650] Updated weights for policy 0, policy_version 17091 (0.0011) [2024-08-05 23:43:08,910][52671] DAMAGECOUNT value on done: 52438.0 [2024-08-05 23:43:08,912][52671] Sum rewards: 39.365, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.282', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.060', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'ARMOR': '0.911', 'weapon2': '0.988', 'WEAPON3': '1.400', 'weapon3': '2.686', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.796', 'FRAGCOUNT': '37.000'} [2024-08-05 23:43:09,553][52659] DAMAGECOUNT value on done: 48358.0 [2024-08-05 23:43:09,553][52659] Sum rewards: 34.803, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.733', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.082', 'weapon5': '0.096', 'AMMO3': '0.165', 'AMMO4': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.734', 'WEAPON3': '1.200', 'ARMOR': '1.350', 'HITCOUNT': '2.220', 'weapon3': '2.852', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '30.500'} [2024-08-05 23:43:10,357][52811] DAMAGECOUNT value on done: 47091.0 [2024-08-05 23:43:10,358][52811] Sum rewards: 38.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon4': '0.254', 'weapon2': '0.922', 'WEAPON3': '1.200', 'ARMOR': '1.361', 'weapon3': '2.524', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:10,604][52649] DAMAGECOUNT value on done: 48830.0 [2024-08-05 23:43:10,604][52649] Sum rewards: 35.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.080', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.304', 'weapon2': '0.496', 'ARMOR': '0.864', 'WEAPON3': '0.950', 'HITCOUNT': '2.430', 'weapon3': '2.790', 'DAMAGECOUNT': '9.870', 'FRAGCOUNT': '28.000'} [2024-08-05 23:43:11,927][52803] DAMAGECOUNT value on done: 46345.0 [2024-08-05 23:43:11,928][52803] Sum rewards: 44.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.955', 'weapon5': '0.006', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'ARMOR': '0.509', 'weapon2': '0.678', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '3.118', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '39.000'} [2024-08-05 23:43:12,021][52671] DAMAGECOUNT value on done: 49328.0 [2024-08-05 23:43:12,022][52671] Sum rewards: 30.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'weapon4': '0.514', 'WEAPON3': '1.100', 'weapon2': '1.240', 'weapon3': '2.042', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '8.376', 'FRAGCOUNT': '27.000'} [2024-08-05 23:43:12,609][52659] DAMAGECOUNT value on done: 48714.0 [2024-08-05 23:43:12,611][52659] Sum rewards: 38.089, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.174', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'AMMO3': '0.149', 'weapon4': '0.174', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.038', 'ARMOR': '1.300', 'HITCOUNT': '2.400', 'weapon3': '2.556', 'DAMAGECOUNT': '9.717', 'FRAGCOUNT': '30.000'} [2024-08-05 23:43:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 140075008. Throughput: 0: 4405.6. Samples: 35026750. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:43:12,794][52567] Avg episode reward: [(0, '37.856')] [2024-08-05 23:43:12,952][52795] DAMAGECOUNT value on done: 47550.0 [2024-08-05 23:43:12,954][52795] Sum rewards: 40.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.474', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.014', 'ARMOR': '0.028', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.246', 'weapon2': '0.520', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.112', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '37.000'} [2024-08-05 23:43:13,324][52811] DAMAGECOUNT value on done: 49643.0 [2024-08-05 23:43:13,326][52811] Sum rewards: 38.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'ARMOR': '0.453', 'weapon4': '0.554', 'weapon2': '0.592', 'WEAPON3': '1.050', 'HITCOUNT': '2.290', 'weapon3': '2.486', 'DAMAGECOUNT': '9.525', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:13,661][52650] Updated weights for policy 0, policy_version 17101 (0.0028) [2024-08-05 23:43:13,875][52649] DAMAGECOUNT value on done: 48431.0 [2024-08-05 23:43:13,875][52649] Sum rewards: 44.577, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.012', 'AMMO2': '0.039', 'ARMOR': '0.068', 'AMMO3': '0.100', 'weapon5': '0.114', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.331', 'weapon2': '0.534', 'weapon4': '0.584', 'WEAPON3': '0.600', 'weapon3': '2.350', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.230', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:15,056][52671] DAMAGECOUNT value on done: 49258.0 [2024-08-05 23:43:15,057][52671] Sum rewards: 30.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.822', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.158', 'AMMO4': '0.182', 'weapon4': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.872', 'weapon2': '0.890', 'WEAPON3': '1.100', 'HITCOUNT': '1.890', 'weapon3': '2.384', 'DAMAGECOUNT': '9.171', 'FRAGCOUNT': '28.000'} [2024-08-05 23:43:15,606][52659] DAMAGECOUNT value on done: 50750.0 [2024-08-05 23:43:15,606][52659] Sum rewards: 38.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.044', 'AMMO5': '0.003', 'weapon5': '0.058', 'AMMO2': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'AMMO4': '0.323', 'weapon4': '0.356', 'ARMOR': '0.432', 'WEAPON4': '0.700', 'weapon2': '0.886', 'WEAPON3': '1.200', 'weapon3': '2.452', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.479', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:16,021][52795] DAMAGECOUNT value on done: 43458.0 [2024-08-05 23:43:16,022][52795] Sum rewards: 47.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.936', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.183', 'weapon2': '0.814', 'ARMOR': '0.824', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '3.034', 'DAMAGECOUNT': '11.118', 'FRAGCOUNT': '39.000'} [2024-08-05 23:43:16,332][52811] DAMAGECOUNT value on done: 44486.0 [2024-08-05 23:43:16,335][52811] Sum rewards: 32.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'ARMOR': '0.404', 'weapon2': '0.760', 'WEAPON3': '1.300', 'HITCOUNT': '2.150', 'weapon3': '2.736', 'DAMAGECOUNT': '9.228', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:16,637][52649] DAMAGECOUNT value on done: 48047.0 [2024-08-05 23:43:16,637][52649] Sum rewards: 24.724, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.960', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.078', 'weapon7': '0.092', 'AMMO3': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon4': '0.742', 'WEAPON3': '0.750', 'weapon2': '0.976', 'ARMOR': '1.442', 'HITCOUNT': '1.470', 'weapon3': '1.640', 'DAMAGECOUNT': '5.760', 'FRAGCOUNT': '19.000'} [2024-08-05 23:43:17,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 140165120. Throughput: 0: 4411.1. Samples: 35039940. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:43:17,794][52567] Avg episode reward: [(0, '37.834')] [2024-08-05 23:43:18,045][52650] Updated weights for policy 0, policy_version 17111 (0.0028) [2024-08-05 23:43:18,432][52659] DAMAGECOUNT value on done: 55128.0 [2024-08-05 23:43:18,434][52659] Sum rewards: 36.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.496', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'ARMOR': '0.424', 'weapon2': '0.834', 'WEAPON3': '1.450', 'HITCOUNT': '2.700', 'weapon3': '2.880', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:18,994][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:43:19,241][52795] DAMAGECOUNT value on done: 44722.0 [2024-08-05 23:43:19,242][52795] Sum rewards: 40.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.696', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.183', 'WEAPON4': '0.350', 'ARMOR': '0.473', 'weapon4': '0.522', 'weapon2': '0.602', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '2.486', 'DAMAGECOUNT': '10.119', 'FRAGCOUNT': '35.000'} [2024-08-05 23:43:19,451][52811] DAMAGECOUNT value on done: 46006.0 [2024-08-05 23:43:19,453][52811] Sum rewards: 37.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.944', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO4': '0.151', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.404', 'ARMOR': '0.465', 'weapon2': '0.626', 'WEAPON3': '1.200', 'HITCOUNT': '2.360', 'weapon3': '2.686', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:19,597][52649] DAMAGECOUNT value on done: 48722.0 [2024-08-05 23:43:19,597][52649] Sum rewards: 42.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.293', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'weapon5': '0.070', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'ARMOR': '0.408', 'weapon2': '0.672', 'WEAPON3': '1.450', 'weapon3': '2.776', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '38.000'} [2024-08-05 23:43:21,136][52659] DAMAGECOUNT value on done: 50099.0 [2024-08-05 23:43:21,136][52659] Sum rewards: 35.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.803', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.132', 'weapon5': '0.160', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.524', 'weapon2': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.836', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '29.000'} [2024-08-05 23:43:22,346][52795] DAMAGECOUNT value on done: 47326.0 [2024-08-05 23:43:22,347][52795] Sum rewards: 37.771, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.278', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.356', 'ARMOR': '0.840', 'weapon2': '0.844', 'WEAPON3': '1.250', 'weapon3': '2.466', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.797', 'FRAGCOUNT': '35.000'} [2024-08-05 23:43:22,391][52649] DAMAGECOUNT value on done: 48278.0 [2024-08-05 23:43:22,392][52649] Sum rewards: 29.612, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.602', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.124', 'AMMO3': '0.203', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'ARMOR': '0.488', 'weapon4': '0.532', 'WEAPON4': '0.650', 'weapon2': '0.662', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.340', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '28.000'} [2024-08-05 23:43:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 140247040. Throughput: 0: 4419.6. Samples: 35066680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:43:22,802][52567] Avg episode reward: [(0, '37.918')] [2024-08-05 23:43:22,882][52650] Updated weights for policy 0, policy_version 17121 (0.0023) [2024-08-05 23:43:23,725][52659] DAMAGECOUNT value on done: 50062.0 [2024-08-05 23:43:23,726][52659] Sum rewards: 39.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.842', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'AMMO4': '0.155', 'ARMOR': '0.441', 'WEAPON4': '0.550', 'weapon2': '0.708', 'weapon4': '0.772', 'WEAPON3': '1.050', 'weapon3': '2.330', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:24,410][52811] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2024-08-05 23:43:25,395][52795] DAMAGECOUNT value on done: 49191.0 [2024-08-05 23:43:25,398][52795] Sum rewards: 37.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.757', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.072', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'weapon2': '1.106', 'WEAPON3': '1.200', 'ARMOR': '1.200', 'weapon3': '2.402', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.413', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:25,575][52649] DAMAGECOUNT value on done: 46319.0 [2024-08-05 23:43:25,575][52649] Sum rewards: 37.317, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.285', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.007', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.173', 'ARMOR': '0.461', 'WEAPON3': '1.200', 'weapon2': '1.472', 'HITCOUNT': '2.170', 'weapon3': '2.368', 'DAMAGECOUNT': '9.330', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:26,471][52659] DAMAGECOUNT value on done: 49294.0 [2024-08-05 23:43:26,471][52659] Sum rewards: 34.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.451', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.038', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.224', 'WEAPON4': '0.300', 'ARMOR': '0.465', 'weapon2': '0.648', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.802', 'DAMAGECOUNT': '10.788', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:27,655][52650] Updated weights for policy 0, policy_version 17131 (0.0015) [2024-08-05 23:43:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 140337152. Throughput: 0: 4420.0. Samples: 35093290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:43:27,794][52567] Avg episode reward: [(0, '37.792')] [2024-08-05 23:43:28,509][52795] DAMAGECOUNT value on done: 48093.0 [2024-08-05 23:43:28,509][52795] Sum rewards: 49.717, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.835', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.245', 'ARMOR': '0.472', 'weapon2': '0.672', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '2.948', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '45.000'} [2024-08-05 23:43:29,035][52649] DAMAGECOUNT value on done: 50559.0 [2024-08-05 23:43:29,036][52649] Sum rewards: 36.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.048', 'AMMO4': '0.129', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'ARMOR': '0.420', 'weapon2': '0.840', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.708', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:29,058][52659] DAMAGECOUNT value on done: 52033.0 [2024-08-05 23:43:29,058][52659] Sum rewards: 30.244, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.170', 'ARMOR': '0.458', 'WEAPON3': '1.050', 'weapon2': '1.312', 'HITCOUNT': '2.140', 'weapon3': '2.548', 'DAMAGECOUNT': '7.932', 'FRAGCOUNT': '26.000'} [2024-08-05 23:43:29,289][52662] DAMAGECOUNT value on done: 55114.0 [2024-08-05 23:43:29,289][52662] Sum rewards: 45.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.554', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'weapon4': '0.196', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.718', 'ARMOR': '1.296', 'WEAPON3': '1.500', 'HITCOUNT': '2.670', 'weapon3': '2.756', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '41.000'} [2024-08-05 23:43:31,710][52795] DAMAGECOUNT value on done: 49539.0 [2024-08-05 23:43:31,711][52795] Sum rewards: 40.543, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.165', 'AMMO2': '0.036', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.180', 'weapon4': '0.216', 'weapon2': '0.950', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '2.604', 'DAMAGECOUNT': '9.705', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:31,743][52650] Updated weights for policy 0, policy_version 17141 (0.0014) [2024-08-05 23:43:31,798][52649] DAMAGECOUNT value on done: 46116.0 [2024-08-05 23:43:31,798][52649] Sum rewards: 32.408, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.094', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.834', 'ARMOR': '1.200', 'WEAPON3': '1.300', 'HITCOUNT': '1.980', 'weapon3': '2.756', 'DAMAGECOUNT': '9.114', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:31,937][52668] DAMAGECOUNT value on done: 50014.0 [2024-08-05 23:43:31,937][52668] Sum rewards: 39.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.748', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.102', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.398', 'ARMOR': '0.472', 'weapon2': '0.612', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.744', 'DAMAGECOUNT': '10.668', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:32,106][52662] DAMAGECOUNT value on done: 56398.0 [2024-08-05 23:43:32,106][52662] Sum rewards: 34.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.761', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.169', 'WEAPON4': '0.350', 'weapon4': '0.532', 'weapon2': '0.868', 'WEAPON3': '1.100', 'ARMOR': '1.358', 'HITCOUNT': '2.340', 'weapon3': '2.392', 'DAMAGECOUNT': '9.717', 'FRAGCOUNT': '29.000'} [2024-08-05 23:43:32,489][52794] DAMAGECOUNT value on done: 55348.0 [2024-08-05 23:43:32,490][52794] Sum rewards: 36.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.866', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.117', 'weapon5': '0.124', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon4': '0.372', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon2': '1.270', 'weapon3': '2.014', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.879', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 140427264. Throughput: 0: 4418.5. Samples: 35106450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:43:32,802][52567] Avg episode reward: [(0, '38.243')] [2024-08-05 23:43:34,588][52668] DAMAGECOUNT value on done: 54040.0 [2024-08-05 23:43:34,589][52668] Sum rewards: 44.398, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.395', 'AMMO5': '0.010', 'AMMO2': '0.037', 'ARMOR': '0.048', 'weapon5': '0.110', 'AMMO3': '0.116', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.526', 'weapon4': '0.548', 'WEAPON3': '0.750', 'HITCOUNT': '2.510', 'weapon3': '2.622', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '35.500'} [2024-08-05 23:43:34,696][52795] DAMAGECOUNT value on done: 46712.0 [2024-08-05 23:43:34,696][52795] Sum rewards: 37.912, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.707', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.114', 'AMMO4': '0.158', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.316', 'WEAPON4': '0.400', 'weapon2': '0.860', 'WEAPON3': '1.100', 'ARMOR': '1.313', 'HITCOUNT': '2.180', 'weapon3': '2.486', 'DAMAGECOUNT': '9.768', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:34,802][52649] DAMAGECOUNT value on done: 47142.0 [2024-08-05 23:43:34,803][52649] Sum rewards: 32.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON3': '0.950', 'weapon2': '1.022', 'ARMOR': '1.224', 'HITCOUNT': '2.070', 'weapon3': '2.412', 'DAMAGECOUNT': '8.190', 'FRAGCOUNT': '27.000'} [2024-08-05 23:43:35,091][52662] DAMAGECOUNT value on done: 57632.0 [2024-08-05 23:43:35,091][52662] Sum rewards: 29.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.042', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.265', 'weapon4': '0.444', 'ARMOR': '0.516', 'weapon2': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.190', 'weapon3': '2.614', 'DAMAGECOUNT': '8.451', 'FRAGCOUNT': '29.000'} [2024-08-05 23:43:35,425][52794] DAMAGECOUNT value on done: 55582.0 [2024-08-05 23:43:35,425][52794] Sum rewards: 49.254, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'HEALTH': '0.358', 'WEAPON3': '0.800', 'ARMOR': '0.877', 'weapon2': '1.110', 'HITCOUNT': '2.510', 'weapon3': '2.624', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '37.000'} [2024-08-05 23:43:36,848][52650] Updated weights for policy 0, policy_version 17151 (0.0025) [2024-08-05 23:43:37,172][52668] DAMAGECOUNT value on done: 47802.0 [2024-08-05 23:43:37,174][52668] Sum rewards: 36.836, reward structure: {'DEATHCOUNT': '-15.000', 'weapon4': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'HEALTH': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '3.260', 'DAMAGECOUNT': '10.374', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:37,296][52649] DAMAGECOUNT value on done: 49728.0 [2024-08-05 23:43:37,299][52649] Sum rewards: 32.477, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon4': '0.106', 'AMMO4': '0.119', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'ARMOR': '0.412', 'HEALTH': '0.482', 'WEAPON3': '0.800', 'weapon2': '0.880', 'HITCOUNT': '1.910', 'weapon3': '2.870', 'DAMAGECOUNT': '8.277', 'FRAGCOUNT': '26.000'} [2024-08-05 23:43:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 140517376. Throughput: 0: 4415.1. Samples: 35132980. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:43:37,802][52567] Avg episode reward: [(0, '38.117')] [2024-08-05 23:43:37,869][52795] DAMAGECOUNT value on done: 43913.0 [2024-08-05 23:43:37,869][52795] Sum rewards: 31.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'ARMOR': '0.500', 'weapon2': '0.886', 'WEAPON3': '1.450', 'HITCOUNT': '2.310', 'weapon3': '2.592', 'DAMAGECOUNT': '9.477', 'FRAGCOUNT': '28.000'} [2024-08-05 23:43:38,261][52662] DAMAGECOUNT value on done: 51201.0 [2024-08-05 23:43:38,262][52662] Sum rewards: 35.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.942', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.290', 'weapon2': '0.640', 'ARMOR': '0.921', 'WEAPON3': '1.300', 'HITCOUNT': '2.460', 'weapon3': '2.832', 'DAMAGECOUNT': '9.681', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:38,542][52794] DAMAGECOUNT value on done: 54985.0 [2024-08-05 23:43:38,544][52794] Sum rewards: 35.220, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.392', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.064', 'AMMO4': '0.106', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.330', 'WEAPON3': '0.850', 'ARMOR': '1.255', 'weapon2': '1.322', 'weapon3': '2.146', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '27.000'} [2024-08-05 23:43:40,064][52668] DAMAGECOUNT value on done: 49945.0 [2024-08-05 23:43:40,064][52668] Sum rewards: 37.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.549', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.498', 'ARMOR': '0.886', 'weapon2': '1.024', 'WEAPON3': '1.150', 'weapon3': '2.258', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.425', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:40,437][52649] DAMAGECOUNT value on done: 50440.0 [2024-08-05 23:43:40,437][52649] Sum rewards: 36.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.846', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.068', 'weapon4': '0.180', 'AMMO3': '0.209', 'AMMO4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.462', 'weapon2': '0.838', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.638', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '31.500'} [2024-08-05 23:43:41,004][52795] DAMAGECOUNT value on done: 46685.0 [2024-08-05 23:43:41,005][52795] Sum rewards: 36.218, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.190', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.030', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.270', 'ARMOR': '0.453', 'weapon2': '0.640', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.832', 'DAMAGECOUNT': '8.997', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:41,121][52662] DAMAGECOUNT value on done: 52934.0 [2024-08-05 23:43:41,123][52662] Sum rewards: 37.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon7': '0.048', 'weapon5': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.194', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon4': '0.458', 'weapon2': '0.670', 'WEAPON3': '1.300', 'HITCOUNT': '2.230', 'weapon3': '2.440', 'DAMAGECOUNT': '9.294', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:41,395][52794] DAMAGECOUNT value on done: 50520.0 [2024-08-05 23:43:41,395][52794] Sum rewards: 35.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.744', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.131', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.904', 'ARMOR': '1.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.200', 'weapon3': '2.754', 'DAMAGECOUNT': '8.877', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:41,403][52660] DAMAGECOUNT value on done: 51448.0 [2024-08-05 23:43:41,403][52660] Sum rewards: 41.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.814', 'WEAPON3': '1.150', 'HITCOUNT': '2.390', 'weapon3': '2.666', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '37.000'} [2024-08-05 23:43:41,620][52650] Updated weights for policy 0, policy_version 17161 (0.0023) [2024-08-05 23:43:42,748][52668] DAMAGECOUNT value on done: 51037.0 [2024-08-05 23:43:42,749][52668] Sum rewards: 42.447, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.946', 'AMMO2': '0.021', 'weapon4': '0.104', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'ARMOR': '0.412', 'weapon2': '0.816', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.878', 'DAMAGECOUNT': '10.239', 'FRAGCOUNT': '37.000'} [2024-08-05 23:43:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 140607488. Throughput: 0: 4411.8. Samples: 35159230. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-05 23:43:42,794][52567] Avg episode reward: [(0, '37.740')] [2024-08-05 23:43:43,370][52649] DAMAGECOUNT value on done: 51458.0 [2024-08-05 23:43:43,372][52649] Sum rewards: 42.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.364', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.610', 'ARMOR': '0.921', 'WEAPON3': '1.200', 'HITCOUNT': '2.420', 'weapon3': '3.062', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '37.000'} [2024-08-05 23:43:43,602][52664] DAMAGECOUNT value on done: 51367.0 [2024-08-05 23:43:43,602][52664] Sum rewards: 37.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.243', 'AMMO5': '0.020', 'ARMOR': '0.036', 'AMMO2': '0.080', 'weapon5': '0.148', 'AMMO3': '0.160', 'weapon4': '0.290', 'AMMO4': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'weapon2': '0.724', 'WEAPON3': '0.900', 'weapon3': '2.522', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:43,940][52662] DAMAGECOUNT value on done: 55645.0 [2024-08-05 23:43:43,941][52662] Sum rewards: 45.941, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'ARMOR': '0.450', 'weapon2': '0.474', 'weapon4': '0.586', 'WEAPON3': '1.550', 'weapon3': '2.550', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '42.000'} [2024-08-05 23:43:43,945][52795] DAMAGECOUNT value on done: 47270.0 [2024-08-05 23:43:43,946][52795] Sum rewards: 46.545, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.154', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.362', 'ARMOR': '0.878', 'weapon2': '0.990', 'WEAPON3': '1.050', 'weapon3': '2.190', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '38.000'} [2024-08-05 23:43:44,238][52794] DAMAGECOUNT value on done: 53549.0 [2024-08-05 23:43:44,240][52794] Sum rewards: 32.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.696', 'AMMO5': '0.015', 'AMMO2': '0.076', 'AMMO3': '0.175', 'weapon4': '0.242', 'WEAPON5': '0.250', 'AMMO4': '0.382', 'WEAPON4': '0.650', 'ARMOR': '0.800', 'WEAPON3': '0.950', 'weapon2': '0.962', 'HITCOUNT': '2.280', 'weapon3': '2.510', 'DAMAGECOUNT': '8.622', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:44,581][52660] DAMAGECOUNT value on done: 52966.0 [2024-08-05 23:43:44,581][52660] Sum rewards: 36.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.528', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.254', 'weapon2': '0.428', 'ARMOR': '0.462', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '2.554', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:45,586][52668] DAMAGECOUNT value on done: 52323.0 [2024-08-05 23:43:45,586][52668] Sum rewards: 41.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.272', 'AMMO2': '0.020', 'weapon4': '0.026', 'AMMO4': '0.098', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.758', 'ARMOR': '0.828', 'WEAPON3': '1.450', 'HITCOUNT': '2.750', 'weapon3': '2.986', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '37.000'} [2024-08-05 23:43:46,139][52650] Updated weights for policy 0, policy_version 17171 (0.0011) [2024-08-05 23:43:46,254][52664] DAMAGECOUNT value on done: 51932.0 [2024-08-05 23:43:46,254][52664] Sum rewards: 47.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.631', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'weapon4': '0.234', 'AMMO3': '0.260', 'WEAPON4': '0.550', 'weapon2': '0.646', 'ARMOR': '0.853', 'WEAPON3': '1.650', 'weapon3': '2.790', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '43.000'} [2024-08-05 23:43:46,297][52649] DAMAGECOUNT value on done: 49655.0 [2024-08-05 23:43:46,297][52649] Sum rewards: 40.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'ARMOR': '0.495', 'weapon4': '0.614', 'weapon2': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.418', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.041', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:46,906][52795] DAMAGECOUNT value on done: 45412.0 [2024-08-05 23:43:46,910][52795] Sum rewards: 30.450, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.658', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.070', 'weapon4': '0.110', 'AMMO4': '0.193', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '1.006', 'WEAPON3': '1.300', 'HITCOUNT': '1.990', 'weapon3': '2.574', 'DAMAGECOUNT': '8.541', 'FRAGCOUNT': '30.000'} [2024-08-05 23:43:47,285][52660] DAMAGECOUNT value on done: 50732.0 [2024-08-05 23:43:47,286][52660] Sum rewards: 44.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.028', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.518', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.066', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '39.000'} [2024-08-05 23:43:47,310][52662] DAMAGECOUNT value on done: 57224.0 [2024-08-05 23:43:47,312][52662] Sum rewards: 49.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.289', 'AMMO5': '0.005', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.206', 'WEAPON4': '0.400', 'weapon4': '0.472', 'weapon2': '0.920', 'WEAPON3': '1.150', 'ARMOR': '1.255', 'weapon3': '2.420', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '40.000'} [2024-08-05 23:43:47,526][52794] DAMAGECOUNT value on done: 55879.0 [2024-08-05 23:43:47,530][52794] Sum rewards: 35.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.666', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.168', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.449', 'weapon2': '0.680', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '2.922', 'DAMAGECOUNT': '11.595', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 140689408. Throughput: 0: 4407.8. Samples: 35172280. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:43:47,795][52567] Avg episode reward: [(0, '38.079')] [2024-08-05 23:43:48,322][52668] DAMAGECOUNT value on done: 52068.0 [2024-08-05 23:43:48,324][52668] Sum rewards: 45.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.066', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.171', 'weapon5': '0.188', 'ARMOR': '0.400', 'weapon2': '0.856', 'WEAPON3': '1.000', 'weapon3': '2.594', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '38.000'} [2024-08-05 23:43:48,811][52664] DAMAGECOUNT value on done: 53334.0 [2024-08-05 23:43:48,811][52664] Sum rewards: 28.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.473', 'AMMO5': '0.015', 'weapon5': '0.030', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.748', 'ARMOR': '0.887', 'WEAPON3': '1.250', 'HITCOUNT': '2.170', 'weapon3': '2.846', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '27.000'} [2024-08-05 23:43:49,387][52649] DAMAGECOUNT value on done: 44860.0 [2024-08-05 23:43:49,389][52649] Sum rewards: 15.138, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.940', 'AMMO2': '0.023', 'weapon7': '0.046', 'AMMO3': '0.083', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.550', 'weapon2': '0.596', 'weapon4': '0.976', 'HITCOUNT': '1.150', 'weapon3': '1.208', 'DAMAGECOUNT': '4.392', 'FRAGCOUNT': '13.000'} [2024-08-05 23:43:50,000][52658] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-05 23:43:50,016][52795] DAMAGECOUNT value on done: 47839.0 [2024-08-05 23:43:50,017][52795] Sum rewards: 38.081, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.342', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.062', 'AMMO4': '0.160', 'AMMO3': '0.199', 'weapon4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.826', 'ARMOR': '0.968', 'WEAPON3': '1.400', 'HITCOUNT': '2.470', 'weapon3': '2.670', 'DAMAGECOUNT': '10.911', 'FRAGCOUNT': '35.000'} [2024-08-05 23:43:50,155][52662] DAMAGECOUNT value on done: 59291.0 [2024-08-05 23:43:50,158][52662] Sum rewards: 34.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.548', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO2': '0.067', 'weapon5': '0.096', 'AMMO3': '0.151', 'AMMO4': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon2': '0.974', 'weapon3': '2.238', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '28.500'} [2024-08-05 23:43:50,159][52660] DAMAGECOUNT value on done: 51239.0 [2024-08-05 23:43:50,163][52660] Sum rewards: 43.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.775', 'AMMO5': '0.003', 'weapon5': '0.020', 'weapon4': '0.046', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.248', 'AMMO3': '0.251', 'WEAPON4': '0.450', 'ARMOR': '0.475', 'weapon2': '0.786', 'WEAPON3': '1.650', 'HITCOUNT': '2.480', 'weapon3': '2.872', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '41.000'} [2024-08-05 23:43:50,410][52794] DAMAGECOUNT value on done: 56145.0 [2024-08-05 23:43:50,411][52794] Sum rewards: 48.052, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.564', 'ARMOR': '0.808', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.116', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '43.000'} [2024-08-05 23:43:50,771][52650] Updated weights for policy 0, policy_version 17181 (0.0016) [2024-08-05 23:43:51,434][52668] DAMAGECOUNT value on done: 52425.0 [2024-08-05 23:43:51,436][52668] Sum rewards: 36.320, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.352', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.054', 'weapon4': '0.070', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'ARMOR': '0.449', 'weapon2': '0.682', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.926', 'DAMAGECOUNT': '9.774', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:51,584][52664] DAMAGECOUNT value on done: 52459.0 [2024-08-05 23:43:51,585][52664] Sum rewards: 35.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.566', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.252', 'ARMOR': '0.428', 'weapon2': '0.916', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '2.576', 'DAMAGECOUNT': '10.038', 'FRAGCOUNT': '31.000'} [2024-08-05 23:43:52,429][52649] DAMAGECOUNT value on done: 52238.0 [2024-08-05 23:43:52,429][52649] Sum rewards: 35.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO2': '0.015', 'AMMO5': '0.016', 'weapon4': '0.074', 'AMMO4': '0.076', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'weapon2': '0.618', 'ARMOR': '0.920', 'WEAPON3': '1.400', 'HITCOUNT': '2.360', 'weapon3': '2.960', 'DAMAGECOUNT': '10.797', 'FRAGCOUNT': '32.000'} [2024-08-05 23:43:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 140787712. Throughput: 0: 4422.7. Samples: 35199060. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-05 23:43:52,802][52567] Avg episode reward: [(0, '37.729')] [2024-08-05 23:43:53,019][52795] DAMAGECOUNT value on done: 48633.0 [2024-08-05 23:43:53,019][52795] Sum rewards: 43.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'ARMOR': '0.489', 'weapon2': '0.898', 'WEAPON3': '1.400', 'weapon3': '2.562', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '39.000'} [2024-08-05 23:43:53,264][52660] DAMAGECOUNT value on done: 47364.0 [2024-08-05 23:43:53,264][52660] Sum rewards: 49.854, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.146', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.099', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'ARMOR': '1.252', 'weapon2': '1.362', 'weapon3': '2.364', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '38.000'} [2024-08-05 23:43:53,352][52662] DAMAGECOUNT value on done: 52738.0 [2024-08-05 23:43:53,353][52662] Sum rewards: 30.794, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.343', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.148', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'ARMOR': '0.824', 'weapon2': '1.088', 'WEAPON3': '1.350', 'HITCOUNT': '2.250', 'weapon3': '2.634', 'DAMAGECOUNT': '8.463', 'FRAGCOUNT': '30.000'} [2024-08-05 23:43:53,568][52794] DAMAGECOUNT value on done: 52476.0 [2024-08-05 23:43:53,568][52794] Sum rewards: 29.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.003', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon4': '0.108', 'AMMO4': '0.119', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'weapon2': '1.238', 'HITCOUNT': '2.110', 'weapon3': '2.412', 'DAMAGECOUNT': '8.466', 'FRAGCOUNT': '27.000'} [2024-08-05 23:43:54,479][52664] DAMAGECOUNT value on done: 50396.0 [2024-08-05 23:43:54,481][52664] Sum rewards: 35.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.092', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.038', 'weapon4': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'weapon2': '0.664', 'WEAPON3': '1.400', 'HITCOUNT': '2.430', 'weapon3': '3.008', 'DAMAGECOUNT': '10.050', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:54,535][52668] DAMAGECOUNT value on done: 50573.0 [2024-08-05 23:43:54,535][52668] Sum rewards: 41.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.509', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.052', 'weapon4': '0.080', 'AMMO4': '0.137', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.444', 'weapon2': '0.702', 'WEAPON3': '1.150', 'HITCOUNT': '2.430', 'weapon3': '2.916', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '34.000'} [2024-08-05 23:43:55,021][52649] DAMAGECOUNT value on done: 46159.0 [2024-08-05 23:43:55,021][52649] Sum rewards: 44.071, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.176', 'AMMO5': '0.003', 'AMMO2': '0.027', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.132', 'AMMO3': '0.135', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '0.950', 'HITCOUNT': '2.440', 'weapon3': '3.004', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '36.000'} [2024-08-05 23:43:55,207][52650] Updated weights for policy 0, policy_version 17191 (0.0019) [2024-08-05 23:43:56,054][52795] DAMAGECOUNT value on done: 45867.0 [2024-08-05 23:43:56,056][52795] Sum rewards: 36.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.064', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.090', 'AMMO4': '0.094', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.816', 'WEAPON3': '1.150', 'weapon2': '1.344', 'HITCOUNT': '2.230', 'weapon3': '2.304', 'DAMAGECOUNT': '9.303', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:56,168][52660] DAMAGECOUNT value on done: 52029.0 [2024-08-05 23:43:56,169][52660] Sum rewards: 37.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.260', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.147', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.200', 'HITCOUNT': '2.320', 'weapon3': '2.806', 'DAMAGECOUNT': '10.413', 'FRAGCOUNT': '34.500'} [2024-08-05 23:43:56,393][52662] DAMAGECOUNT value on done: 55162.0 [2024-08-05 23:43:56,393][52662] Sum rewards: 39.642, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.364', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.180', 'weapon5': '0.196', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'ARMOR': '0.481', 'weapon2': '0.596', 'WEAPON4': '0.600', 'weapon4': '1.068', 'WEAPON3': '1.150', 'weapon3': '1.802', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '33.000'} [2024-08-05 23:43:56,590][52794] DAMAGECOUNT value on done: 54295.0 [2024-08-05 23:43:56,590][52794] Sum rewards: 28.415, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.390', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO4': '0.115', 'AMMO3': '0.116', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.474', 'WEAPON3': '0.850', 'weapon2': '1.072', 'HITCOUNT': '1.830', 'weapon3': '2.444', 'DAMAGECOUNT': '7.428', 'FRAGCOUNT': '22.000'} [2024-08-05 23:43:57,217][52664] DAMAGECOUNT value on done: 55716.0 [2024-08-05 23:43:57,217][52664] Sum rewards: 43.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.732', 'ARMOR': '0.933', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '2.952', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '38.000'} [2024-08-05 23:43:57,465][52668] DAMAGECOUNT value on done: 53207.0 [2024-08-05 23:43:57,466][52668] Sum rewards: 44.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.378', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.175', 'ARMOR': '0.400', 'weapon2': '0.988', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.780', 'DAMAGECOUNT': '11.115', 'FRAGCOUNT': '38.000'} [2024-08-05 23:43:57,723][52649] DAMAGECOUNT value on done: 50581.0 [2024-08-05 23:43:57,724][52649] Sum rewards: 39.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.682', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.068', 'weapon4': '0.136', 'AMMO3': '0.192', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'ARMOR': '0.448', 'weapon2': '0.880', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.710', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '35.000'} [2024-08-05 23:43:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 140869632. Throughput: 0: 4419.1. Samples: 35225610. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 23:43:57,794][52567] Avg episode reward: [(0, '38.292')] [2024-08-05 23:43:58,386][52663] Large shaping reward 2.598 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon5', 0.002)] [2024-08-05 23:43:59,125][52795] DAMAGECOUNT value on done: 49946.0 [2024-08-05 23:43:59,125][52795] Sum rewards: 42.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.284', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'AMMO3': '0.199', 'WEAPON4': '0.400', 'weapon4': '0.434', 'ARMOR': '0.440', 'weapon2': '0.608', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.742', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '38.000'} [2024-08-05 23:43:59,443][52660] DAMAGECOUNT value on done: 52053.0 [2024-08-05 23:43:59,447][52660] Sum rewards: 31.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.191', 'WEAPON3': '1.100', 'weapon2': '1.304', 'ARMOR': '1.654', 'HITCOUNT': '2.310', 'weapon3': '2.556', 'DAMAGECOUNT': '8.364', 'FRAGCOUNT': '28.000'} [2024-08-05 23:43:59,550][52662] DAMAGECOUNT value on done: 54527.0 [2024-08-05 23:43:59,550][52662] Sum rewards: 39.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.814', 'AMMO5': '0.010', 'ARMOR': '0.036', 'weapon5': '0.052', 'AMMO2': '0.057', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.222', 'AMMO4': '0.287', 'WEAPON4': '0.550', 'weapon2': '0.996', 'WEAPON3': '1.250', 'weapon3': '2.466', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.233', 'FRAGCOUNT': '36.000'} [2024-08-05 23:43:59,815][52794] DAMAGECOUNT value on done: 57254.0 [2024-08-05 23:43:59,816][52794] Sum rewards: 34.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.112', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.174', 'WEAPON3': '1.000', 'weapon2': '1.358', 'ARMOR': '1.653', 'HITCOUNT': '2.160', 'weapon3': '2.374', 'DAMAGECOUNT': '9.159', 'FRAGCOUNT': '28.000'} [2024-08-05 23:44:00,123][52650] Updated weights for policy 0, policy_version 17201 (0.0024) [2024-08-05 23:44:00,213][52664] DAMAGECOUNT value on done: 53030.0 [2024-08-05 23:44:00,215][52664] Sum rewards: 41.406, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.036', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.902', 'WEAPON3': '1.150', 'ARMOR': '1.355', 'HITCOUNT': '2.570', 'weapon3': '2.732', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:00,668][52668] DAMAGECOUNT value on done: 49981.0 [2024-08-05 23:44:00,669][52668] Sum rewards: 44.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.921', 'AMMO5': '0.009', 'weapon5': '0.028', 'AMMO2': '0.045', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'weapon4': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.060', 'ARMOR': '1.307', 'weapon3': '2.230', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.974', 'FRAGCOUNT': '36.500'} [2024-08-05 23:44:00,809][52649] DAMAGECOUNT value on done: 49829.0 [2024-08-05 23:44:00,811][52649] Sum rewards: 42.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.849', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'ARMOR': '0.865', 'weapon2': '0.884', 'WEAPON3': '1.600', 'weapon3': '2.534', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '38.000'} [2024-08-05 23:44:02,315][52662] DAMAGECOUNT value on done: 55215.0 [2024-08-05 23:44:02,316][52662] Sum rewards: 55.521, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.632', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'ARMOR': '0.447', 'weapon2': '1.050', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '45.000'} [2024-08-05 23:44:02,338][52660] DAMAGECOUNT value on done: 51148.0 [2024-08-05 23:44:02,339][52660] Sum rewards: 38.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.932', 'AMMO5': '0.008', 'weapon4': '0.024', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.902', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '2.650', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '33.500'} [2024-08-05 23:44:02,408][52795] DAMAGECOUNT value on done: 52190.0 [2024-08-05 23:44:02,409][52795] Sum rewards: 56.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.953', 'AMMO2': '0.006', 'weapon4': '0.024', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'ARMOR': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.178', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '47.000'} [2024-08-05 23:44:02,476][52794] DAMAGECOUNT value on done: 56806.0 [2024-08-05 23:44:02,477][52794] Sum rewards: 40.479, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.881', 'AMMO2': '0.004', 'weapon4': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.114', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.198', 'ARMOR': '1.257', 'weapon3': '2.320', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '10.716', 'FRAGCOUNT': '31.000'} [2024-08-05 23:44:02,596][52664] DAMAGECOUNT value on done: 49093.0 [2024-08-05 23:44:02,598][52664] Sum rewards: 21.483, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.874', 'AMMO5': '0.003', 'weapon5': '0.024', 'ARMOR': '0.032', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'AMMO4': '0.193', 'weapon4': '0.320', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '1.530', 'weapon3': '2.788', 'DAMAGECOUNT': '6.990', 'FRAGCOUNT': '19.000'} [2024-08-05 23:44:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 140959744. Throughput: 0: 4416.9. Samples: 35238700. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 23:44:02,794][52567] Avg episode reward: [(0, '38.302')] [2024-08-05 23:44:03,189][52668] DAMAGECOUNT value on done: 50750.0 [2024-08-05 23:44:03,190][52668] Sum rewards: 45.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.334', 'ARMOR': '0.489', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.200', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:03,936][52649] DAMAGECOUNT value on done: 53479.0 [2024-08-05 23:44:03,937][52649] Sum rewards: 35.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.744', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'ARMOR': '0.451', 'weapon2': '0.812', 'WEAPON3': '1.800', 'HITCOUNT': '2.440', 'weapon3': '2.926', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '35.000'} [2024-08-05 23:44:04,526][52650] Updated weights for policy 0, policy_version 17211 (0.0011) [2024-08-05 23:44:04,833][52660] DAMAGECOUNT value on done: 51188.0 [2024-08-05 23:44:04,835][52660] Sum rewards: 50.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.870', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.230', 'ARMOR': '0.457', 'weapon2': '0.640', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.148', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '44.000'} [2024-08-05 23:44:05,031][52662] DAMAGECOUNT value on done: 56884.0 [2024-08-05 23:44:05,034][52662] Sum rewards: 36.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.727', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'ARMOR': '0.436', 'weapon2': '0.848', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.828', 'DAMAGECOUNT': '10.401', 'FRAGCOUNT': '33.000'} [2024-08-05 23:44:05,259][52794] DAMAGECOUNT value on done: 56546.0 [2024-08-05 23:44:05,262][52794] Sum rewards: 27.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'AMMO5': '0.012', 'AMMO2': '0.039', 'ARMOR': '0.040', 'weapon5': '0.106', 'AMMO3': '0.163', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.588', 'WEAPON3': '1.000', 'HITCOUNT': '1.590', 'weapon3': '2.784', 'DAMAGECOUNT': '7.953', 'FRAGCOUNT': '25.000'} [2024-08-05 23:44:05,359][52664] DAMAGECOUNT value on done: 57931.0 [2024-08-05 23:44:05,361][52664] Sum rewards: 38.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'ARMOR': '0.800', 'weapon2': '0.884', 'WEAPON3': '1.550', 'HITCOUNT': '2.550', 'weapon3': '2.776', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '36.000'} [2024-08-05 23:44:05,397][52795] DAMAGECOUNT value on done: 46250.0 [2024-08-05 23:44:05,398][52795] Sum rewards: 42.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.068', 'WEAPON4': '0.150', 'weapon4': '0.206', 'AMMO3': '0.223', 'ARMOR': '0.404', 'weapon2': '0.922', 'WEAPON3': '1.400', 'weapon3': '2.624', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:06,013][52668] DAMAGECOUNT value on done: 47357.0 [2024-08-05 23:44:06,013][52668] Sum rewards: 36.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.792', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.187', 'WEAPON4': '0.350', 'weapon4': '0.538', 'weapon2': '0.834', 'WEAPON3': '0.900', 'ARMOR': '1.371', 'HITCOUNT': '2.350', 'weapon3': '2.438', 'DAMAGECOUNT': '9.366', 'FRAGCOUNT': '30.000'} [2024-08-05 23:44:06,047][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:44:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17885.9, 300 sec: 17633.6). Total num frames: 141049856. Throughput: 0: 4413.8. Samples: 35265300. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-05 23:44:07,802][52567] Avg episode reward: [(0, '38.422')] [2024-08-05 23:44:07,982][52660] DAMAGECOUNT value on done: 51332.0 [2024-08-05 23:44:07,982][52660] Sum rewards: 43.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.955', 'AMMO2': '0.026', 'weapon4': '0.088', 'AMMO4': '0.128', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.628', 'ARMOR': '0.862', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '2.990', 'DAMAGECOUNT': '10.983', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:08,081][52662] DAMAGECOUNT value on done: 54907.0 [2024-08-05 23:44:08,082][52662] Sum rewards: 50.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.359', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.171', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.684', 'ARMOR': '0.867', 'WEAPON3': '1.100', 'weapon3': '2.596', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '43.000'} [2024-08-05 23:44:08,120][52664] DAMAGECOUNT value on done: 53235.0 [2024-08-05 23:44:08,121][52664] Sum rewards: 47.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.615', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.284', 'weapon2': '0.636', 'ARMOR': '0.844', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:08,258][52794] DAMAGECOUNT value on done: 54614.0 [2024-08-05 23:44:08,261][52794] Sum rewards: 49.218, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.190', 'AMMO2': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.143', 'weapon4': '0.144', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.040', 'weapon3': '2.606', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '41.000'} [2024-08-05 23:44:08,584][52795] DAMAGECOUNT value on done: 47879.0 [2024-08-05 23:44:08,587][52795] Sum rewards: 47.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.456', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'weapon4': '0.226', 'AMMO3': '0.239', 'weapon2': '0.662', 'ARMOR': '0.947', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '42.000'} [2024-08-05 23:44:08,809][52668] DAMAGECOUNT value on done: 51402.0 [2024-08-05 23:44:08,811][52668] Sum rewards: 45.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.160', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.098', 'AMMO3': '0.139', 'weapon5': '0.140', 'AMMO4': '0.195', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.504', 'weapon2': '0.968', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.538', 'FRAGCOUNT': '36.000'} [2024-08-05 23:44:09,311][52650] Updated weights for policy 0, policy_version 17221 (0.0014) [2024-08-05 23:44:10,239][52660] DAMAGECOUNT value on done: 50108.0 [2024-08-05 23:44:10,239][52660] Sum rewards: 35.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.852', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.219', 'weapon4': '0.262', 'WEAPON4': '0.550', 'weapon2': '0.762', 'ARMOR': '0.974', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.648', 'DAMAGECOUNT': '9.609', 'FRAGCOUNT': '33.000'} [2024-08-05 23:44:10,603][52664] DAMAGECOUNT value on done: 55120.0 [2024-08-05 23:44:10,603][52664] Sum rewards: 43.286, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.070', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.082', 'weapon4': '0.162', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.730', 'ARMOR': '0.908', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.826', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '34.000'} [2024-08-05 23:44:10,942][52662] DAMAGECOUNT value on done: 54864.0 [2024-08-05 23:44:10,942][52662] Sum rewards: 36.730, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.591', 'AMMO5': '0.005', 'AMMO2': '0.046', 'ARMOR': '0.084', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.124', 'AMMO4': '0.228', 'WEAPON4': '0.450', 'weapon2': '0.716', 'weapon4': '0.728', 'WEAPON3': '0.800', 'weapon3': '2.190', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '8.922', 'FRAGCOUNT': '28.000'} [2024-08-05 23:44:11,114][52794] DAMAGECOUNT value on done: 60091.0 [2024-08-05 23:44:11,115][52794] Sum rewards: 40.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.499', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'AMMO4': '0.224', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '0.662', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.678', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '36.000'} [2024-08-05 23:44:11,332][52668] DAMAGECOUNT value on done: 50051.0 [2024-08-05 23:44:11,332][52668] Sum rewards: 23.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'ARMOR': '1.323', 'WEAPON3': '1.350', 'weapon2': '1.394', 'HITCOUNT': '1.840', 'weapon3': '2.390', 'DAMAGECOUNT': '7.569', 'FRAGCOUNT': '23.000'} [2024-08-05 23:44:11,658][52795] DAMAGECOUNT value on done: 49804.0 [2024-08-05 23:44:11,658][52795] Sum rewards: 44.790, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.775', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.430', 'WEAPON4': '0.450', 'ARMOR': '0.491', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.532', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:12,172][52662] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:44:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 141131776. Throughput: 0: 4408.9. Samples: 35291690. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:44:12,802][52567] Avg episode reward: [(0, '39.016')] [2024-08-05 23:44:13,042][52660] DAMAGECOUNT value on done: 50256.0 [2024-08-05 23:44:13,043][52660] Sum rewards: 26.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.134', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.420', 'weapon2': '0.766', 'WEAPON3': '1.050', 'HITCOUNT': '2.050', 'weapon3': '2.794', 'DAMAGECOUNT': '8.895', 'FRAGCOUNT': '22.500'} [2024-08-05 23:44:13,086][52664] DAMAGECOUNT value on done: 51841.0 [2024-08-05 23:44:13,088][52664] Sum rewards: 40.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.915', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.094', 'weapon4': '0.170', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.772', 'ARMOR': '0.929', 'WEAPON3': '1.300', 'weapon3': '2.626', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '35.500'} [2024-08-05 23:44:13,690][52650] Updated weights for policy 0, policy_version 17231 (0.0031) [2024-08-05 23:44:13,833][52662] DAMAGECOUNT value on done: 57384.0 [2024-08-05 23:44:13,833][52662] Sum rewards: 46.170, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.533', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.178', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'weapon2': '0.626', 'WEAPON3': '1.600', 'HITCOUNT': '2.930', 'weapon3': '2.940', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '44.000'} [2024-08-05 23:44:14,122][52794] DAMAGECOUNT value on done: 54003.0 [2024-08-05 23:44:14,124][52794] Sum rewards: 44.829, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.134', 'AMMO5': '0.007', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.412', 'WEAPON3': '1.500', 'HITCOUNT': '2.610', 'weapon3': '3.002', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '43.000'} [2024-08-05 23:44:14,581][52668] DAMAGECOUNT value on done: 51119.0 [2024-08-05 23:44:14,582][52668] Sum rewards: 36.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.624', 'AMMO5': '0.009', 'ARMOR': '0.036', 'weapon5': '0.048', 'AMMO2': '0.052', 'weapon4': '0.176', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.260', 'WEAPON4': '0.550', 'weapon2': '0.984', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.542', 'DAMAGECOUNT': '9.087', 'FRAGCOUNT': '33.000'} [2024-08-05 23:44:15,276][52664] DAMAGECOUNT value on done: 52528.0 [2024-08-05 23:44:15,277][52664] Sum rewards: 43.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.534', 'weapon4': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'ARMOR': '0.455', 'weapon2': '0.716', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '3.026', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '36.000'} [2024-08-05 23:44:16,363][52660] DAMAGECOUNT value on done: 49170.0 [2024-08-05 23:44:16,364][52660] Sum rewards: 37.348, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.199', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'ARMOR': '0.400', 'weapon4': '0.582', 'WEAPON3': '0.900', 'weapon2': '1.130', 'weapon3': '2.120', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.048', 'FRAGCOUNT': '29.000'} [2024-08-05 23:44:16,628][52662] DAMAGECOUNT value on done: 52607.0 [2024-08-05 23:44:16,630][52662] Sum rewards: 30.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.020', 'AMMO4': '0.073', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.483', 'weapon4': '0.582', 'weapon2': '0.738', 'WEAPON3': '1.050', 'HITCOUNT': '2.090', 'weapon3': '2.382', 'DAMAGECOUNT': '8.559', 'FRAGCOUNT': '26.000'} [2024-08-05 23:44:16,905][52794] DAMAGECOUNT value on done: 56611.0 [2024-08-05 23:44:16,908][52794] Sum rewards: 40.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.122', 'AMMO5': '0.005', 'ARMOR': '0.025', 'AMMO2': '0.044', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.230', 'weapon2': '0.324', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '2.752', 'DAMAGECOUNT': '11.304', 'FRAGCOUNT': '36.000'} [2024-08-05 23:44:17,698][52668] DAMAGECOUNT value on done: 49717.0 [2024-08-05 23:44:17,698][52668] Sum rewards: 46.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'AMMO3': '0.196', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.540', 'weapon4': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.526', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.992', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 141221888. Throughput: 0: 4417.1. Samples: 35305220. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:44:17,802][52567] Avg episode reward: [(0, '39.136')] [2024-08-05 23:44:17,821][52614] Saving new best policy, reward=39.136! [2024-08-05 23:44:18,366][52664] DAMAGECOUNT value on done: 51786.0 [2024-08-05 23:44:18,366][52664] Sum rewards: 34.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.784', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.051', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.253', 'weapon4': '0.472', 'WEAPON4': '0.600', 'weapon2': '0.668', 'WEAPON3': '1.200', 'HITCOUNT': '2.390', 'weapon3': '2.482', 'DAMAGECOUNT': '9.555', 'FRAGCOUNT': '31.000'} [2024-08-05 23:44:18,686][52650] Updated weights for policy 0, policy_version 17241 (0.0022) [2024-08-05 23:44:19,054][52614] Signal inference workers to stop experience collection... (3200 times) [2024-08-05 23:44:19,058][52614] Signal inference workers to resume experience collection... (3200 times) [2024-08-05 23:44:19,111][52650] InferenceWorker_p0-w0: stopping experience collection (3200 times) [2024-08-05 23:44:19,112][52650] InferenceWorker_p0-w0: resuming experience collection (3200 times) [2024-08-05 23:44:19,313][52660] DAMAGECOUNT value on done: 51291.0 [2024-08-05 23:44:19,314][52660] Sum rewards: 40.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.149', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.854', 'WEAPON3': '1.200', 'HITCOUNT': '2.530', 'weapon3': '2.898', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:19,478][52662] DAMAGECOUNT value on done: 56685.0 [2024-08-05 23:44:19,481][52662] Sum rewards: 42.549, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.754', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'ARMOR': '0.920', 'weapon2': '0.958', 'WEAPON3': '1.550', 'weapon3': '2.592', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:19,747][52794] DAMAGECOUNT value on done: 58645.0 [2024-08-05 23:44:19,750][52794] Sum rewards: 46.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.460', 'weapon2': '0.618', 'ARMOR': '1.273', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '2.590', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:20,544][52668] DAMAGECOUNT value on done: 48747.0 [2024-08-05 23:44:20,547][52668] Sum rewards: 41.780, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.785', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.141', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.266', 'ARMOR': '0.849', 'weapon2': '0.912', 'WEAPON3': '1.000', 'HITCOUNT': '2.190', 'weapon3': '2.416', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '33.500'} [2024-08-05 23:44:21,391][52664] DAMAGECOUNT value on done: 55598.0 [2024-08-05 23:44:21,391][52664] Sum rewards: 41.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.062', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.094', 'AMMO4': '0.160', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.600', 'HITCOUNT': '2.400', 'weapon3': '2.928', 'DAMAGECOUNT': '10.056', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:21,788][52662] DAMAGECOUNT value on done: 56631.0 [2024-08-05 23:44:21,788][52662] Sum rewards: 48.149, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.064', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'HEALTH': '0.210', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'ARMOR': '0.424', 'weapon2': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '3.090', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '40.000'} [2024-08-05 23:44:22,119][52794] DAMAGECOUNT value on done: 56259.0 [2024-08-05 23:44:22,119][52794] Sum rewards: 34.727, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.796', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.097', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.958', 'WEAPON3': '1.000', 'weapon2': '1.100', 'HITCOUNT': '2.060', 'weapon3': '2.618', 'DAMAGECOUNT': '8.742', 'FRAGCOUNT': '28.000'} [2024-08-05 23:44:22,382][52660] DAMAGECOUNT value on done: 55726.0 [2024-08-05 23:44:22,382][52660] Sum rewards: 48.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.253', 'AMMO5': '0.007', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'weapon5': '0.182', 'AMMO3': '0.189', 'AMMO4': '0.198', 'weapon4': '0.382', 'WEAPON4': '0.400', 'ARMOR': '0.478', 'weapon2': '0.708', 'WEAPON3': '1.100', 'weapon3': '2.502', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '40.000'} [2024-08-05 23:44:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 141303808. Throughput: 0: 4406.4. Samples: 35331270. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:44:22,794][52567] Avg episode reward: [(0, '39.562')] [2024-08-05 23:44:22,801][52614] Saving new best policy, reward=39.562! [2024-08-05 23:44:22,807][52669] DAMAGECOUNT value on done: 52161.0 [2024-08-05 23:44:22,809][52669] Sum rewards: 45.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.438', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.998', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '40.000'} [2024-08-05 23:44:23,208][52650] Updated weights for policy 0, policy_version 17251 (0.0017) [2024-08-05 23:44:23,727][52668] DAMAGECOUNT value on done: 52176.0 [2024-08-05 23:44:23,728][52668] Sum rewards: 36.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.414', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.157', 'WEAPON4': '0.350', 'ARMOR': '0.463', 'WEAPON3': '0.650', 'weapon4': '0.658', 'weapon2': '0.660', 'weapon3': '2.346', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '9.246', 'FRAGCOUNT': '29.000'} [2024-08-05 23:44:24,219][52664] DAMAGECOUNT value on done: 51531.0 [2024-08-05 23:44:24,219][52664] Sum rewards: 47.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon2': '0.760', 'ARMOR': '0.804', 'WEAPON3': '0.950', 'weapon3': '2.722', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '38.000'} [2024-08-05 23:44:24,272][52662] DAMAGECOUNT value on done: 55644.0 [2024-08-05 23:44:24,273][52662] Sum rewards: 38.871, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.974', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon2': '0.776', 'WEAPON3': '1.000', 'HITCOUNT': '2.110', 'weapon3': '2.876', 'DAMAGECOUNT': '9.837', 'FRAGCOUNT': '32.000'} [2024-08-05 23:44:24,664][52794] DAMAGECOUNT value on done: 58116.0 [2024-08-05 23:44:24,665][52794] Sum rewards: 42.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.025', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.185', 'weapon4': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:24,731][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:44:25,315][52660] DAMAGECOUNT value on done: 49797.0 [2024-08-05 23:44:25,317][52660] Sum rewards: 43.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.335', 'AMMO5': '0.007', 'AMMO2': '0.037', 'ARMOR': '0.052', 'weapon5': '0.086', 'AMMO3': '0.185', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '38.000'} [2024-08-05 23:44:25,666][52669] DAMAGECOUNT value on done: 52132.0 [2024-08-05 23:44:25,668][52669] Sum rewards: 45.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'weapon5': '0.008', 'weapon4': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.502', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '3.250', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '40.000'} [2024-08-05 23:44:26,757][52668] DAMAGECOUNT value on done: 51378.0 [2024-08-05 23:44:26,757][52668] Sum rewards: 27.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'ARMOR': '0.013', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon7': '0.078', 'AMMO3': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.890', 'HITCOUNT': '2.030', 'weapon3': '2.416', 'DAMAGECOUNT': '7.920', 'FRAGCOUNT': '24.000'} [2024-08-05 23:44:26,979][52664] DAMAGECOUNT value on done: 53502.0 [2024-08-05 23:44:26,979][52664] Sum rewards: 44.490, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.515', 'AMMO2': '0.036', 'weapon4': '0.164', 'AMMO4': '0.178', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'weapon2': '0.792', 'ARMOR': '0.907', 'WEAPON3': '1.550', 'HITCOUNT': '2.670', 'weapon3': '2.780', 'DAMAGECOUNT': '11.781', 'FRAGCOUNT': '43.000'} [2024-08-05 23:44:27,435][52794] DAMAGECOUNT value on done: 55777.0 [2024-08-05 23:44:27,435][52794] Sum rewards: 31.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.062', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'ARMOR': '0.856', 'weapon2': '1.056', 'WEAPON3': '1.200', 'HITCOUNT': '1.780', 'weapon3': '2.610', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '27.000'} [2024-08-05 23:44:27,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 141393920. Throughput: 0: 4403.3. Samples: 35357380. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:44:27,795][52567] Avg episode reward: [(0, '39.992')] [2024-08-05 23:44:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017261_141402112.pth... [2024-08-05 23:44:27,822][52650] Updated weights for policy 0, policy_version 17261 (0.0014) [2024-08-05 23:44:27,926][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000016744_137166848.pth [2024-08-05 23:44:27,931][52614] Saving new best policy, reward=39.992! [2024-08-05 23:44:28,218][52660] DAMAGECOUNT value on done: 51365.0 [2024-08-05 23:44:28,220][52660] Sum rewards: 40.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.179', 'AMMO2': '0.037', 'AMMO3': '0.161', 'AMMO4': '0.185', 'weapon4': '0.264', 'WEAPON4': '0.350', 'ARMOR': '0.424', 'weapon2': '0.710', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '2.826', 'DAMAGECOUNT': '11.136', 'FRAGCOUNT': '31.000'} [2024-08-05 23:44:29,187][52669] DAMAGECOUNT value on done: 51527.0 [2024-08-05 23:44:29,188][52669] Sum rewards: 34.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.183', 'ARMOR': '0.913', 'weapon2': '1.054', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '2.698', 'DAMAGECOUNT': '10.665', 'FRAGCOUNT': '28.000'} [2024-08-05 23:44:29,782][52664] DAMAGECOUNT value on done: 51595.0 [2024-08-05 23:44:29,782][52664] Sum rewards: 32.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.492', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.110', 'AMMO3': '0.188', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.500', 'weapon2': '0.618', 'ARMOR': '0.855', 'WEAPON3': '1.100', 'HITCOUNT': '2.370', 'weapon3': '2.630', 'DAMAGECOUNT': '9.639', 'FRAGCOUNT': '29.000'} [2024-08-05 23:44:31,005][52660] DAMAGECOUNT value on done: 51182.0 [2024-08-05 23:44:31,005][52660] Sum rewards: 33.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.189', 'AMMO4': '0.222', 'weapon5': '0.240', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.881', 'weapon2': '0.920', 'WEAPON3': '1.150', 'weapon3': '2.196', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.234', 'FRAGCOUNT': '31.000'} [2024-08-05 23:44:32,373][52669] DAMAGECOUNT value on done: 50973.0 [2024-08-05 23:44:32,373][52669] Sum rewards: 49.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.224', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.062', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'ARMOR': '0.405', 'weapon2': '0.570', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.988', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '43.000'} [2024-08-05 23:44:32,446][52664] DAMAGECOUNT value on done: 53803.0 [2024-08-05 23:44:32,446][52664] Sum rewards: 38.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.504', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.174', 'weapon2': '0.980', 'WEAPON3': '1.050', 'ARMOR': '1.351', 'HITCOUNT': '2.480', 'weapon3': '2.688', 'DAMAGECOUNT': '10.236', 'FRAGCOUNT': '31.000'} [2024-08-05 23:44:32,506][52650] Updated weights for policy 0, policy_version 17271 (0.0019) [2024-08-05 23:44:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 141484032. Throughput: 0: 4402.9. Samples: 35370410. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:44:32,795][52567] Avg episode reward: [(0, '39.765')] [2024-08-05 23:44:33,755][52660] DAMAGECOUNT value on done: 53530.0 [2024-08-05 23:44:33,757][52660] Sum rewards: 52.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.366', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'ARMOR': '0.454', 'weapon2': '0.610', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.118', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '43.000'} [2024-08-05 23:44:34,978][52669] DAMAGECOUNT value on done: 52382.0 [2024-08-05 23:44:34,978][52669] Sum rewards: 48.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.744', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.123', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.756', 'ARMOR': '0.804', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.942', 'DAMAGECOUNT': '10.965', 'FRAGCOUNT': '40.000'} [2024-08-05 23:44:35,009][52664] DAMAGECOUNT value on done: 52906.0 [2024-08-05 23:44:35,011][52664] Sum rewards: 31.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.236', 'weapon2': '0.668', 'ARMOR': '0.860', 'WEAPON3': '1.500', 'HITCOUNT': '2.220', 'weapon3': '2.872', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '29.000'} [2024-08-05 23:44:36,148][52820] DAMAGECOUNT value on done: 45278.0 [2024-08-05 23:44:36,159][52820] Sum rewards: 44.760, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon5': '0.118', 'weapon4': '0.152', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'HEALTH': '0.230', 'weapon2': '0.796', 'WEAPON3': '1.050', 'HITCOUNT': '2.400', 'weapon3': '2.670', 'DAMAGECOUNT': '10.437', 'FRAGCOUNT': '39.000'} [2024-08-05 23:44:36,899][52660] DAMAGECOUNT value on done: 51343.0 [2024-08-05 23:44:36,903][52660] Sum rewards: 46.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.039', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.244', 'ARMOR': '0.416', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '40.000'} [2024-08-05 23:44:37,076][52650] Updated weights for policy 0, policy_version 17281 (0.0010) [2024-08-05 23:44:37,105][52667] DAMAGECOUNT value on done: 51526.0 [2024-08-05 23:44:37,108][52667] Sum rewards: 28.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.112', 'weapon4': '0.186', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '1.176', 'WEAPON3': '1.400', 'ARMOR': '1.436', 'HITCOUNT': '2.110', 'weapon3': '2.240', 'DAMAGECOUNT': '8.895', 'FRAGCOUNT': '25.000'} [2024-08-05 23:44:37,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 141574144. Throughput: 0: 4402.7. Samples: 35397180. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:44:37,794][52567] Avg episode reward: [(0, '40.004')] [2024-08-05 23:44:37,802][52614] Saving new best policy, reward=40.004! [2024-08-05 23:44:38,424][52669] DAMAGECOUNT value on done: 52701.0 [2024-08-05 23:44:38,425][52669] Sum rewards: 37.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.154', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.836', 'ARMOR': '0.905', 'WEAPON3': '1.200', 'weapon3': '2.452', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.086', 'FRAGCOUNT': '32.500'} [2024-08-05 23:44:39,298][52820] DAMAGECOUNT value on done: 48241.0 [2024-08-05 23:44:39,302][52820] Sum rewards: 43.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.077', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.652', 'ARMOR': '0.853', 'WEAPON3': '1.500', 'HITCOUNT': '2.650', 'weapon3': '2.872', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '38.000'} [2024-08-05 23:44:39,977][52667] DAMAGECOUNT value on done: 53099.0 [2024-08-05 23:44:39,977][52667] Sum rewards: 23.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.040', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'weapon4': '0.510', 'weapon2': '0.756', 'WEAPON3': '1.000', 'HITCOUNT': '2.160', 'weapon3': '2.436', 'DAMAGECOUNT': '8.799', 'FRAGCOUNT': '20.500'} [2024-08-05 23:44:41,426][52669] DAMAGECOUNT value on done: 52642.0 [2024-08-05 23:44:41,427][52669] Sum rewards: 40.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.614', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'ARMOR': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '3.112', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '36.000'} [2024-08-05 23:44:41,971][52650] Updated weights for policy 0, policy_version 17291 (0.0011) [2024-08-05 23:44:42,320][52820] DAMAGECOUNT value on done: 46671.0 [2024-08-05 23:44:42,322][52820] Sum rewards: 42.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.031', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.096', 'weapon4': '0.154', 'AMMO4': '0.159', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.300', 'ARMOR': '1.379', 'HITCOUNT': '2.460', 'weapon3': '2.942', 'DAMAGECOUNT': '11.046', 'FRAGCOUNT': '36.000'} [2024-08-05 23:44:42,784][52667] DAMAGECOUNT value on done: 51523.0 [2024-08-05 23:44:42,786][52667] Sum rewards: 46.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.109', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.213', 'weapon2': '0.606', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.188', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '41.000'} [2024-08-05 23:44:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 141656064. Throughput: 0: 4395.5. Samples: 35423410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:44:42,795][52567] Avg episode reward: [(0, '39.832')] [2024-08-05 23:44:43,897][52647] DAMAGECOUNT value on done: 53324.0 [2024-08-05 23:44:43,899][52647] Sum rewards: 41.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.486', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.054', 'AMMO4': '0.174', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.320', 'WEAPON4': '0.450', 'ARMOR': '0.892', 'weapon2': '1.042', 'WEAPON3': '1.200', 'weapon3': '2.374', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:44,248][52669] DAMAGECOUNT value on done: 51683.0 [2024-08-05 23:44:44,249][52669] Sum rewards: 34.386, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.344', 'ARMOR': '0.456', 'weapon2': '0.988', 'WEAPON3': '1.100', 'weapon3': '2.282', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.702', 'FRAGCOUNT': '29.000'} [2024-08-05 23:44:45,419][52820] DAMAGECOUNT value on done: 46079.0 [2024-08-05 23:44:45,419][52820] Sum rewards: 42.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.090', 'AMMO4': '0.183', 'AMMO3': '0.224', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.856', 'ARMOR': '0.913', 'WEAPON3': '1.350', 'weapon3': '2.544', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:45,906][52667] DAMAGECOUNT value on done: 52201.0 [2024-08-05 23:44:45,907][52667] Sum rewards: 42.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.073', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.151', 'weapon4': '0.234', 'WEAPON4': '0.250', 'ARMOR': '0.462', 'WEAPON3': '0.900', 'weapon2': '1.060', 'weapon3': '2.566', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.455', 'FRAGCOUNT': '35.000'} [2024-08-05 23:44:46,401][52650] Updated weights for policy 0, policy_version 17301 (0.0022) [2024-08-05 23:44:46,525][52647] DAMAGECOUNT value on done: 52967.0 [2024-08-05 23:44:46,526][52647] Sum rewards: 27.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.080', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.242', 'AMMO4': '0.244', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon2': '0.972', 'WEAPON3': '1.050', 'HITCOUNT': '1.920', 'weapon3': '2.476', 'DAMAGECOUNT': '7.674', 'FRAGCOUNT': '25.500'} [2024-08-05 23:44:47,365][52669] DAMAGECOUNT value on done: 52017.0 [2024-08-05 23:44:47,366][52669] Sum rewards: 36.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.716', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.024', 'weapon5': '0.094', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.450', 'HITCOUNT': '2.260', 'weapon3': '2.838', 'DAMAGECOUNT': '10.770', 'FRAGCOUNT': '34.000'} [2024-08-05 23:44:47,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 141746176. Throughput: 0: 4401.3. Samples: 35436760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:44:47,795][52567] Avg episode reward: [(0, '40.028')] [2024-08-05 23:44:47,798][52614] Saving new best policy, reward=40.028! [2024-08-05 23:44:48,112][52665] DAMAGECOUNT value on done: 49923.0 [2024-08-05 23:44:48,113][52665] Sum rewards: 32.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.683', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.504', 'weapon2': '0.724', 'ARMOR': '1.341', 'WEAPON3': '1.450', 'weapon3': '2.548', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '9.870', 'FRAGCOUNT': '29.000'} [2024-08-05 23:44:48,543][52820] DAMAGECOUNT value on done: 46491.0 [2024-08-05 23:44:48,543][52820] Sum rewards: 43.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.173', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon7': '0.050', 'ARMOR': '0.076', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO4': '0.224', 'WEAPON4': '0.500', 'weapon2': '0.584', 'WEAPON3': '0.800', 'weapon4': '1.058', 'weapon3': '1.910', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '11.217', 'FRAGCOUNT': '35.000'} [2024-08-05 23:44:49,013][52667] DAMAGECOUNT value on done: 54109.0 [2024-08-05 23:44:49,013][52667] Sum rewards: 51.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.430', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'ARMOR': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '3.148', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '45.000'} [2024-08-05 23:44:49,368][52647] DAMAGECOUNT value on done: 57879.0 [2024-08-05 23:44:49,368][52647] Sum rewards: 35.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.056', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.592', 'ARMOR': '0.854', 'WEAPON3': '1.000', 'HITCOUNT': '1.940', 'weapon3': '2.558', 'DAMAGECOUNT': '8.700', 'FRAGCOUNT': '32.000'} [2024-08-05 23:44:50,273][52669] DAMAGECOUNT value on done: 50207.0 [2024-08-05 23:44:50,274][52669] Sum rewards: 42.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.798', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.804', 'WEAPON3': '1.050', 'ARMOR': '1.200', 'weapon3': '2.508', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.776', 'FRAGCOUNT': '35.000'} [2024-08-05 23:44:51,175][52650] Updated weights for policy 0, policy_version 17311 (0.0011) [2024-08-05 23:44:51,340][52665] DAMAGECOUNT value on done: 54557.0 [2024-08-05 23:44:51,340][52665] Sum rewards: 39.624, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.272', 'weapon2': '0.508', 'ARMOR': '0.800', 'WEAPON3': '1.550', 'HITCOUNT': '2.550', 'weapon3': '3.178', 'DAMAGECOUNT': '11.190', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:51,715][52820] DAMAGECOUNT value on done: 48466.0 [2024-08-05 23:44:51,716][52820] Sum rewards: 46.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.791', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.230', 'weapon4': '0.348', 'ARMOR': '0.412', 'weapon2': '0.526', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '2.734', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '41.000'} [2024-08-05 23:44:51,970][52667] DAMAGECOUNT value on done: 54716.0 [2024-08-05 23:44:51,970][52667] Sum rewards: 41.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.074', 'AMMO3': '0.204', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.500', 'ARMOR': '0.914', 'weapon2': '1.016', 'WEAPON3': '1.200', 'weapon3': '2.320', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.416', 'FRAGCOUNT': '36.500'} [2024-08-05 23:44:52,082][52647] DAMAGECOUNT value on done: 54613.0 [2024-08-05 23:44:52,083][52647] Sum rewards: 43.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.354', 'ARMOR': '0.840', 'WEAPON3': '0.950', 'weapon2': '1.072', 'weapon3': '2.326', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.194', 'FRAGCOUNT': '35.000'} [2024-08-05 23:44:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 141836288. Throughput: 0: 4387.3. Samples: 35462730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:44:52,794][52567] Avg episode reward: [(0, '40.332')] [2024-08-05 23:44:52,795][52614] Saving new best policy, reward=40.332! [2024-08-05 23:44:52,898][52669] DAMAGECOUNT value on done: 53061.0 [2024-08-05 23:44:52,901][52669] Sum rewards: 21.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.920', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.086', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.330', 'ARMOR': '0.495', 'WEAPON4': '0.500', 'weapon2': '0.980', 'WEAPON3': '1.300', 'HITCOUNT': '1.770', 'weapon3': '2.154', 'DAMAGECOUNT': '7.167', 'FRAGCOUNT': '20.000'} [2024-08-05 23:44:54,032][52665] DAMAGECOUNT value on done: 53145.0 [2024-08-05 23:44:54,033][52665] Sum rewards: 35.447, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.315', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.108', 'AMMO4': '0.171', 'weapon5': '0.204', 'weapon4': '0.272', 'WEAPON5': '0.450', 'ARMOR': '0.515', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.396', 'weapon3': '1.900', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '9.957', 'FRAGCOUNT': '29.000'} [2024-08-05 23:44:54,889][52647] DAMAGECOUNT value on done: 56549.0 [2024-08-05 23:44:54,889][52647] Sum rewards: 47.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.640', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.030', 'weapon4': '0.126', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.734', 'ARMOR': '0.812', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '2.886', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '41.000'} [2024-08-05 23:44:55,022][52820] DAMAGECOUNT value on done: 49841.0 [2024-08-05 23:44:55,023][52820] Sum rewards: 39.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.040', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.400', 'weapon4': '0.538', 'ARMOR': '0.800', 'weapon2': '0.804', 'WEAPON3': '1.000', 'weapon3': '2.410', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.852', 'FRAGCOUNT': '34.500'} [2024-08-05 23:44:55,070][52667] DAMAGECOUNT value on done: 53557.0 [2024-08-05 23:44:55,070][52667] Sum rewards: 43.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'weapon5': '0.010', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO2': '0.066', 'AMMO3': '0.171', 'WEAPON5': '0.300', 'AMMO4': '0.332', 'weapon4': '0.336', 'weapon2': '0.718', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.536', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '37.000'} [2024-08-05 23:44:55,237][52669] DAMAGECOUNT value on done: 52785.0 [2024-08-05 23:44:55,239][52669] Sum rewards: 29.202, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.844', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'ARMOR': '0.474', 'weapon4': '0.578', 'weapon2': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '1.760', 'weapon3': '2.128', 'DAMAGECOUNT': '8.040', 'FRAGCOUNT': '24.000'} [2024-08-05 23:44:56,087][52650] Updated weights for policy 0, policy_version 17321 (0.0012) [2024-08-05 23:44:56,795][52665] DAMAGECOUNT value on done: 50084.0 [2024-08-05 23:44:56,797][52665] Sum rewards: 40.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.228', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.650', 'HITCOUNT': '2.760', 'weapon3': '2.770', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '38.000'} [2024-08-05 23:44:57,654][52647] DAMAGECOUNT value on done: 55577.0 [2024-08-05 23:44:57,654][52647] Sum rewards: 36.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.631', 'AMMO5': '0.025', 'AMMO2': '0.057', 'weapon5': '0.106', 'AMMO3': '0.175', 'AMMO4': '0.287', 'WEAPON5': '0.450', 'weapon4': '0.468', 'ARMOR': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.742', 'WEAPON3': '1.100', 'HITCOUNT': '2.060', 'weapon3': '2.254', 'DAMAGECOUNT': '9.834', 'FRAGCOUNT': '32.000'} [2024-08-05 23:44:57,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 141926400. Throughput: 0: 4376.4. Samples: 35488630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:44:57,794][52567] Avg episode reward: [(0, '40.180')] [2024-08-05 23:44:57,967][52667] DAMAGECOUNT value on done: 52197.0 [2024-08-05 23:44:57,967][52667] Sum rewards: 39.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.199', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.168', 'weapon4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.720', 'WEAPON3': '1.050', 'ARMOR': '1.253', 'HITCOUNT': '2.220', 'weapon3': '2.690', 'DAMAGECOUNT': '9.465', 'FRAGCOUNT': '35.000'} [2024-08-05 23:44:58,320][52820] DAMAGECOUNT value on done: 48872.0 [2024-08-05 23:44:58,329][52820] Sum rewards: 54.400, reward structure: {'DEATHCOUNT': '-12.000', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.534', 'HEALTH': '0.574', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.180', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '43.000'} [2024-08-05 23:44:58,375][52669] DAMAGECOUNT value on done: 48736.0 [2024-08-05 23:44:58,375][52669] Sum rewards: 34.217, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.738', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.072', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'AMMO4': '0.286', 'weapon4': '0.464', 'WEAPON4': '0.700', 'weapon2': '0.844', 'WEAPON3': '1.100', 'ARMOR': '1.366', 'weapon3': '2.344', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '9.864', 'FRAGCOUNT': '32.000'} [2024-08-05 23:44:59,776][52647] DAMAGECOUNT value on done: 53022.0 [2024-08-05 23:44:59,777][52647] Sum rewards: 35.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.153', 'weapon5': '0.156', 'AMMO4': '0.156', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.462', 'weapon2': '0.852', 'WEAPON3': '0.950', 'HITCOUNT': '2.390', 'weapon3': '2.504', 'DAMAGECOUNT': '10.371', 'FRAGCOUNT': '31.000'} [2024-08-05 23:44:59,971][52665] DAMAGECOUNT value on done: 49205.0 [2024-08-05 23:44:59,974][52665] Sum rewards: 44.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.724', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.069', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.392', 'weapon2': '0.618', 'ARMOR': '0.900', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:00,549][52650] Updated weights for policy 0, policy_version 17331 (0.0014) [2024-08-05 23:45:00,674][52667] DAMAGECOUNT value on done: 52541.0 [2024-08-05 23:45:00,675][52667] Sum rewards: 34.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.498', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon4': '0.822', 'weapon2': '0.922', 'WEAPON3': '1.050', 'weapon3': '2.058', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '29.000'} [2024-08-05 23:45:01,141][52666] DAMAGECOUNT value on done: 50176.0 [2024-08-05 23:45:01,141][52666] Sum rewards: 40.389, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.480', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '3.086', 'DAMAGECOUNT': '10.869', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:01,201][52669] DAMAGECOUNT value on done: 53590.0 [2024-08-05 23:45:01,203][52669] Sum rewards: 37.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.396', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.154', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'ARMOR': '0.512', 'weapon2': '0.724', 'WEAPON3': '1.350', 'HITCOUNT': '2.170', 'weapon3': '2.824', 'DAMAGECOUNT': '9.276', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:01,449][52820] DAMAGECOUNT value on done: 45866.0 [2024-08-05 23:45:01,449][52820] Sum rewards: 38.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.188', 'weapon2': '0.828', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '2.822', 'DAMAGECOUNT': '10.743', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:02,513][52665] DAMAGECOUNT value on done: 50243.0 [2024-08-05 23:45:02,514][52665] Sum rewards: 38.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'ARMOR': '0.856', 'WEAPON3': '1.000', 'weapon2': '1.078', 'HITCOUNT': '2.340', 'weapon3': '2.606', 'DAMAGECOUNT': '10.059', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:02,797][52567] Fps is (10 sec: 17199.6, 60 sec: 17475.7, 300 sec: 17605.7). Total num frames: 142008320. Throughput: 0: 4368.7. Samples: 35501820. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:45:02,802][52567] Avg episode reward: [(0, '40.014')] [2024-08-05 23:45:02,803][52647] DAMAGECOUNT value on done: 57189.0 [2024-08-05 23:45:02,804][52647] Sum rewards: 44.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.863', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.528', 'ARMOR': '0.532', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.640', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.982', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:03,208][52667] DAMAGECOUNT value on done: 53500.0 [2024-08-05 23:45:03,215][52667] Sum rewards: 31.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.881', 'AMMO2': '0.053', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.156', 'AMMO3': '0.186', 'AMMO4': '0.265', 'ARMOR': '0.497', 'WEAPON4': '0.650', 'weapon2': '1.180', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.488', 'DAMAGECOUNT': '9.936', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:04,102][52669] DAMAGECOUNT value on done: 54320.0 [2024-08-05 23:45:04,104][52669] Sum rewards: 38.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.012', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon5': '0.168', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'ARMOR': '0.855', 'weapon2': '1.172', 'WEAPON3': '1.250', 'HITCOUNT': '2.300', 'weapon3': '2.322', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:04,326][52666] DAMAGECOUNT value on done: 52625.0 [2024-08-05 23:45:04,327][52666] Sum rewards: 47.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.442', 'AMMO5': '0.012', 'weapon5': '0.046', 'AMMO2': '0.052', 'AMMO3': '0.152', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'ARMOR': '0.520', 'weapon4': '0.556', 'WEAPON4': '0.700', 'weapon2': '0.782', 'WEAPON3': '1.050', 'weapon3': '2.410', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '39.000'} [2024-08-05 23:45:04,574][52820] DAMAGECOUNT value on done: 47659.0 [2024-08-05 23:45:04,575][52820] Sum rewards: 32.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.651', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.608', 'ARMOR': '0.800', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '2.854', 'DAMAGECOUNT': '9.963', 'FRAGCOUNT': '29.500'} [2024-08-05 23:45:05,227][52650] Updated weights for policy 0, policy_version 17341 (0.0050) [2024-08-05 23:45:05,379][52665] DAMAGECOUNT value on done: 53331.0 [2024-08-05 23:45:05,381][52665] Sum rewards: 44.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.090', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.390', 'ARMOR': '0.476', 'weapon2': '0.682', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '2.642', 'DAMAGECOUNT': '10.812', 'FRAGCOUNT': '40.000'} [2024-08-05 23:45:05,737][52647] DAMAGECOUNT value on done: 57860.0 [2024-08-05 23:45:05,737][52647] Sum rewards: 46.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.964', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'ARMOR': '0.473', 'weapon2': '0.688', 'WEAPON3': '1.200', 'HITCOUNT': '2.550', 'weapon3': '3.038', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '40.000'} [2024-08-05 23:45:05,943][52667] DAMAGECOUNT value on done: 51778.0 [2024-08-05 23:45:05,946][52667] Sum rewards: 42.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.450', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon2': '0.488', 'weapon4': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:06,265][52658] DAMAGECOUNT value on done: 52367.0 [2024-08-05 23:45:06,266][52658] Sum rewards: 26.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.186', 'WEAPON4': '0.400', 'weapon4': '0.416', 'ARMOR': '0.457', 'weapon2': '0.894', 'WEAPON3': '1.150', 'HITCOUNT': '2.330', 'weapon3': '2.514', 'DAMAGECOUNT': '8.772', 'FRAGCOUNT': '28.000'} [2024-08-05 23:45:07,213][52669] DAMAGECOUNT value on done: 55462.0 [2024-08-05 23:45:07,216][52669] Sum rewards: 48.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.644', 'ARMOR': '1.231', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 142098432. Throughput: 0: 4378.6. Samples: 35528310. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:45:07,795][52567] Avg episode reward: [(0, '39.978')] [2024-08-05 23:45:07,795][52820] DAMAGECOUNT value on done: 49284.0 [2024-08-05 23:45:07,795][52820] Sum rewards: 34.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.352', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'AMMO4': '0.287', 'weapon4': '0.430', 'WEAPON4': '0.500', 'weapon2': '1.032', 'WEAPON3': '1.400', 'weapon3': '2.322', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:07,888][52666] DAMAGECOUNT value on done: 51172.0 [2024-08-05 23:45:07,889][52666] Sum rewards: 33.801, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.676', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.056', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'AMMO4': '0.282', 'weapon4': '0.404', 'ARMOR': '0.519', 'WEAPON4': '0.600', 'weapon2': '0.652', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '2.638', 'DAMAGECOUNT': '9.813', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:08,136][52665] DAMAGECOUNT value on done: 53600.0 [2024-08-05 23:45:08,136][52665] Sum rewards: 39.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.022', 'weapon4': '0.028', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'ARMOR': '0.436', 'weapon2': '0.564', 'WEAPON3': '1.250', 'HITCOUNT': '2.430', 'weapon3': '3.162', 'DAMAGECOUNT': '9.981', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:08,374][52667] DAMAGECOUNT value on done: 50223.0 [2024-08-05 23:45:08,376][52667] Sum rewards: 34.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.634', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'weapon4': '0.160', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.648', 'ARMOR': '1.009', 'WEAPON3': '1.550', 'HITCOUNT': '2.460', 'weapon3': '2.844', 'DAMAGECOUNT': '10.125', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:08,474][52647] DAMAGECOUNT value on done: 54833.0 [2024-08-05 23:45:08,475][52647] Sum rewards: 41.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.226', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'weapon4': '0.102', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.890', 'WEAPON3': '1.100', 'ARMOR': '1.298', 'HITCOUNT': '2.470', 'weapon3': '2.846', 'DAMAGECOUNT': '10.542', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:08,745][52658] DAMAGECOUNT value on done: 52469.0 [2024-08-05 23:45:08,747][52658] Sum rewards: 45.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.540', 'AMMO4': '-0.033', 'AMMO2': '-0.007', 'AMMO3': '0.234', 'weapon2': '0.662', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.140', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '42.000'} [2024-08-05 23:45:09,218][52670] DAMAGECOUNT value on done: 51468.0 [2024-08-05 23:45:09,218][52670] Sum rewards: 45.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.028', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.026', 'ARMOR': '0.036', 'weapon5': '0.042', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.292', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '39.500'} [2024-08-05 23:45:09,780][52650] Updated weights for policy 0, policy_version 17351 (0.0024) [2024-08-05 23:45:10,287][52669] DAMAGECOUNT value on done: 53217.0 [2024-08-05 23:45:10,287][52669] Sum rewards: 49.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'AMMO2': '0.019', 'ARMOR': '0.040', 'AMMO4': '0.097', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon5': '0.206', 'weapon2': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.792', 'DAMAGECOUNT': '11.892', 'FRAGCOUNT': '42.000'} [2024-08-05 23:45:10,819][52666] DAMAGECOUNT value on done: 49872.0 [2024-08-05 23:45:10,819][52666] Sum rewards: 35.781, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.811', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.114', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.906', 'ARMOR': '1.267', 'WEAPON3': '1.550', 'HITCOUNT': '2.460', 'weapon3': '2.754', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:10,923][52665] DAMAGECOUNT value on done: 54776.0 [2024-08-05 23:45:10,926][52665] Sum rewards: 42.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.453', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.068', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'ARMOR': '0.872', 'WEAPON3': '1.050', 'weapon2': '1.056', 'HITCOUNT': '2.210', 'weapon3': '2.660', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:10,977][52663] DAMAGECOUNT value on done: 54870.0 [2024-08-05 23:45:10,977][52663] Sum rewards: 48.528, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.617', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.750', 'WEAPON3': '1.200', 'ARMOR': '1.712', 'HITCOUNT': '2.790', 'weapon3': '2.864', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '40.000'} [2024-08-05 23:45:11,007][52820] DAMAGECOUNT value on done: 51216.0 [2024-08-05 23:45:11,008][52820] Sum rewards: 44.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.647', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.054', 'weapon4': '0.160', 'AMMO3': '0.217', 'weapon2': '0.664', 'ARMOR': '1.259', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '2.902', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:11,187][52667] DAMAGECOUNT value on done: 53398.0 [2024-08-05 23:45:11,188][52647] DAMAGECOUNT value on done: 53558.0 [2024-08-05 23:45:11,188][52647] Sum rewards: 28.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'weapon4': '0.110', 'AMMO4': '0.112', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.830', 'WEAPON3': '1.000', 'HITCOUNT': '1.810', 'weapon3': '2.800', 'DAMAGECOUNT': '7.659', 'FRAGCOUNT': '26.000'} [2024-08-05 23:45:11,191][52667] Sum rewards: 51.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.211', 'weapon4': '0.322', 'WEAPON4': '0.400', 'weapon2': '0.606', 'ARMOR': '0.808', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.776', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '45.000'} [2024-08-05 23:45:11,731][52658] DAMAGECOUNT value on done: 51390.0 [2024-08-05 23:45:11,732][52658] Sum rewards: 33.125, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.551', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.274', 'weapon2': '0.538', 'ARMOR': '0.800', 'WEAPON3': '1.600', 'HITCOUNT': '2.520', 'weapon3': '3.046', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:11,780][52670] DAMAGECOUNT value on done: 51713.0 [2024-08-05 23:45:11,780][52670] Sum rewards: 38.776, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.834', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon4': '0.218', 'WEAPON3': '0.900', 'weapon2': '1.064', 'HITCOUNT': '2.370', 'weapon3': '2.590', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:12,794][52567] Fps is (10 sec: 18026.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 142188544. Throughput: 0: 4388.3. Samples: 35554850. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 23:45:12,794][52567] Avg episode reward: [(0, '39.933')] [2024-08-05 23:45:13,120][52669] DAMAGECOUNT value on done: 52879.0 [2024-08-05 23:45:13,123][52669] Sum rewards: 37.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.608', 'AMMO5': '0.024', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.136', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON5': '0.400', 'weapon2': '0.634', 'ARMOR': '1.288', 'WEAPON3': '1.450', 'HITCOUNT': '2.180', 'weapon3': '2.530', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:13,409][52666] DAMAGECOUNT value on done: 50834.0 [2024-08-05 23:45:13,410][52666] Sum rewards: 40.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.175', 'ARMOR': '0.456', 'weapon2': '1.022', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.760', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:13,734][52663] DAMAGECOUNT value on done: 52285.0 [2024-08-05 23:45:13,734][52663] Sum rewards: 46.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.526', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.500', 'weapon2': '0.920', 'WEAPON3': '1.100', 'weapon3': '2.272', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:13,736][52647] DAMAGECOUNT value on done: 51744.0 [2024-08-05 23:45:13,736][52647] Sum rewards: 41.854, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.376', 'ARMOR': '0.456', 'WEAPON3': '0.850', 'weapon2': '1.100', 'weapon3': '2.204', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.593', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:13,878][52667] DAMAGECOUNT value on done: 50761.0 [2024-08-05 23:45:13,878][52667] Sum rewards: 42.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO3': '0.148', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.348', 'WEAPON4': '0.350', 'ARMOR': '0.481', 'weapon2': '0.602', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '2.726', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:14,033][52820] DAMAGECOUNT value on done: 46606.0 [2024-08-05 23:45:14,036][52820] Sum rewards: 45.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon5': '0.156', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.224', 'ARMOR': '0.400', 'weapon2': '0.956', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '39.000'} [2024-08-05 23:45:14,131][52665] DAMAGECOUNT value on done: 53535.0 [2024-08-05 23:45:14,132][52665] Sum rewards: 38.388, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.236', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.078', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.196', 'WEAPON3': '1.100', 'weapon2': '1.134', 'ARMOR': '1.352', 'weapon3': '2.358', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:14,342][52658] DAMAGECOUNT value on done: 51217.0 [2024-08-05 23:45:14,344][52658] Sum rewards: 44.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.244', 'AMMO5': '0.012', 'ARMOR': '0.040', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'weapon4': '0.246', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.034', 'weapon3': '2.346', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:14,635][52670] DAMAGECOUNT value on done: 51915.0 [2024-08-05 23:45:14,637][52670] Sum rewards: 35.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.679', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.062', 'weapon4': '0.182', 'AMMO3': '0.216', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.888', 'weapon2': '1.200', 'WEAPON3': '1.350', 'HITCOUNT': '2.000', 'weapon3': '2.322', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:14,679][52650] Updated weights for policy 0, policy_version 17361 (0.0028) [2024-08-05 23:45:16,078][52666] DAMAGECOUNT value on done: 50479.0 [2024-08-05 23:45:16,078][52666] Sum rewards: 37.319, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.941', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.084', 'weapon4': '0.140', 'AMMO3': '0.156', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'WEAPON3': '1.000', 'weapon2': '1.072', 'HITCOUNT': '2.450', 'weapon3': '2.474', 'DAMAGECOUNT': '10.140', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:16,088][52647] DAMAGECOUNT value on done: 54410.0 [2024-08-05 23:45:16,088][52647] Sum rewards: 40.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.329', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'AMMO4': '0.157', 'WEAPON4': '0.450', 'ARMOR': '0.463', 'weapon4': '0.486', 'weapon2': '0.704', 'WEAPON3': '1.000', 'weapon3': '2.514', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.145', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:16,131][52669] DAMAGECOUNT value on done: 51031.0 [2024-08-05 23:45:16,133][52669] Sum rewards: 32.481, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.101', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.126', 'AMMO3': '0.138', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'ARMOR': '1.340', 'weapon2': '1.596', 'weapon3': '2.076', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.270', 'FRAGCOUNT': '26.000'} [2024-08-05 23:45:16,648][52667] DAMAGECOUNT value on done: 54156.0 [2024-08-05 23:45:16,649][52667] Sum rewards: 30.980, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon7': '0.066', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon4': '0.216', 'AMMO3': '0.242', 'ARMOR': '0.867', 'weapon2': '0.926', 'WEAPON3': '1.400', 'HITCOUNT': '2.330', 'weapon3': '2.588', 'DAMAGECOUNT': '9.651', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:16,876][52663] DAMAGECOUNT value on done: 54554.0 [2024-08-05 23:45:16,877][52663] Sum rewards: 48.153, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.086', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.374', 'weapon2': '0.732', 'WEAPON3': '1.250', 'ARMOR': '1.304', 'weapon3': '2.586', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:17,141][52658] DAMAGECOUNT value on done: 55029.0 [2024-08-05 23:45:17,141][52658] Sum rewards: 47.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.685', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'AMMO4': '0.181', 'ARMOR': '0.473', 'weapon2': '0.570', 'WEAPON4': '0.650', 'weapon4': '0.810', 'WEAPON3': '1.100', 'weapon3': '2.244', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:17,174][52820] DAMAGECOUNT value on done: 47506.0 [2024-08-05 23:45:17,178][52820] Sum rewards: 44.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.228', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.030', 'weapon4': '0.060', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.972', 'WEAPON3': '1.100', 'ARMOR': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.780', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:17,209][52670] DAMAGECOUNT value on done: 48972.0 [2024-08-05 23:45:17,209][52670] Sum rewards: 35.454, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.064', 'AMMO4': '0.068', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'ARMOR': '0.490', 'weapon2': '0.712', 'WEAPON3': '1.100', 'HITCOUNT': '2.270', 'weapon3': '2.900', 'DAMAGECOUNT': '9.642', 'FRAGCOUNT': '29.500'} [2024-08-05 23:45:17,405][52665] DAMAGECOUNT value on done: 53919.0 [2024-08-05 23:45:17,405][52665] Sum rewards: 34.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.736', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.200', 'weapon4': '0.318', 'WEAPON4': '0.350', 'ARMOR': '0.848', 'weapon2': '1.074', 'WEAPON3': '1.200', 'weapon3': '2.456', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.422', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:17,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17606.4). Total num frames: 142278656. Throughput: 0: 4391.1. Samples: 35568010. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 23:45:17,794][52567] Avg episode reward: [(0, '39.746')] [2024-08-05 23:45:18,381][52647] DAMAGECOUNT value on done: 53718.0 [2024-08-05 23:45:18,381][52647] Sum rewards: 44.720, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.123', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'weapon4': '0.656', 'weapon2': '0.810', 'WEAPON3': '0.900', 'weapon3': '2.420', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.005', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:19,063][52666] DAMAGECOUNT value on done: 48607.0 [2024-08-05 23:45:19,063][52666] Sum rewards: 36.832, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.598', 'weapon2': '0.638', 'WEAPON3': '1.100', 'HITCOUNT': '1.880', 'weapon3': '2.190', 'DAMAGECOUNT': '7.902', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:19,274][52667] DAMAGECOUNT value on done: 57111.0 [2024-08-05 23:45:19,276][52667] Sum rewards: 49.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.351', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.104', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.350', 'ARMOR': '0.518', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '43.500'} [2024-08-05 23:45:19,370][52669] DAMAGECOUNT value on done: 53137.0 [2024-08-05 23:45:19,370][52669] Sum rewards: 42.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.814', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.187', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.262', 'weapon4': '0.404', 'WEAPON4': '0.600', 'weapon2': '0.620', 'ARMOR': '0.880', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '2.570', 'DAMAGECOUNT': '11.217', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:19,391][52650] Updated weights for policy 0, policy_version 17371 (0.0010) [2024-08-05 23:45:19,766][52658] DAMAGECOUNT value on done: 50164.0 [2024-08-05 23:45:19,768][52658] Sum rewards: 51.862, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.335', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'ARMOR': '0.455', 'weapon2': '0.488', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '43.000'} [2024-08-05 23:45:20,104][52663] DAMAGECOUNT value on done: 53324.0 [2024-08-05 23:45:20,104][52663] Sum rewards: 38.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.656', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.632', 'WEAPON3': '1.050', 'HITCOUNT': '2.550', 'weapon3': '2.884', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:20,257][52820] DAMAGECOUNT value on done: 50858.0 [2024-08-05 23:45:20,259][52820] Sum rewards: 53.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.094', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.189', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.520', 'ARMOR': '0.950', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '45.000'} [2024-08-05 23:45:20,332][52670] DAMAGECOUNT value on done: 48945.0 [2024-08-05 23:45:20,334][52670] Sum rewards: 35.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.462', 'AMMO5': '0.011', 'weapon5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.142', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon4': '0.496', 'WEAPON4': '0.550', 'weapon2': '0.824', 'WEAPON3': '0.850', 'ARMOR': '0.864', 'HITCOUNT': '2.350', 'weapon3': '2.430', 'DAMAGECOUNT': '9.276', 'FRAGCOUNT': '28.500'} [2024-08-05 23:45:20,401][52665] DAMAGECOUNT value on done: 50464.0 [2024-08-05 23:45:20,404][52665] Sum rewards: 40.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.994', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.250', 'HITCOUNT': '2.330', 'weapon3': '2.920', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:20,676][52647] DAMAGECOUNT value on done: 54940.0 [2024-08-05 23:45:20,677][52647] Sum rewards: 35.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.213', 'weapon4': '0.222', 'WEAPON4': '0.400', 'weapon2': '0.744', 'WEAPON3': '1.200', 'ARMOR': '1.282', 'HITCOUNT': '2.130', 'weapon3': '2.806', 'DAMAGECOUNT': '9.186', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:21,836][52666] DAMAGECOUNT value on done: 50431.0 [2024-08-05 23:45:21,836][52666] Sum rewards: 38.776, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.133', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.145', 'weapon4': '0.192', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.804', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.874', 'DAMAGECOUNT': '9.435', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:22,087][52667] DAMAGECOUNT value on done: 52709.0 [2024-08-05 23:45:22,087][52667] Sum rewards: 26.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.584', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.112', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.714', 'ARMOR': '0.854', 'WEAPON3': '1.150', 'HITCOUNT': '1.890', 'weapon3': '2.864', 'DAMAGECOUNT': '7.821', 'FRAGCOUNT': '24.000'} [2024-08-05 23:45:22,596][52658] DAMAGECOUNT value on done: 58435.0 [2024-08-05 23:45:22,596][52658] Sum rewards: 52.016, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.692', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'WEAPON4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.264', 'weapon2': '0.568', 'ARMOR': '0.871', 'WEAPON3': '1.500', 'weapon3': '2.874', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '46.000'} [2024-08-05 23:45:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 142360576. Throughput: 0: 4390.9. Samples: 35594770. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 23:45:22,794][52567] Avg episode reward: [(0, '39.991')] [2024-08-05 23:45:23,023][52663] DAMAGECOUNT value on done: 50814.0 [2024-08-05 23:45:23,025][52663] Sum rewards: 38.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.582', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '1.112', 'ARMOR': '1.312', 'WEAPON3': '1.450', 'HITCOUNT': '2.370', 'weapon3': '2.602', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:23,033][52670] DAMAGECOUNT value on done: 53805.0 [2024-08-05 23:45:23,034][52670] Sum rewards: 35.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.885', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.060', 'AMMO3': '0.186', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.524', 'WEAPON4': '0.550', 'ARMOR': '0.869', 'weapon2': '1.038', 'WEAPON3': '1.150', 'weapon3': '2.212', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.795', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:23,249][52820] DAMAGECOUNT value on done: 47974.0 [2024-08-05 23:45:23,253][52820] Sum rewards: 40.091, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'HEALTH': '0.078', 'AMMO3': '0.143', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '1.250', 'HITCOUNT': '2.250', 'weapon3': '2.562', 'DAMAGECOUNT': '8.748', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:23,283][52665] DAMAGECOUNT value on done: 50119.0 [2024-08-05 23:45:23,284][52665] Sum rewards: 44.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.007', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.145', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.958', 'DAMAGECOUNT': '10.656', 'FRAGCOUNT': '39.000'} [2024-08-05 23:45:23,684][52647] DAMAGECOUNT value on done: 54218.0 [2024-08-05 23:45:23,685][52647] Sum rewards: 39.662, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.018', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.181', 'AMMO3': '0.254', 'WEAPON4': '0.400', 'weapon2': '0.504', 'ARMOR': '0.855', 'WEAPON3': '1.550', 'HITCOUNT': '2.620', 'weapon3': '3.130', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:23,743][52650] Updated weights for policy 0, policy_version 17381 (0.0012) [2024-08-05 23:45:24,375][52666] DAMAGECOUNT value on done: 52567.0 [2024-08-05 23:45:24,382][52666] Sum rewards: 41.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.340', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO4': '0.022', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.384', 'ARMOR': '0.454', 'weapon2': '0.736', 'WEAPON3': '1.400', 'weapon3': '2.604', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:24,909][52667] DAMAGECOUNT value on done: 56631.0 [2024-08-05 23:45:24,909][52667] Sum rewards: 43.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.624', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon4': '0.230', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'weapon2': '0.552', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '2.866', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:25,499][52658] DAMAGECOUNT value on done: 52105.0 [2024-08-05 23:45:25,502][52658] Sum rewards: 46.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.449', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.105', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'weapon4': '0.354', 'ARMOR': '0.456', 'weapon2': '0.870', 'WEAPON3': '1.300', 'weapon3': '2.504', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:25,558][52670] DAMAGECOUNT value on done: 50020.0 [2024-08-05 23:45:25,558][52670] Sum rewards: 31.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.534', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.253', 'weapon2': '0.806', 'ARMOR': '0.921', 'WEAPON3': '1.700', 'HITCOUNT': '2.430', 'weapon3': '2.922', 'DAMAGECOUNT': '9.597', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:25,908][52663] DAMAGECOUNT value on done: 53365.0 [2024-08-05 23:45:25,908][52663] Sum rewards: 22.661, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.974', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.070', 'weapon7': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO6': '0.220', 'AMMO7': '0.220', 'WEAPON4': '0.250', 'WEAPON7': '0.300', 'weapon2': '0.600', 'WEAPON3': '0.700', 'ARMOR': '0.869', 'weapon4': '0.900', 'HITCOUNT': '1.340', 'weapon3': '1.612', 'DAMAGECOUNT': '5.676', 'FRAGCOUNT': '19.000'} [2024-08-05 23:45:26,209][52820] DAMAGECOUNT value on done: 48169.0 [2024-08-05 23:45:26,209][52820] Sum rewards: 34.183, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.022', 'AMMO4': '0.093', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.716', 'WEAPON3': '1.450', 'HITCOUNT': '2.380', 'weapon3': '2.918', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:26,221][52665] DAMAGECOUNT value on done: 52428.0 [2024-08-05 23:45:26,221][52665] Sum rewards: 47.563, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.148', 'AMMO5': '0.009', 'weapon5': '0.014', 'ARMOR': '0.036', 'AMMO2': '0.043', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '0.700', 'weapon4': '0.736', 'weapon3': '2.366', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:26,690][52647] DAMAGECOUNT value on done: 53468.0 [2024-08-05 23:45:26,691][52647] Sum rewards: 34.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.142', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.141', 'WEAPON4': '0.250', 'weapon4': '0.262', 'WEAPON3': '0.950', 'weapon2': '0.998', 'ARMOR': '1.850', 'HITCOUNT': '2.100', 'weapon3': '2.524', 'DAMAGECOUNT': '8.874', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:27,157][52666] DAMAGECOUNT value on done: 51937.0 [2024-08-05 23:45:27,159][52666] Sum rewards: 44.913, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.178', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon5': '0.090', 'AMMO3': '0.162', 'AMMO4': '0.297', 'WEAPON5': '0.300', 'weapon2': '0.398', 'weapon4': '0.570', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.648', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 142450688. Throughput: 0: 4392.9. Samples: 35621090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:45:27,794][52567] Avg episode reward: [(0, '39.967')] [2024-08-05 23:45:27,854][52667] DAMAGECOUNT value on done: 52986.0 [2024-08-05 23:45:27,856][52667] Sum rewards: 49.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.463', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.183', 'WEAPON4': '0.350', 'ARMOR': '0.470', 'weapon4': '0.540', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.548', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:28,467][52658] DAMAGECOUNT value on done: 54235.0 [2024-08-05 23:45:28,468][52658] Sum rewards: 41.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.030', 'weapon4': '0.040', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.686', 'ARMOR': '1.329', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '3.058', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:28,572][52663] DAMAGECOUNT value on done: 56774.0 [2024-08-05 23:45:28,573][52663] Sum rewards: 37.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.516', 'WEAPON3': '1.350', 'HITCOUNT': '2.160', 'weapon3': '3.062', 'DAMAGECOUNT': '10.239', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:28,597][52670] DAMAGECOUNT value on done: 50595.0 [2024-08-05 23:45:28,598][52670] Sum rewards: 35.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.071', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.012', 'AMMO4': '0.014', 'WEAPON5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'ARMOR': '0.490', 'weapon2': '0.826', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.900', 'DAMAGECOUNT': '9.450', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:28,612][52650] Updated weights for policy 0, policy_version 17391 (0.0012) [2024-08-05 23:45:28,941][52665] DAMAGECOUNT value on done: 50813.0 [2024-08-05 23:45:28,943][52665] Sum rewards: 31.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.889', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'weapon2': '0.816', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.852', 'DAMAGECOUNT': '9.576', 'FRAGCOUNT': '28.000'} [2024-08-05 23:45:29,351][52820] DAMAGECOUNT value on done: 52273.0 [2024-08-05 23:45:29,356][52820] Sum rewards: 34.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.026', 'AMMO5': '0.003', 'AMMO2': '0.029', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.146', 'AMMO3': '0.269', 'weapon4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.650', 'HITCOUNT': '2.430', 'weapon3': '2.974', 'DAMAGECOUNT': '11.067', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:29,370][52671] DAMAGECOUNT value on done: 57921.0 [2024-08-05 23:45:29,371][52671] Sum rewards: 47.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.749', 'AMMO5': '0.009', 'weapon5': '0.024', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.147', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'WEAPON3': '1.100', 'weapon2': '1.148', 'weapon3': '2.584', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '40.000'} [2024-08-05 23:45:29,430][52647] DAMAGECOUNT value on done: 55044.0 [2024-08-05 23:45:29,432][52647] Sum rewards: 36.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.886', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.078', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.318', 'ARMOR': '0.424', 'weapon2': '0.596', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '2.774', 'DAMAGECOUNT': '9.879', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:30,322][52666] DAMAGECOUNT value on done: 49484.0 [2024-08-05 23:45:30,322][52666] Sum rewards: 46.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO4': '0.148', 'weapon4': '0.170', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.453', 'weapon2': '0.508', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.050', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:30,694][52667] DAMAGECOUNT value on done: 54145.0 [2024-08-05 23:45:30,696][52667] Sum rewards: 33.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.978', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.079', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'ARMOR': '0.460', 'weapon2': '1.004', 'WEAPON3': '1.400', 'HITCOUNT': '2.200', 'weapon3': '2.528', 'DAMAGECOUNT': '8.718', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:31,250][52658] DAMAGECOUNT value on done: 54434.0 [2024-08-05 23:45:31,251][52658] Sum rewards: 39.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.141', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.122', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'AMMO4': '0.259', 'weapon4': '0.298', 'WEAPON4': '0.600', 'weapon2': '0.860', 'WEAPON3': '1.200', 'ARMOR': '1.363', 'weapon3': '2.414', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.022', 'FRAGCOUNT': '34.500'} [2024-08-05 23:45:31,484][52663] DAMAGECOUNT value on done: 52235.0 [2024-08-05 23:45:31,485][52663] Sum rewards: 43.014, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.018', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.139', 'weapon4': '0.170', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.850', 'weapon2': '1.306', 'weapon3': '2.420', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:31,528][52670] DAMAGECOUNT value on done: 48652.0 [2024-08-05 23:45:31,528][52670] Sum rewards: 30.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.727', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO4': '0.149', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.352', 'ARMOR': '0.671', 'weapon2': '0.956', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.328', 'DAMAGECOUNT': '8.844', 'FRAGCOUNT': '27.000'} [2024-08-05 23:45:32,128][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:45:32,154][52647] DAMAGECOUNT value on done: 53092.0 [2024-08-05 23:45:32,154][52647] Sum rewards: 29.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.098', 'AMMO3': '0.162', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'ARMOR': '0.488', 'WEAPON4': '0.600', 'weapon2': '0.604', 'weapon4': '0.616', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.412', 'DAMAGECOUNT': '8.835', 'FRAGCOUNT': '25.000'} [2024-08-05 23:45:32,156][52665] DAMAGECOUNT value on done: 51677.0 [2024-08-05 23:45:32,157][52665] Sum rewards: 42.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.276', 'AMMO5': '0.008', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.652', 'WEAPON3': '1.100', 'ARMOR': '1.651', 'HITCOUNT': '2.390', 'weapon3': '2.866', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:32,311][52671] DAMAGECOUNT value on done: 52478.0 [2024-08-05 23:45:32,311][52671] Sum rewards: 34.865, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.394', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.097', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.220', 'WEAPON3': '0.700', 'ARMOR': '0.824', 'weapon2': '1.302', 'HITCOUNT': '2.170', 'weapon3': '2.272', 'DAMAGECOUNT': '8.763', 'FRAGCOUNT': '26.000'} [2024-08-05 23:45:32,311][52820] DAMAGECOUNT value on done: 52019.0 [2024-08-05 23:45:32,312][52820] Sum rewards: 37.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.544', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.054', 'AMMO3': '0.216', 'AMMO4': '0.272', 'weapon4': '0.414', 'weapon2': '0.506', 'WEAPON4': '0.650', 'ARMOR': '0.804', 'WEAPON3': '1.300', 'HITCOUNT': '2.460', 'weapon3': '2.718', 'DAMAGECOUNT': '10.032', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 142540800. Throughput: 0: 4394.7. Samples: 35634520. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:45:32,794][52567] Avg episode reward: [(0, '39.917')] [2024-08-05 23:45:32,907][52666] DAMAGECOUNT value on done: 49068.0 [2024-08-05 23:45:32,916][52666] Sum rewards: 33.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.076', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.106', 'AMMO3': '0.165', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.433', 'weapon2': '0.958', 'WEAPON3': '1.050', 'HITCOUNT': '2.030', 'weapon3': '2.520', 'DAMAGECOUNT': '9.498', 'FRAGCOUNT': '29.000'} [2024-08-05 23:45:32,978][52650] Updated weights for policy 0, policy_version 17401 (0.0011) [2024-08-05 23:45:33,972][52663] DAMAGECOUNT value on done: 52557.0 [2024-08-05 23:45:33,972][52663] Sum rewards: 33.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.036', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO4': '0.173', 'AMMO3': '0.199', 'WEAPON4': '0.400', 'weapon2': '0.644', 'WEAPON3': '1.150', 'HITCOUNT': '2.110', 'weapon3': '2.868', 'DAMAGECOUNT': '9.867', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:34,199][52670] DAMAGECOUNT value on done: 46681.0 [2024-08-05 23:45:34,200][52670] Sum rewards: 40.778, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.476', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.220', 'ARMOR': '0.528', 'weapon2': '0.794', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.702', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:34,412][52658] DAMAGECOUNT value on done: 54574.0 [2024-08-05 23:45:34,421][52658] Sum rewards: 46.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.079', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.774', 'ARMOR': '0.946', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:34,519][52647] DAMAGECOUNT value on done: 52616.0 [2024-08-05 23:45:34,520][52647] Sum rewards: 29.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.388', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'weapon4': '0.116', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.746', 'WEAPON3': '1.650', 'HITCOUNT': '2.030', 'weapon3': '2.848', 'DAMAGECOUNT': '8.916', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:34,573][52803] DAMAGECOUNT value on done: 50320.0 [2024-08-05 23:45:34,573][52803] Sum rewards: 37.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'AMMO5': '0.007', 'weapon5': '0.042', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'weapon4': '0.218', 'AMMO3': '0.223', 'AMMO4': '0.250', 'ARMOR': '0.497', 'WEAPON4': '0.500', 'weapon2': '0.918', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '2.560', 'DAMAGECOUNT': '10.299', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:35,175][52665] DAMAGECOUNT value on done: 50973.0 [2024-08-05 23:45:35,176][52665] Sum rewards: 45.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.624', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.010', 'weapon5': '0.012', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.824', 'ARMOR': '0.839', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '2.996', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:35,472][52671] DAMAGECOUNT value on done: 53165.0 [2024-08-05 23:45:35,473][52671] Sum rewards: 50.883, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.284', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.129', 'AMMO3': '0.131', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.436', 'WEAPON3': '0.900', 'weapon2': '1.060', 'HITCOUNT': '2.400', 'weapon3': '2.474', 'DAMAGECOUNT': '10.419', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:35,505][52820] DAMAGECOUNT value on done: 50008.0 [2024-08-05 23:45:35,506][52820] Sum rewards: 37.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.014', 'weapon5': '0.022', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.450', 'weapon2': '0.752', 'ARMOR': '0.869', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.642', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:35,971][52666] DAMAGECOUNT value on done: 50937.0 [2024-08-05 23:45:35,975][52666] Sum rewards: 44.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.269', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.210', 'weapon4': '0.330', 'WEAPON4': '0.450', 'ARMOR': '0.466', 'weapon2': '0.512', 'WEAPON3': '1.400', 'HITCOUNT': '2.690', 'weapon3': '2.912', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:36,803][52663] DAMAGECOUNT value on done: 55457.0 [2024-08-05 23:45:36,803][52663] Sum rewards: 42.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.753', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon2': '0.696', 'weapon4': '0.724', 'ARMOR': '0.953', 'WEAPON3': '1.100', 'weapon3': '2.204', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:37,071][52670] DAMAGECOUNT value on done: 51864.0 [2024-08-05 23:45:37,074][52670] Sum rewards: 41.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.549', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.106', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'ARMOR': '0.451', 'weapon2': '1.048', 'WEAPON3': '1.350', 'HITCOUNT': '2.220', 'weapon3': '2.538', 'DAMAGECOUNT': '10.170', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:37,262][52658] DAMAGECOUNT value on done: 51340.0 [2024-08-05 23:45:37,262][52658] Sum rewards: 36.956, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.619', 'AMMO5': '0.007', 'weapon5': '0.032', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'weapon4': '0.206', 'AMMO3': '0.217', 'WEAPON4': '0.500', 'ARMOR': '0.904', 'weapon2': '1.040', 'WEAPON3': '1.300', 'weapon3': '2.484', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:37,738][52803] DAMAGECOUNT value on done: 53429.0 [2024-08-05 23:45:37,738][52803] Sum rewards: 37.127, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.229', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.164', 'WEAPON4': '0.500', 'weapon2': '0.646', 'weapon4': '0.864', 'WEAPON3': '1.050', 'weapon3': '2.166', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.477', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 142622720. Throughput: 0: 4406.7. Samples: 35661030. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:45:37,794][52567] Avg episode reward: [(0, '39.958')] [2024-08-05 23:45:37,830][52650] Updated weights for policy 0, policy_version 17411 (0.0018) [2024-08-05 23:45:38,327][52665] DAMAGECOUNT value on done: 51037.0 [2024-08-05 23:45:38,327][52665] Sum rewards: 39.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.124', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'ARMOR': '0.475', 'weapon2': '0.612', 'WEAPON3': '1.500', 'HITCOUNT': '2.710', 'weapon3': '2.926', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:38,403][52671] DAMAGECOUNT value on done: 49939.0 [2024-08-05 23:45:38,405][52671] Sum rewards: 45.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.953', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.030', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.804', 'WEAPON3': '1.300', 'ARMOR': '1.330', 'weapon3': '2.770', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '39.500'} [2024-08-05 23:45:39,008][52666] DAMAGECOUNT value on done: 50756.0 [2024-08-05 23:45:39,011][52666] Sum rewards: 39.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.108', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.259', 'weapon2': '0.964', 'ARMOR': '1.265', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '2.798', 'DAMAGECOUNT': '11.610', 'FRAGCOUNT': '34.000'} [2024-08-05 23:45:39,314][52663] DAMAGECOUNT value on done: 52560.0 [2024-08-05 23:45:39,314][52663] Sum rewards: 44.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.239', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.160', 'AMMO3': '0.223', 'weapon4': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.850', 'ARMOR': '0.938', 'WEAPON3': '1.300', 'weapon3': '2.428', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:39,593][52658] DAMAGECOUNT value on done: 52114.0 [2024-08-05 23:45:39,601][52658] Sum rewards: 26.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.164', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.050', 'weapon4': '0.162', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'ARMOR': '0.520', 'weapon2': '0.824', 'WEAPON3': '1.500', 'HITCOUNT': '1.920', 'weapon3': '2.728', 'DAMAGECOUNT': '8.307', 'FRAGCOUNT': '27.000'} [2024-08-05 23:45:40,338][52670] DAMAGECOUNT value on done: 53390.0 [2024-08-05 23:45:40,342][52670] Sum rewards: 35.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.378', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.482', 'weapon2': '0.738', 'ARMOR': '1.200', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.564', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:40,860][52803] DAMAGECOUNT value on done: 49324.0 [2024-08-05 23:45:40,861][52803] Sum rewards: 39.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.854', 'AMMO5': '0.004', 'AMMO2': '0.047', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.222', 'AMMO4': '0.233', 'AMMO3': '0.240', 'ARMOR': '0.483', 'WEAPON4': '0.500', 'weapon2': '0.564', 'WEAPON3': '1.600', 'HITCOUNT': '2.610', 'weapon3': '2.874', 'DAMAGECOUNT': '10.320', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:41,321][52671] DAMAGECOUNT value on done: 50616.0 [2024-08-05 23:45:41,323][52671] Sum rewards: 39.754, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.052', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.098', 'AMMO3': '0.164', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'ARMOR': '0.512', 'weapon2': '0.574', 'weapon4': '0.654', 'WEAPON3': '1.000', 'HITCOUNT': '2.290', 'weapon3': '2.424', 'DAMAGECOUNT': '10.194', 'FRAGCOUNT': '31.500'} [2024-08-05 23:45:41,434][52665] DAMAGECOUNT value on done: 49822.0 [2024-08-05 23:45:41,434][52665] Sum rewards: 21.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.776', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.042', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'ARMOR': '0.507', 'weapon4': '0.532', 'weapon2': '0.862', 'WEAPON3': '1.350', 'HITCOUNT': '1.880', 'weapon3': '2.300', 'DAMAGECOUNT': '7.614', 'FRAGCOUNT': '22.000'} [2024-08-05 23:45:42,076][52663] DAMAGECOUNT value on done: 51859.0 [2024-08-05 23:45:42,076][52663] Sum rewards: 34.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.188', 'weapon4': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.844', 'ARMOR': '0.875', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.628', 'DAMAGECOUNT': '9.435', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:42,442][52650] Updated weights for policy 0, policy_version 17421 (0.0026) [2024-08-05 23:45:42,443][52666] DAMAGECOUNT value on done: 51347.0 [2024-08-05 23:45:42,444][52666] Sum rewards: 51.734, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.176', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.108', 'weapon5': '0.144', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.482', 'weapon2': '0.944', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '42.000'} [2024-08-05 23:45:42,492][52658] DAMAGECOUNT value on done: 52640.0 [2024-08-05 23:45:42,492][52658] Sum rewards: 28.248, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.702', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.201', 'AMMO3': '0.222', 'weapon4': '0.430', 'WEAPON4': '0.550', 'ARMOR': '0.881', 'weapon2': '1.212', 'WEAPON3': '1.300', 'weapon3': '2.080', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.411', 'FRAGCOUNT': '28.500'} [2024-08-05 23:45:42,635][52811] DAMAGECOUNT value on done: 50654.0 [2024-08-05 23:45:42,635][52811] Sum rewards: 48.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.469', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.024', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'ARMOR': '0.432', 'weapon2': '0.606', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.960', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '43.000'} [2024-08-05 23:45:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 142712832. Throughput: 0: 4416.0. Samples: 35687350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:45:42,794][52567] Avg episode reward: [(0, '39.859')] [2024-08-05 23:45:43,876][52670] DAMAGECOUNT value on done: 52564.0 [2024-08-05 23:45:43,877][52670] Sum rewards: 41.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.132', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.142', 'AMMO3': '0.143', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.354', 'ARMOR': '0.468', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon2': '0.856', 'weapon3': '2.422', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.839', 'FRAGCOUNT': '35.500'} [2024-08-05 23:45:44,003][52803] DAMAGECOUNT value on done: 48496.0 [2024-08-05 23:45:44,005][52803] Sum rewards: 31.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.364', 'WEAPON4': '0.400', 'ARMOR': '0.452', 'weapon2': '0.972', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.642', 'FRAGCOUNT': '28.000'} [2024-08-05 23:45:44,123][52665] DAMAGECOUNT value on done: 50000.0 [2024-08-05 23:45:44,123][52665] Sum rewards: 30.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.505', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.102', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.266', 'WEAPON4': '0.400', 'weapon2': '0.970', 'WEAPON3': '1.300', 'ARMOR': '1.348', 'HITCOUNT': '2.120', 'weapon3': '2.458', 'DAMAGECOUNT': '8.505', 'FRAGCOUNT': '28.000'} [2024-08-05 23:45:44,146][52671] DAMAGECOUNT value on done: 54239.0 [2024-08-05 23:45:44,148][52671] Sum rewards: 27.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'weapon5': '0.034', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.222', 'ARMOR': '0.488', 'WEAPON4': '0.550', 'weapon4': '0.588', 'weapon2': '0.756', 'WEAPON3': '1.150', 'HITCOUNT': '1.940', 'weapon3': '2.418', 'DAMAGECOUNT': '7.839', 'FRAGCOUNT': '26.000'} [2024-08-05 23:45:44,909][52658] DAMAGECOUNT value on done: 51498.0 [2024-08-05 23:45:44,917][52658] Sum rewards: 37.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.526', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.794', 'ARMOR': '0.832', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '2.868', 'DAMAGECOUNT': '9.777', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:45,094][52663] DAMAGECOUNT value on done: 50119.0 [2024-08-05 23:45:45,095][52663] Sum rewards: 42.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.830', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.024', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon4': '0.236', 'weapon2': '0.454', 'ARMOR': '0.905', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '3.112', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:45,458][52666] DAMAGECOUNT value on done: 50749.0 [2024-08-05 23:45:45,459][52666] Sum rewards: 40.654, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.108', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'HEALTH': '0.290', 'ARMOR': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.582', 'weapon2': '0.990', 'weapon3': '2.226', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '10.497', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:45,529][52659] DAMAGECOUNT value on done: 53111.0 [2024-08-05 23:45:45,531][52659] Sum rewards: 40.029, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.833', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'AMMO4': '0.158', 'WEAPON4': '0.350', 'ARMOR': '0.880', 'WEAPON3': '1.000', 'weapon2': '1.012', 'HITCOUNT': '2.430', 'weapon3': '2.732', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:45,735][52811] DAMAGECOUNT value on done: 47912.0 [2024-08-05 23:45:45,738][52811] Sum rewards: 38.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.098', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '0.800', 'weapon2': '0.906', 'weapon3': '2.234', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.434', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:46,663][52670] DAMAGECOUNT value on done: 52392.0 [2024-08-05 23:45:46,664][52670] Sum rewards: 40.281, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.009', 'weapon5': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'ARMOR': '0.886', 'WEAPON3': '0.950', 'weapon2': '1.110', 'HITCOUNT': '2.350', 'weapon3': '2.484', 'DAMAGECOUNT': '9.540', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:46,988][52650] Updated weights for policy 0, policy_version 17431 (0.0013) [2024-08-05 23:45:47,050][52803] DAMAGECOUNT value on done: 52522.0 [2024-08-05 23:45:47,052][52803] Sum rewards: 40.248, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.164', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.616', 'WEAPON3': '1.400', 'HITCOUNT': '2.440', 'weapon3': '3.004', 'DAMAGECOUNT': '10.371', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:47,164][52671] DAMAGECOUNT value on done: 53332.0 [2024-08-05 23:45:47,164][52671] Sum rewards: 40.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.012', 'weapon5': '0.022', 'ARMOR': '0.032', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO3': '0.163', 'AMMO4': '0.163', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.740', 'WEAPON3': '1.100', 'HITCOUNT': '2.130', 'weapon3': '2.908', 'DAMAGECOUNT': '8.952', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:47,730][52663] DAMAGECOUNT value on done: 51908.0 [2024-08-05 23:45:47,733][52663] Sum rewards: 37.186, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.468', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.129', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'WEAPON4': '0.500', 'weapon2': '0.562', 'weapon4': '0.574', 'WEAPON3': '0.900', 'ARMOR': '1.009', 'HITCOUNT': '2.200', 'weapon3': '2.410', 'DAMAGECOUNT': '8.943', 'FRAGCOUNT': '29.000'} [2024-08-05 23:45:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 142802944. Throughput: 0: 4413.5. Samples: 35700420. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-05 23:45:47,794][52567] Avg episode reward: [(0, '39.328')] [2024-08-05 23:45:48,049][52658] DAMAGECOUNT value on done: 54551.0 [2024-08-05 23:45:48,050][52658] Sum rewards: 45.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.061', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.025', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.516', 'weapon2': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.346', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '40.000'} [2024-08-05 23:45:48,296][52666] DAMAGECOUNT value on done: 49879.0 [2024-08-05 23:45:48,297][52666] Sum rewards: 36.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.806', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.058', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'ARMOR': '0.859', 'weapon2': '0.958', 'WEAPON3': '1.200', 'HITCOUNT': '2.420', 'weapon3': '2.800', 'DAMAGECOUNT': '10.533', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:48,604][52659] DAMAGECOUNT value on done: 55535.0 [2024-08-05 23:45:48,604][52659] Sum rewards: 35.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.501', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.182', 'WEAPON4': '0.400', 'ARMOR': '0.476', 'weapon4': '0.514', 'weapon2': '0.654', 'WEAPON3': '0.900', 'HITCOUNT': '2.280', 'weapon3': '2.484', 'DAMAGECOUNT': '10.683', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:48,836][52811] DAMAGECOUNT value on done: 50613.0 [2024-08-05 23:45:48,839][52811] Sum rewards: 49.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.318', 'AMMO2': '0.045', 'weapon4': '0.062', 'AMMO4': '0.227', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon2': '0.672', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.084', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '43.000'} [2024-08-05 23:45:49,723][52670] DAMAGECOUNT value on done: 52717.0 [2024-08-05 23:45:49,723][52670] Sum rewards: 43.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.157', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.170', 'AMMO4': '0.194', 'WEAPON4': '0.400', 'ARMOR': '0.492', 'weapon4': '0.522', 'weapon2': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.508', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:50,040][52803] DAMAGECOUNT value on done: 48282.0 [2024-08-05 23:45:50,048][52803] Sum rewards: 55.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.278', 'ARMOR': '0.452', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '45.000'} [2024-08-05 23:45:50,166][52671] DAMAGECOUNT value on done: 55104.0 [2024-08-05 23:45:50,168][52671] Sum rewards: 28.155, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.997', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.157', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON3': '0.950', 'weapon2': '1.160', 'HITCOUNT': '1.780', 'weapon3': '2.030', 'DAMAGECOUNT': '7.461', 'FRAGCOUNT': '25.000'} [2024-08-05 23:45:50,624][52663] DAMAGECOUNT value on done: 54563.0 [2024-08-05 23:45:50,626][52663] Sum rewards: 38.046, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.133', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.152', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.242', 'ARMOR': '0.400', 'weapon2': '0.952', 'WEAPON3': '1.200', 'HITCOUNT': '2.550', 'weapon3': '2.562', 'DAMAGECOUNT': '10.911', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:50,695][52658] DAMAGECOUNT value on done: 56496.0 [2024-08-05 23:45:50,695][52658] Sum rewards: 31.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.486', 'AMMO5': '0.014', 'weapon5': '0.034', 'AMMO2': '0.036', 'weapon4': '0.164', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'weapon2': '0.690', 'ARMOR': '0.855', 'WEAPON3': '1.350', 'HITCOUNT': '2.430', 'weapon3': '2.926', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '29.000'} [2024-08-05 23:45:51,544][52659] DAMAGECOUNT value on done: 52770.0 [2024-08-05 23:45:51,545][52659] Sum rewards: 49.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO3': '0.149', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.488', 'weapon2': '0.796', 'ARMOR': '0.866', 'WEAPON3': '1.000', 'weapon3': '2.302', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '39.000'} [2024-08-05 23:45:51,666][52666] DAMAGECOUNT value on done: 50455.0 [2024-08-05 23:45:51,668][52666] Sum rewards: 43.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.876', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.460', 'ARMOR': '0.525', 'weapon2': '0.868', 'WEAPON3': '1.150', 'weapon3': '2.434', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:51,803][52650] Updated weights for policy 0, policy_version 17441 (0.0037) [2024-08-05 23:45:51,824][52811] DAMAGECOUNT value on done: 48480.0 [2024-08-05 23:45:51,824][52811] Sum rewards: 40.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.975', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.056', 'weapon4': '0.068', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.516', 'WEAPON3': '1.350', 'HITCOUNT': '2.430', 'weapon3': '3.134', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:52,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 142893056. Throughput: 0: 4416.9. Samples: 35727070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:45:52,795][52567] Avg episode reward: [(0, '39.438')] [2024-08-05 23:45:52,854][52671] DAMAGECOUNT value on done: 52631.0 [2024-08-05 23:45:52,855][52671] Sum rewards: 39.522, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.592', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.255', 'ARMOR': '0.455', 'weapon2': '0.812', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '3.006', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '36.000'} [2024-08-05 23:45:53,030][52670] DAMAGECOUNT value on done: 48897.0 [2024-08-05 23:45:53,032][52670] Sum rewards: 38.526, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.486', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.160', 'weapon2': '0.818', 'ARMOR': '0.896', 'WEAPON3': '1.000', 'HITCOUNT': '2.150', 'weapon3': '2.858', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:53,137][52803] DAMAGECOUNT value on done: 51763.0 [2024-08-05 23:45:53,137][52803] Sum rewards: 26.707, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.136', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.115', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.354', 'WEAPON4': '0.400', 'ARMOR': '0.925', 'weapon2': '1.136', 'WEAPON3': '1.150', 'HITCOUNT': '1.940', 'weapon3': '2.256', 'DAMAGECOUNT': '7.623', 'FRAGCOUNT': '24.000'} [2024-08-05 23:45:53,277][52658] DAMAGECOUNT value on done: 51963.0 [2024-08-05 23:45:53,277][52658] Sum rewards: 39.940, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.512', 'AMMO5': '0.007', 'weapon5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.476', 'ARMOR': '0.511', 'weapon2': '0.954', 'WEAPON3': '1.050', 'HITCOUNT': '2.300', 'weapon3': '2.366', 'DAMAGECOUNT': '9.612', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:53,647][52663] DAMAGECOUNT value on done: 52762.0 [2024-08-05 23:45:53,649][52663] Sum rewards: 52.079, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon4': '0.320', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '3.156', 'DAMAGECOUNT': '11.892', 'FRAGCOUNT': '44.000'} [2024-08-05 23:45:54,485][52659] DAMAGECOUNT value on done: 53985.0 [2024-08-05 23:45:54,487][52659] Sum rewards: 39.890, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.902', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.266', 'weapon2': '0.860', 'ARMOR': '1.311', 'WEAPON3': '1.500', 'weapon3': '2.782', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:54,621][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:45:54,678][52666] DAMAGECOUNT value on done: 51540.0 [2024-08-05 23:45:54,680][52666] Sum rewards: 37.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.236', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.450', 'weapon2': '0.832', 'weapon4': '0.854', 'ARMOR': '0.930', 'WEAPON3': '1.000', 'weapon3': '1.978', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '10.065', 'FRAGCOUNT': '33.000'} [2024-08-05 23:45:55,032][52811] DAMAGECOUNT value on done: 48818.0 [2024-08-05 23:45:55,033][52811] Sum rewards: 38.760, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.042', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON3': '0.800', 'ARMOR': '0.862', 'weapon2': '1.246', 'HITCOUNT': '2.290', 'weapon3': '2.488', 'DAMAGECOUNT': '9.531', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:55,675][52671] DAMAGECOUNT value on done: 55665.0 [2024-08-05 23:45:55,676][52671] Sum rewards: 49.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.585', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.238', 'ARMOR': '0.468', 'weapon2': '0.834', 'WEAPON3': '1.050', 'weapon3': '2.660', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '41.000'} [2024-08-05 23:45:56,073][52670] DAMAGECOUNT value on done: 52158.0 [2024-08-05 23:45:56,074][52670] Sum rewards: 49.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.254', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon4': '0.258', 'weapon2': '0.602', 'ARMOR': '0.875', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '2.978', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '42.000'} [2024-08-05 23:45:56,163][52803] DAMAGECOUNT value on done: 49586.0 [2024-08-05 23:45:56,163][52803] Sum rewards: 40.271, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.064', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'weapon4': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.860', 'ARMOR': '0.867', 'WEAPON3': '0.900', 'HITCOUNT': '2.330', 'weapon3': '2.434', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '32.000'} [2024-08-05 23:45:56,311][52650] Updated weights for policy 0, policy_version 17451 (0.0019) [2024-08-05 23:45:56,372][52658] DAMAGECOUNT value on done: 52051.0 [2024-08-05 23:45:56,376][52658] Sum rewards: 40.614, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.348', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO4': '0.075', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.646', 'weapon2': '0.786', 'WEAPON3': '0.850', 'ARMOR': '0.888', 'HITCOUNT': '2.140', 'weapon3': '2.250', 'DAMAGECOUNT': '10.434', 'FRAGCOUNT': '31.000'} [2024-08-05 23:45:56,748][52663] DAMAGECOUNT value on done: 53979.0 [2024-08-05 23:45:56,748][52663] Sum rewards: 35.252, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.802', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.130', 'weapon4': '0.274', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'weapon2': '0.926', 'WEAPON3': '0.950', 'HITCOUNT': '2.410', 'weapon3': '2.602', 'DAMAGECOUNT': '9.339', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:57,046][52659] DAMAGECOUNT value on done: 52705.0 [2024-08-05 23:45:57,047][52659] Sum rewards: 39.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.458', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.238', 'WEAPON4': '0.350', 'ARMOR': '0.853', 'weapon2': '0.952', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.536', 'DAMAGECOUNT': '9.321', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:57,170][52666] Large shaping reward 3.426 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.375, 125.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:45:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 142983168. Throughput: 0: 4410.2. Samples: 35753310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-05 23:45:57,794][52567] Avg episode reward: [(0, '39.205')] [2024-08-05 23:45:57,891][52666] DAMAGECOUNT value on done: 52128.0 [2024-08-05 23:45:57,893][52666] Sum rewards: 44.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.222', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.187', 'weapon4': '0.296', 'WEAPON4': '0.350', 'ARMOR': '0.466', 'weapon2': '0.526', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.780', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '38.000'} [2024-08-05 23:45:57,982][52811] DAMAGECOUNT value on done: 51833.0 [2024-08-05 23:45:57,983][52811] Sum rewards: 49.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.374', 'ARMOR': '0.456', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.312', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '43.000'} [2024-08-05 23:45:58,450][52671] DAMAGECOUNT value on done: 54193.0 [2024-08-05 23:45:58,453][52671] Sum rewards: 44.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.047', 'weapon4': '0.068', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '3.114', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '37.000'} [2024-08-05 23:45:59,091][52803] DAMAGECOUNT value on done: 52171.0 [2024-08-05 23:45:59,092][52803] Sum rewards: 33.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'weapon4': '0.024', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'ARMOR': '0.907', 'WEAPON3': '1.250', 'weapon2': '1.290', 'HITCOUNT': '2.080', 'weapon3': '2.488', 'DAMAGECOUNT': '8.811', 'FRAGCOUNT': '30.000'} [2024-08-05 23:45:59,137][52670] DAMAGECOUNT value on done: 50396.0 [2024-08-05 23:45:59,138][52670] Sum rewards: 48.520, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.122', 'AMMO2': '0.009', 'AMMO5': '0.013', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.132', 'weapon4': '0.148', 'WEAPON5': '0.250', 'ARMOR': '0.412', 'WEAPON3': '0.800', 'weapon2': '0.868', 'HITCOUNT': '2.470', 'weapon3': '2.670', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '39.000'} [2024-08-05 23:45:59,523][52663] DAMAGECOUNT value on done: 55527.0 [2024-08-05 23:45:59,523][52663] Sum rewards: 42.750, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.212', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.169', 'weapon4': '0.292', 'ARMOR': '0.452', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.612', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '35.000'} [2024-08-05 23:45:59,699][52658] DAMAGECOUNT value on done: 55950.0 [2024-08-05 23:45:59,701][52658] Sum rewards: 43.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.602', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.058', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'ARMOR': '0.504', 'weapon2': '0.540', 'WEAPON3': '1.550', 'HITCOUNT': '2.680', 'weapon3': '3.110', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '39.000'} [2024-08-05 23:46:00,226][52659] DAMAGECOUNT value on done: 55249.0 [2024-08-05 23:46:00,226][52659] Sum rewards: 35.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.086', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'ARMOR': '0.420', 'weapon2': '0.900', 'WEAPON3': '1.150', 'HITCOUNT': '2.390', 'weapon3': '2.728', 'DAMAGECOUNT': '10.416', 'FRAGCOUNT': '30.000'} [2024-08-05 23:46:00,880][52811] DAMAGECOUNT value on done: 52710.0 [2024-08-05 23:46:00,880][52811] Sum rewards: 31.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON3': '1.000', 'weapon2': '1.212', 'ARMOR': '1.310', 'HITCOUNT': '2.230', 'weapon3': '2.530', 'DAMAGECOUNT': '9.420', 'FRAGCOUNT': '28.000'} [2024-08-05 23:46:01,129][52650] Updated weights for policy 0, policy_version 17461 (0.0022) [2024-08-05 23:46:01,235][52671] DAMAGECOUNT value on done: 53170.0 [2024-08-05 23:46:01,236][52671] Sum rewards: 46.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.504', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.104', 'AMMO4': '0.176', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.502', 'weapon2': '0.594', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.944', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '39.500'} [2024-08-05 23:46:02,004][52670] DAMAGECOUNT value on done: 51263.0 [2024-08-05 23:46:02,005][52670] Sum rewards: 42.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.324', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.153', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.838', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '2.522', 'DAMAGECOUNT': '11.499', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:02,198][52803] DAMAGECOUNT value on done: 47473.0 [2024-08-05 23:46:02,198][52803] Sum rewards: 24.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.135', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.163', 'AMMO3': '0.189', 'weapon4': '0.258', 'WEAPON4': '0.400', 'ARMOR': '0.910', 'weapon2': '0.988', 'WEAPON3': '1.150', 'HITCOUNT': '1.730', 'weapon3': '2.476', 'DAMAGECOUNT': '7.035', 'FRAGCOUNT': '24.000'} [2024-08-05 23:46:02,297][52663] DAMAGECOUNT value on done: 54790.0 [2024-08-05 23:46:02,297][52663] Sum rewards: 42.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'weapon5': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.338', 'weapon2': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.604', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '38.000'} [2024-08-05 23:46:02,475][52659] DAMAGECOUNT value on done: 54380.0 [2024-08-05 23:46:02,479][52659] Sum rewards: 41.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.078', 'AMMO4': '0.084', 'weapon4': '0.146', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.718', 'ARMOR': '0.912', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.802', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:02,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17750.0, 300 sec: 17633.6). Total num frames: 143073280. Throughput: 0: 4414.4. Samples: 35766660. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 23:46:02,794][52567] Avg episode reward: [(0, '39.430')] [2024-08-05 23:46:03,543][52671] DAMAGECOUNT value on done: 58551.0 [2024-08-05 23:46:03,543][52671] Sum rewards: 43.084, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.177', 'AMMO4': '0.177', 'weapon4': '0.228', 'WEAPON4': '0.300', 'ARMOR': '0.467', 'weapon2': '1.008', 'WEAPON3': '1.150', 'weapon3': '2.496', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.509', 'FRAGCOUNT': '38.000'} [2024-08-05 23:46:03,931][52811] DAMAGECOUNT value on done: 48669.0 [2024-08-05 23:46:03,931][52811] Sum rewards: 37.345, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.562', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.062', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'ARMOR': '0.416', 'weapon4': '0.444', 'WEAPON4': '0.500', 'weapon2': '0.604', 'WEAPON3': '1.500', 'HITCOUNT': '2.530', 'weapon3': '2.554', 'DAMAGECOUNT': '10.965', 'FRAGCOUNT': '35.000'} [2024-08-05 23:46:04,690][52670] DAMAGECOUNT value on done: 49728.0 [2024-08-05 23:46:04,690][52670] Sum rewards: 24.310, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.363', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'ARMOR': '0.857', 'WEAPON3': '0.900', 'weapon2': '1.288', 'HITCOUNT': '1.590', 'weapon3': '1.654', 'DAMAGECOUNT': '6.585', 'FRAGCOUNT': '21.000'} [2024-08-05 23:46:04,794][52659] DAMAGECOUNT value on done: 50840.0 [2024-08-05 23:46:04,796][52659] Sum rewards: 43.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.156', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'weapon2': '0.800', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '2.824', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:05,207][52663] DAMAGECOUNT value on done: 52959.0 [2024-08-05 23:46:05,207][52663] Sum rewards: 40.954, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'weapon4': '0.300', 'ARMOR': '0.416', 'weapon2': '0.636', 'WEAPON3': '1.750', 'weapon3': '2.748', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '39.000'} [2024-08-05 23:46:05,220][52803] DAMAGECOUNT value on done: 53205.0 [2024-08-05 23:46:05,222][52803] Sum rewards: 46.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.246', 'weapon2': '0.684', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.766', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '40.000'} [2024-08-05 23:46:05,570][52650] Updated weights for policy 0, policy_version 17471 (0.0019) [2024-08-05 23:46:06,048][52671] DAMAGECOUNT value on done: 53293.0 [2024-08-05 23:46:06,049][52671] Sum rewards: 32.458, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.816', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'ARMOR': '0.925', 'WEAPON3': '1.100', 'weapon2': '1.106', 'HITCOUNT': '1.940', 'weapon3': '2.596', 'DAMAGECOUNT': '8.445', 'FRAGCOUNT': '28.000'} [2024-08-05 23:46:06,959][52811] DAMAGECOUNT value on done: 50072.0 [2024-08-05 23:46:06,968][52811] Sum rewards: 39.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.520', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.130', 'weapon5': '0.136', 'weapon4': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon2': '1.126', 'HITCOUNT': '2.290', 'weapon3': '2.352', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:07,446][52659] DAMAGECOUNT value on done: 51668.0 [2024-08-05 23:46:07,447][52659] Sum rewards: 34.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.121', 'weapon5': '0.122', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'ARMOR': '0.525', 'WEAPON4': '0.550', 'weapon4': '0.766', 'weapon2': '0.784', 'WEAPON3': '0.800', 'weapon3': '2.074', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '9.615', 'FRAGCOUNT': '29.000'} [2024-08-05 23:46:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 143155200. Throughput: 0: 4411.1. Samples: 35793270. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 23:46:07,794][52567] Avg episode reward: [(0, '39.417')] [2024-08-05 23:46:08,480][52803] DAMAGECOUNT value on done: 49970.0 [2024-08-05 23:46:08,480][52803] Sum rewards: 39.991, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.528', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.144', 'ARMOR': '0.861', 'WEAPON3': '0.900', 'weapon2': '0.988', 'HITCOUNT': '2.490', 'weapon3': '2.858', 'DAMAGECOUNT': '9.564', 'FRAGCOUNT': '33.000'} [2024-08-05 23:46:08,606][52671] DAMAGECOUNT value on done: 50869.0 [2024-08-05 23:46:08,606][52671] Sum rewards: 47.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.556', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO4': '0.176', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'weapon2': '0.498', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '2.976', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '41.000'} [2024-08-05 23:46:09,990][52811] DAMAGECOUNT value on done: 50095.0 [2024-08-05 23:46:09,993][52811] Sum rewards: 43.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.298', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'ARMOR': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.996', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '38.000'} [2024-08-05 23:46:10,024][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:46:10,190][52650] Updated weights for policy 0, policy_version 17481 (0.0014) [2024-08-05 23:46:10,373][52659] DAMAGECOUNT value on done: 55408.0 [2024-08-05 23:46:10,375][52659] Sum rewards: 46.654, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.295', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'weapon5': '0.112', 'AMMO3': '0.132', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON3': '0.750', 'weapon2': '1.288', 'weapon3': '2.320', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.832', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:11,515][52803] DAMAGECOUNT value on done: 48736.0 [2024-08-05 23:46:11,517][52803] Sum rewards: 34.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.349', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.171', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.792', 'ARMOR': '0.865', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.680', 'DAMAGECOUNT': '9.453', 'FRAGCOUNT': '29.000'} [2024-08-05 23:46:11,787][52671] DAMAGECOUNT value on done: 55815.0 [2024-08-05 23:46:11,787][52671] Sum rewards: 26.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.374', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.038', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'weapon4': '0.422', 'weapon2': '0.728', 'WEAPON3': '1.300', 'HITCOUNT': '2.210', 'weapon3': '2.550', 'DAMAGECOUNT': '9.321', 'FRAGCOUNT': '26.500'} [2024-08-05 23:46:12,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 143245312. Throughput: 0: 4413.8. Samples: 35819710. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-05 23:46:12,795][52567] Avg episode reward: [(0, '39.347')] [2024-08-05 23:46:13,052][52659] DAMAGECOUNT value on done: 53027.0 [2024-08-05 23:46:13,053][52659] Sum rewards: 42.251, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.365', 'AMMO5': '0.004', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.116', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'ARMOR': '0.501', 'weapon2': '0.734', 'WEAPON3': '1.500', 'HITCOUNT': '2.700', 'weapon3': '2.944', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '39.000'} [2024-08-05 23:46:13,182][52811] DAMAGECOUNT value on done: 53590.0 [2024-08-05 23:46:13,183][52811] Sum rewards: 43.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.587', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.216', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'weapon2': '0.558', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.036', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '39.000'} [2024-08-05 23:46:14,143][52671] DAMAGECOUNT value on done: 54993.0 [2024-08-05 23:46:14,144][52671] Sum rewards: 42.107, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO2': '0.035', 'AMMO3': '0.155', 'AMMO4': '0.172', 'weapon4': '0.370', 'WEAPON4': '0.450', 'ARMOR': '0.949', 'weapon2': '0.956', 'WEAPON3': '1.000', 'weapon3': '2.500', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '35.000'} [2024-08-05 23:46:14,681][52803] DAMAGECOUNT value on done: 50561.0 [2024-08-05 23:46:14,683][52803] Sum rewards: 38.359, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.715', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.062', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'weapon2': '0.626', 'ARMOR': '1.303', 'WEAPON3': '1.700', 'HITCOUNT': '2.660', 'weapon3': '2.934', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:14,911][52650] Updated weights for policy 0, policy_version 17491 (0.0012) [2024-08-05 23:46:15,940][52659] DAMAGECOUNT value on done: 53379.0 [2024-08-05 23:46:15,941][52659] Sum rewards: 30.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.272', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.056', 'weapon4': '0.060', 'AMMO4': '0.099', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon2': '0.732', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.938', 'DAMAGECOUNT': '8.979', 'FRAGCOUNT': '27.000'} [2024-08-05 23:46:16,235][52811] DAMAGECOUNT value on done: 47782.0 [2024-08-05 23:46:16,236][52811] Sum rewards: 41.659, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.671', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.109', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.478', 'weapon2': '0.540', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.680', 'DAMAGECOUNT': '10.515', 'FRAGCOUNT': '36.000'} [2024-08-05 23:46:17,243][52671] DAMAGECOUNT value on done: 55622.0 [2024-08-05 23:46:17,251][52671] Sum rewards: 31.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.422', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.196', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'weapon2': '0.860', 'WEAPON3': '1.350', 'HITCOUNT': '2.260', 'weapon3': '2.768', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '28.000'} [2024-08-05 23:46:17,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 143335424. Throughput: 0: 4409.1. Samples: 35832930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:46:17,795][52567] Avg episode reward: [(0, '39.624')] [2024-08-05 23:46:17,808][52803] DAMAGECOUNT value on done: 49728.0 [2024-08-05 23:46:17,808][52803] Sum rewards: 43.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.428', 'AMMO5': '0.008', 'weapon5': '0.042', 'AMMO2': '0.045', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.224', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.850', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '38.000'} [2024-08-05 23:46:18,835][52659] DAMAGECOUNT value on done: 51293.0 [2024-08-05 23:46:18,837][52659] Sum rewards: 31.545, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.174', 'ARMOR': '0.457', 'WEAPON3': '0.900', 'weapon2': '1.428', 'weapon3': '2.146', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '8.805', 'FRAGCOUNT': '26.000'} [2024-08-05 23:46:19,402][52811] DAMAGECOUNT value on done: 51545.0 [2024-08-05 23:46:19,402][52811] Sum rewards: 37.722, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.418', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon5': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.386', 'ARMOR': '0.852', 'WEAPON3': '0.900', 'weapon2': '1.082', 'weapon3': '2.186', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '9.804', 'FRAGCOUNT': '29.000'} [2024-08-05 23:46:19,623][52650] Updated weights for policy 0, policy_version 17501 (0.0012) [2024-08-05 23:46:19,864][52671] DAMAGECOUNT value on done: 52999.0 [2024-08-05 23:46:19,866][52671] Sum rewards: 41.019, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.133', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'WEAPON4': '0.300', 'ARMOR': '0.453', 'weapon4': '0.602', 'weapon2': '0.726', 'WEAPON3': '0.850', 'weapon3': '2.390', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '31.000'} [2024-08-05 23:46:20,936][52803] DAMAGECOUNT value on done: 47735.0 [2024-08-05 23:46:20,937][52803] Sum rewards: 37.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.212', 'AMMO4': '0.227', 'weapon4': '0.434', 'WEAPON4': '0.450', 'weapon2': '0.722', 'ARMOR': '0.800', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.642', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:21,479][52659] DAMAGECOUNT value on done: 51937.0 [2024-08-05 23:46:21,480][52659] Sum rewards: 39.804, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.018', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.024', 'AMMO4': '0.027', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.418', 'weapon2': '0.782', 'WEAPON3': '1.100', 'weapon3': '2.522', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '9.669', 'FRAGCOUNT': '33.000'} [2024-08-05 23:46:21,951][52649] DAMAGECOUNT value on done: 52800.0 [2024-08-05 23:46:21,954][52649] Sum rewards: 38.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.210', 'weapon4': '0.272', 'WEAPON4': '0.500', 'weapon2': '0.762', 'WEAPON3': '1.050', 'HITCOUNT': '2.290', 'weapon3': '2.616', 'DAMAGECOUNT': '10.011', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:22,566][52811] DAMAGECOUNT value on done: 49046.0 [2024-08-05 23:46:22,568][52811] Sum rewards: 36.876, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.322', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon4': '0.304', 'WEAPON3': '1.000', 'weapon2': '1.016', 'HITCOUNT': '2.250', 'weapon3': '2.516', 'DAMAGECOUNT': '9.189', 'FRAGCOUNT': '30.000'} [2024-08-05 23:46:22,757][52671] DAMAGECOUNT value on done: 53182.0 [2024-08-05 23:46:22,757][52671] Sum rewards: 49.021, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'weapon4': '0.258', 'ARMOR': '0.420', 'WEAPON3': '0.900', 'weapon2': '1.222', 'weapon3': '2.182', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '39.000'} [2024-08-05 23:46:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 143425536. Throughput: 0: 4407.8. Samples: 35859380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-05 23:46:22,794][52567] Avg episode reward: [(0, '39.348')] [2024-08-05 23:46:22,946][52662] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.042, -14.0), ('weapon5', 0.002)] [2024-08-05 23:46:23,835][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:46:24,018][52659] DAMAGECOUNT value on done: 54262.0 [2024-08-05 23:46:24,019][52659] Sum rewards: 40.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.764', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.036', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON3': '1.000', 'weapon2': '1.064', 'HITCOUNT': '2.560', 'weapon3': '2.640', 'DAMAGECOUNT': '10.536', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:24,050][52803] DAMAGECOUNT value on done: 49931.0 [2024-08-05 23:46:24,050][52803] Sum rewards: 40.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.282', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.192', 'ARMOR': '0.404', 'weapon2': '0.652', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.950', 'DAMAGECOUNT': '10.830', 'FRAGCOUNT': '36.000'} [2024-08-05 23:46:24,187][52650] Updated weights for policy 0, policy_version 17511 (0.0042) [2024-08-05 23:46:25,029][52649] DAMAGECOUNT value on done: 52622.0 [2024-08-05 23:46:25,030][52649] Sum rewards: 38.379, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.968', 'weapon5': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon4': '0.322', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.870', 'WEAPON3': '1.450', 'weapon3': '2.548', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.376', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:25,588][52811] DAMAGECOUNT value on done: 50407.0 [2024-08-05 23:46:25,590][52811] Sum rewards: 36.645, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.295', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.099', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.398', 'ARMOR': '0.453', 'WEAPON3': '0.900', 'weapon2': '0.918', 'weapon3': '2.326', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.578', 'FRAGCOUNT': '28.000'} [2024-08-05 23:46:27,008][52659] DAMAGECOUNT value on done: 59266.0 [2024-08-05 23:46:27,009][52659] Sum rewards: 48.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.308', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.222', 'weapon4': '0.422', 'WEAPON3': '0.950', 'HITCOUNT': '2.810', 'weapon3': '3.168', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '39.000'} [2024-08-05 23:46:27,214][52803] DAMAGECOUNT value on done: 50104.0 [2024-08-05 23:46:27,215][52803] Sum rewards: 41.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.193', 'AMMO4': '0.196', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'weapon2': '0.870', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.826', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '36.000'} [2024-08-05 23:46:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 143507456. Throughput: 0: 4406.6. Samples: 35885650. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:46:27,802][52567] Avg episode reward: [(0, '39.469')] [2024-08-05 23:46:27,809][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017519_143515648.pth... [2024-08-05 23:46:27,938][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017002_139280384.pth [2024-08-05 23:46:28,015][52649] DAMAGECOUNT value on done: 52155.0 [2024-08-05 23:46:28,015][52649] Sum rewards: 43.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.183', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.187', 'WEAPON4': '0.450', 'weapon2': '0.544', 'weapon4': '0.894', 'ARMOR': '0.936', 'WEAPON3': '1.050', 'weapon3': '2.420', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '11.172', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:28,772][52811] DAMAGECOUNT value on done: 50475.0 [2024-08-05 23:46:28,772][52811] Sum rewards: 37.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.861', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.092', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'weapon4': '0.396', 'ARMOR': '0.487', 'WEAPON4': '0.550', 'weapon2': '0.594', 'WEAPON3': '0.950', 'HITCOUNT': '2.310', 'weapon3': '2.574', 'DAMAGECOUNT': '8.919', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:28,972][52650] Updated weights for policy 0, policy_version 17521 (0.0033) [2024-08-05 23:46:30,107][52659] DAMAGECOUNT value on done: 53381.0 [2024-08-05 23:46:30,108][52659] Sum rewards: 32.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.036', 'AMMO4': '0.063', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'ARMOR': '0.424', 'weapon2': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '2.330', 'weapon3': '3.072', 'DAMAGECOUNT': '9.846', 'FRAGCOUNT': '29.000'} [2024-08-05 23:46:30,405][52803] DAMAGECOUNT value on done: 50919.0 [2024-08-05 23:46:30,406][52803] Sum rewards: 32.258, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.942', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.036', 'weapon5': '0.044', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.000', 'weapon4': '1.118', 'HITCOUNT': '1.990', 'weapon3': '2.178', 'DAMAGECOUNT': '7.503', 'FRAGCOUNT': '28.000'} [2024-08-05 23:46:30,870][52649] DAMAGECOUNT value on done: 51296.0 [2024-08-05 23:46:30,870][52649] Sum rewards: 33.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.389', 'AMMO5': '0.004', 'weapon5': '0.038', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.261', 'weapon4': '0.526', 'WEAPON4': '0.550', 'ARMOR': '0.800', 'weapon2': '0.848', 'WEAPON3': '1.200', 'weapon3': '2.358', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '9.747', 'FRAGCOUNT': '29.000'} [2024-08-05 23:46:31,879][52811] DAMAGECOUNT value on done: 50590.0 [2024-08-05 23:46:31,881][52811] Sum rewards: 36.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.362', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.062', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'ARMOR': '0.416', 'weapon2': '0.990', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.690', 'DAMAGECOUNT': '10.497', 'FRAGCOUNT': '32.500'} [2024-08-05 23:46:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 143589376. Throughput: 0: 4398.7. Samples: 35898360. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:46:32,794][52567] Avg episode reward: [(0, '39.554')] [2024-08-05 23:46:33,008][52659] DAMAGECOUNT value on done: 53987.0 [2024-08-05 23:46:33,010][52659] Sum rewards: 45.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.374', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '1.150', 'WEAPON3': '1.350', 'ARMOR': '1.820', 'weapon3': '2.534', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '41.000'} [2024-08-05 23:46:33,401][52803] DAMAGECOUNT value on done: 49743.0 [2024-08-05 23:46:33,409][52803] Sum rewards: 37.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.691', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.175', 'WEAPON4': '0.400', 'weapon4': '0.404', 'weapon2': '0.808', 'WEAPON3': '1.000', 'ARMOR': '1.354', 'HITCOUNT': '2.270', 'weapon3': '2.418', 'DAMAGECOUNT': '10.194', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:33,523][52650] Updated weights for policy 0, policy_version 17531 (0.0046) [2024-08-05 23:46:33,862][52649] DAMAGECOUNT value on done: 51818.0 [2024-08-05 23:46:33,862][52649] Sum rewards: 34.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.174', 'AMMO3': '0.233', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.582', 'ARMOR': '1.200', 'WEAPON3': '1.400', 'HITCOUNT': '2.040', 'weapon3': '2.804', 'DAMAGECOUNT': '9.288', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:34,889][52811] DAMAGECOUNT value on done: 53140.0 [2024-08-05 23:46:34,890][52811] Sum rewards: 37.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.214', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.144', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'AMMO4': '0.290', 'weapon4': '0.470', 'WEAPON4': '0.500', 'ARMOR': '0.820', 'WEAPON3': '0.950', 'weapon2': '0.974', 'weapon3': '2.146', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.491', 'FRAGCOUNT': '31.000'} [2024-08-05 23:46:36,098][52659] DAMAGECOUNT value on done: 52877.0 [2024-08-05 23:46:36,098][52659] Sum rewards: 40.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.195', 'ARMOR': '0.423', 'weapon2': '0.492', 'weapon4': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '2.752', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '35.000'} [2024-08-05 23:46:36,215][52795] DAMAGECOUNT value on done: 51075.0 [2024-08-05 23:46:36,216][52795] Sum rewards: 38.049, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.019', 'HEALTH': '0.042', 'AMMO4': '0.093', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'ARMOR': '0.400', 'weapon2': '0.986', 'WEAPON3': '1.000', 'HITCOUNT': '2.490', 'weapon3': '2.718', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:36,546][52649] DAMAGECOUNT value on done: 51297.0 [2024-08-05 23:46:36,548][52649] Sum rewards: 34.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.969', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.047', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.231', 'AMMO4': '0.236', 'ARMOR': '0.448', 'WEAPON4': '0.450', 'weapon2': '1.132', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.424', 'DAMAGECOUNT': '9.057', 'FRAGCOUNT': '33.000'} [2024-08-05 23:46:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 143687680. Throughput: 0: 4400.9. Samples: 35925110. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:46:37,794][52567] Avg episode reward: [(0, '39.575')] [2024-08-05 23:46:38,059][52811] DAMAGECOUNT value on done: 48231.0 [2024-08-05 23:46:38,059][52811] Sum rewards: 45.809, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.056', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.030', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.578', 'WEAPON3': '0.700', 'weapon2': '0.902', 'weapon3': '2.350', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.235', 'FRAGCOUNT': '35.000'} [2024-08-05 23:46:38,346][52650] Updated weights for policy 0, policy_version 17541 (0.0013) [2024-08-05 23:46:38,850][52659] DAMAGECOUNT value on done: 55848.0 [2024-08-05 23:46:38,859][52659] Sum rewards: 40.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.747', 'AMMO5': '0.007', 'ARMOR': '0.020', 'weapon5': '0.032', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.185', 'WEAPON4': '0.400', 'weapon4': '0.414', 'weapon2': '0.560', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '2.734', 'DAMAGECOUNT': '11.445', 'FRAGCOUNT': '36.000'} [2024-08-05 23:46:38,959][52662] DAMAGECOUNT value on done: 59332.0 [2024-08-05 23:46:38,961][52662] Sum rewards: 54.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.108', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.280', 'ARMOR': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.350', 'weapon3': '2.832', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '49.000'} [2024-08-05 23:46:39,315][52795] DAMAGECOUNT value on done: 47011.0 [2024-08-05 23:46:39,315][52795] Sum rewards: 39.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.752', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.036', 'weapon4': '0.048', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.600', 'ARMOR': '0.918', 'WEAPON3': '1.350', 'HITCOUNT': '2.310', 'weapon3': '3.086', 'DAMAGECOUNT': '10.659', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:39,710][52649] DAMAGECOUNT value on done: 49422.0 [2024-08-05 23:46:39,711][52649] Sum rewards: 35.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.778', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.171', 'weapon4': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon2': '1.376', 'ARMOR': '1.385', 'weapon3': '2.118', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '9.309', 'FRAGCOUNT': '29.000'} [2024-08-05 23:46:41,116][52811] DAMAGECOUNT value on done: 49995.0 [2024-08-05 23:46:41,118][52811] Sum rewards: 49.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.986', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.197', 'ARMOR': '0.400', 'weapon2': '1.138', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '42.000'} [2024-08-05 23:46:41,587][52668] DAMAGECOUNT value on done: 53354.0 [2024-08-05 23:46:41,587][52668] Sum rewards: 38.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.617', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.227', 'weapon4': '0.252', 'WEAPON4': '0.300', 'ARMOR': '0.816', 'weapon2': '0.828', 'WEAPON3': '1.350', 'HITCOUNT': '2.440', 'weapon3': '2.608', 'DAMAGECOUNT': '10.020', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:42,190][52662] DAMAGECOUNT value on done: 60886.0 [2024-08-05 23:46:42,190][52662] Sum rewards: 55.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.838', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.022', 'AMMO4': '0.060', 'weapon4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon2': '0.662', 'ARMOR': '1.253', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.052', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '48.500'} [2024-08-05 23:46:42,468][52795] DAMAGECOUNT value on done: 48242.0 [2024-08-05 23:46:42,469][52795] Sum rewards: 39.354, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.006', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.023', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'ARMOR': '0.454', 'weapon2': '0.930', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.838', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '31.000'} [2024-08-05 23:46:42,547][52664] DAMAGECOUNT value on done: 55271.0 [2024-08-05 23:46:42,548][52664] Sum rewards: 47.311, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon2': '0.724', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '2.950', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '38.000'} [2024-08-05 23:46:42,776][52649] DAMAGECOUNT value on done: 54083.0 [2024-08-05 23:46:42,779][52649] Sum rewards: 38.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.586', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon4': '0.154', 'AMMO4': '0.159', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.722', 'WEAPON3': '1.250', 'ARMOR': '1.254', 'HITCOUNT': '2.420', 'weapon3': '2.960', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:42,796][52567] Fps is (10 sec: 18018.9, 60 sec: 17612.2, 300 sec: 17605.7). Total num frames: 143769600. Throughput: 0: 4404.3. Samples: 35951510. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:46:42,796][52567] Avg episode reward: [(0, '40.169')] [2024-08-05 23:46:42,970][52650] Updated weights for policy 0, policy_version 17551 (0.0024) [2024-08-05 23:46:43,360][52794] DAMAGECOUNT value on done: 59360.0 [2024-08-05 23:46:43,360][52794] Sum rewards: 44.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.760', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.046', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.782', 'WEAPON3': '1.350', 'HITCOUNT': '2.500', 'weapon3': '2.916', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '38.000'} [2024-08-05 23:46:44,267][52668] DAMAGECOUNT value on done: 57228.0 [2024-08-05 23:46:44,275][52668] Sum rewards: 36.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.023', 'AMMO5': '0.005', 'AMMO2': '0.065', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'AMMO4': '0.324', 'weapon4': '0.524', 'WEAPON4': '0.650', 'weapon2': '0.826', 'ARMOR': '0.848', 'WEAPON3': '1.200', 'weapon3': '2.260', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.564', 'FRAGCOUNT': '33.000'} [2024-08-05 23:46:44,985][52662] DAMAGECOUNT value on done: 61838.0 [2024-08-05 23:46:44,987][52662] Sum rewards: 49.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.231', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.364', 'weapon2': '0.542', 'ARMOR': '0.804', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '42.000'} [2024-08-05 23:46:45,161][52664] DAMAGECOUNT value on done: 56172.0 [2024-08-05 23:46:45,161][52664] Sum rewards: 47.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.708', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.080', 'AMMO3': '0.139', 'AMMO4': '0.276', 'weapon4': '0.298', 'WEAPON5': '0.300', 'ARMOR': '0.485', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon2': '1.004', 'weapon3': '2.410', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '41.000'} [2024-08-05 23:46:45,573][52795] DAMAGECOUNT value on done: 50717.0 [2024-08-05 23:46:45,573][52795] Sum rewards: 36.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.048', 'AMMO3': '0.211', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.420', 'ARMOR': '0.500', 'weapon2': '0.506', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '2.696', 'DAMAGECOUNT': '10.173', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:45,899][52649] DAMAGECOUNT value on done: 50035.0 [2024-08-05 23:46:45,900][52649] Sum rewards: 45.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.241', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.074', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.752', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.844', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '39.000'} [2024-08-05 23:46:46,077][52794] DAMAGECOUNT value on done: 58832.0 [2024-08-05 23:46:46,078][52794] Sum rewards: 36.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon5': '0.142', 'AMMO3': '0.228', 'AMMO4': '0.230', 'weapon4': '0.230', 'ARMOR': '0.416', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.140', 'weapon3': '2.848', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:47,263][52668] DAMAGECOUNT value on done: 51553.0 [2024-08-05 23:46:47,265][52668] Sum rewards: 41.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.916', 'AMMO5': '0.006', 'ARMOR': '0.036', 'AMMO2': '0.047', 'weapon7': '0.048', 'weapon5': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.215', 'AMMO4': '0.234', 'weapon4': '0.470', 'weapon2': '0.478', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.354', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '37.500'} [2024-08-05 23:46:47,601][52664] DAMAGECOUNT value on done: 57055.0 [2024-08-05 23:46:47,601][52664] Sum rewards: 38.737, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.659', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.236', 'weapon2': '0.772', 'WEAPON3': '1.450', 'ARMOR': '1.770', 'HITCOUNT': '2.740', 'weapon3': '2.876', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '35.000'} [2024-08-05 23:46:47,685][52650] Updated weights for policy 0, policy_version 17561 (0.0025) [2024-08-05 23:46:47,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 143859712. Throughput: 0: 4403.7. Samples: 35964830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:46:47,795][52567] Avg episode reward: [(0, '40.206')] [2024-08-05 23:46:47,825][52662] DAMAGECOUNT value on done: 55466.0 [2024-08-05 23:46:47,825][52662] Sum rewards: 45.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.032', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.452', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.718', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:48,745][52795] DAMAGECOUNT value on done: 52753.0 [2024-08-05 23:46:48,746][52795] Sum rewards: 37.588, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.426', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.184', 'AMMO4': '0.218', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon4': '0.252', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'weapon2': '0.516', 'WEAPON3': '1.500', 'HITCOUNT': '2.260', 'weapon3': '2.702', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '35.000'} [2024-08-05 23:46:48,958][52794] DAMAGECOUNT value on done: 57932.0 [2024-08-05 23:46:48,960][52794] Sum rewards: 32.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.225', 'AMMO5': '0.022', 'ARMOR': '0.040', 'AMMO2': '0.063', 'weapon5': '0.078', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'AMMO4': '0.314', 'weapon4': '0.366', 'weapon2': '0.554', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.130', 'weapon3': '2.688', 'DAMAGECOUNT': '8.841', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:48,966][52649] DAMAGECOUNT value on done: 50750.0 [2024-08-05 23:46:48,967][52649] Sum rewards: 40.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.595', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.126', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.518', 'weapon4': '0.726', 'WEAPON3': '1.050', 'weapon3': '2.352', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '33.000'} [2024-08-05 23:46:49,544][52614] Signal inference workers to stop experience collection... (3250 times) [2024-08-05 23:46:49,550][52614] Signal inference workers to resume experience collection... (3250 times) [2024-08-05 23:46:49,605][52650] InferenceWorker_p0-w0: stopping experience collection (3250 times) [2024-08-05 23:46:49,605][52650] InferenceWorker_p0-w0: resuming experience collection (3250 times) [2024-08-05 23:46:49,891][52668] DAMAGECOUNT value on done: 53610.0 [2024-08-05 23:46:49,891][52668] Sum rewards: 41.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.608', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.304', 'ARMOR': '0.460', 'weapon2': '0.638', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.882', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '36.000'} [2024-08-05 23:46:50,390][52664] DAMAGECOUNT value on done: 56139.0 [2024-08-05 23:46:50,390][52664] Sum rewards: 41.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.117', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.172', 'weapon4': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.878', 'WEAPON3': '1.050', 'weapon2': '1.206', 'weapon3': '2.434', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:50,574][52662] DAMAGECOUNT value on done: 57294.0 [2024-08-05 23:46:50,574][52662] Sum rewards: 49.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.446', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.180', 'weapon5': '0.190', 'weapon4': '0.336', 'WEAPON4': '0.350', 'ARMOR': '0.444', 'weapon2': '0.870', 'WEAPON3': '1.150', 'weapon3': '2.302', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '42.000'} [2024-08-05 23:46:51,686][52794] DAMAGECOUNT value on done: 54303.0 [2024-08-05 23:46:51,687][52794] Sum rewards: 41.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.022', 'weapon5': '0.048', 'weapon4': '0.078', 'AMMO4': '0.110', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '3.198', 'DAMAGECOUNT': '11.349', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:51,831][52795] DAMAGECOUNT value on done: 51005.0 [2024-08-05 23:46:51,832][52795] Sum rewards: 29.363, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.012', 'weapon5': '0.024', 'AMMO2': '0.038', 'weapon4': '0.140', 'AMMO4': '0.188', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon2': '0.836', 'WEAPON3': '1.350', 'HITCOUNT': '2.010', 'weapon3': '2.742', 'DAMAGECOUNT': '8.736', 'FRAGCOUNT': '29.000'} [2024-08-05 23:46:51,926][52660] DAMAGECOUNT value on done: 54630.0 [2024-08-05 23:46:51,926][52660] Sum rewards: 31.289, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.896', 'WEAPON3': '1.300', 'HITCOUNT': '2.210', 'weapon3': '2.794', 'DAMAGECOUNT': '9.546', 'FRAGCOUNT': '27.000'} [2024-08-05 23:46:52,026][52649] DAMAGECOUNT value on done: 53260.0 [2024-08-05 23:46:52,028][52649] Sum rewards: 33.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.814', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'ARMOR': '0.524', 'weapon4': '0.570', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '2.436', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.596', 'FRAGCOUNT': '31.000'} [2024-08-05 23:46:52,135][52650] Updated weights for policy 0, policy_version 17571 (0.0012) [2024-08-05 23:46:52,794][52567] Fps is (10 sec: 18844.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 143958016. Throughput: 0: 4399.1. Samples: 35991230. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-05 23:46:52,795][52567] Avg episode reward: [(0, '39.979')] [2024-08-05 23:46:53,062][52668] DAMAGECOUNT value on done: 54131.0 [2024-08-05 23:46:53,064][52668] Sum rewards: 35.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.842', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.746', 'WEAPON3': '1.200', 'ARMOR': '1.313', 'HITCOUNT': '2.270', 'weapon3': '2.618', 'DAMAGECOUNT': '9.282', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:53,071][52664] DAMAGECOUNT value on done: 54037.0 [2024-08-05 23:46:53,071][52664] Sum rewards: 41.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'ARMOR': '0.400', 'weapon2': '0.748', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.076', 'DAMAGECOUNT': '10.923', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:53,567][52662] DAMAGECOUNT value on done: 58841.0 [2024-08-05 23:46:53,567][52662] Sum rewards: 32.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.556', 'AMMO5': '0.025', 'AMMO2': '0.054', 'weapon5': '0.106', 'AMMO3': '0.214', 'AMMO4': '0.270', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON4': '0.700', 'ARMOR': '0.852', 'weapon2': '0.868', 'WEAPON3': '1.350', 'HITCOUNT': '2.180', 'weapon3': '2.246', 'DAMAGECOUNT': '9.378', 'FRAGCOUNT': '31.000'} [2024-08-05 23:46:54,244][52671] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:46:54,299][52649] DAMAGECOUNT value on done: 53832.0 [2024-08-05 23:46:54,299][52649] Sum rewards: 36.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.198', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.033', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.758', 'ARMOR': '0.855', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.898', 'DAMAGECOUNT': '10.176', 'FRAGCOUNT': '33.000'} [2024-08-05 23:46:54,536][52794] DAMAGECOUNT value on done: 56524.0 [2024-08-05 23:46:54,537][52794] Sum rewards: 38.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'weapon4': '0.732', 'WEAPON3': '0.900', 'ARMOR': '0.937', 'weapon2': '1.008', 'weapon3': '2.066', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '8.925', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:54,549][52660] DAMAGECOUNT value on done: 56854.0 [2024-08-05 23:46:54,549][52660] Sum rewards: 43.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.072', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.690', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.910', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '38.000'} [2024-08-05 23:46:54,951][52795] DAMAGECOUNT value on done: 53348.0 [2024-08-05 23:46:54,952][52795] Sum rewards: 35.830, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.244', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.172', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.880', 'weapon2': '1.004', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '2.626', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '32.000'} [2024-08-05 23:46:55,707][52811] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:46:55,818][52668] DAMAGECOUNT value on done: 55960.0 [2024-08-05 23:46:55,818][52668] Sum rewards: 37.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.080', 'AMMO3': '0.134', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'ARMOR': '0.448', 'weapon4': '0.464', 'WEAPON4': '0.550', 'weapon2': '0.716', 'WEAPON3': '0.850', 'weapon3': '2.498', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.911', 'FRAGCOUNT': '31.000'} [2024-08-05 23:46:56,001][52664] DAMAGECOUNT value on done: 59237.0 [2024-08-05 23:46:56,003][52664] Sum rewards: 42.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.152', 'AMMO5': '0.006', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.057', 'weapon5': '0.134', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'weapon2': '0.746', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '2.592', 'DAMAGECOUNT': '10.563', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:56,354][52662] DAMAGECOUNT value on done: 60313.0 [2024-08-05 23:46:56,356][52662] Sum rewards: 38.439, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.262', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.092', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.142', 'ARMOR': '1.258', 'HITCOUNT': '2.180', 'weapon3': '2.414', 'DAMAGECOUNT': '9.267', 'FRAGCOUNT': '31.500'} [2024-08-05 23:46:56,909][52650] Updated weights for policy 0, policy_version 17581 (0.0028) [2024-08-05 23:46:57,195][52649] DAMAGECOUNT value on done: 54600.0 [2024-08-05 23:46:57,195][52649] Sum rewards: 36.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.088', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.072', 'AMMO3': '0.180', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON4': '0.350', 'weapon2': '1.062', 'WEAPON3': '1.100', 'ARMOR': '1.671', 'weapon3': '2.464', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '9.426', 'FRAGCOUNT': '31.000'} [2024-08-05 23:46:57,357][52666] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:46:57,565][52794] DAMAGECOUNT value on done: 59653.0 [2024-08-05 23:46:57,568][52794] Sum rewards: 36.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.786', 'AMMO5': '0.012', 'AMMO2': '0.031', 'ARMOR': '0.032', 'weapon5': '0.044', 'weapon4': '0.094', 'AMMO4': '0.155', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.650', 'HITCOUNT': '2.420', 'weapon3': '3.008', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '34.000'} [2024-08-05 23:46:57,644][52660] DAMAGECOUNT value on done: 54694.0 [2024-08-05 23:46:57,645][52660] Sum rewards: 42.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.557', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.094', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.300', 'ARMOR': '0.487', 'weapon2': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:57,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 144039936. Throughput: 0: 4394.0. Samples: 36017440. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-05 23:46:57,795][52567] Avg episode reward: [(0, '39.497')] [2024-08-05 23:46:58,043][52795] DAMAGECOUNT value on done: 50002.0 [2024-08-05 23:46:58,045][52795] Sum rewards: 30.518, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.838', 'AMMO5': '0.012', 'weapon5': '0.038', 'AMMO2': '0.052', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon4': '0.384', 'WEAPON4': '0.650', 'ARMOR': '0.940', 'weapon2': '0.980', 'WEAPON3': '1.400', 'HITCOUNT': '2.200', 'weapon3': '2.330', 'DAMAGECOUNT': '9.870', 'FRAGCOUNT': '29.500'} [2024-08-05 23:46:58,574][52664] DAMAGECOUNT value on done: 55733.0 [2024-08-05 23:46:58,575][52664] Sum rewards: 25.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.308', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.024', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.186', 'WEAPON3': '1.150', 'weapon2': '1.584', 'HITCOUNT': '1.990', 'ARMOR': '2.105', 'weapon3': '2.110', 'DAMAGECOUNT': '8.109', 'FRAGCOUNT': '21.000'} [2024-08-05 23:46:58,928][52668] DAMAGECOUNT value on done: 55726.0 [2024-08-05 23:46:58,930][52668] Sum rewards: 42.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.668', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.167', 'weapon2': '0.418', 'ARMOR': '0.436', 'weapon4': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.866', 'DAMAGECOUNT': '10.974', 'FRAGCOUNT': '37.000'} [2024-08-05 23:46:59,632][52662] DAMAGECOUNT value on done: 63212.0 [2024-08-05 23:46:59,633][52662] Sum rewards: 41.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.472', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon2': '0.354', 'ARMOR': '0.412', 'weapon4': '0.512', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '2.818', 'DAMAGECOUNT': '11.763', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:00,246][52649] DAMAGECOUNT value on done: 53783.0 [2024-08-05 23:47:00,249][52649] Sum rewards: 45.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon4': '0.374', 'weapon2': '0.656', 'ARMOR': '0.850', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '38.000'} [2024-08-05 23:47:00,527][52660] DAMAGECOUNT value on done: 54759.0 [2024-08-05 23:47:00,528][52660] Sum rewards: 39.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.601', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.820', 'ARMOR': '0.854', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '2.896', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:00,712][52794] DAMAGECOUNT value on done: 59402.0 [2024-08-05 23:47:00,714][52794] Sum rewards: 31.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.066', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.190', 'weapon4': '0.306', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'weapon2': '0.716', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '2.734', 'DAMAGECOUNT': '9.771', 'FRAGCOUNT': '28.000'} [2024-08-05 23:47:01,013][52795] DAMAGECOUNT value on done: 46301.0 [2024-08-05 23:47:01,014][52795] Sum rewards: 21.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.014', 'weapon5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO3': '0.169', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'ARMOR': '0.920', 'WEAPON3': '1.050', 'weapon2': '1.198', 'HITCOUNT': '1.840', 'weapon3': '2.472', 'DAMAGECOUNT': '7.164', 'FRAGCOUNT': '19.500'} [2024-08-05 23:47:01,165][52664] DAMAGECOUNT value on done: 52302.0 [2024-08-05 23:47:01,166][52664] Sum rewards: 34.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.022', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.076', 'weapon4': '0.096', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'ARMOR': '0.808', 'weapon2': '0.924', 'WEAPON3': '1.400', 'HITCOUNT': '2.310', 'weapon3': '2.652', 'DAMAGECOUNT': '9.627', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:01,343][52650] Updated weights for policy 0, policy_version 17591 (0.0030) [2024-08-05 23:47:01,719][52668] DAMAGECOUNT value on done: 56451.0 [2024-08-05 23:47:01,720][52668] Sum rewards: 48.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.601', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.522', 'ARMOR': '0.860', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '3.144', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '41.000'} [2024-08-05 23:47:02,590][52662] DAMAGECOUNT value on done: 56140.0 [2024-08-05 23:47:02,592][52662] Sum rewards: 38.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.988', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.202', 'weapon4': '0.334', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '2.720', 'DAMAGECOUNT': '10.206', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:02,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 144121856. Throughput: 0: 4395.8. Samples: 36030740. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-05 23:47:02,794][52567] Avg episode reward: [(0, '39.314')] [2024-08-05 23:47:03,349][52649] DAMAGECOUNT value on done: 48705.0 [2024-08-05 23:47:03,351][52649] Sum rewards: 46.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.882', 'AMMO5': '0.007', 'AMMO2': '0.042', 'ARMOR': '0.056', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'AMMO4': '0.211', 'weapon4': '0.320', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '2.836', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '41.000'} [2024-08-05 23:47:03,533][52660] DAMAGECOUNT value on done: 50748.0 [2024-08-05 23:47:03,535][52660] Sum rewards: 40.060, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.064', 'AMMO3': '0.124', 'weapon4': '0.156', 'HEALTH': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'ARMOR': '0.808', 'weapon2': '0.898', 'HITCOUNT': '2.280', 'weapon3': '2.710', 'DAMAGECOUNT': '10.152', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:03,585][52664] DAMAGECOUNT value on done: 62132.0 [2024-08-05 23:47:03,593][52664] Sum rewards: 52.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.404', 'ARMOR': '0.936', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.030', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '45.000'} [2024-08-05 23:47:03,866][52794] DAMAGECOUNT value on done: 56620.0 [2024-08-05 23:47:03,870][52794] Sum rewards: 45.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon5': '0.186', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.364', 'weapon2': '0.896', 'ARMOR': '0.903', 'WEAPON3': '1.150', 'weapon3': '2.282', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '37.000'} [2024-08-05 23:47:03,966][52795] DAMAGECOUNT value on done: 50903.0 [2024-08-05 23:47:03,967][52795] Sum rewards: 45.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.032', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.155', 'AMMO4': '0.159', 'WEAPON4': '0.400', 'ARMOR': '0.459', 'weapon4': '0.588', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.380', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:04,775][52668] DAMAGECOUNT value on done: 54896.0 [2024-08-05 23:47:04,775][52668] Sum rewards: 47.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.212', 'ARMOR': '0.461', 'weapon2': '0.718', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.002', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '42.000'} [2024-08-05 23:47:05,734][52662] DAMAGECOUNT value on done: 59101.0 [2024-08-05 23:47:05,735][52662] Sum rewards: 39.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.213', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.178', 'weapon5': '0.182', 'AMMO4': '0.252', 'weapon4': '0.308', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.848', 'ARMOR': '0.914', 'WEAPON3': '1.200', 'weapon3': '2.390', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '33.500'} [2024-08-05 23:47:06,112][52650] Updated weights for policy 0, policy_version 17601 (0.0021) [2024-08-05 23:47:06,155][52664] DAMAGECOUNT value on done: 56736.0 [2024-08-05 23:47:06,156][52664] Sum rewards: 37.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.182', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.066', 'AMMO3': '0.167', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon4': '0.382', 'ARMOR': '0.446', 'WEAPON4': '0.600', 'weapon2': '0.808', 'WEAPON3': '1.050', 'weapon3': '2.376', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.503', 'FRAGCOUNT': '35.000'} [2024-08-05 23:47:06,442][52649] DAMAGECOUNT value on done: 56263.0 [2024-08-05 23:47:06,443][52649] Sum rewards: 40.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO3': '0.161', 'AMMO4': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.400', 'ARMOR': '0.458', 'weapon2': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.586', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:06,492][52660] DAMAGECOUNT value on done: 54650.0 [2024-08-05 23:47:06,493][52660] Sum rewards: 24.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO4': '0.211', 'AMMO3': '0.217', 'WEAPON4': '0.550', 'ARMOR': '0.911', 'weapon2': '1.076', 'WEAPON3': '1.350', 'HITCOUNT': '1.890', 'weapon3': '2.484', 'DAMAGECOUNT': '7.863', 'FRAGCOUNT': '24.000'} [2024-08-05 23:47:07,095][52795] DAMAGECOUNT value on done: 51108.0 [2024-08-05 23:47:07,096][52795] Sum rewards: 43.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.038', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.237', 'weapon2': '0.646', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '2.988', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '39.000'} [2024-08-05 23:47:07,262][52794] DAMAGECOUNT value on done: 58776.0 [2024-08-05 23:47:07,263][52794] Sum rewards: 54.078, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.234', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO4': '0.218', 'AMMO3': '0.260', 'WEAPON4': '0.500', 'weapon2': '0.714', 'ARMOR': '1.007', 'WEAPON3': '1.600', 'weapon3': '2.624', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '50.000'} [2024-08-05 23:47:07,402][52668] DAMAGECOUNT value on done: 56864.0 [2024-08-05 23:47:07,402][52668] Sum rewards: 36.050, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.648', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'ARMOR': '0.483', 'weapon4': '0.528', 'WEAPON3': '0.900', 'weapon2': '0.946', 'weapon3': '2.378', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 144220160. Throughput: 0: 4395.3. Samples: 36057170. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 23:47:07,795][52567] Avg episode reward: [(0, '39.642')] [2024-08-05 23:47:08,810][52664] DAMAGECOUNT value on done: 57990.0 [2024-08-05 23:47:08,812][52664] Sum rewards: 35.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.127', 'AMMO3': '0.150', 'weapon4': '0.234', 'WEAPON4': '0.250', 'ARMOR': '0.902', 'WEAPON3': '0.950', 'weapon2': '1.026', 'HITCOUNT': '2.240', 'weapon3': '2.470', 'DAMAGECOUNT': '8.610', 'FRAGCOUNT': '30.000'} [2024-08-05 23:47:09,040][52662] DAMAGECOUNT value on done: 57799.0 [2024-08-05 23:47:09,041][52662] Sum rewards: 30.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.062', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO4': '0.198', 'AMMO3': '0.252', 'WEAPON4': '0.450', 'weapon2': '0.760', 'ARMOR': '1.288', 'WEAPON3': '1.550', 'HITCOUNT': '2.440', 'weapon3': '2.638', 'DAMAGECOUNT': '9.816', 'FRAGCOUNT': '26.000'} [2024-08-05 23:47:09,156][52649] DAMAGECOUNT value on done: 50790.0 [2024-08-05 23:47:09,156][52649] Sum rewards: 49.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.476', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.030', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon4': '0.274', 'ARMOR': '0.447', 'weapon2': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '40.000'} [2024-08-05 23:47:09,157][52660] DAMAGECOUNT value on done: 55396.0 [2024-08-05 23:47:09,159][52660] Sum rewards: 37.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.286', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.074', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.642', 'WEAPON3': '1.300', 'HITCOUNT': '2.260', 'weapon3': '3.072', 'DAMAGECOUNT': '10.029', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:10,132][52668] DAMAGECOUNT value on done: 53305.0 [2024-08-05 23:47:10,132][52668] Sum rewards: 36.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.022', 'ARMOR': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.109', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.350', 'HITCOUNT': '2.490', 'weapon3': '3.118', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:10,238][52795] DAMAGECOUNT value on done: 48653.0 [2024-08-05 23:47:10,239][52795] Sum rewards: 33.077, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.196', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'ARMOR': '0.479', 'weapon2': '0.856', 'WEAPON3': '1.750', 'HITCOUNT': '2.420', 'weapon3': '2.874', 'DAMAGECOUNT': '9.723', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:10,319][52794] DAMAGECOUNT value on done: 60362.0 [2024-08-05 23:47:10,321][52794] Sum rewards: 30.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.142', 'AMMO3': '0.166', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.890', 'WEAPON3': '1.000', 'HITCOUNT': '2.120', 'weapon3': '2.550', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '25.500'} [2024-08-05 23:47:10,731][52650] Updated weights for policy 0, policy_version 17611 (0.0013) [2024-08-05 23:47:11,600][52664] DAMAGECOUNT value on done: 55226.0 [2024-08-05 23:47:11,600][52664] Sum rewards: 41.157, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.655', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.300', 'ARMOR': '0.485', 'weapon4': '0.488', 'weapon2': '0.798', 'WEAPON3': '0.850', 'HITCOUNT': '2.190', 'weapon3': '2.442', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:11,676][52660] DAMAGECOUNT value on done: 53997.0 [2024-08-05 23:47:11,677][52660] Sum rewards: 33.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.826', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.494', 'weapon2': '0.722', 'ARMOR': '0.940', 'WEAPON3': '1.200', 'HITCOUNT': '1.910', 'weapon3': '2.406', 'DAMAGECOUNT': '8.547', 'FRAGCOUNT': '30.000'} [2024-08-05 23:47:12,046][52662] DAMAGECOUNT value on done: 58862.0 [2024-08-05 23:47:12,048][52662] Sum rewards: 45.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.384', 'ARMOR': '0.412', 'weapon4': '0.420', 'WEAPON3': '1.350', 'HITCOUNT': '2.360', 'weapon3': '2.894', 'DAMAGECOUNT': '10.941', 'FRAGCOUNT': '41.000'} [2024-08-05 23:47:12,278][52649] DAMAGECOUNT value on done: 54270.0 [2024-08-05 23:47:12,279][52649] Sum rewards: 42.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.234', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.788', 'WEAPON3': '1.300', 'ARMOR': '1.319', 'HITCOUNT': '2.530', 'weapon3': '2.772', 'DAMAGECOUNT': '11.067', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:12,782][52668] DAMAGECOUNT value on done: 54060.0 [2024-08-05 23:47:12,782][52668] Sum rewards: 42.068, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-2.185', 'AMMO4': '-0.062', 'AMMO2': '-0.012', 'AMMO3': '0.105', 'WEAPON3': '0.850', 'ARMOR': '0.906', 'weapon2': '1.592', 'weapon3': '2.334', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '9.930', 'FRAGCOUNT': '32.000'} [2024-08-05 23:47:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 144302080. Throughput: 0: 4391.6. Samples: 36083270. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-05 23:47:12,794][52567] Avg episode reward: [(0, '39.668')] [2024-08-05 23:47:12,995][52794] DAMAGECOUNT value on done: 60096.0 [2024-08-05 23:47:12,995][52794] Sum rewards: 36.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.971', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.110', 'AMMO4': '0.201', 'AMMO3': '0.219', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.718', 'WEAPON3': '1.350', 'ARMOR': '1.435', 'HITCOUNT': '2.350', 'weapon3': '2.508', 'DAMAGECOUNT': '9.870', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:13,372][52795] DAMAGECOUNT value on done: 51731.0 [2024-08-05 23:47:13,373][52795] Sum rewards: 42.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.138', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.056', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.750', 'WEAPON3': '1.500', 'HITCOUNT': '2.510', 'weapon3': '2.922', 'DAMAGECOUNT': '11.676', 'FRAGCOUNT': '39.000'} [2024-08-05 23:47:14,301][52664] DAMAGECOUNT value on done: 56162.0 [2024-08-05 23:47:14,308][52664] Sum rewards: 40.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.951', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO4': '0.043', 'weapon4': '0.118', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.858', 'weapon2': '0.874', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.792', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '35.000'} [2024-08-05 23:47:14,648][52662] DAMAGECOUNT value on done: 60050.0 [2024-08-05 23:47:14,648][52662] Sum rewards: 37.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'weapon4': '0.192', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.682', 'ARMOR': '0.878', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.930', 'DAMAGECOUNT': '9.408', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:14,896][52660] DAMAGECOUNT value on done: 55474.0 [2024-08-05 23:47:14,896][52660] Sum rewards: 46.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.603', 'AMMO5': '0.013', 'weapon5': '0.034', 'ARMOR': '0.044', 'AMMO2': '0.056', 'weapon4': '0.150', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'WEAPON4': '0.600', 'weapon2': '0.652', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.896', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '41.000'} [2024-08-05 23:47:15,117][52649] DAMAGECOUNT value on done: 53442.0 [2024-08-05 23:47:15,118][52649] Sum rewards: 40.875, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.824', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.114', 'weapon5': '0.122', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.500', 'weapon4': '0.714', 'weapon2': '0.742', 'WEAPON3': '0.800', 'weapon3': '2.186', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.839', 'FRAGCOUNT': '33.500'} [2024-08-05 23:47:15,518][52650] Updated weights for policy 0, policy_version 17621 (0.0014) [2024-08-05 23:47:15,635][52794] DAMAGECOUNT value on done: 60392.0 [2024-08-05 23:47:15,635][52794] Sum rewards: 46.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.477', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.080', 'AMMO4': '0.110', 'weapon5': '0.110', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '3.070', 'DAMAGECOUNT': '11.538', 'FRAGCOUNT': '40.500'} [2024-08-05 23:47:16,054][52668] DAMAGECOUNT value on done: 50885.0 [2024-08-05 23:47:16,054][52668] Sum rewards: 44.085, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.245', 'AMMO5': '0.021', 'AMMO2': '0.032', 'AMMO3': '0.118', 'AMMO4': '0.161', 'weapon4': '0.168', 'weapon5': '0.234', 'WEAPON4': '0.350', 'ARMOR': '0.433', 'WEAPON5': '0.450', 'weapon2': '0.718', 'WEAPON3': '0.800', 'weapon3': '2.620', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.584', 'FRAGCOUNT': '35.000'} [2024-08-05 23:47:16,479][52795] DAMAGECOUNT value on done: 52273.0 [2024-08-05 23:47:16,480][52795] Sum rewards: 44.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.308', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.105', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'ARMOR': '0.436', 'weapon2': '0.866', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.840', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '38.000'} [2024-08-05 23:47:17,262][52662] DAMAGECOUNT value on done: 57985.0 [2024-08-05 23:47:17,263][52662] Sum rewards: 35.245, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.888', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.115', 'AMMO4': '0.135', 'weapon4': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'ARMOR': '0.800', 'weapon2': '1.014', 'HITCOUNT': '1.960', 'weapon3': '2.374', 'DAMAGECOUNT': '9.234', 'FRAGCOUNT': '27.000'} [2024-08-05 23:47:17,434][52664] DAMAGECOUNT value on done: 55766.0 [2024-08-05 23:47:17,434][52664] Sum rewards: 47.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.518', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon4': '0.180', 'AMMO4': '0.197', 'AMMO3': '0.201', 'WEAPON4': '0.450', 'weapon2': '0.822', 'WEAPON3': '1.250', 'ARMOR': '1.794', 'HITCOUNT': '2.740', 'weapon3': '2.792', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '40.000'} [2024-08-05 23:47:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 144392192. Throughput: 0: 4404.4. Samples: 36096560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:47:17,794][52567] Avg episode reward: [(0, '39.940')] [2024-08-05 23:47:18,037][52660] DAMAGECOUNT value on done: 54345.0 [2024-08-05 23:47:18,038][52660] Sum rewards: 29.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.666', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.118', 'weapon5': '0.146', 'AMMO4': '0.168', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.402', 'ARMOR': '0.488', 'WEAPON3': '0.700', 'weapon2': '0.842', 'HITCOUNT': '2.070', 'weapon3': '2.356', 'DAMAGECOUNT': '9.039', 'FRAGCOUNT': '24.000'} [2024-08-05 23:47:18,146][52649] DAMAGECOUNT value on done: 56961.0 [2024-08-05 23:47:18,150][52649] Sum rewards: 42.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.706', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.148', 'AMMO3': '0.157', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.460', 'weapon2': '0.764', 'WEAPON3': '0.950', 'ARMOR': '1.299', 'weapon3': '2.498', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.446', 'FRAGCOUNT': '32.000'} [2024-08-05 23:47:18,498][52794] DAMAGECOUNT value on done: 58189.0 [2024-08-05 23:47:18,501][52794] Sum rewards: 37.750, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.688', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.122', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'weapon2': '0.784', 'WEAPON3': '1.400', 'HITCOUNT': '2.460', 'weapon3': '2.680', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:19,134][52668] DAMAGECOUNT value on done: 54511.0 [2024-08-05 23:47:19,135][52668] Sum rewards: 34.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.848', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.120', 'weapon5': '0.164', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.896', 'ARMOR': '1.345', 'HITCOUNT': '2.160', 'weapon3': '2.274', 'DAMAGECOUNT': '9.327', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:19,744][52795] DAMAGECOUNT value on done: 48842.0 [2024-08-05 23:47:19,745][52795] Sum rewards: 31.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.148', 'AMMO2': '0.029', 'weapon4': '0.138', 'AMMO4': '0.144', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.812', 'ARMOR': '0.909', 'WEAPON3': '1.400', 'HITCOUNT': '1.990', 'weapon3': '2.802', 'DAMAGECOUNT': '8.925', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:20,088][52650] Updated weights for policy 0, policy_version 17631 (0.0012) [2024-08-05 23:47:20,109][52664] DAMAGECOUNT value on done: 58871.0 [2024-08-05 23:47:20,110][52664] Sum rewards: 34.713, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.454', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'ARMOR': '0.916', 'weapon2': '0.958', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.714', 'DAMAGECOUNT': '9.819', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:20,414][52662] DAMAGECOUNT value on done: 58109.0 [2024-08-05 23:47:20,415][52662] Sum rewards: 30.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'ARMOR': '0.004', 'AMMO2': '0.042', 'weapon4': '0.160', 'AMMO3': '0.205', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.696', 'WEAPON3': '1.300', 'HITCOUNT': '2.290', 'weapon3': '2.966', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '28.000'} [2024-08-05 23:47:20,500][52660] DAMAGECOUNT value on done: 53538.0 [2024-08-05 23:47:20,503][52660] Sum rewards: 34.675, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.682', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.068', 'weapon4': '0.120', 'AMMO3': '0.204', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.838', 'ARMOR': '0.916', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '2.694', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:21,433][52668] DAMAGECOUNT value on done: 53933.0 [2024-08-05 23:47:21,434][52668] Sum rewards: 47.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.052', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.554', 'ARMOR': '0.948', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '3.100', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '40.000'} [2024-08-05 23:47:21,680][52794] DAMAGECOUNT value on done: 64929.0 [2024-08-05 23:47:21,680][52794] Sum rewards: 60.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.305', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'ARMOR': '0.400', 'weapon2': '0.656', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '52.000'} [2024-08-05 23:47:22,527][52664] DAMAGECOUNT value on done: 53891.0 [2024-08-05 23:47:22,527][52664] Sum rewards: 22.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.169', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'ARMOR': '0.440', 'weapon2': '0.590', 'WEAPON3': '1.450', 'HITCOUNT': '1.740', 'weapon3': '3.126', 'DAMAGECOUNT': '7.080', 'FRAGCOUNT': '24.000'} [2024-08-05 23:47:22,794][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17605.8). Total num frames: 144474112. Throughput: 0: 4399.1. Samples: 36123070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:47:22,795][52567] Avg episode reward: [(0, '39.767')] [2024-08-05 23:47:22,892][52795] DAMAGECOUNT value on done: 53192.0 [2024-08-05 23:47:22,899][52795] Sum rewards: 34.913, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.209', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.750', 'ARMOR': '0.856', 'WEAPON3': '1.250', 'HITCOUNT': '2.260', 'weapon3': '2.542', 'DAMAGECOUNT': '9.738', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:23,408][52660] DAMAGECOUNT value on done: 53913.0 [2024-08-05 23:47:23,409][52660] Sum rewards: 43.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.656', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.162', 'weapon4': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.886', 'WEAPON3': '1.200', 'ARMOR': '1.340', 'HITCOUNT': '2.580', 'weapon3': '2.744', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '38.000'} [2024-08-05 23:47:23,547][52662] DAMAGECOUNT value on done: 60571.0 [2024-08-05 23:47:23,547][52662] Sum rewards: 33.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.415', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.104', 'weapon5': '0.110', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '1.010', 'WEAPON3': '1.150', 'HITCOUNT': '2.250', 'weapon3': '2.574', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:24,203][52668] DAMAGECOUNT value on done: 55124.0 [2024-08-05 23:47:24,203][52668] Sum rewards: 41.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'weapon7': '0.012', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.572', 'weapon4': '0.826', 'ARMOR': '0.993', 'WEAPON3': '1.150', 'weapon3': '2.210', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:24,765][52650] Updated weights for policy 0, policy_version 17641 (0.0022) [2024-08-05 23:47:24,774][52794] DAMAGECOUNT value on done: 57197.0 [2024-08-05 23:47:24,777][52794] Sum rewards: 33.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.298', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.036', 'AMMO4': '0.149', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.380', 'ARMOR': '0.522', 'weapon2': '1.100', 'WEAPON3': '1.200', 'weapon3': '2.274', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '9.582', 'FRAGCOUNT': '28.500'} [2024-08-05 23:47:25,683][52664] DAMAGECOUNT value on done: 57463.0 [2024-08-05 23:47:25,684][52664] Sum rewards: 39.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.616', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.130', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'weapon2': '0.646', 'WEAPON3': '1.400', 'HITCOUNT': '2.500', 'weapon3': '2.986', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '37.000'} [2024-08-05 23:47:25,908][52660] DAMAGECOUNT value on done: 52620.0 [2024-08-05 23:47:25,908][52660] Sum rewards: 39.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'ARMOR': '0.459', 'weapon4': '0.554', 'weapon2': '0.628', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '2.622', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:25,998][52795] DAMAGECOUNT value on done: 55263.0 [2024-08-05 23:47:25,998][52795] Sum rewards: 35.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.446', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.144', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.350', 'ARMOR': '0.930', 'weapon2': '1.060', 'WEAPON3': '1.250', 'weapon3': '2.236', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.219', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:26,761][52662] DAMAGECOUNT value on done: 55714.0 [2024-08-05 23:47:26,761][52662] Sum rewards: 27.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.566', 'AMMO5': '0.009', 'weapon5': '0.018', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'ARMOR': '0.844', 'weapon2': '0.928', 'WEAPON3': '1.350', 'HITCOUNT': '2.230', 'weapon3': '2.750', 'DAMAGECOUNT': '9.321', 'FRAGCOUNT': '24.500'} [2024-08-05 23:47:26,770][52668] DAMAGECOUNT value on done: 52882.0 [2024-08-05 23:47:26,771][52668] Sum rewards: 33.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.053', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.238', 'weapon4': '0.340', 'WEAPON4': '0.400', 'ARMOR': '0.474', 'weapon2': '0.846', 'WEAPON3': '1.350', 'HITCOUNT': '2.240', 'weapon3': '2.522', 'DAMAGECOUNT': '9.495', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:27,553][52669] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:47:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 144564224. Throughput: 0: 4398.9. Samples: 36149450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:47:27,794][52567] Avg episode reward: [(0, '38.962')] [2024-08-05 23:47:28,066][52794] DAMAGECOUNT value on done: 60743.0 [2024-08-05 23:47:28,066][52794] Sum rewards: 41.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.539', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.149', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'weapon4': '0.446', 'weapon2': '0.594', 'ARMOR': '0.876', 'WEAPON3': '1.600', 'weapon3': '2.690', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '37.000'} [2024-08-05 23:47:28,391][52660] DAMAGECOUNT value on done: 54922.0 [2024-08-05 23:47:28,391][52660] Sum rewards: 38.733, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.694', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.139', 'weapon4': '0.188', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon2': '0.566', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '2.808', 'DAMAGECOUNT': '10.893', 'FRAGCOUNT': '37.000'} [2024-08-05 23:47:28,669][52664] DAMAGECOUNT value on done: 54777.0 [2024-08-05 23:47:28,670][52664] Sum rewards: 40.059, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.792', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.157', 'ARMOR': '0.452', 'weapon2': '0.644', 'WEAPON3': '1.150', 'HITCOUNT': '2.350', 'weapon3': '3.150', 'DAMAGECOUNT': '9.546', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:29,119][52795] DAMAGECOUNT value on done: 49925.0 [2024-08-05 23:47:29,120][52795] Sum rewards: 42.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'ARMOR': '0.458', 'weapon2': '1.098', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '37.000'} [2024-08-05 23:47:29,470][52668] DAMAGECOUNT value on done: 52664.0 [2024-08-05 23:47:29,471][52668] Sum rewards: 42.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'ARMOR': '0.012', 'AMMO5': '0.026', 'AMMO2': '0.052', 'weapon5': '0.070', 'AMMO3': '0.132', 'AMMO4': '0.259', 'weapon4': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon2': '1.066', 'weapon3': '2.232', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:29,493][52650] Updated weights for policy 0, policy_version 17651 (0.0018) [2024-08-05 23:47:29,538][52662] DAMAGECOUNT value on done: 59915.0 [2024-08-05 23:47:29,541][52662] Sum rewards: 37.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.502', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.052', 'weapon5': '0.102', 'AMMO3': '0.157', 'AMMO4': '0.261', 'weapon4': '0.514', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.754', 'WEAPON3': '1.050', 'weapon3': '2.370', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:30,446][52794] DAMAGECOUNT value on done: 61538.0 [2024-08-05 23:47:30,454][52794] Sum rewards: 34.659, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.563', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.200', 'ARMOR': '0.459', 'weapon2': '0.828', 'WEAPON3': '1.000', 'HITCOUNT': '1.940', 'weapon3': '2.586', 'DAMAGECOUNT': '8.679', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:31,431][52660] DAMAGECOUNT value on done: 59131.0 [2024-08-05 23:47:31,434][52660] Sum rewards: 33.941, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.296', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.292', 'AMMO3': '0.307', 'weapon2': '0.638', 'ARMOR': '0.804', 'WEAPON3': '1.850', 'HITCOUNT': '2.480', 'weapon3': '2.720', 'DAMAGECOUNT': '10.215', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:31,559][52664] DAMAGECOUNT value on done: 56941.0 [2024-08-05 23:47:31,561][52664] Sum rewards: 36.711, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.170', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'ARMOR': '0.421', 'weapon4': '0.514', 'weapon2': '0.994', 'WEAPON3': '1.000', 'weapon3': '2.182', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '9.414', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:32,216][52662] DAMAGECOUNT value on done: 60022.0 [2024-08-05 23:47:32,216][52662] Sum rewards: 33.616, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.215', 'weapon4': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.792', 'ARMOR': '0.892', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.726', 'DAMAGECOUNT': '10.173', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:32,242][52795] DAMAGECOUNT value on done: 51004.0 [2024-08-05 23:47:32,243][52795] Sum rewards: 39.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.646', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'WEAPON3': '1.100', 'weapon2': '1.206', 'ARMOR': '1.256', 'HITCOUNT': '2.190', 'weapon3': '2.576', 'DAMAGECOUNT': '9.375', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:32,517][52668] DAMAGECOUNT value on done: 56423.0 [2024-08-05 23:47:32,519][52668] Sum rewards: 45.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.286', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.135', 'AMMO4': '0.208', 'weapon4': '0.214', 'ARMOR': '0.405', 'WEAPON4': '0.450', 'weapon2': '0.790', 'WEAPON3': '0.900', 'weapon3': '2.794', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '36.500'} [2024-08-05 23:47:32,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 144654336. Throughput: 0: 4391.8. Samples: 36162460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:47:32,794][52567] Avg episode reward: [(0, '38.745')] [2024-08-05 23:47:33,159][52669] DAMAGECOUNT value on done: 56277.0 [2024-08-05 23:47:33,160][52669] Sum rewards: 46.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.251', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.099', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.676', 'WEAPON3': '1.000', 'ARMOR': '1.295', 'weapon3': '2.574', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '38.000'} [2024-08-05 23:47:33,538][52794] DAMAGECOUNT value on done: 60329.0 [2024-08-05 23:47:33,538][52794] Sum rewards: 44.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.777', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.102', 'weapon4': '0.184', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.648', 'ARMOR': '0.862', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.862', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '39.000'} [2024-08-05 23:47:33,908][52650] Updated weights for policy 0, policy_version 17661 (0.0023) [2024-08-05 23:47:34,100][52664] DAMAGECOUNT value on done: 56128.0 [2024-08-05 23:47:34,100][52664] Sum rewards: 39.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.388', 'AMMO2': '0.031', 'ARMOR': '0.040', 'AMMO4': '0.157', 'AMMO3': '0.209', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.770', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.786', 'DAMAGECOUNT': '9.666', 'FRAGCOUNT': '37.000'} [2024-08-05 23:47:34,672][52660] DAMAGECOUNT value on done: 54090.0 [2024-08-05 23:47:34,675][52660] Sum rewards: 48.006, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.589', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.094', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.274', 'ARMOR': '0.465', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.918', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '40.000'} [2024-08-05 23:47:35,222][52795] DAMAGECOUNT value on done: 53615.0 [2024-08-05 23:47:35,223][52795] Sum rewards: 44.727, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.350', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.020', 'weapon5': '0.056', 'AMMO3': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.298', 'WEAPON3': '0.900', 'weapon2': '1.150', 'weapon3': '2.328', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.433', 'FRAGCOUNT': '35.000'} [2024-08-05 23:47:35,224][52662] DAMAGECOUNT value on done: 59072.0 [2024-08-05 23:47:35,226][52662] Sum rewards: 40.028, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.190', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.141', 'weapon4': '0.172', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.922', 'ARMOR': '0.934', 'WEAPON3': '0.950', 'HITCOUNT': '2.220', 'weapon3': '2.462', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:35,620][52668] DAMAGECOUNT value on done: 55688.0 [2024-08-05 23:47:35,623][52668] Sum rewards: 47.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.101', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'ARMOR': '0.440', 'weapon2': '0.740', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '40.000'} [2024-08-05 23:47:36,079][52669] DAMAGECOUNT value on done: 55652.0 [2024-08-05 23:47:36,079][52669] Sum rewards: 47.582, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.121', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.260', 'ARMOR': '0.416', 'WEAPON4': '0.500', 'weapon2': '0.516', 'weapon4': '0.546', 'WEAPON3': '0.850', 'weapon3': '2.724', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '39.000'} [2024-08-05 23:47:36,476][52794] DAMAGECOUNT value on done: 62301.0 [2024-08-05 23:47:36,477][52794] Sum rewards: 43.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon4': '0.372', 'WEAPON4': '0.450', 'weapon2': '0.490', 'ARMOR': '0.840', 'WEAPON3': '1.550', 'weapon3': '2.732', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '40.000'} [2024-08-05 23:47:37,204][52660] DAMAGECOUNT value on done: 54665.0 [2024-08-05 23:47:37,205][52660] Sum rewards: 38.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.696', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.458', 'weapon2': '0.676', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.522', 'DAMAGECOUNT': '9.900', 'FRAGCOUNT': '35.000'} [2024-08-05 23:47:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 144736256. Throughput: 0: 4395.6. Samples: 36189030. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:47:37,794][52567] Avg episode reward: [(0, '39.379')] [2024-08-05 23:47:38,605][52650] Updated weights for policy 0, policy_version 17671 (0.0013) [2024-08-05 23:47:38,986][52669] DAMAGECOUNT value on done: 54513.0 [2024-08-05 23:47:38,987][52669] Sum rewards: 33.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.230', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon7': '0.084', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.174', 'AMMO4': '0.178', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.744', 'WEAPON3': '1.200', 'HITCOUNT': '2.030', 'weapon3': '2.382', 'DAMAGECOUNT': '8.958', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:39,425][52647] DAMAGECOUNT value on done: 56780.0 [2024-08-05 23:47:39,425][52647] Sum rewards: 42.757, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.058', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.198', 'HEALTH': '0.212', 'WEAPON4': '0.350', 'weapon2': '0.866', 'WEAPON3': '1.050', 'ARMOR': '1.624', 'HITCOUNT': '2.330', 'weapon3': '2.706', 'DAMAGECOUNT': '10.368', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:39,589][52794] DAMAGECOUNT value on done: 59041.0 [2024-08-05 23:47:39,589][52794] Sum rewards: 32.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.226', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.126', 'AMMO4': '0.126', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.816', 'weapon2': '0.828', 'WEAPON3': '1.400', 'HITCOUNT': '2.370', 'weapon3': '2.712', 'DAMAGECOUNT': '9.792', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:40,281][52660] DAMAGECOUNT value on done: 54145.0 [2024-08-05 23:47:40,285][52660] Sum rewards: 31.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.792', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.177', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon2': '1.196', 'ARMOR': '1.260', 'HITCOUNT': '2.080', 'weapon3': '2.424', 'DAMAGECOUNT': '8.889', 'FRAGCOUNT': '27.000'} [2024-08-05 23:47:41,885][52669] DAMAGECOUNT value on done: 54956.0 [2024-08-05 23:47:41,886][52669] Sum rewards: 47.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.034', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.062', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.510', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.104', 'DAMAGECOUNT': '11.949', 'FRAGCOUNT': '39.000'} [2024-08-05 23:47:42,658][52647] DAMAGECOUNT value on done: 57420.0 [2024-08-05 23:47:42,658][52647] Sum rewards: 48.717, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.205', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.220', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'ARMOR': '0.477', 'weapon2': '0.698', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '44.000'} [2024-08-05 23:47:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17749.8, 300 sec: 17633.6). Total num frames: 144834560. Throughput: 0: 4400.0. Samples: 36215440. Policy #0 lag: (min: 2.0, avg: 3.9, max: 8.0) [2024-08-05 23:47:42,795][52567] Avg episode reward: [(0, '39.384')] [2024-08-05 23:47:43,304][52660] DAMAGECOUNT value on done: 56514.0 [2024-08-05 23:47:43,305][52660] Sum rewards: 35.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.084', 'AMMO3': '0.177', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'weapon4': '0.370', 'ARMOR': '0.520', 'WEAPON4': '0.550', 'weapon2': '0.604', 'WEAPON3': '1.150', 'HITCOUNT': '2.260', 'weapon3': '2.674', 'DAMAGECOUNT': '8.952', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:43,415][52650] Updated weights for policy 0, policy_version 17681 (0.0012) [2024-08-05 23:47:43,872][52667] DAMAGECOUNT value on done: 54919.0 [2024-08-05 23:47:43,873][52667] Sum rewards: 31.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.232', 'weapon4': '0.302', 'WEAPON4': '0.400', 'ARMOR': '0.467', 'weapon2': '0.628', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.852', 'DAMAGECOUNT': '10.179', 'FRAGCOUNT': '28.000'} [2024-08-05 23:47:44,827][52669] DAMAGECOUNT value on done: 56205.0 [2024-08-05 23:47:44,828][52669] Sum rewards: 40.105, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.554', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.266', 'WEAPON4': '0.300', 'AMMO3': '0.308', 'weapon2': '0.362', 'WEAPON3': '1.750', 'HITCOUNT': '2.780', 'weapon3': '3.008', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '40.000'} [2024-08-05 23:47:45,043][52647] DAMAGECOUNT value on done: 61608.0 [2024-08-05 23:47:45,048][52647] Sum rewards: 35.481, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.409', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.040', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.251', 'weapon4': '0.258', 'ARMOR': '0.481', 'WEAPON4': '0.500', 'weapon2': '0.816', 'WEAPON3': '1.600', 'weapon3': '2.574', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '37.000'} [2024-08-05 23:47:46,362][52667] DAMAGECOUNT value on done: 56890.0 [2024-08-05 23:47:46,363][52667] Sum rewards: 39.841, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.058', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.251', 'AMMO3': '0.263', 'weapon4': '0.396', 'ARMOR': '0.420', 'WEAPON4': '0.600', 'weapon2': '0.648', 'WEAPON3': '1.500', 'weapon3': '2.590', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '39.000'} [2024-08-05 23:47:46,399][52660] DAMAGECOUNT value on done: 55408.0 [2024-08-05 23:47:46,399][52660] Sum rewards: 49.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.177', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.050', 'weapon4': '0.110', 'AMMO4': '0.147', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.452', 'weapon2': '0.690', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.862', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '42.000'} [2024-08-05 23:47:47,603][52669] DAMAGECOUNT value on done: 56165.0 [2024-08-05 23:47:47,604][52669] Sum rewards: 43.368, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.207', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO3': '0.117', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.032', 'weapon3': '2.384', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.392', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:47,639][52647] DAMAGECOUNT value on done: 59542.0 [2024-08-05 23:47:47,640][52647] Sum rewards: 49.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.375', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'ARMOR': '0.454', 'weapon2': '0.570', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.126', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '43.000'} [2024-08-05 23:47:47,798][52567] Fps is (10 sec: 18014.7, 60 sec: 17611.6, 300 sec: 17605.6). Total num frames: 144916480. Throughput: 0: 4403.4. Samples: 36228910. Policy #0 lag: (min: 2.0, avg: 3.9, max: 8.0) [2024-08-05 23:47:47,799][52567] Avg episode reward: [(0, '39.670')] [2024-08-05 23:47:47,876][52650] Updated weights for policy 0, policy_version 17691 (0.0015) [2024-08-05 23:47:49,117][52667] DAMAGECOUNT value on done: 55420.0 [2024-08-05 23:47:49,117][52667] Sum rewards: 38.232, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.042', 'AMMO4': '0.177', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.402', 'ARMOR': '0.463', 'weapon2': '0.536', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '2.766', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '34.000'} [2024-08-05 23:47:50,000][52647] DAMAGECOUNT value on done: 60966.0 [2024-08-05 23:47:50,003][52647] Sum rewards: 47.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.878', 'ARMOR': '0.880', 'WEAPON3': '1.100', 'weapon3': '2.530', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '41.000'} [2024-08-05 23:47:50,278][52669] DAMAGECOUNT value on done: 56209.0 [2024-08-05 23:47:50,278][52669] Sum rewards: 34.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.188', 'AMMO5': '0.012', 'ARMOR': '0.017', 'weapon5': '0.056', 'AMMO2': '0.063', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.313', 'weapon4': '0.546', 'WEAPON4': '0.550', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.442', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.701', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:52,088][52667] DAMAGECOUNT value on done: 55745.0 [2024-08-05 23:47:52,088][52667] Sum rewards: 38.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.575', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.136', 'AMMO4': '0.195', 'weapon4': '0.240', 'weapon5': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.790', 'ARMOR': '0.848', 'WEAPON3': '0.900', 'HITCOUNT': '2.370', 'weapon3': '2.442', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '31.000'} [2024-08-05 23:47:52,784][52650] Updated weights for policy 0, policy_version 17701 (0.0023) [2024-08-05 23:47:52,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.4, 300 sec: 17605.9). Total num frames: 145006592. Throughput: 0: 4404.9. Samples: 36255390. Policy #0 lag: (min: 2.0, avg: 3.9, max: 8.0) [2024-08-05 23:47:52,795][52567] Avg episode reward: [(0, '39.883')] [2024-08-05 23:47:52,822][52647] DAMAGECOUNT value on done: 59449.0 [2024-08-05 23:47:52,824][52647] Sum rewards: 51.661, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.138', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.175', 'weapon2': '0.736', 'ARMOR': '0.855', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.122', 'DAMAGECOUNT': '11.616', 'FRAGCOUNT': '42.000'} [2024-08-05 23:47:53,212][52669] DAMAGECOUNT value on done: 54890.0 [2024-08-05 23:47:53,212][52669] Sum rewards: 34.234, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.268', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.166', 'ARMOR': '0.892', 'weapon2': '1.024', 'WEAPON3': '1.200', 'HITCOUNT': '2.360', 'weapon3': '2.780', 'DAMAGECOUNT': '9.621', 'FRAGCOUNT': '29.000'} [2024-08-05 23:47:54,959][52667] DAMAGECOUNT value on done: 58161.0 [2024-08-05 23:47:54,960][52667] Sum rewards: 41.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.088', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '1.028', 'WEAPON3': '1.550', 'ARMOR': '1.701', 'weapon3': '2.722', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:55,444][52647] DAMAGECOUNT value on done: 56559.0 [2024-08-05 23:47:55,445][52647] Sum rewards: 38.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.144', 'AMMO5': '0.012', 'ARMOR': '0.034', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.185', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.516', 'weapon4': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.364', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:56,292][52669] DAMAGECOUNT value on done: 55464.0 [2024-08-05 23:47:56,294][52669] Sum rewards: 38.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.241', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'ARMOR': '0.844', 'weapon2': '1.004', 'WEAPON3': '1.250', 'weapon3': '2.394', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.341', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:57,093][52650] Updated weights for policy 0, policy_version 17711 (0.0014) [2024-08-05 23:47:57,794][52567] Fps is (10 sec: 18030.1, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 145096704. Throughput: 0: 4413.3. Samples: 36281870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:47:57,794][52567] Avg episode reward: [(0, '39.858')] [2024-08-05 23:47:57,819][52667] DAMAGECOUNT value on done: 57791.0 [2024-08-05 23:47:57,820][52667] Sum rewards: 36.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.982', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'weapon4': '0.134', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'ARMOR': '0.493', 'weapon2': '0.504', 'WEAPON3': '1.550', 'HITCOUNT': '2.310', 'weapon3': '3.108', 'DAMAGECOUNT': '9.225', 'FRAGCOUNT': '36.000'} [2024-08-05 23:47:58,506][52647] DAMAGECOUNT value on done: 60484.0 [2024-08-05 23:47:58,507][52647] Sum rewards: 36.305, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.144', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.832', 'ARMOR': '0.880', 'WEAPON3': '1.200', 'HITCOUNT': '2.320', 'weapon3': '2.792', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '33.000'} [2024-08-05 23:47:58,966][52669] DAMAGECOUNT value on done: 53559.0 [2024-08-05 23:47:58,966][52669] Sum rewards: 36.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.986', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.064', 'AMMO3': '0.207', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.596', 'ARMOR': '0.894', 'WEAPON3': '1.300', 'HITCOUNT': '2.340', 'weapon3': '2.688', 'DAMAGECOUNT': '10.056', 'FRAGCOUNT': '32.000'} [2024-08-05 23:47:59,707][52820] DAMAGECOUNT value on done: 48713.0 [2024-08-05 23:47:59,707][52820] Sum rewards: 42.033, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.567', 'AMMO2': '0.024', 'weapon4': '0.106', 'AMMO4': '0.119', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'ARMOR': '0.408', 'WEAPON3': '0.900', 'weapon2': '1.030', 'HITCOUNT': '2.380', 'weapon3': '2.740', 'DAMAGECOUNT': '10.305', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:00,229][52665] DAMAGECOUNT value on done: 52912.0 [2024-08-05 23:48:00,230][52665] Sum rewards: 38.867, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.468', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.798', 'ARMOR': '0.816', 'WEAPON3': '0.950', 'HITCOUNT': '2.220', 'weapon3': '2.878', 'DAMAGECOUNT': '8.967', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:00,748][52667] DAMAGECOUNT value on done: 56387.0 [2024-08-05 23:48:00,749][52667] Sum rewards: 34.407, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.802', 'AMMO5': '0.004', 'AMMO2': '0.034', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.169', 'ARMOR': '0.420', 'WEAPON4': '0.500', 'weapon2': '0.626', 'weapon4': '0.672', 'WEAPON3': '0.750', 'HITCOUNT': '2.090', 'weapon3': '2.454', 'DAMAGECOUNT': '8.490', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:01,399][52647] DAMAGECOUNT value on done: 61920.0 [2024-08-05 23:48:01,399][52647] Sum rewards: 39.653, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.800', 'AMMO5': '0.025', 'AMMO2': '0.079', 'weapon5': '0.112', 'AMMO3': '0.259', 'weapon4': '0.304', 'AMMO4': '0.394', 'WEAPON5': '0.500', 'weapon2': '0.550', 'WEAPON4': '0.750', 'ARMOR': '0.888', 'WEAPON3': '1.550', 'weapon3': '2.652', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:01,549][52669] DAMAGECOUNT value on done: 57270.0 [2024-08-05 23:48:01,549][52669] Sum rewards: 44.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.752', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.116', 'weapon5': '0.118', 'AMMO4': '0.196', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.995', 'weapon2': '1.010', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.502', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:02,136][52650] Updated weights for policy 0, policy_version 17721 (0.0028) [2024-08-05 23:48:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 145178624. Throughput: 0: 4414.4. Samples: 36295210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:48:02,802][52567] Avg episode reward: [(0, '39.614')] [2024-08-05 23:48:02,874][52820] DAMAGECOUNT value on done: 52412.0 [2024-08-05 23:48:02,876][52820] Sum rewards: 52.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.407', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO3': '0.174', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon4': '0.334', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.946', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:03,554][52665] DAMAGECOUNT value on done: 59052.0 [2024-08-05 23:48:03,554][52665] Sum rewards: 55.172, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.850', 'ARMOR': '0.867', 'WEAPON3': '0.950', 'weapon3': '2.730', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:03,612][52667] DAMAGECOUNT value on done: 56147.0 [2024-08-05 23:48:03,613][52667] Sum rewards: 46.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.761', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.074', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.188', 'AMMO4': '0.192', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.878', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.672', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:04,085][52647] DAMAGECOUNT value on done: 58075.0 [2024-08-05 23:48:04,086][52647] Sum rewards: 38.756, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.197', 'ARMOR': '0.400', 'weapon4': '0.414', 'WEAPON4': '0.450', 'weapon2': '0.844', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '2.370', 'DAMAGECOUNT': '9.726', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:04,493][52669] DAMAGECOUNT value on done: 55639.0 [2024-08-05 23:48:04,494][52669] Sum rewards: 26.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.766', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.196', 'AMMO4': '0.203', 'WEAPON4': '0.450', 'weapon4': '0.484', 'weapon2': '0.562', 'ARMOR': '0.846', 'WEAPON3': '1.300', 'HITCOUNT': '2.200', 'weapon3': '2.684', 'DAMAGECOUNT': '8.562', 'FRAGCOUNT': '24.000'} [2024-08-05 23:48:05,952][52820] DAMAGECOUNT value on done: 49862.0 [2024-08-05 23:48:05,958][52820] Sum rewards: 37.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO3': '0.127', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.314', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon2': '0.556', 'WEAPON3': '0.800', 'HITCOUNT': '2.330', 'weapon3': '2.830', 'DAMAGECOUNT': '9.573', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:06,317][52647] DAMAGECOUNT value on done: 56839.0 [2024-08-05 23:48:06,318][52647] Sum rewards: 34.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.029', 'AMMO5': '0.017', 'weapon7': '0.018', 'AMMO2': '0.062', 'weapon5': '0.134', 'AMMO3': '0.179', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.311', 'WEAPON5': '0.350', 'WEAPON4': '0.750', 'weapon4': '0.788', 'weapon2': '0.822', 'ARMOR': '0.856', 'WEAPON3': '1.050', 'weapon3': '1.868', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '9.843', 'FRAGCOUNT': '31.000'} [2024-08-05 23:48:06,409][52650] Updated weights for policy 0, policy_version 17731 (0.0022) [2024-08-05 23:48:06,500][52667] DAMAGECOUNT value on done: 56102.0 [2024-08-05 23:48:06,501][52667] Sum rewards: 36.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.369', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.184', 'AMMO3': '0.244', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.678', 'ARMOR': '0.800', 'WEAPON3': '1.550', 'HITCOUNT': '2.180', 'weapon3': '2.610', 'DAMAGECOUNT': '10.683', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:06,681][52665] DAMAGECOUNT value on done: 56689.0 [2024-08-05 23:48:06,682][52665] Sum rewards: 34.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO3': '0.165', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.730', 'weapon4': '0.832', 'WEAPON3': '0.950', 'weapon3': '1.856', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '30.500'} [2024-08-05 23:48:07,342][52669] DAMAGECOUNT value on done: 52489.0 [2024-08-05 23:48:07,344][52669] Sum rewards: 44.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.272', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.083', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.227', 'ARMOR': '0.400', 'weapon2': '0.874', 'WEAPON3': '1.400', 'weapon3': '2.566', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 145268736. Throughput: 0: 4410.0. Samples: 36321520. Policy #0 lag: (min: 0.0, avg: 4.7, max: 7.0) [2024-08-05 23:48:07,802][52567] Avg episode reward: [(0, '39.832')] [2024-08-05 23:48:08,969][52820] DAMAGECOUNT value on done: 50311.0 [2024-08-05 23:48:08,970][52820] Sum rewards: 46.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.187', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.106', 'weapon5': '0.122', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'weapon2': '0.656', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '2.870', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:09,072][52647] DAMAGECOUNT value on done: 55653.0 [2024-08-05 23:48:09,072][52647] Sum rewards: 45.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.014', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.202', 'AMMO3': '0.236', 'ARMOR': '0.800', 'weapon2': '0.832', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '11.727', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:09,223][52667] DAMAGECOUNT value on done: 56464.0 [2024-08-05 23:48:09,225][52667] Sum rewards: 29.014, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.042', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.086', 'weapon4': '0.162', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.824', 'ARMOR': '1.251', 'WEAPON3': '1.900', 'HITCOUNT': '2.130', 'weapon3': '2.654', 'DAMAGECOUNT': '8.892', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:09,694][52665] DAMAGECOUNT value on done: 54008.0 [2024-08-05 23:48:09,694][52665] Sum rewards: 39.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.238', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.036', 'ARMOR': '0.052', 'AMMO4': '0.129', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '3.064', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:09,704][52658] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:48:10,243][52669] DAMAGECOUNT value on done: 56963.0 [2024-08-05 23:48:10,244][52669] Sum rewards: 41.561, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.060', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.153', 'weapon5': '0.172', 'weapon4': '0.280', 'weapon2': '0.882', 'WEAPON3': '0.900', 'weapon3': '2.320', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.119', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:10,496][52666] DAMAGECOUNT value on done: 53908.0 [2024-08-05 23:48:10,498][52666] Sum rewards: 39.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.521', 'AMMO5': '0.011', 'AMMO2': '0.071', 'weapon5': '0.170', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon4': '0.306', 'AMMO4': '0.354', 'weapon2': '0.460', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '2.698', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:11,376][52650] Updated weights for policy 0, policy_version 17741 (0.0014) [2024-08-05 23:48:12,091][52820] DAMAGECOUNT value on done: 49387.0 [2024-08-05 23:48:12,093][52820] Sum rewards: 30.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.406', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.146', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'weapon4': '0.454', 'weapon2': '0.840', 'ARMOR': '0.927', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.384', 'DAMAGECOUNT': '8.688', 'FRAGCOUNT': '31.000'} [2024-08-05 23:48:12,126][52647] DAMAGECOUNT value on done: 56213.0 [2024-08-05 23:48:12,129][52647] Sum rewards: 26.941, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.736', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.025', 'AMMO3': '0.098', 'weapon7': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '0.600', 'weapon4': '1.214', 'HITCOUNT': '1.480', 'weapon3': '1.962', 'DAMAGECOUNT': '5.409', 'FRAGCOUNT': '22.000'} [2024-08-05 23:48:12,276][52667] DAMAGECOUNT value on done: 55416.0 [2024-08-05 23:48:12,277][52667] Sum rewards: 41.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.190', 'AMMO4': '0.227', 'WEAPON4': '0.500', 'weapon2': '0.660', 'ARMOR': '0.828', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '2.912', 'DAMAGECOUNT': '10.914', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:12,682][52665] DAMAGECOUNT value on done: 53258.0 [2024-08-05 23:48:12,683][52665] Sum rewards: 43.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.588', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.846', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 145367040. Throughput: 0: 4412.9. Samples: 36348030. Policy #0 lag: (min: 0.0, avg: 4.7, max: 7.0) [2024-08-05 23:48:12,794][52567] Avg episode reward: [(0, '39.597')] [2024-08-05 23:48:12,913][52666] DAMAGECOUNT value on done: 55683.0 [2024-08-05 23:48:12,915][52666] Sum rewards: 29.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon7': '0.038', 'weapon5': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.372', 'weapon2': '0.698', 'WEAPON3': '1.250', 'ARMOR': '1.322', 'HITCOUNT': '2.190', 'weapon3': '2.588', 'DAMAGECOUNT': '9.174', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:13,114][52669] DAMAGECOUNT value on done: 57305.0 [2024-08-05 23:48:13,116][52669] Sum rewards: 26.129, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.980', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.214', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.550', 'weapon2': '0.698', 'ARMOR': '0.868', 'WEAPON3': '1.650', 'HITCOUNT': '2.070', 'weapon3': '2.794', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:13,147][52658] DAMAGECOUNT value on done: 56680.0 [2024-08-05 23:48:13,150][52658] Sum rewards: 47.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.140', 'weapon5': '0.188', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.926', 'weapon2': '1.040', 'WEAPON3': '1.400', 'weapon3': '2.392', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:14,590][52647] DAMAGECOUNT value on done: 56054.0 [2024-08-05 23:48:14,590][52647] Sum rewards: 27.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'ARMOR': '0.004', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.400', 'weapon4': '0.426', 'weapon2': '0.624', 'WEAPON3': '1.200', 'HITCOUNT': '1.830', 'weapon3': '2.746', 'DAMAGECOUNT': '7.008', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:15,003][52667] DAMAGECOUNT value on done: 53630.0 [2024-08-05 23:48:15,003][52667] Sum rewards: 46.146, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.064', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'AMMO4': '0.282', 'ARMOR': '0.400', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon2': '1.182', 'weapon3': '2.112', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.221', 'FRAGCOUNT': '38.500'} [2024-08-05 23:48:15,274][52820] DAMAGECOUNT value on done: 52252.0 [2024-08-05 23:48:15,275][52820] Sum rewards: 47.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.144', 'AMMO4': '0.190', 'weapon5': '0.192', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.402', 'weapon2': '0.410', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '2.702', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:15,529][52650] Updated weights for policy 0, policy_version 17751 (0.0013) [2024-08-05 23:48:15,700][52666] DAMAGECOUNT value on done: 55308.0 [2024-08-05 23:48:15,702][52666] Sum rewards: 44.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.958', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.075', 'weapon5': '0.106', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.450', 'weapon2': '0.712', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.892', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:15,744][52665] DAMAGECOUNT value on done: 53995.0 [2024-08-05 23:48:15,745][52665] Sum rewards: 46.466, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.842', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'weapon4': '0.480', 'weapon2': '0.768', 'ARMOR': '0.955', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:16,123][52669] DAMAGECOUNT value on done: 60086.0 [2024-08-05 23:48:16,123][52669] Sum rewards: 58.242, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.003', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon2': '0.680', 'WEAPON3': '0.900', 'HITCOUNT': '2.990', 'weapon3': '3.050', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '46.000'} [2024-08-05 23:48:16,299][52658] DAMAGECOUNT value on done: 56003.0 [2024-08-05 23:48:16,300][52658] Sum rewards: 43.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.671', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.782', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.860', 'DAMAGECOUNT': '10.602', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:16,509][52662] Large shaping reward 3.554 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.078, -26.0), ('weapon5', 0.002)] [2024-08-05 23:48:16,592][52670] DAMAGECOUNT value on done: 54958.0 [2024-08-05 23:48:16,592][52670] Sum rewards: 35.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.172', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.560', 'ARMOR': '0.861', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.808', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '29.500'} [2024-08-05 23:48:17,376][52647] DAMAGECOUNT value on done: 58575.0 [2024-08-05 23:48:17,378][52647] Sum rewards: 39.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.249', 'AMMO5': '0.005', 'ARMOR': '0.033', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.098', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '2.926', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:17,795][52567] Fps is (10 sec: 17202.0, 60 sec: 17476.1, 300 sec: 17605.8). Total num frames: 145440768. Throughput: 0: 4418.4. Samples: 36361290. Policy #0 lag: (min: 0.0, avg: 4.7, max: 7.0) [2024-08-05 23:48:17,795][52567] Avg episode reward: [(0, '39.830')] [2024-08-05 23:48:18,021][52667] DAMAGECOUNT value on done: 56938.0 [2024-08-05 23:48:18,021][52667] Sum rewards: 36.927, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.524', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.140', 'weapon4': '0.196', 'AMMO4': '0.263', 'weapon5': '0.296', 'WEAPON5': '0.350', 'ARMOR': '0.474', 'WEAPON4': '0.600', 'weapon2': '0.806', 'WEAPON3': '0.850', 'weapon3': '2.360', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '30.000'} [2024-08-05 23:48:18,149][52820] DAMAGECOUNT value on done: 53952.0 [2024-08-05 23:48:18,150][52820] Sum rewards: 38.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.856', 'AMMO5': '0.011', 'ARMOR': '0.032', 'AMMO2': '0.046', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.241', 'weapon4': '0.326', 'WEAPON4': '0.500', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:18,423][52666] DAMAGECOUNT value on done: 53298.0 [2024-08-05 23:48:18,427][52666] Sum rewards: 37.740, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.660', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.422', 'weapon2': '0.810', 'WEAPON3': '0.850', 'weapon3': '2.506', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.278', 'FRAGCOUNT': '29.000'} [2024-08-05 23:48:18,998][52669] DAMAGECOUNT value on done: 57267.0 [2024-08-05 23:48:18,999][52669] Sum rewards: 49.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.109', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.118', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'ARMOR': '0.886', 'weapon2': '0.972', 'WEAPON3': '1.250', 'weapon3': '2.630', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '42.000'} [2024-08-05 23:48:19,343][52658] DAMAGECOUNT value on done: 55325.0 [2024-08-05 23:48:19,343][52658] Sum rewards: 46.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'weapon4': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'ARMOR': '0.472', 'weapon2': '0.604', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.176', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '42.000'} [2024-08-05 23:48:19,408][52670] DAMAGECOUNT value on done: 55553.0 [2024-08-05 23:48:19,408][52670] Sum rewards: 40.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'weapon4': '0.194', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.740', 'ARMOR': '0.854', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.832', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:19,411][52665] DAMAGECOUNT value on done: 56698.0 [2024-08-05 23:48:19,412][52665] Sum rewards: 42.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.126', 'weapon4': '0.174', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.463', 'weapon2': '0.684', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.772', 'DAMAGECOUNT': '10.101', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:20,276][52663] DAMAGECOUNT value on done: 58032.0 [2024-08-05 23:48:20,276][52663] Sum rewards: 31.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.295', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.243', 'weapon2': '0.990', 'ARMOR': '1.336', 'WEAPON3': '1.500', 'HITCOUNT': '2.400', 'weapon3': '2.790', 'DAMAGECOUNT': '9.486', 'FRAGCOUNT': '29.000'} [2024-08-05 23:48:20,319][52647] DAMAGECOUNT value on done: 57273.0 [2024-08-05 23:48:20,319][52647] Sum rewards: 29.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.094', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'ARMOR': '0.898', 'weapon2': '0.918', 'WEAPON3': '1.450', 'HITCOUNT': '2.120', 'weapon3': '2.650', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '29.000'} [2024-08-05 23:48:20,636][52667] DAMAGECOUNT value on done: 54305.0 [2024-08-05 23:48:20,637][52667] Sum rewards: 39.784, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.519', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.076', 'AMMO3': '0.166', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.788', 'WEAPON3': '1.200', 'ARMOR': '1.266', 'HITCOUNT': '2.350', 'weapon3': '2.738', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:20,748][52650] Updated weights for policy 0, policy_version 17761 (0.0037) [2024-08-05 23:48:21,282][52820] DAMAGECOUNT value on done: 52604.0 [2024-08-05 23:48:21,283][52820] Sum rewards: 41.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.604', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'ARMOR': '0.479', 'weapon2': '0.712', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.858', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:21,449][52666] DAMAGECOUNT value on done: 54118.0 [2024-08-05 23:48:21,450][52666] Sum rewards: 32.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO3': '0.161', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.400', 'ARMOR': '0.480', 'WEAPON3': '1.000', 'weapon2': '1.198', 'weapon3': '2.208', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '9.852', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:21,623][52669] DAMAGECOUNT value on done: 56453.0 [2024-08-05 23:48:21,623][52669] Sum rewards: 41.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO3': '0.212', 'weapon2': '0.898', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.812', 'DAMAGECOUNT': '10.722', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:22,139][52658] DAMAGECOUNT value on done: 55092.0 [2024-08-05 23:48:22,140][52658] Sum rewards: 46.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.457', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon4': '0.122', 'AMMO4': '0.153', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'weapon2': '0.530', 'ARMOR': '0.889', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '3.096', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:22,184][52665] DAMAGECOUNT value on done: 56747.0 [2024-08-05 23:48:22,185][52665] Sum rewards: 38.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.138', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.028', 'weapon4': '0.046', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.916', 'WEAPON3': '1.150', 'HITCOUNT': '2.210', 'weapon3': '2.830', 'DAMAGECOUNT': '9.441', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:22,355][52670] DAMAGECOUNT value on done: 54989.0 [2024-08-05 23:48:22,356][52670] Sum rewards: 31.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'ARMOR': '0.455', 'weapon2': '1.268', 'WEAPON3': '1.350', 'HITCOUNT': '2.100', 'weapon3': '2.392', 'DAMAGECOUNT': '9.222', 'FRAGCOUNT': '30.000'} [2024-08-05 23:48:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.5, 300 sec: 17633.6). Total num frames: 145539072. Throughput: 0: 4414.4. Samples: 36387680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:48:22,802][52567] Avg episode reward: [(0, '40.085')] [2024-08-05 23:48:23,048][52647] DAMAGECOUNT value on done: 56807.0 [2024-08-05 23:48:23,048][52647] Sum rewards: 37.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.884', 'AMMO5': '0.017', 'weapon5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.188', 'AMMO4': '0.197', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon4': '0.516', 'weapon2': '0.808', 'WEAPON3': '1.100', 'weapon3': '2.356', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:23,065][52663] DAMAGECOUNT value on done: 56082.0 [2024-08-05 23:48:23,065][52663] Sum rewards: 45.627, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.076', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'ARMOR': '0.854', 'WEAPON3': '0.950', 'weapon2': '1.138', 'HITCOUNT': '2.630', 'weapon3': '2.650', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:23,651][52667] DAMAGECOUNT value on done: 57101.0 [2024-08-05 23:48:23,651][52667] Sum rewards: 32.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.257', 'AMMO5': '0.007', 'weapon5': '0.016', 'weapon7': '0.018', 'ARMOR': '0.036', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'AMMO4': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.376', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.000', 'HITCOUNT': '2.060', 'weapon3': '2.780', 'DAMAGECOUNT': '8.835', 'FRAGCOUNT': '26.500'} [2024-08-05 23:48:24,081][52666] DAMAGECOUNT value on done: 54157.0 [2024-08-05 23:48:24,083][52666] Sum rewards: 41.591, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.119', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.124', 'AMMO3': '0.147', 'weapon4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.468', 'WEAPON3': '1.000', 'weapon2': '1.086', 'weapon3': '2.410', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:24,373][52669] DAMAGECOUNT value on done: 55231.0 [2024-08-05 23:48:24,374][52669] Sum rewards: 46.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.087', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'ARMOR': '0.457', 'weapon2': '0.566', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.138', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '38.500'} [2024-08-05 23:48:24,439][52820] DAMAGECOUNT value on done: 49593.0 [2024-08-05 23:48:24,439][52820] Sum rewards: 37.135, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.672', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.260', 'AMMO3': '0.262', 'ARMOR': '0.470', 'weapon2': '0.762', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '2.722', 'DAMAGECOUNT': '11.181', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:24,886][52658] DAMAGECOUNT value on done: 58279.0 [2024-08-05 23:48:24,886][52658] Sum rewards: 41.483, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.003', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.070', 'AMMO4': '0.107', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.408', 'weapon4': '0.502', 'WEAPON3': '1.100', 'HITCOUNT': '2.220', 'weapon3': '2.846', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:24,996][52670] DAMAGECOUNT value on done: 53073.0 [2024-08-05 23:48:24,997][52670] Sum rewards: 50.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.301', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.596', 'ARMOR': '0.832', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.902', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:25,062][52650] Updated weights for policy 0, policy_version 17771 (0.0029) [2024-08-05 23:48:25,225][52665] DAMAGECOUNT value on done: 58661.0 [2024-08-05 23:48:25,226][52665] Sum rewards: 42.417, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.595', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.194', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '3.192', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:25,383][52647] DAMAGECOUNT value on done: 58880.0 [2024-08-05 23:48:25,383][52647] Sum rewards: 49.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.117', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.114', 'AMMO4': '0.164', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.036', 'ARMOR': '1.677', 'weapon3': '2.492', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:25,808][52663] DAMAGECOUNT value on done: 58122.0 [2024-08-05 23:48:25,810][52663] Sum rewards: 41.203, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.072', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.360', 'ARMOR': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.856', 'DAMAGECOUNT': '10.704', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:26,819][52667] DAMAGECOUNT value on done: 61246.0 [2024-08-05 23:48:26,819][52667] Sum rewards: 47.281, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.166', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.406', 'ARMOR': '0.488', 'weapon2': '0.556', 'WEAPON3': '0.850', 'weapon3': '2.578', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:26,856][52666] DAMAGECOUNT value on done: 52449.0 [2024-08-05 23:48:26,858][52666] Sum rewards: 48.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.911', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.156', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.372', 'weapon2': '0.662', 'ARMOR': '0.852', 'WEAPON3': '1.100', 'weapon3': '2.530', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '42.000'} [2024-08-05 23:48:26,954][52669] DAMAGECOUNT value on done: 57268.0 [2024-08-05 23:48:26,954][52669] Sum rewards: 48.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.134', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'ARMOR': '0.505', 'weapon2': '0.558', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.866', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '41.000'} [2024-08-05 23:48:27,658][52670] DAMAGECOUNT value on done: 53325.0 [2024-08-05 23:48:27,660][52670] Sum rewards: 50.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.815', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.130', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.250', 'ARMOR': '0.800', 'weapon2': '0.848', 'WEAPON3': '0.900', 'weapon3': '2.618', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:27,689][52820] DAMAGECOUNT value on done: 51396.0 [2024-08-05 23:48:27,690][52820] Sum rewards: 45.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.964', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'ARMOR': '0.412', 'weapon2': '0.584', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '3.108', 'DAMAGECOUNT': '11.211', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:27,794][52567] Fps is (10 sec: 18023.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 145620992. Throughput: 0: 4413.8. Samples: 36414060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:48:27,794][52567] Avg episode reward: [(0, '40.712')] [2024-08-05 23:48:27,876][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017777_145629184.pth... [2024-08-05 23:48:27,964][52647] DAMAGECOUNT value on done: 57173.0 [2024-08-05 23:48:27,965][52647] Sum rewards: 47.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.096', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.056', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.914', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '41.000'} [2024-08-05 23:48:28,045][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017261_141402112.pth [2024-08-05 23:48:28,050][52614] Saving new best policy, reward=40.712! [2024-08-05 23:48:28,139][52658] DAMAGECOUNT value on done: 53611.0 [2024-08-05 23:48:28,139][52658] Sum rewards: 42.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.102', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.172', 'AMMO3': '0.175', 'WEAPON4': '0.400', 'weapon4': '0.478', 'weapon2': '0.916', 'ARMOR': '0.948', 'WEAPON3': '1.000', 'weapon3': '2.372', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.281', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:28,419][52665] DAMAGECOUNT value on done: 57144.0 [2024-08-05 23:48:28,419][52665] Sum rewards: 38.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.138', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.288', 'WEAPON5': '0.300', 'ARMOR': '0.858', 'WEAPON3': '1.050', 'weapon2': '1.064', 'weapon3': '2.310', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:28,764][52663] DAMAGECOUNT value on done: 56821.0 [2024-08-05 23:48:28,764][52663] Sum rewards: 37.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.431', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.177', 'ARMOR': '0.400', 'weapon2': '1.222', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.450', 'DAMAGECOUNT': '10.491', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:29,863][52666] DAMAGECOUNT value on done: 53696.0 [2024-08-05 23:48:29,863][52666] Sum rewards: 28.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.814', 'AMMO5': '0.009', 'AMMO2': '0.071', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'AMMO4': '0.355', 'weapon4': '0.492', 'ARMOR': '0.532', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon2': '1.238', 'weapon3': '1.936', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '9.795', 'FRAGCOUNT': '25.000'} [2024-08-05 23:48:29,892][52667] DAMAGECOUNT value on done: 56099.0 [2024-08-05 23:48:29,893][52667] Sum rewards: 36.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.013', 'weapon5': '0.044', 'AMMO2': '0.045', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'ARMOR': '0.420', 'weapon4': '0.424', 'WEAPON4': '0.500', 'weapon2': '0.948', 'WEAPON3': '1.050', 'HITCOUNT': '2.300', 'weapon3': '2.370', 'DAMAGECOUNT': '10.170', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:30,272][52650] Updated weights for policy 0, policy_version 17781 (0.0022) [2024-08-05 23:48:30,275][52647] DAMAGECOUNT value on done: 56313.0 [2024-08-05 23:48:30,277][52647] Sum rewards: 37.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.411', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'ARMOR': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.400', 'HITCOUNT': '2.270', 'weapon3': '3.258', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:30,865][52820] DAMAGECOUNT value on done: 53171.0 [2024-08-05 23:48:30,866][52820] Sum rewards: 42.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'weapon5': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'ARMOR': '0.040', 'AMMO4': '0.125', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.376', 'WEAPON4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:30,900][52670] DAMAGECOUNT value on done: 57510.0 [2024-08-05 23:48:30,901][52670] Sum rewards: 44.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'weapon7': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.038', 'weapon4': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '2.954', 'DAMAGECOUNT': '11.115', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:31,011][52658] DAMAGECOUNT value on done: 62062.0 [2024-08-05 23:48:31,012][52658] Sum rewards: 40.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.866', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.114', 'AMMO3': '0.202', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'ARMOR': '0.490', 'WEAPON4': '0.500', 'weapon2': '0.664', 'weapon4': '0.880', 'WEAPON3': '1.200', 'weapon3': '2.118', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '10.881', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:31,557][52665] DAMAGECOUNT value on done: 56562.0 [2024-08-05 23:48:31,558][52665] Sum rewards: 32.016, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.849', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'AMMO3': '0.136', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.449', 'weapon2': '0.454', 'weapon4': '0.600', 'WEAPON3': '0.800', 'HITCOUNT': '1.770', 'weapon3': '2.632', 'DAMAGECOUNT': '7.929', 'FRAGCOUNT': '26.000'} [2024-08-05 23:48:31,912][52663] DAMAGECOUNT value on done: 53802.0 [2024-08-05 23:48:31,912][52663] Sum rewards: 29.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.822', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon5': '0.030', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'ARMOR': '0.858', 'weapon2': '1.010', 'WEAPON3': '1.350', 'HITCOUNT': '2.130', 'weapon3': '2.574', 'DAMAGECOUNT': '8.964', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:32,716][52666] DAMAGECOUNT value on done: 56174.0 [2024-08-05 23:48:32,716][52666] Sum rewards: 38.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.814', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.068', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'weapon4': '0.626', 'weapon2': '0.758', 'ARMOR': '0.872', 'WEAPON3': '0.950', 'weapon3': '2.234', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.551', 'FRAGCOUNT': '31.000'} [2024-08-05 23:48:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 145711104. Throughput: 0: 4397.3. Samples: 36426770. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-05 23:48:32,794][52567] Avg episode reward: [(0, '40.435')] [2024-08-05 23:48:32,815][52667] DAMAGECOUNT value on done: 61091.0 [2024-08-05 23:48:32,818][52667] Sum rewards: 52.800, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.246', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon5': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.206', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '2.980', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:33,600][52670] DAMAGECOUNT value on done: 53080.0 [2024-08-05 23:48:33,602][52670] Sum rewards: 39.013, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.038', 'HEALTH': '0.073', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.182', 'WEAPON4': '0.250', 'ARMOR': '0.474', 'WEAPON3': '0.600', 'weapon2': '1.346', 'HITCOUNT': '2.330', 'weapon3': '2.342', 'DAMAGECOUNT': '9.180', 'FRAGCOUNT': '30.000'} [2024-08-05 23:48:33,856][52658] DAMAGECOUNT value on done: 55252.0 [2024-08-05 23:48:33,857][52658] Sum rewards: 36.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.044', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.051', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.892', 'WEAPON3': '1.250', 'ARMOR': '1.276', 'HITCOUNT': '2.300', 'weapon3': '2.746', 'DAMAGECOUNT': '9.441', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:34,023][52820] DAMAGECOUNT value on done: 54723.0 [2024-08-05 23:48:34,023][52820] Sum rewards: 42.074, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.300', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.136', 'WEAPON4': '0.400', 'weapon4': '0.580', 'weapon2': '0.842', 'ARMOR': '0.928', 'WEAPON3': '0.950', 'weapon3': '2.384', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:34,436][52670] Large shaping reward -2.552 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.003, -3.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:48:34,531][52650] Updated weights for policy 0, policy_version 17791 (0.0015) [2024-08-05 23:48:34,668][52665] DAMAGECOUNT value on done: 55101.0 [2024-08-05 23:48:34,669][52665] Sum rewards: 51.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.459', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO4': '0.164', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.416', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '44.000'} [2024-08-05 23:48:34,846][52663] DAMAGECOUNT value on done: 56763.0 [2024-08-05 23:48:34,847][52663] Sum rewards: 36.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.093', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.208', 'weapon4': '0.320', 'WEAPON4': '0.550', 'weapon2': '0.822', 'ARMOR': '0.910', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.522', 'DAMAGECOUNT': '10.194', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:35,190][52666] DAMAGECOUNT value on done: 55831.0 [2024-08-05 23:48:35,190][52666] Sum rewards: 49.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.214', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.230', 'ARMOR': '0.400', 'weapon2': '0.680', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '2.810', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:35,825][52667] DAMAGECOUNT value on done: 55948.0 [2024-08-05 23:48:35,826][52667] Sum rewards: 32.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.154', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.172', 'AMMO3': '0.198', 'AMMO4': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.668', 'weapon2': '0.696', 'ARMOR': '0.893', 'WEAPON3': '1.200', 'weapon3': '2.092', 'HITCOUNT': '2.120', 'DAMAGECOUNT': '8.886', 'FRAGCOUNT': '29.500'} [2024-08-05 23:48:36,282][52670] DAMAGECOUNT value on done: 54314.0 [2024-08-05 23:48:36,283][52670] Sum rewards: 39.370, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.186', 'AMMO5': '0.003', 'AMMO2': '0.026', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'weapon4': '0.160', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.756', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.858', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:36,738][52658] DAMAGECOUNT value on done: 57994.0 [2024-08-05 23:48:36,738][52658] Sum rewards: 45.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.078', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.184', 'weapon2': '0.596', 'ARMOR': '0.956', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '3.066', 'DAMAGECOUNT': '11.277', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:37,028][52820] DAMAGECOUNT value on done: 49257.0 [2024-08-05 23:48:37,028][52820] Sum rewards: 34.502, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.043', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.160', 'weapon4': '0.160', 'WEAPON3': '0.750', 'ARMOR': '0.867', 'weapon2': '1.702', 'weapon3': '1.912', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '7.953', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:37,168][52665] DAMAGECOUNT value on done: 54155.0 [2024-08-05 23:48:37,169][52665] Sum rewards: 47.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.442', 'AMMO5': '0.012', 'ARMOR': '0.044', 'AMMO2': '0.055', 'weapon5': '0.098', 'AMMO3': '0.250', 'AMMO4': '0.277', 'WEAPON5': '0.300', 'weapon4': '0.374', 'weapon2': '0.494', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.650', 'weapon3': '2.724', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '44.000'} [2024-08-05 23:48:37,757][52663] DAMAGECOUNT value on done: 61027.0 [2024-08-05 23:48:37,758][52663] Sum rewards: 45.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon5': '0.064', 'AMMO3': '0.165', 'AMMO4': '0.186', 'weapon4': '0.210', 'WEAPON5': '0.300', 'ARMOR': '0.446', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:37,794][52666] DAMAGECOUNT value on done: 53191.0 [2024-08-05 23:48:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 145801216. Throughput: 0: 4394.2. Samples: 36453130. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-05 23:48:37,794][52567] Avg episode reward: [(0, '40.479')] [2024-08-05 23:48:37,794][52666] Sum rewards: 38.888, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.577', 'AMMO2': '0.017', 'AMMO5': '0.022', 'weapon4': '0.064', 'AMMO4': '0.087', 'AMMO3': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon5': '0.372', 'WEAPON3': '0.750', 'ARMOR': '0.858', 'weapon2': '1.232', 'weapon3': '2.142', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:38,029][52671] DAMAGECOUNT value on done: 61323.0 [2024-08-05 23:48:38,030][52671] Sum rewards: 36.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.726', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.932', 'WEAPON3': '1.200', 'ARMOR': '1.314', 'HITCOUNT': '2.380', 'weapon3': '2.888', 'DAMAGECOUNT': '10.206', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:38,687][52667] DAMAGECOUNT value on done: 57984.0 [2024-08-05 23:48:38,687][52667] Sum rewards: 46.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.402', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.175', 'weapon5': '0.194', 'weapon4': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'weapon2': '0.730', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.614', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '41.500'} [2024-08-05 23:48:38,854][52670] DAMAGECOUNT value on done: 51970.0 [2024-08-05 23:48:38,855][52670] Sum rewards: 39.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'weapon4': '0.190', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.826', 'ARMOR': '0.907', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.736', 'DAMAGECOUNT': '9.954', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:39,369][52650] Updated weights for policy 0, policy_version 17801 (0.0011) [2024-08-05 23:48:39,715][52658] DAMAGECOUNT value on done: 57718.0 [2024-08-05 23:48:39,716][52658] Sum rewards: 38.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'weapon2': '0.528', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.650', 'DAMAGECOUNT': '9.852', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:40,022][52820] DAMAGECOUNT value on done: 51108.0 [2024-08-05 23:48:40,025][52820] Sum rewards: 36.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.526', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.091', 'WEAPON5': '0.200', 'weapon5': '0.214', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'ARMOR': '0.911', 'weapon2': '0.982', 'WEAPON3': '1.350', 'HITCOUNT': '2.050', 'weapon3': '2.496', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:40,320][52663] DAMAGECOUNT value on done: 56282.0 [2024-08-05 23:48:40,321][52663] Sum rewards: 47.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.164', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.348', 'WEAPON4': '0.450', 'weapon2': '0.548', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.702', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:40,512][52665] DAMAGECOUNT value on done: 55991.0 [2024-08-05 23:48:40,512][52665] Sum rewards: 41.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.687', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.090', 'weapon5': '0.090', 'AMMO4': '0.143', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'weapon2': '1.002', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.620', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:40,912][52666] DAMAGECOUNT value on done: 52997.0 [2024-08-05 23:48:40,912][52666] Sum rewards: 39.033, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.160', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.314', 'weapon4': '0.340', 'weapon2': '0.696', 'WEAPON3': '0.900', 'ARMOR': '1.260', 'HITCOUNT': '2.550', 'weapon3': '2.624', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:41,040][52671] DAMAGECOUNT value on done: 56001.0 [2024-08-05 23:48:41,040][52671] Sum rewards: 38.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.677', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.121', 'weapon4': '0.168', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.758', 'ARMOR': '0.958', 'WEAPON3': '1.200', 'HITCOUNT': '2.340', 'weapon3': '2.726', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:41,828][52662] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:48:41,935][52670] DAMAGECOUNT value on done: 50714.0 [2024-08-05 23:48:41,937][52670] Sum rewards: 43.069, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.168', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.758', 'WEAPON3': '1.000', 'weapon3': '2.574', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:42,646][52658] DAMAGECOUNT value on done: 58370.0 [2024-08-05 23:48:42,647][52658] Sum rewards: 39.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.156', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.122', 'AMMO3': '0.192', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON4': '0.500', 'ARMOR': '0.864', 'weapon2': '0.936', 'WEAPON3': '1.150', 'weapon3': '2.254', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 145883136. Throughput: 0: 4398.2. Samples: 36479790. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-05 23:48:42,795][52567] Avg episode reward: [(0, '40.452')] [2024-08-05 23:48:43,053][52663] DAMAGECOUNT value on done: 55807.0 [2024-08-05 23:48:43,053][52663] Sum rewards: 38.175, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.096', 'ARMOR': '0.005', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.151', 'AMMO4': '0.219', 'weapon5': '0.250', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.714', 'WEAPON3': '0.900', 'HITCOUNT': '2.180', 'weapon3': '2.418', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '32.500'} [2024-08-05 23:48:43,203][52820] DAMAGECOUNT value on done: 54795.0 [2024-08-05 23:48:43,204][52820] Sum rewards: 40.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.773', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.220', 'weapon4': '0.310', 'WEAPON4': '0.350', 'ARMOR': '0.446', 'weapon2': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.742', 'DAMAGECOUNT': '11.811', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:43,523][52614] Signal inference workers to stop experience collection... (3300 times) [2024-08-05 23:48:43,523][52614] Signal inference workers to resume experience collection... (3300 times) [2024-08-05 23:48:43,534][52665] DAMAGECOUNT value on done: 53997.0 [2024-08-05 23:48:43,534][52665] Sum rewards: 35.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.022', 'AMMO5': '0.003', 'weapon4': '0.008', 'weapon5': '0.014', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.231', 'ARMOR': '0.856', 'weapon2': '1.012', 'WEAPON3': '1.450', 'HITCOUNT': '2.330', 'weapon3': '2.748', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '32.500'} [2024-08-05 23:48:43,554][52650] InferenceWorker_p0-w0: stopping experience collection (3300 times) [2024-08-05 23:48:43,554][52650] InferenceWorker_p0-w0: resuming experience collection (3300 times) [2024-08-05 23:48:43,605][52650] Updated weights for policy 0, policy_version 17811 (0.0027) [2024-08-05 23:48:43,790][52666] DAMAGECOUNT value on done: 54155.0 [2024-08-05 23:48:43,792][52666] Sum rewards: 32.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.715', 'AMMO2': '0.037', 'ARMOR': '0.044', 'AMMO4': '0.183', 'AMMO3': '0.244', 'weapon4': '0.266', 'WEAPON4': '0.400', 'weapon2': '0.746', 'WEAPON3': '1.550', 'HITCOUNT': '2.300', 'weapon3': '2.702', 'DAMAGECOUNT': '9.654', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:43,887][52671] DAMAGECOUNT value on done: 56484.0 [2024-08-05 23:48:43,889][52671] Sum rewards: 37.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.447', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.058', 'AMMO3': '0.150', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'ARMOR': '0.472', 'WEAPON4': '0.550', 'weapon4': '0.652', 'weapon2': '0.658', 'WEAPON3': '0.850', 'weapon3': '2.422', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '9.957', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:44,570][52670] DAMAGECOUNT value on done: 54529.0 [2024-08-05 23:48:44,571][52670] Sum rewards: 26.623, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.659', 'AMMO5': '0.010', 'weapon5': '0.068', 'AMMO2': '0.080', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.398', 'ARMOR': '0.412', 'weapon4': '0.464', 'WEAPON4': '0.850', 'weapon2': '1.098', 'WEAPON3': '1.300', 'weapon3': '2.090', 'HITCOUNT': '2.090', 'DAMAGECOUNT': '7.995', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:45,649][52658] DAMAGECOUNT value on done: 54441.0 [2024-08-05 23:48:45,650][52658] Sum rewards: 37.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.277', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.076', 'AMMO4': '0.166', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'ARMOR': '0.461', 'weapon2': '0.596', 'WEAPON3': '1.450', 'HITCOUNT': '2.180', 'weapon3': '2.800', 'DAMAGECOUNT': '9.303', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:45,923][52665] DAMAGECOUNT value on done: 55396.0 [2024-08-05 23:48:45,924][52665] Sum rewards: 40.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.328', 'AMMO5': '0.005', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'weapon4': '0.486', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.532', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.112', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:46,001][52663] DAMAGECOUNT value on done: 59810.0 [2024-08-05 23:48:46,002][52663] Sum rewards: 53.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.558', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.272', 'weapon2': '0.740', 'ARMOR': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.770', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '46.000'} [2024-08-05 23:48:46,142][52666] DAMAGECOUNT value on done: 54232.0 [2024-08-05 23:48:46,142][52666] Sum rewards: 36.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.140', 'AMMO3': '0.211', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.386', 'ARMOR': '0.424', 'weapon2': '0.586', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '2.572', 'DAMAGECOUNT': '10.428', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:46,417][52820] DAMAGECOUNT value on done: 52238.0 [2024-08-05 23:48:46,419][52820] Sum rewards: 58.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.844', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon2': '0.782', 'WEAPON3': '1.000', 'ARMOR': '1.398', 'HITCOUNT': '2.750', 'weapon3': '2.872', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '48.000'} [2024-08-05 23:48:46,742][52671] DAMAGECOUNT value on done: 53268.0 [2024-08-05 23:48:46,742][52671] Sum rewards: 42.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.078', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon2': '0.538', 'ARMOR': '0.832', 'WEAPON3': '1.050', 'HITCOUNT': '2.220', 'weapon3': '3.052', 'DAMAGECOUNT': '9.987', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:47,119][52670] DAMAGECOUNT value on done: 57474.0 [2024-08-05 23:48:47,120][52670] Sum rewards: 48.698, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.602', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.140', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'weapon4': '0.418', 'WEAPON4': '0.450', 'weapon2': '0.842', 'ARMOR': '0.914', 'WEAPON3': '0.950', 'weapon3': '2.458', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17614.1, 300 sec: 17578.1). Total num frames: 145973248. Throughput: 0: 4392.4. Samples: 36492870. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:48:47,794][52567] Avg episode reward: [(0, '40.700')] [2024-08-05 23:48:48,546][52650] Updated weights for policy 0, policy_version 17821 (0.0013) [2024-08-05 23:48:48,672][52658] DAMAGECOUNT value on done: 56007.0 [2024-08-05 23:48:48,674][52658] Sum rewards: 40.089, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.980', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.126', 'weapon5': '0.164', 'AMMO4': '0.226', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.710', 'ARMOR': '0.820', 'WEAPON3': '1.450', 'HITCOUNT': '2.480', 'weapon3': '2.618', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:48,757][52665] DAMAGECOUNT value on done: 53912.0 [2024-08-05 23:48:48,758][52665] Sum rewards: 31.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.197', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.062', 'AMMO4': '0.103', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.436', 'weapon2': '1.270', 'WEAPON3': '1.350', 'HITCOUNT': '2.240', 'weapon3': '2.462', 'DAMAGECOUNT': '8.817', 'FRAGCOUNT': '30.000'} [2024-08-05 23:48:48,937][52666] DAMAGECOUNT value on done: 53719.0 [2024-08-05 23:48:48,945][52666] Sum rewards: 29.991, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.326', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.042', 'HITCOUNT': '1.740', 'weapon3': '2.146', 'DAMAGECOUNT': '7.116', 'FRAGCOUNT': '25.000'} [2024-08-05 23:48:49,214][52671] DAMAGECOUNT value on done: 54134.0 [2024-08-05 23:48:49,215][52671] Sum rewards: 39.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.828', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.160', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'ARMOR': '0.491', 'weapon2': '0.786', 'WEAPON3': '1.350', 'HITCOUNT': '2.490', 'weapon3': '2.820', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '35.000'} [2024-08-05 23:48:49,417][52820] DAMAGECOUNT value on done: 52081.0 [2024-08-05 23:48:49,423][52820] Sum rewards: 47.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.400', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO3': '0.145', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.441', 'weapon4': '0.502', 'WEAPON3': '0.800', 'weapon2': '0.822', 'weapon3': '2.194', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:49,486][52663] DAMAGECOUNT value on done: 56867.0 [2024-08-05 23:48:49,489][52663] Sum rewards: 49.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.197', 'weapon4': '0.280', 'weapon2': '0.378', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '2.960', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:50,004][52670] DAMAGECOUNT value on done: 55734.0 [2024-08-05 23:48:50,005][52670] Sum rewards: 36.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.729', 'AMMO5': '0.004', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.316', 'ARMOR': '0.452', 'weapon2': '0.594', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.746', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '31.000'} [2024-08-05 23:48:51,523][52658] DAMAGECOUNT value on done: 56242.0 [2024-08-05 23:48:51,525][52658] Sum rewards: 42.469, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.070', 'AMMO4': '0.111', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.469', 'weapon4': '0.596', 'weapon2': '0.974', 'WEAPON3': '1.100', 'weapon3': '2.064', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:51,793][52665] DAMAGECOUNT value on done: 53915.0 [2024-08-05 23:48:51,795][52665] Sum rewards: 33.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.704', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO3': '0.179', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.304', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'weapon2': '0.620', 'WEAPON3': '1.100', 'HITCOUNT': '2.120', 'weapon3': '2.610', 'DAMAGECOUNT': '8.634', 'FRAGCOUNT': '31.500'} [2024-08-05 23:48:51,949][52671] DAMAGECOUNT value on done: 58655.0 [2024-08-05 23:48:51,950][52671] Sum rewards: 48.302, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.050', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.218', 'weapon2': '0.424', 'ARMOR': '0.500', 'weapon4': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.580', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:51,978][52666] DAMAGECOUNT value on done: 53938.0 [2024-08-05 23:48:51,978][52666] Sum rewards: 28.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.917', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.116', 'AMMO3': '0.171', 'AMMO4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'ARMOR': '0.816', 'weapon2': '0.886', 'WEAPON3': '1.050', 'HITCOUNT': '2.210', 'weapon3': '2.478', 'DAMAGECOUNT': '9.567', 'FRAGCOUNT': '25.000'} [2024-08-05 23:48:52,533][52820] DAMAGECOUNT value on done: 56532.0 [2024-08-05 23:48:52,536][52820] Sum rewards: 51.704, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.177', 'weapon2': '0.622', 'ARMOR': '0.878', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '3.008', 'DAMAGECOUNT': '12.777', 'FRAGCOUNT': '41.000'} [2024-08-05 23:48:52,574][52663] DAMAGECOUNT value on done: 55092.0 [2024-08-05 23:48:52,578][52663] Sum rewards: 34.497, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.736', 'AMMO5': '0.017', 'AMMO2': '0.064', 'AMMO3': '0.190', 'weapon4': '0.214', 'weapon5': '0.226', 'AMMO4': '0.322', 'WEAPON5': '0.450', 'ARMOR': '0.484', 'WEAPON4': '0.750', 'weapon2': '0.942', 'WEAPON3': '1.100', 'HITCOUNT': '1.950', 'weapon3': '2.324', 'DAMAGECOUNT': '9.699', 'FRAGCOUNT': '34.000'} [2024-08-05 23:48:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 146063360. Throughput: 0: 4396.0. Samples: 36519340. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:48:52,794][52567] Avg episode reward: [(0, '40.859')] [2024-08-05 23:48:52,795][52614] Saving new best policy, reward=40.859! [2024-08-05 23:48:53,033][52650] Updated weights for policy 0, policy_version 17831 (0.0012) [2024-08-05 23:48:53,093][52670] DAMAGECOUNT value on done: 55585.0 [2024-08-05 23:48:53,094][52670] Sum rewards: 39.737, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.000', 'AMMO4': '0.001', 'HEALTH': '0.094', 'AMMO3': '0.146', 'WEAPON3': '0.850', 'ARMOR': '0.851', 'weapon2': '1.334', 'HITCOUNT': '2.430', 'weapon3': '2.452', 'DAMAGECOUNT': '9.579', 'FRAGCOUNT': '31.000'} [2024-08-05 23:48:54,026][52659] DAMAGECOUNT value on done: 56788.0 [2024-08-05 23:48:54,027][52659] Sum rewards: 45.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.212', 'weapon2': '0.296', 'ARMOR': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '3.330', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:54,414][52671] DAMAGECOUNT value on done: 57301.0 [2024-08-05 23:48:54,414][52671] Sum rewards: 48.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.196', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.508', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.990', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:54,607][52658] DAMAGECOUNT value on done: 55485.0 [2024-08-05 23:48:54,610][52658] Sum rewards: 50.113, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.378', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.740', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon3': '2.690', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '40.000'} [2024-08-05 23:48:54,929][52665] DAMAGECOUNT value on done: 53088.0 [2024-08-05 23:48:54,931][52665] Sum rewards: 35.995, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.149', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.112', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.334', 'ARMOR': '0.488', 'WEAPON3': '0.800', 'weapon2': '0.982', 'HITCOUNT': '2.310', 'weapon3': '2.430', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:54,986][52666] DAMAGECOUNT value on done: 52983.0 [2024-08-05 23:48:54,988][52666] Sum rewards: 34.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.142', 'AMMO5': '0.007', 'weapon5': '0.022', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO2': '0.053', 'AMMO3': '0.181', 'AMMO4': '0.264', 'weapon4': '0.472', 'WEAPON4': '0.700', 'weapon2': '0.836', 'WEAPON3': '1.100', 'HITCOUNT': '2.230', 'weapon3': '2.434', 'DAMAGECOUNT': '9.312', 'FRAGCOUNT': '31.500'} [2024-08-05 23:48:55,769][52820] DAMAGECOUNT value on done: 55801.0 [2024-08-05 23:48:55,770][52820] Sum rewards: 40.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.272', 'AMMO5': '0.007', 'AMMO2': '0.022', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO4': '0.112', 'weapon4': '0.144', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '3.144', 'DAMAGECOUNT': '11.346', 'FRAGCOUNT': '36.000'} [2024-08-05 23:48:55,834][52663] DAMAGECOUNT value on done: 52770.0 [2024-08-05 23:48:55,836][52663] Sum rewards: 29.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.417', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.088', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'AMMO4': '0.310', 'weapon4': '0.468', 'WEAPON4': '0.700', 'weapon2': '0.734', 'ARMOR': '0.820', 'WEAPON3': '1.100', 'HITCOUNT': '1.990', 'weapon3': '2.462', 'DAMAGECOUNT': '7.953', 'FRAGCOUNT': '30.000'} [2024-08-05 23:48:55,936][52670] DAMAGECOUNT value on done: 55903.0 [2024-08-05 23:48:55,937][52670] Sum rewards: 35.210, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.734', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.107', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.386', 'weapon2': '0.680', 'ARMOR': '0.934', 'WEAPON3': '1.250', 'HITCOUNT': '2.270', 'weapon3': '2.604', 'DAMAGECOUNT': '9.558', 'FRAGCOUNT': '29.000'} [2024-08-05 23:48:56,498][52659] DAMAGECOUNT value on done: 58571.0 [2024-08-05 23:48:56,501][52659] Sum rewards: 24.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.476', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.950', 'ARMOR': '0.955', 'WEAPON3': '1.000', 'HITCOUNT': '2.180', 'weapon3': '2.394', 'DAMAGECOUNT': '8.883', 'FRAGCOUNT': '20.000'} [2024-08-05 23:48:56,912][52671] DAMAGECOUNT value on done: 59456.0 [2024-08-05 23:48:56,914][52671] Sum rewards: 48.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.936', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.102', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.564', 'WEAPON3': '1.150', 'ARMOR': '1.327', 'HITCOUNT': '2.660', 'weapon3': '2.990', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '39.000'} [2024-08-05 23:48:57,129][52803] DAMAGECOUNT value on done: 53667.0 [2024-08-05 23:48:57,129][52803] Sum rewards: 39.880, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.138', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon5': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.368', 'WEAPON3': '0.950', 'weapon2': '1.044', 'weapon3': '2.346', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.041', 'FRAGCOUNT': '33.000'} [2024-08-05 23:48:57,718][52658] DAMAGECOUNT value on done: 58358.0 [2024-08-05 23:48:57,719][52658] Sum rewards: 39.507, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.790', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.096', 'AMMO4': '0.138', 'weapon5': '0.186', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.594', 'ARMOR': '0.974', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '2.844', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '37.000'} [2024-08-05 23:48:57,757][52660] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0)] [2024-08-05 23:48:57,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 146145280. Throughput: 0: 4388.6. Samples: 36545520. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:48:57,795][52567] Avg episode reward: [(0, '40.679')] [2024-08-05 23:48:57,802][52665] DAMAGECOUNT value on done: 52942.0 [2024-08-05 23:48:57,802][52665] Sum rewards: 27.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.626', 'AMMO5': '0.021', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.179', 'weapon4': '0.258', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.869', 'weapon2': '1.030', 'WEAPON3': '1.150', 'HITCOUNT': '1.930', 'weapon3': '2.180', 'DAMAGECOUNT': '8.826', 'FRAGCOUNT': '27.000'} [2024-08-05 23:48:57,823][52666] DAMAGECOUNT value on done: 54469.0 [2024-08-05 23:48:57,826][52666] Sum rewards: 50.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.715', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO4': '0.039', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'ARMOR': '0.433', 'weapon2': '0.940', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '2.710', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '43.000'} [2024-08-05 23:48:57,845][52650] Updated weights for policy 0, policy_version 17841 (0.0031) [2024-08-05 23:48:58,421][52664] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:48:58,647][52670] DAMAGECOUNT value on done: 51991.0 [2024-08-05 23:48:58,647][52670] Sum rewards: 34.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.996', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.454', 'weapon2': '0.956', 'WEAPON3': '1.200', 'ARMOR': '1.284', 'weapon3': '2.274', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.282', 'FRAGCOUNT': '30.000'} [2024-08-05 23:48:58,859][52659] DAMAGECOUNT value on done: 56624.0 [2024-08-05 23:48:58,861][52659] Sum rewards: 44.501, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.237', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.201', 'weapon4': '0.298', 'WEAPON4': '0.350', 'ARMOR': '0.518', 'weapon2': '0.580', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.924', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:58,866][52663] DAMAGECOUNT value on done: 55577.0 [2024-08-05 23:48:58,867][52663] Sum rewards: 39.306, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.298', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.252', 'ARMOR': '0.888', 'WEAPON3': '0.900', 'weapon2': '1.020', 'weapon3': '2.544', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '32.000'} [2024-08-05 23:48:58,966][52820] DAMAGECOUNT value on done: 53828.0 [2024-08-05 23:48:58,966][52820] Sum rewards: 43.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.024', 'weapon5': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'ARMOR': '0.874', 'weapon2': '0.914', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.812', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '38.000'} [2024-08-05 23:48:59,177][52671] DAMAGECOUNT value on done: 56856.0 [2024-08-05 23:48:59,179][52671] Sum rewards: 51.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.155', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.868', 'ARMOR': '0.924', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '44.000'} [2024-08-05 23:49:00,181][52803] DAMAGECOUNT value on done: 57721.0 [2024-08-05 23:49:00,184][52803] Sum rewards: 42.794, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.217', 'weapon4': '0.388', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:00,425][52666] DAMAGECOUNT value on done: 55680.0 [2024-08-05 23:49:00,425][52666] Sum rewards: 44.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.034', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'ARMOR': '0.820', 'weapon2': '1.124', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:00,546][52658] DAMAGECOUNT value on done: 60079.0 [2024-08-05 23:49:00,546][52658] Sum rewards: 43.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.041', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.224', 'weapon4': '0.306', 'WEAPON4': '0.500', 'ARMOR': '0.836', 'WEAPON3': '0.850', 'weapon2': '0.918', 'weapon3': '2.544', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:01,256][52670] DAMAGECOUNT value on done: 55874.0 [2024-08-05 23:49:01,257][52670] Sum rewards: 47.051, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.284', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.060', 'AMMO4': '0.112', 'weapon4': '0.114', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'weapon2': '1.194', 'weapon3': '2.458', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.148', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:01,472][52663] DAMAGECOUNT value on done: 58206.0 [2024-08-05 23:49:01,473][52663] Sum rewards: 44.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.971', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.076', 'weapon4': '0.164', 'AMMO3': '0.191', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.526', 'ARMOR': '1.286', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.998', 'DAMAGECOUNT': '10.914', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:01,612][52659] DAMAGECOUNT value on done: 57284.0 [2024-08-05 23:49:01,613][52659] Sum rewards: 39.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.114', 'weapon4': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.930', 'weapon2': '1.138', 'WEAPON3': '1.150', 'HITCOUNT': '2.200', 'weapon3': '2.404', 'DAMAGECOUNT': '9.897', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:02,039][52671] DAMAGECOUNT value on done: 58708.0 [2024-08-05 23:49:02,042][52671] Sum rewards: 29.636, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.302', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.198', 'AMMO3': '0.247', 'ARMOR': '0.501', 'WEAPON4': '0.600', 'weapon2': '0.608', 'weapon4': '0.670', 'WEAPON3': '1.450', 'HITCOUNT': '2.300', 'weapon3': '2.386', 'DAMAGECOUNT': '9.129', 'FRAGCOUNT': '31.000'} [2024-08-05 23:49:02,379][52650] Updated weights for policy 0, policy_version 17851 (0.0022) [2024-08-05 23:49:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 146235392. Throughput: 0: 4388.1. Samples: 36558750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:49:02,795][52567] Avg episode reward: [(0, '40.965')] [2024-08-05 23:49:02,795][52614] Saving new best policy, reward=40.965! [2024-08-05 23:49:03,193][52666] DAMAGECOUNT value on done: 55457.0 [2024-08-05 23:49:03,194][52666] Sum rewards: 37.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.784', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.060', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.286', 'weapon2': '0.802', 'WEAPON3': '0.950', 'ARMOR': '1.269', 'HITCOUNT': '2.290', 'weapon3': '2.574', 'DAMAGECOUNT': '9.987', 'FRAGCOUNT': '31.000'} [2024-08-05 23:49:03,268][52803] DAMAGECOUNT value on done: 53069.0 [2024-08-05 23:49:03,268][52803] Sum rewards: 42.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.095', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.702', 'ARMOR': '0.879', 'WEAPON3': '1.100', 'weapon3': '2.610', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.235', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:03,570][52811] DAMAGECOUNT value on done: 54070.0 [2024-08-05 23:49:03,571][52811] Sum rewards: 40.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.126', 'AMMO5': '0.015', 'AMMO2': '0.034', 'ARMOR': '0.040', 'weapon5': '0.102', 'AMMO3': '0.160', 'AMMO4': '0.170', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.606', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '2.874', 'DAMAGECOUNT': '10.248', 'FRAGCOUNT': '34.000'} [2024-08-05 23:49:03,610][52658] DAMAGECOUNT value on done: 55269.0 [2024-08-05 23:49:03,611][52658] Sum rewards: 31.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.717', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.360', 'ARMOR': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.722', 'DAMAGECOUNT': '9.648', 'FRAGCOUNT': '26.000'} [2024-08-05 23:49:04,010][52670] DAMAGECOUNT value on done: 54266.0 [2024-08-05 23:49:04,010][52670] Sum rewards: 43.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.308', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.066', 'weapon4': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.596', 'ARMOR': '0.853', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.944', 'DAMAGECOUNT': '11.610', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:04,344][52663] DAMAGECOUNT value on done: 56120.0 [2024-08-05 23:49:04,345][52663] Sum rewards: 35.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.290', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon4': '0.540', 'weapon2': '0.792', 'WEAPON3': '1.000', 'ARMOR': '1.266', 'HITCOUNT': '2.260', 'weapon3': '2.442', 'DAMAGECOUNT': '10.074', 'FRAGCOUNT': '30.000'} [2024-08-05 23:49:04,693][52659] DAMAGECOUNT value on done: 56225.0 [2024-08-05 23:49:04,693][52659] Sum rewards: 38.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.543', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.550', 'weapon4': '0.610', 'weapon2': '0.732', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '2.474', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:05,151][52671] DAMAGECOUNT value on done: 57768.0 [2024-08-05 23:49:05,153][52671] Sum rewards: 42.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.452', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.210', 'ARMOR': '0.800', 'weapon2': '0.862', 'WEAPON3': '1.200', 'HITCOUNT': '2.370', 'weapon3': '2.670', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '37.000'} [2024-08-05 23:49:06,383][52803] DAMAGECOUNT value on done: 53202.0 [2024-08-05 23:49:06,386][52803] Sum rewards: 52.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.102', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'ARMOR': '0.476', 'weapon2': '0.882', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '44.000'} [2024-08-05 23:49:06,671][52670] DAMAGECOUNT value on done: 54803.0 [2024-08-05 23:49:06,671][52670] Sum rewards: 42.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.230', 'ARMOR': '0.487', 'weapon2': '0.578', 'WEAPON3': '1.450', 'HITCOUNT': '2.490', 'weapon3': '2.946', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '40.000'} [2024-08-05 23:49:06,756][52811] DAMAGECOUNT value on done: 51234.0 [2024-08-05 23:49:06,760][52811] Sum rewards: 41.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.145', 'AMMO5': '0.004', 'AMMO2': '0.036', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.147', 'AMMO4': '0.179', 'WEAPON4': '0.400', 'weapon4': '0.460', 'weapon2': '0.838', 'WEAPON3': '0.900', 'weapon3': '2.430', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '9.966', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:06,856][52663] DAMAGECOUNT value on done: 58078.0 [2024-08-05 23:49:06,858][52663] Sum rewards: 45.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.248', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'weapon2': '0.868', 'ARMOR': '1.375', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '2.594', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '41.000'} [2024-08-05 23:49:07,130][52658] DAMAGECOUNT value on done: 56007.0 [2024-08-05 23:49:07,132][52658] Sum rewards: 45.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.386', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.190', 'weapon5': '0.196', 'AMMO4': '0.235', 'weapon4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon2': '0.840', 'ARMOR': '0.890', 'WEAPON3': '1.200', 'weapon3': '2.470', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:07,441][52650] Updated weights for policy 0, policy_version 17861 (0.0029) [2024-08-05 23:49:07,685][52659] DAMAGECOUNT value on done: 58894.0 [2024-08-05 23:49:07,688][52659] Sum rewards: 40.823, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.068', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.582', 'ARMOR': '0.923', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.972', 'DAMAGECOUNT': '10.935', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:07,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 146325504. Throughput: 0: 4386.2. Samples: 36585060. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-05 23:49:07,794][52567] Avg episode reward: [(0, '40.582')] [2024-08-05 23:49:08,302][52671] DAMAGECOUNT value on done: 56816.0 [2024-08-05 23:49:08,310][52671] Sum rewards: 43.974, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.548', 'AMMO5': '0.010', 'AMMO2': '0.057', 'AMMO3': '0.151', 'weapon5': '0.262', 'AMMO4': '0.287', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON4': '0.700', 'weapon4': '0.834', 'ARMOR': '0.853', 'WEAPON3': '0.950', 'weapon3': '1.962', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.938', 'FRAGCOUNT': '34.000'} [2024-08-05 23:49:09,522][52803] DAMAGECOUNT value on done: 55436.0 [2024-08-05 23:49:09,524][52803] Sum rewards: 30.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.024', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.836', 'WEAPON3': '1.200', 'HITCOUNT': '2.020', 'weapon3': '2.436', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '29.000'} [2024-08-05 23:49:09,760][52670] DAMAGECOUNT value on done: 53840.0 [2024-08-05 23:49:09,760][52670] Sum rewards: 44.500, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.423', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'ARMOR': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.046', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '42.000'} [2024-08-05 23:49:09,773][52811] DAMAGECOUNT value on done: 53453.0 [2024-08-05 23:49:09,774][52811] Sum rewards: 34.213, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.126', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'AMMO4': '0.314', 'ARMOR': '0.457', 'WEAPON4': '0.600', 'weapon4': '0.664', 'weapon2': '0.748', 'WEAPON3': '1.000', 'weapon3': '1.930', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '8.520', 'FRAGCOUNT': '31.000'} [2024-08-05 23:49:09,776][52663] DAMAGECOUNT value on done: 58884.0 [2024-08-05 23:49:09,777][52663] Sum rewards: 37.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.062', 'weapon4': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'ARMOR': '0.478', 'weapon2': '0.652', 'WEAPON3': '1.550', 'HITCOUNT': '2.490', 'weapon3': '2.852', 'DAMAGECOUNT': '10.071', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:10,167][52658] DAMAGECOUNT value on done: 59418.0 [2024-08-05 23:49:10,183][52658] Sum rewards: 36.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.961', 'AMMO5': '0.009', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.233', 'weapon5': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.350', 'ARMOR': '0.488', 'weapon2': '0.640', 'WEAPON3': '1.350', 'HITCOUNT': '2.550', 'weapon3': '2.562', 'DAMAGECOUNT': '10.404', 'FRAGCOUNT': '34.000'} [2024-08-05 23:49:10,802][52659] DAMAGECOUNT value on done: 57911.0 [2024-08-05 23:49:10,802][52659] Sum rewards: 40.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.112', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.880', 'WEAPON3': '1.200', 'ARMOR': '1.283', 'HITCOUNT': '2.320', 'weapon3': '2.672', 'DAMAGECOUNT': '10.593', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:11,218][52671] DAMAGECOUNT value on done: 61992.0 [2024-08-05 23:49:11,221][52671] Sum rewards: 42.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.404', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.136', 'AMMO3': '0.154', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.632', 'ARMOR': '0.861', 'WEAPON3': '0.950', 'HITCOUNT': '2.620', 'weapon3': '2.758', 'DAMAGECOUNT': '10.323', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:11,653][52650] Updated weights for policy 0, policy_version 17871 (0.0016) [2024-08-05 23:49:12,378][52663] DAMAGECOUNT value on done: 59156.0 [2024-08-05 23:49:12,379][52663] Sum rewards: 50.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO2': '0.036', 'ARMOR': '0.048', 'AMMO3': '0.172', 'AMMO4': '0.180', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '41.000'} [2024-08-05 23:49:12,619][52803] DAMAGECOUNT value on done: 52195.0 [2024-08-05 23:49:12,619][52803] Sum rewards: 46.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.846', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.354', 'ARMOR': '0.483', 'weapon2': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.458', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '38.000'} [2024-08-05 23:49:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 146407424. Throughput: 0: 4395.5. Samples: 36611860. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:49:12,795][52567] Avg episode reward: [(0, '40.723')] [2024-08-05 23:49:12,934][52811] DAMAGECOUNT value on done: 53108.0 [2024-08-05 23:49:12,935][52811] Sum rewards: 56.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.294', 'ARMOR': '0.400', 'weapon2': '0.702', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '46.000'} [2024-08-05 23:49:14,130][52659] DAMAGECOUNT value on done: 54166.0 [2024-08-05 23:49:14,131][52659] Sum rewards: 37.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.830', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.104', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.554', 'ARMOR': '0.903', 'WEAPON3': '1.200', 'HITCOUNT': '2.340', 'weapon3': '2.788', 'DAMAGECOUNT': '9.978', 'FRAGCOUNT': '32.000'} [2024-08-05 23:49:14,606][52671] DAMAGECOUNT value on done: 57210.0 [2024-08-05 23:49:14,607][52671] Sum rewards: 52.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.863', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.032', 'AMMO4': '0.123', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.840', 'WEAPON3': '0.900', 'ARMOR': '1.269', 'HITCOUNT': '2.600', 'weapon3': '2.708', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '43.000'} [2024-08-05 23:49:15,069][52663] DAMAGECOUNT value on done: 56209.0 [2024-08-05 23:49:15,071][52663] Sum rewards: 36.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.050', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.254', 'WEAPON4': '0.400', 'ARMOR': '0.856', 'weapon2': '0.886', 'WEAPON3': '1.500', 'HITCOUNT': '2.350', 'weapon3': '2.638', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '34.000'} [2024-08-05 23:49:15,645][52803] DAMAGECOUNT value on done: 55101.0 [2024-08-05 23:49:15,645][52803] Sum rewards: 37.650, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.470', 'AMMO5': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.122', 'AMMO3': '0.132', 'weapon4': '0.136', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.453', 'weapon2': '0.884', 'WEAPON3': '1.000', 'HITCOUNT': '2.370', 'weapon3': '2.698', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:15,867][52811] DAMAGECOUNT value on done: 52636.0 [2024-08-05 23:49:15,871][52811] Sum rewards: 43.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.908', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.237', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.782', 'ARMOR': '0.956', 'WEAPON3': '1.400', 'weapon3': '2.540', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.454', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:16,357][52650] Updated weights for policy 0, policy_version 17881 (0.0020) [2024-08-05 23:49:17,057][52659] DAMAGECOUNT value on done: 55263.0 [2024-08-05 23:49:17,058][52659] Sum rewards: 40.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.363', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.187', 'weapon2': '0.994', 'WEAPON3': '1.200', 'ARMOR': '1.321', 'HITCOUNT': '2.400', 'weapon3': '2.916', 'DAMAGECOUNT': '10.785', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:17,359][52671] DAMAGECOUNT value on done: 54725.0 [2024-08-05 23:49:17,360][52671] Sum rewards: 45.554, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.210', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.398', 'weapon4': '0.850', 'WEAPON3': '1.000', 'weapon3': '2.364', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.568', 'FRAGCOUNT': '37.000'} [2024-08-05 23:49:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.5, 300 sec: 17633.6). Total num frames: 146505728. Throughput: 0: 4403.3. Samples: 36624920. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-05 23:49:17,795][52567] Avg episode reward: [(0, '40.892')] [2024-08-05 23:49:18,759][52803] DAMAGECOUNT value on done: 53288.0 [2024-08-05 23:49:18,760][52803] Sum rewards: 43.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO2': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.048', 'weapon5': '0.054', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon2': '0.864', 'WEAPON3': '1.000', 'ARMOR': '1.387', 'HITCOUNT': '2.630', 'weapon3': '2.776', 'DAMAGECOUNT': '11.106', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:19,008][52811] DAMAGECOUNT value on done: 55328.0 [2024-08-05 23:49:19,010][52811] Sum rewards: 44.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.366', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.040', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'ARMOR': '0.860', 'WEAPON3': '1.050', 'weapon2': '1.112', 'HITCOUNT': '2.340', 'weapon3': '2.432', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '40.000'} [2024-08-05 23:49:19,826][52659] DAMAGECOUNT value on done: 59513.0 [2024-08-05 23:49:19,827][52659] Sum rewards: 50.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'ARMOR': '0.471', 'weapon4': '0.570', 'weapon2': '0.760', 'WEAPON3': '1.200', 'weapon3': '2.356', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '44.000'} [2024-08-05 23:49:20,145][52671] DAMAGECOUNT value on done: 59096.0 [2024-08-05 23:49:20,146][52671] Sum rewards: 36.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.860', 'AMMO2': '0.001', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'weapon4': '0.142', 'AMMO3': '0.254', 'weapon2': '0.900', 'ARMOR': '1.359', 'WEAPON3': '1.650', 'HITCOUNT': '2.190', 'weapon3': '2.772', 'DAMAGECOUNT': '9.843', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:21,059][52650] Updated weights for policy 0, policy_version 17891 (0.0015) [2024-08-05 23:49:21,932][52803] DAMAGECOUNT value on done: 55885.0 [2024-08-05 23:49:21,932][52803] Sum rewards: 46.029, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.096', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.254', 'ARMOR': '0.500', 'weapon2': '0.806', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.702', 'DAMAGECOUNT': '10.842', 'FRAGCOUNT': '37.000'} [2024-08-05 23:49:22,054][52811] DAMAGECOUNT value on done: 56000.0 [2024-08-05 23:49:22,056][52811] Sum rewards: 37.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.414', 'AMMO5': '0.015', 'weapon5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.052', 'AMMO4': '0.158', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.536', 'weapon2': '0.576', 'WEAPON3': '1.050', 'HITCOUNT': '2.250', 'weapon3': '3.108', 'DAMAGECOUNT': '9.870', 'FRAGCOUNT': '32.000'} [2024-08-05 23:49:22,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 146595840. Throughput: 0: 4407.3. Samples: 36651460. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 23:49:22,794][52567] Avg episode reward: [(0, '40.980')] [2024-08-05 23:49:22,795][52614] Saving new best policy, reward=40.980! [2024-08-05 23:49:22,893][52659] DAMAGECOUNT value on done: 56809.0 [2024-08-05 23:49:22,894][52659] Sum rewards: 34.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.084', 'AMMO5': '0.017', 'AMMO2': '0.052', 'ARMOR': '0.068', 'weapon5': '0.096', 'AMMO3': '0.191', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON4': '0.550', 'weapon2': '0.564', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.652', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '31.000'} [2024-08-05 23:49:23,161][52671] DAMAGECOUNT value on done: 58796.0 [2024-08-05 23:49:23,161][52671] Sum rewards: 49.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.568', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.568', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.409', 'FRAGCOUNT': '43.000'} [2024-08-05 23:49:25,225][52811] DAMAGECOUNT value on done: 52882.0 [2024-08-05 23:49:25,225][52811] Sum rewards: 49.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.754', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.033', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.538', 'ARMOR': '1.293', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.252', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '41.000'} [2024-08-05 23:49:25,285][52803] DAMAGECOUNT value on done: 51067.0 [2024-08-05 23:49:25,288][52803] Sum rewards: 36.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.552', 'AMMO5': '0.014', 'weapon5': '0.024', 'AMMO2': '0.052', 'AMMO3': '0.214', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'weapon4': '0.308', 'ARMOR': '0.457', 'WEAPON4': '0.550', 'weapon2': '0.872', 'WEAPON3': '1.350', 'HITCOUNT': '2.340', 'weapon3': '2.540', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '33.500'} [2024-08-05 23:49:25,447][52659] DAMAGECOUNT value on done: 56906.0 [2024-08-05 23:49:25,449][52659] Sum rewards: 41.914, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.675', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.138', 'weapon5': '0.158', 'WEAPON4': '0.200', 'ARMOR': '0.485', 'weapon4': '0.528', 'weapon2': '0.586', 'WEAPON3': '0.850', 'HITCOUNT': '2.330', 'weapon3': '2.500', 'DAMAGECOUNT': '10.581', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:25,537][52650] Updated weights for policy 0, policy_version 17901 (0.0021) [2024-08-05 23:49:25,897][52671] DAMAGECOUNT value on done: 59050.0 [2024-08-05 23:49:25,899][52671] Sum rewards: 39.455, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon5': '0.076', 'weapon4': '0.122', 'AMMO4': '0.142', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '1.038', 'WEAPON3': '1.050', 'weapon3': '2.472', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 146677760. Throughput: 0: 4399.3. Samples: 36677760. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 23:49:27,794][52567] Avg episode reward: [(0, '41.081')] [2024-08-05 23:49:27,797][52614] Saving new best policy, reward=41.081! [2024-08-05 23:49:28,422][52659] DAMAGECOUNT value on done: 54366.0 [2024-08-05 23:49:28,422][52659] Sum rewards: 27.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.181', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.998', 'WEAPON3': '1.300', 'weapon3': '2.318', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.219', 'FRAGCOUNT': '25.000'} [2024-08-05 23:49:28,481][52811] DAMAGECOUNT value on done: 54399.0 [2024-08-05 23:49:28,481][52811] Sum rewards: 49.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.707', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'AMMO3': '0.263', 'ARMOR': '0.498', 'weapon2': '0.612', 'WEAPON3': '1.600', 'weapon3': '2.816', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '45.000'} [2024-08-05 23:49:28,498][52803] DAMAGECOUNT value on done: 57326.0 [2024-08-05 23:49:28,499][52803] Sum rewards: 45.506, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.708', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.078', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.782', 'ARMOR': '1.341', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '38.000'} [2024-08-05 23:49:28,923][52671] DAMAGECOUNT value on done: 56218.0 [2024-08-05 23:49:28,924][52671] Sum rewards: 38.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.278', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.157', 'AMMO4': '0.217', 'weapon5': '0.224', 'weapon4': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.706', 'ARMOR': '0.870', 'WEAPON3': '1.050', 'HITCOUNT': '2.270', 'weapon3': '2.440', 'DAMAGECOUNT': '9.657', 'FRAGCOUNT': '34.000'} [2024-08-05 23:49:29,980][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:49:30,370][52650] Updated weights for policy 0, policy_version 17911 (0.0011) [2024-08-05 23:49:31,105][52659] DAMAGECOUNT value on done: 56256.0 [2024-08-05 23:49:31,107][52659] Sum rewards: 46.970, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.368', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.228', 'AMMO3': '0.297', 'weapon2': '0.494', 'ARMOR': '0.880', 'WEAPON3': '1.800', 'HITCOUNT': '2.770', 'weapon3': '2.846', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '44.000'} [2024-08-05 23:49:31,452][52671] DAMAGECOUNT value on done: 55386.0 [2024-08-05 23:49:31,453][52671] Sum rewards: 26.223, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.505', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.031', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.412', 'weapon4': '0.726', 'weapon2': '0.778', 'WEAPON3': '1.050', 'HITCOUNT': '1.650', 'weapon3': '1.958', 'DAMAGECOUNT': '6.612', 'FRAGCOUNT': '24.000'} [2024-08-05 23:49:31,520][52811] DAMAGECOUNT value on done: 53754.0 [2024-08-05 23:49:31,520][52811] Sum rewards: 44.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.216', 'AMMO2': '0.022', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.218', 'ARMOR': '0.400', 'weapon2': '1.032', 'WEAPON3': '1.100', 'weapon3': '2.576', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:31,589][52803] DAMAGECOUNT value on done: 54342.0 [2024-08-05 23:49:31,590][52803] Sum rewards: 49.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.156', 'AMMO4': '0.176', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.400', 'ARMOR': '0.457', 'weapon2': '0.854', 'WEAPON3': '1.250', 'weapon3': '2.548', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '42.000'} [2024-08-05 23:49:32,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 146759680. Throughput: 0: 4396.2. Samples: 36690700. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-05 23:49:32,795][52567] Avg episode reward: [(0, '41.291')] [2024-08-05 23:49:32,795][52614] Saving new best policy, reward=41.291! [2024-08-05 23:49:34,102][52659] DAMAGECOUNT value on done: 57240.0 [2024-08-05 23:49:34,104][52659] Sum rewards: 32.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.335', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.148', 'AMMO3': '0.170', 'AMMO4': '0.259', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.604', 'ARMOR': '0.844', 'WEAPON3': '1.050', 'HITCOUNT': '1.960', 'weapon3': '2.710', 'DAMAGECOUNT': '8.934', 'FRAGCOUNT': '28.000'} [2024-08-05 23:49:34,697][52803] DAMAGECOUNT value on done: 52413.0 [2024-08-05 23:49:34,698][52803] Sum rewards: 42.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.671', 'AMMO5': '0.004', 'weapon4': '0.010', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.624', 'ARMOR': '0.847', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '3.150', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '38.000'} [2024-08-05 23:49:34,726][52811] DAMAGECOUNT value on done: 57112.0 [2024-08-05 23:49:34,727][52811] Sum rewards: 41.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.083', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.173', 'AMMO3': '0.202', 'weapon4': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.650', 'ARMOR': '0.874', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '2.740', 'DAMAGECOUNT': '10.566', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:34,963][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:49:35,527][52650] Updated weights for policy 0, policy_version 17921 (0.0033) [2024-08-05 23:49:35,638][52649] DAMAGECOUNT value on done: 56197.0 [2024-08-05 23:49:35,638][52649] Sum rewards: 37.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.087', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.454', 'weapon2': '0.840', 'ARMOR': '0.851', 'WEAPON3': '1.300', 'HITCOUNT': '2.030', 'weapon3': '2.226', 'DAMAGECOUNT': '10.191', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:36,855][52659] DAMAGECOUNT value on done: 62967.0 [2024-08-05 23:49:36,855][52659] Sum rewards: 31.612, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.068', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.209', 'weapon4': '0.386', 'WEAPON4': '0.500', 'weapon2': '0.846', 'WEAPON3': '1.300', 'ARMOR': '1.332', 'HITCOUNT': '2.360', 'weapon3': '2.448', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '28.500'} [2024-08-05 23:49:37,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17633.6). Total num frames: 146857984. Throughput: 0: 4386.9. Samples: 36716750. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:49:37,795][52567] Avg episode reward: [(0, '41.207')] [2024-08-05 23:49:37,847][52803] DAMAGECOUNT value on done: 54355.0 [2024-08-05 23:49:37,848][52803] Sum rewards: 46.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.194', 'AMMO3': '0.199', 'AMMO4': '0.208', 'WEAPON5': '0.350', 'ARMOR': '0.420', 'WEAPON4': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.874', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '41.000'} [2024-08-05 23:49:37,872][52811] DAMAGECOUNT value on done: 51280.0 [2024-08-05 23:49:37,874][52811] Sum rewards: 49.424, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.452', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon2': '0.774', 'ARMOR': '0.852', 'WEAPON3': '0.950', 'HITCOUNT': '2.610', 'weapon3': '2.876', 'DAMAGECOUNT': '10.494', 'FRAGCOUNT': '40.000'} [2024-08-05 23:49:38,708][52649] DAMAGECOUNT value on done: 56599.0 [2024-08-05 23:49:38,708][52649] Sum rewards: 47.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.726', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.138', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.224', 'WEAPON4': '0.250', 'ARMOR': '0.854', 'weapon2': '0.856', 'WEAPON3': '0.950', 'weapon3': '2.572', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '40.000'} [2024-08-05 23:49:39,580][52650] Updated weights for policy 0, policy_version 17931 (0.0012) [2024-08-05 23:49:40,035][52659] DAMAGECOUNT value on done: 56690.0 [2024-08-05 23:49:40,038][52659] Sum rewards: 43.102, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.632', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.050', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'AMMO4': '0.230', 'WEAPON4': '0.450', 'weapon4': '0.698', 'WEAPON3': '0.800', 'weapon2': '0.860', 'ARMOR': '1.200', 'weapon3': '2.152', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '9.927', 'FRAGCOUNT': '32.000'} [2024-08-05 23:49:40,916][52811] DAMAGECOUNT value on done: 55307.0 [2024-08-05 23:49:40,917][52811] Sum rewards: 41.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.473', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon4': '0.398', 'ARMOR': '0.538', 'WEAPON4': '0.550', 'weapon2': '0.724', 'WEAPON3': '1.300', 'weapon3': '2.612', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:41,000][52664] DAMAGECOUNT value on done: 59256.0 [2024-08-05 23:49:41,000][52664] Sum rewards: 45.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.453', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.217', 'weapon4': '0.364', 'WEAPON4': '0.400', 'ARMOR': '0.456', 'weapon2': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '41.000'} [2024-08-05 23:49:41,023][52803] DAMAGECOUNT value on done: 52778.0 [2024-08-05 23:49:41,025][52803] Sum rewards: 31.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.365', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.236', 'weapon2': '0.314', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'weapon4': '1.054', 'WEAPON3': '1.300', 'HITCOUNT': '2.180', 'weapon3': '2.308', 'DAMAGECOUNT': '9.150', 'FRAGCOUNT': '29.000'} [2024-08-05 23:49:41,183][52649] DAMAGECOUNT value on done: 56530.0 [2024-08-05 23:49:41,185][52649] Sum rewards: 51.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.206', 'weapon4': '0.222', 'ARMOR': '0.454', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '42.000'} [2024-08-05 23:49:42,795][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 146939904. Throughput: 0: 4395.3. Samples: 36743310. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:49:42,795][52567] Avg episode reward: [(0, '41.395')] [2024-08-05 23:49:42,881][52614] Saving new best policy, reward=41.395! [2024-08-05 23:49:43,107][52659] DAMAGECOUNT value on done: 57479.0 [2024-08-05 23:49:43,108][52659] Sum rewards: 40.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.708', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.264', 'weapon2': '1.030', 'WEAPON3': '1.100', 'ARMOR': '1.334', 'weapon3': '2.542', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.431', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:43,784][52664] DAMAGECOUNT value on done: 59096.0 [2024-08-05 23:49:43,785][52664] Sum rewards: 27.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.494', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '1.006', 'WEAPON3': '1.250', 'ARMOR': '1.290', 'HITCOUNT': '2.170', 'weapon3': '2.322', 'DAMAGECOUNT': '8.772', 'FRAGCOUNT': '23.500'} [2024-08-05 23:49:44,158][52811] DAMAGECOUNT value on done: 52822.0 [2024-08-05 23:49:44,158][52811] Sum rewards: 44.999, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.310', 'ARMOR': '0.424', 'weapon2': '0.830', 'WEAPON3': '0.900', 'HITCOUNT': '2.460', 'weapon3': '2.556', 'DAMAGECOUNT': '11.328', 'FRAGCOUNT': '37.000'} [2024-08-05 23:49:44,199][52803] DAMAGECOUNT value on done: 50559.0 [2024-08-05 23:49:44,200][52803] Sum rewards: 30.449, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.590', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.068', 'AMMO3': '0.132', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'ARMOR': '0.860', 'weapon2': '0.902', 'weapon4': '0.998', 'weapon3': '1.704', 'HITCOUNT': '2.180', 'DAMAGECOUNT': '8.472', 'FRAGCOUNT': '24.000'} [2024-08-05 23:49:44,399][52649] DAMAGECOUNT value on done: 55377.0 [2024-08-05 23:49:44,400][52649] Sum rewards: 46.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.998', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.040', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO3': '0.208', 'weapon2': '0.568', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.884', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '41.000'} [2024-08-05 23:49:44,631][52650] Updated weights for policy 0, policy_version 17941 (0.0012) [2024-08-05 23:49:45,352][52659] DAMAGECOUNT value on done: 56953.0 [2024-08-05 23:49:45,353][52659] Sum rewards: 43.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon4': '0.392', 'ARMOR': '0.400', 'weapon2': '0.706', 'WEAPON3': '1.350', 'weapon3': '2.702', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '37.000'} [2024-08-05 23:49:46,286][52664] DAMAGECOUNT value on done: 60488.0 [2024-08-05 23:49:46,287][52664] Sum rewards: 41.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.338', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.114', 'AMMO3': '0.140', 'AMMO4': '0.316', 'WEAPON5': '0.400', 'ARMOR': '0.470', 'weapon2': '0.714', 'weapon4': '0.714', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.130', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '10.299', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:47,236][52803] DAMAGECOUNT value on done: 54048.0 [2024-08-05 23:49:47,239][52803] Sum rewards: 49.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'ARMOR': '0.455', 'weapon2': '0.744', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.090', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '44.000'} [2024-08-05 23:49:47,371][52811] DAMAGECOUNT value on done: 54404.0 [2024-08-05 23:49:47,371][52811] Sum rewards: 45.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.064', 'AMMO4': '0.146', 'AMMO3': '0.166', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '38.000'} [2024-08-05 23:49:47,689][52649] DAMAGECOUNT value on done: 55270.0 [2024-08-05 23:49:47,689][52649] Sum rewards: 44.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.191', 'weapon2': '0.722', 'ARMOR': '0.928', 'WEAPON3': '1.150', 'HITCOUNT': '2.290', 'weapon3': '2.958', 'DAMAGECOUNT': '10.356', 'FRAGCOUNT': '38.000'} [2024-08-05 23:49:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 147030016. Throughput: 0: 4391.5. Samples: 36756370. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-05 23:49:47,795][52567] Avg episode reward: [(0, '41.444')] [2024-08-05 23:49:47,797][52614] Saving new best policy, reward=41.444! [2024-08-05 23:49:48,394][52659] DAMAGECOUNT value on done: 59613.0 [2024-08-05 23:49:48,394][52659] Sum rewards: 40.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.494', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon5': '0.442', 'weapon2': '0.828', 'WEAPON3': '1.300', 'ARMOR': '1.313', 'HITCOUNT': '2.100', 'weapon3': '2.554', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:49,016][52650] Updated weights for policy 0, policy_version 17951 (0.0029) [2024-08-05 23:49:49,092][52664] DAMAGECOUNT value on done: 59756.0 [2024-08-05 23:49:49,093][52664] Sum rewards: 37.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.288', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.239', 'weapon2': '0.456', 'ARMOR': '1.256', 'WEAPON3': '1.450', 'HITCOUNT': '2.400', 'weapon3': '3.378', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:49,612][52662] DAMAGECOUNT value on done: 63112.0 [2024-08-05 23:49:49,613][52662] Sum rewards: 42.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.528', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.211', 'WEAPON4': '0.400', 'weapon4': '0.404', 'weapon2': '0.596', 'ARMOR': '0.836', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.770', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '38.000'} [2024-08-05 23:49:50,250][52803] DAMAGECOUNT value on done: 53070.0 [2024-08-05 23:49:50,252][52803] Sum rewards: 33.086, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.357', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'ARMOR': '0.479', 'weapon4': '0.642', 'weapon2': '0.812', 'WEAPON3': '1.050', 'HITCOUNT': '2.210', 'weapon3': '2.362', 'DAMAGECOUNT': '8.898', 'FRAGCOUNT': '27.000'} [2024-08-05 23:49:50,629][52811] DAMAGECOUNT value on done: 54035.0 [2024-08-05 23:49:50,629][52811] Sum rewards: 38.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon4': '0.292', 'ARMOR': '0.472', 'weapon2': '0.582', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '2.978', 'DAMAGECOUNT': '10.650', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:50,756][52649] DAMAGECOUNT value on done: 54164.0 [2024-08-05 23:49:50,756][52649] Sum rewards: 34.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.651', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.201', 'weapon5': '0.256', 'WEAPON5': '0.300', 'ARMOR': '0.412', 'weapon4': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon2': '1.272', 'weapon3': '1.730', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '8.601', 'FRAGCOUNT': '32.000'} [2024-08-05 23:49:51,691][52664] DAMAGECOUNT value on done: 57461.0 [2024-08-05 23:49:51,692][52664] Sum rewards: 32.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.043', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.054', 'weapon4': '0.154', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon2': '0.830', 'WEAPON3': '1.250', 'HITCOUNT': '2.380', 'weapon3': '2.736', 'DAMAGECOUNT': '10.272', 'FRAGCOUNT': '27.500'} [2024-08-05 23:49:52,517][52662] DAMAGECOUNT value on done: 64037.0 [2024-08-05 23:49:52,518][52662] Sum rewards: 37.464, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.294', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'ARMOR': '0.800', 'WEAPON3': '1.050', 'weapon2': '1.360', 'HITCOUNT': '2.200', 'weapon3': '2.476', 'DAMAGECOUNT': '9.453', 'FRAGCOUNT': '30.000'} [2024-08-05 23:49:52,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 147120128. Throughput: 0: 4387.6. Samples: 36782500. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:49:52,794][52567] Avg episode reward: [(0, '41.411')] [2024-08-05 23:49:53,008][52666] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:49:53,209][52668] DAMAGECOUNT value on done: 56599.0 [2024-08-05 23:49:53,210][52668] Sum rewards: 35.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.944', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'ARMOR': '0.820', 'weapon2': '1.046', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '2.566', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '31.000'} [2024-08-05 23:49:53,459][52803] DAMAGECOUNT value on done: 54776.0 [2024-08-05 23:49:53,467][52803] Sum rewards: 37.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.696', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.188', 'AMMO3': '0.232', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'ARMOR': '0.523', 'WEAPON4': '0.550', 'weapon4': '0.646', 'weapon2': '0.832', 'WEAPON3': '1.450', 'weapon3': '1.980', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '34.000'} [2024-08-05 23:49:53,680][52811] DAMAGECOUNT value on done: 54063.0 [2024-08-05 23:49:53,681][52811] Sum rewards: 41.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.832', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon5': '0.082', 'AMMO3': '0.131', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'weapon4': '0.540', 'WEAPON4': '0.600', 'weapon2': '0.802', 'WEAPON3': '0.850', 'ARMOR': '0.874', 'weapon3': '2.304', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.419', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:53,690][52649] DAMAGECOUNT value on done: 53272.0 [2024-08-05 23:49:53,692][52649] Sum rewards: 45.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.093', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.470', 'weapon2': '0.522', 'ARMOR': '0.855', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '39.000'} [2024-08-05 23:49:54,112][52794] DAMAGECOUNT value on done: 62900.0 [2024-08-05 23:49:54,115][52794] Sum rewards: 41.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.024', 'weapon5': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.962', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:54,132][52650] Updated weights for policy 0, policy_version 17961 (0.0023) [2024-08-05 23:49:54,894][52664] DAMAGECOUNT value on done: 63588.0 [2024-08-05 23:49:54,895][52664] Sum rewards: 42.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.134', 'AMMO4': '0.183', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.944', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '37.000'} [2024-08-05 23:49:55,602][52662] DAMAGECOUNT value on done: 65604.0 [2024-08-05 23:49:55,602][52662] Sum rewards: 42.445, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.239', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.151', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.770', 'WEAPON3': '0.850', 'ARMOR': '0.859', 'HITCOUNT': '2.630', 'weapon3': '2.758', 'DAMAGECOUNT': '11.298', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:56,442][52668] DAMAGECOUNT value on done: 60453.0 [2024-08-05 23:49:56,442][52668] Sum rewards: 38.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.115', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'ARMOR': '0.852', 'weapon2': '0.890', 'WEAPON3': '1.100', 'HITCOUNT': '2.370', 'weapon3': '2.830', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:56,490][52803] DAMAGECOUNT value on done: 53348.0 [2024-08-05 23:49:56,493][52803] Sum rewards: 36.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.604', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.900', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '10.815', 'FRAGCOUNT': '33.000'} [2024-08-05 23:49:56,592][52649] DAMAGECOUNT value on done: 58259.0 [2024-08-05 23:49:56,593][52649] Sum rewards: 47.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.856', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.145', 'AMMO3': '0.170', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.590', 'ARMOR': '0.944', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.742', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '42.000'} [2024-08-05 23:49:56,863][52811] DAMAGECOUNT value on done: 56903.0 [2024-08-05 23:49:56,864][52811] Sum rewards: 40.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.682', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.212', 'weapon5': '0.274', 'AMMO4': '0.292', 'WEAPON5': '0.400', 'weapon4': '0.440', 'ARMOR': '0.483', 'weapon2': '0.518', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.454', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '37.000'} [2024-08-05 23:49:57,084][52794] DAMAGECOUNT value on done: 62472.0 [2024-08-05 23:49:57,087][52794] Sum rewards: 37.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.014', 'AMMO2': '0.041', 'ARMOR': '0.056', 'weapon5': '0.110', 'AMMO4': '0.207', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.450', 'weapon2': '0.596', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.740', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '35.000'} [2024-08-05 23:49:57,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17476.4, 300 sec: 17578.2). Total num frames: 147193856. Throughput: 0: 4379.1. Samples: 36808920. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-05 23:49:57,794][52567] Avg episode reward: [(0, '41.196')] [2024-08-05 23:49:58,144][52664] DAMAGECOUNT value on done: 59160.0 [2024-08-05 23:49:58,144][52664] Sum rewards: 43.911, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.115', 'AMMO4': '0.173', 'WEAPON4': '0.400', 'ARMOR': '0.508', 'weapon4': '0.696', 'WEAPON3': '0.750', 'weapon2': '0.810', 'weapon3': '2.274', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.281', 'FRAGCOUNT': '36.000'} [2024-08-05 23:49:58,484][52662] DAMAGECOUNT value on done: 59343.0 [2024-08-05 23:49:58,493][52662] Sum rewards: 34.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.844', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.174', 'AMMO4': '0.177', 'weapon4': '0.186', 'weapon5': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.588', 'WEAPON3': '1.100', 'ARMOR': '1.391', 'HITCOUNT': '2.190', 'weapon3': '2.664', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '29.500'} [2024-08-05 23:49:58,546][52650] Updated weights for policy 0, policy_version 17971 (0.0029) [2024-08-05 23:49:59,436][52649] DAMAGECOUNT value on done: 54094.0 [2024-08-05 23:49:59,437][52649] Sum rewards: 49.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.673', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.168', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.116', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '41.000'} [2024-08-05 23:49:59,538][52668] DAMAGECOUNT value on done: 55488.0 [2024-08-05 23:49:59,538][52668] Sum rewards: 52.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.568', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.123', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.784', 'WEAPON3': '1.050', 'ARMOR': '1.312', 'weapon3': '2.598', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '47.000'} [2024-08-05 23:49:59,859][52811] DAMAGECOUNT value on done: 51337.0 [2024-08-05 23:49:59,862][52811] Sum rewards: 34.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.856', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.142', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.712', 'WEAPON3': '1.300', 'HITCOUNT': '2.140', 'weapon3': '2.852', 'DAMAGECOUNT': '9.318', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:00,028][52795] DAMAGECOUNT value on done: 55300.0 [2024-08-05 23:50:00,029][52795] Sum rewards: 45.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.950', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.460', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:00,190][52794] DAMAGECOUNT value on done: 60091.0 [2024-08-05 23:50:00,192][52794] Sum rewards: 20.444, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.448', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.038', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.114', 'AMMO3': '0.148', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.644', 'WEAPON3': '0.850', 'ARMOR': '0.899', 'weapon4': '1.234', 'HITCOUNT': '1.570', 'weapon3': '1.594', 'DAMAGECOUNT': '6.477', 'FRAGCOUNT': '16.000'} [2024-08-05 23:50:01,196][52664] DAMAGECOUNT value on done: 55763.0 [2024-08-05 23:50:01,196][52664] Sum rewards: 47.832, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.392', 'AMMO2': '0.025', 'ARMOR': '0.036', 'AMMO4': '0.125', 'AMMO3': '0.133', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.722', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.712', 'DAMAGECOUNT': '10.383', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:01,518][52662] DAMAGECOUNT value on done: 61236.0 [2024-08-05 23:50:01,518][52662] Sum rewards: 44.224, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.584', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.242', 'weapon2': '0.778', 'ARMOR': '1.384', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '2.980', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '41.000'} [2024-08-05 23:50:02,178][52649] DAMAGECOUNT value on done: 54386.0 [2024-08-05 23:50:02,179][52649] Sum rewards: 34.654, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.268', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.150', 'AMMO3': '0.239', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.550', 'weapon2': '0.878', 'WEAPON3': '1.400', 'ARMOR': '1.426', 'weapon3': '2.296', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.896', 'FRAGCOUNT': '32.000'} [2024-08-05 23:50:02,672][52668] DAMAGECOUNT value on done: 57353.0 [2024-08-05 23:50:02,673][52668] Sum rewards: 39.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.116', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.034', 'ARMOR': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'weapon4': '0.472', 'weapon2': '0.494', 'WEAPON3': '1.300', 'HITCOUNT': '2.600', 'weapon3': '2.782', 'DAMAGECOUNT': '11.229', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 147292160. Throughput: 0: 4385.3. Samples: 36822260. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-05 23:50:02,794][52567] Avg episode reward: [(0, '41.329')] [2024-08-05 23:50:02,915][52811] DAMAGECOUNT value on done: 53399.0 [2024-08-05 23:50:02,917][52811] Sum rewards: 36.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.014', 'weapon5': '0.052', 'AMMO2': '0.055', 'AMMO3': '0.162', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'ARMOR': '0.444', 'weapon4': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon2': '1.296', 'weapon3': '1.822', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '10.212', 'FRAGCOUNT': '32.000'} [2024-08-05 23:50:03,145][52795] DAMAGECOUNT value on done: 50136.0 [2024-08-05 23:50:03,145][52795] Sum rewards: 33.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.543', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.176', 'weapon4': '0.384', 'WEAPON4': '0.400', 'weapon2': '0.720', 'WEAPON3': '1.250', 'ARMOR': '1.326', 'HITCOUNT': '2.390', 'weapon3': '2.752', 'DAMAGECOUNT': '9.375', 'FRAGCOUNT': '29.000'} [2024-08-05 23:50:03,163][52794] DAMAGECOUNT value on done: 58428.0 [2024-08-05 23:50:03,163][52794] Sum rewards: 45.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.488', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.108', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.768', 'WEAPON3': '1.200', 'ARMOR': '1.308', 'weapon3': '2.566', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:03,523][52650] Updated weights for policy 0, policy_version 17981 (0.0037) [2024-08-05 23:50:04,390][52664] DAMAGECOUNT value on done: 65750.0 [2024-08-05 23:50:04,391][52664] Sum rewards: 35.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.190', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon4': '0.272', 'AMMO4': '0.285', 'ARMOR': '0.428', 'weapon2': '0.570', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '2.892', 'DAMAGECOUNT': '10.854', 'FRAGCOUNT': '32.500'} [2024-08-05 23:50:04,653][52662] DAMAGECOUNT value on done: 63289.0 [2024-08-05 23:50:04,655][52662] Sum rewards: 50.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.706', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon4': '0.172', 'AMMO4': '0.210', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'ARMOR': '0.436', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.020', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '43.000'} [2024-08-05 23:50:04,674][52649] DAMAGECOUNT value on done: 56570.0 [2024-08-05 23:50:04,674][52649] Sum rewards: 31.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon4': '0.358', 'weapon2': '0.768', 'ARMOR': '0.891', 'WEAPON3': '1.400', 'HITCOUNT': '2.340', 'weapon3': '2.684', 'DAMAGECOUNT': '9.930', 'FRAGCOUNT': '28.000'} [2024-08-05 23:50:04,906][52660] DAMAGECOUNT value on done: 57839.0 [2024-08-05 23:50:04,906][52660] Sum rewards: 31.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.012', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.082', 'AMMO4': '0.165', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.400', 'ARMOR': '0.893', 'weapon2': '1.062', 'WEAPON3': '1.200', 'HITCOUNT': '2.260', 'weapon3': '2.288', 'DAMAGECOUNT': '9.552', 'FRAGCOUNT': '29.500'} [2024-08-05 23:50:05,919][52668] DAMAGECOUNT value on done: 58145.0 [2024-08-05 23:50:05,919][52668] Sum rewards: 46.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.403', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.219', 'weapon4': '0.414', 'WEAPON4': '0.450', 'weapon2': '0.626', 'ARMOR': '0.871', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.592', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:06,250][52795] DAMAGECOUNT value on done: 51896.0 [2024-08-05 23:50:06,250][52795] Sum rewards: 37.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.953', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.195', 'weapon5': '0.206', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'ARMOR': '0.428', 'weapon4': '0.468', 'WEAPON4': '0.700', 'weapon2': '0.758', 'WEAPON3': '1.200', 'weapon3': '2.262', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.962', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:06,295][52794] DAMAGECOUNT value on done: 60297.0 [2024-08-05 23:50:06,297][52794] Sum rewards: 37.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.909', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.124', 'AMMO3': '0.183', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.342', 'ARMOR': '0.408', 'weapon2': '0.544', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.756', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '29.500'} [2024-08-05 23:50:07,146][52664] DAMAGECOUNT value on done: 60836.0 [2024-08-05 23:50:07,146][52664] Sum rewards: 50.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.006', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.310', 'ARMOR': '0.400', 'weapon2': '0.582', 'WEAPON3': '1.450', 'weapon3': '2.892', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '45.000'} [2024-08-05 23:50:07,386][52649] DAMAGECOUNT value on done: 56851.0 [2024-08-05 23:50:07,388][52649] Sum rewards: 32.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.495', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.145', 'weapon5': '0.146', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.492', 'weapon4': '0.502', 'weapon2': '0.518', 'WEAPON3': '0.850', 'HITCOUNT': '2.040', 'weapon3': '2.674', 'DAMAGECOUNT': '9.057', 'FRAGCOUNT': '28.000'} [2024-08-05 23:50:07,624][52662] DAMAGECOUNT value on done: 64109.0 [2024-08-05 23:50:07,636][52662] Sum rewards: 47.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'ARMOR': '0.454', 'weapon2': '0.702', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '3.004', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:07,662][52650] Updated weights for policy 0, policy_version 17991 (0.0019) [2024-08-05 23:50:07,682][52660] DAMAGECOUNT value on done: 60960.0 [2024-08-05 23:50:07,682][52660] Sum rewards: 37.471, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.276', 'AMMO5': '0.021', 'AMMO2': '0.068', 'weapon5': '0.184', 'AMMO3': '0.213', 'AMMO4': '0.342', 'weapon4': '0.398', 'WEAPON5': '0.550', 'weapon2': '0.832', 'WEAPON4': '0.850', 'ARMOR': '0.873', 'WEAPON3': '1.300', 'weapon3': '2.200', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 147382272. Throughput: 0: 4374.2. Samples: 36848300. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-05 23:50:07,794][52567] Avg episode reward: [(0, '41.064')] [2024-08-05 23:50:08,596][52668] DAMAGECOUNT value on done: 59748.0 [2024-08-05 23:50:08,596][52668] Sum rewards: 40.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.199', 'AMMO4': '0.254', 'weapon5': '0.256', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON4': '0.650', 'weapon2': '0.878', 'ARMOR': '0.967', 'WEAPON3': '1.200', 'weapon3': '2.088', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:08,959][52794] DAMAGECOUNT value on done: 64073.0 [2024-08-05 23:50:08,960][52794] Sum rewards: 49.232, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.266', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.068', 'weapon4': '0.070', 'AMMO4': '0.099', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'ARMOR': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.700', 'HITCOUNT': '2.940', 'weapon3': '3.156', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '46.000'} [2024-08-05 23:50:09,485][52795] DAMAGECOUNT value on done: 54760.0 [2024-08-05 23:50:09,485][52795] Sum rewards: 44.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.038', 'weapon4': '0.064', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.374', 'ARMOR': '0.428', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '3.284', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '40.500'} [2024-08-05 23:50:10,062][52662] DAMAGECOUNT value on done: 68003.0 [2024-08-05 23:50:10,064][52662] Sum rewards: 56.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.768', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon4': '0.304', 'ARMOR': '0.420', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '46.000'} [2024-08-05 23:50:10,190][52664] DAMAGECOUNT value on done: 61574.0 [2024-08-05 23:50:10,191][52664] Sum rewards: 39.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.290', 'ARMOR': '0.427', 'WEAPON3': '1.050', 'weapon2': '1.064', 'weapon3': '2.432', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:10,431][52660] DAMAGECOUNT value on done: 58913.0 [2024-08-05 23:50:10,435][52660] Sum rewards: 45.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.506', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.232', 'weapon4': '0.396', 'weapon2': '0.562', 'WEAPON3': '1.500', 'weapon3': '2.738', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:10,536][52649] DAMAGECOUNT value on done: 58789.0 [2024-08-05 23:50:10,538][52649] Sum rewards: 38.723, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.522', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.668', 'ARMOR': '0.880', 'WEAPON3': '1.300', 'weapon3': '2.486', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:11,546][52668] DAMAGECOUNT value on done: 59505.0 [2024-08-05 23:50:11,547][52668] Sum rewards: 40.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.958', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.434', 'ARMOR': '0.820', 'WEAPON3': '1.300', 'HITCOUNT': '2.550', 'weapon3': '2.964', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:11,573][52794] DAMAGECOUNT value on done: 64349.0 [2024-08-05 23:50:11,573][52794] Sum rewards: 56.303, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.838', 'AMMO5': '0.012', 'ARMOR': '0.036', 'weapon5': '0.040', 'AMMO2': '0.049', 'AMMO3': '0.232', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.338', 'weapon4': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '50.000'} [2024-08-05 23:50:12,564][52795] DAMAGECOUNT value on done: 57107.0 [2024-08-05 23:50:12,565][52795] Sum rewards: 48.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO3': '0.177', 'weapon4': '0.182', 'AMMO4': '0.198', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.684', 'ARMOR': '0.899', 'WEAPON3': '1.050', 'weapon3': '2.684', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '41.000'} [2024-08-05 23:50:12,598][52664] DAMAGECOUNT value on done: 59306.0 [2024-08-05 23:50:12,598][52664] Sum rewards: 49.354, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon4': '0.306', 'HEALTH': '0.480', 'weapon2': '0.590', 'ARMOR': '0.800', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:12,745][52650] Updated weights for policy 0, policy_version 18001 (0.0036) [2024-08-05 23:50:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 147464192. Throughput: 0: 4379.8. Samples: 36874850. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-05 23:50:12,794][52567] Avg episode reward: [(0, '41.313')] [2024-08-05 23:50:12,853][52662] DAMAGECOUNT value on done: 59299.0 [2024-08-05 23:50:12,854][52662] Sum rewards: 37.777, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.013', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.044', 'AMMO3': '0.166', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.342', 'WEAPON4': '0.450', 'weapon2': '0.858', 'WEAPON3': '0.950', 'ARMOR': '1.268', 'HITCOUNT': '2.050', 'weapon3': '2.490', 'DAMAGECOUNT': '9.477', 'FRAGCOUNT': '33.000'} [2024-08-05 23:50:13,662][52649] DAMAGECOUNT value on done: 57441.0 [2024-08-05 23:50:13,663][52649] Sum rewards: 45.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.106', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.072', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'ARMOR': '0.504', 'weapon2': '0.812', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.864', 'DAMAGECOUNT': '10.974', 'FRAGCOUNT': '41.000'} [2024-08-05 23:50:13,731][52660] DAMAGECOUNT value on done: 59010.0 [2024-08-05 23:50:13,732][52660] Sum rewards: 46.900, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'weapon4': '0.064', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'ARMOR': '0.841', 'WEAPON3': '1.050', 'weapon2': '1.206', 'weapon3': '2.482', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '38.500'} [2024-08-05 23:50:14,584][52794] DAMAGECOUNT value on done: 59772.0 [2024-08-05 23:50:14,592][52794] Sum rewards: 36.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.116', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'weapon4': '0.298', 'WEAPON4': '0.350', 'ARMOR': '0.473', 'weapon2': '0.656', 'WEAPON3': '1.050', 'HITCOUNT': '2.180', 'weapon3': '2.722', 'DAMAGECOUNT': '9.456', 'FRAGCOUNT': '32.000'} [2024-08-05 23:50:14,607][52668] DAMAGECOUNT value on done: 60076.0 [2024-08-05 23:50:14,609][52668] Sum rewards: 45.547, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.765', 'weapon5': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'ARMOR': '0.461', 'weapon2': '0.806', 'WEAPON3': '0.850', 'HITCOUNT': '2.420', 'weapon3': '2.862', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:15,244][52664] DAMAGECOUNT value on done: 59802.0 [2024-08-05 23:50:15,245][52664] Sum rewards: 37.443, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.114', 'weapon4': '0.124', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.388', 'ARMOR': '0.824', 'WEAPON3': '1.600', 'HITCOUNT': '2.490', 'weapon3': '3.012', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:15,628][52795] DAMAGECOUNT value on done: 54812.0 [2024-08-05 23:50:15,631][52795] Sum rewards: 43.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.168', 'weapon4': '0.196', 'WEAPON4': '0.250', 'ARMOR': '0.457', 'weapon2': '0.818', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '2.798', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:15,943][52662] DAMAGECOUNT value on done: 63135.0 [2024-08-05 23:50:15,944][52662] Sum rewards: 44.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.828', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.168', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.472', 'weapon4': '0.484', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.482', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '37.000'} [2024-08-05 23:50:16,736][52660] DAMAGECOUNT value on done: 54854.0 [2024-08-05 23:50:16,738][52660] Sum rewards: 49.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.987', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.479', 'weapon2': '0.532', 'weapon4': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.502', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:16,754][52649] DAMAGECOUNT value on done: 52645.0 [2024-08-05 23:50:16,754][52649] Sum rewards: 41.618, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.378', 'AMMO5': '0.012', 'AMMO2': '0.048', 'ARMOR': '0.048', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'AMMO4': '0.238', 'weapon4': '0.296', 'WEAPON4': '0.550', 'weapon2': '0.608', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '2.722', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:16,981][52650] Updated weights for policy 0, policy_version 18011 (0.0040) [2024-08-05 23:50:17,429][52794] DAMAGECOUNT value on done: 62310.0 [2024-08-05 23:50:17,430][52794] Sum rewards: 43.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.748', 'AMMO5': '0.015', 'weapon4': '0.016', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.130', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.436', 'weapon2': '0.772', 'WEAPON3': '1.200', 'HITCOUNT': '2.120', 'weapon3': '2.828', 'DAMAGECOUNT': '10.602', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:17,765][52668] DAMAGECOUNT value on done: 58492.0 [2024-08-05 23:50:17,765][52668] Sum rewards: 39.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.449', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.037', 'weapon5': '0.066', 'AMMO3': '0.177', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.558', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.422', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.788', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 147554304. Throughput: 0: 4385.1. Samples: 36888030. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:50:17,795][52567] Avg episode reward: [(0, '41.280')] [2024-08-05 23:50:17,984][52664] DAMAGECOUNT value on done: 59205.0 [2024-08-05 23:50:17,984][52664] Sum rewards: 38.242, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.768', 'WEAPON3': '1.400', 'HITCOUNT': '2.470', 'weapon3': '2.808', 'DAMAGECOUNT': '10.317', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:18,596][52662] DAMAGECOUNT value on done: 61027.0 [2024-08-05 23:50:18,597][52662] Sum rewards: 30.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.451', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.090', 'AMMO3': '0.154', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.902', 'WEAPON3': '1.100', 'HITCOUNT': '2.290', 'weapon3': '2.590', 'DAMAGECOUNT': '9.684', 'FRAGCOUNT': '27.000'} [2024-08-05 23:50:18,659][52795] DAMAGECOUNT value on done: 57246.0 [2024-08-05 23:50:18,661][52795] Sum rewards: 38.841, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.204', 'AMMO5': '0.026', 'AMMO2': '0.085', 'weapon5': '0.086', 'AMMO3': '0.256', 'weapon4': '0.398', 'AMMO4': '0.424', 'ARMOR': '0.436', 'WEAPON5': '0.500', 'weapon2': '0.770', 'WEAPON4': '1.000', 'WEAPON3': '1.600', 'weapon3': '2.400', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:19,624][52660] DAMAGECOUNT value on done: 58867.0 [2024-08-05 23:50:19,625][52660] Sum rewards: 52.891, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.195', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.016', 'AMMO4': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.256', 'ARMOR': '0.457', 'weapon2': '0.706', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '44.000'} [2024-08-05 23:50:19,794][52649] DAMAGECOUNT value on done: 61222.0 [2024-08-05 23:50:19,798][52649] Sum rewards: 57.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.213', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.024', 'weapon5': '0.036', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.544', 'ARMOR': '0.854', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.210', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '49.000'} [2024-08-05 23:50:20,328][52794] DAMAGECOUNT value on done: 63292.0 [2024-08-05 23:50:20,331][52794] Sum rewards: 29.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.866', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.074', 'AMMO3': '0.213', 'weapon4': '0.220', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '1.004', 'WEAPON3': '1.250', 'ARMOR': '1.264', 'HITCOUNT': '2.110', 'weapon3': '2.468', 'DAMAGECOUNT': '8.790', 'FRAGCOUNT': '28.000'} [2024-08-05 23:50:20,448][52664] DAMAGECOUNT value on done: 61956.0 [2024-08-05 23:50:20,449][52664] Sum rewards: 33.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.066', 'weapon4': '0.094', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'weapon2': '0.754', 'WEAPON3': '1.000', 'ARMOR': '1.228', 'HITCOUNT': '2.210', 'weapon3': '2.872', 'DAMAGECOUNT': '9.255', 'FRAGCOUNT': '29.000'} [2024-08-05 23:50:20,801][52668] DAMAGECOUNT value on done: 60587.0 [2024-08-05 23:50:20,803][52668] Sum rewards: 33.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.054', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.048', 'weapon4': '0.082', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.774', 'ARMOR': '0.820', 'WEAPON3': '1.450', 'HITCOUNT': '2.350', 'weapon3': '2.806', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '30.000'} [2024-08-05 23:50:21,269][52662] DAMAGECOUNT value on done: 63241.0 [2024-08-05 23:50:21,270][52662] Sum rewards: 51.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.236', 'weapon2': '0.768', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '44.000'} [2024-08-05 23:50:21,792][52795] DAMAGECOUNT value on done: 54176.0 [2024-08-05 23:50:21,794][52795] Sum rewards: 48.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.639', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.057', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.218', 'weapon2': '0.640', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '2.880', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '42.000'} [2024-08-05 23:50:21,828][52650] Updated weights for policy 0, policy_version 18021 (0.0014) [2024-08-05 23:50:22,467][52660] DAMAGECOUNT value on done: 59227.0 [2024-08-05 23:50:22,468][52660] Sum rewards: 41.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.112', 'AMMO3': '0.150', 'AMMO4': '0.159', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon2': '0.944', 'WEAPON3': '0.950', 'HITCOUNT': '2.490', 'weapon3': '2.578', 'DAMAGECOUNT': '11.493', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:22,619][52649] DAMAGECOUNT value on done: 54303.0 [2024-08-05 23:50:22,620][52649] Sum rewards: 33.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.952', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.968', 'WEAPON3': '1.350', 'ARMOR': '1.387', 'HITCOUNT': '2.440', 'weapon3': '2.614', 'DAMAGECOUNT': '10.539', 'FRAGCOUNT': '32.000'} [2024-08-05 23:50:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 147636224. Throughput: 0: 4397.4. Samples: 36914630. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:50:22,794][52567] Avg episode reward: [(0, '41.327')] [2024-08-05 23:50:23,010][52664] DAMAGECOUNT value on done: 57387.0 [2024-08-05 23:50:23,012][52664] Sum rewards: 36.825, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.824', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.217', 'weapon4': '0.230', 'AMMO3': '0.232', 'WEAPON4': '0.500', 'weapon2': '0.842', 'ARMOR': '0.874', 'WEAPON3': '1.400', 'HITCOUNT': '2.360', 'weapon3': '2.556', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '37.000'} [2024-08-05 23:50:23,133][52794] DAMAGECOUNT value on done: 63162.0 [2024-08-05 23:50:23,134][52794] Sum rewards: 29.807, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.974', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.476', 'weapon2': '0.540', 'ARMOR': '1.200', 'WEAPON3': '1.400', 'HITCOUNT': '2.010', 'weapon3': '2.604', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '29.000'} [2024-08-05 23:50:23,466][52668] DAMAGECOUNT value on done: 56175.0 [2024-08-05 23:50:23,466][52668] Sum rewards: 33.826, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.686', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.102', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.330', 'weapon2': '0.446', 'ARMOR': '0.455', 'WEAPON3': '0.750', 'weapon4': '0.882', 'weapon3': '1.788', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '8.610', 'FRAGCOUNT': '26.000'} [2024-08-05 23:50:24,374][52662] DAMAGECOUNT value on done: 64397.0 [2024-08-05 23:50:24,375][52662] Sum rewards: 48.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.055', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.184', 'weapon2': '0.868', 'WEAPON3': '1.050', 'weapon3': '2.664', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:24,923][52795] DAMAGECOUNT value on done: 50315.0 [2024-08-05 23:50:24,923][52795] Sum rewards: 53.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.570', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO3': '0.135', 'AMMO4': '0.190', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '2.712', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '43.000'} [2024-08-05 23:50:25,426][52660] DAMAGECOUNT value on done: 57802.0 [2024-08-05 23:50:25,427][52660] Sum rewards: 45.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.182', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.038', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.210', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'ARMOR': '0.461', 'weapon2': '0.812', 'WEAPON3': '1.300', 'HITCOUNT': '2.430', 'weapon3': '2.624', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '42.000'} [2024-08-05 23:50:25,518][52649] DAMAGECOUNT value on done: 58458.0 [2024-08-05 23:50:25,522][52649] Sum rewards: 45.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.282', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.191', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.246', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:25,878][52794] DAMAGECOUNT value on done: 64455.0 [2024-08-05 23:50:25,879][52794] Sum rewards: 46.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.843', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.187', 'WEAPON4': '0.400', 'weapon4': '0.444', 'weapon2': '0.692', 'ARMOR': '0.877', 'WEAPON3': '1.250', 'weapon3': '2.560', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:25,908][52664] DAMAGECOUNT value on done: 60859.0 [2024-08-05 23:50:25,911][52664] Sum rewards: 34.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.608', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'ARMOR': '0.463', 'weapon4': '0.602', 'weapon2': '0.782', 'WEAPON3': '1.100', 'weapon3': '2.218', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.188', 'FRAGCOUNT': '32.000'} [2024-08-05 23:50:26,128][52650] Updated weights for policy 0, policy_version 18031 (0.0021) [2024-08-05 23:50:26,360][52668] DAMAGECOUNT value on done: 57561.0 [2024-08-05 23:50:26,361][52668] Sum rewards: 34.425, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.545', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.116', 'AMMO4': '0.190', 'weapon5': '0.194', 'AMMO3': '0.211', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.898', 'weapon2': '0.960', 'WEAPON3': '1.250', 'HITCOUNT': '2.100', 'weapon3': '2.446', 'DAMAGECOUNT': '10.503', 'FRAGCOUNT': '33.000'} [2024-08-05 23:50:27,149][52662] DAMAGECOUNT value on done: 60706.0 [2024-08-05 23:50:27,149][52662] Sum rewards: 31.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.734', 'AMMO5': '0.011', 'AMMO2': '0.064', 'weapon5': '0.122', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'AMMO4': '0.322', 'ARMOR': '0.452', 'weapon4': '0.482', 'WEAPON4': '0.550', 'weapon2': '0.822', 'WEAPON3': '1.050', 'HITCOUNT': '2.160', 'weapon3': '2.380', 'DAMAGECOUNT': '8.163', 'FRAGCOUNT': '26.000'} [2024-08-05 23:50:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 147726336. Throughput: 0: 4392.0. Samples: 36940950. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-05 23:50:27,795][52567] Avg episode reward: [(0, '41.052')] [2024-08-05 23:50:27,843][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018034_147734528.pth... [2024-08-05 23:50:27,990][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017519_143515648.pth [2024-08-05 23:50:28,000][52660] DAMAGECOUNT value on done: 59419.0 [2024-08-05 23:50:28,000][52660] Sum rewards: 48.017, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.728', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.046', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon4': '0.214', 'WEAPON4': '0.450', 'weapon2': '0.890', 'WEAPON3': '1.000', 'weapon3': '2.586', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:28,019][52795] DAMAGECOUNT value on done: 54339.0 [2024-08-05 23:50:28,019][52795] Sum rewards: 44.154, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO3': '0.111', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON3': '0.650', 'weapon2': '0.776', 'ARMOR': '0.953', 'HITCOUNT': '2.410', 'weapon3': '2.450', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:28,479][52649] DAMAGECOUNT value on done: 57533.0 [2024-08-05 23:50:28,480][52649] Sum rewards: 40.004, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.728', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.256', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.678', 'ARMOR': '0.853', 'WEAPON3': '1.550', 'weapon3': '2.800', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '37.000'} [2024-08-05 23:50:28,670][52794] DAMAGECOUNT value on done: 62266.0 [2024-08-05 23:50:28,671][52794] Sum rewards: 42.359, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.391', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.040', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.324', 'weapon2': '0.596', 'ARMOR': '0.911', 'WEAPON3': '1.500', 'HITCOUNT': '2.710', 'weapon3': '2.846', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:29,088][52664] DAMAGECOUNT value on done: 58238.0 [2024-08-05 23:50:29,088][52664] Sum rewards: 42.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.628', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.216', 'WEAPON4': '0.300', 'ARMOR': '0.854', 'weapon2': '0.878', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.680', 'DAMAGECOUNT': '10.383', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:29,425][52668] DAMAGECOUNT value on done: 54204.0 [2024-08-05 23:50:29,425][52668] Sum rewards: 36.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.061', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon4': '0.484', 'weapon2': '0.762', 'WEAPON3': '1.000', 'weapon3': '2.360', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '9.957', 'FRAGCOUNT': '31.000'} [2024-08-05 23:50:30,050][52662] DAMAGECOUNT value on done: 59937.0 [2024-08-05 23:50:30,051][52662] Sum rewards: 22.723, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.343', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.108', 'AMMO3': '0.110', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.632', 'WEAPON3': '0.700', 'weapon4': '1.044', 'HITCOUNT': '1.250', 'weapon3': '1.854', 'DAMAGECOUNT': '5.484', 'FRAGCOUNT': '18.000'} [2024-08-05 23:50:31,069][52795] DAMAGECOUNT value on done: 55270.0 [2024-08-05 23:50:31,069][52795] Sum rewards: 47.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.794', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.018', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.386', 'weapon2': '0.552', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '2.864', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:31,072][52660] DAMAGECOUNT value on done: 57423.0 [2024-08-05 23:50:31,073][52660] Sum rewards: 38.461, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon7': '0.070', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.580', 'weapon2': '0.698', 'WEAPON3': '0.700', 'weapon3': '2.012', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.234', 'FRAGCOUNT': '30.000'} [2024-08-05 23:50:31,158][52649] DAMAGECOUNT value on done: 61345.0 [2024-08-05 23:50:31,162][52649] Sum rewards: 47.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.968', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.102', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'weapon4': '0.314', 'WEAPON4': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.700', 'HITCOUNT': '2.730', 'weapon3': '2.750', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '43.000'} [2024-08-05 23:50:31,220][52650] Updated weights for policy 0, policy_version 18041 (0.0034) [2024-08-05 23:50:31,936][52794] DAMAGECOUNT value on done: 69217.0 [2024-08-05 23:50:31,937][52794] Sum rewards: 52.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.573', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.058', 'weapon4': '0.062', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.656', 'ARMOR': '0.852', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.976', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '45.000'} [2024-08-05 23:50:32,024][52668] DAMAGECOUNT value on done: 58768.0 [2024-08-05 23:50:32,024][52668] Sum rewards: 48.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.998', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.596', 'ARMOR': '0.906', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.002', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '42.000'} [2024-08-05 23:50:32,051][52664] DAMAGECOUNT value on done: 61305.0 [2024-08-05 23:50:32,051][52664] Sum rewards: 51.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.826', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.368', 'ARMOR': '0.454', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '44.000'} [2024-08-05 23:50:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 147816448. Throughput: 0: 4386.5. Samples: 36953760. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-05 23:50:32,794][52567] Avg episode reward: [(0, '41.390')] [2024-08-05 23:50:33,038][52662] DAMAGECOUNT value on done: 64482.0 [2024-08-05 23:50:33,038][52662] Sum rewards: 41.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.368', 'ARMOR': '0.404', 'weapon2': '0.596', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '2.684', 'DAMAGECOUNT': '11.733', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:33,950][52660] DAMAGECOUNT value on done: 56788.0 [2024-08-05 23:50:33,952][52660] Sum rewards: 38.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.198', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.119', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'ARMOR': '0.850', 'WEAPON3': '1.250', 'weapon2': '1.318', 'HITCOUNT': '2.270', 'weapon3': '2.412', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:34,069][52795] DAMAGECOUNT value on done: 52365.0 [2024-08-05 23:50:34,070][52795] Sum rewards: 41.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.892', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.183', 'weapon4': '0.190', 'AMMO4': '0.209', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.879', 'WEAPON3': '1.050', 'weapon2': '1.084', 'weapon3': '2.172', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.136', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:34,583][52794] DAMAGECOUNT value on done: 59534.0 [2024-08-05 23:50:34,585][52794] Sum rewards: 28.765, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.742', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.079', 'AMMO3': '0.099', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.132', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.502', 'WEAPON3': '0.650', 'weapon4': '0.850', 'HITCOUNT': '1.730', 'weapon3': '1.976', 'DAMAGECOUNT': '7.011', 'FRAGCOUNT': '22.000'} [2024-08-05 23:50:35,121][52664] DAMAGECOUNT value on done: 60390.0 [2024-08-05 23:50:35,122][52664] Sum rewards: 46.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.279', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.234', 'WEAPON4': '0.400', 'ARMOR': '0.487', 'weapon2': '0.862', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '42.000'} [2024-08-05 23:50:35,194][52668] DAMAGECOUNT value on done: 58506.0 [2024-08-05 23:50:35,196][52668] Sum rewards: 52.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.934', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.646', 'ARMOR': '0.934', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '45.000'} [2024-08-05 23:50:35,857][52662] DAMAGECOUNT value on done: 58712.0 [2024-08-05 23:50:35,859][52662] Sum rewards: 31.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'ARMOR': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.162', 'AMMO3': '0.212', 'weapon4': '0.326', 'weapon2': '0.818', 'WEAPON3': '1.250', 'HITCOUNT': '2.190', 'weapon3': '2.474', 'DAMAGECOUNT': '8.994', 'FRAGCOUNT': '29.000'} [2024-08-05 23:50:35,964][52650] Updated weights for policy 0, policy_version 18051 (0.0034) [2024-08-05 23:50:36,418][52647] DAMAGECOUNT value on done: 60748.0 [2024-08-05 23:50:36,419][52647] Sum rewards: 38.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.493', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.024', 'weapon5': '0.052', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.350', 'HITCOUNT': '2.480', 'weapon3': '3.012', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '35.500'} [2024-08-05 23:50:37,117][52660] DAMAGECOUNT value on done: 57689.0 [2024-08-05 23:50:37,117][52660] Sum rewards: 40.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.632', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.050', 'AMMO3': '0.137', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'WEAPON4': '0.450', 'ARMOR': '0.501', 'WEAPON3': '0.900', 'weapon2': '0.914', 'weapon3': '2.594', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.328', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:37,174][52795] DAMAGECOUNT value on done: 55313.0 [2024-08-05 23:50:37,175][52795] Sum rewards: 47.995, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.009', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO3': '0.126', 'AMMO4': '0.182', 'weapon4': '0.248', 'WEAPON4': '0.350', 'ARMOR': '0.424', 'weapon2': '0.884', 'WEAPON3': '0.950', 'weapon3': '2.550', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:37,286][52794] DAMAGECOUNT value on done: 65187.0 [2024-08-05 23:50:37,286][52794] Sum rewards: 55.732, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.036', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.074', 'weapon5': '0.102', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.410', 'weapon2': '0.722', 'WEAPON3': '0.800', 'ARMOR': '0.854', 'weapon3': '2.532', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '45.000'} [2024-08-05 23:50:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.4, 300 sec: 17605.9). Total num frames: 147906560. Throughput: 0: 4400.4. Samples: 36980520. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-05 23:50:37,794][52567] Avg episode reward: [(0, '41.741')] [2024-08-05 23:50:37,797][52614] Saving new best policy, reward=41.741! [2024-08-05 23:50:38,319][52668] DAMAGECOUNT value on done: 58291.0 [2024-08-05 23:50:38,320][52668] Sum rewards: 39.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.728', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.078', 'weapon4': '0.102', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.250', 'ARMOR': '1.706', 'HITCOUNT': '2.020', 'weapon3': '2.840', 'DAMAGECOUNT': '9.501', 'FRAGCOUNT': '36.500'} [2024-08-05 23:50:38,804][52662] DAMAGECOUNT value on done: 63911.0 [2024-08-05 23:50:38,804][52662] Sum rewards: 42.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.608', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.070', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'ARMOR': '0.462', 'weapon2': '0.552', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '3.106', 'DAMAGECOUNT': '11.523', 'FRAGCOUNT': '36.500'} [2024-08-05 23:50:39,223][52669] DAMAGECOUNT value on done: 59737.0 [2024-08-05 23:50:39,226][52669] Sum rewards: 42.739, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.117', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.152', 'WEAPON4': '0.350', 'ARMOR': '0.447', 'weapon4': '0.558', 'weapon2': '0.736', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.526', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:39,248][52647] DAMAGECOUNT value on done: 60832.0 [2024-08-05 23:50:39,251][52647] Sum rewards: 35.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.020', 'weapon4': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.928', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '2.828', 'DAMAGECOUNT': '10.236', 'FRAGCOUNT': '32.000'} [2024-08-05 23:50:39,442][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:50:40,196][52794] DAMAGECOUNT value on done: 64944.0 [2024-08-05 23:50:40,204][52794] Sum rewards: 34.202, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.226', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.106', 'AMMO4': '0.171', 'weapon4': '0.206', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.485', 'weapon2': '0.780', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.598', 'DAMAGECOUNT': '10.218', 'FRAGCOUNT': '33.500'} [2024-08-05 23:50:40,203][52614] Signal inference workers to stop experience collection... (3350 times) [2024-08-05 23:50:40,210][52614] Signal inference workers to resume experience collection... (3350 times) [2024-08-05 23:50:40,261][52650] InferenceWorker_p0-w0: stopping experience collection (3350 times) [2024-08-05 23:50:40,261][52650] InferenceWorker_p0-w0: resuming experience collection (3350 times) [2024-08-05 23:50:40,305][52650] Updated weights for policy 0, policy_version 18061 (0.0011) [2024-08-05 23:50:40,399][52660] DAMAGECOUNT value on done: 55586.0 [2024-08-05 23:50:40,399][52660] Sum rewards: 37.674, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'ARMOR': '0.400', 'weapon4': '0.414', 'weapon2': '0.622', 'WEAPON3': '0.950', 'HITCOUNT': '2.060', 'weapon3': '2.602', 'DAMAGECOUNT': '8.838', 'FRAGCOUNT': '31.000'} [2024-08-05 23:50:40,469][52795] DAMAGECOUNT value on done: 56194.0 [2024-08-05 23:50:40,472][52795] Sum rewards: 42.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.154', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.126', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.396', 'WEAPON4': '0.450', 'weapon2': '0.702', 'WEAPON3': '0.900', 'ARMOR': '1.261', 'weapon3': '2.656', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.763', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:41,497][52662] DAMAGECOUNT value on done: 64508.0 [2024-08-05 23:50:41,498][52662] Sum rewards: 44.834, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.826', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO4': '0.133', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.536', 'ARMOR': '0.887', 'WEAPON3': '1.600', 'HITCOUNT': '2.670', 'weapon3': '3.072', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '42.000'} [2024-08-05 23:50:41,525][52647] DAMAGECOUNT value on done: 65499.0 [2024-08-05 23:50:41,525][52647] Sum rewards: 47.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'weapon4': '0.372', 'ARMOR': '0.458', 'weapon2': '0.640', 'WEAPON3': '1.050', 'HITCOUNT': '2.620', 'weapon3': '2.644', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:41,526][52668] DAMAGECOUNT value on done: 57386.0 [2024-08-05 23:50:41,528][52668] Sum rewards: 49.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.194', 'weapon2': '0.844', 'WEAPON3': '1.250', 'ARMOR': '1.256', 'weapon3': '2.766', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '42.000'} [2024-08-05 23:50:41,840][52669] DAMAGECOUNT value on done: 59330.0 [2024-08-05 23:50:41,840][52669] Sum rewards: 37.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.210', 'AMMO3': '0.251', 'ARMOR': '0.408', 'weapon2': '1.038', 'WEAPON3': '1.500', 'weapon3': '2.418', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 147988480. Throughput: 0: 4396.7. Samples: 37006770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:50:42,795][52567] Avg episode reward: [(0, '41.672')] [2024-08-05 23:50:42,991][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:50:43,188][52794] DAMAGECOUNT value on done: 64073.0 [2024-08-05 23:50:43,188][52794] Sum rewards: 44.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.716', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'ARMOR': '0.914', 'weapon2': '1.002', 'WEAPON3': '1.350', 'weapon3': '2.592', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:43,529][52660] DAMAGECOUNT value on done: 58621.0 [2024-08-05 23:50:43,530][52660] Sum rewards: 44.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO5': '0.005', 'ARMOR': '0.024', 'weapon5': '0.024', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.164', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.846', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '2.778', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '40.000'} [2024-08-05 23:50:43,557][52795] DAMAGECOUNT value on done: 52607.0 [2024-08-05 23:50:43,558][52795] Sum rewards: 37.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.193', 'WEAPON4': '0.500', 'weapon4': '0.636', 'ARMOR': '0.895', 'weapon2': '1.110', 'WEAPON3': '1.200', 'weapon3': '1.998', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '33.000'} [2024-08-05 23:50:44,063][52647] DAMAGECOUNT value on done: 63125.0 [2024-08-05 23:50:44,064][52647] Sum rewards: 43.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.308', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.788', 'ARMOR': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.566', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:44,384][52668] DAMAGECOUNT value on done: 56832.0 [2024-08-05 23:50:44,384][52668] Sum rewards: 47.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.998', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.054', 'ARMOR': '0.060', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.658', 'WEAPON3': '1.450', 'weapon3': '2.772', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '43.000'} [2024-08-05 23:50:44,440][52662] DAMAGECOUNT value on done: 62678.0 [2024-08-05 23:50:44,444][52662] Sum rewards: 43.115, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.479', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.826', 'WEAPON3': '1.050', 'ARMOR': '1.285', 'HITCOUNT': '2.460', 'weapon3': '2.622', 'DAMAGECOUNT': '10.818', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:44,715][52669] DAMAGECOUNT value on done: 58261.0 [2024-08-05 23:50:44,716][52669] Sum rewards: 39.700, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.044', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.250', 'AMMO4': '0.258', 'WEAPON4': '0.400', 'ARMOR': '0.509', 'weapon2': '1.000', 'WEAPON3': '1.450', 'HITCOUNT': '2.450', 'weapon3': '2.654', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '38.000'} [2024-08-05 23:50:45,069][52650] Updated weights for policy 0, policy_version 18071 (0.0017) [2024-08-05 23:50:46,064][52660] DAMAGECOUNT value on done: 63947.0 [2024-08-05 23:50:46,067][52660] Sum rewards: 51.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.935', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.030', 'AMMO4': '0.032', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'ARMOR': '0.444', 'weapon2': '0.586', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.046', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '45.000'} [2024-08-05 23:50:46,122][52794] DAMAGECOUNT value on done: 65644.0 [2024-08-05 23:50:46,122][52794] Sum rewards: 37.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.406', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.054', 'weapon4': '0.158', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'WEAPON4': '0.450', 'weapon2': '0.958', 'WEAPON3': '1.100', 'ARMOR': '1.291', 'HITCOUNT': '2.440', 'weapon3': '2.600', 'DAMAGECOUNT': '10.029', 'FRAGCOUNT': '32.000'} [2024-08-05 23:50:46,664][52795] DAMAGECOUNT value on done: 56382.0 [2024-08-05 23:50:46,664][52795] Sum rewards: 33.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.061', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.056', 'weapon4': '0.072', 'AMMO4': '0.117', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.700', 'ARMOR': '0.870', 'WEAPON3': '1.200', 'HITCOUNT': '2.180', 'weapon3': '2.954', 'DAMAGECOUNT': '9.570', 'FRAGCOUNT': '30.000'} [2024-08-05 23:50:46,869][52647] DAMAGECOUNT value on done: 64216.0 [2024-08-05 23:50:46,869][52647] Sum rewards: 42.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.348', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.034', 'AMMO4': '0.094', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.888', 'WEAPON3': '1.200', 'ARMOR': '1.275', 'HITCOUNT': '2.450', 'weapon3': '2.594', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '37.000'} [2024-08-05 23:50:47,172][52668] DAMAGECOUNT value on done: 60567.0 [2024-08-05 23:50:47,173][52668] Sum rewards: 49.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.651', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.219', 'weapon4': '0.242', 'weapon2': '0.492', 'ARMOR': '0.856', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '3.046', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '43.000'} [2024-08-05 23:50:47,534][52669] DAMAGECOUNT value on done: 58792.0 [2024-08-05 23:50:47,534][52669] Sum rewards: 45.101, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.319', 'AMMO2': '0.014', 'AMMO5': '0.019', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'weapon2': '0.744', 'WEAPON3': '1.050', 'ARMOR': '1.273', 'HITCOUNT': '2.610', 'weapon3': '2.876', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 148078592. Throughput: 0: 4395.5. Samples: 37020060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:50:47,794][52567] Avg episode reward: [(0, '42.302')] [2024-08-05 23:50:47,834][52614] Saving new best policy, reward=42.302! [2024-08-05 23:50:49,248][52660] DAMAGECOUNT value on done: 57338.0 [2024-08-05 23:50:49,250][52660] Sum rewards: 34.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.409', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.094', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'WEAPON4': '0.400', 'weapon4': '0.478', 'weapon2': '0.740', 'WEAPON3': '1.050', 'ARMOR': '1.328', 'HITCOUNT': '2.440', 'weapon3': '2.458', 'DAMAGECOUNT': '9.744', 'FRAGCOUNT': '28.000'} [2024-08-05 23:50:49,278][52668] Large shaping reward 2.572 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-05 23:50:49,352][52794] DAMAGECOUNT value on done: 62471.0 [2024-08-05 23:50:49,352][52794] Sum rewards: 38.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.807', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.186', 'AMMO3': '0.209', 'WEAPON4': '0.400', 'weapon4': '0.550', 'weapon2': '0.666', 'ARMOR': '0.914', 'WEAPON3': '1.350', 'weapon3': '2.552', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:49,609][52650] Updated weights for policy 0, policy_version 18081 (0.0019) [2024-08-05 23:50:49,819][52647] DAMAGECOUNT value on done: 63354.0 [2024-08-05 23:50:49,821][52647] Sum rewards: 42.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.407', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '1.012', 'WEAPON3': '1.150', 'ARMOR': '1.338', 'HITCOUNT': '2.620', 'weapon3': '2.822', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:49,886][52795] DAMAGECOUNT value on done: 59217.0 [2024-08-05 23:50:49,887][52795] Sum rewards: 42.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.428', 'ARMOR': '0.800', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.354', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:50,179][52668] DAMAGECOUNT value on done: 60148.0 [2024-08-05 23:50:50,181][52668] Sum rewards: 55.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.025', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'weapon4': '0.182', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.506', 'ARMOR': '0.892', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '2.998', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '49.000'} [2024-08-05 23:50:50,500][52669] DAMAGECOUNT value on done: 59716.0 [2024-08-05 23:50:50,501][52669] Sum rewards: 35.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.132', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.120', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.284', 'ARMOR': '0.408', 'WEAPON3': '0.800', 'weapon2': '1.320', 'weapon3': '2.102', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.533', 'FRAGCOUNT': '30.000'} [2024-08-05 23:50:52,007][52660] DAMAGECOUNT value on done: 58635.0 [2024-08-05 23:50:52,010][52660] Sum rewards: 43.951, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.452', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.107', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.496', 'WEAPON3': '1.700', 'HITCOUNT': '2.810', 'weapon3': '3.126', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '43.000'} [2024-08-05 23:50:52,137][52647] DAMAGECOUNT value on done: 60489.0 [2024-08-05 23:50:52,137][52647] Sum rewards: 43.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.074', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.171', 'weapon4': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.150', 'ARMOR': '1.285', 'HITCOUNT': '2.490', 'weapon3': '2.904', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '35.500'} [2024-08-05 23:50:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 148168704. Throughput: 0: 4397.3. Samples: 37046180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:50:52,794][52567] Avg episode reward: [(0, '42.369')] [2024-08-05 23:50:52,795][52614] Saving new best policy, reward=42.369! [2024-08-05 23:50:53,030][52795] DAMAGECOUNT value on done: 52141.0 [2024-08-05 23:50:53,033][52795] Sum rewards: 26.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.852', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.206', 'AMMO3': '0.227', 'weapon2': '0.782', 'ARMOR': '0.839', 'WEAPON3': '1.300', 'HITCOUNT': '1.630', 'weapon3': '2.782', 'DAMAGECOUNT': '6.648', 'FRAGCOUNT': '26.000'} [2024-08-05 23:50:53,718][52669] DAMAGECOUNT value on done: 60125.0 [2024-08-05 23:50:53,718][52669] Sum rewards: 41.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.411', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.180', 'AMMO3': '0.188', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.455', 'weapon2': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.746', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '36.500'} [2024-08-05 23:50:54,568][52650] Updated weights for policy 0, policy_version 18091 (0.0011) [2024-08-05 23:50:54,867][52647] DAMAGECOUNT value on done: 63060.0 [2024-08-05 23:50:54,867][52647] Sum rewards: 28.368, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.126', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.162', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.508', 'weapon2': '0.522', 'ARMOR': '0.876', 'WEAPON3': '1.050', 'HITCOUNT': '1.790', 'weapon3': '2.648', 'DAMAGECOUNT': '7.728', 'FRAGCOUNT': '26.000'} [2024-08-05 23:50:54,974][52660] DAMAGECOUNT value on done: 57955.0 [2024-08-05 23:50:54,976][52660] Sum rewards: 34.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.970', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.036', 'ARMOR': '0.044', 'weapon4': '0.078', 'AMMO4': '0.176', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.830', 'weapon3': '3.218', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '33.500'} [2024-08-05 23:50:55,797][52667] DAMAGECOUNT value on done: 57639.0 [2024-08-05 23:50:55,800][52667] Sum rewards: 34.268, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.938', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.088', 'AMMO3': '0.116', 'weapon5': '0.146', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'ARMOR': '1.400', 'weapon2': '1.510', 'weapon3': '2.054', 'HITCOUNT': '2.080', 'DAMAGECOUNT': '8.160', 'FRAGCOUNT': '28.000'} [2024-08-05 23:50:56,242][52795] DAMAGECOUNT value on done: 55306.0 [2024-08-05 23:50:56,242][52795] Sum rewards: 50.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.633', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon4': '0.072', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.726', 'WEAPON3': '1.600', 'weapon3': '3.026', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.906', 'FRAGCOUNT': '46.000'} [2024-08-05 23:50:56,794][52669] DAMAGECOUNT value on done: 59332.0 [2024-08-05 23:50:56,794][52669] Sum rewards: 33.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.211', 'AMMO5': '0.009', 'ARMOR': '0.040', 'AMMO2': '0.044', 'weapon5': '0.116', 'AMMO3': '0.153', 'AMMO4': '0.221', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon2': '1.014', 'HITCOUNT': '1.930', 'weapon3': '2.388', 'DAMAGECOUNT': '9.369', 'FRAGCOUNT': '28.500'} [2024-08-05 23:50:57,146][52647] DAMAGECOUNT value on done: 65090.0 [2024-08-05 23:50:57,147][52647] Sum rewards: 36.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.040', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.536', 'weapon2': '0.604', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.544', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '34.000'} [2024-08-05 23:50:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 148258816. Throughput: 0: 4390.0. Samples: 37072400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:50:57,795][52567] Avg episode reward: [(0, '41.528')] [2024-08-05 23:50:57,912][52660] DAMAGECOUNT value on done: 60494.0 [2024-08-05 23:50:57,913][52660] Sum rewards: 45.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.216', 'AMMO5': '0.007', 'AMMO2': '0.035', 'ARMOR': '0.040', 'weapon4': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '3.018', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '39.000'} [2024-08-05 23:50:58,852][52667] DAMAGECOUNT value on done: 60229.0 [2024-08-05 23:50:58,852][52667] Sum rewards: 39.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.250', 'weapon2': '0.912', 'WEAPON3': '1.250', 'ARMOR': '1.386', 'HITCOUNT': '2.330', 'weapon3': '2.570', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '35.000'} [2024-08-05 23:50:59,331][52650] Updated weights for policy 0, policy_version 18101 (0.0021) [2024-08-05 23:50:59,332][52795] DAMAGECOUNT value on done: 57396.0 [2024-08-05 23:50:59,332][52795] Sum rewards: 42.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.120', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.566', 'weapon4': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.528', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '36.000'} [2024-08-05 23:50:59,362][52647] DAMAGECOUNT value on done: 60308.0 [2024-08-05 23:50:59,362][52647] Sum rewards: 25.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.304', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.062', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'AMMO4': '0.265', 'WEAPON4': '0.550', 'weapon2': '0.558', 'weapon4': '0.716', 'ARMOR': '0.844', 'WEAPON3': '1.150', 'HITCOUNT': '1.690', 'weapon3': '2.334', 'DAMAGECOUNT': '6.699', 'FRAGCOUNT': '25.000'} [2024-08-05 23:51:00,003][52669] DAMAGECOUNT value on done: 57774.0 [2024-08-05 23:51:00,003][52669] Sum rewards: 33.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.214', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.500', 'weapon2': '0.804', 'WEAPON3': '1.150', 'HITCOUNT': '2.270', 'weapon3': '2.474', 'DAMAGECOUNT': '8.652', 'FRAGCOUNT': '31.000'} [2024-08-05 23:51:01,024][52660] DAMAGECOUNT value on done: 58087.0 [2024-08-05 23:51:01,025][52660] Sum rewards: 32.213, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon5': '0.128', 'weapon4': '0.144', 'AMMO4': '0.147', 'AMMO3': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.812', 'WEAPON3': '1.150', 'HITCOUNT': '2.030', 'weapon3': '2.530', 'DAMAGECOUNT': '8.037', 'FRAGCOUNT': '29.000'} [2024-08-05 23:51:02,095][52667] DAMAGECOUNT value on done: 59213.0 [2024-08-05 23:51:02,095][52667] Sum rewards: 44.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.106', 'AMMO3': '0.170', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.588', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:02,224][52647] DAMAGECOUNT value on done: 60984.0 [2024-08-05 23:51:02,225][52647] Sum rewards: 45.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.380', 'ARMOR': '0.432', 'weapon2': '0.586', 'WEAPON3': '1.400', 'HITCOUNT': '2.730', 'weapon3': '2.764', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 148340736. Throughput: 0: 4390.2. Samples: 37085590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-05 23:51:02,795][52567] Avg episode reward: [(0, '41.205')] [2024-08-05 23:51:03,019][52669] DAMAGECOUNT value on done: 59413.0 [2024-08-05 23:51:03,021][52669] Sum rewards: 47.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.696', 'AMMO5': '0.021', 'AMMO2': '0.035', 'weapon5': '0.054', 'weapon4': '0.114', 'AMMO4': '0.172', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '2.550', 'weapon3': '3.002', 'DAMAGECOUNT': '11.847', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:03,656][52650] Updated weights for policy 0, policy_version 18111 (0.0020) [2024-08-05 23:51:04,892][52647] DAMAGECOUNT value on done: 60055.0 [2024-08-05 23:51:04,893][52647] Sum rewards: 59.687, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.642', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'ARMOR': '0.456', 'weapon2': '0.512', 'weapon4': '0.570', 'WEAPON3': '0.800', 'weapon3': '2.722', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '46.000'} [2024-08-05 23:51:05,132][52667] DAMAGECOUNT value on done: 59475.0 [2024-08-05 23:51:05,135][52667] Sum rewards: 46.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.091', 'weapon5': '0.124', 'AMMO3': '0.154', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.784', 'WEAPON3': '1.000', 'HITCOUNT': '2.470', 'weapon3': '2.710', 'DAMAGECOUNT': '11.190', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:05,656][52669] DAMAGECOUNT value on done: 57532.0 [2024-08-05 23:51:05,657][52669] Sum rewards: 44.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.744', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.578', 'ARMOR': '0.824', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.968', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:07,516][52647] DAMAGECOUNT value on done: 60135.0 [2024-08-05 23:51:07,516][52647] Sum rewards: 45.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.219', 'AMMO5': '0.010', 'AMMO2': '0.040', 'ARMOR': '0.052', 'weapon5': '0.068', 'AMMO3': '0.185', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon2': '1.122', 'weapon3': '2.302', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 148430848. Throughput: 0: 4390.9. Samples: 37112220. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:51:07,794][52567] Avg episode reward: [(0, '41.454')] [2024-08-05 23:51:08,222][52667] DAMAGECOUNT value on done: 61843.0 [2024-08-05 23:51:08,224][52667] Sum rewards: 42.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.658', 'AMMO5': '0.007', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon4': '0.222', 'AMMO4': '0.232', 'WEAPON4': '0.450', 'weapon2': '0.614', 'ARMOR': '0.800', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '2.966', 'DAMAGECOUNT': '11.046', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:08,523][52650] Updated weights for policy 0, policy_version 18121 (0.0021) [2024-08-05 23:51:08,808][52669] DAMAGECOUNT value on done: 61852.0 [2024-08-05 23:51:08,808][52669] Sum rewards: 48.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.226', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:10,386][52647] DAMAGECOUNT value on done: 60348.0 [2024-08-05 23:51:10,387][52647] Sum rewards: 53.725, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.385', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.018', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.274', 'weapon2': '0.538', 'WEAPON3': '1.150', 'ARMOR': '1.364', 'HITCOUNT': '2.970', 'weapon3': '2.990', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '43.000'} [2024-08-05 23:51:10,928][52667] DAMAGECOUNT value on done: 61152.0 [2024-08-05 23:51:10,930][52667] Sum rewards: 38.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.448', 'AMMO5': '0.012', 'ARMOR': '0.032', 'AMMO2': '0.035', 'weapon4': '0.130', 'weapon5': '0.152', 'AMMO4': '0.174', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.956', 'WEAPON3': '1.150', 'HITCOUNT': '2.180', 'weapon3': '2.540', 'DAMAGECOUNT': '10.083', 'FRAGCOUNT': '34.000'} [2024-08-05 23:51:10,983][52665] DAMAGECOUNT value on done: 56685.0 [2024-08-05 23:51:10,983][52665] Sum rewards: 43.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.716', 'AMMO5': '0.004', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '3.080', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '37.000'} [2024-08-05 23:51:11,651][52669] DAMAGECOUNT value on done: 59932.0 [2024-08-05 23:51:11,652][52669] Sum rewards: 44.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.831', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.126', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.494', 'ARMOR': '0.924', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.088', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 148520960. Throughput: 0: 4396.2. Samples: 37138780. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:51:12,794][52567] Avg episode reward: [(0, '41.705')] [2024-08-05 23:51:13,007][52650] Updated weights for policy 0, policy_version 18131 (0.0017) [2024-08-05 23:51:13,213][52647] DAMAGECOUNT value on done: 62360.0 [2024-08-05 23:51:13,213][52647] Sum rewards: 43.058, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.463', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.604', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '3.196', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:13,454][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:51:13,484][52667] DAMAGECOUNT value on done: 59965.0 [2024-08-05 23:51:13,485][52667] Sum rewards: 35.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.015', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.146', 'AMMO4': '0.147', 'weapon4': '0.170', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.690', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.698', 'DAMAGECOUNT': '10.734', 'FRAGCOUNT': '31.000'} [2024-08-05 23:51:13,949][52665] DAMAGECOUNT value on done: 62988.0 [2024-08-05 23:51:13,953][52665] Sum rewards: 41.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.782', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.181', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.400', 'weapon2': '0.834', 'WEAPON3': '1.100', 'ARMOR': '1.439', 'weapon3': '2.736', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.808', 'FRAGCOUNT': '34.000'} [2024-08-05 23:51:14,546][52669] DAMAGECOUNT value on done: 56511.0 [2024-08-05 23:51:14,547][52669] Sum rewards: 50.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.555', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.196', 'weapon4': '0.204', 'WEAPON4': '0.250', 'ARMOR': '0.455', 'weapon2': '0.566', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.028', 'DAMAGECOUNT': '12.066', 'FRAGCOUNT': '45.000'} [2024-08-05 23:51:15,914][52647] DAMAGECOUNT value on done: 60765.0 [2024-08-05 23:51:15,916][52647] Sum rewards: 39.094, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.636', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.112', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'weapon2': '0.704', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '2.824', 'DAMAGECOUNT': '10.476', 'FRAGCOUNT': '31.000'} [2024-08-05 23:51:16,438][52667] DAMAGECOUNT value on done: 60035.0 [2024-08-05 23:51:16,439][52667] Sum rewards: 45.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.576', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.154', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '2.650', 'weapon3': '3.102', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '41.500'} [2024-08-05 23:51:16,498][52666] DAMAGECOUNT value on done: 58482.0 [2024-08-05 23:51:16,500][52666] Sum rewards: 53.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.163', 'AMMO3': '0.210', 'weapon4': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.546', 'ARMOR': '0.894', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '2.952', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '46.000'} [2024-08-05 23:51:17,044][52665] DAMAGECOUNT value on done: 60196.0 [2024-08-05 23:51:17,046][52665] Sum rewards: 38.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.079', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.184', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.438', 'ARMOR': '0.881', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '3.038', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '34.000'} [2024-08-05 23:51:17,464][52650] Updated weights for policy 0, policy_version 18141 (0.0011) [2024-08-05 23:51:17,648][52669] DAMAGECOUNT value on done: 60756.0 [2024-08-05 23:51:17,648][52669] Sum rewards: 43.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.980', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:17,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 148619264. Throughput: 0: 4403.3. Samples: 37151910. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:51:17,794][52567] Avg episode reward: [(0, '42.182')] [2024-08-05 23:51:18,493][52647] DAMAGECOUNT value on done: 60698.0 [2024-08-05 23:51:18,494][52647] Sum rewards: 49.256, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.865', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.770', 'ARMOR': '0.861', 'WEAPON3': '1.050', 'HITCOUNT': '2.500', 'weapon3': '2.516', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:19,001][52666] DAMAGECOUNT value on done: 60286.0 [2024-08-05 23:51:19,003][52666] Sum rewards: 53.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.954', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.792', 'WEAPON3': '1.000', 'ARMOR': '1.388', 'weapon3': '2.844', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '43.000'} [2024-08-05 23:51:19,339][52667] DAMAGECOUNT value on done: 59530.0 [2024-08-05 23:51:19,342][52667] Sum rewards: 39.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.735', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.098', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.850', 'WEAPON3': '1.100', 'HITCOUNT': '2.400', 'weapon3': '2.846', 'DAMAGECOUNT': '10.284', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:20,206][52665] DAMAGECOUNT value on done: 57507.0 [2024-08-05 23:51:20,208][52665] Sum rewards: 44.828, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.274', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.058', 'weapon4': '0.140', 'AMMO4': '0.213', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.469', 'weapon2': '0.498', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '3.072', 'DAMAGECOUNT': '10.497', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:20,336][52669] DAMAGECOUNT value on done: 61781.0 [2024-08-05 23:51:20,336][52669] Sum rewards: 53.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.693', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.016', 'weapon4': '0.046', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.770', 'ARMOR': '0.800', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '2.958', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '45.000'} [2024-08-05 23:51:21,041][52647] DAMAGECOUNT value on done: 62279.0 [2024-08-05 23:51:21,050][52647] Sum rewards: 33.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.743', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.070', 'weapon7': '0.090', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.193', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.428', 'ARMOR': '0.449', 'weapon2': '0.570', 'WEAPON3': '1.200', 'HITCOUNT': '1.750', 'weapon3': '2.464', 'DAMAGECOUNT': '8.397', 'FRAGCOUNT': '31.000'} [2024-08-05 23:51:21,987][52667] DAMAGECOUNT value on done: 59550.0 [2024-08-05 23:51:21,988][52667] Sum rewards: 30.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'ARMOR': '0.032', 'AMMO2': '0.034', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.110', 'weapon3': '2.842', 'DAMAGECOUNT': '9.258', 'FRAGCOUNT': '27.000'} [2024-08-05 23:51:22,155][52666] DAMAGECOUNT value on done: 58993.0 [2024-08-05 23:51:22,156][52666] Sum rewards: 41.037, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'weapon5': '0.014', 'ARMOR': '0.032', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'AMMO3': '0.287', 'weapon4': '0.540', 'WEAPON4': '0.550', 'weapon2': '0.628', 'WEAPON3': '1.600', 'weapon3': '2.558', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '40.000'} [2024-08-05 23:51:22,578][52650] Updated weights for policy 0, policy_version 18151 (0.0030) [2024-08-05 23:51:22,757][52665] DAMAGECOUNT value on done: 56639.0 [2024-08-05 23:51:22,759][52665] Sum rewards: 41.037, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.137', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon5': '0.052', 'weapon4': '0.080', 'AMMO4': '0.163', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.822', 'WEAPON3': '1.400', 'ARMOR': '1.673', 'HITCOUNT': '2.390', 'weapon3': '2.764', 'DAMAGECOUNT': '10.143', 'FRAGCOUNT': '40.000'} [2024-08-05 23:51:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 148692992. Throughput: 0: 4406.7. Samples: 37178820. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:51:22,794][52567] Avg episode reward: [(0, '42.251')] [2024-08-05 23:51:23,111][52669] DAMAGECOUNT value on done: 64043.0 [2024-08-05 23:51:23,112][52669] Sum rewards: 38.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon4': '0.356', 'ARMOR': '0.451', 'weapon2': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '32.000'} [2024-08-05 23:51:23,130][52670] DAMAGECOUNT value on done: 57558.0 [2024-08-05 23:51:23,130][52670] Sum rewards: 27.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'weapon4': '0.422', 'ARMOR': '0.436', 'weapon2': '0.876', 'WEAPON3': '1.100', 'HITCOUNT': '2.050', 'weapon3': '2.462', 'DAMAGECOUNT': '7.800', 'FRAGCOUNT': '24.500'} [2024-08-05 23:51:23,705][52820] DAMAGECOUNT value on done: 52298.0 [2024-08-05 23:51:23,705][52820] Sum rewards: 39.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.178', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.136', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.824', 'ARMOR': '0.890', 'WEAPON3': '1.500', 'HITCOUNT': '2.400', 'weapon3': '2.586', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '37.000'} [2024-08-05 23:51:24,053][52647] DAMAGECOUNT value on done: 60220.0 [2024-08-05 23:51:24,054][52647] Sum rewards: 36.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.896', 'ARMOR': '0.900', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.548', 'DAMAGECOUNT': '9.141', 'FRAGCOUNT': '33.000'} [2024-08-05 23:51:25,056][52667] DAMAGECOUNT value on done: 59119.0 [2024-08-05 23:51:25,058][52667] Sum rewards: 49.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.593', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.032', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.560', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.784', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '44.000'} [2024-08-05 23:51:25,262][52665] DAMAGECOUNT value on done: 58579.0 [2024-08-05 23:51:25,264][52665] Sum rewards: 53.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.779', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.173', 'weapon4': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.100', 'ARMOR': '1.352', 'weapon3': '2.710', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '44.000'} [2024-08-05 23:51:25,428][52669] DAMAGECOUNT value on done: 60748.0 [2024-08-05 23:51:25,428][52669] Sum rewards: 33.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.854', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.084', 'weapon4': '0.106', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.500', 'HITCOUNT': '2.090', 'weapon3': '2.904', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '31.500'} [2024-08-05 23:51:25,479][52666] DAMAGECOUNT value on done: 56297.0 [2024-08-05 23:51:25,480][52666] Sum rewards: 31.974, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.312', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'ARMOR': '0.928', 'WEAPON3': '1.100', 'weapon2': '1.318', 'HITCOUNT': '2.060', 'weapon3': '2.490', 'DAMAGECOUNT': '8.997', 'FRAGCOUNT': '26.000'} [2024-08-05 23:51:26,499][52670] DAMAGECOUNT value on done: 60166.0 [2024-08-05 23:51:26,499][52670] Sum rewards: 49.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.164', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:26,845][52820] DAMAGECOUNT value on done: 56892.0 [2024-08-05 23:51:26,847][52820] Sum rewards: 49.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.128', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'weapon4': '0.182', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.736', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:26,855][52650] Updated weights for policy 0, policy_version 18161 (0.0024) [2024-08-05 23:51:26,941][52658] DAMAGECOUNT value on done: 60796.0 [2024-08-05 23:51:26,943][52658] Sum rewards: 48.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.531', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.068', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'ARMOR': '0.453', 'weapon2': '0.760', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '2.902', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '40.000'} [2024-08-05 23:51:27,010][52647] DAMAGECOUNT value on done: 60496.0 [2024-08-05 23:51:27,010][52647] Sum rewards: 53.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon4': '0.324', 'weapon2': '0.484', 'ARMOR': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '47.000'} [2024-08-05 23:51:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 148783104. Throughput: 0: 4406.4. Samples: 37205060. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-05 23:51:27,794][52567] Avg episode reward: [(0, '42.169')] [2024-08-05 23:51:27,951][52665] DAMAGECOUNT value on done: 60567.0 [2024-08-05 23:51:27,952][52665] Sum rewards: 36.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.095', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.080', 'AMMO3': '0.144', 'weapon4': '0.170', 'AMMO4': '0.177', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.860', 'WEAPON3': '1.000', 'HITCOUNT': '2.590', 'weapon3': '2.654', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '29.500'} [2024-08-05 23:51:27,996][52794] Large shaping reward 2.543 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.492, 164.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:51:28,087][52667] DAMAGECOUNT value on done: 58447.0 [2024-08-05 23:51:28,087][52667] Sum rewards: 59.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.664', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.326', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '51.000'} [2024-08-05 23:51:28,563][52666] DAMAGECOUNT value on done: 57753.0 [2024-08-05 23:51:28,565][52666] Sum rewards: 36.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.349', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.738', 'ARMOR': '0.840', 'WEAPON3': '1.000', 'HITCOUNT': '2.350', 'weapon3': '2.794', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '29.500'} [2024-08-05 23:51:28,648][52663] DAMAGECOUNT value on done: 61401.0 [2024-08-05 23:51:28,648][52663] Sum rewards: 50.550, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.351', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.121', 'weapon5': '0.172', 'AMMO4': '0.276', 'weapon2': '0.368', 'WEAPON5': '0.400', 'ARMOR': '0.487', 'WEAPON4': '0.500', 'weapon4': '0.730', 'WEAPON3': '0.800', 'HITCOUNT': '2.420', 'weapon3': '2.442', 'DAMAGECOUNT': '10.107', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:28,690][52669] DAMAGECOUNT value on done: 59780.0 [2024-08-05 23:51:28,691][52669] Sum rewards: 34.542, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.134', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.261', 'ARMOR': '0.462', 'weapon2': '0.558', 'WEAPON3': '1.550', 'HITCOUNT': '2.460', 'weapon3': '3.070', 'DAMAGECOUNT': '9.981', 'FRAGCOUNT': '33.000'} [2024-08-05 23:51:28,773][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:51:29,461][52670] DAMAGECOUNT value on done: 59209.0 [2024-08-05 23:51:29,462][52670] Sum rewards: 53.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.664', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.668', 'ARMOR': '0.800', 'WEAPON3': '1.550', 'HITCOUNT': '2.800', 'weapon3': '2.930', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '48.000'} [2024-08-05 23:51:29,812][52658] DAMAGECOUNT value on done: 59683.0 [2024-08-05 23:51:29,813][52820] DAMAGECOUNT value on done: 53347.0 [2024-08-05 23:51:29,813][52658] Sum rewards: 39.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.026', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.182', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.906', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.690', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '34.000'} [2024-08-05 23:51:29,813][52820] Sum rewards: 38.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.326', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.060', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.882', 'ARMOR': '0.945', 'WEAPON3': '1.350', 'HITCOUNT': '2.360', 'weapon3': '2.822', 'DAMAGECOUNT': '10.455', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:30,917][52667] DAMAGECOUNT value on done: 61035.0 [2024-08-05 23:51:30,918][52667] Sum rewards: 48.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.112', 'weapon5': '0.006', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon4': '0.058', 'AMMO4': '0.182', 'AMMO3': '0.199', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.792', 'WEAPON3': '1.250', 'ARMOR': '1.407', 'weapon3': '2.864', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:30,948][52665] DAMAGECOUNT value on done: 59766.0 [2024-08-05 23:51:30,948][52665] Sum rewards: 28.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.855', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.410', 'ARMOR': '0.453', 'weapon2': '0.594', 'WEAPON3': '1.500', 'HITCOUNT': '2.050', 'weapon3': '2.448', 'DAMAGECOUNT': '9.057', 'FRAGCOUNT': '28.000'} [2024-08-05 23:51:31,350][52666] DAMAGECOUNT value on done: 57276.0 [2024-08-05 23:51:31,352][52666] Sum rewards: 37.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'weapon7': '0.018', 'AMMO2': '0.028', 'weapon5': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.666', 'weapon4': '0.772', 'WEAPON3': '0.950', 'weapon3': '2.240', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '9.357', 'FRAGCOUNT': '30.500'} [2024-08-05 23:51:31,565][52650] Updated weights for policy 0, policy_version 18171 (0.0010) [2024-08-05 23:51:31,638][52663] DAMAGECOUNT value on done: 59564.0 [2024-08-05 23:51:31,642][52663] Sum rewards: 39.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.619', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.516', 'ARMOR': '0.856', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '3.038', 'DAMAGECOUNT': '10.446', 'FRAGCOUNT': '33.000'} [2024-08-05 23:51:31,719][52669] DAMAGECOUNT value on done: 59234.0 [2024-08-05 23:51:31,719][52669] Sum rewards: 45.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.037', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'ARMOR': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.208', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:32,175][52670] DAMAGECOUNT value on done: 57244.0 [2024-08-05 23:51:32,175][52670] Sum rewards: 46.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.162', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon5': '0.252', 'WEAPON4': '0.300', 'ARMOR': '0.856', 'weapon2': '0.966', 'WEAPON3': '1.000', 'weapon3': '2.306', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:32,607][52658] DAMAGECOUNT value on done: 59142.0 [2024-08-05 23:51:32,608][52658] Sum rewards: 45.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.249', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'ARMOR': '0.494', 'weapon2': '0.738', 'WEAPON3': '1.500', 'HITCOUNT': '2.620', 'weapon3': '2.912', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 148873216. Throughput: 0: 4404.0. Samples: 37218240. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:51:32,794][52567] Avg episode reward: [(0, '42.324')] [2024-08-05 23:51:32,920][52820] DAMAGECOUNT value on done: 53909.0 [2024-08-05 23:51:32,920][52820] Sum rewards: 39.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.676', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.300', 'weapon5': '0.370', 'WEAPON4': '0.550', 'weapon2': '0.742', 'weapon4': '0.818', 'ARMOR': '0.893', 'WEAPON3': '0.900', 'weapon3': '1.722', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '32.000'} [2024-08-05 23:51:33,841][52667] DAMAGECOUNT value on done: 58497.0 [2024-08-05 23:51:33,842][52667] Sum rewards: 48.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.352', 'ARMOR': '0.421', 'WEAPON4': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.610', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:33,931][52666] DAMAGECOUNT value on done: 55979.0 [2024-08-05 23:51:33,933][52666] Sum rewards: 36.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon4': '0.144', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.400', 'weapon2': '0.862', 'WEAPON3': '1.200', 'ARMOR': '1.312', 'HITCOUNT': '2.460', 'weapon3': '2.706', 'DAMAGECOUNT': '10.590', 'FRAGCOUNT': '31.500'} [2024-08-05 23:51:34,052][52665] DAMAGECOUNT value on done: 61930.0 [2024-08-05 23:51:34,053][52665] Sum rewards: 40.009, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'AMMO4': '0.250', 'weapon4': '0.416', 'WEAPON4': '0.600', 'weapon2': '0.676', 'WEAPON3': '1.050', 'HITCOUNT': '2.320', 'weapon3': '2.606', 'DAMAGECOUNT': '9.807', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:34,624][52663] DAMAGECOUNT value on done: 61107.0 [2024-08-05 23:51:34,624][52663] Sum rewards: 38.746, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.610', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.850', 'ARMOR': '0.908', 'WEAPON3': '1.050', 'HITCOUNT': '2.140', 'weapon3': '2.950', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '32.000'} [2024-08-05 23:51:34,725][52669] DAMAGECOUNT value on done: 61719.0 [2024-08-05 23:51:34,726][52669] Sum rewards: 52.717, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.169', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.398', 'ARMOR': '0.420', 'WEAPON3': '0.850', 'weapon2': '0.908', 'weapon3': '2.416', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:35,029][52670] DAMAGECOUNT value on done: 57351.0 [2024-08-05 23:51:35,030][52670] Sum rewards: 45.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.074', 'weapon4': '0.144', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'ARMOR': '0.454', 'weapon2': '0.492', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '3.038', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:35,219][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:51:35,894][52658] DAMAGECOUNT value on done: 59089.0 [2024-08-05 23:51:35,895][52658] Sum rewards: 44.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.015', 'ARMOR': '0.040', 'AMMO2': '0.049', 'weapon5': '0.134', 'AMMO3': '0.244', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.566', 'weapon2': '0.730', 'WEAPON3': '1.500', 'weapon3': '2.284', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:35,967][52820] DAMAGECOUNT value on done: 53721.0 [2024-08-05 23:51:35,967][52820] Sum rewards: 46.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'weapon5': '0.002', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.198', 'weapon2': '0.488', 'ARMOR': '0.935', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.180', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:36,179][52650] Updated weights for policy 0, policy_version 18181 (0.0032) [2024-08-05 23:51:36,720][52667] DAMAGECOUNT value on done: 60663.0 [2024-08-05 23:51:36,728][52667] Sum rewards: 38.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.510', 'weapon2': '0.564', 'ARMOR': '0.882', 'WEAPON3': '1.200', 'HITCOUNT': '2.360', 'weapon3': '2.540', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '32.500'} [2024-08-05 23:51:36,819][52666] DAMAGECOUNT value on done: 57184.0 [2024-08-05 23:51:36,819][52666] Sum rewards: 41.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.074', 'AMMO3': '0.240', 'AMMO4': '0.255', 'WEAPON5': '0.400', 'weapon4': '0.452', 'ARMOR': '0.464', 'WEAPON4': '0.650', 'weapon2': '0.670', 'WEAPON3': '1.450', 'HITCOUNT': '2.330', 'weapon3': '2.454', 'DAMAGECOUNT': '10.464', 'FRAGCOUNT': '37.000'} [2024-08-05 23:51:37,256][52665] DAMAGECOUNT value on done: 61870.0 [2024-08-05 23:51:37,256][52665] Sum rewards: 58.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.567', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.190', 'weapon2': '0.430', 'ARMOR': '0.850', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.150', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '49.000'} [2024-08-05 23:51:37,326][52663] DAMAGECOUNT value on done: 60364.0 [2024-08-05 23:51:37,327][52663] Sum rewards: 48.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.360', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'ARMOR': '0.400', 'weapon2': '0.794', 'WEAPON3': '0.900', 'HITCOUNT': '2.560', 'weapon3': '2.926', 'DAMAGECOUNT': '10.584', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:37,793][52670] DAMAGECOUNT value on done: 60969.0 [2024-08-05 23:51:37,793][52670] Sum rewards: 37.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.145', 'AMMO5': '0.012', 'AMMO2': '0.031', 'ARMOR': '0.036', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.130', 'AMMO4': '0.157', 'WEAPON7': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '0.850', 'weapon4': '0.906', 'weapon3': '2.030', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '10.257', 'FRAGCOUNT': '31.500'} [2024-08-05 23:51:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17606.0). Total num frames: 148963328. Throughput: 0: 4412.9. Samples: 37244760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:51:37,795][52567] Avg episode reward: [(0, '42.573')] [2024-08-05 23:51:37,823][52614] Saving new best policy, reward=42.573! [2024-08-05 23:51:38,572][52658] DAMAGECOUNT value on done: 62254.0 [2024-08-05 23:51:38,575][52658] Sum rewards: 44.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.379', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'ARMOR': '0.454', 'weapon2': '0.984', 'WEAPON3': '1.000', 'weapon3': '2.778', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:39,086][52820] DAMAGECOUNT value on done: 56302.0 [2024-08-05 23:51:39,087][52820] Sum rewards: 49.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.158', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:39,726][52667] DAMAGECOUNT value on done: 65387.0 [2024-08-05 23:51:39,726][52667] Sum rewards: 53.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.434', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.058', 'AMMO3': '0.132', 'weapon4': '0.136', 'WEAPON4': '0.150', 'ARMOR': '0.484', 'weapon2': '0.574', 'WEAPON3': '0.850', 'HITCOUNT': '2.680', 'weapon3': '3.056', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '42.000'} [2024-08-05 23:51:39,734][52666] DAMAGECOUNT value on done: 60254.0 [2024-08-05 23:51:39,734][52666] Sum rewards: 43.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.653', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.172', 'AMMO3': '0.174', 'weapon4': '0.286', 'WEAPON4': '0.400', 'ARMOR': '0.463', 'weapon2': '0.814', 'WEAPON3': '1.100', 'weapon3': '2.712', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '37.000'} [2024-08-05 23:51:40,361][52665] DAMAGECOUNT value on done: 60551.0 [2024-08-05 23:51:40,362][52665] Sum rewards: 42.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'ARMOR': '0.404', 'weapon2': '0.840', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '2.784', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '36.500'} [2024-08-05 23:51:40,539][52663] DAMAGECOUNT value on done: 57472.0 [2024-08-05 23:51:40,539][52663] Sum rewards: 38.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.873', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.175', 'weapon5': '0.262', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'WEAPON4': '0.450', 'weapon4': '0.578', 'weapon2': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.190', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:40,644][52670] DAMAGECOUNT value on done: 56649.0 [2024-08-05 23:51:40,644][52670] Sum rewards: 41.621, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.426', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.032', 'AMMO4': '0.102', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon4': '0.298', 'WEAPON3': '0.750', 'weapon2': '1.118', 'weapon3': '2.422', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '32.000'} [2024-08-05 23:51:40,747][52650] Updated weights for policy 0, policy_version 18191 (0.0010) [2024-08-05 23:51:41,528][52658] DAMAGECOUNT value on done: 57235.0 [2024-08-05 23:51:41,529][52658] Sum rewards: 40.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.121', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.153', 'AMMO4': '0.153', 'WEAPON4': '0.400', 'ARMOR': '0.436', 'weapon4': '0.436', 'weapon2': '0.604', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.574', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '33.000'} [2024-08-05 23:51:42,117][52820] DAMAGECOUNT value on done: 57081.0 [2024-08-05 23:51:42,120][52820] Sum rewards: 28.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.890', 'AMMO5': '0.011', 'weapon5': '0.036', 'AMMO2': '0.041', 'AMMO4': '0.207', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.400', 'ARMOR': '0.464', 'weapon2': '0.844', 'WEAPON3': '1.550', 'HITCOUNT': '2.180', 'weapon3': '2.598', 'DAMAGECOUNT': '9.387', 'FRAGCOUNT': '29.000'} [2024-08-05 23:51:42,228][52666] DAMAGECOUNT value on done: 58862.0 [2024-08-05 23:51:42,229][52666] Sum rewards: 29.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.763', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.036', 'weapon5': '0.106', 'weapon4': '0.142', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.150', 'HITCOUNT': '2.200', 'weapon3': '3.124', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '28.000'} [2024-08-05 23:51:42,647][52667] DAMAGECOUNT value on done: 59930.0 [2024-08-05 23:51:42,649][52667] Sum rewards: 42.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.064', 'AMMO3': '0.198', 'weapon4': '0.234', 'WEAPON5': '0.250', 'AMMO4': '0.279', 'ARMOR': '0.452', 'WEAPON4': '0.650', 'weapon2': '0.682', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.786', 'DAMAGECOUNT': '11.493', 'FRAGCOUNT': '37.000'} [2024-08-05 23:51:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 149045248. Throughput: 0: 4409.3. Samples: 37270820. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-05 23:51:42,794][52567] Avg episode reward: [(0, '42.362')] [2024-08-05 23:51:43,034][52665] DAMAGECOUNT value on done: 59186.0 [2024-08-05 23:51:43,034][52665] Sum rewards: 48.484, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.460', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.248', 'weapon4': '0.306', 'WEAPON4': '0.350', 'ARMOR': '0.465', 'weapon2': '0.684', 'WEAPON3': '1.450', 'weapon3': '2.758', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '47.000'} [2024-08-05 23:51:43,141][52670] DAMAGECOUNT value on done: 57998.0 [2024-08-05 23:51:43,141][52670] Sum rewards: 47.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.152', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.024', 'AMMO4': '0.111', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.274', 'weapon4': '0.536', 'WEAPON3': '1.050', 'HITCOUNT': '2.620', 'weapon3': '2.872', 'DAMAGECOUNT': '11.052', 'FRAGCOUNT': '40.000'} [2024-08-05 23:51:43,429][52671] DAMAGECOUNT value on done: 65473.0 [2024-08-05 23:51:43,429][52671] Sum rewards: 47.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.315', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.274', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.742', 'ARMOR': '0.909', 'WEAPON3': '1.650', 'weapon3': '2.602', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '44.000'} [2024-08-05 23:51:43,601][52663] DAMAGECOUNT value on done: 61580.0 [2024-08-05 23:51:43,605][52663] Sum rewards: 55.813, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.470', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.298', 'ARMOR': '0.458', 'weapon2': '0.532', 'WEAPON3': '1.850', 'HITCOUNT': '3.200', 'weapon3': '3.264', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '51.000'} [2024-08-05 23:51:44,319][52658] DAMAGECOUNT value on done: 64919.0 [2024-08-05 23:51:44,322][52658] Sum rewards: 31.685, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.156', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon4': '0.154', 'WEAPON3': '0.900', 'weapon2': '1.090', 'HITCOUNT': '2.080', 'weapon3': '2.506', 'DAMAGECOUNT': '8.571', 'FRAGCOUNT': '29.000'} [2024-08-05 23:51:45,147][52667] DAMAGECOUNT value on done: 65094.0 [2024-08-05 23:51:45,147][52667] Sum rewards: 37.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.450', 'weapon4': '0.466', 'weapon2': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.626', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:45,215][52820] DAMAGECOUNT value on done: 56336.0 [2024-08-05 23:51:45,216][52820] Sum rewards: 42.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.127', 'AMMO3': '0.151', 'weapon4': '0.194', 'WEAPON4': '0.350', 'weapon2': '0.790', 'ARMOR': '0.895', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.762', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:45,378][52666] DAMAGECOUNT value on done: 56992.0 [2024-08-05 23:51:45,379][52666] Sum rewards: 39.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.070', 'weapon4': '0.122', 'AMMO4': '0.163', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '1.028', 'WEAPON3': '1.200', 'weapon3': '2.534', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:46,037][52650] Updated weights for policy 0, policy_version 18201 (0.0012) [2024-08-05 23:51:46,120][52665] DAMAGECOUNT value on done: 58228.0 [2024-08-05 23:51:46,120][52665] Sum rewards: 48.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.242', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO4': '0.187', 'AMMO3': '0.235', 'WEAPON4': '0.450', 'weapon2': '0.816', 'ARMOR': '0.890', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '43.000'} [2024-08-05 23:51:46,343][52671] DAMAGECOUNT value on done: 60271.0 [2024-08-05 23:51:46,343][52671] Sum rewards: 49.139, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.038', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.193', 'weapon4': '0.246', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.518', 'ARMOR': '0.851', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '44.000'} [2024-08-05 23:51:46,429][52670] DAMAGECOUNT value on done: 55818.0 [2024-08-05 23:51:46,429][52670] Sum rewards: 45.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.153', 'weapon5': '0.154', 'weapon4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.485', 'weapon2': '0.756', 'WEAPON3': '0.950', 'HITCOUNT': '2.420', 'weapon3': '2.720', 'DAMAGECOUNT': '11.544', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:46,540][52663] DAMAGECOUNT value on done: 64659.0 [2024-08-05 23:51:46,541][52663] Sum rewards: 34.305, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.364', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'AMMO4': '0.242', 'weapon4': '0.270', 'WEAPON4': '0.550', 'weapon2': '0.790', 'ARMOR': '1.308', 'WEAPON3': '1.350', 'HITCOUNT': '2.380', 'weapon3': '2.480', 'DAMAGECOUNT': '10.896', 'FRAGCOUNT': '34.000'} [2024-08-05 23:51:46,974][52658] DAMAGECOUNT value on done: 59304.0 [2024-08-05 23:51:46,977][52658] Sum rewards: 47.581, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.708', 'AMMO5': '0.019', 'ARMOR': '0.024', 'AMMO2': '0.040', 'weapon5': '0.142', 'AMMO3': '0.144', 'weapon4': '0.154', 'AMMO4': '0.199', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.792', 'WEAPON3': '0.900', 'HITCOUNT': '2.470', 'weapon3': '2.650', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 149135360. Throughput: 0: 4413.3. Samples: 37284190. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 23:51:47,794][52567] Avg episode reward: [(0, '43.171')] [2024-08-05 23:51:47,798][52614] Saving new best policy, reward=43.171! [2024-08-05 23:51:48,305][52820] DAMAGECOUNT value on done: 52345.0 [2024-08-05 23:51:48,307][52820] Sum rewards: 34.831, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.187', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon7': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.718', 'WEAPON3': '0.900', 'weapon4': '1.172', 'weapon3': '1.852', 'HITCOUNT': '1.970', 'DAMAGECOUNT': '8.256', 'FRAGCOUNT': '29.000'} [2024-08-05 23:51:48,367][52667] DAMAGECOUNT value on done: 59438.0 [2024-08-05 23:51:48,368][52667] Sum rewards: 40.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.488', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.236', 'weapon4': '0.402', 'ARMOR': '0.475', 'WEAPON4': '0.550', 'weapon2': '0.728', 'WEAPON3': '1.000', 'HITCOUNT': '2.330', 'weapon3': '2.574', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:48,653][52666] DAMAGECOUNT value on done: 57163.0 [2024-08-05 23:51:48,656][52666] Sum rewards: 42.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.708', 'AMMO5': '0.007', 'ARMOR': '0.016', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:49,010][52665] DAMAGECOUNT value on done: 59952.0 [2024-08-05 23:51:49,011][52665] Sum rewards: 45.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.678', 'ARMOR': '0.852', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.718', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '40.000'} [2024-08-05 23:51:49,251][52671] DAMAGECOUNT value on done: 60589.0 [2024-08-05 23:51:49,251][52671] Sum rewards: 43.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.642', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO2': '0.068', 'weapon5': '0.164', 'AMMO3': '0.178', 'weapon4': '0.268', 'AMMO4': '0.341', 'WEAPON5': '0.400', 'weapon2': '0.652', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:49,425][52670] DAMAGECOUNT value on done: 54510.0 [2024-08-05 23:51:49,427][52670] Sum rewards: 39.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.640', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.118', 'weapon4': '0.118', 'AMMO4': '0.152', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.442', 'weapon2': '0.894', 'WEAPON3': '1.250', 'HITCOUNT': '2.460', 'weapon3': '2.602', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:49,723][52663] DAMAGECOUNT value on done: 59690.0 [2024-08-05 23:51:49,727][52663] Sum rewards: 41.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.134', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon2': '1.052', 'ARMOR': '1.295', 'HITCOUNT': '2.230', 'weapon3': '2.392', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:50,063][52650] Updated weights for policy 0, policy_version 18211 (0.0024) [2024-08-05 23:51:50,176][52658] DAMAGECOUNT value on done: 61514.0 [2024-08-05 23:51:50,177][52658] Sum rewards: 36.927, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.638', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.105', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'weapon2': '0.500', 'ARMOR': '0.975', 'WEAPON3': '1.650', 'HITCOUNT': '2.350', 'weapon3': '2.984', 'DAMAGECOUNT': '10.560', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:50,983][52667] DAMAGECOUNT value on done: 62328.0 [2024-08-05 23:51:50,984][52667] Sum rewards: 48.761, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.334', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.014', 'weapon4': '0.016', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.720', 'ARMOR': '0.915', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.070', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:51,418][52820] DAMAGECOUNT value on done: 54610.0 [2024-08-05 23:51:51,418][52820] Sum rewards: 40.813, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.602', 'weapon2': '0.678', 'WEAPON3': '1.100', 'ARMOR': '1.365', 'HITCOUNT': '2.420', 'weapon3': '2.580', 'DAMAGECOUNT': '9.642', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:51,452][52666] DAMAGECOUNT value on done: 57327.0 [2024-08-05 23:51:51,452][52666] Sum rewards: 33.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.547', 'AMMO2': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.154', 'AMMO3': '0.204', 'AMMO4': '0.240', 'weapon2': '0.332', 'WEAPON4': '0.500', 'ARMOR': '0.504', 'weapon4': '0.864', 'WEAPON3': '1.150', 'HITCOUNT': '2.070', 'weapon3': '2.338', 'DAMAGECOUNT': '9.516', 'FRAGCOUNT': '29.000'} [2024-08-05 23:51:52,078][52665] DAMAGECOUNT value on done: 58404.0 [2024-08-05 23:51:52,078][52665] Sum rewards: 47.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.161', 'ARMOR': '0.453', 'weapon2': '0.942', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:52,171][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:51:52,369][52671] DAMAGECOUNT value on done: 57441.0 [2024-08-05 23:51:52,370][52671] Sum rewards: 45.807, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.015', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.235', 'ARMOR': '0.454', 'weapon2': '0.570', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.046', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '43.000'} [2024-08-05 23:51:52,487][52670] DAMAGECOUNT value on done: 58955.0 [2024-08-05 23:51:52,491][52670] Sum rewards: 53.367, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.695', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.392', 'ARMOR': '0.453', 'weapon4': '0.592', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '44.000'} [2024-08-05 23:51:52,760][52663] DAMAGECOUNT value on done: 60083.0 [2024-08-05 23:51:52,762][52663] Sum rewards: 52.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.363', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.222', 'AMMO4': '0.223', 'WEAPON4': '0.400', 'weapon2': '0.766', 'ARMOR': '0.911', 'WEAPON3': '1.450', 'weapon3': '2.616', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '48.000'} [2024-08-05 23:51:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 149225472. Throughput: 0: 4400.7. Samples: 37310250. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 23:51:52,794][52567] Avg episode reward: [(0, '42.999')] [2024-08-05 23:51:52,918][52658] DAMAGECOUNT value on done: 61482.0 [2024-08-05 23:51:52,919][52658] Sum rewards: 41.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.212', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon4': '0.404', 'ARMOR': '0.493', 'weapon2': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:54,333][52666] DAMAGECOUNT value on done: 58868.0 [2024-08-05 23:51:54,335][52666] Sum rewards: 63.631, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.539', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'ARMOR': '0.408', 'WEAPON3': '0.950', 'weapon2': '1.014', 'weapon3': '2.730', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '52.000'} [2024-08-05 23:51:54,521][52820] DAMAGECOUNT value on done: 56855.0 [2024-08-05 23:51:54,522][52820] Sum rewards: 42.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.060', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.182', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'ARMOR': '0.440', 'weapon2': '0.724', 'WEAPON3': '1.100', 'HITCOUNT': '2.350', 'weapon3': '2.792', 'DAMAGECOUNT': '11.052', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:54,726][52665] DAMAGECOUNT value on done: 58758.0 [2024-08-05 23:51:54,726][52665] Sum rewards: 43.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.765', 'AMMO5': '0.015', 'ARMOR': '0.032', 'AMMO2': '0.033', 'weapon5': '0.096', 'weapon4': '0.130', 'AMMO4': '0.164', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '3.058', 'DAMAGECOUNT': '10.086', 'FRAGCOUNT': '39.000'} [2024-08-05 23:51:54,913][52671] DAMAGECOUNT value on done: 58091.0 [2024-08-05 23:51:54,915][52671] Sum rewards: 44.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.064', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.127', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.150', 'HITCOUNT': '2.430', 'weapon3': '3.182', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:54,927][52650] Updated weights for policy 0, policy_version 18221 (0.0015) [2024-08-05 23:51:55,391][52670] DAMAGECOUNT value on done: 60821.0 [2024-08-05 23:51:55,392][52670] Sum rewards: 38.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.375', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.126', 'AMMO3': '0.143', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'weapon4': '0.478', 'WEAPON3': '0.900', 'weapon2': '0.950', 'weapon3': '2.202', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.041', 'FRAGCOUNT': '33.000'} [2024-08-05 23:51:55,623][52658] DAMAGECOUNT value on done: 62225.0 [2024-08-05 23:51:55,623][52658] Sum rewards: 43.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.183', 'ARMOR': '0.918', 'WEAPON3': '1.150', 'weapon2': '1.184', 'weapon3': '2.526', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '38.000'} [2024-08-05 23:51:55,634][52663] DAMAGECOUNT value on done: 63617.0 [2024-08-05 23:51:55,635][52663] Sum rewards: 46.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.948', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.196', 'weapon4': '0.330', 'WEAPON4': '0.500', 'ARMOR': '0.914', 'weapon2': '0.962', 'WEAPON3': '1.250', 'weapon3': '2.424', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '40.000'} [2024-08-05 23:51:56,975][52666] DAMAGECOUNT value on done: 56597.0 [2024-08-05 23:51:56,976][52666] Sum rewards: 30.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.201', 'AMMO4': '0.245', 'weapon4': '0.356', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'weapon2': '0.938', 'WEAPON3': '1.200', 'HITCOUNT': '2.140', 'weapon3': '2.454', 'DAMAGECOUNT': '8.634', 'FRAGCOUNT': '27.000'} [2024-08-05 23:51:57,288][52665] DAMAGECOUNT value on done: 57727.0 [2024-08-05 23:51:57,288][52665] Sum rewards: 42.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.516', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.652', 'ARMOR': '0.926', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.904', 'DAMAGECOUNT': '11.445', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:57,616][52820] DAMAGECOUNT value on done: 58286.0 [2024-08-05 23:51:57,617][52820] Sum rewards: 41.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.778', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.134', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.250', 'ARMOR': '0.452', 'weapon2': '0.862', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.644', 'FRAGCOUNT': '34.000'} [2024-08-05 23:51:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 149307392. Throughput: 0: 4393.5. Samples: 37336490. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 23:51:57,795][52567] Avg episode reward: [(0, '43.118')] [2024-08-05 23:51:57,898][52670] DAMAGECOUNT value on done: 59050.0 [2024-08-05 23:51:57,900][52670] Sum rewards: 40.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.217', 'AMMO5': '0.010', 'weapon5': '0.028', 'AMMO2': '0.037', 'AMMO3': '0.182', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.354', 'ARMOR': '0.924', 'WEAPON3': '1.100', 'weapon2': '1.268', 'weapon3': '2.110', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '9.948', 'FRAGCOUNT': '35.000'} [2024-08-05 23:51:58,382][52671] DAMAGECOUNT value on done: 62283.0 [2024-08-05 23:51:58,382][52671] Sum rewards: 40.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.194', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.907', 'weapon2': '0.976', 'WEAPON3': '1.300', 'HITCOUNT': '2.370', 'weapon3': '2.614', 'DAMAGECOUNT': '10.884', 'FRAGCOUNT': '36.000'} [2024-08-05 23:51:58,639][52663] DAMAGECOUNT value on done: 60285.0 [2024-08-05 23:51:58,639][52663] Sum rewards: 48.907, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.682', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'weapon4': '0.458', 'weapon2': '0.550', 'WEAPON3': '0.800', 'HITCOUNT': '2.480', 'weapon3': '2.648', 'DAMAGECOUNT': '10.254', 'FRAGCOUNT': '40.000'} [2024-08-05 23:51:58,780][52658] DAMAGECOUNT value on done: 58694.0 [2024-08-05 23:51:58,781][52658] Sum rewards: 47.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.751', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.042', 'weapon5': '0.084', 'AMMO4': '0.190', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon2': '0.840', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '41.000'} [2024-08-05 23:51:59,464][52666] DAMAGECOUNT value on done: 56820.0 [2024-08-05 23:51:59,464][52666] Sum rewards: 32.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO3': '0.102', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '1.300', 'ARMOR': '1.702', 'HITCOUNT': '2.000', 'weapon3': '2.226', 'DAMAGECOUNT': '8.526', 'FRAGCOUNT': '26.500'} [2024-08-05 23:51:59,547][52650] Updated weights for policy 0, policy_version 18231 (0.0015) [2024-08-05 23:52:00,271][52665] DAMAGECOUNT value on done: 56335.0 [2024-08-05 23:52:00,273][52665] Sum rewards: 22.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.112', 'AMMO3': '0.186', 'weapon4': '0.212', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'ARMOR': '0.420', 'WEAPON4': '0.550', 'weapon2': '0.864', 'WEAPON3': '1.150', 'HITCOUNT': '1.670', 'weapon3': '2.446', 'DAMAGECOUNT': '7.260', 'FRAGCOUNT': '22.000'} [2024-08-05 23:52:00,396][52670] DAMAGECOUNT value on done: 59629.0 [2024-08-05 23:52:00,396][52670] Sum rewards: 49.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.249', 'weapon2': '0.484', 'ARMOR': '0.800', 'WEAPON3': '1.550', 'HITCOUNT': '2.640', 'weapon3': '3.208', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '45.000'} [2024-08-05 23:52:00,855][52820] DAMAGECOUNT value on done: 52827.0 [2024-08-05 23:52:00,855][52820] Sum rewards: 40.741, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.159', 'AMMO3': '0.180', 'weapon4': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.784', 'WEAPON3': '1.250', 'HITCOUNT': '2.430', 'weapon3': '2.704', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:01,099][52659] DAMAGECOUNT value on done: 60470.0 [2024-08-05 23:52:01,099][52659] Sum rewards: 35.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.067', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.072', 'weapon5': '0.080', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.640', 'ARMOR': '0.937', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '2.958', 'DAMAGECOUNT': '11.046', 'FRAGCOUNT': '31.000'} [2024-08-05 23:52:01,144][52671] DAMAGECOUNT value on done: 61377.0 [2024-08-05 23:52:01,146][52671] Sum rewards: 48.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.484', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon4': '0.332', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '41.000'} [2024-08-05 23:52:01,250][52663] DAMAGECOUNT value on done: 59231.0 [2024-08-05 23:52:01,252][52663] Sum rewards: 45.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.923', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.105', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.092', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:01,337][52658] DAMAGECOUNT value on done: 59662.0 [2024-08-05 23:52:01,338][52658] Sum rewards: 38.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.819', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.360', 'ARMOR': '0.482', 'weapon2': '0.570', 'WEAPON3': '1.400', 'HITCOUNT': '2.380', 'weapon3': '2.792', 'DAMAGECOUNT': '10.965', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:02,086][52666] DAMAGECOUNT value on done: 56096.0 [2024-08-05 23:52:02,087][52666] Sum rewards: 37.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'weapon5': '0.004', 'WEAPON5': '0.050', 'AMMO2': '0.056', 'AMMO3': '0.168', 'AMMO4': '0.281', 'ARMOR': '0.460', 'weapon4': '0.584', 'WEAPON4': '0.650', 'weapon2': '0.778', 'WEAPON3': '1.050', 'HITCOUNT': '2.090', 'weapon3': '2.334', 'DAMAGECOUNT': '9.339', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 149397504. Throughput: 0: 4398.7. Samples: 37349850. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 23:52:02,795][52567] Avg episode reward: [(0, '43.124')] [2024-08-05 23:52:03,006][52670] DAMAGECOUNT value on done: 59803.0 [2024-08-05 23:52:03,008][52670] Sum rewards: 41.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'ARMOR': '0.400', 'weapon2': '0.852', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.860', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:03,040][52665] DAMAGECOUNT value on done: 56579.0 [2024-08-05 23:52:03,040][52665] Sum rewards: 45.250, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.888', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.152', 'weapon5': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.924', 'WEAPON3': '0.950', 'HITCOUNT': '2.500', 'weapon3': '2.546', 'DAMAGECOUNT': '10.473', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:03,452][52659] DAMAGECOUNT value on done: 61942.0 [2024-08-05 23:52:03,455][52659] Sum rewards: 36.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.142', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.520', 'weapon2': '0.906', 'ARMOR': '0.918', 'WEAPON3': '1.050', 'weapon3': '2.184', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '31.000'} [2024-08-05 23:52:03,511][52671] DAMAGECOUNT value on done: 63663.0 [2024-08-05 23:52:03,513][52671] Sum rewards: 46.246, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.042', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '2.938', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:03,987][52820] DAMAGECOUNT value on done: 54827.0 [2024-08-05 23:52:03,988][52820] Sum rewards: 36.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.438', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.132', 'AMMO3': '0.190', 'AMMO4': '0.202', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.424', 'weapon2': '0.804', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '2.550', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:04,169][52650] Updated weights for policy 0, policy_version 18241 (0.0017) [2024-08-05 23:52:04,332][52658] DAMAGECOUNT value on done: 59273.0 [2024-08-05 23:52:04,332][52658] Sum rewards: 36.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.188', 'weapon4': '0.340', 'WEAPON4': '0.400', 'weapon2': '0.558', 'ARMOR': '0.977', 'WEAPON3': '1.300', 'HITCOUNT': '2.150', 'weapon3': '2.732', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:04,681][52663] DAMAGECOUNT value on done: 56835.0 [2024-08-05 23:52:04,683][52663] Sum rewards: 46.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.629', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'ARMOR': '0.485', 'weapon2': '0.852', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.746', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '40.000'} [2024-08-05 23:52:04,897][52666] DAMAGECOUNT value on done: 58038.0 [2024-08-05 23:52:04,898][52666] Sum rewards: 38.202, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.803', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.077', 'AMMO3': '0.279', 'weapon4': '0.314', 'AMMO4': '0.384', 'ARMOR': '0.400', 'weapon2': '0.730', 'WEAPON4': '0.750', 'WEAPON3': '1.650', 'HITCOUNT': '2.500', 'weapon3': '2.662', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '38.000'} [2024-08-05 23:52:05,750][52665] DAMAGECOUNT value on done: 56428.0 [2024-08-05 23:52:05,750][52665] Sum rewards: 36.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.539', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.218', 'weapon2': '0.244', 'WEAPON3': '1.250', 'HITCOUNT': '2.130', 'weapon3': '3.290', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:06,045][52670] DAMAGECOUNT value on done: 55563.0 [2024-08-05 23:52:06,046][52670] Sum rewards: 46.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.023', 'weapon5': '0.028', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'ARMOR': '0.400', 'weapon2': '1.032', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '2.632', 'DAMAGECOUNT': '10.716', 'FRAGCOUNT': '41.000'} [2024-08-05 23:52:06,654][52659] DAMAGECOUNT value on done: 60178.0 [2024-08-05 23:52:06,654][52659] Sum rewards: 39.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.046', 'weapon4': '0.166', 'AMMO3': '0.208', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.350', 'HITCOUNT': '2.320', 'weapon3': '3.008', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '37.000'} [2024-08-05 23:52:06,730][52671] DAMAGECOUNT value on done: 60356.0 [2024-08-05 23:52:06,730][52671] Sum rewards: 42.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.092', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.138', 'AMMO3': '0.153', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '0.950', 'HITCOUNT': '2.170', 'weapon3': '2.862', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:06,966][52658] DAMAGECOUNT value on done: 59014.0 [2024-08-05 23:52:06,967][52658] Sum rewards: 38.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.106', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.165', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.338', 'weapon2': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.310', 'weapon3': '2.796', 'DAMAGECOUNT': '10.587', 'FRAGCOUNT': '32.000'} [2024-08-05 23:52:07,058][52820] DAMAGECOUNT value on done: 58518.0 [2024-08-05 23:52:07,059][52820] Sum rewards: 40.260, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.066', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.614', 'ARMOR': '0.851', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '2.758', 'DAMAGECOUNT': '11.169', 'FRAGCOUNT': '38.000'} [2024-08-05 23:52:07,602][52666] DAMAGECOUNT value on done: 59414.0 [2024-08-05 23:52:07,602][52666] Sum rewards: 44.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.098', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'weapon2': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.868', 'DAMAGECOUNT': '11.202', 'FRAGCOUNT': '40.000'} [2024-08-05 23:52:07,756][52663] DAMAGECOUNT value on done: 59173.0 [2024-08-05 23:52:07,756][52663] Sum rewards: 40.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.965', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.148', 'weapon4': '0.178', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'weapon5': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '0.950', 'HITCOUNT': '2.300', 'weapon3': '2.620', 'DAMAGECOUNT': '10.788', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:07,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 149487616. Throughput: 0: 4384.0. Samples: 37376100. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-05 23:52:07,794][52567] Avg episode reward: [(0, '42.504')] [2024-08-05 23:52:08,726][52670] DAMAGECOUNT value on done: 59936.0 [2024-08-05 23:52:08,726][52670] Sum rewards: 43.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.538', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.202', 'ARMOR': '0.412', 'weapon2': '0.894', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '37.000'} [2024-08-05 23:52:08,865][52650] Updated weights for policy 0, policy_version 18251 (0.0025) [2024-08-05 23:52:09,571][52659] DAMAGECOUNT value on done: 61702.0 [2024-08-05 23:52:09,571][52659] Sum rewards: 54.089, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '44.000'} [2024-08-05 23:52:09,663][52658] DAMAGECOUNT value on done: 61872.0 [2024-08-05 23:52:09,663][52658] Sum rewards: 40.827, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.642', 'AMMO5': '0.003', 'AMMO2': '0.047', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.233', 'AMMO3': '0.237', 'weapon4': '0.454', 'WEAPON4': '0.550', 'weapon2': '0.680', 'ARMOR': '0.812', 'WEAPON3': '1.550', 'weapon3': '2.540', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.542', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:09,674][52671] DAMAGECOUNT value on done: 63069.0 [2024-08-05 23:52:09,675][52671] Sum rewards: 48.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'weapon4': '0.218', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '2.988', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:10,240][52820] DAMAGECOUNT value on done: 55873.0 [2024-08-05 23:52:10,240][52820] Sum rewards: 42.284, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.194', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.278', 'WEAPON4': '0.400', 'weapon2': '1.100', 'WEAPON3': '1.150', 'ARMOR': '2.168', 'weapon3': '2.390', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '37.500'} [2024-08-05 23:52:10,508][52666] DAMAGECOUNT value on done: 59864.0 [2024-08-05 23:52:10,508][52666] Sum rewards: 53.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.517', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.192', 'WEAPON4': '0.450', 'weapon4': '0.544', 'weapon2': '0.550', 'ARMOR': '0.812', 'WEAPON3': '1.150', 'weapon3': '2.584', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '45.000'} [2024-08-05 23:52:10,972][52663] DAMAGECOUNT value on done: 62823.0 [2024-08-05 23:52:10,972][52663] Sum rewards: 57.308, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.005', 'AMMO4': '0.026', 'HEALTH': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.167', 'weapon2': '0.346', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '3.314', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '46.000'} [2024-08-05 23:52:11,409][52670] DAMAGECOUNT value on done: 58472.0 [2024-08-05 23:52:11,409][52670] Sum rewards: 49.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.272', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.136', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.740', 'ARMOR': '0.808', 'WEAPON3': '1.050', 'weapon3': '2.636', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:12,060][52659] DAMAGECOUNT value on done: 59793.0 [2024-08-05 23:52:12,062][52659] Sum rewards: 40.970, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.070', 'AMMO3': '0.170', 'HEALTH': '0.188', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.468', 'ARMOR': '0.516', 'weapon2': '0.646', 'WEAPON3': '0.950', 'weapon3': '2.520', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.704', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:12,096][52671] DAMAGECOUNT value on done: 61893.0 [2024-08-05 23:52:12,097][52671] Sum rewards: 53.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.771', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.036', 'ARMOR': '0.072', 'AMMO4': '0.180', 'weapon4': '0.194', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.926', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '47.000'} [2024-08-05 23:52:12,665][52658] DAMAGECOUNT value on done: 63289.0 [2024-08-05 23:52:12,666][52658] Sum rewards: 42.386, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.164', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.094', 'AMMO3': '0.131', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon4': '0.482', 'ARMOR': '0.495', 'WEAPON4': '0.550', 'weapon2': '0.604', 'WEAPON3': '0.800', 'HITCOUNT': '2.360', 'weapon3': '2.560', 'DAMAGECOUNT': '9.630', 'FRAGCOUNT': '35.000'} [2024-08-05 23:52:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 149577728. Throughput: 0: 4391.3. Samples: 37402670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:52:12,795][52567] Avg episode reward: [(0, '43.219')] [2024-08-05 23:52:12,795][52614] Saving new best policy, reward=43.219! [2024-08-05 23:52:13,367][52820] DAMAGECOUNT value on done: 55316.0 [2024-08-05 23:52:13,369][52820] Sum rewards: 38.305, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.017', 'ARMOR': '0.032', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO3': '0.158', 'AMMO4': '0.184', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.768', 'WEAPON3': '1.100', 'HITCOUNT': '2.290', 'weapon3': '2.562', 'DAMAGECOUNT': '9.705', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:13,629][52650] Updated weights for policy 0, policy_version 18261 (0.0017) [2024-08-05 23:52:14,037][52663] DAMAGECOUNT value on done: 59719.0 [2024-08-05 23:52:14,037][52663] Sum rewards: 36.465, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.255', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.108', 'weapon4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.500', 'ARMOR': '0.915', 'WEAPON3': '1.550', 'HITCOUNT': '2.580', 'weapon3': '3.074', 'DAMAGECOUNT': '10.797', 'FRAGCOUNT': '35.000'} [2024-08-05 23:52:14,217][52670] DAMAGECOUNT value on done: 58798.0 [2024-08-05 23:52:14,217][52670] Sum rewards: 43.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.966', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '3.144', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '37.000'} [2024-08-05 23:52:14,822][52659] DAMAGECOUNT value on done: 62793.0 [2024-08-05 23:52:14,825][52659] Sum rewards: 47.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.005', 'AMMO2': '0.022', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon5': '0.132', 'AMMO3': '0.155', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.000', 'HITCOUNT': '2.410', 'weapon3': '2.892', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '40.000'} [2024-08-05 23:52:14,869][52671] DAMAGECOUNT value on done: 60665.0 [2024-08-05 23:52:14,871][52671] Sum rewards: 34.444, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.538', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'weapon4': '0.192', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.700', 'HITCOUNT': '2.650', 'weapon3': '2.980', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:15,756][52658] DAMAGECOUNT value on done: 59237.0 [2024-08-05 23:52:15,759][52658] Sum rewards: 47.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.764', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.336', 'WEAPON4': '0.350', 'ARMOR': '0.495', 'weapon2': '0.762', 'WEAPON3': '1.150', 'weapon3': '2.548', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '38.000'} [2024-08-05 23:52:16,524][52663] DAMAGECOUNT value on done: 61647.0 [2024-08-05 23:52:16,525][52663] Sum rewards: 44.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.698', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.846', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:16,561][52820] DAMAGECOUNT value on done: 60823.0 [2024-08-05 23:52:16,562][52820] Sum rewards: 52.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.863', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.166', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.280', 'ARMOR': '0.823', 'weapon2': '0.894', 'WEAPON3': '1.050', 'weapon3': '2.452', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '43.500'} [2024-08-05 23:52:17,499][52670] DAMAGECOUNT value on done: 58040.0 [2024-08-05 23:52:17,500][52670] Sum rewards: 48.797, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.073', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.182', 'weapon4': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon2': '0.616', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.942', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:17,619][52659] DAMAGECOUNT value on done: 61415.0 [2024-08-05 23:52:17,619][52659] Sum rewards: 37.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.628', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.092', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'AMMO4': '0.275', 'weapon4': '0.454', 'WEAPON4': '0.500', 'weapon2': '0.776', 'ARMOR': '0.828', 'WEAPON3': '1.100', 'weapon3': '2.428', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '32.000'} [2024-08-05 23:52:17,703][52671] DAMAGECOUNT value on done: 65576.0 [2024-08-05 23:52:17,703][52671] Sum rewards: 37.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'ARMOR': '0.460', 'weapon2': '0.712', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '2.930', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 149667840. Throughput: 0: 4389.3. Samples: 37415760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:52:17,794][52567] Avg episode reward: [(0, '42.939')] [2024-08-05 23:52:18,261][52650] Updated weights for policy 0, policy_version 18271 (0.0027) [2024-08-05 23:52:18,753][52658] DAMAGECOUNT value on done: 58836.0 [2024-08-05 23:52:18,753][52658] Sum rewards: 34.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.474', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.152', 'AMMO4': '0.152', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.268', 'weapon2': '0.824', 'ARMOR': '0.852', 'WEAPON3': '1.100', 'HITCOUNT': '2.110', 'weapon3': '2.468', 'DAMAGECOUNT': '8.487', 'FRAGCOUNT': '31.000'} [2024-08-05 23:52:19,250][52803] DAMAGECOUNT value on done: 57318.0 [2024-08-05 23:52:19,251][52803] Sum rewards: 40.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.056', 'weapon4': '0.092', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.592', 'ARMOR': '0.917', 'WEAPON3': '1.550', 'HITCOUNT': '2.380', 'weapon3': '2.992', 'DAMAGECOUNT': '10.953', 'FRAGCOUNT': '37.500'} [2024-08-05 23:52:19,317][52663] DAMAGECOUNT value on done: 62735.0 [2024-08-05 23:52:19,318][52663] Sum rewards: 48.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.402', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO3': '0.121', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.400', 'weapon2': '0.692', 'WEAPON3': '0.800', 'ARMOR': '0.916', 'HITCOUNT': '2.480', 'weapon3': '2.760', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '40.000'} [2024-08-05 23:52:19,656][52820] DAMAGECOUNT value on done: 58783.0 [2024-08-05 23:52:19,658][52820] Sum rewards: 35.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.097', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.024', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon4': '0.178', 'weapon2': '0.522', 'WEAPON3': '0.950', 'HITCOUNT': '2.280', 'weapon3': '3.076', 'DAMAGECOUNT': '8.946', 'FRAGCOUNT': '30.000'} [2024-08-05 23:52:20,393][52659] DAMAGECOUNT value on done: 58548.0 [2024-08-05 23:52:20,397][52659] Sum rewards: 58.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.025', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'ARMOR': '0.400', 'weapon2': '0.732', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.948', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '50.000'} [2024-08-05 23:52:20,566][52671] DAMAGECOUNT value on done: 61589.0 [2024-08-05 23:52:20,569][52671] Sum rewards: 55.556, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.185', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.096', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'WEAPON3': '0.600', 'weapon4': '0.638', 'weapon2': '0.892', 'weapon3': '2.198', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:21,274][52658] DAMAGECOUNT value on done: 64064.0 [2024-08-05 23:52:21,275][52658] Sum rewards: 49.673, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.075', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.808', 'WEAPON3': '1.250', 'ARMOR': '1.313', 'weapon3': '2.802', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:22,258][52803] DAMAGECOUNT value on done: 61528.0 [2024-08-05 23:52:22,260][52803] Sum rewards: 38.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO4': '0.026', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.233', 'ARMOR': '0.416', 'weapon2': '0.486', 'WEAPON3': '1.450', 'HITCOUNT': '2.430', 'weapon3': '3.290', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '35.000'} [2024-08-05 23:52:22,368][52663] DAMAGECOUNT value on done: 63420.0 [2024-08-05 23:52:22,368][52663] Sum rewards: 49.925, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.238', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.118', 'weapon4': '0.124', 'AMMO4': '0.148', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon2': '0.806', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.728', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '43.000'} [2024-08-05 23:52:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 149749760. Throughput: 0: 4389.1. Samples: 37442270. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:52:22,794][52567] Avg episode reward: [(0, '43.366')] [2024-08-05 23:52:22,795][52614] Saving new best policy, reward=43.366! [2024-08-05 23:52:22,878][52820] DAMAGECOUNT value on done: 57863.0 [2024-08-05 23:52:22,880][52820] Sum rewards: 45.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.666', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.248', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '2.852', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '41.000'} [2024-08-05 23:52:23,087][52650] Updated weights for policy 0, policy_version 18281 (0.0011) [2024-08-05 23:52:23,273][52659] DAMAGECOUNT value on done: 59824.0 [2024-08-05 23:52:23,276][52659] Sum rewards: 52.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.208', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'ARMOR': '0.465', 'weapon2': '0.634', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '44.000'} [2024-08-05 23:52:23,460][52671] DAMAGECOUNT value on done: 58679.0 [2024-08-05 23:52:23,460][52671] Sum rewards: 48.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.470', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.274', 'ARMOR': '0.461', 'weapon2': '0.634', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '2.882', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '45.000'} [2024-08-05 23:52:25,090][52663] DAMAGECOUNT value on done: 59525.0 [2024-08-05 23:52:25,093][52663] Sum rewards: 38.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'AMMO4': '0.260', 'WEAPON4': '0.500', 'weapon4': '0.554', 'weapon2': '0.612', 'ARMOR': '1.261', 'WEAPON3': '1.300', 'HITCOUNT': '2.380', 'weapon3': '2.642', 'DAMAGECOUNT': '9.948', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:25,363][52803] DAMAGECOUNT value on done: 57015.0 [2024-08-05 23:52:25,365][52803] Sum rewards: 45.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.188', 'AMMO3': '0.189', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.908', 'weapon2': '1.024', 'WEAPON3': '1.100', 'weapon3': '2.276', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:26,081][52811] DAMAGECOUNT value on done: 58470.0 [2024-08-05 23:52:26,083][52811] Sum rewards: 49.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.468', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.159', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '40.500'} [2024-08-05 23:52:26,331][52659] DAMAGECOUNT value on done: 62730.0 [2024-08-05 23:52:26,331][52659] Sum rewards: 43.564, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'weapon5': '0.014', 'AMMO5': '0.015', 'weapon4': '0.036', 'AMMO2': '0.038', 'AMMO3': '0.170', 'AMMO4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.855', 'weapon2': '0.920', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '2.832', 'DAMAGECOUNT': '9.651', 'FRAGCOUNT': '37.000'} [2024-08-05 23:52:26,505][52671] DAMAGECOUNT value on done: 62526.0 [2024-08-05 23:52:26,507][52671] Sum rewards: 39.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.014', 'AMMO2': '0.033', 'ARMOR': '0.040', 'weapon5': '0.040', 'AMMO4': '0.167', 'AMMO3': '0.217', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.350', 'HITCOUNT': '2.480', 'weapon3': '2.840', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:27,505][52650] Updated weights for policy 0, policy_version 18291 (0.0011) [2024-08-05 23:52:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 149839872. Throughput: 0: 4394.7. Samples: 37468580. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:52:27,794][52567] Avg episode reward: [(0, '43.467')] [2024-08-05 23:52:27,861][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018292_149848064.pth... [2024-08-05 23:52:27,998][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000017777_145629184.pth [2024-08-05 23:52:28,002][52614] Saving new best policy, reward=43.467! [2024-08-05 23:52:28,387][52803] DAMAGECOUNT value on done: 56759.0 [2024-08-05 23:52:28,388][52803] Sum rewards: 36.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.737', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.179', 'weapon4': '0.224', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'weapon2': '0.608', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '2.832', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:29,162][52811] DAMAGECOUNT value on done: 54983.0 [2024-08-05 23:52:29,162][52811] Sum rewards: 46.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.879', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'ARMOR': '0.800', 'weapon2': '0.900', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.814', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:29,588][52659] DAMAGECOUNT value on done: 61012.0 [2024-08-05 23:52:29,588][52659] Sum rewards: 51.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.216', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon7': '0.014', 'weapon4': '0.028', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.808', 'WEAPON3': '1.150', 'ARMOR': '1.387', 'HITCOUNT': '2.720', 'weapon3': '2.942', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:29,771][52671] DAMAGECOUNT value on done: 61691.0 [2024-08-05 23:52:29,774][52671] Sum rewards: 35.773, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.095', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO3': '0.117', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.478', 'weapon4': '0.586', 'WEAPON3': '0.800', 'ARMOR': '0.893', 'HITCOUNT': '2.150', 'weapon3': '2.630', 'DAMAGECOUNT': '8.685', 'FRAGCOUNT': '28.000'} [2024-08-05 23:52:31,496][52803] DAMAGECOUNT value on done: 59048.0 [2024-08-05 23:52:31,498][52803] Sum rewards: 41.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.612', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.744', 'ARMOR': '0.853', 'WEAPON3': '1.200', 'HITCOUNT': '2.260', 'weapon3': '3.002', 'DAMAGECOUNT': '10.836', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:32,280][52811] DAMAGECOUNT value on done: 57014.0 [2024-08-05 23:52:32,281][52811] Sum rewards: 37.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.986', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon5': '0.110', 'AMMO3': '0.212', 'AMMO4': '0.228', 'WEAPON5': '0.400', 'ARMOR': '0.456', 'weapon2': '0.478', 'weapon4': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.380', 'weapon3': '2.660', 'DAMAGECOUNT': '10.683', 'FRAGCOUNT': '35.000'} [2024-08-05 23:52:32,319][52650] Updated weights for policy 0, policy_version 18301 (0.0017) [2024-08-05 23:52:32,574][52659] DAMAGECOUNT value on done: 60465.0 [2024-08-05 23:52:32,577][52659] Sum rewards: 39.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.140', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.126', 'weapon4': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'WEAPON3': '0.750', 'weapon2': '0.960', 'HITCOUNT': '2.270', 'weapon3': '2.466', 'DAMAGECOUNT': '10.533', 'FRAGCOUNT': '32.000'} [2024-08-05 23:52:32,672][52671] DAMAGECOUNT value on done: 62745.0 [2024-08-05 23:52:32,674][52671] Sum rewards: 36.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.388', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.242', 'weapon4': '0.270', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '2.770', 'DAMAGECOUNT': '11.085', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 149929984. Throughput: 0: 4384.0. Samples: 37481470. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:52:32,795][52567] Avg episode reward: [(0, '43.309')] [2024-08-05 23:52:34,533][52803] DAMAGECOUNT value on done: 55973.0 [2024-08-05 23:52:34,534][52803] Sum rewards: 42.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.534', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.174', 'weapon4': '0.284', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon2': '0.794', 'WEAPON3': '1.100', 'weapon3': '2.544', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:35,252][52659] DAMAGECOUNT value on done: 58441.0 [2024-08-05 23:52:35,253][52659] Sum rewards: 48.179, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'HEALTH': '0.516', 'ARMOR': '0.800', 'weapon2': '0.838', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.970', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '38.000'} [2024-08-05 23:52:35,423][52811] DAMAGECOUNT value on done: 57290.0 [2024-08-05 23:52:35,425][52811] Sum rewards: 45.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.815', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.023', 'weapon5': '0.026', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon4': '0.232', 'weapon2': '0.622', 'ARMOR': '0.892', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '2.844', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:35,461][52671] DAMAGECOUNT value on done: 60281.0 [2024-08-05 23:52:35,462][52671] Sum rewards: 44.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.855', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.213', 'weapon4': '0.244', 'WEAPON4': '0.250', 'ARMOR': '0.420', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '38.500'} [2024-08-05 23:52:36,862][52650] Updated weights for policy 0, policy_version 18311 (0.0010) [2024-08-05 23:52:37,329][52803] DAMAGECOUNT value on done: 58842.0 [2024-08-05 23:52:37,330][52803] Sum rewards: 44.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.421', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.224', 'weapon4': '0.304', 'WEAPON4': '0.450', 'ARMOR': '0.494', 'weapon2': '0.902', 'WEAPON3': '1.300', 'weapon3': '2.454', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.223', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 150011904. Throughput: 0: 4396.9. Samples: 37508110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 23:52:37,794][52567] Avg episode reward: [(0, '43.429')] [2024-08-05 23:52:38,220][52659] DAMAGECOUNT value on done: 60408.0 [2024-08-05 23:52:38,221][52659] Sum rewards: 49.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.423', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'ARMOR': '0.457', 'weapon4': '0.694', 'weapon2': '0.706', 'WEAPON3': '1.350', 'weapon3': '2.208', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:38,417][52811] DAMAGECOUNT value on done: 55919.0 [2024-08-05 23:52:38,420][52671] DAMAGECOUNT value on done: 59216.0 [2024-08-05 23:52:38,420][52671] Sum rewards: 41.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.086', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.136', 'AMMO4': '0.172', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.646', 'ARMOR': '0.956', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.866', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:38,420][52811] Sum rewards: 31.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.645', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.154', 'weapon4': '0.180', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'ARMOR': '0.848', 'WEAPON3': '0.950', 'weapon2': '1.108', 'HITCOUNT': '2.160', 'weapon3': '2.304', 'DAMAGECOUNT': '9.849', 'FRAGCOUNT': '29.000'} [2024-08-05 23:52:40,545][52803] DAMAGECOUNT value on done: 57356.0 [2024-08-05 23:52:40,548][52803] Sum rewards: 43.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.766', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.208', 'weapon4': '0.470', 'WEAPON4': '0.550', 'weapon2': '0.636', 'ARMOR': '0.852', 'WEAPON3': '1.150', 'weapon3': '2.546', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:40,852][52614] Signal inference workers to stop experience collection... (3400 times) [2024-08-05 23:52:40,853][52614] Signal inference workers to resume experience collection... (3400 times) [2024-08-05 23:52:40,901][52650] InferenceWorker_p0-w0: stopping experience collection (3400 times) [2024-08-05 23:52:40,902][52650] InferenceWorker_p0-w0: resuming experience collection (3400 times) [2024-08-05 23:52:41,326][52811] DAMAGECOUNT value on done: 59400.0 [2024-08-05 23:52:41,326][52811] Sum rewards: 45.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.758', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.028', 'AMMO4': '0.089', 'weapon4': '0.112', 'weapon5': '0.142', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.960', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '40.000'} [2024-08-05 23:52:41,354][52650] Updated weights for policy 0, policy_version 18321 (0.0012) [2024-08-05 23:52:41,504][52659] DAMAGECOUNT value on done: 61550.0 [2024-08-05 23:52:41,505][52659] Sum rewards: 44.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon5': '0.052', 'AMMO4': '0.154', 'AMMO3': '0.199', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.620', 'ARMOR': '0.861', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '2.852', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '38.000'} [2024-08-05 23:52:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17578.3). Total num frames: 150102016. Throughput: 0: 4408.7. Samples: 37534880. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 23:52:42,794][52567] Avg episode reward: [(0, '43.446')] [2024-08-05 23:52:43,621][52803] DAMAGECOUNT value on done: 59819.0 [2024-08-05 23:52:43,621][52803] Sum rewards: 45.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.584', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.129', 'weapon4': '0.154', 'AMMO3': '0.211', 'weapon2': '0.870', 'WEAPON3': '1.200', 'ARMOR': '1.360', 'HITCOUNT': '2.650', 'weapon3': '2.686', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '37.000'} [2024-08-05 23:52:44,485][52811] DAMAGECOUNT value on done: 58967.0 [2024-08-05 23:52:44,486][52811] Sum rewards: 36.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.655', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.177', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'ARMOR': '0.800', 'WEAPON3': '1.000', 'weapon2': '1.390', 'weapon3': '2.214', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '8.901', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:44,575][52659] DAMAGECOUNT value on done: 66452.0 [2024-08-05 23:52:44,576][52664] DAMAGECOUNT value on done: 62287.0 [2024-08-05 23:52:44,577][52659] Sum rewards: 38.884, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.392', 'AMMO5': '0.020', 'weapon5': '0.026', 'ARMOR': '0.036', 'AMMO2': '0.049', 'AMMO3': '0.239', 'AMMO4': '0.247', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.726', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '2.582', 'DAMAGECOUNT': '10.455', 'FRAGCOUNT': '38.000'} [2024-08-05 23:52:44,578][52664] Sum rewards: 34.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.154', 'AMMO4': '0.191', 'WEAPON4': '0.350', 'weapon4': '0.406', 'ARMOR': '0.800', 'weapon2': '0.850', 'WEAPON3': '1.000', 'HITCOUNT': '2.370', 'weapon3': '2.494', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '31.500'} [2024-08-05 23:52:46,221][52650] Updated weights for policy 0, policy_version 18331 (0.0021) [2024-08-05 23:52:46,655][52803] DAMAGECOUNT value on done: 54626.0 [2024-08-05 23:52:46,657][52803] Sum rewards: 36.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.589', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.221', 'weapon4': '0.338', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.828', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:47,041][52649] DAMAGECOUNT value on done: 59714.0 [2024-08-05 23:52:47,044][52649] Sum rewards: 39.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.566', 'AMMO5': '0.024', 'AMMO2': '0.063', 'AMMO3': '0.146', 'weapon5': '0.216', 'AMMO4': '0.315', 'ARMOR': '0.468', 'WEAPON5': '0.600', 'weapon4': '0.722', 'WEAPON4': '0.900', 'WEAPON3': '0.950', 'weapon2': '1.054', 'weapon3': '1.706', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '10.551', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:47,337][52664] DAMAGECOUNT value on done: 62912.0 [2024-08-05 23:52:47,338][52664] Sum rewards: 44.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.992', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.118', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.748', 'ARMOR': '0.870', 'WEAPON3': '1.550', 'HITCOUNT': '2.710', 'weapon3': '2.878', 'DAMAGECOUNT': '11.448', 'FRAGCOUNT': '41.000'} [2024-08-05 23:52:47,471][52811] DAMAGECOUNT value on done: 56365.0 [2024-08-05 23:52:47,475][52811] Sum rewards: 38.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.285', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.604', 'WEAPON3': '1.450', 'HITCOUNT': '2.570', 'weapon3': '2.852', 'DAMAGECOUNT': '10.449', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:47,523][52659] DAMAGECOUNT value on done: 60404.0 [2024-08-05 23:52:47,524][52659] Sum rewards: 37.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.492', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon4': '0.074', 'AMMO4': '0.194', 'weapon5': '0.226', 'AMMO3': '0.232', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.598', 'ARMOR': '0.905', 'WEAPON3': '1.400', 'HITCOUNT': '2.320', 'weapon3': '2.790', 'DAMAGECOUNT': '11.142', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:47,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 150200320. Throughput: 0: 4405.3. Samples: 37548090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-05 23:52:47,794][52567] Avg episode reward: [(0, '42.742')] [2024-08-05 23:52:49,745][52803] DAMAGECOUNT value on done: 60787.0 [2024-08-05 23:52:49,747][52803] Sum rewards: 39.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.714', 'AMMO5': '0.005', 'weapon7': '0.018', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.224', 'weapon4': '0.332', 'WEAPON4': '0.400', 'ARMOR': '0.487', 'weapon2': '0.544', 'WEAPON3': '1.450', 'HITCOUNT': '2.430', 'weapon3': '2.690', 'DAMAGECOUNT': '10.383', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:50,060][52664] DAMAGECOUNT value on done: 63863.0 [2024-08-05 23:52:50,061][52664] Sum rewards: 38.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.118', 'AMMO5': '0.016', 'AMMO2': '0.034', 'ARMOR': '0.040', 'AMMO3': '0.147', 'weapon5': '0.162', 'AMMO4': '0.171', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.880', 'WEAPON3': '0.950', 'HITCOUNT': '2.070', 'weapon3': '2.406', 'DAMAGECOUNT': '10.119', 'FRAGCOUNT': '35.000'} [2024-08-05 23:52:50,217][52659] DAMAGECOUNT value on done: 60986.0 [2024-08-05 23:52:50,218][52659] Sum rewards: 38.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.789', 'AMMO2': '0.018', 'ARMOR': '0.028', 'AMMO4': '0.091', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.360', 'weapon2': '0.624', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.800', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:50,220][52649] DAMAGECOUNT value on done: 60709.0 [2024-08-05 23:52:50,221][52649] Sum rewards: 42.125, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.133', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'AMMO4': '0.227', 'ARMOR': '0.440', 'WEAPON4': '0.550', 'weapon2': '0.556', 'weapon4': '0.648', 'WEAPON3': '1.350', 'weapon3': '2.362', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '39.000'} [2024-08-05 23:52:50,343][52650] Updated weights for policy 0, policy_version 18341 (0.0030) [2024-08-05 23:52:50,486][52811] DAMAGECOUNT value on done: 58569.0 [2024-08-05 23:52:50,488][52811] Sum rewards: 47.784, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.162', 'AMMO5': '0.005', 'weapon4': '0.036', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'AMMO3': '0.292', 'ARMOR': '0.400', 'weapon2': '0.606', 'WEAPON3': '1.800', 'HITCOUNT': '2.700', 'weapon3': '3.070', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '47.000'} [2024-08-05 23:52:52,751][52649] DAMAGECOUNT value on done: 60393.0 [2024-08-05 23:52:52,754][52649] Sum rewards: 48.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.998', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon4': '0.252', 'weapon2': '0.442', 'ARMOR': '0.861', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.068', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '42.000'} [2024-08-05 23:52:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 150282240. Throughput: 0: 4411.1. Samples: 37574600. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:52:52,794][52567] Avg episode reward: [(0, '42.880')] [2024-08-05 23:52:52,807][52803] DAMAGECOUNT value on done: 58260.0 [2024-08-05 23:52:52,808][52803] Sum rewards: 41.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.398', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.584', 'ARMOR': '0.916', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '3.010', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '35.000'} [2024-08-05 23:52:53,205][52664] DAMAGECOUNT value on done: 63315.0 [2024-08-05 23:52:53,206][52664] Sum rewards: 36.881, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.715', 'weapon5': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.061', 'AMMO3': '0.224', 'AMMO4': '0.303', 'WEAPON5': '0.350', 'weapon4': '0.510', 'WEAPON4': '0.750', 'ARMOR': '0.905', 'weapon2': '0.934', 'WEAPON3': '1.250', 'weapon3': '2.276', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '36.000'} [2024-08-05 23:52:53,360][52659] DAMAGECOUNT value on done: 61565.0 [2024-08-05 23:52:53,362][52659] Sum rewards: 54.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.845', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.256', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '47.000'} [2024-08-05 23:52:53,519][52811] DAMAGECOUNT value on done: 57261.0 [2024-08-05 23:52:53,520][52811] Sum rewards: 36.479, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.698', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.225', 'weapon4': '0.262', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon2': '0.574', 'WEAPON3': '1.250', 'HITCOUNT': '2.460', 'weapon3': '2.910', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '34.500'} [2024-08-05 23:52:55,576][52650] Updated weights for policy 0, policy_version 18351 (0.0016) [2024-08-05 23:52:55,597][52659] DAMAGECOUNT value on done: 64181.0 [2024-08-05 23:52:55,598][52659] Sum rewards: 56.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.022', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.024', 'weapon5': '0.062', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.187', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '46.000'} [2024-08-05 23:52:55,604][52664] DAMAGECOUNT value on done: 61626.0 [2024-08-05 23:52:55,604][52664] Sum rewards: 51.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.724', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.161', 'WEAPON4': '0.350', 'weapon2': '0.476', 'weapon4': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.310', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '44.000'} [2024-08-05 23:52:55,840][52649] DAMAGECOUNT value on done: 59991.0 [2024-08-05 23:52:55,841][52649] Sum rewards: 58.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.914', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon4': '0.354', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '48.000'} [2024-08-05 23:52:55,995][52803] DAMAGECOUNT value on done: 56703.0 [2024-08-05 23:52:55,999][52803] Sum rewards: 51.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.977', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.714', 'ARMOR': '0.856', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.944', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '43.000'} [2024-08-05 23:52:56,618][52811] DAMAGECOUNT value on done: 60320.0 [2024-08-05 23:52:56,619][52811] Sum rewards: 31.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.191', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.169', 'AMMO4': '0.277', 'WEAPON5': '0.300', 'ARMOR': '0.420', 'weapon2': '0.592', 'WEAPON4': '0.600', 'weapon4': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.118', 'HITCOUNT': '2.130', 'DAMAGECOUNT': '9.624', 'FRAGCOUNT': '29.000'} [2024-08-05 23:52:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 150364160. Throughput: 0: 4405.6. Samples: 37600920. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:52:57,794][52567] Avg episode reward: [(0, '43.357')] [2024-08-05 23:52:58,096][52664] DAMAGECOUNT value on done: 67295.0 [2024-08-05 23:52:58,096][52664] Sum rewards: 37.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.084', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.208', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON4': '0.400', 'weapon2': '0.742', 'WEAPON3': '1.250', 'weapon3': '2.268', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '33.000'} [2024-08-05 23:52:58,233][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:52:59,001][52649] DAMAGECOUNT value on done: 58284.0 [2024-08-05 23:52:59,002][52649] Sum rewards: 34.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.325', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.219', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.388', 'weapon2': '0.426', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.020', 'weapon3': '2.652', 'DAMAGECOUNT': '9.042', 'FRAGCOUNT': '34.000'} [2024-08-05 23:52:59,152][52803] DAMAGECOUNT value on done: 57981.0 [2024-08-05 23:52:59,154][52803] Sum rewards: 39.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.185', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.118', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.876', 'WEAPON3': '1.100', 'HITCOUNT': '2.430', 'weapon3': '2.614', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '33.500'} [2024-08-05 23:52:59,638][52811] DAMAGECOUNT value on done: 55565.0 [2024-08-05 23:52:59,640][52811] Sum rewards: 47.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.328', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.017', 'ARMOR': '0.028', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.224', 'weapon2': '0.286', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '3.258', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:00,126][52650] Updated weights for policy 0, policy_version 18361 (0.0014) [2024-08-05 23:53:00,575][52664] DAMAGECOUNT value on done: 62998.0 [2024-08-05 23:53:00,575][52664] Sum rewards: 44.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon5': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon4': '0.282', 'weapon2': '0.648', 'ARMOR': '0.800', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.786', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:01,731][52662] DAMAGECOUNT value on done: 67035.0 [2024-08-05 23:53:01,732][52662] Sum rewards: 36.614, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.249', 'weapon5': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.237', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '2.994', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '33.000'} [2024-08-05 23:53:02,060][52649] DAMAGECOUNT value on done: 57738.0 [2024-08-05 23:53:02,061][52649] Sum rewards: 36.044, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.984', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'AMMO3': '0.306', 'ARMOR': '0.412', 'weapon2': '0.542', 'WEAPON3': '1.850', 'HITCOUNT': '2.630', 'weapon3': '3.030', 'DAMAGECOUNT': '10.722', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:02,206][52803] DAMAGECOUNT value on done: 56167.0 [2024-08-05 23:53:02,206][52803] Sum rewards: 44.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.308', 'AMMO5': '0.017', 'weapon5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.160', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON4': '0.450', 'ARMOR': '0.476', 'weapon2': '0.532', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.852', 'DAMAGECOUNT': '10.167', 'FRAGCOUNT': '39.000'} [2024-08-05 23:53:02,699][52811] DAMAGECOUNT value on done: 59033.0 [2024-08-05 23:53:02,700][52811] Sum rewards: 42.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.056', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.212', 'WEAPON4': '0.400', 'ARMOR': '0.465', 'weapon2': '0.576', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.872', 'DAMAGECOUNT': '11.178', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 150462464. Throughput: 0: 4407.8. Samples: 37614110. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:53:02,802][52567] Avg episode reward: [(0, '43.324')] [2024-08-05 23:53:03,103][52668] DAMAGECOUNT value on done: 60289.0 [2024-08-05 23:53:03,104][52668] Sum rewards: 39.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.992', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.048', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.239', 'WEAPON4': '0.450', 'weapon4': '0.524', 'weapon2': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.392', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.070', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:03,634][52664] DAMAGECOUNT value on done: 59348.0 [2024-08-05 23:53:03,636][52664] Sum rewards: 32.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.052', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.237', 'weapon4': '0.530', 'WEAPON4': '0.600', 'weapon2': '0.776', 'WEAPON3': '1.200', 'ARMOR': '1.380', 'weapon3': '2.376', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '28.500'} [2024-08-05 23:53:04,631][52649] DAMAGECOUNT value on done: 57472.0 [2024-08-05 23:53:04,633][52649] Sum rewards: 43.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.507', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.120', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.576', 'ARMOR': '0.856', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '2.882', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:04,825][52650] Updated weights for policy 0, policy_version 18371 (0.0020) [2024-08-05 23:53:04,845][52662] DAMAGECOUNT value on done: 68209.0 [2024-08-05 23:53:04,846][52662] Sum rewards: 50.336, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.150', 'AMMO3': '0.287', 'weapon4': '0.318', 'weapon2': '0.410', 'ARMOR': '0.455', 'WEAPON3': '1.650', 'HITCOUNT': '2.750', 'weapon3': '3.028', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '48.000'} [2024-08-05 23:53:05,370][52803] DAMAGECOUNT value on done: 54574.0 [2024-08-05 23:53:05,371][52803] Sum rewards: 41.455, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.651', 'AMMO5': '0.007', 'ARMOR': '0.052', 'AMMO2': '0.055', 'weapon5': '0.074', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.274', 'weapon4': '0.532', 'weapon2': '0.626', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.438', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '40.000'} [2024-08-05 23:53:05,648][52668] DAMAGECOUNT value on done: 64889.0 [2024-08-05 23:53:05,651][52668] Sum rewards: 55.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.143', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.021', 'weapon4': '0.082', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.718', 'ARMOR': '0.820', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.026', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '45.000'} [2024-08-05 23:53:05,715][52811] DAMAGECOUNT value on done: 56350.0 [2024-08-05 23:53:05,718][52811] Sum rewards: 45.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.724', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.157', 'weapon4': '0.332', 'WEAPON4': '0.400', 'ARMOR': '0.482', 'weapon2': '0.698', 'WEAPON3': '1.000', 'HITCOUNT': '2.440', 'weapon3': '2.712', 'DAMAGECOUNT': '10.584', 'FRAGCOUNT': '39.000'} [2024-08-05 23:53:06,477][52664] DAMAGECOUNT value on done: 70549.0 [2024-08-05 23:53:06,477][52664] Sum rewards: 55.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.866', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.108', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.346', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.014', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '47.000'} [2024-08-05 23:53:06,849][52794] DAMAGECOUNT value on done: 67036.0 [2024-08-05 23:53:06,854][52794] Sum rewards: 52.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.368', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO3': '0.143', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'ARMOR': '0.436', 'WEAPON3': '0.950', 'weapon2': '1.098', 'weapon3': '2.528', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:07,535][52649] DAMAGECOUNT value on done: 63020.0 [2024-08-05 23:53:07,535][52649] Sum rewards: 53.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.614', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon2': '0.574', 'WEAPON3': '1.300', 'ARMOR': '1.374', 'weapon3': '2.714', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '43.000'} [2024-08-05 23:53:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 150544384. Throughput: 0: 4398.9. Samples: 37640220. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:53:07,794][52567] Avg episode reward: [(0, '43.889')] [2024-08-05 23:53:07,883][52614] Saving new best policy, reward=43.889! [2024-08-05 23:53:08,115][52662] DAMAGECOUNT value on done: 70604.0 [2024-08-05 23:53:08,116][52662] Sum rewards: 57.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.166', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '48.500'} [2024-08-05 23:53:08,426][52803] DAMAGECOUNT value on done: 58797.0 [2024-08-05 23:53:08,426][52803] Sum rewards: 53.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.622', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.259', 'weapon4': '0.298', 'WEAPON4': '0.400', 'weapon2': '0.610', 'ARMOR': '0.836', 'WEAPON3': '1.550', 'weapon3': '2.912', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '46.000'} [2024-08-05 23:53:08,864][52811] DAMAGECOUNT value on done: 58402.0 [2024-08-05 23:53:08,865][52811] Sum rewards: 53.693, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.063', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon5': '0.080', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon2': '0.362', 'weapon4': '0.514', 'WEAPON3': '0.800', 'weapon3': '2.712', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:09,033][52668] DAMAGECOUNT value on done: 58705.0 [2024-08-05 23:53:09,033][52668] Sum rewards: 36.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.152', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'ARMOR': '0.800', 'weapon2': '1.028', 'WEAPON3': '1.200', 'HITCOUNT': '2.190', 'weapon3': '2.416', 'DAMAGECOUNT': '9.651', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:09,521][52664] DAMAGECOUNT value on done: 65198.0 [2024-08-05 23:53:09,521][52664] Sum rewards: 55.808, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.215', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.026', 'weapon4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.127', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.780', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '46.000'} [2024-08-05 23:53:09,826][52794] DAMAGECOUNT value on done: 66734.0 [2024-08-05 23:53:09,826][52794] Sum rewards: 49.671, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.232', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.648', 'ARMOR': '0.840', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.002', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '45.000'} [2024-08-05 23:53:09,936][52650] Updated weights for policy 0, policy_version 18381 (0.0011) [2024-08-05 23:53:10,355][52649] DAMAGECOUNT value on done: 57425.0 [2024-08-05 23:53:10,355][52649] Sum rewards: 42.177, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.155', 'ARMOR': '0.400', 'weapon4': '0.524', 'weapon2': '0.596', 'WEAPON3': '0.950', 'HITCOUNT': '2.560', 'weapon3': '2.598', 'DAMAGECOUNT': '9.993', 'FRAGCOUNT': '34.000'} [2024-08-05 23:53:10,939][52662] DAMAGECOUNT value on done: 62458.0 [2024-08-05 23:53:10,941][52662] Sum rewards: 37.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.288', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.168', 'WEAPON3': '0.950', 'weapon2': '1.156', 'ARMOR': '1.254', 'HITCOUNT': '2.140', 'weapon3': '2.740', 'DAMAGECOUNT': '9.345', 'FRAGCOUNT': '30.000'} [2024-08-05 23:53:11,473][52803] DAMAGECOUNT value on done: 56815.0 [2024-08-05 23:53:11,476][52803] Sum rewards: 39.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.560', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.350', 'HITCOUNT': '2.600', 'weapon3': '2.854', 'DAMAGECOUNT': '11.235', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:11,647][52668] DAMAGECOUNT value on done: 60869.0 [2024-08-05 23:53:11,649][52668] Sum rewards: 35.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.175', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON4': '0.450', 'ARMOR': '0.967', 'weapon2': '0.994', 'WEAPON3': '1.150', 'weapon3': '2.206', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '31.000'} [2024-08-05 23:53:12,122][52811] DAMAGECOUNT value on done: 57660.0 [2024-08-05 23:53:12,123][52811] Sum rewards: 50.656, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.688', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.092', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'AMMO4': '0.302', 'weapon2': '0.366', 'ARMOR': '0.440', 'WEAPON4': '0.550', 'weapon4': '0.728', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.604', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:12,522][52664] DAMAGECOUNT value on done: 66526.0 [2024-08-05 23:53:12,522][52664] Sum rewards: 52.426, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.170', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'ARMOR': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.298', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '47.000'} [2024-08-05 23:53:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 150626304. Throughput: 0: 4398.7. Samples: 37666520. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-05 23:53:12,794][52567] Avg episode reward: [(0, '43.950')] [2024-08-05 23:53:12,795][52614] Saving new best policy, reward=43.950! [2024-08-05 23:53:13,034][52649] DAMAGECOUNT value on done: 58784.0 [2024-08-05 23:53:13,040][52649] Sum rewards: 52.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.472', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.230', 'weapon4': '0.308', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '47.000'} [2024-08-05 23:53:13,085][52794] DAMAGECOUNT value on done: 64231.0 [2024-08-05 23:53:13,086][52794] Sum rewards: 43.187, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.594', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.110', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.358', 'ARMOR': '0.404', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.352', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:13,433][52660] DAMAGECOUNT value on done: 60946.0 [2024-08-05 23:53:13,436][52660] Sum rewards: 29.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.106', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon4': '0.302', 'ARMOR': '0.824', 'weapon2': '0.860', 'WEAPON3': '1.500', 'HITCOUNT': '2.120', 'weapon3': '2.416', 'DAMAGECOUNT': '9.321', 'FRAGCOUNT': '28.000'} [2024-08-05 23:53:14,085][52650] Updated weights for policy 0, policy_version 18391 (0.0012) [2024-08-05 23:53:14,223][52668] DAMAGECOUNT value on done: 61634.0 [2024-08-05 23:53:14,223][52668] Sum rewards: 41.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.343', 'weapon7': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.153', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.378', 'WEAPON4': '0.400', 'ARMOR': '0.511', 'WEAPON3': '0.850', 'weapon4': '0.936', 'HITCOUNT': '2.210', 'weapon3': '2.492', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:14,243][52662] DAMAGECOUNT value on done: 64761.0 [2024-08-05 23:53:14,244][52662] Sum rewards: 37.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.920', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.189', 'weapon4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.250', 'HITCOUNT': '2.290', 'weapon3': '2.884', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '33.000'} [2024-08-05 23:53:14,677][52803] DAMAGECOUNT value on done: 59001.0 [2024-08-05 23:53:14,677][52803] Sum rewards: 47.103, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.112', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon5': '0.072', 'AMMO4': '0.227', 'weapon4': '0.290', 'AMMO3': '0.309', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.498', 'WEAPON4': '0.550', 'WEAPON3': '1.900', 'weapon3': '2.796', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '46.000'} [2024-08-05 23:53:15,211][52811] DAMAGECOUNT value on done: 58854.0 [2024-08-05 23:53:15,213][52811] Sum rewards: 51.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.848', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.200', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'ARMOR': '0.804', 'weapon2': '0.854', 'WEAPON3': '1.050', 'weapon3': '2.562', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '43.000'} [2024-08-05 23:53:15,592][52664] DAMAGECOUNT value on done: 62829.0 [2024-08-05 23:53:15,592][52664] Sum rewards: 42.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.823', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.156', 'AMMO4': '0.205', 'weapon5': '0.320', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.804', 'WEAPON3': '0.950', 'ARMOR': '1.332', 'weapon3': '2.230', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.557', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:15,689][52660] DAMAGECOUNT value on done: 64711.0 [2024-08-05 23:53:15,689][52660] Sum rewards: 45.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.080', 'AMMO4': '0.081', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.726', 'WEAPON3': '1.200', 'ARMOR': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.662', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:15,882][52794] DAMAGECOUNT value on done: 61812.0 [2024-08-05 23:53:15,883][52794] Sum rewards: 39.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'ARMOR': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '3.056', 'DAMAGECOUNT': '10.152', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:16,164][52649] DAMAGECOUNT value on done: 60715.0 [2024-08-05 23:53:16,167][52649] Sum rewards: 45.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon5': '0.218', 'ARMOR': '0.458', 'weapon2': '0.704', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '2.754', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:16,549][52668] DAMAGECOUNT value on done: 63183.0 [2024-08-05 23:53:16,551][52668] Sum rewards: 40.677, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.025', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.292', 'ARMOR': '0.901', 'WEAPON3': '1.050', 'weapon2': '1.090', 'HITCOUNT': '2.360', 'weapon3': '2.480', 'DAMAGECOUNT': '10.305', 'FRAGCOUNT': '34.000'} [2024-08-05 23:53:16,993][52662] DAMAGECOUNT value on done: 66773.0 [2024-08-05 23:53:16,996][52662] Sum rewards: 40.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.678', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.780', 'WEAPON3': '1.200', 'HITCOUNT': '2.210', 'weapon3': '2.796', 'DAMAGECOUNT': '10.452', 'FRAGCOUNT': '34.000'} [2024-08-05 23:53:17,693][52803] DAMAGECOUNT value on done: 56925.0 [2024-08-05 23:53:17,693][52803] Sum rewards: 33.708, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.172', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.019', 'weapon5': '0.026', 'weapon4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'weapon2': '0.760', 'ARMOR': '1.403', 'WEAPON3': '1.700', 'HITCOUNT': '2.420', 'weapon3': '2.930', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '33.000'} [2024-08-05 23:53:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 150724608. Throughput: 0: 4400.5. Samples: 37679490. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-05 23:53:17,794][52567] Avg episode reward: [(0, '43.741')] [2024-08-05 23:53:18,192][52664] DAMAGECOUNT value on done: 63651.0 [2024-08-05 23:53:18,201][52664] Sum rewards: 39.641, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.025', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO4': '0.205', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'weapon4': '0.424', 'ARMOR': '0.493', 'weapon2': '0.812', 'WEAPON3': '1.400', 'weapon3': '2.486', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:18,430][52811] DAMAGECOUNT value on done: 60784.0 [2024-08-05 23:53:18,431][52811] Sum rewards: 46.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.434', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.040', 'AMMO4': '0.106', 'weapon5': '0.132', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.814', 'ARMOR': '0.890', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.776', 'DAMAGECOUNT': '11.643', 'FRAGCOUNT': '39.500'} [2024-08-05 23:53:18,582][52660] DAMAGECOUNT value on done: 62815.0 [2024-08-05 23:53:18,583][52660] Sum rewards: 50.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.076', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.756', 'WEAPON3': '1.150', 'ARMOR': '1.766', 'weapon3': '2.586', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:18,711][52794] DAMAGECOUNT value on done: 64217.0 [2024-08-05 23:53:18,711][52794] Sum rewards: 39.496, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.792', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon5': '0.172', 'AMMO3': '0.208', 'AMMO4': '0.318', 'weapon4': '0.366', 'WEAPON5': '0.450', 'weapon2': '0.614', 'WEAPON4': '0.650', 'ARMOR': '0.928', 'WEAPON3': '1.250', 'weapon3': '2.510', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:19,172][52650] Updated weights for policy 0, policy_version 18401 (0.0034) [2024-08-05 23:53:19,324][52649] DAMAGECOUNT value on done: 61305.0 [2024-08-05 23:53:19,327][52649] Sum rewards: 52.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.792', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.180', 'weapon2': '0.610', 'ARMOR': '0.908', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.014', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '44.000'} [2024-08-05 23:53:19,573][52668] DAMAGECOUNT value on done: 63766.0 [2024-08-05 23:53:19,576][52668] Sum rewards: 54.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.491', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.074', 'AMMO3': '0.148', 'AMMO4': '0.169', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.432', 'weapon2': '0.500', 'weapon4': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.612', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '45.000'} [2024-08-05 23:53:19,858][52662] DAMAGECOUNT value on done: 67859.0 [2024-08-05 23:53:19,858][52662] Sum rewards: 36.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.062', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO3': '0.249', 'ARMOR': '0.424', 'weapon2': '0.430', 'WEAPON3': '1.450', 'HITCOUNT': '2.560', 'weapon3': '3.070', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '34.000'} [2024-08-05 23:53:21,051][52664] DAMAGECOUNT value on done: 62845.0 [2024-08-05 23:53:21,051][52664] Sum rewards: 37.739, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.818', 'AMMO5': '0.013', 'weapon5': '0.030', 'AMMO2': '0.044', 'AMMO4': '0.219', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.412', 'WEAPON4': '0.550', 'ARMOR': '0.858', 'weapon2': '0.956', 'WEAPON3': '1.450', 'weapon3': '2.270', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:21,399][52660] DAMAGECOUNT value on done: 61876.0 [2024-08-05 23:53:21,399][52660] Sum rewards: 28.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.396', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.144', 'AMMO3': '0.163', 'AMMO4': '0.224', 'WEAPON5': '0.450', 'weapon4': '0.460', 'WEAPON4': '0.600', 'weapon2': '0.828', 'ARMOR': '0.912', 'WEAPON3': '1.050', 'HITCOUNT': '2.210', 'weapon3': '2.230', 'DAMAGECOUNT': '8.568', 'FRAGCOUNT': '26.000'} [2024-08-05 23:53:21,512][52811] DAMAGECOUNT value on done: 56134.0 [2024-08-05 23:53:21,513][52811] Sum rewards: 54.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.698', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.086', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'weapon4': '0.504', 'weapon2': '0.544', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.624', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '46.000'} [2024-08-05 23:53:21,901][52794] DAMAGECOUNT value on done: 68105.0 [2024-08-05 23:53:21,904][52794] Sum rewards: 46.008, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.872', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.350', 'ARMOR': '0.486', 'weapon2': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '39.000'} [2024-08-05 23:53:22,439][52668] DAMAGECOUNT value on done: 63876.0 [2024-08-05 23:53:22,439][52668] Sum rewards: 44.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'AMMO3': '0.223', 'ARMOR': '0.458', 'weapon2': '0.736', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.086', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '39.000'} [2024-08-05 23:53:22,528][52649] DAMAGECOUNT value on done: 62542.0 [2024-08-05 23:53:22,528][52649] Sum rewards: 47.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.444', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.186', 'weapon5': '0.230', 'WEAPON4': '0.300', 'ARMOR': '0.426', 'weapon2': '0.524', 'weapon4': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.452', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '43.000'} [2024-08-05 23:53:22,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 150814720. Throughput: 0: 4390.4. Samples: 37705680. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-05 23:53:22,794][52567] Avg episode reward: [(0, '43.594')] [2024-08-05 23:53:23,010][52662] DAMAGECOUNT value on done: 72138.0 [2024-08-05 23:53:23,012][52662] Sum rewards: 43.161, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.486', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.064', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.860', 'ARMOR': '1.200', 'WEAPON3': '1.450', 'weapon3': '2.824', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:23,532][52650] Updated weights for policy 0, policy_version 18411 (0.0023) [2024-08-05 23:53:23,554][52664] DAMAGECOUNT value on done: 65976.0 [2024-08-05 23:53:23,555][52664] Sum rewards: 42.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.300', 'weapon4': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.522', 'ARMOR': '0.887', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.228', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:24,103][52795] DAMAGECOUNT value on done: 58607.0 [2024-08-05 23:53:24,103][52795] Sum rewards: 38.437, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.186', 'AMMO4': '0.221', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.374', 'WEAPON4': '0.450', 'weapon2': '0.562', 'ARMOR': '0.831', 'WEAPON3': '1.350', 'HITCOUNT': '2.260', 'weapon3': '2.550', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:24,181][52660] DAMAGECOUNT value on done: 58565.0 [2024-08-05 23:53:24,183][52660] Sum rewards: 40.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.465', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.238', 'weapon4': '0.260', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon2': '0.674', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '2.856', 'DAMAGECOUNT': '11.133', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:24,405][52811] DAMAGECOUNT value on done: 57565.0 [2024-08-05 23:53:24,406][52811] Sum rewards: 46.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.184', 'AMMO3': '0.218', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.378', 'ARMOR': '0.454', 'WEAPON4': '0.550', 'weapon2': '0.668', 'WEAPON3': '1.400', 'weapon3': '2.506', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '41.000'} [2024-08-05 23:53:24,990][52668] DAMAGECOUNT value on done: 61773.0 [2024-08-05 23:53:24,991][52668] Sum rewards: 36.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.857', 'ARMOR': '0.004', 'AMMO5': '0.011', 'weapon5': '0.032', 'AMMO2': '0.046', 'weapon4': '0.078', 'AMMO3': '0.187', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.796', 'WEAPON3': '1.250', 'HITCOUNT': '2.240', 'weapon3': '2.838', 'DAMAGECOUNT': '9.843', 'FRAGCOUNT': '33.000'} [2024-08-05 23:53:25,138][52794] DAMAGECOUNT value on done: 67911.0 [2024-08-05 23:53:25,139][52794] Sum rewards: 35.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.041', 'AMMO5': '0.017', 'ARMOR': '0.048', 'AMMO2': '0.060', 'weapon5': '0.140', 'AMMO3': '0.175', 'AMMO4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.482', 'weapon2': '0.720', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.332', 'HITCOUNT': '2.400', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:25,772][52649] DAMAGECOUNT value on done: 61764.0 [2024-08-05 23:53:25,773][52649] Sum rewards: 50.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.525', 'AMMO5': '0.003', 'AMMO2': '0.028', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.138', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.596', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '2.858', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '43.000'} [2024-08-05 23:53:25,858][52662] DAMAGECOUNT value on done: 63642.0 [2024-08-05 23:53:25,860][52662] Sum rewards: 51.373, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.094', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.245', 'weapon2': '0.606', 'ARMOR': '0.800', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.052', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '46.000'} [2024-08-05 23:53:26,093][52664] DAMAGECOUNT value on done: 61177.0 [2024-08-05 23:53:26,093][52664] Sum rewards: 43.113, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.206', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.147', 'weapon5': '0.222', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.516', 'WEAPON3': '0.950', 'weapon2': '1.016', 'HITCOUNT': '2.230', 'weapon3': '2.234', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:27,231][52795] DAMAGECOUNT value on done: 53688.0 [2024-08-05 23:53:27,233][52795] Sum rewards: 42.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.364', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.524', 'weapon2': '0.688', 'ARMOR': '0.858', 'WEAPON3': '0.950', 'weapon3': '2.370', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.656', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:27,396][52660] DAMAGECOUNT value on done: 62253.0 [2024-08-05 23:53:27,397][52660] Sum rewards: 40.645, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'weapon5': '0.040', 'WEAPON5': '0.050', 'ARMOR': '0.056', 'AMMO2': '0.060', 'AMMO3': '0.174', 'weapon4': '0.214', 'AMMO4': '0.301', 'WEAPON4': '0.650', 'weapon2': '0.768', 'WEAPON3': '1.000', 'HITCOUNT': '2.240', 'weapon3': '2.666', 'DAMAGECOUNT': '10.158', 'FRAGCOUNT': '34.000'} [2024-08-05 23:53:27,571][52794] DAMAGECOUNT value on done: 63379.0 [2024-08-05 23:53:27,573][52794] Sum rewards: 38.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.202', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.558', 'weapon2': '0.618', 'WEAPON3': '1.200', 'ARMOR': '1.222', 'HITCOUNT': '2.260', 'weapon3': '2.286', 'DAMAGECOUNT': '10.821', 'FRAGCOUNT': '34.500'} [2024-08-05 23:53:27,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 150896640. Throughput: 0: 4379.1. Samples: 37731940. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-05 23:53:27,795][52567] Avg episode reward: [(0, '43.455')] [2024-08-05 23:53:28,093][52650] Updated weights for policy 0, policy_version 18421 (0.0044) [2024-08-05 23:53:28,265][52668] DAMAGECOUNT value on done: 64404.0 [2024-08-05 23:53:28,265][52668] Sum rewards: 46.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.723', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.054', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'ARMOR': '0.858', 'weapon2': '0.960', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.730', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '39.000'} [2024-08-05 23:53:28,405][52662] DAMAGECOUNT value on done: 66579.0 [2024-08-05 23:53:28,408][52662] Sum rewards: 45.530, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.429', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.032', 'weapon5': '0.054', 'AMMO3': '0.121', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.084', 'weapon3': '2.174', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:28,810][52664] DAMAGECOUNT value on done: 64670.0 [2024-08-05 23:53:28,820][52664] Sum rewards: 44.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.167', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.170', 'WEAPON4': '0.500', 'weapon2': '0.566', 'weapon4': '0.688', 'ARMOR': '0.872', 'WEAPON3': '1.050', 'weapon3': '2.548', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '11.433', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:28,953][52649] DAMAGECOUNT value on done: 55805.0 [2024-08-05 23:53:28,954][52649] Sum rewards: 35.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.951', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon4': '0.378', 'WEAPON4': '0.400', 'ARMOR': '0.459', 'weapon2': '0.982', 'WEAPON3': '1.000', 'HITCOUNT': '2.360', 'weapon3': '2.414', 'DAMAGECOUNT': '9.480', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:30,430][52660] DAMAGECOUNT value on done: 62893.0 [2024-08-05 23:53:30,432][52660] Sum rewards: 40.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.095', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'ARMOR': '0.868', 'weapon2': '0.882', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '2.868', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:30,445][52795] DAMAGECOUNT value on done: 55710.0 [2024-08-05 23:53:30,445][52795] Sum rewards: 44.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.963', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.224', 'weapon2': '0.494', 'ARMOR': '0.922', 'WEAPON3': '1.450', 'HITCOUNT': '2.450', 'weapon3': '3.306', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '39.000'} [2024-08-05 23:53:30,561][52794] DAMAGECOUNT value on done: 66039.0 [2024-08-05 23:53:30,561][52794] Sum rewards: 42.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO4': '0.192', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.842', 'WEAPON3': '1.400', 'ARMOR': '1.673', 'weapon3': '2.686', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:31,027][52668] DAMAGECOUNT value on done: 60101.0 [2024-08-05 23:53:31,028][52668] Sum rewards: 47.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.001', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.213', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '2.926', 'DAMAGECOUNT': '11.763', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:31,368][52664] DAMAGECOUNT value on done: 63192.0 [2024-08-05 23:53:31,369][52664] Sum rewards: 57.246, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.048', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.590', 'ARMOR': '1.266', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '49.000'} [2024-08-05 23:53:31,520][52662] DAMAGECOUNT value on done: 65411.0 [2024-08-05 23:53:31,520][52662] Sum rewards: 49.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.446', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.052', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.036', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '45.000'} [2024-08-05 23:53:32,001][52649] DAMAGECOUNT value on done: 64312.0 [2024-08-05 23:53:32,002][52649] Sum rewards: 33.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon7': '0.078', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.286', 'weapon2': '0.422', 'weapon4': '0.532', 'WEAPON3': '0.900', 'HITCOUNT': '1.800', 'weapon3': '2.408', 'DAMAGECOUNT': '8.955', 'FRAGCOUNT': '29.000'} [2024-08-05 23:53:32,741][52650] Updated weights for policy 0, policy_version 18431 (0.0012) [2024-08-05 23:53:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 150986752. Throughput: 0: 4381.1. Samples: 37745240. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:53:32,794][52567] Avg episode reward: [(0, '43.964')] [2024-08-05 23:53:32,795][52614] Saving new best policy, reward=43.964! [2024-08-05 23:53:32,900][52660] DAMAGECOUNT value on done: 62011.0 [2024-08-05 23:53:32,901][52660] Sum rewards: 47.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.232', 'weapon4': '0.252', 'WEAPON4': '0.350', 'ARMOR': '0.432', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:33,458][52668] DAMAGECOUNT value on done: 62212.0 [2024-08-05 23:53:33,460][52668] Sum rewards: 56.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.040', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.176', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'ARMOR': '0.452', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '46.000'} [2024-08-05 23:53:33,653][52795] DAMAGECOUNT value on done: 58645.0 [2024-08-05 23:53:33,654][52795] Sum rewards: 47.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.024', 'ARMOR': '0.036', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '1.004', 'WEAPON3': '1.200', 'weapon3': '2.472', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '40.000'} [2024-08-05 23:53:33,658][52794] DAMAGECOUNT value on done: 67964.0 [2024-08-05 23:53:33,660][52794] Sum rewards: 59.175, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.183', 'ARMOR': '0.490', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '48.000'} [2024-08-05 23:53:33,681][52664] DAMAGECOUNT value on done: 64930.0 [2024-08-05 23:53:33,681][52664] Sum rewards: 43.341, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.852', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.170', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.512', 'ARMOR': '0.887', 'WEAPON3': '1.300', 'HITCOUNT': '2.350', 'weapon3': '3.022', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:34,327][52662] DAMAGECOUNT value on done: 67161.0 [2024-08-05 23:53:34,329][52662] Sum rewards: 43.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.166', 'AMMO3': '0.210', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.368', 'ARMOR': '0.485', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.142', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:34,728][52647] DAMAGECOUNT value on done: 64106.0 [2024-08-05 23:53:34,728][52647] Sum rewards: 30.226, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.216', 'AMMO5': '0.007', 'weapon5': '0.054', 'AMMO2': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.308', 'AMMO4': '0.368', 'weapon4': '0.474', 'weapon2': '0.684', 'WEAPON4': '0.750', 'ARMOR': '0.885', 'WEAPON3': '1.800', 'HITCOUNT': '2.360', 'weapon3': '2.454', 'DAMAGECOUNT': '10.074', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:35,066][52649] DAMAGECOUNT value on done: 58538.0 [2024-08-05 23:53:35,067][52649] Sum rewards: 51.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.058', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.240', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '44.000'} [2024-08-05 23:53:35,522][52660] DAMAGECOUNT value on done: 62741.0 [2024-08-05 23:53:35,523][52660] Sum rewards: 39.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.217', 'weapon5': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.364', 'WEAPON4': '0.450', 'weapon2': '0.722', 'ARMOR': '0.853', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.396', 'DAMAGECOUNT': '9.966', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:36,151][52664] DAMAGECOUNT value on done: 63640.0 [2024-08-05 23:53:36,152][52664] Sum rewards: 35.303, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.355', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'WEAPON4': '0.350', 'ARMOR': '0.474', 'weapon4': '0.536', 'weapon2': '0.740', 'WEAPON3': '1.000', 'HITCOUNT': '2.180', 'weapon3': '2.456', 'DAMAGECOUNT': '9.480', 'FRAGCOUNT': '28.000'} [2024-08-05 23:53:36,462][52668] DAMAGECOUNT value on done: 57994.0 [2024-08-05 23:53:36,464][52668] Sum rewards: 38.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'AMMO5': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.040', 'weapon5': '0.044', 'AMMO4': '0.120', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.730', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '2.764', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '33.000'} [2024-08-05 23:53:36,530][52794] DAMAGECOUNT value on done: 66823.0 [2024-08-05 23:53:36,532][52794] Sum rewards: 38.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.862', 'weapon7': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.077', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'ARMOR': '0.400', 'weapon4': '0.440', 'weapon2': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.744', 'DAMAGECOUNT': '10.983', 'FRAGCOUNT': '34.000'} [2024-08-05 23:53:36,617][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:53:36,769][52795] DAMAGECOUNT value on done: 60844.0 [2024-08-05 23:53:36,770][52795] Sum rewards: 40.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'weapon4': '0.474', 'weapon2': '0.690', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '2.604', 'DAMAGECOUNT': '11.211', 'FRAGCOUNT': '33.000'} [2024-08-05 23:53:37,183][52650] Updated weights for policy 0, policy_version 18441 (0.0053) [2024-08-05 23:53:37,356][52647] DAMAGECOUNT value on done: 64227.0 [2024-08-05 23:53:37,356][52647] Sum rewards: 37.815, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.402', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.744', 'WEAPON3': '0.850', 'HITCOUNT': '2.450', 'weapon3': '2.766', 'DAMAGECOUNT': '10.185', 'FRAGCOUNT': '31.000'} [2024-08-05 23:53:37,534][52662] DAMAGECOUNT value on done: 68827.0 [2024-08-05 23:53:37,535][52662] Sum rewards: 55.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.498', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO3': '0.226', 'ARMOR': '0.416', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '49.000'} [2024-08-05 23:53:37,733][52649] DAMAGECOUNT value on done: 62110.0 [2024-08-05 23:53:37,735][52649] Sum rewards: 40.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.320', 'AMMO5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon4': '0.312', 'ARMOR': '0.455', 'weapon2': '0.662', 'WEAPON3': '1.300', 'HITCOUNT': '2.600', 'weapon3': '2.704', 'DAMAGECOUNT': '10.956', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:37,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 151068672. Throughput: 0: 4374.4. Samples: 37771450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:53:37,795][52567] Avg episode reward: [(0, '43.878')] [2024-08-05 23:53:38,549][52660] DAMAGECOUNT value on done: 61638.0 [2024-08-05 23:53:38,551][52660] Sum rewards: 44.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.037', 'ARMOR': '0.040', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.656', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '39.000'} [2024-08-05 23:53:39,187][52666] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:53:39,644][52668] DAMAGECOUNT value on done: 62601.0 [2024-08-05 23:53:39,644][52668] Sum rewards: 46.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.171', 'AMMO5': '0.008', 'weapon5': '0.030', 'AMMO2': '0.036', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'WEAPON4': '0.500', 'weapon4': '0.570', 'weapon2': '0.678', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon3': '2.474', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.499', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:39,660][52794] DAMAGECOUNT value on done: 68439.0 [2024-08-05 23:53:39,663][52794] Sum rewards: 40.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.475', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.734', 'ARMOR': '0.906', 'WEAPON3': '1.650', 'weapon3': '2.842', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:39,830][52795] DAMAGECOUNT value on done: 58352.0 [2024-08-05 23:53:39,834][52795] Sum rewards: 43.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.666', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.436', 'WEAPON3': '1.050', 'ARMOR': '1.374', 'HITCOUNT': '2.430', 'weapon3': '3.242', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:40,168][52647] DAMAGECOUNT value on done: 68839.0 [2024-08-05 23:53:40,171][52647] Sum rewards: 36.925, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.020', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon5': '0.112', 'weapon4': '0.248', 'AMMO3': '0.272', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon2': '0.702', 'ARMOR': '0.853', 'WEAPON3': '1.700', 'HITCOUNT': '2.480', 'weapon3': '2.680', 'DAMAGECOUNT': '10.020', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:40,568][52649] DAMAGECOUNT value on done: 61699.0 [2024-08-05 23:53:40,569][52649] Sum rewards: 50.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.868', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.122', 'AMMO4': '0.169', 'weapon5': '0.182', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.638', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.794', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '45.000'} [2024-08-05 23:53:40,598][52662] DAMAGECOUNT value on done: 64300.0 [2024-08-05 23:53:40,602][52662] Sum rewards: 49.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.768', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon4': '0.484', 'weapon2': '0.594', 'WEAPON3': '0.950', 'HITCOUNT': '2.600', 'weapon3': '2.732', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:41,852][52660] DAMAGECOUNT value on done: 61387.0 [2024-08-05 23:53:41,854][52660] Sum rewards: 51.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.927', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.191', 'weapon4': '0.296', 'WEAPON4': '0.400', 'ARMOR': '0.440', 'weapon2': '0.822', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '44.000'} [2024-08-05 23:53:42,259][52650] Updated weights for policy 0, policy_version 18451 (0.0020) [2024-08-05 23:53:42,632][52794] DAMAGECOUNT value on done: 65608.0 [2024-08-05 23:53:42,636][52794] Sum rewards: 32.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.078', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.074', 'AMMO4': '0.155', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.400', 'weapon2': '0.798', 'ARMOR': '0.888', 'WEAPON3': '1.150', 'HITCOUNT': '2.060', 'weapon3': '2.638', 'DAMAGECOUNT': '10.026', 'FRAGCOUNT': '28.000'} [2024-08-05 23:53:42,705][52668] DAMAGECOUNT value on done: 62492.0 [2024-08-05 23:53:42,706][52668] Sum rewards: 48.158, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.515', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.119', 'AMMO3': '0.135', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.658', 'weapon4': '0.662', 'ARMOR': '0.854', 'WEAPON3': '1.000', 'weapon3': '2.428', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 151158784. Throughput: 0: 4382.9. Samples: 37798150. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-05 23:53:42,794][52567] Avg episode reward: [(0, '44.265')] [2024-08-05 23:53:42,795][52614] Saving new best policy, reward=44.265! [2024-08-05 23:53:42,976][52795] DAMAGECOUNT value on done: 61796.0 [2024-08-05 23:53:42,980][52795] Sum rewards: 53.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO2': '0.004', 'weapon4': '0.012', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'AMMO3': '0.196', 'weapon2': '0.342', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.452', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '47.000'} [2024-08-05 23:53:43,104][52647] DAMAGECOUNT value on done: 67710.0 [2024-08-05 23:53:43,106][52647] Sum rewards: 43.063, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.285', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.174', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'weapon4': '0.310', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.750', 'weapon3': '2.700', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '40.000'} [2024-08-05 23:53:43,361][52649] DAMAGECOUNT value on done: 65739.0 [2024-08-05 23:53:43,372][52649] Sum rewards: 51.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.081', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.254', 'ARMOR': '0.454', 'weapon2': '0.502', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '2.938', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:43,641][52662] DAMAGECOUNT value on done: 63517.0 [2024-08-05 23:53:43,641][52662] Sum rewards: 39.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.172', 'weapon4': '0.212', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '1.062', 'WEAPON3': '1.250', 'HITCOUNT': '2.240', 'weapon3': '2.338', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:44,687][52660] DAMAGECOUNT value on done: 61272.0 [2024-08-05 23:53:44,687][52660] Sum rewards: 42.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.054', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.096', 'AMMO3': '0.188', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.328', 'ARMOR': '0.408', 'WEAPON4': '0.450', 'weapon2': '0.766', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.578', 'DAMAGECOUNT': '10.704', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:45,426][52668] DAMAGECOUNT value on done: 62761.0 [2024-08-05 23:53:45,427][52668] Sum rewards: 56.794, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.034', 'ARMOR': '0.040', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.254', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '51.000'} [2024-08-05 23:53:45,843][52794] DAMAGECOUNT value on done: 72885.0 [2024-08-05 23:53:45,845][52794] Sum rewards: 40.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.070', 'AMMO3': '0.209', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.408', 'weapon4': '0.454', 'weapon2': '0.758', 'WEAPON3': '1.250', 'weapon3': '2.458', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:46,176][52795] DAMAGECOUNT value on done: 58067.0 [2024-08-05 23:53:46,178][52795] Sum rewards: 43.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.854', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'AMMO4': '0.225', 'WEAPON4': '0.500', 'weapon2': '0.674', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '2.752', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '41.000'} [2024-08-05 23:53:46,276][52647] DAMAGECOUNT value on done: 67604.0 [2024-08-05 23:53:46,278][52647] Sum rewards: 39.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.768', 'WEAPON3': '1.250', 'ARMOR': '1.305', 'HITCOUNT': '2.400', 'weapon3': '2.946', 'DAMAGECOUNT': '10.164', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:46,378][52650] Updated weights for policy 0, policy_version 18461 (0.0023) [2024-08-05 23:53:46,603][52662] DAMAGECOUNT value on done: 68136.0 [2024-08-05 23:53:46,605][52662] Sum rewards: 39.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.160', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'ARMOR': '0.451', 'weapon2': '0.482', 'weapon4': '0.542', 'WEAPON3': '1.300', 'HITCOUNT': '2.370', 'weapon3': '2.608', 'DAMAGECOUNT': '10.962', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:47,593][52660] DAMAGECOUNT value on done: 59579.0 [2024-08-05 23:53:47,593][52660] Sum rewards: 46.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.088', 'weapon5': '0.104', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon2': '0.748', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '2.876', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 151240704. Throughput: 0: 4379.8. Samples: 37811200. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-05 23:53:47,794][52567] Avg episode reward: [(0, '44.125')] [2024-08-05 23:53:48,312][52668] DAMAGECOUNT value on done: 60574.0 [2024-08-05 23:53:48,322][52668] Sum rewards: 38.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.726', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.114', 'AMMO3': '0.163', 'AMMO4': '0.183', 'weapon4': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.728', 'WEAPON3': '0.950', 'ARMOR': '1.409', 'HITCOUNT': '2.250', 'weapon3': '2.632', 'DAMAGECOUNT': '9.564', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:48,767][52794] DAMAGECOUNT value on done: 63444.0 [2024-08-05 23:53:48,768][52794] Sum rewards: 48.407, reward structure: {'DEATHCOUNT': '-8.250', 'weapon7': '0.004', 'AMMO5': '0.008', 'weapon5': '0.032', 'AMMO2': '0.040', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'HEALTH': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.470', 'weapon2': '0.660', 'WEAPON3': '0.750', 'weapon3': '2.576', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.730', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:49,262][52795] DAMAGECOUNT value on done: 53907.0 [2024-08-05 23:53:49,264][52795] Sum rewards: 38.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.884', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'WEAPON3': '1.050', 'weapon2': '1.088', 'ARMOR': '1.346', 'HITCOUNT': '2.510', 'weapon3': '2.646', 'DAMAGECOUNT': '10.776', 'FRAGCOUNT': '30.000'} [2024-08-05 23:53:49,351][52647] DAMAGECOUNT value on done: 67117.0 [2024-08-05 23:53:49,351][52647] Sum rewards: 45.676, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.775', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.252', 'ARMOR': '0.404', 'weapon2': '0.942', 'WEAPON3': '1.500', 'weapon3': '2.742', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '42.000'} [2024-08-05 23:53:49,367][52669] DAMAGECOUNT value on done: 63558.0 [2024-08-05 23:53:49,368][52669] Sum rewards: 36.496, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.678', 'AMMO5': '0.003', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO4': '0.208', 'AMMO3': '0.261', 'weapon4': '0.314', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'weapon2': '0.734', 'WEAPON3': '1.600', 'weapon3': '2.544', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '34.000'} [2024-08-05 23:53:49,445][52662] DAMAGECOUNT value on done: 62048.0 [2024-08-05 23:53:49,445][52662] Sum rewards: 40.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.147', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '2.240', 'weapon3': '2.976', 'DAMAGECOUNT': '10.008', 'FRAGCOUNT': '37.000'} [2024-08-05 23:53:50,642][52660] DAMAGECOUNT value on done: 62463.0 [2024-08-05 23:53:50,642][52660] Sum rewards: 42.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.845', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.030', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.139', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'ARMOR': '0.861', 'weapon2': '0.888', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.800', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:51,469][52650] Updated weights for policy 0, policy_version 18471 (0.0026) [2024-08-05 23:53:51,525][52668] DAMAGECOUNT value on done: 59880.0 [2024-08-05 23:53:51,526][52668] Sum rewards: 35.828, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.763', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.166', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.804', 'WEAPON3': '1.000', 'HITCOUNT': '2.070', 'weapon3': '2.804', 'DAMAGECOUNT': '9.144', 'FRAGCOUNT': '31.000'} [2024-08-05 23:53:51,603][52794] DAMAGECOUNT value on done: 69096.0 [2024-08-05 23:53:51,604][52794] Sum rewards: 49.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.512', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.204', 'AMMO3': '0.223', 'weapon4': '0.348', 'ARMOR': '0.451', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.534', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '46.000'} [2024-08-05 23:53:51,886][52647] DAMAGECOUNT value on done: 64702.0 [2024-08-05 23:53:51,887][52647] Sum rewards: 52.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.148', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.452', 'weapon2': '0.654', 'ARMOR': '0.813', 'WEAPON3': '1.000', 'weapon3': '2.498', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '44.000'} [2024-08-05 23:53:52,134][52669] DAMAGECOUNT value on done: 63255.0 [2024-08-05 23:53:52,135][52669] Sum rewards: 47.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.528', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.052', 'weapon4': '0.080', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon2': '0.676', 'ARMOR': '0.800', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.948', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '41.000'} [2024-08-05 23:53:52,364][52662] DAMAGECOUNT value on done: 67112.0 [2024-08-05 23:53:52,364][52662] Sum rewards: 36.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.898', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.160', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.378', 'weapon2': '0.880', 'WEAPON3': '1.050', 'ARMOR': '1.665', 'HITCOUNT': '2.290', 'weapon3': '2.352', 'DAMAGECOUNT': '9.603', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:52,420][52795] DAMAGECOUNT value on done: 58157.0 [2024-08-05 23:53:52,421][52795] Sum rewards: 36.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.697', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.156', 'AMMO3': '0.217', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON4': '0.500', 'ARMOR': '0.513', 'weapon2': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '2.538', 'DAMAGECOUNT': '11.454', 'FRAGCOUNT': '35.500'} [2024-08-05 23:53:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 151339008. Throughput: 0: 4383.1. Samples: 37837460. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-05 23:53:52,794][52567] Avg episode reward: [(0, '43.467')] [2024-08-05 23:53:52,844][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:53:53,222][52660] DAMAGECOUNT value on done: 67982.0 [2024-08-05 23:53:53,223][52660] Sum rewards: 51.457, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.846', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.118', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'weapon4': '0.530', 'weapon2': '0.704', 'WEAPON3': '0.800', 'ARMOR': '0.868', 'weapon3': '2.580', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '41.000'} [2024-08-05 23:53:54,027][52668] DAMAGECOUNT value on done: 65492.0 [2024-08-05 23:53:54,029][52668] Sum rewards: 62.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.698', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.042', 'AMMO4': '0.055', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'ARMOR': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.258', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '54.000'} [2024-08-05 23:53:54,394][52647] DAMAGECOUNT value on done: 66624.0 [2024-08-05 23:53:54,396][52647] Sum rewards: 42.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.456', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.116', 'AMMO4': '0.161', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON4': '0.450', 'ARMOR': '0.491', 'weapon2': '0.570', 'WEAPON3': '0.800', 'HITCOUNT': '2.320', 'weapon3': '2.552', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:54,868][52794] DAMAGECOUNT value on done: 69170.0 [2024-08-05 23:53:54,868][52794] Sum rewards: 49.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.016', 'weapon4': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO4': '0.021', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.910', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '41.000'} [2024-08-05 23:53:55,235][52671] Large shaping reward 3.231 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.18, 60.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:53:55,371][52669] DAMAGECOUNT value on done: 62670.0 [2024-08-05 23:53:55,372][52669] Sum rewards: 50.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.946', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.056', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.334', 'WEAPON4': '0.450', 'weapon2': '0.534', 'ARMOR': '0.951', 'WEAPON3': '1.350', 'weapon3': '2.802', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '43.000'} [2024-08-05 23:53:55,489][52795] DAMAGECOUNT value on done: 59365.0 [2024-08-05 23:53:55,490][52795] Sum rewards: 44.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.218', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.154', 'AMMO3': '0.201', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:55,509][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:53:55,659][52662] DAMAGECOUNT value on done: 67678.0 [2024-08-05 23:53:55,659][52662] Sum rewards: 34.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.791', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.468', 'WEAPON3': '1.500', 'HITCOUNT': '2.240', 'weapon3': '2.780', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '32.000'} [2024-08-05 23:53:56,285][52650] Updated weights for policy 0, policy_version 18481 (0.0026) [2024-08-05 23:53:56,361][52660] DAMAGECOUNT value on done: 61151.0 [2024-08-05 23:53:56,364][52660] Sum rewards: 43.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.092', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.362', 'weapon2': '0.542', 'ARMOR': '0.907', 'WEAPON3': '1.350', 'weapon3': '2.484', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '38.000'} [2024-08-05 23:53:56,930][52647] DAMAGECOUNT value on done: 68300.0 [2024-08-05 23:53:56,931][52647] Sum rewards: 40.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.993', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.191', 'ARMOR': '0.400', 'weapon2': '0.670', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '2.884', 'DAMAGECOUNT': '9.510', 'FRAGCOUNT': '36.000'} [2024-08-05 23:53:57,172][52668] DAMAGECOUNT value on done: 63676.0 [2024-08-05 23:53:57,172][52668] Sum rewards: 42.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.103', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.151', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.332', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '2.876', 'DAMAGECOUNT': '10.584', 'FRAGCOUNT': '35.500'} [2024-08-05 23:53:57,794][52567] Fps is (10 sec: 18841.1, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 151429120. Throughput: 0: 4378.7. Samples: 37863560. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-05 23:53:57,795][52567] Avg episode reward: [(0, '43.860')] [2024-08-05 23:53:58,014][52669] DAMAGECOUNT value on done: 61673.0 [2024-08-05 23:53:58,015][52669] Sum rewards: 27.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.325', 'AMMO5': '0.006', 'AMMO2': '0.057', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.283', 'weapon4': '0.510', 'ARMOR': '0.531', 'WEAPON4': '0.600', 'weapon2': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '1.830', 'weapon3': '2.546', 'DAMAGECOUNT': '8.643', 'FRAGCOUNT': '24.000'} [2024-08-05 23:53:58,088][52794] DAMAGECOUNT value on done: 67510.0 [2024-08-05 23:53:58,090][52794] Sum rewards: 35.829, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.079', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO2': '0.060', 'AMMO3': '0.197', 'AMMO4': '0.300', 'weapon4': '0.304', 'WEAPON4': '0.450', 'ARMOR': '0.469', 'weapon2': '0.604', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '2.852', 'DAMAGECOUNT': '10.311', 'FRAGCOUNT': '35.000'} [2024-08-05 23:53:58,682][52795] DAMAGECOUNT value on done: 56634.0 [2024-08-05 23:53:58,683][52795] Sum rewards: 53.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'ARMOR': '0.036', 'AMMO2': '0.036', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'AMMO4': '0.181', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.820', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '44.000'} [2024-08-05 23:53:58,745][52662] DAMAGECOUNT value on done: 66488.0 [2024-08-05 23:53:58,746][52662] Sum rewards: 46.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.359', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.082', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'ARMOR': '0.456', 'weapon2': '0.660', 'WEAPON3': '1.250', 'HITCOUNT': '2.470', 'weapon3': '2.980', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '41.000'} [2024-08-05 23:53:59,367][52660] DAMAGECOUNT value on done: 63155.0 [2024-08-05 23:53:59,368][52660] Sum rewards: 52.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'AMMO5': '0.008', 'ARMOR': '0.031', 'AMMO2': '0.038', 'weapon4': '0.124', 'weapon5': '0.126', 'AMMO4': '0.191', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.830', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '46.000'} [2024-08-05 23:54:00,286][52647] DAMAGECOUNT value on done: 63921.0 [2024-08-05 23:54:00,286][52647] Sum rewards: 44.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.777', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON4': '0.350', 'ARMOR': '0.451', 'weapon2': '0.588', 'weapon4': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.516', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.839', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:00,651][52650] Updated weights for policy 0, policy_version 18491 (0.0015) [2024-08-05 23:54:01,089][52669] DAMAGECOUNT value on done: 64069.0 [2024-08-05 23:54:01,092][52669] Sum rewards: 48.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.762', 'AMMO5': '0.022', 'AMMO2': '0.037', 'weapon5': '0.076', 'weapon4': '0.100', 'AMMO4': '0.185', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'WEAPON5': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '2.968', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '43.000'} [2024-08-05 23:54:01,127][52794] DAMAGECOUNT value on done: 70080.0 [2024-08-05 23:54:01,127][52794] Sum rewards: 45.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.711', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.062', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.187', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.678', 'ARMOR': '0.832', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.930', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '40.500'} [2024-08-05 23:54:01,368][52667] DAMAGECOUNT value on done: 61416.0 [2024-08-05 23:54:01,369][52667] Sum rewards: 44.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.130', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon4': '0.296', 'ARMOR': '0.454', 'weapon2': '0.652', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '2.856', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:01,747][52795] DAMAGECOUNT value on done: 58608.0 [2024-08-05 23:54:01,747][52795] Sum rewards: 35.289, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.899', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.168', 'AMMO3': '0.196', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON4': '0.450', 'weapon2': '0.658', 'WEAPON3': '1.300', 'HITCOUNT': '2.250', 'weapon3': '2.628', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '34.000'} [2024-08-05 23:54:02,176][52614] Signal inference workers to stop experience collection... (3450 times) [2024-08-05 23:54:02,177][52614] Signal inference workers to resume experience collection... (3450 times) [2024-08-05 23:54:02,236][52650] InferenceWorker_p0-w0: stopping experience collection (3450 times) [2024-08-05 23:54:02,244][52650] InferenceWorker_p0-w0: resuming experience collection (3450 times) [2024-08-05 23:54:02,503][52660] DAMAGECOUNT value on done: 61597.0 [2024-08-05 23:54:02,503][52660] Sum rewards: 37.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.573', 'AMMO5': '0.003', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.178', 'AMMO3': '0.234', 'weapon4': '0.254', 'WEAPON4': '0.400', 'weapon2': '0.996', 'ARMOR': '1.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.320', 'weapon3': '2.520', 'DAMAGECOUNT': '10.926', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 151502848. Throughput: 0: 4378.7. Samples: 37876530. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-05 23:54:02,794][52567] Avg episode reward: [(0, '43.852')] [2024-08-05 23:54:02,870][52647] DAMAGECOUNT value on done: 64233.0 [2024-08-05 23:54:02,871][52647] Sum rewards: 30.278, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.070', 'AMMO5': '0.018', 'AMMO2': '0.074', 'weapon5': '0.196', 'AMMO3': '0.230', 'AMMO4': '0.372', 'ARMOR': '0.464', 'weapon4': '0.492', 'WEAPON5': '0.500', 'weapon2': '0.660', 'WEAPON4': '0.850', 'WEAPON3': '1.400', 'weapon3': '2.284', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.747', 'FRAGCOUNT': '32.000'} [2024-08-05 23:54:03,698][52794] DAMAGECOUNT value on done: 66401.0 [2024-08-05 23:54:03,700][52794] Sum rewards: 49.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.662', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.382', 'ARMOR': '0.458', 'weapon2': '0.874', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '42.000'} [2024-08-05 23:54:04,124][52669] DAMAGECOUNT value on done: 63945.0 [2024-08-05 23:54:04,130][52667] DAMAGECOUNT value on done: 64508.0 [2024-08-05 23:54:04,132][52669] Sum rewards: 44.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.345', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.049', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon2': '0.822', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.980', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:04,132][52667] Sum rewards: 50.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.202', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.618', 'ARMOR': '0.919', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '44.000'} [2024-08-05 23:54:04,940][52795] DAMAGECOUNT value on done: 59698.0 [2024-08-05 23:54:04,942][52795] Sum rewards: 42.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.799', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.211', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.490', 'ARMOR': '0.914', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '3.108', 'DAMAGECOUNT': '10.512', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:05,236][52660] DAMAGECOUNT value on done: 64941.0 [2024-08-05 23:54:05,238][52660] Sum rewards: 55.057, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.087', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.124', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.406', 'ARMOR': '0.485', 'weapon2': '0.588', 'WEAPON3': '0.850', 'weapon3': '2.560', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '44.000'} [2024-08-05 23:54:05,734][52647] DAMAGECOUNT value on done: 63776.0 [2024-08-05 23:54:05,735][52647] Sum rewards: 38.986, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.742', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.275', 'weapon4': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.574', 'ARMOR': '0.944', 'WEAPON3': '1.650', 'HITCOUNT': '2.700', 'weapon3': '2.804', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:05,755][52650] Updated weights for policy 0, policy_version 18501 (0.0028) [2024-08-05 23:54:06,890][52667] DAMAGECOUNT value on done: 62720.0 [2024-08-05 23:54:06,892][52667] Sum rewards: 36.305, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.445', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.036', 'ARMOR': '0.040', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON3': '0.850', 'weapon2': '0.992', 'HITCOUNT': '2.290', 'weapon3': '2.830', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '28.000'} [2024-08-05 23:54:07,357][52669] DAMAGECOUNT value on done: 62874.0 [2024-08-05 23:54:07,357][52669] Sum rewards: 44.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.128', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.155', 'weapon5': '0.204', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON4': '0.700', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.262', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.626', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 151601152. Throughput: 0: 4385.3. Samples: 37903020. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 23:54:07,794][52567] Avg episode reward: [(0, '43.924')] [2024-08-05 23:54:07,935][52660] DAMAGECOUNT value on done: 61686.0 [2024-08-05 23:54:07,936][52660] Sum rewards: 38.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.740', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.164', 'AMMO4': '0.201', 'AMMO3': '0.227', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.732', 'ARMOR': '0.867', 'WEAPON3': '1.450', 'HITCOUNT': '2.190', 'weapon3': '2.414', 'DAMAGECOUNT': '10.797', 'FRAGCOUNT': '36.500'} [2024-08-05 23:54:07,960][52795] DAMAGECOUNT value on done: 56596.0 [2024-08-05 23:54:07,963][52795] Sum rewards: 42.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.275', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.271', 'ARMOR': '0.430', 'weapon2': '0.488', 'WEAPON3': '1.600', 'HITCOUNT': '2.620', 'weapon3': '3.142', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:08,299][52647] DAMAGECOUNT value on done: 64182.0 [2024-08-05 23:54:08,299][52647] Sum rewards: 46.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.813', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.072', 'AMMO4': '0.132', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.466', 'ARMOR': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.954', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:09,320][52667] DAMAGECOUNT value on done: 62949.0 [2024-08-05 23:54:09,329][52667] Sum rewards: 42.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.204', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.199', 'weapon4': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.708', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'HITCOUNT': '2.420', 'weapon3': '2.736', 'DAMAGECOUNT': '10.422', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:10,066][52650] Updated weights for policy 0, policy_version 18511 (0.0013) [2024-08-05 23:54:10,440][52669] DAMAGECOUNT value on done: 62122.0 [2024-08-05 23:54:10,440][52669] Sum rewards: 49.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.083', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.166', 'ARMOR': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.464', 'weapon2': '0.774', 'WEAPON3': '1.000', 'weapon3': '2.472', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:10,763][52647] DAMAGECOUNT value on done: 64256.0 [2024-08-05 23:54:10,764][52647] Sum rewards: 49.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.861', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'weapon4': '0.630', 'weapon2': '0.724', 'WEAPON3': '1.100', 'weapon3': '2.458', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:11,248][52795] DAMAGECOUNT value on done: 59807.0 [2024-08-05 23:54:11,250][52795] Sum rewards: 39.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.959', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'ARMOR': '0.857', 'weapon2': '0.898', 'WEAPON3': '1.300', 'HITCOUNT': '2.330', 'weapon3': '2.732', 'DAMAGECOUNT': '10.275', 'FRAGCOUNT': '34.000'} [2024-08-05 23:54:11,809][52667] DAMAGECOUNT value on done: 65608.0 [2024-08-05 23:54:11,809][52667] Sum rewards: 41.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.147', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.390', 'ARMOR': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '2.658', 'DAMAGECOUNT': '11.265', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 151683072. Throughput: 0: 4391.8. Samples: 37929570. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 23:54:12,794][52567] Avg episode reward: [(0, '43.967')] [2024-08-05 23:54:13,193][52647] DAMAGECOUNT value on done: 66346.0 [2024-08-05 23:54:13,195][52647] Sum rewards: 49.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.172', 'weapon4': '0.288', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '2.990', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '42.000'} [2024-08-05 23:54:13,408][52669] DAMAGECOUNT value on done: 62683.0 [2024-08-05 23:54:13,408][52669] Sum rewards: 35.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.494', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.046', 'weapon4': '0.130', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'ARMOR': '0.828', 'weapon2': '0.942', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.592', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '31.000'} [2024-08-05 23:54:14,213][52667] DAMAGECOUNT value on done: 64486.0 [2024-08-05 23:54:14,214][52667] Sum rewards: 36.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.378', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'AMMO3': '0.217', 'weapon4': '0.250', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'weapon2': '0.748', 'WEAPON3': '1.350', 'HITCOUNT': '2.300', 'weapon3': '2.690', 'DAMAGECOUNT': '10.002', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:14,319][52795] DAMAGECOUNT value on done: 62478.0 [2024-08-05 23:54:14,329][52795] Sum rewards: 35.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.240', 'WEAPON4': '0.250', 'ARMOR': '0.464', 'weapon2': '0.670', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.760', 'DAMAGECOUNT': '9.783', 'FRAGCOUNT': '33.000'} [2024-08-05 23:54:15,027][52650] Updated weights for policy 0, policy_version 18521 (0.0015) [2024-08-05 23:54:15,668][52647] DAMAGECOUNT value on done: 64743.0 [2024-08-05 23:54:15,670][52647] Sum rewards: 48.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.199', 'weapon4': '0.238', 'weapon2': '0.688', 'ARMOR': '0.881', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.824', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:16,073][52669] DAMAGECOUNT value on done: 60787.0 [2024-08-05 23:54:16,073][52669] Sum rewards: 34.659, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.048', 'weapon4': '0.086', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.684', 'HEALTH': '0.952', 'WEAPON3': '1.000', 'ARMOR': '1.300', 'HITCOUNT': '2.190', 'weapon3': '2.958', 'DAMAGECOUNT': '9.765', 'FRAGCOUNT': '30.000'} [2024-08-05 23:54:16,921][52667] DAMAGECOUNT value on done: 64217.0 [2024-08-05 23:54:16,922][52667] Sum rewards: 44.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.203', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.216', 'ARMOR': '0.400', 'weapon2': '0.720', 'WEAPON3': '1.400', 'weapon3': '2.802', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:17,394][52795] DAMAGECOUNT value on done: 56302.0 [2024-08-05 23:54:17,395][52795] Sum rewards: 42.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.165', 'AMMO3': '0.237', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.432', 'ARMOR': '0.485', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '2.986', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 151773184. Throughput: 0: 4389.3. Samples: 37942760. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-05 23:54:17,794][52567] Avg episode reward: [(0, '43.856')] [2024-08-05 23:54:17,835][52647] DAMAGECOUNT value on done: 63468.0 [2024-08-05 23:54:17,835][52647] Sum rewards: 33.136, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.704', 'weapon7': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.111', 'WEAPON4': '0.200', 'weapon4': '0.372', 'ARMOR': '0.452', 'WEAPON3': '0.600', 'weapon2': '1.120', 'HITCOUNT': '1.900', 'weapon3': '2.116', 'DAMAGECOUNT': '8.310', 'FRAGCOUNT': '25.000'} [2024-08-05 23:54:19,014][52669] DAMAGECOUNT value on done: 65891.0 [2024-08-05 23:54:19,017][52669] Sum rewards: 43.508, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.679', 'AMMO5': '0.008', 'weapon5': '0.036', 'AMMO2': '0.063', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'AMMO4': '0.317', 'weapon4': '0.480', 'WEAPON4': '0.650', 'weapon2': '0.774', 'ARMOR': '0.832', 'WEAPON3': '1.550', 'weapon3': '2.388', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.117', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:19,356][52667] DAMAGECOUNT value on done: 64055.0 [2024-08-05 23:54:19,365][52667] Sum rewards: 47.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.240', 'ARMOR': '0.428', 'weapon2': '0.890', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.854', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '42.000'} [2024-08-05 23:54:19,576][52650] Updated weights for policy 0, policy_version 18531 (0.0035) [2024-08-05 23:54:20,118][52647] DAMAGECOUNT value on done: 66028.0 [2024-08-05 23:54:20,118][52647] Sum rewards: 40.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.954', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.107', 'weapon4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'ARMOR': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.700', 'HITCOUNT': '2.460', 'weapon3': '3.070', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:20,383][52665] DAMAGECOUNT value on done: 60375.0 [2024-08-05 23:54:20,386][52665] Sum rewards: 39.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.933', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.118', 'weapon4': '0.156', 'AMMO3': '0.191', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'ARMOR': '0.480', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.990', 'DAMAGECOUNT': '11.070', 'FRAGCOUNT': '34.000'} [2024-08-05 23:54:20,453][52795] DAMAGECOUNT value on done: 58991.0 [2024-08-05 23:54:20,453][52795] Sum rewards: 47.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO4': '0.172', 'AMMO3': '0.184', 'WEAPON4': '0.400', 'ARMOR': '0.485', 'weapon2': '0.766', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.746', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:21,922][52669] DAMAGECOUNT value on done: 64210.0 [2024-08-05 23:54:21,922][52669] Sum rewards: 55.553, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.166', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.392', 'ARMOR': '0.420', 'HEALTH': '0.810', 'WEAPON3': '0.900', 'weapon2': '0.960', 'weapon3': '2.350', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '45.000'} [2024-08-05 23:54:22,776][52667] DAMAGECOUNT value on done: 62856.0 [2024-08-05 23:54:22,776][52667] Sum rewards: 33.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.167', 'weapon4': '0.194', 'WEAPON4': '0.400', 'ARMOR': '0.483', 'weapon2': '0.590', 'WEAPON3': '0.900', 'HITCOUNT': '2.180', 'weapon3': '2.862', 'DAMAGECOUNT': '9.783', 'FRAGCOUNT': '28.000'} [2024-08-05 23:54:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 151863296. Throughput: 0: 4391.3. Samples: 37969060. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 23:54:22,795][52567] Avg episode reward: [(0, '43.528')] [2024-08-05 23:54:22,955][52647] DAMAGECOUNT value on done: 64015.0 [2024-08-05 23:54:22,957][52647] Sum rewards: 43.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'AMMO3': '0.168', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.465', 'weapon2': '0.536', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.836', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:23,205][52665] DAMAGECOUNT value on done: 66849.0 [2024-08-05 23:54:23,207][52665] Sum rewards: 41.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.130', 'weapon4': '0.148', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.750', 'WEAPON3': '1.550', 'HITCOUNT': '2.610', 'weapon3': '2.696', 'DAMAGECOUNT': '11.583', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:23,587][52795] DAMAGECOUNT value on done: 61145.0 [2024-08-05 23:54:23,588][52795] Sum rewards: 44.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.086', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.125', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'ARMOR': '0.478', 'weapon2': '0.656', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '3.084', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:24,084][52650] Updated weights for policy 0, policy_version 18541 (0.0031) [2024-08-05 23:54:24,791][52669] DAMAGECOUNT value on done: 60937.0 [2024-08-05 23:54:24,792][52669] Sum rewards: 47.520, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.456', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.184', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'ARMOR': '0.471', 'weapon2': '0.594', 'WEAPON3': '1.650', 'weapon3': '2.946', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '43.000'} [2024-08-05 23:54:25,463][52667] DAMAGECOUNT value on done: 64014.0 [2024-08-05 23:54:25,463][52667] Sum rewards: 49.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.277', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.530', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.038', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '42.000'} [2024-08-05 23:54:25,512][52647] DAMAGECOUNT value on done: 64092.0 [2024-08-05 23:54:25,514][52647] Sum rewards: 29.125, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.216', 'AMMO5': '0.005', 'AMMO2': '0.057', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.287', 'weapon4': '0.318', 'AMMO3': '0.354', 'ARMOR': '0.477', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '2.150', 'HITCOUNT': '2.440', 'weapon3': '2.730', 'DAMAGECOUNT': '10.788', 'FRAGCOUNT': '32.000'} [2024-08-05 23:54:25,916][52665] DAMAGECOUNT value on done: 63533.0 [2024-08-05 23:54:25,916][52665] Sum rewards: 37.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.504', 'AMMO2': '0.029', 'weapon4': '0.098', 'AMMO4': '0.145', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'ARMOR': '0.517', 'weapon2': '0.768', 'WEAPON3': '1.400', 'HITCOUNT': '2.230', 'weapon3': '2.912', 'DAMAGECOUNT': '10.011', 'FRAGCOUNT': '33.000'} [2024-08-05 23:54:26,834][52666] DAMAGECOUNT value on done: 62737.0 [2024-08-05 23:54:26,835][52666] Sum rewards: 42.173, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.822', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.243', 'ARMOR': '0.451', 'weapon4': '0.504', 'WEAPON4': '0.550', 'weapon2': '0.576', 'WEAPON3': '1.550', 'weapon3': '2.618', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:27,459][52669] DAMAGECOUNT value on done: 64401.0 [2024-08-05 23:54:27,460][52669] Sum rewards: 38.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.205', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'weapon2': '0.710', 'WEAPON3': '1.250', 'HITCOUNT': '2.370', 'weapon3': '2.878', 'DAMAGECOUNT': '10.935', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 151945216. Throughput: 0: 4387.6. Samples: 37995590. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 23:54:27,794][52567] Avg episode reward: [(0, '43.395')] [2024-08-05 23:54:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018548_151945216.pth... [2024-08-05 23:54:28,012][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018034_147734528.pth [2024-08-05 23:54:28,397][52667] DAMAGECOUNT value on done: 63444.0 [2024-08-05 23:54:28,397][52667] Sum rewards: 53.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.446', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'weapon4': '0.162', 'AMMO3': '0.189', 'weapon2': '0.344', 'ARMOR': '0.492', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.300', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '46.000'} [2024-08-05 23:54:28,678][52650] Updated weights for policy 0, policy_version 18551 (0.0025) [2024-08-05 23:54:28,797][52665] DAMAGECOUNT value on done: 61342.0 [2024-08-05 23:54:28,798][52665] Sum rewards: 40.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.272', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.222', 'AMMO3': '0.225', 'weapon2': '0.424', 'ARMOR': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.534', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.706', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:29,058][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:54:29,820][52666] DAMAGECOUNT value on done: 64631.0 [2024-08-05 23:54:29,820][52666] Sum rewards: 48.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.907', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.134', 'weapon4': '0.170', 'AMMO3': '0.201', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.200', 'ARMOR': '1.212', 'HITCOUNT': '2.670', 'weapon3': '2.830', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '40.500'} [2024-08-05 23:54:30,419][52669] DAMAGECOUNT value on done: 66586.0 [2024-08-05 23:54:30,419][52669] Sum rewards: 57.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.746', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.147', 'weapon4': '0.202', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.944', 'weapon3': '2.682', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '46.000'} [2024-08-05 23:54:30,617][52658] DAMAGECOUNT value on done: 65239.0 [2024-08-05 23:54:30,618][52658] Sum rewards: 49.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.098', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.814', 'ARMOR': '0.849', 'WEAPON3': '1.350', 'weapon3': '2.612', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '43.000'} [2024-08-05 23:54:30,958][52667] DAMAGECOUNT value on done: 62577.0 [2024-08-05 23:54:30,958][52667] Sum rewards: 40.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.096', 'AMMO3': '0.141', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'ARMOR': '0.444', 'WEAPON4': '0.650', 'weapon2': '0.712', 'weapon4': '0.878', 'WEAPON3': '0.900', 'weapon3': '2.066', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:31,595][52665] DAMAGECOUNT value on done: 61019.0 [2024-08-05 23:54:31,595][52665] Sum rewards: 56.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'AMMO4': '0.220', 'weapon4': '0.456', 'ARMOR': '0.465', 'WEAPON4': '0.500', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '49.000'} [2024-08-05 23:54:32,446][52666] DAMAGECOUNT value on done: 63440.0 [2024-08-05 23:54:32,447][52666] Sum rewards: 51.273, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.395', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.568', 'ARMOR': '0.909', 'WEAPON3': '1.800', 'HITCOUNT': '3.070', 'weapon3': '3.180', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '47.000'} [2024-08-05 23:54:32,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17550.3). Total num frames: 152035328. Throughput: 0: 4386.2. Samples: 38008580. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-05 23:54:32,796][52567] Avg episode reward: [(0, '43.916')] [2024-08-05 23:54:33,312][52669] DAMAGECOUNT value on done: 68224.0 [2024-08-05 23:54:33,313][52669] Sum rewards: 45.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.290', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.112', 'weapon5': '0.168', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'weapon2': '0.638', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '2.786', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:33,700][52650] Updated weights for policy 0, policy_version 18561 (0.0014) [2024-08-05 23:54:33,721][52658] DAMAGECOUNT value on done: 63215.0 [2024-08-05 23:54:33,721][52658] Sum rewards: 36.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.404', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon5': '0.156', 'AMMO3': '0.195', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.734', 'DAMAGECOUNT': '10.596', 'FRAGCOUNT': '32.000'} [2024-08-05 23:54:33,877][52670] DAMAGECOUNT value on done: 61023.0 [2024-08-05 23:54:33,881][52670] Sum rewards: 44.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.780', 'WEAPON3': '1.150', 'HITCOUNT': '2.320', 'weapon3': '2.790', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:33,950][52667] DAMAGECOUNT value on done: 63729.0 [2024-08-05 23:54:33,951][52667] Sum rewards: 35.161, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.958', 'AMMO5': '0.003', 'AMMO2': '0.051', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon4': '0.910', 'weapon2': '0.952', 'weapon3': '1.894', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '8.082', 'FRAGCOUNT': '28.000'} [2024-08-05 23:54:34,932][52665] DAMAGECOUNT value on done: 62718.0 [2024-08-05 23:54:34,934][52665] Sum rewards: 48.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.758', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'ARMOR': '0.524', 'weapon2': '0.542', 'WEAPON3': '1.000', 'HITCOUNT': '2.510', 'weapon3': '3.054', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:35,053][52666] DAMAGECOUNT value on done: 58672.0 [2024-08-05 23:54:35,055][52666] Sum rewards: 22.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.229', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon7': '0.082', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.480', 'weapon2': '0.702', 'weapon4': '0.960', 'WEAPON3': '1.200', 'HITCOUNT': '1.700', 'weapon3': '1.806', 'DAMAGECOUNT': '7.125', 'FRAGCOUNT': '23.000'} [2024-08-05 23:54:36,241][52669] DAMAGECOUNT value on done: 64540.0 [2024-08-05 23:54:36,242][52669] Sum rewards: 40.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.096', 'AMMO4': '0.205', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.584', 'weapon2': '0.642', 'WEAPON3': '1.350', 'weapon3': '2.420', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.376', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:36,539][52670] DAMAGECOUNT value on done: 63918.0 [2024-08-05 23:54:36,539][52670] Sum rewards: 52.078, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon4': '0.118', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'ARMOR': '0.424', 'weapon2': '0.566', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '3.104', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '43.000'} [2024-08-05 23:54:36,663][52658] DAMAGECOUNT value on done: 63450.0 [2024-08-05 23:54:36,664][52658] Sum rewards: 57.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.439', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.156', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.512', 'weapon2': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.430', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '47.000'} [2024-08-05 23:54:36,995][52667] DAMAGECOUNT value on done: 62681.0 [2024-08-05 23:54:36,997][52667] Sum rewards: 46.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '3.238', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 152125440. Throughput: 0: 4390.5. Samples: 38035030. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:54:37,794][52567] Avg episode reward: [(0, '43.601')] [2024-08-05 23:54:37,999][52665] DAMAGECOUNT value on done: 63923.0 [2024-08-05 23:54:37,999][52665] Sum rewards: 40.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.257', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'weapon5': '0.064', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'ARMOR': '0.453', 'weapon2': '1.064', 'WEAPON3': '1.300', 'HITCOUNT': '2.290', 'weapon3': '2.628', 'DAMAGECOUNT': '10.068', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:38,091][52666] DAMAGECOUNT value on done: 61016.0 [2024-08-05 23:54:38,092][52666] Sum rewards: 38.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.035', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.176', 'AMMO3': '0.193', 'weapon4': '0.488', 'weapon2': '0.492', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.250', 'weapon3': '2.676', 'DAMAGECOUNT': '9.789', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:38,384][52650] Updated weights for policy 0, policy_version 18571 (0.0026) [2024-08-05 23:54:39,104][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:54:39,182][52669] DAMAGECOUNT value on done: 64168.0 [2024-08-05 23:54:39,183][52669] Sum rewards: 44.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'AMMO5': '0.012', 'weapon5': '0.026', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.194', 'weapon4': '0.252', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '3.054', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:39,786][52670] DAMAGECOUNT value on done: 63046.0 [2024-08-05 23:54:39,787][52670] Sum rewards: 43.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.058', 'AMMO5': '0.005', 'weapon5': '0.014', 'ARMOR': '0.028', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'AMMO4': '0.235', 'weapon4': '0.470', 'weapon2': '0.534', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.754', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:39,900][52658] DAMAGECOUNT value on done: 63321.0 [2024-08-05 23:54:39,901][52663] DAMAGECOUNT value on done: 65454.0 [2024-08-05 23:54:39,903][52663] Sum rewards: 47.554, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.744', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.146', 'weapon5': '0.202', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.460', 'WEAPON3': '0.900', 'weapon2': '0.912', 'weapon3': '2.352', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:39,902][52658] Sum rewards: 52.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'weapon2': '0.520', 'weapon4': '0.582', 'WEAPON3': '0.900', 'weapon3': '2.700', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '43.000'} [2024-08-05 23:54:40,155][52667] DAMAGECOUNT value on done: 64163.0 [2024-08-05 23:54:40,156][52667] Sum rewards: 39.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.168', 'ARMOR': '0.453', 'weapon2': '0.870', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.824', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '33.000'} [2024-08-05 23:54:40,755][52665] DAMAGECOUNT value on done: 63891.0 [2024-08-05 23:54:40,755][52665] Sum rewards: 48.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'ARMOR': '0.509', 'weapon2': '0.746', 'WEAPON3': '1.050', 'HITCOUNT': '2.620', 'weapon3': '3.038', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:41,275][52666] DAMAGECOUNT value on done: 59989.0 [2024-08-05 23:54:41,283][52666] Sum rewards: 28.666, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.312', 'AMMO5': '0.015', 'weapon5': '0.056', 'AMMO2': '0.057', 'AMMO3': '0.231', 'weapon4': '0.258', 'AMMO4': '0.283', 'WEAPON5': '0.300', 'ARMOR': '0.502', 'WEAPON4': '0.650', 'weapon2': '0.666', 'WEAPON3': '1.350', 'HITCOUNT': '1.980', 'weapon3': '2.672', 'DAMAGECOUNT': '7.959', 'FRAGCOUNT': '32.000'} [2024-08-05 23:54:41,336][52669] DAMAGECOUNT value on done: 63390.0 [2024-08-05 23:54:41,337][52669] Sum rewards: 46.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.124', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.326', 'weapon2': '0.576', 'ARMOR': '0.885', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:42,302][52663] DAMAGECOUNT value on done: 63289.0 [2024-08-05 23:54:42,302][52663] Sum rewards: 36.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.896', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.074', 'AMMO4': '0.133', 'weapon4': '0.184', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.790', 'ARMOR': '0.858', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.710', 'DAMAGECOUNT': '11.175', 'FRAGCOUNT': '32.000'} [2024-08-05 23:54:42,539][52650] Updated weights for policy 0, policy_version 18581 (0.0012) [2024-08-05 23:54:42,772][52658] DAMAGECOUNT value on done: 65564.0 [2024-08-05 23:54:42,772][52658] Sum rewards: 33.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.686', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.136', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.916', 'WEAPON3': '1.250', 'HITCOUNT': '2.430', 'weapon3': '2.614', 'DAMAGECOUNT': '9.930', 'FRAGCOUNT': '32.000'} [2024-08-05 23:54:42,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 152215552. Throughput: 0: 4398.2. Samples: 38061480. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-05 23:54:42,794][52567] Avg episode reward: [(0, '43.539')] [2024-08-05 23:54:42,876][52670] DAMAGECOUNT value on done: 61865.0 [2024-08-05 23:54:42,876][52670] Sum rewards: 51.246, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.146', 'AMMO2': '0.022', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.287', 'weapon2': '0.574', 'ARMOR': '1.284', 'WEAPON3': '1.800', 'weapon3': '3.124', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '48.000'} [2024-08-05 23:54:43,084][52667] DAMAGECOUNT value on done: 69086.0 [2024-08-05 23:54:43,084][52667] Sum rewards: 40.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.536', 'AMMO2': '0.026', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.239', 'weapon2': '0.744', 'ARMOR': '0.853', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '2.964', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:43,455][52665] DAMAGECOUNT value on done: 65939.0 [2024-08-05 23:54:43,456][52665] Sum rewards: 44.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.377', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.207', 'weapon4': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.465', 'weapon2': '0.816', 'WEAPON3': '1.050', 'weapon3': '2.450', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.982', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:44,108][52669] DAMAGECOUNT value on done: 65420.0 [2024-08-05 23:54:44,108][52669] Sum rewards: 39.312, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.672', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.058', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'AMMO4': '0.291', 'weapon4': '0.342', 'ARMOR': '0.420', 'WEAPON4': '0.500', 'weapon2': '0.930', 'WEAPON3': '1.250', 'weapon3': '2.352', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:44,444][52666] DAMAGECOUNT value on done: 60074.0 [2024-08-05 23:54:44,444][52666] Sum rewards: 43.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.942', 'AMMO5': '0.015', 'weapon5': '0.026', 'AMMO2': '0.045', 'AMMO3': '0.199', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'ARMOR': '0.416', 'weapon4': '0.438', 'WEAPON4': '0.550', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:45,162][52663] DAMAGECOUNT value on done: 64367.0 [2024-08-05 23:54:45,163][52663] Sum rewards: 33.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.487', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.066', 'weapon4': '0.090', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'ARMOR': '0.468', 'weapon2': '1.056', 'WEAPON3': '1.250', 'HITCOUNT': '2.380', 'weapon3': '2.576', 'DAMAGECOUNT': '9.780', 'FRAGCOUNT': '31.000'} [2024-08-05 23:54:46,004][52658] DAMAGECOUNT value on done: 60856.0 [2024-08-05 23:54:46,005][52658] Sum rewards: 41.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.334', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.090', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'AMMO4': '0.280', 'WEAPON4': '0.600', 'weapon4': '0.666', 'ARMOR': '0.848', 'weapon2': '0.946', 'WEAPON3': '0.950', 'weapon3': '1.942', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '10.863', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:46,013][52670] DAMAGECOUNT value on done: 60816.0 [2024-08-05 23:54:46,015][52670] Sum rewards: 44.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.160', 'weapon4': '0.164', 'WEAPON4': '0.300', 'weapon2': '0.588', 'ARMOR': '0.889', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '3.030', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:46,156][52665] DAMAGECOUNT value on done: 65284.0 [2024-08-05 23:54:46,157][52665] Sum rewards: 34.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.688', 'ARMOR': '0.856', 'WEAPON3': '1.200', 'HITCOUNT': '2.370', 'weapon3': '3.124', 'DAMAGECOUNT': '10.242', 'FRAGCOUNT': '28.000'} [2024-08-05 23:54:46,216][52667] DAMAGECOUNT value on done: 64082.0 [2024-08-05 23:54:46,216][52667] Sum rewards: 52.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.239', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.139', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.820', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '2.814', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '44.000'} [2024-08-05 23:54:47,292][52650] Updated weights for policy 0, policy_version 18591 (0.0012) [2024-08-05 23:54:47,541][52666] DAMAGECOUNT value on done: 61050.0 [2024-08-05 23:54:47,543][52666] Sum rewards: 40.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'ARMOR': '0.440', 'weapon2': '0.470', 'weapon4': '0.598', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '36.000'} [2024-08-05 23:54:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 152305664. Throughput: 0: 4404.4. Samples: 38074730. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:54:47,794][52567] Avg episode reward: [(0, '43.043')] [2024-08-05 23:54:48,193][52663] DAMAGECOUNT value on done: 64410.0 [2024-08-05 23:54:48,196][52663] Sum rewards: 38.003, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.178', 'weapon5': '0.228', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '2.946', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '36.000'} [2024-08-05 23:54:48,529][52820] DAMAGECOUNT value on done: 56478.0 [2024-08-05 23:54:48,530][52820] Sum rewards: 42.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.106', 'AMMO4': '0.114', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'ARMOR': '0.404', 'weapon2': '0.466', 'WEAPON3': '1.550', 'HITCOUNT': '2.600', 'weapon3': '3.176', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:48,914][52665] DAMAGECOUNT value on done: 64785.0 [2024-08-05 23:54:48,915][52665] Sum rewards: 45.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.178', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.189', 'weapon5': '0.194', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON4': '0.450', 'weapon2': '0.794', 'ARMOR': '0.908', 'WEAPON3': '1.050', 'weapon3': '2.330', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '39.000'} [2024-08-05 23:54:48,986][52670] DAMAGECOUNT value on done: 65272.0 [2024-08-05 23:54:48,986][52670] Sum rewards: 40.037, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.998', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.122', 'weapon5': '0.142', 'AMMO4': '0.165', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'ARMOR': '0.460', 'weapon2': '0.556', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '2.940', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:49,171][52658] DAMAGECOUNT value on done: 68547.0 [2024-08-05 23:54:49,173][52658] Sum rewards: 43.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'AMMO4': '0.183', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.756', 'WEAPON3': '0.850', 'ARMOR': '0.926', 'weapon3': '2.578', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.884', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:49,396][52667] DAMAGECOUNT value on done: 69385.0 [2024-08-05 23:54:49,399][52667] Sum rewards: 45.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.404', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.173', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.000', 'HITCOUNT': '2.610', 'weapon3': '2.932', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:50,272][52666] DAMAGECOUNT value on done: 64840.0 [2024-08-05 23:54:50,273][52666] Sum rewards: 56.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.383', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.211', 'ARMOR': '0.400', 'weapon2': '0.796', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '47.000'} [2024-08-05 23:54:50,933][52663] DAMAGECOUNT value on done: 61332.0 [2024-08-05 23:54:50,933][52663] Sum rewards: 38.961, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.428', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.119', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.676', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '3.026', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:51,530][52820] DAMAGECOUNT value on done: 60861.0 [2024-08-05 23:54:51,530][52820] Sum rewards: 46.755, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.064', 'AMMO3': '0.131', 'weapon5': '0.152', 'WEAPON5': '0.200', 'HEALTH': '0.211', 'AMMO4': '0.318', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.914', 'weapon3': '1.978', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.781', 'FRAGCOUNT': '37.000'} [2024-08-05 23:54:51,817][52670] DAMAGECOUNT value on done: 60641.0 [2024-08-05 23:54:51,818][52670] Sum rewards: 51.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.432', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.165', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.850', 'ARMOR': '0.893', 'weapon3': '2.632', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '43.000'} [2024-08-05 23:54:51,954][52650] Updated weights for policy 0, policy_version 18601 (0.0016) [2024-08-05 23:54:52,104][52665] DAMAGECOUNT value on done: 63130.0 [2024-08-05 23:54:52,104][52665] Sum rewards: 48.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.126', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.166', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon2': '0.472', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '2.806', 'DAMAGECOUNT': '11.832', 'FRAGCOUNT': '42.000'} [2024-08-05 23:54:52,256][52658] DAMAGECOUNT value on done: 63212.0 [2024-08-05 23:54:52,256][52658] Sum rewards: 52.060, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.078', 'HEALTH': '0.116', 'AMMO3': '0.123', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon4': '0.206', 'WEAPON4': '0.250', 'ARMOR': '0.481', 'WEAPON3': '0.700', 'weapon2': '0.772', 'HITCOUNT': '2.570', 'weapon3': '2.714', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:52,532][52667] DAMAGECOUNT value on done: 62918.0 [2024-08-05 23:54:52,534][52667] Sum rewards: 33.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.142', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'ARMOR': '0.427', 'weapon4': '0.580', 'weapon2': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.402', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '30.000'} [2024-08-05 23:54:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 152387584. Throughput: 0: 4406.7. Samples: 38101320. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:54:52,794][52567] Avg episode reward: [(0, '43.235')] [2024-08-05 23:54:53,221][52666] DAMAGECOUNT value on done: 62421.0 [2024-08-05 23:54:53,221][52666] Sum rewards: 45.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.344', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.076', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.598', 'ARMOR': '0.870', 'WEAPON3': '1.500', 'HITCOUNT': '2.360', 'weapon3': '2.974', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:53,333][52663] DAMAGECOUNT value on done: 65455.0 [2024-08-05 23:54:53,334][52663] Sum rewards: 43.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'weapon5': '0.002', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.552', 'ARMOR': '0.876', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '3.210', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:54,291][52671] DAMAGECOUNT value on done: 69121.0 [2024-08-05 23:54:54,292][52671] Sum rewards: 35.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.282', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.243', 'weapon4': '0.300', 'ARMOR': '0.536', 'WEAPON4': '0.550', 'weapon2': '0.808', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.516', 'DAMAGECOUNT': '10.944', 'FRAGCOUNT': '33.000'} [2024-08-05 23:54:54,626][52820] DAMAGECOUNT value on done: 56681.0 [2024-08-05 23:54:54,628][52820] Sum rewards: 42.628, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO3': '0.161', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'ARMOR': '0.432', 'weapon4': '0.466', 'weapon2': '0.832', 'WEAPON3': '0.950', 'HITCOUNT': '2.280', 'weapon3': '2.424', 'DAMAGECOUNT': '10.002', 'FRAGCOUNT': '34.000'} [2024-08-05 23:54:54,957][52670] DAMAGECOUNT value on done: 62119.0 [2024-08-05 23:54:54,960][52670] Sum rewards: 44.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.325', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.029', 'ARMOR': '0.053', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon4': '0.362', 'weapon2': '0.432', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '2.970', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:55,103][52665] DAMAGECOUNT value on done: 61655.0 [2024-08-05 23:54:55,103][52665] Sum rewards: 45.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.896', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.152', 'AMMO3': '0.177', 'WEAPON4': '0.450', 'weapon4': '0.528', 'weapon2': '0.540', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.586', 'DAMAGECOUNT': '10.281', 'FRAGCOUNT': '40.000'} [2024-08-05 23:54:55,119][52658] DAMAGECOUNT value on done: 65032.0 [2024-08-05 23:54:55,122][52658] Sum rewards: 45.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.964', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.346', 'ARMOR': '0.420', 'WEAPON3': '1.500', 'HITCOUNT': '2.440', 'weapon3': '3.004', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '43.000'} [2024-08-05 23:54:55,311][52667] DAMAGECOUNT value on done: 65425.0 [2024-08-05 23:54:55,320][52667] Sum rewards: 33.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.439', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.500', 'weapon2': '0.638', 'weapon4': '0.720', 'ARMOR': '0.905', 'WEAPON3': '1.200', 'HITCOUNT': '2.220', 'weapon3': '2.282', 'DAMAGECOUNT': '9.291', 'FRAGCOUNT': '31.000'} [2024-08-05 23:54:56,199][52666] DAMAGECOUNT value on done: 61196.0 [2024-08-05 23:54:56,203][52666] Sum rewards: 48.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.770', 'AMMO5': '0.017', 'ARMOR': '0.060', 'AMMO2': '0.070', 'weapon5': '0.076', 'AMMO3': '0.145', 'weapon4': '0.218', 'AMMO4': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.800', 'weapon2': '0.814', 'WEAPON3': '1.000', 'weapon3': '2.614', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:56,428][52650] Updated weights for policy 0, policy_version 18611 (0.0020) [2024-08-05 23:54:56,469][52663] DAMAGECOUNT value on done: 68467.0 [2024-08-05 23:54:56,469][52663] Sum rewards: 48.231, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.175', 'AMMO5': '0.010', 'AMMO2': '0.036', 'ARMOR': '0.056', 'weapon5': '0.060', 'AMMO3': '0.098', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON4': '0.550', 'weapon4': '0.558', 'WEAPON3': '0.650', 'weapon3': '2.628', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.424', 'FRAGCOUNT': '38.000'} [2024-08-05 23:54:57,298][52671] DAMAGECOUNT value on done: 63456.0 [2024-08-05 23:54:57,299][52671] Sum rewards: 37.212, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.083', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.080', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'ARMOR': '0.400', 'weapon4': '0.556', 'WEAPON3': '0.750', 'weapon2': '1.574', 'weapon3': '1.640', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.390', 'FRAGCOUNT': '28.000'} [2024-08-05 23:54:57,673][52820] DAMAGECOUNT value on done: 57892.0 [2024-08-05 23:54:57,681][52820] Sum rewards: 48.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.097', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.179', 'ARMOR': '0.400', 'weapon2': '0.856', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '3.008', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 152477696. Throughput: 0: 4403.1. Samples: 38127710. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-05 23:54:57,794][52567] Avg episode reward: [(0, '43.317')] [2024-08-05 23:54:57,803][52670] DAMAGECOUNT value on done: 59075.0 [2024-08-05 23:54:57,803][52670] Sum rewards: 29.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.490', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.060', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'AMMO4': '0.263', 'weapon4': '0.442', 'ARMOR': '0.472', 'WEAPON4': '0.600', 'weapon2': '0.810', 'WEAPON3': '1.500', 'HITCOUNT': '2.420', 'weapon3': '2.436', 'DAMAGECOUNT': '9.771', 'FRAGCOUNT': '29.000'} [2024-08-05 23:54:57,809][52658] DAMAGECOUNT value on done: 64981.0 [2024-08-05 23:54:57,809][52658] Sum rewards: 40.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.791', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.056', 'weapon5': '0.056', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'ARMOR': '0.859', 'weapon2': '0.988', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.710', 'DAMAGECOUNT': '10.497', 'FRAGCOUNT': '35.000'} [2024-08-05 23:54:58,202][52665] DAMAGECOUNT value on done: 62627.0 [2024-08-05 23:54:58,203][52665] Sum rewards: 29.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.368', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'weapon4': '0.424', 'ARMOR': '0.883', 'weapon2': '0.916', 'WEAPON3': '1.150', 'HITCOUNT': '1.930', 'weapon3': '2.234', 'DAMAGECOUNT': '8.025', 'FRAGCOUNT': '27.000'} [2024-08-05 23:54:59,017][52666] DAMAGECOUNT value on done: 61290.0 [2024-08-05 23:54:59,017][52666] Sum rewards: 45.421, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.444', 'AMMO5': '0.015', 'AMMO2': '0.074', 'weapon5': '0.158', 'AMMO3': '0.191', 'WEAPON5': '0.350', 'AMMO4': '0.368', 'weapon4': '0.602', 'weapon2': '0.684', 'WEAPON4': '0.750', 'ARMOR': '0.808', 'WEAPON3': '1.100', 'weapon3': '2.304', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '41.000'} [2024-08-05 23:54:59,379][52663] DAMAGECOUNT value on done: 63877.0 [2024-08-05 23:54:59,379][52663] Sum rewards: 50.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.338', 'weapon2': '0.456', 'ARMOR': '0.463', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '2.870', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:00,217][52671] DAMAGECOUNT value on done: 64298.0 [2024-08-05 23:55:00,218][52671] Sum rewards: 42.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.447', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.041', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.204', 'weapon4': '0.284', 'WEAPON4': '0.450', 'weapon2': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '2.390', 'weapon3': '2.844', 'DAMAGECOUNT': '11.127', 'FRAGCOUNT': '37.000'} [2024-08-05 23:55:00,500][52658] DAMAGECOUNT value on done: 66089.0 [2024-08-05 23:55:00,500][52658] Sum rewards: 43.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'AMMO3': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.394', 'ARMOR': '0.404', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.684', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.592', 'FRAGCOUNT': '38.000'} [2024-08-05 23:55:00,670][52670] DAMAGECOUNT value on done: 58392.0 [2024-08-05 23:55:00,672][52670] Sum rewards: 43.184, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.546', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.253', 'ARMOR': '0.472', 'weapon2': '0.504', 'WEAPON3': '1.500', 'HITCOUNT': '2.630', 'weapon3': '3.086', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:00,763][52820] DAMAGECOUNT value on done: 58281.0 [2024-08-05 23:55:00,765][52820] Sum rewards: 48.719, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.912', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.038', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.281', 'weapon2': '0.476', 'WEAPON4': '0.500', 'weapon4': '0.518', 'WEAPON3': '1.600', 'weapon3': '2.638', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '45.000'} [2024-08-05 23:55:01,267][52665] DAMAGECOUNT value on done: 62349.0 [2024-08-05 23:55:01,271][52665] Sum rewards: 44.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.479', 'AMMO5': '0.003', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'weapon4': '0.548', 'weapon2': '0.770', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '37.000'} [2024-08-05 23:55:01,375][52650] Updated weights for policy 0, policy_version 18621 (0.0014) [2024-08-05 23:55:02,069][52666] DAMAGECOUNT value on done: 61239.0 [2024-08-05 23:55:02,069][52666] Sum rewards: 44.006, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.685', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.164', 'AMMO4': '0.183', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.600', 'weapon2': '0.616', 'ARMOR': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.278', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '38.500'} [2024-08-05 23:55:02,379][52663] DAMAGECOUNT value on done: 64141.0 [2024-08-05 23:55:02,380][52663] Sum rewards: 48.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.251', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.080', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.400', 'weapon4': '0.498', 'weapon2': '0.822', 'WEAPON3': '1.150', 'ARMOR': '1.351', 'weapon3': '2.364', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.174', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:02,579][52649] Large shaping reward 3.441 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.39, 130.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:55:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 152567808. Throughput: 0: 4397.3. Samples: 38140640. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:55:02,794][52567] Avg episode reward: [(0, '43.263')] [2024-08-05 23:55:03,143][52658] DAMAGECOUNT value on done: 62398.0 [2024-08-05 23:55:03,144][52658] Sum rewards: 43.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon4': '0.252', 'ARMOR': '0.454', 'weapon2': '0.616', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '2.828', 'DAMAGECOUNT': '11.112', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:03,368][52671] DAMAGECOUNT value on done: 61671.0 [2024-08-05 23:55:03,370][52671] Sum rewards: 42.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.725', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.466', 'WEAPON3': '1.500', 'HITCOUNT': '2.570', 'weapon3': '2.846', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:03,887][52820] DAMAGECOUNT value on done: 59885.0 [2024-08-05 23:55:03,887][52820] Sum rewards: 41.223, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.475', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.140', 'AMMO4': '0.147', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.310', 'ARMOR': '0.432', 'weapon2': '0.894', 'WEAPON3': '0.900', 'weapon3': '2.324', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '34.000'} [2024-08-05 23:55:03,941][52670] DAMAGECOUNT value on done: 62987.0 [2024-08-05 23:55:03,942][52670] Sum rewards: 43.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.722', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.030', 'AMMO4': '0.117', 'weapon4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.600', 'ARMOR': '1.212', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '3.000', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '37.500'} [2024-08-05 23:55:04,369][52665] DAMAGECOUNT value on done: 62717.0 [2024-08-05 23:55:04,371][52665] Sum rewards: 45.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.682', 'ARMOR': '0.942', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:04,836][52663] DAMAGECOUNT value on done: 67034.0 [2024-08-05 23:55:04,838][52663] Sum rewards: 33.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.812', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.062', 'ARMOR': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.308', 'weapon4': '0.474', 'weapon2': '0.612', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '2.656', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '30.000'} [2024-08-05 23:55:05,351][52666] DAMAGECOUNT value on done: 62900.0 [2024-08-05 23:55:05,353][52666] Sum rewards: 49.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.654', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.166', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon2': '0.408', 'ARMOR': '0.493', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.086', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '42.000'} [2024-08-05 23:55:05,654][52658] DAMAGECOUNT value on done: 63574.0 [2024-08-05 23:55:05,658][52658] Sum rewards: 42.406, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.612', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon4': '0.426', 'weapon2': '0.668', 'ARMOR': '0.877', 'WEAPON3': '1.600', 'weapon3': '2.522', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:05,723][52650] Updated weights for policy 0, policy_version 18631 (0.0012) [2024-08-05 23:55:06,668][52671] DAMAGECOUNT value on done: 61321.0 [2024-08-05 23:55:06,669][52671] Sum rewards: 30.122, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.952', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon4': '0.166', 'weapon5': '0.180', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'AMMO4': '0.286', 'ARMOR': '0.548', 'WEAPON4': '0.550', 'weapon2': '0.590', 'WEAPON3': '1.600', 'HITCOUNT': '2.150', 'weapon3': '2.712', 'DAMAGECOUNT': '9.690', 'FRAGCOUNT': '31.000'} [2024-08-05 23:55:06,982][52670] DAMAGECOUNT value on done: 64046.0 [2024-08-05 23:55:06,982][52670] Sum rewards: 30.801, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.645', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.168', 'AMMO3': '0.260', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'ARMOR': '0.458', 'weapon2': '0.626', 'WEAPON3': '1.500', 'HITCOUNT': '2.270', 'weapon3': '2.626', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '31.000'} [2024-08-05 23:55:07,095][52820] DAMAGECOUNT value on done: 60526.0 [2024-08-05 23:55:07,099][52820] Sum rewards: 44.727, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.006', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.072', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.316', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'WEAPON3': '0.750', 'weapon2': '0.978', 'HITCOUNT': '2.320', 'weapon3': '2.474', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '36.000'} [2024-08-05 23:55:07,382][52665] DAMAGECOUNT value on done: 62163.0 [2024-08-05 23:55:07,384][52665] Sum rewards: 52.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.708', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.128', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '45.000'} [2024-08-05 23:55:07,556][52663] DAMAGECOUNT value on done: 64757.0 [2024-08-05 23:55:07,558][52663] Sum rewards: 53.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.994', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.232', 'ARMOR': '0.455', 'weapon2': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.998', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '44.000'} [2024-08-05 23:55:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 152649728. Throughput: 0: 4406.2. Samples: 38167340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-05 23:55:07,794][52567] Avg episode reward: [(0, '43.337')] [2024-08-05 23:55:08,183][52658] DAMAGECOUNT value on done: 62814.0 [2024-08-05 23:55:08,184][52658] Sum rewards: 39.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.240', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.046', 'weapon5': '0.078', 'AMMO3': '0.186', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.384', 'WEAPON4': '0.550', 'weapon2': '0.708', 'WEAPON3': '1.250', 'HITCOUNT': '2.380', 'weapon3': '2.546', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '35.000'} [2024-08-05 23:55:08,256][52666] DAMAGECOUNT value on done: 60394.0 [2024-08-05 23:55:08,258][52666] Sum rewards: 36.534, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.603', 'AMMO5': '0.007', 'AMMO2': '0.045', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.260', 'weapon4': '0.332', 'ARMOR': '0.456', 'WEAPON4': '0.500', 'weapon2': '0.702', 'WEAPON3': '1.500', 'HITCOUNT': '2.370', 'weapon3': '2.450', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '35.000'} [2024-08-05 23:55:09,725][52670] DAMAGECOUNT value on done: 62996.0 [2024-08-05 23:55:09,726][52670] Sum rewards: 48.560, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.245', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.054', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.242', 'ARMOR': '0.454', 'weapon2': '0.808', 'WEAPON3': '0.950', 'weapon3': '2.708', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:09,842][52671] DAMAGECOUNT value on done: 66586.0 [2024-08-05 23:55:09,842][52671] Sum rewards: 56.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.101', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.173', 'WEAPON4': '0.400', 'ARMOR': '0.507', 'weapon4': '0.510', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon3': '2.696', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '46.000'} [2024-08-05 23:55:10,048][52820] DAMAGECOUNT value on done: 60184.0 [2024-08-05 23:55:10,050][52820] Sum rewards: 43.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.482', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'ARMOR': '0.854', 'weapon2': '1.062', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.656', 'DAMAGECOUNT': '11.544', 'FRAGCOUNT': '38.000'} [2024-08-05 23:55:10,210][52663] DAMAGECOUNT value on done: 63286.0 [2024-08-05 23:55:10,210][52663] Sum rewards: 50.172, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.120', 'weapon5': '0.190', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HEALTH': '0.464', 'WEAPON3': '0.650', 'ARMOR': '0.800', 'weapon2': '0.814', 'weapon4': '0.848', 'weapon3': '1.858', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:10,500][52665] DAMAGECOUNT value on done: 60084.0 [2024-08-05 23:55:10,502][52665] Sum rewards: 41.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.828', 'ARMOR': '0.924', 'WEAPON3': '1.300', 'HITCOUNT': '2.360', 'weapon3': '2.932', 'DAMAGECOUNT': '11.202', 'FRAGCOUNT': '37.000'} [2024-08-05 23:55:10,820][52650] Updated weights for policy 0, policy_version 18641 (0.0012) [2024-08-05 23:55:11,143][52666] DAMAGECOUNT value on done: 60289.0 [2024-08-05 23:55:11,144][52666] Sum rewards: 37.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.191', 'weapon4': '0.484', 'WEAPON4': '0.500', 'weapon2': '0.654', 'WEAPON3': '1.200', 'HITCOUNT': '2.350', 'weapon3': '2.534', 'DAMAGECOUNT': '10.392', 'FRAGCOUNT': '34.000'} [2024-08-05 23:55:11,199][52658] DAMAGECOUNT value on done: 62987.0 [2024-08-05 23:55:11,202][52658] Sum rewards: 39.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.955', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO4': '0.163', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.400', 'weapon2': '0.786', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '2.672', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '34.000'} [2024-08-05 23:55:12,611][52671] DAMAGECOUNT value on done: 65661.0 [2024-08-05 23:55:12,611][52671] Sum rewards: 50.419, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.402', 'AMMO2': '0.023', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'weapon2': '0.368', 'weapon4': '0.548', 'ARMOR': '0.853', 'WEAPON3': '1.550', 'weapon3': '2.690', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '47.000'} [2024-08-05 23:55:12,792][52659] DAMAGECOUNT value on done: 64304.0 [2024-08-05 23:55:12,793][52659] Sum rewards: 39.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.254', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.232', 'WEAPON4': '0.550', 'weapon2': '0.718', 'weapon4': '0.764', 'ARMOR': '0.876', 'WEAPON3': '1.450', 'weapon3': '2.070', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '36.000'} [2024-08-05 23:55:12,793][52670] DAMAGECOUNT value on done: 63519.0 [2024-08-05 23:55:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 152739840. Throughput: 0: 4401.3. Samples: 38193650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 23:55:12,820][52567] Avg episode reward: [(0, '43.507')] [2024-08-05 23:55:12,810][52663] DAMAGECOUNT value on done: 60495.0 [2024-08-05 23:55:12,820][52670] Sum rewards: 43.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.476', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.225', 'WEAPON4': '0.500', 'weapon4': '0.602', 'weapon2': '1.008', 'WEAPON3': '1.100', 'weapon3': '2.032', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '36.000'} [2024-08-05 23:55:12,821][52663] Sum rewards: 40.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.846', 'AMMO5': '0.024', 'AMMO2': '0.051', 'weapon5': '0.108', 'AMMO3': '0.161', 'AMMO4': '0.256', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'ARMOR': '0.840', 'weapon2': '0.916', 'WEAPON3': '0.950', 'weapon3': '2.376', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '34.000'} [2024-08-05 23:55:13,170][52820] DAMAGECOUNT value on done: 55663.0 [2024-08-05 23:55:13,170][52820] Sum rewards: 36.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.582', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.134', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon4': '0.504', 'weapon2': '1.010', 'WEAPON3': '1.050', 'weapon3': '2.172', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '9.954', 'FRAGCOUNT': '31.000'} [2024-08-05 23:55:13,578][52665] DAMAGECOUNT value on done: 59812.0 [2024-08-05 23:55:13,578][52665] Sum rewards: 27.371, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-5.262', 'AMMO5': '0.014', 'AMMO2': '0.089', 'AMMO3': '0.233', 'weapon5': '0.274', 'AMMO4': '0.444', 'WEAPON5': '0.450', 'weapon4': '0.474', 'weapon2': '0.796', 'ARMOR': '0.915', 'WEAPON4': '0.950', 'WEAPON3': '1.450', 'HITCOUNT': '2.030', 'weapon3': '2.064', 'DAMAGECOUNT': '9.699', 'FRAGCOUNT': '30.000'} [2024-08-05 23:55:14,095][52658] DAMAGECOUNT value on done: 65985.0 [2024-08-05 23:55:14,098][52658] Sum rewards: 43.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.988', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'ARMOR': '0.450', 'weapon2': '0.522', 'weapon4': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.650', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '38.000'} [2024-08-05 23:55:14,271][52666] DAMAGECOUNT value on done: 59162.0 [2024-08-05 23:55:14,271][52666] Sum rewards: 37.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.597', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.028', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON3': '0.950', 'ARMOR': '1.259', 'weapon2': '1.644', 'weapon3': '2.064', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '31.000'} [2024-08-05 23:55:15,292][52650] Updated weights for policy 0, policy_version 18651 (0.0032) [2024-08-05 23:55:15,585][52671] DAMAGECOUNT value on done: 68125.0 [2024-08-05 23:55:15,586][52671] Sum rewards: 47.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.021', 'weapon5': '0.026', 'weapon4': '0.036', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.736', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '42.500'} [2024-08-05 23:55:15,780][52663] DAMAGECOUNT value on done: 63183.0 [2024-08-05 23:55:15,780][52663] Sum rewards: 48.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.668', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.102', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.238', 'ARMOR': '0.404', 'weapon4': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.770', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:15,796][52670] DAMAGECOUNT value on done: 64246.0 [2024-08-05 23:55:15,797][52670] Sum rewards: 47.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.038', 'AMMO4': '0.140', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.466', 'weapon4': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.480', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:15,816][52659] DAMAGECOUNT value on done: 65574.0 [2024-08-05 23:55:15,817][52659] Sum rewards: 40.660, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.852', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.136', 'AMMO3': '0.174', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.552', 'weapon2': '0.714', 'ARMOR': '0.936', 'WEAPON3': '1.100', 'weapon3': '2.220', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.896', 'FRAGCOUNT': '38.000'} [2024-08-05 23:55:16,072][52820] DAMAGECOUNT value on done: 58650.0 [2024-08-05 23:55:16,074][52820] Sum rewards: 50.860, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.204', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.082', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '45.000'} [2024-08-05 23:55:16,312][52665] DAMAGECOUNT value on done: 59624.0 [2024-08-05 23:55:16,312][52665] Sum rewards: 37.798, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.631', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.098', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.394', 'ARMOR': '0.404', 'weapon4': '0.556', 'WEAPON3': '0.850', 'HITCOUNT': '2.360', 'weapon3': '2.646', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '30.000'} [2024-08-05 23:55:17,098][52666] DAMAGECOUNT value on done: 62603.0 [2024-08-05 23:55:17,098][52666] Sum rewards: 46.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon4': '0.246', 'ARMOR': '0.436', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:17,374][52658] DAMAGECOUNT value on done: 67543.0 [2024-08-05 23:55:17,375][52658] Sum rewards: 48.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.056', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 152829952. Throughput: 0: 4412.1. Samples: 38207120. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 23:55:17,794][52567] Avg episode reward: [(0, '43.175')] [2024-08-05 23:55:18,370][52670] DAMAGECOUNT value on done: 59122.0 [2024-08-05 23:55:18,370][52670] Sum rewards: 45.189, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.379', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon7': '0.060', 'weapon5': '0.106', 'AMMO4': '0.109', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.354', 'ARMOR': '0.424', 'weapon4': '0.656', 'WEAPON3': '1.050', 'HITCOUNT': '2.220', 'weapon3': '2.224', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:18,533][52663] DAMAGECOUNT value on done: 67076.0 [2024-08-05 23:55:18,533][52663] Sum rewards: 54.391, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.094', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.102', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '45.000'} [2024-08-05 23:55:18,988][52671] DAMAGECOUNT value on done: 65203.0 [2024-08-05 23:55:18,989][52671] Sum rewards: 60.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'AMMO2': '0.021', 'ARMOR': '0.040', 'AMMO4': '0.102', 'weapon4': '0.146', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.114', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '50.000'} [2024-08-05 23:55:19,159][52659] DAMAGECOUNT value on done: 64684.0 [2024-08-05 23:55:19,163][52659] Sum rewards: 54.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.092', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.262', 'AMMO3': '0.263', 'ARMOR': '0.468', 'weapon2': '0.702', 'WEAPON3': '1.650', 'weapon3': '2.784', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '50.000'} [2024-08-05 23:55:19,191][52820] DAMAGECOUNT value on done: 61130.0 [2024-08-05 23:55:19,193][52820] Sum rewards: 47.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.523', 'AMMO2': '0.026', 'weapon4': '0.118', 'AMMO4': '0.128', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'ARMOR': '0.416', 'weapon2': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.188', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:19,816][52666] DAMAGECOUNT value on done: 62647.0 [2024-08-05 23:55:19,817][52666] Sum rewards: 36.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.436', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.226', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.590', 'ARMOR': '0.853', 'WEAPON3': '1.350', 'HITCOUNT': '2.250', 'weapon3': '2.824', 'DAMAGECOUNT': '9.699', 'FRAGCOUNT': '33.000'} [2024-08-05 23:55:19,890][52650] Updated weights for policy 0, policy_version 18661 (0.0012) [2024-08-05 23:55:20,315][52658] DAMAGECOUNT value on done: 63046.0 [2024-08-05 23:55:20,316][52658] Sum rewards: 35.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.765', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.154', 'AMMO3': '0.198', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.484', 'weapon4': '0.560', 'WEAPON4': '0.650', 'ARMOR': '0.836', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.554', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '30.000'} [2024-08-05 23:55:21,233][52663] DAMAGECOUNT value on done: 63806.0 [2024-08-05 23:55:21,234][52663] Sum rewards: 47.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.184', 'weapon5': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.201', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.558', 'ARMOR': '0.903', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.880', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '42.000'} [2024-08-05 23:55:21,449][52670] DAMAGECOUNT value on done: 63927.0 [2024-08-05 23:55:21,451][52670] Sum rewards: 38.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.132', 'weapon5': '0.152', 'AMMO4': '0.177', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.848', 'ARMOR': '1.331', 'WEAPON3': '1.400', 'HITCOUNT': '2.520', 'weapon3': '2.584', 'DAMAGECOUNT': '11.973', 'FRAGCOUNT': '32.000'} [2024-08-05 23:55:21,772][52671] DAMAGECOUNT value on done: 66968.0 [2024-08-05 23:55:21,773][52671] Sum rewards: 39.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.398', 'AMMO5': '0.010', 'ARMOR': '0.040', 'AMMO2': '0.043', 'AMMO3': '0.188', 'weapon5': '0.210', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.382', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.626', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '36.000'} [2024-08-05 23:55:22,017][52659] DAMAGECOUNT value on done: 65751.0 [2024-08-05 23:55:22,019][52659] Sum rewards: 45.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.456', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon4': '0.418', 'ARMOR': '0.508', 'weapon2': '0.892', 'WEAPON3': '1.350', 'weapon3': '2.408', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.147', 'FRAGCOUNT': '42.000'} [2024-08-05 23:55:22,392][52820] DAMAGECOUNT value on done: 62208.0 [2024-08-05 23:55:22,394][52820] Sum rewards: 44.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.116', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.236', 'weapon5': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.784', 'ARMOR': '0.941', 'WEAPON3': '1.400', 'weapon3': '2.460', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 152920064. Throughput: 0: 4405.8. Samples: 38233290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-05 23:55:22,794][52567] Avg episode reward: [(0, '43.322')] [2024-08-05 23:55:22,968][52666] DAMAGECOUNT value on done: 64546.0 [2024-08-05 23:55:22,968][52666] Sum rewards: 52.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.755', 'AMMO2': '0.039', 'weapon4': '0.112', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.786', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:23,164][52658] DAMAGECOUNT value on done: 63463.0 [2024-08-05 23:55:23,164][52658] Sum rewards: 51.620, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.068', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.136', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'ARMOR': '0.461', 'weapon4': '0.464', 'weapon2': '0.778', 'WEAPON3': '1.100', 'weapon3': '2.434', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:23,810][52663] DAMAGECOUNT value on done: 64982.0 [2024-08-05 23:55:23,811][52663] Sum rewards: 37.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.055', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.276', 'WEAPON4': '0.550', 'weapon4': '0.678', 'weapon2': '0.848', 'WEAPON3': '1.050', 'weapon3': '2.200', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.005', 'FRAGCOUNT': '34.000'} [2024-08-05 23:55:24,601][52670] DAMAGECOUNT value on done: 63194.0 [2024-08-05 23:55:24,601][52670] Sum rewards: 55.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '47.000'} [2024-08-05 23:55:24,805][52671] DAMAGECOUNT value on done: 65982.0 [2024-08-05 23:55:24,805][52671] Sum rewards: 51.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.173', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.884', 'ARMOR': '0.919', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:24,865][52650] Updated weights for policy 0, policy_version 18671 (0.0017) [2024-08-05 23:55:25,131][52659] DAMAGECOUNT value on done: 63928.0 [2024-08-05 23:55:25,133][52659] Sum rewards: 34.333, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.344', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.313', 'weapon2': '0.568', 'ARMOR': '0.867', 'WEAPON3': '1.750', 'HITCOUNT': '2.700', 'weapon3': '3.032', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '35.500'} [2024-08-05 23:55:25,474][52820] DAMAGECOUNT value on done: 56984.0 [2024-08-05 23:55:25,475][52820] Sum rewards: 52.858, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.553', 'AMMO5': '0.010', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.118', 'AMMO4': '0.122', 'AMMO3': '0.150', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.778', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.700', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '42.000'} [2024-08-05 23:55:25,707][52658] DAMAGECOUNT value on done: 68422.0 [2024-08-05 23:55:25,708][52658] Sum rewards: 57.076, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon4': '0.210', 'ARMOR': '0.476', 'WEAPON3': '0.900', 'weapon2': '1.086', 'weapon3': '2.438', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '46.000'} [2024-08-05 23:55:26,822][52663] DAMAGECOUNT value on done: 66587.0 [2024-08-05 23:55:26,825][52663] Sum rewards: 45.826, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.026', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon5': '0.202', 'WEAPON4': '0.300', 'ARMOR': '0.408', 'weapon2': '0.512', 'weapon4': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.506', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '38.000'} [2024-08-05 23:55:27,584][52671] DAMAGECOUNT value on done: 65099.0 [2024-08-05 23:55:27,585][52671] Sum rewards: 50.795, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.538', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.076', 'WEAPON4': '0.100', 'weapon2': '0.232', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '2.890', 'weapon3': '3.486', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '47.000'} [2024-08-05 23:55:27,675][52670] DAMAGECOUNT value on done: 61572.0 [2024-08-05 23:55:27,676][52670] Sum rewards: 27.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.269', 'AMMO5': '0.012', 'weapon5': '0.038', 'AMMO2': '0.048', 'AMMO3': '0.146', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.652', 'weapon2': '0.720', 'WEAPON3': '0.900', 'HITCOUNT': '2.060', 'weapon3': '2.334', 'DAMAGECOUNT': '8.322', 'FRAGCOUNT': '25.000'} [2024-08-05 23:55:27,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 153001984. Throughput: 0: 4405.8. Samples: 38259740. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:55:27,795][52567] Avg episode reward: [(0, '44.072')] [2024-08-05 23:55:27,883][52659] DAMAGECOUNT value on done: 65889.0 [2024-08-05 23:55:27,885][52659] Sum rewards: 31.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.062', 'WEAPON5': '0.100', 'weapon5': '0.166', 'AMMO3': '0.187', 'AMMO4': '0.312', 'WEAPON4': '0.700', 'weapon4': '0.710', 'weapon2': '0.718', 'WEAPON3': '1.100', 'HITCOUNT': '2.130', 'weapon3': '2.144', 'DAMAGECOUNT': '9.288', 'FRAGCOUNT': '31.000'} [2024-08-05 23:55:28,543][52820] DAMAGECOUNT value on done: 58682.0 [2024-08-05 23:55:28,545][52820] Sum rewards: 41.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.240', 'weapon2': '0.244', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.124', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '34.000'} [2024-08-05 23:55:29,175][52650] Updated weights for policy 0, policy_version 18681 (0.0016) [2024-08-05 23:55:29,920][52663] DAMAGECOUNT value on done: 67806.0 [2024-08-05 23:55:29,922][52663] Sum rewards: 51.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.952', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.162', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.452', 'ARMOR': '0.508', 'weapon2': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.518', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '42.000'} [2024-08-05 23:55:30,570][52670] DAMAGECOUNT value on done: 61824.0 [2024-08-05 23:55:30,572][52670] Sum rewards: 47.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.110', 'weapon5': '0.114', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'ARMOR': '0.455', 'weapon2': '0.888', 'WEAPON3': '1.100', 'weapon3': '2.590', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.352', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:30,606][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:55:30,837][52671] DAMAGECOUNT value on done: 69999.0 [2024-08-05 23:55:30,839][52671] Sum rewards: 47.725, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.520', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.118', 'AMMO3': '0.199', 'AMMO4': '0.235', 'weapon4': '0.262', 'WEAPON5': '0.300', 'ARMOR': '0.448', 'WEAPON4': '0.500', 'weapon2': '0.924', 'WEAPON3': '1.200', 'weapon3': '2.368', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:31,095][52659] DAMAGECOUNT value on done: 65184.0 [2024-08-05 23:55:31,096][52659] Sum rewards: 43.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'ARMOR': '0.447', 'weapon2': '0.752', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.906', 'DAMAGECOUNT': '11.307', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:31,509][52820] DAMAGECOUNT value on done: 62713.0 [2024-08-05 23:55:31,509][52820] Sum rewards: 39.417, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.520', 'AMMO5': '0.013', 'weapon5': '0.022', 'AMMO2': '0.043', 'weapon4': '0.166', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'ARMOR': '0.449', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'HITCOUNT': '2.850', 'weapon3': '3.018', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:32,622][52663] DAMAGECOUNT value on done: 63643.0 [2024-08-05 23:55:32,624][52663] Sum rewards: 47.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.991', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.426', 'weapon4': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.590', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '44.000'} [2024-08-05 23:55:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.5, 300 sec: 17605.9). Total num frames: 153100288. Throughput: 0: 4406.0. Samples: 38273000. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:55:32,794][52567] Avg episode reward: [(0, '44.080')] [2024-08-05 23:55:33,826][52671] DAMAGECOUNT value on done: 66144.0 [2024-08-05 23:55:33,826][52671] Sum rewards: 51.984, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO3': '0.240', 'weapon2': '0.454', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '3.302', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '47.000'} [2024-08-05 23:55:34,155][52650] Updated weights for policy 0, policy_version 18691 (0.0012) [2024-08-05 23:55:34,198][52659] DAMAGECOUNT value on done: 62792.0 [2024-08-05 23:55:34,199][52659] Sum rewards: 48.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.997', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.252', 'weapon2': '0.452', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '3.040', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:34,621][52820] DAMAGECOUNT value on done: 60215.0 [2024-08-05 23:55:34,622][52820] Sum rewards: 47.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO2': '0.011', 'ARMOR': '0.036', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.262', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:36,676][52671] DAMAGECOUNT value on done: 62214.0 [2024-08-05 23:55:36,677][52671] Sum rewards: 39.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.194', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.208', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'ARMOR': '0.847', 'weapon2': '0.948', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.652', 'DAMAGECOUNT': '10.605', 'FRAGCOUNT': '37.000'} [2024-08-05 23:55:36,984][52659] DAMAGECOUNT value on done: 64124.0 [2024-08-05 23:55:36,984][52659] Sum rewards: 52.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.927', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon2': '0.392', 'weapon4': '0.396', 'ARMOR': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '2.952', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:37,053][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:55:37,751][52820] DAMAGECOUNT value on done: 59405.0 [2024-08-05 23:55:37,759][52820] Sum rewards: 42.449, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.256', 'ARMOR': '0.004', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:37,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 153182208. Throughput: 0: 4401.8. Samples: 38299400. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:55:37,794][52567] Avg episode reward: [(0, '43.958')] [2024-08-05 23:55:38,227][52650] Updated weights for policy 0, policy_version 18701 (0.0052) [2024-08-05 23:55:39,767][52671] DAMAGECOUNT value on done: 65870.0 [2024-08-05 23:55:39,767][52671] Sum rewards: 41.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'ARMOR': '0.452', 'weapon4': '0.466', 'weapon2': '0.504', 'WEAPON3': '1.250', 'HITCOUNT': '2.470', 'weapon3': '2.714', 'DAMAGECOUNT': '10.032', 'FRAGCOUNT': '37.000'} [2024-08-05 23:55:40,108][52659] DAMAGECOUNT value on done: 66736.0 [2024-08-05 23:55:40,110][52659] Sum rewards: 49.941, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.066', 'AMMO3': '0.164', 'ARMOR': '0.400', 'HEALTH': '0.494', 'weapon2': '0.672', 'WEAPON3': '0.900', 'HITCOUNT': '2.670', 'weapon3': '3.194', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:40,830][52820] DAMAGECOUNT value on done: 65994.0 [2024-08-05 23:55:40,830][52820] Sum rewards: 62.642, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.013', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.160', 'ARMOR': '0.451', 'weapon2': '0.684', 'WEAPON3': '1.000', 'weapon3': '3.092', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '49.000'} [2024-08-05 23:55:41,343][52803] DAMAGECOUNT value on done: 61980.0 [2024-08-05 23:55:41,344][52803] Sum rewards: 51.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.244', 'weapon4': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.618', 'WEAPON3': '1.450', 'weapon3': '2.804', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '46.000'} [2024-08-05 23:55:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 153264128. Throughput: 0: 4402.9. Samples: 38325840. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 23:55:42,802][52567] Avg episode reward: [(0, '44.437')] [2024-08-05 23:55:42,803][52671] DAMAGECOUNT value on done: 65712.0 [2024-08-05 23:55:42,804][52671] Sum rewards: 41.086, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.667', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon4': '0.428', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '37.000'} [2024-08-05 23:55:42,872][52614] Saving new best policy, reward=44.437! [2024-08-05 23:55:43,195][52659] DAMAGECOUNT value on done: 64864.0 [2024-08-05 23:55:43,197][52659] Sum rewards: 47.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.102', 'weapon4': '0.118', 'AMMO3': '0.164', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.452', 'weapon2': '0.966', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.636', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:43,343][52650] Updated weights for policy 0, policy_version 18711 (0.0025) [2024-08-05 23:55:43,663][52664] DAMAGECOUNT value on done: 66392.0 [2024-08-05 23:55:43,664][52664] Sum rewards: 47.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.658', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'weapon4': '0.408', 'ARMOR': '0.449', 'weapon2': '0.556', 'WEAPON3': '1.400', 'HITCOUNT': '2.740', 'weapon3': '2.792', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '44.000'} [2024-08-05 23:55:43,919][52820] DAMAGECOUNT value on done: 63066.0 [2024-08-05 23:55:43,920][52820] Sum rewards: 43.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.850', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.066', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'ARMOR': '0.455', 'weapon4': '0.462', 'weapon2': '0.572', 'WEAPON3': '1.550', 'weapon3': '2.676', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:44,415][52803] DAMAGECOUNT value on done: 65157.0 [2024-08-05 23:55:44,418][52803] Sum rewards: 39.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.831', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.231', 'weapon4': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.710', 'ARMOR': '0.854', 'WEAPON3': '1.500', 'HITCOUNT': '2.550', 'weapon3': '2.828', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '36.000'} [2024-08-05 23:55:45,921][52671] DAMAGECOUNT value on done: 66527.0 [2024-08-05 23:55:45,921][52671] Sum rewards: 39.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.893', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.194', 'AMMO3': '0.241', 'ARMOR': '0.472', 'weapon2': '0.700', 'WEAPON3': '1.500', 'HITCOUNT': '2.430', 'weapon3': '2.796', 'DAMAGECOUNT': '11.346', 'FRAGCOUNT': '35.000'} [2024-08-05 23:55:46,283][52659] DAMAGECOUNT value on done: 64333.0 [2024-08-05 23:55:46,284][52659] Sum rewards: 44.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.052', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.145', 'weapon2': '0.440', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '3.144', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '36.000'} [2024-08-05 23:55:46,409][52811] DAMAGECOUNT value on done: 63500.0 [2024-08-05 23:55:46,409][52811] Sum rewards: 56.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.618', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.223', 'weapon2': '0.472', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.274', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '48.000'} [2024-08-05 23:55:46,511][52664] DAMAGECOUNT value on done: 66981.0 [2024-08-05 23:55:46,512][52664] Sum rewards: 48.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.554', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.234', 'weapon4': '0.428', 'WEAPON4': '0.450', 'ARMOR': '0.485', 'weapon2': '0.710', 'WEAPON3': '1.450', 'weapon3': '2.598', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:47,139][52820] DAMAGECOUNT value on done: 60971.0 [2024-08-05 23:55:47,139][52820] Sum rewards: 28.640, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.852', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.198', 'AMMO4': '0.235', 'weapon5': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON4': '0.500', 'ARMOR': '0.854', 'weapon2': '1.016', 'WEAPON3': '1.200', 'weapon3': '2.040', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '9.324', 'FRAGCOUNT': '26.000'} [2024-08-05 23:55:47,476][52803] DAMAGECOUNT value on done: 60410.0 [2024-08-05 23:55:47,476][52803] Sum rewards: 40.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.014', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO4': '0.144', 'AMMO3': '0.157', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.919', 'weapon2': '0.978', 'WEAPON3': '1.000', 'weapon3': '2.374', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '10.185', 'FRAGCOUNT': '35.000'} [2024-08-05 23:55:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 153354240. Throughput: 0: 4398.2. Samples: 38338560. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-05 23:55:47,794][52567] Avg episode reward: [(0, '44.554')] [2024-08-05 23:55:47,798][52614] Saving new best policy, reward=44.554! [2024-08-05 23:55:48,120][52650] Updated weights for policy 0, policy_version 18721 (0.0032) [2024-08-05 23:55:49,110][52671] DAMAGECOUNT value on done: 64263.0 [2024-08-05 23:55:49,110][52671] Sum rewards: 44.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.186', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.662', 'weapon2': '0.716', 'ARMOR': '0.863', 'WEAPON3': '1.150', 'weapon3': '2.348', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.946', 'FRAGCOUNT': '39.000'} [2024-08-05 23:55:49,266][52659] DAMAGECOUNT value on done: 61500.0 [2024-08-05 23:55:49,267][52659] Sum rewards: 34.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.171', 'weapon4': '0.284', 'WEAPON4': '0.400', 'ARMOR': '0.458', 'WEAPON3': '1.050', 'weapon2': '1.402', 'HITCOUNT': '1.940', 'weapon3': '2.042', 'DAMAGECOUNT': '9.177', 'FRAGCOUNT': '31.000'} [2024-08-05 23:55:49,484][52664] DAMAGECOUNT value on done: 68105.0 [2024-08-05 23:55:49,484][52664] Sum rewards: 46.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.354', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.151', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon4': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '42.000'} [2024-08-05 23:55:49,492][52811] DAMAGECOUNT value on done: 58866.0 [2024-08-05 23:55:49,492][52811] Sum rewards: 44.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.574', 'ARMOR': '0.856', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.040', 'DAMAGECOUNT': '11.619', 'FRAGCOUNT': '37.000'} [2024-08-05 23:55:50,507][52803] DAMAGECOUNT value on done: 59981.0 [2024-08-05 23:55:50,507][52803] Sum rewards: 32.397, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.008', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.516', 'weapon4': '0.542', 'ARMOR': '0.883', 'WEAPON3': '1.450', 'HITCOUNT': '2.280', 'weapon3': '2.588', 'DAMAGECOUNT': '9.666', 'FRAGCOUNT': '32.000'} [2024-08-05 23:55:51,898][52671] DAMAGECOUNT value on done: 62711.0 [2024-08-05 23:55:51,898][52671] Sum rewards: 44.613, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.058', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.614', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '3.294', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '38.000'} [2024-08-05 23:55:52,147][52659] DAMAGECOUNT value on done: 64377.0 [2024-08-05 23:55:52,147][52659] Sum rewards: 51.244, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.582', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.122', 'weapon5': '0.140', 'AMMO4': '0.163', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.514', 'WEAPON3': '0.800', 'weapon2': '0.978', 'weapon3': '2.178', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '40.000'} [2024-08-05 23:55:52,557][52811] DAMAGECOUNT value on done: 61042.0 [2024-08-05 23:55:52,559][52811] Sum rewards: 39.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.642', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.217', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.824', 'WEAPON3': '1.300', 'weapon3': '2.660', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '34.000'} [2024-08-05 23:55:52,679][52664] DAMAGECOUNT value on done: 66654.0 [2024-08-05 23:55:52,682][52664] Sum rewards: 35.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.538', 'AMMO5': '0.005', 'AMMO2': '0.053', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'AMMO4': '0.263', 'WEAPON4': '0.600', 'weapon2': '0.652', 'weapon4': '0.914', 'ARMOR': '0.971', 'WEAPON3': '1.250', 'weapon3': '2.066', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '33.000'} [2024-08-05 23:55:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 153436160. Throughput: 0: 4385.1. Samples: 38364670. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 23:55:52,795][52567] Avg episode reward: [(0, '44.381')] [2024-08-05 23:55:52,913][52650] Updated weights for policy 0, policy_version 18731 (0.0012) [2024-08-05 23:55:53,532][52803] DAMAGECOUNT value on done: 63465.0 [2024-08-05 23:55:53,536][52803] Sum rewards: 56.674, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.335', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.150', 'WEAPON4': '0.400', 'weapon2': '0.580', 'weapon4': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.636', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '46.000'} [2024-08-05 23:55:55,233][52659] DAMAGECOUNT value on done: 65637.0 [2024-08-05 23:55:55,233][52659] Sum rewards: 49.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'ARMOR': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.280', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '43.000'} [2024-08-05 23:55:55,652][52664] DAMAGECOUNT value on done: 65279.0 [2024-08-05 23:55:55,653][52664] Sum rewards: 35.413, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.014', 'AMMO5': '0.007', 'ARMOR': '0.072', 'AMMO2': '0.075', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'AMMO4': '0.373', 'weapon2': '0.510', 'WEAPON4': '0.750', 'weapon4': '0.872', 'WEAPON3': '1.400', 'weapon3': '2.254', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.959', 'FRAGCOUNT': '36.000'} [2024-08-05 23:55:55,686][52811] DAMAGECOUNT value on done: 61542.0 [2024-08-05 23:55:55,687][52811] Sum rewards: 51.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.532', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.024', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.640', 'WEAPON3': '1.300', 'ARMOR': '1.306', 'HITCOUNT': '2.800', 'weapon3': '3.174', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '46.000'} [2024-08-05 23:55:56,668][52803] DAMAGECOUNT value on done: 61404.0 [2024-08-05 23:55:56,669][52803] Sum rewards: 64.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.426', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.244', 'ARMOR': '0.410', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '54.000'} [2024-08-05 23:55:57,138][52650] Updated weights for policy 0, policy_version 18741 (0.0014) [2024-08-05 23:55:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 153534464. Throughput: 0: 4390.7. Samples: 38391230. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 23:55:57,794][52567] Avg episode reward: [(0, '44.765')] [2024-08-05 23:55:57,797][52614] Saving new best policy, reward=44.765! [2024-08-05 23:55:57,890][52659] DAMAGECOUNT value on done: 69713.0 [2024-08-05 23:55:57,895][52659] Sum rewards: 39.842, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.605', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.084', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon2': '0.900', 'WEAPON3': '1.000', 'HITCOUNT': '2.400', 'weapon3': '2.894', 'DAMAGECOUNT': '9.783', 'FRAGCOUNT': '33.000'} [2024-08-05 23:55:58,411][52664] DAMAGECOUNT value on done: 70726.0 [2024-08-05 23:55:58,413][52664] Sum rewards: 37.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.118', 'AMMO5': '0.007', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon5': '0.186', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.388', 'ARMOR': '0.478', 'weapon2': '0.580', 'WEAPON3': '1.100', 'HITCOUNT': '2.270', 'weapon3': '2.634', 'DAMAGECOUNT': '10.293', 'FRAGCOUNT': '33.000'} [2024-08-05 23:55:58,700][52811] DAMAGECOUNT value on done: 59995.0 [2024-08-05 23:55:58,703][52811] Sum rewards: 50.644, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'HEALTH': '0.016', 'AMMO2': '0.017', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.134', 'weapon4': '0.138', 'WEAPON3': '0.800', 'ARMOR': '0.800', 'weapon2': '1.030', 'weapon3': '2.666', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '41.000'} [2024-08-05 23:55:59,919][52803] DAMAGECOUNT value on done: 62666.0 [2024-08-05 23:55:59,922][52803] Sum rewards: 42.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.803', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.088', 'weapon4': '0.146', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.836', 'ARMOR': '0.856', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.746', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:01,219][52664] DAMAGECOUNT value on done: 66819.0 [2024-08-05 23:56:01,220][52664] Sum rewards: 43.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.228', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.238', 'ARMOR': '0.408', 'weapon2': '0.430', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '3.000', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:01,238][52659] DAMAGECOUNT value on done: 64498.0 [2024-08-05 23:56:01,239][52659] Sum rewards: 44.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.684', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon4': '0.420', 'weapon2': '0.724', 'WEAPON3': '1.400', 'weapon3': '2.530', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:01,800][52811] DAMAGECOUNT value on done: 62901.0 [2024-08-05 23:56:01,802][52811] Sum rewards: 33.469, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.090', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.261', 'ARMOR': '0.457', 'weapon2': '0.742', 'WEAPON3': '1.550', 'HITCOUNT': '2.460', 'weapon3': '2.830', 'DAMAGECOUNT': '10.503', 'FRAGCOUNT': '32.500'} [2024-08-05 23:56:02,244][52649] DAMAGECOUNT value on done: 64174.0 [2024-08-05 23:56:02,245][52649] Sum rewards: 52.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon5': '0.178', 'weapon4': '0.190', 'ARMOR': '0.443', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '42.000'} [2024-08-05 23:56:02,308][52650] Updated weights for policy 0, policy_version 18751 (0.0043) [2024-08-05 23:56:02,415][52614] Signal inference workers to stop experience collection... (3500 times) [2024-08-05 23:56:02,416][52614] Signal inference workers to resume experience collection... (3500 times) [2024-08-05 23:56:02,451][52650] InferenceWorker_p0-w0: stopping experience collection (3500 times) [2024-08-05 23:56:02,456][52650] InferenceWorker_p0-w0: resuming experience collection (3500 times) [2024-08-05 23:56:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 153616384. Throughput: 0: 4376.4. Samples: 38404060. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-05 23:56:02,795][52567] Avg episode reward: [(0, '44.917')] [2024-08-05 23:56:02,844][52614] Saving new best policy, reward=44.917! [2024-08-05 23:56:03,128][52803] DAMAGECOUNT value on done: 60816.0 [2024-08-05 23:56:03,129][52803] Sum rewards: 45.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.118', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.092', 'AMMO3': '0.155', 'ARMOR': '0.460', 'weapon2': '0.826', 'WEAPON3': '1.000', 'HITCOUNT': '2.290', 'weapon3': '2.902', 'DAMAGECOUNT': '10.380', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:03,910][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:56:04,140][52659] DAMAGECOUNT value on done: 64580.0 [2024-08-05 23:56:04,142][52659] Sum rewards: 39.591, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.216', 'weapon4': '0.228', 'WEAPON4': '0.250', 'ARMOR': '0.477', 'weapon2': '1.218', 'WEAPON3': '1.250', 'weapon3': '2.306', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:04,295][52664] DAMAGECOUNT value on done: 63267.0 [2024-08-05 23:56:04,295][52664] Sum rewards: 42.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.060', 'weapon4': '0.118', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'ARMOR': '0.412', 'weapon2': '0.872', 'WEAPON3': '1.350', 'weapon3': '2.738', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:04,913][52811] DAMAGECOUNT value on done: 62612.0 [2024-08-05 23:56:04,916][52811] Sum rewards: 45.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.018', 'weapon4': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'ARMOR': '0.416', 'weapon2': '0.586', 'WEAPON3': '0.950', 'HITCOUNT': '2.390', 'weapon3': '3.256', 'DAMAGECOUNT': '10.935', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:05,151][52649] DAMAGECOUNT value on done: 64589.0 [2024-08-05 23:56:05,151][52649] Sum rewards: 48.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.508', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'ARMOR': '0.408', 'weapon4': '0.448', 'weapon2': '0.950', 'WEAPON3': '1.050', 'weapon3': '2.396', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '39.000'} [2024-08-05 23:56:05,429][52665] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:56:05,740][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:56:06,214][52803] DAMAGECOUNT value on done: 63669.0 [2024-08-05 23:56:06,217][52803] Sum rewards: 47.787, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.738', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.144', 'AMMO3': '0.157', 'weapon4': '0.330', 'WEAPON3': '1.000', 'weapon2': '1.176', 'ARMOR': '1.248', 'weapon3': '2.154', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:06,520][52650] Updated weights for policy 0, policy_version 18761 (0.0045) [2024-08-05 23:56:06,969][52659] DAMAGECOUNT value on done: 66192.0 [2024-08-05 23:56:06,970][52659] Sum rewards: 52.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.046', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.054', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '0.406', 'ARMOR': '0.491', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:07,450][52664] DAMAGECOUNT value on done: 74583.0 [2024-08-05 23:56:07,452][52664] Sum rewards: 48.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.153', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.652', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '43.000'} [2024-08-05 23:56:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 153706496. Throughput: 0: 4381.3. Samples: 38430450. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:56:07,794][52567] Avg episode reward: [(0, '44.926')] [2024-08-05 23:56:07,798][52614] Saving new best policy, reward=44.926! [2024-08-05 23:56:07,969][52794] Large shaping reward 2.572 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-05 23:56:07,983][52811] DAMAGECOUNT value on done: 60416.0 [2024-08-05 23:56:07,985][52811] Sum rewards: 49.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.288', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.120', 'weapon4': '0.138', 'AMMO3': '0.215', 'AMMO4': '0.233', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.734', 'ARMOR': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.716', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.153', 'FRAGCOUNT': '42.500'} [2024-08-05 23:56:08,025][52649] DAMAGECOUNT value on done: 65359.0 [2024-08-05 23:56:08,025][52649] Sum rewards: 56.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.016', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.260', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '48.000'} [2024-08-05 23:56:09,183][52803] DAMAGECOUNT value on done: 58175.0 [2024-08-05 23:56:09,183][52803] Sum rewards: 40.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.218', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON4': '0.600', 'weapon2': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.384', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.647', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:09,709][52659] DAMAGECOUNT value on done: 68207.0 [2024-08-05 23:56:09,710][52659] Sum rewards: 43.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.435', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'AMMO4': '0.199', 'weapon4': '0.412', 'WEAPON4': '0.550', 'ARMOR': '0.916', 'weapon2': '0.920', 'WEAPON3': '1.100', 'weapon3': '2.530', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:10,408][52649] DAMAGECOUNT value on done: 64366.0 [2024-08-05 23:56:10,410][52649] Sum rewards: 54.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.184', 'weapon4': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '2.972', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '46.000'} [2024-08-05 23:56:10,664][52664] DAMAGECOUNT value on done: 69060.0 [2024-08-05 23:56:10,665][52664] Sum rewards: 43.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.086', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'ARMOR': '0.400', 'weapon2': '1.226', 'WEAPON3': '1.250', 'weapon3': '2.528', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:11,096][52811] DAMAGECOUNT value on done: 63029.0 [2024-08-05 23:56:11,098][52811] Sum rewards: 56.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.227', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.083', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'ARMOR': '0.424', 'weapon2': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '48.000'} [2024-08-05 23:56:11,167][52668] DAMAGECOUNT value on done: 64244.0 [2024-08-05 23:56:11,168][52668] Sum rewards: 44.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.199', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.126', 'weapon5': '0.196', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'ARMOR': '0.448', 'weapon2': '0.522', 'WEAPON4': '0.550', 'weapon4': '0.704', 'WEAPON3': '0.900', 'weapon3': '2.244', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:11,616][52650] Updated weights for policy 0, policy_version 18771 (0.0010) [2024-08-05 23:56:12,014][52662] DAMAGECOUNT value on done: 70768.0 [2024-08-05 23:56:12,016][52662] Sum rewards: 41.794, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.016', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.804', 'ARMOR': '0.914', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '2.874', 'DAMAGECOUNT': '11.199', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:12,232][52803] DAMAGECOUNT value on done: 64591.0 [2024-08-05 23:56:12,234][52803] Sum rewards: 49.592, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.056', 'AMMO4': '0.075', 'HEALTH': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon2': '0.598', 'WEAPON3': '0.950', 'HITCOUNT': '2.540', 'weapon3': '3.160', 'DAMAGECOUNT': '11.412', 'FRAGCOUNT': '40.000'} [2024-08-05 23:56:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 153796608. Throughput: 0: 4386.5. Samples: 38457130. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:56:12,794][52567] Avg episode reward: [(0, '45.766')] [2024-08-05 23:56:12,795][52614] Saving new best policy, reward=45.766! [2024-08-05 23:56:13,608][52649] DAMAGECOUNT value on done: 62158.0 [2024-08-05 23:56:13,609][52649] Sum rewards: 49.783, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.064', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.271', 'ARMOR': '0.400', 'weapon2': '0.770', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '2.916', 'DAMAGECOUNT': '11.622', 'FRAGCOUNT': '48.000'} [2024-08-05 23:56:13,980][52664] DAMAGECOUNT value on done: 71356.0 [2024-08-05 23:56:13,980][52664] Sum rewards: 58.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.037', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.040', 'AMMO4': '0.066', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.216', 'weapon2': '0.692', 'WEAPON3': '1.200', 'ARMOR': '1.254', 'weapon3': '2.968', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '48.000'} [2024-08-05 23:56:14,271][52668] DAMAGECOUNT value on done: 68553.0 [2024-08-05 23:56:14,271][52668] Sum rewards: 45.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.384', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.170', 'weapon4': '0.174', 'WEAPON4': '0.350', 'ARMOR': '0.889', 'weapon2': '0.990', 'WEAPON3': '1.000', 'HITCOUNT': '2.470', 'weapon3': '2.674', 'DAMAGECOUNT': '10.992', 'FRAGCOUNT': '39.000'} [2024-08-05 23:56:14,301][52811] DAMAGECOUNT value on done: 61031.0 [2024-08-05 23:56:14,302][52811] Sum rewards: 41.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.162', 'weapon5': '0.186', 'AMMO4': '0.285', 'weapon4': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:14,587][52662] DAMAGECOUNT value on done: 72801.0 [2024-08-05 23:56:14,587][52662] Sum rewards: 49.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.190', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.146', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:15,403][52803] DAMAGECOUNT value on done: 61854.0 [2024-08-05 23:56:15,404][52803] Sum rewards: 36.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.820', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.518', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '2.904', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '33.000'} [2024-08-05 23:56:15,855][52650] Updated weights for policy 0, policy_version 18781 (0.0025) [2024-08-05 23:56:16,577][52664] DAMAGECOUNT value on done: 67178.0 [2024-08-05 23:56:16,577][52664] Sum rewards: 49.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.285', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon5': '0.034', 'AMMO4': '0.126', 'weapon4': '0.206', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.492', 'ARMOR': '0.915', 'WEAPON3': '1.550', 'HITCOUNT': '2.920', 'weapon3': '3.040', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:16,620][52649] DAMAGECOUNT value on done: 61527.0 [2024-08-05 23:56:16,620][52649] Sum rewards: 42.330, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.035', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.034', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.690', 'ARMOR': '0.908', 'WEAPON3': '1.600', 'HITCOUNT': '2.510', 'weapon3': '2.728', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '40.000'} [2024-08-05 23:56:16,879][52794] DAMAGECOUNT value on done: 72057.0 [2024-08-05 23:56:16,879][52794] Sum rewards: 57.930, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.314', 'AMMO2': '0.025', 'ARMOR': '0.032', 'weapon4': '0.118', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.301', 'weapon2': '0.540', 'WEAPON3': '1.800', 'weapon3': '3.108', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '52.000'} [2024-08-05 23:56:17,541][52662] DAMAGECOUNT value on done: 74904.0 [2024-08-05 23:56:17,545][52662] Sum rewards: 47.110, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.142', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.178', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.394', 'ARMOR': '0.470', 'WEAPON3': '1.700', 'HITCOUNT': '2.940', 'weapon3': '3.204', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:17,573][52668] DAMAGECOUNT value on done: 62943.0 [2024-08-05 23:56:17,575][52668] Sum rewards: 47.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.516', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '40.500'} [2024-08-05 23:56:17,588][52811] DAMAGECOUNT value on done: 64656.0 [2024-08-05 23:56:17,593][52811] Sum rewards: 44.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.575', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.154', 'AMMO4': '0.159', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '2.972', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 153878528. Throughput: 0: 4378.4. Samples: 38470030. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-05 23:56:17,794][52567] Avg episode reward: [(0, '45.641')] [2024-08-05 23:56:18,515][52803] DAMAGECOUNT value on done: 60585.0 [2024-08-05 23:56:18,515][52803] Sum rewards: 39.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.100', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon4': '0.214', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon2': '0.934', 'WEAPON3': '1.200', 'weapon3': '2.512', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:19,531][52664] DAMAGECOUNT value on done: 67618.0 [2024-08-05 23:56:19,532][52664] Sum rewards: 45.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.352', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.216', 'weapon4': '0.420', 'weapon2': '0.498', 'WEAPON4': '0.600', 'ARMOR': '0.862', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:19,736][52794] DAMAGECOUNT value on done: 70412.0 [2024-08-05 23:56:19,736][52794] Sum rewards: 42.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.574', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.482', 'WEAPON3': '1.050', 'HITCOUNT': '2.380', 'weapon3': '2.860', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:19,996][52649] DAMAGECOUNT value on done: 61699.0 [2024-08-05 23:56:19,997][52649] Sum rewards: 55.109, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.022', 'AMMO2': '0.024', 'ARMOR': '0.036', 'AMMO4': '0.119', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'weapon4': '0.394', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.662', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:20,015][52668] DAMAGECOUNT value on done: 64432.0 [2024-08-05 23:56:20,016][52668] Sum rewards: 39.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.875', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.046', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.702', 'ARMOR': '0.952', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.938', 'DAMAGECOUNT': '10.644', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:20,391][52662] DAMAGECOUNT value on done: 66632.0 [2024-08-05 23:56:20,392][52662] Sum rewards: 44.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.141', 'weapon5': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.394', 'WEAPON5': '0.450', 'ARMOR': '0.862', 'WEAPON3': '0.900', 'weapon2': '0.966', 'weapon3': '2.168', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:20,655][52811] DAMAGECOUNT value on done: 59689.0 [2024-08-05 23:56:20,655][52811] Sum rewards: 42.626, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.292', 'WEAPON4': '0.450', 'weapon4': '0.508', 'weapon2': '0.726', 'WEAPON3': '1.700', 'weapon3': '2.474', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '44.000'} [2024-08-05 23:56:20,800][52650] Updated weights for policy 0, policy_version 18791 (0.0032) [2024-08-05 23:56:21,535][52803] DAMAGECOUNT value on done: 61832.0 [2024-08-05 23:56:21,538][52803] Sum rewards: 42.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.064', 'weapon5': '0.120', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.320', 'weapon2': '0.522', 'WEAPON4': '0.650', 'weapon4': '0.714', 'ARMOR': '0.818', 'WEAPON3': '1.150', 'weapon3': '2.416', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:21,853][52664] DAMAGECOUNT value on done: 67535.0 [2024-08-05 23:56:21,854][52664] Sum rewards: 53.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.296', 'ARMOR': '0.467', 'weapon2': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:22,425][52660] DAMAGECOUNT value on done: 65327.0 [2024-08-05 23:56:22,428][52660] Sum rewards: 54.784, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.485', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.129', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON4': '0.200', 'ARMOR': '0.470', 'weapon2': '0.484', 'WEAPON3': '0.850', 'HITCOUNT': '2.840', 'weapon3': '3.036', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '44.000'} [2024-08-05 23:56:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 153968640. Throughput: 0: 4380.7. Samples: 38496530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:56:22,794][52567] Avg episode reward: [(0, '45.837')] [2024-08-05 23:56:22,795][52614] Saving new best policy, reward=45.837! [2024-08-05 23:56:22,856][52649] DAMAGECOUNT value on done: 67005.0 [2024-08-05 23:56:22,856][52649] Sum rewards: 40.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.221', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon5': '0.356', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.350', 'HITCOUNT': '2.520', 'weapon3': '2.670', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:22,925][52794] DAMAGECOUNT value on done: 68406.0 [2024-08-05 23:56:22,927][52794] Sum rewards: 49.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.351', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.045', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.512', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.814', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '43.000'} [2024-08-05 23:56:23,054][52668] DAMAGECOUNT value on done: 65420.0 [2024-08-05 23:56:23,056][52668] Sum rewards: 50.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.476', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.106', 'AMMO4': '0.175', 'AMMO3': '0.176', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.772', 'ARMOR': '0.903', 'WEAPON3': '1.150', 'weapon3': '2.648', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '44.000'} [2024-08-05 23:56:23,534][52662] DAMAGECOUNT value on done: 68510.0 [2024-08-05 23:56:23,534][52662] Sum rewards: 35.216, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.154', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.226', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.742', 'WEAPON3': '1.550', 'HITCOUNT': '2.590', 'weapon3': '2.970', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '34.000'} [2024-08-05 23:56:23,829][52811] DAMAGECOUNT value on done: 62987.0 [2024-08-05 23:56:23,830][52811] Sum rewards: 40.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.832', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.019', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.628', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.006', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:24,524][52803] DAMAGECOUNT value on done: 60634.0 [2024-08-05 23:56:24,525][52803] Sum rewards: 56.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.170', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '47.000'} [2024-08-05 23:56:24,883][52664] DAMAGECOUNT value on done: 69965.0 [2024-08-05 23:56:24,885][52664] Sum rewards: 48.512, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.395', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.091', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'weapon2': '0.528', 'weapon4': '0.590', 'WEAPON3': '0.950', 'weapon3': '2.574', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:25,258][52650] Updated weights for policy 0, policy_version 18801 (0.0013) [2024-08-05 23:56:25,285][52660] DAMAGECOUNT value on done: 68697.0 [2024-08-05 23:56:25,285][52660] Sum rewards: 49.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '2.590', 'weapon3': '2.994', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:25,663][52649] DAMAGECOUNT value on done: 61688.0 [2024-08-05 23:56:25,664][52649] Sum rewards: 48.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.428', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.133', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.976', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '43.000'} [2024-08-05 23:56:25,772][52668] DAMAGECOUNT value on done: 66598.0 [2024-08-05 23:56:25,774][52668] Sum rewards: 40.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.319', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.310', 'ARMOR': '0.471', 'weapon2': '0.578', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.976', 'DAMAGECOUNT': '10.245', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:25,963][52794] DAMAGECOUNT value on done: 66282.0 [2024-08-05 23:56:25,963][52794] Sum rewards: 52.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.269', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.212', 'weapon4': '0.370', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'weapon2': '0.758', 'WEAPON3': '1.350', 'weapon3': '2.544', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '46.000'} [2024-08-05 23:56:26,752][52662] DAMAGECOUNT value on done: 70402.0 [2024-08-05 23:56:26,752][52662] Sum rewards: 36.582, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.030', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '34.000'} [2024-08-05 23:56:26,855][52811] DAMAGECOUNT value on done: 61193.0 [2024-08-05 23:56:26,855][52811] Sum rewards: 52.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.685', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.183', 'AMMO4': '0.216', 'weapon4': '0.298', 'weapon5': '0.336', 'ARMOR': '0.420', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.278', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:27,481][52664] DAMAGECOUNT value on done: 64968.0 [2024-08-05 23:56:27,481][52664] Sum rewards: 45.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.567', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon4': '0.244', 'weapon2': '0.888', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.373', 'FRAGCOUNT': '39.000'} [2024-08-05 23:56:27,588][52803] DAMAGECOUNT value on done: 58766.0 [2024-08-05 23:56:27,590][52803] Sum rewards: 49.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon4': '0.552', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '2.536', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '43.000'} [2024-08-05 23:56:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 154058752. Throughput: 0: 4370.9. Samples: 38522530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-05 23:56:27,794][52567] Avg episode reward: [(0, '46.008')] [2024-08-05 23:56:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018806_154058752.pth... [2024-08-05 23:56:27,845][52660] DAMAGECOUNT value on done: 67214.0 [2024-08-05 23:56:27,846][52660] Sum rewards: 42.945, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.525', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon5': '0.106', 'weapon4': '0.128', 'AMMO4': '0.173', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.702', 'WEAPON3': '1.650', 'HITCOUNT': '2.740', 'weapon3': '2.762', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '40.500'} [2024-08-05 23:56:27,945][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018292_149848064.pth [2024-08-05 23:56:27,956][52614] Saving new best policy, reward=46.008! [2024-08-05 23:56:28,534][52668] DAMAGECOUNT value on done: 67103.0 [2024-08-05 23:56:28,536][52668] Sum rewards: 39.774, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.026', 'weapon5': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.155', 'ARMOR': '0.865', 'WEAPON3': '0.950', 'weapon2': '1.172', 'HITCOUNT': '2.290', 'weapon3': '2.648', 'DAMAGECOUNT': '10.011', 'FRAGCOUNT': '32.000'} [2024-08-05 23:56:28,716][52649] DAMAGECOUNT value on done: 62901.0 [2024-08-05 23:56:28,718][52649] Sum rewards: 53.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.977', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.156', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'weapon4': '0.364', 'WEAPON4': '0.450', 'weapon2': '0.790', 'WEAPON3': '1.050', 'ARMOR': '1.266', 'weapon3': '2.356', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:29,121][52794] DAMAGECOUNT value on done: 68239.0 [2024-08-05 23:56:29,123][52794] Sum rewards: 38.890, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon4': '0.390', 'weapon2': '0.662', 'ARMOR': '0.862', 'WEAPON3': '1.400', 'HITCOUNT': '2.670', 'weapon3': '2.678', 'DAMAGECOUNT': '12.066', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:29,616][52662] DAMAGECOUNT value on done: 72237.0 [2024-08-05 23:56:29,616][52662] Sum rewards: 50.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.748', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.248', 'ARMOR': '0.460', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '44.000'} [2024-08-05 23:56:30,002][52811] DAMAGECOUNT value on done: 62353.0 [2024-08-05 23:56:30,002][52811] Sum rewards: 48.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'AMMO2': '0.028', 'ARMOR': '0.032', 'weapon5': '0.106', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.318', 'WEAPON4': '0.400', 'weapon2': '0.814', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.544', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '42.000'} [2024-08-05 23:56:30,316][52650] Updated weights for policy 0, policy_version 18811 (0.0034) [2024-08-05 23:56:30,631][52664] DAMAGECOUNT value on done: 68969.0 [2024-08-05 23:56:30,631][52664] Sum rewards: 47.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.023', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.106', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.378', 'ARMOR': '0.412', 'weapon2': '0.638', 'WEAPON3': '1.400', 'weapon3': '2.664', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:30,736][52803] DAMAGECOUNT value on done: 62101.0 [2024-08-05 23:56:30,738][52803] Sum rewards: 34.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.452', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon5': '0.270', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.780', 'ARMOR': '0.855', 'WEAPON3': '1.200', 'weapon3': '2.176', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.861', 'FRAGCOUNT': '32.000'} [2024-08-05 23:56:30,849][52660] DAMAGECOUNT value on done: 65650.0 [2024-08-05 23:56:30,849][52660] Sum rewards: 50.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.094', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.082', 'AMMO3': '0.122', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'ARMOR': '0.444', 'WEAPON4': '0.450', 'weapon4': '0.508', 'WEAPON3': '0.700', 'weapon2': '0.800', 'weapon3': '2.420', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:31,259][52649] DAMAGECOUNT value on done: 64753.0 [2024-08-05 23:56:31,259][52649] Sum rewards: 50.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.325', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO4': '0.142', 'AMMO3': '0.143', 'WEAPON4': '0.300', 'ARMOR': '0.420', 'weapon2': '0.724', 'WEAPON3': '0.900', 'HITCOUNT': '2.610', 'weapon3': '2.996', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '43.000'} [2024-08-05 23:56:31,306][52668] DAMAGECOUNT value on done: 67657.0 [2024-08-05 23:56:31,308][52668] Sum rewards: 40.403, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.094', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'ARMOR': '0.459', 'weapon2': '0.524', 'WEAPON3': '1.400', 'HITCOUNT': '2.580', 'weapon3': '3.080', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:32,367][52794] DAMAGECOUNT value on done: 71862.0 [2024-08-05 23:56:32,367][52794] Sum rewards: 42.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.017', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.516', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.790', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 154140672. Throughput: 0: 4377.3. Samples: 38535540. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:56:32,794][52567] Avg episode reward: [(0, '45.651')] [2024-08-05 23:56:32,881][52662] DAMAGECOUNT value on done: 75975.0 [2024-08-05 23:56:32,882][52662] Sum rewards: 35.814, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.606', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.140', 'AMMO3': '0.185', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.348', 'ARMOR': '0.460', 'WEAPON4': '0.500', 'weapon2': '0.930', 'WEAPON3': '1.050', 'HITCOUNT': '2.220', 'weapon3': '2.318', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '33.000'} [2024-08-05 23:56:33,094][52664] DAMAGECOUNT value on done: 67548.0 [2024-08-05 23:56:33,094][52664] Sum rewards: 51.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.196', 'AMMO3': '0.241', 'weapon2': '0.360', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.254', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:33,158][52811] DAMAGECOUNT value on done: 61620.0 [2024-08-05 23:56:33,161][52811] Sum rewards: 46.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.375', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.062', 'AMMO4': '0.099', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '1.006', 'WEAPON3': '1.250', 'ARMOR': '1.818', 'weapon3': '2.582', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '39.500'} [2024-08-05 23:56:33,762][52647] DAMAGECOUNT value on done: 68976.0 [2024-08-05 23:56:33,762][52647] Sum rewards: 53.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.234', 'weapon2': '0.462', 'ARMOR': '0.473', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.016', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '44.000'} [2024-08-05 23:56:33,828][52660] DAMAGECOUNT value on done: 62384.0 [2024-08-05 23:56:33,829][52660] Sum rewards: 38.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.965', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.038', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO4': '0.172', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'weapon2': '0.690', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.866', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '33.500'} [2024-08-05 23:56:33,837][52803] DAMAGECOUNT value on done: 61332.0 [2024-08-05 23:56:33,837][52803] Sum rewards: 47.543, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.426', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.177', 'weapon4': '0.184', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.070', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '43.000'} [2024-08-05 23:56:34,358][52649] DAMAGECOUNT value on done: 64066.0 [2024-08-05 23:56:34,358][52649] Sum rewards: 25.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO3': '0.166', 'AMMO4': '0.184', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'ARMOR': '0.456', 'weapon2': '0.748', 'WEAPON3': '1.100', 'HITCOUNT': '2.030', 'weapon3': '2.578', 'DAMAGECOUNT': '8.283', 'FRAGCOUNT': '23.500'} [2024-08-05 23:56:34,527][52668] DAMAGECOUNT value on done: 66409.0 [2024-08-05 23:56:34,529][52668] Sum rewards: 59.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.040', 'AMMO4': '0.129', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.078', 'weapon3': '2.484', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '47.000'} [2024-08-05 23:56:34,840][52650] Updated weights for policy 0, policy_version 18821 (0.0025) [2024-08-05 23:56:35,420][52794] DAMAGECOUNT value on done: 72524.0 [2024-08-05 23:56:35,422][52794] Sum rewards: 49.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.338', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.174', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.266', 'ARMOR': '0.503', 'weapon2': '0.542', 'WEAPON3': '1.350', 'weapon3': '2.708', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '42.000'} [2024-08-05 23:56:35,456][52664] DAMAGECOUNT value on done: 68063.0 [2024-08-05 23:56:35,459][52664] Sum rewards: 34.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.602', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.022', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.714', 'ARMOR': '0.853', 'weapon2': '0.970', 'WEAPON3': '1.300', 'weapon3': '1.980', 'HITCOUNT': '2.100', 'DAMAGECOUNT': '9.399', 'FRAGCOUNT': '31.000'} [2024-08-05 23:56:35,878][52662] DAMAGECOUNT value on done: 68047.0 [2024-08-05 23:56:35,878][52662] Sum rewards: 55.319, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.555', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.072', 'weapon4': '0.120', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.150', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '47.000'} [2024-08-05 23:56:36,070][52647] DAMAGECOUNT value on done: 68240.0 [2024-08-05 23:56:36,074][52647] Sum rewards: 50.235, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon5': '0.140', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'ARMOR': '0.412', 'weapon4': '0.446', 'weapon2': '0.716', 'WEAPON3': '0.750', 'weapon3': '2.262', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '40.000'} [2024-08-05 23:56:36,236][52811] DAMAGECOUNT value on done: 62228.0 [2024-08-05 23:56:36,236][52811] Sum rewards: 36.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.160', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.207', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON3': '1.450', 'HITCOUNT': '2.460', 'weapon3': '2.984', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:36,974][52803] DAMAGECOUNT value on done: 63125.0 [2024-08-05 23:56:36,975][52803] Sum rewards: 50.913, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.322', 'AMMO5': '0.007', 'AMMO2': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon2': '0.434', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '3.032', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:37,180][52660] DAMAGECOUNT value on done: 66209.0 [2024-08-05 23:56:37,182][52660] Sum rewards: 48.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'AMMO2': '0.030', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.178', 'weapon4': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.742', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.872', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '43.000'} [2024-08-05 23:56:37,283][52649] DAMAGECOUNT value on done: 66135.0 [2024-08-05 23:56:37,283][52649] Sum rewards: 41.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.551', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.178', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.402', 'ARMOR': '0.479', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '3.032', 'DAMAGECOUNT': '10.779', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 154230784. Throughput: 0: 4383.6. Samples: 38561930. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:56:37,794][52567] Avg episode reward: [(0, '46.100')] [2024-08-05 23:56:37,797][52614] Saving new best policy, reward=46.100! [2024-08-05 23:56:37,845][52668] DAMAGECOUNT value on done: 68599.0 [2024-08-05 23:56:37,848][52668] Sum rewards: 43.400, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.319', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.104', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.446', 'weapon2': '0.550', 'ARMOR': '0.936', 'WEAPON3': '1.750', 'weapon3': '2.548', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '40.000'} [2024-08-05 23:56:37,976][52794] DAMAGECOUNT value on done: 67912.0 [2024-08-05 23:56:37,976][52794] Sum rewards: 52.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.015', 'AMMO5': '0.009', 'AMMO2': '0.021', 'ARMOR': '0.024', 'AMMO4': '0.105', 'weapon5': '0.136', 'weapon4': '0.140', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.826', 'WEAPON3': '1.350', 'weapon3': '2.670', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '46.000'} [2024-08-05 23:56:38,201][52664] DAMAGECOUNT value on done: 68138.0 [2024-08-05 23:56:38,201][52664] Sum rewards: 57.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.090', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.346', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.194', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '51.000'} [2024-08-05 23:56:38,543][52662] DAMAGECOUNT value on done: 70148.0 [2024-08-05 23:56:38,543][52662] Sum rewards: 35.655, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.293', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.068', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.292', 'weapon4': '0.354', 'WEAPON4': '0.400', 'ARMOR': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.750', 'HITCOUNT': '2.510', 'weapon3': '2.732', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:38,862][52647] DAMAGECOUNT value on done: 72778.0 [2024-08-05 23:56:38,863][52647] Sum rewards: 43.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.160', 'AMMO3': '0.192', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'ARMOR': '0.473', 'WEAPON4': '0.500', 'weapon2': '0.682', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.758', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:39,319][52811] DAMAGECOUNT value on done: 64657.0 [2024-08-05 23:56:39,325][52811] Sum rewards: 39.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.312', 'ARMOR': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.460', 'weapon3': '2.858', 'DAMAGECOUNT': '11.619', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:39,375][52650] Updated weights for policy 0, policy_version 18831 (0.0020) [2024-08-05 23:56:39,966][52803] DAMAGECOUNT value on done: 60860.0 [2024-08-05 23:56:39,966][52803] Sum rewards: 43.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.876', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.199', 'AMMO3': '0.237', 'weapon2': '0.364', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.420', 'weapon3': '2.862', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '40.000'} [2024-08-05 23:56:40,024][52649] DAMAGECOUNT value on done: 65677.0 [2024-08-05 23:56:40,024][52649] Sum rewards: 42.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.748', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.134', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon4': '0.572', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:40,390][52660] DAMAGECOUNT value on done: 67210.0 [2024-08-05 23:56:40,397][52660] Sum rewards: 55.951, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.979', 'AMMO5': '0.004', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'AMMO4': '0.189', 'weapon4': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.764', 'ARMOR': '0.873', 'WEAPON3': '1.100', 'weapon3': '2.784', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:40,504][52794] DAMAGECOUNT value on done: 70093.0 [2024-08-05 23:56:40,505][52794] Sum rewards: 46.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.636', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.026', 'weapon4': '0.096', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.756', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '2.930', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '41.500'} [2024-08-05 23:56:40,885][52662] DAMAGECOUNT value on done: 69472.0 [2024-08-05 23:56:40,885][52662] Sum rewards: 47.014, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.127', 'AMMO5': '0.007', 'AMMO2': '0.023', 'ARMOR': '0.024', 'weapon5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.538', 'weapon2': '0.810', 'WEAPON3': '0.900', 'weapon3': '2.416', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:41,082][52668] DAMAGECOUNT value on done: 62381.0 [2024-08-05 23:56:41,084][52668] Sum rewards: 27.565, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.815', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon7': '0.066', 'AMMO4': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.610', 'WEAPON3': '0.700', 'weapon4': '1.164', 'HITCOUNT': '1.580', 'weapon3': '1.990', 'DAMAGECOUNT': '6.840', 'FRAGCOUNT': '23.000'} [2024-08-05 23:56:41,802][52647] DAMAGECOUNT value on done: 71166.0 [2024-08-05 23:56:41,803][52647] Sum rewards: 37.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.371', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.168', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.400', 'weapon3': '2.690', 'DAMAGECOUNT': '10.368', 'FRAGCOUNT': '32.000'} [2024-08-05 23:56:42,531][52811] DAMAGECOUNT value on done: 59700.0 [2024-08-05 23:56:42,531][52811] Sum rewards: 42.156, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.038', 'AMMO2': '0.061', 'AMMO3': '0.205', 'AMMO4': '0.307', 'weapon4': '0.544', 'WEAPON4': '0.650', 'weapon2': '0.916', 'WEAPON3': '1.200', 'ARMOR': '1.233', 'weapon3': '2.260', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.698', 'FRAGCOUNT': '40.000'} [2024-08-05 23:56:42,641][52649] DAMAGECOUNT value on done: 59698.0 [2024-08-05 23:56:42,643][52649] Sum rewards: 38.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.102', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.072', 'AMMO4': '0.119', 'AMMO3': '0.213', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '2.850', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 154320896. Throughput: 0: 4380.7. Samples: 38588360. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-05 23:56:42,794][52567] Avg episode reward: [(0, '45.752')] [2024-08-05 23:56:43,109][52660] DAMAGECOUNT value on done: 65152.0 [2024-08-05 23:56:43,110][52660] Sum rewards: 38.124, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.326', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'ARMOR': '0.447', 'weapon2': '0.654', 'WEAPON3': '1.150', 'HITCOUNT': '2.270', 'weapon3': '3.166', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '32.000'} [2024-08-05 23:56:43,342][52794] DAMAGECOUNT value on done: 72824.0 [2024-08-05 23:56:43,349][52794] Sum rewards: 56.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO2': '0.002', 'AMMO4': '0.007', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon4': '0.214', 'ARMOR': '0.452', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '47.000'} [2024-08-05 23:56:43,689][52668] DAMAGECOUNT value on done: 65837.0 [2024-08-05 23:56:43,691][52668] Sum rewards: 42.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.431', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.145', 'AMMO3': '0.191', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.966', 'WEAPON3': '1.100', 'weapon3': '2.426', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:43,814][52662] DAMAGECOUNT value on done: 71977.0 [2024-08-05 23:56:43,816][52662] Sum rewards: 58.103, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.588', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '47.000'} [2024-08-05 23:56:43,954][52650] Updated weights for policy 0, policy_version 18841 (0.0022) [2024-08-05 23:56:44,238][52647] DAMAGECOUNT value on done: 71289.0 [2024-08-05 23:56:44,240][52647] Sum rewards: 39.263, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.877', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.199', 'weapon4': '0.274', 'WEAPON4': '0.350', 'ARMOR': '0.436', 'weapon2': '0.798', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.678', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:45,534][52811] DAMAGECOUNT value on done: 61940.0 [2024-08-05 23:56:45,535][52811] Sum rewards: 43.572, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.034', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.264', 'weapon2': '0.422', 'ARMOR': '0.457', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.130', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:45,617][52660] DAMAGECOUNT value on done: 66691.0 [2024-08-05 23:56:45,617][52660] Sum rewards: 42.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.180', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.138', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'ARMOR': '0.457', 'weapon2': '0.610', 'WEAPON3': '1.450', 'HITCOUNT': '2.370', 'weapon3': '2.858', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:45,698][52649] DAMAGECOUNT value on done: 68110.0 [2024-08-05 23:56:45,698][52649] Sum rewards: 43.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.183', 'weapon4': '0.246', 'ARMOR': '0.408', 'weapon2': '0.712', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.712', 'DAMAGECOUNT': '11.394', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:45,834][52794] DAMAGECOUNT value on done: 70645.0 [2024-08-05 23:56:45,837][52794] Sum rewards: 45.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.231', 'weapon2': '0.408', 'WEAPON3': '1.500', 'HITCOUNT': '2.730', 'weapon3': '3.208', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:46,133][52668] DAMAGECOUNT value on done: 61686.0 [2024-08-05 23:56:46,133][52668] Sum rewards: 41.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.882', 'AMMO5': '0.004', 'AMMO2': '0.051', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.253', 'WEAPON4': '0.500', 'weapon4': '0.574', 'weapon2': '0.824', 'ARMOR': '0.878', 'WEAPON3': '1.250', 'weapon3': '2.378', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.076', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:46,366][52662] DAMAGECOUNT value on done: 72271.0 [2024-08-05 23:56:46,367][52662] Sum rewards: 39.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.186', 'AMMO3': '0.208', 'AMMO4': '0.223', 'WEAPON4': '0.400', 'ARMOR': '0.465', 'weapon2': '0.714', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.822', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '35.000'} [2024-08-05 23:56:46,546][52647] DAMAGECOUNT value on done: 71502.0 [2024-08-05 23:56:46,548][52647] Sum rewards: 53.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.831', 'AMMO5': '0.009', 'AMMO2': '0.019', 'ARMOR': '0.024', 'weapon5': '0.034', 'AMMO4': '0.094', 'weapon4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.126', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '48.000'} [2024-08-05 23:56:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 154411008. Throughput: 0: 4393.1. Samples: 38601750. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:56:47,794][52567] Avg episode reward: [(0, '45.574')] [2024-08-05 23:56:48,459][52794] DAMAGECOUNT value on done: 72140.0 [2024-08-05 23:56:48,469][52794] Sum rewards: 44.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.496', 'ARMOR': '0.870', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.906', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:48,594][52649] DAMAGECOUNT value on done: 62978.0 [2024-08-05 23:56:48,595][52649] Sum rewards: 43.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.234', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.278', 'ARMOR': '0.420', 'weapon2': '0.868', 'WEAPON3': '1.050', 'weapon3': '2.712', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '36.000'} [2024-08-05 23:56:48,608][52660] DAMAGECOUNT value on done: 66741.0 [2024-08-05 23:56:48,608][52660] Sum rewards: 50.720, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.462', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'ARMOR': '0.446', 'weapon2': '0.898', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '46.000'} [2024-08-05 23:56:48,801][52650] Updated weights for policy 0, policy_version 18851 (0.0021) [2024-08-05 23:56:48,854][52795] DAMAGECOUNT value on done: 63279.0 [2024-08-05 23:56:48,854][52795] Sum rewards: 48.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.932', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.048', 'AMMO4': '0.223', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'ARMOR': '0.416', 'weapon2': '0.562', 'WEAPON4': '0.700', 'weapon4': '0.812', 'WEAPON3': '1.450', 'weapon3': '2.306', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '41.000'} [2024-08-05 23:56:48,859][52794] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:56:48,876][52662] DAMAGECOUNT value on done: 68332.0 [2024-08-05 23:56:48,876][52662] Sum rewards: 46.837, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.062', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.240', 'weapon2': '0.746', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.740', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '39.000'} [2024-08-05 23:56:49,369][52668] DAMAGECOUNT value on done: 66301.0 [2024-08-05 23:56:49,370][52668] Sum rewards: 47.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.248', 'ARMOR': '0.400', 'weapon2': '0.724', 'WEAPON3': '1.450', 'HITCOUNT': '2.520', 'weapon3': '2.828', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '42.000'} [2024-08-05 23:56:49,393][52647] DAMAGECOUNT value on done: 69190.0 [2024-08-05 23:56:49,393][52647] Sum rewards: 53.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.454', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.810', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '46.000'} [2024-08-05 23:56:51,244][52649] DAMAGECOUNT value on done: 66614.0 [2024-08-05 23:56:51,245][52649] Sum rewards: 53.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.608', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.077', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'ARMOR': '0.454', 'weapon2': '0.508', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.098', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '46.000'} [2024-08-05 23:56:51,503][52660] DAMAGECOUNT value on done: 65701.0 [2024-08-05 23:56:51,506][52660] Sum rewards: 47.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.607', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.136', 'weapon4': '0.140', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'ARMOR': '0.455', 'weapon2': '0.988', 'WEAPON3': '1.050', 'weapon3': '2.544', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '40.000'} [2024-08-05 23:56:51,684][52794] DAMAGECOUNT value on done: 69783.0 [2024-08-05 23:56:51,686][52794] Sum rewards: 45.047, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.560', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.080', 'AMMO3': '0.212', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.402', 'ARMOR': '0.467', 'WEAPON4': '0.650', 'weapon2': '0.838', 'WEAPON3': '1.250', 'weapon3': '2.396', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '42.000'} [2024-08-05 23:56:51,945][52668] DAMAGECOUNT value on done: 65432.0 [2024-08-05 23:56:51,946][52668] Sum rewards: 36.550, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.792', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.106', 'WEAPON5': '0.200', 'weapon5': '0.226', 'AMMO4': '0.253', 'ARMOR': '0.484', 'WEAPON4': '0.550', 'weapon2': '0.556', 'WEAPON3': '0.650', 'weapon4': '0.782', 'weapon3': '2.194', 'HITCOUNT': '2.210', 'DAMAGECOUNT': '8.820', 'FRAGCOUNT': '30.000'} [2024-08-05 23:56:51,957][52795] DAMAGECOUNT value on done: 57853.0 [2024-08-05 23:56:51,957][52795] Sum rewards: 45.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.181', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.182', 'AMMO3': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.382', 'ARMOR': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '39.000'} [2024-08-05 23:56:52,062][52662] DAMAGECOUNT value on done: 68422.0 [2024-08-05 23:56:52,065][52662] Sum rewards: 56.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.202', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.878', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '48.000'} [2024-08-05 23:56:52,520][52647] DAMAGECOUNT value on done: 70214.0 [2024-08-05 23:56:52,520][52647] Sum rewards: 39.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.234', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.255', 'weapon4': '0.262', 'weapon2': '0.276', 'ARMOR': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.620', 'weapon3': '3.178', 'DAMAGECOUNT': '10.770', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 154501120. Throughput: 0: 4398.0. Samples: 38628360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-05 23:56:52,794][52567] Avg episode reward: [(0, '45.613')] [2024-08-05 23:56:53,002][52650] Updated weights for policy 0, policy_version 18861 (0.0017) [2024-08-05 23:56:54,032][52660] DAMAGECOUNT value on done: 65924.0 [2024-08-05 23:56:54,032][52660] Sum rewards: 57.451, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.102', 'weapon4': '0.120', 'HEALTH': '0.146', 'AMMO3': '0.185', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'ARMOR': '0.432', 'weapon2': '0.506', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.024', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '48.000'} [2024-08-05 23:56:54,032][52649] DAMAGECOUNT value on done: 65449.0 [2024-08-05 23:56:54,035][52649] Sum rewards: 45.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.076', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.222', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '3.110', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '38.000'} [2024-08-05 23:56:54,436][52794] DAMAGECOUNT value on done: 76906.0 [2024-08-05 23:56:54,436][52794] Sum rewards: 50.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'ARMOR': '0.456', 'weapon4': '0.530', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.572', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '44.000'} [2024-08-05 23:56:54,656][52668] DAMAGECOUNT value on done: 66765.0 [2024-08-05 23:56:54,657][52668] Sum rewards: 51.476, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.211', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'AMMO3': '0.211', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.560', 'WEAPON3': '1.200', 'ARMOR': '1.274', 'HITCOUNT': '2.740', 'weapon3': '2.772', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:54,903][52662] DAMAGECOUNT value on done: 72459.0 [2024-08-05 23:56:54,905][52662] Sum rewards: 53.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.152', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.878', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:55,038][52795] DAMAGECOUNT value on done: 59220.0 [2024-08-05 23:56:55,039][52795] Sum rewards: 33.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.514', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon4': '0.628', 'WEAPON4': '0.650', 'ARMOR': '0.929', 'WEAPON3': '1.000', 'weapon2': '1.020', 'weapon3': '1.914', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.530', 'FRAGCOUNT': '30.000'} [2024-08-05 23:56:55,092][52647] DAMAGECOUNT value on done: 71844.0 [2024-08-05 23:56:55,092][52647] Sum rewards: 33.801, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.864', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon5': '0.024', 'weapon4': '0.076', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.662', 'ARMOR': '0.858', 'WEAPON3': '1.550', 'HITCOUNT': '2.370', 'weapon3': '2.996', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '34.000'} [2024-08-05 23:56:56,740][52649] DAMAGECOUNT value on done: 70028.0 [2024-08-05 23:56:56,742][52649] Sum rewards: 54.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.827', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'weapon4': '0.332', 'ARMOR': '0.458', 'weapon2': '0.502', 'WEAPON3': '0.950', 'HITCOUNT': '2.860', 'weapon3': '2.896', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:57,011][52794] DAMAGECOUNT value on done: 67262.0 [2024-08-05 23:56:57,013][52794] Sum rewards: 39.119, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.284', 'weapon2': '0.794', 'WEAPON3': '1.700', 'HITCOUNT': '2.570', 'weapon3': '2.892', 'DAMAGECOUNT': '11.454', 'FRAGCOUNT': '37.000'} [2024-08-05 23:56:57,045][52660] DAMAGECOUNT value on done: 64839.0 [2024-08-05 23:56:57,045][52660] Sum rewards: 67.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.034', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon5': '0.068', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.276', 'WEAPON3': '1.000', 'weapon3': '3.354', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '56.000'} [2024-08-05 23:56:57,344][52669] DAMAGECOUNT value on done: 68466.0 [2024-08-05 23:56:57,345][52669] Sum rewards: 53.522, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.186', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.018', 'AMMO4': '0.036', 'weapon4': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.221', 'ARMOR': '0.443', 'weapon2': '0.444', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.306', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '46.000'} [2024-08-05 23:56:57,392][52662] DAMAGECOUNT value on done: 66514.0 [2024-08-05 23:56:57,393][52662] Sum rewards: 48.436, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.232', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.141', 'AMMO3': '0.230', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '44.000'} [2024-08-05 23:56:57,683][52668] DAMAGECOUNT value on done: 63861.0 [2024-08-05 23:56:57,684][52668] Sum rewards: 33.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.054', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'AMMO3': '0.203', 'WEAPON4': '0.500', 'weapon2': '0.528', 'weapon4': '0.626', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.496', 'DAMAGECOUNT': '9.861', 'FRAGCOUNT': '31.000'} [2024-08-05 23:56:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 154583040. Throughput: 0: 4389.6. Samples: 38654660. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:56:57,794][52567] Avg episode reward: [(0, '45.840')] [2024-08-05 23:56:58,112][52650] Updated weights for policy 0, policy_version 18871 (0.0027) [2024-08-05 23:56:58,175][52647] DAMAGECOUNT value on done: 68001.0 [2024-08-05 23:56:58,175][52647] Sum rewards: 53.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.671', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.812', 'WEAPON3': '1.150', 'ARMOR': '1.332', 'weapon3': '2.750', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '45.000'} [2024-08-05 23:56:58,244][52795] DAMAGECOUNT value on done: 62168.0 [2024-08-05 23:56:58,247][52795] Sum rewards: 39.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.030', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.195', 'weapon4': '0.372', 'WEAPON4': '0.400', 'weapon2': '0.796', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '2.564', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '34.000'} [2024-08-05 23:56:59,991][52794] DAMAGECOUNT value on done: 73225.0 [2024-08-05 23:56:59,992][52794] Sum rewards: 48.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.017', 'AMMO2': '0.039', 'ARMOR': '0.044', 'AMMO3': '0.142', 'AMMO4': '0.193', 'weapon5': '0.324', 'weapon4': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.388', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:00,026][52660] DAMAGECOUNT value on done: 66872.0 [2024-08-05 23:57:00,027][52660] Sum rewards: 43.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.843', 'AMMO5': '0.012', 'ARMOR': '0.044', 'AMMO2': '0.073', 'AMMO3': '0.144', 'weapon5': '0.184', 'WEAPON5': '0.300', 'AMMO4': '0.365', 'weapon2': '0.614', 'weapon4': '0.870', 'WEAPON4': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.040', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:00,252][52669] DAMAGECOUNT value on done: 67423.0 [2024-08-05 23:57:00,252][52669] Sum rewards: 45.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.808', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.076', 'AMMO3': '0.179', 'ARMOR': '0.459', 'weapon2': '0.862', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:00,315][52662] DAMAGECOUNT value on done: 71089.0 [2024-08-05 23:57:00,315][52662] Sum rewards: 46.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.885', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'ARMOR': '0.457', 'weapon2': '0.782', 'WEAPON3': '1.400', 'HITCOUNT': '2.690', 'weapon3': '2.788', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '41.000'} [2024-08-05 23:57:00,574][52668] DAMAGECOUNT value on done: 64032.0 [2024-08-05 23:57:00,574][52668] Sum rewards: 41.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.301', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.244', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '3.156', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:00,711][52647] DAMAGECOUNT value on done: 68218.0 [2024-08-05 23:57:00,712][52647] Sum rewards: 48.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.486', 'weapon4': '0.812', 'WEAPON3': '1.250', 'weapon3': '2.328', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:00,753][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:57:01,568][52795] DAMAGECOUNT value on done: 63468.0 [2024-08-05 23:57:01,568][52795] Sum rewards: 28.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.336', 'ARMOR': '0.800', 'weapon2': '0.980', 'WEAPON3': '1.050', 'HITCOUNT': '1.790', 'weapon3': '2.414', 'DAMAGECOUNT': '7.872', 'FRAGCOUNT': '25.000'} [2024-08-05 23:57:02,522][52650] Updated weights for policy 0, policy_version 18881 (0.0026) [2024-08-05 23:57:02,639][52794] DAMAGECOUNT value on done: 73202.0 [2024-08-05 23:57:02,639][52794] Sum rewards: 45.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.448', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.053', 'weapon5': '0.192', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'weapon2': '0.374', 'weapon4': '0.414', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.724', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 154673152. Throughput: 0: 4397.1. Samples: 38667900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:57:02,794][52567] Avg episode reward: [(0, '45.552')] [2024-08-05 23:57:02,992][52660] DAMAGECOUNT value on done: 72189.0 [2024-08-05 23:57:02,992][52660] Sum rewards: 47.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.104', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.264', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:03,057][52662] DAMAGECOUNT value on done: 71879.0 [2024-08-05 23:57:03,064][52662] Sum rewards: 48.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.490', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.074', 'weapon4': '0.108', 'AMMO4': '0.128', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'ARMOR': '0.469', 'weapon2': '0.954', 'WEAPON3': '1.000', 'weapon3': '2.682', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '41.500'} [2024-08-05 23:57:03,138][52669] DAMAGECOUNT value on done: 67251.0 [2024-08-05 23:57:03,138][52669] Sum rewards: 44.825, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.170', 'AMMO5': '0.015', 'weapon5': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon4': '0.182', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.698', 'ARMOR': '0.804', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '40.500'} [2024-08-05 23:57:03,522][52647] DAMAGECOUNT value on done: 67985.0 [2024-08-05 23:57:03,524][52647] Sum rewards: 43.073, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.360', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon4': '0.346', 'ARMOR': '0.455', 'weapon2': '0.664', 'WEAPON3': '1.500', 'HITCOUNT': '2.590', 'weapon3': '2.698', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:03,611][52668] DAMAGECOUNT value on done: 69260.0 [2024-08-05 23:57:03,612][52668] Sum rewards: 43.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon5': '0.158', 'AMMO3': '0.187', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.808', 'WEAPON3': '1.200', 'weapon3': '2.494', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.304', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:04,157][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:57:04,670][52795] DAMAGECOUNT value on done: 62555.0 [2024-08-05 23:57:04,670][52795] Sum rewards: 49.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.370', 'ARMOR': '0.408', 'weapon2': '0.702', 'WEAPON3': '1.250', 'weapon3': '2.662', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:04,837][52667] DAMAGECOUNT value on done: 66045.0 [2024-08-05 23:57:04,837][52667] Sum rewards: 56.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.004', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.191', 'weapon2': '0.530', 'ARMOR': '0.808', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.160', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '45.000'} [2024-08-05 23:57:05,193][52794] DAMAGECOUNT value on done: 71331.0 [2024-08-05 23:57:05,193][52794] Sum rewards: 47.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.638', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.344', 'weapon2': '0.636', 'ARMOR': '0.808', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '2.750', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:05,516][52660] DAMAGECOUNT value on done: 65348.0 [2024-08-05 23:57:05,517][52660] Sum rewards: 47.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.199', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.199', 'weapon4': '0.330', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon2': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '41.000'} [2024-08-05 23:57:05,558][52662] DAMAGECOUNT value on done: 70158.0 [2024-08-05 23:57:05,559][52662] Sum rewards: 39.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.112', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'weapon4': '0.546', 'WEAPON4': '0.600', 'weapon2': '0.692', 'ARMOR': '0.804', 'WEAPON3': '1.100', 'weapon3': '2.316', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '36.500'} [2024-08-05 23:57:06,027][52669] DAMAGECOUNT value on done: 65854.0 [2024-08-05 23:57:06,028][52669] Sum rewards: 47.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'ARMOR': '0.016', 'weapon4': '0.018', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.144', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.700', 'HITCOUNT': '2.650', 'weapon3': '3.172', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '44.000'} [2024-08-05 23:57:06,116][52647] DAMAGECOUNT value on done: 67142.0 [2024-08-05 23:57:06,116][52647] Sum rewards: 27.216, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.056', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.282', 'WEAPON4': '0.500', 'weapon2': '0.780', 'weapon4': '0.824', 'WEAPON3': '1.100', 'ARMOR': '1.738', 'HITCOUNT': '2.110', 'weapon3': '2.122', 'DAMAGECOUNT': '8.880', 'FRAGCOUNT': '25.000'} [2024-08-05 23:57:06,280][52668] DAMAGECOUNT value on done: 68347.0 [2024-08-05 23:57:06,280][52668] Sum rewards: 53.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.936', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.223', 'ARMOR': '0.464', 'weapon2': '0.830', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '45.000'} [2024-08-05 23:57:07,296][52650] Updated weights for policy 0, policy_version 18891 (0.0021) [2024-08-05 23:57:07,735][52794] DAMAGECOUNT value on done: 74734.0 [2024-08-05 23:57:07,737][52794] Sum rewards: 55.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'ARMOR': '0.456', 'weapon4': '0.488', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '2.632', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '45.000'} [2024-08-05 23:57:07,769][52795] DAMAGECOUNT value on done: 64893.0 [2024-08-05 23:57:07,769][52795] Sum rewards: 34.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.530', 'ARMOR': '0.853', 'WEAPON3': '1.250', 'HITCOUNT': '2.040', 'weapon3': '3.234', 'DAMAGECOUNT': '9.291', 'FRAGCOUNT': '30.000'} [2024-08-05 23:57:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 154763264. Throughput: 0: 4399.8. Samples: 38694520. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-05 23:57:07,794][52567] Avg episode reward: [(0, '45.599')] [2024-08-05 23:57:08,073][52667] DAMAGECOUNT value on done: 69220.0 [2024-08-05 23:57:08,074][52667] Sum rewards: 58.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.482', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.159', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '0.950', 'weapon3': '3.186', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '49.000'} [2024-08-05 23:57:08,455][52647] DAMAGECOUNT value on done: 68073.0 [2024-08-05 23:57:08,456][52647] Sum rewards: 41.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon4': '0.338', 'weapon2': '0.638', 'ARMOR': '0.892', 'WEAPON3': '1.600', 'weapon3': '2.806', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:08,633][52660] DAMAGECOUNT value on done: 67218.0 [2024-08-05 23:57:08,633][52660] Sum rewards: 44.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.397', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.162', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.224', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:08,851][52669] DAMAGECOUNT value on done: 67909.0 [2024-08-05 23:57:08,851][52669] Sum rewards: 42.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.233', 'weapon4': '0.394', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:09,879][52794] DAMAGECOUNT value on done: 70399.0 [2024-08-05 23:57:09,879][52794] Sum rewards: 49.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.266', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.818', 'ARMOR': '0.853', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '2.966', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:10,754][52647] DAMAGECOUNT value on done: 69723.0 [2024-08-05 23:57:10,757][52647] Sum rewards: 40.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.180', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.760', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.626', 'DAMAGECOUNT': '10.131', 'FRAGCOUNT': '37.500'} [2024-08-05 23:57:10,838][52795] DAMAGECOUNT value on done: 62071.0 [2024-08-05 23:57:10,838][52795] Sum rewards: 47.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.595', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.128', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'ARMOR': '0.408', 'weapon2': '0.616', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.888', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:11,137][52667] DAMAGECOUNT value on done: 66027.0 [2024-08-05 23:57:11,137][52667] Sum rewards: 38.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.940', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.148', 'weapon5': '0.236', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'ARMOR': '0.408', 'weapon2': '0.530', 'WEAPON4': '0.700', 'weapon4': '0.716', 'WEAPON3': '1.050', 'HITCOUNT': '2.270', 'weapon3': '2.272', 'DAMAGECOUNT': '9.921', 'FRAGCOUNT': '34.000'} [2024-08-05 23:57:11,422][52669] DAMAGECOUNT value on done: 68645.0 [2024-08-05 23:57:11,424][52669] Sum rewards: 62.275, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.828', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon4': '0.208', 'weapon2': '0.770', 'WEAPON3': '1.050', 'weapon3': '2.586', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '51.000'} [2024-08-05 23:57:11,735][52660] DAMAGECOUNT value on done: 64704.0 [2024-08-05 23:57:11,736][52660] Sum rewards: 35.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.792', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.162', 'AMMO3': '0.226', 'weapon4': '0.330', 'weapon2': '0.516', 'WEAPON3': '1.250', 'HITCOUNT': '2.310', 'weapon3': '2.782', 'DAMAGECOUNT': '9.321', 'FRAGCOUNT': '33.000'} [2024-08-05 23:57:11,737][52650] Updated weights for policy 0, policy_version 18901 (0.0011) [2024-08-05 23:57:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 154845184. Throughput: 0: 4413.8. Samples: 38721150. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 23:57:12,794][52567] Avg episode reward: [(0, '45.631')] [2024-08-05 23:57:13,254][52647] DAMAGECOUNT value on done: 68769.0 [2024-08-05 23:57:13,254][52647] Sum rewards: 43.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.564', 'AMMO5': '0.018', 'weapon5': '0.030', 'AMMO2': '0.042', 'AMMO3': '0.199', 'AMMO4': '0.212', 'weapon4': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.646', 'ARMOR': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.768', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:13,368][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:57:14,051][52795] DAMAGECOUNT value on done: 58470.0 [2024-08-05 23:57:14,051][52795] Sum rewards: 46.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.186', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.944', 'WEAPON3': '1.300', 'ARMOR': '1.372', 'weapon3': '2.448', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:14,069][52667] DAMAGECOUNT value on done: 66282.0 [2024-08-05 23:57:14,069][52667] Sum rewards: 34.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.639', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.132', 'AMMO3': '0.174', 'WEAPON4': '0.400', 'weapon4': '0.600', 'weapon2': '0.798', 'WEAPON3': '1.150', 'weapon3': '2.392', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '9.999', 'FRAGCOUNT': '32.000'} [2024-08-05 23:57:14,252][52669] DAMAGECOUNT value on done: 66948.0 [2024-08-05 23:57:14,252][52669] Sum rewards: 42.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.324', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'weapon4': '0.354', 'ARMOR': '0.461', 'weapon2': '1.020', 'WEAPON3': '1.500', 'weapon3': '2.384', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:15,177][52660] DAMAGECOUNT value on done: 69699.0 [2024-08-05 23:57:15,178][52660] Sum rewards: 57.278, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.411', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'AMMO4': '0.232', 'weapon4': '0.468', 'weapon2': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.668', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '50.000'} [2024-08-05 23:57:16,312][52647] DAMAGECOUNT value on done: 67121.0 [2024-08-05 23:57:16,313][52647] Sum rewards: 39.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.994', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'ARMOR': '0.416', 'weapon2': '0.532', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '3.192', 'DAMAGECOUNT': '10.959', 'FRAGCOUNT': '35.000'} [2024-08-05 23:57:16,480][52650] Updated weights for policy 0, policy_version 18911 (0.0012) [2024-08-05 23:57:16,859][52667] DAMAGECOUNT value on done: 69354.0 [2024-08-05 23:57:16,861][52667] Sum rewards: 42.488, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.215', 'weapon2': '0.736', 'ARMOR': '0.824', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.944', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:17,047][52795] DAMAGECOUNT value on done: 63170.0 [2024-08-05 23:57:17,048][52795] Sum rewards: 59.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.668', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO3': '0.157', 'AMMO4': '0.173', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.812', 'WEAPON3': '0.950', 'weapon3': '2.560', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '49.000'} [2024-08-05 23:57:17,385][52669] DAMAGECOUNT value on done: 66725.0 [2024-08-05 23:57:17,386][52669] Sum rewards: 44.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.900', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.152', 'WEAPON4': '0.300', 'AMMO3': '0.306', 'weapon2': '0.526', 'WEAPON3': '1.900', 'HITCOUNT': '2.970', 'weapon3': '3.066', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '43.000'} [2024-08-05 23:57:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 154943488. Throughput: 0: 4415.1. Samples: 38734220. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 23:57:17,795][52567] Avg episode reward: [(0, '45.659')] [2024-08-05 23:57:18,263][52660] DAMAGECOUNT value on done: 65107.0 [2024-08-05 23:57:18,270][52660] Sum rewards: 37.214, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.148', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.108', 'AMMO3': '0.169', 'AMMO4': '0.215', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'WEAPON3': '0.950', 'weapon2': '1.230', 'weapon3': '2.158', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.263', 'FRAGCOUNT': '33.500'} [2024-08-05 23:57:18,789][52647] DAMAGECOUNT value on done: 68865.0 [2024-08-05 23:57:18,790][52647] Sum rewards: 33.992, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.276', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon2': '0.184', 'weapon4': '0.938', 'WEAPON3': '0.950', 'HITCOUNT': '2.040', 'weapon3': '2.694', 'DAMAGECOUNT': '8.511', 'FRAGCOUNT': '29.000'} [2024-08-05 23:57:19,741][52667] DAMAGECOUNT value on done: 68431.0 [2024-08-05 23:57:19,742][52667] Sum rewards: 47.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.241', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.208', 'ARMOR': '0.416', 'weapon2': '1.024', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:20,122][52795] DAMAGECOUNT value on done: 62590.0 [2024-08-05 23:57:20,123][52795] Sum rewards: 36.229, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'ARMOR': '0.450', 'weapon4': '0.554', 'weapon2': '1.082', 'WEAPON3': '1.100', 'weapon3': '2.044', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.675', 'FRAGCOUNT': '31.500'} [2024-08-05 23:57:20,581][52669] DAMAGECOUNT value on done: 66738.0 [2024-08-05 23:57:20,585][52669] Sum rewards: 46.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.151', 'WEAPON4': '0.300', 'weapon4': '0.346', 'ARMOR': '0.420', 'weapon2': '0.440', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '3.002', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:20,772][52803] Large shaping reward -2.513 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.264, -88.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:57:21,157][52650] Updated weights for policy 0, policy_version 18921 (0.0014) [2024-08-05 23:57:21,357][52647] DAMAGECOUNT value on done: 67972.0 [2024-08-05 23:57:21,358][52647] Sum rewards: 42.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.022', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.228', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.616', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '2.654', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:22,755][52667] DAMAGECOUNT value on done: 67944.0 [2024-08-05 23:57:22,757][52667] Sum rewards: 38.332, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.045', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.226', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'ARMOR': '0.457', 'weapon4': '0.468', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '2.594', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.866', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:22,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 155033600. Throughput: 0: 4419.1. Samples: 38760790. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-05 23:57:22,795][52567] Avg episode reward: [(0, '45.258')] [2024-08-05 23:57:23,107][52795] DAMAGECOUNT value on done: 59719.0 [2024-08-05 23:57:23,107][52795] Sum rewards: 38.620, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.726', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.129', 'weapon4': '0.210', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.214', 'HITCOUNT': '2.260', 'weapon3': '2.366', 'DAMAGECOUNT': '9.255', 'FRAGCOUNT': '32.000'} [2024-08-05 23:57:23,449][52669] DAMAGECOUNT value on done: 64834.0 [2024-08-05 23:57:23,449][52669] Sum rewards: 46.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.854', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.187', 'weapon4': '0.436', 'WEAPON4': '0.450', 'ARMOR': '0.499', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.644', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:24,402][52647] DAMAGECOUNT value on done: 67689.0 [2024-08-05 23:57:24,408][52647] Sum rewards: 44.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.376', 'ARMOR': '0.486', 'weapon2': '0.642', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.824', 'DAMAGECOUNT': '10.791', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:25,704][52650] Updated weights for policy 0, policy_version 18931 (0.0019) [2024-08-05 23:57:26,007][52667] DAMAGECOUNT value on done: 67499.0 [2024-08-05 23:57:26,008][52667] Sum rewards: 36.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.546', 'AMMO5': '0.012', 'AMMO2': '0.050', 'ARMOR': '0.076', 'weapon5': '0.154', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'WEAPON4': '0.500', 'weapon4': '0.538', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.300', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '33.000'} [2024-08-05 23:57:26,274][52795] DAMAGECOUNT value on done: 62580.0 [2024-08-05 23:57:26,274][52795] Sum rewards: 40.233, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.484', 'weapon2': '0.746', 'ARMOR': '0.865', 'WEAPON3': '1.300', 'weapon3': '2.394', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '36.000'} [2024-08-05 23:57:26,362][52669] DAMAGECOUNT value on done: 69677.0 [2024-08-05 23:57:26,363][52669] Sum rewards: 39.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.133', 'AMMO5': '0.008', 'ARMOR': '0.040', 'weapon5': '0.046', 'AMMO2': '0.055', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.250', 'AMMO4': '0.276', 'WEAPON4': '0.550', 'weapon2': '0.936', 'WEAPON3': '0.950', 'HITCOUNT': '2.410', 'weapon3': '2.534', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '36.000'} [2024-08-05 23:57:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 155115520. Throughput: 0: 4420.6. Samples: 38787290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:57:27,795][52567] Avg episode reward: [(0, '44.966')] [2024-08-05 23:57:28,555][52667] DAMAGECOUNT value on done: 66655.0 [2024-08-05 23:57:28,556][52667] Sum rewards: 41.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.651', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.312', 'ARMOR': '0.440', 'weapon2': '0.678', 'WEAPON3': '0.900', 'HITCOUNT': '2.480', 'weapon3': '2.558', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '34.000'} [2024-08-05 23:57:29,012][52669] DAMAGECOUNT value on done: 68805.0 [2024-08-05 23:57:29,012][52669] Sum rewards: 54.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.811', 'AMMO2': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.202', 'weapon2': '0.410', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.214', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '46.000'} [2024-08-05 23:57:29,087][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:57:29,392][52795] DAMAGECOUNT value on done: 64248.0 [2024-08-05 23:57:29,394][52795] Sum rewards: 53.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.943', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.110', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.406', 'ARMOR': '0.428', 'weapon4': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '45.000'} [2024-08-05 23:57:30,318][52650] Updated weights for policy 0, policy_version 18941 (0.0011) [2024-08-05 23:57:30,736][52665] DAMAGECOUNT value on done: 63415.0 [2024-08-05 23:57:30,736][52665] Sum rewards: 32.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.574', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.138', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'ARMOR': '0.474', 'weapon4': '0.520', 'weapon2': '1.024', 'WEAPON3': '1.050', 'weapon3': '2.214', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '9.120', 'FRAGCOUNT': '29.000'} [2024-08-05 23:57:31,422][52667] DAMAGECOUNT value on done: 68135.0 [2024-08-05 23:57:31,422][52667] Sum rewards: 43.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.144', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.018', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.244', 'ARMOR': '0.400', 'weapon2': '0.534', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.000', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:32,011][52669] DAMAGECOUNT value on done: 65584.0 [2024-08-05 23:57:32,011][52669] Sum rewards: 56.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.146', 'weapon5': '0.154', 'AMMO4': '0.239', 'weapon4': '0.300', 'WEAPON5': '0.350', 'ARMOR': '0.449', 'WEAPON4': '0.550', 'weapon2': '0.752', 'WEAPON3': '0.850', 'weapon3': '2.526', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '46.000'} [2024-08-05 23:57:32,482][52795] DAMAGECOUNT value on done: 60222.0 [2024-08-05 23:57:32,482][52795] Sum rewards: 42.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.160', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'weapon2': '0.784', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '10.878', 'FRAGCOUNT': '41.000'} [2024-08-05 23:57:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 155205632. Throughput: 0: 4416.2. Samples: 38800480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-05 23:57:32,794][52567] Avg episode reward: [(0, '45.393')] [2024-08-05 23:57:33,431][52665] DAMAGECOUNT value on done: 70686.0 [2024-08-05 23:57:33,431][52665] Sum rewards: 38.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.174', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'ARMOR': '0.449', 'weapon4': '0.456', 'WEAPON4': '0.500', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.538', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '33.000'} [2024-08-05 23:57:34,545][52667] DAMAGECOUNT value on done: 67894.0 [2024-08-05 23:57:34,549][52667] Sum rewards: 52.240, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.260', 'AMMO3': '0.278', 'ARMOR': '0.404', 'weapon2': '0.576', 'WEAPON3': '1.550', 'weapon3': '2.810', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '49.000'} [2024-08-05 23:57:34,765][52669] DAMAGECOUNT value on done: 68507.0 [2024-08-05 23:57:34,765][52669] Sum rewards: 43.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'AMMO5': '0.003', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon5': '0.188', 'AMMO4': '0.254', 'weapon2': '0.536', 'WEAPON4': '0.550', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.346', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:35,060][52650] Updated weights for policy 0, policy_version 18951 (0.0012) [2024-08-05 23:57:35,597][52795] DAMAGECOUNT value on done: 63160.0 [2024-08-05 23:57:35,599][52795] Sum rewards: 43.737, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.941', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'WEAPON3': '0.950', 'weapon2': '1.206', 'HITCOUNT': '2.320', 'weapon3': '2.498', 'DAMAGECOUNT': '10.059', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:36,339][52665] DAMAGECOUNT value on done: 67423.0 [2024-08-05 23:57:36,340][52665] Sum rewards: 41.338, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.672', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.320', 'ARMOR': '0.400', 'weapon2': '0.798', 'WEAPON3': '1.050', 'HITCOUNT': '2.240', 'weapon3': '2.624', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '35.000'} [2024-08-05 23:57:37,429][52667] DAMAGECOUNT value on done: 66506.0 [2024-08-05 23:57:37,431][52667] Sum rewards: 46.857, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.570', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '3.102', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:37,484][52658] DAMAGECOUNT value on done: 70184.0 [2024-08-05 23:57:37,486][52658] Sum rewards: 61.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.702', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.264', 'weapon2': '0.708', 'ARMOR': '0.884', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '49.000'} [2024-08-05 23:57:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 155295744. Throughput: 0: 4413.5. Samples: 38826970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:57:37,794][52567] Avg episode reward: [(0, '45.526')] [2024-08-05 23:57:38,045][52669] DAMAGECOUNT value on done: 70708.0 [2024-08-05 23:57:38,045][52669] Sum rewards: 49.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.526', 'weapon2': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:38,687][52795] DAMAGECOUNT value on done: 66101.0 [2024-08-05 23:57:38,688][52795] Sum rewards: 40.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.980', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.168', 'AMMO4': '0.198', 'AMMO3': '0.204', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.616', 'WEAPON3': '1.400', 'HITCOUNT': '2.570', 'weapon3': '2.702', 'DAMAGECOUNT': '10.869', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:38,944][52666] DAMAGECOUNT value on done: 67032.0 [2024-08-05 23:57:38,944][52666] Sum rewards: 45.688, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.070', 'weapon4': '0.144', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.400', 'ARMOR': '0.478', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '41.000'} [2024-08-05 23:57:39,336][52650] Updated weights for policy 0, policy_version 18961 (0.0015) [2024-08-05 23:57:39,469][52665] DAMAGECOUNT value on done: 64971.0 [2024-08-05 23:57:39,470][52665] Sum rewards: 41.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.164', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.260', 'AMMO3': '0.264', 'WEAPON4': '0.450', 'ARMOR': '0.466', 'weapon2': '0.470', 'WEAPON3': '1.550', 'HITCOUNT': '2.260', 'weapon3': '2.866', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:40,133][52667] DAMAGECOUNT value on done: 67511.0 [2024-08-05 23:57:40,141][52667] Sum rewards: 45.917, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.089', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.046', 'weapon5': '0.050', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'WEAPON4': '0.600', 'weapon2': '0.788', 'WEAPON3': '0.900', 'weapon4': '0.968', 'weapon3': '1.986', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '11.346', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:40,155][52820] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2024-08-05 23:57:40,276][52658] DAMAGECOUNT value on done: 67285.0 [2024-08-05 23:57:40,277][52658] Sum rewards: 56.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.352', 'ARMOR': '0.447', 'weapon2': '0.652', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '2.764', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '48.000'} [2024-08-05 23:57:40,859][52669] DAMAGECOUNT value on done: 72584.0 [2024-08-05 23:57:40,861][52669] Sum rewards: 49.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.872', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.424', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '3.238', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '43.000'} [2024-08-05 23:57:41,371][52666] DAMAGECOUNT value on done: 68216.0 [2024-08-05 23:57:41,372][52666] Sum rewards: 41.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO2': '0.031', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.360', 'ARMOR': '0.416', 'WEAPON3': '1.100', 'weapon4': '1.170', 'weapon3': '2.022', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '10.755', 'FRAGCOUNT': '35.000'} [2024-08-05 23:57:41,778][52795] DAMAGECOUNT value on done: 59702.0 [2024-08-05 23:57:41,782][52795] Sum rewards: 36.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.059', 'AMMO5': '0.003', 'AMMO2': '0.042', 'AMMO3': '0.178', 'AMMO4': '0.211', 'WEAPON4': '0.450', 'ARMOR': '0.477', 'weapon4': '0.564', 'weapon2': '0.596', 'WEAPON3': '1.000', 'HITCOUNT': '2.390', 'weapon3': '2.630', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '32.000'} [2024-08-05 23:57:42,442][52665] DAMAGECOUNT value on done: 65549.0 [2024-08-05 23:57:42,443][52665] Sum rewards: 54.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.894', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.182', 'weapon4': '0.222', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon2': '0.478', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.816', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '47.000'} [2024-08-05 23:57:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 155385856. Throughput: 0: 4413.1. Samples: 38853250. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:57:42,794][52567] Avg episode reward: [(0, '45.325')] [2024-08-05 23:57:42,885][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-05 23:57:43,072][52667] DAMAGECOUNT value on done: 65421.0 [2024-08-05 23:57:43,072][52667] Sum rewards: 37.486, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.745', 'AMMO2': '0.024', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'AMMO4': '0.120', 'WEAPON4': '0.450', 'weapon2': '0.480', 'WEAPON3': '0.750', 'weapon4': '1.102', 'HITCOUNT': '1.930', 'weapon3': '2.200', 'DAMAGECOUNT': '8.220', 'FRAGCOUNT': '31.000'} [2024-08-05 23:57:43,116][52658] DAMAGECOUNT value on done: 67946.0 [2024-08-05 23:57:43,117][52658] Sum rewards: 58.091, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.848', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'ARMOR': '0.478', 'weapon4': '0.508', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.736', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '50.000'} [2024-08-05 23:57:43,338][52669] DAMAGECOUNT value on done: 68093.0 [2024-08-05 23:57:43,340][52669] Sum rewards: 41.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.132', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'weapon2': '0.596', 'WEAPON3': '0.900', 'HITCOUNT': '2.410', 'weapon3': '3.026', 'DAMAGECOUNT': '10.659', 'FRAGCOUNT': '35.000'} [2024-08-05 23:57:44,057][52666] DAMAGECOUNT value on done: 67459.0 [2024-08-05 23:57:44,057][52666] Sum rewards: 43.434, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.156', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'AMMO4': '0.213', 'AMMO3': '0.240', 'weapon4': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.728', 'WEAPON3': '1.500', 'weapon3': '2.514', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.057', 'FRAGCOUNT': '41.000'} [2024-08-05 23:57:44,502][52650] Updated weights for policy 0, policy_version 18971 (0.0020) [2024-08-05 23:57:44,965][52795] DAMAGECOUNT value on done: 62815.0 [2024-08-05 23:57:44,965][52795] Sum rewards: 43.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.620', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.241', 'weapon2': '0.580', 'WEAPON3': '1.550', 'HITCOUNT': '2.600', 'weapon3': '3.098', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:45,435][52670] DAMAGECOUNT value on done: 64417.0 [2024-08-05 23:57:45,435][52670] Sum rewards: 42.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'ARMOR': '0.432', 'WEAPON4': '0.600', 'weapon4': '0.636', 'weapon2': '0.652', 'WEAPON3': '0.950', 'weapon3': '2.394', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:45,524][52665] DAMAGECOUNT value on done: 68308.0 [2024-08-05 23:57:45,526][52665] Sum rewards: 66.288, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.198', 'weapon4': '0.260', 'AMMO3': '0.276', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.550', 'weapon3': '2.938', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '59.000'} [2024-08-05 23:57:45,897][52658] DAMAGECOUNT value on done: 67286.0 [2024-08-05 23:57:45,897][52658] Sum rewards: 47.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.686', 'WEAPON3': '1.150', 'ARMOR': '1.244', 'HITCOUNT': '2.490', 'weapon3': '2.778', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:45,941][52667] DAMAGECOUNT value on done: 67953.0 [2024-08-05 23:57:45,941][52667] Sum rewards: 44.629, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.827', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.219', 'weapon4': '0.370', 'WEAPON4': '0.500', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '43.000'} [2024-08-05 23:57:45,968][52669] DAMAGECOUNT value on done: 68490.0 [2024-08-05 23:57:45,968][52669] Sum rewards: 49.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.207', 'weapon2': '0.890', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:46,592][52666] DAMAGECOUNT value on done: 61977.0 [2024-08-05 23:57:46,593][52666] Sum rewards: 42.238, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.434', 'ARMOR': '0.914', 'weapon2': '0.950', 'WEAPON3': '1.000', 'weapon3': '2.314', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '9.915', 'FRAGCOUNT': '34.000'} [2024-08-05 23:57:47,100][52663] DAMAGECOUNT value on done: 68503.0 [2024-08-05 23:57:47,101][52663] Sum rewards: 32.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.592', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.140', 'AMMO4': '0.146', 'weapon5': '0.204', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.424', 'WEAPON3': '0.900', 'weapon2': '1.036', 'HITCOUNT': '2.100', 'weapon3': '2.164', 'DAMAGECOUNT': '9.147', 'FRAGCOUNT': '29.000'} [2024-08-05 23:57:47,689][52670] DAMAGECOUNT value on done: 68515.0 [2024-08-05 23:57:47,690][52670] Sum rewards: 56.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.116', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '47.000'} [2024-08-05 23:57:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 155467776. Throughput: 0: 4412.9. Samples: 38866480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-05 23:57:47,795][52567] Avg episode reward: [(0, '45.423')] [2024-08-05 23:57:48,062][52795] DAMAGECOUNT value on done: 65138.0 [2024-08-05 23:57:48,063][52795] Sum rewards: 48.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.498', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.139', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon5': '0.206', 'WEAPON4': '0.350', 'weapon4': '0.718', 'ARMOR': '0.800', 'WEAPON3': '0.850', 'weapon2': '0.860', 'weapon3': '1.964', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '41.000'} [2024-08-05 23:57:48,487][52665] DAMAGECOUNT value on done: 68353.0 [2024-08-05 23:57:48,490][52665] Sum rewards: 50.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO3': '0.150', 'weapon4': '0.160', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.000', 'HITCOUNT': '2.710', 'weapon3': '3.032', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:48,780][52650] Updated weights for policy 0, policy_version 18981 (0.0010) [2024-08-05 23:57:48,784][52669] DAMAGECOUNT value on done: 68305.0 [2024-08-05 23:57:48,784][52669] Sum rewards: 60.659, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.158', 'weapon4': '0.158', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '3.234', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '49.000'} [2024-08-05 23:57:48,872][52658] DAMAGECOUNT value on done: 69601.0 [2024-08-05 23:57:48,872][52658] Sum rewards: 49.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.156', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.452', 'weapon4': '0.572', 'ARMOR': '0.920', 'WEAPON3': '1.200', 'weapon3': '2.640', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:48,905][52667] DAMAGECOUNT value on done: 73175.0 [2024-08-05 23:57:48,905][52667] Sum rewards: 46.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.458', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.046', 'AMMO3': '0.220', 'AMMO4': '0.232', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:49,209][52666] DAMAGECOUNT value on done: 65415.0 [2024-08-05 23:57:49,211][52666] Sum rewards: 49.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.054', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.674', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.058', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '44.000'} [2024-08-05 23:57:50,252][52663] DAMAGECOUNT value on done: 66796.0 [2024-08-05 23:57:50,254][52663] Sum rewards: 38.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.677', 'AMMO2': '0.027', 'ARMOR': '0.040', 'AMMO4': '0.134', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.930', 'WEAPON3': '1.050', 'weapon3': '2.458', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.521', 'FRAGCOUNT': '33.000'} [2024-08-05 23:57:50,728][52670] DAMAGECOUNT value on done: 67388.0 [2024-08-05 23:57:50,730][52670] Sum rewards: 47.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.640', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.303', 'weapon2': '0.402', 'ARMOR': '0.456', 'WEAPON3': '1.900', 'HITCOUNT': '2.960', 'weapon3': '3.344', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '45.000'} [2024-08-05 23:57:51,452][52667] DAMAGECOUNT value on done: 68585.0 [2024-08-05 23:57:51,454][52667] Sum rewards: 52.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.400', 'ARMOR': '0.462', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '46.000'} [2024-08-05 23:57:51,463][52658] DAMAGECOUNT value on done: 64785.0 [2024-08-05 23:57:51,465][52658] Sum rewards: 40.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.990', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'ARMOR': '0.483', 'weapon2': '0.754', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.930', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '38.000'} [2024-08-05 23:57:51,501][52665] DAMAGECOUNT value on done: 68223.0 [2024-08-05 23:57:51,501][52665] Sum rewards: 55.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.055', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.160', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.424', 'weapon2': '0.450', 'ARMOR': '0.475', 'WEAPON3': '1.450', 'weapon3': '2.652', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '49.000'} [2024-08-05 23:57:51,714][52669] DAMAGECOUNT value on done: 68865.0 [2024-08-05 23:57:51,715][52669] Sum rewards: 40.520, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.256', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.066', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'weapon2': '0.378', 'WEAPON4': '0.500', 'weapon4': '0.620', 'WEAPON3': '0.900', 'HITCOUNT': '2.340', 'weapon3': '2.738', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '35.000'} [2024-08-05 23:57:52,206][52666] DAMAGECOUNT value on done: 63760.0 [2024-08-05 23:57:52,209][52666] Sum rewards: 44.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon5': '0.080', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.284', 'weapon2': '0.720', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '2.712', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 155557888. Throughput: 0: 4412.0. Samples: 38893060. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 23:57:52,794][52567] Avg episode reward: [(0, '45.523')] [2024-08-05 23:57:53,267][52663] DAMAGECOUNT value on done: 68663.0 [2024-08-05 23:57:53,267][52663] Sum rewards: 45.439, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.042', 'weapon5': '0.068', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.221', 'WEAPON4': '0.450', 'weapon2': '0.718', 'WEAPON3': '1.350', 'weapon3': '2.734', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:53,561][52670] DAMAGECOUNT value on done: 65849.0 [2024-08-05 23:57:53,561][52670] Sum rewards: 46.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.004', 'AMMO2': '0.036', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.268', 'weapon4': '0.270', 'WEAPON4': '0.400', 'weapon2': '0.574', 'ARMOR': '0.800', 'WEAPON3': '1.600', 'HITCOUNT': '2.570', 'weapon3': '2.788', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '42.000'} [2024-08-05 23:57:53,717][52650] Updated weights for policy 0, policy_version 18991 (0.0026) [2024-08-05 23:57:53,998][52665] DAMAGECOUNT value on done: 70037.0 [2024-08-05 23:57:53,998][52665] Sum rewards: 48.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.807', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.502', 'ARMOR': '0.800', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.050', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:54,510][52667] DAMAGECOUNT value on done: 72194.0 [2024-08-05 23:57:54,512][52658] DAMAGECOUNT value on done: 72537.0 [2024-08-05 23:57:54,511][52667] Sum rewards: 25.197, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.264', 'AMMO5': '0.003', 'ARMOR': '0.028', 'weapon7': '0.048', 'weapon5': '0.048', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.256', 'weapon2': '0.386', 'WEAPON4': '0.600', 'weapon4': '1.172', 'WEAPON3': '1.200', 'HITCOUNT': '2.110', 'weapon3': '2.122', 'DAMAGECOUNT': '8.427', 'FRAGCOUNT': '25.000'} [2024-08-05 23:57:54,514][52658] Sum rewards: 36.395, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.922', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.016', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.177', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.486', 'weapon4': '0.694', 'WEAPON3': '1.250', 'weapon3': '2.530', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '34.500'} [2024-08-05 23:57:54,687][52666] DAMAGECOUNT value on done: 63540.0 [2024-08-05 23:57:54,688][52666] Sum rewards: 38.270, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.321', 'weapon4': '0.520', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon2': '0.970', 'weapon3': '2.330', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '34.000'} [2024-08-05 23:57:55,916][52663] DAMAGECOUNT value on done: 68034.0 [2024-08-05 23:57:55,917][52663] Sum rewards: 42.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.396', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.174', 'ARMOR': '0.412', 'WEAPON4': '0.600', 'weapon4': '0.674', 'weapon2': '0.940', 'WEAPON3': '0.950', 'weapon3': '2.108', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '37.000'} [2024-08-05 23:57:56,021][52670] DAMAGECOUNT value on done: 65194.0 [2024-08-05 23:57:56,022][52670] Sum rewards: 47.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.401', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.195', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.876', 'WEAPON3': '1.150', 'weapon3': '2.402', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:56,590][52665] DAMAGECOUNT value on done: 69114.0 [2024-08-05 23:57:56,590][52665] Sum rewards: 44.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.026', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.436', 'ARMOR': '0.472', 'weapon2': '0.596', 'WEAPON3': '1.400', 'weapon3': '2.620', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '40.000'} [2024-08-05 23:57:57,498][52666] DAMAGECOUNT value on done: 65306.0 [2024-08-05 23:57:57,500][52666] Sum rewards: 46.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'ARMOR': '0.032', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.194', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'weapon4': '0.432', 'weapon2': '0.478', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.700', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:57,726][52667] DAMAGECOUNT value on done: 67033.0 [2024-08-05 23:57:57,726][52667] Sum rewards: 48.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.965', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.740', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '43.000'} [2024-08-05 23:57:57,736][52658] DAMAGECOUNT value on done: 67204.0 [2024-08-05 23:57:57,737][52658] Sum rewards: 41.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'AMMO5': '0.005', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.205', 'weapon4': '0.230', 'weapon5': '0.262', 'WEAPON4': '0.400', 'ARMOR': '0.415', 'WEAPON3': '1.050', 'weapon2': '1.136', 'weapon3': '2.140', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '36.500'} [2024-08-05 23:57:57,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 155648000. Throughput: 0: 4408.9. Samples: 38919550. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 23:57:57,794][52567] Avg episode reward: [(0, '45.189')] [2024-08-05 23:57:58,302][52650] Updated weights for policy 0, policy_version 19001 (0.0027) [2024-08-05 23:57:58,541][52663] DAMAGECOUNT value on done: 65472.0 [2024-08-05 23:57:58,543][52663] Sum rewards: 46.893, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'weapon4': '0.214', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon2': '0.472', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.022', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2024-08-05 23:57:58,733][52670] DAMAGECOUNT value on done: 68808.0 [2024-08-05 23:57:58,734][52670] Sum rewards: 45.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.372', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.280', 'ARMOR': '0.420', 'weapon2': '0.684', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.852', 'DAMAGECOUNT': '10.608', 'FRAGCOUNT': '39.000'} [2024-08-05 23:57:59,772][52665] DAMAGECOUNT value on done: 68526.0 [2024-08-05 23:57:59,772][52665] Sum rewards: 48.102, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.230', 'weapon4': '0.370', 'WEAPON4': '0.400', 'HEALTH': '0.418', 'WEAPON3': '0.750', 'ARMOR': '0.824', 'weapon2': '1.308', 'weapon3': '2.154', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.223', 'FRAGCOUNT': '41.000'} [2024-08-05 23:58:00,364][52666] DAMAGECOUNT value on done: 69023.0 [2024-08-05 23:58:00,366][52666] Sum rewards: 46.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.242', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.108', 'AMMO4': '0.112', 'AMMO3': '0.221', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.400', 'weapon3': '2.772', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '41.000'} [2024-08-05 23:58:00,418][52667] DAMAGECOUNT value on done: 70020.0 [2024-08-05 23:58:00,418][52667] Sum rewards: 50.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.516', 'weapon5': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.096', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:00,481][52658] DAMAGECOUNT value on done: 69247.0 [2024-08-05 23:58:00,482][52658] Sum rewards: 47.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.636', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.212', 'weapon2': '0.422', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.148', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:01,255][52663] DAMAGECOUNT value on done: 69829.0 [2024-08-05 23:58:01,263][52663] Sum rewards: 50.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.894', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.192', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:01,502][52670] DAMAGECOUNT value on done: 64165.0 [2024-08-05 23:58:01,504][52670] Sum rewards: 38.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.068', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO3': '0.216', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '10.572', 'FRAGCOUNT': '36.000'} [2024-08-05 23:58:02,738][52650] Updated weights for policy 0, policy_version 19011 (0.0013) [2024-08-05 23:58:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 155738112. Throughput: 0: 4414.2. Samples: 38932860. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 23:58:02,795][52567] Avg episode reward: [(0, '45.288')] [2024-08-05 23:58:02,853][52666] DAMAGECOUNT value on done: 66612.0 [2024-08-05 23:58:02,855][52666] Sum rewards: 50.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.405', 'AMMO5': '0.003', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO2': '0.058', 'weapon5': '0.066', 'AMMO3': '0.194', 'AMMO4': '0.290', 'weapon4': '0.336', 'weapon2': '0.470', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '2.866', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:02,860][52665] DAMAGECOUNT value on done: 67365.0 [2024-08-05 23:58:02,862][52665] Sum rewards: 46.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.561', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.072', 'AMMO4': '0.134', 'weapon4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'ARMOR': '0.456', 'weapon2': '0.848', 'WEAPON3': '1.500', 'weapon3': '2.674', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:03,139][52658] DAMAGECOUNT value on done: 68917.0 [2024-08-05 23:58:03,141][52658] Sum rewards: 39.277, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.082', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.219', 'AMMO3': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.450', 'ARMOR': '0.471', 'weapon2': '0.724', 'WEAPON3': '1.550', 'weapon3': '2.640', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.808', 'FRAGCOUNT': '37.500'} [2024-08-05 23:58:04,048][52663] DAMAGECOUNT value on done: 72583.0 [2024-08-05 23:58:04,050][52663] Sum rewards: 47.937, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.302', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO4': '0.207', 'AMMO3': '0.272', 'weapon2': '0.346', 'WEAPON5': '0.350', 'weapon4': '0.374', 'weapon5': '0.394', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.610', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:04,633][52670] DAMAGECOUNT value on done: 65555.0 [2024-08-05 23:58:04,633][52670] Sum rewards: 38.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.207', 'WEAPON4': '0.400', 'ARMOR': '0.436', 'weapon4': '0.528', 'weapon2': '0.802', 'WEAPON3': '0.900', 'weapon3': '2.342', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.308', 'FRAGCOUNT': '34.000'} [2024-08-05 23:58:05,517][52665] DAMAGECOUNT value on done: 66141.0 [2024-08-05 23:58:05,518][52665] Sum rewards: 48.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.621', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'weapon5': '0.116', 'AMMO3': '0.223', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '43.000'} [2024-08-05 23:58:05,791][52658] DAMAGECOUNT value on done: 70099.0 [2024-08-05 23:58:05,792][52658] Sum rewards: 45.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.122', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.400', 'HITCOUNT': '2.740', 'weapon3': '2.976', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '41.000'} [2024-08-05 23:58:05,979][52666] DAMAGECOUNT value on done: 64383.0 [2024-08-05 23:58:05,980][52666] Sum rewards: 32.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.076', 'weapon5': '0.124', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'AMMO4': '0.378', 'weapon2': '0.678', 'WEAPON4': '0.850', 'weapon4': '0.852', 'WEAPON3': '1.000', 'weapon3': '1.700', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '9.561', 'FRAGCOUNT': '30.000'} [2024-08-05 23:58:07,078][52663] DAMAGECOUNT value on done: 68028.0 [2024-08-05 23:58:07,079][52663] Sum rewards: 43.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.995', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.104', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon2': '0.892', 'WEAPON3': '1.000', 'weapon3': '2.620', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:07,418][52670] DAMAGECOUNT value on done: 62828.0 [2024-08-05 23:58:07,418][52670] Sum rewards: 38.670, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.905', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.043', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.219', 'weapon4': '0.388', 'WEAPON4': '0.550', 'weapon2': '0.870', 'ARMOR': '0.896', 'WEAPON3': '1.300', 'weapon3': '2.486', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:07,498][52650] Updated weights for policy 0, policy_version 19021 (0.0011) [2024-08-05 23:58:07,638][52665] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-05 23:58:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 155820032. Throughput: 0: 4411.8. Samples: 38959320. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:58:07,795][52567] Avg episode reward: [(0, '45.213')] [2024-08-05 23:58:08,086][52665] DAMAGECOUNT value on done: 67592.0 [2024-08-05 23:58:08,086][52665] Sum rewards: 58.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.393', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.125', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.314', 'ARMOR': '0.400', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '49.000'} [2024-08-05 23:58:08,293][52658] DAMAGECOUNT value on done: 65806.0 [2024-08-05 23:58:08,294][52658] Sum rewards: 36.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.520', 'WEAPON3': '1.350', 'HITCOUNT': '2.440', 'weapon3': '2.874', 'DAMAGECOUNT': '10.224', 'FRAGCOUNT': '33.000'} [2024-08-05 23:58:08,438][52671] DAMAGECOUNT value on done: 73090.0 [2024-08-05 23:58:08,440][52671] Sum rewards: 47.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.853', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.304', 'ARMOR': '0.412', 'weapon2': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '43.000'} [2024-08-05 23:58:08,904][52666] DAMAGECOUNT value on done: 64933.0 [2024-08-05 23:58:08,904][52666] Sum rewards: 47.378, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.182', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.126', 'ARMOR': '0.455', 'weapon2': '0.588', 'WEAPON3': '0.850', 'HITCOUNT': '2.440', 'weapon3': '3.172', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '38.000'} [2024-08-05 23:58:10,070][52663] DAMAGECOUNT value on done: 68408.0 [2024-08-05 23:58:10,079][52663] Sum rewards: 59.853, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.222', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.578', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.656', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '52.000'} [2024-08-05 23:58:10,264][52670] DAMAGECOUNT value on done: 61845.0 [2024-08-05 23:58:10,265][52670] Sum rewards: 37.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.892', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'weapon4': '0.486', 'ARMOR': '0.836', 'weapon2': '0.852', 'WEAPON3': '1.350', 'weapon3': '2.282', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.359', 'FRAGCOUNT': '35.000'} [2024-08-05 23:58:10,871][52665] DAMAGECOUNT value on done: 66022.0 [2024-08-05 23:58:10,871][52665] Sum rewards: 38.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.781', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.122', 'weapon5': '0.124', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '2.950', 'DAMAGECOUNT': '11.019', 'FRAGCOUNT': '36.000'} [2024-08-05 23:58:11,149][52658] DAMAGECOUNT value on done: 67790.0 [2024-08-05 23:58:11,151][52658] Sum rewards: 46.556, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.788', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.325', 'ARMOR': '0.556', 'weapon2': '0.594', 'WEAPON3': '1.900', 'weapon3': '3.006', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:11,189][52671] DAMAGECOUNT value on done: 67621.0 [2024-08-05 23:58:11,189][52671] Sum rewards: 44.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'weapon5': '0.006', 'AMMO5': '0.009', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.185', 'ARMOR': '0.460', 'WEAPON4': '0.550', 'weapon4': '0.750', 'weapon2': '0.926', 'WEAPON3': '1.100', 'weapon3': '2.128', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:11,460][52666] DAMAGECOUNT value on done: 65314.0 [2024-08-05 23:58:11,460][52666] Sum rewards: 44.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.025', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'AMMO4': '0.213', 'weapon4': '0.394', 'ARMOR': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.748', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '38.000'} [2024-08-05 23:58:11,661][52820] DAMAGECOUNT value on done: 61428.0 [2024-08-05 23:58:11,663][52820] Sum rewards: 61.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.276', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.334', 'ARMOR': '0.458', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '52.000'} [2024-08-05 23:58:12,181][52650] Updated weights for policy 0, policy_version 19031 (0.0033) [2024-08-05 23:58:12,748][52670] DAMAGECOUNT value on done: 67549.0 [2024-08-05 23:58:12,748][52670] Sum rewards: 56.506, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.230', 'weapon2': '0.528', 'HEALTH': '0.607', 'WEAPON3': '0.800', 'HITCOUNT': '2.960', 'weapon3': '2.994', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:12,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 155910144. Throughput: 0: 4413.8. Samples: 38985910. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:58:12,794][52567] Avg episode reward: [(0, '45.564')] [2024-08-05 23:58:13,369][52663] DAMAGECOUNT value on done: 70834.0 [2024-08-05 23:58:13,370][52663] Sum rewards: 46.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.691', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.154', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'weapon4': '0.556', 'weapon2': '0.736', 'WEAPON3': '1.000', 'weapon3': '2.464', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '39.500'} [2024-08-05 23:58:13,587][52671] DAMAGECOUNT value on done: 68963.0 [2024-08-05 23:58:13,589][52671] Sum rewards: 54.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.722', 'AMMO5': '0.008', 'AMMO2': '0.011', 'ARMOR': '0.032', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon5': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.376', 'WEAPON3': '1.050', 'weapon3': '2.712', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:13,878][52665] DAMAGECOUNT value on done: 66498.0 [2024-08-05 23:58:13,878][52665] Sum rewards: 44.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.432', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.161', 'WEAPON3': '1.000', 'weapon2': '1.062', 'HITCOUNT': '2.510', 'weapon3': '2.616', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:14,103][52658] DAMAGECOUNT value on done: 66803.0 [2024-08-05 23:58:14,105][52658] Sum rewards: 48.999, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.296', 'weapon4': '0.616', 'HEALTH': '0.734', 'WEAPON3': '0.900', 'weapon3': '2.794', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:14,393][52666] DAMAGECOUNT value on done: 67766.0 [2024-08-05 23:58:14,393][52666] Sum rewards: 56.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.708', 'AMMO2': '0.014', 'ARMOR': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.190', 'weapon4': '0.222', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.264', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '46.000'} [2024-08-05 23:58:14,713][52820] DAMAGECOUNT value on done: 65188.0 [2024-08-05 23:58:14,714][52820] Sum rewards: 51.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.892', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.702', 'ARMOR': '0.829', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:15,868][52670] DAMAGECOUNT value on done: 68254.0 [2024-08-05 23:58:15,869][52670] Sum rewards: 46.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.083', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.402', 'WEAPON3': '1.550', 'HITCOUNT': '2.580', 'weapon3': '3.064', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:16,508][52650] Updated weights for policy 0, policy_version 19041 (0.0018) [2024-08-05 23:58:16,609][52658] DAMAGECOUNT value on done: 66441.0 [2024-08-05 23:58:16,612][52658] Sum rewards: 38.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.816', 'AMMO5': '0.005', 'AMMO2': '0.040', 'ARMOR': '0.048', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.198', 'WEAPON4': '0.400', 'weapon2': '0.634', 'weapon4': '0.726', 'WEAPON3': '0.900', 'weapon3': '2.188', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.362', 'FRAGCOUNT': '33.000'} [2024-08-05 23:58:16,627][52663] DAMAGECOUNT value on done: 68586.0 [2024-08-05 23:58:16,627][52663] Sum rewards: 39.528, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.718', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.086', 'weapon4': '0.132', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'ARMOR': '0.484', 'weapon2': '0.718', 'WEAPON3': '1.600', 'HITCOUNT': '2.560', 'weapon3': '2.778', 'DAMAGECOUNT': '11.487', 'FRAGCOUNT': '39.500'} [2024-08-05 23:58:16,671][52671] DAMAGECOUNT value on done: 65765.0 [2024-08-05 23:58:16,671][52671] Sum rewards: 49.461, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.255', 'weapon2': '0.612', 'ARMOR': '0.840', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.062', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:16,706][52665] DAMAGECOUNT value on done: 66226.0 [2024-08-05 23:58:16,707][52665] Sum rewards: 49.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.677', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.090', 'AMMO3': '0.178', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.298', 'ARMOR': '0.420', 'WEAPON4': '0.550', 'weapon2': '0.606', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '2.760', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:17,441][52666] DAMAGECOUNT value on done: 64715.0 [2024-08-05 23:58:17,442][52666] Sum rewards: 46.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.689', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.091', 'AMMO3': '0.207', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.346', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:17,736][52820] DAMAGECOUNT value on done: 60749.0 [2024-08-05 23:58:17,737][52820] Sum rewards: 44.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.217', 'weapon4': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.084', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 155992064. Throughput: 0: 4415.8. Samples: 38999190. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:58:17,794][52567] Avg episode reward: [(0, '46.304')] [2024-08-05 23:58:17,797][52614] Saving new best policy, reward=46.304! [2024-08-05 23:58:18,220][52614] Signal inference workers to stop experience collection... (3550 times) [2024-08-05 23:58:18,224][52614] Signal inference workers to resume experience collection... (3550 times) [2024-08-05 23:58:18,302][52650] InferenceWorker_p0-w0: stopping experience collection (3550 times) [2024-08-05 23:58:18,307][52650] InferenceWorker_p0-w0: resuming experience collection (3550 times) [2024-08-05 23:58:18,347][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:58:19,015][52670] DAMAGECOUNT value on done: 67020.0 [2024-08-05 23:58:19,017][52670] Sum rewards: 42.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.323', 'AMMO2': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.210', 'weapon2': '0.598', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '2.800', 'DAMAGECOUNT': '12.057', 'FRAGCOUNT': '36.000'} [2024-08-05 23:58:19,496][52663] DAMAGECOUNT value on done: 67389.0 [2024-08-05 23:58:19,496][52663] Sum rewards: 46.616, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.722', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.040', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.200', 'weapon4': '0.432', 'WEAPON4': '0.450', 'weapon2': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.462', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '42.000'} [2024-08-05 23:58:19,560][52658] DAMAGECOUNT value on done: 70800.0 [2024-08-05 23:58:19,561][52658] Sum rewards: 53.314, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.654', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.098', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'ARMOR': '0.451', 'weapon2': '0.590', 'WEAPON3': '1.550', 'weapon3': '2.986', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '47.000'} [2024-08-05 23:58:19,741][52671] DAMAGECOUNT value on done: 65613.0 [2024-08-05 23:58:19,746][52671] Sum rewards: 51.535, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.853', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'weapon4': '0.118', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.112', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '46.000'} [2024-08-05 23:58:19,918][52665] DAMAGECOUNT value on done: 63709.0 [2024-08-05 23:58:19,920][52665] Sum rewards: 38.574, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.258', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.542', 'ARMOR': '0.804', 'WEAPON3': '1.550', 'weapon3': '2.800', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '35.000'} [2024-08-05 23:58:20,498][52666] DAMAGECOUNT value on done: 64836.0 [2024-08-05 23:58:20,501][52666] Sum rewards: 51.115, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.249', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.362', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:20,824][52820] DAMAGECOUNT value on done: 61456.0 [2024-08-05 23:58:20,824][52820] Sum rewards: 50.064, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.040', 'ARMOR': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.125', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.596', 'WEAPON3': '0.750', 'weapon2': '0.952', 'weapon3': '2.218', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:21,432][52650] Updated weights for policy 0, policy_version 19051 (0.0019) [2024-08-05 23:58:21,904][52670] DAMAGECOUNT value on done: 67898.0 [2024-08-05 23:58:21,906][52670] Sum rewards: 51.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.157', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.350', 'weapon4': '0.716', 'WEAPON3': '0.900', 'weapon2': '0.978', 'weapon3': '2.092', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '42.000'} [2024-08-05 23:58:22,155][52658] DAMAGECOUNT value on done: 71755.0 [2024-08-05 23:58:22,156][52658] Sum rewards: 49.890, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.325', 'AMMO5': '0.005', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon4': '0.184', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.230', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:22,280][52663] DAMAGECOUNT value on done: 65324.0 [2024-08-05 23:58:22,282][52663] Sum rewards: 54.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.742', 'AMMO5': '0.006', 'AMMO2': '0.038', 'ARMOR': '0.052', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.410', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '46.000'} [2024-08-05 23:58:22,786][52671] DAMAGECOUNT value on done: 70377.0 [2024-08-05 23:58:22,789][52671] Sum rewards: 41.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon5': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.658', 'ARMOR': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.440', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.373', 'FRAGCOUNT': '36.000'} [2024-08-05 23:58:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 156090368. Throughput: 0: 4410.2. Samples: 39025430. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:58:22,794][52567] Avg episode reward: [(0, '46.427')] [2024-08-05 23:58:22,795][52614] Saving new best policy, reward=46.427! [2024-08-05 23:58:23,080][52665] DAMAGECOUNT value on done: 63842.0 [2024-08-05 23:58:23,082][52665] Sum rewards: 50.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.586', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '3.166', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:23,411][52666] DAMAGECOUNT value on done: 63041.0 [2024-08-05 23:58:23,413][52666] Sum rewards: 44.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.473', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.056', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon4': '0.466', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:23,863][52820] DAMAGECOUNT value on done: 61782.0 [2024-08-05 23:58:23,864][52820] Sum rewards: 36.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.175', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.043', 'AMMO3': '0.118', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO4': '0.214', 'WEAPON4': '0.600', 'weapon4': '0.704', 'weapon2': '0.718', 'WEAPON3': '0.800', 'weapon3': '2.068', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.503', 'FRAGCOUNT': '30.500'} [2024-08-05 23:58:25,015][52670] DAMAGECOUNT value on done: 68169.0 [2024-08-05 23:58:25,017][52670] Sum rewards: 42.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'AMMO4': '0.228', 'weapon2': '0.454', 'WEAPON4': '0.500', 'weapon4': '0.534', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '38.000'} [2024-08-05 23:58:25,254][52658] DAMAGECOUNT value on done: 66919.0 [2024-08-05 23:58:25,254][52658] Sum rewards: 44.520, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.235', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'weapon5': '0.266', 'WEAPON3': '0.900', 'weapon2': '1.176', 'weapon3': '2.106', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.619', 'FRAGCOUNT': '35.000'} [2024-08-05 23:58:25,510][52663] DAMAGECOUNT value on done: 67859.0 [2024-08-05 23:58:25,511][52663] Sum rewards: 55.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.262', 'AMMO5': '0.003', 'AMMO2': '0.025', 'ARMOR': '0.036', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '50.000'} [2024-08-05 23:58:25,869][52671] DAMAGECOUNT value on done: 69278.0 [2024-08-05 23:58:25,871][52671] Sum rewards: 41.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.574', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.112', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '2.620', 'weapon3': '3.194', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:26,080][52650] Updated weights for policy 0, policy_version 19061 (0.0010) [2024-08-05 23:58:26,233][52665] DAMAGECOUNT value on done: 64255.0 [2024-08-05 23:58:26,236][52665] Sum rewards: 47.990, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon4': '0.188', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.650', 'HITCOUNT': '2.730', 'weapon3': '2.966', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:26,387][52659] DAMAGECOUNT value on done: 68200.0 [2024-08-05 23:58:26,389][52659] Sum rewards: 44.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.606', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.209', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.688', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:26,726][52666] DAMAGECOUNT value on done: 66804.0 [2024-08-05 23:58:26,728][52666] Sum rewards: 50.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.389', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.154', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'ARMOR': '0.404', 'weapon2': '0.486', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.114', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '43.000'} [2024-08-05 23:58:26,982][52820] DAMAGECOUNT value on done: 63730.0 [2024-08-05 23:58:26,985][52820] Sum rewards: 44.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.939', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.164', 'weapon4': '0.202', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'weapon2': '0.588', 'WEAPON3': '1.100', 'HITCOUNT': '2.630', 'weapon3': '3.004', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 156172288. Throughput: 0: 4406.7. Samples: 39051550. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-05 23:58:27,794][52567] Avg episode reward: [(0, '46.384')] [2024-08-05 23:58:27,857][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019065_156180480.pth... [2024-08-05 23:58:27,994][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018548_151945216.pth [2024-08-05 23:58:28,020][52658] DAMAGECOUNT value on done: 67838.0 [2024-08-05 23:58:28,022][52658] Sum rewards: 49.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'ARMOR': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.110', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '43.000'} [2024-08-05 23:58:28,509][52663] DAMAGECOUNT value on done: 72139.0 [2024-08-05 23:58:28,509][52663] Sum rewards: 52.554, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.192', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.283', 'weapon2': '0.596', 'WEAPON3': '1.800', 'weapon3': '3.012', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '49.000'} [2024-08-05 23:58:28,532][52670] DAMAGECOUNT value on done: 63128.0 [2024-08-05 23:58:28,533][52670] Sum rewards: 48.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.868', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.146', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.424', 'ARMOR': '0.451', 'WEAPON3': '1.350', 'HITCOUNT': '2.450', 'weapon3': '3.048', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '42.000'} [2024-08-05 23:58:28,936][52671] DAMAGECOUNT value on done: 72480.0 [2024-08-05 23:58:28,937][52671] Sum rewards: 44.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.670', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.388', 'WEAPON3': '1.600', 'HITCOUNT': '2.820', 'weapon3': '3.404', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:29,529][52659] DAMAGECOUNT value on done: 70183.0 [2024-08-05 23:58:29,530][52659] Sum rewards: 51.096, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.100', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.117', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'ARMOR': '0.453', 'weapon2': '0.702', 'WEAPON3': '1.600', 'weapon3': '2.880', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '47.000'} [2024-08-05 23:58:29,579][52666] DAMAGECOUNT value on done: 66452.0 [2024-08-05 23:58:29,580][52666] Sum rewards: 41.649, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.628', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.386', 'ARMOR': '0.400', 'weapon2': '0.686', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '2.698', 'DAMAGECOUNT': '11.262', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:30,248][52820] DAMAGECOUNT value on done: 64191.0 [2024-08-05 23:58:30,248][52820] Sum rewards: 36.461, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.692', 'AMMO5': '0.010', 'weapon5': '0.036', 'AMMO2': '0.040', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.233', 'weapon4': '0.460', 'WEAPON4': '0.500', 'weapon2': '0.584', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.652', 'DAMAGECOUNT': '10.995', 'FRAGCOUNT': '38.000'} [2024-08-05 23:58:30,627][52658] DAMAGECOUNT value on done: 72006.0 [2024-08-05 23:58:30,627][52658] Sum rewards: 40.705, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.734', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.052', 'weapon5': '0.054', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'AMMO4': '0.262', 'weapon4': '0.478', 'WEAPON4': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.450', 'HITCOUNT': '2.470', 'weapon3': '2.656', 'DAMAGECOUNT': '10.752', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:30,943][52650] Updated weights for policy 0, policy_version 19071 (0.0013) [2024-08-05 23:58:31,124][52670] DAMAGECOUNT value on done: 67796.0 [2024-08-05 23:58:31,127][52670] Sum rewards: 52.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon4': '0.232', 'WEAPON4': '0.250', 'ARMOR': '0.466', 'weapon2': '0.654', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.794', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '47.000'} [2024-08-05 23:58:31,568][52663] DAMAGECOUNT value on done: 68166.0 [2024-08-05 23:58:31,569][52663] Sum rewards: 44.079, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.844', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.319', 'WEAPON4': '0.400', 'weapon2': '0.474', 'weapon4': '0.658', 'WEAPON3': '1.850', 'weapon3': '2.506', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '42.000'} [2024-08-05 23:58:31,679][52671] DAMAGECOUNT value on done: 68992.0 [2024-08-05 23:58:31,680][52671] Sum rewards: 45.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.262', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.022', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.340', 'weapon2': '0.514', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '2.958', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:32,247][52659] DAMAGECOUNT value on done: 67806.0 [2024-08-05 23:58:32,248][52659] Sum rewards: 36.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.912', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.074', 'AMMO4': '0.113', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON3': '0.800', 'weapon2': '0.816', 'HITCOUNT': '1.950', 'weapon3': '1.982', 'DAMAGECOUNT': '9.366', 'FRAGCOUNT': '31.000'} [2024-08-05 23:58:32,326][52666] DAMAGECOUNT value on done: 68733.0 [2024-08-05 23:58:32,327][52666] Sum rewards: 49.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.363', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon4': '0.460', 'weapon2': '0.858', 'ARMOR': '0.864', 'WEAPON3': '1.000', 'weapon3': '2.456', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '41.000'} [2024-08-05 23:58:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 156262400. Throughput: 0: 4402.5. Samples: 39064590. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 23:58:32,794][52567] Avg episode reward: [(0, '46.035')] [2024-08-05 23:58:33,282][52820] DAMAGECOUNT value on done: 64312.0 [2024-08-05 23:58:33,293][52820] Sum rewards: 45.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.816', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.034', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.198', 'WEAPON4': '0.450', 'weapon2': '0.540', 'weapon4': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.452', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:33,940][52670] DAMAGECOUNT value on done: 67880.0 [2024-08-05 23:58:33,942][52670] Sum rewards: 59.549, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.166', 'AMMO3': '0.201', 'weapon2': '0.436', 'ARMOR': '0.489', 'HEALTH': '0.636', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.226', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '49.000'} [2024-08-05 23:58:34,342][52663] DAMAGECOUNT value on done: 69674.0 [2024-08-05 23:58:34,344][52663] Sum rewards: 50.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO4': '0.178', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.512', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '42.000'} [2024-08-05 23:58:34,831][52671] DAMAGECOUNT value on done: 71451.0 [2024-08-05 23:58:34,833][52671] Sum rewards: 46.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.148', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'AMMO4': '0.285', 'weapon2': '0.490', 'WEAPON4': '0.550', 'weapon4': '0.860', 'WEAPON3': '1.050', 'weapon3': '2.128', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:35,341][52659] DAMAGECOUNT value on done: 69464.0 [2024-08-05 23:58:35,343][52659] Sum rewards: 45.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.688', 'AMMO5': '0.009', 'AMMO2': '0.067', 'weapon5': '0.180', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'AMMO4': '0.337', 'weapon2': '0.454', 'weapon4': '0.644', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.400', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '41.000'} [2024-08-05 23:58:35,389][52650] Updated weights for policy 0, policy_version 19081 (0.0012) [2024-08-05 23:58:36,454][52820] DAMAGECOUNT value on done: 58750.0 [2024-08-05 23:58:36,455][52820] Sum rewards: 33.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'AMMO5': '0.003', 'ARMOR': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'AMMO3': '0.258', 'AMMO4': '0.260', 'weapon4': '0.430', 'weapon2': '0.470', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.210', 'weapon3': '2.838', 'DAMAGECOUNT': '9.261', 'FRAGCOUNT': '32.000'} [2024-08-05 23:58:36,666][52670] DAMAGECOUNT value on done: 65407.0 [2024-08-05 23:58:36,668][52670] Sum rewards: 44.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.540', 'weapon4': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.488', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '42.000'} [2024-08-05 23:58:36,716][52663] DAMAGECOUNT value on done: 69949.0 [2024-08-05 23:58:36,716][52663] Sum rewards: 39.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.952', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.886', 'WEAPON3': '1.150', 'HITCOUNT': '2.450', 'weapon3': '2.512', 'DAMAGECOUNT': '10.086', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:37,272][52803] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon5', 0.002)] [2024-08-05 23:58:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 156352512. Throughput: 0: 4398.2. Samples: 39090980. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 23:58:37,795][52567] Avg episode reward: [(0, '45.880')] [2024-08-05 23:58:37,965][52671] DAMAGECOUNT value on done: 69898.0 [2024-08-05 23:58:37,966][52671] Sum rewards: 42.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.356', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.318', 'weapon2': '0.348', 'ARMOR': '0.452', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '3.062', 'DAMAGECOUNT': '11.748', 'FRAGCOUNT': '38.000'} [2024-08-05 23:58:38,587][52659] DAMAGECOUNT value on done: 69004.0 [2024-08-05 23:58:38,587][52659] Sum rewards: 62.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.256', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.179', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '50.000'} [2024-08-05 23:58:39,519][52820] DAMAGECOUNT value on done: 62963.0 [2024-08-05 23:58:39,521][52820] Sum rewards: 50.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.915', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO4': '0.119', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.702', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '41.500'} [2024-08-05 23:58:39,604][52663] DAMAGECOUNT value on done: 72081.0 [2024-08-05 23:58:39,604][52663] Sum rewards: 48.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.533', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'weapon5': '0.064', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.368', 'WEAPON3': '0.850', 'weapon2': '0.966', 'weapon3': '2.418', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:39,642][52670] DAMAGECOUNT value on done: 66159.0 [2024-08-05 23:58:39,642][52670] Sum rewards: 53.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.412', 'weapon2': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.664', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:40,106][52650] Updated weights for policy 0, policy_version 19091 (0.0036) [2024-08-05 23:58:40,859][52671] DAMAGECOUNT value on done: 69302.0 [2024-08-05 23:58:40,861][52671] Sum rewards: 50.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.168', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'ARMOR': '0.455', 'weapon2': '0.730', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.818', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '44.000'} [2024-08-05 23:58:41,166][52659] DAMAGECOUNT value on done: 69960.0 [2024-08-05 23:58:41,166][52659] Sum rewards: 44.376, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.705', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.032', 'weapon5': '0.072', 'weapon4': '0.088', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.275', 'weapon2': '0.354', 'WEAPON3': '1.600', 'HITCOUNT': '2.570', 'weapon3': '3.260', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '42.000'} [2024-08-05 23:58:42,423][52663] DAMAGECOUNT value on done: 67211.0 [2024-08-05 23:58:42,425][52663] Sum rewards: 46.991, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.525', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.648', 'ARMOR': '0.923', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '3.134', 'DAMAGECOUNT': '10.704', 'FRAGCOUNT': '41.000'} [2024-08-05 23:58:42,563][52820] DAMAGECOUNT value on done: 65425.0 [2024-08-05 23:58:42,563][52820] Sum rewards: 47.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.400', 'ARMOR': '0.892', 'weapon2': '0.992', 'WEAPON3': '1.150', 'weapon3': '2.418', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '41.000'} [2024-08-05 23:58:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 156434432. Throughput: 0: 4402.0. Samples: 39117640. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-05 23:58:42,794][52567] Avg episode reward: [(0, '46.679')] [2024-08-05 23:58:42,795][52614] Saving new best policy, reward=46.679! [2024-08-05 23:58:43,713][52671] DAMAGECOUNT value on done: 74470.0 [2024-08-05 23:58:43,715][52671] Sum rewards: 56.624, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.181', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.138', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.414', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.780', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '47.000'} [2024-08-05 23:58:44,140][52659] DAMAGECOUNT value on done: 69669.0 [2024-08-05 23:58:44,142][52659] Sum rewards: 54.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.675', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.280', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '46.000'} [2024-08-05 23:58:44,969][52650] Updated weights for policy 0, policy_version 19101 (0.0011) [2024-08-05 23:58:45,680][52820] DAMAGECOUNT value on done: 65046.0 [2024-08-05 23:58:45,680][52820] Sum rewards: 36.525, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO4': '0.087', 'AMMO3': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '0.550', 'weapon4': '0.566', 'HEALTH': '0.886', 'weapon3': '1.890', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '8.514', 'FRAGCOUNT': '29.000'} [2024-08-05 23:58:45,799][52664] DAMAGECOUNT value on done: 70315.0 [2024-08-05 23:58:45,800][52664] Sum rewards: 43.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.218', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO4': '0.031', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.196', 'ARMOR': '0.453', 'weapon2': '0.584', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.162', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:46,214][52671] DAMAGECOUNT value on done: 70710.0 [2024-08-05 23:58:46,215][52671] Sum rewards: 51.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'ARMOR': '0.428', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '46.000'} [2024-08-05 23:58:46,531][52659] DAMAGECOUNT value on done: 66356.0 [2024-08-05 23:58:46,531][52659] Sum rewards: 41.957, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.823', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.021', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.174', 'WEAPON7': '0.200', 'weapon2': '0.244', 'weapon4': '0.752', 'WEAPON3': '1.000', 'HITCOUNT': '2.340', 'weapon3': '2.452', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '35.000'} [2024-08-05 23:58:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 156524544. Throughput: 0: 4393.8. Samples: 39130580. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-05 23:58:47,795][52567] Avg episode reward: [(0, '46.768')] [2024-08-05 23:58:47,799][52614] Saving new best policy, reward=46.768! [2024-08-05 23:58:48,578][52671] DAMAGECOUNT value on done: 65762.0 [2024-08-05 23:58:48,578][52671] Sum rewards: 38.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.735', 'AMMO5': '0.012', 'AMMO2': '0.034', 'ARMOR': '0.040', 'weapon7': '0.046', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'AMMO4': '0.170', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.622', 'weapon4': '0.716', 'WEAPON3': '1.000', 'weapon3': '2.202', 'HITCOUNT': '2.260', 'DAMAGECOUNT': '10.644', 'FRAGCOUNT': '32.000'} [2024-08-05 23:58:48,722][52820] DAMAGECOUNT value on done: 60919.0 [2024-08-05 23:58:48,723][52820] Sum rewards: 38.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.038', 'ARMOR': '0.040', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.218', 'weapon4': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '35.500'} [2024-08-05 23:58:48,767][52664] DAMAGECOUNT value on done: 71488.0 [2024-08-05 23:58:48,768][52664] Sum rewards: 50.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.738', 'AMMO5': '0.003', 'ARMOR': '0.022', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.180', 'weapon4': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '43.000'} [2024-08-05 23:58:49,113][52659] DAMAGECOUNT value on done: 68187.0 [2024-08-05 23:58:49,116][52659] Sum rewards: 44.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.658', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.384', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '3.006', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '38.500'} [2024-08-05 23:58:49,217][52650] Updated weights for policy 0, policy_version 19111 (0.0024) [2024-08-05 23:58:51,568][52664] DAMAGECOUNT value on done: 72372.0 [2024-08-05 23:58:51,568][52664] Sum rewards: 44.642, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.705', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'weapon2': '0.756', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '2.924', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '35.000'} [2024-08-05 23:58:51,596][52671] DAMAGECOUNT value on done: 70229.0 [2024-08-05 23:58:51,598][52671] Sum rewards: 46.393, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.302', 'weapon2': '0.474', 'WEAPON3': '1.700', 'HITCOUNT': '3.060', 'weapon3': '3.150', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '43.000'} [2024-08-05 23:58:51,743][52820] DAMAGECOUNT value on done: 62257.0 [2024-08-05 23:58:51,744][52820] Sum rewards: 47.316, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.144', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.306', 'weapon2': '0.558', 'ARMOR': '0.850', 'WEAPON3': '0.900', 'HITCOUNT': '2.450', 'weapon3': '2.940', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '39.000'} [2024-08-05 23:58:52,157][52659] DAMAGECOUNT value on done: 70627.0 [2024-08-05 23:58:52,162][52659] Sum rewards: 39.662, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.155', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.032', 'AMMO4': '0.094', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.764', 'WEAPON3': '1.500', 'HITCOUNT': '2.500', 'weapon3': '2.854', 'DAMAGECOUNT': '11.568', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 156614656. Throughput: 0: 4386.0. Samples: 39156690. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-05 23:58:52,794][52567] Avg episode reward: [(0, '46.527')] [2024-08-05 23:58:54,306][52664] DAMAGECOUNT value on done: 70455.0 [2024-08-05 23:58:54,307][52664] Sum rewards: 45.806, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.503', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.190', 'weapon4': '0.270', 'ARMOR': '0.404', 'weapon2': '0.776', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.802', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '38.000'} [2024-08-05 23:58:54,459][52650] Updated weights for policy 0, policy_version 19121 (0.0011) [2024-08-05 23:58:54,739][52671] DAMAGECOUNT value on done: 70323.0 [2024-08-05 23:58:54,741][52671] Sum rewards: 48.255, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.282', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.266', 'weapon4': '0.384', 'weapon2': '0.414', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.860', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '43.500'} [2024-08-05 23:58:54,785][52820] DAMAGECOUNT value on done: 67526.0 [2024-08-05 23:58:54,786][52820] Sum rewards: 59.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.390', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.188', 'weapon2': '0.348', 'WEAPON4': '0.550', 'weapon4': '0.898', 'WEAPON3': '1.250', 'weapon3': '2.496', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '51.000'} [2024-08-05 23:58:55,186][52659] DAMAGECOUNT value on done: 69260.0 [2024-08-05 23:58:55,186][52659] Sum rewards: 51.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.982', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.051', 'weapon5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON4': '0.550', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.490', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '48.000'} [2024-08-05 23:58:57,416][52671] DAMAGECOUNT value on done: 70487.0 [2024-08-05 23:58:57,417][52671] Sum rewards: 37.595, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'weapon4': '0.252', 'AMMO3': '0.272', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon2': '0.640', 'WEAPON3': '1.600', 'HITCOUNT': '2.640', 'weapon3': '2.782', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '38.000'} [2024-08-05 23:58:57,552][52664] DAMAGECOUNT value on done: 69703.0 [2024-08-05 23:58:57,552][52664] Sum rewards: 52.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.903', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.044', 'AMMO4': '0.148', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.078', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '45.000'} [2024-08-05 23:58:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 156696576. Throughput: 0: 4378.7. Samples: 39182950. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 23:58:57,794][52567] Avg episode reward: [(0, '46.774')] [2024-08-05 23:58:57,860][52614] Saving new best policy, reward=46.774! [2024-08-05 23:58:57,949][52659] DAMAGECOUNT value on done: 68207.0 [2024-08-05 23:58:57,949][52659] Sum rewards: 40.348, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.465', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.090', 'AMMO4': '0.208', 'AMMO3': '0.211', 'WEAPON5': '0.350', 'ARMOR': '0.420', 'weapon4': '0.446', 'weapon2': '0.514', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.604', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.622', 'FRAGCOUNT': '40.000'} [2024-08-05 23:58:58,016][52820] DAMAGECOUNT value on done: 63484.0 [2024-08-05 23:58:58,016][52820] Sum rewards: 41.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon5': '0.096', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.294', 'ARMOR': '0.447', 'weapon2': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '2.220', 'weapon3': '2.938', 'DAMAGECOUNT': '9.807', 'FRAGCOUNT': '37.000'} [2024-08-05 23:58:58,539][52650] Updated weights for policy 0, policy_version 19131 (0.0012) [2024-08-05 23:59:00,037][52664] DAMAGECOUNT value on done: 74379.0 [2024-08-05 23:59:00,038][52664] Sum rewards: 51.278, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'weapon5': '0.144', 'weapon2': '0.638', 'WEAPON3': '0.800', 'ARMOR': '0.850', 'HITCOUNT': '2.340', 'weapon3': '3.014', 'DAMAGECOUNT': '10.959', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:00,805][52671] DAMAGECOUNT value on done: 68139.0 [2024-08-05 23:59:00,805][52671] Sum rewards: 40.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.923', 'AMMO5': '0.018', 'ARMOR': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.166', 'weapon5': '0.186', 'AMMO4': '0.268', 'WEAPON5': '0.350', 'weapon4': '0.402', 'WEAPON4': '0.600', 'weapon2': '0.636', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '2.506', 'DAMAGECOUNT': '11.628', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:01,153][52820] DAMAGECOUNT value on done: 63573.0 [2024-08-05 23:59:01,154][52820] Sum rewards: 46.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.075', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.084', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon5': '0.194', 'WEAPON4': '0.200', 'ARMOR': '0.460', 'weapon2': '0.776', 'WEAPON3': '0.900', 'HITCOUNT': '2.720', 'weapon3': '2.724', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:01,362][52659] DAMAGECOUNT value on done: 65133.0 [2024-08-05 23:59:01,363][52659] Sum rewards: 43.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.635', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.334', 'ARMOR': '0.400', 'weapon4': '0.736', 'WEAPON4': '0.750', 'weapon2': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.264', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.869', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:02,263][52803] DAMAGECOUNT value on done: 66667.0 [2024-08-05 23:59:02,263][52803] Sum rewards: 55.302, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.178', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.250', 'ARMOR': '0.456', 'weapon2': '0.512', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '49.000'} [2024-08-05 23:59:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 156778496. Throughput: 0: 4366.5. Samples: 39195680. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 23:59:02,794][52567] Avg episode reward: [(0, '46.923')] [2024-08-05 23:59:02,795][52614] Saving new best policy, reward=46.923! [2024-08-05 23:59:02,981][52664] DAMAGECOUNT value on done: 71377.0 [2024-08-05 23:59:02,981][52664] Sum rewards: 51.746, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.690', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.161', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.812', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:03,603][52650] Updated weights for policy 0, policy_version 19141 (0.0045) [2024-08-05 23:59:03,730][52671] DAMAGECOUNT value on done: 66869.0 [2024-08-05 23:59:03,730][52671] Sum rewards: 45.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.400', 'ARMOR': '0.438', 'weapon4': '0.532', 'weapon2': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.392', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:04,162][52659] DAMAGECOUNT value on done: 68285.0 [2024-08-05 23:59:04,164][52659] Sum rewards: 43.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.618', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '2.928', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:04,318][52820] DAMAGECOUNT value on done: 68628.0 [2024-08-05 23:59:04,320][52820] Sum rewards: 31.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.959', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.116', 'AMMO3': '0.175', 'AMMO4': '0.225', 'WEAPON4': '0.500', 'weapon4': '0.576', 'weapon2': '0.946', 'WEAPON3': '0.950', 'HITCOUNT': '1.780', 'weapon3': '2.208', 'DAMAGECOUNT': '7.902', 'FRAGCOUNT': '29.000'} [2024-08-05 23:59:05,240][52803] DAMAGECOUNT value on done: 68774.0 [2024-08-05 23:59:05,241][52803] Sum rewards: 41.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.278', 'AMMO5': '0.012', 'AMMO2': '0.040', 'ARMOR': '0.040', 'AMMO3': '0.136', 'AMMO4': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON4': '0.500', 'weapon2': '0.808', 'WEAPON3': '0.850', 'weapon3': '2.430', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '34.000'} [2024-08-05 23:59:06,191][52664] DAMAGECOUNT value on done: 66892.0 [2024-08-05 23:59:06,191][52664] Sum rewards: 40.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.276', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.037', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.169', 'AMMO4': '0.185', 'WEAPON4': '0.400', 'weapon4': '0.424', 'weapon2': '0.788', 'WEAPON3': '1.100', 'HITCOUNT': '2.370', 'weapon3': '2.540', 'DAMAGECOUNT': '10.875', 'FRAGCOUNT': '35.000'} [2024-08-05 23:59:06,485][52659] DAMAGECOUNT value on done: 69904.0 [2024-08-05 23:59:06,487][52659] Sum rewards: 50.270, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'HEALTH': '0.010', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.106', 'AMMO3': '0.156', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'ARMOR': '0.427', 'weapon2': '0.708', 'WEAPON3': '0.850', 'HITCOUNT': '2.680', 'weapon3': '2.952', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:07,343][52820] DAMAGECOUNT value on done: 66654.0 [2024-08-05 23:59:07,344][52820] Sum rewards: 40.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.309', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.072', 'weapon4': '0.112', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.810', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.796', 'DAMAGECOUNT': '10.764', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:07,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 156876800. Throughput: 0: 4366.2. Samples: 39221910. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-05 23:59:07,795][52567] Avg episode reward: [(0, '46.473')] [2024-08-05 23:59:08,208][52650] Updated weights for policy 0, policy_version 19151 (0.0015) [2024-08-05 23:59:08,340][52803] DAMAGECOUNT value on done: 64738.0 [2024-08-05 23:59:08,342][52803] Sum rewards: 51.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.454', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.197', 'AMMO3': '0.209', 'WEAPON4': '0.400', 'weapon4': '0.602', 'weapon2': '0.650', 'ARMOR': '0.869', 'WEAPON3': '1.200', 'weapon3': '2.440', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:08,631][52664] DAMAGECOUNT value on done: 77276.0 [2024-08-05 23:59:08,639][52664] Sum rewards: 30.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.246', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.084', 'AMMO3': '0.163', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.020', 'HITCOUNT': '1.900', 'weapon3': '2.380', 'DAMAGECOUNT': '8.079', 'FRAGCOUNT': '29.000'} [2024-08-05 23:59:08,710][52811] DAMAGECOUNT value on done: 68055.0 [2024-08-05 23:59:08,713][52811] Sum rewards: 50.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.291', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.116', 'AMMO4': '0.156', 'AMMO3': '0.183', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:09,576][52659] DAMAGECOUNT value on done: 73986.0 [2024-08-05 23:59:09,578][52659] Sum rewards: 51.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.044', 'AMMO3': '0.162', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.390', 'ARMOR': '0.448', 'weapon2': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.684', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:10,451][52820] DAMAGECOUNT value on done: 65286.0 [2024-08-05 23:59:10,451][52820] Sum rewards: 47.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.292', 'AMMO5': '0.008', 'ARMOR': '0.028', 'AMMO2': '0.035', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon4': '0.168', 'AMMO4': '0.173', 'WEAPON4': '0.350', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '2.720', 'weapon3': '2.816', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:11,331][52803] DAMAGECOUNT value on done: 64400.0 [2024-08-05 23:59:11,333][52803] Sum rewards: 52.283, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.381', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.245', 'weapon4': '0.252', 'weapon2': '0.508', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '47.000'} [2024-08-05 23:59:11,739][52664] DAMAGECOUNT value on done: 74074.0 [2024-08-05 23:59:11,739][52664] Sum rewards: 58.581, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.697', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.151', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'ARMOR': '0.480', 'weapon4': '0.488', 'weapon2': '0.796', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '49.000'} [2024-08-05 23:59:11,819][52811] DAMAGECOUNT value on done: 62098.0 [2024-08-05 23:59:11,822][52811] Sum rewards: 41.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.204', 'weapon2': '0.388', 'WEAPON3': '1.150', 'HITCOUNT': '2.230', 'weapon3': '3.282', 'DAMAGECOUNT': '9.696', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:12,652][52659] DAMAGECOUNT value on done: 68844.0 [2024-08-05 23:59:12,652][52659] Sum rewards: 54.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.227', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.255', 'weapon4': '0.264', 'ARMOR': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '49.000'} [2024-08-05 23:59:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 156958720. Throughput: 0: 4373.6. Samples: 39248360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:59:12,795][52567] Avg episode reward: [(0, '46.614')] [2024-08-05 23:59:12,836][52650] Updated weights for policy 0, policy_version 19161 (0.0013) [2024-08-05 23:59:14,160][52664] DAMAGECOUNT value on done: 75697.0 [2024-08-05 23:59:14,170][52664] Sum rewards: 50.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.676', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.152', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.918', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:14,321][52649] DAMAGECOUNT value on done: 67928.0 [2024-08-05 23:59:14,321][52649] Sum rewards: 40.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.341', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.157', 'weapon4': '0.270', 'WEAPON4': '0.350', 'ARMOR': '0.440', 'weapon2': '0.640', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '2.798', 'DAMAGECOUNT': '11.262', 'FRAGCOUNT': '35.000'} [2024-08-05 23:59:14,412][52803] DAMAGECOUNT value on done: 66646.0 [2024-08-05 23:59:14,412][52803] Sum rewards: 37.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.046', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO4': '0.100', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.550', 'weapon2': '0.608', 'WEAPON3': '0.850', 'HITCOUNT': '2.330', 'weapon3': '2.622', 'DAMAGECOUNT': '9.543', 'FRAGCOUNT': '30.500'} [2024-08-05 23:59:14,980][52811] DAMAGECOUNT value on done: 64715.0 [2024-08-05 23:59:14,981][52811] Sum rewards: 44.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'ARMOR': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.167', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.686', 'WEAPON3': '1.000', 'HITCOUNT': '2.640', 'weapon3': '2.790', 'DAMAGECOUNT': '11.019', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:15,493][52659] DAMAGECOUNT value on done: 68630.0 [2024-08-05 23:59:15,493][52659] Sum rewards: 39.296, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.735', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.194', 'AMMO3': '0.262', 'WEAPON4': '0.600', 'weapon4': '0.662', 'ARMOR': '0.923', 'weapon2': '0.944', 'WEAPON3': '1.500', 'weapon3': '2.012', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:16,794][52664] DAMAGECOUNT value on done: 71328.0 [2024-08-05 23:59:16,794][52664] Sum rewards: 43.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.072', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon4': '0.098', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '3.142', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:17,420][52649] DAMAGECOUNT value on done: 68845.0 [2024-08-05 23:59:17,422][52649] Sum rewards: 45.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.370', 'ARMOR': '0.444', 'weapon4': '0.482', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:17,505][52803] DAMAGECOUNT value on done: 64803.0 [2024-08-05 23:59:17,506][52803] Sum rewards: 35.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.256', 'WEAPON3': '0.900', 'weapon2': '1.084', 'weapon3': '2.456', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.197', 'FRAGCOUNT': '30.000'} [2024-08-05 23:59:17,613][52650] Updated weights for policy 0, policy_version 19171 (0.0012) [2024-08-05 23:59:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 157048832. Throughput: 0: 4381.8. Samples: 39261770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:59:17,794][52567] Avg episode reward: [(0, '46.132')] [2024-08-05 23:59:17,989][52811] DAMAGECOUNT value on done: 64652.0 [2024-08-05 23:59:17,989][52811] Sum rewards: 34.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.125', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.726', 'WEAPON3': '1.300', 'HITCOUNT': '2.350', 'weapon3': '2.792', 'DAMAGECOUNT': '9.330', 'FRAGCOUNT': '32.000'} [2024-08-05 23:59:18,649][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:59:18,766][52659] DAMAGECOUNT value on done: 70701.0 [2024-08-05 23:59:18,769][52659] Sum rewards: 52.819, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.744', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.266', 'weapon2': '0.498', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '3.042', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '48.000'} [2024-08-05 23:59:19,757][52664] DAMAGECOUNT value on done: 71713.0 [2024-08-05 23:59:19,758][52664] Sum rewards: 42.122, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.176', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.016', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.278', 'weapon2': '0.668', 'WEAPON3': '1.700', 'HITCOUNT': '2.790', 'weapon3': '3.100', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:19,969][52649] DAMAGECOUNT value on done: 70170.0 [2024-08-05 23:59:19,970][52649] Sum rewards: 61.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.481', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'ARMOR': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.288', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '51.000'} [2024-08-05 23:59:20,602][52803] DAMAGECOUNT value on done: 67344.0 [2024-08-05 23:59:20,602][52803] Sum rewards: 59.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.976', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.052', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon4': '0.408', 'weapon2': '0.798', 'WEAPON3': '1.050', 'weapon3': '2.672', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '50.000'} [2024-08-05 23:59:21,047][52811] DAMAGECOUNT value on done: 64079.0 [2024-08-05 23:59:21,048][52811] Sum rewards: 47.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.319', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.233', 'AMMO4': '0.255', 'weapon4': '0.564', 'weapon2': '0.572', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.462', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:21,497][52659] DAMAGECOUNT value on done: 71782.0 [2024-08-05 23:59:21,498][52659] Sum rewards: 39.809, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.812', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.506', 'weapon2': '0.770', 'WEAPON3': '1.150', 'weapon3': '2.356', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '34.000'} [2024-08-05 23:59:21,779][52662] DAMAGECOUNT value on done: 74863.0 [2024-08-05 23:59:21,781][52662] Sum rewards: 43.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.046', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.232', 'weapon4': '0.470', 'weapon2': '0.476', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.752', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:21,854][52668] DAMAGECOUNT value on done: 68573.0 [2024-08-05 23:59:21,854][52668] Sum rewards: 52.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.902', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.028', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.544', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.464', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:22,123][52650] Updated weights for policy 0, policy_version 19181 (0.0025) [2024-08-05 23:59:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 157138944. Throughput: 0: 4386.2. Samples: 39288360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-05 23:59:22,795][52567] Avg episode reward: [(0, '46.155')] [2024-08-05 23:59:22,797][52649] DAMAGECOUNT value on done: 68722.0 [2024-08-05 23:59:22,797][52649] Sum rewards: 51.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.164', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.484', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '2.664', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:22,808][52664] DAMAGECOUNT value on done: 72013.0 [2024-08-05 23:59:22,808][52664] Sum rewards: 52.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.184', 'AMMO5': '0.005', 'ARMOR': '0.017', 'AMMO2': '0.043', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.214', 'weapon4': '0.224', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.172', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:23,648][52803] DAMAGECOUNT value on done: 64931.0 [2024-08-05 23:59:23,648][52803] Sum rewards: 42.223, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.255', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.156', 'weapon4': '0.174', 'AMMO4': '0.228', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.602', 'WEAPON3': '1.650', 'HITCOUNT': '2.640', 'weapon3': '2.788', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:24,047][52811] DAMAGECOUNT value on done: 66816.0 [2024-08-05 23:59:24,051][52811] Sum rewards: 44.667, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.508', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.228', 'AMMO3': '0.261', 'ARMOR': '0.446', 'weapon2': '0.510', 'WEAPON3': '1.600', 'HITCOUNT': '2.690', 'weapon3': '3.042', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '42.000'} [2024-08-05 23:59:24,348][52668] DAMAGECOUNT value on done: 72833.0 [2024-08-05 23:59:24,349][52668] Sum rewards: 54.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.911', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.036', 'weapon5': '0.080', 'AMMO4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.518', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.580', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '47.000'} [2024-08-05 23:59:25,078][52662] DAMAGECOUNT value on done: 77225.0 [2024-08-05 23:59:25,078][52662] Sum rewards: 49.607, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.316', 'weapon2': '0.486', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.046', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:25,723][52649] DAMAGECOUNT value on done: 66167.0 [2024-08-05 23:59:25,724][52649] Sum rewards: 41.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.795', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.328', 'weapon2': '0.356', 'WEAPON3': '1.450', 'HITCOUNT': '2.650', 'weapon3': '3.020', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:25,801][52664] DAMAGECOUNT value on done: 74373.0 [2024-08-05 23:59:25,802][52664] Sum rewards: 47.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.441', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.249', 'weapon2': '0.330', 'ARMOR': '0.461', 'WEAPON3': '1.500', 'HITCOUNT': '2.770', 'weapon3': '3.354', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:26,652][52650] Updated weights for policy 0, policy_version 19191 (0.0012) [2024-08-05 23:59:26,692][52803] DAMAGECOUNT value on done: 67680.0 [2024-08-05 23:59:26,694][52803] Sum rewards: 49.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.561', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.071', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.568', 'ARMOR': '0.886', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:27,026][52811] DAMAGECOUNT value on done: 66952.0 [2024-08-05 23:59:27,028][52811] Sum rewards: 51.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'AMMO5': '0.004', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:27,063][52668] DAMAGECOUNT value on done: 66766.0 [2024-08-05 23:59:27,064][52668] Sum rewards: 45.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.148', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.620', 'weapon4': '0.792', 'WEAPON3': '0.800', 'weapon3': '2.390', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:27,500][52649] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-05 23:59:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 157229056. Throughput: 0: 4386.4. Samples: 39315030. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 23:59:27,794][52567] Avg episode reward: [(0, '46.364')] [2024-08-05 23:59:27,863][52794] DAMAGECOUNT value on done: 76902.0 [2024-08-05 23:59:27,863][52794] Sum rewards: 64.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.034', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.213', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '55.000'} [2024-08-05 23:59:27,967][52662] DAMAGECOUNT value on done: 78718.0 [2024-08-05 23:59:27,967][52662] Sum rewards: 42.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.514', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'ARMOR': '0.408', 'weapon4': '0.458', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.728', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '36.000'} [2024-08-05 23:59:28,470][52664] DAMAGECOUNT value on done: 68939.0 [2024-08-05 23:59:28,471][52664] Sum rewards: 48.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.049', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'AMMO4': '0.185', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.796', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:28,783][52649] DAMAGECOUNT value on done: 66017.0 [2024-08-05 23:59:28,784][52649] Sum rewards: 55.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.126', 'AMMO3': '0.188', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon4': '0.512', 'WEAPON4': '0.600', 'weapon2': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.324', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '50.000'} [2024-08-05 23:59:29,542][52668] DAMAGECOUNT value on done: 68869.0 [2024-08-05 23:59:29,544][52668] Sum rewards: 55.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.131', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.152', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.232', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:29,853][52803] DAMAGECOUNT value on done: 62485.0 [2024-08-05 23:59:29,853][52803] Sum rewards: 52.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.179', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.130', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '47.000'} [2024-08-05 23:59:30,089][52811] DAMAGECOUNT value on done: 65248.0 [2024-08-05 23:59:30,100][52811] Sum rewards: 57.272, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.376', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.248', 'AMMO3': '0.259', 'weapon2': '0.428', 'ARMOR': '0.485', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '51.000'} [2024-08-05 23:59:30,875][52794] DAMAGECOUNT value on done: 74161.0 [2024-08-05 23:59:30,876][52794] Sum rewards: 42.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.173', 'WEAPON4': '0.350', 'weapon4': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.810', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:30,922][52662] DAMAGECOUNT value on done: 70686.0 [2024-08-05 23:59:30,923][52662] Sum rewards: 52.051, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.439', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.046', 'weapon5': '0.066', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon2': '0.662', 'WEAPON3': '1.050', 'HITCOUNT': '2.680', 'weapon3': '3.034', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:31,384][52664] DAMAGECOUNT value on done: 72968.0 [2024-08-05 23:59:31,384][52664] Sum rewards: 47.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.217', 'weapon2': '0.376', 'WEAPON3': '1.400', 'HITCOUNT': '2.590', 'weapon3': '3.250', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:31,458][52647] DAMAGECOUNT value on done: 72838.0 [2024-08-05 23:59:31,459][52647] Sum rewards: 44.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.134', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.068', 'AMMO4': '0.129', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.320', 'ARMOR': '0.456', 'weapon2': '0.814', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.614', 'DAMAGECOUNT': '11.586', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:31,681][52650] Updated weights for policy 0, policy_version 19201 (0.0012) [2024-08-05 23:59:31,947][52649] DAMAGECOUNT value on done: 65073.0 [2024-08-05 23:59:31,949][52649] Sum rewards: 38.149, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.350', 'AMMO5': '0.009', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.146', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '3.116', 'DAMAGECOUNT': '10.122', 'FRAGCOUNT': '36.000'} [2024-08-05 23:59:32,071][52660] DAMAGECOUNT value on done: 69035.0 [2024-08-05 23:59:32,071][52660] Sum rewards: 35.895, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.166', 'AMMO5': '0.017', 'ARMOR': '0.032', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.179', 'AMMO3': '0.194', 'weapon4': '0.336', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.300', 'weapon3': '2.758', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '34.000'} [2024-08-05 23:59:32,683][52668] DAMAGECOUNT value on done: 69562.0 [2024-08-05 23:59:32,684][52668] Sum rewards: 46.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.156', 'AMMO2': '0.045', 'AMMO3': '0.188', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.440', 'weapon4': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:32,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 157319168. Throughput: 0: 4385.6. Samples: 39327930. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-05 23:59:32,794][52567] Avg episode reward: [(0, '46.726')] [2024-08-05 23:59:32,888][52803] DAMAGECOUNT value on done: 68481.0 [2024-08-05 23:59:32,893][52803] Sum rewards: 37.365, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.585', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon4': '0.348', 'ARMOR': '0.422', 'weapon2': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.726', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:33,197][52811] DAMAGECOUNT value on done: 66404.0 [2024-08-05 23:59:33,199][52811] Sum rewards: 30.358, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.651', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.298', 'ARMOR': '0.460', 'weapon2': '0.684', 'WEAPON3': '1.450', 'HITCOUNT': '2.340', 'weapon3': '2.714', 'DAMAGECOUNT': '10.125', 'FRAGCOUNT': '31.000'} [2024-08-05 23:59:33,531][52794] DAMAGECOUNT value on done: 72387.0 [2024-08-05 23:59:33,537][52794] Sum rewards: 43.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.182', 'AMMO5': '0.007', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO4': '0.188', 'AMMO3': '0.198', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.594', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.464', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:33,588][52662] DAMAGECOUNT value on done: 72641.0 [2024-08-05 23:59:33,590][52662] Sum rewards: 49.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.064', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.170', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.506', 'weapon2': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.482', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:34,240][52664] DAMAGECOUNT value on done: 71622.0 [2024-08-05 23:59:34,242][52664] Sum rewards: 40.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.491', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.814', 'WEAPON3': '1.250', 'weapon3': '2.476', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '36.000'} [2024-08-05 23:59:34,401][52647] DAMAGECOUNT value on done: 72232.0 [2024-08-05 23:59:34,403][52647] Sum rewards: 52.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.224', 'weapon2': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '46.000'} [2024-08-05 23:59:34,917][52660] DAMAGECOUNT value on done: 72802.0 [2024-08-05 23:59:34,919][52660] Sum rewards: 38.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.720', 'ARMOR': '0.005', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.800', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '2.904', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '35.500'} [2024-08-05 23:59:34,937][52649] DAMAGECOUNT value on done: 70333.0 [2024-08-05 23:59:34,937][52649] Sum rewards: 43.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'ARMOR': '0.004', 'WEAPON5': '0.050', 'AMMO2': '0.053', 'weapon5': '0.080', 'AMMO3': '0.158', 'AMMO4': '0.263', 'weapon4': '0.318', 'WEAPON4': '0.500', 'weapon2': '0.632', 'WEAPON3': '1.000', 'HITCOUNT': '2.410', 'weapon3': '2.752', 'DAMAGECOUNT': '9.984', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:35,597][52668] DAMAGECOUNT value on done: 70012.0 [2024-08-05 23:59:35,597][52668] Sum rewards: 41.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.499', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'ARMOR': '0.453', 'WEAPON3': '0.800', 'weapon2': '1.312', 'HITCOUNT': '2.200', 'weapon3': '2.368', 'DAMAGECOUNT': '10.242', 'FRAGCOUNT': '34.000'} [2024-08-05 23:59:35,742][52650] Updated weights for policy 0, policy_version 19211 (0.0011) [2024-08-05 23:59:36,157][52803] DAMAGECOUNT value on done: 66326.0 [2024-08-05 23:59:36,159][52803] Sum rewards: 51.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.368', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '2.912', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:36,339][52794] DAMAGECOUNT value on done: 69856.0 [2024-08-05 23:59:36,340][52794] Sum rewards: 37.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.526', 'weapon4': '0.544', 'ARMOR': '0.816', 'WEAPON3': '0.950', 'HITCOUNT': '2.200', 'weapon3': '2.426', 'DAMAGECOUNT': '10.722', 'FRAGCOUNT': '30.000'} [2024-08-05 23:59:36,356][52662] DAMAGECOUNT value on done: 74216.0 [2024-08-05 23:59:36,356][52662] Sum rewards: 35.790, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.415', 'AMMO5': '0.012', 'AMMO2': '0.085', 'weapon5': '0.176', 'AMMO3': '0.218', 'WEAPON5': '0.400', 'AMMO4': '0.427', 'weapon4': '0.470', 'weapon2': '0.570', 'WEAPON4': '0.950', 'WEAPON3': '1.350', 'HITCOUNT': '2.390', 'weapon3': '2.464', 'DAMAGECOUNT': '11.442', 'FRAGCOUNT': '35.000'} [2024-08-05 23:59:36,376][52811] DAMAGECOUNT value on done: 65634.0 [2024-08-05 23:59:36,379][52811] Sum rewards: 49.622, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.944', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'ARMOR': '0.463', 'weapon4': '0.634', 'weapon2': '0.708', 'WEAPON3': '1.300', 'weapon3': '2.276', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:36,381][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-05 23:59:36,993][52664] DAMAGECOUNT value on done: 72582.0 [2024-08-05 23:59:36,994][52664] Sum rewards: 48.832, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.390', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'weapon4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.650', 'HITCOUNT': '2.990', 'weapon3': '3.022', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:37,056][52647] DAMAGECOUNT value on done: 77147.0 [2024-08-05 23:59:37,057][52647] Sum rewards: 50.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.216', 'weapon4': '0.380', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '46.000'} [2024-08-05 23:59:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 157401088. Throughput: 0: 4400.7. Samples: 39354720. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-05 23:59:37,794][52567] Avg episode reward: [(0, '46.118')] [2024-08-05 23:59:38,039][52660] DAMAGECOUNT value on done: 71476.0 [2024-08-05 23:59:38,039][52660] Sum rewards: 53.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.469', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.154', 'AMMO3': '0.156', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.502', 'weapon4': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.540', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '43.500'} [2024-08-05 23:59:38,113][52649] DAMAGECOUNT value on done: 65051.0 [2024-08-05 23:59:38,114][52649] Sum rewards: 33.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.841', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.048', 'ARMOR': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.242', 'weapon4': '0.332', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon2': '1.190', 'weapon3': '2.208', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.089', 'FRAGCOUNT': '31.000'} [2024-08-05 23:59:38,438][52662] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:59:38,775][52668] DAMAGECOUNT value on done: 71588.0 [2024-08-05 23:59:38,776][52668] Sum rewards: 55.066, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.929', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.122', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.052', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '46.000'} [2024-08-05 23:59:39,307][52803] DAMAGECOUNT value on done: 65084.0 [2024-08-05 23:59:39,309][52803] Sum rewards: 53.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.310', 'weapon4': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.002', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:39,326][52794] DAMAGECOUNT value on done: 72393.0 [2024-08-05 23:59:39,326][52794] Sum rewards: 41.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.984', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon4': '0.306', 'weapon2': '0.488', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.858', 'DAMAGECOUNT': '12.462', 'FRAGCOUNT': '36.500'} [2024-08-05 23:59:39,354][52662] DAMAGECOUNT value on done: 75641.0 [2024-08-05 23:59:39,355][52662] Sum rewards: 32.646, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.937', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.142', 'weapon4': '0.170', 'AMMO3': '0.221', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'ARMOR': '0.463', 'WEAPON4': '0.500', 'weapon2': '0.798', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '2.600', 'DAMAGECOUNT': '10.017', 'FRAGCOUNT': '32.000'} [2024-08-05 23:59:39,439][52664] DAMAGECOUNT value on done: 72376.0 [2024-08-05 23:59:39,440][52664] Sum rewards: 46.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.062', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.024', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.318', 'WEAPON4': '0.400', 'ARMOR': '0.514', 'weapon4': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '40.500'} [2024-08-05 23:59:39,460][52811] DAMAGECOUNT value on done: 68271.0 [2024-08-05 23:59:39,461][52811] Sum rewards: 39.163, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.466', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.045', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.225', 'weapon4': '0.544', 'WEAPON4': '0.550', 'weapon2': '0.836', 'WEAPON3': '1.100', 'weapon3': '2.260', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.845', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:39,488][52647] DAMAGECOUNT value on done: 75975.0 [2024-08-05 23:59:39,488][52647] Sum rewards: 55.886, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.324', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.608', 'weapon2': '0.672', 'WEAPON3': '1.250', 'weapon3': '2.474', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '48.000'} [2024-08-05 23:59:40,956][52650] Updated weights for policy 0, policy_version 19221 (0.0024) [2024-08-05 23:59:41,073][52660] DAMAGECOUNT value on done: 70287.0 [2024-08-05 23:59:41,073][52660] Sum rewards: 53.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.260', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.281', 'weapon2': '0.314', 'WEAPON3': '1.800', 'HITCOUNT': '3.180', 'weapon3': '3.374', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '49.000'} [2024-08-05 23:59:41,259][52649] DAMAGECOUNT value on done: 66221.0 [2024-08-05 23:59:41,267][52649] Sum rewards: 32.900, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.253', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'weapon5': '0.234', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.434', 'ARMOR': '0.449', 'WEAPON3': '1.400', 'HITCOUNT': '2.340', 'weapon3': '2.718', 'DAMAGECOUNT': '9.960', 'FRAGCOUNT': '30.500'} [2024-08-05 23:59:41,699][52668] DAMAGECOUNT value on done: 72342.0 [2024-08-05 23:59:41,700][52668] Sum rewards: 54.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.885', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'AMMO4': '0.239', 'weapon4': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.822', 'WEAPON3': '1.400', 'weapon3': '2.542', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '50.000'} [2024-08-05 23:59:42,314][52662] DAMAGECOUNT value on done: 79963.0 [2024-08-05 23:59:42,314][52662] Sum rewards: 42.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.057', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.050', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO4': '0.206', 'AMMO3': '0.237', 'ARMOR': '0.421', 'WEAPON4': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '2.970', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:42,333][52794] DAMAGECOUNT value on done: 75708.0 [2024-08-05 23:59:42,333][52794] Sum rewards: 43.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.478', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.166', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon2': '0.348', 'WEAPON4': '0.450', 'weapon4': '0.888', 'WEAPON3': '1.000', 'weapon3': '2.276', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.538', 'FRAGCOUNT': '36.000'} [2024-08-05 23:59:42,411][52811] DAMAGECOUNT value on done: 64042.0 [2024-08-05 23:59:42,412][52811] Sum rewards: 50.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.652', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.350', 'ARMOR': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.904', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:42,564][52803] DAMAGECOUNT value on done: 66322.0 [2024-08-05 23:59:42,565][52803] Sum rewards: 47.406, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.218', 'AMMO3': '0.266', 'weapon4': '0.362', 'ARMOR': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.696', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:42,606][52647] DAMAGECOUNT value on done: 75731.0 [2024-08-05 23:59:42,606][52647] Sum rewards: 50.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.944', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon5': '0.124', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.200', 'ARMOR': '0.457', 'WEAPON3': '0.950', 'weapon2': '0.998', 'weapon3': '2.530', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:42,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 157483008. Throughput: 0: 4402.7. Samples: 39381070. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-05 23:59:42,794][52567] Avg episode reward: [(0, '46.167')] [2024-08-05 23:59:43,838][52660] DAMAGECOUNT value on done: 66146.0 [2024-08-05 23:59:43,839][52660] Sum rewards: 39.730, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.010', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.224', 'weapon4': '0.364', 'WEAPON4': '0.400', 'ARMOR': '0.474', 'weapon2': '0.846', 'WEAPON3': '1.350', 'weapon3': '2.580', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:44,591][52668] DAMAGECOUNT value on done: 70385.0 [2024-08-05 23:59:44,595][52668] Sum rewards: 48.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.263', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO3': '0.162', 'AMMO4': '0.162', 'weapon5': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.530', 'weapon4': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.382', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:44,604][52649] DAMAGECOUNT value on done: 68436.0 [2024-08-05 23:59:44,604][52649] Sum rewards: 47.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.076', 'AMMO4': '0.137', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'ARMOR': '0.440', 'WEAPON4': '0.450', 'weapon4': '0.482', 'weapon2': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.580', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.049', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:45,355][52662] DAMAGECOUNT value on done: 71248.0 [2024-08-05 23:59:45,356][52662] Sum rewards: 35.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.287', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.054', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.292', 'weapon3': '1.878', 'HITCOUNT': '1.950', 'DAMAGECOUNT': '9.603', 'FRAGCOUNT': '31.000'} [2024-08-05 23:59:45,373][52794] DAMAGECOUNT value on done: 76275.0 [2024-08-05 23:59:45,374][52794] Sum rewards: 46.172, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.026', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.110', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.308', 'ARMOR': '0.494', 'weapon2': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:45,405][52811] DAMAGECOUNT value on done: 67317.0 [2024-08-05 23:59:45,407][52811] Sum rewards: 50.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.082', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'ARMOR': '0.408', 'weapon4': '0.434', 'weapon2': '0.836', 'WEAPON3': '1.250', 'weapon3': '2.568', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:45,503][52650] Updated weights for policy 0, policy_version 19231 (0.0012) [2024-08-05 23:59:45,617][52803] DAMAGECOUNT value on done: 65387.0 [2024-08-05 23:59:45,618][52803] Sum rewards: 52.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.211', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:45,676][52647] DAMAGECOUNT value on done: 75445.0 [2024-08-05 23:59:45,676][52647] Sum rewards: 36.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.170', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO4': '0.192', 'AMMO3': '0.196', 'weapon2': '0.538', 'WEAPON4': '0.600', 'weapon4': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.494', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '31.000'} [2024-08-05 23:59:46,884][52660] DAMAGECOUNT value on done: 69944.0 [2024-08-05 23:59:46,886][52660] Sum rewards: 36.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.268', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.213', 'weapon2': '0.374', 'WEAPON4': '0.500', 'weapon4': '0.620', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '2.796', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '35.000'} [2024-08-05 23:59:47,064][52649] DAMAGECOUNT value on done: 67964.0 [2024-08-05 23:59:47,065][52649] Sum rewards: 44.842, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.892', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.594', 'ARMOR': '0.816', 'WEAPON3': '1.400', 'weapon3': '2.688', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '42.000'} [2024-08-05 23:59:47,429][52803] Large shaping reward 3.321 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.27, 90.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-05 23:59:47,458][52668] DAMAGECOUNT value on done: 72843.0 [2024-08-05 23:59:47,459][52668] Sum rewards: 50.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.744', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.146', 'AMMO3': '0.154', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.318', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '0.926', 'weapon3': '2.366', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '42.000'} [2024-08-05 23:59:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 157581312. Throughput: 0: 4418.0. Samples: 39394490. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-05 23:59:47,794][52567] Avg episode reward: [(0, '46.000')] [2024-08-05 23:59:48,434][52662] DAMAGECOUNT value on done: 74128.0 [2024-08-05 23:59:48,434][52662] Sum rewards: 42.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.812', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.060', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.654', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.014', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '36.000'} [2024-08-05 23:59:48,466][52794] DAMAGECOUNT value on done: 71946.0 [2024-08-05 23:59:48,467][52794] Sum rewards: 45.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.468', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon4': '0.386', 'ARMOR': '0.449', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:48,531][52811] DAMAGECOUNT value on done: 65251.0 [2024-08-05 23:59:48,532][52811] Sum rewards: 44.180, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.172', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.018', 'weapon4': '0.046', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'ARMOR': '0.424', 'weapon2': '0.894', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.174', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:48,603][52647] DAMAGECOUNT value on done: 73085.0 [2024-08-05 23:59:48,604][52647] Sum rewards: 44.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'ARMOR': '0.020', 'weapon5': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.215', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.892', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:48,848][52803] DAMAGECOUNT value on done: 63394.0 [2024-08-05 23:59:48,849][52803] Sum rewards: 51.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.308', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.157', 'weapon4': '0.202', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.066', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '45.500'} [2024-08-05 23:59:49,527][52660] DAMAGECOUNT value on done: 71227.0 [2024-08-05 23:59:49,529][52660] Sum rewards: 48.721, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO4': '0.213', 'AMMO3': '0.229', 'WEAPON4': '0.400', 'weapon2': '0.748', 'WEAPON3': '1.350', 'weapon3': '2.670', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:49,812][52650] Updated weights for policy 0, policy_version 19241 (0.0028) [2024-08-05 23:59:50,043][52649] DAMAGECOUNT value on done: 70223.0 [2024-08-05 23:59:50,043][52649] Sum rewards: 47.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.977', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.120', 'weapon4': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.008', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:50,267][52668] DAMAGECOUNT value on done: 66471.0 [2024-08-05 23:59:50,267][52668] Sum rewards: 45.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon4': '0.462', 'weapon2': '0.506', 'WEAPON3': '1.550', 'weapon3': '2.780', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '42.000'} [2024-08-05 23:59:51,296][52647] DAMAGECOUNT value on done: 74027.0 [2024-08-05 23:59:51,296][52647] Sum rewards: 47.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.256', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.360', 'ARMOR': '0.456', 'weapon2': '0.586', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '2.720', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:51,388][52662] DAMAGECOUNT value on done: 73619.0 [2024-08-05 23:59:51,392][52662] Sum rewards: 43.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.202', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.096', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'ARMOR': '0.465', 'WEAPON4': '0.550', 'weapon4': '0.592', 'weapon2': '0.736', 'WEAPON3': '1.100', 'weapon3': '2.334', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '38.000'} [2024-08-05 23:59:51,470][52794] DAMAGECOUNT value on done: 74916.0 [2024-08-05 23:59:51,472][52794] Sum rewards: 57.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.806', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.308', 'weapon5': '0.356', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '48.000'} [2024-08-05 23:59:51,573][52811] DAMAGECOUNT value on done: 66564.0 [2024-08-05 23:59:51,574][52811] Sum rewards: 50.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.876', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.208', 'WEAPON4': '0.500', 'weapon4': '0.542', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.532', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '43.000'} [2024-08-05 23:59:51,898][52803] DAMAGECOUNT value on done: 66692.0 [2024-08-05 23:59:51,901][52803] Sum rewards: 61.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon4': '0.266', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '51.000'} [2024-08-05 23:59:52,539][52660] DAMAGECOUNT value on done: 69737.0 [2024-08-05 23:59:52,542][52660] Sum rewards: 51.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.009', 'weapon4': '0.038', 'AMMO4': '0.047', 'weapon5': '0.072', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.684', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.934', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:52,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 157663232. Throughput: 0: 4413.5. Samples: 39420520. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 23:59:52,795][52567] Avg episode reward: [(0, '46.482')] [2024-08-05 23:59:53,248][52649] DAMAGECOUNT value on done: 69398.0 [2024-08-05 23:59:53,250][52649] Sum rewards: 39.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.355', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.214', 'ARMOR': '0.454', 'weapon4': '0.478', 'WEAPON4': '0.550', 'weapon2': '0.626', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '2.566', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '36.500'} [2024-08-05 23:59:53,358][52668] DAMAGECOUNT value on done: 69296.0 [2024-08-05 23:59:53,361][52668] Sum rewards: 44.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.866', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.132', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'ARMOR': '0.466', 'weapon4': '0.696', 'weapon2': '1.024', 'WEAPON3': '1.250', 'weapon3': '1.936', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.377', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:53,934][52647] DAMAGECOUNT value on done: 77415.0 [2024-08-05 23:59:53,935][52647] Sum rewards: 61.017, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.824', 'AMMO5': '0.008', 'ARMOR': '0.036', 'AMMO2': '0.036', 'weapon5': '0.058', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.254', 'AMMO3': '0.275', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.954', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '53.000'} [2024-08-05 23:59:53,988][52662] DAMAGECOUNT value on done: 76566.0 [2024-08-05 23:59:53,988][52662] Sum rewards: 51.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.403', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.191', 'weapon5': '0.208', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'weapon2': '0.424', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.626', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:54,158][52794] DAMAGECOUNT value on done: 76803.0 [2024-08-05 23:59:54,161][52794] Sum rewards: 43.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.095', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.040', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.230', 'weapon4': '0.368', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '2.906', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:54,605][52811] DAMAGECOUNT value on done: 66433.0 [2024-08-05 23:59:54,605][52811] Sum rewards: 48.338, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.938', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO4': '0.149', 'AMMO3': '0.236', 'weapon4': '0.256', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:54,885][52650] Updated weights for policy 0, policy_version 19251 (0.0013) [2024-08-05 23:59:54,957][52803] DAMAGECOUNT value on done: 64245.0 [2024-08-05 23:59:54,958][52803] Sum rewards: 33.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.902', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.166', 'AMMO3': '0.180', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.414', 'ARMOR': '0.424', 'WEAPON4': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.150', 'HITCOUNT': '2.090', 'weapon3': '2.534', 'DAMAGECOUNT': '8.739', 'FRAGCOUNT': '29.000'} [2024-08-05 23:59:55,418][52660] DAMAGECOUNT value on done: 70668.0 [2024-08-05 23:59:55,421][52660] Sum rewards: 47.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.022', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.672', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '2.936', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '41.000'} [2024-08-05 23:59:56,171][52668] DAMAGECOUNT value on done: 66021.0 [2024-08-05 23:59:56,171][52668] Sum rewards: 49.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO4': '-0.037', 'AMMO2': '-0.007', 'AMMO3': '0.218', 'weapon2': '0.816', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '44.000'} [2024-08-05 23:59:56,337][52647] DAMAGECOUNT value on done: 72397.0 [2024-08-05 23:59:56,338][52647] Sum rewards: 44.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.053', 'weapon5': '0.112', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'AMMO4': '0.266', 'weapon4': '0.344', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '40.000'} [2024-08-05 23:59:56,343][52649] DAMAGECOUNT value on done: 63732.0 [2024-08-05 23:59:56,344][52649] Sum rewards: 41.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.902', 'AMMO5': '0.006', 'AMMO2': '0.050', 'weapon4': '0.134', 'weapon5': '0.164', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.252', 'WEAPON4': '0.500', 'weapon2': '0.752', 'WEAPON3': '1.050', 'HITCOUNT': '2.550', 'weapon3': '2.750', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '37.000'} [2024-08-05 23:59:56,603][52662] DAMAGECOUNT value on done: 75238.0 [2024-08-05 23:59:56,603][52662] Sum rewards: 29.726, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.571', 'weapon5': '0.006', 'AMMO5': '0.013', 'ARMOR': '0.048', 'AMMO2': '0.052', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon2': '0.382', 'WEAPON4': '0.600', 'weapon4': '0.910', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.420', 'DAMAGECOUNT': '8.901', 'FRAGCOUNT': '26.000'} [2024-08-05 23:59:56,632][52794] DAMAGECOUNT value on done: 73993.0 [2024-08-05 23:59:56,632][52794] Sum rewards: 29.110, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.972', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.078', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.370', 'WEAPON4': '0.450', 'weapon2': '0.948', 'WEAPON3': '1.350', 'weapon3': '2.350', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.044', 'FRAGCOUNT': '30.000'} [2024-08-05 23:59:57,599][52811] DAMAGECOUNT value on done: 65759.0 [2024-08-05 23:59:57,600][52811] Sum rewards: 39.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.541', 'AMMO5': '0.017', 'ARMOR': '0.036', 'AMMO2': '0.054', 'weapon5': '0.148', 'AMMO3': '0.170', 'AMMO4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.536', 'weapon4': '0.838', 'WEAPON3': '1.050', 'weapon3': '2.218', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.593', 'FRAGCOUNT': '35.500'} [2024-08-05 23:59:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 157753344. Throughput: 0: 4413.3. Samples: 39446960. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-05 23:59:57,794][52567] Avg episode reward: [(0, '46.092')] [2024-08-05 23:59:58,102][52803] DAMAGECOUNT value on done: 68267.0 [2024-08-05 23:59:58,102][52803] Sum rewards: 65.958, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.464', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.161', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '55.000'} [2024-08-05 23:59:58,498][52660] DAMAGECOUNT value on done: 70067.0 [2024-08-05 23:59:58,498][52660] Sum rewards: 38.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.968', 'ARMOR': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.151', 'AMMO4': '0.217', 'WEAPON4': '0.400', 'weapon4': '0.456', 'weapon2': '0.786', 'WEAPON3': '1.050', 'HITCOUNT': '2.390', 'weapon3': '2.564', 'DAMAGECOUNT': '9.978', 'FRAGCOUNT': '33.000'} [2024-08-05 23:59:59,009][52649] DAMAGECOUNT value on done: 71997.0 [2024-08-05 23:59:59,009][52649] Sum rewards: 49.826, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.623', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.168', 'weapon4': '0.384', 'ARMOR': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.828', 'weapon3': '2.434', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '39.000'} [2024-08-05 23:59:59,191][52668] DAMAGECOUNT value on done: 71097.0 [2024-08-05 23:59:59,195][52668] Sum rewards: 55.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO5': '0.013', 'AMMO4': '0.056', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.198', 'AMMO3': '0.229', 'weapon2': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.780', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '47.500'} [2024-08-05 23:59:59,249][52662] DAMAGECOUNT value on done: 72762.0 [2024-08-05 23:59:59,251][52662] Sum rewards: 50.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.442', 'weapon4': '0.002', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'AMMO3': '0.258', 'ARMOR': '0.478', 'weapon2': '0.574', 'WEAPON3': '1.650', 'HITCOUNT': '2.960', 'weapon3': '3.212', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '45.000'} [2024-08-05 23:59:59,257][52794] DAMAGECOUNT value on done: 76766.0 [2024-08-05 23:59:59,257][52794] Sum rewards: 59.164, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.503', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.018', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon4': '0.268', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.878', 'FRAGCOUNT': '48.000'} [2024-08-05 23:59:59,355][52647] DAMAGECOUNT value on done: 71799.0 [2024-08-05 23:59:59,355][52647] Sum rewards: 38.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.269', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.022', 'weapon5': '0.062', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'ARMOR': '0.457', 'weapon2': '0.958', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.782', 'DAMAGECOUNT': '10.743', 'FRAGCOUNT': '32.000'} [2024-08-05 23:59:59,513][52650] Updated weights for policy 0, policy_version 19261 (0.0012) [2024-08-06 00:00:00,704][52811] DAMAGECOUNT value on done: 67402.0 [2024-08-06 00:00:00,706][52811] Sum rewards: 31.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.858', 'AMMO2': '0.025', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.137', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '0.900', 'weapon4': '1.008', 'HITCOUNT': '2.040', 'weapon3': '2.062', 'DAMAGECOUNT': '8.235', 'FRAGCOUNT': '26.000'} [2024-08-06 00:00:00,903][52614] Signal inference workers to stop experience collection... (3600 times) [2024-08-06 00:00:00,908][52614] Signal inference workers to resume experience collection... (3600 times) [2024-08-06 00:00:00,964][52650] InferenceWorker_p0-w0: stopping experience collection (3600 times) [2024-08-06 00:00:00,977][52650] InferenceWorker_p0-w0: resuming experience collection (3600 times) [2024-08-06 00:00:01,256][52803] DAMAGECOUNT value on done: 64095.0 [2024-08-06 00:00:01,257][52803] Sum rewards: 40.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.086', 'AMMO3': '0.158', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON4': '0.450', 'weapon2': '0.688', 'WEAPON3': '0.900', 'HITCOUNT': '2.350', 'weapon3': '2.674', 'DAMAGECOUNT': '9.705', 'FRAGCOUNT': '35.000'} [2024-08-06 00:00:01,557][52660] DAMAGECOUNT value on done: 69512.0 [2024-08-06 00:00:01,557][52660] Sum rewards: 43.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.217', 'AMMO3': '0.220', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '2.626', 'DAMAGECOUNT': '11.418', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:02,056][52649] DAMAGECOUNT value on done: 67443.0 [2024-08-06 00:00:02,056][52649] Sum rewards: 53.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.767', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.218', 'ARMOR': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.364', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '44.000'} [2024-08-06 00:00:02,076][52668] DAMAGECOUNT value on done: 70455.0 [2024-08-06 00:00:02,076][52668] Sum rewards: 55.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.036', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.270', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '48.000'} [2024-08-06 00:00:02,181][52662] DAMAGECOUNT value on done: 72750.0 [2024-08-06 00:00:02,183][52662] Sum rewards: 47.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.215', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO4': '0.162', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.456', 'weapon2': '0.748', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '2.806', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '41.500'} [2024-08-06 00:00:02,276][52794] DAMAGECOUNT value on done: 73667.0 [2024-08-06 00:00:02,277][52794] Sum rewards: 44.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.156', 'weapon4': '0.180', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.200', 'HITCOUNT': '2.540', 'weapon3': '3.080', 'DAMAGECOUNT': '11.217', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:02,497][52647] DAMAGECOUNT value on done: 71284.0 [2024-08-06 00:00:02,498][52647] Sum rewards: 38.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.790', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.410', 'weapon2': '0.538', 'WEAPON3': '1.150', 'HITCOUNT': '2.380', 'weapon3': '2.700', 'DAMAGECOUNT': '9.897', 'FRAGCOUNT': '34.000'} [2024-08-06 00:00:02,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.6, 300 sec: 17578.0). Total num frames: 157835264. Throughput: 0: 4406.8. Samples: 39460080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 00:00:02,795][52567] Avg episode reward: [(0, '46.074')] [2024-08-06 00:00:03,081][52669] DAMAGECOUNT value on done: 72503.0 [2024-08-06 00:00:03,083][52669] Sum rewards: 48.426, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.084', 'AMMO3': '0.162', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'HEALTH': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.540', 'weapon2': '0.620', 'WEAPON3': '0.950', 'weapon3': '2.494', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:03,777][52811] DAMAGECOUNT value on done: 64532.0 [2024-08-06 00:00:03,777][52811] Sum rewards: 56.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.951', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.070', 'weapon4': '0.098', 'AMMO4': '0.120', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '49.000'} [2024-08-06 00:00:03,857][52650] Updated weights for policy 0, policy_version 19271 (0.0018) [2024-08-06 00:00:04,492][52660] DAMAGECOUNT value on done: 68762.0 [2024-08-06 00:00:04,492][52660] Sum rewards: 29.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.634', 'AMMO5': '0.010', 'ARMOR': '0.024', 'weapon7': '0.042', 'AMMO2': '0.067', 'AMMO3': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.250', 'AMMO4': '0.335', 'WEAPON3': '0.650', 'weapon2': '0.712', 'WEAPON4': '0.750', 'weapon4': '0.900', 'weapon3': '1.920', 'HITCOUNT': '2.010', 'DAMAGECOUNT': '8.514', 'FRAGCOUNT': '25.000'} [2024-08-06 00:00:04,775][52662] DAMAGECOUNT value on done: 76745.0 [2024-08-06 00:00:04,777][52662] Sum rewards: 47.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.192', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.201', 'weapon4': '0.304', 'WEAPON4': '0.350', 'ARMOR': '0.472', 'weapon2': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.460', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:04,788][52647] DAMAGECOUNT value on done: 71569.0 [2024-08-06 00:00:04,788][52647] Sum rewards: 56.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.751', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.183', 'WEAPON4': '0.350', 'weapon4': '0.530', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '49.000'} [2024-08-06 00:00:04,858][52794] DAMAGECOUNT value on done: 79706.0 [2024-08-06 00:00:04,858][52794] Sum rewards: 32.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.086', 'AMMO5': '0.010', 'ARMOR': '0.024', 'weapon5': '0.072', 'AMMO2': '0.074', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'AMMO4': '0.368', 'weapon4': '0.442', 'WEAPON4': '0.750', 'weapon2': '0.784', 'WEAPON3': '0.950', 'HITCOUNT': '2.110', 'weapon3': '2.470', 'DAMAGECOUNT': '8.400', 'FRAGCOUNT': '29.000'} [2024-08-06 00:00:05,156][52668] DAMAGECOUNT value on done: 71225.0 [2024-08-06 00:00:05,157][52668] Sum rewards: 55.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.090', 'AMMO3': '0.194', 'weapon2': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.370', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '47.000'} [2024-08-06 00:00:05,266][52649] DAMAGECOUNT value on done: 70480.0 [2024-08-06 00:00:05,266][52649] Sum rewards: 47.661, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.420', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.300', 'ARMOR': '0.456', 'weapon2': '0.548', 'WEAPON3': '0.700', 'weapon4': '0.738', 'weapon3': '2.424', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '37.000'} [2024-08-06 00:00:06,116][52669] DAMAGECOUNT value on done: 70794.0 [2024-08-06 00:00:06,125][52669] Sum rewards: 39.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.046', 'weapon4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon2': '0.534', 'WEAPON3': '0.900', 'HITCOUNT': '2.270', 'weapon3': '3.242', 'DAMAGECOUNT': '10.113', 'FRAGCOUNT': '32.000'} [2024-08-06 00:00:06,699][52811] DAMAGECOUNT value on done: 65489.0 [2024-08-06 00:00:06,699][52811] Sum rewards: 41.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.534', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '3.068', 'DAMAGECOUNT': '10.647', 'FRAGCOUNT': '38.000'} [2024-08-06 00:00:07,319][52660] DAMAGECOUNT value on done: 69809.0 [2024-08-06 00:00:07,320][52660] Sum rewards: 56.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.015', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.124', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.198', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2024-08-06 00:00:07,555][52662] DAMAGECOUNT value on done: 70730.0 [2024-08-06 00:00:07,556][52662] Sum rewards: 50.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.736', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'weapon5': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.556', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.110', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:07,637][52794] DAMAGECOUNT value on done: 71152.0 [2024-08-06 00:00:07,637][52794] Sum rewards: 41.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.380', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.114', 'AMMO4': '0.161', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.630', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.750', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '38.000'} [2024-08-06 00:00:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 157933568. Throughput: 0: 4387.6. Samples: 39485800. Policy #0 lag: (min: 2.0, avg: 4.0, max: 8.0) [2024-08-06 00:00:07,794][52567] Avg episode reward: [(0, '45.755')] [2024-08-06 00:00:07,955][52668] DAMAGECOUNT value on done: 68735.0 [2024-08-06 00:00:07,956][52668] Sum rewards: 56.546, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.765', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.236', 'weapon4': '0.296', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '51.000'} [2024-08-06 00:00:08,162][52649] DAMAGECOUNT value on done: 69457.0 [2024-08-06 00:00:08,163][52649] Sum rewards: 45.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.136', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.162', 'AMMO3': '0.198', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.548', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.858', 'DAMAGECOUNT': '11.784', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:08,209][52647] DAMAGECOUNT value on done: 72146.0 [2024-08-06 00:00:08,210][52647] Sum rewards: 45.191, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.030', 'ARMOR': '0.048', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.552', 'weapon4': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.558', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '36.000'} [2024-08-06 00:00:09,058][52650] Updated weights for policy 0, policy_version 19281 (0.0012) [2024-08-06 00:00:09,353][52669] DAMAGECOUNT value on done: 70825.0 [2024-08-06 00:00:09,354][52669] Sum rewards: 41.398, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.116', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.133', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.256', 'weapon2': '0.386', 'weapon4': '0.470', 'WEAPON3': '0.800', 'HITCOUNT': '2.240', 'weapon3': '2.614', 'DAMAGECOUNT': '10.722', 'FRAGCOUNT': '33.000'} [2024-08-06 00:00:10,088][52660] DAMAGECOUNT value on done: 70231.0 [2024-08-06 00:00:10,089][52660] Sum rewards: 35.567, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.186', 'AMMO5': '0.009', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.252', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon2': '1.066', 'WEAPON3': '1.450', 'HITCOUNT': '1.930', 'weapon3': '2.234', 'DAMAGECOUNT': '10.077', 'FRAGCOUNT': '36.000'} [2024-08-06 00:00:10,384][52662] DAMAGECOUNT value on done: 74970.0 [2024-08-06 00:00:10,385][52662] Sum rewards: 36.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.173', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.123', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.716', 'DAMAGECOUNT': '11.643', 'FRAGCOUNT': '33.000'} [2024-08-06 00:00:10,461][52794] DAMAGECOUNT value on done: 77070.0 [2024-08-06 00:00:10,463][52794] Sum rewards: 41.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO4': '0.140', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.536', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '37.000'} [2024-08-06 00:00:10,563][52668] DAMAGECOUNT value on done: 68112.0 [2024-08-06 00:00:10,564][52668] Sum rewards: 46.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.463', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon5': '0.174', 'ARMOR': '0.420', 'weapon2': '0.490', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '3.074', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:10,844][52647] DAMAGECOUNT value on done: 74131.0 [2024-08-06 00:00:10,845][52647] Sum rewards: 51.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.180', 'weapon4': '0.220', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:11,469][52649] DAMAGECOUNT value on done: 74683.0 [2024-08-06 00:00:11,469][52649] Sum rewards: 55.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.788', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.330', 'ARMOR': '0.412', 'weapon2': '0.800', 'WEAPON3': '1.050', 'weapon3': '2.636', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '45.000'} [2024-08-06 00:00:12,172][52667] DAMAGECOUNT value on done: 71195.0 [2024-08-06 00:00:12,174][52667] Sum rewards: 58.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.642', 'AMMO2': '0.001', 'AMMO4': '0.003', 'ARMOR': '0.012', 'WEAPON4': '0.100', 'weapon4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.272', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.000'} [2024-08-06 00:00:12,218][52669] DAMAGECOUNT value on done: 70536.0 [2024-08-06 00:00:12,218][52669] Sum rewards: 56.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.855', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.060', 'AMMO3': '0.168', 'weapon4': '0.204', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.974', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '49.000'} [2024-08-06 00:00:12,794][52567] Fps is (10 sec: 18842.9, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 158023680. Throughput: 0: 4387.6. Samples: 39512470. Policy #0 lag: (min: 2.0, avg: 4.0, max: 8.0) [2024-08-06 00:00:12,794][52567] Avg episode reward: [(0, '46.325')] [2024-08-06 00:00:12,801][52660] DAMAGECOUNT value on done: 76080.0 [2024-08-06 00:00:12,801][52660] Sum rewards: 42.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.545', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.144', 'AMMO4': '0.245', 'weapon5': '0.260', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.714', 'WEAPON3': '0.900', 'HITCOUNT': '2.370', 'weapon3': '2.528', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '36.000'} [2024-08-06 00:00:12,850][52662] DAMAGECOUNT value on done: 76304.0 [2024-08-06 00:00:12,852][52662] Sum rewards: 47.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.336', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO4': '0.186', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON4': '0.550', 'weapon4': '0.642', 'WEAPON3': '1.400', 'weapon3': '2.474', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:12,994][52794] DAMAGECOUNT value on done: 77792.0 [2024-08-06 00:00:12,996][52794] Sum rewards: 51.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.154', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.033', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'weapon4': '0.180', 'AMMO3': '0.229', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.118', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '46.000'} [2024-08-06 00:00:13,063][52795] DAMAGECOUNT value on done: 65952.0 [2024-08-06 00:00:13,063][52795] Sum rewards: 26.843, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.338', 'weapon2': '0.782', 'WEAPON3': '1.000', 'HITCOUNT': '2.030', 'weapon3': '2.724', 'DAMAGECOUNT': '8.019', 'FRAGCOUNT': '23.000'} [2024-08-06 00:00:13,390][52650] Updated weights for policy 0, policy_version 19291 (0.0038) [2024-08-06 00:00:13,405][52647] DAMAGECOUNT value on done: 73233.0 [2024-08-06 00:00:13,406][52647] Sum rewards: 56.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.372', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon4': '0.228', 'weapon2': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.064', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '48.000'} [2024-08-06 00:00:13,663][52668] DAMAGECOUNT value on done: 72976.0 [2024-08-06 00:00:13,664][52668] Sum rewards: 40.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.048', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.053', 'weapon5': '0.098', 'weapon4': '0.120', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'WEAPON4': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.450', 'HITCOUNT': '2.380', 'weapon3': '2.970', 'DAMAGECOUNT': '11.148', 'FRAGCOUNT': '37.000'} [2024-08-06 00:00:15,107][52667] DAMAGECOUNT value on done: 74300.0 [2024-08-06 00:00:15,108][52667] Sum rewards: 57.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.166', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.070', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.632', 'WEAPON3': '1.650', 'weapon3': '2.528', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '51.000'} [2024-08-06 00:00:15,409][52669] DAMAGECOUNT value on done: 72000.0 [2024-08-06 00:00:15,411][52669] Sum rewards: 45.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.162', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.604', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '2.970', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:15,769][52660] DAMAGECOUNT value on done: 69418.0 [2024-08-06 00:00:15,769][52660] Sum rewards: 46.074, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.332', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.312', 'weapon2': '0.390', 'ARMOR': '0.412', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '2.996', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:15,993][52662] DAMAGECOUNT value on done: 74434.0 [2024-08-06 00:00:15,994][52662] Sum rewards: 49.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.436', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.094', 'AMMO3': '0.160', 'weapon2': '0.340', 'WEAPON3': '1.000', 'HITCOUNT': '2.720', 'weapon3': '3.350', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:16,135][52794] DAMAGECOUNT value on done: 75939.0 [2024-08-06 00:00:16,136][52794] Sum rewards: 51.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '46.000'} [2024-08-06 00:00:16,138][52647] DAMAGECOUNT value on done: 71039.0 [2024-08-06 00:00:16,138][52647] Sum rewards: 42.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.428', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.044', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.318', 'weapon2': '0.384', 'WEAPON4': '0.400', 'ARMOR': '0.428', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '3.032', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '38.000'} [2024-08-06 00:00:16,305][52795] DAMAGECOUNT value on done: 61703.0 [2024-08-06 00:00:16,306][52795] Sum rewards: 43.715, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.803', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.032', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.424', 'ARMOR': '0.489', 'WEAPON3': '1.550', 'HITCOUNT': '2.750', 'weapon3': '2.922', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:16,532][52668] DAMAGECOUNT value on done: 72703.0 [2024-08-06 00:00:16,541][52668] Sum rewards: 52.026, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon5': '0.176', 'WEAPON4': '0.300', 'ARMOR': '0.416', 'weapon2': '0.556', 'weapon4': '0.588', 'HEALTH': '0.827', 'WEAPON3': '0.850', 'weapon3': '2.472', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 158105600. Throughput: 0: 4394.2. Samples: 39525670. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:00:17,794][52567] Avg episode reward: [(0, '46.363')] [2024-08-06 00:00:17,859][52667] DAMAGECOUNT value on done: 70131.0 [2024-08-06 00:00:17,860][52667] Sum rewards: 45.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'weapon5': '0.038', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.194', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '39.500'} [2024-08-06 00:00:18,091][52650] Updated weights for policy 0, policy_version 19301 (0.0010) [2024-08-06 00:00:18,253][52660] DAMAGECOUNT value on done: 71280.0 [2024-08-06 00:00:18,255][52660] Sum rewards: 45.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.704', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.170', 'AMMO4': '0.197', 'weapon5': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.484', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '2.354', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '37.500'} [2024-08-06 00:00:18,463][52669] DAMAGECOUNT value on done: 73651.0 [2024-08-06 00:00:18,466][52669] Sum rewards: 62.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'ARMOR': '0.013', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.185', 'AMMO3': '0.189', 'weapon2': '0.364', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '52.000'} [2024-08-06 00:00:19,007][52794] DAMAGECOUNT value on done: 78242.0 [2024-08-06 00:00:19,007][52794] Sum rewards: 43.713, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.017', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.145', 'ARMOR': '0.400', 'weapon2': '0.718', 'WEAPON3': '0.850', 'HITCOUNT': '2.360', 'weapon3': '3.188', 'DAMAGECOUNT': '10.524', 'FRAGCOUNT': '36.000'} [2024-08-06 00:00:19,113][52647] DAMAGECOUNT value on done: 72489.0 [2024-08-06 00:00:19,114][52647] Sum rewards: 46.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.208', 'weapon4': '0.394', 'WEAPON4': '0.400', 'weapon2': '0.680', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.756', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:19,449][52795] DAMAGECOUNT value on done: 63521.0 [2024-08-06 00:00:19,450][52795] Sum rewards: 44.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'AMMO2': '0.031', 'ARMOR': '0.040', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.171', 'weapon4': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:20,562][52667] DAMAGECOUNT value on done: 69980.0 [2024-08-06 00:00:20,563][52667] Sum rewards: 37.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.056', 'weapon5': '0.096', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'weapon4': '0.354', 'WEAPON4': '0.650', 'weapon2': '0.680', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.596', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '34.000'} [2024-08-06 00:00:20,897][52669] DAMAGECOUNT value on done: 70510.0 [2024-08-06 00:00:20,898][52669] Sum rewards: 37.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.621', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.164', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.246', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.704', 'weapon2': '0.748', 'WEAPON3': '1.100', 'HITCOUNT': '2.200', 'weapon3': '2.214', 'DAMAGECOUNT': '10.686', 'FRAGCOUNT': '33.000'} [2024-08-06 00:00:21,386][52660] DAMAGECOUNT value on done: 68402.0 [2024-08-06 00:00:21,389][52660] Sum rewards: 47.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.749', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.058', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'WEAPON4': '0.400', 'ARMOR': '0.479', 'weapon4': '0.532', 'weapon2': '0.706', 'WEAPON3': '1.050', 'HITCOUNT': '2.390', 'weapon3': '2.468', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:21,585][52647] DAMAGECOUNT value on done: 72170.0 [2024-08-06 00:00:21,593][52647] Sum rewards: 52.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.122', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.540', 'weapon2': '0.716', 'WEAPON3': '0.900', 'weapon3': '2.352', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '44.000'} [2024-08-06 00:00:21,940][52794] DAMAGECOUNT value on done: 74757.0 [2024-08-06 00:00:21,941][52794] Sum rewards: 44.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.328', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon5': '0.166', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:22,621][52795] DAMAGECOUNT value on done: 66194.0 [2024-08-06 00:00:22,621][52795] Sum rewards: 39.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.129', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.372', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '35.000'} [2024-08-06 00:00:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 158187520. Throughput: 0: 4384.9. Samples: 39552040. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:00:22,794][52567] Avg episode reward: [(0, '46.439')] [2024-08-06 00:00:23,053][52650] Updated weights for policy 0, policy_version 19311 (0.0015) [2024-08-06 00:00:23,121][52667] DAMAGECOUNT value on done: 73740.0 [2024-08-06 00:00:23,123][52667] Sum rewards: 45.739, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.230', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.082', 'weapon4': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.568', 'ARMOR': '0.873', 'WEAPON3': '1.750', 'weapon3': '2.970', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:23,856][52669] DAMAGECOUNT value on done: 70787.0 [2024-08-06 00:00:23,856][52669] Sum rewards: 47.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.348', 'weapon4': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.221', 'ARMOR': '0.456', 'weapon2': '0.548', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.270', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:24,251][52647] DAMAGECOUNT value on done: 71970.0 [2024-08-06 00:00:24,251][52647] Sum rewards: 49.926, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.706', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.268', 'ARMOR': '0.400', 'weapon2': '0.932', 'WEAPON3': '0.950', 'weapon3': '2.504', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:24,543][52660] DAMAGECOUNT value on done: 73399.0 [2024-08-06 00:00:24,545][52660] Sum rewards: 41.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'weapon4': '0.404', 'weapon2': '0.818', 'WEAPON3': '1.550', 'weapon3': '2.510', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:25,747][52795] DAMAGECOUNT value on done: 67420.0 [2024-08-06 00:00:25,748][52795] Sum rewards: 46.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.843', 'AMMO5': '0.006', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.216', 'weapon2': '0.660', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.764', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '38.500'} [2024-08-06 00:00:26,075][52667] DAMAGECOUNT value on done: 72504.0 [2024-08-06 00:00:26,075][52667] Sum rewards: 43.638, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.654', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.068', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'weapon4': '0.360', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.916', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:26,902][52669] DAMAGECOUNT value on done: 71302.0 [2024-08-06 00:00:26,905][52669] Sum rewards: 55.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.996', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon4': '0.224', 'weapon2': '0.360', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.214', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '49.000'} [2024-08-06 00:00:27,090][52660] DAMAGECOUNT value on done: 69370.0 [2024-08-06 00:00:27,091][52660] Sum rewards: 48.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon5': '0.052', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:27,281][52650] Updated weights for policy 0, policy_version 19321 (0.0014) [2024-08-06 00:00:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 158285824. Throughput: 0: 4384.7. Samples: 39578380. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:00:27,794][52567] Avg episode reward: [(0, '46.617')] [2024-08-06 00:00:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019322_158285824.pth... [2024-08-06 00:00:27,920][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000018806_154058752.pth [2024-08-06 00:00:28,815][52667] DAMAGECOUNT value on done: 72792.0 [2024-08-06 00:00:28,816][52667] Sum rewards: 51.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.965', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.178', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.628', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '45.500'} [2024-08-06 00:00:28,917][52795] DAMAGECOUNT value on done: 66755.0 [2024-08-06 00:00:28,918][52795] Sum rewards: 51.811, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.178', 'weapon4': '0.222', 'weapon2': '0.698', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '2.748', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '44.000'} [2024-08-06 00:00:29,719][52669] DAMAGECOUNT value on done: 69046.0 [2024-08-06 00:00:29,719][52669] Sum rewards: 46.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.256', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.142', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.556', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '2.792', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:31,295][52667] DAMAGECOUNT value on done: 71397.0 [2024-08-06 00:00:31,296][52667] Sum rewards: 38.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.196', 'AMMO3': '0.240', 'weapon2': '0.390', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.128', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '35.000'} [2024-08-06 00:00:32,035][52795] DAMAGECOUNT value on done: 68768.0 [2024-08-06 00:00:32,036][52795] Sum rewards: 47.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.828', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.654', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:32,296][52650] Updated weights for policy 0, policy_version 19331 (0.0014) [2024-08-06 00:00:32,614][52669] DAMAGECOUNT value on done: 73531.0 [2024-08-06 00:00:32,614][52669] Sum rewards: 44.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.176', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.195', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.556', 'weapon2': '0.776', 'WEAPON3': '1.100', 'weapon3': '2.436', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '37.000'} [2024-08-06 00:00:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 158367744. Throughput: 0: 4375.8. Samples: 39591400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 00:00:32,794][52567] Avg episode reward: [(0, '46.597')] [2024-08-06 00:00:34,199][52667] DAMAGECOUNT value on done: 70708.0 [2024-08-06 00:00:34,200][52667] Sum rewards: 47.797, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.696', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.219', 'WEAPON4': '0.400', 'weapon2': '0.614', 'weapon4': '0.706', 'WEAPON3': '1.300', 'weapon3': '2.254', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '44.000'} [2024-08-06 00:00:35,224][52795] DAMAGECOUNT value on done: 66340.0 [2024-08-06 00:00:35,224][52795] Sum rewards: 45.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.710', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.080', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.370', 'WEAPON4': '0.550', 'weapon4': '0.826', 'WEAPON3': '1.450', 'weapon3': '2.506', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:35,438][52669] DAMAGECOUNT value on done: 73005.0 [2024-08-06 00:00:35,439][52669] Sum rewards: 49.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'AMMO4': '0.235', 'weapon2': '0.570', 'WEAPON4': '0.600', 'weapon4': '0.770', 'WEAPON3': '1.150', 'weapon3': '2.364', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '44.000'} [2024-08-06 00:00:36,916][52650] Updated weights for policy 0, policy_version 19341 (0.0014) [2024-08-06 00:00:37,149][52667] DAMAGECOUNT value on done: 73060.0 [2024-08-06 00:00:37,158][52667] Sum rewards: 52.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.355', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.150', 'AMMO3': '0.227', 'AMMO4': '0.273', 'WEAPON5': '0.400', 'weapon4': '0.448', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.636', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '45.000'} [2024-08-06 00:00:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 158457856. Throughput: 0: 4392.0. Samples: 39618160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 00:00:37,794][52567] Avg episode reward: [(0, '46.574')] [2024-08-06 00:00:38,036][52669] DAMAGECOUNT value on done: 69634.0 [2024-08-06 00:00:38,036][52669] Sum rewards: 41.780, reward structure: {'DEATHCOUNT': '-15.750', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.046', 'HEALTH': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.336', 'weapon2': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.662', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '37.000'} [2024-08-06 00:00:38,258][52795] DAMAGECOUNT value on done: 63427.0 [2024-08-06 00:00:38,259][52795] Sum rewards: 66.208, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.652', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'AMMO3': '0.145', 'ARMOR': '0.400', 'weapon2': '0.960', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '54.000'} [2024-08-06 00:00:40,228][52667] DAMAGECOUNT value on done: 71530.0 [2024-08-06 00:00:40,230][52667] Sum rewards: 38.260, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.740', 'AMMO5': '0.029', 'ARMOR': '0.040', 'weapon4': '0.052', 'AMMO2': '0.056', 'weapon5': '0.152', 'AMMO3': '0.256', 'AMMO4': '0.280', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.794', 'WEAPON3': '1.500', 'HITCOUNT': '2.410', 'weapon3': '2.722', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:40,454][52669] DAMAGECOUNT value on done: 72128.0 [2024-08-06 00:00:40,456][52669] Sum rewards: 38.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.094', 'AMMO5': '0.010', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.202', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.650', 'HITCOUNT': '2.390', 'weapon3': '3.096', 'DAMAGECOUNT': '10.842', 'FRAGCOUNT': '37.000'} [2024-08-06 00:00:41,331][52650] Updated weights for policy 0, policy_version 19351 (0.0038) [2024-08-06 00:00:41,498][52795] DAMAGECOUNT value on done: 67317.0 [2024-08-06 00:00:41,500][52795] Sum rewards: 43.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.026', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.024', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.209', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '2.996', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 158539776. Throughput: 0: 4388.9. Samples: 39644460. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 00:00:42,794][52567] Avg episode reward: [(0, '46.281')] [2024-08-06 00:00:43,064][52669] DAMAGECOUNT value on done: 74970.0 [2024-08-06 00:00:43,065][52669] Sum rewards: 46.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.408', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.390', 'weapon2': '0.446', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.842', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:43,279][52667] DAMAGECOUNT value on done: 69195.0 [2024-08-06 00:00:43,279][52667] Sum rewards: 33.943, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.074', 'weapon7': '0.074', 'AMMO3': '0.085', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.820', 'weapon4': '1.204', 'weapon3': '1.504', 'HITCOUNT': '1.780', 'DAMAGECOUNT': '8.067', 'FRAGCOUNT': '27.000'} [2024-08-06 00:00:44,338][52658] DAMAGECOUNT value on done: 74005.0 [2024-08-06 00:00:44,340][52658] Sum rewards: 38.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.137', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.162', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.648', 'weapon4': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.280', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '33.500'} [2024-08-06 00:00:44,662][52795] DAMAGECOUNT value on done: 67878.0 [2024-08-06 00:00:44,662][52795] Sum rewards: 62.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.407', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO4': '0.144', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.354', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '52.000'} [2024-08-06 00:00:45,359][52665] DAMAGECOUNT value on done: 68065.0 [2024-08-06 00:00:45,360][52665] Sum rewards: 59.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.194', 'AMMO2': '0.010', 'ARMOR': '0.036', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon4': '0.216', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '3.036', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '49.000'} [2024-08-06 00:00:45,592][52669] DAMAGECOUNT value on done: 76794.0 [2024-08-06 00:00:45,592][52669] Sum rewards: 51.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.397', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.282', 'ARMOR': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.146', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:46,163][52650] Updated weights for policy 0, policy_version 19361 (0.0048) [2024-08-06 00:00:46,572][52667] DAMAGECOUNT value on done: 71913.0 [2024-08-06 00:00:46,572][52667] Sum rewards: 50.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.341', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.164', 'AMMO4': '0.185', 'AMMO3': '0.186', 'weapon5': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:47,170][52666] DAMAGECOUNT value on done: 70819.0 [2024-08-06 00:00:47,172][52666] Sum rewards: 48.814, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.142', 'weapon4': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.866', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '2.896', 'DAMAGECOUNT': '11.361', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:47,461][52658] DAMAGECOUNT value on done: 71764.0 [2024-08-06 00:00:47,462][52658] Sum rewards: 53.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.483', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.158', 'AMMO3': '0.193', 'WEAPON4': '0.400', 'weapon4': '0.444', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '45.000'} [2024-08-06 00:00:47,774][52795] DAMAGECOUNT value on done: 64226.0 [2024-08-06 00:00:47,774][52795] Sum rewards: 50.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.407', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.270', 'ARMOR': '0.459', 'weapon2': '0.468', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.060', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:47,778][52665] DAMAGECOUNT value on done: 74756.0 [2024-08-06 00:00:47,780][52665] Sum rewards: 44.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.794', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.668', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.048', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 158629888. Throughput: 0: 4391.2. Samples: 39657680. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:00:47,794][52567] Avg episode reward: [(0, '46.982')] [2024-08-06 00:00:47,869][52614] Saving new best policy, reward=46.982! [2024-08-06 00:00:48,553][52669] DAMAGECOUNT value on done: 73056.0 [2024-08-06 00:00:48,553][52669] Sum rewards: 57.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.275', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.060', 'AMMO4': '0.122', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '48.000'} [2024-08-06 00:00:49,269][52667] DAMAGECOUNT value on done: 69565.0 [2024-08-06 00:00:49,270][52667] Sum rewards: 46.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.041', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.143', 'weapon4': '0.158', 'weapon5': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.570', 'WEAPON3': '0.900', 'weapon3': '2.908', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '37.000'} [2024-08-06 00:00:50,045][52658] DAMAGECOUNT value on done: 72028.0 [2024-08-06 00:00:50,047][52658] Sum rewards: 48.679, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.242', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'weapon5': '0.374', 'weapon2': '0.386', 'weapon4': '0.436', 'ARMOR': '0.463', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.598', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:50,132][52666] DAMAGECOUNT value on done: 72358.0 [2024-08-06 00:00:50,132][52666] Sum rewards: 48.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.450', 'weapon2': '0.594', 'weapon4': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.314', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:50,893][52650] Updated weights for policy 0, policy_version 19371 (0.0013) [2024-08-06 00:00:50,945][52795] DAMAGECOUNT value on done: 66076.0 [2024-08-06 00:00:50,946][52795] Sum rewards: 43.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.032', 'ARMOR': '0.008', 'AMMO2': '0.043', 'AMMO3': '0.179', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'weapon4': '0.460', 'weapon2': '0.736', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '2.578', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '39.000'} [2024-08-06 00:00:51,103][52669] DAMAGECOUNT value on done: 72234.0 [2024-08-06 00:00:51,103][52669] Sum rewards: 40.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.219', 'weapon2': '0.364', 'weapon4': '0.548', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.818', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '36.000'} [2024-08-06 00:00:51,165][52665] DAMAGECOUNT value on done: 71528.0 [2024-08-06 00:00:51,167][52665] Sum rewards: 51.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.178', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '3.136', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '45.000'} [2024-08-06 00:00:52,128][52667] DAMAGECOUNT value on done: 71733.0 [2024-08-06 00:00:52,130][52667] Sum rewards: 46.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO3': '0.198', 'weapon2': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '2.380', 'weapon3': '3.210', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:52,773][52658] DAMAGECOUNT value on done: 71763.0 [2024-08-06 00:00:52,773][52658] Sum rewards: 49.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.175', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 158720000. Throughput: 0: 4402.0. Samples: 39683890. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:00:52,795][52567] Avg episode reward: [(0, '47.035')] [2024-08-06 00:00:52,795][52614] Saving new best policy, reward=47.035! [2024-08-06 00:00:52,982][52666] DAMAGECOUNT value on done: 71950.0 [2024-08-06 00:00:52,984][52666] Sum rewards: 51.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.325', 'AMMO2': '0.021', 'ARMOR': '0.036', 'AMMO4': '0.104', 'AMMO3': '0.215', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.238', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '45.000'} [2024-08-06 00:00:53,508][52663] DAMAGECOUNT value on done: 72786.0 [2024-08-06 00:00:53,509][52663] Sum rewards: 47.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.670', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.051', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.894', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '2.866', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:53,632][52665] DAMAGECOUNT value on done: 69374.0 [2024-08-06 00:00:53,633][52665] Sum rewards: 44.433, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.740', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon5': '0.030', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon4': '0.192', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.180', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:53,958][52795] DAMAGECOUNT value on done: 67764.0 [2024-08-06 00:00:53,959][52795] Sum rewards: 45.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.177', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.522', 'weapon2': '0.706', 'WEAPON3': '1.050', 'weapon3': '2.344', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '40.000'} [2024-08-06 00:00:54,065][52669] DAMAGECOUNT value on done: 72603.0 [2024-08-06 00:00:54,069][52669] Sum rewards: 50.919, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.692', 'AMMO2': '0.015', 'ARMOR': '0.028', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.600', 'weapon4': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.562', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:55,002][52667] DAMAGECOUNT value on done: 78208.0 [2024-08-06 00:00:55,004][52667] Sum rewards: 59.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.118', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.272', 'ARMOR': '0.430', 'weapon2': '0.448', 'WEAPON3': '1.700', 'HITCOUNT': '3.050', 'weapon3': '3.310', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '52.000'} [2024-08-06 00:00:55,184][52670] DAMAGECOUNT value on done: 68551.0 [2024-08-06 00:00:55,185][52670] Sum rewards: 43.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.747', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.153', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'ARMOR': '0.416', 'WEAPON4': '0.450', 'weapon4': '0.532', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '2.604', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '37.500'} [2024-08-06 00:00:55,379][52650] Updated weights for policy 0, policy_version 19381 (0.0012) [2024-08-06 00:00:55,816][52658] DAMAGECOUNT value on done: 74114.0 [2024-08-06 00:00:55,819][52658] Sum rewards: 53.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.951', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO3': '0.136', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.440', 'weapon4': '0.612', 'WEAPON3': '0.850', 'weapon3': '2.662', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:56,072][52666] DAMAGECOUNT value on done: 66295.0 [2024-08-06 00:00:56,073][52666] Sum rewards: 44.600, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.051', 'weapon5': '0.124', 'AMMO3': '0.206', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'weapon4': '0.532', 'weapon2': '0.570', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:56,601][52663] DAMAGECOUNT value on done: 71143.0 [2024-08-06 00:00:56,601][52663] Sum rewards: 49.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.189', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.776', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:56,700][52665] DAMAGECOUNT value on done: 69574.0 [2024-08-06 00:00:56,700][52665] Sum rewards: 49.742, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.009', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.230', 'weapon2': '0.322', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '3.106', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '41.000'} [2024-08-06 00:00:57,053][52795] DAMAGECOUNT value on done: 63734.0 [2024-08-06 00:00:57,054][52795] Sum rewards: 38.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.232', 'ARMOR': '0.004', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.582', 'WEAPON3': '1.100', 'HITCOUNT': '2.380', 'weapon3': '2.900', 'DAMAGECOUNT': '10.536', 'FRAGCOUNT': '35.000'} [2024-08-06 00:00:57,129][52669] DAMAGECOUNT value on done: 72533.0 [2024-08-06 00:00:57,131][52669] Sum rewards: 46.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.193', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon4': '0.542', 'weapon2': '0.822', 'WEAPON3': '1.200', 'weapon3': '2.424', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '42.000'} [2024-08-06 00:00:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 158810112. Throughput: 0: 4392.9. Samples: 39710150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:00:57,794][52567] Avg episode reward: [(0, '47.274')] [2024-08-06 00:00:57,797][52614] Saving new best policy, reward=47.274! [2024-08-06 00:00:57,899][52667] DAMAGECOUNT value on done: 72861.0 [2024-08-06 00:00:57,900][52667] Sum rewards: 49.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'ARMOR': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.178', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:58,063][52670] DAMAGECOUNT value on done: 73651.0 [2024-08-06 00:00:58,063][52670] Sum rewards: 63.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.044', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.008', 'AMMO4': '0.021', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.244', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.316', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '56.000'} [2024-08-06 00:00:58,892][52658] DAMAGECOUNT value on done: 68830.0 [2024-08-06 00:00:58,895][52658] Sum rewards: 49.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.366', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.248', 'ARMOR': '0.469', 'weapon2': '0.656', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '43.000'} [2024-08-06 00:00:58,962][52666] DAMAGECOUNT value on done: 68990.0 [2024-08-06 00:00:58,962][52666] Sum rewards: 42.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.158', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.030', 'AMMO4': '0.046', 'weapon4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'ARMOR': '0.416', 'weapon2': '0.724', 'WEAPON3': '1.200', 'HITCOUNT': '2.240', 'weapon3': '3.018', 'DAMAGECOUNT': '10.725', 'FRAGCOUNT': '38.000'} [2024-08-06 00:00:59,229][52663] DAMAGECOUNT value on done: 72343.0 [2024-08-06 00:00:59,229][52663] Sum rewards: 39.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.613', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon2': '0.944', 'WEAPON3': '1.150', 'HITCOUNT': '2.380', 'weapon3': '2.866', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '34.000'} [2024-08-06 00:00:59,819][52665] DAMAGECOUNT value on done: 72096.0 [2024-08-06 00:00:59,819][52665] Sum rewards: 40.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.456', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO4': '0.206', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'weapon4': '0.490', 'weapon2': '0.534', 'WEAPON3': '1.500', 'HITCOUNT': '2.680', 'weapon3': '2.702', 'DAMAGECOUNT': '11.364', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:00,036][52650] Updated weights for policy 0, policy_version 19391 (0.0013) [2024-08-06 00:01:00,169][52795] DAMAGECOUNT value on done: 67664.0 [2024-08-06 00:01:00,172][52795] Sum rewards: 50.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.325', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'AMMO3': '0.194', 'weapon4': '0.294', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '3.252', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '43.000'} [2024-08-06 00:01:00,716][52670] DAMAGECOUNT value on done: 70770.0 [2024-08-06 00:01:00,718][52670] Sum rewards: 35.053, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.072', 'AMMO4': '0.158', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.000', 'HITCOUNT': '2.250', 'weapon3': '2.884', 'DAMAGECOUNT': '9.975', 'FRAGCOUNT': '30.000'} [2024-08-06 00:01:01,140][52667] DAMAGECOUNT value on done: 76772.0 [2024-08-06 00:01:01,142][52667] Sum rewards: 51.026, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.375', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.126', 'weapon4': '0.172', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.706', 'WEAPON3': '1.600', 'weapon3': '2.698', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '48.000'} [2024-08-06 00:01:01,794][52658] DAMAGECOUNT value on done: 76215.0 [2024-08-06 00:01:01,796][52658] Sum rewards: 40.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.502', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.024', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.686', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.724', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '36.000'} [2024-08-06 00:01:01,847][52666] DAMAGECOUNT value on done: 67719.0 [2024-08-06 00:01:01,848][52666] Sum rewards: 43.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.199', 'weapon4': '0.282', 'WEAPON4': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '2.930', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:02,460][52663] DAMAGECOUNT value on done: 72382.0 [2024-08-06 00:01:02,460][52663] Sum rewards: 50.659, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.712', 'WEAPON3': '1.300', 'weapon3': '2.690', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '47.000'} [2024-08-06 00:01:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17613.0, 300 sec: 17578.1). Total num frames: 158892032. Throughput: 0: 4389.3. Samples: 39723190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:01:02,794][52567] Avg episode reward: [(0, '47.472')] [2024-08-06 00:01:02,815][52614] Saving new best policy, reward=47.472! [2024-08-06 00:01:03,070][52665] DAMAGECOUNT value on done: 72943.0 [2024-08-06 00:01:03,071][52665] Sum rewards: 51.705, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'ARMOR': '0.457', 'weapon2': '0.492', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.286', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '41.500'} [2024-08-06 00:01:03,375][52795] DAMAGECOUNT value on done: 70478.0 [2024-08-06 00:01:03,376][52795] Sum rewards: 58.068, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.837', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon5': '0.146', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.278', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '50.000'} [2024-08-06 00:01:03,731][52667] DAMAGECOUNT value on done: 71132.0 [2024-08-06 00:01:03,731][52667] Sum rewards: 51.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.213', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.228', 'weapon2': '0.662', 'WEAPON3': '0.900', 'weapon3': '2.858', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:03,995][52670] DAMAGECOUNT value on done: 70442.0 [2024-08-06 00:01:03,995][52670] Sum rewards: 50.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon4': '0.202', 'AMMO3': '0.215', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.734', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:04,409][52658] DAMAGECOUNT value on done: 71298.0 [2024-08-06 00:01:04,413][52658] Sum rewards: 45.427, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.782', 'AMMO5': '0.011', 'AMMO2': '0.049', 'AMMO3': '0.184', 'weapon5': '0.186', 'AMMO4': '0.245', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.624', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.670', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:04,943][52650] Updated weights for policy 0, policy_version 19401 (0.0012) [2024-08-06 00:01:05,012][52666] DAMAGECOUNT value on done: 68057.0 [2024-08-06 00:01:05,014][52666] Sum rewards: 52.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.341', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.222', 'weapon2': '0.460', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.138', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '45.000'} [2024-08-06 00:01:05,299][52663] DAMAGECOUNT value on done: 69758.0 [2024-08-06 00:01:05,299][52663] Sum rewards: 48.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.484', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.193', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:06,115][52665] DAMAGECOUNT value on done: 72190.0 [2024-08-06 00:01:06,116][52665] Sum rewards: 42.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.050', 'weapon5': '0.114', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.251', 'weapon2': '0.506', 'weapon4': '0.690', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.452', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.901', 'FRAGCOUNT': '37.000'} [2024-08-06 00:01:06,474][52667] DAMAGECOUNT value on done: 74627.0 [2024-08-06 00:01:06,476][52667] Sum rewards: 54.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.062', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.542', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.166', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '46.000'} [2024-08-06 00:01:06,528][52795] DAMAGECOUNT value on done: 64233.0 [2024-08-06 00:01:06,529][52795] Sum rewards: 51.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.562', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.160', 'AMMO3': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.430', 'weapon2': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:06,990][52670] DAMAGECOUNT value on done: 68993.0 [2024-08-06 00:01:06,992][52670] Sum rewards: 47.906, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.806', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.390', 'weapon2': '0.660', 'WEAPON3': '0.900', 'HITCOUNT': '2.440', 'weapon3': '2.794', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:07,125][52658] DAMAGECOUNT value on done: 73430.0 [2024-08-06 00:01:07,125][52658] Sum rewards: 41.367, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.608', 'AMMO5': '0.011', 'ARMOR': '0.028', 'AMMO2': '0.052', 'weapon5': '0.128', 'AMMO4': '0.260', 'WEAPON5': '0.300', 'AMMO3': '0.322', 'weapon4': '0.390', 'weapon2': '0.502', 'WEAPON4': '0.600', 'WEAPON3': '1.900', 'weapon3': '2.662', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:07,659][52666] DAMAGECOUNT value on done: 68843.0 [2024-08-06 00:01:07,661][52666] Sum rewards: 37.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.923', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO4': '0.178', 'AMMO3': '0.182', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.754', 'WEAPON3': '1.050', 'HITCOUNT': '2.120', 'weapon3': '2.588', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '33.000'} [2024-08-06 00:01:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 158982144. Throughput: 0: 4382.4. Samples: 39749250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:01:07,795][52567] Avg episode reward: [(0, '47.475')] [2024-08-06 00:01:07,797][52614] Saving new best policy, reward=47.475! [2024-08-06 00:01:08,445][52663] DAMAGECOUNT value on done: 74711.0 [2024-08-06 00:01:08,446][52663] Sum rewards: 51.902, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.912', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.074', 'weapon4': '0.112', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.236', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '45.000'} [2024-08-06 00:01:08,896][52665] DAMAGECOUNT value on done: 75023.0 [2024-08-06 00:01:08,897][52665] Sum rewards: 56.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.232', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.366', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.178', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '49.000'} [2024-08-06 00:01:09,376][52650] Updated weights for policy 0, policy_version 19411 (0.0013) [2024-08-06 00:01:09,548][52795] DAMAGECOUNT value on done: 67146.0 [2024-08-06 00:01:09,549][52795] Sum rewards: 50.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.130', 'AMMO3': '0.203', 'weapon2': '1.162', 'WEAPON3': '1.200', 'weapon3': '2.556', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:09,795][52670] DAMAGECOUNT value on done: 72756.0 [2024-08-06 00:01:09,795][52670] Sum rewards: 46.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.326', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.332', 'weapon2': '0.414', 'WEAPON3': '1.050', 'HITCOUNT': '2.430', 'weapon3': '2.926', 'DAMAGECOUNT': '11.844', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:10,117][52658] DAMAGECOUNT value on done: 73147.0 [2024-08-06 00:01:10,118][52658] Sum rewards: 46.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.176', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.170', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon4': '0.506', 'weapon2': '0.714', 'WEAPON3': '1.300', 'weapon3': '2.494', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:10,521][52666] DAMAGECOUNT value on done: 73684.0 [2024-08-06 00:01:10,521][52666] Sum rewards: 51.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.272', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '2.932', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:11,104][52663] DAMAGECOUNT value on done: 76897.0 [2024-08-06 00:01:11,105][52663] Sum rewards: 45.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.931', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.192', 'AMMO4': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:11,989][52665] DAMAGECOUNT value on done: 72782.0 [2024-08-06 00:01:11,991][52665] Sum rewards: 44.936, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.766', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.128', 'weapon5': '0.210', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.778', 'WEAPON3': '0.900', 'HITCOUNT': '2.460', 'weapon3': '2.550', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '36.000'} [2024-08-06 00:01:12,603][52670] DAMAGECOUNT value on done: 68090.0 [2024-08-06 00:01:12,604][52670] Sum rewards: 45.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.126', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon5': '0.090', 'AMMO3': '0.167', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.450', 'weapon2': '0.724', 'WEAPON3': '1.050', 'HITCOUNT': '2.660', 'weapon3': '2.806', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:12,641][52795] DAMAGECOUNT value on done: 69217.0 [2024-08-06 00:01:12,642][52795] Sum rewards: 47.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.714', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.204', 'AMMO4': '0.265', 'weapon5': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.346', 'ARMOR': '0.483', 'weapon2': '0.526', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.566', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 159072256. Throughput: 0: 4378.0. Samples: 39775390. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:01:12,795][52567] Avg episode reward: [(0, '47.512')] [2024-08-06 00:01:12,795][52614] Saving new best policy, reward=47.512! [2024-08-06 00:01:12,861][52658] DAMAGECOUNT value on done: 74618.0 [2024-08-06 00:01:12,862][52658] Sum rewards: 58.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.481', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.350', 'weapon4': '0.414', 'WEAPON3': '0.950', 'weapon3': '3.086', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '48.000'} [2024-08-06 00:01:13,404][52666] DAMAGECOUNT value on done: 70573.0 [2024-08-06 00:01:13,404][52666] Sum rewards: 49.908, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.039', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.057', 'AMMO3': '0.116', 'weapon5': '0.236', 'AMMO4': '0.283', 'WEAPON5': '0.300', 'weapon2': '0.466', 'weapon4': '0.654', 'WEAPON4': '0.700', 'WEAPON3': '0.700', 'weapon3': '2.396', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:14,198][52663] DAMAGECOUNT value on done: 72173.0 [2024-08-06 00:01:14,199][52663] Sum rewards: 43.416, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.036', 'ARMOR': '0.048', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon4': '0.190', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.600', 'HITCOUNT': '2.810', 'weapon3': '2.988', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:14,460][52650] Updated weights for policy 0, policy_version 19421 (0.0023) [2024-08-06 00:01:15,249][52670] DAMAGECOUNT value on done: 70397.0 [2024-08-06 00:01:15,250][52670] Sum rewards: 53.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.085', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.010', 'AMMO4': '0.022', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.282', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '46.000'} [2024-08-06 00:01:15,517][52658] DAMAGECOUNT value on done: 69977.0 [2024-08-06 00:01:15,517][52658] Sum rewards: 46.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.996', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.152', 'weapon2': '0.418', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '2.880', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:15,558][52665] DAMAGECOUNT value on done: 72269.0 [2024-08-06 00:01:15,559][52665] Sum rewards: 33.646, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.520', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.209', 'weapon4': '0.422', 'ARMOR': '0.459', 'WEAPON4': '0.550', 'weapon2': '0.936', 'WEAPON3': '1.350', 'weapon3': '2.426', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.199', 'FRAGCOUNT': '31.000'} [2024-08-06 00:01:15,978][52666] DAMAGECOUNT value on done: 68161.0 [2024-08-06 00:01:15,979][52666] Sum rewards: 43.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.402', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.520', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.806', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '36.000'} [2024-08-06 00:01:16,313][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:01:17,201][52663] DAMAGECOUNT value on done: 71867.0 [2024-08-06 00:01:17,202][52663] Sum rewards: 38.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon5': '0.340', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.390', 'weapon3': '2.578', 'DAMAGECOUNT': '10.377', 'FRAGCOUNT': '34.000'} [2024-08-06 00:01:17,507][52671] DAMAGECOUNT value on done: 76799.0 [2024-08-06 00:01:17,508][52671] Sum rewards: 37.529, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.842', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.225', 'weapon4': '0.242', 'WEAPON4': '0.450', 'weapon2': '0.606', 'WEAPON3': '1.050', 'HITCOUNT': '2.480', 'weapon3': '2.826', 'DAMAGECOUNT': '11.127', 'FRAGCOUNT': '34.000'} [2024-08-06 00:01:17,611][52658] DAMAGECOUNT value on done: 71863.0 [2024-08-06 00:01:17,613][52658] Sum rewards: 49.319, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'ARMOR': '0.424', 'weapon4': '0.498', 'weapon2': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.304', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '43.000'} [2024-08-06 00:01:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 159154176. Throughput: 0: 4373.3. Samples: 39788200. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:01:17,795][52567] Avg episode reward: [(0, '47.657')] [2024-08-06 00:01:17,797][52614] Saving new best policy, reward=47.657! [2024-08-06 00:01:18,111][52670] DAMAGECOUNT value on done: 67179.0 [2024-08-06 00:01:18,111][52670] Sum rewards: 44.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.895', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.082', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon4': '0.368', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.760', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:18,608][52665] DAMAGECOUNT value on done: 71542.0 [2024-08-06 00:01:18,609][52665] Sum rewards: 38.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.184', 'AMMO4': '0.190', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '2.700', 'weapon3': '3.186', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '35.000'} [2024-08-06 00:01:18,942][52650] Updated weights for policy 0, policy_version 19431 (0.0047) [2024-08-06 00:01:19,105][52666] DAMAGECOUNT value on done: 69223.0 [2024-08-06 00:01:19,106][52666] Sum rewards: 55.079, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.518', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.054', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO4': '0.269', 'AMMO3': '0.289', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.800', 'weapon3': '3.132', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '52.000'} [2024-08-06 00:01:20,142][52663] DAMAGECOUNT value on done: 75034.0 [2024-08-06 00:01:20,142][52663] Sum rewards: 54.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.398', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'ARMOR': '0.472', 'weapon2': '0.738', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '2.992', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '47.000'} [2024-08-06 00:01:20,638][52671] DAMAGECOUNT value on done: 72060.0 [2024-08-06 00:01:20,639][52671] Sum rewards: 46.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'weapon4': '0.148', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.864', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:20,799][52670] DAMAGECOUNT value on done: 65655.0 [2024-08-06 00:01:20,801][52670] Sum rewards: 44.216, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.169', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'ARMOR': '0.404', 'weapon4': '0.482', 'HEALTH': '0.626', 'weapon2': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.394', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:21,048][52658] DAMAGECOUNT value on done: 70801.0 [2024-08-06 00:01:21,050][52658] Sum rewards: 49.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '3.198', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '43.000'} [2024-08-06 00:01:21,720][52666] DAMAGECOUNT value on done: 69896.0 [2024-08-06 00:01:21,721][52666] Sum rewards: 62.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.098', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.398', 'weapon2': '0.416', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '52.000'} [2024-08-06 00:01:21,808][52665] DAMAGECOUNT value on done: 70795.0 [2024-08-06 00:01:21,809][52665] Sum rewards: 48.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.054', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.214', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '41.500'} [2024-08-06 00:01:22,671][52663] DAMAGECOUNT value on done: 73537.0 [2024-08-06 00:01:22,671][52663] Sum rewards: 56.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.260', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.616', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '48.000'} [2024-08-06 00:01:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 159244288. Throughput: 0: 4355.8. Samples: 39814170. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:01:22,795][52567] Avg episode reward: [(0, '47.845')] [2024-08-06 00:01:22,795][52614] Saving new best policy, reward=47.845! [2024-08-06 00:01:23,487][52658] DAMAGECOUNT value on done: 70805.0 [2024-08-06 00:01:23,489][52658] Sum rewards: 50.890, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.486', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO4': '0.195', 'weapon4': '0.204', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'weapon2': '0.906', 'WEAPON3': '1.350', 'weapon3': '2.636', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '45.000'} [2024-08-06 00:01:23,680][52671] DAMAGECOUNT value on done: 73747.0 [2024-08-06 00:01:23,680][52671] Sum rewards: 50.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.187', 'weapon2': '0.772', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:23,827][52650] Updated weights for policy 0, policy_version 19441 (0.0017) [2024-08-06 00:01:24,141][52670] DAMAGECOUNT value on done: 71049.0 [2024-08-06 00:01:24,141][52670] Sum rewards: 42.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.532', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO4': '0.137', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.520', 'weapon2': '0.562', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.658', 'DAMAGECOUNT': '10.500', 'FRAGCOUNT': '37.000'} [2024-08-06 00:01:24,825][52666] DAMAGECOUNT value on done: 71601.0 [2024-08-06 00:01:24,827][52666] Sum rewards: 46.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.358', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.142', 'AMMO4': '0.199', 'AMMO3': '0.209', 'WEAPON4': '0.450', 'weapon2': '0.466', 'weapon4': '0.476', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.720', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:24,981][52665] DAMAGECOUNT value on done: 72478.0 [2024-08-06 00:01:24,981][52665] Sum rewards: 53.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.264', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.197', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.450', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.780', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '45.000'} [2024-08-06 00:01:25,275][52663] DAMAGECOUNT value on done: 71434.0 [2024-08-06 00:01:25,276][52663] Sum rewards: 45.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.104', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.584', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '2.782', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:26,394][52658] DAMAGECOUNT value on done: 75488.0 [2024-08-06 00:01:26,394][52658] Sum rewards: 57.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.808', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.422', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '49.000'} [2024-08-06 00:01:26,600][52670] DAMAGECOUNT value on done: 72272.0 [2024-08-06 00:01:26,600][52670] Sum rewards: 43.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.140', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.630', 'weapon3': '3.210', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:26,919][52671] DAMAGECOUNT value on done: 70392.0 [2024-08-06 00:01:26,920][52671] Sum rewards: 53.690, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.304', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.136', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '45.000'} [2024-08-06 00:01:27,567][52666] DAMAGECOUNT value on done: 68998.0 [2024-08-06 00:01:27,567][52666] Sum rewards: 49.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.686', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.162', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.034', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:27,752][52665] DAMAGECOUNT value on done: 71031.0 [2024-08-06 00:01:27,753][52665] Sum rewards: 57.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.784', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.202', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '48.000'} [2024-08-06 00:01:27,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17605.8). Total num frames: 159334400. Throughput: 0: 4351.1. Samples: 39840260. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:01:27,795][52567] Avg episode reward: [(0, '48.269')] [2024-08-06 00:01:27,801][52614] Saving new best policy, reward=48.269! [2024-08-06 00:01:27,981][52663] DAMAGECOUNT value on done: 70028.0 [2024-08-06 00:01:27,982][52663] Sum rewards: 55.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.210', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '2.902', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '48.500'} [2024-08-06 00:01:28,450][52650] Updated weights for policy 0, policy_version 19451 (0.0040) [2024-08-06 00:01:29,436][52670] DAMAGECOUNT value on done: 71919.0 [2024-08-06 00:01:29,438][52670] Sum rewards: 57.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.909', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.346', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '48.000'} [2024-08-06 00:01:29,678][52658] DAMAGECOUNT value on done: 76533.0 [2024-08-06 00:01:29,678][52658] Sum rewards: 52.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.110', 'weapon4': '0.136', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '1.042', 'WEAPON3': '1.150', 'weapon3': '2.512', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '43.000'} [2024-08-06 00:01:29,840][52671] DAMAGECOUNT value on done: 70359.0 [2024-08-06 00:01:29,841][52671] Sum rewards: 56.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.526', 'weapon4': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.540', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '47.000'} [2024-08-06 00:01:30,407][52666] DAMAGECOUNT value on done: 69033.0 [2024-08-06 00:01:30,407][52666] Sum rewards: 46.491, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.549', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon4': '0.074', 'weapon5': '0.082', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.420', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.224', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:30,846][52665] DAMAGECOUNT value on done: 70455.0 [2024-08-06 00:01:30,847][52665] Sum rewards: 44.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.609', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.173', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.318', 'ARMOR': '0.404', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.648', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '40.500'} [2024-08-06 00:01:31,120][52663] DAMAGECOUNT value on done: 71802.0 [2024-08-06 00:01:31,120][52663] Sum rewards: 42.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.191', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.108', 'AMMO3': '0.161', 'AMMO4': '0.221', 'weapon4': '0.292', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '3.054', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '35.500'} [2024-08-06 00:01:32,171][52658] DAMAGECOUNT value on done: 71076.0 [2024-08-06 00:01:32,171][52658] Sum rewards: 37.893, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.646', 'AMMO5': '0.013', 'AMMO2': '0.060', 'weapon5': '0.166', 'AMMO3': '0.223', 'weapon4': '0.288', 'AMMO4': '0.298', 'WEAPON5': '0.350', 'ARMOR': '0.499', 'WEAPON4': '0.700', 'weapon2': '0.844', 'WEAPON3': '1.300', 'weapon3': '2.346', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '35.000'} [2024-08-06 00:01:32,595][52670] DAMAGECOUNT value on done: 71862.0 [2024-08-06 00:01:32,595][52670] Sum rewards: 44.735, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.137', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.052', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.808', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.902', 'DAMAGECOUNT': '11.892', 'FRAGCOUNT': '37.000'} [2024-08-06 00:01:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 159416320. Throughput: 0: 4348.2. Samples: 39853350. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:01:32,794][52567] Avg episode reward: [(0, '48.302')] [2024-08-06 00:01:32,795][52614] Saving new best policy, reward=48.302! [2024-08-06 00:01:32,980][52671] DAMAGECOUNT value on done: 74831.0 [2024-08-06 00:01:32,981][52671] Sum rewards: 51.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.204', 'weapon4': '0.498', 'WEAPON4': '0.500', 'weapon2': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:33,163][52650] Updated weights for policy 0, policy_version 19461 (0.0025) [2024-08-06 00:01:33,270][52665] DAMAGECOUNT value on done: 70721.0 [2024-08-06 00:01:33,270][52665] Sum rewards: 55.682, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'HEALTH': '0.016', 'AMMO2': '0.027', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'ARMOR': '0.408', 'weapon4': '0.422', 'weapon2': '0.644', 'WEAPON3': '0.900', 'weapon3': '2.636', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '47.000'} [2024-08-06 00:01:33,424][52666] DAMAGECOUNT value on done: 66488.0 [2024-08-06 00:01:33,424][52666] Sum rewards: 37.531, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.546', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.236', 'AMMO3': '0.299', 'ARMOR': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.800', 'HITCOUNT': '2.550', 'weapon3': '2.820', 'DAMAGECOUNT': '10.341', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:34,050][52663] DAMAGECOUNT value on done: 76044.0 [2024-08-06 00:01:34,051][52663] Sum rewards: 47.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.723', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.412', 'weapon4': '0.426', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '3.022', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:34,836][52820] DAMAGECOUNT value on done: 65320.0 [2024-08-06 00:01:34,836][52820] Sum rewards: 39.818, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.954', 'AMMO5': '0.014', 'weapon5': '0.042', 'AMMO2': '0.055', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'AMMO4': '0.276', 'ARMOR': '0.438', 'weapon2': '0.528', 'weapon4': '0.560', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.600', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.676', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:35,165][52658] DAMAGECOUNT value on done: 71536.0 [2024-08-06 00:01:35,165][52658] Sum rewards: 37.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'AMMO4': '0.261', 'WEAPON4': '0.600', 'weapon2': '0.632', 'weapon4': '0.734', 'WEAPON3': '1.300', 'weapon3': '2.244', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '34.500'} [2024-08-06 00:01:35,712][52670] DAMAGECOUNT value on done: 72703.0 [2024-08-06 00:01:35,714][52670] Sum rewards: 52.993, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.412', 'ARMOR': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.289', 'weapon2': '0.502', 'WEAPON3': '1.700', 'HITCOUNT': '2.970', 'weapon3': '3.096', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '51.000'} [2024-08-06 00:01:36,135][52671] DAMAGECOUNT value on done: 73456.0 [2024-08-06 00:01:36,137][52671] Sum rewards: 44.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.060', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.014', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:36,365][52665] DAMAGECOUNT value on done: 68411.0 [2024-08-06 00:01:36,366][52665] Sum rewards: 49.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.252', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:36,376][52666] DAMAGECOUNT value on done: 70692.0 [2024-08-06 00:01:36,377][52666] Sum rewards: 46.731, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'HEALTH': '0.300', 'weapon4': '0.300', 'ARMOR': '0.453', 'weapon2': '0.786', 'WEAPON3': '1.200', 'weapon3': '2.716', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:36,955][52663] DAMAGECOUNT value on done: 71052.0 [2024-08-06 00:01:36,956][52663] Sum rewards: 37.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.198', 'AMMO5': '0.011', 'ARMOR': '0.024', 'AMMO2': '0.044', 'weapon5': '0.160', 'AMMO3': '0.161', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.564', 'WEAPON3': '0.950', 'weapon4': '0.952', 'weapon3': '2.076', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.658', 'FRAGCOUNT': '32.000'} [2024-08-06 00:01:37,464][52659] DAMAGECOUNT value on done: 72142.0 [2024-08-06 00:01:37,464][52659] Sum rewards: 34.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.104', 'AMMO4': '0.168', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.408', 'WEAPON4': '0.450', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '29.500'} [2024-08-06 00:01:37,686][52650] Updated weights for policy 0, policy_version 19471 (0.0011) [2024-08-06 00:01:37,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 159506432. Throughput: 0: 4348.2. Samples: 39879560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:01:37,794][52567] Avg episode reward: [(0, '47.852')] [2024-08-06 00:01:37,901][52820] DAMAGECOUNT value on done: 69298.0 [2024-08-06 00:01:37,901][52820] Sum rewards: 44.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.162', 'AMMO4': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '3.038', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:38,094][52658] DAMAGECOUNT value on done: 76625.0 [2024-08-06 00:01:38,101][52658] Sum rewards: 53.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.087', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.197', 'weapon4': '0.398', 'WEAPON4': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '47.000'} [2024-08-06 00:01:38,445][52670] DAMAGECOUNT value on done: 67126.0 [2024-08-06 00:01:38,445][52670] Sum rewards: 47.493, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.848', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.482', 'weapon4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.854', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:38,914][52671] DAMAGECOUNT value on done: 76259.0 [2024-08-06 00:01:38,914][52671] Sum rewards: 52.280, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.714', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.119', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.476', 'weapon2': '0.716', 'WEAPON3': '0.750', 'weapon3': '2.636', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:39,091][52666] DAMAGECOUNT value on done: 70757.0 [2024-08-06 00:01:39,093][52666] Sum rewards: 50.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.128', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.726', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '43.000'} [2024-08-06 00:01:39,707][52663] DAMAGECOUNT value on done: 73932.0 [2024-08-06 00:01:39,707][52663] Sum rewards: 51.784, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'HEALTH': '0.068', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.574', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '2.742', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:39,716][52665] DAMAGECOUNT value on done: 68191.0 [2024-08-06 00:01:39,716][52665] Sum rewards: 50.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.214', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.982', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:40,235][52659] DAMAGECOUNT value on done: 74375.0 [2024-08-06 00:01:40,238][52659] Sum rewards: 48.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.156', 'AMMO4': '0.157', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.072', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:41,072][52820] DAMAGECOUNT value on done: 64274.0 [2024-08-06 00:01:41,076][52820] Sum rewards: 38.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.434', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.060', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.652', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '3.000', 'DAMAGECOUNT': '10.575', 'FRAGCOUNT': '35.000'} [2024-08-06 00:01:41,533][52670] DAMAGECOUNT value on done: 72508.0 [2024-08-06 00:01:41,535][52670] Sum rewards: 55.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.191', 'weapon5': '0.216', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.000'} [2024-08-06 00:01:41,910][52671] DAMAGECOUNT value on done: 72900.0 [2024-08-06 00:01:41,910][52671] Sum rewards: 47.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.995', 'AMMO5': '0.006', 'ARMOR': '0.032', 'AMMO2': '0.038', 'weapon5': '0.090', 'AMMO3': '0.179', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.576', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '2.860', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:42,325][52666] DAMAGECOUNT value on done: 72667.0 [2024-08-06 00:01:42,327][52666] Sum rewards: 45.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.157', 'AMMO4': '0.163', 'weapon5': '0.178', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon4': '0.446', 'WEAPON4': '0.450', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.508', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:42,756][52650] Updated weights for policy 0, policy_version 19481 (0.0014) [2024-08-06 00:01:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 159588352. Throughput: 0: 4345.3. Samples: 39905690. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 00:01:42,794][52567] Avg episode reward: [(0, '47.914')] [2024-08-06 00:01:42,811][52663] DAMAGECOUNT value on done: 74533.0 [2024-08-06 00:01:42,812][52663] Sum rewards: 51.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.983', 'AMMO5': '0.007', 'AMMO2': '0.029', 'ARMOR': '0.040', 'AMMO3': '0.133', 'AMMO4': '0.147', 'weapon5': '0.174', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.518', 'weapon2': '0.814', 'WEAPON3': '0.850', 'weapon3': '2.170', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '44.000'} [2024-08-06 00:01:42,892][52665] DAMAGECOUNT value on done: 68450.0 [2024-08-06 00:01:42,893][52665] Sum rewards: 46.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon4': '0.260', 'weapon2': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '3.108', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '42.000'} [2024-08-06 00:01:43,419][52659] DAMAGECOUNT value on done: 72055.0 [2024-08-06 00:01:43,420][52659] Sum rewards: 45.294, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.078', 'ARMOR': '0.009', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO3': '0.187', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.400', 'weapon2': '0.784', 'WEAPON3': '1.050', 'weapon3': '2.508', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:43,486][52820] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:01:44,213][52820] DAMAGECOUNT value on done: 65213.0 [2024-08-06 00:01:44,213][52820] Sum rewards: 42.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.166', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.430', 'WEAPON4': '0.450', 'weapon2': '1.056', 'WEAPON3': '1.100', 'weapon3': '2.136', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '38.000'} [2024-08-06 00:01:44,442][52670] DAMAGECOUNT value on done: 71899.0 [2024-08-06 00:01:44,442][52670] Sum rewards: 50.180, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.652', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'AMMO4': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon5': '0.374', 'ARMOR': '0.416', 'weapon2': '0.736', 'WEAPON3': '0.850', 'weapon3': '2.398', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '41.000'} [2024-08-06 00:01:44,704][52671] DAMAGECOUNT value on done: 74322.0 [2024-08-06 00:01:44,705][52671] Sum rewards: 31.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.477', 'AMMO5': '0.007', 'ARMOR': '0.044', 'weapon7': '0.050', 'AMMO2': '0.054', 'weapon5': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.272', 'weapon2': '0.368', 'WEAPON4': '0.650', 'weapon4': '1.134', 'WEAPON3': '1.150', 'weapon3': '1.734', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '8.613', 'FRAGCOUNT': '30.000'} [2024-08-06 00:01:45,753][52663] DAMAGECOUNT value on done: 75356.0 [2024-08-06 00:01:45,753][52663] Sum rewards: 35.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.242', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.189', 'weapon4': '0.392', 'WEAPON4': '0.400', 'ARMOR': '0.480', 'weapon2': '0.824', 'WEAPON3': '1.150', 'weapon3': '2.586', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '9.825', 'FRAGCOUNT': '30.000'} [2024-08-06 00:01:45,810][52659] DAMAGECOUNT value on done: 74331.0 [2024-08-06 00:01:45,811][52659] Sum rewards: 55.051, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.182', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.042', 'ARMOR': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'weapon4': '0.222', 'AMMO3': '0.283', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.600', 'weapon3': '2.788', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '51.000'} [2024-08-06 00:01:46,968][52650] Updated weights for policy 0, policy_version 19491 (0.0012) [2024-08-06 00:01:47,329][52671] DAMAGECOUNT value on done: 73911.0 [2024-08-06 00:01:47,332][52671] Sum rewards: 34.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.274', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon5': '0.158', 'AMMO3': '0.159', 'AMMO4': '0.300', 'weapon4': '0.362', 'ARMOR': '0.424', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon2': '0.840', 'WEAPON3': '1.050', 'weapon3': '2.356', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '32.000'} [2024-08-06 00:01:47,392][52820] DAMAGECOUNT value on done: 66038.0 [2024-08-06 00:01:47,394][52820] Sum rewards: 43.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.148', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.772', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:47,649][52670] DAMAGECOUNT value on done: 68852.0 [2024-08-06 00:01:47,650][52670] Sum rewards: 37.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.422', 'ARMOR': '0.024', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'weapon4': '0.476', 'weapon2': '0.642', 'WEAPON3': '1.350', 'HITCOUNT': '2.550', 'weapon3': '2.630', 'DAMAGECOUNT': '10.335', 'FRAGCOUNT': '33.000'} [2024-08-06 00:01:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 159678464. Throughput: 0: 4345.6. Samples: 39918740. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 00:01:47,794][52567] Avg episode reward: [(0, '47.573')] [2024-08-06 00:01:48,547][52659] DAMAGECOUNT value on done: 73165.0 [2024-08-06 00:01:48,556][52659] Sum rewards: 39.447, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.228', 'AMMO3': '0.305', 'weapon2': '0.370', 'WEAPON4': '0.500', 'weapon4': '0.514', 'WEAPON3': '1.800', 'weapon3': '2.846', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:48,891][52663] DAMAGECOUNT value on done: 71841.0 [2024-08-06 00:01:48,892][52663] Sum rewards: 51.907, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.082', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.051', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.254', 'AMMO3': '0.255', 'weapon2': '0.402', 'weapon4': '0.580', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.556', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '48.000'} [2024-08-06 00:01:50,251][52671] DAMAGECOUNT value on done: 73537.0 [2024-08-06 00:01:50,251][52671] Sum rewards: 46.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '3.110', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:50,252][52670] DAMAGECOUNT value on done: 70494.0 [2024-08-06 00:01:50,252][52670] Sum rewards: 51.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.304', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.126', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '43.000'} [2024-08-06 00:01:50,503][52820] DAMAGECOUNT value on done: 67396.0 [2024-08-06 00:01:50,508][52820] Sum rewards: 35.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.732', 'WEAPON3': '1.350', 'HITCOUNT': '2.460', 'weapon3': '2.524', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '34.000'} [2024-08-06 00:01:51,025][52664] DAMAGECOUNT value on done: 74620.0 [2024-08-06 00:01:51,025][52664] Sum rewards: 53.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.584', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.068', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.434', 'WEAPON3': '1.150', 'HITCOUNT': '2.540', 'weapon3': '3.210', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '45.000'} [2024-08-06 00:01:51,762][52659] DAMAGECOUNT value on done: 75377.0 [2024-08-06 00:01:51,762][52659] Sum rewards: 60.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.046', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon4': '0.056', 'weapon5': '0.058', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '52.000'} [2024-08-06 00:01:51,910][52650] Updated weights for policy 0, policy_version 19501 (0.0028) [2024-08-06 00:01:51,937][52671] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:01:52,808][52567] Fps is (10 sec: 17997.7, 60 sec: 17472.2, 300 sec: 17577.3). Total num frames: 159768576. Throughput: 0: 4352.7. Samples: 39945180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:01:52,808][52567] Avg episode reward: [(0, '47.442')] [2024-08-06 00:01:53,067][52671] DAMAGECOUNT value on done: 78219.0 [2024-08-06 00:01:53,067][52671] Sum rewards: 42.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.151', 'weapon4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.596', 'WEAPON3': '0.950', 'HITCOUNT': '2.500', 'weapon3': '3.100', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '35.000'} [2024-08-06 00:01:53,777][52820] DAMAGECOUNT value on done: 68651.0 [2024-08-06 00:01:53,777][52820] Sum rewards: 46.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.016', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:53,790][52664] DAMAGECOUNT value on done: 75249.0 [2024-08-06 00:01:53,791][52664] Sum rewards: 39.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.154', 'WEAPON4': '0.350', 'weapon4': '0.360', 'ARMOR': '0.404', 'weapon2': '0.912', 'WEAPON3': '1.000', 'weapon3': '2.500', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '34.000'} [2024-08-06 00:01:54,229][52659] DAMAGECOUNT value on done: 74134.0 [2024-08-06 00:01:54,230][52659] Sum rewards: 53.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.494', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.133', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.420', 'weapon4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.640', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '45.000'} [2024-08-06 00:01:55,885][52671] DAMAGECOUNT value on done: 73646.0 [2024-08-06 00:01:55,888][52671] Sum rewards: 30.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.094', 'AMMO3': '0.160', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.050', 'HITCOUNT': '1.930', 'weapon3': '2.734', 'DAMAGECOUNT': '8.808', 'FRAGCOUNT': '26.500'} [2024-08-06 00:01:56,368][52664] DAMAGECOUNT value on done: 77022.0 [2024-08-06 00:01:56,369][52664] Sum rewards: 56.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.482', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.018', 'weapon5': '0.032', 'weapon4': '0.058', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.742', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '47.000'} [2024-08-06 00:01:56,826][52650] Updated weights for policy 0, policy_version 19511 (0.0026) [2024-08-06 00:01:56,867][52820] DAMAGECOUNT value on done: 69063.0 [2024-08-06 00:01:56,868][52820] Sum rewards: 48.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.980', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.140', 'AMMO3': '0.168', 'AMMO4': '0.208', 'weapon4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.408', 'weapon2': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.696', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:57,254][52659] DAMAGECOUNT value on done: 70121.0 [2024-08-06 00:01:57,255][52659] Sum rewards: 47.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.212', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.166', 'weapon2': '0.630', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '3.074', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '39.000'} [2024-08-06 00:01:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 159850496. Throughput: 0: 4356.7. Samples: 39971440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:01:57,794][52567] Avg episode reward: [(0, '47.337')] [2024-08-06 00:01:58,828][52671] DAMAGECOUNT value on done: 69993.0 [2024-08-06 00:01:58,828][52671] Sum rewards: 48.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.707', 'AMMO5': '0.006', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.182', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.424', 'WEAPON4': '0.450', 'weapon2': '0.962', 'WEAPON3': '1.150', 'weapon3': '2.218', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:59,479][52664] DAMAGECOUNT value on done: 74762.0 [2024-08-06 00:01:59,479][52664] Sum rewards: 48.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.216', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '40.000'} [2024-08-06 00:01:59,962][52820] DAMAGECOUNT value on done: 63792.0 [2024-08-06 00:01:59,962][52820] Sum rewards: 57.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.406', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '47.000'} [2024-08-06 00:02:00,338][52659] DAMAGECOUNT value on done: 72922.0 [2024-08-06 00:02:00,341][52659] Sum rewards: 45.712, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.202', 'ARMOR': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.049', 'AMMO4': '0.245', 'AMMO3': '0.275', 'weapon5': '0.298', 'weapon2': '0.384', 'weapon4': '0.506', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.486', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:00,887][52614] Signal inference workers to stop experience collection... (3650 times) [2024-08-06 00:02:00,895][52614] Signal inference workers to resume experience collection... (3650 times) [2024-08-06 00:02:00,967][52650] InferenceWorker_p0-w0: stopping experience collection (3650 times) [2024-08-06 00:02:00,975][52650] InferenceWorker_p0-w0: resuming experience collection (3650 times) [2024-08-06 00:02:00,976][52650] Updated weights for policy 0, policy_version 19521 (0.0012) [2024-08-06 00:02:01,963][52671] DAMAGECOUNT value on done: 74880.0 [2024-08-06 00:02:01,963][52671] Sum rewards: 50.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.066', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.208', 'weapon5': '0.220', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.264', 'ARMOR': '0.424', 'WEAPON4': '0.450', 'weapon2': '0.826', 'WEAPON3': '1.200', 'weapon3': '2.374', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:02,474][52664] DAMAGECOUNT value on done: 73928.0 [2024-08-06 00:02:02,474][52664] Sum rewards: 46.802, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.118', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.480', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:02,794][52567] Fps is (10 sec: 16406.7, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 159932416. Throughput: 0: 4365.1. Samples: 39984630. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:02:02,794][52567] Avg episode reward: [(0, '47.271')] [2024-08-06 00:02:03,078][52820] DAMAGECOUNT value on done: 66780.0 [2024-08-06 00:02:03,080][52820] Sum rewards: 38.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.210', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'weapon4': '0.230', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.600', 'HITCOUNT': '2.510', 'weapon3': '3.030', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '37.000'} [2024-08-06 00:02:03,563][52659] DAMAGECOUNT value on done: 74792.0 [2024-08-06 00:02:03,564][52659] Sum rewards: 46.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.622', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon4': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.000', 'HITCOUNT': '2.680', 'weapon3': '3.132', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:05,137][52671] DAMAGECOUNT value on done: 73991.0 [2024-08-06 00:02:05,138][52671] Sum rewards: 41.434, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.644', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.060', 'weapon4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '2.952', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '38.500'} [2024-08-06 00:02:05,243][52664] DAMAGECOUNT value on done: 79045.0 [2024-08-06 00:02:05,243][52664] Sum rewards: 55.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.217', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.064', 'weapon5': '0.114', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.474', 'weapon2': '0.594', 'WEAPON3': '0.850', 'weapon3': '2.648', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '44.000'} [2024-08-06 00:02:05,498][52820] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2024-08-06 00:02:06,140][52650] Updated weights for policy 0, policy_version 19531 (0.0011) [2024-08-06 00:02:06,231][52820] DAMAGECOUNT value on done: 69522.0 [2024-08-06 00:02:06,232][52820] Sum rewards: 51.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.191', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.233', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.506', 'weapon4': '0.906', 'WEAPON3': '1.400', 'weapon3': '2.328', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '46.000'} [2024-08-06 00:02:06,602][52659] DAMAGECOUNT value on done: 72871.0 [2024-08-06 00:02:06,604][52659] Sum rewards: 38.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.047', 'weapon4': '0.126', 'weapon5': '0.156', 'AMMO3': '0.198', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.676', 'WEAPON3': '1.200', 'HITCOUNT': '2.080', 'weapon3': '2.752', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '37.000'} [2024-08-06 00:02:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 160030720. Throughput: 0: 4367.6. Samples: 40010710. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:02:07,794][52567] Avg episode reward: [(0, '47.071')] [2024-08-06 00:02:07,877][52664] DAMAGECOUNT value on done: 75532.0 [2024-08-06 00:02:07,877][52664] Sum rewards: 39.708, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.006', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.234', 'AMMO4': '0.247', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON4': '0.600', 'weapon2': '0.620', 'WEAPON3': '1.600', 'weapon3': '2.378', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:08,164][52671] DAMAGECOUNT value on done: 74351.0 [2024-08-06 00:02:08,166][52671] Sum rewards: 44.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.119', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.183', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.534', 'weapon2': '0.592', 'WEAPON3': '1.150', 'HITCOUNT': '2.370', 'weapon3': '2.412', 'DAMAGECOUNT': '11.592', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:09,468][52659] DAMAGECOUNT value on done: 71091.0 [2024-08-06 00:02:09,469][52659] Sum rewards: 29.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.574', 'WEAPON3': '1.400', 'HITCOUNT': '2.280', 'weapon3': '2.566', 'DAMAGECOUNT': '8.652', 'FRAGCOUNT': '29.000'} [2024-08-06 00:02:09,483][52820] DAMAGECOUNT value on done: 68733.0 [2024-08-06 00:02:09,484][52820] Sum rewards: 32.414, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.748', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'weapon2': '0.272', 'AMMO3': '0.275', 'weapon4': '0.298', 'WEAPON3': '1.650', 'HITCOUNT': '2.510', 'weapon3': '3.194', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '32.000'} [2024-08-06 00:02:10,446][52664] DAMAGECOUNT value on done: 70256.0 [2024-08-06 00:02:10,447][52664] Sum rewards: 41.945, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.102', 'AMMO4': '0.149', 'WEAPON4': '0.350', 'weapon4': '0.504', 'weapon2': '0.546', 'WEAPON3': '0.750', 'HITCOUNT': '2.510', 'weapon3': '2.630', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '34.000'} [2024-08-06 00:02:10,716][52671] DAMAGECOUNT value on done: 72274.0 [2024-08-06 00:02:10,718][52671] Sum rewards: 44.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'ARMOR': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.232', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.656', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:10,790][52650] Updated weights for policy 0, policy_version 19541 (0.0022) [2024-08-06 00:02:12,067][52659] DAMAGECOUNT value on done: 68702.0 [2024-08-06 00:02:12,071][52659] Sum rewards: 44.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.551', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.678', 'weapon2': '0.790', 'WEAPON3': '1.100', 'weapon3': '2.338', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:12,586][52820] DAMAGECOUNT value on done: 65319.0 [2024-08-06 00:02:12,589][52820] Sum rewards: 50.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.996', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'ARMOR': '0.462', 'weapon2': '0.588', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.006', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '42.000'} [2024-08-06 00:02:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 160120832. Throughput: 0: 4378.5. Samples: 40037290. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:02:12,795][52567] Avg episode reward: [(0, '46.872')] [2024-08-06 00:02:13,015][52664] DAMAGECOUNT value on done: 81619.0 [2024-08-06 00:02:13,016][52664] Sum rewards: 48.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.485', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'ARMOR': '0.455', 'weapon2': '0.608', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '2.976', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:13,480][52671] DAMAGECOUNT value on done: 70817.0 [2024-08-06 00:02:13,480][52671] Sum rewards: 42.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.177', 'AMMO5': '0.009', 'AMMO2': '0.027', 'ARMOR': '0.032', 'weapon5': '0.136', 'AMMO4': '0.137', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.382', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.806', 'DAMAGECOUNT': '11.844', 'FRAGCOUNT': '37.000'} [2024-08-06 00:02:14,952][52659] DAMAGECOUNT value on done: 73544.0 [2024-08-06 00:02:14,955][52659] Sum rewards: 61.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.083', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.348', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '53.000'} [2024-08-06 00:02:15,208][52650] Updated weights for policy 0, policy_version 19551 (0.0034) [2024-08-06 00:02:15,723][52820] DAMAGECOUNT value on done: 66825.0 [2024-08-06 00:02:15,732][52820] Sum rewards: 53.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.443', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.242', 'weapon2': '0.380', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.074', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '48.000'} [2024-08-06 00:02:15,778][52664] DAMAGECOUNT value on done: 78255.0 [2024-08-06 00:02:15,780][52664] Sum rewards: 45.858, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.428', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.048', 'weapon5': '0.058', 'WEAPON5': '0.200', 'AMMO4': '0.238', 'AMMO3': '0.244', 'weapon2': '0.594', 'WEAPON4': '0.650', 'weapon4': '0.906', 'WEAPON3': '1.450', 'weapon3': '2.128', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 160210944. Throughput: 0: 4379.6. Samples: 40050430. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:02:17,794][52567] Avg episode reward: [(0, '46.994')] [2024-08-06 00:02:18,122][52659] DAMAGECOUNT value on done: 73956.0 [2024-08-06 00:02:18,126][52659] Sum rewards: 49.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.164', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.166', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.880', 'WEAPON3': '0.950', 'weapon3': '2.420', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:18,554][52664] DAMAGECOUNT value on done: 79247.0 [2024-08-06 00:02:18,555][52664] Sum rewards: 37.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.758', 'AMMO2': '0.022', 'weapon4': '0.092', 'AMMO4': '0.111', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'ARMOR': '0.400', 'weapon2': '0.918', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.782', 'DAMAGECOUNT': '10.650', 'FRAGCOUNT': '32.000'} [2024-08-06 00:02:18,932][52820] DAMAGECOUNT value on done: 71536.0 [2024-08-06 00:02:18,934][52820] Sum rewards: 45.686, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.437', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.102', 'AMMO3': '0.244', 'weapon4': '0.244', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '2.884', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '42.500'} [2024-08-06 00:02:19,990][52650] Updated weights for policy 0, policy_version 19561 (0.0023) [2024-08-06 00:02:21,292][52659] DAMAGECOUNT value on done: 77814.0 [2024-08-06 00:02:21,300][52659] Sum rewards: 41.338, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.922', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'AMMO4': '0.253', 'ARMOR': '0.455', 'weapon4': '0.524', 'WEAPON4': '0.550', 'weapon2': '0.754', 'WEAPON3': '1.250', 'weapon3': '2.344', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:21,721][52664] DAMAGECOUNT value on done: 75115.0 [2024-08-06 00:02:21,721][52664] Sum rewards: 44.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO4': '0.176', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.478', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.418', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.361', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:22,035][52820] DAMAGECOUNT value on done: 66678.0 [2024-08-06 00:02:22,036][52820] Sum rewards: 33.097, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.693', 'AMMO5': '0.003', 'AMMO2': '0.026', 'ARMOR': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.602', 'weapon2': '0.926', 'WEAPON3': '1.450', 'weapon3': '2.192', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.582', 'FRAGCOUNT': '32.000'} [2024-08-06 00:02:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 160284672. Throughput: 0: 4382.9. Samples: 40076790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:02:22,794][52567] Avg episode reward: [(0, '46.379')] [2024-08-06 00:02:24,225][52659] DAMAGECOUNT value on done: 73286.0 [2024-08-06 00:02:24,228][52659] Sum rewards: 54.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.308', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.189', 'weapon2': '0.468', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.210', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '45.000'} [2024-08-06 00:02:24,421][52664] DAMAGECOUNT value on done: 75499.0 [2024-08-06 00:02:24,421][52664] Sum rewards: 48.676, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.363', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.110', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon2': '0.528', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '2.980', 'DAMAGECOUNT': '11.358', 'FRAGCOUNT': '42.000'} [2024-08-06 00:02:24,556][52650] Updated weights for policy 0, policy_version 19571 (0.0024) [2024-08-06 00:02:24,752][52803] DAMAGECOUNT value on done: 71795.0 [2024-08-06 00:02:24,753][52803] Sum rewards: 62.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.590', 'WEAPON3': '1.400', 'weapon3': '2.740', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '54.000'} [2024-08-06 00:02:25,142][52820] DAMAGECOUNT value on done: 67671.0 [2024-08-06 00:02:25,144][52820] Sum rewards: 44.240, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.318', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'AMMO3': '0.298', 'weapon2': '0.346', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'HITCOUNT': '2.790', 'weapon3': '2.970', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '44.000'} [2024-08-06 00:02:27,338][52664] DAMAGECOUNT value on done: 76542.0 [2024-08-06 00:02:27,340][52664] Sum rewards: 49.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.143', 'AMMO3': '0.194', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.490', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.466', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '42.000'} [2024-08-06 00:02:27,382][52659] DAMAGECOUNT value on done: 72816.0 [2024-08-06 00:02:27,383][52659] Sum rewards: 50.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.802', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.184', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'weapon4': '0.474', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:27,450][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:02:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 160382976. Throughput: 0: 4390.5. Samples: 40103260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:02:27,794][52567] Avg episode reward: [(0, '46.494')] [2024-08-06 00:02:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019578_160382976.pth... [2024-08-06 00:02:27,903][52803] DAMAGECOUNT value on done: 72784.0 [2024-08-06 00:02:27,905][52803] Sum rewards: 45.245, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.210', 'AMMO4': '0.251', 'AMMO3': '0.272', 'weapon4': '0.376', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.590', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:27,940][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019065_156180480.pth [2024-08-06 00:02:28,530][52820] DAMAGECOUNT value on done: 72344.0 [2024-08-06 00:02:28,533][52820] Sum rewards: 34.335, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.484', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO4': '0.236', 'weapon4': '0.242', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'weapon5': '0.368', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.550', 'weapon3': '2.546', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.148', 'FRAGCOUNT': '34.500'} [2024-08-06 00:02:29,099][52650] Updated weights for policy 0, policy_version 19581 (0.0040) [2024-08-06 00:02:29,422][52811] DAMAGECOUNT value on done: 72039.0 [2024-08-06 00:02:29,422][52811] Sum rewards: 50.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.231', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.420', 'weapon4': '0.734', 'WEAPON3': '1.300', 'weapon3': '2.506', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '44.000'} [2024-08-06 00:02:30,058][52664] DAMAGECOUNT value on done: 77259.0 [2024-08-06 00:02:30,060][52664] Sum rewards: 29.329, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.846', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon7': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.127', 'weapon5': '0.172', 'AMMO4': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'ARMOR': '0.404', 'weapon2': '0.530', 'weapon4': '0.768', 'WEAPON3': '0.800', 'weapon3': '1.544', 'HITCOUNT': '1.740', 'DAMAGECOUNT': '8.658', 'FRAGCOUNT': '23.000'} [2024-08-06 00:02:30,472][52659] DAMAGECOUNT value on done: 74633.0 [2024-08-06 00:02:30,472][52659] Sum rewards: 42.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.924', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.212', 'AMMO3': '0.245', 'weapon4': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.450', 'HITCOUNT': '2.620', 'weapon3': '2.812', 'DAMAGECOUNT': '11.796', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:30,767][52649] DAMAGECOUNT value on done: 72312.0 [2024-08-06 00:02:30,767][52649] Sum rewards: 52.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.117', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '45.000'} [2024-08-06 00:02:30,995][52803] DAMAGECOUNT value on done: 69037.0 [2024-08-06 00:02:30,996][52803] Sum rewards: 58.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.380', 'ARMOR': '0.455', 'weapon4': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.616', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '51.000'} [2024-08-06 00:02:31,042][52662] DAMAGECOUNT value on done: 78357.0 [2024-08-06 00:02:31,042][52662] Sum rewards: 40.904, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'ARMOR': '0.005', 'weapon5': '0.010', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon4': '0.242', 'AMMO4': '0.267', 'WEAPON4': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.982', 'DAMAGECOUNT': '10.482', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:31,726][52820] DAMAGECOUNT value on done: 70681.0 [2024-08-06 00:02:31,726][52820] Sum rewards: 50.149, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.118', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.698', 'WEAPON3': '0.900', 'HITCOUNT': '2.840', 'weapon3': '2.880', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:32,454][52811] DAMAGECOUNT value on done: 66288.0 [2024-08-06 00:02:32,455][52811] Sum rewards: 47.747, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO3': '0.140', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.448', 'weapon2': '0.726', 'WEAPON3': '0.950', 'weapon3': '2.552', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:32,559][52664] DAMAGECOUNT value on done: 72800.0 [2024-08-06 00:02:32,560][52664] Sum rewards: 45.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.984', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.230', 'weapon2': '0.658', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '2.786', 'DAMAGECOUNT': '11.583', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:32,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 160473088. Throughput: 0: 4390.9. Samples: 40116330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:02:32,794][52567] Avg episode reward: [(0, '45.866')] [2024-08-06 00:02:32,969][52647] DAMAGECOUNT value on done: 77048.0 [2024-08-06 00:02:32,970][52647] Sum rewards: 45.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.146', 'WEAPON4': '0.450', 'weapon2': '0.508', 'weapon4': '0.556', 'WEAPON3': '0.900', 'weapon3': '2.556', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:33,481][52668] DAMAGECOUNT value on done: 72926.0 [2024-08-06 00:02:33,483][52668] Sum rewards: 46.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon5': '0.088', 'AMMO3': '0.198', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '3.078', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:33,659][52649] DAMAGECOUNT value on done: 72827.0 [2024-08-06 00:02:33,659][52659] DAMAGECOUNT value on done: 75856.0 [2024-08-06 00:02:33,659][52649] Sum rewards: 43.520, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.445', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.188', 'weapon5': '0.190', 'AMMO3': '0.200', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.748', 'WEAPON3': '1.250', 'weapon3': '2.600', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.946', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:33,659][52659] Sum rewards: 47.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.470', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.536', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:33,864][52662] DAMAGECOUNT value on done: 81673.0 [2024-08-06 00:02:33,865][52662] Sum rewards: 46.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.522', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.121', 'AMMO3': '0.238', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '2.778', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:33,908][52650] Updated weights for policy 0, policy_version 19591 (0.0021) [2024-08-06 00:02:34,054][52803] DAMAGECOUNT value on done: 68982.0 [2024-08-06 00:02:34,056][52803] Sum rewards: 52.337, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.280', 'weapon4': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '46.000'} [2024-08-06 00:02:34,703][52820] DAMAGECOUNT value on done: 69698.0 [2024-08-06 00:02:34,705][52820] Sum rewards: 48.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.907', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.112', 'AMMO3': '0.214', 'AMMO4': '0.275', 'WEAPON5': '0.400', 'weapon2': '0.430', 'weapon4': '0.434', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '44.000'} [2024-08-06 00:02:35,516][52811] DAMAGECOUNT value on done: 69012.0 [2024-08-06 00:02:35,516][52811] Sum rewards: 50.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'ARMOR': '0.005', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.450', 'weapon4': '0.472', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:35,519][52664] DAMAGECOUNT value on done: 77704.0 [2024-08-06 00:02:35,519][52664] Sum rewards: 54.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.154', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.205', 'weapon2': '0.906', 'WEAPON3': '1.350', 'weapon3': '2.714', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '47.000'} [2024-08-06 00:02:35,983][52647] DAMAGECOUNT value on done: 75709.0 [2024-08-06 00:02:35,983][52647] Sum rewards: 33.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.267', 'AMMO5': '0.005', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.720', 'WEAPON3': '1.400', 'HITCOUNT': '2.430', 'weapon3': '2.620', 'DAMAGECOUNT': '10.431', 'FRAGCOUNT': '32.000'} [2024-08-06 00:02:36,541][52668] DAMAGECOUNT value on done: 76736.0 [2024-08-06 00:02:36,542][52668] Sum rewards: 44.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.924', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.024', 'weapon4': '0.026', 'AMMO4': '0.095', 'weapon5': '0.160', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.776', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.848', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '37.000'} [2024-08-06 00:02:36,756][52662] DAMAGECOUNT value on done: 83027.0 [2024-08-06 00:02:36,757][52662] Sum rewards: 46.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.202', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon5': '0.160', 'AMMO3': '0.183', 'AMMO4': '0.224', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.648', 'WEAPON3': '1.200', 'weapon3': '2.408', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:36,901][52649] DAMAGECOUNT value on done: 74157.0 [2024-08-06 00:02:36,903][52649] Sum rewards: 50.742, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.454', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.132', 'AMMO4': '0.162', 'weapon4': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.834', 'WEAPON3': '0.850', 'weapon3': '2.678', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.961', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:37,281][52803] DAMAGECOUNT value on done: 70758.0 [2024-08-06 00:02:37,283][52803] Sum rewards: 47.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.476', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.012', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.197', 'AMMO3': '0.251', 'weapon2': '0.326', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.946', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '45.000'} [2024-08-06 00:02:37,519][52794] DAMAGECOUNT value on done: 81054.0 [2024-08-06 00:02:37,519][52794] Sum rewards: 46.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.357', 'AMMO5': '0.017', 'ARMOR': '0.040', 'AMMO2': '0.048', 'weapon5': '0.152', 'AMMO3': '0.217', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.424', 'weapon4': '0.438', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.718', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '43.500'} [2024-08-06 00:02:37,787][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:02:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 160555008. Throughput: 0: 4390.2. Samples: 40142680. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:02:37,794][52567] Avg episode reward: [(0, '46.288')] [2024-08-06 00:02:38,040][52664] DAMAGECOUNT value on done: 75387.0 [2024-08-06 00:02:38,042][52664] Sum rewards: 40.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.504', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.168', 'AMMO3': '0.199', 'weapon4': '0.214', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.592', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '36.000'} [2024-08-06 00:02:38,428][52647] DAMAGECOUNT value on done: 81478.0 [2024-08-06 00:02:38,428][52647] Sum rewards: 47.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO4': '0.236', 'AMMO3': '0.244', 'weapon5': '0.258', 'WEAPON5': '0.350', 'weapon4': '0.384', 'weapon2': '0.496', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.564', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:38,474][52650] Updated weights for policy 0, policy_version 19601 (0.0010) [2024-08-06 00:02:38,597][52811] DAMAGECOUNT value on done: 68523.0 [2024-08-06 00:02:38,605][52811] Sum rewards: 44.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.861', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.199', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.613', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:39,225][52668] DAMAGECOUNT value on done: 70912.0 [2024-08-06 00:02:39,226][52668] Sum rewards: 38.460, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.222', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.270', 'weapon4': '0.352', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.892', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:39,649][52662] DAMAGECOUNT value on done: 74892.0 [2024-08-06 00:02:39,651][52662] Sum rewards: 50.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.781', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.322', 'ARMOR': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.406', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '42.000'} [2024-08-06 00:02:40,002][52649] DAMAGECOUNT value on done: 73990.0 [2024-08-06 00:02:40,002][52649] Sum rewards: 67.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.148', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.990', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '55.000'} [2024-08-06 00:02:40,114][52794] DAMAGECOUNT value on done: 78598.0 [2024-08-06 00:02:40,116][52794] Sum rewards: 56.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.056', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.280', 'weapon2': '0.568', 'WEAPON4': '0.650', 'weapon4': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.352', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '48.000'} [2024-08-06 00:02:40,483][52803] DAMAGECOUNT value on done: 68697.0 [2024-08-06 00:02:40,484][52803] Sum rewards: 41.510, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.479', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.195', 'AMMO4': '0.200', 'weapon5': '0.202', 'weapon4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.944', 'WEAPON3': '1.200', 'weapon3': '2.358', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:41,030][52664] DAMAGECOUNT value on done: 76551.0 [2024-08-06 00:02:41,031][52664] Sum rewards: 43.866, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.693', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.228', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.862', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:41,360][52647] DAMAGECOUNT value on done: 80085.0 [2024-08-06 00:02:41,361][52647] Sum rewards: 52.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.786', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.129', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon4': '0.424', 'weapon2': '0.480', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '2.814', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '45.000'} [2024-08-06 00:02:41,698][52811] DAMAGECOUNT value on done: 67574.0 [2024-08-06 00:02:41,698][52811] Sum rewards: 35.797, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.792', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.090', 'weapon4': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.618', 'WEAPON3': '1.600', 'HITCOUNT': '2.560', 'weapon3': '2.850', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '35.000'} [2024-08-06 00:02:41,725][52668] DAMAGECOUNT value on done: 72582.0 [2024-08-06 00:02:41,725][52668] Sum rewards: 45.823, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.633', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'weapon2': '0.320', 'ARMOR': '0.412', 'weapon4': '0.418', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '3.012', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '44.000'} [2024-08-06 00:02:42,221][52662] DAMAGECOUNT value on done: 77603.0 [2024-08-06 00:02:42,225][52662] Sum rewards: 57.804, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.246', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'weapon2': '0.412', 'weapon4': '0.448', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '50.000'} [2024-08-06 00:02:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 160645120. Throughput: 0: 4394.7. Samples: 40169200. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:02:42,795][52567] Avg episode reward: [(0, '46.127')] [2024-08-06 00:02:42,846][52649] DAMAGECOUNT value on done: 70296.0 [2024-08-06 00:02:42,847][52649] Sum rewards: 46.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.185', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.038', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.236', 'weapon2': '0.480', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.266', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '42.000'} [2024-08-06 00:02:42,949][52794] DAMAGECOUNT value on done: 76490.0 [2024-08-06 00:02:42,949][52794] Sum rewards: 48.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.014', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO3': '0.206', 'weapon4': '0.220', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.948', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:43,130][52650] Updated weights for policy 0, policy_version 19611 (0.0010) [2024-08-06 00:02:43,402][52803] DAMAGECOUNT value on done: 71263.0 [2024-08-06 00:02:43,403][52803] Sum rewards: 45.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.599', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.186', 'weapon4': '0.266', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '2.990', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:43,852][52660] DAMAGECOUNT value on done: 72799.0 [2024-08-06 00:02:43,860][52660] Sum rewards: 46.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.163', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '2.480', 'weapon3': '2.690', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:44,085][52664] DAMAGECOUNT value on done: 75865.0 [2024-08-06 00:02:44,086][52664] Sum rewards: 46.197, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.448', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.702', 'WEAPON3': '0.950', 'HITCOUNT': '2.280', 'weapon3': '3.078', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:44,373][52647] DAMAGECOUNT value on done: 80377.0 [2024-08-06 00:02:44,376][52647] Sum rewards: 52.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.414', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.159', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '2.988', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '46.000'} [2024-08-06 00:02:44,542][52668] DAMAGECOUNT value on done: 74272.0 [2024-08-06 00:02:44,542][52668] Sum rewards: 50.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.216', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.648', 'WEAPON3': '1.050', 'weapon3': '2.670', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:44,871][52811] DAMAGECOUNT value on done: 71271.0 [2024-08-06 00:02:44,872][52811] Sum rewards: 47.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.346', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.250', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '41.500'} [2024-08-06 00:02:45,235][52649] DAMAGECOUNT value on done: 70464.0 [2024-08-06 00:02:45,237][52649] Sum rewards: 55.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.636', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.012', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.220', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.328', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '49.000'} [2024-08-06 00:02:45,292][52662] DAMAGECOUNT value on done: 78515.0 [2024-08-06 00:02:45,292][52662] Sum rewards: 40.956, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.000', 'weapon5': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.055', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'AMMO4': '0.276', 'weapon4': '0.410', 'WEAPON4': '0.500', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.776', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:45,890][52795] Large shaping reward 2.527 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2024-08-06 00:02:45,948][52794] DAMAGECOUNT value on done: 74400.0 [2024-08-06 00:02:45,948][52794] Sum rewards: 49.866, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.519', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon7': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.228', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '44.500'} [2024-08-06 00:02:46,384][52660] DAMAGECOUNT value on done: 76542.0 [2024-08-06 00:02:46,385][52660] Sum rewards: 36.235, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.538', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.218', 'AMMO3': '0.241', 'AMMO4': '0.272', 'weapon4': '0.378', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.370', 'weapon3': '2.604', 'DAMAGECOUNT': '11.220', 'FRAGCOUNT': '35.500'} [2024-08-06 00:02:46,452][52803] DAMAGECOUNT value on done: 68219.0 [2024-08-06 00:02:46,454][52803] Sum rewards: 35.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.611', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.198', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '1.114', 'WEAPON3': '1.200', 'weapon3': '2.160', 'HITCOUNT': '2.320', 'DAMAGECOUNT': '9.864', 'FRAGCOUNT': '32.000'} [2024-08-06 00:02:47,071][52668] DAMAGECOUNT value on done: 74468.0 [2024-08-06 00:02:47,071][52668] Sum rewards: 54.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.592', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.352', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '3.116', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '46.000'} [2024-08-06 00:02:47,411][52647] DAMAGECOUNT value on done: 80096.0 [2024-08-06 00:02:47,412][52647] Sum rewards: 56.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.246', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.151', 'AMMO3': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.516', 'weapon4': '0.776', 'WEAPON3': '1.000', 'weapon3': '2.322', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '47.000'} [2024-08-06 00:02:47,741][52650] Updated weights for policy 0, policy_version 19621 (0.0023) [2024-08-06 00:02:47,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 160735232. Throughput: 0: 4398.0. Samples: 40182540. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:02:47,795][52567] Avg episode reward: [(0, '46.719')] [2024-08-06 00:02:47,887][52811] DAMAGECOUNT value on done: 70891.0 [2024-08-06 00:02:47,888][52811] Sum rewards: 46.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.064', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.508', 'WEAPON3': '1.350', 'HITCOUNT': '2.430', 'weapon3': '3.014', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:48,240][52649] DAMAGECOUNT value on done: 68852.0 [2024-08-06 00:02:48,241][52649] Sum rewards: 43.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.672', 'AMMO5': '0.019', 'ARMOR': '0.028', 'AMMO2': '0.041', 'AMMO3': '0.149', 'AMMO4': '0.205', 'weapon5': '0.352', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.566', 'WEAPON3': '0.900', 'HITCOUNT': '2.260', 'weapon3': '2.360', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '37.500'} [2024-08-06 00:02:48,367][52662] DAMAGECOUNT value on done: 80026.0 [2024-08-06 00:02:48,368][52662] Sum rewards: 49.183, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.185', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.446', 'WEAPON3': '0.900', 'weapon2': '0.912', 'weapon3': '2.150', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:48,851][52660] DAMAGECOUNT value on done: 75304.0 [2024-08-06 00:02:48,861][52660] Sum rewards: 39.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.234', 'AMMO5': '0.004', 'weapon5': '0.048', 'AMMO2': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'AMMO4': '0.270', 'weapon2': '0.316', 'weapon4': '0.432', 'ARMOR': '0.466', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.630', 'weapon3': '2.964', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '36.000'} [2024-08-06 00:02:49,006][52794] DAMAGECOUNT value on done: 76423.0 [2024-08-06 00:02:49,006][52794] Sum rewards: 48.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.802', 'AMMO5': '0.003', 'AMMO2': '0.038', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.153', 'AMMO4': '0.190', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:49,505][52803] DAMAGECOUNT value on done: 70950.0 [2024-08-06 00:02:49,506][52803] Sum rewards: 32.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.342', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon7': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.434', 'weapon4': '0.692', 'WEAPON3': '1.450', 'HITCOUNT': '2.140', 'weapon3': '2.196', 'DAMAGECOUNT': '9.810', 'FRAGCOUNT': '31.000'} [2024-08-06 00:02:49,745][52668] DAMAGECOUNT value on done: 74982.0 [2024-08-06 00:02:49,747][52668] Sum rewards: 37.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.147', 'WEAPON4': '0.350', 'weapon2': '0.576', 'weapon4': '0.670', 'WEAPON3': '0.900', 'weapon3': '2.484', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '33.000'} [2024-08-06 00:02:50,120][52647] DAMAGECOUNT value on done: 76631.0 [2024-08-06 00:02:50,123][52647] Sum rewards: 41.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'AMMO4': '0.238', 'weapon2': '0.330', 'ARMOR': '0.463', 'WEAPON4': '0.550', 'weapon4': '0.844', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.648', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '37.000'} [2024-08-06 00:02:50,967][52811] DAMAGECOUNT value on done: 69159.0 [2024-08-06 00:02:50,967][52811] Sum rewards: 45.337, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.210', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.716', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.746', 'DAMAGECOUNT': '11.733', 'FRAGCOUNT': '39.000'} [2024-08-06 00:02:51,321][52662] DAMAGECOUNT value on done: 85073.0 [2024-08-06 00:02:51,322][52662] Sum rewards: 53.378, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.480', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.188', 'AMMO3': '0.271', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '48.000'} [2024-08-06 00:02:51,369][52649] DAMAGECOUNT value on done: 75028.0 [2024-08-06 00:02:51,372][52649] Sum rewards: 45.586, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.870', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.331', 'weapon2': '0.398', 'WEAPON3': '2.000', 'HITCOUNT': '3.100', 'weapon3': '3.250', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '43.000'} [2024-08-06 00:02:51,941][52660] DAMAGECOUNT value on done: 74650.0 [2024-08-06 00:02:51,942][52660] Sum rewards: 50.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.116', 'AMMO3': '0.144', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.716', 'WEAPON3': '0.800', 'weapon3': '2.626', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '42.000'} [2024-08-06 00:02:51,993][52794] DAMAGECOUNT value on done: 79997.0 [2024-08-06 00:02:51,995][52794] Sum rewards: 50.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.474', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.076', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.776', 'WEAPON3': '1.300', 'weapon3': '2.592', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '44.000'} [2024-08-06 00:02:52,363][52650] Updated weights for policy 0, policy_version 19631 (0.0011) [2024-08-06 00:02:52,432][52803] DAMAGECOUNT value on done: 66564.0 [2024-08-06 00:02:52,435][52803] Sum rewards: 45.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.012', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.093', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.274', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.302', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:52,754][52668] DAMAGECOUNT value on done: 77171.0 [2024-08-06 00:02:52,755][52668] Sum rewards: 60.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.853', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.238', 'AMMO3': '0.244', 'weapon2': '0.702', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '52.000'} [2024-08-06 00:02:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17616.8, 300 sec: 17550.3). Total num frames: 160825344. Throughput: 0: 4401.5. Samples: 40208780. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:02:52,794][52567] Avg episode reward: [(0, '46.244')] [2024-08-06 00:02:52,853][52647] DAMAGECOUNT value on done: 78563.0 [2024-08-06 00:02:52,853][52647] Sum rewards: 52.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.114', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '44.000'} [2024-08-06 00:02:54,072][52649] DAMAGECOUNT value on done: 70143.0 [2024-08-06 00:02:54,082][52649] Sum rewards: 55.267, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.528', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.600', 'weapon3': '3.032', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '50.000'} [2024-08-06 00:02:54,089][52662] DAMAGECOUNT value on done: 75918.0 [2024-08-06 00:02:54,090][52662] Sum rewards: 56.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.191', 'weapon4': '0.280', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.082', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '48.000'} [2024-08-06 00:02:54,184][52811] DAMAGECOUNT value on done: 70381.0 [2024-08-06 00:02:54,184][52811] Sum rewards: 42.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.918', 'AMMO2': '0.022', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.328', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.012', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '35.000'} [2024-08-06 00:02:54,540][52660] DAMAGECOUNT value on done: 70550.0 [2024-08-06 00:02:54,541][52660] Sum rewards: 52.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.344', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.075', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.716', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '2.970', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '44.500'} [2024-08-06 00:02:54,818][52794] DAMAGECOUNT value on done: 80756.0 [2024-08-06 00:02:54,820][52794] Sum rewards: 50.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.075', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.012', 'ARMOR': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.242', 'weapon2': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.460', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '44.500'} [2024-08-06 00:02:55,261][52668] DAMAGECOUNT value on done: 75042.0 [2024-08-06 00:02:55,261][52668] Sum rewards: 50.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.065', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.048', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '45.000'} [2024-08-06 00:02:55,426][52803] DAMAGECOUNT value on done: 71847.0 [2024-08-06 00:02:55,427][52803] Sum rewards: 35.772, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.239', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.193', 'AMMO3': '0.255', 'weapon2': '0.380', 'WEAPON4': '0.450', 'weapon4': '0.580', 'WEAPON3': '1.550', 'HITCOUNT': '2.450', 'weapon3': '2.666', 'DAMAGECOUNT': '10.098', 'FRAGCOUNT': '36.000'} [2024-08-06 00:02:55,836][52647] DAMAGECOUNT value on done: 81521.0 [2024-08-06 00:02:55,837][52647] Sum rewards: 50.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.146', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.622', 'weapon2': '0.874', 'WEAPON3': '1.100', 'weapon3': '2.210', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '43.500'} [2024-08-06 00:02:56,918][52662] DAMAGECOUNT value on done: 79067.0 [2024-08-06 00:02:56,918][52662] Sum rewards: 49.047, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.346', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.037', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.622', 'WEAPON3': '1.600', 'weapon3': '2.624', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '45.000'} [2024-08-06 00:02:57,125][52650] Updated weights for policy 0, policy_version 19641 (0.0019) [2024-08-06 00:02:57,221][52649] DAMAGECOUNT value on done: 70177.0 [2024-08-06 00:02:57,223][52649] Sum rewards: 43.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.414', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.050', 'AMMO4': '0.132', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.548', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '2.998', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:57,290][52811] DAMAGECOUNT value on done: 69871.0 [2024-08-06 00:02:57,292][52811] Sum rewards: 44.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.815', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.194', 'AMMO3': '0.234', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.520', 'weapon4': '0.774', 'WEAPON4': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.140', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '41.000'} [2024-08-06 00:02:57,643][52794] DAMAGECOUNT value on done: 76436.0 [2024-08-06 00:02:57,644][52794] Sum rewards: 47.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.088', 'AMMO4': '0.117', 'weapon5': '0.148', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '0.950', 'HITCOUNT': '2.850', 'weapon3': '3.054', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '38.000'} [2024-08-06 00:02:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 160907264. Throughput: 0: 4398.0. Samples: 40235200. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:02:57,794][52567] Avg episode reward: [(0, '47.212')] [2024-08-06 00:02:57,798][52660] DAMAGECOUNT value on done: 74422.0 [2024-08-06 00:02:57,798][52660] Sum rewards: 52.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon4': '0.524', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.606', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '45.000'} [2024-08-06 00:02:58,081][52647] DAMAGECOUNT value on done: 76893.0 [2024-08-06 00:02:58,083][52647] Sum rewards: 52.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.957', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.230', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '46.000'} [2024-08-06 00:02:58,535][52668] DAMAGECOUNT value on done: 76805.0 [2024-08-06 00:02:58,536][52668] Sum rewards: 44.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.158', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO4': '0.165', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.172', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '40.000'} [2024-08-06 00:02:58,649][52803] DAMAGECOUNT value on done: 71334.0 [2024-08-06 00:02:58,649][52803] Sum rewards: 62.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '53.000'} [2024-08-06 00:02:59,752][52662] DAMAGECOUNT value on done: 77394.0 [2024-08-06 00:02:59,754][52662] Sum rewards: 44.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.817', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.198', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '3.012', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:00,332][52811] DAMAGECOUNT value on done: 71869.0 [2024-08-06 00:03:00,332][52811] Sum rewards: 40.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.941', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.288', 'weapon2': '0.726', 'WEAPON3': '0.900', 'HITCOUNT': '2.590', 'weapon3': '2.762', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '33.000'} [2024-08-06 00:03:00,427][52647] DAMAGECOUNT value on done: 75084.0 [2024-08-06 00:03:00,427][52647] Sum rewards: 39.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.635', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.144', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.300', 'HITCOUNT': '2.080', 'weapon3': '3.254', 'DAMAGECOUNT': '9.855', 'FRAGCOUNT': '36.000'} [2024-08-06 00:03:00,528][52649] DAMAGECOUNT value on done: 72422.0 [2024-08-06 00:03:00,528][52649] Sum rewards: 47.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.202', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.114', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '40.000'} [2024-08-06 00:03:00,578][52794] DAMAGECOUNT value on done: 79282.0 [2024-08-06 00:03:00,579][52794] Sum rewards: 47.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.692', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.454', 'weapon2': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.550', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:00,863][52660] DAMAGECOUNT value on done: 76276.0 [2024-08-06 00:03:00,864][52660] Sum rewards: 58.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.126', 'weapon4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.264', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 00:03:01,580][52803] DAMAGECOUNT value on done: 69271.0 [2024-08-06 00:03:01,583][52803] Sum rewards: 47.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.711', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.384', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:01,627][52668] DAMAGECOUNT value on done: 71436.0 [2024-08-06 00:03:01,628][52668] Sum rewards: 51.886, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.728', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.372', 'WEAPON4': '0.400', 'weapon4': '0.726', 'WEAPON3': '1.350', 'weapon3': '2.546', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '48.000'} [2024-08-06 00:03:01,662][52650] Updated weights for policy 0, policy_version 19651 (0.0037) [2024-08-06 00:03:01,696][52671] Large shaping reward 2.611 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2024-08-06 00:03:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 160989184. Throughput: 0: 4398.7. Samples: 40248370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:03:02,795][52567] Avg episode reward: [(0, '47.562')] [2024-08-06 00:03:02,984][52662] DAMAGECOUNT value on done: 80900.0 [2024-08-06 00:03:02,984][52662] Sum rewards: 46.770, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon5': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.810', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:03,273][52649] DAMAGECOUNT value on done: 72088.0 [2024-08-06 00:03:03,275][52649] Sum rewards: 51.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.110', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.442', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '3.028', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '43.000'} [2024-08-06 00:03:03,319][52811] DAMAGECOUNT value on done: 68387.0 [2024-08-06 00:03:03,324][52811] Sum rewards: 52.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.244', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.430', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.142', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '45.000'} [2024-08-06 00:03:03,331][52647] DAMAGECOUNT value on done: 75553.0 [2024-08-06 00:03:03,332][52647] Sum rewards: 49.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.712', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.151', 'AMMO3': '0.172', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.840', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:03,798][52794] DAMAGECOUNT value on done: 81878.0 [2024-08-06 00:03:03,798][52794] Sum rewards: 57.082, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.310', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.299', 'weapon4': '0.332', 'WEAPON4': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.700', 'weapon3': '2.720', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '53.000'} [2024-08-06 00:03:03,821][52660] DAMAGECOUNT value on done: 74753.0 [2024-08-06 00:03:03,822][52660] Sum rewards: 64.905, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.100', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'weapon4': '0.400', 'weapon2': '0.574', 'WEAPON3': '0.900', 'weapon3': '2.960', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2024-08-06 00:03:04,599][52668] DAMAGECOUNT value on done: 73700.0 [2024-08-06 00:03:04,600][52668] Sum rewards: 58.150, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.020', 'AMMO4': '0.101', 'HEALTH': '0.135', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.582', 'WEAPON3': '0.900', 'weapon3': '2.944', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:04,716][52803] DAMAGECOUNT value on done: 70379.0 [2024-08-06 00:03:04,718][52803] Sum rewards: 43.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.074', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.914', 'WEAPON3': '1.300', 'weapon3': '2.620', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '37.500'} [2024-08-06 00:03:05,954][52662] DAMAGECOUNT value on done: 78820.0 [2024-08-06 00:03:05,954][52662] Sum rewards: 37.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.022', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.380', 'weapon2': '0.646', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '2.760', 'DAMAGECOUNT': '10.746', 'FRAGCOUNT': '32.000'} [2024-08-06 00:03:06,071][52649] DAMAGECOUNT value on done: 74978.0 [2024-08-06 00:03:06,072][52649] Sum rewards: 50.127, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.335', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.308', 'AMMO3': '0.319', 'weapon2': '0.330', 'WEAPON3': '1.850', 'weapon3': '3.044', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '48.000'} [2024-08-06 00:03:06,228][52647] DAMAGECOUNT value on done: 75594.0 [2024-08-06 00:03:06,228][52647] Sum rewards: 44.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.364', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.190', 'weapon5': '0.226', 'AMMO4': '0.277', 'WEAPON5': '0.300', 'weapon4': '0.388', 'WEAPON4': '0.550', 'weapon2': '0.794', 'WEAPON3': '1.150', 'weapon3': '2.304', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '40.000'} [2024-08-06 00:03:06,345][52811] DAMAGECOUNT value on done: 71742.0 [2024-08-06 00:03:06,346][52811] Sum rewards: 54.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon2': '0.356', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.236', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:06,442][52650] Updated weights for policy 0, policy_version 19661 (0.0026) [2024-08-06 00:03:06,786][52660] DAMAGECOUNT value on done: 73970.0 [2024-08-06 00:03:06,786][52660] Sum rewards: 36.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.060', 'AMMO4': '0.132', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon4': '0.510', 'weapon2': '0.810', 'WEAPON3': '0.900', 'HITCOUNT': '2.230', 'weapon3': '2.418', 'DAMAGECOUNT': '9.906', 'FRAGCOUNT': '32.000'} [2024-08-06 00:03:06,846][52794] DAMAGECOUNT value on done: 77861.0 [2024-08-06 00:03:06,847][52794] Sum rewards: 45.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO4': '0.126', 'AMMO3': '0.168', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '3.156', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:07,622][52668] DAMAGECOUNT value on done: 70188.0 [2024-08-06 00:03:07,624][52668] Sum rewards: 54.325, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.581', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.382', 'weapon2': '0.578', 'WEAPON3': '0.950', 'weapon3': '2.834', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.501', 'FRAGCOUNT': '43.000'} [2024-08-06 00:03:07,726][52658] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:03:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 161079296. Throughput: 0: 4394.2. Samples: 40274530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:03:07,794][52567] Avg episode reward: [(0, '47.905')] [2024-08-06 00:03:07,904][52803] DAMAGECOUNT value on done: 69140.0 [2024-08-06 00:03:07,904][52803] Sum rewards: 44.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.069', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.154', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.754', 'weapon2': '0.860', 'WEAPON3': '1.150', 'weapon3': '2.034', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '40.000'} [2024-08-06 00:03:08,814][52662] DAMAGECOUNT value on done: 76831.0 [2024-08-06 00:03:08,816][52662] Sum rewards: 45.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.852', 'AMMO5': '0.003', 'ARMOR': '0.024', 'weapon5': '0.028', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.185', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon2': '0.432', 'weapon4': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:08,850][52647] DAMAGECOUNT value on done: 76764.0 [2024-08-06 00:03:08,850][52647] Sum rewards: 56.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.975', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.098', 'weapon4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.330', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '49.000'} [2024-08-06 00:03:09,142][52649] DAMAGECOUNT value on done: 74277.0 [2024-08-06 00:03:09,145][52649] Sum rewards: 53.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.982', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.261', 'weapon2': '0.736', 'WEAPON3': '1.650', 'weapon3': '3.056', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '48.000'} [2024-08-06 00:03:09,490][52811] DAMAGECOUNT value on done: 70193.0 [2024-08-06 00:03:09,492][52811] Sum rewards: 56.269, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.252', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.248', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.636', 'WEAPON3': '1.350', 'weapon3': '2.588', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '49.000'} [2024-08-06 00:03:09,683][52794] DAMAGECOUNT value on done: 80410.0 [2024-08-06 00:03:09,683][52794] Sum rewards: 37.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.712', 'AMMO5': '0.009', 'ARMOR': '0.028', 'AMMO2': '0.038', 'AMMO3': '0.174', 'weapon5': '0.186', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.488', 'weapon2': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.564', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '32.000'} [2024-08-06 00:03:09,865][52660] DAMAGECOUNT value on done: 73978.0 [2024-08-06 00:03:09,865][52660] Sum rewards: 42.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.956', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.132', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon4': '0.308', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.220', 'weapon3': '2.900', 'DAMAGECOUNT': '11.733', 'FRAGCOUNT': '36.000'} [2024-08-06 00:03:10,445][52668] DAMAGECOUNT value on done: 75133.0 [2024-08-06 00:03:10,446][52668] Sum rewards: 46.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.191', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.472', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.646', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:10,784][52803] DAMAGECOUNT value on done: 67232.0 [2024-08-06 00:03:10,784][52803] Sum rewards: 50.543, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.494', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.588', 'weapon2': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.490', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '42.000'} [2024-08-06 00:03:10,960][52650] Updated weights for policy 0, policy_version 19671 (0.0011) [2024-08-06 00:03:11,112][52647] DAMAGECOUNT value on done: 78158.0 [2024-08-06 00:03:11,113][52647] Sum rewards: 43.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.984', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.818', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:11,811][52669] DAMAGECOUNT value on done: 76651.0 [2024-08-06 00:03:11,813][52669] Sum rewards: 48.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.027', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.186', 'AMMO4': '0.186', 'weapon4': '0.342', 'WEAPON4': '0.450', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:11,890][52662] DAMAGECOUNT value on done: 77471.0 [2024-08-06 00:03:11,891][52662] Sum rewards: 56.811, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.188', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:12,204][52649] DAMAGECOUNT value on done: 67713.0 [2024-08-06 00:03:12,205][52649] Sum rewards: 40.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.151', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.064', 'AMMO3': '0.161', 'weapon5': '0.208', 'AMMO4': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.588', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon4': '1.122', 'weapon3': '1.824', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '33.000'} [2024-08-06 00:03:12,532][52811] DAMAGECOUNT value on done: 71182.0 [2024-08-06 00:03:12,535][52811] Sum rewards: 51.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.144', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '46.000'} [2024-08-06 00:03:12,544][52794] DAMAGECOUNT value on done: 77522.0 [2024-08-06 00:03:12,545][52794] Sum rewards: 49.346, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.261', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.187', 'weapon4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.912', 'WEAPON3': '1.200', 'weapon3': '2.578', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '42.000'} [2024-08-06 00:03:12,734][52660] DAMAGECOUNT value on done: 73639.0 [2024-08-06 00:03:12,734][52660] Sum rewards: 47.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.158', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.126', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon2': '0.364', 'ARMOR': '0.425', 'WEAPON4': '0.450', 'weapon4': '0.558', 'WEAPON3': '0.950', 'weapon3': '2.680', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '40.500'} [2024-08-06 00:03:12,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 161177600. Throughput: 0: 4400.2. Samples: 40301270. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:03:12,795][52567] Avg episode reward: [(0, '48.094')] [2024-08-06 00:03:13,604][52668] DAMAGECOUNT value on done: 74308.0 [2024-08-06 00:03:13,606][52668] Sum rewards: 47.814, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.772', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.112', 'AMMO3': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.486', 'weapon2': '0.516', 'WEAPON3': '0.850', 'weapon3': '2.688', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.424', 'FRAGCOUNT': '38.000'} [2024-08-06 00:03:13,627][52647] DAMAGECOUNT value on done: 77754.0 [2024-08-06 00:03:13,629][52647] Sum rewards: 50.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.594', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.330', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '2.946', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '45.000'} [2024-08-06 00:03:13,831][52803] DAMAGECOUNT value on done: 71269.0 [2024-08-06 00:03:13,834][52803] Sum rewards: 53.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.978', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'ARMOR': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.332', 'weapon4': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '46.000'} [2024-08-06 00:03:14,440][52669] DAMAGECOUNT value on done: 75353.0 [2024-08-06 00:03:14,441][52669] Sum rewards: 48.510, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.055', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.194', 'weapon4': '0.252', 'AMMO3': '0.254', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.600', 'HITCOUNT': '2.840', 'weapon3': '2.946', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '46.000'} [2024-08-06 00:03:14,512][52662] DAMAGECOUNT value on done: 81189.0 [2024-08-06 00:03:14,514][52662] Sum rewards: 52.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.062', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.012', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '46.000'} [2024-08-06 00:03:14,716][52649] DAMAGECOUNT value on done: 75778.0 [2024-08-06 00:03:14,718][52649] Sum rewards: 43.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.466', 'WEAPON3': '1.100', 'HITCOUNT': '2.380', 'weapon3': '3.048', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:15,337][52794] DAMAGECOUNT value on done: 84486.0 [2024-08-06 00:03:15,338][52794] Sum rewards: 54.535, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.656', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.628', 'WEAPON3': '1.550', 'weapon3': '2.690', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '50.500'} [2024-08-06 00:03:15,441][52667] DAMAGECOUNT value on done: 75294.0 [2024-08-06 00:03:15,443][52667] Sum rewards: 42.647, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.136', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:15,503][52650] Updated weights for policy 0, policy_version 19681 (0.0013) [2024-08-06 00:03:15,618][52811] DAMAGECOUNT value on done: 70559.0 [2024-08-06 00:03:15,618][52811] Sum rewards: 55.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.121', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.053', 'weapon5': '0.118', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.264', 'WEAPON4': '0.450', 'weapon2': '0.618', 'weapon4': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.296', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:15,703][52660] DAMAGECOUNT value on done: 72241.0 [2024-08-06 00:03:15,705][52660] Sum rewards: 41.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.156', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.862', 'WEAPON3': '0.950', 'HITCOUNT': '2.390', 'weapon3': '2.604', 'DAMAGECOUNT': '10.437', 'FRAGCOUNT': '35.000'} [2024-08-06 00:03:16,296][52668] DAMAGECOUNT value on done: 75617.0 [2024-08-06 00:03:16,298][52668] Sum rewards: 46.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.984', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '42.000'} [2024-08-06 00:03:16,582][52647] DAMAGECOUNT value on done: 75063.0 [2024-08-06 00:03:16,582][52647] Sum rewards: 45.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.238', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.004', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:16,822][52803] DAMAGECOUNT value on done: 68630.0 [2024-08-06 00:03:16,825][52803] Sum rewards: 52.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.266', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.470', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '2.984', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '43.000'} [2024-08-06 00:03:17,204][52669] DAMAGECOUNT value on done: 74818.0 [2024-08-06 00:03:17,206][52669] Sum rewards: 43.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.410', 'weapon4': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '38.000'} [2024-08-06 00:03:17,519][52662] DAMAGECOUNT value on done: 75691.0 [2024-08-06 00:03:17,522][52662] Sum rewards: 63.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.828', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.071', 'AMMO3': '0.165', 'weapon2': '0.290', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.518', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '52.000'} [2024-08-06 00:03:17,687][52649] DAMAGECOUNT value on done: 71877.0 [2024-08-06 00:03:17,689][52649] Sum rewards: 45.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.877', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.066', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.388', 'weapon2': '0.516', 'ARMOR': '0.958', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.732', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '37.500'} [2024-08-06 00:03:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 161259520. Throughput: 0: 4403.6. Samples: 40314490. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:03:17,794][52567] Avg episode reward: [(0, '48.312')] [2024-08-06 00:03:17,797][52614] Saving new best policy, reward=48.312! [2024-08-06 00:03:18,503][52794] DAMAGECOUNT value on done: 75333.0 [2024-08-06 00:03:18,504][52794] Sum rewards: 48.971, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.480', 'WEAPON3': '1.650', 'HITCOUNT': '2.800', 'weapon3': '2.868', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:18,506][52667] DAMAGECOUNT value on done: 77796.0 [2024-08-06 00:03:18,508][52667] Sum rewards: 37.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.672', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.098', 'weapon4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.676', 'WEAPON3': '1.450', 'HITCOUNT': '2.450', 'weapon3': '2.876', 'DAMAGECOUNT': '10.488', 'FRAGCOUNT': '35.000'} [2024-08-06 00:03:18,587][52660] DAMAGECOUNT value on done: 73489.0 [2024-08-06 00:03:18,587][52660] Sum rewards: 45.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.006', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.036', 'AMMO4': '0.159', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.926', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.842', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '40.000'} [2024-08-06 00:03:18,835][52811] DAMAGECOUNT value on done: 69654.0 [2024-08-06 00:03:18,835][52811] Sum rewards: 40.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.558', 'AMMO2': '0.017', 'weapon4': '0.058', 'AMMO4': '0.083', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.340', 'WEAPON3': '1.600', 'HITCOUNT': '2.690', 'weapon3': '3.436', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '38.000'} [2024-08-06 00:03:19,082][52647] DAMAGECOUNT value on done: 76814.0 [2024-08-06 00:03:19,084][52647] Sum rewards: 51.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.616', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.220', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '46.000'} [2024-08-06 00:03:19,365][52668] DAMAGECOUNT value on done: 72957.0 [2024-08-06 00:03:19,365][52668] Sum rewards: 38.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.588', 'AMMO5': '0.018', 'ARMOR': '0.032', 'AMMO2': '0.064', 'weapon5': '0.180', 'AMMO3': '0.186', 'weapon4': '0.276', 'AMMO4': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.632', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.602', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.666', 'FRAGCOUNT': '33.500'} [2024-08-06 00:03:20,058][52669] DAMAGECOUNT value on done: 74295.0 [2024-08-06 00:03:20,060][52669] Sum rewards: 36.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.168', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon7': '0.014', 'AMMO2': '0.036', 'weapon5': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.380', 'weapon4': '0.808', 'WEAPON3': '1.150', 'weapon3': '2.426', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.277', 'FRAGCOUNT': '33.000'} [2024-08-06 00:03:20,127][52803] DAMAGECOUNT value on done: 73363.0 [2024-08-06 00:03:20,128][52803] Sum rewards: 65.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.008', 'weapon5': '0.014', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.186', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '55.000'} [2024-08-06 00:03:20,481][52650] Updated weights for policy 0, policy_version 19691 (0.0014) [2024-08-06 00:03:20,735][52662] DAMAGECOUNT value on done: 79563.0 [2024-08-06 00:03:20,736][52662] Sum rewards: 56.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon4': '0.296', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.836', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '49.000'} [2024-08-06 00:03:20,877][52649] DAMAGECOUNT value on done: 75513.0 [2024-08-06 00:03:20,877][52649] Sum rewards: 62.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.093', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.058', 'weapon4': '0.066', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '53.000'} [2024-08-06 00:03:20,879][52667] DAMAGECOUNT value on done: 74854.0 [2024-08-06 00:03:20,881][52667] Sum rewards: 54.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.102', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.034', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.458', 'weapon2': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '44.000'} [2024-08-06 00:03:21,639][52794] DAMAGECOUNT value on done: 81019.0 [2024-08-06 00:03:21,639][52794] Sum rewards: 45.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.060', 'AMMO3': '0.191', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.430', 'WEAPON4': '0.500', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.638', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.847', 'FRAGCOUNT': '40.000'} [2024-08-06 00:03:21,670][52660] DAMAGECOUNT value on done: 74317.0 [2024-08-06 00:03:21,672][52660] Sum rewards: 43.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.922', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.168', 'AMMO4': '0.178', 'weapon5': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.450', 'weapon2': '0.964', 'WEAPON3': '1.050', 'weapon3': '2.014', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:21,807][52647] DAMAGECOUNT value on done: 75635.0 [2024-08-06 00:03:21,807][52647] Sum rewards: 39.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.201', 'weapon4': '0.414', 'WEAPON4': '0.450', 'weapon2': '0.884', 'WEAPON3': '1.250', 'HITCOUNT': '2.430', 'weapon3': '2.446', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '36.000'} [2024-08-06 00:03:21,898][52811] DAMAGECOUNT value on done: 72301.0 [2024-08-06 00:03:21,900][52811] Sum rewards: 65.083, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.026', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.052', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon2': '0.986', 'WEAPON3': '1.000', 'weapon3': '2.770', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '52.000'} [2024-08-06 00:03:22,461][52668] DAMAGECOUNT value on done: 72697.0 [2024-08-06 00:03:22,462][52668] Sum rewards: 53.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.370', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.372', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '46.000'} [2024-08-06 00:03:22,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 161341440. Throughput: 0: 4397.1. Samples: 40340550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:03:22,795][52567] Avg episode reward: [(0, '48.589')] [2024-08-06 00:03:22,814][52614] Saving new best policy, reward=48.589! [2024-08-06 00:03:23,038][52669] DAMAGECOUNT value on done: 76492.0 [2024-08-06 00:03:23,048][52669] Sum rewards: 53.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.062', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.163', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.690', 'WEAPON3': '0.950', 'weapon3': '2.518', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '43.500'} [2024-08-06 00:03:23,217][52803] DAMAGECOUNT value on done: 67193.0 [2024-08-06 00:03:23,221][52803] Sum rewards: 40.966, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon7': '0.088', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON7': '0.200', 'weapon2': '0.474', 'WEAPON3': '0.850', 'weapon4': '1.036', 'HITCOUNT': '2.140', 'weapon3': '2.172', 'DAMAGECOUNT': '9.294', 'FRAGCOUNT': '34.000'} [2024-08-06 00:03:23,537][52667] DAMAGECOUNT value on done: 74113.0 [2024-08-06 00:03:23,539][52667] Sum rewards: 39.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.138', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.046', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'AMMO3': '0.251', 'weapon4': '0.440', 'WEAPON4': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.500', 'HITCOUNT': '2.580', 'weapon3': '2.590', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:23,887][52662] DAMAGECOUNT value on done: 80405.0 [2024-08-06 00:03:23,887][52662] Sum rewards: 47.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.056', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.588', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.078', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:24,163][52649] DAMAGECOUNT value on done: 73818.0 [2024-08-06 00:03:24,165][52649] Sum rewards: 48.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.106', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.049', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.245', 'weapon4': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '2.952', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '44.000'} [2024-08-06 00:03:24,335][52647] DAMAGECOUNT value on done: 76019.0 [2024-08-06 00:03:24,337][52647] Sum rewards: 46.394, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.177', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.412', 'WEAPON3': '1.000', 'HITCOUNT': '2.960', 'weapon3': '3.060', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '38.000'} [2024-08-06 00:03:24,581][52660] DAMAGECOUNT value on done: 80220.0 [2024-08-06 00:03:24,583][52660] Sum rewards: 50.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.028', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.256', 'weapon2': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.032', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:24,831][52794] DAMAGECOUNT value on done: 82252.0 [2024-08-06 00:03:24,832][52794] Sum rewards: 49.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.243', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.418', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.008', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '43.000'} [2024-08-06 00:03:24,935][52650] Updated weights for policy 0, policy_version 19701 (0.0014) [2024-08-06 00:03:25,141][52811] DAMAGECOUNT value on done: 69968.0 [2024-08-06 00:03:25,143][52811] Sum rewards: 68.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.346', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.354', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.000'} [2024-08-06 00:03:25,211][52668] DAMAGECOUNT value on done: 77177.0 [2024-08-06 00:03:25,213][52668] Sum rewards: 42.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.877', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.034', 'AMMO2': '0.044', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.224', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '3.010', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '38.500'} [2024-08-06 00:03:25,876][52669] DAMAGECOUNT value on done: 76890.0 [2024-08-06 00:03:25,880][52669] Sum rewards: 31.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.308', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon4': '0.256', 'WEAPON4': '0.350', 'ARMOR': '0.428', 'weapon2': '0.740', 'WEAPON3': '1.400', 'HITCOUNT': '2.380', 'weapon3': '2.706', 'DAMAGECOUNT': '9.717', 'FRAGCOUNT': '31.000'} [2024-08-06 00:03:26,701][52667] DAMAGECOUNT value on done: 78219.0 [2024-08-06 00:03:26,703][52667] Sum rewards: 50.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.210', 'ARMOR': '0.455', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '42.000'} [2024-08-06 00:03:26,790][52649] DAMAGECOUNT value on done: 79550.0 [2024-08-06 00:03:26,790][52649] Sum rewards: 52.549, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.304', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.209', 'AMMO4': '0.223', 'WEAPON4': '0.450', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:26,968][52662] DAMAGECOUNT value on done: 78458.0 [2024-08-06 00:03:26,968][52662] Sum rewards: 43.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.286', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.201', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:27,051][52660] DAMAGECOUNT value on done: 73675.0 [2024-08-06 00:03:27,051][52660] Sum rewards: 52.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.587', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon5': '0.048', 'weapon4': '0.064', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.292', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.348', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '48.000'} [2024-08-06 00:03:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 161431552. Throughput: 0: 4389.8. Samples: 40366740. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:03:27,795][52567] Avg episode reward: [(0, '48.622')] [2024-08-06 00:03:27,855][52668] DAMAGECOUNT value on done: 76748.0 [2024-08-06 00:03:27,855][52668] Sum rewards: 43.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.934', 'AMMO2': '0.016', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'weapon2': '0.222', 'AMMO3': '0.287', 'WEAPON3': '1.750', 'HITCOUNT': '2.580', 'weapon3': '3.520', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '42.000'} [2024-08-06 00:03:27,859][52614] Saving new best policy, reward=48.622! [2024-08-06 00:03:27,860][52794] DAMAGECOUNT value on done: 81065.0 [2024-08-06 00:03:27,861][52794] Sum rewards: 65.627, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'HEALTH': '0.084', 'AMMO3': '0.180', 'weapon2': '0.630', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '53.000'} [2024-08-06 00:03:28,246][52811] DAMAGECOUNT value on done: 70757.0 [2024-08-06 00:03:28,248][52811] Sum rewards: 55.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.891', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '49.000'} [2024-08-06 00:03:28,951][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:03:28,978][52669] DAMAGECOUNT value on done: 75220.0 [2024-08-06 00:03:28,978][52669] Sum rewards: 57.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.536', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.207', 'weapon2': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.206', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '50.000'} [2024-08-06 00:03:29,425][52667] DAMAGECOUNT value on done: 75771.0 [2024-08-06 00:03:29,427][52667] Sum rewards: 36.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.432', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.164', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.856', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '2.434', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '34.000'} [2024-08-06 00:03:29,826][52650] Updated weights for policy 0, policy_version 19711 (0.0011) [2024-08-06 00:03:30,147][52660] DAMAGECOUNT value on done: 75649.0 [2024-08-06 00:03:30,147][52660] Sum rewards: 48.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.298', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO3': '0.190', 'AMMO4': '0.192', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.528', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.698', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '43.000'} [2024-08-06 00:03:30,760][52794] DAMAGECOUNT value on done: 82730.0 [2024-08-06 00:03:30,764][52794] Sum rewards: 47.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.904', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.170', 'weapon5': '0.184', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '2.676', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '42.000'} [2024-08-06 00:03:31,811][52669] DAMAGECOUNT value on done: 75128.0 [2024-08-06 00:03:31,812][52669] Sum rewards: 45.822, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.074', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.072', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'weapon4': '0.310', 'weapon2': '0.634', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.626', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '42.000'} [2024-08-06 00:03:32,124][52667] DAMAGECOUNT value on done: 77048.0 [2024-08-06 00:03:32,124][52667] Sum rewards: 45.760, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.116', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.102', 'weapon5': '0.120', 'AMMO4': '0.192', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.600', 'weapon3': '2.838', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '43.000'} [2024-08-06 00:03:32,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 161521664. Throughput: 0: 4382.7. Samples: 40379760. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:03:32,794][52567] Avg episode reward: [(0, '48.902')] [2024-08-06 00:03:32,795][52614] Saving new best policy, reward=48.902! [2024-08-06 00:03:33,012][52660] DAMAGECOUNT value on done: 73258.0 [2024-08-06 00:03:33,013][52660] Sum rewards: 58.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.864', 'AMMO5': '0.008', 'AMMO2': '0.041', 'ARMOR': '0.056', 'weapon5': '0.092', 'AMMO4': '0.205', 'AMMO3': '0.211', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '51.000'} [2024-08-06 00:03:33,305][52794] DAMAGECOUNT value on done: 78721.0 [2024-08-06 00:03:33,307][52794] Sum rewards: 45.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO4': '0.188', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON4': '0.500', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.892', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:33,350][52658] Large shaping reward 2.740 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 00:03:34,334][52650] Updated weights for policy 0, policy_version 19721 (0.0022) [2024-08-06 00:03:34,909][52669] DAMAGECOUNT value on done: 75215.0 [2024-08-06 00:03:34,910][52669] Sum rewards: 41.407, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.731', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.184', 'weapon4': '0.214', 'AMMO3': '0.258', 'WEAPON4': '0.400', 'weapon2': '0.414', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.842', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '38.500'} [2024-08-06 00:03:34,982][52667] DAMAGECOUNT value on done: 76008.0 [2024-08-06 00:03:34,982][52667] Sum rewards: 53.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.157', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '44.000'} [2024-08-06 00:03:35,897][52660] DAMAGECOUNT value on done: 78349.0 [2024-08-06 00:03:35,898][52660] Sum rewards: 56.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.418', 'weapon4': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:37,458][52795] DAMAGECOUNT value on done: 69933.0 [2024-08-06 00:03:37,458][52795] Sum rewards: 47.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.427', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'weapon4': '0.416', 'weapon2': '0.468', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.826', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '44.000'} [2024-08-06 00:03:37,781][52667] DAMAGECOUNT value on done: 75535.0 [2024-08-06 00:03:37,782][52667] Sum rewards: 49.500, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.242', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '45.000'} [2024-08-06 00:03:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 161611776. Throughput: 0: 4380.2. Samples: 40405890. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:03:37,794][52567] Avg episode reward: [(0, '48.892')] [2024-08-06 00:03:38,202][52669] DAMAGECOUNT value on done: 73519.0 [2024-08-06 00:03:38,204][52669] Sum rewards: 51.859, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.224', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon4': '0.466', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '2.668', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '45.000'} [2024-08-06 00:03:38,736][52660] DAMAGECOUNT value on done: 73506.0 [2024-08-06 00:03:38,737][52660] Sum rewards: 42.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.968', 'AMMO5': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon5': '0.098', 'weapon4': '0.118', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.400', 'HITCOUNT': '2.730', 'weapon3': '3.130', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '37.500'} [2024-08-06 00:03:39,229][52650] Updated weights for policy 0, policy_version 19731 (0.0016) [2024-08-06 00:03:40,534][52795] DAMAGECOUNT value on done: 65304.0 [2024-08-06 00:03:40,538][52795] Sum rewards: 35.350, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.737', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.132', 'AMMO4': '0.207', 'AMMO3': '0.212', 'weapon5': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.590', 'WEAPON3': '1.300', 'HITCOUNT': '2.420', 'weapon3': '2.764', 'DAMAGECOUNT': '10.323', 'FRAGCOUNT': '33.000'} [2024-08-06 00:03:40,787][52667] DAMAGECOUNT value on done: 77686.0 [2024-08-06 00:03:40,787][52667] Sum rewards: 60.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.164', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.274', 'weapon4': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.878', 'FRAGCOUNT': '53.000'} [2024-08-06 00:03:41,391][52669] DAMAGECOUNT value on done: 78275.0 [2024-08-06 00:03:41,393][52669] Sum rewards: 48.341, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'AMMO2': '0.050', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO4': '0.248', 'weapon4': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.788', 'WEAPON3': '0.900', 'weapon3': '2.328', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '40.500'} [2024-08-06 00:03:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 161693696. Throughput: 0: 4378.0. Samples: 40432210. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:03:42,794][52567] Avg episode reward: [(0, '48.974')] [2024-08-06 00:03:42,795][52614] Saving new best policy, reward=48.974! [2024-08-06 00:03:43,185][52663] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('HEALTH', -0.036000000000000004, -12.0), ('weapon5', 0.002)] [2024-08-06 00:03:43,625][52660] Large shaping reward 3.471 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.42, 140.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:03:43,636][52795] DAMAGECOUNT value on done: 67128.0 [2024-08-06 00:03:43,637][52795] Sum rewards: 42.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.542', 'AMMO5': '0.010', 'AMMO2': '0.052', 'AMMO3': '0.145', 'weapon4': '0.178', 'weapon5': '0.240', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.050', 'HITCOUNT': '2.210', 'weapon3': '2.778', 'DAMAGECOUNT': '10.821', 'FRAGCOUNT': '36.000'} [2024-08-06 00:03:44,012][52667] DAMAGECOUNT value on done: 76018.0 [2024-08-06 00:03:44,012][52667] Sum rewards: 58.484, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon2': '0.306', 'weapon4': '0.352', 'HEALTH': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.072', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '49.000'} [2024-08-06 00:03:44,076][52669] DAMAGECOUNT value on done: 77312.0 [2024-08-06 00:03:44,076][52669] Sum rewards: 47.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.442', 'weapon2': '0.638', 'WEAPON3': '1.050', 'weapon3': '2.658', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '40.000'} [2024-08-06 00:03:44,119][52650] Updated weights for policy 0, policy_version 19741 (0.0023) [2024-08-06 00:03:46,729][52669] DAMAGECOUNT value on done: 74597.0 [2024-08-06 00:03:46,729][52669] Sum rewards: 52.261, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.610', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.190', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'weapon4': '0.394', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '2.522', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:46,755][52795] DAMAGECOUNT value on done: 70189.0 [2024-08-06 00:03:46,759][52795] Sum rewards: 42.217, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.062', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.167', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.864', 'WEAPON3': '1.250', 'weapon3': '2.478', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:46,799][52667] DAMAGECOUNT value on done: 74215.0 [2024-08-06 00:03:46,800][52667] Sum rewards: 56.938, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.573', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO4': '0.158', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.508', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.516', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '49.000'} [2024-08-06 00:03:47,632][52658] DAMAGECOUNT value on done: 78344.0 [2024-08-06 00:03:47,632][52658] Sum rewards: 44.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.275', 'AMMO5': '0.006', 'ARMOR': '0.016', 'weapon5': '0.034', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.191', 'WEAPON4': '0.400', 'weapon2': '0.522', 'weapon4': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.676', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 161783808. Throughput: 0: 4368.9. Samples: 40444970. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:03:47,794][52567] Avg episode reward: [(0, '48.681')] [2024-08-06 00:03:48,610][52650] Updated weights for policy 0, policy_version 19751 (0.0026) [2024-08-06 00:03:49,660][52669] DAMAGECOUNT value on done: 76491.0 [2024-08-06 00:03:49,661][52669] Sum rewards: 46.437, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.958', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.482', 'WEAPON3': '1.700', 'HITCOUNT': '3.000', 'weapon3': '3.166', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '44.000'} [2024-08-06 00:03:49,859][52667] DAMAGECOUNT value on done: 75909.0 [2024-08-06 00:03:49,859][52667] Sum rewards: 50.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.684', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.018', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.149', 'WEAPON4': '0.300', 'weapon2': '0.502', 'weapon4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.736', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:49,948][52795] DAMAGECOUNT value on done: 72206.0 [2024-08-06 00:03:49,950][52795] Sum rewards: 55.393, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.533', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.084', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.246', 'weapon4': '0.348', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.824', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '49.000'} [2024-08-06 00:03:50,773][52658] DAMAGECOUNT value on done: 75976.0 [2024-08-06 00:03:50,776][52658] Sum rewards: 39.077, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.242', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.163', 'weapon4': '0.268', 'AMMO3': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '2.100', 'HITCOUNT': '2.660', 'weapon3': '2.936', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '40.000'} [2024-08-06 00:03:52,752][52667] DAMAGECOUNT value on done: 74071.0 [2024-08-06 00:03:52,753][52667] Sum rewards: 49.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.847', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.209', 'weapon2': '0.260', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.234', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '43.000'} [2024-08-06 00:03:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 161865728. Throughput: 0: 4359.1. Samples: 40470690. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:03:52,795][52567] Avg episode reward: [(0, '48.751')] [2024-08-06 00:03:52,888][52669] DAMAGECOUNT value on done: 79252.0 [2024-08-06 00:03:52,891][52669] Sum rewards: 42.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.355', 'AMMO5': '0.003', 'ARMOR': '0.020', 'weapon5': '0.046', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'AMMO4': '0.258', 'weapon2': '0.432', 'WEAPON4': '0.500', 'weapon4': '0.566', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.774', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '38.000'} [2024-08-06 00:03:53,183][52795] DAMAGECOUNT value on done: 70632.0 [2024-08-06 00:03:53,183][52795] Sum rewards: 43.144, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.034', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.172', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.748', 'weapon4': '0.918', 'WEAPON3': '1.250', 'weapon3': '2.060', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:53,363][52650] Updated weights for policy 0, policy_version 19761 (0.0020) [2024-08-06 00:03:53,529][52658] DAMAGECOUNT value on done: 75798.0 [2024-08-06 00:03:53,531][52658] Sum rewards: 46.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.110', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.074', 'AMMO3': '0.147', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.494', 'weapon2': '0.946', 'WEAPON3': '0.950', 'weapon3': '2.320', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:55,630][52667] DAMAGECOUNT value on done: 76553.0 [2024-08-06 00:03:55,632][52667] Sum rewards: 53.021, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.710', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.042', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon4': '0.302', 'weapon2': '0.502', 'WEAPON3': '1.600', 'weapon3': '2.884', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '48.500'} [2024-08-06 00:03:55,769][52669] DAMAGECOUNT value on done: 80745.0 [2024-08-06 00:03:55,771][52669] Sum rewards: 44.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.041', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.698', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.956', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '39.000'} [2024-08-06 00:03:56,334][52795] DAMAGECOUNT value on done: 72861.0 [2024-08-06 00:03:56,335][52795] Sum rewards: 48.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.965', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.219', 'weapon2': '0.730', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.022', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '41.000'} [2024-08-06 00:03:56,541][52658] DAMAGECOUNT value on done: 76386.0 [2024-08-06 00:03:56,541][52658] Sum rewards: 54.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.494', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.182', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '46.000'} [2024-08-06 00:03:57,039][52666] DAMAGECOUNT value on done: 75245.0 [2024-08-06 00:03:57,040][52666] Sum rewards: 52.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.148', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.132', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.164', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '47.000'} [2024-08-06 00:03:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 161955840. Throughput: 0: 4352.4. Samples: 40497130. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:03:57,794][52567] Avg episode reward: [(0, '48.687')] [2024-08-06 00:03:57,993][52650] Updated weights for policy 0, policy_version 19771 (0.0013) [2024-08-06 00:03:58,430][52667] DAMAGECOUNT value on done: 82697.0 [2024-08-06 00:03:58,430][52667] Sum rewards: 49.710, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.364', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.150', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '2.836', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '44.000'} [2024-08-06 00:03:58,719][52669] DAMAGECOUNT value on done: 77024.0 [2024-08-06 00:03:58,719][52669] Sum rewards: 40.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.922', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon4': '0.398', 'weapon2': '0.468', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.818', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '37.000'} [2024-08-06 00:03:59,171][52658] DAMAGECOUNT value on done: 77747.0 [2024-08-06 00:03:59,171][52658] Sum rewards: 41.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.024', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon5': '0.180', 'weapon2': '0.710', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.848', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '36.000'} [2024-08-06 00:03:59,411][52795] DAMAGECOUNT value on done: 71305.0 [2024-08-06 00:03:59,412][52795] Sum rewards: 55.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.184', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon4': '0.266', 'weapon2': '0.452', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '48.000'} [2024-08-06 00:03:59,576][52665] DAMAGECOUNT value on done: 72589.0 [2024-08-06 00:03:59,579][52665] Sum rewards: 50.440, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO2': '0.009', 'AMMO4': '0.043', 'HEALTH': '0.070', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.292', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:00,026][52666] DAMAGECOUNT value on done: 76825.0 [2024-08-06 00:04:00,029][52666] Sum rewards: 55.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.645', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.056', 'weapon4': '0.080', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.318', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:00,855][52820] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:04:01,237][52667] DAMAGECOUNT value on done: 75716.0 [2024-08-06 00:04:01,238][52667] Sum rewards: 28.884, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.160', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.110', 'AMMO3': '0.203', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.656', 'WEAPON3': '1.300', 'HITCOUNT': '2.020', 'weapon3': '2.650', 'DAMAGECOUNT': '8.565', 'FRAGCOUNT': '28.000'} [2024-08-06 00:04:01,696][52669] DAMAGECOUNT value on done: 76414.0 [2024-08-06 00:04:01,698][52669] Sum rewards: 44.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.260', 'weapon2': '0.488', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '3.302', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '41.000'} [2024-08-06 00:04:02,323][52658] DAMAGECOUNT value on done: 73234.0 [2024-08-06 00:04:02,333][52658] Sum rewards: 50.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.072', 'AMMO4': '0.079', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.566', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.954', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:02,559][52650] Updated weights for policy 0, policy_version 19781 (0.0014) [2024-08-06 00:04:02,616][52665] DAMAGECOUNT value on done: 79395.0 [2024-08-06 00:04:02,616][52665] Sum rewards: 56.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.380', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:02,733][52795] DAMAGECOUNT value on done: 67615.0 [2024-08-06 00:04:02,734][52795] Sum rewards: 42.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'ARMOR': '0.025', 'AMMO2': '0.027', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.548', 'weapon4': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.514', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 162045952. Throughput: 0: 4355.6. Samples: 40510490. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:04:02,794][52567] Avg episode reward: [(0, '48.710')] [2024-08-06 00:04:02,901][52666] DAMAGECOUNT value on done: 76578.0 [2024-08-06 00:04:02,902][52666] Sum rewards: 54.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.074', 'weapon4': '0.144', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.096', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:04,094][52667] DAMAGECOUNT value on done: 80837.0 [2024-08-06 00:04:04,095][52667] Sum rewards: 43.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.983', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.110', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '2.926', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '38.000'} [2024-08-06 00:04:04,570][52669] DAMAGECOUNT value on done: 77718.0 [2024-08-06 00:04:04,571][52669] Sum rewards: 60.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.512', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.142', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.418', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '50.000'} [2024-08-06 00:04:05,195][52670] DAMAGECOUNT value on done: 73320.0 [2024-08-06 00:04:05,195][52670] Sum rewards: 53.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.638', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.132', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '45.000'} [2024-08-06 00:04:05,259][52614] Signal inference workers to stop experience collection... (3700 times) [2024-08-06 00:04:05,263][52614] Signal inference workers to resume experience collection... (3700 times) [2024-08-06 00:04:05,304][52650] InferenceWorker_p0-w0: stopping experience collection (3700 times) [2024-08-06 00:04:05,304][52650] InferenceWorker_p0-w0: resuming experience collection (3700 times) [2024-08-06 00:04:05,375][52658] DAMAGECOUNT value on done: 80572.0 [2024-08-06 00:04:05,375][52658] Sum rewards: 41.799, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.046', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.231', 'weapon5': '0.244', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'weapon4': '0.362', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.624', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '40.000'} [2024-08-06 00:04:05,485][52663] DAMAGECOUNT value on done: 77128.0 [2024-08-06 00:04:05,487][52663] Sum rewards: 48.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.895', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'weapon2': '0.266', 'weapon4': '0.430', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.126', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '39.000'} [2024-08-06 00:04:05,739][52665] DAMAGECOUNT value on done: 75599.0 [2024-08-06 00:04:05,742][52665] Sum rewards: 37.805, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.825', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.136', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.299', 'weapon4': '0.354', 'WEAPON3': '1.700', 'HITCOUNT': '2.610', 'weapon3': '2.746', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:06,013][52795] DAMAGECOUNT value on done: 71315.0 [2024-08-06 00:04:06,014][52795] Sum rewards: 48.002, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'HEALTH': '0.080', 'weapon5': '0.108', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.852', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:06,149][52666] DAMAGECOUNT value on done: 71342.0 [2024-08-06 00:04:06,149][52666] Sum rewards: 58.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.940', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.108', 'weapon5': '0.108', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '52.000'} [2024-08-06 00:04:07,201][52667] DAMAGECOUNT value on done: 75477.0 [2024-08-06 00:04:07,201][52667] Sum rewards: 46.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.426', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'AMMO4': '0.214', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '40.000'} [2024-08-06 00:04:07,346][52650] Updated weights for policy 0, policy_version 19791 (0.0013) [2024-08-06 00:04:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 162136064. Throughput: 0: 4356.9. Samples: 40536610. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:04:07,794][52567] Avg episode reward: [(0, '48.598')] [2024-08-06 00:04:07,825][52669] DAMAGECOUNT value on done: 75936.0 [2024-08-06 00:04:07,825][52669] Sum rewards: 33.520, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.690', 'ARMOR': '0.024', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.268', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.650', 'HITCOUNT': '2.280', 'weapon3': '3.040', 'DAMAGECOUNT': '10.209', 'FRAGCOUNT': '35.000'} [2024-08-06 00:04:08,042][52670] DAMAGECOUNT value on done: 77558.0 [2024-08-06 00:04:08,044][52670] Sum rewards: 48.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.036', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.462', 'weapon4': '0.584', 'WEAPON3': '0.950', 'weapon3': '2.632', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '41.000'} [2024-08-06 00:04:08,258][52658] DAMAGECOUNT value on done: 75403.0 [2024-08-06 00:04:08,260][52658] Sum rewards: 52.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.794', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon2': '0.344', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '3.486', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:08,590][52663] DAMAGECOUNT value on done: 75865.0 [2024-08-06 00:04:08,590][52663] Sum rewards: 50.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.435', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.076', 'AMMO3': '0.163', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '41.500'} [2024-08-06 00:04:08,700][52665] DAMAGECOUNT value on done: 73092.0 [2024-08-06 00:04:08,700][52665] Sum rewards: 45.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.049', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.245', 'weapon2': '0.266', 'WEAPON4': '0.500', 'weapon4': '0.758', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.752', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '41.000'} [2024-08-06 00:04:08,743][52666] DAMAGECOUNT value on done: 72755.0 [2024-08-06 00:04:08,745][52666] Sum rewards: 47.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.044', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.390', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '41.000'} [2024-08-06 00:04:09,020][52795] DAMAGECOUNT value on done: 72640.0 [2024-08-06 00:04:09,021][52795] Sum rewards: 52.251, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.208', 'AMMO3': '0.311', 'WEAPON3': '1.750', 'HITCOUNT': '2.990', 'weapon3': '3.504', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:10,156][52667] DAMAGECOUNT value on done: 78570.0 [2024-08-06 00:04:10,156][52667] Sum rewards: 43.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.196', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.138', 'weapon4': '0.140', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.864', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:10,485][52670] DAMAGECOUNT value on done: 74427.0 [2024-08-06 00:04:10,485][52670] Sum rewards: 45.006, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.394', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.118', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'weapon4': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.574', 'WEAPON3': '0.900', 'HITCOUNT': '2.410', 'weapon3': '2.592', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '37.500'} [2024-08-06 00:04:11,112][52663] DAMAGECOUNT value on done: 76078.0 [2024-08-06 00:04:11,113][52663] Sum rewards: 40.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.946', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.128', 'AMMO4': '0.145', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '3.358', 'DAMAGECOUNT': '11.205', 'FRAGCOUNT': '35.000'} [2024-08-06 00:04:11,269][52666] DAMAGECOUNT value on done: 71684.0 [2024-08-06 00:04:11,272][52666] Sum rewards: 43.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.088', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.342', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.716', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '39.000'} [2024-08-06 00:04:11,343][52658] DAMAGECOUNT value on done: 78534.0 [2024-08-06 00:04:11,345][52658] Sum rewards: 62.222, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.062', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon2': '0.590', 'HEALTH': '0.824', 'WEAPON3': '0.850', 'weapon3': '3.144', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:11,810][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:04:11,843][52665] DAMAGECOUNT value on done: 73596.0 [2024-08-06 00:04:11,844][52665] Sum rewards: 49.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.232', 'AMMO5': '0.007', 'weapon5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.728', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.066', 'FRAGCOUNT': '41.000'} [2024-08-06 00:04:12,240][52795] DAMAGECOUNT value on done: 68445.0 [2024-08-06 00:04:12,240][52795] Sum rewards: 47.957, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.310', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:12,257][52650] Updated weights for policy 0, policy_version 19801 (0.0028) [2024-08-06 00:04:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 162217984. Throughput: 0: 4360.4. Samples: 40562960. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:04:12,794][52567] Avg episode reward: [(0, '48.846')] [2024-08-06 00:04:13,312][52670] DAMAGECOUNT value on done: 75875.0 [2024-08-06 00:04:13,314][52670] Sum rewards: 67.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.312', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.025', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon4': '0.156', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.000', 'weapon3': '3.262', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '55.000'} [2024-08-06 00:04:13,775][52663] DAMAGECOUNT value on done: 77351.0 [2024-08-06 00:04:13,776][52663] Sum rewards: 53.507, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.666', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'weapon4': '0.180', 'AMMO3': '0.286', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '3.090', 'weapon3': '3.128', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:13,928][52658] DAMAGECOUNT value on done: 78237.0 [2024-08-06 00:04:13,929][52658] Sum rewards: 49.609, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.015', 'AMMO2': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.098', 'weapon5': '0.108', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.306', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.056', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '42.500'} [2024-08-06 00:04:13,970][52666] DAMAGECOUNT value on done: 72546.0 [2024-08-06 00:04:13,970][52666] Sum rewards: 46.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.068', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.594', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '3.168', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:15,056][52665] DAMAGECOUNT value on done: 76340.0 [2024-08-06 00:04:15,056][52665] Sum rewards: 41.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.428', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.179', 'AMMO3': '0.234', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.674', 'WEAPON3': '1.400', 'weapon3': '2.582', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '38.000'} [2024-08-06 00:04:15,491][52795] DAMAGECOUNT value on done: 69824.0 [2024-08-06 00:04:15,493][52795] Sum rewards: 41.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.644', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.157', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.586', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.856', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '36.000'} [2024-08-06 00:04:15,646][52670] DAMAGECOUNT value on done: 73274.0 [2024-08-06 00:04:15,648][52670] Sum rewards: 44.766, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.667', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'weapon5': '0.206', 'AMMO4': '0.210', 'AMMO3': '0.248', 'weapon2': '0.362', 'weapon4': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.746', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:16,364][52666] DAMAGECOUNT value on done: 73236.0 [2024-08-06 00:04:16,365][52666] Sum rewards: 55.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.835', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.182', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'ARMOR': '0.455', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:16,621][52663] DAMAGECOUNT value on done: 74543.0 [2024-08-06 00:04:16,623][52663] Sum rewards: 56.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.279', 'weapon2': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.566', 'WEAPON3': '1.700', 'weapon3': '2.824', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '51.000'} [2024-08-06 00:04:16,636][52658] DAMAGECOUNT value on done: 78366.0 [2024-08-06 00:04:16,638][52658] Sum rewards: 43.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.004', 'AMMO2': '0.042', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'AMMO4': '0.208', 'weapon2': '0.372', 'WEAPON4': '0.400', 'weapon4': '0.464', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.858', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '38.000'} [2024-08-06 00:04:16,929][52650] Updated weights for policy 0, policy_version 19811 (0.0019) [2024-08-06 00:04:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 162299904. Throughput: 0: 4360.0. Samples: 40575960. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:04:17,794][52567] Avg episode reward: [(0, '48.449')] [2024-08-06 00:04:18,191][52665] DAMAGECOUNT value on done: 77232.0 [2024-08-06 00:04:18,192][52665] Sum rewards: 52.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.213', 'weapon4': '0.464', 'WEAPON4': '0.550', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.686', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:18,582][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:04:18,601][52795] DAMAGECOUNT value on done: 71212.0 [2024-08-06 00:04:18,605][52795] Sum rewards: 39.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.994', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.176', 'AMMO3': '0.183', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON4': '0.400', 'weapon4': '0.668', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '2.518', 'DAMAGECOUNT': '10.344', 'FRAGCOUNT': '35.000'} [2024-08-06 00:04:18,737][52670] DAMAGECOUNT value on done: 77073.0 [2024-08-06 00:04:18,737][52670] Sum rewards: 51.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.005', 'AMMO2': '0.014', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.220', 'weapon2': '0.382', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.422', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:19,471][52663] DAMAGECOUNT value on done: 79103.0 [2024-08-06 00:04:19,473][52663] Sum rewards: 44.219, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.114', 'weapon4': '0.186', 'AMMO4': '0.190', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '3.164', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '39.000'} [2024-08-06 00:04:19,719][52666] DAMAGECOUNT value on done: 77508.0 [2024-08-06 00:04:19,719][52666] Sum rewards: 42.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.200', 'HITCOUNT': '2.530', 'weapon3': '3.290', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:19,830][52658] DAMAGECOUNT value on done: 74785.0 [2024-08-06 00:04:19,831][52658] Sum rewards: 53.559, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.184', 'weapon4': '0.370', 'WEAPON4': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:21,231][52650] Updated weights for policy 0, policy_version 19821 (0.0011) [2024-08-06 00:04:21,458][52665] DAMAGECOUNT value on done: 76345.0 [2024-08-06 00:04:21,459][52665] Sum rewards: 52.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.788', 'WEAPON3': '0.950', 'weapon3': '2.654', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:21,718][52670] DAMAGECOUNT value on done: 72010.0 [2024-08-06 00:04:21,719][52670] Sum rewards: 50.855, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.794', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.464', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.868', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:21,889][52795] DAMAGECOUNT value on done: 68500.0 [2024-08-06 00:04:21,889][52795] Sum rewards: 52.614, reward structure: {'DEATHCOUNT': '-17.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.504', 'HEALTH': '0.623', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:22,105][52663] DAMAGECOUNT value on done: 81366.0 [2024-08-06 00:04:22,105][52663] Sum rewards: 53.411, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.334', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.298', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:22,764][52666] DAMAGECOUNT value on done: 76049.0 [2024-08-06 00:04:22,766][52666] Sum rewards: 65.120, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.378', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.139', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '58.000'} [2024-08-06 00:04:22,788][52658] DAMAGECOUNT value on done: 75762.0 [2024-08-06 00:04:22,789][52658] Sum rewards: 45.577, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.772', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon5': '0.054', 'AMMO2': '0.054', 'AMMO3': '0.270', 'AMMO4': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.448', 'weapon4': '0.542', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'HITCOUNT': '2.430', 'weapon3': '2.606', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 162398208. Throughput: 0: 4368.0. Samples: 40602450. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:04:22,802][52567] Avg episode reward: [(0, '48.732')] [2024-08-06 00:04:24,247][52665] DAMAGECOUNT value on done: 79754.0 [2024-08-06 00:04:24,249][52665] Sum rewards: 57.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.312', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.076', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon2': '0.610', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '2.998', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:24,616][52670] DAMAGECOUNT value on done: 73884.0 [2024-08-06 00:04:24,616][52670] Sum rewards: 39.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.342', 'AMMO5': '0.010', 'ARMOR': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.178', 'weapon5': '0.184', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.522', 'WEAPON3': '1.100', 'HITCOUNT': '2.330', 'weapon3': '2.664', 'DAMAGECOUNT': '10.461', 'FRAGCOUNT': '33.000'} [2024-08-06 00:04:24,994][52795] DAMAGECOUNT value on done: 71619.0 [2024-08-06 00:04:24,995][52795] Sum rewards: 39.881, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.400', 'AMMO5': '0.004', 'weapon5': '0.036', 'AMMO2': '0.046', 'weapon7': '0.056', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.232', 'AMMO3': '0.261', 'weapon4': '0.368', 'WEAPON4': '0.450', 'ARMOR': '0.467', 'weapon2': '0.572', 'WEAPON3': '1.450', 'HITCOUNT': '2.540', 'weapon3': '2.644', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:25,219][52658] DAMAGECOUNT value on done: 73780.0 [2024-08-06 00:04:25,220][52658] Sum rewards: 27.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.981', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.062', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.892', 'WEAPON3': '1.050', 'HITCOUNT': '2.100', 'weapon3': '2.226', 'DAMAGECOUNT': '8.937', 'FRAGCOUNT': '26.000'} [2024-08-06 00:04:25,408][52666] DAMAGECOUNT value on done: 72965.0 [2024-08-06 00:04:25,408][52666] Sum rewards: 55.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.424', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.196', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:25,462][52663] DAMAGECOUNT value on done: 75728.0 [2024-08-06 00:04:25,463][52663] Sum rewards: 39.269, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.923', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon5': '0.166', 'AMMO3': '0.178', 'weapon2': '0.256', 'ARMOR': '0.451', 'WEAPON4': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '2.610', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '32.500'} [2024-08-06 00:04:26,177][52650] Updated weights for policy 0, policy_version 19831 (0.0012) [2024-08-06 00:04:27,253][52670] DAMAGECOUNT value on done: 70981.0 [2024-08-06 00:04:27,254][52670] Sum rewards: 40.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.161', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.160', 'AMMO3': '0.205', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.262', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '36.500'} [2024-08-06 00:04:27,286][52665] DAMAGECOUNT value on done: 77175.0 [2024-08-06 00:04:27,287][52665] Sum rewards: 51.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.502', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.140', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.128', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 162480128. Throughput: 0: 4368.0. Samples: 40628770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:04:27,802][52567] Avg episode reward: [(0, '48.278')] [2024-08-06 00:04:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019834_162480128.pth... [2024-08-06 00:04:27,966][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019322_158285824.pth [2024-08-06 00:04:28,072][52795] DAMAGECOUNT value on done: 74008.0 [2024-08-06 00:04:28,072][52795] Sum rewards: 39.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.178', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.152', 'AMMO3': '0.212', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'weapon4': '0.358', 'weapon2': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.420', 'weapon3': '2.612', 'DAMAGECOUNT': '10.590', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:28,085][52666] DAMAGECOUNT value on done: 72474.0 [2024-08-06 00:04:28,088][52666] Sum rewards: 36.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.004', 'AMMO2': '0.031', 'weapon5': '0.040', 'weapon7': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.450', 'weapon4': '0.578', 'weapon2': '0.708', 'WEAPON3': '1.350', 'HITCOUNT': '2.380', 'weapon3': '2.448', 'DAMAGECOUNT': '9.753', 'FRAGCOUNT': '34.500'} [2024-08-06 00:04:28,271][52658] DAMAGECOUNT value on done: 75168.0 [2024-08-06 00:04:28,271][52658] Sum rewards: 53.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.367', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.724', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '2.888', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:28,376][52663] DAMAGECOUNT value on done: 75677.0 [2024-08-06 00:04:28,379][52663] Sum rewards: 43.461, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.885', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.164', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'weapon2': '0.776', 'WEAPON3': '1.050', 'HITCOUNT': '2.620', 'weapon3': '2.906', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:28,904][52671] DAMAGECOUNT value on done: 81227.0 [2024-08-06 00:04:28,908][52671] Sum rewards: 47.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.225', 'weapon2': '0.466', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.280', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '41.000'} [2024-08-06 00:04:30,071][52669] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 00:04:30,125][52670] DAMAGECOUNT value on done: 69740.0 [2024-08-06 00:04:30,126][52670] Sum rewards: 50.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.694', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.176', 'AMMO4': '0.189', 'AMMO3': '0.196', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '2.636', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:30,174][52665] DAMAGECOUNT value on done: 77015.0 [2024-08-06 00:04:30,175][52665] Sum rewards: 48.466, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.015', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.148', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'weapon2': '0.472', 'weapon4': '0.506', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.572', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '45.000'} [2024-08-06 00:04:30,910][52658] DAMAGECOUNT value on done: 78725.0 [2024-08-06 00:04:30,910][52658] Sum rewards: 41.258, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.116', 'HEALTH': '0.284', 'WEAPON3': '0.700', 'weapon2': '1.070', 'HITCOUNT': '2.300', 'weapon3': '2.840', 'DAMAGECOUNT': '9.711', 'FRAGCOUNT': '33.000'} [2024-08-06 00:04:30,980][52666] DAMAGECOUNT value on done: 73728.0 [2024-08-06 00:04:30,980][52666] Sum rewards: 37.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.144', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.202', 'weapon2': '0.332', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '2.972', 'DAMAGECOUNT': '11.496', 'FRAGCOUNT': '33.000'} [2024-08-06 00:04:31,078][52650] Updated weights for policy 0, policy_version 19841 (0.0028) [2024-08-06 00:04:31,158][52795] DAMAGECOUNT value on done: 68092.0 [2024-08-06 00:04:31,160][52795] Sum rewards: 47.734, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon5': '0.160', 'weapon4': '0.172', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '0.984', 'weapon3': '2.508', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.577', 'FRAGCOUNT': '40.000'} [2024-08-06 00:04:31,497][52663] DAMAGECOUNT value on done: 79720.0 [2024-08-06 00:04:31,498][52663] Sum rewards: 49.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.333', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.121', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.842', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:32,020][52671] DAMAGECOUNT value on done: 77043.0 [2024-08-06 00:04:32,020][52671] Sum rewards: 58.979, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.426', 'weapon4': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.650', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 162570240. Throughput: 0: 4376.7. Samples: 40641920. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:04:32,794][52567] Avg episode reward: [(0, '47.982')] [2024-08-06 00:04:32,863][52670] DAMAGECOUNT value on done: 76375.0 [2024-08-06 00:04:32,863][52670] Sum rewards: 66.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.908', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '55.000'} [2024-08-06 00:04:33,082][52665] DAMAGECOUNT value on done: 75251.0 [2024-08-06 00:04:33,082][52665] Sum rewards: 44.674, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.245', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.192', 'WEAPON4': '0.450', 'weapon4': '0.470', 'weapon2': '0.710', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.562', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '39.000'} [2024-08-06 00:04:33,676][52658] DAMAGECOUNT value on done: 80671.0 [2024-08-06 00:04:33,676][52658] Sum rewards: 49.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.579', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.336', 'weapon4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '43.000'} [2024-08-06 00:04:33,817][52666] DAMAGECOUNT value on done: 75696.0 [2024-08-06 00:04:33,818][52666] Sum rewards: 45.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.217', 'weapon4': '0.322', 'weapon2': '0.516', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '2.926', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '39.000'} [2024-08-06 00:04:33,982][52663] DAMAGECOUNT value on done: 78055.0 [2024-08-06 00:04:33,982][52663] Sum rewards: 53.444, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.564', 'AMMO5': '0.011', 'AMMO2': '0.041', 'AMMO4': '0.203', 'weapon5': '0.220', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON4': '0.400', 'ARMOR': '0.416', 'weapon4': '0.570', 'WEAPON3': '1.450', 'weapon3': '2.580', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:34,354][52795] DAMAGECOUNT value on done: 70546.0 [2024-08-06 00:04:34,355][52795] Sum rewards: 36.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.332', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.204', 'weapon2': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.642', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.782', 'DAMAGECOUNT': '10.200', 'FRAGCOUNT': '32.000'} [2024-08-06 00:04:34,712][52671] DAMAGECOUNT value on done: 78077.0 [2024-08-06 00:04:34,712][52671] Sum rewards: 51.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.460', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.148', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:35,229][52650] Updated weights for policy 0, policy_version 19851 (0.0036) [2024-08-06 00:04:35,459][52670] DAMAGECOUNT value on done: 76765.0 [2024-08-06 00:04:35,460][52670] Sum rewards: 52.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.372', 'WEAPON4': '0.450', 'weapon4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.668', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '46.000'} [2024-08-06 00:04:36,035][52665] DAMAGECOUNT value on done: 75735.0 [2024-08-06 00:04:36,046][52665] Sum rewards: 56.026, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.575', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon4': '0.306', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '51.000'} [2024-08-06 00:04:36,356][52658] DAMAGECOUNT value on done: 75351.0 [2024-08-06 00:04:36,356][52658] Sum rewards: 55.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.134', 'AMMO3': '0.173', 'weapon2': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.582', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.914', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:36,453][52666] DAMAGECOUNT value on done: 72773.0 [2024-08-06 00:04:36,453][52666] Sum rewards: 42.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.718', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.148', 'AMMO4': '0.149', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.408', 'weapon4': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.738', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '37.500'} [2024-08-06 00:04:36,935][52663] DAMAGECOUNT value on done: 75391.0 [2024-08-06 00:04:36,936][52663] Sum rewards: 44.945, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.130', 'weapon5': '0.146', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.382', 'weapon2': '0.492', 'WEAPON3': '0.750', 'HEALTH': '0.782', 'weapon3': '2.792', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '36.000'} [2024-08-06 00:04:37,487][52795] DAMAGECOUNT value on done: 73320.0 [2024-08-06 00:04:37,488][52795] Sum rewards: 55.052, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.056', 'weapon4': '0.058', 'AMMO4': '0.070', 'HEALTH': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon2': '1.000', 'weapon3': '2.684', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 162660352. Throughput: 0: 4390.0. Samples: 40668240. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:04:37,794][52567] Avg episode reward: [(0, '48.119')] [2024-08-06 00:04:37,898][52671] DAMAGECOUNT value on done: 74402.0 [2024-08-06 00:04:37,898][52671] Sum rewards: 51.987, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'HEALTH': '0.397', 'weapon2': '0.688', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.004', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '45.000'} [2024-08-06 00:04:38,328][52670] DAMAGECOUNT value on done: 75754.0 [2024-08-06 00:04:38,330][52670] Sum rewards: 33.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.285', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.141', 'AMMO3': '0.205', 'WEAPON4': '0.550', 'weapon4': '0.646', 'weapon2': '0.684', 'WEAPON3': '1.350', 'weapon3': '2.278', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '31.000'} [2024-08-06 00:04:39,083][52665] DAMAGECOUNT value on done: 76778.0 [2024-08-06 00:04:39,083][52665] Sum rewards: 51.859, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.372', 'HEALTH': '0.458', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.862', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:39,133][52658] DAMAGECOUNT value on done: 75826.0 [2024-08-06 00:04:39,135][52658] Sum rewards: 53.188, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.307', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon4': '0.240', 'weapon2': '0.498', 'WEAPON3': '0.950', 'HITCOUNT': '3.020', 'weapon3': '3.080', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '43.000'} [2024-08-06 00:04:39,260][52666] DAMAGECOUNT value on done: 74239.0 [2024-08-06 00:04:39,262][52666] Sum rewards: 68.175, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.335', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon4': '0.240', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '58.000'} [2024-08-06 00:04:39,669][52663] DAMAGECOUNT value on done: 74349.0 [2024-08-06 00:04:39,670][52663] Sum rewards: 43.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.040', 'weapon4': '0.128', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.302', 'WEAPON3': '0.850', 'weapon2': '0.944', 'weapon3': '2.434', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '33.000'} [2024-08-06 00:04:40,227][52650] Updated weights for policy 0, policy_version 19861 (0.0021) [2024-08-06 00:04:40,718][52671] DAMAGECOUNT value on done: 74561.0 [2024-08-06 00:04:40,718][52671] Sum rewards: 53.381, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.824', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.132', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.420', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '43.000'} [2024-08-06 00:04:40,821][52670] DAMAGECOUNT value on done: 75197.0 [2024-08-06 00:04:40,823][52670] Sum rewards: 34.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.036', 'AMMO5': '0.005', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.179', 'AMMO4': '0.234', 'weapon2': '0.392', 'WEAPON4': '0.500', 'weapon4': '0.938', 'WEAPON3': '0.950', 'weapon3': '2.286', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.005', 'FRAGCOUNT': '31.000'} [2024-08-06 00:04:41,823][52666] DAMAGECOUNT value on done: 71056.0 [2024-08-06 00:04:41,825][52666] Sum rewards: 51.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.532', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.049', 'AMMO3': '0.143', 'weapon5': '0.156', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.560', 'weapon2': '0.824', 'WEAPON3': '0.950', 'weapon3': '2.206', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:41,944][52658] DAMAGECOUNT value on done: 80928.0 [2024-08-06 00:04:41,944][52658] Sum rewards: 49.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon5': '0.120', 'AMMO4': '0.169', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '44.500'} [2024-08-06 00:04:42,337][52665] DAMAGECOUNT value on done: 74818.0 [2024-08-06 00:04:42,337][52665] Sum rewards: 41.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.804', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'AMMO4': '0.241', 'WEAPON4': '0.450', 'weapon2': '0.674', 'weapon4': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.260', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.361', 'FRAGCOUNT': '37.000'} [2024-08-06 00:04:42,678][52663] DAMAGECOUNT value on done: 75763.0 [2024-08-06 00:04:42,678][52663] Sum rewards: 40.122, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.060', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.244', 'weapon4': '0.342', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.790', 'weapon3': '2.926', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '39.000'} [2024-08-06 00:04:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 162750464. Throughput: 0: 4388.0. Samples: 40694590. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:04:42,794][52567] Avg episode reward: [(0, '48.210')] [2024-08-06 00:04:43,418][52670] DAMAGECOUNT value on done: 77400.0 [2024-08-06 00:04:43,421][52670] Sum rewards: 57.565, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.376', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.532', 'WEAPON3': '0.800', 'weapon2': '0.938', 'weapon3': '2.240', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '45.000'} [2024-08-06 00:04:43,821][52671] DAMAGECOUNT value on done: 78816.0 [2024-08-06 00:04:43,821][52671] Sum rewards: 41.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.546', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'AMMO4': '0.223', 'weapon4': '0.454', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '2.828', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '36.000'} [2024-08-06 00:04:44,261][52666] DAMAGECOUNT value on done: 75434.0 [2024-08-06 00:04:44,263][52666] Sum rewards: 55.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.170', 'weapon4': '0.322', 'weapon2': '0.814', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:44,902][52650] Updated weights for policy 0, policy_version 19871 (0.0013) [2024-08-06 00:04:45,332][52665] DAMAGECOUNT value on done: 73858.0 [2024-08-06 00:04:45,333][52665] Sum rewards: 39.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.110', 'AMMO4': '0.181', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.190', 'weapon3': '3.058', 'DAMAGECOUNT': '9.969', 'FRAGCOUNT': '35.000'} [2024-08-06 00:04:45,524][52663] DAMAGECOUNT value on done: 80436.0 [2024-08-06 00:04:45,526][52663] Sum rewards: 52.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.048', 'weapon5': '0.110', 'AMMO3': '0.166', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON4': '0.500', 'weapon4': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:45,856][52670] DAMAGECOUNT value on done: 71862.0 [2024-08-06 00:04:45,856][52670] Sum rewards: 61.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.542', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.092', 'AMMO4': '0.115', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.818', 'WEAPON3': '0.950', 'weapon3': '2.726', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '50.000'} [2024-08-06 00:04:46,484][52671] DAMAGECOUNT value on done: 77575.0 [2024-08-06 00:04:46,484][52671] Sum rewards: 47.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.318', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.102', 'AMMO4': '0.152', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon5': '0.566', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.794', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '40.000'} [2024-08-06 00:04:46,695][52666] DAMAGECOUNT value on done: 74524.0 [2024-08-06 00:04:46,695][52666] Sum rewards: 52.637, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.123', 'WEAPON4': '0.250', 'weapon2': '0.476', 'weapon4': '0.492', 'WEAPON3': '0.800', 'HITCOUNT': '2.560', 'weapon3': '2.606', 'DAMAGECOUNT': '11.301', 'FRAGCOUNT': '43.000'} [2024-08-06 00:04:46,948][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:04:47,428][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:04:47,751][52665] DAMAGECOUNT value on done: 74636.0 [2024-08-06 00:04:47,751][52665] Sum rewards: 45.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.180', 'weapon2': '0.804', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '2.890', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '40.000'} [2024-08-06 00:04:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 162832384. Throughput: 0: 4387.1. Samples: 40707910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:04:47,794][52567] Avg episode reward: [(0, '48.450')] [2024-08-06 00:04:48,382][52670] DAMAGECOUNT value on done: 77348.0 [2024-08-06 00:04:48,382][52670] Sum rewards: 46.788, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.174', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.372', 'weapon4': '0.436', 'WEAPON3': '1.450', 'weapon3': '2.662', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '40.000'} [2024-08-06 00:04:48,522][52663] DAMAGECOUNT value on done: 75813.0 [2024-08-06 00:04:48,524][52663] Sum rewards: 51.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'weapon2': '0.194', 'AMMO3': '0.198', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.646', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:48,652][52659] DAMAGECOUNT value on done: 75762.0 [2024-08-06 00:04:48,656][52659] Sum rewards: 35.857, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.166', 'AMMO5': '0.024', 'AMMO2': '0.041', 'weapon5': '0.128', 'AMMO4': '0.206', 'AMMO3': '0.231', 'WEAPON5': '0.400', 'ARMOR': '0.408', 'weapon4': '0.504', 'WEAPON4': '0.600', 'weapon2': '0.722', 'WEAPON3': '1.450', 'weapon3': '2.368', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '35.000'} [2024-08-06 00:04:49,237][52650] Updated weights for policy 0, policy_version 19881 (0.0028) [2024-08-06 00:04:49,511][52666] DAMAGECOUNT value on done: 76698.0 [2024-08-06 00:04:49,514][52666] Sum rewards: 45.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.155', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.200', 'AMMO4': '0.229', 'weapon2': '0.382', 'WEAPON4': '0.450', 'weapon4': '0.624', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.800', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '40.000'} [2024-08-06 00:04:49,625][52671] DAMAGECOUNT value on done: 80331.0 [2024-08-06 00:04:49,626][52671] Sum rewards: 53.165, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.544', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.926', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:50,499][52665] DAMAGECOUNT value on done: 72665.0 [2024-08-06 00:04:50,499][52665] Sum rewards: 52.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.787', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.142', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '45.000'} [2024-08-06 00:04:51,200][52670] DAMAGECOUNT value on done: 76349.0 [2024-08-06 00:04:51,201][52670] Sum rewards: 48.383, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.922', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.256', 'weapon4': '0.280', 'weapon2': '0.508', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.020', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '43.000'} [2024-08-06 00:04:51,332][52663] DAMAGECOUNT value on done: 78339.0 [2024-08-06 00:04:51,333][52663] Sum rewards: 51.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.318', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.140', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.098', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:51,804][52664] DAMAGECOUNT value on done: 77997.0 [2024-08-06 00:04:51,805][52664] Sum rewards: 37.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.139', 'weapon5': '0.178', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.602', 'WEAPON3': '0.750', 'weapon2': '0.902', 'weapon3': '2.114', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '10.131', 'FRAGCOUNT': '32.000'} [2024-08-06 00:04:51,843][52659] DAMAGECOUNT value on done: 79217.0 [2024-08-06 00:04:51,843][52659] Sum rewards: 57.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.918', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.195', 'weapon4': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '50.000'} [2024-08-06 00:04:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 162922496. Throughput: 0: 4394.0. Samples: 40734340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:04:52,802][52567] Avg episode reward: [(0, '48.352')] [2024-08-06 00:04:52,875][52671] DAMAGECOUNT value on done: 76923.0 [2024-08-06 00:04:52,876][52671] Sum rewards: 44.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.018', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.066', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.468', 'weapon4': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.564', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:53,460][52665] DAMAGECOUNT value on done: 72632.0 [2024-08-06 00:04:53,462][52665] Sum rewards: 50.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.892', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.468', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '2.974', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:53,880][52650] Updated weights for policy 0, policy_version 19891 (0.0034) [2024-08-06 00:04:54,302][52670] DAMAGECOUNT value on done: 73335.0 [2024-08-06 00:04:54,302][52670] Sum rewards: 50.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.824', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.135', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.508', 'weapon4': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.472', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '43.000'} [2024-08-06 00:04:54,306][52663] DAMAGECOUNT value on done: 78463.0 [2024-08-06 00:04:54,306][52663] Sum rewards: 51.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.118', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.390', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:54,392][52664] DAMAGECOUNT value on done: 79326.0 [2024-08-06 00:04:54,393][52664] Sum rewards: 44.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.020', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.154', 'AMMO3': '0.219', 'weapon2': '0.534', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.106', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '38.000'} [2024-08-06 00:04:55,291][52659] DAMAGECOUNT value on done: 75597.0 [2024-08-06 00:04:55,291][52659] Sum rewards: 40.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.825', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.156', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.452', 'WEAPON3': '1.150', 'HITCOUNT': '2.450', 'weapon3': '2.952', 'DAMAGECOUNT': '10.626', 'FRAGCOUNT': '35.000'} [2024-08-06 00:04:56,160][52671] DAMAGECOUNT value on done: 78737.0 [2024-08-06 00:04:56,161][52671] Sum rewards: 53.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.609', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.448', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '44.000'} [2024-08-06 00:04:56,506][52665] DAMAGECOUNT value on done: 73350.0 [2024-08-06 00:04:56,508][52665] Sum rewards: 57.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.284', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:56,839][52663] DAMAGECOUNT value on done: 80159.0 [2024-08-06 00:04:56,841][52663] Sum rewards: 56.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.683', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.454', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.266', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '47.000'} [2024-08-06 00:04:57,215][52670] DAMAGECOUNT value on done: 73560.0 [2024-08-06 00:04:57,216][52670] Sum rewards: 32.784, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.727', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.968', 'WEAPON3': '1.100', 'HITCOUNT': '2.160', 'weapon3': '2.286', 'DAMAGECOUNT': '9.198', 'FRAGCOUNT': '29.000'} [2024-08-06 00:04:57,478][52664] DAMAGECOUNT value on done: 81225.0 [2024-08-06 00:04:57,479][52664] Sum rewards: 42.824, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.612', 'ARMOR': '0.028', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.524', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '41.000'} [2024-08-06 00:04:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.4). Total num frames: 163012608. Throughput: 0: 4395.6. Samples: 40760760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:04:57,794][52567] Avg episode reward: [(0, '48.583')] [2024-08-06 00:04:58,417][52659] DAMAGECOUNT value on done: 78593.0 [2024-08-06 00:04:58,422][52659] Sum rewards: 43.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.609', 'AMMO5': '0.015', 'ARMOR': '0.036', 'AMMO2': '0.043', 'AMMO3': '0.184', 'weapon5': '0.190', 'AMMO4': '0.214', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON4': '0.550', 'weapon4': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.424', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '39.000'} [2024-08-06 00:04:58,672][52650] Updated weights for policy 0, policy_version 19901 (0.0011) [2024-08-06 00:04:59,198][52671] DAMAGECOUNT value on done: 77739.0 [2024-08-06 00:04:59,201][52671] Sum rewards: 44.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.137', 'AMMO3': '0.234', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '2.650', 'weapon3': '2.952', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '42.000'} [2024-08-06 00:04:59,509][52820] DAMAGECOUNT value on done: 70270.0 [2024-08-06 00:04:59,512][52820] Sum rewards: 55.009, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.911', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.234', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '49.000'} [2024-08-06 00:04:59,958][52663] DAMAGECOUNT value on done: 76238.0 [2024-08-06 00:04:59,959][52663] Sum rewards: 44.900, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.948', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.610', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '35.500'} [2024-08-06 00:05:00,360][52664] DAMAGECOUNT value on done: 78126.0 [2024-08-06 00:05:00,361][52664] Sum rewards: 36.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO4': '0.181', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.562', 'weapon4': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.398', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.092', 'FRAGCOUNT': '34.000'} [2024-08-06 00:05:01,523][52659] DAMAGECOUNT value on done: 77853.0 [2024-08-06 00:05:01,523][52659] Sum rewards: 50.301, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.774', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.034', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.348', 'weapon2': '0.628', 'WEAPON3': '2.050', 'weapon3': '3.030', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '50.000'} [2024-08-06 00:05:02,158][52671] DAMAGECOUNT value on done: 77087.0 [2024-08-06 00:05:02,158][52671] Sum rewards: 36.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.549', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.058', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.224', 'weapon4': '0.424', 'WEAPON4': '0.600', 'weapon2': '0.788', 'WEAPON3': '1.500', 'HITCOUNT': '2.340', 'weapon3': '2.410', 'DAMAGECOUNT': '10.650', 'FRAGCOUNT': '34.000'} [2024-08-06 00:05:02,763][52820] DAMAGECOUNT value on done: 73146.0 [2024-08-06 00:05:02,763][52820] Sum rewards: 42.369, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.618', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.544', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 163102720. Throughput: 0: 4400.2. Samples: 40773970. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:05:02,794][52567] Avg episode reward: [(0, '47.923')] [2024-08-06 00:05:03,214][52664] DAMAGECOUNT value on done: 78295.0 [2024-08-06 00:05:03,215][52664] Sum rewards: 53.477, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.594', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.068', 'weapon4': '0.072', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.012', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:03,239][52650] Updated weights for policy 0, policy_version 19911 (0.0020) [2024-08-06 00:05:04,043][52659] DAMAGECOUNT value on done: 79268.0 [2024-08-06 00:05:04,043][52659] Sum rewards: 45.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.160', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.470', 'WEAPON4': '0.500', 'weapon4': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.550', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.373', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:04,639][52671] DAMAGECOUNT value on done: 82069.0 [2024-08-06 00:05:04,639][52671] Sum rewards: 41.014, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.843', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.186', 'AMMO4': '0.192', 'AMMO3': '0.216', 'weapon4': '0.238', 'WEAPON4': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.856', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '37.000'} [2024-08-06 00:05:05,906][52820] DAMAGECOUNT value on done: 68454.0 [2024-08-06 00:05:05,906][52820] Sum rewards: 45.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.244', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'weapon5': '0.176', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon2': '0.448', 'weapon4': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.412', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '39.000'} [2024-08-06 00:05:06,235][52664] DAMAGECOUNT value on done: 82253.0 [2024-08-06 00:05:06,236][52664] Sum rewards: 37.800, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.974', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon7': '0.060', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.156', 'weapon5': '0.156', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.572', 'weapon4': '0.942', 'WEAPON3': '0.950', 'HITCOUNT': '1.970', 'weapon3': '2.012', 'DAMAGECOUNT': '9.624', 'FRAGCOUNT': '32.000'} [2024-08-06 00:05:06,633][52659] DAMAGECOUNT value on done: 78853.0 [2024-08-06 00:05:06,633][52659] Sum rewards: 56.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.336', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.278', 'weapon2': '0.306', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.170', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '51.000'} [2024-08-06 00:05:07,118][52671] DAMAGECOUNT value on done: 77596.0 [2024-08-06 00:05:07,118][52671] Sum rewards: 54.380, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.281', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.123', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON3': '0.850', 'weapon2': '0.914', 'HITCOUNT': '2.780', 'weapon3': '2.848', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 163184640. Throughput: 0: 4403.3. Samples: 40800600. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:05:07,794][52567] Avg episode reward: [(0, '47.936')] [2024-08-06 00:05:07,995][52650] Updated weights for policy 0, policy_version 19921 (0.0017) [2024-08-06 00:05:08,455][52664] DAMAGECOUNT value on done: 79907.0 [2024-08-06 00:05:08,455][52664] Sum rewards: 53.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.757', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO3': '0.159', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.514', 'weapon2': '0.638', 'WEAPON3': '1.050', 'weapon3': '2.458', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:09,241][52820] DAMAGECOUNT value on done: 68458.0 [2024-08-06 00:05:09,241][52820] Sum rewards: 33.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.030', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.736', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.854', 'DAMAGECOUNT': '9.735', 'FRAGCOUNT': '31.000'} [2024-08-06 00:05:09,381][52659] DAMAGECOUNT value on done: 74475.0 [2024-08-06 00:05:09,382][52659] Sum rewards: 55.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.346', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.348', 'weapon4': '0.696', 'WEAPON3': '1.000', 'weapon3': '2.600', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '48.000'} [2024-08-06 00:05:10,125][52671] DAMAGECOUNT value on done: 73999.0 [2024-08-06 00:05:10,127][52671] Sum rewards: 47.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.806', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.214', 'weapon2': '0.214', 'weapon4': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.102', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:11,036][52664] DAMAGECOUNT value on done: 73959.0 [2024-08-06 00:05:11,036][52664] Sum rewards: 47.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.266', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.020', 'weapon5': '0.048', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.290', 'weapon2': '0.524', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.858', 'DAMAGECOUNT': '11.109', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:12,292][52820] DAMAGECOUNT value on done: 69472.0 [2024-08-06 00:05:12,292][52820] Sum rewards: 40.645, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.637', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon7': '0.066', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.568', 'WEAPON3': '0.700', 'weapon4': '0.700', 'HITCOUNT': '2.080', 'weapon3': '2.164', 'DAMAGECOUNT': '10.302', 'FRAGCOUNT': '34.000'} [2024-08-06 00:05:12,318][52659] DAMAGECOUNT value on done: 77243.0 [2024-08-06 00:05:12,319][52659] Sum rewards: 53.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.287', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.054', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.480', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.780', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '47.000'} [2024-08-06 00:05:12,548][52650] Updated weights for policy 0, policy_version 19931 (0.0011) [2024-08-06 00:05:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 163274752. Throughput: 0: 4406.7. Samples: 40827070. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:05:12,794][52567] Avg episode reward: [(0, '47.770')] [2024-08-06 00:05:12,921][52671] DAMAGECOUNT value on done: 78483.0 [2024-08-06 00:05:12,922][52671] Sum rewards: 44.704, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.119', 'weapon5': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.782', 'WEAPON3': '0.850', 'weapon3': '2.456', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.809', 'FRAGCOUNT': '37.000'} [2024-08-06 00:05:13,972][52664] DAMAGECOUNT value on done: 85705.0 [2024-08-06 00:05:13,972][52664] Sum rewards: 48.446, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.374', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'AMMO4': '0.191', 'WEAPON4': '0.450', 'weapon2': '0.516', 'weapon4': '0.702', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:14,724][52659] DAMAGECOUNT value on done: 79768.0 [2024-08-06 00:05:14,724][52659] Sum rewards: 57.852, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.582', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.270', 'weapon2': '0.280', 'AMMO3': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.254', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '51.000'} [2024-08-06 00:05:15,342][52671] DAMAGECOUNT value on done: 77821.0 [2024-08-06 00:05:15,343][52671] Sum rewards: 49.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.735', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.191', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '3.096', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:15,521][52820] DAMAGECOUNT value on done: 71145.0 [2024-08-06 00:05:15,524][52820] Sum rewards: 37.036, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.712', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.142', 'AMMO4': '0.218', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '2.744', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '36.000'} [2024-08-06 00:05:16,880][52664] DAMAGECOUNT value on done: 82507.0 [2024-08-06 00:05:16,881][52664] Sum rewards: 49.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.188', 'weapon5': '0.220', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:17,259][52650] Updated weights for policy 0, policy_version 19941 (0.0016) [2024-08-06 00:05:17,342][52659] DAMAGECOUNT value on done: 77126.0 [2024-08-06 00:05:17,344][52659] Sum rewards: 43.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.298', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon4': '0.142', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.940', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '37.500'} [2024-08-06 00:05:17,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 163364864. Throughput: 0: 4409.7. Samples: 40840360. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:05:17,795][52567] Avg episode reward: [(0, '47.789')] [2024-08-06 00:05:17,817][52671] DAMAGECOUNT value on done: 78778.0 [2024-08-06 00:05:17,818][52671] Sum rewards: 46.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.086', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon4': '0.212', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.726', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '40.500'} [2024-08-06 00:05:18,636][52820] DAMAGECOUNT value on done: 71812.0 [2024-08-06 00:05:18,637][52820] Sum rewards: 32.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.084', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.133', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.550', 'weapon4': '0.868', 'WEAPON3': '1.400', 'weapon3': '2.130', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.483', 'FRAGCOUNT': '30.000'} [2024-08-06 00:05:19,321][52664] DAMAGECOUNT value on done: 84136.0 [2024-08-06 00:05:19,322][52664] Sum rewards: 57.517, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.012', 'weapon4': '0.034', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.173', 'HEALTH': '0.368', 'weapon2': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.978', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '47.000'} [2024-08-06 00:05:20,220][52659] DAMAGECOUNT value on done: 75624.0 [2024-08-06 00:05:20,221][52659] Sum rewards: 53.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.284', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.052', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'AMMO4': '0.238', 'weapon4': '0.346', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '47.000'} [2024-08-06 00:05:20,751][52671] DAMAGECOUNT value on done: 76729.0 [2024-08-06 00:05:20,755][52671] Sum rewards: 50.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.392', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:21,561][52820] DAMAGECOUNT value on done: 72722.0 [2024-08-06 00:05:21,563][52820] Sum rewards: 29.953, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.436', 'WEAPON3': '1.450', 'HITCOUNT': '2.480', 'weapon3': '2.576', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '30.500'} [2024-08-06 00:05:21,777][52650] Updated weights for policy 0, policy_version 19951 (0.0011) [2024-08-06 00:05:21,856][52664] DAMAGECOUNT value on done: 79726.0 [2024-08-06 00:05:21,857][52664] Sum rewards: 49.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.364', 'weapon4': '0.388', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 163454976. Throughput: 0: 4421.6. Samples: 40867210. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:05:22,802][52567] Avg episode reward: [(0, '47.830')] [2024-08-06 00:05:23,164][52659] DAMAGECOUNT value on done: 72683.0 [2024-08-06 00:05:23,167][52659] Sum rewards: 49.617, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon7': '0.056', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.548', 'weapon4': '0.710', 'WEAPON3': '0.950', 'weapon3': '2.384', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:23,647][52671] DAMAGECOUNT value on done: 74695.0 [2024-08-06 00:05:23,651][52671] Sum rewards: 39.177, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.315', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.662', 'WEAPON3': '1.350', 'weapon3': '2.588', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '36.000'} [2024-08-06 00:05:24,672][52820] DAMAGECOUNT value on done: 68349.0 [2024-08-06 00:05:24,672][52820] Sum rewards: 51.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.054', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.043', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.227', 'weapon4': '0.240', 'weapon5': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.634', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:24,938][52664] DAMAGECOUNT value on done: 79422.0 [2024-08-06 00:05:24,939][52664] Sum rewards: 48.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.673', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.156', 'AMMO3': '0.166', 'AMMO4': '0.269', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon2': '0.740', 'WEAPON3': '1.100', 'weapon3': '2.586', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '43.000'} [2024-08-06 00:05:26,266][52659] DAMAGECOUNT value on done: 77879.0 [2024-08-06 00:05:26,266][52659] Sum rewards: 47.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.431', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.028', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.248', 'weapon2': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:26,410][52650] Updated weights for policy 0, policy_version 19961 (0.0011) [2024-08-06 00:05:27,709][52820] DAMAGECOUNT value on done: 71258.0 [2024-08-06 00:05:27,714][52820] Sum rewards: 44.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon5': '0.116', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.182', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '39.000'} [2024-08-06 00:05:27,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 163545088. Throughput: 0: 4420.2. Samples: 40893500. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:05:27,794][52567] Avg episode reward: [(0, '47.961')] [2024-08-06 00:05:27,962][52664] DAMAGECOUNT value on done: 80473.0 [2024-08-06 00:05:27,962][52664] Sum rewards: 47.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.012', 'weapon4': '0.016', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '3.096', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:28,631][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:05:29,028][52659] DAMAGECOUNT value on done: 77970.0 [2024-08-06 00:05:29,029][52659] Sum rewards: 45.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.722', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.376', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.712', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:30,515][52664] DAMAGECOUNT value on done: 81122.0 [2024-08-06 00:05:30,516][52664] Sum rewards: 41.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.252', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.172', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.784', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '36.000'} [2024-08-06 00:05:30,741][52647] DAMAGECOUNT value on done: 81341.0 [2024-08-06 00:05:30,742][52647] Sum rewards: 48.277, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.779', 'AMMO5': '0.006', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon4': '0.178', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.992', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:30,775][52820] DAMAGECOUNT value on done: 73915.0 [2024-08-06 00:05:30,776][52820] Sum rewards: 56.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.906', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.112', 'AMMO4': '0.180', 'weapon4': '0.194', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.082', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '51.000'} [2024-08-06 00:05:30,982][52650] Updated weights for policy 0, policy_version 19971 (0.0011) [2024-08-06 00:05:31,977][52659] DAMAGECOUNT value on done: 83170.0 [2024-08-06 00:05:31,979][52659] Sum rewards: 60.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.034', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.072', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '50.000'} [2024-08-06 00:05:32,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17612.6, 300 sec: 17522.5). Total num frames: 163627008. Throughput: 0: 4421.5. Samples: 40906880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:05:32,796][52567] Avg episode reward: [(0, '47.793')] [2024-08-06 00:05:33,084][52664] DAMAGECOUNT value on done: 76971.0 [2024-08-06 00:05:33,085][52664] Sum rewards: 48.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.238', 'weapon2': '0.554', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.026', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:33,227][52647] DAMAGECOUNT value on done: 80266.0 [2024-08-06 00:05:33,229][52647] Sum rewards: 56.184, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.285', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.159', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.706', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '45.000'} [2024-08-06 00:05:34,055][52820] DAMAGECOUNT value on done: 72975.0 [2024-08-06 00:05:34,056][52820] Sum rewards: 52.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO2': '0.050', 'weapon5': '0.056', 'AMMO3': '0.166', 'AMMO4': '0.250', 'weapon2': '0.444', 'WEAPON4': '0.500', 'weapon4': '0.814', 'WEAPON3': '0.950', 'weapon3': '2.426', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:34,787][52659] DAMAGECOUNT value on done: 77843.0 [2024-08-06 00:05:34,790][52659] Sum rewards: 44.502, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.395', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.231', 'weapon4': '0.284', 'WEAPON4': '0.400', 'weapon2': '0.628', 'WEAPON3': '1.450', 'weapon3': '2.798', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:35,611][52650] Updated weights for policy 0, policy_version 19981 (0.0024) [2024-08-06 00:05:36,038][52664] DAMAGECOUNT value on done: 82199.0 [2024-08-06 00:05:36,042][52664] Sum rewards: 56.971, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.360', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.127', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.314', 'weapon2': '0.498', 'WEAPON3': '0.850', 'HITCOUNT': '2.790', 'weapon3': '2.898', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:36,223][52647] DAMAGECOUNT value on done: 85427.0 [2024-08-06 00:05:36,227][52647] Sum rewards: 42.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.537', 'ARMOR': '0.016', 'AMMO5': '0.018', 'weapon5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.480', 'weapon4': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.700', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.847', 'FRAGCOUNT': '38.000'} [2024-08-06 00:05:37,120][52820] DAMAGECOUNT value on done: 70073.0 [2024-08-06 00:05:37,121][52820] Sum rewards: 62.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.371', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.234', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '53.000'} [2024-08-06 00:05:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 163717120. Throughput: 0: 4422.2. Samples: 40933340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:05:37,794][52567] Avg episode reward: [(0, '47.925')] [2024-08-06 00:05:37,808][52659] DAMAGECOUNT value on done: 76898.0 [2024-08-06 00:05:37,808][52659] Sum rewards: 46.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.104', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.930', 'WEAPON3': '1.050', 'weapon3': '2.484', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:38,753][52664] DAMAGECOUNT value on done: 79846.0 [2024-08-06 00:05:38,755][52664] Sum rewards: 52.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.050', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'AMMO4': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.500', 'weapon4': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '46.000'} [2024-08-06 00:05:38,894][52647] DAMAGECOUNT value on done: 84451.0 [2024-08-06 00:05:38,895][52647] Sum rewards: 41.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.122', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.698', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '2.782', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '35.500'} [2024-08-06 00:05:40,280][52820] DAMAGECOUNT value on done: 71187.0 [2024-08-06 00:05:40,281][52820] Sum rewards: 46.864, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.921', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.276', 'AMMO3': '0.278', 'weapon2': '0.552', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '43.000'} [2024-08-06 00:05:40,509][52650] Updated weights for policy 0, policy_version 19991 (0.0018) [2024-08-06 00:05:40,868][52659] DAMAGECOUNT value on done: 79748.0 [2024-08-06 00:05:40,872][52659] Sum rewards: 60.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.758', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.170', 'AMMO3': '0.201', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '51.000'} [2024-08-06 00:05:41,033][52664] DAMAGECOUNT value on done: 80919.0 [2024-08-06 00:05:41,034][52664] Sum rewards: 49.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.632', 'AMMO5': '0.005', 'ARMOR': '0.019', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.858', 'WEAPON3': '1.000', 'weapon3': '2.654', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:41,108][52647] DAMAGECOUNT value on done: 84916.0 [2024-08-06 00:05:41,109][52647] Sum rewards: 50.116, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.438', 'AMMO5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon2': '0.528', 'weapon4': '0.742', 'WEAPON3': '1.700', 'weapon3': '2.372', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '47.000'} [2024-08-06 00:05:41,593][52662] DAMAGECOUNT value on done: 81895.0 [2024-08-06 00:05:41,594][52662] Sum rewards: 42.966, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.532', 'AMMO5': '0.017', 'ARMOR': '0.048', 'AMMO2': '0.055', 'AMMO3': '0.142', 'AMMO4': '0.273', 'weapon5': '0.382', 'WEAPON5': '0.450', 'weapon4': '0.588', 'WEAPON4': '0.600', 'weapon2': '0.638', 'WEAPON3': '0.800', 'weapon3': '2.100', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.614', 'FRAGCOUNT': '34.000'} [2024-08-06 00:05:42,320][52668] DAMAGECOUNT value on done: 76948.0 [2024-08-06 00:05:42,320][52668] Sum rewards: 45.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO2': '0.017', 'weapon4': '0.076', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.568', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.164', 'DAMAGECOUNT': '12.066', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:42,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 163807232. Throughput: 0: 4423.3. Samples: 40959810. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:05:42,795][52567] Avg episode reward: [(0, '47.838')] [2024-08-06 00:05:42,878][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:05:43,200][52664] DAMAGECOUNT value on done: 80728.0 [2024-08-06 00:05:43,200][52664] Sum rewards: 59.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.622', 'ARMOR': '0.004', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.648', 'WEAPON3': '1.450', 'weapon3': '2.752', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '51.000'} [2024-08-06 00:05:43,212][52647] DAMAGECOUNT value on done: 83814.0 [2024-08-06 00:05:43,213][52647] Sum rewards: 45.452, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.195', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.156', 'AMMO3': '0.241', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '2.996', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:43,610][52820] DAMAGECOUNT value on done: 75566.0 [2024-08-06 00:05:43,610][52820] Sum rewards: 44.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.068', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.916', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '2.810', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:43,853][52659] DAMAGECOUNT value on done: 79990.0 [2024-08-06 00:05:43,854][52659] Sum rewards: 49.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.740', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.234', 'weapon4': '0.264', 'weapon2': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.120', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:44,569][52662] DAMAGECOUNT value on done: 86886.0 [2024-08-06 00:05:44,571][52662] Sum rewards: 56.914, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.910', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.268', 'AMMO3': '0.274', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '53.000'} [2024-08-06 00:05:45,030][52668] DAMAGECOUNT value on done: 81538.0 [2024-08-06 00:05:45,031][52668] Sum rewards: 53.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.038', 'AMMO4': '0.177', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.488', 'weapon4': '0.778', 'WEAPON3': '1.250', 'weapon3': '2.462', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '45.000'} [2024-08-06 00:05:45,081][52650] Updated weights for policy 0, policy_version 20001 (0.0019) [2024-08-06 00:05:45,654][52647] DAMAGECOUNT value on done: 81076.0 [2024-08-06 00:05:45,655][52647] Sum rewards: 51.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.209', 'AMMO3': '0.213', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '45.000'} [2024-08-06 00:05:46,557][52649] DAMAGECOUNT value on done: 76563.0 [2024-08-06 00:05:46,558][52649] Sum rewards: 51.346, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.282', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '43.000'} [2024-08-06 00:05:46,896][52820] DAMAGECOUNT value on done: 71369.0 [2024-08-06 00:05:46,899][52820] Sum rewards: 60.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.973', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'AMMO3': '0.167', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'weapon2': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '51.000'} [2024-08-06 00:05:47,011][52803] DAMAGECOUNT value on done: 76412.0 [2024-08-06 00:05:47,011][52803] Sum rewards: 54.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'ARMOR': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.198', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.910', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '47.000'} [2024-08-06 00:05:47,481][52662] DAMAGECOUNT value on done: 87397.0 [2024-08-06 00:05:47,481][52662] Sum rewards: 48.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.922', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.104', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:47,630][52668] DAMAGECOUNT value on done: 74371.0 [2024-08-06 00:05:47,630][52668] Sum rewards: 39.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.302', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.161', 'AMMO4': '0.191', 'weapon2': '0.302', 'weapon5': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.564', 'WEAPON3': '1.100', 'HITCOUNT': '2.240', 'weapon3': '2.580', 'DAMAGECOUNT': '10.377', 'FRAGCOUNT': '35.000'} [2024-08-06 00:05:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 163889152. Throughput: 0: 4426.4. Samples: 40973160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:05:47,795][52567] Avg episode reward: [(0, '48.204')] [2024-08-06 00:05:48,610][52794] DAMAGECOUNT value on done: 85919.0 [2024-08-06 00:05:48,614][52794] Sum rewards: 50.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.867', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.110', 'AMMO4': '0.193', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.792', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '44.000'} [2024-08-06 00:05:48,656][52647] DAMAGECOUNT value on done: 82953.0 [2024-08-06 00:05:48,657][52647] Sum rewards: 50.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.044', 'AMMO2': '0.016', 'ARMOR': '0.036', 'AMMO4': '0.079', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.574', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.056', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:49,305][52649] DAMAGECOUNT value on done: 76074.0 [2024-08-06 00:05:49,308][52649] Sum rewards: 37.362, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.406', 'AMMO5': '0.017', 'ARMOR': '0.018', 'AMMO2': '0.042', 'weapon5': '0.074', 'AMMO3': '0.097', 'AMMO4': '0.209', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.640', 'WEAPON3': '0.700', 'weapon2': '0.756', 'weapon3': '2.354', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '9.741', 'FRAGCOUNT': '30.000'} [2024-08-06 00:05:49,577][52650] Updated weights for policy 0, policy_version 20011 (0.0015) [2024-08-06 00:05:49,976][52820] DAMAGECOUNT value on done: 72306.0 [2024-08-06 00:05:49,976][52820] Sum rewards: 50.717, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.573', 'AMMO5': '0.004', 'ARMOR': '0.016', 'weapon5': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon4': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.281', 'weapon2': '0.294', 'WEAPON3': '1.600', 'HITCOUNT': '2.930', 'weapon3': '3.252', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '47.500'} [2024-08-06 00:05:50,185][52803] DAMAGECOUNT value on done: 77510.0 [2024-08-06 00:05:50,185][52803] Sum rewards: 52.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.865', 'AMMO5': '0.003', 'ARMOR': '0.036', 'AMMO2': '0.040', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.200', 'WEAPON4': '0.550', 'weapon2': '0.566', 'weapon4': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.512', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '46.000'} [2024-08-06 00:05:50,357][52668] DAMAGECOUNT value on done: 77391.0 [2024-08-06 00:05:50,358][52668] Sum rewards: 56.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.762', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.150', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.802', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '45.000'} [2024-08-06 00:05:50,363][52662] DAMAGECOUNT value on done: 78828.0 [2024-08-06 00:05:50,363][52662] Sum rewards: 46.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.086', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.782', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '2.766', 'DAMAGECOUNT': '11.808', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:51,169][52647] DAMAGECOUNT value on done: 85897.0 [2024-08-06 00:05:51,169][52647] Sum rewards: 45.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.244', 'AMMO5': '0.006', 'ARMOR': '0.029', 'AMMO2': '0.047', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.234', 'AMMO3': '0.247', 'WEAPON4': '0.450', 'weapon4': '0.484', 'weapon2': '0.534', 'WEAPON3': '1.450', 'weapon3': '2.618', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:51,500][52794] DAMAGECOUNT value on done: 83321.0 [2024-08-06 00:05:51,500][52794] Sum rewards: 46.026, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.758', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.066', 'weapon4': '0.102', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.430', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.122', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:51,741][52795] Large shaping reward -2.539 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28800000000000003, -96.0), ('ARMOR', -0.002, -2.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:05:52,053][52811] DAMAGECOUNT value on done: 76752.0 [2024-08-06 00:05:52,055][52811] Sum rewards: 48.101, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.175', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.096', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.301', 'weapon2': '0.342', 'WEAPON3': '1.850', 'HITCOUNT': '3.040', 'weapon3': '3.290', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '46.000'} [2024-08-06 00:05:52,186][52649] DAMAGECOUNT value on done: 77923.0 [2024-08-06 00:05:52,188][52649] Sum rewards: 38.634, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.250', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'AMMO4': '0.247', 'weapon2': '0.506', 'weapon4': '0.624', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.466', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.298', 'FRAGCOUNT': '39.000'} [2024-08-06 00:05:52,656][52660] DAMAGECOUNT value on done: 76935.0 [2024-08-06 00:05:52,658][52660] Sum rewards: 53.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.062', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'weapon4': '0.440', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.498', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '48.000'} [2024-08-06 00:05:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 163979264. Throughput: 0: 4422.0. Samples: 40999590. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:05:52,794][52567] Avg episode reward: [(0, '48.260')] [2024-08-06 00:05:53,037][52662] DAMAGECOUNT value on done: 81978.0 [2024-08-06 00:05:53,039][52662] Sum rewards: 54.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.503', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.170', 'weapon4': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.032', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '46.000'} [2024-08-06 00:05:53,082][52668] DAMAGECOUNT value on done: 79014.0 [2024-08-06 00:05:53,084][52668] Sum rewards: 48.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.985', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'AMMO4': '0.230', 'weapon2': '0.482', 'WEAPON4': '0.500', 'weapon4': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.548', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:53,103][52820] DAMAGECOUNT value on done: 76288.0 [2024-08-06 00:05:53,104][52820] Sum rewards: 46.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.954', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.264', 'weapon2': '0.718', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.832', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:53,377][52803] DAMAGECOUNT value on done: 72984.0 [2024-08-06 00:05:53,377][52803] Sum rewards: 42.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon5': '0.184', 'AMMO3': '0.234', 'weapon2': '0.282', 'WEAPON4': '0.450', 'weapon4': '0.730', 'WEAPON3': '1.400', 'weapon3': '2.588', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '38.500'} [2024-08-06 00:05:54,024][52647] DAMAGECOUNT value on done: 81010.0 [2024-08-06 00:05:54,025][52647] Sum rewards: 45.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.175', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '2.740', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:54,219][52794] DAMAGECOUNT value on done: 80732.0 [2024-08-06 00:05:54,220][52794] Sum rewards: 45.549, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.185', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.105', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.660', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '2.936', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:54,339][52650] Updated weights for policy 0, policy_version 20021 (0.0010) [2024-08-06 00:05:55,015][52649] DAMAGECOUNT value on done: 78742.0 [2024-08-06 00:05:55,016][52649] Sum rewards: 50.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.322', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon2': '0.434', 'weapon4': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '43.500'} [2024-08-06 00:05:55,164][52811] DAMAGECOUNT value on done: 69897.0 [2024-08-06 00:05:55,166][52811] Sum rewards: 38.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.616', 'AMMO5': '0.003', 'weapon5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.730', 'weapon2': '0.742', 'WEAPON3': '1.300', 'weapon3': '2.170', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.827', 'FRAGCOUNT': '36.000'} [2024-08-06 00:05:55,326][52660] DAMAGECOUNT value on done: 81089.0 [2024-08-06 00:05:55,329][52660] Sum rewards: 48.415, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.811', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.081', 'AMMO3': '0.157', 'weapon5': '0.194', 'WEAPON5': '0.400', 'AMMO4': '0.403', 'weapon2': '0.624', 'weapon4': '0.672', 'WEAPON4': '0.850', 'WEAPON3': '1.000', 'weapon3': '2.206', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '43.000'} [2024-08-06 00:05:55,996][52668] DAMAGECOUNT value on done: 78166.0 [2024-08-06 00:05:55,996][52668] Sum rewards: 38.213, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.602', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.094', 'weapon5': '0.144', 'AMMO4': '0.195', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '3.064', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '36.000'} [2024-08-06 00:05:56,078][52662] DAMAGECOUNT value on done: 82675.0 [2024-08-06 00:05:56,079][52662] Sum rewards: 47.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.534', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.118', 'AMMO3': '0.193', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.402', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:56,169][52820] DAMAGECOUNT value on done: 75515.0 [2024-08-06 00:05:56,172][52820] Sum rewards: 49.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.137', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.017', 'AMMO4': '0.036', 'weapon5': '0.070', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.066', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:56,618][52647] DAMAGECOUNT value on done: 79374.0 [2024-08-06 00:05:56,618][52647] Sum rewards: 48.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.055', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.177', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '2.868', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '41.000'} [2024-08-06 00:05:56,736][52803] DAMAGECOUNT value on done: 73647.0 [2024-08-06 00:05:56,739][52803] Sum rewards: 56.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.514', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.326', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2024-08-06 00:05:57,449][52794] DAMAGECOUNT value on done: 78808.0 [2024-08-06 00:05:57,451][52794] Sum rewards: 49.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.392', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.426', 'weapon4': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '42.000'} [2024-08-06 00:05:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 164069376. Throughput: 0: 4415.6. Samples: 41025770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:05:57,794][52567] Avg episode reward: [(0, '48.101')] [2024-08-06 00:05:58,159][52660] DAMAGECOUNT value on done: 79050.0 [2024-08-06 00:05:58,161][52660] Sum rewards: 40.391, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.806', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.260', 'weapon4': '0.374', 'weapon2': '0.520', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.868', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '39.000'} [2024-08-06 00:05:58,208][52649] DAMAGECOUNT value on done: 74663.0 [2024-08-06 00:05:58,209][52649] Sum rewards: 53.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.064', 'AMMO4': '0.103', 'weapon4': '0.152', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.744', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '45.000'} [2024-08-06 00:05:58,430][52811] DAMAGECOUNT value on done: 73144.0 [2024-08-06 00:05:58,431][52811] Sum rewards: 48.541, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.459', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.022', 'weapon5': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON5': '0.100', 'weapon2': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '2.620', 'weapon3': '3.404', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '45.000'} [2024-08-06 00:05:58,756][52662] DAMAGECOUNT value on done: 84042.0 [2024-08-06 00:05:58,757][52662] Sum rewards: 46.992, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.072', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON3': '0.850', 'weapon2': '1.130', 'weapon3': '2.700', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '38.000'} [2024-08-06 00:05:58,793][52668] DAMAGECOUNT value on done: 79539.0 [2024-08-06 00:05:58,794][52668] Sum rewards: 54.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.298', 'AMMO5': '0.004', 'weapon4': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '3.338', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '49.000'} [2024-08-06 00:05:59,169][52650] Updated weights for policy 0, policy_version 20031 (0.0025) [2024-08-06 00:05:59,192][52647] DAMAGECOUNT value on done: 78662.0 [2024-08-06 00:05:59,192][52647] Sum rewards: 38.143, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon4': '0.452', 'weapon2': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '2.170', 'weapon3': '2.566', 'DAMAGECOUNT': '9.327', 'FRAGCOUNT': '34.000'} [2024-08-06 00:05:59,272][52820] DAMAGECOUNT value on done: 73680.0 [2024-08-06 00:05:59,274][52820] Sum rewards: 45.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.626', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon5': '0.082', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'weapon4': '0.430', 'ARMOR': '0.465', 'WEAPON4': '0.600', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.946', 'FRAGCOUNT': '40.000'} [2024-08-06 00:05:59,815][52803] DAMAGECOUNT value on done: 75817.0 [2024-08-06 00:05:59,815][52803] Sum rewards: 60.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.581', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.106', 'weapon4': '0.184', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '50.000'} [2024-08-06 00:05:59,973][52794] DAMAGECOUNT value on done: 80863.0 [2024-08-06 00:05:59,974][52794] Sum rewards: 55.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.256', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon2': '0.604', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.148', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '46.000'} [2024-08-06 00:06:01,284][52660] DAMAGECOUNT value on done: 79180.0 [2024-08-06 00:06:01,286][52660] Sum rewards: 47.940, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.805', 'ARMOR': '0.004', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.272', 'weapon4': '0.274', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.190', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:01,396][52649] DAMAGECOUNT value on done: 75000.0 [2024-08-06 00:06:01,396][52649] Sum rewards: 53.372, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.024', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.222', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.066', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '47.000'} [2024-08-06 00:06:01,466][52662] DAMAGECOUNT value on done: 89173.0 [2024-08-06 00:06:01,466][52662] Sum rewards: 48.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.018', 'AMMO5': '0.010', 'ARMOR': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.159', 'weapon5': '0.168', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'weapon4': '0.510', 'WEAPON4': '0.600', 'weapon2': '0.738', 'WEAPON3': '1.050', 'weapon3': '2.320', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:01,520][52811] DAMAGECOUNT value on done: 73572.0 [2024-08-06 00:06:01,520][52811] Sum rewards: 57.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.685', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.374', 'weapon4': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.792', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '49.000'} [2024-08-06 00:06:01,588][52647] DAMAGECOUNT value on done: 78970.0 [2024-08-06 00:06:01,588][52647] Sum rewards: 36.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.063', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.106', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.366', 'weapon4': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.798', 'DAMAGECOUNT': '10.128', 'FRAGCOUNT': '33.000'} [2024-08-06 00:06:01,682][52668] DAMAGECOUNT value on done: 81189.0 [2024-08-06 00:06:01,684][52668] Sum rewards: 46.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.554', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.128', 'AMMO3': '0.160', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.356', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.054', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:02,657][52794] DAMAGECOUNT value on done: 84176.0 [2024-08-06 00:06:02,657][52794] Sum rewards: 49.730, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO3': '0.146', 'weapon5': '0.150', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '0.800', 'weapon2': '1.234', 'weapon3': '2.222', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 164159488. Throughput: 0: 4421.4. Samples: 41039320. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:06:02,794][52567] Avg episode reward: [(0, '48.603')] [2024-08-06 00:06:03,018][52803] DAMAGECOUNT value on done: 73238.0 [2024-08-06 00:06:03,018][52803] Sum rewards: 54.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.244', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.054', 'weapon4': '0.076', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.256', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:03,485][52650] Updated weights for policy 0, policy_version 20041 (0.0011) [2024-08-06 00:06:04,141][52647] DAMAGECOUNT value on done: 81614.0 [2024-08-06 00:06:04,143][52647] Sum rewards: 60.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.236', 'weapon4': '0.266', 'WEAPON4': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '52.000'} [2024-08-06 00:06:04,144][52660] DAMAGECOUNT value on done: 75347.0 [2024-08-06 00:06:04,146][52660] Sum rewards: 48.225, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.230', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.292', 'weapon2': '0.442', 'WEAPON3': '1.700', 'HITCOUNT': '3.190', 'weapon3': '3.206', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:04,388][52662] DAMAGECOUNT value on done: 79655.0 [2024-08-06 00:06:04,396][52662] Sum rewards: 34.963, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'ARMOR': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon4': '0.094', 'weapon5': '0.204', 'AMMO3': '0.212', 'AMMO4': '0.305', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.824', 'WEAPON3': '1.200', 'HITCOUNT': '2.080', 'weapon3': '2.592', 'DAMAGECOUNT': '11.211', 'FRAGCOUNT': '32.500'} [2024-08-06 00:06:04,537][52811] DAMAGECOUNT value on done: 72132.0 [2024-08-06 00:06:04,539][52811] Sum rewards: 48.735, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon4': '0.152', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.164', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '43.000'} [2024-08-06 00:06:04,545][52649] DAMAGECOUNT value on done: 73344.0 [2024-08-06 00:06:04,545][52649] Sum rewards: 55.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.111', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:04,641][52668] DAMAGECOUNT value on done: 79127.0 [2024-08-06 00:06:04,643][52668] Sum rewards: 40.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'weapon4': '0.362', 'weapon2': '0.752', 'WEAPON3': '1.600', 'weapon3': '2.598', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '36.000'} [2024-08-06 00:06:05,363][52794] DAMAGECOUNT value on done: 84732.0 [2024-08-06 00:06:05,365][52794] Sum rewards: 37.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.902', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.420', 'weapon2': '0.696', 'WEAPON3': '1.500', 'weapon3': '2.566', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '36.000'} [2024-08-06 00:06:06,047][52803] DAMAGECOUNT value on done: 76348.0 [2024-08-06 00:06:06,047][52803] Sum rewards: 59.973, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.068', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '52.000'} [2024-08-06 00:06:06,555][52647] DAMAGECOUNT value on done: 82168.0 [2024-08-06 00:06:06,556][52647] Sum rewards: 47.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO3': '0.188', 'AMMO4': '0.189', 'WEAPON4': '0.400', 'weapon2': '0.528', 'weapon4': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.404', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:06,822][52660] DAMAGECOUNT value on done: 77771.0 [2024-08-06 00:06:06,822][52660] Sum rewards: 31.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.345', 'AMMO2': '0.017', 'weapon7': '0.048', 'AMMO4': '0.083', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.199', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.554', 'weapon2': '0.742', 'WEAPON3': '1.250', 'HITCOUNT': '2.350', 'weapon3': '2.430', 'DAMAGECOUNT': '10.047', 'FRAGCOUNT': '31.000'} [2024-08-06 00:06:07,010][52662] DAMAGECOUNT value on done: 83889.0 [2024-08-06 00:06:07,010][52662] Sum rewards: 55.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.062', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.254', 'WEAPON4': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.930', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '49.000'} [2024-08-06 00:06:07,324][52668] DAMAGECOUNT value on done: 81316.0 [2024-08-06 00:06:07,327][52668] Sum rewards: 53.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.952', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.404', 'weapon4': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:07,427][52811] DAMAGECOUNT value on done: 75436.0 [2024-08-06 00:06:07,427][52811] Sum rewards: 46.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.871', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.124', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon4': '0.444', 'WEAPON4': '0.450', 'weapon2': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '38.000'} [2024-08-06 00:06:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 164241408. Throughput: 0: 4405.8. Samples: 41065470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:06:07,794][52567] Avg episode reward: [(0, '48.716')] [2024-08-06 00:06:07,918][52649] DAMAGECOUNT value on done: 79358.0 [2024-08-06 00:06:07,918][52649] Sum rewards: 53.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.699', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.098', 'AMMO3': '0.178', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:08,072][52794] DAMAGECOUNT value on done: 81665.0 [2024-08-06 00:06:08,072][52794] Sum rewards: 66.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.504', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.178', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '2.870', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2024-08-06 00:06:08,282][52650] Updated weights for policy 0, policy_version 20051 (0.0018) [2024-08-06 00:06:09,040][52803] DAMAGECOUNT value on done: 72823.0 [2024-08-06 00:06:09,041][52803] Sum rewards: 49.316, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.630', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.059', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'AMMO4': '0.297', 'weapon2': '0.522', 'weapon4': '0.824', 'WEAPON4': '0.850', 'WEAPON3': '1.650', 'weapon3': '2.218', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '46.000'} [2024-08-06 00:06:09,531][52647] DAMAGECOUNT value on done: 82363.0 [2024-08-06 00:06:09,538][52660] DAMAGECOUNT value on done: 80068.0 [2024-08-06 00:06:09,539][52647] Sum rewards: 55.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.624', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon4': '0.252', 'weapon2': '0.280', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.284', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:09,540][52660] Sum rewards: 46.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.064', 'weapon4': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '1.022', 'WEAPON3': '1.050', 'weapon3': '2.636', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.376', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:09,962][52662] DAMAGECOUNT value on done: 82120.0 [2024-08-06 00:06:09,963][52662] Sum rewards: 58.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'weapon4': '0.164', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.300', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '52.000'} [2024-08-06 00:06:10,002][52668] DAMAGECOUNT value on done: 76270.0 [2024-08-06 00:06:10,002][52668] Sum rewards: 58.324, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '51.000'} [2024-08-06 00:06:10,477][52811] DAMAGECOUNT value on done: 74956.0 [2024-08-06 00:06:10,477][52811] Sum rewards: 45.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.978', 'AMMO5': '0.009', 'ARMOR': '0.010', 'AMMO2': '0.049', 'weapon5': '0.068', 'AMMO3': '0.166', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.430', 'weapon2': '0.620', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.642', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '39.000'} [2024-08-06 00:06:10,890][52649] DAMAGECOUNT value on done: 74181.0 [2024-08-06 00:06:10,890][52649] Sum rewards: 41.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.674', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.190', 'weapon5': '0.208', 'AMMO4': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.566', 'weapon4': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '36.000'} [2024-08-06 00:06:10,940][52794] DAMAGECOUNT value on done: 83572.0 [2024-08-06 00:06:10,941][52794] Sum rewards: 55.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.268', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.222', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '47.000'} [2024-08-06 00:06:11,942][52647] DAMAGECOUNT value on done: 79186.0 [2024-08-06 00:06:11,943][52647] Sum rewards: 43.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.097', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.038', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'AMMO4': '0.243', 'AMMO3': '0.251', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '2.884', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '38.000'} [2024-08-06 00:06:12,109][52803] DAMAGECOUNT value on done: 74599.0 [2024-08-06 00:06:12,109][52803] Sum rewards: 47.580, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.183', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.640', 'WEAPON3': '0.750', 'HITCOUNT': '2.600', 'weapon3': '2.834', 'DAMAGECOUNT': '10.947', 'FRAGCOUNT': '38.000'} [2024-08-06 00:06:12,513][52660] DAMAGECOUNT value on done: 78280.0 [2024-08-06 00:06:12,513][52660] Sum rewards: 34.712, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.468', 'AMMO5': '0.007', 'AMMO2': '0.055', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'AMMO4': '0.273', 'weapon2': '0.356', 'WEAPON4': '0.700', 'weapon4': '0.768', 'WEAPON3': '1.350', 'weapon3': '2.446', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '10.581', 'FRAGCOUNT': '34.000'} [2024-08-06 00:06:12,620][52662] DAMAGECOUNT value on done: 85813.0 [2024-08-06 00:06:12,622][52662] Sum rewards: 55.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.317', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.192', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '47.000'} [2024-08-06 00:06:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 164331520. Throughput: 0: 4410.0. Samples: 41091950. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:06:12,794][52567] Avg episode reward: [(0, '49.316')] [2024-08-06 00:06:12,795][52614] Saving new best policy, reward=49.316! [2024-08-06 00:06:12,949][52668] DAMAGECOUNT value on done: 78118.0 [2024-08-06 00:06:12,949][52668] Sum rewards: 49.576, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.222', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.698', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '43.000'} [2024-08-06 00:06:13,219][52650] Updated weights for policy 0, policy_version 20061 (0.0035) [2024-08-06 00:06:13,516][52811] DAMAGECOUNT value on done: 73279.0 [2024-08-06 00:06:13,518][52811] Sum rewards: 44.159, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.667', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.068', 'WEAPON5': '0.200', 'AMMO4': '0.266', 'AMMO3': '0.288', 'weapon4': '0.304', 'weapon2': '0.424', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.690', 'weapon3': '2.906', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '43.000'} [2024-08-06 00:06:13,661][52794] DAMAGECOUNT value on done: 86089.0 [2024-08-06 00:06:13,663][52794] Sum rewards: 48.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.147', 'weapon2': '0.236', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'HITCOUNT': '2.770', 'weapon3': '3.468', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:13,717][52669] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:06:14,163][52649] DAMAGECOUNT value on done: 74963.0 [2024-08-06 00:06:14,164][52649] Sum rewards: 54.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.534', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.146', 'AMMO3': '0.208', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.704', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '46.000'} [2024-08-06 00:06:14,481][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:06:14,553][52647] DAMAGECOUNT value on done: 81379.0 [2024-08-06 00:06:14,553][52647] Sum rewards: 45.888, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.751', 'ARMOR': '0.004', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.550', 'HITCOUNT': '2.750', 'weapon3': '3.076', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:15,220][52803] DAMAGECOUNT value on done: 70134.0 [2024-08-06 00:06:15,222][52803] Sum rewards: 35.931, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.074', 'AMMO5': '0.016', 'ARMOR': '0.028', 'AMMO2': '0.058', 'weapon5': '0.178', 'AMMO3': '0.215', 'AMMO4': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.510', 'weapon4': '0.628', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.394', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '10.410', 'FRAGCOUNT': '36.000'} [2024-08-06 00:06:15,473][52660] DAMAGECOUNT value on done: 78637.0 [2024-08-06 00:06:15,475][52660] Sum rewards: 57.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.183', 'weapon4': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '50.000'} [2024-08-06 00:06:15,522][52662] DAMAGECOUNT value on done: 84269.0 [2024-08-06 00:06:15,523][52662] Sum rewards: 63.714, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.275', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '55.000'} [2024-08-06 00:06:16,039][52668] DAMAGECOUNT value on done: 73743.0 [2024-08-06 00:06:16,039][52668] Sum rewards: 38.971, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.138', 'AMMO2': '0.023', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.214', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.440', 'weapon3': '3.112', 'DAMAGECOUNT': '10.665', 'FRAGCOUNT': '37.000'} [2024-08-06 00:06:16,510][52794] DAMAGECOUNT value on done: 82160.0 [2024-08-06 00:06:16,510][52794] Sum rewards: 50.747, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.123', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'AMMO4': '0.214', 'weapon4': '0.366', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:16,608][52811] DAMAGECOUNT value on done: 74749.0 [2024-08-06 00:06:16,609][52811] Sum rewards: 50.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.605', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.068', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.902', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:16,820][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:06:17,172][52649] DAMAGECOUNT value on done: 76681.0 [2024-08-06 00:06:17,173][52649] Sum rewards: 46.528, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.562', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.148', 'AMMO4': '0.162', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon4': '0.596', 'weapon2': '0.838', 'WEAPON3': '1.050', 'weapon3': '2.164', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.777', 'FRAGCOUNT': '37.000'} [2024-08-06 00:06:17,240][52647] DAMAGECOUNT value on done: 79734.0 [2024-08-06 00:06:17,243][52647] Sum rewards: 42.388, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.130', 'ARMOR': '0.004', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.242', 'weapon4': '0.492', 'WEAPON4': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:17,583][52650] Updated weights for policy 0, policy_version 20071 (0.0012) [2024-08-06 00:06:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 164421632. Throughput: 0: 4395.6. Samples: 41104680. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:06:17,794][52567] Avg episode reward: [(0, '48.860')] [2024-08-06 00:06:18,096][52662] DAMAGECOUNT value on done: 81641.0 [2024-08-06 00:06:18,097][52662] Sum rewards: 54.640, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.198', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.225', 'weapon5': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:18,287][52803] DAMAGECOUNT value on done: 76418.0 [2024-08-06 00:06:18,291][52803] Sum rewards: 51.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.214', 'AMMO3': '0.235', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '44.500'} [2024-08-06 00:06:18,494][52660] DAMAGECOUNT value on done: 78421.0 [2024-08-06 00:06:18,495][52660] Sum rewards: 59.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.072', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.073', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.422', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.258', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '50.000'} [2024-08-06 00:06:19,077][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:06:19,109][52668] DAMAGECOUNT value on done: 79104.0 [2024-08-06 00:06:19,112][52668] Sum rewards: 42.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.061', 'weapon5': '0.090', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.305', 'weapon4': '0.520', 'WEAPON4': '0.750', 'weapon2': '0.834', 'WEAPON3': '0.900', 'weapon3': '2.228', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '37.000'} [2024-08-06 00:06:19,179][52794] DAMAGECOUNT value on done: 84993.0 [2024-08-06 00:06:19,179][52794] Sum rewards: 50.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.176', 'weapon2': '0.606', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.100', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:19,651][52647] DAMAGECOUNT value on done: 80717.0 [2024-08-06 00:06:19,652][52647] Sum rewards: 48.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.586', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.722', 'WEAPON3': '1.400', 'weapon3': '2.710', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:19,684][52811] DAMAGECOUNT value on done: 73857.0 [2024-08-06 00:06:19,685][52811] Sum rewards: 44.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'weapon4': '0.454', 'weapon2': '0.828', 'WEAPON3': '1.200', 'weapon3': '2.554', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '39.000'} [2024-08-06 00:06:19,834][52669] DAMAGECOUNT value on done: 81210.0 [2024-08-06 00:06:19,836][52669] Sum rewards: 48.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.680', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.432', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.590', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:20,224][52649] DAMAGECOUNT value on done: 76345.0 [2024-08-06 00:06:20,226][52649] Sum rewards: 50.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.296', 'ARMOR': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.212', 'WEAPON4': '0.450', 'weapon2': '0.480', 'weapon4': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.710', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '46.000'} [2024-08-06 00:06:21,206][52662] DAMAGECOUNT value on done: 81979.0 [2024-08-06 00:06:21,208][52662] Sum rewards: 54.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.167', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '47.000'} [2024-08-06 00:06:21,426][52803] DAMAGECOUNT value on done: 75695.0 [2024-08-06 00:06:21,427][52803] Sum rewards: 52.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.630', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.182', 'AMMO3': '0.224', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '46.000'} [2024-08-06 00:06:21,634][52660] DAMAGECOUNT value on done: 78525.0 [2024-08-06 00:06:21,636][52660] Sum rewards: 63.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.223', 'weapon2': '0.380', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.422', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '54.000'} [2024-08-06 00:06:22,171][52667] DAMAGECOUNT value on done: 79579.0 [2024-08-06 00:06:22,174][52667] Sum rewards: 49.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'weapon2': '0.204', 'AMMO3': '0.220', 'weapon4': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.310', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:22,265][52668] DAMAGECOUNT value on done: 78637.0 [2024-08-06 00:06:22,265][52668] Sum rewards: 45.348, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.044', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'AMMO4': '0.221', 'weapon4': '0.358', 'WEAPON4': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:22,274][52650] Updated weights for policy 0, policy_version 20081 (0.0024) [2024-08-06 00:06:22,300][52794] DAMAGECOUNT value on done: 82503.0 [2024-08-06 00:06:22,301][52794] Sum rewards: 52.715, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.577', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO4': '0.247', 'AMMO3': '0.257', 'weapon4': '0.432', 'WEAPON4': '0.600', 'weapon2': '0.698', 'WEAPON3': '1.550', 'weapon3': '2.522', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:22,762][52669] DAMAGECOUNT value on done: 79002.0 [2024-08-06 00:06:22,763][52669] Sum rewards: 41.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.065', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.384', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '3.390', 'DAMAGECOUNT': '10.947', 'FRAGCOUNT': '35.000'} [2024-08-06 00:06:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 164511744. Throughput: 0: 4397.6. Samples: 41131230. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:06:22,794][52567] Avg episode reward: [(0, '48.928')] [2024-08-06 00:06:22,796][52811] DAMAGECOUNT value on done: 75720.0 [2024-08-06 00:06:22,797][52811] Sum rewards: 42.731, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.707', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.108', 'AMMO3': '0.156', 'AMMO4': '0.297', 'WEAPON5': '0.300', 'weapon2': '0.430', 'weapon4': '0.512', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.632', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '39.000'} [2024-08-06 00:06:23,677][52649] DAMAGECOUNT value on done: 79367.0 [2024-08-06 00:06:23,679][52649] Sum rewards: 45.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.534', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:23,806][52662] DAMAGECOUNT value on done: 85954.0 [2024-08-06 00:06:23,806][52662] Sum rewards: 56.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.222', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.148', 'AMMO4': '0.161', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '47.000'} [2024-08-06 00:06:24,501][52803] DAMAGECOUNT value on done: 72715.0 [2024-08-06 00:06:24,501][52803] Sum rewards: 43.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.232', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.790', 'weapon4': '0.912', 'weapon3': '2.074', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.332', 'FRAGCOUNT': '36.000'} [2024-08-06 00:06:24,576][52660] DAMAGECOUNT value on done: 76649.0 [2024-08-06 00:06:24,576][52660] Sum rewards: 51.799, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.166', 'AMMO3': '0.238', 'AMMO4': '0.245', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.608', 'WEAPON3': '1.450', 'weapon3': '2.620', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:24,718][52794] DAMAGECOUNT value on done: 88930.0 [2024-08-06 00:06:24,718][52794] Sum rewards: 53.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.062', 'weapon4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.738', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '2.966', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '43.000'} [2024-08-06 00:06:24,955][52667] DAMAGECOUNT value on done: 82201.0 [2024-08-06 00:06:24,956][52667] Sum rewards: 44.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.894', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.052', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'AMMO4': '0.281', 'weapon2': '0.420', 'weapon4': '0.604', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.656', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:25,171][52669] DAMAGECOUNT value on done: 79489.0 [2024-08-06 00:06:25,172][52669] Sum rewards: 49.171, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.173', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.228', 'AMMO4': '0.242', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.600', 'weapon4': '0.726', 'WEAPON3': '1.300', 'weapon3': '2.160', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:25,231][52668] DAMAGECOUNT value on done: 80114.0 [2024-08-06 00:06:25,233][52668] Sum rewards: 53.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.075', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.010', 'weapon4': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.686', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.102', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '46.000'} [2024-08-06 00:06:25,861][52811] DAMAGECOUNT value on done: 73260.0 [2024-08-06 00:06:25,862][52811] Sum rewards: 57.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.763', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.246', 'weapon4': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.802', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '50.000'} [2024-08-06 00:06:26,437][52662] DAMAGECOUNT value on done: 79629.0 [2024-08-06 00:06:26,439][52662] Sum rewards: 42.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.160', 'weapon5': '0.176', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'weapon4': '0.708', 'weapon2': '0.834', 'WEAPON3': '1.000', 'weapon3': '2.062', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '38.000'} [2024-08-06 00:06:26,544][52649] DAMAGECOUNT value on done: 78780.0 [2024-08-06 00:06:26,545][52649] Sum rewards: 51.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.620', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.051', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.296', 'weapon2': '0.302', 'WEAPON3': '1.800', 'HITCOUNT': '2.800', 'weapon3': '3.426', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:26,966][52650] Updated weights for policy 0, policy_version 20091 (0.0013) [2024-08-06 00:06:27,651][52794] DAMAGECOUNT value on done: 79286.0 [2024-08-06 00:06:27,651][52794] Sum rewards: 36.852, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.684', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.249', 'weapon2': '0.390', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.500', 'weapon3': '2.782', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '35.000'} [2024-08-06 00:06:27,657][52803] DAMAGECOUNT value on done: 74419.0 [2024-08-06 00:06:27,658][52803] Sum rewards: 48.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.153', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'weapon4': '0.642', 'weapon2': '0.762', 'WEAPON3': '1.050', 'weapon3': '2.258', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:27,728][52660] DAMAGECOUNT value on done: 77794.0 [2024-08-06 00:06:27,730][52660] Sum rewards: 52.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.136', 'AMMO3': '0.232', 'weapon2': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.280', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '47.000'} [2024-08-06 00:06:27,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 164601856. Throughput: 0: 4393.5. Samples: 41157520. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:06:27,795][52567] Avg episode reward: [(0, '48.981')] [2024-08-06 00:06:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020093_164601856.pth... [2024-08-06 00:06:27,827][52667] DAMAGECOUNT value on done: 79594.0 [2024-08-06 00:06:27,829][52667] Sum rewards: 54.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'weapon4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:27,962][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019578_160382976.pth [2024-08-06 00:06:28,234][52669] DAMAGECOUNT value on done: 78407.0 [2024-08-06 00:06:28,234][52669] Sum rewards: 50.395, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.156', 'AMMO4': '0.196', 'WEAPON4': '0.450', 'weapon4': '0.672', 'weapon2': '0.740', 'WEAPON3': '0.900', 'weapon3': '2.282', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:28,373][52668] DAMAGECOUNT value on done: 77435.0 [2024-08-06 00:06:28,375][52668] Sum rewards: 45.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.226', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.770', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:28,980][52811] DAMAGECOUNT value on done: 75786.0 [2024-08-06 00:06:28,983][52811] Sum rewards: 52.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.955', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.442', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:29,177][52662] DAMAGECOUNT value on done: 84569.0 [2024-08-06 00:06:29,180][52662] Sum rewards: 60.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.892', 'AMMO5': '0.003', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'weapon2': '0.426', 'weapon4': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.820', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '54.000'} [2024-08-06 00:06:29,572][52649] DAMAGECOUNT value on done: 71761.0 [2024-08-06 00:06:29,572][52649] Sum rewards: 50.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.824', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.160', 'WEAPON4': '0.400', 'weapon2': '0.442', 'weapon4': '0.512', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '2.894', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:30,193][52794] DAMAGECOUNT value on done: 84469.0 [2024-08-06 00:06:30,195][52794] Sum rewards: 31.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.178', 'AMMO4': '0.259', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.824', 'WEAPON3': '1.100', 'weapon3': '1.998', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.350', 'FRAGCOUNT': '27.000'} [2024-08-06 00:06:30,830][52803] DAMAGECOUNT value on done: 73880.0 [2024-08-06 00:06:30,830][52803] Sum rewards: 51.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.826', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.124', 'weapon4': '0.148', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'weapon2': '0.594', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:30,850][52660] DAMAGECOUNT value on done: 78639.0 [2024-08-06 00:06:30,851][52660] Sum rewards: 60.142, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.696', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.060', 'AMMO3': '0.118', 'weapon5': '0.154', 'WEAPON5': '0.300', 'AMMO4': '0.301', 'weapon2': '0.370', 'WEAPON4': '0.650', 'weapon4': '0.768', 'WEAPON3': '0.850', 'weapon3': '2.514', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '49.000'} [2024-08-06 00:06:31,055][52669] DAMAGECOUNT value on done: 81074.0 [2024-08-06 00:06:31,055][52669] Sum rewards: 48.472, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.624', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.070', 'weapon5': '0.130', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'AMMO4': '0.350', 'weapon2': '0.424', 'weapon4': '0.426', 'WEAPON4': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.724', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:31,163][52667] DAMAGECOUNT value on done: 77845.0 [2024-08-06 00:06:31,164][52667] Sum rewards: 49.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO2': '0.032', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon2': '0.318', 'weapon4': '0.508', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '2.940', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:31,510][52668] DAMAGECOUNT value on done: 76756.0 [2024-08-06 00:06:31,512][52668] Sum rewards: 45.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.122', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'WEAPON4': '0.550', 'weapon2': '0.604', 'weapon4': '0.786', 'WEAPON3': '1.050', 'weapon3': '2.222', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:31,611][52662] DAMAGECOUNT value on done: 84091.0 [2024-08-06 00:06:31,612][52662] Sum rewards: 44.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.972', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'AMMO3': '0.229', 'weapon4': '0.342', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.902', 'DAMAGECOUNT': '11.058', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:31,864][52650] Updated weights for policy 0, policy_version 20101 (0.0012) [2024-08-06 00:06:32,071][52811] DAMAGECOUNT value on done: 74402.0 [2024-08-06 00:06:32,071][52811] Sum rewards: 45.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.815', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.210', 'AMMO3': '0.248', 'weapon4': '0.308', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.034', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:32,442][52649] DAMAGECOUNT value on done: 80477.0 [2024-08-06 00:06:32,444][52649] Sum rewards: 49.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.572', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.066', 'AMMO3': '0.188', 'weapon5': '0.292', 'AMMO4': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.428', 'weapon2': '0.464', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.526', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:32,674][52794] DAMAGECOUNT value on done: 86161.0 [2024-08-06 00:06:32,675][52794] Sum rewards: 42.051, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.545', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.058', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.028', 'DAMAGECOUNT': '11.727', 'FRAGCOUNT': '38.000'} [2024-08-06 00:06:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 164683776. Throughput: 0: 4381.6. Samples: 41170330. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:06:32,794][52567] Avg episode reward: [(0, '49.296')] [2024-08-06 00:06:33,827][52803] DAMAGECOUNT value on done: 70831.0 [2024-08-06 00:06:33,827][52803] Sum rewards: 36.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.179', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.071', 'weapon5': '0.122', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'AMMO4': '0.354', 'weapon2': '0.416', 'WEAPON4': '0.800', 'weapon4': '0.984', 'WEAPON3': '1.150', 'weapon3': '2.220', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.797', 'FRAGCOUNT': '32.000'} [2024-08-06 00:06:33,922][52669] DAMAGECOUNT value on done: 80407.0 [2024-08-06 00:06:33,923][52669] Sum rewards: 37.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.748', 'AMMO2': '0.044', 'AMMO4': '0.220', 'AMMO3': '0.225', 'weapon4': '0.402', 'WEAPON4': '0.450', 'weapon2': '0.630', 'WEAPON3': '1.400', 'HITCOUNT': '2.320', 'weapon3': '2.824', 'DAMAGECOUNT': '10.551', 'FRAGCOUNT': '36.000'} [2024-08-06 00:06:33,974][52660] DAMAGECOUNT value on done: 83686.0 [2024-08-06 00:06:33,974][52660] Sum rewards: 46.724, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.534', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'weapon4': '0.490', 'weapon2': '0.520', 'WEAPON3': '0.950', 'HITCOUNT': '2.560', 'weapon3': '2.830', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '39.000'} [2024-08-06 00:06:34,100][52667] DAMAGECOUNT value on done: 82158.0 [2024-08-06 00:06:34,101][52667] Sum rewards: 44.021, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.130', 'AMMO4': '0.233', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.368', 'weapon4': '0.370', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.812', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:34,398][52662] DAMAGECOUNT value on done: 82357.0 [2024-08-06 00:06:34,398][52662] Sum rewards: 48.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon4': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon2': '0.728', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '2.874', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '43.000'} [2024-08-06 00:06:34,432][52668] DAMAGECOUNT value on done: 81277.0 [2024-08-06 00:06:34,433][52668] Sum rewards: 46.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.375', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.110', 'AMMO3': '0.175', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.760', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:35,017][52649] DAMAGECOUNT value on done: 76070.0 [2024-08-06 00:06:35,020][52649] Sum rewards: 44.841, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.264', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.106', 'AMMO4': '0.178', 'AMMO3': '0.198', 'weapon5': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.748', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '2.682', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:35,217][52811] DAMAGECOUNT value on done: 75352.0 [2024-08-06 00:06:35,217][52811] Sum rewards: 50.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.800', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'weapon5': '0.166', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.718', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.892', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:35,458][52794] DAMAGECOUNT value on done: 84216.0 [2024-08-06 00:06:35,460][52794] Sum rewards: 34.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.057', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.056', 'weapon5': '0.138', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'AMMO4': '0.278', 'weapon4': '0.418', 'weapon2': '0.624', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.240', 'weapon3': '2.514', 'DAMAGECOUNT': '9.453', 'FRAGCOUNT': '34.000'} [2024-08-06 00:06:36,329][52650] Updated weights for policy 0, policy_version 20111 (0.0010) [2024-08-06 00:06:36,704][52660] DAMAGECOUNT value on done: 78124.0 [2024-08-06 00:06:36,708][52660] Sum rewards: 51.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.234', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.078', 'AMMO3': '0.209', 'weapon2': '0.412', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.262', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:36,767][52803] DAMAGECOUNT value on done: 75429.0 [2024-08-06 00:06:36,769][52803] Sum rewards: 44.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.784', 'AMMO5': '0.006', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.120', 'weapon4': '0.144', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.896', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:36,857][52667] DAMAGECOUNT value on done: 79266.0 [2024-08-06 00:06:36,857][52667] Sum rewards: 44.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.472', 'weapon2': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.514', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:36,899][52669] DAMAGECOUNT value on done: 79580.0 [2024-08-06 00:06:36,900][52669] Sum rewards: 50.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.674', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.192', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:37,453][52668] DAMAGECOUNT value on done: 81781.0 [2024-08-06 00:06:37,453][52668] Sum rewards: 50.212, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.540', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.056', 'weapon4': '0.078', 'AMMO4': '0.201', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.592', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:37,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 164765696. Throughput: 0: 4383.3. Samples: 41196840. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:06:37,794][52567] Avg episode reward: [(0, '48.502')] [2024-08-06 00:06:37,954][52649] DAMAGECOUNT value on done: 80011.0 [2024-08-06 00:06:37,958][52649] Sum rewards: 45.564, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.187', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.256', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '2.936', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:38,016][52794] DAMAGECOUNT value on done: 87826.0 [2024-08-06 00:06:38,018][52794] Sum rewards: 54.065, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.820', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.263', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '47.000'} [2024-08-06 00:06:38,373][52811] DAMAGECOUNT value on done: 75317.0 [2024-08-06 00:06:38,376][52811] Sum rewards: 52.865, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.044', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.043', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'weapon4': '0.238', 'AMMO3': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.850', 'WEAPON3': '1.500', 'weapon3': '2.560', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2024-08-06 00:06:39,701][52667] DAMAGECOUNT value on done: 81593.0 [2024-08-06 00:06:39,702][52667] Sum rewards: 47.841, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.924', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.061', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'AMMO4': '0.303', 'weapon4': '0.408', 'weapon2': '0.622', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.450', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:39,832][52669] DAMAGECOUNT value on done: 78615.0 [2024-08-06 00:06:39,832][52669] Sum rewards: 43.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.160', 'WEAPON3': '0.850', 'weapon2': '1.016', 'HITCOUNT': '2.520', 'weapon3': '2.664', 'DAMAGECOUNT': '10.461', 'FRAGCOUNT': '37.000'} [2024-08-06 00:06:39,867][52803] DAMAGECOUNT value on done: 73457.0 [2024-08-06 00:06:39,867][52803] Sum rewards: 62.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.384', 'weapon4': '0.446', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '52.000'} [2024-08-06 00:06:40,032][52660] DAMAGECOUNT value on done: 80123.0 [2024-08-06 00:06:40,033][52660] Sum rewards: 56.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.230', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.522', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '49.000'} [2024-08-06 00:06:40,655][52794] DAMAGECOUNT value on done: 83455.0 [2024-08-06 00:06:40,656][52794] Sum rewards: 59.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.027', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.195', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '52.000'} [2024-08-06 00:06:41,150][52649] DAMAGECOUNT value on done: 78196.0 [2024-08-06 00:06:41,153][52649] Sum rewards: 50.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.166', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.094', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '44.500'} [2024-08-06 00:06:41,274][52650] Updated weights for policy 0, policy_version 20121 (0.0014) [2024-08-06 00:06:41,623][52811] DAMAGECOUNT value on done: 74513.0 [2024-08-06 00:06:41,623][52811] Sum rewards: 54.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:41,683][52614] Signal inference workers to stop experience collection... (3750 times) [2024-08-06 00:06:41,683][52614] Signal inference workers to resume experience collection... (3750 times) [2024-08-06 00:06:41,769][52650] InferenceWorker_p0-w0: stopping experience collection (3750 times) [2024-08-06 00:06:41,769][52650] InferenceWorker_p0-w0: resuming experience collection (3750 times) [2024-08-06 00:06:42,601][52667] DAMAGECOUNT value on done: 81177.0 [2024-08-06 00:06:42,602][52667] Sum rewards: 67.469, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'HEALTH': '0.010', 'weapon5': '0.028', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.198', 'weapon2': '0.448', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '0.800', 'weapon3': '2.772', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '55.000'} [2024-08-06 00:06:42,687][52660] DAMAGECOUNT value on done: 76926.0 [2024-08-06 00:06:42,688][52660] Sum rewards: 44.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.570', 'WEAPON3': '0.850', 'HITCOUNT': '2.430', 'weapon3': '2.846', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '37.000'} [2024-08-06 00:06:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 164864000. Throughput: 0: 4388.2. Samples: 41223240. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:06:42,794][52567] Avg episode reward: [(0, '49.288')] [2024-08-06 00:06:42,810][52669] DAMAGECOUNT value on done: 78902.0 [2024-08-06 00:06:42,810][52669] Sum rewards: 40.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.844', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.108', 'AMMO4': '0.212', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.378', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.590', 'weapon3': '2.906', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '38.000'} [2024-08-06 00:06:42,996][52803] DAMAGECOUNT value on done: 77612.0 [2024-08-06 00:06:43,000][52803] Sum rewards: 47.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.232', 'weapon2': '0.440', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.238', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:43,836][52649] DAMAGECOUNT value on done: 83303.0 [2024-08-06 00:06:43,836][52649] Sum rewards: 46.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.472', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.225', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.814', 'DAMAGECOUNT': '11.259', 'FRAGCOUNT': '43.000'} [2024-08-06 00:06:44,738][52811] DAMAGECOUNT value on done: 76816.0 [2024-08-06 00:06:44,747][52811] Sum rewards: 51.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '43.000'} [2024-08-06 00:06:45,348][52650] Updated weights for policy 0, policy_version 20131 (0.0016) [2024-08-06 00:06:45,367][52660] DAMAGECOUNT value on done: 82459.0 [2024-08-06 00:06:45,369][52660] Sum rewards: 42.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.730', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.066', 'weapon4': '0.118', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.662', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '2.962', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '39.000'} [2024-08-06 00:06:45,663][52669] DAMAGECOUNT value on done: 77830.0 [2024-08-06 00:06:45,663][52669] Sum rewards: 45.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.314', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.123', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '2.990', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:45,787][52667] DAMAGECOUNT value on done: 80310.0 [2024-08-06 00:06:45,788][52667] Sum rewards: 53.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.932', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon4': '0.364', 'weapon2': '0.640', 'WEAPON3': '1.300', 'weapon3': '2.580', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:46,160][52803] DAMAGECOUNT value on done: 71068.0 [2024-08-06 00:06:46,160][52803] Sum rewards: 39.109, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.720', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.020', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.186', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.750', 'HITCOUNT': '2.840', 'weapon3': '3.216', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:47,558][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:06:47,707][52660] DAMAGECOUNT value on done: 77684.0 [2024-08-06 00:06:47,708][52660] Sum rewards: 51.749, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.330', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.380', 'weapon2': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.576', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:47,784][52811] DAMAGECOUNT value on done: 74293.0 [2024-08-06 00:06:47,785][52811] Sum rewards: 50.426, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.205', 'weapon2': '0.326', 'HEALTH': '0.874', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.478', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '42.000'} [2024-08-06 00:06:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17551.1). Total num frames: 164945920. Throughput: 0: 4382.2. Samples: 41236520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:06:47,794][52567] Avg episode reward: [(0, '48.585')] [2024-08-06 00:06:48,710][52669] DAMAGECOUNT value on done: 82635.0 [2024-08-06 00:06:48,713][52669] Sum rewards: 55.297, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.995', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.129', 'AMMO4': '0.131', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.614', 'WEAPON3': '0.800', 'weapon3': '2.362', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:48,830][52667] DAMAGECOUNT value on done: 82419.0 [2024-08-06 00:06:48,830][52667] Sum rewards: 52.942, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.084', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.054', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '46.000'} [2024-08-06 00:06:50,190][52650] Updated weights for policy 0, policy_version 20141 (0.0026) [2024-08-06 00:06:50,861][52811] DAMAGECOUNT value on done: 75105.0 [2024-08-06 00:06:50,861][52811] Sum rewards: 42.265, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.133', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon4': '0.218', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '3.076', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:51,443][52669] DAMAGECOUNT value on done: 81311.0 [2024-08-06 00:06:51,443][52669] Sum rewards: 50.709, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.482', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon4': '0.230', 'AMMO3': '0.231', 'weapon2': '0.332', 'ARMOR': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.204', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '45.000'} [2024-08-06 00:06:51,777][52667] DAMAGECOUNT value on done: 79897.0 [2024-08-06 00:06:51,778][52667] Sum rewards: 41.676, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.932', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.130', 'weapon4': '0.142', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.650', 'HITCOUNT': '2.480', 'weapon3': '3.032', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '40.000'} [2024-08-06 00:06:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 165036032. Throughput: 0: 4387.1. Samples: 41262890. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:06:52,794][52567] Avg episode reward: [(0, '48.798')] [2024-08-06 00:06:53,943][52669] DAMAGECOUNT value on done: 78613.0 [2024-08-06 00:06:53,943][52669] Sum rewards: 40.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.694', 'AMMO5': '0.003', 'weapon5': '0.020', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO2': '0.054', 'AMMO3': '0.210', 'AMMO4': '0.269', 'weapon2': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.582', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '38.000'} [2024-08-06 00:06:54,959][52667] DAMAGECOUNT value on done: 78920.0 [2024-08-06 00:06:54,962][52667] Sum rewards: 57.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.742', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.256', 'weapon2': '0.302', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.290', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '49.000'} [2024-08-06 00:06:55,235][52650] Updated weights for policy 0, policy_version 20151 (0.0011) [2024-08-06 00:06:56,341][52669] DAMAGECOUNT value on done: 81026.0 [2024-08-06 00:06:56,342][52669] Sum rewards: 48.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon4': '0.124', 'WEAPON4': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.253', 'weapon2': '0.426', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.192', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '44.000'} [2024-08-06 00:06:56,441][52658] DAMAGECOUNT value on done: 82381.0 [2024-08-06 00:06:56,442][52658] Sum rewards: 47.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.642', 'AMMO5': '0.007', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'weapon5': '0.192', 'AMMO3': '0.207', 'AMMO4': '0.220', 'weapon2': '0.468', 'WEAPON4': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.394', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 165117952. Throughput: 0: 4387.5. Samples: 41289390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:06:57,795][52567] Avg episode reward: [(0, '48.805')] [2024-08-06 00:06:58,039][52667] DAMAGECOUNT value on done: 80307.0 [2024-08-06 00:06:58,041][52667] Sum rewards: 46.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon5': '0.054', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.251', 'weapon2': '0.504', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.058', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '41.000'} [2024-08-06 00:06:59,261][52669] DAMAGECOUNT value on done: 84046.0 [2024-08-06 00:06:59,264][52669] Sum rewards: 59.746, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.173', 'weapon5': '0.184', 'WEAPON5': '0.250', 'AMMO4': '0.286', 'weapon4': '0.482', 'weapon2': '0.528', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.500', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '50.000'} [2024-08-06 00:06:59,505][52650] Updated weights for policy 0, policy_version 20161 (0.0017) [2024-08-06 00:06:59,507][52658] DAMAGECOUNT value on done: 80450.0 [2024-08-06 00:06:59,509][52658] Sum rewards: 56.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.582', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.201', 'weapon2': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '47.000'} [2024-08-06 00:07:00,974][52667] DAMAGECOUNT value on done: 78519.0 [2024-08-06 00:07:00,975][52667] Sum rewards: 41.704, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.200', 'AMMO3': '0.262', 'WEAPON4': '0.450', 'weapon4': '0.502', 'weapon2': '0.634', 'WEAPON3': '1.500', 'weapon3': '2.582', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '38.000'} [2024-08-06 00:07:02,335][52669] DAMAGECOUNT value on done: 85708.0 [2024-08-06 00:07:02,336][52669] Sum rewards: 56.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.974', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.188', 'weapon5': '0.194', 'AMMO4': '0.231', 'weapon4': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.588', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '50.000'} [2024-08-06 00:07:02,352][52658] DAMAGECOUNT value on done: 80397.0 [2024-08-06 00:07:02,353][52658] Sum rewards: 54.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.939', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '47.000'} [2024-08-06 00:07:02,487][52795] DAMAGECOUNT value on done: 73981.0 [2024-08-06 00:07:02,488][52795] Sum rewards: 34.409, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-0.316', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.920', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '34.000'} [2024-08-06 00:07:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 165216256. Throughput: 0: 4397.1. Samples: 41302550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:07:02,794][52567] Avg episode reward: [(0, '48.855')] [2024-08-06 00:07:04,090][52667] DAMAGECOUNT value on done: 80588.0 [2024-08-06 00:07:04,104][52667] Sum rewards: 52.475, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.612', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.221', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon2': '1.032', 'weapon3': '2.274', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '44.000'} [2024-08-06 00:07:04,289][52650] Updated weights for policy 0, policy_version 20171 (0.0024) [2024-08-06 00:07:05,028][52669] DAMAGECOUNT value on done: 81200.0 [2024-08-06 00:07:05,030][52669] Sum rewards: 48.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.410', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.201', 'weapon2': '0.866', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.944', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '40.000'} [2024-08-06 00:07:05,417][52658] DAMAGECOUNT value on done: 81057.0 [2024-08-06 00:07:05,417][52658] Sum rewards: 50.453, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.386', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '44.000'} [2024-08-06 00:07:05,647][52795] DAMAGECOUNT value on done: 69452.0 [2024-08-06 00:07:05,648][52795] Sum rewards: 41.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.495', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.906', 'WEAPON3': '1.200', 'weapon3': '2.356', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '36.000'} [2024-08-06 00:07:06,527][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:07:06,848][52667] DAMAGECOUNT value on done: 86744.0 [2024-08-06 00:07:06,848][52667] Sum rewards: 37.889, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.156', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.076', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.292', 'weapon2': '0.368', 'WEAPON3': '1.750', 'HITCOUNT': '2.810', 'weapon3': '3.124', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '37.000'} [2024-08-06 00:07:07,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 165306368. Throughput: 0: 4395.3. Samples: 41329020. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:07:07,794][52567] Avg episode reward: [(0, '48.656')] [2024-08-06 00:07:07,972][52669] DAMAGECOUNT value on done: 80541.0 [2024-08-06 00:07:07,975][52669] Sum rewards: 45.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.893', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.970', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '40.000'} [2024-08-06 00:07:08,060][52666] DAMAGECOUNT value on done: 79234.0 [2024-08-06 00:07:08,060][52666] Sum rewards: 45.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.938', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '40.000'} [2024-08-06 00:07:08,214][52658] DAMAGECOUNT value on done: 82762.0 [2024-08-06 00:07:08,214][52658] Sum rewards: 60.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.105', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.177', 'weapon2': '0.322', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.338', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '49.000'} [2024-08-06 00:07:08,773][52795] DAMAGECOUNT value on done: 71479.0 [2024-08-06 00:07:08,774][52795] Sum rewards: 51.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:09,064][52650] Updated weights for policy 0, policy_version 20181 (0.0019) [2024-08-06 00:07:09,647][52667] DAMAGECOUNT value on done: 80813.0 [2024-08-06 00:07:09,649][52667] Sum rewards: 62.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.129', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.206', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.270', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '52.000'} [2024-08-06 00:07:10,906][52665] DAMAGECOUNT value on done: 77576.0 [2024-08-06 00:07:10,906][52665] Sum rewards: 52.053, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.658', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.232', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:11,003][52658] DAMAGECOUNT value on done: 77482.0 [2024-08-06 00:07:11,006][52658] Sum rewards: 50.959, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.244', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.030', 'AMMO3': '0.109', 'AMMO4': '0.152', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.650', 'WEAPON3': '0.750', 'weapon2': '0.890', 'weapon3': '2.114', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '41.500'} [2024-08-06 00:07:11,124][52669] DAMAGECOUNT value on done: 81260.0 [2024-08-06 00:07:11,125][52669] Sum rewards: 42.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.782', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.045', 'weapon5': '0.146', 'AMMO3': '0.196', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.372', 'WEAPON4': '0.450', 'weapon2': '0.676', 'WEAPON3': '1.100', 'HITCOUNT': '2.100', 'weapon3': '2.530', 'DAMAGECOUNT': '10.578', 'FRAGCOUNT': '38.000'} [2024-08-06 00:07:11,443][52666] DAMAGECOUNT value on done: 80488.0 [2024-08-06 00:07:11,443][52666] Sum rewards: 48.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.082', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.448', 'weapon4': '0.508', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '2.848', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '44.000'} [2024-08-06 00:07:11,837][52795] DAMAGECOUNT value on done: 73791.0 [2024-08-06 00:07:11,840][52795] Sum rewards: 43.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.571', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon5': '0.118', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.954', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:12,406][52667] DAMAGECOUNT value on done: 85850.0 [2024-08-06 00:07:12,410][52667] Sum rewards: 55.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.208', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.044', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.736', 'WEAPON3': '1.600', 'weapon3': '2.908', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '49.000'} [2024-08-06 00:07:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 165388288. Throughput: 0: 4396.7. Samples: 41355370. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:07:12,794][52567] Avg episode reward: [(0, '48.628')] [2024-08-06 00:07:13,177][52663] DAMAGECOUNT value on done: 81048.0 [2024-08-06 00:07:13,178][52663] Sum rewards: 46.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.846', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'AMMO3': '0.188', 'WEAPON4': '0.400', 'weapon2': '0.722', 'weapon4': '0.738', 'WEAPON3': '1.000', 'weapon3': '2.300', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '40.000'} [2024-08-06 00:07:13,379][52650] Updated weights for policy 0, policy_version 20191 (0.0018) [2024-08-06 00:07:13,708][52658] DAMAGECOUNT value on done: 85336.0 [2024-08-06 00:07:13,708][52658] Sum rewards: 57.256, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.378', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.176', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:13,804][52665] DAMAGECOUNT value on done: 83592.0 [2024-08-06 00:07:13,805][52665] Sum rewards: 48.959, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'HEALTH': '0.358', 'weapon2': '0.596', 'weapon4': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.416', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:14,155][52669] DAMAGECOUNT value on done: 80094.0 [2024-08-06 00:07:14,156][52669] Sum rewards: 46.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'AMMO2': '0.055', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'weapon2': '0.600', 'weapon4': '0.684', 'WEAPON3': '1.050', 'weapon3': '2.338', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:14,637][52666] DAMAGECOUNT value on done: 82129.0 [2024-08-06 00:07:14,638][52666] Sum rewards: 67.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.773', 'AMMO5': '0.003', 'AMMO2': '0.045', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.224', 'weapon2': '0.314', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.710', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '56.000'} [2024-08-06 00:07:14,951][52795] DAMAGECOUNT value on done: 76910.0 [2024-08-06 00:07:14,952][52795] Sum rewards: 53.445, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.929', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.172', 'AMMO4': '0.193', 'AMMO3': '0.241', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.284', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:15,017][52667] DAMAGECOUNT value on done: 79359.0 [2024-08-06 00:07:15,019][52667] Sum rewards: 43.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.887', 'AMMO5': '0.007', 'weapon5': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'AMMO4': '0.265', 'weapon4': '0.452', 'weapon2': '0.596', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.714', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:16,295][52665] DAMAGECOUNT value on done: 79509.0 [2024-08-06 00:07:16,297][52665] Sum rewards: 38.773, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.193', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.112', 'AMMO4': '0.175', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '2.828', 'DAMAGECOUNT': '11.730', 'FRAGCOUNT': '36.000'} [2024-08-06 00:07:16,295][52663] DAMAGECOUNT value on done: 80064.0 [2024-08-06 00:07:16,298][52663] Sum rewards: 46.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.424', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.092', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.228', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '40.000'} [2024-08-06 00:07:16,315][52658] DAMAGECOUNT value on done: 79257.0 [2024-08-06 00:07:16,315][52658] Sum rewards: 48.867, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.945', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.096', 'AMMO3': '0.129', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.042', 'weapon3': '2.692', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '39.000'} [2024-08-06 00:07:16,358][52670] DAMAGECOUNT value on done: 77436.0 [2024-08-06 00:07:16,358][52670] Sum rewards: 52.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.828', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon2': '0.592', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '3.226', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '43.000'} [2024-08-06 00:07:17,404][52666] DAMAGECOUNT value on done: 75317.0 [2024-08-06 00:07:17,405][52666] Sum rewards: 48.148, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.050', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.081', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.279', 'weapon2': '0.326', 'WEAPON3': '1.700', 'HITCOUNT': '2.920', 'weapon3': '3.194', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 165478400. Throughput: 0: 4406.2. Samples: 41368610. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:07:17,794][52567] Avg episode reward: [(0, '48.808')] [2024-08-06 00:07:18,117][52667] DAMAGECOUNT value on done: 83555.0 [2024-08-06 00:07:18,118][52667] Sum rewards: 61.994, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.064', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '55.000'} [2024-08-06 00:07:18,246][52795] DAMAGECOUNT value on done: 75191.0 [2024-08-06 00:07:18,247][52795] Sum rewards: 47.053, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.690', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.190', 'AMMO3': '0.251', 'WEAPON4': '0.550', 'weapon2': '0.628', 'weapon4': '0.654', 'WEAPON3': '1.350', 'weapon3': '2.456', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:18,286][52650] Updated weights for policy 0, policy_version 20201 (0.0022) [2024-08-06 00:07:18,624][52663] DAMAGECOUNT value on done: 80662.0 [2024-08-06 00:07:18,624][52663] Sum rewards: 46.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.411', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.240', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.020', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:19,100][52670] DAMAGECOUNT value on done: 81912.0 [2024-08-06 00:07:19,100][52670] Sum rewards: 43.971, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.944', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.324', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.258', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '39.000'} [2024-08-06 00:07:19,262][52658] DAMAGECOUNT value on done: 83801.0 [2024-08-06 00:07:19,263][52658] Sum rewards: 60.862, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.049', 'weapon5': '0.096', 'AMMO3': '0.186', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.472', 'weapon2': '0.502', 'HEALTH': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.684', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:19,369][52665] DAMAGECOUNT value on done: 76777.0 [2024-08-06 00:07:19,370][52665] Sum rewards: 42.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.465', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'AMMO4': '0.229', 'weapon2': '0.572', 'weapon4': '0.618', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.580', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '39.000'} [2024-08-06 00:07:20,428][52666] DAMAGECOUNT value on done: 78356.0 [2024-08-06 00:07:20,437][52666] Sum rewards: 71.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.216', 'AMMO3': '0.221', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '61.000'} [2024-08-06 00:07:21,282][52663] DAMAGECOUNT value on done: 81923.0 [2024-08-06 00:07:21,284][52663] Sum rewards: 45.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'ARMOR': '0.005', 'AMMO5': '0.005', 'weapon5': '0.036', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'AMMO4': '0.227', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:21,315][52795] DAMAGECOUNT value on done: 77231.0 [2024-08-06 00:07:21,316][52795] Sum rewards: 53.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.836', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.258', 'weapon4': '0.268', 'weapon2': '0.316', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.104', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:22,267][52658] DAMAGECOUNT value on done: 82370.0 [2024-08-06 00:07:22,267][52658] Sum rewards: 47.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.137', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.372', 'ARMOR': '0.456', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.030', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '43.000'} [2024-08-06 00:07:22,394][52670] DAMAGECOUNT value on done: 77916.0 [2024-08-06 00:07:22,396][52670] Sum rewards: 34.606, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.164', 'AMMO4': '0.181', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.500', 'weapon4': '0.622', 'WEAPON3': '1.250', 'HITCOUNT': '2.340', 'weapon3': '2.522', 'DAMAGECOUNT': '10.467', 'FRAGCOUNT': '34.000'} [2024-08-06 00:07:22,682][52650] Updated weights for policy 0, policy_version 20211 (0.0014) [2024-08-06 00:07:22,695][52665] DAMAGECOUNT value on done: 79083.0 [2024-08-06 00:07:22,696][52665] Sum rewards: 64.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '55.000'} [2024-08-06 00:07:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 165568512. Throughput: 0: 4400.7. Samples: 41394870. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:07:22,794][52567] Avg episode reward: [(0, '49.156')] [2024-08-06 00:07:23,572][52666] DAMAGECOUNT value on done: 76562.0 [2024-08-06 00:07:23,572][52666] Sum rewards: 61.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.376', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.123', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '50.000'} [2024-08-06 00:07:24,022][52663] DAMAGECOUNT value on done: 78388.0 [2024-08-06 00:07:24,022][52663] Sum rewards: 45.914, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.708', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.610', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '39.000'} [2024-08-06 00:07:24,568][52795] DAMAGECOUNT value on done: 75432.0 [2024-08-06 00:07:24,572][52795] Sum rewards: 45.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.604', 'AMMO5': '0.007', 'ARMOR': '0.013', 'AMMO2': '0.025', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.454', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.808', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '40.000'} [2024-08-06 00:07:24,975][52658] DAMAGECOUNT value on done: 82982.0 [2024-08-06 00:07:24,975][52658] Sum rewards: 55.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.430', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '2.782', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:25,365][52665] DAMAGECOUNT value on done: 81245.0 [2024-08-06 00:07:25,365][52665] Sum rewards: 49.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.448', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.178', 'weapon4': '0.240', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.632', 'WEAPON3': '1.600', 'weapon3': '2.686', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:25,615][52670] DAMAGECOUNT value on done: 80493.0 [2024-08-06 00:07:25,615][52670] Sum rewards: 57.854, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.238', 'WEAPON3': '0.800', 'weapon2': '0.832', 'weapon3': '2.722', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:26,278][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:07:26,485][52666] DAMAGECOUNT value on done: 76398.0 [2024-08-06 00:07:26,487][52666] Sum rewards: 45.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.606', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.156', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.866', 'WEAPON3': '1.300', 'HITCOUNT': '2.370', 'weapon3': '2.412', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:26,809][52663] DAMAGECOUNT value on done: 83222.0 [2024-08-06 00:07:26,811][52663] Sum rewards: 54.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.335', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.205', 'weapon2': '0.414', 'weapon4': '0.544', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.690', 'weapon3': '2.748', 'DAMAGECOUNT': '12.057', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:27,466][52650] Updated weights for policy 0, policy_version 20221 (0.0015) [2024-08-06 00:07:27,731][52795] DAMAGECOUNT value on done: 71691.0 [2024-08-06 00:07:27,733][52795] Sum rewards: 48.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '2.974', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 165650432. Throughput: 0: 4392.2. Samples: 41420890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:07:27,794][52567] Avg episode reward: [(0, '49.465')] [2024-08-06 00:07:27,858][52614] Saving new best policy, reward=49.465! [2024-08-06 00:07:28,107][52658] DAMAGECOUNT value on done: 78804.0 [2024-08-06 00:07:28,107][52658] Sum rewards: 42.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.158', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'weapon2': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '2.620', 'weapon3': '3.104', 'DAMAGECOUNT': '12.057', 'FRAGCOUNT': '38.000'} [2024-08-06 00:07:28,140][52670] DAMAGECOUNT value on done: 77834.0 [2024-08-06 00:07:28,141][52670] Sum rewards: 52.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.079', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon2': '0.414', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.272', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '44.000'} [2024-08-06 00:07:28,232][52665] DAMAGECOUNT value on done: 81235.0 [2024-08-06 00:07:28,232][52665] Sum rewards: 46.889, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.652', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon5': '0.166', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '37.000'} [2024-08-06 00:07:28,302][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:07:29,382][52666] DAMAGECOUNT value on done: 76946.0 [2024-08-06 00:07:29,382][52666] Sum rewards: 39.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.606', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'weapon5': '0.206', 'AMMO4': '0.206', 'AMMO3': '0.215', 'WEAPON4': '0.550', 'weapon2': '0.558', 'weapon4': '0.794', 'WEAPON3': '1.300', 'weapon3': '2.212', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '36.000'} [2024-08-06 00:07:29,854][52663] DAMAGECOUNT value on done: 85066.0 [2024-08-06 00:07:29,855][52663] Sum rewards: 37.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.229', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.350', 'HITCOUNT': '2.500', 'weapon3': '2.810', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '35.000'} [2024-08-06 00:07:30,824][52795] DAMAGECOUNT value on done: 76061.0 [2024-08-06 00:07:30,825][52795] Sum rewards: 49.760, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.260', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.054', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:30,834][52658] DAMAGECOUNT value on done: 80080.0 [2024-08-06 00:07:30,835][52658] Sum rewards: 47.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.028', 'weapon5': '0.070', 'AMMO4': '0.096', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.230', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.374', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:30,974][52665] DAMAGECOUNT value on done: 81037.0 [2024-08-06 00:07:30,974][52665] Sum rewards: 48.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.225', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:31,380][52670] DAMAGECOUNT value on done: 80563.0 [2024-08-06 00:07:31,382][52670] Sum rewards: 41.064, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.581', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.122', 'AMMO3': '0.155', 'weapon5': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.706', 'WEAPON3': '0.950', 'HITCOUNT': '1.990', 'weapon3': '2.754', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '35.000'} [2024-08-06 00:07:32,436][52650] Updated weights for policy 0, policy_version 20231 (0.0021) [2024-08-06 00:07:32,518][52666] DAMAGECOUNT value on done: 82283.0 [2024-08-06 00:07:32,518][52666] Sum rewards: 53.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.300', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.121', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 165740544. Throughput: 0: 4386.4. Samples: 41433910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:07:32,794][52567] Avg episode reward: [(0, '49.710')] [2024-08-06 00:07:32,795][52614] Saving new best policy, reward=49.710! [2024-08-06 00:07:32,999][52663] DAMAGECOUNT value on done: 79890.0 [2024-08-06 00:07:33,001][52663] Sum rewards: 45.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.023', 'ARMOR': '0.016', 'AMMO5': '0.025', 'AMMO2': '0.050', 'weapon5': '0.204', 'AMMO3': '0.207', 'AMMO4': '0.250', 'weapon2': '0.364', 'WEAPON5': '0.550', 'weapon4': '0.566', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.632', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:33,238][52658] DAMAGECOUNT value on done: 78815.0 [2024-08-06 00:07:33,239][52658] Sum rewards: 56.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.029', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.084', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.364', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 00:07:33,925][52665] DAMAGECOUNT value on done: 83930.0 [2024-08-06 00:07:33,927][52665] Sum rewards: 43.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.936', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.190', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '3.158', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '39.000'} [2024-08-06 00:07:34,006][52670] DAMAGECOUNT value on done: 76135.0 [2024-08-06 00:07:34,006][52670] Sum rewards: 45.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.493', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.512', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '2.994', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:34,209][52795] DAMAGECOUNT value on done: 77162.0 [2024-08-06 00:07:34,213][52795] Sum rewards: 56.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO4': '0.075', 'AMMO3': '0.175', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:35,271][52666] DAMAGECOUNT value on done: 79963.0 [2024-08-06 00:07:35,272][52666] Sum rewards: 46.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.302', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.354', 'weapon4': '0.456', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '2.944', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:35,692][52663] DAMAGECOUNT value on done: 80592.0 [2024-08-06 00:07:35,693][52663] Sum rewards: 54.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon4': '0.316', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.740', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '49.000'} [2024-08-06 00:07:36,187][52658] DAMAGECOUNT value on done: 79137.0 [2024-08-06 00:07:36,191][52658] Sum rewards: 48.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.856', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon4': '0.146', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.984', 'DAMAGECOUNT': '11.907', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:36,674][52665] DAMAGECOUNT value on done: 81703.0 [2024-08-06 00:07:36,675][52665] Sum rewards: 53.914, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'HEALTH': '0.103', 'AMMO3': '0.179', 'weapon4': '0.288', 'weapon2': '0.416', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.042', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '44.000'} [2024-08-06 00:07:36,947][52650] Updated weights for policy 0, policy_version 20241 (0.0020) [2024-08-06 00:07:37,231][52670] DAMAGECOUNT value on done: 78465.0 [2024-08-06 00:07:37,233][52670] Sum rewards: 54.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.349', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.588', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.804', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:37,377][52795] DAMAGECOUNT value on done: 73174.0 [2024-08-06 00:07:37,379][52795] Sum rewards: 52.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.944', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.392', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 165822464. Throughput: 0: 4387.1. Samples: 41460310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:07:37,794][52567] Avg episode reward: [(0, '49.617')] [2024-08-06 00:07:38,331][52666] DAMAGECOUNT value on done: 78017.0 [2024-08-06 00:07:38,341][52666] Sum rewards: 54.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.095', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.272', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '47.000'} [2024-08-06 00:07:38,568][52663] DAMAGECOUNT value on done: 83607.0 [2024-08-06 00:07:38,569][52663] Sum rewards: 40.524, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.546', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.098', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'weapon4': '0.310', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.600', 'weapon3': '2.946', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '39.000'} [2024-08-06 00:07:38,589][52658] DAMAGECOUNT value on done: 83320.0 [2024-08-06 00:07:38,591][52658] Sum rewards: 55.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.218', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.019', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.370', 'weapon4': '0.398', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.016', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '47.000'} [2024-08-06 00:07:39,729][52665] DAMAGECOUNT value on done: 81531.0 [2024-08-06 00:07:39,732][52665] Sum rewards: 58.040, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.058', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.066', 'AMMO3': '0.145', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.406', 'weapon4': '0.558', 'WEAPON3': '0.900', 'weapon3': '2.688', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:39,854][52671] DAMAGECOUNT value on done: 85332.0 [2024-08-06 00:07:39,854][52671] Sum rewards: 48.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.990', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.242', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.550', 'HITCOUNT': '2.570', 'weapon3': '3.088', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:40,302][52670] DAMAGECOUNT value on done: 75075.0 [2024-08-06 00:07:40,302][52670] Sum rewards: 41.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.010', 'weapon5': '0.034', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'AMMO4': '0.228', 'weapon2': '0.544', 'weapon4': '0.620', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '37.000'} [2024-08-06 00:07:40,423][52795] DAMAGECOUNT value on done: 75189.0 [2024-08-06 00:07:40,426][52795] Sum rewards: 64.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.518', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.024', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon4': '0.206', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '55.000'} [2024-08-06 00:07:41,344][52666] DAMAGECOUNT value on done: 76096.0 [2024-08-06 00:07:41,346][52666] Sum rewards: 39.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.114', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon2': '0.228', 'AMMO3': '0.229', 'weapon4': '0.346', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '3.132', 'DAMAGECOUNT': '10.866', 'FRAGCOUNT': '35.000'} [2024-08-06 00:07:41,693][52658] DAMAGECOUNT value on done: 84241.0 [2024-08-06 00:07:41,695][52658] Sum rewards: 40.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.635', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon4': '0.224', 'weapon2': '0.908', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.668', 'DAMAGECOUNT': '10.710', 'FRAGCOUNT': '34.000'} [2024-08-06 00:07:41,711][52650] Updated weights for policy 0, policy_version 20251 (0.0020) [2024-08-06 00:07:41,757][52663] DAMAGECOUNT value on done: 81757.0 [2024-08-06 00:07:41,757][52663] Sum rewards: 38.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.645', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.078', 'AMMO3': '0.173', 'AMMO4': '0.174', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.826', 'WEAPON3': '1.100', 'HITCOUNT': '2.390', 'weapon3': '2.726', 'DAMAGECOUNT': '11.106', 'FRAGCOUNT': '33.000'} [2024-08-06 00:07:42,599][52665] DAMAGECOUNT value on done: 79454.0 [2024-08-06 00:07:42,601][52665] Sum rewards: 46.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.067', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'weapon4': '0.230', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'weapon2': '0.870', 'WEAPON3': '1.450', 'weapon3': '2.644', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 165920768. Throughput: 0: 4378.9. Samples: 41486440. Policy #0 lag: (min: 0.0, avg: 4.4, max: 7.0) [2024-08-06 00:07:42,794][52567] Avg episode reward: [(0, '49.448')] [2024-08-06 00:07:42,897][52671] DAMAGECOUNT value on done: 81577.0 [2024-08-06 00:07:42,897][52671] Sum rewards: 50.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.188', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:43,143][52670] DAMAGECOUNT value on done: 73374.0 [2024-08-06 00:07:43,145][52670] Sum rewards: 39.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.148', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'AMMO4': '0.296', 'weapon2': '0.424', 'weapon4': '0.610', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.180', 'weapon3': '2.574', 'DAMAGECOUNT': '10.902', 'FRAGCOUNT': '34.000'} [2024-08-06 00:07:43,498][52795] DAMAGECOUNT value on done: 75676.0 [2024-08-06 00:07:43,498][52795] Sum rewards: 50.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.380', 'weapon4': '0.452', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:43,935][52666] DAMAGECOUNT value on done: 78012.0 [2024-08-06 00:07:43,936][52666] Sum rewards: 53.563, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.708', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.118', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'weapon2': '0.732', 'WEAPON3': '0.900', 'HITCOUNT': '2.780', 'weapon3': '2.946', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '43.000'} [2024-08-06 00:07:44,514][52658] DAMAGECOUNT value on done: 79271.0 [2024-08-06 00:07:44,516][52658] Sum rewards: 53.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.195', 'weapon2': '0.902', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '2.978', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:44,654][52663] DAMAGECOUNT value on done: 79860.0 [2024-08-06 00:07:44,655][52663] Sum rewards: 51.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:45,404][52665] DAMAGECOUNT value on done: 80512.0 [2024-08-06 00:07:45,406][52665] Sum rewards: 63.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.222', 'weapon4': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '53.000'} [2024-08-06 00:07:45,771][52671] DAMAGECOUNT value on done: 82651.0 [2024-08-06 00:07:45,771][52671] Sum rewards: 60.718, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.146', 'weapon4': '0.148', 'weapon2': '0.272', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.362', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '49.000'} [2024-08-06 00:07:45,955][52670] DAMAGECOUNT value on done: 80547.0 [2024-08-06 00:07:45,955][52670] Sum rewards: 52.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.494', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '3.232', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:46,513][52650] Updated weights for policy 0, policy_version 20261 (0.0017) [2024-08-06 00:07:46,640][52795] DAMAGECOUNT value on done: 72616.0 [2024-08-06 00:07:46,642][52795] Sum rewards: 48.600, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.674', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.138', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'weapon2': '0.478', 'WEAPON3': '1.800', 'HITCOUNT': '2.870', 'weapon3': '3.112', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:46,735][52666] DAMAGECOUNT value on done: 81353.0 [2024-08-06 00:07:46,738][52666] Sum rewards: 68.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.326', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 00:07:47,060][52658] DAMAGECOUNT value on done: 80767.0 [2024-08-06 00:07:47,061][52658] Sum rewards: 61.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.502', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.076', 'weapon5': '0.104', 'AMMO4': '0.121', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.272', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '52.000'} [2024-08-06 00:07:47,470][52663] DAMAGECOUNT value on done: 77210.0 [2024-08-06 00:07:47,472][52663] Sum rewards: 39.792, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.388', 'AMMO5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.364', 'WEAPON3': '1.000', 'weapon2': '1.046', 'HITCOUNT': '2.150', 'weapon3': '2.348', 'DAMAGECOUNT': '8.583', 'FRAGCOUNT': '34.000'} [2024-08-06 00:07:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 166002688. Throughput: 0: 4383.5. Samples: 41499810. Policy #0 lag: (min: 0.0, avg: 4.4, max: 7.0) [2024-08-06 00:07:47,795][52567] Avg episode reward: [(0, '50.160')] [2024-08-06 00:07:47,797][52614] Saving new best policy, reward=50.160! [2024-08-06 00:07:48,422][52665] DAMAGECOUNT value on done: 80618.0 [2024-08-06 00:07:48,424][52665] Sum rewards: 44.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO4': '0.163', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.686', 'WEAPON3': '1.000', 'HITCOUNT': '2.680', 'weapon3': '2.848', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '38.000'} [2024-08-06 00:07:48,838][52671] DAMAGECOUNT value on done: 78374.0 [2024-08-06 00:07:48,840][52671] Sum rewards: 47.664, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'AMMO3': '0.122', 'weapon5': '0.146', 'weapon4': '0.148', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'HEALTH': '0.215', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.984', 'weapon3': '2.522', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '38.000'} [2024-08-06 00:07:48,946][52670] DAMAGECOUNT value on done: 80357.0 [2024-08-06 00:07:48,946][52670] Sum rewards: 41.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.250', 'HITCOUNT': '2.430', 'weapon3': '3.112', 'DAMAGECOUNT': '10.776', 'FRAGCOUNT': '37.000'} [2024-08-06 00:07:49,832][52795] DAMAGECOUNT value on done: 75906.0 [2024-08-06 00:07:49,834][52795] Sum rewards: 54.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.088', 'weapon4': '0.134', 'AMMO3': '0.168', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.084', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '47.500'} [2024-08-06 00:07:50,079][52666] DAMAGECOUNT value on done: 77555.0 [2024-08-06 00:07:50,080][52666] Sum rewards: 54.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.032', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.219', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.710', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:50,194][52658] DAMAGECOUNT value on done: 85331.0 [2024-08-06 00:07:50,196][52658] Sum rewards: 56.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.361', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.322', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.506', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:50,536][52663] DAMAGECOUNT value on done: 78900.0 [2024-08-06 00:07:50,539][52663] Sum rewards: 36.383, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon7': '0.056', 'HEALTH': '0.069', 'weapon5': '0.100', 'AMMO3': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.908', 'weapon3': '1.742', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '9.411', 'FRAGCOUNT': '31.500'} [2024-08-06 00:07:50,839][52650] Updated weights for policy 0, policy_version 20271 (0.0021) [2024-08-06 00:07:51,660][52665] DAMAGECOUNT value on done: 79076.0 [2024-08-06 00:07:51,661][52665] Sum rewards: 49.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.080', 'weapon5': '0.092', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'AMMO4': '0.401', 'weapon2': '0.444', 'weapon4': '0.508', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.664', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:51,700][52671] DAMAGECOUNT value on done: 79627.0 [2024-08-06 00:07:51,701][52671] Sum rewards: 63.366, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon4': '0.044', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon2': '0.830', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '51.000'} [2024-08-06 00:07:51,907][52670] DAMAGECOUNT value on done: 80029.0 [2024-08-06 00:07:51,907][52670] Sum rewards: 56.613, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.086', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.684', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.108', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:52,610][52664] DAMAGECOUNT value on done: 82411.0 [2024-08-06 00:07:52,612][52664] Sum rewards: 59.524, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.332', 'AMMO5': '0.006', 'ARMOR': '0.032', 'AMMO2': '0.035', 'weapon5': '0.042', 'AMMO3': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'weapon4': '0.390', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '0.750', 'weapon3': '2.896', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 166084608. Throughput: 0: 4379.6. Samples: 41526100. Policy #0 lag: (min: 0.0, avg: 4.4, max: 7.0) [2024-08-06 00:07:52,794][52567] Avg episode reward: [(0, '50.482')] [2024-08-06 00:07:52,795][52614] Saving new best policy, reward=50.482! [2024-08-06 00:07:52,917][52666] DAMAGECOUNT value on done: 78509.0 [2024-08-06 00:07:52,918][52666] Sum rewards: 51.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.684', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.366', 'weapon4': '0.388', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '44.000'} [2024-08-06 00:07:52,931][52795] DAMAGECOUNT value on done: 78452.0 [2024-08-06 00:07:52,931][52795] Sum rewards: 54.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.102', 'AMMO3': '0.161', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.378', 'weapon4': '0.514', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.814', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '47.000'} [2024-08-06 00:07:53,571][52663] DAMAGECOUNT value on done: 84977.0 [2024-08-06 00:07:53,571][52663] Sum rewards: 55.056, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.371', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.134', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.504', 'weapon4': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.532', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '44.000'} [2024-08-06 00:07:54,573][52665] DAMAGECOUNT value on done: 79440.0 [2024-08-06 00:07:54,575][52665] Sum rewards: 66.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.670', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.408', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '57.000'} [2024-08-06 00:07:54,649][52671] DAMAGECOUNT value on done: 82973.0 [2024-08-06 00:07:54,652][52671] Sum rewards: 50.387, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.550', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.239', 'weapon2': '0.272', 'WEAPON4': '0.450', 'weapon4': '0.764', 'WEAPON3': '1.100', 'weapon3': '2.586', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:54,975][52670] DAMAGECOUNT value on done: 79439.0 [2024-08-06 00:07:54,976][52670] Sum rewards: 46.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.227', 'weapon4': '0.230', 'weapon2': '0.584', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '2.974', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:55,611][52664] DAMAGECOUNT value on done: 83206.0 [2024-08-06 00:07:55,613][52664] Sum rewards: 42.230, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.222', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.414', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:55,959][52650] Updated weights for policy 0, policy_version 20281 (0.0023) [2024-08-06 00:07:56,037][52666] DAMAGECOUNT value on done: 75613.0 [2024-08-06 00:07:56,039][52666] Sum rewards: 54.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.161', 'weapon5': '0.172', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'weapon4': '0.384', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.774', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '45.000'} [2024-08-06 00:07:56,340][52795] DAMAGECOUNT value on done: 72362.0 [2024-08-06 00:07:56,341][52795] Sum rewards: 56.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.472', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.984', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:56,691][52663] DAMAGECOUNT value on done: 80702.0 [2024-08-06 00:07:56,693][52663] Sum rewards: 56.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.336', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.177', 'AMMO3': '0.188', 'weapon5': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.450', 'weapon4': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '48.000'} [2024-08-06 00:07:57,472][52671] DAMAGECOUNT value on done: 81760.0 [2024-08-06 00:07:57,473][52671] Sum rewards: 51.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.069', 'weapon5': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon4': '0.238', 'weapon2': '0.354', 'WEAPON3': '0.950', 'HITCOUNT': '3.010', 'weapon3': '3.230', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '41.000'} [2024-08-06 00:07:57,531][52665] DAMAGECOUNT value on done: 79182.0 [2024-08-06 00:07:57,531][52665] Sum rewards: 50.817, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.576', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.232', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.222', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '42.000'} [2024-08-06 00:07:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 166174720. Throughput: 0: 4373.1. Samples: 41552160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:07:57,795][52567] Avg episode reward: [(0, '50.806')] [2024-08-06 00:07:57,882][52614] Saving new best policy, reward=50.806! [2024-08-06 00:07:58,074][52670] DAMAGECOUNT value on done: 81594.0 [2024-08-06 00:07:58,074][52670] Sum rewards: 54.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.866', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.157', 'AMMO3': '0.173', 'weapon5': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.572', 'weapon4': '0.672', 'WEAPON3': '0.950', 'weapon3': '2.084', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:58,401][52664] DAMAGECOUNT value on done: 85758.0 [2024-08-06 00:07:58,401][52664] Sum rewards: 56.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.069', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.110', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '50.000'} [2024-08-06 00:07:59,181][52666] DAMAGECOUNT value on done: 80295.0 [2024-08-06 00:07:59,181][52666] Sum rewards: 52.369, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.130', 'AMMO3': '0.190', 'weapon4': '0.226', 'AMMO4': '0.248', 'WEAPON4': '0.550', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.708', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '46.000'} [2024-08-06 00:07:59,417][52795] DAMAGECOUNT value on done: 75799.0 [2024-08-06 00:07:59,420][52795] Sum rewards: 62.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.249', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.394', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2024-08-06 00:07:59,788][52663] DAMAGECOUNT value on done: 83312.0 [2024-08-06 00:07:59,789][52663] Sum rewards: 56.734, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.371', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.249', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.500', 'weapon3': '2.960', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:00,103][52665] DAMAGECOUNT value on done: 75754.0 [2024-08-06 00:08:00,104][52665] Sum rewards: 24.057, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.998', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'weapon5': '0.190', 'AMMO4': '0.197', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'weapon2': '0.542', 'weapon4': '0.624', 'WEAPON3': '1.400', 'HITCOUNT': '2.190', 'weapon3': '2.228', 'DAMAGECOUNT': '9.252', 'FRAGCOUNT': '27.000'} [2024-08-06 00:08:00,346][52650] Updated weights for policy 0, policy_version 20291 (0.0028) [2024-08-06 00:08:00,345][52659] DAMAGECOUNT value on done: 79986.0 [2024-08-06 00:08:00,347][52659] Sum rewards: 52.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.790', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.256', 'weapon2': '0.274', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.960', 'weapon3': '3.132', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:00,852][52671] DAMAGECOUNT value on done: 84572.0 [2024-08-06 00:08:00,863][52671] Sum rewards: 45.453, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.886', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.156', 'AMMO3': '0.222', 'weapon4': '0.294', 'WEAPON4': '0.400', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.723', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:00,990][52664] DAMAGECOUNT value on done: 82523.0 [2024-08-06 00:08:00,992][52664] Sum rewards: 48.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.406', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.134', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'AMMO4': '0.232', 'weapon4': '0.378', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.840', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:01,409][52670] DAMAGECOUNT value on done: 75765.0 [2024-08-06 00:08:01,409][52670] Sum rewards: 44.712, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.656', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.120', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.354', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.620', 'weapon3': '2.790', 'DAMAGECOUNT': '11.709', 'FRAGCOUNT': '43.000'} [2024-08-06 00:08:01,579][52666] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:08:02,440][52666] DAMAGECOUNT value on done: 79321.0 [2024-08-06 00:08:02,441][52666] Sum rewards: 56.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.912', 'AMMO5': '0.005', 'ARMOR': '0.044', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.213', 'AMMO4': '0.233', 'weapon2': '0.370', 'weapon4': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:02,556][52795] DAMAGECOUNT value on done: 78847.0 [2024-08-06 00:08:02,557][52795] Sum rewards: 60.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.611', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.114', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '51.000'} [2024-08-06 00:08:02,648][52663] DAMAGECOUNT value on done: 82051.0 [2024-08-06 00:08:02,650][52663] Sum rewards: 41.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.497', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.516', 'weapon4': '0.684', 'WEAPON3': '1.050', 'HITCOUNT': '2.290', 'weapon3': '2.380', 'DAMAGECOUNT': '10.764', 'FRAGCOUNT': '35.000'} [2024-08-06 00:08:02,795][52567] Fps is (10 sec: 18021.5, 60 sec: 17476.1, 300 sec: 17578.1). Total num frames: 166264832. Throughput: 0: 4366.6. Samples: 41565110. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:08:02,795][52567] Avg episode reward: [(0, '50.740')] [2024-08-06 00:08:02,939][52665] DAMAGECOUNT value on done: 77707.0 [2024-08-06 00:08:02,939][52665] Sum rewards: 58.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.734', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.088', 'AMMO3': '0.216', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:03,081][52659] DAMAGECOUNT value on done: 84189.0 [2024-08-06 00:08:03,089][52659] Sum rewards: 53.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.726', 'AMMO5': '0.011', 'ARMOR': '0.032', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO3': '0.210', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.384', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '46.000'} [2024-08-06 00:08:03,620][52671] DAMAGECOUNT value on done: 81158.0 [2024-08-06 00:08:03,622][52671] Sum rewards: 48.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.505', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO3': '0.161', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.444', 'weapon2': '0.494', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.646', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:03,795][52664] DAMAGECOUNT value on done: 82739.0 [2024-08-06 00:08:03,796][52664] Sum rewards: 46.045, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.804', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.030', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.288', 'weapon2': '0.416', 'WEAPON3': '1.750', 'HITCOUNT': '2.910', 'weapon3': '3.332', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '43.000'} [2024-08-06 00:08:04,258][52670] DAMAGECOUNT value on done: 82246.0 [2024-08-06 00:08:04,260][52670] Sum rewards: 55.794, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.183', 'weapon4': '0.278', 'HEALTH': '0.596', 'weapon2': '0.824', 'WEAPON3': '1.000', 'weapon3': '2.584', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '45.500'} [2024-08-06 00:08:05,190][52666] DAMAGECOUNT value on done: 80517.0 [2024-08-06 00:08:05,190][52666] Sum rewards: 43.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.446', 'weapon2': '0.596', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '2.726', 'DAMAGECOUNT': '11.457', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:05,396][52650] Updated weights for policy 0, policy_version 20301 (0.0013) [2024-08-06 00:08:05,762][52665] DAMAGECOUNT value on done: 78065.0 [2024-08-06 00:08:05,762][52665] Sum rewards: 53.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.024', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.202', 'AMMO3': '0.240', 'weapon2': '0.336', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.182', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:05,997][52663] DAMAGECOUNT value on done: 84977.0 [2024-08-06 00:08:05,997][52663] Sum rewards: 57.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.962', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.236', 'weapon4': '0.406', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.210', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '50.000'} [2024-08-06 00:08:06,196][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:08:06,228][52659] DAMAGECOUNT value on done: 80011.0 [2024-08-06 00:08:06,229][52659] Sum rewards: 45.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.832', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.118', 'AMMO3': '0.197', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '39.500'} [2024-08-06 00:08:06,342][52664] DAMAGECOUNT value on done: 88107.0 [2024-08-06 00:08:06,342][52664] Sum rewards: 68.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.525', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '57.000'} [2024-08-06 00:08:06,862][52671] DAMAGECOUNT value on done: 83302.0 [2024-08-06 00:08:06,864][52671] Sum rewards: 58.371, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.024', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.166', 'AMMO3': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.070', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '52.000'} [2024-08-06 00:08:07,130][52670] DAMAGECOUNT value on done: 80302.0 [2024-08-06 00:08:07,130][52670] Sum rewards: 46.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.186', 'weapon2': '0.382', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.372', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 166346752. Throughput: 0: 4367.1. Samples: 41591390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:08:07,794][52567] Avg episode reward: [(0, '50.918')] [2024-08-06 00:08:07,797][52614] Saving new best policy, reward=50.918! [2024-08-06 00:08:08,839][52664] DAMAGECOUNT value on done: 84214.0 [2024-08-06 00:08:08,840][52664] Sum rewards: 54.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.630', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.210', 'AMMO3': '0.277', 'weapon2': '0.430', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.166', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:09,220][52659] DAMAGECOUNT value on done: 83243.0 [2024-08-06 00:08:09,220][52659] Sum rewards: 55.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.939', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.362', 'weapon4': '0.678', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:09,220][52663] DAMAGECOUNT value on done: 80089.0 [2024-08-06 00:08:09,222][52663] Sum rewards: 43.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.452', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.040', 'weapon5': '0.100', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.374', 'WEAPON4': '0.450', 'weapon2': '0.524', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '2.770', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:09,515][52650] Updated weights for policy 0, policy_version 20311 (0.0014) [2024-08-06 00:08:09,786][52671] DAMAGECOUNT value on done: 81377.0 [2024-08-06 00:08:09,786][52671] Sum rewards: 43.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.754', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.452', 'weapon4': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.914', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:10,187][52670] DAMAGECOUNT value on done: 77768.0 [2024-08-06 00:08:10,187][52670] Sum rewards: 48.399, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.616', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.044', 'weapon5': '0.076', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.251', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '2.968', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '45.000'} [2024-08-06 00:08:10,466][52662] Large shaping reward -2.507 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.258, -86.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:08:11,245][52664] DAMAGECOUNT value on done: 78097.0 [2024-08-06 00:08:11,246][52664] Sum rewards: 50.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.120', 'AMMO3': '0.170', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '43.000'} [2024-08-06 00:08:11,877][52659] DAMAGECOUNT value on done: 81690.0 [2024-08-06 00:08:11,879][52659] Sum rewards: 46.481, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.898', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.054', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON3': '0.950', 'weapon2': '1.310', 'weapon3': '2.446', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:12,535][52671] DAMAGECOUNT value on done: 82016.0 [2024-08-06 00:08:12,535][52671] Sum rewards: 55.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.201', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.756', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:12,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 166436864. Throughput: 0: 4363.3. Samples: 41617240. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:08:12,795][52567] Avg episode reward: [(0, '50.898')] [2024-08-06 00:08:13,445][52670] DAMAGECOUNT value on done: 77925.0 [2024-08-06 00:08:13,445][52670] Sum rewards: 43.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.034', 'ARMOR': '0.040', 'weapon5': '0.110', 'AMMO4': '0.170', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON4': '0.500', 'weapon4': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:14,137][52664] DAMAGECOUNT value on done: 89815.0 [2024-08-06 00:08:14,137][52664] Sum rewards: 48.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.169', 'WEAPON4': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '3.014', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '42.000'} [2024-08-06 00:08:14,263][52659] DAMAGECOUNT value on done: 83266.0 [2024-08-06 00:08:14,263][52659] Sum rewards: 47.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon4': '0.118', 'AMMO3': '0.192', 'weapon2': '0.372', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.214', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:14,630][52650] Updated weights for policy 0, policy_version 20321 (0.0019) [2024-08-06 00:08:15,033][52671] DAMAGECOUNT value on done: 85709.0 [2024-08-06 00:08:15,035][52671] Sum rewards: 43.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.061', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'AMMO4': '0.307', 'WEAPON4': '0.400', 'weapon2': '0.590', 'weapon4': '0.976', 'WEAPON3': '1.250', 'weapon3': '2.046', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:16,597][52664] DAMAGECOUNT value on done: 86624.0 [2024-08-06 00:08:16,599][52664] Sum rewards: 49.141, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.935', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.132', 'WEAPON4': '0.550', 'weapon2': '0.724', 'weapon4': '0.724', 'WEAPON3': '0.900', 'weapon3': '2.350', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:17,033][52659] DAMAGECOUNT value on done: 83294.0 [2024-08-06 00:08:17,033][52659] Sum rewards: 51.772, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.881', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.064', 'weapon5': '0.126', 'AMMO3': '0.194', 'weapon4': '0.200', 'WEAPON5': '0.250', 'AMMO4': '0.318', 'WEAPON4': '0.500', 'weapon2': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.870', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '44.000'} [2024-08-06 00:08:17,506][52671] DAMAGECOUNT value on done: 82631.0 [2024-08-06 00:08:17,507][52671] Sum rewards: 59.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.388', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '51.000'} [2024-08-06 00:08:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 166518784. Throughput: 0: 4368.9. Samples: 41630510. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:08:17,797][52567] Avg episode reward: [(0, '51.099')] [2024-08-06 00:08:17,823][52614] Saving new best policy, reward=51.099! [2024-08-06 00:08:19,328][52650] Updated weights for policy 0, policy_version 20331 (0.0022) [2024-08-06 00:08:19,388][52664] DAMAGECOUNT value on done: 87677.0 [2024-08-06 00:08:19,389][52664] Sum rewards: 38.048, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.048', 'weapon5': '0.088', 'AMMO3': '0.193', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.426', 'WEAPON4': '0.500', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.568', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '36.000'} [2024-08-06 00:08:19,697][52659] DAMAGECOUNT value on done: 78843.0 [2024-08-06 00:08:19,698][52659] Sum rewards: 51.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.572', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.238', 'weapon2': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.498', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '46.000'} [2024-08-06 00:08:20,314][52671] DAMAGECOUNT value on done: 77928.0 [2024-08-06 00:08:20,317][52671] Sum rewards: 46.619, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'HEALTH': '0.139', 'AMMO3': '0.164', 'weapon4': '0.278', 'weapon2': '0.672', 'WEAPON3': '0.950', 'HITCOUNT': '2.750', 'weapon3': '2.832', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:22,186][52664] DAMAGECOUNT value on done: 83659.0 [2024-08-06 00:08:22,186][52664] Sum rewards: 45.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.464', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.946', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:22,276][52659] DAMAGECOUNT value on done: 81079.0 [2024-08-06 00:08:22,276][52659] Sum rewards: 44.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.218', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.090', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '39.000'} [2024-08-06 00:08:22,795][52567] Fps is (10 sec: 17202.2, 60 sec: 17339.6, 300 sec: 17550.3). Total num frames: 166608896. Throughput: 0: 4359.9. Samples: 41656510. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:08:22,796][52567] Avg episode reward: [(0, '50.950')] [2024-08-06 00:08:22,908][52671] DAMAGECOUNT value on done: 82138.0 [2024-08-06 00:08:22,909][52671] Sum rewards: 39.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.128', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.215', 'weapon4': '0.366', 'WEAPON4': '0.400', 'weapon2': '0.832', 'WEAPON3': '1.250', 'weapon3': '2.582', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.965', 'FRAGCOUNT': '34.500'} [2024-08-06 00:08:23,763][52650] Updated weights for policy 0, policy_version 20341 (0.0018) [2024-08-06 00:08:24,273][52820] DAMAGECOUNT value on done: 74377.0 [2024-08-06 00:08:24,274][52820] Sum rewards: 37.561, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.994', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.080', 'AMMO3': '0.252', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.408', 'weapon4': '0.544', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.680', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '36.000'} [2024-08-06 00:08:24,615][52664] DAMAGECOUNT value on done: 82508.0 [2024-08-06 00:08:24,616][52664] Sum rewards: 34.686, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.063', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '0.650', 'weapon2': '0.918', 'HITCOUNT': '2.340', 'weapon3': '2.574', 'DAMAGECOUNT': '9.258', 'FRAGCOUNT': '28.000'} [2024-08-06 00:08:25,309][52659] DAMAGECOUNT value on done: 84465.0 [2024-08-06 00:08:25,310][52659] Sum rewards: 56.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.314', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.055', 'weapon5': '0.144', 'AMMO3': '0.220', 'AMMO4': '0.276', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.642', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:25,887][52671] DAMAGECOUNT value on done: 82069.0 [2024-08-06 00:08:25,888][52671] Sum rewards: 56.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.008', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.067', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.124', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:27,364][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:08:27,373][52820] DAMAGECOUNT value on done: 76822.0 [2024-08-06 00:08:27,373][52820] Sum rewards: 39.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.039', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.490', 'weapon3': '3.236', 'DAMAGECOUNT': '11.028', 'FRAGCOUNT': '35.000'} [2024-08-06 00:08:27,619][52664] DAMAGECOUNT value on done: 85019.0 [2024-08-06 00:08:27,621][52664] Sum rewards: 41.301, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.175', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.090', 'weapon4': '0.166', 'AMMO4': '0.235', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.894', 'WEAPON3': '1.450', 'weapon3': '2.572', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 166699008. Throughput: 0: 4366.4. Samples: 41682930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:08:27,794][52567] Avg episode reward: [(0, '50.398')] [2024-08-06 00:08:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020349_166699008.pth... [2024-08-06 00:08:27,832][52647] DAMAGECOUNT value on done: 85750.0 [2024-08-06 00:08:27,832][52647] Sum rewards: 47.366, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.272', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon5': '0.172', 'weapon4': '0.200', 'AMMO3': '0.244', 'AMMO4': '0.290', 'weapon2': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '2.966', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '42.500'} [2024-08-06 00:08:27,911][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000019834_162480128.pth [2024-08-06 00:08:27,970][52820] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:08:28,050][52659] DAMAGECOUNT value on done: 81147.0 [2024-08-06 00:08:28,051][52659] Sum rewards: 50.662, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.905', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'weapon2': '0.158', 'AMMO3': '0.173', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.736', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '42.000'} [2024-08-06 00:08:28,517][52650] Updated weights for policy 0, policy_version 20351 (0.0016) [2024-08-06 00:08:28,675][52671] DAMAGECOUNT value on done: 82577.0 [2024-08-06 00:08:28,677][52671] Sum rewards: 43.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.670', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.038', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.201', 'weapon4': '0.204', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '2.912', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:30,547][52820] DAMAGECOUNT value on done: 72030.0 [2024-08-06 00:08:30,547][52820] Sum rewards: 37.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.344', 'ARMOR': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.666', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.712', 'DAMAGECOUNT': '10.638', 'FRAGCOUNT': '33.000'} [2024-08-06 00:08:30,547][52664] DAMAGECOUNT value on done: 85551.0 [2024-08-06 00:08:30,552][52664] Sum rewards: 50.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.662', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.256', 'weapon2': '0.308', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '3.278', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:30,751][52647] DAMAGECOUNT value on done: 84548.0 [2024-08-06 00:08:30,751][52647] Sum rewards: 46.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.128', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.700', 'weapon3': '2.828', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '43.000'} [2024-08-06 00:08:31,039][52659] DAMAGECOUNT value on done: 79388.0 [2024-08-06 00:08:31,039][52659] Sum rewards: 41.130, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.275', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.306', 'weapon4': '0.340', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '2.470', 'weapon3': '2.930', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '43.000'} [2024-08-06 00:08:31,514][52665] Large shaping reward 3.486 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.435, 145.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:08:31,602][52671] DAMAGECOUNT value on done: 80672.0 [2024-08-06 00:08:31,604][52671] Sum rewards: 46.764, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.033', 'weapon5': '0.034', 'AMMO3': '0.109', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.358', 'WEAPON4': '0.450', 'weapon2': '0.534', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.936', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:32,794][52567] Fps is (10 sec: 18023.7, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 166789120. Throughput: 0: 4358.9. Samples: 41695960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:08:32,794][52567] Avg episode reward: [(0, '49.873')] [2024-08-06 00:08:33,163][52664] DAMAGECOUNT value on done: 81671.0 [2024-08-06 00:08:33,165][52664] Sum rewards: 58.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.631', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.220', 'weapon4': '0.258', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.384', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:33,345][52647] DAMAGECOUNT value on done: 89292.0 [2024-08-06 00:08:33,345][52647] Sum rewards: 44.693, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.183', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.098', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.500', 'HITCOUNT': '2.550', 'weapon3': '3.212', 'DAMAGECOUNT': '11.595', 'FRAGCOUNT': '43.000'} [2024-08-06 00:08:33,359][52650] Updated weights for policy 0, policy_version 20361 (0.0015) [2024-08-06 00:08:33,708][52820] DAMAGECOUNT value on done: 72205.0 [2024-08-06 00:08:33,714][52820] Sum rewards: 51.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.702', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO4': '0.178', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.486', 'weapon4': '0.648', 'WEAPON3': '1.200', 'weapon3': '2.508', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '44.000'} [2024-08-06 00:08:33,850][52659] DAMAGECOUNT value on done: 77047.0 [2024-08-06 00:08:33,852][52659] Sum rewards: 55.689, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.864', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'WEAPON4': '0.250', 'weapon4': '0.414', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '2.966', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '45.000'} [2024-08-06 00:08:34,459][52671] DAMAGECOUNT value on done: 79746.0 [2024-08-06 00:08:34,459][52671] Sum rewards: 59.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.192', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.390', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.686', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '49.000'} [2024-08-06 00:08:36,002][52664] DAMAGECOUNT value on done: 86245.0 [2024-08-06 00:08:36,002][52664] Sum rewards: 48.878, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.726', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.718', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '42.000'} [2024-08-06 00:08:36,193][52647] DAMAGECOUNT value on done: 90020.0 [2024-08-06 00:08:36,194][52647] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.302', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.033', 'weapon5': '0.048', 'weapon4': '0.122', 'AMMO4': '0.165', 'AMMO3': '0.245', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.324', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '55.000'} [2024-08-06 00:08:36,803][52820] DAMAGECOUNT value on done: 74494.0 [2024-08-06 00:08:36,804][52820] Sum rewards: 62.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.341', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '51.000'} [2024-08-06 00:08:36,865][52659] DAMAGECOUNT value on done: 82908.0 [2024-08-06 00:08:36,866][52659] Sum rewards: 63.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.894', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.318', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '54.000'} [2024-08-06 00:08:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 166871040. Throughput: 0: 4360.4. Samples: 41722320. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:08:37,795][52567] Avg episode reward: [(0, '50.816')] [2024-08-06 00:08:37,961][52650] Updated weights for policy 0, policy_version 20371 (0.0021) [2024-08-06 00:08:38,058][52614] Signal inference workers to stop experience collection... (3800 times) [2024-08-06 00:08:38,065][52614] Signal inference workers to resume experience collection... (3800 times) [2024-08-06 00:08:38,100][52650] InferenceWorker_p0-w0: stopping experience collection (3800 times) [2024-08-06 00:08:38,115][52650] InferenceWorker_p0-w0: resuming experience collection (3800 times) [2024-08-06 00:08:38,861][52664] DAMAGECOUNT value on done: 84600.0 [2024-08-06 00:08:38,861][52664] Sum rewards: 48.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.438', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.208', 'weapon5': '0.226', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '2.760', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '41.500'} [2024-08-06 00:08:38,965][52647] DAMAGECOUNT value on done: 89042.0 [2024-08-06 00:08:38,966][52647] Sum rewards: 43.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.149', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.752', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '2.706', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:39,418][52659] DAMAGECOUNT value on done: 82556.0 [2024-08-06 00:08:39,424][52659] Sum rewards: 53.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.924', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.032', 'weapon5': '0.054', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.308', 'weapon2': '0.678', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '45.000'} [2024-08-06 00:08:40,025][52820] DAMAGECOUNT value on done: 75977.0 [2024-08-06 00:08:40,026][52820] Sum rewards: 56.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.122', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.870', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '48.000'} [2024-08-06 00:08:41,859][52664] DAMAGECOUNT value on done: 84487.0 [2024-08-06 00:08:41,860][52664] Sum rewards: 39.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.688', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON3': '0.850', 'weapon2': '0.924', 'HITCOUNT': '2.380', 'weapon3': '2.460', 'DAMAGECOUNT': '10.674', 'FRAGCOUNT': '32.000'} [2024-08-06 00:08:41,956][52647] DAMAGECOUNT value on done: 88613.0 [2024-08-06 00:08:41,956][52647] Sum rewards: 53.552, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.808', 'AMMO2': '0.027', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.560', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:42,299][52659] DAMAGECOUNT value on done: 86555.0 [2024-08-06 00:08:42,302][52659] Sum rewards: 41.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.742', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.368', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '3.112', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '37.000'} [2024-08-06 00:08:42,560][52650] Updated weights for policy 0, policy_version 20381 (0.0012) [2024-08-06 00:08:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 166961152. Throughput: 0: 4370.0. Samples: 41748810. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:08:42,794][52567] Avg episode reward: [(0, '50.115')] [2024-08-06 00:08:43,197][52820] DAMAGECOUNT value on done: 76579.0 [2024-08-06 00:08:43,199][52820] Sum rewards: 59.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.320', 'AMMO2': '0.004', 'ARMOR': '0.004', 'AMMO4': '0.019', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'WEAPON3': '1.000', 'weapon2': '1.112', 'weapon3': '2.710', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:44,698][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:08:44,990][52664] DAMAGECOUNT value on done: 84511.0 [2024-08-06 00:08:44,990][52664] Sum rewards: 35.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.871', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.274', 'weapon2': '0.276', 'WEAPON3': '1.600', 'HITCOUNT': '2.600', 'weapon3': '3.318', 'DAMAGECOUNT': '11.349', 'FRAGCOUNT': '33.000'} [2024-08-06 00:08:45,003][52647] DAMAGECOUNT value on done: 85515.0 [2024-08-06 00:08:45,003][52647] Sum rewards: 48.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.162', 'AMMO3': '0.168', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.408', 'weapon2': '0.474', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.706', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:45,328][52659] DAMAGECOUNT value on done: 82097.0 [2024-08-06 00:08:45,331][52659] Sum rewards: 49.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.356', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.310', 'weapon4': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '45.500'} [2024-08-06 00:08:46,320][52820] DAMAGECOUNT value on done: 77540.0 [2024-08-06 00:08:46,322][52820] Sum rewards: 52.676, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.559', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.143', 'weapon4': '0.230', 'AMMO3': '0.270', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.172', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:47,379][52650] Updated weights for policy 0, policy_version 20391 (0.0026) [2024-08-06 00:08:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 167051264. Throughput: 0: 4372.9. Samples: 41761890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:08:47,794][52567] Avg episode reward: [(0, '50.281')] [2024-08-06 00:08:48,141][52647] DAMAGECOUNT value on done: 88111.0 [2024-08-06 00:08:48,141][52647] Sum rewards: 59.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.866', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.052', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.270', 'weapon2': '0.372', 'WEAPON3': '1.700', 'HITCOUNT': '3.130', 'weapon3': '3.348', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '54.000'} [2024-08-06 00:08:48,195][52659] DAMAGECOUNT value on done: 81496.0 [2024-08-06 00:08:48,195][52659] Sum rewards: 53.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon4': '0.096', 'weapon5': '0.130', 'AMMO4': '0.143', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '3.160', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '47.000'} [2024-08-06 00:08:49,596][52820] DAMAGECOUNT value on done: 73366.0 [2024-08-06 00:08:49,598][52820] Sum rewards: 54.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.212', 'ARMOR': '0.013', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.108', 'weapon4': '0.148', 'AMMO4': '0.206', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '2.862', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '48.000'} [2024-08-06 00:08:50,157][52662] DAMAGECOUNT value on done: 85943.0 [2024-08-06 00:08:50,167][52662] Sum rewards: 43.782, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.654', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.055', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'AMMO4': '0.277', 'weapon2': '0.348', 'weapon4': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '2.818', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:50,641][52659] DAMAGECOUNT value on done: 84453.0 [2024-08-06 00:08:50,641][52659] Sum rewards: 47.906, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.294', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.084', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon4': '0.310', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '42.500'} [2024-08-06 00:08:50,759][52803] Large shaping reward 3.261 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.21, 70.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:08:51,154][52668] DAMAGECOUNT value on done: 81115.0 [2024-08-06 00:08:51,154][52668] Sum rewards: 51.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.232', 'WEAPON4': '0.400', 'weapon2': '0.490', 'weapon4': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.501', 'FRAGCOUNT': '45.000'} [2024-08-06 00:08:51,229][52647] DAMAGECOUNT value on done: 89827.0 [2024-08-06 00:08:51,229][52647] Sum rewards: 47.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.008', 'weapon5': '0.030', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'weapon2': '0.344', 'WEAPON3': '1.000', 'HITCOUNT': '2.500', 'weapon3': '3.420', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '40.000'} [2024-08-06 00:08:51,578][52650] Updated weights for policy 0, policy_version 20401 (0.0019) [2024-08-06 00:08:52,640][52820] DAMAGECOUNT value on done: 75036.0 [2024-08-06 00:08:52,641][52820] Sum rewards: 47.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.013', 'ARMOR': '0.030', 'AMMO2': '0.040', 'weapon5': '0.042', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'weapon4': '0.364', 'WEAPON4': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.868', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:52,710][52662] DAMAGECOUNT value on done: 90619.0 [2024-08-06 00:08:52,711][52662] Sum rewards: 44.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.140', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'weapon5': '0.180', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.510', 'weapon4': '0.698', 'WEAPON3': '0.800', 'weapon3': '2.332', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.199', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 167133184. Throughput: 0: 4378.9. Samples: 41788440. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:08:52,795][52567] Avg episode reward: [(0, '49.959')] [2024-08-06 00:08:53,370][52647] DAMAGECOUNT value on done: 85237.0 [2024-08-06 00:08:53,371][52647] Sum rewards: 43.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.019', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.169', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.358', 'WEAPON4': '0.500', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.682', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '36.000'} [2024-08-06 00:08:54,030][52659] DAMAGECOUNT value on done: 84264.0 [2024-08-06 00:08:54,030][52659] Sum rewards: 47.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.162', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'weapon4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.886', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '41.000'} [2024-08-06 00:08:54,250][52668] DAMAGECOUNT value on done: 86421.0 [2024-08-06 00:08:54,252][52668] Sum rewards: 60.090, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.516', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.378', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '52.000'} [2024-08-06 00:08:55,639][52662] DAMAGECOUNT value on done: 92074.0 [2024-08-06 00:08:55,640][52662] Sum rewards: 61.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.854', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.022', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.231', 'weapon4': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '54.000'} [2024-08-06 00:08:55,786][52820] DAMAGECOUNT value on done: 78435.0 [2024-08-06 00:08:55,787][52820] Sum rewards: 53.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.148', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.654', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.802', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '45.000'} [2024-08-06 00:08:55,878][52647] DAMAGECOUNT value on done: 83518.0 [2024-08-06 00:08:55,879][52647] Sum rewards: 37.473, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.502', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.196', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.706', 'WEAPON3': '1.300', 'weapon3': '2.512', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '34.500'} [2024-08-06 00:08:56,571][52650] Updated weights for policy 0, policy_version 20411 (0.0013) [2024-08-06 00:08:57,020][52794] DAMAGECOUNT value on done: 89902.0 [2024-08-06 00:08:57,022][52794] Sum rewards: 38.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.974', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.169', 'AMMO4': '0.251', 'weapon5': '0.288', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON4': '0.650', 'weapon2': '0.678', 'WEAPON3': '1.000', 'weapon3': '2.328', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.949', 'FRAGCOUNT': '33.000'} [2024-08-06 00:08:57,536][52668] DAMAGECOUNT value on done: 79642.0 [2024-08-06 00:08:57,536][52668] Sum rewards: 56.487, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.784', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.778', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '50.000'} [2024-08-06 00:08:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 167231488. Throughput: 0: 4392.9. Samples: 41814920. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:08:57,795][52567] Avg episode reward: [(0, '49.673')] [2024-08-06 00:08:58,063][52649] DAMAGECOUNT value on done: 80912.0 [2024-08-06 00:08:58,065][52649] Sum rewards: 48.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon4': '0.206', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.220', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '42.000'} [2024-08-06 00:08:58,224][52662] DAMAGECOUNT value on done: 82484.0 [2024-08-06 00:08:58,225][52662] Sum rewards: 39.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.070', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.620', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '2.980', 'DAMAGECOUNT': '10.968', 'FRAGCOUNT': '36.000'} [2024-08-06 00:08:58,782][52795] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:08:58,818][52647] DAMAGECOUNT value on done: 83704.0 [2024-08-06 00:08:58,822][52647] Sum rewards: 62.506, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.070', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '51.000'} [2024-08-06 00:08:58,862][52820] DAMAGECOUNT value on done: 76541.0 [2024-08-06 00:08:58,865][52820] Sum rewards: 44.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.238', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon2': '0.342', 'weapon4': '0.368', 'WEAPON3': '0.800', 'HITCOUNT': '2.300', 'weapon3': '3.030', 'DAMAGECOUNT': '10.698', 'FRAGCOUNT': '38.000'} [2024-08-06 00:08:59,641][52794] DAMAGECOUNT value on done: 88121.0 [2024-08-06 00:08:59,641][52794] Sum rewards: 53.066, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.505', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.218', 'AMMO4': '0.225', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon4': '0.396', 'weapon2': '0.456', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.618', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:00,323][52668] DAMAGECOUNT value on done: 82196.0 [2024-08-06 00:09:00,323][52668] Sum rewards: 52.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON5': '0.050', 'AMMO3': '0.247', 'weapon2': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.272', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:00,539][52649] DAMAGECOUNT value on done: 80186.0 [2024-08-06 00:09:00,540][52649] Sum rewards: 48.015, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.844', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.038', 'AMMO2': '0.049', 'WEAPON5': '0.200', 'AMMO4': '0.243', 'AMMO3': '0.255', 'weapon4': '0.338', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.690', 'weapon3': '2.922', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:00,957][52650] Updated weights for policy 0, policy_version 20421 (0.0010) [2024-08-06 00:09:01,130][52662] DAMAGECOUNT value on done: 86423.0 [2024-08-06 00:09:01,132][52662] Sum rewards: 50.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.338', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.054', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:01,517][52647] DAMAGECOUNT value on done: 83295.0 [2024-08-06 00:09:01,517][52647] Sum rewards: 52.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.038', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.238', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:02,039][52820] DAMAGECOUNT value on done: 74186.0 [2024-08-06 00:09:02,039][52820] Sum rewards: 42.206, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.960', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.060', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon2': '0.318', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.760', 'weapon3': '3.006', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '39.000'} [2024-08-06 00:09:02,555][52794] DAMAGECOUNT value on done: 84940.0 [2024-08-06 00:09:02,558][52794] Sum rewards: 47.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.474', 'AMMO5': '0.003', 'AMMO2': '0.005', 'ARMOR': '0.012', 'AMMO4': '0.026', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.300', 'weapon4': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '3.022', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:02,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 167321600. Throughput: 0: 4396.9. Samples: 41828370. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:09:02,795][52567] Avg episode reward: [(0, '49.544')] [2024-08-06 00:09:02,841][52660] DAMAGECOUNT value on done: 80775.0 [2024-08-06 00:09:02,842][52660] Sum rewards: 43.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.133', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.097', 'weapon4': '0.116', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.608', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '3.070', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '37.000'} [2024-08-06 00:09:03,207][52668] DAMAGECOUNT value on done: 83104.0 [2024-08-06 00:09:03,209][52668] Sum rewards: 46.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon4': '0.244', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.600', 'HITCOUNT': '2.720', 'weapon3': '3.014', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:03,620][52649] DAMAGECOUNT value on done: 82751.0 [2024-08-06 00:09:03,622][52649] Sum rewards: 58.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.666', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.219', 'weapon2': '0.386', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.334', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '49.000'} [2024-08-06 00:09:03,963][52662] DAMAGECOUNT value on done: 87170.0 [2024-08-06 00:09:03,964][52662] Sum rewards: 54.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.068', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon5': '0.112', 'AMMO3': '0.204', 'weapon2': '0.478', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.180', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:04,569][52647] DAMAGECOUNT value on done: 85375.0 [2024-08-06 00:09:04,569][52647] Sum rewards: 44.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.665', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.093', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.516', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.932', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:05,048][52820] DAMAGECOUNT value on done: 76204.0 [2024-08-06 00:09:05,049][52820] Sum rewards: 57.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.573', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.370', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.334', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '50.000'} [2024-08-06 00:09:05,339][52660] DAMAGECOUNT value on done: 84574.0 [2024-08-06 00:09:05,340][52660] Sum rewards: 41.094, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.046', 'HEALTH': '0.065', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'weapon2': '0.516', 'weapon4': '0.610', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '2.620', 'DAMAGECOUNT': '10.455', 'FRAGCOUNT': '36.500'} [2024-08-06 00:09:05,382][52794] DAMAGECOUNT value on done: 83690.0 [2024-08-06 00:09:05,385][52794] Sum rewards: 55.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.181', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.416', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:05,635][52668] DAMAGECOUNT value on done: 82502.0 [2024-08-06 00:09:05,639][52668] Sum rewards: 52.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.482', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.036', 'ARMOR': '0.048', 'weapon5': '0.074', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.412', 'WEAPON3': '1.550', 'HITCOUNT': '2.670', 'weapon3': '3.232', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:05,711][52650] Updated weights for policy 0, policy_version 20431 (0.0012) [2024-08-06 00:09:06,759][52649] DAMAGECOUNT value on done: 82965.0 [2024-08-06 00:09:06,760][52649] Sum rewards: 43.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.357', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.046', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.378', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.370', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:06,916][52662] DAMAGECOUNT value on done: 89347.0 [2024-08-06 00:09:06,916][52662] Sum rewards: 65.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.479', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.152', 'weapon4': '0.212', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '55.000'} [2024-08-06 00:09:07,009][52647] DAMAGECOUNT value on done: 86066.0 [2024-08-06 00:09:07,009][52647] Sum rewards: 49.823, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.615', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon4': '0.492', 'weapon2': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.542', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 167403520. Throughput: 0: 4405.6. Samples: 41854760. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:09:07,794][52567] Avg episode reward: [(0, '49.466')] [2024-08-06 00:09:08,143][52820] DAMAGECOUNT value on done: 80103.0 [2024-08-06 00:09:08,144][52820] Sum rewards: 49.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.680', 'AMMO5': '0.010', 'weapon5': '0.040', 'AMMO2': '0.040', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.263', 'weapon2': '0.366', 'weapon4': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.916', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '44.000'} [2024-08-06 00:09:08,460][52660] DAMAGECOUNT value on done: 82948.0 [2024-08-06 00:09:08,464][52660] Sum rewards: 45.757, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.596', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.134', 'AMMO3': '0.169', 'AMMO4': '0.232', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON4': '0.650', 'weapon4': '0.736', 'WEAPON3': '1.050', 'weapon3': '2.392', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:08,491][52794] DAMAGECOUNT value on done: 85248.0 [2024-08-06 00:09:08,491][52794] Sum rewards: 48.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.176', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON4': '0.450', 'weapon4': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.682', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:08,814][52668] DAMAGECOUNT value on done: 84541.0 [2024-08-06 00:09:08,815][52668] Sum rewards: 58.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.609', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'weapon4': '0.154', 'AMMO3': '0.201', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '50.000'} [2024-08-06 00:09:09,452][52647] DAMAGECOUNT value on done: 86893.0 [2024-08-06 00:09:09,452][52647] Sum rewards: 49.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'ARMOR': '0.032', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.206', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:09,929][52649] DAMAGECOUNT value on done: 78029.0 [2024-08-06 00:09:09,931][52649] Sum rewards: 38.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.905', 'AMMO5': '0.003', 'AMMO2': '0.046', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'weapon4': '0.638', 'weapon2': '0.736', 'WEAPON3': '1.350', 'HITCOUNT': '2.290', 'weapon3': '2.394', 'DAMAGECOUNT': '10.098', 'FRAGCOUNT': '35.000'} [2024-08-06 00:09:09,948][52803] DAMAGECOUNT value on done: 81082.0 [2024-08-06 00:09:09,948][52803] Sum rewards: 56.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.112', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon4': '0.232', 'WEAPON4': '0.400', 'weapon2': '0.558', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '2.854', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:10,146][52662] DAMAGECOUNT value on done: 92169.0 [2024-08-06 00:09:10,146][52662] Sum rewards: 33.213, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.358', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.137', 'weapon5': '0.144', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.950', 'weapon3': '2.152', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '8.988', 'FRAGCOUNT': '29.500'} [2024-08-06 00:09:10,393][52650] Updated weights for policy 0, policy_version 20441 (0.0016) [2024-08-06 00:09:10,618][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:09:11,379][52820] DAMAGECOUNT value on done: 75512.0 [2024-08-06 00:09:11,380][52820] Sum rewards: 43.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.292', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.086', 'weapon4': '0.096', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.320', 'WEAPON3': '1.700', 'HITCOUNT': '2.910', 'weapon3': '3.302', 'DAMAGECOUNT': '12.429', 'FRAGCOUNT': '39.000'} [2024-08-06 00:09:11,527][52794] DAMAGECOUNT value on done: 88407.0 [2024-08-06 00:09:11,527][52794] Sum rewards: 48.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.484', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.018', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '41.500'} [2024-08-06 00:09:11,628][52660] DAMAGECOUNT value on done: 82925.0 [2024-08-06 00:09:11,628][52660] Sum rewards: 42.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.739', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '3.038', 'DAMAGECOUNT': '11.235', 'FRAGCOUNT': '38.500'} [2024-08-06 00:09:11,977][52668] DAMAGECOUNT value on done: 85392.0 [2024-08-06 00:09:11,977][52668] Sum rewards: 49.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.385', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.178', 'WEAPON4': '0.400', 'weapon2': '0.484', 'weapon4': '0.496', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '2.794', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:12,279][52647] DAMAGECOUNT value on done: 83451.0 [2024-08-06 00:09:12,279][52647] Sum rewards: 45.724, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.070', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.269', 'AMMO3': '0.273', 'weapon4': '0.354', 'weapon2': '0.480', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'HITCOUNT': '2.790', 'weapon3': '2.866', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 167493632. Throughput: 0: 4403.8. Samples: 41881100. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:09:12,794][52567] Avg episode reward: [(0, '48.946')] [2024-08-06 00:09:12,905][52662] DAMAGECOUNT value on done: 84337.0 [2024-08-06 00:09:12,908][52662] Sum rewards: 53.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.024', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.100', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:12,943][52649] DAMAGECOUNT value on done: 79445.0 [2024-08-06 00:09:12,944][52649] Sum rewards: 45.947, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.974', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon2': '0.276', 'WEAPON3': '1.650', 'HITCOUNT': '3.280', 'weapon3': '3.308', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:13,185][52803] DAMAGECOUNT value on done: 81702.0 [2024-08-06 00:09:13,186][52803] Sum rewards: 49.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.163', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:14,099][52794] DAMAGECOUNT value on done: 89218.0 [2024-08-06 00:09:14,101][52794] Sum rewards: 55.166, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.153', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.056', 'weapon3': '2.372', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '44.000'} [2024-08-06 00:09:14,312][52811] DAMAGECOUNT value on done: 81492.0 [2024-08-06 00:09:14,312][52811] Sum rewards: 59.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.038', 'weapon4': '0.056', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.206', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '52.000'} [2024-08-06 00:09:14,336][52820] DAMAGECOUNT value on done: 76506.0 [2024-08-06 00:09:14,338][52820] Sum rewards: 55.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.158', 'weapon2': '0.798', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '3.080', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:14,402][52660] DAMAGECOUNT value on done: 79192.0 [2024-08-06 00:09:14,402][52660] Sum rewards: 43.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO2': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.286', 'weapon2': '0.420', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '3.114', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '39.000'} [2024-08-06 00:09:14,662][52668] DAMAGECOUNT value on done: 84184.0 [2024-08-06 00:09:14,664][52668] Sum rewards: 57.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.724', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.208', 'weapon4': '0.270', 'weapon2': '0.368', 'ARMOR': '0.408', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '2.976', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '49.000'} [2024-08-06 00:09:15,053][52650] Updated weights for policy 0, policy_version 20451 (0.0012) [2024-08-06 00:09:15,297][52647] DAMAGECOUNT value on done: 85481.0 [2024-08-06 00:09:15,297][52647] Sum rewards: 53.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.536', 'AMMO5': '0.009', 'ARMOR': '0.009', 'AMMO2': '0.033', 'weapon5': '0.042', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.626', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.962', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:15,599][52662] DAMAGECOUNT value on done: 89022.0 [2024-08-06 00:09:15,599][52662] Sum rewards: 62.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.705', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.378', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.738', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '50.000'} [2024-08-06 00:09:15,725][52649] DAMAGECOUNT value on done: 77737.0 [2024-08-06 00:09:15,726][52649] Sum rewards: 53.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.502', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.730', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:16,265][52803] DAMAGECOUNT value on done: 78326.0 [2024-08-06 00:09:16,265][52803] Sum rewards: 62.444, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.084', 'WEAPON4': '0.150', 'weapon2': '0.238', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.450', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '56.000'} [2024-08-06 00:09:17,022][52794] DAMAGECOUNT value on done: 85372.0 [2024-08-06 00:09:17,030][52794] Sum rewards: 42.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.708', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.130', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.480', 'WEAPON4': '0.600', 'weapon4': '0.804', 'WEAPON3': '1.050', 'weapon3': '2.254', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:17,161][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:09:17,442][52811] DAMAGECOUNT value on done: 74269.0 [2024-08-06 00:09:17,444][52811] Sum rewards: 55.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.082', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO4': '0.102', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.762', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '2.916', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:17,462][52820] DAMAGECOUNT value on done: 81885.0 [2024-08-06 00:09:17,463][52820] Sum rewards: 64.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.697', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.262', 'weapon2': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.468', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '56.000'} [2024-08-06 00:09:17,464][52660] DAMAGECOUNT value on done: 81841.0 [2024-08-06 00:09:17,466][52660] Sum rewards: 44.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.928', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.046', 'AMMO4': '0.168', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.544', 'weapon4': '0.584', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.626', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:17,786][52668] DAMAGECOUNT value on done: 85348.0 [2024-08-06 00:09:17,788][52668] Sum rewards: 47.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.480', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 167583744. Throughput: 0: 4411.1. Samples: 41894460. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:09:17,794][52567] Avg episode reward: [(0, '50.032')] [2024-08-06 00:09:18,292][52647] DAMAGECOUNT value on done: 84203.0 [2024-08-06 00:09:18,293][52649] DAMAGECOUNT value on done: 83119.0 [2024-08-06 00:09:18,294][52649] Sum rewards: 40.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.027', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.065', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.323', 'weapon2': '0.510', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.320', 'weapon3': '2.544', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '35.000'} [2024-08-06 00:09:18,295][52647] Sum rewards: 53.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.256', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.241', 'weapon2': '0.486', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.130', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:18,634][52662] DAMAGECOUNT value on done: 86259.0 [2024-08-06 00:09:18,635][52662] Sum rewards: 48.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.006', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.434', 'weapon4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.920', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:19,256][52803] DAMAGECOUNT value on done: 77772.0 [2024-08-06 00:09:19,258][52803] Sum rewards: 43.453, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.408', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.226', 'AMMO3': '0.297', 'weapon4': '0.300', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '2.860', 'weapon3': '2.862', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:19,692][52650] Updated weights for policy 0, policy_version 20461 (0.0023) [2024-08-06 00:09:19,993][52660] DAMAGECOUNT value on done: 84183.0 [2024-08-06 00:09:19,993][52660] Sum rewards: 42.806, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.002', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.256', 'AMMO3': '0.301', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.800', 'HITCOUNT': '2.700', 'weapon3': '3.024', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:20,084][52794] DAMAGECOUNT value on done: 87501.0 [2024-08-06 00:09:20,085][52794] Sum rewards: 48.694, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.835', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.132', 'WEAPON3': '0.850', 'weapon2': '1.026', 'weapon3': '2.796', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '39.000'} [2024-08-06 00:09:20,142][52668] DAMAGECOUNT value on done: 80835.0 [2024-08-06 00:09:20,144][52668] Sum rewards: 47.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.317', 'AMMO5': '0.011', 'ARMOR': '0.036', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.168', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.600', 'weapon2': '0.630', 'weapon4': '0.832', 'WEAPON3': '1.100', 'weapon3': '2.262', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:20,519][52811] DAMAGECOUNT value on done: 77774.0 [2024-08-06 00:09:20,522][52811] Sum rewards: 57.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.069', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.434', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.130', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:20,579][52820] DAMAGECOUNT value on done: 80303.0 [2024-08-06 00:09:20,580][52820] Sum rewards: 61.217, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.135', 'weapon2': '0.930', 'WEAPON3': '0.950', 'weapon3': '2.842', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '49.000'} [2024-08-06 00:09:21,422][52647] DAMAGECOUNT value on done: 85022.0 [2024-08-06 00:09:21,422][52647] Sum rewards: 50.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.058', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.610', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.092', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:21,440][52649] DAMAGECOUNT value on done: 78355.0 [2024-08-06 00:09:21,441][52649] Sum rewards: 45.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.436', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.188', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:21,721][52662] DAMAGECOUNT value on done: 90823.0 [2024-08-06 00:09:21,722][52662] Sum rewards: 57.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.924', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.606', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:22,205][52803] DAMAGECOUNT value on done: 80570.0 [2024-08-06 00:09:22,205][52803] Sum rewards: 51.799, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.262', 'AMMO5': '0.004', 'ARMOR': '0.012', 'weapon5': '0.032', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon4': '0.192', 'AMMO4': '0.193', 'AMMO3': '0.235', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.240', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17613.0, 300 sec: 17578.1). Total num frames: 167665664. Throughput: 0: 4411.1. Samples: 41920820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:09:22,794][52567] Avg episode reward: [(0, '50.443')] [2024-08-06 00:09:22,982][52794] DAMAGECOUNT value on done: 90080.0 [2024-08-06 00:09:22,982][52794] Sum rewards: 44.547, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.049', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.126', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'AMMO3': '0.300', 'weapon4': '0.308', 'weapon2': '0.530', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.770', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.973', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:23,077][52660] DAMAGECOUNT value on done: 82826.0 [2024-08-06 00:09:23,079][52660] Sum rewards: 59.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.730', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:23,228][52668] DAMAGECOUNT value on done: 81849.0 [2024-08-06 00:09:23,230][52668] Sum rewards: 40.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.358', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.076', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.258', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.000', 'HITCOUNT': '2.500', 'weapon3': '2.926', 'DAMAGECOUNT': '11.193', 'FRAGCOUNT': '36.000'} [2024-08-06 00:09:23,419][52811] DAMAGECOUNT value on done: 78497.0 [2024-08-06 00:09:23,420][52811] Sum rewards: 57.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.089', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.344', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '51.000'} [2024-08-06 00:09:23,859][52820] DAMAGECOUNT value on done: 77885.0 [2024-08-06 00:09:23,860][52820] Sum rewards: 53.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.478', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:24,383][52650] Updated weights for policy 0, policy_version 20471 (0.0023) [2024-08-06 00:09:24,678][52649] DAMAGECOUNT value on done: 79071.0 [2024-08-06 00:09:24,679][52649] Sum rewards: 46.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.160', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.228', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:24,704][52662] DAMAGECOUNT value on done: 87816.0 [2024-08-06 00:09:24,706][52662] Sum rewards: 41.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.192', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.265', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.862', 'DAMAGECOUNT': '10.641', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:25,214][52803] DAMAGECOUNT value on done: 77994.0 [2024-08-06 00:09:25,216][52803] Sum rewards: 54.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.848', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.220', 'AMMO3': '0.226', 'weapon4': '0.258', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.308', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:25,834][52669] DAMAGECOUNT value on done: 85335.0 [2024-08-06 00:09:25,834][52669] Sum rewards: 42.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.994', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.418', 'weapon4': '0.674', 'WEAPON3': '1.300', 'weapon3': '2.650', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '37.000'} [2024-08-06 00:09:25,924][52794] DAMAGECOUNT value on done: 85577.0 [2024-08-06 00:09:25,925][52794] Sum rewards: 43.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.764', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO3': '0.104', 'weapon5': '0.154', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.664', 'weapon4': '0.686', 'WEAPON3': '0.700', 'weapon3': '2.260', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.251', 'FRAGCOUNT': '34.000'} [2024-08-06 00:09:25,957][52660] DAMAGECOUNT value on done: 83649.0 [2024-08-06 00:09:25,958][52660] Sum rewards: 47.177, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.045', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.058', 'AMMO4': '0.125', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.230', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:26,100][52668] DAMAGECOUNT value on done: 77507.0 [2024-08-06 00:09:26,102][52668] Sum rewards: 41.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.214', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.032', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.476', 'weapon2': '0.514', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '2.754', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '37.000'} [2024-08-06 00:09:26,550][52811] DAMAGECOUNT value on done: 76429.0 [2024-08-06 00:09:26,552][52811] Sum rewards: 50.021, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.046', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.438', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.780', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:27,424][52662] DAMAGECOUNT value on done: 86078.0 [2024-08-06 00:09:27,427][52662] Sum rewards: 39.786, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-5.593', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon5': '0.110', 'AMMO4': '0.247', 'AMMO3': '0.265', 'weapon2': '0.414', 'WEAPON5': '0.450', 'weapon4': '0.668', 'WEAPON4': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.546', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:27,780][52649] DAMAGECOUNT value on done: 81288.0 [2024-08-06 00:09:27,780][52649] Sum rewards: 52.986, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.010', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.284', 'weapon2': '0.412', 'WEAPON3': '1.600', 'HITCOUNT': '2.970', 'weapon3': '3.234', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:27,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 167755776. Throughput: 0: 4403.8. Samples: 41946980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:09:27,795][52567] Avg episode reward: [(0, '49.782')] [2024-08-06 00:09:28,157][52669] DAMAGECOUNT value on done: 83518.0 [2024-08-06 00:09:28,157][52669] Sum rewards: 49.420, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.247', 'AMMO2': '0.011', 'weapon7': '0.056', 'AMMO4': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon4': '0.388', 'weapon2': '0.414', 'ARMOR': '0.485', 'WEAPON3': '1.550', 'weapon3': '2.846', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:28,446][52803] DAMAGECOUNT value on done: 81542.0 [2024-08-06 00:09:28,446][52803] Sum rewards: 63.868, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.770', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '52.000'} [2024-08-06 00:09:28,816][52650] Updated weights for policy 0, policy_version 20481 (0.0025) [2024-08-06 00:09:29,014][52794] DAMAGECOUNT value on done: 89316.0 [2024-08-06 00:09:29,016][52794] Sum rewards: 52.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO4': '0.148', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '2.770', 'weapon3': '2.990', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:29,017][52660] DAMAGECOUNT value on done: 82853.0 [2024-08-06 00:09:29,019][52660] Sum rewards: 46.992, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.484', 'ARMOR': '0.004', 'AMMO2': '0.038', 'AMMO4': '0.188', 'AMMO3': '0.260', 'weapon2': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.500', 'weapon3': '2.846', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:29,086][52668] DAMAGECOUNT value on done: 84294.0 [2024-08-06 00:09:29,088][52668] Sum rewards: 54.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.175', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.474', 'weapon4': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.572', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:29,636][52811] DAMAGECOUNT value on done: 80283.0 [2024-08-06 00:09:29,636][52811] Sum rewards: 50.354, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.826', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.236', 'AMMO4': '0.249', 'weapon2': '0.488', 'weapon4': '0.504', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '46.500'} [2024-08-06 00:09:30,578][52662] DAMAGECOUNT value on done: 85770.0 [2024-08-06 00:09:30,579][52662] Sum rewards: 42.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.621', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.183', 'weapon5': '0.232', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'weapon4': '0.462', 'weapon2': '0.530', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.446', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.373', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:30,748][52649] DAMAGECOUNT value on done: 80013.0 [2024-08-06 00:09:30,749][52649] Sum rewards: 43.547, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.201', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.150', 'AMMO3': '0.182', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.478', 'weapon2': '0.514', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.582', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '36.000'} [2024-08-06 00:09:31,164][52669] DAMAGECOUNT value on done: 83845.0 [2024-08-06 00:09:31,164][52669] Sum rewards: 46.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.121', 'weapon4': '0.148', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '3.228', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:31,351][52660] DAMAGECOUNT value on done: 82546.0 [2024-08-06 00:09:31,352][52660] Sum rewards: 45.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.755', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon4': '0.156', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.268', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '39.000'} [2024-08-06 00:09:31,404][52668] DAMAGECOUNT value on done: 82677.0 [2024-08-06 00:09:31,404][52668] Sum rewards: 46.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.042', 'AMMO4': '0.154', 'weapon4': '0.194', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.450', 'HITCOUNT': '2.600', 'weapon3': '3.082', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '44.000'} [2024-08-06 00:09:31,642][52794] DAMAGECOUNT value on done: 87310.0 [2024-08-06 00:09:31,642][52794] Sum rewards: 47.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.356', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.044', 'AMMO4': '0.220', 'weapon5': '0.228', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.752', 'WEAPON3': '1.300', 'weapon3': '2.382', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:31,769][52667] DAMAGECOUNT value on done: 83910.0 [2024-08-06 00:09:31,769][52667] Sum rewards: 46.647, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon4': '0.282', 'weapon2': '0.418', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '2.924', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:31,786][52803] DAMAGECOUNT value on done: 77542.0 [2024-08-06 00:09:31,786][52803] Sum rewards: 56.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.176', 'AMMO4': '0.177', 'weapon5': '0.180', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.570', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:32,740][52811] DAMAGECOUNT value on done: 78435.0 [2024-08-06 00:09:32,742][52811] Sum rewards: 40.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.454', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'AMMO3': '0.296', 'weapon2': '0.390', 'weapon4': '0.700', 'WEAPON3': '1.700', 'HITCOUNT': '2.560', 'weapon3': '2.672', 'DAMAGECOUNT': '10.437', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 167845888. Throughput: 0: 4412.4. Samples: 41960450. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:09:32,795][52567] Avg episode reward: [(0, '49.720')] [2024-08-06 00:09:33,352][52662] DAMAGECOUNT value on done: 90979.0 [2024-08-06 00:09:33,353][52662] Sum rewards: 56.549, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.234', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.006', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'AMMO3': '0.303', 'weapon2': '0.346', 'WEAPON3': '1.800', 'HITCOUNT': '3.250', 'weapon3': '3.430', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '52.000'} [2024-08-06 00:09:33,789][52669] DAMAGECOUNT value on done: 81922.0 [2024-08-06 00:09:33,790][52669] Sum rewards: 39.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.048', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '2.360', 'weapon3': '3.408', 'DAMAGECOUNT': '10.545', 'FRAGCOUNT': '35.000'} [2024-08-06 00:09:33,858][52650] Updated weights for policy 0, policy_version 20491 (0.0013) [2024-08-06 00:09:33,907][52649] DAMAGECOUNT value on done: 83962.0 [2024-08-06 00:09:33,907][52649] Sum rewards: 55.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.010', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.016', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'AMMO3': '0.128', 'AMMO4': '0.204', 'weapon4': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.686', 'WEAPON3': '0.800', 'weapon3': '2.900', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '44.500'} [2024-08-06 00:09:34,484][52660] DAMAGECOUNT value on done: 80720.0 [2024-08-06 00:09:34,485][52660] Sum rewards: 44.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.677', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.820', 'WEAPON3': '1.000', 'weapon3': '2.498', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '37.000'} [2024-08-06 00:09:34,549][52668] DAMAGECOUNT value on done: 84325.0 [2024-08-06 00:09:34,550][52668] Sum rewards: 49.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.166', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.698', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '2.920', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '44.000'} [2024-08-06 00:09:34,644][52794] DAMAGECOUNT value on done: 93710.0 [2024-08-06 00:09:34,645][52794] Sum rewards: 52.070, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.534', 'AMMO5': '0.014', 'ARMOR': '0.032', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO4': '0.179', 'AMMO3': '0.217', 'weapon4': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '46.500'} [2024-08-06 00:09:34,751][52667] DAMAGECOUNT value on done: 87016.0 [2024-08-06 00:09:34,752][52667] Sum rewards: 52.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.227', 'weapon4': '0.240', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '2.946', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:34,796][52803] DAMAGECOUNT value on done: 77935.0 [2024-08-06 00:09:34,796][52803] Sum rewards: 38.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO4': '0.149', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.050', 'HITCOUNT': '2.420', 'weapon3': '2.954', 'DAMAGECOUNT': '10.008', 'FRAGCOUNT': '34.000'} [2024-08-06 00:09:35,754][52811] DAMAGECOUNT value on done: 77022.0 [2024-08-06 00:09:35,755][52811] Sum rewards: 45.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.162', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.958', 'WEAPON3': '1.050', 'weapon3': '2.518', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '11.229', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:35,992][52662] DAMAGECOUNT value on done: 84275.0 [2024-08-06 00:09:35,993][52662] Sum rewards: 57.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.678', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '50.500'} [2024-08-06 00:09:36,591][52649] DAMAGECOUNT value on done: 84110.0 [2024-08-06 00:09:36,593][52649] Sum rewards: 62.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.229', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.880', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '51.000'} [2024-08-06 00:09:36,855][52669] DAMAGECOUNT value on done: 84854.0 [2024-08-06 00:09:36,855][52669] Sum rewards: 40.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO4': '0.143', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.150', 'HITCOUNT': '2.270', 'weapon3': '3.028', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '36.000'} [2024-08-06 00:09:37,315][52794] DAMAGECOUNT value on done: 83239.0 [2024-08-06 00:09:37,315][52794] Sum rewards: 54.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.341', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.848', 'WEAPON3': '1.000', 'weapon3': '2.612', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:37,585][52667] DAMAGECOUNT value on done: 84369.0 [2024-08-06 00:09:37,587][52667] Sum rewards: 56.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.778', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.033', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon2': '0.330', 'weapon4': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:37,638][52660] DAMAGECOUNT value on done: 81556.0 [2024-08-06 00:09:37,638][52660] Sum rewards: 40.858, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.466', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'AMMO4': '0.206', 'weapon2': '0.346', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.942', 'DAMAGECOUNT': '11.286', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:37,693][52668] DAMAGECOUNT value on done: 81925.0 [2024-08-06 00:09:37,693][52668] Sum rewards: 54.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.372', 'AMMO5': '0.007', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.163', 'AMMO4': '0.167', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '2.854', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '45.500'} [2024-08-06 00:09:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 167927808. Throughput: 0: 4408.9. Samples: 41986840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:09:37,794][52567] Avg episode reward: [(0, '49.809')] [2024-08-06 00:09:37,913][52803] DAMAGECOUNT value on done: 74997.0 [2024-08-06 00:09:37,914][52803] Sum rewards: 57.012, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.212', 'HEALTH': '0.328', 'weapon2': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.334', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:38,230][52650] Updated weights for policy 0, policy_version 20501 (0.0011) [2024-08-06 00:09:38,866][52811] DAMAGECOUNT value on done: 79547.0 [2024-08-06 00:09:38,866][52811] Sum rewards: 55.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO3': '0.170', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.982', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '47.000'} [2024-08-06 00:09:38,977][52662] DAMAGECOUNT value on done: 89659.0 [2024-08-06 00:09:38,977][52662] Sum rewards: 61.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.068', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon4': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon2': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.968', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '50.000'} [2024-08-06 00:09:39,089][52649] DAMAGECOUNT value on done: 76388.0 [2024-08-06 00:09:39,089][52649] Sum rewards: 55.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.721', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.172', 'weapon4': '0.192', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:39,642][52669] DAMAGECOUNT value on done: 85069.0 [2024-08-06 00:09:39,642][52669] Sum rewards: 46.942, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.057', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon4': '0.260', 'AMMO4': '0.287', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.550', 'weapon3': '2.896', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:40,471][52794] DAMAGECOUNT value on done: 89107.0 [2024-08-06 00:09:40,473][52794] Sum rewards: 48.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.277', 'weapon2': '0.452', 'weapon4': '0.476', 'WEAPON3': '1.750', 'weapon3': '2.820', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '44.000'} [2024-08-06 00:09:40,540][52667] DAMAGECOUNT value on done: 81927.0 [2024-08-06 00:09:40,541][52667] Sum rewards: 45.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.191', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.620', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:40,822][52668] DAMAGECOUNT value on done: 81080.0 [2024-08-06 00:09:40,824][52660] DAMAGECOUNT value on done: 83287.0 [2024-08-06 00:09:40,832][52660] Sum rewards: 61.128, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.789', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.378', 'weapon2': '0.654', 'WEAPON3': '0.800', 'weapon3': '2.886', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:40,831][52668] Sum rewards: 53.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.005', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.038', 'AMMO4': '0.114', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon2': '0.664', 'weapon4': '0.804', 'WEAPON3': '0.900', 'weapon3': '2.310', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '44.000'} [2024-08-06 00:09:40,904][52803] DAMAGECOUNT value on done: 80800.0 [2024-08-06 00:09:40,906][52803] Sum rewards: 52.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.712', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.944', 'WEAPON3': '1.200', 'weapon3': '2.394', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:41,651][52649] DAMAGECOUNT value on done: 84122.0 [2024-08-06 00:09:41,665][52649] Sum rewards: 39.466, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.876', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.118', 'AMMO3': '0.206', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.550', 'weapon4': '1.084', 'WEAPON3': '1.200', 'weapon3': '2.174', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '36.500'} [2024-08-06 00:09:41,937][52811] DAMAGECOUNT value on done: 78707.0 [2024-08-06 00:09:41,938][52811] Sum rewards: 60.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.349', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.145', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.380', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '52.000'} [2024-08-06 00:09:42,241][52662] DAMAGECOUNT value on done: 87660.0 [2024-08-06 00:09:42,241][52662] Sum rewards: 45.946, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.315', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.222', 'weapon2': '0.612', 'WEAPON3': '1.000', 'HITCOUNT': '2.310', 'weapon3': '2.976', 'DAMAGECOUNT': '10.707', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:42,563][52660] Large shaping reward -2.528 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.279, -93.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:09:42,570][52669] DAMAGECOUNT value on done: 84251.0 [2024-08-06 00:09:42,571][52669] Sum rewards: 50.914, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.786', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon4': '0.282', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:42,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.6, 300 sec: 17578.1). Total num frames: 168017920. Throughput: 0: 4408.9. Samples: 42013320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:09:42,795][52567] Avg episode reward: [(0, '50.027')] [2024-08-06 00:09:43,001][52650] Updated weights for policy 0, policy_version 20511 (0.0018) [2024-08-06 00:09:43,234][52660] DAMAGECOUNT value on done: 88318.0 [2024-08-06 00:09:43,235][52660] Sum rewards: 51.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.430', 'AMMO2': '0.004', 'AMMO5': '0.006', 'AMMO4': '0.019', 'weapon5': '0.046', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.196', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '43.500'} [2024-08-06 00:09:43,250][52668] DAMAGECOUNT value on done: 85686.0 [2024-08-06 00:09:43,250][52668] Sum rewards: 53.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.937', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.722', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:43,461][52667] DAMAGECOUNT value on done: 85845.0 [2024-08-06 00:09:43,462][52667] Sum rewards: 39.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.986', 'ARMOR': '0.024', 'AMMO2': '0.049', 'AMMO3': '0.160', 'AMMO4': '0.243', 'weapon2': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon4': '1.206', 'weapon3': '2.040', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '11.061', 'FRAGCOUNT': '35.000'} [2024-08-06 00:09:43,479][52794] DAMAGECOUNT value on done: 89812.0 [2024-08-06 00:09:43,480][52794] Sum rewards: 48.053, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'HEALTH': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.160', 'weapon2': '0.432', 'WEAPON3': '0.950', 'HITCOUNT': '2.430', 'weapon3': '3.158', 'DAMAGECOUNT': '10.953', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:43,958][52803] DAMAGECOUNT value on done: 80739.0 [2024-08-06 00:09:43,960][52803] Sum rewards: 50.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.286', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.324', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:44,543][52649] DAMAGECOUNT value on done: 80291.0 [2024-08-06 00:09:44,546][52649] Sum rewards: 44.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.846', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.170', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'weapon2': '0.298', 'weapon4': '0.390', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '37.500'} [2024-08-06 00:09:44,978][52811] DAMAGECOUNT value on done: 79395.0 [2024-08-06 00:09:44,978][52811] Sum rewards: 36.280, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.393', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.305', 'weapon2': '0.384', 'WEAPON3': '1.800', 'HITCOUNT': '2.540', 'weapon3': '3.326', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '37.000'} [2024-08-06 00:09:45,153][52662] DAMAGECOUNT value on done: 86845.0 [2024-08-06 00:09:45,155][52662] Sum rewards: 47.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.102', 'AMMO5': '0.007', 'ARMOR': '0.020', 'weapon5': '0.032', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.200', 'weapon2': '0.356', 'WEAPON4': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '2.978', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:45,630][52660] DAMAGECOUNT value on done: 82580.0 [2024-08-06 00:09:45,630][52660] Sum rewards: 50.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.032', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.388', 'weapon4': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:45,646][52668] DAMAGECOUNT value on done: 86343.0 [2024-08-06 00:09:45,647][52668] Sum rewards: 56.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.821', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.069', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '3.204', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:45,709][52669] DAMAGECOUNT value on done: 83054.0 [2024-08-06 00:09:45,710][52669] Sum rewards: 60.104, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.345', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.088', 'AMMO3': '0.149', 'weapon2': '0.818', 'WEAPON3': '0.900', 'weapon3': '2.902', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '48.000'} [2024-08-06 00:09:46,209][52667] DAMAGECOUNT value on done: 82328.0 [2024-08-06 00:09:46,220][52667] Sum rewards: 32.967, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.152', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.752', 'weapon2': '0.756', 'WEAPON3': '0.950', 'HITCOUNT': '2.030', 'weapon3': '2.106', 'DAMAGECOUNT': '9.186', 'FRAGCOUNT': '27.000'} [2024-08-06 00:09:46,546][52794] DAMAGECOUNT value on done: 88139.0 [2024-08-06 00:09:46,548][52794] Sum rewards: 39.958, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.303', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.058', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.250', 'AMMO3': '0.266', 'AMMO4': '0.291', 'weapon2': '0.522', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.520', 'weapon3': '2.754', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '39.500'} [2024-08-06 00:09:46,928][52803] DAMAGECOUNT value on done: 76933.0 [2024-08-06 00:09:46,929][52803] Sum rewards: 44.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.395', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.066', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.400', 'weapon4': '0.508', 'weapon2': '0.818', 'WEAPON3': '1.100', 'weapon3': '2.432', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '37.500'} [2024-08-06 00:09:47,349][52650] Updated weights for policy 0, policy_version 20521 (0.0012) [2024-08-06 00:09:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 168116224. Throughput: 0: 4405.6. Samples: 42026620. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:09:47,794][52567] Avg episode reward: [(0, '49.877')] [2024-08-06 00:09:47,797][52649] DAMAGECOUNT value on done: 84133.0 [2024-08-06 00:09:47,800][52649] Sum rewards: 41.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.340', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.050', 'AMMO3': '0.200', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '2.852', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:48,051][52811] DAMAGECOUNT value on done: 77522.0 [2024-08-06 00:09:48,051][52811] Sum rewards: 47.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.741', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.082', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:48,386][52660] DAMAGECOUNT value on done: 84362.0 [2024-08-06 00:09:48,390][52660] Sum rewards: 57.684, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon4': '0.084', 'AMMO3': '0.124', 'HEALTH': '0.130', 'WEAPON4': '0.150', 'WEAPON3': '0.750', 'weapon2': '0.838', 'HITCOUNT': '2.810', 'weapon3': '2.906', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:48,529][52669] DAMAGECOUNT value on done: 84082.0 [2024-08-06 00:09:48,530][52669] Sum rewards: 59.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.626', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.470', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.296', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '52.000'} [2024-08-06 00:09:49,283][52667] DAMAGECOUNT value on done: 84802.0 [2024-08-06 00:09:49,284][52667] Sum rewards: 36.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.618', 'weapon5': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.548', 'WEAPON3': '1.150', 'HITCOUNT': '2.450', 'weapon3': '3.124', 'DAMAGECOUNT': '9.627', 'FRAGCOUNT': '33.000'} [2024-08-06 00:09:49,577][52794] DAMAGECOUNT value on done: 92028.0 [2024-08-06 00:09:49,577][52794] Sum rewards: 41.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO3': '0.137', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.774', 'WEAPON3': '0.850', 'weapon3': '2.590', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '33.000'} [2024-08-06 00:09:50,099][52803] DAMAGECOUNT value on done: 78982.0 [2024-08-06 00:09:50,101][52803] Sum rewards: 48.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.995', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.048', 'AMMO3': '0.149', 'AMMO4': '0.155', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.956', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:50,948][52649] DAMAGECOUNT value on done: 83089.0 [2024-08-06 00:09:50,949][52649] Sum rewards: 60.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.050', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.766', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '52.000'} [2024-08-06 00:09:51,091][52811] DAMAGECOUNT value on done: 80686.0 [2024-08-06 00:09:51,095][52811] Sum rewards: 51.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.781', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.028', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.227', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:51,398][52660] DAMAGECOUNT value on done: 81223.0 [2024-08-06 00:09:51,410][52660] Sum rewards: 51.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.806', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.170', 'AMMO3': '0.180', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.024', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:51,784][52669] DAMAGECOUNT value on done: 81854.0 [2024-08-06 00:09:51,785][52669] Sum rewards: 47.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.178', 'AMMO3': '0.192', 'weapon4': '0.198', 'AMMO4': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '2.886', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '43.000'} [2024-08-06 00:09:52,325][52667] DAMAGECOUNT value on done: 86166.0 [2024-08-06 00:09:52,325][52667] Sum rewards: 59.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.164', 'AMMO3': '0.205', 'AMMO4': '0.217', 'weapon2': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '51.000'} [2024-08-06 00:09:52,385][52650] Updated weights for policy 0, policy_version 20531 (0.0033) [2024-08-06 00:09:52,457][52794] DAMAGECOUNT value on done: 88102.0 [2024-08-06 00:09:52,459][52794] Sum rewards: 59.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.615', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.208', 'weapon2': '0.296', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.276', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '51.000'} [2024-08-06 00:09:52,794][52567] Fps is (10 sec: 18023.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 168198144. Throughput: 0: 4411.1. Samples: 42053260. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:09:52,794][52567] Avg episode reward: [(0, '49.495')] [2024-08-06 00:09:53,103][52803] DAMAGECOUNT value on done: 77948.0 [2024-08-06 00:09:53,104][52803] Sum rewards: 45.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO2': '0.018', 'weapon4': '0.070', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.250', 'weapon2': '0.856', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '2.898', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '41.000'} [2024-08-06 00:09:53,992][52649] DAMAGECOUNT value on done: 87356.0 [2024-08-06 00:09:53,994][52649] Sum rewards: 45.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.634', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.112', 'AMMO3': '0.147', 'AMMO4': '0.163', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.580', 'WEAPON3': '0.950', 'weapon3': '2.754', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:54,195][52811] DAMAGECOUNT value on done: 78310.0 [2024-08-06 00:09:54,196][52811] Sum rewards: 45.751, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.184', 'weapon2': '0.392', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '3.242', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '38.000'} [2024-08-06 00:09:54,295][52660] DAMAGECOUNT value on done: 86707.0 [2024-08-06 00:09:54,297][52660] Sum rewards: 50.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.376', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.218', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:54,753][52669] DAMAGECOUNT value on done: 86748.0 [2024-08-06 00:09:54,753][52669] Sum rewards: 50.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.196', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.128', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:55,280][52667] DAMAGECOUNT value on done: 84579.0 [2024-08-06 00:09:55,282][52667] Sum rewards: 50.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.131', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'weapon4': '0.408', 'weapon2': '0.548', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.828', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '42.000'} [2024-08-06 00:09:56,283][52803] DAMAGECOUNT value on done: 75821.0 [2024-08-06 00:09:56,286][52803] Sum rewards: 60.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.085', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.132', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '50.000'} [2024-08-06 00:09:56,572][52650] Updated weights for policy 0, policy_version 20541 (0.0012) [2024-08-06 00:09:56,943][52660] DAMAGECOUNT value on done: 82398.0 [2024-08-06 00:09:56,943][52660] Sum rewards: 56.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.297', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.136', 'weapon5': '0.172', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.362', 'WEAPON4': '0.450', 'weapon2': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.560', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '45.000'} [2024-08-06 00:09:57,253][52811] DAMAGECOUNT value on done: 80651.0 [2024-08-06 00:09:57,256][52811] Sum rewards: 60.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.855', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.100', 'weapon5': '0.126', 'AMMO4': '0.126', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '53.000'} [2024-08-06 00:09:57,781][52669] DAMAGECOUNT value on done: 85406.0 [2024-08-06 00:09:57,781][52669] Sum rewards: 47.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.256', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.157', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.612', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '2.686', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '40.000'} [2024-08-06 00:09:57,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 168280064. Throughput: 0: 4414.2. Samples: 42079740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:09:57,794][52567] Avg episode reward: [(0, '49.724')] [2024-08-06 00:09:57,852][52667] DAMAGECOUNT value on done: 86894.0 [2024-08-06 00:09:57,853][52667] Sum rewards: 54.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.196', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.976', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '46.000'} [2024-08-06 00:09:58,284][52649] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:09:59,402][52803] DAMAGECOUNT value on done: 79010.0 [2024-08-06 00:09:59,405][52803] Sum rewards: 40.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.034', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.758', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.980', 'DAMAGECOUNT': '10.743', 'FRAGCOUNT': '35.000'} [2024-08-06 00:10:00,269][52811] DAMAGECOUNT value on done: 80287.0 [2024-08-06 00:10:00,271][52811] Sum rewards: 60.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon2': '0.410', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.358', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '52.000'} [2024-08-06 00:10:00,484][52667] DAMAGECOUNT value on done: 84143.0 [2024-08-06 00:10:00,487][52667] Sum rewards: 54.513, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.625', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.129', 'weapon4': '0.380', 'WEAPON4': '0.400', 'weapon2': '0.712', 'WEAPON3': '0.850', 'weapon3': '2.818', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '44.000'} [2024-08-06 00:10:00,682][52669] DAMAGECOUNT value on done: 82357.0 [2024-08-06 00:10:00,683][52669] Sum rewards: 42.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'weapon4': '0.512', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.658', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '38.000'} [2024-08-06 00:10:01,562][52650] Updated weights for policy 0, policy_version 20551 (0.0012) [2024-08-06 00:10:02,398][52803] DAMAGECOUNT value on done: 78475.0 [2024-08-06 00:10:02,409][52803] Sum rewards: 60.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.716', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.246', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 168386560. Throughput: 0: 4407.3. Samples: 42092790. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 00:10:02,794][52567] Avg episode reward: [(0, '49.837')] [2024-08-06 00:10:03,090][52667] DAMAGECOUNT value on done: 82813.0 [2024-08-06 00:10:03,091][52667] Sum rewards: 37.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.098', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.151', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.754', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '2.934', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '35.500'} [2024-08-06 00:10:03,291][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:10:03,622][52811] DAMAGECOUNT value on done: 79477.0 [2024-08-06 00:10:03,622][52811] Sum rewards: 59.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.346', 'weapon4': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.084', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:04,010][52669] DAMAGECOUNT value on done: 85785.0 [2024-08-06 00:10:04,011][52669] Sum rewards: 48.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.615', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.247', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '42.500'} [2024-08-06 00:10:04,538][52658] DAMAGECOUNT value on done: 86026.0 [2024-08-06 00:10:04,539][52658] Sum rewards: 44.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon4': '0.320', 'weapon2': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '2.410', 'weapon3': '3.128', 'DAMAGECOUNT': '10.935', 'FRAGCOUNT': '39.000'} [2024-08-06 00:10:05,341][52803] DAMAGECOUNT value on done: 82056.0 [2024-08-06 00:10:05,341][52803] Sum rewards: 49.566, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.559', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.142', 'AMMO3': '0.151', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '40.000'} [2024-08-06 00:10:05,736][52667] DAMAGECOUNT value on done: 84871.0 [2024-08-06 00:10:05,738][52667] Sum rewards: 53.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.191', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.430', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:06,010][52650] Updated weights for policy 0, policy_version 20561 (0.0026) [2024-08-06 00:10:06,713][52669] DAMAGECOUNT value on done: 89021.0 [2024-08-06 00:10:06,713][52669] Sum rewards: 60.884, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.013', 'AMMO2': '0.030', 'HEALTH': '0.040', 'weapon5': '0.116', 'AMMO4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '0.850', 'weapon3': '2.994', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:06,834][52811] DAMAGECOUNT value on done: 81195.0 [2024-08-06 00:10:06,836][52811] Sum rewards: 49.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.523', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.380', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '43.000'} [2024-08-06 00:10:07,368][52658] DAMAGECOUNT value on done: 85540.0 [2024-08-06 00:10:07,368][52658] Sum rewards: 63.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.595', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.474', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.662', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2024-08-06 00:10:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 168460288. Throughput: 0: 4412.4. Samples: 42119380. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 00:10:07,802][52567] Avg episode reward: [(0, '50.218')] [2024-08-06 00:10:08,461][52803] DAMAGECOUNT value on done: 75311.0 [2024-08-06 00:10:08,462][52803] Sum rewards: 47.710, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.640', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.101', 'weapon4': '0.210', 'AMMO3': '0.241', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '2.680', 'weapon3': '3.248', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '44.500'} [2024-08-06 00:10:08,848][52667] DAMAGECOUNT value on done: 83251.0 [2024-08-06 00:10:08,848][52667] Sum rewards: 56.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.636', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon4': '0.176', 'AMMO4': '0.228', 'weapon5': '0.262', 'AMMO3': '0.285', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.600', 'weapon3': '2.792', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '50.000'} [2024-08-06 00:10:09,337][52669] DAMAGECOUNT value on done: 90548.0 [2024-08-06 00:10:09,338][52669] Sum rewards: 58.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.415', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'weapon5': '0.018', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.424', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:09,881][52811] DAMAGECOUNT value on done: 78197.0 [2024-08-06 00:10:09,881][52811] Sum rewards: 47.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.909', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.282', 'weapon2': '0.542', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.988', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '41.000'} [2024-08-06 00:10:10,466][52658] DAMAGECOUNT value on done: 84537.0 [2024-08-06 00:10:10,467][52658] Sum rewards: 46.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.759', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.185', 'weapon2': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.222', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '40.000'} [2024-08-06 00:10:10,839][52650] Updated weights for policy 0, policy_version 20571 (0.0022) [2024-08-06 00:10:11,559][52667] DAMAGECOUNT value on done: 84478.0 [2024-08-06 00:10:11,560][52667] Sum rewards: 51.574, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.112', 'AMMO3': '0.141', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon4': '0.916', 'weapon3': '2.276', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '42.000'} [2024-08-06 00:10:12,173][52669] DAMAGECOUNT value on done: 86410.0 [2024-08-06 00:10:12,176][52669] Sum rewards: 58.384, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.064', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.236', 'AMMO3': '0.243', 'WEAPON3': '1.600', 'HITCOUNT': '3.410', 'weapon3': '3.434', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '50.000'} [2024-08-06 00:10:12,794][52567] Fps is (10 sec: 15564.6, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 168542208. Throughput: 0: 4420.0. Samples: 42145880. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 00:10:12,803][52567] Avg episode reward: [(0, '50.327')] [2024-08-06 00:10:12,841][52811] DAMAGECOUNT value on done: 80026.0 [2024-08-06 00:10:12,842][52811] Sum rewards: 61.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.102', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.338', 'weapon4': '0.384', 'ARMOR': '0.481', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '51.000'} [2024-08-06 00:10:13,241][52658] DAMAGECOUNT value on done: 86163.0 [2024-08-06 00:10:13,243][52658] Sum rewards: 63.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.054', 'AMMO4': '0.166', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '55.000'} [2024-08-06 00:10:14,436][52667] DAMAGECOUNT value on done: 90444.0 [2024-08-06 00:10:14,438][52667] Sum rewards: 35.948, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.034', 'ARMOR': '0.004', 'AMMO5': '0.017', 'weapon5': '0.026', 'AMMO2': '0.043', 'weapon4': '0.094', 'AMMO3': '0.174', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.982', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.664', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '35.000'} [2024-08-06 00:10:15,056][52669] DAMAGECOUNT value on done: 84207.0 [2024-08-06 00:10:15,057][52669] Sum rewards: 45.684, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.105', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.128', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'weapon2': '0.636', 'weapon4': '0.746', 'WEAPON3': '0.800', 'weapon3': '2.290', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '36.000'} [2024-08-06 00:10:15,637][52650] Updated weights for policy 0, policy_version 20581 (0.0020) [2024-08-06 00:10:16,237][52658] DAMAGECOUNT value on done: 87122.0 [2024-08-06 00:10:16,238][52658] Sum rewards: 46.489, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.049', 'weapon5': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.258', 'weapon2': '0.362', 'weapon4': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '43.500'} [2024-08-06 00:10:17,132][52667] DAMAGECOUNT value on done: 85480.0 [2024-08-06 00:10:17,133][52667] Sum rewards: 58.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.090', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.238', 'weapon4': '0.298', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.302', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '50.000'} [2024-08-06 00:10:17,300][52669] DAMAGECOUNT value on done: 85506.0 [2024-08-06 00:10:17,301][52669] Sum rewards: 47.100, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.217', 'weapon4': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '2.996', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '43.000'} [2024-08-06 00:10:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 168640512. Throughput: 0: 4412.5. Samples: 42159010. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:10:17,794][52567] Avg episode reward: [(0, '50.616')] [2024-08-06 00:10:18,385][52666] DAMAGECOUNT value on done: 84125.0 [2024-08-06 00:10:18,385][52666] Sum rewards: 60.852, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO3': '0.120', 'AMMO4': '0.151', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.278', 'weapon2': '0.532', 'WEAPON3': '0.800', 'weapon3': '2.814', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:18,712][52658] DAMAGECOUNT value on done: 82366.0 [2024-08-06 00:10:18,714][52658] Sum rewards: 57.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.007', 'weapon5': '0.030', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.178', 'WEAPON4': '0.400', 'weapon2': '0.434', 'weapon4': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:19,646][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:10:19,871][52667] DAMAGECOUNT value on done: 90780.0 [2024-08-06 00:10:19,871][52667] Sum rewards: 56.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.098', 'AMMO4': '0.124', 'AMMO3': '0.181', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:20,043][52669] DAMAGECOUNT value on done: 83969.0 [2024-08-06 00:10:20,043][52669] Sum rewards: 44.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.202', 'weapon4': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '2.970', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '39.000'} [2024-08-06 00:10:20,181][52663] DAMAGECOUNT value on done: 84861.0 [2024-08-06 00:10:20,183][52663] Sum rewards: 46.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.636', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.360', 'weapon4': '0.428', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '2.966', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '41.000'} [2024-08-06 00:10:20,283][52665] DAMAGECOUNT value on done: 81423.0 [2024-08-06 00:10:20,283][52665] Sum rewards: 40.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.142', 'AMMO3': '0.194', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON4': '0.600', 'weapon4': '0.796', 'WEAPON3': '1.150', 'weapon3': '2.204', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.541', 'FRAGCOUNT': '35.500'} [2024-08-06 00:10:20,524][52650] Updated weights for policy 0, policy_version 20591 (0.0034) [2024-08-06 00:10:21,416][52666] DAMAGECOUNT value on done: 84159.0 [2024-08-06 00:10:21,418][52666] Sum rewards: 39.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.350', 'weapon2': '0.466', 'weapon4': '0.554', 'WEAPON3': '0.950', 'HITCOUNT': '2.430', 'weapon3': '2.538', 'DAMAGECOUNT': '11.013', 'FRAGCOUNT': '34.000'} [2024-08-06 00:10:21,969][52658] DAMAGECOUNT value on done: 89393.0 [2024-08-06 00:10:21,971][52658] Sum rewards: 50.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.195', 'weapon5': '0.202', 'AMMO4': '0.204', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.762', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.526', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:22,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 168730624. Throughput: 0: 4407.3. Samples: 42185170. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:10:22,794][52567] Avg episode reward: [(0, '50.695')] [2024-08-06 00:10:23,010][52667] DAMAGECOUNT value on done: 82957.0 [2024-08-06 00:10:23,018][52667] Sum rewards: 40.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.809', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.030', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.588', 'WEAPON3': '1.200', 'HITCOUNT': '2.340', 'weapon3': '3.114', 'DAMAGECOUNT': '10.794', 'FRAGCOUNT': '34.000'} [2024-08-06 00:10:23,148][52665] DAMAGECOUNT value on done: 88397.0 [2024-08-06 00:10:23,149][52665] Sum rewards: 63.870, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.175', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.152', 'weapon2': '0.624', 'WEAPON3': '0.950', 'weapon3': '3.200', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '51.000'} [2024-08-06 00:10:23,264][52663] DAMAGECOUNT value on done: 84899.0 [2024-08-06 00:10:23,265][52663] Sum rewards: 56.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'weapon4': '0.246', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '50.000'} [2024-08-06 00:10:24,140][52666] DAMAGECOUNT value on done: 86719.0 [2024-08-06 00:10:24,142][52666] Sum rewards: 48.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.814', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.295', 'weapon4': '0.370', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.792', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '44.000'} [2024-08-06 00:10:24,456][52658] DAMAGECOUNT value on done: 83111.0 [2024-08-06 00:10:24,458][52658] Sum rewards: 47.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.040', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.209', 'AMMO3': '0.222', 'weapon2': '0.268', 'weapon4': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '3.098', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '42.000'} [2024-08-06 00:10:24,807][52650] Updated weights for policy 0, policy_version 20601 (0.0013) [2024-08-06 00:10:25,530][52667] DAMAGECOUNT value on done: 88842.0 [2024-08-06 00:10:25,533][52667] Sum rewards: 65.688, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.587', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.025', 'weapon5': '0.042', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '0.950', 'weapon3': '3.188', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '52.000'} [2024-08-06 00:10:26,142][52670] DAMAGECOUNT value on done: 81743.0 [2024-08-06 00:10:26,143][52670] Sum rewards: 49.845, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.290', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon4': '0.416', 'weapon2': '0.570', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:26,269][52665] DAMAGECOUNT value on done: 82900.0 [2024-08-06 00:10:26,271][52665] Sum rewards: 40.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon2': '0.956', 'HITCOUNT': '2.260', 'weapon3': '2.336', 'DAMAGECOUNT': '10.173', 'FRAGCOUNT': '35.000'} [2024-08-06 00:10:26,272][52663] DAMAGECOUNT value on done: 86038.0 [2024-08-06 00:10:26,274][52663] Sum rewards: 66.565, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.066', 'HEALTH': '0.116', 'AMMO4': '0.146', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.802', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '52.000'} [2024-08-06 00:10:27,087][52658] DAMAGECOUNT value on done: 88083.0 [2024-08-06 00:10:27,090][52658] Sum rewards: 48.916, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.745', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.058', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon2': '0.386', 'weapon4': '0.504', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:27,133][52666] DAMAGECOUNT value on done: 79976.0 [2024-08-06 00:10:27,133][52666] Sum rewards: 50.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.546', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon4': '0.146', 'AMMO3': '0.263', 'weapon2': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '44.000'} [2024-08-06 00:10:27,795][52567] Fps is (10 sec: 17201.6, 60 sec: 17612.6, 300 sec: 17578.1). Total num frames: 168812544. Throughput: 0: 4407.3. Samples: 42211650. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:10:27,795][52567] Avg episode reward: [(0, '50.978')] [2024-08-06 00:10:27,837][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020608_168820736.pth... [2024-08-06 00:10:27,886][52795] DAMAGECOUNT value on done: 77861.0 [2024-08-06 00:10:27,886][52795] Sum rewards: 51.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.679', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.108', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.726', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '44.000'} [2024-08-06 00:10:27,968][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020093_164601856.pth [2024-08-06 00:10:29,060][52663] DAMAGECOUNT value on done: 86512.0 [2024-08-06 00:10:29,063][52663] Sum rewards: 53.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.823', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:29,228][52670] DAMAGECOUNT value on done: 86393.0 [2024-08-06 00:10:29,228][52670] Sum rewards: 47.180, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.163', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.028', 'weapon4': '0.128', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '41.000'} [2024-08-06 00:10:29,383][52665] DAMAGECOUNT value on done: 80395.0 [2024-08-06 00:10:29,383][52665] Sum rewards: 40.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.998', 'AMMO5': '0.012', 'ARMOR': '0.032', 'AMMO2': '0.060', 'AMMO3': '0.126', 'weapon5': '0.274', 'AMMO4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.570', 'WEAPON4': '0.750', 'weapon2': '0.764', 'WEAPON3': '0.800', 'weapon3': '2.170', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '10.854', 'FRAGCOUNT': '34.000'} [2024-08-06 00:10:29,528][52650] Updated weights for policy 0, policy_version 20611 (0.0036) [2024-08-06 00:10:29,662][52658] DAMAGECOUNT value on done: 87169.0 [2024-08-06 00:10:29,663][52658] Sum rewards: 55.310, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.062', 'AMMO2': '0.064', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.320', 'AMMO4': '0.322', 'weapon2': '0.476', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '51.000'} [2024-08-06 00:10:30,075][52666] DAMAGECOUNT value on done: 83183.0 [2024-08-06 00:10:30,076][52666] Sum rewards: 56.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.846', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.068', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.490', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.156', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:30,943][52795] DAMAGECOUNT value on done: 74059.0 [2024-08-06 00:10:30,945][52795] Sum rewards: 50.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.635', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '2.934', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '44.000'} [2024-08-06 00:10:31,905][52663] DAMAGECOUNT value on done: 82469.0 [2024-08-06 00:10:31,905][52663] Sum rewards: 47.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.141', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '3.178', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '41.000'} [2024-08-06 00:10:32,283][52670] DAMAGECOUNT value on done: 81900.0 [2024-08-06 00:10:32,285][52670] Sum rewards: 40.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.573', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.372', 'weapon4': '0.458', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '2.774', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '35.000'} [2024-08-06 00:10:32,395][52665] DAMAGECOUNT value on done: 83156.0 [2024-08-06 00:10:32,395][52665] Sum rewards: 45.014, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.130', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.294', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.882', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '42.000'} [2024-08-06 00:10:32,497][52658] DAMAGECOUNT value on done: 87742.0 [2024-08-06 00:10:32,497][52658] Sum rewards: 58.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.179', 'WEAPON4': '0.400', 'weapon4': '0.568', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.598', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 168902656. Throughput: 0: 4397.1. Samples: 42224490. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:10:32,794][52567] Avg episode reward: [(0, '50.533')] [2024-08-06 00:10:33,095][52666] DAMAGECOUNT value on done: 81059.0 [2024-08-06 00:10:33,103][52666] Sum rewards: 46.128, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.278', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.278', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON3': '1.700', 'HITCOUNT': '2.990', 'weapon3': '3.144', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '44.000'} [2024-08-06 00:10:34,150][52650] Updated weights for policy 0, policy_version 20621 (0.0022) [2024-08-06 00:10:34,152][52795] DAMAGECOUNT value on done: 76452.0 [2024-08-06 00:10:34,153][52795] Sum rewards: 58.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.229', 'weapon2': '0.416', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.212', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '51.000'} [2024-08-06 00:10:34,730][52663] DAMAGECOUNT value on done: 87501.0 [2024-08-06 00:10:34,730][52663] Sum rewards: 44.701, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.332', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon2': '0.204', 'AMMO3': '0.281', 'weapon4': '0.328', 'WEAPON3': '1.700', 'HITCOUNT': '2.970', 'weapon3': '3.200', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '41.000'} [2024-08-06 00:10:35,090][52670] DAMAGECOUNT value on done: 85098.0 [2024-08-06 00:10:35,090][52670] Sum rewards: 52.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.551', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.372', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '2.982', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:35,224][52658] DAMAGECOUNT value on done: 83385.0 [2024-08-06 00:10:35,225][52658] Sum rewards: 55.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.866', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.160', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.260', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:35,639][52665] DAMAGECOUNT value on done: 85865.0 [2024-08-06 00:10:35,640][52665] Sum rewards: 56.710, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.600', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.096', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'weapon4': '0.266', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '51.000'} [2024-08-06 00:10:35,748][52666] DAMAGECOUNT value on done: 80612.0 [2024-08-06 00:10:35,750][52666] Sum rewards: 44.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.073', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.430', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '3.284', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '39.000'} [2024-08-06 00:10:37,185][52795] DAMAGECOUNT value on done: 77601.0 [2024-08-06 00:10:37,185][52795] Sum rewards: 40.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.481', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '2.930', 'DAMAGECOUNT': '11.361', 'FRAGCOUNT': '37.000'} [2024-08-06 00:10:37,576][52670] DAMAGECOUNT value on done: 82407.0 [2024-08-06 00:10:37,577][52670] Sum rewards: 52.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.215', 'weapon2': '0.258', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.424', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:37,667][52663] DAMAGECOUNT value on done: 88594.0 [2024-08-06 00:10:37,667][52663] Sum rewards: 38.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.886', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.028', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon5': '0.184', 'AMMO3': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.442', 'weapon2': '0.630', 'WEAPON3': '1.100', 'HITCOUNT': '2.370', 'weapon3': '2.536', 'DAMAGECOUNT': '10.584', 'FRAGCOUNT': '35.000'} [2024-08-06 00:10:37,794][52567] Fps is (10 sec: 18024.2, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 168992768. Throughput: 0: 4403.1. Samples: 42251400. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:10:37,794][52567] Avg episode reward: [(0, '50.588')] [2024-08-06 00:10:38,138][52658] DAMAGECOUNT value on done: 84924.0 [2024-08-06 00:10:38,148][52658] Sum rewards: 50.939, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.404', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.213', 'AMMO4': '0.214', 'weapon2': '0.388', 'weapon4': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:38,534][52665] DAMAGECOUNT value on done: 85513.0 [2024-08-06 00:10:38,537][52665] Sum rewards: 50.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.725', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO4': '0.075', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.820', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.808', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '42.500'} [2024-08-06 00:10:38,539][52666] DAMAGECOUNT value on done: 81765.0 [2024-08-06 00:10:38,539][52666] Sum rewards: 55.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.950', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.058', 'weapon5': '0.104', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'AMMO4': '0.290', 'weapon2': '0.488', 'WEAPON4': '0.600', 'weapon4': '0.822', 'WEAPON3': '1.100', 'weapon3': '2.248', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:38,760][52650] Updated weights for policy 0, policy_version 20631 (0.0019) [2024-08-06 00:10:40,107][52795] DAMAGECOUNT value on done: 81173.0 [2024-08-06 00:10:40,110][52795] Sum rewards: 44.977, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.970', 'AMMO5': '0.006', 'ARMOR': '0.016', 'weapon5': '0.034', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO4': '0.226', 'AMMO3': '0.275', 'weapon4': '0.440', 'weapon2': '0.532', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.774', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '44.000'} [2024-08-06 00:10:40,311][52670] DAMAGECOUNT value on done: 85801.0 [2024-08-06 00:10:40,311][52670] Sum rewards: 70.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.276', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon4': '0.110', 'AMMO4': '0.114', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '57.500'} [2024-08-06 00:10:40,539][52663] DAMAGECOUNT value on done: 84043.0 [2024-08-06 00:10:40,539][52663] Sum rewards: 49.976, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.059', 'weapon5': '0.126', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.294', 'weapon4': '0.492', 'WEAPON4': '0.600', 'weapon2': '0.646', 'WEAPON3': '0.950', 'weapon3': '2.528', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '42.000'} [2024-08-06 00:10:41,038][52666] DAMAGECOUNT value on done: 86953.0 [2024-08-06 00:10:41,038][52666] Sum rewards: 57.009, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.205', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.038', 'ARMOR': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.147', 'weapon4': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.638', 'WEAPON3': '0.850', 'weapon3': '2.942', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:41,163][52658] DAMAGECOUNT value on done: 83209.0 [2024-08-06 00:10:41,163][52658] Sum rewards: 56.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.788', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'AMMO4': '0.194', 'weapon2': '0.368', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '0.900', 'HITCOUNT': '2.930', 'weapon3': '3.006', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:41,621][52665] DAMAGECOUNT value on done: 85250.0 [2024-08-06 00:10:41,622][52665] Sum rewards: 49.931, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.440', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.164', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17613.0, 300 sec: 17578.1). Total num frames: 169074688. Throughput: 0: 4400.9. Samples: 42277780. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:10:42,794][52567] Avg episode reward: [(0, '51.348')] [2024-08-06 00:10:42,872][52614] Saving new best policy, reward=51.348! [2024-08-06 00:10:42,960][52670] DAMAGECOUNT value on done: 80781.0 [2024-08-06 00:10:42,962][52670] Sum rewards: 58.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon2': '0.738', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:43,046][52663] DAMAGECOUNT value on done: 85078.0 [2024-08-06 00:10:43,048][52663] Sum rewards: 55.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.045', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO4': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:43,198][52650] Updated weights for policy 0, policy_version 20641 (0.0010) [2024-08-06 00:10:43,222][52795] DAMAGECOUNT value on done: 79750.0 [2024-08-06 00:10:43,223][52795] Sum rewards: 56.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.249', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.132', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.000', 'HITCOUNT': '3.000', 'weapon3': '3.172', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:44,067][52666] DAMAGECOUNT value on done: 84024.0 [2024-08-06 00:10:44,072][52666] Sum rewards: 44.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.314', 'AMMO5': '0.005', 'weapon5': '0.042', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'AMMO4': '0.222', 'weapon4': '0.352', 'ARMOR': '0.467', 'WEAPON4': '0.550', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '39.000'} [2024-08-06 00:10:44,211][52658] DAMAGECOUNT value on done: 83293.0 [2024-08-06 00:10:44,211][52658] Sum rewards: 48.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.016', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.052', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.259', 'weapon2': '0.356', 'WEAPON4': '0.550', 'weapon4': '0.862', 'WEAPON3': '1.200', 'weapon3': '2.342', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '43.000'} [2024-08-06 00:10:44,880][52665] DAMAGECOUNT value on done: 88758.0 [2024-08-06 00:10:44,882][52665] Sum rewards: 55.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.306', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:46,198][52663] DAMAGECOUNT value on done: 88560.0 [2024-08-06 00:10:46,198][52663] Sum rewards: 55.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.555', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.009', 'weapon4': '0.010', 'weapon5': '0.036', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.260', 'WEAPON3': '1.600', 'HITCOUNT': '3.270', 'weapon3': '3.460', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:46,344][52670] DAMAGECOUNT value on done: 82615.0 [2024-08-06 00:10:46,345][52670] Sum rewards: 50.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.872', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.154', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.500', 'HITCOUNT': '2.550', 'weapon3': '2.942', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:46,442][52795] DAMAGECOUNT value on done: 81762.0 [2024-08-06 00:10:46,443][52795] Sum rewards: 56.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.722', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:46,697][52658] DAMAGECOUNT value on done: 87877.0 [2024-08-06 00:10:46,698][52658] Sum rewards: 56.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.121', 'AMMO3': '0.233', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:47,150][52666] DAMAGECOUNT value on done: 83224.0 [2024-08-06 00:10:47,150][52666] Sum rewards: 66.692, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.966', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '58.000'} [2024-08-06 00:10:47,448][52665] DAMAGECOUNT value on done: 86663.0 [2024-08-06 00:10:47,448][52665] Sum rewards: 54.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.298', 'weapon4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 169164800. Throughput: 0: 4396.9. Samples: 42290650. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:10:47,795][52567] Avg episode reward: [(0, '51.709')] [2024-08-06 00:10:47,797][52614] Saving new best policy, reward=51.709! [2024-08-06 00:10:48,136][52650] Updated weights for policy 0, policy_version 20651 (0.0034) [2024-08-06 00:10:48,983][52670] DAMAGECOUNT value on done: 78980.0 [2024-08-06 00:10:48,985][52670] Sum rewards: 40.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.052', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon5': '0.216', 'weapon4': '0.250', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.550', 'HITCOUNT': '2.630', 'weapon3': '2.802', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '38.000'} [2024-08-06 00:10:49,076][52663] DAMAGECOUNT value on done: 85768.0 [2024-08-06 00:10:49,077][52663] Sum rewards: 44.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.109', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.092', 'AMMO3': '0.188', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON4': '0.500', 'weapon4': '0.620', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.630', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '39.000'} [2024-08-06 00:10:49,586][52795] DAMAGECOUNT value on done: 80012.0 [2024-08-06 00:10:49,586][52795] Sum rewards: 51.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO2': '0.020', 'ARMOR': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.370', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.078', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:49,605][52666] DAMAGECOUNT value on done: 80768.0 [2024-08-06 00:10:49,607][52666] Sum rewards: 50.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.424', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'AMMO4': '0.242', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '43.000'} [2024-08-06 00:10:49,747][52658] DAMAGECOUNT value on done: 88372.0 [2024-08-06 00:10:49,747][52658] Sum rewards: 48.143, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.332', 'weapon2': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '38.000'} [2024-08-06 00:10:50,462][52665] DAMAGECOUNT value on done: 85859.0 [2024-08-06 00:10:50,462][52665] Sum rewards: 58.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.918', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.167', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '49.000'} [2024-08-06 00:10:51,449][52670] DAMAGECOUNT value on done: 77554.0 [2024-08-06 00:10:51,450][52670] Sum rewards: 51.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.188', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.460', 'weapon2': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.444', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:51,524][52671] DAMAGECOUNT value on done: 89379.0 [2024-08-06 00:10:51,527][52671] Sum rewards: 49.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.124', 'AMMO4': '0.136', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.686', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '2.934', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '45.500'} [2024-08-06 00:10:51,824][52663] DAMAGECOUNT value on done: 85000.0 [2024-08-06 00:10:51,824][52663] Sum rewards: 63.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.064', 'WEAPON4': '0.100', 'weapon2': '0.208', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'HITCOUNT': '3.390', 'weapon3': '3.530', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '55.000'} [2024-08-06 00:10:52,069][52666] DAMAGECOUNT value on done: 81649.0 [2024-08-06 00:10:52,070][52666] Sum rewards: 35.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.012', 'ARMOR': '0.032', 'AMMO2': '0.037', 'AMMO4': '0.187', 'weapon5': '0.192', 'AMMO3': '0.212', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.802', 'DAMAGECOUNT': '10.911', 'FRAGCOUNT': '33.000'} [2024-08-06 00:10:52,526][52658] DAMAGECOUNT value on done: 83167.0 [2024-08-06 00:10:52,527][52658] Sum rewards: 44.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.138', 'weapon4': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.600', 'HITCOUNT': '2.510', 'weapon3': '3.012', 'DAMAGECOUNT': '11.688', 'FRAGCOUNT': '41.000'} [2024-08-06 00:10:52,703][52650] Updated weights for policy 0, policy_version 20661 (0.0029) [2024-08-06 00:10:52,736][52795] DAMAGECOUNT value on done: 76255.0 [2024-08-06 00:10:52,736][52795] Sum rewards: 53.351, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.642', 'AMMO5': '0.024', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO4': '0.201', 'weapon5': '0.202', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.556', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.916', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 169254912. Throughput: 0: 4388.2. Samples: 42316850. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:10:52,794][52567] Avg episode reward: [(0, '51.412')] [2024-08-06 00:10:53,551][52665] DAMAGECOUNT value on done: 83508.0 [2024-08-06 00:10:53,553][52665] Sum rewards: 47.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.832', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.235', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '3.004', 'DAMAGECOUNT': '12.162', 'FRAGCOUNT': '42.000'} [2024-08-06 00:10:54,121][52670] DAMAGECOUNT value on done: 85029.0 [2024-08-06 00:10:54,121][52670] Sum rewards: 54.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.408', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.392', 'weapon4': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.826', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:54,124][52664] DAMAGECOUNT value on done: 86858.0 [2024-08-06 00:10:54,124][52664] Sum rewards: 52.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.914', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.026', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'AMMO4': '0.202', 'weapon4': '0.424', 'WEAPON4': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:54,178][52671] DAMAGECOUNT value on done: 85645.0 [2024-08-06 00:10:54,181][52671] Sum rewards: 51.243, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.472', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.046', 'weapon5': '0.124', 'AMMO4': '0.228', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON4': '0.450', 'weapon4': '0.642', 'WEAPON3': '1.400', 'weapon3': '2.568', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:54,655][52663] DAMAGECOUNT value on done: 80546.0 [2024-08-06 00:10:54,655][52663] Sum rewards: 32.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.968', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.142', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.140', 'weapon3': '2.906', 'DAMAGECOUNT': '10.008', 'FRAGCOUNT': '30.000'} [2024-08-06 00:10:54,813][52666] DAMAGECOUNT value on done: 85396.0 [2024-08-06 00:10:54,815][52666] Sum rewards: 48.672, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.702', 'AMMO5': '0.010', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon4': '0.422', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '2.820', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '46.000'} [2024-08-06 00:10:55,071][52658] DAMAGECOUNT value on done: 84686.0 [2024-08-06 00:10:55,071][52658] Sum rewards: 39.900, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.194', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.215', 'weapon2': '0.356', 'WEAPON4': '0.450', 'weapon4': '0.468', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '2.874', 'DAMAGECOUNT': '11.757', 'FRAGCOUNT': '36.000'} [2024-08-06 00:10:55,807][52795] DAMAGECOUNT value on done: 80261.0 [2024-08-06 00:10:55,808][52795] Sum rewards: 53.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'weapon2': '0.386', 'weapon4': '0.920', 'WEAPON3': '1.050', 'weapon3': '2.402', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:56,606][52665] DAMAGECOUNT value on done: 84264.0 [2024-08-06 00:10:56,606][52665] Sum rewards: 35.829, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON5': '0.050', 'AMMO2': '0.061', 'AMMO3': '0.133', 'AMMO4': '0.304', 'weapon2': '0.602', 'WEAPON3': '0.850', 'WEAPON4': '0.900', 'weapon4': '0.934', 'weapon3': '2.128', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.256', 'FRAGCOUNT': '32.000'} [2024-08-06 00:10:56,841][52664] DAMAGECOUNT value on done: 87778.0 [2024-08-06 00:10:56,841][52664] Sum rewards: 49.739, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'AMMO2': '0.035', 'ARMOR': '0.036', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.192', 'weapon2': '0.408', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '43.000'} [2024-08-06 00:10:56,998][52670] DAMAGECOUNT value on done: 85178.0 [2024-08-06 00:10:57,001][52670] Sum rewards: 53.848, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.026', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.192', 'AMMO3': '0.246', 'weapon4': '0.346', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '48.000'} [2024-08-06 00:10:57,210][52663] DAMAGECOUNT value on done: 83274.0 [2024-08-06 00:10:57,212][52663] Sum rewards: 53.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.755', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.452', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '2.712', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '45.000'} [2024-08-06 00:10:57,252][52671] DAMAGECOUNT value on done: 87104.0 [2024-08-06 00:10:57,252][52671] Sum rewards: 48.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.215', 'weapon4': '0.310', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.954', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '42.000'} [2024-08-06 00:10:57,396][52666] DAMAGECOUNT value on done: 82236.0 [2024-08-06 00:10:57,398][52666] Sum rewards: 54.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'AMMO2': '0.016', 'weapon4': '0.056', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.236', 'weapon2': '0.674', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.116', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:57,550][52650] Updated weights for policy 0, policy_version 20671 (0.0015) [2024-08-06 00:10:57,591][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:10:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 169336832. Throughput: 0: 4390.2. Samples: 42343440. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:10:57,794][52567] Avg episode reward: [(0, '50.980')] [2024-08-06 00:10:57,974][52658] DAMAGECOUNT value on done: 89037.0 [2024-08-06 00:10:57,975][52658] Sum rewards: 43.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.178', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.612', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '2.514', 'DAMAGECOUNT': '11.118', 'FRAGCOUNT': '40.000'} [2024-08-06 00:10:58,947][52795] DAMAGECOUNT value on done: 82079.0 [2024-08-06 00:10:58,950][52795] Sum rewards: 60.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.532', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.122', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.266', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.202', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '50.000'} [2024-08-06 00:10:59,368][52664] DAMAGECOUNT value on done: 90210.0 [2024-08-06 00:10:59,369][52664] Sum rewards: 49.130, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.692', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.028', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'weapon4': '0.286', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.700', 'weapon3': '2.826', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '47.000'} [2024-08-06 00:10:59,541][52670] DAMAGECOUNT value on done: 85063.0 [2024-08-06 00:10:59,541][52670] Sum rewards: 65.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.050', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.179', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.406', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '53.000'} [2024-08-06 00:10:59,868][52665] DAMAGECOUNT value on done: 85093.0 [2024-08-06 00:10:59,870][52665] Sum rewards: 48.863, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'weapon4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.478', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.228', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '44.000'} [2024-08-06 00:11:00,101][52663] DAMAGECOUNT value on done: 89055.0 [2024-08-06 00:11:00,101][52663] Sum rewards: 38.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.909', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.045', 'weapon5': '0.122', 'AMMO3': '0.223', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.500', 'weapon3': '2.792', 'DAMAGECOUNT': '12.234', 'FRAGCOUNT': '33.500'} [2024-08-06 00:11:00,130][52666] DAMAGECOUNT value on done: 81757.0 [2024-08-06 00:11:00,131][52666] Sum rewards: 34.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.839', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.061', 'AMMO3': '0.232', 'weapon5': '0.242', 'AMMO4': '0.307', 'WEAPON5': '0.400', 'weapon4': '0.502', 'WEAPON4': '0.550', 'weapon2': '0.770', 'WEAPON3': '1.250', 'weapon3': '2.200', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '9.744', 'FRAGCOUNT': '32.000'} [2024-08-06 00:11:00,360][52671] DAMAGECOUNT value on done: 83467.0 [2024-08-06 00:11:00,360][52671] Sum rewards: 63.820, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.649', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon4': '0.216', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '52.000'} [2024-08-06 00:11:01,752][52664] DAMAGECOUNT value on done: 86752.0 [2024-08-06 00:11:01,752][52664] Sum rewards: 48.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.862', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon4': '0.158', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.208', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '44.000'} [2024-08-06 00:11:01,960][52650] Updated weights for policy 0, policy_version 20681 (0.0020) [2024-08-06 00:11:02,048][52795] DAMAGECOUNT value on done: 77439.0 [2024-08-06 00:11:02,048][52795] Sum rewards: 55.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.015', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.155', 'weapon5': '0.174', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '3.058', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:02,243][52670] DAMAGECOUNT value on done: 83612.0 [2024-08-06 00:11:02,243][52670] Sum rewards: 48.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.289', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon7': '0.074', 'weapon5': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON7': '0.200', 'AMMO4': '0.255', 'weapon4': '0.450', 'WEAPON4': '0.650', 'weapon2': '0.896', 'WEAPON3': '1.000', 'weapon3': '2.240', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '42.000'} [2024-08-06 00:11:02,718][52666] DAMAGECOUNT value on done: 81179.0 [2024-08-06 00:11:02,718][52666] Sum rewards: 61.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.725', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.236', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '52.000'} [2024-08-06 00:11:02,796][52567] Fps is (10 sec: 17200.4, 60 sec: 17339.3, 300 sec: 17578.0). Total num frames: 169426944. Throughput: 0: 4391.0. Samples: 42356610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:11:02,796][52567] Avg episode reward: [(0, '50.844')] [2024-08-06 00:11:02,936][52665] DAMAGECOUNT value on done: 82823.0 [2024-08-06 00:11:02,936][52665] Sum rewards: 37.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.783', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.191', 'AMMO4': '0.265', 'weapon5': '0.270', 'WEAPON5': '0.450', 'weapon4': '0.518', 'WEAPON4': '0.550', 'weapon2': '0.730', 'WEAPON3': '1.150', 'weapon3': '2.200', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '10.926', 'FRAGCOUNT': '33.500'} [2024-08-06 00:11:02,994][52663] DAMAGECOUNT value on done: 85692.0 [2024-08-06 00:11:02,995][52663] Sum rewards: 61.539, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.672', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.090', 'AMMO3': '0.105', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon2': '1.050', 'weapon3': '2.454', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '48.000'} [2024-08-06 00:11:03,022][52665] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:11:03,156][52671] DAMAGECOUNT value on done: 84922.0 [2024-08-06 00:11:03,157][52671] Sum rewards: 60.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.140', 'weapon4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.264', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '52.000'} [2024-08-06 00:11:04,660][52664] DAMAGECOUNT value on done: 86783.0 [2024-08-06 00:11:04,661][52664] Sum rewards: 44.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.161', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.094', 'AMMO4': '0.115', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.590', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.096', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '37.000'} [2024-08-06 00:11:04,873][52670] DAMAGECOUNT value on done: 86734.0 [2024-08-06 00:11:04,874][52670] Sum rewards: 61.133, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.874', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO4': '0.190', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.346', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.852', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '54.000'} [2024-08-06 00:11:05,048][52795] DAMAGECOUNT value on done: 79468.0 [2024-08-06 00:11:05,049][52795] Sum rewards: 49.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.500', 'weapon4': '0.526', 'weapon2': '0.704', 'WEAPON3': '1.250', 'weapon3': '2.482', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '45.000'} [2024-08-06 00:11:05,616][52666] DAMAGECOUNT value on done: 85496.0 [2024-08-06 00:11:05,620][52666] Sum rewards: 66.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.632', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.158', 'weapon4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '56.000'} [2024-08-06 00:11:05,646][52671] DAMAGECOUNT value on done: 87234.0 [2024-08-06 00:11:05,648][52671] Sum rewards: 55.420, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.368', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.081', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.378', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:05,854][52663] DAMAGECOUNT value on done: 87243.0 [2024-08-06 00:11:05,855][52663] Sum rewards: 44.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.705', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '3.138', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:06,014][52665] DAMAGECOUNT value on done: 84136.0 [2024-08-06 00:11:06,014][52665] Sum rewards: 55.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.226', 'weapon2': '0.522', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.128', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '48.000'} [2024-08-06 00:11:06,690][52650] Updated weights for policy 0, policy_version 20691 (0.0010) [2024-08-06 00:11:07,473][52670] DAMAGECOUNT value on done: 79398.0 [2024-08-06 00:11:07,474][52670] Sum rewards: 33.181, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.920', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'weapon5': '0.242', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.472', 'WEAPON3': '1.650', 'HITCOUNT': '2.480', 'weapon3': '2.720', 'DAMAGECOUNT': '10.899', 'FRAGCOUNT': '34.000'} [2024-08-06 00:11:07,713][52664] DAMAGECOUNT value on done: 91970.0 [2024-08-06 00:11:07,714][52664] Sum rewards: 39.593, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.968', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.040', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'AMMO3': '0.214', 'weapon4': '0.296', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.866', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '37.000'} [2024-08-06 00:11:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 169517056. Throughput: 0: 4392.0. Samples: 42382810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:11:07,794][52567] Avg episode reward: [(0, '50.892')] [2024-08-06 00:11:08,029][52666] DAMAGECOUNT value on done: 83189.0 [2024-08-06 00:11:08,030][52666] Sum rewards: 41.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.927', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.084', 'AMMO3': '0.204', 'AMMO4': '0.258', 'weapon4': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '37.500'} [2024-08-06 00:11:08,179][52795] DAMAGECOUNT value on done: 79701.0 [2024-08-06 00:11:08,179][52795] Sum rewards: 43.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.897', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.120', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.420', 'WEAPON3': '1.550', 'HITCOUNT': '2.350', 'weapon3': '3.180', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:08,559][52671] DAMAGECOUNT value on done: 85948.0 [2024-08-06 00:11:08,559][52671] Sum rewards: 48.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.142', 'AMMO3': '0.190', 'weapon4': '0.436', 'WEAPON4': '0.450', 'weapon2': '0.844', 'WEAPON3': '1.150', 'weapon3': '2.488', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '42.000'} [2024-08-06 00:11:08,643][52663] DAMAGECOUNT value on done: 86653.0 [2024-08-06 00:11:08,643][52663] Sum rewards: 56.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.142', 'AMMO3': '0.158', 'weapon4': '0.216', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.636', 'WEAPON3': '0.950', 'weapon3': '2.776', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:09,189][52665] DAMAGECOUNT value on done: 83253.0 [2024-08-06 00:11:09,191][52665] Sum rewards: 43.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.096', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:10,139][52664] DAMAGECOUNT value on done: 88787.0 [2024-08-06 00:11:10,147][52664] Sum rewards: 45.843, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.683', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.410', 'WEAPON3': '1.650', 'weapon3': '2.908', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '42.000'} [2024-08-06 00:11:10,155][52670] DAMAGECOUNT value on done: 86427.0 [2024-08-06 00:11:10,155][52670] Sum rewards: 46.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.108', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'weapon2': '0.360', 'weapon4': '0.586', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.794', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:10,621][52666] DAMAGECOUNT value on done: 85358.0 [2024-08-06 00:11:10,622][52666] Sum rewards: 58.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.078', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'ARMOR': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.240', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '49.000'} [2024-08-06 00:11:10,846][52659] DAMAGECOUNT value on done: 84507.0 [2024-08-06 00:11:10,847][52659] Sum rewards: 49.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.516', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.488', 'weapon4': '0.802', 'WEAPON3': '1.300', 'weapon3': '2.478', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '44.000'} [2024-08-06 00:11:11,276][52671] DAMAGECOUNT value on done: 88531.0 [2024-08-06 00:11:11,276][52671] Sum rewards: 42.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.632', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.062', 'AMMO3': '0.227', 'weapon5': '0.310', 'AMMO4': '0.311', 'WEAPON5': '0.400', 'weapon2': '0.484', 'weapon4': '0.522', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.316', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '39.000'} [2024-08-06 00:11:11,390][52650] Updated weights for policy 0, policy_version 20701 (0.0025) [2024-08-06 00:11:11,423][52795] DAMAGECOUNT value on done: 77106.0 [2024-08-06 00:11:11,425][52795] Sum rewards: 50.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.206', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.318', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.358', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:11,629][52663] DAMAGECOUNT value on done: 89310.0 [2024-08-06 00:11:11,631][52663] Sum rewards: 44.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.160', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon4': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '2.922', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '39.000'} [2024-08-06 00:11:11,828][52665] DAMAGECOUNT value on done: 79356.0 [2024-08-06 00:11:11,829][52665] Sum rewards: 38.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'ARMOR': '0.029', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.165', 'AMMO3': '0.243', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '1.450', 'HITCOUNT': '2.440', 'weapon3': '2.810', 'DAMAGECOUNT': '10.806', 'FRAGCOUNT': '36.000'} [2024-08-06 00:11:12,054][52614] Signal inference workers to stop experience collection... (3850 times) [2024-08-06 00:11:12,055][52614] Signal inference workers to resume experience collection... (3850 times) [2024-08-06 00:11:12,143][52650] InferenceWorker_p0-w0: stopping experience collection (3850 times) [2024-08-06 00:11:12,143][52650] InferenceWorker_p0-w0: resuming experience collection (3850 times) [2024-08-06 00:11:12,794][52567] Fps is (10 sec: 18025.3, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 169607168. Throughput: 0: 4386.8. Samples: 42409050. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:11:12,794][52567] Avg episode reward: [(0, '50.319')] [2024-08-06 00:11:12,832][52670] DAMAGECOUNT value on done: 84956.0 [2024-08-06 00:11:12,832][52670] Sum rewards: 53.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.203', 'weapon4': '0.222', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.202', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:12,928][52664] DAMAGECOUNT value on done: 82442.0 [2024-08-06 00:11:12,929][52664] Sum rewards: 50.731, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.201', 'weapon4': '0.284', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '42.000'} [2024-08-06 00:11:13,541][52659] DAMAGECOUNT value on done: 88053.0 [2024-08-06 00:11:13,541][52659] Sum rewards: 46.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.412', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.144', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON4': '0.400', 'weapon2': '0.752', 'WEAPON3': '0.850', 'HITCOUNT': '2.450', 'weapon3': '2.630', 'DAMAGECOUNT': '11.592', 'FRAGCOUNT': '39.000'} [2024-08-06 00:11:13,906][52671] DAMAGECOUNT value on done: 85173.0 [2024-08-06 00:11:13,906][52671] Sum rewards: 45.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.044', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.082', 'weapon5': '0.128', 'AMMO3': '0.147', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.692', 'WEAPON3': '1.000', 'HITCOUNT': '2.500', 'weapon3': '2.888', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '39.000'} [2024-08-06 00:11:14,445][52795] DAMAGECOUNT value on done: 79887.0 [2024-08-06 00:11:14,446][52795] Sum rewards: 43.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.260', 'weapon2': '0.438', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.142', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '38.000'} [2024-08-06 00:11:14,664][52663] DAMAGECOUNT value on done: 84233.0 [2024-08-06 00:11:14,667][52663] Sum rewards: 49.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.185', 'AMMO4': '0.203', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.106', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '42.500'} [2024-08-06 00:11:14,941][52665] DAMAGECOUNT value on done: 81692.0 [2024-08-06 00:11:14,957][52665] Sum rewards: 47.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.197', 'weapon4': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.768', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '2.860', 'DAMAGECOUNT': '11.955', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:15,489][52664] DAMAGECOUNT value on done: 94292.0 [2024-08-06 00:11:15,490][52664] Sum rewards: 47.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.887', 'AMMO5': '0.007', 'ARMOR': '0.020', 'weapon5': '0.050', 'AMMO2': '0.059', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.297', 'weapon2': '0.428', 'WEAPON4': '0.650', 'weapon4': '0.676', 'WEAPON3': '1.250', 'weapon3': '2.618', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '41.500'} [2024-08-06 00:11:16,025][52670] DAMAGECOUNT value on done: 83245.0 [2024-08-06 00:11:16,026][52670] Sum rewards: 63.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.219', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '52.000'} [2024-08-06 00:11:16,117][52659] DAMAGECOUNT value on done: 84160.0 [2024-08-06 00:11:16,118][52659] Sum rewards: 51.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.144', 'AMMO3': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.696', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '44.000'} [2024-08-06 00:11:16,279][52650] Updated weights for policy 0, policy_version 20711 (0.0016) [2024-08-06 00:11:16,409][52671] DAMAGECOUNT value on done: 87662.0 [2024-08-06 00:11:16,410][52671] Sum rewards: 54.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.784', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.052', 'AMMO4': '0.163', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '49.000'} [2024-08-06 00:11:17,545][52795] DAMAGECOUNT value on done: 83066.0 [2024-08-06 00:11:17,547][52795] Sum rewards: 56.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO4': '0.131', 'AMMO3': '0.197', 'weapon2': '0.656', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 169689088. Throughput: 0: 4397.3. Samples: 42422370. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:11:17,794][52567] Avg episode reward: [(0, '50.295')] [2024-08-06 00:11:17,986][52665] DAMAGECOUNT value on done: 81994.0 [2024-08-06 00:11:17,993][52665] Sum rewards: 51.030, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO4': '0.122', 'AMMO3': '0.159', 'weapon4': '0.184', 'WEAPON4': '0.250', 'HEALTH': '0.293', 'weapon2': '0.462', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.984', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '43.000'} [2024-08-06 00:11:18,232][52664] DAMAGECOUNT value on done: 91623.0 [2024-08-06 00:11:18,235][52664] Sum rewards: 55.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.138', 'AMMO4': '0.222', 'AMMO3': '0.229', 'weapon4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.846', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:19,068][52659] DAMAGECOUNT value on done: 87670.0 [2024-08-06 00:11:19,072][52659] Sum rewards: 55.796, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.570', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.082', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'weapon4': '0.464', 'weapon2': '0.790', 'WEAPON3': '0.800', 'weapon3': '2.488', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '45.000'} [2024-08-06 00:11:19,255][52670] DAMAGECOUNT value on done: 82460.0 [2024-08-06 00:11:19,256][52670] Sum rewards: 53.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.262', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.032', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.428', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.292', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '44.000'} [2024-08-06 00:11:19,383][52671] DAMAGECOUNT value on done: 85873.0 [2024-08-06 00:11:19,383][52671] Sum rewards: 55.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.743', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon2': '0.362', 'weapon4': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:20,610][52795] DAMAGECOUNT value on done: 76264.0 [2024-08-06 00:11:20,620][52795] Sum rewards: 46.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.166', 'AMMO3': '0.188', 'weapon4': '0.206', 'WEAPON5': '0.250', 'AMMO4': '0.261', 'WEAPON4': '0.450', 'weapon2': '0.842', 'WEAPON3': '1.100', 'weapon3': '2.534', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:20,689][52650] Updated weights for policy 0, policy_version 20721 (0.0011) [2024-08-06 00:11:20,849][52664] DAMAGECOUNT value on done: 92116.0 [2024-08-06 00:11:20,851][52664] Sum rewards: 47.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.776', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.476', 'WEAPON3': '1.350', 'HITCOUNT': '2.660', 'weapon3': '2.780', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '43.000'} [2024-08-06 00:11:22,076][52659] DAMAGECOUNT value on done: 86262.0 [2024-08-06 00:11:22,078][52659] Sum rewards: 52.397, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon4': '0.202', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.698', 'WEAPON3': '1.500', 'weapon3': '2.792', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:22,299][52671] DAMAGECOUNT value on done: 85879.0 [2024-08-06 00:11:22,301][52671] Sum rewards: 42.323, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.453', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.059', 'weapon5': '0.136', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'AMMO4': '0.293', 'weapon4': '0.490', 'weapon2': '0.660', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.404', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '42.000'} [2024-08-06 00:11:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 169779200. Throughput: 0: 4390.9. Samples: 42448990. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:11:22,794][52567] Avg episode reward: [(0, '50.413')] [2024-08-06 00:11:23,240][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:11:23,737][52795] DAMAGECOUNT value on done: 80127.0 [2024-08-06 00:11:23,737][52795] Sum rewards: 49.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.397', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.094', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.390', 'WEAPON3': '1.600', 'HITCOUNT': '2.670', 'weapon3': '3.024', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:23,943][52664] DAMAGECOUNT value on done: 88537.0 [2024-08-06 00:11:23,946][52664] Sum rewards: 57.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.774', 'AMMO5': '0.010', 'ARMOR': '0.028', 'weapon5': '0.040', 'AMMO2': '0.049', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'weapon4': '0.346', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.032', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:24,920][52659] DAMAGECOUNT value on done: 88213.0 [2024-08-06 00:11:24,922][52659] Sum rewards: 57.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.206', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.200', 'AMMO3': '0.238', 'AMMO4': '0.243', 'weapon5': '0.262', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '50.000'} [2024-08-06 00:11:25,156][52671] DAMAGECOUNT value on done: 90024.0 [2024-08-06 00:11:25,156][52671] Sum rewards: 47.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.214', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.440', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.076', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '43.000'} [2024-08-06 00:11:25,472][52650] Updated weights for policy 0, policy_version 20731 (0.0021) [2024-08-06 00:11:26,553][52664] DAMAGECOUNT value on done: 86879.0 [2024-08-06 00:11:26,554][52664] Sum rewards: 50.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.232', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.224', 'weapon4': '0.320', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '2.650', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '44.500'} [2024-08-06 00:11:26,558][52647] DAMAGECOUNT value on done: 90393.0 [2024-08-06 00:11:26,559][52647] Sum rewards: 47.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.040', 'weapon5': '0.078', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.516', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.162', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '39.500'} [2024-08-06 00:11:26,820][52795] DAMAGECOUNT value on done: 83268.0 [2024-08-06 00:11:26,822][52795] Sum rewards: 51.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.768', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.190', 'AMMO4': '0.193', 'weapon2': '0.302', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.972', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '44.000'} [2024-08-06 00:11:26,879][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:11:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.1, 300 sec: 17578.1). Total num frames: 169869312. Throughput: 0: 4393.8. Samples: 42475500. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:11:27,794][52567] Avg episode reward: [(0, '50.177')] [2024-08-06 00:11:28,051][52659] DAMAGECOUNT value on done: 87782.0 [2024-08-06 00:11:28,053][52659] Sum rewards: 53.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.128', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.654', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.042', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '48.000'} [2024-08-06 00:11:28,212][52671] DAMAGECOUNT value on done: 86806.0 [2024-08-06 00:11:28,212][52671] Sum rewards: 45.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.255', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.470', 'weapon2': '0.640', 'WEAPON3': '1.400', 'weapon3': '2.584', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '43.000'} [2024-08-06 00:11:28,784][52647] DAMAGECOUNT value on done: 89427.0 [2024-08-06 00:11:28,787][52647] Sum rewards: 57.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.698', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.168', 'AMMO4': '0.198', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.450', 'weapon4': '0.834', 'WEAPON3': '1.350', 'weapon3': '2.318', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '50.000'} [2024-08-06 00:11:28,817][52664] DAMAGECOUNT value on done: 90010.0 [2024-08-06 00:11:28,817][52664] Sum rewards: 61.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.531', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.040', 'weapon4': '0.062', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.318', 'WEAPON3': '1.200', 'HITCOUNT': '3.300', 'weapon3': '3.378', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '51.000'} [2024-08-06 00:11:29,882][52650] Updated weights for policy 0, policy_version 20741 (0.0013) [2024-08-06 00:11:30,970][52659] DAMAGECOUNT value on done: 83321.0 [2024-08-06 00:11:30,970][52659] Sum rewards: 55.112, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.015', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO3': '0.157', 'weapon2': '1.018', 'WEAPON3': '1.050', 'weapon3': '2.780', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '45.000'} [2024-08-06 00:11:31,176][52671] DAMAGECOUNT value on done: 82083.0 [2024-08-06 00:11:31,177][52671] Sum rewards: 40.726, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.062', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.290', 'AMMO4': '0.308', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.580', 'WEAPON3': '1.700', 'weapon3': '2.652', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:31,276][52647] DAMAGECOUNT value on done: 93605.0 [2024-08-06 00:11:31,276][52647] Sum rewards: 45.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.105', 'AMMO5': '0.007', 'ARMOR': '0.028', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'AMMO3': '0.184', 'AMMO4': '0.259', 'weapon2': '0.424', 'WEAPON4': '0.750', 'weapon4': '0.950', 'WEAPON3': '1.150', 'weapon3': '2.376', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '41.000'} [2024-08-06 00:11:31,323][52664] DAMAGECOUNT value on done: 89114.0 [2024-08-06 00:11:31,323][52664] Sum rewards: 47.542, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.133', 'weapon4': '0.138', 'weapon2': '0.368', 'WEAPON3': '0.900', 'HITCOUNT': '2.390', 'weapon3': '3.370', 'DAMAGECOUNT': '10.689', 'FRAGCOUNT': '39.000'} [2024-08-06 00:11:32,323][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:11:32,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 169951232. Throughput: 0: 4397.3. Samples: 42488530. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:11:32,796][52567] Avg episode reward: [(0, '49.920')] [2024-08-06 00:11:33,493][52660] Large shaping reward 2.555 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('HEALTH', -0.036000000000000004, -12.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:11:33,718][52647] DAMAGECOUNT value on done: 94402.0 [2024-08-06 00:11:33,718][52647] Sum rewards: 53.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.639', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.182', 'AMMO3': '0.193', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.370', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.756', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:33,843][52659] DAMAGECOUNT value on done: 85394.0 [2024-08-06 00:11:33,845][52659] Sum rewards: 49.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.078', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.248', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.332', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '45.000'} [2024-08-06 00:11:33,861][52664] DAMAGECOUNT value on done: 85696.0 [2024-08-06 00:11:33,863][52664] Sum rewards: 46.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.013', 'weapon5': '0.050', 'AMMO2': '0.057', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.284', 'weapon2': '0.516', 'weapon4': '0.606', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.586', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '43.000'} [2024-08-06 00:11:33,993][52671] DAMAGECOUNT value on done: 86532.0 [2024-08-06 00:11:33,993][52671] Sum rewards: 56.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.257', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon4': '0.208', 'weapon2': '0.612', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.990', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '48.000'} [2024-08-06 00:11:34,624][52650] Updated weights for policy 0, policy_version 20751 (0.0012) [2024-08-06 00:11:36,523][52647] DAMAGECOUNT value on done: 93211.0 [2024-08-06 00:11:36,524][52647] Sum rewards: 46.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO2': '0.007', 'AMMO4': '0.032', 'AMMO3': '0.223', 'weapon2': '0.486', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.366', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:36,688][52659] DAMAGECOUNT value on done: 87904.0 [2024-08-06 00:11:36,688][52664] DAMAGECOUNT value on done: 89989.0 [2024-08-06 00:11:36,690][52664] Sum rewards: 40.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.263', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.070', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'weapon4': '0.208', 'WEAPON4': '0.450', 'weapon2': '0.680', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '2.818', 'DAMAGECOUNT': '11.232', 'FRAGCOUNT': '36.000'} [2024-08-06 00:11:36,690][52659] Sum rewards: 37.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.184', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.210', 'weapon4': '0.408', 'WEAPON4': '0.550', 'weapon2': '0.656', 'WEAPON3': '1.200', 'HITCOUNT': '2.550', 'weapon3': '2.660', 'DAMAGECOUNT': '10.317', 'FRAGCOUNT': '34.000'} [2024-08-06 00:11:36,784][52671] DAMAGECOUNT value on done: 86214.0 [2024-08-06 00:11:36,786][52671] Sum rewards: 48.124, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.338', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.286', 'weapon2': '0.302', 'WEAPON3': '1.700', 'HITCOUNT': '2.850', 'weapon3': '3.528', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '45.000'} [2024-08-06 00:11:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 170049536. Throughput: 0: 4407.1. Samples: 42515170. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:11:37,794][52567] Avg episode reward: [(0, '49.721')] [2024-08-06 00:11:39,060][52647] DAMAGECOUNT value on done: 93007.0 [2024-08-06 00:11:39,061][52647] Sum rewards: 49.927, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.752', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.500', 'weapon2': '0.510', 'weapon4': '0.544', 'WEAPON3': '1.550', 'weapon3': '2.740', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '43.000'} [2024-08-06 00:11:39,394][52650] Updated weights for policy 0, policy_version 20761 (0.0011) [2024-08-06 00:11:39,395][52664] DAMAGECOUNT value on done: 88932.0 [2024-08-06 00:11:39,397][52664] Sum rewards: 44.280, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.112', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.358', 'weapon2': '0.386', 'WEAPON3': '1.600', 'weapon3': '2.914', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '41.500'} [2024-08-06 00:11:39,564][52659] DAMAGECOUNT value on done: 86230.0 [2024-08-06 00:11:39,566][52659] Sum rewards: 67.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.290', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.064', 'AMMO3': '0.146', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '0.900', 'weapon3': '2.830', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '58.000'} [2024-08-06 00:11:39,644][52671] DAMAGECOUNT value on done: 86837.0 [2024-08-06 00:11:39,646][52671] Sum rewards: 49.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.073', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO3': '0.174', 'AMMO4': '0.181', 'WEAPON5': '0.300', 'weapon2': '0.360', 'weapon4': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '42.000'} [2024-08-06 00:11:41,767][52647] DAMAGECOUNT value on done: 89925.0 [2024-08-06 00:11:41,768][52647] Sum rewards: 59.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.028', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.049', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.243', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.480', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '55.000'} [2024-08-06 00:11:41,981][52664] DAMAGECOUNT value on done: 88168.0 [2024-08-06 00:11:41,981][52664] Sum rewards: 41.111, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.710', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.242', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.626', 'WEAPON3': '1.400', 'HITCOUNT': '2.480', 'weapon3': '2.796', 'DAMAGECOUNT': '11.043', 'FRAGCOUNT': '40.000'} [2024-08-06 00:11:42,709][52659] DAMAGECOUNT value on done: 83533.0 [2024-08-06 00:11:42,709][52659] Sum rewards: 42.965, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.179', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.183', 'AMMO3': '0.204', 'weapon4': '0.288', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '38.000'} [2024-08-06 00:11:42,712][52671] DAMAGECOUNT value on done: 85935.0 [2024-08-06 00:11:42,715][52671] Sum rewards: 59.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.176', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.334', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.330', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '51.000'} [2024-08-06 00:11:42,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 170131456. Throughput: 0: 4401.1. Samples: 42541490. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:11:42,794][52567] Avg episode reward: [(0, '49.849')] [2024-08-06 00:11:43,873][52650] Updated weights for policy 0, policy_version 20771 (0.0017) [2024-08-06 00:11:44,152][52647] DAMAGECOUNT value on done: 92767.0 [2024-08-06 00:11:44,152][52647] Sum rewards: 54.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.645', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.012', 'weapon5': '0.032', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:44,546][52664] DAMAGECOUNT value on done: 88568.0 [2024-08-06 00:11:44,547][52664] Sum rewards: 51.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.736', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.034', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO4': '0.194', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.610', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '2.854', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '44.000'} [2024-08-06 00:11:45,808][52659] DAMAGECOUNT value on done: 81618.0 [2024-08-06 00:11:45,810][52659] Sum rewards: 50.893, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'ARMOR': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.226', 'weapon2': '0.378', 'WEAPON4': '0.450', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:45,852][52671] DAMAGECOUNT value on done: 84422.0 [2024-08-06 00:11:45,854][52671] Sum rewards: 53.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.718', 'AMMO5': '0.011', 'ARMOR': '0.044', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.178', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.488', 'WEAPON4': '0.500', 'weapon2': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.458', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:47,300][52647] DAMAGECOUNT value on done: 94169.0 [2024-08-06 00:11:47,300][52647] Sum rewards: 53.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.086', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.199', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '45.000'} [2024-08-06 00:11:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 170221568. Throughput: 0: 4397.9. Samples: 42554510. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:11:47,794][52567] Avg episode reward: [(0, '50.239')] [2024-08-06 00:11:47,976][52820] DAMAGECOUNT value on done: 77983.0 [2024-08-06 00:11:47,978][52820] Sum rewards: 47.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.218', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.730', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.676', 'DAMAGECOUNT': '10.818', 'FRAGCOUNT': '39.000'} [2024-08-06 00:11:48,515][52650] Updated weights for policy 0, policy_version 20781 (0.0015) [2024-08-06 00:11:48,921][52659] DAMAGECOUNT value on done: 87654.0 [2024-08-06 00:11:48,922][52659] Sum rewards: 56.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.708', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.110', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.234', 'weapon4': '0.274', 'WEAPON4': '0.450', 'weapon2': '0.852', 'WEAPON3': '0.950', 'weapon3': '2.534', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '48.000'} [2024-08-06 00:11:49,986][52647] DAMAGECOUNT value on done: 89548.0 [2024-08-06 00:11:49,987][52647] Sum rewards: 49.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.167', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'weapon2': '0.386', 'weapon4': '0.506', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '42.000'} [2024-08-06 00:11:51,117][52820] DAMAGECOUNT value on done: 80393.0 [2024-08-06 00:11:51,119][52820] Sum rewards: 40.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.168', 'AMMO5': '0.008', 'ARMOR': '0.032', 'weapon5': '0.034', 'AMMO2': '0.057', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.286', 'WEAPON4': '0.500', 'weapon2': '0.540', 'weapon4': '0.630', 'WEAPON3': '0.850', 'weapon3': '2.598', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '10.713', 'FRAGCOUNT': '35.500'} [2024-08-06 00:11:51,684][52659] DAMAGECOUNT value on done: 87446.0 [2024-08-06 00:11:51,686][52659] Sum rewards: 59.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon2': '0.482', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.296', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2024-08-06 00:11:52,733][52647] DAMAGECOUNT value on done: 88284.0 [2024-08-06 00:11:52,736][52647] Sum rewards: 58.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon4': '0.268', 'weapon2': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.258', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '50.000'} [2024-08-06 00:11:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 170311680. Throughput: 0: 4408.7. Samples: 42581200. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:11:52,794][52567] Avg episode reward: [(0, '50.400')] [2024-08-06 00:11:53,431][52650] Updated weights for policy 0, policy_version 20791 (0.0019) [2024-08-06 00:11:54,202][52820] DAMAGECOUNT value on done: 76937.0 [2024-08-06 00:11:54,203][52820] Sum rewards: 59.999, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.226', 'AMMO2': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.101', 'weapon4': '0.138', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '50.000'} [2024-08-06 00:11:54,602][52659] DAMAGECOUNT value on done: 91241.0 [2024-08-06 00:11:54,604][52659] Sum rewards: 57.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.432', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.044', 'AMMO4': '0.078', 'weapon5': '0.110', 'AMMO3': '0.183', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '49.000'} [2024-08-06 00:11:55,061][52647] DAMAGECOUNT value on done: 87908.0 [2024-08-06 00:11:55,061][52647] Sum rewards: 54.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.145', 'weapon4': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '0.950', 'weapon3': '2.850', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '49.000'} [2024-08-06 00:11:57,262][52820] DAMAGECOUNT value on done: 75870.0 [2024-08-06 00:11:57,262][52820] Sum rewards: 43.907, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.050', 'AMMO5': '0.013', 'ARMOR': '0.028', 'AMMO2': '0.049', 'weapon5': '0.098', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'AMMO4': '0.246', 'weapon4': '0.310', 'WEAPON4': '0.550', 'weapon2': '0.822', 'WEAPON3': '0.950', 'weapon3': '2.558', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.995', 'FRAGCOUNT': '38.500'} [2024-08-06 00:11:57,605][52647] DAMAGECOUNT value on done: 88255.0 [2024-08-06 00:11:57,606][52647] Sum rewards: 57.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.030', 'weapon4': '0.066', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.354', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '47.000'} [2024-08-06 00:11:57,726][52659] DAMAGECOUNT value on done: 86497.0 [2024-08-06 00:11:57,728][52659] Sum rewards: 53.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.571', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO3': '0.200', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.298', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.868', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '46.000'} [2024-08-06 00:11:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 170393600. Throughput: 0: 4413.1. Samples: 42607640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:11:57,794][52567] Avg episode reward: [(0, '50.619')] [2024-08-06 00:11:57,955][52650] Updated weights for policy 0, policy_version 20801 (0.0022) [2024-08-06 00:11:59,605][52662] DAMAGECOUNT value on done: 90253.0 [2024-08-06 00:11:59,607][52662] Sum rewards: 41.073, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.410', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.056', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.260', 'AMMO4': '0.279', 'weapon2': '0.448', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '2.948', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:00,247][52647] DAMAGECOUNT value on done: 89832.0 [2024-08-06 00:12:00,247][52647] Sum rewards: 54.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.706', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.141', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '47.000'} [2024-08-06 00:12:00,312][52820] DAMAGECOUNT value on done: 79059.0 [2024-08-06 00:12:00,315][52820] Sum rewards: 55.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.104', 'AMMO3': '0.202', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.450', 'weapon4': '0.676', 'WEAPON3': '1.150', 'weapon3': '2.608', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:00,872][52659] DAMAGECOUNT value on done: 85905.0 [2024-08-06 00:12:00,872][52659] Sum rewards: 42.837, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO5': '0.008', 'ARMOR': '0.008', 'weapon5': '0.058', 'AMMO2': '0.061', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'AMMO4': '0.303', 'weapon2': '0.470', 'weapon4': '0.498', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.682', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '39.000'} [2024-08-06 00:12:02,397][52650] Updated weights for policy 0, policy_version 20811 (0.0013) [2024-08-06 00:12:02,479][52647] DAMAGECOUNT value on done: 90536.0 [2024-08-06 00:12:02,481][52647] Sum rewards: 54.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.224', 'weapon4': '0.244', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.202', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:02,779][52662] DAMAGECOUNT value on done: 94780.0 [2024-08-06 00:12:02,780][52662] Sum rewards: 41.373, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'AMMO4': '0.204', 'weapon2': '0.478', 'WEAPON4': '0.600', 'weapon4': '0.740', 'WEAPON3': '1.250', 'weapon3': '2.532', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '38.000'} [2024-08-06 00:12:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.8, 300 sec: 17578.1). Total num frames: 170491904. Throughput: 0: 4411.1. Samples: 42620870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:12:02,794][52567] Avg episode reward: [(0, '50.603')] [2024-08-06 00:12:03,465][52820] DAMAGECOUNT value on done: 80266.0 [2024-08-06 00:12:03,467][52820] Sum rewards: 47.168, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.278', 'AMMO3': '0.284', 'weapon2': '0.332', 'WEAPON3': '1.750', 'HITCOUNT': '2.880', 'weapon3': '3.140', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:03,731][52659] DAMAGECOUNT value on done: 88886.0 [2024-08-06 00:12:03,731][52659] Sum rewards: 52.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.957', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.206', 'weapon2': '0.574', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '2.966', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:04,494][52668] DAMAGECOUNT value on done: 85708.0 [2024-08-06 00:12:04,497][52668] Sum rewards: 47.678, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.244', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon4': '0.372', 'weapon2': '0.542', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:04,881][52647] DAMAGECOUNT value on done: 91403.0 [2024-08-06 00:12:04,881][52647] Sum rewards: 50.680, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.565', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon5': '0.026', 'AMMO2': '0.027', 'weapon4': '0.092', 'AMMO4': '0.133', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.642', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:05,732][52662] DAMAGECOUNT value on done: 96238.0 [2024-08-06 00:12:05,732][52662] Sum rewards: 49.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.279', 'AMMO2': '0.024', 'weapon4': '0.106', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.276', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.478', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:06,585][52820] DAMAGECOUNT value on done: 80939.0 [2024-08-06 00:12:06,587][52820] Sum rewards: 49.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.012', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:06,731][52659] DAMAGECOUNT value on done: 88878.0 [2024-08-06 00:12:06,731][52659] Sum rewards: 56.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.892', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:07,318][52650] Updated weights for policy 0, policy_version 20821 (0.0024) [2024-08-06 00:12:07,431][52647] DAMAGECOUNT value on done: 87528.0 [2024-08-06 00:12:07,433][52647] Sum rewards: 50.929, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.076', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.150', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.120', 'DAMAGECOUNT': '12.231', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:07,629][52668] DAMAGECOUNT value on done: 91191.0 [2024-08-06 00:12:07,631][52668] Sum rewards: 52.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.334', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 170573824. Throughput: 0: 4407.8. Samples: 42647340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:12:07,794][52567] Avg episode reward: [(0, '50.170')] [2024-08-06 00:12:08,015][52794] DAMAGECOUNT value on done: 95039.0 [2024-08-06 00:12:08,026][52794] Sum rewards: 57.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.057', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'AMMO4': '0.283', 'weapon2': '0.320', 'weapon4': '0.354', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.972', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '50.000'} [2024-08-06 00:12:08,686][52662] DAMAGECOUNT value on done: 86878.0 [2024-08-06 00:12:08,688][52662] Sum rewards: 53.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.058', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.050', 'weapon5': '0.066', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'WEAPON4': '0.500', 'weapon4': '0.528', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.630', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:09,710][52820] DAMAGECOUNT value on done: 81164.0 [2024-08-06 00:12:09,710][52820] Sum rewards: 43.593, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.903', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.135', 'WEAPON3': '0.950', 'weapon2': '1.110', 'HITCOUNT': '2.630', 'weapon3': '2.770', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '36.000'} [2024-08-06 00:12:10,046][52647] DAMAGECOUNT value on done: 89937.0 [2024-08-06 00:12:10,046][52647] Sum rewards: 58.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.270', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.020', 'weapon5': '0.020', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.736', 'WEAPON3': '1.000', 'weapon3': '2.908', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '47.000'} [2024-08-06 00:12:10,174][52668] DAMAGECOUNT value on done: 84721.0 [2024-08-06 00:12:10,174][52668] Sum rewards: 59.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.044', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.160', 'weapon5': '0.214', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.490', 'WEAPON3': '0.900', 'weapon3': '2.732', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:11,153][52794] DAMAGECOUNT value on done: 92346.0 [2024-08-06 00:12:11,154][52794] Sum rewards: 55.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.016', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.211', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:11,703][52650] Updated weights for policy 0, policy_version 20831 (0.0012) [2024-08-06 00:12:11,810][52662] DAMAGECOUNT value on done: 90656.0 [2024-08-06 00:12:11,812][52662] Sum rewards: 50.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.438', 'weapon4': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:12,763][52820] DAMAGECOUNT value on done: 78014.0 [2024-08-06 00:12:12,765][52820] Sum rewards: 53.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.172', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 170663936. Throughput: 0: 4402.9. Samples: 42673630. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:12:12,794][52567] Avg episode reward: [(0, '50.775')] [2024-08-06 00:12:12,884][52647] DAMAGECOUNT value on done: 88365.0 [2024-08-06 00:12:12,885][52647] Sum rewards: 48.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.159', 'weapon5': '0.206', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON4': '0.850', 'WEAPON3': '1.000', 'weapon4': '1.304', 'weapon3': '1.724', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '12.306', 'FRAGCOUNT': '40.000'} [2024-08-06 00:12:13,005][52668] DAMAGECOUNT value on done: 87235.0 [2024-08-06 00:12:13,006][52668] Sum rewards: 63.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.356', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.252', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '56.000'} [2024-08-06 00:12:13,820][52649] DAMAGECOUNT value on done: 85377.0 [2024-08-06 00:12:13,821][52649] Sum rewards: 56.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.022', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.266', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:14,286][52794] DAMAGECOUNT value on done: 89225.0 [2024-08-06 00:12:14,286][52794] Sum rewards: 46.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.108', 'AMMO3': '0.190', 'AMMO4': '0.214', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '41.500'} [2024-08-06 00:12:15,105][52662] DAMAGECOUNT value on done: 92075.0 [2024-08-06 00:12:15,115][52662] Sum rewards: 54.200, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.652', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.700', 'weapon3': '3.016', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '50.000'} [2024-08-06 00:12:15,274][52647] DAMAGECOUNT value on done: 90051.0 [2024-08-06 00:12:15,275][52647] Sum rewards: 54.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.033', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:15,575][52660] DAMAGECOUNT value on done: 85165.0 [2024-08-06 00:12:15,577][52660] Sum rewards: 54.581, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.355', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.180', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:15,656][52668] DAMAGECOUNT value on done: 87403.0 [2024-08-06 00:12:15,656][52668] Sum rewards: 53.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.324', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.980', 'WEAPON3': '1.050', 'weapon3': '2.738', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:16,049][52820] DAMAGECOUNT value on done: 79663.0 [2024-08-06 00:12:16,050][52820] Sum rewards: 53.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.044', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.398', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.312', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:16,286][52650] Updated weights for policy 0, policy_version 20841 (0.0019) [2024-08-06 00:12:16,969][52649] DAMAGECOUNT value on done: 84637.0 [2024-08-06 00:12:16,971][52649] Sum rewards: 55.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.815', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.154', 'AMMO3': '0.165', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.326', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '2.942', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:17,319][52794] DAMAGECOUNT value on done: 88228.0 [2024-08-06 00:12:17,319][52794] Sum rewards: 54.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.134', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.726', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 170754048. Throughput: 0: 4407.4. Samples: 42686860. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:12:17,794][52567] Avg episode reward: [(0, '51.561')] [2024-08-06 00:12:17,825][52658] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:12:18,044][52662] DAMAGECOUNT value on done: 93196.0 [2024-08-06 00:12:18,046][52662] Sum rewards: 39.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.534', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.060', 'weapon5': '0.134', 'AMMO3': '0.148', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'weapon4': '0.874', 'weapon3': '2.144', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '34.000'} [2024-08-06 00:12:18,283][52660] DAMAGECOUNT value on done: 88431.0 [2024-08-06 00:12:18,284][52660] Sum rewards: 47.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.422', 'weapon4': '0.430', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.768', 'DAMAGECOUNT': '11.571', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:18,474][52668] DAMAGECOUNT value on done: 86896.0 [2024-08-06 00:12:18,474][52668] Sum rewards: 44.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.056', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.222', 'weapon5': '0.242', 'AMMO4': '0.242', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.660', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '2.542', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '39.500'} [2024-08-06 00:12:19,226][52820] DAMAGECOUNT value on done: 82871.0 [2024-08-06 00:12:19,228][52820] Sum rewards: 48.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.056', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.029', 'weapon5': '0.056', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.468', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:19,955][52794] DAMAGECOUNT value on done: 89958.0 [2024-08-06 00:12:19,955][52794] Sum rewards: 55.568, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.175', 'weapon2': '0.678', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:20,105][52649] DAMAGECOUNT value on done: 87235.0 [2024-08-06 00:12:20,106][52649] Sum rewards: 54.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.517', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.279', 'weapon2': '0.466', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.256', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:20,554][52662] DAMAGECOUNT value on done: 96505.0 [2024-08-06 00:12:20,554][52662] Sum rewards: 49.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.864', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.214', 'weapon2': '0.604', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.118', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:20,856][52650] Updated weights for policy 0, policy_version 20851 (0.0012) [2024-08-06 00:12:21,222][52660] DAMAGECOUNT value on done: 88028.0 [2024-08-06 00:12:21,224][52660] Sum rewards: 56.988, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.249', 'weapon2': '0.348', 'weapon4': '0.494', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.814', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '50.000'} [2024-08-06 00:12:21,398][52668] DAMAGECOUNT value on done: 88833.0 [2024-08-06 00:12:21,398][52668] Sum rewards: 43.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.166', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.162', 'AMMO3': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.638', 'weapon4': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.294', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '38.000'} [2024-08-06 00:12:22,282][52820] DAMAGECOUNT value on done: 80637.0 [2024-08-06 00:12:22,283][52820] Sum rewards: 42.099, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.008', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.214', 'AMMO4': '0.217', 'AMMO3': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.366', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.540', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:22,645][52794] DAMAGECOUNT value on done: 92381.0 [2024-08-06 00:12:22,647][52794] Sum rewards: 50.422, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.413', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '0.950', 'HITCOUNT': '2.580', 'weapon3': '2.848', 'DAMAGECOUNT': '11.922', 'FRAGCOUNT': '40.500'} [2024-08-06 00:12:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 170835968. Throughput: 0: 4408.9. Samples: 42713570. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:12:22,794][52567] Avg episode reward: [(0, '51.230')] [2024-08-06 00:12:23,096][52649] DAMAGECOUNT value on done: 87855.0 [2024-08-06 00:12:23,097][52649] Sum rewards: 58.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.156', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON4': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:23,615][52662] DAMAGECOUNT value on done: 89698.0 [2024-08-06 00:12:23,616][52662] Sum rewards: 64.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.696', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'weapon4': '0.172', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '53.000'} [2024-08-06 00:12:24,213][52660] DAMAGECOUNT value on done: 87165.0 [2024-08-06 00:12:24,216][52660] Sum rewards: 45.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.221', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.178', 'weapon4': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.854', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '36.000'} [2024-08-06 00:12:24,420][52668] DAMAGECOUNT value on done: 89989.0 [2024-08-06 00:12:24,423][52668] Sum rewards: 53.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.098', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.261', 'weapon4': '0.562', 'weapon2': '0.584', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.478', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:25,493][52820] DAMAGECOUNT value on done: 78279.0 [2024-08-06 00:12:25,493][52820] Sum rewards: 45.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.222', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.168', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:25,561][52794] DAMAGECOUNT value on done: 94178.0 [2024-08-06 00:12:25,565][52794] Sum rewards: 57.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.446', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:25,768][52650] Updated weights for policy 0, policy_version 20861 (0.0019) [2024-08-06 00:12:25,968][52649] DAMAGECOUNT value on done: 82622.0 [2024-08-06 00:12:25,968][52649] Sum rewards: 60.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.192', 'weapon4': '0.246', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.730', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '53.000'} [2024-08-06 00:12:26,406][52662] DAMAGECOUNT value on done: 93655.0 [2024-08-06 00:12:26,407][52662] Sum rewards: 51.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.355', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.208', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:27,223][52660] DAMAGECOUNT value on done: 83986.0 [2024-08-06 00:12:27,224][52660] Sum rewards: 61.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.152', 'AMMO3': '0.208', 'weapon2': '0.342', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.250', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '52.000'} [2024-08-06 00:12:27,432][52668] DAMAGECOUNT value on done: 88315.0 [2024-08-06 00:12:27,435][52668] Sum rewards: 51.910, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.438', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.114', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:27,795][52567] Fps is (10 sec: 16383.2, 60 sec: 17476.1, 300 sec: 17550.3). Total num frames: 170917888. Throughput: 0: 4414.4. Samples: 42740140. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:12:27,796][52567] Avg episode reward: [(0, '51.562')] [2024-08-06 00:12:27,814][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020865_170926080.pth... [2024-08-06 00:12:27,954][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020349_166699008.pth [2024-08-06 00:12:28,729][52649] DAMAGECOUNT value on done: 83578.0 [2024-08-06 00:12:28,729][52649] Sum rewards: 50.042, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO5': '0.006', 'AMMO2': '0.025', 'AMMO3': '0.119', 'AMMO4': '0.127', 'weapon5': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.378', 'weapon2': '0.660', 'WEAPON3': '0.850', 'HITCOUNT': '2.600', 'weapon3': '2.650', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:28,772][52820] DAMAGECOUNT value on done: 80725.0 [2024-08-06 00:12:28,773][52794] DAMAGECOUNT value on done: 90095.0 [2024-08-06 00:12:28,777][52794] Sum rewards: 56.066, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.332', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.160', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:28,775][52820] Sum rewards: 55.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.214', 'weapon4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '47.000'} [2024-08-06 00:12:29,604][52662] DAMAGECOUNT value on done: 91218.0 [2024-08-06 00:12:29,604][52662] Sum rewards: 51.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.172', 'AMMO3': '0.250', 'AMMO4': '0.250', 'weapon4': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '45.500'} [2024-08-06 00:12:30,415][52660] DAMAGECOUNT value on done: 86821.0 [2024-08-06 00:12:30,417][52660] Sum rewards: 64.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO2': '0.043', 'AMMO4': '0.216', 'AMMO3': '0.223', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '56.000'} [2024-08-06 00:12:30,552][52668] DAMAGECOUNT value on done: 90173.0 [2024-08-06 00:12:30,553][52668] Sum rewards: 55.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.389', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.217', 'weapon4': '0.340', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:30,954][52650] Updated weights for policy 0, policy_version 20871 (0.0012) [2024-08-06 00:12:31,886][52794] DAMAGECOUNT value on done: 91763.0 [2024-08-06 00:12:31,887][52794] Sum rewards: 47.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.756', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.126', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:31,970][52820] DAMAGECOUNT value on done: 83565.0 [2024-08-06 00:12:31,970][52820] Sum rewards: 40.039, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.004', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.150', 'weapon4': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.654', 'WEAPON3': '0.850', 'HITCOUNT': '2.340', 'weapon3': '2.952', 'DAMAGECOUNT': '9.972', 'FRAGCOUNT': '34.000'} [2024-08-06 00:12:31,999][52649] DAMAGECOUNT value on done: 81324.0 [2024-08-06 00:12:31,999][52649] Sum rewards: 35.025, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.996', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.063', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.213', 'AMMO4': '0.313', 'weapon2': '0.434', 'WEAPON4': '0.500', 'weapon4': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '10.761', 'FRAGCOUNT': '32.000'} [2024-08-06 00:12:32,204][52803] DAMAGECOUNT value on done: 85954.0 [2024-08-06 00:12:32,205][52803] Sum rewards: 55.100, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.147', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.314', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.600', 'weapon3': '2.710', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:32,357][52669] DAMAGECOUNT value on done: 90448.0 [2024-08-06 00:12:32,357][52669] Sum rewards: 55.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.062', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO4': '0.171', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:32,697][52662] DAMAGECOUNT value on done: 95446.0 [2024-08-06 00:12:32,697][52662] Sum rewards: 57.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.054', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.254', 'AMMO4': '0.267', 'WEAPON4': '0.500', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '50.000'} [2024-08-06 00:12:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 171008000. Throughput: 0: 4409.3. Samples: 42752930. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:12:32,794][52567] Avg episode reward: [(0, '51.781')] [2024-08-06 00:12:32,857][52614] Saving new best policy, reward=51.781! [2024-08-06 00:12:32,920][52660] DAMAGECOUNT value on done: 88133.0 [2024-08-06 00:12:32,921][52660] Sum rewards: 50.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.227', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.248', 'weapon2': '0.328', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '3.082', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:33,028][52668] DAMAGECOUNT value on done: 85181.0 [2024-08-06 00:12:33,029][52668] Sum rewards: 46.909, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.132', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.156', 'WEAPON7': '0.200', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'weapon4': '0.420', 'weapon2': '0.426', 'WEAPON3': '1.700', 'HITCOUNT': '2.720', 'weapon3': '2.862', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:34,615][52794] DAMAGECOUNT value on done: 94915.0 [2024-08-06 00:12:34,615][52794] Sum rewards: 51.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '44.500'} [2024-08-06 00:12:34,797][52649] DAMAGECOUNT value on done: 87823.0 [2024-08-06 00:12:34,797][52649] Sum rewards: 56.485, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.613', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.800', 'HITCOUNT': '3.070', 'weapon3': '3.074', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '52.000'} [2024-08-06 00:12:34,932][52650] Updated weights for policy 0, policy_version 20881 (0.0016) [2024-08-06 00:12:35,064][52820] DAMAGECOUNT value on done: 80245.0 [2024-08-06 00:12:35,065][52820] Sum rewards: 62.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.952', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.404', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '52.000'} [2024-08-06 00:12:35,209][52662] DAMAGECOUNT value on done: 92241.0 [2024-08-06 00:12:35,210][52662] Sum rewards: 54.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.314', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.012', 'weapon5': '0.038', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.492', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.252', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:35,283][52669] DAMAGECOUNT value on done: 87478.0 [2024-08-06 00:12:35,284][52669] Sum rewards: 53.904, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.052', 'WEAPON5': '0.100', 'HEALTH': '0.115', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.374', 'weapon2': '0.644', 'WEAPON3': '0.750', 'HITCOUNT': '2.610', 'weapon3': '2.770', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:35,405][52803] DAMAGECOUNT value on done: 85644.0 [2024-08-06 00:12:35,406][52803] Sum rewards: 51.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.394', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '3.364', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:35,735][52811] DAMAGECOUNT value on done: 85648.0 [2024-08-06 00:12:35,737][52811] Sum rewards: 53.633, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.349', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO4': '0.116', 'AMMO3': '0.134', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.474', 'weapon2': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.586', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:36,274][52660] DAMAGECOUNT value on done: 87029.0 [2024-08-06 00:12:36,276][52660] Sum rewards: 52.228, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.949', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.094', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.308', 'weapon2': '0.520', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.898', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:36,351][52668] DAMAGECOUNT value on done: 86432.0 [2024-08-06 00:12:36,353][52668] Sum rewards: 50.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.087', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:37,380][52794] DAMAGECOUNT value on done: 90378.0 [2024-08-06 00:12:37,383][52794] Sum rewards: 60.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.008', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.205', 'weapon4': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '50.000'} [2024-08-06 00:12:37,481][52649] DAMAGECOUNT value on done: 83560.0 [2024-08-06 00:12:37,483][52649] Sum rewards: 62.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.020', 'weapon5': '0.076', 'AMMO4': '0.098', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.262', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.422', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '51.000'} [2024-08-06 00:12:37,794][52567] Fps is (10 sec: 18842.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 171106304. Throughput: 0: 4393.8. Samples: 42778920. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:12:37,794][52567] Avg episode reward: [(0, '52.352')] [2024-08-06 00:12:37,797][52614] Saving new best policy, reward=52.352! [2024-08-06 00:12:38,191][52820] DAMAGECOUNT value on done: 81956.0 [2024-08-06 00:12:38,191][52820] Sum rewards: 62.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.923', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.022', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.368', 'weapon4': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '51.000'} [2024-08-06 00:12:38,216][52662] DAMAGECOUNT value on done: 91104.0 [2024-08-06 00:12:38,216][52662] Sum rewards: 62.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.987', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.234', 'weapon2': '0.530', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.286', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '53.000'} [2024-08-06 00:12:38,618][52669] DAMAGECOUNT value on done: 87913.0 [2024-08-06 00:12:38,618][52669] Sum rewards: 51.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.419', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.238', 'ARMOR': '0.491', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.426', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:38,649][52803] DAMAGECOUNT value on done: 83623.0 [2024-08-06 00:12:38,649][52803] Sum rewards: 60.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'AMMO2': '0.056', 'AMMO3': '0.197', 'AMMO4': '0.280', 'weapon2': '0.376', 'weapon4': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '52.000'} [2024-08-06 00:12:39,024][52811] DAMAGECOUNT value on done: 78839.0 [2024-08-06 00:12:39,024][52811] Sum rewards: 55.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.242', 'weapon4': '0.246', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.106', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:39,480][52667] DAMAGECOUNT value on done: 88363.0 [2024-08-06 00:12:39,481][52667] Sum rewards: 49.309, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.330', 'ARMOR': '0.004', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO3': '0.127', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.812', 'WEAPON3': '0.950', 'weapon3': '2.804', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '39.500'} [2024-08-06 00:12:39,551][52660] DAMAGECOUNT value on done: 88722.0 [2024-08-06 00:12:39,551][52660] Sum rewards: 60.068, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.283', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '54.000'} [2024-08-06 00:12:39,642][52668] DAMAGECOUNT value on done: 82082.0 [2024-08-06 00:12:39,643][52668] Sum rewards: 47.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.800', 'ARMOR': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.094', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '40.000'} [2024-08-06 00:12:40,037][52650] Updated weights for policy 0, policy_version 20891 (0.0011) [2024-08-06 00:12:40,268][52649] DAMAGECOUNT value on done: 84448.0 [2024-08-06 00:12:40,270][52649] Sum rewards: 65.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.856', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.024', 'weapon4': '0.072', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '55.000'} [2024-08-06 00:12:40,502][52794] DAMAGECOUNT value on done: 93633.0 [2024-08-06 00:12:40,504][52794] Sum rewards: 47.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'AMMO3': '0.224', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:41,283][52662] DAMAGECOUNT value on done: 90006.0 [2024-08-06 00:12:41,283][52662] Sum rewards: 43.344, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.062', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.189', 'AMMO3': '0.273', 'weapon4': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.760', 'WEAPON3': '1.550', 'weapon3': '2.560', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:41,309][52669] DAMAGECOUNT value on done: 86984.0 [2024-08-06 00:12:41,310][52669] Sum rewards: 61.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.554', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.474', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '53.000'} [2024-08-06 00:12:41,361][52820] DAMAGECOUNT value on done: 86019.0 [2024-08-06 00:12:41,365][52820] Sum rewards: 50.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.754', 'AMMO5': '0.015', 'ARMOR': '0.048', 'AMMO2': '0.051', 'weapon5': '0.112', 'AMMO3': '0.223', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON4': '0.600', 'weapon4': '0.724', 'WEAPON3': '1.300', 'weapon3': '2.348', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:41,747][52803] DAMAGECOUNT value on done: 82187.0 [2024-08-06 00:12:41,750][52803] Sum rewards: 47.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.336', 'weapon2': '0.932', 'WEAPON3': '1.350', 'weapon3': '2.554', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:42,154][52811] DAMAGECOUNT value on done: 82078.0 [2024-08-06 00:12:42,155][52811] Sum rewards: 51.565, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.126', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon5': '0.256', 'weapon2': '0.356', 'WEAPON4': '0.500', 'weapon4': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.650', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:42,364][52667] DAMAGECOUNT value on done: 91281.0 [2024-08-06 00:12:42,366][52667] Sum rewards: 52.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.742', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.085', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.538', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '3.132', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:42,586][52660] DAMAGECOUNT value on done: 86807.0 [2024-08-06 00:12:42,587][52660] Sum rewards: 40.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.972', 'AMMO2': '0.018', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.230', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '2.600', 'weapon3': '3.308', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '36.000'} [2024-08-06 00:12:42,648][52668] DAMAGECOUNT value on done: 89187.0 [2024-08-06 00:12:42,649][52668] Sum rewards: 57.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.955', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.141', 'AMMO3': '0.154', 'WEAPON5': '0.250', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.632', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 171188224. Throughput: 0: 4380.4. Samples: 42804760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:12:42,794][52567] Avg episode reward: [(0, '52.667')] [2024-08-06 00:12:42,795][52614] Saving new best policy, reward=52.667! [2024-08-06 00:12:43,494][52794] DAMAGECOUNT value on done: 91932.0 [2024-08-06 00:12:43,495][52794] Sum rewards: 53.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.528', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.133', 'weapon4': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:43,510][52649] DAMAGECOUNT value on done: 85576.0 [2024-08-06 00:12:43,512][52649] Sum rewards: 41.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.159', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.116', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '36.000'} [2024-08-06 00:12:44,014][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:12:44,299][52662] DAMAGECOUNT value on done: 96045.0 [2024-08-06 00:12:44,302][52662] Sum rewards: 57.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.150', 'AMMO4': '0.181', 'weapon5': '0.242', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.582', 'WEAPON3': '0.950', 'weapon3': '2.622', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '47.500'} [2024-08-06 00:12:44,525][52669] DAMAGECOUNT value on done: 89233.0 [2024-08-06 00:12:44,525][52669] Sum rewards: 51.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.058', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.070', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '3.058', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:44,544][52820] DAMAGECOUNT value on done: 84762.0 [2024-08-06 00:12:44,546][52820] Sum rewards: 46.586, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.794', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO4': '0.169', 'AMMO3': '0.258', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.526', 'WEAPON3': '1.450', 'weapon3': '2.570', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:44,719][52650] Updated weights for policy 0, policy_version 20901 (0.0015) [2024-08-06 00:12:44,953][52803] DAMAGECOUNT value on done: 83971.0 [2024-08-06 00:12:44,953][52803] Sum rewards: 37.920, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon4': '0.342', 'weapon2': '0.634', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '2.724', 'DAMAGECOUNT': '10.203', 'FRAGCOUNT': '34.000'} [2024-08-06 00:12:45,417][52811] DAMAGECOUNT value on done: 82649.0 [2024-08-06 00:12:45,418][52811] Sum rewards: 46.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.102', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon4': '0.258', 'weapon2': '0.454', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.076', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '40.000'} [2024-08-06 00:12:45,584][52667] DAMAGECOUNT value on done: 89169.0 [2024-08-06 00:12:45,585][52667] Sum rewards: 55.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.402', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '2.806', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:45,652][52660] DAMAGECOUNT value on done: 86899.0 [2024-08-06 00:12:45,652][52660] Sum rewards: 51.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.952', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.024', 'weapon5': '0.058', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.588', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.118', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '45.500'} [2024-08-06 00:12:45,779][52668] DAMAGECOUNT value on done: 87919.0 [2024-08-06 00:12:45,781][52668] Sum rewards: 59.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.018', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'weapon4': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.804', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:46,612][52794] DAMAGECOUNT value on done: 98154.0 [2024-08-06 00:12:46,613][52794] Sum rewards: 51.694, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.879', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.248', 'weapon2': '0.288', 'WEAPON4': '0.400', 'weapon4': '0.454', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.936', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '47.000'} [2024-08-06 00:12:46,616][52649] DAMAGECOUNT value on done: 84686.0 [2024-08-06 00:12:46,617][52649] Sum rewards: 49.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.362', 'AMMO5': '0.008', 'AMMO2': '0.013', 'ARMOR': '0.024', 'weapon5': '0.056', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.316', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:47,398][52662] DAMAGECOUNT value on done: 88056.0 [2024-08-06 00:12:47,399][52662] Sum rewards: 47.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.014', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.024', 'weapon4': '0.046', 'AMMO4': '0.101', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.808', 'WEAPON3': '0.950', 'HITCOUNT': '2.500', 'weapon3': '2.990', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '40.000'} [2024-08-06 00:12:47,622][52669] DAMAGECOUNT value on done: 89130.0 [2024-08-06 00:12:47,622][52669] Sum rewards: 45.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.174', 'WEAPON7': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.550', 'weapon3': '2.708', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:47,636][52820] DAMAGECOUNT value on done: 82260.0 [2024-08-06 00:12:47,638][52820] Sum rewards: 57.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.514', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.181', 'weapon2': '0.790', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 171270144. Throughput: 0: 4375.1. Samples: 42817750. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:12:47,794][52567] Avg episode reward: [(0, '52.685')] [2024-08-06 00:12:47,797][52614] Saving new best policy, reward=52.685! [2024-08-06 00:12:47,989][52803] DAMAGECOUNT value on done: 82506.0 [2024-08-06 00:12:47,995][52803] Sum rewards: 55.954, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.991', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.046', 'AMMO4': '0.125', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:48,348][52660] DAMAGECOUNT value on done: 85040.0 [2024-08-06 00:12:48,349][52660] Sum rewards: 56.120, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.289', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.163', 'weapon2': '0.648', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '3.158', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:48,455][52667] DAMAGECOUNT value on done: 85382.0 [2024-08-06 00:12:48,455][52667] Sum rewards: 33.540, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.478', 'ARMOR': '0.004', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.258', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.370', 'weapon3': '3.002', 'DAMAGECOUNT': '10.365', 'FRAGCOUNT': '32.000'} [2024-08-06 00:12:48,507][52668] DAMAGECOUNT value on done: 89690.0 [2024-08-06 00:12:48,509][52668] Sum rewards: 55.823, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.024', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO4': '0.183', 'AMMO3': '0.229', 'weapon4': '0.288', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:48,527][52811] DAMAGECOUNT value on done: 80780.0 [2024-08-06 00:12:48,527][52811] Sum rewards: 57.189, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.106', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon2': '0.548', 'weapon4': '0.702', 'WEAPON3': '0.750', 'weapon3': '2.454', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:48,738][52670] Large shaping reward 2.549 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:12:49,573][52650] Updated weights for policy 0, policy_version 20911 (0.0024) [2024-08-06 00:12:49,736][52794] DAMAGECOUNT value on done: 88031.0 [2024-08-06 00:12:49,738][52794] Sum rewards: 55.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.985', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.110', 'AMMO4': '0.127', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.242', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '47.000'} [2024-08-06 00:12:49,825][52649] DAMAGECOUNT value on done: 88427.0 [2024-08-06 00:12:49,827][52649] Sum rewards: 49.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.575', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO3': '0.173', 'AMMO4': '0.195', 'weapon5': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON4': '0.500', 'weapon4': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.564', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '40.500'} [2024-08-06 00:12:50,481][52662] DAMAGECOUNT value on done: 94169.0 [2024-08-06 00:12:50,482][52662] Sum rewards: 47.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.190', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.524', 'weapon4': '0.728', 'WEAPON3': '1.300', 'weapon3': '2.568', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '40.000'} [2024-08-06 00:12:50,995][52803] DAMAGECOUNT value on done: 86073.0 [2024-08-06 00:12:50,999][52803] Sum rewards: 52.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.046', 'AMMO5': '0.003', 'AMMO2': '0.035', 'ARMOR': '0.040', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.219', 'weapon4': '0.318', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '48.000'} [2024-08-06 00:12:51,125][52669] DAMAGECOUNT value on done: 88591.0 [2024-08-06 00:12:51,126][52669] Sum rewards: 49.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.025', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.336', 'weapon2': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '42.000'} [2024-08-06 00:12:51,385][52660] DAMAGECOUNT value on done: 87011.0 [2024-08-06 00:12:51,387][52660] Sum rewards: 68.468, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.316', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.189', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '56.000'} [2024-08-06 00:12:51,458][52668] DAMAGECOUNT value on done: 85752.0 [2024-08-06 00:12:51,459][52668] Sum rewards: 46.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.902', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.204', 'weapon2': '0.844', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.792', 'DAMAGECOUNT': '11.481', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:51,544][52667] DAMAGECOUNT value on done: 90854.0 [2024-08-06 00:12:51,545][52667] Sum rewards: 62.795, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.575', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.164', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.296', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.000'} [2024-08-06 00:12:51,631][52811] DAMAGECOUNT value on done: 84589.0 [2024-08-06 00:12:51,631][52811] Sum rewards: 45.880, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.205', 'ARMOR': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.074', 'AMMO3': '0.213', 'weapon5': '0.220', 'weapon4': '0.314', 'AMMO4': '0.369', 'weapon2': '0.418', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.758', 'DAMAGECOUNT': '12.918', 'FRAGCOUNT': '41.500'} [2024-08-06 00:12:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 171352064. Throughput: 0: 4377.3. Samples: 42844320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:12:52,794][52567] Avg episode reward: [(0, '52.557')] [2024-08-06 00:12:52,880][52794] DAMAGECOUNT value on done: 94319.0 [2024-08-06 00:12:52,881][52794] Sum rewards: 59.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.812', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.062', 'weapon4': '0.086', 'AMMO4': '0.113', 'AMMO3': '0.230', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.388', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 00:12:53,011][52649] DAMAGECOUNT value on done: 88181.0 [2024-08-06 00:12:53,021][52649] Sum rewards: 52.256, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO4': '0.133', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'weapon4': '0.386', 'weapon2': '0.392', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '2.936', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:53,693][52650] Updated weights for policy 0, policy_version 20921 (0.0019) [2024-08-06 00:12:53,785][52662] DAMAGECOUNT value on done: 92340.0 [2024-08-06 00:12:53,785][52662] Sum rewards: 47.397, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.782', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon4': '0.246', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '2.826', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:53,961][52660] DAMAGECOUNT value on done: 87813.0 [2024-08-06 00:12:53,965][52660] Sum rewards: 53.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.010', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'AMMO2': '0.050', 'AMMO3': '0.225', 'AMMO4': '0.251', 'weapon2': '0.322', 'WEAPON4': '0.550', 'weapon4': '0.652', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '47.000'} [2024-08-06 00:12:53,968][52669] DAMAGECOUNT value on done: 87491.0 [2024-08-06 00:12:53,970][52669] Sum rewards: 50.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.242', 'AMMO5': '0.003', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO2': '0.051', 'AMMO3': '0.195', 'AMMO4': '0.257', 'weapon4': '0.268', 'weapon2': '0.440', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.056', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:53,986][52803] DAMAGECOUNT value on done: 81998.0 [2024-08-06 00:12:53,986][52803] Sum rewards: 49.169, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.048', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '45.500'} [2024-08-06 00:12:54,205][52668] DAMAGECOUNT value on done: 86233.0 [2024-08-06 00:12:54,205][52668] Sum rewards: 61.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.260', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '53.000'} [2024-08-06 00:12:54,712][52811] DAMAGECOUNT value on done: 82654.0 [2024-08-06 00:12:54,714][52811] Sum rewards: 43.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.178', 'AMMO4': '0.178', 'weapon5': '0.188', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.674', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.712', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '38.500'} [2024-08-06 00:12:54,736][52667] DAMAGECOUNT value on done: 86420.0 [2024-08-06 00:12:54,737][52667] Sum rewards: 44.493, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.228', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.208', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.414', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.678', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:56,070][52649] DAMAGECOUNT value on done: 80208.0 [2024-08-06 00:12:56,074][52649] Sum rewards: 45.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.090', 'AMMO3': '0.147', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON4': '0.550', 'weapon4': '0.728', 'WEAPON3': '0.900', 'weapon3': '2.418', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '38.000'} [2024-08-06 00:12:56,145][52794] DAMAGECOUNT value on done: 93824.0 [2024-08-06 00:12:56,146][52794] Sum rewards: 44.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.156', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.203', 'weapon5': '0.228', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.900', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '40.000'} [2024-08-06 00:12:56,732][52662] DAMAGECOUNT value on done: 90513.0 [2024-08-06 00:12:56,734][52662] Sum rewards: 48.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO3': '0.185', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.436', 'WEAPON4': '0.550', 'weapon4': '0.758', 'WEAPON3': '1.050', 'weapon3': '2.374', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.004', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:57,016][52660] DAMAGECOUNT value on done: 92644.0 [2024-08-06 00:12:57,018][52660] Sum rewards: 47.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.584', 'ARMOR': '0.008', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'weapon2': '0.496', 'weapon4': '0.620', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:57,034][52803] DAMAGECOUNT value on done: 82830.0 [2024-08-06 00:12:57,034][52803] Sum rewards: 57.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.075', 'ARMOR': '0.024', 'AMMO5': '0.025', 'AMMO2': '0.067', 'weapon5': '0.128', 'AMMO3': '0.202', 'weapon4': '0.286', 'AMMO4': '0.335', 'WEAPON5': '0.550', 'weapon2': '0.694', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.628', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '49.000'} [2024-08-06 00:12:57,079][52669] DAMAGECOUNT value on done: 88568.0 [2024-08-06 00:12:57,080][52669] Sum rewards: 47.686, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.316', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO4': '0.142', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'weapon4': '0.474', 'weapon2': '0.572', 'WEAPON3': '1.550', 'weapon3': '2.608', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '45.000'} [2024-08-06 00:12:57,187][52668] DAMAGECOUNT value on done: 90353.0 [2024-08-06 00:12:57,189][52668] Sum rewards: 56.245, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.242', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.300', 'weapon4': '0.414', 'WEAPON3': '0.700', 'weapon2': '0.848', 'weapon3': '2.438', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '44.000'} [2024-08-06 00:12:57,592][52667] DAMAGECOUNT value on done: 89667.0 [2024-08-06 00:12:57,593][52667] Sum rewards: 49.577, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.371', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.161', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.524', 'weapon2': '0.532', 'WEAPON3': '1.550', 'weapon3': '2.640', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 171442176. Throughput: 0: 4377.3. Samples: 42870610. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:12:57,794][52567] Avg episode reward: [(0, '52.516')] [2024-08-06 00:12:57,851][52811] DAMAGECOUNT value on done: 81892.0 [2024-08-06 00:12:57,854][52811] Sum rewards: 50.134, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.871', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.268', 'WEAPON4': '0.400', 'weapon2': '0.418', 'weapon4': '0.502', 'WEAPON3': '1.550', 'weapon3': '2.754', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '46.000'} [2024-08-06 00:12:58,518][52794] DAMAGECOUNT value on done: 92350.0 [2024-08-06 00:12:58,519][52794] Sum rewards: 45.781, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.183', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '41.000'} [2024-08-06 00:12:58,841][52650] Updated weights for policy 0, policy_version 20931 (0.0019) [2024-08-06 00:12:59,286][52649] DAMAGECOUNT value on done: 88708.0 [2024-08-06 00:12:59,287][52649] Sum rewards: 49.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.251', 'weapon2': '0.280', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.418', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '43.000'} [2024-08-06 00:12:59,895][52660] DAMAGECOUNT value on done: 87623.0 [2024-08-06 00:12:59,896][52660] Sum rewards: 59.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.505', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.210', 'weapon2': '0.704', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:00,035][52668] DAMAGECOUNT value on done: 90470.0 [2024-08-06 00:13:00,036][52668] Sum rewards: 43.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.152', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '3.412', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '38.000'} [2024-08-06 00:13:00,095][52803] DAMAGECOUNT value on done: 79374.0 [2024-08-06 00:13:00,095][52803] Sum rewards: 49.101, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.250', 'weapon2': '0.260', 'AMMO3': '0.262', 'weapon4': '0.266', 'WEAPON3': '1.600', 'HITCOUNT': '2.920', 'weapon3': '3.160', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '45.000'} [2024-08-06 00:13:00,178][52669] DAMAGECOUNT value on done: 86328.0 [2024-08-06 00:13:00,179][52669] Sum rewards: 57.997, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.143', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.848', 'WEAPON3': '0.950', 'weapon3': '2.536', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:00,731][52667] DAMAGECOUNT value on done: 91025.0 [2024-08-06 00:13:00,733][52667] Sum rewards: 57.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.157', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.354', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '50.000'} [2024-08-06 00:13:00,969][52811] DAMAGECOUNT value on done: 84162.0 [2024-08-06 00:13:00,970][52811] Sum rewards: 56.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.778', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.029', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.217', 'WEAPON4': '0.500', 'weapon4': '0.506', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:01,196][52794] DAMAGECOUNT value on done: 96700.0 [2024-08-06 00:13:01,198][52794] Sum rewards: 59.020, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.813', 'AMMO5': '0.009', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.074', 'weapon5': '0.138', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.388', 'weapon4': '0.446', 'WEAPON3': '1.000', 'weapon3': '2.828', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:02,439][52649] DAMAGECOUNT value on done: 84581.0 [2024-08-06 00:13:02,439][52660] DAMAGECOUNT value on done: 88641.0 [2024-08-06 00:13:02,439][52649] Sum rewards: 49.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.786', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.150', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:02,439][52660] Sum rewards: 48.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.170', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.114', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.644', 'WEAPON3': '0.850', 'HITCOUNT': '2.710', 'weapon3': '2.870', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '39.000'} [2024-08-06 00:13:02,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 171540480. Throughput: 0: 4377.1. Samples: 42883830. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:13:02,794][52567] Avg episode reward: [(0, '52.273')] [2024-08-06 00:13:02,923][52669] DAMAGECOUNT value on done: 92200.0 [2024-08-06 00:13:02,923][52669] Sum rewards: 67.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.237', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.026', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.278', 'weapon4': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '58.000'} [2024-08-06 00:13:03,157][52803] DAMAGECOUNT value on done: 85006.0 [2024-08-06 00:13:03,159][52803] Sum rewards: 50.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.934', 'AMMO5': '0.015', 'weapon7': '0.050', 'AMMO2': '0.063', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.568', 'weapon4': '0.866', 'WEAPON3': '1.050', 'weapon3': '2.072', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '46.000'} [2024-08-06 00:13:03,356][52650] Updated weights for policy 0, policy_version 20941 (0.0027) [2024-08-06 00:13:03,497][52614] Signal inference workers to stop experience collection... (3900 times) [2024-08-06 00:13:03,498][52614] Signal inference workers to resume experience collection... (3900 times) [2024-08-06 00:13:03,535][52650] InferenceWorker_p0-w0: stopping experience collection (3900 times) [2024-08-06 00:13:03,536][52650] InferenceWorker_p0-w0: resuming experience collection (3900 times) [2024-08-06 00:13:03,960][52667] DAMAGECOUNT value on done: 89464.0 [2024-08-06 00:13:03,960][52667] Sum rewards: 60.496, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.198', 'weapon2': '0.344', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2024-08-06 00:13:04,116][52811] DAMAGECOUNT value on done: 83489.0 [2024-08-06 00:13:04,116][52811] Sum rewards: 56.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.006', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.458', 'weapon4': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.564', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:04,130][52794] DAMAGECOUNT value on done: 92380.0 [2024-08-06 00:13:04,130][52794] Sum rewards: 54.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon4': '0.370', 'weapon2': '0.508', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.896', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:05,357][52649] DAMAGECOUNT value on done: 88605.0 [2024-08-06 00:13:05,359][52649] Sum rewards: 58.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.152', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '50.000'} [2024-08-06 00:13:05,736][52660] DAMAGECOUNT value on done: 85681.0 [2024-08-06 00:13:05,737][52660] Sum rewards: 50.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.194', 'AMMO4': '0.201', 'AMMO3': '0.207', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '43.500'} [2024-08-06 00:13:05,739][52669] DAMAGECOUNT value on done: 89770.0 [2024-08-06 00:13:05,740][52669] Sum rewards: 50.513, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '2.886', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:06,199][52803] DAMAGECOUNT value on done: 85192.0 [2024-08-06 00:13:06,201][52803] Sum rewards: 51.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.868', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.414', 'weapon2': '0.736', 'WEAPON3': '1.100', 'weapon3': '2.356', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '44.000'} [2024-08-06 00:13:06,806][52667] DAMAGECOUNT value on done: 90823.0 [2024-08-06 00:13:06,806][52667] Sum rewards: 48.103, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.653', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO4': '0.193', 'AMMO3': '0.230', 'weapon4': '0.264', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '3.042', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '46.000'} [2024-08-06 00:13:07,290][52811] DAMAGECOUNT value on done: 83704.0 [2024-08-06 00:13:07,290][52811] Sum rewards: 53.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.376', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon2': '0.244', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.444', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.088', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:07,683][52650] Updated weights for policy 0, policy_version 20951 (0.0030) [2024-08-06 00:13:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 171630592. Throughput: 0: 4372.0. Samples: 42910310. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:13:07,794][52567] Avg episode reward: [(0, '52.552')] [2024-08-06 00:13:08,196][52649] DAMAGECOUNT value on done: 87082.0 [2024-08-06 00:13:08,198][52649] Sum rewards: 51.980, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.749', 'AMMO5': '0.003', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.212', 'weapon4': '0.444', 'weapon2': '0.486', 'WEAPON3': '0.850', 'weapon3': '2.632', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:08,741][52669] DAMAGECOUNT value on done: 87011.0 [2024-08-06 00:13:08,748][52669] Sum rewards: 60.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'ARMOR': '0.013', 'AMMO2': '0.039', 'weapon5': '0.070', 'AMMO3': '0.172', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.324', 'weapon4': '0.352', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.044', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '52.000'} [2024-08-06 00:13:08,968][52660] DAMAGECOUNT value on done: 90484.0 [2024-08-06 00:13:08,971][52660] Sum rewards: 38.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.114', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '3.062', 'DAMAGECOUNT': '11.331', 'FRAGCOUNT': '36.000'} [2024-08-06 00:13:09,443][52803] DAMAGECOUNT value on done: 82008.0 [2024-08-06 00:13:09,445][52803] Sum rewards: 58.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.356', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.124', 'weapon4': '0.162', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '51.000'} [2024-08-06 00:13:09,465][52667] DAMAGECOUNT value on done: 88628.0 [2024-08-06 00:13:09,466][52667] Sum rewards: 55.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon4': '0.210', 'weapon2': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.236', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:10,349][52811] DAMAGECOUNT value on done: 81911.0 [2024-08-06 00:13:10,349][52811] Sum rewards: 44.859, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.590', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.118', 'weapon5': '0.124', 'AMMO4': '0.204', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '2.886', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:11,318][52649] DAMAGECOUNT value on done: 91418.0 [2024-08-06 00:13:11,318][52649] Sum rewards: 40.177, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.243', 'weapon2': '0.602', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '2.916', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '37.000'} [2024-08-06 00:13:11,383][52669] DAMAGECOUNT value on done: 89583.0 [2024-08-06 00:13:11,413][52669] Sum rewards: 41.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.416', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.142', 'DAMAGECOUNT': '11.394', 'FRAGCOUNT': '38.000'} [2024-08-06 00:13:12,007][52667] DAMAGECOUNT value on done: 87876.0 [2024-08-06 00:13:12,009][52667] Sum rewards: 61.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.058', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '53.000'} [2024-08-06 00:13:12,228][52660] DAMAGECOUNT value on done: 87105.0 [2024-08-06 00:13:12,228][52660] Sum rewards: 57.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.636', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '51.000'} [2024-08-06 00:13:12,752][52803] DAMAGECOUNT value on done: 83609.0 [2024-08-06 00:13:12,753][52803] Sum rewards: 59.348, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon4': '0.226', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 171704320. Throughput: 0: 4370.7. Samples: 42936820. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:13:12,795][52567] Avg episode reward: [(0, '52.322')] [2024-08-06 00:13:12,925][52650] Updated weights for policy 0, policy_version 20961 (0.0021) [2024-08-06 00:13:13,436][52811] DAMAGECOUNT value on done: 85201.0 [2024-08-06 00:13:13,436][52811] Sum rewards: 59.687, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.438', 'weapon2': '0.562', 'WEAPON3': '0.950', 'weapon3': '2.778', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:14,043][52669] DAMAGECOUNT value on done: 92918.0 [2024-08-06 00:13:14,052][52669] Sum rewards: 43.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.439', 'weapon5': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.452', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.380', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '39.000'} [2024-08-06 00:13:14,312][52658] DAMAGECOUNT value on done: 90356.0 [2024-08-06 00:13:14,315][52658] Sum rewards: 48.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'weapon4': '0.414', 'weapon2': '0.480', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.852', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:14,749][52667] DAMAGECOUNT value on done: 89300.0 [2024-08-06 00:13:14,751][52667] Sum rewards: 47.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.104', 'AMMO4': '0.166', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '3.160', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:15,794][52803] DAMAGECOUNT value on done: 83162.0 [2024-08-06 00:13:15,797][52803] Sum rewards: 65.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.255', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.278', 'weapon2': '0.412', 'WEAPON3': '1.700', 'weapon3': '3.316', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '58.000'} [2024-08-06 00:13:16,356][52669] DAMAGECOUNT value on done: 95441.0 [2024-08-06 00:13:16,359][52669] Sum rewards: 53.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:16,485][52811] DAMAGECOUNT value on done: 82334.0 [2024-08-06 00:13:16,485][52811] Sum rewards: 48.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.062', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '3.164', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '40.000'} [2024-08-06 00:13:16,980][52658] DAMAGECOUNT value on done: 88934.0 [2024-08-06 00:13:16,981][52658] Sum rewards: 41.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'ARMOR': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon5': '0.182', 'weapon4': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.824', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '37.000'} [2024-08-06 00:13:17,092][52650] Updated weights for policy 0, policy_version 20971 (0.0016) [2024-08-06 00:13:17,448][52667] DAMAGECOUNT value on done: 87518.0 [2024-08-06 00:13:17,450][52667] Sum rewards: 52.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.954', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.199', 'AMMO3': '0.200', 'weapon4': '0.388', 'WEAPON4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.662', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 171794432. Throughput: 0: 4379.8. Samples: 42950020. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:13:17,794][52567] Avg episode reward: [(0, '51.771')] [2024-08-06 00:13:18,860][52803] DAMAGECOUNT value on done: 80311.0 [2024-08-06 00:13:18,862][52803] Sum rewards: 58.130, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.557', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.114', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon4': '0.466', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:19,457][52669] DAMAGECOUNT value on done: 90904.0 [2024-08-06 00:13:19,465][52669] Sum rewards: 53.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.188', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.172', 'weapon2': '0.486', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.098', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '45.000'} [2024-08-06 00:13:19,617][52811] DAMAGECOUNT value on done: 85038.0 [2024-08-06 00:13:19,618][52811] Sum rewards: 53.507, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.361', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'AMMO3': '0.269', 'weapon2': '0.442', 'WEAPON4': '0.500', 'weapon4': '0.510', 'WEAPON3': '1.600', 'weapon3': '2.656', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:20,090][52658] DAMAGECOUNT value on done: 88885.0 [2024-08-06 00:13:20,092][52658] Sum rewards: 49.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO2': '0.031', 'weapon4': '0.130', 'AMMO4': '0.156', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.158', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:20,518][52667] DAMAGECOUNT value on done: 89461.0 [2024-08-06 00:13:20,518][52667] Sum rewards: 61.489, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.018', 'ARMOR': '0.028', 'AMMO4': '0.090', 'weapon5': '0.204', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.410', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.602', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '54.000'} [2024-08-06 00:13:21,851][52803] DAMAGECOUNT value on done: 83622.0 [2024-08-06 00:13:21,851][52803] Sum rewards: 55.692, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.300', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'weapon4': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.188', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:21,898][52650] Updated weights for policy 0, policy_version 20981 (0.0023) [2024-08-06 00:13:22,113][52666] DAMAGECOUNT value on done: 88524.0 [2024-08-06 00:13:22,114][52666] Sum rewards: 57.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.935', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.126', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.640', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.096', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:22,472][52669] DAMAGECOUNT value on done: 88242.0 [2024-08-06 00:13:22,475][52669] Sum rewards: 41.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.468', 'AMMO5': '0.014', 'ARMOR': '0.028', 'AMMO2': '0.041', 'weapon5': '0.152', 'AMMO4': '0.206', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.450', 'weapon2': '0.924', 'WEAPON3': '1.400', 'weapon3': '2.322', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '38.000'} [2024-08-06 00:13:22,604][52811] DAMAGECOUNT value on done: 84739.0 [2024-08-06 00:13:22,605][52811] Sum rewards: 53.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.165', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:22,795][52567] Fps is (10 sec: 18840.9, 60 sec: 17612.6, 300 sec: 17605.8). Total num frames: 171892736. Throughput: 0: 4381.5. Samples: 42976090. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:13:22,795][52567] Avg episode reward: [(0, '51.953')] [2024-08-06 00:13:22,798][52658] DAMAGECOUNT value on done: 90773.0 [2024-08-06 00:13:22,800][52658] Sum rewards: 53.442, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.046', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.243', 'weapon2': '0.520', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.114', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '47.500'} [2024-08-06 00:13:23,222][52667] DAMAGECOUNT value on done: 94830.0 [2024-08-06 00:13:23,224][52667] Sum rewards: 49.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'AMMO3': '0.229', 'WEAPON4': '0.400', 'weapon4': '0.470', 'weapon2': '0.676', 'WEAPON3': '1.350', 'weapon3': '2.464', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '44.000'} [2024-08-06 00:13:24,902][52803] DAMAGECOUNT value on done: 83590.0 [2024-08-06 00:13:24,912][52803] Sum rewards: 58.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.181', 'AMMO3': '0.195', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '49.500'} [2024-08-06 00:13:25,067][52666] DAMAGECOUNT value on done: 88787.0 [2024-08-06 00:13:25,068][52666] Sum rewards: 51.886, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.407', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.255', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.696', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '45.000'} [2024-08-06 00:13:25,588][52669] DAMAGECOUNT value on done: 89210.0 [2024-08-06 00:13:25,588][52669] Sum rewards: 40.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.084', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.418', 'WEAPON3': '1.500', 'HITCOUNT': '2.450', 'weapon3': '3.298', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '39.000'} [2024-08-06 00:13:25,589][52658] DAMAGECOUNT value on done: 91737.0 [2024-08-06 00:13:25,589][52658] Sum rewards: 55.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.236', 'weapon2': '0.484', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.146', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:25,604][52811] DAMAGECOUNT value on done: 84166.0 [2024-08-06 00:13:25,605][52811] Sum rewards: 51.369, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.074', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO2': '0.060', 'AMMO3': '0.214', 'AMMO4': '0.298', 'weapon4': '0.648', 'WEAPON4': '0.650', 'weapon2': '0.786', 'WEAPON3': '1.250', 'weapon3': '2.234', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '45.500'} [2024-08-06 00:13:26,031][52667] DAMAGECOUNT value on done: 90819.0 [2024-08-06 00:13:26,032][52667] Sum rewards: 57.774, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.090', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.098', 'AMMO4': '0.218', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.380', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.822', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '53.000'} [2024-08-06 00:13:26,857][52650] Updated weights for policy 0, policy_version 20991 (0.0027) [2024-08-06 00:13:27,736][52666] DAMAGECOUNT value on done: 91249.0 [2024-08-06 00:13:27,736][52666] Sum rewards: 43.907, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.287', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.292', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '38.000'} [2024-08-06 00:13:27,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.5, 300 sec: 17605.9). Total num frames: 171982848. Throughput: 0: 4391.3. Samples: 43002370. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:13:27,794][52567] Avg episode reward: [(0, '52.231')] [2024-08-06 00:13:27,869][52803] DAMAGECOUNT value on done: 87286.0 [2024-08-06 00:13:27,869][52803] Sum rewards: 61.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.230', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'weapon2': '0.398', 'weapon4': '0.428', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2024-08-06 00:13:28,457][52658] DAMAGECOUNT value on done: 87061.0 [2024-08-06 00:13:28,458][52658] Sum rewards: 50.140, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.030', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.144', 'AMMO3': '0.190', 'AMMO4': '0.287', 'WEAPON5': '0.400', 'weapon2': '0.438', 'weapon4': '0.530', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '45.000'} [2024-08-06 00:13:28,532][52669] DAMAGECOUNT value on done: 88799.0 [2024-08-06 00:13:28,533][52669] Sum rewards: 58.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.034', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.182', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:28,685][52811] DAMAGECOUNT value on done: 85713.0 [2024-08-06 00:13:28,685][52811] Sum rewards: 47.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.007', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '2.672', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '39.500'} [2024-08-06 00:13:29,050][52667] DAMAGECOUNT value on done: 96012.0 [2024-08-06 00:13:29,051][52667] Sum rewards: 65.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.109', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.304', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '56.000'} [2024-08-06 00:13:30,135][52663] DAMAGECOUNT value on done: 88507.0 [2024-08-06 00:13:30,136][52663] Sum rewards: 38.359, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'weapon5': '0.160', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'weapon4': '0.412', 'weapon2': '0.424', 'WEAPON3': '1.550', 'HITCOUNT': '2.420', 'weapon3': '2.778', 'DAMAGECOUNT': '10.938', 'FRAGCOUNT': '37.000'} [2024-08-06 00:13:30,151][52670] DAMAGECOUNT value on done: 86217.0 [2024-08-06 00:13:30,152][52670] Sum rewards: 49.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.456', 'weapon2': '0.702', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:30,696][52666] DAMAGECOUNT value on done: 83826.0 [2024-08-06 00:13:30,697][52666] Sum rewards: 42.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.098', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.014', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.438', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '3.174', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '38.000'} [2024-08-06 00:13:30,933][52650] Updated weights for policy 0, policy_version 21001 (0.0024) [2024-08-06 00:13:31,002][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:13:31,099][52803] DAMAGECOUNT value on done: 79689.0 [2024-08-06 00:13:31,102][52803] Sum rewards: 52.721, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'weapon4': '0.370', 'ARMOR': '0.404', 'weapon2': '0.682', 'WEAPON3': '0.900', 'HITCOUNT': '2.600', 'weapon3': '2.800', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '43.000'} [2024-08-06 00:13:31,475][52658] DAMAGECOUNT value on done: 94338.0 [2024-08-06 00:13:31,477][52658] Sum rewards: 54.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.583', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.212', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '49.500'} [2024-08-06 00:13:31,793][52667] DAMAGECOUNT value on done: 87857.0 [2024-08-06 00:13:31,795][52667] Sum rewards: 56.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.566', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.098', 'AMMO3': '0.155', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.736', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '46.000'} [2024-08-06 00:13:31,810][52811] DAMAGECOUNT value on done: 82281.0 [2024-08-06 00:13:31,811][52811] Sum rewards: 46.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.904', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '0.282', 'weapon4': '0.294', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.278', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:32,794][52567] Fps is (10 sec: 16384.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 172056576. Throughput: 0: 4390.7. Samples: 43015330. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:13:32,794][52567] Avg episode reward: [(0, '52.254')] [2024-08-06 00:13:33,115][52663] DAMAGECOUNT value on done: 89752.0 [2024-08-06 00:13:33,115][52663] Sum rewards: 57.590, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.991', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.123', 'WEAPON4': '0.250', 'weapon4': '0.328', 'WEAPON3': '0.800', 'weapon2': '0.948', 'weapon3': '2.606', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '46.000'} [2024-08-06 00:13:33,434][52670] DAMAGECOUNT value on done: 90755.0 [2024-08-06 00:13:33,436][52670] Sum rewards: 47.376, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.684', 'AMMO5': '0.006', 'AMMO2': '0.058', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'AMMO4': '0.291', 'ARMOR': '0.416', 'weapon4': '0.554', 'weapon2': '0.638', 'WEAPON4': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.410', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '45.000'} [2024-08-06 00:13:33,854][52666] DAMAGECOUNT value on done: 87257.0 [2024-08-06 00:13:33,856][52666] Sum rewards: 43.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.298', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO2': '0.054', 'weapon5': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.249', 'AMMO4': '0.269', 'WEAPON4': '0.600', 'weapon2': '0.606', 'WEAPON3': '1.500', 'HITCOUNT': '2.710', 'weapon3': '2.850', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '41.500'} [2024-08-06 00:13:33,984][52658] DAMAGECOUNT value on done: 87426.0 [2024-08-06 00:13:33,985][52658] Sum rewards: 47.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.108', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.330', 'weapon4': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '2.928', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:34,377][52667] DAMAGECOUNT value on done: 92925.0 [2024-08-06 00:13:34,380][52667] Sum rewards: 47.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.256', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.088', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.130', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:34,711][52811] DAMAGECOUNT value on done: 84246.0 [2024-08-06 00:13:34,711][52811] Sum rewards: 47.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.252', 'ARMOR': '0.028', 'AMMO2': '0.038', 'AMMO3': '0.170', 'AMMO4': '0.191', 'weapon2': '0.332', 'WEAPON4': '0.550', 'weapon4': '0.812', 'WEAPON3': '1.050', 'weapon3': '2.606', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:35,751][52663] DAMAGECOUNT value on done: 90600.0 [2024-08-06 00:13:35,753][52663] Sum rewards: 55.372, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.168', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '46.000'} [2024-08-06 00:13:36,090][52650] Updated weights for policy 0, policy_version 21011 (0.0032) [2024-08-06 00:13:36,183][52670] DAMAGECOUNT value on done: 85787.0 [2024-08-06 00:13:36,184][52670] Sum rewards: 38.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon5': '0.052', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.924', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.712', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '33.000'} [2024-08-06 00:13:36,608][52666] DAMAGECOUNT value on done: 85428.0 [2024-08-06 00:13:36,610][52666] Sum rewards: 39.705, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.942', 'ARMOR': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon2': '0.304', 'AMMO3': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.850', 'HITCOUNT': '2.980', 'weapon3': '3.016', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '39.000'} [2024-08-06 00:13:36,972][52658] DAMAGECOUNT value on done: 92905.0 [2024-08-06 00:13:36,974][52658] Sum rewards: 56.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.549', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.214', 'weapon4': '0.332', 'weapon2': '0.348', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:37,070][52658] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 00:13:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 172154880. Throughput: 0: 4388.0. Samples: 43041780. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:13:37,795][52567] Avg episode reward: [(0, '51.717')] [2024-08-06 00:13:38,091][52665] DAMAGECOUNT value on done: 85817.0 [2024-08-06 00:13:38,092][52665] Sum rewards: 56.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.203', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:38,847][52663] DAMAGECOUNT value on done: 91180.0 [2024-08-06 00:13:38,847][52663] Sum rewards: 50.628, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.040', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.296', 'weapon2': '0.398', 'WEAPON3': '1.750', 'HITCOUNT': '3.160', 'weapon3': '3.254', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:39,322][52670] DAMAGECOUNT value on done: 88992.0 [2024-08-06 00:13:39,322][52670] Sum rewards: 43.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.878', 'AMMO5': '0.008', 'weapon5': '0.028', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.174', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.510', 'weapon2': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.656', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '38.000'} [2024-08-06 00:13:39,600][52658] DAMAGECOUNT value on done: 91774.0 [2024-08-06 00:13:39,601][52658] Sum rewards: 54.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.042', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.712', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '45.000'} [2024-08-06 00:13:39,739][52666] DAMAGECOUNT value on done: 85737.0 [2024-08-06 00:13:39,741][52666] Sum rewards: 55.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.816', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.436', 'weapon4': '0.496', 'WEAPON3': '1.600', 'weapon3': '2.764', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:40,079][52795] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2024-08-06 00:13:40,542][52650] Updated weights for policy 0, policy_version 21021 (0.0032) [2024-08-06 00:13:40,573][52665] DAMAGECOUNT value on done: 93614.0 [2024-08-06 00:13:40,575][52665] Sum rewards: 58.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.864', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.248', 'weapon4': '0.284', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.170', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '51.000'} [2024-08-06 00:13:41,419][52671] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon5', 0.002)] [2024-08-06 00:13:41,574][52663] DAMAGECOUNT value on done: 86944.0 [2024-08-06 00:13:41,576][52663] Sum rewards: 51.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.575', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '44.000'} [2024-08-06 00:13:42,649][52658] DAMAGECOUNT value on done: 92228.0 [2024-08-06 00:13:42,650][52658] Sum rewards: 59.278, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.666', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.056', 'weapon4': '0.108', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.172', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '50.000'} [2024-08-06 00:13:42,662][52670] DAMAGECOUNT value on done: 86988.0 [2024-08-06 00:13:42,663][52670] Sum rewards: 53.155, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.158', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 172244992. Throughput: 0: 4394.4. Samples: 43068360. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:13:42,794][52567] Avg episode reward: [(0, '51.929')] [2024-08-06 00:13:42,959][52666] DAMAGECOUNT value on done: 86440.0 [2024-08-06 00:13:42,962][52666] Sum rewards: 57.751, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.197', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.138', 'weapon2': '0.252', 'WEAPON3': '0.900', 'HITCOUNT': '3.000', 'weapon3': '3.632', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '45.000'} [2024-08-06 00:13:43,266][52665] DAMAGECOUNT value on done: 87226.0 [2024-08-06 00:13:43,266][52665] Sum rewards: 50.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.048', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.239', 'weapon2': '0.348', 'WEAPON4': '0.450', 'weapon4': '0.722', 'WEAPON3': '0.900', 'weapon3': '2.398', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:44,038][52663] DAMAGECOUNT value on done: 92037.0 [2024-08-06 00:13:44,038][52663] Sum rewards: 49.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.941', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.192', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon5': '0.316', 'WEAPON5': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.616', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '41.500'} [2024-08-06 00:13:45,143][52650] Updated weights for policy 0, policy_version 21031 (0.0011) [2024-08-06 00:13:45,343][52658] DAMAGECOUNT value on done: 87630.0 [2024-08-06 00:13:45,344][52658] Sum rewards: 44.721, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.230', 'weapon2': '0.372', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '2.930', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '40.000'} [2024-08-06 00:13:45,519][52670] DAMAGECOUNT value on done: 90403.0 [2024-08-06 00:13:45,519][52670] Sum rewards: 57.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.129', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.054', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.259', 'weapon2': '0.452', 'WEAPON3': '1.500', 'HITCOUNT': '2.720', 'weapon3': '3.144', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '52.000'} [2024-08-06 00:13:45,916][52665] DAMAGECOUNT value on done: 85057.0 [2024-08-06 00:13:45,917][52665] Sum rewards: 59.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.263', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon4': '0.212', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:46,013][52666] DAMAGECOUNT value on done: 91937.0 [2024-08-06 00:13:46,014][52666] Sum rewards: 51.899, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.240', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.049', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.246', 'AMMO3': '0.252', 'weapon4': '0.326', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.776', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:46,652][52663] DAMAGECOUNT value on done: 92074.0 [2024-08-06 00:13:46,660][52663] Sum rewards: 32.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.088', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.148', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.406', 'WEAPON4': '0.450', 'weapon2': '0.662', 'WEAPON3': '1.400', 'HITCOUNT': '2.400', 'weapon3': '2.538', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '32.000'} [2024-08-06 00:13:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 172326912. Throughput: 0: 4390.9. Samples: 43081420. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:13:47,794][52567] Avg episode reward: [(0, '51.986')] [2024-08-06 00:13:47,963][52658] DAMAGECOUNT value on done: 89713.0 [2024-08-06 00:13:47,963][52658] Sum rewards: 57.111, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.224', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.282', 'weapon2': '0.348', 'WEAPON3': '1.650', 'HITCOUNT': '3.090', 'weapon3': '3.298', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '54.000'} [2024-08-06 00:13:48,004][52670] DAMAGECOUNT value on done: 84792.0 [2024-08-06 00:13:48,004][52670] Sum rewards: 49.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.966', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.108', 'AMMO3': '0.197', 'weapon4': '0.226', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.894', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '43.000'} [2024-08-06 00:13:48,422][52666] DAMAGECOUNT value on done: 89303.0 [2024-08-06 00:13:48,423][52666] Sum rewards: 57.922, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.045', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.199', 'AMMO3': '0.262', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.544', 'WEAPON3': '1.500', 'weapon3': '2.792', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '51.000'} [2024-08-06 00:13:49,060][52665] DAMAGECOUNT value on done: 86739.0 [2024-08-06 00:13:49,062][52665] Sum rewards: 36.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.887', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.450', 'weapon2': '0.528', 'weapon4': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.414', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '33.000'} [2024-08-06 00:13:49,350][52663] DAMAGECOUNT value on done: 87435.0 [2024-08-06 00:13:49,350][52663] Sum rewards: 43.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.846', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon7': '0.050', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'AMMO4': '0.197', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.578', 'weapon4': '0.798', 'WEAPON3': '0.950', 'weapon3': '2.110', 'HITCOUNT': '2.440', 'DAMAGECOUNT': '10.176', 'FRAGCOUNT': '38.000'} [2024-08-06 00:13:49,985][52650] Updated weights for policy 0, policy_version 21041 (0.0017) [2024-08-06 00:13:50,810][52670] DAMAGECOUNT value on done: 87075.0 [2024-08-06 00:13:50,811][52670] Sum rewards: 53.860, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.116', 'AMMO3': '0.191', 'weapon2': '0.542', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.134', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '44.000'} [2024-08-06 00:13:50,904][52658] DAMAGECOUNT value on done: 88444.0 [2024-08-06 00:13:50,904][52658] Sum rewards: 63.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '52.000'} [2024-08-06 00:13:51,189][52666] DAMAGECOUNT value on done: 88097.0 [2024-08-06 00:13:51,191][52666] Sum rewards: 58.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.835', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.402', 'weapon4': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '50.000'} [2024-08-06 00:13:51,507][52664] DAMAGECOUNT value on done: 91769.0 [2024-08-06 00:13:51,507][52664] Sum rewards: 60.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.235', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.157', 'weapon5': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:51,894][52665] DAMAGECOUNT value on done: 90352.0 [2024-08-06 00:13:51,897][52665] Sum rewards: 49.549, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.042', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.037', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '1.086', 'WEAPON3': '1.200', 'weapon3': '2.520', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:52,239][52663] DAMAGECOUNT value on done: 89366.0 [2024-08-06 00:13:52,239][52663] Sum rewards: 42.456, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.060', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.062', 'AMMO4': '0.081', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'weapon2': '0.798', 'WEAPON3': '1.800', 'weapon3': '2.720', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '41.000'} [2024-08-06 00:13:52,268][52795] DAMAGECOUNT value on done: 82028.0 [2024-08-06 00:13:52,268][52795] Sum rewards: 48.242, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.274', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.138', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.764', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.501', 'FRAGCOUNT': '40.000'} [2024-08-06 00:13:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 172417024. Throughput: 0: 4394.4. Samples: 43108060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:13:52,794][52567] Avg episode reward: [(0, '51.942')] [2024-08-06 00:13:53,741][52670] DAMAGECOUNT value on done: 83066.0 [2024-08-06 00:13:53,744][52670] Sum rewards: 45.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.184', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.266', 'weapon4': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.236', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '40.000'} [2024-08-06 00:13:53,950][52658] DAMAGECOUNT value on done: 87336.0 [2024-08-06 00:13:53,951][52658] Sum rewards: 48.212, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.110', 'HEALTH': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.898', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '2.780', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '40.000'} [2024-08-06 00:13:53,982][52664] DAMAGECOUNT value on done: 92628.0 [2024-08-06 00:13:53,982][52664] Sum rewards: 57.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.137', 'weapon5': '0.140', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon2': '0.606', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.644', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:54,194][52666] DAMAGECOUNT value on done: 85315.0 [2024-08-06 00:13:54,194][52666] Sum rewards: 51.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'ARMOR': '0.032', 'AMMO2': '0.043', 'weapon5': '0.058', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'WEAPON4': '0.550', 'weapon4': '0.628', 'weapon2': '0.826', 'WEAPON3': '1.050', 'weapon3': '2.256', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '43.000'} [2024-08-06 00:13:54,465][52650] Updated weights for policy 0, policy_version 21051 (0.0013) [2024-08-06 00:13:54,947][52665] DAMAGECOUNT value on done: 89964.0 [2024-08-06 00:13:54,949][52665] Sum rewards: 49.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.714', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.336', 'weapon4': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '42.000'} [2024-08-06 00:13:55,446][52795] DAMAGECOUNT value on done: 78257.0 [2024-08-06 00:13:55,447][52795] Sum rewards: 49.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.978', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.208', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.720', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '43.000'} [2024-08-06 00:13:55,473][52663] DAMAGECOUNT value on done: 93174.0 [2024-08-06 00:13:55,473][52663] Sum rewards: 55.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.976', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.102', 'weapon4': '0.146', 'AMMO4': '0.168', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.070', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:56,549][52658] DAMAGECOUNT value on done: 92122.0 [2024-08-06 00:13:56,551][52658] Sum rewards: 42.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.297', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.032', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.322', 'weapon2': '0.874', 'WEAPON3': '1.350', 'weapon3': '2.640', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '37.000'} [2024-08-06 00:13:56,806][52664] DAMAGECOUNT value on done: 94170.0 [2024-08-06 00:13:56,807][52664] Sum rewards: 49.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.199', 'weapon2': '0.472', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '3.376', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '44.000'} [2024-08-06 00:13:56,938][52670] DAMAGECOUNT value on done: 81111.0 [2024-08-06 00:13:56,940][52670] Sum rewards: 46.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.346', 'weapon2': '0.684', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '2.714', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '43.000'} [2024-08-06 00:13:57,412][52666] DAMAGECOUNT value on done: 86672.0 [2024-08-06 00:13:57,414][52666] Sum rewards: 56.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'weapon4': '0.406', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '48.000'} [2024-08-06 00:13:57,449][52671] DAMAGECOUNT value on done: 94346.0 [2024-08-06 00:13:57,449][52671] Sum rewards: 52.873, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.070', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.850', 'weapon3': '2.938', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '49.000'} [2024-08-06 00:13:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 172507136. Throughput: 0: 4387.6. Samples: 43134260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:13:57,794][52567] Avg episode reward: [(0, '51.435')] [2024-08-06 00:13:57,984][52665] DAMAGECOUNT value on done: 89660.0 [2024-08-06 00:13:57,984][52665] Sum rewards: 54.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.140', 'AMMO3': '0.205', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '47.000'} [2024-08-06 00:13:58,284][52663] DAMAGECOUNT value on done: 90517.0 [2024-08-06 00:13:58,285][52663] Sum rewards: 59.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.728', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.186', 'weapon4': '0.218', 'weapon2': '0.286', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.354', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '50.000'} [2024-08-06 00:13:58,646][52795] DAMAGECOUNT value on done: 80404.0 [2024-08-06 00:13:58,646][52795] Sum rewards: 43.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.242', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.050', 'weapon7': '0.052', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.430', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.590', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '39.000'} [2024-08-06 00:13:59,105][52650] Updated weights for policy 0, policy_version 21061 (0.0011) [2024-08-06 00:13:59,108][52664] DAMAGECOUNT value on done: 91618.0 [2024-08-06 00:13:59,110][52664] Sum rewards: 60.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.319', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.678', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '50.000'} [2024-08-06 00:13:59,523][52658] DAMAGECOUNT value on done: 93264.0 [2024-08-06 00:13:59,525][52658] Sum rewards: 47.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.832', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.042', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'AMMO4': '0.247', 'AMMO3': '0.256', 'weapon2': '0.380', 'WEAPON4': '0.500', 'weapon4': '0.672', 'WEAPON3': '1.600', 'weapon3': '2.670', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '43.000'} [2024-08-06 00:14:00,122][52670] DAMAGECOUNT value on done: 89547.0 [2024-08-06 00:14:00,122][52670] Sum rewards: 62.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.406', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.062', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.634', 'WEAPON3': '0.850', 'HITCOUNT': '3.030', 'weapon3': '3.048', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '50.000'} [2024-08-06 00:14:00,359][52671] DAMAGECOUNT value on done: 89014.0 [2024-08-06 00:14:00,360][52671] Sum rewards: 37.738, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.018', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.206', 'AMMO3': '0.263', 'weapon4': '0.428', 'WEAPON4': '0.500', 'weapon2': '0.916', 'WEAPON3': '1.550', 'HITCOUNT': '2.240', 'weapon3': '2.406', 'DAMAGECOUNT': '10.107', 'FRAGCOUNT': '37.000'} [2024-08-06 00:14:00,580][52666] DAMAGECOUNT value on done: 90066.0 [2024-08-06 00:14:00,580][52666] Sum rewards: 55.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.046', 'AMMO5': '0.003', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.185', 'WEAPON7': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.460', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:00,714][52663] DAMAGECOUNT value on done: 89504.0 [2024-08-06 00:14:00,714][52663] Sum rewards: 53.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.579', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.110', 'AMMO4': '0.172', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.302', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '2.996', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:01,232][52665] DAMAGECOUNT value on done: 94325.0 [2024-08-06 00:14:01,232][52665] Sum rewards: 67.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.064', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.212', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '56.000'} [2024-08-06 00:14:01,932][52795] DAMAGECOUNT value on done: 82472.0 [2024-08-06 00:14:01,935][52795] Sum rewards: 59.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '3.204', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '49.000'} [2024-08-06 00:14:01,953][52664] DAMAGECOUNT value on done: 91413.0 [2024-08-06 00:14:01,954][52664] Sum rewards: 57.986, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.105', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.204', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '50.000'} [2024-08-06 00:14:02,613][52658] DAMAGECOUNT value on done: 87590.0 [2024-08-06 00:14:02,614][52658] Sum rewards: 51.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.452', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.095', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon4': '0.492', 'WEAPON3': '1.000', 'weapon3': '2.904', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '42.000'} [2024-08-06 00:14:02,730][52671] DAMAGECOUNT value on done: 91210.0 [2024-08-06 00:14:02,730][52671] Sum rewards: 43.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.056', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.174', 'weapon2': '0.196', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '3.414', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 172589056. Throughput: 0: 4393.3. Samples: 43147720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:14:02,794][52567] Avg episode reward: [(0, '51.835')] [2024-08-06 00:14:03,057][52670] DAMAGECOUNT value on done: 90168.0 [2024-08-06 00:14:03,059][52670] Sum rewards: 58.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.314', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.136', 'AMMO3': '0.165', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON4': '0.500', 'weapon4': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.406', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '48.000'} [2024-08-06 00:14:03,495][52666] DAMAGECOUNT value on done: 86619.0 [2024-08-06 00:14:03,495][52666] Sum rewards: 52.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.254', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.199', 'AMMO4': '0.218', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.126', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:03,898][52663] DAMAGECOUNT value on done: 84580.0 [2024-08-06 00:14:03,898][52663] Sum rewards: 48.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.164', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.112', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.088', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '42.000'} [2024-08-06 00:14:04,095][52650] Updated weights for policy 0, policy_version 21071 (0.0018) [2024-08-06 00:14:04,241][52665] DAMAGECOUNT value on done: 91041.0 [2024-08-06 00:14:04,242][52665] Sum rewards: 51.191, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.208', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.263', 'weapon2': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '3.272', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '48.000'} [2024-08-06 00:14:04,488][52664] DAMAGECOUNT value on done: 96774.0 [2024-08-06 00:14:04,491][52664] Sum rewards: 58.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '49.000'} [2024-08-06 00:14:05,021][52795] DAMAGECOUNT value on done: 86199.0 [2024-08-06 00:14:05,021][52795] Sum rewards: 54.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.576', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.110', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:05,587][52671] DAMAGECOUNT value on done: 87550.0 [2024-08-06 00:14:05,587][52671] Sum rewards: 50.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.715', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.178', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '3.376', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '45.000'} [2024-08-06 00:14:05,616][52658] DAMAGECOUNT value on done: 89571.0 [2024-08-06 00:14:05,618][52658] Sum rewards: 62.476, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.343', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.150', 'weapon2': '0.568', 'WEAPON3': '1.000', 'HITCOUNT': '3.200', 'weapon3': '3.242', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2024-08-06 00:14:05,905][52670] DAMAGECOUNT value on done: 88885.0 [2024-08-06 00:14:05,905][52670] Sum rewards: 45.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.118', 'weapon5': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.840', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:06,465][52666] DAMAGECOUNT value on done: 86353.0 [2024-08-06 00:14:06,466][52666] Sum rewards: 54.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.175', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:06,893][52663] DAMAGECOUNT value on done: 88667.0 [2024-08-06 00:14:06,894][52663] Sum rewards: 65.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon4': '0.222', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '55.000'} [2024-08-06 00:14:06,960][52664] DAMAGECOUNT value on done: 93775.0 [2024-08-06 00:14:06,968][52664] Sum rewards: 62.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.859', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.502', 'WEAPON3': '0.950', 'weapon3': '2.756', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '52.000'} [2024-08-06 00:14:07,278][52665] DAMAGECOUNT value on done: 90404.0 [2024-08-06 00:14:07,283][52665] Sum rewards: 52.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.887', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.742', 'WEAPON3': '0.950', 'weapon3': '2.760', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '42.000'} [2024-08-06 00:14:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 172679168. Throughput: 0: 4391.6. Samples: 43173710. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:14:07,794][52567] Avg episode reward: [(0, '52.092')] [2024-08-06 00:14:08,108][52671] DAMAGECOUNT value on done: 89024.0 [2024-08-06 00:14:08,110][52671] Sum rewards: 45.845, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.550', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.301', 'WEAPON3': '1.850', 'HITCOUNT': '2.550', 'weapon3': '3.384', 'DAMAGECOUNT': '12.306', 'FRAGCOUNT': '45.000'} [2024-08-06 00:14:08,182][52795] DAMAGECOUNT value on done: 83785.0 [2024-08-06 00:14:08,182][52795] Sum rewards: 49.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.028', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.188', 'weapon4': '0.408', 'WEAPON4': '0.500', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.844', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '45.000'} [2024-08-06 00:14:08,494][52658] DAMAGECOUNT value on done: 92535.0 [2024-08-06 00:14:08,494][52658] Sum rewards: 37.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.326', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.198', 'weapon4': '0.298', 'WEAPON4': '0.450', 'weapon2': '0.730', 'WEAPON3': '1.050', 'HITCOUNT': '2.410', 'weapon3': '2.718', 'DAMAGECOUNT': '10.494', 'FRAGCOUNT': '35.000'} [2024-08-06 00:14:08,691][52650] Updated weights for policy 0, policy_version 21081 (0.0022) [2024-08-06 00:14:08,830][52670] DAMAGECOUNT value on done: 88355.0 [2024-08-06 00:14:08,831][52670] Sum rewards: 53.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'weapon5': '0.068', 'AMMO3': '0.248', 'weapon2': '0.426', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.194', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:09,336][52666] DAMAGECOUNT value on done: 85442.0 [2024-08-06 00:14:09,339][52666] Sum rewards: 50.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.476', 'weapon2': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.656', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '43.000'} [2024-08-06 00:14:09,999][52663] DAMAGECOUNT value on done: 94377.0 [2024-08-06 00:14:10,001][52663] Sum rewards: 64.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.120', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.362', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '55.000'} [2024-08-06 00:14:10,015][52664] DAMAGECOUNT value on done: 86953.0 [2024-08-06 00:14:10,016][52664] Sum rewards: 54.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'AMMO3': '0.194', 'WEAPON7': '0.200', 'weapon2': '0.302', 'WEAPON4': '0.400', 'weapon4': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:10,353][52665] DAMAGECOUNT value on done: 88438.0 [2024-08-06 00:14:10,353][52665] Sum rewards: 57.399, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.558', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.278', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'HITCOUNT': '3.290', 'weapon3': '3.386', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '53.000'} [2024-08-06 00:14:10,752][52671] DAMAGECOUNT value on done: 91361.0 [2024-08-06 00:14:10,754][52671] Sum rewards: 40.019, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.736', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.103', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.307', 'weapon2': '0.390', 'WEAPON3': '1.800', 'HITCOUNT': '2.670', 'weapon3': '3.132', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:11,362][52795] DAMAGECOUNT value on done: 86533.0 [2024-08-06 00:14:11,364][52795] Sum rewards: 58.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon2': '0.316', 'weapon4': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '48.000'} [2024-08-06 00:14:11,881][52670] DAMAGECOUNT value on done: 91410.0 [2024-08-06 00:14:11,882][52670] Sum rewards: 51.318, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.768', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.066', 'AMMO4': '0.153', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:12,477][52666] DAMAGECOUNT value on done: 90287.0 [2024-08-06 00:14:12,477][52666] Sum rewards: 52.588, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.795', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.134', 'AMMO3': '0.214', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '46.500'} [2024-08-06 00:14:12,683][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:14:12,723][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:14:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 172769280. Throughput: 0: 4395.8. Samples: 43200180. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:14:12,794][52567] Avg episode reward: [(0, '51.978')] [2024-08-06 00:14:12,833][52664] DAMAGECOUNT value on done: 99136.0 [2024-08-06 00:14:12,833][52664] Sum rewards: 55.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'weapon4': '0.034', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.194', 'weapon2': '0.634', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.204', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:13,037][52663] DAMAGECOUNT value on done: 90359.0 [2024-08-06 00:14:13,037][52663] Sum rewards: 59.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.370', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '50.000'} [2024-08-06 00:14:13,108][52650] Updated weights for policy 0, policy_version 21091 (0.0011) [2024-08-06 00:14:13,282][52665] DAMAGECOUNT value on done: 88235.0 [2024-08-06 00:14:13,284][52665] Sum rewards: 44.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.255', 'WEAPON4': '0.400', 'weapon2': '0.566', 'weapon4': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.358', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.913', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:14,023][52671] DAMAGECOUNT value on done: 90918.0 [2024-08-06 00:14:14,023][52671] Sum rewards: 59.133, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.064', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO4': '0.107', 'AMMO3': '0.225', 'weapon2': '0.402', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.320', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.000'} [2024-08-06 00:14:14,402][52795] DAMAGECOUNT value on done: 83665.0 [2024-08-06 00:14:14,411][52795] Sum rewards: 45.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.209', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon7': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.148', 'WEAPON7': '0.200', 'weapon4': '0.308', 'weapon2': '0.384', 'WEAPON3': '0.850', 'HITCOUNT': '2.450', 'weapon3': '2.712', 'DAMAGECOUNT': '10.959', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:14,795][52670] DAMAGECOUNT value on done: 83341.0 [2024-08-06 00:14:14,795][52670] Sum rewards: 43.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.400', 'HITCOUNT': '2.690', 'weapon3': '3.090', 'DAMAGECOUNT': '11.829', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:15,347][52666] DAMAGECOUNT value on done: 87817.0 [2024-08-06 00:14:15,358][52666] Sum rewards: 49.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.136', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.263', 'weapon2': '0.298', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.198', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:15,957][52664] DAMAGECOUNT value on done: 96269.0 [2024-08-06 00:14:15,959][52664] Sum rewards: 47.082, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.278', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.104', 'weapon5': '0.150', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.750', 'HITCOUNT': '2.760', 'weapon3': '2.928', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '45.000'} [2024-08-06 00:14:15,983][52663] DAMAGECOUNT value on done: 91129.0 [2024-08-06 00:14:15,984][52663] Sum rewards: 43.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.672', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'AMMO4': '0.237', 'weapon4': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.926', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '40.000'} [2024-08-06 00:14:16,345][52663] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.002, -2.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:14:16,450][52671] DAMAGECOUNT value on done: 92421.0 [2024-08-06 00:14:16,450][52671] Sum rewards: 41.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.734', 'AMMO5': '0.017', 'ARMOR': '0.040', 'AMMO2': '0.056', 'AMMO3': '0.222', 'AMMO4': '0.282', 'weapon5': '0.390', 'WEAPON5': '0.400', 'weapon4': '0.412', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.430', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:16,527][52665] DAMAGECOUNT value on done: 88882.0 [2024-08-06 00:14:16,528][52665] Sum rewards: 41.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.312', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.040', 'AMMO2': '0.055', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'AMMO4': '0.275', 'weapon2': '0.318', 'weapon4': '0.348', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.450', 'weapon3': '3.024', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:16,554][52659] DAMAGECOUNT value on done: 88660.0 [2024-08-06 00:14:16,554][52659] Sum rewards: 46.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.534', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'AMMO4': '0.227', 'weapon2': '0.370', 'WEAPON4': '0.700', 'weapon4': '0.788', 'WEAPON3': '1.300', 'weapon3': '2.482', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '43.000'} [2024-08-06 00:14:17,553][52670] DAMAGECOUNT value on done: 90927.0 [2024-08-06 00:14:17,561][52670] Sum rewards: 50.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.684', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.172', 'AMMO3': '0.227', 'weapon4': '0.294', 'WEAPON4': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:17,684][52795] DAMAGECOUNT value on done: 80176.0 [2024-08-06 00:14:17,685][52795] Sum rewards: 46.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.584', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.382', 'WEAPON3': '1.550', 'HITCOUNT': '2.330', 'weapon3': '3.432', 'DAMAGECOUNT': '11.763', 'FRAGCOUNT': '43.000'} [2024-08-06 00:14:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 172851200. Throughput: 0: 4397.8. Samples: 43213230. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:14:17,794][52567] Avg episode reward: [(0, '51.639')] [2024-08-06 00:14:17,890][52650] Updated weights for policy 0, policy_version 21101 (0.0020) [2024-08-06 00:14:18,330][52664] DAMAGECOUNT value on done: 96018.0 [2024-08-06 00:14:18,331][52664] Sum rewards: 47.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.223', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.163', 'weapon5': '0.184', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon2': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.788', 'WEAPON3': '1.050', 'weapon3': '2.324', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:18,356][52666] DAMAGECOUNT value on done: 89173.0 [2024-08-06 00:14:18,357][52666] Sum rewards: 41.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.722', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO4': '0.203', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON4': '0.550', 'weapon4': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.350', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.445', 'FRAGCOUNT': '35.500'} [2024-08-06 00:14:18,950][52663] DAMAGECOUNT value on done: 90979.0 [2024-08-06 00:14:18,950][52663] Sum rewards: 54.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.527', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.164', 'WEAPON4': '0.300', 'weapon4': '0.394', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:19,237][52671] DAMAGECOUNT value on done: 88923.0 [2024-08-06 00:14:19,238][52671] Sum rewards: 37.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.888', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.208', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.160', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '33.000'} [2024-08-06 00:14:19,463][52659] DAMAGECOUNT value on done: 91494.0 [2024-08-06 00:14:19,463][52659] Sum rewards: 36.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.736', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.398', 'weapon4': '0.466', 'WEAPON3': '0.850', 'weapon2': '0.876', 'weapon3': '2.102', 'HITCOUNT': '2.230', 'DAMAGECOUNT': '10.323', 'FRAGCOUNT': '30.000'} [2024-08-06 00:14:19,664][52665] DAMAGECOUNT value on done: 87840.0 [2024-08-06 00:14:19,666][52665] Sum rewards: 57.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.028', 'weapon5': '0.046', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.498', 'weapon4': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.720', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '48.000'} [2024-08-06 00:14:20,248][52670] DAMAGECOUNT value on done: 88912.0 [2024-08-06 00:14:20,249][52670] Sum rewards: 38.552, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.932', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.069', 'weapon5': '0.140', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.338', 'AMMO4': '0.347', 'weapon2': '0.718', 'WEAPON4': '0.850', 'WEAPON3': '1.200', 'weapon3': '2.466', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '37.000'} [2024-08-06 00:14:20,284][52647] DAMAGECOUNT value on done: 95562.0 [2024-08-06 00:14:20,287][52647] Sum rewards: 61.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.522', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.079', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.362', 'WEAPON3': '1.650', 'weapon3': '3.268', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '55.000'} [2024-08-06 00:14:20,616][52664] DAMAGECOUNT value on done: 92782.0 [2024-08-06 00:14:20,618][52664] Sum rewards: 52.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.566', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.174', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.538', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:20,876][52795] DAMAGECOUNT value on done: 84615.0 [2024-08-06 00:14:20,878][52795] Sum rewards: 48.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.198', 'WEAPON4': '0.550', 'weapon2': '0.560', 'weapon4': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.524', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '40.000'} [2024-08-06 00:14:22,205][52671] DAMAGECOUNT value on done: 91871.0 [2024-08-06 00:14:22,207][52671] Sum rewards: 48.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.139', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'AMMO4': '0.184', 'weapon5': '0.234', 'weapon2': '0.414', 'weapon4': '0.454', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.514', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '42.000'} [2024-08-06 00:14:22,317][52663] DAMAGECOUNT value on done: 93849.0 [2024-08-06 00:14:22,319][52663] Sum rewards: 54.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.142', 'AMMO5': '0.005', 'AMMO2': '0.031', 'ARMOR': '0.036', 'weapon5': '0.148', 'AMMO4': '0.154', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.436', 'WEAPON4': '0.500', 'weapon4': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.634', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '45.000'} [2024-08-06 00:14:22,366][52650] Updated weights for policy 0, policy_version 21111 (0.0011) [2024-08-06 00:14:22,490][52659] DAMAGECOUNT value on done: 88796.0 [2024-08-06 00:14:22,492][52659] Sum rewards: 53.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.520', 'ARMOR': '0.004', 'AMMO5': '0.014', 'weapon5': '0.028', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon4': '0.212', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:22,599][52665] DAMAGECOUNT value on done: 87817.0 [2024-08-06 00:14:22,607][52665] Sum rewards: 42.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.138', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon5': '0.118', 'AMMO3': '0.180', 'AMMO4': '0.252', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON4': '0.600', 'weapon2': '0.930', 'WEAPON3': '1.100', 'weapon3': '2.328', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.043', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 172941312. Throughput: 0: 4401.8. Samples: 43239860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:14:22,794][52567] Avg episode reward: [(0, '51.222')] [2024-08-06 00:14:23,119][52647] DAMAGECOUNT value on done: 93570.0 [2024-08-06 00:14:23,119][52647] Sum rewards: 44.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.665', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.256', 'weapon4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '3.212', 'DAMAGECOUNT': '12.429', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:23,562][52670] DAMAGECOUNT value on done: 88505.0 [2024-08-06 00:14:23,562][52670] Sum rewards: 59.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.836', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.166', 'AMMO3': '0.175', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.592', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '49.000'} [2024-08-06 00:14:23,699][52664] DAMAGECOUNT value on done: 90809.0 [2024-08-06 00:14:23,700][52664] Sum rewards: 46.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.073', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.500', 'weapon2': '0.580', 'weapon4': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.406', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '40.000'} [2024-08-06 00:14:24,133][52795] DAMAGECOUNT value on done: 86224.0 [2024-08-06 00:14:24,133][52795] Sum rewards: 50.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.488', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon4': '0.254', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '3.128', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:25,173][52671] DAMAGECOUNT value on done: 90548.0 [2024-08-06 00:14:25,175][52671] Sum rewards: 57.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.600', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.215', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.052', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '50.000'} [2024-08-06 00:14:25,248][52663] DAMAGECOUNT value on done: 88659.0 [2024-08-06 00:14:25,249][52663] Sum rewards: 54.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.177', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.936', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:25,322][52659] DAMAGECOUNT value on done: 91526.0 [2024-08-06 00:14:25,322][52659] Sum rewards: 48.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.986', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.264', 'weapon4': '0.370', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '3.278', 'DAMAGECOUNT': '11.568', 'FRAGCOUNT': '40.000'} [2024-08-06 00:14:25,540][52665] DAMAGECOUNT value on done: 87310.0 [2024-08-06 00:14:25,540][52665] Sum rewards: 47.409, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.029', 'HEALTH': '0.085', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.134', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.716', 'WEAPON3': '0.750', 'weapon3': '2.694', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '37.500'} [2024-08-06 00:14:26,266][52647] DAMAGECOUNT value on done: 97781.0 [2024-08-06 00:14:26,266][52647] Sum rewards: 46.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.538', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.179', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.000', 'HITCOUNT': '2.720', 'weapon3': '2.928', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:26,437][52670] DAMAGECOUNT value on done: 86574.0 [2024-08-06 00:14:26,438][52670] Sum rewards: 48.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.032', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.494', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:26,991][52664] DAMAGECOUNT value on done: 94329.0 [2024-08-06 00:14:26,991][52664] Sum rewards: 50.566, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.568', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'AMMO4': '0.254', 'WEAPON4': '0.500', 'weapon4': '0.640', 'weapon2': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.186', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:27,142][52650] Updated weights for policy 0, policy_version 21121 (0.0014) [2024-08-06 00:14:27,305][52795] DAMAGECOUNT value on done: 81096.0 [2024-08-06 00:14:27,306][52795] Sum rewards: 37.972, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.195', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.132', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.308', 'weapon2': '0.390', 'WEAPON3': '1.800', 'HITCOUNT': '2.600', 'weapon3': '2.978', 'DAMAGECOUNT': '10.971', 'FRAGCOUNT': '40.000'} [2024-08-06 00:14:27,611][52671] DAMAGECOUNT value on done: 89814.0 [2024-08-06 00:14:27,619][52671] Sum rewards: 42.065, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.102', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.066', 'weapon4': '0.068', 'WEAPON4': '0.150', 'weapon2': '0.256', 'AMMO3': '0.348', 'WEAPON3': '2.050', 'HITCOUNT': '2.710', 'weapon3': '3.336', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '43.000'} [2024-08-06 00:14:27,794][52567] Fps is (10 sec: 18841.1, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 173039616. Throughput: 0: 4388.2. Samples: 43265830. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:14:27,795][52567] Avg episode reward: [(0, '51.005')] [2024-08-06 00:14:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021123_173039616.pth... [2024-08-06 00:14:27,858][52659] DAMAGECOUNT value on done: 90282.0 [2024-08-06 00:14:27,860][52659] Sum rewards: 52.345, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.046', 'HEALTH': '0.069', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.800', 'weapon4': '1.188', 'weapon3': '1.712', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:27,922][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020608_168820736.pth [2024-08-06 00:14:28,536][52665] DAMAGECOUNT value on done: 83164.0 [2024-08-06 00:14:28,536][52665] Sum rewards: 44.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.119', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.055', 'weapon5': '0.148', 'AMMO3': '0.226', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.488', 'weapon4': '0.506', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.379', 'FRAGCOUNT': '42.000'} [2024-08-06 00:14:28,944][52647] DAMAGECOUNT value on done: 97883.0 [2024-08-06 00:14:28,944][52647] Sum rewards: 44.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.052', 'AMMO2': '0.022', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.412', 'weapon4': '0.636', 'WEAPON3': '0.750', 'weapon3': '2.298', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '37.000'} [2024-08-06 00:14:29,543][52664] DAMAGECOUNT value on done: 93685.0 [2024-08-06 00:14:29,545][52664] Sum rewards: 55.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.616', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.092', 'AMMO4': '0.156', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.026', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:29,863][52614] Signal inference workers to stop experience collection... (3950 times) [2024-08-06 00:14:29,876][52614] Signal inference workers to resume experience collection... (3950 times) [2024-08-06 00:14:29,965][52650] InferenceWorker_p0-w0: stopping experience collection (3950 times) [2024-08-06 00:14:29,968][52650] InferenceWorker_p0-w0: resuming experience collection (3950 times) [2024-08-06 00:14:30,545][52795] DAMAGECOUNT value on done: 84183.0 [2024-08-06 00:14:30,546][52795] Sum rewards: 51.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.921', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.288', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '42.000'} [2024-08-06 00:14:30,927][52671] DAMAGECOUNT value on done: 94624.0 [2024-08-06 00:14:30,928][52671] Sum rewards: 49.274, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.898', 'AMMO5': '0.005', 'weapon5': '0.040', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.201', 'AMMO3': '0.228', 'weapon4': '0.278', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.068', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:31,152][52659] DAMAGECOUNT value on done: 93449.0 [2024-08-06 00:14:31,154][52659] Sum rewards: 56.868, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.172', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.218', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.402', 'WEAPON3': '1.700', 'weapon3': '3.012', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '51.000'} [2024-08-06 00:14:31,399][52647] DAMAGECOUNT value on done: 97499.0 [2024-08-06 00:14:31,401][52647] Sum rewards: 49.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.232', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.432', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:31,711][52665] DAMAGECOUNT value on done: 85606.0 [2024-08-06 00:14:31,715][52665] Sum rewards: 39.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.180', 'weapon5': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.674', 'weapon2': '0.704', 'WEAPON3': '1.050', 'weapon3': '2.002', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '35.000'} [2024-08-06 00:14:31,923][52664] DAMAGECOUNT value on done: 90488.0 [2024-08-06 00:14:31,924][52664] Sum rewards: 53.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.925', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.474', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.184', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '46.000'} [2024-08-06 00:14:32,188][52650] Updated weights for policy 0, policy_version 21131 (0.0013) [2024-08-06 00:14:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 173121536. Throughput: 0: 4388.2. Samples: 43278890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:14:32,794][52567] Avg episode reward: [(0, '50.839')] [2024-08-06 00:14:33,596][52795] DAMAGECOUNT value on done: 83718.0 [2024-08-06 00:14:33,597][52795] Sum rewards: 45.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.198', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.812', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:33,797][52671] DAMAGECOUNT value on done: 91182.0 [2024-08-06 00:14:33,797][52671] Sum rewards: 42.229, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.723', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.191', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.464', 'WEAPON3': '0.900', 'weapon3': '2.840', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '34.000'} [2024-08-06 00:14:33,937][52659] DAMAGECOUNT value on done: 91752.0 [2024-08-06 00:14:33,937][52659] Sum rewards: 44.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '3.238', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:34,180][52647] DAMAGECOUNT value on done: 97292.0 [2024-08-06 00:14:34,182][52647] Sum rewards: 49.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.467', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.175', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.944', 'WEAPON3': '1.000', 'weapon3': '2.646', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:34,649][52665] DAMAGECOUNT value on done: 86468.0 [2024-08-06 00:14:34,650][52665] Sum rewards: 48.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.711', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon5': '0.158', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'weapon4': '0.398', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.580', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '40.000'} [2024-08-06 00:14:34,806][52664] DAMAGECOUNT value on done: 94109.0 [2024-08-06 00:14:34,806][52664] Sum rewards: 45.721, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.314', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.192', 'weapon4': '0.314', 'weapon2': '0.752', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:36,556][52671] DAMAGECOUNT value on done: 86684.0 [2024-08-06 00:14:36,561][52647] DAMAGECOUNT value on done: 94832.0 [2024-08-06 00:14:36,564][52647] Sum rewards: 57.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.126', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.144', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'weapon4': '0.380', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.794', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:36,564][52671] Sum rewards: 60.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.866', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.310', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '51.000'} [2024-08-06 00:14:36,584][52650] Updated weights for policy 0, policy_version 21141 (0.0027) [2024-08-06 00:14:36,633][52795] DAMAGECOUNT value on done: 81109.0 [2024-08-06 00:14:36,634][52795] Sum rewards: 44.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.484', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.472', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '3.088', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:36,702][52659] DAMAGECOUNT value on done: 87099.0 [2024-08-06 00:14:36,702][52659] Sum rewards: 42.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.187', 'weapon4': '0.216', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.674', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.824', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:37,287][52664] DAMAGECOUNT value on done: 93875.0 [2024-08-06 00:14:37,288][52664] Sum rewards: 61.030, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'ARMOR': '0.008', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.200', 'weapon4': '0.384', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '52.000'} [2024-08-06 00:14:37,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 173211648. Throughput: 0: 4390.7. Samples: 43305640. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:14:37,795][52567] Avg episode reward: [(0, '50.630')] [2024-08-06 00:14:38,915][52647] DAMAGECOUNT value on done: 97391.0 [2024-08-06 00:14:38,916][52647] Sum rewards: 62.488, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.287', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.210', 'weapon2': '0.340', 'WEAPON4': '0.650', 'weapon4': '0.758', 'WEAPON3': '0.950', 'weapon3': '2.706', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '50.000'} [2024-08-06 00:14:39,458][52671] DAMAGECOUNT value on done: 90995.0 [2024-08-06 00:14:39,460][52671] Sum rewards: 45.689, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.852', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.096', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'AMMO4': '0.272', 'weapon2': '0.332', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '43.000'} [2024-08-06 00:14:39,559][52659] DAMAGECOUNT value on done: 89662.0 [2024-08-06 00:14:39,559][52659] Sum rewards: 46.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO3': '0.110', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.216', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.840', 'weapon3': '2.744', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '37.000'} [2024-08-06 00:14:39,575][52664] DAMAGECOUNT value on done: 92279.0 [2024-08-06 00:14:39,575][52664] Sum rewards: 52.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.231', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.166', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '2.956', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:39,811][52795] DAMAGECOUNT value on done: 84634.0 [2024-08-06 00:14:39,811][52795] Sum rewards: 61.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.491', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.100', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.434', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.096', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '53.000'} [2024-08-06 00:14:41,109][52647] DAMAGECOUNT value on done: 97926.0 [2024-08-06 00:14:41,109][52647] Sum rewards: 44.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.418', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.608', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.271', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:41,223][52650] Updated weights for policy 0, policy_version 21151 (0.0021) [2024-08-06 00:14:42,096][52664] DAMAGECOUNT value on done: 92362.0 [2024-08-06 00:14:42,104][52664] Sum rewards: 44.108, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.760', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.562', 'WEAPON3': '1.050', 'HITCOUNT': '2.550', 'weapon3': '2.794', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '36.000'} [2024-08-06 00:14:42,574][52671] DAMAGECOUNT value on done: 90642.0 [2024-08-06 00:14:42,575][52671] Sum rewards: 46.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.482', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.233', 'AMMO4': '0.239', 'weapon2': '0.352', 'WEAPON4': '0.450', 'weapon4': '0.728', 'WEAPON3': '1.300', 'weapon3': '2.496', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '42.000'} [2024-08-06 00:14:42,676][52659] DAMAGECOUNT value on done: 92552.0 [2024-08-06 00:14:42,676][52659] Sum rewards: 55.937, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.784', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.033', 'weapon4': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.436', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '51.000'} [2024-08-06 00:14:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 173293568. Throughput: 0: 4396.9. Samples: 43332120. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:14:42,794][52567] Avg episode reward: [(0, '50.336')] [2024-08-06 00:14:42,925][52795] DAMAGECOUNT value on done: 86877.0 [2024-08-06 00:14:42,925][52795] Sum rewards: 44.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO3': '0.152', 'weapon5': '0.166', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON4': '0.650', 'weapon4': '0.702', 'WEAPON3': '0.950', 'weapon3': '2.374', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.433', 'FRAGCOUNT': '38.000'} [2024-08-06 00:14:43,798][52647] DAMAGECOUNT value on done: 93338.0 [2024-08-06 00:14:43,798][52647] Sum rewards: 45.536, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.794', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.080', 'AMMO4': '0.155', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.374', 'weapon2': '0.392', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '2.896', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '40.000'} [2024-08-06 00:14:43,928][52662] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:14:45,143][52671] DAMAGECOUNT value on done: 91298.0 [2024-08-06 00:14:45,143][52671] Sum rewards: 45.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.092', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.244', 'weapon2': '0.454', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.206', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '39.000'} [2024-08-06 00:14:45,210][52659] DAMAGECOUNT value on done: 90414.0 [2024-08-06 00:14:45,211][52659] Sum rewards: 47.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.156', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.061', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'AMMO4': '0.307', 'weapon4': '0.436', 'WEAPON4': '0.550', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.640', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:45,773][52650] Updated weights for policy 0, policy_version 21161 (0.0024) [2024-08-06 00:14:46,081][52795] DAMAGECOUNT value on done: 80621.0 [2024-08-06 00:14:46,082][52795] Sum rewards: 49.991, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.241', 'weapon4': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:46,845][52647] DAMAGECOUNT value on done: 93137.0 [2024-08-06 00:14:46,846][52647] Sum rewards: 56.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.942', 'AMMO5': '0.012', 'AMMO2': '0.052', 'ARMOR': '0.056', 'weapon5': '0.128', 'AMMO3': '0.152', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.960', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '45.500'} [2024-08-06 00:14:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 173383680. Throughput: 0: 4395.1. Samples: 43345500. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:14:47,794][52567] Avg episode reward: [(0, '49.977')] [2024-08-06 00:14:47,884][52671] DAMAGECOUNT value on done: 89966.0 [2024-08-06 00:14:47,885][52671] Sum rewards: 45.452, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'HEALTH': '0.073', 'AMMO4': '0.146', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.396', 'WEAPON3': '0.950', 'HITCOUNT': '2.810', 'weapon3': '3.118', 'DAMAGECOUNT': '12.093', 'FRAGCOUNT': '37.000'} [2024-08-06 00:14:47,992][52659] DAMAGECOUNT value on done: 87657.0 [2024-08-06 00:14:47,994][52659] Sum rewards: 39.727, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.694', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.376', 'weapon4': '0.414', 'WEAPON3': '1.600', 'weapon3': '2.892', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '37.500'} [2024-08-06 00:14:48,307][52669] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:14:49,124][52795] DAMAGECOUNT value on done: 84650.0 [2024-08-06 00:14:49,124][52795] Sum rewards: 62.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.074', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.518', 'WEAPON3': '0.900', 'weapon3': '3.012', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '50.500'} [2024-08-06 00:14:49,906][52647] DAMAGECOUNT value on done: 92357.0 [2024-08-06 00:14:49,909][52647] Sum rewards: 50.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.028', 'weapon5': '0.114', 'AMMO3': '0.132', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '0.900', 'HITCOUNT': '2.900', 'weapon3': '2.902', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '43.000'} [2024-08-06 00:14:50,401][52650] Updated weights for policy 0, policy_version 21171 (0.0021) [2024-08-06 00:14:50,639][52671] DAMAGECOUNT value on done: 89247.0 [2024-08-06 00:14:50,640][52671] Sum rewards: 55.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.944', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.052', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.262', 'WEAPON4': '0.550', 'weapon2': '0.570', 'weapon4': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.444', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '47.000'} [2024-08-06 00:14:50,772][52659] DAMAGECOUNT value on done: 86493.0 [2024-08-06 00:14:50,774][52659] Sum rewards: 52.026, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.265', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.276', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '48.000'} [2024-08-06 00:14:52,192][52795] DAMAGECOUNT value on done: 87914.0 [2024-08-06 00:14:52,193][52795] Sum rewards: 52.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.322', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.148', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '45.000'} [2024-08-06 00:14:52,491][52647] DAMAGECOUNT value on done: 92644.0 [2024-08-06 00:14:52,495][52647] Sum rewards: 49.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.035', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.078', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.278', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '2.890', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 173473792. Throughput: 0: 4409.1. Samples: 43372120. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:14:52,794][52567] Avg episode reward: [(0, '49.790')] [2024-08-06 00:14:53,703][52659] DAMAGECOUNT value on done: 92076.0 [2024-08-06 00:14:53,706][52659] Sum rewards: 51.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.481', 'AMMO2': '0.013', 'ARMOR': '0.020', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon4': '0.212', 'weapon2': '0.730', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:55,041][52647] DAMAGECOUNT value on done: 93747.0 [2024-08-06 00:14:55,041][52647] Sum rewards: 37.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.680', 'AMMO5': '0.005', 'weapon5': '0.026', 'ARMOR': '0.028', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.212', 'AMMO3': '0.257', 'weapon2': '0.382', 'WEAPON4': '0.450', 'weapon4': '0.498', 'WEAPON3': '1.550', 'HITCOUNT': '2.620', 'weapon3': '2.868', 'DAMAGECOUNT': '11.745', 'FRAGCOUNT': '36.000'} [2024-08-06 00:14:55,120][52650] Updated weights for policy 0, policy_version 21181 (0.0020) [2024-08-06 00:14:56,502][52659] DAMAGECOUNT value on done: 91134.0 [2024-08-06 00:14:56,504][52659] Sum rewards: 45.122, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.229', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.662', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.708', 'DAMAGECOUNT': '11.064', 'FRAGCOUNT': '44.000'} [2024-08-06 00:14:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 173555712. Throughput: 0: 4409.3. Samples: 43398600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:14:57,794][52567] Avg episode reward: [(0, '49.322')] [2024-08-06 00:14:57,919][52647] DAMAGECOUNT value on done: 94937.0 [2024-08-06 00:14:57,920][52647] Sum rewards: 48.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.544', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.234', 'weapon2': '0.266', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.124', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '41.000'} [2024-08-06 00:14:59,409][52650] Updated weights for policy 0, policy_version 21191 (0.0020) [2024-08-06 00:14:59,765][52659] DAMAGECOUNT value on done: 96216.0 [2024-08-06 00:14:59,765][52659] Sum rewards: 56.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.495', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'AMMO3': '0.266', 'weapon4': '0.280', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '49.000'} [2024-08-06 00:15:00,343][52647] DAMAGECOUNT value on done: 95724.0 [2024-08-06 00:15:00,343][52647] Sum rewards: 54.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.506', 'ARMOR': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:02,156][52659] DAMAGECOUNT value on done: 90354.0 [2024-08-06 00:15:02,157][52659] Sum rewards: 46.500, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.236', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.034', 'AMMO4': '0.148', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.308', 'weapon2': '0.358', 'WEAPON3': '1.500', 'HITCOUNT': '2.660', 'weapon3': '3.024', 'DAMAGECOUNT': '11.541', 'FRAGCOUNT': '44.500'} [2024-08-06 00:15:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 173645824. Throughput: 0: 4412.5. Samples: 43411790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:15:02,794][52567] Avg episode reward: [(0, '49.520')] [2024-08-06 00:15:02,863][52647] DAMAGECOUNT value on done: 91625.0 [2024-08-06 00:15:02,865][52647] Sum rewards: 44.573, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.160', 'AMMO2': '0.054', 'AMMO3': '0.217', 'AMMO4': '0.271', 'weapon2': '0.448', 'weapon4': '0.546', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:04,018][52650] Updated weights for policy 0, policy_version 21201 (0.0024) [2024-08-06 00:15:04,917][52659] DAMAGECOUNT value on done: 90526.0 [2024-08-06 00:15:04,921][52659] Sum rewards: 59.071, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.715', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.676', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:05,353][52647] DAMAGECOUNT value on done: 94857.0 [2024-08-06 00:15:05,354][52647] Sum rewards: 61.115, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.118', 'weapon4': '0.122', 'AMMO3': '0.123', 'WEAPON3': '0.800', 'weapon2': '1.018', 'weapon3': '2.578', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:07,617][52659] DAMAGECOUNT value on done: 93696.0 [2024-08-06 00:15:07,619][52659] Sum rewards: 59.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.635', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon4': '0.126', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.706', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '54.000'} [2024-08-06 00:15:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 173735936. Throughput: 0: 4401.8. Samples: 43437940. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:15:07,802][52567] Avg episode reward: [(0, '49.496')] [2024-08-06 00:15:07,902][52647] DAMAGECOUNT value on done: 93238.0 [2024-08-06 00:15:07,903][52647] Sum rewards: 58.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.166', 'weapon2': '0.488', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.332', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '47.000'} [2024-08-06 00:15:08,641][52662] DAMAGECOUNT value on done: 94648.0 [2024-08-06 00:15:08,641][52662] Sum rewards: 51.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.556', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.216', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.150', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:09,200][52650] Updated weights for policy 0, policy_version 21211 (0.0012) [2024-08-06 00:15:10,559][52659] DAMAGECOUNT value on done: 92677.0 [2024-08-06 00:15:10,559][52659] Sum rewards: 42.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.996', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.148', 'weapon5': '0.214', 'WEAPON5': '0.250', 'AMMO4': '0.277', 'weapon4': '0.490', 'weapon2': '0.546', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.526', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.397', 'FRAGCOUNT': '38.000'} [2024-08-06 00:15:10,789][52647] DAMAGECOUNT value on done: 95580.0 [2024-08-06 00:15:10,791][52647] Sum rewards: 71.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.956', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.173', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '57.000'} [2024-08-06 00:15:11,374][52662] DAMAGECOUNT value on done: 99302.0 [2024-08-06 00:15:11,375][52662] Sum rewards: 53.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.337', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.768', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:12,179][52820] DAMAGECOUNT value on done: 82929.0 [2024-08-06 00:15:12,180][52820] Sum rewards: 56.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.812', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.152', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.382', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '49.000'} [2024-08-06 00:15:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 173834240. Throughput: 0: 4410.7. Samples: 43464310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:15:12,802][52567] Avg episode reward: [(0, '49.651')] [2024-08-06 00:15:13,846][52650] Updated weights for policy 0, policy_version 21221 (0.0012) [2024-08-06 00:15:13,999][52662] DAMAGECOUNT value on done: 101048.0 [2024-08-06 00:15:13,999][52662] Sum rewards: 62.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.060', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '53.000'} [2024-08-06 00:15:14,602][52668] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:15:15,380][52820] DAMAGECOUNT value on done: 85595.0 [2024-08-06 00:15:15,381][52820] Sum rewards: 59.389, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.592', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.200', 'weapon2': '0.268', 'weapon4': '0.284', 'AMMO3': '0.303', 'WEAPON3': '1.800', 'weapon3': '3.114', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '55.000'} [2024-08-06 00:15:16,363][52668] DAMAGECOUNT value on done: 89772.0 [2024-08-06 00:15:16,365][52668] Sum rewards: 41.742, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'weapon4': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.356', 'WEAPON3': '1.550', 'HITCOUNT': '2.630', 'weapon3': '3.176', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '39.500'} [2024-08-06 00:15:16,541][52794] DAMAGECOUNT value on done: 99294.0 [2024-08-06 00:15:16,542][52794] Sum rewards: 48.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.092', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.478', 'weapon4': '0.736', 'WEAPON3': '1.250', 'weapon3': '2.390', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '42.000'} [2024-08-06 00:15:16,614][52662] DAMAGECOUNT value on done: 90074.0 [2024-08-06 00:15:16,616][52662] Sum rewards: 36.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.005', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.236', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '2.220', 'weapon3': '3.360', 'DAMAGECOUNT': '9.588', 'FRAGCOUNT': '32.000'} [2024-08-06 00:15:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 173916160. Throughput: 0: 4412.2. Samples: 43477440. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:15:17,802][52567] Avg episode reward: [(0, '49.709')] [2024-08-06 00:15:18,103][52650] Updated weights for policy 0, policy_version 21231 (0.0022) [2024-08-06 00:15:18,399][52820] DAMAGECOUNT value on done: 81603.0 [2024-08-06 00:15:18,399][52820] Sum rewards: 48.782, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.230', 'AMMO5': '0.003', 'AMMO2': '0.021', 'ARMOR': '0.024', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.236', 'weapon2': '0.330', 'WEAPON4': '0.500', 'weapon4': '0.774', 'WEAPON3': '1.400', 'weapon3': '2.584', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '46.000'} [2024-08-06 00:15:19,166][52668] DAMAGECOUNT value on done: 95895.0 [2024-08-06 00:15:19,166][52668] Sum rewards: 53.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.174', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.424', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.648', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:19,189][52794] DAMAGECOUNT value on done: 96835.0 [2024-08-06 00:15:19,189][52794] Sum rewards: 48.728, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.329', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.180', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:19,284][52662] DAMAGECOUNT value on done: 95042.0 [2024-08-06 00:15:19,285][52662] Sum rewards: 46.767, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.152', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.258', 'AMMO3': '0.276', 'weapon2': '0.372', 'ARMOR': '0.416', 'WEAPON3': '1.600', 'HITCOUNT': '2.650', 'weapon3': '2.990', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:21,493][52820] DAMAGECOUNT value on done: 79548.0 [2024-08-06 00:15:21,497][52820] Sum rewards: 41.489, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.124', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.474', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.722', 'DAMAGECOUNT': '11.034', 'FRAGCOUNT': '35.000'} [2024-08-06 00:15:21,889][52794] DAMAGECOUNT value on done: 93860.0 [2024-08-06 00:15:21,891][52794] Sum rewards: 50.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.456', 'weapon2': '0.898', 'WEAPON3': '1.250', 'weapon3': '2.352', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:22,017][52662] DAMAGECOUNT value on done: 96947.0 [2024-08-06 00:15:22,018][52662] Sum rewards: 56.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.209', 'weapon2': '0.418', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:22,256][52668] DAMAGECOUNT value on done: 89859.0 [2024-08-06 00:15:22,257][52668] Sum rewards: 68.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.092', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.242', 'weapon4': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '58.000'} [2024-08-06 00:15:22,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 173998080. Throughput: 0: 4414.4. Samples: 43504290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:15:22,802][52567] Avg episode reward: [(0, '50.204')] [2024-08-06 00:15:23,065][52650] Updated weights for policy 0, policy_version 21241 (0.0010) [2024-08-06 00:15:24,589][52820] DAMAGECOUNT value on done: 83668.0 [2024-08-06 00:15:24,590][52820] Sum rewards: 59.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.049', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.190', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '54.000'} [2024-08-06 00:15:24,926][52794] DAMAGECOUNT value on done: 92129.0 [2024-08-06 00:15:24,927][52794] Sum rewards: 43.965, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.790', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO4': '0.213', 'AMMO3': '0.225', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '3.066', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '42.000'} [2024-08-06 00:15:25,135][52662] DAMAGECOUNT value on done: 98247.0 [2024-08-06 00:15:25,135][52662] Sum rewards: 59.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.636', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.225', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '49.000'} [2024-08-06 00:15:25,519][52668] DAMAGECOUNT value on done: 91216.0 [2024-08-06 00:15:25,522][52668] Sum rewards: 49.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.538', 'weapon2': '0.694', 'WEAPON3': '1.150', 'weapon3': '2.528', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:27,439][52650] Updated weights for policy 0, policy_version 21251 (0.0042) [2024-08-06 00:15:27,718][52820] DAMAGECOUNT value on done: 84804.0 [2024-08-06 00:15:27,718][52820] Sum rewards: 48.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.083', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.130', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon4': '0.362', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.654', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '42.000'} [2024-08-06 00:15:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 174096384. Throughput: 0: 4405.6. Samples: 43530370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:15:27,794][52567] Avg episode reward: [(0, '50.530')] [2024-08-06 00:15:27,965][52794] DAMAGECOUNT value on done: 94248.0 [2024-08-06 00:15:27,968][52794] Sum rewards: 46.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.987', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO4': '0.154', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.588', 'weapon4': '0.636', 'WEAPON3': '1.300', 'weapon3': '2.406', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '41.000'} [2024-08-06 00:15:28,085][52662] DAMAGECOUNT value on done: 101405.0 [2024-08-06 00:15:28,087][52662] Sum rewards: 54.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.176', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '45.000'} [2024-08-06 00:15:28,545][52668] DAMAGECOUNT value on done: 92282.0 [2024-08-06 00:15:28,547][52668] Sum rewards: 58.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.152', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:28,708][52660] DAMAGECOUNT value on done: 89660.0 [2024-08-06 00:15:28,709][52660] Sum rewards: 58.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.253', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.184', 'AMMO3': '0.187', 'weapon4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.836', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '50.500'} [2024-08-06 00:15:30,892][52649] DAMAGECOUNT value on done: 90000.0 [2024-08-06 00:15:30,893][52649] Sum rewards: 58.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.272', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.237', 'weapon2': '0.382', 'weapon4': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '51.000'} [2024-08-06 00:15:30,941][52820] DAMAGECOUNT value on done: 84871.0 [2024-08-06 00:15:30,943][52820] Sum rewards: 39.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.815', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.174', 'AMMO4': '0.246', 'weapon5': '0.302', 'weapon4': '0.380', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.696', 'DAMAGECOUNT': '11.796', 'FRAGCOUNT': '35.500'} [2024-08-06 00:15:31,087][52794] DAMAGECOUNT value on done: 96696.0 [2024-08-06 00:15:31,088][52794] Sum rewards: 48.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.815', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'weapon2': '0.344', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '3.436', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:31,261][52662] DAMAGECOUNT value on done: 93888.0 [2024-08-06 00:15:31,261][52662] Sum rewards: 58.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.592', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.139', 'AMMO4': '0.153', 'WEAPON4': '0.350', 'weapon4': '0.484', 'weapon2': '0.768', 'WEAPON3': '0.800', 'weapon3': '2.542', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '49.000'} [2024-08-06 00:15:31,692][52668] DAMAGECOUNT value on done: 90884.0 [2024-08-06 00:15:31,693][52668] Sum rewards: 42.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.304', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.236', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '2.858', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '37.000'} [2024-08-06 00:15:31,814][52660] DAMAGECOUNT value on done: 92257.0 [2024-08-06 00:15:31,815][52660] Sum rewards: 45.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.059', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.266', 'weapon2': '0.404', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '3.142', 'DAMAGECOUNT': '11.478', 'FRAGCOUNT': '41.000'} [2024-08-06 00:15:32,390][52650] Updated weights for policy 0, policy_version 21261 (0.0025) [2024-08-06 00:15:32,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 174178304. Throughput: 0: 4404.7. Samples: 43543710. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 00:15:32,794][52567] Avg episode reward: [(0, '50.617')] [2024-08-06 00:15:33,666][52649] DAMAGECOUNT value on done: 88349.0 [2024-08-06 00:15:33,666][52649] Sum rewards: 41.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.088', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.201', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.458', 'WEAPON3': '1.300', 'HITCOUNT': '2.600', 'weapon3': '2.808', 'DAMAGECOUNT': '11.136', 'FRAGCOUNT': '37.000'} [2024-08-06 00:15:34,048][52820] DAMAGECOUNT value on done: 84801.0 [2024-08-06 00:15:34,049][52820] Sum rewards: 39.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon5': '0.124', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon2': '0.448', 'weapon4': '0.552', 'WEAPON3': '0.900', 'weapon3': '2.066', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '10.896', 'FRAGCOUNT': '34.000'} [2024-08-06 00:15:34,123][52794] DAMAGECOUNT value on done: 99212.0 [2024-08-06 00:15:34,124][52794] Sum rewards: 61.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.428', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '51.000'} [2024-08-06 00:15:34,132][52668] DAMAGECOUNT value on done: 93356.0 [2024-08-06 00:15:34,133][52668] Sum rewards: 50.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.564', 'AMMO5': '0.007', 'ARMOR': '0.016', 'weapon5': '0.048', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'AMMO4': '0.255', 'weapon4': '0.256', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '45.000'} [2024-08-06 00:15:34,236][52662] DAMAGECOUNT value on done: 98322.0 [2024-08-06 00:15:34,236][52662] Sum rewards: 56.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.416', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.012', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.236', 'weapon2': '0.266', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.380', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '50.000'} [2024-08-06 00:15:34,266][52660] DAMAGECOUNT value on done: 92390.0 [2024-08-06 00:15:34,267][52660] Sum rewards: 48.931, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.723', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.288', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.012', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:35,778][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:15:36,554][52650] Updated weights for policy 0, policy_version 21271 (0.0010) [2024-08-06 00:15:36,891][52649] DAMAGECOUNT value on done: 91515.0 [2024-08-06 00:15:36,893][52649] Sum rewards: 44.623, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.690', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.014', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.294', 'weapon4': '0.392', 'WEAPON4': '0.500', 'weapon2': '0.686', 'WEAPON3': '1.600', 'weapon3': '2.666', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '42.000'} [2024-08-06 00:15:37,150][52820] DAMAGECOUNT value on done: 82604.0 [2024-08-06 00:15:37,151][52820] Sum rewards: 54.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.908', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.344', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.208', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '47.000'} [2024-08-06 00:15:37,214][52794] DAMAGECOUNT value on done: 95160.0 [2024-08-06 00:15:37,214][52794] Sum rewards: 58.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.682', 'AMMO5': '0.004', 'weapon7': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.220', 'weapon2': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '50.000'} [2024-08-06 00:15:37,266][52668] DAMAGECOUNT value on done: 94300.0 [2024-08-06 00:15:37,266][52668] Sum rewards: 49.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.937', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.251', 'weapon2': '0.328', 'WEAPON4': '0.500', 'weapon4': '0.634', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:37,270][52662] DAMAGECOUNT value on done: 95466.0 [2024-08-06 00:15:37,272][52662] Sum rewards: 41.589, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.946', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.045', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.227', 'weapon4': '0.402', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '2.844', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '40.000'} [2024-08-06 00:15:37,489][52660] DAMAGECOUNT value on done: 92362.0 [2024-08-06 00:15:37,491][52660] Sum rewards: 51.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.186', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.083', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.848', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '41.000'} [2024-08-06 00:15:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 174260224. Throughput: 0: 4402.2. Samples: 43570220. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 00:15:37,802][52567] Avg episode reward: [(0, '50.771')] [2024-08-06 00:15:39,848][52794] DAMAGECOUNT value on done: 95916.0 [2024-08-06 00:15:39,850][52794] Sum rewards: 45.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.695', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.326', 'weapon2': '0.688', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '41.000'} [2024-08-06 00:15:39,880][52662] DAMAGECOUNT value on done: 99456.0 [2024-08-06 00:15:39,882][52662] Sum rewards: 44.414, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.847', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'weapon2': '0.454', 'WEAPON3': '1.700', 'HITCOUNT': '2.680', 'weapon3': '3.048', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:39,981][52669] DAMAGECOUNT value on done: 95238.0 [2024-08-06 00:15:39,981][52669] Sum rewards: 60.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'AMMO2': '0.017', 'weapon4': '0.080', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '52.000'} [2024-08-06 00:15:39,992][52649] DAMAGECOUNT value on done: 92329.0 [2024-08-06 00:15:39,992][52649] Sum rewards: 56.999, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.957', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.110', 'AMMO3': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.466', 'weapon2': '0.510', 'WEAPON3': '0.750', 'weapon3': '2.750', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '46.000'} [2024-08-06 00:15:40,263][52820] DAMAGECOUNT value on done: 84367.0 [2024-08-06 00:15:40,265][52820] Sum rewards: 60.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.306', 'AMMO2': '0.034', 'AMMO3': '0.160', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'weapon2': '0.508', 'weapon4': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '49.000'} [2024-08-06 00:15:40,450][52668] DAMAGECOUNT value on done: 92929.0 [2024-08-06 00:15:40,451][52668] Sum rewards: 52.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.259', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '2.978', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '45.000'} [2024-08-06 00:15:40,723][52660] DAMAGECOUNT value on done: 88622.0 [2024-08-06 00:15:40,725][52660] Sum rewards: 54.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.785', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.516', 'WEAPON3': '1.550', 'weapon3': '2.894', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '49.000'} [2024-08-06 00:15:40,822][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:15:41,405][52650] Updated weights for policy 0, policy_version 21281 (0.0027) [2024-08-06 00:15:42,645][52794] DAMAGECOUNT value on done: 99552.0 [2024-08-06 00:15:42,645][52794] Sum rewards: 58.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.223', 'weapon2': '0.532', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.152', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '50.000'} [2024-08-06 00:15:42,666][52662] DAMAGECOUNT value on done: 95883.0 [2024-08-06 00:15:42,666][52662] Sum rewards: 44.740, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.062', 'HEALTH': '0.130', 'AMMO4': '0.144', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.480', 'weapon3': '2.828', 'DAMAGECOUNT': '10.926', 'FRAGCOUNT': '37.000'} [2024-08-06 00:15:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 174358528. Throughput: 0: 4404.0. Samples: 43596780. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 00:15:42,802][52567] Avg episode reward: [(0, '51.084')] [2024-08-06 00:15:42,909][52669] DAMAGECOUNT value on done: 91999.0 [2024-08-06 00:15:42,911][52669] Sum rewards: 58.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.182', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon2': '0.286', 'weapon4': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.178', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '50.000'} [2024-08-06 00:15:43,138][52649] DAMAGECOUNT value on done: 86202.0 [2024-08-06 00:15:43,140][52649] Sum rewards: 39.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.068', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon4': '0.360', 'weapon2': '0.502', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.904', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '36.000'} [2024-08-06 00:15:43,238][52668] DAMAGECOUNT value on done: 94489.0 [2024-08-06 00:15:43,239][52668] Sum rewards: 51.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.692', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.064', 'AMMO4': '0.182', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.400', 'weapon4': '0.672', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:43,435][52820] DAMAGECOUNT value on done: 87272.0 [2024-08-06 00:15:43,435][52820] Sum rewards: 48.795, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.010', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.258', 'weapon2': '0.682', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.062', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:43,448][52660] DAMAGECOUNT value on done: 91006.0 [2024-08-06 00:15:43,450][52660] Sum rewards: 48.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.358', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.038', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '42.000'} [2024-08-06 00:15:45,504][52668] DAMAGECOUNT value on done: 89934.0 [2024-08-06 00:15:45,504][52668] Sum rewards: 50.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.222', 'AMMO5': '0.018', 'ARMOR': '0.036', 'AMMO2': '0.062', 'AMMO3': '0.192', 'weapon5': '0.244', 'AMMO4': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.434', 'weapon4': '0.602', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.444', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:45,610][52794] DAMAGECOUNT value on done: 95213.0 [2024-08-06 00:15:45,613][52794] Sum rewards: 54.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.196', 'WEAPON4': '0.450', 'weapon2': '0.522', 'weapon4': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.700', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '46.000'} [2024-08-06 00:15:45,637][52662] DAMAGECOUNT value on done: 94916.0 [2024-08-06 00:15:45,638][52662] Sum rewards: 37.371, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.428', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.262', 'AMMO3': '0.280', 'weapon2': '0.430', 'WEAPON3': '1.750', 'HITCOUNT': '2.680', 'weapon3': '3.052', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '37.000'} [2024-08-06 00:15:45,790][52660] DAMAGECOUNT value on done: 92481.0 [2024-08-06 00:15:45,792][52660] Sum rewards: 53.954, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.273', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.348', 'weapon2': '0.366', 'WEAPON3': '0.950', 'HITCOUNT': '3.000', 'weapon3': '3.028', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:45,840][52669] DAMAGECOUNT value on done: 92017.0 [2024-08-06 00:15:45,843][52669] Sum rewards: 42.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.434', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.054', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '38.000'} [2024-08-06 00:15:46,224][52649] DAMAGECOUNT value on done: 87275.0 [2024-08-06 00:15:46,224][52649] Sum rewards: 38.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.171', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.168', 'weapon4': '0.178', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '2.480', 'weapon3': '3.064', 'DAMAGECOUNT': '11.091', 'FRAGCOUNT': '33.500'} [2024-08-06 00:15:46,340][52650] Updated weights for policy 0, policy_version 21291 (0.0038) [2024-08-06 00:15:46,524][52820] DAMAGECOUNT value on done: 84435.0 [2024-08-06 00:15:46,524][52820] Sum rewards: 41.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.466', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon4': '0.082', 'weapon5': '0.176', 'AMMO4': '0.188', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.200', 'HITCOUNT': '2.460', 'weapon3': '2.894', 'DAMAGECOUNT': '11.394', 'FRAGCOUNT': '37.000'} [2024-08-06 00:15:47,763][52667] DAMAGECOUNT value on done: 92766.0 [2024-08-06 00:15:47,763][52667] Sum rewards: 55.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.044', 'AMMO3': '0.163', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.534', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '47.000'} [2024-08-06 00:15:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 174448640. Throughput: 0: 4402.2. Samples: 43609890. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 00:15:47,794][52567] Avg episode reward: [(0, '50.769')] [2024-08-06 00:15:48,185][52794] DAMAGECOUNT value on done: 98355.0 [2024-08-06 00:15:48,186][52794] Sum rewards: 55.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.106', 'AMMO4': '0.171', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '47.000'} [2024-08-06 00:15:48,234][52662] DAMAGECOUNT value on done: 93982.0 [2024-08-06 00:15:48,235][52662] Sum rewards: 50.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.492', 'weapon2': '0.704', 'WEAPON3': '0.850', 'weapon3': '2.618', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '41.000'} [2024-08-06 00:15:48,258][52668] DAMAGECOUNT value on done: 90523.0 [2024-08-06 00:15:48,258][52668] Sum rewards: 38.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.660', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO4': '0.196', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.410', 'WEAPON4': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.450', 'HITCOUNT': '2.440', 'weapon3': '2.714', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '36.000'} [2024-08-06 00:15:48,595][52660] DAMAGECOUNT value on done: 92069.0 [2024-08-06 00:15:48,596][52660] Sum rewards: 62.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.589', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.086', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.282', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '53.000'} [2024-08-06 00:15:48,983][52669] DAMAGECOUNT value on done: 91257.0 [2024-08-06 00:15:48,984][52669] Sum rewards: 45.253, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.600', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.080', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON4': '0.500', 'weapon2': '0.502', 'weapon4': '0.540', 'WEAPON3': '1.650', 'weapon3': '2.604', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:49,372][52649] DAMAGECOUNT value on done: 85361.0 [2024-08-06 00:15:49,374][52649] Sum rewards: 45.008, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.004', 'ARMOR': '0.020', 'weapon5': '0.034', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.206', 'weapon2': '0.360', 'WEAPON4': '0.650', 'weapon4': '0.810', 'WEAPON3': '1.250', 'weapon3': '2.506', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '41.000'} [2024-08-06 00:15:49,550][52820] DAMAGECOUNT value on done: 82757.0 [2024-08-06 00:15:49,550][52820] Sum rewards: 60.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '53.000'} [2024-08-06 00:15:50,351][52667] DAMAGECOUNT value on done: 94812.0 [2024-08-06 00:15:50,352][52667] Sum rewards: 38.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.460', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.126', 'AMMO3': '0.164', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.396', 'WEAPON3': '0.900', 'weapon2': '1.040', 'weapon3': '2.092', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '10.593', 'FRAGCOUNT': '32.000'} [2024-08-06 00:15:50,449][52650] Updated weights for policy 0, policy_version 21301 (0.0020) [2024-08-06 00:15:51,002][52794] DAMAGECOUNT value on done: 96414.0 [2024-08-06 00:15:51,004][52794] Sum rewards: 52.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.488', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.180', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:51,126][52662] DAMAGECOUNT value on done: 100832.0 [2024-08-06 00:15:51,128][52662] Sum rewards: 54.045, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.098', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'weapon2': '0.274', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'HITCOUNT': '3.140', 'weapon3': '3.240', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '50.000'} [2024-08-06 00:15:51,589][52668] DAMAGECOUNT value on done: 86145.0 [2024-08-06 00:15:51,589][52668] Sum rewards: 48.667, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.638', 'AMMO5': '0.003', 'AMMO2': '0.041', 'ARMOR': '0.048', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.201', 'AMMO4': '0.207', 'weapon4': '0.338', 'WEAPON4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '46.000'} [2024-08-06 00:15:51,819][52660] DAMAGECOUNT value on done: 93073.0 [2024-08-06 00:15:51,819][52660] Sum rewards: 47.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.873', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.534', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.128', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '41.000'} [2024-08-06 00:15:52,076][52669] DAMAGECOUNT value on done: 93129.0 [2024-08-06 00:15:52,076][52669] Sum rewards: 40.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'ARMOR': '0.032', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO3': '0.153', 'AMMO4': '0.164', 'WEAPON4': '0.500', 'weapon4': '0.500', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.594', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.688', 'FRAGCOUNT': '36.500'} [2024-08-06 00:15:52,366][52649] DAMAGECOUNT value on done: 92709.0 [2024-08-06 00:15:52,367][52649] Sum rewards: 55.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.198', 'weapon5': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.584', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '46.000'} [2024-08-06 00:15:52,738][52820] DAMAGECOUNT value on done: 85419.0 [2024-08-06 00:15:52,740][52820] Sum rewards: 59.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.345', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.099', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.344', 'weapon2': '0.752', 'WEAPON3': '0.850', 'weapon3': '2.650', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 174530560. Throughput: 0: 4409.6. Samples: 43636370. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 00:15:52,794][52567] Avg episode reward: [(0, '51.064')] [2024-08-06 00:15:53,066][52667] DAMAGECOUNT value on done: 93884.0 [2024-08-06 00:15:53,067][52667] Sum rewards: 54.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.548', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.036', 'AMMO4': '0.119', 'weapon5': '0.122', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.802', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '46.000'} [2024-08-06 00:15:53,589][52803] DAMAGECOUNT value on done: 91037.0 [2024-08-06 00:15:53,589][52803] Sum rewards: 59.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.417', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.134', 'AMMO3': '0.188', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.542', 'weapon4': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.496', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:54,009][52794] DAMAGECOUNT value on done: 102711.0 [2024-08-06 00:15:54,010][52794] Sum rewards: 52.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.468', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:54,123][52662] DAMAGECOUNT value on done: 92380.0 [2024-08-06 00:15:54,123][52662] Sum rewards: 55.066, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.146', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.346', 'weapon2': '0.406', 'WEAPON3': '0.900', 'weapon3': '2.754', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '47.000'} [2024-08-06 00:15:54,373][52668] DAMAGECOUNT value on done: 92751.0 [2024-08-06 00:15:54,376][52668] Sum rewards: 39.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.152', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'AMMO3': '0.148', 'weapon5': '0.196', 'AMMO4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON4': '0.550', 'weapon4': '0.674', 'WEAPON3': '0.850', 'weapon3': '2.212', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.692', 'FRAGCOUNT': '34.000'} [2024-08-06 00:15:54,676][52660] DAMAGECOUNT value on done: 90734.0 [2024-08-06 00:15:54,679][52660] Sum rewards: 46.489, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO4': '0.179', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.034', 'DAMAGECOUNT': '11.781', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:55,186][52669] DAMAGECOUNT value on done: 92815.0 [2024-08-06 00:15:55,187][52669] Sum rewards: 39.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.156', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'AMMO4': '0.210', 'WEAPON4': '0.500', 'weapon4': '0.602', 'weapon2': '0.946', 'WEAPON3': '0.950', 'weapon3': '2.168', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '35.000'} [2024-08-06 00:15:55,333][52668] Large shaping reward 2.503 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('weapon5', 0.002)] [2024-08-06 00:15:55,509][52650] Updated weights for policy 0, policy_version 21311 (0.0024) [2024-08-06 00:15:55,554][52667] DAMAGECOUNT value on done: 89480.0 [2024-08-06 00:15:55,555][52667] Sum rewards: 53.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.702', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.143', 'AMMO4': '0.148', 'weapon5': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.646', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '45.000'} [2024-08-06 00:15:55,569][52649] DAMAGECOUNT value on done: 87982.0 [2024-08-06 00:15:55,570][52649] Sum rewards: 46.627, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.348', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.436', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '2.556', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:55,922][52820] DAMAGECOUNT value on done: 88143.0 [2024-08-06 00:15:55,922][52820] Sum rewards: 50.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.048', 'weapon5': '0.146', 'AMMO3': '0.199', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.384', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '43.000'} [2024-08-06 00:15:56,751][52803] DAMAGECOUNT value on done: 89871.0 [2024-08-06 00:15:56,751][52803] Sum rewards: 50.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.278', 'AMMO5': '0.006', 'weapon5': '0.032', 'AMMO2': '0.034', 'ARMOR': '0.060', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.074', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:56,936][52794] DAMAGECOUNT value on done: 92207.0 [2024-08-06 00:15:56,936][52794] Sum rewards: 52.358, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.152', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO3': '0.121', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.490', 'weapon2': '0.526', 'WEAPON3': '0.850', 'HITCOUNT': '2.790', 'weapon3': '2.832', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '42.000'} [2024-08-06 00:15:57,034][52662] DAMAGECOUNT value on done: 99204.0 [2024-08-06 00:15:57,035][52662] Sum rewards: 62.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.956', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.211', 'weapon4': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '53.000'} [2024-08-06 00:15:57,340][52668] DAMAGECOUNT value on done: 92104.0 [2024-08-06 00:15:57,343][52668] Sum rewards: 54.177, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.243', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.078', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon2': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.868', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '45.000'} [2024-08-06 00:15:57,673][52660] DAMAGECOUNT value on done: 91890.0 [2024-08-06 00:15:57,673][52660] Sum rewards: 54.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.059', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.718', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '46.000'} [2024-08-06 00:15:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17578.2). Total num frames: 174612480. Throughput: 0: 4401.6. Samples: 43662380. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 00:15:57,802][52567] Avg episode reward: [(0, '51.100')] [2024-08-06 00:15:57,946][52669] DAMAGECOUNT value on done: 93139.0 [2024-08-06 00:15:57,946][52669] Sum rewards: 47.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.384', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon4': '0.236', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.038', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '44.000'} [2024-08-06 00:15:58,316][52667] DAMAGECOUNT value on done: 95266.0 [2024-08-06 00:15:58,316][52667] Sum rewards: 52.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.175', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon4': '0.210', 'AMMO3': '0.257', 'weapon2': '0.484', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.088', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '47.000'} [2024-08-06 00:15:58,467][52811] DAMAGECOUNT value on done: 90540.0 [2024-08-06 00:15:58,470][52811] Sum rewards: 57.462, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon4': '0.318', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '2.990', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '51.000'} [2024-08-06 00:15:58,651][52649] DAMAGECOUNT value on done: 90072.0 [2024-08-06 00:15:58,654][52649] Sum rewards: 67.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.263', 'AMMO2': '0.008', 'ARMOR': '0.016', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon4': '0.276', 'weapon2': '0.576', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 00:15:59,030][52820] DAMAGECOUNT value on done: 85039.0 [2024-08-06 00:15:59,031][52820] Sum rewards: 54.917, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.940', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.754', 'WEAPON3': '1.250', 'weapon3': '2.584', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '48.000'} [2024-08-06 00:15:59,921][52803] DAMAGECOUNT value on done: 87962.0 [2024-08-06 00:15:59,923][52803] Sum rewards: 56.014, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.862', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.145', 'AMMO4': '0.166', 'weapon5': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '2.954', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '45.000'} [2024-08-06 00:15:59,979][52794] DAMAGECOUNT value on done: 98995.0 [2024-08-06 00:15:59,979][52794] Sum rewards: 54.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.682', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '46.500'} [2024-08-06 00:16:00,141][52662] DAMAGECOUNT value on done: 96837.0 [2024-08-06 00:16:00,142][52662] Sum rewards: 59.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.204', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '50.000'} [2024-08-06 00:16:00,288][52668] DAMAGECOUNT value on done: 94156.0 [2024-08-06 00:16:00,289][52668] Sum rewards: 49.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.778', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.502', 'weapon4': '0.524', 'WEAPON3': '1.600', 'weapon3': '2.648', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:00,373][52650] Updated weights for policy 0, policy_version 21321 (0.0027) [2024-08-06 00:16:00,618][52669] DAMAGECOUNT value on done: 92084.0 [2024-08-06 00:16:00,622][52669] Sum rewards: 55.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.008', 'AMMO5': '0.016', 'ARMOR': '0.028', 'AMMO2': '0.046', 'AMMO3': '0.198', 'AMMO4': '0.229', 'weapon2': '0.310', 'weapon5': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.308', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '48.000'} [2024-08-06 00:16:00,737][52660] DAMAGECOUNT value on done: 89230.0 [2024-08-06 00:16:00,738][52660] Sum rewards: 49.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.654', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.175', 'WEAPON4': '0.500', 'weapon2': '0.614', 'weapon4': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:01,447][52667] DAMAGECOUNT value on done: 91705.0 [2024-08-06 00:16:01,447][52667] Sum rewards: 60.198, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.570', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon2': '0.212', 'AMMO3': '0.279', 'WEAPON3': '1.750', 'weapon3': '3.400', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 00:16:01,664][52811] DAMAGECOUNT value on done: 83785.0 [2024-08-06 00:16:01,664][52811] Sum rewards: 52.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:01,696][52649] DAMAGECOUNT value on done: 88322.0 [2024-08-06 00:16:01,697][52649] Sum rewards: 31.595, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.730', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.148', 'AMMO4': '0.195', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon4': '0.490', 'weapon2': '0.526', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '1.890', 'weapon3': '2.392', 'DAMAGECOUNT': '8.238', 'FRAGCOUNT': '28.000'} [2024-08-06 00:16:02,169][52820] DAMAGECOUNT value on done: 86196.0 [2024-08-06 00:16:02,170][52820] Sum rewards: 48.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.494', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.588', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.026', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 174702592. Throughput: 0: 4402.2. Samples: 43675540. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 00:16:02,794][52567] Avg episode reward: [(0, '51.020')] [2024-08-06 00:16:03,091][52803] DAMAGECOUNT value on done: 85527.0 [2024-08-06 00:16:03,093][52803] Sum rewards: 33.250, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.500', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.058', 'AMMO2': '0.075', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'AMMO4': '0.374', 'weapon4': '0.384', 'weapon2': '0.502', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.410', 'weapon3': '2.794', 'DAMAGECOUNT': '10.020', 'FRAGCOUNT': '34.000'} [2024-08-06 00:16:03,107][52794] DAMAGECOUNT value on done: 98182.0 [2024-08-06 00:16:03,107][52794] Sum rewards: 58.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.245', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.144', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'AMMO4': '0.247', 'weapon4': '0.372', 'WEAPON4': '0.450', 'weapon2': '0.778', 'WEAPON3': '0.850', 'weapon3': '2.506', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:03,294][52662] DAMAGECOUNT value on done: 95302.0 [2024-08-06 00:16:03,297][52662] Sum rewards: 53.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.259', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.022', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.234', 'weapon2': '0.514', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.192', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:03,306][52668] DAMAGECOUNT value on done: 90056.0 [2024-08-06 00:16:03,308][52668] Sum rewards: 51.191, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.767', 'AMMO5': '0.007', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon5': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.528', 'weapon2': '0.722', 'WEAPON3': '0.950', 'weapon3': '2.442', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '41.500'} [2024-08-06 00:16:03,573][52660] DAMAGECOUNT value on done: 90886.0 [2024-08-06 00:16:03,575][52660] Sum rewards: 47.987, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.400', 'weapon4': '0.532', 'weapon2': '0.590', 'WEAPON3': '0.800', 'weapon3': '2.688', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '39.000'} [2024-08-06 00:16:03,759][52669] DAMAGECOUNT value on done: 93004.0 [2024-08-06 00:16:03,760][52669] Sum rewards: 49.410, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.024', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.192', 'weapon4': '0.346', 'WEAPON4': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:04,423][52649] DAMAGECOUNT value on done: 89783.0 [2024-08-06 00:16:04,425][52649] Sum rewards: 60.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.248', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:04,734][52667] DAMAGECOUNT value on done: 93923.0 [2024-08-06 00:16:04,737][52667] Sum rewards: 47.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.085', 'AMMO5': '0.003', 'weapon5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.181', 'AMMO3': '0.229', 'WEAPON4': '0.400', 'weapon2': '0.446', 'weapon4': '0.532', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:04,807][52650] Updated weights for policy 0, policy_version 21331 (0.0012) [2024-08-06 00:16:04,877][52811] DAMAGECOUNT value on done: 86079.0 [2024-08-06 00:16:04,878][52811] Sum rewards: 43.777, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.144', 'AMMO4': '0.163', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.378', 'weapon2': '0.550', 'HEALTH': '0.564', 'WEAPON3': '0.800', 'HITCOUNT': '2.510', 'weapon3': '2.544', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '36.000'} [2024-08-06 00:16:05,282][52820] DAMAGECOUNT value on done: 89578.0 [2024-08-06 00:16:05,282][52820] Sum rewards: 38.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.096', 'AMMO3': '0.191', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.376', 'ARMOR': '0.498', 'weapon4': '0.520', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.644', 'DAMAGECOUNT': '10.677', 'FRAGCOUNT': '34.000'} [2024-08-06 00:16:05,887][52794] DAMAGECOUNT value on done: 96490.0 [2024-08-06 00:16:05,888][52794] Sum rewards: 44.846, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.108', 'AMMO4': '0.213', 'AMMO3': '0.220', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.550', 'weapon2': '0.554', 'WEAPON3': '1.300', 'HITCOUNT': '2.630', 'weapon3': '2.652', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '39.000'} [2024-08-06 00:16:05,963][52668] DAMAGECOUNT value on done: 91470.0 [2024-08-06 00:16:05,963][52668] Sum rewards: 58.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.237', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.138', 'WEAPON4': '0.150', 'weapon2': '0.206', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '3.400', 'weapon3': '3.442', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '51.000'} [2024-08-06 00:16:06,167][52803] DAMAGECOUNT value on done: 88546.0 [2024-08-06 00:16:06,168][52803] Sum rewards: 54.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.085', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.166', 'AMMO4': '0.210', 'AMMO3': '0.214', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:06,401][52660] DAMAGECOUNT value on done: 92637.0 [2024-08-06 00:16:06,405][52660] Sum rewards: 51.635, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.886', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.494', 'WEAPON4': '0.550', 'weapon4': '0.554', 'WEAPON3': '1.400', 'weapon3': '2.564', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:07,286][52669] DAMAGECOUNT value on done: 90812.0 [2024-08-06 00:16:07,287][52669] Sum rewards: 53.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.156', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.242', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:07,366][52667] DAMAGECOUNT value on done: 94900.0 [2024-08-06 00:16:07,366][52667] Sum rewards: 46.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.203', 'weapon2': '0.772', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.888', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:07,494][52649] DAMAGECOUNT value on done: 93762.0 [2024-08-06 00:16:07,495][52649] Sum rewards: 54.131, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.624', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.267', 'AMMO3': '0.285', 'weapon4': '0.412', 'weapon2': '0.426', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.642', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '50.000'} [2024-08-06 00:16:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 174792704. Throughput: 0: 4392.5. Samples: 43701950. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 00:16:07,794][52567] Avg episode reward: [(0, '50.603')] [2024-08-06 00:16:07,959][52811] DAMAGECOUNT value on done: 86764.0 [2024-08-06 00:16:07,961][52811] Sum rewards: 48.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.044', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.396', 'WEAPON4': '0.600', 'weapon4': '0.886', 'WEAPON3': '1.350', 'weapon3': '2.422', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:08,381][52820] DAMAGECOUNT value on done: 88628.0 [2024-08-06 00:16:08,383][52820] Sum rewards: 44.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.584', 'ARMOR': '0.016', 'AMMO2': '0.042', 'AMMO4': '0.211', 'AMMO3': '0.214', 'weapon2': '0.392', 'weapon4': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '2.904', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:08,804][52794] DAMAGECOUNT value on done: 101645.0 [2024-08-06 00:16:08,805][52794] Sum rewards: 64.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.704', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.796', 'WEAPON3': '0.900', 'weapon3': '2.752', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '51.000'} [2024-08-06 00:16:08,981][52668] DAMAGECOUNT value on done: 95002.0 [2024-08-06 00:16:08,981][52668] Sum rewards: 61.617, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.506', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.232', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:09,069][52803] DAMAGECOUNT value on done: 87003.0 [2024-08-06 00:16:09,070][52803] Sum rewards: 52.997, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.832', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'AMMO4': '0.231', 'WEAPON4': '0.500', 'weapon4': '0.566', 'weapon2': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.532', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:09,367][52660] DAMAGECOUNT value on done: 97769.0 [2024-08-06 00:16:09,367][52660] Sum rewards: 65.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.149', 'weapon2': '0.640', 'WEAPON3': '0.950', 'weapon3': '3.136', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:09,893][52650] Updated weights for policy 0, policy_version 21341 (0.0012) [2024-08-06 00:16:10,032][52667] DAMAGECOUNT value on done: 93514.0 [2024-08-06 00:16:10,033][52667] Sum rewards: 43.922, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.682', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'weapon4': '0.230', 'AMMO3': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.600', 'HITCOUNT': '2.710', 'weapon3': '2.980', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:10,055][52669] DAMAGECOUNT value on done: 96879.0 [2024-08-06 00:16:10,056][52669] Sum rewards: 61.256, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.364', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.336', 'weapon2': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.876', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '49.000'} [2024-08-06 00:16:10,713][52649] DAMAGECOUNT value on done: 92474.0 [2024-08-06 00:16:10,713][52649] Sum rewards: 50.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.078', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.346', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.442', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:11,087][52811] DAMAGECOUNT value on done: 86427.0 [2024-08-06 00:16:11,088][52811] Sum rewards: 64.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.312', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.102', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '52.000'} [2024-08-06 00:16:11,484][52820] DAMAGECOUNT value on done: 86847.0 [2024-08-06 00:16:11,486][52820] Sum rewards: 50.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.154', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.358', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.998', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:11,882][52794] DAMAGECOUNT value on done: 97333.0 [2024-08-06 00:16:11,883][52794] Sum rewards: 57.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.092', 'WEAPON4': '0.100', 'weapon2': '0.256', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'HITCOUNT': '2.920', 'weapon3': '3.434', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '50.000'} [2024-08-06 00:16:12,134][52668] DAMAGECOUNT value on done: 94657.0 [2024-08-06 00:16:12,134][52668] Sum rewards: 51.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.945', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.138', 'AMMO3': '0.170', 'weapon4': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.782', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:12,139][52803] DAMAGECOUNT value on done: 90374.0 [2024-08-06 00:16:12,141][52803] Sum rewards: 52.037, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.384', 'AMMO2': '0.015', 'ARMOR': '0.034', 'AMMO4': '0.073', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon2': '0.432', 'weapon4': '0.436', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '3.008', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:12,395][52660] DAMAGECOUNT value on done: 91716.0 [2024-08-06 00:16:12,396][52660] Sum rewards: 48.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.012', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.452', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '2.930', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 174874624. Throughput: 0: 4395.8. Samples: 43728180. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 00:16:12,802][52567] Avg episode reward: [(0, '51.351')] [2024-08-06 00:16:12,883][52667] DAMAGECOUNT value on done: 95155.0 [2024-08-06 00:16:12,884][52667] Sum rewards: 43.477, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.745', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.068', 'weapon4': '0.124', 'AMMO4': '0.183', 'AMMO3': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.176', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '40.000'} [2024-08-06 00:16:13,007][52669] DAMAGECOUNT value on done: 94865.0 [2024-08-06 00:16:13,007][52669] Sum rewards: 58.621, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.865', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.275', 'weapon2': '0.294', 'WEAPON3': '1.700', 'HITCOUNT': '3.050', 'weapon3': '3.410', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:13,731][52649] DAMAGECOUNT value on done: 84566.0 [2024-08-06 00:16:13,732][52649] Sum rewards: 48.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.695', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'AMMO3': '0.204', 'weapon2': '0.276', 'WEAPON4': '0.500', 'weapon4': '0.768', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:13,887][52650] Updated weights for policy 0, policy_version 21351 (0.0021) [2024-08-06 00:16:14,141][52811] DAMAGECOUNT value on done: 89294.0 [2024-08-06 00:16:14,141][52811] Sum rewards: 54.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.292', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.079', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.364', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.338', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:15,164][52803] DAMAGECOUNT value on done: 87346.0 [2024-08-06 00:16:15,166][52803] Sum rewards: 64.866, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.030', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.196', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 00:16:15,545][52669] DAMAGECOUNT value on done: 92043.0 [2024-08-06 00:16:15,548][52669] Sum rewards: 55.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.482', 'weapon4': '0.630', 'WEAPON3': '1.400', 'weapon3': '2.646', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:15,552][52660] DAMAGECOUNT value on done: 93955.0 [2024-08-06 00:16:15,553][52660] Sum rewards: 56.563, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.302', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.380', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '52.000'} [2024-08-06 00:16:15,942][52667] DAMAGECOUNT value on done: 93641.0 [2024-08-06 00:16:15,942][52667] Sum rewards: 60.588, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'HEALTH': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon2': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '48.000'} [2024-08-06 00:16:16,742][52649] DAMAGECOUNT value on done: 93689.0 [2024-08-06 00:16:16,743][52649] Sum rewards: 55.931, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.246', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.060', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.297', 'weapon2': '0.322', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.942', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '49.000'} [2024-08-06 00:16:17,254][52811] DAMAGECOUNT value on done: 86680.0 [2024-08-06 00:16:17,256][52811] Sum rewards: 50.783, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.160', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO4': '0.071', 'weapon2': '0.202', 'AMMO3': '0.230', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '3.568', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:17,329][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:16:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 174964736. Throughput: 0: 4389.3. Samples: 43741230. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 00:16:17,802][52567] Avg episode reward: [(0, '51.564')] [2024-08-06 00:16:18,236][52803] DAMAGECOUNT value on done: 87091.0 [2024-08-06 00:16:18,238][52803] Sum rewards: 52.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.802', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.328', 'ARMOR': '0.408', 'weapon2': '0.652', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '2.864', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:18,371][52669] DAMAGECOUNT value on done: 94351.0 [2024-08-06 00:16:18,371][52669] Sum rewards: 56.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.885', 'AMMO5': '0.003', 'AMMO2': '0.022', 'ARMOR': '0.040', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.190', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.102', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:18,886][52650] Updated weights for policy 0, policy_version 21361 (0.0011) [2024-08-06 00:16:18,911][52660] DAMAGECOUNT value on done: 90397.0 [2024-08-06 00:16:18,914][52660] Sum rewards: 56.340, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.052', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.562', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.180', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:18,935][52667] DAMAGECOUNT value on done: 93001.0 [2024-08-06 00:16:18,937][52667] Sum rewards: 61.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.126', 'weapon4': '0.174', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:19,363][52649] DAMAGECOUNT value on done: 87760.0 [2024-08-06 00:16:19,363][52649] Sum rewards: 35.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.056', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.078', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.288', 'WEAPON4': '0.500', 'weapon4': '0.792', 'WEAPON3': '1.250', 'HITCOUNT': '2.380', 'weapon3': '2.518', 'DAMAGECOUNT': '9.537', 'FRAGCOUNT': '33.500'} [2024-08-06 00:16:20,483][52811] DAMAGECOUNT value on done: 86156.0 [2024-08-06 00:16:20,486][52811] Sum rewards: 50.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.632', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.155', 'AMMO3': '0.207', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '2.900', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:21,192][52669] DAMAGECOUNT value on done: 98152.0 [2024-08-06 00:16:21,192][52669] Sum rewards: 63.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.266', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 00:16:21,230][52803] DAMAGECOUNT value on done: 82960.0 [2024-08-06 00:16:21,230][52803] Sum rewards: 31.528, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.015', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.018', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'weapon4': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.308', 'weapon2': '0.366', 'WEAPON3': '1.850', 'HITCOUNT': '2.320', 'weapon3': '3.096', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '34.500'} [2024-08-06 00:16:21,903][52667] DAMAGECOUNT value on done: 93537.0 [2024-08-06 00:16:21,905][52667] Sum rewards: 54.283, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.000', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.234', 'WEAPON3': '0.800', 'weapon2': '0.918', 'weapon3': '2.734', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:21,936][52658] DAMAGECOUNT value on done: 95560.0 [2024-08-06 00:16:21,940][52658] Sum rewards: 64.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.875', 'AMMO5': '0.006', 'weapon5': '0.022', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.249', 'weapon2': '0.276', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.220', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:22,119][52649] DAMAGECOUNT value on done: 92820.0 [2024-08-06 00:16:22,121][52649] Sum rewards: 51.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.466', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.304', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:22,133][52660] DAMAGECOUNT value on done: 95205.0 [2024-08-06 00:16:22,136][52660] Sum rewards: 56.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon2': '0.384', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.394', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 175054848. Throughput: 0: 4388.7. Samples: 43767710. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 00:16:22,794][52567] Avg episode reward: [(0, '52.260')] [2024-08-06 00:16:23,637][52650] Updated weights for policy 0, policy_version 21371 (0.0023) [2024-08-06 00:16:23,652][52811] DAMAGECOUNT value on done: 89116.0 [2024-08-06 00:16:23,655][52811] Sum rewards: 58.564, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.588', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '52.000'} [2024-08-06 00:16:23,665][52669] DAMAGECOUNT value on done: 100241.0 [2024-08-06 00:16:23,665][52669] Sum rewards: 57.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.405', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.394', 'weapon4': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '50.000'} [2024-08-06 00:16:24,238][52803] DAMAGECOUNT value on done: 89808.0 [2024-08-06 00:16:24,239][52803] Sum rewards: 59.202, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.684', 'AMMO2': '0.005', 'AMMO5': '0.009', 'weapon5': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.023', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.296', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.518', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '52.000'} [2024-08-06 00:16:24,909][52649] DAMAGECOUNT value on done: 91066.0 [2024-08-06 00:16:24,910][52649] Sum rewards: 46.827, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'HEALTH': '0.013', 'AMMO2': '0.024', 'ARMOR': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.177', 'weapon5': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.308', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.996', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '38.000'} [2024-08-06 00:16:25,003][52667] DAMAGECOUNT value on done: 91674.0 [2024-08-06 00:16:25,005][52667] Sum rewards: 47.621, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.235', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.161', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.014', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:25,005][52660] DAMAGECOUNT value on done: 91390.0 [2024-08-06 00:16:25,008][52660] Sum rewards: 47.915, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.306', 'ARMOR': '0.008', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.259', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.160', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:25,042][52658] DAMAGECOUNT value on done: 93269.0 [2024-08-06 00:16:25,046][52658] Sum rewards: 51.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.178', 'AMMO3': '0.225', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:26,674][52669] DAMAGECOUNT value on done: 94480.0 [2024-08-06 00:16:26,678][52669] Sum rewards: 45.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.112', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.784', 'WEAPON3': '1.200', 'HITCOUNT': '2.530', 'weapon3': '2.888', 'DAMAGECOUNT': '10.728', 'FRAGCOUNT': '40.000'} [2024-08-06 00:16:26,703][52811] DAMAGECOUNT value on done: 87812.0 [2024-08-06 00:16:26,705][52811] Sum rewards: 52.326, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.209', 'weapon2': '0.360', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.358', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:27,215][52803] DAMAGECOUNT value on done: 89611.0 [2024-08-06 00:16:27,216][52803] Sum rewards: 55.140, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.458', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 175144960. Throughput: 0: 4387.6. Samples: 43794220. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 00:16:27,802][52567] Avg episode reward: [(0, '52.443')] [2024-08-06 00:16:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021380_175144960.pth... [2024-08-06 00:16:27,848][52667] DAMAGECOUNT value on done: 94156.0 [2024-08-06 00:16:27,848][52667] Sum rewards: 57.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.888', 'ARMOR': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.213', 'weapon2': '0.288', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.426', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '49.000'} [2024-08-06 00:16:27,866][52658] DAMAGECOUNT value on done: 93427.0 [2024-08-06 00:16:27,866][52658] Sum rewards: 49.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.432', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.160', 'AMMO3': '0.195', 'AMMO4': '0.277', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.550', 'weapon4': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.538', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:27,901][52649] DAMAGECOUNT value on done: 96058.0 [2024-08-06 00:16:27,902][52649] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.571', 'ARMOR': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'weapon4': '0.500', 'weapon2': '0.690', 'WEAPON3': '0.900', 'weapon3': '2.694', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '49.000'} [2024-08-06 00:16:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000020865_170926080.pth [2024-08-06 00:16:28,130][52650] Updated weights for policy 0, policy_version 21381 (0.0015) [2024-08-06 00:16:29,310][52669] DAMAGECOUNT value on done: 92764.0 [2024-08-06 00:16:29,310][52669] Sum rewards: 46.191, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.615', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.269', 'weapon4': '0.366', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.818', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:29,808][52811] DAMAGECOUNT value on done: 87944.0 [2024-08-06 00:16:29,809][52811] Sum rewards: 51.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.756', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.404', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.710', 'weapon3': '2.890', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:30,419][52803] DAMAGECOUNT value on done: 86839.0 [2024-08-06 00:16:30,422][52803] Sum rewards: 56.352, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.874', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.514', 'weapon4': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:30,790][52614] Signal inference workers to stop experience collection... (4000 times) [2024-08-06 00:16:30,790][52614] Signal inference workers to resume experience collection... (4000 times) [2024-08-06 00:16:30,856][52650] InferenceWorker_p0-w0: stopping experience collection (4000 times) [2024-08-06 00:16:30,856][52650] InferenceWorker_p0-w0: resuming experience collection (4000 times) [2024-08-06 00:16:31,078][52667] DAMAGECOUNT value on done: 100203.0 [2024-08-06 00:16:31,079][52667] Sum rewards: 66.505, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'HEALTH': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.115', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '57.000'} [2024-08-06 00:16:31,132][52658] DAMAGECOUNT value on done: 95638.0 [2024-08-06 00:16:31,133][52658] Sum rewards: 58.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.074', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO4': '0.195', 'AMMO3': '0.198', 'weapon2': '0.400', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '52.000'} [2024-08-06 00:16:32,039][52666] DAMAGECOUNT value on done: 93208.0 [2024-08-06 00:16:32,041][52666] Sum rewards: 58.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon4': '0.210', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '50.500'} [2024-08-06 00:16:32,200][52669] DAMAGECOUNT value on done: 94219.0 [2024-08-06 00:16:32,203][52669] Sum rewards: 65.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.152', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon2': '0.198', 'weapon4': '0.482', 'WEAPON3': '0.950', 'weapon3': '3.038', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:32,647][52650] Updated weights for policy 0, policy_version 21391 (0.0019) [2024-08-06 00:16:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 175235072. Throughput: 0: 4382.0. Samples: 43807080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:16:32,794][52567] Avg episode reward: [(0, '52.880')] [2024-08-06 00:16:32,795][52614] Saving new best policy, reward=52.880! [2024-08-06 00:16:32,857][52811] DAMAGECOUNT value on done: 86206.0 [2024-08-06 00:16:32,858][52811] Sum rewards: 48.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.027', 'weapon5': '0.064', 'AMMO4': '0.132', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '2.842', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '40.000'} [2024-08-06 00:16:33,638][52803] DAMAGECOUNT value on done: 88450.0 [2024-08-06 00:16:33,640][52803] Sum rewards: 57.517, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.030', 'weapon4': '0.048', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.470', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.246', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '51.000'} [2024-08-06 00:16:34,195][52667] DAMAGECOUNT value on done: 95045.0 [2024-08-06 00:16:34,195][52667] Sum rewards: 47.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.075', 'weapon5': '0.120', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'AMMO4': '0.376', 'weapon2': '0.536', 'WEAPON4': '0.600', 'weapon4': '0.866', 'WEAPON3': '0.900', 'weapon3': '2.186', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '40.000'} [2024-08-06 00:16:34,236][52658] DAMAGECOUNT value on done: 96571.0 [2024-08-06 00:16:34,238][52658] Sum rewards: 55.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.387', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO2': '0.053', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'AMMO4': '0.264', 'weapon4': '0.336', 'weapon2': '0.494', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:34,777][52666] DAMAGECOUNT value on done: 93036.0 [2024-08-06 00:16:34,778][52666] Sum rewards: 51.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.166', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.036', 'AMMO2': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'AMMO4': '0.298', 'weapon4': '0.466', 'WEAPON4': '0.550', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon3': '2.608', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:35,494][52669] DAMAGECOUNT value on done: 93524.0 [2024-08-06 00:16:35,495][52669] Sum rewards: 50.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.838', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.166', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:35,980][52811] DAMAGECOUNT value on done: 89291.0 [2024-08-06 00:16:35,981][52811] Sum rewards: 46.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.926', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'WEAPON4': '0.350', 'weapon2': '0.520', 'weapon4': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.666', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '39.000'} [2024-08-06 00:16:36,764][52803] DAMAGECOUNT value on done: 86899.0 [2024-08-06 00:16:36,765][52803] Sum rewards: 45.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon5': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.398', 'weapon4': '0.408', 'WEAPON3': '1.050', 'HITCOUNT': '2.400', 'weapon3': '2.734', 'DAMAGECOUNT': '11.211', 'FRAGCOUNT': '39.000'} [2024-08-06 00:16:37,055][52666] DAMAGECOUNT value on done: 94873.0 [2024-08-06 00:16:37,056][52666] Sum rewards: 42.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.320', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon7': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.146', 'WEAPON7': '0.200', 'AMMO3': '0.214', 'weapon2': '0.416', 'WEAPON4': '0.500', 'weapon4': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.202', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '38.000'} [2024-08-06 00:16:37,188][52667] DAMAGECOUNT value on done: 99936.0 [2024-08-06 00:16:37,188][52667] Sum rewards: 46.057, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.786', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.173', 'weapon5': '0.222', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '38.000'} [2024-08-06 00:16:37,280][52658] DAMAGECOUNT value on done: 91459.0 [2024-08-06 00:16:37,281][52658] Sum rewards: 50.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.845', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.444', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.018', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:37,560][52650] Updated weights for policy 0, policy_version 21401 (0.0012) [2024-08-06 00:16:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 175316992. Throughput: 0: 4375.6. Samples: 43833270. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:16:37,794][52567] Avg episode reward: [(0, '52.786')] [2024-08-06 00:16:38,331][52663] DAMAGECOUNT value on done: 93659.0 [2024-08-06 00:16:38,331][52663] Sum rewards: 58.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.179', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.304', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '50.500'} [2024-08-06 00:16:39,007][52811] DAMAGECOUNT value on done: 86889.0 [2024-08-06 00:16:39,008][52811] Sum rewards: 55.028, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.791', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.308', 'weapon4': '0.510', 'WEAPON3': '1.500', 'weapon3': '2.784', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '50.000'} [2024-08-06 00:16:39,079][52670] DAMAGECOUNT value on done: 90607.0 [2024-08-06 00:16:39,080][52670] Sum rewards: 49.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.232', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:39,551][52666] DAMAGECOUNT value on done: 88385.0 [2024-08-06 00:16:39,551][52666] Sum rewards: 55.906, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.445', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon5': '0.074', 'AMMO3': '0.138', 'WEAPON4': '0.350', 'weapon4': '0.462', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '2.606', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:39,757][52803] DAMAGECOUNT value on done: 84349.0 [2024-08-06 00:16:39,757][52803] Sum rewards: 49.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'ARMOR': '0.024', 'weapon5': '0.038', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'weapon4': '0.434', 'weapon2': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.740', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:40,324][52667] DAMAGECOUNT value on done: 91555.0 [2024-08-06 00:16:40,325][52667] Sum rewards: 44.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.040', 'weapon4': '0.086', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.744', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.980', 'DAMAGECOUNT': '11.094', 'FRAGCOUNT': '39.000'} [2024-08-06 00:16:40,443][52658] DAMAGECOUNT value on done: 98796.0 [2024-08-06 00:16:40,443][52658] Sum rewards: 48.963, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.218', 'weapon5': '0.260', 'AMMO4': '0.311', 'weapon2': '0.380', 'WEAPON5': '0.450', 'weapon4': '0.564', 'WEAPON4': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.492', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:40,947][52663] DAMAGECOUNT value on done: 93930.0 [2024-08-06 00:16:40,947][52663] Sum rewards: 48.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.590', 'AMMO5': '0.004', 'ARMOR': '0.027', 'weapon5': '0.028', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'AMMO4': '0.255', 'weapon2': '0.470', 'weapon4': '0.522', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:41,550][52670] DAMAGECOUNT value on done: 95325.0 [2024-08-06 00:16:41,551][52670] Sum rewards: 52.018, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.332', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon4': '0.120', 'weapon5': '0.146', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'WEAPON4': '0.500', 'weapon2': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.752', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '49.000'} [2024-08-06 00:16:41,946][52666] DAMAGECOUNT value on done: 91844.0 [2024-08-06 00:16:41,948][52666] Sum rewards: 53.470, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.922', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon2': '0.374', 'weapon4': '0.454', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:42,117][52811] DAMAGECOUNT value on done: 89147.0 [2024-08-06 00:16:42,117][52811] Sum rewards: 55.067, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.883', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.101', 'weapon5': '0.198', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon4': '0.696', 'weapon2': '0.724', 'weapon3': '2.112', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '43.500'} [2024-08-06 00:16:42,509][52650] Updated weights for policy 0, policy_version 21411 (0.0022) [2024-08-06 00:16:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 175398912. Throughput: 0: 4382.7. Samples: 43859600. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:16:42,794][52567] Avg episode reward: [(0, '52.456')] [2024-08-06 00:16:42,959][52803] DAMAGECOUNT value on done: 88504.0 [2024-08-06 00:16:42,961][52803] Sum rewards: 56.584, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.153', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '50.000'} [2024-08-06 00:16:43,043][52667] DAMAGECOUNT value on done: 97837.0 [2024-08-06 00:16:43,044][52667] Sum rewards: 56.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.565', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon5': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:43,134][52658] DAMAGECOUNT value on done: 91828.0 [2024-08-06 00:16:43,136][52658] Sum rewards: 47.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.195', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.216', 'WEAPON4': '0.400', 'weapon2': '0.424', 'weapon4': '0.440', 'WEAPON3': '1.400', 'weapon3': '2.808', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '43.000'} [2024-08-06 00:16:43,592][52663] DAMAGECOUNT value on done: 94919.0 [2024-08-06 00:16:43,593][52663] Sum rewards: 58.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.243', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.112', 'AMMO3': '0.180', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '50.000'} [2024-08-06 00:16:44,455][52670] DAMAGECOUNT value on done: 90137.0 [2024-08-06 00:16:44,466][52670] Sum rewards: 54.879, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.527', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.138', 'weapon5': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.680', 'WEAPON3': '0.850', 'HITCOUNT': '2.640', 'weapon3': '2.664', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:45,095][52666] DAMAGECOUNT value on done: 90107.0 [2024-08-06 00:16:45,095][52666] Sum rewards: 53.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.234', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.156', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.570', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:45,229][52811] DAMAGECOUNT value on done: 88987.0 [2024-08-06 00:16:45,233][52811] Sum rewards: 51.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.472', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'AMMO3': '0.178', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon5': '0.264', 'weapon4': '0.498', 'WEAPON4': '0.500', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.376', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:45,938][52803] DAMAGECOUNT value on done: 88034.0 [2024-08-06 00:16:45,941][52803] Sum rewards: 57.016, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.588', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.106', 'AMMO3': '0.152', 'weapon2': '0.284', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.106', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '48.000'} [2024-08-06 00:16:46,109][52658] DAMAGECOUNT value on done: 97648.0 [2024-08-06 00:16:46,109][52658] Sum rewards: 62.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.199', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '53.000'} [2024-08-06 00:16:46,116][52663] DAMAGECOUNT value on done: 94698.0 [2024-08-06 00:16:46,118][52663] Sum rewards: 41.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.036', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.178', 'AMMO4': '0.224', 'weapon5': '0.288', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.682', 'WEAPON3': '1.150', 'HITCOUNT': '2.130', 'weapon3': '2.404', 'DAMAGECOUNT': '10.554', 'FRAGCOUNT': '36.000'} [2024-08-06 00:16:46,797][52650] Updated weights for policy 0, policy_version 21421 (0.0012) [2024-08-06 00:16:47,067][52794] Large shaping reward 3.516 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:16:47,594][52670] DAMAGECOUNT value on done: 93164.0 [2024-08-06 00:16:47,595][52670] Sum rewards: 46.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.718', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.165', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.458', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 175489024. Throughput: 0: 4382.7. Samples: 43872760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:16:47,794][52567] Avg episode reward: [(0, '52.865')] [2024-08-06 00:16:48,232][52666] DAMAGECOUNT value on done: 90092.0 [2024-08-06 00:16:48,232][52666] Sum rewards: 54.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.668', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.050', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:48,240][52811] DAMAGECOUNT value on done: 88653.0 [2024-08-06 00:16:48,244][52811] Sum rewards: 51.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.621', 'AMMO5': '0.011', 'AMMO2': '0.024', 'ARMOR': '0.040', 'AMMO4': '0.122', 'AMMO3': '0.198', 'weapon5': '0.202', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '2.494', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '45.000'} [2024-08-06 00:16:48,877][52663] DAMAGECOUNT value on done: 91655.0 [2024-08-06 00:16:48,879][52663] Sum rewards: 46.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.785', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.147', 'AMMO3': '0.246', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:48,898][52803] DAMAGECOUNT value on done: 91019.0 [2024-08-06 00:16:48,900][52803] Sum rewards: 30.907, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.765', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.063', 'AMMO3': '0.210', 'weapon5': '0.244', 'WEAPON5': '0.250', 'AMMO4': '0.317', 'WEAPON4': '0.650', 'weapon2': '0.712', 'weapon4': '0.820', 'WEAPON3': '1.200', 'weapon3': '1.896', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.199', 'FRAGCOUNT': '29.000'} [2024-08-06 00:16:49,037][52658] DAMAGECOUNT value on done: 96231.0 [2024-08-06 00:16:49,038][52658] Sum rewards: 48.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.092', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.414', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.080', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:50,377][52670] DAMAGECOUNT value on done: 92392.0 [2024-08-06 00:16:50,387][52670] Sum rewards: 57.937, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.385', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.084', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.266', 'WEAPON3': '1.750', 'HITCOUNT': '3.170', 'weapon3': '3.326', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '52.000'} [2024-08-06 00:16:50,874][52664] DAMAGECOUNT value on done: 96486.0 [2024-08-06 00:16:50,875][52664] Sum rewards: 60.305, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.780', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.202', 'weapon4': '0.478', 'WEAPON4': '0.500', 'weapon2': '0.538', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '49.000'} [2024-08-06 00:16:51,012][52666] DAMAGECOUNT value on done: 90655.0 [2024-08-06 00:16:51,012][52666] Sum rewards: 54.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.581', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.384', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.086', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:51,216][52811] DAMAGECOUNT value on done: 89772.0 [2024-08-06 00:16:51,216][52811] Sum rewards: 46.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.995', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon5': '0.120', 'AMMO3': '0.177', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON4': '0.450', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.544', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '40.000'} [2024-08-06 00:16:51,606][52650] Updated weights for policy 0, policy_version 21431 (0.0012) [2024-08-06 00:16:51,768][52658] DAMAGECOUNT value on done: 97144.0 [2024-08-06 00:16:51,772][52658] Sum rewards: 52.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.636', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.048', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'AMMO4': '0.242', 'weapon2': '0.414', 'weapon4': '0.468', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.686', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:51,961][52803] DAMAGECOUNT value on done: 84159.0 [2024-08-06 00:16:51,964][52803] Sum rewards: 50.015, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.296', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.124', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:52,059][52663] DAMAGECOUNT value on done: 97289.0 [2024-08-06 00:16:52,060][52663] Sum rewards: 66.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.834', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.211', 'weapon4': '0.244', 'WEAPON4': '0.450', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 00:16:52,173][52665] DAMAGECOUNT value on done: 90427.0 [2024-08-06 00:16:52,176][52665] Sum rewards: 49.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '42.000'} [2024-08-06 00:16:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 175579136. Throughput: 0: 4386.9. Samples: 43899360. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:16:52,795][52567] Avg episode reward: [(0, '53.059')] [2024-08-06 00:16:52,803][52614] Saving new best policy, reward=53.059! [2024-08-06 00:16:53,545][52670] DAMAGECOUNT value on done: 94485.0 [2024-08-06 00:16:53,549][52670] Sum rewards: 47.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.984', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.038', 'AMMO4': '0.116', 'weapon5': '0.124', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.908', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.712', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:53,596][52664] DAMAGECOUNT value on done: 97181.0 [2024-08-06 00:16:53,597][52664] Sum rewards: 55.720, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.631', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.226', 'ARMOR': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '49.000'} [2024-08-06 00:16:54,299][52666] DAMAGECOUNT value on done: 95846.0 [2024-08-06 00:16:54,301][52666] Sum rewards: 47.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.645', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.132', 'AMMO3': '0.150', 'weapon4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.000', 'HITCOUNT': '2.500', 'weapon3': '3.158', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '39.500'} [2024-08-06 00:16:54,350][52811] DAMAGECOUNT value on done: 86042.0 [2024-08-06 00:16:54,350][52811] Sum rewards: 42.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.830', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.068', 'AMMO3': '0.095', 'weapon5': '0.124', 'WEAPON5': '0.250', 'AMMO4': '0.342', 'WEAPON3': '0.550', 'weapon2': '0.618', 'WEAPON4': '0.700', 'weapon4': '0.700', 'weapon3': '2.318', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.283', 'FRAGCOUNT': '36.000'} [2024-08-06 00:16:54,635][52658] DAMAGECOUNT value on done: 91645.0 [2024-08-06 00:16:54,637][52658] Sum rewards: 43.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.440', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.636', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '2.782', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '35.000'} [2024-08-06 00:16:55,257][52663] DAMAGECOUNT value on done: 96561.0 [2024-08-06 00:16:55,259][52663] Sum rewards: 45.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.531', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.032', 'weapon4': '0.042', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.694', 'WEAPON3': '1.550', 'weapon3': '2.846', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:55,274][52665] DAMAGECOUNT value on done: 97158.0 [2024-08-06 00:16:55,274][52665] Sum rewards: 44.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.230', 'WEAPON4': '0.500', 'weapon4': '0.540', 'weapon2': '0.584', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.546', 'DAMAGECOUNT': '10.632', 'FRAGCOUNT': '41.000'} [2024-08-06 00:16:55,957][52664] DAMAGECOUNT value on done: 98109.0 [2024-08-06 00:16:55,958][52664] Sum rewards: 46.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.732', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.161', 'AMMO3': '0.174', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.470', 'weapon3': '2.840', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '40.000'} [2024-08-06 00:16:56,167][52650] Updated weights for policy 0, policy_version 21441 (0.0022) [2024-08-06 00:16:56,231][52659] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 00:16:56,825][52670] DAMAGECOUNT value on done: 88815.0 [2024-08-06 00:16:56,827][52670] Sum rewards: 43.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.488', 'AMMO5': '0.014', 'ARMOR': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.173', 'weapon5': '0.204', 'AMMO4': '0.281', 'WEAPON5': '0.300', 'weapon4': '0.590', 'weapon2': '0.628', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.328', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '39.000'} [2024-08-06 00:16:57,304][52811] DAMAGECOUNT value on done: 88243.0 [2024-08-06 00:16:57,305][52811] Sum rewards: 37.038, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.844', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.082', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.550', 'HITCOUNT': '2.580', 'weapon3': '2.874', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '36.000'} [2024-08-06 00:16:57,437][52666] DAMAGECOUNT value on done: 93023.0 [2024-08-06 00:16:57,440][52666] Sum rewards: 47.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.046', 'AMMO2': '0.051', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.256', 'weapon4': '0.384', 'weapon2': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.790', 'DAMAGECOUNT': '11.160', 'FRAGCOUNT': '44.000'} [2024-08-06 00:16:57,721][52658] DAMAGECOUNT value on done: 93847.0 [2024-08-06 00:16:57,726][52658] Sum rewards: 42.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.496', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.137', 'WEAPON7': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.500', 'weapon4': '0.666', 'WEAPON3': '1.450', 'weapon3': '2.358', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '40.000'} [2024-08-06 00:16:57,748][52663] DAMAGECOUNT value on done: 92180.0 [2024-08-06 00:16:57,749][52663] Sum rewards: 56.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon4': '0.226', 'weapon2': '0.240', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.390', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '48.000'} [2024-08-06 00:16:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 175669248. Throughput: 0: 4384.7. Samples: 43925490. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:16:57,794][52567] Avg episode reward: [(0, '51.893')] [2024-08-06 00:16:58,206][52665] DAMAGECOUNT value on done: 91845.0 [2024-08-06 00:16:58,208][52665] Sum rewards: 51.745, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.076', 'weapon7': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.039', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.193', 'weapon5': '0.210', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '2.634', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '47.000'} [2024-08-06 00:16:58,691][52664] DAMAGECOUNT value on done: 96293.0 [2024-08-06 00:16:58,692][52664] Sum rewards: 51.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.045', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.482', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.082', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '46.000'} [2024-08-06 00:16:59,894][52670] DAMAGECOUNT value on done: 91987.0 [2024-08-06 00:16:59,894][52670] Sum rewards: 57.724, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.126', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.520', 'WEAPON3': '0.800', 'weapon3': '2.846', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:00,471][52666] DAMAGECOUNT value on done: 91711.0 [2024-08-06 00:17:00,472][52666] Sum rewards: 43.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.348', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'AMMO4': '0.215', 'WEAPON4': '0.450', 'weapon4': '0.530', 'weapon2': '0.716', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.520', 'DAMAGECOUNT': '10.842', 'FRAGCOUNT': '39.000'} [2024-08-06 00:17:00,550][52663] DAMAGECOUNT value on done: 94079.0 [2024-08-06 00:17:00,552][52663] Sum rewards: 53.128, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.790', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'AMMO4': '0.269', 'WEAPON4': '0.500', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:00,793][52650] Updated weights for policy 0, policy_version 21451 (0.0032) [2024-08-06 00:17:00,943][52658] DAMAGECOUNT value on done: 93633.0 [2024-08-06 00:17:00,945][52658] Sum rewards: 64.569, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.688', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.162', 'AMMO3': '0.210', 'weapon2': '0.296', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.246', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.000'} [2024-08-06 00:17:01,240][52665] DAMAGECOUNT value on done: 89049.0 [2024-08-06 00:17:01,241][52665] Sum rewards: 44.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.060', 'AMMO3': '0.147', 'AMMO4': '0.224', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon2': '1.064', 'weapon3': '2.448', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.976', 'FRAGCOUNT': '38.000'} [2024-08-06 00:17:01,586][52664] DAMAGECOUNT value on done: 95875.0 [2024-08-06 00:17:01,586][52664] Sum rewards: 46.882, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.033', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.348', 'weapon2': '0.458', 'WEAPON3': '2.000', 'HITCOUNT': '2.970', 'weapon3': '3.066', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 175751168. Throughput: 0: 4389.1. Samples: 43938740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:17:02,794][52567] Avg episode reward: [(0, '51.610')] [2024-08-06 00:17:03,016][52670] DAMAGECOUNT value on done: 86883.0 [2024-08-06 00:17:03,017][52670] Sum rewards: 43.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.405', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.512', 'WEAPON3': '1.450', 'HITCOUNT': '2.590', 'weapon3': '3.152', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '40.000'} [2024-08-06 00:17:03,168][52663] DAMAGECOUNT value on done: 96210.0 [2024-08-06 00:17:03,169][52663] Sum rewards: 31.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.097', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.030', 'weapon5': '0.032', 'AMMO4': '0.151', 'AMMO3': '0.164', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.662', 'WEAPON3': '1.050', 'HITCOUNT': '2.060', 'weapon3': '3.000', 'DAMAGECOUNT': '9.108', 'FRAGCOUNT': '28.500'} [2024-08-06 00:17:03,331][52671] DAMAGECOUNT value on done: 98670.0 [2024-08-06 00:17:03,334][52671] Sum rewards: 52.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.314', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:03,415][52658] DAMAGECOUNT value on done: 91591.0 [2024-08-06 00:17:03,416][52658] Sum rewards: 47.205, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.208', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.474', 'weapon4': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.632', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:03,612][52666] DAMAGECOUNT value on done: 89540.0 [2024-08-06 00:17:03,613][52666] Sum rewards: 48.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.645', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.262', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:04,318][52665] DAMAGECOUNT value on done: 91362.0 [2024-08-06 00:17:04,320][52665] Sum rewards: 59.759, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.096', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.163', 'weapon4': '0.282', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.228', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:04,397][52664] DAMAGECOUNT value on done: 101337.0 [2024-08-06 00:17:04,397][52664] Sum rewards: 54.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.448', 'AMMO5': '0.007', 'ARMOR': '0.028', 'weapon5': '0.048', 'AMMO2': '0.057', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.287', 'weapon4': '0.556', 'WEAPON4': '0.600', 'weapon2': '0.792', 'WEAPON3': '1.300', 'weapon3': '2.398', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:05,514][52663] DAMAGECOUNT value on done: 95012.0 [2024-08-06 00:17:05,522][52663] Sum rewards: 49.971, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.188', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.260', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.396', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:05,594][52650] Updated weights for policy 0, policy_version 21461 (0.0012) [2024-08-06 00:17:05,620][52670] DAMAGECOUNT value on done: 85376.0 [2024-08-06 00:17:05,622][52670] Sum rewards: 44.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.958', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon4': '0.298', 'weapon2': '0.706', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '2.744', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '38.000'} [2024-08-06 00:17:06,124][52666] DAMAGECOUNT value on done: 91128.0 [2024-08-06 00:17:06,126][52666] Sum rewards: 54.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.584', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.188', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.504', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.600', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:06,321][52671] DAMAGECOUNT value on done: 93174.0 [2024-08-06 00:17:06,321][52671] Sum rewards: 44.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.831', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.528', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '2.856', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '39.000'} [2024-08-06 00:17:06,437][52658] DAMAGECOUNT value on done: 97048.0 [2024-08-06 00:17:06,439][52658] Sum rewards: 50.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.170', 'AMMO3': '0.261', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON4': '0.450', 'weapon2': '0.660', 'WEAPON3': '1.550', 'weapon3': '2.430', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:07,295][52664] DAMAGECOUNT value on done: 98520.0 [2024-08-06 00:17:07,296][52664] Sum rewards: 57.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.846', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.726', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:07,469][52665] DAMAGECOUNT value on done: 94558.0 [2024-08-06 00:17:07,471][52665] Sum rewards: 47.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.834', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.620', 'weapon4': '0.676', 'WEAPON3': '0.750', 'weapon3': '2.362', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '39.000'} [2024-08-06 00:17:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 175841280. Throughput: 0: 4384.2. Samples: 43965000. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:17:07,794][52567] Avg episode reward: [(0, '51.055')] [2024-08-06 00:17:08,611][52663] DAMAGECOUNT value on done: 94077.0 [2024-08-06 00:17:08,612][52663] Sum rewards: 50.201, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.013', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.144', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.056', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:08,725][52670] DAMAGECOUNT value on done: 94047.0 [2024-08-06 00:17:08,726][52670] Sum rewards: 56.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.812', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.174', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.440', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.000', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:08,823][52671] DAMAGECOUNT value on done: 95984.0 [2024-08-06 00:17:08,825][52671] Sum rewards: 59.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.168', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:09,270][52658] DAMAGECOUNT value on done: 98113.0 [2024-08-06 00:17:09,270][52658] Sum rewards: 62.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.188', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.766', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:09,349][52666] DAMAGECOUNT value on done: 94503.0 [2024-08-06 00:17:09,349][52666] Sum rewards: 53.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.525', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.550', 'weapon4': '0.654', 'weapon2': '0.698', 'WEAPON3': '1.050', 'weapon3': '2.238', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:09,983][52665] DAMAGECOUNT value on done: 94848.0 [2024-08-06 00:17:09,984][52665] Sum rewards: 54.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.620', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.134', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.700', 'weapon3': '3.038', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:10,335][52664] DAMAGECOUNT value on done: 90519.0 [2024-08-06 00:17:10,336][52664] Sum rewards: 42.790, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.040', 'ARMOR': '0.057', 'HEALTH': '0.144', 'AMMO3': '0.156', 'AMMO4': '0.201', 'WEAPON4': '0.500', 'weapon4': '0.550', 'weapon2': '0.712', 'WEAPON3': '0.850', 'weapon3': '2.562', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.698', 'FRAGCOUNT': '35.000'} [2024-08-06 00:17:10,355][52650] Updated weights for policy 0, policy_version 21471 (0.0035) [2024-08-06 00:17:11,486][52663] DAMAGECOUNT value on done: 89100.0 [2024-08-06 00:17:11,494][52663] Sum rewards: 52.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO4': '0.138', 'weapon4': '0.154', 'weapon2': '0.234', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.288', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:11,677][52670] DAMAGECOUNT value on done: 95100.0 [2024-08-06 00:17:11,677][52670] Sum rewards: 52.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.914', 'AMMO5': '0.003', 'AMMO2': '0.031', 'ARMOR': '0.036', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.235', 'WEAPON4': '0.550', 'weapon2': '0.638', 'weapon4': '0.648', 'WEAPON3': '1.400', 'weapon3': '2.416', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '46.000'} [2024-08-06 00:17:11,840][52671] DAMAGECOUNT value on done: 92452.0 [2024-08-06 00:17:11,840][52671] Sum rewards: 57.053, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.164', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon4': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.271', 'weapon2': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.190', 'weapon3': '3.422', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:12,084][52658] DAMAGECOUNT value on done: 92415.0 [2024-08-06 00:17:12,088][52658] Sum rewards: 59.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.112', 'AMMO3': '0.169', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.184', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:12,171][52666] DAMAGECOUNT value on done: 91251.0 [2024-08-06 00:17:12,172][52666] Sum rewards: 58.209, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.314', 'WEAPON3': '0.900', 'HITCOUNT': '2.810', 'weapon3': '3.098', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '46.000'} [2024-08-06 00:17:12,713][52664] DAMAGECOUNT value on done: 104176.0 [2024-08-06 00:17:12,713][52664] Sum rewards: 63.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.308', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.136', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '53.000'} [2024-08-06 00:17:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 175931392. Throughput: 0: 4388.0. Samples: 43991680. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:17:12,794][52567] Avg episode reward: [(0, '51.502')] [2024-08-06 00:17:13,177][52665] DAMAGECOUNT value on done: 95109.0 [2024-08-06 00:17:13,177][52665] Sum rewards: 64.140, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.183', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.620', 'WEAPON3': '0.950', 'weapon3': '2.858', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '51.000'} [2024-08-06 00:17:14,151][52663] DAMAGECOUNT value on done: 92423.0 [2024-08-06 00:17:14,152][52663] Sum rewards: 40.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.083', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.810', 'DAMAGECOUNT': '11.268', 'FRAGCOUNT': '36.500'} [2024-08-06 00:17:14,481][52650] Updated weights for policy 0, policy_version 21481 (0.0013) [2024-08-06 00:17:14,565][52671] DAMAGECOUNT value on done: 93871.0 [2024-08-06 00:17:14,565][52671] Sum rewards: 63.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.465', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.083', 'AMMO3': '0.126', 'WEAPON4': '0.250', 'weapon4': '0.450', 'weapon2': '0.754', 'WEAPON3': '0.800', 'weapon3': '2.544', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '51.000'} [2024-08-06 00:17:14,640][52670] DAMAGECOUNT value on done: 93744.0 [2024-08-06 00:17:14,640][52670] Sum rewards: 52.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.166', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.114', 'AMMO3': '0.164', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.722', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:14,763][52658] DAMAGECOUNT value on done: 93880.0 [2024-08-06 00:17:14,767][52658] Sum rewards: 52.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.941', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon7': '0.048', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.558', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '44.500'} [2024-08-06 00:17:15,049][52666] DAMAGECOUNT value on done: 91244.0 [2024-08-06 00:17:15,049][52666] Sum rewards: 56.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.857', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.219', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:15,867][52665] DAMAGECOUNT value on done: 99318.0 [2024-08-06 00:17:15,869][52665] Sum rewards: 57.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.236', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.022', 'AMMO4': '0.038', 'weapon4': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.257', 'weapon2': '0.326', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.406', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '50.000'} [2024-08-06 00:17:15,882][52664] DAMAGECOUNT value on done: 100924.0 [2024-08-06 00:17:15,883][52664] Sum rewards: 52.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.462', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.128', 'weapon5': '0.128', 'AMMO4': '0.198', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:16,815][52663] DAMAGECOUNT value on done: 97845.0 [2024-08-06 00:17:16,824][52663] Sum rewards: 40.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.200', 'HITCOUNT': '2.410', 'weapon3': '2.840', 'DAMAGECOUNT': '10.404', 'FRAGCOUNT': '36.000'} [2024-08-06 00:17:17,392][52670] DAMAGECOUNT value on done: 92815.0 [2024-08-06 00:17:17,395][52670] Sum rewards: 48.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.193', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.251', 'weapon2': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.170', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:17,627][52671] DAMAGECOUNT value on done: 95845.0 [2024-08-06 00:17:17,629][52671] Sum rewards: 51.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'AMMO4': '0.166', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.464', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:17,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 176029696. Throughput: 0: 4393.1. Samples: 44004770. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:17:17,794][52567] Avg episode reward: [(0, '51.146')] [2024-08-06 00:17:17,820][52658] DAMAGECOUNT value on done: 96428.0 [2024-08-06 00:17:17,822][52658] Sum rewards: 48.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.151', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.716', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '2.834', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:17,958][52666] DAMAGECOUNT value on done: 90472.0 [2024-08-06 00:17:17,958][52666] Sum rewards: 66.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.340', 'weapon4': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '55.000'} [2024-08-06 00:17:17,976][52647] DAMAGECOUNT value on done: 99502.0 [2024-08-06 00:17:17,976][52647] Sum rewards: 46.007, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.524', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.138', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'AMMO4': '0.294', 'weapon4': '0.432', 'weapon2': '0.564', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:18,296][52795] DAMAGECOUNT value on done: 87062.0 [2024-08-06 00:17:18,299][52795] Sum rewards: 55.367, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.855', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.268', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '2.830', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:18,740][52664] DAMAGECOUNT value on done: 100273.0 [2024-08-06 00:17:18,741][52664] Sum rewards: 46.923, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.928', 'weapon5': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.652', 'WEAPON3': '1.650', 'weapon3': '2.702', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:18,796][52665] DAMAGECOUNT value on done: 95883.0 [2024-08-06 00:17:18,797][52665] Sum rewards: 59.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.328', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.450', 'weapon2': '0.454', 'weapon4': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.644', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:19,818][52650] Updated weights for policy 0, policy_version 21491 (0.0028) [2024-08-06 00:17:19,885][52663] DAMAGECOUNT value on done: 94733.0 [2024-08-06 00:17:19,886][52663] Sum rewards: 47.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.318', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.066', 'weapon5': '0.080', 'AMMO3': '0.132', 'AMMO4': '0.332', 'WEAPON5': '0.350', 'weapon4': '0.432', 'weapon2': '0.578', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon3': '2.660', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '42.500'} [2024-08-06 00:17:19,981][52670] DAMAGECOUNT value on done: 96826.0 [2024-08-06 00:17:19,982][52670] Sum rewards: 68.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.073', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.233', 'weapon2': '0.344', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.448', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '58.000'} [2024-08-06 00:17:20,470][52666] DAMAGECOUNT value on done: 95362.0 [2024-08-06 00:17:20,470][52666] Sum rewards: 65.071, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon2': '0.438', 'weapon4': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.926', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:20,803][52671] DAMAGECOUNT value on done: 95620.0 [2024-08-06 00:17:20,803][52671] Sum rewards: 57.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.011', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.338', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:20,874][52647] DAMAGECOUNT value on done: 98289.0 [2024-08-06 00:17:20,874][52647] Sum rewards: 50.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.059', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.198', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '2.948', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:21,466][52795] DAMAGECOUNT value on done: 82940.0 [2024-08-06 00:17:21,467][52795] Sum rewards: 52.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:21,539][52664] DAMAGECOUNT value on done: 97500.0 [2024-08-06 00:17:21,539][52664] Sum rewards: 49.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.252', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.158', 'AMMO3': '0.226', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:22,106][52665] DAMAGECOUNT value on done: 94561.0 [2024-08-06 00:17:22,107][52665] Sum rewards: 51.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'weapon2': '0.480', 'weapon4': '0.590', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.754', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:22,408][52670] DAMAGECOUNT value on done: 88534.0 [2024-08-06 00:17:22,409][52670] Sum rewards: 63.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.146', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.464', 'weapon4': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.486', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.000'} [2024-08-06 00:17:22,631][52663] DAMAGECOUNT value on done: 95288.0 [2024-08-06 00:17:22,631][52663] Sum rewards: 58.778, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon4': '0.420', 'weapon2': '0.512', 'WEAPON3': '0.850', 'weapon3': '2.864', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 176103424. Throughput: 0: 4399.6. Samples: 44031250. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:17:22,794][52567] Avg episode reward: [(0, '52.045')] [2024-08-06 00:17:22,799][52666] DAMAGECOUNT value on done: 91892.0 [2024-08-06 00:17:22,801][52666] Sum rewards: 45.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.099', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.180', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.400', 'HITCOUNT': '2.650', 'weapon3': '2.960', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:23,268][52647] DAMAGECOUNT value on done: 102886.0 [2024-08-06 00:17:23,269][52647] Sum rewards: 65.534, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.028', 'ARMOR': '0.040', 'weapon5': '0.122', 'AMMO4': '0.138', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.300', 'HEALTH': '0.450', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.856', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '53.000'} [2024-08-06 00:17:23,713][52650] Updated weights for policy 0, policy_version 21501 (0.0011) [2024-08-06 00:17:23,808][52671] DAMAGECOUNT value on done: 97342.0 [2024-08-06 00:17:23,808][52671] Sum rewards: 58.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.329', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.254', 'weapon4': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.560', 'WEAPON3': '1.500', 'weapon3': '2.676', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:24,173][52659] DAMAGECOUNT value on done: 93007.0 [2024-08-06 00:17:24,175][52659] Sum rewards: 47.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '2.934', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '42.000'} [2024-08-06 00:17:24,310][52664] DAMAGECOUNT value on done: 95202.0 [2024-08-06 00:17:24,310][52664] Sum rewards: 53.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.163', 'weapon4': '0.204', 'WEAPON4': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.902', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '46.000'} [2024-08-06 00:17:24,666][52795] DAMAGECOUNT value on done: 84393.0 [2024-08-06 00:17:24,667][52795] Sum rewards: 39.570, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.430', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.048', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.206', 'AMMO3': '0.229', 'AMMO4': '0.239', 'WEAPON4': '0.600', 'weapon2': '0.644', 'WEAPON3': '1.400', 'HITCOUNT': '2.410', 'weapon3': '2.814', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '38.000'} [2024-08-06 00:17:25,014][52665] DAMAGECOUNT value on done: 93304.0 [2024-08-06 00:17:25,014][52665] Sum rewards: 52.365, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.758', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.058', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'weapon2': '0.466', 'weapon4': '0.482', 'WEAPON3': '1.600', 'weapon3': '2.736', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:25,335][52670] DAMAGECOUNT value on done: 94910.0 [2024-08-06 00:17:25,338][52670] Sum rewards: 52.737, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.162', 'weapon4': '0.448', 'WEAPON4': '0.450', 'weapon2': '0.812', 'WEAPON3': '1.000', 'weapon3': '2.458', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '11.949', 'FRAGCOUNT': '43.500'} [2024-08-06 00:17:25,491][52663] DAMAGECOUNT value on done: 95301.0 [2024-08-06 00:17:25,491][52663] Sum rewards: 49.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.176', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.064', 'AMMO3': '0.171', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.694', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:25,663][52663] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 00:17:25,870][52666] DAMAGECOUNT value on done: 94358.0 [2024-08-06 00:17:25,871][52666] Sum rewards: 61.962, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.150', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.158', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '3.278', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:26,077][52647] DAMAGECOUNT value on done: 102112.0 [2024-08-06 00:17:26,077][52647] Sum rewards: 50.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.494', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.380', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '3.040', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:26,149][52671] DAMAGECOUNT value on done: 92754.0 [2024-08-06 00:17:26,149][52671] Sum rewards: 42.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO5': '0.010', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.180', 'AMMO4': '0.204', 'weapon5': '0.276', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.376', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.493', 'FRAGCOUNT': '37.000'} [2024-08-06 00:17:26,851][52659] DAMAGECOUNT value on done: 95675.0 [2024-08-06 00:17:26,852][52659] Sum rewards: 56.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.045', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.162', 'AMMO3': '0.170', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.834', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:27,074][52664] DAMAGECOUNT value on done: 99033.0 [2024-08-06 00:17:27,075][52664] Sum rewards: 53.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.514', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.346', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.216', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 176193536. Throughput: 0: 4398.2. Samples: 44057520. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:17:27,794][52567] Avg episode reward: [(0, '51.849')] [2024-08-06 00:17:27,815][52795] DAMAGECOUNT value on done: 86966.0 [2024-08-06 00:17:27,815][52795] Sum rewards: 49.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.038', 'AMMO4': '0.111', 'weapon4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '42.000'} [2024-08-06 00:17:27,822][52665] DAMAGECOUNT value on done: 93414.0 [2024-08-06 00:17:27,823][52665] Sum rewards: 64.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.908', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.168', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon4': '0.356', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:28,129][52670] DAMAGECOUNT value on done: 93234.0 [2024-08-06 00:17:28,130][52670] Sum rewards: 46.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.373', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.039', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.197', 'weapon2': '0.314', 'WEAPON4': '0.400', 'weapon4': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.704', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:28,370][52663] DAMAGECOUNT value on done: 97662.0 [2024-08-06 00:17:28,372][52663] Sum rewards: 45.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO5': '0.012', 'AMMO2': '0.032', 'ARMOR': '0.040', 'weapon5': '0.090', 'AMMO4': '0.160', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.794', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '39.000'} [2024-08-06 00:17:28,884][52647] DAMAGECOUNT value on done: 101877.0 [2024-08-06 00:17:28,886][52647] Sum rewards: 54.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon4': '0.286', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:28,988][52671] DAMAGECOUNT value on done: 96071.0 [2024-08-06 00:17:28,992][52671] Sum rewards: 52.996, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.282', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:29,018][52650] Updated weights for policy 0, policy_version 21511 (0.0038) [2024-08-06 00:17:29,695][52659] DAMAGECOUNT value on done: 93267.0 [2024-08-06 00:17:29,696][52659] Sum rewards: 51.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.941', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.201', 'WEAPON4': '0.450', 'weapon2': '0.538', 'weapon4': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.514', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:29,869][52664] DAMAGECOUNT value on done: 97797.0 [2024-08-06 00:17:29,869][52664] Sum rewards: 46.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.533', 'AMMO5': '0.010', 'AMMO2': '0.053', 'AMMO3': '0.194', 'weapon5': '0.226', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'WEAPON4': '0.500', 'weapon2': '0.584', 'weapon4': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.354', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '40.000'} [2024-08-06 00:17:30,815][52665] DAMAGECOUNT value on done: 92775.0 [2024-08-06 00:17:30,815][52665] Sum rewards: 42.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.880', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.068', 'weapon5': '0.096', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'AMMO4': '0.340', 'weapon4': '0.474', 'WEAPON4': '0.650', 'weapon2': '0.736', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '40.000'} [2024-08-06 00:17:30,815][52670] DAMAGECOUNT value on done: 93476.0 [2024-08-06 00:17:30,816][52670] Sum rewards: 62.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.875', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.234', 'AMMO3': '0.248', 'WEAPON3': '1.600', 'HITCOUNT': '3.330', 'weapon3': '3.562', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '55.500'} [2024-08-06 00:17:31,106][52795] DAMAGECOUNT value on done: 89231.0 [2024-08-06 00:17:31,106][52795] Sum rewards: 36.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.636', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.022', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.848', 'WEAPON3': '1.150', 'HITCOUNT': '2.270', 'weapon3': '2.894', 'DAMAGECOUNT': '9.096', 'FRAGCOUNT': '32.000'} [2024-08-06 00:17:31,584][52647] DAMAGECOUNT value on done: 101799.0 [2024-08-06 00:17:31,586][52647] Sum rewards: 47.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.056', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.207', 'weapon2': '0.622', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '2.968', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:31,588][52663] DAMAGECOUNT value on done: 92454.0 [2024-08-06 00:17:31,589][52663] Sum rewards: 54.514, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.690', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.666', 'WEAPON3': '0.850', 'HITCOUNT': '2.640', 'weapon3': '2.976', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:31,653][52671] DAMAGECOUNT value on done: 94824.0 [2024-08-06 00:17:31,653][52671] Sum rewards: 42.049, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.108', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.143', 'weapon5': '0.204', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.470', 'weapon3': '3.092', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '39.000'} [2024-08-06 00:17:32,435][52659] DAMAGECOUNT value on done: 95962.0 [2024-08-06 00:17:32,438][52659] Sum rewards: 48.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.166', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:32,741][52664] DAMAGECOUNT value on done: 94712.0 [2024-08-06 00:17:32,744][52664] Sum rewards: 41.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.364', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'weapon2': '0.480', 'weapon4': '0.720', 'WEAPON3': '1.250', 'weapon3': '2.340', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '38.000'} [2024-08-06 00:17:32,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 176291840. Throughput: 0: 4399.6. Samples: 44070740. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 00:17:32,795][52567] Avg episode reward: [(0, '51.699')] [2024-08-06 00:17:33,399][52670] DAMAGECOUNT value on done: 90292.0 [2024-08-06 00:17:33,399][52670] Sum rewards: 41.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.156', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.147', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON4': '0.400', 'weapon2': '0.838', 'WEAPON3': '1.050', 'weapon3': '2.568', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.154', 'FRAGCOUNT': '37.000'} [2024-08-06 00:17:33,535][52650] Updated weights for policy 0, policy_version 21521 (0.0013) [2024-08-06 00:17:33,609][52665] DAMAGECOUNT value on done: 92657.0 [2024-08-06 00:17:33,610][52665] Sum rewards: 55.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.342', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon5': '0.138', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.894', 'WEAPON3': '1.050', 'weapon3': '2.302', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '46.000'} [2024-08-06 00:17:34,193][52647] DAMAGECOUNT value on done: 99761.0 [2024-08-06 00:17:34,194][52647] Sum rewards: 60.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.075', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.188', 'AMMO3': '0.225', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '51.000'} [2024-08-06 00:17:34,207][52795] DAMAGECOUNT value on done: 87565.0 [2024-08-06 00:17:34,209][52795] Sum rewards: 42.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.056', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'AMMO4': '0.279', 'weapon4': '0.538', 'weapon2': '0.590', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.564', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '38.000'} [2024-08-06 00:17:34,960][52671] DAMAGECOUNT value on done: 94522.0 [2024-08-06 00:17:34,960][52671] Sum rewards: 51.357, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.737', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:35,281][52664] DAMAGECOUNT value on done: 98958.0 [2024-08-06 00:17:35,282][52664] Sum rewards: 57.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.187', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon2': '0.240', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.436', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '50.000'} [2024-08-06 00:17:35,479][52659] DAMAGECOUNT value on done: 95544.0 [2024-08-06 00:17:35,479][52659] Sum rewards: 58.973, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.898', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.146', 'AMMO4': '0.202', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.388', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '53.000'} [2024-08-06 00:17:36,815][52665] DAMAGECOUNT value on done: 91497.0 [2024-08-06 00:17:36,815][52665] Sum rewards: 43.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.758', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.040', 'weapon5': '0.138', 'AMMO4': '0.151', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.476', 'weapon2': '0.552', 'WEAPON3': '1.350', 'HITCOUNT': '2.470', 'weapon3': '2.568', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '39.000'} [2024-08-06 00:17:37,216][52647] DAMAGECOUNT value on done: 102328.0 [2024-08-06 00:17:37,216][52647] Sum rewards: 67.995, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.154', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.157', 'weapon5': '0.204', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '55.000'} [2024-08-06 00:17:37,363][52795] DAMAGECOUNT value on done: 90639.0 [2024-08-06 00:17:37,364][52795] Sum rewards: 41.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.058', 'AMMO3': '0.203', 'weapon4': '0.230', 'AMMO4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.824', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '38.000'} [2024-08-06 00:17:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 176373760. Throughput: 0: 4391.6. Samples: 44096980. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 00:17:37,794][52567] Avg episode reward: [(0, '52.250')] [2024-08-06 00:17:37,922][52650] Updated weights for policy 0, policy_version 21531 (0.0011) [2024-08-06 00:17:38,041][52671] DAMAGECOUNT value on done: 98879.0 [2024-08-06 00:17:38,042][52671] Sum rewards: 54.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.395', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO3': '0.150', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.000', 'weapon3': '2.766', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.500'} [2024-08-06 00:17:38,270][52664] DAMAGECOUNT value on done: 98340.0 [2024-08-06 00:17:38,271][52664] Sum rewards: 47.346, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.761', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.044', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.243', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.486', 'WEAPON3': '1.450', 'weapon3': '2.804', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '43.000'} [2024-08-06 00:17:38,659][52659] DAMAGECOUNT value on done: 97487.0 [2024-08-06 00:17:38,660][52659] Sum rewards: 45.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.842', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.065', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.428', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.130', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:39,547][52663] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:17:39,666][52665] DAMAGECOUNT value on done: 91432.0 [2024-08-06 00:17:39,666][52665] Sum rewards: 44.475, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.164', 'ARMOR': '0.008', 'AMMO2': '0.066', 'AMMO3': '0.234', 'AMMO4': '0.329', 'weapon2': '0.530', 'WEAPON4': '0.600', 'weapon4': '0.808', 'WEAPON3': '1.450', 'weapon3': '2.448', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:39,960][52647] DAMAGECOUNT value on done: 102756.0 [2024-08-06 00:17:39,960][52647] Sum rewards: 58.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:40,432][52795] DAMAGECOUNT value on done: 88959.0 [2024-08-06 00:17:40,433][52795] Sum rewards: 57.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.042', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.264', 'weapon2': '0.412', 'WEAPON3': '1.600', 'weapon3': '3.226', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '49.500'} [2024-08-06 00:17:41,000][52671] DAMAGECOUNT value on done: 95327.0 [2024-08-06 00:17:41,002][52671] Sum rewards: 38.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.354', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.030', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.702', 'WEAPON3': '1.250', 'weapon3': '2.794', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '35.000'} [2024-08-06 00:17:41,197][52664] DAMAGECOUNT value on done: 95794.0 [2024-08-06 00:17:41,199][52664] Sum rewards: 42.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.736', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.204', 'weapon4': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.706', 'WEAPON3': '1.200', 'HITCOUNT': '2.390', 'weapon3': '2.800', 'DAMAGECOUNT': '10.545', 'FRAGCOUNT': '37.000'} [2024-08-06 00:17:41,441][52659] DAMAGECOUNT value on done: 96331.0 [2024-08-06 00:17:41,441][52659] Sum rewards: 55.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.628', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.020', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.330', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '48.000'} [2024-08-06 00:17:41,854][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:17:42,326][52665] DAMAGECOUNT value on done: 86606.0 [2024-08-06 00:17:42,327][52665] Sum rewards: 41.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.292', 'AMMO5': '0.010', 'weapon5': '0.056', 'AMMO2': '0.061', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.304', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.844', 'WEAPON3': '0.900', 'HITCOUNT': '2.390', 'weapon3': '2.504', 'DAMAGECOUNT': '10.326', 'FRAGCOUNT': '34.000'} [2024-08-06 00:17:42,423][52650] Updated weights for policy 0, policy_version 21541 (0.0040) [2024-08-06 00:17:42,655][52647] DAMAGECOUNT value on done: 97084.0 [2024-08-06 00:17:42,656][52647] Sum rewards: 39.919, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.618', 'HEALTH': '0.630', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.874', 'DAMAGECOUNT': '11.238', 'FRAGCOUNT': '35.000'} [2024-08-06 00:17:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 176463872. Throughput: 0: 4401.8. Samples: 44123570. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 00:17:42,795][52567] Avg episode reward: [(0, '52.168')] [2024-08-06 00:17:43,473][52795] DAMAGECOUNT value on done: 85431.0 [2024-08-06 00:17:43,473][52795] Sum rewards: 59.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.904', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.156', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.384', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '51.000'} [2024-08-06 00:17:43,584][52664] DAMAGECOUNT value on done: 96754.0 [2024-08-06 00:17:43,586][52664] Sum rewards: 54.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.511', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.146', 'weapon5': '0.154', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '0.900', 'weapon3': '2.880', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:43,653][52671] DAMAGECOUNT value on done: 90631.0 [2024-08-06 00:17:43,653][52671] Sum rewards: 48.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon2': '0.248', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '3.518', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:44,236][52659] DAMAGECOUNT value on done: 91913.0 [2024-08-06 00:17:44,237][52659] Sum rewards: 60.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.179', 'weapon2': '0.638', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.200', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '51.000'} [2024-08-06 00:17:45,208][52647] DAMAGECOUNT value on done: 97363.0 [2024-08-06 00:17:45,209][52647] Sum rewards: 48.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.193', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.762', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '42.000'} [2024-08-06 00:17:45,507][52665] DAMAGECOUNT value on done: 90308.0 [2024-08-06 00:17:45,508][52665] Sum rewards: 58.421, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.495', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.187', 'weapon4': '0.248', 'AMMO3': '0.275', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.700', 'weapon3': '2.964', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '54.000'} [2024-08-06 00:17:46,348][52671] DAMAGECOUNT value on done: 95690.0 [2024-08-06 00:17:46,349][52671] Sum rewards: 51.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'weapon5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'AMMO4': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.454', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '42.000'} [2024-08-06 00:17:46,700][52795] DAMAGECOUNT value on done: 89484.0 [2024-08-06 00:17:46,700][52795] Sum rewards: 58.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO2': '-0.000', 'AMMO4': '0.000', 'AMMO3': '0.182', 'weapon2': '0.364', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.468', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '49.000'} [2024-08-06 00:17:46,925][52659] DAMAGECOUNT value on done: 94059.0 [2024-08-06 00:17:46,927][52659] Sum rewards: 49.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.854', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.204', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.622', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '42.000'} [2024-08-06 00:17:47,626][52650] Updated weights for policy 0, policy_version 21551 (0.0013) [2024-08-06 00:17:47,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 176545792. Throughput: 0: 4400.4. Samples: 44136760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:17:47,803][52567] Avg episode reward: [(0, '52.411')] [2024-08-06 00:17:48,105][52647] DAMAGECOUNT value on done: 97357.0 [2024-08-06 00:17:48,105][52647] Sum rewards: 56.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon4': '0.208', 'weapon2': '0.240', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.390', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '47.000'} [2024-08-06 00:17:48,381][52665] DAMAGECOUNT value on done: 91603.0 [2024-08-06 00:17:48,404][52665] Sum rewards: 65.041, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.528', 'WEAPON3': '0.950', 'weapon3': '3.050', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:49,602][52671] DAMAGECOUNT value on done: 94511.0 [2024-08-06 00:17:49,603][52671] Sum rewards: 46.387, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.400', 'weapon2': '0.728', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '2.856', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:49,953][52795] DAMAGECOUNT value on done: 89767.0 [2024-08-06 00:17:49,954][52795] Sum rewards: 36.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.056', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.278', 'weapon4': '0.536', 'weapon2': '0.604', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.464', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.629', 'FRAGCOUNT': '33.000'} [2024-08-06 00:17:50,146][52659] DAMAGECOUNT value on done: 97104.0 [2024-08-06 00:17:50,146][52659] Sum rewards: 50.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.915', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.166', 'AMMO3': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '2.890', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '45.000'} [2024-08-06 00:17:50,532][52647] DAMAGECOUNT value on done: 97531.0 [2024-08-06 00:17:50,534][52647] Sum rewards: 52.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.959', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.211', 'weapon4': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.698', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:52,233][52650] Updated weights for policy 0, policy_version 21561 (0.0033) [2024-08-06 00:17:52,304][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:17:52,532][52671] DAMAGECOUNT value on done: 95364.0 [2024-08-06 00:17:52,532][52671] Sum rewards: 51.163, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.681', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.128', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.278', 'weapon2': '0.502', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '2.864', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '41.000'} [2024-08-06 00:17:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 176635904. Throughput: 0: 4404.2. Samples: 44163190. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:17:52,802][52567] Avg episode reward: [(0, '52.196')] [2024-08-06 00:17:52,975][52647] DAMAGECOUNT value on done: 97525.0 [2024-08-06 00:17:52,975][52647] Sum rewards: 40.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.064', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.642', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '3.012', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '36.000'} [2024-08-06 00:17:53,141][52659] DAMAGECOUNT value on done: 94888.0 [2024-08-06 00:17:53,141][52659] Sum rewards: 51.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '46.000'} [2024-08-06 00:17:53,160][52795] DAMAGECOUNT value on done: 85907.0 [2024-08-06 00:17:53,160][52795] Sum rewards: 57.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.146', 'AMMO4': '0.188', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.386', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.808', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:55,427][52671] DAMAGECOUNT value on done: 94361.0 [2024-08-06 00:17:55,429][52671] Sum rewards: 49.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.763', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO3': '0.180', 'AMMO4': '0.197', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.780', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '42.500'} [2024-08-06 00:17:55,744][52647] DAMAGECOUNT value on done: 99548.0 [2024-08-06 00:17:55,745][52647] Sum rewards: 51.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.097', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.348', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:56,062][52659] DAMAGECOUNT value on done: 91998.0 [2024-08-06 00:17:56,062][52659] Sum rewards: 51.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.596', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.175', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '1.004', 'WEAPON3': '1.150', 'weapon3': '2.242', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '44.000'} [2024-08-06 00:17:56,366][52795] DAMAGECOUNT value on done: 88295.0 [2024-08-06 00:17:56,367][52795] Sum rewards: 50.595, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.428', 'weapon4': '0.578', 'HEALTH': '0.850', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '42.000'} [2024-08-06 00:17:56,799][52650] Updated weights for policy 0, policy_version 21571 (0.0032) [2024-08-06 00:17:57,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 176726016. Throughput: 0: 4399.8. Samples: 44189670. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:17:57,802][52567] Avg episode reward: [(0, '51.648')] [2024-08-06 00:17:57,842][52671] DAMAGECOUNT value on done: 93885.0 [2024-08-06 00:17:57,843][52671] Sum rewards: 55.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.230', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '50.000'} [2024-08-06 00:17:58,592][52659] DAMAGECOUNT value on done: 91489.0 [2024-08-06 00:17:58,592][52659] Sum rewards: 54.030, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon4': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '3.082', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '50.000'} [2024-08-06 00:17:58,812][52647] DAMAGECOUNT value on done: 100716.0 [2024-08-06 00:17:58,812][52647] Sum rewards: 61.530, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.356', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '52.000'} [2024-08-06 00:17:59,434][52795] DAMAGECOUNT value on done: 87390.0 [2024-08-06 00:17:59,438][52795] Sum rewards: 41.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.760', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.060', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'AMMO3': '0.245', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.510', 'weapon3': '3.218', 'DAMAGECOUNT': '11.016', 'FRAGCOUNT': '39.000'} [2024-08-06 00:18:01,131][52650] Updated weights for policy 0, policy_version 21581 (0.0028) [2024-08-06 00:18:01,449][52647] DAMAGECOUNT value on done: 96746.0 [2024-08-06 00:18:01,449][52647] Sum rewards: 65.014, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.618', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon4': '0.242', 'weapon2': '0.676', 'WEAPON3': '1.150', 'weapon3': '2.640', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '53.000'} [2024-08-06 00:18:01,509][52659] DAMAGECOUNT value on done: 96404.0 [2024-08-06 00:18:01,511][52659] Sum rewards: 48.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.118', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.736', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:02,615][52795] DAMAGECOUNT value on done: 85774.0 [2024-08-06 00:18:02,616][52795] Sum rewards: 48.653, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.255', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO4': '0.202', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.800', 'HITCOUNT': '3.140', 'weapon3': '3.182', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '45.000'} [2024-08-06 00:18:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 176816128. Throughput: 0: 4406.9. Samples: 44203080. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:18:02,794][52567] Avg episode reward: [(0, '51.635')] [2024-08-06 00:18:04,519][52647] DAMAGECOUNT value on done: 99251.0 [2024-08-06 00:18:04,519][52647] Sum rewards: 39.369, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.764', 'AMMO5': '0.003', 'ARMOR': '0.040', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.234', 'AMMO3': '0.246', 'weapon4': '0.530', 'WEAPON4': '0.650', 'weapon2': '0.684', 'WEAPON3': '1.500', 'weapon3': '2.472', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '37.000'} [2024-08-06 00:18:04,565][52659] DAMAGECOUNT value on done: 95666.0 [2024-08-06 00:18:04,568][52659] Sum rewards: 52.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.424', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '3.236', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '44.000'} [2024-08-06 00:18:05,768][52795] DAMAGECOUNT value on done: 89015.0 [2024-08-06 00:18:05,769][52795] Sum rewards: 53.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'AMMO4': '0.212', 'weapon4': '0.304', 'weapon2': '0.378', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.130', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '48.000'} [2024-08-06 00:18:06,255][52650] Updated weights for policy 0, policy_version 21591 (0.0020) [2024-08-06 00:18:07,027][52659] DAMAGECOUNT value on done: 101160.0 [2024-08-06 00:18:07,030][52659] Sum rewards: 58.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.250', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.186', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '49.000'} [2024-08-06 00:18:07,554][52647] DAMAGECOUNT value on done: 96632.0 [2024-08-06 00:18:07,555][52647] Sum rewards: 39.889, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.042', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON3': '0.850', 'weapon2': '1.006', 'HITCOUNT': '2.350', 'weapon3': '2.854', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '32.000'} [2024-08-06 00:18:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 176906240. Throughput: 0: 4407.8. Samples: 44229600. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:18:07,794][52567] Avg episode reward: [(0, '51.715')] [2024-08-06 00:18:08,999][52795] DAMAGECOUNT value on done: 91360.0 [2024-08-06 00:18:09,000][52795] Sum rewards: 55.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.694', 'WEAPON3': '1.350', 'weapon3': '2.556', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '49.000'} [2024-08-06 00:18:09,312][52659] DAMAGECOUNT value on done: 94596.0 [2024-08-06 00:18:09,312][52659] Sum rewards: 53.144, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.133', 'weapon5': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.758', 'WEAPON3': '0.900', 'weapon3': '2.762', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:10,027][52647] DAMAGECOUNT value on done: 100100.0 [2024-08-06 00:18:10,027][52647] Sum rewards: 48.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.838', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon4': '0.094', 'weapon5': '0.106', 'AMMO4': '0.131', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.112', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '43.000'} [2024-08-06 00:18:10,494][52650] Updated weights for policy 0, policy_version 21601 (0.0012) [2024-08-06 00:18:12,035][52659] DAMAGECOUNT value on done: 94562.0 [2024-08-06 00:18:12,036][52659] Sum rewards: 53.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.336', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '47.000'} [2024-08-06 00:18:12,174][52795] DAMAGECOUNT value on done: 84932.0 [2024-08-06 00:18:12,174][52795] Sum rewards: 49.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.916', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon4': '0.240', 'weapon2': '0.336', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.208', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '43.000'} [2024-08-06 00:18:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 176988160. Throughput: 0: 4408.0. Samples: 44255880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:18:12,795][52567] Avg episode reward: [(0, '51.553')] [2024-08-06 00:18:15,356][52650] Updated weights for policy 0, policy_version 21611 (0.0030) [2024-08-06 00:18:15,398][52795] DAMAGECOUNT value on done: 89567.0 [2024-08-06 00:18:15,398][52795] Sum rewards: 51.814, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.345', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.120', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.344', 'weapon4': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '46.500'} [2024-08-06 00:18:15,453][52659] DAMAGECOUNT value on done: 98577.0 [2024-08-06 00:18:15,453][52659] Sum rewards: 55.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.543', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'AMMO3': '0.204', 'weapon2': '0.384', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '48.000'} [2024-08-06 00:18:17,248][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:18:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 177078272. Throughput: 0: 4401.1. Samples: 44268790. Policy #0 lag: (min: 1.0, avg: 4.1, max: 7.0) [2024-08-06 00:18:17,802][52567] Avg episode reward: [(0, '51.294')] [2024-08-06 00:18:18,298][52659] DAMAGECOUNT value on done: 96770.0 [2024-08-06 00:18:18,300][52659] Sum rewards: 45.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.130', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.326', 'weapon2': '0.704', 'WEAPON3': '0.950', 'HITCOUNT': '2.560', 'weapon3': '2.612', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '40.000'} [2024-08-06 00:18:18,667][52795] DAMAGECOUNT value on done: 92371.0 [2024-08-06 00:18:18,668][52795] Sum rewards: 45.007, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon5': '0.092', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.277', 'weapon2': '0.520', 'WEAPON3': '1.600', 'HITCOUNT': '2.650', 'weapon3': '3.076', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:18,907][52662] DAMAGECOUNT value on done: 99506.0 [2024-08-06 00:18:18,907][52662] Sum rewards: 60.574, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.529', 'AMMO2': '0.036', 'AMMO3': '0.169', 'AMMO4': '0.178', 'weapon4': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.772', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '49.000'} [2024-08-06 00:18:19,006][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:18:19,982][52650] Updated weights for policy 0, policy_version 21621 (0.0011) [2024-08-06 00:18:21,585][52662] DAMAGECOUNT value on done: 103209.0 [2024-08-06 00:18:21,587][52662] Sum rewards: 39.091, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.826', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.242', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.012', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '37.000'} [2024-08-06 00:18:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 177168384. Throughput: 0: 4410.9. Samples: 44295470. Policy #0 lag: (min: 1.0, avg: 4.1, max: 7.0) [2024-08-06 00:18:22,794][52567] Avg episode reward: [(0, '51.099')] [2024-08-06 00:18:23,118][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:18:24,405][52662] DAMAGECOUNT value on done: 105237.0 [2024-08-06 00:18:24,405][52662] Sum rewards: 47.562, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.034', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '43.000'} [2024-08-06 00:18:24,545][52650] Updated weights for policy 0, policy_version 21631 (0.0016) [2024-08-06 00:18:27,231][52662] DAMAGECOUNT value on done: 93886.0 [2024-08-06 00:18:27,233][52662] Sum rewards: 40.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.207', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.802', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.436', 'FRAGCOUNT': '33.500'} [2024-08-06 00:18:27,311][52794] DAMAGECOUNT value on done: 104063.0 [2024-08-06 00:18:27,315][52794] Sum rewards: 52.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.549', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.240', 'weapon2': '0.336', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.132', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '47.000'} [2024-08-06 00:18:27,404][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:18:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 177258496. Throughput: 0: 4403.8. Samples: 44321740. Policy #0 lag: (min: 1.0, avg: 4.1, max: 7.0) [2024-08-06 00:18:27,794][52567] Avg episode reward: [(0, '50.765')] [2024-08-06 00:18:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021638_177258496.pth... [2024-08-06 00:18:27,916][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021123_173039616.pth [2024-08-06 00:18:29,477][52650] Updated weights for policy 0, policy_version 21641 (0.0014) [2024-08-06 00:18:29,496][52668] DAMAGECOUNT value on done: 94404.0 [2024-08-06 00:18:29,496][52668] Sum rewards: 55.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.792', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.135', 'AMMO4': '0.182', 'weapon5': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.570', 'weapon4': '0.608', 'WEAPON3': '0.900', 'weapon3': '2.276', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '47.000'} [2024-08-06 00:18:30,352][52662] DAMAGECOUNT value on done: 99497.0 [2024-08-06 00:18:30,352][52662] Sum rewards: 52.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '46.000'} [2024-08-06 00:18:30,453][52794] DAMAGECOUNT value on done: 100700.0 [2024-08-06 00:18:30,457][52794] Sum rewards: 47.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.834', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.492', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.604', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '11.595', 'FRAGCOUNT': '40.000'} [2024-08-06 00:18:32,137][52668] DAMAGECOUNT value on done: 100356.0 [2024-08-06 00:18:32,137][52668] Sum rewards: 53.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.637', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.208', 'weapon2': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.386', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '46.000'} [2024-08-06 00:18:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 177340416. Throughput: 0: 4392.0. Samples: 44334400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:18:32,794][52567] Avg episode reward: [(0, '50.701')] [2024-08-06 00:18:32,992][52662] DAMAGECOUNT value on done: 101887.0 [2024-08-06 00:18:32,994][52662] Sum rewards: 49.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.192', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.166', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:33,114][52794] DAMAGECOUNT value on done: 97739.0 [2024-08-06 00:18:33,123][52794] Sum rewards: 46.140, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.149', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.658', 'WEAPON3': '0.750', 'weapon3': '2.656', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '36.000'} [2024-08-06 00:18:34,048][52650] Updated weights for policy 0, policy_version 21651 (0.0019) [2024-08-06 00:18:35,037][52668] DAMAGECOUNT value on done: 94535.0 [2024-08-06 00:18:35,038][52668] Sum rewards: 55.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.568', 'AMMO5': '0.007', 'AMMO2': '0.032', 'ARMOR': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.139', 'AMMO4': '0.160', 'WEAPON4': '0.350', 'weapon2': '0.458', 'weapon4': '0.660', 'WEAPON3': '0.850', 'weapon3': '2.460', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '45.000'} [2024-08-06 00:18:35,803][52662] DAMAGECOUNT value on done: 102509.0 [2024-08-06 00:18:35,806][52662] Sum rewards: 48.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.137', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.720', 'weapon3': '3.032', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:35,928][52820] DAMAGECOUNT value on done: 87018.0 [2024-08-06 00:18:35,929][52820] Sum rewards: 45.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.980', 'DAMAGECOUNT': '12.267', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:36,002][52794] DAMAGECOUNT value on done: 96501.0 [2024-08-06 00:18:36,002][52794] Sum rewards: 47.197, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.198', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.204', 'AMMO4': '0.210', 'AMMO3': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '2.962', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '44.500'} [2024-08-06 00:18:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 177430528. Throughput: 0: 4398.4. Samples: 44361120. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:18:37,794][52567] Avg episode reward: [(0, '50.521')] [2024-08-06 00:18:38,033][52668] DAMAGECOUNT value on done: 96130.0 [2024-08-06 00:18:38,036][52668] Sum rewards: 60.731, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'AMMO5': '0.003', 'AMMO2': '0.017', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.086', 'AMMO3': '0.193', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '53.000'} [2024-08-06 00:18:38,496][52662] DAMAGECOUNT value on done: 105500.0 [2024-08-06 00:18:38,504][52662] Sum rewards: 42.060, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.072', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.492', 'WEAPON3': '1.650', 'weapon3': '2.798', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:38,730][52650] Updated weights for policy 0, policy_version 21661 (0.0013) [2024-08-06 00:18:38,744][52794] DAMAGECOUNT value on done: 98836.0 [2024-08-06 00:18:38,745][52794] Sum rewards: 59.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.230', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.490', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.316', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '50.000'} [2024-08-06 00:18:38,976][52820] DAMAGECOUNT value on done: 90048.0 [2024-08-06 00:18:38,977][52820] Sum rewards: 53.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.265', 'AMMO2': '0.040', 'AMMO3': '0.183', 'AMMO4': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.524', 'weapon4': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '48.000'} [2024-08-06 00:18:41,272][52668] DAMAGECOUNT value on done: 97625.0 [2024-08-06 00:18:41,274][52668] Sum rewards: 61.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.852', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.290', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '52.000'} [2024-08-06 00:18:41,675][52662] DAMAGECOUNT value on done: 99484.0 [2024-08-06 00:18:41,676][52662] Sum rewards: 72.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'ARMOR': '0.013', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.146', 'AMMO3': '0.169', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 00:18:41,838][52794] DAMAGECOUNT value on done: 101425.0 [2024-08-06 00:18:41,843][52794] Sum rewards: 60.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.956', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.100', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.336', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '52.000'} [2024-08-06 00:18:41,982][52660] DAMAGECOUNT value on done: 93366.0 [2024-08-06 00:18:41,983][52660] Sum rewards: 48.020, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.640', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.182', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.250', 'HITCOUNT': '2.470', 'weapon3': '3.210', 'DAMAGECOUNT': '11.118', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:42,217][52820] DAMAGECOUNT value on done: 86462.0 [2024-08-06 00:18:42,217][52820] Sum rewards: 54.290, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.506', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.258', 'weapon2': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.264', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '49.000'} [2024-08-06 00:18:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 177520640. Throughput: 0: 4394.2. Samples: 44387410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:18:42,794][52567] Avg episode reward: [(0, '51.037')] [2024-08-06 00:18:43,618][52650] Updated weights for policy 0, policy_version 21671 (0.0023) [2024-08-06 00:18:44,410][52668] DAMAGECOUNT value on done: 95431.0 [2024-08-06 00:18:44,410][52668] Sum rewards: 55.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO2': '0.031', 'AMMO4': '0.152', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.132', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '48.000'} [2024-08-06 00:18:44,423][52614] Signal inference workers to stop experience collection... (4050 times) [2024-08-06 00:18:44,423][52614] Signal inference workers to resume experience collection... (4050 times) [2024-08-06 00:18:44,465][52650] InferenceWorker_p0-w0: stopping experience collection (4050 times) [2024-08-06 00:18:44,465][52650] InferenceWorker_p0-w0: resuming experience collection (4050 times) [2024-08-06 00:18:44,794][52662] DAMAGECOUNT value on done: 102803.0 [2024-08-06 00:18:44,798][52662] Sum rewards: 54.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.132', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'weapon4': '0.174', 'AMMO3': '0.176', 'WEAPON4': '0.400', 'weapon2': '0.738', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '46.000'} [2024-08-06 00:18:44,993][52794] DAMAGECOUNT value on done: 104411.0 [2024-08-06 00:18:44,993][52794] Sum rewards: 56.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon5': '0.106', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '46.000'} [2024-08-06 00:18:45,273][52660] DAMAGECOUNT value on done: 95934.0 [2024-08-06 00:18:45,273][52660] Sum rewards: 46.040, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.899', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.404', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '40.000'} [2024-08-06 00:18:45,387][52820] DAMAGECOUNT value on done: 83961.0 [2024-08-06 00:18:45,387][52820] Sum rewards: 49.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon4': '0.270', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '44.000'} [2024-08-06 00:18:46,795][52649] DAMAGECOUNT value on done: 94524.0 [2024-08-06 00:18:46,797][52649] Sum rewards: 57.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.227', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.042', 'weapon4': '0.044', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.418', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '49.000'} [2024-08-06 00:18:47,446][52668] DAMAGECOUNT value on done: 98011.0 [2024-08-06 00:18:47,448][52668] Sum rewards: 56.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.064', 'weapon4': '0.144', 'AMMO3': '0.173', 'AMMO4': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '2.946', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '51.000'} [2024-08-06 00:18:47,487][52662] DAMAGECOUNT value on done: 99857.0 [2024-08-06 00:18:47,488][52662] Sum rewards: 53.180, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.750', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.140', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.442', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '2.958', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '45.000'} [2024-08-06 00:18:47,670][52794] DAMAGECOUNT value on done: 100613.0 [2024-08-06 00:18:47,672][52794] Sum rewards: 61.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.738', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.154', 'AMMO3': '0.214', 'AMMO4': '0.252', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '52.000'} [2024-08-06 00:18:47,783][52650] Updated weights for policy 0, policy_version 21681 (0.0026) [2024-08-06 00:18:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.5, 300 sec: 17605.9). Total num frames: 177610752. Throughput: 0: 4387.8. Samples: 44400530. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:18:47,794][52567] Avg episode reward: [(0, '51.569')] [2024-08-06 00:18:48,219][52660] DAMAGECOUNT value on done: 96285.0 [2024-08-06 00:18:48,220][52660] Sum rewards: 43.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.382', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.148', 'AMMO3': '0.162', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.700', 'WEAPON3': '1.050', 'HITCOUNT': '2.440', 'weapon3': '2.632', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '37.500'} [2024-08-06 00:18:48,369][52820] DAMAGECOUNT value on done: 87995.0 [2024-08-06 00:18:48,371][52820] Sum rewards: 51.782, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.893', 'AMMO5': '0.009', 'AMMO2': '0.034', 'AMMO3': '0.130', 'AMMO4': '0.169', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.786', 'WEAPON3': '0.800', 'weapon3': '2.522', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '42.000'} [2024-08-06 00:18:48,749][52669] DAMAGECOUNT value on done: 100146.0 [2024-08-06 00:18:48,749][52669] Sum rewards: 52.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.838', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.193', 'weapon4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.780', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '46.000'} [2024-08-06 00:18:49,910][52649] DAMAGECOUNT value on done: 92034.0 [2024-08-06 00:18:49,911][52649] Sum rewards: 41.777, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.282', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.896', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '2.778', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '36.500'} [2024-08-06 00:18:50,143][52662] DAMAGECOUNT value on done: 103644.0 [2024-08-06 00:18:50,145][52662] Sum rewards: 49.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.298', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon4': '0.174', 'AMMO3': '0.188', 'weapon2': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.280', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:50,404][52794] DAMAGECOUNT value on done: 100909.0 [2024-08-06 00:18:50,405][52794] Sum rewards: 59.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.135', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.060', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.222', 'weapon2': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.098', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '52.000'} [2024-08-06 00:18:50,454][52668] DAMAGECOUNT value on done: 98682.0 [2024-08-06 00:18:50,456][52668] Sum rewards: 52.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.625', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'weapon5': '0.056', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.490', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.226', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '45.000'} [2024-08-06 00:18:51,264][52660] DAMAGECOUNT value on done: 96891.0 [2024-08-06 00:18:51,269][52660] Sum rewards: 50.886, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.182', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.208', 'weapon4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.974', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '45.000'} [2024-08-06 00:18:51,277][52669] DAMAGECOUNT value on done: 96609.0 [2024-08-06 00:18:51,278][52669] Sum rewards: 52.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.266', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.114', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '44.000'} [2024-08-06 00:18:51,298][52820] DAMAGECOUNT value on done: 89345.0 [2024-08-06 00:18:51,299][52820] Sum rewards: 54.860, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.545', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '46.000'} [2024-08-06 00:18:52,778][52650] Updated weights for policy 0, policy_version 21691 (0.0018) [2024-08-06 00:18:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 177692672. Throughput: 0: 4388.0. Samples: 44427060. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:18:52,794][52567] Avg episode reward: [(0, '51.653')] [2024-08-06 00:18:52,937][52649] DAMAGECOUNT value on done: 95648.0 [2024-08-06 00:18:52,937][52649] Sum rewards: 51.471, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.116', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '2.520', 'weapon3': '3.164', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:53,264][52668] DAMAGECOUNT value on done: 97053.0 [2024-08-06 00:18:53,266][52668] Sum rewards: 55.750, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.030', 'HEALTH': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.112', 'AMMO4': '0.123', 'WEAPON3': '0.750', 'weapon2': '0.994', 'weapon3': '2.722', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '43.000'} [2024-08-06 00:18:53,396][52662] DAMAGECOUNT value on done: 100197.0 [2024-08-06 00:18:53,396][52662] Sum rewards: 49.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.955', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.152', 'AMMO3': '0.172', 'weapon4': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.904', 'WEAPON3': '1.150', 'weapon3': '2.546', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '43.000'} [2024-08-06 00:18:53,581][52794] DAMAGECOUNT value on done: 104444.0 [2024-08-06 00:18:53,581][52794] Sum rewards: 56.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '48.000'} [2024-08-06 00:18:54,061][52660] DAMAGECOUNT value on done: 93229.0 [2024-08-06 00:18:54,062][52660] Sum rewards: 53.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.282', 'weapon2': '0.372', 'WEAPON3': '1.800', 'weapon3': '3.138', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '49.000'} [2024-08-06 00:18:54,120][52669] DAMAGECOUNT value on done: 95123.0 [2024-08-06 00:18:54,121][52669] Sum rewards: 37.695, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.651', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon7': '0.074', 'AMMO3': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.166', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'WEAPON3': '0.600', 'weapon2': '0.660', 'weapon4': '1.082', 'weapon3': '1.658', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '9.318', 'FRAGCOUNT': '32.000'} [2024-08-06 00:18:54,392][52820] DAMAGECOUNT value on done: 89542.0 [2024-08-06 00:18:54,392][52820] Sum rewards: 53.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.223', 'weapon2': '0.542', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '47.000'} [2024-08-06 00:18:55,627][52649] DAMAGECOUNT value on done: 97146.0 [2024-08-06 00:18:55,628][52649] Sum rewards: 59.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.177', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.818', 'WEAPON3': '1.050', 'weapon3': '2.496', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '49.000'} [2024-08-06 00:18:56,277][52667] DAMAGECOUNT value on done: 97657.0 [2024-08-06 00:18:56,278][52667] Sum rewards: 63.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.321', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon4': '0.280', 'WEAPON3': '1.000', 'HITCOUNT': '3.320', 'weapon3': '3.336', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '51.000'} [2024-08-06 00:18:56,424][52662] DAMAGECOUNT value on done: 99012.0 [2024-08-06 00:18:56,424][52662] Sum rewards: 50.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.501', 'AMMO5': '0.017', 'ARMOR': '0.032', 'AMMO2': '0.061', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.305', 'weapon4': '0.598', 'weapon2': '0.658', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.368', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.288', 'FRAGCOUNT': '44.000'} [2024-08-06 00:18:56,481][52668] DAMAGECOUNT value on done: 98999.0 [2024-08-06 00:18:56,481][52668] Sum rewards: 50.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.622', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.732', 'WEAPON3': '1.350', 'weapon3': '2.708', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '43.000'} [2024-08-06 00:18:56,515][52794] DAMAGECOUNT value on done: 99200.0 [2024-08-06 00:18:56,515][52794] Sum rewards: 46.701, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.170', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.846', 'WEAPON3': '1.050', 'weapon3': '2.464', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.961', 'FRAGCOUNT': '40.000'} [2024-08-06 00:18:57,162][52650] Updated weights for policy 0, policy_version 21701 (0.0012) [2024-08-06 00:18:57,295][52660] DAMAGECOUNT value on done: 94642.0 [2024-08-06 00:18:57,296][52660] Sum rewards: 45.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'AMMO4': '0.222', 'weapon2': '0.330', 'WEAPON4': '0.500', 'weapon4': '0.920', 'WEAPON3': '1.300', 'weapon3': '2.444', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '10.623', 'FRAGCOUNT': '41.000'} [2024-08-06 00:18:57,420][52669] DAMAGECOUNT value on done: 96057.0 [2024-08-06 00:18:57,420][52669] Sum rewards: 59.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.058', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '51.000'} [2024-08-06 00:18:57,566][52820] DAMAGECOUNT value on done: 89867.0 [2024-08-06 00:18:57,568][52820] Sum rewards: 63.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '54.000'} [2024-08-06 00:18:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 177782784. Throughput: 0: 4395.1. Samples: 44453660. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:18:57,794][52567] Avg episode reward: [(0, '52.150')] [2024-08-06 00:18:57,892][52649] DAMAGECOUNT value on done: 90349.0 [2024-08-06 00:18:57,893][52649] Sum rewards: 46.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.558', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.288', 'weapon5': '0.322', 'WEAPON4': '0.450', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.602', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '40.000'} [2024-08-06 00:18:58,978][52667] DAMAGECOUNT value on done: 99011.0 [2024-08-06 00:18:58,979][52667] Sum rewards: 55.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.191', 'weapon2': '0.718', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.964', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '48.000'} [2024-08-06 00:18:58,995][52662] DAMAGECOUNT value on done: 98323.0 [2024-08-06 00:18:58,996][52662] Sum rewards: 56.530, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '46.000'} [2024-08-06 00:18:59,135][52794] DAMAGECOUNT value on done: 102351.0 [2024-08-06 00:18:59,136][52794] Sum rewards: 48.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.166', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.198', 'weapon4': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.936', 'WEAPON3': '1.200', 'weapon3': '2.632', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '42.000'} [2024-08-06 00:18:59,510][52668] DAMAGECOUNT value on done: 94809.0 [2024-08-06 00:18:59,511][52668] Sum rewards: 56.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.866', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.143', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:00,258][52660] DAMAGECOUNT value on done: 96850.0 [2024-08-06 00:19:00,259][52660] Sum rewards: 47.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.212', 'WEAPON4': '0.450', 'weapon2': '0.512', 'weapon4': '0.516', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:00,399][52669] DAMAGECOUNT value on done: 97624.0 [2024-08-06 00:19:00,400][52669] Sum rewards: 54.379, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.011', 'HEALTH': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.064', 'AMMO3': '0.184', 'weapon2': '0.640', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.054', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:00,652][52820] DAMAGECOUNT value on done: 87365.0 [2024-08-06 00:19:00,658][52820] Sum rewards: 54.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.221', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:00,975][52649] DAMAGECOUNT value on done: 92361.0 [2024-08-06 00:19:00,975][52649] Sum rewards: 68.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.735', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon4': '0.214', 'weapon2': '0.722', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '58.000'} [2024-08-06 00:19:01,564][52667] DAMAGECOUNT value on done: 98230.0 [2024-08-06 00:19:01,566][52667] Sum rewards: 49.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.312', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.261', 'weapon2': '0.842', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:01,871][52650] Updated weights for policy 0, policy_version 21711 (0.0012) [2024-08-06 00:19:02,007][52668] DAMAGECOUNT value on done: 94885.0 [2024-08-06 00:19:02,008][52668] Sum rewards: 45.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.688', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.202', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.782', 'WEAPON3': '1.250', 'weapon3': '2.708', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:02,068][52662] DAMAGECOUNT value on done: 105398.0 [2024-08-06 00:19:02,068][52662] Sum rewards: 54.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.710', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.082', 'AMMO4': '0.183', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.400', 'weapon4': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.774', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:02,295][52794] DAMAGECOUNT value on done: 100289.0 [2024-08-06 00:19:02,297][52794] Sum rewards: 46.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.738', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:02,751][52660] DAMAGECOUNT value on done: 96263.0 [2024-08-06 00:19:02,752][52660] Sum rewards: 48.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.204', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.192', 'AMMO3': '0.217', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.372', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 177872896. Throughput: 0: 4395.8. Samples: 44466600. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:19:02,794][52567] Avg episode reward: [(0, '52.161')] [2024-08-06 00:19:03,311][52670] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:19:03,392][52669] DAMAGECOUNT value on done: 97132.0 [2024-08-06 00:19:03,395][52669] Sum rewards: 50.714, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.109', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.013', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.360', 'weapon4': '0.388', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '2.942', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:03,682][52649] DAMAGECOUNT value on done: 89699.0 [2024-08-06 00:19:03,683][52649] Sum rewards: 51.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.055', 'AMMO5': '0.005', 'AMMO2': '0.040', 'AMMO3': '0.175', 'AMMO4': '0.200', 'weapon4': '0.364', 'WEAPON4': '0.400', 'weapon2': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '43.000'} [2024-08-06 00:19:03,815][52820] DAMAGECOUNT value on done: 89091.0 [2024-08-06 00:19:03,817][52820] Sum rewards: 54.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.114', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.408', 'weapon4': '0.574', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:04,292][52667] DAMAGECOUNT value on done: 94291.0 [2024-08-06 00:19:04,293][52667] Sum rewards: 54.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.909', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'weapon4': '0.268', 'weapon5': '0.282', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '0.950', 'weapon3': '2.666', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '45.500'} [2024-08-06 00:19:04,794][52668] DAMAGECOUNT value on done: 90053.0 [2024-08-06 00:19:04,794][52668] Sum rewards: 44.267, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.966', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon4': '0.462', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '2.766', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '42.500'} [2024-08-06 00:19:04,860][52662] DAMAGECOUNT value on done: 96819.0 [2024-08-06 00:19:04,860][52662] Sum rewards: 58.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.148', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.356', 'weapon2': '0.840', 'WEAPON3': '0.900', 'weapon3': '2.362', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:05,149][52794] DAMAGECOUNT value on done: 107444.0 [2024-08-06 00:19:05,149][52794] Sum rewards: 63.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'AMMO4': '0.230', 'WEAPON4': '0.550', 'weapon2': '0.586', 'weapon4': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.512', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '55.000'} [2024-08-06 00:19:05,426][52660] DAMAGECOUNT value on done: 97492.0 [2024-08-06 00:19:05,428][52660] Sum rewards: 56.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.094', 'AMMO3': '0.217', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:06,320][52669] DAMAGECOUNT value on done: 97648.0 [2024-08-06 00:19:06,328][52669] Sum rewards: 50.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.892', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon5': '0.196', 'weapon2': '0.268', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '3.046', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '43.000'} [2024-08-06 00:19:06,491][52650] Updated weights for policy 0, policy_version 21721 (0.0014) [2024-08-06 00:19:06,601][52649] DAMAGECOUNT value on done: 97446.0 [2024-08-06 00:19:06,601][52649] Sum rewards: 53.213, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.635', 'AMMO5': '0.018', 'ARMOR': '0.020', 'weapon5': '0.034', 'AMMO2': '0.056', 'AMMO3': '0.173', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.614', 'WEAPON4': '0.700', 'weapon4': '0.784', 'WEAPON3': '1.150', 'weapon3': '2.310', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:06,977][52820] DAMAGECOUNT value on done: 91921.0 [2024-08-06 00:19:06,979][52820] Sum rewards: 57.870, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.012', 'AMMO2': '0.023', 'HEALTH': '0.029', 'AMMO4': '0.113', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:07,276][52667] DAMAGECOUNT value on done: 98960.0 [2024-08-06 00:19:07,280][52667] Sum rewards: 46.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.522', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.024', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.976', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '41.000'} [2024-08-06 00:19:07,277][52668] DAMAGECOUNT value on done: 96827.0 [2024-08-06 00:19:07,282][52668] Sum rewards: 43.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon4': '0.014', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.202', 'weapon2': '0.722', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.096', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 177954816. Throughput: 0: 4390.9. Samples: 44493060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:19:07,794][52567] Avg episode reward: [(0, '52.205')] [2024-08-06 00:19:08,154][52662] DAMAGECOUNT value on done: 103301.0 [2024-08-06 00:19:08,154][52662] Sum rewards: 48.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.141', 'AMMO4': '0.161', 'weapon5': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '0.832', 'weapon2': '0.850', 'WEAPON3': '0.900', 'weapon3': '1.806', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.291', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:08,234][52660] DAMAGECOUNT value on done: 95950.0 [2024-08-06 00:19:08,234][52660] Sum rewards: 58.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.988', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon4': '0.266', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:08,238][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:19:08,311][52794] DAMAGECOUNT value on done: 96417.0 [2024-08-06 00:19:08,311][52794] Sum rewards: 46.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.150', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:09,014][52669] DAMAGECOUNT value on done: 97406.0 [2024-08-06 00:19:09,014][52669] Sum rewards: 57.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.242', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:09,548][52649] DAMAGECOUNT value on done: 92401.0 [2024-08-06 00:19:09,549][52649] Sum rewards: 57.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.245', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.098', 'AMMO3': '0.152', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.188', 'weapon3': '2.330', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:10,066][52820] DAMAGECOUNT value on done: 89885.0 [2024-08-06 00:19:10,067][52820] Sum rewards: 67.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.178', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '57.000'} [2024-08-06 00:19:10,310][52668] DAMAGECOUNT value on done: 97220.0 [2024-08-06 00:19:10,310][52668] Sum rewards: 55.129, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.635', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon4': '0.362', 'weapon2': '0.524', 'WEAPON3': '1.650', 'weapon3': '2.700', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '50.500'} [2024-08-06 00:19:10,359][52667] DAMAGECOUNT value on done: 96280.0 [2024-08-06 00:19:10,361][52667] Sum rewards: 53.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.796', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.028', 'weapon5': '0.056', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.028', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:11,195][52660] DAMAGECOUNT value on done: 97049.0 [2024-08-06 00:19:11,195][52660] Sum rewards: 58.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon4': '0.164', 'weapon5': '0.166', 'AMMO3': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '2.894', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '51.000'} [2024-08-06 00:19:11,211][52650] Updated weights for policy 0, policy_version 21731 (0.0010) [2024-08-06 00:19:11,264][52662] DAMAGECOUNT value on done: 100612.0 [2024-08-06 00:19:11,268][52662] Sum rewards: 42.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.218', 'weapon2': '0.692', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '2.814', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '36.000'} [2024-08-06 00:19:11,457][52794] DAMAGECOUNT value on done: 103196.0 [2024-08-06 00:19:11,457][52794] Sum rewards: 48.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.096', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.171', 'WEAPON4': '0.350', 'weapon2': '0.482', 'weapon4': '0.556', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '41.000'} [2024-08-06 00:19:11,600][52669] DAMAGECOUNT value on done: 97459.0 [2024-08-06 00:19:11,602][52669] Sum rewards: 57.967, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.648', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon5': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.494', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.250', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:11,723][52669] Large shaping reward 2.506 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:19:12,463][52649] DAMAGECOUNT value on done: 94410.0 [2024-08-06 00:19:12,464][52649] Sum rewards: 51.850, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.374', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.104', 'weapon4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.358', 'WEAPON3': '1.700', 'HITCOUNT': '2.920', 'weapon3': '3.220', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 178044928. Throughput: 0: 4399.6. Samples: 44519720. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:19:12,794][52567] Avg episode reward: [(0, '52.650')] [2024-08-06 00:19:13,135][52668] DAMAGECOUNT value on done: 98312.0 [2024-08-06 00:19:13,137][52668] Sum rewards: 43.671, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.238', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.252', 'WEAPON4': '0.500', 'weapon4': '0.554', 'weapon2': '0.754', 'WEAPON3': '1.400', 'weapon3': '2.396', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:13,247][52820] DAMAGECOUNT value on done: 86843.0 [2024-08-06 00:19:13,248][52820] Sum rewards: 49.962, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.607', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO4': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.398', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '3.080', 'DAMAGECOUNT': '12.258', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:13,319][52667] DAMAGECOUNT value on done: 98028.0 [2024-08-06 00:19:13,320][52667] Sum rewards: 49.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.707', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.220', 'weapon2': '0.302', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '2.828', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:13,450][52803] DAMAGECOUNT value on done: 95215.0 [2024-08-06 00:19:13,451][52803] Sum rewards: 51.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.305', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.110', 'AMMO3': '0.175', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON4': '0.500', 'weapon4': '0.694', 'WEAPON3': '1.200', 'weapon3': '2.416', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:13,888][52660] DAMAGECOUNT value on done: 93471.0 [2024-08-06 00:19:13,889][52660] Sum rewards: 46.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.210', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.723', 'FRAGCOUNT': '41.000'} [2024-08-06 00:19:14,268][52669] DAMAGECOUNT value on done: 94389.0 [2024-08-06 00:19:14,270][52669] Sum rewards: 40.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.848', 'AMMO5': '0.007', 'ARMOR': '0.032', 'weapon5': '0.036', 'AMMO2': '0.065', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.325', 'WEAPON4': '0.450', 'weapon2': '0.488', 'weapon4': '0.540', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '2.744', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '37.000'} [2024-08-06 00:19:14,343][52662] DAMAGECOUNT value on done: 99471.0 [2024-08-06 00:19:14,346][52662] Sum rewards: 50.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.011', 'AMMO2': '0.023', 'ARMOR': '0.028', 'weapon5': '0.104', 'AMMO4': '0.117', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '3.124', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:14,467][52794] DAMAGECOUNT value on done: 102445.0 [2024-08-06 00:19:14,467][52794] Sum rewards: 46.431, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.425', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.128', 'AMMO4': '0.178', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '2.790', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '43.000'} [2024-08-06 00:19:15,611][52649] DAMAGECOUNT value on done: 93452.0 [2024-08-06 00:19:15,611][52649] Sum rewards: 64.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.710', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '56.000'} [2024-08-06 00:19:15,845][52650] Updated weights for policy 0, policy_version 21741 (0.0012) [2024-08-06 00:19:16,015][52668] DAMAGECOUNT value on done: 94481.0 [2024-08-06 00:19:16,016][52668] Sum rewards: 50.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.032', 'weapon5': '0.058', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.728', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '2.964', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:16,281][52820] DAMAGECOUNT value on done: 89659.0 [2024-08-06 00:19:16,281][52820] Sum rewards: 50.778, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.137', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.125', 'weapon4': '0.188', 'weapon2': '0.214', 'AMMO3': '0.289', 'WEAPON3': '1.700', 'HITCOUNT': '2.970', 'weapon3': '3.384', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:16,418][52667] DAMAGECOUNT value on done: 99576.0 [2024-08-06 00:19:16,419][52667] Sum rewards: 60.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.581', 'AMMO5': '0.007', 'weapon5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.049', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.245', 'weapon4': '0.336', 'WEAPON4': '0.500', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '51.000'} [2024-08-06 00:19:16,495][52803] DAMAGECOUNT value on done: 94518.0 [2024-08-06 00:19:16,503][52803] Sum rewards: 54.646, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.129', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.346', 'weapon2': '0.636', 'WEAPON3': '0.900', 'weapon3': '2.754', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '43.000'} [2024-08-06 00:19:16,841][52660] DAMAGECOUNT value on done: 95131.0 [2024-08-06 00:19:16,842][52660] Sum rewards: 41.852, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.235', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.168', 'AMMO3': '0.236', 'AMMO4': '0.281', 'WEAPON5': '0.350', 'weapon2': '0.510', 'weapon4': '0.542', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.468', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:17,187][52669] DAMAGECOUNT value on done: 100428.0 [2024-08-06 00:19:17,187][52669] Sum rewards: 46.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.824', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.166', 'WEAPON4': '0.400', 'weapon2': '0.492', 'weapon4': '0.524', 'WEAPON3': '0.950', 'HITCOUNT': '2.520', 'weapon3': '2.650', 'DAMAGECOUNT': '10.647', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:17,333][52794] DAMAGECOUNT value on done: 100642.0 [2024-08-06 00:19:17,334][52794] Sum rewards: 44.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.862', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon4': '0.484', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.620', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 178135040. Throughput: 0: 4413.3. Samples: 44533000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:19:17,794][52567] Avg episode reward: [(0, '52.740')] [2024-08-06 00:19:18,678][52649] DAMAGECOUNT value on done: 93047.0 [2024-08-06 00:19:18,679][52649] Sum rewards: 44.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.038', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.065', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.314', 'weapon2': '0.518', 'WEAPON3': '1.000', 'HITCOUNT': '2.440', 'weapon3': '2.874', 'DAMAGECOUNT': '9.792', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:18,714][52668] DAMAGECOUNT value on done: 95766.0 [2024-08-06 00:19:18,715][52668] Sum rewards: 45.621, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.146', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.130', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'AMMO4': '0.270', 'weapon2': '0.392', 'weapon4': '0.524', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.674', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:19,312][52667] DAMAGECOUNT value on done: 97969.0 [2024-08-06 00:19:19,313][52667] Sum rewards: 48.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.228', 'weapon2': '0.294', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.178', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:19,442][52820] DAMAGECOUNT value on done: 92289.0 [2024-08-06 00:19:19,442][52820] Sum rewards: 51.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.135', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.478', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '2.982', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:19,450][52660] DAMAGECOUNT value on done: 97204.0 [2024-08-06 00:19:19,454][52660] Sum rewards: 52.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.197', 'weapon2': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.028', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:19,651][52803] DAMAGECOUNT value on done: 92579.0 [2024-08-06 00:19:19,652][52803] Sum rewards: 53.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.471', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.035', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon5': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:20,169][52669] DAMAGECOUNT value on done: 99540.0 [2024-08-06 00:19:20,170][52669] Sum rewards: 48.524, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.301', 'weapon2': '0.440', 'WEAPON3': '1.750', 'HITCOUNT': '2.940', 'weapon3': '3.152', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:20,299][52794] DAMAGECOUNT value on done: 106485.0 [2024-08-06 00:19:20,300][52794] Sum rewards: 54.006, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.685', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon5': '0.054', 'WEAPON4': '0.150', 'weapon4': '0.270', 'AMMO3': '0.281', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.080', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:20,405][52650] Updated weights for policy 0, policy_version 21751 (0.0011) [2024-08-06 00:19:20,982][52811] DAMAGECOUNT value on done: 95713.0 [2024-08-06 00:19:20,983][52811] Sum rewards: 59.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.413', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:21,818][52649] DAMAGECOUNT value on done: 98159.0 [2024-08-06 00:19:21,818][52649] Sum rewards: 50.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.606', 'WEAPON3': '1.400', 'weapon3': '2.758', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:21,894][52668] DAMAGECOUNT value on done: 98949.0 [2024-08-06 00:19:21,895][52668] Sum rewards: 46.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.082', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.049', 'weapon5': '0.062', 'AMMO3': '0.157', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.466', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.540', 'weapon3': '2.940', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '41.000'} [2024-08-06 00:19:22,044][52667] DAMAGECOUNT value on done: 99981.0 [2024-08-06 00:19:22,044][52667] Sum rewards: 61.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.956', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.344', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '52.000'} [2024-08-06 00:19:22,374][52820] DAMAGECOUNT value on done: 89935.0 [2024-08-06 00:19:22,375][52820] Sum rewards: 58.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.270', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2024-08-06 00:19:22,642][52660] DAMAGECOUNT value on done: 102604.0 [2024-08-06 00:19:22,643][52660] Sum rewards: 57.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.208', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon2': '0.378', 'weapon4': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.600', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 178225152. Throughput: 0: 4407.8. Samples: 44559470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:19:22,795][52567] Avg episode reward: [(0, '52.340')] [2024-08-06 00:19:22,816][52803] DAMAGECOUNT value on done: 90627.0 [2024-08-06 00:19:22,817][52803] Sum rewards: 64.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.326', 'weapon4': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '54.000'} [2024-08-06 00:19:22,951][52669] DAMAGECOUNT value on done: 96590.0 [2024-08-06 00:19:22,952][52669] Sum rewards: 56.906, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.950', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.135', 'WEAPON3': '0.950', 'weapon2': '1.110', 'weapon3': '2.680', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:23,047][52794] DAMAGECOUNT value on done: 101607.0 [2024-08-06 00:19:23,047][52794] Sum rewards: 56.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO2': '0.015', 'weapon7': '0.058', 'AMMO4': '0.077', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.434', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:24,146][52811] DAMAGECOUNT value on done: 88286.0 [2024-08-06 00:19:24,147][52811] Sum rewards: 55.404, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.008', 'AMMO4': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.448', 'weapon2': '0.492', 'WEAPON3': '1.000', 'weapon3': '2.848', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '44.500'} [2024-08-06 00:19:24,478][52667] DAMAGECOUNT value on done: 97901.0 [2024-08-06 00:19:24,478][52667] Sum rewards: 43.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.108', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.183', 'AMMO4': '0.194', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.412', 'weapon4': '0.596', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.468', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:24,881][52668] DAMAGECOUNT value on done: 98933.0 [2024-08-06 00:19:24,882][52668] Sum rewards: 45.789, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.015', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon4': '0.206', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.924', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:24,904][52649] DAMAGECOUNT value on done: 96363.0 [2024-08-06 00:19:24,905][52649] Sum rewards: 37.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.175', 'weapon5': '0.182', 'AMMO4': '0.318', 'weapon4': '0.322', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '2.782', 'DAMAGECOUNT': '11.667', 'FRAGCOUNT': '33.000'} [2024-08-06 00:19:25,302][52650] Updated weights for policy 0, policy_version 21761 (0.0012) [2024-08-06 00:19:25,443][52820] DAMAGECOUNT value on done: 91556.0 [2024-08-06 00:19:25,446][52820] Sum rewards: 67.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.605', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.193', 'AMMO4': '0.197', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.748', 'WEAPON3': '1.150', 'weapon3': '2.552', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2024-08-06 00:19:25,456][52669] DAMAGECOUNT value on done: 98685.0 [2024-08-06 00:19:25,457][52669] Sum rewards: 53.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.013', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'weapon4': '0.198', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.138', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:25,581][52660] DAMAGECOUNT value on done: 96778.0 [2024-08-06 00:19:25,581][52660] Sum rewards: 61.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.012', 'weapon5': '0.018', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.264', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '50.000'} [2024-08-06 00:19:26,016][52803] DAMAGECOUNT value on done: 92775.0 [2024-08-06 00:19:26,017][52803] Sum rewards: 39.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.900', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.062', 'AMMO3': '0.225', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.374', 'weapon2': '0.636', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.672', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '36.000'} [2024-08-06 00:19:27,154][52667] DAMAGECOUNT value on done: 97131.0 [2024-08-06 00:19:27,154][52667] Sum rewards: 45.186, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.062', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.058', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.291', 'weapon2': '0.448', 'WEAPON4': '0.450', 'weapon4': '0.694', 'WEAPON3': '1.200', 'weapon3': '2.472', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.390', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:27,309][52811] DAMAGECOUNT value on done: 90851.0 [2024-08-06 00:19:27,309][52811] Sum rewards: 66.587, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.397', 'AMMO2': '0.021', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.140', 'weapon2': '0.376', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.416', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '55.000'} [2024-08-06 00:19:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 178307072. Throughput: 0: 4408.7. Samples: 44585800. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:19:27,794][52567] Avg episode reward: [(0, '52.441')] [2024-08-06 00:19:27,912][52649] DAMAGECOUNT value on done: 89693.0 [2024-08-06 00:19:27,913][52649] Sum rewards: 59.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.196', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '51.000'} [2024-08-06 00:19:28,144][52669] DAMAGECOUNT value on done: 102629.0 [2024-08-06 00:19:28,146][52669] Sum rewards: 55.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.138', 'AMMO4': '0.230', 'weapon5': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.700', 'weapon2': '0.700', 'weapon4': '0.738', 'WEAPON3': '0.750', 'weapon3': '2.044', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:28,583][52820] DAMAGECOUNT value on done: 93548.0 [2024-08-06 00:19:28,584][52820] Sum rewards: 41.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.172', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.500', 'HITCOUNT': '2.750', 'weapon3': '3.096', 'DAMAGECOUNT': '11.910', 'FRAGCOUNT': '37.000'} [2024-08-06 00:19:28,867][52660] DAMAGECOUNT value on done: 98015.0 [2024-08-06 00:19:28,869][52660] Sum rewards: 44.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.186', 'AMMO4': '0.227', 'weapon5': '0.262', 'weapon4': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.180', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:29,080][52803] DAMAGECOUNT value on done: 91472.0 [2024-08-06 00:19:29,080][52803] Sum rewards: 56.140, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.296', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:29,879][52650] Updated weights for policy 0, policy_version 21771 (0.0027) [2024-08-06 00:19:29,978][52667] DAMAGECOUNT value on done: 98158.0 [2024-08-06 00:19:29,978][52667] Sum rewards: 54.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon4': '0.286', 'weapon2': '0.492', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '2.944', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:30,434][52649] DAMAGECOUNT value on done: 98081.0 [2024-08-06 00:19:30,435][52649] Sum rewards: 49.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.238', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'weapon4': '0.440', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:30,562][52658] DAMAGECOUNT value on done: 99835.0 [2024-08-06 00:19:30,563][52658] Sum rewards: 43.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.124', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.048', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.376', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:30,580][52811] DAMAGECOUNT value on done: 90963.0 [2024-08-06 00:19:30,581][52811] Sum rewards: 51.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.114', 'weapon4': '0.130', 'AMMO4': '0.138', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.004', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:31,228][52669] DAMAGECOUNT value on done: 104400.0 [2024-08-06 00:19:31,228][52669] Sum rewards: 54.666, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.432', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.160', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.470', 'ARMOR': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '2.926', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:31,734][52820] DAMAGECOUNT value on done: 92823.0 [2024-08-06 00:19:31,734][52820] Sum rewards: 46.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.816', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:31,798][52660] DAMAGECOUNT value on done: 94715.0 [2024-08-06 00:19:31,800][52660] Sum rewards: 53.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.216', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.178', 'AMMO3': '0.216', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:32,206][52803] DAMAGECOUNT value on done: 94714.0 [2024-08-06 00:19:32,208][52803] Sum rewards: 53.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.976', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.090', 'AMMO3': '0.208', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.148', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 178397184. Throughput: 0: 4409.8. Samples: 44598970. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:19:32,794][52567] Avg episode reward: [(0, '52.246')] [2024-08-06 00:19:32,892][52667] DAMAGECOUNT value on done: 96172.0 [2024-08-06 00:19:32,894][52667] Sum rewards: 53.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon2': '0.202', 'AMMO3': '0.235', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.634', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:33,462][52658] DAMAGECOUNT value on done: 97533.0 [2024-08-06 00:19:33,462][52658] Sum rewards: 48.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.175', 'weapon5': '0.214', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.754', 'WEAPON3': '1.100', 'weapon3': '2.508', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '41.000'} [2024-08-06 00:19:33,469][52811] DAMAGECOUNT value on done: 90590.0 [2024-08-06 00:19:33,470][52811] Sum rewards: 44.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.782', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.107', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:33,729][52649] DAMAGECOUNT value on done: 92328.0 [2024-08-06 00:19:33,731][52649] Sum rewards: 50.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.242', 'weapon4': '0.314', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '2.972', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:34,238][52669] DAMAGECOUNT value on done: 98848.0 [2024-08-06 00:19:34,239][52669] Sum rewards: 53.756, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'ARMOR': '0.014', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO4': '0.130', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.344', 'weapon4': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.792', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:34,280][52650] Updated weights for policy 0, policy_version 21781 (0.0036) [2024-08-06 00:19:34,494][52660] DAMAGECOUNT value on done: 99935.0 [2024-08-06 00:19:34,495][52660] Sum rewards: 63.866, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.158', 'AMMO3': '0.168', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '54.000'} [2024-08-06 00:19:34,781][52820] DAMAGECOUNT value on done: 90530.0 [2024-08-06 00:19:34,781][52820] Sum rewards: 41.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.028', 'weapon5': '0.060', 'AMMO4': '0.077', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.664', 'WEAPON3': '1.300', 'HITCOUNT': '2.480', 'weapon3': '2.944', 'DAMAGECOUNT': '11.049', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:35,666][52803] DAMAGECOUNT value on done: 91549.0 [2024-08-06 00:19:35,667][52803] Sum rewards: 44.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.584', 'AMMO5': '0.007', 'ARMOR': '0.016', 'weapon5': '0.032', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.217', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.954', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:35,793][52667] DAMAGECOUNT value on done: 99459.0 [2024-08-06 00:19:35,795][52667] Sum rewards: 65.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.031', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.194', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.280', 'weapon4': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '54.000'} [2024-08-06 00:19:36,385][52658] DAMAGECOUNT value on done: 98194.0 [2024-08-06 00:19:36,387][52658] Sum rewards: 53.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.192', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:36,609][52811] DAMAGECOUNT value on done: 93705.0 [2024-08-06 00:19:36,609][52811] Sum rewards: 57.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.064', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.248', 'weapon2': '0.446', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.156', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:36,771][52649] DAMAGECOUNT value on done: 96780.0 [2024-08-06 00:19:36,771][52649] Sum rewards: 45.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.888', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.782', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.880', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:36,947][52660] DAMAGECOUNT value on done: 96153.0 [2024-08-06 00:19:36,949][52660] Sum rewards: 58.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.192', 'weapon4': '0.294', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '50.000'} [2024-08-06 00:19:37,216][52669] DAMAGECOUNT value on done: 96779.0 [2024-08-06 00:19:37,216][52669] Sum rewards: 39.897, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.702', 'AMMO5': '0.003', 'weapon5': '0.046', 'ARMOR': '0.048', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'AMMO4': '0.247', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'weapon4': '0.536', 'weapon2': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.594', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '37.000'} [2024-08-06 00:19:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 178487296. Throughput: 0: 4402.7. Samples: 44625180. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:19:37,794][52567] Avg episode reward: [(0, '51.893')] [2024-08-06 00:19:38,154][52667] DAMAGECOUNT value on done: 104971.0 [2024-08-06 00:19:38,155][52667] Sum rewards: 57.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '50.000'} [2024-08-06 00:19:38,539][52666] DAMAGECOUNT value on done: 97378.0 [2024-08-06 00:19:38,540][52666] Sum rewards: 50.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.964', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.160', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON4': '0.550', 'weapon4': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.350', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '43.000'} [2024-08-06 00:19:38,602][52658] DAMAGECOUNT value on done: 100473.0 [2024-08-06 00:19:38,603][52658] Sum rewards: 54.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '46.500'} [2024-08-06 00:19:38,691][52803] DAMAGECOUNT value on done: 91222.0 [2024-08-06 00:19:38,691][52803] Sum rewards: 52.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.316', 'weapon2': '0.460', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '2.974', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:39,281][52650] Updated weights for policy 0, policy_version 21791 (0.0014) [2024-08-06 00:19:39,835][52811] DAMAGECOUNT value on done: 90488.0 [2024-08-06 00:19:39,838][52811] Sum rewards: 48.568, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.434', 'AMMO5': '0.014', 'AMMO2': '0.027', 'ARMOR': '0.028', 'AMMO4': '0.133', 'AMMO3': '0.166', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.420', 'weapon5': '0.518', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.572', 'DAMAGECOUNT': '11.424', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:39,917][52649] DAMAGECOUNT value on done: 96077.0 [2024-08-06 00:19:39,920][52649] Sum rewards: 52.326, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.012', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.222', 'weapon4': '0.334', 'weapon2': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:39,958][52669] DAMAGECOUNT value on done: 98564.0 [2024-08-06 00:19:39,959][52669] Sum rewards: 45.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.125', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.880', 'WEAPON3': '1.200', 'weapon3': '2.420', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '38.500'} [2024-08-06 00:19:40,758][52667] DAMAGECOUNT value on done: 100498.0 [2024-08-06 00:19:40,767][52667] Sum rewards: 62.271, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.535', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.078', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.224', 'weapon4': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '52.500'} [2024-08-06 00:19:41,247][52658] DAMAGECOUNT value on done: 101407.0 [2024-08-06 00:19:41,248][52658] Sum rewards: 57.428, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.639', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.190', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:41,491][52666] DAMAGECOUNT value on done: 98081.0 [2024-08-06 00:19:41,491][52666] Sum rewards: 62.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.995', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.217', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '54.000'} [2024-08-06 00:19:41,925][52803] DAMAGECOUNT value on done: 86540.0 [2024-08-06 00:19:41,926][52803] Sum rewards: 43.374, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.895', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.028', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'weapon4': '0.576', 'weapon2': '0.638', 'WEAPON3': '0.950', 'HITCOUNT': '2.540', 'weapon3': '2.636', 'DAMAGECOUNT': '10.740', 'FRAGCOUNT': '35.000'} [2024-08-06 00:19:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 178577408. Throughput: 0: 4394.2. Samples: 44651400. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:19:42,794][52567] Avg episode reward: [(0, '52.065')] [2024-08-06 00:19:42,875][52649] DAMAGECOUNT value on done: 100755.0 [2024-08-06 00:19:42,881][52649] Sum rewards: 53.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.214', 'weapon2': '0.830', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:43,033][52811] DAMAGECOUNT value on done: 91009.0 [2024-08-06 00:19:43,036][52811] Sum rewards: 54.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.168', 'AMMO5': '0.012', 'ARMOR': '0.036', 'AMMO2': '0.044', 'weapon5': '0.148', 'AMMO4': '0.221', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.380', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.704', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '47.500'} [2024-08-06 00:19:43,390][52669] DAMAGECOUNT value on done: 98594.0 [2024-08-06 00:19:43,392][52669] Sum rewards: 56.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.025', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.108', 'AMMO4': '0.128', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.506', 'weapon2': '0.714', 'WEAPON3': '1.400', 'weapon3': '2.366', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '50.000'} [2024-08-06 00:19:43,425][52667] DAMAGECOUNT value on done: 104023.0 [2024-08-06 00:19:43,425][52667] Sum rewards: 47.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.839', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.147', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.360', 'weapon4': '0.628', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.732', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '41.000'} [2024-08-06 00:19:43,876][52650] Updated weights for policy 0, policy_version 21801 (0.0011) [2024-08-06 00:19:43,981][52658] DAMAGECOUNT value on done: 95856.0 [2024-08-06 00:19:43,982][52658] Sum rewards: 39.678, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.690', 'AMMO5': '0.008', 'AMMO2': '0.056', 'weapon5': '0.152', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'AMMO4': '0.279', 'weapon2': '0.418', 'weapon4': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.712', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:44,276][52666] DAMAGECOUNT value on done: 99860.0 [2024-08-06 00:19:44,278][52666] Sum rewards: 61.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.465', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.083', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '50.000'} [2024-08-06 00:19:44,943][52803] DAMAGECOUNT value on done: 93503.0 [2024-08-06 00:19:44,945][52803] Sum rewards: 44.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.468', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '3.026', 'DAMAGECOUNT': '11.085', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:46,280][52811] DAMAGECOUNT value on done: 94010.0 [2024-08-06 00:19:46,288][52811] Sum rewards: 52.496, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.725', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.184', 'weapon4': '0.184', 'AMMO4': '0.241', 'AMMO3': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.666', 'WEAPON3': '1.650', 'weapon3': '2.604', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:46,422][52667] DAMAGECOUNT value on done: 95684.0 [2024-08-06 00:19:46,425][52667] Sum rewards: 52.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.197', 'AMMO5': '0.003', 'AMMO2': '0.026', 'ARMOR': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.092', 'AMMO4': '0.129', 'AMMO3': '0.178', 'WEAPON4': '0.350', 'weapon4': '0.450', 'weapon2': '0.764', 'WEAPON3': '1.050', 'weapon3': '2.510', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '45.000'} [2024-08-06 00:19:46,955][52670] DAMAGECOUNT value on done: 94344.0 [2024-08-06 00:19:46,957][52670] Sum rewards: 44.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.176', 'weapon4': '0.184', 'WEAPON5': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.410', 'weapon3': '2.780', 'DAMAGECOUNT': '11.211', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:47,013][52658] DAMAGECOUNT value on done: 103726.0 [2024-08-06 00:19:47,013][52658] Sum rewards: 62.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'ARMOR': '0.004', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.442', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.252', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '56.000'} [2024-08-06 00:19:47,279][52649] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:19:47,391][52663] DAMAGECOUNT value on done: 98573.0 [2024-08-06 00:19:47,391][52663] Sum rewards: 56.694, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.367', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.305', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.402', 'WEAPON3': '1.850', 'weapon3': '2.770', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '56.000'} [2024-08-06 00:19:47,468][52666] DAMAGECOUNT value on done: 92904.0 [2024-08-06 00:19:47,470][52666] Sum rewards: 50.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.744', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.047', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.234', 'weapon4': '0.380', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '2.860', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '42.000'} [2024-08-06 00:19:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 178659328. Throughput: 0: 4403.6. Samples: 44664760. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 00:19:47,794][52567] Avg episode reward: [(0, '51.848')] [2024-08-06 00:19:48,034][52803] DAMAGECOUNT value on done: 94697.0 [2024-08-06 00:19:48,035][52803] Sum rewards: 62.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.168', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.020', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '54.000'} [2024-08-06 00:19:48,421][52650] Updated weights for policy 0, policy_version 21811 (0.0010) [2024-08-06 00:19:49,307][52811] DAMAGECOUNT value on done: 92525.0 [2024-08-06 00:19:49,308][52811] Sum rewards: 51.376, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.052', 'weapon4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.205', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.270', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '46.500'} [2024-08-06 00:19:49,503][52667] DAMAGECOUNT value on done: 101878.0 [2024-08-06 00:19:49,503][52667] Sum rewards: 42.671, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.266', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.176', 'AMMO3': '0.181', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'weapon4': '0.442', 'weapon2': '0.454', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.462', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:50,028][52670] DAMAGECOUNT value on done: 100462.0 [2024-08-06 00:19:50,033][52670] Sum rewards: 60.218, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.334', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon7': '0.068', 'AMMO4': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.286', 'weapon4': '0.468', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '53.000'} [2024-08-06 00:19:50,161][52658] DAMAGECOUNT value on done: 96271.0 [2024-08-06 00:19:50,161][52658] Sum rewards: 53.494, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.738', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon5': '0.286', 'weapon2': '0.424', 'weapon4': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.592', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:50,518][52663] DAMAGECOUNT value on done: 97970.0 [2024-08-06 00:19:50,518][52663] Sum rewards: 45.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.166', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '2.872', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:50,625][52666] DAMAGECOUNT value on done: 96042.0 [2024-08-06 00:19:50,625][52666] Sum rewards: 49.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.489', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.153', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.978', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '41.500'} [2024-08-06 00:19:51,030][52803] DAMAGECOUNT value on done: 91173.0 [2024-08-06 00:19:51,031][52803] Sum rewards: 44.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.753', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.160', 'AMMO4': '0.177', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.426', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '2.566', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '37.500'} [2024-08-06 00:19:52,319][52811] DAMAGECOUNT value on done: 92432.0 [2024-08-06 00:19:52,319][52811] Sum rewards: 47.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.607', 'AMMO5': '0.005', 'AMMO2': '0.030', 'ARMOR': '0.036', 'weapon5': '0.090', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon2': '0.414', 'weapon4': '0.854', 'WEAPON3': '1.100', 'weapon3': '2.422', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '39.000'} [2024-08-06 00:19:52,677][52658] DAMAGECOUNT value on done: 102162.0 [2024-08-06 00:19:52,677][52658] Sum rewards: 51.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon5': '0.102', 'weapon4': '0.108', 'AMMO4': '0.173', 'AMMO3': '0.176', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '3.252', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '44.000'} [2024-08-06 00:19:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 178749440. Throughput: 0: 4399.6. Samples: 44691040. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 00:19:52,794][52567] Avg episode reward: [(0, '51.855')] [2024-08-06 00:19:52,869][52670] DAMAGECOUNT value on done: 94544.0 [2024-08-06 00:19:52,869][52670] Sum rewards: 50.562, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.972', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.110', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.400', 'weapon2': '0.604', 'weapon4': '0.790', 'WEAPON3': '0.950', 'weapon3': '2.242', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '40.000'} [2024-08-06 00:19:53,217][52664] DAMAGECOUNT value on done: 101390.0 [2024-08-06 00:19:53,217][52664] Sum rewards: 60.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.028', 'weapon4': '0.116', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '51.000'} [2024-08-06 00:19:53,268][52650] Updated weights for policy 0, policy_version 21821 (0.0022) [2024-08-06 00:19:53,469][52666] DAMAGECOUNT value on done: 94195.0 [2024-08-06 00:19:53,473][52666] Sum rewards: 47.671, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'weapon5': '0.120', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.564', 'weapon2': '0.636', 'WEAPON3': '0.950', 'weapon3': '2.214', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:53,992][52663] DAMAGECOUNT value on done: 98999.0 [2024-08-06 00:19:53,992][52663] Sum rewards: 45.022, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.677', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.182', 'weapon4': '0.204', 'AMMO3': '0.209', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.864', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '43.000'} [2024-08-06 00:19:54,130][52803] DAMAGECOUNT value on done: 92411.0 [2024-08-06 00:19:54,130][52803] Sum rewards: 40.088, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.802', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO2': '0.068', 'AMMO3': '0.241', 'AMMO4': '0.339', 'weapon2': '0.372', 'weapon4': '0.456', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '2.844', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:55,193][52658] DAMAGECOUNT value on done: 101096.0 [2024-08-06 00:19:55,194][52658] Sum rewards: 58.633, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'HEALTH': '0.046', 'WEAPON5': '0.100', 'weapon5': '0.118', 'weapon4': '0.126', 'AMMO4': '0.188', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:55,351][52811] DAMAGECOUNT value on done: 91033.0 [2024-08-06 00:19:55,351][52811] Sum rewards: 57.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.401', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.022', 'weapon4': '0.062', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '49.500'} [2024-08-06 00:19:56,064][52664] DAMAGECOUNT value on done: 100972.0 [2024-08-06 00:19:56,065][52664] Sum rewards: 42.761, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.665', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.231', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'weapon5': '0.310', 'weapon4': '0.348', 'ARMOR': '0.486', 'WEAPON4': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.532', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.373', 'FRAGCOUNT': '38.000'} [2024-08-06 00:19:56,203][52670] DAMAGECOUNT value on done: 97616.0 [2024-08-06 00:19:56,205][52670] Sum rewards: 55.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.757', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.086', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '47.000'} [2024-08-06 00:19:56,734][52666] DAMAGECOUNT value on done: 95420.0 [2024-08-06 00:19:56,735][52666] Sum rewards: 63.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'weapon5': '0.038', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO4': '0.193', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon2': '0.440', 'weapon4': '0.478', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '53.000'} [2024-08-06 00:19:56,832][52663] DAMAGECOUNT value on done: 98988.0 [2024-08-06 00:19:56,833][52663] Sum rewards: 56.596, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.401', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'WEAPON4': '0.500', 'weapon2': '0.550', 'weapon4': '0.762', 'WEAPON3': '0.900', 'weapon3': '2.174', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:57,279][52803] DAMAGECOUNT value on done: 91314.0 [2024-08-06 00:19:57,279][52803] Sum rewards: 50.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.353', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.618', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.080', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '43.000'} [2024-08-06 00:19:57,675][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:19:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 178839552. Throughput: 0: 4399.6. Samples: 44717700. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 00:19:57,795][52567] Avg episode reward: [(0, '52.153')] [2024-08-06 00:19:57,798][52650] Updated weights for policy 0, policy_version 21831 (0.0011) [2024-08-06 00:19:57,959][52658] DAMAGECOUNT value on done: 102052.0 [2024-08-06 00:19:57,960][52658] Sum rewards: 53.432, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.034', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.191', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '46.000'} [2024-08-06 00:19:58,412][52811] DAMAGECOUNT value on done: 94016.0 [2024-08-06 00:19:58,412][52811] Sum rewards: 54.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.228', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '48.000'} [2024-08-06 00:19:58,934][52670] DAMAGECOUNT value on done: 96991.0 [2024-08-06 00:19:58,934][52670] Sum rewards: 58.551, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.032', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'weapon5': '0.128', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '2.554', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:59,219][52664] DAMAGECOUNT value on done: 103046.0 [2024-08-06 00:19:59,220][52664] Sum rewards: 61.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '2.672', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '52.000'} [2024-08-06 00:19:59,569][52666] DAMAGECOUNT value on done: 95434.0 [2024-08-06 00:19:59,569][52666] Sum rewards: 58.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.208', 'weapon2': '0.472', 'WEAPON4': '0.500', 'weapon4': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '49.000'} [2024-08-06 00:19:59,799][52663] DAMAGECOUNT value on done: 95025.0 [2024-08-06 00:19:59,800][52663] Sum rewards: 35.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.355', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO4': '0.113', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.420', 'weapon2': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.744', 'DAMAGECOUNT': '10.110', 'FRAGCOUNT': '32.000'} [2024-08-06 00:20:00,281][52803] DAMAGECOUNT value on done: 89689.0 [2024-08-06 00:20:00,281][52803] Sum rewards: 63.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.816', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.254', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '52.000'} [2024-08-06 00:20:01,129][52658] DAMAGECOUNT value on done: 95986.0 [2024-08-06 00:20:01,131][52658] Sum rewards: 52.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.078', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.190', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.462', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:01,420][52811] DAMAGECOUNT value on done: 90454.0 [2024-08-06 00:20:01,421][52811] Sum rewards: 44.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.383', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon7': '0.050', 'AMMO4': '0.065', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.203', 'weapon2': '0.314', 'weapon4': '0.834', 'WEAPON3': '1.200', 'weapon3': '2.600', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.695', 'FRAGCOUNT': '38.000'} [2024-08-06 00:20:01,831][52670] DAMAGECOUNT value on done: 98414.0 [2024-08-06 00:20:01,832][52670] Sum rewards: 48.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.704', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon5': '0.048', 'AMMO4': '0.066', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.368', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:02,294][52650] Updated weights for policy 0, policy_version 21841 (0.0031) [2024-08-06 00:20:02,389][52666] DAMAGECOUNT value on done: 100356.0 [2024-08-06 00:20:02,390][52666] Sum rewards: 51.339, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'ARMOR': '0.008', 'AMMO2': '0.044', 'AMMO3': '0.210', 'AMMO4': '0.220', 'weapon4': '0.286', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:02,404][52664] DAMAGECOUNT value on done: 101743.0 [2024-08-06 00:20:02,406][52664] Sum rewards: 60.858, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.839', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.084', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '53.000'} [2024-08-06 00:20:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 178929664. Throughput: 0: 4399.6. Samples: 44730980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:20:02,794][52567] Avg episode reward: [(0, '52.413')] [2024-08-06 00:20:02,889][52663] DAMAGECOUNT value on done: 101647.0 [2024-08-06 00:20:02,889][52663] Sum rewards: 47.793, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.938', 'AMMO5': '0.007', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.202', 'AMMO3': '0.239', 'weapon4': '0.366', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '2.868', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:02,934][52665] DAMAGECOUNT value on done: 94683.0 [2024-08-06 00:20:02,934][52665] Sum rewards: 50.520, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.149', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.546', 'weapon4': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.562', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:03,554][52803] DAMAGECOUNT value on done: 92702.0 [2024-08-06 00:20:03,555][52803] Sum rewards: 50.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.073', 'weapon5': '0.102', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.448', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:03,984][52658] DAMAGECOUNT value on done: 98085.0 [2024-08-06 00:20:03,987][52658] Sum rewards: 46.645, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.054', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.265', 'weapon4': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:04,417][52811] DAMAGECOUNT value on done: 94489.0 [2024-08-06 00:20:04,417][52811] Sum rewards: 65.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.120', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.216', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '55.000'} [2024-08-06 00:20:04,926][52670] DAMAGECOUNT value on done: 92586.0 [2024-08-06 00:20:04,926][52670] Sum rewards: 42.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.379', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.030', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.175', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.444', 'weapon4': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.870', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '37.000'} [2024-08-06 00:20:05,040][52664] DAMAGECOUNT value on done: 100016.0 [2024-08-06 00:20:05,042][52664] Sum rewards: 49.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.432', 'weapon4': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:05,426][52666] DAMAGECOUNT value on done: 97273.0 [2024-08-06 00:20:05,426][52666] Sum rewards: 44.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.272', 'weapon2': '0.922', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '38.000'} [2024-08-06 00:20:05,597][52663] DAMAGECOUNT value on done: 100409.0 [2024-08-06 00:20:05,597][52663] Sum rewards: 41.954, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.116', 'AMMO5': '0.008', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon5': '0.058', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.672', 'WEAPON3': '1.550', 'weapon3': '2.668', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.244', 'FRAGCOUNT': '41.000'} [2024-08-06 00:20:06,078][52665] DAMAGECOUNT value on done: 102803.0 [2024-08-06 00:20:06,078][52665] Sum rewards: 52.845, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.318', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.154', 'AMMO3': '0.288', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.700', 'weapon3': '2.850', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '47.500'} [2024-08-06 00:20:06,789][52803] DAMAGECOUNT value on done: 93002.0 [2024-08-06 00:20:06,789][52803] Sum rewards: 60.400, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.669', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.207', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '51.000'} [2024-08-06 00:20:07,062][52658] DAMAGECOUNT value on done: 97613.0 [2024-08-06 00:20:07,063][52658] Sum rewards: 44.257, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.178', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon4': '0.244', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.766', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:07,175][52650] Updated weights for policy 0, policy_version 21851 (0.0031) [2024-08-06 00:20:07,429][52664] DAMAGECOUNT value on done: 106302.0 [2024-08-06 00:20:07,429][52664] Sum rewards: 55.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.665', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:07,661][52811] DAMAGECOUNT value on done: 94413.0 [2024-08-06 00:20:07,662][52811] Sum rewards: 61.964, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.167', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.992', 'WEAPON3': '1.050', 'weapon3': '2.480', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '48.000'} [2024-08-06 00:20:07,764][52670] DAMAGECOUNT value on done: 96080.0 [2024-08-06 00:20:07,765][52670] Sum rewards: 46.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.176', 'AMMO3': '0.211', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 179011584. Throughput: 0: 4394.7. Samples: 44757230. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:20:07,802][52567] Avg episode reward: [(0, '51.940')] [2024-08-06 00:20:08,131][52666] DAMAGECOUNT value on done: 95556.0 [2024-08-06 00:20:08,132][52666] Sum rewards: 39.289, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.702', 'AMMO5': '0.005', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'AMMO4': '0.264', 'weapon2': '0.378', 'ARMOR': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.572', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '38.000'} [2024-08-06 00:20:08,837][52663] DAMAGECOUNT value on done: 96604.0 [2024-08-06 00:20:08,837][52663] Sum rewards: 49.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.532', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.550', 'weapon2': '0.694', 'weapon4': '0.776', 'WEAPON3': '1.250', 'weapon3': '2.260', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:09,070][52665] DAMAGECOUNT value on done: 96465.0 [2024-08-06 00:20:09,070][52665] Sum rewards: 53.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.009', 'ARMOR': '0.016', 'weapon7': '0.036', 'AMMO2': '0.075', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.374', 'weapon2': '0.534', 'weapon4': '0.564', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.444', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:09,207][52671] DAMAGECOUNT value on done: 103310.0 [2024-08-06 00:20:09,208][52671] Sum rewards: 53.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.945', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.161', 'weapon5': '0.198', 'AMMO4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON4': '0.600', 'weapon4': '0.766', 'WEAPON3': '0.900', 'weapon3': '2.312', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:09,871][52803] DAMAGECOUNT value on done: 94858.0 [2024-08-06 00:20:09,871][52803] Sum rewards: 42.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.512', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.520', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.842', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '37.000'} [2024-08-06 00:20:09,973][52658] DAMAGECOUNT value on done: 96132.0 [2024-08-06 00:20:09,973][52658] Sum rewards: 50.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.918', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.272', 'weapon2': '0.588', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:09,988][52664] DAMAGECOUNT value on done: 103867.0 [2024-08-06 00:20:09,989][52664] Sum rewards: 62.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'weapon4': '0.162', 'AMMO3': '0.249', 'weapon2': '0.760', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '53.000'} [2024-08-06 00:20:10,082][52670] DAMAGECOUNT value on done: 90563.0 [2024-08-06 00:20:10,082][52670] Sum rewards: 47.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.597', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.159', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.282', 'weapon4': '0.584', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '2.884', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:10,478][52666] DAMAGECOUNT value on done: 93896.0 [2024-08-06 00:20:10,479][52666] Sum rewards: 41.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.658', 'AMMO2': '0.039', 'AMMO3': '0.164', 'AMMO4': '0.193', 'weapon4': '0.210', 'WEAPON4': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.952', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '37.000'} [2024-08-06 00:20:10,742][52811] DAMAGECOUNT value on done: 92204.0 [2024-08-06 00:20:10,744][52811] Sum rewards: 36.874, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.782', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.062', 'weapon5': '0.076', 'AMMO3': '0.158', 'AMMO4': '0.309', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '0.684', 'weapon2': '0.796', 'WEAPON3': '1.000', 'weapon3': '2.074', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '10.653', 'FRAGCOUNT': '35.000'} [2024-08-06 00:20:11,444][52663] DAMAGECOUNT value on done: 99213.0 [2024-08-06 00:20:11,446][52663] Sum rewards: 61.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.258', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.186', 'weapon4': '0.206', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '53.000'} [2024-08-06 00:20:11,696][52650] Updated weights for policy 0, policy_version 21861 (0.0013) [2024-08-06 00:20:11,968][52665] DAMAGECOUNT value on done: 92816.0 [2024-08-06 00:20:11,968][52665] Sum rewards: 45.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.118', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.088', 'AMMO3': '0.170', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.386', 'WEAPON4': '0.400', 'ARMOR': '0.420', 'weapon2': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.802', 'DAMAGECOUNT': '11.301', 'FRAGCOUNT': '39.000'} [2024-08-06 00:20:12,244][52671] DAMAGECOUNT value on done: 97373.0 [2024-08-06 00:20:12,244][52671] Sum rewards: 49.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'ARMOR': '0.009', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.794', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '41.000'} [2024-08-06 00:20:12,610][52664] DAMAGECOUNT value on done: 95717.0 [2024-08-06 00:20:12,610][52664] Sum rewards: 56.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.427', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.049', 'weapon5': '0.118', 'AMMO3': '0.174', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.442', 'weapon2': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.554', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 179101696. Throughput: 0: 4400.0. Samples: 44783800. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:20:12,794][52567] Avg episode reward: [(0, '51.653')] [2024-08-06 00:20:12,956][52803] DAMAGECOUNT value on done: 88394.0 [2024-08-06 00:20:12,957][52803] Sum rewards: 56.962, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.497', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.146', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.518', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.602', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:13,044][52670] DAMAGECOUNT value on done: 90047.0 [2024-08-06 00:20:13,047][52670] Sum rewards: 50.314, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.206', 'AMMO4': '0.231', 'AMMO3': '0.245', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.068', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:13,111][52658] DAMAGECOUNT value on done: 101074.0 [2024-08-06 00:20:13,114][52658] Sum rewards: 45.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.142', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '40.000'} [2024-08-06 00:20:13,493][52666] DAMAGECOUNT value on done: 96065.0 [2024-08-06 00:20:13,496][52666] Sum rewards: 64.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.194', 'AMMO3': '0.195', 'AMMO4': '0.241', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.440', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '55.000'} [2024-08-06 00:20:13,761][52811] DAMAGECOUNT value on done: 94394.0 [2024-08-06 00:20:13,761][52811] Sum rewards: 47.270, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.948', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.260', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.324', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:14,276][52663] DAMAGECOUNT value on done: 99691.0 [2024-08-06 00:20:14,277][52663] Sum rewards: 40.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.144', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.193', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.000', 'HITCOUNT': '2.470', 'weapon3': '2.812', 'DAMAGECOUNT': '10.443', 'FRAGCOUNT': '35.000'} [2024-08-06 00:20:14,602][52665] DAMAGECOUNT value on done: 96397.0 [2024-08-06 00:20:14,603][52665] Sum rewards: 61.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.736', 'WEAPON3': '1.400', 'weapon3': '2.898', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '53.000'} [2024-08-06 00:20:15,207][52671] DAMAGECOUNT value on done: 99778.0 [2024-08-06 00:20:15,207][52671] Sum rewards: 47.201, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.202', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.858', 'WEAPON3': '0.950', 'weapon3': '2.584', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '39.000'} [2024-08-06 00:20:15,740][52664] DAMAGECOUNT value on done: 108222.0 [2024-08-06 00:20:15,741][52664] Sum rewards: 44.468, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.362', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.186', 'AMMO3': '0.253', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.550', 'weapon4': '0.578', 'WEAPON3': '1.500', 'weapon3': '2.464', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:15,840][52658] DAMAGECOUNT value on done: 102792.0 [2024-08-06 00:20:15,841][52658] Sum rewards: 53.720, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.163', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'AMMO4': '0.227', 'weapon4': '0.410', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '48.000'} [2024-08-06 00:20:15,962][52670] DAMAGECOUNT value on done: 99601.0 [2024-08-06 00:20:15,963][52670] Sum rewards: 57.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.447', 'ARMOR': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:16,313][52650] Updated weights for policy 0, policy_version 21871 (0.0010) [2024-08-06 00:20:16,483][52666] DAMAGECOUNT value on done: 99055.0 [2024-08-06 00:20:16,483][52666] Sum rewards: 59.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.767', 'AMMO2': '0.007', 'ARMOR': '0.020', 'AMMO4': '0.033', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.256', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '52.000'} [2024-08-06 00:20:16,495][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:20:16,927][52811] DAMAGECOUNT value on done: 91351.0 [2024-08-06 00:20:16,928][52811] Sum rewards: 62.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.936', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon7': '0.050', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.596', 'weapon2': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.324', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '51.000'} [2024-08-06 00:20:16,957][52663] DAMAGECOUNT value on done: 99692.0 [2024-08-06 00:20:16,958][52663] Sum rewards: 53.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.032', 'weapon5': '0.134', 'AMMO4': '0.151', 'AMMO3': '0.192', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:17,352][52665] DAMAGECOUNT value on done: 98750.0 [2024-08-06 00:20:17,354][52665] Sum rewards: 49.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.262', 'weapon4': '0.348', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.072', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 179183616. Throughput: 0: 4400.2. Samples: 44796980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:20:17,794][52567] Avg episode reward: [(0, '51.825')] [2024-08-06 00:20:18,236][52671] DAMAGECOUNT value on done: 96332.0 [2024-08-06 00:20:18,238][52671] Sum rewards: 41.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.674', 'WEAPON3': '1.550', 'weapon3': '2.742', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '38.000'} [2024-08-06 00:20:18,298][52647] DAMAGECOUNT value on done: 104266.0 [2024-08-06 00:20:18,299][52647] Sum rewards: 59.249, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.898', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'weapon4': '0.190', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '52.000'} [2024-08-06 00:20:18,530][52658] DAMAGECOUNT value on done: 96379.0 [2024-08-06 00:20:18,530][52658] Sum rewards: 51.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.745', 'ARMOR': '0.040', 'AMMO2': '0.044', 'AMMO4': '0.220', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.480', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.892', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:18,869][52664] DAMAGECOUNT value on done: 106341.0 [2024-08-06 00:20:18,869][52664] Sum rewards: 67.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'weapon5': '0.160', 'AMMO3': '0.199', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '55.000'} [2024-08-06 00:20:19,179][52670] DAMAGECOUNT value on done: 100129.0 [2024-08-06 00:20:19,179][52670] Sum rewards: 65.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.204', 'weapon4': '0.458', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '55.000'} [2024-08-06 00:20:19,516][52666] DAMAGECOUNT value on done: 96343.0 [2024-08-06 00:20:19,518][52666] Sum rewards: 57.142, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO5': '0.006', 'AMMO2': '0.023', 'ARMOR': '0.024', 'weapon5': '0.072', 'AMMO4': '0.116', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '49.000'} [2024-08-06 00:20:19,867][52665] DAMAGECOUNT value on done: 98755.0 [2024-08-06 00:20:19,868][52665] Sum rewards: 47.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.591', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.358', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.962', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:19,988][52663] DAMAGECOUNT value on done: 98873.0 [2024-08-06 00:20:19,988][52663] Sum rewards: 56.304, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.152', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.033', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon2': '0.206', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:20,048][52811] DAMAGECOUNT value on done: 92474.0 [2024-08-06 00:20:20,048][52811] Sum rewards: 50.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.038', 'AMMO3': '0.185', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.476', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.876', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:21,019][52650] Updated weights for policy 0, policy_version 21881 (0.0023) [2024-08-06 00:20:21,162][52647] DAMAGECOUNT value on done: 102863.0 [2024-08-06 00:20:21,164][52647] Sum rewards: 51.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.012', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.012', 'weapon5': '0.026', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.208', 'weapon2': '0.508', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.244', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '43.500'} [2024-08-06 00:20:21,183][52671] DAMAGECOUNT value on done: 97906.0 [2024-08-06 00:20:21,185][52671] Sum rewards: 42.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'ARMOR': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.178', 'AMMO4': '0.204', 'weapon4': '0.572', 'WEAPON4': '0.600', 'weapon2': '0.904', 'WEAPON3': '1.050', 'weapon3': '2.332', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '38.000'} [2024-08-06 00:20:21,651][52658] DAMAGECOUNT value on done: 98000.0 [2024-08-06 00:20:21,652][52658] Sum rewards: 46.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.636', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '2.892', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '39.000'} [2024-08-06 00:20:21,672][52664] DAMAGECOUNT value on done: 105094.0 [2024-08-06 00:20:21,673][52664] Sum rewards: 57.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.605', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.122', 'AMMO3': '0.178', 'AMMO4': '0.253', 'weapon4': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:21,889][52670] DAMAGECOUNT value on done: 97549.0 [2024-08-06 00:20:21,890][52670] Sum rewards: 43.858, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.166', 'weapon5': '0.178', 'WEAPON5': '0.250', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.720', 'WEAPON3': '1.000', 'weapon3': '2.484', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '37.000'} [2024-08-06 00:20:22,363][52666] DAMAGECOUNT value on done: 94857.0 [2024-08-06 00:20:22,371][52666] Sum rewards: 46.873, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.408', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.102', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.256', 'weapon2': '0.582', 'WEAPON3': '1.000', 'HITCOUNT': '2.520', 'weapon3': '2.828', 'DAMAGECOUNT': '10.569', 'FRAGCOUNT': '40.000'} [2024-08-06 00:20:22,598][52663] DAMAGECOUNT value on done: 93407.0 [2024-08-06 00:20:22,599][52663] Sum rewards: 47.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.106', 'AMMO3': '0.188', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.970', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 179281920. Throughput: 0: 4408.2. Samples: 44823550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:20:22,794][52665] DAMAGECOUNT value on done: 99328.0 [2024-08-06 00:20:22,794][52567] Avg episode reward: [(0, '51.760')] [2024-08-06 00:20:22,802][52665] Sum rewards: 42.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.640', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.158', 'AMMO3': '0.215', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.776', 'WEAPON3': '1.250', 'weapon3': '2.616', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '38.000'} [2024-08-06 00:20:23,538][52647] DAMAGECOUNT value on done: 107499.0 [2024-08-06 00:20:23,539][52647] Sum rewards: 54.696, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.630', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.534', 'weapon4': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.688', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:24,175][52664] DAMAGECOUNT value on done: 101845.0 [2024-08-06 00:20:24,175][52664] Sum rewards: 50.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.812', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'weapon5': '0.184', 'AMMO4': '0.188', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.572', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:24,426][52658] DAMAGECOUNT value on done: 100790.0 [2024-08-06 00:20:24,428][52658] Sum rewards: 46.009, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.142', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.193', 'WEAPON4': '0.400', 'weapon2': '0.422', 'weapon4': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '41.000'} [2024-08-06 00:20:24,515][52671] DAMAGECOUNT value on done: 100456.0 [2024-08-06 00:20:24,516][52671] Sum rewards: 52.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.676', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.106', 'weapon4': '0.176', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.052', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:24,698][52670] DAMAGECOUNT value on done: 96931.0 [2024-08-06 00:20:24,700][52670] Sum rewards: 50.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.442', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon4': '0.138', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.708', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '2.942', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:25,115][52663] DAMAGECOUNT value on done: 97547.0 [2024-08-06 00:20:25,116][52663] Sum rewards: 60.042, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.282', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.136', 'AMMO3': '0.223', 'AMMO4': '0.266', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '54.000'} [2024-08-06 00:20:25,174][52666] DAMAGECOUNT value on done: 95225.0 [2024-08-06 00:20:25,175][52666] Sum rewards: 51.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.889', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.220', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:25,434][52650] Updated weights for policy 0, policy_version 21891 (0.0011) [2024-08-06 00:20:25,522][52665] DAMAGECOUNT value on done: 103933.0 [2024-08-06 00:20:25,526][52665] Sum rewards: 51.320, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.154', 'AMMO5': '0.008', 'weapon5': '0.008', 'ARMOR': '0.042', 'AMMO2': '0.061', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'AMMO4': '0.304', 'weapon4': '0.418', 'weapon2': '0.542', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '48.000'} [2024-08-06 00:20:26,294][52647] DAMAGECOUNT value on done: 106657.0 [2024-08-06 00:20:26,294][52647] Sum rewards: 53.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.355', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon4': '0.346', 'weapon2': '0.744', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:27,035][52664] DAMAGECOUNT value on done: 99794.0 [2024-08-06 00:20:27,037][52664] Sum rewards: 49.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.020', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.250', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:27,394][52671] DAMAGECOUNT value on done: 99904.0 [2024-08-06 00:20:27,394][52671] Sum rewards: 51.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.130', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.724', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:27,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 179372032. Throughput: 0: 4415.5. Samples: 44850100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:20:27,795][52567] Avg episode reward: [(0, '51.554')] [2024-08-06 00:20:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021896_179372032.pth... [2024-08-06 00:20:27,810][52663] DAMAGECOUNT value on done: 102135.0 [2024-08-06 00:20:27,810][52663] Sum rewards: 58.341, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.154', 'weapon5': '0.158', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.656', 'WEAPON3': '0.850', 'HEALTH': '1.230', 'HITCOUNT': '2.660', 'weapon3': '2.820', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '49.000'} [2024-08-06 00:20:27,881][52670] DAMAGECOUNT value on done: 101240.0 [2024-08-06 00:20:27,882][52670] Sum rewards: 48.206, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.290', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.222', 'AMMO3': '0.230', 'weapon4': '0.370', 'WEAPON4': '0.500', 'weapon2': '0.562', 'WEAPON3': '1.450', 'weapon3': '2.736', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021380_175144960.pth [2024-08-06 00:20:28,233][52666] DAMAGECOUNT value on done: 100165.0 [2024-08-06 00:20:28,235][52666] Sum rewards: 56.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.173', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.092', 'weapon4': '0.124', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '48.000'} [2024-08-06 00:20:28,812][52665] DAMAGECOUNT value on done: 100624.0 [2024-08-06 00:20:28,812][52665] Sum rewards: 54.930, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.028', 'HEALTH': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.256', 'weapon4': '0.344', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.064', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:29,315][52647] DAMAGECOUNT value on done: 106230.0 [2024-08-06 00:20:29,317][52647] Sum rewards: 41.343, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.204', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.166', 'AMMO3': '0.276', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.650', 'HITCOUNT': '2.710', 'weapon3': '3.012', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '39.000'} [2024-08-06 00:20:30,018][52650] Updated weights for policy 0, policy_version 21901 (0.0015) [2024-08-06 00:20:30,132][52664] DAMAGECOUNT value on done: 103772.0 [2024-08-06 00:20:30,133][52664] Sum rewards: 50.535, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.249', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.127', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:30,412][52671] DAMAGECOUNT value on done: 100983.0 [2024-08-06 00:20:30,413][52671] Sum rewards: 32.225, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.044', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.448', 'WEAPON4': '0.500', 'weapon2': '0.702', 'WEAPON3': '1.400', 'weapon3': '2.484', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.923', 'FRAGCOUNT': '32.000'} [2024-08-06 00:20:30,772][52670] DAMAGECOUNT value on done: 93077.0 [2024-08-06 00:20:30,772][52670] Sum rewards: 60.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.236', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '53.000'} [2024-08-06 00:20:31,165][52663] DAMAGECOUNT value on done: 99812.0 [2024-08-06 00:20:31,167][52663] Sum rewards: 58.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO4': '0.181', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.666', 'WEAPON3': '1.400', 'weapon3': '2.598', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:31,221][52666] DAMAGECOUNT value on done: 95521.0 [2024-08-06 00:20:31,224][52666] Sum rewards: 37.418, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon5': '0.058', 'AMMO2': '0.060', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.300', 'weapon4': '0.486', 'weapon2': '0.688', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '2.350', 'weapon3': '2.506', 'DAMAGECOUNT': '10.782', 'FRAGCOUNT': '34.000'} [2024-08-06 00:20:31,648][52665] DAMAGECOUNT value on done: 99608.0 [2024-08-06 00:20:31,650][52665] Sum rewards: 61.299, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.080', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.424', 'HEALTH': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '51.000'} [2024-08-06 00:20:31,652][52659] DAMAGECOUNT value on done: 98487.0 [2024-08-06 00:20:31,654][52659] Sum rewards: 61.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.126', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.193', 'weapon2': '0.440', 'weapon4': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '53.000'} [2024-08-06 00:20:31,762][52647] DAMAGECOUNT value on done: 106192.0 [2024-08-06 00:20:31,763][52647] Sum rewards: 47.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.010', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:32,591][52664] DAMAGECOUNT value on done: 102263.0 [2024-08-06 00:20:32,592][52664] Sum rewards: 51.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.178', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.686', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 179453952. Throughput: 0: 4404.4. Samples: 44862960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:20:32,794][52567] Avg episode reward: [(0, '51.615')] [2024-08-06 00:20:33,295][52671] DAMAGECOUNT value on done: 98083.0 [2024-08-06 00:20:33,297][52671] Sum rewards: 67.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.354', 'AMMO5': '0.005', 'ARMOR': '0.013', 'AMMO2': '0.027', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.183', 'weapon2': '0.298', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '56.000'} [2024-08-06 00:20:33,312][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:20:33,682][52670] DAMAGECOUNT value on done: 99814.0 [2024-08-06 00:20:33,683][52670] Sum rewards: 61.291, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.032', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '55.000'} [2024-08-06 00:20:33,961][52666] DAMAGECOUNT value on done: 99132.0 [2024-08-06 00:20:33,961][52666] Sum rewards: 50.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.646', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.284', 'WEAPON4': '0.450', 'weapon4': '0.542', 'WEAPON3': '1.600', 'weapon3': '2.800', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:34,193][52663] DAMAGECOUNT value on done: 100979.0 [2024-08-06 00:20:34,193][52663] Sum rewards: 62.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.885', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'weapon4': '0.236', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.700', 'weapon3': '3.150', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '54.000'} [2024-08-06 00:20:34,265][52659] DAMAGECOUNT value on done: 98706.0 [2024-08-06 00:20:34,265][52659] Sum rewards: 34.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.004', 'weapon5': '0.036', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'AMMO4': '0.242', 'weapon2': '0.302', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '0.950', 'HITCOUNT': '2.320', 'weapon3': '2.556', 'DAMAGECOUNT': '9.093', 'FRAGCOUNT': '30.000'} [2024-08-06 00:20:34,647][52665] DAMAGECOUNT value on done: 97744.0 [2024-08-06 00:20:34,649][52665] Sum rewards: 54.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.854', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.060', 'AMMO4': '0.109', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.000', 'HITCOUNT': '2.540', 'weapon3': '3.326', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:35,009][52647] DAMAGECOUNT value on done: 103876.0 [2024-08-06 00:20:35,017][52647] Sum rewards: 44.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.423', 'ARMOR': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.209', 'weapon2': '0.402', 'WEAPON4': '0.450', 'weapon4': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '39.000'} [2024-08-06 00:20:35,029][52650] Updated weights for policy 0, policy_version 21911 (0.0021) [2024-08-06 00:20:35,787][52664] DAMAGECOUNT value on done: 98899.0 [2024-08-06 00:20:35,788][52664] Sum rewards: 51.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.129', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.542', 'weapon2': '0.668', 'WEAPON3': '1.250', 'weapon3': '2.514', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:36,061][52671] DAMAGECOUNT value on done: 100777.0 [2024-08-06 00:20:36,064][52671] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.022', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '49.000'} [2024-08-06 00:20:36,614][52663] DAMAGECOUNT value on done: 100024.0 [2024-08-06 00:20:36,616][52663] Sum rewards: 51.954, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.308', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:36,745][52670] DAMAGECOUNT value on done: 98020.0 [2024-08-06 00:20:36,746][52670] Sum rewards: 53.716, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.146', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.400', 'weapon3': '2.674', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '49.000'} [2024-08-06 00:20:37,317][52659] DAMAGECOUNT value on done: 97574.0 [2024-08-06 00:20:37,318][52659] Sum rewards: 53.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.942', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.040', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.748', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '2.912', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '44.500'} [2024-08-06 00:20:37,528][52665] DAMAGECOUNT value on done: 97458.0 [2024-08-06 00:20:37,530][52665] Sum rewards: 46.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.717', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.672', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '40.000'} [2024-08-06 00:20:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 179535872. Throughput: 0: 4410.0. Samples: 44889490. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:20:37,794][52567] Avg episode reward: [(0, '51.518')] [2024-08-06 00:20:37,924][52647] DAMAGECOUNT value on done: 107303.0 [2024-08-06 00:20:37,924][52647] Sum rewards: 58.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.114', 'AMMO3': '0.212', 'weapon2': '0.288', 'AMMO4': '0.295', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.724', 'WEAPON3': '1.300', 'weapon3': '2.672', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:38,755][52664] DAMAGECOUNT value on done: 103570.0 [2024-08-06 00:20:38,755][52664] Sum rewards: 53.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.522', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:39,049][52671] DAMAGECOUNT value on done: 98956.0 [2024-08-06 00:20:39,053][52671] Sum rewards: 48.455, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon4': '0.088', 'weapon5': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon2': '1.006', 'HITCOUNT': '2.340', 'weapon3': '2.532', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '40.000'} [2024-08-06 00:20:39,154][52663] DAMAGECOUNT value on done: 101967.0 [2024-08-06 00:20:39,156][52663] Sum rewards: 53.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.490', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.620', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '2.950', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:39,456][52670] DAMAGECOUNT value on done: 97062.0 [2024-08-06 00:20:39,456][52670] Sum rewards: 43.206, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '2.510', 'weapon3': '3.024', 'DAMAGECOUNT': '10.758', 'FRAGCOUNT': '36.000'} [2024-08-06 00:20:39,824][52650] Updated weights for policy 0, policy_version 21921 (0.0026) [2024-08-06 00:20:40,377][52647] DAMAGECOUNT value on done: 107547.0 [2024-08-06 00:20:40,385][52647] Sum rewards: 53.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.518', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.219', 'weapon5': '0.246', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.544', 'weapon4': '0.780', 'WEAPON3': '1.300', 'weapon3': '2.102', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:40,390][52659] DAMAGECOUNT value on done: 99621.0 [2024-08-06 00:20:40,390][52659] Sum rewards: 38.247, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.186', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.212', 'AMMO3': '0.226', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON4': '0.500', 'weapon4': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.466', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '37.000'} [2024-08-06 00:20:40,587][52665] DAMAGECOUNT value on done: 97646.0 [2024-08-06 00:20:40,588][52665] Sum rewards: 52.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.319', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.172', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.426', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.032', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:41,299][52664] DAMAGECOUNT value on done: 102424.0 [2024-08-06 00:20:41,300][52664] Sum rewards: 50.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.234', 'weapon4': '0.338', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:41,829][52670] DAMAGECOUNT value on done: 94954.0 [2024-08-06 00:20:41,829][52670] Sum rewards: 50.330, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.788', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.098', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon4': '0.372', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.698', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:42,227][52671] DAMAGECOUNT value on done: 98524.0 [2024-08-06 00:20:42,230][52671] Sum rewards: 47.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.196', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.604', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.924', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '40.000'} [2024-08-06 00:20:42,252][52663] DAMAGECOUNT value on done: 97655.0 [2024-08-06 00:20:42,255][52663] Sum rewards: 58.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.284', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.076', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.208', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:42,745][52647] DAMAGECOUNT value on done: 100629.0 [2024-08-06 00:20:42,746][52647] Sum rewards: 43.651, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.874', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon7': '0.064', 'weapon5': '0.088', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.161', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.440', 'weapon4': '0.736', 'WEAPON3': '1.000', 'HITCOUNT': '2.320', 'weapon3': '2.420', 'DAMAGECOUNT': '10.635', 'FRAGCOUNT': '38.000'} [2024-08-06 00:20:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 179625984. Throughput: 0: 4405.3. Samples: 44915940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:20:42,794][52567] Avg episode reward: [(0, '51.566')] [2024-08-06 00:20:43,441][52659] DAMAGECOUNT value on done: 100067.0 [2024-08-06 00:20:43,442][52659] Sum rewards: 43.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.416', 'weapon2': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.664', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '35.000'} [2024-08-06 00:20:43,519][52665] DAMAGECOUNT value on done: 97326.0 [2024-08-06 00:20:43,519][52665] Sum rewards: 48.415, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.186', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon5': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.782', 'WEAPON3': '1.350', 'weapon3': '2.530', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:43,615][52664] DAMAGECOUNT value on done: 100304.0 [2024-08-06 00:20:43,616][52664] Sum rewards: 55.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.202', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.134', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:43,618][52795] DAMAGECOUNT value on done: 91547.0 [2024-08-06 00:20:43,619][52795] Sum rewards: 48.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.591', 'AMMO5': '0.003', 'AMMO2': '0.065', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'AMMO4': '0.325', 'weapon4': '0.440', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:44,128][52650] Updated weights for policy 0, policy_version 21931 (0.0022) [2024-08-06 00:20:44,689][52671] DAMAGECOUNT value on done: 102887.0 [2024-08-06 00:20:44,690][52671] Sum rewards: 46.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.145', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.692', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '3.030', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '40.000'} [2024-08-06 00:20:45,253][52647] DAMAGECOUNT value on done: 101603.0 [2024-08-06 00:20:45,253][52647] Sum rewards: 51.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.142', 'weapon4': '0.174', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:46,194][52659] DAMAGECOUNT value on done: 101602.0 [2024-08-06 00:20:46,194][52659] Sum rewards: 43.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.094', 'WEAPON4': '0.100', 'weapon2': '0.160', 'AMMO3': '0.282', 'WEAPON3': '1.750', 'HITCOUNT': '2.770', 'weapon3': '3.578', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '41.000'} [2024-08-06 00:20:46,511][52664] DAMAGECOUNT value on done: 101036.0 [2024-08-06 00:20:46,511][52664] Sum rewards: 47.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.130', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.422', 'weapon4': '0.604', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '40.000'} [2024-08-06 00:20:46,662][52665] DAMAGECOUNT value on done: 95693.0 [2024-08-06 00:20:46,663][52665] Sum rewards: 45.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.804', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO4': '0.174', 'weapon4': '0.182', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.750', 'HITCOUNT': '2.730', 'weapon3': '3.046', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '44.500'} [2024-08-06 00:20:46,813][52795] DAMAGECOUNT value on done: 87222.0 [2024-08-06 00:20:46,813][52795] Sum rewards: 49.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.234', 'weapon2': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '3.338', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:47,596][52671] DAMAGECOUNT value on done: 98906.0 [2024-08-06 00:20:47,596][52671] Sum rewards: 40.763, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.812', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.264', 'WEAPON4': '0.500', 'weapon4': '0.698', 'weapon2': '0.868', 'WEAPON3': '1.150', 'weapon3': '2.034', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '36.000'} [2024-08-06 00:20:47,795][52567] Fps is (10 sec: 18840.3, 60 sec: 17749.1, 300 sec: 17605.8). Total num frames: 179724288. Throughput: 0: 4397.3. Samples: 44928860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:20:47,795][52567] Avg episode reward: [(0, '51.150')] [2024-08-06 00:20:48,294][52647] DAMAGECOUNT value on done: 101463.0 [2024-08-06 00:20:48,295][52647] Sum rewards: 49.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.394', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO4': '0.101', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.456', 'weapon2': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.466', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:48,625][52659] DAMAGECOUNT value on done: 100366.0 [2024-08-06 00:20:48,628][52659] Sum rewards: 40.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.796', 'ARMOR': '0.020', 'AMMO5': '0.029', 'AMMO2': '0.070', 'AMMO3': '0.162', 'weapon5': '0.258', 'AMMO4': '0.351', 'WEAPON5': '0.450', 'weapon4': '0.460', 'weapon2': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.340', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.105', 'FRAGCOUNT': '37.000'} [2024-08-06 00:20:49,012][52650] Updated weights for policy 0, policy_version 21941 (0.0021) [2024-08-06 00:20:49,511][52665] DAMAGECOUNT value on done: 97021.0 [2024-08-06 00:20:49,512][52665] Sum rewards: 62.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.959', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO4': '0.235', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.236', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '54.000'} [2024-08-06 00:20:49,937][52795] DAMAGECOUNT value on done: 88633.0 [2024-08-06 00:20:49,940][52795] Sum rewards: 49.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.193', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.936', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:50,099][52671] DAMAGECOUNT value on done: 96072.0 [2024-08-06 00:20:50,101][52671] Sum rewards: 65.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO3': '0.154', 'AMMO4': '0.175', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '0.950', 'weapon3': '3.140', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.500'} [2024-08-06 00:20:51,046][52647] DAMAGECOUNT value on done: 102561.0 [2024-08-06 00:20:51,048][52647] Sum rewards: 57.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.123', 'AMMO3': '0.201', 'WEAPON4': '0.400', 'weapon4': '0.414', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '48.000'} [2024-08-06 00:20:51,204][52659] DAMAGECOUNT value on done: 96805.0 [2024-08-06 00:20:51,204][52659] Sum rewards: 56.252, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.990', 'AMMO2': '0.022', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.244', 'AMMO3': '0.275', 'weapon2': '0.384', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:52,207][52665] DAMAGECOUNT value on done: 91238.0 [2024-08-06 00:20:52,208][52665] Sum rewards: 52.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.216', 'weapon4': '0.216', 'weapon2': '0.380', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.172', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '45.000'} [2024-08-06 00:20:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 179806208. Throughput: 0: 4401.3. Samples: 44955290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:20:52,794][52567] Avg episode reward: [(0, '51.509')] [2024-08-06 00:20:52,990][52671] DAMAGECOUNT value on done: 101376.0 [2024-08-06 00:20:52,992][52671] Sum rewards: 65.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.954', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.154', 'AMMO3': '0.159', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.462', 'weapon4': '0.656', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '53.000'} [2024-08-06 00:20:53,019][52795] DAMAGECOUNT value on done: 91286.0 [2024-08-06 00:20:53,021][52795] Sum rewards: 47.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.662', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.380', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.000', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:53,310][52650] Updated weights for policy 0, policy_version 21951 (0.0027) [2024-08-06 00:20:53,553][52647] DAMAGECOUNT value on done: 101321.0 [2024-08-06 00:20:53,553][52647] Sum rewards: 47.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.638', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.044', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.984', 'WEAPON3': '1.150', 'HITCOUNT': '2.410', 'weapon3': '2.576', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:54,359][52659] DAMAGECOUNT value on done: 97588.0 [2024-08-06 00:20:54,359][52659] Sum rewards: 39.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.194', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.076', 'AMMO3': '0.155', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.914', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.644', 'DAMAGECOUNT': '10.587', 'FRAGCOUNT': '34.000'} [2024-08-06 00:20:55,335][52665] DAMAGECOUNT value on done: 95220.0 [2024-08-06 00:20:55,337][52665] Sum rewards: 56.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.304', 'AMMO5': '0.018', 'ARMOR': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.195', 'AMMO4': '0.268', 'weapon5': '0.306', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.238', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '48.000'} [2024-08-06 00:20:55,853][52671] DAMAGECOUNT value on done: 98884.0 [2024-08-06 00:20:55,853][52671] Sum rewards: 53.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.618', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.241', 'weapon2': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.216', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '47.000'} [2024-08-06 00:20:56,027][52647] DAMAGECOUNT value on done: 104261.0 [2024-08-06 00:20:56,027][52647] Sum rewards: 52.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.272', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.114', 'AMMO3': '0.169', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.768', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '44.000'} [2024-08-06 00:20:56,132][52795] DAMAGECOUNT value on done: 93590.0 [2024-08-06 00:20:56,133][52795] Sum rewards: 44.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.864', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.238', 'weapon2': '0.402', 'WEAPON4': '0.450', 'weapon4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.508', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '38.500'} [2024-08-06 00:20:57,265][52659] DAMAGECOUNT value on done: 101222.0 [2024-08-06 00:20:57,267][52659] Sum rewards: 48.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.807', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.223', 'weapon4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.918', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '42.000'} [2024-08-06 00:20:57,366][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:20:57,794][52567] Fps is (10 sec: 16385.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 179888128. Throughput: 0: 4401.3. Samples: 44981860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:20:57,794][52567] Avg episode reward: [(0, '51.434')] [2024-08-06 00:20:58,315][52671] Large shaping reward -2.502 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.252, -84.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 00:20:58,359][52650] Updated weights for policy 0, policy_version 21961 (0.0013) [2024-08-06 00:20:58,522][52665] DAMAGECOUNT value on done: 96253.0 [2024-08-06 00:20:58,523][52665] Sum rewards: 53.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.437', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon4': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.410', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '46.000'} [2024-08-06 00:20:58,591][52647] DAMAGECOUNT value on done: 104932.0 [2024-08-06 00:20:58,591][52647] Sum rewards: 51.978, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.527', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.121', 'AMMO3': '0.143', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.796', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '43.000'} [2024-08-06 00:20:58,878][52614] Signal inference workers to stop experience collection... (4100 times) [2024-08-06 00:20:58,888][52614] Signal inference workers to resume experience collection... (4100 times) [2024-08-06 00:20:58,907][52671] DAMAGECOUNT value on done: 100147.0 [2024-08-06 00:20:58,908][52671] Sum rewards: 56.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.835', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.260', 'weapon2': '0.406', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.312', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '50.000'} [2024-08-06 00:20:58,926][52650] InferenceWorker_p0-w0: stopping experience collection (4100 times) [2024-08-06 00:20:58,933][52650] InferenceWorker_p0-w0: resuming experience collection (4100 times) [2024-08-06 00:20:59,505][52795] DAMAGECOUNT value on done: 92215.0 [2024-08-06 00:20:59,505][52795] Sum rewards: 45.680, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.532', 'WEAPON3': '1.450', 'HITCOUNT': '2.650', 'weapon3': '2.914', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '41.000'} [2024-08-06 00:21:00,308][52659] DAMAGECOUNT value on done: 98795.0 [2024-08-06 00:21:00,308][52659] Sum rewards: 38.890, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.012', 'weapon7': '0.046', 'WEAPON5': '0.050', 'AMMO2': '0.061', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.249', 'AMMO4': '0.303', 'weapon2': '0.484', 'weapon4': '0.628', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.536', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.721', 'FRAGCOUNT': '38.000'} [2024-08-06 00:21:01,590][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:21:01,688][52647] DAMAGECOUNT value on done: 101187.0 [2024-08-06 00:21:01,690][52647] Sum rewards: 47.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.125', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.022', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '40.000'} [2024-08-06 00:21:02,031][52671] DAMAGECOUNT value on done: 99395.0 [2024-08-06 00:21:02,031][52671] Sum rewards: 55.044, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.554', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.245', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'weapon4': '0.592', 'weapon2': '0.616', 'WEAPON3': '1.550', 'weapon3': '2.390', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '50.000'} [2024-08-06 00:21:02,530][52650] Updated weights for policy 0, policy_version 21971 (0.0026) [2024-08-06 00:21:02,612][52795] DAMAGECOUNT value on done: 95181.0 [2024-08-06 00:21:02,612][52795] Sum rewards: 53.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.379', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.138', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '2.980', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '45.500'} [2024-08-06 00:21:02,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 179986432. Throughput: 0: 4398.2. Samples: 44994900. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:02,795][52567] Avg episode reward: [(0, '51.033')] [2024-08-06 00:21:03,285][52659] DAMAGECOUNT value on done: 95389.0 [2024-08-06 00:21:03,287][52659] Sum rewards: 41.737, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.867', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon7': '0.144', 'AMMO3': '0.145', 'weapon4': '0.532', 'weapon2': '0.746', 'WEAPON3': '0.850', 'weapon3': '1.990', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '10.173', 'FRAGCOUNT': '35.000'} [2024-08-06 00:21:04,351][52647] DAMAGECOUNT value on done: 103817.0 [2024-08-06 00:21:04,353][52647] Sum rewards: 58.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.156', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.190', 'weapon4': '0.254', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.236', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '50.000'} [2024-08-06 00:21:05,051][52671] DAMAGECOUNT value on done: 98631.0 [2024-08-06 00:21:05,053][52671] Sum rewards: 54.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.604', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.380', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.640', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '46.000'} [2024-08-06 00:21:05,606][52795] DAMAGECOUNT value on done: 93768.0 [2024-08-06 00:21:05,607][52795] Sum rewards: 55.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.722', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.162', 'AMMO3': '0.214', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.044', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '49.000'} [2024-08-06 00:21:06,362][52659] DAMAGECOUNT value on done: 95709.0 [2024-08-06 00:21:06,362][52659] Sum rewards: 52.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.474', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.046', 'weapon4': '0.152', 'weapon5': '0.158', 'AMMO3': '0.214', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.030', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '47.000'} [2024-08-06 00:21:07,059][52647] DAMAGECOUNT value on done: 100907.0 [2024-08-06 00:21:07,059][52647] Sum rewards: 50.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.239', 'weapon2': '0.836', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '44.000'} [2024-08-06 00:21:07,446][52650] Updated weights for policy 0, policy_version 21981 (0.0011) [2024-08-06 00:21:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 180076544. Throughput: 0: 4398.4. Samples: 45021480. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:07,794][52567] Avg episode reward: [(0, '50.897')] [2024-08-06 00:21:08,707][52795] DAMAGECOUNT value on done: 89392.0 [2024-08-06 00:21:08,708][52795] Sum rewards: 43.009, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.779', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.227', 'weapon5': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '2.742', 'DAMAGECOUNT': '11.883', 'FRAGCOUNT': '40.000'} [2024-08-06 00:21:09,387][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:21:09,468][52659] DAMAGECOUNT value on done: 101120.0 [2024-08-06 00:21:09,469][52659] Sum rewards: 50.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.128', 'weapon4': '0.132', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '3.104', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '42.500'} [2024-08-06 00:21:09,548][52647] DAMAGECOUNT value on done: 103794.0 [2024-08-06 00:21:09,549][52647] Sum rewards: 44.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.796', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.088', 'AMMO3': '0.163', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon4': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '2.788', 'DAMAGECOUNT': '11.082', 'FRAGCOUNT': '39.000'} [2024-08-06 00:21:09,887][52662] Large shaping reward 2.711 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:21:11,805][52795] DAMAGECOUNT value on done: 94656.0 [2024-08-06 00:21:11,806][52795] Sum rewards: 64.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.120', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 00:21:12,235][52650] Updated weights for policy 0, policy_version 21991 (0.0013) [2024-08-06 00:21:12,462][52659] DAMAGECOUNT value on done: 100184.0 [2024-08-06 00:21:12,488][52659] Sum rewards: 53.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.500', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.139', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.410', 'weapon4': '0.444', 'WEAPON3': '1.650', 'weapon3': '2.798', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '47.000'} [2024-08-06 00:21:12,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 180158464. Throughput: 0: 4401.6. Samples: 45048170. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:12,794][52567] Avg episode reward: [(0, '51.095')] [2024-08-06 00:21:14,847][52795] DAMAGECOUNT value on done: 94348.0 [2024-08-06 00:21:14,847][52795] Sum rewards: 48.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.508', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.138', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.380', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.042', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '43.000'} [2024-08-06 00:21:15,727][52659] DAMAGECOUNT value on done: 104215.0 [2024-08-06 00:21:15,728][52659] Sum rewards: 35.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.274', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.096', 'weapon4': '0.144', 'AMMO3': '0.154', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon2': '1.018', 'HITCOUNT': '2.100', 'weapon3': '2.526', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '31.000'} [2024-08-06 00:21:16,631][52650] Updated weights for policy 0, policy_version 22001 (0.0015) [2024-08-06 00:21:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 180248576. Throughput: 0: 4408.0. Samples: 45061320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:17,794][52567] Avg episode reward: [(0, '51.029')] [2024-08-06 00:21:17,993][52795] DAMAGECOUNT value on done: 90952.0 [2024-08-06 00:21:17,993][52795] Sum rewards: 65.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.852', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.434', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '57.000'} [2024-08-06 00:21:18,722][52659] DAMAGECOUNT value on done: 100014.0 [2024-08-06 00:21:18,723][52659] Sum rewards: 70.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.667', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.182', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '60.000'} [2024-08-06 00:21:19,422][52820] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:21:21,075][52795] DAMAGECOUNT value on done: 93025.0 [2024-08-06 00:21:21,075][52795] Sum rewards: 54.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.297', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.012', 'weapon5': '0.046', 'AMMO4': '0.047', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.498', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.124', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '47.000'} [2024-08-06 00:21:21,339][52650] Updated weights for policy 0, policy_version 22011 (0.0031) [2024-08-06 00:21:21,785][52659] DAMAGECOUNT value on done: 99600.0 [2024-08-06 00:21:21,786][52659] Sum rewards: 64.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.189', 'weapon2': '0.236', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.258', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '52.000'} [2024-08-06 00:21:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 180330496. Throughput: 0: 4402.4. Samples: 45087600. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:22,802][52567] Avg episode reward: [(0, '51.542')] [2024-08-06 00:21:24,238][52795] DAMAGECOUNT value on done: 92372.0 [2024-08-06 00:21:24,239][52795] Sum rewards: 61.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.058', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.148', 'weapon2': '0.512', 'WEAPON3': '1.000', 'HITCOUNT': '3.160', 'weapon3': '3.168', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '49.000'} [2024-08-06 00:21:24,663][52659] DAMAGECOUNT value on done: 102624.0 [2024-08-06 00:21:24,665][52659] Sum rewards: 45.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.560', 'weapon3': '3.212', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '40.000'} [2024-08-06 00:21:26,121][52650] Updated weights for policy 0, policy_version 22021 (0.0028) [2024-08-06 00:21:27,283][52659] DAMAGECOUNT value on done: 101440.0 [2024-08-06 00:21:27,283][52659] Sum rewards: 57.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.220', 'weapon2': '0.344', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.378', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '50.000'} [2024-08-06 00:21:27,391][52795] DAMAGECOUNT value on done: 89670.0 [2024-08-06 00:21:27,391][52795] Sum rewards: 46.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.825', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'AMMO4': '0.197', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.832', 'DAMAGECOUNT': '11.688', 'FRAGCOUNT': '41.000'} [2024-08-06 00:21:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 180428800. Throughput: 0: 4400.9. Samples: 45113980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:27,802][52567] Avg episode reward: [(0, '51.516')] [2024-08-06 00:21:28,704][52662] DAMAGECOUNT value on done: 104523.0 [2024-08-06 00:21:28,709][52662] Sum rewards: 56.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.002', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.238', 'weapon5': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.450', 'weapon4': '0.478', 'WEAPON3': '1.500', 'weapon3': '2.644', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '49.000'} [2024-08-06 00:21:30,531][52795] DAMAGECOUNT value on done: 93981.0 [2024-08-06 00:21:30,531][52795] Sum rewards: 56.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.950', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'weapon4': '0.154', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.324', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '48.000'} [2024-08-06 00:21:30,599][52650] Updated weights for policy 0, policy_version 22031 (0.0011) [2024-08-06 00:21:31,719][52662] DAMAGECOUNT value on done: 107708.0 [2024-08-06 00:21:31,721][52662] Sum rewards: 51.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.883', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '46.000'} [2024-08-06 00:21:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 180510720. Throughput: 0: 4410.3. Samples: 45127320. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:21:32,794][52567] Avg episode reward: [(0, '51.615')] [2024-08-06 00:21:33,714][52795] DAMAGECOUNT value on done: 95672.0 [2024-08-06 00:21:33,715][52795] Sum rewards: 45.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.918', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.556', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.754', 'DAMAGECOUNT': '12.936', 'FRAGCOUNT': '41.500'} [2024-08-06 00:21:34,983][52662] DAMAGECOUNT value on done: 110335.0 [2024-08-06 00:21:34,984][52662] Sum rewards: 62.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.840', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.446', 'WEAPON3': '0.950', 'weapon3': '3.164', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '48.000'} [2024-08-06 00:21:35,423][52650] Updated weights for policy 0, policy_version 22041 (0.0013) [2024-08-06 00:21:36,854][52795] DAMAGECOUNT value on done: 90473.0 [2024-08-06 00:21:36,856][52795] Sum rewards: 69.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.190', 'AMMO3': '0.192', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '56.000'} [2024-08-06 00:21:37,662][52668] DAMAGECOUNT value on done: 99354.0 [2024-08-06 00:21:37,663][52668] Sum rewards: 59.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.852', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO3': '0.188', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '49.000'} [2024-08-06 00:21:37,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17749.2, 300 sec: 17633.6). Total num frames: 180600832. Throughput: 0: 4407.1. Samples: 45153610. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:21:37,802][52567] Avg episode reward: [(0, '51.804')] [2024-08-06 00:21:37,866][52662] DAMAGECOUNT value on done: 98873.0 [2024-08-06 00:21:37,867][52662] Sum rewards: 60.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.669', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.292', 'weapon4': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '52.000'} [2024-08-06 00:21:38,580][52794] DAMAGECOUNT value on done: 108932.0 [2024-08-06 00:21:38,582][52794] Sum rewards: 56.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.892', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '49.000'} [2024-08-06 00:21:38,852][52670] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 00:21:39,733][52650] Updated weights for policy 0, policy_version 22051 (0.0032) [2024-08-06 00:21:40,017][52795] DAMAGECOUNT value on done: 94187.0 [2024-08-06 00:21:40,017][52795] Sum rewards: 52.335, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.156', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.254', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.390', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '48.000'} [2024-08-06 00:21:40,225][52662] DAMAGECOUNT value on done: 104727.0 [2024-08-06 00:21:40,229][52662] Sum rewards: 67.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.367', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '56.000'} [2024-08-06 00:21:40,712][52668] DAMAGECOUNT value on done: 104733.0 [2024-08-06 00:21:40,714][52668] Sum rewards: 49.316, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.338', 'AMMO5': '0.011', 'weapon5': '0.072', 'AMMO2': '0.074', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'AMMO4': '0.372', 'weapon2': '0.414', 'weapon4': '0.688', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.554', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '43.000'} [2024-08-06 00:21:41,151][52794] DAMAGECOUNT value on done: 105453.0 [2024-08-06 00:21:41,153][52794] Sum rewards: 61.684, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.020', 'weapon4': '0.042', 'AMMO4': '0.084', 'weapon5': '0.144', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.224', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '52.000'} [2024-08-06 00:21:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 180690944. Throughput: 0: 4408.9. Samples: 45180260. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:21:42,794][52567] Avg episode reward: [(0, '52.475')] [2024-08-06 00:21:42,921][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:21:43,017][52795] DAMAGECOUNT value on done: 97051.0 [2024-08-06 00:21:43,017][52795] Sum rewards: 55.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.802', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.151', 'weapon5': '0.172', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.570', 'weapon4': '0.708', 'WEAPON3': '0.900', 'weapon3': '2.348', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '46.000'} [2024-08-06 00:21:43,292][52662] DAMAGECOUNT value on done: 106453.0 [2024-08-06 00:21:43,293][52662] Sum rewards: 51.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'weapon4': '0.440', 'weapon2': '0.456', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '43.500'} [2024-08-06 00:21:43,690][52668] DAMAGECOUNT value on done: 100125.0 [2024-08-06 00:21:43,692][52668] Sum rewards: 66.777, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.772', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.225', 'AMMO3': '0.238', 'weapon2': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '57.000'} [2024-08-06 00:21:43,876][52820] Large shaping reward 2.522 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:21:44,429][52794] DAMAGECOUNT value on done: 102091.0 [2024-08-06 00:21:44,435][52794] Sum rewards: 58.511, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'HEALTH': '0.144', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon2': '0.388', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.872', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '49.000'} [2024-08-06 00:21:44,690][52650] Updated weights for policy 0, policy_version 22061 (0.0012) [2024-08-06 00:21:46,281][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:21:46,494][52662] DAMAGECOUNT value on done: 107291.0 [2024-08-06 00:21:46,497][52662] Sum rewards: 57.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.533', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.148', 'AMMO3': '0.193', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '48.000'} [2024-08-06 00:21:46,661][52668] DAMAGECOUNT value on done: 100895.0 [2024-08-06 00:21:46,663][52668] Sum rewards: 50.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.070', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.246', 'weapon4': '0.278', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '2.922', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '46.000'} [2024-08-06 00:21:47,386][52794] DAMAGECOUNT value on done: 100248.0 [2024-08-06 00:21:47,387][52794] Sum rewards: 39.780, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.064', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.036', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.294', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.460', 'weapon3': '3.082', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '37.000'} [2024-08-06 00:21:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17633.6). Total num frames: 180781056. Throughput: 0: 4416.0. Samples: 45193620. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:47,795][52567] Avg episode reward: [(0, '52.265')] [2024-08-06 00:21:49,350][52662] DAMAGECOUNT value on done: 111151.0 [2024-08-06 00:21:49,353][52662] Sum rewards: 61.814, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.914', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.170', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.322', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.650', 'weapon3': '2.788', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '55.000'} [2024-08-06 00:21:49,356][52650] Updated weights for policy 0, policy_version 22071 (0.0032) [2024-08-06 00:21:49,357][52668] DAMAGECOUNT value on done: 101973.0 [2024-08-06 00:21:49,358][52668] Sum rewards: 46.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.116', 'AMMO5': '0.003', 'weapon5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.178', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.414', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '3.158', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '42.500'} [2024-08-06 00:21:49,712][52660] DAMAGECOUNT value on done: 97675.0 [2024-08-06 00:21:49,713][52660] Sum rewards: 48.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.569', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.188', 'weapon2': '0.260', 'weapon4': '0.264', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.340', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '42.000'} [2024-08-06 00:21:50,424][52794] DAMAGECOUNT value on done: 103389.0 [2024-08-06 00:21:50,426][52794] Sum rewards: 52.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.201', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.362', 'weapon4': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '46.000'} [2024-08-06 00:21:51,851][52668] DAMAGECOUNT value on done: 99548.0 [2024-08-06 00:21:51,852][52668] Sum rewards: 44.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.052', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.456', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '2.912', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '41.000'} [2024-08-06 00:21:52,111][52662] DAMAGECOUNT value on done: 104302.0 [2024-08-06 00:21:52,112][52662] Sum rewards: 58.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.204', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.538', 'weapon4': '0.648', 'WEAPON3': '1.250', 'weapon3': '2.464', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '50.000'} [2024-08-06 00:21:52,230][52660] DAMAGECOUNT value on done: 100319.0 [2024-08-06 00:21:52,230][52660] Sum rewards: 48.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.044', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.438', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.714', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '43.000'} [2024-08-06 00:21:52,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 180862976. Throughput: 0: 4412.9. Samples: 45220060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:52,802][52567] Avg episode reward: [(0, '52.312')] [2024-08-06 00:21:53,303][52794] DAMAGECOUNT value on done: 105949.0 [2024-08-06 00:21:53,304][52794] Sum rewards: 50.996, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.335', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.081', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.258', 'weapon4': '0.346', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.154', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '46.000'} [2024-08-06 00:21:53,935][52650] Updated weights for policy 0, policy_version 22081 (0.0015) [2024-08-06 00:21:54,305][52668] DAMAGECOUNT value on done: 102687.0 [2024-08-06 00:21:54,307][52668] Sum rewards: 55.171, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.440', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.287', 'weapon2': '0.360', 'WEAPON3': '1.750', 'HITCOUNT': '3.140', 'weapon3': '3.322', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '51.000'} [2024-08-06 00:21:54,753][52660] DAMAGECOUNT value on done: 101770.0 [2024-08-06 00:21:54,754][52660] Sum rewards: 64.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.018', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.156', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '0.950', 'weapon3': '3.216', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '51.000'} [2024-08-06 00:21:55,304][52662] DAMAGECOUNT value on done: 107892.0 [2024-08-06 00:21:55,304][52662] Sum rewards: 55.694, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.375', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon7': '0.082', 'AMMO4': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.128', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.526', 'weapon4': '0.586', 'WEAPON3': '0.900', 'weapon3': '2.506', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '45.000'} [2024-08-06 00:21:56,135][52794] DAMAGECOUNT value on done: 108918.0 [2024-08-06 00:21:56,137][52794] Sum rewards: 51.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.142', 'weapon5': '0.144', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.520', 'weapon4': '0.692', 'WEAPON3': '0.850', 'weapon3': '2.470', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '41.000'} [2024-08-06 00:21:57,017][52668] DAMAGECOUNT value on done: 103304.0 [2024-08-06 00:21:57,018][52668] Sum rewards: 48.403, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.292', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.272', 'weapon2': '0.594', 'WEAPON3': '1.650', 'weapon3': '3.124', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '45.000'} [2024-08-06 00:21:57,460][52660] DAMAGECOUNT value on done: 101595.0 [2024-08-06 00:21:57,461][52660] Sum rewards: 54.685, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.991', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.124', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.466', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon3': '2.476', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '43.000'} [2024-08-06 00:21:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 180953088. Throughput: 0: 4407.3. Samples: 45246500. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:21:57,795][52567] Avg episode reward: [(0, '52.437')] [2024-08-06 00:21:57,847][52662] DAMAGECOUNT value on done: 105078.0 [2024-08-06 00:21:57,848][52662] Sum rewards: 59.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '52.000'} [2024-08-06 00:21:57,933][52669] DAMAGECOUNT value on done: 105816.0 [2024-08-06 00:21:57,934][52669] Sum rewards: 70.224, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.500', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.106', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.940', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '56.000'} [2024-08-06 00:21:58,414][52650] Updated weights for policy 0, policy_version 22091 (0.0027) [2024-08-06 00:21:58,810][52794] DAMAGECOUNT value on done: 104717.0 [2024-08-06 00:21:58,823][52794] Sum rewards: 45.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.141', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.416', 'WEAPON3': '0.800', 'HITCOUNT': '2.440', 'weapon3': '2.876', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '36.500'} [2024-08-06 00:21:59,279][52649] DAMAGECOUNT value on done: 99335.0 [2024-08-06 00:21:59,279][52649] Sum rewards: 55.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.525', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:00,287][52668] DAMAGECOUNT value on done: 101788.0 [2024-08-06 00:22:00,290][52668] Sum rewards: 52.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.203', 'AMMO5': '0.012', 'weapon5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.210', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:00,570][52662] DAMAGECOUNT value on done: 107823.0 [2024-08-06 00:22:00,571][52662] Sum rewards: 47.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.470', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '2.994', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:00,725][52660] DAMAGECOUNT value on done: 97534.0 [2024-08-06 00:22:00,726][52660] Sum rewards: 51.875, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.275', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.157', 'weapon2': '0.298', 'WEAPON3': '0.950', 'HITCOUNT': '2.920', 'weapon3': '3.598', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '41.000'} [2024-08-06 00:22:00,779][52820] DAMAGECOUNT value on done: 91436.0 [2024-08-06 00:22:00,779][52820] Sum rewards: 53.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.858', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:01,196][52669] DAMAGECOUNT value on done: 101627.0 [2024-08-06 00:22:01,196][52669] Sum rewards: 56.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:01,603][52794] DAMAGECOUNT value on done: 105523.0 [2024-08-06 00:22:01,604][52794] Sum rewards: 62.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.797', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon2': '0.448', 'weapon4': '0.602', 'WEAPON3': '0.950', 'weapon3': '2.634', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '52.000'} [2024-08-06 00:22:02,106][52667] DAMAGECOUNT value on done: 102410.0 [2024-08-06 00:22:02,108][52667] Sum rewards: 56.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.142', 'AMMO3': '0.180', 'AMMO4': '0.201', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:02,402][52649] DAMAGECOUNT value on done: 96369.0 [2024-08-06 00:22:02,404][52649] Sum rewards: 46.178, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.711', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.174', 'AMMO3': '0.176', 'AMMO4': '0.191', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.622', 'weapon2': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.124', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '41.500'} [2024-08-06 00:22:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 181043200. Throughput: 0: 4409.1. Samples: 45259730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:22:02,795][52567] Avg episode reward: [(0, '53.152')] [2024-08-06 00:22:02,795][52614] Saving new best policy, reward=53.152! [2024-08-06 00:22:03,407][52650] Updated weights for policy 0, policy_version 22101 (0.0015) [2024-08-06 00:22:03,491][52668] DAMAGECOUNT value on done: 103334.0 [2024-08-06 00:22:03,491][52668] Sum rewards: 52.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.355', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO4': '0.194', 'AMMO3': '0.214', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.820', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:03,847][52662] DAMAGECOUNT value on done: 104162.0 [2024-08-06 00:22:03,848][52662] Sum rewards: 42.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.830', 'AMMO5': '0.008', 'ARMOR': '0.020', 'weapon5': '0.028', 'AMMO2': '0.046', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.126', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '41.000'} [2024-08-06 00:22:03,851][52669] DAMAGECOUNT value on done: 100134.0 [2024-08-06 00:22:03,853][52669] Sum rewards: 57.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.072', 'AMMO5': '0.019', 'ARMOR': '0.028', 'AMMO2': '0.058', 'weapon5': '0.114', 'AMMO3': '0.187', 'AMMO4': '0.290', 'weapon4': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.788', 'WEAPON3': '1.150', 'weapon3': '2.420', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:03,976][52660] DAMAGECOUNT value on done: 99186.0 [2024-08-06 00:22:03,977][52660] Sum rewards: 56.476, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.082', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.106', 'AMMO3': '0.146', 'weapon4': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '2.992', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:04,055][52820] DAMAGECOUNT value on done: 93935.0 [2024-08-06 00:22:04,055][52820] Sum rewards: 48.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.184', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.534', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:04,865][52794] DAMAGECOUNT value on done: 109271.0 [2024-08-06 00:22:04,866][52794] Sum rewards: 58.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.164', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.019', 'ARMOR': '0.028', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.326', 'weapon2': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.958', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:05,223][52667] DAMAGECOUNT value on done: 103330.0 [2024-08-06 00:22:05,225][52667] Sum rewards: 47.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.336', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.136', 'AMMO3': '0.199', 'weapon2': '0.608', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.066', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '40.000'} [2024-08-06 00:22:05,603][52649] DAMAGECOUNT value on done: 100313.0 [2024-08-06 00:22:05,603][52649] Sum rewards: 61.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon4': '0.230', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:06,129][52668] DAMAGECOUNT value on done: 99337.0 [2024-08-06 00:22:06,130][52668] Sum rewards: 54.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.309', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.012', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'weapon4': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.094', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:06,474][52660] DAMAGECOUNT value on done: 102323.0 [2024-08-06 00:22:06,476][52660] Sum rewards: 64.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.053', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon5': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.764', 'WEAPON3': '1.050', 'weapon3': '2.358', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:06,627][52662] DAMAGECOUNT value on done: 103774.0 [2024-08-06 00:22:06,628][52662] Sum rewards: 67.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.362', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '59.000'} [2024-08-06 00:22:06,758][52669] DAMAGECOUNT value on done: 100320.0 [2024-08-06 00:22:06,759][52669] Sum rewards: 54.493, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.293', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.032', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.910', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:07,264][52820] DAMAGECOUNT value on done: 91461.0 [2024-08-06 00:22:07,268][52820] Sum rewards: 55.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.494', 'weapon4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:07,767][52650] Updated weights for policy 0, policy_version 22111 (0.0034) [2024-08-06 00:22:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 181133312. Throughput: 0: 4398.4. Samples: 45285530. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:22:07,794][52567] Avg episode reward: [(0, '53.952')] [2024-08-06 00:22:07,797][52614] Saving new best policy, reward=53.952! [2024-08-06 00:22:07,821][52794] DAMAGECOUNT value on done: 103074.0 [2024-08-06 00:22:07,823][52794] Sum rewards: 42.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.574', 'WEAPON3': '1.050', 'HITCOUNT': '2.570', 'weapon3': '2.786', 'DAMAGECOUNT': '11.622', 'FRAGCOUNT': '36.000'} [2024-08-06 00:22:08,330][52649] DAMAGECOUNT value on done: 101497.0 [2024-08-06 00:22:08,330][52649] Sum rewards: 49.396, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.703', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.160', 'AMMO3': '0.190', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON4': '0.450', 'weapon4': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.636', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:08,368][52667] DAMAGECOUNT value on done: 102602.0 [2024-08-06 00:22:08,368][52667] Sum rewards: 50.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.366', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon5': '0.212', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'weapon2': '0.380', 'weapon4': '0.426', 'WEAPON3': '1.450', 'weapon3': '2.732', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:08,610][52668] DAMAGECOUNT value on done: 98976.0 [2024-08-06 00:22:08,611][52668] Sum rewards: 46.221, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.906', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO3': '0.148', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.496', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '2.822', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '41.500'} [2024-08-06 00:22:09,132][52660] DAMAGECOUNT value on done: 101123.0 [2024-08-06 00:22:09,133][52660] Sum rewards: 60.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.490', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.058', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.332', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.300', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '50.000'} [2024-08-06 00:22:09,391][52662] DAMAGECOUNT value on done: 102807.0 [2024-08-06 00:22:09,392][52662] Sum rewards: 62.861, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.520', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.360', 'weapon2': '0.788', 'WEAPON3': '0.800', 'weapon3': '2.744', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:09,930][52669] DAMAGECOUNT value on done: 102182.0 [2024-08-06 00:22:09,930][52669] Sum rewards: 50.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.002', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'weapon2': '0.572', 'weapon4': '0.574', 'WEAPON3': '1.450', 'weapon3': '2.580', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:10,293][52794] DAMAGECOUNT value on done: 106893.0 [2024-08-06 00:22:10,295][52794] Sum rewards: 58.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.503', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.256', 'weapon4': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.246', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:10,496][52820] DAMAGECOUNT value on done: 88834.0 [2024-08-06 00:22:10,496][52820] Sum rewards: 56.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.693', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.154', 'weapon5': '0.186', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON4': '0.550', 'weapon4': '0.562', 'WEAPON3': '0.950', 'weapon3': '2.510', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:11,214][52649] DAMAGECOUNT value on done: 94987.0 [2024-08-06 00:22:11,215][52649] Sum rewards: 57.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'ARMOR': '0.005', 'AMMO2': '0.039', 'AMMO3': '0.194', 'AMMO4': '0.195', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:11,394][52667] DAMAGECOUNT value on done: 99325.0 [2024-08-06 00:22:11,395][52667] Sum rewards: 60.454, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.203', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon4': '0.222', 'weapon2': '0.666', 'WEAPON3': '1.100', 'weapon3': '2.972', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:11,472][52668] DAMAGECOUNT value on done: 93699.0 [2024-08-06 00:22:11,473][52668] Sum rewards: 40.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.072', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.204', 'AMMO3': '0.211', 'weapon4': '0.336', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.480', 'weapon3': '2.814', 'DAMAGECOUNT': '10.938', 'FRAGCOUNT': '37.000'} [2024-08-06 00:22:11,880][52660] DAMAGECOUNT value on done: 101919.0 [2024-08-06 00:22:11,882][52660] Sum rewards: 42.189, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.073', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'AMMO4': '0.367', 'weapon4': '0.482', 'weapon2': '0.562', 'WEAPON4': '0.800', 'WEAPON3': '1.400', 'weapon3': '2.576', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '39.500'} [2024-08-06 00:22:11,971][52662] DAMAGECOUNT value on done: 109491.0 [2024-08-06 00:22:11,972][52662] Sum rewards: 52.376, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.172', 'weapon2': '0.596', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.218', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:12,687][52650] Updated weights for policy 0, policy_version 22121 (0.0019) [2024-08-06 00:22:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 181215232. Throughput: 0: 4394.4. Samples: 45311730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:22:12,795][52567] Avg episode reward: [(0, '53.993')] [2024-08-06 00:22:12,800][52669] DAMAGECOUNT value on done: 101672.0 [2024-08-06 00:22:12,801][52669] Sum rewards: 53.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.249', 'weapon2': '0.318', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.408', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:12,808][52614] Saving new best policy, reward=53.993! [2024-08-06 00:22:13,066][52794] DAMAGECOUNT value on done: 105372.0 [2024-08-06 00:22:13,067][52794] Sum rewards: 51.593, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.298', 'weapon2': '0.430', 'WEAPON3': '1.850', 'weapon3': '3.216', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:13,526][52820] DAMAGECOUNT value on done: 92801.0 [2024-08-06 00:22:13,530][52820] Sum rewards: 58.443, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon5': '0.060', 'AMMO4': '0.112', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.460', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '47.500'} [2024-08-06 00:22:14,313][52667] DAMAGECOUNT value on done: 103526.0 [2024-08-06 00:22:14,313][52667] Sum rewards: 52.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.832', 'AMMO5': '0.005', 'ARMOR': '0.029', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.174', 'weapon4': '0.218', 'weapon2': '0.814', 'WEAPON3': '1.150', 'weapon3': '2.604', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '44.000'} [2024-08-06 00:22:14,359][52668] DAMAGECOUNT value on done: 102000.0 [2024-08-06 00:22:14,361][52668] Sum rewards: 59.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.915', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.279', 'weapon2': '0.352', 'WEAPON3': '1.800', 'weapon3': '3.172', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '54.000'} [2024-08-06 00:22:14,440][52649] DAMAGECOUNT value on done: 97267.0 [2024-08-06 00:22:14,440][52649] Sum rewards: 48.620, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.476', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.266', 'weapon2': '0.368', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:14,531][52662] DAMAGECOUNT value on done: 100243.0 [2024-08-06 00:22:14,531][52662] Sum rewards: 37.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.145', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.090', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.231', 'WEAPON4': '0.500', 'weapon2': '0.716', 'WEAPON3': '1.500', 'HITCOUNT': '2.450', 'weapon3': '2.816', 'DAMAGECOUNT': '10.272', 'FRAGCOUNT': '36.000'} [2024-08-06 00:22:14,854][52660] DAMAGECOUNT value on done: 100602.0 [2024-08-06 00:22:14,854][52660] Sum rewards: 55.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.761', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.020', 'weapon5': '0.048', 'AMMO4': '0.085', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.350', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:15,651][52794] DAMAGECOUNT value on done: 111534.0 [2024-08-06 00:22:15,655][52794] Sum rewards: 51.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.474', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.046', 'AMMO2': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.276', 'WEAPON4': '0.500', 'weapon4': '0.542', 'weapon2': '0.846', 'WEAPON3': '1.150', 'weapon3': '2.426', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:16,088][52669] DAMAGECOUNT value on done: 102197.0 [2024-08-06 00:22:16,091][52669] Sum rewards: 48.405, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.189', 'weapon5': '0.266', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'weapon4': '0.416', 'weapon2': '0.432', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:16,546][52820] DAMAGECOUNT value on done: 94069.0 [2024-08-06 00:22:16,550][52820] Sum rewards: 59.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.879', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.146', 'AMMO3': '0.193', 'weapon2': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:16,828][52667] DAMAGECOUNT value on done: 99915.0 [2024-08-06 00:22:16,828][52667] Sum rewards: 38.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.094', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.155', 'AMMO3': '0.184', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '0.578', 'WEAPON3': '1.150', 'HITCOUNT': '2.440', 'weapon3': '2.748', 'DAMAGECOUNT': '10.905', 'FRAGCOUNT': '34.000'} [2024-08-06 00:22:17,242][52662] DAMAGECOUNT value on done: 107929.0 [2024-08-06 00:22:17,244][52662] Sum rewards: 51.190, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.497', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.059', 'WEAPON5': '0.100', 'weapon5': '0.148', 'AMMO3': '0.253', 'AMMO4': '0.295', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.634', 'WEAPON3': '1.450', 'weapon3': '2.596', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:17,262][52668] DAMAGECOUNT value on done: 101533.0 [2024-08-06 00:22:17,263][52668] Sum rewards: 46.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.352', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO2': '0.051', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'AMMO4': '0.254', 'WEAPON4': '0.550', 'weapon2': '0.618', 'weapon4': '0.770', 'WEAPON3': '1.200', 'weapon3': '2.242', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:17,517][52650] Updated weights for policy 0, policy_version 22131 (0.0017) [2024-08-06 00:22:17,622][52660] DAMAGECOUNT value on done: 101461.0 [2024-08-06 00:22:17,623][52660] Sum rewards: 46.864, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.257', 'weapon2': '0.558', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.140', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:17,644][52649] DAMAGECOUNT value on done: 94294.0 [2024-08-06 00:22:17,644][52649] Sum rewards: 50.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.542', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.220', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '44.000'} [2024-08-06 00:22:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 181297152. Throughput: 0: 4386.9. Samples: 45324730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:22:17,794][52567] Avg episode reward: [(0, '53.941')] [2024-08-06 00:22:18,175][52794] DAMAGECOUNT value on done: 101861.0 [2024-08-06 00:22:18,183][52794] Sum rewards: 69.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.688', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '58.000'} [2024-08-06 00:22:19,137][52669] DAMAGECOUNT value on done: 102583.0 [2024-08-06 00:22:19,137][52669] Sum rewards: 60.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.134', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.072', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.330', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.318', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:19,693][52667] DAMAGECOUNT value on done: 102374.0 [2024-08-06 00:22:19,693][52667] Sum rewards: 47.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.156', 'AMMO4': '0.177', 'weapon5': '0.220', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON4': '0.600', 'weapon4': '0.702', 'WEAPON3': '0.850', 'weapon3': '2.096', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '39.000'} [2024-08-06 00:22:19,804][52820] DAMAGECOUNT value on done: 94446.0 [2024-08-06 00:22:19,808][52820] Sum rewards: 62.657, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.566', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.122', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.304', 'weapon2': '0.766', 'WEAPON3': '0.800', 'weapon3': '2.628', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:20,125][52662] DAMAGECOUNT value on done: 104344.0 [2024-08-06 00:22:20,125][52662] Sum rewards: 43.417, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.294', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.022', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.144', 'AMMO3': '0.150', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon2': '1.028', 'HITCOUNT': '2.560', 'weapon3': '2.730', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '36.000'} [2024-08-06 00:22:20,143][52668] DAMAGECOUNT value on done: 102163.0 [2024-08-06 00:22:20,145][52668] Sum rewards: 43.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.932', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.048', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.654', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '3.046', 'DAMAGECOUNT': '11.553', 'FRAGCOUNT': '40.000'} [2024-08-06 00:22:20,449][52660] DAMAGECOUNT value on done: 97947.0 [2024-08-06 00:22:20,450][52660] Sum rewards: 53.777, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.978', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.408', 'WEAPON3': '1.700', 'HITCOUNT': '2.930', 'weapon3': '3.164', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '50.000'} [2024-08-06 00:22:20,791][52649] DAMAGECOUNT value on done: 101900.0 [2024-08-06 00:22:20,794][52649] Sum rewards: 55.057, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.902', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.762', 'WEAPON3': '1.000', 'weapon3': '2.906', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:21,267][52794] DAMAGECOUNT value on done: 107374.0 [2024-08-06 00:22:21,269][52794] Sum rewards: 41.690, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.456', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.040', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.290', 'weapon4': '0.344', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.846', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:22,075][52650] Updated weights for policy 0, policy_version 22141 (0.0035) [2024-08-06 00:22:22,332][52669] DAMAGECOUNT value on done: 102090.0 [2024-08-06 00:22:22,333][52669] Sum rewards: 59.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.041', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.211', 'weapon2': '0.396', 'WEAPON4': '0.500', 'weapon4': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17633.6). Total num frames: 181395456. Throughput: 0: 4388.3. Samples: 45351080. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:22:22,795][52567] Avg episode reward: [(0, '53.760')] [2024-08-06 00:22:22,795][52667] DAMAGECOUNT value on done: 103335.0 [2024-08-06 00:22:22,799][52667] Sum rewards: 40.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.582', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.115', 'weapon4': '0.132', 'AMMO3': '0.241', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.322', 'DAMAGECOUNT': '11.277', 'FRAGCOUNT': '37.000'} [2024-08-06 00:22:23,001][52820] DAMAGECOUNT value on done: 94457.0 [2024-08-06 00:22:23,003][52820] Sum rewards: 54.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.714', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.154', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.402', 'weapon2': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.512', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:23,042][52668] DAMAGECOUNT value on done: 98780.0 [2024-08-06 00:22:23,043][52668] Sum rewards: 48.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'ARMOR': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.164', 'AMMO4': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.558', 'weapon4': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '40.000'} [2024-08-06 00:22:23,261][52662] DAMAGECOUNT value on done: 103700.0 [2024-08-06 00:22:23,271][52662] Sum rewards: 49.955, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.939', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.279', 'weapon2': '0.292', 'WEAPON3': '1.700', 'HITCOUNT': '2.580', 'weapon3': '3.276', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:23,545][52660] DAMAGECOUNT value on done: 99700.0 [2024-08-06 00:22:23,546][52660] Sum rewards: 63.105, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.298', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.230', 'weapon2': '0.574', 'WEAPON3': '1.000', 'weapon3': '3.008', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:24,039][52649] DAMAGECOUNT value on done: 96617.0 [2024-08-06 00:22:24,040][52649] Sum rewards: 55.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.706', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon5': '0.156', 'AMMO3': '0.200', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.402', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '48.500'} [2024-08-06 00:22:24,411][52794] DAMAGECOUNT value on done: 106555.0 [2024-08-06 00:22:24,411][52794] Sum rewards: 43.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.468', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.146', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.348', 'weapon2': '0.656', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '37.500'} [2024-08-06 00:22:24,653][52647] Large shaping reward 3.569 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2024-08-06 00:22:24,941][52669] DAMAGECOUNT value on done: 99776.0 [2024-08-06 00:22:24,941][52669] Sum rewards: 64.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '54.000'} [2024-08-06 00:22:25,872][52667] DAMAGECOUNT value on done: 103182.0 [2024-08-06 00:22:25,875][52667] Sum rewards: 61.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.203', 'weapon4': '0.290', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:25,989][52668] DAMAGECOUNT value on done: 100249.0 [2024-08-06 00:22:25,990][52668] Sum rewards: 51.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.165', 'weapon5': '0.180', 'AMMO4': '0.196', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.690', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '44.000'} [2024-08-06 00:22:26,098][52820] DAMAGECOUNT value on done: 91657.0 [2024-08-06 00:22:26,101][52820] Sum rewards: 48.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.332', 'ARMOR': '0.008', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.462', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '2.998', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:26,262][52660] DAMAGECOUNT value on done: 101859.0 [2024-08-06 00:22:26,263][52660] Sum rewards: 62.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.065', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.216', 'weapon2': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.152', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '54.000'} [2024-08-06 00:22:26,808][52650] Updated weights for policy 0, policy_version 22151 (0.0020) [2024-08-06 00:22:26,860][52649] DAMAGECOUNT value on done: 98822.0 [2024-08-06 00:22:26,861][52649] Sum rewards: 55.679, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.205', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.165', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.468', 'WEAPON3': '0.850', 'HITCOUNT': '2.890', 'weapon3': '2.984', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '44.000'} [2024-08-06 00:22:27,373][52794] DAMAGECOUNT value on done: 105797.0 [2024-08-06 00:22:27,378][52794] Sum rewards: 64.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.560', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.078', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.154', 'weapon2': '0.692', 'WEAPON3': '0.950', 'weapon3': '2.948', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 181477376. Throughput: 0: 4384.2. Samples: 45377550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:22:27,794][52567] Avg episode reward: [(0, '53.426')] [2024-08-06 00:22:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022153_181477376.pth... [2024-08-06 00:22:27,945][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021638_177258496.pth [2024-08-06 00:22:28,104][52669] DAMAGECOUNT value on done: 104748.0 [2024-08-06 00:22:28,105][52669] Sum rewards: 51.718, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.565', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.204', 'WEAPON4': '0.500', 'weapon4': '0.508', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:28,738][52668] DAMAGECOUNT value on done: 104005.0 [2024-08-06 00:22:28,738][52668] Sum rewards: 68.511, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.192', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.154', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '57.000'} [2024-08-06 00:22:28,999][52660] DAMAGECOUNT value on done: 108314.0 [2024-08-06 00:22:29,001][52660] Sum rewards: 75.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '62.000'} [2024-08-06 00:22:29,121][52667] DAMAGECOUNT value on done: 105132.0 [2024-08-06 00:22:29,123][52667] Sum rewards: 57.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.892', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.124', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.438', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:29,264][52820] DAMAGECOUNT value on done: 93951.0 [2024-08-06 00:22:29,268][52820] Sum rewards: 57.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'AMMO5': '0.019', 'ARMOR': '0.040', 'AMMO2': '0.062', 'AMMO3': '0.200', 'weapon5': '0.204', 'AMMO4': '0.312', 'weapon4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.690', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '49.500'} [2024-08-06 00:22:29,864][52649] DAMAGECOUNT value on done: 98372.0 [2024-08-06 00:22:29,865][52649] Sum rewards: 61.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.018', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.418', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '52.000'} [2024-08-06 00:22:30,568][52794] DAMAGECOUNT value on done: 111461.0 [2024-08-06 00:22:30,570][52794] Sum rewards: 59.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.660', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.050', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.438', 'WEAPON4': '0.450', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:31,259][52650] Updated weights for policy 0, policy_version 22161 (0.0041) [2024-08-06 00:22:31,371][52669] DAMAGECOUNT value on done: 103851.0 [2024-08-06 00:22:31,371][52669] Sum rewards: 48.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.052', 'weapon5': '0.146', 'weapon4': '0.178', 'AMMO3': '0.192', 'AMMO4': '0.261', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:31,482][52664] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 00:22:31,648][52668] DAMAGECOUNT value on done: 102595.0 [2024-08-06 00:22:31,648][52668] Sum rewards: 36.403, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon7': '0.058', 'weapon5': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'weapon2': '0.470', 'WEAPON4': '0.600', 'weapon4': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.200', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.986', 'FRAGCOUNT': '33.500'} [2024-08-06 00:22:31,948][52660] DAMAGECOUNT value on done: 101243.0 [2024-08-06 00:22:31,949][52660] Sum rewards: 55.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.020', 'AMMO4': '0.093', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.454', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:32,368][52667] DAMAGECOUNT value on done: 102768.0 [2024-08-06 00:22:32,369][52667] Sum rewards: 60.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.018', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.231', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:32,425][52820] DAMAGECOUNT value on done: 97173.0 [2024-08-06 00:22:32,425][52820] Sum rewards: 60.164, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.066', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.276', 'weapon4': '0.362', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 181559296. Throughput: 0: 4373.8. Samples: 45390440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:22:32,794][52567] Avg episode reward: [(0, '54.004')] [2024-08-06 00:22:32,795][52614] Saving new best policy, reward=54.004! [2024-08-06 00:22:32,975][52649] DAMAGECOUNT value on done: 96856.0 [2024-08-06 00:22:32,978][52649] Sum rewards: 45.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.024', 'AMMO2': '0.056', 'AMMO3': '0.191', 'AMMO4': '0.281', 'weapon5': '0.292', 'weapon2': '0.474', 'weapon4': '0.500', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.400', 'weapon3': '2.408', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '41.000'} [2024-08-06 00:22:33,565][52794] DAMAGECOUNT value on done: 105118.0 [2024-08-06 00:22:33,568][52794] Sum rewards: 40.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.052', 'AMMO5': '0.015', 'ARMOR': '0.026', 'AMMO2': '0.043', 'weapon5': '0.198', 'AMMO3': '0.205', 'AMMO4': '0.215', 'weapon2': '0.292', 'WEAPON5': '0.450', 'weapon4': '0.682', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '2.230', 'weapon3': '2.590', 'DAMAGECOUNT': '10.533', 'FRAGCOUNT': '36.000'} [2024-08-06 00:22:34,347][52669] DAMAGECOUNT value on done: 101031.0 [2024-08-06 00:22:34,349][52669] Sum rewards: 45.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.032', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.058', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.480', 'weapon4': '0.648', 'WEAPON3': '1.050', 'weapon3': '2.520', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '35.500'} [2024-08-06 00:22:34,543][52660] DAMAGECOUNT value on done: 102871.0 [2024-08-06 00:22:34,543][52660] Sum rewards: 50.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:35,496][52667] DAMAGECOUNT value on done: 101717.0 [2024-08-06 00:22:35,497][52667] Sum rewards: 46.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.244', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.182', 'weapon5': '0.206', 'WEAPON5': '0.250', 'AMMO4': '0.282', 'weapon4': '0.588', 'weapon2': '0.608', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.326', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '41.000'} [2024-08-06 00:22:35,506][52803] DAMAGECOUNT value on done: 99480.0 [2024-08-06 00:22:35,506][52803] Sum rewards: 58.328, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.653', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.154', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.430', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.674', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:35,625][52820] DAMAGECOUNT value on done: 94626.0 [2024-08-06 00:22:35,626][52820] Sum rewards: 57.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.945', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:35,910][52649] DAMAGECOUNT value on done: 102344.0 [2024-08-06 00:22:35,911][52649] Sum rewards: 46.519, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.350', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.218', 'weapon2': '0.862', 'WEAPON3': '1.450', 'weapon3': '2.720', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '40.000'} [2024-08-06 00:22:35,984][52650] Updated weights for policy 0, policy_version 22171 (0.0023) [2024-08-06 00:22:36,883][52660] DAMAGECOUNT value on done: 99230.0 [2024-08-06 00:22:36,884][52660] Sum rewards: 51.644, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.606', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'AMMO3': '0.264', 'weapon2': '0.292', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.310', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:37,323][52669] DAMAGECOUNT value on done: 103051.0 [2024-08-06 00:22:37,323][52669] Sum rewards: 53.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.487', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.166', 'AMMO3': '0.218', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.218', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 181649408. Throughput: 0: 4371.3. Samples: 45416770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:22:37,795][52567] Avg episode reward: [(0, '53.474')] [2024-08-06 00:22:38,475][52667] DAMAGECOUNT value on done: 102892.0 [2024-08-06 00:22:38,476][52667] Sum rewards: 53.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.234', 'weapon4': '0.264', 'weapon2': '0.630', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:38,636][52649] DAMAGECOUNT value on done: 100883.0 [2024-08-06 00:22:38,640][52649] Sum rewards: 53.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.144', 'weapon5': '0.002', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:38,648][52803] DAMAGECOUNT value on done: 98860.0 [2024-08-06 00:22:38,651][52803] Sum rewards: 50.789, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.388', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'weapon4': '0.154', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.186', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:38,831][52820] DAMAGECOUNT value on done: 90887.0 [2024-08-06 00:22:38,832][52820] Sum rewards: 46.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.173', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.171', 'weapon4': '0.188', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.782', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '40.000'} [2024-08-06 00:22:39,206][52658] DAMAGECOUNT value on done: 104875.0 [2024-08-06 00:22:39,206][52658] Sum rewards: 56.396, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.128', 'weapon2': '0.218', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.452', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '50.000'} [2024-08-06 00:22:39,582][52660] DAMAGECOUNT value on done: 104478.0 [2024-08-06 00:22:39,583][52660] Sum rewards: 51.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.090', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.112', 'AMMO3': '0.212', 'weapon2': '0.492', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.244', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:40,381][52669] DAMAGECOUNT value on done: 107750.0 [2024-08-06 00:22:40,383][52669] Sum rewards: 64.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:40,725][52650] Updated weights for policy 0, policy_version 22181 (0.0010) [2024-08-06 00:22:41,081][52667] DAMAGECOUNT value on done: 100480.0 [2024-08-06 00:22:41,084][52667] Sum rewards: 43.040, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.253', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.033', 'weapon5': '0.040', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.236', 'AMMO3': '0.299', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '2.830', 'weapon3': '3.040', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:41,579][52649] DAMAGECOUNT value on done: 93934.0 [2024-08-06 00:22:41,583][52649] Sum rewards: 54.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.765', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon5': '0.164', 'AMMO4': '0.186', 'WEAPON4': '0.400', 'weapon2': '0.460', 'weapon4': '0.462', 'WEAPON3': '0.900', 'weapon3': '2.728', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.723', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:41,585][52803] DAMAGECOUNT value on done: 96694.0 [2024-08-06 00:22:41,585][52803] Sum rewards: 53.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.136', 'AMMO3': '0.139', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.542', 'weapon4': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.420', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '44.500'} [2024-08-06 00:22:41,875][52820] DAMAGECOUNT value on done: 93963.0 [2024-08-06 00:22:41,875][52820] Sum rewards: 45.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '41.000'} [2024-08-06 00:22:41,980][52658] DAMAGECOUNT value on done: 102293.0 [2024-08-06 00:22:41,982][52658] Sum rewards: 53.994, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.272', 'weapon2': '0.470', 'WEAPON3': '1.750', 'weapon3': '3.148', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '50.000'} [2024-08-06 00:22:42,639][52660] DAMAGECOUNT value on done: 100174.0 [2024-08-06 00:22:42,639][52660] Sum rewards: 50.771, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.577', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.087', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.460', 'WEAPON3': '0.950', 'HITCOUNT': '2.730', 'weapon3': '2.832', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:42,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17633.7). Total num frames: 181747712. Throughput: 0: 4374.7. Samples: 45443360. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:22:42,794][52567] Avg episode reward: [(0, '53.186')] [2024-08-06 00:22:43,475][52811] DAMAGECOUNT value on done: 100337.0 [2024-08-06 00:22:43,483][52811] Sum rewards: 53.194, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.229', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.484', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:43,529][52669] DAMAGECOUNT value on done: 109301.0 [2024-08-06 00:22:43,531][52669] Sum rewards: 59.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.045', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.206', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.630', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '52.000'} [2024-08-06 00:22:43,978][52649] DAMAGECOUNT value on done: 102337.0 [2024-08-06 00:22:43,978][52649] Sum rewards: 48.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.028', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.216', 'weapon2': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.274', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:44,056][52667] DAMAGECOUNT value on done: 104654.0 [2024-08-06 00:22:44,056][52667] Sum rewards: 60.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.436', 'AMMO5': '0.007', 'ARMOR': '0.013', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.170', 'AMMO3': '0.214', 'weapon4': '0.312', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '52.000'} [2024-08-06 00:22:44,770][52803] DAMAGECOUNT value on done: 94959.0 [2024-08-06 00:22:44,770][52803] Sum rewards: 52.524, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.811', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon4': '0.180', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.236', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:44,968][52658] DAMAGECOUNT value on done: 102427.0 [2024-08-06 00:22:44,971][52658] Sum rewards: 49.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.160', 'AMMO3': '0.191', 'AMMO4': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.394', 'weapon4': '0.422', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '44.000'} [2024-08-06 00:22:45,020][52820] DAMAGECOUNT value on done: 96895.0 [2024-08-06 00:22:45,021][52820] Sum rewards: 54.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.565', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon4': '0.222', 'weapon2': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:45,296][52650] Updated weights for policy 0, policy_version 22191 (0.0026) [2024-08-06 00:22:46,479][52669] DAMAGECOUNT value on done: 103592.0 [2024-08-06 00:22:46,482][52669] Sum rewards: 57.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.322', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '48.500'} [2024-08-06 00:22:46,588][52811] DAMAGECOUNT value on done: 92476.0 [2024-08-06 00:22:46,589][52811] Sum rewards: 49.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.021', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.468', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.720', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:46,907][52649] DAMAGECOUNT value on done: 97795.0 [2024-08-06 00:22:46,908][52649] Sum rewards: 62.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.201', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:47,097][52667] DAMAGECOUNT value on done: 109741.0 [2024-08-06 00:22:47,099][52667] Sum rewards: 48.986, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.824', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.278', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.650', 'HITCOUNT': '3.040', 'weapon3': '3.130', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 181821440. Throughput: 0: 4368.4. Samples: 45456310. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:22:47,795][52567] Avg episode reward: [(0, '53.035')] [2024-08-06 00:22:47,853][52803] DAMAGECOUNT value on done: 98322.0 [2024-08-06 00:22:47,857][52803] Sum rewards: 66.406, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.470', 'weapon2': '0.798', 'WEAPON3': '1.150', 'weapon3': '2.372', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '54.000'} [2024-08-06 00:22:48,079][52658] DAMAGECOUNT value on done: 104985.0 [2024-08-06 00:22:48,080][52658] Sum rewards: 53.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.045', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.144', 'weapon4': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.978', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '42.500'} [2024-08-06 00:22:48,122][52820] DAMAGECOUNT value on done: 95148.0 [2024-08-06 00:22:48,122][52820] Sum rewards: 58.938, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.350', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.293', 'WEAPON4': '0.350', 'weapon2': '0.438', 'weapon4': '0.452', 'WEAPON3': '1.800', 'weapon3': '2.804', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:48,561][52666] DAMAGECOUNT value on done: 102187.0 [2024-08-06 00:22:48,563][52666] Sum rewards: 57.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.192', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.854', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:49,563][52669] DAMAGECOUNT value on done: 101577.0 [2024-08-06 00:22:49,563][52669] Sum rewards: 58.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.188', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '50.000'} [2024-08-06 00:22:49,653][52811] DAMAGECOUNT value on done: 94906.0 [2024-08-06 00:22:49,654][52811] Sum rewards: 49.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.481', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.356', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '41.000'} [2024-08-06 00:22:49,930][52667] DAMAGECOUNT value on done: 104308.0 [2024-08-06 00:22:49,933][52667] Sum rewards: 42.194, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon7': '0.028', 'AMMO2': '0.073', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.126', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'AMMO4': '0.365', 'weapon4': '0.512', 'WEAPON4': '0.600', 'weapon2': '0.858', 'WEAPON3': '1.150', 'weapon3': '2.216', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '37.000'} [2024-08-06 00:22:50,226][52649] DAMAGECOUNT value on done: 102060.0 [2024-08-06 00:22:50,227][52649] Sum rewards: 60.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.218', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '52.000'} [2024-08-06 00:22:50,271][52650] Updated weights for policy 0, policy_version 22201 (0.0014) [2024-08-06 00:22:50,572][52658] DAMAGECOUNT value on done: 105731.0 [2024-08-06 00:22:50,572][52658] Sum rewards: 52.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.334', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.039', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.193', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.896', 'WEAPON3': '1.100', 'weapon3': '2.274', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:50,900][52803] DAMAGECOUNT value on done: 96235.0 [2024-08-06 00:22:50,900][52803] Sum rewards: 59.898, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.503', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.127', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.404', 'weapon2': '0.586', 'WEAPON3': '0.900', 'weapon3': '2.390', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:51,188][52820] DAMAGECOUNT value on done: 95725.0 [2024-08-06 00:22:51,189][52820] Sum rewards: 46.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.660', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '42.000'} [2024-08-06 00:22:51,709][52666] DAMAGECOUNT value on done: 103005.0 [2024-08-06 00:22:51,710][52666] Sum rewards: 58.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.706', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.238', 'weapon2': '0.632', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '51.000'} [2024-08-06 00:22:52,195][52667] DAMAGECOUNT value on done: 109058.0 [2024-08-06 00:22:52,195][52667] Sum rewards: 59.436, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.068', 'AMMO4': '0.114', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:52,511][52669] DAMAGECOUNT value on done: 103411.0 [2024-08-06 00:22:52,512][52669] Sum rewards: 54.691, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.266', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:52,666][52664] DAMAGECOUNT value on done: 105626.0 [2024-08-06 00:22:52,667][52664] Sum rewards: 53.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.322', 'weapon2': '0.826', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '47.000'} [2024-08-06 00:22:52,669][52811] DAMAGECOUNT value on done: 95586.0 [2024-08-06 00:22:52,670][52811] Sum rewards: 53.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.386', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.136', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '3.226', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:52,796][52567] Fps is (10 sec: 16381.4, 60 sec: 17475.9, 300 sec: 17578.0). Total num frames: 181911552. Throughput: 0: 4380.3. Samples: 45482650. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:22:52,796][52567] Avg episode reward: [(0, '53.535')] [2024-08-06 00:22:52,988][52658] DAMAGECOUNT value on done: 100481.0 [2024-08-06 00:22:52,990][52658] Sum rewards: 51.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.555', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.249', 'weapon4': '0.274', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.200', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '46.000'} [2024-08-06 00:22:53,131][52649] DAMAGECOUNT value on done: 100461.0 [2024-08-06 00:22:53,133][52649] Sum rewards: 54.956, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.402', 'weapon2': '0.740', 'WEAPON3': '0.900', 'weapon3': '2.688', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '44.000'} [2024-08-06 00:22:53,635][52670] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:22:53,946][52803] DAMAGECOUNT value on done: 98709.0 [2024-08-06 00:22:53,946][52803] Sum rewards: 52.739, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.276', 'weapon5': '0.004', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.109', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '0.700', 'weapon4': '0.864', 'weapon3': '2.202', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:54,351][52820] DAMAGECOUNT value on done: 98157.0 [2024-08-06 00:22:54,355][52820] Sum rewards: 50.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.222', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.252', 'weapon4': '0.266', 'weapon2': '0.756', 'WEAPON3': '1.150', 'weapon3': '2.524', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:54,590][52650] Updated weights for policy 0, policy_version 22211 (0.0047) [2024-08-06 00:22:54,753][52667] DAMAGECOUNT value on done: 100672.0 [2024-08-06 00:22:54,754][52667] Sum rewards: 58.746, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.819', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon4': '0.190', 'AMMO3': '0.254', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.324', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '53.000'} [2024-08-06 00:22:54,875][52666] DAMAGECOUNT value on done: 104354.0 [2024-08-06 00:22:54,877][52666] Sum rewards: 57.751, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'weapon5': '0.032', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.186', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:55,669][52658] DAMAGECOUNT value on done: 108510.0 [2024-08-06 00:22:55,669][52658] Sum rewards: 53.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.098', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:55,724][52669] DAMAGECOUNT value on done: 103568.0 [2024-08-06 00:22:55,724][52669] Sum rewards: 55.231, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.644', 'AMMO5': '0.009', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.180', 'weapon4': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.650', 'weapon3': '2.896', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '49.000'} [2024-08-06 00:22:55,832][52664] DAMAGECOUNT value on done: 104466.0 [2024-08-06 00:22:55,832][52664] Sum rewards: 36.386, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.228', 'HEALTH': '0.495', 'weapon2': '0.904', 'WEAPON3': '1.000', 'weapon3': '2.472', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.482', 'FRAGCOUNT': '31.000'} [2024-08-06 00:22:55,842][52811] DAMAGECOUNT value on done: 95924.0 [2024-08-06 00:22:55,842][52811] Sum rewards: 65.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.161', 'weapon5': '0.190', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.414', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.642', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '55.000'} [2024-08-06 00:22:56,138][52649] DAMAGECOUNT value on done: 105469.0 [2024-08-06 00:22:56,139][52649] Sum rewards: 51.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.546', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.446', 'weapon4': '0.512', 'WEAPON3': '1.600', 'weapon3': '2.724', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '45.000'} [2024-08-06 00:22:56,852][52670] DAMAGECOUNT value on done: 100285.0 [2024-08-06 00:22:56,853][52670] Sum rewards: 70.790, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '57.000'} [2024-08-06 00:22:57,071][52803] DAMAGECOUNT value on done: 96732.0 [2024-08-06 00:22:57,072][52803] Sum rewards: 59.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.644', 'ARMOR': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.138', 'weapon4': '0.142', 'AMMO4': '0.143', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '50.000'} [2024-08-06 00:22:57,268][52820] DAMAGECOUNT value on done: 97563.0 [2024-08-06 00:22:57,271][52820] Sum rewards: 50.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.148', 'AMMO3': '0.168', 'AMMO4': '0.220', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON4': '0.550', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.636', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '43.000'} [2024-08-06 00:22:57,566][52666] DAMAGECOUNT value on done: 97586.0 [2024-08-06 00:22:57,566][52666] Sum rewards: 54.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.102', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.230', 'weapon2': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '48.500'} [2024-08-06 00:22:57,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 182001664. Throughput: 0: 4384.9. Samples: 45509050. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:22:57,794][52567] Avg episode reward: [(0, '54.030')] [2024-08-06 00:22:57,810][52614] Saving new best policy, reward=54.030! [2024-08-06 00:22:57,915][52667] DAMAGECOUNT value on done: 107499.0 [2024-08-06 00:22:57,916][52667] Sum rewards: 63.677, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.802', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.249', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '55.000'} [2024-08-06 00:22:58,677][52658] DAMAGECOUNT value on done: 100213.0 [2024-08-06 00:22:58,678][52658] Sum rewards: 41.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.826', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.185', 'weapon4': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.712', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.870', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '36.000'} [2024-08-06 00:22:58,970][52811] DAMAGECOUNT value on done: 99089.0 [2024-08-06 00:22:58,970][52811] Sum rewards: 59.293, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.142', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.126', 'weapon4': '0.196', 'AMMO3': '0.214', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '52.000'} [2024-08-06 00:22:59,154][52664] DAMAGECOUNT value on done: 107377.0 [2024-08-06 00:22:59,156][52664] Sum rewards: 42.609, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.262', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.056', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'AMMO4': '0.278', 'weapon2': '0.332', 'WEAPON4': '0.650', 'weapon4': '0.966', 'WEAPON3': '1.300', 'weapon3': '2.016', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '40.000'} [2024-08-06 00:22:59,622][52670] DAMAGECOUNT value on done: 105094.0 [2024-08-06 00:22:59,622][52670] Sum rewards: 54.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.181', 'weapon4': '0.346', 'WEAPON4': '0.450', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '48.000'} [2024-08-06 00:22:59,648][52650] Updated weights for policy 0, policy_version 22221 (0.0016) [2024-08-06 00:23:00,171][52803] DAMAGECOUNT value on done: 95847.0 [2024-08-06 00:23:00,174][52803] Sum rewards: 54.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.384', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.171', 'weapon2': '0.558', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.274', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '44.000'} [2024-08-06 00:23:00,236][52666] DAMAGECOUNT value on done: 100905.0 [2024-08-06 00:23:00,238][52666] Sum rewards: 63.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.889', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.147', 'weapon4': '0.148', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '54.000'} [2024-08-06 00:23:00,486][52820] DAMAGECOUNT value on done: 95018.0 [2024-08-06 00:23:00,488][52820] Sum rewards: 47.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.166', 'WEAPON5': '0.300', 'weapon4': '0.490', 'WEAPON4': '0.500', 'weapon2': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.340', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:01,024][52663] DAMAGECOUNT value on done: 102780.0 [2024-08-06 00:23:01,029][52663] Sum rewards: 48.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.575', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon5': '0.132', 'AMMO3': '0.161', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.400', 'weapon2': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.456', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '40.000'} [2024-08-06 00:23:01,549][52658] DAMAGECOUNT value on done: 106765.0 [2024-08-06 00:23:01,549][52658] Sum rewards: 57.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.052', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'AMMO4': '0.258', 'weapon2': '0.336', 'WEAPON4': '0.650', 'weapon4': '0.796', 'WEAPON3': '1.150', 'weapon3': '2.488', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:02,066][52811] DAMAGECOUNT value on done: 95110.0 [2024-08-06 00:23:02,068][52811] Sum rewards: 56.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.656', 'AMMO2': '0.009', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.046', 'weapon5': '0.110', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.426', 'weapon2': '0.638', 'WEAPON3': '0.750', 'weapon3': '2.640', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:02,208][52664] DAMAGECOUNT value on done: 106464.0 [2024-08-06 00:23:02,209][52664] Sum rewards: 46.142, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.941', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.050', 'weapon5': '0.206', 'AMMO3': '0.249', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.500', 'weapon3': '2.578', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '42.500'} [2024-08-06 00:23:02,377][52666] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 00:23:02,416][52670] DAMAGECOUNT value on done: 98935.0 [2024-08-06 00:23:02,417][52670] Sum rewards: 51.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.192', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.058', 'weapon5': '0.146', 'AMMO3': '0.181', 'AMMO4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.450', 'weapon4': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.724', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:02,794][52567] Fps is (10 sec: 18025.3, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 182091776. Throughput: 0: 4381.3. Samples: 45521890. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:23:02,794][52567] Avg episode reward: [(0, '54.287')] [2024-08-06 00:23:02,795][52614] Saving new best policy, reward=54.287! [2024-08-06 00:23:03,205][52803] DAMAGECOUNT value on done: 91614.0 [2024-08-06 00:23:03,208][52803] Sum rewards: 59.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.387', 'AMMO5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.235', 'weapon2': '0.292', 'WEAPON4': '0.450', 'weapon4': '0.596', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:03,467][52666] DAMAGECOUNT value on done: 99349.0 [2024-08-06 00:23:03,467][52666] Sum rewards: 61.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.151', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '3.164', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:03,908][52650] Updated weights for policy 0, policy_version 22231 (0.0012) [2024-08-06 00:23:04,054][52663] DAMAGECOUNT value on done: 102582.0 [2024-08-06 00:23:04,057][52663] Sum rewards: 51.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.137', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '0.850', 'weapon2': '0.896', 'weapon3': '2.506', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:04,391][52658] DAMAGECOUNT value on done: 105767.0 [2024-08-06 00:23:04,392][52658] Sum rewards: 63.705, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.224', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '54.000'} [2024-08-06 00:23:05,250][52811] DAMAGECOUNT value on done: 94259.0 [2024-08-06 00:23:05,250][52811] Sum rewards: 40.169, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.295', 'AMMO5': '0.007', 'AMMO2': '0.058', 'weapon5': '0.068', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.292', 'weapon2': '0.330', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon4': '1.342', 'weapon3': '1.964', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '9.750', 'FRAGCOUNT': '36.000'} [2024-08-06 00:23:05,365][52664] DAMAGECOUNT value on done: 104580.0 [2024-08-06 00:23:05,366][52664] Sum rewards: 57.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.410', 'AMMO2': '0.011', 'weapon4': '0.024', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon2': '0.590', 'WEAPON3': '0.950', 'HITCOUNT': '2.990', 'weapon3': '3.250', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:05,422][52670] DAMAGECOUNT value on done: 102150.0 [2024-08-06 00:23:05,423][52670] Sum rewards: 48.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.215', 'ARMOR': '0.004', 'AMMO5': '0.017', 'weapon5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.150', 'AMMO4': '0.215', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.090', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '40.000'} [2024-08-06 00:23:06,270][52666] DAMAGECOUNT value on done: 100176.0 [2024-08-06 00:23:06,270][52666] Sum rewards: 53.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.815', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.292', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '47.500'} [2024-08-06 00:23:06,333][52803] DAMAGECOUNT value on done: 98177.0 [2024-08-06 00:23:06,333][52803] Sum rewards: 56.536, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.028', 'weapon5': '0.068', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon4': '0.276', 'weapon2': '0.532', 'HEALTH': '1.021', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:06,822][52663] DAMAGECOUNT value on done: 104311.0 [2024-08-06 00:23:06,822][52663] Sum rewards: 64.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.641', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.012', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon4': '0.230', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '54.000'} [2024-08-06 00:23:07,543][52658] DAMAGECOUNT value on done: 106724.0 [2024-08-06 00:23:07,543][52658] Sum rewards: 48.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.222', 'weapon4': '0.244', 'WEAPON4': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:07,768][52664] DAMAGECOUNT value on done: 111595.0 [2024-08-06 00:23:07,769][52664] Sum rewards: 54.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.710', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.100', 'AMMO3': '0.238', 'weapon2': '0.256', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 182173696. Throughput: 0: 4382.0. Samples: 45548270. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:23:07,794][52567] Avg episode reward: [(0, '54.121')] [2024-08-06 00:23:08,118][52670] DAMAGECOUNT value on done: 102560.0 [2024-08-06 00:23:08,118][52670] Sum rewards: 65.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.625', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.141', 'weapon5': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '0.950', 'weapon3': '2.942', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:08,386][52811] DAMAGECOUNT value on done: 97897.0 [2024-08-06 00:23:08,394][52811] Sum rewards: 46.164, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon5': '0.170', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.422', 'weapon2': '0.872', 'WEAPON3': '0.900', 'weapon3': '2.334', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '38.000'} [2024-08-06 00:23:08,761][52650] Updated weights for policy 0, policy_version 22241 (0.0012) [2024-08-06 00:23:09,087][52666] DAMAGECOUNT value on done: 100391.0 [2024-08-06 00:23:09,088][52666] Sum rewards: 55.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.379', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.163', 'weapon5': '0.170', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.238', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '0.950', 'weapon3': '2.854', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:09,379][52803] DAMAGECOUNT value on done: 100069.0 [2024-08-06 00:23:09,380][52803] Sum rewards: 59.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.909', 'AMMO2': '0.005', 'AMMO5': '0.011', 'AMMO4': '0.022', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon4': '0.230', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:09,879][52663] DAMAGECOUNT value on done: 104307.0 [2024-08-06 00:23:09,880][52663] Sum rewards: 62.233, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.232', 'HEALTH': '0.280', 'weapon2': '0.916', 'WEAPON3': '0.950', 'weapon3': '2.650', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:10,347][52658] DAMAGECOUNT value on done: 99987.0 [2024-08-06 00:23:10,347][52658] Sum rewards: 42.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.215', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.594', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.788', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:10,543][52664] DAMAGECOUNT value on done: 108094.0 [2024-08-06 00:23:10,543][52664] Sum rewards: 42.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.668', 'AMMO5': '0.008', 'ARMOR': '0.010', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.174', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.734', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '37.000'} [2024-08-06 00:23:10,976][52670] DAMAGECOUNT value on done: 103046.0 [2024-08-06 00:23:10,977][52670] Sum rewards: 55.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO2': '0.017', 'ARMOR': '0.020', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon4': '0.304', 'weapon2': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:11,510][52811] DAMAGECOUNT value on done: 96070.0 [2024-08-06 00:23:11,512][52811] Sum rewards: 35.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.817', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.222', 'weapon4': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '2.944', 'DAMAGECOUNT': '10.635', 'FRAGCOUNT': '33.000'} [2024-08-06 00:23:11,708][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:23:11,936][52666] DAMAGECOUNT value on done: 105391.0 [2024-08-06 00:23:11,939][52666] Sum rewards: 57.927, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.300', 'AMMO5': '0.012', 'AMMO2': '0.062', 'weapon5': '0.192', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'AMMO4': '0.312', 'weapon2': '0.366', 'weapon4': '0.636', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.534', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:12,652][52803] DAMAGECOUNT value on done: 95333.0 [2024-08-06 00:23:12,655][52803] Sum rewards: 47.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.108', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.197', 'weapon4': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.664', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.846', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '41.000'} [2024-08-06 00:23:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 182272000. Throughput: 0: 4381.3. Samples: 45574710. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:23:12,794][52567] Avg episode reward: [(0, '53.509')] [2024-08-06 00:23:13,020][52663] DAMAGECOUNT value on done: 99596.0 [2024-08-06 00:23:13,020][52663] Sum rewards: 50.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.134', 'AMMO5': '0.011', 'ARMOR': '0.028', 'AMMO2': '0.044', 'AMMO3': '0.208', 'AMMO4': '0.219', 'weapon5': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.500', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.424', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '43.500'} [2024-08-06 00:23:13,060][52658] DAMAGECOUNT value on done: 101902.0 [2024-08-06 00:23:13,062][52658] Sum rewards: 46.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.816', 'AMMO5': '0.020', 'ARMOR': '0.052', 'AMMO2': '0.062', 'AMMO3': '0.183', 'weapon5': '0.242', 'AMMO4': '0.311', 'WEAPON5': '0.350', 'weapon2': '0.390', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.550', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.451', 'FRAGCOUNT': '40.000'} [2024-08-06 00:23:13,447][52664] DAMAGECOUNT value on done: 100303.0 [2024-08-06 00:23:13,447][52664] Sum rewards: 54.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.583', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.084', 'AMMO4': '0.155', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.380', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:13,614][52650] Updated weights for policy 0, policy_version 22251 (0.0015) [2024-08-06 00:23:13,688][52670] DAMAGECOUNT value on done: 97117.0 [2024-08-06 00:23:13,688][52670] Sum rewards: 45.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.785', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.074', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.936', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:14,614][52666] DAMAGECOUNT value on done: 101584.0 [2024-08-06 00:23:14,615][52666] Sum rewards: 53.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.136', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '2.992', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:14,622][52811] DAMAGECOUNT value on done: 96668.0 [2024-08-06 00:23:14,623][52811] Sum rewards: 50.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.006', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.167', 'weapon4': '0.268', 'WEAPON4': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.022', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '44.000'} [2024-08-06 00:23:14,624][52665] DAMAGECOUNT value on done: 98789.0 [2024-08-06 00:23:14,628][52665] Sum rewards: 49.647, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.884', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.616', 'weapon2': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.408', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:15,476][52647] DAMAGECOUNT value on done: 108921.0 [2024-08-06 00:23:15,476][52647] Sum rewards: 56.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.187', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.182', 'weapon5': '0.200', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.432', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:15,524][52658] DAMAGECOUNT value on done: 102373.0 [2024-08-06 00:23:15,526][52658] Sum rewards: 50.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.180', 'AMMO3': '0.241', 'weapon4': '0.242', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.020', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:15,615][52803] DAMAGECOUNT value on done: 96914.0 [2024-08-06 00:23:15,617][52803] Sum rewards: 50.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.394', 'ARMOR': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.205', 'WEAPON4': '0.500', 'weapon4': '0.532', 'weapon2': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '44.000'} [2024-08-06 00:23:15,903][52663] DAMAGECOUNT value on done: 106238.0 [2024-08-06 00:23:15,905][52663] Sum rewards: 52.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.712', 'AMMO5': '0.013', 'ARMOR': '0.032', 'AMMO2': '0.044', 'weapon5': '0.122', 'AMMO3': '0.168', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON4': '0.550', 'weapon4': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.488', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:16,116][52664] DAMAGECOUNT value on done: 113144.0 [2024-08-06 00:23:16,117][52664] Sum rewards: 53.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.303', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.169', 'weapon5': '0.180', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.450', 'weapon2': '0.744', 'WEAPON3': '1.100', 'weapon3': '2.378', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:16,444][52670] DAMAGECOUNT value on done: 100861.0 [2024-08-06 00:23:16,444][52670] Sum rewards: 56.053, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.212', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.076', 'weapon4': '0.152', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.862', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:17,409][52666] DAMAGECOUNT value on done: 100217.0 [2024-08-06 00:23:17,411][52666] Sum rewards: 54.468, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.179', 'weapon2': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.236', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:17,625][52665] DAMAGECOUNT value on done: 107738.0 [2024-08-06 00:23:17,627][52665] Sum rewards: 55.217, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.236', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:17,654][52811] DAMAGECOUNT value on done: 95070.0 [2024-08-06 00:23:17,655][52811] Sum rewards: 39.155, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.925', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO3': '0.178', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.580', 'WEAPON3': '1.050', 'weapon3': '2.518', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '35.000'} [2024-08-06 00:23:17,788][52647] DAMAGECOUNT value on done: 107012.0 [2024-08-06 00:23:17,789][52647] Sum rewards: 51.531, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'HEALTH': '0.254', 'weapon4': '0.424', 'weapon2': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.856', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 182353920. Throughput: 0: 4388.4. Samples: 45587920. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-06 00:23:17,794][52567] Avg episode reward: [(0, '53.475')] [2024-08-06 00:23:18,065][52650] Updated weights for policy 0, policy_version 22261 (0.0013) [2024-08-06 00:23:18,429][52658] DAMAGECOUNT value on done: 100989.0 [2024-08-06 00:23:18,431][52658] Sum rewards: 58.939, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'weapon5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO4': '0.198', 'weapon4': '0.220', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.224', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '53.000'} [2024-08-06 00:23:18,645][52664] DAMAGECOUNT value on done: 111923.0 [2024-08-06 00:23:18,645][52664] Sum rewards: 70.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.171', 'AMMO5': '0.012', 'AMMO2': '0.028', 'ARMOR': '0.028', 'weapon5': '0.104', 'AMMO4': '0.139', 'weapon4': '0.146', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '58.000'} [2024-08-06 00:23:18,772][52663] DAMAGECOUNT value on done: 104937.0 [2024-08-06 00:23:18,774][52663] Sum rewards: 57.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.026', 'weapon4': '0.028', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.656', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.098', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:18,815][52803] DAMAGECOUNT value on done: 95964.0 [2024-08-06 00:23:18,815][52803] Sum rewards: 59.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.020', 'weapon4': '0.038', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'weapon2': '0.814', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:18,837][52671] DAMAGECOUNT value on done: 107665.0 [2024-08-06 00:23:18,837][52671] Sum rewards: 52.093, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.512', 'AMMO5': '0.007', 'weapon5': '0.042', 'AMMO2': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'AMMO4': '0.268', 'weapon2': '0.476', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.654', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:19,205][52670] DAMAGECOUNT value on done: 94847.0 [2024-08-06 00:23:19,207][52670] Sum rewards: 52.635, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.825', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO4': '0.093', 'AMMO3': '0.172', 'weapon2': '0.514', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.310', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:20,240][52666] DAMAGECOUNT value on done: 98133.0 [2024-08-06 00:23:20,241][52666] Sum rewards: 51.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.139', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.144', 'AMMO3': '0.199', 'weapon2': '0.742', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.814', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:20,581][52647] DAMAGECOUNT value on done: 111637.0 [2024-08-06 00:23:20,582][52647] Sum rewards: 44.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.885', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO4': '0.197', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.356', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.410', 'weapon3': '2.810', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '41.000'} [2024-08-06 00:23:20,797][52665] DAMAGECOUNT value on done: 101323.0 [2024-08-06 00:23:20,799][52665] Sum rewards: 53.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.542', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.354', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.298', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '45.500'} [2024-08-06 00:23:20,805][52811] DAMAGECOUNT value on done: 97836.0 [2024-08-06 00:23:20,806][52811] Sum rewards: 43.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.803', 'AMMO5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.154', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '3.032', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '41.000'} [2024-08-06 00:23:21,120][52658] DAMAGECOUNT value on done: 106043.0 [2024-08-06 00:23:21,120][52658] Sum rewards: 59.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.286', 'weapon4': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '52.000'} [2024-08-06 00:23:21,471][52664] DAMAGECOUNT value on done: 109365.0 [2024-08-06 00:23:21,472][52664] Sum rewards: 50.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.188', 'AMMO3': '0.191', 'WEAPON4': '0.450', 'weapon2': '0.474', 'weapon4': '0.914', 'WEAPON3': '1.200', 'weapon3': '2.264', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '44.000'} [2024-08-06 00:23:21,633][52671] DAMAGECOUNT value on done: 101847.0 [2024-08-06 00:23:21,635][52671] Sum rewards: 52.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.117', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.646', 'WEAPON3': '1.000', 'weapon3': '2.696', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:21,857][52670] DAMAGECOUNT value on done: 94156.0 [2024-08-06 00:23:21,857][52670] Sum rewards: 42.496, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.652', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.394', 'weapon4': '0.452', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '2.922', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:21,901][52803] DAMAGECOUNT value on done: 93920.0 [2024-08-06 00:23:21,903][52803] Sum rewards: 48.494, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.856', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'weapon4': '0.204', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '3.014', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:22,065][52663] DAMAGECOUNT value on done: 100697.0 [2024-08-06 00:23:22,066][52663] Sum rewards: 53.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.143', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'weapon4': '0.196', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.986', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:22,677][52650] Updated weights for policy 0, policy_version 22271 (0.0013) [2024-08-06 00:23:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 182444032. Throughput: 0: 4387.8. Samples: 45614220. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-06 00:23:22,794][52567] Avg episode reward: [(0, '53.526')] [2024-08-06 00:23:23,029][52666] DAMAGECOUNT value on done: 100548.0 [2024-08-06 00:23:23,029][52666] Sum rewards: 44.472, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.110', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.081', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'AMMO4': '0.403', 'weapon4': '0.686', 'weapon2': '0.746', 'WEAPON4': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.180', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '41.000'} [2024-08-06 00:23:23,332][52647] DAMAGECOUNT value on done: 110713.0 [2024-08-06 00:23:23,332][52647] Sum rewards: 42.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.542', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '2.684', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '38.000'} [2024-08-06 00:23:23,461][52665] DAMAGECOUNT value on done: 97898.0 [2024-08-06 00:23:23,461][52665] Sum rewards: 63.051, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.448', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.165', 'AMMO3': '0.168', 'WEAPON7': '0.200', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.666', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:23,729][52658] DAMAGECOUNT value on done: 107565.0 [2024-08-06 00:23:23,730][52658] Sum rewards: 55.410, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.833', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.312', 'WEAPON4': '0.550', 'weapon4': '0.704', 'WEAPON3': '1.450', 'weapon3': '2.708', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:23,894][52811] DAMAGECOUNT value on done: 96446.0 [2024-08-06 00:23:23,895][52811] Sum rewards: 78.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.326', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon2': '0.758', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '63.000'} [2024-08-06 00:23:24,239][52664] DAMAGECOUNT value on done: 106184.0 [2024-08-06 00:23:24,239][52664] Sum rewards: 53.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.080', 'AMMO3': '0.164', 'AMMO4': '0.260', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON4': '0.650', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.564', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '44.000'} [2024-08-06 00:23:24,446][52670] DAMAGECOUNT value on done: 103911.0 [2024-08-06 00:23:24,447][52670] Sum rewards: 51.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.175', 'weapon5': '0.178', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:24,643][52671] DAMAGECOUNT value on done: 105234.0 [2024-08-06 00:23:24,648][52671] Sum rewards: 63.459, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'AMMO2': '0.002', 'AMMO4': '0.007', 'ARMOR': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'weapon4': '0.230', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '52.000'} [2024-08-06 00:23:24,981][52803] DAMAGECOUNT value on done: 96776.0 [2024-08-06 00:23:24,981][52803] Sum rewards: 47.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO3': '0.167', 'AMMO4': '0.187', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.824', 'WEAPON3': '0.900', 'weapon3': '2.634', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '40.000'} [2024-08-06 00:23:25,015][52664] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 00:23:25,060][52663] DAMAGECOUNT value on done: 104214.0 [2024-08-06 00:23:25,060][52663] Sum rewards: 60.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.254', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.194', 'weapon5': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:25,471][52666] DAMAGECOUNT value on done: 103014.0 [2024-08-06 00:23:25,475][52666] Sum rewards: 48.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.016', 'AMMO2': '0.059', 'AMMO3': '0.147', 'weapon5': '0.170', 'AMMO4': '0.297', 'weapon2': '0.374', 'WEAPON5': '0.400', 'weapon4': '0.612', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.388', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:26,016][52664] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 00:23:26,251][52647] DAMAGECOUNT value on done: 111235.0 [2024-08-06 00:23:26,251][52647] Sum rewards: 60.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.218', 'weapon2': '0.322', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.446', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '52.000'} [2024-08-06 00:23:26,442][52658] DAMAGECOUNT value on done: 100307.0 [2024-08-06 00:23:26,443][52658] Sum rewards: 49.091, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.009', 'HEALTH': '0.026', 'AMMO4': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'weapon2': '0.424', 'weapon4': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.496', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.784', 'FRAGCOUNT': '41.000'} [2024-08-06 00:23:26,695][52665] DAMAGECOUNT value on done: 100814.0 [2024-08-06 00:23:26,695][52665] Sum rewards: 57.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.860', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon7': '0.054', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.282', 'weapon2': '0.760', 'WEAPON3': '0.800', 'weapon3': '2.638', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:26,902][52664] DAMAGECOUNT value on done: 104090.0 [2024-08-06 00:23:26,902][52664] Sum rewards: 50.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.261', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.023', 'weapon4': '0.080', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.228', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:27,030][52811] DAMAGECOUNT value on done: 98282.0 [2024-08-06 00:23:27,030][52811] Sum rewards: 37.999, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.182', 'AMMO5': '0.010', 'AMMO2': '0.020', 'ARMOR': '0.024', 'weapon7': '0.050', 'weapon5': '0.098', 'AMMO4': '0.100', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.394', 'weapon4': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.402', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '30.000'} [2024-08-06 00:23:27,168][52671] DAMAGECOUNT value on done: 101144.0 [2024-08-06 00:23:27,169][52671] Sum rewards: 55.049, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.202', 'weapon4': '0.318', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.114', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:27,580][52650] Updated weights for policy 0, policy_version 22281 (0.0026) [2024-08-06 00:23:27,668][52670] DAMAGECOUNT value on done: 103809.0 [2024-08-06 00:23:27,669][52670] Sum rewards: 43.389, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.292', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.190', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.600', 'HITCOUNT': '2.540', 'weapon3': '3.296', 'DAMAGECOUNT': '11.040', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 182525952. Throughput: 0: 4376.9. Samples: 45640320. Policy #0 lag: (min: 0.0, avg: 3.0, max: 9.0) [2024-08-06 00:23:27,794][52567] Avg episode reward: [(0, '53.240')] [2024-08-06 00:23:28,034][52803] DAMAGECOUNT value on done: 96951.0 [2024-08-06 00:23:28,035][52803] Sum rewards: 40.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.570', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.146', 'AMMO3': '0.201', 'AMMO4': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON4': '0.700', 'weapon4': '0.784', 'WEAPON3': '1.250', 'weapon3': '2.128', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.847', 'FRAGCOUNT': '38.000'} [2024-08-06 00:23:28,274][52663] DAMAGECOUNT value on done: 104089.0 [2024-08-06 00:23:28,276][52663] Sum rewards: 50.848, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.313', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon4': '0.154', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.428', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.162', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:28,488][52666] DAMAGECOUNT value on done: 100989.0 [2024-08-06 00:23:28,490][52666] Sum rewards: 57.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.966', 'AMMO5': '0.007', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon5': '0.166', 'AMMO3': '0.196', 'weapon4': '0.260', 'weapon2': '0.338', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.002', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:28,656][52647] DAMAGECOUNT value on done: 110567.0 [2024-08-06 00:23:28,656][52647] Sum rewards: 54.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'weapon4': '0.192', 'AMMO3': '0.243', 'weapon2': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:29,477][52658] DAMAGECOUNT value on done: 102619.0 [2024-08-06 00:23:29,488][52658] Sum rewards: 61.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.221', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.442', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '54.000'} [2024-08-06 00:23:29,609][52665] DAMAGECOUNT value on done: 102514.0 [2024-08-06 00:23:29,609][52665] Sum rewards: 41.226, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.055', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.054', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO4': '0.233', 'AMMO3': '0.259', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.550', 'HITCOUNT': '2.520', 'weapon3': '3.048', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:29,656][52664] DAMAGECOUNT value on done: 108783.0 [2024-08-06 00:23:29,658][52664] Sum rewards: 55.826, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.254', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.550', 'weapon3': '2.734', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:30,140][52671] DAMAGECOUNT value on done: 102428.0 [2024-08-06 00:23:30,140][52671] Sum rewards: 53.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.216', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '46.500'} [2024-08-06 00:23:30,248][52811] DAMAGECOUNT value on done: 98806.0 [2024-08-06 00:23:30,248][52811] Sum rewards: 55.196, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.582', 'ARMOR': '0.005', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.186', 'AMMO4': '0.210', 'weapon5': '0.252', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.784', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:30,544][52670] DAMAGECOUNT value on done: 102234.0 [2024-08-06 00:23:30,544][52670] Sum rewards: 55.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.003', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.258', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.338', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:31,033][52803] DAMAGECOUNT value on done: 99065.0 [2024-08-06 00:23:31,034][52803] Sum rewards: 48.347, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon4': '0.124', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '3.182', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '40.000'} [2024-08-06 00:23:31,460][52647] DAMAGECOUNT value on done: 108343.0 [2024-08-06 00:23:31,460][52647] Sum rewards: 56.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.897', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON4': '0.600', 'weapon4': '0.830', 'WEAPON3': '0.950', 'weapon3': '2.168', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:31,529][52666] DAMAGECOUNT value on done: 99367.0 [2024-08-06 00:23:31,529][52663] DAMAGECOUNT value on done: 104421.0 [2024-08-06 00:23:31,532][52666] Sum rewards: 50.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.278', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.150', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:31,532][52663] Sum rewards: 55.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.302', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:32,099][52650] Updated weights for policy 0, policy_version 22291 (0.0016) [2024-08-06 00:23:32,180][52664] DAMAGECOUNT value on done: 107181.0 [2024-08-06 00:23:32,182][52664] Sum rewards: 54.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.196', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.068', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.342', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '44.500'} [2024-08-06 00:23:32,287][52658] DAMAGECOUNT value on done: 105872.0 [2024-08-06 00:23:32,288][52658] Sum rewards: 58.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.852', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.150', 'AMMO4': '0.189', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.668', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:32,740][52665] DAMAGECOUNT value on done: 103102.0 [2024-08-06 00:23:32,742][52665] Sum rewards: 52.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.795', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'weapon2': '0.402', 'WEAPON3': '1.700', 'HITCOUNT': '2.860', 'weapon3': '3.204', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 182616064. Throughput: 0: 4386.9. Samples: 45653720. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 00:23:32,794][52567] Avg episode reward: [(0, '52.928')] [2024-08-06 00:23:32,801][52671] DAMAGECOUNT value on done: 105642.0 [2024-08-06 00:23:32,801][52671] Sum rewards: 59.233, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.300', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.092', 'AMMO3': '0.226', 'AMMO4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'weapon4': '0.436', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '55.000'} [2024-08-06 00:23:33,428][52670] DAMAGECOUNT value on done: 101383.0 [2024-08-06 00:23:33,430][52670] Sum rewards: 48.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.133', 'AMMO3': '0.203', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.004', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '41.500'} [2024-08-06 00:23:33,444][52811] DAMAGECOUNT value on done: 97263.0 [2024-08-06 00:23:33,447][52811] Sum rewards: 57.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.674', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:33,707][52647] DAMAGECOUNT value on done: 112008.0 [2024-08-06 00:23:33,711][52647] Sum rewards: 58.986, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'weapon4': '0.008', 'weapon5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.428', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.394', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:34,064][52803] DAMAGECOUNT value on done: 93339.0 [2024-08-06 00:23:34,065][52803] Sum rewards: 62.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.475', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '54.000'} [2024-08-06 00:23:34,181][52663] DAMAGECOUNT value on done: 102787.0 [2024-08-06 00:23:34,184][52663] Sum rewards: 45.968, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.472', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.422', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.620', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:34,344][52666] DAMAGECOUNT value on done: 100018.0 [2024-08-06 00:23:34,345][52666] Sum rewards: 50.262, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.508', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.311', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '44.000'} [2024-08-06 00:23:34,933][52664] DAMAGECOUNT value on done: 103259.0 [2024-08-06 00:23:34,942][52664] Sum rewards: 51.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.364', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:35,527][52665] DAMAGECOUNT value on done: 103981.0 [2024-08-06 00:23:35,527][52665] Sum rewards: 45.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.696', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.252', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.650', 'weapon3': '3.020', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '40.500'} [2024-08-06 00:23:35,844][52671] DAMAGECOUNT value on done: 105079.0 [2024-08-06 00:23:35,846][52671] Sum rewards: 69.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.032', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.314', 'WEAPON3': '1.100', 'weapon3': '3.292', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '57.000'} [2024-08-06 00:23:36,078][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:23:36,284][52647] DAMAGECOUNT value on done: 112294.0 [2024-08-06 00:23:36,285][52647] Sum rewards: 55.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.051', 'weapon5': '0.082', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.256', 'weapon4': '0.354', 'weapon2': '0.372', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:36,475][52670] DAMAGECOUNT value on done: 105752.0 [2024-08-06 00:23:36,477][52670] Sum rewards: 53.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.183', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'weapon4': '0.314', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:36,487][52811] DAMAGECOUNT value on done: 99600.0 [2024-08-06 00:23:36,489][52811] Sum rewards: 58.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.274', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:36,799][52650] Updated weights for policy 0, policy_version 22301 (0.0019) [2024-08-06 00:23:36,844][52663] DAMAGECOUNT value on done: 97917.0 [2024-08-06 00:23:36,845][52663] Sum rewards: 51.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.762', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.053', 'WEAPON5': '0.150', 'weapon5': '0.196', 'AMMO3': '0.207', 'AMMO4': '0.267', 'weapon4': '0.554', 'WEAPON4': '0.600', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.372', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:37,344][52664] DAMAGECOUNT value on done: 107631.0 [2024-08-06 00:23:37,344][52664] Sum rewards: 50.610, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.055', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.020', 'weapon5': '0.064', 'AMMO4': '0.086', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.050', 'HITCOUNT': '2.680', 'weapon3': '3.208', 'DAMAGECOUNT': '12.183', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:37,426][52666] DAMAGECOUNT value on done: 104906.0 [2024-08-06 00:23:37,427][52666] Sum rewards: 53.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.805', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 182706176. Throughput: 0: 4389.3. Samples: 45680160. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 00:23:37,795][52567] Avg episode reward: [(0, '53.148')] [2024-08-06 00:23:38,489][52665] DAMAGECOUNT value on done: 108223.0 [2024-08-06 00:23:38,492][52665] Sum rewards: 47.730, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.695', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.017', 'weapon5': '0.096', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.274', 'weapon2': '0.878', 'WEAPON3': '1.250', 'weapon3': '2.564', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:38,798][52647] DAMAGECOUNT value on done: 105553.0 [2024-08-06 00:23:38,800][52647] Sum rewards: 65.557, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.478', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.332', 'WEAPON3': '0.750', 'weapon2': '0.950', 'weapon3': '2.596', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:39,121][52671] DAMAGECOUNT value on done: 106329.0 [2024-08-06 00:23:39,121][52671] Sum rewards: 68.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.636', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.131', 'AMMO3': '0.229', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '60.000'} [2024-08-06 00:23:39,203][52670] DAMAGECOUNT value on done: 97626.0 [2024-08-06 00:23:39,204][52670] Sum rewards: 52.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.216', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.095', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.068', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '44.500'} [2024-08-06 00:23:39,377][52663] DAMAGECOUNT value on done: 102632.0 [2024-08-06 00:23:39,378][52663] Sum rewards: 57.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.148', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:39,545][52811] DAMAGECOUNT value on done: 96763.0 [2024-08-06 00:23:39,546][52811] Sum rewards: 68.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.928', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon4': '0.088', 'AMMO4': '0.090', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.748', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '58.000'} [2024-08-06 00:23:39,906][52664] DAMAGECOUNT value on done: 107098.0 [2024-08-06 00:23:39,907][52664] Sum rewards: 54.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.471', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.130', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.222', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:40,225][52666] DAMAGECOUNT value on done: 99778.0 [2024-08-06 00:23:40,233][52666] Sum rewards: 45.299, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.932', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.062', 'AMMO4': '0.176', 'weapon4': '0.214', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.450', 'HITCOUNT': '2.750', 'weapon3': '2.894', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:40,602][52659] DAMAGECOUNT value on done: 103407.0 [2024-08-06 00:23:40,603][52659] Sum rewards: 56.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.774', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.436', 'weapon4': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:41,254][52650] Updated weights for policy 0, policy_version 22311 (0.0013) [2024-08-06 00:23:41,490][52647] DAMAGECOUNT value on done: 105878.0 [2024-08-06 00:23:41,490][52647] Sum rewards: 43.302, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.402', 'ARMOR': '0.004', 'AMMO5': '0.008', 'weapon5': '0.058', 'AMMO2': '0.059', 'WEAPON5': '0.150', 'weapon2': '0.246', 'AMMO3': '0.264', 'AMMO4': '0.295', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.126', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '40.000'} [2024-08-06 00:23:41,639][52671] DAMAGECOUNT value on done: 102872.0 [2024-08-06 00:23:41,640][52671] Sum rewards: 52.769, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.036', 'AMMO4': '0.081', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.452', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.254', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:41,672][52665] DAMAGECOUNT value on done: 105510.0 [2024-08-06 00:23:41,673][52665] Sum rewards: 53.743, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO4': '0.147', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.330', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:42,230][52670] DAMAGECOUNT value on done: 104341.0 [2024-08-06 00:23:42,235][52670] Sum rewards: 46.562, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.860', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.240', 'weapon4': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.400', 'weapon3': '2.716', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:42,287][52663] DAMAGECOUNT value on done: 105909.0 [2024-08-06 00:23:42,287][52663] Sum rewards: 46.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.992', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.504', 'WEAPON3': '1.250', 'HITCOUNT': '2.450', 'weapon3': '2.820', 'DAMAGECOUNT': '11.322', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:42,611][52811] DAMAGECOUNT value on done: 97163.0 [2024-08-06 00:23:42,611][52811] Sum rewards: 58.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.130', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.200', 'weapon2': '0.492', 'WEAPON3': '0.950', 'HITCOUNT': '2.920', 'weapon3': '3.012', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:42,733][52664] DAMAGECOUNT value on done: 104961.0 [2024-08-06 00:23:42,734][52664] Sum rewards: 51.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.009', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.221', 'weapon4': '0.228', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 182788096. Throughput: 0: 4390.0. Samples: 45706600. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 00:23:42,795][52567] Avg episode reward: [(0, '53.376')] [2024-08-06 00:23:43,178][52666] DAMAGECOUNT value on done: 103449.0 [2024-08-06 00:23:43,178][52666] Sum rewards: 49.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.236', 'ARMOR': '0.005', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.102', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon4': '0.276', 'WEAPON4': '0.550', 'weapon2': '0.890', 'WEAPON3': '1.100', 'weapon3': '2.528', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '44.000'} [2024-08-06 00:23:43,262][52659] DAMAGECOUNT value on done: 102604.0 [2024-08-06 00:23:43,262][52659] Sum rewards: 44.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.278', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.187', 'weapon5': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.472', 'weapon2': '0.538', 'WEAPON3': '1.050', 'HITCOUNT': '2.420', 'weapon3': '2.438', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '38.000'} [2024-08-06 00:23:43,971][52647] DAMAGECOUNT value on done: 105690.0 [2024-08-06 00:23:43,971][52647] Sum rewards: 51.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.382', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.970', 'WEAPON3': '1.450', 'weapon3': '2.698', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:44,429][52671] DAMAGECOUNT value on done: 105571.0 [2024-08-06 00:23:44,430][52671] Sum rewards: 58.680, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.342', 'weapon2': '0.792', 'WEAPON3': '1.050', 'weapon3': '2.698', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:44,631][52665] DAMAGECOUNT value on done: 104146.0 [2024-08-06 00:23:44,632][52665] Sum rewards: 49.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon5': '0.140', 'AMMO3': '0.184', 'AMMO4': '0.243', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.566', 'weapon2': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.318', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '43.000'} [2024-08-06 00:23:45,102][52664] DAMAGECOUNT value on done: 105507.0 [2024-08-06 00:23:45,102][52664] Sum rewards: 56.755, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.605', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.108', 'AMMO3': '0.113', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.484', 'WEAPON3': '0.700', 'weapon2': '0.916', 'weapon3': '2.360', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '44.500'} [2024-08-06 00:23:45,326][52670] DAMAGECOUNT value on done: 102882.0 [2024-08-06 00:23:45,339][52670] Sum rewards: 58.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.088', 'weapon4': '0.110', 'AMMO4': '0.155', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:45,425][52663] DAMAGECOUNT value on done: 104181.0 [2024-08-06 00:23:45,426][52663] Sum rewards: 45.337, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.370', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.148', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.510', 'WEAPON3': '1.550', 'weapon3': '2.634', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:46,216][52650] Updated weights for policy 0, policy_version 22321 (0.0028) [2024-08-06 00:23:46,232][52659] DAMAGECOUNT value on done: 102827.0 [2024-08-06 00:23:46,235][52659] Sum rewards: 58.424, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.015', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.255', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '49.000'} [2024-08-06 00:23:46,322][52647] DAMAGECOUNT value on done: 106806.0 [2024-08-06 00:23:46,324][52647] Sum rewards: 54.185, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'weapon4': '0.510', 'weapon2': '0.682', 'WEAPON3': '0.950', 'weapon3': '2.594', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:46,388][52614] Signal inference workers to stop experience collection... (4150 times) [2024-08-06 00:23:46,393][52614] Signal inference workers to resume experience collection... (4150 times) [2024-08-06 00:23:46,470][52650] InferenceWorker_p0-w0: stopping experience collection (4150 times) [2024-08-06 00:23:46,471][52650] InferenceWorker_p0-w0: resuming experience collection (4150 times) [2024-08-06 00:23:47,394][52671] DAMAGECOUNT value on done: 103631.0 [2024-08-06 00:23:47,396][52671] Sum rewards: 52.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO2': '0.053', 'AMMO3': '0.236', 'AMMO4': '0.264', 'weapon2': '0.440', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.780', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 182878208. Throughput: 0: 4395.8. Samples: 45719700. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 00:23:47,795][52567] Avg episode reward: [(0, '53.531')] [2024-08-06 00:23:47,880][52665] DAMAGECOUNT value on done: 102548.0 [2024-08-06 00:23:47,884][52665] Sum rewards: 49.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.148', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.698', 'WEAPON3': '1.400', 'weapon3': '2.612', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '42.000'} [2024-08-06 00:23:48,044][52663] DAMAGECOUNT value on done: 106435.0 [2024-08-06 00:23:48,044][52663] Sum rewards: 66.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.658', 'AMMO2': '0.010', 'weapon4': '0.046', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.246', 'weapon2': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.528', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2024-08-06 00:23:48,463][52670] DAMAGECOUNT value on done: 101293.0 [2024-08-06 00:23:48,464][52670] Sum rewards: 52.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.238', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.614', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.022', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:49,001][52647] DAMAGECOUNT value on done: 105126.0 [2024-08-06 00:23:49,001][52647] Sum rewards: 41.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.278', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.189', 'AMMO4': '0.195', 'WEAPON4': '0.400', 'weapon4': '0.428', 'weapon2': '0.594', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.772', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '39.000'} [2024-08-06 00:23:49,333][52659] DAMAGECOUNT value on done: 104440.0 [2024-08-06 00:23:49,336][52659] Sum rewards: 57.397, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.296', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.072', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.122', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '52.000'} [2024-08-06 00:23:50,343][52671] DAMAGECOUNT value on done: 103539.0 [2024-08-06 00:23:50,344][52671] Sum rewards: 58.687, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.038', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.267', 'weapon4': '0.358', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '2.796', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '53.000'} [2024-08-06 00:23:50,599][52650] Updated weights for policy 0, policy_version 22331 (0.0041) [2024-08-06 00:23:50,949][52663] DAMAGECOUNT value on done: 104537.0 [2024-08-06 00:23:50,950][52663] Sum rewards: 57.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.165', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.032', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:50,984][52665] DAMAGECOUNT value on done: 102014.0 [2024-08-06 00:23:50,984][52665] Sum rewards: 48.860, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.620', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.293', 'weapon2': '0.358', 'WEAPON3': '1.750', 'HITCOUNT': '2.800', 'weapon3': '3.334', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '47.000'} [2024-08-06 00:23:51,401][52670] DAMAGECOUNT value on done: 99110.0 [2024-08-06 00:23:51,405][52670] Sum rewards: 43.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.824', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.185', 'weapon5': '0.202', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.376', 'weapon4': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.776', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '37.000'} [2024-08-06 00:23:51,569][52647] DAMAGECOUNT value on done: 108670.0 [2024-08-06 00:23:51,571][52647] Sum rewards: 44.039, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.478', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO4': '0.226', 'AMMO3': '0.260', 'WEAPON4': '0.450', 'weapon4': '0.524', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '2.664', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '41.000'} [2024-08-06 00:23:51,937][52659] DAMAGECOUNT value on done: 103377.0 [2024-08-06 00:23:51,940][52659] Sum rewards: 30.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.739', 'AMMO5': '0.007', 'weapon5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.055', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'AMMO4': '0.276', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.500', 'HITCOUNT': '2.140', 'weapon3': '2.808', 'DAMAGECOUNT': '9.885', 'FRAGCOUNT': '31.000'} [2024-08-06 00:23:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17613.2, 300 sec: 17578.1). Total num frames: 182968320. Throughput: 0: 4404.0. Samples: 45746450. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 00:23:52,795][52567] Avg episode reward: [(0, '52.955')] [2024-08-06 00:23:53,108][52671] DAMAGECOUNT value on done: 107512.0 [2024-08-06 00:23:53,108][52671] Sum rewards: 56.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.333', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.088', 'AMMO4': '0.178', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.112', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '48.000'} [2024-08-06 00:23:53,348][52663] DAMAGECOUNT value on done: 106466.0 [2024-08-06 00:23:53,351][52663] Sum rewards: 55.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.025', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.120', 'AMMO3': '0.154', 'AMMO4': '0.237', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON4': '0.800', 'weapon4': '0.866', 'WEAPON3': '1.050', 'weapon3': '2.192', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '49.500'} [2024-08-06 00:23:54,080][52647] DAMAGECOUNT value on done: 109621.0 [2024-08-06 00:23:54,080][52647] Sum rewards: 55.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.074', 'weapon5': '0.122', 'AMMO4': '0.139', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.226', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '46.000'} [2024-08-06 00:23:54,123][52665] DAMAGECOUNT value on done: 102878.0 [2024-08-06 00:23:54,124][52665] Sum rewards: 58.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO2': '0.053', 'AMMO3': '0.179', 'AMMO4': '0.263', 'weapon4': '0.318', 'WEAPON4': '0.600', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:54,989][52659] DAMAGECOUNT value on done: 105162.0 [2024-08-06 00:23:54,993][52659] Sum rewards: 40.945, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.615', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.128', 'weapon5': '0.174', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.442', 'weapon2': '0.582', 'WEAPON3': '0.800', 'HITCOUNT': '2.510', 'weapon3': '2.642', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '31.000'} [2024-08-06 00:23:55,390][52650] Updated weights for policy 0, policy_version 22341 (0.0017) [2024-08-06 00:23:56,188][52671] DAMAGECOUNT value on done: 103520.0 [2024-08-06 00:23:56,188][52671] Sum rewards: 58.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'weapon4': '0.212', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.638', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:56,332][52663] DAMAGECOUNT value on done: 102819.0 [2024-08-06 00:23:56,333][52663] Sum rewards: 58.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.212', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '50.000'} [2024-08-06 00:23:56,429][52647] DAMAGECOUNT value on done: 105522.0 [2024-08-06 00:23:56,429][52647] Sum rewards: 51.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.016', 'weapon4': '0.022', 'AMMO2': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.096', 'AMMO3': '0.179', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.770', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '2.942', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '43.500'} [2024-08-06 00:23:57,141][52665] DAMAGECOUNT value on done: 101855.0 [2024-08-06 00:23:57,141][52665] Sum rewards: 51.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.812', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '2.962', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '45.000'} [2024-08-06 00:23:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 183050240. Throughput: 0: 4404.0. Samples: 45772890. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 00:23:57,794][52567] Avg episode reward: [(0, '53.310')] [2024-08-06 00:23:57,877][52659] DAMAGECOUNT value on done: 105468.0 [2024-08-06 00:23:57,877][52659] Sum rewards: 57.949, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.688', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.058', 'AMMO3': '0.212', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.384', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '51.000'} [2024-08-06 00:23:58,891][52647] DAMAGECOUNT value on done: 109361.0 [2024-08-06 00:23:58,892][52647] Sum rewards: 63.240, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.975', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'ARMOR': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.227', 'weapon2': '0.228', 'WEAPON3': '1.550', 'HITCOUNT': '3.290', 'weapon3': '3.330', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2024-08-06 00:23:58,937][52671] DAMAGECOUNT value on done: 100427.0 [2024-08-06 00:23:58,938][52671] Sum rewards: 46.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.110', 'weapon5': '0.116', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '3.228', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '39.500'} [2024-08-06 00:24:00,239][52650] Updated weights for policy 0, policy_version 22351 (0.0017) [2024-08-06 00:24:00,645][52665] DAMAGECOUNT value on done: 100165.0 [2024-08-06 00:24:00,646][52665] Sum rewards: 51.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.356', 'weapon2': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.650', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '44.000'} [2024-08-06 00:24:00,707][52659] DAMAGECOUNT value on done: 101225.0 [2024-08-06 00:24:00,711][52659] Sum rewards: 47.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.131', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.120', 'AMMO3': '0.214', 'weapon2': '0.388', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.296', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '40.500'} [2024-08-06 00:24:01,710][52647] DAMAGECOUNT value on done: 105323.0 [2024-08-06 00:24:01,710][52647] Sum rewards: 51.300, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.136', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.414', 'weapon2': '0.492', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '41.000'} [2024-08-06 00:24:02,047][52671] DAMAGECOUNT value on done: 106151.0 [2024-08-06 00:24:02,048][52671] Sum rewards: 54.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.164', 'weapon5': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '45.000'} [2024-08-06 00:24:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 183140352. Throughput: 0: 4397.8. Samples: 45785820. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:24:02,794][52567] Avg episode reward: [(0, '53.180')] [2024-08-06 00:24:03,758][52665] DAMAGECOUNT value on done: 101766.0 [2024-08-06 00:24:03,759][52665] Sum rewards: 52.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.232', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.192', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.560', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '47.000'} [2024-08-06 00:24:03,790][52659] DAMAGECOUNT value on done: 101868.0 [2024-08-06 00:24:03,792][52659] Sum rewards: 49.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.195', 'weapon2': '0.716', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '2.992', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '42.000'} [2024-08-06 00:24:04,186][52647] DAMAGECOUNT value on done: 108172.0 [2024-08-06 00:24:04,187][52647] Sum rewards: 57.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.198', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.136', 'AMMO4': '0.187', 'weapon5': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.468', 'weapon4': '0.512', 'WEAPON3': '0.850', 'weapon3': '2.534', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '49.000'} [2024-08-06 00:24:04,470][52650] Updated weights for policy 0, policy_version 22361 (0.0024) [2024-08-06 00:24:04,885][52671] DAMAGECOUNT value on done: 103272.0 [2024-08-06 00:24:04,887][52671] Sum rewards: 48.183, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.095', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.126', 'AMMO4': '0.181', 'weapon5': '0.184', 'AMMO3': '0.214', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '3.124', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '43.000'} [2024-08-06 00:24:06,623][52659] DAMAGECOUNT value on done: 105723.0 [2024-08-06 00:24:06,623][52659] Sum rewards: 53.403, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.607', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon4': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.384', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.338', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '46.000'} [2024-08-06 00:24:06,851][52665] DAMAGECOUNT value on done: 96188.0 [2024-08-06 00:24:06,851][52665] Sum rewards: 62.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.216', 'weapon2': '0.466', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.318', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '52.000'} [2024-08-06 00:24:07,499][52647] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:24:07,600][52671] DAMAGECOUNT value on done: 104787.0 [2024-08-06 00:24:07,603][52671] Sum rewards: 52.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.367', 'AMMO5': '0.017', 'AMMO2': '0.028', 'ARMOR': '0.048', 'AMMO4': '0.141', 'weapon5': '0.236', 'AMMO3': '0.248', 'weapon2': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.764', 'WEAPON3': '1.500', 'weapon3': '2.282', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '48.000'} [2024-08-06 00:24:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 183230464. Throughput: 0: 4396.7. Samples: 45812070. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:24:07,794][52567] Avg episode reward: [(0, '53.082')] [2024-08-06 00:24:08,185][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:24:09,011][52795] DAMAGECOUNT value on done: 95797.0 [2024-08-06 00:24:09,012][52795] Sum rewards: 50.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.576', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.209', 'weapon2': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '43.000'} [2024-08-06 00:24:09,487][52650] Updated weights for policy 0, policy_version 22371 (0.0024) [2024-08-06 00:24:09,697][52659] DAMAGECOUNT value on done: 103114.0 [2024-08-06 00:24:09,701][52659] Sum rewards: 47.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.350', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.043', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.216', 'AMMO3': '0.282', 'weapon2': '0.312', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.020', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '44.000'} [2024-08-06 00:24:09,797][52665] DAMAGECOUNT value on done: 99825.0 [2024-08-06 00:24:09,797][52665] Sum rewards: 57.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.134', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.550', 'weapon4': '0.550', 'weapon2': '0.634', 'WEAPON3': '0.950', 'weapon3': '2.486', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '49.000'} [2024-08-06 00:24:10,644][52671] DAMAGECOUNT value on done: 103783.0 [2024-08-06 00:24:10,644][52671] Sum rewards: 48.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.568', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.698', 'WEAPON3': '1.400', 'weapon3': '2.498', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '42.000'} [2024-08-06 00:24:12,129][52795] DAMAGECOUNT value on done: 92622.0 [2024-08-06 00:24:12,129][52795] Sum rewards: 58.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.460', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'weapon4': '0.520', 'weapon2': '0.584', 'WEAPON3': '1.600', 'weapon3': '2.588', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '51.000'} [2024-08-06 00:24:12,223][52665] DAMAGECOUNT value on done: 101194.0 [2024-08-06 00:24:12,224][52665] Sum rewards: 59.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.635', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.110', 'AMMO3': '0.236', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.380', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '51.000'} [2024-08-06 00:24:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 183320576. Throughput: 0: 4406.2. Samples: 45838600. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 00:24:12,795][52567] Avg episode reward: [(0, '53.374')] [2024-08-06 00:24:12,840][52659] DAMAGECOUNT value on done: 99835.0 [2024-08-06 00:24:12,841][52659] Sum rewards: 50.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.948', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'AMMO4': '0.190', 'weapon4': '0.210', 'WEAPON4': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.932', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '44.000'} [2024-08-06 00:24:13,685][52671] DAMAGECOUNT value on done: 103711.0 [2024-08-06 00:24:13,687][52671] Sum rewards: 57.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.517', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.028', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.198', 'WEAPON5': '0.350', 'weapon2': '0.696', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '47.500'} [2024-08-06 00:24:13,780][52650] Updated weights for policy 0, policy_version 22381 (0.0012) [2024-08-06 00:24:15,213][52795] DAMAGECOUNT value on done: 93907.0 [2024-08-06 00:24:15,218][52795] Sum rewards: 62.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO2': '0.018', 'ARMOR': '0.024', 'AMMO4': '0.087', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '52.000'} [2024-08-06 00:24:16,034][52659] DAMAGECOUNT value on done: 100423.0 [2024-08-06 00:24:16,035][52659] Sum rewards: 57.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.433', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.089', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '50.000'} [2024-08-06 00:24:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 183410688. Throughput: 0: 4406.4. Samples: 45852010. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 00:24:17,794][52567] Avg episode reward: [(0, '53.637')] [2024-08-06 00:24:18,512][52795] DAMAGECOUNT value on done: 96030.0 [2024-08-06 00:24:18,512][52795] Sum rewards: 54.848, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.505', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.063', 'weapon5': '0.118', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon4': '0.312', 'AMMO4': '0.313', 'WEAPON4': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.550', 'weapon3': '2.724', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '49.000'} [2024-08-06 00:24:18,544][52650] Updated weights for policy 0, policy_version 22391 (0.0037) [2024-08-06 00:24:18,702][52659] DAMAGECOUNT value on done: 105520.0 [2024-08-06 00:24:18,702][52659] Sum rewards: 58.936, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.265', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO4': '0.114', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '2.922', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '49.000'} [2024-08-06 00:24:21,436][52659] DAMAGECOUNT value on done: 104223.0 [2024-08-06 00:24:21,438][52659] Sum rewards: 42.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.047', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO4': '0.234', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.406', 'weapon2': '0.544', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '2.686', 'DAMAGECOUNT': '12.117', 'FRAGCOUNT': '39.000'} [2024-08-06 00:24:21,716][52795] DAMAGECOUNT value on done: 98030.0 [2024-08-06 00:24:21,719][52795] Sum rewards: 58.705, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.558', 'AMMO5': '0.008', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'AMMO4': '0.144', 'weapon2': '0.192', 'WEAPON4': '0.300', 'weapon4': '0.814', 'WEAPON3': '0.900', 'weapon3': '2.716', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '47.000'} [2024-08-06 00:24:22,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 183492608. Throughput: 0: 4399.8. Samples: 45878150. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 00:24:22,802][52567] Avg episode reward: [(0, '53.668')] [2024-08-06 00:24:23,694][52650] Updated weights for policy 0, policy_version 22401 (0.0027) [2024-08-06 00:24:24,864][52659] DAMAGECOUNT value on done: 109369.0 [2024-08-06 00:24:24,865][52659] Sum rewards: 57.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon5': '0.036', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.554', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '50.000'} [2024-08-06 00:24:24,956][52795] DAMAGECOUNT value on done: 97360.0 [2024-08-06 00:24:24,958][52795] Sum rewards: 61.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.102', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '52.000'} [2024-08-06 00:24:27,573][52659] DAMAGECOUNT value on done: 105439.0 [2024-08-06 00:24:27,575][52659] Sum rewards: 61.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.466', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '54.000'} [2024-08-06 00:24:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 183582720. Throughput: 0: 4386.7. Samples: 45904000. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 00:24:27,794][52567] Avg episode reward: [(0, '53.888')] [2024-08-06 00:24:27,814][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022411_183590912.pth... [2024-08-06 00:24:27,831][52650] Updated weights for policy 0, policy_version 22411 (0.0011) [2024-08-06 00:24:27,950][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000021896_179372032.pth [2024-08-06 00:24:28,132][52795] DAMAGECOUNT value on done: 100244.0 [2024-08-06 00:24:28,134][52795] Sum rewards: 61.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.158', 'weapon4': '0.380', 'weapon2': '0.430', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '49.000'} [2024-08-06 00:24:30,511][52659] DAMAGECOUNT value on done: 104274.0 [2024-08-06 00:24:30,513][52659] Sum rewards: 50.662, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.540', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.158', 'AMMO4': '0.197', 'AMMO3': '0.243', 'WEAPON5': '0.400', 'weapon2': '0.444', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.630', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '46.000'} [2024-08-06 00:24:31,326][52795] DAMAGECOUNT value on done: 98094.0 [2024-08-06 00:24:31,334][52795] Sum rewards: 52.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.615', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon5': '0.222', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.012', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '45.000'} [2024-08-06 00:24:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 183664640. Throughput: 0: 4378.9. Samples: 45916750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-06 00:24:32,794][52567] Avg episode reward: [(0, '53.902')] [2024-08-06 00:24:32,857][52650] Updated weights for policy 0, policy_version 22421 (0.0010) [2024-08-06 00:24:32,994][52659] DAMAGECOUNT value on done: 107998.0 [2024-08-06 00:24:32,995][52659] Sum rewards: 59.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.310', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.400', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '50.500'} [2024-08-06 00:24:34,396][52795] DAMAGECOUNT value on done: 94969.0 [2024-08-06 00:24:34,397][52795] Sum rewards: 65.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.410', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.474', 'WEAPON3': '1.650', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '58.000'} [2024-08-06 00:24:35,601][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:24:36,175][52659] DAMAGECOUNT value on done: 106128.0 [2024-08-06 00:24:36,176][52659] Sum rewards: 54.370, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.220', 'weapon2': '0.452', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.194', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '48.000'} [2024-08-06 00:24:37,567][52795] DAMAGECOUNT value on done: 98628.0 [2024-08-06 00:24:37,570][52795] Sum rewards: 46.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.138', 'AMMO4': '0.174', 'weapon5': '0.182', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.512', 'weapon2': '0.572', 'WEAPON3': '0.850', 'weapon3': '2.482', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '37.000'} [2024-08-06 00:24:37,653][52650] Updated weights for policy 0, policy_version 22431 (0.0021) [2024-08-06 00:24:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 183754752. Throughput: 0: 4364.4. Samples: 45942850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-06 00:24:37,795][52567] Avg episode reward: [(0, '53.900')] [2024-08-06 00:24:37,888][52662] DAMAGECOUNT value on done: 109722.0 [2024-08-06 00:24:37,890][52662] Sum rewards: 58.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.727', 'AMMO5': '0.014', 'ARMOR': '0.028', 'AMMO2': '0.041', 'AMMO3': '0.183', 'AMMO4': '0.207', 'weapon5': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.478', 'weapon4': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.394', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '48.000'} [2024-08-06 00:24:40,690][52795] DAMAGECOUNT value on done: 98039.0 [2024-08-06 00:24:40,691][52795] Sum rewards: 44.426, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.157', 'weapon5': '0.182', 'AMMO4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'weapon4': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '2.470', 'weapon3': '2.558', 'DAMAGECOUNT': '11.073', 'FRAGCOUNT': '36.000'} [2024-08-06 00:24:40,984][52662] DAMAGECOUNT value on done: 112134.0 [2024-08-06 00:24:40,986][52662] Sum rewards: 49.633, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.247', 'weapon4': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.622', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '43.500'} [2024-08-06 00:24:42,288][52650] Updated weights for policy 0, policy_version 22441 (0.0015) [2024-08-06 00:24:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 183844864. Throughput: 0: 4346.4. Samples: 45968480. Policy #0 lag: (min: 0.0, avg: 3.3, max: 9.0) [2024-08-06 00:24:42,795][52567] Avg episode reward: [(0, '53.775')] [2024-08-06 00:24:43,788][52795] DAMAGECOUNT value on done: 95170.0 [2024-08-06 00:24:43,789][52795] Sum rewards: 49.751, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.234', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.002', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '45.000'} [2024-08-06 00:24:43,797][52662] DAMAGECOUNT value on done: 114950.0 [2024-08-06 00:24:43,798][52662] Sum rewards: 52.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.345', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.220', 'weapon4': '0.232', 'weapon5': '0.236', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.026', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '46.500'} [2024-08-06 00:24:45,063][52668] DAMAGECOUNT value on done: 104182.0 [2024-08-06 00:24:45,064][52668] Sum rewards: 55.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.600', 'ARMOR': '0.033', 'AMMO2': '0.055', 'AMMO3': '0.261', 'AMMO4': '0.273', 'weapon2': '0.286', 'WEAPON4': '0.550', 'weapon4': '0.610', 'WEAPON3': '1.650', 'weapon3': '2.884', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '50.000'} [2024-08-06 00:24:46,589][52662] DAMAGECOUNT value on done: 104189.0 [2024-08-06 00:24:46,589][52662] Sum rewards: 65.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.443', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '55.000'} [2024-08-06 00:24:46,954][52795] DAMAGECOUNT value on done: 97294.0 [2024-08-06 00:24:46,955][52795] Sum rewards: 53.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.386', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.125', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.428', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '3.036', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '45.000'} [2024-08-06 00:24:47,362][52650] Updated weights for policy 0, policy_version 22451 (0.0012) [2024-08-06 00:24:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 183926784. Throughput: 0: 4351.5. Samples: 45981640. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 00:24:47,795][52567] Avg episode reward: [(0, '53.983')] [2024-08-06 00:24:47,857][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:24:47,876][52668] DAMAGECOUNT value on done: 109302.0 [2024-08-06 00:24:47,877][52668] Sum rewards: 57.607, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.095', 'AMMO3': '0.154', 'weapon2': '0.948', 'WEAPON3': '0.950', 'weapon3': '2.808', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '46.000'} [2024-08-06 00:24:47,968][52794] DAMAGECOUNT value on done: 112825.0 [2024-08-06 00:24:47,969][52794] Sum rewards: 43.591, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.995', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.168', 'AMMO4': '0.213', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.930', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.642', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '40.000'} [2024-08-06 00:24:48,958][52662] DAMAGECOUNT value on done: 109526.0 [2024-08-06 00:24:48,958][52662] Sum rewards: 50.523, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.127', 'weapon5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.394', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.068', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '42.000'} [2024-08-06 00:24:50,112][52795] DAMAGECOUNT value on done: 95999.0 [2024-08-06 00:24:50,112][52795] Sum rewards: 39.034, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.602', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.182', 'AMMO3': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.536', 'weapon2': '0.706', 'WEAPON3': '1.250', 'HITCOUNT': '2.290', 'weapon3': '2.344', 'DAMAGECOUNT': '10.881', 'FRAGCOUNT': '36.500'} [2024-08-06 00:24:50,725][52794] DAMAGECOUNT value on done: 110569.0 [2024-08-06 00:24:50,730][52794] Sum rewards: 58.382, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.289', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'AMMO4': '0.265', 'weapon4': '0.398', 'weapon2': '0.418', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '53.000'} [2024-08-06 00:24:50,803][52668] DAMAGECOUNT value on done: 104787.0 [2024-08-06 00:24:50,804][52668] Sum rewards: 49.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.466', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.161', 'weapon5': '0.250', 'AMMO4': '0.301', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON4': '0.650', 'weapon4': '0.878', 'WEAPON3': '1.000', 'weapon3': '2.020', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '42.000'} [2024-08-06 00:24:51,424][52650] Updated weights for policy 0, policy_version 22461 (0.0012) [2024-08-06 00:24:52,057][52662] DAMAGECOUNT value on done: 111085.0 [2024-08-06 00:24:52,065][52662] Sum rewards: 55.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '46.000'} [2024-08-06 00:24:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 184016896. Throughput: 0: 4354.0. Samples: 46008000. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 00:24:52,794][52567] Avg episode reward: [(0, '53.582')] [2024-08-06 00:24:53,223][52795] DAMAGECOUNT value on done: 94204.0 [2024-08-06 00:24:53,225][52795] Sum rewards: 56.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.804', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.124', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.374', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '49.000'} [2024-08-06 00:24:53,873][52794] DAMAGECOUNT value on done: 107037.0 [2024-08-06 00:24:53,874][52794] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.706', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.050', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.556', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '51.000'} [2024-08-06 00:24:53,968][52668] DAMAGECOUNT value on done: 105508.0 [2024-08-06 00:24:53,972][52668] Sum rewards: 52.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.160', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.824', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '47.000'} [2024-08-06 00:24:55,175][52662] DAMAGECOUNT value on done: 111974.0 [2024-08-06 00:24:55,176][52662] Sum rewards: 56.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '48.000'} [2024-08-06 00:24:56,303][52795] DAMAGECOUNT value on done: 98686.0 [2024-08-06 00:24:56,303][52795] Sum rewards: 53.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.042', 'AMMO5': '0.004', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.446', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.124', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '47.000'} [2024-08-06 00:24:56,563][52650] Updated weights for policy 0, policy_version 22471 (0.0011) [2024-08-06 00:24:56,950][52794] DAMAGECOUNT value on done: 104605.0 [2024-08-06 00:24:56,952][52794] Sum rewards: 56.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.979', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.191', 'weapon4': '0.252', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '47.000'} [2024-08-06 00:24:57,018][52668] DAMAGECOUNT value on done: 105602.0 [2024-08-06 00:24:57,023][52668] Sum rewards: 47.207, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.074', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.388', 'weapon4': '0.414', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '2.894', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '39.000'} [2024-08-06 00:24:57,497][52660] DAMAGECOUNT value on done: 102315.0 [2024-08-06 00:24:57,497][52660] Sum rewards: 52.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.688', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '45.000'} [2024-08-06 00:24:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 184107008. Throughput: 0: 4346.9. Samples: 46034210. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 00:24:57,794][52567] Avg episode reward: [(0, '53.326')] [2024-08-06 00:24:57,978][52662] DAMAGECOUNT value on done: 115970.0 [2024-08-06 00:24:57,980][52662] Sum rewards: 56.091, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.262', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.314', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '51.000'} [2024-08-06 00:24:59,473][52795] DAMAGECOUNT value on done: 100582.0 [2024-08-06 00:24:59,474][52795] Sum rewards: 56.306, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.642', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.278', 'weapon2': '0.298', 'WEAPON4': '0.300', 'AMMO3': '0.339', 'WEAPON3': '2.000', 'weapon3': '2.996', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '54.000'} [2024-08-06 00:24:59,611][52794] DAMAGECOUNT value on done: 108712.0 [2024-08-06 00:24:59,612][52794] Sum rewards: 59.022, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.023', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.264', 'weapon2': '0.332', 'WEAPON3': '1.700', 'HITCOUNT': '3.340', 'weapon3': '3.478', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '54.000'} [2024-08-06 00:24:59,634][52668] DAMAGECOUNT value on done: 103960.0 [2024-08-06 00:24:59,636][52668] Sum rewards: 49.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.677', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.134', 'AMMO3': '0.166', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.468', 'weapon4': '0.494', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.630', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:00,290][52660] DAMAGECOUNT value on done: 105316.0 [2024-08-06 00:25:00,291][52660] Sum rewards: 59.686, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.313', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'AMMO3': '0.286', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.750', 'weapon3': '2.822', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '54.000'} [2024-08-06 00:25:00,795][52662] DAMAGECOUNT value on done: 108862.0 [2024-08-06 00:25:00,795][52662] Sum rewards: 55.724, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.065', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.244', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.296', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:01,163][52650] Updated weights for policy 0, policy_version 22481 (0.0014) [2024-08-06 00:25:01,776][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:25:01,985][52649] Large shaping reward 3.261 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.21, 70.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:25:02,381][52794] DAMAGECOUNT value on done: 110399.0 [2024-08-06 00:25:02,382][52794] Sum rewards: 47.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.006', 'weapon5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.784', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:02,647][52795] DAMAGECOUNT value on done: 94611.0 [2024-08-06 00:25:02,658][52795] Sum rewards: 48.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.014', 'AMMO2': '0.040', 'ARMOR': '0.040', 'weapon5': '0.176', 'AMMO3': '0.188', 'AMMO4': '0.198', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.646', 'weapon4': '0.732', 'WEAPON3': '1.100', 'weapon3': '2.020', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:02,788][52668] DAMAGECOUNT value on done: 106153.0 [2024-08-06 00:25:02,789][52668] Sum rewards: 39.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.882', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.124', 'AMMO4': '0.305', 'weapon5': '0.438', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '0.700', 'WEAPON4': '0.750', 'weapon4': '0.792', 'weapon3': '1.866', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.398', 'FRAGCOUNT': '34.000'} [2024-08-06 00:25:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 184188928. Throughput: 0: 4342.7. Samples: 46047430. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 00:25:02,794][52567] Avg episode reward: [(0, '53.543')] [2024-08-06 00:25:03,368][52660] DAMAGECOUNT value on done: 107011.0 [2024-08-06 00:25:03,369][52660] Sum rewards: 64.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.072', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '54.000'} [2024-08-06 00:25:03,777][52662] DAMAGECOUNT value on done: 112131.0 [2024-08-06 00:25:03,777][52662] Sum rewards: 45.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.043', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.150', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.756', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '39.000'} [2024-08-06 00:25:04,368][52666] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:25:05,413][52794] DAMAGECOUNT value on done: 113186.0 [2024-08-06 00:25:05,414][52794] Sum rewards: 49.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.665', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.024', 'weapon5': '0.042', 'weapon4': '0.054', 'AMMO4': '0.122', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.744', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '2.934', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:05,618][52650] Updated weights for policy 0, policy_version 22491 (0.0034) [2024-08-06 00:25:05,636][52668] DAMAGECOUNT value on done: 108351.0 [2024-08-06 00:25:05,637][52668] Sum rewards: 57.931, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.974', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '49.000'} [2024-08-06 00:25:05,815][52795] DAMAGECOUNT value on done: 98736.0 [2024-08-06 00:25:05,816][52795] Sum rewards: 54.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'AMMO4': '0.167', 'WEAPON4': '0.300', 'weapon4': '0.638', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.532', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '46.000'} [2024-08-06 00:25:06,308][52660] DAMAGECOUNT value on done: 106549.0 [2024-08-06 00:25:06,310][52660] Sum rewards: 56.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.466', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '46.000'} [2024-08-06 00:25:06,395][52662] DAMAGECOUNT value on done: 109635.0 [2024-08-06 00:25:06,398][52662] Sum rewards: 55.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.016', 'ARMOR': '0.032', 'AMMO2': '0.056', 'AMMO3': '0.182', 'weapon5': '0.196', 'AMMO4': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.454', 'weapon2': '0.598', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.508', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '46.000'} [2024-08-06 00:25:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 184279040. Throughput: 0: 4344.7. Samples: 46073660. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 00:25:07,794][52567] Avg episode reward: [(0, '53.635')] [2024-08-06 00:25:08,214][52794] DAMAGECOUNT value on done: 109358.0 [2024-08-06 00:25:08,215][52794] Sum rewards: 53.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '3.360', 'weapon3': '3.432', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '46.000'} [2024-08-06 00:25:08,308][52668] DAMAGECOUNT value on done: 106638.0 [2024-08-06 00:25:08,309][52668] Sum rewards: 57.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.226', 'AMMO3': '0.254', 'weapon2': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.276', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '51.000'} [2024-08-06 00:25:08,795][52660] DAMAGECOUNT value on done: 102511.0 [2024-08-06 00:25:08,797][52660] Sum rewards: 50.804, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.162', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.090', 'AMMO3': '0.245', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.362', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.756', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '45.500'} [2024-08-06 00:25:08,957][52795] DAMAGECOUNT value on done: 101345.0 [2024-08-06 00:25:08,957][52795] Sum rewards: 52.446, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.034', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.576', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.016', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:09,454][52662] DAMAGECOUNT value on done: 111971.0 [2024-08-06 00:25:09,455][52662] Sum rewards: 48.465, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.414', 'WEAPON3': '0.950', 'weapon3': '2.346', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:10,391][52650] Updated weights for policy 0, policy_version 22501 (0.0016) [2024-08-06 00:25:10,715][52667] DAMAGECOUNT value on done: 107481.0 [2024-08-06 00:25:10,715][52667] Sum rewards: 63.301, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'AMMO2': '0.028', 'HEALTH': '0.039', 'AMMO3': '0.139', 'AMMO4': '0.139', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.334', 'weapon2': '0.786', 'WEAPON3': '0.850', 'weapon3': '2.418', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '49.000'} [2024-08-06 00:25:11,060][52794] DAMAGECOUNT value on done: 109861.0 [2024-08-06 00:25:11,063][52794] Sum rewards: 56.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.035', 'ARMOR': '0.038', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO4': '0.176', 'WEAPON4': '0.500', 'weapon2': '0.534', 'weapon4': '0.602', 'WEAPON3': '0.950', 'weapon3': '2.560', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:11,201][52668] DAMAGECOUNT value on done: 107776.0 [2024-08-06 00:25:11,201][52668] Sum rewards: 49.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.288', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.157', 'AMMO4': '0.190', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '2.896', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:11,598][52669] DAMAGECOUNT value on done: 110562.0 [2024-08-06 00:25:11,598][52669] Sum rewards: 57.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'weapon2': '0.170', 'weapon4': '0.242', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.420', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '50.000'} [2024-08-06 00:25:11,889][52660] DAMAGECOUNT value on done: 103185.0 [2024-08-06 00:25:11,890][52660] Sum rewards: 47.935, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.846', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.129', 'AMMO4': '0.197', 'weapon4': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.620', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '2.862', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '40.000'} [2024-08-06 00:25:12,231][52662] DAMAGECOUNT value on done: 108475.0 [2024-08-06 00:25:12,234][52662] Sum rewards: 48.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.104', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.165', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.570', 'weapon4': '0.834', 'WEAPON3': '1.000', 'weapon3': '2.104', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '40.000'} [2024-08-06 00:25:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 184369152. Throughput: 0: 4359.3. Samples: 46100170. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 00:25:12,795][52567] Avg episode reward: [(0, '53.518')] [2024-08-06 00:25:13,635][52794] DAMAGECOUNT value on done: 113753.0 [2024-08-06 00:25:13,636][52794] Sum rewards: 57.067, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.150', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.374', 'weapon2': '0.610', 'WEAPON3': '0.800', 'weapon3': '2.712', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '45.000'} [2024-08-06 00:25:13,723][52667] DAMAGECOUNT value on done: 108579.0 [2024-08-06 00:25:13,723][52667] Sum rewards: 54.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.061', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'AMMO4': '0.303', 'weapon2': '0.328', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.884', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:14,197][52668] DAMAGECOUNT value on done: 104926.0 [2024-08-06 00:25:14,199][52668] Sum rewards: 65.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.785', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.281', 'weapon2': '0.346', 'WEAPON3': '1.800', 'weapon3': '3.416', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '58.000'} [2024-08-06 00:25:14,738][52669] DAMAGECOUNT value on done: 106565.0 [2024-08-06 00:25:14,738][52669] Sum rewards: 57.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.034', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.048', 'weapon5': '0.064', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.238', 'weapon2': '0.352', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:14,818][52660] DAMAGECOUNT value on done: 107354.0 [2024-08-06 00:25:14,818][52660] Sum rewards: 51.256, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.195', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.210', 'weapon2': '0.232', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.120', 'weapon3': '3.298', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:15,183][52650] Updated weights for policy 0, policy_version 22511 (0.0014) [2024-08-06 00:25:15,262][52662] DAMAGECOUNT value on done: 107598.0 [2024-08-06 00:25:15,263][52662] Sum rewards: 43.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.198', 'AMMO5': '0.014', 'ARMOR': '0.032', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.161', 'AMMO3': '0.162', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.472', 'FRAGCOUNT': '37.000'} [2024-08-06 00:25:15,418][52649] DAMAGECOUNT value on done: 103513.0 [2024-08-06 00:25:15,420][52649] Sum rewards: 43.160, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.969', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.198', 'AMMO3': '0.208', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.630', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '38.000'} [2024-08-06 00:25:16,410][52667] DAMAGECOUNT value on done: 107399.0 [2024-08-06 00:25:16,410][52667] Sum rewards: 56.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.009', 'AMMO2': '0.014', 'ARMOR': '0.020', 'weapon5': '0.036', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.496', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.694', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:16,680][52794] DAMAGECOUNT value on done: 107510.0 [2024-08-06 00:25:16,681][52794] Sum rewards: 47.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.679', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.069', 'weapon5': '0.148', 'AMMO3': '0.199', 'AMMO4': '0.346', 'weapon2': '0.374', 'WEAPON5': '0.400', 'weapon4': '0.668', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.508', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '41.500'} [2024-08-06 00:25:16,722][52668] DAMAGECOUNT value on done: 103444.0 [2024-08-06 00:25:16,723][52668] Sum rewards: 49.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.667', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.596', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.098', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:17,476][52660] DAMAGECOUNT value on done: 105880.0 [2024-08-06 00:25:17,476][52660] Sum rewards: 57.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.368', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.314', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '51.000'} [2024-08-06 00:25:17,625][52662] DAMAGECOUNT value on done: 106786.0 [2024-08-06 00:25:17,625][52662] Sum rewards: 46.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.014', 'AMMO5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.028', 'AMMO4': '0.127', 'weapon5': '0.146', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.688', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '40.000'} [2024-08-06 00:25:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 184459264. Throughput: 0: 4369.3. Samples: 46113370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 00:25:17,795][52567] Avg episode reward: [(0, '53.770')] [2024-08-06 00:25:17,810][52669] DAMAGECOUNT value on done: 105154.0 [2024-08-06 00:25:17,810][52669] Sum rewards: 57.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.106', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.060', 'weapon5': '0.066', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.362', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '50.000'} [2024-08-06 00:25:18,600][52649] DAMAGECOUNT value on done: 100870.0 [2024-08-06 00:25:18,600][52649] Sum rewards: 53.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.054', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.169', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '45.000'} [2024-08-06 00:25:19,379][52794] DAMAGECOUNT value on done: 111528.0 [2024-08-06 00:25:19,379][52794] Sum rewards: 57.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.400', 'weapon2': '0.480', 'weapon4': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.488', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '49.000'} [2024-08-06 00:25:19,531][52667] DAMAGECOUNT value on done: 104339.0 [2024-08-06 00:25:19,531][52667] Sum rewards: 58.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.487', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.756', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:19,723][52650] Updated weights for policy 0, policy_version 22521 (0.0012) [2024-08-06 00:25:19,831][52668] DAMAGECOUNT value on done: 98138.0 [2024-08-06 00:25:19,831][52668] Sum rewards: 45.429, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.271', 'AMMO5': '0.003', 'AMMO2': '0.022', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.110', 'AMMO3': '0.255', 'WEAPON4': '0.400', 'weapon4': '0.548', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.538', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '42.000'} [2024-08-06 00:25:20,408][52669] DAMAGECOUNT value on done: 104855.0 [2024-08-06 00:25:20,410][52669] Sum rewards: 59.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.002', 'weapon4': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon2': '0.484', 'WEAPON3': '1.000', 'HITCOUNT': '3.120', 'weapon3': '3.298', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '49.000'} [2024-08-06 00:25:20,671][52660] DAMAGECOUNT value on done: 106537.0 [2024-08-06 00:25:20,674][52660] Sum rewards: 58.042, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.253', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO3': '0.114', 'AMMO4': '0.146', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.604', 'WEAPON3': '0.750', 'weapon3': '2.584', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '45.000'} [2024-08-06 00:25:20,685][52662] DAMAGECOUNT value on done: 114476.0 [2024-08-06 00:25:20,687][52662] Sum rewards: 62.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.008', 'weapon5': '0.012', 'AMMO4': '0.033', 'weapon4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.274', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '52.000'} [2024-08-06 00:25:21,750][52649] DAMAGECOUNT value on done: 104233.0 [2024-08-06 00:25:21,751][52649] Sum rewards: 45.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.740', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.170', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.106', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '40.000'} [2024-08-06 00:25:22,417][52667] DAMAGECOUNT value on done: 108038.0 [2024-08-06 00:25:22,418][52667] Sum rewards: 47.642, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.060', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.086', 'weapon4': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'weapon2': '0.354', 'WEAPON3': '1.850', 'HITCOUNT': '2.900', 'weapon3': '3.234', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '44.500'} [2024-08-06 00:25:22,420][52794] DAMAGECOUNT value on done: 109022.0 [2024-08-06 00:25:22,421][52794] Sum rewards: 43.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.316', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.188', 'WEAPON4': '0.400', 'weapon4': '0.626', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '39.000'} [2024-08-06 00:25:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 184549376. Throughput: 0: 4376.7. Samples: 46139800. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 00:25:22,794][52567] Avg episode reward: [(0, '53.864')] [2024-08-06 00:25:23,018][52669] DAMAGECOUNT value on done: 105872.0 [2024-08-06 00:25:23,018][52669] Sum rewards: 42.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.328', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.136', 'AMMO4': '0.161', 'WEAPON7': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.738', 'WEAPON3': '0.800', 'weapon3': '2.290', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '11.070', 'FRAGCOUNT': '35.000'} [2024-08-06 00:25:23,019][52668] DAMAGECOUNT value on done: 105834.0 [2024-08-06 00:25:23,032][52668] Sum rewards: 47.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon4': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon2': '0.372', 'WEAPON3': '1.000', 'HITCOUNT': '2.590', 'weapon3': '3.414', 'DAMAGECOUNT': '11.502', 'FRAGCOUNT': '40.000'} [2024-08-06 00:25:23,645][52660] DAMAGECOUNT value on done: 105787.0 [2024-08-06 00:25:23,646][52660] Sum rewards: 53.520, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.874', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.136', 'AMMO4': '0.178', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.368', 'weapon4': '0.452', 'WEAPON3': '1.450', 'weapon3': '2.790', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:23,669][52662] DAMAGECOUNT value on done: 104254.0 [2024-08-06 00:25:23,671][52662] Sum rewards: 47.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.322', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '2.936', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:24,495][52650] Updated weights for policy 0, policy_version 22531 (0.0035) [2024-08-06 00:25:24,562][52649] DAMAGECOUNT value on done: 105500.0 [2024-08-06 00:25:24,562][52649] Sum rewards: 47.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.704', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.718', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '2.916', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '42.000'} [2024-08-06 00:25:24,634][52820] DAMAGECOUNT value on done: 95753.0 [2024-08-06 00:25:24,634][52820] Sum rewards: 40.992, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'ARMOR': '0.024', 'weapon5': '0.048', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'AMMO4': '0.280', 'weapon2': '0.398', 'weapon4': '0.446', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:25,281][52794] DAMAGECOUNT value on done: 116809.0 [2024-08-06 00:25:25,281][52794] Sum rewards: 66.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '55.000'} [2024-08-06 00:25:25,435][52667] DAMAGECOUNT value on done: 103803.0 [2024-08-06 00:25:25,436][52667] Sum rewards: 44.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.715', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.275', 'weapon2': '0.310', 'WEAPON3': '1.550', 'HITCOUNT': '2.630', 'weapon3': '3.554', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:25,482][52668] DAMAGECOUNT value on done: 105298.0 [2024-08-06 00:25:25,482][52668] Sum rewards: 44.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon4': '0.330', 'weapon2': '0.542', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.968', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:26,180][52669] DAMAGECOUNT value on done: 105918.0 [2024-08-06 00:25:26,181][52669] Sum rewards: 47.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.632', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO4': '0.193', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.516', 'WEAPON3': '1.500', 'weapon3': '2.558', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:26,213][52660] DAMAGECOUNT value on done: 106826.0 [2024-08-06 00:25:26,216][52660] Sum rewards: 62.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.149', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.368', 'weapon2': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.810', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '52.000'} [2024-08-06 00:25:26,244][52662] DAMAGECOUNT value on done: 111772.0 [2024-08-06 00:25:26,245][52662] Sum rewards: 44.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.456', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'weapon5': '0.122', 'AMMO4': '0.223', 'WEAPON4': '0.500', 'weapon4': '0.562', 'WEAPON3': '0.750', 'weapon2': '1.092', 'weapon3': '1.986', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.529', 'FRAGCOUNT': '37.000'} [2024-08-06 00:25:27,424][52649] DAMAGECOUNT value on done: 98657.0 [2024-08-06 00:25:27,424][52649] Sum rewards: 46.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.368', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.186', 'weapon2': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.466', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '3.158', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '40.000'} [2024-08-06 00:25:27,678][52820] DAMAGECOUNT value on done: 98680.0 [2024-08-06 00:25:27,678][52820] Sum rewards: 61.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.674', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.155', 'AMMO3': '0.198', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '52.000'} [2024-08-06 00:25:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 184631296. Throughput: 0: 4395.6. Samples: 46166280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 00:25:27,794][52567] Avg episode reward: [(0, '53.092')] [2024-08-06 00:25:27,841][52794] DAMAGECOUNT value on done: 105693.0 [2024-08-06 00:25:27,841][52794] Sum rewards: 49.890, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.912', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.131', 'AMMO4': '0.171', 'weapon5': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.688', 'WEAPON3': '0.800', 'weapon3': '2.508', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:28,082][52667] DAMAGECOUNT value on done: 107426.0 [2024-08-06 00:25:28,084][52667] Sum rewards: 55.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.062', 'AMMO4': '0.171', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.564', 'weapon4': '0.582', 'WEAPON3': '1.450', 'weapon3': '2.514', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '49.000'} [2024-08-06 00:25:28,485][52668] DAMAGECOUNT value on done: 106058.0 [2024-08-06 00:25:28,485][52668] Sum rewards: 43.117, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.076', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.478', 'WEAPON3': '1.550', 'HITCOUNT': '2.440', 'weapon3': '2.786', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '42.000'} [2024-08-06 00:25:28,903][52662] DAMAGECOUNT value on done: 108827.0 [2024-08-06 00:25:28,908][52662] Sum rewards: 53.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.295', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.074', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.308', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.332', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:28,931][52669] DAMAGECOUNT value on done: 106411.0 [2024-08-06 00:25:28,933][52669] Sum rewards: 49.746, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.562', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.200', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:29,105][52650] Updated weights for policy 0, policy_version 22541 (0.0013) [2024-08-06 00:25:29,307][52660] DAMAGECOUNT value on done: 101865.0 [2024-08-06 00:25:29,307][52660] Sum rewards: 47.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.038', 'AMMO3': '0.171', 'weapon5': '0.172', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.630', 'WEAPON3': '1.150', 'HITCOUNT': '2.400', 'weapon3': '2.662', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:30,297][52649] DAMAGECOUNT value on done: 101932.0 [2024-08-06 00:25:30,299][52649] Sum rewards: 53.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.052', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'AMMO4': '0.262', 'weapon2': '0.362', 'weapon4': '0.486', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:30,390][52667] DAMAGECOUNT value on done: 107999.0 [2024-08-06 00:25:30,393][52667] Sum rewards: 50.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.782', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '42.000'} [2024-08-06 00:25:30,899][52820] DAMAGECOUNT value on done: 96529.0 [2024-08-06 00:25:30,900][52820] Sum rewards: 53.128, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.598', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.244', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:30,988][52794] DAMAGECOUNT value on done: 112284.0 [2024-08-06 00:25:30,990][52794] Sum rewards: 56.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.490', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:31,660][52668] DAMAGECOUNT value on done: 103251.0 [2024-08-06 00:25:31,660][52668] Sum rewards: 47.186, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.910', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon4': '0.346', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.086', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:31,876][52669] DAMAGECOUNT value on done: 108008.0 [2024-08-06 00:25:31,878][52669] Sum rewards: 68.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.983', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.206', 'weapon2': '0.616', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '57.000'} [2024-08-06 00:25:32,031][52662] DAMAGECOUNT value on done: 107785.0 [2024-08-06 00:25:32,035][52662] Sum rewards: 44.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.054', 'AMMO5': '0.007', 'ARMOR': '0.028', 'weapon5': '0.032', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.196', 'weapon2': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.614', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '2.766', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '38.500'} [2024-08-06 00:25:32,447][52660] DAMAGECOUNT value on done: 103304.0 [2024-08-06 00:25:32,451][52660] Sum rewards: 37.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.285', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.059', 'weapon5': '0.178', 'AMMO3': '0.182', 'AMMO4': '0.293', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON4': '0.700', 'weapon4': '0.872', 'WEAPON3': '1.150', 'weapon3': '2.226', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.812', 'FRAGCOUNT': '36.000'} [2024-08-06 00:25:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 184721408. Throughput: 0: 4394.2. Samples: 46179380. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 00:25:32,794][52567] Avg episode reward: [(0, '52.294')] [2024-08-06 00:25:33,198][52649] DAMAGECOUNT value on done: 99227.0 [2024-08-06 00:25:33,198][52649] Sum rewards: 58.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO2': '0.015', 'weapon4': '0.074', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.265', 'weapon2': '0.404', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.324', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '52.000'} [2024-08-06 00:25:33,550][52667] DAMAGECOUNT value on done: 107227.0 [2024-08-06 00:25:33,553][52667] Sum rewards: 48.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.760', 'AMMO2': '0.027', 'ARMOR': '0.040', 'weapon4': '0.090', 'AMMO4': '0.137', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '3.240', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '41.000'} [2024-08-06 00:25:33,734][52650] Updated weights for policy 0, policy_version 22551 (0.0023) [2024-08-06 00:25:33,756][52794] DAMAGECOUNT value on done: 111651.0 [2024-08-06 00:25:33,757][52794] Sum rewards: 67.296, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.688', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.161', 'weapon4': '0.240', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '58.000'} [2024-08-06 00:25:34,060][52820] DAMAGECOUNT value on done: 92722.0 [2024-08-06 00:25:34,061][52820] Sum rewards: 44.460, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.624', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.141', 'weapon5': '0.180', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.400', 'weapon2': '0.574', 'WEAPON3': '0.900', 'HITCOUNT': '2.610', 'weapon3': '2.680', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '36.500'} [2024-08-06 00:25:34,381][52669] DAMAGECOUNT value on done: 107140.0 [2024-08-06 00:25:34,383][52669] Sum rewards: 58.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.945', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.149', 'AMMO4': '0.163', 'weapon4': '0.202', 'weapon5': '0.206', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.814', 'WEAPON3': '1.000', 'weapon3': '2.522', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '49.000'} [2024-08-06 00:25:34,466][52668] DAMAGECOUNT value on done: 105085.0 [2024-08-06 00:25:34,466][52668] Sum rewards: 55.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.352', 'AMMO2': '0.016', 'ARMOR': '0.023', 'AMMO4': '0.078', 'AMMO3': '0.224', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.568', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:35,255][52660] DAMAGECOUNT value on done: 106347.0 [2024-08-06 00:25:35,256][52660] Sum rewards: 54.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.455', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon5': '0.138', 'AMMO3': '0.171', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.450', 'weapon2': '0.652', 'WEAPON3': '0.950', 'weapon3': '2.616', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:36,251][52649] DAMAGECOUNT value on done: 106635.0 [2024-08-06 00:25:36,251][52649] Sum rewards: 56.530, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'AMMO2': '0.024', 'HEALTH': '0.075', 'AMMO4': '0.119', 'AMMO3': '0.133', 'weapon4': '0.136', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '0.800', 'HITCOUNT': '2.930', 'weapon3': '3.038', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '44.500'} [2024-08-06 00:25:36,627][52667] DAMAGECOUNT value on done: 109549.0 [2024-08-06 00:25:36,629][52667] Sum rewards: 47.125, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.640', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon5': '0.038', 'weapon4': '0.074', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.291', 'weapon2': '0.402', 'WEAPON3': '1.750', 'HITCOUNT': '2.730', 'weapon3': '3.188', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '45.000'} [2024-08-06 00:25:36,805][52794] DAMAGECOUNT value on done: 110280.0 [2024-08-06 00:25:36,807][52794] Sum rewards: 49.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.018', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.184', 'AMMO3': '0.234', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:37,096][52820] DAMAGECOUNT value on done: 97248.0 [2024-08-06 00:25:37,098][52820] Sum rewards: 47.940, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.202', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.044', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.266', 'weapon2': '0.370', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '1.500', 'weapon3': '2.664', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:37,164][52669] DAMAGECOUNT value on done: 104040.0 [2024-08-06 00:25:37,165][52669] Sum rewards: 49.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.408', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.216', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.442', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:37,286][52668] DAMAGECOUNT value on done: 108834.0 [2024-08-06 00:25:37,289][52668] Sum rewards: 61.387, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.426', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.139', 'AMMO3': '0.143', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.410', 'weapon2': '0.510', 'WEAPON3': '0.850', 'weapon3': '2.540', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 184811520. Throughput: 0: 4396.2. Samples: 46205830. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:25:37,794][52567] Avg episode reward: [(0, '52.591')] [2024-08-06 00:25:38,116][52660] DAMAGECOUNT value on done: 112900.0 [2024-08-06 00:25:38,117][52660] Sum rewards: 55.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.395', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.093', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.768', 'WEAPON3': '0.850', 'weapon3': '2.594', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:38,256][52650] Updated weights for policy 0, policy_version 22561 (0.0011) [2024-08-06 00:25:38,941][52649] DAMAGECOUNT value on done: 101613.0 [2024-08-06 00:25:38,942][52649] Sum rewards: 59.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.490', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.092', 'weapon5': '0.098', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON3': '0.550', 'weapon2': '0.856', 'weapon3': '2.596', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:39,614][52667] DAMAGECOUNT value on done: 108138.0 [2024-08-06 00:25:39,614][52667] Sum rewards: 61.226, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.154', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '51.000'} [2024-08-06 00:25:39,890][52669] DAMAGECOUNT value on done: 108744.0 [2024-08-06 00:25:39,890][52669] Sum rewards: 39.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.964', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.754', 'WEAPON3': '1.300', 'weapon3': '2.492', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '34.500'} [2024-08-06 00:25:39,917][52794] DAMAGECOUNT value on done: 116128.0 [2024-08-06 00:25:39,918][52794] Sum rewards: 51.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.594', 'AMMO5': '0.010', 'ARMOR': '0.016', 'weapon5': '0.046', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'AMMO4': '0.256', 'weapon2': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.864', 'WEAPON3': '1.350', 'weapon3': '2.614', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '45.000'} [2024-08-06 00:25:40,191][52820] DAMAGECOUNT value on done: 98924.0 [2024-08-06 00:25:40,195][52820] Sum rewards: 51.766, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.199', 'AMMO2': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon4': '0.042', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.704', 'WEAPON3': '1.550', 'weapon3': '2.890', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:40,418][52668] DAMAGECOUNT value on done: 107304.0 [2024-08-06 00:25:40,419][52668] Sum rewards: 57.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.060', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon4': '0.278', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.938', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '53.000'} [2024-08-06 00:25:41,353][52660] DAMAGECOUNT value on done: 104509.0 [2024-08-06 00:25:41,353][52660] Sum rewards: 43.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.781', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.122', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'AMMO4': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.348', 'weapon4': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '2.692', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '38.000'} [2024-08-06 00:25:41,694][52649] DAMAGECOUNT value on done: 104224.0 [2024-08-06 00:25:41,696][52649] Sum rewards: 64.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.708', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.125', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '55.000'} [2024-08-06 00:25:41,781][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:25:42,418][52669] DAMAGECOUNT value on done: 108214.0 [2024-08-06 00:25:42,419][52669] Sum rewards: 54.216, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.549', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.108', 'weapon5': '0.166', 'AMMO4': '0.167', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.500', 'WEAPON3': '0.800', 'weapon2': '0.804', 'weapon3': '2.308', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:42,448][52794] DAMAGECOUNT value on done: 109532.0 [2024-08-06 00:25:42,449][52794] Sum rewards: 55.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.144', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.194', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '49.000'} [2024-08-06 00:25:42,592][52667] DAMAGECOUNT value on done: 106304.0 [2024-08-06 00:25:42,592][52667] Sum rewards: 51.937, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.895', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.222', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 184893440. Throughput: 0: 4406.4. Samples: 46232500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:25:42,794][52567] Avg episode reward: [(0, '52.429')] [2024-08-06 00:25:42,924][52650] Updated weights for policy 0, policy_version 22571 (0.0021) [2024-08-06 00:25:43,249][52820] DAMAGECOUNT value on done: 98423.0 [2024-08-06 00:25:43,250][52820] Sum rewards: 45.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.385', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.338', 'weapon2': '0.422', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.836', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '38.000'} [2024-08-06 00:25:44,433][52670] Large shaping reward 2.540 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.489, 163.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:25:44,445][52649] DAMAGECOUNT value on done: 103097.0 [2024-08-06 00:25:44,446][52649] Sum rewards: 53.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.137', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'weapon5': '0.194', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.458', 'weapon4': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.550', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:44,455][52660] DAMAGECOUNT value on done: 107920.0 [2024-08-06 00:25:44,455][52660] Sum rewards: 62.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.686', 'WEAPON3': '1.400', 'weapon3': '2.682', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '54.000'} [2024-08-06 00:25:44,972][52669] DAMAGECOUNT value on done: 105648.0 [2024-08-06 00:25:44,974][52669] Sum rewards: 55.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.120', 'AMMO4': '0.158', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.532', 'weapon4': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.472', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:45,157][52667] DAMAGECOUNT value on done: 107839.0 [2024-08-06 00:25:45,160][52667] Sum rewards: 55.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.432', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:46,333][52820] DAMAGECOUNT value on done: 99381.0 [2024-08-06 00:25:46,334][52820] Sum rewards: 54.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.271', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.094', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.510', 'weapon4': '0.830', 'WEAPON3': '1.000', 'weapon3': '2.358', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:46,454][52658] DAMAGECOUNT value on done: 109165.0 [2024-08-06 00:25:46,454][52658] Sum rewards: 48.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.068', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon4': '0.346', 'WEAPON4': '0.500', 'weapon2': '0.758', 'WEAPON3': '1.250', 'weapon3': '2.580', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:47,304][52650] Updated weights for policy 0, policy_version 22581 (0.0027) [2024-08-06 00:25:47,552][52649] DAMAGECOUNT value on done: 101493.0 [2024-08-06 00:25:47,554][52649] Sum rewards: 52.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '3.134', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:47,617][52660] DAMAGECOUNT value on done: 103342.0 [2024-08-06 00:25:47,620][52660] Sum rewards: 44.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.529', 'AMMO5': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.036', 'AMMO4': '0.136', 'weapon5': '0.142', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.424', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '2.894', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '38.000'} [2024-08-06 00:25:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 184983552. Throughput: 0: 4403.1. Samples: 46245570. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:25:47,802][52567] Avg episode reward: [(0, '52.563')] [2024-08-06 00:25:47,805][52667] DAMAGECOUNT value on done: 104890.0 [2024-08-06 00:25:47,805][52667] Sum rewards: 55.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.242', 'AMMO5': '0.009', 'ARMOR': '0.028', 'AMMO2': '0.044', 'AMMO3': '0.142', 'weapon5': '0.168', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.342', 'weapon4': '0.370', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.938', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:47,887][52669] DAMAGECOUNT value on done: 108246.0 [2024-08-06 00:25:47,888][52669] Sum rewards: 62.665, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.470', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.190', 'weapon4': '0.208', 'AMMO4': '0.212', 'AMMO3': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '2.724', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '56.000'} [2024-08-06 00:25:48,963][52658] DAMAGECOUNT value on done: 107382.0 [2024-08-06 00:25:48,965][52658] Sum rewards: 61.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.376', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon4': '0.240', 'AMMO3': '0.296', 'weapon2': '0.534', 'WEAPON3': '1.750', 'weapon3': '2.998', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '55.000'} [2024-08-06 00:25:49,454][52820] DAMAGECOUNT value on done: 95981.0 [2024-08-06 00:25:49,454][52820] Sum rewards: 47.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.468', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.088', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.374', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.212', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:49,915][52649] DAMAGECOUNT value on done: 107575.0 [2024-08-06 00:25:49,917][52649] Sum rewards: 60.981, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.860', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.255', 'weapon4': '0.370', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '55.000'} [2024-08-06 00:25:50,455][52667] DAMAGECOUNT value on done: 109441.0 [2024-08-06 00:25:50,456][52667] Sum rewards: 52.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.022', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.434', 'weapon4': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:50,661][52669] DAMAGECOUNT value on done: 112477.0 [2024-08-06 00:25:50,662][52669] Sum rewards: 53.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.012', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.072', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon2': '1.024', 'weapon3': '2.450', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:50,745][52660] DAMAGECOUNT value on done: 108545.0 [2024-08-06 00:25:50,745][52660] Sum rewards: 43.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.520', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '3.202', 'DAMAGECOUNT': '12.201', 'FRAGCOUNT': '38.000'} [2024-08-06 00:25:51,746][52664] DAMAGECOUNT value on done: 109858.0 [2024-08-06 00:25:51,746][52664] Sum rewards: 50.471, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.456', 'weapon4': '0.464', 'HEALTH': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.738', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '43.000'} [2024-08-06 00:25:52,125][52658] DAMAGECOUNT value on done: 107140.0 [2024-08-06 00:25:52,126][52658] Sum rewards: 52.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.722', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.179', 'AMMO4': '0.217', 'weapon5': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.380', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.722', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '46.500'} [2024-08-06 00:25:52,294][52650] Updated weights for policy 0, policy_version 22591 (0.0026) [2024-08-06 00:25:52,351][52649] DAMAGECOUNT value on done: 105771.0 [2024-08-06 00:25:52,352][52649] Sum rewards: 57.964, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO2': '0.025', 'weapon4': '0.098', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.530', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.150', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '52.000'} [2024-08-06 00:25:52,587][52820] DAMAGECOUNT value on done: 99421.0 [2024-08-06 00:25:52,587][52820] Sum rewards: 60.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.203', 'weapon5': '0.208', 'AMMO4': '0.238', 'weapon2': '0.266', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '50.000'} [2024-08-06 00:25:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 185073664. Throughput: 0: 4410.4. Samples: 46272130. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:25:52,794][52567] Avg episode reward: [(0, '52.602')] [2024-08-06 00:25:53,543][52667] DAMAGECOUNT value on done: 113301.0 [2024-08-06 00:25:53,543][52667] Sum rewards: 43.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.270', 'ARMOR': '0.008', 'AMMO2': '0.051', 'AMMO3': '0.123', 'AMMO4': '0.255', 'WEAPON4': '0.450', 'weapon2': '0.742', 'weapon4': '0.774', 'WEAPON3': '0.850', 'weapon3': '2.292', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.680', 'FRAGCOUNT': '36.000'} [2024-08-06 00:25:53,606][52669] DAMAGECOUNT value on done: 114914.0 [2024-08-06 00:25:53,606][52669] Sum rewards: 57.322, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.748', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO4': '0.189', 'weapon4': '0.220', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.838', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '51.000'} [2024-08-06 00:25:53,865][52660] DAMAGECOUNT value on done: 104835.0 [2024-08-06 00:25:53,867][52660] Sum rewards: 55.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.102', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.816', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:54,431][52664] DAMAGECOUNT value on done: 109143.0 [2024-08-06 00:25:54,432][52664] Sum rewards: 49.496, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.560', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon2': '0.240', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '3.332', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '45.000'} [2024-08-06 00:25:55,018][52658] DAMAGECOUNT value on done: 110493.0 [2024-08-06 00:25:55,019][52658] Sum rewards: 65.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.466', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '54.000'} [2024-08-06 00:25:55,125][52649] DAMAGECOUNT value on done: 98972.0 [2024-08-06 00:25:55,126][52649] Sum rewards: 57.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.128', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '48.000'} [2024-08-06 00:25:55,843][52820] DAMAGECOUNT value on done: 101392.0 [2024-08-06 00:25:55,843][52820] Sum rewards: 51.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.606', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.256', 'weapon2': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.676', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '44.000'} [2024-08-06 00:25:56,341][52667] DAMAGECOUNT value on done: 109576.0 [2024-08-06 00:25:56,341][52667] Sum rewards: 59.347, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.040', 'AMMO5': '0.005', 'AMMO2': '0.061', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'AMMO4': '0.306', 'weapon2': '0.482', 'WEAPON4': '0.650', 'weapon4': '0.666', 'WEAPON3': '1.500', 'weapon3': '2.454', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '53.000'} [2024-08-06 00:25:56,473][52669] DAMAGECOUNT value on done: 108632.0 [2024-08-06 00:25:56,473][52669] Sum rewards: 61.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.332', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.156', 'AMMO3': '0.183', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.232', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '50.000'} [2024-08-06 00:25:56,719][52650] Updated weights for policy 0, policy_version 22601 (0.0018) [2024-08-06 00:25:57,118][52664] DAMAGECOUNT value on done: 111350.0 [2024-08-06 00:25:57,118][52664] Sum rewards: 48.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.008', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.108', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'WEAPON4': '0.400', 'weapon2': '0.504', 'weapon4': '0.530', 'WEAPON3': '0.950', 'weapon3': '2.658', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '11.919', 'FRAGCOUNT': '41.500'} [2024-08-06 00:25:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 185155584. Throughput: 0: 4403.8. Samples: 46298340. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:25:57,802][52567] Avg episode reward: [(0, '52.825')] [2024-08-06 00:25:57,941][52658] DAMAGECOUNT value on done: 109984.0 [2024-08-06 00:25:57,941][52658] Sum rewards: 51.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.368', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon4': '0.374', 'weapon2': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '46.000'} [2024-08-06 00:25:58,070][52649] DAMAGECOUNT value on done: 107524.0 [2024-08-06 00:25:58,071][52803] DAMAGECOUNT value on done: 103949.0 [2024-08-06 00:25:58,071][52803] Sum rewards: 54.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.013', 'AMMO2': '0.069', 'AMMO3': '0.143', 'weapon5': '0.264', 'AMMO4': '0.344', 'weapon2': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.654', 'WEAPON3': '0.850', 'weapon3': '2.338', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '47.000'} [2024-08-06 00:25:58,071][52649] Sum rewards: 61.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.288', 'AMMO2': '0.003', 'ARMOR': '0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO4': '0.017', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.426', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '53.000'} [2024-08-06 00:25:59,054][52820] DAMAGECOUNT value on done: 99654.0 [2024-08-06 00:25:59,058][52820] Sum rewards: 61.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.035', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.133', 'weapon4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.084', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '51.000'} [2024-08-06 00:25:59,235][52669] DAMAGECOUNT value on done: 106843.0 [2024-08-06 00:25:59,235][52669] Sum rewards: 57.791, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.477', 'AMMO5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.218', 'AMMO3': '0.262', 'WEAPON3': '1.650', 'HITCOUNT': '3.450', 'weapon3': '3.460', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '51.000'} [2024-08-06 00:25:59,496][52667] DAMAGECOUNT value on done: 113408.0 [2024-08-06 00:25:59,497][52667] Sum rewards: 52.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.525', 'AMMO4': '-0.035', 'AMMO2': '-0.007', 'AMMO3': '0.191', 'weapon2': '0.894', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '45.000'} [2024-08-06 00:25:59,634][52664] DAMAGECOUNT value on done: 110211.0 [2024-08-06 00:25:59,636][52664] Sum rewards: 44.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.326', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.174', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.622', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.984', 'DAMAGECOUNT': '10.941', 'FRAGCOUNT': '38.000'} [2024-08-06 00:25:59,961][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:26:00,182][52666] DAMAGECOUNT value on done: 107119.0 [2024-08-06 00:26:00,183][52666] Sum rewards: 57.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.324', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon4': '0.238', 'weapon2': '0.806', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:00,859][52658] DAMAGECOUNT value on done: 104263.0 [2024-08-06 00:26:00,861][52658] Sum rewards: 43.057, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.683', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.154', 'weapon2': '0.756', 'WEAPON3': '0.950', 'HITCOUNT': '2.320', 'weapon3': '3.188', 'DAMAGECOUNT': '11.346', 'FRAGCOUNT': '34.000'} [2024-08-06 00:26:01,282][52649] DAMAGECOUNT value on done: 103340.0 [2024-08-06 00:26:01,284][52649] Sum rewards: 61.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.036', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '51.000'} [2024-08-06 00:26:01,296][52803] DAMAGECOUNT value on done: 103652.0 [2024-08-06 00:26:01,297][52803] Sum rewards: 55.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.418', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.064', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'weapon2': '0.236', 'AMMO3': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.672', 'WEAPON3': '1.450', 'weapon3': '2.802', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:01,486][52650] Updated weights for policy 0, policy_version 22611 (0.0029) [2024-08-06 00:26:01,994][52669] DAMAGECOUNT value on done: 108348.0 [2024-08-06 00:26:01,996][52669] Sum rewards: 54.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.129', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.286', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:02,087][52820] DAMAGECOUNT value on done: 95737.0 [2024-08-06 00:26:02,087][52820] Sum rewards: 59.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.278', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.100', 'weapon4': '0.198', 'AMMO3': '0.216', 'weapon2': '0.424', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.232', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:02,225][52667] DAMAGECOUNT value on done: 104308.0 [2024-08-06 00:26:02,227][52667] Sum rewards: 40.643, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.660', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.170', 'weapon3': '3.162', 'DAMAGECOUNT': '10.908', 'FRAGCOUNT': '36.000'} [2024-08-06 00:26:02,259][52664] DAMAGECOUNT value on done: 109045.0 [2024-08-06 00:26:02,260][52664] Sum rewards: 54.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'AMMO4': '0.260', 'weapon4': '0.480', 'WEAPON4': '0.550', 'weapon2': '0.642', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:02,308][52614] Signal inference workers to stop experience collection... (4200 times) [2024-08-06 00:26:02,309][52614] Signal inference workers to resume experience collection... (4200 times) [2024-08-06 00:26:02,390][52650] InferenceWorker_p0-w0: stopping experience collection (4200 times) [2024-08-06 00:26:02,390][52650] InferenceWorker_p0-w0: resuming experience collection (4200 times) [2024-08-06 00:26:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 185245696. Throughput: 0: 4396.4. Samples: 46311210. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:26:02,795][52567] Avg episode reward: [(0, '52.912')] [2024-08-06 00:26:03,160][52666] DAMAGECOUNT value on done: 107033.0 [2024-08-06 00:26:03,164][52666] Sum rewards: 45.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.044', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'weapon4': '0.232', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '2.908', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '40.000'} [2024-08-06 00:26:03,866][52658] DAMAGECOUNT value on done: 112770.0 [2024-08-06 00:26:03,868][52658] Sum rewards: 46.474, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.610', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.090', 'AMMO3': '0.312', 'weapon2': '0.688', 'WEAPON3': '1.850', 'HITCOUNT': '3.010', 'weapon3': '3.014', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:04,190][52649] DAMAGECOUNT value on done: 107174.0 [2024-08-06 00:26:04,191][52649] Sum rewards: 60.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.244', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.106', 'AMMO3': '0.209', 'weapon2': '0.240', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.468', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:04,367][52803] DAMAGECOUNT value on done: 100353.0 [2024-08-06 00:26:04,368][52803] Sum rewards: 42.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon7': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.202', 'weapon4': '0.304', 'weapon2': '0.576', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.770', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '39.000'} [2024-08-06 00:26:05,005][52664] DAMAGECOUNT value on done: 115399.0 [2024-08-06 00:26:05,005][52664] Sum rewards: 38.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.154', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO3': '0.181', 'AMMO4': '0.225', 'weapon4': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.100', 'HITCOUNT': '2.260', 'weapon3': '2.708', 'DAMAGECOUNT': '11.412', 'FRAGCOUNT': '36.000'} [2024-08-06 00:26:05,126][52669] DAMAGECOUNT value on done: 107519.0 [2024-08-06 00:26:05,127][52669] Sum rewards: 46.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.313', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO3': '0.193', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.422', 'weapon4': '0.878', 'WEAPON3': '1.100', 'weapon3': '2.266', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '40.000'} [2024-08-06 00:26:05,169][52820] DAMAGECOUNT value on done: 98511.0 [2024-08-06 00:26:05,173][52820] Sum rewards: 58.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.229', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.146', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON3': '0.950', 'weapon2': '0.984', 'weapon3': '2.506', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:05,383][52667] DAMAGECOUNT value on done: 111914.0 [2024-08-06 00:26:05,384][52667] Sum rewards: 46.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.633', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.196', 'weapon5': '0.212', 'AMMO4': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.558', 'weapon4': '0.626', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.278', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '41.000'} [2024-08-06 00:26:05,844][52811] DAMAGECOUNT value on done: 104740.0 [2024-08-06 00:26:05,846][52811] Sum rewards: 55.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:05,949][52666] DAMAGECOUNT value on done: 109111.0 [2024-08-06 00:26:05,949][52666] Sum rewards: 55.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.873', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.086', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:06,237][52650] Updated weights for policy 0, policy_version 22621 (0.0013) [2024-08-06 00:26:06,699][52649] DAMAGECOUNT value on done: 105963.0 [2024-08-06 00:26:06,701][52649] Sum rewards: 56.747, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.162', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'AMMO4': '0.257', 'weapon4': '0.358', 'WEAPON4': '0.550', 'weapon2': '0.574', 'WEAPON3': '1.600', 'weapon3': '2.744', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '51.000'} [2024-08-06 00:26:06,801][52658] DAMAGECOUNT value on done: 105072.0 [2024-08-06 00:26:06,802][52658] Sum rewards: 55.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.040', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.198', 'WEAPON4': '0.400', 'weapon2': '0.452', 'weapon4': '0.708', 'WEAPON3': '1.000', 'weapon3': '2.592', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '47.500'} [2024-08-06 00:26:07,541][52803] DAMAGECOUNT value on done: 99183.0 [2024-08-06 00:26:07,543][52803] Sum rewards: 53.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.543', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.030', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.282', 'weapon4': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.658', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '46.500'} [2024-08-06 00:26:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 185335808. Throughput: 0: 4398.2. Samples: 46337720. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:26:07,794][52567] Avg episode reward: [(0, '53.141')] [2024-08-06 00:26:07,899][52670] DAMAGECOUNT value on done: 104990.0 [2024-08-06 00:26:07,901][52670] Sum rewards: 53.521, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.340', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.348', 'WEAPON3': '1.650', 'HITCOUNT': '3.130', 'weapon3': '3.264', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:08,169][52664] DAMAGECOUNT value on done: 113546.0 [2024-08-06 00:26:08,170][52664] Sum rewards: 65.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.963', 'AMMO5': '0.013', 'weapon5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '57.000'} [2024-08-06 00:26:08,311][52820] DAMAGECOUNT value on done: 102191.0 [2024-08-06 00:26:08,311][52820] Sum rewards: 62.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'AMMO3': '0.194', 'weapon4': '0.232', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '52.000'} [2024-08-06 00:26:08,591][52666] DAMAGECOUNT value on done: 102886.0 [2024-08-06 00:26:08,592][52666] Sum rewards: 61.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon4': '0.272', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2024-08-06 00:26:08,739][52811] DAMAGECOUNT value on done: 97770.0 [2024-08-06 00:26:08,740][52811] Sum rewards: 62.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.282', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.464', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '55.000'} [2024-08-06 00:26:09,498][52658] DAMAGECOUNT value on done: 111314.0 [2024-08-06 00:26:09,498][52658] Sum rewards: 59.016, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.105', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.328', 'weapon4': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:09,804][52649] DAMAGECOUNT value on done: 110346.0 [2024-08-06 00:26:09,806][52649] Sum rewards: 54.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.744', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO4': '0.144', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.854', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:09,868][52647] DAMAGECOUNT value on done: 112896.0 [2024-08-06 00:26:09,869][52647] Sum rewards: 48.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.013', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon4': '0.230', 'AMMO4': '0.321', 'WEAPON4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.400', 'HITCOUNT': '2.630', 'weapon3': '3.024', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:10,242][52670] DAMAGECOUNT value on done: 109481.0 [2024-08-06 00:26:10,242][52670] Sum rewards: 50.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.533', 'AMMO5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.036', 'weapon5': '0.042', 'AMMO4': '0.127', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.904', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:10,615][52803] DAMAGECOUNT value on done: 103276.0 [2024-08-06 00:26:10,615][52803] Sum rewards: 50.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.191', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO4': '0.193', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.576', 'weapon2': '0.870', 'WEAPON3': '1.350', 'weapon3': '2.098', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:10,835][52664] DAMAGECOUNT value on done: 105320.0 [2024-08-06 00:26:10,835][52664] Sum rewards: 61.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.205', 'weapon4': '0.260', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '53.000'} [2024-08-06 00:26:10,969][52666] DAMAGECOUNT value on done: 105283.0 [2024-08-06 00:26:10,970][52666] Sum rewards: 55.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.805', 'ARMOR': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.224', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '2.988', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:11,099][52650] Updated weights for policy 0, policy_version 22631 (0.0028) [2024-08-06 00:26:11,355][52663] DAMAGECOUNT value on done: 108259.0 [2024-08-06 00:26:11,356][52663] Sum rewards: 68.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.079', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '57.000'} [2024-08-06 00:26:11,501][52820] DAMAGECOUNT value on done: 99528.0 [2024-08-06 00:26:11,503][52820] Sum rewards: 52.702, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.385', 'weapon5': '0.008', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.644', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:11,860][52811] DAMAGECOUNT value on done: 99519.0 [2024-08-06 00:26:11,861][52811] Sum rewards: 54.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.217', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.097', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.330', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:12,248][52647] DAMAGECOUNT value on done: 112247.0 [2024-08-06 00:26:12,249][52647] Sum rewards: 62.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.039', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '52.000'} [2024-08-06 00:26:12,498][52658] DAMAGECOUNT value on done: 111096.0 [2024-08-06 00:26:12,502][52658] Sum rewards: 65.052, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.434', 'WEAPON3': '1.000', 'weapon3': '3.110', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '54.000'} [2024-08-06 00:26:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 185425920. Throughput: 0: 4393.8. Samples: 46364000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:26:12,794][52567] Avg episode reward: [(0, '54.270')] [2024-08-06 00:26:13,050][52670] DAMAGECOUNT value on done: 103935.0 [2024-08-06 00:26:13,053][52670] Sum rewards: 54.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.393', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.066', 'weapon4': '0.160', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:13,371][52664] DAMAGECOUNT value on done: 117968.0 [2024-08-06 00:26:13,371][52664] Sum rewards: 55.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.203', 'AMMO3': '0.242', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:13,583][52803] DAMAGECOUNT value on done: 101280.0 [2024-08-06 00:26:13,583][52803] Sum rewards: 64.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.614', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.133', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.706', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '53.000'} [2024-08-06 00:26:13,854][52666] DAMAGECOUNT value on done: 104274.0 [2024-08-06 00:26:13,855][52666] Sum rewards: 55.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.825', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:13,980][52663] DAMAGECOUNT value on done: 107796.0 [2024-08-06 00:26:13,981][52663] Sum rewards: 60.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.849', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.218', 'weapon4': '0.254', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2024-08-06 00:26:14,637][52820] DAMAGECOUNT value on done: 100225.0 [2024-08-06 00:26:14,639][52820] Sum rewards: 62.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.471', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.055', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.224', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.492', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '54.000'} [2024-08-06 00:26:14,677][52647] DAMAGECOUNT value on done: 116629.0 [2024-08-06 00:26:14,679][52647] Sum rewards: 52.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.525', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.213', 'weapon4': '0.416', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:14,969][52811] DAMAGECOUNT value on done: 99801.0 [2024-08-06 00:26:14,971][52811] Sum rewards: 46.698, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'HEALTH': '0.056', 'AMMO4': '0.092', 'weapon4': '0.138', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.612', 'WEAPON3': '0.950', 'HITCOUNT': '2.690', 'weapon3': '2.824', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '38.000'} [2024-08-06 00:26:15,441][52650] Updated weights for policy 0, policy_version 22641 (0.0018) [2024-08-06 00:26:15,707][52658] DAMAGECOUNT value on done: 111687.0 [2024-08-06 00:26:15,707][52658] Sum rewards: 56.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.221', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:16,019][52670] DAMAGECOUNT value on done: 106870.0 [2024-08-06 00:26:16,021][52670] Sum rewards: 58.725, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.774', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.116', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.030', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:16,261][52664] DAMAGECOUNT value on done: 116670.0 [2024-08-06 00:26:16,261][52664] Sum rewards: 57.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.897', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.054', 'weapon5': '0.160', 'AMMO3': '0.177', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon4': '1.076', 'weapon3': '2.098', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:16,715][52666] DAMAGECOUNT value on done: 104473.0 [2024-08-06 00:26:16,715][52666] Sum rewards: 57.210, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.863', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.070', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.324', 'weapon4': '0.460', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '2.962', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:16,763][52803] DAMAGECOUNT value on done: 103773.0 [2024-08-06 00:26:16,765][52803] Sum rewards: 56.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'weapon2': '0.326', 'weapon4': '0.336', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.096', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:17,241][52663] DAMAGECOUNT value on done: 108854.0 [2024-08-06 00:26:17,245][52663] Sum rewards: 54.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.144', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.189', 'WEAPON4': '0.500', 'weapon2': '0.556', 'weapon4': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.464', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:17,509][52647] DAMAGECOUNT value on done: 115514.0 [2024-08-06 00:26:17,509][52647] Sum rewards: 57.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.981', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.606', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.048', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:17,766][52820] DAMAGECOUNT value on done: 101893.0 [2024-08-06 00:26:17,766][52820] Sum rewards: 35.493, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.038', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.259', 'WEAPON4': '0.550', 'weapon2': '0.594', 'weapon4': '0.640', 'WEAPON3': '1.450', 'weapon3': '2.364', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.208', 'FRAGCOUNT': '35.000'} [2024-08-06 00:26:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 185516032. Throughput: 0: 4398.7. Samples: 46377320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:26:17,794][52567] Avg episode reward: [(0, '54.616')] [2024-08-06 00:26:17,805][52614] Saving new best policy, reward=54.616! [2024-08-06 00:26:18,008][52811] DAMAGECOUNT value on done: 100744.0 [2024-08-06 00:26:18,008][52811] Sum rewards: 61.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.496', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.194', 'AMMO3': '0.198', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '52.000'} [2024-08-06 00:26:18,631][52658] DAMAGECOUNT value on done: 104716.0 [2024-08-06 00:26:18,631][52658] Sum rewards: 52.477, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.435', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO2': '0.063', 'AMMO3': '0.254', 'weapon2': '0.298', 'AMMO4': '0.317', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.100', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:18,977][52664] DAMAGECOUNT value on done: 113512.0 [2024-08-06 00:26:18,978][52664] Sum rewards: 49.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.895', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.258', 'weapon3': '2.170', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:19,184][52670] DAMAGECOUNT value on done: 107039.0 [2024-08-06 00:26:19,186][52670] Sum rewards: 52.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.055', 'AMMO3': '0.169', 'AMMO4': '0.273', 'weapon5': '0.286', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.338', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '43.500'} [2024-08-06 00:26:19,734][52666] DAMAGECOUNT value on done: 105474.0 [2024-08-06 00:26:19,736][52666] Sum rewards: 57.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon4': '0.076', 'weapon5': '0.080', 'AMMO4': '0.120', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.062', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:19,815][52803] DAMAGECOUNT value on done: 100960.0 [2024-08-06 00:26:19,815][52803] Sum rewards: 46.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.131', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.476', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '2.890', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '39.000'} [2024-08-06 00:26:20,285][52650] Updated weights for policy 0, policy_version 22651 (0.0019) [2024-08-06 00:26:20,541][52647] DAMAGECOUNT value on done: 116755.0 [2024-08-06 00:26:20,542][52647] Sum rewards: 69.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.845', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '59.000'} [2024-08-06 00:26:20,586][52663] DAMAGECOUNT value on done: 108857.0 [2024-08-06 00:26:20,586][52663] Sum rewards: 46.867, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.048', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.069', 'weapon5': '0.122', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'AMMO4': '0.343', 'weapon4': '0.460', 'weapon2': '0.594', 'WEAPON4': '0.800', 'WEAPON3': '1.700', 'weapon3': '2.462', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:20,947][52820] DAMAGECOUNT value on done: 103220.0 [2024-08-06 00:26:20,948][52820] Sum rewards: 61.870, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.154', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.282', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.476', 'WEAPON3': '1.600', 'weapon3': '2.764', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 00:26:21,313][52811] DAMAGECOUNT value on done: 104278.0 [2024-08-06 00:26:21,314][52811] Sum rewards: 63.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.005', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.246', 'weapon2': '0.664', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '57.000'} [2024-08-06 00:26:21,422][52658] DAMAGECOUNT value on done: 106889.0 [2024-08-06 00:26:21,425][52658] Sum rewards: 55.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.782', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO4': '0.139', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:21,645][52669] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:26:21,968][52670] DAMAGECOUNT value on done: 107900.0 [2024-08-06 00:26:21,970][52670] Sum rewards: 53.498, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.871', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.450', 'weapon4': '0.538', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.442', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:22,119][52664] DAMAGECOUNT value on done: 110954.0 [2024-08-06 00:26:22,120][52664] Sum rewards: 60.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.998', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.370', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '52.000'} [2024-08-06 00:26:22,544][52666] DAMAGECOUNT value on done: 110144.0 [2024-08-06 00:26:22,546][52666] Sum rewards: 52.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.914', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.056', 'weapon5': '0.200', 'AMMO3': '0.237', 'AMMO4': '0.278', 'weapon2': '0.290', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.794', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:22,775][52803] DAMAGECOUNT value on done: 100470.0 [2024-08-06 00:26:22,776][52803] Sum rewards: 60.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.092', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.139', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.292', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '53.000'} [2024-08-06 00:26:22,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 185589760. Throughput: 0: 4389.5. Samples: 46403360. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 00:26:22,795][52567] Avg episode reward: [(0, '54.847')] [2024-08-06 00:26:22,898][52614] Saving new best policy, reward=54.847! [2024-08-06 00:26:23,396][52663] DAMAGECOUNT value on done: 103412.0 [2024-08-06 00:26:23,398][52663] Sum rewards: 35.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.354', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.037', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.267', 'weapon4': '0.402', 'WEAPON4': '0.500', 'weapon2': '0.558', 'WEAPON3': '1.600', 'HITCOUNT': '2.570', 'weapon3': '2.678', 'DAMAGECOUNT': '11.448', 'FRAGCOUNT': '33.000'} [2024-08-06 00:26:23,669][52647] DAMAGECOUNT value on done: 115001.0 [2024-08-06 00:26:23,669][52647] Sum rewards: 52.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.240', 'weapon4': '0.360', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.180', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:23,846][52795] Large shaping reward 2.627 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:26:24,125][52820] DAMAGECOUNT value on done: 99764.0 [2024-08-06 00:26:24,127][52820] Sum rewards: 62.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.961', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.187', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.698', 'WEAPON3': '1.000', 'weapon3': '2.668', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:24,322][52658] DAMAGECOUNT value on done: 106975.0 [2024-08-06 00:26:24,323][52658] Sum rewards: 52.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.124', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:24,476][52811] DAMAGECOUNT value on done: 100037.0 [2024-08-06 00:26:24,477][52811] Sum rewards: 58.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.228', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.330', 'weapon4': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:24,629][52650] Updated weights for policy 0, policy_version 22661 (0.0010) [2024-08-06 00:26:25,159][52670] DAMAGECOUNT value on done: 101431.0 [2024-08-06 00:26:25,161][52670] Sum rewards: 50.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.915', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '3.050', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '41.000'} [2024-08-06 00:26:25,288][52664] DAMAGECOUNT value on done: 107974.0 [2024-08-06 00:26:25,288][52664] Sum rewards: 47.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.408', 'AMMO5': '0.005', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'AMMO2': '0.053', 'weapon7': '0.062', 'weapon5': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.770', 'weapon4': '0.926', 'WEAPON3': '0.950', 'weapon3': '1.814', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '11.652', 'FRAGCOUNT': '40.000'} [2024-08-06 00:26:25,767][52803] DAMAGECOUNT value on done: 96864.0 [2024-08-06 00:26:25,768][52666] DAMAGECOUNT value on done: 106324.0 [2024-08-06 00:26:25,771][52803] Sum rewards: 65.429, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.292', 'weapon2': '0.634', 'WEAPON3': '1.700', 'weapon3': '3.034', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '58.000'} [2024-08-06 00:26:25,771][52666] Sum rewards: 59.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.188', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.040', 'AMMO4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon5': '0.216', 'weapon2': '0.304', 'WEAPON4': '0.450', 'weapon4': '0.854', 'WEAPON3': '0.950', 'weapon3': '2.104', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:26,503][52663] DAMAGECOUNT value on done: 111275.0 [2024-08-06 00:26:26,504][52663] Sum rewards: 63.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.488', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '55.000'} [2024-08-06 00:26:26,843][52647] DAMAGECOUNT value on done: 112790.0 [2024-08-06 00:26:26,843][52647] Sum rewards: 48.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.374', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '3.278', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '43.000'} [2024-08-06 00:26:27,236][52665] DAMAGECOUNT value on done: 103211.0 [2024-08-06 00:26:27,237][52665] Sum rewards: 50.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.821', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.167', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON4': '0.500', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.430', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:27,318][52658] DAMAGECOUNT value on done: 105984.0 [2024-08-06 00:26:27,320][52658] Sum rewards: 63.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.094', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '55.000'} [2024-08-06 00:26:27,409][52811] DAMAGECOUNT value on done: 99199.0 [2024-08-06 00:26:27,409][52811] Sum rewards: 59.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.248', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.155', 'AMMO3': '0.199', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.374', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:27,709][52670] DAMAGECOUNT value on done: 104943.0 [2024-08-06 00:26:27,710][52670] Sum rewards: 45.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.472', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO3': '0.135', 'AMMO4': '0.153', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.480', 'weapon4': '0.750', 'WEAPON3': '0.850', 'weapon3': '2.500', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '37.500'} [2024-08-06 00:26:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 185688064. Throughput: 0: 4378.0. Samples: 46429510. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 00:26:27,794][52567] Avg episode reward: [(0, '55.115')] [2024-08-06 00:26:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022667_185688064.pth... [2024-08-06 00:26:27,920][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022153_181477376.pth [2024-08-06 00:26:27,940][52614] Saving new best policy, reward=55.115! [2024-08-06 00:26:28,380][52666] DAMAGECOUNT value on done: 104803.0 [2024-08-06 00:26:28,380][52666] Sum rewards: 55.486, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.179', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.954', 'WEAPON3': '1.050', 'weapon3': '2.554', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:28,621][52664] DAMAGECOUNT value on done: 112677.0 [2024-08-06 00:26:28,621][52664] Sum rewards: 38.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'AMMO4': '0.267', 'weapon4': '0.290', 'weapon2': '0.478', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '3.026', 'DAMAGECOUNT': '11.682', 'FRAGCOUNT': '35.000'} [2024-08-06 00:26:28,795][52803] DAMAGECOUNT value on done: 102122.0 [2024-08-06 00:26:28,798][52803] Sum rewards: 39.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON4': '0.450', 'weapon4': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.632', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '34.000'} [2024-08-06 00:26:29,074][52671] DAMAGECOUNT value on done: 111903.0 [2024-08-06 00:26:29,074][52671] Sum rewards: 44.328, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.213', 'ARMOR': '0.016', 'AMMO5': '0.023', 'AMMO2': '0.028', 'weapon4': '0.074', 'AMMO4': '0.139', 'weapon5': '0.146', 'WEAPON4': '0.300', 'AMMO3': '0.315', 'weapon2': '0.476', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'HITCOUNT': '2.710', 'weapon3': '2.950', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:29,535][52650] Updated weights for policy 0, policy_version 22671 (0.0015) [2024-08-06 00:26:29,593][52663] DAMAGECOUNT value on done: 108606.0 [2024-08-06 00:26:29,596][52663] Sum rewards: 37.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.306', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon5': '0.236', 'weapon2': '0.262', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.420', 'weapon3': '2.918', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '35.000'} [2024-08-06 00:26:29,863][52665] DAMAGECOUNT value on done: 112003.0 [2024-08-06 00:26:29,865][52665] Sum rewards: 47.688, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.354', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.090', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON4': '0.450', 'weapon2': '0.478', 'weapon4': '0.528', 'WEAPON3': '1.650', 'weapon3': '2.598', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:30,143][52647] DAMAGECOUNT value on done: 116357.0 [2024-08-06 00:26:30,143][52647] Sum rewards: 56.915, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.027', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.366', 'weapon2': '0.422', 'WEAPON3': '0.850', 'HITCOUNT': '2.650', 'weapon3': '2.916', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:30,526][52811] DAMAGECOUNT value on done: 103089.0 [2024-08-06 00:26:30,526][52811] Sum rewards: 64.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.706', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.104', 'weapon4': '0.106', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '56.000'} [2024-08-06 00:26:30,564][52658] DAMAGECOUNT value on done: 110974.0 [2024-08-06 00:26:30,566][52658] Sum rewards: 57.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.278', 'weapon4': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:30,620][52670] DAMAGECOUNT value on done: 99425.0 [2024-08-06 00:26:30,621][52670] Sum rewards: 56.943, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.902', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.400', 'weapon4': '0.404', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:31,263][52666] DAMAGECOUNT value on done: 102625.0 [2024-08-06 00:26:31,266][52666] Sum rewards: 46.970, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.938', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.128', 'WEAPON4': '0.250', 'AMMO3': '0.316', 'weapon2': '0.494', 'WEAPON3': '1.800', 'HITCOUNT': '2.920', 'weapon3': '3.040', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:31,537][52664] DAMAGECOUNT value on done: 111451.0 [2024-08-06 00:26:31,537][52664] Sum rewards: 52.634, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.158', 'WEAPON4': '0.350', 'weapon4': '0.368', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.836', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:31,666][52671] DAMAGECOUNT value on done: 106797.0 [2024-08-06 00:26:31,668][52671] Sum rewards: 56.236, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:31,820][52803] DAMAGECOUNT value on done: 104782.0 [2024-08-06 00:26:31,821][52803] Sum rewards: 60.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.012', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '51.000'} [2024-08-06 00:26:32,489][52663] DAMAGECOUNT value on done: 104625.0 [2024-08-06 00:26:32,489][52663] Sum rewards: 44.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.748', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.102', 'AMMO3': '0.142', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.484', 'weapon2': '0.656', 'WEAPON3': '0.950', 'weapon3': '2.600', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '35.500'} [2024-08-06 00:26:32,604][52665] DAMAGECOUNT value on done: 106816.0 [2024-08-06 00:26:32,606][52665] Sum rewards: 61.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.240', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:32,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 185778176. Throughput: 0: 4376.2. Samples: 46442500. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 00:26:32,795][52567] Avg episode reward: [(0, '54.436')] [2024-08-06 00:26:32,943][52647] DAMAGECOUNT value on done: 116274.0 [2024-08-06 00:26:32,946][52647] Sum rewards: 45.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.046', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.224', 'AMMO3': '0.228', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.490', 'weapon3': '3.244', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '43.000'} [2024-08-06 00:26:33,559][52811] DAMAGECOUNT value on done: 101189.0 [2024-08-06 00:26:33,561][52811] Sum rewards: 58.156, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.552', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'AMMO3': '0.239', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '51.500'} [2024-08-06 00:26:33,601][52670] DAMAGECOUNT value on done: 98204.0 [2024-08-06 00:26:33,601][52670] Sum rewards: 47.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'weapon5': '0.030', 'ARMOR': '0.032', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'AMMO4': '0.230', 'weapon2': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.892', 'WEAPON3': '1.200', 'weapon3': '2.486', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:33,619][52658] DAMAGECOUNT value on done: 111725.0 [2024-08-06 00:26:33,621][52658] Sum rewards: 48.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'AMMO2': '0.022', 'ARMOR': '0.028', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon5': '0.216', 'weapon4': '0.314', 'weapon2': '0.736', 'WEAPON3': '1.050', 'weapon3': '2.494', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '41.000'} [2024-08-06 00:26:34,331][52664] DAMAGECOUNT value on done: 108276.0 [2024-08-06 00:26:34,331][52664] Sum rewards: 59.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.502', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.117', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.302', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '54.000'} [2024-08-06 00:26:34,375][52666] DAMAGECOUNT value on done: 104771.0 [2024-08-06 00:26:34,376][52666] Sum rewards: 45.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.565', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.150', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.652', 'WEAPON3': '0.950', 'weapon3': '2.502', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '38.500'} [2024-08-06 00:26:34,452][52671] DAMAGECOUNT value on done: 110970.0 [2024-08-06 00:26:34,454][52671] Sum rewards: 71.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.371', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '59.000'} [2024-08-06 00:26:34,586][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:26:34,650][52650] Updated weights for policy 0, policy_version 22681 (0.0011) [2024-08-06 00:26:34,855][52803] DAMAGECOUNT value on done: 99946.0 [2024-08-06 00:26:34,857][52803] Sum rewards: 53.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.292', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.068', 'AMMO3': '0.147', 'weapon5': '0.296', 'AMMO4': '0.342', 'weapon2': '0.422', 'WEAPON5': '0.500', 'weapon4': '0.700', 'WEAPON4': '0.850', 'WEAPON3': '0.900', 'weapon3': '2.262', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '45.500'} [2024-08-06 00:26:35,386][52663] DAMAGECOUNT value on done: 108531.0 [2024-08-06 00:26:35,386][52663] Sum rewards: 48.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO2': '0.011', 'ARMOR': '0.012', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'weapon4': '0.224', 'AMMO3': '0.248', 'weapon2': '0.262', 'WEAPON3': '1.550', 'HITCOUNT': '2.890', 'weapon3': '3.314', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:35,388][52665] DAMAGECOUNT value on done: 102477.0 [2024-08-06 00:26:35,389][52665] Sum rewards: 53.874, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.062', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.342', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:35,464][52647] DAMAGECOUNT value on done: 110096.0 [2024-08-06 00:26:35,466][52647] Sum rewards: 57.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.098', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '51.000'} [2024-08-06 00:26:36,298][52658] DAMAGECOUNT value on done: 104296.0 [2024-08-06 00:26:36,299][52658] Sum rewards: 49.999, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.710', 'ARMOR': '0.004', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.147', 'weapon4': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.000', 'HITCOUNT': '2.770', 'weapon3': '3.094', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:36,686][52670] DAMAGECOUNT value on done: 108614.0 [2024-08-06 00:26:36,687][52670] Sum rewards: 60.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.792', 'ARMOR': '0.012', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.189', 'weapon4': '0.242', 'weapon2': '0.334', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.320', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:36,737][52811] DAMAGECOUNT value on done: 101490.0 [2024-08-06 00:26:36,737][52811] Sum rewards: 59.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.827', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.094', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.550', 'weapon4': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.524', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:37,130][52664] DAMAGECOUNT value on done: 111994.0 [2024-08-06 00:26:37,130][52664] Sum rewards: 52.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.580', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.438', 'weapon4': '0.532', 'WEAPON3': '1.500', 'weapon3': '2.828', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:37,476][52671] DAMAGECOUNT value on done: 104609.0 [2024-08-06 00:26:37,476][52671] Sum rewards: 32.874, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.674', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.065', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.280', 'AMMO4': '0.324', 'weapon4': '0.686', 'weapon2': '0.694', 'WEAPON4': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.206', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '34.000'} [2024-08-06 00:26:37,492][52666] DAMAGECOUNT value on done: 107833.0 [2024-08-06 00:26:37,494][52666] Sum rewards: 51.598, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.890', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.251', 'weapon2': '0.302', 'WEAPON3': '1.650', 'HITCOUNT': '3.020', 'weapon3': '3.428', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 185860096. Throughput: 0: 4370.9. Samples: 46468820. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:26:37,794][52567] Avg episode reward: [(0, '54.759')] [2024-08-06 00:26:37,864][52803] DAMAGECOUNT value on done: 102393.0 [2024-08-06 00:26:37,865][52803] Sum rewards: 64.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.200', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.026', 'weapon5': '0.038', 'weapon4': '0.102', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.352', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '57.000'} [2024-08-06 00:26:37,934][52663] DAMAGECOUNT value on done: 108570.0 [2024-08-06 00:26:37,935][52663] Sum rewards: 56.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.190', 'AMMO3': '0.221', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:38,038][52665] DAMAGECOUNT value on done: 105528.0 [2024-08-06 00:26:38,038][52665] Sum rewards: 55.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.013', 'weapon5': '0.030', 'AMMO2': '0.041', 'AMMO3': '0.175', 'AMMO4': '0.205', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.940', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:38,379][52647] DAMAGECOUNT value on done: 110846.0 [2024-08-06 00:26:38,381][52647] Sum rewards: 59.550, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '53.000'} [2024-08-06 00:26:38,646][52650] Updated weights for policy 0, policy_version 22691 (0.0011) [2024-08-06 00:26:39,006][52658] DAMAGECOUNT value on done: 107518.0 [2024-08-06 00:26:39,007][52658] Sum rewards: 49.973, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.696', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.106', 'weapon4': '0.134', 'AMMO4': '0.246', 'AMMO3': '0.323', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'HITCOUNT': '2.810', 'weapon3': '2.962', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:39,618][52670] DAMAGECOUNT value on done: 108202.0 [2024-08-06 00:26:39,620][52670] Sum rewards: 50.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.114', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.562', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '2.886', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '43.500'} [2024-08-06 00:26:39,641][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:26:39,811][52811] DAMAGECOUNT value on done: 100103.0 [2024-08-06 00:26:39,814][52811] Sum rewards: 61.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.134', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.472', 'weapon4': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:39,850][52664] DAMAGECOUNT value on done: 111368.0 [2024-08-06 00:26:39,852][52664] Sum rewards: 52.742, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.173', 'HEALTH': '0.232', 'weapon4': '0.276', 'weapon2': '0.564', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '2.966', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:40,186][52666] DAMAGECOUNT value on done: 105937.0 [2024-08-06 00:26:40,186][52666] Sum rewards: 58.523, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.206', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.205', 'weapon4': '0.310', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:40,294][52671] DAMAGECOUNT value on done: 106833.0 [2024-08-06 00:26:40,295][52671] Sum rewards: 53.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.138', 'weapon4': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'ARMOR': '0.400', 'weapon2': '0.772', 'WEAPON3': '1.250', 'weapon3': '2.618', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:40,848][52663] DAMAGECOUNT value on done: 109133.0 [2024-08-06 00:26:40,848][52663] Sum rewards: 53.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.581', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon5': '0.230', 'weapon4': '0.290', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:40,887][52647] DAMAGECOUNT value on done: 109920.0 [2024-08-06 00:26:40,889][52647] Sum rewards: 48.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'weapon5': '0.002', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.181', 'AMMO3': '0.210', 'weapon2': '0.358', 'WEAPON4': '0.550', 'weapon4': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.558', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '43.000'} [2024-08-06 00:26:40,914][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:26:40,966][52803] DAMAGECOUNT value on done: 100404.0 [2024-08-06 00:26:40,966][52803] Sum rewards: 51.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.262', 'weapon4': '0.476', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.052', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:41,068][52665] DAMAGECOUNT value on done: 106329.0 [2024-08-06 00:26:41,069][52665] Sum rewards: 38.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.398', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.160', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.200', 'HITCOUNT': '2.510', 'weapon3': '2.940', 'DAMAGECOUNT': '11.280', 'FRAGCOUNT': '34.500'} [2024-08-06 00:26:42,079][52658] DAMAGECOUNT value on done: 110716.0 [2024-08-06 00:26:42,082][52658] Sum rewards: 55.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.094', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.374', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.214', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:42,565][52670] DAMAGECOUNT value on done: 106234.0 [2024-08-06 00:26:42,567][52670] Sum rewards: 48.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.746', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.070', 'weapon4': '0.148', 'AMMO3': '0.153', 'AMMO4': '0.240', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '2.540', 'weapon3': '3.276', 'DAMAGECOUNT': '12.000', 'FRAGCOUNT': '41.000'} [2024-08-06 00:26:42,636][52671] DAMAGECOUNT value on done: 109846.0 [2024-08-06 00:26:42,637][52671] Sum rewards: 53.918, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.492', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.298', 'weapon5': '0.366', 'weapon2': '0.494', 'WEAPON3': '0.850', 'weapon3': '2.528', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '43.000'} [2024-08-06 00:26:42,790][52664] DAMAGECOUNT value on done: 109526.0 [2024-08-06 00:26:42,790][52664] Sum rewards: 52.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.403', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon7': '0.054', 'weapon5': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.316', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 185942016. Throughput: 0: 4382.7. Samples: 46495560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:26:42,795][52567] Avg episode reward: [(0, '54.109')] [2024-08-06 00:26:42,961][52811] DAMAGECOUNT value on done: 101780.0 [2024-08-06 00:26:42,963][52811] Sum rewards: 44.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.432', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.205', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.798', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.832', 'FRAGCOUNT': '39.000'} [2024-08-06 00:26:43,420][52666] DAMAGECOUNT value on done: 104272.0 [2024-08-06 00:26:43,423][52666] Sum rewards: 57.409, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.700', 'AMMO5': '0.015', 'weapon5': '0.028', 'AMMO2': '0.045', 'AMMO3': '0.223', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '51.000'} [2024-08-06 00:26:43,474][52663] DAMAGECOUNT value on done: 106922.0 [2024-08-06 00:26:43,475][52663] Sum rewards: 44.800, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.870', 'ARMOR': '0.024', 'AMMO2': '0.047', 'AMMO4': '0.233', 'AMMO3': '0.293', 'weapon4': '0.366', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.780', 'weapon3': '2.962', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '43.000'} [2024-08-06 00:26:43,706][52647] DAMAGECOUNT value on done: 111823.0 [2024-08-06 00:26:43,710][52647] Sum rewards: 55.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.338', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.149', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.538', 'weapon4': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.446', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:43,746][52650] Updated weights for policy 0, policy_version 22701 (0.0013) [2024-08-06 00:26:44,042][52803] DAMAGECOUNT value on done: 97384.0 [2024-08-06 00:26:44,051][52803] Sum rewards: 38.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.028', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.260', 'WEAPON4': '0.450', 'weapon4': '0.582', 'weapon2': '0.834', 'WEAPON3': '1.050', 'weapon3': '2.218', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '10.392', 'FRAGCOUNT': '34.000'} [2024-08-06 00:26:44,197][52665] DAMAGECOUNT value on done: 106812.0 [2024-08-06 00:26:44,198][52665] Sum rewards: 42.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.328', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.171', 'AMMO3': '0.187', 'weapon2': '0.344', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.400', 'weapon3': '2.870', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '36.000'} [2024-08-06 00:26:45,172][52664] DAMAGECOUNT value on done: 110047.0 [2024-08-06 00:26:45,174][52664] Sum rewards: 54.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.914', 'AMMO4': '-0.018', 'AMMO2': '-0.004', 'AMMO3': '0.193', 'weapon2': '0.562', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.284', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:45,600][52670] DAMAGECOUNT value on done: 105508.0 [2024-08-06 00:26:45,600][52670] Sum rewards: 50.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.112', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.154', 'AMMO4': '0.246', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon4': '1.048', 'weapon3': '2.154', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:45,843][52671] DAMAGECOUNT value on done: 109324.0 [2024-08-06 00:26:45,843][52671] Sum rewards: 43.824, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.090', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'AMMO3': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.700', 'HITCOUNT': '2.840', 'weapon3': '2.876', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:45,989][52811] DAMAGECOUNT value on done: 101457.0 [2024-08-06 00:26:45,989][52811] Sum rewards: 58.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.560', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.049', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.340', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.344', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:46,178][52647] DAMAGECOUNT value on done: 109057.0 [2024-08-06 00:26:46,178][52647] Sum rewards: 46.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.055', 'weapon5': '0.124', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'AMMO4': '0.276', 'WEAPON4': '0.600', 'weapon2': '0.642', 'weapon4': '0.736', 'WEAPON3': '0.800', 'weapon3': '2.172', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '38.000'} [2024-08-06 00:26:46,275][52663] DAMAGECOUNT value on done: 102495.0 [2024-08-06 00:26:46,275][52663] Sum rewards: 53.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.138', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.410', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:46,390][52666] DAMAGECOUNT value on done: 104689.0 [2024-08-06 00:26:46,390][52666] Sum rewards: 54.171, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.197', 'weapon2': '0.298', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:47,183][52803] DAMAGECOUNT value on done: 101015.0 [2024-08-06 00:26:47,185][52803] Sum rewards: 52.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.562', 'WEAPON3': '0.950', 'HITCOUNT': '2.840', 'weapon3': '2.902', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '43.000'} [2024-08-06 00:26:47,386][52665] DAMAGECOUNT value on done: 108904.0 [2024-08-06 00:26:47,389][52665] Sum rewards: 53.732, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.152', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'AMMO3': '0.323', 'weapon2': '0.330', 'weapon4': '0.388', 'WEAPON3': '1.900', 'weapon3': '3.032', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '52.000'} [2024-08-06 00:26:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 186040320. Throughput: 0: 4395.6. Samples: 46509010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:26:47,794][52567] Avg episode reward: [(0, '52.989')] [2024-08-06 00:26:48,061][52803] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:26:48,275][52650] Updated weights for policy 0, policy_version 22711 (0.0010) [2024-08-06 00:26:48,441][52670] DAMAGECOUNT value on done: 111062.0 [2024-08-06 00:26:48,443][52670] Sum rewards: 58.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.974', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.070', 'weapon4': '0.190', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:48,746][52647] DAMAGECOUNT value on done: 113004.0 [2024-08-06 00:26:48,746][52647] Sum rewards: 46.930, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.991', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.032', 'AMMO2': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'AMMO4': '0.285', 'weapon2': '0.506', 'weapon4': '0.556', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.682', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:48,802][52663] DAMAGECOUNT value on done: 106477.0 [2024-08-06 00:26:48,804][52663] Sum rewards: 37.351, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.215', 'weapon4': '0.530', 'WEAPON4': '0.550', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.626', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '35.000'} [2024-08-06 00:26:49,052][52671] DAMAGECOUNT value on done: 111070.0 [2024-08-06 00:26:49,062][52671] Sum rewards: 55.632, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.653', 'ARMOR': '0.024', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.235', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:49,076][52811] DAMAGECOUNT value on done: 103495.0 [2024-08-06 00:26:49,076][52811] Sum rewards: 68.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.028', 'ARMOR': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.148', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.454', 'WEAPON3': '0.950', 'weapon3': '2.984', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '56.000'} [2024-08-06 00:26:49,196][52666] DAMAGECOUNT value on done: 109802.0 [2024-08-06 00:26:49,197][52666] Sum rewards: 57.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.647', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.086', 'AMMO4': '0.192', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:49,479][52795] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:26:50,224][52665] DAMAGECOUNT value on done: 112156.0 [2024-08-06 00:26:50,226][52665] Sum rewards: 51.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.776', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.154', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.256', 'WEAPON4': '0.500', 'weapon2': '0.642', 'weapon4': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.250', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.799', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:50,467][52803] DAMAGECOUNT value on done: 101603.0 [2024-08-06 00:26:50,470][52803] Sum rewards: 58.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.978', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.044', 'WEAPON4': '0.100', 'weapon2': '0.196', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.578', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '53.000'} [2024-08-06 00:26:51,200][52659] DAMAGECOUNT value on done: 108401.0 [2024-08-06 00:26:51,200][52659] Sum rewards: 60.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.688', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.400', 'weapon3': '2.636', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '52.000'} [2024-08-06 00:26:51,351][52670] DAMAGECOUNT value on done: 101603.0 [2024-08-06 00:26:51,355][52670] Sum rewards: 47.426, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.182', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.166', 'AMMO3': '0.189', 'weapon2': '0.644', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '2.972', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '40.000'} [2024-08-06 00:26:51,627][52671] DAMAGECOUNT value on done: 108083.0 [2024-08-06 00:26:51,627][52671] Sum rewards: 57.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.120', 'weapon4': '0.136', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:51,690][52663] DAMAGECOUNT value on done: 110364.0 [2024-08-06 00:26:51,692][52663] Sum rewards: 53.205, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.206', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.157', 'AMMO4': '0.197', 'weapon2': '0.362', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon4': '1.224', 'weapon3': '2.056', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:52,056][52647] DAMAGECOUNT value on done: 114103.0 [2024-08-06 00:26:52,056][52647] Sum rewards: 45.237, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.898', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.134', 'AMMO3': '0.206', 'AMMO4': '0.211', 'weapon2': '0.338', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '41.000'} [2024-08-06 00:26:52,327][52811] DAMAGECOUNT value on done: 103742.0 [2024-08-06 00:26:52,328][52811] Sum rewards: 57.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.209', 'weapon2': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.214', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '48.000'} [2024-08-06 00:26:52,350][52666] DAMAGECOUNT value on done: 104309.0 [2024-08-06 00:26:52,351][52666] Sum rewards: 49.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'weapon4': '0.184', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.192', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '43.000'} [2024-08-06 00:26:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 186122240. Throughput: 0: 4382.7. Samples: 46534940. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:26:52,794][52567] Avg episode reward: [(0, '52.843')] [2024-08-06 00:26:52,908][52650] Updated weights for policy 0, policy_version 22721 (0.0033) [2024-08-06 00:26:53,040][52665] DAMAGECOUNT value on done: 109487.0 [2024-08-06 00:26:53,041][52665] Sum rewards: 44.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.736', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.288', 'weapon4': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '39.000'} [2024-08-06 00:26:53,598][52803] DAMAGECOUNT value on done: 103327.0 [2024-08-06 00:26:53,601][52803] Sum rewards: 49.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.164', 'AMMO3': '0.180', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.484', 'WEAPON4': '0.550', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.374', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:53,817][52659] DAMAGECOUNT value on done: 106518.0 [2024-08-06 00:26:53,817][52659] Sum rewards: 44.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.968', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.658', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '3.142', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '39.000'} [2024-08-06 00:26:53,962][52670] DAMAGECOUNT value on done: 109794.0 [2024-08-06 00:26:53,963][52670] Sum rewards: 66.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon2': '0.270', 'weapon4': '0.288', 'WEAPON3': '1.650', 'weapon3': '2.994', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '58.000'} [2024-08-06 00:26:54,352][52671] DAMAGECOUNT value on done: 109592.0 [2024-08-06 00:26:54,353][52671] Sum rewards: 48.677, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.134', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.332', 'WEAPON3': '1.000', 'HITCOUNT': '2.480', 'weapon3': '3.236', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '40.000'} [2024-08-06 00:26:54,528][52647] DAMAGECOUNT value on done: 110287.0 [2024-08-06 00:26:54,530][52647] Sum rewards: 57.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.104', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '49.500'} [2024-08-06 00:26:54,659][52663] DAMAGECOUNT value on done: 108972.0 [2024-08-06 00:26:54,660][52663] Sum rewards: 57.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'AMMO4': '0.211', 'weapon2': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '51.000'} [2024-08-06 00:26:54,904][52666] DAMAGECOUNT value on done: 106983.0 [2024-08-06 00:26:54,904][52666] Sum rewards: 46.100, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'weapon5': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'HEALTH': '0.330', 'weapon2': '0.440', 'WEAPON4': '0.600', 'weapon4': '0.718', 'WEAPON3': '0.750', 'weapon3': '1.820', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.602', 'FRAGCOUNT': '39.000'} [2024-08-06 00:26:55,446][52811] DAMAGECOUNT value on done: 101683.0 [2024-08-06 00:26:55,447][52811] Sum rewards: 47.070, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO2': '0.013', 'weapon4': '0.022', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.253', 'weapon2': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '3.230', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '44.000'} [2024-08-06 00:26:56,111][52665] DAMAGECOUNT value on done: 109167.0 [2024-08-06 00:26:56,111][52665] Sum rewards: 57.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.696', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.209', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.402', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:56,863][52670] DAMAGECOUNT value on done: 107774.0 [2024-08-06 00:26:56,864][52670] Sum rewards: 48.410, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.772', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.186', 'AMMO3': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.540', 'weapon2': '0.588', 'WEAPON3': '1.550', 'weapon3': '2.396', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:56,896][52659] DAMAGECOUNT value on done: 107854.0 [2024-08-06 00:26:56,896][52659] Sum rewards: 57.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.510', 'weapon2': '0.788', 'WEAPON3': '0.950', 'weapon3': '2.406', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '45.000'} [2024-08-06 00:26:56,921][52803] DAMAGECOUNT value on done: 97640.0 [2024-08-06 00:26:56,921][52803] Sum rewards: 52.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.545', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.236', 'weapon4': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.082', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '46.000'} [2024-08-06 00:26:57,298][52671] DAMAGECOUNT value on done: 108697.0 [2024-08-06 00:26:57,300][52671] Sum rewards: 58.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon5': '0.018', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.176', 'weapon2': '0.248', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.476', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '47.000'} [2024-08-06 00:26:57,316][52647] DAMAGECOUNT value on done: 114513.0 [2024-08-06 00:26:57,316][52647] Sum rewards: 60.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.894', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.094', 'weapon4': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '2.960', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '50.000'} [2024-08-06 00:26:57,509][52663] DAMAGECOUNT value on done: 111078.0 [2024-08-06 00:26:57,509][52663] Sum rewards: 56.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.275', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.390', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:57,684][52650] Updated weights for policy 0, policy_version 22731 (0.0033) [2024-08-06 00:26:57,804][52567] Fps is (10 sec: 17186.0, 60 sec: 17609.9, 300 sec: 17522.0). Total num frames: 186212352. Throughput: 0: 4383.9. Samples: 46561320. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:26:57,805][52567] Avg episode reward: [(0, '52.651')] [2024-08-06 00:26:58,583][52811] DAMAGECOUNT value on done: 104105.0 [2024-08-06 00:26:58,584][52811] Sum rewards: 52.052, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.955', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.218', 'weapon2': '0.340', 'weapon4': '0.560', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '49.000'} [2024-08-06 00:26:59,151][52665] DAMAGECOUNT value on done: 106982.0 [2024-08-06 00:26:59,151][52665] Sum rewards: 48.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.304', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '42.000'} [2024-08-06 00:26:59,643][52670] DAMAGECOUNT value on done: 105239.0 [2024-08-06 00:26:59,645][52670] Sum rewards: 43.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.642', 'AMMO5': '0.018', 'ARMOR': '0.020', 'AMMO2': '0.044', 'weapon5': '0.122', 'AMMO3': '0.164', 'AMMO4': '0.221', 'WEAPON5': '0.350', 'weapon4': '0.578', 'weapon2': '0.634', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.344', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '39.000'} [2024-08-06 00:26:59,829][52659] DAMAGECOUNT value on done: 107668.0 [2024-08-06 00:26:59,829][52659] Sum rewards: 33.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.282', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.116', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'WEAPON4': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon4': '1.010', 'weapon3': '1.906', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '9.684', 'FRAGCOUNT': '28.500'} [2024-08-06 00:27:00,310][52671] DAMAGECOUNT value on done: 108508.0 [2024-08-06 00:27:00,310][52671] Sum rewards: 58.432, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.004', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.320', 'AMMO4': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '51.000'} [2024-08-06 00:27:00,458][52647] DAMAGECOUNT value on done: 108704.0 [2024-08-06 00:27:00,458][52647] Sum rewards: 48.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.956', 'AMMO5': '0.007', 'AMMO2': '0.027', 'ARMOR': '0.028', 'AMMO4': '0.133', 'AMMO3': '0.137', 'WEAPON5': '0.250', 'weapon5': '0.312', 'WEAPON4': '0.450', 'weapon2': '0.472', 'weapon4': '0.794', 'WEAPON3': '0.850', 'weapon3': '2.228', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.143', 'FRAGCOUNT': '41.000'} [2024-08-06 00:27:00,597][52663] DAMAGECOUNT value on done: 109007.0 [2024-08-06 00:27:00,599][52663] Sum rewards: 54.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.913', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO4': '0.177', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'ARMOR': '0.420', 'weapon2': '0.508', 'weapon4': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.576', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '46.000'} [2024-08-06 00:27:01,631][52811] DAMAGECOUNT value on done: 100834.0 [2024-08-06 00:27:01,631][52811] Sum rewards: 37.694, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.197', 'AMMO3': '0.258', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.550', 'HITCOUNT': '2.630', 'weapon3': '2.964', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '36.500'} [2024-08-06 00:27:02,195][52665] DAMAGECOUNT value on done: 107187.0 [2024-08-06 00:27:02,195][52665] Sum rewards: 57.356, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '50.000'} [2024-08-06 00:27:02,361][52650] Updated weights for policy 0, policy_version 22741 (0.0023) [2024-08-06 00:27:02,426][52670] DAMAGECOUNT value on done: 103650.0 [2024-08-06 00:27:02,427][52670] Sum rewards: 60.879, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.782', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.126', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.548', 'weapon2': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.546', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '49.000'} [2024-08-06 00:27:02,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 186294272. Throughput: 0: 4377.3. Samples: 46574300. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:27:02,795][52567] Avg episode reward: [(0, '52.712')] [2024-08-06 00:27:03,045][52659] DAMAGECOUNT value on done: 107858.0 [2024-08-06 00:27:03,045][52659] Sum rewards: 53.597, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.393', 'weapon5': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.078', 'AMMO3': '0.102', 'WEAPON4': '0.150', 'WEAPON3': '0.800', 'weapon2': '1.124', 'weapon3': '2.520', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '40.500'} [2024-08-06 00:27:03,392][52647] DAMAGECOUNT value on done: 113230.0 [2024-08-06 00:27:03,393][52647] Sum rewards: 62.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.585', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.227', 'weapon4': '0.292', 'WEAPON3': '1.450', 'HITCOUNT': '3.360', 'weapon3': '3.362', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '55.000'} [2024-08-06 00:27:03,434][52671] DAMAGECOUNT value on done: 112161.0 [2024-08-06 00:27:03,437][52671] Sum rewards: 57.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.379', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'AMMO3': '0.230', 'weapon2': '0.390', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.426', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '50.000'} [2024-08-06 00:27:03,729][52663] DAMAGECOUNT value on done: 110916.0 [2024-08-06 00:27:03,731][52663] Sum rewards: 51.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon4': '0.224', 'weapon2': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '2.946', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '44.000'} [2024-08-06 00:27:04,683][52811] DAMAGECOUNT value on done: 101618.0 [2024-08-06 00:27:04,684][52811] Sum rewards: 56.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'WEAPON1': '0.010', 'AMMO3': '0.212', 'weapon2': '0.330', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.506', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '49.000'} [2024-08-06 00:27:05,042][52665] DAMAGECOUNT value on done: 107929.0 [2024-08-06 00:27:05,042][52665] Sum rewards: 67.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.218', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '59.000'} [2024-08-06 00:27:06,011][52659] DAMAGECOUNT value on done: 109256.0 [2024-08-06 00:27:06,012][52659] Sum rewards: 48.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.972', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.201', 'weapon2': '0.718', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '2.998', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '42.000'} [2024-08-06 00:27:06,460][52671] DAMAGECOUNT value on done: 108020.0 [2024-08-06 00:27:06,460][52671] Sum rewards: 48.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.019', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO4': '0.134', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.340', 'WEAPON4': '0.400', 'weapon2': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.672', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '43.000'} [2024-08-06 00:27:06,650][52663] DAMAGECOUNT value on done: 108234.0 [2024-08-06 00:27:06,652][52663] Sum rewards: 56.279, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.144', 'WEAPON4': '0.250', 'AMMO3': '0.338', 'weapon2': '0.468', 'WEAPON3': '1.900', 'weapon3': '3.072', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '53.000'} [2024-08-06 00:27:06,804][52650] Updated weights for policy 0, policy_version 22751 (0.0011) [2024-08-06 00:27:07,646][52665] DAMAGECOUNT value on done: 107233.0 [2024-08-06 00:27:07,657][52665] Sum rewards: 65.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.096', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.350', 'weapon2': '0.496', 'weapon4': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2024-08-06 00:27:07,794][52567] Fps is (10 sec: 17220.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 186384384. Throughput: 0: 4390.7. Samples: 46600940. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:27:07,794][52567] Avg episode reward: [(0, '52.913')] [2024-08-06 00:27:08,936][52659] DAMAGECOUNT value on done: 109721.0 [2024-08-06 00:27:08,937][52659] Sum rewards: 41.216, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.102', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.212', 'AMMO3': '0.244', 'weapon2': '0.486', 'WEAPON4': '0.550', 'weapon4': '0.626', 'WEAPON3': '1.450', 'weapon3': '2.552', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '39.000'} [2024-08-06 00:27:09,361][52671] DAMAGECOUNT value on done: 105866.0 [2024-08-06 00:27:09,363][52671] Sum rewards: 66.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.745', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.194', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.358', 'ARMOR': '0.462', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '54.000'} [2024-08-06 00:27:10,273][52665] DAMAGECOUNT value on done: 105085.0 [2024-08-06 00:27:10,281][52665] Sum rewards: 60.003, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.941', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.198', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '52.000'} [2024-08-06 00:27:11,612][52650] Updated weights for policy 0, policy_version 22761 (0.0045) [2024-08-06 00:27:12,058][52659] DAMAGECOUNT value on done: 105359.0 [2024-08-06 00:27:12,058][52659] Sum rewards: 46.416, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.792', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.127', 'weapon5': '0.174', 'WEAPON4': '0.350', 'weapon2': '0.620', 'weapon4': '0.704', 'WEAPON3': '0.900', 'weapon3': '2.320', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '38.000'} [2024-08-06 00:27:12,553][52671] DAMAGECOUNT value on done: 111407.0 [2024-08-06 00:27:12,555][52671] Sum rewards: 65.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.977', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.025', 'ARMOR': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.178', 'weapon4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '56.000'} [2024-08-06 00:27:12,794][52567] Fps is (10 sec: 18842.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 186482688. Throughput: 0: 4397.1. Samples: 46627380. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:27:12,794][52567] Avg episode reward: [(0, '53.113')] [2024-08-06 00:27:12,963][52665] DAMAGECOUNT value on done: 106571.0 [2024-08-06 00:27:12,963][52665] Sum rewards: 52.119, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.730', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'weapon4': '0.234', 'AMMO3': '0.284', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '2.910', 'weapon3': '3.142', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '50.000'} [2024-08-06 00:27:15,025][52659] DAMAGECOUNT value on done: 107266.0 [2024-08-06 00:27:15,026][52659] Sum rewards: 63.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.214', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '52.000'} [2024-08-06 00:27:15,390][52671] DAMAGECOUNT value on done: 107928.0 [2024-08-06 00:27:15,397][52671] Sum rewards: 54.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.128', 'AMMO5': '0.003', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.142', 'AMMO4': '0.249', 'WEAPON4': '0.500', 'weapon2': '0.556', 'weapon4': '0.578', 'WEAPON3': '0.950', 'weapon3': '2.600', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '46.000'} [2024-08-06 00:27:16,151][52665] DAMAGECOUNT value on done: 101196.0 [2024-08-06 00:27:16,152][52665] Sum rewards: 58.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.390', 'AMMO5': '0.005', 'ARMOR': '0.017', 'AMMO2': '0.046', 'weapon5': '0.114', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'weapon2': '0.378', 'weapon4': '0.616', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '49.000'} [2024-08-06 00:27:16,393][52650] Updated weights for policy 0, policy_version 22771 (0.0026) [2024-08-06 00:27:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 186564608. Throughput: 0: 4399.3. Samples: 46640470. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:27:17,794][52567] Avg episode reward: [(0, '53.124')] [2024-08-06 00:27:17,990][52659] DAMAGECOUNT value on done: 110818.0 [2024-08-06 00:27:17,991][52659] Sum rewards: 55.229, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.058', 'AMMO3': '0.162', 'AMMO4': '0.292', 'weapon5': '0.348', 'weapon2': '0.424', 'WEAPON5': '0.500', 'weapon4': '0.618', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.322', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '45.500'} [2024-08-06 00:27:18,199][52671] DAMAGECOUNT value on done: 109007.0 [2024-08-06 00:27:18,210][52671] Sum rewards: 49.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.152', 'weapon4': '0.180', 'AMMO4': '0.180', 'weapon5': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.542', 'WEAPON3': '0.950', 'HITCOUNT': '2.480', 'weapon3': '2.816', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '42.500'} [2024-08-06 00:27:19,264][52665] DAMAGECOUNT value on done: 105024.0 [2024-08-06 00:27:19,266][52665] Sum rewards: 63.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.850', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.630', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 00:27:20,755][52650] Updated weights for policy 0, policy_version 22781 (0.0024) [2024-08-06 00:27:20,911][52659] DAMAGECOUNT value on done: 107663.0 [2024-08-06 00:27:20,911][52659] Sum rewards: 51.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.630', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.612', 'WEAPON3': '0.900', 'HITCOUNT': '2.930', 'weapon3': '2.944', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '41.500'} [2024-08-06 00:27:21,119][52671] DAMAGECOUNT value on done: 108782.0 [2024-08-06 00:27:21,119][52671] Sum rewards: 55.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.822', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.040', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.199', 'WEAPON4': '0.350', 'weapon4': '0.460', 'weapon2': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.534', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '46.000'} [2024-08-06 00:27:22,413][52665] DAMAGECOUNT value on done: 105015.0 [2024-08-06 00:27:22,415][52665] Sum rewards: 45.876, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.378', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '2.620', 'weapon3': '3.118', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '44.000'} [2024-08-06 00:27:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 186646528. Throughput: 0: 4403.8. Samples: 46666990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:27:22,794][52567] Avg episode reward: [(0, '53.024')] [2024-08-06 00:27:23,649][52659] DAMAGECOUNT value on done: 103874.0 [2024-08-06 00:27:23,650][52659] Sum rewards: 48.109, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.425', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO2': '0.040', 'weapon5': '0.058', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.912', 'weapon3': '2.456', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.117', 'FRAGCOUNT': '38.000'} [2024-08-06 00:27:23,816][52671] DAMAGECOUNT value on done: 108266.0 [2024-08-06 00:27:23,817][52671] Sum rewards: 49.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.826', 'AMMO5': '0.016', 'weapon5': '0.036', 'AMMO2': '0.060', 'AMMO3': '0.179', 'AMMO4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON4': '0.650', 'weapon4': '0.892', 'WEAPON3': '1.000', 'weapon3': '2.214', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '42.500'} [2024-08-06 00:27:25,494][52650] Updated weights for policy 0, policy_version 22791 (0.0025) [2024-08-06 00:27:26,067][52659] DAMAGECOUNT value on done: 104567.0 [2024-08-06 00:27:26,068][52659] Sum rewards: 36.855, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.040', 'AMMO4': '0.190', 'AMMO3': '0.214', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.738', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '34.000'} [2024-08-06 00:27:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 186736640. Throughput: 0: 4396.9. Samples: 46693420. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:27:27,794][52567] Avg episode reward: [(0, '52.835')] [2024-08-06 00:27:28,306][52659] DAMAGECOUNT value on done: 110273.0 [2024-08-06 00:27:28,307][52659] Sum rewards: 56.801, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.445', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.108', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.424', 'weapon2': '0.530', 'WEAPON3': '0.900', 'weapon3': '2.632', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '43.000'} [2024-08-06 00:27:30,121][52650] Updated weights for policy 0, policy_version 22801 (0.0014) [2024-08-06 00:27:31,064][52659] DAMAGECOUNT value on done: 108248.0 [2024-08-06 00:27:31,071][52659] Sum rewards: 49.953, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.065', 'weapon4': '0.106', 'AMMO3': '0.141', 'WEAPON3': '0.850', 'weapon2': '0.852', 'HITCOUNT': '2.660', 'weapon3': '2.858', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '39.000'} [2024-08-06 00:27:32,609][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:27:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 186826752. Throughput: 0: 4396.2. Samples: 46706840. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:27:32,794][52567] Avg episode reward: [(0, '52.755')] [2024-08-06 00:27:33,486][52795] DAMAGECOUNT value on done: 99548.0 [2024-08-06 00:27:33,489][52795] Sum rewards: 48.030, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.835', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon7': '0.076', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.130', 'weapon4': '0.284', 'WEAPON3': '0.850', 'weapon2': '0.910', 'HITCOUNT': '2.440', 'weapon3': '2.460', 'DAMAGECOUNT': '11.253', 'FRAGCOUNT': '39.000'} [2024-08-06 00:27:34,028][52659] DAMAGECOUNT value on done: 113943.0 [2024-08-06 00:27:34,028][52659] Sum rewards: 52.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.683', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.050', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'weapon4': '0.460', 'weapon2': '0.654', 'WEAPON3': '1.350', 'weapon3': '2.634', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '45.000'} [2024-08-06 00:27:34,678][52650] Updated weights for policy 0, policy_version 22811 (0.0025) [2024-08-06 00:27:36,556][52795] DAMAGECOUNT value on done: 97134.0 [2024-08-06 00:27:36,561][52795] Sum rewards: 52.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.058', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.151', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.440', 'weapon2': '0.534', 'WEAPON3': '1.450', 'weapon3': '2.714', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '46.000'} [2024-08-06 00:27:37,048][52659] DAMAGECOUNT value on done: 110016.0 [2024-08-06 00:27:37,050][52659] Sum rewards: 53.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.794', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.026', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.200', 'weapon2': '0.710', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '46.000'} [2024-08-06 00:27:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 186916864. Throughput: 0: 4403.8. Samples: 46733110. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:27:37,794][52567] Avg episode reward: [(0, '52.677')] [2024-08-06 00:27:39,433][52650] Updated weights for policy 0, policy_version 22821 (0.0017) [2024-08-06 00:27:39,767][52795] DAMAGECOUNT value on done: 98462.0 [2024-08-06 00:27:39,769][52795] Sum rewards: 55.104, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '48.000'} [2024-08-06 00:27:40,088][52659] DAMAGECOUNT value on done: 108787.0 [2024-08-06 00:27:40,090][52659] Sum rewards: 51.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.883', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '45.500'} [2024-08-06 00:27:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 187006976. Throughput: 0: 4403.9. Samples: 46759450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:27:42,794][52567] Avg episode reward: [(0, '52.619')] [2024-08-06 00:27:42,833][52659] DAMAGECOUNT value on done: 112453.0 [2024-08-06 00:27:42,834][52659] Sum rewards: 56.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.144', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.020', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.212', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '49.000'} [2024-08-06 00:27:43,031][52795] DAMAGECOUNT value on done: 99777.0 [2024-08-06 00:27:43,032][52795] Sum rewards: 39.848, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.595', 'ARMOR': '0.016', 'AMMO5': '0.022', 'weapon5': '0.066', 'AMMO2': '0.075', 'AMMO3': '0.204', 'AMMO4': '0.377', 'WEAPON5': '0.500', 'weapon2': '0.596', 'weapon4': '0.758', 'WEAPON4': '0.900', 'WEAPON3': '1.250', 'weapon3': '2.178', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '40.000'} [2024-08-06 00:27:44,053][52650] Updated weights for policy 0, policy_version 22831 (0.0022) [2024-08-06 00:27:45,854][52659] DAMAGECOUNT value on done: 111260.0 [2024-08-06 00:27:45,856][52659] Sum rewards: 56.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.774', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '48.000'} [2024-08-06 00:27:46,290][52795] DAMAGECOUNT value on done: 102505.0 [2024-08-06 00:27:46,292][52795] Sum rewards: 54.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.006', 'ARMOR': '0.032', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.223', 'weapon2': '0.442', 'WEAPON4': '0.450', 'weapon4': '0.610', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '46.000'} [2024-08-06 00:27:47,039][52662] DAMAGECOUNT value on done: 114235.0 [2024-08-06 00:27:47,039][52662] Sum rewards: 47.187, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.732', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.056', 'weapon5': '0.126', 'AMMO3': '0.192', 'AMMO4': '0.278', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.538', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '41.000'} [2024-08-06 00:27:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.4). Total num frames: 187088896. Throughput: 0: 4393.8. Samples: 46772020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:27:47,794][52567] Avg episode reward: [(0, '52.694')] [2024-08-06 00:27:49,001][52650] Updated weights for policy 0, policy_version 22841 (0.0014) [2024-08-06 00:27:49,555][52795] DAMAGECOUNT value on done: 102376.0 [2024-08-06 00:27:49,555][52795] Sum rewards: 62.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.502', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.181', 'WEAPON4': '0.400', 'weapon4': '0.428', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2024-08-06 00:27:50,021][52662] DAMAGECOUNT value on done: 117182.0 [2024-08-06 00:27:50,022][52662] Sum rewards: 60.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.478', 'weapon4': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.534', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '51.000'} [2024-08-06 00:27:52,671][52795] DAMAGECOUNT value on done: 104681.0 [2024-08-06 00:27:52,671][52795] Sum rewards: 56.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon4': '0.120', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '49.000'} [2024-08-06 00:27:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 187179008. Throughput: 0: 4384.5. Samples: 46798240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:27:52,794][52567] Avg episode reward: [(0, '52.944')] [2024-08-06 00:27:52,933][52662] DAMAGECOUNT value on done: 119403.0 [2024-08-06 00:27:52,935][52662] Sum rewards: 44.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.216', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.061', 'weapon5': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'AMMO4': '0.303', 'weapon2': '0.398', 'WEAPON4': '0.750', 'weapon4': '0.830', 'WEAPON3': '1.350', 'weapon3': '2.134', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '39.000'} [2024-08-06 00:27:53,938][52650] Updated weights for policy 0, policy_version 22851 (0.0027) [2024-08-06 00:27:54,143][52668] DAMAGECOUNT value on done: 108605.0 [2024-08-06 00:27:54,145][52668] Sum rewards: 43.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.736', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '37.500'} [2024-08-06 00:27:55,913][52795] DAMAGECOUNT value on done: 102610.0 [2024-08-06 00:27:55,913][52795] Sum rewards: 51.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.532', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon5': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.692', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '46.000'} [2024-08-06 00:27:55,921][52662] DAMAGECOUNT value on done: 109134.0 [2024-08-06 00:27:55,925][52662] Sum rewards: 58.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.094', 'weapon5': '0.144', 'AMMO4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.090', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '49.000'} [2024-08-06 00:27:57,340][52668] DAMAGECOUNT value on done: 114351.0 [2024-08-06 00:27:57,341][52668] Sum rewards: 62.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.343', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.220', 'weapon2': '0.308', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.524', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '53.000'} [2024-08-06 00:27:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17615.7, 300 sec: 17550.3). Total num frames: 187269120. Throughput: 0: 4380.7. Samples: 46824510. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:27:57,795][52567] Avg episode reward: [(0, '53.139')] [2024-08-06 00:27:58,267][52650] Updated weights for policy 0, policy_version 22861 (0.0014) [2024-08-06 00:27:58,485][52794] DAMAGECOUNT value on done: 117135.0 [2024-08-06 00:27:58,488][52794] Sum rewards: 53.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.176', 'weapon2': '0.846', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.924', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '45.000'} [2024-08-06 00:27:58,698][52662] DAMAGECOUNT value on done: 114226.0 [2024-08-06 00:27:58,700][52662] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.389', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.068', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '47.000'} [2024-08-06 00:27:59,075][52795] DAMAGECOUNT value on done: 99421.0 [2024-08-06 00:27:59,075][52795] Sum rewards: 49.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.896', 'AMMO5': '0.003', 'AMMO2': '0.054', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'AMMO4': '0.271', 'WEAPON4': '0.400', 'weapon4': '0.492', 'weapon2': '0.812', 'WEAPON3': '1.050', 'weapon3': '2.438', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '40.000'} [2024-08-06 00:28:00,177][52668] DAMAGECOUNT value on done: 109575.0 [2024-08-06 00:28:00,179][52668] Sum rewards: 59.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.155', 'weapon5': '0.194', 'weapon4': '0.320', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:01,330][52794] DAMAGECOUNT value on done: 115496.0 [2024-08-06 00:28:01,332][52794] Sum rewards: 55.322, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.969', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'weapon4': '0.192', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.264', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:01,515][52662] DAMAGECOUNT value on done: 116425.0 [2024-08-06 00:28:01,515][52662] Sum rewards: 62.424, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.711', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.374', 'WEAPON3': '1.600', 'weapon3': '2.974', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '56.000'} [2024-08-06 00:28:02,318][52795] DAMAGECOUNT value on done: 103052.0 [2024-08-06 00:28:02,321][52795] Sum rewards: 50.382, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.284', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.057', 'weapon5': '0.062', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.286', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.788', 'weapon3': '2.328', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '39.000'} [2024-08-06 00:28:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 187351040. Throughput: 0: 4386.7. Samples: 46837870. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:28:02,795][52567] Avg episode reward: [(0, '53.493')] [2024-08-06 00:28:03,024][52668] DAMAGECOUNT value on done: 110201.0 [2024-08-06 00:28:03,026][52668] Sum rewards: 54.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.310', 'weapon2': '0.356', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.032', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '46.500'} [2024-08-06 00:28:03,222][52650] Updated weights for policy 0, policy_version 22871 (0.0012) [2024-08-06 00:28:04,021][52794] DAMAGECOUNT value on done: 111206.0 [2024-08-06 00:28:04,022][52794] Sum rewards: 54.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.704', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '2.946', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:04,172][52662] DAMAGECOUNT value on done: 114913.0 [2024-08-06 00:28:04,172][52662] Sum rewards: 30.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon7': '0.050', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.143', 'WEAPON7': '0.200', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon4': '0.802', 'weapon3': '1.884', 'HITCOUNT': '2.070', 'DAMAGECOUNT': '8.817', 'FRAGCOUNT': '26.500'} [2024-08-06 00:28:05,527][52795] DAMAGECOUNT value on done: 102689.0 [2024-08-06 00:28:05,528][52795] Sum rewards: 56.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.992', 'AMMO5': '0.005', 'AMMO2': '0.035', 'AMMO3': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.390', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '2.958', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:06,182][52668] DAMAGECOUNT value on done: 110891.0 [2024-08-06 00:28:06,184][52668] Sum rewards: 59.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.405', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.223', 'weapon2': '0.280', 'WEAPON3': '1.600', 'weapon3': '3.382', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '51.000'} [2024-08-06 00:28:06,620][52794] DAMAGECOUNT value on done: 108100.0 [2024-08-06 00:28:06,621][52794] Sum rewards: 42.414, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.569', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.023', 'weapon4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.676', 'WEAPON3': '0.900', 'HITCOUNT': '2.310', 'weapon3': '3.126', 'DAMAGECOUNT': '10.485', 'FRAGCOUNT': '34.000'} [2024-08-06 00:28:06,720][52662] DAMAGECOUNT value on done: 120407.0 [2024-08-06 00:28:06,722][52662] Sum rewards: 52.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.006', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:07,040][52660] DAMAGECOUNT value on done: 106725.0 [2024-08-06 00:28:07,042][52660] Sum rewards: 50.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'ARMOR': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon4': '0.462', 'weapon2': '0.670', 'WEAPON3': '1.400', 'weapon3': '2.656', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:07,429][52650] Updated weights for policy 0, policy_version 22881 (0.0028) [2024-08-06 00:28:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 187441152. Throughput: 0: 4376.6. Samples: 46863940. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:28:07,802][52567] Avg episode reward: [(0, '53.209')] [2024-08-06 00:28:08,633][52795] DAMAGECOUNT value on done: 100018.0 [2024-08-06 00:28:08,633][52795] Sum rewards: 62.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.784', 'AMMO5': '0.007', 'AMMO2': '0.020', 'ARMOR': '0.036', 'weapon4': '0.048', 'AMMO4': '0.098', 'weapon5': '0.160', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.200', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:08,813][52668] DAMAGECOUNT value on done: 107975.0 [2024-08-06 00:28:08,815][52668] Sum rewards: 43.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.058', 'weapon5': '0.066', 'AMMO3': '0.197', 'weapon4': '0.274', 'AMMO4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'weapon2': '0.690', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '41.000'} [2024-08-06 00:28:09,355][52794] DAMAGECOUNT value on done: 114050.0 [2024-08-06 00:28:09,356][52794] Sum rewards: 65.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.313', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.098', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2024-08-06 00:28:09,450][52662] DAMAGECOUNT value on done: 114494.0 [2024-08-06 00:28:09,453][52662] Sum rewards: 66.439, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'HEALTH': '0.211', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.458', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '55.000'} [2024-08-06 00:28:09,911][52660] DAMAGECOUNT value on done: 110875.0 [2024-08-06 00:28:09,911][52660] Sum rewards: 63.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.034', 'ARMOR': '0.008', 'AMMO2': '0.047', 'AMMO3': '0.205', 'AMMO4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.328', 'weapon4': '0.448', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:11,569][52668] DAMAGECOUNT value on done: 111104.0 [2024-08-06 00:28:11,570][52668] Sum rewards: 60.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.714', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.048', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.758', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '50.000'} [2024-08-06 00:28:11,734][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-06 00:28:11,820][52795] DAMAGECOUNT value on done: 101907.0 [2024-08-06 00:28:11,821][52795] Sum rewards: 55.027, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.060', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '3.144', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '51.000'} [2024-08-06 00:28:12,069][52794] DAMAGECOUNT value on done: 115180.0 [2024-08-06 00:28:12,071][52794] Sum rewards: 59.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.406', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '2.756', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '50.000'} [2024-08-06 00:28:12,155][52662] DAMAGECOUNT value on done: 116889.0 [2024-08-06 00:28:12,155][52662] Sum rewards: 54.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.179', 'WEAPON4': '0.400', 'weapon2': '0.520', 'weapon4': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.428', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:12,306][52660] DAMAGECOUNT value on done: 110880.0 [2024-08-06 00:28:12,308][52660] Sum rewards: 39.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.962', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.201', 'weapon4': '0.354', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.916', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '36.500'} [2024-08-06 00:28:12,340][52650] Updated weights for policy 0, policy_version 22891 (0.0028) [2024-08-06 00:28:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 187531264. Throughput: 0: 4374.2. Samples: 46890260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:28:12,794][52567] Avg episode reward: [(0, '53.542')] [2024-08-06 00:28:14,195][52668] DAMAGECOUNT value on done: 113918.0 [2024-08-06 00:28:14,195][52668] Sum rewards: 72.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.626', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '60.000'} [2024-08-06 00:28:15,121][52795] DAMAGECOUNT value on done: 100922.0 [2024-08-06 00:28:15,121][52795] Sum rewards: 56.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.716', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:15,124][52660] DAMAGECOUNT value on done: 111489.0 [2024-08-06 00:28:15,124][52660] Sum rewards: 56.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.745', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.422', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:15,190][52794] DAMAGECOUNT value on done: 117800.0 [2024-08-06 00:28:15,194][52794] Sum rewards: 47.964, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.050', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO4': '0.251', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'weapon2': '0.662', 'WEAPON3': '1.400', 'weapon3': '2.668', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '42.500'} [2024-08-06 00:28:15,303][52662] DAMAGECOUNT value on done: 113896.0 [2024-08-06 00:28:15,303][52662] Sum rewards: 52.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.040', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:16,955][52650] Updated weights for policy 0, policy_version 22901 (0.0012) [2024-08-06 00:28:17,388][52668] DAMAGECOUNT value on done: 111593.0 [2024-08-06 00:28:17,391][52668] Sum rewards: 55.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.058', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '2.998', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 187613184. Throughput: 0: 4368.9. Samples: 46903440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:28:17,795][52567] Avg episode reward: [(0, '53.836')] [2024-08-06 00:28:17,882][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:28:17,915][52667] DAMAGECOUNT value on done: 111213.0 [2024-08-06 00:28:17,919][52667] Sum rewards: 41.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.732', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.094', 'AMMO3': '0.195', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.342', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.882', 'DAMAGECOUNT': '11.196', 'FRAGCOUNT': '36.000'} [2024-08-06 00:28:18,317][52660] DAMAGECOUNT value on done: 107546.0 [2024-08-06 00:28:18,318][52660] Sum rewards: 55.520, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.082', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:18,323][52795] DAMAGECOUNT value on done: 98469.0 [2024-08-06 00:28:18,324][52795] Sum rewards: 48.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.107', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.028', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.336', 'weapon4': '0.392', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '3.032', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '40.000'} [2024-08-06 00:28:18,339][52794] DAMAGECOUNT value on done: 114376.0 [2024-08-06 00:28:18,339][52794] Sum rewards: 56.190, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.609', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.050', 'AMMO3': '0.221', 'weapon5': '0.226', 'AMMO4': '0.251', 'weapon2': '0.304', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:18,451][52662] DAMAGECOUNT value on done: 116644.0 [2024-08-06 00:28:18,451][52662] Sum rewards: 57.733, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.270', 'weapon2': '0.310', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.334', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '53.000'} [2024-08-06 00:28:20,120][52668] DAMAGECOUNT value on done: 112496.0 [2024-08-06 00:28:20,122][52668] Sum rewards: 59.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon5': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.480', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '51.000'} [2024-08-06 00:28:20,323][52667] DAMAGECOUNT value on done: 113386.0 [2024-08-06 00:28:20,324][52667] Sum rewards: 55.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.054', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.211', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:20,589][52669] DAMAGECOUNT value on done: 114387.0 [2024-08-06 00:28:20,589][52669] Sum rewards: 43.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.030', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.227', 'weapon2': '0.936', 'WEAPON3': '1.450', 'HITCOUNT': '2.450', 'weapon3': '2.862', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '39.000'} [2024-08-06 00:28:20,997][52662] DAMAGECOUNT value on done: 113250.0 [2024-08-06 00:28:20,997][52794] DAMAGECOUNT value on done: 114178.0 [2024-08-06 00:28:20,998][52662] Sum rewards: 52.830, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.216', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.072', 'AMMO4': '0.106', 'weapon4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:21,000][52794] Sum rewards: 53.242, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.036', 'weapon5': '0.110', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.292', 'weapon2': '0.708', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '2.752', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '43.000'} [2024-08-06 00:28:21,019][52660] DAMAGECOUNT value on done: 107781.0 [2024-08-06 00:28:21,020][52660] Sum rewards: 55.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.416', 'weapon2': '0.978', 'WEAPON3': '1.250', 'weapon3': '2.304', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '47.500'} [2024-08-06 00:28:21,534][52795] DAMAGECOUNT value on done: 103202.0 [2024-08-06 00:28:21,535][52795] Sum rewards: 55.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.848', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.068', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.254', 'weapon4': '0.414', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:21,632][52650] Updated weights for policy 0, policy_version 22911 (0.0013) [2024-08-06 00:28:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 187703296. Throughput: 0: 4374.9. Samples: 46929980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:28:22,795][52567] Avg episode reward: [(0, '53.753')] [2024-08-06 00:28:23,151][52669] DAMAGECOUNT value on done: 111204.0 [2024-08-06 00:28:23,151][52669] Sum rewards: 51.489, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.116', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.034', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'weapon4': '0.232', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:23,200][52668] DAMAGECOUNT value on done: 109382.0 [2024-08-06 00:28:23,202][52668] Sum rewards: 52.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.082', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.820', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:23,259][52667] DAMAGECOUNT value on done: 112254.0 [2024-08-06 00:28:23,259][52667] Sum rewards: 61.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.188', 'weapon2': '0.394', 'WEAPON4': '0.500', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:24,142][52794] DAMAGECOUNT value on done: 119337.0 [2024-08-06 00:28:24,143][52794] Sum rewards: 69.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.280', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.210', 'weapon4': '0.282', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '57.000'} [2024-08-06 00:28:24,161][52662] DAMAGECOUNT value on done: 112306.0 [2024-08-06 00:28:24,162][52662] Sum rewards: 60.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.212', 'weapon2': '0.518', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.150', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '51.000'} [2024-08-06 00:28:24,181][52660] DAMAGECOUNT value on done: 111374.0 [2024-08-06 00:28:24,181][52660] Sum rewards: 45.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.438', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '3.190', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '40.500'} [2024-08-06 00:28:24,923][52795] DAMAGECOUNT value on done: 105189.0 [2024-08-06 00:28:24,925][52795] Sum rewards: 57.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.446', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.062', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '3.300', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:25,904][52669] DAMAGECOUNT value on done: 109712.0 [2024-08-06 00:28:25,905][52669] Sum rewards: 53.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon2': '0.172', 'AMMO3': '0.203', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.720', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:26,142][52668] DAMAGECOUNT value on done: 108292.0 [2024-08-06 00:28:26,142][52668] Sum rewards: 59.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.018', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.215', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:26,294][52667] DAMAGECOUNT value on done: 109948.0 [2024-08-06 00:28:26,294][52667] Sum rewards: 66.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.104', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.606', 'WEAPON3': '0.950', 'weapon3': '2.794', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '55.000'} [2024-08-06 00:28:26,445][52650] Updated weights for policy 0, policy_version 22921 (0.0028) [2024-08-06 00:28:26,581][52614] Signal inference workers to stop experience collection... (4250 times) [2024-08-06 00:28:26,594][52614] Signal inference workers to resume experience collection... (4250 times) [2024-08-06 00:28:26,667][52650] InferenceWorker_p0-w0: stopping experience collection (4250 times) [2024-08-06 00:28:26,667][52650] InferenceWorker_p0-w0: resuming experience collection (4250 times) [2024-08-06 00:28:26,751][52794] DAMAGECOUNT value on done: 111499.0 [2024-08-06 00:28:26,751][52794] Sum rewards: 46.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.675', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.155', 'WEAPON4': '0.450', 'weapon2': '0.494', 'weapon4': '0.664', 'WEAPON3': '0.900', 'weapon3': '2.654', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '40.000'} [2024-08-06 00:28:26,770][52662] DAMAGECOUNT value on done: 111514.0 [2024-08-06 00:28:26,771][52662] Sum rewards: 55.186, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.160', 'weapon5': '0.236', 'AMMO4': '0.289', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON4': '0.750', 'weapon4': '0.810', 'WEAPON3': '1.000', 'weapon3': '2.126', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '48.500'} [2024-08-06 00:28:27,110][52795] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:28:27,288][52660] DAMAGECOUNT value on done: 110714.0 [2024-08-06 00:28:27,289][52660] Sum rewards: 56.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.175', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.040', 'weapon4': '0.112', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.336', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '50.000'} [2024-08-06 00:28:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 187793408. Throughput: 0: 4369.6. Samples: 46956080. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:28:27,794][52567] Avg episode reward: [(0, '54.368')] [2024-08-06 00:28:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022924_187793408.pth... [2024-08-06 00:28:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022411_183590912.pth [2024-08-06 00:28:28,026][52795] DAMAGECOUNT value on done: 99395.0 [2024-08-06 00:28:28,027][52795] Sum rewards: 57.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.060', 'weapon4': '0.064', 'AMMO4': '0.075', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.544', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.120', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:28,089][52649] DAMAGECOUNT value on done: 107873.0 [2024-08-06 00:28:28,089][52649] Sum rewards: 49.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.116', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.194', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '43.000'} [2024-08-06 00:28:29,034][52669] DAMAGECOUNT value on done: 109195.0 [2024-08-06 00:28:29,037][52669] Sum rewards: 54.665, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.080', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.834', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '43.500'} [2024-08-06 00:28:29,276][52668] DAMAGECOUNT value on done: 102458.0 [2024-08-06 00:28:29,277][52668] Sum rewards: 52.382, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.536', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.460', 'weapon4': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.750', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:29,352][52667] DAMAGECOUNT value on done: 113212.0 [2024-08-06 00:28:29,355][52667] Sum rewards: 57.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.225', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.504', 'WEAPON3': '1.400', 'weapon3': '2.694', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:29,560][52794] DAMAGECOUNT value on done: 116314.0 [2024-08-06 00:28:29,561][52794] Sum rewards: 56.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.868', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.188', 'AMMO4': '0.188', 'weapon2': '0.298', 'WEAPON4': '0.350', 'weapon4': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.750', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:29,575][52662] DAMAGECOUNT value on done: 118366.0 [2024-08-06 00:28:29,575][52662] Sum rewards: 46.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.613', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.165', 'weapon5': '0.204', 'AMMO4': '0.271', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '0.950', 'HITCOUNT': '2.300', 'weapon3': '2.394', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '39.000'} [2024-08-06 00:28:30,254][52660] DAMAGECOUNT value on done: 111084.0 [2024-08-06 00:28:30,256][52660] Sum rewards: 48.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.399', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.203', 'weapon4': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.112', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '43.000'} [2024-08-06 00:28:30,803][52649] DAMAGECOUNT value on done: 105293.0 [2024-08-06 00:28:30,804][52649] Sum rewards: 48.045, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.587', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.082', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon4': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.584', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '43.000'} [2024-08-06 00:28:31,000][52650] Updated weights for policy 0, policy_version 22931 (0.0028) [2024-08-06 00:28:31,141][52795] DAMAGECOUNT value on done: 103382.0 [2024-08-06 00:28:31,143][52795] Sum rewards: 50.739, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.575', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.002', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:31,887][52669] DAMAGECOUNT value on done: 110654.0 [2024-08-06 00:28:31,887][52669] Sum rewards: 54.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.025', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.364', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:32,035][52668] DAMAGECOUNT value on done: 110354.0 [2024-08-06 00:28:32,035][52668] Sum rewards: 51.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.456', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.478', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.852', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:32,617][52667] DAMAGECOUNT value on done: 108673.0 [2024-08-06 00:28:32,619][52667] Sum rewards: 57.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon7': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.230', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.686', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '50.000'} [2024-08-06 00:28:32,646][52794] DAMAGECOUNT value on done: 113723.0 [2024-08-06 00:28:32,647][52794] Sum rewards: 50.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.574', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon4': '0.204', 'AMMO4': '0.212', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:32,672][52662] DAMAGECOUNT value on done: 108925.0 [2024-08-06 00:28:32,672][52662] Sum rewards: 52.341, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.584', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.048', 'weapon5': '0.122', 'AMMO3': '0.214', 'weapon4': '0.216', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.864', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 187875328. Throughput: 0: 4374.2. Samples: 46968860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:28:32,795][52567] Avg episode reward: [(0, '53.752')] [2024-08-06 00:28:32,865][52660] DAMAGECOUNT value on done: 110183.0 [2024-08-06 00:28:32,866][52660] Sum rewards: 46.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.840', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.154', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.170', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '42.000'} [2024-08-06 00:28:34,195][52649] DAMAGECOUNT value on done: 108089.0 [2024-08-06 00:28:34,197][52649] Sum rewards: 45.834, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.734', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.054', 'weapon4': '0.086', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '2.570', 'weapon3': '3.244', 'DAMAGECOUNT': '11.568', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:34,305][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:28:34,334][52795] DAMAGECOUNT value on done: 105092.0 [2024-08-06 00:28:34,336][52795] Sum rewards: 42.872, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.680', 'AMMO5': '0.004', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.190', 'AMMO3': '0.274', 'weapon4': '0.360', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '2.892', 'DAMAGECOUNT': '11.241', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:34,593][52669] DAMAGECOUNT value on done: 110270.0 [2024-08-06 00:28:34,594][52669] Sum rewards: 50.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.163', 'weapon5': '0.206', 'AMMO4': '0.267', 'weapon2': '0.382', 'WEAPON5': '0.400', 'weapon4': '0.642', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.512', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '42.500'} [2024-08-06 00:28:35,077][52668] DAMAGECOUNT value on done: 109434.0 [2024-08-06 00:28:35,079][52668] Sum rewards: 48.348, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.616', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.166', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.554', 'weapon4': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.446', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '41.000'} [2024-08-06 00:28:35,146][52667] DAMAGECOUNT value on done: 112862.0 [2024-08-06 00:28:35,148][52667] Sum rewards: 63.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.880', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.058', 'weapon4': '0.084', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.214', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.000'} [2024-08-06 00:28:35,706][52662] DAMAGECOUNT value on done: 116328.0 [2024-08-06 00:28:35,707][52662] Sum rewards: 50.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.146', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.496', 'WEAPON4': '0.550', 'weapon4': '0.648', 'WEAPON3': '0.900', 'weapon3': '2.540', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '43.000'} [2024-08-06 00:28:35,734][52794] DAMAGECOUNT value on done: 121738.0 [2024-08-06 00:28:35,734][52794] Sum rewards: 62.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.181', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:35,764][52650] Updated weights for policy 0, policy_version 22941 (0.0012) [2024-08-06 00:28:36,037][52660] DAMAGECOUNT value on done: 111821.0 [2024-08-06 00:28:36,038][52660] Sum rewards: 52.856, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.226', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.350', 'weapon3': '2.650', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:37,187][52649] DAMAGECOUNT value on done: 110258.0 [2024-08-06 00:28:37,187][52649] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.484', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.068', 'AMMO4': '0.108', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '50.000'} [2024-08-06 00:28:37,305][52669] DAMAGECOUNT value on done: 111148.0 [2024-08-06 00:28:37,311][52669] Sum rewards: 55.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.802', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.203', 'weapon2': '0.692', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.096', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 187965440. Throughput: 0: 4377.3. Samples: 46995220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:28:37,794][52567] Avg episode reward: [(0, '53.953')] [2024-08-06 00:28:37,839][52667] DAMAGECOUNT value on done: 112244.0 [2024-08-06 00:28:37,840][52667] Sum rewards: 46.608, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.046', 'AMMO4': '0.171', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '3.094', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '42.000'} [2024-08-06 00:28:37,986][52668] DAMAGECOUNT value on done: 111157.0 [2024-08-06 00:28:37,987][52668] Sum rewards: 60.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.239', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.190', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:38,663][52794] DAMAGECOUNT value on done: 110076.0 [2024-08-06 00:28:38,665][52794] Sum rewards: 48.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.499', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.024', 'ARMOR': '0.044', 'weapon5': '0.058', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.740', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '41.000'} [2024-08-06 00:28:38,716][52662] DAMAGECOUNT value on done: 112685.0 [2024-08-06 00:28:38,716][52662] Sum rewards: 46.439, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO4': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.976', 'WEAPON3': '1.200', 'weapon3': '2.364', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.574', 'FRAGCOUNT': '40.000'} [2024-08-06 00:28:38,759][52660] DAMAGECOUNT value on done: 106325.0 [2024-08-06 00:28:38,760][52660] Sum rewards: 55.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.184', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.158', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '50.000'} [2024-08-06 00:28:39,985][52649] DAMAGECOUNT value on done: 102910.0 [2024-08-06 00:28:39,985][52649] Sum rewards: 52.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.749', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'weapon2': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.538', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:40,204][52650] Updated weights for policy 0, policy_version 22951 (0.0027) [2024-08-06 00:28:40,354][52669] DAMAGECOUNT value on done: 112011.0 [2024-08-06 00:28:40,356][52669] Sum rewards: 52.613, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO3': '0.172', 'weapon2': '0.738', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '2.982', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:40,506][52668] DAMAGECOUNT value on done: 108115.0 [2024-08-06 00:28:40,507][52668] Sum rewards: 62.418, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon4': '0.272', 'weapon2': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.122', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '54.000'} [2024-08-06 00:28:40,846][52667] DAMAGECOUNT value on done: 111028.0 [2024-08-06 00:28:40,846][52667] Sum rewards: 49.229, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.735', 'AMMO5': '0.022', 'AMMO2': '0.042', 'weapon5': '0.148', 'AMMO3': '0.166', 'weapon2': '0.188', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon4': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '41.000'} [2024-08-06 00:28:41,404][52660] DAMAGECOUNT value on done: 108482.0 [2024-08-06 00:28:41,404][52660] Sum rewards: 62.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.292', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.636', 'WEAPON3': '1.300', 'weapon3': '2.534', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '52.000'} [2024-08-06 00:28:41,678][52794] DAMAGECOUNT value on done: 116353.0 [2024-08-06 00:28:41,678][52794] Sum rewards: 48.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.272', 'weapon4': '0.406', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.134', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '42.000'} [2024-08-06 00:28:41,726][52662] DAMAGECOUNT value on done: 112113.0 [2024-08-06 00:28:41,728][52662] Sum rewards: 48.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.142', 'AMMO4': '0.214', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.326', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.806', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '42.000'} [2024-08-06 00:28:42,484][52649] DAMAGECOUNT value on done: 106911.0 [2024-08-06 00:28:42,485][52649] Sum rewards: 58.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.140', 'weapon4': '0.008', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.262', 'weapon2': '0.456', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.306', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '53.000'} [2024-08-06 00:28:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 188063744. Throughput: 0: 4378.2. Samples: 47021530. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:28:42,795][52567] Avg episode reward: [(0, '53.878')] [2024-08-06 00:28:43,396][52669] DAMAGECOUNT value on done: 111505.0 [2024-08-06 00:28:43,396][52669] Sum rewards: 42.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.867', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.059', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon4': '0.242', 'weapon2': '0.276', 'AMMO4': '0.293', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.226', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '38.500'} [2024-08-06 00:28:43,567][52668] DAMAGECOUNT value on done: 110073.0 [2024-08-06 00:28:43,568][52668] Sum rewards: 56.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.292', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:43,793][52667] DAMAGECOUNT value on done: 114510.0 [2024-08-06 00:28:43,793][52667] Sum rewards: 49.172, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.914', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.550', 'weapon3': '2.742', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:44,180][52660] DAMAGECOUNT value on done: 110959.0 [2024-08-06 00:28:44,181][52660] Sum rewards: 46.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.333', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.048', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'AMMO4': '0.240', 'weapon2': '0.392', 'WEAPON4': '0.450', 'weapon4': '0.628', 'WEAPON3': '1.400', 'weapon3': '2.712', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '41.500'} [2024-08-06 00:28:44,777][52794] DAMAGECOUNT value on done: 116125.0 [2024-08-06 00:28:44,777][52794] Sum rewards: 50.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.424', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.268', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:45,056][52650] Updated weights for policy 0, policy_version 22961 (0.0034) [2024-08-06 00:28:45,636][52649] DAMAGECOUNT value on done: 103147.0 [2024-08-06 00:28:45,637][52649] Sum rewards: 40.818, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'ARMOR': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.346', 'weapon4': '0.604', 'WEAPON3': '1.350', 'weapon3': '2.744', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '37.000'} [2024-08-06 00:28:46,622][52668] DAMAGECOUNT value on done: 113436.0 [2024-08-06 00:28:46,624][52668] Sum rewards: 58.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.410', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.138', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.430', 'weapon2': '0.528', 'WEAPON3': '0.850', 'weapon3': '2.744', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:46,671][52669] DAMAGECOUNT value on done: 108061.0 [2024-08-06 00:28:46,671][52669] Sum rewards: 54.230, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.943', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.126', 'AMMO4': '0.223', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.806', 'weapon3': '2.540', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.063', 'FRAGCOUNT': '43.000'} [2024-08-06 00:28:46,854][52667] DAMAGECOUNT value on done: 112513.0 [2024-08-06 00:28:46,855][52667] Sum rewards: 55.996, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.335', 'ARMOR': '0.016', 'AMMO2': '0.029', 'AMMO3': '0.134', 'AMMO4': '0.145', 'WEAPON4': '0.400', 'weapon4': '0.470', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:47,222][52794] DAMAGECOUNT value on done: 115383.0 [2024-08-06 00:28:47,225][52794] Sum rewards: 63.313, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.145', 'weapon2': '0.354', 'WEAPON3': '1.000', 'HITCOUNT': '3.280', 'weapon3': '3.582', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '51.000'} [2024-08-06 00:28:47,409][52670] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:28:47,603][52660] DAMAGECOUNT value on done: 117391.0 [2024-08-06 00:28:47,604][52660] Sum rewards: 53.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.356', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.166', 'weapon5': '0.222', 'AMMO4': '0.226', 'weapon2': '0.324', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '43.000'} [2024-08-06 00:28:47,746][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:28:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 188137472. Throughput: 0: 4371.5. Samples: 47034590. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:28:47,795][52567] Avg episode reward: [(0, '53.614')] [2024-08-06 00:28:48,690][52649] DAMAGECOUNT value on done: 111724.0 [2024-08-06 00:28:48,693][52649] Sum rewards: 57.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.202', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '48.500'} [2024-08-06 00:28:49,596][52667] DAMAGECOUNT value on done: 110889.0 [2024-08-06 00:28:49,600][52667] Sum rewards: 52.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.440', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.172', 'weapon4': '0.228', 'AMMO3': '0.243', 'AMMO4': '0.243', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.732', 'WEAPON3': '1.350', 'weapon3': '2.546', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '47.500'} [2024-08-06 00:28:49,611][52820] DAMAGECOUNT value on done: 100764.0 [2024-08-06 00:28:49,611][52820] Sum rewards: 59.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.848', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon5': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.814', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:49,721][52668] DAMAGECOUNT value on done: 112119.0 [2024-08-06 00:28:49,722][52668] Sum rewards: 57.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.215', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.506', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.256', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:49,826][52669] DAMAGECOUNT value on done: 113364.0 [2024-08-06 00:28:49,827][52669] Sum rewards: 53.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.310', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.148', 'weapon4': '0.252', 'AMMO3': '0.265', 'AMMO4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.650', 'HITCOUNT': '2.880', 'weapon3': '2.898', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:50,081][52650] Updated weights for policy 0, policy_version 22971 (0.0022) [2024-08-06 00:28:50,361][52794] DAMAGECOUNT value on done: 120933.0 [2024-08-06 00:28:50,365][52794] Sum rewards: 61.059, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO2': '0.026', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.193', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '51.000'} [2024-08-06 00:28:50,610][52660] DAMAGECOUNT value on done: 108707.0 [2024-08-06 00:28:50,610][52660] Sum rewards: 56.537, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon2': '0.272', 'weapon4': '0.314', 'HEALTH': '0.528', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '3.248', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:51,743][52649] DAMAGECOUNT value on done: 105923.0 [2024-08-06 00:28:51,743][52649] Sum rewards: 53.952, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon4': '0.120', 'AMMO3': '0.151', 'AMMO4': '0.151', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'HEALTH': '0.546', 'weapon2': '0.762', 'WEAPON3': '0.800', 'weapon3': '2.728', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:52,403][52667] DAMAGECOUNT value on done: 113343.0 [2024-08-06 00:28:52,405][52667] Sum rewards: 70.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.051', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.207', 'AMMO4': '0.245', 'weapon2': '0.448', 'WEAPON4': '0.500', 'weapon4': '0.710', 'WEAPON3': '1.150', 'weapon3': '2.506', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '60.000'} [2024-08-06 00:28:52,673][52820] DAMAGECOUNT value on done: 103563.0 [2024-08-06 00:28:52,673][52820] Sum rewards: 51.063, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.564', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'weapon2': '0.254', 'AMMO3': '0.285', 'weapon4': '0.332', 'WEAPON3': '1.700', 'weapon3': '3.050', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '47.000'} [2024-08-06 00:28:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 188227584. Throughput: 0: 4379.8. Samples: 47061030. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 00:28:52,794][52567] Avg episode reward: [(0, '54.232')] [2024-08-06 00:28:53,052][52669] DAMAGECOUNT value on done: 112754.0 [2024-08-06 00:28:53,055][52669] Sum rewards: 55.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.922', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.222', 'weapon2': '0.294', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.290', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:53,261][52794] DAMAGECOUNT value on done: 113691.0 [2024-08-06 00:28:53,266][52794] Sum rewards: 51.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.698', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.072', 'AMMO3': '0.203', 'weapon2': '0.248', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '3.488', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:53,527][52660] DAMAGECOUNT value on done: 112895.0 [2024-08-06 00:28:53,529][52660] Sum rewards: 54.083, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.276', 'weapon2': '0.388', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.176', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.500'} [2024-08-06 00:28:54,085][52658] DAMAGECOUNT value on done: 114931.0 [2024-08-06 00:28:54,086][52658] Sum rewards: 67.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.474', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon2': '0.174', 'weapon4': '0.196', 'AMMO3': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 00:28:54,474][52650] Updated weights for policy 0, policy_version 22981 (0.0010) [2024-08-06 00:28:54,780][52649] DAMAGECOUNT value on done: 109136.0 [2024-08-06 00:28:54,783][52649] Sum rewards: 56.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.860', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.028', 'AMMO4': '0.102', 'weapon4': '0.128', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.144', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '49.500'} [2024-08-06 00:28:55,321][52667] DAMAGECOUNT value on done: 109495.0 [2024-08-06 00:28:55,329][52667] Sum rewards: 54.747, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.914', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.062', 'weapon5': '0.182', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'AMMO4': '0.309', 'weapon2': '0.372', 'weapon4': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.554', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '50.000'} [2024-08-06 00:28:55,607][52664] DAMAGECOUNT value on done: 114101.0 [2024-08-06 00:28:55,607][52664] Sum rewards: 42.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.622', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.056', 'weapon5': '0.094', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'AMMO4': '0.279', 'weapon2': '0.698', 'WEAPON4': '0.850', 'WEAPON3': '0.850', 'weapon4': '0.858', 'weapon3': '2.142', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '36.500'} [2024-08-06 00:28:55,670][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:28:55,850][52820] DAMAGECOUNT value on done: 101599.0 [2024-08-06 00:28:55,850][52820] Sum rewards: 54.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.265', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.226', 'weapon5': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.406', 'weapon2': '0.804', 'WEAPON3': '1.450', 'weapon3': '2.178', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '48.000'} [2024-08-06 00:28:56,192][52660] DAMAGECOUNT value on done: 107708.0 [2024-08-06 00:28:56,192][52660] Sum rewards: 53.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.264', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.126', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:56,281][52669] DAMAGECOUNT value on done: 109629.0 [2024-08-06 00:28:56,282][52669] Sum rewards: 42.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.342', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.188', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.390', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.822', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '38.000'} [2024-08-06 00:28:56,819][52658] DAMAGECOUNT value on done: 112143.0 [2024-08-06 00:28:56,821][52658] Sum rewards: 54.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.616', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO4': '0.189', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'weapon4': '0.412', 'WEAPON3': '1.600', 'weapon3': '2.868', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:57,567][52649] DAMAGECOUNT value on done: 107784.0 [2024-08-06 00:28:57,567][52649] Sum rewards: 56.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.182', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '49.000'} [2024-08-06 00:28:57,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 188317696. Throughput: 0: 4384.0. Samples: 47087540. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:28:57,794][52567] Avg episode reward: [(0, '53.716')] [2024-08-06 00:28:57,834][52667] DAMAGECOUNT value on done: 114089.0 [2024-08-06 00:28:57,834][52667] Sum rewards: 49.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.490', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.184', 'AMMO3': '0.266', 'weapon2': '0.368', 'weapon4': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.904', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '45.000'} [2024-08-06 00:28:58,298][52664] DAMAGECOUNT value on done: 113758.0 [2024-08-06 00:28:58,298][52664] Sum rewards: 50.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.557', 'ARMOR': '0.004', 'weapon7': '0.006', 'AMMO5': '0.020', 'AMMO2': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.203', 'weapon5': '0.312', 'AMMO4': '0.338', 'weapon4': '0.386', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.534', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '44.000'} [2024-08-06 00:28:58,856][52660] DAMAGECOUNT value on done: 113605.0 [2024-08-06 00:28:58,859][52660] Sum rewards: 57.145, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.600', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.270', 'weapon2': '0.292', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.310', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '51.000'} [2024-08-06 00:28:59,047][52650] Updated weights for policy 0, policy_version 22991 (0.0034) [2024-08-06 00:28:59,052][52820] DAMAGECOUNT value on done: 97310.0 [2024-08-06 00:28:59,056][52820] Sum rewards: 50.451, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.708', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon2': '0.382', 'WEAPON3': '1.550', 'HITCOUNT': '3.260', 'weapon3': '3.362', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '46.000'} [2024-08-06 00:28:59,279][52669] DAMAGECOUNT value on done: 112239.0 [2024-08-06 00:28:59,279][52669] Sum rewards: 48.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.102', 'weapon4': '0.138', 'AMMO3': '0.173', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '3.128', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '42.000'} [2024-08-06 00:28:59,668][52658] DAMAGECOUNT value on done: 112184.0 [2024-08-06 00:28:59,670][52658] Sum rewards: 65.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.304', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.328', 'WEAPON3': '0.850', 'weapon3': '3.118', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '52.000'} [2024-08-06 00:29:00,615][52664] DAMAGECOUNT value on done: 116317.0 [2024-08-06 00:29:00,617][52664] Sum rewards: 57.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.183', 'WEAPON4': '0.450', 'weapon2': '0.510', 'weapon4': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.686', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '48.500'} [2024-08-06 00:29:00,645][52649] DAMAGECOUNT value on done: 106592.0 [2024-08-06 00:29:00,646][52649] Sum rewards: 60.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.064', 'weapon5': '0.088', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.232', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.444', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '53.000'} [2024-08-06 00:29:00,945][52667] DAMAGECOUNT value on done: 118374.0 [2024-08-06 00:29:00,946][52667] Sum rewards: 56.211, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.254', 'ARMOR': '0.016', 'AMMO5': '0.021', 'AMMO2': '0.047', 'weapon4': '0.100', 'weapon5': '0.160', 'AMMO4': '0.236', 'AMMO3': '0.272', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.158', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:01,854][52660] DAMAGECOUNT value on done: 109477.0 [2024-08-06 00:29:01,856][52660] Sum rewards: 58.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.018', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.200', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '51.000'} [2024-08-06 00:29:02,054][52820] DAMAGECOUNT value on done: 102611.0 [2024-08-06 00:29:02,055][52820] Sum rewards: 67.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.638', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.116', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '55.000'} [2024-08-06 00:29:02,406][52658] DAMAGECOUNT value on done: 115084.0 [2024-08-06 00:29:02,408][52658] Sum rewards: 58.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.033', 'AMMO3': '0.136', 'weapon5': '0.162', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.600', 'weapon4': '0.668', 'WEAPON3': '0.900', 'weapon3': '2.338', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '51.000'} [2024-08-06 00:29:02,510][52669] DAMAGECOUNT value on done: 117460.0 [2024-08-06 00:29:02,510][52669] Sum rewards: 64.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.165', 'weapon4': '0.460', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2024-08-06 00:29:02,671][52660] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:29:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 188407808. Throughput: 0: 4384.9. Samples: 47100760. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:29:02,794][52567] Avg episode reward: [(0, '54.371')] [2024-08-06 00:29:03,310][52664] DAMAGECOUNT value on done: 114268.0 [2024-08-06 00:29:03,313][52664] Sum rewards: 44.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.236', 'weapon4': '0.478', 'WEAPON4': '0.550', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.588', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:03,325][52667] DAMAGECOUNT value on done: 114623.0 [2024-08-06 00:29:03,327][52667] Sum rewards: 56.948, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.414', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.036', 'AMMO4': '0.121', 'weapon4': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.138', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:03,650][52649] DAMAGECOUNT value on done: 112012.0 [2024-08-06 00:29:03,652][52649] Sum rewards: 55.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.148', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '2.926', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '47.000'} [2024-08-06 00:29:03,827][52650] Updated weights for policy 0, policy_version 23001 (0.0031) [2024-08-06 00:29:05,167][52820] DAMAGECOUNT value on done: 103339.0 [2024-08-06 00:29:05,167][52820] Sum rewards: 54.513, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.375', 'ARMOR': '0.008', 'weapon5': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.148', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.740', 'WEAPON3': '0.950', 'weapon3': '2.810', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:05,355][52658] DAMAGECOUNT value on done: 114326.0 [2024-08-06 00:29:05,356][52658] Sum rewards: 53.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.193', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:05,523][52669] DAMAGECOUNT value on done: 120486.0 [2024-08-06 00:29:05,528][52669] Sum rewards: 69.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '59.000'} [2024-08-06 00:29:05,794][52664] DAMAGECOUNT value on done: 113845.0 [2024-08-06 00:29:05,794][52664] Sum rewards: 53.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.016', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.520', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.046', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '48.500'} [2024-08-06 00:29:06,505][52667] DAMAGECOUNT value on done: 117470.0 [2024-08-06 00:29:06,507][52667] Sum rewards: 51.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.203', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.870', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:06,873][52649] DAMAGECOUNT value on done: 110250.0 [2024-08-06 00:29:06,873][52649] Sum rewards: 52.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.088', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.241', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.334', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.434', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 188497920. Throughput: 0: 4381.3. Samples: 47127140. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:29:07,794][52567] Avg episode reward: [(0, '54.202')] [2024-08-06 00:29:08,088][52650] Updated weights for policy 0, policy_version 23011 (0.0014) [2024-08-06 00:29:08,225][52820] DAMAGECOUNT value on done: 102743.0 [2024-08-06 00:29:08,226][52820] Sum rewards: 56.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.115', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon4': '0.466', 'ARMOR': '0.474', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.834', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '47.000'} [2024-08-06 00:29:08,238][52658] DAMAGECOUNT value on done: 108852.0 [2024-08-06 00:29:08,241][52658] Sum rewards: 55.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.531', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.218', 'weapon2': '0.224', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.304', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:08,433][52669] DAMAGECOUNT value on done: 113024.0 [2024-08-06 00:29:08,434][52669] Sum rewards: 52.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.506', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.234', 'weapon2': '0.296', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.550', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:08,588][52664] DAMAGECOUNT value on done: 119665.0 [2024-08-06 00:29:08,588][52664] Sum rewards: 51.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.702', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:09,347][52667] DAMAGECOUNT value on done: 108073.0 [2024-08-06 00:29:09,348][52667] Sum rewards: 45.683, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.486', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO4': '0.119', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'weapon4': '0.532', 'weapon2': '0.564', 'WEAPON3': '0.800', 'HITCOUNT': '2.640', 'weapon3': '2.666', 'DAMAGECOUNT': '11.295', 'FRAGCOUNT': '36.000'} [2024-08-06 00:29:10,042][52649] DAMAGECOUNT value on done: 104332.0 [2024-08-06 00:29:10,043][52649] Sum rewards: 63.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.988', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2024-08-06 00:29:10,163][52647] DAMAGECOUNT value on done: 117905.0 [2024-08-06 00:29:10,163][52647] Sum rewards: 54.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.156', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'weapon4': '0.306', 'weapon2': '0.364', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.980', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '45.500'} [2024-08-06 00:29:11,151][52658] DAMAGECOUNT value on done: 116981.0 [2024-08-06 00:29:11,159][52658] Sum rewards: 43.964, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.424', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon4': '0.356', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.650', 'weapon3': '2.658', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:11,218][52664] DAMAGECOUNT value on done: 118590.0 [2024-08-06 00:29:11,220][52664] Sum rewards: 55.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.939', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.134', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:11,225][52820] DAMAGECOUNT value on done: 103110.0 [2024-08-06 00:29:11,226][52820] Sum rewards: 41.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.206', 'AMMO4': '0.239', 'weapon4': '0.380', 'WEAPON4': '0.400', 'weapon2': '0.798', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.656', 'DAMAGECOUNT': '11.187', 'FRAGCOUNT': '36.000'} [2024-08-06 00:29:11,685][52669] DAMAGECOUNT value on done: 111871.0 [2024-08-06 00:29:11,688][52669] Sum rewards: 54.950, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.268', 'weapon2': '0.282', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.338', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:11,974][52666] DAMAGECOUNT value on done: 112191.0 [2024-08-06 00:29:11,976][52666] Sum rewards: 56.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.210', 'weapon2': '0.956', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '47.000'} [2024-08-06 00:29:12,295][52667] DAMAGECOUNT value on done: 116055.0 [2024-08-06 00:29:12,295][52667] Sum rewards: 51.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.032', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon4': '0.586', 'weapon2': '0.838', 'WEAPON3': '1.200', 'weapon3': '2.332', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:12,438][52647] DAMAGECOUNT value on done: 116085.0 [2024-08-06 00:29:12,438][52647] Sum rewards: 42.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.284', 'weapon4': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '3.206', 'DAMAGECOUNT': '11.514', 'FRAGCOUNT': '38.500'} [2024-08-06 00:29:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 188579840. Throughput: 0: 4383.1. Samples: 47153320. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:29:12,794][52567] Avg episode reward: [(0, '53.861')] [2024-08-06 00:29:13,076][52649] DAMAGECOUNT value on done: 111574.0 [2024-08-06 00:29:13,077][52649] Sum rewards: 48.071, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.485', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.098', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.400', 'weapon2': '0.634', 'weapon4': '0.652', 'WEAPON3': '0.900', 'weapon3': '2.418', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.150', 'FRAGCOUNT': '39.000'} [2024-08-06 00:29:13,120][52650] Updated weights for policy 0, policy_version 23021 (0.0012) [2024-08-06 00:29:13,795][52664] DAMAGECOUNT value on done: 109875.0 [2024-08-06 00:29:13,795][52664] Sum rewards: 51.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.396', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.414', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:14,109][52658] DAMAGECOUNT value on done: 110042.0 [2024-08-06 00:29:14,109][52658] Sum rewards: 54.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.185', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'weapon4': '0.148', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.308', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:14,439][52820] DAMAGECOUNT value on done: 102112.0 [2024-08-06 00:29:14,439][52820] Sum rewards: 69.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.396', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon4': '0.118', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.264', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'weapon3': '3.256', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '60.000'} [2024-08-06 00:29:14,576][52669] DAMAGECOUNT value on done: 113253.0 [2024-08-06 00:29:14,577][52669] Sum rewards: 56.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.137', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.189', 'weapon2': '0.268', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '48.000'} [2024-08-06 00:29:15,199][52666] DAMAGECOUNT value on done: 112071.0 [2024-08-06 00:29:15,200][52666] Sum rewards: 56.683, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.494', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.125', 'AMMO4': '0.183', 'WEAPON4': '0.350', 'weapon2': '0.428', 'weapon4': '0.680', 'WEAPON3': '0.850', 'weapon3': '2.460', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:15,219][52647] DAMAGECOUNT value on done: 121384.0 [2024-08-06 00:29:15,221][52647] Sum rewards: 51.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.044', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.536', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.682', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:16,216][52664] DAMAGECOUNT value on done: 122079.0 [2024-08-06 00:29:16,224][52664] Sum rewards: 48.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.326', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.055', 'AMMO3': '0.192', 'weapon5': '0.210', 'AMMO4': '0.277', 'weapon4': '0.430', 'WEAPON5': '0.450', 'weapon2': '0.560', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.496', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:16,293][52649] DAMAGECOUNT value on done: 108483.0 [2024-08-06 00:29:16,293][52649] Sum rewards: 59.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.240', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:17,120][52658] DAMAGECOUNT value on done: 116252.0 [2024-08-06 00:29:17,120][52658] Sum rewards: 60.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'ARMOR': '0.016', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.076', 'AMMO3': '0.180', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '51.000'} [2024-08-06 00:29:17,457][52650] Updated weights for policy 0, policy_version 23031 (0.0012) [2024-08-06 00:29:17,555][52820] DAMAGECOUNT value on done: 103963.0 [2024-08-06 00:29:17,555][52820] Sum rewards: 44.086, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.264', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.234', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.738', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '40.000'} [2024-08-06 00:29:17,571][52669] DAMAGECOUNT value on done: 111937.0 [2024-08-06 00:29:17,571][52669] Sum rewards: 54.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.544', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO3': '0.152', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.606', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:17,595][52647] DAMAGECOUNT value on done: 119850.0 [2024-08-06 00:29:17,595][52647] Sum rewards: 49.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.885', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO3': '0.147', 'AMMO4': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.556', 'weapon4': '0.744', 'WEAPON3': '1.000', 'weapon3': '2.324', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '40.000'} [2024-08-06 00:29:17,698][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:29:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 188669952. Throughput: 0: 4394.2. Samples: 47166600. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:29:17,794][52567] Avg episode reward: [(0, '54.289')] [2024-08-06 00:29:18,149][52666] DAMAGECOUNT value on done: 113929.0 [2024-08-06 00:29:18,149][52666] Sum rewards: 56.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.978', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.024', 'weapon5': '0.072', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.746', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:18,701][52664] DAMAGECOUNT value on done: 121477.0 [2024-08-06 00:29:18,702][52664] Sum rewards: 53.402, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.984', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon4': '0.312', 'weapon2': '0.376', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '3.056', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '48.000'} [2024-08-06 00:29:19,515][52649] DAMAGECOUNT value on done: 112025.0 [2024-08-06 00:29:19,515][52649] Sum rewards: 63.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '0.252', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.500', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '53.000'} [2024-08-06 00:29:19,551][52670] DAMAGECOUNT value on done: 108948.0 [2024-08-06 00:29:19,553][52670] Sum rewards: 44.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.312', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.082', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.498', 'weapon2': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.390', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.874', 'FRAGCOUNT': '38.000'} [2024-08-06 00:29:19,964][52647] DAMAGECOUNT value on done: 122289.0 [2024-08-06 00:29:19,966][52647] Sum rewards: 64.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.240', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '53.000'} [2024-08-06 00:29:20,039][52803] DAMAGECOUNT value on done: 107874.0 [2024-08-06 00:29:20,040][52803] Sum rewards: 47.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.344', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon4': '0.232', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.118', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:20,281][52658] DAMAGECOUNT value on done: 115926.0 [2024-08-06 00:29:20,281][52658] Sum rewards: 53.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon5': '0.028', 'AMMO4': '0.079', 'weapon4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.424', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '46.500'} [2024-08-06 00:29:20,598][52820] DAMAGECOUNT value on done: 105795.0 [2024-08-06 00:29:20,598][52820] Sum rewards: 49.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.154', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.514', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.782', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:20,867][52666] DAMAGECOUNT value on done: 108146.0 [2024-08-06 00:29:20,868][52666] Sum rewards: 67.617, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.193', 'weapon4': '0.236', 'weapon2': '0.694', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '56.000'} [2024-08-06 00:29:21,096][52664] DAMAGECOUNT value on done: 118040.0 [2024-08-06 00:29:21,097][52664] Sum rewards: 59.936, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.714', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.402', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.214', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '55.000'} [2024-08-06 00:29:22,230][52670] DAMAGECOUNT value on done: 113151.0 [2024-08-06 00:29:22,231][52670] Sum rewards: 37.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.065', 'weapon5': '0.066', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'AMMO4': '0.327', 'weapon4': '0.492', 'WEAPON4': '0.550', 'weapon2': '0.662', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.554', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '33.000'} [2024-08-06 00:29:22,396][52649] DAMAGECOUNT value on done: 109916.0 [2024-08-06 00:29:22,397][52649] Sum rewards: 47.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.360', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.102', 'weapon4': '0.140', 'AMMO4': '0.156', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.024', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:22,556][52650] Updated weights for policy 0, policy_version 23041 (0.0013) [2024-08-06 00:29:22,598][52647] DAMAGECOUNT value on done: 119791.0 [2024-08-06 00:29:22,600][52647] Sum rewards: 55.105, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.912', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.152', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'weapon2': '0.596', 'weapon4': '0.696', 'WEAPON3': '1.150', 'weapon3': '2.452', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 188760064. Throughput: 0: 4395.3. Samples: 47193010. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:29:22,795][52567] Avg episode reward: [(0, '54.266')] [2024-08-06 00:29:22,812][52658] DAMAGECOUNT value on done: 116031.0 [2024-08-06 00:29:22,812][52658] Sum rewards: 52.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.572', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon4': '0.310', 'weapon2': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.166', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:23,048][52803] DAMAGECOUNT value on done: 108163.0 [2024-08-06 00:29:23,049][52803] Sum rewards: 51.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.052', 'weapon4': '0.054', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.392', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '3.310', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '47.000'} [2024-08-06 00:29:23,456][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:29:23,594][52666] DAMAGECOUNT value on done: 109362.0 [2024-08-06 00:29:23,599][52666] Sum rewards: 45.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.812', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.580', 'WEAPON3': '1.250', 'HITCOUNT': '2.490', 'weapon3': '2.988', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '40.000'} [2024-08-06 00:29:23,900][52820] DAMAGECOUNT value on done: 104336.0 [2024-08-06 00:29:23,904][52820] Sum rewards: 53.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.985', 'ARMOR': '0.024', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.218', 'weapon2': '0.238', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.188', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '47.000'} [2024-08-06 00:29:24,154][52664] DAMAGECOUNT value on done: 115632.0 [2024-08-06 00:29:24,154][52664] Sum rewards: 56.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.192', 'AMMO5': '0.005', 'weapon5': '0.020', 'weapon4': '0.054', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'AMMO4': '0.280', 'weapon2': '0.404', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.312', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '51.000'} [2024-08-06 00:29:24,257][52663] DAMAGECOUNT value on done: 112649.0 [2024-08-06 00:29:24,257][52663] Sum rewards: 51.229, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.627', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.165', 'AMMO4': '0.185', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.442', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:25,055][52670] DAMAGECOUNT value on done: 108763.0 [2024-08-06 00:29:25,056][52670] Sum rewards: 55.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.290', 'WEAPON4': '0.500', 'weapon4': '0.590', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '47.000'} [2024-08-06 00:29:25,098][52649] DAMAGECOUNT value on done: 115251.0 [2024-08-06 00:29:25,100][52649] Sum rewards: 57.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'ARMOR': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:25,632][52658] DAMAGECOUNT value on done: 110113.0 [2024-08-06 00:29:25,632][52658] Sum rewards: 65.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.003', 'AMMO2': '0.027', 'ARMOR': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon4': '0.406', 'WEAPON3': '1.500', 'weapon3': '2.966', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '55.000'} [2024-08-06 00:29:25,685][52647] DAMAGECOUNT value on done: 117050.0 [2024-08-06 00:29:25,685][52647] Sum rewards: 46.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.298', 'AMMO5': '0.003', 'ARMOR': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:26,159][52666] DAMAGECOUNT value on done: 108429.0 [2024-08-06 00:29:26,159][52666] Sum rewards: 46.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.025', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.219', 'weapon2': '0.308', 'WEAPON4': '0.400', 'weapon4': '0.748', 'WEAPON3': '1.300', 'weapon3': '2.632', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:26,213][52803] DAMAGECOUNT value on done: 104609.0 [2024-08-06 00:29:26,214][52803] Sum rewards: 52.401, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.828', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.147', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'weapon4': '0.602', 'WEAPON3': '0.900', 'weapon3': '2.404', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:26,962][52650] Updated weights for policy 0, policy_version 23051 (0.0012) [2024-08-06 00:29:26,993][52820] DAMAGECOUNT value on done: 100637.0 [2024-08-06 00:29:26,993][52820] Sum rewards: 55.867, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.032', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.128', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:27,059][52664] DAMAGECOUNT value on done: 113235.0 [2024-08-06 00:29:27,060][52664] Sum rewards: 62.999, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.062', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.254', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.216', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '56.000'} [2024-08-06 00:29:27,728][52663] DAMAGECOUNT value on done: 112731.0 [2024-08-06 00:29:27,728][52663] Sum rewards: 66.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.490', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon2': '0.266', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.520', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '56.000'} [2024-08-06 00:29:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 188841984. Throughput: 0: 4396.7. Samples: 47219380. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:29:27,794][52567] Avg episode reward: [(0, '54.619')] [2024-08-06 00:29:28,070][52670] DAMAGECOUNT value on done: 112060.0 [2024-08-06 00:29:28,072][52670] Sum rewards: 62.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.131', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '3.114', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 00:29:28,152][52811] DAMAGECOUNT value on done: 110254.0 [2024-08-06 00:29:28,154][52811] Sum rewards: 63.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.908', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.308', 'weapon2': '0.422', 'WEAPON3': '1.800', 'weapon3': '3.388', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '56.000'} [2024-08-06 00:29:28,599][52647] DAMAGECOUNT value on done: 120662.0 [2024-08-06 00:29:28,599][52647] Sum rewards: 44.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon7': '0.048', 'AMMO4': '0.083', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.500', 'weapon4': '0.546', 'WEAPON3': '1.500', 'weapon3': '2.386', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '41.500'} [2024-08-06 00:29:28,623][52658] DAMAGECOUNT value on done: 112275.0 [2024-08-06 00:29:28,624][52658] Sum rewards: 65.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.215', 'weapon4': '0.332', 'WEAPON4': '0.400', 'ARMOR': '0.462', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2024-08-06 00:29:29,278][52803] DAMAGECOUNT value on done: 104856.0 [2024-08-06 00:29:29,279][52666] DAMAGECOUNT value on done: 108561.0 [2024-08-06 00:29:29,279][52803] Sum rewards: 70.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '57.000'} [2024-08-06 00:29:29,279][52666] Sum rewards: 40.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.422', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.073', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.248', 'weapon2': '0.476', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '3.110', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '37.000'} [2024-08-06 00:29:30,141][52820] DAMAGECOUNT value on done: 103067.0 [2024-08-06 00:29:30,144][52820] Sum rewards: 47.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.145', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.634', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:30,312][52664] DAMAGECOUNT value on done: 117335.0 [2024-08-06 00:29:30,312][52664] Sum rewards: 55.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.595', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon4': '0.204', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.310', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:30,659][52663] DAMAGECOUNT value on done: 113374.0 [2024-08-06 00:29:30,659][52663] Sum rewards: 51.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.158', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '41.500'} [2024-08-06 00:29:30,815][52670] DAMAGECOUNT value on done: 111731.0 [2024-08-06 00:29:30,815][52670] Sum rewards: 52.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.942', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.073', 'AMMO3': '0.172', 'weapon5': '0.196', 'AMMO4': '0.363', 'WEAPON5': '0.450', 'weapon2': '0.500', 'weapon4': '0.788', 'WEAPON4': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.222', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:31,260][52811] DAMAGECOUNT value on done: 103227.0 [2024-08-06 00:29:31,260][52811] Sum rewards: 63.360, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 00:29:31,364][52647] DAMAGECOUNT value on done: 121710.0 [2024-08-06 00:29:31,366][52647] Sum rewards: 64.981, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.162', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.408', 'HEALTH': '0.484', 'weapon4': '0.786', 'WEAPON3': '0.950', 'weapon3': '2.472', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '52.000'} [2024-08-06 00:29:31,687][52658] DAMAGECOUNT value on done: 110699.0 [2024-08-06 00:29:31,687][52658] Sum rewards: 45.246, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.178', 'weapon2': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.762', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '2.700', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '39.000'} [2024-08-06 00:29:31,833][52666] DAMAGECOUNT value on done: 110887.0 [2024-08-06 00:29:31,834][52666] Sum rewards: 64.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.875', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '3.312', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '55.000'} [2024-08-06 00:29:31,837][52650] Updated weights for policy 0, policy_version 23061 (0.0022) [2024-08-06 00:29:32,374][52803] DAMAGECOUNT value on done: 107688.0 [2024-08-06 00:29:32,374][52803] Sum rewards: 50.843, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.916', 'AMMO5': '0.005', 'AMMO2': '0.006', 'ARMOR': '0.017', 'AMMO4': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'weapon4': '0.466', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 188940288. Throughput: 0: 4397.4. Samples: 47232470. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:29:32,794][52567] Avg episode reward: [(0, '54.485')] [2024-08-06 00:29:32,947][52664] DAMAGECOUNT value on done: 116813.0 [2024-08-06 00:29:32,947][52664] Sum rewards: 67.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.610', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.196', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '56.000'} [2024-08-06 00:29:33,204][52670] DAMAGECOUNT value on done: 111864.0 [2024-08-06 00:29:33,204][52820] DAMAGECOUNT value on done: 107191.0 [2024-08-06 00:29:33,205][52670] Sum rewards: 45.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.032', 'AMMO3': '0.138', 'AMMO4': '0.159', 'weapon5': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.516', 'weapon4': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.286', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.892', 'FRAGCOUNT': '39.000'} [2024-08-06 00:29:33,205][52820] Sum rewards: 58.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.242', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '50.500'} [2024-08-06 00:29:33,562][52663] DAMAGECOUNT value on done: 112790.0 [2024-08-06 00:29:33,565][52663] Sum rewards: 44.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.380', 'weapon4': '0.528', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.748', 'DAMAGECOUNT': '11.769', 'FRAGCOUNT': '37.000'} [2024-08-06 00:29:34,299][52811] DAMAGECOUNT value on done: 104566.0 [2024-08-06 00:29:34,299][52811] Sum rewards: 60.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.058', 'AMMO4': '0.138', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '51.500'} [2024-08-06 00:29:34,369][52666] DAMAGECOUNT value on done: 113670.0 [2024-08-06 00:29:34,372][52666] Sum rewards: 38.734, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon7': '0.052', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.510', 'weapon4': '0.530', 'WEAPON3': '1.250', 'HITCOUNT': '2.400', 'weapon3': '2.504', 'DAMAGECOUNT': '10.578', 'FRAGCOUNT': '36.500'} [2024-08-06 00:29:34,389][52647] DAMAGECOUNT value on done: 114893.0 [2024-08-06 00:29:34,389][52647] Sum rewards: 50.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.996', 'AMMO5': '0.009', 'weapon5': '0.028', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.187', 'WEAPON4': '0.500', 'weapon4': '0.550', 'weapon2': '0.824', 'WEAPON3': '1.100', 'weapon3': '2.380', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:34,602][52658] DAMAGECOUNT value on done: 110489.0 [2024-08-06 00:29:34,606][52658] Sum rewards: 51.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.765', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.278', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.326', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:35,505][52803] DAMAGECOUNT value on done: 105453.0 [2024-08-06 00:29:35,508][52803] Sum rewards: 43.350, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.085', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.096', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.444', 'weapon2': '0.476', 'WEAPON3': '1.750', 'weapon3': '2.634', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:36,127][52664] DAMAGECOUNT value on done: 112762.0 [2024-08-06 00:29:36,128][52664] Sum rewards: 56.131, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.994', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'weapon4': '0.386', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:36,279][52820] DAMAGECOUNT value on done: 104558.0 [2024-08-06 00:29:36,279][52820] Sum rewards: 59.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.008', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.048', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.222', 'AMMO4': '0.238', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '51.000'} [2024-08-06 00:29:36,367][52670] DAMAGECOUNT value on done: 105890.0 [2024-08-06 00:29:36,368][52670] Sum rewards: 50.527, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.598', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.048', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.042', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:36,435][52650] Updated weights for policy 0, policy_version 23071 (0.0012) [2024-08-06 00:29:36,618][52671] DAMAGECOUNT value on done: 116383.0 [2024-08-06 00:29:36,619][52671] Sum rewards: 45.781, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.515', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon2': '0.258', 'AMMO3': '0.289', 'weapon4': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.960', 'weapon3': '3.018', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:36,693][52663] DAMAGECOUNT value on done: 107682.0 [2024-08-06 00:29:36,697][52663] Sum rewards: 49.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.456', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon5': '0.030', 'AMMO4': '0.060', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.368', 'WEAPON3': '1.650', 'HITCOUNT': '2.910', 'weapon3': '3.278', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:37,296][52811] DAMAGECOUNT value on done: 103508.0 [2024-08-06 00:29:37,297][52811] Sum rewards: 43.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.316', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.055', 'weapon5': '0.144', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'AMMO4': '0.276', 'weapon2': '0.582', 'WEAPON4': '0.600', 'weapon4': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.330', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.121', 'FRAGCOUNT': '38.000'} [2024-08-06 00:29:37,472][52647] DAMAGECOUNT value on done: 115190.0 [2024-08-06 00:29:37,474][52647] Sum rewards: 46.122, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.304', 'AMMO5': '0.012', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.220', 'weapon4': '0.228', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'weapon2': '0.592', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '2.738', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:37,680][52658] DAMAGECOUNT value on done: 115599.0 [2024-08-06 00:29:37,682][52666] DAMAGECOUNT value on done: 111588.0 [2024-08-06 00:29:37,682][52666] Sum rewards: 59.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.154', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.086', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'AMMO4': '0.265', 'weapon4': '0.582', 'weapon2': '0.604', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.430', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '48.000'} [2024-08-06 00:29:37,682][52658] Sum rewards: 54.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.726', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 189022208. Throughput: 0: 4393.1. Samples: 47258720. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:29:37,794][52567] Avg episode reward: [(0, '54.039')] [2024-08-06 00:29:38,597][52803] DAMAGECOUNT value on done: 108221.0 [2024-08-06 00:29:38,597][52803] Sum rewards: 52.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.605', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.074', 'weapon5': '0.108', 'AMMO3': '0.152', 'weapon2': '0.852', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:38,795][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:29:38,859][52664] DAMAGECOUNT value on done: 115614.0 [2024-08-06 00:29:38,860][52664] Sum rewards: 43.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.226', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '2.450', 'weapon3': '3.234', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '40.000'} [2024-08-06 00:29:39,074][52671] DAMAGECOUNT value on done: 110872.0 [2024-08-06 00:29:39,075][52671] Sum rewards: 37.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.950', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.232', 'AMMO3': '0.258', 'weapon4': '0.286', 'WEAPON4': '0.500', 'weapon2': '0.792', 'WEAPON3': '1.650', 'HITCOUNT': '2.660', 'weapon3': '2.666', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '37.000'} [2024-08-06 00:29:39,097][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:29:39,303][52665] DAMAGECOUNT value on done: 107846.0 [2024-08-06 00:29:39,305][52665] Sum rewards: 51.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.152', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.302', 'weapon4': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:39,367][52670] DAMAGECOUNT value on done: 109365.0 [2024-08-06 00:29:39,367][52670] Sum rewards: 55.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.606', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.042', 'weapon5': '0.058', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.212', 'WEAPON4': '0.450', 'weapon2': '0.472', 'weapon4': '0.818', 'WEAPON3': '0.900', 'weapon3': '2.486', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:39,407][52663] DAMAGECOUNT value on done: 115717.0 [2024-08-06 00:29:39,408][52663] Sum rewards: 53.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.719', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '0.950', 'HITCOUNT': '2.860', 'weapon3': '2.926', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:39,506][52820] DAMAGECOUNT value on done: 104755.0 [2024-08-06 00:29:39,507][52820] Sum rewards: 52.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.978', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.052', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'AMMO4': '0.258', 'weapon4': '0.404', 'weapon2': '0.494', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:39,966][52647] DAMAGECOUNT value on done: 113817.0 [2024-08-06 00:29:39,967][52647] Sum rewards: 40.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.813', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO4': '0.142', 'weapon4': '0.186', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '3.292', 'DAMAGECOUNT': '11.676', 'FRAGCOUNT': '36.000'} [2024-08-06 00:29:40,164][52666] DAMAGECOUNT value on done: 108839.0 [2024-08-06 00:29:40,164][52666] Sum rewards: 47.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.144', 'WEAPON4': '0.150', 'weapon2': '0.240', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'HITCOUNT': '2.650', 'weapon3': '3.366', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:40,467][52811] DAMAGECOUNT value on done: 105355.0 [2024-08-06 00:29:40,467][52811] Sum rewards: 51.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.026', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.149', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.090', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:40,896][52650] Updated weights for policy 0, policy_version 23081 (0.0018) [2024-08-06 00:29:40,919][52658] DAMAGECOUNT value on done: 116528.0 [2024-08-06 00:29:40,920][52658] Sum rewards: 55.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.232', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.156', 'weapon5': '0.252', 'AMMO4': '0.258', 'weapon4': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.452', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:41,725][52664] DAMAGECOUNT value on done: 116300.0 [2024-08-06 00:29:41,726][52664] Sum rewards: 50.255, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.314', 'AMMO5': '0.024', 'AMMO2': '0.075', 'AMMO3': '0.240', 'weapon5': '0.276', 'weapon2': '0.358', 'AMMO4': '0.377', 'weapon4': '0.434', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.608', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:41,816][52803] DAMAGECOUNT value on done: 105308.0 [2024-08-06 00:29:41,816][52803] Sum rewards: 45.906, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.371', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.264', 'AMMO3': '0.292', 'WEAPON3': '1.700', 'HITCOUNT': '3.100', 'weapon3': '3.300', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:41,934][52670] DAMAGECOUNT value on done: 103700.0 [2024-08-06 00:29:41,934][52670] Sum rewards: 52.831, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.780', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.392', 'WEAPON3': '1.700', 'weapon3': '3.066', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:42,105][52671] DAMAGECOUNT value on done: 115505.0 [2024-08-06 00:29:42,107][52671] Sum rewards: 55.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.237', 'weapon2': '0.416', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '3.170', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:42,271][52663] DAMAGECOUNT value on done: 112850.0 [2024-08-06 00:29:42,273][52663] Sum rewards: 49.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.736', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.022', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.215', 'weapon4': '0.358', 'WEAPON4': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:42,282][52665] DAMAGECOUNT value on done: 116919.0 [2024-08-06 00:29:42,282][52665] Sum rewards: 56.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:42,616][52647] DAMAGECOUNT value on done: 117120.0 [2024-08-06 00:29:42,616][52647] Sum rewards: 54.558, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.024', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.193', 'AMMO3': '0.277', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.600', 'weapon3': '3.022', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '48.500'} [2024-08-06 00:29:42,618][52820] DAMAGECOUNT value on done: 105908.0 [2024-08-06 00:29:42,618][52820] Sum rewards: 43.743, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.045', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.276', 'weapon2': '0.294', 'WEAPON3': '1.700', 'HITCOUNT': '2.710', 'weapon3': '3.490', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:42,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 189104128. Throughput: 0: 4394.9. Samples: 47285310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:29:42,795][52567] Avg episode reward: [(0, '52.926')] [2024-08-06 00:29:42,811][52666] DAMAGECOUNT value on done: 107473.0 [2024-08-06 00:29:42,811][52666] Sum rewards: 52.413, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.030', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.766', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:43,504][52658] DAMAGECOUNT value on done: 108046.0 [2024-08-06 00:29:43,505][52658] Sum rewards: 42.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.471', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.818', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '2.908', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '37.000'} [2024-08-06 00:29:43,592][52811] DAMAGECOUNT value on done: 108485.0 [2024-08-06 00:29:43,593][52811] Sum rewards: 48.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.350', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.078', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon2': '0.370', 'WEAPON4': '0.450', 'weapon4': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:44,246][52664] DAMAGECOUNT value on done: 114274.0 [2024-08-06 00:29:44,246][52664] Sum rewards: 60.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.623', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.020', 'weapon4': '0.020', 'AMMO4': '0.041', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.506', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.296', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:44,352][52670] DAMAGECOUNT value on done: 102344.0 [2024-08-06 00:29:44,352][52670] Sum rewards: 51.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.434', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.796', 'WEAPON3': '1.450', 'weapon3': '2.594', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:44,956][52803] DAMAGECOUNT value on done: 104718.0 [2024-08-06 00:29:44,957][52803] Sum rewards: 46.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.122', 'AMMO3': '0.184', 'weapon2': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.430', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '38.000'} [2024-08-06 00:29:45,143][52671] DAMAGECOUNT value on done: 109417.0 [2024-08-06 00:29:45,143][52671] Sum rewards: 56.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.568', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon4': '0.268', 'AMMO4': '0.275', 'WEAPON4': '0.400', 'weapon2': '0.808', 'WEAPON3': '0.950', 'weapon3': '2.364', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '48.000'} [2024-08-06 00:29:45,290][52663] DAMAGECOUNT value on done: 109962.0 [2024-08-06 00:29:45,291][52663] Sum rewards: 66.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.905', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.226', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.440', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '59.000'} [2024-08-06 00:29:45,389][52666] DAMAGECOUNT value on done: 108934.0 [2024-08-06 00:29:45,391][52666] Sum rewards: 46.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.647', 'AMMO4': '-0.008', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.196', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.352', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '39.000'} [2024-08-06 00:29:45,395][52647] DAMAGECOUNT value on done: 113948.0 [2024-08-06 00:29:45,395][52647] Sum rewards: 60.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.765', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.162', 'weapon5': '0.182', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.576', 'weapon4': '0.692', 'WEAPON3': '0.950', 'weapon3': '2.298', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '48.000'} [2024-08-06 00:29:45,489][52665] DAMAGECOUNT value on done: 111578.0 [2024-08-06 00:29:45,491][52665] Sum rewards: 55.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.848', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '47.000'} [2024-08-06 00:29:45,568][52820] DAMAGECOUNT value on done: 108118.0 [2024-08-06 00:29:45,575][52820] Sum rewards: 58.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.328', 'weapon4': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:45,634][52650] Updated weights for policy 0, policy_version 23091 (0.0014) [2024-08-06 00:29:46,046][52658] DAMAGECOUNT value on done: 111784.0 [2024-08-06 00:29:46,048][52658] Sum rewards: 41.288, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.773', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.192', 'AMMO4': '0.206', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON4': '0.500', 'weapon4': '0.538', 'WEAPON3': '1.450', 'weapon3': '2.476', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '38.500'} [2024-08-06 00:29:46,477][52811] DAMAGECOUNT value on done: 103982.0 [2024-08-06 00:29:46,478][52811] Sum rewards: 42.750, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'AMMO5': '0.012', 'ARMOR': '0.040', 'AMMO2': '0.069', 'AMMO3': '0.112', 'WEAPON5': '0.300', 'weapon5': '0.328', 'AMMO4': '0.347', 'weapon2': '0.514', 'WEAPON3': '0.750', 'WEAPON4': '0.900', 'weapon4': '1.268', 'weapon3': '1.576', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.835', 'FRAGCOUNT': '38.000'} [2024-08-06 00:29:47,139][52664] DAMAGECOUNT value on done: 114304.0 [2024-08-06 00:29:47,140][52664] Sum rewards: 45.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.535', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.316', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '40.000'} [2024-08-06 00:29:47,337][52670] DAMAGECOUNT value on done: 113320.0 [2024-08-06 00:29:47,340][52670] Sum rewards: 59.504, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.128', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.117', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'weapon4': '0.414', 'weapon2': '0.692', 'WEAPON3': '0.800', 'weapon3': '2.650', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 189194240. Throughput: 0: 4389.3. Samples: 47298280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:29:47,794][52567] Avg episode reward: [(0, '52.846')] [2024-08-06 00:29:47,990][52663] DAMAGECOUNT value on done: 113005.0 [2024-08-06 00:29:47,995][52663] Sum rewards: 51.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.440', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.083', 'weapon5': '0.124', 'weapon4': '0.194', 'AMMO3': '0.238', 'WEAPON5': '0.400', 'AMMO4': '0.416', 'weapon2': '0.544', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.866', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '48.000'} [2024-08-06 00:29:48,029][52803] DAMAGECOUNT value on done: 101122.0 [2024-08-06 00:29:48,031][52803] Sum rewards: 47.064, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'ARMOR': '0.004', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.221', 'weapon2': '0.606', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '3.004', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:48,106][52647] DAMAGECOUNT value on done: 117693.0 [2024-08-06 00:29:48,107][52647] Sum rewards: 59.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.380', 'weapon2': '0.434', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '2.890', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:48,137][52671] DAMAGECOUNT value on done: 111236.0 [2024-08-06 00:29:48,137][52671] Sum rewards: 50.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.038', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.148', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.804', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:48,352][52665] DAMAGECOUNT value on done: 107464.0 [2024-08-06 00:29:48,353][52665] Sum rewards: 54.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.762', 'AMMO5': '0.008', 'ARMOR': '0.032', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO3': '0.217', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.426', 'weapon2': '0.458', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '48.000'} [2024-08-06 00:29:48,497][52666] DAMAGECOUNT value on done: 111313.0 [2024-08-06 00:29:48,498][52666] Sum rewards: 41.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.133', 'weapon5': '0.140', 'AMMO4': '0.183', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon4': '0.710', 'weapon2': '1.042', 'weapon3': '1.860', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '10.440', 'FRAGCOUNT': '35.000'} [2024-08-06 00:29:48,728][52658] DAMAGECOUNT value on done: 115159.0 [2024-08-06 00:29:48,730][52658] Sum rewards: 48.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.708', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.676', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:48,731][52820] DAMAGECOUNT value on done: 103656.0 [2024-08-06 00:29:48,733][52820] Sum rewards: 49.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.778', 'WEAPON3': '1.100', 'weapon3': '2.562', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.376', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:49,463][52811] DAMAGECOUNT value on done: 103754.0 [2024-08-06 00:29:49,464][52811] Sum rewards: 56.561, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.656', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.576', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '3.142', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:50,217][52650] Updated weights for policy 0, policy_version 23101 (0.0018) [2024-08-06 00:29:50,765][52670] DAMAGECOUNT value on done: 112178.0 [2024-08-06 00:29:50,765][52670] Sum rewards: 46.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.382', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.175', 'weapon4': '0.476', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.684', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.928', 'FRAGCOUNT': '39.000'} [2024-08-06 00:29:50,990][52647] DAMAGECOUNT value on done: 119307.0 [2024-08-06 00:29:50,991][52647] Sum rewards: 61.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'ARMOR': '0.008', 'AMMO5': '0.011', 'weapon5': '0.018', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '50.500'} [2024-08-06 00:29:51,076][52663] DAMAGECOUNT value on done: 113237.0 [2024-08-06 00:29:51,076][52663] Sum rewards: 53.144, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.067', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.165', 'weapon5': '0.168', 'weapon4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '2.988', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:51,146][52803] DAMAGECOUNT value on done: 107693.0 [2024-08-06 00:29:51,149][52803] Sum rewards: 68.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.574', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.201', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '56.000'} [2024-08-06 00:29:51,180][52671] DAMAGECOUNT value on done: 114178.0 [2024-08-06 00:29:51,180][52671] Sum rewards: 52.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.606', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.217', 'weapon2': '0.286', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:51,261][52665] DAMAGECOUNT value on done: 109906.0 [2024-08-06 00:29:51,266][52665] Sum rewards: 46.247, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.486', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.044', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.239', 'AMMO3': '0.244', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.626', 'WEAPON3': '1.400', 'weapon3': '2.676', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:51,910][52666] DAMAGECOUNT value on done: 110690.0 [2024-08-06 00:29:51,911][52666] Sum rewards: 51.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:52,518][52811] DAMAGECOUNT value on done: 107524.0 [2024-08-06 00:29:52,518][52811] Sum rewards: 54.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.218', 'weapon4': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '3.266', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 189284352. Throughput: 0: 4388.0. Samples: 47324600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:29:52,794][52567] Avg episode reward: [(0, '52.677')] [2024-08-06 00:29:53,528][52647] DAMAGECOUNT value on done: 113751.0 [2024-08-06 00:29:53,529][52647] Sum rewards: 42.280, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.104', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.152', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON4': '0.500', 'ARMOR': '0.503', 'weapon4': '0.772', 'WEAPON3': '1.100', 'HITCOUNT': '2.330', 'weapon3': '2.486', 'DAMAGECOUNT': '10.392', 'FRAGCOUNT': '35.000'} [2024-08-06 00:29:53,646][52670] DAMAGECOUNT value on done: 111185.0 [2024-08-06 00:29:53,649][52670] Sum rewards: 63.820, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.507', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.105', 'AMMO3': '0.115', 'WEAPON5': '0.150', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.716', 'WEAPON3': '0.850', 'weapon3': '2.804', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '51.000'} [2024-08-06 00:29:54,110][52663] DAMAGECOUNT value on done: 112797.0 [2024-08-06 00:29:54,110][52663] Sum rewards: 44.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.040', 'weapon4': '0.140', 'AMMO3': '0.166', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.710', 'WEAPON3': '1.100', 'HITCOUNT': '2.280', 'weapon3': '2.950', 'DAMAGECOUNT': '10.992', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:54,134][52665] DAMAGECOUNT value on done: 110441.0 [2024-08-06 00:29:54,135][52665] Sum rewards: 49.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.350', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.195', 'weapon2': '0.420', 'WEAPON4': '0.450', 'weapon4': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.640', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '42.000'} [2024-08-06 00:29:54,280][52803] DAMAGECOUNT value on done: 109696.0 [2024-08-06 00:29:54,280][52803] Sum rewards: 58.372, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.067', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.276', 'weapon4': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.098', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '53.000'} [2024-08-06 00:29:54,288][52671] DAMAGECOUNT value on done: 114237.0 [2024-08-06 00:29:54,289][52671] Sum rewards: 63.099, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.366', 'weapon2': '0.380', 'WEAPON3': '0.950', 'weapon3': '2.996', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2024-08-06 00:29:54,663][52666] DAMAGECOUNT value on done: 108621.0 [2024-08-06 00:29:54,665][52666] Sum rewards: 47.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO4': '0.210', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.888', 'WEAPON3': '1.250', 'weapon3': '2.420', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '41.000'} [2024-08-06 00:29:55,055][52650] Updated weights for policy 0, policy_version 23111 (0.0022) [2024-08-06 00:29:55,673][52811] DAMAGECOUNT value on done: 105782.0 [2024-08-06 00:29:55,674][52811] Sum rewards: 48.660, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.106', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.032', 'weapon4': '0.060', 'weapon5': '0.064', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.370', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.222', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:56,256][52670] DAMAGECOUNT value on done: 110586.0 [2024-08-06 00:29:56,259][52670] Sum rewards: 60.099, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.972', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.130', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '53.000'} [2024-08-06 00:29:56,583][52647] DAMAGECOUNT value on done: 119042.0 [2024-08-06 00:29:56,584][52647] Sum rewards: 53.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.522', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.098', 'weapon4': '0.170', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:57,026][52671] DAMAGECOUNT value on done: 116180.0 [2024-08-06 00:29:57,026][52671] Sum rewards: 61.045, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.153', 'WEAPON4': '0.400', 'weapon4': '0.590', 'weapon2': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.376', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '49.000'} [2024-08-06 00:29:57,033][52665] DAMAGECOUNT value on done: 111447.0 [2024-08-06 00:29:57,033][52665] Sum rewards: 48.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.154', 'AMMO3': '0.203', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.452', 'weapon4': '0.508', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.634', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '43.000'} [2024-08-06 00:29:57,100][52666] DAMAGECOUNT value on done: 108595.0 [2024-08-06 00:29:57,100][52666] Sum rewards: 49.197, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.042', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.110', 'weapon5': '0.182', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.728', 'weapon3': '2.468', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '40.000'} [2024-08-06 00:29:57,231][52663] DAMAGECOUNT value on done: 111136.0 [2024-08-06 00:29:57,233][52663] Sum rewards: 52.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.135', 'AMMO3': '0.160', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.642', 'FRAGCOUNT': '44.000'} [2024-08-06 00:29:57,365][52803] DAMAGECOUNT value on done: 105234.0 [2024-08-06 00:29:57,367][52803] Sum rewards: 62.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.114', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.264', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '52.000'} [2024-08-06 00:29:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 189366272. Throughput: 0: 4395.3. Samples: 47351110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:29:57,794][52567] Avg episode reward: [(0, '52.508')] [2024-08-06 00:29:58,712][52670] DAMAGECOUNT value on done: 116013.0 [2024-08-06 00:29:58,712][52670] Sum rewards: 61.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon2': '0.598', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.236', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '52.000'} [2024-08-06 00:29:58,841][52811] DAMAGECOUNT value on done: 105934.0 [2024-08-06 00:29:58,842][52811] Sum rewards: 49.703, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.552', 'WEAPON3': '1.600', 'weapon3': '2.740', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:59,506][52671] DAMAGECOUNT value on done: 112265.0 [2024-08-06 00:29:59,508][52671] Sum rewards: 47.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.045', 'ARMOR': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.223', 'weapon4': '0.366', 'WEAPON4': '0.500', 'weapon2': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '40.000'} [2024-08-06 00:29:59,609][52666] DAMAGECOUNT value on done: 114373.0 [2024-08-06 00:29:59,609][52666] Sum rewards: 56.487, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.764', 'AMMO5': '0.005', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'weapon5': '0.162', 'weapon4': '0.164', 'AMMO4': '0.231', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.550', 'weapon3': '2.814', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '51.000'} [2024-08-06 00:29:59,709][52647] DAMAGECOUNT value on done: 113148.0 [2024-08-06 00:29:59,709][52647] Sum rewards: 57.585, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.127', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'HEALTH': '0.540', 'weapon4': '0.586', 'WEAPON3': '0.700', 'weapon2': '0.792', 'weapon3': '2.120', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '46.000'} [2024-08-06 00:29:59,713][52659] DAMAGECOUNT value on done: 112924.0 [2024-08-06 00:29:59,713][52659] Sum rewards: 49.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.294', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.298', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.172', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '45.000'} [2024-08-06 00:29:59,818][52650] Updated weights for policy 0, policy_version 23121 (0.0019) [2024-08-06 00:29:59,851][52665] DAMAGECOUNT value on done: 113291.0 [2024-08-06 00:29:59,853][52665] Sum rewards: 50.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.366', 'weapon4': '0.504', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.852', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '42.000'} [2024-08-06 00:30:00,148][52663] DAMAGECOUNT value on done: 107168.0 [2024-08-06 00:30:00,149][52663] Sum rewards: 50.517, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.009', 'AMMO5': '0.006', 'AMMO2': '0.042', 'ARMOR': '0.044', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.245', 'weapon2': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.676', 'WEAPON3': '1.450', 'weapon3': '2.564', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '46.000'} [2024-08-06 00:30:00,683][52803] DAMAGECOUNT value on done: 107192.0 [2024-08-06 00:30:00,684][52803] Sum rewards: 51.497, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.154', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.142', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'weapon4': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.558', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '46.000'} [2024-08-06 00:30:01,419][52670] DAMAGECOUNT value on done: 105722.0 [2024-08-06 00:30:01,420][52670] Sum rewards: 45.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '3.144', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '38.000'} [2024-08-06 00:30:01,901][52811] DAMAGECOUNT value on done: 105056.0 [2024-08-06 00:30:01,901][52811] Sum rewards: 58.127, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.871', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.122', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.424', 'weapon2': '0.752', 'WEAPON3': '0.950', 'weapon3': '2.568', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '45.500'} [2024-08-06 00:30:02,223][52666] DAMAGECOUNT value on done: 108213.0 [2024-08-06 00:30:02,224][52666] Sum rewards: 51.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.117', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.119', 'AMMO3': '0.138', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.688', 'WEAPON3': '0.850', 'HITCOUNT': '2.360', 'weapon3': '2.870', 'DAMAGECOUNT': '11.712', 'FRAGCOUNT': '44.000'} [2024-08-06 00:30:02,299][52647] DAMAGECOUNT value on done: 117630.0 [2024-08-06 00:30:02,299][52647] Sum rewards: 51.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.588', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '47.000'} [2024-08-06 00:30:02,524][52671] DAMAGECOUNT value on done: 113880.0 [2024-08-06 00:30:02,524][52671] Sum rewards: 46.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.218', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.768', 'WEAPON3': '1.100', 'HITCOUNT': '2.760', 'weapon3': '2.798', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '38.000'} [2024-08-06 00:30:02,714][52659] DAMAGECOUNT value on done: 111582.0 [2024-08-06 00:30:02,715][52659] Sum rewards: 64.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.048', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '55.000'} [2024-08-06 00:30:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 189456384. Throughput: 0: 4391.1. Samples: 47364200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:30:02,795][52567] Avg episode reward: [(0, '52.009')] [2024-08-06 00:30:02,829][52665] DAMAGECOUNT value on done: 117235.0 [2024-08-06 00:30:02,831][52665] Sum rewards: 59.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.264', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.390', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '52.000'} [2024-08-06 00:30:03,005][52663] DAMAGECOUNT value on done: 110839.0 [2024-08-06 00:30:03,005][52663] Sum rewards: 53.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.775', 'AMMO5': '0.007', 'AMMO2': '0.057', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.285', 'weapon4': '0.364', 'weapon2': '0.492', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '47.000'} [2024-08-06 00:30:03,915][52803] DAMAGECOUNT value on done: 104008.0 [2024-08-06 00:30:03,915][52803] Sum rewards: 38.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.138', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.260', 'weapon4': '0.528', 'WEAPON4': '0.550', 'weapon2': '0.700', 'WEAPON3': '0.850', 'HITCOUNT': '2.330', 'weapon3': '2.470', 'DAMAGECOUNT': '10.800', 'FRAGCOUNT': '33.000'} [2024-08-06 00:30:04,016][52670] DAMAGECOUNT value on done: 114849.0 [2024-08-06 00:30:04,016][52670] Sum rewards: 62.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.734', 'AMMO5': '0.006', 'ARMOR': '0.012', 'weapon5': '0.018', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.175', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.050', 'weapon3': '2.992', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '51.500'} [2024-08-06 00:30:04,237][52650] Updated weights for policy 0, policy_version 23131 (0.0028) [2024-08-06 00:30:04,894][52666] DAMAGECOUNT value on done: 110885.0 [2024-08-06 00:30:04,894][52666] Sum rewards: 49.919, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.209', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.049', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.246', 'weapon2': '0.338', 'WEAPON4': '0.400', 'weapon4': '0.644', 'WEAPON3': '1.000', 'weapon3': '2.434', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '42.000'} [2024-08-06 00:30:04,999][52811] DAMAGECOUNT value on done: 106632.0 [2024-08-06 00:30:05,000][52811] Sum rewards: 59.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon4': '0.254', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:05,177][52671] DAMAGECOUNT value on done: 112859.0 [2024-08-06 00:30:05,177][52671] Sum rewards: 51.299, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.091', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.380', 'weapon2': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.458', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '43.000'} [2024-08-06 00:30:05,432][52659] DAMAGECOUNT value on done: 112774.0 [2024-08-06 00:30:05,433][52659] Sum rewards: 59.182, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.934', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon4': '0.020', 'weapon5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.284', 'weapon2': '0.324', 'WEAPON3': '1.600', 'HITCOUNT': '2.890', 'weapon3': '3.368', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '54.000'} [2024-08-06 00:30:05,766][52665] DAMAGECOUNT value on done: 112974.0 [2024-08-06 00:30:05,766][52665] Sum rewards: 38.307, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.944', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.924', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.496', 'DAMAGECOUNT': '10.461', 'FRAGCOUNT': '32.000'} [2024-08-06 00:30:06,204][52811] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:30:06,208][52663] DAMAGECOUNT value on done: 114832.0 [2024-08-06 00:30:06,209][52663] Sum rewards: 56.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon2': '0.438', 'weapon4': '0.542', 'WEAPON3': '0.950', 'weapon3': '2.644', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.404', 'FRAGCOUNT': '47.000'} [2024-08-06 00:30:06,764][52670] DAMAGECOUNT value on done: 111910.0 [2024-08-06 00:30:06,765][52670] Sum rewards: 50.144, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.037', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon4': '0.100', 'AMMO3': '0.105', 'AMMO4': '0.185', 'weapon5': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.666', 'WEAPON3': '0.700', 'HITCOUNT': '2.650', 'weapon3': '2.810', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '41.000'} [2024-08-06 00:30:07,082][52803] DAMAGECOUNT value on done: 102469.0 [2024-08-06 00:30:07,083][52803] Sum rewards: 58.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.750', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'weapon4': '0.230', 'AMMO3': '0.255', 'weapon2': '0.474', 'WEAPON3': '1.600', 'weapon3': '3.140', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:07,470][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:30:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 189546496. Throughput: 0: 4389.3. Samples: 47390530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:30:07,794][52567] Avg episode reward: [(0, '52.111')] [2024-08-06 00:30:08,055][52811] DAMAGECOUNT value on done: 106816.0 [2024-08-06 00:30:08,059][52811] Sum rewards: 66.376, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.315', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.164', 'WEAPON4': '0.350', 'weapon4': '0.456', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '55.000'} [2024-08-06 00:30:08,553][52671] DAMAGECOUNT value on done: 112148.0 [2024-08-06 00:30:08,553][52671] Sum rewards: 40.202, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon2': '0.526', 'weapon4': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.406', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '10.920', 'FRAGCOUNT': '33.000'} [2024-08-06 00:30:08,683][52659] DAMAGECOUNT value on done: 112435.0 [2024-08-06 00:30:08,685][52659] Sum rewards: 57.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.014', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.220', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '48.000'} [2024-08-06 00:30:08,785][52665] DAMAGECOUNT value on done: 113166.0 [2024-08-06 00:30:08,786][52665] Sum rewards: 50.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.823', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.183', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '3.128', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '41.000'} [2024-08-06 00:30:08,911][52650] Updated weights for policy 0, policy_version 23141 (0.0020) [2024-08-06 00:30:09,326][52663] DAMAGECOUNT value on done: 113783.0 [2024-08-06 00:30:09,327][52663] Sum rewards: 64.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'ARMOR': '0.016', 'weapon5': '0.016', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.194', 'WEAPON4': '0.450', 'weapon2': '0.602', 'weapon4': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.562', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '52.000'} [2024-08-06 00:30:09,572][52670] DAMAGECOUNT value on done: 109619.0 [2024-08-06 00:30:09,572][52670] Sum rewards: 49.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.107', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.346', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '41.000'} [2024-08-06 00:30:10,163][52803] DAMAGECOUNT value on done: 106499.0 [2024-08-06 00:30:10,163][52803] Sum rewards: 66.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.195', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.486', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '54.000'} [2024-08-06 00:30:11,182][52811] DAMAGECOUNT value on done: 107919.0 [2024-08-06 00:30:11,182][52811] Sum rewards: 54.519, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.022', 'HEALTH': '0.076', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.318', 'weapon2': '0.774', 'WEAPON3': '0.900', 'weapon3': '2.550', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '45.000'} [2024-08-06 00:30:11,429][52671] DAMAGECOUNT value on done: 117441.0 [2024-08-06 00:30:11,430][52671] Sum rewards: 61.797, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'AMMO5': '0.006', 'ARMOR': '0.048', 'AMMO2': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.248', 'weapon2': '0.510', 'WEAPON4': '0.650', 'weapon4': '0.754', 'WEAPON3': '1.250', 'weapon3': '2.416', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '55.000'} [2024-08-06 00:30:11,643][52659] DAMAGECOUNT value on done: 112445.0 [2024-08-06 00:30:11,644][52659] Sum rewards: 55.701, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon4': '0.062', 'weapon5': '0.062', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.678', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '48.000'} [2024-08-06 00:30:11,871][52665] DAMAGECOUNT value on done: 111809.0 [2024-08-06 00:30:11,872][52665] Sum rewards: 63.555, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.230', 'ARMOR': '0.008', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.150', 'weapon4': '0.276', 'weapon2': '0.320', 'WEAPON3': '0.900', 'HITCOUNT': '3.030', 'weapon3': '3.242', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:12,031][52663] DAMAGECOUNT value on done: 115091.0 [2024-08-06 00:30:12,031][52663] Sum rewards: 50.936, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.880', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '3.470', 'DAMAGECOUNT': '12.039', 'FRAGCOUNT': '44.000'} [2024-08-06 00:30:12,342][52670] DAMAGECOUNT value on done: 108544.0 [2024-08-06 00:30:12,342][52670] Sum rewards: 56.437, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.844', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.432', 'weapon4': '0.502', 'WEAPON3': '1.500', 'weapon3': '2.758', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 189636608. Throughput: 0: 4390.9. Samples: 47416970. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:30:12,802][52567] Avg episode reward: [(0, '53.015')] [2024-08-06 00:30:13,222][52803] DAMAGECOUNT value on done: 106813.0 [2024-08-06 00:30:13,222][52803] Sum rewards: 60.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.158', 'AMMO3': '0.179', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '1.000', 'weapon3': '2.446', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '50.000'} [2024-08-06 00:30:13,552][52650] Updated weights for policy 0, policy_version 23151 (0.0013) [2024-08-06 00:30:14,207][52671] DAMAGECOUNT value on done: 112537.0 [2024-08-06 00:30:14,207][52671] Sum rewards: 49.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO2': '0.001', 'AMMO4': '0.007', 'ARMOR': '0.012', 'AMMO3': '0.249', 'weapon2': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '3.524', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '45.000'} [2024-08-06 00:30:14,294][52811] DAMAGECOUNT value on done: 108496.0 [2024-08-06 00:30:14,295][52811] Sum rewards: 61.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.345', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.118', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.269', 'weapon2': '0.356', 'weapon4': '0.618', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:14,346][52659] DAMAGECOUNT value on done: 112876.0 [2024-08-06 00:30:14,348][52659] Sum rewards: 44.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.658', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.762', 'DAMAGECOUNT': '10.860', 'FRAGCOUNT': '38.000'} [2024-08-06 00:30:14,584][52665] DAMAGECOUNT value on done: 112286.0 [2024-08-06 00:30:14,587][52665] Sum rewards: 57.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.217', 'weapon4': '0.366', 'weapon2': '0.380', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '50.000'} [2024-08-06 00:30:15,210][52663] DAMAGECOUNT value on done: 113507.0 [2024-08-06 00:30:15,212][52663] Sum rewards: 56.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'weapon4': '0.550', 'weapon2': '0.678', 'WEAPON3': '0.950', 'weapon3': '2.396', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2024-08-06 00:30:16,416][52803] DAMAGECOUNT value on done: 107743.0 [2024-08-06 00:30:16,417][52803] Sum rewards: 52.053, reward structure: {'DEATHCOUNT': '-9.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.105', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.342', 'WEAPON3': '0.600', 'weapon2': '0.662', 'weapon4': '0.724', 'HEALTH': '1.083', 'weapon3': '2.034', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '39.500'} [2024-08-06 00:30:17,143][52665] DAMAGECOUNT value on done: 112295.0 [2024-08-06 00:30:17,144][52665] Sum rewards: 51.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.631', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.016', 'weapon5': '0.018', 'AMMO4': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.248', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '44.000'} [2024-08-06 00:30:17,209][52671] DAMAGECOUNT value on done: 110231.0 [2024-08-06 00:30:17,209][52671] Sum rewards: 53.196, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.929', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.058', 'weapon4': '0.074', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.860', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '44.000'} [2024-08-06 00:30:17,335][52811] DAMAGECOUNT value on done: 105073.0 [2024-08-06 00:30:17,337][52811] Sum rewards: 42.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.134', 'weapon5': '0.184', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.636', 'WEAPON3': '0.800', 'HITCOUNT': '2.220', 'weapon3': '2.436', 'DAMAGECOUNT': '10.170', 'FRAGCOUNT': '37.000'} [2024-08-06 00:30:17,422][52659] DAMAGECOUNT value on done: 115088.0 [2024-08-06 00:30:17,423][52659] Sum rewards: 58.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.258', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.650', 'weapon3': '2.956', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 189726720. Throughput: 0: 4394.0. Samples: 47430200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:30:17,794][52567] Avg episode reward: [(0, '53.307')] [2024-08-06 00:30:17,959][52663] DAMAGECOUNT value on done: 115677.0 [2024-08-06 00:30:17,959][52663] Sum rewards: 55.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.652', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '49.000'} [2024-08-06 00:30:18,437][52650] Updated weights for policy 0, policy_version 23161 (0.0013) [2024-08-06 00:30:19,523][52803] DAMAGECOUNT value on done: 102614.0 [2024-08-06 00:30:19,523][52803] Sum rewards: 62.520, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.024', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.277', 'weapon2': '0.312', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.362', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '56.000'} [2024-08-06 00:30:19,760][52665] DAMAGECOUNT value on done: 111651.0 [2024-08-06 00:30:19,761][52665] Sum rewards: 48.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.055', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.198', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.258', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '43.000'} [2024-08-06 00:30:19,884][52671] DAMAGECOUNT value on done: 116016.0 [2024-08-06 00:30:19,884][52671] Sum rewards: 50.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.385', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.210', 'AMMO3': '0.221', 'AMMO4': '0.260', 'WEAPON5': '0.400', 'weapon4': '0.478', 'ARMOR': '0.487', 'weapon2': '0.698', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.292', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '47.000'} [2024-08-06 00:30:20,091][52659] DAMAGECOUNT value on done: 109324.0 [2024-08-06 00:30:20,092][52659] Sum rewards: 50.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO3': '0.119', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.800', 'weapon2': '0.910', 'weapon3': '2.574', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '42.000'} [2024-08-06 00:30:20,370][52811] DAMAGECOUNT value on done: 108930.0 [2024-08-06 00:30:20,371][52811] Sum rewards: 57.498, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.303', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.054', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.272', 'weapon4': '0.378', 'WEAPON4': '0.600', 'weapon2': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.546', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:21,077][52663] DAMAGECOUNT value on done: 112236.0 [2024-08-06 00:30:21,078][52663] Sum rewards: 39.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.188', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.094', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon4': '0.246', 'WEAPON4': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.860', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '35.500'} [2024-08-06 00:30:22,108][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:30:22,623][52671] DAMAGECOUNT value on done: 112404.0 [2024-08-06 00:30:22,623][52671] Sum rewards: 55.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.073', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.164', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '2.810', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '48.000'} [2024-08-06 00:30:22,719][52650] Updated weights for policy 0, policy_version 23171 (0.0023) [2024-08-06 00:30:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 189816832. Throughput: 0: 4399.8. Samples: 47456710. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:30:22,802][52567] Avg episode reward: [(0, '53.480')] [2024-08-06 00:30:22,832][52665] DAMAGECOUNT value on done: 109032.0 [2024-08-06 00:30:22,833][52665] Sum rewards: 46.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.246', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.092', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.590', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '2.794', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '40.000'} [2024-08-06 00:30:22,910][52659] DAMAGECOUNT value on done: 112562.0 [2024-08-06 00:30:22,912][52659] Sum rewards: 58.712, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.211', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'weapon4': '0.214', 'AMMO4': '0.217', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.124', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '52.000'} [2024-08-06 00:30:23,450][52811] DAMAGECOUNT value on done: 105649.0 [2024-08-06 00:30:23,452][52811] Sum rewards: 55.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.875', 'AMMO2': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.078', 'weapon5': '0.112', 'AMMO3': '0.163', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '48.000'} [2024-08-06 00:30:25,491][52671] DAMAGECOUNT value on done: 113990.0 [2024-08-06 00:30:25,492][52671] Sum rewards: 67.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon4': '0.188', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '57.000'} [2024-08-06 00:30:25,682][52665] DAMAGECOUNT value on done: 111252.0 [2024-08-06 00:30:25,682][52665] Sum rewards: 53.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.173', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.396', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.758', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '43.000'} [2024-08-06 00:30:25,854][52659] DAMAGECOUNT value on done: 114972.0 [2024-08-06 00:30:25,856][52659] Sum rewards: 48.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.165', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.137', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.490', 'WEAPON3': '0.850', 'weapon3': '2.614', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.462', 'FRAGCOUNT': '41.000'} [2024-08-06 00:30:26,610][52811] DAMAGECOUNT value on done: 106637.0 [2024-08-06 00:30:26,612][52811] Sum rewards: 61.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.010', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.536', 'WEAPON3': '0.950', 'weapon3': '2.912', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '49.000'} [2024-08-06 00:30:27,654][52650] Updated weights for policy 0, policy_version 23181 (0.0028) [2024-08-06 00:30:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 189898752. Throughput: 0: 4396.0. Samples: 47483130. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:30:27,794][52567] Avg episode reward: [(0, '53.675')] [2024-08-06 00:30:27,855][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023182_189906944.pth... [2024-08-06 00:30:27,979][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022667_185688064.pth [2024-08-06 00:30:28,209][52671] DAMAGECOUNT value on done: 114022.0 [2024-08-06 00:30:28,209][52671] Sum rewards: 63.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.198', 'AMMO3': '0.208', 'weapon2': '0.428', 'WEAPON4': '0.550', 'weapon4': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.592', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '54.000'} [2024-08-06 00:30:28,722][52659] DAMAGECOUNT value on done: 112018.0 [2024-08-06 00:30:28,723][52659] Sum rewards: 51.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.162', 'AMMO5': '0.007', 'ARMOR': '0.013', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO4': '0.089', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.644', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '44.000'} [2024-08-06 00:30:29,045][52665] DAMAGECOUNT value on done: 106262.0 [2024-08-06 00:30:29,045][52665] Sum rewards: 61.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.415', 'AMMO2': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO4': '0.159', 'AMMO3': '0.213', 'weapon2': '0.462', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.284', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '54.000'} [2024-08-06 00:30:31,017][52671] DAMAGECOUNT value on done: 112468.0 [2024-08-06 00:30:31,018][52671] Sum rewards: 49.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.935', 'AMMO5': '0.012', 'AMMO2': '0.035', 'ARMOR': '0.040', 'weapon5': '0.078', 'AMMO4': '0.175', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '45.000'} [2024-08-06 00:30:31,430][52659] DAMAGECOUNT value on done: 108195.0 [2024-08-06 00:30:31,432][52659] Sum rewards: 47.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.079', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.118', 'AMMO3': '0.170', 'weapon4': '0.194', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '2.826', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '41.000'} [2024-08-06 00:30:32,331][52665] DAMAGECOUNT value on done: 108996.0 [2024-08-06 00:30:32,333][52665] Sum rewards: 44.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.239', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.158', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.684', 'WEAPON3': '1.200', 'HITCOUNT': '2.540', 'weapon3': '2.602', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '40.000'} [2024-08-06 00:30:32,429][52650] Updated weights for policy 0, policy_version 23191 (0.0020) [2024-08-06 00:30:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 189988864. Throughput: 0: 4394.9. Samples: 47496050. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:30:32,794][52567] Avg episode reward: [(0, '53.726')] [2024-08-06 00:30:34,644][52659] DAMAGECOUNT value on done: 109147.0 [2024-08-06 00:30:34,646][52659] Sum rewards: 57.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.218', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.044', 'AMMO3': '0.133', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.564', 'weapon4': '0.572', 'WEAPON3': '0.950', 'weapon3': '2.558', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '48.000'} [2024-08-06 00:30:35,451][52665] DAMAGECOUNT value on done: 110435.0 [2024-08-06 00:30:35,452][52665] Sum rewards: 58.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.221', 'weapon4': '0.278', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '51.000'} [2024-08-06 00:30:37,088][52650] Updated weights for policy 0, policy_version 23201 (0.0013) [2024-08-06 00:30:37,340][52659] DAMAGECOUNT value on done: 115174.0 [2024-08-06 00:30:37,343][52659] Sum rewards: 61.366, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.707', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.460', 'weapon4': '0.538', 'WEAPON3': '1.050', 'weapon3': '2.722', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '49.000'} [2024-08-06 00:30:37,661][52614] Signal inference workers to stop experience collection... (4300 times) [2024-08-06 00:30:37,667][52614] Signal inference workers to resume experience collection... (4300 times) [2024-08-06 00:30:37,746][52650] InferenceWorker_p0-w0: stopping experience collection (4300 times) [2024-08-06 00:30:37,746][52650] InferenceWorker_p0-w0: resuming experience collection (4300 times) [2024-08-06 00:30:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 190078976. Throughput: 0: 4400.9. Samples: 47522640. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:30:37,794][52567] Avg episode reward: [(0, '54.059')] [2024-08-06 00:30:40,721][52659] DAMAGECOUNT value on done: 113809.0 [2024-08-06 00:30:40,722][52659] Sum rewards: 60.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.369', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.102', 'weapon2': '0.230', 'weapon4': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.600', 'weapon3': '3.240', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '52.000'} [2024-08-06 00:30:41,499][52650] Updated weights for policy 0, policy_version 23211 (0.0025) [2024-08-06 00:30:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 190160896. Throughput: 0: 4386.5. Samples: 47548500. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:30:42,795][52567] Avg episode reward: [(0, '54.163')] [2024-08-06 00:30:43,841][52659] DAMAGECOUNT value on done: 119010.0 [2024-08-06 00:30:43,841][52659] Sum rewards: 49.571, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.824', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.059', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.294', 'AMMO3': '0.334', 'weapon2': '0.354', 'weapon4': '0.534', 'WEAPON4': '0.550', 'WEAPON3': '2.000', 'weapon3': '2.748', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '48.500'} [2024-08-06 00:30:46,306][52650] Updated weights for policy 0, policy_version 23221 (0.0019) [2024-08-06 00:30:46,933][52659] DAMAGECOUNT value on done: 115288.0 [2024-08-06 00:30:46,934][52659] Sum rewards: 55.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.463', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.402', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '47.000'} [2024-08-06 00:30:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 190251008. Throughput: 0: 4393.3. Samples: 47561900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:30:47,794][52567] Avg episode reward: [(0, '54.180')] [2024-08-06 00:30:50,096][52659] DAMAGECOUNT value on done: 113427.0 [2024-08-06 00:30:50,100][52659] Sum rewards: 54.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.192', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '47.000'} [2024-08-06 00:30:51,066][52650] Updated weights for policy 0, policy_version 23231 (0.0022) [2024-08-06 00:30:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 190341120. Throughput: 0: 4383.8. Samples: 47587800. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:30:52,795][52567] Avg episode reward: [(0, '54.117')] [2024-08-06 00:30:52,981][52659] DAMAGECOUNT value on done: 117514.0 [2024-08-06 00:30:52,983][52659] Sum rewards: 58.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.184', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '50.000'} [2024-08-06 00:30:55,786][52650] Updated weights for policy 0, policy_version 23241 (0.0026) [2024-08-06 00:30:56,147][52659] DAMAGECOUNT value on done: 116294.0 [2024-08-06 00:30:56,147][52659] Sum rewards: 53.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.199', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.246', 'AMMO4': '0.246', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.442', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.652', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '46.500'} [2024-08-06 00:30:57,361][52662] DAMAGECOUNT value on done: 119247.0 [2024-08-06 00:30:57,372][52662] Sum rewards: 61.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.947', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.135', 'weapon5': '0.152', 'AMMO4': '0.185', 'WEAPON5': '0.350', 'weapon4': '0.358', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon3': '2.886', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '50.000'} [2024-08-06 00:30:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 190423040. Throughput: 0: 4370.7. Samples: 47613650. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:30:57,795][52567] Avg episode reward: [(0, '54.123')] [2024-08-06 00:30:58,584][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:30:58,895][52665] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:30:58,997][52795] DAMAGECOUNT value on done: 104245.0 [2024-08-06 00:30:58,997][52795] Sum rewards: 57.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.722', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.058', 'weapon4': '0.080', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.568', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.066', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:00,190][52662] DAMAGECOUNT value on done: 121455.0 [2024-08-06 00:31:00,191][52662] Sum rewards: 42.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.049', 'weapon5': '0.086', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'weapon2': '0.390', 'WEAPON4': '0.500', 'weapon4': '0.510', 'WEAPON3': '0.900', 'HITCOUNT': '2.640', 'weapon3': '2.830', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '37.500'} [2024-08-06 00:31:00,481][52650] Updated weights for policy 0, policy_version 23251 (0.0032) [2024-08-06 00:31:01,459][52668] DAMAGECOUNT value on done: 113546.0 [2024-08-06 00:31:01,459][52668] Sum rewards: 56.556, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.006', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.368', 'weapon2': '0.416', 'WEAPON3': '1.650', 'weapon3': '2.792', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '53.000'} [2024-08-06 00:31:02,135][52795] DAMAGECOUNT value on done: 101747.0 [2024-08-06 00:31:02,138][52795] Sum rewards: 59.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.362', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.364', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '52.000'} [2024-08-06 00:31:02,608][52662] DAMAGECOUNT value on done: 123088.0 [2024-08-06 00:31:02,609][52662] Sum rewards: 39.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.654', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.090', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'AMMO4': '0.274', 'weapon4': '0.446', 'WEAPON4': '0.450', 'weapon2': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.220', 'weapon3': '2.560', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '36.000'} [2024-08-06 00:31:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 190513152. Throughput: 0: 4377.8. Samples: 47627200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:31:02,794][52567] Avg episode reward: [(0, '54.094')] [2024-08-06 00:31:03,930][52649] Large shaping reward 3.351 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.3, 100.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:31:04,305][52668] DAMAGECOUNT value on done: 119478.0 [2024-08-06 00:31:04,305][52668] Sum rewards: 58.361, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.170', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.172', 'weapon2': '0.238', 'AMMO3': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.410', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:05,062][52650] Updated weights for policy 0, policy_version 23261 (0.0020) [2024-08-06 00:31:05,157][52795] DAMAGECOUNT value on done: 102793.0 [2024-08-06 00:31:05,158][52795] Sum rewards: 51.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.472', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.548', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:05,544][52662] DAMAGECOUNT value on done: 113298.0 [2024-08-06 00:31:05,545][52662] Sum rewards: 39.016, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.670', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.061', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'AMMO4': '0.307', 'weapon4': '0.400', 'WEAPON4': '0.650', 'weapon2': '0.908', 'WEAPON3': '1.350', 'weapon3': '2.360', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '37.000'} [2024-08-06 00:31:07,248][52668] DAMAGECOUNT value on done: 114377.0 [2024-08-06 00:31:07,250][52668] Sum rewards: 67.335, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.175', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.116', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'weapon2': '0.728', 'WEAPON3': '0.900', 'weapon3': '2.764', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '53.000'} [2024-08-06 00:31:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 190595072. Throughput: 0: 4373.3. Samples: 47653510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:31:07,794][52567] Avg episode reward: [(0, '54.099')] [2024-08-06 00:31:08,341][52662] DAMAGECOUNT value on done: 119505.0 [2024-08-06 00:31:08,342][52662] Sum rewards: 62.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.132', 'AMMO5': '0.007', 'ARMOR': '0.025', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.422', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '52.000'} [2024-08-06 00:31:08,357][52795] DAMAGECOUNT value on done: 104377.0 [2024-08-06 00:31:08,358][52795] Sum rewards: 50.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.428', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.190', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.136', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '45.000'} [2024-08-06 00:31:08,883][52794] DAMAGECOUNT value on done: 122155.0 [2024-08-06 00:31:08,886][52794] Sum rewards: 57.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.052', 'weapon4': '0.134', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'HITCOUNT': '3.360', 'weapon3': '3.400', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:09,576][52650] Updated weights for policy 0, policy_version 23271 (0.0014) [2024-08-06 00:31:09,838][52668] DAMAGECOUNT value on done: 114751.0 [2024-08-06 00:31:09,840][52668] Sum rewards: 43.456, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.326', 'weapon2': '0.564', 'WEAPON3': '1.450', 'weapon3': '2.776', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '39.000'} [2024-08-06 00:31:11,140][52662] DAMAGECOUNT value on done: 120915.0 [2024-08-06 00:31:11,141][52662] Sum rewards: 55.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.507', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.047', 'weapon5': '0.094', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'weapon2': '0.340', 'weapon4': '0.366', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.982', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '48.000'} [2024-08-06 00:31:11,540][52795] DAMAGECOUNT value on done: 107503.0 [2024-08-06 00:31:11,540][52795] Sum rewards: 54.826, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.307', 'weapon2': '0.348', 'WEAPON3': '1.700', 'HITCOUNT': '3.070', 'weapon3': '3.244', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:11,786][52794] DAMAGECOUNT value on done: 120061.0 [2024-08-06 00:31:11,786][52794] Sum rewards: 53.483, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.104', 'weapon4': '0.136', 'AMMO4': '0.176', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.808', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 190693376. Throughput: 0: 4371.3. Samples: 47679840. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:31:12,794][52567] Avg episode reward: [(0, '54.203')] [2024-08-06 00:31:12,976][52668] DAMAGECOUNT value on done: 114771.0 [2024-08-06 00:31:12,977][52668] Sum rewards: 43.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.621', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon4': '0.170', 'weapon5': '0.204', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '2.948', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '38.000'} [2024-08-06 00:31:13,887][52662] DAMAGECOUNT value on done: 119108.0 [2024-08-06 00:31:13,887][52662] Sum rewards: 44.499, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.039', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.228', 'weapon4': '0.374', 'weapon2': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.718', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '41.000'} [2024-08-06 00:31:14,184][52660] DAMAGECOUNT value on done: 112072.0 [2024-08-06 00:31:14,186][52660] Sum rewards: 61.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.568', 'AMMO5': '0.006', 'AMMO2': '0.047', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.235', 'weapon4': '0.238', 'WEAPON4': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '52.500'} [2024-08-06 00:31:14,519][52650] Updated weights for policy 0, policy_version 23281 (0.0025) [2024-08-06 00:31:14,535][52794] DAMAGECOUNT value on done: 115340.0 [2024-08-06 00:31:14,536][52794] Sum rewards: 43.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.867', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.370', 'ARMOR': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.130', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '40.000'} [2024-08-06 00:31:14,653][52795] DAMAGECOUNT value on done: 106538.0 [2024-08-06 00:31:14,655][52795] Sum rewards: 47.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.035', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO4': '0.164', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.408', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '41.000'} [2024-08-06 00:31:16,106][52668] DAMAGECOUNT value on done: 112008.0 [2024-08-06 00:31:16,107][52668] Sum rewards: 46.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.203', 'weapon2': '0.352', 'WEAPON4': '0.500', 'weapon4': '0.668', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '40.000'} [2024-08-06 00:31:16,352][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:31:16,742][52662] DAMAGECOUNT value on done: 125106.0 [2024-08-06 00:31:16,743][52662] Sum rewards: 56.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.522', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.158', 'AMMO3': '0.174', 'AMMO4': '0.248', 'weapon4': '0.248', 'WEAPON5': '0.450', 'weapon2': '0.542', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:16,995][52660] DAMAGECOUNT value on done: 116289.0 [2024-08-06 00:31:16,995][52660] Sum rewards: 67.221, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.515', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.224', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '3.300', 'weapon3': '3.480', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '58.000'} [2024-08-06 00:31:17,268][52794] DAMAGECOUNT value on done: 113181.0 [2024-08-06 00:31:17,270][52794] Sum rewards: 59.194, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.096', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'weapon4': '0.336', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:17,779][52795] DAMAGECOUNT value on done: 109701.0 [2024-08-06 00:31:17,782][52795] Sum rewards: 57.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.059', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.478', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '48.000'} [2024-08-06 00:31:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 190775296. Throughput: 0: 4375.8. Samples: 47692960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:31:17,794][52567] Avg episode reward: [(0, '54.030')] [2024-08-06 00:31:18,798][52650] Updated weights for policy 0, policy_version 23291 (0.0013) [2024-08-06 00:31:18,986][52668] DAMAGECOUNT value on done: 115842.0 [2024-08-06 00:31:18,989][52668] Sum rewards: 56.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.135', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:19,427][52662] DAMAGECOUNT value on done: 118881.0 [2024-08-06 00:31:19,429][52662] Sum rewards: 53.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.017', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon4': '0.720', 'weapon2': '0.976', 'WEAPON3': '1.000', 'weapon3': '2.108', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:19,769][52794] DAMAGECOUNT value on done: 117725.0 [2024-08-06 00:31:19,771][52794] Sum rewards: 43.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon4': '0.314', 'weapon2': '0.670', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.746', 'DAMAGECOUNT': '11.025', 'FRAGCOUNT': '39.000'} [2024-08-06 00:31:20,085][52660] DAMAGECOUNT value on done: 115412.0 [2024-08-06 00:31:20,086][52660] Sum rewards: 53.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.318', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:21,037][52795] DAMAGECOUNT value on done: 107485.0 [2024-08-06 00:31:21,037][52795] Sum rewards: 59.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.003', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.018', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:21,834][52668] DAMAGECOUNT value on done: 118342.0 [2024-08-06 00:31:21,834][52668] Sum rewards: 52.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.104', 'weapon4': '0.110', 'AMMO4': '0.125', 'AMMO3': '0.215', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '3.294', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '45.000'} [2024-08-06 00:31:21,998][52662] DAMAGECOUNT value on done: 121954.0 [2024-08-06 00:31:21,998][52662] Sum rewards: 61.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '54.000'} [2024-08-06 00:31:22,452][52794] DAMAGECOUNT value on done: 119200.0 [2024-08-06 00:31:22,453][52794] Sum rewards: 45.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.652', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.171', 'weapon5': '0.180', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.500', 'weapon4': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.604', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '39.000'} [2024-08-06 00:31:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 190857216. Throughput: 0: 4373.1. Samples: 47719430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:31:22,795][52567] Avg episode reward: [(0, '54.077')] [2024-08-06 00:31:22,909][52660] DAMAGECOUNT value on done: 116228.0 [2024-08-06 00:31:22,911][52660] Sum rewards: 55.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.184', 'weapon2': '0.404', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.314', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:23,720][52650] Updated weights for policy 0, policy_version 23301 (0.0016) [2024-08-06 00:31:24,189][52795] DAMAGECOUNT value on done: 104307.0 [2024-08-06 00:31:24,191][52795] Sum rewards: 54.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.782', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.600', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '45.500'} [2024-08-06 00:31:24,338][52662] DAMAGECOUNT value on done: 117952.0 [2024-08-06 00:31:24,339][52662] Sum rewards: 44.559, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.815', 'AMMO5': '0.007', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.167', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.876', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '38.000'} [2024-08-06 00:31:24,687][52668] DAMAGECOUNT value on done: 115437.0 [2024-08-06 00:31:24,690][52668] Sum rewards: 47.231, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.668', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO3': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '0.650', 'weapon4': '0.684', 'HITCOUNT': '2.780', 'weapon3': '2.802', 'DAMAGECOUNT': '11.532', 'FRAGCOUNT': '38.000'} [2024-08-06 00:31:24,994][52794] DAMAGECOUNT value on done: 123079.0 [2024-08-06 00:31:24,994][52794] Sum rewards: 52.957, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.620', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.274', 'AMMO3': '0.279', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.010', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:25,917][52660] DAMAGECOUNT value on done: 112778.0 [2024-08-06 00:31:25,918][52660] Sum rewards: 62.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.094', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '52.000'} [2024-08-06 00:31:26,866][52667] DAMAGECOUNT value on done: 116233.0 [2024-08-06 00:31:26,867][52667] Sum rewards: 55.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.280', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '48.000'} [2024-08-06 00:31:27,226][52662] DAMAGECOUNT value on done: 120944.0 [2024-08-06 00:31:27,226][52662] Sum rewards: 48.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.195', 'weapon4': '0.288', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.028', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '42.000'} [2024-08-06 00:31:27,291][52795] DAMAGECOUNT value on done: 107670.0 [2024-08-06 00:31:27,291][52795] Sum rewards: 47.316, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.122', 'AMMO4': '0.222', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.650', 'weapon3': '2.980', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '44.500'} [2024-08-06 00:31:27,515][52668] DAMAGECOUNT value on done: 117100.0 [2024-08-06 00:31:27,516][52668] Sum rewards: 53.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.525', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.180', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '45.000'} [2024-08-06 00:31:27,725][52794] DAMAGECOUNT value on done: 118817.0 [2024-08-06 00:31:27,725][52794] Sum rewards: 55.284, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.823', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.135', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.548', 'WEAPON3': '0.850', 'weapon3': '2.616', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '44.500'} [2024-08-06 00:31:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 190955520. Throughput: 0: 4389.3. Samples: 47746020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:31:27,795][52567] Avg episode reward: [(0, '54.051')] [2024-08-06 00:31:28,121][52650] Updated weights for policy 0, policy_version 23311 (0.0013) [2024-08-06 00:31:28,689][52660] DAMAGECOUNT value on done: 112323.0 [2024-08-06 00:31:28,689][52660] Sum rewards: 49.189, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.153', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.240', 'HEALTH': '0.803', 'weapon2': '0.814', 'WEAPON3': '0.850', 'weapon3': '2.522', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '38.500'} [2024-08-06 00:31:29,272][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:31:29,727][52667] DAMAGECOUNT value on done: 117438.0 [2024-08-06 00:31:29,727][52667] Sum rewards: 43.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'AMMO3': '0.163', 'weapon4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '3.162', 'DAMAGECOUNT': '12.156', 'FRAGCOUNT': '37.500'} [2024-08-06 00:31:30,342][52668] DAMAGECOUNT value on done: 113673.0 [2024-08-06 00:31:30,344][52668] Sum rewards: 50.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.170', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.134', 'weapon4': '0.186', 'AMMO3': '0.194', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '3.090', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:30,428][52795] DAMAGECOUNT value on done: 106808.0 [2024-08-06 00:31:30,428][52795] Sum rewards: 48.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'weapon4': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.258', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '42.000'} [2024-08-06 00:31:30,476][52662] DAMAGECOUNT value on done: 118045.0 [2024-08-06 00:31:30,476][52662] Sum rewards: 56.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.995', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.247', 'weapon2': '0.456', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.226', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:30,983][52794] DAMAGECOUNT value on done: 119092.0 [2024-08-06 00:31:30,983][52794] Sum rewards: 61.795, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.914', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.016', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.340', 'weapon2': '0.910', 'WEAPON3': '0.950', 'weapon3': '2.560', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:31,691][52660] DAMAGECOUNT value on done: 116315.0 [2024-08-06 00:31:31,694][52660] Sum rewards: 53.688, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.915', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.040', 'weapon5': '0.178', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.252', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 191037440. Throughput: 0: 4383.3. Samples: 47759150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:31:32,794][52567] Avg episode reward: [(0, '53.757')] [2024-08-06 00:31:32,792][52667] DAMAGECOUNT value on done: 116878.0 [2024-08-06 00:31:32,795][52667] Sum rewards: 61.399, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.015', 'HEALTH': '0.051', 'AMMO4': '0.076', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:33,133][52650] Updated weights for policy 0, policy_version 23321 (0.0011) [2024-08-06 00:31:33,484][52668] DAMAGECOUNT value on done: 114005.0 [2024-08-06 00:31:33,484][52668] Sum rewards: 64.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.080', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.200', 'AMMO4': '0.252', 'AMMO3': '0.261', 'weapon2': '0.322', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '55.000'} [2024-08-06 00:31:33,556][52795] DAMAGECOUNT value on done: 104765.0 [2024-08-06 00:31:33,556][52795] Sum rewards: 58.650, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.747', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.878', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '48.000'} [2024-08-06 00:31:33,610][52662] DAMAGECOUNT value on done: 117092.0 [2024-08-06 00:31:33,612][52662] Sum rewards: 50.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.603', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.252', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '43.000'} [2024-08-06 00:31:33,654][52669] DAMAGECOUNT value on done: 118420.0 [2024-08-06 00:31:33,655][52669] Sum rewards: 48.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.039', 'AMMO5': '0.005', 'ARMOR': '0.020', 'weapon5': '0.032', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.192', 'weapon4': '0.322', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.958', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '42.000'} [2024-08-06 00:31:34,324][52794] DAMAGECOUNT value on done: 124062.0 [2024-08-06 00:31:34,325][52794] Sum rewards: 54.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon7': '0.058', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.164', 'WEAPON7': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.600', 'weapon4': '0.850', 'WEAPON3': '1.150', 'weapon3': '2.418', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:34,744][52660] DAMAGECOUNT value on done: 115001.0 [2024-08-06 00:31:34,744][52660] Sum rewards: 53.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.074', 'AMMO5': '0.003', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.163', 'AMMO4': '0.201', 'WEAPON4': '0.500', 'weapon4': '0.618', 'weapon2': '0.832', 'WEAPON3': '1.150', 'weapon3': '2.200', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '47.000'} [2024-08-06 00:31:35,447][52667] DAMAGECOUNT value on done: 114450.0 [2024-08-06 00:31:35,448][52667] Sum rewards: 54.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.528', 'ARMOR': '0.004', 'AMMO2': '0.044', 'AMMO4': '0.222', 'AMMO3': '0.239', 'weapon4': '0.338', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.100', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:36,245][52669] DAMAGECOUNT value on done: 116217.0 [2024-08-06 00:31:36,246][52669] Sum rewards: 61.896, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.344', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '54.000'} [2024-08-06 00:31:36,616][52668] DAMAGECOUNT value on done: 107977.0 [2024-08-06 00:31:36,617][52668] Sum rewards: 67.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.008', 'weapon5': '0.014', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.368', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 00:31:36,664][52795] DAMAGECOUNT value on done: 106824.0 [2024-08-06 00:31:36,664][52795] Sum rewards: 55.517, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.214', 'AMMO5': '0.005', 'weapon5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.199', 'AMMO3': '0.274', 'weapon4': '0.328', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:36,782][52662] DAMAGECOUNT value on done: 116350.0 [2024-08-06 00:31:36,782][52662] Sum rewards: 59.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.593', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.216', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.390', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '52.000'} [2024-08-06 00:31:37,194][52794] DAMAGECOUNT value on done: 116784.0 [2024-08-06 00:31:37,194][52794] Sum rewards: 59.281, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.722', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.233', 'WEAPON4': '0.450', 'weapon2': '0.458', 'weapon4': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.712', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '53.000'} [2024-08-06 00:31:37,585][52650] Updated weights for policy 0, policy_version 23331 (0.0012) [2024-08-06 00:31:37,748][52660] DAMAGECOUNT value on done: 115579.0 [2024-08-06 00:31:37,748][52660] Sum rewards: 55.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.648', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.528', 'WEAPON3': '0.900', 'HITCOUNT': '2.890', 'weapon3': '3.016', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '45.000'} [2024-08-06 00:31:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 191127552. Throughput: 0: 4393.1. Samples: 47785490. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:31:37,794][52567] Avg episode reward: [(0, '54.007')] [2024-08-06 00:31:38,364][52667] DAMAGECOUNT value on done: 116807.0 [2024-08-06 00:31:38,366][52667] Sum rewards: 42.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.201', 'WEAPON4': '0.400', 'weapon2': '0.628', 'weapon4': '0.798', 'WEAPON3': '1.250', 'weapon3': '2.386', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '10.785', 'FRAGCOUNT': '39.000'} [2024-08-06 00:31:39,443][52668] DAMAGECOUNT value on done: 115449.0 [2024-08-06 00:31:39,443][52668] Sum rewards: 53.067, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.476', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'weapon2': '0.238', 'AMMO3': '0.298', 'weapon4': '0.384', 'WEAPON3': '1.750', 'weapon3': '2.978', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '48.000'} [2024-08-06 00:31:39,561][52669] DAMAGECOUNT value on done: 114681.0 [2024-08-06 00:31:39,561][52669] Sum rewards: 60.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.163', 'weapon4': '0.232', 'weapon2': '0.402', 'WEAPON3': '0.950', 'weapon3': '3.166', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:39,567][52662] DAMAGECOUNT value on done: 123385.0 [2024-08-06 00:31:39,568][52662] Sum rewards: 66.570, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.344', 'weapon2': '0.486', 'WEAPON3': '0.900', 'weapon3': '2.748', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '54.000'} [2024-08-06 00:31:39,794][52795] DAMAGECOUNT value on done: 105149.0 [2024-08-06 00:31:39,797][52795] Sum rewards: 44.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.465', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.426', 'weapon4': '0.456', 'WEAPON3': '1.500', 'HITCOUNT': '2.590', 'weapon3': '2.756', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '41.000'} [2024-08-06 00:31:40,196][52794] DAMAGECOUNT value on done: 120864.0 [2024-08-06 00:31:40,199][52794] Sum rewards: 53.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.436', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.034', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.178', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.348', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '47.500'} [2024-08-06 00:31:40,779][52660] DAMAGECOUNT value on done: 115419.0 [2024-08-06 00:31:40,782][52660] Sum rewards: 63.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.234', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'weapon2': '0.228', 'AMMO3': '0.235', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.332', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '56.000'} [2024-08-06 00:31:41,443][52667] DAMAGECOUNT value on done: 112999.0 [2024-08-06 00:31:41,445][52667] Sum rewards: 46.163, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.834', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'weapon4': '0.206', 'AMMO3': '0.282', 'weapon2': '0.320', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.220', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '43.000'} [2024-08-06 00:31:42,247][52650] Updated weights for policy 0, policy_version 23341 (0.0017) [2024-08-06 00:31:42,473][52662] DAMAGECOUNT value on done: 113484.0 [2024-08-06 00:31:42,475][52662] Sum rewards: 53.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.019', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.161', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.718', 'WEAPON3': '1.000', 'weapon3': '2.906', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:42,498][52668] DAMAGECOUNT value on done: 113562.0 [2024-08-06 00:31:42,501][52668] Sum rewards: 43.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.140', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '3.064', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '39.000'} [2024-08-06 00:31:42,532][52669] DAMAGECOUNT value on done: 114099.0 [2024-08-06 00:31:42,535][52669] Sum rewards: 57.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.082', 'AMMO5': '0.009', 'ARMOR': '0.022', 'weapon5': '0.022', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.197', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 191217664. Throughput: 0: 4403.1. Samples: 47811790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:31:42,795][52567] Avg episode reward: [(0, '54.154')] [2024-08-06 00:31:42,908][52795] DAMAGECOUNT value on done: 103295.0 [2024-08-06 00:31:42,908][52795] Sum rewards: 53.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.169', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.450', 'weapon2': '0.514', 'weapon4': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.598', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '47.000'} [2024-08-06 00:31:43,055][52649] DAMAGECOUNT value on done: 112619.0 [2024-08-06 00:31:43,055][52649] Sum rewards: 60.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:43,066][52794] DAMAGECOUNT value on done: 118177.0 [2024-08-06 00:31:43,066][52794] Sum rewards: 52.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.080', 'weapon4': '0.128', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.536', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.060', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '45.500'} [2024-08-06 00:31:43,858][52660] DAMAGECOUNT value on done: 116609.0 [2024-08-06 00:31:43,860][52660] Sum rewards: 53.722, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.037', 'weapon5': '0.082', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.650', 'HITCOUNT': '2.930', 'weapon3': '3.078', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '48.000'} [2024-08-06 00:31:44,469][52667] DAMAGECOUNT value on done: 117613.0 [2024-08-06 00:31:44,471][52667] Sum rewards: 54.455, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.551', 'AMMO5': '0.007', 'weapon5': '0.014', 'ARMOR': '0.024', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.218', 'weapon2': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:45,436][52668] DAMAGECOUNT value on done: 115738.0 [2024-08-06 00:31:45,436][52668] Sum rewards: 54.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.512', 'AMMO2': '0.028', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO4': '0.137', 'AMMO3': '0.184', 'weapon2': '0.772', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:45,604][52669] DAMAGECOUNT value on done: 115754.0 [2024-08-06 00:31:45,606][52662] DAMAGECOUNT value on done: 120516.0 [2024-08-06 00:31:45,605][52669] Sum rewards: 62.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.290', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.000'} [2024-08-06 00:31:45,608][52662] Sum rewards: 45.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.085', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.156', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.908', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '38.500'} [2024-08-06 00:31:46,025][52795] DAMAGECOUNT value on done: 107644.0 [2024-08-06 00:31:46,027][52795] Sum rewards: 57.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'ARMOR': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon4': '0.312', 'weapon2': '0.870', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:46,203][52649] DAMAGECOUNT value on done: 109485.0 [2024-08-06 00:31:46,205][52649] Sum rewards: 49.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.059', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon5': '0.078', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.400', 'weapon4': '0.498', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.494', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '41.000'} [2024-08-06 00:31:46,260][52794] DAMAGECOUNT value on done: 126733.0 [2024-08-06 00:31:46,261][52794] Sum rewards: 63.912, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.190', 'weapon2': '0.424', 'HEALTH': '0.449', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:46,412][52660] DAMAGECOUNT value on done: 110976.0 [2024-08-06 00:31:46,412][52660] Sum rewards: 50.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.343', 'AMMO2': '0.023', 'AMMO5': '0.027', 'AMMO4': '0.116', 'AMMO3': '0.170', 'weapon5': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.382', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.528', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '41.000'} [2024-08-06 00:31:46,814][52650] Updated weights for policy 0, policy_version 23351 (0.0012) [2024-08-06 00:31:47,381][52667] DAMAGECOUNT value on done: 116400.0 [2024-08-06 00:31:47,381][52667] Sum rewards: 42.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.325', 'AMMO5': '0.012', 'AMMO2': '0.063', 'AMMO3': '0.195', 'weapon5': '0.254', 'WEAPON5': '0.300', 'AMMO4': '0.315', 'weapon4': '0.560', 'weapon2': '0.646', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.190', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '38.000'} [2024-08-06 00:31:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 191299584. Throughput: 0: 4391.8. Samples: 47824830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:31:47,802][52567] Avg episode reward: [(0, '54.071')] [2024-08-06 00:31:48,068][52668] DAMAGECOUNT value on done: 113029.0 [2024-08-06 00:31:48,068][52668] Sum rewards: 58.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.258', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.056', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.324', 'WEAPON4': '0.400', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:48,356][52662] DAMAGECOUNT value on done: 115768.0 [2024-08-06 00:31:48,358][52662] Sum rewards: 33.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO2': '0.043', 'weapon5': '0.166', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.342', 'WEAPON4': '0.400', 'weapon2': '0.838', 'WEAPON3': '1.150', 'HITCOUNT': '2.250', 'weapon3': '2.398', 'DAMAGECOUNT': '9.249', 'FRAGCOUNT': '32.000'} [2024-08-06 00:31:48,660][52669] DAMAGECOUNT value on done: 114712.0 [2024-08-06 00:31:48,660][52669] Sum rewards: 55.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.092', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.175', 'weapon5': '0.194', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'weapon4': '0.588', 'weapon2': '0.594', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.364', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '47.000'} [2024-08-06 00:31:48,813][52649] DAMAGECOUNT value on done: 112853.0 [2024-08-06 00:31:48,815][52649] Sum rewards: 55.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.073', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.132', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '45.000'} [2024-08-06 00:31:49,004][52794] DAMAGECOUNT value on done: 115008.0 [2024-08-06 00:31:49,006][52794] Sum rewards: 61.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.362', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.110', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.748', 'WEAPON3': '1.050', 'weapon3': '2.708', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '51.000'} [2024-08-06 00:31:49,100][52660] DAMAGECOUNT value on done: 112728.0 [2024-08-06 00:31:49,101][52660] Sum rewards: 50.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.016', 'AMMO4': '0.035', 'weapon5': '0.050', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.484', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '3.154', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '45.000'} [2024-08-06 00:31:49,182][52795] DAMAGECOUNT value on done: 109847.0 [2024-08-06 00:31:49,184][52795] Sum rewards: 54.853, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.077', 'weapon5': '0.112', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.384', 'weapon2': '0.548', 'WEAPON4': '0.550', 'weapon4': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '45.000'} [2024-08-06 00:31:50,074][52667] DAMAGECOUNT value on done: 115305.0 [2024-08-06 00:31:50,077][52667] Sum rewards: 48.972, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.075', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:50,829][52670] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2024-08-06 00:31:50,959][52668] DAMAGECOUNT value on done: 114399.0 [2024-08-06 00:31:50,959][52668] Sum rewards: 51.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.021', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:51,019][52662] DAMAGECOUNT value on done: 116996.0 [2024-08-06 00:31:51,019][52662] Sum rewards: 55.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'AMMO2': '0.028', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.137', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'weapon4': '0.606', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.404', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '45.500'} [2024-08-06 00:31:51,380][52649] DAMAGECOUNT value on done: 113690.0 [2024-08-06 00:31:51,382][52649] Sum rewards: 36.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.199', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.039', 'weapon4': '0.066', 'AMMO3': '0.189', 'AMMO4': '0.197', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.620', 'WEAPON3': '1.100', 'HITCOUNT': '2.150', 'weapon3': '2.726', 'DAMAGECOUNT': '10.296', 'FRAGCOUNT': '33.000'} [2024-08-06 00:31:51,699][52650] Updated weights for policy 0, policy_version 23361 (0.0023) [2024-08-06 00:31:51,807][52794] DAMAGECOUNT value on done: 121390.0 [2024-08-06 00:31:51,808][52794] Sum rewards: 57.408, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.248', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.230', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '48.000'} [2024-08-06 00:31:51,988][52669] DAMAGECOUNT value on done: 115524.0 [2024-08-06 00:31:51,988][52669] Sum rewards: 49.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.127', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.114', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.454', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '42.000'} [2024-08-06 00:31:52,089][52664] DAMAGECOUNT value on done: 118490.0 [2024-08-06 00:31:52,089][52664] Sum rewards: 49.158, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.364', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.592', 'WEAPON3': '1.450', 'weapon3': '2.758', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '47.000'} [2024-08-06 00:31:52,134][52660] DAMAGECOUNT value on done: 116381.0 [2024-08-06 00:31:52,134][52660] Sum rewards: 71.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon4': '0.262', 'weapon2': '0.320', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '59.000'} [2024-08-06 00:31:52,338][52795] DAMAGECOUNT value on done: 104057.0 [2024-08-06 00:31:52,340][52795] Sum rewards: 56.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.169', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.060', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '0.800', 'HITCOUNT': '2.970', 'weapon3': '3.118', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.9). Total num frames: 191389696. Throughput: 0: 4396.4. Samples: 47851350. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:31:52,794][52567] Avg episode reward: [(0, '53.682')] [2024-08-06 00:31:52,809][52667] DAMAGECOUNT value on done: 119183.0 [2024-08-06 00:31:52,810][52667] Sum rewards: 62.656, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.207', 'weapon2': '0.242', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.542', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '54.000'} [2024-08-06 00:31:53,483][52668] DAMAGECOUNT value on done: 118476.0 [2024-08-06 00:31:53,484][52668] Sum rewards: 57.161, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'AMMO3': '0.162', 'weapon4': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:54,426][52660] DAMAGECOUNT value on done: 122498.0 [2024-08-06 00:31:54,426][52660] Sum rewards: 67.817, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.304', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.141', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.548', 'WEAPON3': '0.850', 'weapon3': '2.962', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '56.000'} [2024-08-06 00:31:54,556][52649] DAMAGECOUNT value on done: 106972.0 [2024-08-06 00:31:54,556][52649] Sum rewards: 40.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.120', 'AMMO3': '0.226', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '2.986', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '36.000'} [2024-08-06 00:31:54,590][52664] DAMAGECOUNT value on done: 118500.0 [2024-08-06 00:31:54,591][52664] Sum rewards: 54.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.646', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.330', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '47.000'} [2024-08-06 00:31:54,902][52794] DAMAGECOUNT value on done: 119925.0 [2024-08-06 00:31:54,903][52794] Sum rewards: 39.592, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.217', 'AMMO3': '0.228', 'weapon4': '0.294', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.010', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '37.500'} [2024-08-06 00:31:55,105][52669] DAMAGECOUNT value on done: 116905.0 [2024-08-06 00:31:55,109][52669] Sum rewards: 59.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.408', 'weapon4': '0.496', 'WEAPON3': '1.350', 'weapon3': '2.802', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '52.000'} [2024-08-06 00:31:55,507][52795] DAMAGECOUNT value on done: 108335.0 [2024-08-06 00:31:55,508][52795] Sum rewards: 60.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.406', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.177', 'WEAPON4': '0.450', 'weapon2': '0.500', 'weapon4': '0.770', 'WEAPON3': '1.100', 'weapon3': '2.332', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:55,734][52667] DAMAGECOUNT value on done: 117428.0 [2024-08-06 00:31:55,736][52667] Sum rewards: 59.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.557', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.157', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.478', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.642', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '49.000'} [2024-08-06 00:31:56,006][52650] Updated weights for policy 0, policy_version 23371 (0.0012) [2024-08-06 00:31:56,093][52668] DAMAGECOUNT value on done: 116678.0 [2024-08-06 00:31:56,093][52668] Sum rewards: 53.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.050', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.292', 'weapon2': '0.330', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.168', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '46.000'} [2024-08-06 00:31:56,958][52660] DAMAGECOUNT value on done: 112646.0 [2024-08-06 00:31:56,960][52660] Sum rewards: 47.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.091', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.806', 'WEAPON3': '1.300', 'weapon3': '2.570', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '42.000'} [2024-08-06 00:31:57,471][52664] DAMAGECOUNT value on done: 120178.0 [2024-08-06 00:31:57,472][52664] Sum rewards: 46.785, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.072', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.536', 'WEAPON3': '1.450', 'HITCOUNT': '2.570', 'weapon3': '2.858', 'DAMAGECOUNT': '11.583', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:57,671][52649] DAMAGECOUNT value on done: 111781.0 [2024-08-06 00:31:57,673][52649] Sum rewards: 58.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.202', 'weapon4': '0.322', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 191471616. Throughput: 0: 4399.3. Samples: 47877810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:31:57,795][52567] Avg episode reward: [(0, '53.902')] [2024-08-06 00:31:57,942][52794] DAMAGECOUNT value on done: 119785.0 [2024-08-06 00:31:57,942][52794] Sum rewards: 49.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.040', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'AMMO3': '0.212', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '44.000'} [2024-08-06 00:31:58,228][52669] DAMAGECOUNT value on done: 115524.0 [2024-08-06 00:31:58,230][52669] Sum rewards: 44.728, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.183', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.522', 'weapon4': '0.776', 'WEAPON3': '1.350', 'weapon3': '2.220', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.057', 'FRAGCOUNT': '40.000'} [2024-08-06 00:31:58,283][52667] DAMAGECOUNT value on done: 115024.0 [2024-08-06 00:31:58,283][52667] Sum rewards: 50.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.513', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.221', 'weapon2': '0.488', 'WEAPON4': '0.550', 'weapon4': '0.612', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '2.694', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '43.000'} [2024-08-06 00:31:58,614][52795] DAMAGECOUNT value on done: 109958.0 [2024-08-06 00:31:58,616][52795] Sum rewards: 58.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.612', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.096', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '50.000'} [2024-08-06 00:31:59,766][52660] DAMAGECOUNT value on done: 117236.0 [2024-08-06 00:31:59,768][52660] Sum rewards: 54.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'ARMOR': '0.008', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.233', 'weapon4': '0.242', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '46.000'} [2024-08-06 00:32:00,252][52664] DAMAGECOUNT value on done: 119268.0 [2024-08-06 00:32:00,253][52664] Sum rewards: 59.785, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.495', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.038', 'AMMO2': '0.077', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'AMMO4': '0.385', 'weapon4': '0.634', 'weapon2': '0.688', 'WEAPON4': '0.950', 'WEAPON3': '1.400', 'weapon3': '2.382', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '55.000'} [2024-08-06 00:32:00,449][52794] DAMAGECOUNT value on done: 125535.0 [2024-08-06 00:32:00,449][52794] Sum rewards: 55.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.435', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon5': '0.238', 'weapon2': '0.410', 'WEAPON4': '0.550', 'weapon4': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.438', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '46.000'} [2024-08-06 00:32:00,857][52649] DAMAGECOUNT value on done: 107553.0 [2024-08-06 00:32:00,861][52649] Sum rewards: 46.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.696', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO3': '0.151', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON4': '0.550', 'weapon4': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:00,969][52650] Updated weights for policy 0, policy_version 23381 (0.0026) [2024-08-06 00:32:01,125][52667] DAMAGECOUNT value on done: 117761.0 [2024-08-06 00:32:01,126][52667] Sum rewards: 49.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.178', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.215', 'weapon4': '0.394', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:01,192][52669] DAMAGECOUNT value on done: 113318.0 [2024-08-06 00:32:01,192][52669] Sum rewards: 62.227, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.055', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon4': '0.258', 'weapon2': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '55.000'} [2024-08-06 00:32:02,376][52660] DAMAGECOUNT value on done: 112480.0 [2024-08-06 00:32:02,377][52660] Sum rewards: 57.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.358', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.140', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.590', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '2.808', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '46.000'} [2024-08-06 00:32:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 191569920. Throughput: 0: 4399.1. Samples: 47890920. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:32:02,794][52567] Avg episode reward: [(0, '53.948')] [2024-08-06 00:32:02,872][52658] DAMAGECOUNT value on done: 119567.0 [2024-08-06 00:32:02,873][52658] Sum rewards: 56.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.303', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon2': '0.322', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.232', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '46.000'} [2024-08-06 00:32:02,930][52664] DAMAGECOUNT value on done: 118978.0 [2024-08-06 00:32:02,931][52664] Sum rewards: 57.640, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.806', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'AMMO4': '0.211', 'weapon2': '0.418', 'WEAPON4': '0.500', 'weapon4': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:03,693][52794] DAMAGECOUNT value on done: 118414.0 [2024-08-06 00:32:03,693][52794] Sum rewards: 54.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.134', 'weapon2': '0.222', 'weapon4': '0.224', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.200', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '46.500'} [2024-08-06 00:32:03,939][52649] DAMAGECOUNT value on done: 117286.0 [2024-08-06 00:32:03,940][52649] Sum rewards: 64.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '54.000'} [2024-08-06 00:32:04,076][52667] DAMAGECOUNT value on done: 114104.0 [2024-08-06 00:32:04,077][52667] Sum rewards: 47.091, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.748', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO4': '0.201', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.512', 'WEAPON3': '1.450', 'weapon3': '2.608', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:04,302][52669] DAMAGECOUNT value on done: 117576.0 [2024-08-06 00:32:04,302][52669] Sum rewards: 46.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.176', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.024', 'AMMO4': '0.050', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.594', 'WEAPON3': '1.450', 'HITCOUNT': '2.620', 'weapon3': '3.108', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:05,056][52647] DAMAGECOUNT value on done: 122941.0 [2024-08-06 00:32:05,056][52647] Sum rewards: 60.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.244', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.434', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '51.000'} [2024-08-06 00:32:05,141][52660] DAMAGECOUNT value on done: 118776.0 [2024-08-06 00:32:05,143][52660] Sum rewards: 61.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.188', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:05,471][52650] Updated weights for policy 0, policy_version 23391 (0.0032) [2024-08-06 00:32:05,852][52658] DAMAGECOUNT value on done: 117012.0 [2024-08-06 00:32:05,854][52658] Sum rewards: 60.680, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.299', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.154', 'weapon4': '0.160', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.182', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:05,913][52664] DAMAGECOUNT value on done: 124652.0 [2024-08-06 00:32:05,913][52664] Sum rewards: 60.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'AMMO3': '0.213', 'weapon2': '0.234', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '51.500'} [2024-08-06 00:32:06,795][52667] DAMAGECOUNT value on done: 118476.0 [2024-08-06 00:32:06,796][52667] Sum rewards: 49.354, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'HEALTH': '0.020', 'AMMO2': '0.043', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.217', 'weapon2': '0.364', 'WEAPON4': '0.500', 'weapon4': '0.730', 'WEAPON3': '0.900', 'weapon3': '2.498', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '42.000'} [2024-08-06 00:32:06,909][52669] DAMAGECOUNT value on done: 117685.0 [2024-08-06 00:32:06,909][52669] Sum rewards: 56.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.128', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.198', 'AMMO3': '0.223', 'weapon4': '0.298', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:06,981][52649] DAMAGECOUNT value on done: 109957.0 [2024-08-06 00:32:06,982][52649] Sum rewards: 46.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.219', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.149', 'WEAPON4': '0.350', 'weapon4': '0.564', 'weapon2': '0.840', 'WEAPON3': '1.000', 'weapon3': '2.288', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '38.000'} [2024-08-06 00:32:07,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 191651840. Throughput: 0: 4392.5. Samples: 47917090. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:32:07,794][52567] Avg episode reward: [(0, '54.303')] [2024-08-06 00:32:07,811][52647] DAMAGECOUNT value on done: 120720.0 [2024-08-06 00:32:07,812][52647] Sum rewards: 51.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.594', 'WEAPON3': '0.950', 'weapon3': '2.948', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:08,304][52660] DAMAGECOUNT value on done: 113808.0 [2024-08-06 00:32:08,304][52660] Sum rewards: 45.439, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.270', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.051', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.256', 'AMMO3': '0.267', 'weapon2': '0.452', 'weapon4': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.678', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '45.000'} [2024-08-06 00:32:08,581][52658] DAMAGECOUNT value on done: 116886.0 [2024-08-06 00:32:08,582][52658] Sum rewards: 53.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.665', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.178', 'AMMO4': '0.212', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '44.500'} [2024-08-06 00:32:08,910][52664] DAMAGECOUNT value on done: 123150.0 [2024-08-06 00:32:08,911][52664] Sum rewards: 57.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.195', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.223', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.338', 'ARMOR': '0.510', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '3.046', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:09,589][52669] DAMAGECOUNT value on done: 113982.0 [2024-08-06 00:32:09,592][52669] Sum rewards: 58.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.595', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.132', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.486', 'weapon4': '0.726', 'WEAPON3': '1.000', 'weapon3': '2.426', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:09,681][52667] DAMAGECOUNT value on done: 123514.0 [2024-08-06 00:32:09,682][52667] Sum rewards: 66.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.094', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.076', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon2': '0.232', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.084', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '53.000'} [2024-08-06 00:32:10,156][52649] DAMAGECOUNT value on done: 113257.0 [2024-08-06 00:32:10,166][52649] Sum rewards: 46.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.842', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.173', 'weapon5': '0.192', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.500', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.386', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '40.000'} [2024-08-06 00:32:10,477][52650] Updated weights for policy 0, policy_version 23401 (0.0012) [2024-08-06 00:32:10,557][52647] DAMAGECOUNT value on done: 126404.0 [2024-08-06 00:32:10,557][52647] Sum rewards: 64.726, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.022', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon2': '0.696', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:11,402][52664] DAMAGECOUNT value on done: 114053.0 [2024-08-06 00:32:11,403][52664] Sum rewards: 46.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.570', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.124', 'weapon4': '0.148', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '3.066', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:11,663][52658] DAMAGECOUNT value on done: 120128.0 [2024-08-06 00:32:11,665][52658] Sum rewards: 60.947, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.545', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.135', 'AMMO4': '0.138', 'WEAPON4': '0.300', 'weapon4': '0.548', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '2.532', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '48.500'} [2024-08-06 00:32:12,144][52669] DAMAGECOUNT value on done: 117042.0 [2024-08-06 00:32:12,146][52669] Sum rewards: 59.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.364', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon2': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.024', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '48.000'} [2024-08-06 00:32:12,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 191741952. Throughput: 0: 4389.6. Samples: 47943550. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:32:12,795][52567] Avg episode reward: [(0, '54.435')] [2024-08-06 00:32:12,877][52667] DAMAGECOUNT value on done: 119655.0 [2024-08-06 00:32:12,877][52667] Sum rewards: 62.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '54.000'} [2024-08-06 00:32:13,125][52647] DAMAGECOUNT value on done: 123623.0 [2024-08-06 00:32:13,127][52647] Sum rewards: 41.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.212', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.444', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '3.000', 'DAMAGECOUNT': '11.319', 'FRAGCOUNT': '35.500'} [2024-08-06 00:32:13,289][52649] DAMAGECOUNT value on done: 112729.0 [2024-08-06 00:32:13,305][52649] Sum rewards: 59.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.742', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.362', 'weapon2': '0.396', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '51.000'} [2024-08-06 00:32:13,412][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:32:14,065][52664] DAMAGECOUNT value on done: 127495.0 [2024-08-06 00:32:14,065][52664] Sum rewards: 63.663, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.322', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.052', 'weapon4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.238', 'weapon2': '0.512', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '57.000'} [2024-08-06 00:32:14,107][52820] DAMAGECOUNT value on done: 105977.0 [2024-08-06 00:32:14,109][52820] Sum rewards: 58.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.450', 'weapon4': '0.556', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.466', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:14,375][52658] DAMAGECOUNT value on done: 119929.0 [2024-08-06 00:32:14,375][52658] Sum rewards: 70.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.811', 'AMMO5': '0.007', 'AMMO2': '0.026', 'ARMOR': '0.028', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.406', 'weapon2': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.650', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 00:32:14,774][52650] Updated weights for policy 0, policy_version 23411 (0.0019) [2024-08-06 00:32:15,207][52669] DAMAGECOUNT value on done: 122296.0 [2024-08-06 00:32:15,207][52669] Sum rewards: 57.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.595', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.132', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:15,625][52667] DAMAGECOUNT value on done: 122353.0 [2024-08-06 00:32:15,625][52667] Sum rewards: 54.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.308', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.036', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.136', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:15,660][52647] DAMAGECOUNT value on done: 127176.0 [2024-08-06 00:32:15,660][52647] Sum rewards: 60.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.654', 'AMMO5': '0.006', 'ARMOR': '0.008', 'weapon5': '0.046', 'AMMO2': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'AMMO4': '0.319', 'weapon4': '0.366', 'weapon2': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:16,483][52649] DAMAGECOUNT value on done: 110415.0 [2024-08-06 00:32:16,483][52649] Sum rewards: 41.137, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.688', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.072', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.450', 'weapon2': '0.594', 'weapon4': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.406', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '40.000'} [2024-08-06 00:32:16,539][52664] DAMAGECOUNT value on done: 125790.0 [2024-08-06 00:32:16,539][52664] Sum rewards: 50.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.896', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'weapon4': '0.506', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:17,282][52820] DAMAGECOUNT value on done: 108663.0 [2024-08-06 00:32:17,285][52820] Sum rewards: 62.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.927', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.203', 'weapon2': '0.314', 'WEAPON4': '0.450', 'weapon4': '0.630', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:17,354][52658] DAMAGECOUNT value on done: 113617.0 [2024-08-06 00:32:17,356][52658] Sum rewards: 58.929, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.925', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.073', 'AMMO3': '0.164', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.072', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 191832064. Throughput: 0: 4392.9. Samples: 47956830. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:32:17,794][52567] Avg episode reward: [(0, '54.614')] [2024-08-06 00:32:17,920][52669] DAMAGECOUNT value on done: 125568.0 [2024-08-06 00:32:17,921][52669] Sum rewards: 59.023, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.489', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.260', 'weapon4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:18,188][52667] DAMAGECOUNT value on done: 113300.0 [2024-08-06 00:32:18,191][52667] Sum rewards: 61.186, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.977', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.053', 'weapon5': '0.138', 'AMMO3': '0.233', 'weapon4': '0.254', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.400', 'weapon3': '2.780', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '56.000'} [2024-08-06 00:32:18,434][52647] DAMAGECOUNT value on done: 124487.0 [2024-08-06 00:32:18,435][52647] Sum rewards: 57.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.140', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.180', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.686', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:18,937][52666] DAMAGECOUNT value on done: 116585.0 [2024-08-06 00:32:18,939][52666] Sum rewards: 45.380, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.208', 'AMMO5': '0.006', 'ARMOR': '0.016', 'weapon5': '0.036', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'AMMO4': '0.230', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:19,599][52664] DAMAGECOUNT value on done: 122435.0 [2024-08-06 00:32:19,599][52664] Sum rewards: 45.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.213', 'WEAPON4': '0.450', 'weapon2': '0.530', 'weapon4': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '40.000'} [2024-08-06 00:32:19,750][52650] Updated weights for policy 0, policy_version 23421 (0.0040) [2024-08-06 00:32:19,869][52649] DAMAGECOUNT value on done: 116967.0 [2024-08-06 00:32:19,870][52649] Sum rewards: 65.508, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.176', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '54.000'} [2024-08-06 00:32:20,158][52658] DAMAGECOUNT value on done: 121745.0 [2024-08-06 00:32:20,158][52658] Sum rewards: 49.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.633', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon4': '0.372', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '42.000'} [2024-08-06 00:32:20,380][52820] DAMAGECOUNT value on done: 105641.0 [2024-08-06 00:32:20,391][52820] Sum rewards: 40.066, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.416', 'WEAPON3': '1.550', 'weapon3': '2.728', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '38.000'} [2024-08-06 00:32:21,064][52669] DAMAGECOUNT value on done: 116651.0 [2024-08-06 00:32:21,067][52669] Sum rewards: 43.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.805', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.084', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON3': '0.750', 'weapon4': '0.976', 'weapon3': '2.124', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '10.881', 'FRAGCOUNT': '35.500'} [2024-08-06 00:32:21,244][52667] DAMAGECOUNT value on done: 120484.0 [2024-08-06 00:32:21,244][52667] Sum rewards: 55.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.114', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.199', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.346', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:21,299][52666] DAMAGECOUNT value on done: 116586.0 [2024-08-06 00:32:21,302][52666] Sum rewards: 55.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.382', 'weapon4': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:21,464][52647] DAMAGECOUNT value on done: 121423.0 [2024-08-06 00:32:21,464][52647] Sum rewards: 46.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.171', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.544', 'weapon4': '0.766', 'WEAPON3': '1.000', 'weapon3': '2.164', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '39.000'} [2024-08-06 00:32:22,310][52664] DAMAGECOUNT value on done: 120818.0 [2024-08-06 00:32:22,310][52664] Sum rewards: 66.761, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.780', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.140', 'weapon4': '0.258', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.776', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '54.000'} [2024-08-06 00:32:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 191913984. Throughput: 0: 4394.2. Samples: 47983230. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:32:22,794][52567] Avg episode reward: [(0, '54.427')] [2024-08-06 00:32:23,015][52649] DAMAGECOUNT value on done: 115220.0 [2024-08-06 00:32:23,015][52649] Sum rewards: 60.244, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.906', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.211', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.362', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '51.000'} [2024-08-06 00:32:23,127][52658] DAMAGECOUNT value on done: 114391.0 [2024-08-06 00:32:23,130][52658] Sum rewards: 46.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.182', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.072', 'AMMO3': '0.178', 'weapon5': '0.220', 'AMMO4': '0.360', 'WEAPON5': '0.400', 'weapon4': '0.550', 'weapon2': '0.694', 'WEAPON4': '0.800', 'WEAPON3': '1.050', 'weapon3': '2.228', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '41.500'} [2024-08-06 00:32:23,475][52820] DAMAGECOUNT value on done: 101725.0 [2024-08-06 00:32:23,477][52820] Sum rewards: 57.428, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'HEALTH': '0.156', 'AMMO3': '0.178', 'weapon2': '0.228', 'weapon4': '0.248', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.360', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:23,844][52647] DAMAGECOUNT value on done: 124921.0 [2024-08-06 00:32:23,846][52647] Sum rewards: 47.564, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.746', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.084', 'AMMO3': '0.206', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.777', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:24,031][52669] DAMAGECOUNT value on done: 117056.0 [2024-08-06 00:32:24,031][52669] Sum rewards: 65.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.186', 'weapon2': '0.320', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.314', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '54.000'} [2024-08-06 00:32:24,117][52666] DAMAGECOUNT value on done: 118150.0 [2024-08-06 00:32:24,118][52666] Sum rewards: 49.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.506', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.144', 'AMMO3': '0.147', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.766', 'WEAPON3': '0.950', 'weapon3': '2.618', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '40.500'} [2024-08-06 00:32:24,229][52650] Updated weights for policy 0, policy_version 23431 (0.0019) [2024-08-06 00:32:24,922][52664] DAMAGECOUNT value on done: 118855.0 [2024-08-06 00:32:24,923][52664] Sum rewards: 68.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.198', 'weapon4': '0.314', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '57.000'} [2024-08-06 00:32:26,180][52658] DAMAGECOUNT value on done: 121262.0 [2024-08-06 00:32:26,182][52658] Sum rewards: 61.536, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:26,182][52649] DAMAGECOUNT value on done: 109443.0 [2024-08-06 00:32:26,187][52649] Sum rewards: 57.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.902', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.074', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.714', 'WEAPON3': '1.550', 'weapon3': '2.842', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:26,409][52670] DAMAGECOUNT value on done: 113993.0 [2024-08-06 00:32:26,409][52670] Sum rewards: 62.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:26,592][52820] DAMAGECOUNT value on done: 107268.0 [2024-08-06 00:32:26,596][52820] Sum rewards: 51.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.018', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '45.000'} [2024-08-06 00:32:26,597][52647] DAMAGECOUNT value on done: 126828.0 [2024-08-06 00:32:26,598][52647] Sum rewards: 56.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.500', 'weapon4': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '46.000'} [2024-08-06 00:32:26,953][52666] DAMAGECOUNT value on done: 112904.0 [2024-08-06 00:32:26,954][52666] Sum rewards: 59.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.412', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.014', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.177', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2024-08-06 00:32:27,178][52669] DAMAGECOUNT value on done: 118582.0 [2024-08-06 00:32:27,178][52669] Sum rewards: 68.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'AMMO4': '0.231', 'weapon4': '0.330', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '0.850', 'weapon3': '2.856', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '55.000'} [2024-08-06 00:32:27,692][52664] DAMAGECOUNT value on done: 121834.0 [2024-08-06 00:32:27,694][52664] Sum rewards: 54.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.386', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.223', 'weapon4': '0.354', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '48.000'} [2024-08-06 00:32:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 192004096. Throughput: 0: 4391.3. Samples: 48009400. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:32:27,794][52567] Avg episode reward: [(0, '55.122')] [2024-08-06 00:32:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023438_192004096.pth... [2024-08-06 00:32:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000022924_187793408.pth [2024-08-06 00:32:27,941][52614] Saving new best policy, reward=55.122! [2024-08-06 00:32:28,700][52658] DAMAGECOUNT value on done: 120306.0 [2024-08-06 00:32:28,700][52658] Sum rewards: 51.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.428', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:29,104][52650] Updated weights for policy 0, policy_version 23441 (0.0015) [2024-08-06 00:32:29,466][52647] DAMAGECOUNT value on done: 119736.0 [2024-08-06 00:32:29,466][52647] Sum rewards: 55.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.858', 'ARMOR': '0.028', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.206', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:29,483][52649] DAMAGECOUNT value on done: 115932.0 [2024-08-06 00:32:29,483][52649] Sum rewards: 53.032, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.248', 'AMMO5': '0.005', 'AMMO2': '0.012', 'ARMOR': '0.016', 'AMMO4': '0.057', 'weapon5': '0.110', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.598', 'WEAPON3': '0.850', 'HITCOUNT': '2.700', 'weapon3': '3.008', 'DAMAGECOUNT': '13.074', 'FRAGCOUNT': '42.000'} [2024-08-06 00:32:29,542][52670] DAMAGECOUNT value on done: 118421.0 [2024-08-06 00:32:29,553][52670] Sum rewards: 59.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.516', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.150', 'AMMO4': '0.204', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.600', 'weapon4': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.530', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:29,747][52820] DAMAGECOUNT value on done: 107448.0 [2024-08-06 00:32:29,748][52820] Sum rewards: 41.462, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.790', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.264', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.640', 'WEAPON3': '1.550', 'weapon3': '2.792', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '40.000'} [2024-08-06 00:32:30,058][52669] DAMAGECOUNT value on done: 117497.0 [2024-08-06 00:32:30,061][52669] Sum rewards: 67.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.398', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.157', 'weapon5': '0.200', 'AMMO4': '0.233', 'weapon2': '0.268', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.954', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '55.000'} [2024-08-06 00:32:30,141][52666] DAMAGECOUNT value on done: 113075.0 [2024-08-06 00:32:30,141][52666] Sum rewards: 41.901, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO2': '0.050', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'AMMO4': '0.248', 'HEALTH': '0.357', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '0.700', 'weapon4': '0.810', 'weapon3': '2.328', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '35.000'} [2024-08-06 00:32:30,737][52664] DAMAGECOUNT value on done: 122068.0 [2024-08-06 00:32:30,739][52664] Sum rewards: 63.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.165', 'AMMO3': '0.195', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:30,927][52658] DAMAGECOUNT value on done: 120941.0 [2024-08-06 00:32:30,930][52658] Sum rewards: 53.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.722', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:32,137][52647] DAMAGECOUNT value on done: 120324.0 [2024-08-06 00:32:32,137][52647] Sum rewards: 58.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.948', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.072', 'weapon5': '0.074', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.746', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:32,478][52649] DAMAGECOUNT value on done: 112309.0 [2024-08-06 00:32:32,479][52649] Sum rewards: 44.990, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.897', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.207', 'AMMO3': '0.229', 'weapon2': '0.304', 'WEAPON4': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.350', 'HITCOUNT': '2.560', 'weapon3': '2.812', 'DAMAGECOUNT': '11.478', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 192086016. Throughput: 0: 4389.3. Samples: 48022350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:32:32,794][52567] Avg episode reward: [(0, '55.212')] [2024-08-06 00:32:32,817][52614] Saving new best policy, reward=55.212! [2024-08-06 00:32:32,882][52820] DAMAGECOUNT value on done: 107373.0 [2024-08-06 00:32:32,883][52820] Sum rewards: 57.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon5': '0.048', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.210', 'AMMO3': '0.228', 'weapon2': '0.648', 'WEAPON3': '1.450', 'weapon3': '2.882', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '51.000'} [2024-08-06 00:32:32,938][52670] DAMAGECOUNT value on done: 113333.0 [2024-08-06 00:32:32,942][52670] Sum rewards: 54.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.884', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.082', 'AMMO4': '0.171', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.028', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:33,340][52666] DAMAGECOUNT value on done: 112431.0 [2024-08-06 00:32:33,340][52666] Sum rewards: 43.950, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.112', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.348', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.946', 'DAMAGECOUNT': '12.006', 'FRAGCOUNT': '42.000'} [2024-08-06 00:32:33,385][52664] DAMAGECOUNT value on done: 116766.0 [2024-08-06 00:32:33,386][52664] Sum rewards: 42.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.006', 'ARMOR': '0.032', 'AMMO2': '0.046', 'weapon5': '0.116', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'weapon4': '0.366', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon2': '1.012', 'weapon3': '2.296', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.592', 'FRAGCOUNT': '38.000'} [2024-08-06 00:32:33,661][52650] Updated weights for policy 0, policy_version 23451 (0.0024) [2024-08-06 00:32:33,992][52658] DAMAGECOUNT value on done: 115211.0 [2024-08-06 00:32:33,993][52658] Sum rewards: 55.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.942', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.210', 'AMMO4': '0.221', 'weapon5': '0.236', 'WEAPON5': '0.350', 'weapon4': '0.416', 'weapon2': '0.494', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.598', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '47.500'} [2024-08-06 00:32:35,015][52647] DAMAGECOUNT value on done: 118472.0 [2024-08-06 00:32:35,015][52647] Sum rewards: 58.391, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.072', 'AMMO3': '0.169', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.342', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '47.500'} [2024-08-06 00:32:35,463][52670] DAMAGECOUNT value on done: 116044.0 [2024-08-06 00:32:35,466][52670] Sum rewards: 48.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.238', 'weapon4': '0.258', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '3.010', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:35,744][52649] DAMAGECOUNT value on done: 116492.0 [2024-08-06 00:32:35,745][52649] Sum rewards: 51.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.712', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.196', 'weapon4': '0.220', 'weapon2': '0.386', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.204', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:36,027][52820] DAMAGECOUNT value on done: 107758.0 [2024-08-06 00:32:36,028][52820] Sum rewards: 55.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.169', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.173', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.466', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.498', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '46.000'} [2024-08-06 00:32:36,094][52666] DAMAGECOUNT value on done: 113612.0 [2024-08-06 00:32:36,094][52666] Sum rewards: 61.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.017', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.061', 'AMMO3': '0.132', 'weapon5': '0.174', 'WEAPON5': '0.300', 'AMMO4': '0.304', 'WEAPON4': '0.500', 'weapon4': '0.540', 'weapon2': '0.672', 'WEAPON3': '0.900', 'weapon3': '2.334', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:36,330][52664] DAMAGECOUNT value on done: 119991.0 [2024-08-06 00:32:36,331][52664] Sum rewards: 50.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.437', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon5': '0.168', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.958', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '42.500'} [2024-08-06 00:32:36,391][52658] DAMAGECOUNT value on done: 116949.0 [2024-08-06 00:32:36,393][52658] Sum rewards: 55.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.913', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.400', 'weapon4': '0.582', 'weapon2': '0.826', 'WEAPON3': '1.250', 'weapon3': '2.246', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '48.000'} [2024-08-06 00:32:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 192176128. Throughput: 0: 4380.0. Samples: 48048450. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:32:37,794][52567] Avg episode reward: [(0, '55.075')] [2024-08-06 00:32:37,880][52663] DAMAGECOUNT value on done: 116088.0 [2024-08-06 00:32:37,882][52663] Sum rewards: 38.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.806', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.104', 'AMMO3': '0.183', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.200', 'HITCOUNT': '2.470', 'weapon3': '3.050', 'DAMAGECOUNT': '10.155', 'FRAGCOUNT': '36.000'} [2024-08-06 00:32:37,923][52647] DAMAGECOUNT value on done: 121843.0 [2024-08-06 00:32:37,927][52647] Sum rewards: 58.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.182', 'WEAPON7': '0.200', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:38,155][52670] DAMAGECOUNT value on done: 116768.0 [2024-08-06 00:32:38,163][52670] Sum rewards: 55.678, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.282', 'weapon4': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '48.000'} [2024-08-06 00:32:38,465][52650] Updated weights for policy 0, policy_version 23461 (0.0013) [2024-08-06 00:32:38,498][52649] DAMAGECOUNT value on done: 114876.0 [2024-08-06 00:32:38,499][52649] Sum rewards: 55.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.282', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:38,515][52666] DAMAGECOUNT value on done: 115410.0 [2024-08-06 00:32:38,515][52666] Sum rewards: 60.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.097', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO4': '0.143', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.160', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:39,334][52820] DAMAGECOUNT value on done: 106362.0 [2024-08-06 00:32:39,335][52820] Sum rewards: 49.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.572', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO3': '0.160', 'AMMO4': '0.181', 'WEAPON5': '0.350', 'ARMOR': '0.489', 'weapon4': '0.578', 'WEAPON4': '0.600', 'weapon2': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.278', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '42.000'} [2024-08-06 00:32:39,377][52664] DAMAGECOUNT value on done: 121236.0 [2024-08-06 00:32:39,381][52664] Sum rewards: 57.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.436', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.214', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'weapon2': '0.852', 'WEAPON3': '1.500', 'weapon3': '2.718', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:39,420][52658] DAMAGECOUNT value on done: 115247.0 [2024-08-06 00:32:39,421][52658] Sum rewards: 51.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.368', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.043', 'AMMO3': '0.181', 'AMMO4': '0.217', 'weapon5': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON4': '0.500', 'weapon4': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.402', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '44.500'} [2024-08-06 00:32:40,646][52647] DAMAGECOUNT value on done: 118302.0 [2024-08-06 00:32:40,647][52647] Sum rewards: 54.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.804', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.226', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.224', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:40,648][52670] DAMAGECOUNT value on done: 116936.0 [2024-08-06 00:32:40,649][52670] Sum rewards: 59.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.212', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.430', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '48.000'} [2024-08-06 00:32:40,661][52663] DAMAGECOUNT value on done: 117479.0 [2024-08-06 00:32:40,662][52663] Sum rewards: 54.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.259', 'weapon2': '0.394', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.372', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:41,053][52666] DAMAGECOUNT value on done: 117950.0 [2024-08-06 00:32:41,054][52666] Sum rewards: 48.670, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.066', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.036', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.834', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '45.000'} [2024-08-06 00:32:41,363][52649] DAMAGECOUNT value on done: 120007.0 [2024-08-06 00:32:41,364][52649] Sum rewards: 58.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.071', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.205', 'weapon2': '0.282', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:41,754][52664] DAMAGECOUNT value on done: 119163.0 [2024-08-06 00:32:41,756][52664] Sum rewards: 58.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.014', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon4': '0.236', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:42,256][52658] DAMAGECOUNT value on done: 114792.0 [2024-08-06 00:32:42,258][52658] Sum rewards: 50.706, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.120', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.144', 'AMMO4': '0.169', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'weapon2': '0.368', 'WEAPON3': '1.750', 'HITCOUNT': '2.770', 'weapon3': '3.276', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:42,442][52820] DAMAGECOUNT value on done: 108787.0 [2024-08-06 00:32:42,442][52820] Sum rewards: 56.976, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.757', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.090', 'AMMO3': '0.192', 'weapon2': '0.508', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.238', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:42,698][52803] DAMAGECOUNT value on done: 111512.0 [2024-08-06 00:32:42,700][52803] Sum rewards: 40.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.434', 'AMMO5': '0.012', 'ARMOR': '0.040', 'weapon5': '0.042', 'AMMO2': '0.050', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'weapon4': '0.452', 'weapon2': '0.928', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '10.914', 'FRAGCOUNT': '36.000'} [2024-08-06 00:32:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 192266240. Throughput: 0: 4377.6. Samples: 48074800. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:32:42,794][52567] Avg episode reward: [(0, '54.886')] [2024-08-06 00:32:42,862][52650] Updated weights for policy 0, policy_version 23471 (0.0024) [2024-08-06 00:32:43,222][52647] DAMAGECOUNT value on done: 123303.0 [2024-08-06 00:32:43,229][52647] Sum rewards: 69.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.216', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '57.000'} [2024-08-06 00:32:43,428][52670] DAMAGECOUNT value on done: 110710.0 [2024-08-06 00:32:43,431][52670] Sum rewards: 61.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.775', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.104', 'AMMO3': '0.157', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '50.000'} [2024-08-06 00:32:43,558][52663] DAMAGECOUNT value on done: 117601.0 [2024-08-06 00:32:43,558][52663] Sum rewards: 52.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.168', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.161', 'WEAPON3': '1.000', 'weapon2': '1.042', 'weapon3': '2.684', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '45.000'} [2024-08-06 00:32:43,798][52666] DAMAGECOUNT value on done: 116188.0 [2024-08-06 00:32:43,798][52666] Sum rewards: 55.547, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.508', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.125', 'AMMO4': '0.178', 'weapon5': '0.276', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.784', 'WEAPON3': '0.850', 'weapon3': '2.406', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:44,338][52664] DAMAGECOUNT value on done: 119608.0 [2024-08-06 00:32:44,339][52664] Sum rewards: 63.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.478', 'ARMOR': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.102', 'AMMO3': '0.200', 'weapon2': '0.758', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '53.000'} [2024-08-06 00:32:45,087][52658] DAMAGECOUNT value on done: 119320.0 [2024-08-06 00:32:45,089][52658] Sum rewards: 44.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.867', 'ARMOR': '0.020', 'AMMO5': '0.025', 'weapon5': '0.028', 'AMMO2': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.249', 'weapon4': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.520', 'weapon3': '3.070', 'DAMAGECOUNT': '11.163', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:45,569][52820] DAMAGECOUNT value on done: 110041.0 [2024-08-06 00:32:45,569][52820] Sum rewards: 48.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.499', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.486', 'weapon4': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.712', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '40.000'} [2024-08-06 00:32:45,779][52803] DAMAGECOUNT value on done: 112437.0 [2024-08-06 00:32:45,782][52803] Sum rewards: 45.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.878', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.032', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '39.000'} [2024-08-06 00:32:45,912][52647] DAMAGECOUNT value on done: 123557.0 [2024-08-06 00:32:45,913][52647] Sum rewards: 51.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.644', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.086', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.662', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:46,348][52663] DAMAGECOUNT value on done: 117378.0 [2024-08-06 00:32:46,348][52663] Sum rewards: 52.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.188', 'AMMO4': '0.192', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.598', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '45.000'} [2024-08-06 00:32:46,547][52670] DAMAGECOUNT value on done: 113650.0 [2024-08-06 00:32:46,547][52670] Sum rewards: 43.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.790', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.277', 'weapon2': '0.308', 'WEAPON4': '0.400', 'weapon4': '0.618', 'WEAPON3': '1.700', 'HITCOUNT': '2.760', 'weapon3': '2.812', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:46,961][52666] DAMAGECOUNT value on done: 113236.0 [2024-08-06 00:32:46,963][52666] Sum rewards: 47.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.338', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.227', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.128', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:47,730][52666] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 00:32:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 192348160. Throughput: 0: 4377.1. Samples: 48087890. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:32:47,794][52567] Avg episode reward: [(0, '54.765')] [2024-08-06 00:32:47,813][52658] DAMAGECOUNT value on done: 121020.0 [2024-08-06 00:32:47,813][52658] Sum rewards: 48.061, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'weapon2': '0.316', 'WEAPON3': '1.750', 'HITCOUNT': '2.890', 'weapon3': '3.208', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:47,923][52650] Updated weights for policy 0, policy_version 23481 (0.0032) [2024-08-06 00:32:48,459][52671] DAMAGECOUNT value on done: 121831.0 [2024-08-06 00:32:48,460][52671] Sum rewards: 65.856, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.296', 'HEALTH': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.346', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 00:32:48,784][52663] DAMAGECOUNT value on done: 112739.0 [2024-08-06 00:32:48,784][52663] Sum rewards: 60.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.412', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.215', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '53.000'} [2024-08-06 00:32:48,812][52820] DAMAGECOUNT value on done: 110096.0 [2024-08-06 00:32:48,813][52820] Sum rewards: 66.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO2': '0.033', 'AMMO4': '0.162', 'weapon4': '0.186', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.352', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '56.000'} [2024-08-06 00:32:48,868][52803] DAMAGECOUNT value on done: 108980.0 [2024-08-06 00:32:48,872][52803] Sum rewards: 49.937, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.194', 'weapon4': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '42.000'} [2024-08-06 00:32:49,200][52647] DAMAGECOUNT value on done: 118346.0 [2024-08-06 00:32:49,200][52647] Sum rewards: 54.060, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.988', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.466', 'WEAPON4': '0.500', 'weapon4': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.602', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:49,212][52670] DAMAGECOUNT value on done: 109248.0 [2024-08-06 00:32:49,213][52670] Sum rewards: 62.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.263', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.194', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '53.000'} [2024-08-06 00:32:49,498][52666] DAMAGECOUNT value on done: 111553.0 [2024-08-06 00:32:49,499][52666] Sum rewards: 47.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.365', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.168', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '3.044', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '40.000'} [2024-08-06 00:32:49,787][52811] DAMAGECOUNT value on done: 115855.0 [2024-08-06 00:32:49,788][52811] Sum rewards: 64.690, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.698', 'ARMOR': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.504', 'weapon4': '0.514', 'WEAPON3': '1.650', 'weapon3': '2.734', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '58.000'} [2024-08-06 00:32:51,051][52658] DAMAGECOUNT value on done: 112073.0 [2024-08-06 00:32:51,052][52658] Sum rewards: 45.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.523', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.230', 'weapon2': '0.376', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.188', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '39.000'} [2024-08-06 00:32:51,246][52671] DAMAGECOUNT value on done: 116020.0 [2024-08-06 00:32:51,247][52671] Sum rewards: 59.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.102', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.144', 'weapon2': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon4': '0.482', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:51,689][52647] DAMAGECOUNT value on done: 122977.0 [2024-08-06 00:32:51,689][52647] Sum rewards: 43.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.178', 'AMMO4': '0.202', 'AMMO3': '0.241', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.530', 'weapon3': '2.852', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:51,832][52663] DAMAGECOUNT value on done: 121153.0 [2024-08-06 00:32:51,834][52663] Sum rewards: 62.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.114', 'AMMO3': '0.195', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '53.000'} [2024-08-06 00:32:52,047][52820] DAMAGECOUNT value on done: 105828.0 [2024-08-06 00:32:52,049][52820] Sum rewards: 61.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '53.000'} [2024-08-06 00:32:52,130][52803] DAMAGECOUNT value on done: 109386.0 [2024-08-06 00:32:52,131][52803] Sum rewards: 45.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.898', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO2': '0.053', 'AMMO3': '0.208', 'AMMO4': '0.265', 'weapon4': '0.416', 'weapon2': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '40.000'} [2024-08-06 00:32:52,177][52650] Updated weights for policy 0, policy_version 23491 (0.0034) [2024-08-06 00:32:52,304][52670] DAMAGECOUNT value on done: 106917.0 [2024-08-06 00:32:52,305][52670] Sum rewards: 57.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.515', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.045', 'AMMO3': '0.170', 'weapon4': '0.182', 'weapon5': '0.212', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '3.014', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:52,592][52666] DAMAGECOUNT value on done: 114679.0 [2024-08-06 00:32:52,594][52666] Sum rewards: 67.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.085', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.318', 'weapon4': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '56.000'} [2024-08-06 00:32:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 192438272. Throughput: 0: 4381.1. Samples: 48114240. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:32:52,794][52567] Avg episode reward: [(0, '54.688')] [2024-08-06 00:32:52,845][52811] DAMAGECOUNT value on done: 108766.0 [2024-08-06 00:32:52,846][52811] Sum rewards: 63.249, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.454', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.176', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '56.000'} [2024-08-06 00:32:54,179][52658] DAMAGECOUNT value on done: 115960.0 [2024-08-06 00:32:54,179][52658] Sum rewards: 42.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.614', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '3.104', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '38.000'} [2024-08-06 00:32:54,445][52671] DAMAGECOUNT value on done: 120159.0 [2024-08-06 00:32:54,445][52671] Sum rewards: 56.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.833', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.154', 'weapon4': '0.170', 'AMMO4': '0.179', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.048', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '48.500'} [2024-08-06 00:32:54,468][52665] DAMAGECOUNT value on done: 112176.0 [2024-08-06 00:32:54,469][52665] Sum rewards: 48.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon4': '0.332', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '3.070', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:54,526][52647] DAMAGECOUNT value on done: 117852.0 [2024-08-06 00:32:54,527][52647] Sum rewards: 53.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.205', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.316', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '43.000'} [2024-08-06 00:32:54,810][52663] DAMAGECOUNT value on done: 117340.0 [2024-08-06 00:32:54,810][52663] Sum rewards: 48.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.112', 'AMMO4': '0.209', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.392', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.806', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '42.000'} [2024-08-06 00:32:55,186][52803] DAMAGECOUNT value on done: 113026.0 [2024-08-06 00:32:55,187][52803] Sum rewards: 62.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.926', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO3': '0.236', 'weapon2': '0.340', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.200', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '53.000'} [2024-08-06 00:32:55,286][52820] DAMAGECOUNT value on done: 107380.0 [2024-08-06 00:32:55,288][52820] Sum rewards: 51.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.567', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.270', 'weapon4': '0.762', 'WEAPON3': '1.400', 'weapon3': '2.480', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:55,537][52670] DAMAGECOUNT value on done: 118588.0 [2024-08-06 00:32:55,537][52670] Sum rewards: 57.112, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.410', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.086', 'weapon4': '0.150', 'AMMO4': '0.207', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.106', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:55,635][52795] Large shaping reward 2.525 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47400000000000003, 158.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:32:55,857][52811] DAMAGECOUNT value on done: 109203.0 [2024-08-06 00:32:55,860][52811] Sum rewards: 52.450, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.245', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:55,866][52666] DAMAGECOUNT value on done: 116225.0 [2024-08-06 00:32:55,867][52666] Sum rewards: 61.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.114', 'AMMO3': '0.188', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '2.948', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '51.000'} [2024-08-06 00:32:57,025][52650] Updated weights for policy 0, policy_version 23501 (0.0019) [2024-08-06 00:32:57,128][52671] DAMAGECOUNT value on done: 114911.0 [2024-08-06 00:32:57,130][52671] Sum rewards: 56.603, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.550', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.104', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.354', 'weapon2': '0.376', 'WEAPON3': '2.100', 'weapon3': '3.068', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '52.000'} [2024-08-06 00:32:57,170][52647] DAMAGECOUNT value on done: 122500.0 [2024-08-06 00:32:57,170][52647] Sum rewards: 62.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.705', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.130', 'AMMO3': '0.139', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.752', 'WEAPON3': '0.900', 'weapon3': '2.764', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '48.000'} [2024-08-06 00:32:57,258][52658] DAMAGECOUNT value on done: 119169.0 [2024-08-06 00:32:57,261][52658] Sum rewards: 47.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'ARMOR': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.242', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'HITCOUNT': '2.510', 'weapon3': '3.454', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '44.000'} [2024-08-06 00:32:57,578][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon2', 0.002)] [2024-08-06 00:32:57,721][52665] DAMAGECOUNT value on done: 121315.0 [2024-08-06 00:32:57,721][52665] Sum rewards: 53.439, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.114', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.620', 'WEAPON3': '0.800', 'weapon3': '2.894', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '41.000'} [2024-08-06 00:32:57,752][52663] DAMAGECOUNT value on done: 115167.0 [2024-08-06 00:32:57,753][52663] Sum rewards: 61.733, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.010', 'AMMO4': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.462', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.312', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '51.000'} [2024-08-06 00:32:57,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 192536576. Throughput: 0: 4373.6. Samples: 48140360. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:32:57,794][52567] Avg episode reward: [(0, '54.902')] [2024-08-06 00:32:58,258][52803] DAMAGECOUNT value on done: 110578.0 [2024-08-06 00:32:58,259][52803] Sum rewards: 64.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.410', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.344', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '55.000'} [2024-08-06 00:32:58,436][52820] DAMAGECOUNT value on done: 111023.0 [2024-08-06 00:32:58,439][52820] Sum rewards: 37.449, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.370', 'AMMO5': '0.009', 'weapon5': '0.024', 'AMMO2': '0.044', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.294', 'weapon2': '0.352', 'WEAPON4': '0.600', 'weapon4': '0.656', 'WEAPON3': '1.750', 'weapon3': '2.652', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '11.496', 'FRAGCOUNT': '39.500'} [2024-08-06 00:32:58,749][52670] DAMAGECOUNT value on done: 116961.0 [2024-08-06 00:32:58,749][52670] Sum rewards: 53.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.296', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.201', 'AMMO3': '0.213', 'weapon2': '0.422', 'WEAPON4': '0.450', 'weapon4': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '47.000'} [2024-08-06 00:32:58,888][52811] DAMAGECOUNT value on done: 108136.0 [2024-08-06 00:32:58,889][52811] Sum rewards: 58.545, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon4': '0.216', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.152', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '49.000'} [2024-08-06 00:32:58,955][52666] DAMAGECOUNT value on done: 115475.0 [2024-08-06 00:32:58,957][52666] Sum rewards: 55.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:00,319][52671] DAMAGECOUNT value on done: 116611.0 [2024-08-06 00:33:00,320][52671] Sum rewards: 63.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.190', 'weapon2': '0.232', 'WEAPON3': '1.300', 'HITCOUNT': '3.410', 'weapon3': '3.610', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '53.000'} [2024-08-06 00:33:00,643][52665] DAMAGECOUNT value on done: 116033.0 [2024-08-06 00:33:00,643][52665] Sum rewards: 49.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'weapon7': '0.002', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.157', 'AMMO4': '0.301', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.650', 'weapon4': '0.692', 'WEAPON3': '0.950', 'weapon3': '2.504', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:00,794][52663] DAMAGECOUNT value on done: 118160.0 [2024-08-06 00:33:00,798][52663] Sum rewards: 60.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.666', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:01,461][52820] DAMAGECOUNT value on done: 109525.0 [2024-08-06 00:33:01,463][52820] Sum rewards: 60.850, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.212', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '52.000'} [2024-08-06 00:33:01,490][52803] DAMAGECOUNT value on done: 112835.0 [2024-08-06 00:33:01,492][52803] Sum rewards: 49.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.218', 'weapon2': '0.732', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:01,823][52650] Updated weights for policy 0, policy_version 23511 (0.0022) [2024-08-06 00:33:01,831][52670] DAMAGECOUNT value on done: 116390.0 [2024-08-06 00:33:01,832][52670] Sum rewards: 67.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.464', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'weapon4': '0.170', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '59.000'} [2024-08-06 00:33:01,838][52811] DAMAGECOUNT value on done: 109685.0 [2024-08-06 00:33:01,840][52811] Sum rewards: 52.888, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.782', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.073', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.642', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '2.874', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '44.000'} [2024-08-06 00:33:02,007][52666] DAMAGECOUNT value on done: 113462.0 [2024-08-06 00:33:02,008][52666] Sum rewards: 51.280, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.346', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO4': '0.192', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '45.500'} [2024-08-06 00:33:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 192618496. Throughput: 0: 4374.5. Samples: 48153680. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:33:02,794][52567] Avg episode reward: [(0, '54.647')] [2024-08-06 00:33:02,898][52671] DAMAGECOUNT value on done: 118370.0 [2024-08-06 00:33:02,898][52671] Sum rewards: 51.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'AMMO5': '0.003', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.164', 'AMMO4': '0.249', 'weapon4': '0.542', 'WEAPON4': '0.550', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '2.586', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '44.000'} [2024-08-06 00:33:03,686][52665] DAMAGECOUNT value on done: 112284.0 [2024-08-06 00:33:03,686][52665] Sum rewards: 56.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.155', 'AMMO2': '0.011', 'ARMOR': '0.036', 'AMMO4': '0.055', 'weapon4': '0.124', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.876', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:03,693][52663] DAMAGECOUNT value on done: 118174.0 [2024-08-06 00:33:03,694][52663] Sum rewards: 57.164, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.402', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.256', 'weapon2': '0.422', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.288', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '50.000'} [2024-08-06 00:33:04,531][52803] DAMAGECOUNT value on done: 109658.0 [2024-08-06 00:33:04,532][52803] Sum rewards: 51.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.268', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.122', 'AMMO3': '0.162', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.624', 'weapon2': '0.910', 'WEAPON3': '0.950', 'weapon3': '2.156', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '42.000'} [2024-08-06 00:33:04,568][52820] DAMAGECOUNT value on done: 108926.0 [2024-08-06 00:33:04,568][52820] Sum rewards: 47.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.074', 'AMMO3': '0.203', 'AMMO4': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON4': '0.600', 'weapon4': '0.714', 'WEAPON3': '1.250', 'weapon3': '2.416', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.513', 'FRAGCOUNT': '42.000'} [2024-08-06 00:33:04,913][52670] DAMAGECOUNT value on done: 116133.0 [2024-08-06 00:33:04,915][52670] Sum rewards: 68.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.854', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.316', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '56.000'} [2024-08-06 00:33:05,070][52666] DAMAGECOUNT value on done: 113456.0 [2024-08-06 00:33:05,070][52666] Sum rewards: 57.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.066', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.342', 'weapon2': '0.394', 'WEAPON3': '1.050', 'HITCOUNT': '2.800', 'weapon3': '2.968', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:05,169][52811] DAMAGECOUNT value on done: 113584.0 [2024-08-06 00:33:05,171][52811] Sum rewards: 63.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.446', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.262', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '53.000'} [2024-08-06 00:33:05,572][52671] DAMAGECOUNT value on done: 118612.0 [2024-08-06 00:33:05,583][52671] Sum rewards: 48.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.529', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.225', 'weapon2': '0.588', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.018', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '43.000'} [2024-08-06 00:33:06,210][52650] Updated weights for policy 0, policy_version 23521 (0.0011) [2024-08-06 00:33:06,395][52663] DAMAGECOUNT value on done: 116938.0 [2024-08-06 00:33:06,396][52663] Sum rewards: 51.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.457', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.199', 'AMMO3': '0.205', 'weapon2': '0.386', 'WEAPON4': '0.550', 'weapon4': '0.858', 'WEAPON3': '1.150', 'weapon3': '2.452', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '47.000'} [2024-08-06 00:33:06,657][52665] DAMAGECOUNT value on done: 114809.0 [2024-08-06 00:33:06,657][52665] Sum rewards: 58.714, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon4': '0.488', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.688', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:07,493][52803] DAMAGECOUNT value on done: 109568.0 [2024-08-06 00:33:07,495][52803] Sum rewards: 54.958, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'weapon7': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:07,715][52820] DAMAGECOUNT value on done: 110235.0 [2024-08-06 00:33:07,719][52820] Sum rewards: 47.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.158', 'AMMO5': '0.007', 'AMMO2': '0.029', 'ARMOR': '0.040', 'weapon5': '0.066', 'weapon4': '0.114', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.662', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '2.970', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:07,720][52670] DAMAGECOUNT value on done: 119963.0 [2024-08-06 00:33:07,722][52670] Sum rewards: 53.025, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.082', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.338', 'weapon2': '0.608', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '2.860', 'DAMAGECOUNT': '11.850', 'FRAGCOUNT': '43.000'} [2024-08-06 00:33:07,797][52567] Fps is (10 sec: 16378.4, 60 sec: 17475.3, 300 sec: 17522.3). Total num frames: 192700416. Throughput: 0: 4381.0. Samples: 48180390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:33:07,798][52567] Avg episode reward: [(0, '54.645')] [2024-08-06 00:33:07,989][52666] DAMAGECOUNT value on done: 118510.0 [2024-08-06 00:33:07,993][52666] Sum rewards: 50.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.830', 'WEAPON3': '1.150', 'weapon3': '2.316', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '42.000'} [2024-08-06 00:33:08,291][52811] DAMAGECOUNT value on done: 109384.0 [2024-08-06 00:33:08,291][52811] Sum rewards: 60.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'ARMOR': '0.016', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.094', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon2': '0.484', 'weapon4': '0.498', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:08,650][52671] DAMAGECOUNT value on done: 119717.0 [2024-08-06 00:33:08,651][52671] Sum rewards: 41.668, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.385', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon4': '0.270', 'weapon2': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.896', 'DAMAGECOUNT': '10.611', 'FRAGCOUNT': '36.000'} [2024-08-06 00:33:08,833][52663] DAMAGECOUNT value on done: 115590.0 [2024-08-06 00:33:08,835][52663] Sum rewards: 51.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.434', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.556', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.434', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '44.000'} [2024-08-06 00:33:09,735][52665] DAMAGECOUNT value on done: 115136.0 [2024-08-06 00:33:09,735][52665] Sum rewards: 53.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.022', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO3': '0.176', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '46.000'} [2024-08-06 00:33:10,488][52803] DAMAGECOUNT value on done: 106813.0 [2024-08-06 00:33:10,489][52803] Sum rewards: 66.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.309', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '54.000'} [2024-08-06 00:33:10,702][52670] DAMAGECOUNT value on done: 109500.0 [2024-08-06 00:33:10,703][52670] Sum rewards: 41.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.066', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO3': '0.225', 'weapon2': '0.248', 'WEAPON3': '1.250', 'HITCOUNT': '2.170', 'weapon3': '3.348', 'DAMAGECOUNT': '11.334', 'FRAGCOUNT': '38.000'} [2024-08-06 00:33:10,744][52820] DAMAGECOUNT value on done: 111966.0 [2024-08-06 00:33:10,745][52820] Sum rewards: 48.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon2': '0.366', 'weapon4': '0.464', 'WEAPON3': '1.000', 'weapon3': '2.574', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.544', 'FRAGCOUNT': '40.000'} [2024-08-06 00:33:10,944][52666] DAMAGECOUNT value on done: 113253.0 [2024-08-06 00:33:10,944][52666] Sum rewards: 56.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.638', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.218', 'weapon2': '0.278', 'weapon4': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:11,093][52650] Updated weights for policy 0, policy_version 23531 (0.0010) [2024-08-06 00:33:11,325][52811] DAMAGECOUNT value on done: 108374.0 [2024-08-06 00:33:11,325][52811] Sum rewards: 53.994, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.488', 'AMMO5': '0.012', 'AMMO2': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'AMMO4': '0.272', 'weapon4': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.024', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '50.000'} [2024-08-06 00:33:11,822][52663] DAMAGECOUNT value on done: 111898.0 [2024-08-06 00:33:11,823][52663] Sum rewards: 53.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.630', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.018', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.229', 'weapon2': '0.508', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.268', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '45.000'} [2024-08-06 00:33:12,070][52671] DAMAGECOUNT value on done: 116113.0 [2024-08-06 00:33:12,072][52671] Sum rewards: 48.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.028', 'AMMO4': '0.067', 'weapon7': '0.082', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.376', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.412', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.499', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:12,532][52665] DAMAGECOUNT value on done: 115537.0 [2024-08-06 00:33:12,533][52665] Sum rewards: 51.440, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.236', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.372', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 192798720. Throughput: 0: 4390.4. Samples: 48206970. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:33:12,795][52567] Avg episode reward: [(0, '54.617')] [2024-08-06 00:33:13,118][52659] DAMAGECOUNT value on done: 117786.0 [2024-08-06 00:33:13,119][52659] Sum rewards: 62.869, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.834', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'weapon4': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.568', 'WEAPON3': '0.800', 'weapon3': '3.118', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:13,545][52803] DAMAGECOUNT value on done: 112494.0 [2024-08-06 00:33:13,547][52803] Sum rewards: 57.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.082', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.142', 'weapon4': '0.192', 'AMMO3': '0.238', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.198', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '52.000'} [2024-08-06 00:33:13,926][52670] DAMAGECOUNT value on done: 119252.0 [2024-08-06 00:33:13,936][52670] Sum rewards: 48.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.708', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.184', 'ARMOR': '0.408', 'weapon2': '0.764', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.902', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '39.000'} [2024-08-06 00:33:13,959][52820] DAMAGECOUNT value on done: 108151.0 [2024-08-06 00:33:13,959][52820] Sum rewards: 54.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.830', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon4': '0.290', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '46.000'} [2024-08-06 00:33:13,993][52666] DAMAGECOUNT value on done: 115658.0 [2024-08-06 00:33:13,995][52666] Sum rewards: 55.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.355', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '46.000'} [2024-08-06 00:33:14,432][52663] DAMAGECOUNT value on done: 114652.0 [2024-08-06 00:33:14,433][52663] Sum rewards: 43.774, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.988', 'WEAPON3': '1.000', 'weapon3': '2.644', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '36.000'} [2024-08-06 00:33:14,478][52811] DAMAGECOUNT value on done: 112607.0 [2024-08-06 00:33:14,479][52811] Sum rewards: 59.763, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.244', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.200', 'AMMO3': '0.240', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.316', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '52.000'} [2024-08-06 00:33:14,789][52665] DAMAGECOUNT value on done: 117854.0 [2024-08-06 00:33:14,789][52665] Sum rewards: 57.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.188', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.462', 'weapon4': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.582', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:15,567][52650] Updated weights for policy 0, policy_version 23541 (0.0020) [2024-08-06 00:33:15,636][52671] DAMAGECOUNT value on done: 118209.0 [2024-08-06 00:33:15,636][52671] Sum rewards: 45.067, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.635', 'AMMO5': '0.008', 'AMMO2': '0.051', 'WEAPON5': '0.200', 'weapon5': '0.224', 'AMMO4': '0.253', 'AMMO3': '0.270', 'weapon4': '0.352', 'WEAPON4': '0.600', 'weapon2': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.446', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '43.500'} [2024-08-06 00:33:15,664][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:33:16,526][52803] DAMAGECOUNT value on done: 114219.0 [2024-08-06 00:33:16,528][52803] Sum rewards: 54.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.726', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.066', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '2.940', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '46.000'} [2024-08-06 00:33:16,758][52659] DAMAGECOUNT value on done: 116581.0 [2024-08-06 00:33:16,758][52659] Sum rewards: 60.860, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.286', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon4': '0.274', 'weapon2': '0.676', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:16,975][52670] DAMAGECOUNT value on done: 116320.0 [2024-08-06 00:33:16,975][52670] Sum rewards: 48.388, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.177', 'AMMO4': '0.191', 'HEALTH': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '2.794', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '40.000'} [2024-08-06 00:33:17,300][52614] Signal inference workers to stop experience collection... (4350 times) [2024-08-06 00:33:17,300][52614] Signal inference workers to resume experience collection... (4350 times) [2024-08-06 00:33:17,352][52650] InferenceWorker_p0-w0: stopping experience collection (4350 times) [2024-08-06 00:33:17,364][52650] InferenceWorker_p0-w0: resuming experience collection (4350 times) [2024-08-06 00:33:17,401][52663] DAMAGECOUNT value on done: 119179.0 [2024-08-06 00:33:17,403][52663] Sum rewards: 51.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.658', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.026', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.278', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.350', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '43.000'} [2024-08-06 00:33:17,709][52811] DAMAGECOUNT value on done: 109970.0 [2024-08-06 00:33:17,711][52811] Sum rewards: 47.026, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.227', 'ARMOR': '0.004', 'AMMO5': '0.011', 'weapon5': '0.038', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.542', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '2.816', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '45.000'} [2024-08-06 00:33:17,794][52567] Fps is (10 sec: 18847.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 192888832. Throughput: 0: 4396.9. Samples: 48220210. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:33:17,794][52567] Avg episode reward: [(0, '54.360')] [2024-08-06 00:33:17,979][52665] DAMAGECOUNT value on done: 121328.0 [2024-08-06 00:33:17,979][52665] Sum rewards: 51.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.103', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.078', 'weapon7': '0.098', 'AMMO4': '0.117', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '0.950', 'weapon3': '2.582', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '43.000'} [2024-08-06 00:33:18,880][52671] DAMAGECOUNT value on done: 117387.0 [2024-08-06 00:33:18,881][52671] Sum rewards: 52.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.157', 'ARMOR': '0.008', 'AMMO5': '0.014', 'weapon5': '0.058', 'AMMO2': '0.060', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'AMMO4': '0.301', 'weapon4': '0.350', 'weapon2': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.922', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '47.000'} [2024-08-06 00:33:19,579][52803] DAMAGECOUNT value on done: 110300.0 [2024-08-06 00:33:19,580][52803] Sum rewards: 70.893, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO3': '0.129', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.366', 'weapon2': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.830', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '57.000'} [2024-08-06 00:33:19,723][52659] DAMAGECOUNT value on done: 117794.0 [2024-08-06 00:33:19,724][52659] Sum rewards: 60.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.320', 'weapon4': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '2.972', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '52.000'} [2024-08-06 00:33:19,868][52670] DAMAGECOUNT value on done: 113993.0 [2024-08-06 00:33:19,871][52670] Sum rewards: 50.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.242', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.834', 'WEAPON3': '1.350', 'weapon3': '2.634', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '46.000'} [2024-08-06 00:33:20,163][52650] Updated weights for policy 0, policy_version 23551 (0.0025) [2024-08-06 00:33:20,252][52663] DAMAGECOUNT value on done: 118917.0 [2024-08-06 00:33:20,253][52663] Sum rewards: 59.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.161', 'AMMO3': '0.221', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:20,757][52811] DAMAGECOUNT value on done: 110147.0 [2024-08-06 00:33:20,758][52811] Sum rewards: 46.484, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.192', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.268', 'weapon2': '0.346', 'weapon4': '0.424', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '2.868', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '44.000'} [2024-08-06 00:33:21,202][52665] DAMAGECOUNT value on done: 117488.0 [2024-08-06 00:33:21,202][52665] Sum rewards: 50.112, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.314', 'HEALTH': '0.444', 'weapon2': '0.526', 'WEAPON3': '0.900', 'HITCOUNT': '2.880', 'weapon3': '2.974', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '40.000'} [2024-08-06 00:33:21,730][52671] DAMAGECOUNT value on done: 117561.0 [2024-08-06 00:33:21,733][52671] Sum rewards: 61.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.894', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.324', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '52.000'} [2024-08-06 00:33:22,589][52670] DAMAGECOUNT value on done: 113102.0 [2024-08-06 00:33:22,590][52670] Sum rewards: 52.167, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.704', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.205', 'AMMO3': '0.214', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.632', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '47.000'} [2024-08-06 00:33:22,650][52659] DAMAGECOUNT value on done: 118323.0 [2024-08-06 00:33:22,650][52659] Sum rewards: 67.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '56.000'} [2024-08-06 00:33:22,733][52803] DAMAGECOUNT value on done: 111970.0 [2024-08-06 00:33:22,734][52803] Sum rewards: 59.519, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.616', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'weapon4': '0.238', 'weapon2': '0.388', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.032', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 192970752. Throughput: 0: 4406.7. Samples: 48246750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:33:22,794][52567] Avg episode reward: [(0, '54.891')] [2024-08-06 00:33:23,038][52663] DAMAGECOUNT value on done: 120089.0 [2024-08-06 00:33:23,038][52663] Sum rewards: 56.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.516', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.213', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:23,764][52811] DAMAGECOUNT value on done: 109538.0 [2024-08-06 00:33:23,764][52811] Sum rewards: 53.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.202', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.662', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '47.000'} [2024-08-06 00:33:24,026][52665] DAMAGECOUNT value on done: 118039.0 [2024-08-06 00:33:24,026][52665] Sum rewards: 52.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.646', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.124', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.422', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '46.000'} [2024-08-06 00:33:24,955][52650] Updated weights for policy 0, policy_version 23561 (0.0021) [2024-08-06 00:33:24,998][52671] DAMAGECOUNT value on done: 123076.0 [2024-08-06 00:33:25,000][52671] Sum rewards: 72.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.464', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '59.000'} [2024-08-06 00:33:25,177][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:33:25,424][52663] DAMAGECOUNT value on done: 119397.0 [2024-08-06 00:33:25,425][52663] Sum rewards: 75.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.202', 'weapon4': '0.202', 'WEAPON3': '1.300', 'weapon3': '3.396', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '62.000'} [2024-08-06 00:33:25,751][52659] DAMAGECOUNT value on done: 117850.0 [2024-08-06 00:33:25,752][52659] Sum rewards: 64.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.260', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '54.000'} [2024-08-06 00:33:25,895][52803] DAMAGECOUNT value on done: 108783.0 [2024-08-06 00:33:25,896][52803] Sum rewards: 52.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.120', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '44.000'} [2024-08-06 00:33:26,854][52665] DAMAGECOUNT value on done: 117043.0 [2024-08-06 00:33:26,854][52665] Sum rewards: 63.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.047', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.234', 'WEAPON4': '0.450', 'weapon4': '0.498', 'weapon2': '0.752', 'WEAPON3': '1.000', 'weapon3': '2.450', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 00:33:26,867][52811] DAMAGECOUNT value on done: 111540.0 [2024-08-06 00:33:26,869][52811] Sum rewards: 57.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.879', 'AMMO5': '0.010', 'AMMO2': '0.061', 'weapon5': '0.096', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'AMMO4': '0.307', 'weapon2': '0.434', 'ARMOR': '0.508', 'WEAPON4': '0.700', 'weapon4': '0.754', 'WEAPON3': '1.400', 'weapon3': '2.446', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '52.000'} [2024-08-06 00:33:27,667][52671] DAMAGECOUNT value on done: 118047.0 [2024-08-06 00:33:27,670][52671] Sum rewards: 68.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'weapon4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.376', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 00:33:27,698][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:33:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 193052672. Throughput: 0: 4414.0. Samples: 48273430. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:33:27,794][52567] Avg episode reward: [(0, '55.380')] [2024-08-06 00:33:27,797][52614] Saving new best policy, reward=55.380! [2024-08-06 00:33:28,342][52663] DAMAGECOUNT value on done: 119362.0 [2024-08-06 00:33:28,343][52663] Sum rewards: 49.757, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.343', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO3': '0.147', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'weapon2': '0.386', 'ARMOR': '0.416', 'weapon4': '0.762', 'WEAPON3': '0.900', 'weapon3': '2.472', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.055', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:28,802][52659] DAMAGECOUNT value on done: 117749.0 [2024-08-06 00:33:28,802][52659] Sum rewards: 54.982, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.178', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.088', 'AMMO3': '0.148', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '0.950', 'HITCOUNT': '2.990', 'weapon3': '3.028', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '47.000'} [2024-08-06 00:33:28,973][52803] DAMAGECOUNT value on done: 107436.0 [2024-08-06 00:33:28,975][52803] Sum rewards: 55.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.160', 'weapon4': '0.222', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:29,429][52650] Updated weights for policy 0, policy_version 23571 (0.0024) [2024-08-06 00:33:29,945][52811] DAMAGECOUNT value on done: 111458.0 [2024-08-06 00:33:29,946][52811] Sum rewards: 54.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon4': '0.196', 'weapon2': '0.498', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.144', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '46.000'} [2024-08-06 00:33:30,081][52665] DAMAGECOUNT value on done: 116705.0 [2024-08-06 00:33:30,083][52665] Sum rewards: 53.484, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.154', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.170', 'AMMO3': '0.269', 'WEAPON4': '0.450', 'weapon2': '0.466', 'weapon4': '0.636', 'WEAPON3': '1.650', 'weapon3': '2.640', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '50.000'} [2024-08-06 00:33:30,767][52671] DAMAGECOUNT value on done: 115313.0 [2024-08-06 00:33:30,767][52671] Sum rewards: 56.572, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.911', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.213', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.590', 'WEAPON3': '1.250', 'weapon3': '2.550', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:30,861][52663] DAMAGECOUNT value on done: 116493.0 [2024-08-06 00:33:30,862][52663] Sum rewards: 48.590, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.444', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.152', 'AMMO3': '0.240', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.504', 'WEAPON3': '1.400', 'weapon3': '2.808', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '45.000'} [2024-08-06 00:33:31,897][52659] DAMAGECOUNT value on done: 119404.0 [2024-08-06 00:33:31,897][52659] Sum rewards: 46.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.186', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.770', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '40.000'} [2024-08-06 00:33:31,949][52803] DAMAGECOUNT value on done: 111279.0 [2024-08-06 00:33:31,950][52803] Sum rewards: 50.123, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.634', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.039', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'AMMO3': '0.325', 'weapon2': '0.348', 'weapon4': '0.616', 'WEAPON3': '1.900', 'weapon3': '2.788', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '47.000'} [2024-08-06 00:33:32,616][52665] DAMAGECOUNT value on done: 116177.0 [2024-08-06 00:33:32,618][52665] Sum rewards: 44.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.980', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.116', 'AMMO4': '0.163', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.454', 'WEAPON3': '1.650', 'HITCOUNT': '2.600', 'weapon3': '2.714', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 193150976. Throughput: 0: 4407.6. Samples: 48286230. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:33:32,794][52567] Avg episode reward: [(0, '55.025')] [2024-08-06 00:33:33,093][52811] DAMAGECOUNT value on done: 112622.0 [2024-08-06 00:33:33,101][52811] Sum rewards: 53.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.186', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.214', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON4': '0.650', 'weapon4': '0.678', 'WEAPON3': '1.250', 'weapon3': '2.352', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:33,580][52671] DAMAGECOUNT value on done: 121486.0 [2024-08-06 00:33:33,580][52671] Sum rewards: 66.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.898', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.157', 'AMMO3': '0.157', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '54.000'} [2024-08-06 00:33:34,196][52650] Updated weights for policy 0, policy_version 23581 (0.0024) [2024-08-06 00:33:34,361][52659] DAMAGECOUNT value on done: 113936.0 [2024-08-06 00:33:34,363][52659] Sum rewards: 57.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO2': '0.022', 'weapon4': '0.108', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.494', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.256', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:34,886][52665] DAMAGECOUNT value on done: 115815.0 [2024-08-06 00:33:34,886][52665] Sum rewards: 46.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.096', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'weapon2': '0.406', 'weapon4': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.760', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:34,983][52803] DAMAGECOUNT value on done: 110363.0 [2024-08-06 00:33:34,984][52803] Sum rewards: 34.066, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.246', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.096', 'AMMO3': '0.108', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON3': '0.750', 'weapon2': '0.818', 'HITCOUNT': '2.500', 'weapon3': '2.620', 'DAMAGECOUNT': '10.650', 'FRAGCOUNT': '26.000'} [2024-08-06 00:33:36,117][52811] DAMAGECOUNT value on done: 113124.0 [2024-08-06 00:33:36,118][52811] Sum rewards: 58.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'weapon4': '0.206', 'AMMO3': '0.221', 'weapon2': '0.794', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:36,136][52671] DAMAGECOUNT value on done: 117478.0 [2024-08-06 00:33:36,138][52671] Sum rewards: 57.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.262', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.142', 'AMMO3': '0.246', 'weapon2': '0.306', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '52.000'} [2024-08-06 00:33:36,883][52659] DAMAGECOUNT value on done: 116868.0 [2024-08-06 00:33:36,884][52659] Sum rewards: 42.832, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.668', 'AMMO5': '0.014', 'weapon5': '0.038', 'AMMO2': '0.042', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.212', 'AMMO3': '0.255', 'WEAPON5': '0.300', 'weapon4': '0.444', 'WEAPON4': '0.500', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '2.676', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.918', 'FRAGCOUNT': '40.000'} [2024-08-06 00:33:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 193232896. Throughput: 0: 4415.6. Samples: 48312940. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 00:33:37,794][52567] Avg episode reward: [(0, '54.877')] [2024-08-06 00:33:37,942][52803] DAMAGECOUNT value on done: 112205.0 [2024-08-06 00:33:37,942][52803] Sum rewards: 45.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.063', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon4': '0.270', 'AMMO4': '0.317', 'WEAPON4': '0.450', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '38.500'} [2024-08-06 00:33:38,027][52665] DAMAGECOUNT value on done: 114116.0 [2024-08-06 00:33:38,027][52665] Sum rewards: 67.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.072', 'AMMO4': '0.080', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.202', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '56.000'} [2024-08-06 00:33:38,666][52671] DAMAGECOUNT value on done: 118429.0 [2024-08-06 00:33:38,666][52671] Sum rewards: 53.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.925', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'weapon2': '0.316', 'WEAPON3': '1.600', 'HITCOUNT': '2.960', 'weapon3': '3.378', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:38,679][52650] Updated weights for policy 0, policy_version 23591 (0.0011) [2024-08-06 00:33:39,185][52811] DAMAGECOUNT value on done: 109759.0 [2024-08-06 00:33:39,186][52811] Sum rewards: 46.682, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.652', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.225', 'AMMO3': '0.232', 'weapon4': '0.268', 'WEAPON4': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '2.840', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '44.000'} [2024-08-06 00:33:39,432][52659] DAMAGECOUNT value on done: 119618.0 [2024-08-06 00:33:39,434][52659] Sum rewards: 54.482, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.638', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.734', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.892', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '45.000'} [2024-08-06 00:33:40,476][52665] DAMAGECOUNT value on done: 115347.0 [2024-08-06 00:33:40,476][52665] Sum rewards: 52.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.286', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '2.896', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '43.000'} [2024-08-06 00:33:40,982][52803] DAMAGECOUNT value on done: 106879.0 [2024-08-06 00:33:40,982][52803] Sum rewards: 52.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon7': '0.070', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.330', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '45.000'} [2024-08-06 00:33:41,414][52671] DAMAGECOUNT value on done: 118202.0 [2024-08-06 00:33:41,414][52671] Sum rewards: 48.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.624', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.222', 'weapon2': '0.396', 'WEAPON4': '0.600', 'weapon4': '1.092', 'WEAPON3': '1.200', 'weapon3': '2.148', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '42.500'} [2024-08-06 00:33:42,103][52659] DAMAGECOUNT value on done: 116734.0 [2024-08-06 00:33:42,103][52659] Sum rewards: 53.466, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.041', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.204', 'weapon5': '0.264', 'AMMO4': '0.271', 'weapon4': '0.392', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.536', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '47.000'} [2024-08-06 00:33:42,130][52811] DAMAGECOUNT value on done: 113531.0 [2024-08-06 00:33:42,132][52811] Sum rewards: 56.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.206', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.022', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.215', 'weapon2': '0.744', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '49.000'} [2024-08-06 00:33:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 193323008. Throughput: 0: 4422.0. Samples: 48339350. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:33:42,794][52567] Avg episode reward: [(0, '54.609')] [2024-08-06 00:33:42,885][52665] DAMAGECOUNT value on done: 111217.0 [2024-08-06 00:33:42,885][52665] Sum rewards: 63.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.338', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO3': '0.185', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.878', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '52.500'} [2024-08-06 00:33:43,410][52650] Updated weights for policy 0, policy_version 23601 (0.0018) [2024-08-06 00:33:43,895][52671] DAMAGECOUNT value on done: 117449.0 [2024-08-06 00:33:43,903][52671] Sum rewards: 57.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.914', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.434', 'weapon2': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:44,918][52659] DAMAGECOUNT value on done: 113176.0 [2024-08-06 00:33:44,919][52659] Sum rewards: 58.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.431', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.146', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:45,080][52811] DAMAGECOUNT value on done: 110519.0 [2024-08-06 00:33:45,081][52811] Sum rewards: 59.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.064', 'AMMO4': '0.097', 'weapon5': '0.106', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.786', 'WEAPON3': '1.050', 'weapon3': '2.764', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '50.000'} [2024-08-06 00:33:45,671][52665] DAMAGECOUNT value on done: 114041.0 [2024-08-06 00:33:45,675][52665] Sum rewards: 60.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:47,779][52659] DAMAGECOUNT value on done: 113164.0 [2024-08-06 00:33:47,779][52659] Sum rewards: 41.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.709', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.041', 'AMMO3': '0.166', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.700', 'weapon4': '0.908', 'WEAPON3': '0.950', 'weapon3': '2.124', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.051', 'FRAGCOUNT': '37.000'} [2024-08-06 00:33:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 193413120. Throughput: 0: 4424.7. Samples: 48352790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:33:47,794][52567] Avg episode reward: [(0, '54.700')] [2024-08-06 00:33:48,041][52650] Updated weights for policy 0, policy_version 23611 (0.0049) [2024-08-06 00:33:48,233][52811] DAMAGECOUNT value on done: 112210.0 [2024-08-06 00:33:48,235][52811] Sum rewards: 65.285, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.844', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO3': '0.136', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.322', 'weapon2': '0.676', 'WEAPON3': '0.900', 'weapon3': '2.678', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '51.000'} [2024-08-06 00:33:48,323][52665] DAMAGECOUNT value on done: 114726.0 [2024-08-06 00:33:48,325][52665] Sum rewards: 49.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.353', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.046', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'AMMO4': '0.232', 'weapon4': '0.300', 'weapon5': '0.304', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '2.540', 'weapon3': '2.712', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '41.000'} [2024-08-06 00:33:50,447][52659] DAMAGECOUNT value on done: 120754.0 [2024-08-06 00:33:50,447][52659] Sum rewards: 68.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.167', 'weapon4': '0.244', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '56.000'} [2024-08-06 00:33:52,740][52650] Updated weights for policy 0, policy_version 23621 (0.0020) [2024-08-06 00:33:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 193503232. Throughput: 0: 4417.9. Samples: 48379180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:33:52,794][52567] Avg episode reward: [(0, '54.742')] [2024-08-06 00:33:53,620][52659] DAMAGECOUNT value on done: 118488.0 [2024-08-06 00:33:53,620][52659] Sum rewards: 58.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.054', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.952', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '48.000'} [2024-08-06 00:33:56,193][52659] DAMAGECOUNT value on done: 122677.0 [2024-08-06 00:33:56,202][52659] Sum rewards: 33.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.176', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon2': '0.636', 'weapon4': '0.770', 'WEAPON3': '1.100', 'weapon3': '2.100', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '11.001', 'FRAGCOUNT': '29.000'} [2024-08-06 00:33:56,796][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:33:57,511][52650] Updated weights for policy 0, policy_version 23631 (0.0035) [2024-08-06 00:33:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 193593344. Throughput: 0: 4412.0. Samples: 48405510. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 00:33:57,794][52567] Avg episode reward: [(0, '54.580')] [2024-08-06 00:33:59,369][52659] DAMAGECOUNT value on done: 119073.0 [2024-08-06 00:33:59,369][52659] Sum rewards: 43.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.209', 'weapon2': '0.524', 'WEAPON3': '1.350', 'HITCOUNT': '2.660', 'weapon3': '3.146', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '38.000'} [2024-08-06 00:33:59,377][52670] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 00:34:01,683][52650] Updated weights for policy 0, policy_version 23641 (0.0032) [2024-08-06 00:34:02,074][52659] DAMAGECOUNT value on done: 117452.0 [2024-08-06 00:34:02,075][52659] Sum rewards: 44.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.046', 'AMMO3': '0.181', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.328', 'WEAPON4': '0.450', 'weapon2': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.680', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.075', 'FRAGCOUNT': '37.000'} [2024-08-06 00:34:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 193675264. Throughput: 0: 4412.5. Samples: 48418770. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 00:34:02,794][52567] Avg episode reward: [(0, '54.371')] [2024-08-06 00:34:04,523][52662] DAMAGECOUNT value on done: 123684.0 [2024-08-06 00:34:04,525][52662] Sum rewards: 49.660, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.310', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.250', 'weapon2': '0.270', 'AMMO3': '0.277', 'weapon4': '0.374', 'WEAPON3': '1.700', 'HITCOUNT': '2.990', 'weapon3': '2.992', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '47.000'} [2024-08-06 00:34:04,756][52659] DAMAGECOUNT value on done: 121979.0 [2024-08-06 00:34:04,757][52659] Sum rewards: 52.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'weapon4': '0.324', 'weapon2': '0.442', 'WEAPON3': '1.600', 'HITCOUNT': '2.820', 'weapon3': '2.962', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '48.000'} [2024-08-06 00:34:06,826][52650] Updated weights for policy 0, policy_version 23651 (0.0020) [2024-08-06 00:34:07,609][52662] DAMAGECOUNT value on done: 125475.0 [2024-08-06 00:34:07,611][52662] Sum rewards: 52.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.022', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.558', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '2.782', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '44.500'} [2024-08-06 00:34:07,658][52659] DAMAGECOUNT value on done: 121051.0 [2024-08-06 00:34:07,658][52659] Sum rewards: 62.209, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.026', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.179', 'HEALTH': '0.330', 'weapon2': '0.658', 'WEAPON3': '1.000', 'weapon3': '3.074', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '51.000'} [2024-08-06 00:34:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17750.3, 300 sec: 17578.1). Total num frames: 193765376. Throughput: 0: 4408.7. Samples: 48445140. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 00:34:07,794][52567] Avg episode reward: [(0, '54.176')] [2024-08-06 00:34:09,200][52668] DAMAGECOUNT value on done: 117706.0 [2024-08-06 00:34:09,200][52668] Sum rewards: 49.668, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.461', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.060', 'AMMO3': '0.128', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.400', 'weapon2': '0.678', 'WEAPON3': '0.900', 'HITCOUNT': '2.590', 'weapon3': '2.892', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '41.000'} [2024-08-06 00:34:10,768][52662] DAMAGECOUNT value on done: 127580.0 [2024-08-06 00:34:10,771][52662] Sum rewards: 53.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.491', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.436', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '48.000'} [2024-08-06 00:34:11,405][52650] Updated weights for policy 0, policy_version 23661 (0.0011) [2024-08-06 00:34:11,963][52668] DAMAGECOUNT value on done: 124006.0 [2024-08-06 00:34:11,963][52668] Sum rewards: 46.321, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.562', 'ARMOR': '0.004', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.522', 'WEAPON3': '1.750', 'weapon3': '2.842', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '43.000'} [2024-08-06 00:34:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 193855488. Throughput: 0: 4404.7. Samples: 48471640. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:34:12,794][52567] Avg episode reward: [(0, '54.087')] [2024-08-06 00:34:13,862][52662] DAMAGECOUNT value on done: 118457.0 [2024-08-06 00:34:13,864][52662] Sum rewards: 59.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.997', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.072', 'AMMO3': '0.126', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.360', 'weapon2': '0.564', 'WEAPON4': '0.800', 'WEAPON3': '0.800', 'weapon4': '1.058', 'weapon3': '1.956', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:14,791][52668] DAMAGECOUNT value on done: 119651.0 [2024-08-06 00:34:14,792][52668] Sum rewards: 64.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.839', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.024', 'weapon4': '0.066', 'AMMO4': '0.072', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '54.000'} [2024-08-06 00:34:15,990][52650] Updated weights for policy 0, policy_version 23671 (0.0027) [2024-08-06 00:34:16,463][52662] DAMAGECOUNT value on done: 124476.0 [2024-08-06 00:34:16,465][52662] Sum rewards: 62.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.219', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.388', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '52.000'} [2024-08-06 00:34:17,386][52794] DAMAGECOUNT value on done: 126301.0 [2024-08-06 00:34:17,394][52794] Sum rewards: 43.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.669', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.094', 'AMMO3': '0.175', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON4': '0.550', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.594', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '38.500'} [2024-08-06 00:34:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 193937408. Throughput: 0: 4409.1. Samples: 48484640. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:34:17,794][52567] Avg episode reward: [(0, '54.324')] [2024-08-06 00:34:17,952][52668] DAMAGECOUNT value on done: 118501.0 [2024-08-06 00:34:17,953][52668] Sum rewards: 43.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.156', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.303', 'weapon2': '0.452', 'weapon4': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.698', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '41.000'} [2024-08-06 00:34:19,301][52662] DAMAGECOUNT value on done: 124750.0 [2024-08-06 00:34:19,301][52662] Sum rewards: 49.917, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.714', 'ARMOR': '0.024', 'AMMO2': '0.040', 'AMMO3': '0.125', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'weapon4': '0.540', 'weapon2': '0.656', 'WEAPON3': '0.750', 'weapon3': '2.468', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '41.000'} [2024-08-06 00:34:20,376][52794] DAMAGECOUNT value on done: 125037.0 [2024-08-06 00:34:20,376][52794] Sum rewards: 60.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO2': '0.021', 'weapon4': '0.068', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.251', 'weapon2': '0.622', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.128', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '53.000'} [2024-08-06 00:34:20,527][52650] Updated weights for policy 0, policy_version 23681 (0.0013) [2024-08-06 00:34:20,630][52668] DAMAGECOUNT value on done: 119135.0 [2024-08-06 00:34:20,632][52668] Sum rewards: 48.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.174', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '1.004', 'WEAPON3': '1.050', 'weapon3': '2.540', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '40.000'} [2024-08-06 00:34:21,562][52660] DAMAGECOUNT value on done: 116652.0 [2024-08-06 00:34:21,563][52660] Sum rewards: 49.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.159', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.532', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '42.000'} [2024-08-06 00:34:22,132][52662] DAMAGECOUNT value on done: 123926.0 [2024-08-06 00:34:22,133][52662] Sum rewards: 59.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.227', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'weapon5': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.183', 'weapon4': '0.196', 'weapon2': '0.298', 'WEAPON3': '1.050', 'weapon3': '3.006', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:22,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 194027520. Throughput: 0: 4404.8. Samples: 48511160. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:34:22,795][52567] Avg episode reward: [(0, '54.295')] [2024-08-06 00:34:23,194][52794] DAMAGECOUNT value on done: 119821.0 [2024-08-06 00:34:23,197][52794] Sum rewards: 53.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.167', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '44.000'} [2024-08-06 00:34:23,374][52668] DAMAGECOUNT value on done: 116387.0 [2024-08-06 00:34:23,375][52668] Sum rewards: 52.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.830', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.624', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '2.970', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '45.000'} [2024-08-06 00:34:23,495][52795] DAMAGECOUNT value on done: 109652.0 [2024-08-06 00:34:23,495][52795] Sum rewards: 66.789, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.994', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.238', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '57.000'} [2024-08-06 00:34:24,602][52660] DAMAGECOUNT value on done: 119881.0 [2024-08-06 00:34:24,603][52660] Sum rewards: 44.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.617', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.130', 'AMMO4': '0.142', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.660', 'WEAPON3': '0.800', 'HITCOUNT': '2.520', 'weapon3': '2.874', 'DAMAGECOUNT': '10.776', 'FRAGCOUNT': '36.000'} [2024-08-06 00:34:25,171][52662] DAMAGECOUNT value on done: 129211.0 [2024-08-06 00:34:25,172][52662] Sum rewards: 49.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.008', 'AMMO2': '0.054', 'weapon5': '0.112', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'weapon2': '0.504', 'weapon4': '0.512', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.608', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.315', 'FRAGCOUNT': '42.000'} [2024-08-06 00:34:25,458][52650] Updated weights for policy 0, policy_version 23691 (0.0039) [2024-08-06 00:34:26,365][52794] DAMAGECOUNT value on done: 118387.0 [2024-08-06 00:34:26,366][52794] Sum rewards: 64.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO2': '0.026', 'weapon4': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.400', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '56.000'} [2024-08-06 00:34:26,417][52668] DAMAGECOUNT value on done: 120287.0 [2024-08-06 00:34:26,420][52668] Sum rewards: 48.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.444', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '41.000'} [2024-08-06 00:34:26,684][52795] DAMAGECOUNT value on done: 107385.0 [2024-08-06 00:34:26,685][52795] Sum rewards: 66.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.244', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.374', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '56.000'} [2024-08-06 00:34:27,624][52660] DAMAGECOUNT value on done: 120352.0 [2024-08-06 00:34:27,625][52660] Sum rewards: 49.554, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.835', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.047', 'weapon5': '0.152', 'AMMO3': '0.232', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON4': '0.500', 'weapon2': '0.584', 'WEAPON3': '1.500', 'weapon3': '2.568', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '47.000'} [2024-08-06 00:34:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 194117632. Throughput: 0: 4398.0. Samples: 48537260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:34:27,794][52567] Avg episode reward: [(0, '54.461')] [2024-08-06 00:34:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023696_194117632.pth... [2024-08-06 00:34:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023182_189906944.pth [2024-08-06 00:34:28,450][52662] DAMAGECOUNT value on done: 123832.0 [2024-08-06 00:34:28,450][52662] Sum rewards: 64.913, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.845', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.382', 'weapon2': '0.434', 'WEAPON3': '1.000', 'weapon3': '3.074', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '52.000'} [2024-08-06 00:34:28,584][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:34:29,305][52668] DAMAGECOUNT value on done: 122072.0 [2024-08-06 00:34:29,307][52668] Sum rewards: 47.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.760', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.197', 'weapon2': '0.888', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.898', 'DAMAGECOUNT': '11.190', 'FRAGCOUNT': '40.000'} [2024-08-06 00:34:29,413][52794] DAMAGECOUNT value on done: 122801.0 [2024-08-06 00:34:29,413][52794] Sum rewards: 59.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.147', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'weapon4': '0.270', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'weapon2': '0.782', 'WEAPON3': '1.650', 'weapon3': '2.650', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '53.000'} [2024-08-06 00:34:30,051][52650] Updated weights for policy 0, policy_version 23701 (0.0017) [2024-08-06 00:34:30,053][52795] DAMAGECOUNT value on done: 107989.0 [2024-08-06 00:34:30,054][52795] Sum rewards: 60.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.458', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.084', 'AMMO3': '0.142', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.564', 'WEAPON3': '0.800', 'weapon3': '2.766', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '48.000'} [2024-08-06 00:34:30,421][52660] DAMAGECOUNT value on done: 120297.0 [2024-08-06 00:34:30,422][52660] Sum rewards: 38.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.941', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.070', 'weapon5': '0.098', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.014', 'DAMAGECOUNT': '12.207', 'FRAGCOUNT': '36.000'} [2024-08-06 00:34:31,288][52662] DAMAGECOUNT value on done: 126568.0 [2024-08-06 00:34:31,292][52662] Sum rewards: 55.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.512', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.020', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '46.000'} [2024-08-06 00:34:31,924][52668] DAMAGECOUNT value on done: 119823.0 [2024-08-06 00:34:31,925][52668] Sum rewards: 48.073, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'weapon4': '0.178', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.054', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '44.000'} [2024-08-06 00:34:32,433][52794] DAMAGECOUNT value on done: 123036.0 [2024-08-06 00:34:32,433][52794] Sum rewards: 48.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.362', 'weapon4': '0.638', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.866', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '41.000'} [2024-08-06 00:34:32,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 194199552. Throughput: 0: 4383.1. Samples: 48550030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:34:32,794][52567] Avg episode reward: [(0, '54.382')] [2024-08-06 00:34:32,964][52660] DAMAGECOUNT value on done: 116646.0 [2024-08-06 00:34:32,964][52660] Sum rewards: 40.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.266', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.046', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'AMMO3': '0.241', 'weapon4': '0.460', 'WEAPON4': '0.500', 'weapon2': '0.534', 'WEAPON3': '1.350', 'HITCOUNT': '2.450', 'weapon3': '2.592', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '37.000'} [2024-08-06 00:34:33,188][52795] DAMAGECOUNT value on done: 109023.0 [2024-08-06 00:34:33,190][52795] Sum rewards: 54.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.089', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'AMMO4': '0.199', 'weapon4': '0.446', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '47.000'} [2024-08-06 00:34:34,405][52662] DAMAGECOUNT value on done: 122302.0 [2024-08-06 00:34:34,406][52662] Sum rewards: 47.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.082', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.178', 'AMMO3': '0.187', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.422', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '41.000'} [2024-08-06 00:34:34,673][52650] Updated weights for policy 0, policy_version 23711 (0.0031) [2024-08-06 00:34:34,971][52668] DAMAGECOUNT value on done: 120926.0 [2024-08-06 00:34:34,975][52668] Sum rewards: 39.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'weapon2': '0.518', 'weapon4': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.412', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.478', 'FRAGCOUNT': '38.000'} [2024-08-06 00:34:35,316][52794] DAMAGECOUNT value on done: 128049.0 [2024-08-06 00:34:35,317][52794] Sum rewards: 64.378, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.859', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.149', 'weapon2': '0.638', 'WEAPON3': '0.950', 'weapon3': '3.170', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '51.000'} [2024-08-06 00:34:35,520][52667] DAMAGECOUNT value on done: 121880.0 [2024-08-06 00:34:35,523][52667] Sum rewards: 68.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.593', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 00:34:36,125][52660] DAMAGECOUNT value on done: 115826.0 [2024-08-06 00:34:36,133][52660] Sum rewards: 42.601, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.986', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.282', 'weapon4': '0.322', 'weapon2': '0.608', 'WEAPON3': '0.900', 'HITCOUNT': '2.310', 'weapon3': '2.448', 'DAMAGECOUNT': '10.509', 'FRAGCOUNT': '36.000'} [2024-08-06 00:34:36,284][52795] DAMAGECOUNT value on done: 112549.0 [2024-08-06 00:34:36,284][52795] Sum rewards: 62.310, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.606', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '56.000'} [2024-08-06 00:34:37,090][52662] DAMAGECOUNT value on done: 124744.0 [2024-08-06 00:34:37,090][52662] Sum rewards: 45.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.030', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon5': '0.244', 'WEAPON3': '0.750', 'weapon2': '0.772', 'HITCOUNT': '2.390', 'weapon3': '2.584', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '37.000'} [2024-08-06 00:34:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 194289664. Throughput: 0: 4385.8. Samples: 48576540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:34:37,794][52567] Avg episode reward: [(0, '54.105')] [2024-08-06 00:34:37,929][52668] DAMAGECOUNT value on done: 118521.0 [2024-08-06 00:34:37,929][52668] Sum rewards: 54.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'ARMOR': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.188', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '47.000'} [2024-08-06 00:34:37,956][52794] DAMAGECOUNT value on done: 123712.0 [2024-08-06 00:34:37,958][52794] Sum rewards: 59.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.058', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.408', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.276', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '52.000'} [2024-08-06 00:34:38,302][52667] DAMAGECOUNT value on done: 121465.0 [2024-08-06 00:34:38,303][52667] Sum rewards: 41.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.644', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.055', 'AMMO3': '0.173', 'weapon5': '0.176', 'AMMO4': '0.274', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.570', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '2.746', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '37.000'} [2024-08-06 00:34:38,988][52660] DAMAGECOUNT value on done: 120620.0 [2024-08-06 00:34:38,988][52660] Sum rewards: 49.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.160', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'AMMO4': '0.261', 'weapon4': '0.438', 'WEAPON4': '0.500', 'weapon2': '0.748', 'WEAPON3': '0.950', 'weapon3': '2.390', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '40.000'} [2024-08-06 00:34:39,128][52650] Updated weights for policy 0, policy_version 23721 (0.0010) [2024-08-06 00:34:39,454][52662] DAMAGECOUNT value on done: 122209.0 [2024-08-06 00:34:39,454][52662] Sum rewards: 51.219, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'HEALTH': '0.110', 'AMMO4': '0.124', 'AMMO3': '0.140', 'WEAPON4': '0.300', 'weapon4': '0.488', 'weapon2': '0.620', 'WEAPON3': '0.750', 'weapon3': '2.712', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '41.000'} [2024-08-06 00:34:39,514][52795] DAMAGECOUNT value on done: 111902.0 [2024-08-06 00:34:39,515][52795] Sum rewards: 64.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.148', 'AMMO3': '0.210', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '55.000'} [2024-08-06 00:34:40,284][52794] DAMAGECOUNT value on done: 124237.0 [2024-08-06 00:34:40,285][52794] Sum rewards: 61.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.980', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.202', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '52.000'} [2024-08-06 00:34:40,911][52668] DAMAGECOUNT value on done: 117747.0 [2024-08-06 00:34:40,912][52668] Sum rewards: 42.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.200', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.112', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'weapon4': '0.312', 'weapon2': '0.520', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.360', 'weapon3': '2.874', 'DAMAGECOUNT': '11.226', 'FRAGCOUNT': '38.000'} [2024-08-06 00:34:41,200][52667] DAMAGECOUNT value on done: 121744.0 [2024-08-06 00:34:41,212][52667] Sum rewards: 57.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.868', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.196', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.200', 'weapon3': '3.344', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '50.000'} [2024-08-06 00:34:42,019][52669] DAMAGECOUNT value on done: 122936.0 [2024-08-06 00:34:42,019][52669] Sum rewards: 54.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.042', 'AMMO3': '0.185', 'AMMO4': '0.211', 'weapon4': '0.332', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '47.000'} [2024-08-06 00:34:42,131][52660] DAMAGECOUNT value on done: 119769.0 [2024-08-06 00:34:42,133][52662] DAMAGECOUNT value on done: 121865.0 [2024-08-06 00:34:42,135][52662] Sum rewards: 50.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.928', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.150', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.294', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '2.864', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '44.000'} [2024-08-06 00:34:42,134][52660] Sum rewards: 54.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.958', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.136', 'AMMO3': '0.198', 'AMMO4': '0.275', 'weapon4': '0.372', 'WEAPON5': '0.450', 'weapon2': '0.570', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.606', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:42,583][52795] DAMAGECOUNT value on done: 114778.0 [2024-08-06 00:34:42,585][52795] Sum rewards: 52.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.906', 'AMMO5': '0.011', 'ARMOR': '0.024', 'AMMO2': '0.051', 'weapon5': '0.102', 'AMMO3': '0.135', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.666', 'weapon4': '0.684', 'WEAPON3': '0.900', 'weapon3': '2.272', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '44.000'} [2024-08-06 00:34:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 194379776. Throughput: 0: 4386.7. Samples: 48602910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:34:42,795][52567] Avg episode reward: [(0, '53.395')] [2024-08-06 00:34:42,893][52794] DAMAGECOUNT value on done: 129175.0 [2024-08-06 00:34:42,895][52794] Sum rewards: 60.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.627', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'weapon2': '0.606', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '54.000'} [2024-08-06 00:34:43,951][52668] DAMAGECOUNT value on done: 112302.0 [2024-08-06 00:34:43,951][52668] Sum rewards: 52.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.335', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '3.098', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '43.000'} [2024-08-06 00:34:44,025][52650] Updated weights for policy 0, policy_version 23731 (0.0024) [2024-08-06 00:34:44,483][52667] DAMAGECOUNT value on done: 119540.0 [2024-08-06 00:34:44,485][52667] Sum rewards: 56.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.216', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '47.000'} [2024-08-06 00:34:44,513][52662] DAMAGECOUNT value on done: 121109.0 [2024-08-06 00:34:44,515][52662] Sum rewards: 59.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.663', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.162', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.160', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '54.000'} [2024-08-06 00:34:44,764][52669] DAMAGECOUNT value on done: 120601.0 [2024-08-06 00:34:44,765][52669] Sum rewards: 44.152, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.647', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.046', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'AMMO3': '0.236', 'weapon4': '0.424', 'weapon2': '0.488', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.782', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '40.000'} [2024-08-06 00:34:45,312][52660] DAMAGECOUNT value on done: 119167.0 [2024-08-06 00:34:45,316][52660] Sum rewards: 41.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.266', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.234', 'WEAPON4': '0.600', 'weapon2': '0.618', 'weapon4': '0.670', 'WEAPON3': '0.800', 'weapon3': '2.366', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.764', 'FRAGCOUNT': '38.000'} [2024-08-06 00:34:45,418][52794] DAMAGECOUNT value on done: 121294.0 [2024-08-06 00:34:45,420][52794] Sum rewards: 46.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon7': '0.074', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON4': '0.550', 'weapon4': '0.948', 'WEAPON3': '1.250', 'weapon3': '1.884', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '39.000'} [2024-08-06 00:34:45,695][52795] DAMAGECOUNT value on done: 112731.0 [2024-08-06 00:34:45,698][52795] Sum rewards: 64.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2024-08-06 00:34:47,073][52668] DAMAGECOUNT value on done: 119350.0 [2024-08-06 00:34:47,074][52668] Sum rewards: 40.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.222', 'weapon4': '0.346', 'WEAPON4': '0.550', 'weapon2': '0.638', 'WEAPON3': '1.150', 'HITCOUNT': '2.590', 'weapon3': '2.796', 'DAMAGECOUNT': '11.703', 'FRAGCOUNT': '38.000'} [2024-08-06 00:34:47,181][52662] DAMAGECOUNT value on done: 128210.0 [2024-08-06 00:34:47,182][52662] Sum rewards: 57.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.989', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.208', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '48.000'} [2024-08-06 00:34:47,260][52667] DAMAGECOUNT value on done: 121214.0 [2024-08-06 00:34:47,260][52667] Sum rewards: 51.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.589', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.400', 'weapon4': '0.616', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '2.430', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '45.000'} [2024-08-06 00:34:47,688][52669] DAMAGECOUNT value on done: 119082.0 [2024-08-06 00:34:47,689][52669] Sum rewards: 55.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.105', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.190', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.538', 'weapon4': '0.642', 'WEAPON3': '1.350', 'weapon3': '2.562', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 194469888. Throughput: 0: 4385.6. Samples: 48616120. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:34:47,794][52567] Avg episode reward: [(0, '53.109')] [2024-08-06 00:34:48,158][52660] DAMAGECOUNT value on done: 120516.0 [2024-08-06 00:34:48,158][52660] Sum rewards: 60.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.359', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.118', 'weapon2': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon4': '0.396', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.114', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '52.000'} [2024-08-06 00:34:48,248][52794] DAMAGECOUNT value on done: 125880.0 [2024-08-06 00:34:48,248][52794] Sum rewards: 57.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.505', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.176', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.418', 'WEAPON3': '1.500', 'weapon3': '2.876', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '52.000'} [2024-08-06 00:34:48,733][52671] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 00:34:48,804][52650] Updated weights for policy 0, policy_version 23741 (0.0034) [2024-08-06 00:34:48,898][52795] DAMAGECOUNT value on done: 108670.0 [2024-08-06 00:34:48,899][52795] Sum rewards: 48.524, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.050', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.496', 'WEAPON4': '0.500', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.644', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '44.000'} [2024-08-06 00:34:49,763][52668] DAMAGECOUNT value on done: 117048.0 [2024-08-06 00:34:49,764][52668] Sum rewards: 41.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.636', 'weapon2': '0.666', 'WEAPON3': '0.900', 'weapon3': '2.306', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.458', 'FRAGCOUNT': '33.000'} [2024-08-06 00:34:50,205][52667] DAMAGECOUNT value on done: 118071.0 [2024-08-06 00:34:50,205][52667] Sum rewards: 61.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.429', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.400', 'weapon3': '2.778', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '55.000'} [2024-08-06 00:34:50,251][52662] DAMAGECOUNT value on done: 118605.0 [2024-08-06 00:34:50,251][52662] Sum rewards: 59.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.944', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.226', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:50,528][52669] DAMAGECOUNT value on done: 119263.0 [2024-08-06 00:34:50,530][52669] Sum rewards: 61.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.796', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'AMMO4': '0.253', 'weapon4': '0.366', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '52.000'} [2024-08-06 00:34:50,874][52660] DAMAGECOUNT value on done: 121930.0 [2024-08-06 00:34:50,874][52660] Sum rewards: 65.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.202', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 00:34:51,309][52794] DAMAGECOUNT value on done: 122808.0 [2024-08-06 00:34:51,311][52794] Sum rewards: 52.847, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.891', 'AMMO5': '0.007', 'ARMOR': '0.024', 'weapon5': '0.038', 'AMMO2': '0.047', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'AMMO4': '0.235', 'weapon2': '0.384', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.930', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:52,211][52795] DAMAGECOUNT value on done: 112085.0 [2024-08-06 00:34:52,219][52795] Sum rewards: 47.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.020', 'weapon5': '0.048', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.550', 'weapon4': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '42.000'} [2024-08-06 00:34:52,215][52668] DAMAGECOUNT value on done: 121337.0 [2024-08-06 00:34:52,220][52668] Sum rewards: 66.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO2': '0.022', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.190', 'weapon2': '0.216', 'WEAPON3': '1.150', 'HITCOUNT': '3.440', 'weapon3': '3.626', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '54.000'} [2024-08-06 00:34:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 194551808. Throughput: 0: 4381.8. Samples: 48642320. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:34:52,794][52567] Avg episode reward: [(0, '53.602')] [2024-08-06 00:34:53,156][52662] DAMAGECOUNT value on done: 124815.0 [2024-08-06 00:34:53,157][52662] Sum rewards: 48.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.211', 'weapon4': '0.214', 'WEAPON4': '0.500', 'weapon2': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '43.000'} [2024-08-06 00:34:53,343][52650] Updated weights for policy 0, policy_version 23751 (0.0013) [2024-08-06 00:34:53,361][52667] DAMAGECOUNT value on done: 122515.0 [2024-08-06 00:34:53,363][52667] Sum rewards: 55.486, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.058', 'weapon5': '0.070', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.228', 'AMMO4': '0.288', 'WEAPON4': '0.600', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:53,472][52664] DAMAGECOUNT value on done: 123672.0 [2024-08-06 00:34:53,472][52664] Sum rewards: 60.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.231', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '53.000'} [2024-08-06 00:34:53,519][52669] DAMAGECOUNT value on done: 120354.0 [2024-08-06 00:34:53,522][52669] Sum rewards: 56.923, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.602', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon7': '0.048', 'AMMO4': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.410', 'weapon2': '0.722', 'WEAPON3': '0.950', 'weapon3': '2.240', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '46.000'} [2024-08-06 00:34:53,536][52660] DAMAGECOUNT value on done: 115955.0 [2024-08-06 00:34:53,537][52660] Sum rewards: 58.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '50.000'} [2024-08-06 00:34:54,144][52794] DAMAGECOUNT value on done: 131570.0 [2024-08-06 00:34:54,145][52794] Sum rewards: 56.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.234', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:55,251][52668] DAMAGECOUNT value on done: 118116.0 [2024-08-06 00:34:55,253][52668] Sum rewards: 59.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.221', 'weapon2': '0.482', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.230', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '51.000'} [2024-08-06 00:34:55,283][52795] DAMAGECOUNT value on done: 111213.0 [2024-08-06 00:34:55,283][52795] Sum rewards: 50.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.050', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '43.500'} [2024-08-06 00:34:56,146][52660] DAMAGECOUNT value on done: 116477.0 [2024-08-06 00:34:56,147][52660] Sum rewards: 39.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.770', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.116', 'weapon4': '0.232', 'AMMO3': '0.237', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.400', 'weapon3': '2.964', 'DAMAGECOUNT': '11.247', 'FRAGCOUNT': '39.000'} [2024-08-06 00:34:56,193][52668] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:34:56,209][52662] DAMAGECOUNT value on done: 120770.0 [2024-08-06 00:34:56,211][52662] Sum rewards: 62.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'WEAPON5': '0.050', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon4': '0.238', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '53.000'} [2024-08-06 00:34:56,232][52664] DAMAGECOUNT value on done: 124098.0 [2024-08-06 00:34:56,233][52664] Sum rewards: 71.491, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'HEALTH': '0.218', 'weapon2': '0.568', 'WEAPON3': '0.900', 'weapon3': '3.150', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '57.000'} [2024-08-06 00:34:56,381][52667] DAMAGECOUNT value on done: 120368.0 [2024-08-06 00:34:56,381][52667] Sum rewards: 41.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.203', 'ARMOR': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.160', 'AMMO4': '0.277', 'weapon2': '0.334', 'WEAPON4': '0.500', 'weapon4': '0.796', 'WEAPON3': '1.050', 'weapon3': '2.668', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '34.000'} [2024-08-06 00:34:56,605][52669] DAMAGECOUNT value on done: 118381.0 [2024-08-06 00:34:56,605][52669] Sum rewards: 42.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.510', 'weapon4': '0.572', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '2.714', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '36.000'} [2024-08-06 00:34:56,780][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:34:57,335][52794] DAMAGECOUNT value on done: 119114.0 [2024-08-06 00:34:57,343][52794] Sum rewards: 44.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO4': '0.100', 'weapon2': '0.176', 'AMMO3': '0.214', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.554', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '37.500'} [2024-08-06 00:34:57,440][52649] DAMAGECOUNT value on done: 116230.0 [2024-08-06 00:34:57,440][52649] Sum rewards: 43.683, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO2': '0.038', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.165', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.540', 'weapon4': '0.594', 'WEAPON3': '0.950', 'weapon3': '2.376', 'HITCOUNT': '2.470', 'DAMAGECOUNT': '10.833', 'FRAGCOUNT': '37.000'} [2024-08-06 00:34:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 194641920. Throughput: 0: 4381.8. Samples: 48668820. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:34:57,794][52567] Avg episode reward: [(0, '53.286')] [2024-08-06 00:34:57,839][52668] DAMAGECOUNT value on done: 120016.0 [2024-08-06 00:34:57,839][52668] Sum rewards: 68.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.880', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '57.000'} [2024-08-06 00:34:57,963][52650] Updated weights for policy 0, policy_version 23761 (0.0017) [2024-08-06 00:34:58,432][52795] DAMAGECOUNT value on done: 109578.0 [2024-08-06 00:34:58,433][52795] Sum rewards: 50.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.729', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.286', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.146', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '45.000'} [2024-08-06 00:34:58,565][52664] DAMAGECOUNT value on done: 125151.0 [2024-08-06 00:34:58,565][52664] Sum rewards: 59.115, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.266', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.082', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '50.000'} [2024-08-06 00:34:59,108][52662] DAMAGECOUNT value on done: 121802.0 [2024-08-06 00:34:59,109][52662] Sum rewards: 57.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.318', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:59,115][52660] DAMAGECOUNT value on done: 121380.0 [2024-08-06 00:34:59,116][52660] Sum rewards: 53.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.240', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '45.000'} [2024-08-06 00:34:59,440][52667] DAMAGECOUNT value on done: 120546.0 [2024-08-06 00:34:59,440][52667] Sum rewards: 58.378, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.307', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '49.000'} [2024-08-06 00:34:59,798][52669] DAMAGECOUNT value on done: 119920.0 [2024-08-06 00:34:59,798][52669] Sum rewards: 50.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.505', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon2': '0.106', 'AMMO3': '0.228', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '3.644', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '44.000'} [2024-08-06 00:35:00,238][52794] DAMAGECOUNT value on done: 127592.0 [2024-08-06 00:35:00,239][52794] Sum rewards: 79.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.757', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.214', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.516', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '66.000'} [2024-08-06 00:35:00,699][52649] DAMAGECOUNT value on done: 114533.0 [2024-08-06 00:35:00,699][52649] Sum rewards: 59.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.034', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.324', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:00,908][52668] DAMAGECOUNT value on done: 123347.0 [2024-08-06 00:35:00,908][52668] Sum rewards: 56.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.290', 'AMMO2': '0.028', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.222', 'weapon2': '0.280', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.522', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:01,053][52664] DAMAGECOUNT value on done: 124030.0 [2024-08-06 00:35:01,053][52664] Sum rewards: 58.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.034', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.167', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.436', 'WEAPON3': '1.100', 'weapon3': '2.744', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:01,681][52795] DAMAGECOUNT value on done: 110566.0 [2024-08-06 00:35:01,682][52795] Sum rewards: 41.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.932', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon7': '0.052', 'weapon5': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.223', 'WEAPON4': '0.500', 'weapon4': '0.574', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.026', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.226', 'FRAGCOUNT': '37.000'} [2024-08-06 00:35:02,208][52660] DAMAGECOUNT value on done: 127954.0 [2024-08-06 00:35:02,208][52660] Sum rewards: 60.436, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.150', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'AMMO3': '0.255', 'WEAPON4': '0.400', 'weapon4': '0.430', 'weapon2': '0.730', 'WEAPON3': '1.450', 'weapon3': '2.528', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '53.000'} [2024-08-06 00:35:02,405][52669] DAMAGECOUNT value on done: 120745.0 [2024-08-06 00:35:02,413][52669] Sum rewards: 48.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.102', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.468', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.008', 'DAMAGECOUNT': '11.520', 'FRAGCOUNT': '43.000'} [2024-08-06 00:35:02,492][52667] DAMAGECOUNT value on done: 123815.0 [2024-08-06 00:35:02,493][52667] Sum rewards: 61.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.216', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.183', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:02,730][52650] Updated weights for policy 0, policy_version 23771 (0.0014) [2024-08-06 00:35:02,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 194732032. Throughput: 0: 4380.6. Samples: 48681770. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:35:02,795][52567] Avg episode reward: [(0, '54.042')] [2024-08-06 00:35:03,170][52794] DAMAGECOUNT value on done: 124095.0 [2024-08-06 00:35:03,170][52794] Sum rewards: 49.053, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.440', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.090', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.480', 'WEAPON3': '1.600', 'HITCOUNT': '2.610', 'weapon3': '3.046', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:03,293][52647] DAMAGECOUNT value on done: 127054.0 [2024-08-06 00:35:03,293][52647] Sum rewards: 49.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.056', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.280', 'WEAPON4': '0.500', 'weapon2': '0.536', 'weapon4': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.388', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '42.000'} [2024-08-06 00:35:03,805][52649] DAMAGECOUNT value on done: 117343.0 [2024-08-06 00:35:03,806][52649] Sum rewards: 58.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.733', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:04,033][52668] DAMAGECOUNT value on done: 121628.0 [2024-08-06 00:35:04,033][52668] Sum rewards: 58.033, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.046', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.280', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.320', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '51.500'} [2024-08-06 00:35:04,065][52664] DAMAGECOUNT value on done: 123920.0 [2024-08-06 00:35:04,066][52664] Sum rewards: 57.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.999', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.183', 'weapon2': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:04,789][52795] DAMAGECOUNT value on done: 110106.0 [2024-08-06 00:35:04,793][52795] Sum rewards: 51.797, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.345', 'AMMO2': '0.027', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.278', 'weapon2': '0.518', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.086', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:05,129][52667] DAMAGECOUNT value on done: 121310.0 [2024-08-06 00:35:05,130][52667] Sum rewards: 40.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.572', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.468', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.556', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '35.000'} [2024-08-06 00:35:05,150][52660] DAMAGECOUNT value on done: 117760.0 [2024-08-06 00:35:05,153][52660] Sum rewards: 60.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.140', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.110', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.450', 'weapon3': '2.754', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:05,195][52669] DAMAGECOUNT value on done: 120564.0 [2024-08-06 00:35:05,197][52669] Sum rewards: 59.314, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.826', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'weapon4': '0.224', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:06,079][52647] DAMAGECOUNT value on done: 125164.0 [2024-08-06 00:35:06,081][52647] Sum rewards: 47.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.007', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.185', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.418', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '42.000'} [2024-08-06 00:35:06,310][52794] DAMAGECOUNT value on done: 124191.0 [2024-08-06 00:35:06,312][52794] Sum rewards: 48.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.200', 'weapon4': '0.230', 'AMMO3': '0.274', 'weapon2': '0.550', 'WEAPON3': '1.650', 'HITCOUNT': '2.820', 'weapon3': '2.974', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:06,745][52664] DAMAGECOUNT value on done: 129163.0 [2024-08-06 00:35:06,746][52664] Sum rewards: 52.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'AMMO4': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.486', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.602', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '44.000'} [2024-08-06 00:35:06,912][52649] DAMAGECOUNT value on done: 117695.0 [2024-08-06 00:35:06,912][52649] Sum rewards: 43.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.472', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.223', 'weapon2': '0.446', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '3.110', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '40.000'} [2024-08-06 00:35:07,250][52650] Updated weights for policy 0, policy_version 23781 (0.0016) [2024-08-06 00:35:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 194813952. Throughput: 0: 4380.7. Samples: 48708290. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:35:07,794][52567] Avg episode reward: [(0, '53.981')] [2024-08-06 00:35:07,796][52660] DAMAGECOUNT value on done: 122184.0 [2024-08-06 00:35:07,816][52660] Sum rewards: 55.088, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.890', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.204', 'weapon4': '0.248', 'AMMO3': '0.297', 'weapon2': '0.574', 'WEAPON3': '1.700', 'weapon3': '2.708', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '51.000'} [2024-08-06 00:35:07,936][52795] DAMAGECOUNT value on done: 106515.0 [2024-08-06 00:35:07,937][52795] Sum rewards: 33.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon4': '0.202', 'weapon5': '0.222', 'AMMO3': '0.242', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '1.870', 'weapon3': '2.816', 'DAMAGECOUNT': '9.660', 'FRAGCOUNT': '34.000'} [2024-08-06 00:35:08,132][52667] DAMAGECOUNT value on done: 119593.0 [2024-08-06 00:35:08,133][52667] Sum rewards: 56.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.180', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:08,314][52669] DAMAGECOUNT value on done: 118650.0 [2024-08-06 00:35:08,315][52669] Sum rewards: 66.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.354', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon5': '0.066', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'AMMO4': '0.291', 'weapon2': '0.406', 'weapon4': '0.534', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.722', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '60.000'} [2024-08-06 00:35:08,418][52647] DAMAGECOUNT value on done: 130856.0 [2024-08-06 00:35:08,419][52647] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.244', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.151', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.304', 'weapon4': '0.636', 'WEAPON3': '0.950', 'weapon3': '2.844', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:09,111][52664] DAMAGECOUNT value on done: 126947.0 [2024-08-06 00:35:09,112][52664] Sum rewards: 39.609, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.270', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.075', 'weapon5': '0.084', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.373', 'weapon2': '0.422', 'weapon4': '0.476', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '2.796', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '38.000'} [2024-08-06 00:35:09,167][52794] DAMAGECOUNT value on done: 130528.0 [2024-08-06 00:35:09,168][52794] Sum rewards: 57.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.900', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:09,793][52649] DAMAGECOUNT value on done: 111387.0 [2024-08-06 00:35:09,793][52649] Sum rewards: 49.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.778', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.034', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '45.500'} [2024-08-06 00:35:10,538][52669] DAMAGECOUNT value on done: 122575.0 [2024-08-06 00:35:10,538][52669] Sum rewards: 51.449, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.984', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.167', 'weapon4': '0.260', 'AMMO3': '0.297', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '2.852', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:10,983][52660] DAMAGECOUNT value on done: 116488.0 [2024-08-06 00:35:10,983][52660] Sum rewards: 49.572, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.748', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon2': '0.210', 'WEAPON3': '0.850', 'HITCOUNT': '2.570', 'weapon3': '3.612', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '41.000'} [2024-08-06 00:35:11,073][52795] DAMAGECOUNT value on done: 112781.0 [2024-08-06 00:35:11,076][52795] Sum rewards: 62.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.069', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO3': '0.126', 'AMMO4': '0.146', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.470', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.590', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '51.000'} [2024-08-06 00:35:11,114][52667] DAMAGECOUNT value on done: 122379.0 [2024-08-06 00:35:11,115][52667] Sum rewards: 52.276, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.306', 'weapon4': '0.344', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.134', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:11,519][52647] DAMAGECOUNT value on done: 129069.0 [2024-08-06 00:35:11,520][52647] Sum rewards: 67.300, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.435', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.378', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '56.000'} [2024-08-06 00:35:11,738][52650] Updated weights for policy 0, policy_version 23791 (0.0010) [2024-08-06 00:35:12,130][52794] DAMAGECOUNT value on done: 123165.0 [2024-08-06 00:35:12,130][52794] Sum rewards: 57.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.609', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.183', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:12,305][52664] DAMAGECOUNT value on done: 118665.0 [2024-08-06 00:35:12,305][52664] Sum rewards: 56.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:12,739][52649] DAMAGECOUNT value on done: 116306.0 [2024-08-06 00:35:12,742][52649] Sum rewards: 54.349, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.731', 'AMMO2': '0.001', 'AMMO4': '0.002', 'ARMOR': '0.004', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon4': '0.264', 'weapon2': '0.586', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '3.018', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '44.000'} [2024-08-06 00:35:12,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 194912256. Throughput: 0: 4397.1. Samples: 48735130. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 00:35:12,802][52567] Avg episode reward: [(0, '54.347')] [2024-08-06 00:35:13,004][52658] DAMAGECOUNT value on done: 123477.0 [2024-08-06 00:35:13,005][52658] Sum rewards: 45.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.843', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.197', 'weapon2': '0.542', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '3.172', 'DAMAGECOUNT': '11.730', 'FRAGCOUNT': '39.000'} [2024-08-06 00:35:13,398][52669] DAMAGECOUNT value on done: 123187.0 [2024-08-06 00:35:13,399][52669] Sum rewards: 64.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.754', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.213', 'weapon2': '0.226', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '53.000'} [2024-08-06 00:35:13,553][52667] DAMAGECOUNT value on done: 118680.0 [2024-08-06 00:35:13,553][52667] Sum rewards: 51.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-5.060', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.698', 'WEAPON3': '1.700', 'weapon3': '2.718', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:14,126][52660] DAMAGECOUNT value on done: 124026.0 [2024-08-06 00:35:14,128][52660] Sum rewards: 67.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.655', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.128', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.824', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '55.000'} [2024-08-06 00:35:14,248][52795] DAMAGECOUNT value on done: 114724.0 [2024-08-06 00:35:14,249][52795] Sum rewards: 56.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.130', 'weapon4': '0.174', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.666', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:14,329][52647] DAMAGECOUNT value on done: 131619.0 [2024-08-06 00:35:14,329][52647] Sum rewards: 46.313, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.272', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.054', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO4': '0.270', 'weapon4': '0.298', 'AMMO3': '0.301', 'weapon2': '0.458', 'WEAPON4': '0.600', 'WEAPON3': '1.800', 'HITCOUNT': '2.640', 'weapon3': '2.848', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:14,981][52664] DAMAGECOUNT value on done: 131929.0 [2024-08-06 00:35:14,983][52664] Sum rewards: 52.096, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.538', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.776', 'WEAPON3': '0.900', 'weapon3': '2.870', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '40.500'} [2024-08-06 00:35:15,786][52658] DAMAGECOUNT value on done: 121700.0 [2024-08-06 00:35:15,787][52658] Sum rewards: 53.852, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.757', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.044', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.358', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:15,880][52649] DAMAGECOUNT value on done: 112705.0 [2024-08-06 00:35:15,883][52649] Sum rewards: 59.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.448', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.580', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '50.500'} [2024-08-06 00:35:16,236][52669] DAMAGECOUNT value on done: 119011.0 [2024-08-06 00:35:16,238][52669] Sum rewards: 61.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon4': '0.116', 'AMMO3': '0.183', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.210', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '51.000'} [2024-08-06 00:35:16,330][52667] DAMAGECOUNT value on done: 123596.0 [2024-08-06 00:35:16,330][52667] Sum rewards: 51.599, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.272', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon5': '0.160', 'AMMO4': '0.185', 'AMMO3': '0.201', 'weapon4': '0.310', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '43.500'} [2024-08-06 00:35:16,772][52650] Updated weights for policy 0, policy_version 23801 (0.0027) [2024-08-06 00:35:16,972][52660] DAMAGECOUNT value on done: 118507.0 [2024-08-06 00:35:16,972][52660] Sum rewards: 61.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.453', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.072', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:17,025][52647] DAMAGECOUNT value on done: 129330.0 [2024-08-06 00:35:17,025][52647] Sum rewards: 52.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.837', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon2': '0.368', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.306', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '44.000'} [2024-08-06 00:35:17,330][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:35:17,361][52795] DAMAGECOUNT value on done: 108135.0 [2024-08-06 00:35:17,361][52795] Sum rewards: 43.792, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.226', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.276', 'AMMO3': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '2.690', 'weapon3': '3.136', 'DAMAGECOUNT': '12.234', 'FRAGCOUNT': '43.000'} [2024-08-06 00:35:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 194994176. Throughput: 0: 4407.1. Samples: 48748350. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 00:35:17,794][52567] Avg episode reward: [(0, '54.357')] [2024-08-06 00:35:18,128][52664] DAMAGECOUNT value on done: 130382.0 [2024-08-06 00:35:18,129][52664] Sum rewards: 53.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon5': '0.126', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:18,544][52658] DAMAGECOUNT value on done: 121240.0 [2024-08-06 00:35:18,545][52658] Sum rewards: 52.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.390', 'weapon2': '0.718', 'WEAPON3': '1.250', 'weapon3': '2.592', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:18,964][52667] DAMAGECOUNT value on done: 127891.0 [2024-08-06 00:35:18,964][52667] Sum rewards: 54.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'AMMO5': '0.015', 'ARMOR': '0.024', 'AMMO2': '0.040', 'weapon5': '0.062', 'AMMO3': '0.153', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.470', 'weapon2': '0.592', 'WEAPON3': '1.000', 'weapon3': '2.604', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:19,031][52649] DAMAGECOUNT value on done: 121656.0 [2024-08-06 00:35:19,032][52649] Sum rewards: 53.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.584', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.196', 'weapon2': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.178', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:19,368][52669] DAMAGECOUNT value on done: 122063.0 [2024-08-06 00:35:19,368][52669] Sum rewards: 60.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.510', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.194', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.550', 'HITCOUNT': '3.230', 'weapon3': '3.256', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '53.000'} [2024-08-06 00:35:20,312][52647] DAMAGECOUNT value on done: 126142.0 [2024-08-06 00:35:20,313][52647] Sum rewards: 61.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO2': '0.026', 'weapon4': '0.094', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '53.000'} [2024-08-06 00:35:20,738][52795] DAMAGECOUNT value on done: 113313.0 [2024-08-06 00:35:20,738][52795] Sum rewards: 60.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.685', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.468', 'WEAPON3': '0.950', 'weapon3': '3.108', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:21,089][52658] DAMAGECOUNT value on done: 124066.0 [2024-08-06 00:35:21,090][52658] Sum rewards: 44.012, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.695', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.135', 'AMMO4': '0.139', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'weapon2': '0.534', 'WEAPON3': '0.900', 'HITCOUNT': '2.570', 'weapon3': '2.700', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '35.500'} [2024-08-06 00:35:21,197][52664] DAMAGECOUNT value on done: 128281.0 [2024-08-06 00:35:21,198][52664] Sum rewards: 67.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.609', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.362', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.000'} [2024-08-06 00:35:21,237][52650] Updated weights for policy 0, policy_version 23811 (0.0012) [2024-08-06 00:35:21,719][52667] DAMAGECOUNT value on done: 124542.0 [2024-08-06 00:35:21,720][52667] Sum rewards: 53.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.820', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.608', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.166', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:21,790][52649] DAMAGECOUNT value on done: 114125.0 [2024-08-06 00:35:21,791][52649] Sum rewards: 49.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.184', 'WEAPON4': '0.500', 'weapon4': '0.600', 'weapon2': '0.762', 'WEAPON3': '1.050', 'weapon3': '2.378', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '43.000'} [2024-08-06 00:35:22,237][52669] DAMAGECOUNT value on done: 127247.0 [2024-08-06 00:35:22,239][52669] Sum rewards: 55.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.187', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'weapon5': '0.154', 'AMMO3': '0.252', 'weapon2': '0.472', 'WEAPON3': '1.600', 'HITCOUNT': '2.790', 'weapon3': '3.004', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '49.500'} [2024-08-06 00:35:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 195084288. Throughput: 0: 4402.9. Samples: 48774670. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 00:35:22,802][52567] Avg episode reward: [(0, '54.651')] [2024-08-06 00:35:23,009][52647] DAMAGECOUNT value on done: 129672.0 [2024-08-06 00:35:23,009][52647] Sum rewards: 57.864, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.799', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'AMMO4': '0.238', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:23,869][52795] DAMAGECOUNT value on done: 114713.0 [2024-08-06 00:35:23,869][52795] Sum rewards: 56.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.280', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.224', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:23,961][52658] DAMAGECOUNT value on done: 124871.0 [2024-08-06 00:35:23,961][52658] Sum rewards: 58.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.167', 'WEAPON4': '0.400', 'weapon4': '0.656', 'weapon2': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.288', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:24,025][52664] DAMAGECOUNT value on done: 125786.0 [2024-08-06 00:35:24,028][52664] Sum rewards: 61.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.332', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.054', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.380', 'weapon4': '0.404', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '53.000'} [2024-08-06 00:35:24,654][52667] DAMAGECOUNT value on done: 127074.0 [2024-08-06 00:35:24,654][52667] Sum rewards: 59.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.277', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.190', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'ARMOR': '0.408', 'weapon2': '0.588', 'weapon4': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.514', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:24,696][52669] DAMAGECOUNT value on done: 129922.0 [2024-08-06 00:35:24,696][52669] Sum rewards: 48.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.004', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'weapon2': '0.460', 'weapon4': '0.850', 'WEAPON3': '1.200', 'weapon3': '2.492', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '42.000'} [2024-08-06 00:35:24,757][52649] DAMAGECOUNT value on done: 118366.0 [2024-08-06 00:35:24,757][52649] Sum rewards: 60.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'weapon4': '0.016', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.217', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.506', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '51.000'} [2024-08-06 00:35:25,851][52650] Updated weights for policy 0, policy_version 23821 (0.0022) [2024-08-06 00:35:25,932][52647] DAMAGECOUNT value on done: 131110.0 [2024-08-06 00:35:25,933][52647] Sum rewards: 49.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.165', 'AMMO3': '0.179', 'WEAPON4': '0.400', 'weapon2': '0.546', 'weapon4': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.380', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '43.000'} [2024-08-06 00:35:26,467][52658] DAMAGECOUNT value on done: 117692.0 [2024-08-06 00:35:26,469][52658] Sum rewards: 51.804, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.627', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.152', 'WEAPON4': '0.350', 'weapon4': '0.498', 'weapon2': '0.574', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.698', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '42.000'} [2024-08-06 00:35:26,950][52664] DAMAGECOUNT value on done: 123071.0 [2024-08-06 00:35:26,950][52664] Sum rewards: 49.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.214', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '2.952', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '43.000'} [2024-08-06 00:35:27,098][52667] DAMAGECOUNT value on done: 117819.0 [2024-08-06 00:35:27,099][52667] Sum rewards: 52.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.590', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.254', 'WEAPON4': '0.450', 'weapon2': '0.468', 'weapon4': '0.756', 'WEAPON3': '1.000', 'weapon3': '2.346', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:27,505][52669] DAMAGECOUNT value on done: 120945.0 [2024-08-06 00:35:27,505][52669] Sum rewards: 41.840, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.012', 'AMMO2': '0.070', 'AMMO3': '0.174', 'weapon5': '0.190', 'WEAPON5': '0.350', 'AMMO4': '0.352', 'ARMOR': '0.416', 'weapon2': '0.462', 'weapon4': '0.716', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.346', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '37.000'} [2024-08-06 00:35:27,741][52649] DAMAGECOUNT value on done: 117341.0 [2024-08-06 00:35:27,744][52649] Sum rewards: 56.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.211', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.206', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.468', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 195174400. Throughput: 0: 4411.6. Samples: 48801430. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 00:35:27,802][52567] Avg episode reward: [(0, '54.559')] [2024-08-06 00:35:28,395][52647] DAMAGECOUNT value on done: 124317.0 [2024-08-06 00:35:28,396][52647] Sum rewards: 56.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.835', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.210', 'WEAPON4': '0.450', 'weapon4': '0.524', 'weapon2': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.466', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:28,638][52666] DAMAGECOUNT value on done: 122027.0 [2024-08-06 00:35:28,640][52666] Sum rewards: 68.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.413', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.174', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '58.000'} [2024-08-06 00:35:29,297][52664] DAMAGECOUNT value on done: 126052.0 [2024-08-06 00:35:29,300][52664] Sum rewards: 51.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.398', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.022', 'weapon5': '0.072', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.738', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.010', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '42.000'} [2024-08-06 00:35:29,770][52658] DAMAGECOUNT value on done: 126969.0 [2024-08-06 00:35:29,771][52658] Sum rewards: 55.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.920', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon5': '0.016', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'AMMO4': '0.226', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.512', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:30,207][52669] DAMAGECOUNT value on done: 121737.0 [2024-08-06 00:35:30,210][52669] Sum rewards: 59.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.065', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon5': '0.210', 'AMMO4': '0.324', 'weapon4': '0.338', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:30,393][52667] DAMAGECOUNT value on done: 125418.0 [2024-08-06 00:35:30,393][52667] Sum rewards: 59.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.124', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon4': '0.294', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:30,455][52650] Updated weights for policy 0, policy_version 23831 (0.0048) [2024-08-06 00:35:30,846][52649] DAMAGECOUNT value on done: 114731.0 [2024-08-06 00:35:30,850][52649] Sum rewards: 51.915, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.260', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.062', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.752', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:30,924][52647] DAMAGECOUNT value on done: 124853.0 [2024-08-06 00:35:30,924][52647] Sum rewards: 56.279, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.048', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.133', 'AMMO3': '0.143', 'weapon2': '0.264', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon4': '0.918', 'weapon3': '2.532', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '44.000'} [2024-08-06 00:35:31,715][52666] DAMAGECOUNT value on done: 122064.0 [2024-08-06 00:35:31,715][52666] Sum rewards: 64.887, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.065', 'ARMOR': '0.012', 'AMMO2': '0.041', 'AMMO4': '0.207', 'AMMO3': '0.229', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '56.000'} [2024-08-06 00:35:31,917][52664] DAMAGECOUNT value on done: 126985.0 [2024-08-06 00:35:31,917][52664] Sum rewards: 55.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.554', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.018', 'weapon5': '0.032', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.338', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.242', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:31,983][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:35:32,557][52658] DAMAGECOUNT value on done: 118827.0 [2024-08-06 00:35:32,558][52658] Sum rewards: 55.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.072', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.862', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:32,729][52669] DAMAGECOUNT value on done: 122404.0 [2024-08-06 00:35:32,730][52669] Sum rewards: 45.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.400', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'weapon4': '0.566', 'weapon2': '0.780', 'WEAPON3': '1.150', 'weapon3': '2.390', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '11.466', 'FRAGCOUNT': '41.000'} [2024-08-06 00:35:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 195256320. Throughput: 0: 4416.4. Samples: 48814860. Policy #0 lag: (min: 1.0, avg: 4.8, max: 8.0) [2024-08-06 00:35:32,802][52567] Avg episode reward: [(0, '54.747')] [2024-08-06 00:35:33,401][52647] DAMAGECOUNT value on done: 123437.0 [2024-08-06 00:35:33,403][52647] Sum rewards: 53.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.385', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.171', 'weapon5': '0.192', 'WEAPON5': '0.250', 'AMMO4': '0.288', 'weapon4': '0.624', 'WEAPON4': '0.700', 'weapon2': '0.718', 'WEAPON3': '1.000', 'weapon3': '2.256', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '44.500'} [2024-08-06 00:35:34,027][52649] DAMAGECOUNT value on done: 121306.0 [2024-08-06 00:35:34,028][52649] Sum rewards: 55.775, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.820', 'ARMOR': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.716', 'WEAPON3': '0.950', 'weapon3': '2.894', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:34,387][52666] DAMAGECOUNT value on done: 122399.0 [2024-08-06 00:35:34,388][52666] Sum rewards: 55.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.344', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.350', 'weapon3': '2.790', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:34,452][52664] DAMAGECOUNT value on done: 122283.0 [2024-08-06 00:35:34,452][52664] Sum rewards: 65.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.194', 'AMMO3': '0.213', 'weapon2': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '55.000'} [2024-08-06 00:35:35,417][52650] Updated weights for policy 0, policy_version 23841 (0.0032) [2024-08-06 00:35:35,525][52658] DAMAGECOUNT value on done: 125419.0 [2024-08-06 00:35:35,527][52658] Sum rewards: 48.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.774', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.132', 'AMMO4': '0.224', 'WEAPON4': '0.400', 'weapon4': '0.518', 'weapon2': '0.578', 'WEAPON3': '0.800', 'weapon3': '2.624', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.471', 'FRAGCOUNT': '41.000'} [2024-08-06 00:35:35,670][52669] DAMAGECOUNT value on done: 123510.0 [2024-08-06 00:35:35,670][52669] Sum rewards: 69.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.060', 'AMMO3': '0.230', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.428', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 00:35:36,172][52647] DAMAGECOUNT value on done: 126951.0 [2024-08-06 00:35:36,173][52647] Sum rewards: 65.642, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.312', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.048', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '55.000'} [2024-08-06 00:35:36,636][52649] DAMAGECOUNT value on done: 120001.0 [2024-08-06 00:35:36,637][52649] Sum rewards: 53.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'AMMO4': '0.219', 'weapon4': '0.450', 'weapon2': '0.502', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '46.500'} [2024-08-06 00:35:37,455][52666] DAMAGECOUNT value on done: 118100.0 [2024-08-06 00:35:37,457][52666] Sum rewards: 58.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.237', 'weapon2': '0.304', 'WEAPON4': '0.500', 'weapon4': '0.748', 'WEAPON3': '1.400', 'weapon3': '2.664', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:37,518][52664] DAMAGECOUNT value on done: 124758.0 [2024-08-06 00:35:37,518][52664] Sum rewards: 53.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.886', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '46.500'} [2024-08-06 00:35:37,538][52670] DAMAGECOUNT value on done: 118862.0 [2024-08-06 00:35:37,539][52670] Sum rewards: 59.610, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'HEALTH': '0.134', 'AMMO4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.179', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 195346432. Throughput: 0: 4415.5. Samples: 48841020. Policy #0 lag: (min: 1.0, avg: 4.8, max: 8.0) [2024-08-06 00:35:37,802][52567] Avg episode reward: [(0, '55.223')] [2024-08-06 00:35:38,267][52658] DAMAGECOUNT value on done: 126144.0 [2024-08-06 00:35:38,268][52658] Sum rewards: 69.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO3': '0.168', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '57.000'} [2024-08-06 00:35:38,279][52820] DAMAGECOUNT value on done: 110578.0 [2024-08-06 00:35:38,279][52820] Sum rewards: 60.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.148', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon5': '0.190', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:39,256][52647] DAMAGECOUNT value on done: 123052.0 [2024-08-06 00:35:39,259][52647] Sum rewards: 56.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.656', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.328', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.344', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:39,400][52649] DAMAGECOUNT value on done: 114428.0 [2024-08-06 00:35:39,401][52649] Sum rewards: 55.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.191', 'weapon4': '0.422', 'WEAPON4': '0.450', 'weapon2': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.698', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:39,472][52614] Signal inference workers to stop experience collection... (4400 times) [2024-08-06 00:35:39,475][52614] Signal inference workers to resume experience collection... (4400 times) [2024-08-06 00:35:39,550][52650] InferenceWorker_p0-w0: stopping experience collection (4400 times) [2024-08-06 00:35:39,557][52650] InferenceWorker_p0-w0: resuming experience collection (4400 times) [2024-08-06 00:35:39,588][52650] Updated weights for policy 0, policy_version 23851 (0.0012) [2024-08-06 00:35:40,524][52666] DAMAGECOUNT value on done: 118310.0 [2024-08-06 00:35:40,526][52664] DAMAGECOUNT value on done: 127026.0 [2024-08-06 00:35:40,526][52666] Sum rewards: 60.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.962', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.189', 'weapon4': '0.268', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:40,526][52664] Sum rewards: 63.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:40,617][52670] DAMAGECOUNT value on done: 123831.0 [2024-08-06 00:35:40,623][52670] Sum rewards: 63.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.794', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.156', 'AMMO3': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '53.000'} [2024-08-06 00:35:40,925][52658] DAMAGECOUNT value on done: 126344.0 [2024-08-06 00:35:40,925][52658] Sum rewards: 59.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.813', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.176', 'AMMO3': '0.213', 'weapon4': '0.292', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '51.000'} [2024-08-06 00:35:41,344][52820] DAMAGECOUNT value on done: 113118.0 [2024-08-06 00:35:41,344][52820] Sum rewards: 50.231, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.976', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon2': '0.244', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.298', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:42,004][52647] DAMAGECOUNT value on done: 127307.0 [2024-08-06 00:35:42,004][52647] Sum rewards: 47.945, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.763', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.086', 'AMMO3': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.602', 'WEAPON3': '0.750', 'weapon2': '0.754', 'weapon3': '2.446', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '37.000'} [2024-08-06 00:35:42,191][52649] DAMAGECOUNT value on done: 120297.0 [2024-08-06 00:35:42,191][52649] Sum rewards: 52.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.874', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.632', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:42,249][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:35:42,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 195444736. Throughput: 0: 4409.6. Samples: 48867250. Policy #0 lag: (min: 1.0, avg: 4.8, max: 8.0) [2024-08-06 00:35:42,802][52567] Avg episode reward: [(0, '55.445')] [2024-08-06 00:35:42,802][52614] Saving new best policy, reward=55.445! [2024-08-06 00:35:43,154][52664] DAMAGECOUNT value on done: 123933.0 [2024-08-06 00:35:43,154][52664] Sum rewards: 56.001, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.304', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.630', 'weapon4': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.388', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:43,347][52658] DAMAGECOUNT value on done: 119294.0 [2024-08-06 00:35:43,349][52658] Sum rewards: 46.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.110', 'AMMO4': '0.119', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.766', 'WEAPON3': '0.900', 'HITCOUNT': '2.690', 'weapon3': '2.878', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '38.000'} [2024-08-06 00:35:43,712][52666] DAMAGECOUNT value on done: 116675.0 [2024-08-06 00:35:43,712][52666] Sum rewards: 46.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.143', 'WEAPON4': '0.450', 'weapon4': '0.522', 'weapon2': '0.792', 'WEAPON3': '0.950', 'weapon3': '2.512', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '38.000'} [2024-08-06 00:35:43,784][52670] DAMAGECOUNT value on done: 118837.0 [2024-08-06 00:35:43,785][52670] Sum rewards: 67.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'weapon4': '0.148', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '56.000'} [2024-08-06 00:35:44,344][52647] DAMAGECOUNT value on done: 128178.0 [2024-08-06 00:35:44,345][52647] Sum rewards: 54.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.705', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.508', 'weapon4': '0.642', 'WEAPON3': '1.300', 'weapon3': '2.466', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:44,536][52820] DAMAGECOUNT value on done: 110093.0 [2024-08-06 00:35:44,537][52820] Sum rewards: 51.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'weapon5': '0.002', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.266', 'weapon4': '0.344', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.204', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:44,694][52650] Updated weights for policy 0, policy_version 23861 (0.0013) [2024-08-06 00:35:44,984][52663] DAMAGECOUNT value on done: 121172.0 [2024-08-06 00:35:44,985][52663] Sum rewards: 64.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.624', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.038', 'AMMO4': '0.121', 'AMMO3': '0.162', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '54.500'} [2024-08-06 00:35:45,358][52649] DAMAGECOUNT value on done: 117154.0 [2024-08-06 00:35:45,359][52649] Sum rewards: 61.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.874', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.199', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '52.000'} [2024-08-06 00:35:45,865][52664] DAMAGECOUNT value on done: 124193.0 [2024-08-06 00:35:45,867][52664] Sum rewards: 53.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.715', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.086', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.002', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:46,460][52658] DAMAGECOUNT value on done: 121726.0 [2024-08-06 00:35:46,460][52658] Sum rewards: 60.991, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.648', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.155', 'AMMO3': '0.156', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.386', 'WEAPON3': '0.900', 'HITCOUNT': '3.060', 'weapon3': '3.082', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:46,614][52666] DAMAGECOUNT value on done: 118533.0 [2024-08-06 00:35:46,617][52666] Sum rewards: 52.390, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.382', 'AMMO5': '0.016', 'ARMOR': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.234', 'AMMO4': '0.305', 'weapon5': '0.324', 'WEAPON5': '0.450', 'weapon2': '0.624', 'weapon4': '0.624', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.074', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:46,699][52670] DAMAGECOUNT value on done: 120876.0 [2024-08-06 00:35:46,701][52670] Sum rewards: 51.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.475', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.040', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.221', 'weapon4': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:46,893][52647] DAMAGECOUNT value on done: 123388.0 [2024-08-06 00:35:46,895][52647] Sum rewards: 56.322, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.058', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.256', 'AMMO3': '0.271', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:47,494][52820] DAMAGECOUNT value on done: 106453.0 [2024-08-06 00:35:47,496][52820] Sum rewards: 52.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.058', 'weapon4': '0.066', 'weapon5': '0.084', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'AMMO4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.100', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:47,586][52663] DAMAGECOUNT value on done: 120890.0 [2024-08-06 00:35:47,586][52663] Sum rewards: 38.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.066', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.189', 'weapon4': '0.276', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.150', 'HITCOUNT': '2.130', 'weapon3': '2.880', 'DAMAGECOUNT': '10.233', 'FRAGCOUNT': '34.000'} [2024-08-06 00:35:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 195518464. Throughput: 0: 4411.3. Samples: 48880280. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:35:47,795][52567] Avg episode reward: [(0, '55.666')] [2024-08-06 00:35:47,797][52614] Saving new best policy, reward=55.666! [2024-08-06 00:35:48,650][52649] DAMAGECOUNT value on done: 121531.0 [2024-08-06 00:35:48,652][52649] Sum rewards: 60.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.386', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.036', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.766', 'WEAPON3': '1.000', 'weapon3': '2.894', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:49,206][52650] Updated weights for policy 0, policy_version 23871 (0.0024) [2024-08-06 00:35:49,516][52658] DAMAGECOUNT value on done: 120048.0 [2024-08-06 00:35:49,518][52658] Sum rewards: 53.083, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.627', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.217', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:49,712][52666] DAMAGECOUNT value on done: 119477.0 [2024-08-06 00:35:49,713][52666] Sum rewards: 50.836, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.142', 'AMMO3': '0.189', 'weapon2': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '3.032', 'DAMAGECOUNT': '12.201', 'FRAGCOUNT': '43.000'} [2024-08-06 00:35:49,866][52670] DAMAGECOUNT value on done: 122050.0 [2024-08-06 00:35:49,866][52670] Sum rewards: 62.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.176', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.244', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '51.000'} [2024-08-06 00:35:49,955][52647] DAMAGECOUNT value on done: 127463.0 [2024-08-06 00:35:49,955][52647] Sum rewards: 51.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.202', 'weapon4': '0.268', 'WEAPON4': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '45.500'} [2024-08-06 00:35:50,134][52663] DAMAGECOUNT value on done: 121728.0 [2024-08-06 00:35:50,135][52663] Sum rewards: 45.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.264', 'weapon2': '0.478', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.012', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '40.000'} [2024-08-06 00:35:50,649][52820] DAMAGECOUNT value on done: 111961.0 [2024-08-06 00:35:50,651][52820] Sum rewards: 51.905, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.322', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.204', 'AMMO4': '0.238', 'weapon2': '0.286', 'AMMO3': '0.297', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.602', 'WEAPON3': '1.750', 'weapon3': '2.522', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:51,598][52649] DAMAGECOUNT value on done: 119471.0 [2024-08-06 00:35:51,598][52649] Sum rewards: 49.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.310', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.394', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:52,515][52647] DAMAGECOUNT value on done: 121815.0 [2024-08-06 00:35:52,516][52647] Sum rewards: 47.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.720', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.217', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '3.360', 'DAMAGECOUNT': '11.889', 'FRAGCOUNT': '41.000'} [2024-08-06 00:35:52,789][52666] DAMAGECOUNT value on done: 122701.0 [2024-08-06 00:35:52,789][52666] Sum rewards: 52.387, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.796', 'AMMO5': '0.008', 'ARMOR': '0.024', 'AMMO2': '0.048', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'AMMO4': '0.241', 'weapon2': '0.410', 'WEAPON4': '0.600', 'weapon4': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.430', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 195608576. Throughput: 0: 4401.8. Samples: 48906370. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:35:52,794][52567] Avg episode reward: [(0, '55.474')] [2024-08-06 00:35:52,824][52658] DAMAGECOUNT value on done: 120580.0 [2024-08-06 00:35:52,825][52658] Sum rewards: 63.387, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.870', 'AMMO5': '0.006', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.650', 'weapon3': '2.740', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '57.000'} [2024-08-06 00:35:53,015][52670] DAMAGECOUNT value on done: 122261.0 [2024-08-06 00:35:53,015][52670] Sum rewards: 67.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.090', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.294', 'weapon2': '0.310', 'WEAPON3': '0.950', 'weapon3': '3.142', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '54.000'} [2024-08-06 00:35:53,034][52663] DAMAGECOUNT value on done: 121993.0 [2024-08-06 00:35:53,034][52663] Sum rewards: 58.740, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.714', 'WEAPON3': '0.750', 'weapon3': '2.752', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:53,676][52820] DAMAGECOUNT value on done: 112147.0 [2024-08-06 00:35:53,676][52820] Sum rewards: 58.338, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.570', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon4': '0.200', 'WEAPON3': '0.800', 'weapon2': '0.966', 'weapon3': '2.738', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '47.000'} [2024-08-06 00:35:53,898][52650] Updated weights for policy 0, policy_version 23881 (0.0032) [2024-08-06 00:35:54,521][52649] DAMAGECOUNT value on done: 125013.0 [2024-08-06 00:35:54,521][52649] Sum rewards: 61.415, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.006', 'AMMO4': '0.027', 'HEALTH': '0.083', 'AMMO3': '0.159', 'weapon2': '0.674', 'WEAPON3': '0.900', 'HITCOUNT': '3.110', 'weapon3': '3.188', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:55,105][52647] DAMAGECOUNT value on done: 126629.0 [2024-08-06 00:35:55,106][52647] Sum rewards: 47.274, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'ARMOR': '0.020', 'weapon5': '0.030', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.198', 'AMMO3': '0.198', 'WEAPON4': '0.400', 'weapon2': '0.570', 'weapon4': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.556', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '43.000'} [2024-08-06 00:35:55,526][52658] DAMAGECOUNT value on done: 124462.0 [2024-08-06 00:35:55,527][52658] Sum rewards: 58.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:55,745][52666] DAMAGECOUNT value on done: 121143.0 [2024-08-06 00:35:55,749][52666] Sum rewards: 63.602, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.233', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.108', 'weapon5': '0.146', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.600', 'WEAPON3': '0.700', 'weapon3': '2.646', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '49.000'} [2024-08-06 00:35:55,910][52670] DAMAGECOUNT value on done: 115080.0 [2024-08-06 00:35:55,913][52670] Sum rewards: 54.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.932', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.024', 'weapon5': '0.058', 'AMMO4': '0.089', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.418', 'weapon2': '0.684', 'WEAPON3': '0.850', 'weapon3': '2.686', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:56,244][52663] DAMAGECOUNT value on done: 117409.0 [2024-08-06 00:35:56,244][52663] Sum rewards: 56.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.494', 'AMMO5': '0.003', 'AMMO2': '0.018', 'ARMOR': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.138', 'WEAPON4': '0.450', 'weapon4': '0.522', 'weapon2': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.598', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:56,922][52820] DAMAGECOUNT value on done: 111970.0 [2024-08-06 00:35:56,925][52820] Sum rewards: 56.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.348', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon4': '0.254', 'weapon2': '0.382', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.994', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '46.000'} [2024-08-06 00:35:57,158][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:35:57,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 195706880. Throughput: 0: 4393.6. Samples: 48932840. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:35:57,794][52567] Avg episode reward: [(0, '55.820')] [2024-08-06 00:35:57,797][52614] Saving new best policy, reward=55.820! [2024-08-06 00:35:58,445][52650] Updated weights for policy 0, policy_version 23891 (0.0020) [2024-08-06 00:35:58,746][52658] DAMAGECOUNT value on done: 126070.0 [2024-08-06 00:35:58,747][52658] Sum rewards: 63.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '53.000'} [2024-08-06 00:35:58,839][52666] DAMAGECOUNT value on done: 118203.0 [2024-08-06 00:35:58,841][52666] Sum rewards: 61.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.306', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.698', 'WEAPON3': '0.800', 'weapon3': '2.832', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:58,983][52670] DAMAGECOUNT value on done: 118022.0 [2024-08-06 00:35:58,983][52670] Sum rewards: 55.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.450', 'weapon2': '0.464', 'weapon4': '0.620', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '48.000'} [2024-08-06 00:35:59,308][52663] DAMAGECOUNT value on done: 125563.0 [2024-08-06 00:35:59,308][52663] Sum rewards: 56.244, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.765', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'weapon4': '0.106', 'AMMO3': '0.136', 'WEAPON3': '0.900', 'weapon2': '1.022', 'weapon3': '2.730', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '45.000'} [2024-08-06 00:35:59,555][52671] DAMAGECOUNT value on done: 126488.0 [2024-08-06 00:35:59,556][52671] Sum rewards: 63.002, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.362', 'HEALTH': '0.579', 'weapon2': '0.630', 'WEAPON3': '0.800', 'weapon3': '2.886', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '50.000'} [2024-08-06 00:35:59,970][52820] DAMAGECOUNT value on done: 113126.0 [2024-08-06 00:35:59,970][52820] Sum rewards: 59.386, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.718', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon4': '0.412', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:01,295][52658] Large shaping reward 2.676 for [('FRAGCOUNT', 3.0, 3.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.405, 135.0), ('HEALTH', -0.03, -10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:36:01,422][52658] DAMAGECOUNT value on done: 116980.0 [2024-08-06 00:36:01,424][52658] Sum rewards: 60.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.827', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.053', 'weapon5': '0.148', 'AMMO3': '0.171', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.430', 'weapon4': '0.442', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:01,626][52666] DAMAGECOUNT value on done: 116502.0 [2024-08-06 00:36:01,626][52666] Sum rewards: 63.341, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon5': '0.212', 'weapon2': '0.300', 'weapon4': '0.346', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:01,825][52670] DAMAGECOUNT value on done: 114362.0 [2024-08-06 00:36:01,825][52670] Sum rewards: 58.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon4': '0.454', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.768', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:02,525][52663] DAMAGECOUNT value on done: 121931.0 [2024-08-06 00:36:02,526][52663] Sum rewards: 52.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.220', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:02,630][52671] DAMAGECOUNT value on done: 120382.0 [2024-08-06 00:36:02,630][52671] Sum rewards: 52.443, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.342', 'AMMO5': '0.003', 'ARMOR': '0.036', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'AMMO4': '0.189', 'weapon4': '0.256', 'WEAPON4': '0.500', 'weapon2': '0.834', 'WEAPON3': '0.900', 'weapon3': '2.646', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '43.000'} [2024-08-06 00:36:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 195780608. Throughput: 0: 4385.1. Samples: 48945680. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:36:02,795][52567] Avg episode reward: [(0, '56.229')] [2024-08-06 00:36:02,841][52614] Saving new best policy, reward=56.229! [2024-08-06 00:36:03,191][52820] DAMAGECOUNT value on done: 110567.0 [2024-08-06 00:36:03,192][52820] Sum rewards: 49.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.297', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.162', 'WEAPON4': '0.500', 'weapon2': '0.542', 'weapon4': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.546', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '42.000'} [2024-08-06 00:36:03,338][52650] Updated weights for policy 0, policy_version 23901 (0.0015) [2024-08-06 00:36:03,959][52658] DAMAGECOUNT value on done: 120963.0 [2024-08-06 00:36:03,959][52658] Sum rewards: 60.136, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.368', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.314', 'weapon2': '0.334', 'WEAPON3': '0.850', 'HITCOUNT': '3.070', 'weapon3': '3.100', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:04,113][52666] DAMAGECOUNT value on done: 120756.0 [2024-08-06 00:36:04,113][52666] Sum rewards: 70.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.018', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '59.000'} [2024-08-06 00:36:04,256][52670] DAMAGECOUNT value on done: 112100.0 [2024-08-06 00:36:04,258][52670] Sum rewards: 64.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.932', 'ARMOR': '0.004', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '54.000'} [2024-08-06 00:36:04,315][52803] DAMAGECOUNT value on done: 114946.0 [2024-08-06 00:36:04,315][52803] Sum rewards: 42.404, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.172', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.472', 'weapon4': '0.542', 'WEAPON3': '1.050', 'HITCOUNT': '2.200', 'weapon3': '2.674', 'DAMAGECOUNT': '10.164', 'FRAGCOUNT': '38.000'} [2024-08-06 00:36:05,050][52665] DAMAGECOUNT value on done: 116995.0 [2024-08-06 00:36:05,052][52665] Sum rewards: 54.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.137', 'AMMO2': '0.020', 'ARMOR': '0.028', 'AMMO4': '0.099', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.310', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.234', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:05,420][52671] DAMAGECOUNT value on done: 125173.0 [2024-08-06 00:36:05,421][52671] Sum rewards: 57.369, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.880', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.149', 'AMMO3': '0.160', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.676', 'WEAPON3': '0.950', 'weapon3': '2.868', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '45.500'} [2024-08-06 00:36:05,823][52663] DAMAGECOUNT value on done: 119717.0 [2024-08-06 00:36:05,825][52663] Sum rewards: 54.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.028', 'ARMOR': '0.040', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.204', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.134', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:06,333][52820] DAMAGECOUNT value on done: 113628.0 [2024-08-06 00:36:06,335][52820] Sum rewards: 56.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.062', 'AMMO3': '0.167', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.336', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.952', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:06,746][52658] DAMAGECOUNT value on done: 123729.0 [2024-08-06 00:36:06,748][52658] Sum rewards: 50.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.630', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.286', 'weapon4': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.880', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:07,077][52666] DAMAGECOUNT value on done: 121017.0 [2024-08-06 00:36:07,077][52666] Sum rewards: 57.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.078', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO4': '0.190', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.150', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:07,184][52670] DAMAGECOUNT value on done: 122886.0 [2024-08-06 00:36:07,184][52670] Sum rewards: 50.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.144', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'weapon5': '0.124', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.676', 'WEAPON3': '1.150', 'weapon3': '2.542', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:07,457][52803] DAMAGECOUNT value on done: 117742.0 [2024-08-06 00:36:07,457][52803] Sum rewards: 62.514, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.010', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon2': '0.226', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '55.000'} [2024-08-06 00:36:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 195870720. Throughput: 0: 4385.3. Samples: 48972010. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 00:36:07,794][52567] Avg episode reward: [(0, '56.182')] [2024-08-06 00:36:08,076][52650] Updated weights for policy 0, policy_version 23911 (0.0028) [2024-08-06 00:36:08,168][52665] DAMAGECOUNT value on done: 126577.0 [2024-08-06 00:36:08,170][52665] Sum rewards: 65.221, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.699', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.226', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '53.000'} [2024-08-06 00:36:08,508][52671] DAMAGECOUNT value on done: 119742.0 [2024-08-06 00:36:08,509][52671] Sum rewards: 58.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.182', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:08,677][52663] DAMAGECOUNT value on done: 123210.0 [2024-08-06 00:36:08,678][52663] Sum rewards: 64.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.006', 'ARMOR': '0.013', 'AMMO2': '0.031', 'weapon5': '0.108', 'AMMO4': '0.157', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '54.000'} [2024-08-06 00:36:09,532][52820] DAMAGECOUNT value on done: 114227.0 [2024-08-06 00:36:09,534][52820] Sum rewards: 50.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.312', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.183', 'weapon4': '0.224', 'weapon2': '0.738', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.832', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '42.000'} [2024-08-06 00:36:09,907][52666] DAMAGECOUNT value on done: 120112.0 [2024-08-06 00:36:09,909][52666] Sum rewards: 50.736, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.798', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.217', 'AMMO3': '0.284', 'weapon2': '0.334', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:10,029][52670] DAMAGECOUNT value on done: 121571.0 [2024-08-06 00:36:10,031][52670] Sum rewards: 51.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.575', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon5': '0.182', 'AMMO4': '0.306', 'weapon2': '0.344', 'WEAPON4': '0.500', 'weapon4': '0.732', 'WEAPON3': '1.150', 'weapon3': '2.520', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '42.000'} [2024-08-06 00:36:10,630][52803] DAMAGECOUNT value on done: 114280.0 [2024-08-06 00:36:10,631][52803] Sum rewards: 64.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.192', 'weapon4': '0.266', 'WEAPON4': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '54.000'} [2024-08-06 00:36:11,296][52665] DAMAGECOUNT value on done: 120629.0 [2024-08-06 00:36:11,296][52665] Sum rewards: 54.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.412', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.159', 'weapon5': '0.210', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.450', 'weapon4': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.682', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:11,299][52811] DAMAGECOUNT value on done: 121971.0 [2024-08-06 00:36:11,300][52811] Sum rewards: 72.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.634', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.194', 'AMMO4': '0.224', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '60.000'} [2024-08-06 00:36:11,304][52663] DAMAGECOUNT value on done: 123423.0 [2024-08-06 00:36:11,304][52663] Sum rewards: 60.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.087', 'AMMO3': '0.184', 'WEAPON4': '0.400', 'weapon2': '0.424', 'weapon4': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '52.000'} [2024-08-06 00:36:11,449][52671] DAMAGECOUNT value on done: 121636.0 [2024-08-06 00:36:11,449][52671] Sum rewards: 56.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.162', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.050', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'AMMO4': '0.248', 'weapon4': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:12,074][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:36:12,357][52666] DAMAGECOUNT value on done: 118227.0 [2024-08-06 00:36:12,357][52666] Sum rewards: 57.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.666', 'WEAPON3': '1.350', 'weapon3': '2.514', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:12,478][52670] DAMAGECOUNT value on done: 121179.0 [2024-08-06 00:36:12,478][52670] Sum rewards: 57.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:12,742][52820] DAMAGECOUNT value on done: 114795.0 [2024-08-06 00:36:12,742][52820] Sum rewards: 53.886, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.732', 'AMMO5': '0.003', 'weapon5': '0.036', 'AMMO2': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'AMMO4': '0.268', 'weapon2': '0.354', 'WEAPON4': '0.600', 'weapon4': '0.698', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:12,742][52650] Updated weights for policy 0, policy_version 23921 (0.0014) [2024-08-06 00:36:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 195960832. Throughput: 0: 4381.3. Samples: 48998590. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 00:36:12,795][52567] Avg episode reward: [(0, '56.745')] [2024-08-06 00:36:12,795][52614] Saving new best policy, reward=56.745! [2024-08-06 00:36:13,788][52803] DAMAGECOUNT value on done: 114229.0 [2024-08-06 00:36:13,790][52803] Sum rewards: 53.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.056', 'ARMOR': '0.024', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.179', 'weapon2': '0.494', 'WEAPON4': '0.500', 'weapon4': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.358', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '46.000'} [2024-08-06 00:36:14,229][52665] DAMAGECOUNT value on done: 116329.0 [2024-08-06 00:36:14,229][52665] Sum rewards: 47.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.422', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon4': '0.188', 'AMMO4': '0.190', 'weapon2': '0.208', 'AMMO3': '0.213', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.600', 'weapon3': '3.154', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '42.000'} [2024-08-06 00:36:14,438][52671] DAMAGECOUNT value on done: 123083.0 [2024-08-06 00:36:14,440][52671] Sum rewards: 48.008, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.360', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.150', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '44.500'} [2024-08-06 00:36:14,483][52811] DAMAGECOUNT value on done: 112770.0 [2024-08-06 00:36:14,484][52811] Sum rewards: 50.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.619', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.398', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.128', 'DAMAGECOUNT': '12.012', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:14,617][52663] DAMAGECOUNT value on done: 121648.0 [2024-08-06 00:36:14,617][52663] Sum rewards: 56.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.720', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.236', 'weapon2': '0.520', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.206', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:15,050][52666] DAMAGECOUNT value on done: 118217.0 [2024-08-06 00:36:15,052][52666] Sum rewards: 54.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.174', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.346', 'weapon4': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.006', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:15,183][52670] DAMAGECOUNT value on done: 120610.0 [2024-08-06 00:36:15,184][52670] Sum rewards: 54.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.366', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.256', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:16,195][52820] DAMAGECOUNT value on done: 110978.0 [2024-08-06 00:36:16,196][52820] Sum rewards: 60.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.554', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.172', 'AMMO3': '0.211', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.652', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:16,805][52803] DAMAGECOUNT value on done: 118600.0 [2024-08-06 00:36:16,809][52803] Sum rewards: 59.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.831', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:17,247][52665] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 00:36:17,257][52665] DAMAGECOUNT value on done: 119414.0 [2024-08-06 00:36:17,264][52665] Sum rewards: 57.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'weapon5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'AMMO4': '0.330', 'weapon2': '0.380', 'WEAPON4': '0.700', 'weapon4': '0.920', 'WEAPON3': '1.000', 'weapon3': '2.428', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:17,329][52650] Updated weights for policy 0, policy_version 23931 (0.0012) [2024-08-06 00:36:17,382][52663] DAMAGECOUNT value on done: 120587.0 [2024-08-06 00:36:17,382][52663] Sum rewards: 55.527, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.851', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.178', 'weapon4': '0.186', 'AMMO3': '0.213', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:17,449][52671] DAMAGECOUNT value on done: 122936.0 [2024-08-06 00:36:17,449][52671] Sum rewards: 51.537, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.743', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.245', 'AMMO3': '0.260', 'weapon4': '0.270', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.028', 'DAMAGECOUNT': '12.972', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:17,573][52811] DAMAGECOUNT value on done: 113362.0 [2024-08-06 00:36:17,574][52811] Sum rewards: 46.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.234', 'AMMO5': '0.015', 'weapon5': '0.026', 'ARMOR': '0.028', 'AMMO2': '0.051', 'AMMO3': '0.228', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.614', 'weapon2': '0.694', 'WEAPON3': '1.350', 'weapon3': '2.378', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '43.000'} [2024-08-06 00:36:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 196042752. Throughput: 0: 4367.8. Samples: 49011410. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 00:36:17,795][52567] Avg episode reward: [(0, '56.234')] [2024-08-06 00:36:17,929][52666] DAMAGECOUNT value on done: 123046.0 [2024-08-06 00:36:17,930][52666] Sum rewards: 51.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:18,228][52670] DAMAGECOUNT value on done: 124887.0 [2024-08-06 00:36:18,231][52670] Sum rewards: 56.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'ARMOR': '0.008', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.204', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.776', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:19,311][52820] DAMAGECOUNT value on done: 112649.0 [2024-08-06 00:36:19,315][52820] Sum rewards: 62.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.530', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.203', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.486', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '52.000'} [2024-08-06 00:36:19,483][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:36:19,974][52665] DAMAGECOUNT value on done: 119278.0 [2024-08-06 00:36:19,975][52665] Sum rewards: 50.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.612', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.165', 'WEAPON4': '0.450', 'weapon2': '0.496', 'weapon4': '0.608', 'WEAPON3': '1.050', 'weapon3': '2.634', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:19,980][52803] DAMAGECOUNT value on done: 115504.0 [2024-08-06 00:36:19,982][52803] Sum rewards: 58.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.726', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.306', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:19,988][52663] DAMAGECOUNT value on done: 116448.0 [2024-08-06 00:36:19,988][52663] Sum rewards: 55.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.701', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.070', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.344', 'weapon4': '0.488', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:20,268][52671] DAMAGECOUNT value on done: 124531.0 [2024-08-06 00:36:20,268][52671] Sum rewards: 58.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.082', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.456', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.162', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:20,599][52811] DAMAGECOUNT value on done: 113674.0 [2024-08-06 00:36:20,599][52811] Sum rewards: 63.860, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.380', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.116', 'AMMO4': '0.207', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.336', 'weapon4': '0.582', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.716', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 00:36:21,026][52666] DAMAGECOUNT value on done: 118309.0 [2024-08-06 00:36:21,029][52666] Sum rewards: 53.367, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.293', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.066', 'WEAPON5': '0.250', 'AMMO4': '0.256', 'AMMO3': '0.280', 'weapon2': '0.464', 'WEAPON4': '0.500', 'weapon4': '0.570', 'WEAPON3': '1.600', 'weapon3': '2.510', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:21,300][52670] DAMAGECOUNT value on done: 114526.0 [2024-08-06 00:36:21,301][52670] Sum rewards: 61.501, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.098', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.191', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '3.290', 'weapon3': '3.314', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:22,100][52650] Updated weights for policy 0, policy_version 23941 (0.0012) [2024-08-06 00:36:22,342][52820] DAMAGECOUNT value on done: 116104.0 [2024-08-06 00:36:22,344][52820] Sum rewards: 68.003, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.075', 'AMMO3': '0.140', 'weapon4': '0.152', 'HEALTH': '0.332', 'weapon2': '0.464', 'WEAPON3': '0.850', 'HITCOUNT': '3.070', 'weapon3': '3.240', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '54.000'} [2024-08-06 00:36:22,518][52663] DAMAGECOUNT value on done: 119364.0 [2024-08-06 00:36:22,520][52663] Sum rewards: 57.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.094', 'AMMO4': '0.117', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.392', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.176', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 196141056. Throughput: 0: 4375.8. Samples: 49037930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:36:22,794][52567] Avg episode reward: [(0, '56.239')] [2024-08-06 00:36:22,860][52665] DAMAGECOUNT value on done: 120833.0 [2024-08-06 00:36:22,862][52665] Sum rewards: 62.470, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.133', 'weapon4': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.874', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '49.500'} [2024-08-06 00:36:23,064][52803] DAMAGECOUNT value on done: 117913.0 [2024-08-06 00:36:23,064][52803] Sum rewards: 54.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '2.808', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '47.500'} [2024-08-06 00:36:23,267][52671] DAMAGECOUNT value on done: 120275.0 [2024-08-06 00:36:23,269][52671] Sum rewards: 45.012, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.975', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.008', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO4': '0.215', 'AMMO3': '0.221', 'weapon2': '0.448', 'WEAPON4': '0.550', 'weapon4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.454', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.486', 'FRAGCOUNT': '43.000'} [2024-08-06 00:36:23,620][52811] DAMAGECOUNT value on done: 114328.0 [2024-08-06 00:36:23,620][52811] Sum rewards: 51.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.779', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.181', 'AMMO4': '0.183', 'weapon2': '0.404', 'WEAPON4': '0.500', 'weapon4': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:23,848][52666] DAMAGECOUNT value on done: 119724.0 [2024-08-06 00:36:23,852][52666] Sum rewards: 48.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.008', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.516', 'weapon2': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.198', 'FRAGCOUNT': '43.000'} [2024-08-06 00:36:24,085][52670] DAMAGECOUNT value on done: 123635.0 [2024-08-06 00:36:24,094][52670] Sum rewards: 50.761, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.206', 'weapon2': '0.930', 'WEAPON3': '1.050', 'weapon3': '2.602', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '41.500'} [2024-08-06 00:36:24,435][52659] DAMAGECOUNT value on done: 122541.0 [2024-08-06 00:36:24,436][52659] Sum rewards: 56.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:25,411][52665] DAMAGECOUNT value on done: 123586.0 [2024-08-06 00:36:25,411][52665] Sum rewards: 73.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.108', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '61.000'} [2024-08-06 00:36:25,429][52820] DAMAGECOUNT value on done: 114042.0 [2024-08-06 00:36:25,429][52820] Sum rewards: 54.784, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.526', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.744', 'WEAPON3': '0.900', 'weapon3': '2.838', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '43.000'} [2024-08-06 00:36:25,530][52663] DAMAGECOUNT value on done: 123495.0 [2024-08-06 00:36:25,531][52663] Sum rewards: 53.550, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.865', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.374', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:26,104][52671] DAMAGECOUNT value on done: 123496.0 [2024-08-06 00:36:26,104][52671] Sum rewards: 64.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.868', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '54.000'} [2024-08-06 00:36:26,127][52803] DAMAGECOUNT value on done: 113635.0 [2024-08-06 00:36:26,128][52803] Sum rewards: 43.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.682', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.045', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.226', 'weapon2': '0.500', 'WEAPON4': '0.750', 'weapon4': '0.784', 'WEAPON3': '1.250', 'weapon3': '2.462', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '38.000'} [2024-08-06 00:36:26,546][52650] Updated weights for policy 0, policy_version 23951 (0.0012) [2024-08-06 00:36:26,958][52811] DAMAGECOUNT value on done: 118406.0 [2024-08-06 00:36:26,958][52811] Sum rewards: 55.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.215', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.156', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:27,088][52670] DAMAGECOUNT value on done: 121320.0 [2024-08-06 00:36:27,088][52670] Sum rewards: 56.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.237', 'AMMO5': '0.003', 'AMMO2': '0.030', 'ARMOR': '0.040', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:27,229][52659] DAMAGECOUNT value on done: 121173.0 [2024-08-06 00:36:27,230][52659] Sum rewards: 48.235, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.399', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.223', 'AMMO3': '0.244', 'weapon2': '0.398', 'WEAPON4': '0.550', 'weapon4': '0.554', 'WEAPON3': '1.400', 'weapon3': '2.696', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 196222976. Throughput: 0: 4379.1. Samples: 49064310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:36:27,794][52567] Avg episode reward: [(0, '56.168')] [2024-08-06 00:36:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023953_196222976.pth... [2024-08-06 00:36:27,921][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023438_192004096.pth [2024-08-06 00:36:28,224][52665] DAMAGECOUNT value on done: 126366.0 [2024-08-06 00:36:28,225][52665] Sum rewards: 64.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.133', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'weapon2': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:28,560][52820] DAMAGECOUNT value on done: 113591.0 [2024-08-06 00:36:28,562][52820] Sum rewards: 57.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.722', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.432', 'weapon4': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:28,695][52663] DAMAGECOUNT value on done: 123501.0 [2024-08-06 00:36:28,697][52663] Sum rewards: 53.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO2': '0.036', 'weapon4': '0.092', 'AMMO4': '0.182', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.292', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:28,951][52671] DAMAGECOUNT value on done: 122015.0 [2024-08-06 00:36:28,953][52671] Sum rewards: 51.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.246', 'AMMO5': '0.004', 'AMMO2': '0.033', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.225', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.704', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:29,456][52803] DAMAGECOUNT value on done: 114787.0 [2024-08-06 00:36:29,456][52803] Sum rewards: 59.316, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.777', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.152', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.392', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.700', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:30,117][52659] DAMAGECOUNT value on done: 122095.0 [2024-08-06 00:36:30,119][52659] Sum rewards: 51.372, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.096', 'ARMOR': '0.004', 'AMMO2': '0.041', 'AMMO3': '0.202', 'AMMO4': '0.204', 'WEAPON4': '0.400', 'weapon4': '0.430', 'weapon2': '0.470', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '2.924', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '46.000'} [2024-08-06 00:36:30,120][52811] DAMAGECOUNT value on done: 113887.0 [2024-08-06 00:36:30,122][52811] Sum rewards: 47.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.159', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.057', 'weapon5': '0.114', 'AMMO3': '0.204', 'AMMO4': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '42.500'} [2024-08-06 00:36:30,228][52670] DAMAGECOUNT value on done: 119517.0 [2024-08-06 00:36:30,230][52670] Sum rewards: 67.778, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.442', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '55.000'} [2024-08-06 00:36:31,148][52665] DAMAGECOUNT value on done: 121695.0 [2024-08-06 00:36:31,151][52665] Sum rewards: 51.172, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.104', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.250', 'weapon4': '0.426', 'WEAPON3': '0.850', 'weapon2': '0.872', 'weapon3': '2.308', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '40.000'} [2024-08-06 00:36:31,291][52650] Updated weights for policy 0, policy_version 23961 (0.0026) [2024-08-06 00:36:31,715][52820] DAMAGECOUNT value on done: 115073.0 [2024-08-06 00:36:31,719][52820] Sum rewards: 54.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.510', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.174', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:31,845][52663] DAMAGECOUNT value on done: 124100.0 [2024-08-06 00:36:31,846][52663] Sum rewards: 48.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.036', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.166', 'AMMO4': '0.191', 'weapon5': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.560', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.696', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '43.000'} [2024-08-06 00:36:31,893][52671] DAMAGECOUNT value on done: 122065.0 [2024-08-06 00:36:31,894][52671] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO2': '0.007', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.035', 'weapon5': '0.056', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon2': '0.600', 'WEAPON3': '0.950', 'weapon3': '3.088', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:32,664][52803] DAMAGECOUNT value on done: 110526.0 [2024-08-06 00:36:32,664][52803] Sum rewards: 48.374, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.198', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.125', 'AMMO4': '0.185', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '0.800', 'HITCOUNT': '2.420', 'weapon3': '2.714', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '41.000'} [2024-08-06 00:36:32,665][52670] DAMAGECOUNT value on done: 118152.0 [2024-08-06 00:36:32,665][52670] Sum rewards: 56.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.158', 'AMMO3': '0.222', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 196313088. Throughput: 0: 4375.1. Samples: 49077160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:36:32,794][52567] Avg episode reward: [(0, '56.383')] [2024-08-06 00:36:33,241][52659] DAMAGECOUNT value on done: 124070.0 [2024-08-06 00:36:33,247][52811] DAMAGECOUNT value on done: 113450.0 [2024-08-06 00:36:33,250][52659] Sum rewards: 69.081, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.039', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon4': '0.314', 'weapon2': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.708', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.000'} [2024-08-06 00:36:33,250][52811] Sum rewards: 59.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.235', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.944', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:33,971][52665] DAMAGECOUNT value on done: 122448.0 [2024-08-06 00:36:33,972][52665] Sum rewards: 52.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO5': '0.018', 'weapon5': '0.026', 'AMMO4': '0.078', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:34,615][52663] DAMAGECOUNT value on done: 123854.0 [2024-08-06 00:36:34,617][52663] Sum rewards: 46.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.215', 'weapon2': '0.226', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '3.184', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '41.000'} [2024-08-06 00:36:34,659][52671] DAMAGECOUNT value on done: 127526.0 [2024-08-06 00:36:34,660][52671] Sum rewards: 54.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.510', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.138', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '46.000'} [2024-08-06 00:36:34,948][52820] DAMAGECOUNT value on done: 116511.0 [2024-08-06 00:36:34,949][52820] Sum rewards: 55.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.961', 'AMMO2': '0.016', 'ARMOR': '0.024', 'AMMO4': '0.081', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.416', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.202', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:35,701][52803] DAMAGECOUNT value on done: 117348.0 [2024-08-06 00:36:35,703][52803] Sum rewards: 60.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.704', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.196', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.410', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.626', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '52.000'} [2024-08-06 00:36:35,932][52659] DAMAGECOUNT value on done: 121629.0 [2024-08-06 00:36:35,933][52659] Sum rewards: 39.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.685', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.126', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.562', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon2': '1.004', 'weapon3': '2.092', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.337', 'FRAGCOUNT': '34.000'} [2024-08-06 00:36:36,048][52650] Updated weights for policy 0, policy_version 23971 (0.0028) [2024-08-06 00:36:36,280][52811] DAMAGECOUNT value on done: 118187.0 [2024-08-06 00:36:36,283][52811] Sum rewards: 65.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.171', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '53.000'} [2024-08-06 00:36:37,013][52665] DAMAGECOUNT value on done: 121560.0 [2024-08-06 00:36:37,014][52665] Sum rewards: 53.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.688', 'AMMO5': '0.005', 'AMMO2': '0.023', 'ARMOR': '0.024', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:37,554][52663] DAMAGECOUNT value on done: 122975.0 [2024-08-06 00:36:37,556][52663] Sum rewards: 41.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.915', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.159', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.100', 'HITCOUNT': '2.140', 'weapon3': '2.958', 'DAMAGECOUNT': '10.839', 'FRAGCOUNT': '37.500'} [2024-08-06 00:36:37,733][52671] DAMAGECOUNT value on done: 123211.0 [2024-08-06 00:36:37,733][52671] Sum rewards: 58.520, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.046', 'weapon4': '0.054', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.344', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.380', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 196395008. Throughput: 0: 4378.9. Samples: 49103420. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:36:37,794][52567] Avg episode reward: [(0, '56.010')] [2024-08-06 00:36:38,024][52820] DAMAGECOUNT value on done: 112113.0 [2024-08-06 00:36:38,024][52820] Sum rewards: 47.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.160', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.484', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '2.916', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '41.000'} [2024-08-06 00:36:38,865][52803] DAMAGECOUNT value on done: 118515.0 [2024-08-06 00:36:38,868][52803] Sum rewards: 43.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.294', 'WEAPON4': '0.450', 'weapon4': '0.620', 'WEAPON3': '1.350', 'weapon3': '2.576', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '39.000'} [2024-08-06 00:36:39,046][52659] DAMAGECOUNT value on done: 122319.0 [2024-08-06 00:36:39,046][52659] Sum rewards: 57.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon5': '0.140', 'AMMO3': '0.179', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'weapon4': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.684', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:39,297][52811] DAMAGECOUNT value on done: 113798.0 [2024-08-06 00:36:39,297][52811] Sum rewards: 55.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.642', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.157', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.562', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.874', 'DAMAGECOUNT': '11.484', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:39,759][52665] DAMAGECOUNT value on done: 121357.0 [2024-08-06 00:36:39,761][52665] Sum rewards: 56.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.210', 'weapon4': '0.348', 'weapon2': '0.456', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.008', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:40,423][52663] DAMAGECOUNT value on done: 121340.0 [2024-08-06 00:36:40,425][52663] Sum rewards: 57.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.066', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'ARMOR': '0.453', 'weapon2': '0.500', 'weapon4': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.624', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:40,768][52671] DAMAGECOUNT value on done: 119508.0 [2024-08-06 00:36:40,769][52671] Sum rewards: 51.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.572', 'WEAPON3': '0.950', 'HITCOUNT': '2.560', 'weapon3': '3.146', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '42.000'} [2024-08-06 00:36:40,786][52650] Updated weights for policy 0, policy_version 23981 (0.0010) [2024-08-06 00:36:41,974][52803] DAMAGECOUNT value on done: 115843.0 [2024-08-06 00:36:41,974][52803] Sum rewards: 62.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.006', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.088', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.318', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.336', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '53.500'} [2024-08-06 00:36:41,979][52659] DAMAGECOUNT value on done: 123254.0 [2024-08-06 00:36:41,979][52659] Sum rewards: 49.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.243', 'weapon2': '0.682', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '2.862', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:42,395][52811] DAMAGECOUNT value on done: 114984.0 [2024-08-06 00:36:42,396][52811] Sum rewards: 55.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO3': '0.186', 'AMMO4': '0.187', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.586', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 196485120. Throughput: 0: 4376.9. Samples: 49129800. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:36:42,796][52567] Avg episode reward: [(0, '55.499')] [2024-08-06 00:36:42,793][52665] DAMAGECOUNT value on done: 121036.0 [2024-08-06 00:36:42,797][52665] Sum rewards: 56.294, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.047', 'weapon4': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.170', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '46.000'} [2024-08-06 00:36:43,500][52671] DAMAGECOUNT value on done: 125386.0 [2024-08-06 00:36:43,501][52671] Sum rewards: 42.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.812', 'AMMO5': '0.008', 'ARMOR': '0.036', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO3': '0.157', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.382', 'WEAPON4': '0.550', 'weapon2': '0.612', 'WEAPON3': '1.000', 'weapon3': '2.616', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '38.500'} [2024-08-06 00:36:44,918][52659] DAMAGECOUNT value on done: 117922.0 [2024-08-06 00:36:44,921][52659] Sum rewards: 49.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.086', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.678', 'WEAPON3': '1.050', 'HITCOUNT': '2.630', 'weapon3': '2.668', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '42.000'} [2024-08-06 00:36:45,085][52803] DAMAGECOUNT value on done: 115847.0 [2024-08-06 00:36:45,088][52803] Sum rewards: 47.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.656', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.774', 'DAMAGECOUNT': '11.631', 'FRAGCOUNT': '41.000'} [2024-08-06 00:36:45,438][52811] DAMAGECOUNT value on done: 113928.0 [2024-08-06 00:36:45,439][52811] Sum rewards: 49.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.731', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.176', 'AMMO3': '0.184', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '42.000'} [2024-08-06 00:36:45,490][52650] Updated weights for policy 0, policy_version 23991 (0.0011) [2024-08-06 00:36:45,916][52665] DAMAGECOUNT value on done: 120507.0 [2024-08-06 00:36:45,917][52665] Sum rewards: 55.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.938', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'AMMO3': '0.171', 'weapon2': '0.296', 'WEAPON4': '0.400', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.920', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '46.000'} [2024-08-06 00:36:45,978][52665] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:36:46,510][52671] DAMAGECOUNT value on done: 121941.0 [2024-08-06 00:36:46,512][52671] Sum rewards: 47.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.155', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.215', 'weapon4': '0.398', 'WEAPON4': '0.500', 'weapon2': '0.778', 'WEAPON3': '1.200', 'weapon3': '2.480', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:47,728][52659] DAMAGECOUNT value on done: 122409.0 [2024-08-06 00:36:47,728][52659] Sum rewards: 67.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.442', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.222', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 00:36:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 196575232. Throughput: 0: 4387.3. Samples: 49143110. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:36:47,794][52567] Avg episode reward: [(0, '55.180')] [2024-08-06 00:36:48,145][52803] DAMAGECOUNT value on done: 113264.0 [2024-08-06 00:36:48,145][52803] Sum rewards: 52.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.737', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.652', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '46.000'} [2024-08-06 00:36:48,508][52811] DAMAGECOUNT value on done: 115937.0 [2024-08-06 00:36:48,510][52811] Sum rewards: 49.607, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.758', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon5': '0.224', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.458', 'WEAPON3': '1.500', 'weapon3': '2.602', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '46.000'} [2024-08-06 00:36:49,244][52665] DAMAGECOUNT value on done: 118746.0 [2024-08-06 00:36:49,244][52665] Sum rewards: 61.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.027', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.151', 'weapon4': '0.230', 'weapon2': '0.482', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.142', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:49,492][52671] DAMAGECOUNT value on done: 122597.0 [2024-08-06 00:36:49,493][52671] Sum rewards: 41.565, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.070', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.188', 'AMMO3': '0.285', 'WEAPON4': '0.450', 'weapon2': '0.476', 'weapon4': '0.622', 'WEAPON3': '1.600', 'weapon3': '2.568', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.504', 'FRAGCOUNT': '41.000'} [2024-08-06 00:36:50,120][52650] Updated weights for policy 0, policy_version 24001 (0.0011) [2024-08-06 00:36:50,855][52659] DAMAGECOUNT value on done: 123938.0 [2024-08-06 00:36:50,855][52659] Sum rewards: 48.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO2': '0.002', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO4': '0.010', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.244', 'weapon2': '0.408', 'WEAPON3': '1.600', 'HITCOUNT': '2.810', 'weapon3': '3.354', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:51,189][52803] DAMAGECOUNT value on done: 111514.0 [2024-08-06 00:36:51,189][52803] Sum rewards: 50.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.359', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon4': '0.570', 'weapon2': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.979', 'FRAGCOUNT': '44.000'} [2024-08-06 00:36:51,616][52811] DAMAGECOUNT value on done: 116494.0 [2024-08-06 00:36:51,618][52811] Sum rewards: 57.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.767', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.117', 'weapon2': '0.210', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.684', 'WEAPON3': '1.400', 'weapon3': '2.846', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '49.000'} [2024-08-06 00:36:52,000][52665] DAMAGECOUNT value on done: 119582.0 [2024-08-06 00:36:52,000][52665] Sum rewards: 50.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.391', 'AMMO5': '0.009', 'AMMO2': '0.028', 'ARMOR': '0.036', 'AMMO4': '0.141', 'weapon5': '0.152', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.406', 'weapon4': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '42.500'} [2024-08-06 00:36:52,493][52671] DAMAGECOUNT value on done: 123379.0 [2024-08-06 00:36:52,495][52671] Sum rewards: 60.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.135', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '50.500'} [2024-08-06 00:36:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 196657152. Throughput: 0: 4381.8. Samples: 49169190. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:36:52,795][52567] Avg episode reward: [(0, '54.812')] [2024-08-06 00:36:53,817][52659] DAMAGECOUNT value on done: 121585.0 [2024-08-06 00:36:53,820][52659] Sum rewards: 56.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.199', 'AMMO4': '0.214', 'weapon4': '0.438', 'weapon2': '0.494', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.794', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '50.000'} [2024-08-06 00:36:54,260][52803] DAMAGECOUNT value on done: 116155.0 [2024-08-06 00:36:54,263][52803] Sum rewards: 60.622, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.410', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.010', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon2': '0.346', 'weapon4': '0.502', 'WEAPON3': '0.900', 'weapon3': '2.916', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '48.000'} [2024-08-06 00:36:54,486][52650] Updated weights for policy 0, policy_version 24011 (0.0036) [2024-08-06 00:36:54,501][52811] DAMAGECOUNT value on done: 117112.0 [2024-08-06 00:36:54,501][52811] Sum rewards: 52.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.649', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'AMMO4': '0.208', 'weapon4': '0.390', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:54,753][52665] DAMAGECOUNT value on done: 115905.0 [2024-08-06 00:36:54,754][52665] Sum rewards: 54.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO3': '0.127', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'weapon2': '0.614', 'WEAPON3': '0.850', 'HITCOUNT': '2.930', 'weapon3': '3.174', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '45.000'} [2024-08-06 00:36:55,554][52671] DAMAGECOUNT value on done: 122579.0 [2024-08-06 00:36:55,554][52671] Sum rewards: 61.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'AMMO3': '0.227', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '51.000'} [2024-08-06 00:36:56,710][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:36:56,929][52659] DAMAGECOUNT value on done: 117358.0 [2024-08-06 00:36:56,929][52659] Sum rewards: 51.505, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.067', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.062', 'AMMO3': '0.140', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.554', 'WEAPON4': '0.600', 'weapon4': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.554', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '43.000'} [2024-08-06 00:36:57,254][52803] DAMAGECOUNT value on done: 115498.0 [2024-08-06 00:36:57,255][52803] Sum rewards: 68.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'AMMO3': '0.149', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '3.042', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '56.000'} [2024-08-06 00:36:57,420][52811] DAMAGECOUNT value on done: 118365.0 [2024-08-06 00:36:57,422][52811] Sum rewards: 68.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.913', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.213', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '58.000'} [2024-08-06 00:36:57,639][52665] DAMAGECOUNT value on done: 118840.0 [2024-08-06 00:36:57,639][52665] Sum rewards: 59.186, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.105', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.338', 'weapon4': '0.358', 'WEAPON3': '0.950', 'weapon3': '3.064', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '47.000'} [2024-08-06 00:36:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 196747264. Throughput: 0: 4390.5. Samples: 49196160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:36:57,794][52567] Avg episode reward: [(0, '55.014')] [2024-08-06 00:36:59,130][52650] Updated weights for policy 0, policy_version 24021 (0.0032) [2024-08-06 00:36:59,645][52659] DAMAGECOUNT value on done: 117952.0 [2024-08-06 00:36:59,646][52659] Sum rewards: 54.518, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.578', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon5': '0.060', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.418', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.784', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:00,235][52803] DAMAGECOUNT value on done: 116620.0 [2024-08-06 00:37:00,235][52803] Sum rewards: 45.663, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.495', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.192', 'AMMO3': '0.263', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.838', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '41.000'} [2024-08-06 00:37:00,450][52811] DAMAGECOUNT value on done: 113944.0 [2024-08-06 00:37:00,452][52811] Sum rewards: 58.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.026', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.217', 'WEAPON4': '0.450', 'weapon4': '0.462', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '2.656', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:00,509][52665] DAMAGECOUNT value on done: 119790.0 [2024-08-06 00:37:00,509][52665] Sum rewards: 60.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.356', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon5': '0.106', 'AMMO3': '0.175', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '50.500'} [2024-08-06 00:37:00,839][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.561, 187.0), ('HEALTH', -0.051000000000000004, -17.0), ('ARMOR', -0.001, -1.0), ('weapon5', 0.002)] [2024-08-06 00:37:02,750][52659] DAMAGECOUNT value on done: 125393.0 [2024-08-06 00:37:02,751][52659] Sum rewards: 55.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:02,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 196845568. Throughput: 0: 4394.0. Samples: 49209140. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:37:02,794][52567] Avg episode reward: [(0, '55.104')] [2024-08-06 00:37:03,316][52803] DAMAGECOUNT value on done: 111933.0 [2024-08-06 00:37:03,320][52803] Sum rewards: 56.731, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.894', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.236', 'weapon2': '0.482', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.304', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:03,540][52811] DAMAGECOUNT value on done: 119247.0 [2024-08-06 00:37:03,540][52811] Sum rewards: 62.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.234', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '53.000'} [2024-08-06 00:37:04,111][52650] Updated weights for policy 0, policy_version 24031 (0.0026) [2024-08-06 00:37:05,624][52659] DAMAGECOUNT value on done: 123550.0 [2024-08-06 00:37:05,626][52659] Sum rewards: 63.206, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.745', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.058', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.192', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.614', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:06,754][52811] DAMAGECOUNT value on done: 115683.0 [2024-08-06 00:37:06,755][52811] Sum rewards: 62.090, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.304', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '51.500'} [2024-08-06 00:37:07,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 196927488. Throughput: 0: 4396.0. Samples: 49235750. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:37:07,796][52567] Avg episode reward: [(0, '55.231')] [2024-08-06 00:37:07,928][52659] DAMAGECOUNT value on done: 127736.0 [2024-08-06 00:37:07,928][52659] Sum rewards: 63.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.625', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.158', 'AMMO3': '0.168', 'AMMO4': '0.177', 'weapon2': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '55.000'} [2024-08-06 00:37:08,273][52650] Updated weights for policy 0, policy_version 24041 (0.0012) [2024-08-06 00:37:09,843][52811] DAMAGECOUNT value on done: 116869.0 [2024-08-06 00:37:09,844][52811] Sum rewards: 51.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.663', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.178', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon4': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '44.000'} [2024-08-06 00:37:10,354][52659] DAMAGECOUNT value on done: 123832.0 [2024-08-06 00:37:10,354][52659] Sum rewards: 55.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.108', 'AMMO5': '0.003', 'weapon5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.212', 'weapon4': '0.372', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 197017600. Throughput: 0: 4394.4. Samples: 49262060. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 00:37:12,794][52567] Avg episode reward: [(0, '55.438')] [2024-08-06 00:37:13,336][52659] DAMAGECOUNT value on done: 122530.0 [2024-08-06 00:37:13,337][52659] Sum rewards: 65.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO2': '0.020', 'weapon4': '0.082', 'AMMO4': '0.097', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.556', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '55.000'} [2024-08-06 00:37:13,396][52650] Updated weights for policy 0, policy_version 24051 (0.0013) [2024-08-06 00:37:13,698][52662] DAMAGECOUNT value on done: 128424.0 [2024-08-06 00:37:13,699][52662] Sum rewards: 51.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.049', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon5': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '2.944', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '42.000'} [2024-08-06 00:37:16,722][52662] DAMAGECOUNT value on done: 129874.0 [2024-08-06 00:37:16,725][52662] Sum rewards: 52.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.189', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.402', 'WEAPON4': '0.450', 'weapon4': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:17,058][52659] DAMAGECOUNT value on done: 126853.0 [2024-08-06 00:37:17,058][52659] Sum rewards: 61.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.181', 'AMMO3': '0.185', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:17,784][52668] DAMAGECOUNT value on done: 121943.0 [2024-08-06 00:37:17,785][52668] Sum rewards: 44.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.210', 'weapon2': '0.286', 'WEAPON4': '0.550', 'weapon4': '0.794', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '40.000'} [2024-08-06 00:37:17,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 197099520. Throughput: 0: 4390.2. Samples: 49274720. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 00:37:17,794][52567] Avg episode reward: [(0, '55.483')] [2024-08-06 00:37:18,002][52650] Updated weights for policy 0, policy_version 24061 (0.0018) [2024-08-06 00:37:19,671][52659] DAMAGECOUNT value on done: 126141.0 [2024-08-06 00:37:19,672][52659] Sum rewards: 58.193, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.240', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.291', 'weapon2': '0.382', 'WEAPON3': '1.700', 'weapon3': '3.106', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '53.000'} [2024-08-06 00:37:19,943][52662] DAMAGECOUNT value on done: 132443.0 [2024-08-06 00:37:19,945][52662] Sum rewards: 56.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon4': '0.254', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.328', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '48.000'} [2024-08-06 00:37:20,383][52668] DAMAGECOUNT value on done: 128904.0 [2024-08-06 00:37:20,383][52668] Sum rewards: 52.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.412', 'AMMO2': '0.042', 'AMMO4': '0.212', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'weapon4': '0.406', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.704', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '46.000'} [2024-08-06 00:37:22,568][52662] DAMAGECOUNT value on done: 123157.0 [2024-08-06 00:37:22,578][52662] Sum rewards: 53.817, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.020', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.056', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO4': '0.206', 'weapon4': '0.238', 'AMMO3': '0.268', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.998', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '50.000'} [2024-08-06 00:37:22,591][52650] Updated weights for policy 0, policy_version 24071 (0.0013) [2024-08-06 00:37:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 197189632. Throughput: 0: 4385.3. Samples: 49300760. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 00:37:22,794][52567] Avg episode reward: [(0, '55.183')] [2024-08-06 00:37:23,339][52668] DAMAGECOUNT value on done: 125101.0 [2024-08-06 00:37:23,339][52668] Sum rewards: 67.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 00:37:25,113][52662] DAMAGECOUNT value on done: 128832.0 [2024-08-06 00:37:25,113][52662] Sum rewards: 58.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'WEAPON4': '0.450', 'weapon2': '0.466', 'weapon4': '0.784', 'WEAPON3': '1.300', 'weapon3': '2.468', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:26,038][52668] DAMAGECOUNT value on done: 122773.0 [2024-08-06 00:37:26,040][52668] Sum rewards: 48.730, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.574', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.126', 'weapon5': '0.128', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.826', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '39.000'} [2024-08-06 00:37:26,925][52794] DAMAGECOUNT value on done: 130476.0 [2024-08-06 00:37:26,926][52794] Sum rewards: 48.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.262', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.158', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.450', 'weapon2': '0.502', 'weapon4': '0.610', 'WEAPON3': '1.250', 'weapon3': '2.368', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '42.000'} [2024-08-06 00:37:27,361][52650] Updated weights for policy 0, policy_version 24081 (0.0022) [2024-08-06 00:37:27,786][52662] DAMAGECOUNT value on done: 128864.0 [2024-08-06 00:37:27,791][52662] Sum rewards: 44.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.771', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.057', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.283', 'weapon4': '0.470', 'WEAPON4': '0.650', 'weapon2': '0.768', 'WEAPON3': '1.100', 'weapon3': '2.440', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '42.000'} [2024-08-06 00:37:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 197279744. Throughput: 0: 4387.1. Samples: 49327220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:37:27,794][52567] Avg episode reward: [(0, '54.990')] [2024-08-06 00:37:28,425][52668] DAMAGECOUNT value on done: 123797.0 [2024-08-06 00:37:28,427][52668] Sum rewards: 57.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.363', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.426', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '50.000'} [2024-08-06 00:37:30,110][52660] DAMAGECOUNT value on done: 121633.0 [2024-08-06 00:37:30,110][52660] Sum rewards: 57.284, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.948', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.092', 'weapon4': '0.118', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '2.912', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:30,120][52794] DAMAGECOUNT value on done: 129281.0 [2024-08-06 00:37:30,121][52794] Sum rewards: 52.603, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon4': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '46.000'} [2024-08-06 00:37:31,092][52662] DAMAGECOUNT value on done: 128604.0 [2024-08-06 00:37:31,094][52662] Sum rewards: 57.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'weapon5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.170', 'weapon2': '0.370', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.444', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '48.000'} [2024-08-06 00:37:31,547][52668] DAMAGECOUNT value on done: 120879.0 [2024-08-06 00:37:31,548][52668] Sum rewards: 55.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.692', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.308', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:32,117][52650] Updated weights for policy 0, policy_version 24091 (0.0011) [2024-08-06 00:37:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 197361664. Throughput: 0: 4380.0. Samples: 49340210. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:37:32,795][52567] Avg episode reward: [(0, '54.976')] [2024-08-06 00:37:33,190][52660] DAMAGECOUNT value on done: 124390.0 [2024-08-06 00:37:33,190][52660] Sum rewards: 53.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.208', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '46.000'} [2024-08-06 00:37:33,333][52794] DAMAGECOUNT value on done: 124706.0 [2024-08-06 00:37:33,337][52794] Sum rewards: 57.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.981', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.318', 'weapon4': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2024-08-06 00:37:34,145][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:37:34,302][52662] DAMAGECOUNT value on done: 133788.0 [2024-08-06 00:37:34,303][52662] Sum rewards: 52.166, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.211', 'WEAPON4': '0.450', 'weapon2': '0.516', 'weapon4': '0.696', 'WEAPON3': '1.300', 'weapon3': '2.546', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:34,629][52668] DAMAGECOUNT value on done: 125622.0 [2024-08-06 00:37:34,632][52668] Sum rewards: 63.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.810', 'ARMOR': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.181', 'AMMO4': '0.221', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:35,845][52659] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:37:36,319][52660] DAMAGECOUNT value on done: 125268.0 [2024-08-06 00:37:36,320][52660] Sum rewards: 58.859, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon5': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.212', 'weapon2': '0.316', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.290', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:36,376][52794] DAMAGECOUNT value on done: 123440.0 [2024-08-06 00:37:36,377][52794] Sum rewards: 55.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.172', 'weapon5': '0.196', 'weapon2': '0.276', 'AMMO4': '0.302', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.748', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '46.000'} [2024-08-06 00:37:36,934][52650] Updated weights for policy 0, policy_version 24101 (0.0011) [2024-08-06 00:37:37,203][52662] DAMAGECOUNT value on done: 128902.0 [2024-08-06 00:37:37,203][52662] Sum rewards: 60.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.116', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.222', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:37,715][52668] DAMAGECOUNT value on done: 126732.0 [2024-08-06 00:37:37,715][52668] Sum rewards: 58.106, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'HEALTH': '0.082', 'weapon4': '0.082', 'AMMO3': '0.183', 'weapon2': '0.412', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.380', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 197451776. Throughput: 0: 4391.6. Samples: 49366810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:37:37,802][52567] Avg episode reward: [(0, '55.148')] [2024-08-06 00:37:39,111][52794] DAMAGECOUNT value on done: 128490.0 [2024-08-06 00:37:39,112][52794] Sum rewards: 66.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.036', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.089', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.428', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.182', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '56.000'} [2024-08-06 00:37:39,342][52660] DAMAGECOUNT value on done: 125173.0 [2024-08-06 00:37:39,344][52660] Sum rewards: 58.743, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'AMMO2': '0.030', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.130', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.468', 'weapon2': '0.700', 'WEAPON3': '0.800', 'weapon3': '2.518', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '45.000'} [2024-08-06 00:37:39,787][52662] DAMAGECOUNT value on done: 131094.0 [2024-08-06 00:37:39,789][52662] Sum rewards: 54.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.907', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.152', 'weapon5': '0.178', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'WEAPON4': '0.400', 'weapon2': '0.536', 'WEAPON3': '0.850', 'HITCOUNT': '2.780', 'weapon3': '2.806', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '45.000'} [2024-08-06 00:37:41,009][52668] DAMAGECOUNT value on done: 125354.0 [2024-08-06 00:37:41,010][52668] Sum rewards: 61.812, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.928', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.294', 'weapon4': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.822', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '55.000'} [2024-08-06 00:37:41,597][52650] Updated weights for policy 0, policy_version 24111 (0.0013) [2024-08-06 00:37:41,666][52794] DAMAGECOUNT value on done: 127389.0 [2024-08-06 00:37:41,668][52794] Sum rewards: 47.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.426', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.658', 'WEAPON3': '1.450', 'weapon3': '2.664', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '42.000'} [2024-08-06 00:37:42,351][52660] DAMAGECOUNT value on done: 121324.0 [2024-08-06 00:37:42,351][52660] Sum rewards: 54.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.622', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.208', 'weapon2': '0.284', 'WEAPON4': '0.450', 'weapon4': '0.778', 'WEAPON3': '1.350', 'weapon3': '2.712', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:42,395][52662] DAMAGECOUNT value on done: 126383.0 [2024-08-06 00:37:42,395][52662] Sum rewards: 47.339, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.192', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.740', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '2.934', 'DAMAGECOUNT': '12.243', 'FRAGCOUNT': '40.000'} [2024-08-06 00:37:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 197533696. Throughput: 0: 4379.6. Samples: 49393240. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:37:42,802][52567] Avg episode reward: [(0, '55.173')] [2024-08-06 00:37:43,676][52668] DAMAGECOUNT value on done: 125860.0 [2024-08-06 00:37:43,676][52668] Sum rewards: 51.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.173', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.264', 'ARMOR': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '41.500'} [2024-08-06 00:37:44,481][52667] DAMAGECOUNT value on done: 126917.0 [2024-08-06 00:37:44,481][52667] Sum rewards: 62.532, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.036', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.414', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '50.000'} [2024-08-06 00:37:44,611][52794] DAMAGECOUNT value on done: 132436.0 [2024-08-06 00:37:44,612][52794] Sum rewards: 51.803, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.994', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.080', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.624', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.996', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '45.000'} [2024-08-06 00:37:44,992][52660] DAMAGECOUNT value on done: 121121.0 [2024-08-06 00:37:44,994][52660] Sum rewards: 68.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.160', 'ARMOR': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon2': '0.312', 'weapon4': '0.452', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '56.000'} [2024-08-06 00:37:45,407][52662] DAMAGECOUNT value on done: 129460.0 [2024-08-06 00:37:45,407][52662] Sum rewards: 60.812, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.064', 'ARMOR': '0.005', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.054', 'AMMO4': '0.110', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.352', 'weapon2': '0.514', 'WEAPON3': '0.950', 'weapon3': '2.890', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:45,818][52650] Updated weights for policy 0, policy_version 24121 (0.0029) [2024-08-06 00:37:46,184][52668] DAMAGECOUNT value on done: 122922.0 [2024-08-06 00:37:46,184][52668] Sum rewards: 45.555, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.587', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.327', 'WEAPON4': '0.400', 'weapon2': '0.460', 'weapon4': '0.518', 'WEAPON3': '1.900', 'weapon3': '2.488', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '46.000'} [2024-08-06 00:37:47,552][52667] DAMAGECOUNT value on done: 125417.0 [2024-08-06 00:37:47,554][52667] Sum rewards: 48.944, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.159', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.125', 'WEAPON4': '0.350', 'weapon4': '0.568', 'WEAPON3': '0.800', 'weapon2': '0.882', 'weapon3': '2.424', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.856', 'FRAGCOUNT': '40.000'} [2024-08-06 00:37:47,734][52794] DAMAGECOUNT value on done: 127785.0 [2024-08-06 00:37:47,734][52794] Sum rewards: 50.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.109', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.524', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '3.272', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '43.000'} [2024-08-06 00:37:47,799][52567] Fps is (10 sec: 17194.1, 60 sec: 17474.7, 300 sec: 17577.8). Total num frames: 197623808. Throughput: 0: 4382.6. Samples: 49406380. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:37:47,800][52567] Avg episode reward: [(0, '55.095')] [2024-08-06 00:37:47,862][52660] DAMAGECOUNT value on done: 125362.0 [2024-08-06 00:37:47,862][52660] Sum rewards: 53.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '46.000'} [2024-08-06 00:37:48,476][52662] DAMAGECOUNT value on done: 127357.0 [2024-08-06 00:37:48,477][52662] Sum rewards: 61.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.180', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.324', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '51.000'} [2024-08-06 00:37:49,128][52668] DAMAGECOUNT value on done: 122980.0 [2024-08-06 00:37:49,129][52668] Sum rewards: 65.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.320', 'weapon4': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '56.000'} [2024-08-06 00:37:49,371][52669] DAMAGECOUNT value on done: 128650.0 [2024-08-06 00:37:49,371][52669] Sum rewards: 68.257, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.076', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.080', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '59.000'} [2024-08-06 00:37:49,756][52795] DAMAGECOUNT value on done: 114464.0 [2024-08-06 00:37:49,756][52795] Sum rewards: 56.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.140', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.257', 'WEAPON4': '0.450', 'weapon4': '0.494', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.430', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '46.500'} [2024-08-06 00:37:50,562][52667] DAMAGECOUNT value on done: 125695.0 [2024-08-06 00:37:50,563][52667] Sum rewards: 49.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.492', 'AMMO5': '0.005', 'weapon5': '0.044', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'AMMO4': '0.227', 'WEAPON4': '0.400', 'weapon2': '0.452', 'weapon4': '0.654', 'WEAPON3': '0.900', 'weapon3': '2.576', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '43.000'} [2024-08-06 00:37:50,643][52660] DAMAGECOUNT value on done: 124568.0 [2024-08-06 00:37:50,643][52660] Sum rewards: 52.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.172', 'weapon5': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.766', 'WEAPON3': '1.150', 'weapon3': '2.300', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '44.000'} [2024-08-06 00:37:50,766][52650] Updated weights for policy 0, policy_version 24131 (0.0025) [2024-08-06 00:37:50,866][52794] DAMAGECOUNT value on done: 128909.0 [2024-08-06 00:37:50,868][52794] Sum rewards: 51.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon5': '0.140', 'AMMO3': '0.198', 'weapon2': '0.302', 'AMMO4': '0.327', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '1.200', 'weapon3': '2.412', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '44.000'} [2024-08-06 00:37:51,459][52662] DAMAGECOUNT value on done: 126923.0 [2024-08-06 00:37:51,459][52662] Sum rewards: 62.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '54.000'} [2024-08-06 00:37:51,521][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:37:51,948][52668] DAMAGECOUNT value on done: 117930.0 [2024-08-06 00:37:51,949][52668] Sum rewards: 67.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.006', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.064', 'weapon4': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '59.000'} [2024-08-06 00:37:52,334][52669] DAMAGECOUNT value on done: 125196.0 [2024-08-06 00:37:52,336][52669] Sum rewards: 59.260, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.021', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.160', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.026', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '50.000'} [2024-08-06 00:37:52,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 197722112. Throughput: 0: 4379.8. Samples: 49432840. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:37:52,794][52567] Avg episode reward: [(0, '55.822')] [2024-08-06 00:37:52,955][52795] DAMAGECOUNT value on done: 111311.0 [2024-08-06 00:37:52,955][52795] Sum rewards: 55.499, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.464', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO3': '0.112', 'AMMO4': '0.133', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.464', 'weapon4': '0.506', 'WEAPON3': '0.750', 'HITCOUNT': '2.710', 'weapon3': '2.788', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '46.000'} [2024-08-06 00:37:53,478][52660] DAMAGECOUNT value on done: 123535.0 [2024-08-06 00:37:53,479][52660] Sum rewards: 54.659, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.170', 'weapon2': '0.998', 'WEAPON3': '1.000', 'weapon3': '2.830', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.104', 'FRAGCOUNT': '44.000'} [2024-08-06 00:37:53,784][52667] DAMAGECOUNT value on done: 124018.0 [2024-08-06 00:37:53,784][52667] Sum rewards: 54.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.966', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.243', 'weapon2': '0.328', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.468', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:53,810][52794] DAMAGECOUNT value on done: 134499.0 [2024-08-06 00:37:53,810][52794] Sum rewards: 66.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.214', 'AMMO5': '0.011', 'AMMO2': '0.024', 'ARMOR': '0.028', 'AMMO4': '0.119', 'AMMO3': '0.145', 'weapon4': '0.148', 'weapon5': '0.212', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '3.030', 'weapon3': '3.254', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '53.000'} [2024-08-06 00:37:54,499][52668] DAMAGECOUNT value on done: 124033.0 [2024-08-06 00:37:54,500][52668] Sum rewards: 54.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.744', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'weapon2': '0.492', 'weapon4': '0.584', 'WEAPON3': '1.450', 'weapon3': '2.626', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '48.000'} [2024-08-06 00:37:54,627][52662] DAMAGECOUNT value on done: 125408.0 [2024-08-06 00:37:54,628][52662] Sum rewards: 50.823, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.924', 'ARMOR': '0.008', 'AMMO2': '0.036', 'AMMO4': '0.177', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.330', 'weapon4': '0.658', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.830', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '45.000'} [2024-08-06 00:37:55,286][52664] DAMAGECOUNT value on done: 128296.0 [2024-08-06 00:37:55,286][52664] Sum rewards: 56.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.536', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '2.984', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:55,315][52650] Updated weights for policy 0, policy_version 24141 (0.0019) [2024-08-06 00:37:55,501][52669] DAMAGECOUNT value on done: 123863.0 [2024-08-06 00:37:55,501][52669] Sum rewards: 60.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.976', 'AMMO5': '0.005', 'weapon5': '0.032', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO3': '0.213', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.106', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '53.000'} [2024-08-06 00:37:56,040][52660] DAMAGECOUNT value on done: 124185.0 [2024-08-06 00:37:56,042][52660] Sum rewards: 43.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.867', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.193', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '2.906', 'DAMAGECOUNT': '11.007', 'FRAGCOUNT': '37.000'} [2024-08-06 00:37:56,130][52795] DAMAGECOUNT value on done: 113360.0 [2024-08-06 00:37:56,130][52795] Sum rewards: 61.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.178', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.173', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.644', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '52.000'} [2024-08-06 00:37:56,639][52667] DAMAGECOUNT value on done: 125924.0 [2024-08-06 00:37:56,640][52667] Sum rewards: 57.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.060', 'AMMO4': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.171', 'WEAPON7': '0.200', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.898', 'WEAPON3': '1.100', 'weapon3': '2.458', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '49.000'} [2024-08-06 00:37:57,012][52794] DAMAGECOUNT value on done: 125400.0 [2024-08-06 00:37:57,013][52794] Sum rewards: 43.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.139', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.356', 'weapon4': '0.442', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '2.878', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '38.000'} [2024-08-06 00:37:57,077][52668] DAMAGECOUNT value on done: 121999.0 [2024-08-06 00:37:57,078][52668] Sum rewards: 52.224, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.928', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon4': '0.182', 'WEAPON4': '0.300', 'AMMO3': '0.311', 'weapon2': '0.788', 'WEAPON3': '1.750', 'weapon3': '2.730', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '50.000'} [2024-08-06 00:37:57,749][52662] DAMAGECOUNT value on done: 133116.0 [2024-08-06 00:37:57,750][52662] Sum rewards: 59.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.518', 'AMMO2': '0.017', 'ARMOR': '0.044', 'AMMO4': '0.083', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.468', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '50.000'} [2024-08-06 00:37:57,794][52567] Fps is (10 sec: 17212.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 197795840. Throughput: 0: 4377.5. Samples: 49459050. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:37:57,794][52567] Avg episode reward: [(0, '56.079')] [2024-08-06 00:37:58,116][52664] DAMAGECOUNT value on done: 128799.0 [2024-08-06 00:37:58,117][52664] Sum rewards: 52.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.017', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.280', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.260', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:58,379][52669] DAMAGECOUNT value on done: 123148.0 [2024-08-06 00:37:58,380][52669] Sum rewards: 40.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.628', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.034', 'AMMO4': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '2.880', 'DAMAGECOUNT': '11.655', 'FRAGCOUNT': '34.500'} [2024-08-06 00:37:58,664][52660] DAMAGECOUNT value on done: 127753.0 [2024-08-06 00:37:58,669][52660] Sum rewards: 63.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.021', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.154', 'AMMO3': '0.259', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.322', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '54.000'} [2024-08-06 00:37:59,117][52795] DAMAGECOUNT value on done: 113677.0 [2024-08-06 00:37:59,118][52795] Sum rewards: 53.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.078', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '47.000'} [2024-08-06 00:37:59,755][52668] DAMAGECOUNT value on done: 126796.0 [2024-08-06 00:37:59,755][52668] Sum rewards: 66.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'weapon2': '0.196', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.464', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '57.000'} [2024-08-06 00:37:59,803][52667] DAMAGECOUNT value on done: 122531.0 [2024-08-06 00:37:59,804][52667] Sum rewards: 50.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.263', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.046', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'weapon2': '0.194', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.494', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '43.000'} [2024-08-06 00:37:59,952][52794] DAMAGECOUNT value on done: 131067.0 [2024-08-06 00:37:59,954][52794] Sum rewards: 64.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.952', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.434', 'weapon4': '0.602', 'WEAPON3': '1.250', 'weapon3': '2.628', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:00,276][52650] Updated weights for policy 0, policy_version 24151 (0.0029) [2024-08-06 00:38:00,570][52664] DAMAGECOUNT value on done: 129551.0 [2024-08-06 00:38:00,570][52664] Sum rewards: 58.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.058', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.324', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.398', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:00,696][52662] DAMAGECOUNT value on done: 123472.0 [2024-08-06 00:38:00,697][52662] Sum rewards: 62.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.458', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.045', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'AMMO4': '0.223', 'WEAPON4': '0.450', 'weapon2': '0.574', 'weapon4': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.340', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:01,248][52660] DAMAGECOUNT value on done: 120410.0 [2024-08-06 00:38:01,249][52660] Sum rewards: 53.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.247', 'ARMOR': '0.004', 'AMMO2': '0.044', 'AMMO4': '0.219', 'AMMO3': '0.228', 'WEAPON4': '0.450', 'weapon4': '0.466', 'weapon2': '0.782', 'WEAPON3': '1.400', 'weapon3': '2.542', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '46.000'} [2024-08-06 00:38:01,475][52669] DAMAGECOUNT value on done: 124758.0 [2024-08-06 00:38:01,476][52669] Sum rewards: 52.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.154', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '2.722', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '44.500'} [2024-08-06 00:38:02,251][52795] DAMAGECOUNT value on done: 117594.0 [2024-08-06 00:38:02,252][52795] Sum rewards: 60.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.144', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.382', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:02,380][52668] DAMAGECOUNT value on done: 123356.0 [2024-08-06 00:38:02,380][52668] Sum rewards: 70.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.026', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.378', 'weapon4': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '61.000'} [2024-08-06 00:38:02,632][52667] DAMAGECOUNT value on done: 127296.0 [2024-08-06 00:38:02,632][52667] Sum rewards: 55.701, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.222', 'weapon4': '0.332', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:02,633][52647] DAMAGECOUNT value on done: 131767.0 [2024-08-06 00:38:02,634][52647] Sum rewards: 54.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.460', 'AMMO2': '0.021', 'ARMOR': '0.036', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.238', 'AMMO3': '0.246', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '2.754', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17578.3). Total num frames: 197885952. Throughput: 0: 4385.1. Samples: 49472050. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:38:02,794][52567] Avg episode reward: [(0, '56.673')] [2024-08-06 00:38:03,117][52794] DAMAGECOUNT value on done: 127360.0 [2024-08-06 00:38:03,125][52794] Sum rewards: 56.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.296', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.126', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.744', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '2.952', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:03,209][52664] DAMAGECOUNT value on done: 129084.0 [2024-08-06 00:38:03,209][52664] Sum rewards: 61.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.754', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.159', 'weapon4': '0.194', 'weapon2': '0.894', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:03,707][52662] DAMAGECOUNT value on done: 128787.0 [2024-08-06 00:38:03,708][52662] Sum rewards: 46.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.049', 'AMMO5': '0.007', 'ARMOR': '0.040', 'AMMO2': '0.058', 'weapon5': '0.160', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.292', 'weapon2': '0.396', 'WEAPON4': '0.650', 'weapon4': '0.684', 'WEAPON3': '1.050', 'HITCOUNT': '2.340', 'weapon3': '2.486', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '40.000'} [2024-08-06 00:38:04,164][52660] DAMAGECOUNT value on done: 121621.0 [2024-08-06 00:38:04,165][52660] Sum rewards: 64.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.105', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.562', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '55.000'} [2024-08-06 00:38:04,472][52669] DAMAGECOUNT value on done: 123612.0 [2024-08-06 00:38:04,476][52669] Sum rewards: 64.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.282', 'weapon4': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:04,550][52650] Updated weights for policy 0, policy_version 24161 (0.0013) [2024-08-06 00:38:05,038][52667] DAMAGECOUNT value on done: 124348.0 [2024-08-06 00:38:05,039][52667] Sum rewards: 46.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.382', 'weapon4': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '40.000'} [2024-08-06 00:38:05,134][52668] DAMAGECOUNT value on done: 124996.0 [2024-08-06 00:38:05,134][52668] Sum rewards: 63.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.130', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.462', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.600', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:05,300][52647] DAMAGECOUNT value on done: 130128.0 [2024-08-06 00:38:05,301][52647] Sum rewards: 60.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.545', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon4': '0.224', 'weapon2': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.176', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:05,397][52795] DAMAGECOUNT value on done: 115180.0 [2024-08-06 00:38:05,398][52795] Sum rewards: 38.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.944', 'AMMO5': '0.003', 'AMMO2': '0.005', 'ARMOR': '0.016', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.116', 'AMMO3': '0.166', 'weapon2': '0.396', 'WEAPON3': '1.000', 'HITCOUNT': '2.070', 'weapon3': '3.336', 'DAMAGECOUNT': '9.834', 'FRAGCOUNT': '32.000'} [2024-08-06 00:38:05,894][52664] DAMAGECOUNT value on done: 128220.0 [2024-08-06 00:38:05,894][52664] Sum rewards: 51.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.725', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.150', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '0.950', 'HITCOUNT': '2.660', 'weapon3': '2.970', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:06,221][52794] DAMAGECOUNT value on done: 137058.0 [2024-08-06 00:38:06,221][52794] Sum rewards: 69.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon4': '0.192', 'AMMO4': '0.195', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.000'} [2024-08-06 00:38:06,438][52660] DAMAGECOUNT value on done: 126280.0 [2024-08-06 00:38:06,440][52660] Sum rewards: 61.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'ARMOR': '0.028', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.510', 'weapon4': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:06,905][52662] DAMAGECOUNT value on done: 125854.0 [2024-08-06 00:38:06,906][52662] Sum rewards: 57.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.772', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.272', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.452', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:07,359][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:38:07,512][52669] DAMAGECOUNT value on done: 124963.0 [2024-08-06 00:38:07,512][52669] Sum rewards: 64.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.927', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO3': '0.130', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '0.850', 'weapon3': '3.116', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:07,580][52668] DAMAGECOUNT value on done: 128543.0 [2024-08-06 00:38:07,580][52668] Sum rewards: 61.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.105', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.374', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '2.968', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:07,705][52667] DAMAGECOUNT value on done: 124948.0 [2024-08-06 00:38:07,710][52667] Sum rewards: 51.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.435', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon2': '0.236', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'weapon4': '0.492', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '2.928', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 197976064. Throughput: 0: 4393.6. Samples: 49498470. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:38:07,794][52567] Avg episode reward: [(0, '56.408')] [2024-08-06 00:38:08,040][52647] DAMAGECOUNT value on done: 135238.0 [2024-08-06 00:38:08,042][52647] Sum rewards: 45.302, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.024', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.596', 'weapon2': '0.694', 'WEAPON3': '1.450', 'weapon3': '2.352', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '41.000'} [2024-08-06 00:38:08,539][52795] DAMAGECOUNT value on done: 119483.0 [2024-08-06 00:38:08,541][52795] Sum rewards: 57.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.174', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.476', 'weapon4': '0.652', 'WEAPON3': '1.450', 'weapon3': '2.374', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:08,671][52664] DAMAGECOUNT value on done: 133610.0 [2024-08-06 00:38:08,673][52664] Sum rewards: 47.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.152', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.214', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '42.500'} [2024-08-06 00:38:09,045][52794] DAMAGECOUNT value on done: 123760.0 [2024-08-06 00:38:09,047][52794] Sum rewards: 55.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.086', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:09,351][52660] DAMAGECOUNT value on done: 132819.0 [2024-08-06 00:38:09,352][52660] Sum rewards: 57.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.717', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.033', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.151', 'AMMO4': '0.164', 'weapon4': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.782', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:09,487][52650] Updated weights for policy 0, policy_version 24171 (0.0024) [2024-08-06 00:38:09,802][52662] DAMAGECOUNT value on done: 126541.0 [2024-08-06 00:38:09,805][52662] Sum rewards: 55.132, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.355', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.175', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.440', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.620', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '45.000'} [2024-08-06 00:38:10,207][52669] DAMAGECOUNT value on done: 124953.0 [2024-08-06 00:38:10,210][52669] Sum rewards: 51.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.151', 'weapon5': '0.152', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.650', 'weapon4': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.536', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.579', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:10,331][52649] DAMAGECOUNT value on done: 121225.0 [2024-08-06 00:38:10,331][52649] Sum rewards: 47.448, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.164', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.059', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'AMMO4': '0.293', 'weapon2': '0.552', 'weapon4': '0.702', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.368', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '45.000'} [2024-08-06 00:38:10,518][52647] DAMAGECOUNT value on done: 133806.0 [2024-08-06 00:38:10,518][52647] Sum rewards: 52.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.422', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.118', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.670', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '46.000'} [2024-08-06 00:38:10,671][52668] DAMAGECOUNT value on done: 126418.0 [2024-08-06 00:38:10,672][52668] Sum rewards: 57.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.062', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon2': '0.218', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.482', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:10,976][52667] DAMAGECOUNT value on done: 127386.0 [2024-08-06 00:38:10,977][52667] Sum rewards: 41.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.884', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.660', 'DAMAGECOUNT': '10.713', 'FRAGCOUNT': '35.000'} [2024-08-06 00:38:11,304][52664] DAMAGECOUNT value on done: 131173.0 [2024-08-06 00:38:11,305][52664] Sum rewards: 46.613, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.900', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.086', 'AMMO4': '0.182', 'AMMO3': '0.186', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.204', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:11,570][52795] DAMAGECOUNT value on done: 117293.0 [2024-08-06 00:38:11,571][52795] Sum rewards: 57.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.144', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:12,141][52794] DAMAGECOUNT value on done: 132414.0 [2024-08-06 00:38:12,141][52794] Sum rewards: 58.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO4': '0.184', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:12,356][52660] DAMAGECOUNT value on done: 122360.0 [2024-08-06 00:38:12,356][52660] Sum rewards: 54.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.212', 'weapon2': '0.584', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.006', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:12,717][52669] DAMAGECOUNT value on done: 125214.0 [2024-08-06 00:38:12,717][52669] Sum rewards: 48.510, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.272', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.199', 'AMMO3': '0.250', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:12,758][52649] DAMAGECOUNT value on done: 120148.0 [2024-08-06 00:38:12,759][52649] Sum rewards: 61.124, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.841', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon4': '0.068', 'AMMO4': '0.106', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'HITCOUNT': '3.310', 'weapon3': '3.542', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '55.000'} [2024-08-06 00:38:12,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 198066176. Throughput: 0: 4400.6. Samples: 49525250. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 00:38:12,795][52567] Avg episode reward: [(0, '56.182')] [2024-08-06 00:38:13,583][52647] DAMAGECOUNT value on done: 135941.0 [2024-08-06 00:38:13,584][52647] Sum rewards: 45.783, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.217', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'weapon2': '0.464', 'weapon4': '0.516', 'WEAPON3': '1.450', 'weapon3': '2.682', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:13,782][52650] Updated weights for policy 0, policy_version 24181 (0.0013) [2024-08-06 00:38:14,163][52667] DAMAGECOUNT value on done: 126412.0 [2024-08-06 00:38:14,163][52667] Sum rewards: 60.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.608', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.076', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:14,397][52664] DAMAGECOUNT value on done: 123465.0 [2024-08-06 00:38:14,398][52664] Sum rewards: 50.134, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.736', 'AMMO5': '0.005', 'weapon5': '0.016', 'ARMOR': '0.016', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.226', 'weapon4': '0.440', 'weapon2': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.608', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '42.500'} [2024-08-06 00:38:14,686][52795] DAMAGECOUNT value on done: 113780.0 [2024-08-06 00:38:14,690][52795] Sum rewards: 61.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.249', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon4': '0.224', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:15,178][52660] DAMAGECOUNT value on done: 126789.0 [2024-08-06 00:38:15,179][52660] Sum rewards: 47.540, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.364', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.120', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.700', 'weapon3': '2.802', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '45.000'} [2024-08-06 00:38:15,305][52649] DAMAGECOUNT value on done: 122297.0 [2024-08-06 00:38:15,306][52649] Sum rewards: 61.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.189', 'weapon2': '0.318', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.240', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:15,336][52794] DAMAGECOUNT value on done: 128645.0 [2024-08-06 00:38:15,337][52794] Sum rewards: 47.902, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.858', 'AMMO2': '0.043', 'AMMO4': '0.213', 'AMMO3': '0.298', 'weapon4': '0.370', 'WEAPON4': '0.550', 'weapon2': '0.654', 'WEAPON3': '1.650', 'weapon3': '2.732', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '45.000'} [2024-08-06 00:38:15,841][52669] DAMAGECOUNT value on done: 123448.0 [2024-08-06 00:38:15,842][52669] Sum rewards: 57.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.768', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.388', 'weapon4': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:16,693][52647] DAMAGECOUNT value on done: 134285.0 [2024-08-06 00:38:16,693][52647] Sum rewards: 56.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.676', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.045', 'weapon5': '0.090', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'weapon4': '0.380', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.640', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:17,339][52667] DAMAGECOUNT value on done: 124418.0 [2024-08-06 00:38:17,340][52667] Sum rewards: 57.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.758', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:17,434][52664] DAMAGECOUNT value on done: 136794.0 [2024-08-06 00:38:17,435][52664] Sum rewards: 56.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.206', 'weapon2': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.146', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '46.000'} [2024-08-06 00:38:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 198156288. Throughput: 0: 4407.4. Samples: 49538540. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:38:17,794][52567] Avg episode reward: [(0, '55.906')] [2024-08-06 00:38:17,873][52795] DAMAGECOUNT value on done: 116238.0 [2024-08-06 00:38:17,875][52795] Sum rewards: 43.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.173', 'AMMO3': '0.245', 'weapon2': '0.436', 'WEAPON4': '0.500', 'weapon4': '0.676', 'WEAPON3': '1.400', 'weapon3': '2.688', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.249', 'FRAGCOUNT': '39.000'} [2024-08-06 00:38:17,882][52794] DAMAGECOUNT value on done: 128387.0 [2024-08-06 00:38:17,882][52794] Sum rewards: 54.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.422', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.400', 'weapon4': '0.416', 'WEAPON3': '0.950', 'HITCOUNT': '2.920', 'weapon3': '3.014', 'DAMAGECOUNT': '12.588', 'FRAGCOUNT': '46.000'} [2024-08-06 00:38:18,069][52660] DAMAGECOUNT value on done: 120709.0 [2024-08-06 00:38:18,071][52660] Sum rewards: 50.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.936', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.102', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:18,370][52669] DAMAGECOUNT value on done: 128135.0 [2024-08-06 00:38:18,370][52669] Sum rewards: 67.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.218', 'weapon4': '0.282', 'WEAPON4': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '55.000'} [2024-08-06 00:38:18,440][52649] DAMAGECOUNT value on done: 123046.0 [2024-08-06 00:38:18,440][52649] Sum rewards: 61.931, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.042', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.102', 'weapon5': '0.152', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:18,763][52650] Updated weights for policy 0, policy_version 24191 (0.0012) [2024-08-06 00:38:19,214][52647] DAMAGECOUNT value on done: 131038.0 [2024-08-06 00:38:19,214][52647] Sum rewards: 57.215, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.050', 'AMMO5': '0.028', 'ARMOR': '0.028', 'AMMO2': '0.069', 'weapon5': '0.124', 'AMMO3': '0.210', 'AMMO4': '0.346', 'WEAPON5': '0.400', 'weapon2': '0.636', 'weapon4': '0.790', 'WEAPON4': '0.900', 'WEAPON3': '1.250', 'weapon3': '2.116', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:20,092][52664] DAMAGECOUNT value on done: 134537.0 [2024-08-06 00:38:20,093][52664] Sum rewards: 47.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.406', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '3.324', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '40.000'} [2024-08-06 00:38:20,461][52667] DAMAGECOUNT value on done: 127433.0 [2024-08-06 00:38:20,462][52667] Sum rewards: 60.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.463', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.350', 'weapon2': '0.498', 'weapon4': '0.524', 'WEAPON3': '1.000', 'weapon3': '2.682', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:20,825][52794] DAMAGECOUNT value on done: 135413.0 [2024-08-06 00:38:20,826][52794] Sum rewards: 56.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:20,933][52660] DAMAGECOUNT value on done: 128308.0 [2024-08-06 00:38:20,935][52660] Sum rewards: 43.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.370', 'AMMO5': '0.012', 'weapon5': '0.038', 'AMMO2': '0.038', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.278', 'AMMO3': '0.297', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '2.820', 'weapon3': '3.096', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '41.000'} [2024-08-06 00:38:20,977][52795] DAMAGECOUNT value on done: 116285.0 [2024-08-06 00:38:20,977][52795] Sum rewards: 59.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.275', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'weapon5': '0.154', 'weapon4': '0.180', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:21,422][52669] DAMAGECOUNT value on done: 127997.0 [2024-08-06 00:38:21,424][52669] Sum rewards: 59.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.206', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:21,491][52649] DAMAGECOUNT value on done: 115868.0 [2024-08-06 00:38:21,492][52649] Sum rewards: 48.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.386', 'weapon2': '0.564', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:22,033][52647] DAMAGECOUNT value on done: 133569.0 [2024-08-06 00:38:22,033][52647] Sum rewards: 50.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.070', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.218', 'weapon2': '0.384', 'WEAPON4': '0.400', 'weapon4': '0.726', 'WEAPON3': '0.800', 'weapon3': '2.438', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '41.000'} [2024-08-06 00:38:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 198246400. Throughput: 0: 4401.8. Samples: 49564890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:38:22,794][52567] Avg episode reward: [(0, '55.606')] [2024-08-06 00:38:23,017][52664] DAMAGECOUNT value on done: 133051.0 [2024-08-06 00:38:23,018][52664] Sum rewards: 53.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.212', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.248', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:23,175][52650] Updated weights for policy 0, policy_version 24201 (0.0011) [2024-08-06 00:38:23,251][52667] DAMAGECOUNT value on done: 122870.0 [2024-08-06 00:38:23,251][52667] Sum rewards: 42.552, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.014', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.238', 'weapon2': '0.300', 'AMMO3': '0.347', 'WEAPON4': '0.450', 'weapon4': '0.556', 'WEAPON3': '2.000', 'weapon3': '2.810', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:23,260][52660] DAMAGECOUNT value on done: 122117.0 [2024-08-06 00:38:23,260][52660] Sum rewards: 44.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.387', 'ARMOR': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.169', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.444', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '3.028', 'DAMAGECOUNT': '10.830', 'FRAGCOUNT': '40.000'} [2024-08-06 00:38:23,433][52658] DAMAGECOUNT value on done: 129224.0 [2024-08-06 00:38:23,435][52658] Sum rewards: 66.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.255', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.180', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.694', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '56.000'} [2024-08-06 00:38:23,628][52794] DAMAGECOUNT value on done: 128371.0 [2024-08-06 00:38:23,628][52794] Sum rewards: 64.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.733', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'AMMO3': '0.219', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.384', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:24,089][52795] DAMAGECOUNT value on done: 114005.0 [2024-08-06 00:38:24,089][52795] Sum rewards: 52.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'AMMO4': '0.212', 'weapon4': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '2.852', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:24,195][52669] DAMAGECOUNT value on done: 123107.0 [2024-08-06 00:38:24,196][52669] Sum rewards: 47.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.189', 'AMMO3': '0.198', 'weapon4': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.998', 'WEAPON3': '1.150', 'weapon3': '2.488', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.273', 'FRAGCOUNT': '42.000'} [2024-08-06 00:38:24,718][52649] DAMAGECOUNT value on done: 120731.0 [2024-08-06 00:38:24,719][52649] Sum rewards: 50.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.916', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.112', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.444', 'weapon2': '0.524', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.724', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:25,117][52647] DAMAGECOUNT value on done: 134959.0 [2024-08-06 00:38:25,118][52647] Sum rewards: 40.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.154', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.134', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.498', 'weapon2': '0.612', 'WEAPON3': '0.950', 'HITCOUNT': '2.560', 'weapon3': '2.604', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '32.500'} [2024-08-06 00:38:26,046][52667] DAMAGECOUNT value on done: 128188.0 [2024-08-06 00:38:26,047][52667] Sum rewards: 54.295, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.020', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.046', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.608', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '3.130', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '45.000'} [2024-08-06 00:38:26,160][52664] DAMAGECOUNT value on done: 130479.0 [2024-08-06 00:38:26,160][52664] Sum rewards: 57.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.712', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.170', 'AMMO3': '0.189', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:26,260][52658] DAMAGECOUNT value on done: 126610.0 [2024-08-06 00:38:26,261][52658] Sum rewards: 57.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.270', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.072', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.332', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:26,746][52614] Signal inference workers to stop experience collection... (4450 times) [2024-08-06 00:38:26,747][52614] Signal inference workers to resume experience collection... (4450 times) [2024-08-06 00:38:26,782][52650] InferenceWorker_p0-w0: stopping experience collection (4450 times) [2024-08-06 00:38:26,782][52650] InferenceWorker_p0-w0: resuming experience collection (4450 times) [2024-08-06 00:38:26,839][52669] DAMAGECOUNT value on done: 126181.0 [2024-08-06 00:38:26,839][52669] Sum rewards: 47.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.208', 'weapon2': '0.342', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.984', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '40.000'} [2024-08-06 00:38:27,164][52795] DAMAGECOUNT value on done: 115093.0 [2024-08-06 00:38:27,164][52795] Sum rewards: 60.189, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.149', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.820', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:27,622][52647] DAMAGECOUNT value on done: 129343.0 [2024-08-06 00:38:27,622][52647] Sum rewards: 56.764, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.192', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.784', 'WEAPON3': '0.950', 'weapon3': '2.810', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:27,646][52649] DAMAGECOUNT value on done: 117845.0 [2024-08-06 00:38:27,646][52649] Sum rewards: 60.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO5': '0.014', 'weapon5': '0.062', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.260', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 198328320. Throughput: 0: 4403.3. Samples: 49591390. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:38:27,795][52567] Avg episode reward: [(0, '55.039')] [2024-08-06 00:38:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024210_198328320.pth... [2024-08-06 00:38:27,955][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023696_194117632.pth [2024-08-06 00:38:28,080][52650] Updated weights for policy 0, policy_version 24211 (0.0025) [2024-08-06 00:38:28,798][52664] DAMAGECOUNT value on done: 128142.0 [2024-08-06 00:38:28,800][52664] Sum rewards: 63.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.412', 'weapon4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.690', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '53.000'} [2024-08-06 00:38:29,024][52667] DAMAGECOUNT value on done: 133293.0 [2024-08-06 00:38:29,026][52667] Sum rewards: 59.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon7': '0.058', 'AMMO4': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon2': '0.226', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.594', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '2.952', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:29,268][52669] DAMAGECOUNT value on done: 132225.0 [2024-08-06 00:38:29,269][52669] Sum rewards: 55.592, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.534', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.608', 'WEAPON3': '0.800', 'weapon3': '2.578', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '41.000'} [2024-08-06 00:38:29,277][52658] DAMAGECOUNT value on done: 126489.0 [2024-08-06 00:38:29,277][52658] Sum rewards: 61.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.055', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.616', 'WEAPON3': '1.350', 'weapon3': '2.736', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '53.000'} [2024-08-06 00:38:30,309][52795] DAMAGECOUNT value on done: 114367.0 [2024-08-06 00:38:30,311][52795] Sum rewards: 50.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.764', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'weapon4': '0.180', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.732', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '2.880', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:30,938][52649] DAMAGECOUNT value on done: 125880.0 [2024-08-06 00:38:30,939][52649] Sum rewards: 43.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.609', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.404', 'weapon4': '0.562', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.604', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '40.500'} [2024-08-06 00:38:31,038][52647] DAMAGECOUNT value on done: 130036.0 [2024-08-06 00:38:31,038][52647] Sum rewards: 59.879, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.485', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.222', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.338', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.762', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '53.000'} [2024-08-06 00:38:31,731][52667] DAMAGECOUNT value on done: 128979.0 [2024-08-06 00:38:31,732][52667] Sum rewards: 51.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.172', 'weapon4': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:32,044][52664] DAMAGECOUNT value on done: 130763.0 [2024-08-06 00:38:32,045][52664] Sum rewards: 55.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.775', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.052', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:32,047][52658] DAMAGECOUNT value on done: 127957.0 [2024-08-06 00:38:32,047][52658] Sum rewards: 45.522, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.560', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.035', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.223', 'weapon2': '0.280', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '3.184', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '42.000'} [2024-08-06 00:38:32,098][52669] DAMAGECOUNT value on done: 134785.0 [2024-08-06 00:38:32,101][52669] Sum rewards: 54.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.064', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.482', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '46.000'} [2024-08-06 00:38:32,566][52650] Updated weights for policy 0, policy_version 24221 (0.0010) [2024-08-06 00:38:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 198418432. Throughput: 0: 4399.6. Samples: 49604340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:38:32,794][52567] Avg episode reward: [(0, '54.979')] [2024-08-06 00:38:33,422][52795] DAMAGECOUNT value on done: 111000.0 [2024-08-06 00:38:33,430][52795] Sum rewards: 53.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.914', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.121', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.378', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.794', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:33,494][52647] DAMAGECOUNT value on done: 128375.0 [2024-08-06 00:38:33,497][52647] Sum rewards: 61.986, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.165', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon2': '0.354', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.422', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:34,129][52649] DAMAGECOUNT value on done: 119300.0 [2024-08-06 00:38:34,129][52649] Sum rewards: 56.131, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.872', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.303', 'weapon2': '0.384', 'WEAPON3': '1.800', 'weapon3': '3.090', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '53.000'} [2024-08-06 00:38:34,415][52664] DAMAGECOUNT value on done: 132120.0 [2024-08-06 00:38:34,416][52664] Sum rewards: 59.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.244', 'weapon2': '0.610', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:34,677][52667] DAMAGECOUNT value on done: 132521.0 [2024-08-06 00:38:34,677][52667] Sum rewards: 63.131, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.204', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.286', 'weapon2': '0.428', 'weapon4': '0.468', 'WEAPON3': '1.600', 'weapon3': '2.894', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '55.000'} [2024-08-06 00:38:34,997][52658] DAMAGECOUNT value on done: 129605.0 [2024-08-06 00:38:34,998][52658] Sum rewards: 57.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.110', 'AMMO4': '0.147', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.462', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '2.554', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:35,095][52669] DAMAGECOUNT value on done: 125819.0 [2024-08-06 00:38:35,096][52669] Sum rewards: 53.428, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.211', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '45.000'} [2024-08-06 00:38:35,814][52647] DAMAGECOUNT value on done: 131533.0 [2024-08-06 00:38:35,815][52647] Sum rewards: 52.516, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.083', 'weapon2': '0.228', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.270', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:36,605][52795] DAMAGECOUNT value on done: 117543.0 [2024-08-06 00:38:36,605][52795] Sum rewards: 51.816, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.075', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.263', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.196', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:36,993][52664] DAMAGECOUNT value on done: 128707.0 [2024-08-06 00:38:36,994][52664] Sum rewards: 84.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.053', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.398', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '71.000'} [2024-08-06 00:38:37,023][52650] Updated weights for policy 0, policy_version 24231 (0.0012) [2024-08-06 00:38:37,386][52649] DAMAGECOUNT value on done: 123198.0 [2024-08-06 00:38:37,388][52649] Sum rewards: 53.160, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.202', 'weapon2': '0.328', 'WEAPON4': '0.450', 'weapon4': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.598', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '46.000'} [2024-08-06 00:38:37,426][52666] DAMAGECOUNT value on done: 126782.0 [2024-08-06 00:38:37,429][52666] Sum rewards: 52.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.318', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO3': '0.195', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.538', 'WEAPON4': '0.550', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.390', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '44.500'} [2024-08-06 00:38:37,736][52667] DAMAGECOUNT value on done: 122202.0 [2024-08-06 00:38:37,736][52667] Sum rewards: 47.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.105', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'weapon4': '0.244', 'AMMO3': '0.253', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '2.980', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '42.000'} [2024-08-06 00:38:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 198508544. Throughput: 0: 4398.0. Samples: 49630750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:38:37,794][52567] Avg episode reward: [(0, '55.180')] [2024-08-06 00:38:38,011][52669] DAMAGECOUNT value on done: 125906.0 [2024-08-06 00:38:38,014][52669] Sum rewards: 51.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.055', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'AMMO4': '0.273', 'weapon2': '0.412', 'WEAPON4': '0.450', 'weapon4': '0.756', 'WEAPON3': '1.300', 'weapon3': '2.170', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:38,099][52658] DAMAGECOUNT value on done: 122727.0 [2024-08-06 00:38:38,100][52658] Sum rewards: 56.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.942', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.206', 'AMMO3': '0.240', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.144', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:38,529][52647] DAMAGECOUNT value on done: 128096.0 [2024-08-06 00:38:38,537][52647] Sum rewards: 58.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.660', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:39,540][52664] DAMAGECOUNT value on done: 129974.0 [2024-08-06 00:38:39,542][52664] Sum rewards: 64.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.160', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.100', 'weapon3': '3.352', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2024-08-06 00:38:39,669][52795] DAMAGECOUNT value on done: 119258.0 [2024-08-06 00:38:39,670][52795] Sum rewards: 58.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.637', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:40,387][52649] DAMAGECOUNT value on done: 122755.0 [2024-08-06 00:38:40,388][52649] Sum rewards: 61.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.218', 'weapon2': '0.416', 'weapon4': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:40,513][52666] DAMAGECOUNT value on done: 125946.0 [2024-08-06 00:38:40,514][52666] Sum rewards: 45.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.128', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.092', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'AMMO4': '0.251', 'weapon4': '0.476', 'WEAPON4': '0.500', 'weapon2': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.600', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '40.000'} [2024-08-06 00:38:40,864][52669] DAMAGECOUNT value on done: 127449.0 [2024-08-06 00:38:40,864][52669] Sum rewards: 62.701, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.193', 'HEALTH': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.398', 'weapon4': '0.722', 'WEAPON3': '1.100', 'weapon3': '2.542', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:40,894][52667] DAMAGECOUNT value on done: 131178.0 [2024-08-06 00:38:40,894][52667] Sum rewards: 68.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.565', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.276', 'weapon2': '0.532', 'WEAPON3': '1.750', 'weapon3': '3.158', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 00:38:40,996][52647] DAMAGECOUNT value on done: 132345.0 [2024-08-06 00:38:40,996][52647] Sum rewards: 61.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.110', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.150', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:41,262][52658] DAMAGECOUNT value on done: 131566.0 [2024-08-06 00:38:41,262][52658] Sum rewards: 56.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.559', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.238', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:41,807][52650] Updated weights for policy 0, policy_version 24241 (0.0012) [2024-08-06 00:38:41,996][52664] DAMAGECOUNT value on done: 131918.0 [2024-08-06 00:38:41,996][52664] Sum rewards: 53.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.010', 'ARMOR': '0.020', 'AMMO4': '0.052', 'weapon4': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.424', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '43.500'} [2024-08-06 00:38:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 198598656. Throughput: 0: 4401.6. Samples: 49657120. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:38:42,794][52567] Avg episode reward: [(0, '55.309')] [2024-08-06 00:38:42,811][52795] DAMAGECOUNT value on done: 113195.0 [2024-08-06 00:38:42,812][52795] Sum rewards: 61.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon4': '0.186', 'AMMO3': '0.230', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:43,217][52647] DAMAGECOUNT value on done: 133165.0 [2024-08-06 00:38:43,218][52647] Sum rewards: 59.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.668', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.146', 'AMMO3': '0.184', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:43,247][52666] DAMAGECOUNT value on done: 127213.0 [2024-08-06 00:38:43,249][52666] Sum rewards: 58.562, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.057', 'AMMO5': '0.010', 'weapon5': '0.018', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.131', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '0.950', 'HITCOUNT': '3.210', 'weapon3': '3.226', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:43,581][52649] DAMAGECOUNT value on done: 119201.0 [2024-08-06 00:38:43,585][52669] DAMAGECOUNT value on done: 128153.0 [2024-08-06 00:38:43,591][52649] Sum rewards: 59.635, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.959', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.173', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.234', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:43,591][52669] Sum rewards: 57.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.333', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.166', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.540', 'weapon4': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.466', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:44,235][52664] DAMAGECOUNT value on done: 127550.0 [2024-08-06 00:38:44,237][52664] Sum rewards: 44.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.055', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.193', 'AMMO4': '0.274', 'weapon2': '0.412', 'WEAPON4': '0.500', 'weapon4': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.692', 'DAMAGECOUNT': '10.851', 'FRAGCOUNT': '39.000'} [2024-08-06 00:38:44,282][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:38:44,628][52658] DAMAGECOUNT value on done: 124217.0 [2024-08-06 00:38:44,630][52658] Sum rewards: 64.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.750', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon2': '0.216', 'AMMO3': '0.282', 'WEAPON3': '1.800', 'HITCOUNT': '3.440', 'weapon3': '3.512', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '58.000'} [2024-08-06 00:38:45,935][52795] DAMAGECOUNT value on done: 118190.0 [2024-08-06 00:38:45,936][52795] Sum rewards: 59.835, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.134', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.271', 'weapon2': '0.382', 'weapon4': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.850', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:46,101][52647] DAMAGECOUNT value on done: 128202.0 [2024-08-06 00:38:46,106][52647] Sum rewards: 56.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.870', 'AMMO5': '0.007', 'weapon5': '0.022', 'ARMOR': '0.029', 'WEAPON5': '0.050', 'AMMO2': '0.055', 'AMMO3': '0.234', 'AMMO4': '0.277', 'weapon4': '0.460', 'weapon2': '0.476', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.792', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:46,369][52666] DAMAGECOUNT value on done: 123225.0 [2024-08-06 00:38:46,371][52666] Sum rewards: 62.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.018', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.123', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.302', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '54.000'} [2024-08-06 00:38:46,557][52650] Updated weights for policy 0, policy_version 24251 (0.0011) [2024-08-06 00:38:46,730][52649] DAMAGECOUNT value on done: 126130.0 [2024-08-06 00:38:46,731][52649] Sum rewards: 53.962, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.386', 'ARMOR': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon4': '0.200', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.186', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '50.000'} [2024-08-06 00:38:47,163][52670] DAMAGECOUNT value on done: 123101.0 [2024-08-06 00:38:47,163][52670] Sum rewards: 48.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.896', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.185', 'WEAPON4': '0.450', 'weapon2': '0.624', 'weapon4': '0.842', 'WEAPON3': '1.100', 'weapon3': '2.204', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '41.000'} [2024-08-06 00:38:47,334][52658] DAMAGECOUNT value on done: 130044.0 [2024-08-06 00:38:47,335][52658] Sum rewards: 59.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.214', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:47,376][52664] DAMAGECOUNT value on done: 129438.0 [2024-08-06 00:38:47,376][52664] Sum rewards: 61.924, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.039', 'HEALTH': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'AMMO4': '0.196', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17750.9, 300 sec: 17578.1). Total num frames: 198688768. Throughput: 0: 4404.2. Samples: 49670240. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:38:47,794][52567] Avg episode reward: [(0, '55.557')] [2024-08-06 00:38:48,993][52795] DAMAGECOUNT value on done: 119211.0 [2024-08-06 00:38:48,994][52795] Sum rewards: 48.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.898', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.133', 'AMMO3': '0.201', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.608', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '42.000'} [2024-08-06 00:38:49,017][52647] DAMAGECOUNT value on done: 132260.0 [2024-08-06 00:38:49,017][52647] Sum rewards: 57.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.499', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon5': '0.158', 'AMMO3': '0.176', 'AMMO4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.700', 'weapon4': '0.846', 'WEAPON3': '1.100', 'weapon3': '2.272', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '49.000'} [2024-08-06 00:38:49,316][52649] DAMAGECOUNT value on done: 124341.0 [2024-08-06 00:38:49,317][52649] Sum rewards: 56.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.040', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO3': '0.111', 'AMMO4': '0.122', 'weapon5': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.754', 'weapon2': '0.950', 'weapon3': '2.028', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:49,477][52666] DAMAGECOUNT value on done: 122938.0 [2024-08-06 00:38:49,479][52666] Sum rewards: 57.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.238', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.202', 'weapon2': '0.894', 'WEAPON3': '1.100', 'weapon3': '2.638', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '48.000'} [2024-08-06 00:38:50,208][52658] DAMAGECOUNT value on done: 130610.0 [2024-08-06 00:38:50,211][52658] Sum rewards: 48.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.245', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.184', 'AMMO4': '0.191', 'weapon5': '0.194', 'WEAPON5': '0.350', 'weapon2': '0.486', 'weapon4': '0.552', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.480', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:50,268][52670] DAMAGECOUNT value on done: 128004.0 [2024-08-06 00:38:50,269][52670] Sum rewards: 50.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.290', 'weapon4': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.120', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:51,125][52650] Updated weights for policy 0, policy_version 24261 (0.0015) [2024-08-06 00:38:51,842][52647] DAMAGECOUNT value on done: 126190.0 [2024-08-06 00:38:51,843][52647] Sum rewards: 46.581, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.637', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.082', 'AMMO3': '0.199', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.346', 'weapon4': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '42.500'} [2024-08-06 00:38:51,915][52649] DAMAGECOUNT value on done: 118790.0 [2024-08-06 00:38:51,915][52649] Sum rewards: 49.396, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.130', 'AMMO3': '0.160', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON4': '0.700', 'weapon4': '0.744', 'WEAPON3': '1.000', 'weapon3': '2.262', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:52,703][52666] DAMAGECOUNT value on done: 121630.0 [2024-08-06 00:38:52,703][52666] Sum rewards: 59.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.618', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.572', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '53.000'} [2024-08-06 00:38:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 198770688. Throughput: 0: 4406.7. Samples: 49696770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:38:52,794][52567] Avg episode reward: [(0, '55.539')] [2024-08-06 00:38:53,273][52658] DAMAGECOUNT value on done: 131211.0 [2024-08-06 00:38:53,273][52658] Sum rewards: 56.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.424', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '47.000'} [2024-08-06 00:38:53,365][52670] DAMAGECOUNT value on done: 123172.0 [2024-08-06 00:38:53,365][52670] Sum rewards: 49.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.274', 'weapon4': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.196', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:53,938][52663] DAMAGECOUNT value on done: 125514.0 [2024-08-06 00:38:53,939][52663] Sum rewards: 50.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.652', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '2.998', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:54,599][52647] DAMAGECOUNT value on done: 130906.0 [2024-08-06 00:38:54,600][52647] Sum rewards: 46.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.283', 'weapon2': '0.560', 'WEAPON3': '1.700', 'HITCOUNT': '2.800', 'weapon3': '3.006', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '43.000'} [2024-08-06 00:38:54,985][52649] DAMAGECOUNT value on done: 124977.0 [2024-08-06 00:38:54,986][52649] Sum rewards: 57.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.424', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon4': '0.170', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.336', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '52.000'} [2024-08-06 00:38:55,160][52666] DAMAGECOUNT value on done: 123461.0 [2024-08-06 00:38:55,162][52666] Sum rewards: 63.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.258', 'weapon4': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '56.000'} [2024-08-06 00:38:55,639][52658] DAMAGECOUNT value on done: 124039.0 [2024-08-06 00:38:55,639][52658] Sum rewards: 59.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.141', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.178', 'AMMO3': '0.194', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.314', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '51.000'} [2024-08-06 00:38:55,826][52650] Updated weights for policy 0, policy_version 24271 (0.0016) [2024-08-06 00:38:55,900][52670] DAMAGECOUNT value on done: 125369.0 [2024-08-06 00:38:55,901][52670] Sum rewards: 51.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.521', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon4': '0.312', 'weapon2': '0.442', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.050', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '44.000'} [2024-08-06 00:38:56,832][52663] DAMAGECOUNT value on done: 126145.0 [2024-08-06 00:38:56,834][52663] Sum rewards: 65.246, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.038', 'weapon4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.204', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'HITCOUNT': '3.410', 'weapon3': '3.542', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '59.000'} [2024-08-06 00:38:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 198860800. Throughput: 0: 4396.2. Samples: 49723080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:38:57,794][52567] Avg episode reward: [(0, '55.648')] [2024-08-06 00:38:57,959][52649] DAMAGECOUNT value on done: 121897.0 [2024-08-06 00:38:57,959][52649] Sum rewards: 50.058, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.133', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.290', 'weapon2': '0.398', 'WEAPON3': '1.700', 'HITCOUNT': '2.710', 'weapon3': '3.274', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '46.500'} [2024-08-06 00:38:58,040][52666] DAMAGECOUNT value on done: 124402.0 [2024-08-06 00:38:58,042][52666] Sum rewards: 59.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.797', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon4': '0.200', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '49.500'} [2024-08-06 00:38:58,665][52658] DAMAGECOUNT value on done: 125994.0 [2024-08-06 00:38:58,666][52658] Sum rewards: 49.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.232', 'weapon4': '0.278', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.052', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '45.000'} [2024-08-06 00:38:58,690][52670] DAMAGECOUNT value on done: 127288.0 [2024-08-06 00:38:58,690][52670] Sum rewards: 57.884, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.320', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.174', 'AMMO3': '0.296', 'WEAPON3': '1.750', 'HITCOUNT': '3.110', 'weapon3': '3.594', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '53.000'} [2024-08-06 00:38:59,829][52663] DAMAGECOUNT value on done: 125919.0 [2024-08-06 00:38:59,829][52663] Sum rewards: 52.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.552', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.780', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:00,587][52650] Updated weights for policy 0, policy_version 24281 (0.0012) [2024-08-06 00:39:00,711][52649] DAMAGECOUNT value on done: 126559.0 [2024-08-06 00:39:00,712][52649] Sum rewards: 57.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon5': '0.048', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon4': '0.412', 'weapon2': '0.472', 'WEAPON3': '1.550', 'weapon3': '2.806', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:01,112][52666] DAMAGECOUNT value on done: 126887.0 [2024-08-06 00:39:01,115][52666] Sum rewards: 48.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.720', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.190', 'AMMO4': '0.190', 'AMMO3': '0.195', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '40.500'} [2024-08-06 00:39:01,725][52670] DAMAGECOUNT value on done: 126449.0 [2024-08-06 00:39:01,725][52670] Sum rewards: 46.073, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.241', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.238', 'weapon2': '0.296', 'AMMO3': '0.316', 'WEAPON3': '1.800', 'HITCOUNT': '2.740', 'weapon3': '3.198', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '45.000'} [2024-08-06 00:39:01,729][52658] DAMAGECOUNT value on done: 125121.0 [2024-08-06 00:39:01,729][52658] Sum rewards: 61.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.753', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.161', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '3.360', 'weapon3': '3.402', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 198942720. Throughput: 0: 4397.6. Samples: 49736430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:39:02,794][52567] Avg episode reward: [(0, '55.512')] [2024-08-06 00:39:03,137][52663] DAMAGECOUNT value on done: 126171.0 [2024-08-06 00:39:03,137][52663] Sum rewards: 49.660, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.086', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'weapon2': '0.496', 'weapon4': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.508', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:03,242][52820] DAMAGECOUNT value on done: 115820.0 [2024-08-06 00:39:03,245][52820] Sum rewards: 62.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.004', 'weapon5': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO4': '0.179', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.736', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '54.000'} [2024-08-06 00:39:03,415][52649] DAMAGECOUNT value on done: 124603.0 [2024-08-06 00:39:03,417][52649] Sum rewards: 61.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.242', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '53.000'} [2024-08-06 00:39:03,601][52666] DAMAGECOUNT value on done: 125901.0 [2024-08-06 00:39:03,602][52666] Sum rewards: 57.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.426', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.092', 'AMMO4': '0.164', 'AMMO3': '0.224', 'weapon4': '0.306', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '52.000'} [2024-08-06 00:39:04,321][52670] DAMAGECOUNT value on done: 120032.0 [2024-08-06 00:39:04,321][52670] Sum rewards: 59.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.334', 'ARMOR': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '47.000'} [2024-08-06 00:39:04,477][52658] DAMAGECOUNT value on done: 125404.0 [2024-08-06 00:39:04,479][52658] Sum rewards: 56.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.703', 'ARMOR': '0.004', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.225', 'weapon4': '0.284', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.118', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:05,147][52650] Updated weights for policy 0, policy_version 24291 (0.0020) [2024-08-06 00:39:05,847][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:39:06,256][52666] DAMAGECOUNT value on done: 123206.0 [2024-08-06 00:39:06,261][52666] Sum rewards: 56.495, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.186', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.040', 'weapon5': '0.146', 'AMMO4': '0.198', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.388', 'WEAPON4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '2.636', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:06,389][52820] DAMAGECOUNT value on done: 118443.0 [2024-08-06 00:39:06,390][52820] Sum rewards: 62.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.216', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 00:39:06,561][52663] DAMAGECOUNT value on done: 121658.0 [2024-08-06 00:39:06,563][52663] Sum rewards: 46.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.924', 'AMMO2': '0.004', 'ARMOR': '0.012', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.201', 'weapon2': '0.854', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '2.946', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '39.000'} [2024-08-06 00:39:06,702][52649] DAMAGECOUNT value on done: 129633.0 [2024-08-06 00:39:06,703][52649] Sum rewards: 48.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.404', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.224', 'weapon2': '0.464', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.128', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:07,098][52670] DAMAGECOUNT value on done: 122661.0 [2024-08-06 00:39:07,098][52670] Sum rewards: 50.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.214', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon2': '0.644', 'WEAPON3': '1.350', 'weapon3': '2.636', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:07,202][52658] DAMAGECOUNT value on done: 129508.0 [2024-08-06 00:39:07,205][52658] Sum rewards: 56.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.228', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.225', 'WEAPON4': '0.450', 'weapon4': '0.688', 'weapon2': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.338', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '47.000'} [2024-08-06 00:39:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 199032832. Throughput: 0: 4395.3. Samples: 49762680. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:39:07,794][52567] Avg episode reward: [(0, '55.712')] [2024-08-06 00:39:08,301][52671] DAMAGECOUNT value on done: 131494.0 [2024-08-06 00:39:08,305][52671] Sum rewards: 61.985, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.623', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.070', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.246', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '55.000'} [2024-08-06 00:39:09,376][52666] DAMAGECOUNT value on done: 120602.0 [2024-08-06 00:39:09,379][52666] Sum rewards: 50.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.206', 'weapon2': '0.676', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.936', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:09,468][52820] DAMAGECOUNT value on done: 114172.0 [2024-08-06 00:39:09,468][52820] Sum rewards: 43.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.611', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO3': '0.138', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.576', 'weapon4': '0.788', 'WEAPON3': '0.900', 'weapon3': '2.320', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '35.000'} [2024-08-06 00:39:09,594][52663] DAMAGECOUNT value on done: 131131.0 [2024-08-06 00:39:09,595][52663] Sum rewards: 61.153, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'AMMO3': '0.292', 'weapon2': '0.346', 'weapon4': '0.578', 'WEAPON3': '1.650', 'weapon3': '2.728', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '53.000'} [2024-08-06 00:39:09,790][52650] Updated weights for policy 0, policy_version 24301 (0.0018) [2024-08-06 00:39:09,929][52658] DAMAGECOUNT value on done: 130899.0 [2024-08-06 00:39:09,932][52658] Sum rewards: 65.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.876', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '55.000'} [2024-08-06 00:39:10,113][52670] DAMAGECOUNT value on done: 119369.0 [2024-08-06 00:39:10,114][52670] Sum rewards: 62.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon7': '0.056', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.408', 'weapon4': '0.684', 'WEAPON3': '0.950', 'weapon3': '2.492', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '51.000'} [2024-08-06 00:39:10,996][52671] DAMAGECOUNT value on done: 125486.0 [2024-08-06 00:39:10,998][52671] Sum rewards: 62.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.068', 'AMMO3': '0.191', 'AMMO4': '0.266', 'weapon2': '0.286', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '52.000'} [2024-08-06 00:39:12,330][52666] DAMAGECOUNT value on done: 124682.0 [2024-08-06 00:39:12,331][52666] Sum rewards: 43.421, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.447', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.150', 'AMMO4': '0.173', 'weapon4': '0.228', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.420', 'weapon3': '2.994', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:12,407][52663] DAMAGECOUNT value on done: 127036.0 [2024-08-06 00:39:12,408][52663] Sum rewards: 58.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'AMMO4': '0.211', 'weapon2': '0.298', 'weapon4': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:12,500][52820] DAMAGECOUNT value on done: 111587.0 [2024-08-06 00:39:12,501][52820] Sum rewards: 65.645, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon2': '0.298', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.258', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '55.000'} [2024-08-06 00:39:12,638][52658] DAMAGECOUNT value on done: 122610.0 [2024-08-06 00:39:12,639][52658] Sum rewards: 68.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.224', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '57.000'} [2024-08-06 00:39:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199122944. Throughput: 0: 4396.0. Samples: 49789210. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:39:12,795][52567] Avg episode reward: [(0, '56.306')] [2024-08-06 00:39:12,975][52670] DAMAGECOUNT value on done: 116725.0 [2024-08-06 00:39:12,977][52670] Sum rewards: 53.058, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.223', 'weapon2': '0.716', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.042', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '44.000'} [2024-08-06 00:39:13,710][52671] DAMAGECOUNT value on done: 129724.0 [2024-08-06 00:39:13,710][52671] Sum rewards: 60.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.528', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.182', 'weapon2': '0.422', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.472', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '51.000'} [2024-08-06 00:39:14,509][52650] Updated weights for policy 0, policy_version 24311 (0.0011) [2024-08-06 00:39:14,929][52666] DAMAGECOUNT value on done: 125591.0 [2024-08-06 00:39:14,939][52666] Sum rewards: 49.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.045', 'weapon5': '0.122', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon4': '0.432', 'WEAPON4': '0.550', 'weapon2': '0.872', 'WEAPON3': '0.900', 'weapon3': '2.346', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '41.000'} [2024-08-06 00:39:14,980][52665] DAMAGECOUNT value on done: 122462.0 [2024-08-06 00:39:14,980][52665] Sum rewards: 61.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.593', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '49.000'} [2024-08-06 00:39:15,156][52663] DAMAGECOUNT value on done: 124379.0 [2024-08-06 00:39:15,157][52663] Sum rewards: 52.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.005', 'AMMO5': '0.003', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.241', 'weapon4': '0.308', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.188', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:15,458][52670] DAMAGECOUNT value on done: 127560.0 [2024-08-06 00:39:15,460][52670] Sum rewards: 47.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.128', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '3.078', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '41.000'} [2024-08-06 00:39:15,639][52820] DAMAGECOUNT value on done: 116690.0 [2024-08-06 00:39:15,641][52820] Sum rewards: 56.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.358', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.238', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:15,750][52658] DAMAGECOUNT value on done: 125128.0 [2024-08-06 00:39:15,751][52658] Sum rewards: 49.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.913', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.664', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:16,577][52671] DAMAGECOUNT value on done: 125093.0 [2024-08-06 00:39:16,578][52671] Sum rewards: 70.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.377', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.106', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '3.174', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '57.000'} [2024-08-06 00:39:17,556][52666] DAMAGECOUNT value on done: 124618.0 [2024-08-06 00:39:17,558][52666] Sum rewards: 55.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.192', 'weapon2': '0.342', 'WEAPON4': '0.450', 'weapon4': '0.896', 'WEAPON3': '1.150', 'weapon3': '2.344', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '46.500'} [2024-08-06 00:39:17,620][52665] DAMAGECOUNT value on done: 131212.0 [2024-08-06 00:39:17,620][52665] Sum rewards: 56.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.380', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.172', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:17,792][52663] DAMAGECOUNT value on done: 127814.0 [2024-08-06 00:39:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199213056. Throughput: 0: 4402.2. Samples: 49802440. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:39:17,796][52567] Avg episode reward: [(0, '56.426')] [2024-08-06 00:39:17,793][52663] Sum rewards: 54.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.354', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon5': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.194', 'weapon2': '0.602', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '2.956', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:18,193][52670] DAMAGECOUNT value on done: 126007.0 [2024-08-06 00:39:18,194][52670] Sum rewards: 52.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.301', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.068', 'AMMO3': '0.146', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.220', 'weapon2': '0.352', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.206', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '41.000'} [2024-08-06 00:39:18,703][52820] DAMAGECOUNT value on done: 116841.0 [2024-08-06 00:39:18,704][52820] Sum rewards: 52.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.775', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.238', 'AMMO3': '0.270', 'weapon2': '0.306', 'WEAPON3': '1.650', 'HITCOUNT': '3.170', 'weapon3': '3.234', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '47.000'} [2024-08-06 00:39:18,835][52658] DAMAGECOUNT value on done: 128433.0 [2024-08-06 00:39:18,835][52658] Sum rewards: 53.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.956', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.534', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '47.000'} [2024-08-06 00:39:19,033][52650] Updated weights for policy 0, policy_version 24321 (0.0024) [2024-08-06 00:39:19,506][52671] DAMAGECOUNT value on done: 126689.0 [2024-08-06 00:39:19,506][52671] Sum rewards: 63.125, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.129', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.076', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.414', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.196', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '52.500'} [2024-08-06 00:39:20,065][52666] DAMAGECOUNT value on done: 122396.0 [2024-08-06 00:39:20,073][52666] Sum rewards: 44.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.674', 'weapon4': '0.758', 'WEAPON3': '1.350', 'weapon3': '2.322', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '38.000'} [2024-08-06 00:39:20,588][52665] DAMAGECOUNT value on done: 125146.0 [2024-08-06 00:39:20,589][52665] Sum rewards: 53.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.283', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.163', 'WEAPON4': '0.300', 'weapon2': '0.430', 'weapon4': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:20,829][52670] DAMAGECOUNT value on done: 125253.0 [2024-08-06 00:39:20,829][52670] Sum rewards: 44.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon5': '0.208', 'AMMO4': '0.290', 'weapon2': '0.530', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon4': '1.040', 'weapon3': '1.980', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '40.000'} [2024-08-06 00:39:21,004][52663] DAMAGECOUNT value on done: 129296.0 [2024-08-06 00:39:21,005][52663] Sum rewards: 68.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.941', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.084', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.229', 'WEAPON3': '1.550', 'weapon3': '3.430', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '58.000'} [2024-08-06 00:39:21,719][52820] DAMAGECOUNT value on done: 117026.0 [2024-08-06 00:39:21,719][52820] Sum rewards: 59.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.099', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon2': '0.380', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.382', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:22,407][52671] DAMAGECOUNT value on done: 126946.0 [2024-08-06 00:39:22,408][52671] Sum rewards: 46.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.327', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.051', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.254', 'weapon2': '0.434', 'weapon4': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.460', 'weapon3': '2.520', 'DAMAGECOUNT': '11.589', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199303168. Throughput: 0: 4400.4. Samples: 49828770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:39:22,794][52567] Avg episode reward: [(0, '55.904')] [2024-08-06 00:39:23,284][52666] DAMAGECOUNT value on done: 122776.0 [2024-08-06 00:39:23,285][52666] Sum rewards: 57.157, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.035', 'HEALTH': '0.088', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.191', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.808', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:23,479][52665] DAMAGECOUNT value on done: 120958.0 [2024-08-06 00:39:23,479][52665] Sum rewards: 55.527, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.608', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon2': '0.330', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '3.256', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '45.000'} [2024-08-06 00:39:23,786][52670] DAMAGECOUNT value on done: 125498.0 [2024-08-06 00:39:23,788][52670] Sum rewards: 58.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.221', 'weapon2': '0.444', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.270', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '51.000'} [2024-08-06 00:39:23,930][52650] Updated weights for policy 0, policy_version 24331 (0.0013) [2024-08-06 00:39:24,021][52663] DAMAGECOUNT value on done: 127249.0 [2024-08-06 00:39:24,023][52663] Sum rewards: 66.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 00:39:24,824][52820] DAMAGECOUNT value on done: 117400.0 [2024-08-06 00:39:24,826][52820] Sum rewards: 50.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.544', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.068', 'weapon4': '0.156', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.722', 'WEAPON3': '1.050', 'weapon3': '2.876', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '44.000'} [2024-08-06 00:39:25,217][52671] DAMAGECOUNT value on done: 127500.0 [2024-08-06 00:39:25,217][52671] Sum rewards: 55.851, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.226', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.148', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.606', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '3.116', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '45.000'} [2024-08-06 00:39:25,842][52666] DAMAGECOUNT value on done: 127460.0 [2024-08-06 00:39:25,842][52666] Sum rewards: 55.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.665', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon7': '0.022', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.402', 'weapon2': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.826', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:26,430][52670] DAMAGECOUNT value on done: 128883.0 [2024-08-06 00:39:26,432][52670] Sum rewards: 44.692, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.234', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.043', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.216', 'AMMO3': '0.227', 'weapon4': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.042', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '41.000'} [2024-08-06 00:39:26,554][52665] DAMAGECOUNT value on done: 123361.0 [2024-08-06 00:39:26,555][52665] Sum rewards: 40.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.452', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.488', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '36.000'} [2024-08-06 00:39:27,154][52663] DAMAGECOUNT value on done: 125107.0 [2024-08-06 00:39:27,154][52663] Sum rewards: 51.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.307', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.356', 'weapon2': '0.574', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:27,661][52803] DAMAGECOUNT value on done: 119177.0 [2024-08-06 00:39:27,661][52803] Sum rewards: 48.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.104', 'AMMO5': '0.005', 'AMMO2': '0.031', 'ARMOR': '0.040', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.224', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '2.764', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199385088. Throughput: 0: 4402.0. Samples: 49855210. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:39:27,794][52567] Avg episode reward: [(0, '55.479')] [2024-08-06 00:39:27,830][52667] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 00:39:28,009][52820] DAMAGECOUNT value on done: 114435.0 [2024-08-06 00:39:28,013][52820] Sum rewards: 46.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.555', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.194', 'weapon4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '3.064', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:28,216][52650] Updated weights for policy 0, policy_version 24341 (0.0019) [2024-08-06 00:39:28,448][52671] DAMAGECOUNT value on done: 129019.0 [2024-08-06 00:39:28,450][52671] Sum rewards: 52.753, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.247', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.112', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '44.000'} [2024-08-06 00:39:28,542][52666] DAMAGECOUNT value on done: 122704.0 [2024-08-06 00:39:28,543][52666] Sum rewards: 55.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.072', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '3.348', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:28,959][52670] DAMAGECOUNT value on done: 119223.0 [2024-08-06 00:39:28,961][52670] Sum rewards: 55.552, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.054', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.127', 'weapon4': '0.220', 'weapon2': '0.256', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.188', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:29,530][52665] DAMAGECOUNT value on done: 124227.0 [2024-08-06 00:39:29,533][52665] Sum rewards: 60.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.909', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.128', 'AMMO3': '0.189', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.500', 'weapon4': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:29,952][52663] DAMAGECOUNT value on done: 120962.0 [2024-08-06 00:39:29,954][52663] Sum rewards: 52.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.152', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '45.000'} [2024-08-06 00:39:30,693][52803] DAMAGECOUNT value on done: 122598.0 [2024-08-06 00:39:30,693][52803] Sum rewards: 59.444, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.048', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.251', 'weapon2': '0.380', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '47.000'} [2024-08-06 00:39:31,169][52671] DAMAGECOUNT value on done: 125370.0 [2024-08-06 00:39:31,172][52671] Sum rewards: 60.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:31,196][52666] DAMAGECOUNT value on done: 125781.0 [2024-08-06 00:39:31,196][52666] Sum rewards: 73.837, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.231', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '2.944', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '65.000'} [2024-08-06 00:39:31,220][52820] DAMAGECOUNT value on done: 118127.0 [2024-08-06 00:39:31,222][52820] Sum rewards: 49.717, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.854', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.048', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.241', 'weapon2': '0.382', 'WEAPON4': '0.650', 'weapon4': '0.668', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '44.000'} [2024-08-06 00:39:31,877][52670] DAMAGECOUNT value on done: 128168.0 [2024-08-06 00:39:31,877][52670] Sum rewards: 55.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.168', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:32,291][52665] DAMAGECOUNT value on done: 125344.0 [2024-08-06 00:39:32,291][52665] Sum rewards: 55.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.652', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.296', 'weapon2': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.094', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 199475200. Throughput: 0: 4406.6. Samples: 49868540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:39:32,795][52567] Avg episode reward: [(0, '55.324')] [2024-08-06 00:39:32,915][52663] DAMAGECOUNT value on done: 123544.0 [2024-08-06 00:39:32,916][52663] Sum rewards: 49.238, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.777', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.548', 'weapon4': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.654', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:32,928][52659] DAMAGECOUNT value on done: 127019.0 [2024-08-06 00:39:32,929][52659] Sum rewards: 53.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.171', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.808', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:32,940][52811] DAMAGECOUNT value on done: 127637.0 [2024-08-06 00:39:32,940][52811] Sum rewards: 68.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.502', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.068', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.244', 'ARMOR': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '56.000'} [2024-08-06 00:39:33,146][52650] Updated weights for policy 0, policy_version 24351 (0.0022) [2024-08-06 00:39:33,548][52803] DAMAGECOUNT value on done: 119442.0 [2024-08-06 00:39:33,548][52803] Sum rewards: 59.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.000', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.138', 'WEAPON4': '0.150', 'weapon2': '0.224', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.440', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '53.000'} [2024-08-06 00:39:33,834][52671] DAMAGECOUNT value on done: 129673.0 [2024-08-06 00:39:33,835][52671] Sum rewards: 69.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon4': '0.212', 'AMMO3': '0.222', 'weapon2': '0.490', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '58.000'} [2024-08-06 00:39:34,181][52820] DAMAGECOUNT value on done: 118625.0 [2024-08-06 00:39:34,181][52820] Sum rewards: 48.464, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.717', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.243', 'weapon2': '0.330', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '45.000'} [2024-08-06 00:39:34,769][52670] DAMAGECOUNT value on done: 126243.0 [2024-08-06 00:39:34,772][52670] Sum rewards: 50.808, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.697', 'ARMOR': '0.004', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.301', 'weapon4': '0.338', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.924', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:35,390][52665] DAMAGECOUNT value on done: 128785.0 [2024-08-06 00:39:35,391][52665] Sum rewards: 62.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.193', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.030', 'weapon4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.241', 'weapon2': '0.354', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.356', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 00:39:35,634][52659] DAMAGECOUNT value on done: 126317.0 [2024-08-06 00:39:35,645][52659] Sum rewards: 58.880, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.128', 'AMMO3': '0.218', 'AMMO4': '0.281', 'WEAPON5': '0.300', 'weapon4': '0.430', 'WEAPON4': '0.500', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.536', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '49.500'} [2024-08-06 00:39:35,970][52663] DAMAGECOUNT value on done: 128165.0 [2024-08-06 00:39:35,971][52663] Sum rewards: 58.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.582', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.100', 'weapon4': '0.220', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.300', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '52.000'} [2024-08-06 00:39:36,110][52811] DAMAGECOUNT value on done: 117326.0 [2024-08-06 00:39:36,110][52811] Sum rewards: 53.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.193', 'weapon2': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.586', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:36,540][52803] DAMAGECOUNT value on done: 118418.0 [2024-08-06 00:39:36,541][52803] Sum rewards: 45.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.844', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.120', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.546', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '2.770', 'DAMAGECOUNT': '12.567', 'FRAGCOUNT': '41.000'} [2024-08-06 00:39:36,566][52671] DAMAGECOUNT value on done: 126843.0 [2024-08-06 00:39:36,566][52671] Sum rewards: 56.926, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.540', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.248', 'AMMO3': '0.320', 'weapon2': '0.488', 'WEAPON3': '1.900', 'weapon3': '2.918', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '54.000'} [2024-08-06 00:39:37,196][52820] DAMAGECOUNT value on done: 119470.0 [2024-08-06 00:39:37,197][52820] Sum rewards: 51.413, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.322', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.180', 'WEAPON4': '0.400', 'weapon2': '0.432', 'weapon4': '0.698', 'WEAPON3': '1.150', 'weapon3': '2.608', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:37,380][52670] DAMAGECOUNT value on done: 124363.0 [2024-08-06 00:39:37,382][52670] Sum rewards: 59.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.416', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.334', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '52.000'} [2024-08-06 00:39:37,637][52650] Updated weights for policy 0, policy_version 24361 (0.0011) [2024-08-06 00:39:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199565312. Throughput: 0: 4401.3. Samples: 49894830. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:39:37,794][52567] Avg episode reward: [(0, '55.592')] [2024-08-06 00:39:38,503][52659] DAMAGECOUNT value on done: 126760.0 [2024-08-06 00:39:38,503][52659] Sum rewards: 54.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.734', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '2.924', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '47.000'} [2024-08-06 00:39:38,591][52665] DAMAGECOUNT value on done: 131345.0 [2024-08-06 00:39:38,592][52665] Sum rewards: 62.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.020', 'AMMO4': '0.044', 'weapon5': '0.130', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.500', 'weapon4': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.526', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '51.000'} [2024-08-06 00:39:38,845][52663] DAMAGECOUNT value on done: 128472.0 [2024-08-06 00:39:38,847][52663] Sum rewards: 57.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.595', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.188', 'weapon4': '0.222', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:39,200][52811] DAMAGECOUNT value on done: 118388.0 [2024-08-06 00:39:39,203][52811] Sum rewards: 55.432, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.682', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon4': '0.084', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.194', 'AMMO3': '0.273', 'weapon2': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.978', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '52.000'} [2024-08-06 00:39:39,473][52671] DAMAGECOUNT value on done: 126857.0 [2024-08-06 00:39:39,474][52671] Sum rewards: 58.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.543', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.584', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.192', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:39,577][52803] DAMAGECOUNT value on done: 123344.0 [2024-08-06 00:39:39,578][52803] Sum rewards: 52.963, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.186', 'AMMO5': '0.013', 'ARMOR': '0.044', 'AMMO2': '0.056', 'weapon5': '0.152', 'AMMO3': '0.246', 'AMMO4': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.504', 'WEAPON4': '0.650', 'weapon2': '0.660', 'WEAPON3': '1.450', 'weapon3': '2.416', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:40,063][52670] DAMAGECOUNT value on done: 124019.0 [2024-08-06 00:39:40,063][52670] Sum rewards: 68.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.070', 'weapon4': '0.094', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.764', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '55.000'} [2024-08-06 00:39:40,470][52820] DAMAGECOUNT value on done: 116474.0 [2024-08-06 00:39:40,472][52820] Sum rewards: 66.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.958', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.171', 'AMMO3': '0.217', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '55.000'} [2024-08-06 00:39:41,485][52659] DAMAGECOUNT value on done: 128646.0 [2024-08-06 00:39:41,485][52659] Sum rewards: 59.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.955', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.140', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '51.000'} [2024-08-06 00:39:41,576][52665] DAMAGECOUNT value on done: 126130.0 [2024-08-06 00:39:41,576][52665] Sum rewards: 50.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.194', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'AMMO4': '0.255', 'weapon2': '0.324', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.002', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:41,909][52663] DAMAGECOUNT value on done: 129485.0 [2024-08-06 00:39:41,909][52663] Sum rewards: 64.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.248', 'weapon2': '0.368', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.374', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '56.000'} [2024-08-06 00:39:42,255][52811] DAMAGECOUNT value on done: 119369.0 [2024-08-06 00:39:42,258][52811] Sum rewards: 69.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.306', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.018', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.189', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '57.000'} [2024-08-06 00:39:42,377][52670] Large shaping reward 2.611 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2024-08-06 00:39:42,364][52650] Updated weights for policy 0, policy_version 24371 (0.0037) [2024-08-06 00:39:42,540][52671] DAMAGECOUNT value on done: 132680.0 [2024-08-06 00:39:42,542][52671] Sum rewards: 63.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.178', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '55.000'} [2024-08-06 00:39:42,720][52803] DAMAGECOUNT value on done: 121129.0 [2024-08-06 00:39:42,720][52803] Sum rewards: 71.653, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.288', 'ARMOR': '0.008', 'AMMO2': '0.040', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.200', 'weapon4': '0.268', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '58.000'} [2024-08-06 00:39:42,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199655424. Throughput: 0: 4402.9. Samples: 49921210. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:39:42,795][52567] Avg episode reward: [(0, '56.443')] [2024-08-06 00:39:43,742][52820] DAMAGECOUNT value on done: 118375.0 [2024-08-06 00:39:43,743][52820] Sum rewards: 70.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.951', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.206', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '59.000'} [2024-08-06 00:39:44,400][52659] DAMAGECOUNT value on done: 126580.0 [2024-08-06 00:39:44,400][52659] Sum rewards: 56.473, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.524', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.170', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.336', 'weapon4': '0.518', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:44,692][52665] DAMAGECOUNT value on done: 127692.0 [2024-08-06 00:39:44,695][52665] Sum rewards: 61.688, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.757', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.153', 'weapon2': '0.776', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '49.000'} [2024-08-06 00:39:45,024][52663] DAMAGECOUNT value on done: 129328.0 [2024-08-06 00:39:45,025][52663] Sum rewards: 65.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.060', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.169', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.554', 'weapon2': '0.578', 'WEAPON3': '0.950', 'weapon3': '2.480', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '52.000'} [2024-08-06 00:39:45,284][52671] DAMAGECOUNT value on done: 128378.0 [2024-08-06 00:39:45,285][52671] Sum rewards: 64.248, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.455', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.242', 'weapon4': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.298', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '54.000'} [2024-08-06 00:39:45,336][52811] DAMAGECOUNT value on done: 118650.0 [2024-08-06 00:39:45,337][52811] Sum rewards: 46.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.517', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.804', 'WEAPON3': '1.450', 'weapon3': '2.684', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:45,533][52803] DAMAGECOUNT value on done: 122725.0 [2024-08-06 00:39:45,535][52803] Sum rewards: 55.280, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.314', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.254', 'AMMO3': '0.263', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.312', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '49.000'} [2024-08-06 00:39:46,895][52820] DAMAGECOUNT value on done: 119880.0 [2024-08-06 00:39:46,903][52820] Sum rewards: 42.744, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.451', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.870', 'DAMAGECOUNT': '11.328', 'FRAGCOUNT': '41.000'} [2024-08-06 00:39:47,138][52650] Updated weights for policy 0, policy_version 24381 (0.0036) [2024-08-06 00:39:47,276][52665] DAMAGECOUNT value on done: 127087.0 [2024-08-06 00:39:47,277][52665] Sum rewards: 68.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.654', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.211', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '57.000'} [2024-08-06 00:39:47,437][52659] DAMAGECOUNT value on done: 127877.0 [2024-08-06 00:39:47,439][52659] Sum rewards: 70.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.024', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon5': '0.102', 'AMMO3': '0.132', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.748', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '57.000'} [2024-08-06 00:39:47,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 199745536. Throughput: 0: 4396.9. Samples: 49934290. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:39:47,795][52567] Avg episode reward: [(0, '56.853')] [2024-08-06 00:39:47,798][52614] Saving new best policy, reward=56.853! [2024-08-06 00:39:47,960][52663] DAMAGECOUNT value on done: 127957.0 [2024-08-06 00:39:47,960][52663] Sum rewards: 58.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.372', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '50.000'} [2024-08-06 00:39:48,287][52671] DAMAGECOUNT value on done: 123792.0 [2024-08-06 00:39:48,287][52671] Sum rewards: 49.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.005', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.182', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.696', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.904', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:48,498][52811] DAMAGECOUNT value on done: 123585.0 [2024-08-06 00:39:48,499][52811] Sum rewards: 59.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.295', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '52.000'} [2024-08-06 00:39:48,732][52803] DAMAGECOUNT value on done: 117368.0 [2024-08-06 00:39:48,733][52803] Sum rewards: 41.073, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.497', 'AMMO5': '0.005', 'ARMOR': '0.032', 'AMMO2': '0.032', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.376', 'weapon4': '0.482', 'WEAPON3': '1.550', 'HITCOUNT': '2.660', 'weapon3': '2.764', 'DAMAGECOUNT': '11.199', 'FRAGCOUNT': '40.000'} [2024-08-06 00:39:49,949][52820] DAMAGECOUNT value on done: 118091.0 [2024-08-06 00:39:49,951][52820] Sum rewards: 40.942, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.864', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.056', 'AMMO3': '0.175', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.400', 'weapon4': '0.444', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.824', 'DAMAGECOUNT': '12.147', 'FRAGCOUNT': '37.500'} [2024-08-06 00:39:50,381][52665] DAMAGECOUNT value on done: 126132.0 [2024-08-06 00:39:50,381][52665] Sum rewards: 59.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.465', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.102', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '0.950', 'weapon3': '3.018', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:50,460][52659] DAMAGECOUNT value on done: 128516.0 [2024-08-06 00:39:50,460][52659] Sum rewards: 54.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.838', 'AMMO5': '0.010', 'ARMOR': '0.021', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.394', 'WEAPON3': '1.550', 'weapon3': '2.970', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:50,916][52663] DAMAGECOUNT value on done: 126055.0 [2024-08-06 00:39:50,916][52663] Sum rewards: 48.348, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon4': '0.100', 'weapon5': '0.114', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.032', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '42.000'} [2024-08-06 00:39:51,358][52671] DAMAGECOUNT value on done: 130961.0 [2024-08-06 00:39:51,359][52671] Sum rewards: 68.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.117', 'AMMO3': '0.162', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '57.000'} [2024-08-06 00:39:51,687][52811] DAMAGECOUNT value on done: 118241.0 [2024-08-06 00:39:51,689][52811] Sum rewards: 55.161, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.919', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.090', 'weapon5': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.622', 'weapon2': '0.632', 'WEAPON3': '0.750', 'weapon3': '2.468', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '43.000'} [2024-08-06 00:39:51,709][52650] Updated weights for policy 0, policy_version 24391 (0.0011) [2024-08-06 00:39:51,728][52803] DAMAGECOUNT value on done: 119477.0 [2024-08-06 00:39:51,728][52803] Sum rewards: 55.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.478', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.161', 'weapon2': '0.306', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '3.046', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '46.000'} [2024-08-06 00:39:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 199827456. Throughput: 0: 4399.8. Samples: 49960670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:39:52,794][52567] Avg episode reward: [(0, '56.688')] [2024-08-06 00:39:53,103][52820] DAMAGECOUNT value on done: 118493.0 [2024-08-06 00:39:53,111][52820] Sum rewards: 60.403, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.674', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon2': '0.240', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon4': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '54.000'} [2024-08-06 00:39:53,422][52659] DAMAGECOUNT value on done: 122905.0 [2024-08-06 00:39:53,423][52659] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.216', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.157', 'weapon2': '0.250', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '49.000'} [2024-08-06 00:39:53,437][52665] DAMAGECOUNT value on done: 125961.0 [2024-08-06 00:39:53,441][52665] Sum rewards: 56.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.106', 'AMMO3': '0.165', 'AMMO4': '0.231', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '49.000'} [2024-08-06 00:39:54,432][52671] DAMAGECOUNT value on done: 127753.0 [2024-08-06 00:39:54,434][52671] Sum rewards: 63.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.924', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.248', 'AMMO3': '0.257', 'weapon2': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '54.000'} [2024-08-06 00:39:54,638][52803] DAMAGECOUNT value on done: 116208.0 [2024-08-06 00:39:54,641][52803] Sum rewards: 76.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.016', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.576', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '64.000'} [2024-08-06 00:39:54,788][52811] DAMAGECOUNT value on done: 117755.0 [2024-08-06 00:39:54,788][52811] Sum rewards: 48.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.433', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.104', 'AMMO3': '0.173', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.468', 'weapon2': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.428', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '41.000'} [2024-08-06 00:39:56,147][52820] DAMAGECOUNT value on done: 120584.0 [2024-08-06 00:39:56,147][52820] Sum rewards: 72.152, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.157', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.808', 'WEAPON3': '0.950', 'weapon3': '2.750', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '57.000'} [2024-08-06 00:39:56,345][52650] Updated weights for policy 0, policy_version 24401 (0.0017) [2024-08-06 00:39:56,423][52665] DAMAGECOUNT value on done: 126376.0 [2024-08-06 00:39:56,424][52665] Sum rewards: 67.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.890', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '56.000'} [2024-08-06 00:39:56,573][52659] DAMAGECOUNT value on done: 128787.0 [2024-08-06 00:39:56,575][52659] Sum rewards: 78.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.762', 'ARMOR': '0.014', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.306', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '64.000'} [2024-08-06 00:39:57,313][52671] DAMAGECOUNT value on done: 127962.0 [2024-08-06 00:39:57,315][52671] Sum rewards: 57.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.488', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.053', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'AMMO4': '0.264', 'weapon4': '0.406', 'weapon2': '0.564', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:57,782][52803] DAMAGECOUNT value on done: 122666.0 [2024-08-06 00:39:57,786][52803] Sum rewards: 65.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.081', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.198', 'weapon4': '0.272', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '54.000'} [2024-08-06 00:39:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 199909376. Throughput: 0: 4403.1. Samples: 49987350. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:39:57,795][52567] Avg episode reward: [(0, '57.328')] [2024-08-06 00:39:57,798][52614] Saving new best policy, reward=57.328! [2024-08-06 00:39:57,842][52811] DAMAGECOUNT value on done: 123543.0 [2024-08-06 00:39:57,843][52811] Sum rewards: 68.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.296', 'weapon4': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '56.000'} [2024-08-06 00:39:59,261][52820] DAMAGECOUNT value on done: 121351.0 [2024-08-06 00:39:59,261][52820] Sum rewards: 56.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.256', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.018', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.218', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '48.000'} [2024-08-06 00:39:59,451][52665] DAMAGECOUNT value on done: 122639.0 [2024-08-06 00:39:59,453][52665] Sum rewards: 45.104, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.188', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.550', 'weapon3': '2.812', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '39.000'} [2024-08-06 00:39:59,611][52659] DAMAGECOUNT value on done: 129716.0 [2024-08-06 00:39:59,612][52659] Sum rewards: 67.538, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.226', 'AMMO3': '0.255', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '58.000'} [2024-08-06 00:40:00,525][52671] DAMAGECOUNT value on done: 128932.0 [2024-08-06 00:40:00,527][52671] Sum rewards: 69.516, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.284', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.232', 'weapon2': '0.408', 'WEAPON3': '0.950', 'weapon3': '3.142', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '55.000'} [2024-08-06 00:40:00,908][52811] DAMAGECOUNT value on done: 118191.0 [2024-08-06 00:40:00,911][52811] Sum rewards: 53.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.992', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.141', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.594', 'weapon2': '0.764', 'WEAPON3': '1.200', 'weapon3': '2.198', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '48.000'} [2024-08-06 00:40:00,974][52803] DAMAGECOUNT value on done: 122985.0 [2024-08-06 00:40:00,975][52803] Sum rewards: 54.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.432', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.042', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.207', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.100', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '45.000'} [2024-08-06 00:40:01,191][52650] Updated weights for policy 0, policy_version 24411 (0.0039) [2024-08-06 00:40:01,351][52668] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 00:40:02,309][52665] DAMAGECOUNT value on done: 125691.0 [2024-08-06 00:40:02,313][52665] Sum rewards: 73.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.574', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.308', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '61.000'} [2024-08-06 00:40:02,335][52820] DAMAGECOUNT value on done: 116535.0 [2024-08-06 00:40:02,337][52820] Sum rewards: 56.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.107', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.233', 'weapon2': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.164', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '49.000'} [2024-08-06 00:40:02,552][52659] DAMAGECOUNT value on done: 125791.0 [2024-08-06 00:40:02,552][52659] Sum rewards: 48.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.352', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.185', 'weapon5': '0.296', 'AMMO4': '0.302', 'weapon4': '0.488', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.368', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '42.000'} [2024-08-06 00:40:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 200007680. Throughput: 0: 4390.7. Samples: 50000020. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:40:02,794][52567] Avg episode reward: [(0, '57.794')] [2024-08-06 00:40:02,795][52614] Saving new best policy, reward=57.794! [2024-08-06 00:40:03,232][52671] DAMAGECOUNT value on done: 127219.0 [2024-08-06 00:40:03,232][52671] Sum rewards: 57.121, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.024', 'HEALTH': '0.054', 'AMMO4': '0.119', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.584', 'WEAPON3': '0.950', 'HITCOUNT': '3.120', 'weapon3': '3.128', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '46.000'} [2024-08-06 00:40:04,019][52803] DAMAGECOUNT value on done: 120514.0 [2024-08-06 00:40:04,020][52803] Sum rewards: 57.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon4': '0.172', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.282', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '51.000'} [2024-08-06 00:40:04,285][52811] DAMAGECOUNT value on done: 119784.0 [2024-08-06 00:40:04,287][52811] Sum rewards: 55.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.022', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.240', 'weapon2': '0.570', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '49.000'} [2024-08-06 00:40:05,352][52659] DAMAGECOUNT value on done: 122057.0 [2024-08-06 00:40:05,353][52659] Sum rewards: 56.508, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.906', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.161', 'AMMO3': '0.164', 'WEAPON4': '0.300', 'weapon4': '0.446', 'weapon2': '0.746', 'WEAPON3': '1.000', 'weapon3': '2.634', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '45.000'} [2024-08-06 00:40:05,453][52665] DAMAGECOUNT value on done: 120427.0 [2024-08-06 00:40:05,458][52665] Sum rewards: 52.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.753', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.536', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.076', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '45.500'} [2024-08-06 00:40:05,458][52650] Updated weights for policy 0, policy_version 24421 (0.0025) [2024-08-06 00:40:07,074][52803] DAMAGECOUNT value on done: 120770.0 [2024-08-06 00:40:07,075][52803] Sum rewards: 56.617, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.514', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'AMMO3': '0.284', 'weapon2': '0.296', 'WEAPON3': '1.600', 'weapon3': '3.084', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '52.000'} [2024-08-06 00:40:07,434][52811] DAMAGECOUNT value on done: 119025.0 [2024-08-06 00:40:07,435][52811] Sum rewards: 62.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.246', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.117', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.322', 'weapon4': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '54.000'} [2024-08-06 00:40:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 200089600. Throughput: 0: 4394.2. Samples: 50026510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:40:07,795][52567] Avg episode reward: [(0, '58.035')] [2024-08-06 00:40:07,798][52614] Saving new best policy, reward=58.035! [2024-08-06 00:40:08,133][52659] DAMAGECOUNT value on done: 122585.0 [2024-08-06 00:40:08,134][52659] Sum rewards: 58.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.133', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.450', 'weapon2': '0.640', 'weapon4': '0.756', 'WEAPON3': '0.900', 'weapon3': '2.300', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '48.000'} [2024-08-06 00:40:08,520][52665] DAMAGECOUNT value on done: 123490.0 [2024-08-06 00:40:08,521][52665] Sum rewards: 51.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.142', 'AMMO2': '0.045', 'AMMO3': '0.197', 'AMMO4': '0.223', 'WEAPON4': '0.450', 'weapon2': '0.524', 'weapon4': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '44.000'} [2024-08-06 00:40:10,134][52803] DAMAGECOUNT value on done: 117170.0 [2024-08-06 00:40:10,134][52803] Sum rewards: 41.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.068', 'AMMO3': '0.096', 'weapon5': '0.278', 'AMMO4': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '0.550', 'weapon2': '0.578', 'weapon4': '0.688', 'WEAPON4': '0.750', 'weapon3': '2.248', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '11.718', 'FRAGCOUNT': '35.000'} [2024-08-06 00:40:10,490][52650] Updated weights for policy 0, policy_version 24431 (0.0012) [2024-08-06 00:40:10,646][52811] DAMAGECOUNT value on done: 119469.0 [2024-08-06 00:40:10,647][52811] Sum rewards: 45.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.044', 'AMMO3': '0.136', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.394', 'weapon4': '0.622', 'WEAPON3': '0.850', 'HITCOUNT': '2.570', 'weapon3': '2.642', 'DAMAGECOUNT': '10.596', 'FRAGCOUNT': '39.000'} [2024-08-06 00:40:10,970][52659] DAMAGECOUNT value on done: 129628.0 [2024-08-06 00:40:10,971][52659] Sum rewards: 42.675, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'weapon5': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.234', 'weapon4': '0.522', 'WEAPON4': '0.600', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '40.000'} [2024-08-06 00:40:11,563][52665] DAMAGECOUNT value on done: 124938.0 [2024-08-06 00:40:11,565][52665] Sum rewards: 56.656, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.270', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.136', 'AMMO4': '0.220', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.340', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '50.000'} [2024-08-06 00:40:12,437][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:40:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 200179712. Throughput: 0: 4383.1. Samples: 50052450. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 00:40:12,794][52567] Avg episode reward: [(0, '57.557')] [2024-08-06 00:40:13,295][52803] DAMAGECOUNT value on done: 116057.0 [2024-08-06 00:40:13,304][52803] Sum rewards: 51.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'weapon4': '0.414', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '44.000'} [2024-08-06 00:40:13,720][52811] DAMAGECOUNT value on done: 121416.0 [2024-08-06 00:40:13,721][52811] Sum rewards: 58.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.101', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.150', 'weapon4': '0.232', 'AMMO3': '0.235', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '51.000'} [2024-08-06 00:40:13,770][52659] DAMAGECOUNT value on done: 128875.0 [2024-08-06 00:40:13,771][52659] Sum rewards: 69.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.086', 'AMMO5': '0.009', 'AMMO2': '0.037', 'AMMO3': '0.144', 'weapon5': '0.166', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.460', 'weapon4': '0.466', 'WEAPON3': '0.850', 'weapon3': '2.674', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '55.000'} [2024-08-06 00:40:14,954][52650] Updated weights for policy 0, policy_version 24441 (0.0041) [2024-08-06 00:40:16,343][52803] DAMAGECOUNT value on done: 120907.0 [2024-08-06 00:40:16,344][52803] Sum rewards: 56.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.226', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '47.000'} [2024-08-06 00:40:16,771][52811] DAMAGECOUNT value on done: 121503.0 [2024-08-06 00:40:16,772][52811] Sum rewards: 50.540, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.826', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.160', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.400', 'HITCOUNT': '2.630', 'weapon3': '2.886', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '47.000'} [2024-08-06 00:40:16,919][52659] DAMAGECOUNT value on done: 133018.0 [2024-08-06 00:40:16,919][52659] Sum rewards: 59.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.768', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.162', 'AMMO4': '0.233', 'AMMO3': '0.240', 'weapon4': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '52.500'} [2024-08-06 00:40:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 200269824. Throughput: 0: 4381.4. Samples: 50065700. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 00:40:17,794][52567] Avg episode reward: [(0, '58.162')] [2024-08-06 00:40:17,798][52614] Saving new best policy, reward=58.162! [2024-08-06 00:40:19,518][52803] DAMAGECOUNT value on done: 119888.0 [2024-08-06 00:40:19,519][52803] Sum rewards: 49.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.102', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.356', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '43.000'} [2024-08-06 00:40:19,881][52811] DAMAGECOUNT value on done: 123549.0 [2024-08-06 00:40:19,882][52811] Sum rewards: 58.501, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.972', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.224', 'AMMO3': '0.273', 'WEAPON3': '1.700', 'HITCOUNT': '3.420', 'weapon3': '3.460', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '53.000'} [2024-08-06 00:40:19,883][52650] Updated weights for policy 0, policy_version 24451 (0.0023) [2024-08-06 00:40:20,120][52659] DAMAGECOUNT value on done: 129245.0 [2024-08-06 00:40:20,121][52659] Sum rewards: 64.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.643', 'AMMO5': '0.007', 'AMMO2': '0.041', 'AMMO3': '0.188', 'AMMO4': '0.207', 'weapon5': '0.226', 'weapon4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '56.000'} [2024-08-06 00:40:22,616][52803] DAMAGECOUNT value on done: 121288.0 [2024-08-06 00:40:22,617][52803] Sum rewards: 52.232, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.644', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.068', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon4': '0.242', 'AMMO4': '0.339', 'weapon2': '0.548', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '48.000'} [2024-08-06 00:40:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 200351744. Throughput: 0: 4382.0. Samples: 50092020. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 00:40:22,794][52567] Avg episode reward: [(0, '58.166')] [2024-08-06 00:40:22,795][52614] Saving new best policy, reward=58.166! [2024-08-06 00:40:22,902][52811] DAMAGECOUNT value on done: 119338.0 [2024-08-06 00:40:22,904][52811] Sum rewards: 61.525, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.168', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'AMMO4': '0.278', 'weapon4': '0.354', 'weapon2': '0.438', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '55.000'} [2024-08-06 00:40:23,190][52659] DAMAGECOUNT value on done: 126299.0 [2024-08-06 00:40:23,194][52659] Sum rewards: 43.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.086', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.043', 'weapon5': '0.050', 'AMMO3': '0.121', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon2': '0.618', 'WEAPON4': '0.650', 'WEAPON3': '0.650', 'weapon4': '0.760', 'weapon3': '2.394', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '37.000'} [2024-08-06 00:40:24,277][52668] DAMAGECOUNT value on done: 127357.0 [2024-08-06 00:40:24,278][52668] Sum rewards: 72.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.070', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '3.138', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '59.000'} [2024-08-06 00:40:24,750][52662] DAMAGECOUNT value on done: 132794.0 [2024-08-06 00:40:24,751][52662] Sum rewards: 49.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.814', 'weapon5': '0.012', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.400', 'weapon2': '0.446', 'weapon4': '0.732', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '41.000'} [2024-08-06 00:40:24,827][52650] Updated weights for policy 0, policy_version 24461 (0.0022) [2024-08-06 00:40:25,841][52803] DAMAGECOUNT value on done: 116370.0 [2024-08-06 00:40:25,845][52803] Sum rewards: 53.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.191', 'weapon2': '0.368', 'WEAPON4': '0.450', 'weapon4': '0.920', 'WEAPON3': '1.100', 'weapon3': '2.474', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '45.500'} [2024-08-06 00:40:25,957][52659] DAMAGECOUNT value on done: 131363.0 [2024-08-06 00:40:25,959][52659] Sum rewards: 56.057, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.572', 'AMMO5': '0.004', 'AMMO2': '0.036', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.287', 'weapon4': '0.316', 'weapon2': '0.338', 'WEAPON3': '1.650', 'weapon3': '3.036', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '52.000'} [2024-08-06 00:40:26,106][52811] DAMAGECOUNT value on done: 123399.0 [2024-08-06 00:40:26,107][52811] Sum rewards: 45.658, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.436', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.151', 'weapon5': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.718', 'WEAPON3': '0.950', 'weapon3': '2.492', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '36.000'} [2024-08-06 00:40:26,887][52668] DAMAGECOUNT value on done: 133494.0 [2024-08-06 00:40:26,889][52668] Sum rewards: 51.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'weapon5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.490', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '43.000'} [2024-08-06 00:40:27,445][52662] DAMAGECOUNT value on done: 134134.0 [2024-08-06 00:40:27,446][52662] Sum rewards: 53.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.988', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.172', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '3.126', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '46.000'} [2024-08-06 00:40:27,599][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:40:27,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 200433664. Throughput: 0: 4364.4. Samples: 50117610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:40:27,795][52567] Avg episode reward: [(0, '57.783')] [2024-08-06 00:40:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024467_200433664.pth... [2024-08-06 00:40:27,929][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000023953_196222976.pth [2024-08-06 00:40:29,181][52659] DAMAGECOUNT value on done: 131121.0 [2024-08-06 00:40:29,183][52659] Sum rewards: 55.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.042', 'weapon4': '0.084', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.470', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '47.500'} [2024-08-06 00:40:29,302][52650] Updated weights for policy 0, policy_version 24471 (0.0018) [2024-08-06 00:40:29,418][52811] DAMAGECOUNT value on done: 120353.0 [2024-08-06 00:40:29,418][52811] Sum rewards: 59.157, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.612', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO4': '0.228', 'AMMO3': '0.234', 'weapon2': '0.356', 'WEAPON5': '0.400', 'weapon4': '0.542', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.598', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '52.000'} [2024-08-06 00:40:29,638][52668] DAMAGECOUNT value on done: 129407.0 [2024-08-06 00:40:29,638][52668] Sum rewards: 51.500, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.535', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.206', 'weapon5': '0.214', 'AMMO4': '0.234', 'AMMO3': '0.248', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '2.938', 'DAMAGECOUNT': '12.918', 'FRAGCOUNT': '47.000'} [2024-08-06 00:40:30,560][52662] DAMAGECOUNT value on done: 136763.0 [2024-08-06 00:40:30,560][52662] Sum rewards: 51.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'AMMO4': '0.244', 'ARMOR': '0.480', 'weapon4': '0.684', 'WEAPON4': '0.700', 'weapon2': '0.774', 'WEAPON3': '0.850', 'weapon3': '2.298', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '43.000'} [2024-08-06 00:40:32,418][52668] DAMAGECOUNT value on done: 126710.0 [2024-08-06 00:40:32,419][52668] Sum rewards: 41.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.112', 'AMMO2': '0.048', 'AMMO3': '0.204', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.640', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.776', 'DAMAGECOUNT': '11.811', 'FRAGCOUNT': '36.000'} [2024-08-06 00:40:32,443][52811] DAMAGECOUNT value on done: 121714.0 [2024-08-06 00:40:32,444][52811] Sum rewards: 49.005, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.783', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.130', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.272', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.720', 'weapon3': '3.068', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '46.000'} [2024-08-06 00:40:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 200523776. Throughput: 0: 4357.1. Samples: 50130360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:40:32,795][52567] Avg episode reward: [(0, '57.375')] [2024-08-06 00:40:33,775][52662] DAMAGECOUNT value on done: 127280.0 [2024-08-06 00:40:33,776][52662] Sum rewards: 50.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.104', 'AMMO3': '0.151', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon4': '1.156', 'weapon3': '2.288', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '43.000'} [2024-08-06 00:40:33,817][52650] Updated weights for policy 0, policy_version 24481 (0.0022) [2024-08-06 00:40:35,144][52668] DAMAGECOUNT value on done: 128698.0 [2024-08-06 00:40:35,144][52668] Sum rewards: 62.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.664', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '54.000'} [2024-08-06 00:40:36,526][52662] DAMAGECOUNT value on done: 133238.0 [2024-08-06 00:40:36,527][52662] Sum rewards: 48.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.001', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.246', 'weapon2': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '2.630', 'weapon3': '3.120', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '44.000'} [2024-08-06 00:40:36,804][52660] DAMAGECOUNT value on done: 125098.0 [2024-08-06 00:40:36,805][52660] Sum rewards: 37.789, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.679', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon7': '0.074', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon2': '0.328', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon4': '1.148', 'weapon3': '2.004', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '10.395', 'FRAGCOUNT': '36.000'} [2024-08-06 00:40:37,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 200605696. Throughput: 0: 4358.7. Samples: 50156810. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:40:37,794][52567] Avg episode reward: [(0, '57.228')] [2024-08-06 00:40:37,992][52668] DAMAGECOUNT value on done: 125488.0 [2024-08-06 00:40:37,993][52668] Sum rewards: 54.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon4': '0.394', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '48.000'} [2024-08-06 00:40:38,767][52650] Updated weights for policy 0, policy_version 24491 (0.0045) [2024-08-06 00:40:38,877][52671] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:40:39,682][52660] DAMAGECOUNT value on done: 129274.0 [2024-08-06 00:40:39,683][52660] Sum rewards: 59.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.040', 'AMMO4': '0.044', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.420', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.210', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '54.000'} [2024-08-06 00:40:39,765][52662] DAMAGECOUNT value on done: 132921.0 [2024-08-06 00:40:39,766][52662] Sum rewards: 43.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon5': '0.042', 'AMMO2': '0.044', 'AMMO3': '0.166', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.550', 'weapon2': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.768', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '37.000'} [2024-08-06 00:40:39,970][52794] DAMAGECOUNT value on done: 135664.0 [2024-08-06 00:40:39,972][52794] Sum rewards: 56.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.492', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.051', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.228', 'AMMO4': '0.255', 'WEAPON4': '0.500', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '49.000'} [2024-08-06 00:40:40,692][52668] DAMAGECOUNT value on done: 129532.0 [2024-08-06 00:40:40,693][52668] Sum rewards: 43.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.952', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.130', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.600', 'HITCOUNT': '2.610', 'weapon3': '2.994', 'DAMAGECOUNT': '11.730', 'FRAGCOUNT': '40.500'} [2024-08-06 00:40:42,555][52660] DAMAGECOUNT value on done: 130039.0 [2024-08-06 00:40:42,556][52660] Sum rewards: 58.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.462', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'weapon4': '0.162', 'weapon2': '0.174', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.448', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '53.000'} [2024-08-06 00:40:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 200704000. Throughput: 0: 4345.6. Samples: 50182900. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:40:42,794][52567] Avg episode reward: [(0, '56.967')] [2024-08-06 00:40:42,809][52662] DAMAGECOUNT value on done: 133051.0 [2024-08-06 00:40:42,811][52662] Sum rewards: 57.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.786', 'ARMOR': '0.005', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.240', 'weapon2': '0.436', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '1.094', 'weapon3': '2.230', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '50.000'} [2024-08-06 00:40:43,080][52794] DAMAGECOUNT value on done: 134181.0 [2024-08-06 00:40:43,081][52794] Sum rewards: 56.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.192', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '46.000'} [2024-08-06 00:40:43,465][52650] Updated weights for policy 0, policy_version 24501 (0.0023) [2024-08-06 00:40:43,670][52671] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 00:40:43,763][52668] DAMAGECOUNT value on done: 131390.0 [2024-08-06 00:40:43,764][52668] Sum rewards: 57.404, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.191', 'weapon4': '0.200', 'WEAPON4': '0.300', 'HEALTH': '0.310', 'weapon2': '0.376', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.236', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '48.000'} [2024-08-06 00:40:44,304][52614] Signal inference workers to stop experience collection... (4500 times) [2024-08-06 00:40:44,313][52614] Signal inference workers to resume experience collection... (4500 times) [2024-08-06 00:40:44,390][52650] InferenceWorker_p0-w0: stopping experience collection (4500 times) [2024-08-06 00:40:44,391][52650] InferenceWorker_p0-w0: resuming experience collection (4500 times) [2024-08-06 00:40:45,483][52660] DAMAGECOUNT value on done: 130073.0 [2024-08-06 00:40:45,483][52660] Sum rewards: 61.551, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'ARMOR': '0.021', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.116', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '52.000'} [2024-08-06 00:40:45,609][52662] DAMAGECOUNT value on done: 138584.0 [2024-08-06 00:40:45,609][52662] Sum rewards: 56.338, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.435', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.285', 'weapon4': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.140', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '50.000'} [2024-08-06 00:40:45,931][52794] DAMAGECOUNT value on done: 129379.0 [2024-08-06 00:40:45,933][52794] Sum rewards: 52.479, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.119', 'AMMO5': '0.005', 'AMMO2': '0.011', 'ARMOR': '0.016', 'AMMO4': '0.054', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.704', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '44.000'} [2024-08-06 00:40:46,414][52668] DAMAGECOUNT value on done: 130247.0 [2024-08-06 00:40:46,416][52668] Sum rewards: 57.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.194', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '50.000'} [2024-08-06 00:40:47,792][52650] Updated weights for policy 0, policy_version 24511 (0.0012) [2024-08-06 00:40:47,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 200794112. Throughput: 0: 4356.9. Samples: 50196080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:40:47,794][52567] Avg episode reward: [(0, '56.738')] [2024-08-06 00:40:48,381][52660] DAMAGECOUNT value on done: 126187.0 [2024-08-06 00:40:48,382][52660] Sum rewards: 57.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.022', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.244', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.422', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '49.000'} [2024-08-06 00:40:48,723][52662] DAMAGECOUNT value on done: 133667.0 [2024-08-06 00:40:48,725][52662] Sum rewards: 66.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon4': '0.222', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.344', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '57.000'} [2024-08-06 00:40:49,055][52794] DAMAGECOUNT value on done: 128289.0 [2024-08-06 00:40:49,056][52794] Sum rewards: 53.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.222', 'weapon4': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.760', 'WEAPON3': '1.300', 'weapon3': '2.682', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '46.000'} [2024-08-06 00:40:49,182][52668] DAMAGECOUNT value on done: 131197.0 [2024-08-06 00:40:49,182][52668] Sum rewards: 69.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '57.000'} [2024-08-06 00:40:51,062][52660] DAMAGECOUNT value on done: 125821.0 [2024-08-06 00:40:51,062][52660] Sum rewards: 61.492, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.500', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.596', 'WEAPON3': '0.900', 'weapon3': '2.982', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '50.000'} [2024-08-06 00:40:51,888][52662] DAMAGECOUNT value on done: 135822.0 [2024-08-06 00:40:51,888][52662] Sum rewards: 58.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.597', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.167', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.612', 'WEAPON3': '1.000', 'weapon3': '2.872', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '49.000'} [2024-08-06 00:40:52,200][52668] DAMAGECOUNT value on done: 127880.0 [2024-08-06 00:40:52,200][52668] Sum rewards: 54.490, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.506', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '47.000'} [2024-08-06 00:40:52,200][52794] DAMAGECOUNT value on done: 132764.0 [2024-08-06 00:40:52,203][52794] Sum rewards: 47.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.172', 'ARMOR': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.199', 'WEAPON4': '0.400', 'weapon2': '0.462', 'weapon4': '0.748', 'WEAPON3': '1.200', 'weapon3': '2.468', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '42.000'} [2024-08-06 00:40:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 200867840. Throughput: 0: 4348.7. Samples: 50222200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:40:52,794][52567] Avg episode reward: [(0, '56.194')] [2024-08-06 00:40:53,325][52650] Updated weights for policy 0, policy_version 24521 (0.0019) [2024-08-06 00:40:53,596][52667] DAMAGECOUNT value on done: 132262.0 [2024-08-06 00:40:53,597][52667] Sum rewards: 63.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.524', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2024-08-06 00:40:53,736][52660] DAMAGECOUNT value on done: 130475.0 [2024-08-06 00:40:53,738][52660] Sum rewards: 58.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.855', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.116', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.356', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.892', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '51.000'} [2024-08-06 00:40:54,837][52662] DAMAGECOUNT value on done: 130539.0 [2024-08-06 00:40:54,837][52662] Sum rewards: 47.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.094', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.051', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.255', 'WEAPON4': '0.450', 'weapon2': '0.526', 'weapon4': '0.838', 'WEAPON3': '1.200', 'weapon3': '2.060', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.468', 'FRAGCOUNT': '42.000'} [2024-08-06 00:40:54,964][52668] DAMAGECOUNT value on done: 127656.0 [2024-08-06 00:40:54,966][52668] Sum rewards: 56.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.455', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.147', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.850', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '47.000'} [2024-08-06 00:40:55,176][52794] DAMAGECOUNT value on done: 131669.0 [2024-08-06 00:40:55,177][52794] Sum rewards: 48.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.215', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.238', 'weapon2': '0.586', 'WEAPON3': '1.450', 'HITCOUNT': '2.650', 'weapon3': '3.042', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '44.000'} [2024-08-06 00:40:55,224][52664] DAMAGECOUNT value on done: 132588.0 [2024-08-06 00:40:55,224][52664] Sum rewards: 46.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.538', 'weapon4': '0.596', 'WEAPON3': '1.350', 'weapon3': '2.474', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '41.000'} [2024-08-06 00:40:56,686][52660] DAMAGECOUNT value on done: 129490.0 [2024-08-06 00:40:56,687][52660] Sum rewards: 55.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.581', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.146', 'AMMO3': '0.193', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '47.000'} [2024-08-06 00:40:56,842][52667] DAMAGECOUNT value on done: 130517.0 [2024-08-06 00:40:56,844][52667] Sum rewards: 59.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.146', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '50.000'} [2024-08-06 00:40:57,175][52650] Updated weights for policy 0, policy_version 24531 (0.0020) [2024-08-06 00:40:57,599][52662] DAMAGECOUNT value on done: 133957.0 [2024-08-06 00:40:57,602][52662] Sum rewards: 51.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.166', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.159', 'AMMO3': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.912', 'WEAPON3': '1.150', 'weapon3': '2.370', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '45.000'} [2024-08-06 00:40:57,653][52668] DAMAGECOUNT value on done: 122104.0 [2024-08-06 00:40:57,653][52668] Sum rewards: 48.729, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.544', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.956', 'WEAPON3': '1.000', 'weapon3': '2.432', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '40.000'} [2024-08-06 00:40:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 200966144. Throughput: 0: 4355.6. Samples: 50248450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:40:57,794][52567] Avg episode reward: [(0, '56.227')] [2024-08-06 00:40:58,043][52794] DAMAGECOUNT value on done: 136918.0 [2024-08-06 00:40:58,044][52794] Sum rewards: 54.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.174', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.194', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '47.000'} [2024-08-06 00:40:58,380][52664] DAMAGECOUNT value on done: 133045.0 [2024-08-06 00:40:58,384][52664] Sum rewards: 51.844, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.681', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.252', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '43.000'} [2024-08-06 00:40:59,117][52660] DAMAGECOUNT value on done: 128646.0 [2024-08-06 00:40:59,118][52660] Sum rewards: 55.356, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.568', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.780', 'WEAPON3': '1.700', 'weapon3': '2.762', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '50.000'} [2024-08-06 00:40:59,704][52667] DAMAGECOUNT value on done: 130654.0 [2024-08-06 00:40:59,704][52667] Sum rewards: 55.206, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.365', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:00,058][52668] DAMAGECOUNT value on done: 128463.0 [2024-08-06 00:41:00,059][52668] Sum rewards: 54.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.658', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.082', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.276', 'weapon2': '0.402', 'WEAPON3': '1.600', 'HITCOUNT': '2.960', 'weapon3': '3.168', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:00,723][52647] DAMAGECOUNT value on done: 137270.0 [2024-08-06 00:41:00,725][52647] Sum rewards: 67.915, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.244', 'HEALTH': '0.830', 'WEAPON3': '1.150', 'HITCOUNT': '3.340', 'weapon3': '3.448', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '56.000'} [2024-08-06 00:41:00,726][52662] DAMAGECOUNT value on done: 132387.0 [2024-08-06 00:41:00,728][52662] Sum rewards: 61.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.201', 'weapon4': '0.370', 'WEAPON4': '0.500', 'weapon2': '0.802', 'WEAPON3': '1.250', 'weapon3': '2.622', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:01,172][52794] DAMAGECOUNT value on done: 131969.0 [2024-08-06 00:41:01,172][52794] Sum rewards: 48.954, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.855', 'AMMO2': '0.009', 'weapon4': '0.024', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.217', 'weapon2': '0.808', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '2.986', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '43.000'} [2024-08-06 00:41:01,218][52664] DAMAGECOUNT value on done: 133914.0 [2024-08-06 00:41:01,219][52664] Sum rewards: 49.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO3': '0.159', 'AMMO4': '0.176', 'weapon4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '2.968', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '42.000'} [2024-08-06 00:41:01,799][52660] DAMAGECOUNT value on done: 129393.0 [2024-08-06 00:41:01,807][52660] Sum rewards: 61.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:02,200][52650] Updated weights for policy 0, policy_version 24541 (0.0034) [2024-08-06 00:41:02,370][52667] DAMAGECOUNT value on done: 128494.0 [2024-08-06 00:41:02,372][52667] Sum rewards: 49.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.784', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.108', 'AMMO3': '0.187', 'AMMO4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON4': '0.750', 'weapon4': '1.016', 'WEAPON3': '1.150', 'weapon3': '2.114', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '44.000'} [2024-08-06 00:41:02,746][52669] DAMAGECOUNT value on done: 133621.0 [2024-08-06 00:41:02,752][52669] Sum rewards: 60.927, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.812', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.236', 'weapon2': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 201048064. Throughput: 0: 4353.8. Samples: 50261620. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:41:02,794][52567] Avg episode reward: [(0, '55.877')] [2024-08-06 00:41:03,010][52668] DAMAGECOUNT value on done: 126488.0 [2024-08-06 00:41:03,012][52668] Sum rewards: 61.356, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.691', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.133', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '0.900', 'weapon4': '0.928', 'weapon3': '2.366', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:03,326][52662] DAMAGECOUNT value on done: 132285.0 [2024-08-06 00:41:03,327][52662] Sum rewards: 56.526, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.640', 'ARMOR': '0.004', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon4': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.330', 'weapon2': '0.356', 'WEAPON3': '1.900', 'weapon3': '3.186', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:03,577][52647] DAMAGECOUNT value on done: 134786.0 [2024-08-06 00:41:03,578][52647] Sum rewards: 60.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.994', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO4': '0.207', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:03,740][52794] DAMAGECOUNT value on done: 134190.0 [2024-08-06 00:41:03,741][52794] Sum rewards: 65.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.912', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.196', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.414', 'weapon4': '0.446', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '57.000'} [2024-08-06 00:41:04,203][52664] DAMAGECOUNT value on done: 134116.0 [2024-08-06 00:41:04,203][52664] Sum rewards: 58.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.234', 'weapon2': '0.690', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:04,903][52660] DAMAGECOUNT value on done: 132323.0 [2024-08-06 00:41:04,903][52660] Sum rewards: 54.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.053', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:05,143][52667] DAMAGECOUNT value on done: 130350.0 [2024-08-06 00:41:05,145][52667] Sum rewards: 55.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.223', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.304', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:05,751][52669] DAMAGECOUNT value on done: 130004.0 [2024-08-06 00:41:05,752][52669] Sum rewards: 58.131, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.712', 'ARMOR': '0.004', 'weapon7': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.126', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.604', 'WEAPON3': '0.800', 'weapon3': '2.914', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:05,952][52668] DAMAGECOUNT value on done: 130663.0 [2024-08-06 00:41:05,953][52668] Sum rewards: 49.379, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.667', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO3': '0.120', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON3': '0.800', 'weapon2': '0.806', 'HITCOUNT': '2.410', 'weapon3': '2.794', 'DAMAGECOUNT': '11.601', 'FRAGCOUNT': '40.000'} [2024-08-06 00:41:06,373][52647] DAMAGECOUNT value on done: 139438.0 [2024-08-06 00:41:06,376][52647] Sum rewards: 52.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.044', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.035', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'AMMO3': '0.185', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.522', 'weapon4': '0.548', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:06,435][52662] DAMAGECOUNT value on done: 131616.0 [2024-08-06 00:41:06,435][52662] Sum rewards: 72.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.380', 'AMMO2': '0.012', 'weapon4': '0.012', 'AMMO5': '0.013', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.100', 'weapon3': '3.386', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '58.000'} [2024-08-06 00:41:06,714][52794] DAMAGECOUNT value on done: 139364.0 [2024-08-06 00:41:06,715][52794] Sum rewards: 56.353, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.375', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.410', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:06,884][52650] Updated weights for policy 0, policy_version 24551 (0.0021) [2024-08-06 00:41:07,008][52664] DAMAGECOUNT value on done: 133060.0 [2024-08-06 00:41:07,009][52664] Sum rewards: 56.836, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.762', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'weapon4': '0.218', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.628', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 201138176. Throughput: 0: 4353.5. Samples: 50287930. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:41:07,795][52567] Avg episode reward: [(0, '55.171')] [2024-08-06 00:41:07,889][52667] DAMAGECOUNT value on done: 127707.0 [2024-08-06 00:41:07,889][52667] Sum rewards: 62.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.334', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'weapon5': '0.172', 'AMMO3': '0.182', 'weapon4': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '53.000'} [2024-08-06 00:41:08,192][52660] DAMAGECOUNT value on done: 124561.0 [2024-08-06 00:41:08,192][52660] Sum rewards: 49.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.889', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.128', 'weapon4': '0.130', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.732', 'WEAPON3': '0.850', 'HITCOUNT': '2.620', 'weapon3': '2.780', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:08,576][52669] DAMAGECOUNT value on done: 129170.0 [2024-08-06 00:41:08,578][52669] Sum rewards: 65.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.924', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.165', 'weapon5': '0.188', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON4': '0.550', 'weapon4': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.566', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:09,277][52668] DAMAGECOUNT value on done: 128209.0 [2024-08-06 00:41:09,279][52668] Sum rewards: 61.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.094', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.442', 'weapon4': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:09,409][52647] DAMAGECOUNT value on done: 138558.0 [2024-08-06 00:41:09,410][52647] Sum rewards: 51.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.366', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.199', 'AMMO3': '0.274', 'weapon2': '0.600', 'WEAPON3': '1.600', 'weapon3': '3.002', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:09,460][52662] DAMAGECOUNT value on done: 137590.0 [2024-08-06 00:41:09,460][52662] Sum rewards: 55.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon4': '0.222', 'weapon2': '0.308', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.310', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:09,864][52794] DAMAGECOUNT value on done: 130854.0 [2024-08-06 00:41:09,866][52794] Sum rewards: 69.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'ARMOR': '0.020', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.201', 'weapon4': '0.398', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '58.000'} [2024-08-06 00:41:10,123][52664] DAMAGECOUNT value on done: 138294.0 [2024-08-06 00:41:10,123][52664] Sum rewards: 58.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.294', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:10,688][52667] DAMAGECOUNT value on done: 131342.0 [2024-08-06 00:41:10,688][52667] Sum rewards: 45.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.654', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.264', 'weapon2': '0.406', 'ARMOR': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.890', 'DAMAGECOUNT': '12.138', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:11,144][52669] DAMAGECOUNT value on done: 128062.0 [2024-08-06 00:41:11,145][52669] Sum rewards: 52.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.069', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.184', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.630', 'weapon2': '0.638', 'WEAPON3': '1.400', 'weapon3': '2.262', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '44.500'} [2024-08-06 00:41:11,281][52660] DAMAGECOUNT value on done: 126958.0 [2024-08-06 00:41:11,284][52660] Sum rewards: 65.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.015', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.108', 'AMMO4': '0.178', 'weapon4': '0.192', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '58.000'} [2024-08-06 00:41:11,355][52650] Updated weights for policy 0, policy_version 24561 (0.0013) [2024-08-06 00:41:12,058][52647] DAMAGECOUNT value on done: 140102.0 [2024-08-06 00:41:12,067][52647] Sum rewards: 52.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.529', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.232', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.172', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:12,340][52668] DAMAGECOUNT value on done: 129641.0 [2024-08-06 00:41:12,341][52668] Sum rewards: 56.435, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.118', 'AMMO3': '0.192', 'weapon2': '0.638', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:12,549][52662] DAMAGECOUNT value on done: 128184.0 [2024-08-06 00:41:12,551][52662] Sum rewards: 48.349, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.788', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.052', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.236', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.600', 'HITCOUNT': '2.750', 'weapon3': '3.034', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:12,581][52664] DAMAGECOUNT value on done: 135748.0 [2024-08-06 00:41:12,581][52664] Sum rewards: 49.020, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.930', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.245', 'AMMO3': '0.288', 'weapon4': '0.382', 'WEAPON4': '0.550', 'weapon2': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.548', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:12,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 201220096. Throughput: 0: 4369.1. Samples: 50314220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 00:41:12,795][52567] Avg episode reward: [(0, '55.604')] [2024-08-06 00:41:12,827][52794] DAMAGECOUNT value on done: 135200.0 [2024-08-06 00:41:12,827][52794] Sum rewards: 40.082, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.405', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.484', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '2.902', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '36.000'} [2024-08-06 00:41:13,690][52669] DAMAGECOUNT value on done: 129340.0 [2024-08-06 00:41:13,691][52669] Sum rewards: 54.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.465', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.155', 'AMMO3': '0.202', 'weapon2': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.858', 'WEAPON3': '1.250', 'weapon3': '2.596', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:13,837][52667] DAMAGECOUNT value on done: 128072.0 [2024-08-06 00:41:13,839][52667] Sum rewards: 44.577, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.351', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.024', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.648', 'weapon2': '0.682', 'WEAPON3': '0.950', 'weapon3': '2.212', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.172', 'FRAGCOUNT': '37.000'} [2024-08-06 00:41:14,324][52647] DAMAGECOUNT value on done: 139228.0 [2024-08-06 00:41:14,325][52647] Sum rewards: 59.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.299', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.542', 'weapon4': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:14,617][52660] DAMAGECOUNT value on done: 131801.0 [2024-08-06 00:41:14,618][52660] Sum rewards: 56.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.557', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.048', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.280', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:14,874][52664] DAMAGECOUNT value on done: 127989.0 [2024-08-06 00:41:14,875][52664] Sum rewards: 52.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.552', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon4': '0.262', 'weapon2': '0.458', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.136', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '43.000'} [2024-08-06 00:41:15,228][52795] DAMAGECOUNT value on done: 119076.0 [2024-08-06 00:41:15,229][52795] Sum rewards: 57.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.124', 'WEAPON4': '0.250', 'weapon4': '0.446', 'weapon2': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.710', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:15,395][52662] DAMAGECOUNT value on done: 133760.0 [2024-08-06 00:41:15,397][52662] Sum rewards: 68.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.515', 'AMMO2': '0.028', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.166', 'weapon2': '0.228', 'weapon4': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '57.000'} [2024-08-06 00:41:15,443][52668] DAMAGECOUNT value on done: 132524.0 [2024-08-06 00:41:15,444][52668] Sum rewards: 43.472, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.452', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.212', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.504', 'WEAPON3': '1.600', 'HITCOUNT': '2.520', 'weapon3': '2.850', 'DAMAGECOUNT': '11.943', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:15,794][52794] DAMAGECOUNT value on done: 131866.0 [2024-08-06 00:41:15,794][52794] Sum rewards: 48.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.381', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.136', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon2': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.960', 'WEAPON3': '1.150', 'weapon3': '2.224', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '43.000'} [2024-08-06 00:41:16,222][52650] Updated weights for policy 0, policy_version 24571 (0.0012) [2024-08-06 00:41:16,549][52669] DAMAGECOUNT value on done: 128437.0 [2024-08-06 00:41:16,549][52669] Sum rewards: 53.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.806', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '45.500'} [2024-08-06 00:41:16,724][52667] DAMAGECOUNT value on done: 129857.0 [2024-08-06 00:41:16,724][52667] Sum rewards: 57.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.975', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.175', 'weapon4': '0.222', 'AMMO3': '0.231', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:16,789][52647] DAMAGECOUNT value on done: 136119.0 [2024-08-06 00:41:16,789][52647] Sum rewards: 54.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.090', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.229', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:17,455][52664] DAMAGECOUNT value on done: 141969.0 [2024-08-06 00:41:17,465][52664] Sum rewards: 54.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.722', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.249', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.834', 'WEAPON3': '1.450', 'weapon3': '2.528', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:17,548][52660] DAMAGECOUNT value on done: 138211.0 [2024-08-06 00:41:17,549][52660] Sum rewards: 65.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.068', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.692', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 201310208. Throughput: 0: 4374.7. Samples: 50327220. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:41:17,795][52567] Avg episode reward: [(0, '55.173')] [2024-08-06 00:41:17,831][52662] DAMAGECOUNT value on done: 130718.0 [2024-08-06 00:41:17,833][52662] Sum rewards: 56.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.334', 'weapon4': '0.346', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:18,245][52668] DAMAGECOUNT value on done: 130421.0 [2024-08-06 00:41:18,245][52668] Sum rewards: 41.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.169', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.156', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON4': '0.550', 'weapon4': '0.796', 'WEAPON3': '1.150', 'weapon3': '2.402', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '35.500'} [2024-08-06 00:41:18,359][52795] DAMAGECOUNT value on done: 116632.0 [2024-08-06 00:41:18,359][52795] Sum rewards: 64.927, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.835', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.062', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.266', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:18,476][52794] DAMAGECOUNT value on done: 141565.0 [2024-08-06 00:41:18,477][52794] Sum rewards: 52.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.919', 'AMMO5': '0.003', 'AMMO2': '0.024', 'ARMOR': '0.044', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.181', 'weapon2': '0.250', 'WEAPON4': '0.450', 'weapon4': '1.008', 'WEAPON3': '1.100', 'weapon3': '2.352', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '44.000'} [2024-08-06 00:41:19,017][52667] DAMAGECOUNT value on done: 131929.0 [2024-08-06 00:41:19,018][52667] Sum rewards: 50.972, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.900', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'AMMO3': '0.229', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.656', 'WEAPON3': '1.350', 'weapon3': '2.678', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:19,598][52669] DAMAGECOUNT value on done: 130027.0 [2024-08-06 00:41:19,599][52669] Sum rewards: 64.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.489', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO4': '0.120', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '55.000'} [2024-08-06 00:41:19,743][52647] DAMAGECOUNT value on done: 137795.0 [2024-08-06 00:41:19,743][52647] Sum rewards: 47.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.675', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.186', 'AMMO4': '0.220', 'AMMO3': '0.226', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '2.748', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '42.000'} [2024-08-06 00:41:20,233][52660] DAMAGECOUNT value on done: 127396.0 [2024-08-06 00:41:20,235][52660] Sum rewards: 57.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.438', 'weapon2': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:20,571][52664] DAMAGECOUNT value on done: 139149.0 [2024-08-06 00:41:20,572][52664] Sum rewards: 60.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.206', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:21,002][52662] DAMAGECOUNT value on done: 131026.0 [2024-08-06 00:41:21,005][52662] Sum rewards: 53.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.818', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon4': '0.142', 'AMMO3': '0.201', 'weapon2': '0.626', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.034', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '44.000'} [2024-08-06 00:41:21,161][52650] Updated weights for policy 0, policy_version 24581 (0.0010) [2024-08-06 00:41:21,410][52795] DAMAGECOUNT value on done: 118463.0 [2024-08-06 00:41:21,411][52795] Sum rewards: 57.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.490', 'AMMO5': '0.010', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.287', 'weapon4': '0.408', 'WEAPON4': '0.550', 'weapon2': '0.632', 'WEAPON3': '1.750', 'weapon3': '2.618', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '50.500'} [2024-08-06 00:41:21,437][52794] DAMAGECOUNT value on done: 126914.0 [2024-08-06 00:41:21,439][52794] Sum rewards: 35.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.156', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.080', 'AMMO3': '0.142', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'ARMOR': '0.421', 'weapon2': '0.654', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon4': '0.998', 'weapon3': '1.826', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '9.462', 'FRAGCOUNT': '31.000'} [2024-08-06 00:41:21,860][52667] DAMAGECOUNT value on done: 130371.0 [2024-08-06 00:41:21,861][52667] Sum rewards: 45.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.178', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.636', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '2.726', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '40.000'} [2024-08-06 00:41:22,551][52669] DAMAGECOUNT value on done: 129974.0 [2024-08-06 00:41:22,556][52647] DAMAGECOUNT value on done: 139667.0 [2024-08-06 00:41:22,561][52669] Sum rewards: 65.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.894', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.038', 'weapon4': '0.086', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '3.292', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:22,561][52647] Sum rewards: 57.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.482', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon4': '0.494', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.480', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 201400320. Throughput: 0: 4375.8. Samples: 50353720. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:41:22,795][52567] Avg episode reward: [(0, '55.590')] [2024-08-06 00:41:22,887][52660] DAMAGECOUNT value on done: 131728.0 [2024-08-06 00:41:22,887][52660] Sum rewards: 57.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.781', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon4': '0.182', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:23,415][52664] DAMAGECOUNT value on done: 137579.0 [2024-08-06 00:41:23,416][52664] Sum rewards: 55.355, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.506', 'weapon4': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.504', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:24,076][52794] DAMAGECOUNT value on done: 137864.0 [2024-08-06 00:41:24,077][52794] Sum rewards: 61.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.364', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.138', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.390', 'WEAPON4': '0.550', 'weapon4': '0.630', 'WEAPON3': '1.550', 'weapon3': '2.602', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '53.000'} [2024-08-06 00:41:24,526][52795] DAMAGECOUNT value on done: 117994.0 [2024-08-06 00:41:24,526][52795] Sum rewards: 48.850, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.632', 'ARMOR': '0.004', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon2': '0.256', 'AMMO3': '0.297', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.750', 'HITCOUNT': '2.970', 'weapon3': '3.054', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:24,538][52667] DAMAGECOUNT value on done: 129011.0 [2024-08-06 00:41:24,538][52667] Sum rewards: 52.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.054', 'AMMO3': '0.141', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.270', 'weapon2': '0.316', 'WEAPON4': '0.550', 'weapon4': '0.890', 'WEAPON3': '0.900', 'weapon3': '2.454', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:25,158][52650] Updated weights for policy 0, policy_version 24591 (0.0024) [2024-08-06 00:41:25,479][52669] DAMAGECOUNT value on done: 130740.0 [2024-08-06 00:41:25,481][52669] Sum rewards: 59.565, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.480', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon4': '0.252', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.700', 'weapon3': '3.072', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:25,601][52647] DAMAGECOUNT value on done: 134321.0 [2024-08-06 00:41:25,601][52647] Sum rewards: 50.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.875', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.256', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '42.000'} [2024-08-06 00:41:25,826][52660] DAMAGECOUNT value on done: 125302.0 [2024-08-06 00:41:25,826][52660] Sum rewards: 53.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.372', 'weapon4': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '44.000'} [2024-08-06 00:41:26,224][52664] DAMAGECOUNT value on done: 134056.0 [2024-08-06 00:41:26,225][52664] Sum rewards: 35.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.835', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.215', 'WEAPON4': '0.450', 'weapon4': '0.478', 'weapon2': '0.656', 'WEAPON3': '1.250', 'HITCOUNT': '2.490', 'weapon3': '2.530', 'DAMAGECOUNT': '10.731', 'FRAGCOUNT': '33.000'} [2024-08-06 00:41:26,518][52649] DAMAGECOUNT value on done: 125706.0 [2024-08-06 00:41:26,518][52649] Sum rewards: 55.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'AMMO4': '0.164', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.842', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:27,049][52794] DAMAGECOUNT value on done: 133625.0 [2024-08-06 00:41:27,051][52794] Sum rewards: 55.949, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.952', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO4': '0.225', 'AMMO3': '0.265', 'weapon2': '0.448', 'WEAPON4': '0.550', 'weapon4': '0.662', 'WEAPON3': '1.500', 'weapon3': '2.600', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:27,310][52667] DAMAGECOUNT value on done: 132687.0 [2024-08-06 00:41:27,311][52667] Sum rewards: 60.246, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.278', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.061', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.303', 'weapon2': '0.354', 'WEAPON4': '0.600', 'weapon4': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:27,681][52795] DAMAGECOUNT value on done: 122020.0 [2024-08-06 00:41:27,691][52795] Sum rewards: 51.720, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.336', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO4': '0.123', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.570', 'WEAPON3': '0.950', 'weapon3': '2.886', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:27,795][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 201490432. Throughput: 0: 4378.0. Samples: 50379910. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:41:27,795][52567] Avg episode reward: [(0, '55.391')] [2024-08-06 00:41:27,802][52647] DAMAGECOUNT value on done: 134447.0 [2024-08-06 00:41:27,803][52647] Sum rewards: 52.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.340', 'ARMOR': '0.408', 'weapon4': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:28,371][52669] DAMAGECOUNT value on done: 128027.0 [2024-08-06 00:41:28,372][52669] Sum rewards: 50.517, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.447', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.056', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'AMMO4': '0.278', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:28,791][52664] DAMAGECOUNT value on done: 132483.0 [2024-08-06 00:41:28,791][52664] Sum rewards: 47.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.935', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.092', 'AMMO4': '0.099', 'AMMO3': '0.211', 'weapon2': '0.612', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.108', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '40.000'} [2024-08-06 00:41:28,845][52660] DAMAGECOUNT value on done: 132647.0 [2024-08-06 00:41:28,847][52660] Sum rewards: 47.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.175', 'AMMO3': '0.199', 'weapon4': '0.464', 'WEAPON4': '0.500', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:29,257][52649] DAMAGECOUNT value on done: 124988.0 [2024-08-06 00:41:29,258][52649] Sum rewards: 54.241, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'weapon5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.238', 'WEAPON4': '0.500', 'weapon4': '0.566', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.554', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:29,534][52794] DAMAGECOUNT value on done: 133186.0 [2024-08-06 00:41:29,535][52794] Sum rewards: 61.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.561', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.229', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '53.000'} [2024-08-06 00:41:29,891][52667] DAMAGECOUNT value on done: 128117.0 [2024-08-06 00:41:29,891][52667] Sum rewards: 64.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO4': '0.091', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.252', 'weapon4': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:30,136][52658] DAMAGECOUNT value on done: 133749.0 [2024-08-06 00:41:30,137][52658] Sum rewards: 58.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.643', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.130', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.408', 'weapon2': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:30,228][52650] Updated weights for policy 0, policy_version 24601 (0.0012) [2024-08-06 00:41:30,868][52795] DAMAGECOUNT value on done: 119329.0 [2024-08-06 00:41:30,869][52795] Sum rewards: 42.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.958', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.100', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'AMMO4': '0.261', 'weapon2': '0.478', 'WEAPON4': '0.600', 'weapon4': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.318', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '39.000'} [2024-08-06 00:41:30,871][52647] DAMAGECOUNT value on done: 132856.0 [2024-08-06 00:41:30,872][52647] Sum rewards: 50.355, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.306', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.134', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:31,753][52664] DAMAGECOUNT value on done: 134559.0 [2024-08-06 00:41:31,753][52664] Sum rewards: 43.119, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.358', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO3': '0.129', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '0.994', 'weapon3': '2.086', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '11.388', 'FRAGCOUNT': '36.000'} [2024-08-06 00:41:31,798][52649] DAMAGECOUNT value on done: 126988.0 [2024-08-06 00:41:31,799][52649] Sum rewards: 56.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.141', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.450', 'weapon4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.544', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:31,876][52660] DAMAGECOUNT value on done: 127136.0 [2024-08-06 00:41:31,879][52660] Sum rewards: 57.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.770', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.239', 'weapon2': '0.292', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.600', 'weapon3': '2.792', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:32,056][52669] DAMAGECOUNT value on done: 133137.0 [2024-08-06 00:41:32,058][52669] Sum rewards: 65.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.378', 'ARMOR': '0.008', 'AMMO5': '0.011', 'weapon5': '0.024', 'AMMO2': '0.049', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.478', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '55.000'} [2024-08-06 00:41:32,270][52667] DAMAGECOUNT value on done: 133416.0 [2024-08-06 00:41:32,270][52667] Sum rewards: 64.404, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.487', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.097', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.448', 'WEAPON3': '0.950', 'weapon3': '3.068', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:32,396][52658] DAMAGECOUNT value on done: 131004.0 [2024-08-06 00:41:32,398][52658] Sum rewards: 52.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.951', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.616', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.078', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:32,666][52794] DAMAGECOUNT value on done: 140008.0 [2024-08-06 00:41:32,667][52794] Sum rewards: 58.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.688', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.128', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.458', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.192', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 201572352. Throughput: 0: 4376.7. Samples: 50393030. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 00:41:32,794][52567] Avg episode reward: [(0, '55.173')] [2024-08-06 00:41:33,797][52647] DAMAGECOUNT value on done: 137173.0 [2024-08-06 00:41:33,797][52647] Sum rewards: 61.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.113', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO4': '0.167', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '2.956', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '53.000'} [2024-08-06 00:41:34,037][52795] DAMAGECOUNT value on done: 123861.0 [2024-08-06 00:41:34,037][52795] Sum rewards: 50.973, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO2': '0.011', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.057', 'weapon5': '0.082', 'AMMO3': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.490', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.662', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:34,664][52649] DAMAGECOUNT value on done: 127742.0 [2024-08-06 00:41:34,665][52649] Sum rewards: 55.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO3': '0.129', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.566', 'weapon4': '0.630', 'WEAPON3': '0.800', 'weapon3': '2.458', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:34,818][52650] Updated weights for policy 0, policy_version 24611 (0.0030) [2024-08-06 00:41:34,836][52664] DAMAGECOUNT value on done: 136865.0 [2024-08-06 00:41:34,837][52664] Sum rewards: 57.034, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.133', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.152', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:35,021][52669] DAMAGECOUNT value on done: 133252.0 [2024-08-06 00:41:35,021][52669] Sum rewards: 63.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.038', 'AMMO4': '0.169', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.798', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:35,045][52667] DAMAGECOUNT value on done: 138349.0 [2024-08-06 00:41:35,045][52667] Sum rewards: 55.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.336', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.318', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:35,311][52658] DAMAGECOUNT value on done: 132494.0 [2024-08-06 00:41:35,312][52658] Sum rewards: 74.518, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.046', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '64.000'} [2024-08-06 00:41:35,533][52794] DAMAGECOUNT value on done: 133686.0 [2024-08-06 00:41:35,534][52794] Sum rewards: 65.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.108', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.162', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.426', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '54.000'} [2024-08-06 00:41:36,884][52647] DAMAGECOUNT value on done: 132103.0 [2024-08-06 00:41:36,886][52647] Sum rewards: 47.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.441', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.056', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.278', 'weapon4': '0.374', 'WEAPON4': '0.450', 'weapon2': '0.720', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '2.662', 'DAMAGECOUNT': '12.021', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:37,216][52795] DAMAGECOUNT value on done: 122095.0 [2024-08-06 00:41:37,216][52795] Sum rewards: 54.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.814', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.214', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:37,300][52649] DAMAGECOUNT value on done: 120579.0 [2024-08-06 00:41:37,300][52649] Sum rewards: 49.427, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.256', 'AMMO5': '0.012', 'weapon5': '0.022', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.226', 'weapon2': '0.398', 'WEAPON4': '0.450', 'weapon4': '0.592', 'WEAPON3': '1.350', 'weapon3': '2.724', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '45.500'} [2024-08-06 00:41:37,486][52667] DAMAGECOUNT value on done: 133764.0 [2024-08-06 00:41:37,486][52667] Sum rewards: 55.842, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.018', 'weapon5': '0.006', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.160', 'AMMO3': '0.217', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:37,683][52664] DAMAGECOUNT value on done: 132716.0 [2024-08-06 00:41:37,683][52664] Sum rewards: 50.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.554', 'weapon2': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.554', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '43.000'} [2024-08-06 00:41:37,703][52658] DAMAGECOUNT value on done: 133309.0 [2024-08-06 00:41:37,703][52658] Sum rewards: 60.879, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.184', 'weapon2': '0.272', 'AMMO3': '0.287', 'WEAPON4': '0.400', 'weapon4': '0.506', 'WEAPON3': '1.650', 'weapon3': '2.914', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '55.000'} [2024-08-06 00:41:37,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 201662464. Throughput: 0: 4380.9. Samples: 50419340. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 00:41:37,794][52567] Avg episode reward: [(0, '55.313')] [2024-08-06 00:41:38,161][52669] DAMAGECOUNT value on done: 128281.0 [2024-08-06 00:41:38,162][52669] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.245', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.066', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.384', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '53.000'} [2024-08-06 00:41:38,423][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:41:39,465][52650] Updated weights for policy 0, policy_version 24621 (0.0011) [2024-08-06 00:41:39,551][52647] DAMAGECOUNT value on done: 137329.0 [2024-08-06 00:41:39,553][52647] Sum rewards: 52.503, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.851', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.040', 'weapon5': '0.114', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:40,058][52649] DAMAGECOUNT value on done: 125637.0 [2024-08-06 00:41:40,059][52649] Sum rewards: 62.925, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'ARMOR': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:40,362][52664] DAMAGECOUNT value on done: 134359.0 [2024-08-06 00:41:40,362][52664] Sum rewards: 48.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.540', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.362', 'weapon4': '0.362', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:40,394][52795] DAMAGECOUNT value on done: 118729.0 [2024-08-06 00:41:40,396][52795] Sum rewards: 58.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.177', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '48.000'} [2024-08-06 00:41:40,427][52669] DAMAGECOUNT value on done: 130861.0 [2024-08-06 00:41:40,427][52669] Sum rewards: 51.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.287', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'weapon2': '0.534', 'weapon4': '0.722', 'WEAPON3': '1.400', 'weapon3': '2.496', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:40,712][52667] DAMAGECOUNT value on done: 137473.0 [2024-08-06 00:41:40,713][52667] Sum rewards: 56.152, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon2': '0.278', 'AMMO3': '0.279', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:40,846][52658] DAMAGECOUNT value on done: 135039.0 [2024-08-06 00:41:40,847][52658] Sum rewards: 53.189, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.340', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.124', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.750', 'weapon3': '3.004', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:42,190][52647] DAMAGECOUNT value on done: 137696.0 [2024-08-06 00:41:42,190][52647] Sum rewards: 55.703, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.145', 'weapon5': '0.148', 'weapon4': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '0.900', 'HITCOUNT': '2.780', 'weapon3': '2.940', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 201752576. Throughput: 0: 4385.3. Samples: 50445790. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 00:41:42,794][52567] Avg episode reward: [(0, '55.074')] [2024-08-06 00:41:43,006][52669] DAMAGECOUNT value on done: 136977.0 [2024-08-06 00:41:43,007][52669] Sum rewards: 63.339, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.175', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.160', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.370', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '53.000'} [2024-08-06 00:41:43,108][52664] DAMAGECOUNT value on done: 136241.0 [2024-08-06 00:41:43,108][52664] Sum rewards: 53.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.111', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.187', 'weapon2': '0.290', 'WEAPON4': '0.450', 'weapon4': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '46.000'} [2024-08-06 00:41:43,291][52649] DAMAGECOUNT value on done: 122611.0 [2024-08-06 00:41:43,291][52649] Sum rewards: 59.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.046', 'AMMO4': '0.123', 'AMMO3': '0.150', 'weapon4': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.592', 'WEAPON3': '0.900', 'HITCOUNT': '2.960', 'weapon3': '3.030', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:43,311][52667] DAMAGECOUNT value on done: 127404.0 [2024-08-06 00:41:43,311][52667] Sum rewards: 63.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.216', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.364', 'weapon2': '0.680', 'WEAPON3': '0.850', 'weapon3': '2.794', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:43,550][52658] DAMAGECOUNT value on done: 127176.0 [2024-08-06 00:41:43,552][52658] Sum rewards: 53.486, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.165', 'HEALTH': '0.226', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.762', 'WEAPON3': '0.800', 'weapon3': '2.584', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '43.500'} [2024-08-06 00:41:43,582][52795] DAMAGECOUNT value on done: 121419.0 [2024-08-06 00:41:43,583][52795] Sum rewards: 56.409, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.992', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.082', 'weapon5': '0.182', 'AMMO3': '0.189', 'WEAPON5': '0.400', 'AMMO4': '0.410', 'weapon2': '0.492', 'weapon4': '0.558', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.442', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:44,109][52650] Updated weights for policy 0, policy_version 24631 (0.0030) [2024-08-06 00:41:44,864][52647] DAMAGECOUNT value on done: 131865.0 [2024-08-06 00:41:44,864][52647] Sum rewards: 45.069, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.110', 'ARMOR': '0.008', 'AMMO2': '0.036', 'AMMO3': '0.167', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.532', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '2.888', 'DAMAGECOUNT': '10.989', 'FRAGCOUNT': '37.000'} [2024-08-06 00:41:45,757][52664] DAMAGECOUNT value on done: 132044.0 [2024-08-06 00:41:45,757][52664] Sum rewards: 52.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.492', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.080', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:45,943][52649] DAMAGECOUNT value on done: 129669.0 [2024-08-06 00:41:45,944][52649] Sum rewards: 44.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.193', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.550', 'weapon4': '1.008', 'WEAPON3': '1.150', 'weapon3': '2.104', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.367', 'FRAGCOUNT': '39.000'} [2024-08-06 00:41:45,970][52669] DAMAGECOUNT value on done: 140015.0 [2024-08-06 00:41:45,970][52669] Sum rewards: 62.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.320', 'weapon4': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:46,243][52667] DAMAGECOUNT value on done: 136464.0 [2024-08-06 00:41:46,243][52667] Sum rewards: 62.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.845', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.550', 'weapon3': '2.948', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '55.000'} [2024-08-06 00:41:46,550][52658] DAMAGECOUNT value on done: 136739.0 [2024-08-06 00:41:46,550][52658] Sum rewards: 62.132, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.473', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.256', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.348', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '56.000'} [2024-08-06 00:41:46,647][52795] DAMAGECOUNT value on done: 120817.0 [2024-08-06 00:41:46,649][52795] Sum rewards: 58.742, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.356', 'weapon2': '0.414', 'HEALTH': '0.927', 'WEAPON3': '1.000', 'weapon3': '3.046', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:46,761][52647] Large shaping reward 2.519 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('HEALTH', -0.012, -4.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:41:46,973][52666] DAMAGECOUNT value on done: 131469.0 [2024-08-06 00:41:46,973][52666] Sum rewards: 57.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.061', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'AMMO4': '0.303', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.596', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:47,209][52647] DAMAGECOUNT value on done: 136197.0 [2024-08-06 00:41:47,209][52647] Sum rewards: 48.740, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'weapon5': '0.096', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.448', 'WEAPON3': '1.000', 'HITCOUNT': '2.630', 'weapon3': '2.954', 'DAMAGECOUNT': '11.811', 'FRAGCOUNT': '41.000'} [2024-08-06 00:41:47,797][52567] Fps is (10 sec: 17198.8, 60 sec: 17339.0, 300 sec: 17550.2). Total num frames: 201834496. Throughput: 0: 4389.1. Samples: 50459140. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 00:41:47,797][52567] Avg episode reward: [(0, '54.927')] [2024-08-06 00:41:47,976][52803] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:41:48,138][52664] DAMAGECOUNT value on done: 134845.0 [2024-08-06 00:41:48,139][52664] Sum rewards: 65.587, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.156', 'weapon4': '0.178', 'HEALTH': '0.180', 'weapon2': '0.736', 'WEAPON3': '0.900', 'weapon3': '2.904', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '51.000'} [2024-08-06 00:41:48,772][52650] Updated weights for policy 0, policy_version 24641 (0.0015) [2024-08-06 00:41:49,091][52649] DAMAGECOUNT value on done: 123750.0 [2024-08-06 00:41:49,092][52658] DAMAGECOUNT value on done: 128367.0 [2024-08-06 00:41:49,095][52649] Sum rewards: 48.127, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.266', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.209', 'weapon2': '0.454', 'weapon4': '0.520', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '43.000'} [2024-08-06 00:41:49,098][52658] Sum rewards: 45.641, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.458', 'AMMO5': '0.013', 'weapon5': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.057', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'AMMO4': '0.284', 'weapon4': '0.440', 'WEAPON4': '0.700', 'weapon2': '0.808', 'WEAPON3': '1.050', 'weapon3': '2.470', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '42.000'} [2024-08-06 00:41:49,308][52669] DAMAGECOUNT value on done: 129628.0 [2024-08-06 00:41:49,309][52669] Sum rewards: 45.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.839', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.127', 'AMMO4': '0.171', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '0.828', 'weapon3': '2.178', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '11.427', 'FRAGCOUNT': '38.000'} [2024-08-06 00:41:49,625][52666] DAMAGECOUNT value on done: 130632.0 [2024-08-06 00:41:49,628][52666] Sum rewards: 60.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:49,731][52795] DAMAGECOUNT value on done: 118744.0 [2024-08-06 00:41:49,731][52795] Sum rewards: 57.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.554', 'ARMOR': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.189', 'WEAPON4': '0.400', 'weapon2': '0.588', 'weapon4': '0.898', 'WEAPON3': '1.150', 'weapon3': '2.326', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:49,751][52647] DAMAGECOUNT value on done: 130690.0 [2024-08-06 00:41:49,751][52647] Sum rewards: 51.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.916', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.230', 'WEAPON4': '0.500', 'weapon2': '0.614', 'weapon4': '0.832', 'WEAPON3': '1.100', 'weapon3': '2.234', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '44.000'} [2024-08-06 00:41:49,873][52647] Large shaping reward 2.740 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.012, -4.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 00:41:52,045][52649] DAMAGECOUNT value on done: 128101.0 [2024-08-06 00:41:52,045][52649] Sum rewards: 56.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.268', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:52,174][52658] DAMAGECOUNT value on done: 135064.0 [2024-08-06 00:41:52,176][52658] Sum rewards: 61.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO2': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.038', 'weapon4': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.198', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.052', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:52,274][52669] DAMAGECOUNT value on done: 130911.0 [2024-08-06 00:41:52,276][52669] Sum rewards: 61.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.211', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '52.000'} [2024-08-06 00:41:52,417][52666] DAMAGECOUNT value on done: 130926.0 [2024-08-06 00:41:52,419][52666] Sum rewards: 44.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.008', 'AMMO5': '0.009', 'ARMOR': '0.016', 'weapon5': '0.074', 'AMMO2': '0.075', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.377', 'weapon2': '0.786', 'WEAPON4': '0.850', 'WEAPON3': '0.900', 'weapon4': '0.920', 'weapon3': '2.026', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.139', 'FRAGCOUNT': '40.000'} [2024-08-06 00:41:52,675][52647] DAMAGECOUNT value on done: 135627.0 [2024-08-06 00:41:52,677][52647] Sum rewards: 52.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.322', 'WEAPON4': '0.550', 'weapon4': '0.726', 'WEAPON3': '1.400', 'weapon3': '2.546', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:52,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 201932800. Throughput: 0: 4393.8. Samples: 50485650. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:41:52,795][52567] Avg episode reward: [(0, '55.225')] [2024-08-06 00:41:52,807][52795] DAMAGECOUNT value on done: 118650.0 [2024-08-06 00:41:52,815][52795] Sum rewards: 48.347, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.795', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.196', 'WEAPON4': '0.500', 'weapon2': '0.554', 'weapon4': '0.632', 'WEAPON3': '0.850', 'HITCOUNT': '2.490', 'weapon3': '2.688', 'DAMAGECOUNT': '10.671', 'FRAGCOUNT': '40.000'} [2024-08-06 00:41:53,148][52650] Updated weights for policy 0, policy_version 24651 (0.0025) [2024-08-06 00:41:55,086][52658] DAMAGECOUNT value on done: 135022.0 [2024-08-06 00:41:55,087][52658] Sum rewards: 37.838, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.530', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.057', 'WEAPON5': '0.200', 'AMMO4': '0.283', 'AMMO3': '0.308', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.700', 'weapon3': '2.868', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '37.000'} [2024-08-06 00:41:55,125][52669] DAMAGECOUNT value on done: 132008.0 [2024-08-06 00:41:55,129][52669] Sum rewards: 54.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.178', 'weapon4': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '47.500'} [2024-08-06 00:41:55,187][52649] DAMAGECOUNT value on done: 127657.0 [2024-08-06 00:41:55,188][52649] Sum rewards: 59.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.700', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.183', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '50.000'} [2024-08-06 00:41:55,466][52666] DAMAGECOUNT value on done: 127891.0 [2024-08-06 00:41:55,469][52666] Sum rewards: 53.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.208', 'weapon5': '0.238', 'weapon4': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '47.000'} [2024-08-06 00:41:55,948][52795] DAMAGECOUNT value on done: 119256.0 [2024-08-06 00:41:55,951][52795] Sum rewards: 50.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.106', 'AMMO3': '0.194', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON4': '0.450', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '40.500'} [2024-08-06 00:41:56,310][52670] DAMAGECOUNT value on done: 128102.0 [2024-08-06 00:41:56,312][52670] Sum rewards: 61.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.712', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon5': '0.146', 'AMMO3': '0.204', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.428', 'WEAPON4': '0.600', 'weapon2': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.412', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '53.000'} [2024-08-06 00:41:56,906][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:41:57,794][52567] Fps is (10 sec: 18027.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 202014720. Throughput: 0: 4395.4. Samples: 50512010. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:41:57,794][52567] Avg episode reward: [(0, '55.058')] [2024-08-06 00:41:57,845][52669] DAMAGECOUNT value on done: 133138.0 [2024-08-06 00:41:57,846][52669] Sum rewards: 61.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.209', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO3': '0.157', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.456', 'weapon2': '0.878', 'WEAPON3': '1.000', 'weapon3': '2.352', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:57,929][52650] Updated weights for policy 0, policy_version 24661 (0.0015) [2024-08-06 00:41:58,075][52658] DAMAGECOUNT value on done: 135438.0 [2024-08-06 00:41:58,075][52658] Sum rewards: 37.660, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.270', 'AMMO5': '0.016', 'AMMO2': '0.075', 'weapon5': '0.142', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'AMMO4': '0.375', 'WEAPON4': '0.550', 'weapon4': '0.620', 'weapon2': '0.696', 'WEAPON3': '1.250', 'weapon3': '2.254', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '36.000'} [2024-08-06 00:41:58,196][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:41:58,319][52649] DAMAGECOUNT value on done: 123895.0 [2024-08-06 00:41:58,319][52666] DAMAGECOUNT value on done: 127188.0 [2024-08-06 00:41:58,321][52649] Sum rewards: 53.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.310', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.418', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.278', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '49.000'} [2024-08-06 00:41:58,321][52666] Sum rewards: 43.137, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.130', 'ARMOR': '0.008', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.050', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'weapon4': '0.256', 'AMMO3': '0.272', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.890', 'weapon3': '3.102', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '43.000'} [2024-08-06 00:41:58,895][52670] DAMAGECOUNT value on done: 132801.0 [2024-08-06 00:41:58,903][52670] Sum rewards: 49.516, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.360', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.036', 'AMMO4': '0.099', 'weapon4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.434', 'WEAPON3': '1.650', 'HITCOUNT': '3.080', 'weapon3': '3.112', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '45.000'} [2024-08-06 00:41:59,127][52795] DAMAGECOUNT value on done: 116509.0 [2024-08-06 00:41:59,127][52795] Sum rewards: 64.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.376', 'weapon4': '0.432', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '54.000'} [2024-08-06 00:42:00,892][52658] DAMAGECOUNT value on done: 128484.0 [2024-08-06 00:42:00,892][52658] Sum rewards: 40.177, reward structure: {'DEATHCOUNT': '-22.500', 'HEALTH': '-3.130', 'AMMO5': '0.008', 'AMMO2': '0.054', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.269', 'AMMO3': '0.297', 'weapon2': '0.522', 'weapon4': '0.524', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.542', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '43.000'} [2024-08-06 00:42:01,117][52666] DAMAGECOUNT value on done: 125570.0 [2024-08-06 00:42:01,129][52666] Sum rewards: 46.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.654', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.165', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.530', 'weapon4': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '42.000'} [2024-08-06 00:42:01,375][52649] DAMAGECOUNT value on done: 130801.0 [2024-08-06 00:42:01,375][52649] Sum rewards: 56.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.207', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon4': '0.138', 'AMMO4': '0.158', 'weapon5': '0.168', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.110', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:01,941][52670] DAMAGECOUNT value on done: 127706.0 [2024-08-06 00:42:01,941][52670] Sum rewards: 51.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.618', 'AMMO5': '0.011', 'ARMOR': '0.040', 'AMMO2': '0.048', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.237', 'WEAPON4': '0.500', 'weapon4': '0.622', 'weapon2': '0.714', 'WEAPON3': '1.250', 'weapon3': '2.266', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:02,212][52795] DAMAGECOUNT value on done: 123063.0 [2024-08-06 00:42:02,214][52795] Sum rewards: 56.612, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.510', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.472', 'weapon4': '0.520', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:02,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 202096640. Throughput: 0: 4395.8. Samples: 50525030. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 00:42:02,794][52567] Avg episode reward: [(0, '54.760')] [2024-08-06 00:42:03,041][52650] Updated weights for policy 0, policy_version 24671 (0.0012) [2024-08-06 00:42:03,665][52658] DAMAGECOUNT value on done: 131175.0 [2024-08-06 00:42:03,665][52658] Sum rewards: 62.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.784', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.392', 'weapon4': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:04,162][52666] DAMAGECOUNT value on done: 127864.0 [2024-08-06 00:42:04,170][52666] Sum rewards: 50.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.450', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.890', 'WEAPON3': '1.350', 'weapon3': '2.574', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '45.000'} [2024-08-06 00:42:04,522][52649] DAMAGECOUNT value on done: 129471.0 [2024-08-06 00:42:04,523][52649] Sum rewards: 57.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.688', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.044', 'weapon5': '0.072', 'AMMO4': '0.218', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.540', 'weapon2': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.538', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:04,707][52670] DAMAGECOUNT value on done: 130102.0 [2024-08-06 00:42:04,707][52670] Sum rewards: 59.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.490', 'ARMOR': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.380', 'weapon4': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:05,356][52795] DAMAGECOUNT value on done: 123715.0 [2024-08-06 00:42:05,356][52795] Sum rewards: 52.260, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.447', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:06,177][52658] DAMAGECOUNT value on done: 129454.0 [2024-08-06 00:42:06,178][52658] Sum rewards: 50.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.831', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.026', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.160', 'AMMO3': '0.187', 'weapon2': '0.274', 'WEAPON4': '0.550', 'weapon4': '1.162', 'WEAPON3': '1.200', 'weapon3': '2.416', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:06,558][52666] DAMAGECOUNT value on done: 129724.0 [2024-08-06 00:42:06,559][52666] Sum rewards: 56.510, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.080', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '2.748', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:07,228][52650] Updated weights for policy 0, policy_version 24681 (0.0011) [2024-08-06 00:42:07,375][52670] DAMAGECOUNT value on done: 131805.0 [2024-08-06 00:42:07,375][52670] Sum rewards: 56.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.887', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'AMMO4': '0.156', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.112', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:07,508][52649] DAMAGECOUNT value on done: 123257.0 [2024-08-06 00:42:07,508][52649] Sum rewards: 54.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.424', 'weapon4': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 202194944. Throughput: 0: 4400.9. Samples: 50551760. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:42:07,794][52567] Avg episode reward: [(0, '54.698')] [2024-08-06 00:42:08,369][52795] DAMAGECOUNT value on done: 118038.0 [2024-08-06 00:42:08,370][52795] Sum rewards: 58.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.030', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.334', 'weapon4': '0.392', 'WEAPON3': '1.750', 'weapon3': '3.102', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:08,904][52663] DAMAGECOUNT value on done: 130316.0 [2024-08-06 00:42:08,907][52663] Sum rewards: 60.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.168', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon5': '0.294', 'weapon2': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.392', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '51.000'} [2024-08-06 00:42:08,917][52658] DAMAGECOUNT value on done: 129781.0 [2024-08-06 00:42:08,919][52658] Sum rewards: 51.045, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.262', 'WEAPON4': '0.450', 'weapon2': '0.642', 'weapon4': '0.814', 'WEAPON3': '1.350', 'weapon3': '2.266', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:09,299][52666] DAMAGECOUNT value on done: 131065.0 [2024-08-06 00:42:09,309][52666] Sum rewards: 51.448, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.884', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.444', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '42.000'} [2024-08-06 00:42:10,110][52670] DAMAGECOUNT value on done: 130965.0 [2024-08-06 00:42:10,111][52670] Sum rewards: 52.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.455', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.810', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:10,812][52649] DAMAGECOUNT value on done: 129490.0 [2024-08-06 00:42:10,814][52649] Sum rewards: 43.346, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.842', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.045', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.280', 'ARMOR': '0.400', 'weapon2': '0.444', 'WEAPON4': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.600', 'weapon3': '2.678', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '41.000'} [2024-08-06 00:42:11,584][52658] DAMAGECOUNT value on done: 133759.0 [2024-08-06 00:42:11,585][52658] Sum rewards: 46.030, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.071', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.149', 'AMMO3': '0.239', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.464', 'WEAPON3': '1.350', 'HITCOUNT': '2.480', 'weapon3': '2.854', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '41.000'} [2024-08-06 00:42:11,621][52663] DAMAGECOUNT value on done: 130954.0 [2024-08-06 00:42:11,625][52663] Sum rewards: 60.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.803', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO4': '0.136', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.702', 'WEAPON3': '0.900', 'weapon3': '2.774', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:11,649][52795] DAMAGECOUNT value on done: 122838.0 [2024-08-06 00:42:11,649][52795] Sum rewards: 57.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'ARMOR': '0.008', 'AMMO2': '0.049', 'AMMO3': '0.159', 'AMMO4': '0.247', 'WEAPON4': '0.450', 'weapon2': '0.534', 'weapon4': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.700', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:11,961][52650] Updated weights for policy 0, policy_version 24691 (0.0012) [2024-08-06 00:42:12,059][52666] DAMAGECOUNT value on done: 130283.0 [2024-08-06 00:42:12,062][52666] Sum rewards: 53.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.529', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.456', 'weapon4': '0.474', 'WEAPON3': '0.950', 'weapon3': '2.814', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:12,122][52663] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:42:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 202276864. Throughput: 0: 4408.5. Samples: 50578290. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:42:12,794][52567] Avg episode reward: [(0, '54.933')] [2024-08-06 00:42:12,965][52670] DAMAGECOUNT value on done: 124973.0 [2024-08-06 00:42:12,967][52670] Sum rewards: 60.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.468', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.221', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:13,835][52649] DAMAGECOUNT value on done: 126598.0 [2024-08-06 00:42:13,838][52649] Sum rewards: 65.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.727', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.178', 'weapon2': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.220', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '56.000'} [2024-08-06 00:42:14,147][52658] DAMAGECOUNT value on done: 134944.0 [2024-08-06 00:42:14,148][52658] Sum rewards: 43.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.182', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.700', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '38.000'} [2024-08-06 00:42:14,764][52795] DAMAGECOUNT value on done: 123563.0 [2024-08-06 00:42:14,768][52795] Sum rewards: 48.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.508', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.064', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.296', 'WEAPON4': '0.500', 'weapon4': '0.738', 'WEAPON3': '1.350', 'weapon3': '2.572', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '42.000'} [2024-08-06 00:42:14,781][52666] DAMAGECOUNT value on done: 127767.0 [2024-08-06 00:42:14,781][52666] Sum rewards: 52.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.856', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.102', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '2.962', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '47.000'} [2024-08-06 00:42:14,840][52663] DAMAGECOUNT value on done: 131664.0 [2024-08-06 00:42:14,840][52663] Sum rewards: 66.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.147', 'AMMO4': '0.147', 'weapon5': '0.192', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.862', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '55.000'} [2024-08-06 00:42:15,583][52670] DAMAGECOUNT value on done: 127936.0 [2024-08-06 00:42:15,583][52670] Sum rewards: 57.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.851', 'ARMOR': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.197', 'AMMO4': '0.226', 'weapon4': '0.386', 'weapon2': '0.568', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:16,465][52671] DAMAGECOUNT value on done: 135809.0 [2024-08-06 00:42:16,465][52671] Sum rewards: 55.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.560', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.205', 'weapon4': '0.318', 'weapon2': '0.602', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '2.984', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:16,531][52650] Updated weights for policy 0, policy_version 24701 (0.0030) [2024-08-06 00:42:16,813][52649] DAMAGECOUNT value on done: 131519.0 [2024-08-06 00:42:16,814][52649] Sum rewards: 64.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.288', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '55.000'} [2024-08-06 00:42:17,274][52658] DAMAGECOUNT value on done: 127527.0 [2024-08-06 00:42:17,275][52658] Sum rewards: 56.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.284', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.148', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:17,368][52666] DAMAGECOUNT value on done: 125417.0 [2024-08-06 00:42:17,371][52666] Sum rewards: 64.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.605', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.186', 'weapon2': '0.338', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.282', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '54.000'} [2024-08-06 00:42:17,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 202358784. Throughput: 0: 4402.6. Samples: 50591150. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 00:42:17,795][52567] Avg episode reward: [(0, '55.124')] [2024-08-06 00:42:17,865][52663] DAMAGECOUNT value on done: 129586.0 [2024-08-06 00:42:17,865][52663] Sum rewards: 33.876, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.828', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.145', 'weapon5': '0.216', 'AMMO4': '0.253', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.664', 'WEAPON3': '0.800', 'weapon4': '0.936', 'weapon3': '1.966', 'HITCOUNT': '2.360', 'DAMAGECOUNT': '10.245', 'FRAGCOUNT': '26.000'} [2024-08-06 00:42:17,955][52670] DAMAGECOUNT value on done: 124667.0 [2024-08-06 00:42:17,957][52670] Sum rewards: 60.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.230', 'AMMO4': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:19,246][52671] DAMAGECOUNT value on done: 130088.0 [2024-08-06 00:42:19,246][52671] Sum rewards: 51.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.162', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '44.500'} [2024-08-06 00:42:19,460][52649] DAMAGECOUNT value on done: 129281.0 [2024-08-06 00:42:19,461][52649] Sum rewards: 49.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.006', 'ARMOR': '0.008', 'weapon5': '0.028', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'AMMO4': '0.224', 'AMMO3': '0.253', 'weapon2': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.730', 'WEAPON3': '1.500', 'weapon3': '2.662', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '44.500'} [2024-08-06 00:42:19,836][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:42:20,083][52658] DAMAGECOUNT value on done: 129588.0 [2024-08-06 00:42:20,084][52658] Sum rewards: 51.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'weapon5': '0.050', 'AMMO2': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'AMMO4': '0.312', 'WEAPON4': '0.450', 'weapon2': '0.668', 'weapon4': '0.810', 'WEAPON3': '1.200', 'weapon3': '2.244', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '45.000'} [2024-08-06 00:42:20,156][52666] DAMAGECOUNT value on done: 130230.0 [2024-08-06 00:42:20,157][52666] Sum rewards: 69.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.693', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.206', 'AMMO3': '0.241', 'weapon2': '0.654', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '60.000'} [2024-08-06 00:42:20,788][52663] DAMAGECOUNT value on done: 126821.0 [2024-08-06 00:42:20,791][52663] Sum rewards: 64.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.549', 'weapon5': '0.006', 'AMMO5': '0.007', 'weapon4': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '54.500'} [2024-08-06 00:42:20,873][52614] Signal inference workers to stop experience collection... (4550 times) [2024-08-06 00:42:20,874][52614] Signal inference workers to resume experience collection... (4550 times) [2024-08-06 00:42:20,927][52670] DAMAGECOUNT value on done: 122023.0 [2024-08-06 00:42:20,927][52670] Sum rewards: 62.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.364', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '54.000'} [2024-08-06 00:42:20,950][52650] InferenceWorker_p0-w0: stopping experience collection (4550 times) [2024-08-06 00:42:20,950][52650] InferenceWorker_p0-w0: resuming experience collection (4550 times) [2024-08-06 00:42:21,476][52650] Updated weights for policy 0, policy_version 24711 (0.0013) [2024-08-06 00:42:21,915][52649] DAMAGECOUNT value on done: 134248.0 [2024-08-06 00:42:21,917][52649] Sum rewards: 57.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.953', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.936', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:22,521][52671] DAMAGECOUNT value on done: 135005.0 [2024-08-06 00:42:22,523][52671] Sum rewards: 65.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.944', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.191', 'weapon2': '0.202', 'weapon4': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '54.000'} [2024-08-06 00:42:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 202457088. Throughput: 0: 4403.3. Samples: 50617490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:42:22,794][52567] Avg episode reward: [(0, '54.846')] [2024-08-06 00:42:23,261][52666] DAMAGECOUNT value on done: 131463.0 [2024-08-06 00:42:23,261][52666] Sum rewards: 75.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.717', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '61.000'} [2024-08-06 00:42:23,281][52658] DAMAGECOUNT value on done: 134044.0 [2024-08-06 00:42:23,281][52658] Sum rewards: 65.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.416', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '55.000'} [2024-08-06 00:42:23,684][52663] DAMAGECOUNT value on done: 136276.0 [2024-08-06 00:42:23,684][52663] Sum rewards: 65.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.852', 'ARMOR': '0.004', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon4': '0.298', 'weapon2': '0.654', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '56.000'} [2024-08-06 00:42:23,821][52670] DAMAGECOUNT value on done: 132272.0 [2024-08-06 00:42:23,822][52670] Sum rewards: 54.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.718', 'WEAPON3': '1.300', 'weapon3': '2.426', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:25,349][52671] DAMAGECOUNT value on done: 130094.0 [2024-08-06 00:42:25,358][52671] Sum rewards: 61.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.592', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.232', 'weapon2': '0.412', 'WEAPON4': '0.500', 'weapon4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.464', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '52.000'} [2024-08-06 00:42:26,000][52666] DAMAGECOUNT value on done: 129249.0 [2024-08-06 00:42:26,000][52666] Sum rewards: 51.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'AMMO4': '0.241', 'WEAPON4': '0.500', 'weapon2': '0.554', 'weapon4': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.636', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '45.000'} [2024-08-06 00:42:26,009][52650] Updated weights for policy 0, policy_version 24721 (0.0012) [2024-08-06 00:42:26,633][52670] DAMAGECOUNT value on done: 131389.0 [2024-08-06 00:42:26,634][52670] Sum rewards: 58.445, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.054', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.271', 'AMMO3': '0.273', 'weapon2': '0.530', 'WEAPON4': '0.600', 'weapon4': '0.702', 'WEAPON3': '1.500', 'weapon3': '2.344', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:26,691][52663] DAMAGECOUNT value on done: 132768.0 [2024-08-06 00:42:26,691][52663] Sum rewards: 66.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'weapon5': '0.058', 'AMMO2': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.320', 'weapon2': '0.376', 'weapon4': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 00:42:27,483][52665] DAMAGECOUNT value on done: 127214.0 [2024-08-06 00:42:27,485][52665] Sum rewards: 56.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.218', 'weapon2': '0.310', 'WEAPON4': '0.600', 'weapon4': '0.662', 'WEAPON3': '1.300', 'weapon3': '2.712', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '48.500'} [2024-08-06 00:42:27,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 202547200. Throughput: 0: 4398.7. Samples: 50643730. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:42:27,794][52567] Avg episode reward: [(0, '55.403')] [2024-08-06 00:42:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024725_202547200.pth... [2024-08-06 00:42:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024210_198328320.pth [2024-08-06 00:42:28,197][52820] DAMAGECOUNT value on done: 120677.0 [2024-08-06 00:42:28,203][52820] Sum rewards: 56.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.215', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon5': '0.070', 'AMMO3': '0.234', 'weapon2': '0.570', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.088', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:28,506][52666] DAMAGECOUNT value on done: 126469.0 [2024-08-06 00:42:28,506][52666] Sum rewards: 46.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.225', 'weapon2': '0.320', 'weapon4': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.490', 'weapon3': '3.010', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '43.000'} [2024-08-06 00:42:28,591][52671] DAMAGECOUNT value on done: 132016.0 [2024-08-06 00:42:28,592][52671] Sum rewards: 63.525, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.853', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '55.000'} [2024-08-06 00:42:29,204][52670] DAMAGECOUNT value on done: 129533.0 [2024-08-06 00:42:29,205][52670] Sum rewards: 47.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.220', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.124', 'AMMO3': '0.158', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '2.946', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '39.000'} [2024-08-06 00:42:29,794][52663] DAMAGECOUNT value on done: 129473.0 [2024-08-06 00:42:29,796][52663] Sum rewards: 63.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.447', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '55.000'} [2024-08-06 00:42:30,676][52665] DAMAGECOUNT value on done: 135701.0 [2024-08-06 00:42:30,676][52650] Updated weights for policy 0, policy_version 24731 (0.0021) [2024-08-06 00:42:30,676][52665] Sum rewards: 54.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon4': '0.040', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.218', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '47.000'} [2024-08-06 00:42:31,273][52666] DAMAGECOUNT value on done: 128166.0 [2024-08-06 00:42:31,274][52666] Sum rewards: 66.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.755', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.376', 'WEAPON3': '1.050', 'weapon3': '3.216', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:31,477][52820] DAMAGECOUNT value on done: 122779.0 [2024-08-06 00:42:31,478][52820] Sum rewards: 48.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.453', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO4': '0.213', 'AMMO3': '0.223', 'weapon4': '0.416', 'WEAPON4': '0.550', 'weapon2': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.736', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '43.000'} [2024-08-06 00:42:31,753][52671] DAMAGECOUNT value on done: 132023.0 [2024-08-06 00:42:31,754][52671] Sum rewards: 64.724, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.891', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.170', 'weapon5': '0.206', 'weapon4': '0.338', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:32,051][52670] DAMAGECOUNT value on done: 129411.0 [2024-08-06 00:42:32,052][52670] Sum rewards: 43.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.179', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '2.898', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '39.000'} [2024-08-06 00:42:32,728][52663] DAMAGECOUNT value on done: 132265.0 [2024-08-06 00:42:32,728][52663] Sum rewards: 55.583, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO4': '0.032', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.604', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.218', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 202629120. Throughput: 0: 4386.9. Samples: 50656540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:42:32,794][52567] Avg episode reward: [(0, '55.299')] [2024-08-06 00:42:33,491][52665] DAMAGECOUNT value on done: 128976.0 [2024-08-06 00:42:33,491][52665] Sum rewards: 47.862, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.436', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.145', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.554', 'weapon2': '0.752', 'WEAPON3': '0.850', 'weapon3': '2.246', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '11.490', 'FRAGCOUNT': '40.000'} [2024-08-06 00:42:33,957][52666] DAMAGECOUNT value on done: 132150.0 [2024-08-06 00:42:33,965][52666] Sum rewards: 55.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.092', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:34,222][52671] DAMAGECOUNT value on done: 133456.0 [2024-08-06 00:42:34,224][52671] Sum rewards: 63.018, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-5.370', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.066', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'weapon4': '0.258', 'AMMO3': '0.306', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.040', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '59.000'} [2024-08-06 00:42:34,599][52820] DAMAGECOUNT value on done: 118372.0 [2024-08-06 00:42:34,601][52820] Sum rewards: 44.346, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.574', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.173', 'AMMO3': '0.224', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '41.000'} [2024-08-06 00:42:34,794][52670] DAMAGECOUNT value on done: 134279.0 [2024-08-06 00:42:34,794][52670] Sum rewards: 67.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '57.000'} [2024-08-06 00:42:35,410][52650] Updated weights for policy 0, policy_version 24741 (0.0014) [2024-08-06 00:42:35,712][52663] DAMAGECOUNT value on done: 133623.0 [2024-08-06 00:42:35,716][52663] Sum rewards: 48.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.033', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.202', 'weapon4': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '41.500'} [2024-08-06 00:42:36,671][52665] DAMAGECOUNT value on done: 125590.0 [2024-08-06 00:42:36,674][52665] Sum rewards: 57.050, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.212', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:36,708][52666] DAMAGECOUNT value on done: 127196.0 [2024-08-06 00:42:36,709][52666] Sum rewards: 51.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.857', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.227', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.794', 'WEAPON3': '1.350', 'weapon3': '2.608', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '45.000'} [2024-08-06 00:42:37,054][52671] DAMAGECOUNT value on done: 132921.0 [2024-08-06 00:42:37,056][52671] Sum rewards: 49.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.667', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.182', 'weapon2': '0.402', 'WEAPON4': '0.500', 'weapon4': '0.766', 'WEAPON3': '1.050', 'weapon3': '2.464', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '11.706', 'FRAGCOUNT': '42.500'} [2024-08-06 00:42:37,535][52670] DAMAGECOUNT value on done: 124536.0 [2024-08-06 00:42:37,536][52670] Sum rewards: 59.058, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.280', 'AMMO5': '0.007', 'AMMO2': '0.051', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO3': '0.187', 'AMMO4': '0.254', 'weapon4': '0.368', 'WEAPON4': '0.550', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.546', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 202719232. Throughput: 0: 4390.2. Samples: 50683210. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 00:42:37,794][52567] Avg episode reward: [(0, '55.255')] [2024-08-06 00:42:37,832][52820] DAMAGECOUNT value on done: 116721.0 [2024-08-06 00:42:37,832][52820] Sum rewards: 61.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '52.000'} [2024-08-06 00:42:38,665][52663] DAMAGECOUNT value on done: 132466.0 [2024-08-06 00:42:38,666][52663] Sum rewards: 62.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.382', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'weapon2': '0.228', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.708', 'WEAPON3': '1.500', 'weapon3': '2.774', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '55.000'} [2024-08-06 00:42:39,510][52665] DAMAGECOUNT value on done: 128090.0 [2024-08-06 00:42:39,518][52665] Sum rewards: 57.656, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.255', 'weapon5': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.015', 'ARMOR': '0.016', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.456', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.252', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:39,674][52671] DAMAGECOUNT value on done: 130255.0 [2024-08-06 00:42:39,674][52671] Sum rewards: 51.768, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.266', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '3.000', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:39,877][52650] Updated weights for policy 0, policy_version 24751 (0.0010) [2024-08-06 00:42:40,168][52666] DAMAGECOUNT value on done: 130807.0 [2024-08-06 00:42:40,168][52666] Sum rewards: 62.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.958', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.169', 'weapon2': '0.448', 'weapon4': '0.452', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:40,765][52670] DAMAGECOUNT value on done: 132573.0 [2024-08-06 00:42:40,767][52670] Sum rewards: 50.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.178', 'weapon2': '0.200', 'AMMO3': '0.211', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '3.458', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '43.000'} [2024-08-06 00:42:40,968][52820] DAMAGECOUNT value on done: 121564.0 [2024-08-06 00:42:40,968][52820] Sum rewards: 59.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.449', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.228', 'weapon2': '0.430', 'WEAPON4': '0.450', 'weapon4': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '54.000'} [2024-08-06 00:42:41,570][52663] DAMAGECOUNT value on done: 130344.0 [2024-08-06 00:42:41,570][52663] Sum rewards: 62.158, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.207', 'ARMOR': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.194', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:42,574][52665] DAMAGECOUNT value on done: 128755.0 [2024-08-06 00:42:42,574][52665] Sum rewards: 50.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.754', 'ARMOR': '0.020', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.492', 'weapon4': '0.516', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.6). Total num frames: 202801152. Throughput: 0: 4391.6. Samples: 50709630. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 00:42:42,794][52567] Avg episode reward: [(0, '55.517')] [2024-08-06 00:42:42,953][52671] DAMAGECOUNT value on done: 134500.0 [2024-08-06 00:42:42,954][52671] Sum rewards: 55.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.556', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.035', 'weapon5': '0.078', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.090', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '48.500'} [2024-08-06 00:42:43,237][52659] DAMAGECOUNT value on done: 131891.0 [2024-08-06 00:42:43,239][52659] Sum rewards: 51.531, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.997', 'AMMO2': '0.028', 'ARMOR': '0.036', 'AMMO4': '0.140', 'AMMO3': '0.252', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:43,528][52670] DAMAGECOUNT value on done: 130595.0 [2024-08-06 00:42:43,530][52670] Sum rewards: 51.923, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon4': '0.142', 'AMMO3': '0.188', 'weapon2': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.302', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '44.000'} [2024-08-06 00:42:43,915][52820] DAMAGECOUNT value on done: 121219.0 [2024-08-06 00:42:43,916][52820] Sum rewards: 51.767, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.602', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.205', 'AMMO3': '0.227', 'weapon4': '0.296', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '2.976', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '47.000'} [2024-08-06 00:42:44,546][52650] Updated weights for policy 0, policy_version 24761 (0.0022) [2024-08-06 00:42:44,780][52663] DAMAGECOUNT value on done: 126361.0 [2024-08-06 00:42:44,780][52663] Sum rewards: 69.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.400', 'weapon2': '0.584', 'weapon4': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.484', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '58.000'} [2024-08-06 00:42:45,253][52665] DAMAGECOUNT value on done: 130481.0 [2024-08-06 00:42:45,255][52665] Sum rewards: 55.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.823', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.292', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.376', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:45,625][52671] DAMAGECOUNT value on done: 131971.0 [2024-08-06 00:42:45,625][52671] Sum rewards: 56.344, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.094', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.284', 'weapon2': '0.392', 'WEAPON4': '0.450', 'weapon4': '0.694', 'WEAPON3': '1.600', 'weapon3': '2.574', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:45,832][52659] DAMAGECOUNT value on done: 130433.0 [2024-08-06 00:42:45,834][52659] Sum rewards: 53.746, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon2': '0.552', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.270', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '45.000'} [2024-08-06 00:42:46,398][52670] DAMAGECOUNT value on done: 129580.0 [2024-08-06 00:42:46,398][52670] Sum rewards: 62.864, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.700', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon4': '0.162', 'weapon2': '0.252', 'AMMO3': '0.325', 'WEAPON3': '1.950', 'HITCOUNT': '3.210', 'weapon3': '3.372', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '58.000'} [2024-08-06 00:42:47,043][52820] DAMAGECOUNT value on done: 121599.0 [2024-08-06 00:42:47,044][52820] Sum rewards: 58.978, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.996', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.118', 'AMMO3': '0.139', 'weapon4': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.000', 'weapon2': '1.102', 'weapon3': '2.456', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '47.000'} [2024-08-06 00:42:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17613.6, 300 sec: 17522.5). Total num frames: 202891264. Throughput: 0: 4393.8. Samples: 50722750. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 00:42:47,794][52567] Avg episode reward: [(0, '55.953')] [2024-08-06 00:42:47,896][52663] DAMAGECOUNT value on done: 127970.0 [2024-08-06 00:42:47,897][52663] Sum rewards: 55.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.439', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.201', 'weapon2': '0.704', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '3.068', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:48,133][52671] DAMAGECOUNT value on done: 131450.0 [2024-08-06 00:42:48,133][52671] Sum rewards: 51.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.164', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.128', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '43.000'} [2024-08-06 00:42:48,135][52665] DAMAGECOUNT value on done: 133791.0 [2024-08-06 00:42:48,136][52665] Sum rewards: 59.836, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.902', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.114', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.372', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '55.000'} [2024-08-06 00:42:48,407][52659] DAMAGECOUNT value on done: 130967.0 [2024-08-06 00:42:48,407][52659] Sum rewards: 54.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.851', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.162', 'AMMO4': '0.213', 'weapon2': '0.614', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '3.114', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:48,540][52803] DAMAGECOUNT value on done: 124001.0 [2024-08-06 00:42:48,540][52803] Sum rewards: 55.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.170', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:49,382][52670] DAMAGECOUNT value on done: 129397.0 [2024-08-06 00:42:49,383][52670] Sum rewards: 60.175, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.268', 'weapon4': '0.268', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.050', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '52.000'} [2024-08-06 00:42:49,760][52650] Updated weights for policy 0, policy_version 24771 (0.0033) [2024-08-06 00:42:50,228][52820] DAMAGECOUNT value on done: 122389.0 [2024-08-06 00:42:50,236][52820] Sum rewards: 62.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.160', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.530', 'weapon4': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.580', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:50,715][52663] DAMAGECOUNT value on done: 132716.0 [2024-08-06 00:42:50,715][52663] Sum rewards: 56.815, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.558', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.436', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '3.074', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:51,026][52671] DAMAGECOUNT value on done: 137404.0 [2024-08-06 00:42:51,027][52671] Sum rewards: 61.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.046', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.172', 'weapon2': '0.310', 'WEAPON3': '1.000', 'weapon3': '3.244', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '51.000'} [2024-08-06 00:42:51,182][52665] DAMAGECOUNT value on done: 136629.0 [2024-08-06 00:42:51,182][52665] Sum rewards: 63.981, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.368', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.228', 'AMMO3': '0.263', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '57.000'} [2024-08-06 00:42:51,352][52659] DAMAGECOUNT value on done: 133470.0 [2024-08-06 00:42:51,354][52659] Sum rewards: 59.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.322', 'weapon2': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:51,592][52803] DAMAGECOUNT value on done: 126868.0 [2024-08-06 00:42:51,592][52803] Sum rewards: 46.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.286', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO3': '0.196', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.370', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '40.500'} [2024-08-06 00:42:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 202981376. Throughput: 0: 4387.8. Samples: 50749210. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 00:42:52,794][52567] Avg episode reward: [(0, '56.598')] [2024-08-06 00:42:53,429][52820] DAMAGECOUNT value on done: 120068.0 [2024-08-06 00:42:53,430][52820] Sum rewards: 69.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.035', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.097', 'WEAPON5': '0.200', 'weapon2': '0.222', 'weapon4': '0.246', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.244', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '60.000'} [2024-08-06 00:42:53,576][52663] DAMAGECOUNT value on done: 132586.0 [2024-08-06 00:42:53,576][52663] Sum rewards: 49.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.730', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon4': '0.444', 'weapon2': '0.548', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '2.814', 'DAMAGECOUNT': '12.342', 'FRAGCOUNT': '39.000'} [2024-08-06 00:42:53,841][52650] Updated weights for policy 0, policy_version 24781 (0.0010) [2024-08-06 00:42:53,984][52671] DAMAGECOUNT value on done: 133319.0 [2024-08-06 00:42:53,988][52671] Sum rewards: 54.081, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.452', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.191', 'AMMO3': '0.240', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '47.000'} [2024-08-06 00:42:54,069][52665] DAMAGECOUNT value on done: 130467.0 [2024-08-06 00:42:54,069][52665] Sum rewards: 52.378, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.794', 'AMMO5': '0.009', 'ARMOR': '0.016', 'weapon5': '0.054', 'AMMO2': '0.073', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'AMMO4': '0.366', 'weapon2': '0.482', 'weapon4': '0.584', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.626', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '49.000'} [2024-08-06 00:42:54,262][52659] DAMAGECOUNT value on done: 132151.0 [2024-08-06 00:42:54,264][52659] Sum rewards: 64.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.346', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.150', 'AMMO3': '0.259', 'weapon4': '0.354', 'weapon2': '0.446', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '56.000'} [2024-08-06 00:42:54,646][52803] DAMAGECOUNT value on done: 123807.0 [2024-08-06 00:42:54,646][52803] Sum rewards: 43.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.432', 'AMMO2': '0.045', 'AMMO3': '0.202', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.518', 'weapon2': '0.682', 'WEAPON3': '1.300', 'weapon3': '2.506', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '39.000'} [2024-08-06 00:42:54,662][52811] DAMAGECOUNT value on done: 132645.0 [2024-08-06 00:42:54,663][52811] Sum rewards: 61.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.508', 'weapon2': '0.558', 'WEAPON3': '1.400', 'weapon3': '2.644', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '53.000'} [2024-08-06 00:42:56,157][52663] DAMAGECOUNT value on done: 134204.0 [2024-08-06 00:42:56,157][52663] Sum rewards: 50.991, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.786', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.182', 'WEAPON4': '0.400', 'weapon4': '0.480', 'weapon2': '0.816', 'WEAPON3': '1.250', 'weapon3': '2.424', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '42.000'} [2024-08-06 00:42:56,462][52820] DAMAGECOUNT value on done: 123007.0 [2024-08-06 00:42:56,464][52820] Sum rewards: 58.750, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.437', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.114', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.320', 'weapon4': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '48.000'} [2024-08-06 00:42:56,585][52671] DAMAGECOUNT value on done: 128072.0 [2024-08-06 00:42:56,585][52671] Sum rewards: 48.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.032', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.196', 'weapon2': '1.076', 'WEAPON3': '1.150', 'weapon3': '2.472', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '40.500'} [2024-08-06 00:42:57,070][52659] DAMAGECOUNT value on done: 132265.0 [2024-08-06 00:42:57,071][52659] Sum rewards: 54.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon7': '0.056', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.109', 'weapon5': '0.116', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '46.000'} [2024-08-06 00:42:57,175][52665] DAMAGECOUNT value on done: 132532.0 [2024-08-06 00:42:57,175][52665] Sum rewards: 60.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.525', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.044', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:57,710][52811] DAMAGECOUNT value on done: 121912.0 [2024-08-06 00:42:57,712][52811] Sum rewards: 50.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.066', 'AMMO4': '0.190', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.524', 'weapon2': '0.604', 'WEAPON3': '1.300', 'weapon3': '2.520', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '45.000'} [2024-08-06 00:42:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 203071488. Throughput: 0: 4383.1. Samples: 50775530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:42:57,794][52567] Avg episode reward: [(0, '56.660')] [2024-08-06 00:42:58,032][52803] DAMAGECOUNT value on done: 123134.0 [2024-08-06 00:42:58,033][52803] Sum rewards: 59.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.778', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.159', 'weapon5': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '50.000'} [2024-08-06 00:42:58,672][52650] Updated weights for policy 0, policy_version 24791 (0.0011) [2024-08-06 00:42:59,131][52663] DAMAGECOUNT value on done: 133786.0 [2024-08-06 00:42:59,131][52663] Sum rewards: 47.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.315', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.230', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '3.140', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '43.000'} [2024-08-06 00:42:59,166][52671] DAMAGECOUNT value on done: 135080.0 [2024-08-06 00:42:59,167][52671] Sum rewards: 46.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.044', 'AMMO2': '0.054', 'weapon7': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'AMMO4': '0.270', 'weapon2': '0.312', 'WEAPON4': '0.450', 'weapon4': '0.854', 'WEAPON3': '1.100', 'weapon3': '2.522', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '39.000'} [2024-08-06 00:42:59,487][52820] DAMAGECOUNT value on done: 124405.0 [2024-08-06 00:42:59,487][52820] Sum rewards: 65.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.802', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.102', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 00:42:59,623][52659] DAMAGECOUNT value on done: 133043.0 [2024-08-06 00:42:59,624][52659] Sum rewards: 51.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.112', 'AMMO3': '0.220', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.120', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '44.000'} [2024-08-06 00:43:00,201][52665] DAMAGECOUNT value on done: 132219.0 [2024-08-06 00:43:00,202][52665] Sum rewards: 67.680, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.575', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '3.302', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '54.000'} [2024-08-06 00:43:00,682][52811] DAMAGECOUNT value on done: 123959.0 [2024-08-06 00:43:00,683][52811] Sum rewards: 66.201, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.907', 'ARMOR': '0.004', 'AMMO2': '0.040', 'AMMO4': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.378', 'weapon4': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '55.000'} [2024-08-06 00:43:01,209][52803] DAMAGECOUNT value on done: 128485.0 [2024-08-06 00:43:01,211][52803] Sum rewards: 59.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.565', 'AMMO5': '0.003', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.154', 'AMMO4': '0.179', 'AMMO3': '0.213', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.516', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '52.000'} [2024-08-06 00:43:01,959][52663] DAMAGECOUNT value on done: 133433.0 [2024-08-06 00:43:01,959][52663] Sum rewards: 64.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.272', 'weapon2': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.302', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '58.000'} [2024-08-06 00:43:02,205][52671] DAMAGECOUNT value on done: 132622.0 [2024-08-06 00:43:02,205][52671] Sum rewards: 57.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.132', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.232', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '49.000'} [2024-08-06 00:43:02,611][52820] DAMAGECOUNT value on done: 124618.0 [2024-08-06 00:43:02,611][52820] Sum rewards: 65.066, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.324', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'AMMO3': '0.209', 'weapon2': '0.286', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '57.000'} [2024-08-06 00:43:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 203161600. Throughput: 0: 4394.9. Samples: 50788920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:43:02,794][52567] Avg episode reward: [(0, '57.186')] [2024-08-06 00:43:02,809][52659] DAMAGECOUNT value on done: 127287.0 [2024-08-06 00:43:02,809][52659] Sum rewards: 52.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.493', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.642', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '45.000'} [2024-08-06 00:43:03,232][52650] Updated weights for policy 0, policy_version 24801 (0.0020) [2024-08-06 00:43:03,347][52665] DAMAGECOUNT value on done: 130359.0 [2024-08-06 00:43:03,347][52665] Sum rewards: 41.875, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.779', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.058', 'weapon5': '0.076', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'AMMO3': '0.271', 'weapon2': '0.598', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '2.910', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '39.000'} [2024-08-06 00:43:03,792][52811] DAMAGECOUNT value on done: 124266.0 [2024-08-06 00:43:03,795][52811] Sum rewards: 56.409, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.912', 'AMMO5': '0.007', 'AMMO2': '0.037', 'ARMOR': '0.040', 'weapon5': '0.170', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.434', 'WEAPON3': '1.550', 'weapon3': '2.692', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '51.000'} [2024-08-06 00:43:04,384][52803] DAMAGECOUNT value on done: 124837.0 [2024-08-06 00:43:04,385][52803] Sum rewards: 42.060, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.532', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.056', 'weapon5': '0.070', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.280', 'WEAPON4': '0.600', 'weapon2': '0.726', 'WEAPON3': '0.800', 'weapon4': '1.198', 'weapon3': '1.792', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '37.000'} [2024-08-06 00:43:04,707][52663] DAMAGECOUNT value on done: 130176.0 [2024-08-06 00:43:04,707][52663] Sum rewards: 49.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.864', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.181', 'weapon4': '0.184', 'WEAPON4': '0.400', 'weapon2': '0.578', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.020', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '43.000'} [2024-08-06 00:43:04,756][52671] DAMAGECOUNT value on done: 132655.0 [2024-08-06 00:43:04,756][52671] Sum rewards: 61.180, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.356', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.218', 'weapon2': '0.580', 'WEAPON3': '0.850', 'weapon3': '2.840', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '49.000'} [2024-08-06 00:43:05,143][52659] DAMAGECOUNT value on done: 133765.0 [2024-08-06 00:43:05,145][52659] Sum rewards: 65.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.942', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.178', 'WEAPON4': '0.400', 'weapon4': '0.462', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.804', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '55.000'} [2024-08-06 00:43:05,656][52820] DAMAGECOUNT value on done: 121943.0 [2024-08-06 00:43:05,656][52820] Sum rewards: 70.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.187', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '58.000'} [2024-08-06 00:43:06,561][52665] DAMAGECOUNT value on done: 130349.0 [2024-08-06 00:43:06,562][52665] Sum rewards: 56.593, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.261', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon2': '0.456', 'weapon4': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.812', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '46.000'} [2024-08-06 00:43:06,776][52811] DAMAGECOUNT value on done: 123539.0 [2024-08-06 00:43:06,779][52811] Sum rewards: 57.334, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.043', 'AMMO3': '0.167', 'AMMO4': '0.213', 'WEAPON4': '0.300', 'HEALTH': '0.544', 'weapon2': '0.704', 'weapon4': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.246', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:07,123][52671] DAMAGECOUNT value on done: 134104.0 [2024-08-06 00:43:07,124][52671] Sum rewards: 62.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.748', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.169', 'AMMO4': '0.203', 'weapon2': '0.270', 'WEAPON4': '0.500', 'weapon4': '0.904', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '53.000'} [2024-08-06 00:43:07,469][52803] DAMAGECOUNT value on done: 127655.0 [2024-08-06 00:43:07,472][52803] Sum rewards: 59.873, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.004', 'AMMO2': '0.031', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.227', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.104', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '54.000'} [2024-08-06 00:43:07,576][52659] DAMAGECOUNT value on done: 134802.0 [2024-08-06 00:43:07,576][52659] Sum rewards: 52.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.209', 'weapon4': '0.314', 'weapon2': '0.378', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '45.000'} [2024-08-06 00:43:07,734][52650] Updated weights for policy 0, policy_version 24811 (0.0025) [2024-08-06 00:43:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 203251712. Throughput: 0: 4396.0. Samples: 50815310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:43:07,794][52567] Avg episode reward: [(0, '57.039')] [2024-08-06 00:43:08,703][52820] DAMAGECOUNT value on done: 123413.0 [2024-08-06 00:43:08,704][52820] Sum rewards: 52.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.066', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.183', 'weapon5': '0.190', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.560', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '44.000'} [2024-08-06 00:43:09,433][52665] DAMAGECOUNT value on done: 130760.0 [2024-08-06 00:43:09,433][52665] Sum rewards: 52.645, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.125', 'weapon5': '0.128', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.836', 'WEAPON3': '0.850', 'weapon3': '2.600', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '44.000'} [2024-08-06 00:43:09,901][52811] DAMAGECOUNT value on done: 128057.0 [2024-08-06 00:43:09,903][52811] Sum rewards: 51.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.672', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.125', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.384', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '3.022', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '43.000'} [2024-08-06 00:43:10,026][52671] DAMAGECOUNT value on done: 132455.0 [2024-08-06 00:43:10,028][52671] Sum rewards: 62.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.190', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 00:43:10,508][52803] DAMAGECOUNT value on done: 121875.0 [2024-08-06 00:43:10,508][52803] Sum rewards: 58.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.676', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.512', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '51.000'} [2024-08-06 00:43:10,606][52659] DAMAGECOUNT value on done: 130978.0 [2024-08-06 00:43:10,608][52659] Sum rewards: 58.320, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.091', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '2.932', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '51.000'} [2024-08-06 00:43:11,854][52820] DAMAGECOUNT value on done: 125293.0 [2024-08-06 00:43:11,863][52820] Sum rewards: 69.866, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.049', 'weapon4': '0.066', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '58.000'} [2024-08-06 00:43:12,623][52650] Updated weights for policy 0, policy_version 24821 (0.0040) [2024-08-06 00:43:12,631][52665] DAMAGECOUNT value on done: 127380.0 [2024-08-06 00:43:12,636][52665] Sum rewards: 55.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.778', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.064', 'AMMO3': '0.189', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.448', 'weapon4': '0.690', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.496', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '49.000'} [2024-08-06 00:43:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 203333632. Throughput: 0: 4393.6. Samples: 50841440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:43:12,794][52567] Avg episode reward: [(0, '56.688')] [2024-08-06 00:43:13,070][52811] DAMAGECOUNT value on done: 123574.0 [2024-08-06 00:43:13,073][52811] Sum rewards: 60.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.708', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.778', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '50.000'} [2024-08-06 00:43:13,607][52803] DAMAGECOUNT value on done: 124370.0 [2024-08-06 00:43:13,610][52803] Sum rewards: 58.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.498', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:13,768][52659] DAMAGECOUNT value on done: 126739.0 [2024-08-06 00:43:13,768][52659] Sum rewards: 56.521, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.238', 'HEALTH': '0.408', 'weapon4': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:15,126][52820] DAMAGECOUNT value on done: 122089.0 [2024-08-06 00:43:15,127][52820] Sum rewards: 46.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.322', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.169', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '3.164', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '40.000'} [2024-08-06 00:43:15,673][52665] DAMAGECOUNT value on done: 130140.0 [2024-08-06 00:43:15,675][52665] Sum rewards: 50.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.214', 'weapon2': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.784', 'WEAPON3': '1.300', 'weapon3': '2.552', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '44.000'} [2024-08-06 00:43:16,158][52811] DAMAGECOUNT value on done: 122733.0 [2024-08-06 00:43:16,158][52811] Sum rewards: 57.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.963', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.192', 'weapon5': '0.202', 'AMMO4': '0.234', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.426', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '50.000'} [2024-08-06 00:43:16,588][52803] DAMAGECOUNT value on done: 121803.0 [2024-08-06 00:43:16,590][52803] Sum rewards: 66.241, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.759', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.130', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '58.000'} [2024-08-06 00:43:16,785][52659] DAMAGECOUNT value on done: 126706.0 [2024-08-06 00:43:16,787][52659] Sum rewards: 48.030, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.150', 'AMMO2': '0.037', 'AMMO3': '0.134', 'AMMO4': '0.185', 'weapon4': '0.390', 'WEAPON4': '0.400', 'weapon2': '0.882', 'WEAPON3': '0.950', 'weapon3': '2.588', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '40.000'} [2024-08-06 00:43:17,249][52650] Updated weights for policy 0, policy_version 24831 (0.0015) [2024-08-06 00:43:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 203423744. Throughput: 0: 4401.1. Samples: 50854590. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:43:17,794][52567] Avg episode reward: [(0, '56.533')] [2024-08-06 00:43:18,204][52820] DAMAGECOUNT value on done: 123785.0 [2024-08-06 00:43:18,208][52820] Sum rewards: 59.610, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.338', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.464', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '53.500'} [2024-08-06 00:43:18,557][52665] DAMAGECOUNT value on done: 125107.0 [2024-08-06 00:43:18,557][52665] Sum rewards: 59.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.094', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO3': '0.150', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.502', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.650', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '49.000'} [2024-08-06 00:43:19,228][52811] DAMAGECOUNT value on done: 128883.0 [2024-08-06 00:43:19,228][52811] Sum rewards: 63.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '54.000'} [2024-08-06 00:43:19,722][52659] DAMAGECOUNT value on done: 133677.0 [2024-08-06 00:43:19,722][52659] Sum rewards: 42.714, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.259', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'AMMO4': '0.238', 'weapon2': '0.478', 'weapon4': '0.588', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '2.750', 'DAMAGECOUNT': '12.147', 'FRAGCOUNT': '39.000'} [2024-08-06 00:43:19,789][52803] DAMAGECOUNT value on done: 127740.0 [2024-08-06 00:43:19,792][52803] Sum rewards: 58.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.389', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO4': '0.121', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.450', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '49.500'} [2024-08-06 00:43:20,554][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:43:21,453][52820] DAMAGECOUNT value on done: 125189.0 [2024-08-06 00:43:21,453][52820] Sum rewards: 59.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.486', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '50.000'} [2024-08-06 00:43:21,672][52665] DAMAGECOUNT value on done: 128217.0 [2024-08-06 00:43:21,674][52665] Sum rewards: 52.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.050', 'weapon4': '0.152', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.090', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:21,909][52650] Updated weights for policy 0, policy_version 24841 (0.0022) [2024-08-06 00:43:22,403][52811] DAMAGECOUNT value on done: 122844.0 [2024-08-06 00:43:22,404][52811] Sum rewards: 52.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.114', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.032', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '44.000'} [2024-08-06 00:43:22,780][52659] DAMAGECOUNT value on done: 133129.0 [2024-08-06 00:43:22,781][52659] Sum rewards: 53.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.896', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.212', 'DAMAGECOUNT': '12.762', 'FRAGCOUNT': '46.000'} [2024-08-06 00:43:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 203505664. Throughput: 0: 4397.8. Samples: 50881110. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:43:22,794][52567] Avg episode reward: [(0, '56.648')] [2024-08-06 00:43:22,891][52803] DAMAGECOUNT value on done: 127621.0 [2024-08-06 00:43:22,891][52803] Sum rewards: 54.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.108', 'AMMO3': '0.173', 'weapon4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.110', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '44.500'} [2024-08-06 00:43:24,624][52820] DAMAGECOUNT value on done: 127415.0 [2024-08-06 00:43:24,626][52820] Sum rewards: 70.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.257', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.233', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '59.000'} [2024-08-06 00:43:24,810][52665] DAMAGECOUNT value on done: 129891.0 [2024-08-06 00:43:24,811][52665] Sum rewards: 55.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.222', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:25,427][52811] DAMAGECOUNT value on done: 124358.0 [2024-08-06 00:43:25,430][52811] Sum rewards: 50.068, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon4': '0.224', 'weapon2': '0.674', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '43.000'} [2024-08-06 00:43:25,598][52659] DAMAGECOUNT value on done: 137819.0 [2024-08-06 00:43:25,598][52659] Sum rewards: 50.772, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.730', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO4': '0.194', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON4': '0.550', 'weapon4': '0.590', 'WEAPON3': '1.450', 'weapon3': '2.584', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:26,145][52803] DAMAGECOUNT value on done: 125059.0 [2024-08-06 00:43:26,148][52803] Sum rewards: 49.598, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.378', 'AMMO5': '0.008', 'weapon5': '0.016', 'ARMOR': '0.024', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'AMMO4': '0.195', 'weapon2': '0.418', 'WEAPON4': '0.650', 'weapon4': '0.814', 'WEAPON3': '1.250', 'weapon3': '2.454', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '45.000'} [2024-08-06 00:43:26,783][52650] Updated weights for policy 0, policy_version 24851 (0.0013) [2024-08-06 00:43:27,750][52820] DAMAGECOUNT value on done: 120803.0 [2024-08-06 00:43:27,750][52820] Sum rewards: 57.795, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.142', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.380', 'weapon4': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.002', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '49.000'} [2024-08-06 00:43:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 203603968. Throughput: 0: 4396.5. Samples: 50907470. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:43:27,802][52567] Avg episode reward: [(0, '56.676')] [2024-08-06 00:43:28,148][52659] DAMAGECOUNT value on done: 134770.0 [2024-08-06 00:43:28,149][52659] Sum rewards: 64.592, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.386', 'HEALTH': '0.449', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '53.500'} [2024-08-06 00:43:28,579][52811] DAMAGECOUNT value on done: 124264.0 [2024-08-06 00:43:28,579][52811] Sum rewards: 61.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.464', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.110', 'AMMO3': '0.174', 'AMMO4': '0.229', 'weapon4': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.976', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '50.000'} [2024-08-06 00:43:29,253][52803] DAMAGECOUNT value on done: 126076.0 [2024-08-06 00:43:29,254][52803] Sum rewards: 61.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.895', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '53.000'} [2024-08-06 00:43:31,186][52650] Updated weights for policy 0, policy_version 24861 (0.0023) [2024-08-06 00:43:31,219][52659] DAMAGECOUNT value on done: 130620.0 [2024-08-06 00:43:31,219][52659] Sum rewards: 51.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.400', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.217', 'weapon2': '0.296', 'WEAPON4': '0.550', 'weapon4': '0.598', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.846', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '45.000'} [2024-08-06 00:43:31,646][52811] DAMAGECOUNT value on done: 124131.0 [2024-08-06 00:43:31,647][52811] Sum rewards: 50.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.014', 'AMMO2': '0.051', 'AMMO3': '0.165', 'weapon5': '0.196', 'AMMO4': '0.257', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.586', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '44.000'} [2024-08-06 00:43:32,389][52803] DAMAGECOUNT value on done: 122243.0 [2024-08-06 00:43:32,392][52803] Sum rewards: 61.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.616', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.232', 'weapon4': '0.282', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '52.000'} [2024-08-06 00:43:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 203677696. Throughput: 0: 4396.0. Samples: 50920570. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:43:32,795][52567] Avg episode reward: [(0, '56.717')] [2024-08-06 00:43:33,666][52668] DAMAGECOUNT value on done: 132131.0 [2024-08-06 00:43:33,668][52668] Sum rewards: 53.059, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.552', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon4': '0.272', 'weapon2': '0.752', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '48.000'} [2024-08-06 00:43:34,233][52659] DAMAGECOUNT value on done: 135993.0 [2024-08-06 00:43:34,233][52659] Sum rewards: 53.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.758', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.348', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.068', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '46.000'} [2024-08-06 00:43:34,701][52811] DAMAGECOUNT value on done: 125216.0 [2024-08-06 00:43:34,701][52811] Sum rewards: 38.547, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.342', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO4': '0.211', 'AMMO3': '0.291', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.700', 'HITCOUNT': '2.470', 'weapon3': '3.114', 'DAMAGECOUNT': '11.400', 'FRAGCOUNT': '38.000'} [2024-08-06 00:43:35,536][52803] DAMAGECOUNT value on done: 121374.0 [2024-08-06 00:43:35,536][52803] Sum rewards: 67.048, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.927', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon2': '0.196', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.484', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '58.000'} [2024-08-06 00:43:35,943][52650] Updated weights for policy 0, policy_version 24871 (0.0019) [2024-08-06 00:43:36,950][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:43:36,995][52668] DAMAGECOUNT value on done: 138654.0 [2024-08-06 00:43:36,996][52668] Sum rewards: 60.752, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.841', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.046', 'weapon5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON4': '0.500', 'weapon4': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.720', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '49.000'} [2024-08-06 00:43:37,100][52662] DAMAGECOUNT value on done: 136719.0 [2024-08-06 00:43:37,100][52662] Sum rewards: 47.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon5': '0.128', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.280', 'weapon2': '0.782', 'WEAPON3': '0.950', 'HITCOUNT': '2.550', 'weapon3': '2.686', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '39.000'} [2024-08-06 00:43:37,183][52659] DAMAGECOUNT value on done: 135987.0 [2024-08-06 00:43:37,183][52659] Sum rewards: 50.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.268', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.204', 'AMMO3': '0.222', 'weapon2': '0.302', 'WEAPON4': '0.400', 'weapon4': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '43.000'} [2024-08-06 00:43:37,224][52649] Large shaping reward 2.519 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.468, 156.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:43:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 203776000. Throughput: 0: 4402.2. Samples: 50947310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:43:37,794][52567] Avg episode reward: [(0, '56.601')] [2024-08-06 00:43:37,841][52811] DAMAGECOUNT value on done: 126119.0 [2024-08-06 00:43:37,841][52811] Sum rewards: 52.050, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.555', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.190', 'AMMO3': '0.280', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.650', 'weapon3': '2.914', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '51.000'} [2024-08-06 00:43:38,637][52803] DAMAGECOUNT value on done: 126301.0 [2024-08-06 00:43:38,637][52803] Sum rewards: 59.968, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.485', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.078', 'AMMO3': '0.213', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.600', 'weapon2': '0.694', 'WEAPON3': '1.350', 'weapon3': '2.620', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '53.000'} [2024-08-06 00:43:38,867][52662] Large shaping reward 2.742 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 00:43:40,108][52662] DAMAGECOUNT value on done: 139463.0 [2024-08-06 00:43:40,111][52662] Sum rewards: 64.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.715', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '53.000'} [2024-08-06 00:43:40,127][52668] DAMAGECOUNT value on done: 134459.0 [2024-08-06 00:43:40,128][52668] Sum rewards: 65.234, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.758', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon7': '0.060', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.254', 'weapon4': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '54.000'} [2024-08-06 00:43:40,313][52650] Updated weights for policy 0, policy_version 24881 (0.0020) [2024-08-06 00:43:40,993][52811] DAMAGECOUNT value on done: 127896.0 [2024-08-06 00:43:40,994][52811] Sum rewards: 52.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.494', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.760', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '43.000'} [2024-08-06 00:43:41,924][52803] DAMAGECOUNT value on done: 124301.0 [2024-08-06 00:43:41,924][52803] Sum rewards: 48.684, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.552', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.048', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.368', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.208', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '43.000'} [2024-08-06 00:43:42,632][52668] DAMAGECOUNT value on done: 132262.0 [2024-08-06 00:43:42,632][52668] Sum rewards: 65.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.176', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '55.000'} [2024-08-06 00:43:42,729][52662] DAMAGECOUNT value on done: 141940.0 [2024-08-06 00:43:42,729][52662] Sum rewards: 66.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.036', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.290', 'WEAPON3': '1.250', 'HITCOUNT': '3.480', 'weapon3': '3.498', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '55.000'} [2024-08-06 00:43:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 203857920. Throughput: 0: 4404.7. Samples: 50973740. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:43:42,802][52567] Avg episode reward: [(0, '56.703')] [2024-08-06 00:43:44,101][52811] DAMAGECOUNT value on done: 124472.0 [2024-08-06 00:43:44,104][52811] Sum rewards: 55.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.552', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.146', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon5': '0.256', 'weapon2': '0.394', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.884', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '45.000'} [2024-08-06 00:43:45,024][52803] DAMAGECOUNT value on done: 126232.0 [2024-08-06 00:43:45,027][52803] Sum rewards: 54.645, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.698', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.131', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '50.000'} [2024-08-06 00:43:45,166][52650] Updated weights for policy 0, policy_version 24891 (0.0021) [2024-08-06 00:43:45,493][52668] DAMAGECOUNT value on done: 132721.0 [2024-08-06 00:43:45,493][52668] Sum rewards: 46.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.146', 'AMMO5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.342', 'weapon4': '0.386', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '3.132', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '39.000'} [2024-08-06 00:43:45,754][52662] DAMAGECOUNT value on done: 131911.0 [2024-08-06 00:43:45,754][52662] Sum rewards: 57.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.565', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.522', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.136', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '51.000'} [2024-08-06 00:43:47,251][52811] DAMAGECOUNT value on done: 127919.0 [2024-08-06 00:43:47,251][52811] Sum rewards: 53.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.842', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.058', 'AMMO4': '0.216', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.280', 'weapon4': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.032', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '46.000'} [2024-08-06 00:43:47,750][52660] DAMAGECOUNT value on done: 129752.0 [2024-08-06 00:43:47,751][52660] Sum rewards: 52.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.544', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.124', 'AMMO4': '0.201', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.362', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 203948032. Throughput: 0: 4394.7. Samples: 50986680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:43:47,794][52567] Avg episode reward: [(0, '56.414')] [2024-08-06 00:43:48,133][52803] DAMAGECOUNT value on done: 120742.0 [2024-08-06 00:43:48,134][52803] Sum rewards: 47.616, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.887', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.098', 'WEAPON4': '0.200', 'weapon2': '0.264', 'AMMO3': '0.328', 'WEAPON3': '1.950', 'HITCOUNT': '3.050', 'weapon3': '3.398', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:48,397][52668] DAMAGECOUNT value on done: 129793.0 [2024-08-06 00:43:48,397][52668] Sum rewards: 46.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.684', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.108', 'AMMO3': '0.226', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '3.234', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '41.000'} [2024-08-06 00:43:48,417][52662] DAMAGECOUNT value on done: 137608.0 [2024-08-06 00:43:48,417][52662] Sum rewards: 51.473, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'HEALTH': '0.350', 'weapon4': '0.500', 'weapon2': '0.528', 'WEAPON3': '0.850', 'weapon3': '2.820', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '41.000'} [2024-08-06 00:43:48,426][52667] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.498, 166.0)] [2024-08-06 00:43:49,639][52650] Updated weights for policy 0, policy_version 24901 (0.0028) [2024-08-06 00:43:50,571][52811] DAMAGECOUNT value on done: 123968.0 [2024-08-06 00:43:50,571][52811] Sum rewards: 42.274, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.417', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.112', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.258', 'WEAPON4': '0.450', 'weapon2': '0.532', 'WEAPON3': '0.850', 'weapon4': '0.950', 'weapon3': '2.120', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.845', 'FRAGCOUNT': '34.500'} [2024-08-06 00:43:50,715][52660] DAMAGECOUNT value on done: 133821.0 [2024-08-06 00:43:50,716][52660] Sum rewards: 58.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.462', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.074', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.336', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '50.000'} [2024-08-06 00:43:51,154][52662] DAMAGECOUNT value on done: 137511.0 [2024-08-06 00:43:51,154][52662] Sum rewards: 52.641, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.529', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.026', 'weapon4': '0.060', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '0.386', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.254', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '48.000'} [2024-08-06 00:43:51,417][52668] DAMAGECOUNT value on done: 134265.0 [2024-08-06 00:43:51,419][52668] Sum rewards: 52.434, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.271', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon4': '0.220', 'AMMO3': '0.258', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.008', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:52,559][52794] DAMAGECOUNT value on done: 140425.0 [2024-08-06 00:43:52,560][52794] Sum rewards: 53.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '46.000'} [2024-08-06 00:43:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 204038144. Throughput: 0: 4394.7. Samples: 51013070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:43:52,794][52567] Avg episode reward: [(0, '55.914')] [2024-08-06 00:43:53,604][52660] DAMAGECOUNT value on done: 133850.0 [2024-08-06 00:43:53,605][52660] Sum rewards: 49.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.118', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '2.330', 'weapon3': '2.974', 'DAMAGECOUNT': '11.433', 'FRAGCOUNT': '42.000'} [2024-08-06 00:43:53,651][52811] DAMAGECOUNT value on done: 126592.0 [2024-08-06 00:43:53,651][52811] Sum rewards: 56.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.355', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.056', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.215', 'AMMO4': '0.278', 'weapon4': '0.422', 'weapon2': '0.520', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.614', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '51.000'} [2024-08-06 00:43:54,185][52668] DAMAGECOUNT value on done: 136234.0 [2024-08-06 00:43:54,186][52668] Sum rewards: 60.220, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.167', 'weapon4': '0.396', 'HEALTH': '0.420', 'weapon2': '0.772', 'WEAPON3': '0.950', 'weapon3': '2.642', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '48.000'} [2024-08-06 00:43:54,404][52662] DAMAGECOUNT value on done: 137786.0 [2024-08-06 00:43:54,405][52662] Sum rewards: 56.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.207', 'weapon2': '0.316', 'WEAPON4': '0.550', 'weapon4': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:54,529][52650] Updated weights for policy 0, policy_version 24911 (0.0013) [2024-08-06 00:43:55,364][52794] DAMAGECOUNT value on done: 139103.0 [2024-08-06 00:43:55,364][52794] Sum rewards: 55.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.164', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.160', 'weapon2': '0.438', 'WEAPON4': '0.450', 'weapon4': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '48.000'} [2024-08-06 00:43:56,599][52660] DAMAGECOUNT value on done: 134501.0 [2024-08-06 00:43:56,601][52660] Sum rewards: 53.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.590', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:56,890][52662] DAMAGECOUNT value on done: 142965.0 [2024-08-06 00:43:56,890][52662] Sum rewards: 52.798, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.538', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.664', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '48.000'} [2024-08-06 00:43:57,313][52668] DAMAGECOUNT value on done: 134738.0 [2024-08-06 00:43:57,313][52668] Sum rewards: 48.160, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.297', 'AMMO5': '0.003', 'weapon5': '0.034', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO4': '0.183', 'AMMO3': '0.248', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.636', 'WEAPON3': '1.500', 'weapon3': '2.718', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '45.000'} [2024-08-06 00:43:57,544][52664] DAMAGECOUNT value on done: 137170.0 [2024-08-06 00:43:57,545][52664] Sum rewards: 52.461, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.575', 'ARMOR': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.259', 'WEAPON4': '0.500', 'weapon2': '0.572', 'weapon4': '0.790', 'WEAPON3': '1.400', 'weapon3': '2.358', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '50.000'} [2024-08-06 00:43:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 204128256. Throughput: 0: 4392.0. Samples: 51039080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:43:57,794][52567] Avg episode reward: [(0, '55.833')] [2024-08-06 00:43:58,006][52794] DAMAGECOUNT value on done: 133722.0 [2024-08-06 00:43:58,006][52794] Sum rewards: 50.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.572', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon5': '0.236', 'weapon2': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.624', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '44.000'} [2024-08-06 00:43:59,089][52667] DAMAGECOUNT value on done: 136600.0 [2024-08-06 00:43:59,092][52667] Sum rewards: 55.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '47.000'} [2024-08-06 00:43:59,340][52650] Updated weights for policy 0, policy_version 24921 (0.0011) [2024-08-06 00:43:59,432][52662] DAMAGECOUNT value on done: 138622.0 [2024-08-06 00:43:59,432][52662] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.556', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.176', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.472', 'weapon4': '0.672', 'WEAPON3': '1.300', 'weapon3': '2.560', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '56.000'} [2024-08-06 00:43:59,441][52660] DAMAGECOUNT value on done: 130763.0 [2024-08-06 00:43:59,441][52660] Sum rewards: 51.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.162', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.059', 'weapon5': '0.162', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'AMMO4': '0.295', 'weapon2': '0.472', 'WEAPON4': '0.750', 'weapon4': '0.766', 'WEAPON3': '1.000', 'weapon3': '2.282', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '43.000'} [2024-08-06 00:43:59,935][52647] DAMAGECOUNT value on done: 142634.0 [2024-08-06 00:43:59,935][52647] Sum rewards: 59.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.960', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.106', 'AMMO4': '0.204', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.338', 'WEAPON3': '1.500', 'weapon3': '2.830', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '53.000'} [2024-08-06 00:44:00,209][52668] DAMAGECOUNT value on done: 135968.0 [2024-08-06 00:44:00,210][52668] Sum rewards: 59.173, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.300', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.122', 'AMMO4': '0.156', 'weapon5': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '0.800', 'weapon4': '0.936', 'weapon3': '2.186', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:00,298][52664] DAMAGECOUNT value on done: 137336.0 [2024-08-06 00:44:00,298][52664] Sum rewards: 47.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.688', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.274', 'weapon2': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '39.000'} [2024-08-06 00:44:00,573][52794] DAMAGECOUNT value on done: 132986.0 [2024-08-06 00:44:00,573][52794] Sum rewards: 63.913, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.661', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon4': '0.488', 'weapon2': '0.782', 'WEAPON3': '1.000', 'weapon3': '2.632', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:02,065][52660] DAMAGECOUNT value on done: 130597.0 [2024-08-06 00:44:02,066][52660] Sum rewards: 53.693, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.092', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'AMMO3': '0.296', 'weapon2': '0.448', 'WEAPON3': '1.700', 'HITCOUNT': '2.830', 'weapon3': '3.104', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '48.500'} [2024-08-06 00:44:02,068][52662] DAMAGECOUNT value on done: 140842.0 [2024-08-06 00:44:02,070][52662] Sum rewards: 56.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO3': '0.235', 'weapon2': '0.378', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.428', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:02,124][52667] DAMAGECOUNT value on done: 135923.0 [2024-08-06 00:44:02,125][52667] Sum rewards: 64.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon4': '0.232', 'weapon2': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '55.000'} [2024-08-06 00:44:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 204210176. Throughput: 0: 4396.7. Samples: 51052440. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:44:02,802][52567] Avg episode reward: [(0, '55.580')] [2024-08-06 00:44:02,854][52668] DAMAGECOUNT value on done: 132802.0 [2024-08-06 00:44:02,854][52668] Sum rewards: 58.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.912', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.127', 'AMMO3': '0.216', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:02,995][52647] DAMAGECOUNT value on done: 139800.0 [2024-08-06 00:44:02,996][52647] Sum rewards: 56.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:03,012][52794] DAMAGECOUNT value on done: 137318.0 [2024-08-06 00:44:03,013][52794] Sum rewards: 55.825, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.775', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'AMMO3': '0.148', 'weapon2': '0.568', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.190', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:03,556][52664] DAMAGECOUNT value on done: 139417.0 [2024-08-06 00:44:03,556][52664] Sum rewards: 66.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.660', 'AMMO2': '0.006', 'AMMO5': '0.009', 'weapon5': '0.024', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon4': '0.216', 'weapon2': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '55.000'} [2024-08-06 00:44:03,963][52650] Updated weights for policy 0, policy_version 24931 (0.0011) [2024-08-06 00:44:04,397][52662] DAMAGECOUNT value on done: 135053.0 [2024-08-06 00:44:04,398][52662] Sum rewards: 51.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.004', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.222', 'WEAPON4': '0.500', 'weapon4': '0.682', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '2.292', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:05,087][52667] DAMAGECOUNT value on done: 135242.0 [2024-08-06 00:44:05,088][52667] Sum rewards: 55.134, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.568', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon4': '0.456', 'weapon2': '0.542', 'WEAPON3': '1.550', 'weapon3': '2.700', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:05,171][52660] DAMAGECOUNT value on done: 135165.0 [2024-08-06 00:44:05,172][52660] Sum rewards: 51.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.159', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon4': '0.198', 'AMMO3': '0.225', 'weapon2': '0.446', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.176', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:05,695][52794] DAMAGECOUNT value on done: 135847.0 [2024-08-06 00:44:05,697][52794] Sum rewards: 55.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.101', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.156', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.296', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '3.388', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:05,786][52668] DAMAGECOUNT value on done: 132641.0 [2024-08-06 00:44:05,787][52668] Sum rewards: 60.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.262', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '51.000'} [2024-08-06 00:44:06,237][52647] DAMAGECOUNT value on done: 144103.0 [2024-08-06 00:44:06,237][52647] Sum rewards: 53.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.822', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.049', 'weapon5': '0.108', 'AMMO3': '0.192', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'weapon4': '0.438', 'weapon2': '0.570', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.648', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '47.000'} [2024-08-06 00:44:06,757][52664] DAMAGECOUNT value on done: 139620.0 [2024-08-06 00:44:06,757][52664] Sum rewards: 71.917, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.050', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.092', 'AMMO3': '0.111', 'weapon2': '0.532', 'WEAPON3': '0.750', 'weapon3': '3.276', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '55.000'} [2024-08-06 00:44:06,967][52662] DAMAGECOUNT value on done: 139327.0 [2024-08-06 00:44:06,968][52662] Sum rewards: 62.952, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.114', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '51.000'} [2024-08-06 00:44:07,714][52667] DAMAGECOUNT value on done: 132805.0 [2024-08-06 00:44:07,715][52667] Sum rewards: 50.048, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.214', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.028', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 204300288. Throughput: 0: 4394.9. Samples: 51078880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:44:07,802][52567] Avg episode reward: [(0, '55.796')] [2024-08-06 00:44:08,085][52794] DAMAGECOUNT value on done: 142962.0 [2024-08-06 00:44:08,085][52794] Sum rewards: 71.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.284', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 00:44:08,276][52660] DAMAGECOUNT value on done: 134293.0 [2024-08-06 00:44:08,278][52660] Sum rewards: 57.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.214', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.214', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '51.000'} [2024-08-06 00:44:08,633][52650] Updated weights for policy 0, policy_version 24941 (0.0035) [2024-08-06 00:44:08,853][52647] DAMAGECOUNT value on done: 143555.0 [2024-08-06 00:44:08,853][52647] Sum rewards: 57.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.842', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon4': '0.042', 'AMMO4': '0.137', 'weapon5': '0.196', 'AMMO3': '0.206', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:08,912][52668] DAMAGECOUNT value on done: 126332.0 [2024-08-06 00:44:08,914][52668] Sum rewards: 50.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.837', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '2.940', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:09,358][52664] DAMAGECOUNT value on done: 137626.0 [2024-08-06 00:44:09,360][52664] Sum rewards: 52.898, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.096', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.336', 'weapon2': '0.790', 'WEAPON3': '0.950', 'weapon3': '2.548', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:09,916][52662] DAMAGECOUNT value on done: 137148.0 [2024-08-06 00:44:09,917][52662] Sum rewards: 56.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.820', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'AMMO3': '0.286', 'weapon2': '0.336', 'WEAPON3': '1.850', 'HITCOUNT': '3.170', 'weapon3': '3.318', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:10,545][52667] DAMAGECOUNT value on done: 134533.0 [2024-08-06 00:44:10,546][52667] Sum rewards: 48.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.415', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.176', 'weapon5': '0.180', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.376', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '40.000'} [2024-08-06 00:44:11,106][52794] DAMAGECOUNT value on done: 136537.0 [2024-08-06 00:44:11,106][52794] Sum rewards: 53.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.123', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.758', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:11,110][52669] DAMAGECOUNT value on done: 138439.0 [2024-08-06 00:44:11,110][52669] Sum rewards: 56.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.399', 'AMMO5': '0.010', 'weapon5': '0.034', 'AMMO2': '0.043', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.280', 'WEAPON4': '0.450', 'weapon2': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:11,286][52660] DAMAGECOUNT value on done: 133484.0 [2024-08-06 00:44:11,287][52660] Sum rewards: 62.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.382', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '52.500'} [2024-08-06 00:44:11,342][52647] DAMAGECOUNT value on done: 145524.0 [2024-08-06 00:44:11,342][52647] Sum rewards: 63.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.706', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.474', 'WEAPON3': '1.500', 'weapon3': '2.926', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '54.000'} [2024-08-06 00:44:11,738][52668] DAMAGECOUNT value on done: 132745.0 [2024-08-06 00:44:11,740][52668] Sum rewards: 50.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.842', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.048', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.238', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon2': '1.000', 'weapon3': '2.418', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:12,106][52664] DAMAGECOUNT value on done: 142642.0 [2024-08-06 00:44:12,106][52664] Sum rewards: 51.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.604', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.151', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.276', 'weapon2': '0.608', 'WEAPON4': '0.700', 'weapon4': '0.748', 'WEAPON3': '0.950', 'weapon3': '2.244', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '42.000'} [2024-08-06 00:44:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 204390400. Throughput: 0: 4394.7. Samples: 51105230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:44:12,802][52567] Avg episode reward: [(0, '55.803')] [2024-08-06 00:44:12,829][52662] DAMAGECOUNT value on done: 137550.0 [2024-08-06 00:44:12,829][52662] Sum rewards: 63.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.255', 'weapon4': '0.278', 'WEAPON3': '1.500', 'weapon3': '3.322', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '55.000'} [2024-08-06 00:44:13,370][52650] Updated weights for policy 0, policy_version 24951 (0.0026) [2024-08-06 00:44:13,594][52660] DAMAGECOUNT value on done: 134837.0 [2024-08-06 00:44:13,595][52660] Sum rewards: 66.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.482', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon4': '0.272', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '58.000'} [2024-08-06 00:44:13,668][52667] DAMAGECOUNT value on done: 132508.0 [2024-08-06 00:44:13,668][52667] Sum rewards: 54.783, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.340', 'AMMO5': '0.013', 'weapon7': '0.042', 'weapon5': '0.044', 'AMMO2': '0.059', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'AMMO4': '0.297', 'weapon4': '0.338', 'weapon2': '0.536', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.734', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:13,834][52794] DAMAGECOUNT value on done: 139653.0 [2024-08-06 00:44:13,835][52794] Sum rewards: 66.102, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.481', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.243', 'weapon2': '0.296', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.432', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '58.000'} [2024-08-06 00:44:14,245][52669] DAMAGECOUNT value on done: 134091.0 [2024-08-06 00:44:14,247][52669] Sum rewards: 50.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.642', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.038', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'AMMO4': '0.208', 'weapon4': '0.278', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '3.172', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:14,280][52647] DAMAGECOUNT value on done: 143404.0 [2024-08-06 00:44:14,280][52647] Sum rewards: 46.138, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.784', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.221', 'AMMO3': '0.247', 'weapon2': '0.410', 'weapon4': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.792', 'DAMAGECOUNT': '12.528', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:14,502][52668] DAMAGECOUNT value on done: 131287.0 [2024-08-06 00:44:14,502][52668] Sum rewards: 59.614, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'HEALTH': '0.126', 'weapon5': '0.154', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.596', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:15,139][52664] DAMAGECOUNT value on done: 140901.0 [2024-08-06 00:44:15,140][52664] Sum rewards: 63.940, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.060', 'AMMO4': '0.154', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '55.000'} [2024-08-06 00:44:15,705][52662] DAMAGECOUNT value on done: 136604.0 [2024-08-06 00:44:15,708][52662] Sum rewards: 58.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.458', 'weapon2': '0.620', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:16,200][52667] DAMAGECOUNT value on done: 136733.0 [2024-08-06 00:44:16,202][52667] Sum rewards: 65.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.248', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.198', 'AMMO4': '0.199', 'weapon2': '0.234', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '54.000'} [2024-08-06 00:44:16,794][52660] DAMAGECOUNT value on done: 137204.0 [2024-08-06 00:44:16,795][52660] Sum rewards: 56.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.064', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'weapon4': '0.172', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:17,025][52794] DAMAGECOUNT value on done: 144561.0 [2024-08-06 00:44:17,025][52794] Sum rewards: 62.401, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.085', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.076', 'weapon4': '0.162', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.600', 'weapon3': '3.322', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '57.000'} [2024-08-06 00:44:17,131][52647] DAMAGECOUNT value on done: 140736.0 [2024-08-06 00:44:17,132][52647] Sum rewards: 65.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.445', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.201', 'weapon4': '0.234', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '56.000'} [2024-08-06 00:44:17,513][52668] DAMAGECOUNT value on done: 136305.0 [2024-08-06 00:44:17,517][52668] Sum rewards: 66.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.792', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.213', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '54.000'} [2024-08-06 00:44:17,586][52650] Updated weights for policy 0, policy_version 24961 (0.0014) [2024-08-06 00:44:17,666][52669] DAMAGECOUNT value on done: 133498.0 [2024-08-06 00:44:17,666][52669] Sum rewards: 48.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.968', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.053', 'weapon5': '0.118', 'weapon4': '0.166', 'AMMO3': '0.167', 'AMMO4': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.760', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '40.000'} [2024-08-06 00:44:17,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 204480512. Throughput: 0: 4390.9. Samples: 51118160. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 00:44:17,794][52567] Avg episode reward: [(0, '56.210')] [2024-08-06 00:44:18,024][52664] DAMAGECOUNT value on done: 132389.0 [2024-08-06 00:44:18,025][52664] Sum rewards: 50.337, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.502', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.146', 'AMMO4': '0.161', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon2': '0.506', 'weapon4': '0.702', 'WEAPON3': '0.800', 'weapon3': '2.238', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '40.500'} [2024-08-06 00:44:18,883][52662] DAMAGECOUNT value on done: 142052.0 [2024-08-06 00:44:18,884][52662] Sum rewards: 50.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.830', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.138', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon4': '1.098', 'weapon3': '2.074', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:18,992][52667] DAMAGECOUNT value on done: 133227.0 [2024-08-06 00:44:18,992][52667] Sum rewards: 60.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.679', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:19,835][52660] DAMAGECOUNT value on done: 129384.0 [2024-08-06 00:44:19,835][52660] Sum rewards: 63.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.129', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.068', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'weapon2': '0.578', 'weapon4': '0.578', 'WEAPON3': '0.850', 'weapon3': '2.590', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '51.000'} [2024-08-06 00:44:20,154][52794] DAMAGECOUNT value on done: 135382.0 [2024-08-06 00:44:20,154][52794] Sum rewards: 53.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.190', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.712', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '2.922', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:20,159][52647] DAMAGECOUNT value on done: 142450.0 [2024-08-06 00:44:20,160][52647] Sum rewards: 49.073, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.388', 'AMMO5': '0.003', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.260', 'AMMO3': '0.263', 'weapon2': '0.404', 'WEAPON3': '1.650', 'weapon3': '3.134', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:20,295][52669] DAMAGECOUNT value on done: 132360.0 [2024-08-06 00:44:20,295][52669] Sum rewards: 51.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.344', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.524', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:20,407][52668] DAMAGECOUNT value on done: 133414.0 [2024-08-06 00:44:20,408][52668] Sum rewards: 64.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.591', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.332', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '54.000'} [2024-08-06 00:44:21,192][52664] DAMAGECOUNT value on done: 147383.0 [2024-08-06 00:44:21,192][52664] Sum rewards: 66.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.639', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.142', 'weapon4': '0.154', 'AMMO3': '0.165', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '0.950', 'weapon3': '2.882', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '53.500'} [2024-08-06 00:44:21,626][52667] DAMAGECOUNT value on done: 134377.0 [2024-08-06 00:44:21,627][52667] Sum rewards: 51.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.026', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:22,080][52662] DAMAGECOUNT value on done: 132593.0 [2024-08-06 00:44:22,080][52662] Sum rewards: 51.535, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.036', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.215', 'weapon2': '0.690', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:22,671][52669] DAMAGECOUNT value on done: 134181.0 [2024-08-06 00:44:22,671][52669] Sum rewards: 53.173, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.216', 'AMMO3': '0.253', 'weapon2': '0.356', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.870', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '47.500'} [2024-08-06 00:44:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 204554240. Throughput: 0: 4374.0. Samples: 51144140. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 00:44:22,802][52567] Avg episode reward: [(0, '56.217')] [2024-08-06 00:44:22,827][52660] DAMAGECOUNT value on done: 132774.0 [2024-08-06 00:44:22,829][52660] Sum rewards: 66.350, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.392', 'weapon4': '0.584', 'WEAPON3': '1.450', 'weapon3': '2.732', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '55.000'} [2024-08-06 00:44:22,949][52650] Updated weights for policy 0, policy_version 24971 (0.0025) [2024-08-06 00:44:22,984][52647] DAMAGECOUNT value on done: 143464.0 [2024-08-06 00:44:22,985][52647] Sum rewards: 45.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.253', 'AMMO5': '0.005', 'AMMO2': '0.055', 'AMMO3': '0.183', 'AMMO4': '0.273', 'WEAPON4': '0.450', 'weapon2': '0.518', 'weapon4': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.562', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.391', 'FRAGCOUNT': '40.000'} [2024-08-06 00:44:23,439][52794] DAMAGECOUNT value on done: 139773.0 [2024-08-06 00:44:23,440][52794] Sum rewards: 50.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.396', 'AMMO5': '0.003', 'AMMO2': '0.031', 'ARMOR': '0.032', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.206', 'weapon4': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:23,563][52668] DAMAGECOUNT value on done: 134673.0 [2024-08-06 00:44:23,565][52668] Sum rewards: 53.989, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.420', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'weapon4': '0.288', 'AMMO3': '0.294', 'weapon2': '0.306', 'WEAPON3': '1.750', 'weapon3': '3.048', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:24,035][52664] DAMAGECOUNT value on done: 143850.0 [2024-08-06 00:44:24,036][52664] Sum rewards: 59.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon2': '0.396', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.430', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '53.000'} [2024-08-06 00:44:24,440][52667] DAMAGECOUNT value on done: 137045.0 [2024-08-06 00:44:24,441][52667] Sum rewards: 69.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.809', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '59.000'} [2024-08-06 00:44:25,124][52662] DAMAGECOUNT value on done: 138501.0 [2024-08-06 00:44:25,127][52662] Sum rewards: 58.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.919', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.169', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.852', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:25,510][52660] DAMAGECOUNT value on done: 136673.0 [2024-08-06 00:44:25,512][52660] Sum rewards: 64.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.238', 'weapon2': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.314', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '55.000'} [2024-08-06 00:44:25,575][52647] DAMAGECOUNT value on done: 138810.0 [2024-08-06 00:44:25,576][52647] Sum rewards: 52.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.142', 'AMMO3': '0.193', 'weapon2': '0.328', 'WEAPON4': '0.450', 'weapon4': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:25,708][52669] DAMAGECOUNT value on done: 133406.0 [2024-08-06 00:44:25,709][52669] Sum rewards: 59.201, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.141', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.256', 'HEALTH': '0.391', 'weapon2': '0.568', 'WEAPON3': '0.850', 'weapon3': '2.886', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '47.500'} [2024-08-06 00:44:26,030][52668] DAMAGECOUNT value on done: 137199.0 [2024-08-06 00:44:26,035][52668] Sum rewards: 50.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.506', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.222', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON4': '0.400', 'weapon4': '0.560', 'WEAPON3': '1.550', 'weapon3': '2.618', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:26,350][52794] DAMAGECOUNT value on done: 137217.0 [2024-08-06 00:44:26,351][52794] Sum rewards: 64.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.894', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon2': '0.268', 'weapon4': '0.298', 'WEAPON3': '1.000', 'weapon3': '3.322', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:26,759][52664] DAMAGECOUNT value on done: 141953.0 [2024-08-06 00:44:26,760][52664] Sum rewards: 48.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.058', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'AMMO4': '0.291', 'weapon2': '0.470', 'WEAPON4': '0.550', 'weapon4': '0.694', 'WEAPON3': '1.250', 'weapon3': '2.336', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:27,080][52650] Updated weights for policy 0, policy_version 24981 (0.0012) [2024-08-06 00:44:27,549][52667] DAMAGECOUNT value on done: 135321.0 [2024-08-06 00:44:27,550][52667] Sum rewards: 51.087, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.140', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'weapon4': '0.226', 'AMMO3': '0.259', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 204652544. Throughput: 0: 4366.4. Samples: 51170230. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 00:44:27,794][52567] Avg episode reward: [(0, '56.210')] [2024-08-06 00:44:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024982_204652544.pth... [2024-08-06 00:44:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024467_200433664.pth [2024-08-06 00:44:28,006][52662] DAMAGECOUNT value on done: 134782.0 [2024-08-06 00:44:28,006][52662] Sum rewards: 47.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.714', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.212', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '3.316', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '42.000'} [2024-08-06 00:44:28,605][52669] DAMAGECOUNT value on done: 134692.0 [2024-08-06 00:44:28,605][52669] Sum rewards: 56.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.932', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.024', 'AMMO2': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.294', 'weapon4': '0.570', 'WEAPON4': '0.600', 'weapon2': '0.766', 'WEAPON3': '0.950', 'weapon3': '2.436', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:28,640][52660] DAMAGECOUNT value on done: 142909.0 [2024-08-06 00:44:28,642][52660] Sum rewards: 54.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.498', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.216', 'AMMO3': '0.217', 'weapon2': '0.226', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.318', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:28,777][52647] DAMAGECOUNT value on done: 138545.0 [2024-08-06 00:44:28,777][52647] Sum rewards: 39.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.894', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.072', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon4': '0.490', 'weapon2': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.480', 'weapon3': '2.714', 'DAMAGECOUNT': '12.294', 'FRAGCOUNT': '37.500'} [2024-08-06 00:44:28,851][52794] DAMAGECOUNT value on done: 146933.0 [2024-08-06 00:44:28,853][52794] Sum rewards: 61.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.154', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:29,124][52668] DAMAGECOUNT value on done: 135934.0 [2024-08-06 00:44:29,124][52668] Sum rewards: 63.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.270', 'weapon4': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '54.000'} [2024-08-06 00:44:29,667][52664] DAMAGECOUNT value on done: 138705.0 [2024-08-06 00:44:29,667][52664] Sum rewards: 58.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.384', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:30,694][52667] DAMAGECOUNT value on done: 133546.0 [2024-08-06 00:44:30,694][52667] Sum rewards: 54.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.022', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.167', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.728', 'WEAPON3': '1.450', 'weapon3': '2.566', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '49.500'} [2024-08-06 00:44:30,732][52662] DAMAGECOUNT value on done: 135882.0 [2024-08-06 00:44:30,734][52662] Sum rewards: 53.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.164', 'AMMO5': '0.003', 'AMMO2': '0.048', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'AMMO4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.386', 'weapon4': '0.584', 'WEAPON3': '1.550', 'weapon3': '2.656', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '47.000'} [2024-08-06 00:44:31,372][52660] DAMAGECOUNT value on done: 132207.0 [2024-08-06 00:44:31,374][52660] Sum rewards: 53.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.984', 'ARMOR': '0.004', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.228', 'weapon2': '0.504', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '47.000'} [2024-08-06 00:44:31,399][52647] DAMAGECOUNT value on done: 137304.0 [2024-08-06 00:44:31,399][52647] Sum rewards: 50.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.477', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.198', 'AMMO3': '0.220', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.000', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:31,762][52669] DAMAGECOUNT value on done: 135198.0 [2024-08-06 00:44:31,764][52669] Sum rewards: 61.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '54.000'} [2024-08-06 00:44:31,931][52794] DAMAGECOUNT value on done: 132134.0 [2024-08-06 00:44:31,931][52794] Sum rewards: 62.370, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.690', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.051', 'weapon5': '0.054', 'WEAPON5': '0.200', 'AMMO4': '0.257', 'AMMO3': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.096', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '57.000'} [2024-08-06 00:44:31,966][52650] Updated weights for policy 0, policy_version 24991 (0.0015) [2024-08-06 00:44:32,490][52664] DAMAGECOUNT value on done: 136994.0 [2024-08-06 00:44:32,491][52664] Sum rewards: 45.127, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.066', 'WEAPON5': '0.150', 'weapon4': '0.244', 'AMMO3': '0.249', 'AMMO4': '0.261', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '40.000'} [2024-08-06 00:44:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 204734464. Throughput: 0: 4368.7. Samples: 51183270. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 00:44:32,794][52567] Avg episode reward: [(0, '56.648')] [2024-08-06 00:44:33,105][52614] Signal inference workers to stop experience collection... (4600 times) [2024-08-06 00:44:33,105][52614] Signal inference workers to resume experience collection... (4600 times) [2024-08-06 00:44:33,137][52650] InferenceWorker_p0-w0: stopping experience collection (4600 times) [2024-08-06 00:44:33,137][52650] InferenceWorker_p0-w0: resuming experience collection (4600 times) [2024-08-06 00:44:33,613][52667] DAMAGECOUNT value on done: 137558.0 [2024-08-06 00:44:33,614][52667] Sum rewards: 52.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.177', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.384', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:33,848][52660] DAMAGECOUNT value on done: 135781.0 [2024-08-06 00:44:33,850][52660] Sum rewards: 47.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'weapon2': '0.428', 'weapon4': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.652', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '39.000'} [2024-08-06 00:44:34,336][52647] DAMAGECOUNT value on done: 141138.0 [2024-08-06 00:44:34,337][52647] Sum rewards: 51.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon4': '0.126', 'AMMO4': '0.146', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.180', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:34,477][52669] DAMAGECOUNT value on done: 135239.0 [2024-08-06 00:44:34,478][52669] Sum rewards: 53.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.292', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.158', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.256', 'weapon2': '0.332', 'WEAPON4': '0.600', 'weapon4': '0.874', 'WEAPON3': '1.100', 'weapon3': '2.288', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '47.000'} [2024-08-06 00:44:34,827][52794] DAMAGECOUNT value on done: 143279.0 [2024-08-06 00:44:34,831][52794] Sum rewards: 65.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.372', 'AMMO5': '0.008', 'AMMO2': '0.015', 'ARMOR': '0.032', 'AMMO4': '0.077', 'weapon5': '0.144', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.276', 'weapon4': '0.428', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:35,490][52664] DAMAGECOUNT value on done: 139781.0 [2024-08-06 00:44:35,490][52664] Sum rewards: 57.212, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '1.000', 'WEAPON3': '1.250', 'weapon3': '2.498', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:36,622][52667] DAMAGECOUNT value on done: 131532.0 [2024-08-06 00:44:36,623][52667] Sum rewards: 41.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.216', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.133', 'weapon5': '0.146', 'weapon7': '0.170', 'AMMO6': '0.220', 'AMMO7': '0.220', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON7': '0.300', 'weapon2': '0.412', 'WEAPON4': '0.700', 'WEAPON3': '0.750', 'weapon4': '1.180', 'weapon3': '1.842', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '10.245', 'FRAGCOUNT': '34.500'} [2024-08-06 00:44:36,847][52650] Updated weights for policy 0, policy_version 25001 (0.0013) [2024-08-06 00:44:36,953][52660] DAMAGECOUNT value on done: 130722.0 [2024-08-06 00:44:36,953][52660] Sum rewards: 68.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.280', 'weapon4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.034', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '59.000'} [2024-08-06 00:44:36,994][52647] DAMAGECOUNT value on done: 135803.0 [2024-08-06 00:44:36,994][52647] Sum rewards: 39.689, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.184', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '2.864', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '37.000'} [2024-08-06 00:44:37,438][52669] DAMAGECOUNT value on done: 132037.0 [2024-08-06 00:44:37,440][52669] Sum rewards: 44.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.207', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.151', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.648', 'weapon4': '0.662', 'WEAPON3': '0.900', 'weapon3': '2.386', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '37.000'} [2024-08-06 00:44:37,675][52794] DAMAGECOUNT value on done: 138165.0 [2024-08-06 00:44:37,676][52794] Sum rewards: 51.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.587', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '2.962', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '45.000'} [2024-08-06 00:44:37,769][52649] DAMAGECOUNT value on done: 131303.0 [2024-08-06 00:44:37,770][52649] Sum rewards: 73.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.049', 'weapon4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '61.000'} [2024-08-06 00:44:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 204824576. Throughput: 0: 4369.6. Samples: 51209700. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:44:37,794][52567] Avg episode reward: [(0, '56.322')] [2024-08-06 00:44:38,005][52658] DAMAGECOUNT value on done: 138089.0 [2024-08-06 00:44:38,006][52658] Sum rewards: 47.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.312', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.240', 'weapon2': '0.812', 'WEAPON3': '1.500', 'weapon3': '2.706', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '43.500'} [2024-08-06 00:44:38,233][52664] DAMAGECOUNT value on done: 142049.0 [2024-08-06 00:44:38,234][52664] Sum rewards: 62.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.135', 'ARMOR': '0.024', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.202', 'weapon4': '0.420', 'WEAPON4': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '53.000'} [2024-08-06 00:44:39,694][52667] DAMAGECOUNT value on done: 138022.0 [2024-08-06 00:44:39,694][52667] Sum rewards: 56.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.642', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO4': '0.107', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.294', 'weapon4': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.734', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '47.500'} [2024-08-06 00:44:39,726][52669] DAMAGECOUNT value on done: 137135.0 [2024-08-06 00:44:39,729][52669] Sum rewards: 48.932, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.112', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '0.600', 'HEALTH': '0.947', 'weapon4': '1.132', 'weapon3': '2.240', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '39.000'} [2024-08-06 00:44:39,746][52647] DAMAGECOUNT value on done: 140594.0 [2024-08-06 00:44:39,747][52647] Sum rewards: 40.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.362', 'weapon4': '0.738', 'WEAPON3': '1.050', 'weapon3': '1.870', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '9.795', 'FRAGCOUNT': '36.000'} [2024-08-06 00:44:40,197][52660] DAMAGECOUNT value on done: 137967.0 [2024-08-06 00:44:40,198][52660] Sum rewards: 60.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.894', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.160', 'AMMO3': '0.222', 'weapon4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '51.000'} [2024-08-06 00:44:40,247][52795] DAMAGECOUNT value on done: 124393.0 [2024-08-06 00:44:40,249][52795] Sum rewards: 65.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.052', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2024-08-06 00:44:40,541][52794] DAMAGECOUNT value on done: 137402.0 [2024-08-06 00:44:40,542][52794] Sum rewards: 54.661, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.585', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.012', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.129', 'AMMO4': '0.179', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.990', 'weapon3': '2.290', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.648', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:40,777][52664] DAMAGECOUNT value on done: 138421.0 [2024-08-06 00:44:40,778][52664] Sum rewards: 72.606, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.119', 'HEALTH': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.284', 'weapon4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '59.000'} [2024-08-06 00:44:40,936][52649] DAMAGECOUNT value on done: 129660.0 [2024-08-06 00:44:40,937][52649] Sum rewards: 55.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.086', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.199', 'AMMO4': '0.237', 'weapon4': '0.352', 'WEAPON4': '0.500', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:41,009][52658] DAMAGECOUNT value on done: 135454.0 [2024-08-06 00:44:41,011][52658] Sum rewards: 46.529, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.356', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon5': '0.176', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'AMMO4': '0.289', 'weapon2': '0.508', 'WEAPON4': '0.700', 'weapon4': '0.770', 'WEAPON3': '1.150', 'weapon3': '2.278', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '42.000'} [2024-08-06 00:44:41,548][52650] Updated weights for policy 0, policy_version 25011 (0.0015) [2024-08-06 00:44:42,146][52647] DAMAGECOUNT value on done: 142688.0 [2024-08-06 00:44:42,147][52647] Sum rewards: 58.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.278', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.286', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:42,299][52667] DAMAGECOUNT value on done: 143533.0 [2024-08-06 00:44:42,300][52667] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.118', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.158', 'AMMO4': '0.167', 'weapon4': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.812', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '56.000'} [2024-08-06 00:44:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 204914688. Throughput: 0: 4373.6. Samples: 51235890. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:44:42,794][52567] Avg episode reward: [(0, '56.438')] [2024-08-06 00:44:42,821][52669] DAMAGECOUNT value on done: 137207.0 [2024-08-06 00:44:42,822][52669] Sum rewards: 48.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.028', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.678', 'weapon2': '0.738', 'WEAPON3': '1.200', 'weapon3': '2.360', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:43,240][52660] DAMAGECOUNT value on done: 131945.0 [2024-08-06 00:44:43,240][52660] Sum rewards: 61.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.855', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.496', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '53.000'} [2024-08-06 00:44:43,279][52794] DAMAGECOUNT value on done: 144328.0 [2024-08-06 00:44:43,280][52794] Sum rewards: 50.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.413', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.170', 'weapon4': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.708', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '2.816', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:43,284][52664] DAMAGECOUNT value on done: 139262.0 [2024-08-06 00:44:43,284][52664] Sum rewards: 59.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'weapon5': '0.018', 'AMMO2': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.299', 'weapon2': '0.466', 'WEAPON4': '0.750', 'weapon4': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.416', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:43,407][52795] DAMAGECOUNT value on done: 121536.0 [2024-08-06 00:44:43,411][52795] Sum rewards: 54.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.785', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.160', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '44.000'} [2024-08-06 00:44:43,415][52658] DAMAGECOUNT value on done: 137182.0 [2024-08-06 00:44:43,415][52658] Sum rewards: 57.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.559', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon4': '0.096', 'AMMO4': '0.096', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.376', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:44,176][52649] DAMAGECOUNT value on done: 131067.0 [2024-08-06 00:44:44,177][52649] Sum rewards: 41.283, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.134', 'AMMO5': '0.007', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.217', 'weapon4': '0.464', 'WEAPON4': '0.550', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.726', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '36.000'} [2024-08-06 00:44:44,518][52647] DAMAGECOUNT value on done: 136050.0 [2024-08-06 00:44:44,519][52647] Sum rewards: 45.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.064', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.178', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '38.000'} [2024-08-06 00:44:44,845][52667] DAMAGECOUNT value on done: 139417.0 [2024-08-06 00:44:44,846][52667] Sum rewards: 66.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.770', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.344', 'weapon4': '0.414', 'WEAPON3': '1.700', 'weapon3': '2.844', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '59.000'} [2024-08-06 00:44:45,805][52669] DAMAGECOUNT value on done: 133215.0 [2024-08-06 00:44:45,807][52669] Sum rewards: 57.986, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.053', 'weapon5': '0.100', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.263', 'weapon4': '0.546', 'weapon2': '0.636', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.502', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:45,820][52664] DAMAGECOUNT value on done: 141515.0 [2024-08-06 00:44:45,820][52664] Sum rewards: 60.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:45,939][52650] Updated weights for policy 0, policy_version 25021 (0.0011) [2024-08-06 00:44:46,220][52658] DAMAGECOUNT value on done: 138318.0 [2024-08-06 00:44:46,220][52658] Sum rewards: 60.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.229', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '53.000'} [2024-08-06 00:44:46,272][52794] DAMAGECOUNT value on done: 140073.0 [2024-08-06 00:44:46,273][52794] Sum rewards: 79.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.935', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.195', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.464', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '64.500'} [2024-08-06 00:44:46,488][52795] DAMAGECOUNT value on done: 122535.0 [2024-08-06 00:44:46,489][52795] Sum rewards: 46.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon4': '0.484', 'weapon2': '0.578', 'WEAPON3': '1.500', 'weapon3': '2.612', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '42.000'} [2024-08-06 00:44:47,045][52647] DAMAGECOUNT value on done: 140312.0 [2024-08-06 00:44:47,045][52647] Sum rewards: 49.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.570', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'weapon4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.478', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.268', 'DAMAGECOUNT': '12.345', 'FRAGCOUNT': '43.000'} [2024-08-06 00:44:47,271][52649] DAMAGECOUNT value on done: 132205.0 [2024-08-06 00:44:47,283][52649] Sum rewards: 60.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.189', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon4': '0.458', 'weapon2': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '50.000'} [2024-08-06 00:44:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 205004800. Throughput: 0: 4372.7. Samples: 51249210. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 00:44:47,794][52567] Avg episode reward: [(0, '56.326')] [2024-08-06 00:44:47,958][52667] DAMAGECOUNT value on done: 142222.0 [2024-08-06 00:44:47,960][52667] Sum rewards: 54.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.987', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.658', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:48,231][52669] DAMAGECOUNT value on done: 135274.0 [2024-08-06 00:44:48,231][52669] Sum rewards: 43.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.918', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'weapon4': '0.216', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.780', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '38.000'} [2024-08-06 00:44:48,416][52664] DAMAGECOUNT value on done: 137131.0 [2024-08-06 00:44:48,418][52664] Sum rewards: 56.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.012', 'AMMO4': '0.019', 'weapon5': '0.060', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.362', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:49,329][52658] DAMAGECOUNT value on done: 139414.0 [2024-08-06 00:44:49,331][52658] Sum rewards: 56.116, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.146', 'WEAPON4': '0.400', 'weapon2': '0.432', 'ARMOR': '0.481', 'weapon4': '0.686', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '46.000'} [2024-08-06 00:44:49,582][52795] DAMAGECOUNT value on done: 122994.0 [2024-08-06 00:44:49,584][52795] Sum rewards: 58.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.134', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:49,833][52647] DAMAGECOUNT value on done: 135503.0 [2024-08-06 00:44:49,833][52647] Sum rewards: 58.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.942', 'ARMOR': '0.004', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.192', 'weapon4': '0.230', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:49,992][52649] DAMAGECOUNT value on done: 125490.0 [2024-08-06 00:44:49,992][52649] Sum rewards: 58.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:50,434][52650] Updated weights for policy 0, policy_version 25031 (0.0014) [2024-08-06 00:44:50,824][52667] DAMAGECOUNT value on done: 132893.0 [2024-08-06 00:44:50,824][52667] Sum rewards: 64.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.879', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.236', 'weapon2': '0.346', 'WEAPON3': '1.350', 'HITCOUNT': '3.370', 'weapon3': '3.388', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '54.000'} [2024-08-06 00:44:51,247][52669] DAMAGECOUNT value on done: 141797.0 [2024-08-06 00:44:51,247][52669] Sum rewards: 56.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.216', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:51,287][52664] DAMAGECOUNT value on done: 140164.0 [2024-08-06 00:44:51,288][52664] Sum rewards: 61.533, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.908', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.196', 'AMMO4': '0.205', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON4': '0.550', 'weapon4': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.534', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:52,111][52658] DAMAGECOUNT value on done: 132083.0 [2024-08-06 00:44:52,113][52658] Sum rewards: 54.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.230', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.630', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '47.000'} [2024-08-06 00:44:52,610][52795] DAMAGECOUNT value on done: 126214.0 [2024-08-06 00:44:52,611][52795] Sum rewards: 47.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.905', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.085', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.738', 'WEAPON3': '1.100', 'weapon3': '2.738', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '41.000'} [2024-08-06 00:44:52,718][52647] DAMAGECOUNT value on done: 141178.0 [2024-08-06 00:44:52,720][52647] Sum rewards: 65.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.360', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '56.000'} [2024-08-06 00:44:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 205086720. Throughput: 0: 4378.2. Samples: 51275900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:44:52,794][52567] Avg episode reward: [(0, '56.109')] [2024-08-06 00:44:52,901][52649] DAMAGECOUNT value on done: 129287.0 [2024-08-06 00:44:52,903][52649] Sum rewards: 40.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.752', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.160', 'AMMO4': '0.194', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.200', 'HITCOUNT': '2.290', 'weapon3': '2.752', 'DAMAGECOUNT': '10.950', 'FRAGCOUNT': '36.000'} [2024-08-06 00:44:53,526][52667] DAMAGECOUNT value on done: 140787.0 [2024-08-06 00:44:53,526][52667] Sum rewards: 54.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.076', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '47.000'} [2024-08-06 00:44:53,954][52669] DAMAGECOUNT value on done: 145297.0 [2024-08-06 00:44:53,954][52669] Sum rewards: 58.678, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.528', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.170', 'AMMO4': '0.178', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.392', 'WEAPON4': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.566', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:54,262][52666] DAMAGECOUNT value on done: 136155.0 [2024-08-06 00:44:54,262][52666] Sum rewards: 59.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.446', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.134', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'weapon4': '0.378', 'weapon2': '0.490', 'WEAPON3': '0.900', 'weapon3': '2.930', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '48.000'} [2024-08-06 00:44:54,653][52658] DAMAGECOUNT value on done: 141794.0 [2024-08-06 00:44:54,654][52658] Sum rewards: 59.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.225', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:55,531][52650] Updated weights for policy 0, policy_version 25041 (0.0038) [2024-08-06 00:44:55,727][52795] DAMAGECOUNT value on done: 124423.0 [2024-08-06 00:44:55,728][52795] Sum rewards: 56.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.100', 'AMMO3': '0.217', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.370', 'WEAPON4': '0.450', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.594', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '49.500'} [2024-08-06 00:44:56,080][52649] DAMAGECOUNT value on done: 128195.0 [2024-08-06 00:44:56,080][52649] Sum rewards: 61.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon4': '0.168', 'weapon5': '0.216', 'weapon2': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.100', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '53.000'} [2024-08-06 00:44:56,891][52669] DAMAGECOUNT value on done: 134274.0 [2024-08-06 00:44:56,895][52669] Sum rewards: 50.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.880', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.040', 'AMMO4': '0.115', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.834', 'WEAPON3': '0.950', 'weapon3': '2.564', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '41.000'} [2024-08-06 00:44:56,950][52666] DAMAGECOUNT value on done: 135920.0 [2024-08-06 00:44:56,952][52666] Sum rewards: 66.138, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon4': '0.320', 'weapon2': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '52.000'} [2024-08-06 00:44:57,789][52658] DAMAGECOUNT value on done: 132992.0 [2024-08-06 00:44:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 205176832. Throughput: 0: 4377.1. Samples: 51302200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:44:57,800][52567] Avg episode reward: [(0, '55.930')] [2024-08-06 00:44:57,801][52658] Sum rewards: 60.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.052', 'AMMO4': '0.138', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '49.000'} [2024-08-06 00:44:58,898][52795] DAMAGECOUNT value on done: 128214.0 [2024-08-06 00:44:58,898][52795] Sum rewards: 49.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.198', 'weapon4': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '3.168', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '42.500'} [2024-08-06 00:44:59,194][52649] DAMAGECOUNT value on done: 134940.0 [2024-08-06 00:44:59,194][52649] Sum rewards: 64.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.992', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.560', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '57.000'} [2024-08-06 00:44:59,476][52666] DAMAGECOUNT value on done: 135624.0 [2024-08-06 00:44:59,476][52666] Sum rewards: 51.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.206', 'AMMO3': '0.208', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.382', 'weapon4': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:00,083][52669] DAMAGECOUNT value on done: 136026.0 [2024-08-06 00:45:00,084][52669] Sum rewards: 59.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.831', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.057', 'weapon5': '0.108', 'AMMO3': '0.185', 'AMMO4': '0.287', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.600', 'weapon4': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:00,196][52650] Updated weights for policy 0, policy_version 25051 (0.0011) [2024-08-06 00:45:00,489][52658] DAMAGECOUNT value on done: 139809.0 [2024-08-06 00:45:00,490][52658] Sum rewards: 48.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.153', 'weapon5': '0.194', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon4': '0.960', 'weapon3': '2.096', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '41.500'} [2024-08-06 00:45:02,048][52666] DAMAGECOUNT value on done: 132657.0 [2024-08-06 00:45:02,048][52666] Sum rewards: 58.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.022', 'ARMOR': '0.040', 'AMMO2': '0.041', 'weapon5': '0.134', 'AMMO3': '0.204', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:02,064][52795] DAMAGECOUNT value on done: 127119.0 [2024-08-06 00:45:02,064][52795] Sum rewards: 65.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '54.000'} [2024-08-06 00:45:02,296][52649] DAMAGECOUNT value on done: 128042.0 [2024-08-06 00:45:02,298][52649] Sum rewards: 51.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.964', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon4': '0.126', 'AMMO4': '0.153', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.080', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 205266944. Throughput: 0: 4391.6. Samples: 51315780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:45:02,802][52567] Avg episode reward: [(0, '55.976')] [2024-08-06 00:45:02,827][52670] DAMAGECOUNT value on done: 132211.0 [2024-08-06 00:45:02,829][52670] Sum rewards: 45.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.636', 'AMMO5': '0.005', 'weapon5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.190', 'weapon4': '0.202', 'WEAPON4': '0.400', 'weapon2': '0.822', 'WEAPON3': '1.050', 'weapon3': '2.648', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.847', 'FRAGCOUNT': '40.000'} [2024-08-06 00:45:03,201][52669] DAMAGECOUNT value on done: 137058.0 [2024-08-06 00:45:03,201][52669] Sum rewards: 59.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.543', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.246', 'weapon2': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:03,214][52658] DAMAGECOUNT value on done: 140133.0 [2024-08-06 00:45:03,264][52658] Sum rewards: 62.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:04,476][52650] Updated weights for policy 0, policy_version 25061 (0.0012) [2024-08-06 00:45:04,882][52666] DAMAGECOUNT value on done: 131571.0 [2024-08-06 00:45:04,884][52666] Sum rewards: 46.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.602', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.061', 'weapon5': '0.180', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'AMMO4': '0.304', 'weapon4': '0.460', 'weapon2': '0.494', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.592', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '38.000'} [2024-08-06 00:45:05,108][52795] DAMAGECOUNT value on done: 123438.0 [2024-08-06 00:45:05,108][52795] Sum rewards: 57.387, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.358', 'AMMO5': '0.010', 'AMMO2': '0.016', 'ARMOR': '0.040', 'weapon5': '0.064', 'AMMO4': '0.079', 'AMMO3': '0.141', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.438', 'WEAPON3': '0.950', 'HITCOUNT': '2.770', 'weapon3': '3.000', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:05,235][52649] DAMAGECOUNT value on done: 132123.0 [2024-08-06 00:45:05,238][52649] Sum rewards: 52.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.145', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.354', 'weapon4': '0.792', 'WEAPON3': '0.850', 'weapon3': '2.162', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.066', 'FRAGCOUNT': '43.000'} [2024-08-06 00:45:05,880][52670] DAMAGECOUNT value on done: 137824.0 [2024-08-06 00:45:05,881][52670] Sum rewards: 57.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.652', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.208', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.662', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '46.000'} [2024-08-06 00:45:06,281][52669] DAMAGECOUNT value on done: 138627.0 [2024-08-06 00:45:06,283][52669] Sum rewards: 66.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.316', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.114', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '56.000'} [2024-08-06 00:45:06,506][52658] DAMAGECOUNT value on done: 140940.0 [2024-08-06 00:45:06,508][52658] Sum rewards: 63.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.023', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.044', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.472', 'WEAPON3': '1.550', 'weapon3': '2.940', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '55.000'} [2024-08-06 00:45:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 205357056. Throughput: 0: 4401.8. Samples: 51342220. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:45:07,802][52567] Avg episode reward: [(0, '55.887')] [2024-08-06 00:45:07,918][52666] DAMAGECOUNT value on done: 129836.0 [2024-08-06 00:45:07,920][52666] Sum rewards: 49.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.054', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.206', 'weapon4': '0.362', 'WEAPON4': '0.450', 'weapon2': '0.714', 'WEAPON3': '1.200', 'weapon3': '2.692', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '44.000'} [2024-08-06 00:45:08,170][52795] DAMAGECOUNT value on done: 125962.0 [2024-08-06 00:45:08,171][52795] Sum rewards: 52.482, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.280', 'weapon2': '0.452', 'WEAPON3': '1.750', 'HITCOUNT': '3.090', 'weapon3': '3.126', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:08,331][52649] DAMAGECOUNT value on done: 132405.0 [2024-08-06 00:45:08,332][52649] Sum rewards: 52.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.225', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.206', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.474', 'ARMOR': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:08,796][52670] DAMAGECOUNT value on done: 132050.0 [2024-08-06 00:45:08,799][52670] Sum rewards: 54.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.090', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:09,293][52650] Updated weights for policy 0, policy_version 25071 (0.0020) [2024-08-06 00:45:09,502][52658] DAMAGECOUNT value on done: 132339.0 [2024-08-06 00:45:09,504][52658] Sum rewards: 48.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.848', 'WEAPON3': '1.250', 'weapon3': '2.578', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '11.565', 'FRAGCOUNT': '42.000'} [2024-08-06 00:45:10,846][52666] DAMAGECOUNT value on done: 132296.0 [2024-08-06 00:45:10,848][52666] Sum rewards: 50.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.935', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.076', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.212', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon4': '0.808', 'weapon2': '0.812', 'weapon3': '2.118', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '41.000'} [2024-08-06 00:45:11,275][52649] DAMAGECOUNT value on done: 128795.0 [2024-08-06 00:45:11,275][52649] Sum rewards: 56.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.441', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.088', 'weapon5': '0.140', 'AMMO4': '0.141', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.140', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:11,297][52795] DAMAGECOUNT value on done: 125069.0 [2024-08-06 00:45:11,299][52795] Sum rewards: 57.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.102', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.942', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:11,674][52670] DAMAGECOUNT value on done: 134672.0 [2024-08-06 00:45:11,677][52670] Sum rewards: 52.931, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.124', 'HEALTH': '0.143', 'AMMO4': '0.205', 'weapon5': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '0.700', 'weapon3': '2.638', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '42.000'} [2024-08-06 00:45:12,371][52658] DAMAGECOUNT value on done: 135939.0 [2024-08-06 00:45:12,372][52658] Sum rewards: 53.389, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.754', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.190', 'WEAPON4': '0.400', 'weapon2': '0.526', 'weapon4': '0.584', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '46.000'} [2024-08-06 00:45:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 205438976. Throughput: 0: 4410.4. Samples: 51368700. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:45:12,794][52567] Avg episode reward: [(0, '55.814')] [2024-08-06 00:45:13,552][52650] Updated weights for policy 0, policy_version 25081 (0.0012) [2024-08-06 00:45:13,839][52666] DAMAGECOUNT value on done: 134173.0 [2024-08-06 00:45:13,841][52666] Sum rewards: 48.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.032', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.046', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '42.000'} [2024-08-06 00:45:14,022][52649] DAMAGECOUNT value on done: 135322.0 [2024-08-06 00:45:14,025][52649] Sum rewards: 53.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.054', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.634', 'WEAPON3': '1.450', 'weapon3': '2.646', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '46.000'} [2024-08-06 00:45:14,413][52795] DAMAGECOUNT value on done: 123340.0 [2024-08-06 00:45:14,415][52795] Sum rewards: 56.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.200', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.159', 'weapon4': '0.370', 'WEAPON4': '0.500', 'weapon2': '0.940', 'WEAPON3': '1.000', 'weapon3': '2.458', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:14,717][52670] DAMAGECOUNT value on done: 136748.0 [2024-08-06 00:45:14,719][52670] Sum rewards: 59.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.536', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'AMMO4': '0.244', 'weapon4': '0.444', 'WEAPON4': '0.500', 'weapon2': '0.622', 'WEAPON3': '0.950', 'weapon3': '2.732', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:15,407][52658] DAMAGECOUNT value on done: 135098.0 [2024-08-06 00:45:15,411][52658] Sum rewards: 70.752, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon4': '0.240', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '58.000'} [2024-08-06 00:45:17,000][52666] DAMAGECOUNT value on done: 135579.0 [2024-08-06 00:45:17,000][52666] Sum rewards: 51.900, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.014', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.034', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.218', 'AMMO3': '0.236', 'weapon4': '0.298', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:17,202][52649] DAMAGECOUNT value on done: 134106.0 [2024-08-06 00:45:17,202][52649] Sum rewards: 55.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.055', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'weapon4': '0.484', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.782', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '46.000'} [2024-08-06 00:45:17,522][52795] DAMAGECOUNT value on done: 123303.0 [2024-08-06 00:45:17,524][52795] Sum rewards: 62.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.098', 'AMMO3': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.496', 'weapon2': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.570', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:17,669][52670] DAMAGECOUNT value on done: 136043.0 [2024-08-06 00:45:17,671][52670] Sum rewards: 56.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.218', 'weapon2': '0.812', 'WEAPON3': '1.200', 'weapon3': '2.610', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 205529088. Throughput: 0: 4412.9. Samples: 51381850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:45:17,795][52567] Avg episode reward: [(0, '55.918')] [2024-08-06 00:45:18,477][52658] DAMAGECOUNT value on done: 134755.0 [2024-08-06 00:45:18,477][52658] Sum rewards: 55.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.725', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.244', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:18,622][52650] Updated weights for policy 0, policy_version 25091 (0.0020) [2024-08-06 00:45:19,241][52663] DAMAGECOUNT value on done: 134676.0 [2024-08-06 00:45:19,248][52663] Sum rewards: 48.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '1.008', 'WEAPON3': '1.500', 'weapon3': '2.738', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '44.000'} [2024-08-06 00:45:20,088][52666] DAMAGECOUNT value on done: 134311.0 [2024-08-06 00:45:20,089][52666] Sum rewards: 43.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.909', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.158', 'AMMO3': '0.164', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon2': '0.654', 'weapon4': '0.904', 'WEAPON3': '1.000', 'weapon3': '2.012', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '39.000'} [2024-08-06 00:45:20,154][52649] DAMAGECOUNT value on done: 128083.0 [2024-08-06 00:45:20,154][52649] Sum rewards: 63.605, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.848', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.083', 'AMMO3': '0.170', 'weapon2': '0.678', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.114', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '53.000'} [2024-08-06 00:45:20,554][52795] DAMAGECOUNT value on done: 123958.0 [2024-08-06 00:45:20,554][52795] Sum rewards: 56.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.234', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '48.000'} [2024-08-06 00:45:20,967][52670] DAMAGECOUNT value on done: 130098.0 [2024-08-06 00:45:20,968][52670] Sum rewards: 60.015, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.804', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.083', 'weapon4': '0.134', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.832', 'WEAPON3': '0.900', 'weapon3': '2.790', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:21,174][52658] DAMAGECOUNT value on done: 139407.0 [2024-08-06 00:45:21,176][52658] Sum rewards: 69.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.940', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.223', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '61.000'} [2024-08-06 00:45:21,889][52663] DAMAGECOUNT value on done: 135755.0 [2024-08-06 00:45:21,890][52663] Sum rewards: 48.736, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.000', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon5': '0.206', 'AMMO3': '0.251', 'AMMO4': '0.314', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.816', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 205619200. Throughput: 0: 4421.5. Samples: 51408670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 00:45:22,795][52567] Avg episode reward: [(0, '56.005')] [2024-08-06 00:45:22,939][52650] Updated weights for policy 0, policy_version 25101 (0.0012) [2024-08-06 00:45:23,114][52649] DAMAGECOUNT value on done: 133872.0 [2024-08-06 00:45:23,115][52649] Sum rewards: 52.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon5': '0.034', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.356', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.138', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:23,149][52666] DAMAGECOUNT value on done: 131951.0 [2024-08-06 00:45:23,149][52666] Sum rewards: 44.674, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.498', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.047', 'AMMO3': '0.131', 'weapon5': '0.152', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.028', 'weapon3': '2.132', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '36.000'} [2024-08-06 00:45:23,718][52795] DAMAGECOUNT value on done: 121179.0 [2024-08-06 00:45:23,720][52795] Sum rewards: 53.908, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.012', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.246', 'weapon2': '0.382', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.366', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '48.000'} [2024-08-06 00:45:23,778][52670] DAMAGECOUNT value on done: 133292.0 [2024-08-06 00:45:23,780][52670] Sum rewards: 64.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.742', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.046', 'weapon4': '0.124', 'AMMO4': '0.163', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '54.000'} [2024-08-06 00:45:24,072][52658] DAMAGECOUNT value on done: 139182.0 [2024-08-06 00:45:24,074][52658] Sum rewards: 50.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.682', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.062', 'AMMO2': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.323', 'weapon2': '0.424', 'weapon4': '0.472', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '2.850', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:24,430][52663] DAMAGECOUNT value on done: 136010.0 [2024-08-06 00:45:24,431][52663] Sum rewards: 42.529, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.234', 'ARMOR': '0.012', 'AMMO5': '0.012', 'weapon5': '0.046', 'AMMO2': '0.070', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'AMMO4': '0.348', 'weapon2': '0.482', 'weapon4': '0.740', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.478', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '41.000'} [2024-08-06 00:45:24,792][52671] DAMAGECOUNT value on done: 141626.0 [2024-08-06 00:45:24,794][52671] Sum rewards: 73.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.082', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon2': '0.558', 'WEAPON3': '0.950', 'weapon3': '2.808', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '59.000'} [2024-08-06 00:45:25,798][52666] DAMAGECOUNT value on done: 129965.0 [2024-08-06 00:45:25,801][52666] Sum rewards: 56.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.478', 'AMMO2': '0.027', 'weapon7': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.135', 'WEAPON7': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.472', 'weapon2': '0.498', 'WEAPON3': '1.500', 'weapon3': '2.764', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:26,165][52649] DAMAGECOUNT value on done: 131494.0 [2024-08-06 00:45:26,166][52649] Sum rewards: 54.699, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.995', 'ARMOR': '0.004', 'AMMO2': '0.048', 'AMMO3': '0.236', 'AMMO4': '0.238', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:26,456][52670] DAMAGECOUNT value on done: 129567.0 [2024-08-06 00:45:26,457][52670] Sum rewards: 57.920, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.375', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon2': '0.194', 'AMMO3': '0.267', 'weapon4': '0.352', 'WEAPON3': '1.700', 'weapon3': '3.240', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '53.000'} [2024-08-06 00:45:26,794][52795] DAMAGECOUNT value on done: 127919.0 [2024-08-06 00:45:26,794][52795] Sum rewards: 53.570, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.047', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.236', 'AMMO3': '0.245', 'weapon4': '0.428', 'weapon2': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '47.500'} [2024-08-06 00:45:27,243][52658] DAMAGECOUNT value on done: 132109.0 [2024-08-06 00:45:27,245][52658] Sum rewards: 58.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.664', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.046', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'AMMO4': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.480', 'WEAPON3': '0.900', 'weapon3': '2.976', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:27,346][52663] DAMAGECOUNT value on done: 134509.0 [2024-08-06 00:45:27,346][52663] Sum rewards: 60.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '55.000'} [2024-08-06 00:45:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 205701120. Throughput: 0: 4421.6. Samples: 51434860. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:45:27,802][52567] Avg episode reward: [(0, '56.056')] [2024-08-06 00:45:27,865][52671] DAMAGECOUNT value on done: 135148.0 [2024-08-06 00:45:27,867][52671] Sum rewards: 60.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.254', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.838', 'WEAPON3': '1.300', 'weapon3': '2.252', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:27,878][52650] Updated weights for policy 0, policy_version 25111 (0.0029) [2024-08-06 00:45:28,304][52666] DAMAGECOUNT value on done: 135666.0 [2024-08-06 00:45:28,307][52666] Sum rewards: 69.601, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.158', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.416', 'weapon4': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '57.000'} [2024-08-06 00:45:28,976][52649] DAMAGECOUNT value on done: 136437.0 [2024-08-06 00:45:28,976][52649] Sum rewards: 54.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:29,263][52670] DAMAGECOUNT value on done: 127038.0 [2024-08-06 00:45:29,265][52670] Sum rewards: 58.475, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.036', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.478', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.274', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '48.000'} [2024-08-06 00:45:29,931][52795] DAMAGECOUNT value on done: 127479.0 [2024-08-06 00:45:29,934][52795] Sum rewards: 41.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.152', 'weapon5': '0.168', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.802', 'WEAPON3': '0.900', 'weapon3': '2.554', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.292', 'FRAGCOUNT': '35.000'} [2024-08-06 00:45:30,177][52658] DAMAGECOUNT value on done: 134215.0 [2024-08-06 00:45:30,181][52658] Sum rewards: 57.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.380', 'weapon4': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:30,327][52671] DAMAGECOUNT value on done: 139959.0 [2024-08-06 00:45:30,328][52671] Sum rewards: 61.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.839', 'AMMO5': '0.005', 'AMMO2': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.216', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.446', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '52.000'} [2024-08-06 00:45:30,418][52663] DAMAGECOUNT value on done: 131539.0 [2024-08-06 00:45:30,419][52663] Sum rewards: 58.405, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.568', 'weapon4': '0.608', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:31,479][52666] DAMAGECOUNT value on done: 137066.0 [2024-08-06 00:45:31,479][52666] Sum rewards: 65.738, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.706', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.056', 'AMMO2': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'AMMO4': '0.409', 'weapon2': '0.410', 'weapon4': '0.502', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '56.000'} [2024-08-06 00:45:31,982][52649] DAMAGECOUNT value on done: 134008.0 [2024-08-06 00:45:31,982][52649] Sum rewards: 54.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.048', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.240', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '46.000'} [2024-08-06 00:45:32,377][52670] DAMAGECOUNT value on done: 136882.0 [2024-08-06 00:45:32,377][52670] Sum rewards: 59.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.330', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.210', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 205783040. Throughput: 0: 4417.6. Samples: 51448000. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:45:32,795][52567] Avg episode reward: [(0, '56.447')] [2024-08-06 00:45:32,800][52650] Updated weights for policy 0, policy_version 25121 (0.0013) [2024-08-06 00:45:33,108][52795] DAMAGECOUNT value on done: 122216.0 [2024-08-06 00:45:33,109][52795] Sum rewards: 52.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon5': '0.086', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.410', 'weapon2': '0.902', 'WEAPON3': '1.000', 'weapon3': '2.394', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '44.000'} [2024-08-06 00:45:33,229][52671] DAMAGECOUNT value on done: 134888.0 [2024-08-06 00:45:33,229][52671] Sum rewards: 52.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.258', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.111', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.422', 'weapon4': '0.602', 'WEAPON3': '1.400', 'weapon3': '2.586', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '44.000'} [2024-08-06 00:45:33,261][52658] DAMAGECOUNT value on done: 139690.0 [2024-08-06 00:45:33,262][52658] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.922', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon4': '0.226', 'weapon2': '0.604', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '59.000'} [2024-08-06 00:45:33,292][52663] DAMAGECOUNT value on done: 141539.0 [2024-08-06 00:45:33,292][52663] Sum rewards: 66.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.525', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon4': '0.222', 'weapon2': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.274', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '56.000'} [2024-08-06 00:45:34,562][52666] DAMAGECOUNT value on done: 133710.0 [2024-08-06 00:45:34,565][52666] Sum rewards: 51.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.052', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.197', 'weapon5': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.500', 'weapon4': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.540', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '44.000'} [2024-08-06 00:45:34,629][52649] DAMAGECOUNT value on done: 138853.0 [2024-08-06 00:45:34,630][52649] Sum rewards: 51.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.968', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.155', 'AMMO4': '0.232', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.466', 'weapon4': '0.756', 'WEAPON3': '1.050', 'weapon3': '2.248', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '43.000'} [2024-08-06 00:45:35,449][52670] DAMAGECOUNT value on done: 135097.0 [2024-08-06 00:45:35,449][52670] Sum rewards: 46.639, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.636', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.424', 'weapon2': '0.566', 'WEAPON3': '1.000', 'HITCOUNT': '2.640', 'weapon3': '2.698', 'DAMAGECOUNT': '11.124', 'FRAGCOUNT': '38.000'} [2024-08-06 00:45:35,596][52671] DAMAGECOUNT value on done: 135972.0 [2024-08-06 00:45:35,597][52671] Sum rewards: 53.751, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.404', 'AMMO5': '0.013', 'ARMOR': '0.016', 'weapon5': '0.022', 'AMMO2': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.302', 'WEAPON4': '0.550', 'weapon4': '0.660', 'weapon2': '0.722', 'WEAPON3': '1.150', 'weapon3': '2.344', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:36,131][52795] DAMAGECOUNT value on done: 127997.0 [2024-08-06 00:45:36,133][52795] Sum rewards: 59.806, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.852', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.400', 'weapon2': '0.458', 'weapon4': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.564', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '53.000'} [2024-08-06 00:45:36,758][52663] DAMAGECOUNT value on done: 138610.0 [2024-08-06 00:45:36,758][52663] Sum rewards: 68.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.360', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '56.000'} [2024-08-06 00:45:37,277][52650] Updated weights for policy 0, policy_version 25131 (0.0021) [2024-08-06 00:45:37,355][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:45:37,603][52666] DAMAGECOUNT value on done: 131600.0 [2024-08-06 00:45:37,603][52666] Sum rewards: 59.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.062', 'AMMO3': '0.207', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.374', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:37,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 205889536. Throughput: 0: 4406.4. Samples: 51474190. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:45:37,794][52567] Avg episode reward: [(0, '56.543')] [2024-08-06 00:45:38,180][52671] DAMAGECOUNT value on done: 137278.0 [2024-08-06 00:45:38,181][52671] Sum rewards: 63.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.224', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '53.000'} [2024-08-06 00:45:38,226][52665] DAMAGECOUNT value on done: 132055.0 [2024-08-06 00:45:38,226][52665] Sum rewards: 58.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.483', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.141', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:38,550][52670] DAMAGECOUNT value on done: 134453.0 [2024-08-06 00:45:38,552][52670] Sum rewards: 52.237, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.956', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '2.852', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:39,290][52795] DAMAGECOUNT value on done: 129165.0 [2024-08-06 00:45:39,290][52795] Sum rewards: 64.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.560', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.058', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.334', 'WEAPON3': '1.650', 'weapon3': '3.372', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '57.000'} [2024-08-06 00:45:39,588][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:45:39,768][52663] DAMAGECOUNT value on done: 134077.0 [2024-08-06 00:45:39,768][52663] Sum rewards: 54.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.590', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '48.500'} [2024-08-06 00:45:40,715][52666] DAMAGECOUNT value on done: 133151.0 [2024-08-06 00:45:40,715][52666] Sum rewards: 51.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '43.000'} [2024-08-06 00:45:40,820][52671] DAMAGECOUNT value on done: 137910.0 [2024-08-06 00:45:40,821][52671] Sum rewards: 59.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon4': '0.240', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:41,481][52665] DAMAGECOUNT value on done: 139946.0 [2024-08-06 00:45:41,484][52665] Sum rewards: 49.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon4': '0.292', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.106', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '43.000'} [2024-08-06 00:45:41,634][52650] Updated weights for policy 0, policy_version 25141 (0.0013) [2024-08-06 00:45:41,762][52670] DAMAGECOUNT value on done: 133316.0 [2024-08-06 00:45:41,762][52670] Sum rewards: 45.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.161', 'AMMO4': '0.164', 'WEAPON4': '0.350', 'weapon4': '0.606', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.476', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '38.000'} [2024-08-06 00:45:42,727][52663] DAMAGECOUNT value on done: 136983.0 [2024-08-06 00:45:42,728][52663] Sum rewards: 53.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.668', 'AMMO2': '0.031', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.208', 'weapon2': '0.528', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.186', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '44.000'} [2024-08-06 00:45:42,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 205971456. Throughput: 0: 4412.2. Samples: 51500750. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:45:42,794][52567] Avg episode reward: [(0, '56.283')] [2024-08-06 00:45:43,468][52666] DAMAGECOUNT value on done: 137063.0 [2024-08-06 00:45:43,472][52666] Sum rewards: 57.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.827', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon2': '0.204', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.414', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:43,741][52671] DAMAGECOUNT value on done: 137847.0 [2024-08-06 00:45:43,742][52671] Sum rewards: 55.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.196', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.110', 'weapon5': '0.122', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.380', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.094', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:44,419][52665] DAMAGECOUNT value on done: 133263.0 [2024-08-06 00:45:44,420][52665] Sum rewards: 47.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'weapon7': '0.036', 'AMMO2': '0.051', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.186', 'WEAPON7': '0.200', 'AMMO4': '0.256', 'weapon2': '0.272', 'WEAPON4': '0.550', 'weapon4': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '40.000'} [2024-08-06 00:45:44,547][52670] DAMAGECOUNT value on done: 139507.0 [2024-08-06 00:45:44,550][52670] Sum rewards: 59.789, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.605', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon4': '0.280', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.178', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '52.000'} [2024-08-06 00:45:45,889][52663] DAMAGECOUNT value on done: 138998.0 [2024-08-06 00:45:45,890][52663] Sum rewards: 61.912, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.805', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.338', 'WEAPON4': '0.400', 'weapon4': '0.616', 'WEAPON3': '1.600', 'weapon3': '2.790', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '57.000'} [2024-08-06 00:45:46,253][52671] DAMAGECOUNT value on done: 135379.0 [2024-08-06 00:45:46,254][52671] Sum rewards: 54.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.052', 'AMMO3': '0.198', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:46,416][52650] Updated weights for policy 0, policy_version 25151 (0.0031) [2024-08-06 00:45:46,553][52666] DAMAGECOUNT value on done: 131496.0 [2024-08-06 00:45:46,564][52666] Sum rewards: 44.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.205', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.144', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.714', 'WEAPON3': '1.000', 'HITCOUNT': '2.650', 'weapon3': '2.708', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '37.000'} [2024-08-06 00:45:47,114][52665] DAMAGECOUNT value on done: 130477.0 [2024-08-06 00:45:47,114][52665] Sum rewards: 50.079, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.774', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.152', 'weapon4': '0.246', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.600', 'weapon3': '2.816', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '46.000'} [2024-08-06 00:45:47,509][52670] DAMAGECOUNT value on done: 129310.0 [2024-08-06 00:45:47,509][52670] Sum rewards: 59.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.566', 'weapon4': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.560', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '52.000'} [2024-08-06 00:45:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 206053376. Throughput: 0: 4402.9. Samples: 51513910. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:45:47,795][52567] Avg episode reward: [(0, '56.171')] [2024-08-06 00:45:48,819][52663] DAMAGECOUNT value on done: 137809.0 [2024-08-06 00:45:48,821][52663] Sum rewards: 65.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.998', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.243', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '55.000'} [2024-08-06 00:45:48,863][52671] DAMAGECOUNT value on done: 139164.0 [2024-08-06 00:45:48,863][52671] Sum rewards: 58.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.672', 'AMMO5': '0.003', 'ARMOR': '0.009', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.214', 'weapon4': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:49,285][52666] DAMAGECOUNT value on done: 135330.0 [2024-08-06 00:45:49,286][52666] Sum rewards: 55.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.176', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.988', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:50,160][52659] DAMAGECOUNT value on done: 136800.0 [2024-08-06 00:45:50,161][52659] Sum rewards: 60.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.095', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.408', 'weapon4': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:50,297][52665] DAMAGECOUNT value on done: 132503.0 [2024-08-06 00:45:50,297][52665] Sum rewards: 48.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.716', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.165', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON4': '0.500', 'weapon4': '0.614', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '43.000'} [2024-08-06 00:45:50,416][52670] DAMAGECOUNT value on done: 137650.0 [2024-08-06 00:45:50,416][52670] Sum rewards: 63.683, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon2': '0.346', 'weapon4': '0.424', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:51,153][52650] Updated weights for policy 0, policy_version 25161 (0.0011) [2024-08-06 00:45:51,790][52820] DAMAGECOUNT value on done: 125769.0 [2024-08-06 00:45:51,790][52820] Sum rewards: 63.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.338', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.198', 'weapon2': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.234', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:51,900][52663] DAMAGECOUNT value on done: 134682.0 [2024-08-06 00:45:51,901][52663] Sum rewards: 46.867, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.212', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.175', 'weapon5': '0.198', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.550', 'weapon4': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '41.000'} [2024-08-06 00:45:52,002][52671] DAMAGECOUNT value on done: 137113.0 [2024-08-06 00:45:52,002][52671] Sum rewards: 58.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.430', 'WEAPON3': '1.350', 'weapon3': '2.948', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2024-08-06 00:45:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 206143488. Throughput: 0: 4405.3. Samples: 51540460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:45:52,802][52567] Avg episode reward: [(0, '56.122')] [2024-08-06 00:45:53,266][52665] DAMAGECOUNT value on done: 133648.0 [2024-08-06 00:45:53,266][52665] Sum rewards: 50.232, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'weapon4': '0.202', 'AMMO3': '0.275', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:53,349][52659] DAMAGECOUNT value on done: 135033.0 [2024-08-06 00:45:53,349][52659] Sum rewards: 53.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.277', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:53,575][52670] DAMAGECOUNT value on done: 135709.0 [2024-08-06 00:45:53,576][52670] Sum rewards: 64.443, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.252', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.188', 'weapon2': '0.266', 'weapon4': '0.558', 'WEAPON3': '0.950', 'weapon3': '2.624', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '51.000'} [2024-08-06 00:45:54,871][52820] DAMAGECOUNT value on done: 127510.0 [2024-08-06 00:45:54,871][52820] Sum rewards: 55.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.411', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'AMMO3': '0.241', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.624', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:54,963][52671] DAMAGECOUNT value on done: 136163.0 [2024-08-06 00:45:54,964][52671] Sum rewards: 56.057, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.092', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.052', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.275', 'AMMO4': '0.292', 'weapon2': '0.506', 'weapon4': '0.552', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.584', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '52.000'} [2024-08-06 00:45:55,149][52663] DAMAGECOUNT value on done: 130409.0 [2024-08-06 00:45:55,149][52663] Sum rewards: 53.505, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.237', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon5': '0.234', 'weapon4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.784', 'WEAPON3': '0.850', 'HITCOUNT': '2.410', 'weapon3': '2.482', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '43.000'} [2024-08-06 00:45:55,881][52650] Updated weights for policy 0, policy_version 25171 (0.0021) [2024-08-06 00:45:55,898][52665] DAMAGECOUNT value on done: 135745.0 [2024-08-06 00:45:55,899][52665] Sum rewards: 57.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.685', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.215', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:55,937][52659] DAMAGECOUNT value on done: 135672.0 [2024-08-06 00:45:55,938][52659] Sum rewards: 52.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.846', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '2.978', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '46.000'} [2024-08-06 00:45:56,414][52670] DAMAGECOUNT value on done: 134412.0 [2024-08-06 00:45:56,414][52670] Sum rewards: 49.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.787', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.164', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.766', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:57,450][52671] DAMAGECOUNT value on done: 142299.0 [2024-08-06 00:45:57,450][52671] Sum rewards: 58.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.372', 'weapon4': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '49.000'} [2024-08-06 00:45:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 206233600. Throughput: 0: 4397.3. Samples: 51566580. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:45:57,794][52567] Avg episode reward: [(0, '56.000')] [2024-08-06 00:45:57,944][52820] DAMAGECOUNT value on done: 123116.0 [2024-08-06 00:45:57,948][52820] Sum rewards: 51.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.672', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.510', 'weapon4': '0.512', 'WEAPON3': '1.450', 'weapon3': '2.662', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '45.000'} [2024-08-06 00:45:57,952][52663] DAMAGECOUNT value on done: 133621.0 [2024-08-06 00:45:57,953][52663] Sum rewards: 66.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.917', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '56.000'} [2024-08-06 00:45:58,782][52665] DAMAGECOUNT value on done: 137951.0 [2024-08-06 00:45:58,783][52665] Sum rewards: 52.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.054', 'AMMO3': '0.197', 'AMMO4': '0.245', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '47.000'} [2024-08-06 00:45:58,909][52659] DAMAGECOUNT value on done: 138445.0 [2024-08-06 00:45:58,913][52659] Sum rewards: 63.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.964', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.174', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '53.000'} [2024-08-06 00:45:59,527][52670] DAMAGECOUNT value on done: 133758.0 [2024-08-06 00:45:59,527][52670] Sum rewards: 55.391, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.106', 'AMMO3': '0.148', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.458', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '3.092', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:00,295][52650] Updated weights for policy 0, policy_version 25181 (0.0011) [2024-08-06 00:46:00,579][52671] DAMAGECOUNT value on done: 137763.0 [2024-08-06 00:46:00,580][52671] Sum rewards: 56.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.418', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon7': '0.050', 'weapon5': '0.054', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:00,984][52820] DAMAGECOUNT value on done: 121361.0 [2024-08-06 00:46:00,986][52820] Sum rewards: 59.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.004', 'weapon5': '0.012', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'weapon2': '0.850', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.010', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:01,009][52663] DAMAGECOUNT value on done: 137662.0 [2024-08-06 00:46:01,012][52663] Sum rewards: 56.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.535', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.078', 'weapon4': '0.100', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:01,665][52669] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.002, -2.0), ('weapon5', 0.002)] [2024-08-06 00:46:01,827][52665] DAMAGECOUNT value on done: 141155.0 [2024-08-06 00:46:01,828][52665] Sum rewards: 49.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.005', 'weapon5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon2': '0.220', 'AMMO3': '0.249', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.302', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:02,037][52659] DAMAGECOUNT value on done: 136194.0 [2024-08-06 00:46:02,039][52659] Sum rewards: 50.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.546', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.062', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.244', 'weapon4': '0.394', 'weapon2': '0.502', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.690', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.129', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 206323712. Throughput: 0: 4404.0. Samples: 51580030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:46:02,794][52567] Avg episode reward: [(0, '56.354')] [2024-08-06 00:46:03,706][52663] DAMAGECOUNT value on done: 137493.0 [2024-08-06 00:46:03,707][52663] Sum rewards: 61.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.496', 'weapon2': '0.578', 'WEAPON3': '0.900', 'weapon3': '2.686', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '50.000'} [2024-08-06 00:46:04,016][52671] DAMAGECOUNT value on done: 132433.0 [2024-08-06 00:46:04,020][52671] Sum rewards: 53.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.084', 'AMMO3': '0.145', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.550', 'weapon4': '0.558', 'weapon2': '0.770', 'WEAPON3': '0.850', 'weapon3': '2.386', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '47.000'} [2024-08-06 00:46:04,090][52820] DAMAGECOUNT value on done: 125850.0 [2024-08-06 00:46:04,090][52820] Sum rewards: 49.042, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.550', 'AMMO5': '0.007', 'AMMO2': '0.055', 'weapon5': '0.064', 'WEAPON5': '0.200', 'weapon4': '0.258', 'AMMO3': '0.261', 'AMMO4': '0.273', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.700', 'weapon3': '3.044', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '47.000'} [2024-08-06 00:46:04,921][52650] Updated weights for policy 0, policy_version 25191 (0.0038) [2024-08-06 00:46:04,984][52665] DAMAGECOUNT value on done: 135005.0 [2024-08-06 00:46:04,984][52665] Sum rewards: 48.974, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.322', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'weapon2': '0.322', 'WEAPON3': '1.600', 'HITCOUNT': '2.780', 'weapon3': '3.182', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:05,530][52659] DAMAGECOUNT value on done: 136750.0 [2024-08-06 00:46:05,531][52659] Sum rewards: 57.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.388', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.043', 'AMMO3': '0.192', 'AMMO4': '0.217', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '50.000'} [2024-08-06 00:46:06,674][52663] DAMAGECOUNT value on done: 138797.0 [2024-08-06 00:46:06,674][52663] Sum rewards: 52.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.918', 'ARMOR': '0.008', 'AMMO5': '0.028', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.172', 'AMMO3': '0.176', 'weapon4': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.670', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:07,120][52820] DAMAGECOUNT value on done: 125834.0 [2024-08-06 00:46:07,122][52820] Sum rewards: 57.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.702', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.276', 'weapon4': '0.408', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:07,310][52671] DAMAGECOUNT value on done: 139898.0 [2024-08-06 00:46:07,310][52671] Sum rewards: 54.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.936', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.254', 'weapon4': '0.396', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '2.766', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:07,523][52665] DAMAGECOUNT value on done: 137083.0 [2024-08-06 00:46:07,523][52665] Sum rewards: 49.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.210', 'weapon2': '0.380', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.236', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '41.000'} [2024-08-06 00:46:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 206413824. Throughput: 0: 4392.5. Samples: 51606330. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:46:07,794][52567] Avg episode reward: [(0, '56.067')] [2024-08-06 00:46:08,833][52659] DAMAGECOUNT value on done: 136667.0 [2024-08-06 00:46:08,835][52659] Sum rewards: 37.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.356', 'weapon4': '0.476', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '2.880', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '34.000'} [2024-08-06 00:46:09,597][52650] Updated weights for policy 0, policy_version 25201 (0.0012) [2024-08-06 00:46:09,874][52663] DAMAGECOUNT value on done: 139081.0 [2024-08-06 00:46:09,875][52663] Sum rewards: 58.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.330', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'AMMO4': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.580', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '48.500'} [2024-08-06 00:46:10,012][52665] DAMAGECOUNT value on done: 136858.0 [2024-08-06 00:46:10,013][52665] Sum rewards: 55.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.583', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.058', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.288', 'weapon2': '0.368', 'weapon4': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:10,135][52820] DAMAGECOUNT value on done: 126037.0 [2024-08-06 00:46:10,138][52820] Sum rewards: 58.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.333', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.145', 'AMMO3': '0.205', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '2.944', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:10,593][52671] DAMAGECOUNT value on done: 137205.0 [2024-08-06 00:46:10,593][52671] Sum rewards: 56.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.468', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.164', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:11,106][52803] DAMAGECOUNT value on done: 128581.0 [2024-08-06 00:46:11,106][52803] Sum rewards: 55.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.072', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.636', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.058', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:11,708][52659] DAMAGECOUNT value on done: 131650.0 [2024-08-06 00:46:11,710][52659] Sum rewards: 58.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.274', 'weapon2': '0.314', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '53.000'} [2024-08-06 00:46:12,556][52665] DAMAGECOUNT value on done: 134748.0 [2024-08-06 00:46:12,558][52665] Sum rewards: 55.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.139', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.204', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:12,592][52663] DAMAGECOUNT value on done: 138259.0 [2024-08-06 00:46:12,592][52663] Sum rewards: 58.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.942', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.218', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 206495744. Throughput: 0: 4398.9. Samples: 51632810. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 00:46:12,802][52567] Avg episode reward: [(0, '56.004')] [2024-08-06 00:46:13,339][52820] DAMAGECOUNT value on done: 126546.0 [2024-08-06 00:46:13,341][52820] Sum rewards: 44.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.788', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'weapon5': '0.352', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.280', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '40.500'} [2024-08-06 00:46:13,356][52671] DAMAGECOUNT value on done: 136927.0 [2024-08-06 00:46:13,356][52671] Sum rewards: 40.242, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.572', 'AMMO5': '0.026', 'ARMOR': '0.052', 'AMMO2': '0.081', 'weapon5': '0.202', 'AMMO3': '0.229', 'AMMO4': '0.404', 'WEAPON5': '0.500', 'weapon2': '0.570', 'weapon4': '0.776', 'WEAPON4': '1.050', 'WEAPON3': '1.300', 'weapon3': '2.098', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '41.000'} [2024-08-06 00:46:14,045][52671] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-06 00:46:14,178][52803] DAMAGECOUNT value on done: 132241.0 [2024-08-06 00:46:14,181][52803] Sum rewards: 63.376, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'HEALTH': '0.178', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.604', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '53.000'} [2024-08-06 00:46:14,341][52650] Updated weights for policy 0, policy_version 25211 (0.0038) [2024-08-06 00:46:14,635][52659] DAMAGECOUNT value on done: 138800.0 [2024-08-06 00:46:14,635][52659] Sum rewards: 57.555, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.371', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.012', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon2': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon4': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '53.000'} [2024-08-06 00:46:15,241][52665] DAMAGECOUNT value on done: 134650.0 [2024-08-06 00:46:15,242][52665] Sum rewards: 46.841, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.834', 'ARMOR': '0.016', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.180', 'AMMO3': '0.271', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'weapon4': '0.464', 'weapon2': '0.502', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.428', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '47.000'} [2024-08-06 00:46:15,633][52663] DAMAGECOUNT value on done: 134485.0 [2024-08-06 00:46:15,633][52663] Sum rewards: 43.233, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.789', 'AMMO5': '0.020', 'weapon5': '0.024', 'AMMO2': '0.036', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon4': '0.274', 'weapon2': '0.444', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.048', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '41.000'} [2024-08-06 00:46:16,186][52811] DAMAGECOUNT value on done: 138128.0 [2024-08-06 00:46:16,186][52811] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '55.000'} [2024-08-06 00:46:16,517][52671] DAMAGECOUNT value on done: 139138.0 [2024-08-06 00:46:16,519][52671] Sum rewards: 57.767, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.330', 'AMMO2': '0.024', 'weapon4': '0.092', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.293', 'weapon2': '0.386', 'WEAPON3': '1.800', 'HITCOUNT': '3.270', 'weapon3': '3.312', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '53.000'} [2024-08-06 00:46:16,532][52820] DAMAGECOUNT value on done: 123973.0 [2024-08-06 00:46:16,533][52820] Sum rewards: 42.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.847', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.047', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'AMMO4': '0.235', 'weapon2': '0.428', 'weapon4': '0.446', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.590', 'weapon3': '2.746', 'DAMAGECOUNT': '11.715', 'FRAGCOUNT': '37.000'} [2024-08-06 00:46:17,337][52803] DAMAGECOUNT value on done: 128747.0 [2024-08-06 00:46:17,338][52803] Sum rewards: 53.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.101', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.183', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:17,601][52665] DAMAGECOUNT value on done: 136022.0 [2024-08-06 00:46:17,601][52665] Sum rewards: 57.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.905', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.056', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.450', 'weapon4': '0.468', 'weapon2': '0.666', 'WEAPON3': '1.450', 'weapon3': '2.508', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '50.000'} [2024-08-06 00:46:17,734][52659] DAMAGECOUNT value on done: 140173.0 [2024-08-06 00:46:17,735][52659] Sum rewards: 65.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.055', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.252', 'weapon2': '0.634', 'WEAPON3': '0.850', 'weapon3': '2.988', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 206585856. Throughput: 0: 4399.6. Samples: 51645980. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 00:46:17,794][52567] Avg episode reward: [(0, '55.626')] [2024-08-06 00:46:18,952][52650] Updated weights for policy 0, policy_version 25221 (0.0030) [2024-08-06 00:46:19,270][52811] DAMAGECOUNT value on done: 125714.0 [2024-08-06 00:46:19,271][52811] Sum rewards: 38.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.644', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.050', 'weapon5': '0.088', 'AMMO3': '0.186', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'weapon4': '0.622', 'WEAPON4': '0.650', 'weapon2': '0.892', 'WEAPON3': '1.150', 'weapon3': '2.126', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '35.000'} [2024-08-06 00:46:19,471][52671] DAMAGECOUNT value on done: 136572.0 [2024-08-06 00:46:19,472][52671] Sum rewards: 51.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.664', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.392', 'WEAPON3': '1.750', 'HITCOUNT': '2.820', 'weapon3': '2.894', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:19,747][52820] DAMAGECOUNT value on done: 127992.0 [2024-08-06 00:46:19,747][52820] Sum rewards: 54.946, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO2': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.048', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.260', 'weapon4': '0.434', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:20,397][52659] DAMAGECOUNT value on done: 135519.0 [2024-08-06 00:46:20,397][52659] Sum rewards: 55.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.190', 'AMMO5': '0.008', 'weapon5': '0.036', 'AMMO2': '0.052', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.259', 'WEAPON4': '0.350', 'weapon4': '0.562', 'weapon2': '0.564', 'WEAPON3': '0.950', 'weapon3': '2.632', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:20,502][52803] DAMAGECOUNT value on done: 127487.0 [2024-08-06 00:46:20,504][52803] Sum rewards: 43.979, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.051', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.254', 'AMMO3': '0.266', 'weapon2': '0.400', 'weapon4': '0.626', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.572', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '42.000'} [2024-08-06 00:46:20,870][52665] DAMAGECOUNT value on done: 133029.0 [2024-08-06 00:46:20,872][52665] Sum rewards: 69.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '57.000'} [2024-08-06 00:46:22,283][52811] DAMAGECOUNT value on done: 128490.0 [2024-08-06 00:46:22,285][52811] Sum rewards: 54.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.922', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.119', 'weapon5': '0.126', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon2': '0.998', 'weapon3': '2.278', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 206675968. Throughput: 0: 4402.2. Samples: 51672290. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 00:46:22,794][52567] Avg episode reward: [(0, '55.329')] [2024-08-06 00:46:22,838][52820] DAMAGECOUNT value on done: 129565.0 [2024-08-06 00:46:22,841][52820] Sum rewards: 56.716, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.522', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.436', 'weapon2': '0.606', 'WEAPON3': '1.400', 'weapon3': '2.562', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:23,258][52659] DAMAGECOUNT value on done: 131333.0 [2024-08-06 00:46:23,259][52659] Sum rewards: 55.557, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.657', 'AMMO5': '0.013', 'weapon5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.266', 'ARMOR': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '50.000'} [2024-08-06 00:46:23,727][52803] DAMAGECOUNT value on done: 133643.0 [2024-08-06 00:46:23,729][52803] Sum rewards: 64.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.306', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.127', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '55.000'} [2024-08-06 00:46:23,826][52650] Updated weights for policy 0, policy_version 25231 (0.0026) [2024-08-06 00:46:23,838][52665] DAMAGECOUNT value on done: 134146.0 [2024-08-06 00:46:23,839][52665] Sum rewards: 43.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.936', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.273', 'weapon2': '0.536', 'WEAPON3': '1.700', 'HITCOUNT': '2.650', 'weapon3': '3.240', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '41.000'} [2024-08-06 00:46:25,379][52811] DAMAGECOUNT value on done: 128238.0 [2024-08-06 00:46:25,380][52811] Sum rewards: 52.003, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.802', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO3': '0.158', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'weapon4': '0.514', 'weapon2': '0.774', 'WEAPON3': '0.950', 'weapon3': '2.448', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.916', 'FRAGCOUNT': '43.000'} [2024-08-06 00:46:25,550][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:46:26,073][52659] DAMAGECOUNT value on done: 131369.0 [2024-08-06 00:46:26,075][52659] Sum rewards: 53.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.465', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.118', 'AMMO4': '0.187', 'AMMO3': '0.207', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.656', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:26,107][52820] DAMAGECOUNT value on done: 129698.0 [2024-08-06 00:46:26,110][52820] Sum rewards: 61.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.227', 'WEAPON4': '0.450', 'weapon4': '0.554', 'weapon2': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.644', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '50.000'} [2024-08-06 00:46:26,809][52803] DAMAGECOUNT value on done: 128947.0 [2024-08-06 00:46:26,811][52803] Sum rewards: 45.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.804', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '3.262', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '39.000'} [2024-08-06 00:46:26,994][52665] DAMAGECOUNT value on done: 129512.0 [2024-08-06 00:46:26,994][52665] Sum rewards: 54.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.091', 'AMMO3': '0.216', 'weapon4': '0.216', 'weapon2': '0.822', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 206757888. Throughput: 0: 4395.5. Samples: 51698550. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 00:46:27,795][52567] Avg episode reward: [(0, '54.881')] [2024-08-06 00:46:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000025239_206757888.pth... [2024-08-06 00:46:27,956][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024725_202547200.pth [2024-08-06 00:46:28,249][52650] Updated weights for policy 0, policy_version 25241 (0.0013) [2024-08-06 00:46:28,484][52811] DAMAGECOUNT value on done: 128703.0 [2024-08-06 00:46:28,488][52811] Sum rewards: 62.075, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.097', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.484', 'WEAPON3': '1.550', 'weapon3': '2.790', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '56.000'} [2024-08-06 00:46:29,431][52820] DAMAGECOUNT value on done: 126908.0 [2024-08-06 00:46:29,432][52820] Sum rewards: 59.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.175', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon4': '0.338', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:29,458][52659] DAMAGECOUNT value on done: 138565.0 [2024-08-06 00:46:29,458][52659] Sum rewards: 57.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.255', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.181', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.500', 'weapon2': '0.822', 'WEAPON3': '1.300', 'weapon3': '2.502', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:30,182][52803] DAMAGECOUNT value on done: 132690.0 [2024-08-06 00:46:30,182][52803] Sum rewards: 58.679, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.155', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.235', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '2.992', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '53.000'} [2024-08-06 00:46:30,239][52665] DAMAGECOUNT value on done: 132472.0 [2024-08-06 00:46:30,239][52665] Sum rewards: 52.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.892', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.444', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:31,563][52811] DAMAGECOUNT value on done: 132822.0 [2024-08-06 00:46:31,563][52811] Sum rewards: 52.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.526', 'weapon2': '0.582', 'WEAPON3': '0.900', 'weapon3': '2.450', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '41.000'} [2024-08-06 00:46:32,398][52659] DAMAGECOUNT value on done: 137654.0 [2024-08-06 00:46:32,401][52659] Sum rewards: 46.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.605', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.410', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.118', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '43.000'} [2024-08-06 00:46:32,594][52820] DAMAGECOUNT value on done: 126895.0 [2024-08-06 00:46:32,601][52820] Sum rewards: 41.596, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.176', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.174', 'AMMO4': '0.225', 'WEAPON4': '0.400', 'weapon2': '0.522', 'weapon4': '0.942', 'WEAPON3': '1.050', 'weapon3': '1.964', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '10.446', 'FRAGCOUNT': '38.500'} [2024-08-06 00:46:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 206848000. Throughput: 0: 4386.2. Samples: 51711290. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 00:46:32,795][52567] Avg episode reward: [(0, '54.583')] [2024-08-06 00:46:33,254][52803] DAMAGECOUNT value on done: 126376.0 [2024-08-06 00:46:33,262][52803] Sum rewards: 51.742, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.000', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.163', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '43.000'} [2024-08-06 00:46:33,412][52650] Updated weights for policy 0, policy_version 25251 (0.0047) [2024-08-06 00:46:33,504][52665] DAMAGECOUNT value on done: 134317.0 [2024-08-06 00:46:33,504][52665] Sum rewards: 44.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon2': '0.210', 'weapon4': '0.210', 'AMMO3': '0.233', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.380', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '38.000'} [2024-08-06 00:46:34,782][52811] DAMAGECOUNT value on done: 128604.0 [2024-08-06 00:46:34,787][52811] Sum rewards: 61.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.807', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.252', 'weapon2': '0.590', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '54.000'} [2024-08-06 00:46:35,562][52659] DAMAGECOUNT value on done: 142526.0 [2024-08-06 00:46:35,563][52659] Sum rewards: 48.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.105', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '43.000'} [2024-08-06 00:46:35,807][52820] DAMAGECOUNT value on done: 130153.0 [2024-08-06 00:46:35,807][52820] Sum rewards: 63.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO4': '0.054', 'weapon7': '0.062', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.167', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '54.000'} [2024-08-06 00:46:36,368][52803] DAMAGECOUNT value on done: 128993.0 [2024-08-06 00:46:36,368][52803] Sum rewards: 60.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.234', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.338', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.744', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '52.000'} [2024-08-06 00:46:37,551][52650] Updated weights for policy 0, policy_version 25261 (0.0012) [2024-08-06 00:46:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 206938112. Throughput: 0: 4376.7. Samples: 51737410. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 00:46:37,794][52567] Avg episode reward: [(0, '54.568')] [2024-08-06 00:46:37,838][52811] DAMAGECOUNT value on done: 127458.0 [2024-08-06 00:46:37,841][52811] Sum rewards: 57.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.516', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon2': '0.794', 'WEAPON3': '0.950', 'weapon3': '2.962', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '44.000'} [2024-08-06 00:46:38,809][52659] DAMAGECOUNT value on done: 139333.0 [2024-08-06 00:46:38,810][52659] Sum rewards: 50.276, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.180', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.612', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.954', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:39,060][52820] DAMAGECOUNT value on done: 127482.0 [2024-08-06 00:46:39,060][52820] Sum rewards: 62.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.222', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon5': '0.060', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '3.172', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:39,368][52803] DAMAGECOUNT value on done: 126789.0 [2024-08-06 00:46:39,369][52803] Sum rewards: 63.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.219', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.173', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '53.000'} [2024-08-06 00:46:40,892][52811] DAMAGECOUNT value on done: 133815.0 [2024-08-06 00:46:40,892][52811] Sum rewards: 55.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.143', 'AMMO3': '0.198', 'weapon2': '0.470', 'WEAPON4': '0.550', 'weapon4': '0.892', 'WEAPON3': '1.150', 'weapon3': '2.392', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '47.000'} [2024-08-06 00:46:41,598][52659] DAMAGECOUNT value on done: 136473.0 [2024-08-06 00:46:41,599][52659] Sum rewards: 74.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'weapon2': '0.208', 'weapon4': '0.438', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '58.000'} [2024-08-06 00:46:42,300][52650] Updated weights for policy 0, policy_version 25271 (0.0034) [2024-08-06 00:46:42,375][52820] DAMAGECOUNT value on done: 128378.0 [2024-08-06 00:46:42,376][52820] Sum rewards: 52.310, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.984', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO4': '0.164', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.328', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:42,439][52803] DAMAGECOUNT value on done: 132334.0 [2024-08-06 00:46:42,439][52803] Sum rewards: 52.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.478', 'AMMO5': '0.014', 'ARMOR': '0.016', 'weapon5': '0.058', 'AMMO2': '0.084', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon2': '0.400', 'AMMO4': '0.420', 'WEAPON4': '0.450', 'weapon4': '0.486', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '44.500'} [2024-08-06 00:46:42,540][52662] DAMAGECOUNT value on done: 141877.0 [2024-08-06 00:46:42,540][52662] Sum rewards: 59.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.804', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.288', 'weapon4': '0.434', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.2). Total num frames: 207020032. Throughput: 0: 4380.0. Samples: 51763680. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 00:46:42,794][52567] Avg episode reward: [(0, '55.056')] [2024-08-06 00:46:44,061][52811] DAMAGECOUNT value on done: 128223.0 [2024-08-06 00:46:44,069][52811] Sum rewards: 66.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.126', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.200', 'AMMO4': '0.215', 'weapon4': '0.230', 'weapon5': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.836', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '57.000'} [2024-08-06 00:46:44,308][52668] DAMAGECOUNT value on done: 136221.0 [2024-08-06 00:46:44,308][52668] Sum rewards: 49.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.453', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.058', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:44,576][52659] DAMAGECOUNT value on done: 141018.0 [2024-08-06 00:46:44,576][52659] Sum rewards: 58.155, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.534', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.164', 'AMMO4': '0.186', 'AMMO3': '0.252', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.336', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '52.000'} [2024-08-06 00:46:44,974][52662] DAMAGECOUNT value on done: 144312.0 [2024-08-06 00:46:44,976][52662] Sum rewards: 56.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.060', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.112', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.014', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:45,382][52803] DAMAGECOUNT value on done: 132810.0 [2024-08-06 00:46:45,383][52803] Sum rewards: 62.180, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.706', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'weapon4': '0.428', 'weapon2': '0.548', 'WEAPON3': '1.750', 'weapon3': '2.746', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '56.000'} [2024-08-06 00:46:45,561][52820] DAMAGECOUNT value on done: 130530.0 [2024-08-06 00:46:45,561][52820] Sum rewards: 63.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.793', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.215', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '55.000'} [2024-08-06 00:46:46,775][52668] DAMAGECOUNT value on done: 144344.0 [2024-08-06 00:46:46,775][52668] Sum rewards: 69.027, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.224', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon5': '0.092', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon4': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.668', 'WEAPON3': '1.400', 'weapon3': '2.642', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '60.000'} [2024-08-06 00:46:47,084][52650] Updated weights for policy 0, policy_version 25281 (0.0023) [2024-08-06 00:46:47,183][52811] DAMAGECOUNT value on done: 129427.0 [2024-08-06 00:46:47,183][52811] Sum rewards: 52.224, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.400', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon5': '0.112', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.324', 'weapon4': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.866', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '47.000'} [2024-08-06 00:46:47,384][52662] DAMAGECOUNT value on done: 146275.0 [2024-08-06 00:46:47,385][52662] Sum rewards: 46.692, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.226', 'WEAPON4': '0.450', 'weapon4': '0.578', 'weapon2': '0.678', 'WEAPON3': '1.250', 'weapon3': '2.556', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '42.000'} [2024-08-06 00:46:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 207110144. Throughput: 0: 4372.2. Samples: 51776780. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:46:47,794][52567] Avg episode reward: [(0, '55.053')] [2024-08-06 00:46:47,898][52659] DAMAGECOUNT value on done: 140086.0 [2024-08-06 00:46:47,899][52659] Sum rewards: 45.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.792', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.150', 'AMMO4': '0.173', 'weapon5': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.550', 'weapon4': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.582', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '38.500'} [2024-08-06 00:46:48,496][52803] DAMAGECOUNT value on done: 129410.0 [2024-08-06 00:46:48,500][52803] Sum rewards: 58.592, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.143', 'AMMO4': '0.173', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.442', 'WEAPON3': '1.000', 'weapon3': '2.830', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:48,642][52820] DAMAGECOUNT value on done: 131459.0 [2024-08-06 00:46:48,642][52820] Sum rewards: 52.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '3.214', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '44.000'} [2024-08-06 00:46:49,285][52668] DAMAGECOUNT value on done: 138894.0 [2024-08-06 00:46:49,295][52668] Sum rewards: 47.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.121', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '41.000'} [2024-08-06 00:46:49,870][52662] DAMAGECOUNT value on done: 136994.0 [2024-08-06 00:46:49,870][52662] Sum rewards: 60.021, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.375', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.230', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:50,162][52811] DAMAGECOUNT value on done: 129153.0 [2024-08-06 00:46:50,164][52811] Sum rewards: 63.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'weapon5': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.344', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '54.000'} [2024-08-06 00:46:51,627][52803] DAMAGECOUNT value on done: 131306.0 [2024-08-06 00:46:51,628][52803] Sum rewards: 65.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.824', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '56.000'} [2024-08-06 00:46:51,632][52820] DAMAGECOUNT value on done: 126627.0 [2024-08-06 00:46:51,633][52820] Sum rewards: 68.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.325', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.082', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.412', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '56.000'} [2024-08-06 00:46:51,967][52668] DAMAGECOUNT value on done: 137129.0 [2024-08-06 00:46:51,967][52668] Sum rewards: 58.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.666', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.254', 'weapon2': '0.446', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '52.000'} [2024-08-06 00:46:51,974][52650] Updated weights for policy 0, policy_version 25291 (0.0033) [2024-08-06 00:46:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 207192064. Throughput: 0: 4378.0. Samples: 51803340. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:46:52,794][52567] Avg episode reward: [(0, '55.285')] [2024-08-06 00:46:53,093][52662] DAMAGECOUNT value on done: 143173.0 [2024-08-06 00:46:53,094][52662] Sum rewards: 66.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.232', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 00:46:53,255][52811] DAMAGECOUNT value on done: 128608.0 [2024-08-06 00:46:53,255][52811] Sum rewards: 52.180, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.442', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.112', 'AMMO4': '0.179', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.450', 'weapon4': '0.950', 'WEAPON3': '1.250', 'weapon3': '2.256', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:54,632][52803] DAMAGECOUNT value on done: 127127.0 [2024-08-06 00:46:54,635][52803] Sum rewards: 57.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.166', 'AMMO3': '0.171', 'WEAPON4': '0.350', 'weapon4': '0.522', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.498', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:54,832][52668] DAMAGECOUNT value on done: 137731.0 [2024-08-06 00:46:54,834][52668] Sum rewards: 65.361, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.498', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.098', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.680', 'WEAPON3': '0.800', 'weapon3': '2.716', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '51.000'} [2024-08-06 00:46:55,575][52662] DAMAGECOUNT value on done: 142348.0 [2024-08-06 00:46:55,575][52662] Sum rewards: 55.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.475', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO4': '0.181', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.352', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '48.000'} [2024-08-06 00:46:56,278][52650] Updated weights for policy 0, policy_version 25301 (0.0027) [2024-08-06 00:46:56,439][52811] DAMAGECOUNT value on done: 130235.0 [2024-08-06 00:46:56,439][52811] Sum rewards: 58.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.955', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.080', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.538', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '49.000'} [2024-08-06 00:46:56,940][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:46:57,208][52794] DAMAGECOUNT value on done: 144967.0 [2024-08-06 00:46:57,211][52794] Sum rewards: 51.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.446', 'AMMO5': '0.005', 'ARMOR': '0.040', 'AMMO2': '0.057', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.287', 'weapon2': '0.480', 'WEAPON4': '0.500', 'weapon4': '0.714', 'WEAPON3': '1.050', 'weapon3': '2.346', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '45.000'} [2024-08-06 00:46:57,740][52803] DAMAGECOUNT value on done: 125640.0 [2024-08-06 00:46:57,741][52803] Sum rewards: 48.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.260', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.240', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '42.000'} [2024-08-06 00:46:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 207282176. Throughput: 0: 4372.9. Samples: 51829590. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:46:57,794][52567] Avg episode reward: [(0, '55.411')] [2024-08-06 00:46:57,906][52660] DAMAGECOUNT value on done: 134948.0 [2024-08-06 00:46:57,907][52660] Sum rewards: 62.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.901', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.330', 'weapon4': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '53.000'} [2024-08-06 00:46:57,955][52668] DAMAGECOUNT value on done: 134325.0 [2024-08-06 00:46:57,958][52668] Sum rewards: 50.601, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'ARMOR': '0.028', 'AMMO2': '0.032', 'weapon5': '0.066', 'AMMO4': '0.159', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.344', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:58,434][52662] DAMAGECOUNT value on done: 142567.0 [2024-08-06 00:46:58,435][52662] Sum rewards: 57.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.402', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.092', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'weapon2': '0.366', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '47.000'} [2024-08-06 00:46:58,890][52811] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:46:59,570][52811] DAMAGECOUNT value on done: 130890.0 [2024-08-06 00:46:59,572][52811] Sum rewards: 53.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.562', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.186', 'AMMO3': '0.216', 'weapon4': '0.344', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '46.000'} [2024-08-06 00:46:59,805][52794] DAMAGECOUNT value on done: 144081.0 [2024-08-06 00:46:59,807][52794] Sum rewards: 58.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.291', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.169', 'weapon4': '0.234', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:00,739][52660] DAMAGECOUNT value on done: 138631.0 [2024-08-06 00:47:00,739][52660] Sum rewards: 58.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.520', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.196', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:00,779][52803] DAMAGECOUNT value on done: 131791.0 [2024-08-06 00:47:00,782][52803] Sum rewards: 64.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.212', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '55.000'} [2024-08-06 00:47:00,825][52668] DAMAGECOUNT value on done: 139203.0 [2024-08-06 00:47:00,825][52668] Sum rewards: 60.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.699', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.226', 'weapon2': '0.360', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '52.000'} [2024-08-06 00:47:01,018][52647] DAMAGECOUNT value on done: 147073.0 [2024-08-06 00:47:01,018][52647] Sum rewards: 56.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.224', 'weapon2': '0.562', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '2.982', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:01,290][52662] DAMAGECOUNT value on done: 147545.0 [2024-08-06 00:47:01,290][52662] Sum rewards: 54.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.548', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.224', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:01,355][52650] Updated weights for policy 0, policy_version 25311 (0.0027) [2024-08-06 00:47:01,578][52664] DAMAGECOUNT value on done: 142231.0 [2024-08-06 00:47:01,578][52664] Sum rewards: 61.982, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '2.906', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:01,958][52614] Signal inference workers to stop experience collection... (4650 times) [2024-08-06 00:47:01,958][52614] Signal inference workers to resume experience collection... (4650 times) [2024-08-06 00:47:02,004][52650] InferenceWorker_p0-w0: stopping experience collection (4650 times) [2024-08-06 00:47:02,027][52650] InferenceWorker_p0-w0: resuming experience collection (4650 times) [2024-08-06 00:47:02,643][52811] DAMAGECOUNT value on done: 132821.0 [2024-08-06 00:47:02,647][52811] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.004', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.206', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:02,653][52794] DAMAGECOUNT value on done: 138476.0 [2024-08-06 00:47:02,656][52794] Sum rewards: 52.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '44.500'} [2024-08-06 00:47:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 207372288. Throughput: 0: 4370.0. Samples: 51842630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:47:02,795][52567] Avg episode reward: [(0, '55.776')] [2024-08-06 00:47:03,622][52647] DAMAGECOUNT value on done: 144430.0 [2024-08-06 00:47:03,625][52647] Sum rewards: 53.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.908', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.158', 'weapon5': '0.200', 'AMMO4': '0.235', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:03,789][52660] DAMAGECOUNT value on done: 139058.0 [2024-08-06 00:47:03,790][52660] Sum rewards: 62.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '53.000'} [2024-08-06 00:47:03,799][52662] DAMAGECOUNT value on done: 143115.0 [2024-08-06 00:47:03,800][52662] Sum rewards: 51.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.314', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon4': '0.124', 'AMMO4': '0.184', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.362', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:03,800][52663] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:47:03,869][52668] DAMAGECOUNT value on done: 142124.0 [2024-08-06 00:47:03,869][52668] Sum rewards: 76.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.042', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.201', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.288', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '62.000'} [2024-08-06 00:47:03,879][52803] DAMAGECOUNT value on done: 129647.0 [2024-08-06 00:47:03,879][52803] Sum rewards: 64.771, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.204', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.220', 'AMMO3': '0.222', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '57.000'} [2024-08-06 00:47:04,404][52664] DAMAGECOUNT value on done: 142300.0 [2024-08-06 00:47:04,404][52664] Sum rewards: 54.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.634', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'weapon2': '0.460', 'weapon4': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:05,386][52794] DAMAGECOUNT value on done: 138180.0 [2024-08-06 00:47:05,388][52794] Sum rewards: 63.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.936', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.154', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:05,694][52811] DAMAGECOUNT value on done: 128727.0 [2024-08-06 00:47:05,694][52811] Sum rewards: 53.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.104', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.171', 'weapon4': '0.210', 'weapon2': '0.620', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.008', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:05,832][52650] Updated weights for policy 0, policy_version 25321 (0.0016) [2024-08-06 00:47:06,430][52660] DAMAGECOUNT value on done: 138806.0 [2024-08-06 00:47:06,430][52660] Sum rewards: 53.799, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.339', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.084', 'AMMO3': '0.150', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON4': '0.400', 'ARMOR': '0.466', 'weapon4': '0.858', 'WEAPON3': '0.900', 'weapon3': '2.428', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:06,472][52647] DAMAGECOUNT value on done: 148089.0 [2024-08-06 00:47:06,474][52647] Sum rewards: 46.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.926', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.628', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '3.012', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:06,495][52662] DAMAGECOUNT value on done: 145667.0 [2024-08-06 00:47:06,513][52662] Sum rewards: 63.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon5': '0.048', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.450', 'weapon2': '0.470', 'weapon4': '0.756', 'WEAPON3': '0.950', 'weapon3': '2.534', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '53.000'} [2024-08-06 00:47:06,640][52668] DAMAGECOUNT value on done: 139652.0 [2024-08-06 00:47:06,641][52668] Sum rewards: 55.663, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.550', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.246', 'AMMO3': '0.261', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.042', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:06,994][52803] DAMAGECOUNT value on done: 131278.0 [2024-08-06 00:47:06,995][52803] Sum rewards: 59.145, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.330', 'AMMO5': '0.012', 'ARMOR': '0.025', 'AMMO2': '0.050', 'AMMO3': '0.142', 'AMMO4': '0.251', 'WEAPON5': '0.350', 'weapon5': '0.364', 'WEAPON4': '0.450', 'weapon2': '0.608', 'weapon4': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.012', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:07,166][52664] DAMAGECOUNT value on done: 144280.0 [2024-08-06 00:47:07,166][52664] Sum rewards: 62.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.060', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.346', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:07,684][52667] DAMAGECOUNT value on done: 140866.0 [2024-08-06 00:47:07,685][52667] Sum rewards: 52.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.182', 'weapon4': '0.394', 'WEAPON4': '0.450', 'weapon2': '0.808', 'WEAPON3': '1.150', 'weapon3': '2.526', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:07,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 207462400. Throughput: 0: 4369.1. Samples: 51868900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 00:47:07,795][52567] Avg episode reward: [(0, '56.555')] [2024-08-06 00:47:07,871][52794] DAMAGECOUNT value on done: 142237.0 [2024-08-06 00:47:07,872][52794] Sum rewards: 55.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.221', 'weapon2': '0.622', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '2.912', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:08,985][52811] DAMAGECOUNT value on done: 132385.0 [2024-08-06 00:47:08,985][52811] Sum rewards: 44.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.787', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.198', 'weapon2': '0.462', 'WEAPON4': '0.600', 'weapon4': '0.726', 'WEAPON3': '1.250', 'weapon3': '2.450', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '40.000'} [2024-08-06 00:47:09,124][52662] DAMAGECOUNT value on done: 139300.0 [2024-08-06 00:47:09,125][52662] Sum rewards: 50.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.957', 'AMMO5': '0.011', 'ARMOR': '0.028', 'AMMO2': '0.042', 'weapon5': '0.056', 'AMMO3': '0.192', 'AMMO4': '0.210', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.916', 'DAMAGECOUNT': '12.741', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:09,371][52660] DAMAGECOUNT value on done: 135942.0 [2024-08-06 00:47:09,372][52660] Sum rewards: 63.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.518', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:09,394][52647] DAMAGECOUNT value on done: 148099.0 [2024-08-06 00:47:09,395][52647] Sum rewards: 49.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.837', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.211', 'weapon4': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '2.970', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:09,412][52668] DAMAGECOUNT value on done: 141070.0 [2024-08-06 00:47:09,412][52668] Sum rewards: 58.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.112', 'weapon4': '0.166', 'AMMO3': '0.207', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:10,010][52803] DAMAGECOUNT value on done: 125114.0 [2024-08-06 00:47:10,010][52803] Sum rewards: 52.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.285', 'AMMO5': '0.003', 'AMMO2': '0.019', 'ARMOR': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon4': '0.214', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:10,115][52664] DAMAGECOUNT value on done: 144200.0 [2024-08-06 00:47:10,117][52664] Sum rewards: 58.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:10,394][52650] Updated weights for policy 0, policy_version 25331 (0.0012) [2024-08-06 00:47:10,654][52794] DAMAGECOUNT value on done: 141603.0 [2024-08-06 00:47:10,662][52794] Sum rewards: 69.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon2': '0.216', 'AMMO3': '0.248', 'weapon4': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '59.000'} [2024-08-06 00:47:10,701][52667] DAMAGECOUNT value on done: 140153.0 [2024-08-06 00:47:10,701][52667] Sum rewards: 57.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.639', 'ARMOR': '0.008', 'AMMO2': '0.037', 'AMMO3': '0.183', 'AMMO4': '0.186', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:11,755][52647] DAMAGECOUNT value on done: 149990.0 [2024-08-06 00:47:11,755][52647] Sum rewards: 53.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.196', 'weapon2': '0.228', 'weapon4': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '2.978', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '44.000'} [2024-08-06 00:47:12,048][52811] DAMAGECOUNT value on done: 128174.0 [2024-08-06 00:47:12,051][52811] Sum rewards: 46.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.158', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.235', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.592', 'WEAPON3': '1.450', 'weapon3': '2.728', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '41.000'} [2024-08-06 00:47:12,202][52662] DAMAGECOUNT value on done: 143885.0 [2024-08-06 00:47:12,204][52662] Sum rewards: 53.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon4': '0.206', 'weapon2': '0.424', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.208', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:12,367][52660] DAMAGECOUNT value on done: 135446.0 [2024-08-06 00:47:12,368][52660] Sum rewards: 51.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.014', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.110', 'AMMO3': '0.186', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'weapon4': '0.430', 'WEAPON4': '0.500', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.558', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:12,469][52668] DAMAGECOUNT value on done: 138176.0 [2024-08-06 00:47:12,469][52668] Sum rewards: 61.293, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.722', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.434', 'weapon4': '0.574', 'WEAPON3': '1.750', 'weapon3': '2.584', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '57.000'} [2024-08-06 00:47:12,479][52664] DAMAGECOUNT value on done: 142478.0 [2024-08-06 00:47:12,479][52664] Sum rewards: 44.358, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.342', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.146', 'WEAPON5': '0.250', 'weapon4': '0.290', 'AMMO3': '0.301', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '2.946', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '41.000'} [2024-08-06 00:47:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 207544320. Throughput: 0: 4370.2. Samples: 51895210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 00:47:12,795][52567] Avg episode reward: [(0, '56.594')] [2024-08-06 00:47:13,786][52794] DAMAGECOUNT value on done: 147922.0 [2024-08-06 00:47:13,788][52794] Sum rewards: 59.454, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon4': '0.312', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '53.000'} [2024-08-06 00:47:14,017][52667] DAMAGECOUNT value on done: 139772.0 [2024-08-06 00:47:14,017][52667] Sum rewards: 53.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.121', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.444', 'weapon4': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:14,208][52647] DAMAGECOUNT value on done: 148162.0 [2024-08-06 00:47:14,208][52647] Sum rewards: 58.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.145', 'weapon4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.146', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2024-08-06 00:47:14,965][52664] DAMAGECOUNT value on done: 146471.0 [2024-08-06 00:47:14,966][52664] Sum rewards: 44.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.154', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.189', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '3.048', 'DAMAGECOUNT': '11.487', 'FRAGCOUNT': '39.000'} [2024-08-06 00:47:15,130][52811] DAMAGECOUNT value on done: 131571.0 [2024-08-06 00:47:15,134][52811] Sum rewards: 54.483, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.461', 'AMMO5': '0.008', 'ARMOR': '0.036', 'AMMO2': '0.042', 'AMMO3': '0.163', 'weapon5': '0.192', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.600', 'weapon2': '0.782', 'weapon4': '0.840', 'WEAPON3': '0.950', 'weapon3': '1.984', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:15,200][52650] Updated weights for policy 0, policy_version 25341 (0.0029) [2024-08-06 00:47:15,286][52662] DAMAGECOUNT value on done: 140683.0 [2024-08-06 00:47:15,290][52662] Sum rewards: 38.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.008', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.456', 'WEAPON3': '1.450', 'HITCOUNT': '2.300', 'weapon3': '2.764', 'DAMAGECOUNT': '10.605', 'FRAGCOUNT': '36.000'} [2024-08-06 00:47:15,543][52660] DAMAGECOUNT value on done: 139726.0 [2024-08-06 00:47:15,543][52660] Sum rewards: 50.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.304', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.174', 'WEAPON4': '0.400', 'weapon4': '0.696', 'weapon2': '0.874', 'WEAPON3': '1.000', 'weapon3': '2.148', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:15,640][52668] DAMAGECOUNT value on done: 137194.0 [2024-08-06 00:47:15,641][52668] Sum rewards: 54.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.064', 'AMMO4': '0.065', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.158', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '48.000'} [2024-08-06 00:47:16,563][52667] DAMAGECOUNT value on done: 137633.0 [2024-08-06 00:47:16,563][52667] Sum rewards: 57.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.702', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.207', 'weapon2': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '49.000'} [2024-08-06 00:47:16,787][52647] DAMAGECOUNT value on done: 145092.0 [2024-08-06 00:47:16,787][52647] Sum rewards: 51.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.968', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.238', 'weapon4': '0.308', 'weapon2': '0.480', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.032', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:16,969][52794] DAMAGECOUNT value on done: 140535.0 [2024-08-06 00:47:16,969][52794] Sum rewards: 45.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.758', 'AMMO5': '0.003', 'ARMOR': '0.048', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'AMMO3': '0.206', 'AMMO4': '0.262', 'weapon4': '0.442', 'weapon2': '0.574', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '40.000'} [2024-08-06 00:47:17,150][52671] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:47:17,477][52664] DAMAGECOUNT value on done: 146084.0 [2024-08-06 00:47:17,478][52664] Sum rewards: 63.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.030', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon4': '0.212', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.358', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 207634432. Throughput: 0: 4376.0. Samples: 51908210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 00:47:17,795][52567] Avg episode reward: [(0, '56.239')] [2024-08-06 00:47:18,436][52662] DAMAGECOUNT value on done: 142806.0 [2024-08-06 00:47:18,436][52662] Sum rewards: 59.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.592', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.178', 'WEAPON4': '0.400', 'weapon2': '0.492', 'weapon4': '0.652', 'WEAPON3': '0.950', 'weapon3': '2.552', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '49.500'} [2024-08-06 00:47:18,527][52660] DAMAGECOUNT value on done: 138742.0 [2024-08-06 00:47:18,528][52660] Sum rewards: 48.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.386', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.088', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.994', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:18,624][52668] DAMAGECOUNT value on done: 131096.0 [2024-08-06 00:47:18,627][52668] Sum rewards: 53.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.194', 'WEAPON4': '0.450', 'weapon2': '0.480', 'weapon4': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.462', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:19,248][52667] DAMAGECOUNT value on done: 139214.0 [2024-08-06 00:47:19,249][52667] Sum rewards: 53.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.911', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.157', 'weapon5': '0.158', 'AMMO4': '0.186', 'weapon4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.662', 'WEAPON3': '0.950', 'weapon3': '2.734', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:19,271][52647] DAMAGECOUNT value on done: 147570.0 [2024-08-06 00:47:19,271][52647] Sum rewards: 59.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.698', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:20,013][52650] Updated weights for policy 0, policy_version 25351 (0.0019) [2024-08-06 00:47:20,165][52794] DAMAGECOUNT value on done: 145055.0 [2024-08-06 00:47:20,167][52794] Sum rewards: 69.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.717', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.133', 'AMMO3': '0.196', 'weapon2': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.554', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '57.000'} [2024-08-06 00:47:20,225][52664] DAMAGECOUNT value on done: 137024.0 [2024-08-06 00:47:20,227][52664] Sum rewards: 61.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.016', 'ARMOR': '0.032', 'AMMO2': '0.048', 'weapon5': '0.090', 'AMMO3': '0.158', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'weapon4': '0.456', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '53.000'} [2024-08-06 00:47:20,809][52660] DAMAGECOUNT value on done: 138792.0 [2024-08-06 00:47:20,809][52660] Sum rewards: 61.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.614', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.187', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:21,002][52668] DAMAGECOUNT value on done: 137220.0 [2024-08-06 00:47:21,002][52668] Sum rewards: 49.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'ARMOR': '0.005', 'AMMO5': '0.014', 'AMMO2': '0.067', 'AMMO3': '0.188', 'weapon5': '0.242', 'weapon4': '0.332', 'AMMO4': '0.333', 'weapon2': '0.346', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:21,476][52662] DAMAGECOUNT value on done: 141107.0 [2024-08-06 00:47:21,477][52662] Sum rewards: 51.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.054', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.201', 'AMMO4': '0.246', 'weapon2': '0.386', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:21,935][52667] DAMAGECOUNT value on done: 137998.0 [2024-08-06 00:47:21,936][52667] Sum rewards: 68.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.945', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.184', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '56.000'} [2024-08-06 00:47:22,078][52647] DAMAGECOUNT value on done: 148107.0 [2024-08-06 00:47:22,079][52647] Sum rewards: 58.234, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.005', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO3': '0.129', 'AMMO4': '0.133', 'weapon4': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.758', 'WEAPON3': '0.850', 'weapon3': '2.774', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:22,647][52669] DAMAGECOUNT value on done: 142910.0 [2024-08-06 00:47:22,650][52669] Sum rewards: 55.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.588', 'AMMO2': '0.016', 'ARMOR': '0.024', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon4': '0.234', 'weapon2': '0.530', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.084', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 207724544. Throughput: 0: 4383.7. Samples: 51934680. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 00:47:22,795][52567] Avg episode reward: [(0, '56.690')] [2024-08-06 00:47:22,853][52664] DAMAGECOUNT value on done: 152505.0 [2024-08-06 00:47:22,854][52664] Sum rewards: 62.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.397', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.152', 'AMMO4': '0.182', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.738', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:23,463][52794] DAMAGECOUNT value on done: 148413.0 [2024-08-06 00:47:23,464][52794] Sum rewards: 45.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.365', 'AMMO5': '0.004', 'weapon5': '0.042', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.770', 'WEAPON3': '1.000', 'HITCOUNT': '2.560', 'weapon3': '2.612', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '38.000'} [2024-08-06 00:47:23,901][52660] DAMAGECOUNT value on done: 139802.0 [2024-08-06 00:47:23,902][52660] Sum rewards: 60.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.428', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.166', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '3.032', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:24,093][52668] DAMAGECOUNT value on done: 135968.0 [2024-08-06 00:47:24,094][52668] Sum rewards: 54.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.254', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:24,332][52650] Updated weights for policy 0, policy_version 25361 (0.0012) [2024-08-06 00:47:24,444][52647] DAMAGECOUNT value on done: 144185.0 [2024-08-06 00:47:24,445][52647] Sum rewards: 62.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO3': '0.153', 'AMMO4': '0.168', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.762', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '52.000'} [2024-08-06 00:47:24,681][52662] DAMAGECOUNT value on done: 145994.0 [2024-08-06 00:47:24,683][52662] Sum rewards: 48.681, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.143', 'weapon5': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.974', 'WEAPON3': '1.100', 'weapon3': '2.586', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:24,702][52667] DAMAGECOUNT value on done: 141843.0 [2024-08-06 00:47:24,704][52667] Sum rewards: 66.346, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.155', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.148', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.574', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:25,400][52669] DAMAGECOUNT value on done: 138989.0 [2024-08-06 00:47:25,400][52669] Sum rewards: 58.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.256', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.044', 'weapon5': '0.076', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.648', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '50.500'} [2024-08-06 00:47:25,476][52664] DAMAGECOUNT value on done: 148580.0 [2024-08-06 00:47:25,477][52664] Sum rewards: 52.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.252', 'AMMO5': '0.005', 'AMMO2': '0.028', 'ARMOR': '0.028', 'weapon5': '0.098', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.478', 'weapon2': '0.548', 'WEAPON3': '1.600', 'weapon3': '2.614', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:26,198][52794] DAMAGECOUNT value on done: 139944.0 [2024-08-06 00:47:26,199][52794] Sum rewards: 52.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.798', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.132', 'AMMO3': '0.162', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'weapon4': '0.574', 'WEAPON4': '0.600', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.472', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:26,522][52660] DAMAGECOUNT value on done: 142019.0 [2024-08-06 00:47:26,523][52660] Sum rewards: 55.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO2': '0.024', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.192', 'weapon2': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.038', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:26,649][52668] DAMAGECOUNT value on done: 140714.0 [2024-08-06 00:47:26,651][52668] Sum rewards: 51.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.008', 'ARMOR': '0.024', 'AMMO2': '0.049', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.243', 'weapon4': '0.588', 'WEAPON4': '0.600', 'weapon2': '0.782', 'WEAPON3': '1.450', 'weapon3': '2.246', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '46.500'} [2024-08-06 00:47:27,106][52667] DAMAGECOUNT value on done: 137679.0 [2024-08-06 00:47:27,106][52667] Sum rewards: 47.312, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.204', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.168', 'AMMO3': '0.205', 'AMMO4': '0.293', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON4': '0.750', 'weapon4': '0.762', 'WEAPON3': '1.250', 'weapon3': '2.216', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:27,201][52647] DAMAGECOUNT value on done: 143211.0 [2024-08-06 00:47:27,201][52647] Sum rewards: 57.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.741', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.056', 'weapon5': '0.112', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'AMMO4': '0.279', 'WEAPON4': '0.600', 'weapon2': '0.628', 'weapon4': '0.780', 'WEAPON3': '1.050', 'weapon3': '2.126', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '49.000'} [2024-08-06 00:47:27,619][52662] DAMAGECOUNT value on done: 138061.0 [2024-08-06 00:47:27,621][52662] Sum rewards: 66.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.122', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.206', 'weapon5': '0.216', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.584', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '55.500'} [2024-08-06 00:47:27,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 207814656. Throughput: 0: 4386.4. Samples: 51961070. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 00:47:27,794][52567] Avg episode reward: [(0, '56.483')] [2024-08-06 00:47:28,122][52664] DAMAGECOUNT value on done: 146760.0 [2024-08-06 00:47:28,123][52664] Sum rewards: 61.422, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'weapon5': '0.130', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.374', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:28,553][52669] DAMAGECOUNT value on done: 138452.0 [2024-08-06 00:47:28,555][52669] Sum rewards: 58.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '48.500'} [2024-08-06 00:47:29,302][52660] DAMAGECOUNT value on done: 133887.0 [2024-08-06 00:47:29,304][52660] Sum rewards: 52.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.524', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.145', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.512', 'WEAPON3': '0.900', 'weapon2': '1.002', 'weapon3': '2.222', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:29,416][52647] DAMAGECOUNT value on done: 142189.0 [2024-08-06 00:47:29,417][52647] Sum rewards: 60.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.617', 'ARMOR': '0.024', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.204', 'weapon4': '0.206', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:29,424][52650] Updated weights for policy 0, policy_version 25371 (0.0021) [2024-08-06 00:47:29,504][52668] DAMAGECOUNT value on done: 138123.0 [2024-08-06 00:47:29,505][52668] Sum rewards: 53.672, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.362', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'weapon4': '0.256', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '2.912', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '49.000'} [2024-08-06 00:47:29,531][52794] DAMAGECOUNT value on done: 144378.0 [2024-08-06 00:47:29,531][52794] Sum rewards: 52.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.197', 'weapon4': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.088', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '44.500'} [2024-08-06 00:47:29,810][52667] DAMAGECOUNT value on done: 139227.0 [2024-08-06 00:47:29,811][52667] Sum rewards: 56.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.716', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon4': '0.118', 'AMMO4': '0.122', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.260', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '49.000'} [2024-08-06 00:47:30,554][52664] DAMAGECOUNT value on done: 143213.0 [2024-08-06 00:47:30,554][52664] Sum rewards: 52.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.557', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.188', 'weapon2': '0.360', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.186', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:30,849][52662] DAMAGECOUNT value on done: 142994.0 [2024-08-06 00:47:30,850][52662] Sum rewards: 52.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.203', 'WEAPON4': '0.450', 'weapon4': '0.482', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.492', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:31,103][52669] DAMAGECOUNT value on done: 137253.0 [2024-08-06 00:47:31,105][52669] Sum rewards: 59.446, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.112', 'AMMO2': '0.034', 'ARMOR': '0.040', 'AMMO4': '0.169', 'weapon4': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.252', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '52.000'} [2024-08-06 00:47:32,164][52647] DAMAGECOUNT value on done: 145693.0 [2024-08-06 00:47:32,165][52647] Sum rewards: 50.354, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.852', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.188', 'weapon4': '0.210', 'AMMO3': '0.281', 'weapon2': '0.436', 'WEAPON3': '1.650', 'HITCOUNT': '2.900', 'weapon3': '3.090', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:32,398][52667] DAMAGECOUNT value on done: 142355.0 [2024-08-06 00:47:32,399][52667] Sum rewards: 62.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.598', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2024-08-06 00:47:32,548][52660] DAMAGECOUNT value on done: 137933.0 [2024-08-06 00:47:32,549][52660] Sum rewards: 59.758, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO2': '0.009', 'AMMO4': '0.047', 'HEALTH': '0.190', 'AMMO3': '0.193', 'weapon2': '0.294', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.488', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:32,600][52794] DAMAGECOUNT value on done: 141311.0 [2024-08-06 00:47:32,601][52794] Sum rewards: 47.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'ARMOR': '0.004', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.071', 'AMMO3': '0.140', 'weapon5': '0.162', 'WEAPON5': '0.350', 'AMMO4': '0.353', 'weapon2': '0.358', 'weapon4': '0.596', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.634', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '40.000'} [2024-08-06 00:47:32,744][52668] DAMAGECOUNT value on done: 139897.0 [2024-08-06 00:47:32,745][52668] Sum rewards: 67.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.208', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '58.000'} [2024-08-06 00:47:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 207896576. Throughput: 0: 4388.2. Samples: 51974250. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 00:47:32,795][52567] Avg episode reward: [(0, '56.147')] [2024-08-06 00:47:33,354][52664] DAMAGECOUNT value on done: 141329.0 [2024-08-06 00:47:33,355][52664] Sum rewards: 51.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.564', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon4': '0.276', 'weapon2': '0.480', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '2.932', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '44.000'} [2024-08-06 00:47:33,597][52650] Updated weights for policy 0, policy_version 25381 (0.0024) [2024-08-06 00:47:33,947][52662] DAMAGECOUNT value on done: 139903.0 [2024-08-06 00:47:33,947][52662] Sum rewards: 57.762, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.315', 'weapon2': '0.330', 'WEAPON3': '1.850', 'weapon3': '3.160', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:34,172][52669] DAMAGECOUNT value on done: 138884.0 [2024-08-06 00:47:34,173][52669] Sum rewards: 56.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.588', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '3.020', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '49.000'} [2024-08-06 00:47:34,954][52647] DAMAGECOUNT value on done: 140725.0 [2024-08-06 00:47:34,954][52647] Sum rewards: 62.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.196', 'weapon2': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.150', 'weapon3': '2.586', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '53.000'} [2024-08-06 00:47:35,073][52660] DAMAGECOUNT value on done: 141155.0 [2024-08-06 00:47:35,073][52660] Sum rewards: 53.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.583', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.338', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.050', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:35,203][52668] DAMAGECOUNT value on done: 141564.0 [2024-08-06 00:47:35,203][52668] Sum rewards: 49.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon4': '0.250', 'weapon2': '0.710', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '44.000'} [2024-08-06 00:47:35,440][52667] DAMAGECOUNT value on done: 139828.0 [2024-08-06 00:47:35,440][52667] Sum rewards: 50.406, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.034', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.148', 'AMMO4': '0.229', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON4': '0.600', 'weapon4': '0.680', 'WEAPON3': '0.900', 'weapon3': '2.300', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:35,566][52794] DAMAGECOUNT value on done: 151428.0 [2024-08-06 00:47:35,569][52794] Sum rewards: 52.736, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.573', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.946', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:35,870][52664] DAMAGECOUNT value on done: 144082.0 [2024-08-06 00:47:35,871][52664] Sum rewards: 50.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.133', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.165', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.398', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.903', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:36,927][52662] DAMAGECOUNT value on done: 140952.0 [2024-08-06 00:47:36,929][52662] Sum rewards: 63.583, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.185', 'AMMO5': '0.004', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:37,271][52647] DAMAGECOUNT value on done: 145428.0 [2024-08-06 00:47:37,278][52647] Sum rewards: 59.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '52.000'} [2024-08-06 00:47:37,332][52669] DAMAGECOUNT value on done: 138164.0 [2024-08-06 00:47:37,334][52669] Sum rewards: 61.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.185', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.150', 'weapon4': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.514', 'WEAPON3': '0.800', 'weapon3': '3.090', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '49.000'} [2024-08-06 00:47:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 207986688. Throughput: 0: 4386.0. Samples: 52000710. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 00:47:37,794][52567] Avg episode reward: [(0, '55.967')] [2024-08-06 00:47:37,806][52660] DAMAGECOUNT value on done: 147789.0 [2024-08-06 00:47:37,808][52660] Sum rewards: 61.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon4': '0.318', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:37,933][52668] DAMAGECOUNT value on done: 140781.0 [2024-08-06 00:47:37,934][52668] Sum rewards: 59.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.165', 'weapon2': '0.256', 'weapon4': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '48.000'} [2024-08-06 00:47:38,217][52667] DAMAGECOUNT value on done: 138074.0 [2024-08-06 00:47:38,218][52667] Sum rewards: 56.890, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.084', 'AMMO3': '0.178', 'weapon2': '0.416', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.330', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '48.000'} [2024-08-06 00:47:38,556][52794] DAMAGECOUNT value on done: 136838.0 [2024-08-06 00:47:38,556][52794] Sum rewards: 52.325, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.378', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.130', 'weapon4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.266', 'weapon2': '0.438', 'WEAPON3': '1.600', 'weapon3': '2.998', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '48.000'} [2024-08-06 00:47:38,724][52650] Updated weights for policy 0, policy_version 25391 (0.0014) [2024-08-06 00:47:38,764][52664] DAMAGECOUNT value on done: 146802.0 [2024-08-06 00:47:38,764][52664] Sum rewards: 54.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.993', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:39,662][52660] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:47:40,376][52669] DAMAGECOUNT value on done: 138944.0 [2024-08-06 00:47:40,377][52669] Sum rewards: 51.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.278', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '2.906', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '44.000'} [2024-08-06 00:47:40,415][52647] DAMAGECOUNT value on done: 147491.0 [2024-08-06 00:47:40,415][52647] Sum rewards: 56.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.464', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.378', 'weapon4': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:40,726][52660] DAMAGECOUNT value on done: 136660.0 [2024-08-06 00:47:40,726][52660] Sum rewards: 55.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.168', 'weapon4': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.100', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:40,980][52667] DAMAGECOUNT value on done: 142240.0 [2024-08-06 00:47:40,982][52667] Sum rewards: 54.959, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.909', 'AMMO5': '0.010', 'ARMOR': '0.016', 'weapon5': '0.046', 'AMMO2': '0.048', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.232', 'AMMO4': '0.239', 'WEAPON4': '0.550', 'weapon2': '0.618', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:41,393][52664] DAMAGECOUNT value on done: 142777.0 [2024-08-06 00:47:41,393][52664] Sum rewards: 50.865, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.167', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.478', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '2.940', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '41.000'} [2024-08-06 00:47:41,613][52794] DAMAGECOUNT value on done: 148614.0 [2024-08-06 00:47:41,616][52794] Sum rewards: 60.683, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.918', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.232', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'weapon4': '0.386', 'weapon2': '0.534', 'WEAPON3': '1.600', 'weapon3': '2.714', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '55.000'} [2024-08-06 00:47:42,530][52664] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 00:47:42,748][52647] DAMAGECOUNT value on done: 141294.0 [2024-08-06 00:47:42,749][52647] Sum rewards: 56.755, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.251', 'weapon4': '0.258', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:42,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 208076800. Throughput: 0: 4388.4. Samples: 52027070. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:47:42,794][52567] Avg episode reward: [(0, '55.722')] [2024-08-06 00:47:43,063][52650] Updated weights for policy 0, policy_version 25401 (0.0023) [2024-08-06 00:47:43,403][52660] DAMAGECOUNT value on done: 141184.0 [2024-08-06 00:47:43,403][52660] Sum rewards: 68.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.836', 'AMMO2': '0.021', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.223', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '59.000'} [2024-08-06 00:47:43,534][52669] DAMAGECOUNT value on done: 140229.0 [2024-08-06 00:47:43,536][52669] Sum rewards: 59.021, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.801', 'AMMO5': '0.007', 'AMMO2': '0.033', 'ARMOR': '0.040', 'weapon5': '0.046', 'weapon4': '0.064', 'AMMO3': '0.151', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.864', 'WEAPON3': '1.000', 'weapon3': '2.880', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:44,240][52667] DAMAGECOUNT value on done: 136996.0 [2024-08-06 00:47:44,242][52667] Sum rewards: 61.533, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.012', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.158', 'weapon4': '0.208', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.694', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:44,328][52664] DAMAGECOUNT value on done: 143997.0 [2024-08-06 00:47:44,329][52664] Sum rewards: 55.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.537', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'AMMO4': '0.180', 'weapon4': '0.424', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '2.716', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '46.500'} [2024-08-06 00:47:44,922][52794] DAMAGECOUNT value on done: 142426.0 [2024-08-06 00:47:44,924][52794] Sum rewards: 50.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.164', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '42.000'} [2024-08-06 00:47:45,550][52658] DAMAGECOUNT value on done: 143541.0 [2024-08-06 00:47:45,555][52658] Sum rewards: 64.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.148', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon2': '0.450', 'weapon4': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '54.000'} [2024-08-06 00:47:45,960][52647] DAMAGECOUNT value on done: 144804.0 [2024-08-06 00:47:45,960][52647] Sum rewards: 52.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.019', 'weapon5': '0.028', 'AMMO2': '0.052', 'AMMO3': '0.203', 'AMMO4': '0.261', 'weapon4': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.994', 'WEAPON3': '1.150', 'weapon3': '2.454', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:46,110][52660] DAMAGECOUNT value on done: 133530.0 [2024-08-06 00:47:46,111][52660] Sum rewards: 30.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.060', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.198', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.546', 'WEAPON3': '1.200', 'HITCOUNT': '1.870', 'weapon3': '2.246', 'DAMAGECOUNT': '8.424', 'FRAGCOUNT': '29.000'} [2024-08-06 00:47:46,746][52669] DAMAGECOUNT value on done: 140542.0 [2024-08-06 00:47:46,748][52669] Sum rewards: 62.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.270', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.250', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '52.000'} [2024-08-06 00:47:47,110][52664] DAMAGECOUNT value on done: 145441.0 [2024-08-06 00:47:47,111][52664] Sum rewards: 42.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.644', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.022', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.181', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.376', 'weapon4': '0.766', 'WEAPON3': '1.050', 'weapon3': '2.568', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.778', 'FRAGCOUNT': '36.000'} [2024-08-06 00:47:47,117][52667] DAMAGECOUNT value on done: 143371.0 [2024-08-06 00:47:47,120][52667] Sum rewards: 60.769, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.096', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.652', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '51.000'} [2024-08-06 00:47:47,739][52650] Updated weights for policy 0, policy_version 25411 (0.0041) [2024-08-06 00:47:47,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 208166912. Throughput: 0: 4390.9. Samples: 52040220. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:47:47,795][52567] Avg episode reward: [(0, '55.695')] [2024-08-06 00:47:48,036][52794] DAMAGECOUNT value on done: 142235.0 [2024-08-06 00:47:48,037][52794] Sum rewards: 54.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.671', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '48.000'} [2024-08-06 00:47:48,218][52647] DAMAGECOUNT value on done: 140148.0 [2024-08-06 00:47:48,219][52647] Sum rewards: 52.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.472', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon5': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.196', 'weapon4': '0.286', 'weapon2': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.036', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:48,524][52660] DAMAGECOUNT value on done: 141862.0 [2024-08-06 00:47:48,524][52660] Sum rewards: 43.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.609', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.124', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon2': '0.990', 'WEAPON3': '1.050', 'weapon3': '2.534', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '36.000'} [2024-08-06 00:47:48,660][52658] DAMAGECOUNT value on done: 140107.0 [2024-08-06 00:47:48,660][52658] Sum rewards: 52.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.498', 'AMMO2': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.202', 'AMMO3': '0.269', 'weapon4': '0.382', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:49,858][52669] DAMAGECOUNT value on done: 135764.0 [2024-08-06 00:47:49,859][52669] Sum rewards: 44.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.582', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO4': '0.167', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.460', 'weapon2': '0.798', 'WEAPON3': '1.150', 'weapon3': '2.492', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.181', 'FRAGCOUNT': '40.500'} [2024-08-06 00:47:49,893][52664] DAMAGECOUNT value on done: 141637.0 [2024-08-06 00:47:49,893][52664] Sum rewards: 48.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.102', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.052', 'weapon5': '0.126', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'weapon2': '0.542', 'WEAPON4': '0.750', 'weapon4': '0.960', 'WEAPON3': '1.250', 'weapon3': '1.956', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:50,202][52667] DAMAGECOUNT value on done: 147482.0 [2024-08-06 00:47:50,203][52667] Sum rewards: 52.759, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.180', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.068', 'AMMO3': '0.138', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.340', 'weapon2': '0.566', 'WEAPON4': '0.600', 'weapon4': '0.822', 'WEAPON3': '0.850', 'weapon3': '2.164', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:51,315][52647] DAMAGECOUNT value on done: 145906.0 [2024-08-06 00:47:51,315][52647] Sum rewards: 52.298, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'AMMO4': '0.232', 'weapon2': '0.304', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.002', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:51,433][52794] DAMAGECOUNT value on done: 149046.0 [2024-08-06 00:47:51,434][52794] Sum rewards: 59.746, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.076', 'AMMO3': '0.113', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.350', 'weapon2': '0.560', 'weapon4': '0.636', 'WEAPON3': '0.800', 'weapon3': '2.526', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '46.500'} [2024-08-06 00:47:51,458][52658] DAMAGECOUNT value on done: 142059.0 [2024-08-06 00:47:51,460][52658] Sum rewards: 54.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.244', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:51,516][52660] DAMAGECOUNT value on done: 135760.0 [2024-08-06 00:47:51,519][52660] Sum rewards: 48.804, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.158', 'WEAPON4': '0.300', 'weapon2': '0.554', 'weapon4': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.602', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '40.000'} [2024-08-06 00:47:52,151][52669] DAMAGECOUNT value on done: 142227.0 [2024-08-06 00:47:52,152][52669] Sum rewards: 65.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.485', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon4': '0.312', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '57.000'} [2024-08-06 00:47:52,539][52650] Updated weights for policy 0, policy_version 25421 (0.0021) [2024-08-06 00:47:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 208257024. Throughput: 0: 4395.8. Samples: 52066710. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:47:52,794][52567] Avg episode reward: [(0, '55.389')] [2024-08-06 00:47:52,816][52664] DAMAGECOUNT value on done: 144003.0 [2024-08-06 00:47:52,817][52664] Sum rewards: 47.202, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.809', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.193', 'weapon2': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '3.316', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '40.000'} [2024-08-06 00:47:53,051][52667] DAMAGECOUNT value on done: 144364.0 [2024-08-06 00:47:53,052][52667] Sum rewards: 59.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.206', 'weapon4': '0.238', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.068', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '52.000'} [2024-08-06 00:47:53,175][52649] DAMAGECOUNT value on done: 135398.0 [2024-08-06 00:47:53,176][52649] Sum rewards: 45.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.562', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'AMMO3': '0.210', 'weapon2': '0.288', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.866', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '41.000'} [2024-08-06 00:47:54,221][52794] DAMAGECOUNT value on done: 144492.0 [2024-08-06 00:47:54,223][52794] Sum rewards: 55.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.113', 'weapon5': '0.166', 'AMMO4': '0.235', 'weapon4': '0.238', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.660', 'WEAPON3': '0.750', 'weapon3': '2.686', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '45.000'} [2024-08-06 00:47:54,691][52669] DAMAGECOUNT value on done: 141323.0 [2024-08-06 00:47:54,693][52669] Sum rewards: 47.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.951', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.158', 'AMMO3': '0.200', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.450', 'weapon2': '0.654', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '2.538', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '43.000'} [2024-08-06 00:47:54,751][52658] DAMAGECOUNT value on done: 143353.0 [2024-08-06 00:47:54,752][52658] Sum rewards: 58.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.734', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.056', 'AMMO4': '0.141', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '50.000'} [2024-08-06 00:47:56,114][52667] DAMAGECOUNT value on done: 146480.0 [2024-08-06 00:47:56,117][52667] Sum rewards: 48.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.374', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.035', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.570', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.594', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '39.000'} [2024-08-06 00:47:56,274][52649] DAMAGECOUNT value on done: 133930.0 [2024-08-06 00:47:56,275][52649] Sum rewards: 55.276, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.381', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.125', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '3.132', 'DAMAGECOUNT': '12.810', 'FRAGCOUNT': '46.000'} [2024-08-06 00:47:57,122][52669] DAMAGECOUNT value on done: 136731.0 [2024-08-06 00:47:57,124][52669] Sum rewards: 35.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.396', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.156', 'weapon5': '0.210', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon2': '0.986', 'weapon3': '2.104', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '10.548', 'FRAGCOUNT': '29.500'} [2024-08-06 00:47:57,259][52650] Updated weights for policy 0, policy_version 25431 (0.0020) [2024-08-06 00:47:57,756][52658] DAMAGECOUNT value on done: 143906.0 [2024-08-06 00:47:57,757][52658] Sum rewards: 55.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.048', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.216', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '47.000'} [2024-08-06 00:47:57,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 208330752. Throughput: 0: 4403.3. Samples: 52093360. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:47:57,795][52567] Avg episode reward: [(0, '55.297')] [2024-08-06 00:47:58,037][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:47:58,901][52649] DAMAGECOUNT value on done: 135478.0 [2024-08-06 00:47:58,903][52649] Sum rewards: 50.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.434', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.438', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '41.000'} [2024-08-06 00:47:59,031][52667] DAMAGECOUNT value on done: 137800.0 [2024-08-06 00:47:59,031][52667] Sum rewards: 54.967, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.302', 'AMMO5': '0.009', 'weapon5': '0.038', 'AMMO2': '0.049', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO4': '0.247', 'AMMO3': '0.315', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.142', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:00,122][52669] DAMAGECOUNT value on done: 139970.0 [2024-08-06 00:48:00,122][52669] Sum rewards: 56.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.180', 'WEAPON4': '0.400', 'weapon4': '0.718', 'weapon2': '0.774', 'WEAPON3': '1.100', 'weapon3': '2.302', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '48.000'} [2024-08-06 00:48:00,534][52658] DAMAGECOUNT value on done: 137045.0 [2024-08-06 00:48:00,534][52658] Sum rewards: 59.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.400', 'weapon2': '0.416', 'weapon4': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:01,710][52650] Updated weights for policy 0, policy_version 25441 (0.0023) [2024-08-06 00:48:01,743][52667] DAMAGECOUNT value on done: 145508.0 [2024-08-06 00:48:01,744][52667] Sum rewards: 61.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.497', 'AMMO5': '0.010', 'weapon5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.520', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.130', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '54.000'} [2024-08-06 00:48:01,951][52649] DAMAGECOUNT value on done: 137654.0 [2024-08-06 00:48:01,953][52649] Sum rewards: 60.566, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.908', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO4': '0.215', 'AMMO3': '0.224', 'weapon5': '0.284', 'weapon2': '0.310', 'weapon4': '0.438', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.650', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 208429056. Throughput: 0: 4404.0. Samples: 52106390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:48:02,794][52567] Avg episode reward: [(0, '55.291')] [2024-08-06 00:48:02,986][52666] DAMAGECOUNT value on done: 140679.0 [2024-08-06 00:48:02,988][52666] Sum rewards: 55.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.032', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.280', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '45.000'} [2024-08-06 00:48:03,053][52669] DAMAGECOUNT value on done: 146128.0 [2024-08-06 00:48:03,053][52669] Sum rewards: 53.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.174', 'weapon2': '0.336', 'WEAPON4': '0.500', 'weapon4': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '46.000'} [2024-08-06 00:48:03,520][52658] DAMAGECOUNT value on done: 146809.0 [2024-08-06 00:48:03,522][52658] Sum rewards: 58.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.688', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.221', 'weapon2': '0.230', 'WEAPON4': '0.400', 'weapon4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.864', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:04,942][52649] DAMAGECOUNT value on done: 130672.0 [2024-08-06 00:48:04,943][52649] Sum rewards: 57.270, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.765', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:05,003][52795] DAMAGECOUNT value on done: 129170.0 [2024-08-06 00:48:05,004][52795] Sum rewards: 62.298, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.783', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.084', 'weapon4': '0.118', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '56.000'} [2024-08-06 00:48:05,910][52669] DAMAGECOUNT value on done: 150385.0 [2024-08-06 00:48:05,910][52669] Sum rewards: 63.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.076', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.724', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:05,997][52666] DAMAGECOUNT value on done: 140675.0 [2024-08-06 00:48:06,000][52666] Sum rewards: 57.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.787', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.434', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.346', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:06,336][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:48:06,341][52658] DAMAGECOUNT value on done: 136786.0 [2024-08-06 00:48:06,342][52658] Sum rewards: 48.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '0.950', 'weapon3': '2.354', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '42.000'} [2024-08-06 00:48:06,599][52650] Updated weights for policy 0, policy_version 25451 (0.0028) [2024-08-06 00:48:07,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 208519168. Throughput: 0: 4401.8. Samples: 52132760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:48:07,794][52567] Avg episode reward: [(0, '55.163')] [2024-08-06 00:48:08,138][52649] DAMAGECOUNT value on done: 135030.0 [2024-08-06 00:48:08,141][52649] Sum rewards: 63.132, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:08,149][52795] DAMAGECOUNT value on done: 126556.0 [2024-08-06 00:48:08,150][52795] Sum rewards: 56.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.093', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.074', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.026', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:08,453][52669] DAMAGECOUNT value on done: 139081.0 [2024-08-06 00:48:08,454][52669] Sum rewards: 61.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.127', 'weapon5': '0.176', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.704', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '52.000'} [2024-08-06 00:48:08,903][52666] DAMAGECOUNT value on done: 140726.0 [2024-08-06 00:48:08,903][52666] Sum rewards: 57.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.555', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.052', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.258', 'WEAPON4': '0.550', 'weapon4': '0.676', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.270', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '48.000'} [2024-08-06 00:48:09,153][52658] DAMAGECOUNT value on done: 145246.0 [2024-08-06 00:48:09,153][52658] Sum rewards: 61.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon4': '0.404', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '52.000'} [2024-08-06 00:48:11,046][52650] Updated weights for policy 0, policy_version 25461 (0.0043) [2024-08-06 00:48:11,258][52649] DAMAGECOUNT value on done: 132716.0 [2024-08-06 00:48:11,258][52649] Sum rewards: 56.157, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.251', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:11,299][52795] DAMAGECOUNT value on done: 127896.0 [2024-08-06 00:48:11,302][52795] Sum rewards: 62.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.780', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '55.000'} [2024-08-06 00:48:11,303][52669] DAMAGECOUNT value on done: 140091.0 [2024-08-06 00:48:11,305][52669] Sum rewards: 47.722, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.405', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.113', 'AMMO4': '0.156', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.732', 'WEAPON3': '0.800', 'weapon3': '2.618', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.195', 'FRAGCOUNT': '39.000'} [2024-08-06 00:48:11,786][52658] DAMAGECOUNT value on done: 145349.0 [2024-08-06 00:48:11,788][52658] Sum rewards: 62.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.207', 'weapon2': '0.402', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.194', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '52.000'} [2024-08-06 00:48:11,981][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:48:12,128][52666] DAMAGECOUNT value on done: 138055.0 [2024-08-06 00:48:12,128][52666] Sum rewards: 63.161, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.487', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.024', 'AMMO4': '0.076', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '55.000'} [2024-08-06 00:48:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 208601088. Throughput: 0: 4404.4. Samples: 52159270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:48:12,802][52567] Avg episode reward: [(0, '55.515')] [2024-08-06 00:48:13,091][52670] DAMAGECOUNT value on done: 137880.0 [2024-08-06 00:48:13,091][52670] Sum rewards: 67.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.041', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.338', 'weapon4': '0.380', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '57.000'} [2024-08-06 00:48:14,309][52669] DAMAGECOUNT value on done: 142114.0 [2024-08-06 00:48:14,312][52669] Sum rewards: 61.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.209', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:14,403][52649] DAMAGECOUNT value on done: 139374.0 [2024-08-06 00:48:14,404][52649] Sum rewards: 58.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.148', 'weapon4': '0.168', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.500', 'weapon3': '2.846', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:14,553][52795] DAMAGECOUNT value on done: 128242.0 [2024-08-06 00:48:14,554][52795] Sum rewards: 67.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.351', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.219', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.302', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '57.000'} [2024-08-06 00:48:14,791][52658] DAMAGECOUNT value on done: 146103.0 [2024-08-06 00:48:14,793][52658] Sum rewards: 63.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.452', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.168', 'AMMO3': '0.182', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:15,209][52666] DAMAGECOUNT value on done: 136351.0 [2024-08-06 00:48:15,210][52666] Sum rewards: 59.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.919', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'AMMO4': '0.226', 'weapon2': '0.388', 'WEAPON4': '0.400', 'weapon4': '0.810', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:15,614][52650] Updated weights for policy 0, policy_version 25471 (0.0013) [2024-08-06 00:48:16,411][52670] DAMAGECOUNT value on done: 143076.0 [2024-08-06 00:48:16,412][52670] Sum rewards: 59.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.139', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon4': '0.292', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:17,308][52669] DAMAGECOUNT value on done: 143733.0 [2024-08-06 00:48:17,309][52669] Sum rewards: 54.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.877', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.166', 'weapon4': '0.194', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.678', 'WEAPON3': '1.000', 'weapon3': '2.578', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '45.000'} [2024-08-06 00:48:17,598][52649] DAMAGECOUNT value on done: 133557.0 [2024-08-06 00:48:17,599][52649] Sum rewards: 66.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.240', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.000'} [2024-08-06 00:48:17,713][52658] DAMAGECOUNT value on done: 137156.0 [2024-08-06 00:48:17,715][52658] Sum rewards: 53.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.034', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.306', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '46.000'} [2024-08-06 00:48:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 208691200. Throughput: 0: 4397.8. Samples: 52172150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:48:17,794][52567] Avg episode reward: [(0, '56.017')] [2024-08-06 00:48:17,902][52795] DAMAGECOUNT value on done: 130754.0 [2024-08-06 00:48:17,902][52795] Sum rewards: 60.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.951', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'AMMO4': '0.245', 'weapon2': '0.382', 'weapon4': '0.520', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:18,461][52666] DAMAGECOUNT value on done: 134679.0 [2024-08-06 00:48:18,462][52666] Sum rewards: 58.267, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.046', 'weapon4': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon5': '0.180', 'weapon2': '0.840', 'WEAPON3': '1.050', 'weapon3': '2.760', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:19,755][52670] DAMAGECOUNT value on done: 137634.0 [2024-08-06 00:48:19,757][52670] Sum rewards: 68.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '59.000'} [2024-08-06 00:48:20,539][52650] Updated weights for policy 0, policy_version 25481 (0.0029) [2024-08-06 00:48:20,621][52658] DAMAGECOUNT value on done: 140710.0 [2024-08-06 00:48:20,623][52658] Sum rewards: 63.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.170', 'AMMO4': '0.181', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.394', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '54.000'} [2024-08-06 00:48:20,779][52649] DAMAGECOUNT value on done: 136819.0 [2024-08-06 00:48:20,779][52649] Sum rewards: 56.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.082', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '48.000'} [2024-08-06 00:48:21,078][52795] DAMAGECOUNT value on done: 128632.0 [2024-08-06 00:48:21,078][52795] Sum rewards: 45.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '2.774', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '38.000'} [2024-08-06 00:48:21,199][52666] DAMAGECOUNT value on done: 137197.0 [2024-08-06 00:48:21,199][52666] Sum rewards: 54.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.164', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.136', 'AMMO4': '0.217', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.400', 'weapon4': '0.664', 'WEAPON3': '1.400', 'weapon3': '2.444', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '46.500'} [2024-08-06 00:48:22,455][52670] DAMAGECOUNT value on done: 138647.0 [2024-08-06 00:48:22,463][52670] Sum rewards: 44.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.096', 'AMMO3': '0.171', 'AMMO4': '0.207', 'weapon4': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.800', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '38.000'} [2024-08-06 00:48:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 208781312. Throughput: 0: 4399.1. Samples: 52198670. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:48:22,794][52567] Avg episode reward: [(0, '56.117')] [2024-08-06 00:48:23,253][52658] DAMAGECOUNT value on done: 140114.0 [2024-08-06 00:48:23,256][52658] Sum rewards: 62.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.181', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:23,921][52649] DAMAGECOUNT value on done: 135381.0 [2024-08-06 00:48:23,921][52649] Sum rewards: 40.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.968', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.127', 'AMMO3': '0.148', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '0.900', 'weapon4': '1.302', 'HITCOUNT': '2.060', 'weapon3': '2.066', 'DAMAGECOUNT': '8.928', 'FRAGCOUNT': '35.000'} [2024-08-06 00:48:24,250][52795] DAMAGECOUNT value on done: 132339.0 [2024-08-06 00:48:24,250][52795] Sum rewards: 52.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.626', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.101', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '1.102', 'WEAPON3': '1.350', 'weapon3': '2.380', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '46.000'} [2024-08-06 00:48:24,420][52666] DAMAGECOUNT value on done: 138866.0 [2024-08-06 00:48:24,420][52666] Sum rewards: 59.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.309', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.486', 'weapon4': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:24,923][52650] Updated weights for policy 0, policy_version 25491 (0.0012) [2024-08-06 00:48:25,583][52670] DAMAGECOUNT value on done: 141354.0 [2024-08-06 00:48:25,585][52670] Sum rewards: 53.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.874', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '3.362', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '45.000'} [2024-08-06 00:48:26,226][52658] DAMAGECOUNT value on done: 139625.0 [2024-08-06 00:48:26,227][52658] Sum rewards: 58.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.558', 'AMMO2': '0.012', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.310', 'weapon2': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:27,061][52649] DAMAGECOUNT value on done: 133293.0 [2024-08-06 00:48:27,062][52649] Sum rewards: 54.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.915', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'weapon4': '0.470', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.700', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:27,132][52666] DAMAGECOUNT value on done: 140342.0 [2024-08-06 00:48:27,133][52666] Sum rewards: 54.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.666', 'AMMO5': '0.003', 'AMMO2': '0.034', 'ARMOR': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon4': '0.362', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '48.000'} [2024-08-06 00:48:27,481][52795] DAMAGECOUNT value on done: 131821.0 [2024-08-06 00:48:27,481][52795] Sum rewards: 55.346, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.614', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon5': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.334', 'weapon4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.792', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 208863232. Throughput: 0: 4397.5. Samples: 52224960. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:48:27,795][52567] Avg episode reward: [(0, '56.018')] [2024-08-06 00:48:27,834][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000025497_208871424.pth... [2024-08-06 00:48:28,004][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000024982_204652544.pth [2024-08-06 00:48:28,587][52670] DAMAGECOUNT value on done: 140895.0 [2024-08-06 00:48:28,588][52670] Sum rewards: 54.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.094', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.272', 'weapon4': '0.352', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.024', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:29,830][52658] DAMAGECOUNT value on done: 144148.0 [2024-08-06 00:48:29,830][52658] Sum rewards: 55.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.596', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.054', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:29,846][52650] Updated weights for policy 0, policy_version 25501 (0.0068) [2024-08-06 00:48:29,887][52649] DAMAGECOUNT value on done: 139809.0 [2024-08-06 00:48:29,889][52649] Sum rewards: 56.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.237', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON1': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.180', 'weapon2': '0.572', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.252', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:30,392][52666] DAMAGECOUNT value on done: 139357.0 [2024-08-06 00:48:30,393][52666] Sum rewards: 60.850, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.315', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.184', 'AMMO3': '0.236', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '56.000'} [2024-08-06 00:48:30,575][52795] DAMAGECOUNT value on done: 128388.0 [2024-08-06 00:48:30,576][52795] Sum rewards: 58.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.014', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon5': '0.176', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.136', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '46.500'} [2024-08-06 00:48:31,075][52663] DAMAGECOUNT value on done: 138931.0 [2024-08-06 00:48:31,076][52663] Sum rewards: 54.206, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.605', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.014', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'weapon2': '0.378', 'weapon4': '0.564', 'WEAPON3': '0.850', 'weapon3': '2.820', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2024-08-06 00:48:31,851][52670] DAMAGECOUNT value on done: 134525.0 [2024-08-06 00:48:31,852][52670] Sum rewards: 59.203, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.055', 'weapon5': '0.102', 'AMMO3': '0.155', 'HEALTH': '0.236', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'weapon4': '0.862', 'weapon3': '2.374', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '48.000'} [2024-08-06 00:48:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 208953344. Throughput: 0: 4388.3. Samples: 52237690. Policy #0 lag: (min: 0.0, avg: 2.5, max: 8.0) [2024-08-06 00:48:32,794][52567] Avg episode reward: [(0, '55.888')] [2024-08-06 00:48:32,988][52649] DAMAGECOUNT value on done: 138597.0 [2024-08-06 00:48:32,989][52649] Sum rewards: 57.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.662', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.302', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.372', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:33,141][52658] DAMAGECOUNT value on done: 144952.0 [2024-08-06 00:48:33,142][52658] Sum rewards: 71.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.203', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '59.000'} [2024-08-06 00:48:33,338][52666] DAMAGECOUNT value on done: 137186.0 [2024-08-06 00:48:33,339][52666] Sum rewards: 57.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.115', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.136', 'AMMO3': '0.271', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.386', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:33,669][52795] DAMAGECOUNT value on done: 130955.0 [2024-08-06 00:48:33,669][52795] Sum rewards: 59.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.079', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon4': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '52.000'} [2024-08-06 00:48:33,816][52671] DAMAGECOUNT value on done: 146356.0 [2024-08-06 00:48:33,819][52671] Sum rewards: 52.125, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.112', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.110', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '48.000'} [2024-08-06 00:48:34,160][52663] DAMAGECOUNT value on done: 141067.0 [2024-08-06 00:48:34,163][52663] Sum rewards: 58.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.166', 'AMMO3': '0.218', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:34,332][52650] Updated weights for policy 0, policy_version 25511 (0.0012) [2024-08-06 00:48:34,515][52670] DAMAGECOUNT value on done: 139001.0 [2024-08-06 00:48:34,516][52670] Sum rewards: 67.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.739', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon2': '0.348', 'weapon4': '0.446', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '58.000'} [2024-08-06 00:48:35,846][52649] DAMAGECOUNT value on done: 132309.0 [2024-08-06 00:48:35,848][52649] Sum rewards: 48.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.657', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.410', 'weapon4': '0.452', 'WEAPON3': '1.550', 'HITCOUNT': '2.740', 'weapon3': '2.744', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '45.000'} [2024-08-06 00:48:35,891][52658] DAMAGECOUNT value on done: 136893.0 [2024-08-06 00:48:35,891][52658] Sum rewards: 49.623, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.904', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.053', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'AMMO4': '0.264', 'weapon4': '0.396', 'WEAPON4': '0.550', 'weapon2': '0.640', 'WEAPON3': '1.500', 'weapon3': '2.492', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:36,080][52666] DAMAGECOUNT value on done: 134465.0 [2024-08-06 00:48:36,082][52666] Sum rewards: 53.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.872', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.158', 'weapon2': '0.744', 'WEAPON3': '0.900', 'HITCOUNT': '2.860', 'weapon3': '2.880', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '43.000'} [2024-08-06 00:48:36,690][52795] DAMAGECOUNT value on done: 129555.0 [2024-08-06 00:48:36,691][52795] Sum rewards: 53.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.602', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.386', 'weapon2': '0.392', 'ARMOR': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.092', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '44.000'} [2024-08-06 00:48:36,723][52671] DAMAGECOUNT value on done: 139890.0 [2024-08-06 00:48:36,723][52671] Sum rewards: 55.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon7': '0.050', 'AMMO4': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.203', 'weapon4': '0.318', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:37,233][52670] DAMAGECOUNT value on done: 134353.0 [2024-08-06 00:48:37,234][52670] Sum rewards: 59.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.195', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:37,265][52663] DAMAGECOUNT value on done: 139957.0 [2024-08-06 00:48:37,266][52663] Sum rewards: 40.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.006', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.177', 'weapon5': '0.250', 'AMMO4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.356', 'weapon4': '0.660', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.420', 'weapon3': '2.478', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '35.500'} [2024-08-06 00:48:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 209043456. Throughput: 0: 4387.8. Samples: 52264160. Policy #0 lag: (min: 0.0, avg: 2.5, max: 8.0) [2024-08-06 00:48:37,794][52567] Avg episode reward: [(0, '55.835')] [2024-08-06 00:48:38,915][52649] DAMAGECOUNT value on done: 138496.0 [2024-08-06 00:48:38,917][52649] Sum rewards: 58.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.254', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:38,999][52666] DAMAGECOUNT value on done: 141318.0 [2024-08-06 00:48:39,001][52666] Sum rewards: 67.442, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.214', 'AMMO5': '0.016', 'ARMOR': '0.028', 'AMMO2': '0.063', 'weapon5': '0.210', 'weapon4': '0.228', 'AMMO3': '0.239', 'AMMO4': '0.314', 'weapon2': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '59.000'} [2024-08-06 00:48:39,075][52650] Updated weights for policy 0, policy_version 25521 (0.0020) [2024-08-06 00:48:39,107][52658] DAMAGECOUNT value on done: 139010.0 [2024-08-06 00:48:39,107][52658] Sum rewards: 53.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'AMMO4': '0.214', 'weapon4': '0.222', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '46.000'} [2024-08-06 00:48:39,204][52671] DAMAGECOUNT value on done: 144980.0 [2024-08-06 00:48:39,204][52671] Sum rewards: 49.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.295', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.118', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '41.000'} [2024-08-06 00:48:39,651][52662] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.07200000000000001, -24.0), ('weapon5', 0.002)] [2024-08-06 00:48:39,765][52795] DAMAGECOUNT value on done: 128402.0 [2024-08-06 00:48:39,766][52795] Sum rewards: 57.270, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.281', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.110', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.297', 'weapon2': '0.378', 'WEAPON3': '1.750', 'weapon3': '3.148', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '52.000'} [2024-08-06 00:48:40,224][52670] DAMAGECOUNT value on done: 131347.0 [2024-08-06 00:48:40,225][52670] Sum rewards: 48.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.042', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.068', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.226', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '43.000'} [2024-08-06 00:48:40,266][52663] DAMAGECOUNT value on done: 139631.0 [2024-08-06 00:48:40,267][52663] Sum rewards: 64.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.018', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.074', 'AMMO3': '0.138', 'AMMO4': '0.192', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '0.950', 'weapon3': '2.994', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:41,914][52649] DAMAGECOUNT value on done: 136245.0 [2024-08-06 00:48:41,917][52649] Sum rewards: 61.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.062', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon4': '0.124', 'weapon5': '0.132', 'AMMO3': '0.143', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.604', 'WEAPON3': '0.900', 'weapon3': '2.952', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:41,951][52666] DAMAGECOUNT value on done: 141643.0 [2024-08-06 00:48:41,951][52666] Sum rewards: 51.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.018', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.191', 'weapon2': '0.612', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.128', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '44.000'} [2024-08-06 00:48:41,992][52658] DAMAGECOUNT value on done: 144507.0 [2024-08-06 00:48:41,993][52658] Sum rewards: 51.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.055', 'weapon5': '0.086', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'AMMO4': '0.276', 'weapon4': '0.514', 'WEAPON4': '0.600', 'weapon2': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.532', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '43.000'} [2024-08-06 00:48:42,334][52671] DAMAGECOUNT value on done: 139848.0 [2024-08-06 00:48:42,334][52671] Sum rewards: 61.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO3': '0.174', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.412', 'weapon4': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 209133568. Throughput: 0: 4383.6. Samples: 52290620. Policy #0 lag: (min: 0.0, avg: 2.5, max: 8.0) [2024-08-06 00:48:42,794][52567] Avg episode reward: [(0, '56.471')] [2024-08-06 00:48:42,825][52795] DAMAGECOUNT value on done: 127831.0 [2024-08-06 00:48:42,827][52795] Sum rewards: 54.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.391', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'weapon4': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.302', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.226', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '48.000'} [2024-08-06 00:48:43,195][52670] DAMAGECOUNT value on done: 142276.0 [2024-08-06 00:48:43,196][52670] Sum rewards: 65.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.046', 'weapon4': '0.052', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.260', 'weapon2': '0.270', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.402', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '57.000'} [2024-08-06 00:48:43,280][52663] DAMAGECOUNT value on done: 136681.0 [2024-08-06 00:48:43,281][52663] Sum rewards: 63.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.158', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.065', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.346', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.354', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '52.000'} [2024-08-06 00:48:43,605][52650] Updated weights for policy 0, policy_version 25531 (0.0024) [2024-08-06 00:48:44,227][52649] DAMAGECOUNT value on done: 141827.0 [2024-08-06 00:48:44,228][52649] Sum rewards: 70.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.435', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.191', 'weapon2': '0.276', 'WEAPON3': '1.100', 'HITCOUNT': '3.320', 'weapon3': '3.466', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '59.000'} [2024-08-06 00:48:44,949][52666] DAMAGECOUNT value on done: 138110.0 [2024-08-06 00:48:44,951][52666] Sum rewards: 55.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.615', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.086', 'AMMO3': '0.203', 'weapon2': '0.644', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.108', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:45,414][52671] DAMAGECOUNT value on done: 141565.0 [2024-08-06 00:48:45,415][52671] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO3': '0.229', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.348', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '59.000'} [2024-08-06 00:48:45,924][52795] DAMAGECOUNT value on done: 129434.0 [2024-08-06 00:48:45,924][52795] Sum rewards: 62.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.984', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.192', 'AMMO3': '0.241', 'weapon4': '0.250', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '54.000'} [2024-08-06 00:48:46,066][52663] DAMAGECOUNT value on done: 146523.0 [2024-08-06 00:48:46,066][52663] Sum rewards: 59.387, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.088', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.271', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.220', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '53.000'} [2024-08-06 00:48:46,309][52670] DAMAGECOUNT value on done: 139842.0 [2024-08-06 00:48:46,310][52670] Sum rewards: 58.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.794', 'AMMO2': '0.017', 'ARMOR': '0.024', 'AMMO4': '0.085', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.266', 'weapon4': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:47,509][52649] DAMAGECOUNT value on done: 138719.0 [2024-08-06 00:48:47,511][52649] Sum rewards: 55.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.044', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.176', 'weapon5': '0.188', 'weapon2': '0.404', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.548', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:47,783][52666] DAMAGECOUNT value on done: 136137.0 [2024-08-06 00:48:47,783][52666] Sum rewards: 52.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.515', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.208', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.458', 'weapon2': '0.696', 'WEAPON3': '1.400', 'weapon3': '2.448', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '46.000'} [2024-08-06 00:48:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 209215488. Throughput: 0: 4390.0. Samples: 52303940. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:48:47,794][52567] Avg episode reward: [(0, '57.276')] [2024-08-06 00:48:48,519][52650] Updated weights for policy 0, policy_version 25541 (0.0021) [2024-08-06 00:48:48,583][52671] DAMAGECOUNT value on done: 142761.0 [2024-08-06 00:48:48,586][52671] Sum rewards: 64.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.018', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.344', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '55.000'} [2024-08-06 00:48:48,835][52663] DAMAGECOUNT value on done: 143478.0 [2024-08-06 00:48:48,836][52663] Sum rewards: 55.719, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.366', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.066', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'AMMO3': '0.254', 'weapon4': '0.374', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.836', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:49,017][52795] DAMAGECOUNT value on done: 125705.0 [2024-08-06 00:48:49,020][52795] Sum rewards: 51.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon4': '0.252', 'weapon2': '0.292', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.242', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '46.000'} [2024-08-06 00:48:49,180][52670] DAMAGECOUNT value on done: 139980.0 [2024-08-06 00:48:49,182][52670] Sum rewards: 63.223, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.914', 'AMMO5': '0.004', 'AMMO2': '0.027', 'ARMOR': '0.044', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'weapon2': '0.256', 'AMMO3': '0.276', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.146', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '57.000'} [2024-08-06 00:48:50,473][52666] DAMAGECOUNT value on done: 137543.0 [2024-08-06 00:48:50,473][52666] Sum rewards: 51.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.190', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.022', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '45.000'} [2024-08-06 00:48:50,596][52649] DAMAGECOUNT value on done: 143389.0 [2024-08-06 00:48:50,596][52649] Sum rewards: 59.974, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.465', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.378', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '2.906', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:51,248][52671] DAMAGECOUNT value on done: 142998.0 [2024-08-06 00:48:51,248][52671] Sum rewards: 57.004, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.978', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.059', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'AMMO4': '0.296', 'weapon2': '0.428', 'WEAPON4': '0.650', 'weapon4': '0.678', 'WEAPON3': '1.400', 'weapon3': '2.496', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2024-08-06 00:48:51,657][52663] DAMAGECOUNT value on done: 139046.0 [2024-08-06 00:48:51,657][52663] Sum rewards: 56.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.020', 'ARMOR': '0.030', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.470', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.300', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '46.500'} [2024-08-06 00:48:52,063][52670] DAMAGECOUNT value on done: 137744.0 [2024-08-06 00:48:52,065][52670] Sum rewards: 48.260, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.057', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon4': '0.164', 'weapon5': '0.170', 'AMMO4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.708', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.708', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '44.000'} [2024-08-06 00:48:52,133][52795] DAMAGECOUNT value on done: 132203.0 [2024-08-06 00:48:52,133][52795] Sum rewards: 56.204, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.054', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon2': '0.796', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '2.874', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:52,311][52665] DAMAGECOUNT value on done: 137503.0 [2024-08-06 00:48:52,312][52665] Sum rewards: 68.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.100', 'weapon4': '0.204', 'AMMO3': '0.225', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 00:48:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 209305600. Throughput: 0: 4390.4. Samples: 52330330. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:48:52,794][52567] Avg episode reward: [(0, '57.723')] [2024-08-06 00:48:53,080][52650] Updated weights for policy 0, policy_version 25551 (0.0028) [2024-08-06 00:48:53,662][52666] DAMAGECOUNT value on done: 141885.0 [2024-08-06 00:48:53,663][52666] Sum rewards: 51.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.885', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.384', 'weapon2': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '46.000'} [2024-08-06 00:48:54,064][52671] DAMAGECOUNT value on done: 143613.0 [2024-08-06 00:48:54,064][52671] Sum rewards: 67.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.500'} [2024-08-06 00:48:54,740][52663] DAMAGECOUNT value on done: 141356.0 [2024-08-06 00:48:54,742][52663] Sum rewards: 54.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.390', 'weapon2': '0.708', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:54,765][52665] DAMAGECOUNT value on done: 144234.0 [2024-08-06 00:48:54,765][52665] Sum rewards: 54.443, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.065', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.112', 'WEAPON4': '0.200', 'WEAPON3': '0.800', 'weapon2': '1.192', 'weapon3': '2.502', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '43.000'} [2024-08-06 00:48:54,907][52670] DAMAGECOUNT value on done: 144516.0 [2024-08-06 00:48:54,907][52670] Sum rewards: 59.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.364', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.122', 'AMMO3': '0.158', 'AMMO4': '0.196', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.550', 'weapon4': '0.592', 'WEAPON3': '1.050', 'weapon3': '2.646', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '49.000'} [2024-08-06 00:48:55,260][52795] DAMAGECOUNT value on done: 132712.0 [2024-08-06 00:48:55,261][52795] Sum rewards: 65.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.706', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.251', 'weapon2': '0.288', 'WEAPON3': '1.450', 'HITCOUNT': '3.410', 'weapon3': '3.488', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '57.000'} [2024-08-06 00:48:56,552][52666] DAMAGECOUNT value on done: 135719.0 [2024-08-06 00:48:56,552][52666] Sum rewards: 53.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.367', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.192', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon2': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.518', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '47.000'} [2024-08-06 00:48:57,262][52663] DAMAGECOUNT value on done: 143290.0 [2024-08-06 00:48:57,264][52663] Sum rewards: 51.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.872', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO3': '0.128', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'weapon4': '0.520', 'WEAPON3': '0.800', 'weapon2': '0.872', 'weapon3': '2.320', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '40.500'} [2024-08-06 00:48:57,304][52671] DAMAGECOUNT value on done: 139838.0 [2024-08-06 00:48:57,305][52671] Sum rewards: 51.950, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.104', 'AMMO5': '0.007', 'AMMO2': '0.014', 'ARMOR': '0.024', 'weapon4': '0.040', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.662', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.038', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '43.500'} [2024-08-06 00:48:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 209387520. Throughput: 0: 4384.9. Samples: 52356590. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:48:57,794][52567] Avg episode reward: [(0, '57.664')] [2024-08-06 00:48:57,869][52650] Updated weights for policy 0, policy_version 25561 (0.0015) [2024-08-06 00:48:57,897][52665] DAMAGECOUNT value on done: 138267.0 [2024-08-06 00:48:57,900][52665] Sum rewards: 59.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.927', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.052', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:57,976][52670] DAMAGECOUNT value on done: 133319.0 [2024-08-06 00:48:57,977][52670] Sum rewards: 41.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.126', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.068', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.318', 'weapon4': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '2.540', 'weapon3': '3.064', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '35.000'} [2024-08-06 00:48:58,451][52795] DAMAGECOUNT value on done: 127346.0 [2024-08-06 00:48:58,451][52795] Sum rewards: 58.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.245', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.922', 'WEAPON3': '1.400', 'weapon3': '2.436', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '51.000'} [2024-08-06 00:48:59,297][52666] DAMAGECOUNT value on done: 139864.0 [2024-08-06 00:48:59,299][52666] Sum rewards: 55.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.035', 'ARMOR': '0.040', 'weapon5': '0.114', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon4': '0.414', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.666', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '47.000'} [2024-08-06 00:49:00,022][52663] DAMAGECOUNT value on done: 142197.0 [2024-08-06 00:49:00,022][52663] Sum rewards: 46.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.538', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.192', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.522', 'weapon2': '0.812', 'WEAPON3': '1.150', 'weapon3': '2.286', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '41.000'} [2024-08-06 00:49:00,229][52671] DAMAGECOUNT value on done: 143896.0 [2024-08-06 00:49:00,230][52671] Sum rewards: 50.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.506', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.580', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '41.000'} [2024-08-06 00:49:00,362][52670] DAMAGECOUNT value on done: 142051.0 [2024-08-06 00:49:00,362][52670] Sum rewards: 49.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.224', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.202', 'AMMO3': '0.231', 'AMMO4': '0.281', 'weapon4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '2.898', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:00,694][52665] DAMAGECOUNT value on done: 135619.0 [2024-08-06 00:49:00,696][52665] Sum rewards: 59.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.566', 'WEAPON3': '1.000', 'weapon3': '2.852', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '48.000'} [2024-08-06 00:49:01,535][52795] DAMAGECOUNT value on done: 133060.0 [2024-08-06 00:49:01,535][52795] Sum rewards: 62.602, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.386', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO3': '0.146', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.694', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '52.000'} [2024-08-06 00:49:02,281][52659] DAMAGECOUNT value on done: 141083.0 [2024-08-06 00:49:02,288][52659] Sum rewards: 53.304, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.492', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '45.000'} [2024-08-06 00:49:02,603][52650] Updated weights for policy 0, policy_version 25571 (0.0015) [2024-08-06 00:49:02,705][52663] DAMAGECOUNT value on done: 140156.0 [2024-08-06 00:49:02,706][52663] Sum rewards: 65.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.818', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.202', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.432', 'WEAPON3': '1.150', 'weapon3': '2.920', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '55.000'} [2024-08-06 00:49:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 209477632. Throughput: 0: 4387.1. Samples: 52369570. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 00:49:02,794][52567] Avg episode reward: [(0, '57.071')] [2024-08-06 00:49:02,900][52670] DAMAGECOUNT value on done: 141086.0 [2024-08-06 00:49:02,901][52670] Sum rewards: 63.548, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.418', 'AMMO5': '0.007', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.222', 'AMMO3': '0.262', 'weapon2': '0.436', 'WEAPON3': '1.600', 'weapon3': '3.050', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '56.000'} [2024-08-06 00:49:03,069][52671] DAMAGECOUNT value on done: 141299.0 [2024-08-06 00:49:03,070][52671] Sum rewards: 48.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.002', 'AMMO5': '0.007', 'weapon5': '0.014', 'ARMOR': '0.040', 'AMMO2': '0.050', 'weapon4': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.253', 'WEAPON4': '0.450', 'weapon2': '0.608', 'WEAPON3': '0.850', 'HITCOUNT': '2.590', 'weapon3': '3.106', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '41.500'} [2024-08-06 00:49:03,842][52665] DAMAGECOUNT value on done: 137178.0 [2024-08-06 00:49:03,842][52665] Sum rewards: 48.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.728', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.023', 'weapon5': '0.042', 'weapon4': '0.088', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.336', 'WEAPON3': '1.550', 'HITCOUNT': '2.920', 'weapon3': '3.322', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:04,711][52795] DAMAGECOUNT value on done: 134161.0 [2024-08-06 00:49:04,711][52795] Sum rewards: 61.774, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.605', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.312', 'weapon4': '0.646', 'WEAPON3': '1.100', 'weapon3': '2.854', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '50.000'} [2024-08-06 00:49:05,227][52659] DAMAGECOUNT value on done: 140182.0 [2024-08-06 00:49:05,229][52659] Sum rewards: 62.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.210', 'weapon4': '0.356', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:05,680][52663] DAMAGECOUNT value on done: 135302.0 [2024-08-06 00:49:05,681][52663] Sum rewards: 58.393, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.452', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon4': '0.208', 'AMMO3': '0.264', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:05,816][52670] DAMAGECOUNT value on done: 139773.0 [2024-08-06 00:49:05,817][52670] Sum rewards: 71.185, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.463', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.070', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '61.000'} [2024-08-06 00:49:05,941][52671] DAMAGECOUNT value on done: 140392.0 [2024-08-06 00:49:05,943][52671] Sum rewards: 52.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.628', 'AMMO5': '0.009', 'AMMO2': '0.040', 'AMMO3': '0.197', 'AMMO4': '0.202', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.496', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.540', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '45.000'} [2024-08-06 00:49:06,913][52665] DAMAGECOUNT value on done: 138884.0 [2024-08-06 00:49:06,914][52665] Sum rewards: 61.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:07,263][52650] Updated weights for policy 0, policy_version 25581 (0.0036) [2024-08-06 00:49:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 209567744. Throughput: 0: 4382.9. Samples: 52395900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:49:07,795][52567] Avg episode reward: [(0, '56.898')] [2024-08-06 00:49:08,471][52663] DAMAGECOUNT value on done: 138497.0 [2024-08-06 00:49:08,471][52663] Sum rewards: 64.117, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'weapon5': '0.162', 'weapon4': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '0.900', 'weapon3': '2.864', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:08,474][52670] DAMAGECOUNT value on done: 138371.0 [2024-08-06 00:49:08,476][52670] Sum rewards: 53.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.744', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.402', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '45.000'} [2024-08-06 00:49:08,481][52659] DAMAGECOUNT value on done: 141394.0 [2024-08-06 00:49:08,482][52659] Sum rewards: 59.105, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.692', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.112', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.267', 'AMMO3': '0.280', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.016', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '53.500'} [2024-08-06 00:49:09,125][52671] DAMAGECOUNT value on done: 147002.0 [2024-08-06 00:49:09,126][52671] Sum rewards: 55.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'weapon2': '0.486', 'weapon4': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.426', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '46.000'} [2024-08-06 00:49:10,047][52665] DAMAGECOUNT value on done: 139980.0 [2024-08-06 00:49:10,048][52665] Sum rewards: 53.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.209', 'weapon4': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.720', 'WEAPON3': '1.350', 'weapon3': '2.594', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '47.000'} [2024-08-06 00:49:11,114][52659] DAMAGECOUNT value on done: 143622.0 [2024-08-06 00:49:11,115][52659] Sum rewards: 59.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:11,413][52663] DAMAGECOUNT value on done: 142789.0 [2024-08-06 00:49:11,414][52663] Sum rewards: 60.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.405', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'weapon2': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2024-08-06 00:49:11,453][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:49:11,486][52650] Updated weights for policy 0, policy_version 25591 (0.0014) [2024-08-06 00:49:11,707][52671] DAMAGECOUNT value on done: 142955.0 [2024-08-06 00:49:11,708][52671] Sum rewards: 62.638, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.745', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO3': '0.160', 'AMMO4': '0.162', 'weapon5': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 209649664. Throughput: 0: 4380.7. Samples: 52422090. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:49:12,794][52567] Avg episode reward: [(0, '57.073')] [2024-08-06 00:49:13,111][52665] DAMAGECOUNT value on done: 142228.0 [2024-08-06 00:49:13,111][52665] Sum rewards: 49.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.827', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.330', 'weapon4': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.036', 'DAMAGECOUNT': '12.831', 'FRAGCOUNT': '41.000'} [2024-08-06 00:49:13,858][52659] DAMAGECOUNT value on done: 140264.0 [2024-08-06 00:49:13,860][52659] Sum rewards: 51.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO2': '0.034', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.171', 'weapon2': '0.342', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '3.500', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '43.000'} [2024-08-06 00:49:14,269][52663] DAMAGECOUNT value on done: 142322.0 [2024-08-06 00:49:14,269][52663] Sum rewards: 59.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.555', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.170', 'WEAPON3': '0.950', 'weapon2': '0.994', 'weapon3': '2.660', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '48.000'} [2024-08-06 00:49:14,553][52671] DAMAGECOUNT value on done: 136716.0 [2024-08-06 00:49:14,555][52671] Sum rewards: 50.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.754', 'AMMO5': '0.007', 'AMMO2': '0.029', 'ARMOR': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.428', 'weapon4': '0.480', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.816', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '43.000'} [2024-08-06 00:49:16,069][52665] DAMAGECOUNT value on done: 145109.0 [2024-08-06 00:49:16,071][52665] Sum rewards: 49.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.031', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.738', 'WEAPON3': '0.800', 'weapon4': '0.802', 'weapon3': '2.300', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '40.500'} [2024-08-06 00:49:16,504][52820] DAMAGECOUNT value on done: 130553.0 [2024-08-06 00:49:16,507][52820] Sum rewards: 62.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.935', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '52.000'} [2024-08-06 00:49:16,547][52650] Updated weights for policy 0, policy_version 25601 (0.0011) [2024-08-06 00:49:16,659][52659] DAMAGECOUNT value on done: 140812.0 [2024-08-06 00:49:16,659][52659] Sum rewards: 49.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.155', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.402', 'weapon4': '0.784', 'WEAPON3': '1.000', 'weapon3': '2.474', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '42.000'} [2024-08-06 00:49:16,675][52663] DAMAGECOUNT value on done: 144060.0 [2024-08-06 00:49:16,675][52663] Sum rewards: 69.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.915', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '57.000'} [2024-08-06 00:49:17,386][52671] DAMAGECOUNT value on done: 145162.0 [2024-08-06 00:49:17,389][52671] Sum rewards: 57.794, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.178', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '52.000'} [2024-08-06 00:49:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 209739776. Throughput: 0: 4392.4. Samples: 52435350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 00:49:17,795][52567] Avg episode reward: [(0, '57.145')] [2024-08-06 00:49:19,108][52665] DAMAGECOUNT value on done: 139608.0 [2024-08-06 00:49:19,110][52665] Sum rewards: 58.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'weapon4': '0.354', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:19,323][52663] DAMAGECOUNT value on done: 143892.0 [2024-08-06 00:49:19,327][52663] Sum rewards: 57.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.016', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.652', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.070', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '48.500'} [2024-08-06 00:49:19,612][52820] DAMAGECOUNT value on done: 132411.0 [2024-08-06 00:49:19,612][52820] Sum rewards: 56.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.023', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon4': '0.220', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.622', 'WEAPON3': '1.550', 'weapon3': '2.936', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:19,741][52659] DAMAGECOUNT value on done: 141643.0 [2024-08-06 00:49:19,741][52659] Sum rewards: 60.046, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.474', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.388', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '49.000'} [2024-08-06 00:49:19,878][52614] Signal inference workers to stop experience collection... (4700 times) [2024-08-06 00:49:19,878][52614] Signal inference workers to resume experience collection... (4700 times) [2024-08-06 00:49:19,914][52650] InferenceWorker_p0-w0: stopping experience collection (4700 times) [2024-08-06 00:49:19,914][52650] InferenceWorker_p0-w0: resuming experience collection (4700 times) [2024-08-06 00:49:20,470][52671] DAMAGECOUNT value on done: 142638.0 [2024-08-06 00:49:20,472][52671] Sum rewards: 58.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.762', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.448', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '49.000'} [2024-08-06 00:49:21,293][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:49:21,365][52650] Updated weights for policy 0, policy_version 25611 (0.0011) [2024-08-06 00:49:22,066][52665] DAMAGECOUNT value on done: 143052.0 [2024-08-06 00:49:22,068][52665] Sum rewards: 76.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.715', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.000'} [2024-08-06 00:49:22,124][52663] DAMAGECOUNT value on done: 143019.0 [2024-08-06 00:49:22,124][52663] Sum rewards: 50.895, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.954', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.239', 'AMMO3': '0.255', 'weapon4': '0.412', 'weapon2': '0.556', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.664', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '46.500'} [2024-08-06 00:49:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 209829888. Throughput: 0: 4388.7. Samples: 52461650. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 00:49:22,794][52567] Avg episode reward: [(0, '57.331')] [2024-08-06 00:49:22,796][52820] DAMAGECOUNT value on done: 127905.0 [2024-08-06 00:49:22,802][52820] Sum rewards: 53.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.260', 'weapon2': '0.276', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.340', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '47.000'} [2024-08-06 00:49:22,903][52659] DAMAGECOUNT value on done: 136115.0 [2024-08-06 00:49:22,911][52659] Sum rewards: 49.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.458', 'ARMOR': '0.005', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO3': '0.195', 'AMMO4': '0.207', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.682', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '43.500'} [2024-08-06 00:49:23,508][52671] DAMAGECOUNT value on done: 142267.0 [2024-08-06 00:49:23,510][52671] Sum rewards: 62.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.058', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '53.000'} [2024-08-06 00:49:24,838][52665] DAMAGECOUNT value on done: 142181.0 [2024-08-06 00:49:24,838][52665] Sum rewards: 56.962, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.840', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.332', 'WEAPON3': '1.800', 'weapon3': '3.118', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 00:49:25,317][52663] DAMAGECOUNT value on done: 139444.0 [2024-08-06 00:49:25,318][52663] Sum rewards: 52.385, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '47.500'} [2024-08-06 00:49:25,479][52659] DAMAGECOUNT value on done: 143770.0 [2024-08-06 00:49:25,479][52659] Sum rewards: 54.027, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.257', 'weapon2': '0.268', 'weapon4': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.150', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '47.000'} [2024-08-06 00:49:25,892][52650] Updated weights for policy 0, policy_version 25621 (0.0046) [2024-08-06 00:49:26,046][52820] DAMAGECOUNT value on done: 125424.0 [2024-08-06 00:49:26,046][52820] Sum rewards: 48.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.159', 'WEAPON4': '0.450', 'weapon4': '0.484', 'weapon2': '0.844', 'WEAPON3': '1.000', 'weapon3': '2.442', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '42.000'} [2024-08-06 00:49:26,145][52671] DAMAGECOUNT value on done: 144411.0 [2024-08-06 00:49:26,147][52671] Sum rewards: 61.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.206', 'ARMOR': '0.004', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.176', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '53.000'} [2024-08-06 00:49:27,456][52665] DAMAGECOUNT value on done: 138635.0 [2024-08-06 00:49:27,459][52665] Sum rewards: 47.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.079', 'AMMO5': '0.005', 'ARMOR': '0.040', 'weapon5': '0.046', 'AMMO2': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'AMMO4': '0.439', 'weapon2': '0.574', 'WEAPON4': '0.950', 'WEAPON3': '0.950', 'weapon4': '1.138', 'weapon3': '1.966', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '11.661', 'FRAGCOUNT': '43.000'} [2024-08-06 00:49:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 209920000. Throughput: 0: 4384.2. Samples: 52487910. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 00:49:27,794][52567] Avg episode reward: [(0, '56.992')] [2024-08-06 00:49:28,497][52659] DAMAGECOUNT value on done: 145635.0 [2024-08-06 00:49:28,497][52659] Sum rewards: 64.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon4': '0.152', 'AMMO3': '0.226', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '54.000'} [2024-08-06 00:49:29,133][52671] DAMAGECOUNT value on done: 141075.0 [2024-08-06 00:49:29,136][52671] Sum rewards: 56.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '49.000'} [2024-08-06 00:49:29,235][52820] DAMAGECOUNT value on done: 131527.0 [2024-08-06 00:49:29,237][52820] Sum rewards: 68.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.209', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '60.000'} [2024-08-06 00:49:30,233][52650] Updated weights for policy 0, policy_version 25631 (0.0020) [2024-08-06 00:49:30,580][52665] DAMAGECOUNT value on done: 139051.0 [2024-08-06 00:49:30,580][52665] Sum rewards: 52.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'AMMO3': '0.161', 'WEAPON4': '0.400', 'weapon2': '0.500', 'weapon4': '0.866', 'WEAPON3': '1.050', 'weapon3': '2.432', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '42.000'} [2024-08-06 00:49:31,217][52659] DAMAGECOUNT value on done: 140877.0 [2024-08-06 00:49:31,218][52659] Sum rewards: 60.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.846', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.152', 'weapon5': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON4': '0.550', 'weapon4': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.412', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '49.000'} [2024-08-06 00:49:32,405][52820] DAMAGECOUNT value on done: 130368.0 [2024-08-06 00:49:32,406][52820] Sum rewards: 49.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.196', 'weapon2': '0.712', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '41.000'} [2024-08-06 00:49:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 210010112. Throughput: 0: 4375.6. Samples: 52500840. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 00:49:32,794][52567] Avg episode reward: [(0, '57.310')] [2024-08-06 00:49:33,546][52665] DAMAGECOUNT value on done: 140969.0 [2024-08-06 00:49:33,546][52665] Sum rewards: 50.389, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.839', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon5': '0.284', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.500', 'weapon3': '2.688', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '45.000'} [2024-08-06 00:49:34,026][52659] DAMAGECOUNT value on done: 136342.0 [2024-08-06 00:49:34,028][52659] Sum rewards: 56.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.838', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.212', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.752', 'WEAPON3': '1.300', 'weapon3': '2.676', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '48.000'} [2024-08-06 00:49:34,339][52803] DAMAGECOUNT value on done: 133161.0 [2024-08-06 00:49:34,339][52803] Sum rewards: 52.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.186', 'AMMO4': '0.220', 'weapon4': '0.472', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '46.000'} [2024-08-06 00:49:35,425][52650] Updated weights for policy 0, policy_version 25641 (0.0023) [2024-08-06 00:49:35,478][52820] DAMAGECOUNT value on done: 130864.0 [2024-08-06 00:49:35,478][52820] Sum rewards: 61.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.638', 'weapon5': '0.006', 'AMMO5': '0.013', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.224', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '54.000'} [2024-08-06 00:49:36,472][52665] DAMAGECOUNT value on done: 138488.0 [2024-08-06 00:49:36,473][52665] Sum rewards: 64.095, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.823', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.208', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '55.000'} [2024-08-06 00:49:36,617][52659] DAMAGECOUNT value on done: 136125.0 [2024-08-06 00:49:36,617][52659] Sum rewards: 48.185, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.998', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon4': '0.154', 'AMMO4': '0.159', 'weapon5': '0.206', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '2.884', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:37,347][52803] DAMAGECOUNT value on done: 138113.0 [2024-08-06 00:49:37,348][52803] Sum rewards: 67.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.375', 'AMMO5': '0.014', 'ARMOR': '0.024', 'AMMO2': '0.047', 'AMMO3': '0.151', 'weapon5': '0.178', 'AMMO4': '0.235', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.740', 'WEAPON3': '1.000', 'weapon3': '2.496', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '55.000'} [2024-08-06 00:49:37,636][52811] DAMAGECOUNT value on done: 141788.0 [2024-08-06 00:49:37,637][52811] Sum rewards: 45.295, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.266', 'ARMOR': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.144', 'AMMO3': '0.154', 'AMMO4': '0.163', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.578', 'WEAPON3': '1.000', 'HITCOUNT': '2.330', 'weapon3': '2.626', 'DAMAGECOUNT': '10.980', 'FRAGCOUNT': '38.000'} [2024-08-06 00:49:37,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 210083840. Throughput: 0: 4372.2. Samples: 52527080. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 00:49:37,795][52567] Avg episode reward: [(0, '57.220')] [2024-08-06 00:49:38,577][52820] DAMAGECOUNT value on done: 131609.0 [2024-08-06 00:49:38,578][52820] Sum rewards: 56.732, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.613', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.172', 'AMMO3': '0.200', 'AMMO4': '0.238', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.936', 'WEAPON3': '1.150', 'weapon3': '2.266', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '49.000'} [2024-08-06 00:49:39,303][52659] DAMAGECOUNT value on done: 142955.0 [2024-08-06 00:49:39,306][52659] Sum rewards: 54.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '47.000'} [2024-08-06 00:49:39,314][52650] Updated weights for policy 0, policy_version 25651 (0.0012) [2024-08-06 00:49:39,526][52665] DAMAGECOUNT value on done: 138716.0 [2024-08-06 00:49:39,528][52665] Sum rewards: 53.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.622', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.474', 'weapon4': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.760', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '45.000'} [2024-08-06 00:49:40,135][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:49:40,458][52803] DAMAGECOUNT value on done: 133081.0 [2024-08-06 00:49:40,458][52803] Sum rewards: 49.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.108', 'AMMO3': '0.193', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.454', 'weapon4': '0.586', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '43.000'} [2024-08-06 00:49:40,701][52811] DAMAGECOUNT value on done: 130200.0 [2024-08-06 00:49:40,701][52811] Sum rewards: 49.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.094', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.212', 'weapon4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:41,669][52820] DAMAGECOUNT value on done: 129593.0 [2024-08-06 00:49:41,670][52820] Sum rewards: 71.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.187', 'weapon4': '0.204', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '61.000'} [2024-08-06 00:49:42,048][52665] DAMAGECOUNT value on done: 134660.0 [2024-08-06 00:49:42,048][52665] Sum rewards: 53.091, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.304', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'weapon4': '0.498', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.650', 'weapon3': '2.616', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '49.000'} [2024-08-06 00:49:42,205][52659] DAMAGECOUNT value on done: 141677.0 [2024-08-06 00:49:42,205][52659] Sum rewards: 47.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.942', 'ARMOR': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.136', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '42.000'} [2024-08-06 00:49:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 210182144. Throughput: 0: 4377.8. Samples: 52553590. Policy #0 lag: (min: 1.0, avg: 2.5, max: 7.0) [2024-08-06 00:49:42,794][52567] Avg episode reward: [(0, '56.656')] [2024-08-06 00:49:43,486][52803] DAMAGECOUNT value on done: 131814.0 [2024-08-06 00:49:43,487][52803] Sum rewards: 43.188, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.610', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.225', 'AMMO3': '0.262', 'weapon2': '0.348', 'weapon4': '0.470', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'HITCOUNT': '2.690', 'weapon3': '2.856', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '41.000'} [2024-08-06 00:49:43,709][52811] DAMAGECOUNT value on done: 133011.0 [2024-08-06 00:49:43,710][52811] Sum rewards: 49.311, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.616', 'AMMO5': '0.010', 'AMMO2': '0.068', 'weapon5': '0.132', 'AMMO3': '0.218', 'weapon4': '0.286', 'WEAPON5': '0.300', 'AMMO4': '0.341', 'WEAPON4': '0.650', 'weapon2': '0.764', 'WEAPON3': '1.250', 'weapon3': '2.504', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '46.000'} [2024-08-06 00:49:44,496][52650] Updated weights for policy 0, policy_version 25661 (0.0022) [2024-08-06 00:49:44,504][52665] DAMAGECOUNT value on done: 137532.0 [2024-08-06 00:49:44,505][52665] Sum rewards: 67.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.664', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon4': '0.074', 'WEAPON4': '0.100', 'weapon2': '0.208', 'AMMO3': '0.221', 'WEAPON3': '1.300', 'HITCOUNT': '3.530', 'weapon3': '3.548', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '57.000'} [2024-08-06 00:49:44,770][52820] DAMAGECOUNT value on done: 133996.0 [2024-08-06 00:49:44,770][52820] Sum rewards: 68.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.892', 'AMMO2': '0.006', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.029', 'weapon5': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.352', 'weapon4': '0.366', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '56.000'} [2024-08-06 00:49:44,898][52659] DAMAGECOUNT value on done: 146542.0 [2024-08-06 00:49:44,898][52659] Sum rewards: 44.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.173', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.074', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.546', 'WEAPON3': '1.450', 'HITCOUNT': '2.570', 'weapon3': '3.056', 'DAMAGECOUNT': '12.048', 'FRAGCOUNT': '42.000'} [2024-08-06 00:49:46,604][52803] DAMAGECOUNT value on done: 138197.0 [2024-08-06 00:49:46,605][52803] Sum rewards: 56.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.433', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.128', 'AMMO3': '0.162', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.762', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '47.000'} [2024-08-06 00:49:46,904][52811] DAMAGECOUNT value on done: 132339.0 [2024-08-06 00:49:46,904][52811] Sum rewards: 45.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.071', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.173', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.490', 'WEAPON3': '0.950', 'HITCOUNT': '2.690', 'weapon3': '2.786', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '38.000'} [2024-08-06 00:49:47,015][52665] DAMAGECOUNT value on done: 139421.0 [2024-08-06 00:49:47,016][52665] Sum rewards: 56.043, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.126', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.147', 'weapon4': '0.174', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.216', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '48.000'} [2024-08-06 00:49:47,091][52659] DAMAGECOUNT value on done: 144410.0 [2024-08-06 00:49:47,091][52659] Sum rewards: 64.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.212', 'WEAPON4': '0.450', 'weapon4': '0.466', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '55.000'} [2024-08-06 00:49:47,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 210272256. Throughput: 0: 4384.4. Samples: 52566870. Policy #0 lag: (min: 1.0, avg: 2.5, max: 7.0) [2024-08-06 00:49:47,795][52567] Avg episode reward: [(0, '56.385')] [2024-08-06 00:49:47,948][52820] DAMAGECOUNT value on done: 133765.0 [2024-08-06 00:49:47,948][52820] Sum rewards: 50.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.647', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.148', 'AMMO4': '0.192', 'weapon5': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.554', 'WEAPON3': '0.850', 'weapon3': '2.638', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '41.000'} [2024-08-06 00:49:48,272][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:49:49,539][52650] Updated weights for policy 0, policy_version 25671 (0.0033) [2024-08-06 00:49:49,573][52803] DAMAGECOUNT value on done: 132975.0 [2024-08-06 00:49:49,577][52803] Sum rewards: 49.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.436', 'AMMO2': '0.027', 'ARMOR': '0.028', 'AMMO4': '0.133', 'AMMO3': '0.223', 'weapon2': '0.438', 'WEAPON4': '0.500', 'weapon4': '0.806', 'WEAPON3': '1.350', 'weapon3': '2.576', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '45.000'} [2024-08-06 00:49:50,014][52811] DAMAGECOUNT value on done: 133275.0 [2024-08-06 00:49:50,014][52811] Sum rewards: 51.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.984', 'AMMO5': '0.007', 'AMMO2': '0.030', 'ARMOR': '0.040', 'weapon5': '0.064', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '2.990', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:50,148][52659] DAMAGECOUNT value on done: 141266.0 [2024-08-06 00:49:50,150][52659] Sum rewards: 57.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.528', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon5': '0.070', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.812', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '48.000'} [2024-08-06 00:49:50,693][52668] DAMAGECOUNT value on done: 141077.0 [2024-08-06 00:49:50,694][52668] Sum rewards: 52.599, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.944', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.234', 'weapon4': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.228', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '47.000'} [2024-08-06 00:49:51,002][52820] DAMAGECOUNT value on done: 134078.0 [2024-08-06 00:49:51,008][52820] Sum rewards: 56.526, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.875', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.028', 'AMMO3': '0.092', 'weapon5': '0.124', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.596', 'weapon4': '0.602', 'WEAPON3': '0.750', 'weapon3': '2.428', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 210354176. Throughput: 0: 4388.0. Samples: 52593360. Policy #0 lag: (min: 1.0, avg: 2.5, max: 7.0) [2024-08-06 00:49:52,794][52567] Avg episode reward: [(0, '56.286')] [2024-08-06 00:49:52,830][52803] DAMAGECOUNT value on done: 137719.0 [2024-08-06 00:49:52,830][52803] Sum rewards: 67.878, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'ARMOR': '0.024', 'weapon5': '0.054', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.388', 'HEALTH': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '55.000'} [2024-08-06 00:49:53,122][52659] DAMAGECOUNT value on done: 145950.0 [2024-08-06 00:49:53,125][52659] Sum rewards: 59.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.732', 'WEAPON3': '1.300', 'weapon3': '2.570', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '50.000'} [2024-08-06 00:49:53,197][52811] DAMAGECOUNT value on done: 137894.0 [2024-08-06 00:49:53,197][52811] Sum rewards: 53.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.316', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.078', 'weapon4': '0.192', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:53,525][52668] DAMAGECOUNT value on done: 149233.0 [2024-08-06 00:49:53,526][52668] Sum rewards: 61.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.963', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.191', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'weapon4': '0.538', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '53.000'} [2024-08-06 00:49:53,763][52650] Updated weights for policy 0, policy_version 25681 (0.0011) [2024-08-06 00:49:53,763][52662] DAMAGECOUNT value on done: 146462.0 [2024-08-06 00:49:53,776][52662] Sum rewards: 54.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.023', 'ARMOR': '0.028', 'AMMO2': '0.038', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.222', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '46.000'} [2024-08-06 00:49:54,288][52820] DAMAGECOUNT value on done: 132414.0 [2024-08-06 00:49:54,289][52820] Sum rewards: 59.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO4': '0.213', 'AMMO3': '0.238', 'weapon5': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.372', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.688', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '51.000'} [2024-08-06 00:49:55,930][52803] DAMAGECOUNT value on done: 131153.0 [2024-08-06 00:49:55,932][52803] Sum rewards: 56.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.068', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.076', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon5': '0.206', 'weapon2': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.004', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '46.500'} [2024-08-06 00:49:56,140][52668] DAMAGECOUNT value on done: 143543.0 [2024-08-06 00:49:56,142][52668] Sum rewards: 62.453, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.183', 'AMMO2': '0.030', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.214', 'AMMO3': '0.217', 'weapon2': '0.888', 'WEAPON3': '1.250', 'weapon3': '2.720', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '55.000'} [2024-08-06 00:49:56,341][52659] DAMAGECOUNT value on done: 144986.0 [2024-08-06 00:49:56,342][52659] Sum rewards: 51.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.735', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.154', 'AMMO3': '0.209', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '44.500'} [2024-08-06 00:49:56,346][52811] DAMAGECOUNT value on done: 133916.0 [2024-08-06 00:49:56,346][52811] Sum rewards: 57.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.350', 'weapon4': '0.592', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.250', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '46.000'} [2024-08-06 00:49:56,836][52662] DAMAGECOUNT value on done: 149996.0 [2024-08-06 00:49:56,837][52662] Sum rewards: 68.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.044', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.118', 'weapon4': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.000', 'weapon3': '3.042', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '55.000'} [2024-08-06 00:49:57,443][52820] DAMAGECOUNT value on done: 132932.0 [2024-08-06 00:49:57,445][52820] Sum rewards: 71.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.528', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.190', 'weapon4': '0.190', 'weapon2': '0.722', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '57.000'} [2024-08-06 00:49:57,668][52647] DAMAGECOUNT value on done: 151507.0 [2024-08-06 00:49:57,668][52647] Sum rewards: 48.629, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.188', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.231', 'AMMO3': '0.239', 'weapon2': '0.482', 'weapon4': '0.536', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '44.000'} [2024-08-06 00:49:57,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 210444288. Throughput: 0: 4388.0. Samples: 52619550. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 00:49:57,794][52567] Avg episode reward: [(0, '56.626')] [2024-08-06 00:49:58,549][52650] Updated weights for policy 0, policy_version 25691 (0.0015) [2024-08-06 00:49:59,073][52803] DAMAGECOUNT value on done: 133814.0 [2024-08-06 00:49:59,075][52803] Sum rewards: 50.728, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'ARMOR': '0.013', 'AMMO2': '0.047', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.233', 'AMMO3': '0.268', 'weapon2': '0.486', 'WEAPON4': '0.500', 'weapon4': '0.580', 'WEAPON3': '1.550', 'weapon3': '2.522', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '46.000'} [2024-08-06 00:49:59,279][52668] DAMAGECOUNT value on done: 142144.0 [2024-08-06 00:49:59,281][52668] Sum rewards: 61.671, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.528', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '50.000'} [2024-08-06 00:49:59,435][52811] DAMAGECOUNT value on done: 132866.0 [2024-08-06 00:49:59,435][52811] Sum rewards: 72.966, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.162', 'weapon4': '0.244', 'HEALTH': '0.274', 'weapon2': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.262', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '59.000'} [2024-08-06 00:49:59,638][52662] DAMAGECOUNT value on done: 150983.0 [2024-08-06 00:49:59,639][52662] Sum rewards: 48.250, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.440', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'weapon4': '0.248', 'AMMO3': '0.278', 'weapon2': '0.294', 'WEAPON3': '1.800', 'weapon3': '3.238', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '44.000'} [2024-08-06 00:50:00,426][52647] DAMAGECOUNT value on done: 150114.0 [2024-08-06 00:50:00,427][52647] Sum rewards: 63.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.186', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.068', 'weapon4': '0.070', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:00,573][52820] DAMAGECOUNT value on done: 134925.0 [2024-08-06 00:50:00,574][52820] Sum rewards: 58.398, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.658', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.135', 'AMMO4': '0.185', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '0.900', 'weapon4': '0.938', 'weapon3': '2.378', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:01,560][52664] DAMAGECOUNT value on done: 147898.0 [2024-08-06 00:50:01,560][52664] Sum rewards: 65.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.231', 'weapon4': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:01,761][52668] DAMAGECOUNT value on done: 142555.0 [2024-08-06 00:50:01,761][52668] Sum rewards: 58.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.393', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon4': '0.284', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '47.500'} [2024-08-06 00:50:02,220][52803] DAMAGECOUNT value on done: 131023.0 [2024-08-06 00:50:02,220][52803] Sum rewards: 48.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.588', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.024', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.240', 'weapon2': '0.668', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.910', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:02,444][52662] DAMAGECOUNT value on done: 141366.0 [2024-08-06 00:50:02,446][52662] Sum rewards: 54.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.778', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.191', 'WEAPON4': '0.450', 'weapon4': '0.482', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:02,482][52811] DAMAGECOUNT value on done: 138917.0 [2024-08-06 00:50:02,482][52811] Sum rewards: 55.740, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.032', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.512', 'WEAPON3': '1.600', 'weapon3': '2.756', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 210526208. Throughput: 0: 4387.8. Samples: 52632800. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 00:50:02,802][52567] Avg episode reward: [(0, '57.000')] [2024-08-06 00:50:03,181][52650] Updated weights for policy 0, policy_version 25701 (0.0011) [2024-08-06 00:50:03,557][52647] DAMAGECOUNT value on done: 153027.0 [2024-08-06 00:50:03,558][52647] Sum rewards: 59.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.106', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.378', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:03,860][52820] DAMAGECOUNT value on done: 131818.0 [2024-08-06 00:50:03,860][52820] Sum rewards: 55.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.661', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.112', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.048', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:04,472][52664] DAMAGECOUNT value on done: 147820.0 [2024-08-06 00:50:04,475][52664] Sum rewards: 66.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO2': '0.024', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.272', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '56.000'} [2024-08-06 00:50:04,593][52668] DAMAGECOUNT value on done: 139421.0 [2024-08-06 00:50:04,594][52668] Sum rewards: 60.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.072', 'AMMO3': '0.165', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.510', 'weapon4': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '52.000'} [2024-08-06 00:50:04,796][52660] DAMAGECOUNT value on done: 140084.0 [2024-08-06 00:50:04,798][52660] Sum rewards: 49.622, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.070', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'AMMO3': '0.254', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '43.000'} [2024-08-06 00:50:05,155][52662] DAMAGECOUNT value on done: 148454.0 [2024-08-06 00:50:05,155][52662] Sum rewards: 61.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.088', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.183', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.674', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '52.000'} [2024-08-06 00:50:05,345][52803] DAMAGECOUNT value on done: 137268.0 [2024-08-06 00:50:05,345][52803] Sum rewards: 55.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.855', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.180', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:05,635][52811] DAMAGECOUNT value on done: 133272.0 [2024-08-06 00:50:05,638][52811] Sum rewards: 59.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.147', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.520', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:05,729][52647] DAMAGECOUNT value on done: 152677.0 [2024-08-06 00:50:05,729][52647] Sum rewards: 51.782, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.202', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.049', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'AMMO4': '0.247', 'weapon2': '0.316', 'WEAPON4': '0.500', 'weapon4': '0.584', 'WEAPON3': '1.500', 'weapon3': '2.726', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:06,920][52664] DAMAGECOUNT value on done: 149195.0 [2024-08-06 00:50:06,921][52664] Sum rewards: 65.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.280', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.022', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.156', 'weapon2': '0.634', 'WEAPON3': '1.000', 'weapon3': '3.060', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:07,164][52820] DAMAGECOUNT value on done: 133943.0 [2024-08-06 00:50:07,164][52820] Sum rewards: 68.803, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.218', 'weapon2': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '58.000'} [2024-08-06 00:50:07,527][52650] Updated weights for policy 0, policy_version 25711 (0.0020) [2024-08-06 00:50:07,586][52668] DAMAGECOUNT value on done: 144007.0 [2024-08-06 00:50:07,586][52668] Sum rewards: 61.201, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'HEALTH': '0.178', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.318', 'weapon4': '0.320', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:07,699][52662] DAMAGECOUNT value on done: 146013.0 [2024-08-06 00:50:07,701][52662] Sum rewards: 42.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.069', 'weapon5': '0.142', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.344', 'AMMO4': '0.345', 'WEAPON4': '0.750', 'weapon4': '0.786', 'WEAPON3': '1.100', 'weapon3': '2.412', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '10.995', 'FRAGCOUNT': '39.000'} [2024-08-06 00:50:07,716][52660] DAMAGECOUNT value on done: 143278.0 [2024-08-06 00:50:07,717][52660] Sum rewards: 53.759, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.028', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.239', 'weapon2': '0.298', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 210624512. Throughput: 0: 4382.9. Samples: 52658880. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 00:50:07,794][52567] Avg episode reward: [(0, '56.762')] [2024-08-06 00:50:08,358][52803] DAMAGECOUNT value on done: 138139.0 [2024-08-06 00:50:08,361][52803] Sum rewards: 58.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.496', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.197', 'AMMO3': '0.209', 'weapon4': '0.380', 'WEAPON4': '0.400', 'weapon2': '0.852', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:08,388][52647] DAMAGECOUNT value on done: 153901.0 [2024-08-06 00:50:08,388][52647] Sum rewards: 44.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.269', 'AMMO5': '0.007', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.204', 'weapon5': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.422', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '11.733', 'FRAGCOUNT': '38.000'} [2024-08-06 00:50:08,800][52811] DAMAGECOUNT value on done: 133365.0 [2024-08-06 00:50:08,803][52811] Sum rewards: 42.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO3': '0.194', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.690', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '36.000'} [2024-08-06 00:50:09,558][52664] DAMAGECOUNT value on done: 147673.0 [2024-08-06 00:50:09,561][52664] Sum rewards: 37.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.129', 'weapon5': '0.158', 'WEAPON5': '0.250', 'AMMO4': '0.260', 'weapon2': '0.456', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon4': '0.944', 'weapon3': '2.230', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '10.419', 'FRAGCOUNT': '32.000'} [2024-08-06 00:50:10,232][52794] DAMAGECOUNT value on done: 150098.0 [2024-08-06 00:50:10,232][52794] Sum rewards: 65.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.682', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.064', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.321', 'weapon4': '0.438', 'weapon2': '0.626', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.616', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:10,301][52668] DAMAGECOUNT value on done: 146991.0 [2024-08-06 00:50:10,301][52668] Sum rewards: 63.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.751', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon5': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon4': '0.264', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:10,309][52820] DAMAGECOUNT value on done: 135041.0 [2024-08-06 00:50:10,310][52820] Sum rewards: 52.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.022', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon5': '0.120', 'AMMO3': '0.160', 'weapon4': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.000', 'HITCOUNT': '2.770', 'weapon3': '2.838', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '44.000'} [2024-08-06 00:50:10,502][52660] DAMAGECOUNT value on done: 143638.0 [2024-08-06 00:50:10,502][52660] Sum rewards: 55.901, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.119', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.173', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:10,565][52662] DAMAGECOUNT value on done: 147331.0 [2024-08-06 00:50:10,566][52662] Sum rewards: 54.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.764', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.186', 'AMMO3': '0.236', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'weapon2': '0.506', 'weapon4': '0.568', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.446', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:11,032][52647] DAMAGECOUNT value on done: 153278.0 [2024-08-06 00:50:11,032][52647] Sum rewards: 57.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:11,374][52803] DAMAGECOUNT value on done: 133944.0 [2024-08-06 00:50:11,374][52803] Sum rewards: 51.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.886', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.582', 'WEAPON3': '1.550', 'weapon3': '2.940', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:11,843][52811] DAMAGECOUNT value on done: 135243.0 [2024-08-06 00:50:11,844][52811] Sum rewards: 76.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.114', 'AMMO4': '0.125', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.356', 'weapon4': '0.372', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '64.000'} [2024-08-06 00:50:11,894][52664] DAMAGECOUNT value on done: 147479.0 [2024-08-06 00:50:11,895][52664] Sum rewards: 54.679, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.611', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.088', 'weapon4': '0.184', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.034', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '51.000'} [2024-08-06 00:50:12,543][52650] Updated weights for policy 0, policy_version 25721 (0.0013) [2024-08-06 00:50:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 210706432. Throughput: 0: 4388.9. Samples: 52685410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:50:12,802][52567] Avg episode reward: [(0, '56.617')] [2024-08-06 00:50:12,928][52794] DAMAGECOUNT value on done: 149319.0 [2024-08-06 00:50:12,929][52794] Sum rewards: 69.588, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '57.000'} [2024-08-06 00:50:13,338][52647] DAMAGECOUNT value on done: 149289.0 [2024-08-06 00:50:13,338][52647] Sum rewards: 47.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.118', 'weapon5': '0.132', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.406', 'weapon2': '0.550', 'WEAPON3': '0.750', 'weapon3': '2.762', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '39.000'} [2024-08-06 00:50:13,340][52662] DAMAGECOUNT value on done: 152014.0 [2024-08-06 00:50:13,341][52662] Sum rewards: 52.736, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.123', 'AMMO3': '0.286', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.598', 'WEAPON3': '1.700', 'weapon3': '2.750', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:13,383][52820] DAMAGECOUNT value on done: 137136.0 [2024-08-06 00:50:13,386][52820] Sum rewards: 67.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.170', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:13,441][52668] DAMAGECOUNT value on done: 144435.0 [2024-08-06 00:50:13,442][52668] Sum rewards: 55.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.204', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.132', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:13,657][52660] DAMAGECOUNT value on done: 143612.0 [2024-08-06 00:50:13,660][52660] Sum rewards: 59.044, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.725', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.438', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.652', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:14,231][52664] DAMAGECOUNT value on done: 151349.0 [2024-08-06 00:50:14,232][52664] Sum rewards: 61.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.537', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.450', 'weapon4': '0.596', 'weapon2': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.410', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:14,420][52803] DAMAGECOUNT value on done: 136445.0 [2024-08-06 00:50:14,422][52803] Sum rewards: 63.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.194', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.224', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:14,974][52811] DAMAGECOUNT value on done: 133184.0 [2024-08-06 00:50:14,977][52811] Sum rewards: 55.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon4': '0.344', 'weapon2': '0.726', 'WEAPON3': '1.250', 'weapon3': '2.548', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:15,746][52647] DAMAGECOUNT value on done: 151654.0 [2024-08-06 00:50:15,746][52647] Sum rewards: 49.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.587', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO4': '0.086', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.328', 'weapon2': '0.886', 'WEAPON3': '1.100', 'weapon3': '2.450', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '42.000'} [2024-08-06 00:50:15,891][52794] DAMAGECOUNT value on done: 143544.0 [2024-08-06 00:50:15,891][52794] Sum rewards: 65.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.883', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.198', 'AMMO3': '0.226', 'weapon4': '0.306', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '58.000'} [2024-08-06 00:50:16,250][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:50:16,287][52662] DAMAGECOUNT value on done: 147490.0 [2024-08-06 00:50:16,287][52662] Sum rewards: 47.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.655', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.215', 'weapon2': '0.330', 'WEAPON4': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '41.500'} [2024-08-06 00:50:16,417][52820] DAMAGECOUNT value on done: 130842.0 [2024-08-06 00:50:16,417][52820] Sum rewards: 50.715, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.142', 'AMMO4': '0.215', 'weapon2': '0.298', 'WEAPON5': '0.350', 'weapon5': '0.362', 'WEAPON4': '0.500', 'weapon4': '0.856', 'WEAPON3': '0.950', 'weapon3': '1.974', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '41.000'} [2024-08-06 00:50:16,518][52668] DAMAGECOUNT value on done: 146065.0 [2024-08-06 00:50:16,519][52668] Sum rewards: 60.939, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.146', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'weapon4': '0.418', 'weapon2': '0.804', 'WEAPON3': '0.900', 'weapon3': '2.676', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:16,672][52660] DAMAGECOUNT value on done: 141145.0 [2024-08-06 00:50:16,675][52660] Sum rewards: 63.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:16,878][52664] DAMAGECOUNT value on done: 150800.0 [2024-08-06 00:50:16,879][52664] Sum rewards: 51.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.009', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.076', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'weapon4': '0.346', 'WEAPON4': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.678', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '42.000'} [2024-08-06 00:50:17,461][52803] DAMAGECOUNT value on done: 132157.0 [2024-08-06 00:50:17,462][52803] Sum rewards: 56.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.222', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.146', 'AMMO3': '0.184', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.456', 'weapon4': '0.456', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.656', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:17,593][52650] Updated weights for policy 0, policy_version 25731 (0.0020) [2024-08-06 00:50:17,644][52667] DAMAGECOUNT value on done: 145206.0 [2024-08-06 00:50:17,645][52667] Sum rewards: 53.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.028', 'weapon4': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.236', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 210788352. Throughput: 0: 4392.9. Samples: 52698520. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:50:17,802][52567] Avg episode reward: [(0, '56.676')] [2024-08-06 00:50:17,964][52811] DAMAGECOUNT value on done: 135355.0 [2024-08-06 00:50:17,965][52811] Sum rewards: 59.262, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.885', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.274', 'weapon2': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.130', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:18,246][52647] DAMAGECOUNT value on done: 153437.0 [2024-08-06 00:50:18,246][52647] Sum rewards: 60.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.704', 'AMMO5': '0.010', 'weapon5': '0.032', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO4': '0.203', 'AMMO3': '0.223', 'weapon4': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:19,003][52794] DAMAGECOUNT value on done: 142997.0 [2024-08-06 00:50:19,005][52794] Sum rewards: 56.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.206', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.226', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:19,327][52662] DAMAGECOUNT value on done: 150738.0 [2024-08-06 00:50:19,330][52662] Sum rewards: 63.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.752', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.254', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '52.000'} [2024-08-06 00:50:19,370][52668] DAMAGECOUNT value on done: 143704.0 [2024-08-06 00:50:19,370][52668] Sum rewards: 66.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.066', 'weapon4': '0.104', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.222', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '56.000'} [2024-08-06 00:50:19,521][52660] DAMAGECOUNT value on done: 140344.0 [2024-08-06 00:50:19,523][52660] Sum rewards: 57.843, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.522', 'weapon4': '0.618', 'WEAPON3': '1.550', 'weapon3': '2.552', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:19,706][52664] DAMAGECOUNT value on done: 142604.0 [2024-08-06 00:50:19,709][52664] Sum rewards: 70.216, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.352', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 00:50:20,453][52803] DAMAGECOUNT value on done: 130531.0 [2024-08-06 00:50:20,454][52803] Sum rewards: 60.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.711', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.084', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '52.000'} [2024-08-06 00:50:20,717][52667] DAMAGECOUNT value on done: 145241.0 [2024-08-06 00:50:20,717][52667] Sum rewards: 60.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.602', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.148', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:20,957][52811] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:50:21,103][52811] DAMAGECOUNT value on done: 135310.0 [2024-08-06 00:50:21,106][52811] Sum rewards: 53.661, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.053', 'ARMOR': '0.056', 'HEALTH': '0.071', 'weapon5': '0.094', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'AMMO4': '0.266', 'weapon4': '0.298', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon2': '0.894', 'weapon3': '2.502', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:21,507][52650] Updated weights for policy 0, policy_version 25741 (0.0012) [2024-08-06 00:50:21,566][52647] DAMAGECOUNT value on done: 149455.0 [2024-08-06 00:50:21,567][52647] Sum rewards: 60.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.066', 'AMMO3': '0.182', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:22,066][52668] DAMAGECOUNT value on done: 141668.0 [2024-08-06 00:50:22,069][52668] Sum rewards: 44.243, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.056', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.492', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.740', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '40.000'} [2024-08-06 00:50:22,139][52794] DAMAGECOUNT value on done: 147009.0 [2024-08-06 00:50:22,139][52794] Sum rewards: 57.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.032', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.181', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.854', 'WEAPON3': '1.150', 'weapon3': '2.484', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:22,229][52660] DAMAGECOUNT value on done: 144090.0 [2024-08-06 00:50:22,230][52660] Sum rewards: 52.373, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'weapon5': '0.218', 'AMMO4': '0.272', 'HEALTH': '0.298', 'WEAPON4': '0.450', 'WEAPON3': '0.550', 'weapon4': '0.700', 'weapon2': '0.716', 'weapon3': '2.124', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '41.000'} [2024-08-06 00:50:22,445][52662] DAMAGECOUNT value on done: 144407.0 [2024-08-06 00:50:22,446][52662] Sum rewards: 64.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.972', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon4': '0.252', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:22,745][52664] DAMAGECOUNT value on done: 158080.0 [2024-08-06 00:50:22,747][52664] Sum rewards: 65.437, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.434', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.272', 'weapon4': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:22,795][52567] Fps is (10 sec: 18021.0, 60 sec: 17612.6, 300 sec: 17578.0). Total num frames: 210886656. Throughput: 0: 4392.2. Samples: 52724730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:50:22,795][52567] Avg episode reward: [(0, '57.401')] [2024-08-06 00:50:23,505][52803] DAMAGECOUNT value on done: 137147.0 [2024-08-06 00:50:23,505][52803] Sum rewards: 60.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.549', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.408', 'weapon4': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:23,572][52667] DAMAGECOUNT value on done: 144957.0 [2024-08-06 00:50:23,573][52667] Sum rewards: 62.774, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.570', 'AMMO5': '0.003', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.178', 'AMMO3': '0.275', 'weapon2': '0.316', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.086', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '57.000'} [2024-08-06 00:50:23,970][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:50:24,059][52647] DAMAGECOUNT value on done: 147905.0 [2024-08-06 00:50:24,059][52647] Sum rewards: 49.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon7': '0.054', 'AMMO4': '0.151', 'weapon5': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.186', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.312', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '40.000'} [2024-08-06 00:50:24,141][52811] DAMAGECOUNT value on done: 137308.0 [2024-08-06 00:50:24,141][52811] Sum rewards: 48.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.921', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.209', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.866', 'WEAPON3': '1.200', 'weapon3': '2.562', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '41.000'} [2024-08-06 00:50:24,978][52668] DAMAGECOUNT value on done: 136512.0 [2024-08-06 00:50:24,979][52668] Sum rewards: 61.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.674', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.229', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:25,043][52660] DAMAGECOUNT value on done: 143403.0 [2024-08-06 00:50:25,045][52660] Sum rewards: 54.171, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.506', 'weapon4': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.664', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:25,143][52794] DAMAGECOUNT value on done: 147603.0 [2024-08-06 00:50:25,144][52794] Sum rewards: 66.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:25,286][52664] DAMAGECOUNT value on done: 153575.0 [2024-08-06 00:50:25,287][52664] Sum rewards: 63.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.612', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon4': '0.320', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:25,463][52662] DAMAGECOUNT value on done: 149095.0 [2024-08-06 00:50:25,463][52662] Sum rewards: 60.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.604', 'AMMO5': '0.005', 'AMMO2': '0.032', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.158', 'AMMO3': '0.179', 'weapon4': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '51.000'} [2024-08-06 00:50:26,491][52647] DAMAGECOUNT value on done: 147021.0 [2024-08-06 00:50:26,493][52647] Sum rewards: 56.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.784', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.192', 'weapon2': '0.328', 'WEAPON4': '0.450', 'weapon4': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '48.500'} [2024-08-06 00:50:26,599][52803] DAMAGECOUNT value on done: 133819.0 [2024-08-06 00:50:26,599][52803] Sum rewards: 51.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.600', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.212', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:26,727][52650] Updated weights for policy 0, policy_version 25751 (0.0025) [2024-08-06 00:50:26,876][52667] DAMAGECOUNT value on done: 141900.0 [2024-08-06 00:50:26,877][52667] Sum rewards: 53.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.537', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.095', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.642', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.828', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:27,293][52811] DAMAGECOUNT value on done: 133083.0 [2024-08-06 00:50:27,295][52811] Sum rewards: 42.865, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO4': '0.224', 'AMMO3': '0.231', 'weapon2': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '40.000'} [2024-08-06 00:50:27,464][52668] DAMAGECOUNT value on done: 141974.0 [2024-08-06 00:50:27,464][52668] Sum rewards: 57.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon4': '0.354', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:27,510][52660] DAMAGECOUNT value on done: 143292.0 [2024-08-06 00:50:27,510][52660] Sum rewards: 52.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.544', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.245', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.394', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.108', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:27,708][52664] DAMAGECOUNT value on done: 151624.0 [2024-08-06 00:50:27,708][52664] Sum rewards: 53.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.972', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.193', 'AMMO3': '0.253', 'WEAPON4': '0.550', 'weapon2': '0.652', 'weapon4': '0.678', 'WEAPON3': '1.450', 'weapon3': '2.334', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:27,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 210976768. Throughput: 0: 4387.3. Samples: 52751020. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 00:50:27,794][52567] Avg episode reward: [(0, '57.547')] [2024-08-06 00:50:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000025754_210976768.pth... [2024-08-06 00:50:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000025239_206757888.pth [2024-08-06 00:50:28,632][52794] DAMAGECOUNT value on done: 152347.0 [2024-08-06 00:50:28,633][52794] Sum rewards: 55.927, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon4': '0.180', 'weapon2': '0.406', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.156', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:28,867][52662] DAMAGECOUNT value on done: 144692.0 [2024-08-06 00:50:28,867][52662] Sum rewards: 46.211, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.036', 'AMMO5': '0.010', 'ARMOR': '0.044', 'AMMO2': '0.049', 'weapon5': '0.142', 'weapon4': '0.156', 'AMMO3': '0.219', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '3.102', 'DAMAGECOUNT': '12.027', 'FRAGCOUNT': '42.000'} [2024-08-06 00:50:29,516][52647] DAMAGECOUNT value on done: 150298.0 [2024-08-06 00:50:29,516][52647] Sum rewards: 54.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.378', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.130', 'AMMO3': '0.209', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:29,740][52803] DAMAGECOUNT value on done: 136246.0 [2024-08-06 00:50:29,741][52803] Sum rewards: 52.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.434', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.192', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.696', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:29,981][52667] DAMAGECOUNT value on done: 144825.0 [2024-08-06 00:50:29,983][52667] Sum rewards: 64.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.368', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.227', 'weapon4': '0.252', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:30,142][52669] DAMAGECOUNT value on done: 147797.0 [2024-08-06 00:50:30,142][52669] Sum rewards: 56.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.400', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'weapon4': '0.594', 'weapon2': '0.868', 'WEAPON3': '1.400', 'weapon3': '2.358', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:30,354][52668] DAMAGECOUNT value on done: 140397.0 [2024-08-06 00:50:30,356][52668] Sum rewards: 52.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.996', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.406', 'weapon4': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.518', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:30,377][52660] DAMAGECOUNT value on done: 143866.0 [2024-08-06 00:50:30,377][52660] Sum rewards: 47.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.888', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.146', 'AMMO3': '0.227', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.480', 'weapon4': '0.568', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.500', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '44.000'} [2024-08-06 00:50:30,382][52614] Signal inference workers to stop experience collection... (4750 times) [2024-08-06 00:50:30,383][52614] Signal inference workers to resume experience collection... (4750 times) [2024-08-06 00:50:30,416][52650] InferenceWorker_p0-w0: stopping experience collection (4750 times) [2024-08-06 00:50:30,416][52650] InferenceWorker_p0-w0: resuming experience collection (4750 times) [2024-08-06 00:50:30,552][52811] DAMAGECOUNT value on done: 137436.0 [2024-08-06 00:50:30,552][52811] Sum rewards: 60.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.516', 'AMMO2': '0.043', 'AMMO4': '0.214', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.346', 'weapon4': '0.356', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.132', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '51.000'} [2024-08-06 00:50:31,010][52650] Updated weights for policy 0, policy_version 25761 (0.0011) [2024-08-06 00:50:31,028][52664] DAMAGECOUNT value on done: 148567.0 [2024-08-06 00:50:31,029][52664] Sum rewards: 62.119, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.012', 'weapon5': '0.014', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.267', 'weapon2': '0.360', 'WEAPON3': '1.650', 'HITCOUNT': '3.130', 'weapon3': '3.386', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:31,431][52794] DAMAGECOUNT value on done: 145642.0 [2024-08-06 00:50:31,441][52794] Sum rewards: 63.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.209', 'AMMO5': '0.010', 'ARMOR': '0.028', 'weapon5': '0.032', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:31,786][52662] DAMAGECOUNT value on done: 146854.0 [2024-08-06 00:50:31,786][52662] Sum rewards: 46.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.257', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.564', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.586', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '41.000'} [2024-08-06 00:50:32,651][52647] DAMAGECOUNT value on done: 146509.0 [2024-08-06 00:50:32,652][52647] Sum rewards: 67.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.535', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.768', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '58.500'} [2024-08-06 00:50:32,695][52667] DAMAGECOUNT value on done: 143702.0 [2024-08-06 00:50:32,696][52667] Sum rewards: 60.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.355', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.068', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.279', 'weapon2': '0.516', 'WEAPON3': '1.750', 'weapon3': '3.136', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:32,746][52803] DAMAGECOUNT value on done: 129049.0 [2024-08-06 00:50:32,746][52803] Sum rewards: 47.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.348', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'weapon4': '0.204', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '2.992', 'DAMAGECOUNT': '11.805', 'FRAGCOUNT': '44.000'} [2024-08-06 00:50:32,794][52567] Fps is (10 sec: 17204.5, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 211058688. Throughput: 0: 4381.6. Samples: 52764040. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 00:50:32,795][52567] Avg episode reward: [(0, '57.280')] [2024-08-06 00:50:33,274][52660] DAMAGECOUNT value on done: 146562.0 [2024-08-06 00:50:33,275][52660] Sum rewards: 54.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.719', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.032', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.208', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.264', 'weapon4': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.098', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:33,276][52668] DAMAGECOUNT value on done: 144549.0 [2024-08-06 00:50:33,276][52668] Sum rewards: 42.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.804', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon7': '0.072', 'AMMO4': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon2': '0.196', 'AMMO3': '0.225', 'weapon4': '0.446', 'WEAPON3': '1.350', 'HITCOUNT': '2.320', 'weapon3': '2.602', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '38.000'} [2024-08-06 00:50:33,364][52669] DAMAGECOUNT value on done: 143225.0 [2024-08-06 00:50:33,365][52669] Sum rewards: 41.513, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.406', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO2': '0.061', 'weapon5': '0.064', 'AMMO3': '0.288', 'AMMO4': '0.304', 'weapon4': '0.334', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.968', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '39.000'} [2024-08-06 00:50:33,735][52811] DAMAGECOUNT value on done: 132765.0 [2024-08-06 00:50:33,735][52811] Sum rewards: 55.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.449', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.204', 'AMMO4': '0.221', 'weapon2': '0.320', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.750', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:34,114][52664] DAMAGECOUNT value on done: 146413.0 [2024-08-06 00:50:34,115][52664] Sum rewards: 59.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.036', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.390', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:34,176][52794] DAMAGECOUNT value on done: 150349.0 [2024-08-06 00:50:34,176][52794] Sum rewards: 57.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.862', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO4': '0.203', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.386', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:34,351][52662] DAMAGECOUNT value on done: 146648.0 [2024-08-06 00:50:34,351][52662] Sum rewards: 67.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.710', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.060', 'weapon4': '0.116', 'AMMO4': '0.235', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.258', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '58.000'} [2024-08-06 00:50:35,246][52667] DAMAGECOUNT value on done: 147553.0 [2024-08-06 00:50:35,256][52667] Sum rewards: 66.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.272', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.350', 'weapon3': '2.734', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '56.000'} [2024-08-06 00:50:35,657][52647] DAMAGECOUNT value on done: 149365.0 [2024-08-06 00:50:35,658][52647] Sum rewards: 48.090, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.466', 'AMMO5': '0.003', 'AMMO2': '0.012', 'ARMOR': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.103', 'WEAPON4': '0.150', 'weapon2': '0.462', 'weapon4': '0.464', 'WEAPON3': '0.800', 'weapon3': '2.612', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '11.811', 'FRAGCOUNT': '37.000'} [2024-08-06 00:50:35,678][52669] DAMAGECOUNT value on done: 143910.0 [2024-08-06 00:50:35,678][52669] Sum rewards: 62.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.445', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '51.000'} [2024-08-06 00:50:35,797][52650] Updated weights for policy 0, policy_version 25771 (0.0014) [2024-08-06 00:50:36,551][52668] DAMAGECOUNT value on done: 143408.0 [2024-08-06 00:50:36,552][52668] Sum rewards: 56.792, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.185', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.258', 'weapon2': '0.406', 'weapon4': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.786', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '51.000'} [2024-08-06 00:50:36,570][52660] DAMAGECOUNT value on done: 138803.0 [2024-08-06 00:50:36,570][52660] Sum rewards: 57.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.890', 'AMMO2': '0.040', 'AMMO3': '0.189', 'AMMO4': '0.200', 'weapon2': '0.296', 'WEAPON4': '0.650', 'weapon4': '0.712', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:36,593][52794] DAMAGECOUNT value on done: 153531.0 [2024-08-06 00:50:36,593][52794] Sum rewards: 63.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '54.000'} [2024-08-06 00:50:36,745][52662] DAMAGECOUNT value on done: 150561.0 [2024-08-06 00:50:36,745][52662] Sum rewards: 51.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.702', 'AMMO5': '0.005', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO2': '0.056', 'weapon5': '0.088', 'AMMO3': '0.179', 'AMMO4': '0.280', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.754', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '43.000'} [2024-08-06 00:50:36,808][52811] DAMAGECOUNT value on done: 136264.0 [2024-08-06 00:50:36,808][52811] Sum rewards: 49.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.898', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.192', 'weapon5': '0.248', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.390', 'weapon4': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.538', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '43.000'} [2024-08-06 00:50:37,238][52664] DAMAGECOUNT value on done: 148069.0 [2024-08-06 00:50:37,239][52664] Sum rewards: 46.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.109', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '40.000'} [2024-08-06 00:50:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 211140608. Throughput: 0: 4373.6. Samples: 52790170. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 00:50:37,794][52567] Avg episode reward: [(0, '56.614')] [2024-08-06 00:50:38,255][52667] DAMAGECOUNT value on done: 142167.0 [2024-08-06 00:50:38,257][52667] Sum rewards: 56.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.299', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.054', 'weapon5': '0.140', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'weapon2': '0.526', 'WEAPON4': '0.750', 'weapon4': '0.826', 'WEAPON3': '0.900', 'weapon3': '2.294', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:38,579][52647] DAMAGECOUNT value on done: 152181.0 [2024-08-06 00:50:38,579][52647] Sum rewards: 58.298, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'HEALTH': '0.160', 'AMMO3': '0.184', 'weapon4': '0.334', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:38,705][52669] DAMAGECOUNT value on done: 142295.0 [2024-08-06 00:50:38,707][52669] Sum rewards: 55.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.197', 'AMMO3': '0.222', 'weapon4': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:39,400][52668] DAMAGECOUNT value on done: 145397.0 [2024-08-06 00:50:39,400][52668] Sum rewards: 67.797, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.082', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.175', 'weapon2': '0.556', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:39,432][52660] DAMAGECOUNT value on done: 143156.0 [2024-08-06 00:50:39,433][52660] Sum rewards: 60.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:39,571][52794] DAMAGECOUNT value on done: 144472.0 [2024-08-06 00:50:39,572][52794] Sum rewards: 42.551, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.446', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.450', 'weapon2': '0.518', 'weapon4': '0.572', 'WEAPON3': '1.400', 'weapon3': '2.518', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '38.500'} [2024-08-06 00:50:39,583][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:50:39,724][52662] DAMAGECOUNT value on done: 143685.0 [2024-08-06 00:50:39,724][52662] Sum rewards: 71.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.847', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.175', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '59.000'} [2024-08-06 00:50:39,785][52664] DAMAGECOUNT value on done: 151397.0 [2024-08-06 00:50:39,786][52664] Sum rewards: 47.529, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.178', 'AMMO3': '0.224', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '41.000'} [2024-08-06 00:50:40,886][52650] Updated weights for policy 0, policy_version 25781 (0.0011) [2024-08-06 00:50:40,903][52667] DAMAGECOUNT value on done: 144146.0 [2024-08-06 00:50:40,904][52667] Sum rewards: 55.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.646', 'AMMO5': '0.003', 'ARMOR': '0.013', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.114', 'AMMO4': '0.153', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.276', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:40,954][52647] DAMAGECOUNT value on done: 146602.0 [2024-08-06 00:50:40,955][52647] Sum rewards: 68.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.450', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.128', 'AMMO3': '0.162', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'weapon4': '0.360', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '0.950', 'weapon3': '2.726', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '57.000'} [2024-08-06 00:50:41,022][52669] DAMAGECOUNT value on done: 143542.0 [2024-08-06 00:50:41,024][52669] Sum rewards: 57.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.173', 'weapon4': '0.312', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.140', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:42,311][52668] DAMAGECOUNT value on done: 147088.0 [2024-08-06 00:50:42,312][52668] Sum rewards: 66.320, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.229', 'weapon2': '0.408', 'HEALTH': '0.735', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '56.000'} [2024-08-06 00:50:42,325][52660] DAMAGECOUNT value on done: 145327.0 [2024-08-06 00:50:42,325][52660] Sum rewards: 48.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.450', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.237', 'weapon4': '0.270', 'WEAPON4': '0.450', 'weapon2': '1.020', 'WEAPON3': '1.100', 'weapon3': '2.432', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '42.000'} [2024-08-06 00:50:42,546][52664] DAMAGECOUNT value on done: 147735.0 [2024-08-06 00:50:42,546][52664] Sum rewards: 54.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.065', 'AMMO3': '0.161', 'weapon5': '0.200', 'AMMO4': '0.325', 'WEAPON5': '0.350', 'weapon4': '0.542', 'weapon2': '0.628', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.298', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:42,669][52794] DAMAGECOUNT value on done: 149482.0 [2024-08-06 00:50:42,670][52794] Sum rewards: 66.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.404', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:42,764][52662] DAMAGECOUNT value on done: 147728.0 [2024-08-06 00:50:42,764][52662] Sum rewards: 58.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.795', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.134', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.100', 'HITCOUNT': '3.210', 'weapon3': '3.214', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 211230720. Throughput: 0: 4374.0. Samples: 52816380. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 00:50:42,794][52567] Avg episode reward: [(0, '57.192')] [2024-08-06 00:50:43,748][52667] DAMAGECOUNT value on done: 147509.0 [2024-08-06 00:50:43,748][52667] Sum rewards: 63.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.882', 'ARMOR': '0.010', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO3': '0.153', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.228', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:43,933][52647] DAMAGECOUNT value on done: 149733.0 [2024-08-06 00:50:43,934][52647] Sum rewards: 58.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.016', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.211', 'weapon2': '0.462', 'WEAPON4': '0.550', 'weapon4': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.610', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '51.000'} [2024-08-06 00:50:44,369][52669] DAMAGECOUNT value on done: 142938.0 [2024-08-06 00:50:44,370][52669] Sum rewards: 54.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.874', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:44,898][52650] Updated weights for policy 0, policy_version 25791 (0.0020) [2024-08-06 00:50:45,023][52660] DAMAGECOUNT value on done: 152229.0 [2024-08-06 00:50:45,027][52660] Sum rewards: 51.691, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.597', 'AMMO5': '0.008', 'ARMOR': '0.016', 'weapon5': '0.042', 'AMMO2': '0.056', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.279', 'weapon2': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.774', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:45,053][52668] DAMAGECOUNT value on done: 145167.0 [2024-08-06 00:50:45,053][52668] Sum rewards: 48.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.595', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.216', 'AMMO4': '0.218', 'AMMO3': '0.225', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.452', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '46.000'} [2024-08-06 00:50:45,562][52794] DAMAGECOUNT value on done: 145413.0 [2024-08-06 00:50:45,562][52794] Sum rewards: 46.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.284', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.187', 'AMMO3': '0.198', 'WEAPON4': '0.400', 'weapon4': '0.562', 'weapon2': '0.808', 'WEAPON3': '1.100', 'weapon3': '2.352', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.306', 'FRAGCOUNT': '42.000'} [2024-08-06 00:50:45,585][52662] DAMAGECOUNT value on done: 144433.0 [2024-08-06 00:50:45,585][52662] Sum rewards: 52.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.376', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.060', 'weapon5': '0.112', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.301', 'weapon2': '0.514', 'WEAPON4': '0.650', 'weapon4': '1.094', 'WEAPON3': '1.100', 'weapon3': '2.032', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:45,713][52664] DAMAGECOUNT value on done: 148916.0 [2024-08-06 00:50:45,715][52664] Sum rewards: 58.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.338', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.168', 'AMMO4': '0.175', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '51.000'} [2024-08-06 00:50:46,783][52667] DAMAGECOUNT value on done: 144588.0 [2024-08-06 00:50:46,785][52667] Sum rewards: 50.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.237', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.662', 'WEAPON3': '1.550', 'weapon3': '2.678', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '44.500'} [2024-08-06 00:50:47,174][52647] DAMAGECOUNT value on done: 144671.0 [2024-08-06 00:50:47,175][52647] Sum rewards: 52.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO3': '0.146', 'weapon4': '0.148', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '3.202', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '43.000'} [2024-08-06 00:50:47,303][52669] DAMAGECOUNT value on done: 144367.0 [2024-08-06 00:50:47,303][52669] Sum rewards: 64.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.033', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.668', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '57.000'} [2024-08-06 00:50:47,794][52567] Fps is (10 sec: 18841.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 211329024. Throughput: 0: 4377.3. Samples: 52829780. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 00:50:47,795][52567] Avg episode reward: [(0, '56.635')] [2024-08-06 00:50:48,308][52660] DAMAGECOUNT value on done: 141248.0 [2024-08-06 00:50:48,309][52660] Sum rewards: 56.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.666', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.134', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '49.000'} [2024-08-06 00:50:48,378][52662] DAMAGECOUNT value on done: 145981.0 [2024-08-06 00:50:48,378][52662] Sum rewards: 51.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.477', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.050', 'AMMO2': '0.061', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.282', 'weapon2': '0.302', 'AMMO4': '0.307', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.152', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:48,406][52794] DAMAGECOUNT value on done: 156264.0 [2024-08-06 00:50:48,406][52794] Sum rewards: 61.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.223', 'weapon4': '0.308', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:48,489][52664] DAMAGECOUNT value on done: 151121.0 [2024-08-06 00:50:48,489][52664] Sum rewards: 72.257, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.171', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.586', 'weapon4': '0.708', 'WEAPON3': '0.900', 'HEALTH': '1.074', 'weapon3': '2.482', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '57.000'} [2024-08-06 00:50:49,565][52667] DAMAGECOUNT value on done: 142654.0 [2024-08-06 00:50:49,569][52667] Sum rewards: 52.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.388', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.242', 'weapon2': '0.452', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.228', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '47.000'} [2024-08-06 00:50:49,604][52647] DAMAGECOUNT value on done: 151545.0 [2024-08-06 00:50:49,604][52647] Sum rewards: 66.424, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.906', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.270', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.600', 'weapon3': '3.022', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '59.000'} [2024-08-06 00:50:50,058][52650] Updated weights for policy 0, policy_version 25801 (0.0011) [2024-08-06 00:50:50,119][52669] DAMAGECOUNT value on done: 145742.0 [2024-08-06 00:50:50,120][52669] Sum rewards: 62.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon4': '0.194', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '53.000'} [2024-08-06 00:50:50,946][52660] DAMAGECOUNT value on done: 146370.0 [2024-08-06 00:50:50,947][52660] Sum rewards: 59.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.367', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.212', 'AMMO3': '0.227', 'weapon2': '0.240', 'WEAPON3': '1.250', 'weapon3': '3.362', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:51,497][52794] DAMAGECOUNT value on done: 141562.0 [2024-08-06 00:50:51,497][52794] Sum rewards: 55.451, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.106', 'AMMO5': '0.014', 'AMMO2': '0.041', 'ARMOR': '0.053', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.452', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '50.000'} [2024-08-06 00:50:51,504][52664] DAMAGECOUNT value on done: 145905.0 [2024-08-06 00:50:51,504][52664] Sum rewards: 50.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.234', 'weapon2': '0.952', 'WEAPON3': '1.350', 'weapon3': '2.658', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:52,644][52667] DAMAGECOUNT value on done: 146243.0 [2024-08-06 00:50:52,645][52667] Sum rewards: 42.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.146', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '2.604', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '39.000'} [2024-08-06 00:50:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 211402752. Throughput: 0: 4377.3. Samples: 52855860. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 00:50:52,794][52567] Avg episode reward: [(0, '56.806')] [2024-08-06 00:50:53,140][52669] DAMAGECOUNT value on done: 145865.0 [2024-08-06 00:50:53,142][52669] Sum rewards: 63.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.930', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.046', 'weapon4': '0.048', 'AMMO3': '0.206', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.784', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '55.000'} [2024-08-06 00:50:54,179][52660] DAMAGECOUNT value on done: 138465.0 [2024-08-06 00:50:54,179][52660] Sum rewards: 56.160, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.255', 'AMMO2': '0.024', 'weapon4': '0.038', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.880', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:54,473][52794] DAMAGECOUNT value on done: 153578.0 [2024-08-06 00:50:54,473][52794] Sum rewards: 61.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.158', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.144', 'AMMO3': '0.178', 'weapon4': '0.246', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '52.500'} [2024-08-06 00:50:54,584][52664] DAMAGECOUNT value on done: 148948.0 [2024-08-06 00:50:54,584][52664] Sum rewards: 64.355, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.221', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'weapon4': '0.446', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '58.000'} [2024-08-06 00:50:54,935][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:50:55,012][52650] Updated weights for policy 0, policy_version 25811 (0.0011) [2024-08-06 00:50:55,161][52667] DAMAGECOUNT value on done: 141875.0 [2024-08-06 00:50:55,161][52667] Sum rewards: 53.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon4': '1.154', 'weapon3': '2.040', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '44.000'} [2024-08-06 00:50:56,131][52669] DAMAGECOUNT value on done: 141105.0 [2024-08-06 00:50:56,133][52669] Sum rewards: 68.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.414', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.225', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '60.000'} [2024-08-06 00:50:56,863][52660] DAMAGECOUNT value on done: 146938.0 [2024-08-06 00:50:56,863][52660] Sum rewards: 64.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.061', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.049', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.247', 'weapon5': '0.270', 'weapon2': '0.478', 'WEAPON4': '0.600', 'weapon4': '0.710', 'WEAPON3': '0.950', 'weapon3': '2.324', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '52.000'} [2024-08-06 00:50:57,589][52794] DAMAGECOUNT value on done: 147005.0 [2024-08-06 00:50:57,589][52794] Sum rewards: 51.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.544', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.201', 'AMMO3': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.550', 'weapon3': '2.686', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '48.000'} [2024-08-06 00:50:57,590][52658] DAMAGECOUNT value on done: 148398.0 [2024-08-06 00:50:57,592][52658] Sum rewards: 53.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.745', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.456', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.728', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '44.000'} [2024-08-06 00:50:57,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 211492864. Throughput: 0: 4371.3. Samples: 52882120. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 00:50:57,794][52567] Avg episode reward: [(0, '56.676')] [2024-08-06 00:50:57,967][52667] DAMAGECOUNT value on done: 148056.0 [2024-08-06 00:50:57,967][52667] Sum rewards: 57.039, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'weapon5': '0.128', 'AMMO4': '0.170', 'HEALTH': '0.376', 'WEAPON4': '0.400', 'weapon4': '0.546', 'WEAPON3': '0.750', 'weapon2': '0.814', 'weapon3': '2.312', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '45.000'} [2024-08-06 00:50:59,258][52650] Updated weights for policy 0, policy_version 25821 (0.0014) [2024-08-06 00:50:59,291][52669] DAMAGECOUNT value on done: 146962.0 [2024-08-06 00:50:59,292][52669] Sum rewards: 47.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.184', 'AMMO3': '0.261', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '2.876', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '42.500'} [2024-08-06 00:50:59,597][52660] DAMAGECOUNT value on done: 141225.0 [2024-08-06 00:50:59,597][52660] Sum rewards: 71.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.825', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.386', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '59.000'} [2024-08-06 00:51:00,329][52794] DAMAGECOUNT value on done: 146989.0 [2024-08-06 00:51:00,331][52794] Sum rewards: 53.911, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.492', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.146', 'weapon4': '0.164', 'AMMO4': '0.216', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.970', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:00,788][52658] DAMAGECOUNT value on done: 145558.0 [2024-08-06 00:51:00,788][52658] Sum rewards: 69.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.325', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '59.000'} [2024-08-06 00:51:01,089][52667] DAMAGECOUNT value on done: 151633.0 [2024-08-06 00:51:01,090][52667] Sum rewards: 48.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'ARMOR': '0.004', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.380', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.032', 'DAMAGECOUNT': '12.453', 'FRAGCOUNT': '42.000'} [2024-08-06 00:51:01,516][52669] DAMAGECOUNT value on done: 146048.0 [2024-08-06 00:51:01,517][52669] Sum rewards: 56.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.076', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.170', 'AMMO3': '0.172', 'WEAPON4': '0.500', 'weapon4': '0.600', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.416', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:02,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 211591168. Throughput: 0: 4378.2. Samples: 52895540. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 00:51:02,794][52567] Avg episode reward: [(0, '56.674')] [2024-08-06 00:51:03,248][52794] DAMAGECOUNT value on done: 153991.0 [2024-08-06 00:51:03,252][52794] Sum rewards: 61.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon2': '0.190', 'AMMO3': '0.192', 'weapon4': '0.208', 'WEAPON3': '1.200', 'HITCOUNT': '3.450', 'weapon3': '3.458', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '52.000'} [2024-08-06 00:51:03,816][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:51:03,848][52658] DAMAGECOUNT value on done: 147268.0 [2024-08-06 00:51:03,848][52658] Sum rewards: 60.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.190', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:04,097][52667] DAMAGECOUNT value on done: 149435.0 [2024-08-06 00:51:04,100][52667] Sum rewards: 54.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.146', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO2': '0.037', 'AMMO3': '0.173', 'AMMO4': '0.184', 'weapon5': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.468', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '45.000'} [2024-08-06 00:51:04,270][52669] DAMAGECOUNT value on done: 141754.0 [2024-08-06 00:51:04,270][52669] Sum rewards: 59.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.043', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.290', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:04,434][52650] Updated weights for policy 0, policy_version 25831 (0.0040) [2024-08-06 00:51:06,504][52794] DAMAGECOUNT value on done: 149522.0 [2024-08-06 00:51:06,505][52794] Sum rewards: 57.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.298', 'weapon2': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:06,595][52658] DAMAGECOUNT value on done: 149216.0 [2024-08-06 00:51:06,595][52658] Sum rewards: 74.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.314', 'weapon4': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '62.000'} [2024-08-06 00:51:06,753][52669] DAMAGECOUNT value on done: 145401.0 [2024-08-06 00:51:06,754][52669] Sum rewards: 64.743, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.623', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.178', 'AMMO3': '0.256', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.276', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '55.000'} [2024-08-06 00:51:06,836][52667] DAMAGECOUNT value on done: 149621.0 [2024-08-06 00:51:06,836][52667] Sum rewards: 38.049, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.798', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon7': '0.050', 'weapon5': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'AMMO4': '0.177', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '1.330', 'weapon3': '1.872', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '9.423', 'FRAGCOUNT': '32.000'} [2024-08-06 00:51:07,740][52649] DAMAGECOUNT value on done: 140819.0 [2024-08-06 00:51:07,741][52649] Sum rewards: 63.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.543', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.038', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '52.000'} [2024-08-06 00:51:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 211673088. Throughput: 0: 4380.5. Samples: 52921850. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:51:07,794][52567] Avg episode reward: [(0, '56.786')] [2024-08-06 00:51:08,380][52650] Updated weights for policy 0, policy_version 25841 (0.0013) [2024-08-06 00:51:08,931][52658] DAMAGECOUNT value on done: 148479.0 [2024-08-06 00:51:08,932][52658] Sum rewards: 59.564, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.965', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.143', 'WEAPON4': '0.350', 'weapon2': '0.444', 'weapon4': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:09,371][52667] DAMAGECOUNT value on done: 142538.0 [2024-08-06 00:51:09,373][52667] Sum rewards: 57.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.390', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:09,673][52669] DAMAGECOUNT value on done: 151173.0 [2024-08-06 00:51:09,673][52669] Sum rewards: 53.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.303', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.068', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'weapon2': '0.682', 'weapon4': '0.702', 'WEAPON3': '1.000', 'weapon3': '2.320', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '45.000'} [2024-08-06 00:51:10,352][52649] DAMAGECOUNT value on done: 138820.0 [2024-08-06 00:51:10,352][52649] Sum rewards: 59.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.585', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.870', 'WEAPON3': '1.300', 'weapon3': '2.650', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:11,708][52658] DAMAGECOUNT value on done: 141123.0 [2024-08-06 00:51:11,709][52658] Sum rewards: 41.838, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.094', 'AMMO5': '0.012', 'ARMOR': '0.040', 'AMMO2': '0.054', 'weapon5': '0.164', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'AMMO4': '0.271', 'WEAPON4': '0.550', 'weapon2': '0.572', 'weapon4': '0.622', 'WEAPON3': '1.400', 'weapon3': '2.328', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.234', 'FRAGCOUNT': '39.000'} [2024-08-06 00:51:11,956][52667] DAMAGECOUNT value on done: 150965.0 [2024-08-06 00:51:11,956][52667] Sum rewards: 60.671, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'ARMOR': '0.024', 'weapon5': '0.052', 'AMMO2': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.274', 'weapon2': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.622', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '51.500'} [2024-08-06 00:51:12,453][52666] DAMAGECOUNT value on done: 146316.0 [2024-08-06 00:51:12,453][52666] Sum rewards: 64.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.591', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.241', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '55.000'} [2024-08-06 00:51:12,478][52669] DAMAGECOUNT value on done: 155408.0 [2024-08-06 00:51:12,479][52669] Sum rewards: 56.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.182', 'AMMO4': '0.204', 'WEAPON4': '0.550', 'weapon2': '0.566', 'weapon4': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.492', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '47.000'} [2024-08-06 00:51:12,796][52567] Fps is (10 sec: 17200.5, 60 sec: 17612.3, 300 sec: 17550.2). Total num frames: 211763200. Throughput: 0: 4379.6. Samples: 52948110. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:51:12,796][52567] Avg episode reward: [(0, '57.177')] [2024-08-06 00:51:13,162][52650] Updated weights for policy 0, policy_version 25851 (0.0033) [2024-08-06 00:51:13,764][52649] DAMAGECOUNT value on done: 139998.0 [2024-08-06 00:51:13,764][52649] Sum rewards: 55.042, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.035', 'ARMOR': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon2': '0.254', 'AMMO3': '0.265', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.970', 'weapon3': '3.228', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:14,567][52658] DAMAGECOUNT value on done: 150239.0 [2024-08-06 00:51:14,571][52658] Sum rewards: 39.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.804', 'AMMO5': '0.006', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.478', 'weapon4': '0.720', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '2.398', 'DAMAGECOUNT': '10.290', 'FRAGCOUNT': '37.000'} [2024-08-06 00:51:15,195][52669] DAMAGECOUNT value on done: 143480.0 [2024-08-06 00:51:15,196][52669] Sum rewards: 48.982, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '43.000'} [2024-08-06 00:51:15,395][52666] DAMAGECOUNT value on done: 146688.0 [2024-08-06 00:51:15,395][52666] Sum rewards: 69.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.290', 'weapon4': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '55.000'} [2024-08-06 00:51:15,867][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:51:16,781][52649] DAMAGECOUNT value on done: 141900.0 [2024-08-06 00:51:16,783][52649] Sum rewards: 56.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.838', 'AMMO5': '0.012', 'AMMO2': '0.016', 'ARMOR': '0.036', 'weapon5': '0.058', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.233', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:17,299][52658] DAMAGECOUNT value on done: 141884.0 [2024-08-06 00:51:17,301][52658] Sum rewards: 60.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 211845120. Throughput: 0: 4385.8. Samples: 52961400. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:51:17,795][52567] Avg episode reward: [(0, '57.206')] [2024-08-06 00:51:17,832][52650] Updated weights for policy 0, policy_version 25861 (0.0041) [2024-08-06 00:51:18,021][52669] DAMAGECOUNT value on done: 145405.0 [2024-08-06 00:51:18,023][52669] Sum rewards: 66.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.385', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.320', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '59.000'} [2024-08-06 00:51:18,215][52666] DAMAGECOUNT value on done: 145534.0 [2024-08-06 00:51:18,217][52666] Sum rewards: 59.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.050', 'weapon5': '0.058', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.252', 'weapon2': '0.404', 'WEAPON4': '0.700', 'weapon4': '0.820', 'WEAPON3': '1.000', 'weapon3': '2.492', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:20,107][52649] DAMAGECOUNT value on done: 136368.0 [2024-08-06 00:51:20,108][52649] Sum rewards: 60.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.373', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon2': '0.190', 'AMMO3': '0.222', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.510', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:20,118][52658] DAMAGECOUNT value on done: 150459.0 [2024-08-06 00:51:20,118][52658] Sum rewards: 55.529, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.930', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.182', 'weapon4': '0.222', 'AMMO3': '0.311', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.100', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:20,661][52666] DAMAGECOUNT value on done: 142440.0 [2024-08-06 00:51:20,662][52666] Sum rewards: 49.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.437', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.384', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '46.000'} [2024-08-06 00:51:20,896][52669] DAMAGECOUNT value on done: 146396.0 [2024-08-06 00:51:20,897][52669] Sum rewards: 53.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.062', 'weapon5': '0.094', 'AMMO3': '0.136', 'WEAPON5': '0.250', 'AMMO4': '0.311', 'weapon2': '0.348', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon4': '1.164', 'weapon3': '2.190', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '44.000'} [2024-08-06 00:51:21,435][52670] DAMAGECOUNT value on done: 142959.0 [2024-08-06 00:51:21,458][52670] Sum rewards: 64.923, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.075', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.248', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '54.000'} [2024-08-06 00:51:22,772][52650] Updated weights for policy 0, policy_version 25871 (0.0018) [2024-08-06 00:51:22,794][52567] Fps is (10 sec: 17205.9, 60 sec: 17476.5, 300 sec: 17550.3). Total num frames: 211935232. Throughput: 0: 4389.3. Samples: 52987690. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:51:22,794][52567] Avg episode reward: [(0, '57.209')] [2024-08-06 00:51:23,043][52658] DAMAGECOUNT value on done: 150428.0 [2024-08-06 00:51:23,051][52658] Sum rewards: 60.547, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO4': '0.209', 'AMMO3': '0.237', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.230', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '53.000'} [2024-08-06 00:51:23,065][52666] DAMAGECOUNT value on done: 141451.0 [2024-08-06 00:51:23,065][52666] Sum rewards: 63.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.000'} [2024-08-06 00:51:23,283][52649] DAMAGECOUNT value on done: 140267.0 [2024-08-06 00:51:23,284][52649] Sum rewards: 60.596, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.226', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.148', 'AMMO3': '0.193', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON4': '0.550', 'weapon2': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.416', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:24,077][52669] DAMAGECOUNT value on done: 149017.0 [2024-08-06 00:51:24,078][52669] Sum rewards: 64.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '3.400', 'weapon3': '3.416', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '56.000'} [2024-08-06 00:51:24,143][52670] DAMAGECOUNT value on done: 147311.0 [2024-08-06 00:51:24,143][52670] Sum rewards: 44.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.426', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.183', 'AMMO4': '0.243', 'weapon5': '0.262', 'weapon4': '0.288', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.812', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '39.500'} [2024-08-06 00:51:25,834][52666] DAMAGECOUNT value on done: 139881.0 [2024-08-06 00:51:25,834][52666] Sum rewards: 62.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.107', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '53.000'} [2024-08-06 00:51:26,071][52658] DAMAGECOUNT value on done: 150600.0 [2024-08-06 00:51:26,072][52658] Sum rewards: 47.546, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.605', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.110', 'AMMO4': '0.238', 'AMMO3': '0.250', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.700', 'weapon4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.438', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '44.000'} [2024-08-06 00:51:26,463][52649] DAMAGECOUNT value on done: 137517.0 [2024-08-06 00:51:26,466][52649] Sum rewards: 63.047, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.138', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '53.000'} [2024-08-06 00:51:26,914][52650] Updated weights for policy 0, policy_version 25881 (0.0012) [2024-08-06 00:51:26,966][52670] DAMAGECOUNT value on done: 142383.0 [2024-08-06 00:51:26,967][52670] Sum rewards: 50.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.085', 'AMMO5': '0.006', 'AMMO2': '0.039', 'ARMOR': '0.040', 'weapon5': '0.074', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon4': '0.244', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '44.000'} [2024-08-06 00:51:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 212025344. Throughput: 0: 4394.0. Samples: 53014110. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:51:27,794][52567] Avg episode reward: [(0, '57.455')] [2024-08-06 00:51:28,569][52666] DAMAGECOUNT value on done: 141698.0 [2024-08-06 00:51:28,570][52666] Sum rewards: 51.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.482', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.154', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon2': '0.556', 'WEAPON3': '1.600', 'HITCOUNT': '2.910', 'weapon3': '3.020', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '47.000'} [2024-08-06 00:51:29,186][52658] DAMAGECOUNT value on done: 141860.0 [2024-08-06 00:51:29,186][52658] Sum rewards: 54.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.492', 'weapon4': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '45.500'} [2024-08-06 00:51:29,536][52670] DAMAGECOUNT value on done: 143402.0 [2024-08-06 00:51:29,536][52670] Sum rewards: 52.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.938', 'ARMOR': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon4': '0.170', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:29,730][52649] DAMAGECOUNT value on done: 144429.0 [2024-08-06 00:51:29,732][52649] Sum rewards: 58.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.831', 'AMMO5': '0.009', 'ARMOR': '0.012', 'weapon5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'weapon4': '0.414', 'weapon2': '0.488', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '52.000'} [2024-08-06 00:51:30,094][52795] DAMAGECOUNT value on done: 134612.0 [2024-08-06 00:51:30,094][52795] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.184', 'AMMO3': '0.194', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'weapon2': '0.384', 'weapon4': '0.442', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.716', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '53.000'} [2024-08-06 00:51:31,690][52666] DAMAGECOUNT value on done: 143307.0 [2024-08-06 00:51:31,694][52666] Sum rewards: 49.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.180', 'weapon4': '0.372', 'WEAPON4': '0.400', 'weapon2': '0.828', 'WEAPON3': '1.100', 'weapon3': '2.618', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '44.000'} [2024-08-06 00:51:31,885][52658] DAMAGECOUNT value on done: 145344.0 [2024-08-06 00:51:31,885][52658] Sum rewards: 51.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.883', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.072', 'weapon4': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.332', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.288', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '45.000'} [2024-08-06 00:51:32,031][52649] DAMAGECOUNT value on done: 139124.0 [2024-08-06 00:51:32,034][52649] Sum rewards: 62.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.672', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.188', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.302', 'WEAPON4': '0.400', 'weapon2': '0.494', 'weapon4': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.374', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:32,174][52650] Updated weights for policy 0, policy_version 25891 (0.0025) [2024-08-06 00:51:32,765][52670] DAMAGECOUNT value on done: 145659.0 [2024-08-06 00:51:32,766][52670] Sum rewards: 48.970, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.754', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.051', 'weapon5': '0.106', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'weapon2': '0.314', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '45.000'} [2024-08-06 00:51:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 212115456. Throughput: 0: 4392.7. Samples: 53027450. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:51:32,794][52567] Avg episode reward: [(0, '57.448')] [2024-08-06 00:51:33,298][52795] DAMAGECOUNT value on done: 129950.0 [2024-08-06 00:51:33,299][52795] Sum rewards: 36.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.066', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.568', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '3.002', 'DAMAGECOUNT': '10.182', 'FRAGCOUNT': '32.500'} [2024-08-06 00:51:34,561][52649] DAMAGECOUNT value on done: 141417.0 [2024-08-06 00:51:34,562][52649] Sum rewards: 51.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.878', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.280', 'weapon2': '0.332', 'WEAPON3': '1.800', 'HITCOUNT': '3.140', 'weapon3': '3.456', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '47.000'} [2024-08-06 00:51:34,577][52658] DAMAGECOUNT value on done: 144820.0 [2024-08-06 00:51:34,585][52658] Sum rewards: 59.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.052', 'weapon7': '0.060', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.213', 'weapon4': '0.412', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:34,869][52666] DAMAGECOUNT value on done: 144412.0 [2024-08-06 00:51:34,871][52666] Sum rewards: 45.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.036', 'ARMOR': '0.040', 'weapon5': '0.110', 'AMMO3': '0.172', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'weapon4': '0.318', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.898', 'DAMAGECOUNT': '12.210', 'FRAGCOUNT': '39.500'} [2024-08-06 00:51:35,792][52670] DAMAGECOUNT value on done: 145410.0 [2024-08-06 00:51:35,792][52670] Sum rewards: 58.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.722', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.164', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.348', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:36,450][52795] DAMAGECOUNT value on done: 133538.0 [2024-08-06 00:51:36,450][52795] Sum rewards: 61.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.185', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.058', 'AMMO3': '0.163', 'weapon5': '0.214', 'AMMO4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON4': '0.600', 'weapon4': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.198', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:36,575][52650] Updated weights for policy 0, policy_version 25901 (0.0020) [2024-08-06 00:51:37,265][52649] DAMAGECOUNT value on done: 141101.0 [2024-08-06 00:51:37,265][52649] Sum rewards: 68.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.839', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.054', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '56.000'} [2024-08-06 00:51:37,551][52658] DAMAGECOUNT value on done: 144598.0 [2024-08-06 00:51:37,551][52658] Sum rewards: 61.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO4': '0.186', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '0.712', 'WEAPON3': '1.200', 'weapon3': '2.658', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2024-08-06 00:51:37,711][52666] DAMAGECOUNT value on done: 143964.0 [2024-08-06 00:51:37,712][52666] Sum rewards: 50.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.489', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.182', 'AMMO3': '0.211', 'AMMO4': '0.253', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '43.000'} [2024-08-06 00:51:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 212197376. Throughput: 0: 4397.1. Samples: 53053730. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 00:51:37,794][52567] Avg episode reward: [(0, '56.999')] [2024-08-06 00:51:38,682][52670] DAMAGECOUNT value on done: 139133.0 [2024-08-06 00:51:38,683][52670] Sum rewards: 55.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.682', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.037', 'weapon5': '0.092', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.638', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:39,209][52663] DAMAGECOUNT value on done: 143915.0 [2024-08-06 00:51:39,211][52663] Sum rewards: 56.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.132', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'weapon4': '0.388', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '45.000'} [2024-08-06 00:51:39,570][52795] DAMAGECOUNT value on done: 133257.0 [2024-08-06 00:51:39,571][52795] Sum rewards: 58.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.879', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon5': '0.302', 'WEAPON4': '0.450', 'weapon4': '0.524', 'weapon2': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.200', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:40,194][52649] DAMAGECOUNT value on done: 137714.0 [2024-08-06 00:51:40,194][52649] Sum rewards: 49.388, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO5': '0.004', 'ARMOR': '0.012', 'weapon5': '0.024', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.194', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.478', 'weapon2': '0.708', 'WEAPON3': '1.250', 'weapon3': '2.554', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '45.000'} [2024-08-06 00:51:40,623][52666] DAMAGECOUNT value on done: 142086.0 [2024-08-06 00:51:40,623][52666] Sum rewards: 56.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'ARMOR': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon4': '0.228', 'AMMO3': '0.237', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:40,666][52658] DAMAGECOUNT value on done: 148949.0 [2024-08-06 00:51:40,666][52658] Sum rewards: 55.548, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.120', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:41,160][52650] Updated weights for policy 0, policy_version 25911 (0.0016) [2024-08-06 00:51:41,496][52670] DAMAGECOUNT value on done: 143811.0 [2024-08-06 00:51:41,496][52670] Sum rewards: 58.398, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.302', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO3': '0.157', 'weapon2': '1.046', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '46.000'} [2024-08-06 00:51:42,123][52671] DAMAGECOUNT value on done: 151463.0 [2024-08-06 00:51:42,123][52671] Sum rewards: 60.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.054', 'weapon5': '0.062', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.271', 'weapon4': '0.332', 'WEAPON4': '0.450', 'weapon2': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.664', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '52.000'} [2024-08-06 00:51:42,399][52663] DAMAGECOUNT value on done: 145960.0 [2024-08-06 00:51:42,399][52663] Sum rewards: 59.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.871', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.073', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.364', 'weapon2': '0.678', 'WEAPON4': '0.700', 'weapon4': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.288', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 212295680. Throughput: 0: 4394.4. Samples: 53079870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:51:42,794][52567] Avg episode reward: [(0, '56.854')] [2024-08-06 00:51:42,802][52795] DAMAGECOUNT value on done: 135686.0 [2024-08-06 00:51:42,803][52795] Sum rewards: 60.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.755', 'AMMO5': '0.007', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.182', 'AMMO4': '0.251', 'weapon2': '0.344', 'weapon4': '0.378', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:43,292][52658] DAMAGECOUNT value on done: 149783.0 [2024-08-06 00:51:43,294][52658] Sum rewards: 61.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.377', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.378', 'weapon4': '0.396', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:43,319][52649] DAMAGECOUNT value on done: 144873.0 [2024-08-06 00:51:43,319][52649] Sum rewards: 61.500, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.444', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.012', 'weapon4': '0.014', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.238', 'weapon2': '0.392', 'WEAPON3': '1.450', 'HITCOUNT': '3.370', 'weapon3': '3.394', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '54.000'} [2024-08-06 00:51:43,388][52666] DAMAGECOUNT value on done: 138806.0 [2024-08-06 00:51:43,388][52666] Sum rewards: 48.769, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'WEAPON4': '0.150', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.366', 'weapon4': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.884', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '44.000'} [2024-08-06 00:51:44,043][52670] DAMAGECOUNT value on done: 138953.0 [2024-08-06 00:51:44,043][52670] Sum rewards: 57.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.312', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:45,187][52671] DAMAGECOUNT value on done: 144942.0 [2024-08-06 00:51:45,196][52671] Sum rewards: 59.202, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.178', 'AMMO5': '0.003', 'ARMOR': '0.021', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'AMMO3': '0.295', 'weapon2': '0.362', 'WEAPON3': '1.750', 'weapon3': '3.230', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '54.000'} [2024-08-06 00:51:45,594][52663] DAMAGECOUNT value on done: 144241.0 [2024-08-06 00:51:45,594][52663] Sum rewards: 46.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.170', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.594', 'WEAPON3': '1.200', 'HITCOUNT': '2.630', 'weapon3': '2.964', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '41.000'} [2024-08-06 00:51:45,685][52650] Updated weights for policy 0, policy_version 25921 (0.0027) [2024-08-06 00:51:45,861][52795] DAMAGECOUNT value on done: 133259.0 [2024-08-06 00:51:45,861][52795] Sum rewards: 60.407, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.107', 'weapon4': '0.154', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '0.650', 'weapon2': '0.796', 'weapon3': '2.810', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:45,978][52666] DAMAGECOUNT value on done: 146371.0 [2024-08-06 00:51:45,978][52666] Sum rewards: 59.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.215', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:46,226][52658] DAMAGECOUNT value on done: 141755.0 [2024-08-06 00:51:46,228][52658] Sum rewards: 57.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.055', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.410', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:46,684][52649] DAMAGECOUNT value on done: 143353.0 [2024-08-06 00:51:46,685][52649] Sum rewards: 58.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:46,879][52670] DAMAGECOUNT value on done: 135585.0 [2024-08-06 00:51:46,879][52670] Sum rewards: 49.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.221', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'AMMO4': '0.191', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.562', 'WEAPON3': '0.800', 'weapon4': '1.128', 'weapon3': '1.826', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '41.000'} [2024-08-06 00:51:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 212377600. Throughput: 0: 4392.7. Samples: 53093210. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:51:47,794][52567] Avg episode reward: [(0, '56.973')] [2024-08-06 00:51:48,324][52671] DAMAGECOUNT value on done: 150677.0 [2024-08-06 00:51:48,325][52671] Sum rewards: 71.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.516', 'weapon4': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.470', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 00:51:48,337][52663] DAMAGECOUNT value on done: 144836.0 [2024-08-06 00:51:48,338][52663] Sum rewards: 58.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:48,616][52658] DAMAGECOUNT value on done: 143766.0 [2024-08-06 00:51:48,617][52658] Sum rewards: 59.349, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.953', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.155', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '3.166', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:48,954][52795] DAMAGECOUNT value on done: 137057.0 [2024-08-06 00:51:48,954][52795] Sum rewards: 55.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.089', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.210', 'AMMO4': '0.219', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:49,235][52666] DAMAGECOUNT value on done: 146806.0 [2024-08-06 00:51:49,237][52666] Sum rewards: 59.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.908', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'weapon5': '0.202', 'AMMO4': '0.213', 'AMMO3': '0.253', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.758', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:49,655][52649] DAMAGECOUNT value on done: 137322.0 [2024-08-06 00:51:49,655][52649] Sum rewards: 58.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.160', 'weapon4': '0.172', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.698', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:50,016][52670] DAMAGECOUNT value on done: 147031.0 [2024-08-06 00:51:50,016][52670] Sum rewards: 57.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.139', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.634', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:50,604][52650] Updated weights for policy 0, policy_version 25931 (0.0030) [2024-08-06 00:51:50,772][52614] Signal inference workers to stop experience collection... (4800 times) [2024-08-06 00:51:50,773][52614] Signal inference workers to resume experience collection... (4800 times) [2024-08-06 00:51:50,855][52650] InferenceWorker_p0-w0: stopping experience collection (4800 times) [2024-08-06 00:51:50,855][52650] InferenceWorker_p0-w0: resuming experience collection (4800 times) [2024-08-06 00:51:51,448][52663] DAMAGECOUNT value on done: 142251.0 [2024-08-06 00:51:51,450][52663] Sum rewards: 60.271, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'AMMO4': '0.239', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '52.000'} [2024-08-06 00:51:51,552][52671] DAMAGECOUNT value on done: 144266.0 [2024-08-06 00:51:51,554][52671] Sum rewards: 53.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO3': '0.175', 'AMMO4': '0.180', 'weapon2': '0.414', 'WEAPON4': '0.450', 'weapon4': '0.842', 'WEAPON3': '1.050', 'weapon3': '2.310', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '46.000'} [2024-08-06 00:51:51,605][52658] DAMAGECOUNT value on done: 149317.0 [2024-08-06 00:51:51,606][52658] Sum rewards: 57.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.494', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.057', 'weapon5': '0.180', 'AMMO3': '0.231', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'weapon4': '0.480', 'WEAPON4': '0.550', 'weapon2': '0.710', 'WEAPON3': '1.300', 'weapon3': '2.348', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:51,705][52666] DAMAGECOUNT value on done: 142799.0 [2024-08-06 00:51:51,705][52666] Sum rewards: 62.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.347', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.108', 'AMMO3': '0.180', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '55.000'} [2024-08-06 00:51:51,873][52662] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:51:52,098][52795] DAMAGECOUNT value on done: 136611.0 [2024-08-06 00:51:52,100][52795] Sum rewards: 57.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '49.000'} [2024-08-06 00:51:52,273][52670] DAMAGECOUNT value on done: 144696.0 [2024-08-06 00:51:52,274][52670] Sum rewards: 57.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.052', 'AMMO4': '0.062', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.372', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.320', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:52,761][52649] DAMAGECOUNT value on done: 143419.0 [2024-08-06 00:51:52,762][52649] Sum rewards: 57.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.359', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.201', 'weapon2': '0.362', 'weapon4': '0.366', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.978', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 212467712. Throughput: 0: 4395.8. Samples: 53119660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 00:51:52,795][52567] Avg episode reward: [(0, '56.974')] [2024-08-06 00:51:54,135][52663] DAMAGECOUNT value on done: 150960.0 [2024-08-06 00:51:54,137][52663] Sum rewards: 48.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.944', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.172', 'AMMO3': '0.192', 'AMMO4': '0.217', 'weapon4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.020', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '43.000'} [2024-08-06 00:51:54,232][52666] DAMAGECOUNT value on done: 141897.0 [2024-08-06 00:51:54,232][52666] Sum rewards: 68.631, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.034', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon4': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 00:51:54,599][52671] DAMAGECOUNT value on done: 146631.0 [2024-08-06 00:51:54,599][52671] Sum rewards: 60.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.180', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.680', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '51.000'} [2024-08-06 00:51:55,250][52650] Updated weights for policy 0, policy_version 25941 (0.0027) [2024-08-06 00:51:55,257][52795] DAMAGECOUNT value on done: 133239.0 [2024-08-06 00:51:55,259][52795] Sum rewards: 51.427, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.930', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.306', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.082', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:55,267][52670] DAMAGECOUNT value on done: 145713.0 [2024-08-06 00:51:55,268][52670] Sum rewards: 68.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.726', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.114', 'AMMO4': '0.161', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '57.000'} [2024-08-06 00:51:56,010][52649] DAMAGECOUNT value on done: 140957.0 [2024-08-06 00:51:56,012][52649] Sum rewards: 54.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.505', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.340', 'weapon4': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.000'} [2024-08-06 00:51:57,094][52663] DAMAGECOUNT value on done: 145593.0 [2024-08-06 00:51:57,097][52663] Sum rewards: 22.474, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon7': '0.056', 'AMMO3': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'WEAPON3': '0.350', 'weapon2': '0.408', 'WEAPON4': '0.450', 'HEALTH': '0.740', 'weapon4': '1.150', 'HITCOUNT': '1.380', 'weapon3': '1.548', 'DAMAGECOUNT': '6.345', 'FRAGCOUNT': '18.000'} [2024-08-06 00:51:57,194][52666] DAMAGECOUNT value on done: 141349.0 [2024-08-06 00:51:57,196][52666] Sum rewards: 43.945, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.675', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.292', 'weapon2': '0.684', 'WEAPON3': '0.950', 'HITCOUNT': '2.570', 'weapon3': '2.774', 'DAMAGECOUNT': '11.418', 'FRAGCOUNT': '35.000'} [2024-08-06 00:51:57,218][52671] DAMAGECOUNT value on done: 147184.0 [2024-08-06 00:51:57,218][52671] Sum rewards: 57.713, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.092', 'AMMO4': '0.163', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.394', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.000', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '50.000'} [2024-08-06 00:51:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 212557824. Throughput: 0: 4395.9. Samples: 53145920. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:51:57,794][52567] Avg episode reward: [(0, '56.592')] [2024-08-06 00:51:57,985][52670] DAMAGECOUNT value on done: 142518.0 [2024-08-06 00:51:57,985][52670] Sum rewards: 54.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.938', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.144', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '46.000'} [2024-08-06 00:51:58,392][52795] DAMAGECOUNT value on done: 135823.0 [2024-08-06 00:51:58,392][52795] Sum rewards: 50.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.016', 'weapon5': '0.062', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '42.500'} [2024-08-06 00:51:59,200][52649] DAMAGECOUNT value on done: 146548.0 [2024-08-06 00:51:59,201][52649] Sum rewards: 55.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.582', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.030', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '48.000'} [2024-08-06 00:51:59,787][52650] Updated weights for policy 0, policy_version 25951 (0.0010) [2024-08-06 00:52:00,068][52666] DAMAGECOUNT value on done: 146975.0 [2024-08-06 00:52:00,070][52666] Sum rewards: 59.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.785', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.221', 'weapon2': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.362', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:00,207][52663] DAMAGECOUNT value on done: 144096.0 [2024-08-06 00:52:00,209][52663] Sum rewards: 62.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.197', 'weapon2': '0.282', 'WEAPON4': '0.450', 'weapon4': '1.040', 'WEAPON3': '1.200', 'weapon3': '2.344', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:00,451][52671] DAMAGECOUNT value on done: 147003.0 [2024-08-06 00:52:00,452][52671] Sum rewards: 48.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.740', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.046', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.228', 'AMMO3': '0.255', 'weapon2': '0.272', 'WEAPON4': '0.500', 'weapon4': '0.812', 'WEAPON3': '1.550', 'weapon3': '2.456', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.015', 'FRAGCOUNT': '45.000'} [2024-08-06 00:52:00,937][52670] DAMAGECOUNT value on done: 149271.0 [2024-08-06 00:52:00,937][52670] Sum rewards: 57.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.056', 'AMMO3': '0.150', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.894', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '49.000'} [2024-08-06 00:52:01,527][52795] DAMAGECOUNT value on done: 134230.0 [2024-08-06 00:52:01,527][52795] Sum rewards: 62.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.061', 'weapon5': '0.108', 'AMMO3': '0.164', 'WEAPON5': '0.300', 'AMMO4': '0.304', 'weapon2': '0.430', 'WEAPON4': '0.550', 'weapon4': '0.786', 'WEAPON3': '1.000', 'weapon3': '2.388', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:02,012][52649] DAMAGECOUNT value on done: 143803.0 [2024-08-06 00:52:02,013][52649] Sum rewards: 62.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.118', 'weapon4': '0.136', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'weapon2': '0.824', 'WEAPON3': '0.950', 'weapon3': '2.724', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 212639744. Throughput: 0: 4400.0. Samples: 53159400. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:52:02,794][52567] Avg episode reward: [(0, '56.388')] [2024-08-06 00:52:03,113][52666] DAMAGECOUNT value on done: 140521.0 [2024-08-06 00:52:03,113][52666] Sum rewards: 56.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.512', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.110', 'AMMO4': '0.180', 'weapon4': '0.226', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.132', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:03,134][52671] DAMAGECOUNT value on done: 148533.0 [2024-08-06 00:52:03,135][52671] Sum rewards: 53.366, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.644', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'WEAPON5': '0.050', 'AMMO2': '0.053', 'AMMO3': '0.211', 'AMMO4': '0.263', 'weapon4': '0.404', 'weapon2': '0.476', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '49.000'} [2024-08-06 00:52:03,308][52663] DAMAGECOUNT value on done: 146983.0 [2024-08-06 00:52:03,309][52663] Sum rewards: 64.345, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.763', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.594', 'WEAPON3': '1.500', 'weapon3': '2.884', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 00:52:04,070][52670] DAMAGECOUNT value on done: 137559.0 [2024-08-06 00:52:04,072][52670] Sum rewards: 49.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.513', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon5': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.430', 'weapon2': '0.474', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.696', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '42.000'} [2024-08-06 00:52:04,144][52665] DAMAGECOUNT value on done: 142752.0 [2024-08-06 00:52:04,144][52665] Sum rewards: 59.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.958', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.058', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.176', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.292', 'weapon2': '0.408', 'weapon4': '0.698', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.352', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '49.000'} [2024-08-06 00:52:04,298][52650] Updated weights for policy 0, policy_version 25961 (0.0017) [2024-08-06 00:52:04,726][52795] DAMAGECOUNT value on done: 133566.0 [2024-08-06 00:52:04,726][52795] Sum rewards: 59.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.487', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.182', 'weapon5': '0.194', 'AMMO4': '0.237', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON4': '0.550', 'weapon4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.512', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '52.000'} [2024-08-06 00:52:05,057][52649] DAMAGECOUNT value on done: 149212.0 [2024-08-06 00:52:05,057][52649] Sum rewards: 63.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.912', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.204', 'weapon2': '0.328', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.608', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:05,632][52663] DAMAGECOUNT value on done: 148334.0 [2024-08-06 00:52:05,633][52663] Sum rewards: 54.619, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.102', 'AMMO3': '0.248', 'weapon2': '0.436', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.188', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '48.000'} [2024-08-06 00:52:05,900][52671] DAMAGECOUNT value on done: 145184.0 [2024-08-06 00:52:05,900][52671] Sum rewards: 62.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.038', 'AMMO2': '0.047', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.235', 'weapon4': '0.404', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:06,257][52666] DAMAGECOUNT value on done: 144840.0 [2024-08-06 00:52:06,260][52666] Sum rewards: 57.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.034', 'ARMOR': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:06,863][52670] DAMAGECOUNT value on done: 147256.0 [2024-08-06 00:52:06,863][52670] Sum rewards: 63.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.068', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.214', 'weapon4': '0.230', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.276', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:07,206][52665] DAMAGECOUNT value on done: 149089.0 [2024-08-06 00:52:07,206][52665] Sum rewards: 53.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.054', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.244', 'weapon4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '48.000'} [2024-08-06 00:52:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 212729856. Throughput: 0: 4402.2. Samples: 53185790. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:52:07,794][52567] Avg episode reward: [(0, '56.742')] [2024-08-06 00:52:07,834][52795] DAMAGECOUNT value on done: 132985.0 [2024-08-06 00:52:07,835][52795] Sum rewards: 60.272, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.638', 'AMMO5': '0.003', 'weapon5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon4': '0.140', 'AMMO4': '0.193', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:08,634][52663] DAMAGECOUNT value on done: 147865.0 [2024-08-06 00:52:08,636][52663] Sum rewards: 60.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.576', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '3.210', 'weapon3': '3.248', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '52.000'} [2024-08-06 00:52:08,804][52671] DAMAGECOUNT value on done: 149155.0 [2024-08-06 00:52:08,805][52671] Sum rewards: 60.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.552', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.136', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.584', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:09,043][52650] Updated weights for policy 0, policy_version 25971 (0.0013) [2024-08-06 00:52:09,314][52670] DAMAGECOUNT value on done: 146277.0 [2024-08-06 00:52:09,314][52670] Sum rewards: 61.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.655', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.046', 'AMMO4': '0.116', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.480', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:10,433][52665] DAMAGECOUNT value on done: 143756.0 [2024-08-06 00:52:10,451][52665] Sum rewards: 66.859, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.048', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO3': '0.202', 'AMMO4': '0.204', 'weapon2': '0.314', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 00:52:11,072][52795] DAMAGECOUNT value on done: 133601.0 [2024-08-06 00:52:11,074][52795] Sum rewards: 45.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.714', 'AMMO5': '0.003', 'weapon5': '0.036', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.177', 'weapon4': '0.198', 'AMMO4': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.764', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.832', 'DAMAGECOUNT': '12.501', 'FRAGCOUNT': '39.000'} [2024-08-06 00:52:11,251][52663] DAMAGECOUNT value on done: 145163.0 [2024-08-06 00:52:11,253][52663] Sum rewards: 59.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.112', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO4': '0.180', 'AMMO3': '0.226', 'weapon2': '0.360', 'WEAPON4': '0.550', 'weapon4': '0.618', 'WEAPON3': '1.400', 'weapon3': '2.578', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:11,690][52659] DAMAGECOUNT value on done: 146017.0 [2024-08-06 00:52:11,692][52659] Sum rewards: 60.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'ARMOR': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.193', 'weapon4': '0.240', 'AMMO4': '0.243', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.184', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:11,747][52671] DAMAGECOUNT value on done: 145915.0 [2024-08-06 00:52:11,747][52671] Sum rewards: 49.094, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.596', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.042', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.232', 'weapon2': '0.404', 'WEAPON4': '0.600', 'weapon4': '0.618', 'WEAPON3': '1.400', 'weapon3': '2.588', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '44.000'} [2024-08-06 00:52:12,367][52670] DAMAGECOUNT value on done: 144533.0 [2024-08-06 00:52:12,367][52670] Sum rewards: 55.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.106', 'ARMOR': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.348', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '49.000'} [2024-08-06 00:52:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17613.3, 300 sec: 17578.1). Total num frames: 212819968. Throughput: 0: 4405.8. Samples: 53212370. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:52:12,794][52567] Avg episode reward: [(0, '56.608')] [2024-08-06 00:52:13,206][52665] DAMAGECOUNT value on done: 140217.0 [2024-08-06 00:52:13,206][52665] Sum rewards: 47.689, reward structure: {'DEATHCOUNT': '-18.750', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.032', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'HEALTH': '0.258', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '43.500'} [2024-08-06 00:52:13,804][52650] Updated weights for policy 0, policy_version 25981 (0.0041) [2024-08-06 00:52:14,049][52663] DAMAGECOUNT value on done: 139433.0 [2024-08-06 00:52:14,051][52663] Sum rewards: 46.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.174', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '3.018', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '40.500'} [2024-08-06 00:52:14,148][52795] DAMAGECOUNT value on done: 131261.0 [2024-08-06 00:52:14,150][52795] Sum rewards: 58.104, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.022', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.236', 'weapon2': '0.256', 'AMMO3': '0.268', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.650', 'weapon3': '3.038', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:14,818][52659] DAMAGECOUNT value on done: 145337.0 [2024-08-06 00:52:14,818][52659] Sum rewards: 58.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.390', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO3': '0.158', 'weapon4': '0.180', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.780', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '46.000'} [2024-08-06 00:52:14,894][52671] DAMAGECOUNT value on done: 145434.0 [2024-08-06 00:52:14,894][52671] Sum rewards: 61.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.709', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon4': '0.294', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:15,475][52670] DAMAGECOUNT value on done: 144170.0 [2024-08-06 00:52:15,483][52670] Sum rewards: 67.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.276', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.026', 'weapon5': '0.058', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.266', 'weapon2': '0.294', 'WEAPON3': '1.600', 'weapon3': '3.422', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 00:52:15,905][52665] DAMAGECOUNT value on done: 141875.0 [2024-08-06 00:52:15,906][52665] Sum rewards: 53.945, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.390', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '44.000'} [2024-08-06 00:52:16,890][52663] DAMAGECOUNT value on done: 142639.0 [2024-08-06 00:52:16,890][52663] Sum rewards: 43.987, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO4': '0.195', 'weapon2': '0.276', 'AMMO3': '0.296', 'WEAPON3': '1.750', 'HITCOUNT': '2.940', 'weapon3': '3.286', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '42.000'} [2024-08-06 00:52:17,274][52795] DAMAGECOUNT value on done: 137561.0 [2024-08-06 00:52:17,275][52795] Sum rewards: 67.596, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.114', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.656', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '54.000'} [2024-08-06 00:52:17,787][52659] DAMAGECOUNT value on done: 146595.0 [2024-08-06 00:52:17,790][52659] Sum rewards: 60.093, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.130', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.106', 'AMMO4': '0.111', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.352', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.300', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '54.000'} [2024-08-06 00:52:17,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 212901888. Throughput: 0: 4404.4. Samples: 53225650. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:52:17,795][52567] Avg episode reward: [(0, '56.666')] [2024-08-06 00:52:17,864][52671] DAMAGECOUNT value on done: 152353.0 [2024-08-06 00:52:17,867][52671] Sum rewards: 67.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO4': '0.169', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '59.000'} [2024-08-06 00:52:18,155][52650] Updated weights for policy 0, policy_version 25991 (0.0012) [2024-08-06 00:52:18,428][52665] DAMAGECOUNT value on done: 143334.0 [2024-08-06 00:52:18,429][52665] Sum rewards: 50.362, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.912', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.062', 'weapon5': '0.126', 'AMMO3': '0.252', 'weapon4': '0.282', 'WEAPON5': '0.300', 'AMMO4': '0.312', 'WEAPON4': '0.600', 'weapon2': '0.626', 'WEAPON3': '1.550', 'weapon3': '2.662', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '47.000'} [2024-08-06 00:52:19,660][52663] DAMAGECOUNT value on done: 147811.0 [2024-08-06 00:52:19,662][52663] Sum rewards: 59.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.988', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.183', 'AMMO4': '0.189', 'weapon4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '50.500'} [2024-08-06 00:52:20,416][52795] DAMAGECOUNT value on done: 137063.0 [2024-08-06 00:52:20,417][52795] Sum rewards: 51.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.056', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.238', 'weapon2': '0.840', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '43.000'} [2024-08-06 00:52:20,486][52659] DAMAGECOUNT value on done: 148406.0 [2024-08-06 00:52:20,495][52659] Sum rewards: 49.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.049', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.246', 'weapon2': '0.330', 'WEAPON4': '0.450', 'weapon4': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '41.500'} [2024-08-06 00:52:20,508][52671] DAMAGECOUNT value on done: 146850.0 [2024-08-06 00:52:20,509][52671] Sum rewards: 44.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.234', 'weapon4': '0.242', 'WEAPON4': '0.450', 'weapon2': '0.786', 'WEAPON3': '1.400', 'HITCOUNT': '2.390', 'weapon3': '2.588', 'DAMAGECOUNT': '11.685', 'FRAGCOUNT': '41.000'} [2024-08-06 00:52:21,228][52665] DAMAGECOUNT value on done: 144314.0 [2024-08-06 00:52:21,261][52665] Sum rewards: 49.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.030', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.145', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.408', 'weapon4': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '43.000'} [2024-08-06 00:52:22,614][52663] DAMAGECOUNT value on done: 148188.0 [2024-08-06 00:52:22,614][52663] Sum rewards: 70.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '60.000'} [2024-08-06 00:52:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 212992000. Throughput: 0: 4409.1. Samples: 53252140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:52:22,794][52567] Avg episode reward: [(0, '56.944')] [2024-08-06 00:52:23,001][52650] Updated weights for policy 0, policy_version 26001 (0.0013) [2024-08-06 00:52:23,089][52659] DAMAGECOUNT value on done: 145658.0 [2024-08-06 00:52:23,090][52659] Sum rewards: 58.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.224', 'weapon2': '0.468', 'WEAPON4': '0.500', 'weapon4': '0.622', 'WEAPON3': '1.350', 'weapon3': '2.544', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:23,112][52671] DAMAGECOUNT value on done: 140990.0 [2024-08-06 00:52:23,112][52671] Sum rewards: 51.624, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.004', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.295', 'weapon2': '0.406', 'WEAPON3': '1.850', 'HITCOUNT': '2.840', 'weapon3': '3.116', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:23,647][52795] DAMAGECOUNT value on done: 131752.0 [2024-08-06 00:52:23,647][52795] Sum rewards: 55.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.652', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'AMMO3': '0.163', 'WEAPON7': '0.200', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.582', 'weapon2': '0.734', 'WEAPON3': '0.950', 'weapon3': '2.236', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '47.000'} [2024-08-06 00:52:24,514][52665] DAMAGECOUNT value on done: 146563.0 [2024-08-06 00:52:24,516][52665] Sum rewards: 48.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.542', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.171', 'weapon5': '0.174', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.500', 'weapon2': '0.616', 'WEAPON3': '0.900', 'weapon3': '2.524', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '40.000'} [2024-08-06 00:52:25,497][52671] DAMAGECOUNT value on done: 150196.0 [2024-08-06 00:52:25,505][52671] Sum rewards: 64.218, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.126', 'weapon4': '0.144', 'HEALTH': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '55.000'} [2024-08-06 00:52:25,500][52659] DAMAGECOUNT value on done: 145169.0 [2024-08-06 00:52:25,508][52659] Sum rewards: 43.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.877', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.084', 'weapon4': '0.156', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.774', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '2.848', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '36.000'} [2024-08-06 00:52:25,801][52663] DAMAGECOUNT value on done: 149080.0 [2024-08-06 00:52:25,801][52663] Sum rewards: 60.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.506', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:26,887][52795] DAMAGECOUNT value on done: 137959.0 [2024-08-06 00:52:26,887][52795] Sum rewards: 57.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.026', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.035', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon5': '0.220', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '49.500'} [2024-08-06 00:52:27,632][52665] DAMAGECOUNT value on done: 150123.0 [2024-08-06 00:52:27,632][52665] Sum rewards: 56.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.705', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '48.500'} [2024-08-06 00:52:27,748][52650] Updated weights for policy 0, policy_version 26011 (0.0020) [2024-08-06 00:52:27,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 213082112. Throughput: 0: 4416.0. Samples: 53278590. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:52:27,795][52567] Avg episode reward: [(0, '56.751')] [2024-08-06 00:52:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026011_213082112.pth... [2024-08-06 00:52:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000025497_208871424.pth [2024-08-06 00:52:28,713][52671] DAMAGECOUNT value on done: 147477.0 [2024-08-06 00:52:28,713][52671] Sum rewards: 53.775, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.674', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '47.000'} [2024-08-06 00:52:28,720][52659] DAMAGECOUNT value on done: 146822.0 [2024-08-06 00:52:28,721][52659] Sum rewards: 61.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.232', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'weapon4': '0.342', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:28,959][52663] DAMAGECOUNT value on done: 148398.0 [2024-08-06 00:52:28,963][52663] Sum rewards: 52.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.888', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.043', 'weapon5': '0.062', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.496', 'WEAPON4': '0.550', 'weapon2': '0.870', 'WEAPON3': '1.050', 'weapon3': '2.376', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '44.000'} [2024-08-06 00:52:30,005][52795] DAMAGECOUNT value on done: 138767.0 [2024-08-06 00:52:30,007][52795] Sum rewards: 53.900, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'ARMOR': '0.040', 'AMMO4': '0.091', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.424', 'weapon4': '0.456', 'WEAPON3': '0.850', 'HITCOUNT': '2.910', 'weapon3': '2.934', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '42.000'} [2024-08-06 00:52:30,755][52665] DAMAGECOUNT value on done: 144958.0 [2024-08-06 00:52:30,758][52665] Sum rewards: 63.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.454', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.064', 'weapon4': '0.130', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.214', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.382', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '57.000'} [2024-08-06 00:52:31,796][52671] DAMAGECOUNT value on done: 147972.0 [2024-08-06 00:52:31,798][52671] Sum rewards: 70.660, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.119', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '61.000'} [2024-08-06 00:52:31,840][52659] DAMAGECOUNT value on done: 141749.0 [2024-08-06 00:52:31,844][52659] Sum rewards: 65.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.182', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '56.000'} [2024-08-06 00:52:31,923][52663] DAMAGECOUNT value on done: 148013.0 [2024-08-06 00:52:31,923][52663] Sum rewards: 59.360, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon4': '0.278', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:32,317][52650] Updated weights for policy 0, policy_version 26021 (0.0039) [2024-08-06 00:52:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 213164032. Throughput: 0: 4405.3. Samples: 53291450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:52:32,794][52567] Avg episode reward: [(0, '56.989')] [2024-08-06 00:52:33,886][52665] DAMAGECOUNT value on done: 147531.0 [2024-08-06 00:52:33,887][52665] Sum rewards: 49.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.146', 'AMMO4': '0.165', 'weapon5': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.684', 'weapon4': '0.760', 'WEAPON3': '0.850', 'weapon3': '2.086', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '43.000'} [2024-08-06 00:52:34,796][52671] DAMAGECOUNT value on done: 148800.0 [2024-08-06 00:52:34,796][52671] Sum rewards: 46.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.126', 'weapon5': '0.224', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON4': '0.500', 'weapon2': '0.788', 'WEAPON3': '0.850', 'weapon3': '2.396', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '39.000'} [2024-08-06 00:52:34,855][52659] DAMAGECOUNT value on done: 147670.0 [2024-08-06 00:52:34,856][52659] Sum rewards: 41.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.490', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.500', 'weapon4': '0.582', 'weapon2': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.438', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '38.000'} [2024-08-06 00:52:35,110][52663] DAMAGECOUNT value on done: 144302.0 [2024-08-06 00:52:35,111][52663] Sum rewards: 54.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.373', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.722', 'WEAPON3': '1.150', 'weapon3': '2.724', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '45.000'} [2024-08-06 00:52:36,916][52665] DAMAGECOUNT value on done: 147341.0 [2024-08-06 00:52:36,920][52665] Sum rewards: 58.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon2': '0.238', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.570', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:37,166][52650] Updated weights for policy 0, policy_version 26031 (0.0028) [2024-08-06 00:52:37,714][52671] DAMAGECOUNT value on done: 146666.0 [2024-08-06 00:52:37,715][52671] Sum rewards: 63.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.682', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.356', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:37,766][52659] DAMAGECOUNT value on done: 149334.0 [2024-08-06 00:52:37,767][52659] Sum rewards: 40.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.916', 'AMMO5': '0.012', 'AMMO2': '0.064', 'AMMO3': '0.146', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.321', 'weapon2': '0.482', 'weapon4': '0.484', 'WEAPON4': '0.750', 'WEAPON3': '0.850', 'HITCOUNT': '2.510', 'weapon3': '2.532', 'DAMAGECOUNT': '11.097', 'FRAGCOUNT': '35.000'} [2024-08-06 00:52:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 213254144. Throughput: 0: 4402.4. Samples: 53317770. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:52:37,795][52567] Avg episode reward: [(0, '56.610')] [2024-08-06 00:52:39,921][52665] DAMAGECOUNT value on done: 143825.0 [2024-08-06 00:52:39,922][52665] Sum rewards: 56.690, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.686', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:40,733][52659] DAMAGECOUNT value on done: 145765.0 [2024-08-06 00:52:40,736][52659] Sum rewards: 60.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.196', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:41,625][52650] Updated weights for policy 0, policy_version 26041 (0.0029) [2024-08-06 00:52:41,826][52820] DAMAGECOUNT value on done: 134615.0 [2024-08-06 00:52:41,828][52820] Sum rewards: 49.086, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.404', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.234', 'weapon4': '0.352', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '2.440', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.186', 'FRAGCOUNT': '40.000'} [2024-08-06 00:52:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 213344256. Throughput: 0: 4403.6. Samples: 53344080. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:52:42,794][52567] Avg episode reward: [(0, '56.492')] [2024-08-06 00:52:42,816][52665] DAMAGECOUNT value on done: 143801.0 [2024-08-06 00:52:42,818][52665] Sum rewards: 56.070, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.158', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon5': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.414', 'HEALTH': '0.530', 'WEAPON3': '0.850', 'weapon3': '2.782', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '44.000'} [2024-08-06 00:52:43,680][52659] DAMAGECOUNT value on done: 141088.0 [2024-08-06 00:52:43,682][52659] Sum rewards: 52.951, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.756', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.150', 'weapon4': '0.260', 'AMMO3': '0.278', 'weapon2': '0.558', 'WEAPON3': '1.550', 'weapon3': '2.924', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '48.000'} [2024-08-06 00:52:43,877][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:52:45,018][52820] DAMAGECOUNT value on done: 137276.0 [2024-08-06 00:52:45,018][52820] Sum rewards: 61.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon4': '0.572', 'weapon2': '0.780', 'WEAPON3': '0.950', 'weapon3': '2.396', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:45,706][52665] DAMAGECOUNT value on done: 145471.0 [2024-08-06 00:52:45,708][52665] Sum rewards: 52.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.008', 'AMMO2': '0.021', 'ARMOR': '0.036', 'AMMO4': '0.103', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'weapon4': '0.390', 'weapon2': '0.930', 'WEAPON3': '1.000', 'weapon3': '2.518', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '43.000'} [2024-08-06 00:52:46,317][52659] DAMAGECOUNT value on done: 140998.0 [2024-08-06 00:52:46,318][52659] Sum rewards: 53.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.098', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '46.000'} [2024-08-06 00:52:46,356][52650] Updated weights for policy 0, policy_version 26051 (0.0043) [2024-08-06 00:52:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 213434368. Throughput: 0: 4399.8. Samples: 53357390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:52:47,794][52567] Avg episode reward: [(0, '56.309')] [2024-08-06 00:52:48,245][52665] DAMAGECOUNT value on done: 144268.0 [2024-08-06 00:52:48,246][52665] Sum rewards: 64.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.832', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.133', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '52.500'} [2024-08-06 00:52:48,319][52820] DAMAGECOUNT value on done: 133511.0 [2024-08-06 00:52:48,321][52820] Sum rewards: 73.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.912', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon5': '0.074', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '61.000'} [2024-08-06 00:52:49,320][52659] DAMAGECOUNT value on done: 147495.0 [2024-08-06 00:52:49,323][52659] Sum rewards: 53.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.208', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.103', 'AMMO3': '0.151', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON3': '0.900', 'HITCOUNT': '2.810', 'weapon3': '3.452', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '42.000'} [2024-08-06 00:52:50,699][52665] DAMAGECOUNT value on done: 144600.0 [2024-08-06 00:52:50,700][52665] Sum rewards: 68.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.140', 'weapon4': '0.178', 'AMMO3': '0.206', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '57.000'} [2024-08-06 00:52:51,014][52650] Updated weights for policy 0, policy_version 26061 (0.0011) [2024-08-06 00:52:51,325][52820] DAMAGECOUNT value on done: 129988.0 [2024-08-06 00:52:51,327][52820] Sum rewards: 52.444, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.983', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.160', 'WEAPON4': '0.500', 'weapon4': '0.674', 'weapon2': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.452', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '43.000'} [2024-08-06 00:52:52,077][52659] DAMAGECOUNT value on done: 146395.0 [2024-08-06 00:52:52,077][52659] Sum rewards: 56.436, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.167', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.030', 'AMMO4': '0.128', 'weapon4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.482', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.110', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 213524480. Throughput: 0: 4399.8. Samples: 53383780. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:52:52,794][52567] Avg episode reward: [(0, '56.482')] [2024-08-06 00:52:53,566][52665] DAMAGECOUNT value on done: 139594.0 [2024-08-06 00:52:53,568][52665] Sum rewards: 66.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.654', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.063', 'weapon5': '0.118', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.312', 'AMMO4': '0.313', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon4': '1.108', 'weapon3': '2.274', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '56.000'} [2024-08-06 00:52:54,287][52820] DAMAGECOUNT value on done: 136872.0 [2024-08-06 00:52:54,287][52820] Sum rewards: 59.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.176', 'weapon4': '0.342', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '51.000'} [2024-08-06 00:52:55,169][52659] DAMAGECOUNT value on done: 150781.0 [2024-08-06 00:52:55,170][52659] Sum rewards: 50.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.096', 'AMMO4': '0.173', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '44.000'} [2024-08-06 00:52:55,515][52650] Updated weights for policy 0, policy_version 26071 (0.0015) [2024-08-06 00:52:55,637][52803] DAMAGECOUNT value on done: 137308.0 [2024-08-06 00:52:55,638][52803] Sum rewards: 45.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'weapon4': '0.252', 'AMMO3': '0.259', 'weapon2': '0.310', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '3.002', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '42.000'} [2024-08-06 00:52:56,514][52665] DAMAGECOUNT value on done: 143590.0 [2024-08-06 00:52:56,519][52665] Sum rewards: 68.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.246', 'WEAPON3': '1.350', 'weapon3': '3.460', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '57.000'} [2024-08-06 00:52:57,399][52820] DAMAGECOUNT value on done: 135300.0 [2024-08-06 00:52:57,401][52820] Sum rewards: 61.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '53.000'} [2024-08-06 00:52:57,790][52647] DAMAGECOUNT value on done: 155889.0 [2024-08-06 00:52:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 213606400. Throughput: 0: 4399.1. Samples: 53410330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:52:57,796][52567] Avg episode reward: [(0, '56.515')] [2024-08-06 00:52:57,792][52647] Sum rewards: 48.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.200', 'weapon4': '0.244', 'AMMO3': '0.254', 'weapon2': '0.440', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.090', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '45.000'} [2024-08-06 00:52:57,829][52659] DAMAGECOUNT value on done: 149224.0 [2024-08-06 00:52:57,829][52659] Sum rewards: 57.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.660', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.400', 'weapon2': '0.702', 'WEAPON3': '1.250', 'weapon3': '2.414', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '50.000'} [2024-08-06 00:52:58,567][52803] DAMAGECOUNT value on done: 142734.0 [2024-08-06 00:52:58,569][52803] Sum rewards: 54.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.755', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon4': '0.294', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '47.000'} [2024-08-06 00:52:58,783][52668] DAMAGECOUNT value on done: 145528.0 [2024-08-06 00:52:58,784][52668] Sum rewards: 49.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.947', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.162', 'AMMO3': '0.217', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.058', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '44.500'} [2024-08-06 00:52:59,136][52811] DAMAGECOUNT value on done: 146304.0 [2024-08-06 00:52:59,138][52811] Sum rewards: 57.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.298', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon4': '0.440', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '49.000'} [2024-08-06 00:52:59,252][52665] DAMAGECOUNT value on done: 143498.0 [2024-08-06 00:52:59,253][52665] Sum rewards: 45.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.819', 'AMMO5': '0.003', 'ARMOR': '0.036', 'AMMO2': '0.060', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'AMMO4': '0.301', 'weapon2': '0.378', 'weapon4': '0.634', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.231', 'FRAGCOUNT': '42.000'} [2024-08-06 00:53:00,344][52659] DAMAGECOUNT value on done: 145884.0 [2024-08-06 00:53:00,346][52659] Sum rewards: 54.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.006', 'AMMO2': '0.055', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.277', 'weapon4': '0.584', 'WEAPON4': '0.600', 'weapon2': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.420', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:00,427][52650] Updated weights for policy 0, policy_version 26081 (0.0012) [2024-08-06 00:53:00,542][52820] DAMAGECOUNT value on done: 136195.0 [2024-08-06 00:53:00,542][52820] Sum rewards: 60.920, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.368', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '2.912', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:00,653][52647] DAMAGECOUNT value on done: 154748.0 [2024-08-06 00:53:00,653][52647] Sum rewards: 56.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.068', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.160', 'AMMO3': '0.223', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.860', 'WEAPON3': '1.300', 'weapon3': '2.444', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:01,669][52803] DAMAGECOUNT value on done: 138251.0 [2024-08-06 00:53:01,672][52803] Sum rewards: 67.719, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.427', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.177', 'weapon5': '0.246', 'WEAPON4': '0.250', 'AMMO4': '0.274', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:01,774][52668] DAMAGECOUNT value on done: 154778.0 [2024-08-06 00:53:01,775][52668] Sum rewards: 65.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.139', 'AMMO5': '0.007', 'weapon7': '0.014', 'AMMO2': '0.026', 'weapon5': '0.066', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:02,284][52811] DAMAGECOUNT value on done: 135220.0 [2024-08-06 00:53:02,285][52811] Sum rewards: 55.775, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.762', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.128', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.320', 'weapon4': '0.338', 'WEAPON3': '1.900', 'weapon3': '2.966', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '53.500'} [2024-08-06 00:53:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 213696512. Throughput: 0: 4392.0. Samples: 53423290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 00:53:02,794][52567] Avg episode reward: [(0, '56.860')] [2024-08-06 00:53:02,916][52647] DAMAGECOUNT value on done: 157904.0 [2024-08-06 00:53:02,917][52647] Sum rewards: 50.841, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.096', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.178', 'weapon4': '0.206', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.600', 'weapon3': '2.954', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:02,986][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:53:03,326][52659] DAMAGECOUNT value on done: 150787.0 [2024-08-06 00:53:03,326][52659] Sum rewards: 55.617, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.176', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.436', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.208', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:03,363][52664] DAMAGECOUNT value on done: 153351.0 [2024-08-06 00:53:03,365][52664] Sum rewards: 67.404, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.058', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.156', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '59.000'} [2024-08-06 00:53:03,370][52662] DAMAGECOUNT value on done: 151719.0 [2024-08-06 00:53:03,370][52662] Sum rewards: 66.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.525', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.376', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '57.000'} [2024-08-06 00:53:03,749][52820] DAMAGECOUNT value on done: 137151.0 [2024-08-06 00:53:03,753][52820] Sum rewards: 65.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.502', 'AMMO5': '0.010', 'AMMO2': '0.031', 'ARMOR': '0.032', 'AMMO4': '0.154', 'weapon5': '0.194', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.428', 'weapon4': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.592', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:04,691][52668] DAMAGECOUNT value on done: 148744.0 [2024-08-06 00:53:04,693][52668] Sum rewards: 61.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.614', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:04,817][52803] DAMAGECOUNT value on done: 137232.0 [2024-08-06 00:53:04,821][52803] Sum rewards: 60.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.680', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon2': '0.336', 'weapon4': '0.416', 'WEAPON3': '1.100', 'weapon3': '2.738', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:04,991][52650] Updated weights for policy 0, policy_version 26091 (0.0027) [2024-08-06 00:53:05,318][52647] DAMAGECOUNT value on done: 157030.0 [2024-08-06 00:53:05,318][52647] Sum rewards: 48.532, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.172', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.116', 'AMMO4': '0.263', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.390', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.822', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:05,477][52811] DAMAGECOUNT value on done: 138119.0 [2024-08-06 00:53:05,477][52811] Sum rewards: 56.720, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.051', 'weapon5': '0.130', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon2': '0.314', 'WEAPON4': '0.650', 'weapon4': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.582', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:05,758][52664] DAMAGECOUNT value on done: 152802.0 [2024-08-06 00:53:05,759][52664] Sum rewards: 53.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.573', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon5': '0.196', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:06,193][52659] DAMAGECOUNT value on done: 150379.0 [2024-08-06 00:53:06,193][52659] Sum rewards: 67.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.076', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.796', 'WEAPON3': '0.900', 'weapon3': '2.702', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:06,446][52662] DAMAGECOUNT value on done: 155218.0 [2024-08-06 00:53:06,448][52662] Sum rewards: 64.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'weapon4': '0.166', 'AMMO3': '0.193', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.414', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:07,002][52820] DAMAGECOUNT value on done: 134367.0 [2024-08-06 00:53:07,011][52820] Sum rewards: 60.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.180', 'weapon2': '0.332', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:07,606][52647] DAMAGECOUNT value on done: 157530.0 [2024-08-06 00:53:07,607][52647] Sum rewards: 46.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.122', 'AMMO3': '0.197', 'AMMO4': '0.200', 'weapon2': '0.230', 'WEAPON4': '0.350', 'weapon4': '0.742', 'WEAPON3': '1.250', 'weapon3': '2.564', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '42.000'} [2024-08-06 00:53:07,671][52668] DAMAGECOUNT value on done: 147625.0 [2024-08-06 00:53:07,672][52668] Sum rewards: 66.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.062', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.058', 'weapon4': '0.064', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '58.000'} [2024-08-06 00:53:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 213778432. Throughput: 0: 4386.9. Samples: 53449550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:53:07,795][52567] Avg episode reward: [(0, '57.033')] [2024-08-06 00:53:07,882][52803] DAMAGECOUNT value on done: 143168.0 [2024-08-06 00:53:07,882][52803] Sum rewards: 57.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.418', 'AMMO5': '0.007', 'ARMOR': '0.036', 'AMMO2': '0.057', 'weapon5': '0.170', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'AMMO4': '0.285', 'weapon2': '0.556', 'weapon4': '0.588', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.390', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:08,227][52664] DAMAGECOUNT value on done: 154186.0 [2024-08-06 00:53:08,227][52664] Sum rewards: 60.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.505', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.188', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon4': '0.302', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:08,622][52811] DAMAGECOUNT value on done: 137773.0 [2024-08-06 00:53:08,624][52811] Sum rewards: 61.524, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.116', 'weapon5': '0.242', 'AMMO4': '0.246', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON4': '0.600', 'weapon2': '0.698', 'WEAPON3': '0.750', 'weapon3': '2.356', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:09,144][52662] DAMAGECOUNT value on done: 155270.0 [2024-08-06 00:53:09,145][52662] Sum rewards: 52.405, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.076', 'AMMO5': '0.004', 'weapon4': '0.008', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.720', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.072', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:09,649][52650] Updated weights for policy 0, policy_version 26101 (0.0011) [2024-08-06 00:53:10,286][52820] DAMAGECOUNT value on done: 139440.0 [2024-08-06 00:53:10,286][52820] Sum rewards: 62.277, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.797', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'weapon2': '0.190', 'weapon4': '0.234', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'HITCOUNT': '3.260', 'weapon3': '3.322', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:10,380][52647] DAMAGECOUNT value on done: 157641.0 [2024-08-06 00:53:10,381][52647] Sum rewards: 44.058, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.825', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.218', 'AMMO4': '0.227', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon4': '0.516', 'WEAPON4': '0.550', 'weapon2': '0.652', 'WEAPON3': '1.350', 'weapon3': '2.296', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '41.500'} [2024-08-06 00:53:10,701][52668] DAMAGECOUNT value on done: 146607.0 [2024-08-06 00:53:10,701][52668] Sum rewards: 48.046, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.717', 'AMMO5': '0.005', 'AMMO2': '0.056', 'AMMO3': '0.137', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.281', 'WEAPON4': '0.450', 'weapon4': '0.526', 'weapon2': '0.544', 'WEAPON3': '0.850', 'weapon3': '2.644', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '39.500'} [2024-08-06 00:53:10,942][52803] DAMAGECOUNT value on done: 137746.0 [2024-08-06 00:53:10,944][52803] Sum rewards: 54.210, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.049', 'weapon5': '0.102', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.338', 'weapon4': '0.386', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:10,942][52664] DAMAGECOUNT value on done: 151706.0 [2024-08-06 00:53:10,948][52664] Sum rewards: 43.288, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.626', 'WEAPON3': '1.500', 'weapon3': '2.496', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '41.000'} [2024-08-06 00:53:11,520][52811] DAMAGECOUNT value on done: 138039.0 [2024-08-06 00:53:11,521][52811] Sum rewards: 54.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'weapon2': '0.424', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.314', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:12,391][52662] DAMAGECOUNT value on done: 145802.0 [2024-08-06 00:53:12,393][52662] Sum rewards: 46.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.264', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.478', 'weapon4': '0.514', 'WEAPON3': '1.700', 'weapon3': '2.506', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '43.000'} [2024-08-06 00:53:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 213868544. Throughput: 0: 4393.3. Samples: 53476290. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:53:12,794][52567] Avg episode reward: [(0, '56.532')] [2024-08-06 00:53:13,025][52647] DAMAGECOUNT value on done: 153364.0 [2024-08-06 00:53:13,026][52647] Sum rewards: 43.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.991', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.126', 'weapon4': '0.220', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.050', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '39.000'} [2024-08-06 00:53:13,436][52664] DAMAGECOUNT value on done: 151844.0 [2024-08-06 00:53:13,436][52664] Sum rewards: 50.898, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.598', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.048', 'weapon4': '0.070', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.510', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.176', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:13,452][52820] DAMAGECOUNT value on done: 138865.0 [2024-08-06 00:53:13,452][52820] Sum rewards: 61.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.814', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.028', 'AMMO4': '0.124', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:13,616][52660] DAMAGECOUNT value on done: 144749.0 [2024-08-06 00:53:13,616][52660] Sum rewards: 51.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.294', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.138', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON4': '0.500', 'weapon4': '0.814', 'WEAPON3': '0.950', 'weapon3': '2.262', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '43.000'} [2024-08-06 00:53:13,665][52668] DAMAGECOUNT value on done: 144690.0 [2024-08-06 00:53:13,669][52668] Sum rewards: 62.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.222', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'weapon3': '3.440', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:14,111][52650] Updated weights for policy 0, policy_version 26111 (0.0012) [2024-08-06 00:53:14,183][52803] DAMAGECOUNT value on done: 142059.0 [2024-08-06 00:53:14,183][52803] Sum rewards: 57.236, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.829', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:14,570][52811] DAMAGECOUNT value on done: 142425.0 [2024-08-06 00:53:14,572][52811] Sum rewards: 44.351, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.870', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'ARMOR': '0.525', 'weapon4': '0.576', 'weapon2': '0.616', 'WEAPON3': '1.700', 'weapon3': '2.576', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '42.000'} [2024-08-06 00:53:15,364][52662] DAMAGECOUNT value on done: 152720.0 [2024-08-06 00:53:15,365][52662] Sum rewards: 51.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.032', 'ARMOR': '0.040', 'weapon5': '0.118', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.474', 'WEAPON4': '0.550', 'weapon4': '0.682', 'WEAPON3': '1.300', 'weapon3': '2.482', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:15,633][52647] DAMAGECOUNT value on done: 156740.0 [2024-08-06 00:53:15,633][52647] Sum rewards: 55.412, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.524', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.294', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.048', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '48.500'} [2024-08-06 00:53:16,111][52664] DAMAGECOUNT value on done: 155884.0 [2024-08-06 00:53:16,111][52664] Sum rewards: 52.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.298', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO3': '0.117', 'weapon5': '0.130', 'AMMO4': '0.154', 'WEAPON5': '0.300', 'weapon4': '0.334', 'ARMOR': '0.461', 'WEAPON4': '0.500', 'weapon2': '0.824', 'WEAPON3': '0.850', 'weapon3': '2.506', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '43.000'} [2024-08-06 00:53:16,569][52820] DAMAGECOUNT value on done: 138538.0 [2024-08-06 00:53:16,571][52820] Sum rewards: 53.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.059', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.060', 'AMMO3': '0.129', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.450', 'weapon2': '0.522', 'WEAPON3': '0.850', 'HITCOUNT': '2.790', 'weapon3': '2.930', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:16,803][52660] DAMAGECOUNT value on done: 148284.0 [2024-08-06 00:53:16,803][52660] Sum rewards: 56.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.166', 'AMMO4': '0.189', 'weapon5': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON4': '0.550', 'weapon4': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.318', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:16,853][52668] DAMAGECOUNT value on done: 148766.0 [2024-08-06 00:53:16,853][52668] Sum rewards: 60.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.250', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon4': '0.322', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '52.000'} [2024-08-06 00:53:17,310][52803] DAMAGECOUNT value on done: 135597.0 [2024-08-06 00:53:17,313][52803] Sum rewards: 51.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.189', 'weapon2': '0.822', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '42.000'} [2024-08-06 00:53:17,718][52811] DAMAGECOUNT value on done: 138523.0 [2024-08-06 00:53:17,728][52811] Sum rewards: 60.189, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'HEALTH': '0.280', 'weapon2': '0.740', 'WEAPON3': '0.900', 'weapon3': '3.012', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 213958656. Throughput: 0: 4394.4. Samples: 53489200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:53:17,794][52567] Avg episode reward: [(0, '56.242')] [2024-08-06 00:53:18,050][52647] DAMAGECOUNT value on done: 158790.0 [2024-08-06 00:53:18,052][52647] Sum rewards: 65.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.272', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'weapon4': '0.228', 'AMMO3': '0.237', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:18,295][52662] DAMAGECOUNT value on done: 150777.0 [2024-08-06 00:53:18,296][52662] Sum rewards: 50.430, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.106', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'weapon4': '0.176', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.232', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:18,446][52664] DAMAGECOUNT value on done: 156512.0 [2024-08-06 00:53:18,446][52664] Sum rewards: 63.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'AMMO5': '0.007', 'weapon5': '0.050', 'AMMO2': '0.058', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.291', 'weapon2': '0.384', 'WEAPON4': '0.500', 'weapon4': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:19,138][52650] Updated weights for policy 0, policy_version 26121 (0.0020) [2024-08-06 00:53:19,781][52820] DAMAGECOUNT value on done: 137062.0 [2024-08-06 00:53:19,784][52820] Sum rewards: 52.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.024', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.291', 'weapon4': '0.442', 'WEAPON4': '0.600', 'weapon2': '0.802', 'WEAPON3': '1.200', 'weapon3': '2.524', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:19,792][52660] DAMAGECOUNT value on done: 148487.0 [2024-08-06 00:53:19,795][52660] Sum rewards: 58.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'weapon5': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO4': '0.185', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.744', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:19,822][52668] DAMAGECOUNT value on done: 152692.0 [2024-08-06 00:53:19,823][52668] Sum rewards: 65.949, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.236', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:20,408][52647] DAMAGECOUNT value on done: 154119.0 [2024-08-06 00:53:20,409][52647] Sum rewards: 48.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.528', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.432', 'weapon4': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '42.000'} [2024-08-06 00:53:20,583][52803] DAMAGECOUNT value on done: 138597.0 [2024-08-06 00:53:20,584][52803] Sum rewards: 57.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.544', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.158', 'AMMO4': '0.189', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.294', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:20,781][52811] DAMAGECOUNT value on done: 137907.0 [2024-08-06 00:53:20,782][52811] Sum rewards: 62.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.402', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon5': '0.110', 'weapon4': '0.148', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.196', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:20,868][52664] DAMAGECOUNT value on done: 147016.0 [2024-08-06 00:53:20,868][52664] Sum rewards: 53.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.754', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.168', 'weapon4': '0.244', 'weapon5': '0.248', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '2.766', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:20,933][52662] DAMAGECOUNT value on done: 151913.0 [2024-08-06 00:53:20,933][52662] Sum rewards: 48.755, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.280', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.102', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.750', 'HITCOUNT': '3.040', 'weapon3': '3.108', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '44.500'} [2024-08-06 00:53:21,190][52794] DAMAGECOUNT value on done: 154391.0 [2024-08-06 00:53:21,191][52794] Sum rewards: 48.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.198', 'AMMO4': '0.210', 'weapon4': '0.218', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '2.900', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:22,734][52647] DAMAGECOUNT value on done: 153180.0 [2024-08-06 00:53:22,742][52647] Sum rewards: 61.276, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.465', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.112', 'AMMO3': '0.205', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.486', 'weapon2': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.628', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 214040576. Throughput: 0: 4389.8. Samples: 53515310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:53:22,794][52567] Avg episode reward: [(0, '56.480')] [2024-08-06 00:53:22,810][52820] DAMAGECOUNT value on done: 137382.0 [2024-08-06 00:53:22,810][52820] Sum rewards: 52.952, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.189', 'weapon2': '0.356', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.480', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:23,039][52664] DAMAGECOUNT value on done: 162375.0 [2024-08-06 00:53:23,039][52664] Sum rewards: 50.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'ARMOR': '0.020', 'AMMO2': '0.023', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.000', 'weapon4': '1.132', 'weapon3': '2.226', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:23,128][52660] DAMAGECOUNT value on done: 148443.0 [2024-08-06 00:53:23,130][52660] Sum rewards: 59.986, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon4': '0.346', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:23,159][52668] DAMAGECOUNT value on done: 149406.0 [2024-08-06 00:53:23,160][52668] Sum rewards: 61.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.176', 'weapon2': '1.020', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:23,657][52650] Updated weights for policy 0, policy_version 26131 (0.0035) [2024-08-06 00:53:23,856][52662] DAMAGECOUNT value on done: 157881.0 [2024-08-06 00:53:23,858][52662] Sum rewards: 70.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 00:53:23,906][52803] DAMAGECOUNT value on done: 136239.0 [2024-08-06 00:53:23,907][52803] Sum rewards: 60.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.165', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.254', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '52.000'} [2024-08-06 00:53:23,984][52811] DAMAGECOUNT value on done: 143582.0 [2024-08-06 00:53:23,986][52811] Sum rewards: 51.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.511', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.066', 'weapon5': '0.162', 'AMMO3': '0.165', 'WEAPON5': '0.300', 'AMMO4': '0.331', 'weapon2': '0.486', 'WEAPON4': '0.650', 'weapon4': '0.754', 'WEAPON3': '1.000', 'weapon3': '2.328', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '43.000'} [2024-08-06 00:53:24,115][52794] DAMAGECOUNT value on done: 153872.0 [2024-08-06 00:53:24,118][52794] Sum rewards: 49.504, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.544', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.144', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.856', 'WEAPON3': '1.350', 'weapon3': '2.714', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:25,255][52647] DAMAGECOUNT value on done: 151421.0 [2024-08-06 00:53:25,255][52647] Sum rewards: 55.573, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.374', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.147', 'AMMO4': '0.183', 'weapon4': '0.368', 'WEAPON4': '0.450', 'weapon2': '0.646', 'WEAPON3': '0.950', 'weapon3': '2.794', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:25,726][52664] DAMAGECOUNT value on done: 157168.0 [2024-08-06 00:53:25,727][52664] Sum rewards: 45.942, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.143', 'WEAPON4': '0.300', 'weapon4': '0.492', 'WEAPON3': '0.800', 'weapon2': '1.166', 'weapon3': '2.170', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '10.779', 'FRAGCOUNT': '37.000'} [2024-08-06 00:53:25,849][52820] DAMAGECOUNT value on done: 139078.0 [2024-08-06 00:53:25,851][52820] Sum rewards: 48.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.794', 'AMMO5': '0.007', 'AMMO2': '0.042', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon5': '0.288', 'weapon4': '0.420', 'WEAPON4': '0.450', 'weapon2': '0.926', 'WEAPON3': '1.200', 'weapon3': '2.134', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '42.000'} [2024-08-06 00:53:26,014][52660] DAMAGECOUNT value on done: 146306.0 [2024-08-06 00:53:26,015][52660] Sum rewards: 62.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.515', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.134', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.360', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.820', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:26,027][52668] DAMAGECOUNT value on done: 150742.0 [2024-08-06 00:53:26,027][52668] Sum rewards: 61.537, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.095', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.302', 'WEAPON3': '0.800', 'HITCOUNT': '2.910', 'weapon3': '3.286', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:26,571][52662] DAMAGECOUNT value on done: 151836.0 [2024-08-06 00:53:26,571][52662] Sum rewards: 51.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.098', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon2': '0.534', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '1.132', 'weapon3': '1.864', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '43.000'} [2024-08-06 00:53:26,896][52794] DAMAGECOUNT value on done: 148498.0 [2024-08-06 00:53:26,896][52794] Sum rewards: 50.078, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.484', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.126', 'weapon4': '0.132', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.700', 'HITCOUNT': '3.000', 'weapon3': '3.028', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '46.500'} [2024-08-06 00:53:27,060][52811] DAMAGECOUNT value on done: 138057.0 [2024-08-06 00:53:27,062][52811] Sum rewards: 53.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.528', 'AMMO5': '0.005', 'weapon5': '0.054', 'AMMO2': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.252', 'AMMO4': '0.279', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.174', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:27,130][52803] DAMAGECOUNT value on done: 141907.0 [2024-08-06 00:53:27,130][52803] Sum rewards: 51.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'AMMO4': '0.173', 'WEAPON7': '0.200', 'weapon2': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.682', 'WEAPON3': '0.950', 'weapon3': '2.672', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '43.000'} [2024-08-06 00:53:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 214130688. Throughput: 0: 4388.9. Samples: 53541580. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-06 00:53:27,794][52567] Avg episode reward: [(0, '56.372')] [2024-08-06 00:53:28,232][52647] DAMAGECOUNT value on done: 155220.0 [2024-08-06 00:53:28,235][52647] Sum rewards: 56.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.038', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO4': '0.179', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:28,583][52660] DAMAGECOUNT value on done: 145787.0 [2024-08-06 00:53:28,587][52660] Sum rewards: 64.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.250', 'weapon3': '3.412', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '57.000'} [2024-08-06 00:53:28,592][52667] DAMAGECOUNT value on done: 149410.0 [2024-08-06 00:53:28,597][52667] Sum rewards: 46.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.360', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.386', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.754', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '41.000'} [2024-08-06 00:53:28,608][52668] DAMAGECOUNT value on done: 148994.0 [2024-08-06 00:53:28,611][52668] Sum rewards: 65.760, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.741', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon5': '0.176', 'AMMO4': '0.177', 'WEAPON4': '0.350', 'weapon4': '0.608', 'weapon2': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.286', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '52.000'} [2024-08-06 00:53:28,804][52664] DAMAGECOUNT value on done: 156551.0 [2024-08-06 00:53:28,806][52664] Sum rewards: 49.348, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.910', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.158', 'AMMO3': '0.237', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'weapon4': '0.432', 'weapon2': '0.510', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.590', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '45.500'} [2024-08-06 00:53:28,850][52650] Updated weights for policy 0, policy_version 26141 (0.0025) [2024-08-06 00:53:28,943][52820] DAMAGECOUNT value on done: 136355.0 [2024-08-06 00:53:28,945][52820] Sum rewards: 45.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.182', 'weapon5': '0.196', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '39.000'} [2024-08-06 00:53:29,725][52662] DAMAGECOUNT value on done: 155820.0 [2024-08-06 00:53:29,726][52662] Sum rewards: 66.509, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.286', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.265', 'weapon4': '0.358', 'weapon2': '0.442', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '60.000'} [2024-08-06 00:53:30,083][52794] DAMAGECOUNT value on done: 148503.0 [2024-08-06 00:53:30,083][52794] Sum rewards: 63.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.305', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.266', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:30,110][52811] DAMAGECOUNT value on done: 137647.0 [2024-08-06 00:53:30,111][52811] Sum rewards: 43.854, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.258', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.209', 'AMMO3': '0.211', 'weapon2': '0.580', 'WEAPON4': '0.650', 'weapon4': '0.820', 'WEAPON3': '1.300', 'weapon3': '2.282', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '42.000'} [2024-08-06 00:53:30,165][52803] DAMAGECOUNT value on done: 142927.0 [2024-08-06 00:53:30,167][52803] Sum rewards: 58.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.451', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.132', 'AMMO3': '0.153', 'AMMO4': '0.227', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.720', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:31,226][52647] DAMAGECOUNT value on done: 151876.0 [2024-08-06 00:53:31,226][52647] Sum rewards: 65.362, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.565', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.146', 'AMMO4': '0.155', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '57.000'} [2024-08-06 00:53:31,582][52660] DAMAGECOUNT value on done: 149069.0 [2024-08-06 00:53:31,582][52660] Sum rewards: 56.400, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.164', 'AMMO3': '0.207', 'weapon2': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:31,592][52668] DAMAGECOUNT value on done: 145820.0 [2024-08-06 00:53:31,592][52668] Sum rewards: 47.638, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'weapon5': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.026', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '43.000'} [2024-08-06 00:53:31,599][52667] DAMAGECOUNT value on done: 149410.0 [2024-08-06 00:53:31,599][52667] Sum rewards: 46.064, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.846', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.191', 'weapon5': '0.246', 'weapon4': '0.266', 'AMMO4': '0.268', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.470', 'weapon3': '2.748', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '41.000'} [2024-08-06 00:53:31,958][52664] DAMAGECOUNT value on done: 152456.0 [2024-08-06 00:53:31,958][52664] Sum rewards: 45.860, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.785', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon7': '0.074', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO3': '0.165', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.538', 'weapon4': '0.548', 'WEAPON3': '1.050', 'HITCOUNT': '2.350', 'weapon3': '2.500', 'DAMAGECOUNT': '11.667', 'FRAGCOUNT': '38.000'} [2024-08-06 00:53:32,018][52820] DAMAGECOUNT value on done: 138521.0 [2024-08-06 00:53:32,018][52820] Sum rewards: 56.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.024', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:32,353][52662] DAMAGECOUNT value on done: 149351.0 [2024-08-06 00:53:32,354][52662] Sum rewards: 57.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.490', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.004', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:32,643][52794] DAMAGECOUNT value on done: 151486.0 [2024-08-06 00:53:32,645][52794] Sum rewards: 52.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.665', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.207', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:32,755][52650] Updated weights for policy 0, policy_version 26151 (0.0013) [2024-08-06 00:53:32,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 214228992. Throughput: 0: 4386.7. Samples: 53554790. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-06 00:53:32,795][52567] Avg episode reward: [(0, '55.804')] [2024-08-06 00:53:32,959][52664] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:53:33,118][52803] DAMAGECOUNT value on done: 138710.0 [2024-08-06 00:53:33,120][52803] Sum rewards: 64.774, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'HEALTH': '0.287', 'weapon2': '0.538', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '3.240', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:33,127][52811] DAMAGECOUNT value on done: 140140.0 [2024-08-06 00:53:33,129][52811] Sum rewards: 53.488, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon5': '0.092', 'AMMO3': '0.266', 'weapon2': '0.452', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.258', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:34,200][52668] DAMAGECOUNT value on done: 141675.0 [2024-08-06 00:53:34,201][52668] Sum rewards: 64.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.668', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.205', 'weapon2': '0.288', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:34,212][52660] DAMAGECOUNT value on done: 148396.0 [2024-08-06 00:53:34,212][52660] Sum rewards: 58.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.992', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon4': '0.158', 'AMMO4': '0.163', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:34,431][52667] DAMAGECOUNT value on done: 149970.0 [2024-08-06 00:53:34,431][52667] Sum rewards: 58.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.960', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.146', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:34,434][52647] DAMAGECOUNT value on done: 154086.0 [2024-08-06 00:53:34,435][52647] Sum rewards: 57.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '1.012', 'WEAPON3': '1.100', 'weapon3': '2.350', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:35,158][52664] DAMAGECOUNT value on done: 151347.0 [2024-08-06 00:53:35,158][52664] Sum rewards: 56.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'weapon2': '0.488', 'weapon4': '0.626', 'WEAPON3': '0.850', 'weapon3': '2.558', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:35,320][52662] DAMAGECOUNT value on done: 154261.0 [2024-08-06 00:53:35,322][52662] Sum rewards: 62.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.901', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.236', 'weapon2': '0.780', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:35,330][52820] DAMAGECOUNT value on done: 140258.0 [2024-08-06 00:53:35,330][52820] Sum rewards: 62.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.187', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.468', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:35,677][52794] DAMAGECOUNT value on done: 151571.0 [2024-08-06 00:53:35,678][52794] Sum rewards: 45.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.136', 'AMMO4': '0.193', 'weapon5': '0.296', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '0.922', 'weapon3': '2.106', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '39.000'} [2024-08-06 00:53:36,208][52803] DAMAGECOUNT value on done: 141818.0 [2024-08-06 00:53:36,208][52803] Sum rewards: 59.904, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.634', 'AMMO5': '0.010', 'AMMO2': '0.060', 'AMMO3': '0.174', 'weapon5': '0.232', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON4': '0.650', 'weapon4': '0.744', 'WEAPON3': '1.100', 'weapon3': '2.316', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:36,233][52811] DAMAGECOUNT value on done: 138346.0 [2024-08-06 00:53:36,233][52811] Sum rewards: 66.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.216', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:36,872][52667] DAMAGECOUNT value on done: 146495.0 [2024-08-06 00:53:36,874][52667] Sum rewards: 58.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.015', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.342', 'weapon2': '0.632', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:37,245][52668] DAMAGECOUNT value on done: 147057.0 [2024-08-06 00:53:37,246][52668] Sum rewards: 58.852, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.846', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.160', 'AMMO3': '0.192', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.118', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:37,266][52647] DAMAGECOUNT value on done: 156513.0 [2024-08-06 00:53:37,267][52647] Sum rewards: 44.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.992', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '40.000'} [2024-08-06 00:53:37,269][52660] DAMAGECOUNT value on done: 148261.0 [2024-08-06 00:53:37,270][52660] Sum rewards: 54.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.038', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.186', 'AMMO4': '0.188', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.536', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 214302720. Throughput: 0: 4387.1. Samples: 53581200. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-06 00:53:37,795][52567] Avg episode reward: [(0, '55.764')] [2024-08-06 00:53:37,830][52650] Updated weights for policy 0, policy_version 26161 (0.0025) [2024-08-06 00:53:37,991][52662] DAMAGECOUNT value on done: 149275.0 [2024-08-06 00:53:38,002][52662] Sum rewards: 52.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.182', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon2': '0.392', 'WEAPON4': '0.550', 'weapon4': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.486', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:38,086][52664] DAMAGECOUNT value on done: 152022.0 [2024-08-06 00:53:38,086][52664] Sum rewards: 46.007, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.145', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon2': '0.986', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.814', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '39.000'} [2024-08-06 00:53:38,359][52669] DAMAGECOUNT value on done: 152042.0 [2024-08-06 00:53:38,359][52669] Sum rewards: 47.863, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.440', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.300', 'AMMO3': '0.309', 'weapon2': '0.514', 'WEAPON3': '1.800', 'HITCOUNT': '2.780', 'weapon3': '2.950', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:38,386][52794] DAMAGECOUNT value on done: 157171.0 [2024-08-06 00:53:38,386][52794] Sum rewards: 59.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.874', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:38,679][52820] DAMAGECOUNT value on done: 142680.0 [2024-08-06 00:53:38,680][52820] Sum rewards: 65.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.292', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.087', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:39,272][52811] DAMAGECOUNT value on done: 140886.0 [2024-08-06 00:53:39,272][52811] Sum rewards: 67.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.753', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:39,274][52803] DAMAGECOUNT value on done: 137092.0 [2024-08-06 00:53:39,274][52803] Sum rewards: 50.951, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.396', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.069', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.199', 'AMMO4': '0.344', 'weapon2': '0.494', 'WEAPON4': '0.500', 'weapon4': '0.802', 'WEAPON3': '1.250', 'weapon3': '2.246', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:39,591][52667] DAMAGECOUNT value on done: 150711.0 [2024-08-06 00:53:39,592][52667] Sum rewards: 72.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.072', 'weapon4': '0.114', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 00:53:40,163][52647] DAMAGECOUNT value on done: 152480.0 [2024-08-06 00:53:40,167][52647] Sum rewards: 67.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO4': '0.175', 'AMMO3': '0.197', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '57.000'} [2024-08-06 00:53:40,201][52668] DAMAGECOUNT value on done: 145730.0 [2024-08-06 00:53:40,205][52668] Sum rewards: 67.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.433', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.492', 'weapon4': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.750', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:40,225][52660] DAMAGECOUNT value on done: 149016.0 [2024-08-06 00:53:40,225][52660] Sum rewards: 61.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.172', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON4': '0.550', 'weapon4': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '52.000'} [2024-08-06 00:53:40,458][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:53:40,870][52662] DAMAGECOUNT value on done: 152056.0 [2024-08-06 00:53:40,873][52662] Sum rewards: 58.346, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.615', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.211', 'WEAPON4': '0.450', 'weapon2': '0.484', 'weapon4': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:40,997][52664] DAMAGECOUNT value on done: 156526.0 [2024-08-06 00:53:40,997][52664] Sum rewards: 57.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.526', 'AMMO5': '0.007', 'AMMO2': '0.027', 'ARMOR': '0.028', 'weapon5': '0.060', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.302', 'WEAPON4': '0.450', 'weapon4': '0.596', 'WEAPON3': '1.400', 'weapon3': '2.494', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:41,033][52669] DAMAGECOUNT value on done: 148834.0 [2024-08-06 00:53:41,033][52669] Sum rewards: 63.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.182', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.195', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.484', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:41,187][52794] DAMAGECOUNT value on done: 150979.0 [2024-08-06 00:53:41,189][52794] Sum rewards: 67.789, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.765', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.070', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '58.000'} [2024-08-06 00:53:41,837][52820] DAMAGECOUNT value on done: 135747.0 [2024-08-06 00:53:41,838][52820] Sum rewards: 59.202, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.318', 'weapon4': '0.492', 'HEALTH': '0.520', 'WEAPON3': '1.000', 'weapon3': '2.886', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '47.500'} [2024-08-06 00:53:42,324][52811] DAMAGECOUNT value on done: 139265.0 [2024-08-06 00:53:42,324][52811] Sum rewards: 45.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.677', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon2': '0.474', 'weapon4': '0.476', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.866', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '40.000'} [2024-08-06 00:53:42,369][52803] DAMAGECOUNT value on done: 135524.0 [2024-08-06 00:53:42,370][52803] Sum rewards: 60.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.076', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.206', 'weapon2': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:42,534][52650] Updated weights for policy 0, policy_version 26171 (0.0020) [2024-08-06 00:53:42,626][52647] DAMAGECOUNT value on done: 154790.0 [2024-08-06 00:53:42,628][52647] Sum rewards: 56.765, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.102', 'ARMOR': '0.008', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.202', 'weapon4': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:42,770][52667] DAMAGECOUNT value on done: 149413.0 [2024-08-06 00:53:42,771][52667] Sum rewards: 62.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.705', 'AMMO5': '0.006', 'AMMO2': '0.023', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.233', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:42,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 214392832. Throughput: 0: 4383.3. Samples: 53607580. Policy #0 lag: (min: 0.0, avg: 2.4, max: 7.0) [2024-08-06 00:53:42,802][52567] Avg episode reward: [(0, '56.354')] [2024-08-06 00:53:43,290][52664] DAMAGECOUNT value on done: 153432.0 [2024-08-06 00:53:43,292][52664] Sum rewards: 70.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.018', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.136', 'weapon4': '0.164', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '59.000'} [2024-08-06 00:53:43,334][52668] DAMAGECOUNT value on done: 149042.0 [2024-08-06 00:53:43,338][52668] Sum rewards: 53.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.410', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.236', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:43,355][52660] DAMAGECOUNT value on done: 151263.0 [2024-08-06 00:53:43,356][52660] Sum rewards: 54.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.718', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.186', 'AMMO3': '0.210', 'AMMO4': '0.233', 'weapon2': '0.268', 'WEAPON4': '0.500', 'weapon4': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:43,666][52662] DAMAGECOUNT value on done: 151591.0 [2024-08-06 00:53:43,669][52662] Sum rewards: 59.103, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.212', 'weapon2': '0.270', 'HEALTH': '0.521', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.288', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:43,779][52669] DAMAGECOUNT value on done: 148772.0 [2024-08-06 00:53:43,781][52669] Sum rewards: 58.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.108', 'AMMO3': '0.164', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.374', 'weapon2': '0.574', 'WEAPON3': '0.950', 'weapon3': '2.736', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:43,915][52794] DAMAGECOUNT value on done: 155579.0 [2024-08-06 00:53:43,915][52794] Sum rewards: 62.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.655', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.498', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:45,315][52667] DAMAGECOUNT value on done: 152712.0 [2024-08-06 00:53:45,315][52667] Sum rewards: 57.735, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.462', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.223', 'weapon4': '0.256', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:45,329][52647] DAMAGECOUNT value on done: 149233.0 [2024-08-06 00:53:45,329][52647] Sum rewards: 55.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.156', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.676', 'weapon4': '0.858', 'WEAPON3': '0.950', 'weapon3': '2.136', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:45,381][52803] DAMAGECOUNT value on done: 142287.0 [2024-08-06 00:53:45,383][52803] Sum rewards: 56.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.540', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:45,495][52811] DAMAGECOUNT value on done: 141523.0 [2024-08-06 00:53:45,498][52811] Sum rewards: 50.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.416', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.782', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:45,976][52664] DAMAGECOUNT value on done: 154510.0 [2024-08-06 00:53:45,976][52664] Sum rewards: 59.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.916', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon4': '0.354', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:46,268][52669] DAMAGECOUNT value on done: 148220.0 [2024-08-06 00:53:46,270][52669] Sum rewards: 70.558, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.546', 'ARMOR': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.295', 'weapon2': '0.314', 'WEAPON3': '1.600', 'weapon3': '3.178', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2024-08-06 00:53:46,419][52668] DAMAGECOUNT value on done: 147347.0 [2024-08-06 00:53:46,421][52668] Sum rewards: 44.341, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.440', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.160', 'weapon2': '0.572', 'WEAPON3': '1.100', 'HITCOUNT': '2.320', 'weapon3': '3.164', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '37.000'} [2024-08-06 00:53:46,429][52660] DAMAGECOUNT value on done: 143652.0 [2024-08-06 00:53:46,431][52660] Sum rewards: 53.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.158', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.216', 'weapon4': '0.236', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:46,577][52662] DAMAGECOUNT value on done: 154930.0 [2024-08-06 00:53:46,578][52662] Sum rewards: 52.843, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:46,883][52794] DAMAGECOUNT value on done: 158687.0 [2024-08-06 00:53:46,886][52794] Sum rewards: 64.204, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.034', 'HEALTH': '0.154', 'weapon5': '0.160', 'AMMO4': '0.168', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:46,974][52650] Updated weights for policy 0, policy_version 26181 (0.0020) [2024-08-06 00:53:47,794][52567] Fps is (10 sec: 18842.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 214491136. Throughput: 0: 4385.6. Samples: 53620640. Policy #0 lag: (min: 0.0, avg: 2.4, max: 7.0) [2024-08-06 00:53:47,802][52567] Avg episode reward: [(0, '57.060')] [2024-08-06 00:53:47,929][52647] DAMAGECOUNT value on done: 156640.0 [2024-08-06 00:53:47,929][52647] Sum rewards: 62.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.536', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.081', 'weapon4': '0.164', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.058', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:48,262][52667] DAMAGECOUNT value on done: 147010.0 [2024-08-06 00:53:48,264][52667] Sum rewards: 57.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.066', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:48,453][52803] DAMAGECOUNT value on done: 138194.0 [2024-08-06 00:53:48,453][52803] Sum rewards: 47.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.819', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.165', 'AMMO4': '0.242', 'weapon5': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.622', 'WEAPON4': '0.800', 'weapon4': '0.818', 'WEAPON3': '1.000', 'weapon3': '2.020', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '41.000'} [2024-08-06 00:53:48,705][52811] DAMAGECOUNT value on done: 138018.0 [2024-08-06 00:53:48,705][52811] Sum rewards: 59.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.080', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'weapon2': '0.498', 'WEAPON4': '0.550', 'weapon4': '0.884', 'WEAPON3': '1.050', 'weapon3': '2.316', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '48.500'} [2024-08-06 00:53:48,805][52664] DAMAGECOUNT value on done: 155806.0 [2024-08-06 00:53:48,807][52664] Sum rewards: 51.363, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.183', 'AMMO4': '0.219', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.660', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '44.500'} [2024-08-06 00:53:49,100][52668] DAMAGECOUNT value on done: 150174.0 [2024-08-06 00:53:49,103][52668] Sum rewards: 63.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon5': '0.146', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:49,113][52660] DAMAGECOUNT value on done: 147839.0 [2024-08-06 00:53:49,116][52660] Sum rewards: 53.324, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'weapon4': '0.192', 'AMMO3': '0.226', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.312', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:49,331][52669] DAMAGECOUNT value on done: 148835.0 [2024-08-06 00:53:49,332][52669] Sum rewards: 63.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.980', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.454', 'weapon2': '0.462', 'ARMOR': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:49,447][52662] DAMAGECOUNT value on done: 148639.0 [2024-08-06 00:53:49,449][52662] Sum rewards: 59.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.220', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.768', 'WEAPON3': '1.400', 'weapon3': '2.630', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:49,673][52794] DAMAGECOUNT value on done: 148738.0 [2024-08-06 00:53:49,674][52794] Sum rewards: 50.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'ARMOR': '0.004', 'weapon4': '0.014', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.246', 'weapon2': '0.358', 'WEAPON3': '1.500', 'HITCOUNT': '2.770', 'weapon3': '3.432', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:51,088][52667] DAMAGECOUNT value on done: 149489.0 [2024-08-06 00:53:51,088][52667] Sum rewards: 60.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.666', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.066', 'weapon4': '0.110', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.600', 'weapon3': '2.924', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '53.000'} [2024-08-06 00:53:51,400][52664] DAMAGECOUNT value on done: 150412.0 [2024-08-06 00:53:51,405][52664] Sum rewards: 52.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.146', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.157', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.550', 'weapon4': '0.686', 'WEAPON3': '1.000', 'weapon3': '2.582', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '45.000'} [2024-08-06 00:53:51,674][52650] Updated weights for policy 0, policy_version 26191 (0.0036) [2024-08-06 00:53:51,743][52803] DAMAGECOUNT value on done: 141066.0 [2024-08-06 00:53:51,744][52803] Sum rewards: 53.680, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.261', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.030', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.215', 'WEAPON4': '0.400', 'weapon4': '0.512', 'weapon2': '0.694', 'WEAPON3': '1.350', 'weapon3': '2.454', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:51,885][52668] DAMAGECOUNT value on done: 151483.0 [2024-08-06 00:53:51,886][52668] Sum rewards: 53.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.003', 'AMMO2': '0.045', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.224', 'AMMO3': '0.242', 'weapon2': '0.400', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.902', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:51,912][52660] DAMAGECOUNT value on done: 149830.0 [2024-08-06 00:53:51,914][52660] Sum rewards: 51.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon4': '0.070', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.280', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '3.344', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:52,015][52811] DAMAGECOUNT value on done: 141694.0 [2024-08-06 00:53:52,015][52811] Sum rewards: 53.288, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'weapon4': '0.484', 'weapon2': '0.830', 'WEAPON3': '0.900', 'weapon3': '2.350', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '41.000'} [2024-08-06 00:53:52,039][52662] DAMAGECOUNT value on done: 152088.0 [2024-08-06 00:53:52,039][52662] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.490', 'weapon2': '0.776', 'WEAPON3': '1.150', 'weapon3': '2.510', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:52,248][52794] DAMAGECOUNT value on done: 154129.0 [2024-08-06 00:53:52,248][52794] Sum rewards: 60.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.011', 'ARMOR': '0.052', 'weapon5': '0.054', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.412', 'WEAPON3': '1.000', 'weapon3': '2.950', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:52,469][52669] DAMAGECOUNT value on done: 147934.0 [2024-08-06 00:53:52,469][52669] Sum rewards: 58.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.738', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.091', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '48.000'} [2024-08-06 00:53:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 214573056. Throughput: 0: 4384.3. Samples: 53646840. Policy #0 lag: (min: 0.0, avg: 2.4, max: 7.0) [2024-08-06 00:53:52,802][52567] Avg episode reward: [(0, '56.813')] [2024-08-06 00:53:53,235][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:53:53,783][52667] DAMAGECOUNT value on done: 152434.0 [2024-08-06 00:53:53,785][52667] Sum rewards: 65.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.402', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '54.000'} [2024-08-06 00:53:54,445][52664] DAMAGECOUNT value on done: 154015.0 [2024-08-06 00:53:54,448][52664] Sum rewards: 58.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.176', 'AMMO3': '0.182', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon4': '0.268', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '49.000'} [2024-08-06 00:53:54,574][52662] DAMAGECOUNT value on done: 149478.0 [2024-08-06 00:53:54,574][52662] Sum rewards: 58.058, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.972', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.278', 'weapon4': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2024-08-06 00:53:54,773][52660] DAMAGECOUNT value on done: 157339.0 [2024-08-06 00:53:54,773][52660] Sum rewards: 65.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.897', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.150', 'weapon5': '0.170', 'weapon2': '0.180', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:54,807][52668] DAMAGECOUNT value on done: 150523.0 [2024-08-06 00:53:54,808][52668] Sum rewards: 57.683, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '2.704', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:54,828][52794] DAMAGECOUNT value on done: 150569.0 [2024-08-06 00:53:54,830][52794] Sum rewards: 62.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.111', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.076', 'weapon4': '0.110', 'AMMO3': '0.185', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '51.000'} [2024-08-06 00:53:54,919][52803] DAMAGECOUNT value on done: 133853.0 [2024-08-06 00:53:54,921][52803] Sum rewards: 58.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.666', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.356', 'weapon4': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:55,077][52811] DAMAGECOUNT value on done: 137283.0 [2024-08-06 00:53:55,079][52811] Sum rewards: 55.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.118', 'AMMO3': '0.205', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '47.000'} [2024-08-06 00:53:55,476][52669] DAMAGECOUNT value on done: 149063.0 [2024-08-06 00:53:55,476][52669] Sum rewards: 58.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.081', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.474', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '50.000'} [2024-08-06 00:53:56,471][52667] DAMAGECOUNT value on done: 149778.0 [2024-08-06 00:53:56,472][52667] Sum rewards: 61.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.255', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.206', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2024-08-06 00:53:56,477][52650] Updated weights for policy 0, policy_version 26201 (0.0023) [2024-08-06 00:53:57,607][52660] DAMAGECOUNT value on done: 146627.0 [2024-08-06 00:53:57,608][52660] Sum rewards: 65.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.146', 'AMMO5': '0.004', 'ARMOR': '0.017', 'weapon5': '0.034', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'AMMO4': '0.197', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '56.000'} [2024-08-06 00:53:57,632][52662] DAMAGECOUNT value on done: 149961.0 [2024-08-06 00:53:57,632][52662] Sum rewards: 50.464, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.021', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.137', 'AMMO3': '0.148', 'WEAPON4': '0.300', 'weapon4': '0.328', 'ARMOR': '0.500', 'weapon2': '0.616', 'WEAPON3': '0.900', 'HITCOUNT': '2.670', 'weapon3': '2.712', 'DAMAGECOUNT': '11.940', 'FRAGCOUNT': '40.000'} [2024-08-06 00:53:57,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 214654976. Throughput: 0: 4377.3. Samples: 53673270. Policy #0 lag: (min: 0.0, avg: 2.4, max: 7.0) [2024-08-06 00:53:57,795][52567] Avg episode reward: [(0, '57.603')] [2024-08-06 00:53:57,854][52794] DAMAGECOUNT value on done: 161059.0 [2024-08-06 00:53:57,865][52794] Sum rewards: 48.462, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.224', 'ARMOR': '0.012', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon5': '0.138', 'weapon4': '0.226', 'AMMO3': '0.246', 'AMMO4': '0.315', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.638', 'WEAPON3': '1.400', 'weapon3': '2.670', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '44.000'} [2024-08-06 00:53:58,066][52811] DAMAGECOUNT value on done: 140267.0 [2024-08-06 00:53:58,067][52811] Sum rewards: 51.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.761', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.052', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.261', 'WEAPON4': '0.650', 'weapon2': '0.694', 'weapon4': '0.974', 'WEAPON3': '1.000', 'weapon3': '1.988', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:58,381][52669] DAMAGECOUNT value on done: 150209.0 [2024-08-06 00:53:58,381][52669] Sum rewards: 54.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.512', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.666', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '46.000'} [2024-08-06 00:53:59,027][52667] DAMAGECOUNT value on done: 147959.0 [2024-08-06 00:53:59,029][52667] Sum rewards: 65.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.233', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '57.000'} [2024-08-06 00:54:00,604][52660] DAMAGECOUNT value on done: 150656.0 [2024-08-06 00:54:00,606][52660] Sum rewards: 50.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.236', 'weapon2': '0.324', 'WEAPON4': '0.450', 'weapon4': '0.512', 'WEAPON3': '1.450', 'weapon3': '2.682', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '46.000'} [2024-08-06 00:54:00,939][52650] Updated weights for policy 0, policy_version 26211 (0.0013) [2024-08-06 00:54:01,038][52794] DAMAGECOUNT value on done: 146437.0 [2024-08-06 00:54:01,038][52794] Sum rewards: 59.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.864', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.143', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.442', 'weapon4': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.792', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:01,285][52669] DAMAGECOUNT value on done: 150925.0 [2024-08-06 00:54:01,285][52669] Sum rewards: 65.255, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.251', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.328', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:02,042][52667] DAMAGECOUNT value on done: 150661.0 [2024-08-06 00:54:02,042][52667] Sum rewards: 53.864, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.180', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.378', 'weapon4': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '44.000'} [2024-08-06 00:54:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 214745088. Throughput: 0: 4380.9. Samples: 53686340. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:54:02,794][52567] Avg episode reward: [(0, '57.647')] [2024-08-06 00:54:03,235][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:54:03,584][52794] DAMAGECOUNT value on done: 157732.0 [2024-08-06 00:54:03,584][52794] Sum rewards: 43.253, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.368', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.203', 'AMMO3': '0.224', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '2.778', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '41.000'} [2024-08-06 00:54:03,775][52669] DAMAGECOUNT value on done: 146466.0 [2024-08-06 00:54:03,775][52669] Sum rewards: 63.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.316', 'WEAPON4': '0.400', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:03,794][52660] DAMAGECOUNT value on done: 143094.0 [2024-08-06 00:54:03,797][52660] Sum rewards: 49.106, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.132', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.122', 'AMMO3': '0.245', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.364', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '2.912', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '46.000'} [2024-08-06 00:54:05,237][52667] DAMAGECOUNT value on done: 146827.0 [2024-08-06 00:54:05,239][52667] Sum rewards: 58.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.105', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:05,955][52650] Updated weights for policy 0, policy_version 26221 (0.0012) [2024-08-06 00:54:06,645][52660] DAMAGECOUNT value on done: 151433.0 [2024-08-06 00:54:06,646][52660] Sum rewards: 47.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.435', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '43.500'} [2024-08-06 00:54:06,737][52794] DAMAGECOUNT value on done: 151840.0 [2024-08-06 00:54:06,738][52794] Sum rewards: 63.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.836', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.372', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '52.000'} [2024-08-06 00:54:06,777][52669] DAMAGECOUNT value on done: 151613.0 [2024-08-06 00:54:06,778][52669] Sum rewards: 57.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.362', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.136', 'AMMO3': '0.160', 'weapon2': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.646', 'WEAPON3': '0.900', 'weapon3': '2.660', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '47.000'} [2024-08-06 00:54:07,739][52667] DAMAGECOUNT value on done: 152550.0 [2024-08-06 00:54:07,741][52667] Sum rewards: 49.788, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.605', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.068', 'weapon4': '0.104', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.496', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '3.046', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '47.000'} [2024-08-06 00:54:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 214835200. Throughput: 0: 4386.0. Samples: 53712680. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:54:07,794][52567] Avg episode reward: [(0, '57.626')] [2024-08-06 00:54:07,929][52658] DAMAGECOUNT value on done: 152918.0 [2024-08-06 00:54:07,930][52658] Sum rewards: 52.393, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.672', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'AMMO4': '0.284', 'weapon4': '0.412', 'weapon2': '0.464', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2024-08-06 00:54:09,309][52660] DAMAGECOUNT value on done: 146463.0 [2024-08-06 00:54:09,309][52660] Sum rewards: 60.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.110', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:09,517][52794] DAMAGECOUNT value on done: 152285.0 [2024-08-06 00:54:09,518][52794] Sum rewards: 61.872, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.585', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.156', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '55.000'} [2024-08-06 00:54:09,814][52669] DAMAGECOUNT value on done: 150905.0 [2024-08-06 00:54:09,817][52669] Sum rewards: 65.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.516', 'AMMO5': '0.003', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.198', 'AMMO4': '0.217', 'weapon4': '0.228', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '56.000'} [2024-08-06 00:54:10,119][52650] Updated weights for policy 0, policy_version 26231 (0.0021) [2024-08-06 00:54:10,757][52667] DAMAGECOUNT value on done: 156365.0 [2024-08-06 00:54:10,758][52667] Sum rewards: 55.051, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.834', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.151', 'weapon5': '0.196', 'weapon4': '0.246', 'AMMO4': '0.277', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.756', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '44.000'} [2024-08-06 00:54:11,038][52658] DAMAGECOUNT value on done: 149757.0 [2024-08-06 00:54:11,038][52658] Sum rewards: 55.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.273', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.093', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.119', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.638', 'WEAPON3': '0.700', 'weapon3': '2.676', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '44.000'} [2024-08-06 00:54:12,309][52669] DAMAGECOUNT value on done: 146816.0 [2024-08-06 00:54:12,310][52669] Sum rewards: 52.724, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.360', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.175', 'AMMO3': '0.241', 'WEAPON4': '0.450', 'weapon4': '0.558', 'weapon2': '0.570', 'WEAPON3': '1.500', 'weapon3': '2.444', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:12,444][52794] DAMAGECOUNT value on done: 158885.0 [2024-08-06 00:54:12,444][52794] Sum rewards: 51.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.063', 'weapon5': '0.182', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'AMMO4': '0.317', 'weapon4': '0.424', 'WEAPON4': '0.550', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '2.482', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '43.000'} [2024-08-06 00:54:12,514][52614] Signal inference workers to stop experience collection... (4850 times) [2024-08-06 00:54:12,514][52614] Signal inference workers to resume experience collection... (4850 times) [2024-08-06 00:54:12,587][52650] InferenceWorker_p0-w0: stopping experience collection (4850 times) [2024-08-06 00:54:12,587][52650] InferenceWorker_p0-w0: resuming experience collection (4850 times) [2024-08-06 00:54:12,808][52567] Fps is (10 sec: 17997.6, 60 sec: 17608.7, 300 sec: 17577.3). Total num frames: 214925312. Throughput: 0: 4383.5. Samples: 53738900. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:54:12,808][52567] Avg episode reward: [(0, '57.503')] [2024-08-06 00:54:13,810][52667] DAMAGECOUNT value on done: 154661.0 [2024-08-06 00:54:13,811][52667] Sum rewards: 68.026, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.712', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.044', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 00:54:14,106][52658] DAMAGECOUNT value on done: 152714.0 [2024-08-06 00:54:14,110][52658] Sum rewards: 62.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.084', 'AMMO5': '0.007', 'AMMO2': '0.054', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'AMMO4': '0.271', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.000'} [2024-08-06 00:54:15,114][52650] Updated weights for policy 0, policy_version 26241 (0.0013) [2024-08-06 00:54:15,317][52669] DAMAGECOUNT value on done: 150502.0 [2024-08-06 00:54:15,318][52669] Sum rewards: 61.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.457', 'AMMO5': '0.003', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.172', 'AMMO4': '0.232', 'weapon2': '0.382', 'WEAPON4': '0.500', 'weapon4': '0.812', 'WEAPON3': '1.100', 'weapon3': '2.510', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:15,509][52794] DAMAGECOUNT value on done: 154562.0 [2024-08-06 00:54:15,509][52794] Sum rewards: 53.825, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.298', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.184', 'AMMO4': '0.225', 'weapon4': '0.242', 'AMMO3': '0.255', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.558', 'WEAPON3': '1.400', 'weapon3': '2.686', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '50.000'} [2024-08-06 00:54:16,765][52667] DAMAGECOUNT value on done: 154829.0 [2024-08-06 00:54:16,767][52667] Sum rewards: 61.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.120', 'AMMO2': '0.014', 'ARMOR': '0.036', 'AMMO4': '0.068', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.286', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '52.000'} [2024-08-06 00:54:17,139][52658] DAMAGECOUNT value on done: 153732.0 [2024-08-06 00:54:17,141][52658] Sum rewards: 48.681, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.074', 'weapon5': '0.074', 'WEAPON4': '0.150', 'weapon2': '0.246', 'AMMO3': '0.273', 'WEAPON3': '1.600', 'HITCOUNT': '2.630', 'weapon3': '3.394', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '46.000'} [2024-08-06 00:54:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 215007232. Throughput: 0: 4386.0. Samples: 53752160. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 00:54:17,794][52567] Avg episode reward: [(0, '57.513')] [2024-08-06 00:54:18,337][52669] DAMAGECOUNT value on done: 156863.0 [2024-08-06 00:54:18,346][52669] Sum rewards: 65.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.146', 'AMMO5': '0.003', 'AMMO2': '0.031', 'ARMOR': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.330', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '56.000'} [2024-08-06 00:54:18,985][52649] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 00:54:19,720][52667] DAMAGECOUNT value on done: 147263.0 [2024-08-06 00:54:19,720][52667] Sum rewards: 54.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.739', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.200', 'AMMO3': '0.224', 'AMMO4': '0.235', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.686', 'WEAPON3': '1.250', 'weapon3': '2.510', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '46.000'} [2024-08-06 00:54:19,759][52650] Updated weights for policy 0, policy_version 26251 (0.0022) [2024-08-06 00:54:19,927][52658] DAMAGECOUNT value on done: 152860.0 [2024-08-06 00:54:19,927][52658] Sum rewards: 49.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '42.000'} [2024-08-06 00:54:21,273][52669] DAMAGECOUNT value on done: 160929.0 [2024-08-06 00:54:21,273][52669] Sum rewards: 59.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon4': '0.332', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '50.000'} [2024-08-06 00:54:21,401][52666] DAMAGECOUNT value on done: 151206.0 [2024-08-06 00:54:21,401][52666] Sum rewards: 50.485, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.054', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.224', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.600', 'weapon3': '2.922', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '46.500'} [2024-08-06 00:54:22,318][52667] DAMAGECOUNT value on done: 156299.0 [2024-08-06 00:54:22,318][52667] Sum rewards: 60.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.408', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.235', 'weapon2': '0.446', 'WEAPON4': '0.500', 'weapon4': '0.674', 'WEAPON3': '1.500', 'weapon3': '2.696', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:22,631][52658] DAMAGECOUNT value on done: 146313.0 [2024-08-06 00:54:22,635][52658] Sum rewards: 61.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.504', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.099', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '52.000'} [2024-08-06 00:54:22,794][52567] Fps is (10 sec: 17226.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 215097344. Throughput: 0: 4379.4. Samples: 53778270. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 00:54:22,794][52567] Avg episode reward: [(0, '57.893')] [2024-08-06 00:54:24,115][52666] DAMAGECOUNT value on done: 150884.0 [2024-08-06 00:54:24,117][52666] Sum rewards: 43.668, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon4': '0.256', 'AMMO4': '0.318', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.134', 'DAMAGECOUNT': '12.588', 'FRAGCOUNT': '41.000'} [2024-08-06 00:54:24,294][52650] Updated weights for policy 0, policy_version 26261 (0.0025) [2024-08-06 00:54:24,511][52669] DAMAGECOUNT value on done: 149026.0 [2024-08-06 00:54:24,512][52669] Sum rewards: 61.241, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.525', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.018', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.278', 'weapon2': '0.338', 'WEAPON3': '1.700', 'weapon3': '3.300', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '55.000'} [2024-08-06 00:54:24,748][52649] DAMAGECOUNT value on done: 146099.0 [2024-08-06 00:54:24,750][52649] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.284', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.480', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '57.000'} [2024-08-06 00:54:24,951][52795] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:54:25,726][52658] DAMAGECOUNT value on done: 155156.0 [2024-08-06 00:54:25,727][52658] Sum rewards: 60.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.619', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.340', 'weapon4': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:26,859][52666] DAMAGECOUNT value on done: 149412.0 [2024-08-06 00:54:26,861][52666] Sum rewards: 45.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.995', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.146', 'AMMO3': '0.191', 'AMMO4': '0.283', 'weapon2': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.576', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.340', 'weapon3': '2.692', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '40.000'} [2024-08-06 00:54:27,244][52669] DAMAGECOUNT value on done: 150594.0 [2024-08-06 00:54:27,245][52669] Sum rewards: 60.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.402', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.201', 'weapon2': '0.310', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.464', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '50.000'} [2024-08-06 00:54:27,416][52649] DAMAGECOUNT value on done: 143703.0 [2024-08-06 00:54:27,416][52649] Sum rewards: 53.226, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.062', 'AMMO4': '0.218', 'weapon4': '0.238', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 215187456. Throughput: 0: 4381.3. Samples: 53804740. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 00:54:27,794][52567] Avg episode reward: [(0, '57.254')] [2024-08-06 00:54:27,879][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026269_215195648.pth... [2024-08-06 00:54:28,003][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000025754_210976768.pth [2024-08-06 00:54:28,680][52658] DAMAGECOUNT value on done: 146294.0 [2024-08-06 00:54:28,682][52658] Sum rewards: 52.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.031', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon5': '0.068', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.712', 'WEAPON3': '1.700', 'HITCOUNT': '2.820', 'weapon3': '2.880', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '49.000'} [2024-08-06 00:54:29,316][52650] Updated weights for policy 0, policy_version 26271 (0.0013) [2024-08-06 00:54:29,712][52666] DAMAGECOUNT value on done: 147695.0 [2024-08-06 00:54:29,713][52666] Sum rewards: 54.456, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.650', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.078', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.306', 'weapon4': '0.366', 'weapon2': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'weapon3': '2.704', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:30,076][52649] DAMAGECOUNT value on done: 144935.0 [2024-08-06 00:54:30,076][52649] Sum rewards: 55.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.182', 'weapon4': '0.238', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:30,574][52669] DAMAGECOUNT value on done: 151505.0 [2024-08-06 00:54:30,576][52669] Sum rewards: 59.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.942', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO3': '0.233', 'weapon2': '0.594', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:30,715][52670] DAMAGECOUNT value on done: 148005.0 [2024-08-06 00:54:30,717][52670] Sum rewards: 61.560, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.142', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:31,575][52658] DAMAGECOUNT value on done: 155710.0 [2024-08-06 00:54:31,577][52658] Sum rewards: 67.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '56.000'} [2024-08-06 00:54:32,424][52666] DAMAGECOUNT value on done: 145767.0 [2024-08-06 00:54:32,425][52666] Sum rewards: 50.023, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'weapon5': '0.036', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'AMMO4': '0.211', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.754', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '45.000'} [2024-08-06 00:54:32,666][52649] DAMAGECOUNT value on done: 146830.0 [2024-08-06 00:54:32,666][52649] Sum rewards: 54.027, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.304', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'AMMO4': '0.212', 'weapon4': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17605.9). Total num frames: 215277568. Throughput: 0: 4375.1. Samples: 53817520. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:54:32,795][52567] Avg episode reward: [(0, '57.103')] [2024-08-06 00:54:33,335][52669] DAMAGECOUNT value on done: 153371.0 [2024-08-06 00:54:33,335][52669] Sum rewards: 54.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.927', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.130', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.668', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '2.940', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '47.000'} [2024-08-06 00:54:33,359][52670] DAMAGECOUNT value on done: 151664.0 [2024-08-06 00:54:33,360][52670] Sum rewards: 52.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.821', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.022', 'weapon5': '0.048', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.364', 'WEAPON4': '0.400', 'weapon4': '0.792', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '47.500'} [2024-08-06 00:54:33,483][52650] Updated weights for policy 0, policy_version 26281 (0.0024) [2024-08-06 00:54:34,155][52658] DAMAGECOUNT value on done: 154852.0 [2024-08-06 00:54:34,156][52658] Sum rewards: 50.685, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.026', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.190', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '43.000'} [2024-08-06 00:54:35,536][52666] DAMAGECOUNT value on done: 144323.0 [2024-08-06 00:54:35,537][52666] Sum rewards: 58.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.258', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.092', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.276', 'weapon2': '0.556', 'WEAPON4': '0.700', 'weapon4': '0.706', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '52.000'} [2024-08-06 00:54:35,651][52649] DAMAGECOUNT value on done: 141239.0 [2024-08-06 00:54:35,654][52649] Sum rewards: 56.536, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.147', 'AMMO5': '0.003', 'AMMO2': '0.036', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon4': '0.308', 'weapon2': '0.316', 'WEAPON3': '1.700', 'weapon3': '3.078', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:36,625][52670] DAMAGECOUNT value on done: 147785.0 [2024-08-06 00:54:36,626][52670] Sum rewards: 70.302, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'HEALTH': '0.158', 'AMMO3': '0.171', 'weapon4': '0.326', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '57.000'} [2024-08-06 00:54:36,792][52658] DAMAGECOUNT value on done: 155902.0 [2024-08-06 00:54:36,793][52658] Sum rewards: 57.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.688', 'AMMO5': '0.008', 'AMMO2': '0.054', 'weapon5': '0.096', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'AMMO4': '0.271', 'weapon4': '0.376', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 215359488. Throughput: 0: 4384.9. Samples: 53844160. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:54:37,795][52567] Avg episode reward: [(0, '56.888')] [2024-08-06 00:54:38,254][52649] DAMAGECOUNT value on done: 145866.0 [2024-08-06 00:54:38,255][52649] Sum rewards: 63.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.005', 'weapon5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '53.500'} [2024-08-06 00:54:38,511][52650] Updated weights for policy 0, policy_version 26291 (0.0012) [2024-08-06 00:54:38,575][52666] DAMAGECOUNT value on done: 146840.0 [2024-08-06 00:54:38,577][52666] Sum rewards: 60.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.066', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.468', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.276', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:39,342][52670] DAMAGECOUNT value on done: 147769.0 [2024-08-06 00:54:39,344][52670] Sum rewards: 47.911, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.714', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon4': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '44.000'} [2024-08-06 00:54:39,666][52658] DAMAGECOUNT value on done: 146633.0 [2024-08-06 00:54:39,668][52658] Sum rewards: 56.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.048', 'weapon4': '0.060', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:40,768][52649] DAMAGECOUNT value on done: 142635.0 [2024-08-06 00:54:40,771][52649] Sum rewards: 57.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.617', 'AMMO5': '0.010', 'AMMO2': '0.037', 'ARMOR': '0.040', 'weapon5': '0.152', 'AMMO4': '0.183', 'AMMO3': '0.226', 'weapon4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '50.000'} [2024-08-06 00:54:41,030][52666] DAMAGECOUNT value on done: 148154.0 [2024-08-06 00:54:41,031][52666] Sum rewards: 54.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.231', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '49.000'} [2024-08-06 00:54:41,922][52670] DAMAGECOUNT value on done: 149558.0 [2024-08-06 00:54:41,923][52670] Sum rewards: 45.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.180', 'AMMO4': '0.190', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '3.026', 'DAMAGECOUNT': '11.697', 'FRAGCOUNT': '40.000'} [2024-08-06 00:54:42,477][52658] DAMAGECOUNT value on done: 150451.0 [2024-08-06 00:54:42,479][52658] Sum rewards: 56.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.241', 'weapon5': '0.256', 'weapon2': '0.302', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '49.000'} [2024-08-06 00:54:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 215449600. Throughput: 0: 4388.2. Samples: 53870740. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:54:42,794][52567] Avg episode reward: [(0, '56.832')] [2024-08-06 00:54:43,078][52650] Updated weights for policy 0, policy_version 26301 (0.0012) [2024-08-06 00:54:43,491][52649] DAMAGECOUNT value on done: 149254.0 [2024-08-06 00:54:43,491][52649] Sum rewards: 55.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.976', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.758', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '47.500'} [2024-08-06 00:54:43,990][52666] DAMAGECOUNT value on done: 149212.0 [2024-08-06 00:54:43,991][52666] Sum rewards: 58.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.501', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '50.000'} [2024-08-06 00:54:45,002][52670] DAMAGECOUNT value on done: 150782.0 [2024-08-06 00:54:45,004][52670] Sum rewards: 61.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.586', 'ARMOR': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.246', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:45,269][52658] DAMAGECOUNT value on done: 149688.0 [2024-08-06 00:54:45,271][52658] Sum rewards: 56.249, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.062', 'HEALTH': '0.136', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon2': '0.494', 'WEAPON4': '0.550', 'weapon4': '0.790', 'WEAPON3': '0.850', 'weapon3': '2.434', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '46.000'} [2024-08-06 00:54:45,722][52649] DAMAGECOUNT value on done: 143658.0 [2024-08-06 00:54:45,724][52649] Sum rewards: 52.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.076', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.170', 'AMMO3': '0.184', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON4': '0.500', 'weapon4': '1.028', 'WEAPON3': '1.100', 'weapon3': '2.062', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '45.500'} [2024-08-06 00:54:46,956][52666] DAMAGECOUNT value on done: 148845.0 [2024-08-06 00:54:46,958][52666] Sum rewards: 58.888, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.548', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.044', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:47,416][52650] Updated weights for policy 0, policy_version 26311 (0.0033) [2024-08-06 00:54:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 215539712. Throughput: 0: 4396.0. Samples: 53884160. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:54:47,794][52567] Avg episode reward: [(0, '56.819')] [2024-08-06 00:54:47,873][52670] DAMAGECOUNT value on done: 144000.0 [2024-08-06 00:54:47,878][52670] Sum rewards: 54.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.102', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.608', 'WEAPON3': '1.500', 'weapon3': '2.914', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '47.000'} [2024-08-06 00:54:48,281][52658] DAMAGECOUNT value on done: 149477.0 [2024-08-06 00:54:48,281][52658] Sum rewards: 54.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.779', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.034', 'AMMO3': '0.228', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '47.000'} [2024-08-06 00:54:48,287][52649] DAMAGECOUNT value on done: 146235.0 [2024-08-06 00:54:48,287][52649] Sum rewards: 55.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.068', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon4': '0.238', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.238', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:48,701][52663] DAMAGECOUNT value on done: 149149.0 [2024-08-06 00:54:48,701][52663] Sum rewards: 61.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.186', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.692', 'WEAPON3': '1.500', 'weapon3': '2.808', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 00:54:50,055][52666] DAMAGECOUNT value on done: 146406.0 [2024-08-06 00:54:50,056][52666] Sum rewards: 48.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.605', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon7': '0.070', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.534', 'weapon4': '0.908', 'WEAPON3': '0.950', 'weapon3': '2.266', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '39.500'} [2024-08-06 00:54:50,929][52649] DAMAGECOUNT value on done: 145794.0 [2024-08-06 00:54:50,929][52649] Sum rewards: 53.897, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.484', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.062', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.600', 'HITCOUNT': '2.900', 'weapon3': '2.992', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '50.000'} [2024-08-06 00:54:51,118][52670] DAMAGECOUNT value on done: 148858.0 [2024-08-06 00:54:51,118][52670] Sum rewards: 62.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'weapon4': '0.196', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '54.000'} [2024-08-06 00:54:51,122][52658] DAMAGECOUNT value on done: 153664.0 [2024-08-06 00:54:51,123][52658] Sum rewards: 57.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.198', 'weapon2': '0.512', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.172', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '49.000'} [2024-08-06 00:54:51,287][52671] DAMAGECOUNT value on done: 155882.0 [2024-08-06 00:54:51,288][52671] Sum rewards: 57.384, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon5': '0.188', 'WEAPON4': '0.400', 'weapon4': '0.506', 'weapon2': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.088', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '49.000'} [2024-08-06 00:54:51,794][52663] DAMAGECOUNT value on done: 151224.0 [2024-08-06 00:54:51,796][52663] Sum rewards: 57.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.582', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.281', 'weapon2': '0.326', 'WEAPON3': '1.850', 'weapon3': '3.220', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:52,381][52650] Updated weights for policy 0, policy_version 26321 (0.0020) [2024-08-06 00:54:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 215621632. Throughput: 0: 4398.2. Samples: 53910600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:54:52,794][52567] Avg episode reward: [(0, '56.829')] [2024-08-06 00:54:52,900][52666] DAMAGECOUNT value on done: 143829.0 [2024-08-06 00:54:52,925][52666] Sum rewards: 59.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.598', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.204', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.814', 'WEAPON3': '1.500', 'weapon3': '2.764', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '51.000'} [2024-08-06 00:54:53,719][52649] DAMAGECOUNT value on done: 143020.0 [2024-08-06 00:54:53,719][52649] Sum rewards: 70.475, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.332', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.340', 'WEAPON3': '1.150', 'weapon3': '3.280', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '57.000'} [2024-08-06 00:54:53,826][52670] DAMAGECOUNT value on done: 143591.0 [2024-08-06 00:54:53,826][52670] Sum rewards: 48.241, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.106', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon4': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.300', 'weapon3': '2.520', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '43.000'} [2024-08-06 00:54:54,156][52658] DAMAGECOUNT value on done: 154782.0 [2024-08-06 00:54:54,156][52658] Sum rewards: 54.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.399', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.050', 'weapon5': '0.064', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'weapon2': '0.484', 'weapon4': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.692', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '49.000'} [2024-08-06 00:54:54,398][52671] DAMAGECOUNT value on done: 149941.0 [2024-08-06 00:54:54,400][52671] Sum rewards: 56.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO2': '0.038', 'AMMO4': '0.188', 'AMMO3': '0.245', 'weapon2': '0.296', 'WEAPON4': '0.400', 'weapon4': '0.754', 'WEAPON3': '1.500', 'weapon3': '2.668', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '49.000'} [2024-08-06 00:54:54,872][52663] DAMAGECOUNT value on done: 148840.0 [2024-08-06 00:54:54,872][52663] Sum rewards: 51.451, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.097', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO4': '0.234', 'AMMO3': '0.248', 'weapon4': '0.294', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.710', 'weapon3': '2.868', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:55,497][52666] DAMAGECOUNT value on done: 151170.0 [2024-08-06 00:54:55,499][52666] Sum rewards: 58.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.158', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.724', 'weapon2': '0.934', 'WEAPON3': '1.100', 'weapon3': '1.976', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:55,922][52795] DAMAGECOUNT value on done: 139110.0 [2024-08-06 00:54:55,926][52795] Sum rewards: 52.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.779', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'weapon5': '0.178', 'AMMO4': '0.190', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.614', 'WEAPON3': '1.350', 'weapon3': '2.540', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '46.000'} [2024-08-06 00:54:56,382][52670] DAMAGECOUNT value on done: 140316.0 [2024-08-06 00:54:56,384][52670] Sum rewards: 51.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.306', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.225', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '45.000'} [2024-08-06 00:54:56,824][52649] DAMAGECOUNT value on done: 148494.0 [2024-08-06 00:54:56,824][52649] Sum rewards: 41.581, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.954', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.046', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.230', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.968', 'DAMAGECOUNT': '10.863', 'FRAGCOUNT': '35.000'} [2024-08-06 00:54:57,164][52650] Updated weights for policy 0, policy_version 26331 (0.0031) [2024-08-06 00:54:57,296][52671] DAMAGECOUNT value on done: 155893.0 [2024-08-06 00:54:57,297][52671] Sum rewards: 58.071, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.800', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.237', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:57,484][52658] DAMAGECOUNT value on done: 146779.0 [2024-08-06 00:54:57,485][52658] Sum rewards: 53.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.266', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.196', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.320', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '46.000'} [2024-08-06 00:54:57,643][52663] DAMAGECOUNT value on done: 149129.0 [2024-08-06 00:54:57,644][52663] Sum rewards: 47.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'WEAPON4': '0.450', 'weapon2': '0.562', 'weapon4': '0.678', 'WEAPON3': '0.800', 'weapon3': '2.372', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '39.500'} [2024-08-06 00:54:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 215711744. Throughput: 0: 4397.8. Samples: 53936740. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:54:57,794][52567] Avg episode reward: [(0, '56.261')] [2024-08-06 00:54:57,942][52666] DAMAGECOUNT value on done: 152158.0 [2024-08-06 00:54:57,942][52666] Sum rewards: 65.867, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.318', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO3': '0.131', 'AMMO4': '0.151', 'weapon4': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.478', 'WEAPON3': '0.950', 'weapon3': '3.108', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '53.000'} [2024-08-06 00:54:59,048][52670] DAMAGECOUNT value on done: 151596.0 [2024-08-06 00:54:59,049][52670] Sum rewards: 55.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.988', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.033', 'WEAPON5': '0.150', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.316', 'weapon2': '0.604', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '48.000'} [2024-08-06 00:54:59,052][52795] DAMAGECOUNT value on done: 134579.0 [2024-08-06 00:54:59,055][52795] Sum rewards: 55.958, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.447', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.912', 'WEAPON3': '1.100', 'weapon3': '2.594', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '47.000'} [2024-08-06 00:54:59,958][52649] DAMAGECOUNT value on done: 148404.0 [2024-08-06 00:54:59,958][52649] Sum rewards: 63.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.756', 'AMMO5': '0.008', 'weapon4': '0.040', 'AMMO2': '0.042', 'weapon5': '0.082', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '54.500'} [2024-08-06 00:55:00,170][52671] DAMAGECOUNT value on done: 149397.0 [2024-08-06 00:55:00,170][52671] Sum rewards: 62.834, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.860', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.055', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'AMMO4': '0.275', 'weapon2': '0.520', 'weapon4': '0.626', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.520', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '58.000'} [2024-08-06 00:55:00,343][52658] DAMAGECOUNT value on done: 148302.0 [2024-08-06 00:55:00,343][52658] Sum rewards: 56.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.330', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.110', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'weapon2': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.488', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:00,662][52663] DAMAGECOUNT value on done: 147589.0 [2024-08-06 00:55:00,664][52663] Sum rewards: 62.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.272', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '53.000'} [2024-08-06 00:55:01,067][52666] DAMAGECOUNT value on done: 148061.0 [2024-08-06 00:55:01,068][52666] Sum rewards: 60.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.160', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '51.000'} [2024-08-06 00:55:01,728][52650] Updated weights for policy 0, policy_version 26341 (0.0013) [2024-08-06 00:55:02,169][52670] DAMAGECOUNT value on done: 149123.0 [2024-08-06 00:55:02,169][52670] Sum rewards: 53.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'ARMOR': '0.008', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.065', 'weapon5': '0.128', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'AMMO4': '0.327', 'weapon4': '0.530', 'WEAPON4': '0.750', 'weapon2': '0.800', 'WEAPON3': '1.050', 'weapon3': '2.338', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '45.500'} [2024-08-06 00:55:02,228][52795] DAMAGECOUNT value on done: 138177.0 [2024-08-06 00:55:02,228][52795] Sum rewards: 57.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.356', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.972', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 215801856. Throughput: 0: 4391.6. Samples: 53949780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 00:55:02,794][52567] Avg episode reward: [(0, '56.519')] [2024-08-06 00:55:02,980][52658] DAMAGECOUNT value on done: 154324.0 [2024-08-06 00:55:02,981][52658] Sum rewards: 62.236, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.080', 'weapon4': '0.142', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '54.000'} [2024-08-06 00:55:03,066][52649] DAMAGECOUNT value on done: 142011.0 [2024-08-06 00:55:03,066][52649] Sum rewards: 49.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.659', 'AMMO5': '0.012', 'ARMOR': '0.036', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO3': '0.158', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon2': '0.956', 'weapon3': '2.244', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '41.000'} [2024-08-06 00:55:03,109][52663] DAMAGECOUNT value on done: 156800.0 [2024-08-06 00:55:03,110][52663] Sum rewards: 73.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.165', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '60.000'} [2024-08-06 00:55:03,367][52671] DAMAGECOUNT value on done: 151851.0 [2024-08-06 00:55:03,371][52671] Sum rewards: 58.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.043', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.338', 'weapon4': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:04,250][52666] DAMAGECOUNT value on done: 147261.0 [2024-08-06 00:55:04,250][52666] Sum rewards: 61.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'ARMOR': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.604', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '53.000'} [2024-08-06 00:55:05,112][52670] DAMAGECOUNT value on done: 151077.0 [2024-08-06 00:55:05,113][52670] Sum rewards: 57.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.669', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.344', 'weapon4': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '47.500'} [2024-08-06 00:55:05,483][52795] DAMAGECOUNT value on done: 137216.0 [2024-08-06 00:55:05,483][52795] Sum rewards: 53.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.799', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.844', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:05,938][52663] DAMAGECOUNT value on done: 150227.0 [2024-08-06 00:55:05,939][52663] Sum rewards: 51.837, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.328', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.177', 'AMMO3': '0.210', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '1.030', 'WEAPON3': '1.150', 'weapon3': '2.186', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '13.902', 'FRAGCOUNT': '45.000'} [2024-08-06 00:55:06,076][52649] DAMAGECOUNT value on done: 147540.0 [2024-08-06 00:55:06,080][52649] Sum rewards: 47.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.380', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '2.980', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '43.000'} [2024-08-06 00:55:06,171][52671] DAMAGECOUNT value on done: 152031.0 [2024-08-06 00:55:06,172][52671] Sum rewards: 54.659, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.222', 'AMMO3': '0.253', 'WEAPON4': '0.450', 'weapon2': '0.472', 'weapon4': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.632', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:06,386][52650] Updated weights for policy 0, policy_version 26351 (0.0012) [2024-08-06 00:55:07,186][52666] DAMAGECOUNT value on done: 145621.0 [2024-08-06 00:55:07,188][52666] Sum rewards: 49.220, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.279', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.278', 'weapon2': '0.756', 'WEAPON3': '1.100', 'weapon3': '2.588', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '40.000'} [2024-08-06 00:55:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 215891968. Throughput: 0: 4403.6. Samples: 53976430. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:55:07,802][52567] Avg episode reward: [(0, '56.685')] [2024-08-06 00:55:08,172][52670] DAMAGECOUNT value on done: 147752.0 [2024-08-06 00:55:08,174][52670] Sum rewards: 54.875, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.938', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.106', 'weapon4': '0.202', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:08,587][52795] DAMAGECOUNT value on done: 140441.0 [2024-08-06 00:55:08,589][52795] Sum rewards: 53.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.284', 'AMMO5': '0.010', 'ARMOR': '0.021', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.157', 'AMMO3': '0.203', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.002', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '49.000'} [2024-08-06 00:55:09,015][52671] DAMAGECOUNT value on done: 152145.0 [2024-08-06 00:55:09,018][52671] Sum rewards: 62.957, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.519', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'weapon5': '0.176', 'AMMO3': '0.178', 'weapon2': '0.698', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '51.000'} [2024-08-06 00:55:09,018][52663] DAMAGECOUNT value on done: 149131.0 [2024-08-06 00:55:09,020][52663] Sum rewards: 64.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.782', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:09,290][52649] DAMAGECOUNT value on done: 145105.0 [2024-08-06 00:55:09,292][52649] Sum rewards: 52.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.901', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.464', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.670', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.444', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:09,813][52666] DAMAGECOUNT value on done: 151656.0 [2024-08-06 00:55:09,815][52666] Sum rewards: 58.518, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.217', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.342', 'weapon4': '0.620', 'WEAPON3': '0.950', 'weapon3': '2.626', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:10,521][52670] DAMAGECOUNT value on done: 154447.0 [2024-08-06 00:55:10,522][52670] Sum rewards: 63.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO3': '0.196', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '54.000'} [2024-08-06 00:55:10,857][52650] Updated weights for policy 0, policy_version 26361 (0.0012) [2024-08-06 00:55:11,763][52795] DAMAGECOUNT value on done: 138052.0 [2024-08-06 00:55:11,766][52795] Sum rewards: 58.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.472', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:11,877][52671] DAMAGECOUNT value on done: 152519.0 [2024-08-06 00:55:11,877][52671] Sum rewards: 51.884, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.251', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.129', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.474', 'weapon4': '0.492', 'WEAPON3': '0.800', 'HITCOUNT': '2.650', 'weapon3': '2.738', 'DAMAGECOUNT': '11.958', 'FRAGCOUNT': '42.000'} [2024-08-06 00:55:12,086][52663] DAMAGECOUNT value on done: 151267.0 [2024-08-06 00:55:12,086][52663] Sum rewards: 51.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon4': '0.190', 'AMMO3': '0.208', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '45.000'} [2024-08-06 00:55:12,464][52666] DAMAGECOUNT value on done: 144957.0 [2024-08-06 00:55:12,465][52666] Sum rewards: 49.342, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.925', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.512', 'WEAPON3': '1.750', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:12,491][52649] DAMAGECOUNT value on done: 151014.0 [2024-08-06 00:55:12,491][52649] Sum rewards: 54.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.041', 'AMMO3': '0.145', 'weapon5': '0.196', 'AMMO4': '0.204', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.446', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17480.3, 300 sec: 17578.1). Total num frames: 215973888. Throughput: 0: 4398.9. Samples: 54002690. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:55:12,794][52567] Avg episode reward: [(0, '56.350')] [2024-08-06 00:55:13,175][52670] DAMAGECOUNT value on done: 142610.0 [2024-08-06 00:55:13,175][52670] Sum rewards: 52.687, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO4': '0.154', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '45.500'} [2024-08-06 00:55:14,656][52671] DAMAGECOUNT value on done: 150274.0 [2024-08-06 00:55:14,656][52671] Sum rewards: 59.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.693', 'AMMO5': '0.011', 'ARMOR': '0.036', 'AMMO2': '0.067', 'weapon5': '0.080', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'AMMO4': '0.337', 'weapon4': '0.478', 'weapon2': '0.638', 'WEAPON4': '0.850', 'WEAPON3': '1.050', 'weapon3': '2.490', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '53.000'} [2024-08-06 00:55:14,894][52663] DAMAGECOUNT value on done: 153335.0 [2024-08-06 00:55:14,894][52795] DAMAGECOUNT value on done: 141999.0 [2024-08-06 00:55:14,894][52795] Sum rewards: 57.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:14,894][52663] Sum rewards: 53.315, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.254', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.197', 'weapon4': '0.234', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.040', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '45.000'} [2024-08-06 00:55:14,905][52665] DAMAGECOUNT value on done: 147851.0 [2024-08-06 00:55:14,905][52665] Sum rewards: 59.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.150', 'weapon4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:15,231][52666] DAMAGECOUNT value on done: 148893.0 [2024-08-06 00:55:15,233][52666] Sum rewards: 51.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.091', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.592', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.934', 'DAMAGECOUNT': '12.159', 'FRAGCOUNT': '44.000'} [2024-08-06 00:55:15,424][52649] DAMAGECOUNT value on done: 148566.0 [2024-08-06 00:55:15,424][52649] Sum rewards: 57.783, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO2': '0.009', 'ARMOR': '0.016', 'AMMO4': '0.042', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.422', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:15,715][52650] Updated weights for policy 0, policy_version 26371 (0.0018) [2024-08-06 00:55:15,883][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:55:16,103][52670] DAMAGECOUNT value on done: 151400.0 [2024-08-06 00:55:16,118][52670] Sum rewards: 44.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.120', 'AMMO3': '0.179', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON4': '0.600', 'weapon4': '0.862', 'WEAPON3': '1.050', 'weapon3': '2.344', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '38.500'} [2024-08-06 00:55:17,148][52671] DAMAGECOUNT value on done: 154318.0 [2024-08-06 00:55:17,151][52671] Sum rewards: 63.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.140', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.362', 'weapon4': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:17,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 216064000. Throughput: 0: 4411.5. Samples: 54016040. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:55:17,795][52567] Avg episode reward: [(0, '56.415')] [2024-08-06 00:55:17,902][52663] DAMAGECOUNT value on done: 152326.0 [2024-08-06 00:55:17,904][52663] Sum rewards: 53.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.968', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'weapon4': '0.188', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.880', 'WEAPON3': '1.450', 'weapon3': '2.618', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:18,011][52665] DAMAGECOUNT value on done: 154115.0 [2024-08-06 00:55:18,012][52665] Sum rewards: 61.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.250', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.213', 'weapon4': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '53.000'} [2024-08-06 00:55:18,139][52795] DAMAGECOUNT value on done: 140876.0 [2024-08-06 00:55:18,140][52795] Sum rewards: 48.602, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'AMMO4': '0.261', 'weapon2': '0.544', 'WEAPON4': '0.550', 'weapon4': '0.654', 'WEAPON3': '1.400', 'weapon3': '2.380', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:18,493][52649] DAMAGECOUNT value on done: 154151.0 [2024-08-06 00:55:18,494][52649] Sum rewards: 61.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.017', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '51.000'} [2024-08-06 00:55:19,127][52670] DAMAGECOUNT value on done: 151221.0 [2024-08-06 00:55:19,129][52670] Sum rewards: 54.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.091', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon5': '0.214', 'AMMO4': '0.217', 'weapon2': '0.434', 'WEAPON4': '0.450', 'weapon4': '0.758', 'WEAPON3': '1.200', 'weapon3': '2.268', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:19,731][52659] DAMAGECOUNT value on done: 151217.0 [2024-08-06 00:55:19,732][52659] Sum rewards: 60.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.194', 'AMMO3': '0.228', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2024-08-06 00:55:19,888][52671] DAMAGECOUNT value on done: 151365.0 [2024-08-06 00:55:19,890][52671] Sum rewards: 64.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.233', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon5': '0.226', 'AMMO3': '0.250', 'weapon2': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.796', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '55.000'} [2024-08-06 00:55:20,318][52650] Updated weights for policy 0, policy_version 26381 (0.0014) [2024-08-06 00:55:21,071][52665] DAMAGECOUNT value on done: 148203.0 [2024-08-06 00:55:21,071][52665] Sum rewards: 55.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.469', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.026', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.294', 'weapon4': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:21,164][52663] DAMAGECOUNT value on done: 150436.0 [2024-08-06 00:55:21,164][52663] Sum rewards: 62.039, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.063', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon4': '0.312', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '54.000'} [2024-08-06 00:55:21,256][52795] DAMAGECOUNT value on done: 138651.0 [2024-08-06 00:55:21,258][52795] Sum rewards: 66.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.019', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'weapon4': '0.168', 'AMMO3': '0.180', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '56.000'} [2024-08-06 00:55:22,125][52670] DAMAGECOUNT value on done: 148862.0 [2024-08-06 00:55:22,126][52670] Sum rewards: 44.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.259', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon4': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.688', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '37.500'} [2024-08-06 00:55:22,363][52659] DAMAGECOUNT value on done: 150277.0 [2024-08-06 00:55:22,365][52659] Sum rewards: 58.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.936', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.052', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.470', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.184', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:22,445][52671] DAMAGECOUNT value on done: 150033.0 [2024-08-06 00:55:22,445][52671] Sum rewards: 52.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.274', 'ARMOR': '0.008', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon4': '0.230', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 216154112. Throughput: 0: 4403.6. Samples: 54042320. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 00:55:22,802][52567] Avg episode reward: [(0, '56.410')] [2024-08-06 00:55:24,196][52665] DAMAGECOUNT value on done: 144621.0 [2024-08-06 00:55:24,197][52665] Sum rewards: 53.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '3.080', 'weapon3': '3.084', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:24,405][52795] DAMAGECOUNT value on done: 140590.0 [2024-08-06 00:55:24,406][52795] Sum rewards: 61.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.210', 'weapon2': '0.732', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '53.000'} [2024-08-06 00:55:24,527][52663] DAMAGECOUNT value on done: 144454.0 [2024-08-06 00:55:24,530][52663] Sum rewards: 58.595, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.765', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.164', 'WEAPON4': '0.250', 'AMMO3': '0.292', 'weapon2': '0.488', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '55.000'} [2024-08-06 00:55:24,863][52650] Updated weights for policy 0, policy_version 26391 (0.0014) [2024-08-06 00:55:25,102][52670] DAMAGECOUNT value on done: 149060.0 [2024-08-06 00:55:25,104][52670] Sum rewards: 53.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.225', 'AMMO2': '0.022', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon4': '0.352', 'weapon2': '0.508', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2024-08-06 00:55:25,348][52659] DAMAGECOUNT value on done: 151450.0 [2024-08-06 00:55:25,348][52659] Sum rewards: 51.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.542', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'AMMO3': '0.232', 'weapon4': '0.478', 'WEAPON4': '0.500', 'weapon2': '0.832', 'WEAPON3': '1.450', 'weapon3': '2.344', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '45.000'} [2024-08-06 00:55:25,471][52671] DAMAGECOUNT value on done: 157289.0 [2024-08-06 00:55:25,472][52671] Sum rewards: 56.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.424', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.140', 'weapon4': '0.204', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.038', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '47.500'} [2024-08-06 00:55:26,786][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:55:26,891][52665] DAMAGECOUNT value on done: 146691.0 [2024-08-06 00:55:26,892][52665] Sum rewards: 58.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.573', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.084', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.374', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.298', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:27,528][52795] DAMAGECOUNT value on done: 138718.0 [2024-08-06 00:55:27,530][52795] Sum rewards: 56.189, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.306', 'weapon2': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:27,758][52663] DAMAGECOUNT value on done: 147789.0 [2024-08-06 00:55:27,758][52663] Sum rewards: 54.940, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.451', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.192', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.790', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:27,759][52659] DAMAGECOUNT value on done: 153061.0 [2024-08-06 00:55:27,760][52659] Sum rewards: 55.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO3': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'weapon5': '0.270', 'weapon4': '0.430', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon2': '1.160', 'weapon3': '1.892', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 216244224. Throughput: 0: 4392.2. Samples: 54068390. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:55:27,795][52567] Avg episode reward: [(0, '56.283')] [2024-08-06 00:55:27,877][52671] DAMAGECOUNT value on done: 151238.0 [2024-08-06 00:55:27,877][52671] Sum rewards: 46.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.478', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.061', 'AMMO3': '0.168', 'weapon5': '0.260', 'AMMO4': '0.303', 'WEAPON5': '0.350', 'weapon2': '0.414', 'weapon4': '0.490', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.518', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '41.000'} [2024-08-06 00:55:29,367][52665] DAMAGECOUNT value on done: 148474.0 [2024-08-06 00:55:29,368][52665] Sum rewards: 61.710, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.015', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon2': '0.440', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.168', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '48.500'} [2024-08-06 00:55:29,722][52650] Updated weights for policy 0, policy_version 26401 (0.0013) [2024-08-06 00:55:30,419][52663] DAMAGECOUNT value on done: 153420.0 [2024-08-06 00:55:30,419][52663] Sum rewards: 66.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'AMMO5': '0.007', 'AMMO2': '0.055', 'weapon5': '0.146', 'AMMO3': '0.205', 'weapon4': '0.214', 'WEAPON5': '0.250', 'AMMO4': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '55.000'} [2024-08-06 00:55:30,631][52795] DAMAGECOUNT value on done: 138038.0 [2024-08-06 00:55:30,632][52795] Sum rewards: 51.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'weapon7': '0.056', 'AMMO2': '0.063', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'AMMO4': '0.313', 'weapon2': '0.474', 'WEAPON4': '0.600', 'weapon4': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.400', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '44.000'} [2024-08-06 00:55:31,215][52659] DAMAGECOUNT value on done: 150599.0 [2024-08-06 00:55:31,215][52659] Sum rewards: 58.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:31,353][52671] DAMAGECOUNT value on done: 145560.0 [2024-08-06 00:55:31,354][52671] Sum rewards: 60.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.120', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.732', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:32,337][52665] DAMAGECOUNT value on done: 148877.0 [2024-08-06 00:55:32,337][52665] Sum rewards: 54.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.622', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO3': '0.163', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 216326144. Throughput: 0: 4388.4. Samples: 54081640. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:55:32,794][52567] Avg episode reward: [(0, '56.493')] [2024-08-06 00:55:32,970][52663] DAMAGECOUNT value on done: 152895.0 [2024-08-06 00:55:32,972][52663] Sum rewards: 53.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.245', 'weapon2': '0.366', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.436', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:33,741][52795] DAMAGECOUNT value on done: 138255.0 [2024-08-06 00:55:33,742][52795] Sum rewards: 67.632, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.488', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.632', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '54.000'} [2024-08-06 00:55:34,125][52650] Updated weights for policy 0, policy_version 26411 (0.0038) [2024-08-06 00:55:34,413][52659] DAMAGECOUNT value on done: 149914.0 [2024-08-06 00:55:34,414][52659] Sum rewards: 58.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.214', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.288', 'weapon4': '0.302', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.142', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:34,471][52671] DAMAGECOUNT value on done: 155208.0 [2024-08-06 00:55:34,471][52671] Sum rewards: 63.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.438', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.077', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.428', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '55.000'} [2024-08-06 00:55:35,446][52665] DAMAGECOUNT value on done: 151803.0 [2024-08-06 00:55:35,447][52665] Sum rewards: 56.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.281', 'ARMOR': '0.008', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.205', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:36,364][52663] DAMAGECOUNT value on done: 154143.0 [2024-08-06 00:55:36,365][52663] Sum rewards: 53.242, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.239', 'weapon2': '0.348', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:36,392][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:55:37,041][52795] DAMAGECOUNT value on done: 138327.0 [2024-08-06 00:55:37,041][52795] Sum rewards: 56.187, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.703', 'AMMO5': '0.003', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO2': '0.051', 'AMMO3': '0.219', 'AMMO4': '0.254', 'weapon4': '0.422', 'WEAPON4': '0.450', 'weapon2': '0.602', 'WEAPON3': '1.450', 'weapon3': '2.760', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:37,185][52659] DAMAGECOUNT value on done: 151922.0 [2024-08-06 00:55:37,185][52659] Sum rewards: 58.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.725', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '51.000'} [2024-08-06 00:55:37,285][52671] DAMAGECOUNT value on done: 152241.0 [2024-08-06 00:55:37,288][52671] Sum rewards: 58.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.382', 'ARMOR': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.182', 'AMMO4': '0.308', 'weapon2': '0.424', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 216416256. Throughput: 0: 4385.3. Samples: 54107940. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:55:37,794][52567] Avg episode reward: [(0, '56.625')] [2024-08-06 00:55:38,812][52665] DAMAGECOUNT value on done: 154973.0 [2024-08-06 00:55:38,813][52665] Sum rewards: 54.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.214', 'WEAPON4': '0.400', 'weapon4': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:38,929][52650] Updated weights for policy 0, policy_version 26421 (0.0013) [2024-08-06 00:55:39,471][52663] DAMAGECOUNT value on done: 153588.0 [2024-08-06 00:55:39,472][52663] Sum rewards: 60.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.055', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.034', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:39,988][52659] DAMAGECOUNT value on done: 147159.0 [2024-08-06 00:55:39,989][52659] Sum rewards: 62.935, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.034', 'AMMO4': '0.078', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.332', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '53.000'} [2024-08-06 00:55:40,059][52671] DAMAGECOUNT value on done: 153311.0 [2024-08-06 00:55:40,060][52671] Sum rewards: 61.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.578', 'weapon4': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.516', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:40,082][52795] DAMAGECOUNT value on done: 136644.0 [2024-08-06 00:55:40,083][52795] Sum rewards: 56.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.232', 'weapon4': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:41,978][52665] DAMAGECOUNT value on done: 149617.0 [2024-08-06 00:55:41,978][52665] Sum rewards: 51.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.812', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '42.000'} [2024-08-06 00:55:42,459][52663] DAMAGECOUNT value on done: 151863.0 [2024-08-06 00:55:42,459][52663] Sum rewards: 39.625, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.315', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.228', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.830', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '37.000'} [2024-08-06 00:55:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 216506368. Throughput: 0: 4390.2. Samples: 54134300. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 00:55:42,802][52567] Avg episode reward: [(0, '56.550')] [2024-08-06 00:55:42,942][52659] DAMAGECOUNT value on done: 153247.0 [2024-08-06 00:55:42,942][52659] Sum rewards: 68.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.227', 'weapon2': '0.378', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.468', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '58.000'} [2024-08-06 00:55:43,084][52671] DAMAGECOUNT value on done: 154035.0 [2024-08-06 00:55:43,084][52671] Sum rewards: 59.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.037', 'weapon5': '0.186', 'AMMO4': '0.187', 'AMMO3': '0.191', 'weapon2': '0.310', 'weapon4': '0.466', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:43,258][52795] DAMAGECOUNT value on done: 143162.0 [2024-08-06 00:55:43,259][52795] Sum rewards: 60.983, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.664', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.211', 'weapon5': '0.212', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:43,745][52650] Updated weights for policy 0, policy_version 26431 (0.0011) [2024-08-06 00:55:44,774][52665] DAMAGECOUNT value on done: 152354.0 [2024-08-06 00:55:44,774][52665] Sum rewards: 55.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.098', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon4': '0.304', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '49.000'} [2024-08-06 00:55:45,224][52663] DAMAGECOUNT value on done: 149610.0 [2024-08-06 00:55:45,226][52663] Sum rewards: 64.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.550', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.228', 'weapon2': '0.456', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '50.500'} [2024-08-06 00:55:45,732][52659] DAMAGECOUNT value on done: 154217.0 [2024-08-06 00:55:45,734][52659] Sum rewards: 57.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.445', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.232', 'weapon2': '0.586', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.110', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:45,793][52671] DAMAGECOUNT value on done: 151714.0 [2024-08-06 00:55:45,795][52671] Sum rewards: 56.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.011', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.242', 'weapon4': '0.362', 'WEAPON4': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '49.000'} [2024-08-06 00:55:46,485][52795] DAMAGECOUNT value on done: 141956.0 [2024-08-06 00:55:46,486][52795] Sum rewards: 55.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.338', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.228', 'weapon4': '0.368', 'WEAPON4': '0.550', 'weapon2': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.588', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '48.500'} [2024-08-06 00:55:47,585][52665] DAMAGECOUNT value on done: 152010.0 [2024-08-06 00:55:47,587][52665] Sum rewards: 54.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.357', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.148', 'AMMO4': '0.266', 'weapon5': '0.290', 'WEAPON5': '0.400', 'weapon2': '0.454', 'weapon4': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.408', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 216596480. Throughput: 0: 4398.4. Samples: 54147710. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 00:55:47,794][52567] Avg episode reward: [(0, '57.014')] [2024-08-06 00:55:48,249][52650] Updated weights for policy 0, policy_version 26441 (0.0023) [2024-08-06 00:55:48,862][52659] DAMAGECOUNT value on done: 149937.0 [2024-08-06 00:55:48,863][52659] Sum rewards: 48.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.102', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.482', 'weapon2': '0.564', 'WEAPON3': '1.450', 'weapon3': '2.624', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '44.500'} [2024-08-06 00:55:49,559][52795] DAMAGECOUNT value on done: 136354.0 [2024-08-06 00:55:49,559][52795] Sum rewards: 53.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.728', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.542', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '46.000'} [2024-08-06 00:55:50,735][52665] DAMAGECOUNT value on done: 148464.0 [2024-08-06 00:55:50,738][52665] Sum rewards: 49.673, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.150', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.294', 'WEAPON4': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.660', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '45.000'} [2024-08-06 00:55:51,811][52659] DAMAGECOUNT value on done: 146094.0 [2024-08-06 00:55:51,813][52659] Sum rewards: 57.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '50.000'} [2024-08-06 00:55:52,700][52795] DAMAGECOUNT value on done: 143250.0 [2024-08-06 00:55:52,702][52795] Sum rewards: 59.477, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.835', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.164', 'AMMO3': '0.208', 'AMMO4': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.430', 'weapon4': '0.512', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.628', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '54.000'} [2024-08-06 00:55:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 216678400. Throughput: 0: 4392.2. Samples: 54174080. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 00:55:52,794][52567] Avg episode reward: [(0, '56.900')] [2024-08-06 00:55:52,954][52650] Updated weights for policy 0, policy_version 26451 (0.0013) [2024-08-06 00:55:53,558][52665] DAMAGECOUNT value on done: 149112.0 [2024-08-06 00:55:53,559][52665] Sum rewards: 55.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.818', 'AMMO5': '0.003', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon2': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon4': '0.914', 'WEAPON3': '1.550', 'weapon3': '2.586', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '48.000'} [2024-08-06 00:55:54,352][52659] DAMAGECOUNT value on done: 146399.0 [2024-08-06 00:55:54,353][52659] Sum rewards: 61.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.036', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO4': '0.179', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.644', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '52.000'} [2024-08-06 00:55:55,385][52647] DAMAGECOUNT value on done: 160835.0 [2024-08-06 00:55:55,387][52647] Sum rewards: 53.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.234', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.165', 'AMMO3': '0.176', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.746', 'WEAPON3': '1.100', 'weapon3': '2.566', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:55,792][52795] DAMAGECOUNT value on done: 143062.0 [2024-08-06 00:55:55,794][52795] Sum rewards: 54.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.955', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.276', 'weapon2': '0.360', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.162', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '49.000'} [2024-08-06 00:55:56,590][52665] DAMAGECOUNT value on done: 148961.0 [2024-08-06 00:55:56,592][52665] Sum rewards: 47.391, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.367', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.111', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON3': '0.750', 'weapon2': '1.322', 'weapon3': '2.394', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.470', 'FRAGCOUNT': '38.000'} [2024-08-06 00:55:57,285][52659] DAMAGECOUNT value on done: 151482.0 [2024-08-06 00:55:57,286][52659] Sum rewards: 47.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.783', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon7': '0.056', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.185', 'WEAPON7': '0.200', 'weapon2': '0.440', 'WEAPON4': '0.450', 'weapon4': '0.864', 'WEAPON3': '1.150', 'weapon3': '2.368', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '11.931', 'FRAGCOUNT': '41.000'} [2024-08-06 00:55:57,639][52650] Updated weights for policy 0, policy_version 26461 (0.0012) [2024-08-06 00:55:57,779][52647] DAMAGECOUNT value on done: 159556.0 [2024-08-06 00:55:57,781][52647] Sum rewards: 55.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.335', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.570', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.192', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '47.000'} [2024-08-06 00:55:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 216768512. Throughput: 0: 4391.5. Samples: 54200310. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 00:55:57,802][52567] Avg episode reward: [(0, '56.479')] [2024-08-06 00:55:59,498][52665] DAMAGECOUNT value on done: 148511.0 [2024-08-06 00:55:59,498][52665] Sum rewards: 49.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.064', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.052', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.590', 'WEAPON4': '0.600', 'weapon4': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.422', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '44.000'} [2024-08-06 00:55:59,910][52659] DAMAGECOUNT value on done: 151486.0 [2024-08-06 00:55:59,911][52659] Sum rewards: 62.897, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.350', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.114', 'AMMO3': '0.163', 'weapon2': '0.668', 'WEAPON3': '1.000', 'weapon3': '3.100', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:00,803][52647] DAMAGECOUNT value on done: 162203.0 [2024-08-06 00:56:00,803][52647] Sum rewards: 52.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.252', 'AMMO5': '0.007', 'AMMO2': '0.068', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'AMMO4': '0.341', 'ARMOR': '0.400', 'weapon2': '0.476', 'weapon4': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '44.000'} [2024-08-06 00:56:02,381][52650] Updated weights for policy 0, policy_version 26471 (0.0012) [2024-08-06 00:56:02,729][52665] DAMAGECOUNT value on done: 149249.0 [2024-08-06 00:56:02,729][52665] Sum rewards: 54.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.579', 'AMMO5': '0.013', 'ARMOR': '0.016', 'weapon5': '0.034', 'AMMO2': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.268', 'weapon4': '0.502', 'WEAPON4': '0.550', 'weapon2': '0.794', 'WEAPON3': '1.050', 'weapon3': '2.486', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '47.500'} [2024-08-06 00:56:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 216858624. Throughput: 0: 4393.4. Samples: 54213740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:56:02,794][52567] Avg episode reward: [(0, '56.257')] [2024-08-06 00:56:02,956][52659] DAMAGECOUNT value on done: 155567.0 [2024-08-06 00:56:02,957][52659] Sum rewards: 58.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.241', 'weapon2': '0.358', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.406', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '51.000'} [2024-08-06 00:56:03,667][52647] DAMAGECOUNT value on done: 161965.0 [2024-08-06 00:56:03,669][52647] Sum rewards: 58.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.005', 'AMMO2': '0.028', 'weapon4': '0.132', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.296', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.378', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:03,883][52664] DAMAGECOUNT value on done: 157864.0 [2024-08-06 00:56:03,885][52664] Sum rewards: 50.973, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.456', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.203', 'weapon4': '0.448', 'weapon2': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.554', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '44.000'} [2024-08-06 00:56:05,206][52820] DAMAGECOUNT value on done: 139238.0 [2024-08-06 00:56:05,206][52820] Sum rewards: 46.657, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.898', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.296', 'AMMO3': '0.357', 'WEAPON4': '0.400', 'weapon4': '0.568', 'WEAPON3': '2.000', 'weapon3': '2.674', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:05,242][52665] DAMAGECOUNT value on done: 144754.0 [2024-08-06 00:56:05,243][52665] Sum rewards: 61.686, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.505', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.400', 'weapon4': '0.440', 'weapon2': '0.542', 'WEAPON3': '1.600', 'weapon3': '2.622', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '55.000'} [2024-08-06 00:56:05,750][52659] DAMAGECOUNT value on done: 154919.0 [2024-08-06 00:56:05,751][52659] Sum rewards: 69.601, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.090', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon2': '0.176', 'AMMO3': '0.276', 'WEAPON3': '1.750', 'weapon3': '3.526', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '61.000'} [2024-08-06 00:56:06,776][52647] DAMAGECOUNT value on done: 162306.0 [2024-08-06 00:56:06,776][52647] Sum rewards: 54.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.403', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.048', 'weapon5': '0.108', 'AMMO3': '0.170', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'weapon4': '0.376', 'weapon2': '0.404', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:06,988][52664] DAMAGECOUNT value on done: 158048.0 [2024-08-06 00:56:06,989][52664] Sum rewards: 53.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.128', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.230', 'AMMO3': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:07,158][52650] Updated weights for policy 0, policy_version 26481 (0.0039) [2024-08-06 00:56:07,290][52614] Signal inference workers to stop experience collection... (4900 times) [2024-08-06 00:56:07,300][52614] Signal inference workers to resume experience collection... (4900 times) [2024-08-06 00:56:07,373][52650] InferenceWorker_p0-w0: stopping experience collection (4900 times) [2024-08-06 00:56:07,377][52650] InferenceWorker_p0-w0: resuming experience collection (4900 times) [2024-08-06 00:56:07,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17578.2). Total num frames: 216948736. Throughput: 0: 4386.2. Samples: 54239700. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:56:07,794][52567] Avg episode reward: [(0, '56.453')] [2024-08-06 00:56:08,137][52665] DAMAGECOUNT value on done: 148279.0 [2024-08-06 00:56:08,138][52665] Sum rewards: 52.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.388', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.102', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '2.954', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:08,465][52820] DAMAGECOUNT value on done: 140900.0 [2024-08-06 00:56:08,466][52820] Sum rewards: 38.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.680', 'AMMO5': '0.018', 'ARMOR': '0.024', 'AMMO2': '0.067', 'weapon5': '0.180', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'AMMO4': '0.333', 'weapon2': '0.412', 'weapon4': '0.658', 'WEAPON4': '0.850', 'WEAPON3': '1.150', 'weapon3': '2.436', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '10.872', 'FRAGCOUNT': '38.000'} [2024-08-06 00:56:08,833][52659] DAMAGECOUNT value on done: 151225.0 [2024-08-06 00:56:08,833][52659] Sum rewards: 62.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.944', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.226', 'weapon2': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:09,714][52647] DAMAGECOUNT value on done: 162781.0 [2024-08-06 00:56:09,715][52647] Sum rewards: 60.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.229', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.416', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '51.000'} [2024-08-06 00:56:09,732][52668] DAMAGECOUNT value on done: 150236.0 [2024-08-06 00:56:09,734][52668] Sum rewards: 53.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.664', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:10,005][52664] DAMAGECOUNT value on done: 159121.0 [2024-08-06 00:56:10,006][52664] Sum rewards: 56.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.940', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.858', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:10,868][52665] DAMAGECOUNT value on done: 147958.0 [2024-08-06 00:56:10,868][52665] Sum rewards: 53.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.755', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO3': '0.160', 'AMMO4': '0.197', 'WEAPON5': '0.300', 'weapon4': '0.318', 'weapon2': '0.326', 'weapon5': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.758', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '43.000'} [2024-08-06 00:56:11,548][52650] Updated weights for policy 0, policy_version 26491 (0.0014) [2024-08-06 00:56:11,680][52820] DAMAGECOUNT value on done: 138883.0 [2024-08-06 00:56:11,683][52820] Sum rewards: 66.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.041', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.199', 'weapon2': '0.256', 'WEAPON3': '1.250', 'HITCOUNT': '3.350', 'weapon3': '3.586', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '55.000'} [2024-08-06 00:56:11,701][52659] DAMAGECOUNT value on done: 156319.0 [2024-08-06 00:56:11,701][52659] Sum rewards: 66.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.746', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.024', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '55.000'} [2024-08-06 00:56:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 217030656. Throughput: 0: 4393.1. Samples: 54266080. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:56:12,794][52567] Avg episode reward: [(0, '56.338')] [2024-08-06 00:56:12,883][52647] DAMAGECOUNT value on done: 159160.0 [2024-08-06 00:56:12,884][52647] Sum rewards: 67.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.228', 'AMMO3': '0.236', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '58.000'} [2024-08-06 00:56:12,978][52668] DAMAGECOUNT value on done: 159330.0 [2024-08-06 00:56:12,980][52668] Sum rewards: 53.269, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.034', 'AMMO4': '0.059', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.622', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:13,232][52664] DAMAGECOUNT value on done: 156258.0 [2024-08-06 00:56:13,232][52664] Sum rewards: 48.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.286', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.862', 'WEAPON3': '1.150', 'weapon3': '2.496', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '42.000'} [2024-08-06 00:56:13,318][52820] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2024-08-06 00:56:14,638][52659] DAMAGECOUNT value on done: 155419.0 [2024-08-06 00:56:14,638][52659] Sum rewards: 57.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.514', 'weapon4': '0.712', 'WEAPON3': '1.300', 'weapon3': '2.458', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:14,757][52820] DAMAGECOUNT value on done: 134738.0 [2024-08-06 00:56:14,760][52820] Sum rewards: 63.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon2': '0.622', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.158', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:14,830][52662] DAMAGECOUNT value on done: 155751.0 [2024-08-06 00:56:14,832][52662] Sum rewards: 47.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.744', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.054', 'AMMO3': '0.193', 'AMMO4': '0.272', 'weapon5': '0.296', 'weapon2': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.944', 'WEAPON3': '1.100', 'weapon3': '1.976', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.096', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:15,689][52647] DAMAGECOUNT value on done: 161538.0 [2024-08-06 00:56:15,691][52647] Sum rewards: 56.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.152', 'AMMO3': '0.160', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.734', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:16,000][52664] DAMAGECOUNT value on done: 156633.0 [2024-08-06 00:56:16,002][52664] Sum rewards: 65.624, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.050', 'HEALTH': '0.140', 'AMMO3': '0.158', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.498', 'WEAPON3': '0.950', 'weapon2': '0.964', 'weapon3': '2.304', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:16,204][52668] DAMAGECOUNT value on done: 153252.0 [2024-08-06 00:56:16,207][52668] Sum rewards: 47.509, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.521', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.237', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.500', 'weapon3': '2.916', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '43.000'} [2024-08-06 00:56:16,426][52803] DAMAGECOUNT value on done: 142102.0 [2024-08-06 00:56:16,427][52803] Sum rewards: 56.636, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.326', 'ARMOR': '0.004', 'weapon7': '0.006', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.202', 'weapon4': '0.226', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.244', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:16,521][52650] Updated weights for policy 0, policy_version 26501 (0.0024) [2024-08-06 00:56:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 217120768. Throughput: 0: 4390.2. Samples: 54279200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 00:56:17,802][52567] Avg episode reward: [(0, '56.513')] [2024-08-06 00:56:17,926][52820] DAMAGECOUNT value on done: 142289.0 [2024-08-06 00:56:17,927][52820] Sum rewards: 63.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.802', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.160', 'weapon2': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'weapon4': '0.688', 'WEAPON3': '1.350', 'weapon3': '2.580', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:17,932][52662] DAMAGECOUNT value on done: 160361.0 [2024-08-06 00:56:17,934][52662] Sum rewards: 61.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.804', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'AMMO4': '0.203', 'WEAPON4': '0.400', 'weapon2': '0.538', 'weapon4': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.562', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:18,095][52647] DAMAGECOUNT value on done: 164075.0 [2024-08-06 00:56:18,095][52647] Sum rewards: 60.460, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.782', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'weapon4': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '2.672', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:18,388][52664] DAMAGECOUNT value on done: 161384.0 [2024-08-06 00:56:18,390][52664] Sum rewards: 65.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.948', 'AMMO5': '0.011', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.065', 'weapon5': '0.080', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.368', 'weapon4': '0.436', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 00:56:18,693][52668] DAMAGECOUNT value on done: 152058.0 [2024-08-06 00:56:18,694][52668] Sum rewards: 45.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.065', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.288', 'weapon2': '0.458', 'WEAPON4': '0.600', 'weapon4': '0.692', 'WEAPON3': '1.350', 'weapon3': '2.502', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:19,575][52803] DAMAGECOUNT value on done: 147242.0 [2024-08-06 00:56:19,575][52803] Sum rewards: 57.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon4': '0.302', 'WEAPON4': '0.450', 'weapon2': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:20,663][52647] DAMAGECOUNT value on done: 159103.0 [2024-08-06 00:56:20,664][52647] Sum rewards: 54.043, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.242', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.982', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '48.500'} [2024-08-06 00:56:20,947][52662] DAMAGECOUNT value on done: 160290.0 [2024-08-06 00:56:20,950][52662] Sum rewards: 54.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.372', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.027', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:20,967][52820] DAMAGECOUNT value on done: 140651.0 [2024-08-06 00:56:20,968][52820] Sum rewards: 73.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.005', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.232', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '64.000'} [2024-08-06 00:56:21,026][52664] DAMAGECOUNT value on done: 161693.0 [2024-08-06 00:56:21,028][52664] Sum rewards: 61.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.066', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.280', 'WEAPON3': '1.100', 'weapon3': '3.230', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:21,161][52650] Updated weights for policy 0, policy_version 26511 (0.0016) [2024-08-06 00:56:21,505][52668] DAMAGECOUNT value on done: 151497.0 [2024-08-06 00:56:21,505][52668] Sum rewards: 57.273, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.485', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.090', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:22,237][52811] DAMAGECOUNT value on done: 152054.0 [2024-08-06 00:56:22,240][52811] Sum rewards: 65.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.374', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.684', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:22,515][52803] DAMAGECOUNT value on done: 142696.0 [2024-08-06 00:56:22,517][52803] Sum rewards: 54.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.490', 'AMMO2': '0.032', 'AMMO3': '0.147', 'AMMO4': '0.159', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.648', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 217210880. Throughput: 0: 4396.0. Samples: 54305760. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:56:22,794][52567] Avg episode reward: [(0, '56.844')] [2024-08-06 00:56:23,101][52647] DAMAGECOUNT value on done: 158251.0 [2024-08-06 00:56:23,102][52647] Sum rewards: 57.873, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.126', 'AMMO5': '0.004', 'weapon5': '0.030', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.362', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:23,371][52662] DAMAGECOUNT value on done: 151260.0 [2024-08-06 00:56:23,373][52662] Sum rewards: 62.440, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.029', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.264', 'weapon2': '0.268', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '57.000'} [2024-08-06 00:56:23,494][52664] DAMAGECOUNT value on done: 152166.0 [2024-08-06 00:56:23,495][52664] Sum rewards: 59.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.486', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.202', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '51.000'} [2024-08-06 00:56:24,160][52820] DAMAGECOUNT value on done: 140823.0 [2024-08-06 00:56:24,162][52820] Sum rewards: 56.705, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:24,504][52660] DAMAGECOUNT value on done: 149921.0 [2024-08-06 00:56:24,504][52660] Sum rewards: 68.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.748', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.892', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '57.000'} [2024-08-06 00:56:25,028][52668] DAMAGECOUNT value on done: 149799.0 [2024-08-06 00:56:25,028][52668] Sum rewards: 60.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.888', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.154', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'weapon4': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.648', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '51.000'} [2024-08-06 00:56:25,381][52811] DAMAGECOUNT value on done: 140416.0 [2024-08-06 00:56:25,381][52811] Sum rewards: 66.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.016', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO4': '0.179', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.374', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '58.000'} [2024-08-06 00:56:25,387][52647] DAMAGECOUNT value on done: 157135.0 [2024-08-06 00:56:25,388][52647] Sum rewards: 66.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.092', 'AMMO4': '0.134', 'AMMO3': '0.286', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '1.700', 'weapon3': '2.736', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '58.000'} [2024-08-06 00:56:25,600][52650] Updated weights for policy 0, policy_version 26521 (0.0012) [2024-08-06 00:56:25,667][52803] DAMAGECOUNT value on done: 142831.0 [2024-08-06 00:56:25,668][52803] Sum rewards: 65.823, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.660', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.116', 'AMMO3': '0.199', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.526', 'weapon4': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.502', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '58.000'} [2024-08-06 00:56:25,899][52664] DAMAGECOUNT value on done: 167317.0 [2024-08-06 00:56:25,899][52664] Sum rewards: 53.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.556', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.492', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:26,204][52662] DAMAGECOUNT value on done: 157379.0 [2024-08-06 00:56:26,204][52662] Sum rewards: 57.596, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.052', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon5': '0.242', 'weapon4': '0.316', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.488', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:27,364][52820] DAMAGECOUNT value on done: 142599.0 [2024-08-06 00:56:27,366][52820] Sum rewards: 65.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.378', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon4': '0.308', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '55.000'} [2024-08-06 00:56:27,451][52660] DAMAGECOUNT value on done: 153569.0 [2024-08-06 00:56:27,453][52660] Sum rewards: 60.532, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.580', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 217292800. Throughput: 0: 4391.1. Samples: 54331900. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:56:27,794][52567] Avg episode reward: [(0, '57.674')] [2024-08-06 00:56:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026525_217292800.pth... [2024-08-06 00:56:27,965][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026011_213082112.pth [2024-08-06 00:56:28,066][52668] DAMAGECOUNT value on done: 153731.0 [2024-08-06 00:56:28,069][52668] Sum rewards: 53.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.582', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.170', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.514', 'weapon2': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.464', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:28,381][52647] DAMAGECOUNT value on done: 160105.0 [2024-08-06 00:56:28,382][52647] Sum rewards: 52.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.364', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '42.000'} [2024-08-06 00:56:28,406][52811] DAMAGECOUNT value on done: 143679.0 [2024-08-06 00:56:28,406][52811] Sum rewards: 61.632, reward structure: {'DEATHCOUNT': '-16.500', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.082', 'weapon4': '0.166', 'WEAPON4': '0.200', 'HEALTH': '0.212', 'AMMO3': '0.248', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:28,641][52803] DAMAGECOUNT value on done: 147995.0 [2024-08-06 00:56:28,641][52803] Sum rewards: 57.495, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.510', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.135', 'weapon5': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.706', 'weapon4': '0.814', 'WEAPON3': '0.950', 'weapon3': '1.856', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:28,823][52664] DAMAGECOUNT value on done: 162243.0 [2024-08-06 00:56:28,824][52664] Sum rewards: 62.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.960', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.036', 'weapon5': '0.110', 'AMMO3': '0.159', 'AMMO4': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON4': '0.500', 'weapon4': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.540', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:29,023][52662] DAMAGECOUNT value on done: 155202.0 [2024-08-06 00:56:29,024][52662] Sum rewards: 46.026, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.282', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.053', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'AMMO4': '0.267', 'weapon2': '0.372', 'weapon4': '0.472', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.756', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '42.500'} [2024-08-06 00:56:30,186][52650] Updated weights for policy 0, policy_version 26531 (0.0062) [2024-08-06 00:56:30,488][52660] DAMAGECOUNT value on done: 152857.0 [2024-08-06 00:56:30,488][52660] Sum rewards: 52.648, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'AMMO2': '0.029', 'AMMO3': '0.139', 'AMMO4': '0.145', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.688', 'WEAPON3': '0.850', 'weapon3': '2.918', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:30,651][52820] DAMAGECOUNT value on done: 139228.0 [2024-08-06 00:56:30,654][52820] Sum rewards: 55.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.784', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:30,932][52647] DAMAGECOUNT value on done: 156659.0 [2024-08-06 00:56:30,932][52647] Sum rewards: 54.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.057', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.194', 'AMMO3': '0.233', 'weapon2': '0.706', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:31,147][52668] DAMAGECOUNT value on done: 157844.0 [2024-08-06 00:56:31,147][52668] Sum rewards: 60.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.257', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.020', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon4': '0.326', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '51.000'} [2024-08-06 00:56:31,483][52664] DAMAGECOUNT value on done: 161572.0 [2024-08-06 00:56:31,483][52664] Sum rewards: 60.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.043', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:31,488][52811] DAMAGECOUNT value on done: 141934.0 [2024-08-06 00:56:31,489][52811] Sum rewards: 46.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.503', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon4': '0.112', 'AMMO4': '0.154', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '3.440', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '39.000'} [2024-08-06 00:56:31,760][52803] DAMAGECOUNT value on done: 142144.0 [2024-08-06 00:56:31,763][52803] Sum rewards: 54.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.152', 'weapon5': '0.198', 'WEAPON5': '0.250', 'AMMO4': '0.272', 'weapon2': '0.636', 'WEAPON4': '0.650', 'weapon4': '0.936', 'WEAPON3': '0.950', 'weapon3': '1.974', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:32,116][52662] DAMAGECOUNT value on done: 156289.0 [2024-08-06 00:56:32,116][52662] Sum rewards: 48.307, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.926', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon4': '0.424', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '42.000'} [2024-08-06 00:56:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 217382912. Throughput: 0: 4375.8. Samples: 54344620. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 00:56:32,795][52567] Avg episode reward: [(0, '57.139')] [2024-08-06 00:56:33,109][52794] DAMAGECOUNT value on done: 159206.0 [2024-08-06 00:56:33,109][52794] Sum rewards: 58.783, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.852', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.086', 'AMMO3': '0.158', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.588', 'weapon4': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.508', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:33,464][52647] DAMAGECOUNT value on done: 159080.0 [2024-08-06 00:56:33,465][52647] Sum rewards: 61.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:33,531][52660] DAMAGECOUNT value on done: 153311.0 [2024-08-06 00:56:33,532][52660] Sum rewards: 56.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.653', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.048', 'AMMO3': '0.158', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.434', 'WEAPON4': '0.450', 'weapon2': '0.756', 'WEAPON3': '0.900', 'weapon3': '2.540', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:33,691][52820] DAMAGECOUNT value on done: 143890.0 [2024-08-06 00:56:33,692][52820] Sum rewards: 47.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.218', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.474', 'weapon4': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.570', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '43.000'} [2024-08-06 00:56:34,021][52664] DAMAGECOUNT value on done: 157013.0 [2024-08-06 00:56:34,021][52664] Sum rewards: 49.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:34,356][52668] DAMAGECOUNT value on done: 153523.0 [2024-08-06 00:56:34,358][52668] Sum rewards: 50.529, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.208', 'HEALTH': '0.380', 'weapon2': '0.562', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.068', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '43.000'} [2024-08-06 00:56:34,654][52811] DAMAGECOUNT value on done: 143167.0 [2024-08-06 00:56:34,654][52811] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-15.000', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.160', 'HEALTH': '0.176', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:34,999][52650] Updated weights for policy 0, policy_version 26541 (0.0021) [2024-08-06 00:56:35,118][52803] DAMAGECOUNT value on done: 146674.0 [2024-08-06 00:56:35,118][52803] Sum rewards: 50.203, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.427', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.050', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.228', 'weapon2': '0.362', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:35,163][52662] DAMAGECOUNT value on done: 162797.0 [2024-08-06 00:56:35,163][52662] Sum rewards: 54.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.288', 'AMMO5': '0.003', 'ARMOR': '0.024', 'weapon5': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'weapon4': '0.218', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.184', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:35,750][52647] DAMAGECOUNT value on done: 161548.0 [2024-08-06 00:56:35,750][52647] Sum rewards: 58.133, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.765', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.230', 'weapon2': '0.430', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:36,203][52794] DAMAGECOUNT value on done: 158958.0 [2024-08-06 00:56:36,203][52794] Sum rewards: 55.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:36,402][52660] DAMAGECOUNT value on done: 152302.0 [2024-08-06 00:56:36,404][52660] Sum rewards: 78.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.865', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.214', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '66.000'} [2024-08-06 00:56:36,410][52664] DAMAGECOUNT value on done: 155656.0 [2024-08-06 00:56:36,412][52664] Sum rewards: 52.791, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.656', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.230', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '3.338', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:36,743][52820] DAMAGECOUNT value on done: 143220.0 [2024-08-06 00:56:36,746][52820] Sum rewards: 50.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.711', 'ARMOR': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon4': '0.356', 'weapon2': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.886', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:36,819][52667] DAMAGECOUNT value on done: 153821.0 [2024-08-06 00:56:36,821][52667] Sum rewards: 52.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.013', 'AMMO2': '0.057', 'AMMO3': '0.150', 'AMMO4': '0.283', 'weapon5': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON4': '0.600', 'weapon4': '0.850', 'WEAPON3': '0.900', 'weapon3': '2.116', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:36,974][52668] DAMAGECOUNT value on done: 156127.0 [2024-08-06 00:56:36,976][52668] Sum rewards: 67.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.651', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.220', 'weapon2': '0.288', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '57.000'} [2024-08-06 00:56:37,711][52811] DAMAGECOUNT value on done: 147444.0 [2024-08-06 00:56:37,712][52811] Sum rewards: 62.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.111', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO3': '0.136', 'weapon5': '0.150', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.568', 'WEAPON3': '0.850', 'weapon3': '2.710', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 217473024. Throughput: 0: 4380.9. Samples: 54371220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:56:37,794][52567] Avg episode reward: [(0, '57.020')] [2024-08-06 00:56:38,147][52803] DAMAGECOUNT value on done: 140374.0 [2024-08-06 00:56:38,151][52647] DAMAGECOUNT value on done: 157085.0 [2024-08-06 00:56:38,155][52803] Sum rewards: 60.332, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'HEALTH': '0.254', 'weapon2': '0.638', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '3.124', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:38,155][52647] Sum rewards: 55.727, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.025', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.250', 'weapon2': '0.308', 'AMMO3': '0.326', 'weapon4': '0.398', 'WEAPON3': '1.850', 'weapon3': '3.038', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:38,323][52662] DAMAGECOUNT value on done: 156389.0 [2024-08-06 00:56:38,325][52662] Sum rewards: 54.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.045', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.414', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '2.922', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:38,865][52660] DAMAGECOUNT value on done: 150828.0 [2024-08-06 00:56:38,867][52660] Sum rewards: 62.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.120', 'AMMO5': '0.003', 'AMMO2': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'AMMO4': '0.224', 'weapon2': '0.378', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:38,932][52664] DAMAGECOUNT value on done: 157615.0 [2024-08-06 00:56:38,933][52664] Sum rewards: 65.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.158', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '54.500'} [2024-08-06 00:56:38,975][52803] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:56:39,350][52794] DAMAGECOUNT value on done: 152620.0 [2024-08-06 00:56:39,350][52794] Sum rewards: 50.688, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.774', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'AMMO4': '0.202', 'weapon4': '0.284', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '3.002', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '42.000'} [2024-08-06 00:56:39,456][52668] DAMAGECOUNT value on done: 153093.0 [2024-08-06 00:56:39,457][52668] Sum rewards: 46.424, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.235', 'WEAPON4': '0.550', 'weapon2': '0.574', 'weapon4': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.458', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.297', 'FRAGCOUNT': '43.500'} [2024-08-06 00:56:39,607][52650] Updated weights for policy 0, policy_version 26551 (0.0013) [2024-08-06 00:56:39,788][52667] DAMAGECOUNT value on done: 154599.0 [2024-08-06 00:56:39,788][52667] Sum rewards: 64.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.909', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.177', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:39,964][52820] DAMAGECOUNT value on done: 143002.0 [2024-08-06 00:56:39,965][52820] Sum rewards: 53.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.630', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.182', 'weapon4': '0.252', 'weapon2': '0.716', 'WEAPON3': '0.900', 'weapon3': '2.726', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '42.000'} [2024-08-06 00:56:40,186][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:56:40,837][52811] DAMAGECOUNT value on done: 143633.0 [2024-08-06 00:56:40,839][52811] Sum rewards: 51.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.742', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:40,901][52647] DAMAGECOUNT value on done: 159547.0 [2024-08-06 00:56:40,901][52647] Sum rewards: 48.151, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.202', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.326', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '42.500'} [2024-08-06 00:56:41,258][52803] DAMAGECOUNT value on done: 143510.0 [2024-08-06 00:56:41,261][52803] Sum rewards: 54.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.039', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.285', 'weapon2': '0.530', 'WEAPON3': '1.700', 'HITCOUNT': '3.070', 'weapon3': '3.186', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:41,431][52662] DAMAGECOUNT value on done: 161661.0 [2024-08-06 00:56:41,431][52662] Sum rewards: 67.633, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.560', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.062', 'WEAPON4': '0.100', 'weapon2': '0.226', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.492', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '59.000'} [2024-08-06 00:56:41,931][52660] DAMAGECOUNT value on done: 154002.0 [2024-08-06 00:56:41,932][52660] Sum rewards: 54.686, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:42,010][52664] DAMAGECOUNT value on done: 160516.0 [2024-08-06 00:56:42,010][52664] Sum rewards: 44.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.015', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.206', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.618', 'weapon4': '0.756', 'WEAPON3': '1.300', 'weapon3': '2.044', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:42,256][52667] DAMAGECOUNT value on done: 155315.0 [2024-08-06 00:56:42,256][52667] Sum rewards: 56.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.607', 'AMMO5': '0.012', 'ARMOR': '0.032', 'AMMO2': '0.059', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'AMMO4': '0.294', 'weapon2': '0.440', 'weapon4': '0.778', 'WEAPON4': '0.800', 'WEAPON3': '1.050', 'weapon3': '2.308', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:42,392][52794] DAMAGECOUNT value on done: 153941.0 [2024-08-06 00:56:42,392][52794] Sum rewards: 62.379, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.102', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.160', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'weapon2': '0.476', 'WEAPON3': '1.650', 'weapon3': '3.092', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '57.000'} [2024-08-06 00:56:42,454][52668] DAMAGECOUNT value on done: 150073.0 [2024-08-06 00:56:42,455][52668] Sum rewards: 46.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.839', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.226', 'weapon2': '0.616', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '2.846', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '40.000'} [2024-08-06 00:56:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 217563136. Throughput: 0: 4384.7. Samples: 54397620. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:56:42,794][52567] Avg episode reward: [(0, '57.233')] [2024-08-06 00:56:43,057][52820] DAMAGECOUNT value on done: 142340.0 [2024-08-06 00:56:43,058][52820] Sum rewards: 64.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.208', 'weapon2': '0.758', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:43,587][52647] DAMAGECOUNT value on done: 154273.0 [2024-08-06 00:56:43,595][52647] Sum rewards: 55.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'AMMO4': '0.224', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:43,873][52811] DAMAGECOUNT value on done: 142997.0 [2024-08-06 00:56:43,874][52811] Sum rewards: 59.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.010', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.046', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'AMMO4': '0.251', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:44,182][52660] DAMAGECOUNT value on done: 152716.0 [2024-08-06 00:56:44,183][52660] Sum rewards: 46.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.795', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.152', 'AMMO3': '0.162', 'AMMO4': '0.215', 'weapon5': '0.278', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.210', 'weapon3': '2.988', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:44,208][52662] DAMAGECOUNT value on done: 154724.0 [2024-08-06 00:56:44,208][52662] Sum rewards: 73.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon5': '0.154', 'weapon4': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '63.000'} [2024-08-06 00:56:44,349][52803] DAMAGECOUNT value on done: 140497.0 [2024-08-06 00:56:44,349][52803] Sum rewards: 58.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.652', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.406', 'weapon4': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:44,395][52664] DAMAGECOUNT value on done: 157429.0 [2024-08-06 00:56:44,396][52664] Sum rewards: 53.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.828', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.720', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.991', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:44,404][52650] Updated weights for policy 0, policy_version 26561 (0.0011) [2024-08-06 00:56:44,834][52668] DAMAGECOUNT value on done: 145695.0 [2024-08-06 00:56:44,836][52668] Sum rewards: 49.364, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.235', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon4': '0.202', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.148', 'DAMAGECOUNT': '12.060', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:45,114][52794] DAMAGECOUNT value on done: 156157.0 [2024-08-06 00:56:45,120][52794] Sum rewards: 55.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.104', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.217', 'weapon4': '0.258', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.880', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:45,337][52667] DAMAGECOUNT value on done: 150181.0 [2024-08-06 00:56:45,339][52667] Sum rewards: 44.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.524', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.203', 'weapon5': '0.228', 'WEAPON5': '0.350', 'weapon4': '0.416', 'WEAPON4': '0.550', 'weapon2': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.446', 'DAMAGECOUNT': '11.058', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:46,042][52820] DAMAGECOUNT value on done: 142481.0 [2024-08-06 00:56:46,044][52820] Sum rewards: 56.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.098', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:46,220][52647] DAMAGECOUNT value on done: 161598.0 [2024-08-06 00:56:46,220][52647] Sum rewards: 55.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.357', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.181', 'weapon5': '0.210', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.550', 'weapon4': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.480', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:46,931][52811] DAMAGECOUNT value on done: 148698.0 [2024-08-06 00:56:46,933][52811] Sum rewards: 60.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.762', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.144', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.316', 'weapon4': '0.388', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:46,970][52660] DAMAGECOUNT value on done: 152811.0 [2024-08-06 00:56:46,970][52660] Sum rewards: 55.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.678', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.036', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:46,983][52662] DAMAGECOUNT value on done: 159097.0 [2024-08-06 00:56:46,984][52662] Sum rewards: 56.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.424', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.072', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon2': '0.432', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.272', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:47,125][52664] DAMAGECOUNT value on done: 159440.0 [2024-08-06 00:56:47,125][52664] Sum rewards: 58.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.161', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:47,277][52803] DAMAGECOUNT value on done: 147585.0 [2024-08-06 00:56:47,280][52803] Sum rewards: 64.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 00:56:47,491][52668] DAMAGECOUNT value on done: 151680.0 [2024-08-06 00:56:47,491][52668] Sum rewards: 48.502, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.196', 'AMMO4': '0.292', 'weapon5': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.524', 'weapon2': '0.686', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.180', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '44.000'} [2024-08-06 00:56:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 217645056. Throughput: 0: 4382.2. Samples: 54410940. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:56:47,794][52567] Avg episode reward: [(0, '57.236')] [2024-08-06 00:56:47,879][52667] DAMAGECOUNT value on done: 155769.0 [2024-08-06 00:56:47,881][52667] Sum rewards: 60.142, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.688', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.912', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:48,087][52794] DAMAGECOUNT value on done: 155752.0 [2024-08-06 00:56:48,089][52794] Sum rewards: 51.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.379', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.148', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'weapon2': '0.562', 'weapon4': '0.894', 'WEAPON3': '0.900', 'weapon3': '2.262', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '42.000'} [2024-08-06 00:56:48,705][52669] DAMAGECOUNT value on done: 157278.0 [2024-08-06 00:56:48,713][52669] Sum rewards: 60.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.574', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.192', 'AMMO4': '0.228', 'weapon5': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.376', 'weapon4': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.598', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '51.000'} [2024-08-06 00:56:48,825][52650] Updated weights for policy 0, policy_version 26571 (0.0023) [2024-08-06 00:56:49,217][52820] DAMAGECOUNT value on done: 144240.0 [2024-08-06 00:56:49,219][52820] Sum rewards: 61.725, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.915', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO4': '0.155', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'weapon4': '0.296', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.994', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '57.000'} [2024-08-06 00:56:49,734][52660] DAMAGECOUNT value on done: 152810.0 [2024-08-06 00:56:49,734][52660] Sum rewards: 47.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.672', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.576', 'weapon4': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '39.500'} [2024-08-06 00:56:49,830][52664] DAMAGECOUNT value on done: 161161.0 [2024-08-06 00:56:49,830][52664] Sum rewards: 64.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.250', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.171', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.292', 'weapon4': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:49,897][52811] DAMAGECOUNT value on done: 142757.0 [2024-08-06 00:56:49,897][52811] Sum rewards: 54.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.475', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.188', 'weapon2': '0.540', 'WEAPON4': '0.600', 'weapon4': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.472', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:50,099][52662] DAMAGECOUNT value on done: 153998.0 [2024-08-06 00:56:50,101][52662] Sum rewards: 56.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.380', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:50,340][52803] DAMAGECOUNT value on done: 147377.0 [2024-08-06 00:56:50,340][52803] Sum rewards: 47.893, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.786', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.243', 'WEAPON4': '0.450', 'weapon2': '0.466', 'weapon4': '0.686', 'WEAPON3': '1.500', 'weapon3': '2.476', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '45.000'} [2024-08-06 00:56:50,496][52668] DAMAGECOUNT value on done: 149988.0 [2024-08-06 00:56:50,496][52668] Sum rewards: 46.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'ARMOR': '0.009', 'weapon5': '0.028', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.196', 'weapon4': '0.280', 'WEAPON4': '0.450', 'weapon2': '0.596', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.874', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:50,526][52667] DAMAGECOUNT value on done: 154965.0 [2024-08-06 00:56:50,526][52667] Sum rewards: 62.544, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.554', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.161', 'AMMO3': '0.223', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '53.500'} [2024-08-06 00:56:51,154][52794] DAMAGECOUNT value on done: 162179.0 [2024-08-06 00:56:51,154][52794] Sum rewards: 61.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.994', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.163', 'AMMO3': '0.229', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.792', 'WEAPON3': '1.400', 'weapon3': '2.598', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '54.000'} [2024-08-06 00:56:51,720][52669] DAMAGECOUNT value on done: 153250.0 [2024-08-06 00:56:51,720][52669] Sum rewards: 49.206, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.710', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon5': '0.218', 'AMMO3': '0.264', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.650', 'weapon3': '2.860', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:52,387][52820] DAMAGECOUNT value on done: 141592.0 [2024-08-06 00:56:52,389][52820] Sum rewards: 58.796, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.165', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.054', 'AMMO2': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.330', 'AMMO4': '0.339', 'weapon4': '0.588', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.782', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:52,638][52660] DAMAGECOUNT value on done: 156301.0 [2024-08-06 00:56:52,639][52660] Sum rewards: 63.657, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.214', 'AMMO3': '0.245', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.548', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '56.000'} [2024-08-06 00:56:52,662][52662] DAMAGECOUNT value on done: 157725.0 [2024-08-06 00:56:52,664][52662] Sum rewards: 66.638, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.456', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '59.000'} [2024-08-06 00:56:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 217735168. Throughput: 0: 4391.8. Samples: 54437330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:56:52,794][52567] Avg episode reward: [(0, '57.052')] [2024-08-06 00:56:52,847][52664] DAMAGECOUNT value on done: 155828.0 [2024-08-06 00:56:52,847][52664] Sum rewards: 62.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.234', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '51.000'} [2024-08-06 00:56:52,890][52811] DAMAGECOUNT value on done: 142882.0 [2024-08-06 00:56:52,890][52811] Sum rewards: 60.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.243', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.254', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:53,042][52667] DAMAGECOUNT value on done: 157827.0 [2024-08-06 00:56:53,042][52667] Sum rewards: 58.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.752', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:53,207][52668] DAMAGECOUNT value on done: 153848.0 [2024-08-06 00:56:53,207][52668] Sum rewards: 56.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.745', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.074', 'weapon4': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.716', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:53,477][52803] DAMAGECOUNT value on done: 143333.0 [2024-08-06 00:56:53,479][52803] Sum rewards: 50.842, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.790', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.240', 'weapon2': '0.242', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.290', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '46.000'} [2024-08-06 00:56:53,546][52794] DAMAGECOUNT value on done: 155982.0 [2024-08-06 00:56:53,546][52794] Sum rewards: 60.242, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.108', 'AMMO4': '0.117', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:53,661][52650] Updated weights for policy 0, policy_version 26581 (0.0011) [2024-08-06 00:56:54,508][52669] DAMAGECOUNT value on done: 153256.0 [2024-08-06 00:56:54,508][52669] Sum rewards: 47.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.721', 'AMMO5': '0.004', 'AMMO2': '0.039', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'AMMO4': '0.197', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '39.500'} [2024-08-06 00:56:55,428][52662] DAMAGECOUNT value on done: 156551.0 [2024-08-06 00:56:55,429][52662] Sum rewards: 56.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.665', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.213', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.174', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:55,467][52820] DAMAGECOUNT value on done: 142565.0 [2024-08-06 00:56:55,467][52820] Sum rewards: 44.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'weapon5': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'weapon2': '0.424', 'ARMOR': '0.449', 'weapon4': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.698', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '39.000'} [2024-08-06 00:56:55,778][52664] DAMAGECOUNT value on done: 158871.0 [2024-08-06 00:56:55,781][52664] Sum rewards: 54.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.176', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'AMMO4': '0.232', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.646', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:55,886][52660] DAMAGECOUNT value on done: 148472.0 [2024-08-06 00:56:55,887][52660] Sum rewards: 57.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.030', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.216', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '48.000'} [2024-08-06 00:56:55,960][52667] DAMAGECOUNT value on done: 151723.0 [2024-08-06 00:56:55,962][52667] Sum rewards: 51.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.620', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.213', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.536', 'weapon2': '0.606', 'WEAPON3': '1.350', 'weapon3': '2.390', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '44.000'} [2024-08-06 00:56:56,064][52811] DAMAGECOUNT value on done: 145365.0 [2024-08-06 00:56:56,065][52811] Sum rewards: 65.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.246', 'weapon4': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '55.000'} [2024-08-06 00:56:56,416][52803] DAMAGECOUNT value on done: 146778.0 [2024-08-06 00:56:56,419][52803] Sum rewards: 64.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.552', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.159', 'AMMO3': '0.193', 'weapon2': '0.440', 'WEAPON4': '0.550', 'weapon4': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '55.000'} [2024-08-06 00:56:56,439][52668] DAMAGECOUNT value on done: 152338.0 [2024-08-06 00:56:56,441][52668] Sum rewards: 56.668, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.200', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.323', 'weapon2': '0.368', 'WEAPON3': '1.900', 'weapon3': '3.080', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '55.000'} [2024-08-06 00:56:56,576][52794] DAMAGECOUNT value on done: 160639.0 [2024-08-06 00:56:56,576][52794] Sum rewards: 59.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.235', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.212', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '50.000'} [2024-08-06 00:56:56,862][52669] DAMAGECOUNT value on done: 152466.0 [2024-08-06 00:56:56,864][52669] Sum rewards: 42.538, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.362', 'weapon4': '0.404', 'WEAPON3': '1.650', 'HITCOUNT': '2.920', 'weapon3': '3.008', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '41.000'} [2024-08-06 00:56:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 217825280. Throughput: 0: 4383.8. Samples: 54463350. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 00:56:57,795][52567] Avg episode reward: [(0, '56.156')] [2024-08-06 00:56:58,402][52662] DAMAGECOUNT value on done: 160176.0 [2024-08-06 00:56:58,402][52662] Sum rewards: 70.356, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.035', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.203', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.522', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '59.000'} [2024-08-06 00:56:58,515][52650] Updated weights for policy 0, policy_version 26591 (0.0030) [2024-08-06 00:56:58,552][52667] DAMAGECOUNT value on done: 154712.0 [2024-08-06 00:56:58,553][52667] Sum rewards: 61.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.932', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.064', 'AMMO3': '0.183', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.406', 'WEAPON4': '0.500', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '53.000'} [2024-08-06 00:56:58,592][52820] DAMAGECOUNT value on done: 146135.0 [2024-08-06 00:56:58,592][52820] Sum rewards: 67.562, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.044', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.276', 'weapon4': '0.454', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '58.000'} [2024-08-06 00:56:58,719][52660] DAMAGECOUNT value on done: 152745.0 [2024-08-06 00:56:58,721][52660] Sum rewards: 61.050, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.184', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '52.000'} [2024-08-06 00:56:59,137][52668] DAMAGECOUNT value on done: 154925.0 [2024-08-06 00:56:59,139][52668] Sum rewards: 54.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:59,238][52811] DAMAGECOUNT value on done: 143115.0 [2024-08-06 00:56:59,240][52811] Sum rewards: 52.586, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.220', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.424', 'weapon4': '1.028', 'WEAPON3': '1.450', 'weapon3': '2.312', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '47.000'} [2024-08-06 00:56:59,512][52803] DAMAGECOUNT value on done: 142048.0 [2024-08-06 00:56:59,521][52803] Sum rewards: 57.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.414', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '49.000'} [2024-08-06 00:56:59,580][52794] DAMAGECOUNT value on done: 163107.0 [2024-08-06 00:56:59,581][52794] Sum rewards: 49.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.124', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.052', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.440', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '44.000'} [2024-08-06 00:56:59,683][52669] DAMAGECOUNT value on done: 153753.0 [2024-08-06 00:56:59,685][52669] Sum rewards: 62.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:01,343][52667] DAMAGECOUNT value on done: 156780.0 [2024-08-06 00:57:01,343][52667] Sum rewards: 52.637, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.879', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon2': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.580', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.116', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '43.000'} [2024-08-06 00:57:01,528][52660] DAMAGECOUNT value on done: 154676.0 [2024-08-06 00:57:01,530][52660] Sum rewards: 55.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'weapon2': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '45.000'} [2024-08-06 00:57:01,581][52662] DAMAGECOUNT value on done: 153619.0 [2024-08-06 00:57:01,582][52662] Sum rewards: 55.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon4': '0.120', 'AMMO4': '0.128', 'weapon5': '0.146', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.672', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '46.500'} [2024-08-06 00:57:01,683][52820] DAMAGECOUNT value on done: 147817.0 [2024-08-06 00:57:01,684][52820] Sum rewards: 61.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.351', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.217', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:01,971][52668] DAMAGECOUNT value on done: 156732.0 [2024-08-06 00:57:01,971][52668] Sum rewards: 61.310, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.191', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon4': '0.296', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.000'} [2024-08-06 00:57:02,439][52811] DAMAGECOUNT value on done: 145646.0 [2024-08-06 00:57:02,440][52811] Sum rewards: 50.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.254', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.190', 'weapon5': '0.246', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON4': '0.550', 'weapon4': '0.694', 'WEAPON3': '1.150', 'weapon3': '2.242', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '42.000'} [2024-08-06 00:57:02,567][52803] DAMAGECOUNT value on done: 140282.0 [2024-08-06 00:57:02,567][52803] Sum rewards: 57.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.422', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon2': '0.574', 'weapon4': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.370', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '49.000'} [2024-08-06 00:57:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 217907200. Throughput: 0: 4388.2. Samples: 54476670. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 00:57:02,795][52567] Avg episode reward: [(0, '56.599')] [2024-08-06 00:57:02,807][52794] DAMAGECOUNT value on done: 154178.0 [2024-08-06 00:57:02,807][52794] Sum rewards: 65.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.368', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.194', 'weapon2': '0.458', 'WEAPON4': '0.500', 'weapon4': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.604', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 00:57:02,839][52650] Updated weights for policy 0, policy_version 26601 (0.0023) [2024-08-06 00:57:02,852][52669] DAMAGECOUNT value on done: 152196.0 [2024-08-06 00:57:02,852][52669] Sum rewards: 45.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.006', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.156', 'weapon5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.930', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '41.000'} [2024-08-06 00:57:04,028][52660] DAMAGECOUNT value on done: 162652.0 [2024-08-06 00:57:04,028][52660] Sum rewards: 57.523, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.897', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.056', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'AMMO4': '0.281', 'weapon2': '0.360', 'WEAPON4': '0.550', 'weapon4': '0.724', 'WEAPON3': '1.000', 'weapon3': '2.480', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '47.000'} [2024-08-06 00:57:04,352][52667] DAMAGECOUNT value on done: 155309.0 [2024-08-06 00:57:04,353][52667] Sum rewards: 63.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.068', 'AMMO4': '0.117', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.378', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '53.000'} [2024-08-06 00:57:04,402][52668] DAMAGECOUNT value on done: 155396.0 [2024-08-06 00:57:04,404][52668] Sum rewards: 57.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.604', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:04,745][52662] DAMAGECOUNT value on done: 157467.0 [2024-08-06 00:57:04,754][52662] Sum rewards: 63.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '54.000'} [2024-08-06 00:57:04,943][52820] DAMAGECOUNT value on done: 141277.0 [2024-08-06 00:57:04,945][52820] Sum rewards: 70.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.998', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.352', 'weapon4': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '60.000'} [2024-08-06 00:57:05,543][52811] DAMAGECOUNT value on done: 143895.0 [2024-08-06 00:57:05,544][52811] Sum rewards: 53.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.528', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.194', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '46.000'} [2024-08-06 00:57:05,573][52803] DAMAGECOUNT value on done: 146612.0 [2024-08-06 00:57:05,573][52803] Sum rewards: 48.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.646', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '3.054', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '42.000'} [2024-08-06 00:57:05,972][52794] DAMAGECOUNT value on done: 158717.0 [2024-08-06 00:57:05,973][52794] Sum rewards: 56.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.535', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.128', 'AMMO3': '0.190', 'weapon2': '0.546', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.112', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '47.000'} [2024-08-06 00:57:06,190][52669] DAMAGECOUNT value on done: 154521.0 [2024-08-06 00:57:06,190][52669] Sum rewards: 61.495, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon4': '0.198', 'AMMO4': '0.208', 'AMMO3': '0.217', 'weapon5': '0.352', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:07,000][52660] DAMAGECOUNT value on done: 151712.0 [2024-08-06 00:57:07,002][52660] Sum rewards: 56.968, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.141', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.418', 'weapon4': '0.456', 'WEAPON3': '1.600', 'weapon3': '2.748', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '52.000'} [2024-08-06 00:57:07,050][52667] DAMAGECOUNT value on done: 153125.0 [2024-08-06 00:57:07,050][52667] Sum rewards: 60.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.030', 'weapon4': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'weapon2': '0.374', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.308', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '53.000'} [2024-08-06 00:57:07,777][52650] Updated weights for policy 0, policy_version 26611 (0.0012) [2024-08-06 00:57:07,781][52662] DAMAGECOUNT value on done: 154947.0 [2024-08-06 00:57:07,781][52662] Sum rewards: 64.684, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.452', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '55.000'} [2024-08-06 00:57:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 217997312. Throughput: 0: 4385.7. Samples: 54503120. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 00:57:07,795][52567] Avg episode reward: [(0, '57.034')] [2024-08-06 00:57:07,918][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:57:08,548][52811] DAMAGECOUNT value on done: 146013.0 [2024-08-06 00:57:08,550][52811] Sum rewards: 54.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.310', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.220', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'weapon5': '0.282', 'weapon2': '0.354', 'WEAPON4': '0.550', 'weapon4': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.410', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '50.000'} [2024-08-06 00:57:08,651][52803] DAMAGECOUNT value on done: 142128.0 [2024-08-06 00:57:08,653][52803] Sum rewards: 44.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.175', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.000', 'HITCOUNT': '2.610', 'weapon3': '2.950', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '40.000'} [2024-08-06 00:57:08,908][52794] DAMAGECOUNT value on done: 155993.0 [2024-08-06 00:57:08,910][52794] Sum rewards: 65.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO2': '0.017', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.253', 'weapon2': '0.370', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.420', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '57.000'} [2024-08-06 00:57:09,065][52669] DAMAGECOUNT value on done: 155496.0 [2024-08-06 00:57:09,065][52669] Sum rewards: 64.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.107', 'AMMO3': '0.190', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '54.000'} [2024-08-06 00:57:09,585][52660] DAMAGECOUNT value on done: 155544.0 [2024-08-06 00:57:09,587][52660] Sum rewards: 58.241, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.139', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.254', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '2.990', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '53.000'} [2024-08-06 00:57:09,749][52667] DAMAGECOUNT value on done: 155479.0 [2024-08-06 00:57:09,768][52667] Sum rewards: 59.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.265', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.454', 'weapon4': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:10,823][52662] DAMAGECOUNT value on done: 154428.0 [2024-08-06 00:57:10,828][52662] Sum rewards: 48.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.166', 'AMMO4': '0.187', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '43.000'} [2024-08-06 00:57:11,618][52803] DAMAGECOUNT value on done: 146115.0 [2024-08-06 00:57:11,623][52803] Sum rewards: 60.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.354', 'weapon4': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 00:57:11,631][52811] DAMAGECOUNT value on done: 142885.0 [2024-08-06 00:57:11,635][52811] Sum rewards: 58.737, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '48.000'} [2024-08-06 00:57:12,014][52794] DAMAGECOUNT value on done: 165348.0 [2024-08-06 00:57:12,014][52794] Sum rewards: 44.922, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.492', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.064', 'weapon5': '0.096', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'AMMO4': '0.320', 'weapon4': '0.538', 'WEAPON4': '0.700', 'weapon2': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.280', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '41.000'} [2024-08-06 00:57:12,050][52650] Updated weights for policy 0, policy_version 26621 (0.0031) [2024-08-06 00:57:12,163][52669] DAMAGECOUNT value on done: 155145.0 [2024-08-06 00:57:12,166][52669] Sum rewards: 50.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.805', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon4': '0.252', 'weapon2': '0.402', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.074', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '43.000'} [2024-08-06 00:57:12,369][52667] DAMAGECOUNT value on done: 151915.0 [2024-08-06 00:57:12,371][52667] Sum rewards: 62.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.949', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.096', 'AMMO3': '0.187', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.384', 'WEAPON4': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '55.000'} [2024-08-06 00:57:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 218079232. Throughput: 0: 4388.4. Samples: 54529380. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:57:12,794][52567] Avg episode reward: [(0, '56.973')] [2024-08-06 00:57:12,880][52660] DAMAGECOUNT value on done: 147634.0 [2024-08-06 00:57:12,881][52660] Sum rewards: 51.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.117', 'weapon5': '0.170', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.650', 'WEAPON3': '0.750', 'weapon4': '0.980', 'weapon3': '2.204', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '43.000'} [2024-08-06 00:57:14,647][52803] DAMAGECOUNT value on done: 138450.0 [2024-08-06 00:57:14,648][52803] Sum rewards: 60.228, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.832', 'ARMOR': '0.004', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.153', 'weapon4': '0.266', 'weapon2': '0.386', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.218', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '49.000'} [2024-08-06 00:57:14,881][52667] DAMAGECOUNT value on done: 157632.0 [2024-08-06 00:57:14,891][52667] Sum rewards: 54.794, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.156', 'AMMO4': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.372', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '47.000'} [2024-08-06 00:57:14,909][52811] DAMAGECOUNT value on done: 146776.0 [2024-08-06 00:57:14,909][52811] Sum rewards: 57.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.686', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.322', 'weapon4': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '50.000'} [2024-08-06 00:57:15,126][52794] DAMAGECOUNT value on done: 151555.0 [2024-08-06 00:57:15,127][52794] Sum rewards: 63.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.192', 'weapon2': '0.242', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.208', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '54.000'} [2024-08-06 00:57:15,369][52658] DAMAGECOUNT value on done: 158840.0 [2024-08-06 00:57:15,370][52658] Sum rewards: 66.638, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.377', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.390', 'weapon4': '0.408', 'WEAPON3': '1.650', 'weapon3': '2.806', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '59.000'} [2024-08-06 00:57:15,464][52669] DAMAGECOUNT value on done: 150396.0 [2024-08-06 00:57:15,465][52669] Sum rewards: 34.394, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.192', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.022', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.231', 'weapon4': '0.286', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.950', 'WEAPON3': '1.600', 'weapon3': '2.428', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '11.790', 'FRAGCOUNT': '34.500'} [2024-08-06 00:57:16,222][52660] DAMAGECOUNT value on done: 156820.0 [2024-08-06 00:57:16,222][52660] Sum rewards: 58.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.074', 'weapon5': '0.156', 'AMMO3': '0.162', 'AMMO4': '0.369', 'WEAPON5': '0.400', 'weapon2': '0.524', 'weapon4': '0.706', 'WEAPON4': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.340', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '50.000'} [2024-08-06 00:57:16,965][52650] Updated weights for policy 0, policy_version 26631 (0.0042) [2024-08-06 00:57:17,534][52667] DAMAGECOUNT value on done: 160622.0 [2024-08-06 00:57:17,539][52667] Sum rewards: 48.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.156', 'ARMOR': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.440', 'weapon4': '0.728', 'WEAPON3': '1.000', 'weapon3': '2.438', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '40.000'} [2024-08-06 00:57:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 218177536. Throughput: 0: 4401.8. Samples: 54542700. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:57:17,794][52567] Avg episode reward: [(0, '56.864')] [2024-08-06 00:57:17,879][52811] DAMAGECOUNT value on done: 143024.0 [2024-08-06 00:57:17,879][52811] Sum rewards: 71.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.000', 'weapon3': '3.170', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '58.000'} [2024-08-06 00:57:18,182][52669] DAMAGECOUNT value on done: 155143.0 [2024-08-06 00:57:18,184][52669] Sum rewards: 43.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO4': '0.194', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.386', 'weapon4': '0.534', 'WEAPON3': '1.300', 'HITCOUNT': '2.390', 'weapon3': '2.608', 'DAMAGECOUNT': '10.590', 'FRAGCOUNT': '39.000'} [2024-08-06 00:57:18,332][52794] DAMAGECOUNT value on done: 162432.0 [2024-08-06 00:57:18,332][52794] Sum rewards: 54.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.763', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.098', 'AMMO3': '0.190', 'weapon4': '0.230', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '2.996', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '47.000'} [2024-08-06 00:57:18,360][52658] DAMAGECOUNT value on done: 154657.0 [2024-08-06 00:57:18,363][52658] Sum rewards: 58.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.819', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.220', 'AMMO3': '0.227', 'weapon2': '0.278', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.306', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '52.000'} [2024-08-06 00:57:19,121][52660] DAMAGECOUNT value on done: 150781.0 [2024-08-06 00:57:19,123][52660] Sum rewards: 51.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.578', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon4': '1.060', 'weapon3': '2.262', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '42.000'} [2024-08-06 00:57:20,488][52667] DAMAGECOUNT value on done: 159624.0 [2024-08-06 00:57:20,488][52667] Sum rewards: 59.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon2': '0.426', 'weapon4': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.568', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:20,646][52669] DAMAGECOUNT value on done: 156139.0 [2024-08-06 00:57:20,650][52669] Sum rewards: 56.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.512', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.141', 'AMMO3': '0.210', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '48.000'} [2024-08-06 00:57:21,006][52811] DAMAGECOUNT value on done: 145694.0 [2024-08-06 00:57:21,006][52811] Sum rewards: 63.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.063', 'AMMO3': '0.174', 'weapon5': '0.278', 'AMMO4': '0.313', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.672', 'weapon4': '0.762', 'WEAPON3': '1.000', 'weapon3': '2.022', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '53.000'} [2024-08-06 00:57:21,009][52794] DAMAGECOUNT value on done: 156407.0 [2024-08-06 00:57:21,010][52794] Sum rewards: 54.516, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.232', 'weapon4': '0.328', 'WEAPON4': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '49.000'} [2024-08-06 00:57:21,242][52658] DAMAGECOUNT value on done: 157580.0 [2024-08-06 00:57:21,242][52658] Sum rewards: 59.842, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.258', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.046', 'weapon5': '0.098', 'AMMO3': '0.210', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON4': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '53.000'} [2024-08-06 00:57:21,825][52650] Updated weights for policy 0, policy_version 26641 (0.0026) [2024-08-06 00:57:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 218259456. Throughput: 0: 4393.8. Samples: 54568940. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:57:22,794][52567] Avg episode reward: [(0, '57.072')] [2024-08-06 00:57:23,431][52667] DAMAGECOUNT value on done: 160282.0 [2024-08-06 00:57:23,431][52667] Sum rewards: 63.041, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.461', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.216', 'AMMO3': '0.263', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '56.000'} [2024-08-06 00:57:23,459][52669] DAMAGECOUNT value on done: 151777.0 [2024-08-06 00:57:23,460][52669] Sum rewards: 56.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.853', 'AMMO5': '0.003', 'AMMO2': '0.051', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'AMMO4': '0.257', 'weapon4': '0.578', 'WEAPON4': '0.600', 'weapon2': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.372', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '48.000'} [2024-08-06 00:57:23,500][52794] DAMAGECOUNT value on done: 156809.0 [2024-08-06 00:57:23,500][52794] Sum rewards: 48.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.149', 'weapon4': '0.154', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '2.860', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '43.000'} [2024-08-06 00:57:24,268][52658] DAMAGECOUNT value on done: 158153.0 [2024-08-06 00:57:24,269][52658] Sum rewards: 48.160, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.516', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.052', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'AMMO4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.484', 'weapon4': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.370', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '45.000'} [2024-08-06 00:57:26,235][52794] DAMAGECOUNT value on done: 163179.0 [2024-08-06 00:57:26,235][52794] Sum rewards: 49.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.055', 'weapon5': '0.090', 'AMMO3': '0.184', 'AMMO4': '0.275', 'WEAPON4': '0.450', 'weapon2': '0.506', 'weapon4': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.518', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.882', 'FRAGCOUNT': '42.000'} [2024-08-06 00:57:26,317][52650] Updated weights for policy 0, policy_version 26651 (0.0030) [2024-08-06 00:57:26,353][52667] DAMAGECOUNT value on done: 153107.0 [2024-08-06 00:57:26,353][52667] Sum rewards: 73.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '61.000'} [2024-08-06 00:57:26,370][52669] DAMAGECOUNT value on done: 155471.0 [2024-08-06 00:57:26,370][52669] Sum rewards: 55.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.665', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO3': '0.195', 'AMMO4': '0.197', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.768', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '46.000'} [2024-08-06 00:57:26,772][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:57:27,270][52658] DAMAGECOUNT value on done: 157360.0 [2024-08-06 00:57:27,274][52658] Sum rewards: 49.283, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.260', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'AMMO3': '0.224', 'weapon2': '0.420', 'WEAPON4': '0.600', 'weapon4': '0.918', 'WEAPON3': '1.350', 'weapon3': '2.284', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '46.000'} [2024-08-06 00:57:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 218341376. Throughput: 0: 4388.7. Samples: 54595110. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 00:57:27,794][52567] Avg episode reward: [(0, '56.959')] [2024-08-06 00:57:27,923][52666] DAMAGECOUNT value on done: 156580.0 [2024-08-06 00:57:27,923][52666] Sum rewards: 70.263, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.275', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.060', 'weapon4': '0.118', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.728', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '57.000'} [2024-08-06 00:57:28,930][52794] DAMAGECOUNT value on done: 158818.0 [2024-08-06 00:57:28,932][52794] Sum rewards: 45.176, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.714', 'AMMO5': '0.013', 'ARMOR': '0.028', 'AMMO2': '0.066', 'weapon5': '0.180', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'AMMO4': '0.328', 'weapon2': '0.504', 'weapon4': '0.528', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.540', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '40.000'} [2024-08-06 00:57:29,240][52669] DAMAGECOUNT value on done: 161644.0 [2024-08-06 00:57:29,241][52669] Sum rewards: 56.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.494', 'AMMO5': '0.006', 'AMMO2': '0.020', 'ARMOR': '0.020', 'weapon5': '0.084', 'AMMO4': '0.099', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '48.000'} [2024-08-06 00:57:29,470][52667] DAMAGECOUNT value on done: 160266.0 [2024-08-06 00:57:29,470][52667] Sum rewards: 48.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.086', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon4': '0.274', 'weapon2': '0.738', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.792', 'DAMAGECOUNT': '11.901', 'FRAGCOUNT': '43.000'} [2024-08-06 00:57:30,329][52658] DAMAGECOUNT value on done: 151523.0 [2024-08-06 00:57:30,331][52658] Sum rewards: 58.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.186', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO3': '0.195', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.446', 'weapon4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '50.000'} [2024-08-06 00:57:31,111][52650] Updated weights for policy 0, policy_version 26661 (0.0025) [2024-08-06 00:57:31,342][52666] DAMAGECOUNT value on done: 156439.0 [2024-08-06 00:57:31,342][52666] Sum rewards: 65.954, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.208', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.248', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '59.000'} [2024-08-06 00:57:32,280][52669] DAMAGECOUNT value on done: 165875.0 [2024-08-06 00:57:32,280][52669] Sum rewards: 57.243, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.242', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'AMMO3': '0.236', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '52.000'} [2024-08-06 00:57:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 218439680. Throughput: 0: 4380.2. Samples: 54608050. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:57:32,794][52567] Avg episode reward: [(0, '57.054')] [2024-08-06 00:57:33,223][52658] DAMAGECOUNT value on done: 160295.0 [2024-08-06 00:57:33,225][52658] Sum rewards: 58.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.025', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.148', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '48.500'} [2024-08-06 00:57:34,330][52666] DAMAGECOUNT value on done: 155212.0 [2024-08-06 00:57:34,331][52666] Sum rewards: 72.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.712', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'weapon4': '0.238', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '62.000'} [2024-08-06 00:57:34,764][52649] DAMAGECOUNT value on done: 150948.0 [2024-08-06 00:57:34,765][52649] Sum rewards: 58.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.208', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.278', 'weapon2': '0.330', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.206', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:35,353][52669] DAMAGECOUNT value on done: 154519.0 [2024-08-06 00:57:35,353][52669] Sum rewards: 62.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:35,846][52650] Updated weights for policy 0, policy_version 26671 (0.0011) [2024-08-06 00:57:36,406][52658] DAMAGECOUNT value on done: 150888.0 [2024-08-06 00:57:36,413][52658] Sum rewards: 56.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'WEAPON4': '0.400', 'weapon4': '0.570', 'weapon2': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '48.000'} [2024-08-06 00:57:37,005][52666] DAMAGECOUNT value on done: 152927.0 [2024-08-06 00:57:37,005][52666] Sum rewards: 63.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '54.000'} [2024-08-06 00:57:37,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 218521600. Throughput: 0: 4385.5. Samples: 54634680. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:57:37,795][52567] Avg episode reward: [(0, '57.353')] [2024-08-06 00:57:37,909][52649] DAMAGECOUNT value on done: 148397.0 [2024-08-06 00:57:37,909][52649] Sum rewards: 54.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.802', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.189', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.552', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '48.000'} [2024-08-06 00:57:38,061][52670] DAMAGECOUNT value on done: 152767.0 [2024-08-06 00:57:38,061][52670] Sum rewards: 56.389, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.668', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.133', 'weapon5': '0.146', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.426', 'weapon2': '0.576', 'WEAPON3': '0.800', 'weapon3': '2.662', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '44.000'} [2024-08-06 00:57:38,200][52669] DAMAGECOUNT value on done: 156694.0 [2024-08-06 00:57:38,201][52669] Sum rewards: 76.560, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.740', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.253', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '67.000'} [2024-08-06 00:57:39,915][52658] DAMAGECOUNT value on done: 161095.0 [2024-08-06 00:57:39,917][52658] Sum rewards: 69.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.483', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.124', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '61.000'} [2024-08-06 00:57:39,967][52666] DAMAGECOUNT value on done: 150841.0 [2024-08-06 00:57:39,969][52666] Sum rewards: 57.395, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon2': '0.334', 'weapon4': '0.396', 'WEAPON3': '1.550', 'weapon3': '2.938', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:40,194][52650] Updated weights for policy 0, policy_version 26681 (0.0027) [2024-08-06 00:57:40,370][52649] DAMAGECOUNT value on done: 150208.0 [2024-08-06 00:57:40,371][52649] Sum rewards: 59.238, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.722', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.462', 'WEAPON3': '1.400', 'weapon3': '2.824', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '52.000'} [2024-08-06 00:57:40,485][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:57:41,021][52670] DAMAGECOUNT value on done: 156897.0 [2024-08-06 00:57:41,021][52670] Sum rewards: 58.702, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.662', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.219', 'weapon2': '0.260', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '53.000'} [2024-08-06 00:57:41,329][52669] DAMAGECOUNT value on done: 156035.0 [2024-08-06 00:57:41,330][52669] Sum rewards: 59.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.078', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.500', 'weapon4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.658', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '55.000'} [2024-08-06 00:57:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 218611712. Throughput: 0: 4391.8. Samples: 54660980. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 00:57:42,794][52567] Avg episode reward: [(0, '57.627')] [2024-08-06 00:57:43,063][52658] DAMAGECOUNT value on done: 160873.0 [2024-08-06 00:57:43,065][52658] Sum rewards: 65.978, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.000', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.510', 'weapon2': '0.544', 'WEAPON3': '1.550', 'weapon3': '2.554', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 00:57:43,106][52666] DAMAGECOUNT value on done: 149295.0 [2024-08-06 00:57:43,107][52666] Sum rewards: 59.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.495', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.210', 'weapon2': '0.826', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '49.000'} [2024-08-06 00:57:43,295][52649] DAMAGECOUNT value on done: 151618.0 [2024-08-06 00:57:43,295][52649] Sum rewards: 52.102, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.142', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.188', 'AMMO3': '0.224', 'weapon4': '0.294', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '48.000'} [2024-08-06 00:57:44,158][52670] DAMAGECOUNT value on done: 152351.0 [2024-08-06 00:57:44,158][52670] Sum rewards: 55.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'weapon5': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.178', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '47.000'} [2024-08-06 00:57:44,402][52669] DAMAGECOUNT value on done: 159183.0 [2024-08-06 00:57:44,403][52669] Sum rewards: 65.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.260', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.024', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.258', 'weapon2': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.522', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '56.000'} [2024-08-06 00:57:45,023][52650] Updated weights for policy 0, policy_version 26691 (0.0014) [2024-08-06 00:57:45,811][52658] DAMAGECOUNT value on done: 161431.0 [2024-08-06 00:57:45,811][52658] Sum rewards: 67.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.606', 'weapon4': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '56.000'} [2024-08-06 00:57:46,260][52666] DAMAGECOUNT value on done: 152877.0 [2024-08-06 00:57:46,262][52666] Sum rewards: 69.179, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.102', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.274', 'weapon2': '0.458', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 00:57:46,286][52649] DAMAGECOUNT value on done: 146080.0 [2024-08-06 00:57:46,289][52649] Sum rewards: 55.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.114', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.338', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '46.000'} [2024-08-06 00:57:47,240][52670] DAMAGECOUNT value on done: 152445.0 [2024-08-06 00:57:47,241][52670] Sum rewards: 59.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.668', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '52.000'} [2024-08-06 00:57:47,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 218701824. Throughput: 0: 4388.0. Samples: 54674130. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:57:47,794][52567] Avg episode reward: [(0, '58.004')] [2024-08-06 00:57:48,754][52658] DAMAGECOUNT value on done: 150816.0 [2024-08-06 00:57:48,754][52658] Sum rewards: 49.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.163', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '43.000'} [2024-08-06 00:57:49,308][52666] DAMAGECOUNT value on done: 152789.0 [2024-08-06 00:57:49,308][52666] Sum rewards: 60.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.500', 'weapon3': '2.826', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '54.000'} [2024-08-06 00:57:49,593][52649] DAMAGECOUNT value on done: 149823.0 [2024-08-06 00:57:49,594][52649] Sum rewards: 46.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.115', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '3.218', 'DAMAGECOUNT': '11.871', 'FRAGCOUNT': '41.000'} [2024-08-06 00:57:49,843][52650] Updated weights for policy 0, policy_version 26701 (0.0012) [2024-08-06 00:57:49,913][52670] DAMAGECOUNT value on done: 153422.0 [2024-08-06 00:57:49,915][52670] Sum rewards: 44.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.106', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.492', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '2.798', 'DAMAGECOUNT': '11.592', 'FRAGCOUNT': '39.000'} [2024-08-06 00:57:51,563][52658] DAMAGECOUNT value on done: 154831.0 [2024-08-06 00:57:51,564][52658] Sum rewards: 46.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.652', 'ARMOR': '0.009', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.116', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '3.106', 'DAMAGECOUNT': '12.561', 'FRAGCOUNT': '39.500'} [2024-08-06 00:57:51,762][52666] DAMAGECOUNT value on done: 154956.0 [2024-08-06 00:57:51,764][52666] Sum rewards: 73.852, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.715', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.528', 'weapon4': '0.606', 'WEAPON3': '0.850', 'weapon3': '2.526', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '58.000'} [2024-08-06 00:57:52,166][52649] DAMAGECOUNT value on done: 147692.0 [2024-08-06 00:57:52,166][52649] Sum rewards: 60.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.117', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '51.000'} [2024-08-06 00:57:52,398][52670] DAMAGECOUNT value on done: 155412.0 [2024-08-06 00:57:52,398][52670] Sum rewards: 50.919, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.900', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.238', 'weapon4': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.814', 'WEAPON3': '1.400', 'weapon3': '2.714', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '47.000'} [2024-08-06 00:57:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 218783744. Throughput: 0: 4384.9. Samples: 54700440. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:57:52,802][52567] Avg episode reward: [(0, '57.655')] [2024-08-06 00:57:54,408][52658] DAMAGECOUNT value on done: 155108.0 [2024-08-06 00:57:54,409][52658] Sum rewards: 61.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.864', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.292', 'WEAPON4': '0.500', 'weapon4': '0.892', 'WEAPON3': '1.350', 'weapon3': '2.372', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '52.000'} [2024-08-06 00:57:54,432][52650] Updated weights for policy 0, policy_version 26711 (0.0028) [2024-08-06 00:57:54,742][52666] DAMAGECOUNT value on done: 153439.0 [2024-08-06 00:57:54,742][52666] Sum rewards: 52.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.185', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.222', 'weapon2': '0.236', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.206', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '46.000'} [2024-08-06 00:57:54,987][52649] DAMAGECOUNT value on done: 154847.0 [2024-08-06 00:57:54,987][52649] Sum rewards: 70.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon2': '0.182', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'weapon3': '3.556', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '60.000'} [2024-08-06 00:57:55,352][52670] DAMAGECOUNT value on done: 149014.0 [2024-08-06 00:57:55,353][52670] Sum rewards: 60.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.091', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.790', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '53.000'} [2024-08-06 00:57:57,353][52658] DAMAGECOUNT value on done: 154751.0 [2024-08-06 00:57:57,355][52658] Sum rewards: 66.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.303', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.113', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.508', 'weapon4': '0.648', 'WEAPON3': '1.000', 'weapon3': '2.608', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '55.000'} [2024-08-06 00:57:57,610][52666] DAMAGECOUNT value on done: 150945.0 [2024-08-06 00:57:57,610][52666] Sum rewards: 58.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.084', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.644', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.068', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '49.000'} [2024-08-06 00:57:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 218873856. Throughput: 0: 4387.6. Samples: 54726820. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:57:57,795][52567] Avg episode reward: [(0, '57.988')] [2024-08-06 00:57:58,074][52649] DAMAGECOUNT value on done: 149386.0 [2024-08-06 00:57:58,076][52649] Sum rewards: 69.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.354', 'weapon4': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '59.000'} [2024-08-06 00:57:58,325][52670] DAMAGECOUNT value on done: 154773.0 [2024-08-06 00:57:58,327][52670] Sum rewards: 64.925, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.582', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.108', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.280', 'AMMO3': '0.295', 'WEAPON3': '1.650', 'weapon3': '3.202', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '56.000'} [2024-08-06 00:57:59,097][52650] Updated weights for policy 0, policy_version 26721 (0.0011) [2024-08-06 00:57:59,703][52671] DAMAGECOUNT value on done: 161346.0 [2024-08-06 00:57:59,704][52671] Sum rewards: 64.691, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.057', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.488', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:00,198][52663] DAMAGECOUNT value on done: 154605.0 [2024-08-06 00:58:00,198][52663] Sum rewards: 66.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.052', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.164', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.328', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '2.778', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2024-08-06 00:58:00,356][52666] DAMAGECOUNT value on done: 149227.0 [2024-08-06 00:58:00,357][52666] Sum rewards: 61.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.365', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon4': '0.268', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.000'} [2024-08-06 00:58:00,599][52658] DAMAGECOUNT value on done: 158234.0 [2024-08-06 00:58:00,601][52658] Sum rewards: 53.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO3': '0.201', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.500', 'weapon4': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '47.000'} [2024-08-06 00:58:00,941][52649] DAMAGECOUNT value on done: 150670.0 [2024-08-06 00:58:00,942][52649] Sum rewards: 55.428, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.360', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.338', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.484', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '44.000'} [2024-08-06 00:58:01,055][52670] DAMAGECOUNT value on done: 148993.0 [2024-08-06 00:58:01,055][52670] Sum rewards: 66.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:02,714][52671] DAMAGECOUNT value on done: 155111.0 [2024-08-06 00:58:02,714][52671] Sum rewards: 57.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.879', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.066', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.354', 'WEAPON4': '0.500', 'weapon4': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 218963968. Throughput: 0: 4381.6. Samples: 54739870. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 00:58:02,802][52567] Avg episode reward: [(0, '58.356')] [2024-08-06 00:58:02,802][52614] Saving new best policy, reward=58.356! [2024-08-06 00:58:03,192][52666] DAMAGECOUNT value on done: 156101.0 [2024-08-06 00:58:03,194][52666] Sum rewards: 54.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.592', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.062', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.284', 'AMMO4': '0.311', 'WEAPON4': '0.550', 'weapon4': '0.846', 'WEAPON3': '1.250', 'weapon3': '2.586', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '48.000'} [2024-08-06 00:58:03,326][52663] DAMAGECOUNT value on done: 155534.0 [2024-08-06 00:58:03,326][52663] Sum rewards: 51.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.197', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.392', 'weapon4': '0.410', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:03,360][52658] DAMAGECOUNT value on done: 159916.0 [2024-08-06 00:58:03,360][52658] Sum rewards: 57.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.499', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon4': '0.036', 'AMMO2': '0.037', 'weapon5': '0.046', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.744', 'WEAPON3': '1.500', 'weapon3': '2.916', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:03,778][52650] Updated weights for policy 0, policy_version 26731 (0.0013) [2024-08-06 00:58:03,841][52670] DAMAGECOUNT value on done: 145633.0 [2024-08-06 00:58:03,842][52670] Sum rewards: 60.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.909', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon5': '0.292', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.350', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:04,104][52649] DAMAGECOUNT value on done: 151300.0 [2024-08-06 00:58:04,105][52649] Sum rewards: 63.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.761', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.007', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.248', 'WEAPON3': '1.400', 'HITCOUNT': '3.450', 'weapon3': '3.526', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:05,387][52671] DAMAGECOUNT value on done: 160709.0 [2024-08-06 00:58:05,388][52671] Sum rewards: 63.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon5': '0.194', 'weapon2': '0.512', 'weapon4': '0.598', 'WEAPON3': '1.050', 'weapon3': '2.534', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:05,966][52666] DAMAGECOUNT value on done: 156973.0 [2024-08-06 00:58:05,970][52666] Sum rewards: 48.343, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.320', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.164', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.326', 'WEAPON4': '0.500', 'weapon4': '0.578', 'WEAPON3': '1.550', 'weapon3': '2.594', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:06,433][52658] DAMAGECOUNT value on done: 151378.0 [2024-08-06 00:58:06,433][52658] Sum rewards: 57.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.442', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.216', 'WEAPON4': '0.450', 'weapon2': '0.602', 'weapon4': '0.742', 'WEAPON3': '1.150', 'weapon3': '2.360', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '48.000'} [2024-08-06 00:58:06,441][52663] DAMAGECOUNT value on done: 153601.0 [2024-08-06 00:58:06,442][52663] Sum rewards: 55.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.667', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.230', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.000'} [2024-08-06 00:58:06,956][52670] DAMAGECOUNT value on done: 156514.0 [2024-08-06 00:58:06,959][52670] Sum rewards: 62.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.492', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.078', 'AMMO3': '0.172', 'AMMO4': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:07,044][52649] DAMAGECOUNT value on done: 147786.0 [2024-08-06 00:58:07,046][52649] Sum rewards: 54.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.172', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'AMMO4': '0.203', 'AMMO3': '0.229', 'WEAPON4': '0.500', 'weapon4': '0.506', 'weapon2': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.648', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '47.500'} [2024-08-06 00:58:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 219054080. Throughput: 0: 4383.3. Samples: 54766190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:58:07,794][52567] Avg episode reward: [(0, '58.285')] [2024-08-06 00:58:07,958][52671] DAMAGECOUNT value on done: 154180.0 [2024-08-06 00:58:07,959][52671] Sum rewards: 52.827, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.758', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'weapon4': '0.246', 'AMMO3': '0.254', 'WEAPON4': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.600', 'weapon3': '2.804', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '48.500'} [2024-08-06 00:58:08,457][52650] Updated weights for policy 0, policy_version 26741 (0.0012) [2024-08-06 00:58:09,180][52666] DAMAGECOUNT value on done: 152733.0 [2024-08-06 00:58:09,181][52666] Sum rewards: 47.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.728', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.038', 'weapon5': '0.160', 'AMMO4': '0.188', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '41.000'} [2024-08-06 00:58:09,587][52658] DAMAGECOUNT value on done: 153211.0 [2024-08-06 00:58:09,591][52658] Sum rewards: 47.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.326', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.227', 'weapon4': '0.260', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '43.000'} [2024-08-06 00:58:09,673][52663] DAMAGECOUNT value on done: 154065.0 [2024-08-06 00:58:09,677][52663] Sum rewards: 59.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.060', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.204', 'weapon5': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.446', 'weapon4': '0.470', 'WEAPON3': '1.150', 'weapon3': '2.622', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '52.500'} [2024-08-06 00:58:10,044][52670] DAMAGECOUNT value on done: 153920.0 [2024-08-06 00:58:10,046][52670] Sum rewards: 58.500, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.682', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.120', 'weapon5': '0.146', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.516', 'weapon4': '0.590', 'WEAPON3': '0.850', 'weapon3': '2.510', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '46.000'} [2024-08-06 00:58:10,365][52649] DAMAGECOUNT value on done: 153178.0 [2024-08-06 00:58:10,368][52649] Sum rewards: 60.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.004', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.792', 'WEAPON3': '0.900', 'weapon3': '2.580', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '50.000'} [2024-08-06 00:58:10,416][52671] DAMAGECOUNT value on done: 157348.0 [2024-08-06 00:58:10,418][52671] Sum rewards: 61.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.268', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.054', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO3': '0.281', 'weapon2': '0.600', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '54.000'} [2024-08-06 00:58:10,783][52647] Large shaping reward 2.540 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.489, 163.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:58:12,109][52666] DAMAGECOUNT value on done: 152367.0 [2024-08-06 00:58:12,111][52666] Sum rewards: 57.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.892', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.244', 'AMMO3': '0.251', 'WEAPON3': '1.650', 'weapon3': '3.382', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '51.500'} [2024-08-06 00:58:12,351][52658] DAMAGECOUNT value on done: 158192.0 [2024-08-06 00:58:12,355][52658] Sum rewards: 52.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.223', 'AMMO5': '0.007', 'AMMO2': '0.049', 'AMMO3': '0.139', 'weapon5': '0.144', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.438', 'weapon4': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.670', 'weapon3': '2.762', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:12,645][52663] DAMAGECOUNT value on done: 152296.0 [2024-08-06 00:58:12,647][52663] Sum rewards: 58.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.589', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.126', 'AMMO3': '0.172', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.626', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 219136000. Throughput: 0: 4382.7. Samples: 54792330. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:58:12,794][52567] Avg episode reward: [(0, '58.255')] [2024-08-06 00:58:12,834][52658] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:58:12,930][52670] DAMAGECOUNT value on done: 156251.0 [2024-08-06 00:58:12,931][52670] Sum rewards: 64.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.294', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.164', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:13,084][52650] Updated weights for policy 0, policy_version 26751 (0.0024) [2024-08-06 00:58:13,095][52671] DAMAGECOUNT value on done: 157687.0 [2024-08-06 00:58:13,095][52671] Sum rewards: 64.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO3': '0.177', 'AMMO4': '0.195', 'weapon4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '54.000'} [2024-08-06 00:58:13,329][52649] DAMAGECOUNT value on done: 153140.0 [2024-08-06 00:58:13,339][52649] Sum rewards: 56.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.875', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon5': '0.106', 'AMMO3': '0.196', 'AMMO4': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.794', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:14,685][52666] DAMAGECOUNT value on done: 150604.0 [2024-08-06 00:58:14,685][52666] Sum rewards: 53.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.956', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.233', 'weapon4': '0.310', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '46.000'} [2024-08-06 00:58:15,423][52670] DAMAGECOUNT value on done: 152644.0 [2024-08-06 00:58:15,425][52670] Sum rewards: 57.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.718', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.452', 'weapon4': '0.534', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:15,834][52671] DAMAGECOUNT value on done: 156736.0 [2024-08-06 00:58:15,834][52671] Sum rewards: 55.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.145', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '48.000'} [2024-08-06 00:58:15,934][52649] DAMAGECOUNT value on done: 146662.0 [2024-08-06 00:58:15,935][52649] Sum rewards: 55.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.166', 'ARMOR': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:16,022][52663] DAMAGECOUNT value on done: 161699.0 [2024-08-06 00:58:16,023][52663] Sum rewards: 57.642, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.426', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:17,330][52666] DAMAGECOUNT value on done: 156672.0 [2024-08-06 00:58:17,333][52666] Sum rewards: 62.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.009', 'ARMOR': '0.012', 'weapon5': '0.052', 'AMMO2': '0.053', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.267', 'weapon4': '0.292', 'WEAPON4': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:17,385][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 00:58:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 219217920. Throughput: 0: 4388.9. Samples: 54805550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 00:58:17,794][52567] Avg episode reward: [(0, '58.387')] [2024-08-06 00:58:17,827][52614] Saving new best policy, reward=58.387! [2024-08-06 00:58:17,834][52650] Updated weights for policy 0, policy_version 26761 (0.0016) [2024-08-06 00:58:18,345][52670] DAMAGECOUNT value on done: 159411.0 [2024-08-06 00:58:18,346][52670] Sum rewards: 56.701, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '48.000'} [2024-08-06 00:58:18,494][52671] DAMAGECOUNT value on done: 156437.0 [2024-08-06 00:58:18,495][52671] Sum rewards: 48.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.709', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon4': '0.496', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.440', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.754', 'FRAGCOUNT': '41.000'} [2024-08-06 00:58:18,512][52663] DAMAGECOUNT value on done: 154388.0 [2024-08-06 00:58:18,513][52663] Sum rewards: 49.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.265', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.207', 'weapon2': '0.732', 'WEAPON3': '1.400', 'weapon3': '2.684', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.483', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:18,972][52649] DAMAGECOUNT value on done: 152540.0 [2024-08-06 00:58:18,973][52649] Sum rewards: 60.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.027', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.212', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.316', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:20,786][52666] DAMAGECOUNT value on done: 150162.0 [2024-08-06 00:58:20,788][52666] Sum rewards: 62.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.772', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.184', 'weapon5': '0.210', 'AMMO4': '0.212', 'weapon4': '0.376', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:21,159][52663] DAMAGECOUNT value on done: 154524.0 [2024-08-06 00:58:21,159][52663] Sum rewards: 61.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.270', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.116', 'AMMO4': '0.178', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:21,324][52671] DAMAGECOUNT value on done: 155815.0 [2024-08-06 00:58:21,324][52671] Sum rewards: 66.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.089', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.400', 'weapon3': '2.728', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 00:58:21,537][52670] DAMAGECOUNT value on done: 147118.0 [2024-08-06 00:58:21,539][52670] Sum rewards: 53.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.197', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:21,847][52649] DAMAGECOUNT value on done: 149833.0 [2024-08-06 00:58:21,847][52649] Sum rewards: 57.743, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'HEALTH': '0.124', 'weapon5': '0.142', 'AMMO3': '0.157', 'AMMO4': '0.174', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.488', 'WEAPON3': '0.900', 'weapon3': '2.738', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '46.000'} [2024-08-06 00:58:22,045][52795] DAMAGECOUNT value on done: 143540.0 [2024-08-06 00:58:22,046][52795] Sum rewards: 51.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.852', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'weapon4': '0.518', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.768', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '44.000'} [2024-08-06 00:58:22,636][52650] Updated weights for policy 0, policy_version 26771 (0.0027) [2024-08-06 00:58:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 219308032. Throughput: 0: 4375.6. Samples: 54831580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:58:22,794][52567] Avg episode reward: [(0, '58.419')] [2024-08-06 00:58:22,795][52614] Saving new best policy, reward=58.419! [2024-08-06 00:58:23,662][52666] DAMAGECOUNT value on done: 153609.0 [2024-08-06 00:58:23,662][52666] Sum rewards: 53.237, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.800', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.235', 'WEAPON4': '0.500', 'weapon2': '0.510', 'weapon4': '0.644', 'WEAPON3': '1.350', 'weapon3': '2.424', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:23,777][52663] DAMAGECOUNT value on done: 156820.0 [2024-08-06 00:58:23,777][52663] Sum rewards: 65.637, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.514', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.249', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.000'} [2024-08-06 00:58:24,417][52670] DAMAGECOUNT value on done: 155459.0 [2024-08-06 00:58:24,417][52670] Sum rewards: 49.551, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.719', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon5': '0.142', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'AMMO4': '0.296', 'weapon2': '0.340', 'WEAPON4': '0.650', 'weapon4': '0.846', 'WEAPON3': '1.200', 'weapon3': '2.380', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '47.000'} [2024-08-06 00:58:24,526][52649] DAMAGECOUNT value on done: 156054.0 [2024-08-06 00:58:24,526][52649] Sum rewards: 56.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.075', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.189', 'weapon5': '0.222', 'AMMO4': '0.245', 'WEAPON5': '0.400', 'weapon2': '0.450', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.470', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:24,549][52671] DAMAGECOUNT value on done: 158839.0 [2024-08-06 00:58:24,549][52671] Sum rewards: 50.373, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.524', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon4': '0.436', 'weapon2': '0.490', 'WEAPON3': '1.500', 'weapon3': '2.776', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '46.000'} [2024-08-06 00:58:25,078][52665] DAMAGECOUNT value on done: 152800.0 [2024-08-06 00:58:25,079][52665] Sum rewards: 62.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.094', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.218', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '56.000'} [2024-08-06 00:58:25,504][52795] DAMAGECOUNT value on done: 139059.0 [2024-08-06 00:58:25,505][52795] Sum rewards: 52.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.625', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.250', 'weapon4': '0.310', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '2.956', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:26,657][52663] DAMAGECOUNT value on done: 158231.0 [2024-08-06 00:58:26,657][52663] Sum rewards: 56.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.292', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.151', 'weapon5': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.884', 'WEAPON3': '0.900', 'weapon3': '2.292', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:26,941][52650] Updated weights for policy 0, policy_version 26781 (0.0041) [2024-08-06 00:58:27,104][52671] DAMAGECOUNT value on done: 156991.0 [2024-08-06 00:58:27,105][52671] Sum rewards: 63.157, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.024', 'AMMO4': '0.109', 'weapon4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '54.000'} [2024-08-06 00:58:27,347][52659] DAMAGECOUNT value on done: 156490.0 [2024-08-06 00:58:27,349][52659] Sum rewards: 60.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.825', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'weapon4': '0.148', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.050', 'HITCOUNT': '3.210', 'weapon3': '3.274', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:27,499][52649] DAMAGECOUNT value on done: 153805.0 [2024-08-06 00:58:27,499][52649] Sum rewards: 65.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon5': '0.188', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.430', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.738', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:27,523][52670] DAMAGECOUNT value on done: 155495.0 [2024-08-06 00:58:27,524][52670] Sum rewards: 50.761, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.278', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.043', 'AMMO3': '0.117', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon2': '0.622', 'WEAPON3': '0.700', 'WEAPON4': '0.700', 'weapon4': '1.052', 'weapon3': '1.806', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '42.000'} [2024-08-06 00:58:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 219398144. Throughput: 0: 4365.1. Samples: 54857410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:58:27,794][52567] Avg episode reward: [(0, '58.679')] [2024-08-06 00:58:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026782_219398144.pth... [2024-08-06 00:58:27,921][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026269_215195648.pth [2024-08-06 00:58:27,945][52614] Saving new best policy, reward=58.679! [2024-08-06 00:58:28,059][52665] DAMAGECOUNT value on done: 159257.0 [2024-08-06 00:58:28,061][52665] Sum rewards: 59.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.291', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.618', 'WEAPON3': '1.500', 'weapon3': '2.622', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:28,590][52795] DAMAGECOUNT value on done: 142802.0 [2024-08-06 00:58:28,591][52795] Sum rewards: 48.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.630', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'weapon4': '0.610', 'weapon2': '0.664', 'WEAPON3': '1.450', 'weapon3': '2.290', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '43.000'} [2024-08-06 00:58:29,804][52671] DAMAGECOUNT value on done: 155525.0 [2024-08-06 00:58:29,807][52671] Sum rewards: 64.842, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.440', 'AMMO5': '0.005', 'ARMOR': '0.020', 'weapon5': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.168', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '58.000'} [2024-08-06 00:58:29,983][52663] DAMAGECOUNT value on done: 156981.0 [2024-08-06 00:58:29,984][52663] Sum rewards: 57.317, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.598', 'AMMO5': '0.004', 'ARMOR': '0.016', 'weapon5': '0.028', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'AMMO4': '0.233', 'weapon2': '0.460', 'WEAPON4': '0.550', 'weapon4': '0.656', 'WEAPON3': '1.200', 'weapon3': '2.600', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:30,027][52659] DAMAGECOUNT value on done: 155750.0 [2024-08-06 00:58:30,029][52659] Sum rewards: 63.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.472', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.096', 'weapon5': '0.108', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.364', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:30,358][52649] DAMAGECOUNT value on done: 158360.0 [2024-08-06 00:58:30,360][52649] Sum rewards: 48.458, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.152', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.144', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:30,518][52670] DAMAGECOUNT value on done: 153700.0 [2024-08-06 00:58:30,519][52670] Sum rewards: 58.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.150', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon2': '0.446', 'weapon4': '0.636', 'WEAPON3': '0.850', 'weapon3': '2.612', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '46.000'} [2024-08-06 00:58:30,774][52665] DAMAGECOUNT value on done: 153135.0 [2024-08-06 00:58:30,775][52665] Sum rewards: 55.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon4': '0.308', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '48.000'} [2024-08-06 00:58:31,705][52795] DAMAGECOUNT value on done: 142600.0 [2024-08-06 00:58:31,706][52795] Sum rewards: 62.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.722', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.142', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.490', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '2.622', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '54.000'} [2024-08-06 00:58:32,193][52650] Updated weights for policy 0, policy_version 26791 (0.0028) [2024-08-06 00:58:32,350][52663] DAMAGECOUNT value on done: 155501.0 [2024-08-06 00:58:32,351][52663] Sum rewards: 53.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.122', 'AMMO3': '0.248', 'weapon2': '0.372', 'WEAPON3': '1.450', 'HITCOUNT': '3.300', 'weapon3': '3.322', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:32,757][52671] DAMAGECOUNT value on done: 163023.0 [2024-08-06 00:58:32,757][52671] Sum rewards: 63.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.907', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.156', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.450', 'weapon4': '0.610', 'WEAPON3': '1.500', 'weapon3': '2.690', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 219488256. Throughput: 0: 4361.1. Samples: 54870380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:58:32,794][52567] Avg episode reward: [(0, '58.203')] [2024-08-06 00:58:33,079][52659] DAMAGECOUNT value on done: 157014.0 [2024-08-06 00:58:33,079][52659] Sum rewards: 62.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:33,440][52670] DAMAGECOUNT value on done: 154597.0 [2024-08-06 00:58:33,441][52670] Sum rewards: 62.994, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.923', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '57.000'} [2024-08-06 00:58:33,610][52665] DAMAGECOUNT value on done: 150043.0 [2024-08-06 00:58:33,612][52665] Sum rewards: 64.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.513', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'ARMOR': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.207', 'weapon4': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:34,225][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:58:34,798][52795] DAMAGECOUNT value on done: 146037.0 [2024-08-06 00:58:34,799][52795] Sum rewards: 70.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 00:58:35,385][52663] DAMAGECOUNT value on done: 149614.0 [2024-08-06 00:58:35,387][52663] Sum rewards: 58.036, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.634', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:35,529][52671] DAMAGECOUNT value on done: 156084.0 [2024-08-06 00:58:35,530][52671] Sum rewards: 60.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.240', 'weapon2': '0.286', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:35,947][52659] DAMAGECOUNT value on done: 157012.0 [2024-08-06 00:58:35,950][52659] Sum rewards: 41.960, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.734', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'AMMO3': '0.248', 'weapon2': '0.324', 'WEAPON4': '0.400', 'weapon4': '0.572', 'WEAPON3': '1.500', 'HITCOUNT': '2.720', 'weapon3': '2.800', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '39.000'} [2024-08-06 00:58:36,116][52665] DAMAGECOUNT value on done: 150958.0 [2024-08-06 00:58:36,117][52665] Sum rewards: 52.358, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.147', 'AMMO3': '0.157', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.801', 'FRAGCOUNT': '43.000'} [2024-08-06 00:58:36,463][52650] Updated weights for policy 0, policy_version 26801 (0.0020) [2024-08-06 00:58:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 219570176. Throughput: 0: 4360.2. Samples: 54896650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 00:58:37,795][52567] Avg episode reward: [(0, '58.113')] [2024-08-06 00:58:37,905][52795] DAMAGECOUNT value on done: 142912.0 [2024-08-06 00:58:37,905][52795] Sum rewards: 57.233, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.092', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.176', 'AMMO3': '0.233', 'weapon2': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:38,022][52671] DAMAGECOUNT value on done: 151592.0 [2024-08-06 00:58:38,023][52671] Sum rewards: 70.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.638', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.184', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '61.000'} [2024-08-06 00:58:38,184][52663] DAMAGECOUNT value on done: 151419.0 [2024-08-06 00:58:38,184][52663] Sum rewards: 40.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon7': '0.056', 'weapon5': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.474', 'weapon2': '0.542', 'WEAPON3': '1.050', 'HITCOUNT': '2.260', 'weapon3': '2.678', 'DAMAGECOUNT': '10.890', 'FRAGCOUNT': '35.000'} [2024-08-06 00:58:38,597][52659] DAMAGECOUNT value on done: 155671.0 [2024-08-06 00:58:38,597][52659] Sum rewards: 65.304, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.805', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.364', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:39,035][52665] DAMAGECOUNT value on done: 153754.0 [2024-08-06 00:58:39,035][52665] Sum rewards: 62.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.298', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.362', 'weapon4': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:40,861][52663] DAMAGECOUNT value on done: 158530.0 [2024-08-06 00:58:40,862][52663] Sum rewards: 71.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.958', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.196', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.408', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '60.000'} [2024-08-06 00:58:41,000][52795] DAMAGECOUNT value on done: 146859.0 [2024-08-06 00:58:41,001][52795] Sum rewards: 54.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.370', 'weapon4': '0.598', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '47.000'} [2024-08-06 00:58:41,112][52671] DAMAGECOUNT value on done: 159589.0 [2024-08-06 00:58:41,113][52671] Sum rewards: 47.277, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.610', 'AMMO5': '0.003', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.231', 'AMMO4': '0.249', 'weapon4': '0.286', 'WEAPON4': '0.500', 'weapon2': '0.862', 'WEAPON3': '1.450', 'weapon3': '2.574', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '45.000'} [2024-08-06 00:58:41,342][52650] Updated weights for policy 0, policy_version 26811 (0.0024) [2024-08-06 00:58:41,462][52614] Signal inference workers to stop experience collection... (4950 times) [2024-08-06 00:58:41,475][52614] Signal inference workers to resume experience collection... (4950 times) [2024-08-06 00:58:41,548][52650] InferenceWorker_p0-w0: stopping experience collection (4950 times) [2024-08-06 00:58:41,548][52650] InferenceWorker_p0-w0: resuming experience collection (4950 times) [2024-08-06 00:58:41,624][52659] DAMAGECOUNT value on done: 154750.0 [2024-08-06 00:58:41,624][52659] Sum rewards: 58.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.491', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon4': '0.284', 'weapon2': '0.286', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.172', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:41,912][52665] DAMAGECOUNT value on done: 153715.0 [2024-08-06 00:58:41,914][52665] Sum rewards: 52.071, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.040', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.076', 'AMMO3': '0.209', 'weapon5': '0.300', 'AMMO4': '0.382', 'weapon4': '0.424', 'weapon2': '0.458', 'WEAPON5': '0.650', 'WEAPON4': '0.900', 'WEAPON3': '1.250', 'weapon3': '2.442', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 219660288. Throughput: 0: 4361.6. Samples: 54923090. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:58:42,794][52567] Avg episode reward: [(0, '58.183')] [2024-08-06 00:58:43,812][52671] DAMAGECOUNT value on done: 158527.0 [2024-08-06 00:58:43,823][52671] Sum rewards: 70.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.084', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '55.500'} [2024-08-06 00:58:44,029][52663] DAMAGECOUNT value on done: 157497.0 [2024-08-06 00:58:44,030][52663] Sum rewards: 58.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.830', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.202', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.122', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '50.000'} [2024-08-06 00:58:44,264][52795] DAMAGECOUNT value on done: 145833.0 [2024-08-06 00:58:44,266][52795] Sum rewards: 53.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.934', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.154', 'AMMO3': '0.202', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.650', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '46.000'} [2024-08-06 00:58:44,340][52659] DAMAGECOUNT value on done: 156611.0 [2024-08-06 00:58:44,341][52659] Sum rewards: 57.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.027', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO3': '0.271', 'weapon4': '0.342', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:44,633][52665] DAMAGECOUNT value on done: 156471.0 [2024-08-06 00:58:44,635][52665] Sum rewards: 54.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'ARMOR': '0.005', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.172', 'weapon5': '0.272', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON5': '0.450', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.226', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '46.000'} [2024-08-06 00:58:45,942][52650] Updated weights for policy 0, policy_version 26821 (0.0019) [2024-08-06 00:58:46,832][52671] DAMAGECOUNT value on done: 158952.0 [2024-08-06 00:58:46,833][52671] Sum rewards: 68.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.184', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.022', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.184', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '55.500'} [2024-08-06 00:58:47,283][52663] DAMAGECOUNT value on done: 158944.0 [2024-08-06 00:58:47,286][52663] Sum rewards: 57.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.102', 'AMMO3': '0.136', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '1.006', 'weapon3': '2.186', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '47.000'} [2024-08-06 00:58:47,321][52665] DAMAGECOUNT value on done: 159238.0 [2024-08-06 00:58:47,322][52665] Sum rewards: 40.619, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.747', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.172', 'AMMO4': '0.216', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.650', 'weapon4': '0.668', 'WEAPON3': '1.500', 'weapon3': '2.436', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '40.000'} [2024-08-06 00:58:47,351][52795] DAMAGECOUNT value on done: 142887.0 [2024-08-06 00:58:47,351][52795] Sum rewards: 49.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.558', 'AMMO2': '0.021', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.348', 'weapon4': '0.412', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.708', 'FRAGCOUNT': '43.000'} [2024-08-06 00:58:47,396][52659] DAMAGECOUNT value on done: 151662.0 [2024-08-06 00:58:47,397][52659] Sum rewards: 54.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.725', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.229', 'weapon2': '0.466', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.096', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '48.000'} [2024-08-06 00:58:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 219750400. Throughput: 0: 4368.2. Samples: 54936440. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:58:47,794][52567] Avg episode reward: [(0, '57.795')] [2024-08-06 00:58:49,572][52671] DAMAGECOUNT value on done: 158766.0 [2024-08-06 00:58:49,574][52671] Sum rewards: 58.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.678', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.428', 'weapon4': '0.428', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:49,988][52663] DAMAGECOUNT value on done: 158717.0 [2024-08-06 00:58:49,989][52663] Sum rewards: 61.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.587', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.211', 'weapon4': '0.240', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '51.500'} [2024-08-06 00:58:50,043][52665] DAMAGECOUNT value on done: 155180.0 [2024-08-06 00:58:50,045][52665] Sum rewards: 66.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon4': '0.270', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:50,067][52659] DAMAGECOUNT value on done: 157072.0 [2024-08-06 00:58:50,067][52659] Sum rewards: 40.859, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.049', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'AMMO4': '0.243', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '2.944', 'DAMAGECOUNT': '11.475', 'FRAGCOUNT': '38.000'} [2024-08-06 00:58:50,423][52650] Updated weights for policy 0, policy_version 26831 (0.0011) [2024-08-06 00:58:50,600][52795] DAMAGECOUNT value on done: 145433.0 [2024-08-06 00:58:50,600][52795] Sum rewards: 61.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.084', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.173', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.224', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '51.000'} [2024-08-06 00:58:52,371][52663] DAMAGECOUNT value on done: 157068.0 [2024-08-06 00:58:52,372][52663] Sum rewards: 66.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon4': '0.362', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '55.000'} [2024-08-06 00:58:52,719][52671] DAMAGECOUNT value on done: 156662.0 [2024-08-06 00:58:52,719][52671] Sum rewards: 60.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'weapon5': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.806', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:52,768][52665] DAMAGECOUNT value on done: 157809.0 [2024-08-06 00:58:52,768][52665] Sum rewards: 61.931, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.205', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.147', 'weapon4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '53.000'} [2024-08-06 00:58:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 219840512. Throughput: 0: 4374.9. Samples: 54963060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 00:58:52,794][52567] Avg episode reward: [(0, '57.586')] [2024-08-06 00:58:53,178][52659] DAMAGECOUNT value on done: 159626.0 [2024-08-06 00:58:53,180][52659] Sum rewards: 65.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.434', 'ARMOR': '0.012', 'AMMO5': '0.014', 'weapon5': '0.040', 'AMMO2': '0.045', 'AMMO3': '0.198', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON4': '0.450', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '57.000'} [2024-08-06 00:58:53,650][52795] DAMAGECOUNT value on done: 142923.0 [2024-08-06 00:58:53,650][52795] Sum rewards: 49.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.029', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.091', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.930', 'DAMAGECOUNT': '12.615', 'FRAGCOUNT': '44.000'} [2024-08-06 00:58:54,951][52663] DAMAGECOUNT value on done: 154144.0 [2024-08-06 00:58:54,952][52663] Sum rewards: 54.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.729', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon4': '0.274', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.102', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '48.000'} [2024-08-06 00:58:55,142][52650] Updated weights for policy 0, policy_version 26841 (0.0013) [2024-08-06 00:58:55,637][52665] DAMAGECOUNT value on done: 157574.0 [2024-08-06 00:58:55,637][52665] Sum rewards: 64.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.306', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.153', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.552', 'WEAPON3': '0.900', 'weapon3': '2.854', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '52.000'} [2024-08-06 00:58:56,096][52659] DAMAGECOUNT value on done: 154483.0 [2024-08-06 00:58:56,096][52659] Sum rewards: 55.511, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.920', 'WEAPON3': '0.950', 'weapon3': '2.736', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '44.000'} [2024-08-06 00:58:56,816][52795] DAMAGECOUNT value on done: 142715.0 [2024-08-06 00:58:56,816][52795] Sum rewards: 53.661, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.970', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.154', 'AMMO3': '0.216', 'AMMO4': '0.283', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '49.000'} [2024-08-06 00:58:57,387][52647] DAMAGECOUNT value on done: 165925.0 [2024-08-06 00:58:57,389][52647] Sum rewards: 51.084, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.997', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'AMMO3': '0.235', 'weapon4': '0.388', 'weapon2': '0.526', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.628', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '47.000'} [2024-08-06 00:58:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 219922432. Throughput: 0: 4374.0. Samples: 54989160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:58:57,794][52567] Avg episode reward: [(0, '57.393')] [2024-08-06 00:58:58,248][52665] DAMAGECOUNT value on done: 153865.0 [2024-08-06 00:58:58,249][52665] Sum rewards: 65.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.652', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.124', 'AMMO3': '0.245', 'weapon2': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.358', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '57.000'} [2024-08-06 00:58:58,927][52659] DAMAGECOUNT value on done: 150567.0 [2024-08-06 00:58:58,927][52659] Sum rewards: 44.497, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.385', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'weapon4': '0.214', 'AMMO3': '0.270', 'WEAPON4': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.600', 'weapon3': '2.722', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '44.000'} [2024-08-06 00:58:59,883][52650] Updated weights for policy 0, policy_version 26851 (0.0020) [2024-08-06 00:58:59,950][52795] DAMAGECOUNT value on done: 143330.0 [2024-08-06 00:58:59,961][52795] Sum rewards: 62.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.522', 'ARMOR': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.173', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '3.050', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:00,584][52647] DAMAGECOUNT value on done: 163885.0 [2024-08-06 00:59:00,584][52647] Sum rewards: 51.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.998', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.024', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.214', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '3.058', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '46.000'} [2024-08-06 00:59:00,696][52665] DAMAGECOUNT value on done: 153848.0 [2024-08-06 00:59:00,696][52665] Sum rewards: 53.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.442', 'weapon4': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:01,583][52659] DAMAGECOUNT value on done: 151187.0 [2024-08-06 00:59:01,586][52659] Sum rewards: 55.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.679', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.128', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.448', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 220012544. Throughput: 0: 4371.1. Samples: 55002250. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:59:02,794][52567] Avg episode reward: [(0, '57.416')] [2024-08-06 00:59:03,009][52795] DAMAGECOUNT value on done: 143462.0 [2024-08-06 00:59:03,011][52795] Sum rewards: 58.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.348', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.294', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.234', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:03,486][52647] DAMAGECOUNT value on done: 167218.0 [2024-08-06 00:59:03,488][52647] Sum rewards: 57.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.224', 'AMMO3': '0.232', 'weapon2': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.628', 'WEAPON3': '1.350', 'weapon3': '2.710', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '50.500'} [2024-08-06 00:59:03,682][52665] DAMAGECOUNT value on done: 154525.0 [2024-08-06 00:59:03,684][52665] Sum rewards: 69.622, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.704', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '60.000'} [2024-08-06 00:59:04,533][52650] Updated weights for policy 0, policy_version 26861 (0.0012) [2024-08-06 00:59:04,628][52659] DAMAGECOUNT value on done: 155812.0 [2024-08-06 00:59:04,629][52659] Sum rewards: 52.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.264', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.078', 'AMMO3': '0.181', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.374', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.050', 'HITCOUNT': '2.660', 'weapon3': '2.804', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '46.000'} [2024-08-06 00:59:05,357][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:59:06,079][52647] DAMAGECOUNT value on done: 167088.0 [2024-08-06 00:59:06,081][52647] Sum rewards: 55.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.136', 'AMMO5': '0.010', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO4': '0.156', 'AMMO3': '0.206', 'WEAPON4': '0.400', 'weapon2': '0.486', 'weapon4': '0.672', 'WEAPON3': '1.250', 'weapon3': '2.384', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '46.000'} [2024-08-06 00:59:06,100][52795] DAMAGECOUNT value on done: 141719.0 [2024-08-06 00:59:06,101][52795] Sum rewards: 59.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.390', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon4': '0.076', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO4': '0.247', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.286', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '52.500'} [2024-08-06 00:59:06,710][52665] DAMAGECOUNT value on done: 153237.0 [2024-08-06 00:59:06,711][52665] Sum rewards: 55.672, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.946', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.259', 'weapon2': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '51.000'} [2024-08-06 00:59:07,263][52659] DAMAGECOUNT value on done: 156811.0 [2024-08-06 00:59:07,264][52659] Sum rewards: 62.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO2': '0.027', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.236', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 00:59:07,796][52567] Fps is (10 sec: 17199.7, 60 sec: 17339.2, 300 sec: 17523.2). Total num frames: 220094464. Throughput: 0: 4377.8. Samples: 55028590. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:59:07,796][52567] Avg episode reward: [(0, '57.679')] [2024-08-06 00:59:08,727][52647] DAMAGECOUNT value on done: 167290.0 [2024-08-06 00:59:08,727][52647] Sum rewards: 60.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.976', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.542', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.664', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2024-08-06 00:59:09,238][52650] Updated weights for policy 0, policy_version 26871 (0.0012) [2024-08-06 00:59:09,306][52795] DAMAGECOUNT value on done: 147869.0 [2024-08-06 00:59:09,308][52795] Sum rewards: 53.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.806', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.208', 'weapon2': '0.248', 'WEAPON4': '0.350', 'weapon4': '0.466', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:09,426][52664] DAMAGECOUNT value on done: 162743.0 [2024-08-06 00:59:09,426][52664] Sum rewards: 61.710, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.762', 'AMMO5': '0.005', 'ARMOR': '0.013', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.758', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:09,615][52665] DAMAGECOUNT value on done: 153927.0 [2024-08-06 00:59:09,615][52665] Sum rewards: 53.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.302', 'weapon4': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:09,913][52659] DAMAGECOUNT value on done: 159670.0 [2024-08-06 00:59:09,914][52659] Sum rewards: 49.674, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.040', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.200', 'AMMO4': '0.202', 'HEALTH': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.504', 'weapon4': '0.690', 'WEAPON3': '0.750', 'weapon3': '2.402', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '39.000'} [2024-08-06 00:59:11,682][52647] DAMAGECOUNT value on done: 167379.0 [2024-08-06 00:59:11,683][52647] Sum rewards: 52.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.349', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.065', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon2': '0.604', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.114', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '44.000'} [2024-08-06 00:59:12,315][52665] DAMAGECOUNT value on done: 149427.0 [2024-08-06 00:59:12,319][52665] Sum rewards: 55.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.139', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.122', 'weapon5': '0.134', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.742', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:12,349][52795] DAMAGECOUNT value on done: 147523.0 [2024-08-06 00:59:12,349][52795] Sum rewards: 65.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.606', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.032', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.181', 'WEAPON4': '0.350', 'weapon4': '0.448', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.704', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '53.000'} [2024-08-06 00:59:12,372][52664] DAMAGECOUNT value on done: 163038.0 [2024-08-06 00:59:12,372][52664] Sum rewards: 56.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.131', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.406', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.676', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '49.000'} [2024-08-06 00:59:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 220192768. Throughput: 0: 4392.7. Samples: 55055080. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 00:59:12,794][52567] Avg episode reward: [(0, '57.518')] [2024-08-06 00:59:13,120][52659] DAMAGECOUNT value on done: 159967.0 [2024-08-06 00:59:13,122][52659] Sum rewards: 56.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.017', 'AMMO2': '0.026', 'ARMOR': '0.032', 'AMMO4': '0.129', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon5': '0.436', 'weapon4': '0.492', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.222', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:13,799][52650] Updated weights for policy 0, policy_version 26881 (0.0037) [2024-08-06 00:59:14,253][52647] DAMAGECOUNT value on done: 163754.0 [2024-08-06 00:59:14,254][52647] Sum rewards: 58.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.048', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO4': '0.176', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.028', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:15,264][52664] DAMAGECOUNT value on done: 163864.0 [2024-08-06 00:59:15,265][52664] Sum rewards: 54.089, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.142', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.072', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon4': '0.342', 'WEAPON4': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:15,511][52665] DAMAGECOUNT value on done: 154422.0 [2024-08-06 00:59:15,511][52665] Sum rewards: 70.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.960', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.438', 'weapon2': '0.508', 'WEAPON3': '1.650', 'weapon3': '2.678', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '61.500'} [2024-08-06 00:59:15,559][52795] DAMAGECOUNT value on done: 139998.0 [2024-08-06 00:59:15,560][52795] Sum rewards: 43.132, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.842', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.066', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.328', 'weapon2': '0.388', 'weapon4': '0.836', 'WEAPON4': '0.850', 'WEAPON3': '1.050', 'weapon3': '2.480', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '40.000'} [2024-08-06 00:59:16,205][52659] DAMAGECOUNT value on done: 155482.0 [2024-08-06 00:59:16,206][52659] Sum rewards: 50.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.202', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon7': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.168', 'WEAPON7': '0.200', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.872', 'WEAPON3': '1.000', 'weapon3': '2.404', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '12.771', 'FRAGCOUNT': '44.000'} [2024-08-06 00:59:17,009][52647] DAMAGECOUNT value on done: 166394.0 [2024-08-06 00:59:17,018][52647] Sum rewards: 60.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.062', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '51.000'} [2024-08-06 00:59:17,794][52567] Fps is (10 sec: 18026.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 220274688. Throughput: 0: 4397.1. Samples: 55068250. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 00:59:17,794][52567] Avg episode reward: [(0, '57.440')] [2024-08-06 00:59:17,898][52665] DAMAGECOUNT value on done: 152815.0 [2024-08-06 00:59:17,899][52665] Sum rewards: 50.491, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:17,900][52664] DAMAGECOUNT value on done: 161329.0 [2024-08-06 00:59:17,902][52664] Sum rewards: 62.842, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.374', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.019', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.173', 'weapon2': '0.302', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.370', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:18,545][52650] Updated weights for policy 0, policy_version 26891 (0.0012) [2024-08-06 00:59:18,581][52795] DAMAGECOUNT value on done: 148510.0 [2024-08-06 00:59:18,582][52795] Sum rewards: 67.059, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.630', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon2': '0.718', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:19,110][52668] DAMAGECOUNT value on done: 154976.0 [2024-08-06 00:59:19,112][52668] Sum rewards: 49.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.604', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon5': '0.260', 'weapon4': '0.324', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '42.000'} [2024-08-06 00:59:19,361][52659] DAMAGECOUNT value on done: 160100.0 [2024-08-06 00:59:19,361][52659] Sum rewards: 44.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.826', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.149', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon4': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.934', 'WEAPON3': '1.050', 'weapon3': '2.294', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '11.343', 'FRAGCOUNT': '40.000'} [2024-08-06 00:59:19,692][52647] DAMAGECOUNT value on done: 168415.0 [2024-08-06 00:59:19,693][52647] Sum rewards: 47.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.727', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.051', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.257', 'weapon2': '0.396', 'WEAPON4': '0.500', 'weapon4': '0.866', 'WEAPON3': '1.250', 'weapon3': '2.234', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '43.000'} [2024-08-06 00:59:20,359][52664] DAMAGECOUNT value on done: 161597.0 [2024-08-06 00:59:20,359][52664] Sum rewards: 56.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.258', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '49.000'} [2024-08-06 00:59:21,713][52795] DAMAGECOUNT value on done: 147778.0 [2024-08-06 00:59:21,714][52795] Sum rewards: 52.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon4': '0.184', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'weapon2': '0.598', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.782', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:22,049][52647] DAMAGECOUNT value on done: 162903.0 [2024-08-06 00:59:22,057][52647] Sum rewards: 45.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.398', 'weapon2': '0.614', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.806', 'DAMAGECOUNT': '11.130', 'FRAGCOUNT': '40.000'} [2024-08-06 00:59:22,217][52668] DAMAGECOUNT value on done: 164428.0 [2024-08-06 00:59:22,218][52668] Sum rewards: 57.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.485', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.156', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.258', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.188', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:22,289][52659] DAMAGECOUNT value on done: 160310.0 [2024-08-06 00:59:22,289][52659] Sum rewards: 59.769, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.762', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 220364800. Throughput: 0: 4402.5. Samples: 55094760. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 00:59:22,794][52567] Avg episode reward: [(0, '57.186')] [2024-08-06 00:59:22,912][52664] DAMAGECOUNT value on done: 165833.0 [2024-08-06 00:59:22,912][52664] Sum rewards: 52.636, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.534', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'weapon4': '0.444', 'weapon2': '0.502', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.620', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:23,402][52650] Updated weights for policy 0, policy_version 26901 (0.0011) [2024-08-06 00:59:24,698][52647] DAMAGECOUNT value on done: 163220.0 [2024-08-06 00:59:24,700][52647] Sum rewards: 60.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.776', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.174', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.640', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:25,214][52668] DAMAGECOUNT value on done: 158654.0 [2024-08-06 00:59:25,216][52668] Sum rewards: 61.717, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.172', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '54.000'} [2024-08-06 00:59:25,555][52662] DAMAGECOUNT value on done: 160730.0 [2024-08-06 00:59:25,556][52662] Sum rewards: 63.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.402', 'weapon4': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.536', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '54.000'} [2024-08-06 00:59:25,615][52664] DAMAGECOUNT value on done: 166393.0 [2024-08-06 00:59:25,616][52664] Sum rewards: 58.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.967', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO4': '0.190', 'weapon2': '0.370', 'WEAPON4': '0.450', 'weapon4': '1.002', 'WEAPON3': '1.050', 'weapon3': '2.278', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:27,095][52647] DAMAGECOUNT value on done: 162452.0 [2024-08-06 00:59:27,104][52647] Sum rewards: 66.893, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.163', 'weapon4': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.328', 'HEALTH': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '3.130', 'weapon3': '3.236', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '54.500'} [2024-08-06 00:59:27,643][52650] Updated weights for policy 0, policy_version 26911 (0.0030) [2024-08-06 00:59:27,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 220454912. Throughput: 0: 4391.7. Samples: 55120720. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 00:59:27,795][52567] Avg episode reward: [(0, '57.266')] [2024-08-06 00:59:28,057][52664] DAMAGECOUNT value on done: 156812.0 [2024-08-06 00:59:28,060][52664] Sum rewards: 57.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon5': '0.184', 'AMMO3': '0.188', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.432', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:28,276][52668] DAMAGECOUNT value on done: 157192.0 [2024-08-06 00:59:28,276][52668] Sum rewards: 53.574, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.199', 'weapon5': '0.210', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.588', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '46.000'} [2024-08-06 00:59:28,543][52662] DAMAGECOUNT value on done: 164900.0 [2024-08-06 00:59:28,547][52662] Sum rewards: 51.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.534', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.200', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.706', 'WEAPON3': '1.200', 'weapon3': '2.622', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '43.000'} [2024-08-06 00:59:29,284][52647] DAMAGECOUNT value on done: 165645.0 [2024-08-06 00:59:29,285][52647] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.976', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:29,623][52820] DAMAGECOUNT value on done: 144119.0 [2024-08-06 00:59:29,625][52820] Sum rewards: 61.169, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.345', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon5': '0.086', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.706', 'WEAPON3': '0.800', 'weapon3': '2.544', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '49.000'} [2024-08-06 00:59:30,336][52664] DAMAGECOUNT value on done: 171625.0 [2024-08-06 00:59:30,338][52664] Sum rewards: 51.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.524', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.163', 'weapon5': '0.176', 'AMMO4': '0.183', 'weapon2': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.708', 'WEAPON3': '1.000', 'weapon3': '2.386', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:30,935][52668] DAMAGECOUNT value on done: 156512.0 [2024-08-06 00:59:30,935][52668] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.161', 'weapon4': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:31,447][52662] DAMAGECOUNT value on done: 164790.0 [2024-08-06 00:59:31,449][52662] Sum rewards: 54.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.683', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.109', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.098', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:31,970][52647] DAMAGECOUNT value on done: 162287.0 [2024-08-06 00:59:31,971][52647] Sum rewards: 68.920, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO3': '0.184', 'weapon2': '0.472', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.270', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '56.000'} [2024-08-06 00:59:32,751][52650] Updated weights for policy 0, policy_version 26921 (0.0013) [2024-08-06 00:59:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 220536832. Throughput: 0: 4387.3. Samples: 55133870. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 00:59:32,795][52567] Avg episode reward: [(0, '57.450')] [2024-08-06 00:59:32,816][52820] DAMAGECOUNT value on done: 145421.0 [2024-08-06 00:59:32,818][52820] Sum rewards: 50.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.702', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.126', 'AMMO4': '0.198', 'AMMO3': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.450', 'weapon4': '0.670', 'WEAPON3': '1.300', 'weapon3': '2.572', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:32,832][52664] DAMAGECOUNT value on done: 167268.0 [2024-08-06 00:59:32,832][52664] Sum rewards: 59.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.106', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO4': '0.083', 'AMMO3': '0.229', 'weapon2': '0.452', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.316', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:33,981][52660] DAMAGECOUNT value on done: 155381.0 [2024-08-06 00:59:33,981][52660] Sum rewards: 59.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.934', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.216', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.560', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '2.404', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '51.000'} [2024-08-06 00:59:33,995][52668] DAMAGECOUNT value on done: 154685.0 [2024-08-06 00:59:33,995][52668] Sum rewards: 57.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.114', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.470', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.662', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:34,414][52662] DAMAGECOUNT value on done: 156119.0 [2024-08-06 00:59:34,416][52662] Sum rewards: 59.341, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.272', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:34,457][52647] DAMAGECOUNT value on done: 164485.0 [2024-08-06 00:59:34,460][52647] Sum rewards: 70.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.666', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.225', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '59.000'} [2024-08-06 00:59:35,430][52664] DAMAGECOUNT value on done: 166239.0 [2024-08-06 00:59:35,432][52664] Sum rewards: 51.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.006', 'ARMOR': '0.028', 'AMMO2': '0.044', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:35,930][52820] DAMAGECOUNT value on done: 144278.0 [2024-08-06 00:59:35,930][52820] Sum rewards: 65.214, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.368', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.258', 'weapon4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '57.000'} [2024-08-06 00:59:36,718][52668] DAMAGECOUNT value on done: 159278.0 [2024-08-06 00:59:36,720][52668] Sum rewards: 73.852, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.189', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.180', 'weapon2': '0.214', 'WEAPON3': '1.050', 'HITCOUNT': '3.340', 'weapon3': '3.434', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '60.000'} [2024-08-06 00:59:36,730][52660] DAMAGECOUNT value on done: 158115.0 [2024-08-06 00:59:36,731][52660] Sum rewards: 50.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.518', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '2.928', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:36,905][52650] Updated weights for policy 0, policy_version 26931 (0.0011) [2024-08-06 00:59:36,914][52647] DAMAGECOUNT value on done: 166125.0 [2024-08-06 00:59:36,914][52647] Sum rewards: 48.429, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.444', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '3.154', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '42.000'} [2024-08-06 00:59:37,455][52662] DAMAGECOUNT value on done: 161898.0 [2024-08-06 00:59:37,456][52662] Sum rewards: 54.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.107', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.176', 'AMMO3': '0.177', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.410', 'WEAPON4': '0.500', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.608', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '49.000'} [2024-08-06 00:59:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 220626944. Throughput: 0: 4384.0. Samples: 55160340. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:59:37,795][52567] Avg episode reward: [(0, '57.407')] [2024-08-06 00:59:37,845][52664] DAMAGECOUNT value on done: 162507.0 [2024-08-06 00:59:37,847][52664] Sum rewards: 66.328, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.875', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon2': '0.220', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.452', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '57.000'} [2024-08-06 00:59:38,179][52803] DAMAGECOUNT value on done: 147286.0 [2024-08-06 00:59:38,180][52803] Sum rewards: 58.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.092', 'weapon4': '0.138', 'AMMO3': '0.162', 'AMMO4': '0.166', 'WEAPON4': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '49.000'} [2024-08-06 00:59:38,754][52649] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:59:39,136][52820] DAMAGECOUNT value on done: 139389.0 [2024-08-06 00:59:39,140][52820] Sum rewards: 55.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.475', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO4': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '49.000'} [2024-08-06 00:59:39,382][52647] DAMAGECOUNT value on done: 161265.0 [2024-08-06 00:59:39,383][52647] Sum rewards: 50.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon4': '0.140', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '3.174', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '44.000'} [2024-08-06 00:59:39,834][52660] DAMAGECOUNT value on done: 158220.0 [2024-08-06 00:59:39,835][52660] Sum rewards: 57.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.032', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'weapon4': '0.282', 'weapon2': '0.526', 'WEAPON3': '1.600', 'weapon3': '2.884', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:39,841][52668] DAMAGECOUNT value on done: 162603.0 [2024-08-06 00:59:39,844][52668] Sum rewards: 60.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.899', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.118', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.362', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.750', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:40,450][52664] DAMAGECOUNT value on done: 159940.0 [2024-08-06 00:59:40,451][52664] Sum rewards: 53.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.541', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.166', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.640', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:40,554][52662] DAMAGECOUNT value on done: 160824.0 [2024-08-06 00:59:40,554][52662] Sum rewards: 71.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.162', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.111', 'AMMO3': '0.192', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 00:59:41,306][52803] DAMAGECOUNT value on done: 152106.0 [2024-08-06 00:59:41,309][52803] Sum rewards: 59.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.771', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.118', 'AMMO4': '0.152', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.860', 'weapon3': '3.192', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '53.000'} [2024-08-06 00:59:41,628][52647] DAMAGECOUNT value on done: 164256.0 [2024-08-06 00:59:41,628][52647] Sum rewards: 52.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.776', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.396', 'weapon4': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '46.000'} [2024-08-06 00:59:41,904][52650] Updated weights for policy 0, policy_version 26941 (0.0013) [2024-08-06 00:59:42,317][52820] DAMAGECOUNT value on done: 146660.0 [2024-08-06 00:59:42,319][52820] Sum rewards: 53.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.157', 'weapon4': '0.248', 'weapon5': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '0.950', 'HITCOUNT': '2.690', 'weapon3': '2.762', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:42,624][52660] DAMAGECOUNT value on done: 158202.0 [2024-08-06 00:59:42,627][52660] Sum rewards: 51.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.046', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.158', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.864', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '44.000'} [2024-08-06 00:59:42,659][52668] DAMAGECOUNT value on done: 157511.0 [2024-08-06 00:59:42,660][52668] Sum rewards: 43.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.104', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '1.072', 'WEAPON3': '1.250', 'weapon3': '2.416', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '38.000'} [2024-08-06 00:59:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 220717056. Throughput: 0: 4384.7. Samples: 55186470. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:59:42,794][52567] Avg episode reward: [(0, '57.032')] [2024-08-06 00:59:43,049][52664] DAMAGECOUNT value on done: 162501.0 [2024-08-06 00:59:43,050][52664] Sum rewards: 52.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.994', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '43.000'} [2024-08-06 00:59:43,437][52662] DAMAGECOUNT value on done: 160890.0 [2024-08-06 00:59:43,439][52662] Sum rewards: 58.659, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.800', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'AMMO4': '0.210', 'weapon4': '0.486', 'WEAPON4': '0.500', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.590', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:43,653][52663] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:59:44,089][52647] DAMAGECOUNT value on done: 159300.0 [2024-08-06 00:59:44,089][52647] Sum rewards: 61.590, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.251', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.080', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.690', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '54.000'} [2024-08-06 00:59:44,323][52662] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 00:59:44,361][52803] DAMAGECOUNT value on done: 147398.0 [2024-08-06 00:59:44,366][52803] Sum rewards: 48.071, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.718', 'AMMO5': '0.003', 'AMMO2': '0.032', 'ARMOR': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.255', 'weapon2': '0.346', 'WEAPON4': '0.550', 'weapon4': '0.604', 'WEAPON3': '1.550', 'weapon3': '2.772', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:45,111][52811] DAMAGECOUNT value on done: 156424.0 [2024-08-06 00:59:45,112][52811] Sum rewards: 53.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.040', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.444', 'WEAPON4': '0.550', 'weapon4': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.110', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:45,399][52794] DAMAGECOUNT value on done: 163587.0 [2024-08-06 00:59:45,399][52794] Sum rewards: 46.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.201', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.241', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '42.000'} [2024-08-06 00:59:45,516][52664] DAMAGECOUNT value on done: 165531.0 [2024-08-06 00:59:45,517][52664] Sum rewards: 54.597, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.584', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.354', 'weapon4': '0.426', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:45,625][52820] DAMAGECOUNT value on done: 144875.0 [2024-08-06 00:59:45,627][52820] Sum rewards: 47.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.929', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.127', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.278', 'weapon4': '0.284', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.148', 'DAMAGECOUNT': '12.672', 'FRAGCOUNT': '39.500'} [2024-08-06 00:59:45,783][52668] DAMAGECOUNT value on done: 161102.0 [2024-08-06 00:59:45,783][52668] Sum rewards: 53.616, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.984', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'weapon5': '0.210', 'AMMO3': '0.212', 'AMMO4': '0.230', 'weapon2': '0.342', 'WEAPON4': '0.600', 'weapon4': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.538', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:45,791][52660] DAMAGECOUNT value on done: 156634.0 [2024-08-06 00:59:45,791][52660] Sum rewards: 49.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.298', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.074', 'AMMO3': '0.131', 'weapon5': '0.218', 'AMMO4': '0.370', 'weapon2': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'WEAPON4': '0.950', 'weapon4': '1.026', 'weapon3': '2.058', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '41.000'} [2024-08-06 00:59:45,927][52667] DAMAGECOUNT value on done: 159123.0 [2024-08-06 00:59:45,929][52667] Sum rewards: 66.963, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.583', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:46,607][52650] Updated weights for policy 0, policy_version 26951 (0.0031) [2024-08-06 00:59:46,659][52662] DAMAGECOUNT value on done: 167298.0 [2024-08-06 00:59:46,661][52662] Sum rewards: 48.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '41.000'} [2024-08-06 00:59:46,677][52647] DAMAGECOUNT value on done: 165948.0 [2024-08-06 00:59:46,677][52647] Sum rewards: 44.991, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.944', 'AMMO5': '0.010', 'ARMOR': '0.034', 'AMMO2': '0.054', 'weapon5': '0.056', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'weapon2': '0.362', 'weapon4': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.932', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '42.000'} [2024-08-06 00:59:47,378][52803] DAMAGECOUNT value on done: 148169.0 [2024-08-06 00:59:47,386][52803] Sum rewards: 56.303, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.069', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.150', 'AMMO4': '0.158', 'weapon5': '0.206', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '2.972', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 220798976. Throughput: 0: 4387.8. Samples: 55199700. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 00:59:47,794][52567] Avg episode reward: [(0, '56.530')] [2024-08-06 00:59:48,073][52664] DAMAGECOUNT value on done: 161711.0 [2024-08-06 00:59:48,076][52664] Sum rewards: 50.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.574', 'AMMO5': '0.012', 'AMMO2': '0.019', 'ARMOR': '0.020', 'AMMO4': '0.096', 'weapon5': '0.114', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '44.000'} [2024-08-06 00:59:48,269][52811] DAMAGECOUNT value on done: 144520.0 [2024-08-06 00:59:48,269][52811] Sum rewards: 52.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.211', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.037', 'AMMO3': '0.139', 'AMMO4': '0.187', 'weapon5': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.516', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '44.000'} [2024-08-06 00:59:48,674][52794] DAMAGECOUNT value on done: 164921.0 [2024-08-06 00:59:48,675][52794] Sum rewards: 74.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.220', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '61.000'} [2024-08-06 00:59:48,696][52668] DAMAGECOUNT value on done: 158643.0 [2024-08-06 00:59:48,696][52668] Sum rewards: 66.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.037', 'weapon5': '0.066', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.280', 'WEAPON4': '0.450', 'weapon4': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '56.000'} [2024-08-06 00:59:48,733][52660] DAMAGECOUNT value on done: 155383.0 [2024-08-06 00:59:48,733][52660] Sum rewards: 56.826, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.884', 'AMMO5': '0.007', 'ARMOR': '0.009', 'weapon5': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.824', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:48,762][52820] DAMAGECOUNT value on done: 145596.0 [2024-08-06 00:59:48,763][52820] Sum rewards: 60.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.349', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.091', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon4': '0.444', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:48,922][52667] DAMAGECOUNT value on done: 159202.0 [2024-08-06 00:59:48,923][52667] Sum rewards: 54.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.398', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.400', 'weapon4': '0.506', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.558', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:49,755][52662] DAMAGECOUNT value on done: 161234.0 [2024-08-06 00:59:49,757][52662] Sum rewards: 59.727, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.078', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.000', 'HITCOUNT': '3.120', 'weapon3': '3.264', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:50,516][52803] DAMAGECOUNT value on done: 152252.0 [2024-08-06 00:59:50,519][52803] Sum rewards: 48.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.429', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.133', 'AMMO4': '0.241', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.466', 'WEAPON3': '0.850', 'HITCOUNT': '2.850', 'weapon3': '2.882', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '39.000'} [2024-08-06 00:59:50,556][52664] DAMAGECOUNT value on done: 165064.0 [2024-08-06 00:59:50,558][52664] Sum rewards: 66.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.836', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.080', 'AMMO3': '0.182', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:51,014][52650] Updated weights for policy 0, policy_version 26961 (0.0012) [2024-08-06 00:59:51,282][52811] DAMAGECOUNT value on done: 148991.0 [2024-08-06 00:59:51,283][52811] Sum rewards: 64.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.034', 'weapon5': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.354', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.298', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '53.000'} [2024-08-06 00:59:51,464][52668] DAMAGECOUNT value on done: 154659.0 [2024-08-06 00:59:51,464][52668] Sum rewards: 55.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.590', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.060', 'weapon5': '0.100', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.299', 'weapon4': '0.324', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:51,490][52660] DAMAGECOUNT value on done: 159577.0 [2024-08-06 00:59:51,492][52660] Sum rewards: 68.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.459', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.064', 'AMMO3': '0.211', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon4': '0.446', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.734', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '60.000'} [2024-08-06 00:59:51,505][52794] DAMAGECOUNT value on done: 158165.0 [2024-08-06 00:59:51,506][52794] Sum rewards: 60.538, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.314', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '53.000'} [2024-08-06 00:59:51,851][52820] DAMAGECOUNT value on done: 147270.0 [2024-08-06 00:59:51,853][52820] Sum rewards: 57.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.352', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:51,951][52667] DAMAGECOUNT value on done: 159935.0 [2024-08-06 00:59:51,951][52667] Sum rewards: 49.633, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.295', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon4': '0.208', 'weapon2': '0.242', 'AMMO3': '0.301', 'WEAPON3': '1.750', 'HITCOUNT': '2.880', 'weapon3': '2.972', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:52,745][52662] DAMAGECOUNT value on done: 166737.0 [2024-08-06 00:59:52,747][52662] Sum rewards: 61.985, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO3': '0.189', 'weapon2': '0.298', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.468', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '51.000'} [2024-08-06 00:59:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 220889088. Throughput: 0: 4392.9. Samples: 55226260. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 00:59:52,794][52567] Avg episode reward: [(0, '56.960')] [2024-08-06 00:59:53,631][52664] DAMAGECOUNT value on done: 166099.0 [2024-08-06 00:59:53,632][52664] Sum rewards: 57.304, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.778', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.095', 'weapon4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.490', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.158', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '51.000'} [2024-08-06 00:59:53,712][52803] DAMAGECOUNT value on done: 146958.0 [2024-08-06 00:59:53,713][52803] Sum rewards: 55.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:54,234][52794] DAMAGECOUNT value on done: 159202.0 [2024-08-06 00:59:54,234][52794] Sum rewards: 61.226, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.752', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'weapon4': '0.206', 'AMMO3': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '55.000'} [2024-08-06 00:59:54,342][52668] DAMAGECOUNT value on done: 150453.0 [2024-08-06 00:59:54,343][52668] Sum rewards: 52.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.885', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.966', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '46.000'} [2024-08-06 00:59:54,352][52660] DAMAGECOUNT value on done: 157418.0 [2024-08-06 00:59:54,352][52660] Sum rewards: 54.178, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.680', 'ARMOR': '0.004', 'AMMO2': '0.055', 'AMMO3': '0.254', 'AMMO4': '0.273', 'weapon4': '0.318', 'weapon2': '0.330', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:54,413][52811] DAMAGECOUNT value on done: 146835.0 [2024-08-06 00:59:54,416][52811] Sum rewards: 59.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'ARMOR': '0.004', 'AMMO5': '0.015', 'weapon5': '0.022', 'AMMO2': '0.043', 'weapon4': '0.044', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.256', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '51.000'} [2024-08-06 00:59:54,498][52667] DAMAGECOUNT value on done: 155869.0 [2024-08-06 00:59:54,498][52667] Sum rewards: 69.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.429', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.050', 'weapon5': '0.118', 'AMMO3': '0.187', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.348', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.000'} [2024-08-06 00:59:54,983][52820] DAMAGECOUNT value on done: 144488.0 [2024-08-06 00:59:54,985][52820] Sum rewards: 56.608, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.379', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon5': '0.160', 'AMMO4': '0.198', 'AMMO3': '0.206', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.176', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:55,299][52662] DAMAGECOUNT value on done: 159576.0 [2024-08-06 00:59:55,302][52662] Sum rewards: 53.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.600', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.056', 'weapon5': '0.140', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'AMMO4': '0.282', 'weapon4': '0.462', 'weapon2': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.592', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:56,047][52650] Updated weights for policy 0, policy_version 26971 (0.0024) [2024-08-06 00:59:56,524][52664] DAMAGECOUNT value on done: 160457.0 [2024-08-06 00:59:56,524][52664] Sum rewards: 61.855, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.886', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.134', 'AMMO3': '0.140', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '2.976', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '51.000'} [2024-08-06 00:59:56,729][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 00:59:56,772][52803] DAMAGECOUNT value on done: 151495.0 [2024-08-06 00:59:56,772][52803] Sum rewards: 56.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.506', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.185', 'weapon4': '0.320', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:56,890][52660] DAMAGECOUNT value on done: 158027.0 [2024-08-06 00:59:56,892][52660] Sum rewards: 65.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.615', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.080', 'weapon2': '0.134', 'AMMO3': '0.241', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.668', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '56.000'} [2024-08-06 00:59:56,899][52668] DAMAGECOUNT value on done: 156578.0 [2024-08-06 00:59:56,899][52668] Sum rewards: 65.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.019', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.166', 'WEAPON4': '0.350', 'weapon2': '0.454', 'weapon4': '0.714', 'WEAPON3': '1.000', 'weapon3': '2.622', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '54.000'} [2024-08-06 00:59:57,110][52794] DAMAGECOUNT value on done: 161288.0 [2024-08-06 00:59:57,112][52794] Sum rewards: 60.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.006', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.176', 'weapon4': '0.194', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '52.000'} [2024-08-06 00:59:57,445][52667] DAMAGECOUNT value on done: 159901.0 [2024-08-06 00:59:57,447][52667] Sum rewards: 46.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.092', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.133', 'AMMO4': '0.187', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.604', 'weapon4': '0.666', 'WEAPON3': '0.850', 'weapon3': '2.332', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '38.000'} [2024-08-06 00:59:57,515][52811] DAMAGECOUNT value on done: 148654.0 [2024-08-06 00:59:57,518][52811] Sum rewards: 62.744, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2024-08-06 00:59:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 220971008. Throughput: 0: 4383.5. Samples: 55252340. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 00:59:57,802][52567] Avg episode reward: [(0, '57.246')] [2024-08-06 00:59:58,138][52820] DAMAGECOUNT value on done: 149334.0 [2024-08-06 00:59:58,139][52820] Sum rewards: 62.837, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.064', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon2': '0.240', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'weapon4': '0.532', 'WEAPON3': '1.700', 'weapon3': '2.868', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '57.000'} [2024-08-06 00:59:58,428][52662] DAMAGECOUNT value on done: 164339.0 [2024-08-06 00:59:58,429][52662] Sum rewards: 65.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.266', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '56.000'} [2024-08-06 00:59:58,777][52663] Large shaping reward 2.558 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.537, 179.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 00:59:59,306][52669] DAMAGECOUNT value on done: 161642.0 [2024-08-06 00:59:59,307][52669] Sum rewards: 49.895, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.055', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.356', 'weapon4': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.092', 'FRAGCOUNT': '45.000'} [2024-08-06 00:59:59,710][52668] DAMAGECOUNT value on done: 153838.0 [2024-08-06 00:59:59,712][52668] Sum rewards: 42.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.193', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.590', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.832', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '39.000'} [2024-08-06 00:59:59,726][52660] DAMAGECOUNT value on done: 157330.0 [2024-08-06 00:59:59,727][52660] Sum rewards: 50.104, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.792', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.204', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon4': '0.310', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '2.770', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2024-08-06 00:59:59,797][52803] DAMAGECOUNT value on done: 145572.0 [2024-08-06 00:59:59,799][52803] Sum rewards: 58.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'weapon2': '0.362', 'weapon4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '50.000'} [2024-08-06 00:59:59,801][52664] DAMAGECOUNT value on done: 163599.0 [2024-08-06 00:59:59,802][52664] Sum rewards: 57.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.528', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.167', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.266', 'weapon2': '0.330', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.008', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '48.000'} [2024-08-06 00:59:59,835][52794] DAMAGECOUNT value on done: 160624.0 [2024-08-06 00:59:59,837][52794] Sum rewards: 57.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.092', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.454', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.628', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '49.000'} [2024-08-06 01:00:00,340][52667] DAMAGECOUNT value on done: 160409.0 [2024-08-06 01:00:00,342][52667] Sum rewards: 63.558, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.150', 'weapon5': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.260', 'AMMO3': '0.265', 'weapon4': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '57.000'} [2024-08-06 01:00:00,562][52811] DAMAGECOUNT value on done: 152631.0 [2024-08-06 01:00:00,563][52811] Sum rewards: 60.439, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.333', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.174', 'weapon2': '0.236', 'WEAPON3': '1.250', 'weapon3': '3.332', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '49.500'} [2024-08-06 01:00:00,656][52662] DAMAGECOUNT value on done: 159048.0 [2024-08-06 01:00:00,657][52662] Sum rewards: 60.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.648', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO3': '0.116', 'AMMO4': '0.133', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.478', 'WEAPON3': '0.750', 'weapon3': '2.902', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:00,907][52650] Updated weights for policy 0, policy_version 26981 (0.0014) [2024-08-06 01:00:01,455][52820] DAMAGECOUNT value on done: 147911.0 [2024-08-06 01:00:01,456][52820] Sum rewards: 48.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.734', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.058', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.220', 'AMMO4': '0.292', 'weapon2': '0.368', 'WEAPON4': '0.600', 'weapon4': '0.908', 'WEAPON3': '1.300', 'weapon3': '2.212', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '42.000'} [2024-08-06 01:00:01,954][52795] Large shaping reward -2.508 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.258, -86.0)] [2024-08-06 01:00:02,193][52794] DAMAGECOUNT value on done: 167639.0 [2024-08-06 01:00:02,195][52794] Sum rewards: 65.853, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.754', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.265', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.650', 'weapon3': '3.000', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '59.000'} [2024-08-06 01:00:02,343][52669] DAMAGECOUNT value on done: 158075.0 [2024-08-06 01:00:02,344][52669] Sum rewards: 50.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.609', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO4': '0.174', 'AMMO3': '0.222', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '44.000'} [2024-08-06 01:00:02,575][52668] DAMAGECOUNT value on done: 158938.0 [2024-08-06 01:00:02,575][52668] Sum rewards: 56.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.534', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.320', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '47.000'} [2024-08-06 01:00:02,667][52660] DAMAGECOUNT value on done: 161379.0 [2024-08-06 01:00:02,667][52660] Sum rewards: 54.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.058', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '44.500'} [2024-08-06 01:00:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 221069312. Throughput: 0: 4387.6. Samples: 55265690. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:00:02,795][52567] Avg episode reward: [(0, '57.521')] [2024-08-06 01:00:03,030][52803] DAMAGECOUNT value on done: 148120.0 [2024-08-06 01:00:03,030][52803] Sum rewards: 54.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.006', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.284', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '47.500'} [2024-08-06 01:00:03,151][52667] DAMAGECOUNT value on done: 161713.0 [2024-08-06 01:00:03,151][52667] Sum rewards: 47.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.839', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.160', 'weapon4': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.816', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '2.816', 'DAMAGECOUNT': '11.658', 'FRAGCOUNT': '40.000'} [2024-08-06 01:00:03,416][52662] DAMAGECOUNT value on done: 164045.0 [2024-08-06 01:00:03,418][52662] Sum rewards: 82.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.744', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.182', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.296', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '67.000'} [2024-08-06 01:00:03,611][52811] DAMAGECOUNT value on done: 148381.0 [2024-08-06 01:00:03,612][52811] Sum rewards: 59.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.824', 'AMMO5': '0.003', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.174', 'AMMO4': '0.233', 'weapon2': '0.384', 'WEAPON4': '0.550', 'weapon4': '1.072', 'WEAPON3': '1.100', 'weapon3': '2.232', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '52.000'} [2024-08-06 01:00:04,499][52820] DAMAGECOUNT value on done: 148061.0 [2024-08-06 01:00:04,502][52820] Sum rewards: 51.835, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.346', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.614', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:04,763][52669] DAMAGECOUNT value on done: 158217.0 [2024-08-06 01:00:04,763][52669] Sum rewards: 53.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.756', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.046', 'weapon5': '0.112', 'AMMO3': '0.217', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '47.000'} [2024-08-06 01:00:05,237][52650] Updated weights for policy 0, policy_version 26991 (0.0041) [2024-08-06 01:00:05,268][52794] DAMAGECOUNT value on done: 160675.0 [2024-08-06 01:00:05,270][52794] Sum rewards: 49.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.894', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.124', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.000', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '44.500'} [2024-08-06 01:00:05,615][52668] DAMAGECOUNT value on done: 157197.0 [2024-08-06 01:00:05,616][52668] Sum rewards: 58.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon5': '0.172', 'AMMO4': '0.182', 'WEAPON4': '0.400', 'weapon4': '0.486', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:05,658][52667] DAMAGECOUNT value on done: 157187.0 [2024-08-06 01:00:05,659][52667] Sum rewards: 66.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.766', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon2': '0.204', 'AMMO3': '0.214', 'WEAPON3': '1.400', 'HITCOUNT': '3.540', 'weapon3': '3.646', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2024-08-06 01:00:05,697][52660] DAMAGECOUNT value on done: 153515.0 [2024-08-06 01:00:05,698][52660] Sum rewards: 59.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.122', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.175', 'AMMO3': '0.188', 'weapon2': '0.386', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '51.000'} [2024-08-06 01:00:05,738][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:00:06,024][52803] DAMAGECOUNT value on done: 145143.0 [2024-08-06 01:00:06,024][52803] Sum rewards: 55.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO2': '0.043', 'AMMO3': '0.215', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.242', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '47.000'} [2024-08-06 01:00:06,379][52662] DAMAGECOUNT value on done: 161381.0 [2024-08-06 01:00:06,380][52662] Sum rewards: 54.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.958', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.028', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.240', 'weapon2': '0.268', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.086', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '49.000'} [2024-08-06 01:00:06,603][52811] DAMAGECOUNT value on done: 147945.0 [2024-08-06 01:00:06,603][52811] Sum rewards: 55.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.194', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.202', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:06,907][52649] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 01:00:07,385][52669] DAMAGECOUNT value on done: 156811.0 [2024-08-06 01:00:07,385][52669] Sum rewards: 52.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.058', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.219', 'weapon2': '0.262', 'weapon4': '0.472', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '2.950', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:07,532][52820] DAMAGECOUNT value on done: 146280.0 [2024-08-06 01:00:07,533][52820] Sum rewards: 39.157, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'weapon4': '0.324', 'weapon2': '0.364', 'WEAPON3': '1.650', 'HITCOUNT': '2.740', 'weapon3': '3.110', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '36.000'} [2024-08-06 01:00:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17613.4, 300 sec: 17550.3). Total num frames: 221151232. Throughput: 0: 4385.3. Samples: 55292100. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:00:07,794][52567] Avg episode reward: [(0, '57.047')] [2024-08-06 01:00:08,019][52794] DAMAGECOUNT value on done: 164637.0 [2024-08-06 01:00:08,020][52794] Sum rewards: 44.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'AMMO5': '0.003', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.544', 'weapon2': '0.736', 'WEAPON3': '1.300', 'weapon3': '2.438', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '38.000'} [2024-08-06 01:00:08,447][52668] DAMAGECOUNT value on done: 160138.0 [2024-08-06 01:00:08,449][52668] Sum rewards: 67.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.643', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.096', 'AMMO3': '0.183', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.364', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '56.000'} [2024-08-06 01:00:08,514][52660] DAMAGECOUNT value on done: 157485.0 [2024-08-06 01:00:08,516][52660] Sum rewards: 59.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO2': '0.034', 'AMMO3': '0.166', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '3.054', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:08,636][52667] DAMAGECOUNT value on done: 159456.0 [2024-08-06 01:00:08,637][52667] Sum rewards: 56.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.916', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.174', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '47.000'} [2024-08-06 01:00:09,200][52803] DAMAGECOUNT value on done: 152235.0 [2024-08-06 01:00:09,202][52803] Sum rewards: 58.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.876', 'AMMO5': '0.012', 'ARMOR': '0.024', 'weapon5': '0.060', 'AMMO2': '0.070', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'AMMO4': '0.348', 'weapon4': '0.488', 'weapon2': '0.574', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '53.000'} [2024-08-06 01:00:09,313][52662] DAMAGECOUNT value on done: 165036.0 [2024-08-06 01:00:09,313][52662] Sum rewards: 52.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.656', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.171', 'AMMO4': '0.231', 'weapon5': '0.336', 'weapon2': '0.386', 'WEAPON5': '0.400', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.622', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '43.000'} [2024-08-06 01:00:09,618][52811] DAMAGECOUNT value on done: 154325.0 [2024-08-06 01:00:09,619][52811] Sum rewards: 72.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.925', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.178', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.366', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '62.000'} [2024-08-06 01:00:10,050][52650] Updated weights for policy 0, policy_version 27001 (0.0029) [2024-08-06 01:00:10,483][52669] DAMAGECOUNT value on done: 158103.0 [2024-08-06 01:00:10,484][52669] Sum rewards: 51.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.518', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.172', 'WEAPON4': '0.400', 'weapon4': '0.488', 'weapon2': '0.990', 'WEAPON3': '1.000', 'weapon3': '2.296', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '46.000'} [2024-08-06 01:00:10,534][52794] DAMAGECOUNT value on done: 167693.0 [2024-08-06 01:00:10,536][52794] Sum rewards: 58.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.244', 'AMMO5': '0.005', 'AMMO2': '0.021', 'ARMOR': '0.028', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.492', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.664', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '49.000'} [2024-08-06 01:00:10,574][52820] DAMAGECOUNT value on done: 147218.0 [2024-08-06 01:00:10,574][52820] Sum rewards: 55.213, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.975', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '47.000'} [2024-08-06 01:00:11,242][52667] DAMAGECOUNT value on done: 160480.0 [2024-08-06 01:00:11,243][52667] Sum rewards: 35.624, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.333', 'weapon2': '0.512', 'WEAPON4': '0.550', 'weapon4': '0.960', 'WEAPON3': '1.150', 'weapon3': '2.188', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '11.100', 'FRAGCOUNT': '34.000'} [2024-08-06 01:00:11,693][52662] DAMAGECOUNT value on done: 158633.0 [2024-08-06 01:00:11,693][52662] Sum rewards: 57.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.112', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO3': '0.229', 'weapon2': '0.462', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.054', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '51.000'} [2024-08-06 01:00:11,737][52668] DAMAGECOUNT value on done: 162279.0 [2024-08-06 01:00:11,737][52668] Sum rewards: 64.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.722', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.216', 'weapon4': '0.436', 'WEAPON4': '0.450', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '56.500'} [2024-08-06 01:00:11,799][52660] DAMAGECOUNT value on done: 159404.0 [2024-08-06 01:00:11,802][52660] Sum rewards: 53.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.624', 'ARMOR': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.430', 'weapon4': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:12,237][52803] DAMAGECOUNT value on done: 151665.0 [2024-08-06 01:00:12,238][52803] Sum rewards: 51.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.908', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.169', 'AMMO3': '0.207', 'weapon5': '0.232', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '3.216', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '46.500'} [2024-08-06 01:00:12,751][52811] DAMAGECOUNT value on done: 147698.0 [2024-08-06 01:00:12,753][52811] Sum rewards: 64.499, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.066', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.416', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.918', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '56.000'} [2024-08-06 01:00:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 221241344. Throughput: 0: 4390.5. Samples: 55318290. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:00:12,795][52567] Avg episode reward: [(0, '56.637')] [2024-08-06 01:00:13,390][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:00:13,497][52794] DAMAGECOUNT value on done: 158825.0 [2024-08-06 01:00:13,497][52794] Sum rewards: 52.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.076', 'weapon5': '0.122', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.370', 'AMMO4': '0.379', 'weapon4': '0.522', 'WEAPON4': '0.850', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:13,636][52669] DAMAGECOUNT value on done: 156811.0 [2024-08-06 01:00:13,638][52669] Sum rewards: 50.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO4': '0.163', 'AMMO3': '0.248', 'weapon2': '0.360', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.058', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '44.000'} [2024-08-06 01:00:13,643][52820] DAMAGECOUNT value on done: 149257.0 [2024-08-06 01:00:13,646][52820] Sum rewards: 63.242, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.266', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '57.000'} [2024-08-06 01:00:14,125][52667] DAMAGECOUNT value on done: 160388.0 [2024-08-06 01:00:14,126][52667] Sum rewards: 59.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.366', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.158', 'AMMO3': '0.171', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '49.500'} [2024-08-06 01:00:14,367][52650] Updated weights for policy 0, policy_version 27011 (0.0018) [2024-08-06 01:00:14,687][52668] DAMAGECOUNT value on done: 160575.0 [2024-08-06 01:00:14,688][52668] Sum rewards: 63.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.471', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.116', 'AMMO3': '0.239', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'weapon4': '0.364', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '59.000'} [2024-08-06 01:00:14,712][52662] DAMAGECOUNT value on done: 162527.0 [2024-08-06 01:00:14,712][52662] Sum rewards: 56.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.146', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:14,755][52660] DAMAGECOUNT value on done: 167939.0 [2024-08-06 01:00:14,755][52660] Sum rewards: 62.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.312', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'weapon5': '0.070', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '53.000'} [2024-08-06 01:00:15,312][52803] DAMAGECOUNT value on done: 148437.0 [2024-08-06 01:00:15,312][52803] Sum rewards: 63.128, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.761', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.145', 'weapon5': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.748', 'WEAPON3': '0.950', 'weapon3': '2.686', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:15,829][52811] DAMAGECOUNT value on done: 147940.0 [2024-08-06 01:00:15,830][52811] Sum rewards: 56.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.542', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.235', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:16,344][52669] DAMAGECOUNT value on done: 160276.0 [2024-08-06 01:00:16,345][52669] Sum rewards: 67.406, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.944', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.076', 'weapon4': '0.094', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '57.000'} [2024-08-06 01:00:16,668][52794] DAMAGECOUNT value on done: 163513.0 [2024-08-06 01:00:16,671][52820] DAMAGECOUNT value on done: 146866.0 [2024-08-06 01:00:16,670][52794] Sum rewards: 59.121, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.701', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.165', 'WEAPON4': '0.350', 'weapon4': '0.434', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:16,672][52820] Sum rewards: 66.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.381', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.179', 'weapon4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '55.000'} [2024-08-06 01:00:16,695][52667] DAMAGECOUNT value on done: 157928.0 [2024-08-06 01:00:16,697][52667] Sum rewards: 54.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.517', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.018', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'AMMO4': '0.218', 'weapon4': '0.242', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.244', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '49.000'} [2024-08-06 01:00:17,558][52660] DAMAGECOUNT value on done: 156739.0 [2024-08-06 01:00:17,559][52660] Sum rewards: 58.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.335', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.208', 'weapon2': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.318', 'weapon4': '0.362', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 221331456. Throughput: 0: 4395.8. Samples: 55331680. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:00:17,794][52567] Avg episode reward: [(0, '57.515')] [2024-08-06 01:00:18,001][52662] DAMAGECOUNT value on done: 160978.0 [2024-08-06 01:00:18,005][52662] Sum rewards: 72.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.300', 'weapon4': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '60.000'} [2024-08-06 01:00:18,325][52803] DAMAGECOUNT value on done: 152360.0 [2024-08-06 01:00:18,325][52803] Sum rewards: 65.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.784', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.164', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.500', 'weapon4': '0.970', 'WEAPON3': '1.000', 'weapon3': '2.182', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.000'} [2024-08-06 01:00:18,443][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:00:19,019][52811] DAMAGECOUNT value on done: 149792.0 [2024-08-06 01:00:19,020][52811] Sum rewards: 43.803, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon5': '0.058', 'AMMO2': '0.078', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.389', 'weapon2': '0.618', 'WEAPON4': '0.650', 'weapon4': '0.728', 'WEAPON3': '1.050', 'weapon3': '2.286', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '40.000'} [2024-08-06 01:00:19,286][52650] Updated weights for policy 0, policy_version 27021 (0.0011) [2024-08-06 01:00:19,375][52669] DAMAGECOUNT value on done: 159348.0 [2024-08-06 01:00:19,378][52669] Sum rewards: 49.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO2': '0.005', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.026', 'weapon7': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.340', 'weapon4': '1.078', 'WEAPON3': '1.100', 'weapon3': '2.142', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '11.556', 'FRAGCOUNT': '42.000'} [2024-08-06 01:00:19,563][52667] DAMAGECOUNT value on done: 160331.0 [2024-08-06 01:00:19,563][52667] Sum rewards: 58.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.198', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:19,795][52794] DAMAGECOUNT value on done: 159510.0 [2024-08-06 01:00:19,796][52794] Sum rewards: 39.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.056', 'AMMO3': '0.198', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.496', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.400', 'HITCOUNT': '2.410', 'DAMAGECOUNT': '10.551', 'FRAGCOUNT': '36.000'} [2024-08-06 01:00:19,846][52820] DAMAGECOUNT value on done: 147023.0 [2024-08-06 01:00:19,847][52820] Sum rewards: 53.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.226', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.138', 'weapon5': '0.174', 'AMMO4': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON4': '0.450', 'weapon4': '0.678', 'WEAPON3': '0.850', 'weapon3': '2.444', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:20,048][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:00:20,696][52660] DAMAGECOUNT value on done: 160097.0 [2024-08-06 01:00:20,698][52660] Sum rewards: 53.566, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.695', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon4': '0.442', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '2.706', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:21,127][52662] DAMAGECOUNT value on done: 159991.0 [2024-08-06 01:00:21,129][52662] Sum rewards: 62.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.439', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.736', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:21,336][52803] DAMAGECOUNT value on done: 146990.0 [2024-08-06 01:00:21,337][52803] Sum rewards: 55.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.176', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '46.000'} [2024-08-06 01:00:21,990][52667] DAMAGECOUNT value on done: 156856.0 [2024-08-06 01:00:21,991][52667] Sum rewards: 59.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.224', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.054', 'weapon5': '0.138', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'weapon2': '0.364', 'WEAPON4': '0.600', 'weapon4': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.512', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:22,005][52669] DAMAGECOUNT value on done: 159764.0 [2024-08-06 01:00:22,005][52669] Sum rewards: 51.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.526', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.094', 'AMMO4': '0.198', 'AMMO3': '0.203', 'weapon5': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.714', 'WEAPON3': '1.200', 'HITCOUNT': '2.480', 'weapon3': '2.662', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '45.500'} [2024-08-06 01:00:22,118][52811] DAMAGECOUNT value on done: 147779.0 [2024-08-06 01:00:22,118][52811] Sum rewards: 48.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.151', 'weapon5': '0.208', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.620', 'weapon2': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.288', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '39.500'} [2024-08-06 01:00:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 221413376. Throughput: 0: 4392.9. Samples: 55358020. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:00:22,794][52567] Avg episode reward: [(0, '57.299')] [2024-08-06 01:00:22,895][52794] DAMAGECOUNT value on done: 169864.0 [2024-08-06 01:00:22,895][52794] Sum rewards: 53.037, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.050', 'weapon5': '0.154', 'AMMO3': '0.243', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.450', 'weapon4': '0.852', 'WEAPON3': '1.450', 'weapon3': '2.444', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '47.500'} [2024-08-06 01:00:22,928][52820] DAMAGECOUNT value on done: 150727.0 [2024-08-06 01:00:22,928][52820] Sum rewards: 57.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.199', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:23,539][52650] Updated weights for policy 0, policy_version 27031 (0.0012) [2024-08-06 01:00:23,702][52660] DAMAGECOUNT value on done: 151016.0 [2024-08-06 01:00:23,704][52660] Sum rewards: 44.949, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.477', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon7': '0.072', 'AMMO4': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.106', 'weapon2': '0.610', 'WEAPON3': '0.700', 'weapon4': '0.700', 'HITCOUNT': '2.330', 'weapon3': '2.440', 'DAMAGECOUNT': '10.146', 'FRAGCOUNT': '34.500'} [2024-08-06 01:00:24,371][52667] DAMAGECOUNT value on done: 162072.0 [2024-08-06 01:00:24,373][52667] Sum rewards: 55.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.403', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.128', 'AMMO3': '0.157', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '2.850', 'weapon3': '2.874', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:24,419][52803] DAMAGECOUNT value on done: 145173.0 [2024-08-06 01:00:24,419][52803] Sum rewards: 57.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.052', 'weapon4': '0.110', 'AMMO4': '0.119', 'AMMO3': '0.162', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.102', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:24,898][52658] DAMAGECOUNT value on done: 163224.0 [2024-08-06 01:00:24,899][52658] Sum rewards: 46.823, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.226', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.074', 'weapon4': '0.082', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'weapon2': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.332', 'DAMAGECOUNT': '13.152', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:24,977][52669] DAMAGECOUNT value on done: 156211.0 [2024-08-06 01:00:24,977][52669] Sum rewards: 67.302, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.823', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.122', 'AMMO4': '0.210', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.546', 'weapon4': '0.742', 'WEAPON3': '1.300', 'weapon3': '2.290', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '58.000'} [2024-08-06 01:00:25,221][52811] DAMAGECOUNT value on done: 150481.0 [2024-08-06 01:00:25,222][52811] Sum rewards: 56.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'AMMO3': '0.202', 'weapon2': '0.598', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.216', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '46.000'} [2024-08-06 01:00:26,068][52820] DAMAGECOUNT value on done: 152595.0 [2024-08-06 01:00:26,069][52820] Sum rewards: 59.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.196', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.638', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '51.000'} [2024-08-06 01:00:26,129][52794] DAMAGECOUNT value on done: 157241.0 [2024-08-06 01:00:26,130][52794] Sum rewards: 66.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.084', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:26,236][52660] DAMAGECOUNT value on done: 161535.0 [2024-08-06 01:00:26,239][52660] Sum rewards: 54.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.702', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.400', 'weapon4': '0.486', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.606', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '45.500'} [2024-08-06 01:00:27,203][52667] DAMAGECOUNT value on done: 165468.0 [2024-08-06 01:00:27,207][52667] Sum rewards: 61.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.834', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.161', 'WEAPON4': '0.350', 'weapon4': '0.534', 'weapon2': '0.618', 'WEAPON3': '0.950', 'weapon3': '2.560', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '50.000'} [2024-08-06 01:00:27,550][52803] DAMAGECOUNT value on done: 151843.0 [2024-08-06 01:00:27,553][52803] Sum rewards: 67.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.614', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.235', 'WEAPON4': '0.400', 'weapon2': '0.484', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.662', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '55.000'} [2024-08-06 01:00:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 221503488. Throughput: 0: 4395.1. Samples: 55384250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:00:27,795][52567] Avg episode reward: [(0, '57.121')] [2024-08-06 01:00:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027039_221503488.pth... [2024-08-06 01:00:27,901][52658] DAMAGECOUNT value on done: 159872.0 [2024-08-06 01:00:27,902][52658] Sum rewards: 61.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.052', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:27,957][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026525_217292800.pth [2024-08-06 01:00:28,175][52669] DAMAGECOUNT value on done: 159624.0 [2024-08-06 01:00:28,175][52669] Sum rewards: 52.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.134', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'weapon2': '0.462', 'weapon4': '0.830', 'WEAPON3': '1.100', 'weapon3': '2.436', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '44.000'} [2024-08-06 01:00:28,339][52811] DAMAGECOUNT value on done: 149222.0 [2024-08-06 01:00:28,341][52811] Sum rewards: 65.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.883', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'weapon4': '0.134', 'AMMO3': '0.210', 'weapon2': '0.828', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '55.000'} [2024-08-06 01:00:28,653][52650] Updated weights for policy 0, policy_version 27041 (0.0013) [2024-08-06 01:00:28,664][52660] DAMAGECOUNT value on done: 155069.0 [2024-08-06 01:00:28,667][52660] Sum rewards: 49.550, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.156', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.166', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '40.000'} [2024-08-06 01:00:29,260][52794] DAMAGECOUNT value on done: 166971.0 [2024-08-06 01:00:29,264][52794] Sum rewards: 59.963, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.162', 'AMMO3': '0.167', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.776', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '49.000'} [2024-08-06 01:00:29,330][52820] DAMAGECOUNT value on done: 145929.0 [2024-08-06 01:00:29,331][52820] Sum rewards: 48.809, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.304', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.268', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.436', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '43.000'} [2024-08-06 01:00:30,350][52667] DAMAGECOUNT value on done: 164557.0 [2024-08-06 01:00:30,364][52667] Sum rewards: 52.545, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.335', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.130', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.512', 'weapon4': '0.764', 'WEAPON3': '1.050', 'weapon3': '2.428', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '44.000'} [2024-08-06 01:00:30,686][52803] DAMAGECOUNT value on done: 147394.0 [2024-08-06 01:00:30,689][52803] Sum rewards: 71.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.707', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.037', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon2': '0.448', 'weapon4': '0.544', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '59.000'} [2024-08-06 01:00:31,166][52658] DAMAGECOUNT value on done: 162941.0 [2024-08-06 01:00:31,166][52658] Sum rewards: 64.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.361', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:31,248][52669] DAMAGECOUNT value on done: 160474.0 [2024-08-06 01:00:31,250][52669] Sum rewards: 50.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.272', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.332', 'WEAPON4': '0.400', 'ARMOR': '0.412', 'weapon2': '0.430', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.998', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '44.000'} [2024-08-06 01:00:31,496][52811] DAMAGECOUNT value on done: 151033.0 [2024-08-06 01:00:31,500][52811] Sum rewards: 54.406, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.396', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.058', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon4': '0.470', 'weapon2': '0.510', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:32,369][52794] DAMAGECOUNT value on done: 161007.0 [2024-08-06 01:00:32,369][52794] Sum rewards: 58.707, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.018', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon5': '0.188', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '2.920', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 221593600. Throughput: 0: 4384.9. Samples: 55397020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:00:32,794][52567] Avg episode reward: [(0, '56.989')] [2024-08-06 01:00:33,195][52650] Updated weights for policy 0, policy_version 27051 (0.0013) [2024-08-06 01:00:33,335][52667] DAMAGECOUNT value on done: 165491.0 [2024-08-06 01:00:33,337][52667] Sum rewards: 64.261, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.592', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.155', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.662', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '52.000'} [2024-08-06 01:00:33,718][52803] DAMAGECOUNT value on done: 152123.0 [2024-08-06 01:00:33,718][52803] Sum rewards: 69.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.721', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.068', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.234', 'WEAPON3': '1.550', 'weapon3': '3.292', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '59.000'} [2024-08-06 01:00:34,022][52658] DAMAGECOUNT value on done: 162467.0 [2024-08-06 01:00:34,023][52658] Sum rewards: 45.895, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.804', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.175', 'weapon5': '0.190', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.966', 'WEAPON3': '1.000', 'weapon3': '2.108', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '41.000'} [2024-08-06 01:00:34,651][52669] DAMAGECOUNT value on done: 155949.0 [2024-08-06 01:00:34,676][52669] Sum rewards: 47.264, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.028', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.074', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.224', 'AMMO4': '0.368', 'WEAPON4': '0.700', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '42.000'} [2024-08-06 01:00:34,750][52811] DAMAGECOUNT value on done: 146720.0 [2024-08-06 01:00:34,750][52811] Sum rewards: 36.721, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.505', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.052', 'AMMO2': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'AMMO4': '0.276', 'weapon2': '0.372', 'weapon4': '0.392', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'HITCOUNT': '2.480', 'weapon3': '2.822', 'DAMAGECOUNT': '11.505', 'FRAGCOUNT': '36.000'} [2024-08-06 01:00:35,115][52794] DAMAGECOUNT value on done: 161393.0 [2024-08-06 01:00:35,116][52794] Sum rewards: 54.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.027', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'weapon5': '0.134', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.880', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '44.000'} [2024-08-06 01:00:36,345][52667] DAMAGECOUNT value on done: 158161.0 [2024-08-06 01:00:36,345][52667] Sum rewards: 54.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.013', 'AMMO2': '0.018', 'ARMOR': '0.020', 'weapon5': '0.080', 'weapon4': '0.086', 'AMMO4': '0.089', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '47.000'} [2024-08-06 01:00:36,790][52803] DAMAGECOUNT value on done: 143681.0 [2024-08-06 01:00:36,791][52803] Sum rewards: 64.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.326', 'WEAPON3': '1.050', 'weapon3': '3.202', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '53.000'} [2024-08-06 01:00:37,012][52658] DAMAGECOUNT value on done: 162577.0 [2024-08-06 01:00:37,014][52658] Sum rewards: 63.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.536', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.288', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.108', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:37,529][52669] DAMAGECOUNT value on done: 160216.0 [2024-08-06 01:00:37,529][52669] Sum rewards: 54.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.654', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO3': '0.176', 'weapon4': '0.182', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '2.954', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 221675520. Throughput: 0: 4384.4. Samples: 55423560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:00:37,794][52567] Avg episode reward: [(0, '56.818')] [2024-08-06 01:00:37,832][52811] DAMAGECOUNT value on done: 151852.0 [2024-08-06 01:00:37,834][52811] Sum rewards: 59.901, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO4': '0.155', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.420', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '52.000'} [2024-08-06 01:00:38,013][52650] Updated weights for policy 0, policy_version 27061 (0.0014) [2024-08-06 01:00:38,185][52666] DAMAGECOUNT value on done: 161625.0 [2024-08-06 01:00:38,185][52666] Sum rewards: 63.950, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.078', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '57.000'} [2024-08-06 01:00:38,244][52794] DAMAGECOUNT value on done: 168816.0 [2024-08-06 01:00:38,254][52794] Sum rewards: 72.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.054', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '60.000'} [2024-08-06 01:00:38,662][52667] DAMAGECOUNT value on done: 165278.0 [2024-08-06 01:00:38,664][52667] Sum rewards: 60.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.061', 'weapon5': '0.122', 'AMMO3': '0.156', 'weapon2': '0.278', 'WEAPON5': '0.300', 'AMMO4': '0.307', 'weapon4': '0.398', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '51.000'} [2024-08-06 01:00:39,356][52658] DAMAGECOUNT value on done: 156241.0 [2024-08-06 01:00:39,357][52658] Sum rewards: 54.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.992', 'ARMOR': '0.004', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon2': '0.168', 'weapon4': '0.208', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.452', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:40,406][52669] DAMAGECOUNT value on done: 165429.0 [2024-08-06 01:00:40,407][52669] Sum rewards: 42.535, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.656', 'AMMO5': '0.008', 'AMMO2': '0.075', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.373', 'weapon2': '0.624', 'WEAPON4': '0.700', 'weapon4': '0.732', 'WEAPON3': '1.250', 'weapon3': '2.244', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.355', 'FRAGCOUNT': '41.000'} [2024-08-06 01:00:40,735][52794] DAMAGECOUNT value on done: 162693.0 [2024-08-06 01:00:40,738][52794] Sum rewards: 45.812, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.342', 'AMMO2': '0.006', 'AMMO4': '0.027', 'AMMO3': '0.128', 'WEAPON3': '0.800', 'weapon2': '0.844', 'HITCOUNT': '2.670', 'weapon3': '3.054', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '36.000'} [2024-08-06 01:00:40,972][52811] DAMAGECOUNT value on done: 147676.0 [2024-08-06 01:00:40,972][52811] Sum rewards: 53.581, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.390', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.164', 'AMMO3': '0.243', 'AMMO4': '0.291', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '51.000'} [2024-08-06 01:00:41,176][52666] DAMAGECOUNT value on done: 161649.0 [2024-08-06 01:00:41,177][52666] Sum rewards: 65.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.809', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.200', 'AMMO4': '0.234', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '55.000'} [2024-08-06 01:00:42,259][52658] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:00:42,358][52658] DAMAGECOUNT value on done: 165355.0 [2024-08-06 01:00:42,359][52658] Sum rewards: 64.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.130', 'AMMO3': '0.193', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '53.000'} [2024-08-06 01:00:42,421][52650] Updated weights for policy 0, policy_version 27071 (0.0022) [2024-08-06 01:00:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 221765632. Throughput: 0: 4394.7. Samples: 55450100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:00:42,794][52567] Avg episode reward: [(0, '56.847')] [2024-08-06 01:00:43,134][52669] DAMAGECOUNT value on done: 170213.0 [2024-08-06 01:00:43,134][52669] Sum rewards: 48.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.146', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.048', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'weapon2': '0.548', 'weapon4': '0.784', 'WEAPON3': '1.600', 'weapon3': '2.122', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '46.000'} [2024-08-06 01:00:43,953][52666] DAMAGECOUNT value on done: 160828.0 [2024-08-06 01:00:43,953][52666] Sum rewards: 71.219, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'weapon5': '0.058', 'WEAPON4': '0.100', 'HEALTH': '0.104', 'AMMO3': '0.131', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON3': '0.750', 'weapon2': '0.810', 'weapon3': '2.740', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '54.500'} [2024-08-06 01:00:44,050][52811] DAMAGECOUNT value on done: 150907.0 [2024-08-06 01:00:44,050][52811] Sum rewards: 64.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.521', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.158', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.538', 'WEAPON3': '0.950', 'weapon3': '2.862', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:44,880][52649] DAMAGECOUNT value on done: 155898.0 [2024-08-06 01:00:44,882][52649] Sum rewards: 62.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.572', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.052', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.261', 'weapon2': '0.458', 'weapon4': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:44,961][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:00:45,312][52658] DAMAGECOUNT value on done: 155590.0 [2024-08-06 01:00:45,314][52658] Sum rewards: 55.814, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.108', 'AMMO4': '0.128', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '46.000'} [2024-08-06 01:00:46,332][52669] DAMAGECOUNT value on done: 160225.0 [2024-08-06 01:00:46,333][52669] Sum rewards: 68.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.082', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.708', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.000'} [2024-08-06 01:00:46,697][52666] DAMAGECOUNT value on done: 157972.0 [2024-08-06 01:00:46,697][52666] Sum rewards: 59.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.390', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.062', 'AMMO3': '0.193', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.648', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2024-08-06 01:00:47,151][52650] Updated weights for policy 0, policy_version 27081 (0.0023) [2024-08-06 01:00:47,408][52670] DAMAGECOUNT value on done: 157271.0 [2024-08-06 01:00:47,408][52670] Sum rewards: 45.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.648', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon4': '0.224', 'weapon5': '0.226', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '2.662', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '39.000'} [2024-08-06 01:00:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 221855744. Throughput: 0: 4398.0. Samples: 55463600. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:00:47,794][52567] Avg episode reward: [(0, '57.053')] [2024-08-06 01:00:47,872][52658] DAMAGECOUNT value on done: 166158.0 [2024-08-06 01:00:47,874][52658] Sum rewards: 62.335, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.146', 'weapon2': '0.466', 'HEALTH': '0.744', 'WEAPON3': '0.800', 'HITCOUNT': '3.040', 'weapon3': '3.396', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '49.000'} [2024-08-06 01:00:48,151][52649] DAMAGECOUNT value on done: 151751.0 [2024-08-06 01:00:48,152][52649] Sum rewards: 37.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon5': '0.174', 'AMMO4': '0.200', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon4': '1.072', 'HITCOUNT': '2.140', 'weapon3': '2.232', 'DAMAGECOUNT': '10.062', 'FRAGCOUNT': '34.000'} [2024-08-06 01:00:49,137][52820] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:00:49,741][52666] DAMAGECOUNT value on done: 155195.0 [2024-08-06 01:00:49,744][52666] Sum rewards: 47.000, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.840', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'weapon4': '0.216', 'AMMO3': '0.305', 'weapon2': '0.362', 'WEAPON3': '1.800', 'HITCOUNT': '2.940', 'weapon3': '3.190', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '46.000'} [2024-08-06 01:00:49,828][52669] DAMAGECOUNT value on done: 161761.0 [2024-08-06 01:00:49,829][52669] Sum rewards: 67.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.939', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.142', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '58.000'} [2024-08-06 01:00:50,391][52614] Signal inference workers to stop experience collection... (5000 times) [2024-08-06 01:00:50,392][52614] Signal inference workers to resume experience collection... (5000 times) [2024-08-06 01:00:50,427][52650] InferenceWorker_p0-w0: stopping experience collection (5000 times) [2024-08-06 01:00:50,427][52650] InferenceWorker_p0-w0: resuming experience collection (5000 times) [2024-08-06 01:00:50,553][52670] DAMAGECOUNT value on done: 161986.0 [2024-08-06 01:00:50,553][52670] Sum rewards: 52.740, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.360', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.057', 'weapon5': '0.160', 'AMMO3': '0.197', 'AMMO4': '0.285', 'WEAPON5': '0.300', 'weapon2': '0.394', 'weapon4': '0.546', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.610', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:50,704][52658] DAMAGECOUNT value on done: 166920.0 [2024-08-06 01:00:50,706][52658] Sum rewards: 73.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.485', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon2': '0.128', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.690', 'weapon3': '3.732', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '63.000'} [2024-08-06 01:00:51,319][52649] DAMAGECOUNT value on done: 156096.0 [2024-08-06 01:00:51,320][52649] Sum rewards: 74.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.752', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon4': '0.256', 'weapon2': '0.282', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '63.000'} [2024-08-06 01:00:51,662][52650] Updated weights for policy 0, policy_version 27091 (0.0011) [2024-08-06 01:00:52,508][52669] DAMAGECOUNT value on done: 161620.0 [2024-08-06 01:00:52,509][52669] Sum rewards: 62.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.226', 'AMMO3': '0.249', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.460', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '52.500'} [2024-08-06 01:00:52,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 221937664. Throughput: 0: 4387.8. Samples: 55489550. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:00:52,795][52567] Avg episode reward: [(0, '57.530')] [2024-08-06 01:00:52,983][52666] DAMAGECOUNT value on done: 153787.0 [2024-08-06 01:00:52,985][52666] Sum rewards: 59.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.301', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.121', 'AMMO3': '0.175', 'weapon2': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '49.000'} [2024-08-06 01:00:53,305][52658] DAMAGECOUNT value on done: 165715.0 [2024-08-06 01:00:53,305][52658] Sum rewards: 44.483, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.156', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.146', 'AMMO4': '0.225', 'AMMO3': '0.249', 'weapon5': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.500', 'weapon3': '2.678', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '41.000'} [2024-08-06 01:00:53,721][52670] DAMAGECOUNT value on done: 157884.0 [2024-08-06 01:00:53,723][52670] Sum rewards: 60.332, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.100', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.404', 'weapon4': '0.412', 'ARMOR': '0.472', 'WEAPON3': '1.600', 'weapon3': '2.906', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:54,059][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:00:54,367][52649] DAMAGECOUNT value on done: 156992.0 [2024-08-06 01:00:54,367][52649] Sum rewards: 66.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.228', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '54.000'} [2024-08-06 01:00:55,453][52669] DAMAGECOUNT value on done: 164721.0 [2024-08-06 01:00:55,456][52669] Sum rewards: 64.149, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.222', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '56.000'} [2024-08-06 01:00:55,770][52666] DAMAGECOUNT value on done: 157508.0 [2024-08-06 01:00:55,772][52666] Sum rewards: 51.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.110', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'AMMO4': '0.297', 'weapon2': '0.412', 'WEAPON4': '0.600', 'weapon4': '0.778', 'WEAPON3': '1.250', 'weapon3': '2.442', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:56,192][52658] DAMAGECOUNT value on done: 155309.0 [2024-08-06 01:00:56,196][52658] Sum rewards: 48.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO3': '0.174', 'AMMO4': '0.175', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '2.984', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '40.000'} [2024-08-06 01:00:56,320][52670] DAMAGECOUNT value on done: 157352.0 [2024-08-06 01:00:56,321][52670] Sum rewards: 53.217, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.629', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.060', 'weapon5': '0.060', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.266', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'HITCOUNT': '3.070', 'weapon3': '3.396', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '48.000'} [2024-08-06 01:00:56,630][52650] Updated weights for policy 0, policy_version 27101 (0.0019) [2024-08-06 01:00:57,036][52649] DAMAGECOUNT value on done: 149830.0 [2024-08-06 01:00:57,037][52649] Sum rewards: 35.327, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.410', 'AMMO5': '0.014', 'ARMOR': '0.032', 'AMMO2': '0.047', 'weapon5': '0.144', 'AMMO3': '0.210', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'weapon4': '0.404', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.658', 'DAMAGECOUNT': '11.250', 'FRAGCOUNT': '33.000'} [2024-08-06 01:00:57,776][52649] Large shaping reward 2.602 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 01:00:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 222035968. Throughput: 0: 4395.6. Samples: 55516090. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:00:57,794][52567] Avg episode reward: [(0, '57.300')] [2024-08-06 01:00:58,289][52666] DAMAGECOUNT value on done: 158509.0 [2024-08-06 01:00:58,301][52666] Sum rewards: 62.322, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.554', 'weapon7': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.158', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.804', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '55.000'} [2024-08-06 01:00:59,093][52670] DAMAGECOUNT value on done: 157718.0 [2024-08-06 01:00:59,094][52670] Sum rewards: 52.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.555', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon5': '0.196', 'AMMO4': '0.217', 'weapon2': '0.318', 'WEAPON4': '0.500', 'weapon4': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.562', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '45.000'} [2024-08-06 01:00:59,149][52658] DAMAGECOUNT value on done: 160368.0 [2024-08-06 01:00:59,150][52658] Sum rewards: 63.991, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.062', 'AMMO3': '0.176', 'weapon5': '0.188', 'AMMO4': '0.312', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON4': '0.600', 'weapon4': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.414', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:00,208][52649] DAMAGECOUNT value on done: 154952.0 [2024-08-06 01:01:00,208][52649] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.308', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.202', 'AMMO3': '0.216', 'weapon5': '0.228', 'AMMO4': '0.285', 'weapon2': '0.296', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '2.962', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:00,804][52650] Updated weights for policy 0, policy_version 27111 (0.0011) [2024-08-06 01:01:01,158][52666] DAMAGECOUNT value on done: 160026.0 [2024-08-06 01:01:01,160][52666] Sum rewards: 66.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.366', 'weapon4': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:01,912][52670] DAMAGECOUNT value on done: 160217.0 [2024-08-06 01:01:01,914][52670] Sum rewards: 58.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.392', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.188', 'WEAPON4': '0.400', 'weapon4': '0.436', 'weapon2': '0.492', 'WEAPON3': '0.950', 'weapon3': '2.688', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:02,549][52658] DAMAGECOUNT value on done: 160195.0 [2024-08-06 01:01:02,550][52658] Sum rewards: 62.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.467', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.294', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.354', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:02,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 222117888. Throughput: 0: 4390.7. Samples: 55529260. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:01:02,794][52567] Avg episode reward: [(0, '57.622')] [2024-08-06 01:01:03,415][52649] DAMAGECOUNT value on done: 152304.0 [2024-08-06 01:01:03,415][52649] Sum rewards: 52.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon4': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:03,928][52666] DAMAGECOUNT value on done: 158971.0 [2024-08-06 01:01:03,929][52666] Sum rewards: 59.830, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.385', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.206', 'AMMO4': '0.208', 'AMMO3': '0.249', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.672', 'WEAPON3': '1.550', 'weapon3': '2.582', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '53.000'} [2024-08-06 01:01:04,487][52670] DAMAGECOUNT value on done: 153503.0 [2024-08-06 01:01:04,489][52670] Sum rewards: 54.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.215', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.344', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:05,893][52658] DAMAGECOUNT value on done: 158923.0 [2024-08-06 01:01:05,894][52658] Sum rewards: 51.791, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.402', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'weapon7': '0.050', 'AMMO4': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'weapon2': '0.390', 'WEAPON3': '0.750', 'weapon4': '0.838', 'weapon3': '2.564', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '39.000'} [2024-08-06 01:01:05,897][52650] Updated weights for policy 0, policy_version 27121 (0.0017) [2024-08-06 01:01:06,468][52649] DAMAGECOUNT value on done: 160026.0 [2024-08-06 01:01:06,470][52649] Sum rewards: 58.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.998', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.134', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.504', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '46.000'} [2024-08-06 01:01:06,988][52666] DAMAGECOUNT value on done: 156005.0 [2024-08-06 01:01:06,989][52666] Sum rewards: 58.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.714', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '50.000'} [2024-08-06 01:01:07,449][52671] DAMAGECOUNT value on done: 166220.0 [2024-08-06 01:01:07,450][52671] Sum rewards: 53.804, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.515', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:07,470][52670] DAMAGECOUNT value on done: 159648.0 [2024-08-06 01:01:07,470][52670] Sum rewards: 55.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon4': '0.330', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '46.000'} [2024-08-06 01:01:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 222199808. Throughput: 0: 4389.3. Samples: 55555540. Policy #0 lag: (min: 1.0, avg: 4.7, max: 9.0) [2024-08-06 01:01:07,794][52567] Avg episode reward: [(0, '57.140')] [2024-08-06 01:01:09,048][52658] DAMAGECOUNT value on done: 163076.0 [2024-08-06 01:01:09,051][52658] Sum rewards: 63.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'ARMOR': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.163', 'weapon2': '0.342', 'WEAPON4': '0.350', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '52.000'} [2024-08-06 01:01:09,228][52666] DAMAGECOUNT value on done: 153568.0 [2024-08-06 01:01:09,229][52666] Sum rewards: 44.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.745', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.042', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'weapon2': '0.236', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.660', 'weapon3': '3.420', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '42.000'} [2024-08-06 01:01:09,272][52649] DAMAGECOUNT value on done: 154407.0 [2024-08-06 01:01:09,273][52649] Sum rewards: 59.844, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.057', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.306', 'ARMOR': '0.453', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '49.000'} [2024-08-06 01:01:09,839][52670] DAMAGECOUNT value on done: 153798.0 [2024-08-06 01:01:09,841][52670] Sum rewards: 56.681, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.200', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.158', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:10,055][52671] DAMAGECOUNT value on done: 159486.0 [2024-08-06 01:01:10,055][52671] Sum rewards: 54.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.102', 'weapon4': '0.190', 'AMMO3': '0.198', 'weapon2': '0.466', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.224', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:10,496][52650] Updated weights for policy 0, policy_version 27131 (0.0012) [2024-08-06 01:01:12,044][52666] DAMAGECOUNT value on done: 161438.0 [2024-08-06 01:01:12,046][52666] Sum rewards: 61.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.560', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.030', 'weapon4': '0.110', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.338', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:12,142][52649] DAMAGECOUNT value on done: 156002.0 [2024-08-06 01:01:12,142][52649] Sum rewards: 57.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.124', 'AMMO2': '0.012', 'ARMOR': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.240', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.630', 'WEAPON3': '1.500', 'weapon3': '2.896', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '51.000'} [2024-08-06 01:01:12,194][52658] DAMAGECOUNT value on done: 163975.0 [2024-08-06 01:01:12,196][52658] Sum rewards: 45.865, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.554', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.190', 'AMMO3': '0.265', 'AMMO4': '0.273', 'weapon2': '0.312', 'WEAPON5': '0.350', 'weapon4': '0.458', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'HITCOUNT': '2.660', 'weapon3': '2.696', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '44.000'} [2024-08-06 01:01:12,290][52671] DAMAGECOUNT value on done: 165044.0 [2024-08-06 01:01:12,291][52671] Sum rewards: 52.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.048', 'weapon5': '0.096', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'weapon2': '0.406', 'weapon4': '0.544', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.724', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:12,424][52663] DAMAGECOUNT value on done: 159790.0 [2024-08-06 01:01:12,424][52663] Sum rewards: 66.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.744', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.050', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.266', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '56.000'} [2024-08-06 01:01:12,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 222298112. Throughput: 0: 4396.4. Samples: 55582090. Policy #0 lag: (min: 1.0, avg: 4.7, max: 9.0) [2024-08-06 01:01:12,795][52567] Avg episode reward: [(0, '57.268')] [2024-08-06 01:01:12,810][52670] DAMAGECOUNT value on done: 150530.0 [2024-08-06 01:01:12,812][52670] Sum rewards: 54.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.038', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'AMMO3': '0.232', 'weapon2': '0.476', 'WEAPON4': '0.500', 'weapon4': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '49.000'} [2024-08-06 01:01:12,981][52659] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon5', 0.002)] [2024-08-06 01:01:14,324][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:01:14,870][52650] Updated weights for policy 0, policy_version 27141 (0.0020) [2024-08-06 01:01:15,109][52649] DAMAGECOUNT value on done: 156500.0 [2024-08-06 01:01:15,111][52649] Sum rewards: 58.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.156', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:15,145][52666] DAMAGECOUNT value on done: 161678.0 [2024-08-06 01:01:15,146][52666] Sum rewards: 51.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.005', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon5': '0.214', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:15,210][52658] DAMAGECOUNT value on done: 156621.0 [2024-08-06 01:01:15,211][52658] Sum rewards: 61.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.968', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.162', 'weapon5': '0.234', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.602', 'WEAPON3': '1.000', 'weapon3': '2.354', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '50.000'} [2024-08-06 01:01:15,418][52671] DAMAGECOUNT value on done: 159080.0 [2024-08-06 01:01:15,420][52671] Sum rewards: 59.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.006', 'ARMOR': '0.018', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.121', 'AMMO3': '0.147', 'weapon4': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.918', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '49.000'} [2024-08-06 01:01:15,521][52663] DAMAGECOUNT value on done: 159461.0 [2024-08-06 01:01:15,522][52663] Sum rewards: 42.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.528', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.041', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.207', 'weapon2': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.460', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.781', 'FRAGCOUNT': '37.000'} [2024-08-06 01:01:15,840][52670] DAMAGECOUNT value on done: 161687.0 [2024-08-06 01:01:15,840][52670] Sum rewards: 63.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.788', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.056', 'weapon4': '0.066', 'AMMO4': '0.093', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.310', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:17,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 222388224. Throughput: 0: 4399.8. Samples: 55595010. Policy #0 lag: (min: 1.0, avg: 4.7, max: 9.0) [2024-08-06 01:01:17,794][52567] Avg episode reward: [(0, '57.307')] [2024-08-06 01:01:17,824][52666] DAMAGECOUNT value on done: 157153.0 [2024-08-06 01:01:17,828][52666] Sum rewards: 46.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.348', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.206', 'weapon2': '0.266', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '2.960', 'weapon3': '3.324', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '42.000'} [2024-08-06 01:01:17,948][52649] DAMAGECOUNT value on done: 152938.0 [2024-08-06 01:01:17,950][52649] Sum rewards: 61.851, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.103', 'weapon5': '0.130', 'HEALTH': '0.180', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.186', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '51.000'} [2024-08-06 01:01:18,002][52658] DAMAGECOUNT value on done: 157931.0 [2024-08-06 01:01:18,003][52658] Sum rewards: 53.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO2': '0.016', 'weapon7': '0.068', 'AMMO4': '0.077', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.500', 'weapon4': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:18,308][52671] DAMAGECOUNT value on done: 161545.0 [2024-08-06 01:01:18,308][52671] Sum rewards: 52.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.971', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.522', 'weapon2': '0.822', 'WEAPON3': '1.300', 'weapon3': '2.400', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.591', 'FRAGCOUNT': '46.000'} [2024-08-06 01:01:18,521][52670] DAMAGECOUNT value on done: 159427.0 [2024-08-06 01:01:18,522][52670] Sum rewards: 65.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO2': '0.025', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.182', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.266', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '53.000'} [2024-08-06 01:01:18,542][52663] DAMAGECOUNT value on done: 158538.0 [2024-08-06 01:01:18,542][52663] Sum rewards: 57.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO3': '0.231', 'weapon2': '0.704', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '49.500'} [2024-08-06 01:01:19,913][52650] Updated weights for policy 0, policy_version 27151 (0.0024) [2024-08-06 01:01:20,386][52658] DAMAGECOUNT value on done: 163402.0 [2024-08-06 01:01:20,386][52658] Sum rewards: 63.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.706', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO3': '0.244', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:20,689][52649] DAMAGECOUNT value on done: 158039.0 [2024-08-06 01:01:20,690][52649] Sum rewards: 57.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO3': '0.196', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.500', 'weapon4': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.460', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:20,767][52666] DAMAGECOUNT value on done: 157514.0 [2024-08-06 01:01:20,769][52666] Sum rewards: 65.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.814', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.137', 'weapon5': '0.140', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.350', 'weapon2': '0.484', 'WEAPON3': '0.800', 'weapon3': '2.832', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:21,139][52663] DAMAGECOUNT value on done: 159406.0 [2024-08-06 01:01:21,139][52663] Sum rewards: 63.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.536', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'weapon5': '0.056', 'AMMO3': '0.246', 'AMMO4': '0.259', 'weapon2': '0.294', 'weapon4': '0.328', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:21,297][52671] DAMAGECOUNT value on done: 161850.0 [2024-08-06 01:01:21,298][52671] Sum rewards: 47.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.171', 'weapon4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '3.180', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '42.000'} [2024-08-06 01:01:21,357][52670] DAMAGECOUNT value on done: 161456.0 [2024-08-06 01:01:21,357][52670] Sum rewards: 64.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.117', 'ARMOR': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.239', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:22,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 222470144. Throughput: 0: 4396.0. Samples: 55621380. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:01:22,794][52567] Avg episode reward: [(0, '57.308')] [2024-08-06 01:01:23,631][52666] DAMAGECOUNT value on done: 155838.0 [2024-08-06 01:01:23,632][52666] Sum rewards: 62.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.438', 'AMMO5': '0.005', 'ARMOR': '0.016', 'weapon5': '0.026', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.192', 'WEAPON4': '0.400', 'weapon2': '0.444', 'weapon4': '0.724', 'WEAPON3': '0.850', 'weapon3': '2.632', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '49.500'} [2024-08-06 01:01:23,784][52649] DAMAGECOUNT value on done: 158463.0 [2024-08-06 01:01:23,785][52649] Sum rewards: 65.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:23,959][52663] DAMAGECOUNT value on done: 157267.0 [2024-08-06 01:01:23,961][52663] Sum rewards: 55.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.938', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.216', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.674', 'WEAPON3': '1.400', 'weapon3': '2.464', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '49.000'} [2024-08-06 01:01:24,184][52670] DAMAGECOUNT value on done: 157708.0 [2024-08-06 01:01:24,185][52670] Sum rewards: 57.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.942', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.167', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.976', 'WEAPON3': '1.000', 'weapon3': '2.162', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:24,329][52650] Updated weights for policy 0, policy_version 27161 (0.0037) [2024-08-06 01:01:24,335][52671] DAMAGECOUNT value on done: 161892.0 [2024-08-06 01:01:24,336][52671] Sum rewards: 58.432, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.732', 'AMMO5': '0.005', 'AMMO2': '0.054', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'AMMO4': '0.272', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.766', 'WEAPON3': '1.550', 'weapon3': '2.452', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '53.000'} [2024-08-06 01:01:25,989][52666] DAMAGECOUNT value on done: 161921.0 [2024-08-06 01:01:25,991][52666] Sum rewards: 62.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.322', 'AMMO5': '0.021', 'AMMO2': '0.079', 'AMMO3': '0.192', 'weapon4': '0.320', 'AMMO4': '0.395', 'weapon5': '0.466', 'WEAPON5': '0.600', 'weapon2': '0.614', 'WEAPON4': '0.800', 'WEAPON3': '1.050', 'weapon3': '2.292', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '53.000'} [2024-08-06 01:01:26,460][52649] DAMAGECOUNT value on done: 150891.0 [2024-08-06 01:01:26,462][52649] Sum rewards: 49.726, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.977', 'AMMO5': '0.003', 'ARMOR': '0.028', 'AMMO2': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.576', 'weapon4': '0.646', 'WEAPON3': '0.900', 'weapon3': '2.606', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.687', 'FRAGCOUNT': '41.000'} [2024-08-06 01:01:26,535][52670] DAMAGECOUNT value on done: 164871.0 [2024-08-06 01:01:26,535][52670] Sum rewards: 65.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.120', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.000'} [2024-08-06 01:01:26,981][52663] DAMAGECOUNT value on done: 166734.0 [2024-08-06 01:01:26,982][52663] Sum rewards: 65.917, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.126', 'AMMO4': '0.172', 'weapon5': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.372', 'WEAPON4': '0.450', 'weapon2': '0.622', 'WEAPON3': '0.850', 'weapon3': '2.550', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:27,648][52671] DAMAGECOUNT value on done: 162134.0 [2024-08-06 01:01:27,649][52671] Sum rewards: 66.566, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.902', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.282', 'AMMO3': '0.284', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 01:01:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 222560256. Throughput: 0: 4395.1. Samples: 55647880. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:01:27,794][52567] Avg episode reward: [(0, '57.714')] [2024-08-06 01:01:28,420][52666] DAMAGECOUNT value on done: 155183.0 [2024-08-06 01:01:28,421][52666] Sum rewards: 53.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.208', 'weapon2': '0.342', 'WEAPON4': '0.350', 'weapon4': '0.636', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:28,959][52650] Updated weights for policy 0, policy_version 27171 (0.0011) [2024-08-06 01:01:29,231][52670] DAMAGECOUNT value on done: 152096.0 [2024-08-06 01:01:29,233][52670] Sum rewards: 58.862, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.078', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.175', 'AMMO3': '0.220', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '51.500'} [2024-08-06 01:01:29,425][52649] DAMAGECOUNT value on done: 157360.0 [2024-08-06 01:01:29,426][52649] Sum rewards: 56.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.348', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.104', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'AMMO4': '0.235', 'WEAPON4': '0.550', 'weapon2': '0.748', 'weapon4': '0.802', 'WEAPON3': '1.000', 'weapon3': '2.148', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '49.000'} [2024-08-06 01:01:29,815][52663] DAMAGECOUNT value on done: 160156.0 [2024-08-06 01:01:29,819][52663] Sum rewards: 67.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.465', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.183', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '57.000'} [2024-08-06 01:01:30,186][52671] DAMAGECOUNT value on done: 160605.0 [2024-08-06 01:01:30,186][52671] Sum rewards: 60.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.069', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.169', 'weapon4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '51.000'} [2024-08-06 01:01:31,158][52666] DAMAGECOUNT value on done: 158499.0 [2024-08-06 01:01:31,160][52666] Sum rewards: 54.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.646', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.059', 'AMMO3': '0.184', 'weapon5': '0.218', 'AMMO4': '0.295', 'WEAPON5': '0.300', 'weapon4': '0.452', 'WEAPON4': '0.650', 'weapon2': '0.670', 'WEAPON3': '1.200', 'weapon3': '2.422', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:31,867][52670] DAMAGECOUNT value on done: 160569.0 [2024-08-06 01:01:31,868][52670] Sum rewards: 53.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.376', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '45.500'} [2024-08-06 01:01:32,340][52649] DAMAGECOUNT value on done: 154447.0 [2024-08-06 01:01:32,343][52649] Sum rewards: 55.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'AMMO4': '0.167', 'weapon4': '0.224', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '2.878', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '47.500'} [2024-08-06 01:01:32,408][52663] DAMAGECOUNT value on done: 160284.0 [2024-08-06 01:01:32,409][52663] Sum rewards: 71.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.124', 'weapon4': '0.196', 'AMMO3': '0.211', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 01:01:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 222642176. Throughput: 0: 4393.1. Samples: 55661290. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:01:32,794][52567] Avg episode reward: [(0, '58.059')] [2024-08-06 01:01:33,325][52671] DAMAGECOUNT value on done: 164357.0 [2024-08-06 01:01:33,326][52671] Sum rewards: 62.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO4': '0.185', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '53.000'} [2024-08-06 01:01:33,769][52665] DAMAGECOUNT value on done: 157929.0 [2024-08-06 01:01:33,769][52665] Sum rewards: 65.309, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.362', 'weapon4': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '58.000'} [2024-08-06 01:01:33,975][52650] Updated weights for policy 0, policy_version 27181 (0.0010) [2024-08-06 01:01:34,833][52670] DAMAGECOUNT value on done: 161628.0 [2024-08-06 01:01:34,833][52670] Sum rewards: 74.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.494', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.157', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '62.000'} [2024-08-06 01:01:35,062][52649] DAMAGECOUNT value on done: 160750.0 [2024-08-06 01:01:35,063][52649] Sum rewards: 53.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.748', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.213', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.956', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:35,210][52663] DAMAGECOUNT value on done: 160754.0 [2024-08-06 01:01:35,210][52663] Sum rewards: 47.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.133', 'ARMOR': '0.016', 'AMMO5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.193', 'weapon5': '0.230', 'AMMO4': '0.264', 'weapon2': '0.296', 'weapon4': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.600', 'weapon3': '2.712', 'DAMAGECOUNT': '11.802', 'FRAGCOUNT': '42.000'} [2024-08-06 01:01:36,474][52671] DAMAGECOUNT value on done: 162498.0 [2024-08-06 01:01:36,477][52671] Sum rewards: 63.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.180', 'AMMO4': '0.208', 'weapon4': '0.208', 'weapon5': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '53.500'} [2024-08-06 01:01:36,521][52665] DAMAGECOUNT value on done: 163684.0 [2024-08-06 01:01:36,522][52665] Sum rewards: 52.651, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.640', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.168', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:36,826][52659] DAMAGECOUNT value on done: 161426.0 [2024-08-06 01:01:36,827][52659] Sum rewards: 56.757, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.170', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.292', 'AMMO3': '0.333', 'WEAPON3': '2.000', 'weapon3': '3.230', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '56.000'} [2024-08-06 01:01:37,638][52649] DAMAGECOUNT value on done: 159355.0 [2024-08-06 01:01:37,639][52649] Sum rewards: 68.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.352', 'weapon4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.896', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '58.000'} [2024-08-06 01:01:37,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17749.2, 300 sec: 17550.3). Total num frames: 222740480. Throughput: 0: 4403.3. Samples: 55687700. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:01:37,795][52567] Avg episode reward: [(0, '58.331')] [2024-08-06 01:01:37,802][52670] DAMAGECOUNT value on done: 159121.0 [2024-08-06 01:01:37,804][52670] Sum rewards: 65.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.186', 'weapon5': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.470', 'WEAPON4': '0.500', 'weapon2': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.202', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:38,010][52663] DAMAGECOUNT value on done: 162973.0 [2024-08-06 01:01:38,010][52663] Sum rewards: 60.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.211', 'weapon2': '0.592', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.162', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '51.000'} [2024-08-06 01:01:38,306][52650] Updated weights for policy 0, policy_version 27191 (0.0041) [2024-08-06 01:01:39,093][52665] DAMAGECOUNT value on done: 158826.0 [2024-08-06 01:01:39,094][52665] Sum rewards: 68.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.094', 'AMMO4': '0.141', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.480', 'weapon4': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.658', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:39,385][52671] DAMAGECOUNT value on done: 161372.0 [2024-08-06 01:01:39,385][52671] Sum rewards: 75.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.356', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '64.000'} [2024-08-06 01:01:39,955][52659] DAMAGECOUNT value on done: 161191.0 [2024-08-06 01:01:39,958][52659] Sum rewards: 64.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:40,185][52670] DAMAGECOUNT value on done: 159078.0 [2024-08-06 01:01:40,187][52670] Sum rewards: 55.551, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.101', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'weapon2': '0.808', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:40,406][52649] DAMAGECOUNT value on done: 162830.0 [2024-08-06 01:01:40,409][52649] Sum rewards: 50.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.746', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.183', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.660', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '41.000'} [2024-08-06 01:01:41,130][52663] DAMAGECOUNT value on done: 161732.0 [2024-08-06 01:01:41,132][52663] Sum rewards: 58.300, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.123', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.536', 'HEALTH': '0.723', 'WEAPON3': '0.900', 'weapon3': '2.846', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:41,880][52665] DAMAGECOUNT value on done: 154357.0 [2024-08-06 01:01:41,881][52665] Sum rewards: 50.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.110', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.054', 'AMMO3': '0.189', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'weapon4': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.020', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '46.000'} [2024-08-06 01:01:42,400][52671] DAMAGECOUNT value on done: 168729.0 [2024-08-06 01:01:42,402][52671] Sum rewards: 75.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.355', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.246', 'weapon2': '0.318', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '62.000'} [2024-08-06 01:01:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 222822400. Throughput: 0: 4395.3. Samples: 55713880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:01:42,795][52567] Avg episode reward: [(0, '58.440')] [2024-08-06 01:01:42,845][52659] DAMAGECOUNT value on done: 161818.0 [2024-08-06 01:01:42,845][52659] Sum rewards: 57.473, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.205', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '49.000'} [2024-08-06 01:01:43,423][52650] Updated weights for policy 0, policy_version 27201 (0.0012) [2024-08-06 01:01:43,961][52663] DAMAGECOUNT value on done: 160174.0 [2024-08-06 01:01:43,963][52663] Sum rewards: 56.378, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.005', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '49.000'} [2024-08-06 01:01:44,612][52665] DAMAGECOUNT value on done: 156341.0 [2024-08-06 01:01:44,612][52665] Sum rewards: 60.993, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.226', 'weapon2': '0.390', 'WEAPON4': '0.450', 'weapon4': '0.654', 'WEAPON3': '1.350', 'weapon3': '2.508', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '53.000'} [2024-08-06 01:01:45,101][52671] DAMAGECOUNT value on done: 160758.0 [2024-08-06 01:01:45,102][52671] Sum rewards: 56.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.482', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:45,547][52659] DAMAGECOUNT value on done: 161513.0 [2024-08-06 01:01:45,550][52659] Sum rewards: 52.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.122', 'weapon4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.222', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:46,819][52663] DAMAGECOUNT value on done: 155061.0 [2024-08-06 01:01:46,821][52663] Sum rewards: 68.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.084', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.466', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.218', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '58.000'} [2024-08-06 01:01:47,405][52795] DAMAGECOUNT value on done: 148620.0 [2024-08-06 01:01:47,406][52795] Sum rewards: 61.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.635', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.048', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon5': '0.204', 'AMMO4': '0.240', 'weapon2': '0.244', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.736', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '51.000'} [2024-08-06 01:01:47,710][52650] Updated weights for policy 0, policy_version 27211 (0.0014) [2024-08-06 01:01:47,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 222912512. Throughput: 0: 4393.3. Samples: 55726960. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:01:47,794][52567] Avg episode reward: [(0, '58.695')] [2024-08-06 01:01:47,804][52614] Saving new best policy, reward=58.695! [2024-08-06 01:01:47,842][52671] DAMAGECOUNT value on done: 156281.0 [2024-08-06 01:01:47,844][52671] Sum rewards: 49.888, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.646', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.416', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.058', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:47,885][52665] DAMAGECOUNT value on done: 158203.0 [2024-08-06 01:01:47,886][52665] Sum rewards: 53.016, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.236', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.546', 'weapon2': '0.586', 'WEAPON3': '0.850', 'weapon3': '2.744', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '43.000'} [2024-08-06 01:01:48,495][52659] DAMAGECOUNT value on done: 160001.0 [2024-08-06 01:01:48,496][52659] Sum rewards: 57.467, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.845', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon7': '0.060', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.552', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.822', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '46.000'} [2024-08-06 01:01:49,589][52663] DAMAGECOUNT value on done: 155408.0 [2024-08-06 01:01:49,590][52663] Sum rewards: 45.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.706', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.066', 'AMMO4': '0.130', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '3.186', 'DAMAGECOUNT': '11.967', 'FRAGCOUNT': '39.000'} [2024-08-06 01:01:50,662][52795] DAMAGECOUNT value on done: 143647.0 [2024-08-06 01:01:50,662][52795] Sum rewards: 49.837, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.886', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.258', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.282', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '44.000'} [2024-08-06 01:01:50,702][52665] DAMAGECOUNT value on done: 158431.0 [2024-08-06 01:01:50,702][52665] Sum rewards: 61.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.984', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.036', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '52.000'} [2024-08-06 01:01:50,759][52671] DAMAGECOUNT value on done: 165017.0 [2024-08-06 01:01:50,760][52671] Sum rewards: 66.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.875', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '57.000'} [2024-08-06 01:01:51,313][52659] DAMAGECOUNT value on done: 159407.0 [2024-08-06 01:01:51,315][52659] Sum rewards: 57.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.128', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.141', 'AMMO4': '0.185', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON4': '0.500', 'weapon2': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.430', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '47.000'} [2024-08-06 01:01:52,374][52650] Updated weights for policy 0, policy_version 27221 (0.0031) [2024-08-06 01:01:52,544][52663] DAMAGECOUNT value on done: 163132.0 [2024-08-06 01:01:52,545][52663] Sum rewards: 50.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon2': '0.396', 'weapon4': '0.414', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '42.000'} [2024-08-06 01:01:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 223002624. Throughput: 0: 4388.9. Samples: 55753040. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:01:52,794][52567] Avg episode reward: [(0, '58.293')] [2024-08-06 01:01:53,094][52671] DAMAGECOUNT value on done: 163203.0 [2024-08-06 01:01:53,096][52671] Sum rewards: 55.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.912', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon2': '0.392', 'weapon4': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.774', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:53,799][52659] DAMAGECOUNT value on done: 161185.0 [2024-08-06 01:01:53,801][52659] Sum rewards: 56.202, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.470', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.155', 'AMMO4': '0.234', 'weapon5': '0.276', 'weapon4': '0.370', 'weapon2': '0.434', 'WEAPON5': '0.450', 'ARMOR': '0.465', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.646', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '45.000'} [2024-08-06 01:01:53,823][52665] DAMAGECOUNT value on done: 161936.0 [2024-08-06 01:01:53,823][52665] Sum rewards: 63.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.218', 'AMMO5': '0.015', 'weapon5': '0.048', 'AMMO2': '0.056', 'AMMO3': '0.216', 'AMMO4': '0.281', 'weapon4': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '55.000'} [2024-08-06 01:01:53,835][52795] DAMAGECOUNT value on done: 147563.0 [2024-08-06 01:01:53,836][52795] Sum rewards: 51.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.108', 'AMMO4': '0.135', 'AMMO3': '0.214', 'weapon5': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '2.970', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '43.000'} [2024-08-06 01:01:55,576][52663] DAMAGECOUNT value on done: 162732.0 [2024-08-06 01:01:55,576][52663] Sum rewards: 61.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO2': '0.007', 'AMMO5': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon5': '0.158', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.205', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.216', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '51.000'} [2024-08-06 01:01:55,695][52671] DAMAGECOUNT value on done: 163905.0 [2024-08-06 01:01:55,696][52671] Sum rewards: 61.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.126', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.416', 'weapon2': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.418', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '52.000'} [2024-08-06 01:01:56,430][52659] DAMAGECOUNT value on done: 156323.0 [2024-08-06 01:01:56,433][52659] Sum rewards: 54.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.196', 'AMMO4': '0.203', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.922', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '48.000'} [2024-08-06 01:01:56,751][52665] DAMAGECOUNT value on done: 163912.0 [2024-08-06 01:01:56,755][52665] Sum rewards: 48.988, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.650', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.274', 'AMMO3': '0.280', 'weapon2': '0.342', 'WEAPON3': '1.650', 'weapon3': '3.092', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '46.000'} [2024-08-06 01:01:56,935][52795] DAMAGECOUNT value on done: 147744.0 [2024-08-06 01:01:56,935][52795] Sum rewards: 57.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.850', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.078', 'weapon4': '0.136', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '48.500'} [2024-08-06 01:01:56,994][52647] DAMAGECOUNT value on done: 170723.0 [2024-08-06 01:01:56,996][52647] Sum rewards: 52.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.104', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.161', 'AMMO3': '0.204', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.082', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '46.000'} [2024-08-06 01:01:57,410][52650] Updated weights for policy 0, policy_version 27231 (0.0026) [2024-08-06 01:01:57,764][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:01:57,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 223084544. Throughput: 0: 4381.8. Samples: 55779270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:01:57,795][52567] Avg episode reward: [(0, '58.231')] [2024-08-06 01:01:58,703][52671] DAMAGECOUNT value on done: 163558.0 [2024-08-06 01:01:58,704][52671] Sum rewards: 57.644, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.808', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '51.000'} [2024-08-06 01:01:58,742][52663] DAMAGECOUNT value on done: 164192.0 [2024-08-06 01:01:58,744][52663] Sum rewards: 62.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.798', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.162', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.350', 'weapon3': '2.670', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '54.000'} [2024-08-06 01:01:59,362][52794] Large shaping reward -2.525 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.276, -92.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:01:59,396][52647] DAMAGECOUNT value on done: 168527.0 [2024-08-06 01:01:59,396][52647] Sum rewards: 48.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.306', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.368', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '42.000'} [2024-08-06 01:01:59,417][52659] DAMAGECOUNT value on done: 162664.0 [2024-08-06 01:01:59,419][52659] Sum rewards: 70.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.036', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2024-08-06 01:01:59,907][52665] DAMAGECOUNT value on done: 160455.0 [2024-08-06 01:01:59,909][52665] Sum rewards: 51.568, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.610', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.296', 'weapon4': '0.490', 'WEAPON3': '1.700', 'weapon3': '2.908', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:00,148][52795] DAMAGECOUNT value on done: 151502.0 [2024-08-06 01:02:00,151][52795] Sum rewards: 60.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.719', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.198', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '49.500'} [2024-08-06 01:02:01,508][52671] DAMAGECOUNT value on done: 161918.0 [2024-08-06 01:02:01,508][52671] Sum rewards: 61.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.025', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.072', 'AMMO4': '0.134', 'weapon4': '0.146', 'AMMO3': '0.151', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.956', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '51.000'} [2024-08-06 01:02:01,595][52663] DAMAGECOUNT value on done: 163066.0 [2024-08-06 01:02:01,595][52663] Sum rewards: 47.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.206', 'weapon5': '0.234', 'AMMO4': '0.254', 'weapon4': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.408', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:01,814][52650] Updated weights for policy 0, policy_version 27241 (0.0015) [2024-08-06 01:02:02,087][52647] DAMAGECOUNT value on done: 171359.0 [2024-08-06 01:02:02,090][52647] Sum rewards: 50.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.843', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.204', 'weapon2': '0.582', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.064', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '45.000'} [2024-08-06 01:02:02,166][52659] DAMAGECOUNT value on done: 164836.0 [2024-08-06 01:02:02,167][52659] Sum rewards: 68.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.028', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon2': '0.184', 'weapon4': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '56.000'} [2024-08-06 01:02:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 223174656. Throughput: 0: 4388.9. Samples: 55792510. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 01:02:02,795][52567] Avg episode reward: [(0, '58.417')] [2024-08-06 01:02:02,981][52665] DAMAGECOUNT value on done: 162566.0 [2024-08-06 01:02:02,983][52665] Sum rewards: 61.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.597', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.158', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.702', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:03,359][52795] DAMAGECOUNT value on done: 148132.0 [2024-08-06 01:02:03,360][52795] Sum rewards: 60.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.992', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.230', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.228', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '51.000'} [2024-08-06 01:02:04,621][52663] DAMAGECOUNT value on done: 161682.0 [2024-08-06 01:02:04,625][52663] Sum rewards: 57.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.231', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.143', 'weapon5': '0.192', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.548', 'weapon4': '0.562', 'WEAPON3': '0.800', 'weapon3': '2.424', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '46.000'} [2024-08-06 01:02:04,796][52659] DAMAGECOUNT value on done: 158674.0 [2024-08-06 01:02:04,798][52659] Sum rewards: 46.045, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.034', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.075', 'weapon5': '0.180', 'AMMO3': '0.181', 'WEAPON5': '0.350', 'AMMO4': '0.373', 'weapon2': '0.522', 'weapon4': '0.648', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.276', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:05,239][52647] DAMAGECOUNT value on done: 172534.0 [2024-08-06 01:02:05,240][52647] Sum rewards: 66.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'ARMOR': '0.016', 'weapon5': '0.024', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.185', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:05,885][52665] DAMAGECOUNT value on done: 162758.0 [2024-08-06 01:02:05,885][52665] Sum rewards: 61.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.068', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.216', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '52.000'} [2024-08-06 01:02:06,394][52650] Updated weights for policy 0, policy_version 27251 (0.0013) [2024-08-06 01:02:06,448][52795] DAMAGECOUNT value on done: 152137.0 [2024-08-06 01:02:06,448][52795] Sum rewards: 66.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.697', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:07,581][52659] DAMAGECOUNT value on done: 155616.0 [2024-08-06 01:02:07,581][52659] Sum rewards: 57.481, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.560', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO4': '0.207', 'AMMO3': '0.217', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.588', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:07,705][52663] DAMAGECOUNT value on done: 158461.0 [2024-08-06 01:02:07,706][52663] Sum rewards: 46.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.974', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon5': '0.252', 'weapon4': '0.264', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.360', 'weapon3': '2.932', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:07,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 223256576. Throughput: 0: 4392.0. Samples: 55819020. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 01:02:07,794][52567] Avg episode reward: [(0, '58.571')] [2024-08-06 01:02:07,834][52647] DAMAGECOUNT value on done: 172068.0 [2024-08-06 01:02:07,834][52647] Sum rewards: 54.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.166', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.100', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'weapon2': '0.388', 'WEAPON4': '0.700', 'weapon4': '0.756', 'WEAPON3': '1.250', 'weapon3': '2.516', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '48.000'} [2024-08-06 01:02:09,011][52665] DAMAGECOUNT value on done: 159211.0 [2024-08-06 01:02:09,013][52665] Sum rewards: 55.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.760', 'WEAPON3': '1.450', 'weapon3': '2.390', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '48.500'} [2024-08-06 01:02:09,196][52647] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.117, -39.0), ('weapon5', 0.002)] [2024-08-06 01:02:09,564][52795] DAMAGECOUNT value on done: 150485.0 [2024-08-06 01:02:09,565][52795] Sum rewards: 51.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.448', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.596', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.110', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '43.500'} [2024-08-06 01:02:09,941][52659] DAMAGECOUNT value on done: 155356.0 [2024-08-06 01:02:09,951][52659] Sum rewards: 53.630, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.069', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.097', 'AMMO3': '0.147', 'weapon2': '0.746', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.074', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '44.000'} [2024-08-06 01:02:10,593][52647] DAMAGECOUNT value on done: 172722.0 [2024-08-06 01:02:10,594][52647] Sum rewards: 61.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.245', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.073', 'weapon4': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.816', 'WEAPON3': '1.450', 'weapon3': '2.780', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '53.000'} [2024-08-06 01:02:11,205][52650] Updated weights for policy 0, policy_version 27261 (0.0011) [2024-08-06 01:02:11,751][52664] DAMAGECOUNT value on done: 167519.0 [2024-08-06 01:02:11,751][52664] Sum rewards: 58.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.704', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '48.000'} [2024-08-06 01:02:12,100][52665] DAMAGECOUNT value on done: 159008.0 [2024-08-06 01:02:12,103][52665] Sum rewards: 58.202, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.912', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.179', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.330', 'weapon2': '0.838', 'WEAPON3': '1.150', 'weapon3': '2.412', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '48.000'} [2024-08-06 01:02:12,640][52795] DAMAGECOUNT value on done: 147869.0 [2024-08-06 01:02:12,641][52795] Sum rewards: 59.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.963', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.400', 'weapon4': '0.518', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.632', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 223346688. Throughput: 0: 4394.7. Samples: 55845640. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 01:02:12,794][52567] Avg episode reward: [(0, '58.688')] [2024-08-06 01:02:13,024][52659] DAMAGECOUNT value on done: 161278.0 [2024-08-06 01:02:13,026][52659] Sum rewards: 65.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.899', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.316', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '53.000'} [2024-08-06 01:02:13,090][52647] DAMAGECOUNT value on done: 168663.0 [2024-08-06 01:02:13,090][52647] Sum rewards: 57.025, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.446', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:14,094][52664] DAMAGECOUNT value on done: 168377.0 [2024-08-06 01:02:14,096][52664] Sum rewards: 65.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.546', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.172', 'AMMO3': '0.179', 'AMMO4': '0.201', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.680', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:15,395][52665] DAMAGECOUNT value on done: 159080.0 [2024-08-06 01:02:15,403][52665] Sum rewards: 55.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.736', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon5': '0.178', 'AMMO3': '0.192', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '48.000'} [2024-08-06 01:02:15,455][52647] DAMAGECOUNT value on done: 171050.0 [2024-08-06 01:02:15,457][52647] Sum rewards: 54.012, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.117', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.216', 'AMMO4': '0.218', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '51.000'} [2024-08-06 01:02:15,751][52659] DAMAGECOUNT value on done: 161530.0 [2024-08-06 01:02:15,753][52659] Sum rewards: 58.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.789', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.068', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:15,867][52795] DAMAGECOUNT value on done: 150494.0 [2024-08-06 01:02:15,867][52795] Sum rewards: 65.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.035', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.167', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.486', 'weapon4': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '54.000'} [2024-08-06 01:02:16,118][52650] Updated weights for policy 0, policy_version 27271 (0.0024) [2024-08-06 01:02:16,553][52664] DAMAGECOUNT value on done: 169056.0 [2024-08-06 01:02:16,554][52664] Sum rewards: 62.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.256', 'weapon2': '0.866', 'WEAPON3': '1.200', 'weapon3': '2.598', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.000'} [2024-08-06 01:02:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 223436800. Throughput: 0: 4393.6. Samples: 55859000. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:02:17,794][52567] Avg episode reward: [(0, '58.785')] [2024-08-06 01:02:17,797][52614] Saving new best policy, reward=58.785! [2024-08-06 01:02:18,067][52647] DAMAGECOUNT value on done: 172491.0 [2024-08-06 01:02:18,070][52647] Sum rewards: 51.849, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.244', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO3': '0.141', 'AMMO4': '0.160', 'weapon5': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.606', 'weapon4': '0.810', 'WEAPON3': '0.950', 'weapon3': '2.162', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '43.000'} [2024-08-06 01:02:18,310][52665] DAMAGECOUNT value on done: 157637.0 [2024-08-06 01:02:18,311][52665] Sum rewards: 50.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.012', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.164', 'weapon4': '0.196', 'AMMO3': '0.212', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '2.784', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '46.000'} [2024-08-06 01:02:18,951][52659] DAMAGECOUNT value on done: 164630.0 [2024-08-06 01:02:18,952][52659] Sum rewards: 60.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.174', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '51.000'} [2024-08-06 01:02:19,056][52795] DAMAGECOUNT value on done: 147586.0 [2024-08-06 01:02:19,056][52795] Sum rewards: 54.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.147', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.930', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '48.000'} [2024-08-06 01:02:19,367][52664] DAMAGECOUNT value on done: 166039.0 [2024-08-06 01:02:19,368][52664] Sum rewards: 44.729, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.070', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.275', 'weapon2': '0.424', 'weapon4': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '2.896', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:20,484][52650] Updated weights for policy 0, policy_version 27281 (0.0011) [2024-08-06 01:02:20,696][52647] DAMAGECOUNT value on done: 167333.0 [2024-08-06 01:02:20,698][52647] Sum rewards: 54.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.389', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.108', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.126', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '48.000'} [2024-08-06 01:02:21,033][52665] DAMAGECOUNT value on done: 158715.0 [2024-08-06 01:02:21,033][52665] Sum rewards: 56.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.086', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.214', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.106', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:21,701][52664] DAMAGECOUNT value on done: 166662.0 [2024-08-06 01:02:21,701][52664] Sum rewards: 57.328, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.660', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'AMMO3': '0.317', 'WEAPON3': '1.850', 'HITCOUNT': '3.060', 'weapon3': '3.244', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '52.000'} [2024-08-06 01:02:21,824][52659] DAMAGECOUNT value on done: 164144.0 [2024-08-06 01:02:21,826][52659] Sum rewards: 48.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '3.342', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:22,260][52795] DAMAGECOUNT value on done: 148020.0 [2024-08-06 01:02:22,264][52795] Sum rewards: 59.086, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.596', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.154', 'AMMO4': '0.185', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.364', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '52.000'} [2024-08-06 01:02:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 223526912. Throughput: 0: 4379.6. Samples: 55884780. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:02:22,794][52567] Avg episode reward: [(0, '58.082')] [2024-08-06 01:02:22,926][52647] DAMAGECOUNT value on done: 168234.0 [2024-08-06 01:02:22,926][52647] Sum rewards: 64.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.006', 'AMMO2': '0.017', 'ARMOR': '0.036', 'weapon7': '0.046', 'AMMO4': '0.086', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.774', 'WEAPON3': '0.900', 'weapon3': '2.448', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '53.500'} [2024-08-06 01:02:24,241][52664] DAMAGECOUNT value on done: 171099.0 [2024-08-06 01:02:24,242][52664] Sum rewards: 62.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.683', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '54.000'} [2024-08-06 01:02:24,283][52665] DAMAGECOUNT value on done: 154635.0 [2024-08-06 01:02:24,285][52665] Sum rewards: 59.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.074', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.650', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:24,539][52659] DAMAGECOUNT value on done: 160343.0 [2024-08-06 01:02:24,541][52659] Sum rewards: 61.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.210', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '52.000'} [2024-08-06 01:02:25,112][52650] Updated weights for policy 0, policy_version 27291 (0.0030) [2024-08-06 01:02:25,480][52795] DAMAGECOUNT value on done: 147530.0 [2024-08-06 01:02:25,484][52795] Sum rewards: 48.663, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.218', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.008', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '44.500'} [2024-08-06 01:02:25,595][52647] DAMAGECOUNT value on done: 166246.0 [2024-08-06 01:02:25,596][52647] Sum rewards: 40.967, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.392', 'WEAPON4': '0.500', 'weapon4': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.556', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '11.382', 'FRAGCOUNT': '35.000'} [2024-08-06 01:02:26,936][52664] DAMAGECOUNT value on done: 171059.0 [2024-08-06 01:02:26,936][52664] Sum rewards: 60.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.375', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.262', 'weapon4': '0.272', 'WEAPON3': '1.000', 'HITCOUNT': '2.840', 'weapon3': '3.230', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:27,434][52665] DAMAGECOUNT value on done: 159715.0 [2024-08-06 01:02:27,435][52665] Sum rewards: 57.808, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.690', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO4': '0.202', 'weapon4': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.700', 'weapon3': '2.794', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '53.000'} [2024-08-06 01:02:27,608][52659] DAMAGECOUNT value on done: 165494.0 [2024-08-06 01:02:27,609][52659] Sum rewards: 55.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.620', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.046', 'AMMO4': '0.155', 'weapon4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.650', 'weapon3': '3.026', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 223608832. Throughput: 0: 4377.1. Samples: 55910850. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:02:27,795][52567] Avg episode reward: [(0, '57.935')] [2024-08-06 01:02:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027296_223608832.pth... [2024-08-06 01:02:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000026782_219398144.pth [2024-08-06 01:02:28,486][52647] DAMAGECOUNT value on done: 170519.0 [2024-08-06 01:02:28,487][52647] Sum rewards: 54.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.034', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '47.000'} [2024-08-06 01:02:28,600][52795] DAMAGECOUNT value on done: 149490.0 [2024-08-06 01:02:28,602][52795] Sum rewards: 71.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.267', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.172', 'weapon5': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '59.000'} [2024-08-06 01:02:28,733][52668] DAMAGECOUNT value on done: 160624.0 [2024-08-06 01:02:28,733][52668] Sum rewards: 70.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.096', 'weapon5': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.240', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.370', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '62.000'} [2024-08-06 01:02:29,615][52664] DAMAGECOUNT value on done: 161715.0 [2024-08-06 01:02:29,616][52664] Sum rewards: 57.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.022', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'weapon4': '0.480', 'weapon2': '0.652', 'WEAPON3': '0.850', 'weapon3': '2.616', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '46.000'} [2024-08-06 01:02:29,792][52650] Updated weights for policy 0, policy_version 27301 (0.0028) [2024-08-06 01:02:30,511][52659] DAMAGECOUNT value on done: 164531.0 [2024-08-06 01:02:30,512][52659] Sum rewards: 43.042, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.047', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.118', 'AMMO3': '0.196', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'weapon4': '0.446', 'WEAPON4': '0.500', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.588', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.663', 'FRAGCOUNT': '40.000'} [2024-08-06 01:02:30,569][52665] DAMAGECOUNT value on done: 156811.0 [2024-08-06 01:02:30,570][52665] Sum rewards: 43.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.344', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'AMMO4': '0.186', 'weapon5': '0.186', 'WEAPON4': '0.350', 'weapon4': '0.434', 'weapon2': '0.532', 'WEAPON3': '0.700', 'weapon3': '2.676', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.988', 'FRAGCOUNT': '34.000'} [2024-08-06 01:02:31,140][52647] DAMAGECOUNT value on done: 167936.0 [2024-08-06 01:02:31,140][52647] Sum rewards: 77.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '65.000'} [2024-08-06 01:02:31,494][52668] DAMAGECOUNT value on done: 169554.0 [2024-08-06 01:02:31,494][52668] Sum rewards: 62.807, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.446', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.078', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.227', 'weapon4': '0.336', 'weapon2': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:31,678][52795] DAMAGECOUNT value on done: 146630.0 [2024-08-06 01:02:31,680][52795] Sum rewards: 51.759, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.173', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.160', 'AMMO3': '0.197', 'weapon4': '0.232', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '45.000'} [2024-08-06 01:02:32,266][52664] DAMAGECOUNT value on done: 176731.0 [2024-08-06 01:02:32,267][52664] Sum rewards: 60.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.645', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.066', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.298', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 223698944. Throughput: 0: 4374.4. Samples: 55923810. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:02:32,794][52567] Avg episode reward: [(0, '57.688')] [2024-08-06 01:02:33,924][52647] DAMAGECOUNT value on done: 169557.0 [2024-08-06 01:02:33,928][52647] Sum rewards: 67.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.167', 'AMMO3': '0.209', 'weapon4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.002', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '58.000'} [2024-08-06 01:02:34,492][52668] DAMAGECOUNT value on done: 162952.0 [2024-08-06 01:02:34,493][52668] Sum rewards: 55.059, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.777', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.214', 'weapon2': '0.288', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.324', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '46.000'} [2024-08-06 01:02:34,590][52650] Updated weights for policy 0, policy_version 27311 (0.0022) [2024-08-06 01:02:34,800][52795] DAMAGECOUNT value on done: 153767.0 [2024-08-06 01:02:34,802][52795] Sum rewards: 68.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.121', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.165', 'AMMO3': '0.242', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.300', 'ARMOR': '0.404', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '58.000'} [2024-08-06 01:02:35,362][52664] DAMAGECOUNT value on done: 171821.0 [2024-08-06 01:02:35,362][52664] Sum rewards: 53.131, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.220', 'AMMO3': '0.223', 'weapon2': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.278', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '46.500'} [2024-08-06 01:02:35,804][52662] DAMAGECOUNT value on done: 166798.0 [2024-08-06 01:02:35,805][52662] Sum rewards: 72.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.756', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.172', 'AMMO4': '0.254', 'weapon5': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.550', 'weapon4': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.408', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '60.000'} [2024-08-06 01:02:36,970][52647] DAMAGECOUNT value on done: 170000.0 [2024-08-06 01:02:36,970][52647] Sum rewards: 37.210, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.944', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'ARMOR': '0.043', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.480', 'weapon4': '0.846', 'WEAPON3': '1.300', 'weapon3': '2.206', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '11.616', 'FRAGCOUNT': '34.000'} [2024-08-06 01:02:37,527][52668] DAMAGECOUNT value on done: 162928.0 [2024-08-06 01:02:37,531][52668] Sum rewards: 61.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.584', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO3': '0.168', 'AMMO4': '0.187', 'weapon2': '0.308', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '52.000'} [2024-08-06 01:02:37,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.8, 300 sec: 17522.5). Total num frames: 223780864. Throughput: 0: 4378.9. Samples: 55950090. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:02:37,795][52567] Avg episode reward: [(0, '57.445')] [2024-08-06 01:02:37,889][52795] DAMAGECOUNT value on done: 152904.0 [2024-08-06 01:02:37,894][52795] Sum rewards: 70.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '60.000'} [2024-08-06 01:02:37,975][52664] DAMAGECOUNT value on done: 171185.0 [2024-08-06 01:02:37,976][52664] Sum rewards: 59.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.098', 'AMMO4': '0.160', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '52.000'} [2024-08-06 01:02:38,874][52662] DAMAGECOUNT value on done: 169257.0 [2024-08-06 01:02:38,876][52662] Sum rewards: 50.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.510', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.036', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon4': '0.230', 'AMMO3': '0.288', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.800', 'HITCOUNT': '2.810', 'weapon3': '2.938', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '47.000'} [2024-08-06 01:02:39,317][52650] Updated weights for policy 0, policy_version 27321 (0.0014) [2024-08-06 01:02:39,486][52647] DAMAGECOUNT value on done: 165304.0 [2024-08-06 01:02:39,487][52647] Sum rewards: 45.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.036', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.142', 'AMMO3': '0.196', 'AMMO4': '0.245', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.734', 'DAMAGECOUNT': '12.117', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:40,271][52668] DAMAGECOUNT value on done: 160314.0 [2024-08-06 01:02:40,271][52668] Sum rewards: 46.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.572', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.812', 'DAMAGECOUNT': '11.406', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:40,544][52664] DAMAGECOUNT value on done: 166889.0 [2024-08-06 01:02:40,546][52664] Sum rewards: 53.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.806', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.183', 'weapon2': '0.702', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.008', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '44.000'} [2024-08-06 01:02:41,095][52795] DAMAGECOUNT value on done: 145050.0 [2024-08-06 01:02:41,096][52795] Sum rewards: 61.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.586', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:41,942][52662] DAMAGECOUNT value on done: 169136.0 [2024-08-06 01:02:41,942][52662] Sum rewards: 50.596, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon5': '0.062', 'AMMO3': '0.133', 'AMMO4': '0.158', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.796', 'WEAPON3': '0.800', 'HITCOUNT': '2.640', 'weapon3': '2.654', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '42.000'} [2024-08-06 01:02:42,286][52647] DAMAGECOUNT value on done: 168742.0 [2024-08-06 01:02:42,287][52647] Sum rewards: 49.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.391', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.055', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.206', 'AMMO4': '0.274', 'weapon2': '0.394', 'weapon4': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.690', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '44.000'} [2024-08-06 01:02:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 223870976. Throughput: 0: 4380.5. Samples: 55976390. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:02:42,794][52567] Avg episode reward: [(0, '56.967')] [2024-08-06 01:02:43,023][52668] DAMAGECOUNT value on done: 160234.0 [2024-08-06 01:02:43,025][52668] Sum rewards: 67.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.850', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '57.000'} [2024-08-06 01:02:43,415][52664] DAMAGECOUNT value on done: 164501.0 [2024-08-06 01:02:43,416][52664] Sum rewards: 51.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.216', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.468', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '44.000'} [2024-08-06 01:02:43,435][52660] DAMAGECOUNT value on done: 161369.0 [2024-08-06 01:02:43,436][52660] Sum rewards: 69.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.176', 'AMMO3': '0.197', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '57.000'} [2024-08-06 01:02:43,672][52650] Updated weights for policy 0, policy_version 27331 (0.0019) [2024-08-06 01:02:44,052][52669] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:02:44,272][52795] DAMAGECOUNT value on done: 153788.0 [2024-08-06 01:02:44,273][52795] Sum rewards: 58.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.217', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.146', 'AMMO4': '0.151', 'AMMO3': '0.173', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:45,055][52647] DAMAGECOUNT value on done: 164167.0 [2024-08-06 01:02:45,057][52647] Sum rewards: 56.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.074', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.172', 'AMMO4': '0.178', 'weapon4': '0.188', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.828', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '46.000'} [2024-08-06 01:02:45,102][52662] DAMAGECOUNT value on done: 159955.0 [2024-08-06 01:02:45,104][52662] Sum rewards: 47.445, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.455', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.196', 'weapon2': '0.276', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '2.420', 'weapon3': '2.910', 'DAMAGECOUNT': '11.508', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:45,773][52668] DAMAGECOUNT value on done: 164200.0 [2024-08-06 01:02:45,773][52668] Sum rewards: 52.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.112', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.064', 'AMMO4': '0.170', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.586', 'weapon4': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.556', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '44.500'} [2024-08-06 01:02:46,241][52660] DAMAGECOUNT value on done: 161564.0 [2024-08-06 01:02:46,243][52660] Sum rewards: 36.378, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.415', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.172', 'WEAPON7': '0.200', 'weapon2': '0.298', 'WEAPON4': '0.450', 'weapon4': '0.518', 'WEAPON3': '1.000', 'HITCOUNT': '2.010', 'weapon3': '2.612', 'DAMAGECOUNT': '10.257', 'FRAGCOUNT': '31.000'} [2024-08-06 01:02:46,498][52664] DAMAGECOUNT value on done: 167361.0 [2024-08-06 01:02:46,498][52664] Sum rewards: 52.765, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.308', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.229', 'AMMO4': '0.286', 'weapon5': '0.308', 'weapon4': '0.396', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.420', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '46.000'} [2024-08-06 01:02:47,379][52795] DAMAGECOUNT value on done: 153335.0 [2024-08-06 01:02:47,381][52795] Sum rewards: 60.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.152', 'AMMO4': '0.216', 'AMMO3': '0.221', 'weapon4': '0.386', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '51.000'} [2024-08-06 01:02:47,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 223952896. Throughput: 0: 4381.3. Samples: 55989670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:02:47,795][52567] Avg episode reward: [(0, '56.976')] [2024-08-06 01:02:47,893][52647] DAMAGECOUNT value on done: 171164.0 [2024-08-06 01:02:47,893][52647] Sum rewards: 65.942, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:48,169][52668] DAMAGECOUNT value on done: 167173.0 [2024-08-06 01:02:48,171][52668] Sum rewards: 55.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.479', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.128', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '47.000'} [2024-08-06 01:02:48,552][52660] DAMAGECOUNT value on done: 163044.0 [2024-08-06 01:02:48,553][52660] Sum rewards: 51.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.184', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.055', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.274', 'AMMO3': '0.286', 'WEAPON4': '0.500', 'weapon2': '0.694', 'weapon4': '0.748', 'WEAPON3': '1.600', 'weapon3': '2.112', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '46.000'} [2024-08-06 01:02:48,578][52662] DAMAGECOUNT value on done: 166752.0 [2024-08-06 01:02:48,578][52662] Sum rewards: 51.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.718', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO4': '0.132', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon5': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '2.822', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '43.500'} [2024-08-06 01:02:48,768][52650] Updated weights for policy 0, policy_version 27341 (0.0011) [2024-08-06 01:02:49,348][52664] DAMAGECOUNT value on done: 169916.0 [2024-08-06 01:02:49,349][52664] Sum rewards: 51.308, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.455', 'AMMO5': '0.009', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.066', 'weapon5': '0.070', 'weapon4': '0.084', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.684', 'WEAPON3': '0.850', 'HITCOUNT': '2.800', 'weapon3': '3.028', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '41.000'} [2024-08-06 01:02:50,756][52668] DAMAGECOUNT value on done: 162350.0 [2024-08-06 01:02:50,756][52668] Sum rewards: 64.468, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.308', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.442', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:51,043][52660] DAMAGECOUNT value on done: 162492.0 [2024-08-06 01:02:51,045][52660] Sum rewards: 53.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.654', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.103', 'AMMO4': '0.149', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon2': '0.668', 'WEAPON3': '0.700', 'weapon4': '0.894', 'weapon3': '1.868', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '45.000'} [2024-08-06 01:02:51,966][52662] DAMAGECOUNT value on done: 165416.0 [2024-08-06 01:02:51,966][52662] Sum rewards: 59.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.179', 'weapon2': '0.456', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '3.214', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:52,386][52664] DAMAGECOUNT value on done: 166542.0 [2024-08-06 01:02:52,386][52664] Sum rewards: 47.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon4': '0.416', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.580', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '42.000'} [2024-08-06 01:02:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 224051200. Throughput: 0: 4379.1. Samples: 56016080. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 01:02:52,794][52567] Avg episode reward: [(0, '56.878')] [2024-08-06 01:02:53,218][52650] Updated weights for policy 0, policy_version 27351 (0.0039) [2024-08-06 01:02:53,524][52668] DAMAGECOUNT value on done: 165631.0 [2024-08-06 01:02:53,526][52668] Sum rewards: 50.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.946', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.126', 'weapon5': '0.136', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.712', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '43.000'} [2024-08-06 01:02:53,596][52667] DAMAGECOUNT value on done: 164121.0 [2024-08-06 01:02:53,598][52667] Sum rewards: 57.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.335', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.169', 'AMMO4': '0.177', 'weapon5': '0.228', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '49.000'} [2024-08-06 01:02:53,823][52660] DAMAGECOUNT value on done: 162234.0 [2024-08-06 01:02:53,823][52660] Sum rewards: 65.102, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.612', 'AMMO5': '0.008', 'ARMOR': '0.036', 'AMMO2': '0.041', 'weapon5': '0.136', 'weapon4': '0.162', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '56.000'} [2024-08-06 01:02:53,855][52820] DAMAGECOUNT value on done: 148666.0 [2024-08-06 01:02:53,856][52820] Sum rewards: 52.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.981', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon5': '0.122', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon2': '0.390', 'weapon4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '2.848', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '43.000'} [2024-08-06 01:02:54,042][52665] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:02:54,401][52662] DAMAGECOUNT value on done: 166958.0 [2024-08-06 01:02:54,402][52662] Sum rewards: 73.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.472', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '60.000'} [2024-08-06 01:02:55,534][52664] DAMAGECOUNT value on done: 170315.0 [2024-08-06 01:02:55,535][52664] Sum rewards: 53.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.258', 'AMMO5': '0.016', 'AMMO2': '0.067', 'AMMO3': '0.174', 'weapon5': '0.298', 'weapon4': '0.302', 'AMMO4': '0.335', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.698', 'WEAPON3': '1.000', 'weapon3': '2.432', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '44.000'} [2024-08-06 01:02:56,383][52667] DAMAGECOUNT value on done: 164895.0 [2024-08-06 01:02:56,385][52667] Sum rewards: 65.963, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.056', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon5': '0.212', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:56,708][52668] DAMAGECOUNT value on done: 164035.0 [2024-08-06 01:02:56,708][52668] Sum rewards: 65.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.953', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.110', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.570', 'weapon4': '0.602', 'WEAPON3': '1.050', 'weapon3': '2.500', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '53.000'} [2024-08-06 01:02:56,793][52794] DAMAGECOUNT value on done: 168881.0 [2024-08-06 01:02:56,793][52794] Sum rewards: 63.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.072', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '52.000'} [2024-08-06 01:02:56,992][52660] DAMAGECOUNT value on done: 159881.0 [2024-08-06 01:02:56,993][52660] Sum rewards: 55.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.836', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.215', 'AMMO4': '0.218', 'weapon5': '0.254', 'weapon2': '0.342', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.698', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '50.000'} [2024-08-06 01:02:57,081][52820] DAMAGECOUNT value on done: 149871.0 [2024-08-06 01:02:57,081][52820] Sum rewards: 48.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.563', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.148', 'AMMO3': '0.211', 'AMMO4': '0.245', 'weapon4': '0.266', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.972', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '43.000'} [2024-08-06 01:02:57,138][52662] DAMAGECOUNT value on done: 171864.0 [2024-08-06 01:02:57,141][52662] Sum rewards: 54.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.184', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.874', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '47.000'} [2024-08-06 01:02:57,789][52650] Updated weights for policy 0, policy_version 27361 (0.0038) [2024-08-06 01:02:57,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 224141312. Throughput: 0: 4368.7. Samples: 56042230. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 01:02:57,794][52567] Avg episode reward: [(0, '56.986')] [2024-08-06 01:02:58,519][52664] DAMAGECOUNT value on done: 171186.0 [2024-08-06 01:02:58,521][52664] Sum rewards: 60.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.177', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.500', 'weapon4': '0.870', 'WEAPON3': '1.050', 'weapon3': '2.446', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '51.000'} [2024-08-06 01:02:59,426][52794] DAMAGECOUNT value on done: 170397.0 [2024-08-06 01:02:59,426][52794] Sum rewards: 65.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.064', 'AMMO4': '0.067', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '55.000'} [2024-08-06 01:02:59,507][52667] DAMAGECOUNT value on done: 164324.0 [2024-08-06 01:02:59,509][52667] Sum rewards: 50.958, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.008', 'weapon4': '0.012', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.251', 'weapon2': '0.514', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.212', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '45.500'} [2024-08-06 01:02:59,740][52803] DAMAGECOUNT value on done: 151691.0 [2024-08-06 01:02:59,742][52803] Sum rewards: 48.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.212', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.584', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '41.500'} [2024-08-06 01:02:59,774][52662] DAMAGECOUNT value on done: 165505.0 [2024-08-06 01:02:59,774][52662] Sum rewards: 54.164, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.102', 'AMMO3': '0.136', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.586', 'HEALTH': '0.706', 'WEAPON3': '0.800', 'weapon3': '2.846', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.813', 'FRAGCOUNT': '43.000'} [2024-08-06 01:02:59,818][52668] DAMAGECOUNT value on done: 159832.0 [2024-08-06 01:02:59,821][52668] Sum rewards: 65.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.168', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '53.500'} [2024-08-06 01:03:00,112][52660] DAMAGECOUNT value on done: 164387.0 [2024-08-06 01:03:00,113][52660] Sum rewards: 58.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon5': '0.210', 'weapon4': '0.234', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '50.500'} [2024-08-06 01:03:00,164][52820] DAMAGECOUNT value on done: 149017.0 [2024-08-06 01:03:00,164][52820] Sum rewards: 60.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'weapon5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon2': '0.486', 'weapon4': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.878', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:00,889][52664] DAMAGECOUNT value on done: 165116.0 [2024-08-06 01:03:00,890][52664] Sum rewards: 58.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.126', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.118', 'AMMO4': '0.157', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.422', 'weapon4': '0.434', 'ARMOR': '0.459', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:02,196][52794] DAMAGECOUNT value on done: 163611.0 [2024-08-06 01:03:02,196][52794] Sum rewards: 62.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.188', 'weapon5': '0.262', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.506', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:02,523][52667] DAMAGECOUNT value on done: 160798.0 [2024-08-06 01:03:02,523][52667] Sum rewards: 55.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.067', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.153', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.116', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:02,642][52650] Updated weights for policy 0, policy_version 27371 (0.0021) [2024-08-06 01:03:02,724][52662] DAMAGECOUNT value on done: 172352.0 [2024-08-06 01:03:02,724][52662] Sum rewards: 64.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.828', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.204', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '54.000'} [2024-08-06 01:03:02,781][52803] DAMAGECOUNT value on done: 156048.0 [2024-08-06 01:03:02,783][52803] Sum rewards: 42.253, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.906', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.236', 'AMMO3': '0.244', 'weapon2': '0.590', 'WEAPON4': '0.600', 'weapon4': '0.880', 'WEAPON3': '1.350', 'weapon3': '2.062', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '11.826', 'FRAGCOUNT': '41.500'} [2024-08-06 01:03:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 224223232. Throughput: 0: 4367.6. Samples: 56055540. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 01:03:02,794][52567] Avg episode reward: [(0, '57.271')] [2024-08-06 01:03:02,898][52668] DAMAGECOUNT value on done: 154099.0 [2024-08-06 01:03:02,899][52668] Sum rewards: 33.058, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.065', 'AMMO3': '0.251', 'weapon5': '0.260', 'AMMO4': '0.325', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON4': '0.900', 'weapon4': '1.058', 'WEAPON3': '1.400', 'weapon3': '1.764', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '32.000'} [2024-08-06 01:03:03,175][52660] DAMAGECOUNT value on done: 162425.0 [2024-08-06 01:03:03,177][52660] Sum rewards: 58.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'ARMOR': '0.004', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.157', 'WEAPON4': '0.350', 'weapon2': '0.460', 'weapon4': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.752', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:03,406][52664] DAMAGECOUNT value on done: 168638.0 [2024-08-06 01:03:03,406][52664] Sum rewards: 60.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.706', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.186', 'weapon4': '0.266', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:03,432][52820] DAMAGECOUNT value on done: 143973.0 [2024-08-06 01:03:03,433][52820] Sum rewards: 56.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.368', 'weapon2': '0.580', 'WEAPON3': '0.950', 'weapon3': '2.702', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:03,749][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:03:05,201][52794] DAMAGECOUNT value on done: 164046.0 [2024-08-06 01:03:05,201][52794] Sum rewards: 58.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.720', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.456', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:05,289][52668] DAMAGECOUNT value on done: 160699.0 [2024-08-06 01:03:05,289][52668] Sum rewards: 48.465, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.414', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.112', 'weapon5': '0.174', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '0.702', 'weapon2': '0.966', 'weapon3': '1.968', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '38.000'} [2024-08-06 01:03:05,323][52667] DAMAGECOUNT value on done: 165006.0 [2024-08-06 01:03:05,323][52667] Sum rewards: 63.405, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.004', 'AMMO2': '0.034', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.172', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.230', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '54.000'} [2024-08-06 01:03:05,519][52660] DAMAGECOUNT value on done: 163457.0 [2024-08-06 01:03:05,519][52660] Sum rewards: 65.821, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon5': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.348', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '53.500'} [2024-08-06 01:03:05,562][52662] DAMAGECOUNT value on done: 164916.0 [2024-08-06 01:03:05,565][52662] Sum rewards: 58.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.054', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon4': '0.110', 'weapon5': '0.172', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.096', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:05,826][52803] DAMAGECOUNT value on done: 150932.0 [2024-08-06 01:03:05,827][52803] Sum rewards: 40.625, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.424', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.141', 'AMMO3': '0.144', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.810', 'WEAPON3': '0.900', 'HITCOUNT': '2.190', 'weapon3': '2.532', 'DAMAGECOUNT': '10.602', 'FRAGCOUNT': '34.000'} [2024-08-06 01:03:06,019][52614] Signal inference workers to stop experience collection... (5050 times) [2024-08-06 01:03:06,022][52614] Signal inference workers to resume experience collection... (5050 times) [2024-08-06 01:03:06,072][52650] InferenceWorker_p0-w0: stopping experience collection (5050 times) [2024-08-06 01:03:06,083][52650] InferenceWorker_p0-w0: resuming experience collection (5050 times) [2024-08-06 01:03:06,652][52820] DAMAGECOUNT value on done: 150697.0 [2024-08-06 01:03:06,654][52820] Sum rewards: 43.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.542', 'AMMO5': '0.016', 'ARMOR': '0.016', 'AMMO2': '0.078', 'AMMO3': '0.165', 'weapon4': '0.244', 'AMMO4': '0.392', 'weapon5': '0.394', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.520', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '12.111', 'FRAGCOUNT': '39.500'} [2024-08-06 01:03:07,015][52650] Updated weights for policy 0, policy_version 27381 (0.0020) [2024-08-06 01:03:07,603][52811] DAMAGECOUNT value on done: 161469.0 [2024-08-06 01:03:07,606][52811] Sum rewards: 63.617, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.891', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.197', 'weapon4': '0.268', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 224313344. Throughput: 0: 4379.8. Samples: 56081870. Policy #0 lag: (min: 1.0, avg: 4.5, max: 9.0) [2024-08-06 01:03:07,794][52567] Avg episode reward: [(0, '56.490')] [2024-08-06 01:03:07,991][52794] DAMAGECOUNT value on done: 166499.0 [2024-08-06 01:03:07,991][52794] Sum rewards: 57.450, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.592', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.176', 'weapon4': '0.234', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:08,166][52667] DAMAGECOUNT value on done: 165547.0 [2024-08-06 01:03:08,167][52667] Sum rewards: 62.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.791', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '54.000'} [2024-08-06 01:03:08,258][52668] DAMAGECOUNT value on done: 158554.0 [2024-08-06 01:03:08,259][52668] Sum rewards: 53.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.874', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.157', 'weapon5': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.518', 'weapon4': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.258', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:08,399][52662] DAMAGECOUNT value on done: 169340.0 [2024-08-06 01:03:08,399][52662] Sum rewards: 55.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.375', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.178', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.500', 'weapon4': '0.804', 'WEAPON3': '1.450', 'weapon3': '2.468', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:08,503][52660] DAMAGECOUNT value on done: 161862.0 [2024-08-06 01:03:08,504][52660] Sum rewards: 56.908, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '2.580', 'weapon3': '3.274', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:08,883][52803] DAMAGECOUNT value on done: 153097.0 [2024-08-06 01:03:08,884][52803] Sum rewards: 63.053, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.430', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.205', 'weapon2': '0.564', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.258', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '53.000'} [2024-08-06 01:03:09,840][52820] DAMAGECOUNT value on done: 149532.0 [2024-08-06 01:03:09,841][52820] Sum rewards: 47.341, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.962', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon5': '0.184', 'AMMO3': '0.263', 'AMMO4': '0.297', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON4': '0.600', 'weapon2': '0.606', 'WEAPON3': '1.450', 'weapon3': '2.512', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '45.500'} [2024-08-06 01:03:10,774][52794] DAMAGECOUNT value on done: 165389.0 [2024-08-06 01:03:10,775][52794] Sum rewards: 53.839, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.286', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.458', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:10,805][52811] DAMAGECOUNT value on done: 149032.0 [2024-08-06 01:03:10,805][52811] Sum rewards: 51.281, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.378', 'weapon2': '0.432', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '2.920', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:11,004][52667] DAMAGECOUNT value on done: 166706.0 [2024-08-06 01:03:11,007][52667] Sum rewards: 56.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO3': '0.195', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.286', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:11,143][52669] DAMAGECOUNT value on done: 166136.0 [2024-08-06 01:03:11,144][52669] Sum rewards: 50.249, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon4': '0.258', 'weapon2': '0.330', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.144', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:11,264][52662] DAMAGECOUNT value on done: 164528.0 [2024-08-06 01:03:11,266][52662] Sum rewards: 65.478, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.129', 'AMMO3': '0.222', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 01:03:11,313][52668] DAMAGECOUNT value on done: 163600.0 [2024-08-06 01:03:11,313][52668] Sum rewards: 55.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.154', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon2': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.516', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:11,495][52660] DAMAGECOUNT value on done: 166730.0 [2024-08-06 01:03:11,496][52660] Sum rewards: 63.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.012', 'weapon4': '0.018', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.231', 'weapon2': '0.274', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.472', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '55.000'} [2024-08-06 01:03:11,632][52650] Updated weights for policy 0, policy_version 27391 (0.0034) [2024-08-06 01:03:12,037][52803] DAMAGECOUNT value on done: 156448.0 [2024-08-06 01:03:12,037][52803] Sum rewards: 50.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.080', 'AMMO3': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.235', 'WEAPON4': '0.500', 'weapon4': '0.746', 'WEAPON3': '0.750', 'weapon2': '0.752', 'weapon3': '2.234', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.588', 'FRAGCOUNT': '41.000'} [2024-08-06 01:03:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 224395264. Throughput: 0: 4387.5. Samples: 56108290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:03:12,795][52567] Avg episode reward: [(0, '56.698')] [2024-08-06 01:03:13,004][52820] DAMAGECOUNT value on done: 150374.0 [2024-08-06 01:03:13,004][52820] Sum rewards: 51.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.190', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON4': '0.500', 'weapon4': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.464', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '44.000'} [2024-08-06 01:03:13,557][52794] DAMAGECOUNT value on done: 172587.0 [2024-08-06 01:03:13,558][52794] Sum rewards: 55.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.827', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.144', 'AMMO3': '0.169', 'weapon2': '0.274', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.116', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:13,897][52662] DAMAGECOUNT value on done: 169702.0 [2024-08-06 01:03:13,897][52662] Sum rewards: 67.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.540', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.232', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.582', 'WEAPON3': '1.450', 'weapon3': '2.800', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '59.000'} [2024-08-06 01:03:13,964][52811] DAMAGECOUNT value on done: 153961.0 [2024-08-06 01:03:13,967][52811] Sum rewards: 58.150, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.006', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.124', 'weapon4': '0.166', 'AMMO4': '0.202', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.790', 'weapon3': '3.058', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '54.000'} [2024-08-06 01:03:14,052][52668] DAMAGECOUNT value on done: 162826.0 [2024-08-06 01:03:14,052][52668] Sum rewards: 68.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.116', 'AMMO4': '0.143', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.288', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '57.000'} [2024-08-06 01:03:14,185][52667] DAMAGECOUNT value on done: 162862.0 [2024-08-06 01:03:14,186][52667] Sum rewards: 66.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.614', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.030', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.254', 'weapon2': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '55.000'} [2024-08-06 01:03:14,254][52669] DAMAGECOUNT value on done: 162938.0 [2024-08-06 01:03:14,258][52669] Sum rewards: 55.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.564', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.220', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:14,312][52660] DAMAGECOUNT value on done: 158092.0 [2024-08-06 01:03:14,312][52660] Sum rewards: 57.337, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.154', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:15,220][52803] DAMAGECOUNT value on done: 152017.0 [2024-08-06 01:03:15,220][52803] Sum rewards: 57.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.162', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:16,035][52794] DAMAGECOUNT value on done: 165911.0 [2024-08-06 01:03:16,036][52794] Sum rewards: 62.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.308', 'weapon4': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:16,294][52820] DAMAGECOUNT value on done: 152058.0 [2024-08-06 01:03:16,294][52820] Sum rewards: 56.397, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.825', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.190', 'AMMO4': '0.196', 'weapon4': '0.204', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '52.500'} [2024-08-06 01:03:16,385][52662] DAMAGECOUNT value on done: 166872.0 [2024-08-06 01:03:16,387][52662] Sum rewards: 68.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon4': '0.234', 'weapon2': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '57.000'} [2024-08-06 01:03:16,645][52650] Updated weights for policy 0, policy_version 27401 (0.0024) [2024-08-06 01:03:16,890][52668] DAMAGECOUNT value on done: 164579.0 [2024-08-06 01:03:16,890][52668] Sum rewards: 54.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'weapon4': '0.570', 'weapon2': '0.714', 'WEAPON3': '1.100', 'weapon3': '2.434', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:16,902][52669] DAMAGECOUNT value on done: 163094.0 [2024-08-06 01:03:16,903][52669] Sum rewards: 62.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO3': '0.150', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.662', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:17,078][52811] DAMAGECOUNT value on done: 151683.0 [2024-08-06 01:03:17,078][52811] Sum rewards: 57.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.144', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:17,212][52660] DAMAGECOUNT value on done: 162088.0 [2024-08-06 01:03:17,212][52660] Sum rewards: 47.295, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.232', 'weapon2': '0.412', 'weapon4': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '44.000'} [2024-08-06 01:03:17,275][52667] DAMAGECOUNT value on done: 164566.0 [2024-08-06 01:03:17,275][52667] Sum rewards: 60.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.634', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.344', 'ARMOR': '0.479', 'weapon2': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 224493568. Throughput: 0: 4389.3. Samples: 56121330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:03:17,795][52567] Avg episode reward: [(0, '56.685')] [2024-08-06 01:03:18,268][52803] DAMAGECOUNT value on done: 156675.0 [2024-08-06 01:03:18,268][52803] Sum rewards: 60.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.184', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.370', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.162', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:18,771][52794] DAMAGECOUNT value on done: 169708.0 [2024-08-06 01:03:18,772][52794] Sum rewards: 60.757, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.056', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon5': '0.124', 'AMMO3': '0.174', 'AMMO4': '0.277', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.500', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:19,200][52662] DAMAGECOUNT value on done: 170055.0 [2024-08-06 01:03:19,200][52662] Sum rewards: 55.465, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.580', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.108', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.460', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:19,390][52820] DAMAGECOUNT value on done: 150013.0 [2024-08-06 01:03:19,391][52820] Sum rewards: 63.556, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon2': '0.168', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'weapon3': '3.422', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '57.000'} [2024-08-06 01:03:19,504][52669] DAMAGECOUNT value on done: 161500.0 [2024-08-06 01:03:19,506][52669] Sum rewards: 58.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.327', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.192', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '3.104', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:19,915][52668] DAMAGECOUNT value on done: 166697.0 [2024-08-06 01:03:19,915][52668] Sum rewards: 47.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.867', 'AMMO2': '0.008', 'AMMO5': '0.012', 'ARMOR': '0.036', 'AMMO4': '0.041', 'weapon5': '0.074', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.402', 'WEAPON3': '1.400', 'HITCOUNT': '2.730', 'weapon3': '2.936', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '42.000'} [2024-08-06 01:03:20,017][52811] DAMAGECOUNT value on done: 153295.0 [2024-08-06 01:03:20,018][52811] Sum rewards: 56.480, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.487', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.050', 'weapon7': '0.058', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.518', 'weapon2': '0.684', 'WEAPON3': '0.800', 'weapon3': '2.420', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '45.000'} [2024-08-06 01:03:20,162][52667] DAMAGECOUNT value on done: 165113.0 [2024-08-06 01:03:20,163][52667] Sum rewards: 59.173, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.126', 'AMMO5': '0.006', 'ARMOR': '0.028', 'AMMO2': '0.040', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'weapon4': '0.454', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:20,254][52660] DAMAGECOUNT value on done: 163568.0 [2024-08-06 01:03:20,254][52660] Sum rewards: 46.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.617', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.058', 'AMMO4': '0.196', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.492', 'weapon2': '0.522', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.492', 'FRAGCOUNT': '42.000'} [2024-08-06 01:03:21,177][52650] Updated weights for policy 0, policy_version 27411 (0.0012) [2024-08-06 01:03:21,365][52803] DAMAGECOUNT value on done: 149595.0 [2024-08-06 01:03:21,367][52803] Sum rewards: 46.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.723', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon5': '0.264', 'weapon2': '0.274', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.456', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '40.000'} [2024-08-06 01:03:21,885][52794] DAMAGECOUNT value on done: 172043.0 [2024-08-06 01:03:21,885][52794] Sum rewards: 57.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO2': '0.045', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.225', 'weapon2': '0.776', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:22,318][52669] DAMAGECOUNT value on done: 163095.0 [2024-08-06 01:03:22,318][52669] Sum rewards: 53.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.025', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.190', 'AMMO4': '0.231', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.110', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '46.500'} [2024-08-06 01:03:22,331][52662] DAMAGECOUNT value on done: 163287.0 [2024-08-06 01:03:22,331][52662] Sum rewards: 52.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.008', 'AMMO2': '0.059', 'weapon5': '0.060', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO4': '0.294', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.162', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:22,475][52820] DAMAGECOUNT value on done: 154219.0 [2024-08-06 01:03:22,475][52820] Sum rewards: 52.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.722', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.292', 'weapon2': '0.414', 'WEAPON3': '1.750', 'HITCOUNT': '3.190', 'weapon3': '3.274', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 224575488. Throughput: 0: 4397.8. Samples: 56147990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:03:22,794][52567] Avg episode reward: [(0, '56.598')] [2024-08-06 01:03:22,813][52668] DAMAGECOUNT value on done: 164715.0 [2024-08-06 01:03:22,813][52668] Sum rewards: 53.674, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.068', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.171', 'weapon2': '0.418', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '3.242', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '45.000'} [2024-08-06 01:03:23,029][52811] DAMAGECOUNT value on done: 157372.0 [2024-08-06 01:03:23,029][52811] Sum rewards: 54.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.851', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.154', 'weapon5': '0.252', 'AMMO4': '0.266', 'weapon2': '0.354', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.632', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:23,182][52660] DAMAGECOUNT value on done: 173731.0 [2024-08-06 01:03:23,185][52660] Sum rewards: 61.815, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.287', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.012', 'weapon4': '0.032', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.262', 'weapon2': '0.460', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '53.000'} [2024-08-06 01:03:23,388][52667] DAMAGECOUNT value on done: 164663.0 [2024-08-06 01:03:23,389][52667] Sum rewards: 42.585, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.228', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.176', 'weapon5': '0.218', 'AMMO3': '0.292', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'HITCOUNT': '2.630', 'weapon3': '3.082', 'DAMAGECOUNT': '12.825', 'FRAGCOUNT': '41.000'} [2024-08-06 01:03:24,552][52803] DAMAGECOUNT value on done: 153179.0 [2024-08-06 01:03:24,555][52803] Sum rewards: 52.154, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.045', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.390', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.292', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '46.500'} [2024-08-06 01:03:25,034][52669] DAMAGECOUNT value on done: 161976.0 [2024-08-06 01:03:25,034][52669] Sum rewards: 59.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.934', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.136', 'AMMO4': '0.197', 'AMMO3': '0.244', 'weapon5': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.852', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:25,212][52794] DAMAGECOUNT value on done: 163863.0 [2024-08-06 01:03:25,214][52794] Sum rewards: 55.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.210', 'weapon5': '0.216', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '45.500'} [2024-08-06 01:03:25,713][52662] DAMAGECOUNT value on done: 166672.0 [2024-08-06 01:03:25,714][52662] Sum rewards: 51.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.116', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.166', 'weapon5': '0.204', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.435', 'FRAGCOUNT': '43.000'} [2024-08-06 01:03:25,752][52820] DAMAGECOUNT value on done: 153123.0 [2024-08-06 01:03:25,755][52820] Sum rewards: 68.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.444', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO4': '0.012', 'WEAPON4': '0.100', 'AMMO3': '0.250', 'weapon4': '0.304', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '59.000'} [2024-08-06 01:03:25,996][52650] Updated weights for policy 0, policy_version 27421 (0.0010) [2024-08-06 01:03:26,092][52811] DAMAGECOUNT value on done: 153554.0 [2024-08-06 01:03:26,094][52811] Sum rewards: 56.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.156', 'AMMO3': '0.249', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.500', 'weapon4': '0.558', 'WEAPON3': '1.500', 'weapon3': '2.676', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:26,217][52667] DAMAGECOUNT value on done: 162879.0 [2024-08-06 01:03:26,218][52667] Sum rewards: 58.488, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.082', 'AMMO3': '0.178', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.428', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '51.500'} [2024-08-06 01:03:26,386][52660] DAMAGECOUNT value on done: 161039.0 [2024-08-06 01:03:26,386][52660] Sum rewards: 54.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.894', 'AMMO5': '0.008', 'ARMOR': '0.017', 'AMMO2': '0.038', 'weapon4': '0.172', 'AMMO3': '0.187', 'AMMO4': '0.192', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.914', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '45.000'} [2024-08-06 01:03:27,526][52803] DAMAGECOUNT value on done: 149018.0 [2024-08-06 01:03:27,526][52803] Sum rewards: 46.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.794', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.548', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '3.122', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '39.000'} [2024-08-06 01:03:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 224665600. Throughput: 0: 4398.2. Samples: 56174310. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:03:27,794][52567] Avg episode reward: [(0, '56.669')] [2024-08-06 01:03:27,861][52669] DAMAGECOUNT value on done: 164312.0 [2024-08-06 01:03:27,861][52669] Sum rewards: 45.078, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.194', 'HEALTH': '0.294', 'weapon2': '0.452', 'WEAPON3': '0.850', 'HITCOUNT': '2.710', 'weapon3': '3.158', 'DAMAGECOUNT': '12.108', 'FRAGCOUNT': '36.000'} [2024-08-06 01:03:27,999][52794] DAMAGECOUNT value on done: 167608.0 [2024-08-06 01:03:27,999][52794] Sum rewards: 47.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.596', 'AMMO5': '0.014', 'ARMOR': '0.024', 'AMMO2': '0.034', 'AMMO3': '0.162', 'AMMO4': '0.170', 'weapon5': '0.182', 'weapon4': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.754', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '40.000'} [2024-08-06 01:03:28,556][52662] DAMAGECOUNT value on done: 165421.0 [2024-08-06 01:03:28,557][52662] Sum rewards: 54.616, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.128', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.131', 'weapon5': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.356', 'weapon2': '0.488', 'WEAPON3': '0.800', 'weapon3': '2.822', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '43.000'} [2024-08-06 01:03:29,085][52820] DAMAGECOUNT value on done: 153794.0 [2024-08-06 01:03:29,085][52820] Sum rewards: 68.963, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.105', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon4': '0.036', 'AMMO2': '0.044', 'weapon5': '0.074', 'AMMO4': '0.220', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '59.000'} [2024-08-06 01:03:29,154][52660] DAMAGECOUNT value on done: 164187.0 [2024-08-06 01:03:29,154][52660] Sum rewards: 47.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.245', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.058', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.289', 'WEAPON4': '0.500', 'weapon2': '0.550', 'weapon4': '0.934', 'WEAPON3': '1.050', 'weapon3': '2.208', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.270', 'FRAGCOUNT': '38.500'} [2024-08-06 01:03:29,192][52811] DAMAGECOUNT value on done: 152497.0 [2024-08-06 01:03:29,192][52811] Sum rewards: 51.336, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.388', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.145', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '2.794', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:29,243][52667] DAMAGECOUNT value on done: 165649.0 [2024-08-06 01:03:29,246][52667] Sum rewards: 60.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.032', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.168', 'weapon5': '0.196', 'AMMO4': '0.209', 'weapon4': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.962', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:30,314][52650] Updated weights for policy 0, policy_version 27431 (0.0026) [2024-08-06 01:03:30,529][52803] DAMAGECOUNT value on done: 157443.0 [2024-08-06 01:03:30,529][52803] Sum rewards: 58.891, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.194', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '2.470', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:30,655][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:03:30,805][52669] DAMAGECOUNT value on done: 163422.0 [2024-08-06 01:03:30,806][52669] Sum rewards: 47.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.220', 'weapon2': '0.792', 'WEAPON3': '1.200', 'weapon3': '2.664', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.222', 'FRAGCOUNT': '40.000'} [2024-08-06 01:03:30,876][52794] DAMAGECOUNT value on done: 163687.0 [2024-08-06 01:03:30,878][52794] Sum rewards: 46.200, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.934', 'AMMO5': '0.003', 'weapon4': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.524', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.298', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '37.000'} [2024-08-06 01:03:31,365][52662] DAMAGECOUNT value on done: 164683.0 [2024-08-06 01:03:31,365][52662] Sum rewards: 57.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.502', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.173', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON4': '0.650', 'weapon4': '0.758', 'WEAPON3': '1.150', 'weapon3': '2.198', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:32,276][52820] DAMAGECOUNT value on done: 151392.0 [2024-08-06 01:03:32,277][52820] Sum rewards: 59.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.183', 'weapon4': '0.276', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '2.992', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:32,335][52811] DAMAGECOUNT value on done: 158866.0 [2024-08-06 01:03:32,336][52811] Sum rewards: 56.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.114', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.324', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.088', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:32,389][52667] DAMAGECOUNT value on done: 161706.0 [2024-08-06 01:03:32,392][52667] Sum rewards: 56.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.157', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.516', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.588', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:32,401][52660] DAMAGECOUNT value on done: 156094.0 [2024-08-06 01:03:32,402][52660] Sum rewards: 61.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.150', 'AMMO4': '0.222', 'AMMO3': '0.226', 'weapon2': '0.258', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 224755712. Throughput: 0: 4396.5. Samples: 56187510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:03:32,802][52567] Avg episode reward: [(0, '56.110')] [2024-08-06 01:03:33,541][52794] DAMAGECOUNT value on done: 175390.0 [2024-08-06 01:03:33,542][52794] Sum rewards: 62.136, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.033', 'ARMOR': '0.046', 'weapon5': '0.124', 'AMMO4': '0.164', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.466', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.638', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '54.000'} [2024-08-06 01:03:33,584][52803] DAMAGECOUNT value on done: 156912.0 [2024-08-06 01:03:33,584][52803] Sum rewards: 59.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.580', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.452', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:33,822][52669] DAMAGECOUNT value on done: 164278.0 [2024-08-06 01:03:33,822][52669] Sum rewards: 54.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.888', 'AMMO5': '0.019', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.137', 'weapon4': '0.162', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:35,301][52650] Updated weights for policy 0, policy_version 27441 (0.0031) [2024-08-06 01:03:35,345][52660] DAMAGECOUNT value on done: 165815.0 [2024-08-06 01:03:35,347][52660] Sum rewards: 49.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.045', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.112', 'AMMO3': '0.114', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon2': '0.514', 'weapon4': '0.596', 'WEAPON3': '0.700', 'weapon3': '2.458', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '40.000'} [2024-08-06 01:03:35,366][52811] DAMAGECOUNT value on done: 152918.0 [2024-08-06 01:03:35,368][52811] Sum rewards: 57.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.096', 'AMMO3': '0.164', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.506', 'weapon4': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.586', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '48.500'} [2024-08-06 01:03:35,561][52667] DAMAGECOUNT value on done: 166422.0 [2024-08-06 01:03:35,562][52667] Sum rewards: 54.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.679', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.036', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.153', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.466', 'weapon4': '0.738', 'WEAPON3': '0.850', 'weapon3': '2.490', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:35,673][52820] DAMAGECOUNT value on done: 152252.0 [2024-08-06 01:03:35,673][52820] Sum rewards: 62.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.098', 'weapon5': '0.116', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:36,392][52658] DAMAGECOUNT value on done: 169084.0 [2024-08-06 01:03:36,393][52658] Sum rewards: 75.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.566', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.452', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '65.000'} [2024-08-06 01:03:36,445][52803] DAMAGECOUNT value on done: 153162.0 [2024-08-06 01:03:36,445][52803] Sum rewards: 53.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.179', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.246', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:36,604][52794] DAMAGECOUNT value on done: 162448.0 [2024-08-06 01:03:36,606][52794] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.115', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '55.000'} [2024-08-06 01:03:36,653][52669] DAMAGECOUNT value on done: 161000.0 [2024-08-06 01:03:36,653][52669] Sum rewards: 57.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.708', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.524', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.528', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 224837632. Throughput: 0: 4395.8. Samples: 56213890. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:03:37,794][52567] Avg episode reward: [(0, '56.220')] [2024-08-06 01:03:38,168][52667] DAMAGECOUNT value on done: 170465.0 [2024-08-06 01:03:38,168][52667] Sum rewards: 54.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.210', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.386', 'weapon4': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.630', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:38,472][52811] DAMAGECOUNT value on done: 152842.0 [2024-08-06 01:03:38,478][52811] Sum rewards: 50.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.016', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon2': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.600', 'weapon3': '2.820', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '45.000'} [2024-08-06 01:03:38,494][52660] DAMAGECOUNT value on done: 159643.0 [2024-08-06 01:03:38,494][52660] Sum rewards: 53.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.366', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO4': '0.153', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:38,887][52820] DAMAGECOUNT value on done: 154283.0 [2024-08-06 01:03:38,889][52820] Sum rewards: 56.087, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.112', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.160', 'weapon5': '0.212', 'AMMO4': '0.222', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.450', 'weapon3': '2.772', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:39,380][52658] DAMAGECOUNT value on done: 164836.0 [2024-08-06 01:03:39,383][52658] Sum rewards: 63.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.584', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.454', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:39,518][52803] DAMAGECOUNT value on done: 157077.0 [2024-08-06 01:03:39,519][52803] Sum rewards: 60.733, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'weapon5': '0.156', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.380', 'WEAPON4': '0.500', 'weapon4': '0.792', 'WEAPON3': '0.850', 'weapon3': '2.368', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:39,546][52669] DAMAGECOUNT value on done: 164192.0 [2024-08-06 01:03:39,547][52669] Sum rewards: 48.384, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.062', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.184', 'weapon2': '0.670', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '3.240', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '39.000'} [2024-08-06 01:03:39,726][52794] DAMAGECOUNT value on done: 171625.0 [2024-08-06 01:03:39,727][52794] Sum rewards: 61.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.660', 'AMMO5': '0.003', 'weapon5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.117', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.540', 'weapon2': '0.604', 'WEAPON3': '0.750', 'weapon3': '2.666', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:39,908][52650] Updated weights for policy 0, policy_version 27451 (0.0014) [2024-08-06 01:03:41,025][52667] DAMAGECOUNT value on done: 169844.0 [2024-08-06 01:03:41,028][52667] Sum rewards: 63.308, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.374', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.188', 'weapon5': '0.218', 'AMMO4': '0.220', 'AMMO3': '0.238', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '56.000'} [2024-08-06 01:03:41,976][52658] DAMAGECOUNT value on done: 168154.0 [2024-08-06 01:03:41,976][52811] DAMAGECOUNT value on done: 155101.0 [2024-08-06 01:03:41,978][52658] Sum rewards: 62.389, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'weapon4': '0.174', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:41,978][52811] Sum rewards: 56.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.175', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.478', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:42,012][52820] DAMAGECOUNT value on done: 151527.0 [2024-08-06 01:03:42,013][52820] Sum rewards: 50.206, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.196', 'weapon5': '0.272', 'WEAPON5': '0.400', 'weapon2': '0.424', 'weapon4': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.592', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:42,561][52669] DAMAGECOUNT value on done: 165324.0 [2024-08-06 01:03:42,561][52669] Sum rewards: 52.796, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.585', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO3': '0.149', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON3': '0.900', 'weapon3': '2.756', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '42.500'} [2024-08-06 01:03:42,621][52803] DAMAGECOUNT value on done: 152150.0 [2024-08-06 01:03:42,621][52803] Sum rewards: 57.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.188', 'weapon4': '0.206', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '2.770', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:42,774][52794] DAMAGECOUNT value on done: 166505.0 [2024-08-06 01:03:42,776][52794] Sum rewards: 63.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.804', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon4': '0.092', 'weapon5': '0.208', 'AMMO4': '0.229', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '53.000'} [2024-08-06 01:03:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 224927744. Throughput: 0: 4392.7. Samples: 56239900. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:03:42,794][52567] Avg episode reward: [(0, '56.630')] [2024-08-06 01:03:43,620][52667] DAMAGECOUNT value on done: 170301.0 [2024-08-06 01:03:43,620][52667] Sum rewards: 57.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.550', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO3': '0.156', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.398', 'WEAPON3': '0.950', 'weapon3': '2.748', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '46.000'} [2024-08-06 01:03:44,703][52658] DAMAGECOUNT value on done: 167032.0 [2024-08-06 01:03:44,703][52658] Sum rewards: 46.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.744', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.187', 'AMMO4': '0.235', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.568', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '39.000'} [2024-08-06 01:03:44,725][52650] Updated weights for policy 0, policy_version 27461 (0.0031) [2024-08-06 01:03:44,999][52811] DAMAGECOUNT value on done: 152824.0 [2024-08-06 01:03:44,999][52811] Sum rewards: 56.968, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.809', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.272', 'weapon2': '0.272', 'weapon4': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:45,183][52820] DAMAGECOUNT value on done: 152029.0 [2024-08-06 01:03:45,187][52820] Sum rewards: 50.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO4': '0.211', 'weapon5': '0.212', 'AMMO3': '0.215', 'weapon4': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.662', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '42.000'} [2024-08-06 01:03:45,413][52669] DAMAGECOUNT value on done: 160895.0 [2024-08-06 01:03:45,414][52669] Sum rewards: 56.319, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.613', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon4': '0.320', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:45,681][52803] DAMAGECOUNT value on done: 150553.0 [2024-08-06 01:03:45,681][52803] Sum rewards: 63.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.686', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.202', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:45,877][52794] DAMAGECOUNT value on done: 166909.0 [2024-08-06 01:03:45,879][52794] Sum rewards: 62.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:46,530][52667] DAMAGECOUNT value on done: 163458.0 [2024-08-06 01:03:46,530][52667] Sum rewards: 65.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.170', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.059', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon4': '0.220', 'AMMO3': '0.241', 'AMMO4': '0.294', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '2.826', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '56.000'} [2024-08-06 01:03:47,445][52658] DAMAGECOUNT value on done: 167256.0 [2024-08-06 01:03:47,447][52658] Sum rewards: 57.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.146', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.166', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '3.076', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 225009664. Throughput: 0: 4393.5. Samples: 56253250. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:03:47,795][52567] Avg episode reward: [(0, '56.768')] [2024-08-06 01:03:48,130][52811] DAMAGECOUNT value on done: 154731.0 [2024-08-06 01:03:48,133][52811] Sum rewards: 56.960, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.364', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.290', 'weapon2': '0.552', 'WEAPON3': '0.900', 'HITCOUNT': '3.010', 'weapon3': '3.024', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:48,293][52820] DAMAGECOUNT value on done: 155943.0 [2024-08-06 01:03:48,295][52669] DAMAGECOUNT value on done: 165432.0 [2024-08-06 01:03:48,295][52820] Sum rewards: 68.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.789', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '57.500'} [2024-08-06 01:03:48,295][52669] Sum rewards: 62.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.346', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.144', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.808', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2024-08-06 01:03:48,644][52803] DAMAGECOUNT value on done: 157355.0 [2024-08-06 01:03:48,645][52803] Sum rewards: 59.781, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.218', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.053', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.263', 'weapon4': '0.362', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.864', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '51.000'} [2024-08-06 01:03:48,671][52666] DAMAGECOUNT value on done: 166941.0 [2024-08-06 01:03:48,672][52666] Sum rewards: 59.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO4': '0.172', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON4': '0.400', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '50.500'} [2024-08-06 01:03:48,673][52794] DAMAGECOUNT value on done: 173568.0 [2024-08-06 01:03:48,677][52794] Sum rewards: 53.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.182', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.434', 'WEAPON3': '1.650', 'HITCOUNT': '3.020', 'weapon3': '3.090', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:49,071][52650] Updated weights for policy 0, policy_version 27471 (0.0021) [2024-08-06 01:03:49,149][52667] DAMAGECOUNT value on done: 169741.0 [2024-08-06 01:03:49,150][52667] Sum rewards: 54.010, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.136', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.410', 'weapon2': '0.570', 'WEAPON3': '1.000', 'HITCOUNT': '2.630', 'weapon3': '2.736', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '44.000'} [2024-08-06 01:03:50,191][52658] DAMAGECOUNT value on done: 160995.0 [2024-08-06 01:03:50,192][52658] Sum rewards: 57.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.818', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.242', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.468', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:51,143][52669] DAMAGECOUNT value on done: 170930.0 [2024-08-06 01:03:51,144][52669] Sum rewards: 63.540, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.264', 'weapon4': '0.332', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '2.916', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '55.000'} [2024-08-06 01:03:51,192][52811] DAMAGECOUNT value on done: 153907.0 [2024-08-06 01:03:51,192][52811] Sum rewards: 58.065, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.120', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.150', 'HEALTH': '0.252', 'weapon4': '0.682', 'weapon2': '0.700', 'WEAPON3': '0.750', 'weapon3': '2.316', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '44.500'} [2024-08-06 01:03:51,476][52820] DAMAGECOUNT value on done: 158430.0 [2024-08-06 01:03:51,479][52820] Sum rewards: 71.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.525', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.066', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.246', 'WEAPON3': '1.050', 'weapon3': '3.392', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 01:03:51,570][52666] DAMAGECOUNT value on done: 166928.0 [2024-08-06 01:03:51,572][52666] Sum rewards: 62.423, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.112', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.764', 'WEAPON3': '0.950', 'weapon3': '2.766', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:51,583][52803] DAMAGECOUNT value on done: 152766.0 [2024-08-06 01:03:51,584][52803] Sum rewards: 59.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.769', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'AMMO4': '0.169', 'WEAPON4': '0.500', 'weapon4': '0.520', 'weapon2': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.586', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:51,592][52794] DAMAGECOUNT value on done: 167580.0 [2024-08-06 01:03:51,594][52794] Sum rewards: 59.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.813', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon2': '0.152', 'AMMO3': '0.197', 'weapon4': '0.324', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.142', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 225099776. Throughput: 0: 4390.7. Samples: 56279450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:03:52,794][52567] Avg episode reward: [(0, '57.011')] [2024-08-06 01:03:53,309][52658] DAMAGECOUNT value on done: 170253.0 [2024-08-06 01:03:53,309][52658] Sum rewards: 51.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.646', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.136', 'weapon4': '0.166', 'AMMO4': '0.206', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '43.000'} [2024-08-06 01:03:53,600][52669] DAMAGECOUNT value on done: 175506.0 [2024-08-06 01:03:53,600][52669] Sum rewards: 60.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.648', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '54.000'} [2024-08-06 01:03:53,915][52650] Updated weights for policy 0, policy_version 27481 (0.0013) [2024-08-06 01:03:54,327][52666] DAMAGECOUNT value on done: 166070.0 [2024-08-06 01:03:54,327][52666] Sum rewards: 62.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.076', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.058', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:54,357][52811] DAMAGECOUNT value on done: 155472.0 [2024-08-06 01:03:54,358][52811] Sum rewards: 54.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.228', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.198', 'weapon4': '0.218', 'WEAPON4': '0.450', 'weapon2': '0.874', 'WEAPON3': '0.900', 'weapon3': '2.582', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:54,598][52820] DAMAGECOUNT value on done: 150928.0 [2024-08-06 01:03:54,599][52820] Sum rewards: 59.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.242', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '52.000'} [2024-08-06 01:03:54,797][52803] DAMAGECOUNT value on done: 156960.0 [2024-08-06 01:03:54,799][52803] Sum rewards: 58.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.250', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.094', 'weapon5': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:55,990][52658] DAMAGECOUNT value on done: 159994.0 [2024-08-06 01:03:55,992][52658] Sum rewards: 59.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '0.900', 'weapon3': '3.004', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '49.000'} [2024-08-06 01:03:56,345][52669] DAMAGECOUNT value on done: 165585.0 [2024-08-06 01:03:56,345][52669] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.196', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.548', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '56.000'} [2024-08-06 01:03:56,863][52666] DAMAGECOUNT value on done: 162396.0 [2024-08-06 01:03:56,863][52666] Sum rewards: 48.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.414', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.008', 'DAMAGECOUNT': '13.272', 'FRAGCOUNT': '42.000'} [2024-08-06 01:03:57,508][52811] DAMAGECOUNT value on done: 151300.0 [2024-08-06 01:03:57,510][52811] Sum rewards: 53.003, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.788', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.225', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '48.000'} [2024-08-06 01:03:57,609][52670] DAMAGECOUNT value on done: 161475.0 [2024-08-06 01:03:57,610][52670] Sum rewards: 51.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.504', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.170', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '44.000'} [2024-08-06 01:03:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 225189888. Throughput: 0: 4390.9. Samples: 56305880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:03:57,794][52567] Avg episode reward: [(0, '56.802')] [2024-08-06 01:03:57,839][52803] DAMAGECOUNT value on done: 148847.0 [2024-08-06 01:03:57,840][52803] Sum rewards: 64.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.273', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.141', 'weapon5': '0.226', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.500', 'weapon4': '0.514', 'WEAPON3': '0.850', 'weapon3': '2.608', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '54.000'} [2024-08-06 01:03:58,173][52650] Updated weights for policy 0, policy_version 27491 (0.0013) [2024-08-06 01:03:58,762][52658] DAMAGECOUNT value on done: 170830.0 [2024-08-06 01:03:58,764][52658] Sum rewards: 56.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.194', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '47.500'} [2024-08-06 01:03:59,255][52669] DAMAGECOUNT value on done: 166678.0 [2024-08-06 01:03:59,258][52669] Sum rewards: 55.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.388', 'WEAPON4': '0.400', 'weapon2': '0.730', 'WEAPON3': '1.250', 'weapon3': '2.604', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.000'} [2024-08-06 01:03:59,510][52666] DAMAGECOUNT value on done: 160202.0 [2024-08-06 01:03:59,514][52666] Sum rewards: 57.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon4': '0.270', 'weapon2': '0.296', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.158', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '50.000'} [2024-08-06 01:03:59,655][52649] DAMAGECOUNT value on done: 160835.0 [2024-08-06 01:03:59,656][52649] Sum rewards: 59.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.128', 'weapon5': '0.166', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.090', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '53.000'} [2024-08-06 01:04:00,132][52670] DAMAGECOUNT value on done: 166062.0 [2024-08-06 01:04:00,133][52670] Sum rewards: 48.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.288', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.230', 'DAMAGECOUNT': '12.228', 'FRAGCOUNT': '42.000'} [2024-08-06 01:04:00,563][52811] DAMAGECOUNT value on done: 156986.0 [2024-08-06 01:04:00,566][52811] Sum rewards: 58.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.869', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon5': '0.252', 'weapon2': '0.428', 'WEAPON4': '0.500', 'weapon4': '0.748', 'WEAPON3': '1.050', 'weapon3': '2.252', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '50.000'} [2024-08-06 01:04:01,615][52658] DAMAGECOUNT value on done: 171375.0 [2024-08-06 01:04:01,617][52658] Sum rewards: 50.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.588', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.156', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON3': '1.000', 'weapon3': '2.702', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '43.000'} [2024-08-06 01:04:02,066][52666] DAMAGECOUNT value on done: 158147.0 [2024-08-06 01:04:02,066][52666] Sum rewards: 50.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.134', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.048', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'AMMO4': '0.240', 'weapon4': '0.282', 'WEAPON4': '0.600', 'weapon2': '0.814', 'WEAPON3': '1.400', 'weapon3': '2.628', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '47.000'} [2024-08-06 01:04:02,158][52669] DAMAGECOUNT value on done: 166937.0 [2024-08-06 01:04:02,158][52669] Sum rewards: 62.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.905', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.126', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.450', 'weapon3': '2.916', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:02,553][52649] DAMAGECOUNT value on done: 156871.0 [2024-08-06 01:04:02,553][52649] Sum rewards: 62.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.442', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.156', 'weapon5': '0.186', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '2.996', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:02,608][52670] DAMAGECOUNT value on done: 161956.0 [2024-08-06 01:04:02,610][52670] Sum rewards: 46.044, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.035', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.362', 'weapon2': '0.536', 'WEAPON3': '1.500', 'HITCOUNT': '2.630', 'weapon3': '2.740', 'DAMAGECOUNT': '12.216', 'FRAGCOUNT': '44.000'} [2024-08-06 01:04:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17578.2). Total num frames: 225280000. Throughput: 0: 4398.2. Samples: 56319250. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:04:02,795][52567] Avg episode reward: [(0, '57.044')] [2024-08-06 01:04:03,206][52650] Updated weights for policy 0, policy_version 27501 (0.0011) [2024-08-06 01:04:03,704][52811] DAMAGECOUNT value on done: 152393.0 [2024-08-06 01:04:03,704][52811] Sum rewards: 55.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon2': '0.774', 'WEAPON3': '0.950', 'weapon3': '2.934', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:04,623][52658] DAMAGECOUNT value on done: 170740.0 [2024-08-06 01:04:04,623][52658] Sum rewards: 58.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.159', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.198', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.646', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:05,004][52669] DAMAGECOUNT value on done: 169586.0 [2024-08-06 01:04:05,006][52669] Sum rewards: 57.181, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.612', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.099', 'weapon4': '0.130', 'WEAPON4': '0.200', 'weapon2': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:05,016][52666] DAMAGECOUNT value on done: 162458.0 [2024-08-06 01:04:05,016][52666] Sum rewards: 67.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.448', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.088', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.308', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.292', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '55.000'} [2024-08-06 01:04:05,604][52649] DAMAGECOUNT value on done: 160999.0 [2024-08-06 01:04:05,607][52649] Sum rewards: 54.628, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.006', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.037', 'weapon5': '0.124', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon4': '0.384', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.866', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '51.000'} [2024-08-06 01:04:05,851][52670] DAMAGECOUNT value on done: 161993.0 [2024-08-06 01:04:05,854][52670] Sum rewards: 57.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.186', 'AMMO2': '0.033', 'weapon4': '0.096', 'AMMO3': '0.158', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'weapon2': '0.928', 'WEAPON3': '1.000', 'weapon3': '2.844', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:06,710][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:04:06,782][52811] DAMAGECOUNT value on done: 156931.0 [2024-08-06 01:04:06,786][52811] Sum rewards: 63.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.869', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.167', 'AMMO3': '0.192', 'weapon5': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:07,595][52658] DAMAGECOUNT value on done: 160656.0 [2024-08-06 01:04:07,595][52658] Sum rewards: 58.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.405', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.318', 'weapon4': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '50.000'} [2024-08-06 01:04:07,721][52650] Updated weights for policy 0, policy_version 27511 (0.0019) [2024-08-06 01:04:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 225370112. Throughput: 0: 4387.8. Samples: 56345440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:04:07,802][52567] Avg episode reward: [(0, '57.447')] [2024-08-06 01:04:08,220][52666] DAMAGECOUNT value on done: 163167.0 [2024-08-06 01:04:08,220][52666] Sum rewards: 50.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.814', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.182', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '43.000'} [2024-08-06 01:04:08,768][52649] DAMAGECOUNT value on done: 162151.0 [2024-08-06 01:04:08,769][52649] Sum rewards: 60.229, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.592', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.710', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:08,953][52670] DAMAGECOUNT value on done: 163367.0 [2024-08-06 01:04:08,955][52670] Sum rewards: 71.606, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.562', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.126', 'WEAPON4': '0.200', 'weapon2': '0.296', 'AMMO3': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.342', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '64.000'} [2024-08-06 01:04:09,605][52658] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2024-08-06 01:04:10,776][52658] DAMAGECOUNT value on done: 164880.0 [2024-08-06 01:04:10,777][52658] Sum rewards: 52.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.012', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.148', 'AMMO3': '0.165', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.552', 'weapon2': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.436', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:11,304][52666] DAMAGECOUNT value on done: 164511.0 [2024-08-06 01:04:11,308][52666] Sum rewards: 49.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.155', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon4': '0.396', 'WEAPON4': '0.500', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.542', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '44.000'} [2024-08-06 01:04:11,417][52671] DAMAGECOUNT value on done: 171392.0 [2024-08-06 01:04:11,418][52671] Sum rewards: 55.079, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.404', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.114', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '2.806', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:11,893][52649] DAMAGECOUNT value on done: 154121.0 [2024-08-06 01:04:11,896][52649] Sum rewards: 52.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.417', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.624', 'WEAPON3': '1.350', 'weapon3': '2.762', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:12,002][52670] DAMAGECOUNT value on done: 165745.0 [2024-08-06 01:04:12,003][52670] Sum rewards: 66.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.500', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO3': '0.169', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '3.208', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '53.000'} [2024-08-06 01:04:12,529][52650] Updated weights for policy 0, policy_version 27521 (0.0012) [2024-08-06 01:04:12,795][52567] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17578.1). Total num frames: 225460224. Throughput: 0: 4391.9. Samples: 56371950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:04:12,795][52567] Avg episode reward: [(0, '57.709')] [2024-08-06 01:04:13,638][52658] DAMAGECOUNT value on done: 164868.0 [2024-08-06 01:04:13,642][52658] Sum rewards: 54.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.396', 'AMMO5': '0.007', 'AMMO2': '0.037', 'ARMOR': '0.040', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.164', 'AMMO4': '0.184', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'weapon2': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:14,414][52671] DAMAGECOUNT value on done: 163871.0 [2024-08-06 01:04:14,414][52671] Sum rewards: 52.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.532', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.126', 'weapon5': '0.128', 'AMMO4': '0.197', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.038', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '47.000'} [2024-08-06 01:04:14,423][52666] DAMAGECOUNT value on done: 163735.0 [2024-08-06 01:04:14,423][52666] Sum rewards: 59.068, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.196', 'AMMO4': '0.235', 'weapon4': '0.380', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '53.000'} [2024-08-06 01:04:14,956][52670] DAMAGECOUNT value on done: 157971.0 [2024-08-06 01:04:14,958][52670] Sum rewards: 54.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.765', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon4': '0.142', 'AMMO4': '0.203', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.702', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '2.978', 'DAMAGECOUNT': '13.404', 'FRAGCOUNT': '50.000'} [2024-08-06 01:04:15,172][52649] DAMAGECOUNT value on done: 159855.0 [2024-08-06 01:04:15,173][52649] Sum rewards: 56.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.144', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.199', 'weapon5': '0.214', 'weapon4': '0.234', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '2.934', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:16,802][52658] DAMAGECOUNT value on done: 163411.0 [2024-08-06 01:04:16,803][52658] Sum rewards: 52.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.008', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.102', 'AMMO3': '0.178', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.486', 'weapon2': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:17,065][52666] DAMAGECOUNT value on done: 161032.0 [2024-08-06 01:04:17,068][52666] Sum rewards: 61.390, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.244', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.370', 'WEAPON3': '1.600', 'weapon3': '2.974', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:17,247][52650] Updated weights for policy 0, policy_version 27531 (0.0012) [2024-08-06 01:04:17,624][52670] DAMAGECOUNT value on done: 163730.0 [2024-08-06 01:04:17,626][52670] Sum rewards: 49.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.372', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.096', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.254', 'WEAPON4': '0.400', 'weapon4': '0.418', 'weapon2': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.808', 'DAMAGECOUNT': '12.246', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:17,742][52671] DAMAGECOUNT value on done: 169562.0 [2024-08-06 01:04:17,743][52671] Sum rewards: 58.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.046', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '51.000'} [2024-08-06 01:04:17,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 225542144. Throughput: 0: 4392.9. Samples: 56385190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:04:17,795][52567] Avg episode reward: [(0, '57.726')] [2024-08-06 01:04:18,006][52649] DAMAGECOUNT value on done: 157430.0 [2024-08-06 01:04:18,008][52649] Sum rewards: 53.827, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.715', 'AMMO5': '0.015', 'AMMO2': '0.069', 'weapon5': '0.124', 'AMMO3': '0.222', 'AMMO4': '0.347', 'WEAPON5': '0.350', 'weapon4': '0.360', 'weapon2': '0.398', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:19,614][52666] DAMAGECOUNT value on done: 157900.0 [2024-08-06 01:04:19,614][52666] Sum rewards: 50.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.185', 'AMMO3': '0.190', 'weapon4': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '43.000'} [2024-08-06 01:04:19,963][52658] DAMAGECOUNT value on done: 168705.0 [2024-08-06 01:04:19,963][52658] Sum rewards: 72.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.248', 'ARMOR': '0.004', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.456', 'weapon4': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '60.000'} [2024-08-06 01:04:20,187][52670] DAMAGECOUNT value on done: 158255.0 [2024-08-06 01:04:20,190][52670] Sum rewards: 54.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.657', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.084', 'AMMO3': '0.162', 'AMMO4': '0.169', 'weapon4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '3.102', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '46.000'} [2024-08-06 01:04:20,657][52671] DAMAGECOUNT value on done: 163460.0 [2024-08-06 01:04:20,658][52671] Sum rewards: 56.826, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.012', 'HEALTH': '0.025', 'AMMO4': '0.062', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'weapon2': '0.624', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '3.166', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '46.000'} [2024-08-06 01:04:21,130][52649] DAMAGECOUNT value on done: 165403.0 [2024-08-06 01:04:21,131][52649] Sum rewards: 64.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.556', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.146', 'AMMO4': '0.319', 'weapon5': '0.328', 'weapon2': '0.388', 'weapon4': '0.488', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.456', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '52.500'} [2024-08-06 01:04:21,739][52650] Updated weights for policy 0, policy_version 27541 (0.0014) [2024-08-06 01:04:22,260][52663] DAMAGECOUNT value on done: 164524.0 [2024-08-06 01:04:22,261][52663] Sum rewards: 57.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.138', 'weapon5': '0.218', 'AMMO4': '0.221', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON4': '0.500', 'weapon4': '0.758', 'WEAPON3': '0.950', 'weapon3': '2.214', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:22,693][52666] DAMAGECOUNT value on done: 166977.0 [2024-08-06 01:04:22,693][52666] Sum rewards: 59.413, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.526', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.047', 'weapon5': '0.140', 'AMMO3': '0.166', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.394', 'weapon4': '0.542', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '51.000'} [2024-08-06 01:04:22,794][52567] Fps is (10 sec: 17204.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 225632256. Throughput: 0: 4395.3. Samples: 56411680. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:04:22,794][52567] Avg episode reward: [(0, '57.843')] [2024-08-06 01:04:22,861][52658] DAMAGECOUNT value on done: 169240.0 [2024-08-06 01:04:22,861][52658] Sum rewards: 60.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.803', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.132', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '50.000'} [2024-08-06 01:04:23,107][52670] DAMAGECOUNT value on done: 156166.0 [2024-08-06 01:04:23,107][52670] Sum rewards: 70.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.986', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.117', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '58.000'} [2024-08-06 01:04:23,735][52649] DAMAGECOUNT value on done: 159023.0 [2024-08-06 01:04:23,737][52649] Sum rewards: 55.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '47.000'} [2024-08-06 01:04:23,764][52671] DAMAGECOUNT value on done: 166518.0 [2024-08-06 01:04:23,764][52671] Sum rewards: 69.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.079', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon2': '0.380', 'weapon4': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '59.000'} [2024-08-06 01:04:24,353][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:04:24,891][52663] DAMAGECOUNT value on done: 164187.0 [2024-08-06 01:04:24,891][52663] Sum rewards: 57.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'weapon2': '0.376', 'weapon4': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:25,306][52666] DAMAGECOUNT value on done: 165898.0 [2024-08-06 01:04:25,309][52666] Sum rewards: 48.333, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.957', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.094', 'weapon5': '0.172', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.536', 'weapon4': '0.644', 'WEAPON3': '0.700', 'weapon3': '2.438', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '39.000'} [2024-08-06 01:04:25,773][52658] DAMAGECOUNT value on done: 161728.0 [2024-08-06 01:04:25,773][52658] Sum rewards: 57.278, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.472', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.070', 'weapon5': '0.192', 'weapon4': '0.226', 'AMMO3': '0.247', 'weapon2': '0.334', 'AMMO4': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.914', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:25,858][52670] DAMAGECOUNT value on done: 166797.0 [2024-08-06 01:04:25,859][52670] Sum rewards: 65.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.048', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '55.000'} [2024-08-06 01:04:26,452][52650] Updated weights for policy 0, policy_version 27551 (0.0034) [2024-08-06 01:04:26,614][52649] DAMAGECOUNT value on done: 161007.0 [2024-08-06 01:04:26,615][52649] Sum rewards: 59.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.243', 'weapon2': '0.540', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.190', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:27,000][52671] DAMAGECOUNT value on done: 166073.0 [2024-08-06 01:04:27,001][52671] Sum rewards: 54.705, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.025', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.057', 'weapon5': '0.152', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.284', 'weapon2': '0.294', 'WEAPON4': '0.450', 'weapon4': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.626', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 225714176. Throughput: 0: 4406.7. Samples: 56438200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:04:27,795][52567] Avg episode reward: [(0, '58.014')] [2024-08-06 01:04:27,873][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027554_225722368.pth... [2024-08-06 01:04:28,028][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027039_221503488.pth [2024-08-06 01:04:28,236][52666] DAMAGECOUNT value on done: 160920.0 [2024-08-06 01:04:28,236][52666] Sum rewards: 45.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.925', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.106', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.428', 'WEAPON3': '1.150', 'HITCOUNT': '2.590', 'weapon3': '3.030', 'DAMAGECOUNT': '11.301', 'FRAGCOUNT': '39.000'} [2024-08-06 01:04:28,282][52663] DAMAGECOUNT value on done: 162544.0 [2024-08-06 01:04:28,283][52663] Sum rewards: 42.449, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.919', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.044', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.280', 'weapon2': '0.430', 'WEAPON4': '0.650', 'weapon4': '0.746', 'WEAPON3': '1.600', 'weapon3': '2.502', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.018', 'FRAGCOUNT': '41.000'} [2024-08-06 01:04:28,474][52658] DAMAGECOUNT value on done: 162447.0 [2024-08-06 01:04:28,475][52658] Sum rewards: 52.873, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.234', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.456', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.108', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:28,955][52670] DAMAGECOUNT value on done: 164927.0 [2024-08-06 01:04:28,956][52670] Sum rewards: 65.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.500'} [2024-08-06 01:04:29,621][52671] DAMAGECOUNT value on done: 167927.0 [2024-08-06 01:04:29,621][52671] Sum rewards: 72.649, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.285', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon4': '0.024', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon2': '0.168', 'AMMO3': '0.243', 'WEAPON3': '1.550', 'HITCOUNT': '3.540', 'weapon3': '3.572', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '62.500'} [2024-08-06 01:04:29,833][52649] DAMAGECOUNT value on done: 162132.0 [2024-08-06 01:04:29,834][52649] Sum rewards: 67.020, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.104', 'weapon4': '0.160', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.294', 'weapon2': '0.424', 'WEAPON3': '1.650', 'weapon3': '3.100', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '59.500'} [2024-08-06 01:04:30,806][52663] DAMAGECOUNT value on done: 164634.0 [2024-08-06 01:04:30,806][52663] Sum rewards: 63.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.434', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO3': '0.195', 'AMMO4': '0.208', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:31,076][52650] Updated weights for policy 0, policy_version 27561 (0.0032) [2024-08-06 01:04:31,292][52658] DAMAGECOUNT value on done: 169242.0 [2024-08-06 01:04:31,292][52658] Sum rewards: 70.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.100', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon5': '0.278', 'weapon2': '0.346', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '55.000'} [2024-08-06 01:04:31,440][52666] DAMAGECOUNT value on done: 162356.0 [2024-08-06 01:04:31,442][52666] Sum rewards: 60.346, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.805', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.165', 'weapon4': '0.230', 'weapon2': '0.746', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:31,908][52670] DAMAGECOUNT value on done: 165959.0 [2024-08-06 01:04:31,910][52670] Sum rewards: 54.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.027', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.190', 'AMMO3': '0.209', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '2.932', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:32,456][52671] DAMAGECOUNT value on done: 166821.0 [2024-08-06 01:04:32,457][52671] Sum rewards: 57.240, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'HEALTH': '0.108', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.360', 'WEAPON3': '1.000', 'HITCOUNT': '2.950', 'weapon3': '3.146', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '46.000'} [2024-08-06 01:04:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 225804288. Throughput: 0: 4391.4. Samples: 56450860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:04:32,794][52567] Avg episode reward: [(0, '58.128')] [2024-08-06 01:04:32,815][52649] DAMAGECOUNT value on done: 157657.0 [2024-08-06 01:04:32,816][52649] Sum rewards: 58.389, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.455', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.107', 'WEAPON4': '0.300', 'weapon4': '0.546', 'weapon2': '0.572', 'WEAPON3': '0.700', 'weapon3': '2.714', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:33,493][52663] DAMAGECOUNT value on done: 161892.0 [2024-08-06 01:04:33,493][52663] Sum rewards: 54.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.862', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.199', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.782', 'WEAPON3': '1.300', 'weapon3': '2.586', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:33,876][52666] DAMAGECOUNT value on done: 161092.0 [2024-08-06 01:04:33,878][52666] Sum rewards: 57.040, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.714', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.250', 'weapon4': '0.346', 'AMMO3': '0.353', 'weapon2': '0.404', 'WEAPON3': '2.100', 'weapon3': '2.938', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 01:04:34,568][52670] DAMAGECOUNT value on done: 163668.0 [2024-08-06 01:04:34,568][52670] Sum rewards: 73.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.813', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.094', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '62.000'} [2024-08-06 01:04:35,226][52671] DAMAGECOUNT value on done: 165433.0 [2024-08-06 01:04:35,227][52671] Sum rewards: 58.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.424', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon4': '0.282', 'weapon2': '0.522', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.080', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:35,828][52649] DAMAGECOUNT value on done: 163296.0 [2024-08-06 01:04:35,836][52649] Sum rewards: 66.329, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.335', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.160', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.472', 'weapon2': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.390', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:35,997][52650] Updated weights for policy 0, policy_version 27571 (0.0018) [2024-08-06 01:04:36,125][52663] DAMAGECOUNT value on done: 171498.0 [2024-08-06 01:04:36,128][52663] Sum rewards: 53.741, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.062', 'HEALTH': '0.126', 'AMMO4': '0.135', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.688', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '42.000'} [2024-08-06 01:04:36,872][52666] DAMAGECOUNT value on done: 166388.0 [2024-08-06 01:04:36,872][52666] Sum rewards: 55.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.162', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '47.000'} [2024-08-06 01:04:37,464][52670] DAMAGECOUNT value on done: 168434.0 [2024-08-06 01:04:37,465][52670] Sum rewards: 43.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.764', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO3': '0.158', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'weapon4': '0.708', 'weapon2': '0.732', 'WEAPON3': '0.900', 'weapon3': '2.118', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '10.674', 'FRAGCOUNT': '36.000'} [2024-08-06 01:04:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 225894400. Throughput: 0: 4392.2. Samples: 56477100. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:04:37,794][52567] Avg episode reward: [(0, '58.188')] [2024-08-06 01:04:38,054][52671] DAMAGECOUNT value on done: 168473.0 [2024-08-06 01:04:38,057][52671] Sum rewards: 47.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.355', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.124', 'AMMO3': '0.223', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '2.986', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '41.000'} [2024-08-06 01:04:39,093][52649] DAMAGECOUNT value on done: 163334.0 [2024-08-06 01:04:39,093][52649] Sum rewards: 60.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.342', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.022', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.866', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '50.000'} [2024-08-06 01:04:39,227][52663] DAMAGECOUNT value on done: 164848.0 [2024-08-06 01:04:39,229][52663] Sum rewards: 55.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.390', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '47.000'} [2024-08-06 01:04:39,539][52666] DAMAGECOUNT value on done: 160260.0 [2024-08-06 01:04:39,540][52666] Sum rewards: 66.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.110', 'AMMO3': '0.183', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '57.000'} [2024-08-06 01:04:40,109][52670] DAMAGECOUNT value on done: 156506.0 [2024-08-06 01:04:40,113][52670] Sum rewards: 50.017, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.503', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon5': '0.130', 'AMMO3': '0.244', 'AMMO4': '0.297', 'weapon2': '0.318', 'weapon4': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '46.000'} [2024-08-06 01:04:40,371][52650] Updated weights for policy 0, policy_version 27581 (0.0017) [2024-08-06 01:04:40,465][52671] DAMAGECOUNT value on done: 167253.0 [2024-08-06 01:04:40,465][52671] Sum rewards: 53.759, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.014', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.182', 'AMMO3': '0.190', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '46.000'} [2024-08-06 01:04:41,055][52659] DAMAGECOUNT value on done: 166281.0 [2024-08-06 01:04:41,057][52659] Sum rewards: 52.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.258', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.044', 'AMMO4': '0.185', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.380', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:42,028][52663] DAMAGECOUNT value on done: 165423.0 [2024-08-06 01:04:42,029][52663] Sum rewards: 69.059, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.150', 'HEALTH': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.374', 'WEAPON3': '0.900', 'weapon3': '3.074', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '56.000'} [2024-08-06 01:04:42,102][52649] DAMAGECOUNT value on done: 155749.0 [2024-08-06 01:04:42,102][52649] Sum rewards: 57.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.279', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.204', 'AMMO3': '0.207', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:42,607][52666] DAMAGECOUNT value on done: 162700.0 [2024-08-06 01:04:42,608][52666] Sum rewards: 47.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO5': '0.009', 'ARMOR': '0.032', 'weapon5': '0.032', 'AMMO2': '0.039', 'AMMO3': '0.175', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.516', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.680', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.603', 'FRAGCOUNT': '42.000'} [2024-08-06 01:04:42,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 225984512. Throughput: 0: 4388.2. Samples: 56503350. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 01:04:42,795][52567] Avg episode reward: [(0, '57.868')] [2024-08-06 01:04:43,124][52671] DAMAGECOUNT value on done: 165638.0 [2024-08-06 01:04:43,127][52671] Sum rewards: 51.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.046', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.184', 'weapon5': '0.194', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.394', 'weapon4': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.798', 'FRAGCOUNT': '44.000'} [2024-08-06 01:04:43,152][52670] DAMAGECOUNT value on done: 164817.0 [2024-08-06 01:04:43,152][52670] Sum rewards: 45.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO2': '0.027', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.210', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.868', 'WEAPON3': '1.300', 'weapon3': '2.310', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.693', 'FRAGCOUNT': '41.000'} [2024-08-06 01:04:43,803][52659] DAMAGECOUNT value on done: 166472.0 [2024-08-06 01:04:43,803][52659] Sum rewards: 64.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.738', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO4': '0.139', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.318', 'weapon2': '0.428', 'WEAPON3': '0.950', 'weapon3': '3.024', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:44,586][52649] DAMAGECOUNT value on done: 162935.0 [2024-08-06 01:04:44,586][52649] Sum rewards: 62.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.094', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 01:04:44,988][52663] DAMAGECOUNT value on done: 165359.0 [2024-08-06 01:04:44,989][52663] Sum rewards: 60.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.166', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.186', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.020', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '50.000'} [2024-08-06 01:04:45,230][52650] Updated weights for policy 0, policy_version 27591 (0.0024) [2024-08-06 01:04:45,986][52671] DAMAGECOUNT value on done: 173829.0 [2024-08-06 01:04:45,987][52671] Sum rewards: 58.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.914', 'AMMO5': '0.007', 'ARMOR': '0.024', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:46,080][52670] DAMAGECOUNT value on done: 167236.0 [2024-08-06 01:04:46,080][52670] Sum rewards: 63.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.705', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.080', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.338', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '50.000'} [2024-08-06 01:04:46,775][52659] DAMAGECOUNT value on done: 166214.0 [2024-08-06 01:04:46,788][52659] Sum rewards: 47.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.974', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon4': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.088', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '41.000'} [2024-08-06 01:04:47,102][52665] DAMAGECOUNT value on done: 162919.0 [2024-08-06 01:04:47,103][52665] Sum rewards: 54.755, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.274', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.086', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'weapon4': '0.346', 'weapon2': '0.558', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '48.500'} [2024-08-06 01:04:47,682][52649] DAMAGECOUNT value on done: 159655.0 [2024-08-06 01:04:47,683][52649] Sum rewards: 61.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'AMMO2': '0.027', 'ARMOR': '0.034', 'AMMO4': '0.133', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:47,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 226058240. Throughput: 0: 4384.9. Samples: 56516570. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 01:04:47,795][52567] Avg episode reward: [(0, '57.553')] [2024-08-06 01:04:48,022][52663] DAMAGECOUNT value on done: 168114.0 [2024-08-06 01:04:48,024][52663] Sum rewards: 53.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.825', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.229', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '46.000'} [2024-08-06 01:04:48,676][52671] DAMAGECOUNT value on done: 165876.0 [2024-08-06 01:04:48,678][52671] Sum rewards: 62.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.294', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon2': '0.142', 'AMMO3': '0.204', 'weapon4': '0.436', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.200', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '53.000'} [2024-08-06 01:04:48,862][52670] DAMAGECOUNT value on done: 164702.0 [2024-08-06 01:04:48,863][52670] Sum rewards: 59.252, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.162', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '2.682', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:49,518][52659] DAMAGECOUNT value on done: 167005.0 [2024-08-06 01:04:49,521][52659] Sum rewards: 63.014, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.180', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.102', 'weapon5': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.301', 'weapon2': '0.458', 'WEAPON3': '1.750', 'weapon3': '3.030', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '58.000'} [2024-08-06 01:04:49,813][52650] Updated weights for policy 0, policy_version 27601 (0.0022) [2024-08-06 01:04:50,263][52665] DAMAGECOUNT value on done: 167759.0 [2024-08-06 01:04:50,264][52665] Sum rewards: 40.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.812', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.178', 'AMMO4': '0.210', 'AMMO3': '0.212', 'weapon4': '0.380', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.678', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '37.500'} [2024-08-06 01:04:50,793][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:04:51,082][52649] DAMAGECOUNT value on done: 166263.0 [2024-08-06 01:04:51,082][52649] Sum rewards: 64.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.696', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.088', 'AMMO4': '0.131', 'weapon5': '0.176', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.122', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '53.000'} [2024-08-06 01:04:51,139][52663] DAMAGECOUNT value on done: 166978.0 [2024-08-06 01:04:51,139][52663] Sum rewards: 60.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.752', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.140', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.682', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '51.000'} [2024-08-06 01:04:51,702][52671] DAMAGECOUNT value on done: 161809.0 [2024-08-06 01:04:51,704][52671] Sum rewards: 63.370, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.749', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.110', 'AMMO4': '0.121', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:52,037][52670] DAMAGECOUNT value on done: 164198.0 [2024-08-06 01:04:52,039][52670] Sum rewards: 55.171, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '47.000'} [2024-08-06 01:04:52,521][52647] DAMAGECOUNT value on done: 176096.0 [2024-08-06 01:04:52,522][52647] Sum rewards: 64.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.671', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon4': '0.092', 'weapon5': '0.130', 'AMMO4': '0.189', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '55.000'} [2024-08-06 01:04:52,604][52659] DAMAGECOUNT value on done: 164801.0 [2024-08-06 01:04:52,605][52659] Sum rewards: 61.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.298', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '53.000'} [2024-08-06 01:04:52,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 226156544. Throughput: 0: 4386.2. Samples: 56542820. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 01:04:52,794][52567] Avg episode reward: [(0, '57.805')] [2024-08-06 01:04:53,491][52665] DAMAGECOUNT value on done: 163122.0 [2024-08-06 01:04:53,495][52665] Sum rewards: 51.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.100', 'AMMO3': '0.181', 'weapon5': '0.200', 'AMMO4': '0.222', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.700', 'WEAPON3': '1.050', 'HITCOUNT': '2.660', 'weapon3': '2.758', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:53,795][52663] DAMAGECOUNT value on done: 165042.0 [2024-08-06 01:04:53,798][52663] Sum rewards: 56.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.430', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '48.000'} [2024-08-06 01:04:54,248][52649] DAMAGECOUNT value on done: 164652.0 [2024-08-06 01:04:54,248][52649] Sum rewards: 63.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.159', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.124', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.232', 'weapon4': '0.392', 'WEAPON4': '0.500', 'weapon2': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.460', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '54.000'} [2024-08-06 01:04:54,349][52650] Updated weights for policy 0, policy_version 27611 (0.0037) [2024-08-06 01:04:54,372][52669] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:04:54,475][52668] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:04:54,804][52671] DAMAGECOUNT value on done: 170218.0 [2024-08-06 01:04:54,806][52671] Sum rewards: 62.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'weapon4': '0.126', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:55,341][52647] DAMAGECOUNT value on done: 173556.0 [2024-08-06 01:04:55,342][52647] Sum rewards: 61.774, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.442', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO3': '0.157', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon4': '0.380', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '0.900', 'weapon3': '2.772', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '49.000'} [2024-08-06 01:04:55,451][52659] DAMAGECOUNT value on done: 164134.0 [2024-08-06 01:04:55,453][52659] Sum rewards: 49.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.090', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.210', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.500', 'weapon2': '0.578', 'WEAPON3': '1.500', 'weapon3': '2.652', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '44.000'} [2024-08-06 01:04:56,712][52663] DAMAGECOUNT value on done: 159979.0 [2024-08-06 01:04:56,715][52663] Sum rewards: 62.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '52.000'} [2024-08-06 01:04:56,741][52665] DAMAGECOUNT value on done: 158831.0 [2024-08-06 01:04:56,742][52665] Sum rewards: 52.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.884', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.102', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.120', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:57,543][52649] DAMAGECOUNT value on done: 168046.0 [2024-08-06 01:04:57,543][52649] Sum rewards: 67.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.398', 'ARMOR': '0.005', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.111', 'weapon4': '0.154', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '55.000'} [2024-08-06 01:04:57,594][52671] DAMAGECOUNT value on done: 169004.0 [2024-08-06 01:04:57,595][52671] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.394', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.018', 'AMMO4': '0.077', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '61.000'} [2024-08-06 01:04:57,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 226246656. Throughput: 0: 4383.2. Samples: 56569190. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 01:04:57,794][52567] Avg episode reward: [(0, '58.136')] [2024-08-06 01:04:58,219][52659] DAMAGECOUNT value on done: 166217.0 [2024-08-06 01:04:58,221][52659] Sum rewards: 60.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.628', 'AMMO5': '0.003', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'AMMO3': '0.167', 'AMMO4': '0.258', 'WEAPON4': '0.500', 'weapon2': '0.538', 'weapon4': '0.758', 'WEAPON3': '1.000', 'weapon3': '2.414', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '49.500'} [2024-08-06 01:04:58,269][52647] DAMAGECOUNT value on done: 175830.0 [2024-08-06 01:04:58,270][52647] Sum rewards: 50.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO4': '0.166', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.642', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '42.000'} [2024-08-06 01:04:59,180][52650] Updated weights for policy 0, policy_version 27621 (0.0023) [2024-08-06 01:04:59,858][52665] DAMAGECOUNT value on done: 160700.0 [2024-08-06 01:04:59,859][52665] Sum rewards: 49.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.306', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.230', 'AMMO3': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.952', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '45.000'} [2024-08-06 01:04:59,889][52663] DAMAGECOUNT value on done: 159171.0 [2024-08-06 01:04:59,891][52663] Sum rewards: 39.307, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.480', 'AMMO5': '0.009', 'weapon5': '0.052', 'AMMO2': '0.060', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'AMMO4': '0.299', 'weapon4': '0.404', 'weapon2': '0.542', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.698', 'DAMAGECOUNT': '11.289', 'FRAGCOUNT': '38.000'} [2024-08-06 01:05:00,172][52671] DAMAGECOUNT value on done: 168863.0 [2024-08-06 01:05:00,172][52671] Sum rewards: 58.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.142', 'AMMO3': '0.199', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.646', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '49.000'} [2024-08-06 01:05:00,695][52659] DAMAGECOUNT value on done: 161205.0 [2024-08-06 01:05:00,696][52659] Sum rewards: 57.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '49.000'} [2024-08-06 01:05:01,031][52647] DAMAGECOUNT value on done: 177483.0 [2024-08-06 01:05:01,031][52647] Sum rewards: 56.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.245', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO4': '0.183', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.698', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '49.000'} [2024-08-06 01:05:02,485][52665] DAMAGECOUNT value on done: 163535.0 [2024-08-06 01:05:02,494][52665] Sum rewards: 63.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.422', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.220', 'weapon2': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.612', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '54.000'} [2024-08-06 01:05:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 226336768. Throughput: 0: 4387.6. Samples: 56582630. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:05:02,794][52567] Avg episode reward: [(0, '57.831')] [2024-08-06 01:05:02,862][52671] DAMAGECOUNT value on done: 168436.0 [2024-08-06 01:05:02,862][52671] Sum rewards: 55.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.045', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.160', 'AMMO3': '0.177', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.330', 'weapon2': '0.766', 'WEAPON3': '1.050', 'weapon3': '2.512', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '44.000'} [2024-08-06 01:05:03,115][52663] DAMAGECOUNT value on done: 167560.0 [2024-08-06 01:05:03,117][52663] Sum rewards: 49.133, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.390', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.255', 'weapon4': '0.292', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.068', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '47.000'} [2024-08-06 01:05:03,628][52659] DAMAGECOUNT value on done: 167424.0 [2024-08-06 01:05:03,632][52659] Sum rewards: 59.936, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO2': '0.034', 'AMMO3': '0.146', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.316', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.344', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '48.000'} [2024-08-06 01:05:03,638][52650] Updated weights for policy 0, policy_version 27631 (0.0016) [2024-08-06 01:05:04,163][52647] DAMAGECOUNT value on done: 176486.0 [2024-08-06 01:05:04,163][52647] Sum rewards: 45.334, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.835', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.098', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'AMMO4': '0.272', 'weapon4': '0.306', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '42.000'} [2024-08-06 01:05:04,700][52665] DAMAGECOUNT value on done: 163221.0 [2024-08-06 01:05:04,702][52665] Sum rewards: 56.476, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.674', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'weapon4': '0.278', 'weapon5': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '45.500'} [2024-08-06 01:05:05,873][52671] DAMAGECOUNT value on done: 167236.0 [2024-08-06 01:05:05,873][52671] Sum rewards: 62.323, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.768', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.106', 'AMMO4': '0.116', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.250', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '56.000'} [2024-08-06 01:05:06,273][52663] DAMAGECOUNT value on done: 167167.0 [2024-08-06 01:05:06,275][52663] Sum rewards: 49.927, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.941', 'ARMOR': '0.004', 'AMMO5': '0.024', 'weapon5': '0.048', 'AMMO2': '0.068', 'AMMO3': '0.233', 'AMMO4': '0.340', 'WEAPON5': '0.400', 'weapon4': '0.434', 'weapon2': '0.666', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.496', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '46.000'} [2024-08-06 01:05:06,724][52659] DAMAGECOUNT value on done: 168701.0 [2024-08-06 01:05:06,724][52659] Sum rewards: 46.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.958', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.162', 'AMMO3': '0.198', 'AMMO4': '0.198', 'weapon5': '0.266', 'weapon2': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '2.558', 'DAMAGECOUNT': '11.595', 'FRAGCOUNT': '41.000'} [2024-08-06 01:05:06,927][52647] DAMAGECOUNT value on done: 178165.0 [2024-08-06 01:05:06,927][52647] Sum rewards: 62.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.562', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.266', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '50.000'} [2024-08-06 01:05:07,789][52665] DAMAGECOUNT value on done: 166527.0 [2024-08-06 01:05:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 226418688. Throughput: 0: 4374.9. Samples: 56608550. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:05:07,797][52567] Avg episode reward: [(0, '57.713')] [2024-08-06 01:05:07,797][52665] Sum rewards: 63.525, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.018', 'AMMO5': '0.007', 'AMMO2': '0.042', 'AMMO3': '0.147', 'weapon5': '0.174', 'AMMO4': '0.211', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.660', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:08,480][52650] Updated weights for policy 0, policy_version 27641 (0.0025) [2024-08-06 01:05:09,405][52663] DAMAGECOUNT value on done: 168701.0 [2024-08-06 01:05:09,406][52663] Sum rewards: 56.651, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.203', 'weapon2': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '47.000'} [2024-08-06 01:05:09,651][52659] DAMAGECOUNT value on done: 163336.0 [2024-08-06 01:05:09,652][52659] Sum rewards: 54.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.794', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.128', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.268', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.026', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '46.000'} [2024-08-06 01:05:09,658][52647] DAMAGECOUNT value on done: 173432.0 [2024-08-06 01:05:09,659][52647] Sum rewards: 52.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.378', 'AMMO5': '0.014', 'weapon7': '0.018', 'AMMO2': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.158', 'AMMO4': '0.202', 'AMMO3': '0.239', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON3': '1.400', 'weapon3': '2.750', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '46.000'} [2024-08-06 01:05:10,098][52664] DAMAGECOUNT value on done: 172535.0 [2024-08-06 01:05:10,099][52664] Sum rewards: 63.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.834', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2024-08-06 01:05:10,386][52665] DAMAGECOUNT value on done: 168973.0 [2024-08-06 01:05:10,387][52665] Sum rewards: 61.438, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.832', 'AMMO2': '0.016', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.252', 'weapon2': '0.388', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.320', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '55.000'} [2024-08-06 01:05:12,537][52647] DAMAGECOUNT value on done: 175225.0 [2024-08-06 01:05:12,537][52647] Sum rewards: 52.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.634', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.270', 'weapon2': '0.478', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '2.956', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '45.000'} [2024-08-06 01:05:12,547][52663] DAMAGECOUNT value on done: 168127.0 [2024-08-06 01:05:12,547][52663] Sum rewards: 63.095, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.430', 'weapon2': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.670', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:12,629][52659] DAMAGECOUNT value on done: 161125.0 [2024-08-06 01:05:12,629][52659] Sum rewards: 65.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.048', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.564', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '55.000'} [2024-08-06 01:05:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 226508800. Throughput: 0: 4375.3. Samples: 56635090. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:05:12,794][52567] Avg episode reward: [(0, '57.932')] [2024-08-06 01:05:12,809][52795] DAMAGECOUNT value on done: 152604.0 [2024-08-06 01:05:12,809][52795] Sum rewards: 52.006, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.377', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.086', 'AMMO3': '0.128', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '0.800', 'weapon4': '0.800', 'weapon3': '2.522', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.952', 'FRAGCOUNT': '42.000'} [2024-08-06 01:05:12,855][52664] DAMAGECOUNT value on done: 172675.0 [2024-08-06 01:05:12,857][52664] Sum rewards: 52.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.177', 'weapon4': '0.192', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.634', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '45.000'} [2024-08-06 01:05:13,505][52650] Updated weights for policy 0, policy_version 27651 (0.0037) [2024-08-06 01:05:13,572][52665] DAMAGECOUNT value on done: 164915.0 [2024-08-06 01:05:13,572][52665] Sum rewards: 57.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.292', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.096', 'weapon4': '0.134', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '2.988', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:14,952][52647] DAMAGECOUNT value on done: 177099.0 [2024-08-06 01:05:14,953][52647] Sum rewards: 52.999, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.168', 'AMMO3': '0.214', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '47.000'} [2024-08-06 01:05:15,418][52664] DAMAGECOUNT value on done: 174193.0 [2024-08-06 01:05:15,419][52664] Sum rewards: 57.146, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.092', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '50.500'} [2024-08-06 01:05:15,602][52659] DAMAGECOUNT value on done: 159222.0 [2024-08-06 01:05:15,602][52659] Sum rewards: 46.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.165', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon7': '0.056', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.142', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.380', 'weapon2': '0.582', 'WEAPON3': '0.800', 'HITCOUNT': '2.490', 'weapon3': '2.642', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '37.500'} [2024-08-06 01:05:15,714][52663] DAMAGECOUNT value on done: 166823.0 [2024-08-06 01:05:15,714][52663] Sum rewards: 59.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.276', 'AMMO5': '0.005', 'weapon4': '0.010', 'weapon5': '0.020', 'AMMO2': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.186', 'weapon2': '0.772', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '48.000'} [2024-08-06 01:05:16,023][52795] DAMAGECOUNT value on done: 149139.0 [2024-08-06 01:05:16,024][52795] Sum rewards: 63.552, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.280', 'ARMOR': '0.008', 'AMMO2': '0.042', 'AMMO4': '0.210', 'AMMO3': '0.262', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 01:05:16,234][52665] DAMAGECOUNT value on done: 167171.0 [2024-08-06 01:05:16,236][52665] Sum rewards: 55.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.002', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.109', 'AMMO3': '0.177', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '46.000'} [2024-08-06 01:05:17,735][52650] Updated weights for policy 0, policy_version 27661 (0.0010) [2024-08-06 01:05:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 226598912. Throughput: 0: 4386.2. Samples: 56648240. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:05:17,802][52567] Avg episode reward: [(0, '57.456')] [2024-08-06 01:05:17,813][52647] DAMAGECOUNT value on done: 172278.0 [2024-08-06 01:05:17,814][52647] Sum rewards: 62.927, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'weapon4': '0.064', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:18,381][52659] DAMAGECOUNT value on done: 165884.0 [2024-08-06 01:05:18,385][52664] DAMAGECOUNT value on done: 171162.0 [2024-08-06 01:05:18,385][52659] Sum rewards: 49.904, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.208', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '2.828', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '43.500'} [2024-08-06 01:05:18,389][52664] Sum rewards: 63.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '53.500'} [2024-08-06 01:05:18,868][52663] DAMAGECOUNT value on done: 163085.0 [2024-08-06 01:05:18,869][52663] Sum rewards: 58.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.102', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'AMMO3': '0.181', 'weapon2': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.126', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '49.000'} [2024-08-06 01:05:19,290][52795] DAMAGECOUNT value on done: 152135.0 [2024-08-06 01:05:19,290][52795] Sum rewards: 53.901, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.347', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.162', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'weapon2': '0.332', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '2.770', 'weapon3': '2.864', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '43.500'} [2024-08-06 01:05:19,410][52665] DAMAGECOUNT value on done: 167382.0 [2024-08-06 01:05:19,413][52665] Sum rewards: 58.177, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.193', 'weapon4': '0.284', 'WEAPON4': '0.450', 'weapon2': '0.706', 'WEAPON3': '0.950', 'weapon3': '2.736', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '49.000'} [2024-08-06 01:05:20,936][52647] DAMAGECOUNT value on done: 173784.0 [2024-08-06 01:05:20,937][52647] Sum rewards: 63.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.180', 'AMMO3': '0.182', 'weapon4': '0.366', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '52.000'} [2024-08-06 01:05:21,390][52659] DAMAGECOUNT value on done: 165856.0 [2024-08-06 01:05:21,390][52659] Sum rewards: 52.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.150', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO3': '0.156', 'AMMO4': '0.178', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.654', 'WEAPON3': '0.900', 'HITCOUNT': '2.690', 'weapon3': '2.734', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '44.000'} [2024-08-06 01:05:21,599][52664] DAMAGECOUNT value on done: 172707.0 [2024-08-06 01:05:21,601][52664] Sum rewards: 69.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.508', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.244', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '3.444', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '59.000'} [2024-08-06 01:05:22,349][52665] DAMAGECOUNT value on done: 164573.0 [2024-08-06 01:05:22,350][52665] Sum rewards: 65.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.643', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon4': '0.088', 'weapon5': '0.152', 'AMMO3': '0.188', 'AMMO4': '0.291', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.152', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '55.000'} [2024-08-06 01:05:22,464][52795] DAMAGECOUNT value on done: 153104.0 [2024-08-06 01:05:22,464][52795] Sum rewards: 57.790, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.594', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.294', 'weapon2': '0.346', 'WEAPON3': '1.650', 'weapon3': '3.076', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '52.000'} [2024-08-06 01:05:22,567][52650] Updated weights for policy 0, policy_version 27671 (0.0020) [2024-08-06 01:05:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 226680832. Throughput: 0: 4386.7. Samples: 56674500. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:05:22,802][52567] Avg episode reward: [(0, '57.552')] [2024-08-06 01:05:24,053][52647] DAMAGECOUNT value on done: 171127.0 [2024-08-06 01:05:24,054][52647] Sum rewards: 58.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.384', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.196', 'weapon4': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:24,298][52659] DAMAGECOUNT value on done: 169675.0 [2024-08-06 01:05:24,299][52659] Sum rewards: 57.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:24,659][52664] DAMAGECOUNT value on done: 175472.0 [2024-08-06 01:05:24,659][52664] Sum rewards: 53.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'ARMOR': '0.030', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.872', 'WEAPON3': '1.000', 'weapon3': '2.576', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '46.000'} [2024-08-06 01:05:24,991][52665] DAMAGECOUNT value on done: 164185.0 [2024-08-06 01:05:24,992][52665] Sum rewards: 59.396, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.228', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.068', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO4': '0.222', 'AMMO3': '0.242', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.288', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '52.500'} [2024-08-06 01:05:25,534][52795] DAMAGECOUNT value on done: 156915.0 [2024-08-06 01:05:25,534][52795] Sum rewards: 61.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.849', 'AMMO5': '0.008', 'AMMO2': '0.045', 'AMMO3': '0.166', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:26,704][52794] Large shaping reward 3.396 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.34500000000000003, 115.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:05:27,125][52647] DAMAGECOUNT value on done: 175604.0 [2024-08-06 01:05:27,126][52647] Sum rewards: 58.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.022', 'AMMO5': '0.007', 'AMMO2': '0.027', 'ARMOR': '0.036', 'weapon5': '0.050', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.562', 'WEAPON3': '1.550', 'weapon3': '2.816', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:27,156][52650] Updated weights for policy 0, policy_version 27681 (0.0022) [2024-08-06 01:05:27,518][52659] DAMAGECOUNT value on done: 169086.0 [2024-08-06 01:05:27,529][52659] Sum rewards: 61.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.114', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '50.000'} [2024-08-06 01:05:27,671][52664] DAMAGECOUNT value on done: 176613.0 [2024-08-06 01:05:27,671][52664] Sum rewards: 64.305, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '54.000'} [2024-08-06 01:05:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 226770944. Throughput: 0: 4390.7. Samples: 56700930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:05:27,794][52567] Avg episode reward: [(0, '57.418')] [2024-08-06 01:05:28,025][52665] DAMAGECOUNT value on done: 164407.0 [2024-08-06 01:05:28,027][52665] Sum rewards: 60.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.030', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon5': '0.182', 'AMMO3': '0.211', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.698', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:28,648][52795] DAMAGECOUNT value on done: 152826.0 [2024-08-06 01:05:28,648][52795] Sum rewards: 52.218, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'weapon4': '0.002', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.480', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.266', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '47.000'} [2024-08-06 01:05:29,755][52647] DAMAGECOUNT value on done: 173591.0 [2024-08-06 01:05:29,756][52647] Sum rewards: 62.005, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.500', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon2': '0.158', 'weapon4': '0.178', 'AMMO3': '0.315', 'WEAPON3': '1.900', 'weapon3': '3.366', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '56.000'} [2024-08-06 01:05:30,220][52659] DAMAGECOUNT value on done: 164761.0 [2024-08-06 01:05:30,221][52614] Signal inference workers to stop experience collection... (5100 times) [2024-08-06 01:05:30,232][52614] Signal inference workers to resume experience collection... (5100 times) [2024-08-06 01:05:30,221][52659] Sum rewards: 48.968, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.154', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.014', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.622', 'weapon2': '0.722', 'WEAPON3': '0.950', 'weapon3': '2.474', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '39.000'} [2024-08-06 01:05:30,302][52650] InferenceWorker_p0-w0: stopping experience collection (5100 times) [2024-08-06 01:05:30,303][52650] InferenceWorker_p0-w0: resuming experience collection (5100 times) [2024-08-06 01:05:30,516][52664] DAMAGECOUNT value on done: 167206.0 [2024-08-06 01:05:30,516][52664] Sum rewards: 62.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.693', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon5': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.350', 'weapon3': '2.560', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '52.000'} [2024-08-06 01:05:31,140][52665] DAMAGECOUNT value on done: 162253.0 [2024-08-06 01:05:31,140][52665] Sum rewards: 55.673, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.451', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.107', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon2': '0.290', 'WEAPON3': '0.900', 'HITCOUNT': '2.770', 'weapon3': '3.226', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '44.000'} [2024-08-06 01:05:31,694][52795] DAMAGECOUNT value on done: 157800.0 [2024-08-06 01:05:31,695][52795] Sum rewards: 64.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.016', 'AMMO4': '0.041', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '54.000'} [2024-08-06 01:05:32,007][52650] Updated weights for policy 0, policy_version 27691 (0.0023) [2024-08-06 01:05:32,338][52647] DAMAGECOUNT value on done: 174967.0 [2024-08-06 01:05:32,340][52647] Sum rewards: 66.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.104', 'weapon4': '0.208', 'AMMO3': '0.255', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '58.000'} [2024-08-06 01:05:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 226852864. Throughput: 0: 4388.2. Samples: 56714040. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:05:32,795][52567] Avg episode reward: [(0, '57.735')] [2024-08-06 01:05:32,962][52664] DAMAGECOUNT value on done: 182064.0 [2024-08-06 01:05:32,962][52664] Sum rewards: 62.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.215', 'weapon2': '0.322', 'weapon4': '0.394', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '53.000'} [2024-08-06 01:05:33,398][52659] DAMAGECOUNT value on done: 170405.0 [2024-08-06 01:05:33,398][52659] Sum rewards: 63.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.368', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.066', 'weapon4': '0.128', 'AMMO3': '0.183', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.264', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '54.000'} [2024-08-06 01:05:33,989][52665] DAMAGECOUNT value on done: 164490.0 [2024-08-06 01:05:33,989][52665] Sum rewards: 69.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.370', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.242', 'weapon4': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 01:05:34,764][52795] DAMAGECOUNT value on done: 155268.0 [2024-08-06 01:05:34,764][52795] Sum rewards: 56.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.088', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.172', 'AMMO3': '0.181', 'weapon4': '0.374', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.768', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '45.000'} [2024-08-06 01:05:34,845][52647] DAMAGECOUNT value on done: 174482.0 [2024-08-06 01:05:34,846][52647] Sum rewards: 50.414, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.088', 'weapon4': '0.136', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.164', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '46.500'} [2024-08-06 01:05:35,377][52664] DAMAGECOUNT value on done: 176862.0 [2024-08-06 01:05:35,379][52664] Sum rewards: 59.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.368', 'weapon4': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:36,224][52659] DAMAGECOUNT value on done: 169730.0 [2024-08-06 01:05:36,225][52659] Sum rewards: 62.791, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO4': '0.159', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.690', 'WEAPON3': '1.450', 'weapon3': '2.548', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '57.000'} [2024-08-06 01:05:36,344][52650] Updated weights for policy 0, policy_version 27701 (0.0041) [2024-08-06 01:05:36,499][52668] DAMAGECOUNT value on done: 165691.0 [2024-08-06 01:05:36,500][52668] Sum rewards: 58.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO2': '0.006', 'AMMO5': '0.012', 'AMMO4': '0.028', 'weapon5': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.282', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '49.000'} [2024-08-06 01:05:37,107][52665] DAMAGECOUNT value on done: 159895.0 [2024-08-06 01:05:37,107][52665] Sum rewards: 59.441, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.906', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.035', 'weapon5': '0.148', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'weapon2': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.750', 'weapon3': '2.898', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '54.000'} [2024-08-06 01:05:37,217][52647] DAMAGECOUNT value on done: 170655.0 [2024-08-06 01:05:37,217][52647] Sum rewards: 56.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.790', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.218', 'AMMO3': '0.228', 'weapon4': '0.242', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '49.000'} [2024-08-06 01:05:37,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 226942976. Throughput: 0: 4390.6. Samples: 56740400. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:05:37,802][52567] Avg episode reward: [(0, '58.135')] [2024-08-06 01:05:37,838][52795] DAMAGECOUNT value on done: 153215.0 [2024-08-06 01:05:37,839][52795] Sum rewards: 63.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.764', 'WEAPON3': '1.300', 'weapon3': '2.672', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '53.000'} [2024-08-06 01:05:38,000][52664] DAMAGECOUNT value on done: 176480.0 [2024-08-06 01:05:38,001][52664] Sum rewards: 59.249, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.550', 'ARMOR': '0.008', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.235', 'weapon4': '0.236', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '53.000'} [2024-08-06 01:05:39,332][52668] DAMAGECOUNT value on done: 173647.0 [2024-08-06 01:05:39,333][52668] Sum rewards: 47.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.082', 'AMMO3': '0.190', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.958', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '40.000'} [2024-08-06 01:05:40,069][52647] DAMAGECOUNT value on done: 173768.0 [2024-08-06 01:05:40,069][52647] Sum rewards: 57.844, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.875', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.056', 'weapon4': '0.108', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '52.000'} [2024-08-06 01:05:40,270][52665] DAMAGECOUNT value on done: 166375.0 [2024-08-06 01:05:40,272][52665] Sum rewards: 82.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.655', 'AMMO2': '0.000', 'AMMO4': '0.002', 'WEAPON4': '0.100', 'weapon2': '0.210', 'AMMO3': '0.244', 'weapon4': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '70.000'} [2024-08-06 01:05:40,553][52664] DAMAGECOUNT value on done: 171414.0 [2024-08-06 01:05:40,555][52664] Sum rewards: 53.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.428', 'weapon4': '0.692', 'WEAPON3': '1.250', 'weapon3': '2.536', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '48.000'} [2024-08-06 01:05:40,948][52795] DAMAGECOUNT value on done: 156052.0 [2024-08-06 01:05:40,949][52795] Sum rewards: 63.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:41,418][52650] Updated weights for policy 0, policy_version 27711 (0.0038) [2024-08-06 01:05:42,172][52668] DAMAGECOUNT value on done: 168465.0 [2024-08-06 01:05:42,173][52668] Sum rewards: 69.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.204', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '3.370', 'weapon3': '3.504', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '58.000'} [2024-08-06 01:05:42,486][52647] DAMAGECOUNT value on done: 169227.0 [2024-08-06 01:05:42,487][52647] Sum rewards: 58.790, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.605', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '52.000'} [2024-08-06 01:05:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 227033088. Throughput: 0: 4389.8. Samples: 56766730. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:05:42,802][52567] Avg episode reward: [(0, '58.437')] [2024-08-06 01:05:43,055][52664] DAMAGECOUNT value on done: 169691.0 [2024-08-06 01:05:43,055][52664] Sum rewards: 64.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.146', 'AMMO4': '0.166', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2024-08-06 01:05:43,195][52665] DAMAGECOUNT value on done: 162265.0 [2024-08-06 01:05:43,196][52665] Sum rewards: 65.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.274', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '56.000'} [2024-08-06 01:05:44,442][52795] DAMAGECOUNT value on done: 153275.0 [2024-08-06 01:05:44,444][52795] Sum rewards: 65.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon4': '0.172', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '55.000'} [2024-08-06 01:05:44,929][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:05:45,412][52647] DAMAGECOUNT value on done: 175637.0 [2024-08-06 01:05:45,417][52647] Sum rewards: 54.904, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.113', 'weapon4': '0.176', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.419', 'FRAGCOUNT': '50.000'} [2024-08-06 01:05:45,441][52668] DAMAGECOUNT value on done: 168368.0 [2024-08-06 01:05:45,443][52668] Sum rewards: 64.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.286', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '52.000'} [2024-08-06 01:05:45,785][52650] Updated weights for policy 0, policy_version 27721 (0.0038) [2024-08-06 01:05:46,217][52664] DAMAGECOUNT value on done: 173168.0 [2024-08-06 01:05:46,219][52664] Sum rewards: 69.526, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.004', 'ARMOR': '0.016', 'weapon4': '0.018', 'AMMO2': '0.018', 'weapon5': '0.042', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '58.000'} [2024-08-06 01:05:47,407][52662] DAMAGECOUNT value on done: 171326.0 [2024-08-06 01:05:47,409][52662] Sum rewards: 59.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.830', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.236', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '51.500'} [2024-08-06 01:05:47,706][52795] DAMAGECOUNT value on done: 152340.0 [2024-08-06 01:05:47,707][52795] Sum rewards: 48.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.936', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.288', 'weapon2': '0.344', 'WEAPON3': '1.150', 'HITCOUNT': '2.390', 'weapon3': '3.156', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '41.000'} [2024-08-06 01:05:47,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 227115008. Throughput: 0: 4354.4. Samples: 56778580. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:05:47,794][52567] Avg episode reward: [(0, '58.662')] [2024-08-06 01:05:48,788][52668] DAMAGECOUNT value on done: 165345.0 [2024-08-06 01:05:48,789][52668] Sum rewards: 56.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.027', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.161', 'weapon4': '0.174', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '49.500'} [2024-08-06 01:05:49,388][52664] DAMAGECOUNT value on done: 174698.0 [2024-08-06 01:05:49,388][52664] Sum rewards: 63.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.803', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO4': '0.171', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '53.000'} [2024-08-06 01:05:50,785][52795] DAMAGECOUNT value on done: 151985.0 [2024-08-06 01:05:50,785][52795] Sum rewards: 53.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.496', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.598', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '45.000'} [2024-08-06 01:05:51,029][52662] DAMAGECOUNT value on done: 174185.0 [2024-08-06 01:05:51,029][52662] Sum rewards: 60.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.217', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.364', 'weapon4': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '50.000'} [2024-08-06 01:05:51,215][52650] Updated weights for policy 0, policy_version 27731 (0.0015) [2024-08-06 01:05:52,225][52668] DAMAGECOUNT value on done: 165620.0 [2024-08-06 01:05:52,225][52668] Sum rewards: 63.105, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.396', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.035', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '51.000'} [2024-08-06 01:05:52,509][52664] DAMAGECOUNT value on done: 170962.0 [2024-08-06 01:05:52,510][52664] Sum rewards: 50.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.205', 'weapon4': '0.264', 'weapon2': '0.390', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.166', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '43.000'} [2024-08-06 01:05:52,587][52660] DAMAGECOUNT value on done: 166372.0 [2024-08-06 01:05:52,588][52660] Sum rewards: 68.423, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'weapon4': '0.088', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'HEALTH': '0.238', 'weapon2': '0.508', 'WEAPON3': '0.850', 'weapon3': '3.162', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '55.000'} [2024-08-06 01:05:52,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 227188736. Throughput: 0: 4299.8. Samples: 56802040. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:05:52,794][52567] Avg episode reward: [(0, '58.755')] [2024-08-06 01:05:54,130][52795] DAMAGECOUNT value on done: 154110.0 [2024-08-06 01:05:54,131][52795] Sum rewards: 59.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.402', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.112', 'AMMO3': '0.150', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.584', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '50.000'} [2024-08-06 01:05:54,306][52662] DAMAGECOUNT value on done: 173864.0 [2024-08-06 01:05:54,307][52662] Sum rewards: 55.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.485', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.158', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '47.000'} [2024-08-06 01:05:55,850][52668] DAMAGECOUNT value on done: 169027.0 [2024-08-06 01:05:55,852][52668] Sum rewards: 55.578, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.146', 'AMMO4': '0.227', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.324', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '50.000'} [2024-08-06 01:05:56,093][52664] DAMAGECOUNT value on done: 174816.0 [2024-08-06 01:05:56,093][52664] Sum rewards: 45.579, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.130', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.066', 'weapon5': '0.132', 'weapon4': '0.202', 'AMMO3': '0.321', 'AMMO4': '0.330', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON4': '0.600', 'WEAPON3': '1.850', 'HITCOUNT': '2.710', 'weapon3': '2.920', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '44.000'} [2024-08-06 01:05:56,157][52660] DAMAGECOUNT value on done: 165623.0 [2024-08-06 01:05:56,157][52660] Sum rewards: 49.922, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.148', 'AMMO3': '0.149', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.328', 'weapon4': '0.590', 'WEAPON3': '0.950', 'HITCOUNT': '2.470', 'weapon3': '2.776', 'DAMAGECOUNT': '12.177', 'FRAGCOUNT': '39.000'} [2024-08-06 01:05:56,543][52650] Updated weights for policy 0, policy_version 27741 (0.0011) [2024-08-06 01:05:57,278][52795] DAMAGECOUNT value on done: 151636.0 [2024-08-06 01:05:57,279][52795] Sum rewards: 56.765, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.000', 'AMMO5': '0.007', 'weapon5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.295', 'weapon2': '0.296', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.056', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '53.000'} [2024-08-06 01:05:57,794][52567] Fps is (10 sec: 15564.7, 60 sec: 17066.7, 300 sec: 17467.0). Total num frames: 227270656. Throughput: 0: 4231.8. Samples: 56825520. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:05:57,794][52567] Avg episode reward: [(0, '58.305')] [2024-08-06 01:05:57,908][52662] DAMAGECOUNT value on done: 164203.0 [2024-08-06 01:05:57,909][52662] Sum rewards: 52.709, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.024', 'ARMOR': '0.036', 'weapon5': '0.092', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.972', 'WEAPON3': '1.200', 'weapon3': '2.570', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '44.000'} [2024-08-06 01:05:59,193][52664] DAMAGECOUNT value on done: 175883.0 [2024-08-06 01:05:59,193][52664] Sum rewards: 63.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.586', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.312', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '53.000'} [2024-08-06 01:05:59,329][52668] DAMAGECOUNT value on done: 172127.0 [2024-08-06 01:05:59,330][52668] Sum rewards: 58.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.542', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon2': '0.464', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '50.000'} [2024-08-06 01:05:59,855][52660] DAMAGECOUNT value on done: 168072.0 [2024-08-06 01:05:59,855][52660] Sum rewards: 55.227, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.952', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.098', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon4': '0.378', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '2.742', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '50.000'} [2024-08-06 01:06:00,415][52795] DAMAGECOUNT value on done: 158616.0 [2024-08-06 01:06:00,415][52795] Sum rewards: 55.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.478', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.188', 'weapon5': '0.196', 'AMMO4': '0.207', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '46.500'} [2024-08-06 01:06:01,054][52662] DAMAGECOUNT value on done: 171802.0 [2024-08-06 01:06:01,064][52662] Sum rewards: 55.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.524', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:01,630][52650] Updated weights for policy 0, policy_version 27751 (0.0012) [2024-08-06 01:06:02,126][52664] DAMAGECOUNT value on done: 170698.0 [2024-08-06 01:06:02,127][52664] Sum rewards: 68.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.165', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.098', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:02,351][52668] DAMAGECOUNT value on done: 166680.0 [2024-08-06 01:06:02,351][52668] Sum rewards: 48.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.861', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.136', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.702', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '41.000'} [2024-08-06 01:06:02,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 17494.8). Total num frames: 227360768. Throughput: 0: 4225.1. Samples: 56838370. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:06:02,795][52567] Avg episode reward: [(0, '58.577')] [2024-08-06 01:06:02,884][52660] DAMAGECOUNT value on done: 168439.0 [2024-08-06 01:06:02,885][52660] Sum rewards: 76.341, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.096', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.078', 'AMMO4': '0.081', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.256', 'WEAPON3': '1.100', 'weapon3': '3.332', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '61.000'} [2024-08-06 01:06:03,424][52662] DAMAGECOUNT value on done: 170040.0 [2024-08-06 01:06:03,426][52662] Sum rewards: 51.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.276', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.082', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.022', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:03,674][52795] DAMAGECOUNT value on done: 158727.0 [2024-08-06 01:06:03,676][52795] Sum rewards: 74.589, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.969', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon2': '0.436', 'weapon4': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.904', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2024-08-06 01:06:05,220][52668] DAMAGECOUNT value on done: 170597.0 [2024-08-06 01:06:05,222][52668] Sum rewards: 60.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.668', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:05,304][52664] DAMAGECOUNT value on done: 173028.0 [2024-08-06 01:06:05,305][52664] Sum rewards: 46.090, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.165', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.249', 'weapon4': '0.374', 'WEAPON4': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.550', 'weapon3': '2.804', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '44.000'} [2024-08-06 01:06:05,814][52660] DAMAGECOUNT value on done: 166909.0 [2024-08-06 01:06:05,816][52660] Sum rewards: 48.995, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.050', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.070', 'AMMO3': '0.269', 'AMMO4': '0.293', 'WEAPON5': '0.300', 'weapon4': '0.418', 'WEAPON4': '0.500', 'weapon2': '0.536', 'WEAPON3': '1.550', 'weapon3': '2.668', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:06,133][52662] DAMAGECOUNT value on done: 172245.0 [2024-08-06 01:06:06,141][52662] Sum rewards: 68.215, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.167', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.158', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '54.000'} [2024-08-06 01:06:06,180][52650] Updated weights for policy 0, policy_version 27761 (0.0013) [2024-08-06 01:06:06,330][52667] DAMAGECOUNT value on done: 168312.0 [2024-08-06 01:06:06,330][52667] Sum rewards: 47.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.154', 'AMMO3': '0.191', 'AMMO4': '0.253', 'WEAPON5': '0.400', 'weapon4': '0.416', 'weapon2': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.580', 'weapon3': '2.642', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '40.000'} [2024-08-06 01:06:06,961][52795] DAMAGECOUNT value on done: 150535.0 [2024-08-06 01:06:06,961][52795] Sum rewards: 62.764, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.064', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.032', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon4': '0.302', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '56.000'} [2024-08-06 01:06:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 17439.2). Total num frames: 227442688. Throughput: 0: 4223.5. Samples: 56864560. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:06:07,795][52567] Avg episode reward: [(0, '58.899')] [2024-08-06 01:06:07,822][52614] Saving new best policy, reward=58.899! [2024-08-06 01:06:08,335][52668] DAMAGECOUNT value on done: 168873.0 [2024-08-06 01:06:08,337][52668] Sum rewards: 52.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.205', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.044', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:08,747][52660] DAMAGECOUNT value on done: 164667.0 [2024-08-06 01:06:08,749][52660] Sum rewards: 60.727, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.727', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.056', 'weapon5': '0.104', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.278', 'weapon2': '0.476', 'weapon4': '0.506', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '50.000'} [2024-08-06 01:06:08,897][52667] DAMAGECOUNT value on done: 169566.0 [2024-08-06 01:06:08,898][52667] Sum rewards: 53.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.544', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.080', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.510', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.334', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '44.000'} [2024-08-06 01:06:08,978][52662] DAMAGECOUNT value on done: 176458.0 [2024-08-06 01:06:08,980][52662] Sum rewards: 52.904, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.678', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon4': '0.320', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:09,011][52794] DAMAGECOUNT value on done: 172803.0 [2024-08-06 01:06:09,013][52794] Sum rewards: 44.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.249', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.554', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '2.590', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '37.000'} [2024-08-06 01:06:10,071][52795] DAMAGECOUNT value on done: 158894.0 [2024-08-06 01:06:10,073][52795] Sum rewards: 63.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.675', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:10,678][52650] Updated weights for policy 0, policy_version 27771 (0.0012) [2024-08-06 01:06:10,851][52668] DAMAGECOUNT value on done: 165331.0 [2024-08-06 01:06:10,851][52668] Sum rewards: 65.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.717', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.173', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '58.000'} [2024-08-06 01:06:11,396][52660] DAMAGECOUNT value on done: 169064.0 [2024-08-06 01:06:11,398][52660] Sum rewards: 54.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.104', 'AMMO4': '0.112', 'weapon5': '0.142', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.068', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:11,743][52667] DAMAGECOUNT value on done: 168842.0 [2024-08-06 01:06:11,743][52667] Sum rewards: 47.996, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.230', 'weapon2': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '42.000'} [2024-08-06 01:06:11,820][52662] DAMAGECOUNT value on done: 169905.0 [2024-08-06 01:06:11,821][52662] Sum rewards: 49.085, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.575', 'ARMOR': '0.008', 'AMMO5': '0.009', 'weapon5': '0.062', 'AMMO2': '0.064', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.322', 'weapon4': '0.502', 'weapon2': '0.574', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.564', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '44.000'} [2024-08-06 01:06:11,838][52794] DAMAGECOUNT value on done: 175577.0 [2024-08-06 01:06:11,839][52794] Sum rewards: 61.716, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.290', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.166', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon4': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.718', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '49.000'} [2024-08-06 01:06:12,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16930.1, 300 sec: 17411.5). Total num frames: 227524608. Throughput: 0: 4215.1. Samples: 56890610. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 01:06:12,794][52567] Avg episode reward: [(0, '58.687')] [2024-08-06 01:06:13,191][52795] DAMAGECOUNT value on done: 158950.0 [2024-08-06 01:06:13,193][52795] Sum rewards: 66.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.359', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.077', 'weapon2': '0.218', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.502', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.000'} [2024-08-06 01:06:13,477][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:06:13,874][52668] DAMAGECOUNT value on done: 159111.0 [2024-08-06 01:06:13,874][52668] Sum rewards: 63.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.454', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.179', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.144', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:14,188][52660] DAMAGECOUNT value on done: 166932.0 [2024-08-06 01:06:14,189][52660] Sum rewards: 55.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.063', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.404', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '49.000'} [2024-08-06 01:06:14,881][52667] DAMAGECOUNT value on done: 165517.0 [2024-08-06 01:06:14,882][52667] Sum rewards: 54.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.210', 'AMMO4': '0.210', 'weapon2': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:14,987][52662] DAMAGECOUNT value on done: 177500.0 [2024-08-06 01:06:14,989][52662] Sum rewards: 61.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.156', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.520', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:15,016][52794] DAMAGECOUNT value on done: 168556.0 [2024-08-06 01:06:15,018][52794] Sum rewards: 56.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.075', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.228', 'weapon2': '0.566', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.138', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:15,870][52650] Updated weights for policy 0, policy_version 27781 (0.0013) [2024-08-06 01:06:16,487][52668] DAMAGECOUNT value on done: 166348.0 [2024-08-06 01:06:16,491][52668] Sum rewards: 64.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.187', 'AMMO4': '0.206', 'weapon5': '0.336', 'weapon4': '0.392', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.308', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '54.000'} [2024-08-06 01:06:16,987][52660] DAMAGECOUNT value on done: 168601.0 [2024-08-06 01:06:16,991][52660] Sum rewards: 63.316, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.191', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.688', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '56.000'} [2024-08-06 01:06:17,794][52567] Fps is (10 sec: 17203.8, 60 sec: 16930.2, 300 sec: 17439.2). Total num frames: 227614720. Throughput: 0: 4219.8. Samples: 56903930. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-06 01:06:17,794][52567] Avg episode reward: [(0, '58.975')] [2024-08-06 01:06:17,797][52614] Saving new best policy, reward=58.975! [2024-08-06 01:06:17,838][52662] DAMAGECOUNT value on done: 169380.0 [2024-08-06 01:06:17,840][52662] Sum rewards: 47.438, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.452', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.077', 'weapon5': '0.142', 'AMMO3': '0.201', 'weapon2': '0.364', 'AMMO4': '0.384', 'WEAPON5': '0.450', 'weapon4': '0.632', 'WEAPON4': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '44.000'} [2024-08-06 01:06:17,857][52794] DAMAGECOUNT value on done: 168178.0 [2024-08-06 01:06:17,857][52794] Sum rewards: 52.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.058', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon5': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.750', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:17,870][52667] DAMAGECOUNT value on done: 169526.0 [2024-08-06 01:06:17,870][52667] Sum rewards: 51.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'AMMO5': '0.015', 'ARMOR': '0.028', 'AMMO2': '0.071', 'AMMO3': '0.207', 'weapon4': '0.316', 'AMMO4': '0.357', 'weapon2': '0.362', 'weapon5': '0.368', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.678', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:19,691][52668] DAMAGECOUNT value on done: 163464.0 [2024-08-06 01:06:19,692][52668] Sum rewards: 55.588, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.530', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.208', 'AMMO3': '0.287', 'weapon2': '0.466', 'WEAPON3': '1.600', 'weapon3': '3.050', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '49.000'} [2024-08-06 01:06:20,036][52660] DAMAGECOUNT value on done: 165203.0 [2024-08-06 01:06:20,037][52660] Sum rewards: 37.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.834', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.214', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.688', 'WEAPON3': '1.300', 'HITCOUNT': '2.280', 'weapon3': '2.724', 'DAMAGECOUNT': '10.023', 'FRAGCOUNT': '35.000'} [2024-08-06 01:06:20,238][52650] Updated weights for policy 0, policy_version 27791 (0.0013) [2024-08-06 01:06:20,358][52820] DAMAGECOUNT value on done: 153512.0 [2024-08-06 01:06:20,359][52820] Sum rewards: 59.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.115', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.146', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.318', 'WEAPON3': '0.900', 'weapon3': '3.058', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:20,383][52662] DAMAGECOUNT value on done: 174065.0 [2024-08-06 01:06:20,383][52662] Sum rewards: 59.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.939', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '50.000'} [2024-08-06 01:06:20,402][52794] DAMAGECOUNT value on done: 171294.0 [2024-08-06 01:06:20,402][52794] Sum rewards: 45.672, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.286', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.176', 'AMMO3': '0.253', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '41.000'} [2024-08-06 01:06:20,652][52669] DAMAGECOUNT value on done: 171287.0 [2024-08-06 01:06:20,652][52669] Sum rewards: 63.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.654', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO4': '0.174', 'weapon4': '0.190', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:20,898][52667] DAMAGECOUNT value on done: 170887.0 [2024-08-06 01:06:20,900][52667] Sum rewards: 66.640, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.718', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.195', 'weapon4': '0.270', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '58.000'} [2024-08-06 01:06:22,650][52668] DAMAGECOUNT value on done: 168506.0 [2024-08-06 01:06:22,650][52668] Sum rewards: 57.030, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.426', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO4': '0.208', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.698', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:22,791][52803] DAMAGECOUNT value on done: 156850.0 [2024-08-06 01:06:22,792][52803] Sum rewards: 63.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.618', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.075', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.238', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:22,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17066.6, 300 sec: 17439.2). Total num frames: 227704832. Throughput: 0: 4212.2. Samples: 56929950. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-06 01:06:22,795][52567] Avg episode reward: [(0, '58.447')] [2024-08-06 01:06:23,085][52660] DAMAGECOUNT value on done: 171123.0 [2024-08-06 01:06:23,085][52660] Sum rewards: 52.138, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.960', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.129', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.500', 'weapon2': '0.508', 'weapon4': '0.758', 'WEAPON3': '0.900', 'weapon3': '2.428', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.179', 'FRAGCOUNT': '41.000'} [2024-08-06 01:06:23,326][52669] DAMAGECOUNT value on done: 168708.0 [2024-08-06 01:06:23,327][52669] Sum rewards: 60.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.429', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO4': '0.224', 'AMMO3': '0.248', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.500', 'weapon3': '2.658', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '50.500'} [2024-08-06 01:06:23,440][52662] DAMAGECOUNT value on done: 168974.0 [2024-08-06 01:06:23,448][52662] Sum rewards: 43.932, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.051', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.120', 'AMMO3': '0.223', 'AMMO4': '0.277', 'WEAPON5': '0.300', 'weapon4': '0.456', 'WEAPON4': '0.600', 'weapon2': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.458', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '39.000'} [2024-08-06 01:06:23,505][52794] DAMAGECOUNT value on done: 170263.0 [2024-08-06 01:06:23,507][52794] Sum rewards: 62.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.746', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '51.000'} [2024-08-06 01:06:23,616][52820] DAMAGECOUNT value on done: 154181.0 [2024-08-06 01:06:23,616][52820] Sum rewards: 51.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.205', 'weapon4': '0.376', 'WEAPON4': '0.450', 'weapon2': '0.852', 'WEAPON3': '1.100', 'weapon3': '2.400', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '43.000'} [2024-08-06 01:06:23,674][52667] DAMAGECOUNT value on done: 172271.0 [2024-08-06 01:06:23,674][52667] Sum rewards: 63.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO3': '0.186', 'AMMO4': '0.188', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '52.500'} [2024-08-06 01:06:25,077][52650] Updated weights for policy 0, policy_version 27801 (0.0011) [2024-08-06 01:06:25,998][52668] DAMAGECOUNT value on done: 167831.0 [2024-08-06 01:06:25,999][52668] Sum rewards: 64.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.672', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.104', 'weapon4': '0.168', 'AMMO3': '0.174', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.052', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:26,041][52803] DAMAGECOUNT value on done: 161137.0 [2024-08-06 01:06:26,041][52803] Sum rewards: 64.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.547', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.145', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.942', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:26,255][52662] DAMAGECOUNT value on done: 174805.0 [2024-08-06 01:06:26,256][52662] Sum rewards: 66.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.578', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '57.000'} [2024-08-06 01:06:26,273][52669] DAMAGECOUNT value on done: 167771.0 [2024-08-06 01:06:26,273][52669] Sum rewards: 54.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.200', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.766', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.952', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:26,320][52794] DAMAGECOUNT value on done: 177176.0 [2024-08-06 01:06:26,321][52794] Sum rewards: 56.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.905', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:26,496][52660] DAMAGECOUNT value on done: 163104.0 [2024-08-06 01:06:26,497][52667] DAMAGECOUNT value on done: 168490.0 [2024-08-06 01:06:26,497][52667] Sum rewards: 62.282, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.000', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.206', 'AMMO3': '0.227', 'AMMO4': '0.251', 'weapon2': '0.376', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.636', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:26,497][52660] Sum rewards: 63.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.213', 'weapon4': '0.348', 'WEAPON4': '0.450', 'weapon2': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.628', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '54.000'} [2024-08-06 01:06:26,907][52820] DAMAGECOUNT value on done: 153476.0 [2024-08-06 01:06:26,907][52820] Sum rewards: 53.874, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.892', 'AMMO5': '0.003', 'weapon5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'AMMO4': '0.182', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '0.950', 'HITCOUNT': '2.880', 'weapon3': '3.338', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 16930.1, 300 sec: 17439.2). Total num frames: 227786752. Throughput: 0: 4205.6. Samples: 56955980. Policy #0 lag: (min: 1.0, avg: 4.2, max: 9.0) [2024-08-06 01:06:27,794][52567] Avg episode reward: [(0, '58.266')] [2024-08-06 01:06:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027806_227786752.pth... [2024-08-06 01:06:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027296_223608832.pth [2024-08-06 01:06:28,942][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:06:29,096][52668] DAMAGECOUNT value on done: 169424.0 [2024-08-06 01:06:29,097][52668] Sum rewards: 62.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'ARMOR': '0.008', 'AMMO5': '0.010', 'weapon5': '0.028', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.174', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon2': '1.170', 'weapon3': '2.426', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '54.000'} [2024-08-06 01:06:29,242][52662] DAMAGECOUNT value on done: 172446.0 [2024-08-06 01:06:29,244][52662] Sum rewards: 68.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.531', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.350', 'weapon2': '0.464', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.682', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '56.000'} [2024-08-06 01:06:29,413][52794] DAMAGECOUNT value on done: 171954.0 [2024-08-06 01:06:29,415][52794] Sum rewards: 75.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon4': '0.454', 'weapon2': '0.648', 'WEAPON3': '1.300', 'weapon3': '2.612', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '64.000'} [2024-08-06 01:06:29,560][52660] DAMAGECOUNT value on done: 167470.0 [2024-08-06 01:06:29,562][52660] Sum rewards: 71.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.115', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.368', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '58.000'} [2024-08-06 01:06:29,596][52803] DAMAGECOUNT value on done: 156328.0 [2024-08-06 01:06:29,598][52803] Sum rewards: 64.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.312', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.185', 'AMMO4': '0.229', 'weapon5': '0.318', 'weapon2': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:30,201][52820] DAMAGECOUNT value on done: 148596.0 [2024-08-06 01:06:30,202][52820] Sum rewards: 49.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.855', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon2': '0.830', 'WEAPON3': '1.600', 'weapon3': '2.870', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:30,283][52669] DAMAGECOUNT value on done: 166406.0 [2024-08-06 01:06:30,285][52669] Sum rewards: 60.825, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.600', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon4': '0.100', 'AMMO3': '0.104', 'AMMO4': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.676', 'WEAPON3': '0.700', 'weapon3': '2.952', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:30,370][52650] Updated weights for policy 0, policy_version 27811 (0.0028) [2024-08-06 01:06:30,630][52667] DAMAGECOUNT value on done: 168902.0 [2024-08-06 01:06:30,630][52667] Sum rewards: 53.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.964', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.082', 'AMMO3': '0.099', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.346', 'WEAPON4': '0.650', 'WEAPON3': '0.700', 'weapon4': '1.358', 'weapon3': '1.968', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.008', 'FRAGCOUNT': '43.000'} [2024-08-06 01:06:32,332][52662] DAMAGECOUNT value on done: 175217.0 [2024-08-06 01:06:32,333][52662] Sum rewards: 68.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.716', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.122', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '56.000'} [2024-08-06 01:06:32,486][52794] DAMAGECOUNT value on done: 174617.0 [2024-08-06 01:06:32,486][52794] Sum rewards: 60.867, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.482', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.036', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.221', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:32,653][52803] DAMAGECOUNT value on done: 158056.0 [2024-08-06 01:06:32,654][52803] Sum rewards: 64.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.009', 'weapon5': '0.024', 'AMMO2': '0.037', 'AMMO3': '0.118', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.480', 'weapon2': '0.604', 'WEAPON3': '0.700', 'weapon3': '2.604', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:32,770][52811] DAMAGECOUNT value on done: 166890.0 [2024-08-06 01:06:32,771][52811] Sum rewards: 70.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.112', 'weapon4': '0.120', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '58.000'} [2024-08-06 01:06:32,778][52668] DAMAGECOUNT value on done: 171857.0 [2024-08-06 01:06:32,780][52668] Sum rewards: 60.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.427', 'AMMO2': '0.002', 'ARMOR': '0.004', 'AMMO4': '0.012', 'weapon4': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.812', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:32,794][52567] Fps is (10 sec: 16384.4, 60 sec: 16930.2, 300 sec: 17383.7). Total num frames: 227868672. Throughput: 0: 4190.2. Samples: 56967140. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-06 01:06:32,794][52567] Avg episode reward: [(0, '58.831')] [2024-08-06 01:06:33,165][52660] DAMAGECOUNT value on done: 169143.0 [2024-08-06 01:06:33,167][52660] Sum rewards: 70.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.377', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'weapon4': '0.142', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '58.000'} [2024-08-06 01:06:33,203][52669] DAMAGECOUNT value on done: 168502.0 [2024-08-06 01:06:33,204][52669] Sum rewards: 72.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.315', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.098', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '59.000'} [2024-08-06 01:06:33,444][52820] DAMAGECOUNT value on done: 155627.0 [2024-08-06 01:06:33,445][52820] Sum rewards: 56.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.985', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.152', 'weapon2': '0.272', 'AMMO3': '0.292', 'WEAPON3': '1.750', 'HITCOUNT': '3.320', 'weapon3': '3.382', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '50.000'} [2024-08-06 01:06:33,907][52667] DAMAGECOUNT value on done: 169797.0 [2024-08-06 01:06:33,908][52667] Sum rewards: 58.187, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.909', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon4': '0.060', 'weapon5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '1.014', 'WEAPON3': '1.150', 'weapon3': '2.632', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:34,758][52650] Updated weights for policy 0, policy_version 27821 (0.0014) [2024-08-06 01:06:35,215][52662] DAMAGECOUNT value on done: 167916.0 [2024-08-06 01:06:35,216][52662] Sum rewards: 53.220, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.880', 'AMMO5': '0.010', 'AMMO2': '0.067', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.335', 'weapon2': '0.370', 'WEAPON4': '0.700', 'weapon4': '0.784', 'WEAPON3': '1.350', 'weapon3': '2.598', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '49.000'} [2024-08-06 01:06:35,325][52794] DAMAGECOUNT value on done: 176454.0 [2024-08-06 01:06:35,327][52794] Sum rewards: 54.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon4': '0.482', 'weapon2': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.606', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:35,544][52668] DAMAGECOUNT value on done: 169692.0 [2024-08-06 01:06:35,544][52668] Sum rewards: 58.320, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.560', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.126', 'AMMO3': '0.132', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '0.850', 'weapon3': '2.984', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:35,664][52803] DAMAGECOUNT value on done: 161038.0 [2024-08-06 01:06:35,664][52803] Sum rewards: 56.592, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.052', 'HEALTH': '0.089', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon4': '0.288', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:35,771][52811] DAMAGECOUNT value on done: 153324.0 [2024-08-06 01:06:35,772][52811] Sum rewards: 52.974, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.360', 'weapon4': '0.022', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.150', 'weapon2': '0.808', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.014', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '43.000'} [2024-08-06 01:06:36,022][52660] DAMAGECOUNT value on done: 179506.0 [2024-08-06 01:06:36,023][52660] Sum rewards: 66.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.087', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.066', 'weapon4': '0.086', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '54.000'} [2024-08-06 01:06:36,462][52669] DAMAGECOUNT value on done: 166774.0 [2024-08-06 01:06:36,462][52669] Sum rewards: 52.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.908', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.191', 'WEAPON4': '0.450', 'weapon2': '0.518', 'weapon4': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.368', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '45.500'} [2024-08-06 01:06:36,477][52667] DAMAGECOUNT value on done: 170878.0 [2024-08-06 01:06:36,477][52667] Sum rewards: 78.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.209', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '65.000'} [2024-08-06 01:06:36,780][52820] DAMAGECOUNT value on done: 153698.0 [2024-08-06 01:06:36,782][52820] Sum rewards: 48.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.983', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.086', 'AMMO4': '0.212', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.364', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.878', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '43.000'} [2024-08-06 01:06:37,776][52662] DAMAGECOUNT value on done: 171796.0 [2024-08-06 01:06:37,776][52662] Sum rewards: 58.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.142', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.060', 'AMMO3': '0.158', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.252', 'AMMO4': '0.300', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 16930.2, 300 sec: 17411.5). Total num frames: 227958784. Throughput: 0: 4245.3. Samples: 56993080. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-06 01:06:37,795][52567] Avg episode reward: [(0, '58.594')] [2024-08-06 01:06:37,943][52794] DAMAGECOUNT value on done: 169191.0 [2024-08-06 01:06:37,943][52794] Sum rewards: 66.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.337', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.131', 'weapon5': '0.132', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '0.900', 'weapon3': '2.838', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:38,725][52811] DAMAGECOUNT value on done: 158641.0 [2024-08-06 01:06:38,727][52811] Sum rewards: 59.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.399', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.166', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.364', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '49.000'} [2024-08-06 01:06:38,761][52803] DAMAGECOUNT value on done: 157331.0 [2024-08-06 01:06:38,762][52803] Sum rewards: 65.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.242', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:38,902][52660] DAMAGECOUNT value on done: 164936.0 [2024-08-06 01:06:38,902][52660] Sum rewards: 46.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.092', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.201', 'weapon4': '0.370', 'WEAPON4': '0.450', 'weapon2': '0.606', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.698', 'DAMAGECOUNT': '11.691', 'FRAGCOUNT': '42.000'} [2024-08-06 01:06:39,041][52669] DAMAGECOUNT value on done: 169468.0 [2024-08-06 01:06:39,042][52669] Sum rewards: 56.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.724', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.128', 'weapon4': '0.176', 'AMMO4': '0.199', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.166', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:39,320][52650] Updated weights for policy 0, policy_version 27831 (0.0025) [2024-08-06 01:06:39,532][52667] DAMAGECOUNT value on done: 168065.0 [2024-08-06 01:06:39,532][52667] Sum rewards: 65.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.108', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.836', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:39,915][52820] DAMAGECOUNT value on done: 156108.0 [2024-08-06 01:06:39,916][52820] Sum rewards: 64.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon4': '0.226', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:40,801][52662] DAMAGECOUNT value on done: 169927.0 [2024-08-06 01:06:40,801][52662] Sum rewards: 52.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.056', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.100', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:41,038][52794] DAMAGECOUNT value on done: 172084.0 [2024-08-06 01:06:41,041][52794] Sum rewards: 51.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '2.990', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '41.000'} [2024-08-06 01:06:41,715][52660] DAMAGECOUNT value on done: 169246.0 [2024-08-06 01:06:41,716][52660] Sum rewards: 56.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.664', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.206', 'weapon4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '48.500'} [2024-08-06 01:06:41,788][52811] DAMAGECOUNT value on done: 157256.0 [2024-08-06 01:06:41,790][52811] Sum rewards: 66.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.204', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:41,802][52669] DAMAGECOUNT value on done: 169285.0 [2024-08-06 01:06:41,803][52669] Sum rewards: 70.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.034', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 01:06:41,848][52803] DAMAGECOUNT value on done: 161567.0 [2024-08-06 01:06:41,850][52803] Sum rewards: 50.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.687', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.058', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.774', 'WEAPON3': '1.500', 'weapon3': '2.886', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '44.500'} [2024-08-06 01:06:42,492][52667] DAMAGECOUNT value on done: 170642.0 [2024-08-06 01:06:42,495][52667] Sum rewards: 62.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO2': '0.034', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.256', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 16930.1, 300 sec: 17411.5). Total num frames: 228048896. Throughput: 0: 4308.0. Samples: 57019380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-06 01:06:42,794][52567] Avg episode reward: [(0, '58.957')] [2024-08-06 01:06:43,105][52820] DAMAGECOUNT value on done: 157137.0 [2024-08-06 01:06:43,109][52820] Sum rewards: 58.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.751', 'AMMO5': '0.005', 'AMMO2': '0.017', 'ARMOR': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon4': '0.390', 'weapon2': '0.788', 'WEAPON3': '1.100', 'weapon3': '2.456', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '49.000'} [2024-08-06 01:06:43,693][52662] DAMAGECOUNT value on done: 169050.0 [2024-08-06 01:06:43,694][52662] Sum rewards: 55.255, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.450', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.396', 'weapon2': '0.672', 'WEAPON3': '0.900', 'weapon3': '2.650', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '44.000'} [2024-08-06 01:06:43,937][52794] DAMAGECOUNT value on done: 166597.0 [2024-08-06 01:06:43,938][52794] Sum rewards: 31.740, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.022', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon7': '0.046', 'AMMO4': '0.119', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.936', 'WEAPON3': '1.100', 'weapon3': '1.894', 'HITCOUNT': '1.960', 'DAMAGECOUNT': '8.730', 'FRAGCOUNT': '29.000'} [2024-08-06 01:06:44,493][52650] Updated weights for policy 0, policy_version 27841 (0.0020) [2024-08-06 01:06:44,500][52660] DAMAGECOUNT value on done: 160620.0 [2024-08-06 01:06:44,501][52660] Sum rewards: 59.337, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.228', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.674', 'WEAPON3': '1.350', 'weapon3': '2.704', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:44,768][52669] DAMAGECOUNT value on done: 169404.0 [2024-08-06 01:06:44,768][52669] Sum rewards: 64.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.020', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '54.000'} [2024-08-06 01:06:44,838][52803] DAMAGECOUNT value on done: 154009.0 [2024-08-06 01:06:44,841][52803] Sum rewards: 52.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.910', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.209', 'weapon5': '0.224', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:44,936][52811] DAMAGECOUNT value on done: 157543.0 [2024-08-06 01:06:44,937][52811] Sum rewards: 50.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.278', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.197', 'WEAPON4': '0.350', 'weapon4': '0.570', 'weapon2': '0.762', 'WEAPON3': '1.100', 'weapon3': '2.426', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.744', 'FRAGCOUNT': '42.000'} [2024-08-06 01:06:45,002][52667] DAMAGECOUNT value on done: 166467.0 [2024-08-06 01:06:45,004][52667] Sum rewards: 56.696, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'weapon4': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.295', 'weapon2': '0.442', 'WEAPON3': '1.700', 'weapon3': '3.022', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:46,239][52664] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon5', 0.002)] [2024-08-06 01:06:46,310][52820] DAMAGECOUNT value on done: 154769.0 [2024-08-06 01:06:46,310][52820] Sum rewards: 57.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.595', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.056', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.702', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '51.000'} [2024-08-06 01:06:46,986][52794] DAMAGECOUNT value on done: 180404.0 [2024-08-06 01:06:46,988][52794] Sum rewards: 54.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'ARMOR': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.236', 'weapon4': '0.242', 'AMMO4': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:47,677][52669] DAMAGECOUNT value on done: 166762.0 [2024-08-06 01:06:47,679][52669] Sum rewards: 67.768, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.107', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon5': '0.056', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon2': '0.226', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.400', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 01:06:47,688][52667] DAMAGECOUNT value on done: 172499.0 [2024-08-06 01:06:47,690][52667] Sum rewards: 75.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.778', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.146', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '62.500'} [2024-08-06 01:06:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.0, 300 sec: 17383.7). Total num frames: 228130816. Throughput: 0: 4312.7. Samples: 57032440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 10.0) [2024-08-06 01:06:47,795][52567] Avg episode reward: [(0, '58.700')] [2024-08-06 01:06:47,835][52811] DAMAGECOUNT value on done: 162779.0 [2024-08-06 01:06:47,835][52811] Sum rewards: 64.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.777', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.217', 'weapon2': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:47,902][52660] DAMAGECOUNT value on done: 171059.0 [2024-08-06 01:06:47,904][52660] Sum rewards: 61.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.548', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.246', 'AMMO3': '0.254', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '54.000'} [2024-08-06 01:06:47,928][52803] DAMAGECOUNT value on done: 157570.0 [2024-08-06 01:06:47,929][52803] Sum rewards: 54.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.472', 'AMMO5': '0.008', 'ARMOR': '0.012', 'weapon5': '0.020', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.162', 'AMMO4': '0.220', 'weapon2': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:48,642][52650] Updated weights for policy 0, policy_version 27851 (0.0048) [2024-08-06 01:06:48,869][52658] DAMAGECOUNT value on done: 173885.0 [2024-08-06 01:06:48,872][52658] Sum rewards: 56.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.734', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.194', 'weapon2': '0.368', 'WEAPON4': '0.450', 'weapon4': '0.760', 'WEAPON3': '1.050', 'weapon3': '2.504', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:49,527][52820] DAMAGECOUNT value on done: 158862.0 [2024-08-06 01:06:49,529][52820] Sum rewards: 57.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:50,252][52794] DAMAGECOUNT value on done: 167300.0 [2024-08-06 01:06:50,256][52794] Sum rewards: 58.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.985', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.978', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:50,610][52669] DAMAGECOUNT value on done: 168855.0 [2024-08-06 01:06:50,610][52669] Sum rewards: 49.851, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.292', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.202', 'weapon4': '0.222', 'AMMO3': '0.237', 'WEAPON4': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.802', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '44.000'} [2024-08-06 01:06:50,704][52667] DAMAGECOUNT value on done: 176282.0 [2024-08-06 01:06:50,704][52667] Sum rewards: 70.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO3': '0.191', 'weapon5': '0.248', 'AMMO4': '0.253', 'weapon4': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '56.000'} [2024-08-06 01:06:50,827][52811] DAMAGECOUNT value on done: 158809.0 [2024-08-06 01:06:50,829][52811] Sum rewards: 53.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.614', 'AMMO5': '0.022', 'weapon7': '0.064', 'AMMO2': '0.073', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'weapon5': '0.358', 'AMMO4': '0.363', 'weapon4': '0.594', 'weapon2': '0.636', 'WEAPON5': '0.700', 'WEAPON4': '0.850', 'WEAPON3': '0.950', 'weapon3': '1.982', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '47.000'} [2024-08-06 01:06:50,928][52660] DAMAGECOUNT value on done: 164272.0 [2024-08-06 01:06:50,929][52660] Sum rewards: 57.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.200', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.388', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '51.000'} [2024-08-06 01:06:50,957][52803] DAMAGECOUNT value on done: 153912.0 [2024-08-06 01:06:50,960][52803] Sum rewards: 61.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.038', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon4': '0.192', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.862', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.500'} [2024-08-06 01:06:52,100][52658] DAMAGECOUNT value on done: 170356.0 [2024-08-06 01:06:52,100][52658] Sum rewards: 62.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.622', 'AMMO5': '0.010', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.474', 'weapon4': '0.518', 'WEAPON3': '1.400', 'weapon3': '2.614', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '53.000'} [2024-08-06 01:06:52,699][52820] DAMAGECOUNT value on done: 158085.0 [2024-08-06 01:06:52,701][52820] Sum rewards: 60.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.369', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '52.000'} [2024-08-06 01:06:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 228220928. Throughput: 0: 4324.2. Samples: 57059150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:06:52,795][52567] Avg episode reward: [(0, '59.226')] [2024-08-06 01:06:52,795][52614] Saving new best policy, reward=59.226! [2024-08-06 01:06:53,323][52650] Updated weights for policy 0, policy_version 27861 (0.0014) [2024-08-06 01:06:53,366][52669] DAMAGECOUNT value on done: 169703.0 [2024-08-06 01:06:53,368][52669] Sum rewards: 44.581, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.262', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.160', 'AMMO3': '0.202', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON4': '0.650', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.328', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '43.500'} [2024-08-06 01:06:53,496][52794] DAMAGECOUNT value on done: 176014.0 [2024-08-06 01:06:53,499][52794] Sum rewards: 46.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.863', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.184', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.080', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '41.000'} [2024-08-06 01:06:53,814][52660] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:06:53,827][52667] DAMAGECOUNT value on done: 174517.0 [2024-08-06 01:06:53,829][52667] Sum rewards: 58.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.133', 'weapon5': '0.204', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon2': '0.622', 'weapon4': '0.836', 'WEAPON3': '0.850', 'weapon3': '2.096', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '50.500'} [2024-08-06 01:06:53,856][52811] DAMAGECOUNT value on done: 157268.0 [2024-08-06 01:06:53,858][52811] Sum rewards: 63.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.131', 'WEAPON3': '0.850', 'weapon2': '0.914', 'weapon3': '2.952', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '49.500'} [2024-08-06 01:06:54,247][52803] DAMAGECOUNT value on done: 163277.0 [2024-08-06 01:06:54,247][52803] Sum rewards: 76.564, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.161', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '3.240', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2024-08-06 01:06:55,050][52658] DAMAGECOUNT value on done: 172736.0 [2024-08-06 01:06:55,051][52658] Sum rewards: 55.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.247', 'weapon2': '0.348', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.108', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '48.000'} [2024-08-06 01:06:56,158][52820] DAMAGECOUNT value on done: 158625.0 [2024-08-06 01:06:56,159][52820] Sum rewards: 55.230, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.898', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.074', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.342', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.918', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '50.000'} [2024-08-06 01:06:56,406][52669] DAMAGECOUNT value on done: 166509.0 [2024-08-06 01:06:56,407][52669] Sum rewards: 67.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.762', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.082', 'weapon4': '0.084', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.500'} [2024-08-06 01:06:56,676][52794] DAMAGECOUNT value on done: 171801.0 [2024-08-06 01:06:56,677][52794] Sum rewards: 67.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.386', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'weapon4': '0.226', 'AMMO3': '0.227', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '56.000'} [2024-08-06 01:06:56,787][52667] DAMAGECOUNT value on done: 174981.0 [2024-08-06 01:06:56,789][52667] Sum rewards: 53.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.188', 'AMMO3': '0.191', 'AMMO4': '0.277', 'weapon2': '0.348', 'WEAPON5': '0.400', 'weapon4': '0.572', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '46.000'} [2024-08-06 01:06:56,951][52811] DAMAGECOUNT value on done: 163893.0 [2024-08-06 01:06:56,953][52811] Sum rewards: 66.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.830', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.248', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.874', 'WEAPON3': '1.150', 'weapon3': '2.584', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:57,225][52803] DAMAGECOUNT value on done: 161892.0 [2024-08-06 01:06:57,227][52803] Sum rewards: 57.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.410', 'weapon4': '0.452', 'WEAPON3': '1.500', 'weapon3': '2.876', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '50.000'} [2024-08-06 01:06:57,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 228311040. Throughput: 0: 4324.9. Samples: 57085230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:06:57,794][52567] Avg episode reward: [(0, '59.433')] [2024-08-06 01:06:57,797][52614] Saving new best policy, reward=59.433! [2024-08-06 01:06:58,207][52650] Updated weights for policy 0, policy_version 27871 (0.0011) [2024-08-06 01:06:58,407][52658] DAMAGECOUNT value on done: 171669.0 [2024-08-06 01:06:58,408][52658] Sum rewards: 50.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.066', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '45.000'} [2024-08-06 01:06:59,202][52820] DAMAGECOUNT value on done: 156760.0 [2024-08-06 01:06:59,203][52820] Sum rewards: 63.894, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.226', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.077', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.246', 'weapon4': '0.630', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '55.000'} [2024-08-06 01:06:59,297][52794] DAMAGECOUNT value on done: 172459.0 [2024-08-06 01:06:59,297][52794] Sum rewards: 68.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.128', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.256', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '59.000'} [2024-08-06 01:06:59,524][52669] DAMAGECOUNT value on done: 171701.0 [2024-08-06 01:06:59,524][52669] Sum rewards: 74.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.385', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.236', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '61.000'} [2024-08-06 01:06:59,957][52811] DAMAGECOUNT value on done: 159069.0 [2024-08-06 01:06:59,958][52811] Sum rewards: 72.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.020', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.221', 'weapon2': '0.286', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '59.000'} [2024-08-06 01:07:00,004][52667] DAMAGECOUNT value on done: 168307.0 [2024-08-06 01:07:00,005][52667] Sum rewards: 52.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.127', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.207', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '45.000'} [2024-08-06 01:07:00,310][52803] DAMAGECOUNT value on done: 158155.0 [2024-08-06 01:07:00,312][52803] Sum rewards: 54.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.735', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.364', 'weapon4': '0.518', 'WEAPON3': '1.650', 'weapon3': '2.886', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '49.000'} [2024-08-06 01:07:00,711][52666] DAMAGECOUNT value on done: 172799.0 [2024-08-06 01:07:00,712][52666] Sum rewards: 73.580, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.912', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.144', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '3.378', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '59.000'} [2024-08-06 01:07:01,345][52658] DAMAGECOUNT value on done: 172183.0 [2024-08-06 01:07:01,346][52658] Sum rewards: 54.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.838', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.151', 'AMMO3': '0.248', 'weapon2': '0.296', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '1.450', 'weapon3': '2.660', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '47.500'} [2024-08-06 01:07:01,765][52794] DAMAGECOUNT value on done: 178265.0 [2024-08-06 01:07:01,765][52794] Sum rewards: 59.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.575', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.146', 'weapon5': '0.192', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.654', 'weapon2': '0.674', 'WEAPON3': '0.850', 'weapon3': '2.266', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:02,285][52820] DAMAGECOUNT value on done: 157632.0 [2024-08-06 01:07:02,285][52820] Sum rewards: 70.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'weapon2': '0.172', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.552', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '62.000'} [2024-08-06 01:07:02,508][52669] DAMAGECOUNT value on done: 175624.0 [2024-08-06 01:07:02,509][52669] Sum rewards: 57.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.204', 'weapon4': '0.232', 'AMMO3': '0.234', 'AMMO4': '0.243', 'weapon2': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.030', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:02,770][52650] Updated weights for policy 0, policy_version 27881 (0.0012) [2024-08-06 01:07:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 228401152. Throughput: 0: 4321.6. Samples: 57098400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:07:02,794][52567] Avg episode reward: [(0, '60.242')] [2024-08-06 01:07:02,795][52614] Saving new best policy, reward=60.242! [2024-08-06 01:07:02,903][52667] DAMAGECOUNT value on done: 174187.0 [2024-08-06 01:07:02,904][52667] Sum rewards: 51.030, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.622', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '45.500'} [2024-08-06 01:07:03,209][52811] DAMAGECOUNT value on done: 156781.0 [2024-08-06 01:07:03,209][52811] Sum rewards: 44.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.113', 'AMMO5': '0.016', 'ARMOR': '0.024', 'AMMO2': '0.042', 'AMMO3': '0.188', 'AMMO4': '0.209', 'weapon4': '0.298', 'weapon2': '0.370', 'weapon5': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.618', 'DAMAGECOUNT': '11.817', 'FRAGCOUNT': '38.500'} [2024-08-06 01:07:03,358][52803] DAMAGECOUNT value on done: 162004.0 [2024-08-06 01:07:03,359][52803] Sum rewards: 64.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.191', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.121', 'AMMO3': '0.226', 'weapon2': '0.348', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.278', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '57.000'} [2024-08-06 01:07:03,784][52666] DAMAGECOUNT value on done: 173206.0 [2024-08-06 01:07:03,785][52666] Sum rewards: 78.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'weapon4': '0.224', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 01:07:04,374][52658] DAMAGECOUNT value on done: 166231.0 [2024-08-06 01:07:04,375][52658] Sum rewards: 61.059, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.115', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.122', 'weapon5': '0.124', 'AMMO4': '0.145', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:04,767][52794] DAMAGECOUNT value on done: 172928.0 [2024-08-06 01:07:04,768][52794] Sum rewards: 63.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.336', 'AMMO5': '0.003', 'ARMOR': '0.013', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.219', 'AMMO3': '0.232', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:05,311][52820] DAMAGECOUNT value on done: 159855.0 [2024-08-06 01:07:05,312][52820] Sum rewards: 62.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.284', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon4': '0.106', 'AMMO4': '0.112', 'weapon5': '0.158', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.104', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:05,341][52669] DAMAGECOUNT value on done: 180446.0 [2024-08-06 01:07:05,343][52669] Sum rewards: 55.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.106', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.392', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.196', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:06,334][52803] DAMAGECOUNT value on done: 157350.0 [2024-08-06 01:07:06,336][52803] Sum rewards: 65.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.983', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.234', 'weapon4': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:06,361][52811] DAMAGECOUNT value on done: 159872.0 [2024-08-06 01:07:06,363][52811] Sum rewards: 58.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.524', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.237', 'weapon2': '0.250', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.192', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:06,398][52666] DAMAGECOUNT value on done: 171114.0 [2024-08-06 01:07:06,413][52666] Sum rewards: 55.338, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.303', 'weapon2': '0.418', 'WEAPON3': '1.750', 'HITCOUNT': '3.230', 'weapon3': '3.270', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:06,958][52658] DAMAGECOUNT value on done: 175471.0 [2024-08-06 01:07:06,959][52658] Sum rewards: 59.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.842', 'AMMO5': '0.014', 'AMMO2': '0.073', 'weapon5': '0.148', 'weapon4': '0.158', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'AMMO4': '0.365', 'weapon2': '0.396', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '53.000'} [2024-08-06 01:07:07,624][52650] Updated weights for policy 0, policy_version 27891 (0.0022) [2024-08-06 01:07:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 228483072. Throughput: 0: 4324.9. Samples: 57124570. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:07:07,795][52567] Avg episode reward: [(0, '60.108')] [2024-08-06 01:07:08,226][52669] DAMAGECOUNT value on done: 170138.0 [2024-08-06 01:07:08,226][52669] Sum rewards: 49.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.984', 'AMMO5': '0.016', 'ARMOR': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.159', 'weapon5': '0.198', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'weapon4': '0.484', 'WEAPON4': '0.550', 'weapon2': '0.768', 'WEAPON3': '0.950', 'weapon3': '2.210', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '41.000'} [2024-08-06 01:07:08,366][52820] DAMAGECOUNT value on done: 157419.0 [2024-08-06 01:07:08,366][52820] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.101', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.054', 'weapon4': '0.060', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.200', 'HITCOUNT': '3.350', 'weapon3': '3.380', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '58.000'} [2024-08-06 01:07:08,985][52666] DAMAGECOUNT value on done: 167254.0 [2024-08-06 01:07:08,987][52666] Sum rewards: 58.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.182', 'WEAPON4': '0.300', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.902', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '48.500'} [2024-08-06 01:07:09,152][52670] DAMAGECOUNT value on done: 167085.0 [2024-08-06 01:07:09,153][52670] Sum rewards: 71.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.018', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.219', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '61.000'} [2024-08-06 01:07:09,352][52658] DAMAGECOUNT value on done: 164695.0 [2024-08-06 01:07:09,352][52658] Sum rewards: 52.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.497', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.064', 'AMMO3': '0.213', 'weapon5': '0.218', 'AMMO4': '0.322', 'weapon4': '0.376', 'weapon2': '0.490', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.560', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '46.000'} [2024-08-06 01:07:09,391][52811] DAMAGECOUNT value on done: 158025.0 [2024-08-06 01:07:09,395][52811] Sum rewards: 63.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.952', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:09,506][52803] DAMAGECOUNT value on done: 155859.0 [2024-08-06 01:07:09,508][52803] Sum rewards: 65.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.071', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.254', 'weapon4': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:11,216][52669] DAMAGECOUNT value on done: 172498.0 [2024-08-06 01:07:11,217][52669] Sum rewards: 63.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.566', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.338', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:11,603][52820] DAMAGECOUNT value on done: 157083.0 [2024-08-06 01:07:11,604][52820] Sum rewards: 59.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.037', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.164', 'AMMO4': '0.184', 'weapon4': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.616', 'WEAPON3': '0.950', 'weapon3': '2.954', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '48.500'} [2024-08-06 01:07:11,930][52666] DAMAGECOUNT value on done: 165421.0 [2024-08-06 01:07:11,931][52666] Sum rewards: 63.881, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.478', 'AMMO5': '0.006', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.148', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.380', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '50.500'} [2024-08-06 01:07:12,080][52670] DAMAGECOUNT value on done: 171025.0 [2024-08-06 01:07:12,080][52670] Sum rewards: 53.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '43.000'} [2024-08-06 01:07:12,097][52658] DAMAGECOUNT value on done: 175993.0 [2024-08-06 01:07:12,098][52658] Sum rewards: 57.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.158', 'AMMO3': '0.172', 'weapon2': '0.244', 'WEAPON4': '0.450', 'weapon4': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:12,260][52650] Updated weights for policy 0, policy_version 27901 (0.0025) [2024-08-06 01:07:12,441][52811] DAMAGECOUNT value on done: 160140.0 [2024-08-06 01:07:12,446][52811] Sum rewards: 64.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.454', 'AMMO5': '0.003', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.157', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.718', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:12,484][52803] DAMAGECOUNT value on done: 162064.0 [2024-08-06 01:07:12,487][52803] Sum rewards: 62.473, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.136', 'AMMO3': '0.152', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.172', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 228573184. Throughput: 0: 4337.3. Samples: 57151160. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:07:12,794][52567] Avg episode reward: [(0, '59.693')] [2024-08-06 01:07:12,880][52614] Signal inference workers to stop experience collection... (5150 times) [2024-08-06 01:07:12,881][52614] Signal inference workers to resume experience collection... (5150 times) [2024-08-06 01:07:12,936][52650] InferenceWorker_p0-w0: stopping experience collection (5150 times) [2024-08-06 01:07:12,936][52650] InferenceWorker_p0-w0: resuming experience collection (5150 times) [2024-08-06 01:07:13,799][52649] DAMAGECOUNT value on done: 165408.0 [2024-08-06 01:07:13,800][52649] Sum rewards: 52.247, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon4': '0.156', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.700', 'HITCOUNT': '2.930', 'weapon3': '3.112', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '49.000'} [2024-08-06 01:07:13,934][52669] DAMAGECOUNT value on done: 172241.0 [2024-08-06 01:07:13,936][52669] Sum rewards: 69.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.927', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '58.000'} [2024-08-06 01:07:14,478][52666] DAMAGECOUNT value on done: 162520.0 [2024-08-06 01:07:14,479][52666] Sum rewards: 50.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.224', 'weapon4': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '44.000'} [2024-08-06 01:07:14,650][52670] DAMAGECOUNT value on done: 167199.0 [2024-08-06 01:07:14,650][52670] Sum rewards: 61.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.192', 'AMMO4': '0.212', 'AMMO3': '0.220', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.652', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:14,847][52820] DAMAGECOUNT value on done: 161198.0 [2024-08-06 01:07:14,847][52820] Sum rewards: 64.870, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.011', 'HEALTH': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.187', 'weapon2': '0.282', 'WEAPON3': '1.000', 'weapon3': '3.346', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:15,014][52658] DAMAGECOUNT value on done: 175720.0 [2024-08-06 01:07:15,017][52658] Sum rewards: 51.627, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.898', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.090', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.174', 'weapon2': '0.820', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.029', 'FRAGCOUNT': '42.000'} [2024-08-06 01:07:15,491][52811] DAMAGECOUNT value on done: 158744.0 [2024-08-06 01:07:15,491][52811] Sum rewards: 58.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.834', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '2.986', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '51.500'} [2024-08-06 01:07:15,560][52803] DAMAGECOUNT value on done: 157488.0 [2024-08-06 01:07:15,562][52803] Sum rewards: 51.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.364', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.108', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.494', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.036', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '45.000'} [2024-08-06 01:07:16,462][52649] DAMAGECOUNT value on done: 161764.0 [2024-08-06 01:07:16,463][52649] Sum rewards: 62.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.356', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.156', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.910', 'WEAPON3': '1.000', 'weapon3': '2.498', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:17,071][52650] Updated weights for policy 0, policy_version 27911 (0.0012) [2024-08-06 01:07:17,170][52669] DAMAGECOUNT value on done: 175070.0 [2024-08-06 01:07:17,172][52669] Sum rewards: 65.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '57.000'} [2024-08-06 01:07:17,243][52666] DAMAGECOUNT value on done: 167916.0 [2024-08-06 01:07:17,244][52666] Sum rewards: 64.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.308', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:17,571][52670] DAMAGECOUNT value on done: 166906.0 [2024-08-06 01:07:17,573][52670] Sum rewards: 55.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.070', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon2': '0.762', 'WEAPON3': '1.400', 'weapon3': '2.874', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 228663296. Throughput: 0: 4386.2. Samples: 57164520. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:07:17,795][52567] Avg episode reward: [(0, '59.708')] [2024-08-06 01:07:17,898][52658] DAMAGECOUNT value on done: 175762.0 [2024-08-06 01:07:17,898][52658] Sum rewards: 63.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.772', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.284', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.380', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:18,037][52820] DAMAGECOUNT value on done: 163852.0 [2024-08-06 01:07:18,037][52820] Sum rewards: 57.251, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.724', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.064', 'weapon5': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'AMMO4': '0.322', 'weapon4': '0.362', 'weapon2': '0.480', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.642', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '50.500'} [2024-08-06 01:07:18,586][52803] DAMAGECOUNT value on done: 162016.0 [2024-08-06 01:07:18,588][52803] Sum rewards: 61.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:18,588][52811] DAMAGECOUNT value on done: 159706.0 [2024-08-06 01:07:18,592][52811] Sum rewards: 46.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.108', 'weapon5': '0.122', 'AMMO4': '0.130', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.902', 'WEAPON3': '0.950', 'HITCOUNT': '2.650', 'weapon3': '2.672', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '39.000'} [2024-08-06 01:07:19,577][52649] DAMAGECOUNT value on done: 165365.0 [2024-08-06 01:07:19,577][52649] Sum rewards: 47.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.234', 'weapon4': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.606', 'WEAPON3': '1.400', 'weapon3': '2.792', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '44.000'} [2024-08-06 01:07:19,996][52666] DAMAGECOUNT value on done: 168013.0 [2024-08-06 01:07:19,996][52666] Sum rewards: 54.030, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO4': '0.055', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.574', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.072', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '47.500'} [2024-08-06 01:07:20,162][52670] DAMAGECOUNT value on done: 168149.0 [2024-08-06 01:07:20,163][52670] Sum rewards: 60.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.095', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '50.000'} [2024-08-06 01:07:20,890][52658] DAMAGECOUNT value on done: 165539.0 [2024-08-06 01:07:20,892][52658] Sum rewards: 66.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.218', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.191', 'weapon2': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '57.000'} [2024-08-06 01:07:21,196][52820] DAMAGECOUNT value on done: 155362.0 [2024-08-06 01:07:21,196][52820] Sum rewards: 53.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.465', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO3': '0.114', 'AMMO4': '0.178', 'WEAPON5': '0.300', 'weapon4': '0.560', 'WEAPON4': '0.650', 'WEAPON3': '0.800', 'weapon2': '1.114', 'weapon3': '2.056', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '44.000'} [2024-08-06 01:07:21,387][52650] Updated weights for policy 0, policy_version 27921 (0.0044) [2024-08-06 01:07:21,643][52811] DAMAGECOUNT value on done: 156076.0 [2024-08-06 01:07:21,643][52811] Sum rewards: 54.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.766', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.038', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.390', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.366', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:21,712][52803] DAMAGECOUNT value on done: 153512.0 [2024-08-06 01:07:21,713][52803] Sum rewards: 60.012, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.334', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.106', 'WEAPON4': '0.300', 'weapon4': '0.670', 'WEAPON3': '0.750', 'weapon2': '1.124', 'weapon3': '1.998', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:22,728][52649] DAMAGECOUNT value on done: 167105.0 [2024-08-06 01:07:22,729][52649] Sum rewards: 63.228, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.792', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.184', 'weapon2': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.420', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:22,759][52666] DAMAGECOUNT value on done: 169847.0 [2024-08-06 01:07:22,760][52666] Sum rewards: 65.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.187', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.116', 'weapon4': '0.122', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '57.000'} [2024-08-06 01:07:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 228745216. Throughput: 0: 4395.6. Samples: 57190880. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:07:22,794][52567] Avg episode reward: [(0, '59.529')] [2024-08-06 01:07:22,993][52670] DAMAGECOUNT value on done: 171381.0 [2024-08-06 01:07:22,994][52670] Sum rewards: 76.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.052', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '2.968', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '63.000'} [2024-08-06 01:07:23,633][52658] DAMAGECOUNT value on done: 169820.0 [2024-08-06 01:07:23,633][52658] Sum rewards: 51.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.312', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'weapon2': '0.252', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.340', 'weapon3': '3.352', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '43.000'} [2024-08-06 01:07:24,418][52671] DAMAGECOUNT value on done: 175741.0 [2024-08-06 01:07:24,419][52671] Sum rewards: 48.245, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.126', 'WEAPON4': '0.350', 'weapon4': '0.496', 'weapon2': '0.636', 'WEAPON3': '0.800', 'weapon3': '2.626', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '38.000'} [2024-08-06 01:07:24,819][52811] DAMAGECOUNT value on done: 162182.0 [2024-08-06 01:07:24,827][52811] Sum rewards: 57.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.943', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.073', 'weapon5': '0.218', 'weapon4': '0.222', 'AMMO3': '0.241', 'AMMO4': '0.365', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.764', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '50.000'} [2024-08-06 01:07:25,393][52666] DAMAGECOUNT value on done: 169249.0 [2024-08-06 01:07:25,393][52666] Sum rewards: 60.608, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.177', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO4': '0.176', 'weapon4': '0.212', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.500', 'weapon3': '2.894', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:25,683][52670] DAMAGECOUNT value on done: 163525.0 [2024-08-06 01:07:25,685][52670] Sum rewards: 68.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.342', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '59.000'} [2024-08-06 01:07:25,742][52649] DAMAGECOUNT value on done: 158533.0 [2024-08-06 01:07:25,742][52649] Sum rewards: 54.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.444', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.102', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '0.900', 'HITCOUNT': '2.850', 'weapon3': '3.190', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '45.000'} [2024-08-06 01:07:26,198][52650] Updated weights for policy 0, policy_version 27931 (0.0019) [2024-08-06 01:07:26,270][52658] DAMAGECOUNT value on done: 169596.0 [2024-08-06 01:07:26,272][52658] Sum rewards: 61.332, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.031', 'AMMO3': '0.129', 'AMMO4': '0.156', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.542', 'weapon4': '0.702', 'WEAPON3': '0.900', 'weapon3': '2.240', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '49.000'} [2024-08-06 01:07:27,491][52671] DAMAGECOUNT value on done: 169503.0 [2024-08-06 01:07:27,492][52671] Sum rewards: 67.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.118', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.112', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 228835328. Throughput: 0: 4396.2. Samples: 57217210. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:07:27,794][52567] Avg episode reward: [(0, '60.154')] [2024-08-06 01:07:28,019][52811] DAMAGECOUNT value on done: 156283.0 [2024-08-06 01:07:28,021][52811] Sum rewards: 49.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO5': '0.005', 'weapon4': '0.022', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon2': '0.242', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'HITCOUNT': '2.740', 'weapon3': '3.544', 'DAMAGECOUNT': '11.670', 'FRAGCOUNT': '46.000'} [2024-08-06 01:07:28,440][52666] DAMAGECOUNT value on done: 165875.0 [2024-08-06 01:07:28,442][52666] Sum rewards: 58.348, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.275', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.382', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:28,767][52649] DAMAGECOUNT value on done: 165114.0 [2024-08-06 01:07:28,767][52649] Sum rewards: 62.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.015', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.238', 'weapon4': '0.270', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:28,775][52670] DAMAGECOUNT value on done: 168890.0 [2024-08-06 01:07:28,776][52670] Sum rewards: 66.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.427', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.149', 'weapon4': '0.158', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:29,266][52658] DAMAGECOUNT value on done: 168029.0 [2024-08-06 01:07:29,268][52658] Sum rewards: 54.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.276', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon4': '0.220', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '2.926', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '47.000'} [2024-08-06 01:07:30,193][52671] DAMAGECOUNT value on done: 174144.0 [2024-08-06 01:07:30,194][52671] Sum rewards: 54.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.662', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.186', 'weapon5': '0.186', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.450', 'weapon4': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.638', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '45.000'} [2024-08-06 01:07:30,723][52650] Updated weights for policy 0, policy_version 27941 (0.0013) [2024-08-06 01:07:31,263][52811] DAMAGECOUNT value on done: 161218.0 [2024-08-06 01:07:31,263][52811] Sum rewards: 53.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.573', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.144', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.206', 'DAMAGECOUNT': '12.861', 'FRAGCOUNT': '46.000'} [2024-08-06 01:07:31,379][52666] DAMAGECOUNT value on done: 162972.0 [2024-08-06 01:07:31,380][52666] Sum rewards: 59.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.071', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '3.120', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '47.000'} [2024-08-06 01:07:31,782][52670] DAMAGECOUNT value on done: 163417.0 [2024-08-06 01:07:31,782][52670] Sum rewards: 65.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.644', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.133', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.578', 'WEAPON3': '0.950', 'weapon3': '2.824', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '53.000'} [2024-08-06 01:07:31,790][52649] DAMAGECOUNT value on done: 162790.0 [2024-08-06 01:07:31,790][52649] Sum rewards: 62.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.645', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.218', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2024-08-06 01:07:32,103][52658] DAMAGECOUNT value on done: 173462.0 [2024-08-06 01:07:32,105][52658] Sum rewards: 62.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.432', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:32,685][52671] DAMAGECOUNT value on done: 168417.0 [2024-08-06 01:07:32,686][52671] Sum rewards: 65.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.978', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.054', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.404', 'weapon4': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:32,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17439.3). Total num frames: 228925440. Throughput: 0: 4396.5. Samples: 57230280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:07:32,795][52567] Avg episode reward: [(0, '60.042')] [2024-08-06 01:07:34,321][52666] DAMAGECOUNT value on done: 172360.0 [2024-08-06 01:07:34,321][52666] Sum rewards: 70.065, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.072', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon5': '0.222', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '56.000'} [2024-08-06 01:07:34,790][52670] DAMAGECOUNT value on done: 160909.0 [2024-08-06 01:07:34,792][52670] Sum rewards: 58.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.074', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.230', 'weapon4': '0.402', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '53.000'} [2024-08-06 01:07:34,809][52658] DAMAGECOUNT value on done: 173435.0 [2024-08-06 01:07:34,810][52658] Sum rewards: 50.905, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.018', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.195', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '2.970', 'DAMAGECOUNT': '12.585', 'FRAGCOUNT': '44.000'} [2024-08-06 01:07:34,935][52649] DAMAGECOUNT value on done: 170550.0 [2024-08-06 01:07:34,937][52649] Sum rewards: 62.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.076', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'AMMO4': '0.237', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '56.000'} [2024-08-06 01:07:35,504][52650] Updated weights for policy 0, policy_version 27951 (0.0011) [2024-08-06 01:07:35,609][52671] DAMAGECOUNT value on done: 171145.0 [2024-08-06 01:07:35,611][52671] Sum rewards: 54.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.204', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.030', 'weapon4': '0.070', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.224', 'weapon2': '0.240', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.452', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '46.500'} [2024-08-06 01:07:37,440][52666] DAMAGECOUNT value on done: 170954.0 [2024-08-06 01:07:37,440][52666] Sum rewards: 58.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon2': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.370', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:37,637][52663] DAMAGECOUNT value on done: 170519.0 [2024-08-06 01:07:37,638][52663] Sum rewards: 77.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.597', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.215', 'weapon4': '0.248', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '65.000'} [2024-08-06 01:07:37,795][52567] Fps is (10 sec: 17201.4, 60 sec: 17476.0, 300 sec: 17411.4). Total num frames: 229007360. Throughput: 0: 4393.7. Samples: 57256870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:07:37,803][52567] Avg episode reward: [(0, '60.437')] [2024-08-06 01:07:37,806][52614] Saving new best policy, reward=60.437! [2024-08-06 01:07:37,829][52670] DAMAGECOUNT value on done: 171831.0 [2024-08-06 01:07:37,831][52670] Sum rewards: 63.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.548', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.037', 'weapon5': '0.124', 'AMMO4': '0.185', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '54.500'} [2024-08-06 01:07:37,974][52649] DAMAGECOUNT value on done: 163096.0 [2024-08-06 01:07:37,975][52649] Sum rewards: 46.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.268', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.184', 'weapon5': '0.240', 'AMMO4': '0.257', 'weapon2': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '2.712', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '40.500'} [2024-08-06 01:07:38,160][52658] DAMAGECOUNT value on done: 166364.0 [2024-08-06 01:07:38,162][52658] Sum rewards: 52.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.420', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'weapon4': '0.070', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.906', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '44.000'} [2024-08-06 01:07:38,312][52671] DAMAGECOUNT value on done: 171327.0 [2024-08-06 01:07:38,312][52671] Sum rewards: 56.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.249', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.118', 'AMMO4': '0.212', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.894', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '49.000'} [2024-08-06 01:07:39,195][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:07:39,871][52666] DAMAGECOUNT value on done: 165744.0 [2024-08-06 01:07:39,873][52666] Sum rewards: 56.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.049', 'ARMOR': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.194', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:40,145][52670] DAMAGECOUNT value on done: 169246.0 [2024-08-06 01:07:40,146][52670] Sum rewards: 56.108, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.156', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.074', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon2': '0.294', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.178', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '46.000'} [2024-08-06 01:07:40,440][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:07:40,445][52650] Updated weights for policy 0, policy_version 27961 (0.0013) [2024-08-06 01:07:40,507][52663] DAMAGECOUNT value on done: 169653.0 [2024-08-06 01:07:40,507][52663] Sum rewards: 63.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.811', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:40,982][52671] DAMAGECOUNT value on done: 171352.0 [2024-08-06 01:07:40,982][52671] Sum rewards: 35.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'AMMO4': '0.194', 'WEAPON7': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON4': '0.600', 'weapon4': '0.756', 'WEAPON3': '1.200', 'weapon3': '1.950', 'HITCOUNT': '2.170', 'DAMAGECOUNT': '10.275', 'FRAGCOUNT': '32.000'} [2024-08-06 01:07:40,987][52649] DAMAGECOUNT value on done: 166571.0 [2024-08-06 01:07:40,987][52649] Sum rewards: 69.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.034', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '58.000'} [2024-08-06 01:07:41,012][52658] DAMAGECOUNT value on done: 167597.0 [2024-08-06 01:07:41,014][52658] Sum rewards: 61.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.181', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.000'} [2024-08-06 01:07:42,459][52666] DAMAGECOUNT value on done: 166819.0 [2024-08-06 01:07:42,460][52666] Sum rewards: 55.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.598', 'AMMO5': '0.008', 'AMMO2': '0.052', 'weapon5': '0.104', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.259', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.000', 'HITCOUNT': '2.950', 'weapon3': '2.974', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '46.500'} [2024-08-06 01:07:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 229097472. Throughput: 0: 4395.8. Samples: 57283040. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:07:42,794][52567] Avg episode reward: [(0, '59.829')] [2024-08-06 01:07:43,008][52670] DAMAGECOUNT value on done: 171666.0 [2024-08-06 01:07:43,008][52670] Sum rewards: 64.567, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.875', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.125', 'weapon4': '0.144', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 01:07:43,512][52658] DAMAGECOUNT value on done: 173808.0 [2024-08-06 01:07:43,516][52658] Sum rewards: 59.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon2': '0.576', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '3.192', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:43,526][52663] DAMAGECOUNT value on done: 167146.0 [2024-08-06 01:07:43,526][52663] Sum rewards: 53.019, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.154', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.528', 'weapon4': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.580', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '43.000'} [2024-08-06 01:07:43,918][52671] DAMAGECOUNT value on done: 172124.0 [2024-08-06 01:07:43,918][52671] Sum rewards: 65.860, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.544', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.108', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.302', 'weapon4': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '57.000'} [2024-08-06 01:07:43,926][52649] DAMAGECOUNT value on done: 166932.0 [2024-08-06 01:07:43,926][52649] Sum rewards: 55.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.106', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.124', 'AMMO4': '0.131', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '3.108', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '46.000'} [2024-08-06 01:07:44,622][52650] Updated weights for policy 0, policy_version 27971 (0.0031) [2024-08-06 01:07:45,834][52666] DAMAGECOUNT value on done: 166471.0 [2024-08-06 01:07:45,835][52666] Sum rewards: 65.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.221', 'weapon2': '0.358', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.474', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:46,157][52670] DAMAGECOUNT value on done: 168913.0 [2024-08-06 01:07:46,159][52670] Sum rewards: 62.404, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.472', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.146', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:46,609][52663] DAMAGECOUNT value on done: 169719.0 [2024-08-06 01:07:46,609][52663] Sum rewards: 61.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.976', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.068', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO4': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:47,011][52649] DAMAGECOUNT value on done: 163163.0 [2024-08-06 01:07:47,011][52649] Sum rewards: 69.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.955', 'AMMO5': '0.007', 'weapon5': '0.050', 'AMMO2': '0.052', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'AMMO4': '0.257', 'weapon2': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.632', 'WEAPON3': '1.500', 'weapon3': '2.834', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '59.000'} [2024-08-06 01:07:47,019][52671] DAMAGECOUNT value on done: 170518.0 [2024-08-06 01:07:47,019][52671] Sum rewards: 61.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.248', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:47,794][52567] Fps is (10 sec: 18024.2, 60 sec: 17612.9, 300 sec: 17411.5). Total num frames: 229187584. Throughput: 0: 4397.8. Samples: 57296300. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:07:47,794][52567] Avg episode reward: [(0, '59.641')] [2024-08-06 01:07:48,711][52666] DAMAGECOUNT value on done: 170760.0 [2024-08-06 01:07:48,713][52666] Sum rewards: 47.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.203', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.630', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '41.000'} [2024-08-06 01:07:49,160][52670] DAMAGECOUNT value on done: 173731.0 [2024-08-06 01:07:49,161][52670] Sum rewards: 60.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.957', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.164', 'weapon5': '0.164', 'AMMO3': '0.182', 'AMMO4': '0.202', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '50.000'} [2024-08-06 01:07:49,469][52663] DAMAGECOUNT value on done: 166384.0 [2024-08-06 01:07:49,469][52663] Sum rewards: 52.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.452', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '46.500'} [2024-08-06 01:07:49,529][52650] Updated weights for policy 0, policy_version 27981 (0.0015) [2024-08-06 01:07:49,641][52649] DAMAGECOUNT value on done: 168908.0 [2024-08-06 01:07:49,642][52649] Sum rewards: 71.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.942', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.264', 'AMMO3': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '62.000'} [2024-08-06 01:07:49,917][52671] DAMAGECOUNT value on done: 174444.0 [2024-08-06 01:07:49,918][52671] Sum rewards: 74.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.912', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '61.000'} [2024-08-06 01:07:51,217][52666] DAMAGECOUNT value on done: 165674.0 [2024-08-06 01:07:51,217][52666] Sum rewards: 61.968, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.772', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO4': '0.168', 'weapon4': '0.180', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '53.000'} [2024-08-06 01:07:51,713][52670] DAMAGECOUNT value on done: 161937.0 [2024-08-06 01:07:51,715][52670] Sum rewards: 74.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.689', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.115', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.794', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '64.000'} [2024-08-06 01:07:51,896][52663] DAMAGECOUNT value on done: 176611.0 [2024-08-06 01:07:51,898][52663] Sum rewards: 61.406, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.041', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon4': '0.362', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '52.000'} [2024-08-06 01:07:52,600][52649] DAMAGECOUNT value on done: 167214.0 [2024-08-06 01:07:52,601][52649] Sum rewards: 42.838, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.006', 'weapon5': '0.036', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'AMMO4': '0.221', 'weapon2': '0.406', 'weapon4': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '2.896', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '39.500'} [2024-08-06 01:07:52,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17411.4). Total num frames: 229277696. Throughput: 0: 4401.1. Samples: 57322620. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:07:52,795][52567] Avg episode reward: [(0, '59.646')] [2024-08-06 01:07:53,097][52671] DAMAGECOUNT value on done: 172647.0 [2024-08-06 01:07:53,099][52671] Sum rewards: 63.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.352', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '54.000'} [2024-08-06 01:07:53,832][52659] DAMAGECOUNT value on done: 170802.0 [2024-08-06 01:07:53,834][52659] Sum rewards: 53.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.110', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.350', 'weapon4': '0.476', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '45.000'} [2024-08-06 01:07:54,144][52666] DAMAGECOUNT value on done: 167331.0 [2024-08-06 01:07:54,146][52666] Sum rewards: 55.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.438', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.179', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '45.000'} [2024-08-06 01:07:54,422][52650] Updated weights for policy 0, policy_version 27991 (0.0012) [2024-08-06 01:07:54,486][52670] DAMAGECOUNT value on done: 170238.0 [2024-08-06 01:07:54,497][52670] Sum rewards: 68.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.368', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.156', 'AMMO3': '0.160', 'AMMO4': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.554', 'weapon4': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.424', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:54,671][52663] DAMAGECOUNT value on done: 170672.0 [2024-08-06 01:07:54,672][52663] Sum rewards: 73.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.660', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.086', 'weapon5': '0.090', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '59.500'} [2024-08-06 01:07:54,997][52649] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 01:07:55,468][52649] DAMAGECOUNT value on done: 160204.0 [2024-08-06 01:07:55,470][52649] Sum rewards: 58.124, reward structure: {'DEATHCOUNT': '-9.750', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.127', 'AMMO4': '0.128', 'weapon4': '0.160', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.418', 'WEAPON3': '0.750', 'weapon2': '1.134', 'weapon3': '2.278', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '46.000'} [2024-08-06 01:07:55,736][52647] DAMAGECOUNT value on done: 181017.0 [2024-08-06 01:07:55,736][52647] Sum rewards: 59.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.214', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.158', 'AMMO3': '0.178', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '49.000'} [2024-08-06 01:07:56,529][52671] DAMAGECOUNT value on done: 170719.0 [2024-08-06 01:07:56,530][52671] Sum rewards: 63.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.415', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.072', 'weapon5': '0.090', 'AMMO4': '0.108', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '55.500'} [2024-08-06 01:07:56,729][52670] DAMAGECOUNT value on done: 173094.0 [2024-08-06 01:07:56,731][52670] Sum rewards: 69.794, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.452', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.038', 'AMMO4': '0.104', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '60.000'} [2024-08-06 01:07:57,128][52659] DAMAGECOUNT value on done: 171518.0 [2024-08-06 01:07:57,129][52659] Sum rewards: 53.978, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.938', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.124', 'AMMO4': '0.191', 'weapon5': '0.206', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '2.782', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '48.500'} [2024-08-06 01:07:57,507][52663] DAMAGECOUNT value on done: 170523.0 [2024-08-06 01:07:57,507][52663] Sum rewards: 59.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.085', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.180', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon4': '0.338', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 229367808. Throughput: 0: 4396.9. Samples: 57349020. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:07:57,794][52567] Avg episode reward: [(0, '59.760')] [2024-08-06 01:07:58,143][52649] DAMAGECOUNT value on done: 167760.0 [2024-08-06 01:07:58,151][52649] Sum rewards: 55.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon4': '0.024', 'weapon5': '0.040', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.298', 'WEAPON3': '1.650', 'HITCOUNT': '3.280', 'weapon3': '3.430', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '50.000'} [2024-08-06 01:07:58,449][52665] DAMAGECOUNT value on done: 168400.0 [2024-08-06 01:07:58,449][52665] Sum rewards: 66.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'ARMOR': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'AMMO4': '0.094', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2024-08-06 01:07:58,713][52647] DAMAGECOUNT value on done: 178838.0 [2024-08-06 01:07:58,713][52647] Sum rewards: 59.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.616', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.088', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon4': '0.328', 'WEAPON4': '0.550', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '51.000'} [2024-08-06 01:07:58,931][52650] Updated weights for policy 0, policy_version 28001 (0.0025) [2024-08-06 01:07:59,051][52671] DAMAGECOUNT value on done: 179327.0 [2024-08-06 01:07:59,053][52671] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.666', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.266', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '57.000'} [2024-08-06 01:07:59,291][52670] DAMAGECOUNT value on done: 169560.0 [2024-08-06 01:07:59,292][52670] Sum rewards: 57.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.144', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.352', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '48.000'} [2024-08-06 01:07:59,888][52659] DAMAGECOUNT value on done: 171505.0 [2024-08-06 01:07:59,889][52659] Sum rewards: 66.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.089', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.138', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:00,358][52663] DAMAGECOUNT value on done: 169487.0 [2024-08-06 01:08:00,359][52663] Sum rewards: 49.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.022', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.051', 'weapon5': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'weapon4': '0.326', 'weapon2': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.384', 'FRAGCOUNT': '45.000'} [2024-08-06 01:08:01,047][52649] DAMAGECOUNT value on done: 164994.0 [2024-08-06 01:08:01,048][52649] Sum rewards: 67.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.485', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.282', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '58.000'} [2024-08-06 01:08:01,367][52647] DAMAGECOUNT value on done: 180763.0 [2024-08-06 01:08:01,369][52647] Sum rewards: 53.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.312', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.232', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '3.106', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '46.000'} [2024-08-06 01:08:01,434][52665] DAMAGECOUNT value on done: 172992.0 [2024-08-06 01:08:01,435][52665] Sum rewards: 63.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.984', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.330', 'weapon4': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '52.000'} [2024-08-06 01:08:02,321][52671] DAMAGECOUNT value on done: 171283.0 [2024-08-06 01:08:02,321][52671] Sum rewards: 64.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.878', 'AMMO5': '0.007', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '56.000'} [2024-08-06 01:08:02,445][52670] DAMAGECOUNT value on done: 168616.0 [2024-08-06 01:08:02,446][52670] Sum rewards: 51.639, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.318', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.125', 'weapon5': '0.176', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.670', 'WEAPON3': '0.800', 'weapon3': '2.498', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '41.000'} [2024-08-06 01:08:02,590][52663] DAMAGECOUNT value on done: 173161.0 [2024-08-06 01:08:02,590][52663] Sum rewards: 60.987, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.147', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.362', 'weapon2': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 229449728. Throughput: 0: 4392.7. Samples: 57362190. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:08:02,795][52567] Avg episode reward: [(0, '59.904')] [2024-08-06 01:08:03,026][52659] DAMAGECOUNT value on done: 172429.0 [2024-08-06 01:08:03,028][52659] Sum rewards: 67.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.282', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon4': '0.170', 'AMMO4': '0.211', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '58.000'} [2024-08-06 01:08:03,174][52650] Updated weights for policy 0, policy_version 28011 (0.0016) [2024-08-06 01:08:04,076][52649] DAMAGECOUNT value on done: 171182.0 [2024-08-06 01:08:04,076][52649] Sum rewards: 59.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.187', 'weapon4': '0.390', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.050', 'weapon3': '2.940', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:04,239][52647] DAMAGECOUNT value on done: 181513.0 [2024-08-06 01:08:04,241][52647] Sum rewards: 42.949, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.796', 'ARMOR': '0.016', 'AMMO5': '0.020', 'AMMO2': '0.070', 'weapon5': '0.102', 'AMMO3': '0.219', 'weapon4': '0.320', 'AMMO4': '0.349', 'weapon2': '0.356', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '2.982', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '40.000'} [2024-08-06 01:08:04,591][52665] DAMAGECOUNT value on done: 167585.0 [2024-08-06 01:08:04,592][52665] Sum rewards: 55.325, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.754', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.134', 'weapon5': '0.148', 'AMMO4': '0.162', 'WEAPON5': '0.300', 'weapon4': '0.438', 'WEAPON4': '0.450', 'weapon2': '0.514', 'WEAPON3': '0.900', 'weapon3': '2.600', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '44.000'} [2024-08-06 01:08:05,147][52671] DAMAGECOUNT value on done: 167356.0 [2024-08-06 01:08:05,148][52671] Sum rewards: 69.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.266', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.100', 'weapon5': '0.186', 'AMMO3': '0.208', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 01:08:05,276][52663] DAMAGECOUNT value on done: 172107.0 [2024-08-06 01:08:05,277][52663] Sum rewards: 62.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.462', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.162', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '53.000'} [2024-08-06 01:08:05,834][52659] DAMAGECOUNT value on done: 169779.0 [2024-08-06 01:08:05,834][52659] Sum rewards: 61.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon2': '0.356', 'weapon4': '0.402', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:06,945][52647] DAMAGECOUNT value on done: 181531.0 [2024-08-06 01:08:06,948][52647] Sum rewards: 64.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.452', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.055', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.290', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '56.000'} [2024-08-06 01:08:07,012][52649] DAMAGECOUNT value on done: 169743.0 [2024-08-06 01:08:07,015][52649] Sum rewards: 60.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.924', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'AMMO4': '0.240', 'weapon4': '0.434', 'WEAPON4': '0.500', 'weapon2': '0.724', 'WEAPON3': '1.200', 'weapon3': '2.510', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '51.000'} [2024-08-06 01:08:07,453][52665] DAMAGECOUNT value on done: 163563.0 [2024-08-06 01:08:07,454][52665] Sum rewards: 54.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.527', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.108', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '46.000'} [2024-08-06 01:08:07,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 229531648. Throughput: 0: 4392.9. Samples: 57388560. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:08:07,795][52567] Avg episode reward: [(0, '60.128')] [2024-08-06 01:08:07,999][52663] DAMAGECOUNT value on done: 169841.0 [2024-08-06 01:08:07,999][52663] Sum rewards: 56.935, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.736', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.112', 'AMMO4': '0.165', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.466', 'weapon2': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '48.000'} [2024-08-06 01:08:08,179][52671] DAMAGECOUNT value on done: 175393.0 [2024-08-06 01:08:08,179][52671] Sum rewards: 63.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.116', 'AMMO3': '0.237', 'weapon5': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.180', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '54.000'} [2024-08-06 01:08:08,181][52650] Updated weights for policy 0, policy_version 28021 (0.0026) [2024-08-06 01:08:08,818][52659] DAMAGECOUNT value on done: 169233.0 [2024-08-06 01:08:08,818][52659] Sum rewards: 62.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.854', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.116', 'weapon4': '0.134', 'AMMO3': '0.169', 'AMMO4': '0.230', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.226', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2024-08-06 01:08:09,206][52660] Large shaping reward 2.615 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('HEALTH', -0.006, -2.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:08:09,468][52647] DAMAGECOUNT value on done: 182820.0 [2024-08-06 01:08:09,468][52647] Sum rewards: 43.918, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.730', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.134', 'weapon5': '0.154', 'AMMO4': '0.161', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.750', 'HITCOUNT': '2.820', 'weapon3': '2.922', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '41.500'} [2024-08-06 01:08:10,032][52649] DAMAGECOUNT value on done: 173318.0 [2024-08-06 01:08:10,034][52649] Sum rewards: 65.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.415', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.218', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2024-08-06 01:08:10,348][52665] DAMAGECOUNT value on done: 165739.0 [2024-08-06 01:08:10,349][52665] Sum rewards: 58.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.020', 'ARMOR': '0.036', 'AMMO2': '0.065', 'AMMO3': '0.169', 'weapon5': '0.266', 'AMMO4': '0.327', 'weapon2': '0.388', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.462', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '47.500'} [2024-08-06 01:08:10,755][52663] DAMAGECOUNT value on done: 165500.0 [2024-08-06 01:08:10,757][52663] Sum rewards: 68.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.086', 'weapon5': '0.112', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '58.000'} [2024-08-06 01:08:10,858][52671] DAMAGECOUNT value on done: 174444.0 [2024-08-06 01:08:10,858][52671] Sum rewards: 65.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.476', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.224', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2024-08-06 01:08:11,486][52659] DAMAGECOUNT value on done: 170318.0 [2024-08-06 01:08:11,488][52659] Sum rewards: 48.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.601', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.209', 'weapon4': '0.214', 'AMMO3': '0.248', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.050', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '43.000'} [2024-08-06 01:08:12,508][52647] DAMAGECOUNT value on done: 178530.0 [2024-08-06 01:08:12,509][52647] Sum rewards: 61.406, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.926', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:12,759][52650] Updated weights for policy 0, policy_version 28031 (0.0012) [2024-08-06 01:08:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17411.5). Total num frames: 229629952. Throughput: 0: 4398.4. Samples: 57415140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:08:12,794][52567] Avg episode reward: [(0, '60.022')] [2024-08-06 01:08:13,262][52671] DAMAGECOUNT value on done: 174337.0 [2024-08-06 01:08:13,263][52671] Sum rewards: 65.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.206', 'weapon2': '0.372', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.416', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:13,367][52665] DAMAGECOUNT value on done: 168563.0 [2024-08-06 01:08:13,367][52665] Sum rewards: 63.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.002', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.144', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.684', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '51.000'} [2024-08-06 01:08:13,676][52659] DAMAGECOUNT value on done: 165782.0 [2024-08-06 01:08:13,677][52659] Sum rewards: 48.337, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.092', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.304', 'weapon2': '0.546', 'WEAPON3': '0.850', 'weapon3': '2.650', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '37.500'} [2024-08-06 01:08:13,888][52663] DAMAGECOUNT value on done: 163585.0 [2024-08-06 01:08:13,888][52663] Sum rewards: 49.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.270', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.282', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '41.000'} [2024-08-06 01:08:15,135][52647] DAMAGECOUNT value on done: 179586.0 [2024-08-06 01:08:15,136][52647] Sum rewards: 51.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.943', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO3': '0.154', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '42.000'} [2024-08-06 01:08:15,535][52664] DAMAGECOUNT value on done: 177297.0 [2024-08-06 01:08:15,535][52664] Sum rewards: 51.054, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.522', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.256', 'weapon2': '0.594', 'WEAPON3': '1.600', 'weapon3': '2.964', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '48.000'} [2024-08-06 01:08:15,639][52671] DAMAGECOUNT value on done: 173411.0 [2024-08-06 01:08:15,639][52671] Sum rewards: 53.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.272', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.104', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '2.940', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:16,224][52659] DAMAGECOUNT value on done: 173429.0 [2024-08-06 01:08:16,225][52659] Sum rewards: 71.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.144', 'weapon5': '0.156', 'AMMO4': '0.156', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '56.000'} [2024-08-06 01:08:16,480][52665] DAMAGECOUNT value on done: 169235.0 [2024-08-06 01:08:16,482][52665] Sum rewards: 76.711, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.312', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 01:08:17,036][52663] DAMAGECOUNT value on done: 171561.0 [2024-08-06 01:08:17,038][52663] Sum rewards: 45.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon4': '0.132', 'weapon5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.742', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.780', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '38.500'} [2024-08-06 01:08:17,486][52650] Updated weights for policy 0, policy_version 28041 (0.0012) [2024-08-06 01:08:17,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 229720064. Throughput: 0: 4399.8. Samples: 57428270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:08:17,795][52567] Avg episode reward: [(0, '59.896')] [2024-08-06 01:08:17,960][52647] DAMAGECOUNT value on done: 182217.0 [2024-08-06 01:08:17,961][52647] Sum rewards: 62.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.652', 'ARMOR': '0.004', 'AMMO2': '0.026', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.176', 'AMMO3': '0.182', 'weapon4': '0.784', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '51.000'} [2024-08-06 01:08:18,169][52671] DAMAGECOUNT value on done: 171262.0 [2024-08-06 01:08:18,170][52671] Sum rewards: 53.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.228', 'weapon3': '2.396', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '44.000'} [2024-08-06 01:08:18,548][52664] DAMAGECOUNT value on done: 176779.0 [2024-08-06 01:08:18,548][52664] Sum rewards: 45.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.336', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon4': '0.272', 'weapon2': '0.386', 'WEAPON3': '1.300', 'HITCOUNT': '2.550', 'weapon3': '2.968', 'DAMAGECOUNT': '12.312', 'FRAGCOUNT': '40.000'} [2024-08-06 01:08:18,895][52659] DAMAGECOUNT value on done: 173877.0 [2024-08-06 01:08:18,897][52659] Sum rewards: 65.689, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.067', 'AMMO3': '0.155', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '3.200', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '53.000'} [2024-08-06 01:08:19,521][52665] DAMAGECOUNT value on done: 171664.0 [2024-08-06 01:08:19,521][52665] Sum rewards: 55.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.356', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.186', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.348', 'weapon4': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '45.000'} [2024-08-06 01:08:20,167][52663] DAMAGECOUNT value on done: 171366.0 [2024-08-06 01:08:20,175][52663] Sum rewards: 46.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.051', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon5': '0.268', 'weapon4': '0.396', 'ARMOR': '0.452', 'WEAPON5': '0.500', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.442', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '38.000'} [2024-08-06 01:08:20,511][52647] DAMAGECOUNT value on done: 177383.0 [2024-08-06 01:08:20,513][52647] Sum rewards: 62.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.275', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.124', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:20,912][52664] DAMAGECOUNT value on done: 178994.0 [2024-08-06 01:08:20,913][52664] Sum rewards: 57.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '3.166', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '48.000'} [2024-08-06 01:08:21,560][52659] DAMAGECOUNT value on done: 169474.0 [2024-08-06 01:08:21,561][52659] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.312', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.146', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.220', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '60.000'} [2024-08-06 01:08:22,252][52650] Updated weights for policy 0, policy_version 28051 (0.0034) [2024-08-06 01:08:22,333][52665] DAMAGECOUNT value on done: 174493.0 [2024-08-06 01:08:22,333][52665] Sum rewards: 59.001, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.847', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.138', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'AMMO3': '0.271', 'weapon2': '0.316', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.766', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '51.000'} [2024-08-06 01:08:22,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17612.7, 300 sec: 17411.4). Total num frames: 229801984. Throughput: 0: 4396.9. Samples: 57454730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:08:22,795][52567] Avg episode reward: [(0, '59.599')] [2024-08-06 01:08:22,883][52663] DAMAGECOUNT value on done: 173522.0 [2024-08-06 01:08:22,883][52663] Sum rewards: 50.957, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.928', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.120', 'AMMO4': '0.171', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.600', 'HITCOUNT': '2.890', 'weapon3': '2.970', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:22,920][52665] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.069, -23.0), ('weapon5', 0.002)] [2024-08-06 01:08:23,412][52647] DAMAGECOUNT value on done: 178342.0 [2024-08-06 01:08:23,414][52647] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon2': '0.468', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.204', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '50.000'} [2024-08-06 01:08:23,906][52664] DAMAGECOUNT value on done: 176156.0 [2024-08-06 01:08:23,908][52664] Sum rewards: 59.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO3': '0.232', 'weapon2': '0.664', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '52.000'} [2024-08-06 01:08:24,366][52659] DAMAGECOUNT value on done: 166075.0 [2024-08-06 01:08:24,366][52659] Sum rewards: 61.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.664', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.136', 'weapon4': '0.182', 'AMMO4': '0.185', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '53.000'} [2024-08-06 01:08:25,405][52665] DAMAGECOUNT value on done: 170080.0 [2024-08-06 01:08:25,413][52665] Sum rewards: 59.476, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.332', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.045', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '50.000'} [2024-08-06 01:08:25,833][52647] DAMAGECOUNT value on done: 176682.0 [2024-08-06 01:08:25,833][52647] Sum rewards: 67.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.316', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:26,191][52663] DAMAGECOUNT value on done: 173369.0 [2024-08-06 01:08:26,191][52663] Sum rewards: 64.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.892', 'AMMO5': '0.004', 'ARMOR': '0.004', 'weapon5': '0.038', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'AMMO4': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.616', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:26,437][52650] Updated weights for policy 0, policy_version 28061 (0.0027) [2024-08-06 01:08:26,506][52664] DAMAGECOUNT value on done: 177219.0 [2024-08-06 01:08:26,507][52664] Sum rewards: 53.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.528', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.191', 'weapon5': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.320', 'weapon4': '0.598', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.522', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '46.000'} [2024-08-06 01:08:27,366][52659] DAMAGECOUNT value on done: 163961.0 [2024-08-06 01:08:27,367][52659] Sum rewards: 58.302, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.100', 'AMMO3': '0.153', 'weapon4': '0.198', 'WEAPON4': '0.200', 'HEALTH': '0.450', 'weapon2': '0.504', 'WEAPON3': '0.850', 'HITCOUNT': '2.920', 'weapon3': '3.050', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '46.000'} [2024-08-06 01:08:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17411.5). Total num frames: 229892096. Throughput: 0: 4397.8. Samples: 57480940. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:08:27,795][52567] Avg episode reward: [(0, '59.675')] [2024-08-06 01:08:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028063_229892096.pth... [2024-08-06 01:08:27,917][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027554_225722368.pth [2024-08-06 01:08:28,032][52665] DAMAGECOUNT value on done: 172269.0 [2024-08-06 01:08:28,033][52665] Sum rewards: 62.713, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.158', 'weapon5': '0.198', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '50.000'} [2024-08-06 01:08:28,973][52647] DAMAGECOUNT value on done: 180303.0 [2024-08-06 01:08:28,973][52647] Sum rewards: 55.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon4': '0.346', 'weapon2': '0.534', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:29,410][52663] DAMAGECOUNT value on done: 172605.0 [2024-08-06 01:08:29,414][52663] Sum rewards: 70.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.997', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.074', 'AMMO4': '0.091', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '58.000'} [2024-08-06 01:08:29,598][52664] DAMAGECOUNT value on done: 181165.0 [2024-08-06 01:08:29,598][52664] Sum rewards: 81.153, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.211', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.130', 'weapon2': '0.434', 'WEAPON3': '0.850', 'weapon3': '3.408', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '64.000'} [2024-08-06 01:08:30,154][52659] DAMAGECOUNT value on done: 170408.0 [2024-08-06 01:08:30,156][52659] Sum rewards: 52.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.739', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.078', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '44.000'} [2024-08-06 01:08:31,343][52665] DAMAGECOUNT value on done: 172216.0 [2024-08-06 01:08:31,343][52665] Sum rewards: 58.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.732', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.184', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:31,588][52647] DAMAGECOUNT value on done: 179385.0 [2024-08-06 01:08:31,589][52647] Sum rewards: 68.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'weapon4': '0.210', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.000'} [2024-08-06 01:08:31,826][52650] Updated weights for policy 0, policy_version 28071 (0.0011) [2024-08-06 01:08:32,161][52664] DAMAGECOUNT value on done: 181543.0 [2024-08-06 01:08:32,164][52664] Sum rewards: 56.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.038', 'AMMO4': '0.166', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.392', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:32,542][52663] DAMAGECOUNT value on done: 167890.0 [2024-08-06 01:08:32,545][52663] Sum rewards: 62.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.052', 'AMMO2': '0.038', 'weapon4': '0.174', 'AMMO3': '0.188', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.992', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '52.000'} [2024-08-06 01:08:32,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 229982208. Throughput: 0: 4391.8. Samples: 57493930. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:08:32,794][52567] Avg episode reward: [(0, '60.162')] [2024-08-06 01:08:32,934][52659] DAMAGECOUNT value on done: 170982.0 [2024-08-06 01:08:32,935][52659] Sum rewards: 54.732, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.255', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.278', 'weapon2': '0.420', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.230', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:34,048][52665] DAMAGECOUNT value on done: 169607.0 [2024-08-06 01:08:34,049][52665] Sum rewards: 58.030, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.400', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.126', 'weapon5': '0.134', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.318', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.178', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '53.000'} [2024-08-06 01:08:34,438][52647] DAMAGECOUNT value on done: 179398.0 [2024-08-06 01:08:34,438][52647] Sum rewards: 57.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.181', 'weapon2': '0.316', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '2.992', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:35,220][52664] DAMAGECOUNT value on done: 172139.0 [2024-08-06 01:08:35,224][52664] Sum rewards: 61.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.823', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.257', 'weapon2': '0.480', 'WEAPON3': '1.700', 'weapon3': '3.258', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '56.000'} [2024-08-06 01:08:35,752][52650] Updated weights for policy 0, policy_version 28081 (0.0033) [2024-08-06 01:08:35,871][52659] DAMAGECOUNT value on done: 174117.0 [2024-08-06 01:08:35,871][52659] Sum rewards: 51.772, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.133', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.159', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.454', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '45.500'} [2024-08-06 01:08:36,746][52665] DAMAGECOUNT value on done: 168832.0 [2024-08-06 01:08:36,748][52665] Sum rewards: 57.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.469', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.162', 'weapon5': '0.162', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '2.998', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '48.000'} [2024-08-06 01:08:37,529][52647] DAMAGECOUNT value on done: 178887.0 [2024-08-06 01:08:37,529][52647] Sum rewards: 54.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.208', 'weapon2': '0.288', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.318', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17613.1, 300 sec: 17411.5). Total num frames: 230064128. Throughput: 0: 4394.3. Samples: 57520360. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:08:37,795][52567] Avg episode reward: [(0, '59.866')] [2024-08-06 01:08:37,958][52795] DAMAGECOUNT value on done: 156931.0 [2024-08-06 01:08:37,959][52795] Sum rewards: 48.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.541', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO3': '0.280', 'weapon2': '0.412', 'WEAPON3': '1.750', 'HITCOUNT': '2.990', 'weapon3': '3.300', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '46.000'} [2024-08-06 01:08:38,370][52664] DAMAGECOUNT value on done: 186748.0 [2024-08-06 01:08:38,371][52664] Sum rewards: 55.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.275', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon2': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.254', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.216', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '51.000'} [2024-08-06 01:08:38,824][52659] DAMAGECOUNT value on done: 173847.0 [2024-08-06 01:08:38,824][52659] Sum rewards: 64.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.169', 'weapon4': '0.184', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.050', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '54.000'} [2024-08-06 01:08:39,260][52665] DAMAGECOUNT value on done: 169530.0 [2024-08-06 01:08:39,261][52665] Sum rewards: 57.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.112', 'AMMO4': '0.186', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON4': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:40,631][52647] DAMAGECOUNT value on done: 175580.0 [2024-08-06 01:08:40,634][52647] Sum rewards: 54.808, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.242', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:40,867][52650] Updated weights for policy 0, policy_version 28091 (0.0011) [2024-08-06 01:08:41,085][52795] DAMAGECOUNT value on done: 154368.0 [2024-08-06 01:08:41,085][52795] Sum rewards: 59.437, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.170', 'AMMO4': '0.235', 'weapon4': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.670', 'WEAPON3': '1.600', 'weapon3': '2.662', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2024-08-06 01:08:41,466][52659] DAMAGECOUNT value on done: 169351.0 [2024-08-06 01:08:41,467][52659] Sum rewards: 60.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.166', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.086', 'weapon5': '0.086', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon2': '0.372', 'WEAPON3': '0.950', 'HITCOUNT': '2.800', 'weapon3': '3.292', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:41,509][52664] DAMAGECOUNT value on done: 181724.0 [2024-08-06 01:08:41,509][52664] Sum rewards: 57.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.450', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:41,864][52665] DAMAGECOUNT value on done: 167502.0 [2024-08-06 01:08:41,866][52665] Sum rewards: 62.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.202', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '52.000'} [2024-08-06 01:08:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17439.3). Total num frames: 230154240. Throughput: 0: 4399.6. Samples: 57547000. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:08:42,794][52567] Avg episode reward: [(0, '59.349')] [2024-08-06 01:08:43,722][52647] DAMAGECOUNT value on done: 178968.0 [2024-08-06 01:08:43,722][52647] Sum rewards: 61.856, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.322', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '55.000'} [2024-08-06 01:08:44,142][52795] DAMAGECOUNT value on done: 157030.0 [2024-08-06 01:08:44,143][52795] Sum rewards: 57.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.024', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.726', 'WEAPON3': '1.550', 'weapon3': '2.848', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '50.000'} [2024-08-06 01:08:44,577][52659] DAMAGECOUNT value on done: 175606.0 [2024-08-06 01:08:44,577][52659] Sum rewards: 64.498, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.186', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.146', 'AMMO3': '0.219', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'weapon2': '0.460', 'weapon4': '0.476', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.598', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '57.000'} [2024-08-06 01:08:44,581][52664] DAMAGECOUNT value on done: 181410.0 [2024-08-06 01:08:44,582][52664] Sum rewards: 61.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.086', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '51.000'} [2024-08-06 01:08:44,726][52665] DAMAGECOUNT value on done: 168862.0 [2024-08-06 01:08:44,726][52665] Sum rewards: 55.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.175', 'AMMO4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.000', 'weapon3': '2.488', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:45,363][52650] Updated weights for policy 0, policy_version 28101 (0.0051) [2024-08-06 01:08:46,317][52647] DAMAGECOUNT value on done: 173815.0 [2024-08-06 01:08:46,317][52647] Sum rewards: 57.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.918', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.458', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.210', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:47,153][52664] DAMAGECOUNT value on done: 176232.0 [2024-08-06 01:08:47,153][52664] Sum rewards: 53.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.428', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.088', 'AMMO4': '0.209', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.374', 'WEAPON4': '0.450', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:47,162][52795] DAMAGECOUNT value on done: 157649.0 [2024-08-06 01:08:47,163][52795] Sum rewards: 56.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.884', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.160', 'weapon5': '0.206', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'weapon2': '0.444', 'weapon4': '0.458', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.636', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:47,398][52665] DAMAGECOUNT value on done: 164635.0 [2024-08-06 01:08:47,399][52665] Sum rewards: 58.236, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.057', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.246', 'AMMO4': '0.285', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '52.000'} [2024-08-06 01:08:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 230244352. Throughput: 0: 4404.5. Samples: 57560390. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:08:47,794][52567] Avg episode reward: [(0, '59.251')] [2024-08-06 01:08:47,795][52659] DAMAGECOUNT value on done: 174854.0 [2024-08-06 01:08:47,797][52659] Sum rewards: 53.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.046', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'AMMO4': '0.228', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '45.000'} [2024-08-06 01:08:49,322][52647] DAMAGECOUNT value on done: 180592.0 [2024-08-06 01:08:49,323][52647] Sum rewards: 62.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.187', 'weapon2': '0.226', 'WEAPON4': '0.500', 'weapon4': '0.762', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '52.000'} [2024-08-06 01:08:49,819][52650] Updated weights for policy 0, policy_version 28111 (0.0012) [2024-08-06 01:08:49,846][52665] DAMAGECOUNT value on done: 171603.0 [2024-08-06 01:08:49,846][52665] Sum rewards: 60.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.912', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.164', 'AMMO4': '0.179', 'AMMO3': '0.207', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:50,243][52795] DAMAGECOUNT value on done: 161802.0 [2024-08-06 01:08:50,245][52795] Sum rewards: 48.641, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.940', 'ARMOR': '0.004', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.311', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '3.090', 'weapon3': '3.150', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '46.000'} [2024-08-06 01:08:50,290][52664] DAMAGECOUNT value on done: 174675.0 [2024-08-06 01:08:50,290][52664] Sum rewards: 54.354, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.674', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.276', 'AMMO3': '0.288', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.650', 'weapon3': '2.782', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:50,406][52668] DAMAGECOUNT value on done: 170283.0 [2024-08-06 01:08:50,407][52668] Sum rewards: 51.427, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.192', 'weapon4': '0.194', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.072', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '44.000'} [2024-08-06 01:08:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 230334464. Throughput: 0: 4398.0. Samples: 57586470. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:08:52,794][52567] Avg episode reward: [(0, '58.872')] [2024-08-06 01:08:52,816][52665] DAMAGECOUNT value on done: 167509.0 [2024-08-06 01:08:52,816][52665] Sum rewards: 60.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.170', 'AMMO3': '0.184', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '50.500'} [2024-08-06 01:08:52,956][52664] DAMAGECOUNT value on done: 178031.0 [2024-08-06 01:08:52,957][52664] Sum rewards: 58.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.267', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.138', 'AMMO3': '0.216', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.454', 'weapon4': '0.458', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.656', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '53.000'} [2024-08-06 01:08:53,311][52795] DAMAGECOUNT value on done: 157685.0 [2024-08-06 01:08:53,312][52795] Sum rewards: 61.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.160', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO3': '0.157', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.330', 'WEAPON4': '0.450', 'weapon2': '0.694', 'WEAPON3': '0.850', 'weapon3': '2.614', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '48.000'} [2024-08-06 01:08:53,633][52668] DAMAGECOUNT value on done: 178125.0 [2024-08-06 01:08:53,634][52668] Sum rewards: 51.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.194', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.186', 'weapon5': '0.200', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.550', 'weapon4': '0.824', 'WEAPON3': '1.050', 'weapon3': '2.340', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '44.000'} [2024-08-06 01:08:54,522][52650] Updated weights for policy 0, policy_version 28121 (0.0023) [2024-08-06 01:08:55,979][52664] DAMAGECOUNT value on done: 179714.0 [2024-08-06 01:08:55,980][52664] Sum rewards: 59.040, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.252', 'weapon2': '0.340', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.274', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:56,418][52795] DAMAGECOUNT value on done: 163701.0 [2024-08-06 01:08:56,418][52795] Sum rewards: 66.459, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.272', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.254', 'AMMO3': '0.278', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.160', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 01:08:56,732][52668] DAMAGECOUNT value on done: 173597.0 [2024-08-06 01:08:56,732][52668] Sum rewards: 57.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.166', 'AMMO4': '0.215', 'AMMO3': '0.223', 'WEAPON5': '0.350', 'weapon2': '0.416', 'weapon4': '0.424', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.720', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '49.000'} [2024-08-06 01:08:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.3). Total num frames: 230424576. Throughput: 0: 4399.3. Samples: 57613110. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:08:57,794][52567] Avg episode reward: [(0, '58.799')] [2024-08-06 01:08:58,961][52664] DAMAGECOUNT value on done: 175436.0 [2024-08-06 01:08:58,964][52664] Sum rewards: 54.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon4': '0.148', 'AMMO4': '0.166', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.208', 'DAMAGECOUNT': '13.422', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:59,375][52795] DAMAGECOUNT value on done: 160287.0 [2024-08-06 01:08:59,375][52795] Sum rewards: 57.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.162', 'weapon5': '0.206', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.588', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '47.000'} [2024-08-06 01:08:59,444][52668] DAMAGECOUNT value on done: 174224.0 [2024-08-06 01:08:59,447][52668] Sum rewards: 73.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.016', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.298', 'weapon4': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '60.000'} [2024-08-06 01:08:59,461][52650] Updated weights for policy 0, policy_version 28131 (0.0011) [2024-08-06 01:09:00,725][52820] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:09:01,274][52662] DAMAGECOUNT value on done: 176436.0 [2024-08-06 01:09:01,274][52662] Sum rewards: 61.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.226', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.164', 'AMMO3': '0.186', 'weapon2': '0.348', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:01,595][52664] DAMAGECOUNT value on done: 179100.0 [2024-08-06 01:09:01,595][52664] Sum rewards: 51.948, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.278', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.172', 'AMMO3': '0.177', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'weapon4': '0.374', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.804', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '43.000'} [2024-08-06 01:09:02,514][52795] DAMAGECOUNT value on done: 157844.0 [2024-08-06 01:09:02,515][52795] Sum rewards: 59.438, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.048', 'AMMO3': '0.118', 'weapon5': '0.174', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon2': '0.900', 'weapon3': '2.312', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:02,584][52668] DAMAGECOUNT value on done: 170333.0 [2024-08-06 01:09:02,586][52668] Sum rewards: 55.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.142', 'AMMO3': '0.188', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '46.000'} [2024-08-06 01:09:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17411.5). Total num frames: 230506496. Throughput: 0: 4403.8. Samples: 57626440. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 01:09:02,794][52567] Avg episode reward: [(0, '58.829')] [2024-08-06 01:09:03,886][52650] Updated weights for policy 0, policy_version 28141 (0.0028) [2024-08-06 01:09:04,422][52662] DAMAGECOUNT value on done: 179239.0 [2024-08-06 01:09:04,424][52662] Sum rewards: 58.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.118', 'AMMO3': '0.203', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:04,759][52664] DAMAGECOUNT value on done: 180882.0 [2024-08-06 01:09:04,759][52664] Sum rewards: 57.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.322', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon4': '0.402', 'weapon2': '0.428', 'WEAPON3': '1.550', 'weapon3': '2.848', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '50.000'} [2024-08-06 01:09:05,484][52668] DAMAGECOUNT value on done: 170904.0 [2024-08-06 01:09:05,485][52668] Sum rewards: 61.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.034', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.090', 'AMMO4': '0.163', 'weapon5': '0.220', 'AMMO3': '0.231', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.140', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.000'} [2024-08-06 01:09:05,662][52795] DAMAGECOUNT value on done: 161167.0 [2024-08-06 01:09:05,665][52795] Sum rewards: 63.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:06,140][52660] DAMAGECOUNT value on done: 171117.0 [2024-08-06 01:09:06,142][52660] Sum rewards: 51.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon4': '0.194', 'weapon5': '0.194', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.940', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '44.500'} [2024-08-06 01:09:07,435][52662] DAMAGECOUNT value on done: 179530.0 [2024-08-06 01:09:07,436][52662] Sum rewards: 64.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.170', 'weapon5': '0.192', 'AMMO3': '0.198', 'weapon2': '0.216', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:07,776][52664] DAMAGECOUNT value on done: 174718.0 [2024-08-06 01:09:07,776][52664] Sum rewards: 47.800, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.226', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.063', 'AMMO3': '0.131', 'weapon5': '0.250', 'weapon2': '0.312', 'AMMO4': '0.317', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'WEAPON4': '0.900', 'weapon4': '1.344', 'weapon3': '1.788', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '11.925', 'FRAGCOUNT': '39.000'} [2024-08-06 01:09:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17411.5). Total num frames: 230596608. Throughput: 0: 4401.4. Samples: 57652790. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 01:09:07,794][52567] Avg episode reward: [(0, '58.668')] [2024-08-06 01:09:08,455][52668] DAMAGECOUNT value on done: 173896.0 [2024-08-06 01:09:08,455][52668] Sum rewards: 50.632, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.682', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.166', 'AMMO3': '0.235', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '45.000'} [2024-08-06 01:09:08,600][52650] Updated weights for policy 0, policy_version 28151 (0.0020) [2024-08-06 01:09:08,792][52795] DAMAGECOUNT value on done: 158658.0 [2024-08-06 01:09:08,792][52795] Sum rewards: 60.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.356', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.188', 'AMMO3': '0.222', 'weapon2': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:09,120][52660] DAMAGECOUNT value on done: 170192.0 [2024-08-06 01:09:09,120][52660] Sum rewards: 56.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.066', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.238', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '51.000'} [2024-08-06 01:09:10,229][52662] DAMAGECOUNT value on done: 169196.0 [2024-08-06 01:09:10,230][52662] Sum rewards: 64.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon2': '0.376', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.218', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:10,410][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:09:10,420][52664] DAMAGECOUNT value on done: 178093.0 [2024-08-06 01:09:10,421][52664] Sum rewards: 57.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.085', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.172', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '49.500'} [2024-08-06 01:09:11,415][52668] DAMAGECOUNT value on done: 176565.0 [2024-08-06 01:09:11,416][52668] Sum rewards: 50.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.286', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.070', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '3.050', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '42.000'} [2024-08-06 01:09:11,894][52795] DAMAGECOUNT value on done: 157456.0 [2024-08-06 01:09:11,895][52795] Sum rewards: 55.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.022', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.175', 'weapon4': '0.240', 'weapon2': '0.268', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.060', 'weapon3': '3.226', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:11,951][52660] DAMAGECOUNT value on done: 173045.0 [2024-08-06 01:09:11,954][52660] Sum rewards: 58.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.172', 'weapon5': '0.206', 'AMMO4': '0.251', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '48.000'} [2024-08-06 01:09:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17439.2). Total num frames: 230686720. Throughput: 0: 4403.3. Samples: 57679090. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 01:09:12,795][52567] Avg episode reward: [(0, '58.299')] [2024-08-06 01:09:12,923][52650] Updated weights for policy 0, policy_version 28161 (0.0025) [2024-08-06 01:09:13,019][52662] DAMAGECOUNT value on done: 176773.0 [2024-08-06 01:09:13,021][52662] Sum rewards: 62.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon2': '0.192', 'AMMO3': '0.222', 'weapon4': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:13,271][52667] DAMAGECOUNT value on done: 173074.0 [2024-08-06 01:09:13,273][52667] Sum rewards: 52.013, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.660', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.049', 'weapon5': '0.050', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.244', 'AMMO3': '0.316', 'weapon2': '0.406', 'WEAPON3': '1.850', 'HITCOUNT': '3.130', 'weapon3': '3.200', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:13,985][52668] DAMAGECOUNT value on done: 171923.0 [2024-08-06 01:09:13,986][52668] Sum rewards: 60.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.565', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.244', 'weapon4': '0.292', 'WEAPON4': '0.500', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.682', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:14,471][52660] DAMAGECOUNT value on done: 173663.0 [2024-08-06 01:09:14,473][52660] Sum rewards: 63.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.792', 'ARMOR': '0.004', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.235', 'weapon2': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:15,136][52795] DAMAGECOUNT value on done: 156654.0 [2024-08-06 01:09:15,136][52795] Sum rewards: 52.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.212', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '45.000'} [2024-08-06 01:09:15,850][52662] DAMAGECOUNT value on done: 175096.0 [2024-08-06 01:09:15,851][52662] Sum rewards: 59.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.766', 'ARMOR': '0.012', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon5': '0.184', 'AMMO4': '0.194', 'AMMO3': '0.219', 'weapon4': '0.262', 'weapon2': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '51.000'} [2024-08-06 01:09:16,002][52667] DAMAGECOUNT value on done: 174166.0 [2024-08-06 01:09:16,002][52667] Sum rewards: 55.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.952', 'AMMO5': '0.008', 'ARMOR': '0.018', 'AMMO2': '0.047', 'weapon5': '0.170', 'AMMO3': '0.228', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.438', 'WEAPON4': '0.500', 'weapon2': '0.744', 'WEAPON3': '1.300', 'weapon3': '2.342', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '48.000'} [2024-08-06 01:09:16,509][52668] DAMAGECOUNT value on done: 174517.0 [2024-08-06 01:09:16,510][52668] Sum rewards: 44.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.748', 'WEAPON3': '1.150', 'HITCOUNT': '2.420', 'weapon3': '2.594', 'DAMAGECOUNT': '11.760', 'FRAGCOUNT': '40.000'} [2024-08-06 01:09:16,858][52660] DAMAGECOUNT value on done: 171485.0 [2024-08-06 01:09:16,858][52660] Sum rewards: 52.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.236', 'weapon5': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.998', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '44.000'} [2024-08-06 01:09:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 230768640. Throughput: 0: 4409.6. Samples: 57692360. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 01:09:17,794][52567] Avg episode reward: [(0, '58.409')] [2024-08-06 01:09:18,015][52650] Updated weights for policy 0, policy_version 28171 (0.0012) [2024-08-06 01:09:18,487][52795] DAMAGECOUNT value on done: 159690.0 [2024-08-06 01:09:18,488][52795] Sum rewards: 67.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.125', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.062', 'AMMO3': '0.182', 'weapon4': '0.184', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '57.000'} [2024-08-06 01:09:18,695][52662] DAMAGECOUNT value on done: 177674.0 [2024-08-06 01:09:18,696][52662] Sum rewards: 59.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.211', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.278', 'weapon2': '0.278', 'weapon4': '0.372', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:18,707][52667] DAMAGECOUNT value on done: 174579.0 [2024-08-06 01:09:18,710][52667] Sum rewards: 67.273, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon4': '0.296', 'weapon2': '0.438', 'WEAPON3': '1.650', 'weapon3': '3.002', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '59.000'} [2024-08-06 01:09:18,954][52668] DAMAGECOUNT value on done: 173947.0 [2024-08-06 01:09:18,954][52668] Sum rewards: 63.980, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.046', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.476', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.216', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '53.000'} [2024-08-06 01:09:19,553][52660] DAMAGECOUNT value on done: 169568.0 [2024-08-06 01:09:19,553][52660] Sum rewards: 57.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.483', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.153', 'weapon4': '0.172', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.018', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:21,532][52658] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:09:21,744][52795] DAMAGECOUNT value on done: 156661.0 [2024-08-06 01:09:21,746][52795] Sum rewards: 59.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.072', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon5': '0.166', 'AMMO3': '0.218', 'weapon4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '50.000'} [2024-08-06 01:09:21,818][52662] DAMAGECOUNT value on done: 181747.0 [2024-08-06 01:09:21,819][52662] Sum rewards: 67.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.434', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '59.000'} [2024-08-06 01:09:22,023][52667] DAMAGECOUNT value on done: 169778.0 [2024-08-06 01:09:22,024][52667] Sum rewards: 47.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.375', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.048', 'AMMO3': '0.192', 'weapon5': '0.204', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON4': '0.650', 'weapon4': '0.784', 'WEAPON3': '1.150', 'weapon3': '2.288', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '41.000'} [2024-08-06 01:09:22,133][52794] DAMAGECOUNT value on done: 177917.0 [2024-08-06 01:09:22,133][52794] Sum rewards: 65.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.354', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '56.000'} [2024-08-06 01:09:22,245][52668] DAMAGECOUNT value on done: 170243.0 [2024-08-06 01:09:22,245][52668] Sum rewards: 53.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.820', 'AMMO5': '0.008', 'AMMO2': '0.057', 'weapon5': '0.174', 'AMMO3': '0.204', 'AMMO4': '0.287', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.432', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:22,775][52650] Updated weights for policy 0, policy_version 28181 (0.0014) [2024-08-06 01:09:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 230858752. Throughput: 0: 4404.4. Samples: 57718560. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:09:22,802][52567] Avg episode reward: [(0, '58.646')] [2024-08-06 01:09:23,024][52660] DAMAGECOUNT value on done: 174806.0 [2024-08-06 01:09:23,024][52660] Sum rewards: 65.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.218', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.211', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:24,741][52662] DAMAGECOUNT value on done: 175731.0 [2024-08-06 01:09:24,742][52662] Sum rewards: 71.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.848', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.256', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.428', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '61.000'} [2024-08-06 01:09:24,857][52795] DAMAGECOUNT value on done: 163943.0 [2024-08-06 01:09:24,857][52795] Sum rewards: 63.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.816', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon4': '0.084', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:25,013][52668] DAMAGECOUNT value on done: 164253.0 [2024-08-06 01:09:25,013][52668] Sum rewards: 55.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.228', 'ARMOR': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.420', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:25,056][52667] DAMAGECOUNT value on done: 175081.0 [2024-08-06 01:09:25,057][52667] Sum rewards: 65.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.184', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.228', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.000'} [2024-08-06 01:09:25,073][52794] DAMAGECOUNT value on done: 181005.0 [2024-08-06 01:09:25,076][52794] Sum rewards: 63.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.218', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '2.878', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '53.000'} [2024-08-06 01:09:25,513][52660] DAMAGECOUNT value on done: 173054.0 [2024-08-06 01:09:25,514][52660] Sum rewards: 74.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.934', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.176', 'weapon2': '0.840', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '60.000'} [2024-08-06 01:09:27,500][52650] Updated weights for policy 0, policy_version 28191 (0.0022) [2024-08-06 01:09:27,717][52662] DAMAGECOUNT value on done: 182139.0 [2024-08-06 01:09:27,718][52662] Sum rewards: 56.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '50.000'} [2024-08-06 01:09:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 230940672. Throughput: 0: 4398.9. Samples: 57744950. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:09:27,794][52567] Avg episode reward: [(0, '59.061')] [2024-08-06 01:09:27,901][52667] DAMAGECOUNT value on done: 176171.0 [2024-08-06 01:09:27,901][52667] Sum rewards: 58.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.420', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.302', 'WEAPON3': '1.600', 'HITCOUNT': '3.270', 'weapon3': '3.344', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '51.000'} [2024-08-06 01:09:27,982][52668] DAMAGECOUNT value on done: 169970.0 [2024-08-06 01:09:27,984][52668] Sum rewards: 44.656, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.902', 'AMMO2': '0.011', 'weapon7': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.108', 'weapon2': '0.290', 'ARMOR': '0.400', 'weapon4': '0.632', 'WEAPON3': '0.700', 'weapon3': '1.856', 'HITCOUNT': '2.290', 'DAMAGECOUNT': '10.566', 'FRAGCOUNT': '35.000'} [2024-08-06 01:09:28,007][52795] DAMAGECOUNT value on done: 164459.0 [2024-08-06 01:09:28,008][52795] Sum rewards: 65.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.365', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.176', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '0.900', 'weapon3': '2.978', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '53.000'} [2024-08-06 01:09:28,094][52794] DAMAGECOUNT value on done: 174946.0 [2024-08-06 01:09:28,094][52794] Sum rewards: 78.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.469', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.234', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '66.000'} [2024-08-06 01:09:28,480][52660] DAMAGECOUNT value on done: 173692.0 [2024-08-06 01:09:28,485][52660] Sum rewards: 59.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.655', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.051', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.232', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.502', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:30,672][52662] DAMAGECOUNT value on done: 174976.0 [2024-08-06 01:09:30,672][52662] Sum rewards: 64.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.755', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.110', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:30,826][52667] DAMAGECOUNT value on done: 176884.0 [2024-08-06 01:09:30,826][52667] Sum rewards: 55.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.795', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.400', 'weapon2': '0.572', 'weapon4': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.488', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:30,869][52669] DAMAGECOUNT value on done: 176853.0 [2024-08-06 01:09:30,869][52669] Sum rewards: 69.104, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.555', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO2': '0.057', 'AMMO3': '0.189', 'AMMO4': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '59.000'} [2024-08-06 01:09:30,875][52794] DAMAGECOUNT value on done: 173113.0 [2024-08-06 01:09:30,876][52794] Sum rewards: 62.051, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.304', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:31,048][52668] DAMAGECOUNT value on done: 168089.0 [2024-08-06 01:09:31,050][52668] Sum rewards: 45.687, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.674', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.214', 'AMMO4': '0.234', 'weapon4': '0.260', 'AMMO3': '0.301', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.708', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '43.500'} [2024-08-06 01:09:31,220][52795] DAMAGECOUNT value on done: 154721.0 [2024-08-06 01:09:31,221][52795] Sum rewards: 56.655, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.504', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.037', 'AMMO3': '0.138', 'AMMO4': '0.186', 'weapon5': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '0.750', 'weapon3': '2.594', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.558', 'FRAGCOUNT': '46.000'} [2024-08-06 01:09:31,569][52660] DAMAGECOUNT value on done: 169412.0 [2024-08-06 01:09:31,570][52660] Sum rewards: 48.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon4': '0.514', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '41.500'} [2024-08-06 01:09:31,774][52650] Updated weights for policy 0, policy_version 28201 (0.0021) [2024-08-06 01:09:32,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 231030784. Throughput: 0: 4388.4. Samples: 57757870. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:09:32,794][52567] Avg episode reward: [(0, '58.639')] [2024-08-06 01:09:33,531][52662] DAMAGECOUNT value on done: 177878.0 [2024-08-06 01:09:33,533][52662] Sum rewards: 45.270, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'AMMO3': '0.096', 'weapon5': '0.110', 'HEALTH': '0.111', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'WEAPON4': '0.400', 'WEAPON3': '0.550', 'weapon4': '0.668', 'weapon2': '0.862', 'weapon3': '2.132', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '11.439', 'FRAGCOUNT': '38.000'} [2024-08-06 01:09:33,538][52667] DAMAGECOUNT value on done: 173798.0 [2024-08-06 01:09:33,539][52667] Sum rewards: 58.765, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.487', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.169', 'AMMO3': '0.243', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:33,764][52669] DAMAGECOUNT value on done: 173145.0 [2024-08-06 01:09:33,765][52669] Sum rewards: 52.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.928', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.256', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.010', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '46.000'} [2024-08-06 01:09:33,851][52794] DAMAGECOUNT value on done: 176789.0 [2024-08-06 01:09:33,851][52794] Sum rewards: 65.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.219', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '56.000'} [2024-08-06 01:09:34,208][52668] DAMAGECOUNT value on done: 172384.0 [2024-08-06 01:09:34,210][52668] Sum rewards: 45.493, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'ARMOR': '0.016', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon5': '0.146', 'AMMO3': '0.200', 'AMMO4': '0.316', 'weapon4': '0.424', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '2.628', 'DAMAGECOUNT': '11.634', 'FRAGCOUNT': '43.000'} [2024-08-06 01:09:34,441][52795] DAMAGECOUNT value on done: 164465.0 [2024-08-06 01:09:34,442][52795] Sum rewards: 67.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.639', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon4': '0.198', 'AMMO3': '0.211', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '56.000'} [2024-08-06 01:09:34,744][52660] DAMAGECOUNT value on done: 176542.0 [2024-08-06 01:09:34,745][52660] Sum rewards: 66.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.038', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.245', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '57.000'} [2024-08-06 01:09:36,429][52667] DAMAGECOUNT value on done: 173289.0 [2024-08-06 01:09:36,429][52667] Sum rewards: 50.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.685', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon5': '0.162', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.472', 'WEAPON3': '1.500', 'weapon3': '2.838', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '45.000'} [2024-08-06 01:09:36,451][52669] DAMAGECOUNT value on done: 173221.0 [2024-08-06 01:09:36,453][52669] Sum rewards: 61.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.385', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.204', 'AMMO3': '0.223', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:36,594][52662] DAMAGECOUNT value on done: 174337.0 [2024-08-06 01:09:36,595][52662] Sum rewards: 58.087, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon4': '0.188', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '51.000'} [2024-08-06 01:09:36,877][52650] Updated weights for policy 0, policy_version 28211 (0.0022) [2024-08-06 01:09:36,958][52794] DAMAGECOUNT value on done: 174742.0 [2024-08-06 01:09:36,960][52794] Sum rewards: 54.142, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '2.844', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '48.000'} [2024-08-06 01:09:37,303][52668] DAMAGECOUNT value on done: 172922.0 [2024-08-06 01:09:37,304][52668] Sum rewards: 64.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.197', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.249', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '58.000'} [2024-08-06 01:09:37,530][52795] DAMAGECOUNT value on done: 164174.0 [2024-08-06 01:09:37,530][52795] Sum rewards: 64.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon2': '0.172', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon4': '0.540', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:37,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17749.3, 300 sec: 17439.2). Total num frames: 231129088. Throughput: 0: 4400.6. Samples: 57784500. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:09:37,795][52567] Avg episode reward: [(0, '58.798')] [2024-08-06 01:09:37,867][52660] DAMAGECOUNT value on done: 167774.0 [2024-08-06 01:09:37,867][52660] Sum rewards: 58.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.052', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.260', 'weapon4': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon2': '0.904', 'weapon3': '2.436', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:38,509][52795] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:09:39,246][52669] DAMAGECOUNT value on done: 172239.0 [2024-08-06 01:09:39,247][52669] Sum rewards: 74.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.452', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO3': '0.172', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '60.000'} [2024-08-06 01:09:39,315][52667] DAMAGECOUNT value on done: 174814.0 [2024-08-06 01:09:39,315][52667] Sum rewards: 62.876, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.090', 'weapon5': '0.104', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.512', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.138', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '51.500'} [2024-08-06 01:09:39,730][52662] DAMAGECOUNT value on done: 179689.0 [2024-08-06 01:09:39,731][52662] Sum rewards: 58.563, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.984', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.648', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:40,036][52794] DAMAGECOUNT value on done: 181315.0 [2024-08-06 01:09:40,036][52794] Sum rewards: 44.329, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.968', 'AMMO5': '0.008', 'AMMO2': '0.075', 'weapon5': '0.116', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'AMMO4': '0.375', 'weapon4': '0.388', 'weapon2': '0.622', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.524', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '42.000'} [2024-08-06 01:09:40,463][52668] DAMAGECOUNT value on done: 174379.0 [2024-08-06 01:09:40,464][52668] Sum rewards: 62.069, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.212', 'HEALTH': '0.244', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.562', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:40,908][52650] Updated weights for policy 0, policy_version 28221 (0.0038) [2024-08-06 01:09:40,940][52660] DAMAGECOUNT value on done: 172816.0 [2024-08-06 01:09:40,942][52660] Sum rewards: 59.596, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.951', 'AMMO5': '0.018', 'ARMOR': '0.024', 'AMMO2': '0.056', 'weapon5': '0.164', 'AMMO3': '0.258', 'AMMO4': '0.282', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.732', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:41,910][52669] DAMAGECOUNT value on done: 173077.0 [2024-08-06 01:09:41,911][52669] Sum rewards: 55.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.763', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.168', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.708', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '45.000'} [2024-08-06 01:09:42,043][52667] DAMAGECOUNT value on done: 176167.0 [2024-08-06 01:09:42,044][52667] Sum rewards: 65.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.214', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.094', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.424', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.814', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:42,542][52662] DAMAGECOUNT value on done: 176811.0 [2024-08-06 01:09:42,544][52662] Sum rewards: 50.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO3': '0.168', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.050', 'weapon3': '2.736', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '44.000'} [2024-08-06 01:09:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 231202816. Throughput: 0: 4396.2. Samples: 57810940. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 01:09:42,794][52567] Avg episode reward: [(0, '58.726')] [2024-08-06 01:09:42,864][52794] DAMAGECOUNT value on done: 177109.0 [2024-08-06 01:09:42,866][52794] Sum rewards: 59.219, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.459', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.161', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.332', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '51.000'} [2024-08-06 01:09:43,246][52668] DAMAGECOUNT value on done: 176248.0 [2024-08-06 01:09:43,246][52668] Sum rewards: 56.435, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.113', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.210', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '48.000'} [2024-08-06 01:09:43,304][52614] Signal inference workers to stop experience collection... (5200 times) [2024-08-06 01:09:43,309][52614] Signal inference workers to resume experience collection... (5200 times) [2024-08-06 01:09:43,389][52650] InferenceWorker_p0-w0: stopping experience collection (5200 times) [2024-08-06 01:09:43,389][52650] InferenceWorker_p0-w0: resuming experience collection (5200 times) [2024-08-06 01:09:43,615][52660] DAMAGECOUNT value on done: 174419.0 [2024-08-06 01:09:43,616][52660] Sum rewards: 64.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.475', 'AMMO2': '0.002', 'AMMO4': '0.007', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.239', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:43,812][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:09:44,710][52803] DAMAGECOUNT value on done: 162100.0 [2024-08-06 01:09:44,711][52803] Sum rewards: 58.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.186', 'AMMO5': '0.004', 'ARMOR': '0.012', 'weapon5': '0.022', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.227', 'weapon4': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:44,893][52669] DAMAGECOUNT value on done: 171541.0 [2024-08-06 01:09:44,896][52669] Sum rewards: 50.475, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.804', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.129', 'weapon4': '0.204', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.750', 'HITCOUNT': '2.920', 'weapon3': '3.082', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '48.000'} [2024-08-06 01:09:45,386][52667] DAMAGECOUNT value on done: 172742.0 [2024-08-06 01:09:45,387][52667] Sum rewards: 54.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.044', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'weapon2': '0.464', 'weapon4': '0.610', 'WEAPON3': '1.450', 'weapon3': '2.756', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:45,438][52668] DAMAGECOUNT value on done: 174344.0 [2024-08-06 01:09:45,439][52668] Sum rewards: 57.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.256', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon5': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.522', 'WEAPON3': '0.900', 'weapon3': '2.658', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:45,527][52663] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:09:45,698][52662] DAMAGECOUNT value on done: 180402.0 [2024-08-06 01:09:45,699][52662] Sum rewards: 62.831, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon4': '0.086', 'AMMO4': '0.163', 'AMMO3': '0.170', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '2.992', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:45,777][52650] Updated weights for policy 0, policy_version 28231 (0.0012) [2024-08-06 01:09:45,802][52660] DAMAGECOUNT value on done: 184429.0 [2024-08-06 01:09:45,805][52660] Sum rewards: 64.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.091', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.126', 'AMMO3': '0.209', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.810', 'WEAPON3': '1.250', 'weapon3': '2.658', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '56.000'} [2024-08-06 01:09:45,930][52794] DAMAGECOUNT value on done: 179184.0 [2024-08-06 01:09:45,930][52794] Sum rewards: 51.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.549', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.041', 'weapon5': '0.158', 'AMMO4': '0.204', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.550', 'weapon4': '0.672', 'WEAPON3': '1.250', 'weapon3': '2.522', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '45.000'} [2024-08-06 01:09:46,546][52820] DAMAGECOUNT value on done: 158152.0 [2024-08-06 01:09:46,547][52820] Sum rewards: 57.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.280', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '51.000'} [2024-08-06 01:09:47,778][52803] DAMAGECOUNT value on done: 166187.0 [2024-08-06 01:09:47,778][52803] Sum rewards: 61.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon4': '0.294', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '53.000'} [2024-08-06 01:09:47,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 231292928. Throughput: 0: 4387.1. Samples: 57823860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 01:09:47,794][52567] Avg episode reward: [(0, '58.916')] [2024-08-06 01:09:47,864][52669] DAMAGECOUNT value on done: 174639.0 [2024-08-06 01:09:47,865][52669] Sum rewards: 70.706, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.110', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.216', 'WEAPON3': '0.600', 'weapon2': '0.670', 'HEALTH': '1.070', 'weapon3': '2.852', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:48,326][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:09:48,338][52667] DAMAGECOUNT value on done: 175826.0 [2024-08-06 01:09:48,340][52667] Sum rewards: 68.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.905', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.181', 'weapon2': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.598', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '58.000'} [2024-08-06 01:09:48,674][52660] DAMAGECOUNT value on done: 169940.0 [2024-08-06 01:09:48,675][52660] Sum rewards: 60.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.337', 'ARMOR': '0.004', 'AMMO5': '0.013', 'weapon5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.298', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '51.000'} [2024-08-06 01:09:48,767][52662] DAMAGECOUNT value on done: 173541.0 [2024-08-06 01:09:48,767][52662] Sum rewards: 65.906, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.363', 'AMMO5': '0.003', 'ARMOR': '0.024', 'AMMO2': '0.036', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'weapon2': '0.252', 'weapon4': '0.274', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.172', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '60.000'} [2024-08-06 01:09:49,131][52794] DAMAGECOUNT value on done: 181510.0 [2024-08-06 01:09:49,132][52794] Sum rewards: 66.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'AMMO4': '0.212', 'weapon4': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '56.000'} [2024-08-06 01:09:49,651][52820] DAMAGECOUNT value on done: 159669.0 [2024-08-06 01:09:49,651][52820] Sum rewards: 62.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.115', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.704', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:50,436][52669] DAMAGECOUNT value on done: 173613.0 [2024-08-06 01:09:50,437][52669] Sum rewards: 52.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.407', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.064', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'AMMO4': '0.239', 'weapon2': '0.356', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '2.886', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '48.000'} [2024-08-06 01:09:50,840][52803] DAMAGECOUNT value on done: 160474.0 [2024-08-06 01:09:50,843][52803] Sum rewards: 48.016, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.581', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.090', 'AMMO4': '0.124', 'weapon5': '0.162', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.624', 'WEAPON3': '0.650', 'weapon4': '0.668', 'weapon3': '2.124', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '37.500'} [2024-08-06 01:09:50,855][52650] Updated weights for policy 0, policy_version 28241 (0.0019) [2024-08-06 01:09:51,464][52667] DAMAGECOUNT value on done: 171022.0 [2024-08-06 01:09:51,467][52667] Sum rewards: 53.824, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon4': '0.198', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.722', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.874', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '45.000'} [2024-08-06 01:09:51,484][52662] DAMAGECOUNT value on done: 176346.0 [2024-08-06 01:09:51,487][52662] Sum rewards: 56.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.846', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon2': '0.430', 'weapon4': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '46.000'} [2024-08-06 01:09:51,549][52660] DAMAGECOUNT value on done: 174633.0 [2024-08-06 01:09:51,550][52660] Sum rewards: 68.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.242', 'weapon4': '0.854', 'WEAPON3': '1.300', 'weapon3': '2.628', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '58.000'} [2024-08-06 01:09:51,832][52794] DAMAGECOUNT value on done: 174482.0 [2024-08-06 01:09:51,832][52794] Sum rewards: 66.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.173', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.193', 'weapon4': '0.230', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '57.000'} [2024-08-06 01:09:52,748][52820] DAMAGECOUNT value on done: 157442.0 [2024-08-06 01:09:52,750][52820] Sum rewards: 40.382, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.114', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'weapon2': '0.402', 'WEAPON4': '0.650', 'weapon4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.452', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '11.898', 'FRAGCOUNT': '38.000'} [2024-08-06 01:09:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 231383040. Throughput: 0: 4383.3. Samples: 57850040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 01:09:52,794][52567] Avg episode reward: [(0, '59.098')] [2024-08-06 01:09:53,269][52669] DAMAGECOUNT value on done: 174153.0 [2024-08-06 01:09:53,271][52669] Sum rewards: 62.147, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'HEALTH': '0.208', 'AMMO3': '0.240', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '53.000'} [2024-08-06 01:09:53,991][52811] DAMAGECOUNT value on done: 171450.0 [2024-08-06 01:09:53,992][52811] Sum rewards: 51.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.314', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.123', 'weapon5': '0.146', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.628', 'weapon4': '0.694', 'WEAPON3': '0.750', 'weapon3': '2.116', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '43.000'} [2024-08-06 01:09:54,041][52803] DAMAGECOUNT value on done: 163011.0 [2024-08-06 01:09:54,042][52803] Sum rewards: 62.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.050', 'weapon5': '0.130', 'AMMO3': '0.187', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:54,348][52660] DAMAGECOUNT value on done: 165176.0 [2024-08-06 01:09:54,348][52660] Sum rewards: 56.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.188', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.402', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:54,489][52662] DAMAGECOUNT value on done: 175823.0 [2024-08-06 01:09:54,490][52662] Sum rewards: 71.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.927', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.060', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.280', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.000'} [2024-08-06 01:09:54,507][52667] DAMAGECOUNT value on done: 177701.0 [2024-08-06 01:09:54,508][52667] Sum rewards: 63.042, reward structure: {'DEATHCOUNT': '-13.500', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'HEALTH': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.192', 'weapon4': '0.210', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:54,729][52794] DAMAGECOUNT value on done: 176848.0 [2024-08-06 01:09:54,732][52794] Sum rewards: 59.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.649', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.008', 'AMMO4': '0.037', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.230', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:55,399][52650] Updated weights for policy 0, policy_version 28251 (0.0020) [2024-08-06 01:09:55,626][52658] DAMAGECOUNT value on done: 178191.0 [2024-08-06 01:09:55,627][52658] Sum rewards: 49.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.936', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.282', 'WEAPON4': '0.400', 'weapon4': '0.488', 'weapon2': '0.528', 'WEAPON3': '1.600', 'weapon3': '2.526', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.918', 'FRAGCOUNT': '45.000'} [2024-08-06 01:09:55,877][52820] DAMAGECOUNT value on done: 152811.0 [2024-08-06 01:09:55,878][52820] Sum rewards: 54.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.037', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon4': '0.294', 'weapon2': '0.726', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.645', 'FRAGCOUNT': '47.000'} [2024-08-06 01:09:56,648][52669] DAMAGECOUNT value on done: 171532.0 [2024-08-06 01:09:56,648][52669] Sum rewards: 54.508, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.368', 'AMMO5': '0.012', 'ARMOR': '0.016', 'weapon5': '0.034', 'AMMO2': '0.049', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'weapon2': '0.308', 'WEAPON4': '0.500', 'weapon4': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '47.500'} [2024-08-06 01:09:56,865][52660] DAMAGECOUNT value on done: 176005.0 [2024-08-06 01:09:56,866][52660] Sum rewards: 62.393, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.198', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.143', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.642', 'WEAPON3': '0.850', 'weapon3': '2.444', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '49.000'} [2024-08-06 01:09:57,072][52667] DAMAGECOUNT value on done: 180725.0 [2024-08-06 01:09:57,073][52667] Sum rewards: 54.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.600', 'HITCOUNT': '2.760', 'weapon3': '3.168', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '50.000'} [2024-08-06 01:09:57,115][52803] DAMAGECOUNT value on done: 166297.0 [2024-08-06 01:09:57,116][52803] Sum rewards: 65.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:57,230][52811] DAMAGECOUNT value on done: 158710.0 [2024-08-06 01:09:57,230][52811] Sum rewards: 63.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.606', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.256', 'weapon2': '0.490', 'WEAPON3': '1.600', 'weapon3': '3.310', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:57,477][52662] DAMAGECOUNT value on done: 174365.0 [2024-08-06 01:09:57,492][52662] Sum rewards: 59.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.196', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO4': '0.194', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON4': '0.400', 'weapon4': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '52.000'} [2024-08-06 01:09:57,703][52794] DAMAGECOUNT value on done: 171505.0 [2024-08-06 01:09:57,703][52794] Sum rewards: 66.613, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.802', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.198', 'weapon2': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '54.000'} [2024-08-06 01:09:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 231473152. Throughput: 0: 4390.5. Samples: 57876660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 01:09:57,794][52567] Avg episode reward: [(0, '59.478')] [2024-08-06 01:09:58,162][52658] DAMAGECOUNT value on done: 174519.0 [2024-08-06 01:09:58,163][52658] Sum rewards: 46.200, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.674', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '3.146', 'DAMAGECOUNT': '12.489', 'FRAGCOUNT': '42.500'} [2024-08-06 01:09:58,891][52820] DAMAGECOUNT value on done: 160938.0 [2024-08-06 01:09:58,893][52820] Sum rewards: 58.502, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.948', 'AMMO5': '0.004', 'AMMO2': '0.036', 'weapon5': '0.040', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.270', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '2.818', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '53.000'} [2024-08-06 01:09:59,502][52669] DAMAGECOUNT value on done: 174438.0 [2024-08-06 01:09:59,503][52669] Sum rewards: 70.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.915', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.087', 'AMMO3': '0.202', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '59.500'} [2024-08-06 01:09:59,871][52650] Updated weights for policy 0, policy_version 28261 (0.0019) [2024-08-06 01:09:59,915][52660] DAMAGECOUNT value on done: 169515.0 [2024-08-06 01:09:59,915][52660] Sum rewards: 68.628, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.135', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.328', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '55.000'} [2024-08-06 01:09:59,924][52667] DAMAGECOUNT value on done: 179629.0 [2024-08-06 01:09:59,925][52667] Sum rewards: 69.387, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.609', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.058', 'AMMO4': '0.166', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '60.000'} [2024-08-06 01:10:00,226][52811] DAMAGECOUNT value on done: 164091.0 [2024-08-06 01:10:00,227][52811] Sum rewards: 71.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO2': '0.028', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.204', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '61.000'} [2024-08-06 01:10:00,342][52803] DAMAGECOUNT value on done: 161719.0 [2024-08-06 01:10:00,343][52803] Sum rewards: 54.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.071', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.225', 'WEAPON4': '0.450', 'weapon2': '0.528', 'weapon4': '1.020', 'WEAPON3': '1.050', 'weapon3': '2.144', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '44.000'} [2024-08-06 01:10:00,738][52794] DAMAGECOUNT value on done: 185395.0 [2024-08-06 01:10:00,740][52794] Sum rewards: 62.642, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.095', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.118', 'AMMO3': '0.172', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:01,197][52658] DAMAGECOUNT value on done: 178026.0 [2024-08-06 01:10:01,198][52658] Sum rewards: 62.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.326', 'weapon4': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:02,009][52820] DAMAGECOUNT value on done: 157986.0 [2024-08-06 01:10:02,010][52820] Sum rewards: 55.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.143', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.050', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.204', 'weapon2': '0.494', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '3.038', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:02,370][52669] DAMAGECOUNT value on done: 174232.0 [2024-08-06 01:10:02,370][52669] Sum rewards: 54.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.616', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.304', 'weapon2': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.062', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17439.3). Total num frames: 231563264. Throughput: 0: 4385.8. Samples: 57889720. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:10:02,794][52567] Avg episode reward: [(0, '59.779')] [2024-08-06 01:10:02,821][52667] DAMAGECOUNT value on done: 179008.0 [2024-08-06 01:10:02,821][52667] Sum rewards: 41.175, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.926', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.146', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '2.838', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '39.000'} [2024-08-06 01:10:03,393][52811] DAMAGECOUNT value on done: 162738.0 [2024-08-06 01:10:03,393][52811] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.735', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.070', 'AMMO4': '0.157', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'weapon4': '0.318', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '52.500'} [2024-08-06 01:10:03,515][52803] DAMAGECOUNT value on done: 165534.0 [2024-08-06 01:10:03,515][52803] Sum rewards: 50.341, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.354', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.020', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.230', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '3.168', 'DAMAGECOUNT': '11.901', 'FRAGCOUNT': '42.000'} [2024-08-06 01:10:03,723][52794] DAMAGECOUNT value on done: 172777.0 [2024-08-06 01:10:03,725][52794] Sum rewards: 59.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.433', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.211', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.614', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '50.000'} [2024-08-06 01:10:04,007][52658] DAMAGECOUNT value on done: 177008.0 [2024-08-06 01:10:04,007][52658] Sum rewards: 57.608, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.482', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.120', 'AMMO4': '0.238', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.408', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.890', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:04,752][52650] Updated weights for policy 0, policy_version 28271 (0.0021) [2024-08-06 01:10:05,173][52820] DAMAGECOUNT value on done: 161239.0 [2024-08-06 01:10:05,176][52820] Sum rewards: 62.779, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.144', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:05,293][52669] DAMAGECOUNT value on done: 171497.0 [2024-08-06 01:10:05,295][52669] Sum rewards: 61.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.764', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.192', 'AMMO3': '0.222', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:05,517][52667] DAMAGECOUNT value on done: 173691.0 [2024-08-06 01:10:05,518][52667] Sum rewards: 64.568, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.508', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.270', 'weapon4': '0.272', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '57.000'} [2024-08-06 01:10:06,444][52811] DAMAGECOUNT value on done: 163002.0 [2024-08-06 01:10:06,444][52811] Sum rewards: 63.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.072', 'AMMO4': '0.182', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.344', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:06,567][52794] DAMAGECOUNT value on done: 180264.0 [2024-08-06 01:10:06,568][52794] Sum rewards: 49.558, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.970', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.142', 'weapon5': '0.198', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.456', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.502', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.750', 'FRAGCOUNT': '40.000'} [2024-08-06 01:10:06,611][52803] DAMAGECOUNT value on done: 158940.0 [2024-08-06 01:10:06,612][52803] Sum rewards: 58.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.244', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.242', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:06,815][52658] DAMAGECOUNT value on done: 176970.0 [2024-08-06 01:10:06,817][52658] Sum rewards: 58.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.485', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.012', 'AMMO4': '0.014', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.179', 'weapon2': '0.354', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.426', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:07,239][52666] DAMAGECOUNT value on done: 177265.0 [2024-08-06 01:10:07,241][52666] Sum rewards: 54.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.328', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.466', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 231645184. Throughput: 0: 4389.8. Samples: 57916100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:10:07,794][52567] Avg episode reward: [(0, '59.130')] [2024-08-06 01:10:08,176][52669] DAMAGECOUNT value on done: 176289.0 [2024-08-06 01:10:08,176][52669] Sum rewards: 59.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.293', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.130', 'AMMO4': '0.149', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.276', 'weapon4': '0.944', 'WEAPON3': '1.150', 'weapon3': '2.398', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:08,216][52820] DAMAGECOUNT value on done: 162488.0 [2024-08-06 01:10:08,216][52820] Sum rewards: 64.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.102', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.340', 'weapon2': '0.652', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:08,473][52667] DAMAGECOUNT value on done: 179740.0 [2024-08-06 01:10:08,474][52667] Sum rewards: 67.242, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.957', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.062', 'AMMO4': '0.121', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '58.000'} [2024-08-06 01:10:09,071][52650] Updated weights for policy 0, policy_version 28281 (0.0010) [2024-08-06 01:10:09,102][52794] DAMAGECOUNT value on done: 177006.0 [2024-08-06 01:10:09,102][52794] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.135', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.176', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.692', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:09,597][52803] DAMAGECOUNT value on done: 162172.0 [2024-08-06 01:10:09,598][52803] Sum rewards: 56.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.530', 'ARMOR': '0.008', 'AMMO2': '0.033', 'AMMO3': '0.157', 'AMMO4': '0.163', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.848', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:09,655][52811] DAMAGECOUNT value on done: 167387.0 [2024-08-06 01:10:09,656][52811] Sum rewards: 51.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.017', 'weapon4': '0.080', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.226', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '42.000'} [2024-08-06 01:10:09,698][52658] DAMAGECOUNT value on done: 171203.0 [2024-08-06 01:10:09,699][52658] Sum rewards: 56.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.596', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.096', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.400', 'weapon4': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.648', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:10,411][52666] DAMAGECOUNT value on done: 178569.0 [2024-08-06 01:10:10,411][52666] Sum rewards: 64.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.282', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.064', 'weapon4': '0.142', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:10,707][52669] DAMAGECOUNT value on done: 180049.0 [2024-08-06 01:10:10,709][52669] Sum rewards: 48.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.974', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.055', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.275', 'WEAPON4': '0.500', 'weapon4': '0.644', 'weapon2': '0.686', 'WEAPON3': '1.250', 'weapon3': '2.316', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '41.000'} [2024-08-06 01:10:11,311][52820] DAMAGECOUNT value on done: 159571.0 [2024-08-06 01:10:11,311][52820] Sum rewards: 55.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.692', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '46.000'} [2024-08-06 01:10:11,570][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:10:12,206][52794] DAMAGECOUNT value on done: 177331.0 [2024-08-06 01:10:12,208][52794] Sum rewards: 55.657, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.990', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.128', 'AMMO3': '0.235', 'AMMO4': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.348', 'weapon4': '0.374', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.886', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:12,493][52658] DAMAGECOUNT value on done: 180414.0 [2024-08-06 01:10:12,495][52658] Sum rewards: 57.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.615', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.552', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.538', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:12,642][52803] DAMAGECOUNT value on done: 159598.0 [2024-08-06 01:10:12,643][52803] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'AMMO2': '0.003', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '59.000'} [2024-08-06 01:10:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 231743488. Throughput: 0: 4387.6. Samples: 57942390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:10:12,802][52567] Avg episode reward: [(0, '59.252')] [2024-08-06 01:10:12,817][52811] DAMAGECOUNT value on done: 162920.0 [2024-08-06 01:10:12,819][52811] Sum rewards: 48.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.163', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.166', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.226', 'WEAPON4': '0.400', 'weapon4': '0.510', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '2.800', 'DAMAGECOUNT': '12.333', 'FRAGCOUNT': '42.000'} [2024-08-06 01:10:13,045][52666] DAMAGECOUNT value on done: 176194.0 [2024-08-06 01:10:13,045][52666] Sum rewards: 52.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.478', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO4': '0.174', 'AMMO3': '0.197', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '43.500'} [2024-08-06 01:10:13,292][52669] DAMAGECOUNT value on done: 185941.0 [2024-08-06 01:10:13,294][52669] Sum rewards: 61.276, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.125', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.262', 'weapon2': '0.372', 'WEAPON4': '0.450', 'weapon4': '0.528', 'WEAPON3': '1.450', 'weapon3': '2.678', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:14,133][52650] Updated weights for policy 0, policy_version 28291 (0.0033) [2024-08-06 01:10:14,418][52820] DAMAGECOUNT value on done: 164222.0 [2024-08-06 01:10:14,419][52820] Sum rewards: 60.475, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.140', 'weapon2': '0.264', 'AMMO3': '0.302', 'WEAPON3': '1.750', 'HITCOUNT': '3.330', 'weapon3': '3.382', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '56.000'} [2024-08-06 01:10:15,485][52794] DAMAGECOUNT value on done: 183162.0 [2024-08-06 01:10:15,486][52794] Sum rewards: 54.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.776', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.076', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.930', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '45.000'} [2024-08-06 01:10:15,736][52658] DAMAGECOUNT value on done: 169837.0 [2024-08-06 01:10:15,736][52658] Sum rewards: 58.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.036', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.570', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.154', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '48.000'} [2024-08-06 01:10:15,814][52811] DAMAGECOUNT value on done: 162682.0 [2024-08-06 01:10:15,815][52811] Sum rewards: 67.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.384', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '58.000'} [2024-08-06 01:10:15,835][52803] DAMAGECOUNT value on done: 168568.0 [2024-08-06 01:10:15,836][52803] Sum rewards: 63.564, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.204', 'HEALTH': '0.388', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:15,838][52669] DAMAGECOUNT value on done: 175544.0 [2024-08-06 01:10:15,838][52669] Sum rewards: 66.053, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.136', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.752', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '57.500'} [2024-08-06 01:10:15,993][52666] DAMAGECOUNT value on done: 173734.0 [2024-08-06 01:10:15,993][52666] Sum rewards: 80.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.377', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.018', 'weapon4': '0.054', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '67.000'} [2024-08-06 01:10:16,609][52670] DAMAGECOUNT value on done: 171782.0 [2024-08-06 01:10:16,611][52670] Sum rewards: 62.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.835', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.199', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.180', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:17,528][52820] DAMAGECOUNT value on done: 163688.0 [2024-08-06 01:10:17,530][52820] Sum rewards: 74.164, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'HEALTH': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon4': '0.216', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '61.000'} [2024-08-06 01:10:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 231825408. Throughput: 0: 4398.4. Samples: 57955800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:10:17,802][52567] Avg episode reward: [(0, '59.660')] [2024-08-06 01:10:18,410][52650] Updated weights for policy 0, policy_version 28301 (0.0011) [2024-08-06 01:10:18,564][52794] DAMAGECOUNT value on done: 178492.0 [2024-08-06 01:10:18,564][52794] Sum rewards: 67.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.288', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.124', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '56.000'} [2024-08-06 01:10:18,702][52669] DAMAGECOUNT value on done: 178223.0 [2024-08-06 01:10:18,703][52669] Sum rewards: 70.810, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.761', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.070', 'AMMO3': '0.142', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.500', 'weapon4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.854', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.500'} [2024-08-06 01:10:18,790][52658] DAMAGECOUNT value on done: 180815.0 [2024-08-06 01:10:18,790][52658] Sum rewards: 52.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.105', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.422', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '45.000'} [2024-08-06 01:10:18,880][52803] DAMAGECOUNT value on done: 166963.0 [2024-08-06 01:10:18,881][52803] Sum rewards: 61.971, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.116', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:18,887][52811] DAMAGECOUNT value on done: 168918.0 [2024-08-06 01:10:18,888][52811] Sum rewards: 55.790, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.057', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.287', 'weapon2': '0.558', 'WEAPON4': '0.600', 'weapon4': '0.834', 'WEAPON3': '0.950', 'weapon3': '2.258', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:19,221][52666] DAMAGECOUNT value on done: 170347.0 [2024-08-06 01:10:19,221][52666] Sum rewards: 53.983, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.540', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.064', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.300', 'AMMO3': '0.309', 'weapon2': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.964', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:19,900][52670] DAMAGECOUNT value on done: 176484.0 [2024-08-06 01:10:19,902][52670] Sum rewards: 61.554, reward structure: {'DEATHCOUNT': '-17.250', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'HEALTH': '0.382', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:20,601][52820] DAMAGECOUNT value on done: 163120.0 [2024-08-06 01:10:20,603][52820] Sum rewards: 51.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.726', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO4': '0.181', 'AMMO3': '0.249', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.638', 'WEAPON3': '1.450', 'weapon3': '2.710', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '46.000'} [2024-08-06 01:10:21,529][52658] DAMAGECOUNT value on done: 180881.0 [2024-08-06 01:10:21,530][52658] Sum rewards: 61.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.320', 'weapon4': '0.334', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:21,562][52669] DAMAGECOUNT value on done: 177424.0 [2024-08-06 01:10:21,564][52669] Sum rewards: 64.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:21,806][52803] DAMAGECOUNT value on done: 163451.0 [2024-08-06 01:10:21,807][52803] Sum rewards: 61.592, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.256', 'AMMO3': '0.294', 'weapon2': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.072', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:22,011][52811] DAMAGECOUNT value on done: 164310.0 [2024-08-06 01:10:22,012][52811] Sum rewards: 60.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.460', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.170', 'AMMO4': '0.201', 'weapon5': '0.276', 'weapon4': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.474', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '51.500'} [2024-08-06 01:10:22,384][52666] DAMAGECOUNT value on done: 168142.0 [2024-08-06 01:10:22,385][52666] Sum rewards: 70.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.514', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.165', 'weapon5': '0.214', 'weapon2': '0.354', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.746', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '58.500'} [2024-08-06 01:10:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 231915520. Throughput: 0: 4399.4. Samples: 57982470. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:10:22,802][52567] Avg episode reward: [(0, '59.883')] [2024-08-06 01:10:22,864][52670] DAMAGECOUNT value on done: 172895.0 [2024-08-06 01:10:22,866][52670] Sum rewards: 64.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.115', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.296', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '58.000'} [2024-08-06 01:10:23,268][52650] Updated weights for policy 0, policy_version 28311 (0.0038) [2024-08-06 01:10:23,397][52649] DAMAGECOUNT value on done: 170657.0 [2024-08-06 01:10:23,397][52649] Sum rewards: 64.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.121', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.306', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '56.000'} [2024-08-06 01:10:23,702][52820] DAMAGECOUNT value on done: 160648.0 [2024-08-06 01:10:23,702][52820] Sum rewards: 42.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.757', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.165', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.726', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '2.758', 'DAMAGECOUNT': '11.664', 'FRAGCOUNT': '35.500'} [2024-08-06 01:10:24,140][52658] DAMAGECOUNT value on done: 181006.0 [2024-08-06 01:10:24,141][52658] Sum rewards: 59.091, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.242', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon4': '0.348', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.728', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:24,681][52669] DAMAGECOUNT value on done: 181019.0 [2024-08-06 01:10:24,682][52669] Sum rewards: 74.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.707', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '63.000'} [2024-08-06 01:10:24,997][52803] DAMAGECOUNT value on done: 167024.0 [2024-08-06 01:10:24,998][52803] Sum rewards: 61.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.085', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.226', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:25,081][52811] DAMAGECOUNT value on done: 162302.0 [2024-08-06 01:10:25,083][52811] Sum rewards: 67.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.128', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.288', 'weapon4': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:25,294][52666] DAMAGECOUNT value on done: 172783.0 [2024-08-06 01:10:25,295][52666] Sum rewards: 59.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.178', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.436', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:25,704][52670] DAMAGECOUNT value on done: 171454.0 [2024-08-06 01:10:25,706][52670] Sum rewards: 44.481, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.288', 'WEAPON4': '0.450', 'weapon2': '0.458', 'weapon4': '0.460', 'WEAPON3': '1.650', 'weapon3': '2.718', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '42.000'} [2024-08-06 01:10:25,765][52649] DAMAGECOUNT value on done: 166476.0 [2024-08-06 01:10:25,765][52649] Sum rewards: 57.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.054', 'weapon5': '0.162', 'AMMO3': '0.186', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.650', 'weapon4': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.444', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '48.000'} [2024-08-06 01:10:26,840][52820] DAMAGECOUNT value on done: 162769.0 [2024-08-06 01:10:26,841][52820] Sum rewards: 63.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.759', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.388', 'weapon4': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:27,277][52658] DAMAGECOUNT value on done: 171258.0 [2024-08-06 01:10:27,278][52658] Sum rewards: 68.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.141', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '57.000'} [2024-08-06 01:10:27,712][52650] Updated weights for policy 0, policy_version 28321 (0.0013) [2024-08-06 01:10:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 232005632. Throughput: 0: 4399.3. Samples: 58008910. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:10:27,794][52567] Avg episode reward: [(0, '59.983')] [2024-08-06 01:10:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028321_232005632.pth... [2024-08-06 01:10:27,961][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000027806_227786752.pth [2024-08-06 01:10:28,074][52666] DAMAGECOUNT value on done: 172346.0 [2024-08-06 01:10:28,075][52666] Sum rewards: 52.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.944', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.117', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.490', 'weapon4': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '45.000'} [2024-08-06 01:10:28,202][52803] DAMAGECOUNT value on done: 162786.0 [2024-08-06 01:10:28,202][52803] Sum rewards: 58.150, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.078', 'weapon4': '0.094', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.712', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '51.500'} [2024-08-06 01:10:28,380][52811] DAMAGECOUNT value on done: 163993.0 [2024-08-06 01:10:28,380][52811] Sum rewards: 39.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.116', 'weapon5': '0.118', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '3.100', 'DAMAGECOUNT': '12.123', 'FRAGCOUNT': '35.000'} [2024-08-06 01:10:28,543][52670] DAMAGECOUNT value on done: 174034.0 [2024-08-06 01:10:28,543][52670] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.695', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.162', 'AMMO4': '0.206', 'AMMO3': '0.265', 'WEAPON5': '0.350', 'weapon4': '0.362', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.756', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '56.000'} [2024-08-06 01:10:29,005][52649] DAMAGECOUNT value on done: 169899.0 [2024-08-06 01:10:29,005][52649] Sum rewards: 53.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.574', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.168', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.364', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '43.000'} [2024-08-06 01:10:30,102][52820] DAMAGECOUNT value on done: 164715.0 [2024-08-06 01:10:30,106][52820] Sum rewards: 59.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.402', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.436', 'weapon4': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:30,429][52658] DAMAGECOUNT value on done: 174518.0 [2024-08-06 01:10:30,433][52658] Sum rewards: 53.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.473', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.210', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.370', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:31,267][52803] DAMAGECOUNT value on done: 160522.0 [2024-08-06 01:10:31,268][52803] Sum rewards: 61.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.100', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.184', 'weapon2': '0.228', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.198', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:31,347][52666] DAMAGECOUNT value on done: 173701.0 [2024-08-06 01:10:31,347][52666] Sum rewards: 47.181, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon4': '0.510', 'weapon2': '0.568', 'WEAPON3': '0.850', 'weapon3': '2.124', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '11.562', 'FRAGCOUNT': '39.000'} [2024-08-06 01:10:31,506][52811] DAMAGECOUNT value on done: 162925.0 [2024-08-06 01:10:31,508][52811] Sum rewards: 53.659, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.344', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.157', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.402', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.486', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '42.000'} [2024-08-06 01:10:31,908][52649] DAMAGECOUNT value on done: 171657.0 [2024-08-06 01:10:31,910][52649] Sum rewards: 54.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.048', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.151', 'weapon4': '0.232', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.058', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '45.000'} [2024-08-06 01:10:31,952][52670] DAMAGECOUNT value on done: 176462.0 [2024-08-06 01:10:31,953][52670] Sum rewards: 63.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.127', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:32,700][52650] Updated weights for policy 0, policy_version 28331 (0.0032) [2024-08-06 01:10:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17439.3). Total num frames: 232087552. Throughput: 0: 4398.0. Samples: 58021770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:10:32,794][52567] Avg episode reward: [(0, '59.642')] [2024-08-06 01:10:33,245][52671] DAMAGECOUNT value on done: 180576.0 [2024-08-06 01:10:33,256][52671] Sum rewards: 58.242, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.114', 'AMMO3': '0.133', 'weapon5': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '2.790', 'weapon3': '3.234', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '45.500'} [2024-08-06 01:10:33,371][52820] DAMAGECOUNT value on done: 161926.0 [2024-08-06 01:10:33,371][52820] Sum rewards: 61.161, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.384', 'weapon2': '0.744', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:33,550][52658] DAMAGECOUNT value on done: 174989.0 [2024-08-06 01:10:33,553][52658] Sum rewards: 65.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.035', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.322', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '56.000'} [2024-08-06 01:10:34,041][52666] DAMAGECOUNT value on done: 173943.0 [2024-08-06 01:10:34,042][52666] Sum rewards: 54.820, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.168', 'AMMO4': '0.186', 'weapon5': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.000', 'HITCOUNT': '2.610', 'weapon3': '2.696', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '45.000'} [2024-08-06 01:10:34,181][52795] Large shaping reward 2.569 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2024-08-06 01:10:34,441][52803] DAMAGECOUNT value on done: 167893.0 [2024-08-06 01:10:34,441][52803] Sum rewards: 65.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.220', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:34,544][52670] DAMAGECOUNT value on done: 168735.0 [2024-08-06 01:10:34,546][52670] Sum rewards: 57.211, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.676', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.262', 'AMMO3': '0.269', 'weapon2': '0.292', 'ARMOR': '0.490', 'WEAPON3': '1.650', 'weapon3': '3.082', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '50.000'} [2024-08-06 01:10:34,620][52649] DAMAGECOUNT value on done: 163044.0 [2024-08-06 01:10:34,623][52649] Sum rewards: 50.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.585', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.360', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '3.342', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '45.000'} [2024-08-06 01:10:34,671][52811] DAMAGECOUNT value on done: 165486.0 [2024-08-06 01:10:34,673][52811] Sum rewards: 59.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.162', 'weapon4': '0.198', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.108', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:36,222][52671] DAMAGECOUNT value on done: 174860.0 [2024-08-06 01:10:36,223][52671] Sum rewards: 57.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '48.000'} [2024-08-06 01:10:36,556][52820] DAMAGECOUNT value on done: 162101.0 [2024-08-06 01:10:36,556][52820] Sum rewards: 60.967, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.496', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.090', 'AMMO4': '0.183', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.414', 'weapon4': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:36,596][52658] DAMAGECOUNT value on done: 172967.0 [2024-08-06 01:10:36,596][52658] Sum rewards: 58.766, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.015', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.218', 'weapon2': '0.682', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '48.000'} [2024-08-06 01:10:36,723][52666] DAMAGECOUNT value on done: 170342.0 [2024-08-06 01:10:36,723][52666] Sum rewards: 52.634, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.559', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.186', 'weapon5': '0.216', 'AMMO4': '0.247', 'WEAPON5': '0.450', 'weapon4': '0.516', 'WEAPON4': '0.550', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.314', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '44.000'} [2024-08-06 01:10:37,126][52650] Updated weights for policy 0, policy_version 28341 (0.0016) [2024-08-06 01:10:37,260][52670] DAMAGECOUNT value on done: 173909.0 [2024-08-06 01:10:37,260][52670] Sum rewards: 52.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.194', 'AMMO4': '0.198', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.420', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.630', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:37,579][52803] DAMAGECOUNT value on done: 162494.0 [2024-08-06 01:10:37,580][52803] Sum rewards: 57.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'weapon2': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 232185856. Throughput: 0: 4401.6. Samples: 58048110. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:10:37,794][52567] Avg episode reward: [(0, '59.332')] [2024-08-06 01:10:37,868][52649] DAMAGECOUNT value on done: 170656.0 [2024-08-06 01:10:37,870][52811] DAMAGECOUNT value on done: 163236.0 [2024-08-06 01:10:37,871][52811] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.295', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.146', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:37,871][52649] Sum rewards: 74.827, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.029', 'HEALTH': '0.108', 'AMMO4': '0.143', 'AMMO3': '0.145', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '0.900', 'weapon3': '3.034', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '59.000'} [2024-08-06 01:10:39,179][52671] DAMAGECOUNT value on done: 179142.0 [2024-08-06 01:10:39,180][52671] Sum rewards: 63.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.159', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.584', 'weapon4': '0.838', 'WEAPON3': '0.900', 'weapon3': '2.122', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 01:10:39,624][52666] DAMAGECOUNT value on done: 167604.0 [2024-08-06 01:10:39,625][52666] Sum rewards: 55.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.491', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.218', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:39,645][52820] DAMAGECOUNT value on done: 166198.0 [2024-08-06 01:10:39,646][52820] Sum rewards: 59.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.099', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.024', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.200', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.720', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '50.500'} [2024-08-06 01:10:39,715][52658] DAMAGECOUNT value on done: 177341.0 [2024-08-06 01:10:39,715][52658] Sum rewards: 40.164, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.320', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.090', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.326', 'weapon2': '0.330', 'WEAPON4': '0.450', 'weapon4': '0.656', 'WEAPON3': '1.850', 'weapon3': '2.592', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '11.637', 'FRAGCOUNT': '41.000'} [2024-08-06 01:10:40,242][52670] DAMAGECOUNT value on done: 169399.0 [2024-08-06 01:10:40,246][52670] Sum rewards: 75.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.280', 'weapon2': '0.398', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '61.000'} [2024-08-06 01:10:40,665][52803] DAMAGECOUNT value on done: 167547.0 [2024-08-06 01:10:40,667][52803] Sum rewards: 65.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.078', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:40,804][52811] DAMAGECOUNT value on done: 164644.0 [2024-08-06 01:10:40,806][52811] Sum rewards: 53.065, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.064', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.283', 'WEAPON4': '0.400', 'weapon4': '0.580', 'WEAPON3': '1.650', 'weapon3': '2.608', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:41,231][52649] DAMAGECOUNT value on done: 167639.0 [2024-08-06 01:10:41,231][52649] Sum rewards: 56.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.118', 'ARMOR': '0.004', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon2': '0.160', 'AMMO3': '0.200', 'weapon4': '0.332', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.322', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:42,006][52650] Updated weights for policy 0, policy_version 28351 (0.0013) [2024-08-06 01:10:42,167][52671] DAMAGECOUNT value on done: 172852.0 [2024-08-06 01:10:42,169][52671] Sum rewards: 52.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.179', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.196', 'weapon2': '0.276', 'WEAPON4': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '46.500'} [2024-08-06 01:10:42,403][52666] DAMAGECOUNT value on done: 178073.0 [2024-08-06 01:10:42,403][52666] Sum rewards: 63.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.192', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:42,728][52658] DAMAGECOUNT value on done: 178016.0 [2024-08-06 01:10:42,728][52658] Sum rewards: 54.005, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.026', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.270', 'weapon4': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '44.000'} [2024-08-06 01:10:42,733][52820] DAMAGECOUNT value on done: 168757.0 [2024-08-06 01:10:42,733][52820] Sum rewards: 56.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.604', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.186', 'AMMO4': '0.192', 'AMMO3': '0.225', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.640', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '48.000'} [2024-08-06 01:10:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17467.0). Total num frames: 232267776. Throughput: 0: 4391.8. Samples: 58074290. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:10:42,794][52567] Avg episode reward: [(0, '59.287')] [2024-08-06 01:10:42,886][52670] DAMAGECOUNT value on done: 165367.0 [2024-08-06 01:10:42,886][52670] Sum rewards: 55.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.444', 'AMMO5': '0.004', 'weapon5': '0.030', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.410', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '46.000'} [2024-08-06 01:10:43,640][52663] DAMAGECOUNT value on done: 175278.0 [2024-08-06 01:10:43,641][52663] Sum rewards: 62.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.218', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'AMMO3': '0.244', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '2.848', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:43,846][52803] DAMAGECOUNT value on done: 157552.0 [2024-08-06 01:10:43,846][52803] Sum rewards: 47.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.141', 'WEAPON4': '0.350', 'weapon2': '0.406', 'weapon4': '0.804', 'WEAPON3': '0.950', 'weapon3': '2.486', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '40.000'} [2024-08-06 01:10:43,976][52649] DAMAGECOUNT value on done: 175413.0 [2024-08-06 01:10:43,978][52649] Sum rewards: 54.724, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.156', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.012', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.165', 'weapon2': '0.342', 'WEAPON3': '1.000', 'HITCOUNT': '3.120', 'weapon3': '3.426', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '42.500'} [2024-08-06 01:10:44,030][52811] DAMAGECOUNT value on done: 161802.0 [2024-08-06 01:10:44,033][52811] Sum rewards: 72.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon4': '0.258', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '59.000'} [2024-08-06 01:10:44,896][52666] DAMAGECOUNT value on done: 175469.0 [2024-08-06 01:10:44,896][52666] Sum rewards: 54.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon4': '0.406', 'weapon2': '0.590', 'WEAPON3': '1.550', 'weapon3': '2.712', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:45,344][52671] DAMAGECOUNT value on done: 175742.0 [2024-08-06 01:10:45,345][52671] Sum rewards: 55.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO4': '0.186', 'weapon4': '0.242', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:45,480][52658] DAMAGECOUNT value on done: 171731.0 [2024-08-06 01:10:45,484][52658] Sum rewards: 63.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.131', 'AMMO3': '0.200', 'weapon4': '0.228', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.226', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:45,548][52670] DAMAGECOUNT value on done: 177119.0 [2024-08-06 01:10:45,549][52670] Sum rewards: 59.255, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.689', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.045', 'weapon5': '0.138', 'AMMO4': '0.224', 'weapon4': '0.230', 'AMMO3': '0.239', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:45,853][52820] DAMAGECOUNT value on done: 159142.0 [2024-08-06 01:10:45,854][52820] Sum rewards: 42.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.566', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.498', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.994', 'DAMAGECOUNT': '11.340', 'FRAGCOUNT': '37.000'} [2024-08-06 01:10:46,428][52663] DAMAGECOUNT value on done: 174167.0 [2024-08-06 01:10:46,429][52663] Sum rewards: 48.318, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.148', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.140', 'AMMO3': '0.216', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.372', 'weapon4': '0.382', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '44.000'} [2024-08-06 01:10:46,478][52650] Updated weights for policy 0, policy_version 28361 (0.0026) [2024-08-06 01:10:46,694][52649] DAMAGECOUNT value on done: 167966.0 [2024-08-06 01:10:46,695][52649] Sum rewards: 53.593, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.485', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.028', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.184', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:47,117][52811] DAMAGECOUNT value on done: 167359.0 [2024-08-06 01:10:47,120][52811] Sum rewards: 59.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.382', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '50.000'} [2024-08-06 01:10:47,197][52662] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2024-08-06 01:10:47,439][52666] DAMAGECOUNT value on done: 170843.0 [2024-08-06 01:10:47,439][52666] Sum rewards: 61.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.302', 'WEAPON1': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.114', 'AMMO3': '0.172', 'AMMO4': '0.265', 'weapon4': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2024-08-06 01:10:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 232349696. Throughput: 0: 4398.9. Samples: 58087670. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:10:47,794][52567] Avg episode reward: [(0, '58.827')] [2024-08-06 01:10:47,952][52670] DAMAGECOUNT value on done: 175626.0 [2024-08-06 01:10:47,953][52670] Sum rewards: 79.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.478', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '65.000'} [2024-08-06 01:10:48,301][52671] DAMAGECOUNT value on done: 175510.0 [2024-08-06 01:10:48,301][52671] Sum rewards: 52.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '45.000'} [2024-08-06 01:10:48,687][52658] DAMAGECOUNT value on done: 173182.0 [2024-08-06 01:10:48,687][52658] Sum rewards: 67.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.832', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.352', 'weapon4': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '57.000'} [2024-08-06 01:10:49,143][52663] DAMAGECOUNT value on done: 173086.0 [2024-08-06 01:10:49,143][52663] Sum rewards: 70.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '59.000'} [2024-08-06 01:10:49,186][52649] DAMAGECOUNT value on done: 171416.0 [2024-08-06 01:10:49,189][52649] Sum rewards: 60.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.164', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '50.000'} [2024-08-06 01:10:50,217][52666] DAMAGECOUNT value on done: 171762.0 [2024-08-06 01:10:50,226][52811] DAMAGECOUNT value on done: 162082.0 [2024-08-06 01:10:50,226][52666] Sum rewards: 62.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.092', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.164', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:50,230][52811] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO4': '0.187', 'weapon5': '0.222', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.694', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '57.000'} [2024-08-06 01:10:50,850][52670] DAMAGECOUNT value on done: 175950.0 [2024-08-06 01:10:50,850][52670] Sum rewards: 46.203, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.295', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.186', 'AMMO3': '0.193', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '2.826', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '42.000'} [2024-08-06 01:10:50,940][52671] DAMAGECOUNT value on done: 175291.0 [2024-08-06 01:10:50,941][52671] Sum rewards: 41.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.242', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.207', 'weapon2': '0.288', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.082', 'DAMAGECOUNT': '11.667', 'FRAGCOUNT': '35.500'} [2024-08-06 01:10:51,317][52650] Updated weights for policy 0, policy_version 28371 (0.0011) [2024-08-06 01:10:51,570][52658] DAMAGECOUNT value on done: 178007.0 [2024-08-06 01:10:51,570][52658] Sum rewards: 51.477, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.448', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.050', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.762', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:51,904][52663] DAMAGECOUNT value on done: 175308.0 [2024-08-06 01:10:51,907][52663] Sum rewards: 67.756, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.182', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO4': '0.204', 'AMMO3': '0.233', 'weapon2': '0.386', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '59.000'} [2024-08-06 01:10:52,373][52649] DAMAGECOUNT value on done: 171731.0 [2024-08-06 01:10:52,375][52649] Sum rewards: 52.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.156', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '44.000'} [2024-08-06 01:10:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 232448000. Throughput: 0: 4404.4. Samples: 58114300. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:10:52,794][52567] Avg episode reward: [(0, '59.240')] [2024-08-06 01:10:53,072][52666] DAMAGECOUNT value on done: 171640.0 [2024-08-06 01:10:53,073][52666] Sum rewards: 63.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.046', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.064', 'weapon4': '0.136', 'AMMO3': '0.186', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:53,492][52811] DAMAGECOUNT value on done: 166416.0 [2024-08-06 01:10:53,493][52811] Sum rewards: 64.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.861', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:53,504][52671] DAMAGECOUNT value on done: 177613.0 [2024-08-06 01:10:53,506][52671] Sum rewards: 67.494, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.146', 'weapon4': '0.166', 'AMMO4': '0.181', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '59.000'} [2024-08-06 01:10:53,654][52670] DAMAGECOUNT value on done: 174018.0 [2024-08-06 01:10:53,654][52670] Sum rewards: 64.528, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.119', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.534', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:54,925][52663] DAMAGECOUNT value on done: 172251.0 [2024-08-06 01:10:54,928][52663] Sum rewards: 68.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon4': '0.286', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '55.000'} [2024-08-06 01:10:55,198][52649] DAMAGECOUNT value on done: 168229.0 [2024-08-06 01:10:55,198][52649] Sum rewards: 62.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.224', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.202', 'weapon2': '0.312', 'weapon4': '0.320', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.194', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '51.000'} [2024-08-06 01:10:55,531][52650] Updated weights for policy 0, policy_version 28381 (0.0010) [2024-08-06 01:10:55,884][52666] DAMAGECOUNT value on done: 175185.0 [2024-08-06 01:10:55,884][52666] Sum rewards: 55.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.219', 'weapon2': '0.474', 'WEAPON4': '0.500', 'weapon4': '0.832', 'WEAPON3': '1.000', 'weapon3': '2.334', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '47.000'} [2024-08-06 01:10:56,047][52647] DAMAGECOUNT value on done: 186539.0 [2024-08-06 01:10:56,047][52647] Sum rewards: 67.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.516', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO4': '0.170', 'AMMO3': '0.236', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '58.000'} [2024-08-06 01:10:56,366][52671] DAMAGECOUNT value on done: 174933.0 [2024-08-06 01:10:56,366][52671] Sum rewards: 56.783, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon2': '0.496', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.278', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '50.000'} [2024-08-06 01:10:56,595][52670] DAMAGECOUNT value on done: 178715.0 [2024-08-06 01:10:56,596][52670] Sum rewards: 54.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.992', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.284', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.984', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2024-08-06 01:10:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 232529920. Throughput: 0: 4409.8. Samples: 58140830. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:10:57,794][52567] Avg episode reward: [(0, '58.956')] [2024-08-06 01:10:57,946][52663] DAMAGECOUNT value on done: 181666.0 [2024-08-06 01:10:57,948][52663] Sum rewards: 64.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.234', 'AMMO5': '0.007', 'AMMO2': '0.025', 'ARMOR': '0.028', 'weapon5': '0.052', 'weapon4': '0.106', 'AMMO4': '0.122', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.200', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '53.000'} [2024-08-06 01:10:58,328][52649] DAMAGECOUNT value on done: 173621.0 [2024-08-06 01:10:58,332][52649] Sum rewards: 48.418, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '42.000'} [2024-08-06 01:10:58,827][52666] DAMAGECOUNT value on done: 171198.0 [2024-08-06 01:10:58,828][52666] Sum rewards: 66.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon5': '0.112', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '54.000'} [2024-08-06 01:10:59,078][52671] DAMAGECOUNT value on done: 179388.0 [2024-08-06 01:10:59,080][52671] Sum rewards: 53.526, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.392', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.300', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '48.000'} [2024-08-06 01:10:59,197][52647] DAMAGECOUNT value on done: 183308.0 [2024-08-06 01:10:59,197][52647] Sum rewards: 49.081, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.184', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.051', 'weapon5': '0.102', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.256', 'weapon2': '0.328', 'WEAPON4': '0.500', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '43.000'} [2024-08-06 01:10:59,498][52670] DAMAGECOUNT value on done: 166779.0 [2024-08-06 01:10:59,499][52670] Sum rewards: 58.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.090', 'weapon4': '0.132', 'AMMO3': '0.219', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.276', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '49.000'} [2024-08-06 01:11:00,586][52650] Updated weights for policy 0, policy_version 28391 (0.0013) [2024-08-06 01:11:00,599][52663] DAMAGECOUNT value on done: 175649.0 [2024-08-06 01:11:00,601][52663] Sum rewards: 56.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.999', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.130', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.396', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '47.000'} [2024-08-06 01:11:01,082][52649] DAMAGECOUNT value on done: 172104.0 [2024-08-06 01:11:01,090][52649] Sum rewards: 59.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.795', 'AMMO2': '0.027', 'weapon4': '0.106', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.180', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '52.000'} [2024-08-06 01:11:01,691][52671] DAMAGECOUNT value on done: 177862.0 [2024-08-06 01:11:01,691][52671] Sum rewards: 64.799, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.350', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:01,768][52666] DAMAGECOUNT value on done: 172278.0 [2024-08-06 01:11:01,771][52666] Sum rewards: 57.616, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO2': '0.048', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO4': '0.238', 'AMMO3': '0.279', 'weapon2': '0.518', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:02,056][52647] DAMAGECOUNT value on done: 186046.0 [2024-08-06 01:11:02,058][52647] Sum rewards: 70.436, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.557', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'AMMO3': '0.176', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '3.302', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:02,440][52670] DAMAGECOUNT value on done: 176302.0 [2024-08-06 01:11:02,441][52670] Sum rewards: 64.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.639', 'AMMO5': '0.006', 'AMMO2': '0.009', 'ARMOR': '0.020', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.288', 'weapon2': '0.516', 'WEAPON3': '1.750', 'weapon3': '3.016', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '56.000'} [2024-08-06 01:11:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 232620032. Throughput: 0: 4405.6. Samples: 58154050. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:11:02,794][52567] Avg episode reward: [(0, '58.823')] [2024-08-06 01:11:03,271][52659] DAMAGECOUNT value on done: 175279.0 [2024-08-06 01:11:03,272][52659] Sum rewards: 51.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.215', 'AMMO2': '0.022', 'weapon4': '0.112', 'AMMO4': '0.112', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.700', 'HITCOUNT': '3.080', 'weapon3': '3.318', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '47.000'} [2024-08-06 01:11:03,691][52663] DAMAGECOUNT value on done: 176116.0 [2024-08-06 01:11:03,691][52663] Sum rewards: 69.400, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.464', 'ARMOR': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.246', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '61.000'} [2024-08-06 01:11:04,257][52647] DAMAGECOUNT value on done: 186175.0 [2024-08-06 01:11:04,257][52647] Sum rewards: 55.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.915', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.163', 'AMMO4': '0.191', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.396', 'WEAPON3': '1.000', 'weapon3': '2.862', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '46.000'} [2024-08-06 01:11:04,263][52649] DAMAGECOUNT value on done: 165633.0 [2024-08-06 01:11:04,263][52649] Sum rewards: 69.510, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:04,595][52671] DAMAGECOUNT value on done: 175239.0 [2024-08-06 01:11:04,595][52671] Sum rewards: 57.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'weapon4': '0.120', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.804', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2024-08-06 01:11:05,025][52650] Updated weights for policy 0, policy_version 28401 (0.0011) [2024-08-06 01:11:05,441][52670] DAMAGECOUNT value on done: 178320.0 [2024-08-06 01:11:05,441][52670] Sum rewards: 66.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.702', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.207', 'weapon5': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.748', 'WEAPON3': '1.250', 'weapon3': '2.526', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '56.000'} [2024-08-06 01:11:05,446][52665] DAMAGECOUNT value on done: 173079.0 [2024-08-06 01:11:05,446][52665] Sum rewards: 55.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.216', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon5': '0.084', 'AMMO3': '0.179', 'weapon2': '0.574', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.146', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '46.000'} [2024-08-06 01:11:05,878][52659] DAMAGECOUNT value on done: 175907.0 [2024-08-06 01:11:05,881][52659] Sum rewards: 44.632, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.054', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.239', 'AMMO4': '0.269', 'weapon2': '0.360', 'WEAPON4': '0.500', 'weapon4': '0.688', 'WEAPON3': '1.450', 'weapon3': '2.528', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '42.000'} [2024-08-06 01:11:06,545][52647] DAMAGECOUNT value on done: 186050.0 [2024-08-06 01:11:06,545][52647] Sum rewards: 56.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.462', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.298', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '48.000'} [2024-08-06 01:11:06,665][52663] DAMAGECOUNT value on done: 174035.0 [2024-08-06 01:11:06,667][52663] Sum rewards: 50.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.352', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.055', 'weapon5': '0.118', 'AMMO3': '0.229', 'AMMO4': '0.275', 'weapon4': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '46.000'} [2024-08-06 01:11:07,140][52649] DAMAGECOUNT value on done: 172937.0 [2024-08-06 01:11:07,141][52649] Sum rewards: 59.530, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.820', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.202', 'AMMO3': '0.221', 'AMMO4': '0.227', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:07,394][52671] DAMAGECOUNT value on done: 184789.0 [2024-08-06 01:11:07,394][52671] Sum rewards: 68.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.442', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 232710144. Throughput: 0: 4394.7. Samples: 58180230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:11:07,794][52567] Avg episode reward: [(0, '58.586')] [2024-08-06 01:11:07,922][52670] DAMAGECOUNT value on done: 174129.0 [2024-08-06 01:11:07,924][52670] Sum rewards: 50.873, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.046', 'AMMO4': '0.170', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON4': '0.450', 'weapon4': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.754', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '45.000'} [2024-08-06 01:11:08,285][52665] DAMAGECOUNT value on done: 177975.0 [2024-08-06 01:11:08,286][52665] Sum rewards: 59.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.394', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.604', 'weapon4': '0.676', 'WEAPON3': '1.250', 'weapon3': '2.470', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '49.000'} [2024-08-06 01:11:08,961][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:11:09,082][52647] DAMAGECOUNT value on done: 188249.0 [2024-08-06 01:11:09,083][52647] Sum rewards: 61.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.952', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.174', 'AMMO3': '0.278', 'weapon2': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.196', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:09,190][52659] DAMAGECOUNT value on done: 176544.0 [2024-08-06 01:11:09,190][52659] Sum rewards: 59.897, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.090', 'AMMO4': '0.205', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '52.000'} [2024-08-06 01:11:09,321][52663] DAMAGECOUNT value on done: 178125.0 [2024-08-06 01:11:09,323][52663] Sum rewards: 49.216, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.574', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.516', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '44.000'} [2024-08-06 01:11:09,797][52650] Updated weights for policy 0, policy_version 28411 (0.0013) [2024-08-06 01:11:10,170][52649] DAMAGECOUNT value on done: 170368.0 [2024-08-06 01:11:10,171][52649] Sum rewards: 57.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.036', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.514', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.248', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:10,460][52671] DAMAGECOUNT value on done: 177241.0 [2024-08-06 01:11:10,460][52671] Sum rewards: 77.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.483', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '65.000'} [2024-08-06 01:11:10,477][52670] DAMAGECOUNT value on done: 173680.0 [2024-08-06 01:11:10,477][52670] Sum rewards: 62.888, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.626', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.047', 'weapon5': '0.120', 'AMMO3': '0.132', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.658', 'WEAPON3': '0.850', 'weapon3': '2.486', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:11,267][52665] DAMAGECOUNT value on done: 173249.0 [2024-08-06 01:11:11,269][52665] Sum rewards: 70.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.060', 'AMMO3': '0.155', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.424', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.714', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:11,749][52659] DAMAGECOUNT value on done: 177537.0 [2024-08-06 01:11:11,757][52659] Sum rewards: 60.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon4': '0.084', 'weapon5': '0.094', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.210', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:11,783][52647] DAMAGECOUNT value on done: 183896.0 [2024-08-06 01:11:11,785][52647] Sum rewards: 59.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.214', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO4': '0.208', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.518', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.422', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '52.000'} [2024-08-06 01:11:12,453][52663] DAMAGECOUNT value on done: 176886.0 [2024-08-06 01:11:12,453][52663] Sum rewards: 51.350, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.946', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.024', 'weapon5': '0.120', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.348', 'WEAPON4': '0.400', 'weapon4': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '45.000'} [2024-08-06 01:11:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 232792064. Throughput: 0: 4399.3. Samples: 58206880. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:11:12,794][52567] Avg episode reward: [(0, '59.191')] [2024-08-06 01:11:13,134][52671] DAMAGECOUNT value on done: 171448.0 [2024-08-06 01:11:13,135][52671] Sum rewards: 49.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.302', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.039', 'weapon5': '0.116', 'AMMO3': '0.129', 'AMMO4': '0.197', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '1.296', 'weapon3': '1.836', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '41.000'} [2024-08-06 01:11:13,263][52649] DAMAGECOUNT value on done: 177558.0 [2024-08-06 01:11:13,264][52649] Sum rewards: 73.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.306', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.266', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.764', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '60.000'} [2024-08-06 01:11:14,332][52650] Updated weights for policy 0, policy_version 28421 (0.0013) [2024-08-06 01:11:14,347][52665] DAMAGECOUNT value on done: 168724.0 [2024-08-06 01:11:14,348][52665] Sum rewards: 64.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.194', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.534', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:14,435][52647] DAMAGECOUNT value on done: 184662.0 [2024-08-06 01:11:14,436][52647] Sum rewards: 57.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.125', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.191', 'WEAPON4': '0.550', 'weapon4': '0.554', 'weapon2': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.476', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:14,535][52659] DAMAGECOUNT value on done: 174661.0 [2024-08-06 01:11:14,535][52659] Sum rewards: 51.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '44.000'} [2024-08-06 01:11:15,212][52663] DAMAGECOUNT value on done: 174416.0 [2024-08-06 01:11:15,212][52663] Sum rewards: 46.733, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.242', 'ARMOR': '0.016', 'AMMO5': '0.023', 'AMMO2': '0.081', 'AMMO3': '0.222', 'weapon5': '0.264', 'weapon4': '0.396', 'AMMO4': '0.407', 'WEAPON5': '0.600', 'weapon2': '0.644', 'WEAPON4': '0.850', 'WEAPON3': '1.400', 'weapon3': '2.356', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '43.500'} [2024-08-06 01:11:15,528][52671] DAMAGECOUNT value on done: 179715.0 [2024-08-06 01:11:15,528][52671] Sum rewards: 47.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.887', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon4': '0.178', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.142', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '44.000'} [2024-08-06 01:11:16,408][52649] DAMAGECOUNT value on done: 174967.0 [2024-08-06 01:11:16,412][52649] Sum rewards: 67.612, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.145', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.232', 'AMMO3': '0.257', 'WEAPON3': '1.550', 'HITCOUNT': '3.390', 'weapon3': '3.444', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '59.000'} [2024-08-06 01:11:16,906][52659] DAMAGECOUNT value on done: 174419.0 [2024-08-06 01:11:16,914][52659] Sum rewards: 60.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.196', 'weapon2': '0.254', 'WEAPON4': '0.500', 'weapon4': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:17,145][52647] DAMAGECOUNT value on done: 187106.0 [2024-08-06 01:11:17,146][52647] Sum rewards: 55.363, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.542', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.096', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.298', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.978', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:17,450][52665] DAMAGECOUNT value on done: 170592.0 [2024-08-06 01:11:17,450][52665] Sum rewards: 57.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.346', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.042', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.090', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:17,579][52663] DAMAGECOUNT value on done: 170478.0 [2024-08-06 01:11:17,582][52663] Sum rewards: 53.976, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.867', 'ARMOR': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.225', 'weapon2': '0.376', 'WEAPON4': '0.500', 'weapon4': '0.812', 'WEAPON3': '1.300', 'weapon3': '2.558', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '48.000'} [2024-08-06 01:11:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 232873984. Throughput: 0: 4405.8. Samples: 58220030. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:11:17,794][52567] Avg episode reward: [(0, '59.021')] [2024-08-06 01:11:17,909][52664] DAMAGECOUNT value on done: 182582.0 [2024-08-06 01:11:17,909][52664] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.026', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.452', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:18,313][52671] DAMAGECOUNT value on done: 179769.0 [2024-08-06 01:11:18,315][52671] Sum rewards: 59.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.328', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.154', 'weapon5': '0.214', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.590', 'WEAPON3': '1.500', 'weapon3': '2.790', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '52.500'} [2024-08-06 01:11:18,841][52650] Updated weights for policy 0, policy_version 28431 (0.0020) [2024-08-06 01:11:19,531][52647] DAMAGECOUNT value on done: 182976.0 [2024-08-06 01:11:19,532][52647] Sum rewards: 69.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.344', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.172', 'AMMO3': '0.239', 'weapon2': '0.262', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '59.500'} [2024-08-06 01:11:19,628][52649] DAMAGECOUNT value on done: 179461.0 [2024-08-06 01:11:19,628][52649] Sum rewards: 69.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.161', 'AMMO3': '0.169', 'weapon4': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '56.500'} [2024-08-06 01:11:20,285][52664] DAMAGECOUNT value on done: 182570.0 [2024-08-06 01:11:20,285][52664] Sum rewards: 71.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '59.500'} [2024-08-06 01:11:20,300][52659] DAMAGECOUNT value on done: 175099.0 [2024-08-06 01:11:20,301][52659] Sum rewards: 49.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.047', 'AMMO3': '0.201', 'AMMO4': '0.234', 'weapon5': '0.246', 'WEAPON5': '0.450', 'weapon2': '0.462', 'weapon4': '0.542', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.434', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '42.000'} [2024-08-06 01:11:20,644][52665] DAMAGECOUNT value on done: 173262.0 [2024-08-06 01:11:20,644][52665] Sum rewards: 50.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.896', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.270', 'weapon4': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.118', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '44.500'} [2024-08-06 01:11:20,698][52663] DAMAGECOUNT value on done: 168054.0 [2024-08-06 01:11:20,698][52663] Sum rewards: 51.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.516', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.286', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.266', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '46.000'} [2024-08-06 01:11:21,618][52671] DAMAGECOUNT value on done: 179454.0 [2024-08-06 01:11:21,618][52671] Sum rewards: 66.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.118', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:21,853][52647] DAMAGECOUNT value on done: 183709.0 [2024-08-06 01:11:21,853][52647] Sum rewards: 61.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.108', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.164', 'AMMO3': '0.204', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '52.000'} [2024-08-06 01:11:22,691][52664] DAMAGECOUNT value on done: 184218.0 [2024-08-06 01:11:22,691][52664] Sum rewards: 63.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.678', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.140', 'AMMO4': '0.197', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '55.000'} [2024-08-06 01:11:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 232972288. Throughput: 0: 4408.9. Samples: 58246510. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:11:22,794][52567] Avg episode reward: [(0, '59.190')] [2024-08-06 01:11:23,047][52659] DAMAGECOUNT value on done: 171532.0 [2024-08-06 01:11:23,047][52659] Sum rewards: 67.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO2': '0.035', 'weapon4': '0.132', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.302', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '59.000'} [2024-08-06 01:11:23,658][52650] Updated weights for policy 0, policy_version 28441 (0.0031) [2024-08-06 01:11:23,772][52665] DAMAGECOUNT value on done: 174613.0 [2024-08-06 01:11:23,772][52665] Sum rewards: 65.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.913', 'ARMOR': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.422', 'weapon4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.634', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:24,041][52663] DAMAGECOUNT value on done: 176561.0 [2024-08-06 01:11:24,043][52663] Sum rewards: 54.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.196', 'weapon5': '0.226', 'AMMO4': '0.228', 'weapon2': '0.228', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '45.000'} [2024-08-06 01:11:24,076][52647] DAMAGECOUNT value on done: 181091.0 [2024-08-06 01:11:24,076][52647] Sum rewards: 51.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon4': '0.310', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '2.934', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '46.000'} [2024-08-06 01:11:24,375][52671] DAMAGECOUNT value on done: 178699.0 [2024-08-06 01:11:24,376][52671] Sum rewards: 67.044, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.066', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.140', 'AMMO3': '0.150', 'AMMO4': '0.206', 'weapon4': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.102', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:25,253][52664] DAMAGECOUNT value on done: 181303.0 [2024-08-06 01:11:25,255][52664] Sum rewards: 60.198, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.949', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '49.500'} [2024-08-06 01:11:25,618][52659] DAMAGECOUNT value on done: 178761.0 [2024-08-06 01:11:25,621][52659] Sum rewards: 66.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.196', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'AMMO3': '0.198', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.462', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '55.000'} [2024-08-06 01:11:26,518][52665] DAMAGECOUNT value on done: 175836.0 [2024-08-06 01:11:26,520][52665] Sum rewards: 50.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.818', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.192', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.708', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.656', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '42.000'} [2024-08-06 01:11:26,892][52671] DAMAGECOUNT value on done: 176095.0 [2024-08-06 01:11:26,893][52671] Sum rewards: 53.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.881', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.096', 'AMMO3': '0.163', 'WEAPON4': '0.400', 'weapon4': '0.462', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '45.000'} [2024-08-06 01:11:27,033][52663] DAMAGECOUNT value on done: 176506.0 [2024-08-06 01:11:27,033][52663] Sum rewards: 58.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.110', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:27,083][52647] DAMAGECOUNT value on done: 185102.0 [2024-08-06 01:11:27,083][52647] Sum rewards: 52.517, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.080', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.466', 'weapon4': '0.584', 'WEAPON3': '1.250', 'weapon3': '2.594', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '46.500'} [2024-08-06 01:11:27,440][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:11:27,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 233062400. Throughput: 0: 4416.4. Samples: 58273030. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:11:27,802][52567] Avg episode reward: [(0, '59.368')] [2024-08-06 01:11:27,927][52664] DAMAGECOUNT value on done: 181276.0 [2024-08-06 01:11:27,927][52664] Sum rewards: 44.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.213', 'weapon4': '0.278', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.050', 'HITCOUNT': '2.610', 'weapon3': '2.970', 'DAMAGECOUNT': '12.171', 'FRAGCOUNT': '38.500'} [2024-08-06 01:11:28,179][52650] Updated weights for policy 0, policy_version 28451 (0.0011) [2024-08-06 01:11:28,216][52659] DAMAGECOUNT value on done: 179515.0 [2024-08-06 01:11:28,216][52659] Sum rewards: 66.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.404', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.144', 'AMMO4': '0.146', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:29,214][52647] DAMAGECOUNT value on done: 184515.0 [2024-08-06 01:11:29,214][52647] Sum rewards: 60.408, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.760', 'AMMO5': '0.003', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.184', 'weapon2': '0.198', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.650', 'weapon3': '3.036', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '55.000'} [2024-08-06 01:11:29,642][52665] DAMAGECOUNT value on done: 178919.0 [2024-08-06 01:11:29,642][52665] Sum rewards: 52.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.062', 'AMMO2': '0.050', 'AMMO3': '0.206', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'weapon2': '0.476', 'weapon4': '0.852', 'WEAPON3': '1.250', 'weapon3': '2.354', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '47.000'} [2024-08-06 01:11:30,136][52663] DAMAGECOUNT value on done: 178545.0 [2024-08-06 01:11:30,137][52663] Sum rewards: 53.240, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.970', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.236', 'WEAPON4': '0.300', 'AMMO3': '0.310', 'weapon2': '0.352', 'WEAPON3': '1.900', 'HITCOUNT': '3.210', 'weapon3': '3.218', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:30,406][52664] DAMAGECOUNT value on done: 186547.0 [2024-08-06 01:11:30,407][52664] Sum rewards: 65.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'ARMOR': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.128', 'AMMO3': '0.215', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.348', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '56.000'} [2024-08-06 01:11:31,044][52659] DAMAGECOUNT value on done: 174622.0 [2024-08-06 01:11:31,044][52659] Sum rewards: 61.685, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.963', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.304', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '52.000'} [2024-08-06 01:11:32,246][52647] DAMAGECOUNT value on done: 184914.0 [2024-08-06 01:11:32,246][52647] Sum rewards: 59.730, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.013', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.324', 'weapon2': '0.398', 'WEAPON3': '1.800', 'weapon3': '3.278', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:32,744][52665] DAMAGECOUNT value on done: 174385.0 [2024-08-06 01:11:32,744][52665] Sum rewards: 56.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.590', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.958', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '49.000'} [2024-08-06 01:11:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 233144320. Throughput: 0: 4410.9. Samples: 58286160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:11:32,794][52567] Avg episode reward: [(0, '59.584')] [2024-08-06 01:11:33,039][52650] Updated weights for policy 0, policy_version 28461 (0.0022) [2024-08-06 01:11:33,198][52663] DAMAGECOUNT value on done: 179057.0 [2024-08-06 01:11:33,198][52663] Sum rewards: 67.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.210', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:33,588][52664] DAMAGECOUNT value on done: 186376.0 [2024-08-06 01:11:33,592][52664] Sum rewards: 58.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.056', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.255', 'weapon2': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.286', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '52.000'} [2024-08-06 01:11:34,101][52659] DAMAGECOUNT value on done: 171903.0 [2024-08-06 01:11:34,101][52659] Sum rewards: 71.296, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.906', 'ARMOR': '0.004', 'AMMO2': '0.033', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.240', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '62.000'} [2024-08-06 01:11:35,095][52647] DAMAGECOUNT value on done: 183542.0 [2024-08-06 01:11:35,095][52647] Sum rewards: 58.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.632', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.145', 'weapon4': '0.180', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.862', 'WEAPON3': '0.900', 'weapon3': '2.658', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '47.000'} [2024-08-06 01:11:35,647][52665] DAMAGECOUNT value on done: 177297.0 [2024-08-06 01:11:35,647][52665] Sum rewards: 55.594, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.302', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.156', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.596', 'WEAPON3': '1.600', 'weapon3': '2.684', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:35,768][52663] DAMAGECOUNT value on done: 177621.0 [2024-08-06 01:11:35,769][52663] Sum rewards: 62.559, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.302', 'weapon4': '0.786', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:36,519][52664] DAMAGECOUNT value on done: 176556.0 [2024-08-06 01:11:36,519][52664] Sum rewards: 50.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.607', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.162', 'weapon5': '0.190', 'AMMO4': '0.221', 'weapon2': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '2.926', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '42.000'} [2024-08-06 01:11:36,779][52659] DAMAGECOUNT value on done: 169180.0 [2024-08-06 01:11:36,779][52659] Sum rewards: 56.641, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.110', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.222', 'weapon4': '0.288', 'weapon2': '0.544', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:37,668][52650] Updated weights for policy 0, policy_version 28471 (0.0027) [2024-08-06 01:11:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 233234432. Throughput: 0: 4407.6. Samples: 58312640. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:11:37,802][52567] Avg episode reward: [(0, '59.472')] [2024-08-06 01:11:37,831][52647] DAMAGECOUNT value on done: 180543.0 [2024-08-06 01:11:37,831][52647] Sum rewards: 63.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.358', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '53.000'} [2024-08-06 01:11:38,413][52665] DAMAGECOUNT value on done: 178152.0 [2024-08-06 01:11:38,413][52665] Sum rewards: 63.786, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.596', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.174', 'AMMO4': '0.189', 'weapon5': '0.218', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:38,572][52663] DAMAGECOUNT value on done: 172754.0 [2024-08-06 01:11:38,575][52663] Sum rewards: 53.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.578', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon4': '0.260', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.092', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '46.500'} [2024-08-06 01:11:39,110][52664] DAMAGECOUNT value on done: 191506.0 [2024-08-06 01:11:39,111][52664] Sum rewards: 54.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.068', 'weapon4': '0.134', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '47.000'} [2024-08-06 01:11:39,878][52659] DAMAGECOUNT value on done: 175843.0 [2024-08-06 01:11:39,879][52659] Sum rewards: 61.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.975', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.010', 'AMMO4': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.255', 'weapon2': '0.354', 'WEAPON3': '1.650', 'HITCOUNT': '3.220', 'weapon3': '3.296', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '53.000'} [2024-08-06 01:11:40,303][52647] DAMAGECOUNT value on done: 184098.0 [2024-08-06 01:11:40,306][52647] Sum rewards: 61.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.293', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.326', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:41,274][52665] DAMAGECOUNT value on done: 175172.0 [2024-08-06 01:11:41,276][52665] Sum rewards: 63.481, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO4': '0.214', 'AMMO3': '0.247', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '57.000'} [2024-08-06 01:11:41,550][52664] DAMAGECOUNT value on done: 185833.0 [2024-08-06 01:11:41,550][52664] Sum rewards: 49.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.183', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.958', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '44.000'} [2024-08-06 01:11:42,136][52650] Updated weights for policy 0, policy_version 28481 (0.0015) [2024-08-06 01:11:42,675][52647] DAMAGECOUNT value on done: 178293.0 [2024-08-06 01:11:42,675][52647] Sum rewards: 56.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.592', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.062', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.354', 'weapon4': '0.402', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '49.000'} [2024-08-06 01:11:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 233324544. Throughput: 0: 4404.9. Samples: 58339050. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:11:42,794][52567] Avg episode reward: [(0, '59.102')] [2024-08-06 01:11:42,998][52659] DAMAGECOUNT value on done: 176658.0 [2024-08-06 01:11:42,999][52659] Sum rewards: 66.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.608', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'weapon4': '0.156', 'weapon2': '0.230', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'weapon3': '3.412', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '59.000'} [2024-08-06 01:11:44,376][52664] DAMAGECOUNT value on done: 185830.0 [2024-08-06 01:11:44,376][52664] Sum rewards: 51.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon5': '0.120', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.316', 'weapon4': '0.482', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '2.884', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '41.000'} [2024-08-06 01:11:44,489][52665] DAMAGECOUNT value on done: 174369.0 [2024-08-06 01:11:44,489][52665] Sum rewards: 66.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.130', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:45,964][52647] DAMAGECOUNT value on done: 185776.0 [2024-08-06 01:11:45,968][52647] Sum rewards: 65.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.012', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'weapon4': '0.782', 'WEAPON3': '1.250', 'weapon3': '2.472', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '56.000'} [2024-08-06 01:11:46,018][52659] DAMAGECOUNT value on done: 179519.0 [2024-08-06 01:11:46,020][52659] Sum rewards: 58.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.257', 'weapon4': '0.280', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '50.000'} [2024-08-06 01:11:46,930][52650] Updated weights for policy 0, policy_version 28491 (0.0021) [2024-08-06 01:11:47,373][52664] DAMAGECOUNT value on done: 181807.0 [2024-08-06 01:11:47,374][52664] Sum rewards: 69.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.350', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.190', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.676', 'WEAPON3': '1.350', 'weapon3': '2.864', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '60.000'} [2024-08-06 01:11:47,385][52665] DAMAGECOUNT value on done: 175006.0 [2024-08-06 01:11:47,385][52665] Sum rewards: 67.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.405', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.195', 'weapon4': '0.274', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '55.500'} [2024-08-06 01:11:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 233414656. Throughput: 0: 4406.4. Samples: 58352340. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:11:47,794][52567] Avg episode reward: [(0, '59.428')] [2024-08-06 01:11:48,458][52659] DAMAGECOUNT value on done: 179361.0 [2024-08-06 01:11:48,459][52659] Sum rewards: 70.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.798', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.044', 'AMMO3': '0.119', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.654', 'weapon2': '0.706', 'WEAPON3': '0.950', 'weapon3': '2.502', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '56.000'} [2024-08-06 01:11:50,466][52665] DAMAGECOUNT value on done: 172119.0 [2024-08-06 01:11:50,467][52665] Sum rewards: 56.446, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.078', 'AMMO3': '0.154', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.346', 'WEAPON4': '0.450', 'weapon4': '0.504', 'WEAPON3': '0.850', 'weapon3': '2.860', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '46.000'} [2024-08-06 01:11:50,473][52664] DAMAGECOUNT value on done: 178919.0 [2024-08-06 01:11:50,475][52664] Sum rewards: 46.988, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.677', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.229', 'AMMO3': '0.234', 'weapon2': '0.302', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '2.894', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '41.000'} [2024-08-06 01:11:50,974][52794] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:11:51,557][52650] Updated weights for policy 0, policy_version 28501 (0.0021) [2024-08-06 01:11:51,628][52659] DAMAGECOUNT value on done: 175664.0 [2024-08-06 01:11:51,629][52659] Sum rewards: 74.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.382', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.404', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '62.000'} [2024-08-06 01:11:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 233496576. Throughput: 0: 4412.2. Samples: 58378780. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:11:52,794][52567] Avg episode reward: [(0, '59.738')] [2024-08-06 01:11:53,123][52664] DAMAGECOUNT value on done: 182953.0 [2024-08-06 01:11:53,123][52664] Sum rewards: 63.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.825', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.072', 'AMMO4': '0.171', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '54.000'} [2024-08-06 01:11:53,420][52665] DAMAGECOUNT value on done: 173919.0 [2024-08-06 01:11:53,421][52665] Sum rewards: 62.861, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'HEALTH': '0.015', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.278', 'weapon2': '0.606', 'WEAPON3': '0.850', 'weapon3': '2.884', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '49.000'} [2024-08-06 01:11:54,790][52659] DAMAGECOUNT value on done: 181530.0 [2024-08-06 01:11:54,790][52659] Sum rewards: 71.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.156', 'weapon5': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '58.000'} [2024-08-06 01:11:56,004][52650] Updated weights for policy 0, policy_version 28511 (0.0011) [2024-08-06 01:11:56,062][52665] DAMAGECOUNT value on done: 169918.0 [2024-08-06 01:11:56,062][52665] Sum rewards: 57.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.090', 'weapon4': '0.132', 'AMMO4': '0.167', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '49.000'} [2024-08-06 01:11:56,291][52664] DAMAGECOUNT value on done: 184184.0 [2024-08-06 01:11:56,293][52664] Sum rewards: 56.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.045', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.460', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '49.000'} [2024-08-06 01:11:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 233586688. Throughput: 0: 4406.4. Samples: 58405170. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:11:57,794][52567] Avg episode reward: [(0, '59.682')] [2024-08-06 01:11:57,895][52659] DAMAGECOUNT value on done: 180267.0 [2024-08-06 01:11:57,899][52659] Sum rewards: 61.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'weapon5': '0.024', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.180', 'weapon4': '0.376', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '51.000'} [2024-08-06 01:11:59,011][52665] DAMAGECOUNT value on done: 177295.0 [2024-08-06 01:11:59,023][52665] Sum rewards: 63.601, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.538', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.108', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'AMMO4': '0.260', 'WEAPON4': '0.450', 'weapon2': '0.492', 'weapon4': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.464', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '53.000'} [2024-08-06 01:11:59,405][52664] DAMAGECOUNT value on done: 180718.0 [2024-08-06 01:11:59,407][52664] Sum rewards: 60.446, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.062', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon2': '0.308', 'WEAPON3': '1.700', 'HITCOUNT': '3.110', 'weapon3': '3.278', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '55.000'} [2024-08-06 01:11:59,662][52668] DAMAGECOUNT value on done: 175321.0 [2024-08-06 01:11:59,662][52668] Sum rewards: 55.413, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.472', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.169', 'AMMO3': '0.221', 'weapon2': '0.538', 'WEAPON4': '0.550', 'weapon4': '0.856', 'WEAPON3': '1.400', 'weapon3': '2.210', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:00,763][52650] Updated weights for policy 0, policy_version 28521 (0.0027) [2024-08-06 01:12:01,870][52664] DAMAGECOUNT value on done: 183467.0 [2024-08-06 01:12:01,870][52664] Sum rewards: 52.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'weapon5': '0.158', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.488', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.718', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '45.000'} [2024-08-06 01:12:02,091][52665] DAMAGECOUNT value on done: 171959.0 [2024-08-06 01:12:02,091][52665] Sum rewards: 48.257, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.458', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO4': '0.222', 'AMMO3': '0.232', 'weapon5': '0.244', 'weapon4': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.250', 'HITCOUNT': '2.520', 'weapon3': '2.632', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '43.000'} [2024-08-06 01:12:02,217][52668] DAMAGECOUNT value on done: 182571.0 [2024-08-06 01:12:02,217][52668] Sum rewards: 57.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.450', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.330', 'weapon4': '0.380', 'WEAPON3': '1.000', 'weapon3': '2.948', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '47.000'} [2024-08-06 01:12:02,718][52795] DAMAGECOUNT value on done: 163108.0 [2024-08-06 01:12:02,719][52795] Sum rewards: 74.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.226', 'weapon2': '0.386', 'WEAPON4': '0.400', 'weapon4': '0.696', 'WEAPON3': '1.400', 'weapon3': '2.612', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '64.000'} [2024-08-06 01:12:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 233676800. Throughput: 0: 4409.1. Samples: 58418440. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:12:02,794][52567] Avg episode reward: [(0, '59.732')] [2024-08-06 01:12:05,010][52664] DAMAGECOUNT value on done: 185882.0 [2024-08-06 01:12:05,010][52664] Sum rewards: 65.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.559', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '55.000'} [2024-08-06 01:12:05,272][52668] DAMAGECOUNT value on done: 179121.0 [2024-08-06 01:12:05,275][52668] Sum rewards: 69.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.154', 'weapon2': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.458', 'WEAPON3': '0.850', 'weapon3': '3.108', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:05,347][52650] Updated weights for policy 0, policy_version 28531 (0.0013) [2024-08-06 01:12:05,825][52795] DAMAGECOUNT value on done: 159448.0 [2024-08-06 01:12:05,826][52795] Sum rewards: 59.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.182', 'AMMO3': '0.188', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.086', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:07,736][52664] DAMAGECOUNT value on done: 180301.0 [2024-08-06 01:12:07,737][52664] Sum rewards: 70.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.435', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'ARMOR': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.262', 'weapon2': '0.578', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '61.000'} [2024-08-06 01:12:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 233758720. Throughput: 0: 4406.9. Samples: 58444820. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:12:07,794][52567] Avg episode reward: [(0, '60.010')] [2024-08-06 01:12:08,532][52668] DAMAGECOUNT value on done: 179466.0 [2024-08-06 01:12:08,533][52668] Sum rewards: 58.307, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.254', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.057', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'AMMO4': '0.287', 'weapon2': '0.416', 'WEAPON4': '0.600', 'weapon4': '0.654', 'WEAPON3': '1.500', 'weapon3': '2.460', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '52.000'} [2024-08-06 01:12:08,951][52795] DAMAGECOUNT value on done: 161697.0 [2024-08-06 01:12:08,952][52795] Sum rewards: 53.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.775', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.144', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '45.000'} [2024-08-06 01:12:09,945][52650] Updated weights for policy 0, policy_version 28541 (0.0011) [2024-08-06 01:12:10,567][52664] DAMAGECOUNT value on done: 183329.0 [2024-08-06 01:12:10,567][52664] Sum rewards: 60.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO5': '0.007', 'AMMO2': '0.041', 'AMMO3': '0.156', 'weapon5': '0.172', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '49.000'} [2024-08-06 01:12:11,488][52668] DAMAGECOUNT value on done: 174961.0 [2024-08-06 01:12:11,489][52668] Sum rewards: 47.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.402', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.450', 'weapon4': '0.664', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.180', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '42.000'} [2024-08-06 01:12:12,147][52795] DAMAGECOUNT value on done: 162852.0 [2024-08-06 01:12:12,147][52795] Sum rewards: 64.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.474', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.754', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:12,296][52662] DAMAGECOUNT value on done: 181283.0 [2024-08-06 01:12:12,298][52662] Sum rewards: 51.264, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.184', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.344', 'weapon4': '0.374', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '44.000'} [2024-08-06 01:12:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 233848832. Throughput: 0: 4402.2. Samples: 58471130. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:12:12,794][52567] Avg episode reward: [(0, '59.996')] [2024-08-06 01:12:13,294][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:12:14,374][52668] DAMAGECOUNT value on done: 176091.0 [2024-08-06 01:12:14,378][52668] Sum rewards: 62.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO3': '0.185', 'weapon2': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.140', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '52.000'} [2024-08-06 01:12:14,735][52660] DAMAGECOUNT value on done: 176564.0 [2024-08-06 01:12:14,738][52660] Sum rewards: 66.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.772', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.086', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:14,772][52650] Updated weights for policy 0, policy_version 28551 (0.0020) [2024-08-06 01:12:14,988][52662] DAMAGECOUNT value on done: 185088.0 [2024-08-06 01:12:14,989][52662] Sum rewards: 66.931, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.496', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.254', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:15,312][52795] DAMAGECOUNT value on done: 167587.0 [2024-08-06 01:12:15,314][52795] Sum rewards: 64.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.048', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.352', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:17,013][52668] DAMAGECOUNT value on done: 178824.0 [2024-08-06 01:12:17,015][52668] Sum rewards: 56.486, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.030', 'AMMO4': '0.087', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.382', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.274', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '50.500'} [2024-08-06 01:12:17,303][52660] DAMAGECOUNT value on done: 174697.0 [2024-08-06 01:12:17,303][52660] Sum rewards: 55.086, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.310', 'AMMO5': '0.010', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.206', 'weapon4': '0.282', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.144', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '46.000'} [2024-08-06 01:12:17,726][52662] DAMAGECOUNT value on done: 184614.0 [2024-08-06 01:12:17,726][52662] Sum rewards: 63.948, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.368', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'weapon5': '0.054', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.930', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '52.000'} [2024-08-06 01:12:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 233938944. Throughput: 0: 4404.0. Samples: 58484340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:12:17,802][52567] Avg episode reward: [(0, '60.034')] [2024-08-06 01:12:18,457][52795] DAMAGECOUNT value on done: 163373.0 [2024-08-06 01:12:18,457][52795] Sum rewards: 70.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.226', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.468', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 01:12:19,544][52650] Updated weights for policy 0, policy_version 28561 (0.0031) [2024-08-06 01:12:20,052][52668] DAMAGECOUNT value on done: 180799.0 [2024-08-06 01:12:20,054][52668] Sum rewards: 55.763, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.335', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.382', 'weapon4': '0.436', 'WEAPON3': '0.900', 'HITCOUNT': '2.660', 'weapon3': '2.938', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '45.000'} [2024-08-06 01:12:20,367][52660] DAMAGECOUNT value on done: 177506.0 [2024-08-06 01:12:20,370][52660] Sum rewards: 54.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO3': '0.135', 'AMMO4': '0.142', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.656', 'WEAPON3': '0.900', 'weapon3': '2.356', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '44.000'} [2024-08-06 01:12:20,799][52662] DAMAGECOUNT value on done: 173297.0 [2024-08-06 01:12:20,801][52662] Sum rewards: 40.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.246', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon4': '0.056', 'weapon5': '0.150', 'AMMO3': '0.221', 'AMMO4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.680', 'WEAPON3': '1.350', 'HITCOUNT': '2.380', 'weapon3': '2.902', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '35.500'} [2024-08-06 01:12:21,570][52795] DAMAGECOUNT value on done: 169419.0 [2024-08-06 01:12:21,571][52795] Sum rewards: 68.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.402', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.282', 'weapon4': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:22,332][52658] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2024-08-06 01:12:22,578][52795] Large shaping reward 2.510 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.459, 153.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:12:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 234029056. Throughput: 0: 4404.4. Samples: 58510840. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:12:22,795][52567] Avg episode reward: [(0, '59.993')] [2024-08-06 01:12:22,934][52668] DAMAGECOUNT value on done: 177739.0 [2024-08-06 01:12:22,934][52668] Sum rewards: 68.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:23,193][52662] DAMAGECOUNT value on done: 182564.0 [2024-08-06 01:12:23,195][52662] Sum rewards: 71.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.775', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'weapon4': '0.080', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.265', 'weapon2': '0.280', 'WEAPON3': '1.750', 'weapon3': '3.334', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '62.000'} [2024-08-06 01:12:23,209][52660] DAMAGECOUNT value on done: 178368.0 [2024-08-06 01:12:23,210][52660] Sum rewards: 57.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.331', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.177', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '51.000'} [2024-08-06 01:12:23,930][52650] Updated weights for policy 0, policy_version 28571 (0.0027) [2024-08-06 01:12:24,347][52667] DAMAGECOUNT value on done: 177896.0 [2024-08-06 01:12:24,348][52667] Sum rewards: 59.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon4': '0.092', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.102', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '50.500'} [2024-08-06 01:12:24,606][52795] DAMAGECOUNT value on done: 166107.0 [2024-08-06 01:12:24,606][52795] Sum rewards: 62.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.534', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.202', 'weapon5': '0.206', 'AMMO3': '0.226', 'weapon4': '0.258', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '52.000'} [2024-08-06 01:12:26,124][52668] DAMAGECOUNT value on done: 179810.0 [2024-08-06 01:12:26,125][52668] Sum rewards: 57.612, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.070', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.126', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'AMMO4': '0.283', 'weapon2': '0.354', 'WEAPON4': '0.500', 'weapon4': '0.632', 'WEAPON3': '1.150', 'weapon3': '2.612', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '49.500'} [2024-08-06 01:12:26,294][52660] DAMAGECOUNT value on done: 176982.0 [2024-08-06 01:12:26,295][52660] Sum rewards: 70.605, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.968', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.262', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '65.000'} [2024-08-06 01:12:26,332][52662] DAMAGECOUNT value on done: 179453.0 [2024-08-06 01:12:26,332][52662] Sum rewards: 49.741, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.851', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.088', 'AMMO3': '0.148', 'AMMO4': '0.180', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.568', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '41.000'} [2024-08-06 01:12:26,795][52667] DAMAGECOUNT value on done: 179265.0 [2024-08-06 01:12:26,796][52667] Sum rewards: 66.557, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO3': '0.142', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.504', 'WEAPON3': '0.900', 'weapon3': '2.866', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '54.500'} [2024-08-06 01:12:27,764][52795] DAMAGECOUNT value on done: 162499.0 [2024-08-06 01:12:27,765][52795] Sum rewards: 48.731, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.735', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.666', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '42.000'} [2024-08-06 01:12:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234119168. Throughput: 0: 4400.4. Samples: 58537070. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:12:27,794][52567] Avg episode reward: [(0, '60.301')] [2024-08-06 01:12:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028579_234119168.pth... [2024-08-06 01:12:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028063_229892096.pth [2024-08-06 01:12:28,775][52668] DAMAGECOUNT value on done: 179158.0 [2024-08-06 01:12:28,775][52668] Sum rewards: 62.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.306', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.310', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:28,895][52650] Updated weights for policy 0, policy_version 28581 (0.0025) [2024-08-06 01:12:29,015][52660] DAMAGECOUNT value on done: 174387.0 [2024-08-06 01:12:29,016][52660] Sum rewards: 53.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.309', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'weapon4': '0.304', 'weapon2': '0.860', 'WEAPON3': '1.350', 'weapon3': '2.538', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '46.000'} [2024-08-06 01:12:29,491][52662] DAMAGECOUNT value on done: 182925.0 [2024-08-06 01:12:29,493][52662] Sum rewards: 65.551, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.084', 'AMMO5': '0.007', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.044', 'weapon5': '0.128', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.390', 'WEAPON3': '0.850', 'weapon3': '2.902', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '52.000'} [2024-08-06 01:12:29,586][52667] DAMAGECOUNT value on done: 179495.0 [2024-08-06 01:12:29,594][52667] Sum rewards: 52.453, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.875', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.216', 'AMMO3': '0.321', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.950', 'HITCOUNT': '3.050', 'weapon3': '3.056', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:30,862][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:12:30,967][52795] DAMAGECOUNT value on done: 166938.0 [2024-08-06 01:12:30,967][52795] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.806', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.068', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'weapon4': '0.246', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.500'} [2024-08-06 01:12:31,276][52668] DAMAGECOUNT value on done: 174519.0 [2024-08-06 01:12:31,277][52668] Sum rewards: 46.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.174', 'AMMO4': '0.210', 'AMMO3': '0.245', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.500', 'weapon3': '2.642', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '42.500'} [2024-08-06 01:12:31,488][52660] DAMAGECOUNT value on done: 179202.0 [2024-08-06 01:12:31,490][52660] Sum rewards: 50.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.124', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.416', 'weapon4': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '43.000'} [2024-08-06 01:12:32,329][52662] DAMAGECOUNT value on done: 186727.0 [2024-08-06 01:12:32,332][52662] Sum rewards: 54.116, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.632', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.058', 'weapon5': '0.058', 'WEAPON5': '0.250', 'weapon4': '0.274', 'AMMO4': '0.288', 'AMMO3': '0.295', 'weapon2': '0.370', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '3.012', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '53.500'} [2024-08-06 01:12:32,461][52614] Signal inference workers to stop experience collection... (5250 times) [2024-08-06 01:12:32,463][52614] Signal inference workers to resume experience collection... (5250 times) [2024-08-06 01:12:32,530][52650] InferenceWorker_p0-w0: stopping experience collection (5250 times) [2024-08-06 01:12:32,531][52650] InferenceWorker_p0-w0: resuming experience collection (5250 times) [2024-08-06 01:12:32,652][52794] DAMAGECOUNT value on done: 182505.0 [2024-08-06 01:12:32,653][52794] Sum rewards: 45.780, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.092', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.018', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO4': '0.129', 'weapon2': '0.266', 'AMMO3': '0.361', 'WEAPON3': '2.050', 'HITCOUNT': '2.910', 'weapon3': '3.322', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '46.000'} [2024-08-06 01:12:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234201088. Throughput: 0: 4393.3. Samples: 58550040. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:12:32,794][52567] Avg episode reward: [(0, '59.611')] [2024-08-06 01:12:32,824][52667] DAMAGECOUNT value on done: 174960.0 [2024-08-06 01:12:32,826][52667] Sum rewards: 61.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.768', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.230', 'weapon4': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '53.000'} [2024-08-06 01:12:33,326][52650] Updated weights for policy 0, policy_version 28591 (0.0014) [2024-08-06 01:12:34,084][52795] DAMAGECOUNT value on done: 164057.0 [2024-08-06 01:12:34,085][52795] Sum rewards: 59.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.390', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.276', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '51.000'} [2024-08-06 01:12:34,294][52668] DAMAGECOUNT value on done: 169019.0 [2024-08-06 01:12:34,296][52668] Sum rewards: 56.813, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.448', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.470', 'weapon2': '0.740', 'WEAPON3': '0.900', 'weapon3': '2.554', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '45.500'} [2024-08-06 01:12:34,395][52660] DAMAGECOUNT value on done: 179368.0 [2024-08-06 01:12:34,396][52660] Sum rewards: 75.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'weapon4': '0.192', 'AMMO3': '0.203', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '63.000'} [2024-08-06 01:12:34,963][52662] DAMAGECOUNT value on done: 180212.0 [2024-08-06 01:12:34,964][52662] Sum rewards: 57.738, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.612', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.136', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '0.950', 'weapon3': '2.634', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '47.000'} [2024-08-06 01:12:35,238][52794] DAMAGECOUNT value on done: 185743.0 [2024-08-06 01:12:35,238][52794] Sum rewards: 55.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.402', 'weapon4': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.864', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:35,552][52667] DAMAGECOUNT value on done: 179961.0 [2024-08-06 01:12:35,555][52667] Sum rewards: 61.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.540', 'WEAPON3': '1.400', 'weapon3': '2.908', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '55.000'} [2024-08-06 01:12:36,404][52669] DAMAGECOUNT value on done: 181482.0 [2024-08-06 01:12:36,405][52669] Sum rewards: 57.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.014', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:36,797][52668] DAMAGECOUNT value on done: 174881.0 [2024-08-06 01:12:36,797][52668] Sum rewards: 58.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.276', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.206', 'AMMO3': '0.232', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:37,064][52660] DAMAGECOUNT value on done: 179094.0 [2024-08-06 01:12:37,066][52660] Sum rewards: 71.236, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.232', 'weapon4': '0.618', 'WEAPON3': '0.900', 'HEALTH': '0.976', 'weapon3': '2.932', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '57.000'} [2024-08-06 01:12:37,170][52795] DAMAGECOUNT value on done: 161566.0 [2024-08-06 01:12:37,170][52795] Sum rewards: 50.732, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.944', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.118', 'weapon5': '0.226', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.500', 'weapon2': '0.722', 'WEAPON3': '0.800', 'weapon3': '2.176', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.330', 'FRAGCOUNT': '41.500'} [2024-08-06 01:12:37,489][52662] DAMAGECOUNT value on done: 187428.0 [2024-08-06 01:12:37,492][52662] Sum rewards: 60.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.642', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.215', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '50.500'} [2024-08-06 01:12:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234291200. Throughput: 0: 4393.3. Samples: 58576480. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:12:37,794][52567] Avg episode reward: [(0, '60.021')] [2024-08-06 01:12:38,011][52794] DAMAGECOUNT value on done: 180292.0 [2024-08-06 01:12:38,013][52794] Sum rewards: 60.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.646', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.058', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.390', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.500'} [2024-08-06 01:12:38,194][52650] Updated weights for policy 0, policy_version 28601 (0.0011) [2024-08-06 01:12:38,416][52667] DAMAGECOUNT value on done: 180768.0 [2024-08-06 01:12:38,419][52667] Sum rewards: 54.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.057', 'weapon5': '0.198', 'AMMO3': '0.217', 'weapon2': '0.232', 'AMMO4': '0.285', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '2.956', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '47.000'} [2024-08-06 01:12:39,478][52668] DAMAGECOUNT value on done: 173094.0 [2024-08-06 01:12:39,478][52668] Sum rewards: 62.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.227', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.144', 'weapon4': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '2.926', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:39,682][52669] DAMAGECOUNT value on done: 177557.0 [2024-08-06 01:12:39,683][52669] Sum rewards: 48.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.167', 'weapon5': '0.218', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.000', 'weapon3': '2.540', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '41.000'} [2024-08-06 01:12:39,762][52660] DAMAGECOUNT value on done: 174987.0 [2024-08-06 01:12:39,763][52660] Sum rewards: 65.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.954', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.740', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '57.000'} [2024-08-06 01:12:40,222][52795] DAMAGECOUNT value on done: 161542.0 [2024-08-06 01:12:40,222][52795] Sum rewards: 52.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.404', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.168', 'AMMO4': '0.179', 'AMMO3': '0.220', 'weapon4': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '46.000'} [2024-08-06 01:12:40,563][52662] DAMAGECOUNT value on done: 180148.0 [2024-08-06 01:12:40,565][52662] Sum rewards: 64.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon7': '0.046', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.184', 'WEAPON7': '0.200', 'weapon2': '0.372', 'WEAPON4': '0.450', 'weapon4': '0.758', 'WEAPON3': '1.150', 'weapon3': '2.482', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 01:12:41,066][52667] DAMAGECOUNT value on done: 181036.0 [2024-08-06 01:12:41,066][52667] Sum rewards: 43.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.090', 'AMMO4': '0.176', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.674', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '39.000'} [2024-08-06 01:12:41,076][52794] DAMAGECOUNT value on done: 178382.0 [2024-08-06 01:12:41,079][52794] Sum rewards: 66.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '0.005', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.200', 'weapon2': '0.384', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:42,182][52668] DAMAGECOUNT value on done: 178110.0 [2024-08-06 01:12:42,182][52668] Sum rewards: 70.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.199', 'weapon2': '0.316', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '58.000'} [2024-08-06 01:12:42,424][52660] DAMAGECOUNT value on done: 182518.0 [2024-08-06 01:12:42,426][52660] Sum rewards: 67.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.547', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.084', 'AMMO3': '0.202', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:42,636][52669] DAMAGECOUNT value on done: 179104.0 [2024-08-06 01:12:42,639][52669] Sum rewards: 69.992, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.032', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.236', 'AMMO3': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.850', 'weapon3': '3.236', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '62.000'} [2024-08-06 01:12:42,645][52650] Updated weights for policy 0, policy_version 28611 (0.0022) [2024-08-06 01:12:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234381312. Throughput: 0: 4392.2. Samples: 58602820. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:12:42,794][52567] Avg episode reward: [(0, '60.048')] [2024-08-06 01:12:43,136][52662] DAMAGECOUNT value on done: 182890.0 [2024-08-06 01:12:43,136][52662] Sum rewards: 59.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.726', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.032', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.348', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.386', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '49.000'} [2024-08-06 01:12:43,362][52795] DAMAGECOUNT value on done: 165913.0 [2024-08-06 01:12:43,363][52795] Sum rewards: 70.372, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.908', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.132', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '59.000'} [2024-08-06 01:12:43,660][52794] DAMAGECOUNT value on done: 182123.0 [2024-08-06 01:12:43,661][52794] Sum rewards: 67.900, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.364', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.442', 'weapon2': '0.456', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '55.000'} [2024-08-06 01:12:43,684][52667] DAMAGECOUNT value on done: 178071.0 [2024-08-06 01:12:43,685][52667] Sum rewards: 44.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.642', 'WEAPON3': '1.550', 'weapon3': '2.612', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '41.000'} [2024-08-06 01:12:45,184][52668] DAMAGECOUNT value on done: 177453.0 [2024-08-06 01:12:45,185][52668] Sum rewards: 57.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.032', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.232', 'weapon4': '0.254', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.254', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:45,192][52669] DAMAGECOUNT value on done: 176627.0 [2024-08-06 01:12:45,193][52669] Sum rewards: 46.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.604', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.136', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.010', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '41.500'} [2024-08-06 01:12:45,554][52660] DAMAGECOUNT value on done: 172423.0 [2024-08-06 01:12:45,554][52660] Sum rewards: 53.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.352', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '43.500'} [2024-08-06 01:12:46,036][52662] DAMAGECOUNT value on done: 179159.0 [2024-08-06 01:12:46,037][52662] Sum rewards: 55.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.106', 'AMMO3': '0.173', 'AMMO4': '0.223', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.616', 'weapon4': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.278', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '47.000'} [2024-08-06 01:12:46,189][52667] DAMAGECOUNT value on done: 178338.0 [2024-08-06 01:12:46,189][52667] Sum rewards: 62.385, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.682', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.654', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '51.000'} [2024-08-06 01:12:46,406][52795] DAMAGECOUNT value on done: 161278.0 [2024-08-06 01:12:46,409][52795] Sum rewards: 52.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.622', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.221', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.218', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '44.000'} [2024-08-06 01:12:46,497][52794] DAMAGECOUNT value on done: 179241.0 [2024-08-06 01:12:46,497][52794] Sum rewards: 59.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.627', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.420', 'weapon2': '0.872', 'WEAPON3': '0.950', 'weapon3': '2.562', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:47,300][52650] Updated weights for policy 0, policy_version 28621 (0.0018) [2024-08-06 01:12:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 234463232. Throughput: 0: 4391.8. Samples: 58616070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:12:47,794][52567] Avg episode reward: [(0, '60.006')] [2024-08-06 01:12:48,035][52668] DAMAGECOUNT value on done: 180061.0 [2024-08-06 01:12:48,035][52668] Sum rewards: 69.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon4': '0.386', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.764', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '58.000'} [2024-08-06 01:12:48,236][52660] DAMAGECOUNT value on done: 177553.0 [2024-08-06 01:12:48,237][52660] Sum rewards: 57.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.224', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.056', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon2': '0.586', 'weapon4': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.550', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '48.000'} [2024-08-06 01:12:48,371][52669] DAMAGECOUNT value on done: 177304.0 [2024-08-06 01:12:48,371][52669] Sum rewards: 46.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.532', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.150', 'AMMO4': '0.157', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.914', 'WEAPON3': '1.000', 'weapon3': '2.236', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '40.000'} [2024-08-06 01:12:48,679][52662] DAMAGECOUNT value on done: 185124.0 [2024-08-06 01:12:48,680][52662] Sum rewards: 68.421, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.950', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'weapon4': '0.186', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '61.000'} [2024-08-06 01:12:49,256][52667] DAMAGECOUNT value on done: 179851.0 [2024-08-06 01:12:49,258][52667] Sum rewards: 62.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.216', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.508', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '53.000'} [2024-08-06 01:12:49,419][52794] DAMAGECOUNT value on done: 186729.0 [2024-08-06 01:12:49,421][52794] Sum rewards: 64.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:49,586][52795] DAMAGECOUNT value on done: 168701.0 [2024-08-06 01:12:49,586][52795] Sum rewards: 51.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.287', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.123', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.140', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '45.000'} [2024-08-06 01:12:50,044][52666] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:12:50,935][52668] DAMAGECOUNT value on done: 180819.0 [2024-08-06 01:12:50,936][52668] Sum rewards: 64.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.901', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.120', 'AMMO3': '0.140', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.546', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '52.000'} [2024-08-06 01:12:51,260][52660] DAMAGECOUNT value on done: 179864.0 [2024-08-06 01:12:51,260][52660] Sum rewards: 59.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.786', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.073', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.402', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '51.000'} [2024-08-06 01:12:51,499][52662] DAMAGECOUNT value on done: 181634.0 [2024-08-06 01:12:51,500][52662] Sum rewards: 54.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.689', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.056', 'AMMO3': '0.161', 'weapon5': '0.202', 'AMMO4': '0.281', 'WEAPON5': '0.300', 'weapon2': '0.322', 'weapon4': '0.540', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '46.000'} [2024-08-06 01:12:51,514][52669] DAMAGECOUNT value on done: 176522.0 [2024-08-06 01:12:51,515][52669] Sum rewards: 66.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.224', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:52,052][52650] Updated weights for policy 0, policy_version 28631 (0.0021) [2024-08-06 01:12:52,104][52794] DAMAGECOUNT value on done: 182217.0 [2024-08-06 01:12:52,105][52794] Sum rewards: 58.054, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.116', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.092', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.202', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '51.000'} [2024-08-06 01:12:52,390][52667] DAMAGECOUNT value on done: 180466.0 [2024-08-06 01:12:52,391][52667] Sum rewards: 49.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO2': '0.068', 'AMMO3': '0.201', 'AMMO4': '0.342', 'weapon2': '0.502', 'WEAPON4': '0.700', 'weapon4': '0.706', 'WEAPON3': '1.250', 'weapon3': '2.402', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '47.000'} [2024-08-06 01:12:52,710][52795] DAMAGECOUNT value on done: 169107.0 [2024-08-06 01:12:52,710][52795] Sum rewards: 55.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.188', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'AMMO4': '0.203', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.802', 'WEAPON3': '1.150', 'weapon3': '2.476', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '47.000'} [2024-08-06 01:12:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 234553344. Throughput: 0: 4394.0. Samples: 58642550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:12:52,794][52567] Avg episode reward: [(0, '59.369')] [2024-08-06 01:12:53,644][52668] DAMAGECOUNT value on done: 179219.0 [2024-08-06 01:12:53,644][52668] Sum rewards: 53.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.532', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.640', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '45.000'} [2024-08-06 01:12:53,818][52660] DAMAGECOUNT value on done: 189029.0 [2024-08-06 01:12:53,818][52660] Sum rewards: 55.318, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.347', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.160', 'AMMO3': '0.176', 'AMMO4': '0.289', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON4': '0.650', 'weapon4': '0.742', 'WEAPON3': '1.100', 'weapon3': '2.344', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '51.000'} [2024-08-06 01:12:54,574][52669] DAMAGECOUNT value on done: 179419.0 [2024-08-06 01:12:54,574][52669] Sum rewards: 54.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.669', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon4': '0.242', 'weapon2': '0.662', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '47.000'} [2024-08-06 01:12:54,731][52662] DAMAGECOUNT value on done: 185965.0 [2024-08-06 01:12:54,733][52662] Sum rewards: 68.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.533', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.240', 'weapon4': '0.398', 'weapon2': '0.646', 'WEAPON3': '1.500', 'weapon3': '2.682', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '60.000'} [2024-08-06 01:12:55,113][52667] DAMAGECOUNT value on done: 177595.0 [2024-08-06 01:12:55,113][52667] Sum rewards: 57.896, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.735', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.072', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.215', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.524', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:55,272][52794] DAMAGECOUNT value on done: 184217.0 [2024-08-06 01:12:55,273][52794] Sum rewards: 65.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.709', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.448', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:55,859][52795] DAMAGECOUNT value on done: 160085.0 [2024-08-06 01:12:55,859][52795] Sum rewards: 62.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.508', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon7': '0.028', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.178', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'weapon4': '0.344', 'WEAPON4': '0.450', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '52.000'} [2024-08-06 01:12:56,721][52660] DAMAGECOUNT value on done: 175452.0 [2024-08-06 01:12:56,722][52660] Sum rewards: 59.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.035', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.177', 'weapon4': '0.310', 'WEAPON4': '0.400', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '49.000'} [2024-08-06 01:12:56,845][52650] Updated weights for policy 0, policy_version 28641 (0.0028) [2024-08-06 01:12:57,067][52669] DAMAGECOUNT value on done: 178625.0 [2024-08-06 01:12:57,068][52662] DAMAGECOUNT value on done: 178523.0 [2024-08-06 01:12:57,070][52669] Sum rewards: 57.227, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.101', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.225', 'weapon4': '0.422', 'WEAPON4': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.798', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '53.000'} [2024-08-06 01:12:57,070][52662] Sum rewards: 62.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:57,632][52794] DAMAGECOUNT value on done: 186207.0 [2024-08-06 01:12:57,633][52794] Sum rewards: 56.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.665', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO3': '0.174', 'AMMO4': '0.193', 'weapon4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '50.000'} [2024-08-06 01:12:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234643456. Throughput: 0: 4393.3. Samples: 58668830. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:12:57,794][52567] Avg episode reward: [(0, '59.356')] [2024-08-06 01:12:58,208][52667] DAMAGECOUNT value on done: 181043.0 [2024-08-06 01:12:58,209][52667] Sum rewards: 64.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.138', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.067', 'AMMO3': '0.172', 'weapon5': '0.212', 'AMMO4': '0.336', 'weapon4': '0.394', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '56.000'} [2024-08-06 01:12:58,943][52795] DAMAGECOUNT value on done: 169935.0 [2024-08-06 01:12:58,943][52795] Sum rewards: 60.224, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.358', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.380', 'WEAPON3': '1.700', 'weapon3': '2.914', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '54.000'} [2024-08-06 01:12:59,583][52660] DAMAGECOUNT value on done: 180771.0 [2024-08-06 01:12:59,585][52660] Sum rewards: 76.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '62.000'} [2024-08-06 01:12:59,931][52662] DAMAGECOUNT value on done: 182173.0 [2024-08-06 01:12:59,932][52662] Sum rewards: 64.130, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.800', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:00,054][52669] DAMAGECOUNT value on done: 178303.0 [2024-08-06 01:13:00,054][52669] Sum rewards: 47.462, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.270', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.214', 'AMMO3': '0.247', 'weapon4': '0.398', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.500', 'HITCOUNT': '2.750', 'weapon3': '2.850', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:00,591][52794] DAMAGECOUNT value on done: 179822.0 [2024-08-06 01:13:00,593][52794] Sum rewards: 58.430, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.451', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.221', 'AMMO3': '0.272', 'weapon2': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.746', 'WEAPON3': '1.600', 'weapon3': '2.480', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:01,282][52650] Updated weights for policy 0, policy_version 28651 (0.0029) [2024-08-06 01:13:01,462][52667] DAMAGECOUNT value on done: 175549.0 [2024-08-06 01:13:01,464][52667] Sum rewards: 56.463, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.683', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.051', 'AMMO3': '0.190', 'weapon5': '0.210', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.466', 'weapon4': '0.598', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.426', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:02,045][52795] DAMAGECOUNT value on done: 169907.0 [2024-08-06 01:13:02,045][52795] Sum rewards: 70.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.644', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '58.000'} [2024-08-06 01:13:02,435][52660] DAMAGECOUNT value on done: 170303.0 [2024-08-06 01:13:02,438][52660] Sum rewards: 62.228, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.715', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.056', 'weapon5': '0.126', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'AMMO4': '0.279', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.756', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:02,490][52662] DAMAGECOUNT value on done: 180340.0 [2024-08-06 01:13:02,491][52662] Sum rewards: 56.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.006', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.159', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.748', 'WEAPON3': '0.900', 'weapon3': '2.804', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '47.500'} [2024-08-06 01:13:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 234725376. Throughput: 0: 4390.9. Samples: 58681930. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:13:02,794][52567] Avg episode reward: [(0, '59.557')] [2024-08-06 01:13:03,006][52669] DAMAGECOUNT value on done: 176374.0 [2024-08-06 01:13:03,009][52669] Sum rewards: 58.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.256', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.124', 'AMMO4': '0.183', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:03,204][52794] DAMAGECOUNT value on done: 181384.0 [2024-08-06 01:13:03,204][52794] Sum rewards: 56.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.964', 'AMMO2': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.190', 'AMMO3': '0.241', 'weapon2': '0.258', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.314', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:04,626][52667] DAMAGECOUNT value on done: 182786.0 [2024-08-06 01:13:04,628][52667] Sum rewards: 57.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.680', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.234', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:05,231][52662] DAMAGECOUNT value on done: 178802.0 [2024-08-06 01:13:05,252][52662] Sum rewards: 51.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.352', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.216', 'weapon2': '0.374', 'WEAPON4': '0.700', 'weapon4': '0.744', 'WEAPON3': '1.200', 'weapon3': '2.562', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:05,633][52669] DAMAGECOUNT value on done: 180328.0 [2024-08-06 01:13:05,634][52669] Sum rewards: 73.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.211', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.244', 'weapon4': '0.244', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '62.000'} [2024-08-06 01:13:05,671][52794] DAMAGECOUNT value on done: 176742.0 [2024-08-06 01:13:05,672][52794] Sum rewards: 59.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.094', 'AMMO3': '0.195', 'AMMO4': '0.226', 'weapon4': '0.392', 'WEAPON4': '0.400', 'weapon2': '0.826', 'WEAPON3': '1.200', 'weapon3': '2.492', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:05,750][52660] DAMAGECOUNT value on done: 181070.0 [2024-08-06 01:13:05,751][52660] Sum rewards: 60.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.775', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon2': '0.218', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:06,292][52650] Updated weights for policy 0, policy_version 28661 (0.0014) [2024-08-06 01:13:06,357][52658] DAMAGECOUNT value on done: 183148.0 [2024-08-06 01:13:06,358][52658] Sum rewards: 56.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.121', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.054', 'weapon5': '0.160', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'weapon2': '0.278', 'WEAPON4': '0.500', 'weapon4': '0.636', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:07,347][52667] DAMAGECOUNT value on done: 185741.0 [2024-08-06 01:13:07,349][52667] Sum rewards: 61.122, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon5': '0.122', 'HEALTH': '0.166', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:07,789][52803] DAMAGECOUNT value on done: 167606.0 [2024-08-06 01:13:07,790][52803] Sum rewards: 58.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.960', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.164', 'AMMO4': '0.194', 'AMMO3': '0.201', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '50.500'} [2024-08-06 01:13:07,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 234815488. Throughput: 0: 4383.5. Samples: 58708100. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 01:13:07,795][52567] Avg episode reward: [(0, '59.376')] [2024-08-06 01:13:07,928][52668] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:13:08,078][52794] DAMAGECOUNT value on done: 189977.0 [2024-08-06 01:13:08,078][52794] Sum rewards: 50.396, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.818', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.156', 'AMMO4': '0.157', 'AMMO3': '0.254', 'weapon2': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:08,451][52660] DAMAGECOUNT value on done: 173965.0 [2024-08-06 01:13:08,453][52660] Sum rewards: 42.178, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.632', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon5': '0.206', 'AMMO4': '0.215', 'AMMO3': '0.223', 'weapon2': '0.350', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '39.500'} [2024-08-06 01:13:08,480][52669] DAMAGECOUNT value on done: 179760.0 [2024-08-06 01:13:08,480][52669] Sum rewards: 57.900, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.982', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon4': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.700', 'weapon3': '2.702', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:08,911][52658] DAMAGECOUNT value on done: 179730.0 [2024-08-06 01:13:08,911][52658] Sum rewards: 64.240, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.899', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'weapon2': '0.632', 'weapon4': '0.784', 'WEAPON3': '1.050', 'weapon3': '2.194', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:09,778][52667] DAMAGECOUNT value on done: 183522.0 [2024-08-06 01:13:09,779][52667] Sum rewards: 47.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.108', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.082', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'WEAPON4': '0.350', 'weapon2': '0.412', 'weapon4': '0.698', 'WEAPON3': '0.900', 'HITCOUNT': '2.500', 'weapon3': '2.570', 'DAMAGECOUNT': '11.679', 'FRAGCOUNT': '39.000'} [2024-08-06 01:13:10,443][52820] DAMAGECOUNT value on done: 163178.0 [2024-08-06 01:13:10,445][52820] Sum rewards: 58.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.663', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.056', 'AMMO4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON4': '0.450', 'weapon4': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.418', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:10,638][52650] Updated weights for policy 0, policy_version 28671 (0.0025) [2024-08-06 01:13:10,923][52803] DAMAGECOUNT value on done: 171167.0 [2024-08-06 01:13:10,925][52803] Sum rewards: 54.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.617', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.056', 'AMMO4': '0.121', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '47.000'} [2024-08-06 01:13:11,088][52794] DAMAGECOUNT value on done: 178659.0 [2024-08-06 01:13:11,088][52794] Sum rewards: 70.566, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.348', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon4': '0.338', 'weapon2': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:11,358][52669] DAMAGECOUNT value on done: 176648.0 [2024-08-06 01:13:11,358][52669] Sum rewards: 60.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.789', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.119', 'AMMO4': '0.152', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon5': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon4': '0.878', 'weapon3': '2.210', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:11,511][52658] DAMAGECOUNT value on done: 183702.0 [2024-08-06 01:13:11,513][52658] Sum rewards: 66.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO2': '0.030', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.360', 'weapon4': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:12,409][52667] DAMAGECOUNT value on done: 184210.0 [2024-08-06 01:13:12,409][52667] Sum rewards: 60.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.876', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.162', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.050', 'weapon3': '2.924', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 234905600. Throughput: 0: 4389.3. Samples: 58734590. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 01:13:12,802][52567] Avg episode reward: [(0, '59.100')] [2024-08-06 01:13:13,533][52820] DAMAGECOUNT value on done: 164665.0 [2024-08-06 01:13:13,536][52820] Sum rewards: 62.722, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.163', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.302', 'weapon2': '0.394', 'WEAPON3': '1.000', 'weapon3': '3.018', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:13,899][52803] DAMAGECOUNT value on done: 166383.0 [2024-08-06 01:13:13,900][52803] Sum rewards: 68.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.304', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon4': '0.114', 'AMMO4': '0.163', 'AMMO3': '0.164', 'weapon5': '0.222', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:13,920][52669] DAMAGECOUNT value on done: 181642.0 [2024-08-06 01:13:13,920][52669] Sum rewards: 64.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.199', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:14,214][52794] DAMAGECOUNT value on done: 186218.0 [2024-08-06 01:13:14,217][52794] Sum rewards: 68.790, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.580', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.280', 'weapon2': '0.544', 'WEAPON3': '1.700', 'weapon3': '2.934', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.000'} [2024-08-06 01:13:14,498][52658] DAMAGECOUNT value on done: 182815.0 [2024-08-06 01:13:14,499][52658] Sum rewards: 72.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.003', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.148', 'AMMO4': '0.215', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '63.000'} [2024-08-06 01:13:15,329][52650] Updated weights for policy 0, policy_version 28681 (0.0019) [2024-08-06 01:13:15,420][52667] DAMAGECOUNT value on done: 178696.0 [2024-08-06 01:13:15,421][52667] Sum rewards: 60.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.851', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.054', 'weapon4': '0.072', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.446', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:16,664][52820] DAMAGECOUNT value on done: 162747.0 [2024-08-06 01:13:16,665][52820] Sum rewards: 59.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.814', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.158', 'weapon4': '0.182', 'weapon5': '0.188', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.856', 'WEAPON3': '0.900', 'weapon3': '2.530', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '48.000'} [2024-08-06 01:13:16,674][52669] DAMAGECOUNT value on done: 184900.0 [2024-08-06 01:13:16,675][52669] Sum rewards: 58.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.865', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:16,911][52811] DAMAGECOUNT value on done: 176503.0 [2024-08-06 01:13:16,912][52811] Sum rewards: 62.821, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.535', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO3': '0.148', 'AMMO4': '0.171', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.726', 'WEAPON3': '0.950', 'weapon3': '2.764', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:17,027][52794] DAMAGECOUNT value on done: 182735.0 [2024-08-06 01:13:17,029][52794] Sum rewards: 63.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.066', 'weapon4': '0.102', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.370', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:17,031][52803] DAMAGECOUNT value on done: 166940.0 [2024-08-06 01:13:17,032][52803] Sum rewards: 50.359, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO3': '0.132', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.348', 'weapon4': '0.364', 'WEAPON3': '0.900', 'HITCOUNT': '2.540', 'weapon3': '2.848', 'DAMAGECOUNT': '11.787', 'FRAGCOUNT': '41.000'} [2024-08-06 01:13:17,307][52666] DAMAGECOUNT value on done: 182368.0 [2024-08-06 01:13:17,307][52666] Sum rewards: 68.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.176', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.120', 'AMMO3': '0.173', 'AMMO4': '0.190', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '59.000'} [2024-08-06 01:13:17,377][52658] DAMAGECOUNT value on done: 181621.0 [2024-08-06 01:13:17,379][52658] Sum rewards: 58.894, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.157', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.086', 'AMMO3': '0.110', 'AMMO4': '0.110', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.700', 'weapon2': '0.834', 'weapon3': '2.802', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '44.500'} [2024-08-06 01:13:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 234995712. Throughput: 0: 4393.8. Samples: 58747760. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 01:13:17,794][52567] Avg episode reward: [(0, '59.770')] [2024-08-06 01:13:18,334][52667] DAMAGECOUNT value on done: 184411.0 [2024-08-06 01:13:18,335][52667] Sum rewards: 58.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.041', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.229', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.022', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:19,598][52669] DAMAGECOUNT value on done: 190931.0 [2024-08-06 01:13:19,599][52669] Sum rewards: 58.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.824', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.047', 'weapon5': '0.116', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.235', 'weapon2': '0.342', 'WEAPON4': '0.700', 'weapon4': '1.048', 'WEAPON3': '1.050', 'weapon3': '2.264', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:19,649][52794] DAMAGECOUNT value on done: 182469.0 [2024-08-06 01:13:19,649][52794] Sum rewards: 63.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.266', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '52.000'} [2024-08-06 01:13:19,793][52820] DAMAGECOUNT value on done: 157902.0 [2024-08-06 01:13:19,794][52820] Sum rewards: 63.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.415', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.300', 'weapon4': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:20,088][52811] DAMAGECOUNT value on done: 163347.0 [2024-08-06 01:13:20,089][52811] Sum rewards: 53.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.044', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.093', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.434', 'weapon4': '0.498', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:20,143][52650] Updated weights for policy 0, policy_version 28691 (0.0018) [2024-08-06 01:13:20,158][52803] DAMAGECOUNT value on done: 170958.0 [2024-08-06 01:13:20,159][52803] Sum rewards: 54.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.348', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.808', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '43.000'} [2024-08-06 01:13:20,320][52666] DAMAGECOUNT value on done: 183625.0 [2024-08-06 01:13:20,321][52666] Sum rewards: 59.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.672', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:20,390][52658] DAMAGECOUNT value on done: 177297.0 [2024-08-06 01:13:20,391][52658] Sum rewards: 71.532, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.108', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.064', 'weapon4': '0.082', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.270', 'WEAPON3': '1.400', 'weapon3': '3.294', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 01:13:22,034][52794] DAMAGECOUNT value on done: 188379.0 [2024-08-06 01:13:22,042][52794] Sum rewards: 69.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.093', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.096', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO4': '0.221', 'weapon4': '0.618', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '58.000'} [2024-08-06 01:13:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 235085824. Throughput: 0: 4394.2. Samples: 58774220. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 01:13:22,795][52567] Avg episode reward: [(0, '59.964')] [2024-08-06 01:13:22,804][52669] DAMAGECOUNT value on done: 180272.0 [2024-08-06 01:13:22,805][52669] Sum rewards: 59.579, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.458', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.068', 'AMMO4': '0.155', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.392', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:22,929][52820] DAMAGECOUNT value on done: 165344.0 [2024-08-06 01:13:22,934][52820] Sum rewards: 52.781, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.528', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.310', 'weapon2': '0.310', 'WEAPON3': '1.800', 'HITCOUNT': '3.010', 'weapon3': '3.234', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:23,269][52803] DAMAGECOUNT value on done: 166801.0 [2024-08-06 01:13:23,269][52803] Sum rewards: 66.755, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.890', 'AMMO2': '0.030', 'AMMO3': '0.121', 'AMMO4': '0.148', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.688', 'WEAPON3': '0.800', 'weapon3': '2.770', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '52.000'} [2024-08-06 01:13:23,331][52811] DAMAGECOUNT value on done: 168463.0 [2024-08-06 01:13:23,331][52811] Sum rewards: 53.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.844', 'AMMO5': '0.005', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'AMMO4': '0.259', 'weapon4': '0.580', 'WEAPON4': '0.600', 'weapon2': '0.788', 'WEAPON3': '1.150', 'weapon3': '2.376', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '47.000'} [2024-08-06 01:13:23,416][52666] DAMAGECOUNT value on done: 181457.0 [2024-08-06 01:13:23,417][52666] Sum rewards: 64.752, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.489', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.388', 'weapon4': '0.604', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '57.000'} [2024-08-06 01:13:23,455][52658] DAMAGECOUNT value on done: 186132.0 [2024-08-06 01:13:23,456][52658] Sum rewards: 69.511, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.415', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon2': '0.218', 'AMMO3': '0.271', 'WEAPON3': '1.550', 'weapon3': '3.568', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '61.000'} [2024-08-06 01:13:24,394][52671] Large shaping reward 2.525 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:13:24,458][52650] Updated weights for policy 0, policy_version 28701 (0.0017) [2024-08-06 01:13:24,639][52794] DAMAGECOUNT value on done: 182923.0 [2024-08-06 01:13:24,639][52794] Sum rewards: 56.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.822', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '47.000'} [2024-08-06 01:13:25,772][52669] DAMAGECOUNT value on done: 183489.0 [2024-08-06 01:13:25,777][52669] Sum rewards: 60.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.966', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.110', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'AMMO4': '0.261', 'WEAPON4': '0.500', 'weapon4': '0.558', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:26,051][52820] DAMAGECOUNT value on done: 163343.0 [2024-08-06 01:13:26,051][52820] Sum rewards: 65.239, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '58.000'} [2024-08-06 01:13:26,302][52658] DAMAGECOUNT value on done: 175674.0 [2024-08-06 01:13:26,303][52658] Sum rewards: 67.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.606', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.166', 'weapon5': '0.174', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '55.000'} [2024-08-06 01:13:26,357][52666] DAMAGECOUNT value on done: 179209.0 [2024-08-06 01:13:26,357][52666] Sum rewards: 70.384, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon4': '0.166', 'AMMO3': '0.214', 'weapon2': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '58.000'} [2024-08-06 01:13:26,405][52803] DAMAGECOUNT value on done: 170169.0 [2024-08-06 01:13:26,405][52803] Sum rewards: 58.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.204', 'weapon5': '0.222', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:26,462][52811] DAMAGECOUNT value on done: 167302.0 [2024-08-06 01:13:26,463][52811] Sum rewards: 49.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.198', 'AMMO4': '0.205', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '43.000'} [2024-08-06 01:13:26,801][52670] DAMAGECOUNT value on done: 177269.0 [2024-08-06 01:13:26,801][52670] Sum rewards: 59.661, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.075', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.496', 'WEAPON3': '1.750', 'weapon3': '2.864', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 235167744. Throughput: 0: 4388.9. Samples: 58800320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:13:27,794][52567] Avg episode reward: [(0, '59.867')] [2024-08-06 01:13:29,051][52669] DAMAGECOUNT value on done: 182204.0 [2024-08-06 01:13:29,053][52669] Sum rewards: 57.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.566', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.150', 'AMMO3': '0.190', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.714', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:29,143][52820] DAMAGECOUNT value on done: 166578.0 [2024-08-06 01:13:29,146][52820] Sum rewards: 60.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '52.000'} [2024-08-06 01:13:29,261][52650] Updated weights for policy 0, policy_version 28711 (0.0030) [2024-08-06 01:13:29,362][52658] DAMAGECOUNT value on done: 185644.0 [2024-08-06 01:13:29,364][52658] Sum rewards: 54.240, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.108', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon4': '0.170', 'weapon5': '0.190', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.028', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '48.500'} [2024-08-06 01:13:29,381][52666] DAMAGECOUNT value on done: 175444.0 [2024-08-06 01:13:29,381][52666] Sum rewards: 63.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.642', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.165', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:29,526][52803] DAMAGECOUNT value on done: 163935.0 [2024-08-06 01:13:29,528][52803] Sum rewards: 58.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.632', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:29,748][52670] DAMAGECOUNT value on done: 180940.0 [2024-08-06 01:13:29,748][52670] Sum rewards: 52.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'ARMOR': '0.004', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'weapon4': '0.238', 'AMMO3': '0.239', 'weapon2': '0.588', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '47.000'} [2024-08-06 01:13:29,764][52811] DAMAGECOUNT value on done: 167842.0 [2024-08-06 01:13:29,764][52811] Sum rewards: 58.794, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '52.000'} [2024-08-06 01:13:31,896][52669] DAMAGECOUNT value on done: 185660.0 [2024-08-06 01:13:31,896][52669] Sum rewards: 51.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.744', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon7': '0.048', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.225', 'weapon2': '0.264', 'WEAPON4': '0.500', 'weapon4': '0.888', 'WEAPON3': '1.400', 'weapon3': '2.400', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:32,040][52666] DAMAGECOUNT value on done: 173002.0 [2024-08-06 01:13:32,041][52666] Sum rewards: 54.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.034', 'weapon4': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.446', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.294', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '48.000'} [2024-08-06 01:13:32,231][52820] DAMAGECOUNT value on done: 167801.0 [2024-08-06 01:13:32,233][52820] Sum rewards: 61.765, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.027', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.119', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:32,429][52658] DAMAGECOUNT value on done: 185230.0 [2024-08-06 01:13:32,429][52658] Sum rewards: 50.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.788', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.336', 'weapon2': '0.436', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.958', 'DAMAGECOUNT': '13.047', 'FRAGCOUNT': '44.000'} [2024-08-06 01:13:32,548][52670] DAMAGECOUNT value on done: 177831.0 [2024-08-06 01:13:32,553][52670] Sum rewards: 60.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.459', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.039', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.574', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.548', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:32,786][52803] DAMAGECOUNT value on done: 166937.0 [2024-08-06 01:13:32,790][52803] Sum rewards: 65.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.064', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.201', 'weapon2': '0.572', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.160', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '57.000'} [2024-08-06 01:13:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17633.6). Total num frames: 235266048. Throughput: 0: 4390.0. Samples: 58813620. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:13:32,802][52567] Avg episode reward: [(0, '59.971')] [2024-08-06 01:13:32,815][52811] DAMAGECOUNT value on done: 172121.0 [2024-08-06 01:13:32,819][52811] Sum rewards: 54.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.925', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.179', 'weapon2': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:34,326][52650] Updated weights for policy 0, policy_version 28721 (0.0044) [2024-08-06 01:13:35,080][52666] DAMAGECOUNT value on done: 177341.0 [2024-08-06 01:13:35,082][52666] Sum rewards: 54.829, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO3': '0.170', 'HEALTH': '0.234', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.454', 'weapon4': '0.766', 'WEAPON3': '0.950', 'weapon3': '2.448', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '44.000'} [2024-08-06 01:13:35,257][52658] DAMAGECOUNT value on done: 186418.0 [2024-08-06 01:13:35,259][52658] Sum rewards: 67.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.028', 'AMMO2': '0.016', 'ARMOR': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon4': '0.404', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:35,364][52820] DAMAGECOUNT value on done: 164027.0 [2024-08-06 01:13:35,364][52820] Sum rewards: 57.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.294', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.147', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.204', 'WEAPON3': '0.900', 'weapon2': '1.128', 'weapon3': '2.446', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:35,574][52670] DAMAGECOUNT value on done: 176628.0 [2024-08-06 01:13:35,574][52670] Sum rewards: 59.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.198', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.096', 'AMMO3': '0.157', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.742', 'WEAPON3': '0.950', 'weapon3': '2.588', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:35,830][52803] DAMAGECOUNT value on done: 163939.0 [2024-08-06 01:13:35,831][52803] Sum rewards: 50.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'weapon4': '0.390', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.796', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.023', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:35,995][52811] DAMAGECOUNT value on done: 168781.0 [2024-08-06 01:13:35,996][52811] Sum rewards: 71.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.112', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'weapon4': '0.398', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.000'} [2024-08-06 01:13:36,492][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:13:36,651][52649] DAMAGECOUNT value on done: 174999.0 [2024-08-06 01:13:36,654][52649] Sum rewards: 47.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.332', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.366', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.026', 'FRAGCOUNT': '43.000'} [2024-08-06 01:13:37,658][52666] DAMAGECOUNT value on done: 177997.0 [2024-08-06 01:13:37,658][52666] Sum rewards: 64.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.976', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.205', 'AMMO3': '0.239', 'weapon2': '0.276', 'WEAPON4': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 235347968. Throughput: 0: 4390.2. Samples: 58840110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:13:37,794][52567] Avg episode reward: [(0, '60.045')] [2024-08-06 01:13:38,089][52658] DAMAGECOUNT value on done: 175874.0 [2024-08-06 01:13:38,092][52658] Sum rewards: 54.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.218', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.546', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '48.000'} [2024-08-06 01:13:38,096][52670] DAMAGECOUNT value on done: 179023.0 [2024-08-06 01:13:38,098][52670] Sum rewards: 53.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.318', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.138', 'AMMO4': '0.218', 'AMMO3': '0.238', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:38,384][52650] Updated weights for policy 0, policy_version 28731 (0.0028) [2024-08-06 01:13:38,411][52820] DAMAGECOUNT value on done: 168460.0 [2024-08-06 01:13:38,413][52820] Sum rewards: 49.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.719', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.324', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.110', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '43.000'} [2024-08-06 01:13:38,795][52803] DAMAGECOUNT value on done: 173624.0 [2024-08-06 01:13:38,798][52803] Sum rewards: 55.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.988', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.152', 'weapon4': '0.202', 'AMMO4': '0.206', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.698', 'WEAPON3': '1.250', 'weapon3': '2.600', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '47.500'} [2024-08-06 01:13:39,351][52811] DAMAGECOUNT value on done: 167519.0 [2024-08-06 01:13:39,355][52811] Sum rewards: 60.518, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.230', 'weapon2': '0.510', 'WEAPON3': '0.950', 'weapon3': '2.982', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '49.000'} [2024-08-06 01:13:39,588][52649] DAMAGECOUNT value on done: 171131.0 [2024-08-06 01:13:39,589][52649] Sum rewards: 53.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.162', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.266', 'AMMO4': '0.308', 'WEAPON4': '0.550', 'weapon4': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:40,432][52666] DAMAGECOUNT value on done: 178515.0 [2024-08-06 01:13:40,433][52666] Sum rewards: 61.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.013', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon4': '0.296', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:40,913][52670] DAMAGECOUNT value on done: 181189.0 [2024-08-06 01:13:40,913][52670] Sum rewards: 60.697, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.878', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.030', 'WEAPON4': '0.050', 'AMMO3': '0.275', 'weapon2': '0.386', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.300', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:41,112][52658] DAMAGECOUNT value on done: 180258.0 [2024-08-06 01:13:41,113][52658] Sum rewards: 69.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.410', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.159', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '60.000'} [2024-08-06 01:13:41,458][52820] DAMAGECOUNT value on done: 168388.0 [2024-08-06 01:13:41,461][52820] Sum rewards: 55.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.494', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.098', 'weapon5': '0.148', 'AMMO4': '0.211', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.858', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '48.000'} [2024-08-06 01:13:41,827][52803] DAMAGECOUNT value on done: 171984.0 [2024-08-06 01:13:41,827][52803] Sum rewards: 62.294, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.700', 'ARMOR': '0.004', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.432', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:42,634][52649] DAMAGECOUNT value on done: 174612.0 [2024-08-06 01:13:42,635][52649] Sum rewards: 59.624, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.134', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.249', 'weapon2': '0.302', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.154', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:42,669][52811] DAMAGECOUNT value on done: 173712.0 [2024-08-06 01:13:42,670][52811] Sum rewards: 57.576, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.507', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO4': '0.165', 'weapon2': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.474', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:42,795][52567] Fps is (10 sec: 16382.8, 60 sec: 17476.0, 300 sec: 17578.0). Total num frames: 235429888. Throughput: 0: 4391.9. Samples: 58866470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:13:42,795][52567] Avg episode reward: [(0, '59.798')] [2024-08-06 01:13:43,180][52666] DAMAGECOUNT value on done: 179432.0 [2024-08-06 01:13:43,182][52666] Sum rewards: 62.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.865', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.094', 'weapon5': '0.112', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:43,440][52650] Updated weights for policy 0, policy_version 28741 (0.0013) [2024-08-06 01:13:43,565][52670] DAMAGECOUNT value on done: 173345.0 [2024-08-06 01:13:43,567][52670] Sum rewards: 50.465, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.018', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'weapon2': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.600', 'HITCOUNT': '2.770', 'weapon3': '2.862', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:43,794][52658] DAMAGECOUNT value on done: 180490.0 [2024-08-06 01:13:43,794][52658] Sum rewards: 64.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.066', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.028', 'AMMO4': '0.121', 'weapon5': '0.136', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 01:13:43,997][52671] DAMAGECOUNT value on done: 186248.0 [2024-08-06 01:13:43,997][52671] Sum rewards: 62.922, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.270', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.048', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.402', 'weapon2': '0.478', 'WEAPON3': '1.700', 'weapon3': '2.786', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '57.000'} [2024-08-06 01:13:44,577][52820] DAMAGECOUNT value on done: 168965.0 [2024-08-06 01:13:44,578][52820] Sum rewards: 68.175, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.231', 'weapon2': '0.378', 'WEAPON4': '0.450', 'weapon4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.644', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '58.000'} [2024-08-06 01:13:44,829][52803] DAMAGECOUNT value on done: 168133.0 [2024-08-06 01:13:44,829][52803] Sum rewards: 56.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon2': '0.114', 'AMMO3': '0.198', 'weapon4': '0.424', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.078', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '47.000'} [2024-08-06 01:13:45,584][52649] DAMAGECOUNT value on done: 176146.0 [2024-08-06 01:13:45,585][52649] Sum rewards: 47.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.377', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.104', 'AMMO3': '0.245', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '2.972', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '41.000'} [2024-08-06 01:13:45,821][52811] DAMAGECOUNT value on done: 169018.0 [2024-08-06 01:13:45,821][52811] Sum rewards: 55.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO4': '0.194', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.084', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '48.000'} [2024-08-06 01:13:46,156][52666] DAMAGECOUNT value on done: 176237.0 [2024-08-06 01:13:46,156][52666] Sum rewards: 71.484, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.095', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon2': '0.374', 'weapon4': '0.470', 'WEAPON3': '0.950', 'weapon3': '3.036', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '57.000'} [2024-08-06 01:13:46,437][52658] DAMAGECOUNT value on done: 178537.0 [2024-08-06 01:13:46,439][52658] Sum rewards: 64.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.382', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.238', 'weapon2': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.288', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '54.500'} [2024-08-06 01:13:46,575][52670] DAMAGECOUNT value on done: 178801.0 [2024-08-06 01:13:46,575][52670] Sum rewards: 52.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.526', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.230', 'AMMO3': '0.233', 'weapon2': '0.370', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.122', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '47.000'} [2024-08-06 01:13:46,908][52671] DAMAGECOUNT value on done: 180094.0 [2024-08-06 01:13:46,910][52671] Sum rewards: 59.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.710', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon4': '0.254', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 235520000. Throughput: 0: 4393.8. Samples: 58879650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:13:47,797][52820] DAMAGECOUNT value on done: 165604.0 [2024-08-06 01:13:47,802][52567] Avg episode reward: [(0, '59.796')] [2024-08-06 01:13:47,802][52820] Sum rewards: 64.052, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.238', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.116', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.150', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:47,937][52803] DAMAGECOUNT value on done: 171651.0 [2024-08-06 01:13:47,938][52803] Sum rewards: 51.407, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.076', 'ARMOR': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.120', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:48,184][52650] Updated weights for policy 0, policy_version 28751 (0.0014) [2024-08-06 01:13:48,532][52649] DAMAGECOUNT value on done: 168307.0 [2024-08-06 01:13:48,532][52649] Sum rewards: 60.663, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.550', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.152', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.700', 'weapon3': '2.974', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '55.000'} [2024-08-06 01:13:48,724][52666] DAMAGECOUNT value on done: 172220.0 [2024-08-06 01:13:48,727][52666] Sum rewards: 54.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.665', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.366', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:48,849][52811] DAMAGECOUNT value on done: 167374.0 [2024-08-06 01:13:48,849][52811] Sum rewards: 60.202, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.148', 'AMMO4': '0.283', 'weapon5': '0.292', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.628', 'WEAPON3': '0.900', 'weapon3': '2.388', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '48.000'} [2024-08-06 01:13:49,124][52670] DAMAGECOUNT value on done: 173795.0 [2024-08-06 01:13:49,126][52670] Sum rewards: 53.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.060', 'weapon4': '0.062', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.588', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.078', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '45.000'} [2024-08-06 01:13:49,567][52658] DAMAGECOUNT value on done: 182408.0 [2024-08-06 01:13:49,568][52658] Sum rewards: 62.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.429', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.208', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.362', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:50,224][52671] DAMAGECOUNT value on done: 184069.0 [2024-08-06 01:13:50,226][52671] Sum rewards: 54.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.515', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.101', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.592', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.494', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:50,903][52820] DAMAGECOUNT value on done: 167917.0 [2024-08-06 01:13:50,906][52820] Sum rewards: 62.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:50,950][52649] DAMAGECOUNT value on done: 175748.0 [2024-08-06 01:13:50,950][52649] Sum rewards: 64.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.190', 'weapon4': '0.312', 'WEAPON4': '0.500', 'weapon2': '0.570', 'WEAPON3': '0.850', 'weapon3': '2.934', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '52.000'} [2024-08-06 01:13:51,083][52803] DAMAGECOUNT value on done: 168539.0 [2024-08-06 01:13:51,087][52803] Sum rewards: 74.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.630', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '62.000'} [2024-08-06 01:13:51,844][52666] DAMAGECOUNT value on done: 181787.0 [2024-08-06 01:13:51,846][52666] Sum rewards: 44.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.320', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.354', 'weapon4': '0.490', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.978', 'DAMAGECOUNT': '11.142', 'FRAGCOUNT': '38.000'} [2024-08-06 01:13:51,972][52658] DAMAGECOUNT value on done: 182540.0 [2024-08-06 01:13:51,972][52658] Sum rewards: 54.459, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.054', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.332', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.940', 'weapon3': '3.076', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '44.000'} [2024-08-06 01:13:51,972][52811] DAMAGECOUNT value on done: 169836.0 [2024-08-06 01:13:51,973][52811] Sum rewards: 64.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.146', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.166', 'weapon5': '0.176', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.516', 'weapon4': '0.548', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.492', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '52.500'} [2024-08-06 01:13:52,210][52670] DAMAGECOUNT value on done: 169695.0 [2024-08-06 01:13:52,210][52670] Sum rewards: 48.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.875', 'AMMO5': '0.014', 'AMMO2': '0.057', 'AMMO3': '0.099', 'weapon5': '0.148', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'weapon2': '0.534', 'weapon4': '0.570', 'WEAPON3': '0.600', 'WEAPON4': '0.600', 'weapon3': '2.334', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '39.000'} [2024-08-06 01:13:52,540][52650] Updated weights for policy 0, policy_version 28761 (0.0016) [2024-08-06 01:13:52,794][52567] Fps is (10 sec: 18023.8, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 235610112. Throughput: 0: 4395.4. Samples: 58905890. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:13:52,794][52567] Avg episode reward: [(0, '59.770')] [2024-08-06 01:13:53,200][52671] DAMAGECOUNT value on done: 178467.0 [2024-08-06 01:13:53,200][52671] Sum rewards: 65.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.241', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:53,709][52663] DAMAGECOUNT value on done: 180771.0 [2024-08-06 01:13:53,710][52663] Sum rewards: 64.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.208', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.016', 'AMMO4': '0.034', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.252', 'weapon4': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:53,904][52649] DAMAGECOUNT value on done: 173184.0 [2024-08-06 01:13:53,904][52649] Sum rewards: 65.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.385', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.298', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:53,944][52820] DAMAGECOUNT value on done: 170066.0 [2024-08-06 01:13:53,947][52820] Sum rewards: 65.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:53,985][52647] DAMAGECOUNT value on done: 191950.0 [2024-08-06 01:13:53,987][52647] Sum rewards: 67.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.018', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '55.000'} [2024-08-06 01:13:54,204][52803] DAMAGECOUNT value on done: 165589.0 [2024-08-06 01:13:54,207][52803] Sum rewards: 57.429, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.715', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '50.500'} [2024-08-06 01:13:54,557][52666] DAMAGECOUNT value on done: 180891.0 [2024-08-06 01:13:54,558][52666] Sum rewards: 66.549, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.984', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.188', 'weapon5': '0.230', 'weapon4': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '54.000'} [2024-08-06 01:13:54,860][52670] DAMAGECOUNT value on done: 181932.0 [2024-08-06 01:13:54,861][52670] Sum rewards: 54.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.536', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.150', 'weapon5': '0.198', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.532', 'weapon4': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.356', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '44.000'} [2024-08-06 01:13:54,969][52658] DAMAGECOUNT value on done: 177657.0 [2024-08-06 01:13:54,969][52658] Sum rewards: 74.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.294', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon4': '0.266', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '61.000'} [2024-08-06 01:13:55,035][52811] DAMAGECOUNT value on done: 168274.0 [2024-08-06 01:13:55,039][52811] Sum rewards: 60.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.144', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:56,408][52671] DAMAGECOUNT value on done: 180736.0 [2024-08-06 01:13:56,409][52671] Sum rewards: 57.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.352', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'weapon4': '0.186', 'AMMO3': '0.187', 'weapon2': '0.368', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.310', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '48.000'} [2024-08-06 01:13:56,414][52647] DAMAGECOUNT value on done: 188670.0 [2024-08-06 01:13:56,415][52647] Sum rewards: 65.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.222', 'AMMO3': '0.237', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '56.000'} [2024-08-06 01:13:56,637][52663] DAMAGECOUNT value on done: 179231.0 [2024-08-06 01:13:56,638][52663] Sum rewards: 53.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.628', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.078', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.730', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:57,015][52649] DAMAGECOUNT value on done: 180255.0 [2024-08-06 01:13:57,017][52649] Sum rewards: 60.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.343', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.148', 'AMMO3': '0.195', 'weapon4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.050', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:57,131][52820] DAMAGECOUNT value on done: 166636.0 [2024-08-06 01:13:57,132][52820] Sum rewards: 61.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.268', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.492', 'weapon2': '0.762', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '51.000'} [2024-08-06 01:13:57,313][52803] DAMAGECOUNT value on done: 173284.0 [2024-08-06 01:13:57,315][52803] Sum rewards: 60.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.882', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.158', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '52.000'} [2024-08-06 01:13:57,424][52650] Updated weights for policy 0, policy_version 28771 (0.0012) [2024-08-06 01:13:57,511][52666] DAMAGECOUNT value on done: 174711.0 [2024-08-06 01:13:57,511][52666] Sum rewards: 46.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.499', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO3': '0.150', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.354', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '11.604', 'FRAGCOUNT': '38.000'} [2024-08-06 01:13:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 235700224. Throughput: 0: 4389.8. Samples: 58932130. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:13:57,795][52567] Avg episode reward: [(0, '59.600')] [2024-08-06 01:13:57,815][52658] DAMAGECOUNT value on done: 178137.0 [2024-08-06 01:13:57,817][52658] Sum rewards: 55.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.973', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.210', 'weapon4': '0.242', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.200', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '46.000'} [2024-08-06 01:13:57,846][52670] DAMAGECOUNT value on done: 179829.0 [2024-08-06 01:13:57,846][52670] Sum rewards: 43.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.676', 'AMMO5': '0.011', 'AMMO2': '0.072', 'AMMO3': '0.181', 'weapon5': '0.186', 'AMMO4': '0.359', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.800', 'weapon2': '0.808', 'WEAPON3': '1.000', 'weapon3': '2.328', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '39.000'} [2024-08-06 01:13:58,059][52811] DAMAGECOUNT value on done: 170628.0 [2024-08-06 01:13:58,061][52811] Sum rewards: 58.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2024-08-06 01:13:59,126][52647] DAMAGECOUNT value on done: 191217.0 [2024-08-06 01:13:59,126][52647] Sum rewards: 62.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.132', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'AMMO4': '0.233', 'weapon2': '0.342', 'weapon4': '0.356', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '53.000'} [2024-08-06 01:13:59,205][52671] DAMAGECOUNT value on done: 180998.0 [2024-08-06 01:13:59,207][52671] Sum rewards: 66.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.999', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.152', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.642', 'WEAPON3': '1.150', 'weapon3': '2.682', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '55.000'} [2024-08-06 01:13:59,510][52663] DAMAGECOUNT value on done: 177964.0 [2024-08-06 01:13:59,510][52663] Sum rewards: 57.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.107', 'AMMO3': '0.228', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '2.972', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:00,295][52649] DAMAGECOUNT value on done: 173563.0 [2024-08-06 01:14:00,296][52649] Sum rewards: 68.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.435', 'ARMOR': '0.012', 'AMMO5': '0.014', 'weapon5': '0.024', 'AMMO2': '0.037', 'weapon4': '0.130', 'AMMO4': '0.184', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '60.000'} [2024-08-06 01:14:00,308][52820] DAMAGECOUNT value on done: 166982.0 [2024-08-06 01:14:00,308][52820] Sum rewards: 62.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.577', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:00,399][52803] DAMAGECOUNT value on done: 167666.0 [2024-08-06 01:14:00,401][52803] Sum rewards: 49.372, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.557', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.100', 'AMMO4': '0.246', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon4': '0.332', 'weapon2': '0.428', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.788', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '45.500'} [2024-08-06 01:14:00,644][52666] DAMAGECOUNT value on done: 176963.0 [2024-08-06 01:14:00,645][52666] Sum rewards: 58.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.036', 'weapon5': '0.048', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.626', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '51.000'} [2024-08-06 01:14:00,931][52658] DAMAGECOUNT value on done: 183281.0 [2024-08-06 01:14:00,932][52658] Sum rewards: 59.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.482', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.400', 'weapon4': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:00,985][52811] DAMAGECOUNT value on done: 168149.0 [2024-08-06 01:14:00,988][52811] Sum rewards: 54.822, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.480', 'ARMOR': '0.008', 'AMMO5': '0.011', 'weapon5': '0.042', 'AMMO2': '0.055', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'AMMO4': '0.276', 'weapon4': '0.558', 'WEAPON4': '0.650', 'weapon2': '0.950', 'WEAPON3': '1.200', 'weapon3': '2.170', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:01,035][52670] DAMAGECOUNT value on done: 180593.0 [2024-08-06 01:14:01,037][52670] Sum rewards: 58.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.632', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.282', 'weapon4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:01,477][52647] DAMAGECOUNT value on done: 190725.0 [2024-08-06 01:14:01,478][52647] Sum rewards: 54.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.364', 'weapon4': '0.468', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '2.934', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '47.000'} [2024-08-06 01:14:01,777][52650] Updated weights for policy 0, policy_version 28781 (0.0011) [2024-08-06 01:14:01,976][52671] DAMAGECOUNT value on done: 180400.0 [2024-08-06 01:14:01,978][52671] Sum rewards: 64.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.190', 'WEAPON4': '0.400', 'weapon4': '0.454', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '55.000'} [2024-08-06 01:14:02,395][52663] DAMAGECOUNT value on done: 181285.0 [2024-08-06 01:14:02,396][52663] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.974', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.160', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.650', 'weapon3': '3.200', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '61.000'} [2024-08-06 01:14:02,722][52669] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:14:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 235782144. Throughput: 0: 4391.8. Samples: 58945390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:14:02,794][52567] Avg episode reward: [(0, '59.184')] [2024-08-06 01:14:03,336][52649] DAMAGECOUNT value on done: 176056.0 [2024-08-06 01:14:03,336][52649] Sum rewards: 59.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.695', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.374', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:03,377][52820] DAMAGECOUNT value on done: 171183.0 [2024-08-06 01:14:03,378][52820] Sum rewards: 64.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.116', 'weapon4': '0.134', 'AMMO4': '0.180', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:03,503][52666] DAMAGECOUNT value on done: 177444.0 [2024-08-06 01:14:03,504][52666] Sum rewards: 68.356, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.565', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.164', 'weapon2': '0.774', 'WEAPON3': '1.050', 'weapon3': '3.104', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:03,575][52803] DAMAGECOUNT value on done: 171996.0 [2024-08-06 01:14:03,575][52803] Sum rewards: 48.021, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.066', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.408', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.548', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '42.500'} [2024-08-06 01:14:03,842][52670] DAMAGECOUNT value on done: 178500.0 [2024-08-06 01:14:03,844][52670] Sum rewards: 52.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.491', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.604', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.890', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '46.000'} [2024-08-06 01:14:03,965][52647] DAMAGECOUNT value on done: 191662.0 [2024-08-06 01:14:03,967][52647] Sum rewards: 70.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'weapon4': '0.162', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '58.000'} [2024-08-06 01:14:03,989][52811] DAMAGECOUNT value on done: 169525.0 [2024-08-06 01:14:03,991][52811] Sum rewards: 58.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.090', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.302', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:04,457][52671] DAMAGECOUNT value on done: 182596.0 [2024-08-06 01:14:04,465][52671] Sum rewards: 61.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.078', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.456', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '52.000'} [2024-08-06 01:14:05,208][52663] DAMAGECOUNT value on done: 177866.0 [2024-08-06 01:14:05,208][52663] Sum rewards: 65.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.220', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 01:14:06,355][52647] DAMAGECOUNT value on done: 192948.0 [2024-08-06 01:14:06,356][52647] Sum rewards: 55.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.085', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon4': '0.296', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '49.000'} [2024-08-06 01:14:06,416][52666] DAMAGECOUNT value on done: 181137.0 [2024-08-06 01:14:06,416][52666] Sum rewards: 71.188, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon4': '0.096', 'weapon5': '0.102', 'AMMO4': '0.106', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '61.000'} [2024-08-06 01:14:06,459][52820] DAMAGECOUNT value on done: 173086.0 [2024-08-06 01:14:06,461][52820] Sum rewards: 51.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.845', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon4': '0.182', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.178', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '46.000'} [2024-08-06 01:14:06,506][52649] DAMAGECOUNT value on done: 177761.0 [2024-08-06 01:14:06,508][52649] Sum rewards: 73.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.754', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 01:14:06,535][52650] Updated weights for policy 0, policy_version 28791 (0.0026) [2024-08-06 01:14:06,644][52803] DAMAGECOUNT value on done: 162847.0 [2024-08-06 01:14:06,646][52803] Sum rewards: 60.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.192', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.246', 'WEAPON3': '1.150', 'weapon3': '3.304', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:06,836][52670] DAMAGECOUNT value on done: 182842.0 [2024-08-06 01:14:06,837][52670] Sum rewards: 48.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.726', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.502', 'weapon4': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.754', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '44.000'} [2024-08-06 01:14:07,072][52671] DAMAGECOUNT value on done: 179806.0 [2024-08-06 01:14:07,075][52671] Sum rewards: 64.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.048', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.222', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.572', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:07,273][52811] DAMAGECOUNT value on done: 167020.0 [2024-08-06 01:14:07,275][52811] Sum rewards: 62.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.933', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.392', 'weapon4': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 235872256. Throughput: 0: 4394.2. Samples: 58971960. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 01:14:07,794][52567] Avg episode reward: [(0, '59.681')] [2024-08-06 01:14:08,277][52663] DAMAGECOUNT value on done: 186815.0 [2024-08-06 01:14:08,278][52663] Sum rewards: 60.104, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.056', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon4': '0.260', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.960', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:08,697][52647] DAMAGECOUNT value on done: 188917.0 [2024-08-06 01:14:08,698][52647] Sum rewards: 57.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.946', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.204', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '48.000'} [2024-08-06 01:14:09,104][52666] DAMAGECOUNT value on done: 176636.0 [2024-08-06 01:14:09,104][52666] Sum rewards: 62.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.106', 'AMMO3': '0.125', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.458', 'weapon2': '0.546', 'WEAPON3': '0.900', 'weapon3': '2.688', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:09,412][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:14:09,433][52670] DAMAGECOUNT value on done: 171104.0 [2024-08-06 01:14:09,434][52670] Sum rewards: 53.335, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'ARMOR': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.094', 'AMMO3': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.078', 'weapon3': '2.510', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '43.000'} [2024-08-06 01:14:09,536][52649] DAMAGECOUNT value on done: 172204.0 [2024-08-06 01:14:09,537][52649] Sum rewards: 51.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.929', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.046', 'weapon5': '0.176', 'AMMO3': '0.187', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON4': '0.600', 'weapon4': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.895', 'FRAGCOUNT': '45.000'} [2024-08-06 01:14:09,603][52820] DAMAGECOUNT value on done: 164666.0 [2024-08-06 01:14:09,603][52820] Sum rewards: 66.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.064', 'weapon4': '0.066', 'AMMO4': '0.105', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '3.340', 'weapon3': '3.372', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '58.000'} [2024-08-06 01:14:10,042][52671] DAMAGECOUNT value on done: 184137.0 [2024-08-06 01:14:10,044][52671] Sum rewards: 68.293, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.116', 'weapon4': '0.140', 'WEAPON4': '0.200', 'HEALTH': '0.608', 'weapon2': '0.698', 'WEAPON3': '0.700', 'weapon3': '2.844', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '56.000'} [2024-08-06 01:14:10,407][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:14:10,464][52811] DAMAGECOUNT value on done: 172107.0 [2024-08-06 01:14:10,466][52811] Sum rewards: 58.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.058', 'AMMO4': '0.153', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:11,015][52663] DAMAGECOUNT value on done: 180070.0 [2024-08-06 01:14:11,016][52663] Sum rewards: 55.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.630', 'AMMO5': '0.004', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.119', 'WEAPON4': '0.400', 'weapon4': '0.518', 'weapon2': '0.742', 'WEAPON3': '0.850', 'weapon3': '2.416', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '46.000'} [2024-08-06 01:14:11,305][52650] Updated weights for policy 0, policy_version 28801 (0.0015) [2024-08-06 01:14:11,842][52647] DAMAGECOUNT value on done: 189885.0 [2024-08-06 01:14:11,843][52647] Sum rewards: 56.019, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.652', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon4': '0.318', 'weapon2': '0.468', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:11,852][52666] DAMAGECOUNT value on done: 177264.0 [2024-08-06 01:14:11,853][52666] Sum rewards: 61.354, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'HEALTH': '0.456', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '52.000'} [2024-08-06 01:14:12,006][52649] DAMAGECOUNT value on done: 178383.0 [2024-08-06 01:14:12,006][52649] Sum rewards: 50.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.177', 'AMMO3': '0.204', 'weapon4': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '44.000'} [2024-08-06 01:14:12,476][52670] DAMAGECOUNT value on done: 181859.0 [2024-08-06 01:14:12,476][52670] Sum rewards: 68.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.040', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.310', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '57.000'} [2024-08-06 01:14:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 235962368. Throughput: 0: 4399.8. Samples: 58998310. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 01:14:12,794][52567] Avg episode reward: [(0, '59.869')] [2024-08-06 01:14:13,048][52671] DAMAGECOUNT value on done: 182647.0 [2024-08-06 01:14:13,049][52671] Sum rewards: 47.184, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.590', 'AMMO5': '0.020', 'ARMOR': '0.020', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon5': '0.198', 'AMMO3': '0.240', 'weapon2': '0.340', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '42.500'} [2024-08-06 01:14:13,527][52811] DAMAGECOUNT value on done: 167638.0 [2024-08-06 01:14:13,527][52811] Sum rewards: 62.690, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.340', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.164', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '56.000'} [2024-08-06 01:14:14,192][52663] DAMAGECOUNT value on done: 181604.0 [2024-08-06 01:14:14,194][52663] Sum rewards: 62.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.335', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.216', 'weapon2': '0.230', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.356', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:14,287][52647] DAMAGECOUNT value on done: 191895.0 [2024-08-06 01:14:14,288][52647] Sum rewards: 58.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.765', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.450', 'weapon4': '0.452', 'weapon2': '0.646', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:14,854][52659] DAMAGECOUNT value on done: 180143.0 [2024-08-06 01:14:14,855][52659] Sum rewards: 57.002, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.253', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '52.000'} [2024-08-06 01:14:15,065][52649] DAMAGECOUNT value on done: 176935.0 [2024-08-06 01:14:15,065][52649] Sum rewards: 59.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.374', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:15,304][52670] DAMAGECOUNT value on done: 183727.0 [2024-08-06 01:14:15,304][52670] Sum rewards: 59.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.490', 'weapon4': '0.588', 'WEAPON3': '1.500', 'weapon3': '2.424', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '51.000'} [2024-08-06 01:14:16,126][52650] Updated weights for policy 0, policy_version 28811 (0.0040) [2024-08-06 01:14:16,143][52671] DAMAGECOUNT value on done: 180804.0 [2024-08-06 01:14:16,144][52671] Sum rewards: 61.216, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.815', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.472', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:16,536][52811] DAMAGECOUNT value on done: 172039.0 [2024-08-06 01:14:16,536][52811] Sum rewards: 69.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.865', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.050', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.231', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.458', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '58.000'} [2024-08-06 01:14:17,063][52647] DAMAGECOUNT value on done: 188312.0 [2024-08-06 01:14:17,063][52647] Sum rewards: 73.665, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.138', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.149', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.322', 'WEAPON4': '0.400', 'weapon2': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '60.000'} [2024-08-06 01:14:17,232][52663] DAMAGECOUNT value on done: 178337.0 [2024-08-06 01:14:17,232][52663] Sum rewards: 50.536, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.184', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.274', 'weapon2': '0.324', 'WEAPON3': '1.550', 'HITCOUNT': '2.670', 'weapon3': '3.264', 'DAMAGECOUNT': '12.906', 'FRAGCOUNT': '47.000'} [2024-08-06 01:14:17,324][52665] DAMAGECOUNT value on done: 177686.0 [2024-08-06 01:14:17,324][52665] Sum rewards: 50.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.248', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '2.978', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '46.000'} [2024-08-06 01:14:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 236052480. Throughput: 0: 4400.0. Samples: 59011620. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 01:14:17,795][52567] Avg episode reward: [(0, '59.902')] [2024-08-06 01:14:17,820][52670] DAMAGECOUNT value on done: 179117.0 [2024-08-06 01:14:17,823][52670] Sum rewards: 55.010, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'weapon2': '0.452', 'weapon4': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '49.000'} [2024-08-06 01:14:17,990][52659] DAMAGECOUNT value on done: 180415.0 [2024-08-06 01:14:17,990][52659] Sum rewards: 45.871, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.924', 'AMMO5': '0.014', 'weapon5': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.266', 'AMMO3': '0.298', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.030', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '43.000'} [2024-08-06 01:14:18,038][52649] DAMAGECOUNT value on done: 171004.0 [2024-08-06 01:14:18,040][52649] Sum rewards: 63.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO4': '0.180', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.404', 'WEAPON4': '0.500', 'weapon4': '0.714', 'WEAPON3': '1.200', 'weapon3': '2.406', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '55.000'} [2024-08-06 01:14:18,929][52664] DAMAGECOUNT value on done: 186698.0 [2024-08-06 01:14:18,931][52664] Sum rewards: 54.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.042', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'AMMO3': '0.204', 'AMMO4': '0.208', 'weapon2': '0.312', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.238', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '48.000'} [2024-08-06 01:14:19,226][52671] DAMAGECOUNT value on done: 189650.0 [2024-08-06 01:14:19,226][52671] Sum rewards: 52.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.278', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.020', 'AMMO4': '0.082', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.674', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '45.000'} [2024-08-06 01:14:19,765][52665] DAMAGECOUNT value on done: 182695.0 [2024-08-06 01:14:19,767][52665] Sum rewards: 54.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.577', 'AMMO5': '0.005', 'AMMO2': '0.048', 'AMMO3': '0.172', 'AMMO4': '0.238', 'weapon2': '0.372', 'WEAPON4': '0.500', 'weapon4': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '47.000'} [2024-08-06 01:14:20,042][52663] DAMAGECOUNT value on done: 183369.0 [2024-08-06 01:14:20,043][52663] Sum rewards: 65.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.641', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.232', 'weapon4': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:20,141][52647] DAMAGECOUNT value on done: 189174.0 [2024-08-06 01:14:20,142][52647] Sum rewards: 70.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.189', 'weapon2': '0.282', 'WEAPON3': '1.200', 'HITCOUNT': '3.310', 'weapon3': '3.580', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '58.000'} [2024-08-06 01:14:20,368][52670] DAMAGECOUNT value on done: 178935.0 [2024-08-06 01:14:20,370][52670] Sum rewards: 61.161, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.218', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.231', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:20,537][52649] DAMAGECOUNT value on done: 177156.0 [2024-08-06 01:14:20,538][52649] Sum rewards: 52.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.216', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon2': '0.442', 'ARMOR': '0.487', 'weapon4': '0.502', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.786', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '44.000'} [2024-08-06 01:14:20,553][52650] Updated weights for policy 0, policy_version 28821 (0.0025) [2024-08-06 01:14:20,703][52659] DAMAGECOUNT value on done: 181791.0 [2024-08-06 01:14:20,703][52659] Sum rewards: 62.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.528', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.129', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.466', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:21,542][52671] DAMAGECOUNT value on done: 182022.0 [2024-08-06 01:14:21,543][52671] Sum rewards: 50.552, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '45.000'} [2024-08-06 01:14:21,662][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:14:21,882][52664] DAMAGECOUNT value on done: 187732.0 [2024-08-06 01:14:21,884][52664] Sum rewards: 60.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.229', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:22,327][52665] DAMAGECOUNT value on done: 178655.0 [2024-08-06 01:14:22,328][52665] Sum rewards: 66.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.597', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '56.000'} [2024-08-06 01:14:22,689][52663] DAMAGECOUNT value on done: 182381.0 [2024-08-06 01:14:22,689][52663] Sum rewards: 65.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 236142592. Throughput: 0: 4402.2. Samples: 59038210. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:14:22,802][52567] Avg episode reward: [(0, '59.785')] [2024-08-06 01:14:23,087][52647] DAMAGECOUNT value on done: 186244.0 [2024-08-06 01:14:23,088][52647] Sum rewards: 59.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.040', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.570', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:23,453][52649] DAMAGECOUNT value on done: 174633.0 [2024-08-06 01:14:23,453][52649] Sum rewards: 49.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.881', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.028', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.466', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '2.904', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '44.500'} [2024-08-06 01:14:23,632][52659] DAMAGECOUNT value on done: 181903.0 [2024-08-06 01:14:23,635][52659] Sum rewards: 56.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.382', 'weapon4': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.768', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:24,316][52667] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:14:24,658][52671] DAMAGECOUNT value on done: 175805.0 [2024-08-06 01:14:24,662][52671] Sum rewards: 50.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.212', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.114', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '43.000'} [2024-08-06 01:14:24,697][52664] DAMAGECOUNT value on done: 189438.0 [2024-08-06 01:14:24,701][52664] Sum rewards: 62.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.788', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:25,142][52650] Updated weights for policy 0, policy_version 28831 (0.0011) [2024-08-06 01:14:25,522][52663] DAMAGECOUNT value on done: 179370.0 [2024-08-06 01:14:25,524][52663] Sum rewards: 54.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'weapon5': '0.040', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'AMMO4': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '45.000'} [2024-08-06 01:14:25,565][52665] DAMAGECOUNT value on done: 173924.0 [2024-08-06 01:14:25,567][52665] Sum rewards: 66.230, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.979', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:25,902][52647] DAMAGECOUNT value on done: 189772.0 [2024-08-06 01:14:25,903][52647] Sum rewards: 64.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.689', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.187', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:26,353][52649] DAMAGECOUNT value on done: 182552.0 [2024-08-06 01:14:26,353][52649] Sum rewards: 54.049, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.204', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '46.000'} [2024-08-06 01:14:26,737][52659] DAMAGECOUNT value on done: 180139.0 [2024-08-06 01:14:26,737][52659] Sum rewards: 64.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.040', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.584', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '56.500'} [2024-08-06 01:14:27,768][52671] DAMAGECOUNT value on done: 185713.0 [2024-08-06 01:14:27,768][52671] Sum rewards: 70.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.108', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.424', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '2.860', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.000'} [2024-08-06 01:14:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 236224512. Throughput: 0: 4404.5. Samples: 59064670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:14:27,802][52567] Avg episode reward: [(0, '59.758')] [2024-08-06 01:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028836_236224512.pth... [2024-08-06 01:14:27,858][52665] DAMAGECOUNT value on done: 175830.0 [2024-08-06 01:14:27,858][52665] Sum rewards: 62.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.400', 'weapon2': '0.752', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:27,943][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028321_232005632.pth [2024-08-06 01:14:27,951][52664] DAMAGECOUNT value on done: 186686.0 [2024-08-06 01:14:27,951][52664] Sum rewards: 65.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.124', 'AMMO3': '0.146', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '0.950', 'weapon3': '2.982', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:28,310][52663] DAMAGECOUNT value on done: 174512.0 [2024-08-06 01:14:28,310][52663] Sum rewards: 46.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.062', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.962', 'WEAPON3': '1.000', 'weapon3': '2.370', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.102', 'FRAGCOUNT': '41.000'} [2024-08-06 01:14:28,836][52649] DAMAGECOUNT value on done: 179569.0 [2024-08-06 01:14:28,838][52649] Sum rewards: 58.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.462', 'ARMOR': '0.004', 'AMMO2': '0.031', 'AMMO4': '0.152', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.640', 'weapon2': '0.730', 'WEAPON3': '0.950', 'weapon3': '2.472', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '48.000'} [2024-08-06 01:14:28,945][52647] DAMAGECOUNT value on done: 189493.0 [2024-08-06 01:14:28,945][52647] Sum rewards: 58.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.488', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.078', 'AMMO3': '0.166', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.348', 'weapon4': '0.534', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '49.000'} [2024-08-06 01:14:29,433][52659] DAMAGECOUNT value on done: 179360.0 [2024-08-06 01:14:29,434][52659] Sum rewards: 55.675, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.925', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.046', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.690', 'WEAPON3': '1.400', 'weapon3': '2.936', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '48.000'} [2024-08-06 01:14:29,895][52650] Updated weights for policy 0, policy_version 28841 (0.0027) [2024-08-06 01:14:30,402][52664] DAMAGECOUNT value on done: 185815.0 [2024-08-06 01:14:30,406][52664] Sum rewards: 52.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.908', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.238', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon4': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '47.000'} [2024-08-06 01:14:30,472][52671] DAMAGECOUNT value on done: 184920.0 [2024-08-06 01:14:30,473][52671] Sum rewards: 62.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.062', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '52.000'} [2024-08-06 01:14:30,774][52665] DAMAGECOUNT value on done: 177870.0 [2024-08-06 01:14:30,777][52665] Sum rewards: 51.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.252', 'weapon2': '0.272', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.404', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '44.000'} [2024-08-06 01:14:31,231][52647] DAMAGECOUNT value on done: 189944.0 [2024-08-06 01:14:31,233][52647] Sum rewards: 60.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.357', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.114', 'weapon5': '0.130', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.392', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:31,364][52663] DAMAGECOUNT value on done: 172194.0 [2024-08-06 01:14:31,365][52663] Sum rewards: 52.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'ARMOR': '0.004', 'AMMO2': '0.034', 'AMMO3': '0.142', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'weapon4': '0.558', 'weapon2': '0.560', 'WEAPON3': '0.900', 'weapon3': '2.800', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2024-08-06 01:14:31,949][52649] DAMAGECOUNT value on done: 184660.0 [2024-08-06 01:14:31,951][52649] Sum rewards: 59.736, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.922', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.248', 'AMMO4': '0.266', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.932', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '52.000'} [2024-08-06 01:14:32,433][52659] DAMAGECOUNT value on done: 180149.0 [2024-08-06 01:14:32,433][52659] Sum rewards: 62.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.164', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '52.000'} [2024-08-06 01:14:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 236306432. Throughput: 0: 4399.3. Samples: 59077620. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:14:32,794][52567] Avg episode reward: [(0, '59.177')] [2024-08-06 01:14:32,888][52664] DAMAGECOUNT value on done: 191995.0 [2024-08-06 01:14:32,889][52664] Sum rewards: 59.617, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.340', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'weapon4': '0.160', 'weapon2': '0.244', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.318', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:33,409][52671] DAMAGECOUNT value on done: 184821.0 [2024-08-06 01:14:33,411][52671] Sum rewards: 64.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.169', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.392', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:33,494][52647] DAMAGECOUNT value on done: 188756.0 [2024-08-06 01:14:33,495][52647] Sum rewards: 61.046, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.187', 'weapon2': '0.366', 'WEAPON4': '0.600', 'weapon4': '0.722', 'WEAPON3': '1.200', 'weapon3': '2.626', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:33,960][52665] DAMAGECOUNT value on done: 180212.0 [2024-08-06 01:14:33,961][52665] Sum rewards: 68.312, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.771', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.276', 'AMMO3': '0.282', 'WEAPON3': '1.800', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '62.000'} [2024-08-06 01:14:33,993][52663] DAMAGECOUNT value on done: 181443.0 [2024-08-06 01:14:33,994][52663] Sum rewards: 55.840, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.622', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.368', 'WEAPON4': '0.500', 'weapon4': '0.798', 'WEAPON3': '1.450', 'weapon3': '2.454', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:34,393][52650] Updated weights for policy 0, policy_version 28851 (0.0012) [2024-08-06 01:14:35,030][52659] DAMAGECOUNT value on done: 176802.0 [2024-08-06 01:14:35,030][52659] Sum rewards: 63.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.218', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '56.000'} [2024-08-06 01:14:35,265][52664] DAMAGECOUNT value on done: 191725.0 [2024-08-06 01:14:35,266][52664] Sum rewards: 67.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.076', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.160', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.748', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '59.000'} [2024-08-06 01:14:35,467][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:14:36,040][52647] DAMAGECOUNT value on done: 185578.0 [2024-08-06 01:14:36,040][52647] Sum rewards: 61.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.550', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.147', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.500', 'WEAPON3': '0.850', 'weapon3': '2.952', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 01:14:36,155][52671] DAMAGECOUNT value on done: 183936.0 [2024-08-06 01:14:36,156][52671] Sum rewards: 63.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.180', 'weapon4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '51.000'} [2024-08-06 01:14:36,450][52663] DAMAGECOUNT value on done: 182402.0 [2024-08-06 01:14:36,450][52663] Sum rewards: 74.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.849', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon2': '0.408', 'weapon4': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.756', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.000'} [2024-08-06 01:14:36,633][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 01:14:37,052][52665] DAMAGECOUNT value on done: 180175.0 [2024-08-06 01:14:37,055][52665] Sum rewards: 49.482, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.292', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.209', 'weapon4': '0.220', 'AMMO3': '0.247', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.166', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '46.000'} [2024-08-06 01:14:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17633.6). Total num frames: 236404736. Throughput: 0: 4405.1. Samples: 59104120. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:14:37,794][52567] Avg episode reward: [(0, '59.647')] [2024-08-06 01:14:37,809][52659] DAMAGECOUNT value on done: 183883.0 [2024-08-06 01:14:37,809][52659] Sum rewards: 54.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.050', 'weapon5': '0.130', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'WEAPON4': '0.500', 'weapon2': '0.500', 'weapon4': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.616', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '45.000'} [2024-08-06 01:14:38,011][52664] DAMAGECOUNT value on done: 181512.0 [2024-08-06 01:14:38,012][52664] Sum rewards: 59.923, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO2': '0.034', 'weapon4': '0.144', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.382', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:38,582][52647] DAMAGECOUNT value on done: 189802.0 [2024-08-06 01:14:38,583][52647] Sum rewards: 63.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.390', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:38,617][52671] DAMAGECOUNT value on done: 181239.0 [2024-08-06 01:14:38,617][52671] Sum rewards: 64.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.523', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.185', 'weapon2': '0.442', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.394', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:38,842][52663] DAMAGECOUNT value on done: 182686.0 [2024-08-06 01:14:38,843][52663] Sum rewards: 53.084, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.510', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.121', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.386', 'weapon4': '0.570', 'WEAPON3': '0.750', 'weapon3': '2.622', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.423', 'FRAGCOUNT': '42.000'} [2024-08-06 01:14:39,221][52650] Updated weights for policy 0, policy_version 28861 (0.0013) [2024-08-06 01:14:40,112][52665] DAMAGECOUNT value on done: 184174.0 [2024-08-06 01:14:40,112][52665] Sum rewards: 67.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.182', 'weapon2': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '56.000'} [2024-08-06 01:14:40,259][52659] DAMAGECOUNT value on done: 185039.0 [2024-08-06 01:14:40,259][52659] Sum rewards: 67.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '59.000'} [2024-08-06 01:14:40,735][52664] DAMAGECOUNT value on done: 196897.0 [2024-08-06 01:14:40,736][52664] Sum rewards: 64.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.897', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.176', 'AMMO3': '0.206', 'weapon5': '0.212', 'AMMO4': '0.280', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '2.982', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:41,411][52647] DAMAGECOUNT value on done: 182926.0 [2024-08-06 01:14:41,414][52647] Sum rewards: 57.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.999', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.146', 'AMMO4': '0.184', 'weapon4': '0.298', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '2.966', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '49.000'} [2024-08-06 01:14:41,753][52663] DAMAGECOUNT value on done: 184927.0 [2024-08-06 01:14:41,753][52663] Sum rewards: 74.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.192', 'weapon2': '0.234', 'WEAPON3': '1.300', 'HITCOUNT': '3.390', 'weapon3': '3.628', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 01:14:42,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17613.0, 300 sec: 17605.8). Total num frames: 236486656. Throughput: 0: 4411.6. Samples: 59130650. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:14:42,795][52567] Avg episode reward: [(0, '59.991')] [2024-08-06 01:14:42,807][52665] DAMAGECOUNT value on done: 178802.0 [2024-08-06 01:14:42,811][52665] Sum rewards: 47.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.490', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.190', 'AMMO4': '0.214', 'AMMO3': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.474', 'weapon4': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.624', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '42.000'} [2024-08-06 01:14:42,934][52659] DAMAGECOUNT value on done: 180171.0 [2024-08-06 01:14:42,935][52659] Sum rewards: 70.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.170', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.310', 'weapon3': '3.526', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '58.000'} [2024-08-06 01:14:43,706][52664] DAMAGECOUNT value on done: 191532.0 [2024-08-06 01:14:43,707][52664] Sum rewards: 68.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.552', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.124', 'AMMO3': '0.171', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.500', 'weapon4': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '58.000'} [2024-08-06 01:14:43,874][52650] Updated weights for policy 0, policy_version 28871 (0.0011) [2024-08-06 01:14:44,234][52647] DAMAGECOUNT value on done: 191024.0 [2024-08-06 01:14:44,234][52647] Sum rewards: 60.221, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.790', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'weapon2': '0.248', 'AMMO3': '0.282', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.104', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:44,785][52663] DAMAGECOUNT value on done: 182991.0 [2024-08-06 01:14:44,786][52663] Sum rewards: 64.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.240', 'weapon2': '0.306', 'WEAPON3': '1.500', 'HITCOUNT': '3.430', 'weapon3': '3.450', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '55.000'} [2024-08-06 01:14:45,645][52659] DAMAGECOUNT value on done: 176636.0 [2024-08-06 01:14:45,646][52659] Sum rewards: 60.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.262', 'AMMO2': '0.027', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.270', 'weapon4': '0.616', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '2.854', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:45,908][52665] DAMAGECOUNT value on done: 183617.0 [2024-08-06 01:14:45,908][52665] Sum rewards: 74.360, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.927', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.136', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.300', 'AMMO3': '0.305', 'WEAPON3': '1.700', 'weapon3': '3.148', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '65.000'} [2024-08-06 01:14:45,993][52664] DAMAGECOUNT value on done: 190426.0 [2024-08-06 01:14:45,993][52664] Sum rewards: 56.551, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.053', 'AMMO5': '0.007', 'AMMO2': '0.040', 'ARMOR': '0.052', 'weapon5': '0.104', 'AMMO3': '0.115', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.600', 'WEAPON3': '0.750', 'weapon4': '1.064', 'weapon3': '1.992', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '45.000'} [2024-08-06 01:14:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 236576768. Throughput: 0: 4411.8. Samples: 59143920. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:14:47,794][52567] Avg episode reward: [(0, '60.201')] [2024-08-06 01:14:47,834][52663] DAMAGECOUNT value on done: 178086.0 [2024-08-06 01:14:47,836][52663] Sum rewards: 68.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.052', 'weapon4': '0.082', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '3.340', 'weapon3': '3.386', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '57.000'} [2024-08-06 01:14:48,291][52659] DAMAGECOUNT value on done: 173839.0 [2024-08-06 01:14:48,292][52659] Sum rewards: 50.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.762', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '44.000'} [2024-08-06 01:14:48,409][52664] DAMAGECOUNT value on done: 187100.0 [2024-08-06 01:14:48,410][52664] Sum rewards: 59.002, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.030', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.059', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.283', 'weapon2': '0.290', 'AMMO4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.140', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '53.000'} [2024-08-06 01:14:48,497][52650] Updated weights for policy 0, policy_version 28881 (0.0026) [2024-08-06 01:14:48,977][52665] DAMAGECOUNT value on done: 183438.0 [2024-08-06 01:14:48,978][52665] Sum rewards: 61.389, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.151', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.098', 'weapon4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '55.000'} [2024-08-06 01:14:50,936][52664] DAMAGECOUNT value on done: 183889.0 [2024-08-06 01:14:50,937][52664] Sum rewards: 55.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.502', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon5': '0.060', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'weapon2': '0.370', 'WEAPON4': '0.700', 'weapon4': '0.918', 'WEAPON3': '1.150', 'weapon3': '2.400', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '47.000'} [2024-08-06 01:14:51,018][52659] DAMAGECOUNT value on done: 179912.0 [2024-08-06 01:14:51,018][52659] Sum rewards: 46.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.972', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.110', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'AMMO4': '0.273', 'WEAPON4': '0.700', 'weapon4': '0.742', 'weapon2': '0.788', 'WEAPON3': '0.950', 'weapon3': '2.134', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '39.000'} [2024-08-06 01:14:52,132][52665] DAMAGECOUNT value on done: 180558.0 [2024-08-06 01:14:52,133][52665] Sum rewards: 65.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon4': '0.184', 'weapon2': '0.218', 'WEAPON3': '1.150', 'HITCOUNT': '3.390', 'weapon3': '3.468', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '54.000'} [2024-08-06 01:14:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 236666880. Throughput: 0: 4407.1. Samples: 59170280. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:14:52,794][52567] Avg episode reward: [(0, '59.942')] [2024-08-06 01:14:53,021][52650] Updated weights for policy 0, policy_version 28891 (0.0034) [2024-08-06 01:14:53,655][52659] DAMAGECOUNT value on done: 182217.0 [2024-08-06 01:14:53,656][52659] Sum rewards: 64.598, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.663', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.065', 'weapon5': '0.142', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'AMMO4': '0.327', 'weapon2': '0.504', 'weapon4': '0.516', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.522', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '57.000'} [2024-08-06 01:14:54,149][52664] DAMAGECOUNT value on done: 187324.0 [2024-08-06 01:14:54,150][52664] Sum rewards: 55.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.144', 'weapon2': '0.210', 'AMMO3': '0.231', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.442', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '49.000'} [2024-08-06 01:14:55,197][52665] DAMAGECOUNT value on done: 178839.0 [2024-08-06 01:14:55,199][52665] Sum rewards: 51.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.430', 'weapon4': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.726', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '44.000'} [2024-08-06 01:14:56,109][52659] DAMAGECOUNT value on done: 184919.0 [2024-08-06 01:14:56,111][52659] Sum rewards: 59.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.510', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.248', 'weapon2': '0.692', 'WEAPON3': '1.400', 'weapon3': '2.700', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:56,843][52664] DAMAGECOUNT value on done: 189507.0 [2024-08-06 01:14:56,843][52664] Sum rewards: 59.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.407', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.126', 'AMMO3': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '50.000'} [2024-08-06 01:14:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 236748800. Throughput: 0: 4410.4. Samples: 59196780. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:14:57,802][52567] Avg episode reward: [(0, '59.996')] [2024-08-06 01:14:57,883][52650] Updated weights for policy 0, policy_version 28901 (0.0035) [2024-08-06 01:14:58,244][52665] DAMAGECOUNT value on done: 180406.0 [2024-08-06 01:14:58,246][52665] Sum rewards: 63.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon4': '0.204', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '52.000'} [2024-08-06 01:14:59,028][52659] DAMAGECOUNT value on done: 184282.0 [2024-08-06 01:14:59,028][52659] Sum rewards: 58.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.707', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.096', 'weapon5': '0.120', 'weapon2': '0.184', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.410', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '51.000'} [2024-08-06 01:14:59,123][52664] DAMAGECOUNT value on done: 185649.0 [2024-08-06 01:14:59,128][52664] Sum rewards: 59.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'weapon4': '0.196', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.674', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:01,260][52665] DAMAGECOUNT value on done: 177850.0 [2024-08-06 01:15:01,261][52665] Sum rewards: 65.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.226', 'weapon2': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '55.000'} [2024-08-06 01:15:01,546][52664] DAMAGECOUNT value on done: 188823.0 [2024-08-06 01:15:01,547][52664] Sum rewards: 66.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '57.000'} [2024-08-06 01:15:02,098][52659] DAMAGECOUNT value on done: 180672.0 [2024-08-06 01:15:02,101][52659] Sum rewards: 53.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.412', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.110', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.305', 'WEAPON4': '0.350', 'weapon2': '0.468', 'weapon4': '0.526', 'WEAPON3': '1.750', 'weapon3': '2.626', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '48.000'} [2024-08-06 01:15:02,290][52650] Updated weights for policy 0, policy_version 28911 (0.0011) [2024-08-06 01:15:02,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 236838912. Throughput: 0: 4409.1. Samples: 59210030. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:15:02,795][52567] Avg episode reward: [(0, '60.000')] [2024-08-06 01:15:04,092][52665] DAMAGECOUNT value on done: 178930.0 [2024-08-06 01:15:04,094][52665] Sum rewards: 55.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.146', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon4': '0.326', 'WEAPON4': '0.450', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.702', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '48.000'} [2024-08-06 01:15:04,603][52664] DAMAGECOUNT value on done: 190832.0 [2024-08-06 01:15:04,604][52664] Sum rewards: 60.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.375', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.174', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '49.000'} [2024-08-06 01:15:05,075][52659] DAMAGECOUNT value on done: 186016.0 [2024-08-06 01:15:05,075][52659] Sum rewards: 54.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.154', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '45.000'} [2024-08-06 01:15:06,977][52665] DAMAGECOUNT value on done: 174980.0 [2024-08-06 01:15:06,977][52665] Sum rewards: 62.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.296', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.266', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '53.500'} [2024-08-06 01:15:07,189][52650] Updated weights for policy 0, policy_version 28921 (0.0013) [2024-08-06 01:15:07,220][52664] DAMAGECOUNT value on done: 185321.0 [2024-08-06 01:15:07,221][52664] Sum rewards: 62.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.217', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.120', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '54.000'} [2024-08-06 01:15:07,349][52794] Large shaping reward 2.634 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 01:15:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 236929024. Throughput: 0: 4402.9. Samples: 59236340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:15:07,794][52567] Avg episode reward: [(0, '60.036')] [2024-08-06 01:15:07,801][52659] DAMAGECOUNT value on done: 185822.0 [2024-08-06 01:15:07,803][52659] Sum rewards: 66.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.212', 'weapon5': '0.262', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.400', 'ARMOR': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2024-08-06 01:15:08,729][52668] DAMAGECOUNT value on done: 180021.0 [2024-08-06 01:15:08,730][52668] Sum rewards: 56.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.428', 'weapon4': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '47.000'} [2024-08-06 01:15:09,751][52664] DAMAGECOUNT value on done: 188712.0 [2024-08-06 01:15:09,752][52664] Sum rewards: 69.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.663', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.202', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '58.000'} [2024-08-06 01:15:10,104][52665] DAMAGECOUNT value on done: 181208.0 [2024-08-06 01:15:10,104][52665] Sum rewards: 45.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.828', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.068', 'AMMO3': '0.210', 'weapon5': '0.282', 'AMMO4': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON4': '0.600', 'weapon4': '0.704', 'WEAPON3': '1.250', 'HITCOUNT': '2.170', 'weapon3': '2.286', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '41.000'} [2024-08-06 01:15:11,360][52668] DAMAGECOUNT value on done: 187313.0 [2024-08-06 01:15:11,361][52668] Sum rewards: 52.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.196', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon2': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon4': '0.344', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.038', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:11,536][52650] Updated weights for policy 0, policy_version 28931 (0.0014) [2024-08-06 01:15:12,283][52662] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:15:12,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 237019136. Throughput: 0: 4400.2. Samples: 59262680. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:15:12,802][52567] Avg episode reward: [(0, '59.980')] [2024-08-06 01:15:13,181][52665] DAMAGECOUNT value on done: 176667.0 [2024-08-06 01:15:13,183][52665] Sum rewards: 52.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.092', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.226', 'weapon4': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '45.000'} [2024-08-06 01:15:14,112][52668] DAMAGECOUNT value on done: 184214.0 [2024-08-06 01:15:14,114][52668] Sum rewards: 60.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.052', 'weapon4': '0.074', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.344', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.284', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '52.000'} [2024-08-06 01:15:16,425][52650] Updated weights for policy 0, policy_version 28941 (0.0042) [2024-08-06 01:15:16,944][52668] DAMAGECOUNT value on done: 185455.0 [2024-08-06 01:15:16,945][52668] Sum rewards: 71.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.227', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.268', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '59.000'} [2024-08-06 01:15:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17605.8). Total num frames: 237109248. Throughput: 0: 4408.4. Samples: 59276000. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:15:17,802][52567] Avg episode reward: [(0, '59.884')] [2024-08-06 01:15:19,117][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 01:15:19,695][52668] DAMAGECOUNT value on done: 179663.0 [2024-08-06 01:15:19,697][52668] Sum rewards: 59.643, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.150', 'weapon5': '0.150', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.606', 'WEAPON3': '0.850', 'weapon3': '2.760', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '47.000'} [2024-08-06 01:15:20,367][52662] DAMAGECOUNT value on done: 186520.0 [2024-08-06 01:15:20,367][52662] Sum rewards: 65.720, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.092', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.030', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'weapon2': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '3.350', 'weapon3': '3.406', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:21,479][52650] Updated weights for policy 0, policy_version 28951 (0.0014) [2024-08-06 01:15:22,471][52668] DAMAGECOUNT value on done: 181167.0 [2024-08-06 01:15:22,472][52668] Sum rewards: 57.692, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.441', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.037', 'weapon5': '0.112', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.276', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '55.000'} [2024-08-06 01:15:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 237191168. Throughput: 0: 4388.7. Samples: 59301610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:15:22,794][52567] Avg episode reward: [(0, '60.202')] [2024-08-06 01:15:22,839][52660] DAMAGECOUNT value on done: 181328.0 [2024-08-06 01:15:22,843][52660] Sum rewards: 59.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.580', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.213', 'weapon4': '0.330', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.022', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:22,949][52662] DAMAGECOUNT value on done: 190283.0 [2024-08-06 01:15:22,952][52662] Sum rewards: 55.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.009', 'ARMOR': '0.017', 'AMMO2': '0.058', 'weapon5': '0.092', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.288', 'weapon4': '0.540', 'WEAPON4': '0.600', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.426', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:25,550][52650] Updated weights for policy 0, policy_version 28961 (0.0024) [2024-08-06 01:15:25,663][52668] DAMAGECOUNT value on done: 183197.0 [2024-08-06 01:15:25,665][52668] Sum rewards: 49.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.860', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.202', 'weapon2': '0.470', 'WEAPON4': '0.650', 'weapon4': '0.768', 'WEAPON3': '1.300', 'weapon3': '2.164', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '43.500'} [2024-08-06 01:15:25,709][52662] DAMAGECOUNT value on done: 189045.0 [2024-08-06 01:15:25,710][52662] Sum rewards: 56.603, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.236', 'weapon2': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '3.172', 'DAMAGECOUNT': '13.293', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:25,995][52660] DAMAGECOUNT value on done: 179697.0 [2024-08-06 01:15:25,998][52660] Sum rewards: 61.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.054', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.272', 'weapon2': '0.452', 'WEAPON4': '0.550', 'weapon4': '0.848', 'WEAPON3': '0.950', 'weapon3': '2.316', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '51.000'} [2024-08-06 01:15:26,976][52795] DAMAGECOUNT value on done: 168132.0 [2024-08-06 01:15:26,978][52795] Sum rewards: 61.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.087', 'ARMOR': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.227', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.536', 'WEAPON3': '1.450', 'weapon3': '2.838', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '54.000'} [2024-08-06 01:15:27,740][52614] Signal inference workers to stop experience collection... (5300 times) [2024-08-06 01:15:27,741][52614] Signal inference workers to resume experience collection... (5300 times) [2024-08-06 01:15:27,784][52650] InferenceWorker_p0-w0: stopping experience collection (5300 times) [2024-08-06 01:15:27,785][52650] InferenceWorker_p0-w0: resuming experience collection (5300 times) [2024-08-06 01:15:27,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 237273088. Throughput: 0: 4379.6. Samples: 59327730. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:15:27,794][52567] Avg episode reward: [(0, '60.022')] [2024-08-06 01:15:28,415][52668] DAMAGECOUNT value on done: 186261.0 [2024-08-06 01:15:28,415][52668] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.404', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.187', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '56.000'} [2024-08-06 01:15:28,651][52660] DAMAGECOUNT value on done: 182018.0 [2024-08-06 01:15:28,651][52660] Sum rewards: 51.512, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.014', 'AMMO5': '0.009', 'ARMOR': '0.017', 'AMMO2': '0.064', 'weapon5': '0.120', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'AMMO4': '0.321', 'weapon4': '0.368', 'weapon2': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '2.680', 'weapon3': '2.706', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '47.000'} [2024-08-06 01:15:28,711][52662] DAMAGECOUNT value on done: 178749.0 [2024-08-06 01:15:28,711][52662] Sum rewards: 68.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.396', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.426', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '2.724', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '60.000'} [2024-08-06 01:15:29,325][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:15:29,936][52671] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:15:30,024][52795] DAMAGECOUNT value on done: 164717.0 [2024-08-06 01:15:30,026][52795] Sum rewards: 60.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.140', 'AMMO3': '0.167', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.450', 'weapon2': '0.506', 'WEAPON3': '0.950', 'weapon3': '2.606', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '50.000'} [2024-08-06 01:15:30,595][52650] Updated weights for policy 0, policy_version 28971 (0.0013) [2024-08-06 01:15:30,825][52668] DAMAGECOUNT value on done: 182760.0 [2024-08-06 01:15:30,828][52668] Sum rewards: 56.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.375', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.272', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.342', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '48.500'} [2024-08-06 01:15:31,116][52660] DAMAGECOUNT value on done: 184224.0 [2024-08-06 01:15:31,117][52660] Sum rewards: 68.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO4': '0.196', 'AMMO3': '0.199', 'weapon2': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.626', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '58.000'} [2024-08-06 01:15:31,958][52662] DAMAGECOUNT value on done: 187519.0 [2024-08-06 01:15:31,958][52662] Sum rewards: 62.522, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.064', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.049', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.684', 'weapon4': '0.800', 'WEAPON3': '0.900', 'weapon3': '2.342', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '49.000'} [2024-08-06 01:15:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 237363200. Throughput: 0: 4375.8. Samples: 59340830. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:15:32,795][52567] Avg episode reward: [(0, '60.175')] [2024-08-06 01:15:33,075][52667] DAMAGECOUNT value on done: 183432.0 [2024-08-06 01:15:33,075][52667] Sum rewards: 73.421, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.908', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.078', 'weapon4': '0.154', 'AMMO3': '0.208', 'weapon2': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '63.000'} [2024-08-06 01:15:33,126][52795] DAMAGECOUNT value on done: 166631.0 [2024-08-06 01:15:33,126][52795] Sum rewards: 65.585, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.992', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.380', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.044', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:34,153][52668] DAMAGECOUNT value on done: 184649.0 [2024-08-06 01:15:34,154][52668] Sum rewards: 56.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.674', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.626', 'weapon2': '0.864', 'WEAPON3': '0.950', 'weapon3': '2.096', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:34,471][52660] DAMAGECOUNT value on done: 182075.0 [2024-08-06 01:15:34,474][52660] Sum rewards: 58.014, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.718', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.140', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon4': '0.254', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '2.856', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '52.000'} [2024-08-06 01:15:35,038][52662] DAMAGECOUNT value on done: 184725.0 [2024-08-06 01:15:35,039][52662] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.490', 'weapon4': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.624', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:35,721][52650] Updated weights for policy 0, policy_version 28981 (0.0012) [2024-08-06 01:15:36,296][52795] DAMAGECOUNT value on done: 167595.0 [2024-08-06 01:15:36,296][52795] Sum rewards: 57.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.418', 'WEAPON4': '0.550', 'weapon4': '0.758', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '50.000'} [2024-08-06 01:15:36,384][52667] DAMAGECOUNT value on done: 183881.0 [2024-08-06 01:15:36,385][52667] Sum rewards: 53.259, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.164', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.164', 'weapon4': '0.234', 'weapon2': '0.320', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.280', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '44.000'} [2024-08-06 01:15:37,269][52668] DAMAGECOUNT value on done: 183493.0 [2024-08-06 01:15:37,269][52668] Sum rewards: 47.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.144', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.156', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.364', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.032', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '42.000'} [2024-08-06 01:15:37,456][52660] DAMAGECOUNT value on done: 180636.0 [2024-08-06 01:15:37,458][52660] Sum rewards: 80.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '68.000'} [2024-08-06 01:15:37,689][52662] DAMAGECOUNT value on done: 187246.0 [2024-08-06 01:15:37,689][52662] Sum rewards: 57.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.165', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.340', 'weapon4': '0.396', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.852', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '48.000'} [2024-08-06 01:15:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 237453312. Throughput: 0: 4369.6. Samples: 59366910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:15:37,794][52567] Avg episode reward: [(0, '60.499')] [2024-08-06 01:15:37,797][52614] Saving new best policy, reward=60.499! [2024-08-06 01:15:39,560][52795] DAMAGECOUNT value on done: 172266.0 [2024-08-06 01:15:39,560][52795] Sum rewards: 52.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.904', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON5': '0.350', 'weapon5': '0.424', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.438', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:39,711][52650] Updated weights for policy 0, policy_version 28991 (0.0016) [2024-08-06 01:15:39,797][52667] DAMAGECOUNT value on done: 185206.0 [2024-08-06 01:15:39,797][52667] Sum rewards: 69.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.747', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO4': '0.205', 'AMMO3': '0.223', 'weapon4': '0.286', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 01:15:39,849][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:15:39,927][52668] DAMAGECOUNT value on done: 179413.0 [2024-08-06 01:15:39,928][52668] Sum rewards: 59.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.695', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.360', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '51.000'} [2024-08-06 01:15:40,316][52660] DAMAGECOUNT value on done: 184922.0 [2024-08-06 01:15:40,318][52660] Sum rewards: 75.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.832', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '62.000'} [2024-08-06 01:15:40,491][52662] DAMAGECOUNT value on done: 191857.0 [2024-08-06 01:15:40,491][52662] Sum rewards: 58.056, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'weapon4': '0.290', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.750', 'weapon3': '2.994', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:41,698][52794] DAMAGECOUNT value on done: 187779.0 [2024-08-06 01:15:41,701][52794] Sum rewards: 64.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.024', 'AMMO4': '0.068', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '55.000'} [2024-08-06 01:15:42,557][52668] DAMAGECOUNT value on done: 174359.0 [2024-08-06 01:15:42,558][52668] Sum rewards: 61.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.177', 'weapon5': '0.246', 'AMMO4': '0.272', 'weapon4': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '50.000'} [2024-08-06 01:15:42,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 237543424. Throughput: 0: 4358.9. Samples: 59392930. Policy #0 lag: (min: 0.0, avg: 3.4, max: 10.0) [2024-08-06 01:15:42,794][52567] Avg episode reward: [(0, '60.735')] [2024-08-06 01:15:42,795][52614] Saving new best policy, reward=60.735! [2024-08-06 01:15:42,817][52795] DAMAGECOUNT value on done: 168640.0 [2024-08-06 01:15:42,818][52795] Sum rewards: 66.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.219', 'weapon2': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '58.000'} [2024-08-06 01:15:42,819][52667] DAMAGECOUNT value on done: 181282.0 [2024-08-06 01:15:42,821][52667] Sum rewards: 75.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.568', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '60.000'} [2024-08-06 01:15:43,028][52660] DAMAGECOUNT value on done: 184623.0 [2024-08-06 01:15:43,029][52660] Sum rewards: 67.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.522', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '57.000'} [2024-08-06 01:15:43,532][52662] DAMAGECOUNT value on done: 185038.0 [2024-08-06 01:15:43,532][52662] Sum rewards: 61.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.114', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.410', 'weapon2': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.600', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '50.000'} [2024-08-06 01:15:44,224][52647] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0)] [2024-08-06 01:15:44,869][52650] Updated weights for policy 0, policy_version 29001 (0.0024) [2024-08-06 01:15:44,882][52794] DAMAGECOUNT value on done: 190916.0 [2024-08-06 01:15:44,883][52794] Sum rewards: 62.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.360', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '54.000'} [2024-08-06 01:15:45,233][52668] DAMAGECOUNT value on done: 180302.0 [2024-08-06 01:15:45,233][52668] Sum rewards: 60.081, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.735', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'weapon4': '0.302', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '51.000'} [2024-08-06 01:15:45,551][52660] DAMAGECOUNT value on done: 184521.0 [2024-08-06 01:15:45,552][52660] Sum rewards: 64.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.350', 'weapon4': '0.454', 'weapon2': '0.486', 'WEAPON3': '0.900', 'weapon3': '2.714', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '53.500'} [2024-08-06 01:15:45,696][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:15:45,858][52667] DAMAGECOUNT value on done: 185142.0 [2024-08-06 01:15:45,859][52667] Sum rewards: 61.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.887', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.224', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.582', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:45,901][52669] DAMAGECOUNT value on done: 186037.0 [2024-08-06 01:15:45,904][52669] Sum rewards: 47.565, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.394', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.078', 'weapon5': '0.166', 'AMMO3': '0.183', 'AMMO4': '0.391', 'WEAPON5': '0.400', 'weapon2': '0.436', 'weapon4': '0.690', 'WEAPON4': '0.950', 'WEAPON3': '1.050', 'weapon3': '2.390', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '43.000'} [2024-08-06 01:15:45,925][52795] DAMAGECOUNT value on done: 174990.0 [2024-08-06 01:15:45,928][52795] Sum rewards: 69.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.142', 'weapon4': '0.144', 'AMMO4': '0.165', 'AMMO3': '0.234', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '58.000'} [2024-08-06 01:15:46,738][52662] DAMAGECOUNT value on done: 193642.0 [2024-08-06 01:15:46,739][52662] Sum rewards: 74.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.274', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'AMMO3': '0.229', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.500'} [2024-08-06 01:15:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 237625344. Throughput: 0: 4353.8. Samples: 59405950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 10.0) [2024-08-06 01:15:47,795][52567] Avg episode reward: [(0, '61.285')] [2024-08-06 01:15:47,799][52614] Saving new best policy, reward=61.285! [2024-08-06 01:15:48,143][52667] DAMAGECOUNT value on done: 185324.0 [2024-08-06 01:15:48,145][52667] Sum rewards: 51.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.884', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.210', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:48,151][52794] DAMAGECOUNT value on done: 184303.0 [2024-08-06 01:15:48,151][52794] Sum rewards: 44.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon7': '0.054', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.210', 'weapon2': '0.260', 'WEAPON4': '0.350', 'weapon4': '0.782', 'WEAPON3': '1.250', 'weapon3': '2.404', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.033', 'FRAGCOUNT': '38.000'} [2024-08-06 01:15:48,344][52668] DAMAGECOUNT value on done: 177543.0 [2024-08-06 01:15:48,344][52668] Sum rewards: 60.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.988', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.402', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '54.000'} [2024-08-06 01:15:48,713][52660] DAMAGECOUNT value on done: 180862.0 [2024-08-06 01:15:48,714][52660] Sum rewards: 72.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '58.000'} [2024-08-06 01:15:48,769][52669] DAMAGECOUNT value on done: 182543.0 [2024-08-06 01:15:48,769][52669] Sum rewards: 58.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.362', 'AMMO5': '0.004', 'ARMOR': '0.012', 'weapon5': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon4': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '51.000'} [2024-08-06 01:15:48,993][52650] Updated weights for policy 0, policy_version 29011 (0.0021) [2024-08-06 01:15:49,096][52795] DAMAGECOUNT value on done: 170932.0 [2024-08-06 01:15:49,097][52795] Sum rewards: 54.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.135', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO4': '0.180', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.420', 'weapon2': '0.474', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '47.000'} [2024-08-06 01:15:49,891][52662] DAMAGECOUNT value on done: 185405.0 [2024-08-06 01:15:49,895][52662] Sum rewards: 56.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.705', 'AMMO5': '0.013', 'weapon7': '0.016', 'AMMO2': '0.034', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.166', 'AMMO4': '0.171', 'AMMO3': '0.195', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON4': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.644', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '48.000'} [2024-08-06 01:15:51,041][52668] DAMAGECOUNT value on done: 183719.0 [2024-08-06 01:15:51,042][52668] Sum rewards: 65.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.856', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.044', 'weapon5': '0.050', 'AMMO3': '0.216', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '57.000'} [2024-08-06 01:15:51,150][52667] DAMAGECOUNT value on done: 186225.0 [2024-08-06 01:15:51,152][52667] Sum rewards: 65.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '57.000'} [2024-08-06 01:15:51,295][52794] DAMAGECOUNT value on done: 183917.0 [2024-08-06 01:15:51,297][52794] Sum rewards: 67.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.206', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon5': '0.146', 'AMMO4': '0.206', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '58.000'} [2024-08-06 01:15:51,301][52660] DAMAGECOUNT value on done: 187657.0 [2024-08-06 01:15:51,304][52660] Sum rewards: 60.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'weapon4': '0.494', 'weapon2': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.568', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '50.000'} [2024-08-06 01:15:51,801][52669] DAMAGECOUNT value on done: 184057.0 [2024-08-06 01:15:51,801][52669] Sum rewards: 60.562, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon4': '0.214', 'AMMO4': '0.215', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.160', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:52,192][52795] DAMAGECOUNT value on done: 167447.0 [2024-08-06 01:15:52,195][52795] Sum rewards: 55.714, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.605', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon4': '0.494', 'WEAPON3': '1.650', 'weapon3': '3.020', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '52.000'} [2024-08-06 01:15:52,791][52662] DAMAGECOUNT value on done: 187333.0 [2024-08-06 01:15:52,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.6, 300 sec: 17550.3). Total num frames: 237707264. Throughput: 0: 4350.9. Samples: 59432130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 10.0) [2024-08-06 01:15:52,795][52567] Avg episode reward: [(0, '61.034')] [2024-08-06 01:15:52,792][52662] Sum rewards: 51.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.687', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.130', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '2.944', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:53,770][52667] DAMAGECOUNT value on done: 183427.0 [2024-08-06 01:15:53,771][52667] Sum rewards: 65.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.966', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '57.000'} [2024-08-06 01:15:54,024][52650] Updated weights for policy 0, policy_version 29021 (0.0014) [2024-08-06 01:15:54,163][52794] DAMAGECOUNT value on done: 186988.0 [2024-08-06 01:15:54,166][52794] Sum rewards: 49.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon4': '0.282', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '43.000'} [2024-08-06 01:15:54,233][52668] DAMAGECOUNT value on done: 182717.0 [2024-08-06 01:15:54,235][52668] Sum rewards: 59.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.024', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.050', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.260', 'weapon4': '0.360', 'weapon2': '0.364', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:54,568][52669] DAMAGECOUNT value on done: 181520.0 [2024-08-06 01:15:54,571][52669] Sum rewards: 61.260, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.553', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.122', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '52.000'} [2024-08-06 01:15:54,632][52660] DAMAGECOUNT value on done: 177237.0 [2024-08-06 01:15:54,633][52660] Sum rewards: 53.105, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.012', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.255', 'weapon4': '0.256', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '47.000'} [2024-08-06 01:15:55,280][52795] DAMAGECOUNT value on done: 171476.0 [2024-08-06 01:15:55,281][52795] Sum rewards: 55.348, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.056', 'AMMO3': '0.162', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.394', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:55,678][52662] DAMAGECOUNT value on done: 184485.0 [2024-08-06 01:15:55,679][52662] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.964', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'weapon2': '0.202', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.752', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '59.000'} [2024-08-06 01:15:56,222][52667] DAMAGECOUNT value on done: 183148.0 [2024-08-06 01:15:56,225][52667] Sum rewards: 58.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '51.000'} [2024-08-06 01:15:56,957][52668] DAMAGECOUNT value on done: 185819.0 [2024-08-06 01:15:56,959][52668] Sum rewards: 68.649, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.005', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.052', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO4': '0.253', 'AMMO3': '0.299', 'weapon2': '0.344', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.108', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '62.000'} [2024-08-06 01:15:57,068][52794] DAMAGECOUNT value on done: 184176.0 [2024-08-06 01:15:57,069][52794] Sum rewards: 58.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.130', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.096', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '49.000'} [2024-08-06 01:15:57,232][52660] DAMAGECOUNT value on done: 182608.0 [2024-08-06 01:15:57,234][52660] Sum rewards: 58.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.552', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.197', 'WEAPON4': '0.400', 'weapon2': '0.550', 'weapon4': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.480', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '50.000'} [2024-08-06 01:15:57,612][52669] DAMAGECOUNT value on done: 183240.0 [2024-08-06 01:15:57,612][52669] Sum rewards: 73.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'weapon4': '0.194', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '60.000'} [2024-08-06 01:15:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 237805568. Throughput: 0: 4346.7. Samples: 59458280. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:15:57,794][52567] Avg episode reward: [(0, '60.527')] [2024-08-06 01:15:58,412][52795] DAMAGECOUNT value on done: 169705.0 [2024-08-06 01:15:58,416][52795] Sum rewards: 65.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.604', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.518', 'WEAPON3': '1.550', 'weapon3': '2.736', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '57.000'} [2024-08-06 01:15:58,606][52662] DAMAGECOUNT value on done: 189766.0 [2024-08-06 01:15:58,606][52662] Sum rewards: 58.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.338', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.290', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '49.000'} [2024-08-06 01:15:58,966][52650] Updated weights for policy 0, policy_version 29031 (0.0014) [2024-08-06 01:15:59,277][52667] DAMAGECOUNT value on done: 185396.0 [2024-08-06 01:15:59,279][52667] Sum rewards: 64.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.226', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '53.000'} [2024-08-06 01:15:59,497][52668] DAMAGECOUNT value on done: 185307.0 [2024-08-06 01:15:59,499][52668] Sum rewards: 55.725, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.254', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.088', 'AMMO3': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'weapon2': '0.358', 'weapon4': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.570', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '46.000'} [2024-08-06 01:15:59,760][52794] DAMAGECOUNT value on done: 191173.0 [2024-08-06 01:15:59,760][52794] Sum rewards: 52.378, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.211', 'weapon2': '0.358', 'WEAPON4': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.766', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '44.500'} [2024-08-06 01:15:59,858][52660] DAMAGECOUNT value on done: 185827.0 [2024-08-06 01:15:59,860][52660] Sum rewards: 73.914, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.188', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.227', 'weapon2': '0.242', 'WEAPON4': '0.450', 'weapon4': '0.760', 'WEAPON3': '1.250', 'weapon3': '2.656', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '63.000'} [2024-08-06 01:16:00,728][52669] DAMAGECOUNT value on done: 181110.0 [2024-08-06 01:16:00,729][52669] Sum rewards: 50.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.330', 'weapon4': '0.392', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.016', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '46.000'} [2024-08-06 01:16:01,246][52662] DAMAGECOUNT value on done: 186861.0 [2024-08-06 01:16:01,248][52662] Sum rewards: 66.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.764', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.163', 'weapon5': '0.182', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '54.000'} [2024-08-06 01:16:01,648][52795] DAMAGECOUNT value on done: 166805.0 [2024-08-06 01:16:01,649][52795] Sum rewards: 67.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO4': '0.149', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.226', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:02,143][52667] DAMAGECOUNT value on done: 185424.0 [2024-08-06 01:16:02,144][52667] Sum rewards: 68.255, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.441', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.220', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:02,424][52794] DAMAGECOUNT value on done: 187366.0 [2024-08-06 01:16:02,426][52794] Sum rewards: 58.651, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'ARMOR': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon4': '0.440', 'weapon2': '0.492', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:02,521][52668] DAMAGECOUNT value on done: 184640.0 [2024-08-06 01:16:02,521][52668] Sum rewards: 66.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.512', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '57.500'} [2024-08-06 01:16:02,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 237887488. Throughput: 0: 4350.2. Samples: 59471760. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:16:02,794][52567] Avg episode reward: [(0, '61.086')] [2024-08-06 01:16:02,839][52660] DAMAGECOUNT value on done: 192836.0 [2024-08-06 01:16:02,839][52660] Sum rewards: 37.084, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.623', 'AMMO5': '0.021', 'ARMOR': '0.028', 'AMMO2': '0.058', 'weapon5': '0.174', 'AMMO3': '0.191', 'AMMO4': '0.292', 'WEAPON5': '0.450', 'weapon2': '0.646', 'WEAPON4': '0.700', 'weapon4': '0.920', 'WEAPON3': '1.150', 'weapon3': '1.976', 'HITCOUNT': '2.430', 'DAMAGECOUNT': '11.421', 'FRAGCOUNT': '35.000'} [2024-08-06 01:16:03,389][52650] Updated weights for policy 0, policy_version 29041 (0.0033) [2024-08-06 01:16:03,519][52669] DAMAGECOUNT value on done: 184336.0 [2024-08-06 01:16:03,521][52669] Sum rewards: 58.087, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.082', 'ARMOR': '0.004', 'AMMO5': '0.006', 'weapon5': '0.026', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.219', 'AMMO3': '0.235', 'weapon2': '0.362', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.806', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:04,171][52662] DAMAGECOUNT value on done: 191519.0 [2024-08-06 01:16:04,171][52662] Sum rewards: 68.582, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon4': '0.278', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '59.000'} [2024-08-06 01:16:04,832][52795] DAMAGECOUNT value on done: 166683.0 [2024-08-06 01:16:04,832][52795] Sum rewards: 69.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.318', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.022', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.222', 'weapon4': '0.244', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.318', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '59.000'} [2024-08-06 01:16:05,303][52667] DAMAGECOUNT value on done: 182976.0 [2024-08-06 01:16:05,305][52667] Sum rewards: 61.441, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.418', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.242', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '54.000'} [2024-08-06 01:16:05,317][52794] DAMAGECOUNT value on done: 189847.0 [2024-08-06 01:16:05,317][52794] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'ARMOR': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.177', 'AMMO4': '0.201', 'WEAPON4': '0.550', 'weapon4': '0.764', 'weapon2': '0.890', 'WEAPON3': '1.050', 'weapon3': '2.168', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '57.000'} [2024-08-06 01:16:05,770][52660] DAMAGECOUNT value on done: 180702.0 [2024-08-06 01:16:05,772][52660] Sum rewards: 67.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.211', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'weapon4': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:06,372][52669] DAMAGECOUNT value on done: 183720.0 [2024-08-06 01:16:06,372][52669] Sum rewards: 61.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.162', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:07,163][52662] DAMAGECOUNT value on done: 184117.0 [2024-08-06 01:16:07,163][52662] Sum rewards: 66.307, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.770', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO4': '0.221', 'AMMO3': '0.229', 'weapon4': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '59.000'} [2024-08-06 01:16:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 237977600. Throughput: 0: 4374.2. Samples: 59498450. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:16:07,794][52567] Avg episode reward: [(0, '61.315')] [2024-08-06 01:16:07,864][52614] Saving new best policy, reward=61.315! [2024-08-06 01:16:07,893][52650] Updated weights for policy 0, policy_version 29051 (0.0011) [2024-08-06 01:16:08,057][52795] DAMAGECOUNT value on done: 170719.0 [2024-08-06 01:16:08,059][52795] Sum rewards: 61.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.642', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.035', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.206', 'weapon2': '0.406', 'WEAPON4': '0.600', 'weapon4': '0.792', 'WEAPON3': '1.250', 'weapon3': '2.374', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '53.000'} [2024-08-06 01:16:08,185][52667] DAMAGECOUNT value on done: 186230.0 [2024-08-06 01:16:08,187][52667] Sum rewards: 62.062, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.816', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.168', 'AMMO4': '0.172', 'weapon5': '0.194', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '54.000'} [2024-08-06 01:16:08,340][52794] DAMAGECOUNT value on done: 190923.0 [2024-08-06 01:16:08,342][52794] Sum rewards: 53.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'weapon5': '0.002', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.146', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.550', 'weapon3': '2.964', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:08,752][52660] DAMAGECOUNT value on done: 185434.0 [2024-08-06 01:16:08,753][52660] Sum rewards: 57.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.743', 'AMMO5': '0.004', 'AMMO2': '0.033', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.169', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:09,319][52669] DAMAGECOUNT value on done: 183397.0 [2024-08-06 01:16:09,320][52669] Sum rewards: 59.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.719', 'ARMOR': '0.012', 'AMMO2': '0.045', 'AMMO4': '0.224', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'weapon4': '0.422', 'weapon2': '0.482', 'WEAPON3': '1.500', 'weapon3': '2.810', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '53.000'} [2024-08-06 01:16:09,770][52662] DAMAGECOUNT value on done: 187462.0 [2024-08-06 01:16:09,770][52662] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.012', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.060', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'AMMO4': '0.302', 'weapon2': '0.424', 'WEAPON4': '0.600', 'weapon4': '0.722', 'WEAPON3': '1.250', 'weapon3': '2.424', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '58.000'} [2024-08-06 01:16:10,942][52667] DAMAGECOUNT value on done: 181269.0 [2024-08-06 01:16:10,942][52667] Sum rewards: 71.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.254', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.190', 'weapon2': '0.260', 'WEAPON3': '1.150', 'HITCOUNT': '3.480', 'weapon3': '3.554', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '58.000'} [2024-08-06 01:16:11,136][52795] DAMAGECOUNT value on done: 165586.0 [2024-08-06 01:16:11,138][52795] Sum rewards: 46.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO2': '0.054', 'AMMO3': '0.196', 'AMMO4': '0.270', 'weapon2': '0.358', 'WEAPON4': '0.400', 'weapon4': '0.856', 'WEAPON3': '1.200', 'weapon3': '2.374', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '41.000'} [2024-08-06 01:16:11,268][52794] DAMAGECOUNT value on done: 184615.0 [2024-08-06 01:16:11,272][52794] Sum rewards: 59.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.782', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.066', 'AMMO4': '0.080', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.512', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.046', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:11,528][52660] DAMAGECOUNT value on done: 174790.0 [2024-08-06 01:16:11,530][52660] Sum rewards: 54.732, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.913', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.151', 'weapon5': '0.156', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.876', 'WEAPON3': '0.950', 'weapon3': '2.278', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '45.000'} [2024-08-06 01:16:12,281][52669] DAMAGECOUNT value on done: 181658.0 [2024-08-06 01:16:12,282][52669] Sum rewards: 65.980, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.204', 'WEAPON4': '0.500', 'weapon2': '0.580', 'weapon4': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.434', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '58.000'} [2024-08-06 01:16:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 238059520. Throughput: 0: 4372.0. Samples: 59524470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:16:12,794][52567] Avg episode reward: [(0, '61.297')] [2024-08-06 01:16:12,849][52650] Updated weights for policy 0, policy_version 29061 (0.0022) [2024-08-06 01:16:13,010][52662] DAMAGECOUNT value on done: 184668.0 [2024-08-06 01:16:13,011][52662] Sum rewards: 49.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.012', 'weapon5': '0.018', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.422', 'weapon4': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.686', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '43.000'} [2024-08-06 01:16:13,960][52794] DAMAGECOUNT value on done: 185766.0 [2024-08-06 01:16:13,961][52794] Sum rewards: 57.735, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.546', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon4': '0.200', 'weapon2': '0.606', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.004', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:13,971][52660] DAMAGECOUNT value on done: 185550.0 [2024-08-06 01:16:13,973][52660] Sum rewards: 52.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.486', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.314', 'WEAPON4': '0.500', 'weapon4': '0.778', 'WEAPON3': '1.350', 'weapon3': '2.546', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:14,046][52667] DAMAGECOUNT value on done: 188289.0 [2024-08-06 01:16:14,047][52667] Sum rewards: 65.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.372', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.422', 'weapon4': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:14,191][52795] DAMAGECOUNT value on done: 174206.0 [2024-08-06 01:16:14,193][52795] Sum rewards: 66.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.933', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.180', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '54.000'} [2024-08-06 01:16:15,262][52669] DAMAGECOUNT value on done: 185281.0 [2024-08-06 01:16:15,262][52669] Sum rewards: 56.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.404', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.196', 'AMMO3': '0.214', 'weapon2': '0.338', 'WEAPON4': '0.600', 'weapon4': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:15,627][52662] DAMAGECOUNT value on done: 183380.0 [2024-08-06 01:16:15,630][52662] Sum rewards: 54.669, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.740', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.039', 'AMMO3': '0.120', 'weapon5': '0.150', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.962', 'weapon3': '2.402', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '43.000'} [2024-08-06 01:16:15,923][52658] DAMAGECOUNT value on done: 188015.0 [2024-08-06 01:16:15,923][52658] Sum rewards: 55.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.868', 'AMMO5': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.167', 'weapon4': '0.246', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '48.000'} [2024-08-06 01:16:16,982][52660] DAMAGECOUNT value on done: 178828.0 [2024-08-06 01:16:16,983][52660] Sum rewards: 58.175, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.047', 'weapon5': '0.140', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'AMMO4': '0.234', 'WEAPON4': '0.600', 'weapon4': '0.620', 'weapon2': '0.756', 'WEAPON3': '0.900', 'weapon3': '2.246', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '46.000'} [2024-08-06 01:16:17,044][52794] DAMAGECOUNT value on done: 181714.0 [2024-08-06 01:16:17,046][52794] Sum rewards: 54.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.119', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'AMMO3': '0.225', 'weapon2': '0.474', 'WEAPON4': '0.800', 'weapon4': '0.928', 'WEAPON3': '1.350', 'weapon3': '2.122', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:17,078][52667] DAMAGECOUNT value on done: 190877.0 [2024-08-06 01:16:17,080][52667] Sum rewards: 60.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.334', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.786', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:17,393][52795] DAMAGECOUNT value on done: 174270.0 [2024-08-06 01:16:17,395][52795] Sum rewards: 55.882, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon2': '0.278', 'AMMO3': '0.317', 'WEAPON4': '0.350', 'weapon4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.812', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:17,621][52650] Updated weights for policy 0, policy_version 29071 (0.0011) [2024-08-06 01:16:17,796][52567] Fps is (10 sec: 17199.7, 60 sec: 17339.2, 300 sec: 17550.2). Total num frames: 238149632. Throughput: 0: 4374.0. Samples: 59537670. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:16:17,797][52567] Avg episode reward: [(0, '61.133')] [2024-08-06 01:16:17,910][52669] DAMAGECOUNT value on done: 184934.0 [2024-08-06 01:16:17,912][52669] Sum rewards: 62.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.151', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '54.000'} [2024-08-06 01:16:18,968][52658] DAMAGECOUNT value on done: 184843.0 [2024-08-06 01:16:18,968][52658] Sum rewards: 61.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.537', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:19,574][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:16:19,993][52667] DAMAGECOUNT value on done: 187433.0 [2024-08-06 01:16:19,993][52667] Sum rewards: 44.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.574', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.146', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon4': '0.524', 'WEAPON4': '0.600', 'weapon2': '0.670', 'WEAPON3': '0.950', 'weapon3': '2.408', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.733', 'FRAGCOUNT': '38.000'} [2024-08-06 01:16:20,315][52794] DAMAGECOUNT value on done: 195355.0 [2024-08-06 01:16:20,315][52794] Sum rewards: 63.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.005', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:20,407][52669] DAMAGECOUNT value on done: 181820.0 [2024-08-06 01:16:20,409][52669] Sum rewards: 64.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.953', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.424', 'weapon4': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:20,555][52795] DAMAGECOUNT value on done: 164073.0 [2024-08-06 01:16:20,555][52795] Sum rewards: 46.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.517', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.226', 'weapon4': '0.372', 'WEAPON4': '0.450', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.964', 'FRAGCOUNT': '42.000'} [2024-08-06 01:16:21,612][52658] DAMAGECOUNT value on done: 188738.0 [2024-08-06 01:16:21,613][52658] Sum rewards: 61.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.218', 'weapon2': '0.294', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '51.500'} [2024-08-06 01:16:22,070][52650] Updated weights for policy 0, policy_version 29081 (0.0019) [2024-08-06 01:16:22,714][52667] DAMAGECOUNT value on done: 189431.0 [2024-08-06 01:16:22,716][52667] Sum rewards: 58.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.187', 'weapon2': '0.434', 'WEAPON4': '0.450', 'weapon4': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 238239744. Throughput: 0: 4379.3. Samples: 59563980. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:16:22,794][52567] Avg episode reward: [(0, '60.691')] [2024-08-06 01:16:23,278][52669] DAMAGECOUNT value on done: 188065.0 [2024-08-06 01:16:23,278][52669] Sum rewards: 78.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.244', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '64.000'} [2024-08-06 01:16:23,495][52794] DAMAGECOUNT value on done: 183011.0 [2024-08-06 01:16:23,495][52794] Sum rewards: 48.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.184', 'weapon2': '0.248', 'WEAPON4': '0.500', 'weapon4': '0.734', 'WEAPON3': '1.150', 'weapon3': '2.532', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '42.000'} [2024-08-06 01:16:23,810][52795] DAMAGECOUNT value on done: 175817.0 [2024-08-06 01:16:23,811][52795] Sum rewards: 73.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.634', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.360', 'weapon4': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '60.000'} [2024-08-06 01:16:24,263][52658] DAMAGECOUNT value on done: 188458.0 [2024-08-06 01:16:24,272][52658] Sum rewards: 66.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.578', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.269', 'weapon2': '0.376', 'WEAPON3': '1.600', 'weapon3': '3.454', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '57.000'} [2024-08-06 01:16:25,325][52667] DAMAGECOUNT value on done: 183659.0 [2024-08-06 01:16:25,327][52667] Sum rewards: 57.962, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.033', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.206', 'weapon2': '0.242', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:26,326][52669] DAMAGECOUNT value on done: 190207.0 [2024-08-06 01:16:26,326][52669] Sum rewards: 63.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.844', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.099', 'weapon4': '0.120', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.144', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:26,730][52794] DAMAGECOUNT value on done: 190669.0 [2024-08-06 01:16:26,730][52650] Updated weights for policy 0, policy_version 29091 (0.0013) [2024-08-06 01:16:26,730][52794] Sum rewards: 53.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.939', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.206', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.378', 'weapon2': '0.532', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.726', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.353', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:26,893][52658] DAMAGECOUNT value on done: 186343.0 [2024-08-06 01:16:26,894][52658] Sum rewards: 47.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.486', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.108', 'AMMO3': '0.184', 'AMMO4': '0.205', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '41.000'} [2024-08-06 01:16:26,975][52795] DAMAGECOUNT value on done: 176259.0 [2024-08-06 01:16:26,975][52795] Sum rewards: 72.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.824', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.117', 'weapon5': '0.180', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '60.000'} [2024-08-06 01:16:27,790][52667] DAMAGECOUNT value on done: 188549.0 [2024-08-06 01:16:27,792][52667] Sum rewards: 44.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.208', 'AMMO4': '0.237', 'weapon2': '0.238', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '2.520', 'weapon3': '2.886', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '41.000'} [2024-08-06 01:16:27,794][52567] Fps is (10 sec: 18026.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 238329856. Throughput: 0: 4385.6. Samples: 59590280. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:16:27,794][52567] Avg episode reward: [(0, '60.767')] [2024-08-06 01:16:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029093_238329856.pth... [2024-08-06 01:16:27,970][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028579_234119168.pth [2024-08-06 01:16:28,396][52666] DAMAGECOUNT value on done: 187486.0 [2024-08-06 01:16:28,396][52666] Sum rewards: 56.706, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.539', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'weapon4': '0.162', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.200', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:29,209][52669] DAMAGECOUNT value on done: 196477.0 [2024-08-06 01:16:29,209][52669] Sum rewards: 60.630, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.476', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.324', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '53.500'} [2024-08-06 01:16:29,454][52658] DAMAGECOUNT value on done: 181920.0 [2024-08-06 01:16:29,456][52658] Sum rewards: 57.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.756', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.108', 'AMMO3': '0.172', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.596', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:29,531][52794] DAMAGECOUNT value on done: 187608.0 [2024-08-06 01:16:29,532][52794] Sum rewards: 59.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.736', 'AMMO5': '0.003', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.402', 'weapon2': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.600', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:30,353][52803] DAMAGECOUNT value on done: 172521.0 [2024-08-06 01:16:30,354][52803] Sum rewards: 61.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.924', 'AMMO2': '0.012', 'ARMOR': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon4': '0.066', 'AMMO3': '0.236', 'weapon2': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.388', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:31,409][52650] Updated weights for policy 0, policy_version 29101 (0.0012) [2024-08-06 01:16:31,498][52666] DAMAGECOUNT value on done: 188194.0 [2024-08-06 01:16:31,498][52666] Sum rewards: 53.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.348', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.094', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '48.000'} [2024-08-06 01:16:32,042][52658] DAMAGECOUNT value on done: 190158.0 [2024-08-06 01:16:32,042][52658] Sum rewards: 45.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.855', 'AMMO2': '0.055', 'AMMO3': '0.235', 'AMMO4': '0.277', 'weapon2': '0.278', 'WEAPON4': '0.600', 'weapon4': '0.812', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '2.728', 'DAMAGECOUNT': '12.078', 'FRAGCOUNT': '41.000'} [2024-08-06 01:16:32,338][52669] DAMAGECOUNT value on done: 185274.0 [2024-08-06 01:16:32,339][52669] Sum rewards: 57.007, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.812', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.158', 'AMMO4': '0.198', 'AMMO3': '0.227', 'weapon2': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:32,402][52794] DAMAGECOUNT value on done: 188545.0 [2024-08-06 01:16:32,404][52794] Sum rewards: 73.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '62.000'} [2024-08-06 01:16:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 238419968. Throughput: 0: 4381.8. Samples: 59603130. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:16:32,795][52567] Avg episode reward: [(0, '60.008')] [2024-08-06 01:16:33,491][52803] DAMAGECOUNT value on done: 174707.0 [2024-08-06 01:16:33,494][52803] Sum rewards: 42.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.064', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'AMMO4': '0.255', 'weapon2': '0.406', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon4': '1.120', 'weapon3': '2.148', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '10.620', 'FRAGCOUNT': '39.000'} [2024-08-06 01:16:34,173][52666] DAMAGECOUNT value on done: 186243.0 [2024-08-06 01:16:34,176][52666] Sum rewards: 55.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.872', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.150', 'weapon5': '0.216', 'AMMO4': '0.293', 'WEAPON5': '0.350', 'weapon2': '0.462', 'weapon4': '0.492', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.598', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '44.000'} [2024-08-06 01:16:35,024][52658] DAMAGECOUNT value on done: 180466.0 [2024-08-06 01:16:35,025][52658] Sum rewards: 48.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.295', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.490', 'weapon4': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '42.500'} [2024-08-06 01:16:35,222][52794] DAMAGECOUNT value on done: 193313.0 [2024-08-06 01:16:35,222][52794] Sum rewards: 50.145, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.788', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.214', 'AMMO4': '0.264', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.500', 'weapon2': '0.564', 'WEAPON3': '1.650', 'weapon3': '2.532', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:35,476][52669] DAMAGECOUNT value on done: 188206.0 [2024-08-06 01:16:35,476][52669] Sum rewards: 55.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.466', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.134', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'weapon2': '0.482', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:35,776][52820] DAMAGECOUNT value on done: 167975.0 [2024-08-06 01:16:35,778][52820] Sum rewards: 55.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO5': '0.003', 'weapon7': '0.006', 'weapon5': '0.024', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.714', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:36,089][52650] Updated weights for policy 0, policy_version 29111 (0.0052) [2024-08-06 01:16:36,502][52803] DAMAGECOUNT value on done: 171068.0 [2024-08-06 01:16:36,503][52803] Sum rewards: 52.144, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon2': '0.266', 'AMMO3': '0.269', 'weapon4': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '2.770', 'weapon3': '2.988', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '48.000'} [2024-08-06 01:16:37,149][52666] DAMAGECOUNT value on done: 184192.0 [2024-08-06 01:16:37,151][52666] Sum rewards: 53.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.747', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.154', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.278', 'WEAPON4': '0.550', 'weapon4': '0.618', 'WEAPON3': '1.600', 'weapon3': '2.644', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:37,779][52670] DAMAGECOUNT value on done: 183352.0 [2024-08-06 01:16:37,781][52670] Sum rewards: 73.062, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.464', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'weapon2': '0.228', 'AMMO3': '0.253', 'weapon4': '0.458', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '63.000'} [2024-08-06 01:16:37,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17550.3). Total num frames: 238501888. Throughput: 0: 4388.4. Samples: 59629610. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:16:37,795][52567] Avg episode reward: [(0, '59.346')] [2024-08-06 01:16:37,989][52658] DAMAGECOUNT value on done: 190414.0 [2024-08-06 01:16:37,989][52658] Sum rewards: 59.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.114', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.254', 'weapon4': '0.274', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.228', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:38,334][52669] DAMAGECOUNT value on done: 187775.0 [2024-08-06 01:16:38,335][52669] Sum rewards: 60.424, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.330', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon2': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.289', 'weapon4': '0.294', 'WEAPON3': '1.650', 'weapon3': '3.154', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '53.000'} [2024-08-06 01:16:38,464][52794] DAMAGECOUNT value on done: 188152.0 [2024-08-06 01:16:38,464][52794] Sum rewards: 58.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.189', 'AMMO4': '0.247', 'weapon5': '0.286', 'WEAPON5': '0.400', 'weapon2': '0.424', 'weapon4': '0.484', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.518', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:38,965][52820] DAMAGECOUNT value on done: 170513.0 [2024-08-06 01:16:38,975][52820] Sum rewards: 69.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '58.000'} [2024-08-06 01:16:39,505][52803] DAMAGECOUNT value on done: 172669.0 [2024-08-06 01:16:39,507][52803] Sum rewards: 65.918, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.198', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.260', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 01:16:40,034][52811] DAMAGECOUNT value on done: 180964.0 [2024-08-06 01:16:40,034][52811] Sum rewards: 52.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon5': '0.076', 'AMMO4': '0.176', 'AMMO3': '0.189', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '46.000'} [2024-08-06 01:16:40,251][52666] DAMAGECOUNT value on done: 180821.0 [2024-08-06 01:16:40,251][52666] Sum rewards: 65.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.604', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.201', 'weapon5': '0.246', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.450', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.618', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '55.500'} [2024-08-06 01:16:40,614][52658] DAMAGECOUNT value on done: 189757.0 [2024-08-06 01:16:40,614][52658] Sum rewards: 55.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.139', 'AMMO3': '0.203', 'weapon4': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.120', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '46.000'} [2024-08-06 01:16:40,738][52670] DAMAGECOUNT value on done: 185805.0 [2024-08-06 01:16:40,740][52670] Sum rewards: 61.675, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.670', 'weapon4': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon2': '0.982', 'WEAPON3': '1.000', 'weapon3': '2.892', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:40,875][52650] Updated weights for policy 0, policy_version 29121 (0.0020) [2024-08-06 01:16:41,387][52669] DAMAGECOUNT value on done: 190860.0 [2024-08-06 01:16:41,390][52669] Sum rewards: 65.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.169', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.039', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.201', 'weapon2': '0.282', 'weapon4': '0.536', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:42,036][52820] DAMAGECOUNT value on done: 168047.0 [2024-08-06 01:16:42,040][52820] Sum rewards: 60.528, reward structure: {'DEATHCOUNT': '-13.500', 'ARMOR': '0.005', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.171', 'weapon5': '0.240', 'AMMO4': '0.262', 'WEAPON5': '0.400', 'weapon2': '0.402', 'HEALTH': '0.420', 'weapon4': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.680', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '48.500'} [2024-08-06 01:16:42,536][52803] DAMAGECOUNT value on done: 176209.0 [2024-08-06 01:16:42,538][52803] Sum rewards: 59.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.055', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.156', 'weapon4': '0.162', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '53.000'} [2024-08-06 01:16:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 238592000. Throughput: 0: 4390.4. Samples: 59655850. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:16:42,795][52567] Avg episode reward: [(0, '59.700')] [2024-08-06 01:16:43,041][52658] DAMAGECOUNT value on done: 191547.0 [2024-08-06 01:16:43,044][52658] Sum rewards: 61.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.826', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.209', 'weapon2': '0.388', 'WEAPON4': '0.450', 'weapon4': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '54.000'} [2024-08-06 01:16:43,111][52811] DAMAGECOUNT value on done: 168528.0 [2024-08-06 01:16:43,113][52811] Sum rewards: 64.923, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.438', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.264', 'weapon2': '0.842', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:43,225][52666] DAMAGECOUNT value on done: 177240.0 [2024-08-06 01:16:43,228][52666] Sum rewards: 55.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.293', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'weapon4': '0.144', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'weapon2': '1.010', 'weapon3': '2.710', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '45.000'} [2024-08-06 01:16:43,940][52670] DAMAGECOUNT value on done: 182292.0 [2024-08-06 01:16:43,940][52670] Sum rewards: 48.830, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.692', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon5': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'AMMO4': '0.290', 'weapon4': '0.354', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '2.566', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '45.000'} [2024-08-06 01:16:45,191][52820] DAMAGECOUNT value on done: 162413.0 [2024-08-06 01:16:45,193][52820] Sum rewards: 58.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.204', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.067', 'weapon5': '0.158', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'AMMO4': '0.335', 'weapon4': '0.524', 'WEAPON4': '0.550', 'weapon2': '0.608', 'WEAPON3': '0.900', 'weapon3': '2.408', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:45,445][52650] Updated weights for policy 0, policy_version 29131 (0.0012) [2024-08-06 01:16:45,542][52803] DAMAGECOUNT value on done: 172622.0 [2024-08-06 01:16:45,542][52803] Sum rewards: 64.219, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.330', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.054', 'weapon4': '0.100', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.306', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:45,780][52658] DAMAGECOUNT value on done: 180664.0 [2024-08-06 01:16:45,780][52658] Sum rewards: 59.456, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.292', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.046', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'AMMO4': '0.229', 'weapon2': '0.346', 'WEAPON4': '0.500', 'weapon4': '0.856', 'WEAPON3': '1.300', 'weapon3': '2.354', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '55.000'} [2024-08-06 01:16:46,217][52811] DAMAGECOUNT value on done: 173902.0 [2024-08-06 01:16:46,218][52811] Sum rewards: 59.879, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.809', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.140', 'AMMO3': '0.190', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.318', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:46,450][52666] DAMAGECOUNT value on done: 183023.0 [2024-08-06 01:16:46,451][52666] Sum rewards: 68.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:47,114][52670] DAMAGECOUNT value on done: 182321.0 [2024-08-06 01:16:47,116][52670] Sum rewards: 74.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.696', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.201', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.460', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '61.000'} [2024-08-06 01:16:47,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 238682112. Throughput: 0: 4386.4. Samples: 59669150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:16:47,794][52567] Avg episode reward: [(0, '59.652')] [2024-08-06 01:16:48,393][52820] DAMAGECOUNT value on done: 170935.0 [2024-08-06 01:16:48,394][52820] Sum rewards: 68.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.842', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.231', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '59.000'} [2024-08-06 01:16:48,539][52803] DAMAGECOUNT value on done: 173600.0 [2024-08-06 01:16:48,539][52803] Sum rewards: 39.105, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.169', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.586', 'WEAPON3': '1.150', 'HITCOUNT': '2.180', 'weapon3': '2.952', 'DAMAGECOUNT': '10.293', 'FRAGCOUNT': '34.500'} [2024-08-06 01:16:48,734][52658] DAMAGECOUNT value on done: 184805.0 [2024-08-06 01:16:48,734][52658] Sum rewards: 49.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.666', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '44.000'} [2024-08-06 01:16:49,373][52666] DAMAGECOUNT value on done: 183818.0 [2024-08-06 01:16:49,375][52666] Sum rewards: 72.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.261', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '62.000'} [2024-08-06 01:16:49,388][52811] DAMAGECOUNT value on done: 172093.0 [2024-08-06 01:16:49,390][52811] Sum rewards: 58.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.415', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon4': '0.132', 'weapon5': '0.162', 'AMMO4': '0.164', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.214', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:49,805][52671] DAMAGECOUNT value on done: 190348.0 [2024-08-06 01:16:49,807][52671] Sum rewards: 54.944, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.111', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.510', 'WEAPON3': '0.750', 'weapon3': '2.866', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.300', 'FRAGCOUNT': '43.000'} [2024-08-06 01:16:49,970][52670] DAMAGECOUNT value on done: 184307.0 [2024-08-06 01:16:49,972][52670] Sum rewards: 66.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.128', 'weapon2': '0.184', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'HITCOUNT': '3.380', 'weapon3': '3.542', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '57.000'} [2024-08-06 01:16:49,993][52649] DAMAGECOUNT value on done: 179588.0 [2024-08-06 01:16:49,994][52649] Sum rewards: 54.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.797', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.206', 'weapon2': '0.384', 'WEAPON4': '0.500', 'weapon4': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.432', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:50,111][52650] Updated weights for policy 0, policy_version 29141 (0.0021) [2024-08-06 01:16:51,078][52647] DAMAGECOUNT value on done: 196907.0 [2024-08-06 01:16:51,078][52647] Sum rewards: 57.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.367', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.057', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.222', 'AMMO4': '0.285', 'WEAPON4': '0.350', 'weapon2': '0.780', 'WEAPON3': '1.200', 'weapon3': '2.676', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:51,420][52820] DAMAGECOUNT value on done: 168043.0 [2024-08-06 01:16:51,422][52820] Sum rewards: 61.880, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.302', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.836', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:51,536][52803] DAMAGECOUNT value on done: 169072.0 [2024-08-06 01:16:51,538][52803] Sum rewards: 60.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:51,716][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:16:51,749][52658] DAMAGECOUNT value on done: 185004.0 [2024-08-06 01:16:51,750][52658] Sum rewards: 53.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.348', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.140', 'weapon2': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.418', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '48.000'} [2024-08-06 01:16:52,305][52666] DAMAGECOUNT value on done: 183192.0 [2024-08-06 01:16:52,307][52666] Sum rewards: 54.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.046', 'AMMO2': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'AMMO4': '0.281', 'weapon4': '0.340', 'weapon2': '0.494', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '48.000'} [2024-08-06 01:16:52,496][52671] DAMAGECOUNT value on done: 184785.0 [2024-08-06 01:16:52,497][52671] Sum rewards: 53.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '45.000'} [2024-08-06 01:16:52,555][52811] DAMAGECOUNT value on done: 172940.0 [2024-08-06 01:16:52,557][52811] Sum rewards: 60.331, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.884', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.382', 'WEAPON3': '1.700', 'weapon3': '3.208', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '55.000'} [2024-08-06 01:16:52,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 238764032. Throughput: 0: 4377.3. Samples: 59695430. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:16:52,794][52567] Avg episode reward: [(0, '59.130')] [2024-08-06 01:16:52,983][52670] DAMAGECOUNT value on done: 186430.0 [2024-08-06 01:16:52,985][52670] Sum rewards: 64.041, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.029', 'AMMO5': '0.005', 'weapon5': '0.026', 'ARMOR': '0.028', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.191', 'AMMO3': '0.229', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.166', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '57.000'} [2024-08-06 01:16:53,231][52649] DAMAGECOUNT value on done: 176072.0 [2024-08-06 01:16:53,232][52649] Sum rewards: 58.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.941', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon5': '0.114', 'weapon4': '0.178', 'AMMO3': '0.228', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.158', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:53,661][52647] DAMAGECOUNT value on done: 194438.0 [2024-08-06 01:16:53,663][52647] Sum rewards: 71.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.808', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO4': '0.172', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.730', 'WEAPON3': '1.350', 'weapon3': '2.680', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '59.000'} [2024-08-06 01:16:53,698][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:16:54,548][52820] DAMAGECOUNT value on done: 171907.0 [2024-08-06 01:16:54,549][52820] Sum rewards: 59.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.507', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.108', 'weapon5': '0.196', 'AMMO4': '0.209', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '2.980', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:54,722][52803] DAMAGECOUNT value on done: 172990.0 [2024-08-06 01:16:54,725][52803] Sum rewards: 75.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.050', 'AMMO3': '0.153', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.164', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '62.000'} [2024-08-06 01:16:54,867][52650] Updated weights for policy 0, policy_version 29151 (0.0017) [2024-08-06 01:16:54,894][52658] DAMAGECOUNT value on done: 183399.0 [2024-08-06 01:16:54,896][52658] Sum rewards: 59.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.110', 'AMMO3': '0.227', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:55,032][52671] DAMAGECOUNT value on done: 188882.0 [2024-08-06 01:16:55,034][52671] Sum rewards: 51.809, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon5': '0.184', 'weapon4': '0.258', 'AMMO3': '0.261', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '2.980', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '46.000'} [2024-08-06 01:16:55,601][52666] DAMAGECOUNT value on done: 184764.0 [2024-08-06 01:16:55,603][52666] Sum rewards: 67.053, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.775', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.202', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '56.000'} [2024-08-06 01:16:55,691][52811] DAMAGECOUNT value on done: 176366.0 [2024-08-06 01:16:55,693][52811] Sum rewards: 55.019, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.402', 'WEAPON3': '1.550', 'HITCOUNT': '2.770', 'weapon3': '3.190', 'DAMAGECOUNT': '12.735', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:56,208][52670] DAMAGECOUNT value on done: 178846.0 [2024-08-06 01:16:56,208][52670] Sum rewards: 63.592, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.870', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.200', 'weapon4': '0.234', 'AMMO3': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '3.072', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '57.000'} [2024-08-06 01:16:56,375][52649] DAMAGECOUNT value on done: 179926.0 [2024-08-06 01:16:56,376][52649] Sum rewards: 62.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.494', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.346', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '54.000'} [2024-08-06 01:16:56,467][52647] DAMAGECOUNT value on done: 196030.0 [2024-08-06 01:16:56,469][52647] Sum rewards: 56.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.595', 'AMMO5': '0.009', 'AMMO2': '0.037', 'AMMO3': '0.135', 'weapon5': '0.136', 'AMMO4': '0.184', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.550', 'weapon4': '0.904', 'WEAPON3': '0.950', 'weapon3': '2.352', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '45.000'} [2024-08-06 01:16:57,736][52671] DAMAGECOUNT value on done: 183528.0 [2024-08-06 01:16:57,737][52671] Sum rewards: 55.381, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.106', 'AMMO4': '0.184', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.600', 'weapon3': '2.652', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '52.000'} [2024-08-06 01:16:57,778][52820] DAMAGECOUNT value on done: 173268.0 [2024-08-06 01:16:57,780][52820] Sum rewards: 68.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.054', 'weapon4': '0.070', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '58.000'} [2024-08-06 01:16:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 238854144. Throughput: 0: 4382.7. Samples: 59721690. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:16:57,794][52567] Avg episode reward: [(0, '59.124')] [2024-08-06 01:16:57,984][52803] DAMAGECOUNT value on done: 168178.0 [2024-08-06 01:16:57,987][52803] Sum rewards: 55.277, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.724', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.101', 'AMMO4': '0.217', 'weapon5': '0.266', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '1.110', 'weapon3': '2.060', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.717', 'FRAGCOUNT': '43.000'} [2024-08-06 01:16:58,058][52658] DAMAGECOUNT value on done: 187099.0 [2024-08-06 01:16:58,059][52658] Sum rewards: 56.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon2': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon4': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.200', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:58,715][52666] DAMAGECOUNT value on done: 180859.0 [2024-08-06 01:16:58,715][52666] Sum rewards: 51.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '2.990', 'DAMAGECOUNT': '13.866', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:58,802][52811] DAMAGECOUNT value on done: 173698.0 [2024-08-06 01:16:58,803][52811] Sum rewards: 57.639, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.221', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon5': '0.142', 'AMMO3': '0.165', 'AMMO4': '0.298', 'weapon4': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.684', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '49.000'} [2024-08-06 01:16:58,984][52647] DAMAGECOUNT value on done: 195426.0 [2024-08-06 01:16:58,985][52647] Sum rewards: 54.044, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.306', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.286', 'weapon2': '0.352', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.754', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '50.000'} [2024-08-06 01:16:59,176][52670] DAMAGECOUNT value on done: 183690.0 [2024-08-06 01:16:59,176][52670] Sum rewards: 60.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.072', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.066', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.450', 'weapon2': '0.590', 'weapon4': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '51.000'} [2024-08-06 01:16:59,288][52649] DAMAGECOUNT value on done: 180526.0 [2024-08-06 01:16:59,288][52649] Sum rewards: 57.048, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.141', 'AMMO4': '0.143', 'weapon5': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '2.892', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '47.000'} [2024-08-06 01:16:59,442][52650] Updated weights for policy 0, policy_version 29161 (0.0013) [2024-08-06 01:17:00,846][52820] DAMAGECOUNT value on done: 169523.0 [2024-08-06 01:17:00,848][52820] Sum rewards: 67.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.004', 'ARMOR': '0.008', 'weapon5': '0.030', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:00,888][52671] DAMAGECOUNT value on done: 185617.0 [2024-08-06 01:17:00,888][52671] Sum rewards: 63.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.177', 'AMMO4': '0.217', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '1.008', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:00,997][52658] DAMAGECOUNT value on done: 188016.0 [2024-08-06 01:17:00,999][52658] Sum rewards: 61.286, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'weapon5': '0.052', 'AMMO2': '0.054', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.269', 'weapon2': '0.370', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:01,154][52666] DAMAGECOUNT value on done: 177500.0 [2024-08-06 01:17:01,155][52666] Sum rewards: 67.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:01,187][52803] DAMAGECOUNT value on done: 178619.0 [2024-08-06 01:17:01,188][52803] Sum rewards: 57.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.989', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.120', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '46.500'} [2024-08-06 01:17:01,612][52647] DAMAGECOUNT value on done: 196127.0 [2024-08-06 01:17:01,612][52647] Sum rewards: 60.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.170', 'weapon2': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.424', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.040', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:01,638][52670] DAMAGECOUNT value on done: 179503.0 [2024-08-06 01:17:01,660][52670] Sum rewards: 68.196, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.834', 'ARMOR': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.182', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '60.000'} [2024-08-06 01:17:01,910][52811] DAMAGECOUNT value on done: 172763.0 [2024-08-06 01:17:01,910][52811] Sum rewards: 63.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.205', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:02,257][52649] DAMAGECOUNT value on done: 173980.0 [2024-08-06 01:17:02,257][52649] Sum rewards: 64.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO4': '0.172', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '56.500'} [2024-08-06 01:17:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 238944256. Throughput: 0: 4381.5. Samples: 59734830. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:17:02,794][52567] Avg episode reward: [(0, '59.665')] [2024-08-06 01:17:03,611][52671] DAMAGECOUNT value on done: 186312.0 [2024-08-06 01:17:03,611][52671] Sum rewards: 63.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.306', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.310', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:03,819][52667] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0), ('HEALTH', -0.009000000000000001, -3.0), ('weapon5', 0.002)] [2024-08-06 01:17:03,894][52663] DAMAGECOUNT value on done: 186380.0 [2024-08-06 01:17:03,895][52663] Sum rewards: 66.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.872', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'weapon2': '0.442', 'weapon4': '0.736', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:03,921][52658] DAMAGECOUNT value on done: 182999.0 [2024-08-06 01:17:03,924][52658] Sum rewards: 63.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.825', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.110', 'AMMO3': '0.173', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON4': '0.600', 'weapon4': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.454', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:03,972][52820] DAMAGECOUNT value on done: 173130.0 [2024-08-06 01:17:03,976][52820] Sum rewards: 51.260, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.904', 'AMMO5': '0.003', 'ARMOR': '0.016', 'weapon5': '0.050', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'AMMO4': '0.279', 'weapon4': '0.284', 'weapon2': '0.482', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:04,190][52666] DAMAGECOUNT value on done: 186132.0 [2024-08-06 01:17:04,191][52666] Sum rewards: 53.917, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.450', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '47.000'} [2024-08-06 01:17:04,191][52803] DAMAGECOUNT value on done: 177076.0 [2024-08-06 01:17:04,193][52803] Sum rewards: 54.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.510', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.154', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:04,238][52650] Updated weights for policy 0, policy_version 29171 (0.0016) [2024-08-06 01:17:04,318][52647] DAMAGECOUNT value on done: 198353.0 [2024-08-06 01:17:04,318][52647] Sum rewards: 69.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.092', 'weapon5': '0.096', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.398', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '60.000'} [2024-08-06 01:17:04,736][52670] DAMAGECOUNT value on done: 174567.0 [2024-08-06 01:17:04,738][52670] Sum rewards: 54.398, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.910', 'AMMO2': '0.063', 'AMMO3': '0.184', 'AMMO4': '0.313', 'weapon4': '0.490', 'WEAPON4': '0.500', 'weapon2': '0.608', 'WEAPON3': '1.050', 'weapon3': '2.564', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:05,083][52811] DAMAGECOUNT value on done: 179307.0 [2024-08-06 01:17:05,086][52811] Sum rewards: 69.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.095', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.092', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'weapon2': '0.298', 'WEAPON4': '0.450', 'weapon4': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.844', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:05,429][52649] DAMAGECOUNT value on done: 180224.0 [2024-08-06 01:17:05,430][52649] Sum rewards: 55.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.572', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.193', 'weapon5': '0.202', 'AMMO4': '0.212', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.480', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:06,498][52671] DAMAGECOUNT value on done: 186191.0 [2024-08-06 01:17:06,499][52671] Sum rewards: 75.382, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.283', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.008', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.216', 'weapon4': '0.406', 'weapon2': '0.424', 'WEAPON3': '0.900', 'weapon3': '3.034', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '60.000'} [2024-08-06 01:17:06,748][52647] DAMAGECOUNT value on done: 194258.0 [2024-08-06 01:17:06,749][52647] Sum rewards: 62.777, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.618', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.083', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.261', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.278', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:06,941][52658] DAMAGECOUNT value on done: 182750.0 [2024-08-06 01:17:06,943][52658] Sum rewards: 47.087, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.220', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.172', 'weapon2': '0.258', 'AMMO3': '0.329', 'WEAPON3': '2.000', 'HITCOUNT': '2.940', 'weapon3': '3.184', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '47.000'} [2024-08-06 01:17:06,987][52663] DAMAGECOUNT value on done: 184730.0 [2024-08-06 01:17:06,988][52663] Sum rewards: 62.611, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.702', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.052', 'weapon5': '0.082', 'AMMO3': '0.228', 'weapon4': '0.242', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:07,055][52820] DAMAGECOUNT value on done: 172209.0 [2024-08-06 01:17:07,057][52820] Sum rewards: 42.605, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.600', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.138', 'AMMO3': '0.235', 'weapon2': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '2.948', 'DAMAGECOUNT': '11.463', 'FRAGCOUNT': '41.500'} [2024-08-06 01:17:07,150][52666] DAMAGECOUNT value on done: 186798.0 [2024-08-06 01:17:07,151][52666] Sum rewards: 72.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.682', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.133', 'WEAPON4': '0.300', 'weapon2': '0.562', 'weapon4': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.626', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '59.000'} [2024-08-06 01:17:07,414][52803] DAMAGECOUNT value on done: 173484.0 [2024-08-06 01:17:07,417][52803] Sum rewards: 67.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '3.370', 'weapon3': '3.380', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 239034368. Throughput: 0: 4384.9. Samples: 59761300. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:17:07,794][52567] Avg episode reward: [(0, '59.807')] [2024-08-06 01:17:07,865][52670] DAMAGECOUNT value on done: 185870.0 [2024-08-06 01:17:07,866][52670] Sum rewards: 43.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.039', 'AMMO3': '0.133', 'weapon5': '0.152', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '0.800', 'HITCOUNT': '2.610', 'weapon3': '2.912', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '36.000'} [2024-08-06 01:17:08,089][52811] DAMAGECOUNT value on done: 174881.0 [2024-08-06 01:17:08,089][52811] Sum rewards: 68.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.256', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:08,436][52649] DAMAGECOUNT value on done: 178223.0 [2024-08-06 01:17:08,437][52649] Sum rewards: 59.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.011', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.247', 'weapon2': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.082', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:08,848][52650] Updated weights for policy 0, policy_version 29181 (0.0012) [2024-08-06 01:17:09,045][52671] DAMAGECOUNT value on done: 188052.0 [2024-08-06 01:17:09,045][52671] Sum rewards: 68.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.115', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'AMMO4': '0.183', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.840', 'WEAPON3': '1.200', 'weapon3': '2.224', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '59.000'} [2024-08-06 01:17:09,444][52647] DAMAGECOUNT value on done: 194054.0 [2024-08-06 01:17:09,445][52647] Sum rewards: 45.404, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.323', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.056', 'weapon4': '0.104', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'HITCOUNT': '2.610', 'weapon3': '3.432', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '43.000'} [2024-08-06 01:17:10,045][52663] DAMAGECOUNT value on done: 183011.0 [2024-08-06 01:17:10,047][52663] Sum rewards: 61.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.156', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.468', 'weapon4': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.470', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:10,134][52820] DAMAGECOUNT value on done: 174868.0 [2024-08-06 01:17:10,137][52820] Sum rewards: 70.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.222', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '61.000'} [2024-08-06 01:17:10,139][52658] DAMAGECOUNT value on done: 188324.0 [2024-08-06 01:17:10,142][52658] Sum rewards: 59.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'ARMOR': '0.004', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.488', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:10,209][52666] DAMAGECOUNT value on done: 180245.0 [2024-08-06 01:17:10,212][52666] Sum rewards: 63.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'weapon4': '0.210', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:10,654][52803] DAMAGECOUNT value on done: 176046.0 [2024-08-06 01:17:10,655][52803] Sum rewards: 51.741, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.706', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.137', 'AMMO4': '0.221', 'WEAPON4': '0.350', 'weapon4': '0.570', 'WEAPON3': '0.900', 'weapon2': '0.974', 'weapon3': '2.232', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '42.000'} [2024-08-06 01:17:11,031][52670] DAMAGECOUNT value on done: 184632.0 [2024-08-06 01:17:11,033][52670] Sum rewards: 56.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.185', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon5': '0.176', 'AMMO3': '0.207', 'AMMO4': '0.309', 'weapon2': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.662', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.430', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:11,094][52811] DAMAGECOUNT value on done: 171620.0 [2024-08-06 01:17:11,094][52811] Sum rewards: 44.915, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.236', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.162', 'AMMO3': '0.220', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON4': '0.750', 'weapon4': '0.764', 'WEAPON3': '1.350', 'weapon3': '2.282', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '12.738', 'FRAGCOUNT': '42.500'} [2024-08-06 01:17:11,493][52649] DAMAGECOUNT value on done: 185159.0 [2024-08-06 01:17:11,495][52649] Sum rewards: 59.900, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.442', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.170', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:11,777][52671] DAMAGECOUNT value on done: 184463.0 [2024-08-06 01:17:11,786][52671] Sum rewards: 53.512, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.332', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon4': '0.180', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.952', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:11,929][52647] DAMAGECOUNT value on done: 197009.0 [2024-08-06 01:17:11,929][52647] Sum rewards: 61.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 239116288. Throughput: 0: 4384.0. Samples: 59787560. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:17:12,794][52567] Avg episode reward: [(0, '60.254')] [2024-08-06 01:17:12,931][52663] DAMAGECOUNT value on done: 186720.0 [2024-08-06 01:17:12,931][52663] Sum rewards: 67.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO4': '0.113', 'AMMO3': '0.199', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.430', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:13,278][52820] DAMAGECOUNT value on done: 170905.0 [2024-08-06 01:17:13,278][52820] Sum rewards: 66.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.732', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.196', 'weapon2': '0.426', 'weapon4': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:13,348][52666] DAMAGECOUNT value on done: 182678.0 [2024-08-06 01:17:13,349][52666] Sum rewards: 68.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.035', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.116', 'AMMO3': '0.226', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 01:17:13,588][52650] Updated weights for policy 0, policy_version 29191 (0.0012) [2024-08-06 01:17:13,933][52803] DAMAGECOUNT value on done: 173052.0 [2024-08-06 01:17:13,935][52803] Sum rewards: 55.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.374', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'weapon2': '0.286', 'WEAPON4': '0.650', 'weapon4': '0.766', 'WEAPON3': '1.100', 'weapon3': '2.472', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:14,157][52811] DAMAGECOUNT value on done: 174622.0 [2024-08-06 01:17:14,160][52811] Sum rewards: 61.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.082', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.362', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.102', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:14,262][52670] DAMAGECOUNT value on done: 186155.0 [2024-08-06 01:17:14,264][52670] Sum rewards: 64.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.156', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:14,335][52649] DAMAGECOUNT value on done: 178607.0 [2024-08-06 01:17:14,335][52649] Sum rewards: 57.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.217', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:14,591][52647] DAMAGECOUNT value on done: 192376.0 [2024-08-06 01:17:14,593][52647] Sum rewards: 46.808, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.179', 'AMMO5': '0.016', 'ARMOR': '0.020', 'AMMO2': '0.065', 'weapon5': '0.192', 'AMMO3': '0.210', 'weapon4': '0.318', 'AMMO4': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '2.632', 'DAMAGECOUNT': '12.192', 'FRAGCOUNT': '44.000'} [2024-08-06 01:17:14,955][52671] DAMAGECOUNT value on done: 188881.0 [2024-08-06 01:17:14,955][52671] Sum rewards: 55.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.225', 'weapon2': '0.320', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.014', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:16,116][52663] DAMAGECOUNT value on done: 182899.0 [2024-08-06 01:17:16,117][52663] Sum rewards: 60.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.765', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.215', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.230', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:16,141][52666] DAMAGECOUNT value on done: 182724.0 [2024-08-06 01:17:16,141][52666] Sum rewards: 65.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.133', 'weapon4': '0.166', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.478', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:16,480][52820] DAMAGECOUNT value on done: 172964.0 [2024-08-06 01:17:16,480][52820] Sum rewards: 57.585, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.298', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'AMMO3': '0.289', 'WEAPON4': '0.350', 'weapon2': '0.392', 'weapon4': '0.628', 'WEAPON3': '1.600', 'weapon3': '2.556', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:16,978][52670] DAMAGECOUNT value on done: 183596.0 [2024-08-06 01:17:16,986][52670] Sum rewards: 69.189, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.458', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.227', 'weapon4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '62.000'} [2024-08-06 01:17:16,981][52803] DAMAGECOUNT value on done: 170983.0 [2024-08-06 01:17:16,986][52803] Sum rewards: 72.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.375', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon2': '0.894', 'WEAPON3': '1.000', 'weapon3': '2.942', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '58.000'} [2024-08-06 01:17:17,181][52649] DAMAGECOUNT value on done: 181345.0 [2024-08-06 01:17:17,181][52649] Sum rewards: 62.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.215', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon4': '0.226', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.196', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:17,375][52811] DAMAGECOUNT value on done: 173466.0 [2024-08-06 01:17:17,375][52811] Sum rewards: 63.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.146', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:17,488][52647] DAMAGECOUNT value on done: 194787.0 [2024-08-06 01:17:17,488][52647] Sum rewards: 65.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.462', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17613.4, 300 sec: 17550.3). Total num frames: 239206400. Throughput: 0: 4396.2. Samples: 59800960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:17:17,794][52567] Avg episode reward: [(0, '60.452')] [2024-08-06 01:17:18,080][52671] DAMAGECOUNT value on done: 188221.0 [2024-08-06 01:17:18,081][52671] Sum rewards: 67.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.335', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.097', 'AMMO3': '0.218', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:18,100][52650] Updated weights for policy 0, policy_version 29201 (0.0010) [2024-08-06 01:17:18,816][52664] DAMAGECOUNT value on done: 192231.0 [2024-08-06 01:17:18,817][52664] Sum rewards: 64.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.525', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'AMMO4': '0.213', 'weapon4': '0.264', 'weapon2': '0.354', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:18,925][52663] DAMAGECOUNT value on done: 190857.0 [2024-08-06 01:17:18,926][52663] Sum rewards: 46.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.064', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '3.156', 'DAMAGECOUNT': '12.126', 'FRAGCOUNT': '40.000'} [2024-08-06 01:17:19,107][52666] DAMAGECOUNT value on done: 186502.0 [2024-08-06 01:17:19,107][52666] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.030', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:19,692][52820] DAMAGECOUNT value on done: 174723.0 [2024-08-06 01:17:19,693][52820] Sum rewards: 52.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.144', 'weapon5': '0.166', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.096', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '43.000'} [2024-08-06 01:17:19,789][52670] DAMAGECOUNT value on done: 187278.0 [2024-08-06 01:17:19,792][52670] Sum rewards: 52.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.752', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.960', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:19,969][52647] DAMAGECOUNT value on done: 191715.0 [2024-08-06 01:17:19,969][52647] Sum rewards: 63.340, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.915', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.068', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.540', 'WEAPON3': '1.600', 'weapon3': '3.092', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:20,013][52803] DAMAGECOUNT value on done: 178526.0 [2024-08-06 01:17:20,013][52803] Sum rewards: 64.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.024', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.064', 'weapon4': '0.070', 'WEAPON4': '0.150', 'weapon2': '0.216', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.424', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:20,178][52649] DAMAGECOUNT value on done: 183954.0 [2024-08-06 01:17:20,181][52649] Sum rewards: 73.777, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.751', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon4': '0.172', 'AMMO3': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '61.000'} [2024-08-06 01:17:20,433][52663] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:17:20,491][52811] DAMAGECOUNT value on done: 176180.0 [2024-08-06 01:17:20,491][52811] Sum rewards: 66.751, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.169', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '56.500'} [2024-08-06 01:17:20,753][52659] DAMAGECOUNT value on done: 185600.0 [2024-08-06 01:17:20,753][52659] Sum rewards: 64.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.235', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.350', 'weapon3': '2.782', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:21,050][52671] DAMAGECOUNT value on done: 185705.0 [2024-08-06 01:17:21,054][52671] Sum rewards: 66.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.543', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:21,416][52664] DAMAGECOUNT value on done: 192228.0 [2024-08-06 01:17:21,416][52664] Sum rewards: 59.574, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.138', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.094', 'weapon5': '0.110', 'AMMO4': '0.127', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.080', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:22,110][52666] DAMAGECOUNT value on done: 182017.0 [2024-08-06 01:17:22,119][52666] Sum rewards: 67.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.718', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.026', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.544', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '58.000'} [2024-08-06 01:17:22,259][52663] DAMAGECOUNT value on done: 184849.0 [2024-08-06 01:17:22,260][52663] Sum rewards: 60.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.952', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.233', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:22,521][52647] DAMAGECOUNT value on done: 194630.0 [2024-08-06 01:17:22,523][52647] Sum rewards: 58.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.157', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.168', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.206', 'weapon4': '0.470', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.062', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:22,720][52650] Updated weights for policy 0, policy_version 29211 (0.0021) [2024-08-06 01:17:22,768][52820] DAMAGECOUNT value on done: 172755.0 [2024-08-06 01:17:22,770][52820] Sum rewards: 67.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.078', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.238', 'weapon4': '0.380', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.824', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 239296512. Throughput: 0: 4386.9. Samples: 59827020. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:17:22,794][52567] Avg episode reward: [(0, '60.686')] [2024-08-06 01:17:22,973][52670] DAMAGECOUNT value on done: 175630.0 [2024-08-06 01:17:22,973][52670] Sum rewards: 61.457, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.152', 'weapon4': '0.166', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '2.974', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:22,998][52649] DAMAGECOUNT value on done: 177954.0 [2024-08-06 01:17:23,000][52649] Sum rewards: 70.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.234', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '60.000'} [2024-08-06 01:17:23,128][52803] DAMAGECOUNT value on done: 172505.0 [2024-08-06 01:17:23,129][52803] Sum rewards: 60.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.759', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.332', 'weapon4': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:23,689][52659] DAMAGECOUNT value on done: 185717.0 [2024-08-06 01:17:23,691][52659] Sum rewards: 55.151, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.248', 'AMMO5': '0.006', 'ARMOR': '0.016', 'AMMO2': '0.059', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.244', 'AMMO3': '0.268', 'AMMO4': '0.296', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.500', 'weapon3': '2.840', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:23,822][52811] DAMAGECOUNT value on done: 174157.0 [2024-08-06 01:17:23,822][52811] Sum rewards: 78.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.380', 'WEAPON3': '1.000', 'weapon3': '3.292', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 01:17:24,040][52671] DAMAGECOUNT value on done: 194852.0 [2024-08-06 01:17:24,041][52671] Sum rewards: 70.018, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.581', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon4': '0.142', 'weapon2': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '64.000'} [2024-08-06 01:17:24,351][52664] DAMAGECOUNT value on done: 193329.0 [2024-08-06 01:17:24,351][52664] Sum rewards: 46.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.177', 'weapon5': '0.224', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.670', 'DAMAGECOUNT': '11.673', 'FRAGCOUNT': '39.000'} [2024-08-06 01:17:25,143][52666] DAMAGECOUNT value on done: 182714.0 [2024-08-06 01:17:25,144][52666] Sum rewards: 61.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.892', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.272', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:25,274][52663] DAMAGECOUNT value on done: 186049.0 [2024-08-06 01:17:25,274][52663] Sum rewards: 48.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.095', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.112', 'weapon4': '0.180', 'AMMO3': '0.202', 'AMMO4': '0.261', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '43.000'} [2024-08-06 01:17:25,489][52647] DAMAGECOUNT value on done: 194778.0 [2024-08-06 01:17:25,489][52647] Sum rewards: 57.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.840', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.202', 'AMMO4': '0.226', 'AMMO3': '0.245', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.468', 'WEAPON3': '1.500', 'weapon3': '2.714', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:25,728][52649] DAMAGECOUNT value on done: 183398.0 [2024-08-06 01:17:25,729][52649] Sum rewards: 57.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.952', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.147', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:25,817][52820] DAMAGECOUNT value on done: 171434.0 [2024-08-06 01:17:25,817][52820] Sum rewards: 57.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.935', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.444', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.276', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:25,963][52670] DAMAGECOUNT value on done: 186634.0 [2024-08-06 01:17:25,965][52670] Sum rewards: 50.263, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.830', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.203', 'weapon5': '0.238', 'weapon4': '0.292', 'WEAPON5': '0.300', 'AMMO3': '0.307', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.744', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:26,001][52820] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:17:26,400][52803] DAMAGECOUNT value on done: 177584.0 [2024-08-06 01:17:26,401][52803] Sum rewards: 71.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.335', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.408', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '59.000'} [2024-08-06 01:17:26,631][52659] DAMAGECOUNT value on done: 186393.0 [2024-08-06 01:17:26,631][52659] Sum rewards: 56.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.995', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'weapon4': '0.144', 'AMMO3': '0.232', 'weapon2': '0.520', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.176', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:26,753][52671] DAMAGECOUNT value on done: 186725.0 [2024-08-06 01:17:26,753][52671] Sum rewards: 56.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.158', 'weapon4': '0.214', 'AMMO3': '0.241', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.186', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:26,934][52659] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:17:26,991][52811] DAMAGECOUNT value on done: 173780.0 [2024-08-06 01:17:26,991][52811] Sum rewards: 49.377, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.048', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.108', 'weapon4': '0.130', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.802', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.690', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:27,167][52664] DAMAGECOUNT value on done: 192001.0 [2024-08-06 01:17:27,167][52664] Sum rewards: 62.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.026', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.138', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.550', 'weapon3': '3.374', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:27,727][52650] Updated weights for policy 0, policy_version 29221 (0.0020) [2024-08-06 01:17:27,799][52567] Fps is (10 sec: 17195.2, 60 sec: 17474.9, 300 sec: 17550.0). Total num frames: 239378432. Throughput: 0: 4392.7. Samples: 59853540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:17:27,799][52567] Avg episode reward: [(0, '60.569')] [2024-08-06 01:17:28,169][52647] DAMAGECOUNT value on done: 195525.0 [2024-08-06 01:17:28,170][52647] Sum rewards: 64.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.845', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.592', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:28,220][52663] DAMAGECOUNT value on done: 183927.0 [2024-08-06 01:17:28,221][52663] Sum rewards: 68.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.120', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '58.000'} [2024-08-06 01:17:28,512][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:17:28,612][52649] DAMAGECOUNT value on done: 181758.0 [2024-08-06 01:17:28,613][52649] Sum rewards: 58.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.670', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.242', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:28,672][52665] DAMAGECOUNT value on done: 182327.0 [2024-08-06 01:17:28,674][52665] Sum rewards: 52.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.004', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.232', 'weapon4': '0.336', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.086', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '46.000'} [2024-08-06 01:17:28,686][52670] DAMAGECOUNT value on done: 188877.0 [2024-08-06 01:17:28,687][52670] Sum rewards: 64.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.100', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'AMMO4': '0.239', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:29,003][52820] DAMAGECOUNT value on done: 176030.0 [2024-08-06 01:17:29,006][52820] Sum rewards: 56.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.282', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.228', 'weapon4': '0.380', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '49.500'} [2024-08-06 01:17:29,163][52659] DAMAGECOUNT value on done: 186510.0 [2024-08-06 01:17:29,163][52659] Sum rewards: 52.429, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-5.177', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.056', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.279', 'weapon2': '0.526', 'WEAPON4': '0.950', 'weapon4': '1.028', 'WEAPON3': '1.400', 'weapon3': '2.076', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:29,313][52671] DAMAGECOUNT value on done: 180611.0 [2024-08-06 01:17:29,316][52671] Sum rewards: 56.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.098', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon4': '0.288', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:29,520][52803] DAMAGECOUNT value on done: 168183.0 [2024-08-06 01:17:29,523][52803] Sum rewards: 62.781, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.189', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.342', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:29,908][52664] DAMAGECOUNT value on done: 190978.0 [2024-08-06 01:17:29,909][52664] Sum rewards: 57.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.966', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.226', 'weapon4': '0.360', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:30,085][52811] DAMAGECOUNT value on done: 172839.0 [2024-08-06 01:17:30,086][52811] Sum rewards: 69.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.448', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.158', 'weapon4': '0.242', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.020', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '58.000'} [2024-08-06 01:17:30,713][52647] DAMAGECOUNT value on done: 194317.0 [2024-08-06 01:17:30,715][52647] Sum rewards: 66.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.559', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.035', 'weapon5': '0.150', 'AMMO4': '0.174', 'weapon4': '0.178', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:30,963][52663] DAMAGECOUNT value on done: 187603.0 [2024-08-06 01:17:30,963][52663] Sum rewards: 45.732, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.118', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.128', 'AMMO3': '0.200', 'AMMO4': '0.313', 'WEAPON5': '0.400', 'weapon2': '0.606', 'WEAPON4': '0.750', 'weapon4': '0.814', 'WEAPON3': '1.200', 'weapon3': '2.104', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '44.000'} [2024-08-06 01:17:31,576][52649] DAMAGECOUNT value on done: 176042.0 [2024-08-06 01:17:31,576][52649] Sum rewards: 66.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.144', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.528', 'weapon2': '0.676', 'WEAPON3': '1.250', 'weapon3': '2.572', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '58.000'} [2024-08-06 01:17:31,613][52665] DAMAGECOUNT value on done: 187818.0 [2024-08-06 01:17:31,615][52665] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.568', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.056', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.646', 'WEAPON3': '1.600', 'weapon3': '2.642', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:31,852][52670] DAMAGECOUNT value on done: 183503.0 [2024-08-06 01:17:31,853][52670] Sum rewards: 52.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'AMMO5': '0.012', 'AMMO2': '0.072', 'AMMO3': '0.162', 'weapon5': '0.162', 'WEAPON5': '0.300', 'AMMO4': '0.360', 'weapon2': '0.362', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'weapon4': '0.966', 'weapon3': '2.150', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:31,949][52650] Updated weights for policy 0, policy_version 29231 (0.0012) [2024-08-06 01:17:32,182][52820] DAMAGECOUNT value on done: 178632.0 [2024-08-06 01:17:32,192][52820] Sum rewards: 63.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.496', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.150', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'AMMO4': '0.256', 'weapon2': '0.364', 'weapon4': '0.498', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.716', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:32,211][52659] DAMAGECOUNT value on done: 185398.0 [2024-08-06 01:17:32,211][52659] Sum rewards: 59.690, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.351', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.136', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '2.972', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '47.000'} [2024-08-06 01:17:32,378][52671] DAMAGECOUNT value on done: 190581.0 [2024-08-06 01:17:32,379][52671] Sum rewards: 63.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.008', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.116', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:32,714][52664] DAMAGECOUNT value on done: 196373.0 [2024-08-06 01:17:32,714][52664] Sum rewards: 50.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.080', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon5': '0.066', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.290', 'weapon2': '0.426', 'WEAPON3': '1.550', 'HITCOUNT': '2.920', 'weapon3': '3.024', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '44.000'} [2024-08-06 01:17:32,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 239468544. Throughput: 0: 4389.3. Samples: 59866670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:17:32,795][52567] Avg episode reward: [(0, '60.342')] [2024-08-06 01:17:33,247][52811] DAMAGECOUNT value on done: 176257.0 [2024-08-06 01:17:33,248][52811] Sum rewards: 46.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'ARMOR': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.230', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '3.018', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '42.000'} [2024-08-06 01:17:33,632][52663] DAMAGECOUNT value on done: 186877.0 [2024-08-06 01:17:33,633][52663] Sum rewards: 55.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.614', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '44.000'} [2024-08-06 01:17:33,774][52647] DAMAGECOUNT value on done: 191453.0 [2024-08-06 01:17:33,774][52647] Sum rewards: 67.475, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.504', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon2': '0.214', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'weapon3': '3.570', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '60.000'} [2024-08-06 01:17:34,480][52649] DAMAGECOUNT value on done: 181586.0 [2024-08-06 01:17:34,481][52649] Sum rewards: 53.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.328', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.102', 'weapon4': '0.154', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.690', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '46.000'} [2024-08-06 01:17:34,521][52665] DAMAGECOUNT value on done: 183261.0 [2024-08-06 01:17:34,521][52665] Sum rewards: 56.025, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.301', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.149', 'weapon5': '0.166', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.852', 'weapon3': '2.532', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '43.000'} [2024-08-06 01:17:34,890][52659] DAMAGECOUNT value on done: 184009.0 [2024-08-06 01:17:34,891][52659] Sum rewards: 58.787, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.354', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.120', 'AMMO3': '0.162', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '0.950', 'HITCOUNT': '2.930', 'weapon3': '3.148', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:35,028][52671] DAMAGECOUNT value on done: 190068.0 [2024-08-06 01:17:35,028][52671] Sum rewards: 65.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.911', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.188', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:35,092][52670] DAMAGECOUNT value on done: 183806.0 [2024-08-06 01:17:35,093][52670] Sum rewards: 52.914, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.277', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.199', 'AMMO4': '0.277', 'weapon5': '0.326', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.834', 'WEAPON3': '1.200', 'weapon3': '2.090', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '47.000'} [2024-08-06 01:17:35,289][52820] DAMAGECOUNT value on done: 170036.0 [2024-08-06 01:17:35,289][52820] Sum rewards: 58.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.899', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.193', 'weapon5': '0.226', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.408', 'weapon4': '0.458', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:35,567][52664] DAMAGECOUNT value on done: 197543.0 [2024-08-06 01:17:35,568][52664] Sum rewards: 61.620, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.375', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.164', 'weapon2': '0.190', 'AMMO3': '0.287', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.096', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:36,120][52663] DAMAGECOUNT value on done: 185123.0 [2024-08-06 01:17:36,121][52663] Sum rewards: 65.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.705', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.144', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:36,278][52811] Large shaping reward 3.396 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.34500000000000003, 115.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:17:36,284][52647] DAMAGECOUNT value on done: 193890.0 [2024-08-06 01:17:36,285][52647] Sum rewards: 48.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.066', 'AMMO3': '0.171', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.450', 'weapon2': '0.628', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.938', 'DAMAGECOUNT': '12.264', 'FRAGCOUNT': '42.000'} [2024-08-06 01:17:36,300][52811] DAMAGECOUNT value on done: 172060.0 [2024-08-06 01:17:36,300][52811] Sum rewards: 55.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.164', 'weapon2': '0.194', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '3.444', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:36,797][52650] Updated weights for policy 0, policy_version 29241 (0.0017) [2024-08-06 01:17:37,574][52665] DAMAGECOUNT value on done: 178914.0 [2024-08-06 01:17:37,574][52665] Sum rewards: 59.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.623', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'weapon2': '0.498', 'weapon4': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.776', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '47.000'} [2024-08-06 01:17:37,590][52649] DAMAGECOUNT value on done: 179960.0 [2024-08-06 01:17:37,590][52649] Sum rewards: 63.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.450', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.164', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:37,726][52659] DAMAGECOUNT value on done: 185128.0 [2024-08-06 01:17:37,726][52659] Sum rewards: 59.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.013', 'ARMOR': '0.032', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.606', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.172', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:37,794][52567] Fps is (10 sec: 17211.1, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 239550464. Throughput: 0: 4392.4. Samples: 59893090. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:17:37,795][52567] Avg episode reward: [(0, '60.052')] [2024-08-06 01:17:37,841][52671] DAMAGECOUNT value on done: 189542.0 [2024-08-06 01:17:37,845][52671] Sum rewards: 50.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.896', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.214', 'weapon4': '0.358', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:38,309][52664] DAMAGECOUNT value on done: 187215.0 [2024-08-06 01:17:38,310][52664] Sum rewards: 63.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.256', 'weapon2': '0.402', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.668', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:38,758][52663] DAMAGECOUNT value on done: 179616.0 [2024-08-06 01:17:38,759][52663] Sum rewards: 62.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.582', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon4': '0.248', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:38,950][52647] DAMAGECOUNT value on done: 188211.0 [2024-08-06 01:17:38,951][52647] Sum rewards: 64.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.937', 'AMMO5': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.041', 'weapon5': '0.108', 'weapon4': '0.166', 'AMMO4': '0.203', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.186', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:39,357][52811] DAMAGECOUNT value on done: 176763.0 [2024-08-06 01:17:39,357][52811] Sum rewards: 52.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.265', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.160', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.650', 'HITCOUNT': '2.740', 'weapon3': '3.082', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:40,187][52659] DAMAGECOUNT value on done: 181759.0 [2024-08-06 01:17:40,187][52659] Sum rewards: 65.266, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.757', 'ARMOR': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.146', 'weapon2': '0.574', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.260', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:40,231][52671] DAMAGECOUNT value on done: 189400.0 [2024-08-06 01:17:40,231][52671] Sum rewards: 62.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'weapon2': '0.212', 'AMMO3': '0.220', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.278', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:40,620][52664] DAMAGECOUNT value on done: 201194.0 [2024-08-06 01:17:40,621][52664] Sum rewards: 43.656, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.028', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'AMMO3': '0.267', 'weapon4': '0.320', 'WEAPON4': '0.600', 'weapon2': '0.774', 'WEAPON3': '1.600', 'weapon3': '2.522', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.891', 'FRAGCOUNT': '41.000'} [2024-08-06 01:17:40,810][52665] DAMAGECOUNT value on done: 180118.0 [2024-08-06 01:17:40,810][52665] Sum rewards: 52.286, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.248', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.052', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'AMMO4': '0.262', 'weapon2': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.500', 'HITCOUNT': '2.720', 'weapon3': '2.902', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '49.000'} [2024-08-06 01:17:40,909][52649] DAMAGECOUNT value on done: 187901.0 [2024-08-06 01:17:40,911][52649] Sum rewards: 52.131, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.976', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO4': '0.188', 'AMMO3': '0.281', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.218', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '47.500'} [2024-08-06 01:17:41,061][52650] Updated weights for policy 0, policy_version 29251 (0.0028) [2024-08-06 01:17:41,436][52647] DAMAGECOUNT value on done: 196009.0 [2024-08-06 01:17:41,438][52647] Sum rewards: 53.462, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.864', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.046', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.232', 'weapon2': '0.278', 'weapon4': '0.280', 'AMMO3': '0.322', 'WEAPON4': '0.450', 'WEAPON3': '1.900', 'weapon3': '3.060', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:41,560][52663] DAMAGECOUNT value on done: 176783.0 [2024-08-06 01:17:41,560][52663] Sum rewards: 51.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.189', 'weapon4': '0.192', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '44.000'} [2024-08-06 01:17:42,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 239648768. Throughput: 0: 4398.2. Samples: 59919610. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:17:42,802][52567] Avg episode reward: [(0, '59.841')] [2024-08-06 01:17:42,993][52659] DAMAGECOUNT value on done: 188659.0 [2024-08-06 01:17:42,993][52659] Sum rewards: 54.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.227', 'weapon2': '0.252', 'weapon4': '0.556', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:43,039][52671] DAMAGECOUNT value on done: 186145.0 [2024-08-06 01:17:43,040][52671] Sum rewards: 64.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon4': '0.090', 'weapon5': '0.132', 'AMMO3': '0.189', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.126', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:43,071][52664] DAMAGECOUNT value on done: 197025.0 [2024-08-06 01:17:43,072][52664] Sum rewards: 76.316, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.369', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.938', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '62.000'} [2024-08-06 01:17:43,894][52665] DAMAGECOUNT value on done: 182647.0 [2024-08-06 01:17:43,894][52665] Sum rewards: 52.406, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.100', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO4': '0.169', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:44,103][52649] DAMAGECOUNT value on done: 185171.0 [2024-08-06 01:17:44,104][52649] Sum rewards: 63.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.602', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.160', 'weapon5': '0.204', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.832', 'WEAPON3': '1.300', 'weapon3': '2.612', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '52.000'} [2024-08-06 01:17:44,313][52663] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:17:44,486][52663] DAMAGECOUNT value on done: 186680.0 [2024-08-06 01:17:44,488][52663] Sum rewards: 63.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.144', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.191', 'AMMO3': '0.226', 'weapon4': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:45,660][52664] DAMAGECOUNT value on done: 195107.0 [2024-08-06 01:17:45,661][52664] Sum rewards: 55.255, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.272', 'AMMO3': '0.293', 'weapon2': '0.430', 'WEAPON3': '1.700', 'HITCOUNT': '2.820', 'weapon3': '2.900', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '51.000'} [2024-08-06 01:17:45,912][52659] DAMAGECOUNT value on done: 190900.0 [2024-08-06 01:17:45,915][52659] Sum rewards: 72.896, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.081', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '61.000'} [2024-08-06 01:17:46,077][52650] Updated weights for policy 0, policy_version 29261 (0.0023) [2024-08-06 01:17:46,662][52665] DAMAGECOUNT value on done: 184673.0 [2024-08-06 01:17:46,662][52665] Sum rewards: 49.442, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.122', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.198', 'AMMO3': '0.260', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.360', 'weapon4': '0.406', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.656', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:46,828][52649] DAMAGECOUNT value on done: 189341.0 [2024-08-06 01:17:46,830][52649] Sum rewards: 51.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.850', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.059', 'weapon5': '0.144', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'AMMO4': '0.296', 'WEAPON4': '0.500', 'weapon4': '0.568', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.346', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '44.000'} [2024-08-06 01:17:47,554][52663] DAMAGECOUNT value on done: 187204.0 [2024-08-06 01:17:47,555][52663] Sum rewards: 50.748, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.410', 'weapon4': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.846', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '46.000'} [2024-08-06 01:17:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 239730688. Throughput: 0: 4402.0. Samples: 59932920. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:17:47,802][52567] Avg episode reward: [(0, '59.696')] [2024-08-06 01:17:48,772][52664] DAMAGECOUNT value on done: 191920.0 [2024-08-06 01:17:48,772][52664] Sum rewards: 59.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.833', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.205', 'weapon4': '0.208', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '3.164', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '50.000'} [2024-08-06 01:17:48,804][52659] DAMAGECOUNT value on done: 184813.0 [2024-08-06 01:17:48,804][52659] Sum rewards: 62.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.732', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.210', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:49,124][52662] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:17:49,630][52665] DAMAGECOUNT value on done: 185343.0 [2024-08-06 01:17:49,630][52665] Sum rewards: 65.955, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'HEALTH': '0.232', 'weapon2': '0.402', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.236', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:49,877][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:17:50,416][52663] DAMAGECOUNT value on done: 188567.0 [2024-08-06 01:17:50,418][52663] Sum rewards: 71.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon5': '0.034', 'AMMO4': '0.053', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '61.000'} [2024-08-06 01:17:50,752][52650] Updated weights for policy 0, policy_version 29271 (0.0023) [2024-08-06 01:17:51,437][52664] DAMAGECOUNT value on done: 189224.0 [2024-08-06 01:17:51,437][52664] Sum rewards: 60.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.098', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '54.000'} [2024-08-06 01:17:51,564][52659] DAMAGECOUNT value on done: 182403.0 [2024-08-06 01:17:51,567][52659] Sum rewards: 57.716, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.043', 'weapon5': '0.170', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon2': '0.314', 'weapon4': '0.494', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '49.500'} [2024-08-06 01:17:52,536][52665] DAMAGECOUNT value on done: 188430.0 [2024-08-06 01:17:52,536][52665] Sum rewards: 52.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.184', 'WEAPON4': '0.450', 'weapon4': '0.612', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.360', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '45.000'} [2024-08-06 01:17:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 239820800. Throughput: 0: 4398.2. Samples: 59959220. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:17:52,794][52567] Avg episode reward: [(0, '59.423')] [2024-08-06 01:17:53,409][52663] DAMAGECOUNT value on done: 189954.0 [2024-08-06 01:17:53,410][52663] Sum rewards: 60.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.872', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.196', 'AMMO3': '0.215', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.318', 'weapon4': '0.462', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:54,181][52664] DAMAGECOUNT value on done: 193442.0 [2024-08-06 01:17:54,183][52664] Sum rewards: 76.012, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.740', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.200', 'AMMO3': '0.277', 'weapon2': '0.394', 'WEAPON3': '1.650', 'weapon3': '3.128', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '66.000'} [2024-08-06 01:17:54,303][52659] DAMAGECOUNT value on done: 179351.0 [2024-08-06 01:17:54,304][52659] Sum rewards: 68.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.745', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '57.000'} [2024-08-06 01:17:55,218][52650] Updated weights for policy 0, policy_version 29281 (0.0011) [2024-08-06 01:17:55,464][52665] DAMAGECOUNT value on done: 185195.0 [2024-08-06 01:17:55,464][52665] Sum rewards: 73.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon4': '0.286', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '2.778', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '62.000'} [2024-08-06 01:17:56,467][52663] DAMAGECOUNT value on done: 188514.0 [2024-08-06 01:17:56,468][52663] Sum rewards: 66.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.995', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '56.000'} [2024-08-06 01:17:56,868][52664] DAMAGECOUNT value on done: 195112.0 [2024-08-06 01:17:56,870][52664] Sum rewards: 68.623, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.702', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.132', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 01:17:57,440][52659] DAMAGECOUNT value on done: 185476.0 [2024-08-06 01:17:57,441][52659] Sum rewards: 59.812, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.528', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'weapon4': '0.498', 'weapon2': '0.542', 'WEAPON3': '1.600', 'weapon3': '2.642', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '53.000'} [2024-08-06 01:17:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 239910912. Throughput: 0: 4402.9. Samples: 59985690. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:17:57,794][52567] Avg episode reward: [(0, '60.079')] [2024-08-06 01:17:58,390][52665] DAMAGECOUNT value on done: 189530.0 [2024-08-06 01:17:58,393][52665] Sum rewards: 72.131, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.404', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.068', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '60.000'} [2024-08-06 01:17:59,537][52664] DAMAGECOUNT value on done: 191162.0 [2024-08-06 01:17:59,539][52664] Sum rewards: 65.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.050', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '55.000'} [2024-08-06 01:17:59,687][52663] DAMAGECOUNT value on done: 183002.0 [2024-08-06 01:17:59,690][52663] Sum rewards: 56.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.120', 'AMMO4': '0.203', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.916', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '48.000'} [2024-08-06 01:17:59,994][52650] Updated weights for policy 0, policy_version 29291 (0.0017) [2024-08-06 01:18:00,465][52659] DAMAGECOUNT value on done: 187174.0 [2024-08-06 01:18:00,467][52659] Sum rewards: 57.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.457', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.048', 'weapon5': '0.164', 'AMMO3': '0.196', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.476', 'weapon4': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.510', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '49.000'} [2024-08-06 01:18:00,973][52665] DAMAGECOUNT value on done: 188421.0 [2024-08-06 01:18:00,973][52665] Sum rewards: 59.895, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.512', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.380', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.392', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:02,066][52664] DAMAGECOUNT value on done: 194237.0 [2024-08-06 01:18:02,066][52664] Sum rewards: 62.604, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.520', 'AMMO5': '0.004', 'AMMO2': '0.034', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.238', 'weapon4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '3.002', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 239992832. Throughput: 0: 4398.4. Samples: 59998890. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:18:02,802][52567] Avg episode reward: [(0, '59.835')] [2024-08-06 01:18:03,552][52659] DAMAGECOUNT value on done: 189893.0 [2024-08-06 01:18:03,552][52659] Sum rewards: 59.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.354', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon4': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.100', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '51.000'} [2024-08-06 01:18:04,160][52665] DAMAGECOUNT value on done: 185114.0 [2024-08-06 01:18:04,162][52665] Sum rewards: 51.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.452', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.237', 'weapon5': '0.244', 'weapon2': '0.286', 'WEAPON5': '0.400', 'weapon4': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.630', 'weapon3': '2.658', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '46.000'} [2024-08-06 01:18:04,497][52650] Updated weights for policy 0, policy_version 29301 (0.0027) [2024-08-06 01:18:04,724][52664] DAMAGECOUNT value on done: 196491.0 [2024-08-06 01:18:04,726][52664] Sum rewards: 70.027, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.815', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.396', 'WEAPON3': '1.650', 'weapon3': '3.130', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '61.000'} [2024-08-06 01:18:06,445][52659] DAMAGECOUNT value on done: 189225.0 [2024-08-06 01:18:06,445][52659] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.220', 'weapon4': '0.412', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.070', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '53.000'} [2024-08-06 01:18:07,373][52665] DAMAGECOUNT value on done: 184179.0 [2024-08-06 01:18:07,375][52665] Sum rewards: 64.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.855', 'AMMO5': '0.004', 'AMMO2': '0.031', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.202', 'weapon4': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '54.500'} [2024-08-06 01:18:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 240082944. Throughput: 0: 4408.7. Samples: 60025410. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:18:07,802][52567] Avg episode reward: [(0, '59.742')] [2024-08-06 01:18:07,857][52664] DAMAGECOUNT value on done: 190310.0 [2024-08-06 01:18:07,858][52664] Sum rewards: 61.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.426', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.072', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '52.000'} [2024-08-06 01:18:09,042][52659] DAMAGECOUNT value on done: 185338.0 [2024-08-06 01:18:09,043][52659] Sum rewards: 52.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.390', 'weapon4': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '44.000'} [2024-08-06 01:18:09,183][52650] Updated weights for policy 0, policy_version 29311 (0.0012) [2024-08-06 01:18:10,374][52665] DAMAGECOUNT value on done: 185853.0 [2024-08-06 01:18:10,375][52665] Sum rewards: 68.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.141', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.056', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.195', 'weapon2': '0.250', 'WEAPON3': '1.000', 'weapon3': '3.442', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '54.000'} [2024-08-06 01:18:10,954][52664] DAMAGECOUNT value on done: 193336.0 [2024-08-06 01:18:10,954][52664] Sum rewards: 56.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.391', 'AMMO5': '0.003', 'AMMO2': '0.015', 'ARMOR': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon5': '0.078', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '46.500'} [2024-08-06 01:18:11,304][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:18:11,668][52659] DAMAGECOUNT value on done: 191166.0 [2024-08-06 01:18:11,669][52659] Sum rewards: 54.635, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '47.000'} [2024-08-06 01:18:12,168][52614] Signal inference workers to stop experience collection... (5350 times) [2024-08-06 01:18:12,169][52614] Signal inference workers to resume experience collection... (5350 times) [2024-08-06 01:18:12,210][52650] InferenceWorker_p0-w0: stopping experience collection (5350 times) [2024-08-06 01:18:12,210][52650] InferenceWorker_p0-w0: resuming experience collection (5350 times) [2024-08-06 01:18:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 240173056. Throughput: 0: 4404.7. Samples: 60051730. Policy #0 lag: (min: 2.0, avg: 4.1, max: 8.0) [2024-08-06 01:18:12,794][52567] Avg episode reward: [(0, '59.565')] [2024-08-06 01:18:13,392][52665] DAMAGECOUNT value on done: 183009.0 [2024-08-06 01:18:13,393][52665] Sum rewards: 68.689, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.682', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.134', 'weapon5': '0.144', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.590', 'WEAPON3': '0.800', 'weapon3': '2.752', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:14,046][52650] Updated weights for policy 0, policy_version 29321 (0.0012) [2024-08-06 01:18:14,106][52659] DAMAGECOUNT value on done: 191565.0 [2024-08-06 01:18:14,106][52659] Sum rewards: 66.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.426', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'weapon4': '0.164', 'weapon2': '0.204', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:14,347][52795] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:18:16,414][52665] DAMAGECOUNT value on done: 184154.0 [2024-08-06 01:18:16,415][52665] Sum rewards: 63.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.062', 'weapon5': '0.102', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.308', 'weapon4': '0.468', 'weapon2': '0.624', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.568', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:17,448][52668] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:18:17,529][52668] DAMAGECOUNT value on done: 185758.0 [2024-08-06 01:18:17,530][52668] Sum rewards: 70.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '59.000'} [2024-08-06 01:18:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 240263168. Throughput: 0: 4407.2. Samples: 60064990. Policy #0 lag: (min: 2.0, avg: 4.1, max: 8.0) [2024-08-06 01:18:17,802][52567] Avg episode reward: [(0, '60.006')] [2024-08-06 01:18:18,497][52650] Updated weights for policy 0, policy_version 29331 (0.0012) [2024-08-06 01:18:19,150][52665] DAMAGECOUNT value on done: 180332.0 [2024-08-06 01:18:19,152][52665] Sum rewards: 60.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.112', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.108', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.280', 'weapon4': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '51.000'} [2024-08-06 01:18:20,153][52668] DAMAGECOUNT value on done: 192015.0 [2024-08-06 01:18:20,153][52668] Sum rewards: 58.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.025', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.134', 'AMMO3': '0.206', 'weapon4': '0.206', 'AMMO4': '0.238', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '3.152', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '51.000'} [2024-08-06 01:18:20,782][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:18:22,117][52665] DAMAGECOUNT value on done: 186147.0 [2024-08-06 01:18:22,117][52665] Sum rewards: 60.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.053', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.260', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '51.000'} [2024-08-06 01:18:22,712][52668] DAMAGECOUNT value on done: 189341.0 [2024-08-06 01:18:22,713][52668] Sum rewards: 53.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.054', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.190', 'AMMO4': '0.221', 'WEAPON4': '0.500', 'weapon4': '0.546', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.468', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '45.500'} [2024-08-06 01:18:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 240353280. Throughput: 0: 4412.0. Samples: 60091630. Policy #0 lag: (min: 2.0, avg: 4.1, max: 8.0) [2024-08-06 01:18:22,802][52567] Avg episode reward: [(0, '59.974')] [2024-08-06 01:18:22,954][52650] Updated weights for policy 0, policy_version 29341 (0.0028) [2024-08-06 01:18:24,911][52665] DAMAGECOUNT value on done: 182360.0 [2024-08-06 01:18:24,911][52665] Sum rewards: 68.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.110', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.546', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '58.000'} [2024-08-06 01:18:25,507][52668] DAMAGECOUNT value on done: 190678.0 [2024-08-06 01:18:25,518][52668] Sum rewards: 68.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.158', 'AMMO3': '0.163', 'weapon4': '0.168', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.120', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '56.000'} [2024-08-06 01:18:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17614.2, 300 sec: 17522.5). Total num frames: 240435200. Throughput: 0: 4404.9. Samples: 60117830. Policy #0 lag: (min: 2.0, avg: 4.1, max: 8.0) [2024-08-06 01:18:27,794][52567] Avg episode reward: [(0, '60.296')] [2024-08-06 01:18:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029350_240435200.pth... [2024-08-06 01:18:27,950][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000028836_236224512.pth [2024-08-06 01:18:28,052][52650] Updated weights for policy 0, policy_version 29351 (0.0020) [2024-08-06 01:18:28,118][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:18:28,358][52668] DAMAGECOUNT value on done: 184313.0 [2024-08-06 01:18:28,359][52668] Sum rewards: 59.610, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.589', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO4': '0.189', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'weapon2': '0.332', 'weapon4': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.870', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:29,813][52662] DAMAGECOUNT value on done: 191761.0 [2024-08-06 01:18:29,821][52662] Sum rewards: 61.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.448', 'weapon4': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '53.000'} [2024-08-06 01:18:30,636][52794] Large shaping reward 2.607 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:18:31,202][52668] DAMAGECOUNT value on done: 186851.0 [2024-08-06 01:18:31,202][52668] Sum rewards: 71.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.002', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.182', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 01:18:31,538][52660] DAMAGECOUNT value on done: 186543.0 [2024-08-06 01:18:31,539][52660] Sum rewards: 62.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.738', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.202', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '51.000'} [2024-08-06 01:18:32,282][52662] DAMAGECOUNT value on done: 195670.0 [2024-08-06 01:18:32,283][52662] Sum rewards: 62.566, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.180', 'AMMO3': '0.253', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.500', 'weapon3': '2.808', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:32,666][52650] Updated weights for policy 0, policy_version 29361 (0.0012) [2024-08-06 01:18:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 240525312. Throughput: 0: 4394.0. Samples: 60130650. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 01:18:32,794][52567] Avg episode reward: [(0, '60.417')] [2024-08-06 01:18:34,357][52668] DAMAGECOUNT value on done: 187893.0 [2024-08-06 01:18:34,357][52668] Sum rewards: 55.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.192', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.094', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '49.000'} [2024-08-06 01:18:34,662][52660] DAMAGECOUNT value on done: 184133.0 [2024-08-06 01:18:34,662][52660] Sum rewards: 52.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.168', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.370', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '45.000'} [2024-08-06 01:18:35,024][52662] DAMAGECOUNT value on done: 193472.0 [2024-08-06 01:18:35,025][52662] Sum rewards: 50.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.165', 'AMMO5': '0.005', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.063', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.264', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '42.000'} [2024-08-06 01:18:37,260][52668] DAMAGECOUNT value on done: 190615.0 [2024-08-06 01:18:37,261][52668] Sum rewards: 48.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.710', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.255', 'weapon2': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '2.730', 'weapon3': '3.358', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '45.000'} [2024-08-06 01:18:37,314][52650] Updated weights for policy 0, policy_version 29371 (0.0024) [2024-08-06 01:18:37,641][52660] DAMAGECOUNT value on done: 188256.0 [2024-08-06 01:18:37,645][52660] Sum rewards: 74.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.066', 'weapon5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 01:18:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 240615424. Throughput: 0: 4390.9. Samples: 60156810. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 01:18:37,795][52567] Avg episode reward: [(0, '60.300')] [2024-08-06 01:18:38,348][52662] DAMAGECOUNT value on done: 183966.0 [2024-08-06 01:18:38,361][52662] Sum rewards: 63.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.280', 'weapon2': '0.298', 'WEAPON3': '1.700', 'weapon3': '3.178', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '57.000'} [2024-08-06 01:18:39,701][52668] DAMAGECOUNT value on done: 188073.0 [2024-08-06 01:18:39,702][52668] Sum rewards: 53.067, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.687', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.110', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'weapon5': '0.214', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.548', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '48.000'} [2024-08-06 01:18:40,112][52660] DAMAGECOUNT value on done: 189859.0 [2024-08-06 01:18:40,114][52660] Sum rewards: 63.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.068', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.213', 'weapon2': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.454', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '54.000'} [2024-08-06 01:18:41,334][52662] DAMAGECOUNT value on done: 192593.0 [2024-08-06 01:18:41,336][52662] Sum rewards: 65.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.676', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.112', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '58.000'} [2024-08-06 01:18:41,523][52667] DAMAGECOUNT value on done: 187716.0 [2024-08-06 01:18:41,528][52667] Sum rewards: 51.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.100', 'weapon4': '0.114', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'HITCOUNT': '2.730', 'weapon3': '3.392', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '47.000'} [2024-08-06 01:18:42,432][52650] Updated weights for policy 0, policy_version 29381 (0.0020) [2024-08-06 01:18:42,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 240689152. Throughput: 0: 4379.8. Samples: 60182780. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 01:18:42,795][52567] Avg episode reward: [(0, '60.220')] [2024-08-06 01:18:42,908][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:18:43,009][52668] DAMAGECOUNT value on done: 189996.0 [2024-08-06 01:18:43,013][52668] Sum rewards: 64.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.816', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:43,366][52660] DAMAGECOUNT value on done: 187613.0 [2024-08-06 01:18:43,368][52660] Sum rewards: 63.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.256', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.152', 'AMMO3': '0.182', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.694', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '53.000'} [2024-08-06 01:18:44,410][52667] DAMAGECOUNT value on done: 188855.0 [2024-08-06 01:18:44,412][52667] Sum rewards: 61.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO4': '0.186', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '53.000'} [2024-08-06 01:18:44,608][52662] DAMAGECOUNT value on done: 189657.0 [2024-08-06 01:18:44,608][52662] Sum rewards: 59.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.139', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.732', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '50.000'} [2024-08-06 01:18:45,664][52668] DAMAGECOUNT value on done: 189258.0 [2024-08-06 01:18:45,664][52668] Sum rewards: 74.255, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.008', 'AMMO2': '0.016', 'HEALTH': '0.020', 'AMMO4': '0.078', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.242', 'weapon4': '0.374', 'WEAPON3': '0.950', 'weapon3': '3.258', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '59.000'} [2024-08-06 01:18:45,898][52660] DAMAGECOUNT value on done: 185927.0 [2024-08-06 01:18:45,898][52660] Sum rewards: 56.878, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.154', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.220', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.000'} [2024-08-06 01:18:45,899][52649] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon5', 0.002)] [2024-08-06 01:18:46,574][52650] Updated weights for policy 0, policy_version 29391 (0.0011) [2024-08-06 01:18:47,070][52667] DAMAGECOUNT value on done: 190019.0 [2024-08-06 01:18:47,070][52667] Sum rewards: 60.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.614', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.075', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.594', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.036', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '51.000'} [2024-08-06 01:18:47,534][52662] DAMAGECOUNT value on done: 192608.0 [2024-08-06 01:18:47,543][52662] Sum rewards: 65.747, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.401', 'ARMOR': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '59.000'} [2024-08-06 01:18:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 240787456. Throughput: 0: 4379.5. Samples: 60195970. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 01:18:47,794][52567] Avg episode reward: [(0, '60.803')] [2024-08-06 01:18:48,436][52668] DAMAGECOUNT value on done: 184798.0 [2024-08-06 01:18:48,438][52668] Sum rewards: 66.420, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.236', 'AMMO2': '0.024', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '55.000'} [2024-08-06 01:18:48,800][52660] DAMAGECOUNT value on done: 189034.0 [2024-08-06 01:18:48,801][52660] Sum rewards: 45.649, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.408', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.172', 'AMMO4': '0.210', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.720', 'weapon3': '2.778', 'DAMAGECOUNT': '12.213', 'FRAGCOUNT': '43.000'} [2024-08-06 01:18:49,681][52667] DAMAGECOUNT value on done: 185709.0 [2024-08-06 01:18:49,682][52667] Sum rewards: 55.418, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.434', 'AMMO5': '0.003', 'weapon5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'AMMO4': '0.153', 'weapon2': '0.218', 'WEAPON4': '0.400', 'WEAPON3': '0.700', 'weapon4': '1.440', 'weapon3': '2.122', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '44.000'} [2024-08-06 01:18:50,402][52662] DAMAGECOUNT value on done: 197086.0 [2024-08-06 01:18:50,402][52662] Sum rewards: 62.713, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.363', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon4': '0.182', 'AMMO3': '0.206', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2024-08-06 01:18:51,335][52668] DAMAGECOUNT value on done: 178925.0 [2024-08-06 01:18:51,337][52668] Sum rewards: 52.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.295', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.212', 'AMMO4': '0.227', 'weapon5': '0.256', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.600', 'weapon4': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.286', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '47.000'} [2024-08-06 01:18:51,673][52660] DAMAGECOUNT value on done: 190882.0 [2024-08-06 01:18:51,674][52660] Sum rewards: 70.006, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.404', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.120', 'AMMO4': '0.180', 'AMMO3': '0.237', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '61.000'} [2024-08-06 01:18:51,697][52650] Updated weights for policy 0, policy_version 29401 (0.0023) [2024-08-06 01:18:51,714][52794] DAMAGECOUNT value on done: 192451.0 [2024-08-06 01:18:51,716][52794] Sum rewards: 54.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.174', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.065', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.323', 'WEAPON4': '0.450', 'weapon4': '0.566', 'weapon2': '0.794', 'WEAPON3': '0.900', 'weapon3': '2.218', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '44.000'} [2024-08-06 01:18:52,033][52795] DAMAGECOUNT value on done: 173659.0 [2024-08-06 01:18:52,034][52795] Sum rewards: 65.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.130', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '54.000'} [2024-08-06 01:18:52,415][52667] DAMAGECOUNT value on done: 190329.0 [2024-08-06 01:18:52,415][52667] Sum rewards: 61.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.165', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '52.000'} [2024-08-06 01:18:52,795][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 240869376. Throughput: 0: 4372.0. Samples: 60222150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:18:52,795][52567] Avg episode reward: [(0, '60.741')] [2024-08-06 01:18:53,155][52662] DAMAGECOUNT value on done: 190570.0 [2024-08-06 01:18:53,157][52662] Sum rewards: 62.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.675', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.196', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.568', 'weapon4': '0.648', 'WEAPON3': '1.350', 'weapon3': '2.240', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '52.000'} [2024-08-06 01:18:54,360][52794] DAMAGECOUNT value on done: 195127.0 [2024-08-06 01:18:54,361][52794] Sum rewards: 54.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'AMMO4': '0.230', 'WEAPON4': '0.450', 'weapon4': '0.462', 'weapon2': '0.730', 'WEAPON3': '0.800', 'weapon3': '2.570', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.633', 'FRAGCOUNT': '45.000'} [2024-08-06 01:18:54,372][52668] DAMAGECOUNT value on done: 184978.0 [2024-08-06 01:18:54,372][52668] Sum rewards: 59.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.773', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.930', 'WEAPON3': '1.000', 'weapon3': '2.514', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '47.000'} [2024-08-06 01:18:54,686][52660] DAMAGECOUNT value on done: 190619.0 [2024-08-06 01:18:54,686][52660] Sum rewards: 76.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.014', 'weapon4': '0.016', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '63.000'} [2024-08-06 01:18:55,346][52795] DAMAGECOUNT value on done: 169843.0 [2024-08-06 01:18:55,346][52795] Sum rewards: 56.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.181', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '48.500'} [2024-08-06 01:18:55,506][52662] DAMAGECOUNT value on done: 199095.0 [2024-08-06 01:18:55,510][52662] Sum rewards: 61.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.412', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.215', 'weapon4': '0.248', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '52.000'} [2024-08-06 01:18:55,669][52669] DAMAGECOUNT value on done: 190957.0 [2024-08-06 01:18:55,670][52669] Sum rewards: 55.119, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.035', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.052', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.406', 'weapon4': '0.432', 'WEAPON3': '1.550', 'weapon3': '2.728', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '50.000'} [2024-08-06 01:18:55,864][52667] DAMAGECOUNT value on done: 190577.0 [2024-08-06 01:18:55,865][52667] Sum rewards: 61.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.550', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.134', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '50.500'} [2024-08-06 01:18:56,066][52650] Updated weights for policy 0, policy_version 29411 (0.0023) [2024-08-06 01:18:57,224][52794] DAMAGECOUNT value on done: 189636.0 [2024-08-06 01:18:57,227][52794] Sum rewards: 64.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.534', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.302', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.430', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '56.000'} [2024-08-06 01:18:57,360][52668] DAMAGECOUNT value on done: 183499.0 [2024-08-06 01:18:57,362][52668] Sum rewards: 69.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.628', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '2.982', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '59.000'} [2024-08-06 01:18:57,625][52660] DAMAGECOUNT value on done: 186552.0 [2024-08-06 01:18:57,627][52660] Sum rewards: 72.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.224', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.032', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.263', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '62.000'} [2024-08-06 01:18:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 240967680. Throughput: 0: 4368.4. Samples: 60248310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:18:57,794][52567] Avg episode reward: [(0, '61.224')] [2024-08-06 01:18:58,432][52795] DAMAGECOUNT value on done: 171720.0 [2024-08-06 01:18:58,433][52795] Sum rewards: 56.808, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.359', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.182', 'AMMO3': '0.255', 'weapon4': '0.308', 'WEAPON4': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '51.000'} [2024-08-06 01:18:58,494][52669] DAMAGECOUNT value on done: 187172.0 [2024-08-06 01:18:58,495][52669] Sum rewards: 49.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.264', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.063', 'AMMO3': '0.155', 'weapon5': '0.204', 'AMMO4': '0.314', 'WEAPON5': '0.450', 'weapon4': '0.482', 'weapon2': '0.540', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '41.000'} [2024-08-06 01:18:58,528][52667] DAMAGECOUNT value on done: 191484.0 [2024-08-06 01:18:58,528][52667] Sum rewards: 62.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.799', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.356', 'WEAPON4': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.000'} [2024-08-06 01:18:58,756][52662] DAMAGECOUNT value on done: 189529.0 [2024-08-06 01:18:58,759][52662] Sum rewards: 54.453, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.830', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.160', 'weapon2': '0.376', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '3.524', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '46.000'} [2024-08-06 01:19:00,086][52668] DAMAGECOUNT value on done: 188821.0 [2024-08-06 01:19:00,088][52668] Sum rewards: 63.069, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.499', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.136', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.480', 'weapon4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '50.000'} [2024-08-06 01:19:00,206][52794] DAMAGECOUNT value on done: 189595.0 [2024-08-06 01:19:00,206][52794] Sum rewards: 72.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.299', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 01:19:00,431][52660] DAMAGECOUNT value on done: 193275.0 [2024-08-06 01:19:00,432][52660] Sum rewards: 72.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.016', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '60.000'} [2024-08-06 01:19:00,527][52650] Updated weights for policy 0, policy_version 29421 (0.0023) [2024-08-06 01:19:00,940][52669] DAMAGECOUNT value on done: 189598.0 [2024-08-06 01:19:00,942][52669] Sum rewards: 64.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.764', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.078', 'weapon4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.288', 'WEAPON3': '1.450', 'weapon3': '3.370', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '55.000'} [2024-08-06 01:19:01,359][52671] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.258, -86.0), ('weapon5', 0.002)] [2024-08-06 01:19:01,369][52662] DAMAGECOUNT value on done: 192235.0 [2024-08-06 01:19:01,371][52662] Sum rewards: 56.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.356', 'weapon4': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '48.000'} [2024-08-06 01:19:01,696][52795] DAMAGECOUNT value on done: 173415.0 [2024-08-06 01:19:01,696][52795] Sum rewards: 67.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.785', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO4': '0.117', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.384', 'WEAPON3': '1.500', 'weapon3': '2.918', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:01,700][52667] DAMAGECOUNT value on done: 187406.0 [2024-08-06 01:19:01,700][52667] Sum rewards: 44.802, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.434', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'AMMO4': '0.160', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.744', 'WEAPON3': '1.200', 'weapon3': '2.438', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '38.000'} [2024-08-06 01:19:02,545][52794] DAMAGECOUNT value on done: 191939.0 [2024-08-06 01:19:02,545][52794] Sum rewards: 62.381, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.158', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.139', 'weapon5': '0.154', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.056', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:02,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 241049600. Throughput: 0: 4367.1. Samples: 60261510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:19:02,802][52567] Avg episode reward: [(0, '61.589')] [2024-08-06 01:19:02,802][52614] Saving new best policy, reward=61.589! [2024-08-06 01:19:03,243][52668] DAMAGECOUNT value on done: 186559.0 [2024-08-06 01:19:03,243][52668] Sum rewards: 48.255, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.498', 'AMMO5': '0.009', 'AMMO2': '0.016', 'ARMOR': '0.020', 'weapon5': '0.062', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'WEAPON4': '0.200', 'weapon4': '0.352', 'WEAPON3': '0.700', 'weapon2': '0.792', 'HITCOUNT': '2.520', 'weapon3': '2.760', 'DAMAGECOUNT': '11.526', 'FRAGCOUNT': '37.000'} [2024-08-06 01:19:03,558][52660] DAMAGECOUNT value on done: 181958.0 [2024-08-06 01:19:03,558][52660] Sum rewards: 44.313, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.938', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.047', 'weapon5': '0.190', 'AMMO4': '0.236', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.418', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.714', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '41.000'} [2024-08-06 01:19:03,926][52662] DAMAGECOUNT value on done: 189000.0 [2024-08-06 01:19:03,928][52662] Sum rewards: 57.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.163', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.080', 'AMMO3': '0.198', 'AMMO4': '0.234', 'weapon2': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.018', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:04,085][52669] DAMAGECOUNT value on done: 187073.0 [2024-08-06 01:19:04,086][52669] Sum rewards: 63.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.054', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '54.000'} [2024-08-06 01:19:04,481][52667] DAMAGECOUNT value on done: 188046.0 [2024-08-06 01:19:04,482][52667] Sum rewards: 62.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.364', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.155', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.324', 'weapon4': '0.334', 'WEAPON3': '1.000', 'weapon3': '2.868', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '51.500'} [2024-08-06 01:19:04,938][52795] DAMAGECOUNT value on done: 176649.0 [2024-08-06 01:19:04,938][52795] Sum rewards: 55.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.102', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'WEAPON4': '0.400', 'weapon2': '0.666', 'weapon4': '0.866', 'WEAPON3': '0.900', 'weapon3': '2.108', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '46.000'} [2024-08-06 01:19:05,346][52794] DAMAGECOUNT value on done: 189648.0 [2024-08-06 01:19:05,347][52794] Sum rewards: 66.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.715', 'AMMO5': '0.008', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon5': '0.180', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.294', 'weapon4': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:05,483][52650] Updated weights for policy 0, policy_version 29431 (0.0013) [2024-08-06 01:19:06,268][52668] DAMAGECOUNT value on done: 190942.0 [2024-08-06 01:19:06,271][52668] Sum rewards: 56.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.918', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.226', 'weapon2': '0.258', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.246', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '48.000'} [2024-08-06 01:19:06,564][52660] DAMAGECOUNT value on done: 187987.0 [2024-08-06 01:19:06,567][52660] Sum rewards: 73.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'ARMOR': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.249', 'weapon2': '0.746', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '63.000'} [2024-08-06 01:19:06,584][52669] DAMAGECOUNT value on done: 187684.0 [2024-08-06 01:19:06,585][52669] Sum rewards: 52.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.737', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.210', 'weapon5': '0.240', 'AMMO4': '0.247', 'weapon4': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.456', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '45.000'} [2024-08-06 01:19:06,749][52662] DAMAGECOUNT value on done: 195444.0 [2024-08-06 01:19:06,749][52662] Sum rewards: 62.017, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.390', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.216', 'AMMO3': '0.228', 'AMMO4': '0.272', 'weapon2': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.522', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.638', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '54.000'} [2024-08-06 01:19:07,241][52667] DAMAGECOUNT value on done: 191662.0 [2024-08-06 01:19:07,242][52667] Sum rewards: 74.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.145', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.396', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '61.000'} [2024-08-06 01:19:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 241131520. Throughput: 0: 4354.7. Samples: 60287590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:19:07,794][52567] Avg episode reward: [(0, '61.645')] [2024-08-06 01:19:07,798][52614] Saving new best policy, reward=61.645! [2024-08-06 01:19:08,101][52795] DAMAGECOUNT value on done: 174329.0 [2024-08-06 01:19:08,103][52795] Sum rewards: 68.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.431', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '59.000'} [2024-08-06 01:19:08,388][52794] DAMAGECOUNT value on done: 195486.0 [2024-08-06 01:19:08,389][52794] Sum rewards: 47.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.112', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.276', 'weapon2': '0.344', 'weapon4': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.852', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '41.500'} [2024-08-06 01:19:09,147][52668] DAMAGECOUNT value on done: 190657.0 [2024-08-06 01:19:09,147][52668] Sum rewards: 63.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.274', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:09,409][52660] DAMAGECOUNT value on done: 190802.0 [2024-08-06 01:19:09,412][52660] Sum rewards: 54.116, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.844', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.255', 'weapon2': '0.292', 'WEAPON4': '0.500', 'weapon4': '0.808', 'WEAPON3': '1.500', 'weapon3': '2.684', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '49.000'} [2024-08-06 01:19:09,646][52669] DAMAGECOUNT value on done: 186625.0 [2024-08-06 01:19:09,646][52669] Sum rewards: 68.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.374', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.036', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.216', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:09,904][52667] DAMAGECOUNT value on done: 190128.0 [2024-08-06 01:19:09,905][52667] Sum rewards: 59.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.665', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon2': '0.192', 'AMMO3': '0.238', 'weapon4': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.104', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:09,912][52662] DAMAGECOUNT value on done: 191904.0 [2024-08-06 01:19:09,913][52662] Sum rewards: 61.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.242', 'weapon2': '0.314', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.528', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:10,255][52650] Updated weights for policy 0, policy_version 29441 (0.0011) [2024-08-06 01:19:11,195][52795] DAMAGECOUNT value on done: 179382.0 [2024-08-06 01:19:11,196][52795] Sum rewards: 53.838, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.088', 'AMMO3': '0.173', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.616', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.956', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '44.000'} [2024-08-06 01:19:11,505][52794] DAMAGECOUNT value on done: 191866.0 [2024-08-06 01:19:11,507][52794] Sum rewards: 55.659, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO2': '0.044', 'AMMO4': '0.219', 'AMMO3': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.762', 'WEAPON3': '1.450', 'weapon3': '2.780', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '50.000'} [2024-08-06 01:19:12,134][52668] DAMAGECOUNT value on done: 188650.0 [2024-08-06 01:19:12,135][52668] Sum rewards: 49.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.675', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.058', 'AMMO4': '0.123', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '3.168', 'DAMAGECOUNT': '12.030', 'FRAGCOUNT': '42.000'} [2024-08-06 01:19:12,251][52660] DAMAGECOUNT value on done: 197468.0 [2024-08-06 01:19:12,251][52660] Sum rewards: 57.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO4': '0.168', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.194', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:12,612][52667] DAMAGECOUNT value on done: 188164.0 [2024-08-06 01:19:12,612][52667] Sum rewards: 56.049, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.326', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.226', 'weapon5': '0.252', 'weapon2': '0.436', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.444', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '50.000'} [2024-08-06 01:19:12,714][52669] DAMAGECOUNT value on done: 189763.0 [2024-08-06 01:19:12,717][52669] Sum rewards: 61.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon4': '0.418', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '50.000'} [2024-08-06 01:19:12,796][52567] Fps is (10 sec: 17200.0, 60 sec: 17475.7, 300 sec: 17522.4). Total num frames: 241221632. Throughput: 0: 4361.8. Samples: 60314120. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:19:12,797][52567] Avg episode reward: [(0, '60.742')] [2024-08-06 01:19:13,146][52662] DAMAGECOUNT value on done: 197186.0 [2024-08-06 01:19:13,148][52662] Sum rewards: 67.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.192', 'AMMO3': '0.195', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '56.000'} [2024-08-06 01:19:14,340][52795] DAMAGECOUNT value on done: 176333.0 [2024-08-06 01:19:14,342][52795] Sum rewards: 61.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.312', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:14,581][52794] DAMAGECOUNT value on done: 194986.0 [2024-08-06 01:19:14,581][52794] Sum rewards: 68.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.604', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.182', 'weapon5': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.266', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.926', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '56.000'} [2024-08-06 01:19:14,659][52650] Updated weights for policy 0, policy_version 29451 (0.0016) [2024-08-06 01:19:15,043][52660] DAMAGECOUNT value on done: 184893.0 [2024-08-06 01:19:15,044][52660] Sum rewards: 49.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.078', 'AMMO4': '0.130', 'weapon5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.300', 'HITCOUNT': '2.440', 'weapon3': '3.238', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '44.000'} [2024-08-06 01:19:15,463][52667] DAMAGECOUNT value on done: 190577.0 [2024-08-06 01:19:15,463][52667] Sum rewards: 56.528, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.419', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.050', 'weapon5': '0.114', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.252', 'weapon2': '0.572', 'WEAPON4': '0.600', 'weapon4': '0.850', 'WEAPON3': '1.050', 'weapon3': '2.198', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.041', 'FRAGCOUNT': '47.000'} [2024-08-06 01:19:15,746][52669] DAMAGECOUNT value on done: 188284.0 [2024-08-06 01:19:15,747][52669] Sum rewards: 54.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.302', 'ARMOR': '0.004', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.396', 'weapon4': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.804', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '45.000'} [2024-08-06 01:19:16,046][52662] DAMAGECOUNT value on done: 189678.0 [2024-08-06 01:19:16,049][52662] Sum rewards: 69.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.550', 'weapon3': '2.984', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '60.000'} [2024-08-06 01:19:17,466][52795] DAMAGECOUNT value on done: 172307.0 [2024-08-06 01:19:17,470][52795] Sum rewards: 60.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.308', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:17,552][52794] DAMAGECOUNT value on done: 195400.0 [2024-08-06 01:19:17,553][52794] Sum rewards: 52.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.504', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.431', 'FRAGCOUNT': '44.000'} [2024-08-06 01:19:17,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 241311744. Throughput: 0: 4370.4. Samples: 60327320. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:19:17,795][52567] Avg episode reward: [(0, '60.678')] [2024-08-06 01:19:17,891][52660] DAMAGECOUNT value on done: 190920.0 [2024-08-06 01:19:17,892][52660] Sum rewards: 68.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.876', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.054', 'AMMO4': '0.137', 'weapon4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:18,402][52667] DAMAGECOUNT value on done: 186971.0 [2024-08-06 01:19:18,404][52667] Sum rewards: 68.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.753', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.188', 'AMMO3': '0.189', 'weapon4': '0.360', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '58.000'} [2024-08-06 01:19:18,843][52662] DAMAGECOUNT value on done: 192916.0 [2024-08-06 01:19:18,845][52662] Sum rewards: 67.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.308', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '59.000'} [2024-08-06 01:19:19,020][52669] DAMAGECOUNT value on done: 188505.0 [2024-08-06 01:19:19,020][52669] Sum rewards: 61.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.554', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:19,574][52650] Updated weights for policy 0, policy_version 29461 (0.0024) [2024-08-06 01:19:20,014][52794] DAMAGECOUNT value on done: 190257.0 [2024-08-06 01:19:20,014][52794] Sum rewards: 64.229, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.370', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.264', 'weapon4': '0.394', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.600', 'weapon3': '2.666', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '55.000'} [2024-08-06 01:19:20,640][52795] DAMAGECOUNT value on done: 176049.0 [2024-08-06 01:19:20,641][52795] Sum rewards: 62.448, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.516', 'weapon2': '0.628', 'WEAPON3': '0.950', 'weapon3': '2.662', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:21,062][52660] DAMAGECOUNT value on done: 180942.0 [2024-08-06 01:19:21,064][52660] Sum rewards: 75.884, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.934', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.010', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon2': '0.146', 'AMMO3': '0.301', 'WEAPON3': '1.950', 'weapon3': '3.560', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '68.000'} [2024-08-06 01:19:21,144][52667] DAMAGECOUNT value on done: 193729.0 [2024-08-06 01:19:21,146][52667] Sum rewards: 60.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.402', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.219', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.510', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:21,795][52662] DAMAGECOUNT value on done: 189603.0 [2024-08-06 01:19:21,795][52662] Sum rewards: 59.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.566', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:21,976][52669] DAMAGECOUNT value on done: 186471.0 [2024-08-06 01:19:21,979][52669] Sum rewards: 54.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.965', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.259', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '48.500'} [2024-08-06 01:19:22,777][52794] DAMAGECOUNT value on done: 190252.0 [2024-08-06 01:19:22,778][52794] Sum rewards: 55.805, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.525', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon5': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.858', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '43.000'} [2024-08-06 01:19:22,794][52567] Fps is (10 sec: 17206.4, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 241393664. Throughput: 0: 4368.2. Samples: 60353380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:19:22,794][52567] Avg episode reward: [(0, '60.854')] [2024-08-06 01:19:23,156][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:19:23,226][52658] DAMAGECOUNT value on done: 193302.0 [2024-08-06 01:19:23,228][52658] Sum rewards: 63.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.139', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.024', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'AMMO3': '0.214', 'weapon2': '0.662', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:23,763][52795] DAMAGECOUNT value on done: 174359.0 [2024-08-06 01:19:23,771][52795] Sum rewards: 51.659, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.248', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.040', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'AMMO3': '0.312', 'weapon2': '0.556', 'WEAPON3': '1.700', 'HITCOUNT': '2.890', 'weapon3': '3.064', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '48.000'} [2024-08-06 01:19:24,200][52660] DAMAGECOUNT value on done: 190274.0 [2024-08-06 01:19:24,201][52660] Sum rewards: 56.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.906', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.226', 'AMMO4': '0.249', 'weapon4': '0.292', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.148', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '48.000'} [2024-08-06 01:19:24,214][52667] DAMAGECOUNT value on done: 196341.0 [2024-08-06 01:19:24,215][52667] Sum rewards: 59.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.578', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.128', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:24,299][52650] Updated weights for policy 0, policy_version 29471 (0.0013) [2024-08-06 01:19:24,306][52669] DAMAGECOUNT value on done: 190330.0 [2024-08-06 01:19:24,306][52669] Sum rewards: 55.753, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.290', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO3': '0.304', 'weapon2': '0.360', 'WEAPON3': '1.800', 'weapon3': '3.186', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:24,412][52662] DAMAGECOUNT value on done: 188128.0 [2024-08-06 01:19:24,412][52662] Sum rewards: 60.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.402', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.078', 'AMMO4': '0.126', 'AMMO3': '0.162', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '3.082', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '51.500'} [2024-08-06 01:19:25,746][52794] DAMAGECOUNT value on done: 187122.0 [2024-08-06 01:19:25,747][52794] Sum rewards: 66.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.176', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.103', 'weapon4': '0.140', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.728', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:25,842][52658] DAMAGECOUNT value on done: 189463.0 [2024-08-06 01:19:25,844][52658] Sum rewards: 59.090, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.432', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.328', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '48.000'} [2024-08-06 01:19:26,846][52667] DAMAGECOUNT value on done: 192985.0 [2024-08-06 01:19:26,846][52667] Sum rewards: 68.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.170', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '60.000'} [2024-08-06 01:19:27,057][52795] DAMAGECOUNT value on done: 171717.0 [2024-08-06 01:19:27,057][52795] Sum rewards: 62.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.856', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.089', 'weapon2': '0.190', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '54.000'} [2024-08-06 01:19:27,064][52669] DAMAGECOUNT value on done: 190953.0 [2024-08-06 01:19:27,066][52669] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.268', 'weapon4': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2024-08-06 01:19:27,080][52660] DAMAGECOUNT value on done: 184662.0 [2024-08-06 01:19:27,081][52660] Sum rewards: 69.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.350', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 01:19:27,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 241491968. Throughput: 0: 4378.0. Samples: 60379790. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:19:27,794][52567] Avg episode reward: [(0, '61.043')] [2024-08-06 01:19:28,542][52658] DAMAGECOUNT value on done: 193098.0 [2024-08-06 01:19:28,542][52658] Sum rewards: 48.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.416', 'AMMO5': '0.006', 'ARMOR': '0.008', 'weapon5': '0.038', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.219', 'weapon4': '0.252', 'weapon2': '0.630', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '2.900', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '42.000'} [2024-08-06 01:19:28,782][52794] DAMAGECOUNT value on done: 200862.0 [2024-08-06 01:19:28,792][52794] Sum rewards: 62.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.134', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.092', 'weapon4': '0.096', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '51.500'} [2024-08-06 01:19:28,991][52650] Updated weights for policy 0, policy_version 29481 (0.0014) [2024-08-06 01:19:29,359][52667] DAMAGECOUNT value on done: 194434.0 [2024-08-06 01:19:29,360][52667] Sum rewards: 60.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.504', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.184', 'weapon5': '0.196', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.016', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '50.000'} [2024-08-06 01:19:29,671][52669] DAMAGECOUNT value on done: 187167.0 [2024-08-06 01:19:29,671][52669] Sum rewards: 66.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.112', 'weapon5': '0.162', 'AMMO3': '0.188', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.726', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 01:19:30,100][52795] DAMAGECOUNT value on done: 172193.0 [2024-08-06 01:19:30,102][52795] Sum rewards: 68.713, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.216', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '55.500'} [2024-08-06 01:19:31,394][52658] DAMAGECOUNT value on done: 193165.0 [2024-08-06 01:19:31,395][52658] Sum rewards: 60.889, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.598', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.095', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.568', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '3.158', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '50.000'} [2024-08-06 01:19:32,019][52667] DAMAGECOUNT value on done: 187608.0 [2024-08-06 01:19:32,020][52667] Sum rewards: 47.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.100', 'weapon7': '0.102', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'AMMO6': '0.240', 'AMMO7': '0.240', 'weapon2': '0.302', 'WEAPON7': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon4': '1.210', 'weapon3': '1.898', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.847', 'FRAGCOUNT': '40.000'} [2024-08-06 01:19:32,126][52794] DAMAGECOUNT value on done: 187749.0 [2024-08-06 01:19:32,127][52794] Sum rewards: 59.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.800', 'AMMO2': '0.010', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon2': '0.140', 'AMMO3': '0.214', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.676', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:32,352][52669] DAMAGECOUNT value on done: 192971.0 [2024-08-06 01:19:32,352][52669] Sum rewards: 59.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.237', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.170', 'AMMO4': '0.170', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.492', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.348', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '49.000'} [2024-08-06 01:19:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 241573888. Throughput: 0: 4381.6. Samples: 60393140. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:19:32,794][52567] Avg episode reward: [(0, '60.771')] [2024-08-06 01:19:33,176][52795] DAMAGECOUNT value on done: 176713.0 [2024-08-06 01:19:33,178][52795] Sum rewards: 73.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.227', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.101', 'weapon5': '0.124', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.580', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 01:19:33,356][52650] Updated weights for policy 0, policy_version 29491 (0.0017) [2024-08-06 01:19:33,923][52658] DAMAGECOUNT value on done: 191980.0 [2024-08-06 01:19:33,923][52658] Sum rewards: 69.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.106', 'AMMO3': '0.198', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.362', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:34,698][52794] DAMAGECOUNT value on done: 196239.0 [2024-08-06 01:19:34,699][52794] Sum rewards: 67.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon2': '0.210', 'AMMO3': '0.239', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.438', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '58.000'} [2024-08-06 01:19:34,751][52667] DAMAGECOUNT value on done: 193758.0 [2024-08-06 01:19:34,752][52667] Sum rewards: 66.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.396', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon4': '0.192', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:34,980][52669] DAMAGECOUNT value on done: 195677.0 [2024-08-06 01:19:34,981][52669] Sum rewards: 68.328, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.218', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.376', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:36,330][52795] DAMAGECOUNT value on done: 170660.0 [2024-08-06 01:19:36,332][52795] Sum rewards: 62.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.377', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:37,029][52658] DAMAGECOUNT value on done: 187333.0 [2024-08-06 01:19:37,039][52658] Sum rewards: 66.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.995', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.084', 'weapon4': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:37,246][52794] DAMAGECOUNT value on done: 192917.0 [2024-08-06 01:19:37,246][52794] Sum rewards: 57.374, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.238', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'weapon4': '0.220', 'AMMO4': '0.246', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.700', 'weapon3': '2.976', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:37,786][52669] DAMAGECOUNT value on done: 200905.0 [2024-08-06 01:19:37,787][52669] Sum rewards: 55.550, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.754', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO3': '0.162', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON4': '0.500', 'weapon4': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.556', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '44.000'} [2024-08-06 01:19:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 241664000. Throughput: 0: 4382.5. Samples: 60419360. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:19:37,795][52567] Avg episode reward: [(0, '61.284')] [2024-08-06 01:19:38,309][52650] Updated weights for policy 0, policy_version 29501 (0.0010) [2024-08-06 01:19:39,147][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:19:39,611][52795] DAMAGECOUNT value on done: 179953.0 [2024-08-06 01:19:39,611][52795] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO3': '0.146', 'AMMO4': '0.154', 'weapon2': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.338', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '56.000'} [2024-08-06 01:19:40,017][52794] DAMAGECOUNT value on done: 194227.0 [2024-08-06 01:19:40,018][52794] Sum rewards: 66.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.422', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.197', 'weapon5': '0.220', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.370', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '56.000'} [2024-08-06 01:19:40,118][52669] DAMAGECOUNT value on done: 188611.0 [2024-08-06 01:19:40,120][52669] Sum rewards: 42.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon7': '0.048', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.328', 'weapon4': '0.562', 'WEAPON3': '0.900', 'HITCOUNT': '2.010', 'weapon3': '2.296', 'DAMAGECOUNT': '10.011', 'FRAGCOUNT': '37.000'} [2024-08-06 01:19:40,320][52658] DAMAGECOUNT value on done: 195244.0 [2024-08-06 01:19:40,322][52658] Sum rewards: 62.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.555', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:41,723][52666] DAMAGECOUNT value on done: 192662.0 [2024-08-06 01:19:41,725][52666] Sum rewards: 60.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.300', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.198', 'WEAPON4': '0.450', 'weapon4': '0.526', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:42,628][52650] Updated weights for policy 0, policy_version 29511 (0.0032) [2024-08-06 01:19:42,676][52794] DAMAGECOUNT value on done: 198478.0 [2024-08-06 01:19:42,677][52794] Sum rewards: 58.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.851', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.238', 'weapon4': '0.318', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.928', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:42,740][52795] DAMAGECOUNT value on done: 179265.0 [2024-08-06 01:19:42,740][52795] Sum rewards: 59.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.840', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.124', 'weapon4': '0.150', 'AMMO3': '0.182', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '49.000'} [2024-08-06 01:19:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 241754112. Throughput: 0: 4393.8. Samples: 60446030. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:19:42,794][52567] Avg episode reward: [(0, '61.130')] [2024-08-06 01:19:42,927][52669] DAMAGECOUNT value on done: 193006.0 [2024-08-06 01:19:42,928][52669] Sum rewards: 58.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.417', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.076', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.258', 'weapon2': '0.430', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.188', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:43,127][52658] DAMAGECOUNT value on done: 185703.0 [2024-08-06 01:19:43,128][52658] Sum rewards: 68.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.682', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.193', 'weapon4': '0.328', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '56.000'} [2024-08-06 01:19:44,846][52666] DAMAGECOUNT value on done: 193456.0 [2024-08-06 01:19:44,846][52666] Sum rewards: 59.725, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.054', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon4': '0.266', 'AMMO4': '0.271', 'weapon2': '0.488', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '55.000'} [2024-08-06 01:19:45,479][52794] DAMAGECOUNT value on done: 193174.0 [2024-08-06 01:19:45,479][52794] Sum rewards: 62.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.080', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'AMMO4': '0.398', 'weapon2': '0.450', 'weapon4': '0.536', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '53.500'} [2024-08-06 01:19:45,986][52795] DAMAGECOUNT value on done: 168687.0 [2024-08-06 01:19:45,987][52795] Sum rewards: 60.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.126', 'AMMO3': '0.156', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.346', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '3.022', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:46,010][52669] DAMAGECOUNT value on done: 193267.0 [2024-08-06 01:19:46,014][52669] Sum rewards: 71.059, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '3.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:46,191][52658] DAMAGECOUNT value on done: 194967.0 [2024-08-06 01:19:46,191][52658] Sum rewards: 55.475, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.895', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.946', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '2.872', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '46.000'} [2024-08-06 01:19:47,577][52650] Updated weights for policy 0, policy_version 29521 (0.0015) [2024-08-06 01:19:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 241844224. Throughput: 0: 4386.2. Samples: 60458890. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:19:47,794][52567] Avg episode reward: [(0, '61.078')] [2024-08-06 01:19:48,288][52666] DAMAGECOUNT value on done: 191155.0 [2024-08-06 01:19:48,289][52666] Sum rewards: 61.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.038', 'weapon4': '0.038', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.232', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:48,960][52669] DAMAGECOUNT value on done: 195902.0 [2024-08-06 01:19:48,961][52669] Sum rewards: 63.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.224', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO4': '0.155', 'AMMO3': '0.167', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.236', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:49,076][52795] DAMAGECOUNT value on done: 181282.0 [2024-08-06 01:19:49,076][52795] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.215', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.203', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '62.000'} [2024-08-06 01:19:49,551][52658] DAMAGECOUNT value on done: 194537.0 [2024-08-06 01:19:49,552][52658] Sum rewards: 56.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.182', 'weapon2': '0.628', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '2.994', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '47.000'} [2024-08-06 01:19:50,629][52666] DAMAGECOUNT value on done: 188350.0 [2024-08-06 01:19:50,631][52666] Sum rewards: 47.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.248', 'AMMO4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '3.068', 'DAMAGECOUNT': '12.474', 'FRAGCOUNT': '43.500'} [2024-08-06 01:19:50,924][52614] Signal inference workers to stop experience collection... (5400 times) [2024-08-06 01:19:50,924][52614] Signal inference workers to resume experience collection... (5400 times) [2024-08-06 01:19:51,012][52650] InferenceWorker_p0-w0: stopping experience collection (5400 times) [2024-08-06 01:19:51,013][52650] InferenceWorker_p0-w0: resuming experience collection (5400 times) [2024-08-06 01:19:51,683][52650] Updated weights for policy 0, policy_version 29531 (0.0022) [2024-08-06 01:19:51,771][52647] DAMAGECOUNT value on done: 201357.0 [2024-08-06 01:19:51,774][52647] Sum rewards: 57.067, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon4': '0.228', 'HEALTH': '0.324', 'weapon2': '0.326', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.274', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '49.000'} [2024-08-06 01:19:51,819][52670] DAMAGECOUNT value on done: 188604.0 [2024-08-06 01:19:51,820][52670] Sum rewards: 59.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.240', 'weapon2': '0.264', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '50.000'} [2024-08-06 01:19:52,253][52795] DAMAGECOUNT value on done: 181198.0 [2024-08-06 01:19:52,253][52795] Sum rewards: 60.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.032', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO3': '0.159', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON3': '0.850', 'weapon2': '1.006', 'weapon3': '2.398', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '49.500'} [2024-08-06 01:19:52,333][52658] DAMAGECOUNT value on done: 196905.0 [2024-08-06 01:19:52,334][52658] Sum rewards: 70.530, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.616', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon2': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '57.000'} [2024-08-06 01:19:52,737][52803] DAMAGECOUNT value on done: 177516.0 [2024-08-06 01:19:52,740][52803] Sum rewards: 56.127, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.688', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.305', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.800', 'weapon3': '2.790', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:52,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 241926144. Throughput: 0: 4392.2. Samples: 60485240. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:19:52,802][52567] Avg episode reward: [(0, '61.064')] [2024-08-06 01:19:53,637][52666] DAMAGECOUNT value on done: 185892.0 [2024-08-06 01:19:53,637][52666] Sum rewards: 58.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.440', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.132', 'AMMO3': '0.169', 'AMMO4': '0.200', 'weapon5': '0.218', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.142', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '47.000'} [2024-08-06 01:19:54,845][52658] DAMAGECOUNT value on done: 186243.0 [2024-08-06 01:19:54,846][52658] Sum rewards: 74.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.051', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.174', 'weapon4': '0.372', 'weapon2': '0.398', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '60.000'} [2024-08-06 01:19:54,877][52670] DAMAGECOUNT value on done: 190488.0 [2024-08-06 01:19:54,878][52670] Sum rewards: 62.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon5': '0.102', 'AMMO3': '0.145', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.380', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '2.938', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '52.000'} [2024-08-06 01:19:54,957][52647] DAMAGECOUNT value on done: 199268.0 [2024-08-06 01:19:54,957][52647] Sum rewards: 60.866, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.462', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO3': '0.150', 'AMMO4': '0.157', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.440', 'weapon2': '0.510', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '48.000'} [2024-08-06 01:19:55,820][52803] DAMAGECOUNT value on done: 180173.0 [2024-08-06 01:19:55,823][52803] Sum rewards: 69.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.795', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.149', 'AMMO3': '0.190', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.500'} [2024-08-06 01:19:56,744][52666] DAMAGECOUNT value on done: 182165.0 [2024-08-06 01:19:56,745][52666] Sum rewards: 63.207, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.044', 'AMMO3': '0.160', 'weapon5': '0.210', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon4': '0.378', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.722', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '53.000'} [2024-08-06 01:19:56,829][52650] Updated weights for policy 0, policy_version 29541 (0.0021) [2024-08-06 01:19:57,262][52671] DAMAGECOUNT value on done: 195230.0 [2024-08-06 01:19:57,262][52671] Sum rewards: 52.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.088', 'weapon4': '0.106', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '3.208', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '48.000'} [2024-08-06 01:19:57,414][52647] DAMAGECOUNT value on done: 200880.0 [2024-08-06 01:19:57,414][52647] Sum rewards: 59.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.004', 'weapon4': '0.024', 'AMMO2': '0.029', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.430', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.348', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '51.000'} [2024-08-06 01:19:57,519][52658] DAMAGECOUNT value on done: 188717.0 [2024-08-06 01:19:57,521][52658] Sum rewards: 45.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'AMMO2': '0.009', 'ARMOR': '0.012', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '1.028', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.736', 'FRAGCOUNT': '41.000'} [2024-08-06 01:19:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 242016256. Throughput: 0: 4391.1. Samples: 60511710. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:19:57,794][52567] Avg episode reward: [(0, '61.369')] [2024-08-06 01:19:57,969][52670] DAMAGECOUNT value on done: 187559.0 [2024-08-06 01:19:57,971][52670] Sum rewards: 56.351, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.661', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.226', 'AMMO3': '0.236', 'AMMO4': '0.247', 'weapon4': '0.384', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.642', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '49.000'} [2024-08-06 01:19:58,902][52803] DAMAGECOUNT value on done: 175718.0 [2024-08-06 01:19:58,902][52803] Sum rewards: 53.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.347', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.072', 'AMMO3': '0.194', 'weapon5': '0.200', 'weapon4': '0.302', 'AMMO4': '0.362', 'weapon2': '0.372', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '45.500'} [2024-08-06 01:19:59,846][52666] DAMAGECOUNT value on done: 188659.0 [2024-08-06 01:19:59,850][52666] Sum rewards: 63.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.153', 'weapon4': '0.180', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:00,043][52647] DAMAGECOUNT value on done: 199951.0 [2024-08-06 01:20:00,045][52647] Sum rewards: 50.516, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.330', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon4': '0.348', 'WEAPON4': '0.450', 'weapon2': '0.540', 'WEAPON3': '1.600', 'weapon3': '2.792', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:00,272][52671] DAMAGECOUNT value on done: 189685.0 [2024-08-06 01:20:00,275][52671] Sum rewards: 62.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.150', 'AMMO4': '0.158', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '2.970', 'weapon3': '3.460', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:00,479][52820] DAMAGECOUNT value on done: 172721.0 [2024-08-06 01:20:00,480][52820] Sum rewards: 53.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.983', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.626', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.096', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '46.500'} [2024-08-06 01:20:00,607][52658] DAMAGECOUNT value on done: 190698.0 [2024-08-06 01:20:00,608][52658] Sum rewards: 67.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.154', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon4': '0.012', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.239', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.322', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:01,201][52670] DAMAGECOUNT value on done: 187670.0 [2024-08-06 01:20:01,203][52670] Sum rewards: 60.846, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.932', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.060', 'weapon5': '0.124', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'AMMO4': '0.299', 'weapon2': '0.342', 'weapon4': '0.490', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.684', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:01,491][52811] DAMAGECOUNT value on done: 186771.0 [2024-08-06 01:20:01,493][52811] Sum rewards: 72.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.977', 'ARMOR': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.186', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:01,492][52650] Updated weights for policy 0, policy_version 29551 (0.0012) [2024-08-06 01:20:02,062][52803] DAMAGECOUNT value on done: 177740.0 [2024-08-06 01:20:02,064][52803] Sum rewards: 61.345, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.435', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '49.500'} [2024-08-06 01:20:02,431][52647] DAMAGECOUNT value on done: 201310.0 [2024-08-06 01:20:02,432][52647] Sum rewards: 61.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.745', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon5': '0.108', 'AMMO3': '0.225', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.400', 'weapon4': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.516', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:02,794][52567] Fps is (10 sec: 17204.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 242098176. Throughput: 0: 4390.5. Samples: 60524890. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:20:02,794][52567] Avg episode reward: [(0, '61.153')] [2024-08-06 01:20:03,037][52666] DAMAGECOUNT value on done: 188617.0 [2024-08-06 01:20:03,038][52666] Sum rewards: 53.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.168', 'AMMO3': '0.177', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.600', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '2.352', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '44.000'} [2024-08-06 01:20:03,113][52649] DAMAGECOUNT value on done: 184468.0 [2024-08-06 01:20:03,114][52649] Sum rewards: 60.061, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.416', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.234', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '53.500'} [2024-08-06 01:20:03,188][52671] DAMAGECOUNT value on done: 194017.0 [2024-08-06 01:20:03,191][52671] Sum rewards: 56.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.240', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.194', 'weapon4': '0.276', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:03,540][52658] DAMAGECOUNT value on done: 187672.0 [2024-08-06 01:20:03,542][52658] Sum rewards: 57.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.053', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '0.950', 'weapon4': '1.022', 'weapon3': '2.234', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:03,565][52820] DAMAGECOUNT value on done: 175933.0 [2024-08-06 01:20:03,566][52820] Sum rewards: 68.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.090', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:04,366][52670] DAMAGECOUNT value on done: 188826.0 [2024-08-06 01:20:04,366][52670] Sum rewards: 51.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.377', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO3': '0.188', 'AMMO4': '0.211', 'weapon2': '0.546', 'WEAPON4': '0.550', 'weapon4': '0.744', 'WEAPON3': '1.150', 'weapon3': '2.330', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '44.000'} [2024-08-06 01:20:04,601][52811] DAMAGECOUNT value on done: 172911.0 [2024-08-06 01:20:04,602][52811] Sum rewards: 53.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.475', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.098', 'AMMO3': '0.178', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.410', 'WEAPON4': '0.500', 'weapon2': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.622', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '46.500'} [2024-08-06 01:20:04,885][52647] DAMAGECOUNT value on done: 203211.0 [2024-08-06 01:20:04,887][52647] Sum rewards: 63.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO2': '0.008', 'weapon4': '0.030', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.232', 'weapon2': '0.240', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.590', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:05,259][52803] DAMAGECOUNT value on done: 180594.0 [2024-08-06 01:20:05,261][52803] Sum rewards: 47.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.482', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.112', 'AMMO3': '0.185', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON4': '0.550', 'weapon4': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.434', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '42.000'} [2024-08-06 01:20:05,866][52649] DAMAGECOUNT value on done: 181241.0 [2024-08-06 01:20:05,868][52649] Sum rewards: 62.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.114', 'AMMO4': '0.130', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.702', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:05,884][52666] DAMAGECOUNT value on done: 188542.0 [2024-08-06 01:20:05,885][52666] Sum rewards: 64.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.082', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.304', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:05,985][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:20:06,089][52650] Updated weights for policy 0, policy_version 29561 (0.0030) [2024-08-06 01:20:06,412][52671] DAMAGECOUNT value on done: 188769.0 [2024-08-06 01:20:06,413][52671] Sum rewards: 69.454, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.256', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.171', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:06,465][52658] DAMAGECOUNT value on done: 192124.0 [2024-08-06 01:20:06,465][52658] Sum rewards: 59.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'weapon4': '0.414', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:06,889][52820] DAMAGECOUNT value on done: 172347.0 [2024-08-06 01:20:06,889][52820] Sum rewards: 58.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.194', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.064', 'weapon4': '0.170', 'AMMO4': '0.181', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.724', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:07,198][52670] DAMAGECOUNT value on done: 192003.0 [2024-08-06 01:20:07,198][52670] Sum rewards: 70.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.870', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.118', 'AMMO3': '0.214', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:07,643][52811] DAMAGECOUNT value on done: 179657.0 [2024-08-06 01:20:07,645][52811] Sum rewards: 60.521, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.920', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.239', 'weapon2': '0.250', 'WEAPON3': '1.650', 'weapon3': '3.416', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:07,667][52647] DAMAGECOUNT value on done: 199300.0 [2024-08-06 01:20:07,667][52647] Sum rewards: 55.253, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.059', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.134', 'weapon5': '0.158', 'AMMO4': '0.190', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.024', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '48.500'} [2024-08-06 01:20:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 242188288. Throughput: 0: 4394.4. Samples: 60551130. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:20:07,794][52567] Avg episode reward: [(0, '61.164')] [2024-08-06 01:20:08,401][52803] DAMAGECOUNT value on done: 178076.0 [2024-08-06 01:20:08,406][52803] Sum rewards: 71.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon5': '0.036', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:08,514][52649] DAMAGECOUNT value on done: 185302.0 [2024-08-06 01:20:08,514][52649] Sum rewards: 65.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.845', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.251', 'weapon2': '0.426', 'WEAPON4': '0.750', 'weapon4': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.430', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:09,062][52666] DAMAGECOUNT value on done: 189763.0 [2024-08-06 01:20:09,064][52666] Sum rewards: 61.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.256', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:09,233][52658] DAMAGECOUNT value on done: 192688.0 [2024-08-06 01:20:09,236][52658] Sum rewards: 58.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.240', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.022', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:09,271][52671] DAMAGECOUNT value on done: 191467.0 [2024-08-06 01:20:09,273][52671] Sum rewards: 73.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.175', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.116', 'weapon4': '0.134', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:09,477][52794] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon5', 0.002)] [2024-08-06 01:20:10,012][52820] DAMAGECOUNT value on done: 167058.0 [2024-08-06 01:20:10,012][52820] Sum rewards: 58.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.236', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.192', 'weapon2': '0.710', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.140', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:10,359][52670] DAMAGECOUNT value on done: 184265.0 [2024-08-06 01:20:10,359][52670] Sum rewards: 59.654, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.094', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon4': '0.262', 'AMMO3': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.750', 'weapon3': '2.844', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:10,659][52811] DAMAGECOUNT value on done: 178167.0 [2024-08-06 01:20:10,660][52811] Sum rewards: 73.241, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.898', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.156', 'AMMO4': '0.185', 'AMMO3': '0.220', 'weapon2': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 01:20:10,699][52647] DAMAGECOUNT value on done: 199194.0 [2024-08-06 01:20:10,699][52647] Sum rewards: 60.144, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.124', 'AMMO3': '0.150', 'weapon4': '0.198', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.514', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '2.938', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:10,940][52650] Updated weights for policy 0, policy_version 29571 (0.0019) [2024-08-06 01:20:11,313][52803] DAMAGECOUNT value on done: 178983.0 [2024-08-06 01:20:11,313][52803] Sum rewards: 61.675, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO2': '0.008', 'ARMOR': '0.012', 'AMMO4': '0.039', 'AMMO3': '0.229', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.526', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:11,667][52666] DAMAGECOUNT value on done: 186857.0 [2024-08-06 01:20:11,667][52666] Sum rewards: 78.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.042', 'AMMO4': '0.149', 'AMMO3': '0.151', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '62.500'} [2024-08-06 01:20:11,768][52649] DAMAGECOUNT value on done: 184779.0 [2024-08-06 01:20:11,768][52649] Sum rewards: 44.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.172', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.222', 'weapon5': '0.240', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'weapon4': '0.362', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.640', 'weapon3': '2.688', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '38.500'} [2024-08-06 01:20:12,107][52671] DAMAGECOUNT value on done: 191531.0 [2024-08-06 01:20:12,109][52671] Sum rewards: 65.677, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:12,181][52658] DAMAGECOUNT value on done: 187322.0 [2024-08-06 01:20:12,182][52658] Sum rewards: 51.073, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.643', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.194', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.380', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.974', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '45.000'} [2024-08-06 01:20:12,614][52663] DAMAGECOUNT value on done: 191653.0 [2024-08-06 01:20:12,614][52663] Sum rewards: 60.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.507', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.181', 'weapon5': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:12,699][52670] DAMAGECOUNT value on done: 189056.0 [2024-08-06 01:20:12,699][52670] Sum rewards: 63.689, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.334', 'AMMO5': '0.005', 'weapon5': '0.034', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'AMMO4': '0.208', 'weapon4': '0.224', 'WEAPON4': '0.350', 'ARMOR': '0.495', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.3, 300 sec: 17522.6). Total num frames: 242278400. Throughput: 0: 4394.2. Samples: 60577530. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:20:12,794][52567] Avg episode reward: [(0, '61.494')] [2024-08-06 01:20:13,001][52820] DAMAGECOUNT value on done: 176585.0 [2024-08-06 01:20:13,001][52820] Sum rewards: 68.354, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.324', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.092', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '54.500'} [2024-08-06 01:20:13,571][52647] DAMAGECOUNT value on done: 202206.0 [2024-08-06 01:20:13,571][52647] Sum rewards: 62.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.148', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:13,833][52811] DAMAGECOUNT value on done: 177896.0 [2024-08-06 01:20:13,833][52811] Sum rewards: 61.419, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.324', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.180', 'weapon2': '0.564', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.166', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:14,206][52666] DAMAGECOUNT value on done: 183330.0 [2024-08-06 01:20:14,206][52666] Sum rewards: 66.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.264', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.186', 'AMMO3': '0.190', 'weapon4': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:14,445][52803] DAMAGECOUNT value on done: 173700.0 [2024-08-06 01:20:14,446][52803] Sum rewards: 50.728, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.136', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.260', 'weapon4': '0.294', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.080', 'weapon3': '3.128', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:14,570][52649] DAMAGECOUNT value on done: 178264.0 [2024-08-06 01:20:14,571][52649] Sum rewards: 44.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.336', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.062', 'WEAPON5': '0.150', 'weapon5': '0.200', 'AMMO3': '0.229', 'AMMO4': '0.310', 'weapon4': '0.366', 'WEAPON4': '0.550', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '2.510', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '41.000'} [2024-08-06 01:20:14,980][52671] DAMAGECOUNT value on done: 192336.0 [2024-08-06 01:20:14,982][52671] Sum rewards: 76.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.158', 'AMMO3': '0.182', 'weapon2': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 01:20:15,210][52658] DAMAGECOUNT value on done: 188594.0 [2024-08-06 01:20:15,211][52658] Sum rewards: 72.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.917', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'weapon2': '0.174', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '61.000'} [2024-08-06 01:20:15,349][52650] Updated weights for policy 0, policy_version 29581 (0.0011) [2024-08-06 01:20:15,520][52670] DAMAGECOUNT value on done: 184674.0 [2024-08-06 01:20:15,521][52670] Sum rewards: 63.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.865', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:15,675][52663] DAMAGECOUNT value on done: 189106.0 [2024-08-06 01:20:15,675][52663] Sum rewards: 57.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.170', 'AMMO3': '0.174', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.552', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '2.826', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:16,034][52820] DAMAGECOUNT value on done: 172587.0 [2024-08-06 01:20:16,035][52820] Sum rewards: 57.776, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.635', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.140', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon2': '0.312', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '3.064', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '47.500'} [2024-08-06 01:20:16,264][52647] DAMAGECOUNT value on done: 197845.0 [2024-08-06 01:20:16,266][52647] Sum rewards: 60.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.051', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'AMMO4': '0.256', 'weapon4': '0.396', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:16,840][52811] DAMAGECOUNT value on done: 181725.0 [2024-08-06 01:20:16,840][52811] Sum rewards: 63.761, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.192', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.106', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '55.500'} [2024-08-06 01:20:16,854][52794] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:20:17,424][52666] DAMAGECOUNT value on done: 191292.0 [2024-08-06 01:20:17,424][52666] Sum rewards: 59.354, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.684', 'WEAPON3': '1.550', 'weapon3': '2.528', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:17,446][52803] DAMAGECOUNT value on done: 178080.0 [2024-08-06 01:20:17,449][52803] Sum rewards: 64.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.141', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.151', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.214', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:17,542][52649] DAMAGECOUNT value on done: 184957.0 [2024-08-06 01:20:17,544][52649] Sum rewards: 57.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.790', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.066', 'AMMO3': '0.269', 'AMMO4': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.372', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.650', 'weapon3': '2.758', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 242368512. Throughput: 0: 4391.8. Samples: 60590770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:20:17,794][52567] Avg episode reward: [(0, '61.274')] [2024-08-06 01:20:17,899][52671] DAMAGECOUNT value on done: 193435.0 [2024-08-06 01:20:17,900][52671] Sum rewards: 66.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.001', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.143', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.606', 'WEAPON3': '0.850', 'weapon3': '2.904', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:18,046][52658] DAMAGECOUNT value on done: 193271.0 [2024-08-06 01:20:18,048][52658] Sum rewards: 54.419, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.244', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:18,457][52663] DAMAGECOUNT value on done: 187343.0 [2024-08-06 01:20:18,458][52663] Sum rewards: 48.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.863', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.134', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'WEAPON4': '0.450', 'weapon2': '0.508', 'weapon4': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.124', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '39.000'} [2024-08-06 01:20:18,712][52647] DAMAGECOUNT value on done: 199056.0 [2024-08-06 01:20:18,713][52647] Sum rewards: 51.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.057', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.264', 'AMMO4': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.738', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '44.000'} [2024-08-06 01:20:18,839][52670] DAMAGECOUNT value on done: 180123.0 [2024-08-06 01:20:18,840][52670] Sum rewards: 65.386, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.154', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.063', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'AMMO4': '0.315', 'weapon4': '0.414', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.742', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:19,130][52820] DAMAGECOUNT value on done: 176203.0 [2024-08-06 01:20:19,132][52820] Sum rewards: 52.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.701', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.187', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon5': '0.252', 'weapon2': '0.372', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '45.000'} [2024-08-06 01:20:19,935][52811] DAMAGECOUNT value on done: 178887.0 [2024-08-06 01:20:19,935][52811] Sum rewards: 61.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.247', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.182', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon2': '0.356', 'WEAPON3': '1.700', 'weapon3': '3.196', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '56.500'} [2024-08-06 01:20:20,060][52650] Updated weights for policy 0, policy_version 29591 (0.0012) [2024-08-06 01:20:20,317][52666] DAMAGECOUNT value on done: 191767.0 [2024-08-06 01:20:20,320][52666] Sum rewards: 57.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.673', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.128', 'weapon5': '0.164', 'AMMO4': '0.183', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.830', 'WEAPON3': '0.850', 'weapon3': '2.574', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:20,543][52803] DAMAGECOUNT value on done: 173547.0 [2024-08-06 01:20:20,544][52803] Sum rewards: 62.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.171', 'weapon4': '0.194', 'AMMO4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '51.500'} [2024-08-06 01:20:20,785][52649] DAMAGECOUNT value on done: 183525.0 [2024-08-06 01:20:20,786][52649] Sum rewards: 60.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.215', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO4': '0.194', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.322', 'weapon4': '0.342', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:20,827][52671] DAMAGECOUNT value on done: 189533.0 [2024-08-06 01:20:20,828][52671] Sum rewards: 51.974, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.780', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.060', 'AMMO2': '0.061', 'WEAPON5': '0.150', 'AMMO3': '0.279', 'AMMO4': '0.305', 'weapon2': '0.310', 'WEAPON4': '0.550', 'weapon4': '0.608', 'WEAPON3': '1.600', 'weapon3': '2.696', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:21,292][52663] DAMAGECOUNT value on done: 191246.0 [2024-08-06 01:20:21,292][52663] Sum rewards: 51.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.626', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.104', 'AMMO3': '0.168', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '3.056', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '44.000'} [2024-08-06 01:20:21,384][52647] DAMAGECOUNT value on done: 196428.0 [2024-08-06 01:20:21,384][52647] Sum rewards: 53.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.176', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.096', 'AMMO4': '0.224', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:21,776][52670] DAMAGECOUNT value on done: 191044.0 [2024-08-06 01:20:21,777][52670] Sum rewards: 56.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon4': '0.064', 'weapon5': '0.066', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.242', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:22,309][52820] DAMAGECOUNT value on done: 178717.0 [2024-08-06 01:20:22,313][52820] Sum rewards: 67.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.084', 'weapon4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.706', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:22,719][52664] DAMAGECOUNT value on done: 197014.0 [2024-08-06 01:20:22,720][52664] Sum rewards: 49.022, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.860', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.102', 'AMMO3': '0.283', 'AMMO4': '0.293', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.628', 'WEAPON3': '1.650', 'weapon3': '2.642', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '45.000'} [2024-08-06 01:20:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 242450432. Throughput: 0: 4394.7. Samples: 60617120. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:20:22,795][52567] Avg episode reward: [(0, '60.490')] [2024-08-06 01:20:22,947][52811] DAMAGECOUNT value on done: 177785.0 [2024-08-06 01:20:22,949][52811] Sum rewards: 56.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.252', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.100', 'AMMO3': '0.204', 'weapon4': '0.224', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:23,297][52666] DAMAGECOUNT value on done: 184513.0 [2024-08-06 01:20:23,299][52666] Sum rewards: 39.985, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.652', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.051', 'weapon5': '0.140', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'AMMO4': '0.254', 'WEAPON4': '0.600', 'weapon2': '0.612', 'weapon4': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.344', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '37.000'} [2024-08-06 01:20:23,545][52671] DAMAGECOUNT value on done: 194247.0 [2024-08-06 01:20:23,545][52671] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.694', 'ARMOR': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.161', 'AMMO4': '0.164', 'weapon2': '0.306', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:23,636][52649] DAMAGECOUNT value on done: 190464.0 [2024-08-06 01:20:23,637][52649] Sum rewards: 64.298, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.899', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.766', 'WEAPON3': '1.100', 'weapon3': '2.744', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:23,739][52803] DAMAGECOUNT value on done: 183719.0 [2024-08-06 01:20:23,740][52803] Sum rewards: 63.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.219', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'AMMO4': '0.197', 'weapon2': '0.372', 'weapon4': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:23,940][52647] DAMAGECOUNT value on done: 199379.0 [2024-08-06 01:20:23,940][52647] Sum rewards: 52.518, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.440', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.144', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.354', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '2.562', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:24,243][52663] DAMAGECOUNT value on done: 187774.0 [2024-08-06 01:20:24,243][52663] Sum rewards: 54.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.146', 'WEAPON4': '0.350', 'weapon2': '0.568', 'weapon4': '0.662', 'WEAPON3': '0.950', 'weapon3': '2.466', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '43.500'} [2024-08-06 01:20:24,622][52670] DAMAGECOUNT value on done: 189756.0 [2024-08-06 01:20:24,622][52670] Sum rewards: 61.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.935', 'ARMOR': '0.004', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.210', 'weapon2': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:24,930][52650] Updated weights for policy 0, policy_version 29601 (0.0019) [2024-08-06 01:20:25,387][52664] DAMAGECOUNT value on done: 197573.0 [2024-08-06 01:20:25,387][52664] Sum rewards: 70.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.985', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.046', 'AMMO3': '0.183', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:25,593][52820] DAMAGECOUNT value on done: 175155.0 [2024-08-06 01:20:25,595][52820] Sum rewards: 69.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.100', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.044', 'AMMO4': '0.045', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:26,109][52811] DAMAGECOUNT value on done: 183983.0 [2024-08-06 01:20:26,112][52811] Sum rewards: 52.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.145', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.048', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.320', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '45.000'} [2024-08-06 01:20:26,449][52666] DAMAGECOUNT value on done: 187213.0 [2024-08-06 01:20:26,449][52666] Sum rewards: 52.053, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.406', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.528', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '44.000'} [2024-08-06 01:20:26,508][52671] DAMAGECOUNT value on done: 192845.0 [2024-08-06 01:20:26,511][52671] Sum rewards: 57.457, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.162', 'AMMO4': '0.184', 'weapon5': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '2.626', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:26,615][52649] DAMAGECOUNT value on done: 183650.0 [2024-08-06 01:20:26,616][52649] Sum rewards: 55.891, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.706', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.289', 'weapon2': '0.414', 'WEAPON4': '0.500', 'weapon4': '0.642', 'WEAPON3': '1.650', 'weapon3': '2.408', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:26,748][52647] DAMAGECOUNT value on done: 199473.0 [2024-08-06 01:20:26,748][52647] Sum rewards: 52.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.013', 'weapon5': '0.016', 'ARMOR': '0.024', 'AMMO2': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.272', 'weapon4': '0.432', 'weapon2': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.786', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '44.000'} [2024-08-06 01:20:26,916][52803] DAMAGECOUNT value on done: 182532.0 [2024-08-06 01:20:26,916][52803] Sum rewards: 65.506, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.048', 'weapon4': '0.084', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:27,087][52663] DAMAGECOUNT value on done: 195521.0 [2024-08-06 01:20:27,088][52663] Sum rewards: 50.024, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.110', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon5': '0.068', 'AMMO3': '0.236', 'AMMO4': '0.307', 'WEAPON5': '0.350', 'weapon2': '0.362', 'weapon4': '0.420', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '46.000'} [2024-08-06 01:20:27,310][52670] DAMAGECOUNT value on done: 190663.0 [2024-08-06 01:20:27,310][52670] Sum rewards: 53.373, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.117', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon4': '0.334', 'WEAPON3': '1.600', 'HITCOUNT': '2.820', 'weapon3': '3.284', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 242532352. Throughput: 0: 4387.1. Samples: 60643450. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:20:27,807][52567] Avg episode reward: [(0, '59.786')] [2024-08-06 01:20:27,816][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029607_242540544.pth... [2024-08-06 01:20:27,958][52664] DAMAGECOUNT value on done: 197576.0 [2024-08-06 01:20:27,958][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029093_238329856.pth [2024-08-06 01:20:27,960][52664] Sum rewards: 52.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.702', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.158', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.886', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '46.000'} [2024-08-06 01:20:28,737][52820] DAMAGECOUNT value on done: 178213.0 [2024-08-06 01:20:28,737][52820] Sum rewards: 58.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.063', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon5': '0.248', 'weapon2': '0.822', 'WEAPON3': '1.200', 'weapon3': '2.558', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '48.500'} [2024-08-06 01:20:29,090][52647] DAMAGECOUNT value on done: 201031.0 [2024-08-06 01:20:29,091][52647] Sum rewards: 67.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:29,115][52666] DAMAGECOUNT value on done: 187465.0 [2024-08-06 01:20:29,115][52666] Sum rewards: 57.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.054', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.222', 'weapon4': '0.442', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:29,421][52650] Updated weights for policy 0, policy_version 29611 (0.0024) [2024-08-06 01:20:29,578][52811] DAMAGECOUNT value on done: 179391.0 [2024-08-06 01:20:29,578][52811] Sum rewards: 58.661, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.189', 'weapon2': '0.724', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:29,686][52671] DAMAGECOUNT value on done: 190301.0 [2024-08-06 01:20:29,686][52671] Sum rewards: 66.368, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.305', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.312', 'weapon4': '0.422', 'WEAPON3': '0.900', 'weapon3': '3.054', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:29,772][52649] DAMAGECOUNT value on done: 186692.0 [2024-08-06 01:20:29,773][52649] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.966', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.254', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:29,792][52659] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:20:30,032][52663] DAMAGECOUNT value on done: 190523.0 [2024-08-06 01:20:30,033][52663] Sum rewards: 65.596, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.926', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.156', 'AMMO3': '0.172', 'AMMO4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.354', 'weapon4': '0.596', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.606', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:30,136][52659] DAMAGECOUNT value on done: 191110.0 [2024-08-06 01:20:30,138][52659] Sum rewards: 62.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.219', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon4': '0.198', 'AMMO3': '0.234', 'weapon5': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:30,260][52803] DAMAGECOUNT value on done: 179022.0 [2024-08-06 01:20:30,263][52803] Sum rewards: 70.369, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.202', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon5': '0.192', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.508', 'weapon2': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:30,387][52664] DAMAGECOUNT value on done: 196872.0 [2024-08-06 01:20:30,389][52664] Sum rewards: 54.408, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.322', 'AMMO5': '0.003', 'ARMOR': '0.012', 'weapon5': '0.046', 'AMMO2': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'AMMO4': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.550', 'weapon4': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.780', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:30,501][52670] DAMAGECOUNT value on done: 189449.0 [2024-08-06 01:20:30,502][52670] Sum rewards: 68.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.765', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.182', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.618', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:31,685][52647] DAMAGECOUNT value on done: 199297.0 [2024-08-06 01:20:31,687][52647] Sum rewards: 59.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.320', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.160', 'AMMO3': '0.198', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.384', 'weapon2': '0.470', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.714', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:31,942][52820] DAMAGECOUNT value on done: 177863.0 [2024-08-06 01:20:31,944][52820] Sum rewards: 69.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:32,388][52666] DAMAGECOUNT value on done: 191340.0 [2024-08-06 01:20:32,389][52666] Sum rewards: 62.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon4': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:32,535][52663] DAMAGECOUNT value on done: 190731.0 [2024-08-06 01:20:32,536][52663] Sum rewards: 66.883, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.215', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.145', 'weapon5': '0.154', 'AMMO4': '0.199', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.842', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:32,555][52811] DAMAGECOUNT value on done: 177513.0 [2024-08-06 01:20:32,555][52811] Sum rewards: 66.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.065', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.074', 'AMMO4': '0.157', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:32,590][52671] DAMAGECOUNT value on done: 199940.0 [2024-08-06 01:20:32,592][52671] Sum rewards: 58.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'weapon4': '0.010', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 242622464. Throughput: 0: 4379.6. Samples: 60655970. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:20:32,794][52567] Avg episode reward: [(0, '60.404')] [2024-08-06 01:20:33,024][52649] DAMAGECOUNT value on done: 188309.0 [2024-08-06 01:20:33,026][52649] Sum rewards: 45.920, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.984', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.176', 'weapon5': '0.212', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.500', 'weapon4': '0.720', 'WEAPON3': '1.000', 'weapon3': '2.460', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '40.000'} [2024-08-06 01:20:33,048][52664] DAMAGECOUNT value on done: 196206.0 [2024-08-06 01:20:33,051][52664] Sum rewards: 61.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.169', 'AMMO4': '0.202', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.756', 'WEAPON3': '1.100', 'weapon3': '2.648', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '50.500'} [2024-08-06 01:20:33,097][52659] DAMAGECOUNT value on done: 190438.0 [2024-08-06 01:20:33,100][52659] Sum rewards: 55.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.910', 'AMMO2': '0.023', 'weapon4': '0.096', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'weapon2': '0.658', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:33,331][52803] DAMAGECOUNT value on done: 181466.0 [2024-08-06 01:20:33,331][52803] Sum rewards: 67.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.164', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon4': '0.142', 'weapon2': '0.228', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:33,511][52670] DAMAGECOUNT value on done: 192144.0 [2024-08-06 01:20:33,512][52670] Sum rewards: 58.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.169', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:34,002][52647] DAMAGECOUNT value on done: 196096.0 [2024-08-06 01:20:34,002][52647] Sum rewards: 49.216, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.280', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '40.500'} [2024-08-06 01:20:34,383][52650] Updated weights for policy 0, policy_version 29621 (0.0016) [2024-08-06 01:20:34,947][52820] DAMAGECOUNT value on done: 180343.0 [2024-08-06 01:20:34,955][52820] Sum rewards: 65.520, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.148', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.092', 'AMMO4': '0.096', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:35,235][52666] DAMAGECOUNT value on done: 186963.0 [2024-08-06 01:20:35,235][52666] Sum rewards: 61.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.731', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.380', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.212', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:35,444][52671] DAMAGECOUNT value on done: 191669.0 [2024-08-06 01:20:35,444][52671] Sum rewards: 59.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.348', 'weapon4': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.882', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '48.500'} [2024-08-06 01:20:35,576][52664] DAMAGECOUNT value on done: 201539.0 [2024-08-06 01:20:35,577][52664] Sum rewards: 65.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.186', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:35,617][52811] DAMAGECOUNT value on done: 178870.0 [2024-08-06 01:20:35,621][52811] Sum rewards: 47.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.232', 'weapon4': '0.804', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.716', 'DAMAGECOUNT': '12.429', 'FRAGCOUNT': '41.000'} [2024-08-06 01:20:35,777][52663] DAMAGECOUNT value on done: 188719.0 [2024-08-06 01:20:35,778][52663] Sum rewards: 62.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.021', 'weapon4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.318', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:35,888][52659] DAMAGECOUNT value on done: 191148.0 [2024-08-06 01:20:35,888][52659] Sum rewards: 54.869, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.060', 'AMMO5': '0.008', 'ARMOR': '0.008', 'weapon5': '0.024', 'AMMO2': '0.048', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.239', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'weapon2': '0.796', 'WEAPON3': '1.450', 'weapon3': '2.772', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:35,906][52649] DAMAGECOUNT value on done: 183198.0 [2024-08-06 01:20:35,909][52649] Sum rewards: 62.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.132', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.168', 'weapon4': '0.172', 'AMMO4': '0.216', 'AMMO3': '0.226', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.096', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:36,138][52670] DAMAGECOUNT value on done: 180794.0 [2024-08-06 01:20:36,138][52670] Sum rewards: 61.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.236', 'AMMO5': '0.003', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.178', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.540', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:36,351][52803] DAMAGECOUNT value on done: 178542.0 [2024-08-06 01:20:36,352][52803] Sum rewards: 68.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.375', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.190', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:36,834][52647] DAMAGECOUNT value on done: 199021.0 [2024-08-06 01:20:36,835][52647] Sum rewards: 66.279, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.090', 'weapon2': '0.210', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'weapon4': '0.678', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:37,708][52666] DAMAGECOUNT value on done: 187300.0 [2024-08-06 01:20:37,711][52666] Sum rewards: 52.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.303', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.530', 'WEAPON3': '1.600', 'weapon3': '2.836', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:37,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 242720768. Throughput: 0: 4380.7. Samples: 60682370. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:20:37,794][52567] Avg episode reward: [(0, '60.094')] [2024-08-06 01:20:38,022][52820] DAMAGECOUNT value on done: 175599.0 [2024-08-06 01:20:38,023][52820] Sum rewards: 58.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.451', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.130', 'AMMO3': '0.158', 'AMMO4': '0.284', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.796', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:38,231][52664] DAMAGECOUNT value on done: 202770.0 [2024-08-06 01:20:38,233][52664] Sum rewards: 61.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.330', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.174', 'AMMO4': '0.175', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:38,247][52671] DAMAGECOUNT value on done: 185543.0 [2024-08-06 01:20:38,247][52671] Sum rewards: 57.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.207', 'weapon5': '0.248', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.512', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:38,548][52659] DAMAGECOUNT value on done: 191524.0 [2024-08-06 01:20:38,549][52659] Sum rewards: 61.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.679', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.198', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:38,700][52811] DAMAGECOUNT value on done: 177769.0 [2024-08-06 01:20:38,703][52811] Sum rewards: 53.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.078', 'AMMO3': '0.189', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.450', 'weapon2': '0.820', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.698', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '45.000'} [2024-08-06 01:20:38,752][52663] DAMAGECOUNT value on done: 192283.0 [2024-08-06 01:20:38,753][52663] Sum rewards: 56.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.026', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.358', 'weapon4': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:38,804][52650] Updated weights for policy 0, policy_version 29631 (0.0015) [2024-08-06 01:20:38,924][52670] DAMAGECOUNT value on done: 191617.0 [2024-08-06 01:20:38,926][52670] Sum rewards: 55.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.806', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon2': '0.198', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.216', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:39,024][52649] DAMAGECOUNT value on done: 188602.0 [2024-08-06 01:20:39,025][52649] Sum rewards: 58.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.760', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.287', 'weapon2': '0.388', 'WEAPON3': '1.800', 'weapon3': '3.246', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:39,385][52647] DAMAGECOUNT value on done: 193760.0 [2024-08-06 01:20:39,388][52647] Sum rewards: 57.789, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.950', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.122', 'WEAPON4': '0.150', 'weapon2': '0.328', 'AMMO3': '0.357', 'WEAPON3': '2.050', 'weapon3': '3.238', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:39,494][52803] DAMAGECOUNT value on done: 176034.0 [2024-08-06 01:20:39,496][52803] Sum rewards: 57.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.158', 'AMMO4': '0.212', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.322', 'weapon4': '0.324', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '2.928', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:39,689][52665] DAMAGECOUNT value on done: 187750.0 [2024-08-06 01:20:39,691][52665] Sum rewards: 64.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:40,876][52671] DAMAGECOUNT value on done: 195462.0 [2024-08-06 01:20:40,878][52671] Sum rewards: 56.557, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.968', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'weapon2': '0.270', 'AMMO3': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.700', 'weapon3': '2.956', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:40,941][52664] DAMAGECOUNT value on done: 192273.0 [2024-08-06 01:20:40,942][52664] Sum rewards: 62.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.855', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.448', 'weapon4': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:41,013][52663] DAMAGECOUNT value on done: 192429.0 [2024-08-06 01:20:41,013][52663] Sum rewards: 78.167, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.116', 'WEAPON4': '0.400', 'weapon2': '0.580', 'WEAPON3': '0.750', 'weapon4': '0.750', 'weapon3': '2.464', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '63.000'} [2024-08-06 01:20:41,303][52820] DAMAGECOUNT value on done: 178652.0 [2024-08-06 01:20:41,303][52820] Sum rewards: 72.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.078', 'weapon5': '0.104', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.390', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '62.000'} [2024-08-06 01:20:41,313][52659] DAMAGECOUNT value on done: 190424.0 [2024-08-06 01:20:41,315][52659] Sum rewards: 60.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.448', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon4': '0.212', 'AMMO3': '0.223', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:41,751][52649] DAMAGECOUNT value on done: 187042.0 [2024-08-06 01:20:41,752][52649] Sum rewards: 65.976, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.318', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.232', 'weapon2': '0.498', 'WEAPON3': '1.000', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:41,803][52811] DAMAGECOUNT value on done: 181749.0 [2024-08-06 01:20:41,803][52811] Sum rewards: 62.636, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.276', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.254', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:42,151][52670] DAMAGECOUNT value on done: 193850.0 [2024-08-06 01:20:42,151][52670] Sum rewards: 59.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.051', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.180', 'AMMO4': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.422', 'weapon4': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.504', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '48.000'} [2024-08-06 01:20:42,274][52647] DAMAGECOUNT value on done: 201261.0 [2024-08-06 01:20:42,274][52647] Sum rewards: 52.497, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.652', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.206', 'weapon4': '0.212', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '46.500'} [2024-08-06 01:20:42,549][52803] DAMAGECOUNT value on done: 182882.0 [2024-08-06 01:20:42,549][52803] Sum rewards: 54.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.692', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.122', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.572', 'weapon2': '0.694', 'WEAPON3': '0.950', 'weapon3': '2.150', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '46.000'} [2024-08-06 01:20:42,582][52665] DAMAGECOUNT value on done: 193594.0 [2024-08-06 01:20:42,585][52665] Sum rewards: 73.260, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon4': '0.086', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.496', 'WEAPON3': '1.000', 'weapon3': '3.192', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 242802688. Throughput: 0: 4379.1. Samples: 60708770. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:20:42,794][52567] Avg episode reward: [(0, '59.759')] [2024-08-06 01:20:43,580][52650] Updated weights for policy 0, policy_version 29641 (0.0041) [2024-08-06 01:20:43,649][52671] DAMAGECOUNT value on done: 195346.0 [2024-08-06 01:20:43,650][52671] Sum rewards: 57.312, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.958', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.150', 'AMMO4': '0.217', 'weapon4': '0.262', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.782', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:43,763][52664] DAMAGECOUNT value on done: 207099.0 [2024-08-06 01:20:43,763][52664] Sum rewards: 71.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.269', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon4': '0.202', 'AMMO3': '0.218', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:43,917][52663] DAMAGECOUNT value on done: 190580.0 [2024-08-06 01:20:43,917][52663] Sum rewards: 59.614, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.964', 'ARMOR': '0.005', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.138', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'weapon4': '0.334', 'weapon2': '0.344', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:44,222][52659] DAMAGECOUNT value on done: 189312.0 [2024-08-06 01:20:44,223][52659] Sum rewards: 70.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.060', 'AMMO3': '0.233', 'weapon2': '0.298', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.412', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '61.000'} [2024-08-06 01:20:44,456][52820] DAMAGECOUNT value on done: 179158.0 [2024-08-06 01:20:44,456][52820] Sum rewards: 50.084, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.276', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.049', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.242', 'AMMO4': '0.244', 'weapon4': '0.336', 'weapon2': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.686', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:44,803][52811] DAMAGECOUNT value on done: 179194.0 [2024-08-06 01:20:44,804][52811] Sum rewards: 57.845, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.374', 'AMMO5': '0.003', 'ARMOR': '0.008', 'WEAPON5': '0.050', 'AMMO2': '0.058', 'weapon5': '0.072', 'AMMO3': '0.237', 'AMMO4': '0.290', 'WEAPON4': '0.450', 'weapon2': '0.510', 'weapon4': '1.170', 'WEAPON3': '1.400', 'weapon3': '1.990', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:44,863][52649] DAMAGECOUNT value on done: 180540.0 [2024-08-06 01:20:44,864][52649] Sum rewards: 56.962, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.201', 'AMMO5': '0.007', 'AMMO2': '0.057', 'weapon5': '0.144', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO4': '0.285', 'WEAPON4': '0.400', 'weapon4': '0.520', 'WEAPON3': '1.000', 'weapon3': '2.816', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:44,981][52670] DAMAGECOUNT value on done: 188639.0 [2024-08-06 01:20:44,983][52670] Sum rewards: 61.731, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.017', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.582', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:45,541][52665] DAMAGECOUNT value on done: 189061.0 [2024-08-06 01:20:45,541][52665] Sum rewards: 68.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.060', 'WEAPON4': '0.100', 'weapon2': '0.236', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.578', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:45,606][52803] DAMAGECOUNT value on done: 177477.0 [2024-08-06 01:20:45,606][52803] Sum rewards: 57.614, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.560', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.118', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.744', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:46,160][52664] DAMAGECOUNT value on done: 201687.0 [2024-08-06 01:20:46,161][52664] Sum rewards: 57.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.096', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.148', 'weapon5': '0.182', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.118', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:46,644][52671] DAMAGECOUNT value on done: 194240.0 [2024-08-06 01:20:46,646][52671] Sum rewards: 53.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon5': '0.212', 'AMMO3': '0.213', 'weapon4': '0.292', 'AMMO4': '0.298', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.768', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '46.000'} [2024-08-06 01:20:46,824][52663] DAMAGECOUNT value on done: 184441.0 [2024-08-06 01:20:46,827][52663] Sum rewards: 57.572, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.599', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.174', 'AMMO3': '0.179', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.836', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '49.500'} [2024-08-06 01:20:47,339][52659] DAMAGECOUNT value on done: 190211.0 [2024-08-06 01:20:47,341][52659] Sum rewards: 62.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.384', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:47,598][52820] DAMAGECOUNT value on done: 178377.0 [2024-08-06 01:20:47,599][52820] Sum rewards: 73.206, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.224', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '3.174', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 242892800. Throughput: 0: 4381.6. Samples: 60722060. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:20:47,794][52567] Avg episode reward: [(0, '60.057')] [2024-08-06 01:20:47,844][52811] DAMAGECOUNT value on done: 178841.0 [2024-08-06 01:20:47,845][52811] Sum rewards: 64.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.690', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:48,004][52649] DAMAGECOUNT value on done: 186820.0 [2024-08-06 01:20:48,004][52649] Sum rewards: 58.384, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.290', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'weapon2': '0.272', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.700', 'weapon3': '3.042', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:48,034][52670] DAMAGECOUNT value on done: 188720.0 [2024-08-06 01:20:48,037][52670] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.528', 'ARMOR': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon2': '0.446', 'weapon4': '0.522', 'WEAPON3': '0.900', 'weapon3': '2.832', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:48,339][52650] Updated weights for policy 0, policy_version 29651 (0.0041) [2024-08-06 01:20:48,518][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:20:48,524][52664] DAMAGECOUNT value on done: 199909.0 [2024-08-06 01:20:48,526][52664] Sum rewards: 53.685, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.247', 'weapon4': '0.260', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.070', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:48,774][52665] DAMAGECOUNT value on done: 184288.0 [2024-08-06 01:20:48,775][52665] Sum rewards: 67.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.955', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon2': '0.192', 'AMMO3': '0.196', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.662', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:48,947][52803] DAMAGECOUNT value on done: 183279.0 [2024-08-06 01:20:48,947][52803] Sum rewards: 74.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.770', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.235', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '63.000'} [2024-08-06 01:20:49,204][52663] DAMAGECOUNT value on done: 182844.0 [2024-08-06 01:20:49,205][52663] Sum rewards: 78.535, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.064', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '63.000'} [2024-08-06 01:20:49,539][52671] DAMAGECOUNT value on done: 195075.0 [2024-08-06 01:20:49,539][52671] Sum rewards: 72.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.187', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '59.000'} [2024-08-06 01:20:50,070][52659] DAMAGECOUNT value on done: 185901.0 [2024-08-06 01:20:50,072][52659] Sum rewards: 43.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.659', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '3.038', 'DAMAGECOUNT': '12.426', 'FRAGCOUNT': '38.500'} [2024-08-06 01:20:50,575][52820] DAMAGECOUNT value on done: 175550.0 [2024-08-06 01:20:50,575][52820] Sum rewards: 42.293, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.002', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.122', 'weapon4': '0.164', 'AMMO4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.502', 'WEAPON3': '1.550', 'HITCOUNT': '2.660', 'weapon3': '2.930', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '40.500'} [2024-08-06 01:20:50,910][52811] DAMAGECOUNT value on done: 177501.0 [2024-08-06 01:20:50,911][52811] Sum rewards: 54.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.686', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '45.000'} [2024-08-06 01:20:51,013][52664] DAMAGECOUNT value on done: 196853.0 [2024-08-06 01:20:51,016][52664] Sum rewards: 62.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.094', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.198', 'weapon2': '0.308', 'WEAPON4': '0.350', 'weapon4': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:51,151][52649] DAMAGECOUNT value on done: 185007.0 [2024-08-06 01:20:51,151][52649] Sum rewards: 59.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.117', 'AMMO3': '0.209', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '51.000'} [2024-08-06 01:20:51,823][52665] DAMAGECOUNT value on done: 184619.0 [2024-08-06 01:20:51,825][52665] Sum rewards: 58.506, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.856', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon7': '0.046', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.161', 'weapon2': '0.190', 'WEAPON7': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:51,935][52803] DAMAGECOUNT value on done: 173592.0 [2024-08-06 01:20:51,935][52803] Sum rewards: 69.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.933', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.140', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'weapon4': '0.358', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '58.000'} [2024-08-06 01:20:52,163][52663] DAMAGECOUNT value on done: 191487.0 [2024-08-06 01:20:52,164][52663] Sum rewards: 55.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.868', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.148', 'AMMO4': '0.220', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '47.000'} [2024-08-06 01:20:52,186][52671] DAMAGECOUNT value on done: 190631.0 [2024-08-06 01:20:52,188][52671] Sum rewards: 51.606, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.254', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '44.000'} [2024-08-06 01:20:52,614][52659] DAMAGECOUNT value on done: 193849.0 [2024-08-06 01:20:52,614][52659] Sum rewards: 66.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.084', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.336', 'weapon4': '0.362', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 242974720. Throughput: 0: 4389.8. Samples: 60748670. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:20:52,794][52567] Avg episode reward: [(0, '60.580')] [2024-08-06 01:20:53,081][52650] Updated weights for policy 0, policy_version 29661 (0.0011) [2024-08-06 01:20:53,505][52664] DAMAGECOUNT value on done: 194414.0 [2024-08-06 01:20:53,506][52664] Sum rewards: 59.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.009', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '50.000'} [2024-08-06 01:20:53,698][52820] DAMAGECOUNT value on done: 181610.0 [2024-08-06 01:20:53,707][52820] Sum rewards: 65.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.004', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.226', 'AMMO3': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '55.000'} [2024-08-06 01:20:53,951][52811] DAMAGECOUNT value on done: 180954.0 [2024-08-06 01:20:53,951][52811] Sum rewards: 59.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.044', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.239', 'weapon4': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:54,217][52649] DAMAGECOUNT value on done: 192809.0 [2024-08-06 01:20:54,218][52649] Sum rewards: 56.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.164', 'AMMO3': '0.235', 'AMMO4': '0.264', 'weapon4': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:54,822][52665] DAMAGECOUNT value on done: 188786.0 [2024-08-06 01:20:54,822][52665] Sum rewards: 70.172, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.098', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.150', 'weapon4': '0.170', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'weapon2': '0.358', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '63.000'} [2024-08-06 01:20:55,368][52663] DAMAGECOUNT value on done: 192364.0 [2024-08-06 01:20:55,368][52663] Sum rewards: 64.153, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon7': '0.046', 'weapon5': '0.076', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.400', 'weapon4': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '56.000'} [2024-08-06 01:20:55,387][52659] DAMAGECOUNT value on done: 196518.0 [2024-08-06 01:20:55,387][52659] Sum rewards: 70.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.058', 'AMMO4': '0.127', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:56,266][52664] DAMAGECOUNT value on done: 198573.0 [2024-08-06 01:20:56,266][52664] Sum rewards: 53.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.746', 'AMMO5': '0.005', 'AMMO2': '0.007', 'ARMOR': '0.024', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.052', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '45.000'} [2024-08-06 01:20:56,868][52820] DAMAGECOUNT value on done: 183948.0 [2024-08-06 01:20:56,875][52820] Sum rewards: 62.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.674', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.172', 'AMMO3': '0.174', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.504', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '52.000'} [2024-08-06 01:20:57,027][52811] DAMAGECOUNT value on done: 177497.0 [2024-08-06 01:20:57,030][52811] Sum rewards: 62.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.847', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.174', 'weapon5': '0.198', 'AMMO4': '0.249', 'weapon4': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '54.000'} [2024-08-06 01:20:57,179][52649] DAMAGECOUNT value on done: 190142.0 [2024-08-06 01:20:57,181][52649] Sum rewards: 61.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.233', 'weapon2': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.486', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '53.000'} [2024-08-06 01:20:57,548][52650] Updated weights for policy 0, policy_version 29671 (0.0020) [2024-08-06 01:20:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 243073024. Throughput: 0: 4387.6. Samples: 60774970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:20:57,794][52567] Avg episode reward: [(0, '61.253')] [2024-08-06 01:20:57,913][52665] DAMAGECOUNT value on done: 190390.0 [2024-08-06 01:20:57,913][52665] Sum rewards: 73.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.222', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.150', 'weapon5': '0.178', 'AMMO4': '0.208', 'weapon4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.734', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '60.000'} [2024-08-06 01:20:58,276][52663] DAMAGECOUNT value on done: 193598.0 [2024-08-06 01:20:58,277][52663] Sum rewards: 66.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.467', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.142', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '57.000'} [2024-08-06 01:20:58,413][52659] DAMAGECOUNT value on done: 190109.0 [2024-08-06 01:20:58,413][52659] Sum rewards: 61.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.848', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.352', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '49.000'} [2024-08-06 01:20:59,349][52664] DAMAGECOUNT value on done: 200567.0 [2024-08-06 01:20:59,349][52664] Sum rewards: 66.516, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.153', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.094', 'weapon5': '0.116', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '57.000'} [2024-08-06 01:21:00,031][52811] DAMAGECOUNT value on done: 181673.0 [2024-08-06 01:21:00,032][52811] Sum rewards: 57.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.405', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.186', 'AMMO3': '0.207', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON4': '0.500', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.468', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '50.000'} [2024-08-06 01:21:00,069][52820] DAMAGECOUNT value on done: 175321.0 [2024-08-06 01:21:00,070][52820] Sum rewards: 68.555, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.072', 'AMMO4': '0.137', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.906', 'WEAPON3': '1.000', 'weapon3': '2.486', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '55.000'} [2024-08-06 01:21:00,447][52649] DAMAGECOUNT value on done: 194117.0 [2024-08-06 01:21:00,449][52649] Sum rewards: 55.468, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.011', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO4': '0.204', 'weapon4': '0.230', 'weapon5': '0.236', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '2.832', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '49.000'} [2024-08-06 01:21:00,757][52665] DAMAGECOUNT value on done: 191313.0 [2024-08-06 01:21:00,758][52665] Sum rewards: 70.857, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.280', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.083', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.274', 'weapon2': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.346', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '63.000'} [2024-08-06 01:21:01,164][52663] DAMAGECOUNT value on done: 195149.0 [2024-08-06 01:21:01,165][52663] Sum rewards: 62.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.482', 'AMMO2': '0.044', 'weapon4': '0.170', 'AMMO3': '0.196', 'AMMO4': '0.221', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '53.000'} [2024-08-06 01:21:01,201][52659] DAMAGECOUNT value on done: 187572.0 [2024-08-06 01:21:01,201][52659] Sum rewards: 57.574, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.058', 'AMMO3': '0.250', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.650', 'weapon4': '0.736', 'WEAPON3': '1.500', 'weapon3': '2.534', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '51.000'} [2024-08-06 01:21:02,395][52650] Updated weights for policy 0, policy_version 29681 (0.0011) [2024-08-06 01:21:02,505][52664] DAMAGECOUNT value on done: 195841.0 [2024-08-06 01:21:02,508][52664] Sum rewards: 56.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.481', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.106', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.672', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '48.000'} [2024-08-06 01:21:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 243154944. Throughput: 0: 4384.2. Samples: 60788060. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:21:02,794][52567] Avg episode reward: [(0, '61.265')] [2024-08-06 01:21:03,375][52665] DAMAGECOUNT value on done: 194285.0 [2024-08-06 01:21:03,376][52665] Sum rewards: 76.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.165', 'weapon2': '0.332', 'WEAPON3': '1.050', 'HITCOUNT': '3.520', 'weapon3': '3.532', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '61.000'} [2024-08-06 01:21:03,927][52659] DAMAGECOUNT value on done: 184363.0 [2024-08-06 01:21:03,928][52659] Sum rewards: 64.465, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.072', 'weapon4': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.452', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.224', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '54.000'} [2024-08-06 01:21:03,983][52663] DAMAGECOUNT value on done: 193299.0 [2024-08-06 01:21:03,983][52663] Sum rewards: 51.440, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.472', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.158', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.288', 'weapon2': '0.288', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '2.902', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '49.000'} [2024-08-06 01:21:05,090][52664] DAMAGECOUNT value on done: 199403.0 [2024-08-06 01:21:05,090][52664] Sum rewards: 58.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.468', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.109', 'weapon5': '0.152', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.274', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '52.000'} [2024-08-06 01:21:06,389][52659] DAMAGECOUNT value on done: 191279.0 [2024-08-06 01:21:06,391][52659] Sum rewards: 73.187, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.114', 'HEALTH': '0.117', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '61.000'} [2024-08-06 01:21:06,474][52665] DAMAGECOUNT value on done: 190425.0 [2024-08-06 01:21:06,474][52665] Sum rewards: 54.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.058', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.170', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '45.000'} [2024-08-06 01:21:06,714][52663] DAMAGECOUNT value on done: 188529.0 [2024-08-06 01:21:06,714][52663] Sum rewards: 73.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.055', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.928', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '60.000'} [2024-08-06 01:21:06,978][52650] Updated weights for policy 0, policy_version 29691 (0.0024) [2024-08-06 01:21:07,685][52664] DAMAGECOUNT value on done: 201910.0 [2024-08-06 01:21:07,685][52664] Sum rewards: 59.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.413', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.048', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.239', 'weapon4': '0.270', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '50.000'} [2024-08-06 01:21:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 243236864. Throughput: 0: 4393.8. Samples: 60814840. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:21:07,794][52567] Avg episode reward: [(0, '61.515')] [2024-08-06 01:21:09,502][52659] DAMAGECOUNT value on done: 192938.0 [2024-08-06 01:21:09,504][52659] Sum rewards: 69.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.817', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.076', 'AMMO4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.376', 'WEAPON4': '0.500', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '58.000'} [2024-08-06 01:21:09,512][52665] DAMAGECOUNT value on done: 194069.0 [2024-08-06 01:21:09,513][52665] Sum rewards: 54.486, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.223', 'AMMO3': '0.278', 'weapon4': '0.384', 'weapon2': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.770', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '50.000'} [2024-08-06 01:21:10,513][52664] DAMAGECOUNT value on done: 196514.0 [2024-08-06 01:21:10,514][52664] Sum rewards: 78.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.864', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.428', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '66.000'} [2024-08-06 01:21:11,277][52650] Updated weights for policy 0, policy_version 29701 (0.0022) [2024-08-06 01:21:12,265][52665] DAMAGECOUNT value on done: 193729.0 [2024-08-06 01:21:12,267][52665] Sum rewards: 66.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.893', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.212', 'weapon2': '0.620', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '56.000'} [2024-08-06 01:21:12,321][52659] DAMAGECOUNT value on done: 195883.0 [2024-08-06 01:21:12,323][52659] Sum rewards: 68.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.752', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '58.000'} [2024-08-06 01:21:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.2). Total num frames: 243335168. Throughput: 0: 4398.4. Samples: 60841380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:21:12,794][52567] Avg episode reward: [(0, '61.868')] [2024-08-06 01:21:12,795][52614] Saving new best policy, reward=61.868! [2024-08-06 01:21:13,396][52664] DAMAGECOUNT value on done: 198796.0 [2024-08-06 01:21:13,396][52664] Sum rewards: 71.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.785', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.354', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '58.000'} [2024-08-06 01:21:14,889][52659] DAMAGECOUNT value on done: 194910.0 [2024-08-06 01:21:14,892][52659] Sum rewards: 62.862, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.470', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.275', 'weapon4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '55.000'} [2024-08-06 01:21:15,038][52665] DAMAGECOUNT value on done: 190263.0 [2024-08-06 01:21:15,038][52665] Sum rewards: 59.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'weapon2': '0.608', 'weapon4': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.458', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '50.000'} [2024-08-06 01:21:16,440][52650] Updated weights for policy 0, policy_version 29711 (0.0011) [2024-08-06 01:21:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 243417088. Throughput: 0: 4405.3. Samples: 60854210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:21:17,794][52567] Avg episode reward: [(0, '62.079')] [2024-08-06 01:21:17,873][52614] Saving new best policy, reward=62.079! [2024-08-06 01:21:18,203][52659] DAMAGECOUNT value on done: 190754.0 [2024-08-06 01:21:18,205][52659] Sum rewards: 71.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.142', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.173', 'weapon2': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '59.000'} [2024-08-06 01:21:18,220][52665] DAMAGECOUNT value on done: 190192.0 [2024-08-06 01:21:18,220][52665] Sum rewards: 73.867, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.951', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon4': '0.182', 'AMMO3': '0.214', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '63.000'} [2024-08-06 01:21:20,652][52650] Updated weights for policy 0, policy_version 29721 (0.0024) [2024-08-06 01:21:21,100][52659] DAMAGECOUNT value on done: 196308.0 [2024-08-06 01:21:21,101][52659] Sum rewards: 69.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.877', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.282', 'weapon4': '0.292', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '61.000'} [2024-08-06 01:21:21,142][52665] DAMAGECOUNT value on done: 190276.0 [2024-08-06 01:21:21,145][52665] Sum rewards: 52.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.186', 'AMMO3': '0.187', 'weapon5': '0.196', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '44.000'} [2024-08-06 01:21:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 243507200. Throughput: 0: 4384.0. Samples: 60879650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:21:22,802][52567] Avg episode reward: [(0, '62.336')] [2024-08-06 01:21:22,805][52614] Saving new best policy, reward=62.336! [2024-08-06 01:21:24,088][52659] DAMAGECOUNT value on done: 196248.0 [2024-08-06 01:21:24,089][52659] Sum rewards: 47.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.828', 'AMMO5': '0.009', 'ARMOR': '0.020', 'AMMO2': '0.049', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.238', 'AMMO4': '0.244', 'WEAPON4': '0.450', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.576', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '41.500'} [2024-08-06 01:21:24,163][52665] DAMAGECOUNT value on done: 187634.0 [2024-08-06 01:21:24,164][52665] Sum rewards: 56.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon7': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.227', 'weapon2': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '48.000'} [2024-08-06 01:21:25,385][52794] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:21:25,983][52650] Updated weights for policy 0, policy_version 29731 (0.0017) [2024-08-06 01:21:26,785][52665] DAMAGECOUNT value on done: 188716.0 [2024-08-06 01:21:26,786][52665] Sum rewards: 48.492, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.110', 'weapon4': '0.176', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'AMMO3': '0.306', 'WEAPON3': '1.700', 'HITCOUNT': '2.820', 'weapon3': '3.084', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '46.000'} [2024-08-06 01:21:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 243597312. Throughput: 0: 4382.9. Samples: 60906000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:21:27,794][52567] Avg episode reward: [(0, '61.980')] [2024-08-06 01:21:30,016][52665] DAMAGECOUNT value on done: 185187.0 [2024-08-06 01:21:30,017][52665] Sum rewards: 61.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.067', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '55.000'} [2024-08-06 01:21:30,171][52650] Updated weights for policy 0, policy_version 29741 (0.0025) [2024-08-06 01:21:31,538][52668] DAMAGECOUNT value on done: 190373.0 [2024-08-06 01:21:31,538][52668] Sum rewards: 55.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.262', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.152', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON4': '0.450', 'weapon2': '0.706', 'WEAPON3': '1.250', 'weapon3': '2.564', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '48.000'} [2024-08-06 01:21:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 243679232. Throughput: 0: 4381.1. Samples: 60919210. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:21:32,794][52567] Avg episode reward: [(0, '61.949')] [2024-08-06 01:21:33,144][52665] DAMAGECOUNT value on done: 191168.0 [2024-08-06 01:21:33,146][52665] Sum rewards: 60.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.313', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.430', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.272', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '54.000'} [2024-08-06 01:21:34,631][52668] DAMAGECOUNT value on done: 197288.0 [2024-08-06 01:21:34,632][52668] Sum rewards: 69.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.068', 'weapon4': '0.138', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '57.000'} [2024-08-06 01:21:35,362][52650] Updated weights for policy 0, policy_version 29751 (0.0013) [2024-08-06 01:21:35,536][52665] DAMAGECOUNT value on done: 187772.0 [2024-08-06 01:21:35,536][52665] Sum rewards: 65.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.469', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.157', 'WEAPON4': '0.400', 'weapon2': '0.452', 'weapon4': '0.460', 'WEAPON3': '0.950', 'weapon3': '2.870', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '52.000'} [2024-08-06 01:21:37,684][52668] DAMAGECOUNT value on done: 194619.0 [2024-08-06 01:21:37,686][52668] Sum rewards: 63.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.049', 'weapon5': '0.186', 'AMMO3': '0.188', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.390', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '53.500'} [2024-08-06 01:21:37,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 243761152. Throughput: 0: 4371.5. Samples: 60945390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:21:37,795][52567] Avg episode reward: [(0, '62.238')] [2024-08-06 01:21:38,549][52662] DAMAGECOUNT value on done: 197683.0 [2024-08-06 01:21:38,550][52662] Sum rewards: 66.764, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.576', 'AMMO5': '0.003', 'AMMO2': '0.007', 'ARMOR': '0.012', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.259', 'weapon2': '0.628', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '59.000'} [2024-08-06 01:21:39,414][52650] Updated weights for policy 0, policy_version 29761 (0.0011) [2024-08-06 01:21:40,222][52668] DAMAGECOUNT value on done: 196111.0 [2024-08-06 01:21:40,230][52668] Sum rewards: 67.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'weapon5': '0.004', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.042', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2024-08-06 01:21:41,336][52662] DAMAGECOUNT value on done: 200932.0 [2024-08-06 01:21:41,340][52662] Sum rewards: 58.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.045', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.270', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'HITCOUNT': '3.260', 'weapon3': '3.382', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '51.000'} [2024-08-06 01:21:41,898][52803] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:21:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 243859456. Throughput: 0: 4384.0. Samples: 60972250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:21:42,794][52567] Avg episode reward: [(0, '62.444')] [2024-08-06 01:21:42,795][52614] Saving new best policy, reward=62.444! [2024-08-06 01:21:42,938][52668] DAMAGECOUNT value on done: 189408.0 [2024-08-06 01:21:42,938][52668] Sum rewards: 66.722, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.745', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.173', 'weapon5': '0.188', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '54.000'} [2024-08-06 01:21:44,280][52662] DAMAGECOUNT value on done: 198553.0 [2024-08-06 01:21:44,282][52662] Sum rewards: 62.172, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.010', 'HEALTH': '0.016', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.308', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '49.500'} [2024-08-06 01:21:44,373][52650] Updated weights for policy 0, policy_version 29771 (0.0019) [2024-08-06 01:21:45,807][52668] DAMAGECOUNT value on done: 192169.0 [2024-08-06 01:21:45,807][52668] Sum rewards: 57.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.369', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.236', 'weapon5': '0.278', 'weapon4': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.684', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '49.000'} [2024-08-06 01:21:46,143][52660] DAMAGECOUNT value on done: 191735.0 [2024-08-06 01:21:46,144][52660] Sum rewards: 62.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon4': '0.322', 'weapon2': '0.614', 'WEAPON3': '1.500', 'weapon3': '2.814', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '55.000'} [2024-08-06 01:21:47,457][52662] DAMAGECOUNT value on done: 189193.0 [2024-08-06 01:21:47,460][52662] Sum rewards: 65.089, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.946', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon4': '0.078', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '52.000'} [2024-08-06 01:21:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 243941376. Throughput: 0: 4376.4. Samples: 60985000. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:21:47,794][52567] Avg episode reward: [(0, '62.387')] [2024-08-06 01:21:48,452][52668] DAMAGECOUNT value on done: 191937.0 [2024-08-06 01:21:48,452][52668] Sum rewards: 45.453, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.232', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.048', 'weapon4': '0.136', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.460', 'weapon3': '3.260', 'DAMAGECOUNT': '12.132', 'FRAGCOUNT': '42.000'} [2024-08-06 01:21:48,754][52650] Updated weights for policy 0, policy_version 29781 (0.0015) [2024-08-06 01:21:48,924][52660] DAMAGECOUNT value on done: 189566.0 [2024-08-06 01:21:48,924][52660] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.362', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon2': '0.748', 'WEAPON3': '0.950', 'weapon3': '3.036', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '60.000'} [2024-08-06 01:21:49,933][52667] DAMAGECOUNT value on done: 192855.0 [2024-08-06 01:21:49,934][52667] Sum rewards: 64.407, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'HEALTH': '0.476', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '53.000'} [2024-08-06 01:21:50,656][52662] DAMAGECOUNT value on done: 197896.0 [2024-08-06 01:21:50,659][52662] Sum rewards: 63.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.258', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '55.500'} [2024-08-06 01:21:51,680][52668] DAMAGECOUNT value on done: 196077.0 [2024-08-06 01:21:51,681][52668] Sum rewards: 65.344, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.955', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.077', 'AMMO3': '0.146', 'weapon5': '0.152', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.356', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.580', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '51.000'} [2024-08-06 01:21:52,297][52667] DAMAGECOUNT value on done: 194084.0 [2024-08-06 01:21:52,297][52667] Sum rewards: 62.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.904', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'WEAPON4': '0.400', 'weapon4': '0.424', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.526', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2024-08-06 01:21:52,458][52660] DAMAGECOUNT value on done: 193180.0 [2024-08-06 01:21:52,460][52660] Sum rewards: 56.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'weapon2': '0.260', 'AMMO3': '0.279', 'weapon4': '0.374', 'WEAPON3': '1.600', 'weapon3': '3.032', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '50.000'} [2024-08-06 01:21:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 244031488. Throughput: 0: 4369.6. Samples: 61011470. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:21:52,794][52567] Avg episode reward: [(0, '62.444')] [2024-08-06 01:21:53,654][52650] Updated weights for policy 0, policy_version 29791 (0.0021) [2024-08-06 01:21:53,815][52662] DAMAGECOUNT value on done: 194811.0 [2024-08-06 01:21:53,815][52662] Sum rewards: 64.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.826', 'ARMOR': '0.004', 'AMMO5': '0.015', 'weapon4': '0.044', 'AMMO2': '0.061', 'weapon5': '0.098', 'AMMO3': '0.202', 'AMMO4': '0.303', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '55.500'} [2024-08-06 01:21:54,513][52668] DAMAGECOUNT value on done: 193522.0 [2024-08-06 01:21:54,515][52668] Sum rewards: 62.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon4': '0.062', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.214', 'AMMO3': '0.224', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.438', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '53.000'} [2024-08-06 01:21:55,072][52660] DAMAGECOUNT value on done: 195351.0 [2024-08-06 01:21:55,076][52660] Sum rewards: 61.670, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.356', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '53.000'} [2024-08-06 01:21:55,228][52667] DAMAGECOUNT value on done: 195321.0 [2024-08-06 01:21:55,228][52667] Sum rewards: 72.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.515', 'AMMO5': '0.008', 'weapon4': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON3': '1.200', 'HITCOUNT': '3.480', 'weapon3': '3.530', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '60.000'} [2024-08-06 01:21:56,897][52662] DAMAGECOUNT value on done: 198173.0 [2024-08-06 01:21:56,897][52662] Sum rewards: 68.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.581', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.098', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '56.000'} [2024-08-06 01:21:57,473][52668] DAMAGECOUNT value on done: 195325.0 [2024-08-06 01:21:57,475][52668] Sum rewards: 64.049, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.856', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.195', 'weapon2': '0.274', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '52.500'} [2024-08-06 01:21:57,725][52667] DAMAGECOUNT value on done: 190880.0 [2024-08-06 01:21:57,725][52667] Sum rewards: 60.021, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.270', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.202', 'AMMO3': '0.256', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '54.500'} [2024-08-06 01:21:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 244121600. Throughput: 0: 4366.2. Samples: 61037860. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:21:57,794][52567] Avg episode reward: [(0, '62.582')] [2024-08-06 01:21:57,797][52614] Saving new best policy, reward=62.582! [2024-08-06 01:21:58,121][52660] DAMAGECOUNT value on done: 191741.0 [2024-08-06 01:21:58,122][52660] Sum rewards: 47.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.725', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.286', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.764', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '43.000'} [2024-08-06 01:21:58,177][52650] Updated weights for policy 0, policy_version 29801 (0.0019) [2024-08-06 01:22:00,047][52662] DAMAGECOUNT value on done: 201714.0 [2024-08-06 01:22:00,049][52662] Sum rewards: 55.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.091', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.079', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:00,459][52667] DAMAGECOUNT value on done: 194863.0 [2024-08-06 01:22:00,462][52667] Sum rewards: 52.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.038', 'AMMO3': '0.140', 'AMMO4': '0.191', 'WEAPON4': '0.500', 'weapon2': '0.542', 'weapon4': '0.744', 'WEAPON3': '0.800', 'weapon3': '2.330', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '45.000'} [2024-08-06 01:22:00,987][52668] DAMAGECOUNT value on done: 194656.0 [2024-08-06 01:22:00,990][52668] Sum rewards: 69.542, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO2': '0.052', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.262', 'weapon4': '0.310', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '60.000'} [2024-08-06 01:22:01,563][52660] DAMAGECOUNT value on done: 191648.0 [2024-08-06 01:22:01,563][52660] Sum rewards: 73.347, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.484', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon4': '0.198', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '60.000'} [2024-08-06 01:22:01,810][52794] DAMAGECOUNT value on done: 196862.0 [2024-08-06 01:22:01,811][52794] Sum rewards: 48.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'AMMO2': '0.060', 'weapon5': '0.172', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.298', 'weapon2': '0.536', 'WEAPON4': '0.550', 'weapon4': '0.668', 'WEAPON3': '1.050', 'weapon3': '2.364', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '40.500'} [2024-08-06 01:22:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 244203520. Throughput: 0: 4364.7. Samples: 61050620. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:22:02,794][52567] Avg episode reward: [(0, '62.499')] [2024-08-06 01:22:03,010][52650] Updated weights for policy 0, policy_version 29811 (0.0014) [2024-08-06 01:22:03,055][52662] DAMAGECOUNT value on done: 195344.0 [2024-08-06 01:22:03,068][52662] Sum rewards: 59.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.167', 'weapon4': '0.368', 'WEAPON4': '0.450', 'weapon2': '0.740', 'WEAPON3': '1.000', 'weapon3': '2.644', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '50.000'} [2024-08-06 01:22:03,075][52667] DAMAGECOUNT value on done: 194750.0 [2024-08-06 01:22:03,077][52667] Sum rewards: 52.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.652', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.016', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '46.000'} [2024-08-06 01:22:03,885][52668] DAMAGECOUNT value on done: 190422.0 [2024-08-06 01:22:03,885][52668] Sum rewards: 69.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.761', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.181', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '59.000'} [2024-08-06 01:22:04,228][52669] DAMAGECOUNT value on done: 196337.0 [2024-08-06 01:22:04,230][52669] Sum rewards: 65.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.126', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '57.000'} [2024-08-06 01:22:04,395][52660] DAMAGECOUNT value on done: 193747.0 [2024-08-06 01:22:04,397][52660] Sum rewards: 54.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.644', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.166', 'weapon4': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.290', 'WEAPON5': '0.450', 'weapon2': '0.522', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:05,035][52794] DAMAGECOUNT value on done: 200619.0 [2024-08-06 01:22:05,037][52794] Sum rewards: 59.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.215', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '50.000'} [2024-08-06 01:22:06,214][52667] DAMAGECOUNT value on done: 196494.0 [2024-08-06 01:22:06,217][52667] Sum rewards: 64.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.232', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.179', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.398', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:06,324][52662] DAMAGECOUNT value on done: 203622.0 [2024-08-06 01:22:06,327][52662] Sum rewards: 53.165, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.983', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.285', 'weapon2': '0.384', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.174', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '49.000'} [2024-08-06 01:22:06,499][52668] DAMAGECOUNT value on done: 183895.0 [2024-08-06 01:22:06,502][52668] Sum rewards: 62.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.335', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon4': '0.304', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:06,568][52659] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:22:07,097][52660] DAMAGECOUNT value on done: 196405.0 [2024-08-06 01:22:07,097][52660] Sum rewards: 66.769, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.844', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.052', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '59.000'} [2024-08-06 01:22:07,247][52669] DAMAGECOUNT value on done: 191399.0 [2024-08-06 01:22:07,248][52669] Sum rewards: 53.654, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'AMMO2': '0.055', 'weapon5': '0.104', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.275', 'weapon2': '0.314', 'WEAPON4': '0.600', 'weapon4': '0.820', 'WEAPON3': '1.300', 'weapon3': '2.368', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '49.000'} [2024-08-06 01:22:07,630][52650] Updated weights for policy 0, policy_version 29821 (0.0013) [2024-08-06 01:22:07,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 244293632. Throughput: 0: 4387.3. Samples: 61077080. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:22:07,795][52567] Avg episode reward: [(0, '61.858')] [2024-08-06 01:22:08,099][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:22:08,155][52794] DAMAGECOUNT value on done: 194392.0 [2024-08-06 01:22:08,156][52794] Sum rewards: 63.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.856', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO4': '0.194', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.450', 'weapon4': '0.830', 'WEAPON3': '1.200', 'weapon3': '2.460', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:09,236][52667] DAMAGECOUNT value on done: 192088.0 [2024-08-06 01:22:09,236][52667] Sum rewards: 54.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.748', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon5': '0.166', 'AMMO4': '0.208', 'weapon2': '0.398', 'WEAPON4': '0.400', 'weapon4': '0.516', 'WEAPON3': '0.950', 'weapon3': '2.602', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '45.000'} [2024-08-06 01:22:09,257][52662] DAMAGECOUNT value on done: 194320.0 [2024-08-06 01:22:09,257][52662] Sum rewards: 57.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.544', 'ARMOR': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.286', 'weapon4': '0.290', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.198', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:09,484][52668] DAMAGECOUNT value on done: 190082.0 [2024-08-06 01:22:09,486][52668] Sum rewards: 59.793, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.147', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.904', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:10,084][52660] DAMAGECOUNT value on done: 196705.0 [2024-08-06 01:22:10,086][52660] Sum rewards: 71.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.432', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.187', 'weapon4': '0.224', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '61.000'} [2024-08-06 01:22:10,159][52669] DAMAGECOUNT value on done: 195631.0 [2024-08-06 01:22:10,161][52669] Sum rewards: 77.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.408', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '62.000'} [2024-08-06 01:22:11,258][52794] DAMAGECOUNT value on done: 194820.0 [2024-08-06 01:22:11,260][52794] Sum rewards: 56.698, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.256', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'AMMO3': '0.237', 'weapon4': '0.496', 'WEAPON4': '0.500', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.586', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:12,109][52650] Updated weights for policy 0, policy_version 29831 (0.0013) [2024-08-06 01:22:12,218][52662] DAMAGECOUNT value on done: 196388.0 [2024-08-06 01:22:12,220][52662] Sum rewards: 48.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.122', 'AMMO3': '0.181', 'AMMO4': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.394', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.576', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.459', 'FRAGCOUNT': '41.000'} [2024-08-06 01:22:12,350][52667] DAMAGECOUNT value on done: 192549.0 [2024-08-06 01:22:12,350][52667] Sum rewards: 48.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.600', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.191', 'weapon5': '0.214', 'weapon2': '0.246', 'AMMO4': '0.259', 'WEAPON5': '0.450', 'weapon4': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '42.500'} [2024-08-06 01:22:12,556][52668] DAMAGECOUNT value on done: 188556.0 [2024-08-06 01:22:12,558][52668] Sum rewards: 65.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.013', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.106', 'weapon5': '0.142', 'AMMO4': '0.168', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.330', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '56.000'} [2024-08-06 01:22:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 244375552. Throughput: 0: 4390.4. Samples: 61103570. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:22:12,794][52567] Avg episode reward: [(0, '62.246')] [2024-08-06 01:22:13,085][52669] DAMAGECOUNT value on done: 191897.0 [2024-08-06 01:22:13,086][52669] Sum rewards: 59.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.454', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.114', 'AMMO3': '0.187', 'weapon5': '0.194', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '49.000'} [2024-08-06 01:22:13,244][52660] DAMAGECOUNT value on done: 191693.0 [2024-08-06 01:22:13,254][52660] Sum rewards: 60.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.072', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.356', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:13,791][52794] DAMAGECOUNT value on done: 195008.0 [2024-08-06 01:22:13,793][52794] Sum rewards: 34.719, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon7': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'weapon2': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.636', 'WEAPON3': '1.000', 'weapon3': '1.512', 'HITCOUNT': '1.910', 'DAMAGECOUNT': '9.207', 'FRAGCOUNT': '31.000'} [2024-08-06 01:22:15,014][52662] DAMAGECOUNT value on done: 193788.0 [2024-08-06 01:22:15,014][52662] Sum rewards: 62.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.843', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.195', 'weapon4': '0.300', 'weapon2': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:15,346][52667] DAMAGECOUNT value on done: 197030.0 [2024-08-06 01:22:15,346][52667] Sum rewards: 62.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.276', 'weapon2': '0.582', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:15,495][52668] DAMAGECOUNT value on done: 194101.0 [2024-08-06 01:22:15,497][52668] Sum rewards: 59.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.222', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.239', 'weapon4': '0.404', 'WEAPON3': '1.450', 'weapon3': '2.852', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:16,099][52660] DAMAGECOUNT value on done: 198241.0 [2024-08-06 01:22:16,100][52660] Sum rewards: 58.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.838', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.090', 'AMMO3': '0.194', 'weapon5': '0.216', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.814', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '50.000'} [2024-08-06 01:22:16,254][52669] DAMAGECOUNT value on done: 192790.0 [2024-08-06 01:22:16,254][52669] Sum rewards: 65.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.184', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.127', 'AMMO3': '0.132', 'WEAPON4': '0.400', 'weapon4': '0.458', 'weapon2': '0.462', 'WEAPON3': '0.850', 'weapon3': '2.854', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:16,621][52794] DAMAGECOUNT value on done: 194976.0 [2024-08-06 01:22:16,623][52794] Sum rewards: 61.340, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.354', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.228', 'AMMO3': '0.277', 'weapon2': '0.384', 'WEAPON3': '1.650', 'weapon3': '3.174', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:17,156][52650] Updated weights for policy 0, policy_version 29841 (0.0035) [2024-08-06 01:22:17,442][52795] DAMAGECOUNT value on done: 178515.0 [2024-08-06 01:22:17,443][52795] Sum rewards: 57.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.964', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.146', 'AMMO3': '0.166', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.140', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '49.000'} [2024-08-06 01:22:17,519][52662] DAMAGECOUNT value on done: 200992.0 [2024-08-06 01:22:17,519][52662] Sum rewards: 67.527, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.465', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO3': '0.130', 'AMMO4': '0.186', 'WEAPON4': '0.400', 'weapon4': '0.548', 'weapon2': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.638', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:17,795][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 244465664. Throughput: 0: 4385.1. Samples: 61116540. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:22:17,795][52567] Avg episode reward: [(0, '61.877')] [2024-08-06 01:22:18,323][52668] DAMAGECOUNT value on done: 190495.0 [2024-08-06 01:22:18,331][52668] Sum rewards: 47.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.236', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '2.460', 'weapon3': '2.816', 'DAMAGECOUNT': '11.808', 'FRAGCOUNT': '41.000'} [2024-08-06 01:22:18,362][52667] DAMAGECOUNT value on done: 194634.0 [2024-08-06 01:22:18,362][52667] Sum rewards: 48.778, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.228', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.254', 'weapon4': '0.364', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '2.918', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '45.000'} [2024-08-06 01:22:18,823][52660] DAMAGECOUNT value on done: 187662.0 [2024-08-06 01:22:18,825][52660] Sum rewards: 67.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.205', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.223', 'weapon4': '0.254', 'WEAPON4': '0.500', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '56.000'} [2024-08-06 01:22:19,045][52794] DAMAGECOUNT value on done: 200330.0 [2024-08-06 01:22:19,047][52794] Sum rewards: 53.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.159', 'AMMO4': '0.213', 'weapon5': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.570', 'weapon4': '0.828', 'WEAPON3': '0.900', 'weapon3': '1.980', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '44.000'} [2024-08-06 01:22:19,290][52669] DAMAGECOUNT value on done: 191203.0 [2024-08-06 01:22:19,290][52669] Sum rewards: 61.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.167', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon2': '0.584', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.082', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:19,964][52662] DAMAGECOUNT value on done: 197831.0 [2024-08-06 01:22:19,966][52662] Sum rewards: 67.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.933', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.170', 'weapon5': '0.198', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'weapon2': '0.440', 'weapon4': '0.578', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.480', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '56.500'} [2024-08-06 01:22:20,503][52795] DAMAGECOUNT value on done: 175883.0 [2024-08-06 01:22:20,505][52795] Sum rewards: 75.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.033', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.448', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '64.000'} [2024-08-06 01:22:21,227][52667] DAMAGECOUNT value on done: 193048.0 [2024-08-06 01:22:21,229][52667] Sum rewards: 49.812, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.778', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'AMMO4': '0.267', 'weapon2': '0.374', 'weapon4': '0.552', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.732', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '44.000'} [2024-08-06 01:22:21,300][52668] DAMAGECOUNT value on done: 195468.0 [2024-08-06 01:22:21,302][52668] Sum rewards: 52.838, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.522', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.208', 'weapon4': '0.264', 'AMMO3': '0.267', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '2.944', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '49.000'} [2024-08-06 01:22:21,594][52650] Updated weights for policy 0, policy_version 29851 (0.0015) [2024-08-06 01:22:21,614][52669] DAMAGECOUNT value on done: 194447.0 [2024-08-06 01:22:21,614][52669] Sum rewards: 61.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.108', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.704', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:21,869][52660] DAMAGECOUNT value on done: 193092.0 [2024-08-06 01:22:21,870][52660] Sum rewards: 60.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.104', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.332', 'weapon4': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:21,911][52794] DAMAGECOUNT value on done: 196788.0 [2024-08-06 01:22:21,912][52794] Sum rewards: 56.768, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.786', 'ARMOR': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.250', 'weapon2': '0.260', 'AMMO4': '0.303', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '50.000'} [2024-08-06 01:22:22,779][52662] DAMAGECOUNT value on done: 201818.0 [2024-08-06 01:22:22,780][52662] Sum rewards: 49.667, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.243', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.126', 'AMMO3': '0.242', 'AMMO4': '0.273', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '3.016', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '47.000'} [2024-08-06 01:22:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.8). Total num frames: 244547584. Throughput: 0: 4394.0. Samples: 61143120. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:22:22,794][52567] Avg episode reward: [(0, '61.183')] [2024-08-06 01:22:23,709][52795] DAMAGECOUNT value on done: 176377.0 [2024-08-06 01:22:23,710][52795] Sum rewards: 50.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.708', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.134', 'AMMO3': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'weapon2': '0.256', 'WEAPON4': '0.400', 'weapon4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '42.000'} [2024-08-06 01:22:24,263][52667] DAMAGECOUNT value on done: 195809.0 [2024-08-06 01:22:24,263][52667] Sum rewards: 64.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.024', 'weapon4': '0.074', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.302', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:24,386][52668] DAMAGECOUNT value on done: 196449.0 [2024-08-06 01:22:24,389][52668] Sum rewards: 68.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.914', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.102', 'weapon4': '0.164', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '57.000'} [2024-08-06 01:22:24,428][52669] DAMAGECOUNT value on done: 193435.0 [2024-08-06 01:22:24,428][52669] Sum rewards: 68.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.154', 'AMMO3': '0.176', 'weapon4': '0.218', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '58.000'} [2024-08-06 01:22:24,686][52794] DAMAGECOUNT value on done: 200098.0 [2024-08-06 01:22:24,691][52794] Sum rewards: 57.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.783', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.038', 'weapon4': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.520', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.132', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:24,841][52660] DAMAGECOUNT value on done: 196490.0 [2024-08-06 01:22:24,842][52660] Sum rewards: 65.618, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.247', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon4': '0.268', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '57.000'} [2024-08-06 01:22:25,810][52662] DAMAGECOUNT value on done: 194183.0 [2024-08-06 01:22:25,812][52662] Sum rewards: 55.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.784', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '47.000'} [2024-08-06 01:22:26,339][52650] Updated weights for policy 0, policy_version 29861 (0.0026) [2024-08-06 01:22:26,431][52649] Large shaping reward 2.588 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.537, 179.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:22:26,867][52795] DAMAGECOUNT value on done: 178161.0 [2024-08-06 01:22:26,869][52795] Sum rewards: 57.316, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.250', 'AMMO3': '0.285', 'weapon2': '0.610', 'WEAPON3': '1.650', 'weapon3': '2.884', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:27,069][52669] DAMAGECOUNT value on done: 193503.0 [2024-08-06 01:22:27,070][52669] Sum rewards: 55.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.088', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.100', 'weapon2': '0.188', 'AMMO3': '0.264', 'weapon4': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.346', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:27,308][52668] DAMAGECOUNT value on done: 193937.0 [2024-08-06 01:22:27,310][52668] Sum rewards: 59.729, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.302', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.592', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:27,357][52794] DAMAGECOUNT value on done: 199572.0 [2024-08-06 01:22:27,357][52794] Sum rewards: 48.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.848', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.084', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'weapon2': '0.386', 'WEAPON3': '1.500', 'HITCOUNT': '2.650', 'weapon3': '3.202', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '44.000'} [2024-08-06 01:22:27,739][52667] DAMAGECOUNT value on done: 192061.0 [2024-08-06 01:22:27,740][52667] Sum rewards: 66.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:27,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 244645888. Throughput: 0: 4386.0. Samples: 61169620. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:22:27,794][52567] Avg episode reward: [(0, '60.416')] [2024-08-06 01:22:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029864_244645888.pth... [2024-08-06 01:22:27,918][52660] DAMAGECOUNT value on done: 202975.0 [2024-08-06 01:22:27,918][52660] Sum rewards: 63.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.921', 'ARMOR': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.161', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.542', 'weapon4': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029350_240435200.pth [2024-08-06 01:22:28,299][52662] DAMAGECOUNT value on done: 197837.0 [2024-08-06 01:22:28,302][52662] Sum rewards: 62.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.552', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.024', 'weapon5': '0.038', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.334', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.428', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:29,353][52614] Signal inference workers to stop experience collection... (5450 times) [2024-08-06 01:22:29,358][52614] Signal inference workers to resume experience collection... (5450 times) [2024-08-06 01:22:29,444][52650] InferenceWorker_p0-w0: stopping experience collection (5450 times) [2024-08-06 01:22:29,455][52650] InferenceWorker_p0-w0: resuming experience collection (5450 times) [2024-08-06 01:22:29,706][52669] DAMAGECOUNT value on done: 190826.0 [2024-08-06 01:22:29,706][52669] Sum rewards: 49.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.129', 'AMMO3': '0.148', 'WEAPON4': '0.350', 'weapon4': '0.418', 'weapon2': '0.708', 'WEAPON3': '0.950', 'weapon3': '2.660', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '41.000'} [2024-08-06 01:22:30,022][52795] DAMAGECOUNT value on done: 182067.0 [2024-08-06 01:22:30,023][52795] Sum rewards: 61.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.138', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'AMMO4': '0.257', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:30,199][52794] DAMAGECOUNT value on done: 195425.0 [2024-08-06 01:22:30,200][52794] Sum rewards: 59.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.895', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.060', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.214', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:30,757][52660] DAMAGECOUNT value on done: 189301.0 [2024-08-06 01:22:30,757][52660] Sum rewards: 56.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.403', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.034', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'weapon2': '0.222', 'AMMO3': '0.229', 'WEAPON4': '0.400', 'weapon4': '0.878', 'WEAPON3': '1.300', 'weapon3': '2.504', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '50.000'} [2024-08-06 01:22:30,782][52667] DAMAGECOUNT value on done: 198008.0 [2024-08-06 01:22:30,784][52667] Sum rewards: 47.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.695', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.130', 'weapon5': '0.168', 'AMMO4': '0.176', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.720', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.690', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '44.000'} [2024-08-06 01:22:30,997][52650] Updated weights for policy 0, policy_version 29871 (0.0026) [2024-08-06 01:22:31,048][52662] DAMAGECOUNT value on done: 195461.0 [2024-08-06 01:22:31,048][52662] Sum rewards: 59.301, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.725', 'AMMO5': '0.011', 'AMMO2': '0.057', 'weapon5': '0.190', 'weapon4': '0.228', 'AMMO3': '0.276', 'AMMO4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.908', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:32,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 244736000. Throughput: 0: 4392.2. Samples: 61182650. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:22:32,795][52567] Avg episode reward: [(0, '60.096')] [2024-08-06 01:22:32,867][52669] DAMAGECOUNT value on done: 194328.0 [2024-08-06 01:22:32,868][52669] Sum rewards: 48.309, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.575', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.099', 'AMMO3': '0.163', 'weapon2': '0.942', 'WEAPON3': '1.150', 'HITCOUNT': '2.480', 'weapon3': '2.870', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '40.000'} [2024-08-06 01:22:32,901][52658] DAMAGECOUNT value on done: 198231.0 [2024-08-06 01:22:32,905][52794] DAMAGECOUNT value on done: 195368.0 [2024-08-06 01:22:32,906][52794] Sum rewards: 57.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.924', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.114', 'weapon4': '0.136', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.922', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '46.500'} [2024-08-06 01:22:32,915][52658] Sum rewards: 58.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.088', 'AMMO3': '0.191', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:33,110][52795] DAMAGECOUNT value on done: 179784.0 [2024-08-06 01:22:33,110][52795] Sum rewards: 67.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.166', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '58.000'} [2024-08-06 01:22:33,361][52667] DAMAGECOUNT value on done: 202215.0 [2024-08-06 01:22:33,361][52667] Sum rewards: 70.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.518', 'AMMO5': '0.007', 'AMMO2': '0.010', 'ARMOR': '0.016', 'AMMO4': '0.051', 'weapon2': '0.160', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.236', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 01:22:33,420][52660] DAMAGECOUNT value on done: 196347.0 [2024-08-06 01:22:33,422][52660] Sum rewards: 64.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.108', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:33,626][52662] DAMAGECOUNT value on done: 192868.0 [2024-08-06 01:22:33,628][52662] Sum rewards: 52.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '44.000'} [2024-08-06 01:22:35,457][52650] Updated weights for policy 0, policy_version 29881 (0.0011) [2024-08-06 01:22:35,481][52794] DAMAGECOUNT value on done: 192735.0 [2024-08-06 01:22:35,482][52794] Sum rewards: 69.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.826', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.040', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '59.000'} [2024-08-06 01:22:35,956][52658] DAMAGECOUNT value on done: 194559.0 [2024-08-06 01:22:35,957][52658] Sum rewards: 61.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.620', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.156', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.578', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:36,002][52669] DAMAGECOUNT value on done: 196347.0 [2024-08-06 01:22:36,004][52669] Sum rewards: 61.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.273', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.062', 'AMMO4': '0.159', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:36,206][52667] DAMAGECOUNT value on done: 196980.0 [2024-08-06 01:22:36,207][52667] Sum rewards: 46.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.758', 'WEAPON3': '1.350', 'weapon3': '2.442', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '11.985', 'FRAGCOUNT': '40.500'} [2024-08-06 01:22:36,224][52795] DAMAGECOUNT value on done: 184897.0 [2024-08-06 01:22:36,224][52795] Sum rewards: 65.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.106', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON4': '0.400', 'weapon4': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:36,309][52660] DAMAGECOUNT value on done: 185917.0 [2024-08-06 01:22:36,310][52660] Sum rewards: 52.289, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.052', 'ARMOR': '0.004', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon2': '0.300', 'AMMO3': '0.330', 'WEAPON4': '0.450', 'weapon4': '0.738', 'WEAPON3': '1.850', 'weapon3': '2.696', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '49.000'} [2024-08-06 01:22:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 244817920. Throughput: 0: 4394.4. Samples: 61209220. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:22:37,794][52567] Avg episode reward: [(0, '59.814')] [2024-08-06 01:22:38,737][52794] DAMAGECOUNT value on done: 206684.0 [2024-08-06 01:22:38,737][52794] Sum rewards: 67.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.266', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.041', 'AMMO3': '0.177', 'weapon5': '0.188', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.690', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:38,899][52658] DAMAGECOUNT value on done: 197405.0 [2024-08-06 01:22:38,899][52658] Sum rewards: 48.507, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.212', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.161', 'weapon5': '0.168', 'weapon2': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '3.168', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '39.500'} [2024-08-06 01:22:39,020][52669] DAMAGECOUNT value on done: 190957.0 [2024-08-06 01:22:39,022][52669] Sum rewards: 45.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.214', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.870', 'WEAPON3': '1.300', 'weapon3': '2.380', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.370', 'FRAGCOUNT': '42.000'} [2024-08-06 01:22:39,214][52667] DAMAGECOUNT value on done: 198671.0 [2024-08-06 01:22:39,216][52667] Sum rewards: 52.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.994', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon7': '0.096', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON7': '0.200', 'weapon4': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.688', 'WEAPON3': '0.750', 'weapon3': '2.666', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '42.000'} [2024-08-06 01:22:39,344][52795] DAMAGECOUNT value on done: 181212.0 [2024-08-06 01:22:39,347][52795] Sum rewards: 54.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.232', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon4': '0.232', 'AMMO3': '0.251', 'weapon5': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.450', 'weapon3': '2.672', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:39,409][52660] DAMAGECOUNT value on done: 194456.0 [2024-08-06 01:22:39,409][52660] Sum rewards: 50.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.414', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.400', 'weapon4': '0.520', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.718', 'DAMAGECOUNT': '12.546', 'FRAGCOUNT': '42.000'} [2024-08-06 01:22:40,416][52650] Updated weights for policy 0, policy_version 29891 (0.0017) [2024-08-06 01:22:41,247][52794] DAMAGECOUNT value on done: 191929.0 [2024-08-06 01:22:41,249][52794] Sum rewards: 50.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.016', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.158', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.300', 'HITCOUNT': '2.610', 'weapon3': '3.168', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '45.000'} [2024-08-06 01:22:41,558][52658] DAMAGECOUNT value on done: 198004.0 [2024-08-06 01:22:41,560][52658] Sum rewards: 57.706, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.780', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:41,762][52667] DAMAGECOUNT value on done: 191796.0 [2024-08-06 01:22:41,765][52667] Sum rewards: 53.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.205', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.888', 'DAMAGECOUNT': '12.564', 'FRAGCOUNT': '47.000'} [2024-08-06 01:22:41,906][52669] DAMAGECOUNT value on done: 198586.0 [2024-08-06 01:22:41,907][52669] Sum rewards: 67.282, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.161', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '60.000'} [2024-08-06 01:22:42,393][52795] DAMAGECOUNT value on done: 177329.0 [2024-08-06 01:22:42,393][52795] Sum rewards: 59.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.487', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon7': '0.064', 'weapon5': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.630', 'WEAPON3': '1.300', 'weapon3': '2.714', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:42,652][52660] DAMAGECOUNT value on done: 190223.0 [2024-08-06 01:22:42,652][52660] Sum rewards: 64.881, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.655', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.166', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.700', 'weapon3': '3.214', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 01:22:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 244908032. Throughput: 0: 4392.2. Samples: 61235510. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:22:42,795][52567] Avg episode reward: [(0, '59.045')] [2024-08-06 01:22:44,263][52658] DAMAGECOUNT value on done: 196978.0 [2024-08-06 01:22:44,264][52658] Sum rewards: 63.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.486', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.078', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO4': '0.186', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '54.500'} [2024-08-06 01:22:44,338][52794] DAMAGECOUNT value on done: 202203.0 [2024-08-06 01:22:44,341][52794] Sum rewards: 78.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.395', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.218', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '65.000'} [2024-08-06 01:22:44,510][52667] DAMAGECOUNT value on done: 198305.0 [2024-08-06 01:22:44,510][52667] Sum rewards: 51.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.625', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.078', 'AMMO3': '0.188', 'weapon5': '0.214', 'weapon4': '0.336', 'AMMO4': '0.391', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON4': '0.850', 'WEAPON3': '1.150', 'weapon3': '2.570', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '46.000'} [2024-08-06 01:22:44,754][52650] Updated weights for policy 0, policy_version 29901 (0.0012) [2024-08-06 01:22:44,816][52669] DAMAGECOUNT value on done: 200924.0 [2024-08-06 01:22:44,816][52669] Sum rewards: 64.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.762', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.196', 'weapon2': '0.262', 'weapon4': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:45,548][52795] DAMAGECOUNT value on done: 181255.0 [2024-08-06 01:22:45,548][52795] Sum rewards: 65.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.071', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:47,126][52658] DAMAGECOUNT value on done: 191870.0 [2024-08-06 01:22:47,131][52658] Sum rewards: 53.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.771', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.225', 'weapon4': '0.378', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '45.500'} [2024-08-06 01:22:47,360][52794] DAMAGECOUNT value on done: 198904.0 [2024-08-06 01:22:47,361][52794] Sum rewards: 69.580, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon4': '0.078', 'weapon5': '0.080', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '59.000'} [2024-08-06 01:22:47,622][52669] DAMAGECOUNT value on done: 206636.0 [2024-08-06 01:22:47,623][52669] Sum rewards: 68.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.883', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.332', 'WEAPON3': '1.350', 'HITCOUNT': '3.380', 'weapon3': '3.392', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '57.000'} [2024-08-06 01:22:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 244998144. Throughput: 0: 4398.0. Samples: 61248530. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:22:47,794][52567] Avg episode reward: [(0, '59.282')] [2024-08-06 01:22:48,729][52795] DAMAGECOUNT value on done: 179211.0 [2024-08-06 01:22:48,731][52795] Sum rewards: 60.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.110', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'weapon4': '0.376', 'weapon2': '0.492', 'WEAPON3': '0.900', 'weapon3': '2.818', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '50.500'} [2024-08-06 01:22:49,496][52666] DAMAGECOUNT value on done: 198165.0 [2024-08-06 01:22:49,505][52666] Sum rewards: 65.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.518', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.196', 'weapon5': '0.228', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.426', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.470', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:49,747][52650] Updated weights for policy 0, policy_version 29911 (0.0021) [2024-08-06 01:22:50,169][52669] DAMAGECOUNT value on done: 193137.0 [2024-08-06 01:22:50,171][52669] Sum rewards: 56.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.722', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.203', 'weapon4': '0.328', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.010', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '48.000'} [2024-08-06 01:22:50,417][52658] DAMAGECOUNT value on done: 200468.0 [2024-08-06 01:22:50,418][52658] Sum rewards: 69.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.025', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'AMMO3': '0.242', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '61.000'} [2024-08-06 01:22:50,581][52794] DAMAGECOUNT value on done: 199394.0 [2024-08-06 01:22:50,583][52794] Sum rewards: 64.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.082', 'weapon5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:51,191][52647] DAMAGECOUNT value on done: 206795.0 [2024-08-06 01:22:51,191][52647] Sum rewards: 70.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.304', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '58.000'} [2024-08-06 01:22:51,889][52795] DAMAGECOUNT value on done: 177329.0 [2024-08-06 01:22:51,889][52795] Sum rewards: 63.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.815', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.104', 'AMMO4': '0.185', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'weapon4': '0.384', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:52,382][52666] DAMAGECOUNT value on done: 198741.0 [2024-08-06 01:22:52,383][52666] Sum rewards: 60.734, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.925', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO4': '0.197', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.436', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 01:22:52,797][52567] Fps is (10 sec: 17198.9, 60 sec: 17475.5, 300 sec: 17522.4). Total num frames: 245080064. Throughput: 0: 4392.4. Samples: 61274750. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:22:52,799][52567] Avg episode reward: [(0, '59.575')] [2024-08-06 01:22:53,002][52670] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:22:53,282][52658] DAMAGECOUNT value on done: 190607.0 [2024-08-06 01:22:53,282][52658] Sum rewards: 58.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.218', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon2': '0.666', 'WEAPON3': '1.500', 'weapon3': '2.546', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:53,308][52669] DAMAGECOUNT value on done: 198243.0 [2024-08-06 01:22:53,309][52669] Sum rewards: 65.396, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.536', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.212', 'weapon2': '0.490', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.258', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '56.000'} [2024-08-06 01:22:53,432][52794] DAMAGECOUNT value on done: 203718.0 [2024-08-06 01:22:53,433][52794] Sum rewards: 62.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.118', 'AMMO4': '0.184', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:54,074][52650] Updated weights for policy 0, policy_version 29921 (0.0014) [2024-08-06 01:22:54,182][52647] DAMAGECOUNT value on done: 204909.0 [2024-08-06 01:22:54,183][52647] Sum rewards: 65.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.058', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.174', 'weapon5': '0.206', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON4': '0.600', 'weapon4': '0.730', 'WEAPON3': '1.050', 'weapon3': '2.124', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '55.000'} [2024-08-06 01:22:55,081][52795] DAMAGECOUNT value on done: 176618.0 [2024-08-06 01:22:55,081][52795] Sum rewards: 53.293, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '3.202', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '43.000'} [2024-08-06 01:22:55,583][52666] DAMAGECOUNT value on done: 196657.0 [2024-08-06 01:22:55,583][52666] Sum rewards: 63.207, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.205', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.134', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.360', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:56,051][52794] DAMAGECOUNT value on done: 198001.0 [2024-08-06 01:22:56,053][52794] Sum rewards: 58.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.143', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.133', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.316', 'weapon4': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '50.000'} [2024-08-06 01:22:56,132][52658] DAMAGECOUNT value on done: 199821.0 [2024-08-06 01:22:56,135][52658] Sum rewards: 60.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.317', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.078', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.452', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.308', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:56,195][52669] DAMAGECOUNT value on done: 198402.0 [2024-08-06 01:22:56,196][52669] Sum rewards: 61.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.744', 'AMMO2': '0.031', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.213', 'weapon2': '0.720', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 01:22:56,923][52647] DAMAGECOUNT value on done: 205699.0 [2024-08-06 01:22:56,925][52647] Sum rewards: 54.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.188', 'AMMO3': '0.211', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.200', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '49.000'} [2024-08-06 01:22:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 245170176. Throughput: 0: 4396.4. Samples: 61301410. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:22:57,794][52567] Avg episode reward: [(0, '59.540')] [2024-08-06 01:22:58,183][52795] DAMAGECOUNT value on done: 181752.0 [2024-08-06 01:22:58,192][52795] Sum rewards: 57.123, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '51.000'} [2024-08-06 01:22:58,473][52666] DAMAGECOUNT value on done: 193744.0 [2024-08-06 01:22:58,474][52666] Sum rewards: 63.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.306', 'AMMO5': '0.004', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.022', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.186', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.400', 'weapon3': '3.476', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:58,739][52650] Updated weights for policy 0, policy_version 29931 (0.0024) [2024-08-06 01:22:58,854][52658] DAMAGECOUNT value on done: 199500.0 [2024-08-06 01:22:58,855][52658] Sum rewards: 62.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.416', 'ARMOR': '0.008', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.084', 'AMMO3': '0.229', 'weapon2': '0.286', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.420', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '53.000'} [2024-08-06 01:22:59,100][52670] DAMAGECOUNT value on done: 193022.0 [2024-08-06 01:22:59,100][52670] Sum rewards: 53.210, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.660', 'AMMO2': '0.010', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.052', 'AMMO3': '0.117', 'weapon5': '0.132', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.750', 'WEAPON3': '0.850', 'weapon3': '2.628', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '44.000'} [2024-08-06 01:22:59,210][52669] DAMAGECOUNT value on done: 200665.0 [2024-08-06 01:22:59,211][52669] Sum rewards: 55.839, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon4': '0.172', 'AMMO3': '0.252', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.806', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '50.000'} [2024-08-06 01:22:59,552][52647] DAMAGECOUNT value on done: 205389.0 [2024-08-06 01:22:59,552][52647] Sum rewards: 61.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.157', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.053', 'AMMO3': '0.162', 'weapon4': '0.222', 'AMMO4': '0.266', 'weapon5': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '49.500'} [2024-08-06 01:23:01,074][52666] DAMAGECOUNT value on done: 191558.0 [2024-08-06 01:23:01,074][52666] Sum rewards: 62.351, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.982', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:01,207][52795] DAMAGECOUNT value on done: 174885.0 [2024-08-06 01:23:01,207][52795] Sum rewards: 49.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.548', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO3': '0.204', 'AMMO4': '0.204', 'weapon4': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.618', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '2.694', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '44.000'} [2024-08-06 01:23:01,702][52658] DAMAGECOUNT value on done: 201559.0 [2024-08-06 01:23:01,704][52658] Sum rewards: 58.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.304', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.170', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:01,921][52670] DAMAGECOUNT value on done: 196506.0 [2024-08-06 01:23:01,922][52670] Sum rewards: 76.649, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.799', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 01:23:01,962][52647] DAMAGECOUNT value on done: 206862.0 [2024-08-06 01:23:01,962][52647] Sum rewards: 69.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.040', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.408', 'weapon2': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2024-08-06 01:23:02,794][52567] Fps is (10 sec: 18027.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 245260288. Throughput: 0: 4396.7. Samples: 61314390. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:23:02,794][52567] Avg episode reward: [(0, '59.887')] [2024-08-06 01:23:03,678][52650] Updated weights for policy 0, policy_version 29941 (0.0012) [2024-08-06 01:23:03,972][52666] DAMAGECOUNT value on done: 188076.0 [2024-08-06 01:23:03,972][52666] Sum rewards: 69.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.249', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:04,069][52671] DAMAGECOUNT value on done: 199964.0 [2024-08-06 01:23:04,072][52671] Sum rewards: 49.555, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.750', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.080', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.272', 'weapon4': '0.344', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.020', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '45.000'} [2024-08-06 01:23:04,175][52658] DAMAGECOUNT value on done: 191067.0 [2024-08-06 01:23:04,176][52658] Sum rewards: 58.190, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.173', 'AMMO3': '0.176', 'weapon2': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.066', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '48.500'} [2024-08-06 01:23:04,360][52795] DAMAGECOUNT value on done: 185628.0 [2024-08-06 01:23:04,361][52795] Sum rewards: 67.070, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.003', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.209', 'AMMO3': '0.243', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.450', 'HEALTH': '1.058', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:04,694][52647] DAMAGECOUNT value on done: 207592.0 [2024-08-06 01:23:04,695][52647] Sum rewards: 42.061, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.945', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.698', 'WEAPON3': '1.550', 'weapon3': '2.594', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '40.000'} [2024-08-06 01:23:05,017][52670] DAMAGECOUNT value on done: 191643.0 [2024-08-06 01:23:05,017][52670] Sum rewards: 48.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.080', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon7': '0.100', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.810', 'WEAPON3': '1.200', 'weapon3': '2.352', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '12.252', 'FRAGCOUNT': '42.000'} [2024-08-06 01:23:06,563][52671] DAMAGECOUNT value on done: 194323.0 [2024-08-06 01:23:06,565][52671] Sum rewards: 55.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.708', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.270', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:07,067][52666] DAMAGECOUNT value on done: 193916.0 [2024-08-06 01:23:07,070][52666] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon5': '0.130', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.374', 'weapon2': '0.606', 'WEAPON3': '0.950', 'weapon3': '2.630', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:07,138][52647] DAMAGECOUNT value on done: 204779.0 [2024-08-06 01:23:07,138][52647] Sum rewards: 61.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.118', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:07,266][52658] DAMAGECOUNT value on done: 194349.0 [2024-08-06 01:23:07,267][52658] Sum rewards: 61.042, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.520', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon5': '0.028', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.281', 'weapon2': '0.390', 'WEAPON3': '1.800', 'weapon3': '3.208', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:07,603][52795] DAMAGECOUNT value on done: 184465.0 [2024-08-06 01:23:07,604][52795] Sum rewards: 61.059, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.820', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon5': '0.076', 'AMMO3': '0.248', 'AMMO4': '0.322', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON4': '0.700', 'weapon2': '0.744', 'WEAPON3': '1.450', 'weapon3': '2.422', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 245350400. Throughput: 0: 4396.7. Samples: 61340970. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:23:07,794][52567] Avg episode reward: [(0, '59.687')] [2024-08-06 01:23:07,959][52670] DAMAGECOUNT value on done: 192291.0 [2024-08-06 01:23:07,961][52670] Sum rewards: 55.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.180', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.346', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.240', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '45.000'} [2024-08-06 01:23:08,444][52650] Updated weights for policy 0, policy_version 29951 (0.0014) [2024-08-06 01:23:09,591][52671] DAMAGECOUNT value on done: 197963.0 [2024-08-06 01:23:09,591][52671] Sum rewards: 45.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.032', 'AMMO4': '0.147', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.322', 'WEAPON4': '0.450', 'weapon2': '1.004', 'WEAPON3': '1.200', 'weapon3': '2.428', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '11.838', 'FRAGCOUNT': '42.000'} [2024-08-06 01:23:09,845][52647] DAMAGECOUNT value on done: 203971.0 [2024-08-06 01:23:09,847][52647] Sum rewards: 55.273, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.725', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon5': '0.070', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.290', 'weapon4': '0.528', 'weapon2': '0.538', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.614', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '49.500'} [2024-08-06 01:23:09,967][52658] DAMAGECOUNT value on done: 196023.0 [2024-08-06 01:23:09,968][52658] Sum rewards: 63.701, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon4': '0.434', 'weapon2': '0.528', 'WEAPON3': '1.050', 'weapon3': '2.682', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:10,458][52666] DAMAGECOUNT value on done: 194213.0 [2024-08-06 01:23:10,460][52666] Sum rewards: 75.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.366', 'ARMOR': '0.008', 'AMMO2': '0.030', 'AMMO3': '0.146', 'AMMO4': '0.151', 'weapon2': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.572', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '61.000'} [2024-08-06 01:23:10,727][52795] DAMAGECOUNT value on done: 174387.0 [2024-08-06 01:23:10,727][52795] Sum rewards: 67.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.512', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.228', 'weapon4': '0.262', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 01:23:11,059][52670] DAMAGECOUNT value on done: 193112.0 [2024-08-06 01:23:11,060][52670] Sum rewards: 50.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.835', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.143', 'weapon4': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '2.830', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '41.000'} [2024-08-06 01:23:12,191][52647] DAMAGECOUNT value on done: 207200.0 [2024-08-06 01:23:12,191][52647] Sum rewards: 59.604, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.142', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.054', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'AMMO4': '0.268', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.738', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:12,303][52658] DAMAGECOUNT value on done: 190924.0 [2024-08-06 01:23:12,304][52658] Sum rewards: 41.373, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.009', 'ARMOR': '0.016', 'HEALTH': '0.022', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.107', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.600', 'weapon2': '1.482', 'weapon3': '1.816', 'HITCOUNT': '1.980', 'DAMAGECOUNT': '9.756', 'FRAGCOUNT': '32.000'} [2024-08-06 01:23:12,616][52650] Updated weights for policy 0, policy_version 29961 (0.0039) [2024-08-06 01:23:12,676][52671] DAMAGECOUNT value on done: 193252.0 [2024-08-06 01:23:12,677][52671] Sum rewards: 46.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.072', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.378', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.330', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '40.000'} [2024-08-06 01:23:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 245440512. Throughput: 0: 4388.4. Samples: 61367100. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:23:12,794][52567] Avg episode reward: [(0, '59.401')] [2024-08-06 01:23:13,107][52666] DAMAGECOUNT value on done: 193792.0 [2024-08-06 01:23:13,109][52666] Sum rewards: 65.575, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.860', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '58.000'} [2024-08-06 01:23:13,162][52649] DAMAGECOUNT value on done: 189206.0 [2024-08-06 01:23:13,164][52649] Sum rewards: 49.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.158', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.530', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '2.972', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '43.000'} [2024-08-06 01:23:13,727][52670] DAMAGECOUNT value on done: 195165.0 [2024-08-06 01:23:13,728][52670] Sum rewards: 35.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.750', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.128', 'AMMO4': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '0.700', 'weapon3': '1.516', 'weapon4': '1.766', 'HITCOUNT': '2.280', 'DAMAGECOUNT': '9.486', 'FRAGCOUNT': '29.000'} [2024-08-06 01:23:13,826][52795] DAMAGECOUNT value on done: 187222.0 [2024-08-06 01:23:13,827][52795] Sum rewards: 75.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.821', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.045', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.450', 'weapon3': '3.462', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '63.000'} [2024-08-06 01:23:13,941][52665] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:23:14,590][52647] DAMAGECOUNT value on done: 202577.0 [2024-08-06 01:23:14,598][52647] Sum rewards: 53.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.742', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '46.000'} [2024-08-06 01:23:15,476][52658] DAMAGECOUNT value on done: 197349.0 [2024-08-06 01:23:15,478][52658] Sum rewards: 60.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.036', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon5': '0.174', 'AMMO3': '0.198', 'weapon4': '0.198', 'AMMO4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:15,733][52671] DAMAGECOUNT value on done: 196392.0 [2024-08-06 01:23:15,733][52671] Sum rewards: 58.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.525', 'ARMOR': '0.004', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.262', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:16,022][52666] DAMAGECOUNT value on done: 193901.0 [2024-08-06 01:23:16,022][52666] Sum rewards: 53.060, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.304', 'weapon2': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.124', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '45.000'} [2024-08-06 01:23:16,113][52649] DAMAGECOUNT value on done: 185333.0 [2024-08-06 01:23:16,113][52649] Sum rewards: 52.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.106', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'weapon4': '0.454', 'weapon2': '0.690', 'WEAPON3': '0.900', 'weapon3': '2.530', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.276', 'FRAGCOUNT': '43.000'} [2024-08-06 01:23:16,237][52803] DAMAGECOUNT value on done: 183322.0 [2024-08-06 01:23:16,237][52803] Sum rewards: 68.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.292', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.212', 'WEAPON3': '1.100', 'HITCOUNT': '3.340', 'weapon3': '3.386', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:16,896][52795] DAMAGECOUNT value on done: 186384.0 [2024-08-06 01:23:16,900][52795] Sum rewards: 64.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.753', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.031', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.165', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:16,929][52670] DAMAGECOUNT value on done: 189230.0 [2024-08-06 01:23:16,930][52670] Sum rewards: 61.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon5': '0.052', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.253', 'weapon2': '0.284', 'weapon4': '0.318', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.094', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:17,310][52647] DAMAGECOUNT value on done: 203751.0 [2024-08-06 01:23:17,310][52647] Sum rewards: 52.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.050', 'AMMO4': '0.250', 'weapon5': '0.264', 'AMMO3': '0.277', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.528', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:17,549][52650] Updated weights for policy 0, policy_version 29971 (0.0027) [2024-08-06 01:23:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 245522432. Throughput: 0: 4394.7. Samples: 61380410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:23:17,795][52567] Avg episode reward: [(0, '59.187')] [2024-08-06 01:23:18,512][52658] DAMAGECOUNT value on done: 198436.0 [2024-08-06 01:23:18,513][52658] Sum rewards: 65.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.004', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.082', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.314', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:18,895][52666] DAMAGECOUNT value on done: 192022.0 [2024-08-06 01:23:18,898][52666] Sum rewards: 64.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.376', 'WEAPON4': '0.400', 'weapon4': '0.580', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:18,895][52671] DAMAGECOUNT value on done: 196291.0 [2024-08-06 01:23:18,899][52671] Sum rewards: 60.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.092', 'weapon4': '0.104', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:19,051][52649] DAMAGECOUNT value on done: 190671.0 [2024-08-06 01:23:19,052][52649] Sum rewards: 62.861, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.850', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'weapon2': '0.264', 'AMMO3': '0.317', 'WEAPON3': '1.850', 'weapon3': '3.344', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:19,313][52803] DAMAGECOUNT value on done: 184614.0 [2024-08-06 01:23:19,314][52803] Sum rewards: 52.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.229', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.076', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '46.000'} [2024-08-06 01:23:19,543][52670] DAMAGECOUNT value on done: 194094.0 [2024-08-06 01:23:19,544][52670] Sum rewards: 59.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.688', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO4': '0.174', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.636', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:20,156][52647] DAMAGECOUNT value on done: 200806.0 [2024-08-06 01:23:20,165][52647] Sum rewards: 52.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.722', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.234', 'weapon4': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.124', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '43.000'} [2024-08-06 01:23:21,241][52658] DAMAGECOUNT value on done: 192483.0 [2024-08-06 01:23:21,243][52658] Sum rewards: 59.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.414', 'AMMO5': '0.007', 'weapon5': '0.046', 'AMMO2': '0.050', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon4': '0.250', 'AMMO4': '0.251', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:21,497][52666] DAMAGECOUNT value on done: 188461.0 [2024-08-06 01:23:21,497][52666] Sum rewards: 62.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.155', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:21,857][52649] DAMAGECOUNT value on done: 189439.0 [2024-08-06 01:23:21,857][52649] Sum rewards: 51.429, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.103', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.185', 'AMMO3': '0.230', 'weapon2': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '46.000'} [2024-08-06 01:23:21,943][52671] DAMAGECOUNT value on done: 197750.0 [2024-08-06 01:23:21,943][52671] Sum rewards: 69.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.285', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.320', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.394', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:22,076][52650] Updated weights for policy 0, policy_version 29981 (0.0029) [2024-08-06 01:23:22,373][52803] DAMAGECOUNT value on done: 180968.0 [2024-08-06 01:23:22,374][52803] Sum rewards: 64.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.338', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '54.500'} [2024-08-06 01:23:22,495][52670] DAMAGECOUNT value on done: 189657.0 [2024-08-06 01:23:22,495][52670] Sum rewards: 57.639, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.164', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.112', 'weapon4': '0.134', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.042', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 245612544. Throughput: 0: 4392.4. Samples: 61406880. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:23:22,795][52567] Avg episode reward: [(0, '59.319')] [2024-08-06 01:23:23,252][52647] DAMAGECOUNT value on done: 202587.0 [2024-08-06 01:23:23,252][52647] Sum rewards: 40.912, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO3': '0.094', 'WEAPON5': '0.100', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.308', 'WEAPON3': '0.600', 'weapon4': '1.032', 'HITCOUNT': '2.080', 'weapon3': '2.174', 'DAMAGECOUNT': '9.624', 'FRAGCOUNT': '31.000'} [2024-08-06 01:23:24,134][52664] DAMAGECOUNT value on done: 201860.0 [2024-08-06 01:23:24,134][52664] Sum rewards: 62.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.094', 'AMMO3': '0.186', 'weapon2': '0.950', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '50.500'} [2024-08-06 01:23:24,203][52663] DAMAGECOUNT value on done: 197281.0 [2024-08-06 01:23:24,204][52663] Sum rewards: 67.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.102', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:24,281][52666] DAMAGECOUNT value on done: 196477.0 [2024-08-06 01:23:24,282][52666] Sum rewards: 64.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.131', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:24,390][52658] DAMAGECOUNT value on done: 194375.0 [2024-08-06 01:23:24,390][52658] Sum rewards: 71.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.021', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.096', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.284', 'WEAPON3': '1.650', 'weapon3': '3.336', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '62.000'} [2024-08-06 01:23:24,606][52649] DAMAGECOUNT value on done: 182365.0 [2024-08-06 01:23:24,606][52649] Sum rewards: 44.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.225', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO4': '0.101', 'AMMO3': '0.191', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.808', 'WEAPON3': '1.250', 'weapon3': '2.650', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '39.000'} [2024-08-06 01:23:24,608][52811] DAMAGECOUNT value on done: 192013.0 [2024-08-06 01:23:24,610][52811] Sum rewards: 55.797, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.240', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.058', 'AMMO4': '0.220', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.494', 'weapon4': '0.538', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.608', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:25,033][52670] DAMAGECOUNT value on done: 185868.0 [2024-08-06 01:23:25,033][52670] Sum rewards: 72.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.095', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.131', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.312', 'weapon4': '0.456', 'WEAPON3': '1.000', 'weapon3': '2.886', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 01:23:25,069][52671] DAMAGECOUNT value on done: 198247.0 [2024-08-06 01:23:25,069][52671] Sum rewards: 58.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.784', 'AMMO2': '0.007', 'AMMO5': '0.014', 'AMMO4': '0.035', 'weapon5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.444', 'weapon4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:25,489][52803] DAMAGECOUNT value on done: 183234.0 [2024-08-06 01:23:25,497][52803] Sum rewards: 65.848, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.322', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.054', 'weapon4': '0.238', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '59.000'} [2024-08-06 01:23:25,586][52820] DAMAGECOUNT value on done: 177614.0 [2024-08-06 01:23:25,587][52820] Sum rewards: 60.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.742', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.212', 'weapon2': '0.334', 'weapon4': '0.546', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:25,885][52647] DAMAGECOUNT value on done: 204828.0 [2024-08-06 01:23:25,889][52647] Sum rewards: 62.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.332', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.094', 'weapon5': '0.180', 'AMMO4': '0.181', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:26,840][52650] Updated weights for policy 0, policy_version 29991 (0.0011) [2024-08-06 01:23:26,883][52664] DAMAGECOUNT value on done: 202355.0 [2024-08-06 01:23:26,884][52664] Sum rewards: 57.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.702', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.135', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:26,903][52663] DAMAGECOUNT value on done: 194966.0 [2024-08-06 01:23:26,903][52663] Sum rewards: 71.646, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.044', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.098', 'weapon4': '0.134', 'AMMO4': '0.169', 'weapon2': '0.220', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '62.000'} [2024-08-06 01:23:27,051][52666] DAMAGECOUNT value on done: 196684.0 [2024-08-06 01:23:27,051][52666] Sum rewards: 57.122, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'AMMO4': '0.253', 'WEAPON4': '0.400', 'weapon4': '0.528', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.576', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:27,370][52658] DAMAGECOUNT value on done: 198229.0 [2024-08-06 01:23:27,371][52658] Sum rewards: 59.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.110', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '52.500'} [2024-08-06 01:23:27,693][52649] DAMAGECOUNT value on done: 190347.0 [2024-08-06 01:23:27,694][52649] Sum rewards: 66.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.522', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:27,715][52811] DAMAGECOUNT value on done: 177617.0 [2024-08-06 01:23:27,716][52811] Sum rewards: 49.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.852', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'weapon4': '0.150', 'weapon2': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '3.336', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '44.000'} [2024-08-06 01:23:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 245702656. Throughput: 0: 4393.1. Samples: 61433200. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:23:27,794][52567] Avg episode reward: [(0, '59.793')] [2024-08-06 01:23:27,809][52670] DAMAGECOUNT value on done: 195820.0 [2024-08-06 01:23:27,810][52670] Sum rewards: 50.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon4': '0.238', 'weapon2': '0.328', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.140', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '43.500'} [2024-08-06 01:23:27,952][52671] DAMAGECOUNT value on done: 194883.0 [2024-08-06 01:23:27,952][52671] Sum rewards: 62.859, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.082', 'AMMO4': '0.150', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:28,218][52647] DAMAGECOUNT value on done: 206357.0 [2024-08-06 01:23:28,218][52647] Sum rewards: 71.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.221', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.434', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '62.000'} [2024-08-06 01:23:28,612][52803] DAMAGECOUNT value on done: 185128.0 [2024-08-06 01:23:28,614][52803] Sum rewards: 55.350, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.134', 'ARMOR': '0.008', 'AMMO2': '0.043', 'AMMO3': '0.164', 'AMMO4': '0.213', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.496', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '2.998', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '45.000'} [2024-08-06 01:23:28,692][52820] DAMAGECOUNT value on done: 180683.0 [2024-08-06 01:23:28,695][52820] Sum rewards: 56.313, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.155', 'weapon5': '0.216', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'HEALTH': '0.292', 'WEAPON4': '0.450', 'weapon2': '0.522', 'weapon4': '0.854', 'WEAPON3': '0.900', 'weapon3': '2.116', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '44.000'} [2024-08-06 01:23:29,236][52664] DAMAGECOUNT value on done: 202989.0 [2024-08-06 01:23:29,237][52664] Sum rewards: 58.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.039', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO4': '0.194', 'AMMO3': '0.257', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:29,686][52666] DAMAGECOUNT value on done: 189410.0 [2024-08-06 01:23:29,686][52666] Sum rewards: 56.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.106', 'weapon5': '0.122', 'AMMO4': '0.176', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.450', 'weapon3': '2.880', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:29,958][52663] DAMAGECOUNT value on done: 192958.0 [2024-08-06 01:23:29,958][52663] Sum rewards: 65.802, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.433', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.204', 'weapon5': '0.234', 'AMMO3': '0.245', 'weapon2': '0.322', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.776', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '58.000'} [2024-08-06 01:23:30,444][52647] DAMAGECOUNT value on done: 203179.0 [2024-08-06 01:23:30,444][52647] Sum rewards: 47.342, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'WEAPON3': '0.900', 'weapon2': '1.360', 'weapon3': '2.500', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '38.000'} [2024-08-06 01:23:30,570][52670] DAMAGECOUNT value on done: 194793.0 [2024-08-06 01:23:30,571][52670] Sum rewards: 61.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.056', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO4': '0.210', 'AMMO3': '0.218', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.234', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:30,738][52811] DAMAGECOUNT value on done: 184677.0 [2024-08-06 01:23:30,738][52811] Sum rewards: 63.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.150', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.902', 'WEAPON3': '1.200', 'weapon3': '2.624', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:30,808][52649] DAMAGECOUNT value on done: 189071.0 [2024-08-06 01:23:30,813][52649] Sum rewards: 67.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.236', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.144', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:30,937][52671] DAMAGECOUNT value on done: 199207.0 [2024-08-06 01:23:30,938][52671] Sum rewards: 57.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.702', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.052', 'weapon4': '0.090', 'weapon2': '0.172', 'AMMO3': '0.214', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.486', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:31,195][52650] Updated weights for policy 0, policy_version 30001 (0.0011) [2024-08-06 01:23:31,555][52664] DAMAGECOUNT value on done: 201724.0 [2024-08-06 01:23:31,558][52664] Sum rewards: 56.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.069', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.032', 'AMMO4': '0.128', 'weapon5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.900', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:31,628][52803] DAMAGECOUNT value on done: 183869.0 [2024-08-06 01:23:31,630][52803] Sum rewards: 64.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.018', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.184', 'weapon5': '0.208', 'weapon4': '0.264', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:31,824][52820] DAMAGECOUNT value on done: 177985.0 [2024-08-06 01:23:31,826][52820] Sum rewards: 60.901, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.072', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon5': '0.070', 'weapon4': '0.274', 'AMMO4': '0.278', 'AMMO3': '0.287', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.870', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:32,321][52666] DAMAGECOUNT value on done: 192492.0 [2024-08-06 01:23:32,321][52666] Sum rewards: 61.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.222', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 245792768. Throughput: 0: 4399.6. Samples: 61446510. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:23:32,794][52567] Avg episode reward: [(0, '59.275')] [2024-08-06 01:23:32,957][52647] DAMAGECOUNT value on done: 200799.0 [2024-08-06 01:23:32,957][52647] Sum rewards: 58.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO4': '0.169', 'AMMO3': '0.178', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.732', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:33,073][52663] DAMAGECOUNT value on done: 196529.0 [2024-08-06 01:23:33,075][52663] Sum rewards: 62.098, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.405', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.026', 'weapon5': '0.052', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.232', 'AMMO3': '0.249', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.444', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:33,298][52670] DAMAGECOUNT value on done: 195312.0 [2024-08-06 01:23:33,299][52670] Sum rewards: 55.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.606', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.189', 'weapon2': '0.434', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.947', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:33,780][52811] DAMAGECOUNT value on done: 183685.0 [2024-08-06 01:23:33,782][52811] Sum rewards: 66.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.008', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.136', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.828', 'WEAPON3': '1.250', 'weapon3': '2.760', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:33,885][52649] DAMAGECOUNT value on done: 195246.0 [2024-08-06 01:23:33,888][52649] Sum rewards: 53.206, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.206', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.340', 'WEAPON3': '1.650', 'weapon3': '2.974', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:33,996][52664] DAMAGECOUNT value on done: 201963.0 [2024-08-06 01:23:33,997][52664] Sum rewards: 68.217, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.705', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.090', 'AMMO4': '0.109', 'weapon5': '0.122', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.220', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '58.000'} [2024-08-06 01:23:34,055][52671] DAMAGECOUNT value on done: 198072.0 [2024-08-06 01:23:34,055][52671] Sum rewards: 54.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.530', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.176', 'AMMO3': '0.248', 'weapon4': '0.254', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.800', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:34,706][52803] DAMAGECOUNT value on done: 183676.0 [2024-08-06 01:23:34,707][52803] Sum rewards: 56.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.030', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO3': '0.167', 'AMMO4': '0.217', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.668', 'WEAPON3': '1.150', 'weapon3': '2.608', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:35,015][52820] DAMAGECOUNT value on done: 172434.0 [2024-08-06 01:23:35,017][52820] Sum rewards: 58.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.031', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.170', 'AMMO3': '0.203', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:35,090][52666] DAMAGECOUNT value on done: 192414.0 [2024-08-06 01:23:35,091][52666] Sum rewards: 60.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.028', 'AMMO4': '0.036', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.312', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.388', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:35,277][52647] DAMAGECOUNT value on done: 203745.0 [2024-08-06 01:23:35,279][52647] Sum rewards: 53.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.579', 'AMMO5': '0.008', 'AMMO2': '0.059', 'weapon5': '0.114', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.294', 'weapon2': '0.372', 'WEAPON4': '0.650', 'weapon4': '0.676', 'WEAPON3': '1.050', 'weapon3': '2.590', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '44.000'} [2024-08-06 01:23:35,902][52670] DAMAGECOUNT value on done: 194819.0 [2024-08-06 01:23:35,911][52670] Sum rewards: 67.005, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.486', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:36,163][52650] Updated weights for policy 0, policy_version 30011 (0.0012) [2024-08-06 01:23:36,209][52664] DAMAGECOUNT value on done: 204766.0 [2024-08-06 01:23:36,210][52664] Sum rewards: 35.400, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON7': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.050', 'weapon4': '1.064', 'HITCOUNT': '1.970', 'weapon3': '2.308', 'DAMAGECOUNT': '9.681', 'FRAGCOUNT': '31.000'} [2024-08-06 01:23:36,247][52663] DAMAGECOUNT value on done: 193382.0 [2024-08-06 01:23:36,248][52663] Sum rewards: 68.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.030', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.084', 'weapon4': '0.106', 'AMMO3': '0.184', 'AMMO4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.740', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:36,831][52811] DAMAGECOUNT value on done: 183108.0 [2024-08-06 01:23:36,832][52811] Sum rewards: 62.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.156', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.172', 'AMMO3': '0.219', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.874', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:36,987][52671] DAMAGECOUNT value on done: 194556.0 [2024-08-06 01:23:36,987][52671] Sum rewards: 51.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.049', 'weapon7': '0.052', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.243', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.908', 'WEAPON3': '1.100', 'weapon3': '2.236', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '43.000'} [2024-08-06 01:23:37,014][52649] DAMAGECOUNT value on done: 189563.0 [2024-08-06 01:23:37,014][52649] Sum rewards: 69.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO4': '0.093', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.204', 'weapon2': '0.228', 'weapon4': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:37,206][52794] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:23:37,426][52647] DAMAGECOUNT value on done: 198994.0 [2024-08-06 01:23:37,427][52647] Sum rewards: 62.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.878', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.239', 'weapon4': '0.348', 'weapon5': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.450', 'weapon3': '2.380', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:37,780][52659] DAMAGECOUNT value on done: 196221.0 [2024-08-06 01:23:37,781][52659] Sum rewards: 53.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.522', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'weapon4': '0.256', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.170', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 245874688. Throughput: 0: 4406.3. Samples: 61473020. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:23:37,795][52567] Avg episode reward: [(0, '59.056')] [2024-08-06 01:23:37,794][52803] DAMAGECOUNT value on done: 178280.0 [2024-08-06 01:23:37,796][52803] Sum rewards: 59.387, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.048', 'weapon5': '0.068', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'HEALTH': '0.382', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:38,179][52666] DAMAGECOUNT value on done: 195811.0 [2024-08-06 01:23:38,183][52666] Sum rewards: 57.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.570', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:38,193][52820] DAMAGECOUNT value on done: 181096.0 [2024-08-06 01:23:38,194][52820] Sum rewards: 50.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.345', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.276', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '3.220', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '45.000'} [2024-08-06 01:23:38,367][52664] DAMAGECOUNT value on done: 208392.0 [2024-08-06 01:23:38,369][52664] Sum rewards: 72.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon4': '0.098', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.205', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '62.000'} [2024-08-06 01:23:38,942][52663] DAMAGECOUNT value on done: 200581.0 [2024-08-06 01:23:38,942][52663] Sum rewards: 61.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.562', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.124', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.152', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:39,157][52670] DAMAGECOUNT value on done: 197303.0 [2024-08-06 01:23:39,158][52670] Sum rewards: 63.996, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.253', 'AMMO3': '0.285', 'weapon2': '0.324', 'weapon4': '0.408', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.876', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:39,835][52811] DAMAGECOUNT value on done: 187348.0 [2024-08-06 01:23:39,837][52811] Sum rewards: 66.376, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'weapon4': '0.078', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.180', 'AMMO3': '0.235', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.466', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:39,932][52671] DAMAGECOUNT value on done: 204996.0 [2024-08-06 01:23:39,933][52671] Sum rewards: 68.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.204', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.116', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.768', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:39,980][52647] DAMAGECOUNT value on done: 206306.0 [2024-08-06 01:23:39,980][52647] Sum rewards: 59.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.379', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.131', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.146', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:40,341][52649] DAMAGECOUNT value on done: 192255.0 [2024-08-06 01:23:40,341][52649] Sum rewards: 68.829, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.183', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:40,554][52659] DAMAGECOUNT value on done: 195404.0 [2024-08-06 01:23:40,558][52659] Sum rewards: 61.144, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.038', 'WEAPON5': '0.100', 'HEALTH': '0.115', 'weapon4': '0.128', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.666', 'WEAPON3': '0.850', 'weapon3': '3.038', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:40,687][52650] Updated weights for policy 0, policy_version 30021 (0.0011) [2024-08-06 01:23:40,841][52803] DAMAGECOUNT value on done: 183256.0 [2024-08-06 01:23:40,841][52803] Sum rewards: 59.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.842', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.144', 'weapon4': '0.178', 'AMMO3': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:40,979][52664] DAMAGECOUNT value on done: 197289.0 [2024-08-06 01:23:40,979][52664] Sum rewards: 64.860, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.422', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.326', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.304', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:41,294][52820] DAMAGECOUNT value on done: 177308.0 [2024-08-06 01:23:41,294][52820] Sum rewards: 60.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.675', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:41,313][52666] DAMAGECOUNT value on done: 190830.0 [2024-08-06 01:23:41,314][52666] Sum rewards: 44.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.231', 'weapon2': '0.566', 'WEAPON3': '1.400', 'HITCOUNT': '2.350', 'weapon3': '3.180', 'DAMAGECOUNT': '11.601', 'FRAGCOUNT': '40.000'} [2024-08-06 01:23:41,890][52663] DAMAGECOUNT value on done: 196087.0 [2024-08-06 01:23:41,891][52663] Sum rewards: 64.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.544', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.318', 'weapon4': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:41,918][52670] DAMAGECOUNT value on done: 185131.0 [2024-08-06 01:23:41,919][52670] Sum rewards: 56.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.242', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '3.020', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:42,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 245964800. Throughput: 0: 4401.3. Samples: 61499470. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:23:42,795][52567] Avg episode reward: [(0, '59.487')] [2024-08-06 01:23:42,858][52811] DAMAGECOUNT value on done: 184111.0 [2024-08-06 01:23:42,859][52811] Sum rewards: 63.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.194', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:42,927][52671] DAMAGECOUNT value on done: 196924.0 [2024-08-06 01:23:42,928][52671] Sum rewards: 66.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.044', 'weapon5': '0.094', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.000', 'weapon3': '3.240', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:43,363][52649] DAMAGECOUNT value on done: 193574.0 [2024-08-06 01:23:43,365][52649] Sum rewards: 66.293, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.264', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.088', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.526', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.586', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '53.000'} [2024-08-06 01:23:43,487][52664] DAMAGECOUNT value on done: 212176.0 [2024-08-06 01:23:43,489][52664] Sum rewards: 61.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.126', 'AMMO3': '0.205', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:43,541][52659] DAMAGECOUNT value on done: 196823.0 [2024-08-06 01:23:43,542][52659] Sum rewards: 69.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.030', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '61.000'} [2024-08-06 01:23:43,894][52803] DAMAGECOUNT value on done: 178775.0 [2024-08-06 01:23:43,896][52803] Sum rewards: 64.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.098', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:43,972][52666] DAMAGECOUNT value on done: 192512.0 [2024-08-06 01:23:43,973][52666] Sum rewards: 59.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.986', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'AMMO3': '0.277', 'weapon2': '0.670', 'WEAPON3': '1.650', 'weapon3': '3.150', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:44,476][52820] DAMAGECOUNT value on done: 181383.0 [2024-08-06 01:23:44,476][52820] Sum rewards: 64.414, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.304', 'HEALTH': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.610', 'WEAPON3': '0.850', 'weapon3': '2.750', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:44,786][52670] DAMAGECOUNT value on done: 196186.0 [2024-08-06 01:23:44,788][52670] Sum rewards: 51.050, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.364', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.082', 'weapon5': '0.090', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.818', 'WEAPON3': '1.400', 'weapon3': '2.750', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:45,067][52663] DAMAGECOUNT value on done: 195802.0 [2024-08-06 01:23:45,068][52663] Sum rewards: 61.201, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.142', 'weapon5': '0.156', 'AMMO4': '0.191', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.026', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:45,082][52650] Updated weights for policy 0, policy_version 30031 (0.0012) [2024-08-06 01:23:45,948][52811] DAMAGECOUNT value on done: 182775.0 [2024-08-06 01:23:45,948][52811] Sum rewards: 61.338, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.510', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.100', 'AMMO4': '0.135', 'weapon5': '0.146', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.076', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:45,982][52664] DAMAGECOUNT value on done: 206341.0 [2024-08-06 01:23:45,991][52664] Sum rewards: 51.445, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.273', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.192', 'weapon5': '0.204', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'weapon4': '0.458', 'weapon2': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.518', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:46,153][52671] DAMAGECOUNT value on done: 190315.0 [2024-08-06 01:23:46,155][52671] Sum rewards: 56.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon4': '0.600', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.518', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:46,581][52649] DAMAGECOUNT value on done: 188808.0 [2024-08-06 01:23:46,582][52649] Sum rewards: 63.849, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.400', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.130', 'weapon2': '0.218', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.354', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:46,846][52659] DAMAGECOUNT value on done: 196722.0 [2024-08-06 01:23:46,849][52659] Sum rewards: 60.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.059', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.180', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '49.000'} [2024-08-06 01:23:46,987][52803] DAMAGECOUNT value on done: 189119.0 [2024-08-06 01:23:46,987][52803] Sum rewards: 63.619, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.148', 'AMMO3': '0.156', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'weapon2': '0.388', 'weapon4': '0.446', 'HEALTH': '0.582', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.720', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:47,577][52670] DAMAGECOUNT value on done: 198985.0 [2024-08-06 01:23:47,577][52670] Sum rewards: 67.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.966', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.062', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon5': '0.276', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '57.500'} [2024-08-06 01:23:47,579][52820] DAMAGECOUNT value on done: 183811.0 [2024-08-06 01:23:47,581][52820] Sum rewards: 53.766, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.472', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.186', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.400', 'weapon2': '0.414', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 246054912. Throughput: 0: 4411.8. Samples: 61512920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:23:47,795][52567] Avg episode reward: [(0, '60.268')] [2024-08-06 01:23:47,947][52663] DAMAGECOUNT value on done: 194639.0 [2024-08-06 01:23:47,947][52663] Sum rewards: 68.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'weapon4': '0.464', 'weapon2': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.654', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:47,988][52665] DAMAGECOUNT value on done: 193437.0 [2024-08-06 01:23:47,990][52665] Sum rewards: 72.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.324', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '59.000'} [2024-08-06 01:23:48,832][52664] DAMAGECOUNT value on done: 205785.0 [2024-08-06 01:23:48,832][52664] Sum rewards: 70.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.206', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.560', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:48,967][52811] DAMAGECOUNT value on done: 189402.0 [2024-08-06 01:23:48,968][52811] Sum rewards: 62.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.111', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.120', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:49,006][52671] DAMAGECOUNT value on done: 200634.0 [2024-08-06 01:23:49,008][52671] Sum rewards: 57.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.027', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.130', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:49,553][52659] DAMAGECOUNT value on done: 195980.0 [2024-08-06 01:23:49,556][52659] Sum rewards: 54.493, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.348', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.191', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.852', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '47.500'} [2024-08-06 01:23:49,717][52649] DAMAGECOUNT value on done: 194183.0 [2024-08-06 01:23:49,717][52649] Sum rewards: 66.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon5': '0.198', 'AMMO3': '0.210', 'weapon4': '0.252', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:50,008][52650] Updated weights for policy 0, policy_version 30041 (0.0012) [2024-08-06 01:23:50,044][52803] DAMAGECOUNT value on done: 187620.0 [2024-08-06 01:23:50,045][52803] Sum rewards: 60.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.475', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon2': '0.196', 'weapon5': '0.200', 'AMMO3': '0.259', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.954', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:50,529][52670] DAMAGECOUNT value on done: 193531.0 [2024-08-06 01:23:50,532][52670] Sum rewards: 59.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.726', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'weapon4': '0.528', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.540', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:50,565][52820] DAMAGECOUNT value on done: 180771.0 [2024-08-06 01:23:50,566][52820] Sum rewards: 65.049, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'weapon5': '0.046', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'AMMO4': '0.291', 'weapon4': '0.386', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:50,622][52665] DAMAGECOUNT value on done: 198404.0 [2024-08-06 01:23:50,622][52665] Sum rewards: 53.738, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.724', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.116', 'AMMO3': '0.195', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.750', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '48.500'} [2024-08-06 01:23:50,890][52663] DAMAGECOUNT value on done: 197861.0 [2024-08-06 01:23:50,890][52663] Sum rewards: 74.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.707', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.167', 'weapon2': '0.246', 'WEAPON4': '0.450', 'weapon4': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '61.000'} [2024-08-06 01:23:51,670][52664] DAMAGECOUNT value on done: 201814.0 [2024-08-06 01:23:51,672][52664] Sum rewards: 56.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.084', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.496', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.212', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:51,744][52671] DAMAGECOUNT value on done: 200326.0 [2024-08-06 01:23:51,747][52671] Sum rewards: 57.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.045', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.558', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:52,075][52811] DAMAGECOUNT value on done: 184605.0 [2024-08-06 01:23:52,076][52811] Sum rewards: 58.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.207', 'weapon4': '0.208', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:52,439][52649] DAMAGECOUNT value on done: 192243.0 [2024-08-06 01:23:52,441][52649] Sum rewards: 58.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'ARMOR': '0.004', 'weapon4': '0.012', 'AMMO2': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.289', 'weapon2': '0.392', 'WEAPON3': '1.800', 'HITCOUNT': '3.050', 'weapon3': '3.390', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '52.000'} [2024-08-06 01:23:52,462][52659] DAMAGECOUNT value on done: 194178.0 [2024-08-06 01:23:52,463][52659] Sum rewards: 50.917, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.856', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.274', 'weapon2': '0.662', 'WEAPON3': '1.500', 'weapon3': '2.792', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '45.000'} [2024-08-06 01:23:52,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17613.6, 300 sec: 17522.5). Total num frames: 246136832. Throughput: 0: 4409.1. Samples: 61539380. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:23:52,794][52567] Avg episode reward: [(0, '60.539')] [2024-08-06 01:23:53,105][52803] DAMAGECOUNT value on done: 183447.0 [2024-08-06 01:23:53,105][52803] Sum rewards: 52.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.516', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.118', 'AMMO4': '0.122', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.488', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.834', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '43.000'} [2024-08-06 01:23:53,647][52670] DAMAGECOUNT value on done: 193599.0 [2024-08-06 01:23:53,648][52670] Sum rewards: 59.390, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.179', 'weapon2': '0.738', 'WEAPON3': '1.050', 'weapon3': '2.984', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '48.000'} [2024-08-06 01:23:53,694][52820] DAMAGECOUNT value on done: 183918.0 [2024-08-06 01:23:53,695][52820] Sum rewards: 65.683, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.568', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.288', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:53,697][52663] DAMAGECOUNT value on done: 197344.0 [2024-08-06 01:23:53,698][52663] Sum rewards: 59.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.524', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.306', 'weapon4': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:53,736][52665] DAMAGECOUNT value on done: 193905.0 [2024-08-06 01:23:53,737][52665] Sum rewards: 58.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.111', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.398', 'weapon4': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:54,535][52664] DAMAGECOUNT value on done: 199997.0 [2024-08-06 01:23:54,536][52664] Sum rewards: 69.797, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon4': '0.210', 'weapon2': '0.644', 'WEAPON3': '1.000', 'weapon3': '2.946', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:54,709][52671] DAMAGECOUNT value on done: 199729.0 [2024-08-06 01:23:54,710][52671] Sum rewards: 66.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.340', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.490', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:54,858][52650] Updated weights for policy 0, policy_version 30051 (0.0022) [2024-08-06 01:23:55,082][52811] DAMAGECOUNT value on done: 182702.0 [2024-08-06 01:23:55,083][52811] Sum rewards: 65.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.796', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.044', 'AMMO4': '0.135', 'weapon5': '0.180', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.000'} [2024-08-06 01:23:55,211][52659] DAMAGECOUNT value on done: 194590.0 [2024-08-06 01:23:55,211][52659] Sum rewards: 51.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.913', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon7': '0.218', 'weapon2': '0.280', 'weapon4': '0.508', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.802', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '44.000'} [2024-08-06 01:23:55,331][52649] DAMAGECOUNT value on done: 185750.0 [2024-08-06 01:23:55,333][52649] Sum rewards: 63.622, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.910', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.212', 'AMMO3': '0.229', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '55.000'} [2024-08-06 01:23:56,020][52664] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:23:56,119][52803] DAMAGECOUNT value on done: 186058.0 [2024-08-06 01:23:56,119][52803] Sum rewards: 53.165, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.808', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO4': '0.211', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:56,526][52665] DAMAGECOUNT value on done: 189052.0 [2024-08-06 01:23:56,527][52665] Sum rewards: 54.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.086', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '47.000'} [2024-08-06 01:23:56,740][52663] DAMAGECOUNT value on done: 195907.0 [2024-08-06 01:23:56,749][52663] Sum rewards: 58.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.068', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:56,803][52820] DAMAGECOUNT value on done: 181871.0 [2024-08-06 01:23:56,806][52820] Sum rewards: 48.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.650', 'AMMO5': '0.003', 'weapon5': '0.030', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.191', 'AMMO3': '0.216', 'weapon4': '0.438', 'WEAPON4': '0.450', 'weapon2': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.024', 'FRAGCOUNT': '45.000'} [2024-08-06 01:23:57,426][52664] DAMAGECOUNT value on done: 203074.0 [2024-08-06 01:23:57,428][52664] Sum rewards: 49.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.904', 'AMMO5': '0.004', 'weapon5': '0.042', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.218', 'WEAPON4': '0.550', 'weapon2': '0.558', 'weapon4': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '42.000'} [2024-08-06 01:23:57,434][52671] DAMAGECOUNT value on done: 199590.0 [2024-08-06 01:23:57,434][52671] Sum rewards: 51.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.126', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.498', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.206', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '43.000'} [2024-08-06 01:23:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 246226944. Throughput: 0: 4415.6. Samples: 61565800. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:23:57,794][52567] Avg episode reward: [(0, '60.162')] [2024-08-06 01:23:58,097][52659] DAMAGECOUNT value on done: 191612.0 [2024-08-06 01:23:58,097][52659] Sum rewards: 70.675, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'weapon4': '0.270', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'weapon2': '0.322', 'WEAPON3': '1.800', 'weapon3': '3.052', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '63.000'} [2024-08-06 01:23:58,152][52811] DAMAGECOUNT value on done: 184581.0 [2024-08-06 01:23:58,154][52811] Sum rewards: 66.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.052', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '56.000'} [2024-08-06 01:23:58,370][52649] DAMAGECOUNT value on done: 191934.0 [2024-08-06 01:23:58,374][52649] Sum rewards: 58.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '50.000'} [2024-08-06 01:23:58,695][52671] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:23:59,151][52650] Updated weights for policy 0, policy_version 30061 (0.0014) [2024-08-06 01:23:59,272][52803] DAMAGECOUNT value on done: 183381.0 [2024-08-06 01:23:59,272][52803] Sum rewards: 56.199, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.288', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon4': '0.226', 'weapon2': '0.710', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '46.000'} [2024-08-06 01:23:59,531][52665] DAMAGECOUNT value on done: 190404.0 [2024-08-06 01:23:59,533][52665] Sum rewards: 62.951, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.095', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.102', 'weapon2': '0.242', 'AMMO3': '0.343', 'WEAPON3': '2.050', 'weapon3': '3.440', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '57.000'} [2024-08-06 01:23:59,812][52663] DAMAGECOUNT value on done: 189651.0 [2024-08-06 01:23:59,812][52663] Sum rewards: 63.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.145', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.776', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '51.000'} [2024-08-06 01:23:59,974][52820] DAMAGECOUNT value on done: 185936.0 [2024-08-06 01:23:59,974][52820] Sum rewards: 69.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.086', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '58.000'} [2024-08-06 01:24:00,169][52664] DAMAGECOUNT value on done: 205396.0 [2024-08-06 01:24:00,170][52664] Sum rewards: 55.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.757', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.034', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.174', 'weapon2': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.142', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '47.000'} [2024-08-06 01:24:00,763][52649] DAMAGECOUNT value on done: 189802.0 [2024-08-06 01:24:00,763][52649] Sum rewards: 57.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.205', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.394', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.236', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '50.000'} [2024-08-06 01:24:00,893][52671] DAMAGECOUNT value on done: 195711.0 [2024-08-06 01:24:00,895][52671] Sum rewards: 55.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.951', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.134', 'AMMO4': '0.173', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.224', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '47.500'} [2024-08-06 01:24:01,064][52811] DAMAGECOUNT value on done: 182859.0 [2024-08-06 01:24:01,065][52811] Sum rewards: 62.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.199', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:01,503][52659] DAMAGECOUNT value on done: 198958.0 [2024-08-06 01:24:01,504][52659] Sum rewards: 63.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.419', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.187', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.482', 'weapon4': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:02,015][52665] DAMAGECOUNT value on done: 193464.0 [2024-08-06 01:24:02,019][52665] Sum rewards: 50.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.674', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.070', 'AMMO3': '0.169', 'weapon5': '0.204', 'AMMO4': '0.350', 'weapon2': '0.352', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.446', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '42.000'} [2024-08-06 01:24:02,426][52803] DAMAGECOUNT value on done: 180629.0 [2024-08-06 01:24:02,428][52803] Sum rewards: 58.320, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.986', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.121', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.632', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '3.000', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '47.000'} [2024-08-06 01:24:02,688][52664] DAMAGECOUNT value on done: 200792.0 [2024-08-06 01:24:02,690][52664] Sum rewards: 56.951, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.112', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.241', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.164', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '50.000'} [2024-08-06 01:24:02,703][52663] DAMAGECOUNT value on done: 188088.0 [2024-08-06 01:24:02,705][52663] Sum rewards: 59.595, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.346', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.126', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.303', 'weapon2': '0.368', 'WEAPON3': '1.750', 'weapon3': '3.062', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '54.000'} [2024-08-06 01:24:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 246325248. Throughput: 0: 4417.1. Samples: 61579180. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:24:02,795][52567] Avg episode reward: [(0, '60.292')] [2024-08-06 01:24:03,002][52820] DAMAGECOUNT value on done: 180601.0 [2024-08-06 01:24:03,003][52820] Sum rewards: 56.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.894', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.239', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '49.000'} [2024-08-06 01:24:03,796][52649] DAMAGECOUNT value on done: 197162.0 [2024-08-06 01:24:03,798][52649] Sum rewards: 53.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon2': '0.502', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '2.994', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '44.000'} [2024-08-06 01:24:04,096][52650] Updated weights for policy 0, policy_version 30071 (0.0041) [2024-08-06 01:24:04,103][52811] DAMAGECOUNT value on done: 186214.0 [2024-08-06 01:24:04,103][52811] Sum rewards: 54.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.731', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.296', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.440', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '46.000'} [2024-08-06 01:24:04,310][52659] DAMAGECOUNT value on done: 201559.0 [2024-08-06 01:24:04,313][52659] Sum rewards: 61.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.212', 'weapon2': '0.380', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.312', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '51.000'} [2024-08-06 01:24:04,748][52665] DAMAGECOUNT value on done: 195007.0 [2024-08-06 01:24:04,750][52665] Sum rewards: 47.799, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.186', 'weapon4': '0.246', 'weapon2': '0.250', 'AMMO3': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.870', 'weapon3': '3.054', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '43.000'} [2024-08-06 01:24:05,212][52664] DAMAGECOUNT value on done: 204450.0 [2024-08-06 01:24:05,213][52664] Sum rewards: 59.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.119', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:05,409][52803] DAMAGECOUNT value on done: 188536.0 [2024-08-06 01:24:05,409][52803] Sum rewards: 71.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '61.000'} [2024-08-06 01:24:05,937][52663] DAMAGECOUNT value on done: 196804.0 [2024-08-06 01:24:05,938][52663] Sum rewards: 68.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.184', 'weapon2': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.978', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '57.000'} [2024-08-06 01:24:06,134][52820] DAMAGECOUNT value on done: 183649.0 [2024-08-06 01:24:06,136][52820] Sum rewards: 59.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.683', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.221', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '51.000'} [2024-08-06 01:24:06,696][52649] DAMAGECOUNT value on done: 195381.0 [2024-08-06 01:24:06,696][52649] Sum rewards: 62.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.448', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '53.000'} [2024-08-06 01:24:07,209][52659] DAMAGECOUNT value on done: 194892.0 [2024-08-06 01:24:07,209][52659] Sum rewards: 54.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.300', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.273', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '48.000'} [2024-08-06 01:24:07,225][52811] DAMAGECOUNT value on done: 184380.0 [2024-08-06 01:24:07,226][52811] Sum rewards: 69.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '57.000'} [2024-08-06 01:24:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.2). Total num frames: 246407168. Throughput: 0: 4420.2. Samples: 61605790. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:24:07,794][52567] Avg episode reward: [(0, '60.439')] [2024-08-06 01:24:07,948][52665] DAMAGECOUNT value on done: 195152.0 [2024-08-06 01:24:07,949][52665] Sum rewards: 39.871, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.172', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.055', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'AMMO4': '0.277', 'weapon4': '0.394', 'weapon2': '0.446', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.450', 'weapon3': '2.782', 'DAMAGECOUNT': '11.517', 'FRAGCOUNT': '38.000'} [2024-08-06 01:24:07,955][52664] DAMAGECOUNT value on done: 207109.0 [2024-08-06 01:24:07,956][52664] Sum rewards: 61.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.545', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.602', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 01:24:08,332][52650] Updated weights for policy 0, policy_version 30081 (0.0020) [2024-08-06 01:24:08,383][52803] DAMAGECOUNT value on done: 183000.0 [2024-08-06 01:24:08,386][52803] Sum rewards: 67.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.004', 'weapon4': '0.006', 'AMMO2': '0.035', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.227', 'weapon2': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '3.460', 'weapon3': '3.516', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '58.000'} [2024-08-06 01:24:08,747][52663] DAMAGECOUNT value on done: 197489.0 [2024-08-06 01:24:08,748][52663] Sum rewards: 56.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.366', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.234', 'AMMO3': '0.245', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '48.000'} [2024-08-06 01:24:09,194][52820] DAMAGECOUNT value on done: 184292.0 [2024-08-06 01:24:09,197][52820] Sum rewards: 58.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.205', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'AMMO4': '0.240', 'weapon4': '0.308', 'WEAPON4': '0.450', 'weapon2': '0.596', 'WEAPON3': '1.450', 'weapon3': '2.656', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '51.000'} [2024-08-06 01:24:10,008][52649] DAMAGECOUNT value on done: 200705.0 [2024-08-06 01:24:10,008][52649] Sum rewards: 80.803, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.006', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.228', 'weapon2': '0.240', 'AMMO3': '0.325', 'WEAPON3': '2.000', 'weapon3': '3.254', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '72.000'} [2024-08-06 01:24:10,084][52659] DAMAGECOUNT value on done: 192281.0 [2024-08-06 01:24:10,085][52659] Sum rewards: 62.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.156', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '54.000'} [2024-08-06 01:24:10,278][52811] DAMAGECOUNT value on done: 184269.0 [2024-08-06 01:24:10,278][52811] Sum rewards: 67.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO2': '0.013', 'weapon4': '0.056', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.264', 'weapon2': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.486', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '59.000'} [2024-08-06 01:24:10,804][52664] DAMAGECOUNT value on done: 201814.0 [2024-08-06 01:24:10,805][52664] Sum rewards: 66.806, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.529', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon4': '0.182', 'weapon2': '0.570', 'WEAPON3': '0.900', 'weapon3': '3.078', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:11,091][52665] DAMAGECOUNT value on done: 199340.0 [2024-08-06 01:24:11,091][52665] Sum rewards: 63.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.814', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.098', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.034', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '54.000'} [2024-08-06 01:24:11,378][52803] DAMAGECOUNT value on done: 187868.0 [2024-08-06 01:24:11,381][52803] Sum rewards: 55.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.792', 'WEAPON3': '1.350', 'weapon3': '2.500', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '48.000'} [2024-08-06 01:24:11,633][52663] DAMAGECOUNT value on done: 198010.0 [2024-08-06 01:24:11,633][52663] Sum rewards: 46.451, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.006', 'AMMO5': '0.003', 'weapon5': '0.042', 'AMMO2': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'AMMO4': '0.313', 'weapon2': '0.516', 'WEAPON4': '0.650', 'weapon4': '0.874', 'WEAPON3': '1.150', 'weapon3': '2.248', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '42.000'} [2024-08-06 01:24:12,512][52820] DAMAGECOUNT value on done: 183607.0 [2024-08-06 01:24:12,513][52820] Sum rewards: 58.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'weapon5': '0.220', 'AMMO3': '0.232', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '50.000'} [2024-08-06 01:24:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 246497280. Throughput: 0: 4417.6. Samples: 61631990. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:24:12,794][52567] Avg episode reward: [(0, '60.322')] [2024-08-06 01:24:12,821][52659] DAMAGECOUNT value on done: 189701.0 [2024-08-06 01:24:12,822][52659] Sum rewards: 66.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.149', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '57.000'} [2024-08-06 01:24:13,244][52650] Updated weights for policy 0, policy_version 30091 (0.0018) [2024-08-06 01:24:13,347][52811] DAMAGECOUNT value on done: 182832.0 [2024-08-06 01:24:13,348][52811] Sum rewards: 61.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.175', 'weapon2': '0.264', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '52.500'} [2024-08-06 01:24:13,573][52664] DAMAGECOUNT value on done: 203845.0 [2024-08-06 01:24:13,573][52664] Sum rewards: 57.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.272', 'AMMO5': '0.015', 'AMMO2': '0.072', 'AMMO3': '0.159', 'weapon5': '0.166', 'WEAPON5': '0.350', 'AMMO4': '0.359', 'weapon2': '0.400', 'weapon4': '0.664', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.410', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '48.000'} [2024-08-06 01:24:13,882][52665] DAMAGECOUNT value on done: 196093.0 [2024-08-06 01:24:13,882][52665] Sum rewards: 65.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.034', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.214', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '56.000'} [2024-08-06 01:24:14,411][52803] DAMAGECOUNT value on done: 178889.0 [2024-08-06 01:24:14,414][52803] Sum rewards: 55.064, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.830', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.174', 'AMMO3': '0.243', 'weapon5': '0.254', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.754', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '48.000'} [2024-08-06 01:24:14,474][52663] DAMAGECOUNT value on done: 200107.0 [2024-08-06 01:24:14,474][52663] Sum rewards: 60.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.255', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.246', 'weapon2': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:15,583][52820] DAMAGECOUNT value on done: 180083.0 [2024-08-06 01:24:15,585][52820] Sum rewards: 54.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.025', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.142', 'AMMO3': '0.214', 'WEAPON3': '1.450', 'HITCOUNT': '2.680', 'weapon3': '3.626', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '47.000'} [2024-08-06 01:24:15,750][52659] DAMAGECOUNT value on done: 195871.0 [2024-08-06 01:24:15,750][52659] Sum rewards: 50.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.866', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.190', 'weapon5': '0.196', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.350', 'weapon4': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '2.762', 'DAMAGECOUNT': '13.776', 'FRAGCOUNT': '45.000'} [2024-08-06 01:24:16,404][52811] DAMAGECOUNT value on done: 186235.0 [2024-08-06 01:24:16,405][52811] Sum rewards: 68.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.000', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.163', 'weapon4': '0.220', 'weapon2': '0.342', 'WEAPON3': '1.000', 'weapon3': '3.166', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '55.000'} [2024-08-06 01:24:16,582][52665] DAMAGECOUNT value on done: 199635.0 [2024-08-06 01:24:16,583][52665] Sum rewards: 61.450, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.931', 'AMMO5': '0.006', 'weapon5': '0.044', 'AMMO2': '0.047', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO4': '0.232', 'AMMO3': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '55.000'} [2024-08-06 01:24:17,018][52663] DAMAGECOUNT value on done: 198963.0 [2024-08-06 01:24:17,019][52663] Sum rewards: 69.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.140', 'weapon4': '0.146', 'AMMO4': '0.157', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.000', 'weapon3': '3.246', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '55.000'} [2024-08-06 01:24:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 246579200. Throughput: 0: 4419.6. Samples: 61645390. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:24:17,794][52567] Avg episode reward: [(0, '60.270')] [2024-08-06 01:24:18,123][52650] Updated weights for policy 0, policy_version 30101 (0.0027) [2024-08-06 01:24:18,533][52659] DAMAGECOUNT value on done: 198915.0 [2024-08-06 01:24:18,533][52659] Sum rewards: 64.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '53.000'} [2024-08-06 01:24:18,865][52820] DAMAGECOUNT value on done: 186894.0 [2024-08-06 01:24:18,865][52820] Sum rewards: 55.191, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.148', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.154', 'AMMO4': '0.185', 'weapon4': '0.234', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '51.000'} [2024-08-06 01:24:18,935][52665] DAMAGECOUNT value on done: 198226.0 [2024-08-06 01:24:18,937][52665] Sum rewards: 46.970, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.324', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.232', 'weapon4': '0.284', 'AMMO3': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.650', 'weapon3': '2.648', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '44.500'} [2024-08-06 01:24:19,390][52811] DAMAGECOUNT value on done: 182778.0 [2024-08-06 01:24:19,390][52811] Sum rewards: 64.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.639', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.078', 'weapon4': '0.092', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 01:24:19,556][52663] DAMAGECOUNT value on done: 194514.0 [2024-08-06 01:24:19,556][52663] Sum rewards: 77.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.306', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.233', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '65.000'} [2024-08-06 01:24:21,398][52659] DAMAGECOUNT value on done: 200607.0 [2024-08-06 01:24:21,399][52659] Sum rewards: 57.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.675', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.209', 'weapon4': '0.402', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '2.892', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '51.000'} [2024-08-06 01:24:21,901][52820] DAMAGECOUNT value on done: 189141.0 [2024-08-06 01:24:21,902][52820] Sum rewards: 59.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.413', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.256', 'weapon2': '0.270', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.132', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:22,038][52665] DAMAGECOUNT value on done: 194965.0 [2024-08-06 01:24:22,040][52665] Sum rewards: 62.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.212', 'weapon2': '0.316', 'WEAPON4': '0.500', 'weapon4': '0.830', 'WEAPON3': '1.250', 'weapon3': '2.438', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '54.000'} [2024-08-06 01:24:22,411][52650] Updated weights for policy 0, policy_version 30111 (0.0020) [2024-08-06 01:24:22,572][52811] DAMAGECOUNT value on done: 186884.0 [2024-08-06 01:24:22,573][52811] Sum rewards: 66.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '54.000'} [2024-08-06 01:24:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 246669312. Throughput: 0: 4415.3. Samples: 61671710. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 01:24:22,795][52567] Avg episode reward: [(0, '60.371')] [2024-08-06 01:24:24,337][52659] DAMAGECOUNT value on done: 201016.0 [2024-08-06 01:24:24,338][52659] Sum rewards: 72.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.149', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.046', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '61.000'} [2024-08-06 01:24:24,870][52665] DAMAGECOUNT value on done: 195176.0 [2024-08-06 01:24:24,873][52665] Sum rewards: 59.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'ARMOR': '0.005', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.150', 'AMMO3': '0.156', 'weapon5': '0.290', 'AMMO4': '0.299', 'weapon2': '0.370', 'WEAPON5': '0.400', 'weapon4': '0.580', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.196', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '50.500'} [2024-08-06 01:24:25,003][52820] DAMAGECOUNT value on done: 180040.0 [2024-08-06 01:24:25,004][52820] Sum rewards: 60.792, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.648', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.116', 'AMMO4': '0.161', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.904', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '50.000'} [2024-08-06 01:24:27,096][52665] DAMAGECOUNT value on done: 194047.0 [2024-08-06 01:24:27,098][52665] Sum rewards: 47.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.032', 'AMMO5': '0.010', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.201', 'weapon5': '0.238', 'weapon4': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.608', 'WEAPON3': '0.900', 'weapon3': '2.478', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '11.313', 'FRAGCOUNT': '40.000'} [2024-08-06 01:24:27,291][52650] Updated weights for policy 0, policy_version 30121 (0.0011) [2024-08-06 01:24:27,684][52659] DAMAGECOUNT value on done: 196317.0 [2024-08-06 01:24:27,685][52659] Sum rewards: 67.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.110', 'AMMO3': '0.172', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.378', 'weapon4': '0.454', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '56.000'} [2024-08-06 01:24:27,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 246767616. Throughput: 0: 4407.1. Samples: 61697790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:24:27,794][52567] Avg episode reward: [(0, '60.322')] [2024-08-06 01:24:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030123_246767616.pth... [2024-08-06 01:24:27,922][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029607_242540544.pth [2024-08-06 01:24:29,896][52659] DAMAGECOUNT value on done: 200901.0 [2024-08-06 01:24:29,897][52659] Sum rewards: 53.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.384', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.242', 'weapon2': '0.270', 'weapon4': '0.270', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.190', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '48.000'} [2024-08-06 01:24:30,075][52614] Signal inference workers to stop experience collection... (5500 times) [2024-08-06 01:24:30,076][52614] Signal inference workers to resume experience collection... (5500 times) [2024-08-06 01:24:30,133][52650] InferenceWorker_p0-w0: stopping experience collection (5500 times) [2024-08-06 01:24:30,139][52650] InferenceWorker_p0-w0: resuming experience collection (5500 times) [2024-08-06 01:24:30,547][52665] DAMAGECOUNT value on done: 192686.0 [2024-08-06 01:24:30,548][52665] Sum rewards: 58.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.046', 'AMMO4': '0.188', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.382', 'weapon2': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '50.000'} [2024-08-06 01:24:31,155][52664] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:24:31,993][52650] Updated weights for policy 0, policy_version 30131 (0.0026) [2024-08-06 01:24:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 246841344. Throughput: 0: 4397.8. Samples: 61710820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:24:32,795][52567] Avg episode reward: [(0, '60.221')] [2024-08-06 01:24:33,278][52659] DAMAGECOUNT value on done: 200656.0 [2024-08-06 01:24:33,280][52659] Sum rewards: 53.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.180', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.354', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '47.000'} [2024-08-06 01:24:33,468][52665] DAMAGECOUNT value on done: 193491.0 [2024-08-06 01:24:33,470][52665] Sum rewards: 59.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.412', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.280', 'weapon4': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '49.000'} [2024-08-06 01:24:36,529][52650] Updated weights for policy 0, policy_version 30141 (0.0013) [2024-08-06 01:24:36,538][52665] DAMAGECOUNT value on done: 190409.0 [2024-08-06 01:24:36,539][52665] Sum rewards: 61.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.132', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.352', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 246931456. Throughput: 0: 4384.9. Samples: 61736700. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:24:37,802][52567] Avg episode reward: [(0, '59.915')] [2024-08-06 01:24:38,421][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:24:39,636][52665] DAMAGECOUNT value on done: 196669.0 [2024-08-06 01:24:39,636][52665] Sum rewards: 68.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.102', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.228', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '57.000'} [2024-08-06 01:24:41,467][52668] DAMAGECOUNT value on done: 195340.0 [2024-08-06 01:24:41,467][52668] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.454', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.358', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.348', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '55.000'} [2024-08-06 01:24:41,671][52650] Updated weights for policy 0, policy_version 30151 (0.0026) [2024-08-06 01:24:41,888][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:24:42,661][52665] DAMAGECOUNT value on done: 193705.0 [2024-08-06 01:24:42,663][52665] Sum rewards: 72.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.176', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '60.000'} [2024-08-06 01:24:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 247021568. Throughput: 0: 4380.0. Samples: 61762900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 01:24:42,794][52567] Avg episode reward: [(0, '60.211')] [2024-08-06 01:24:44,492][52668] DAMAGECOUNT value on done: 202684.0 [2024-08-06 01:24:44,492][52668] Sum rewards: 61.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.120', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.230', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '53.000'} [2024-08-06 01:24:45,913][52650] Updated weights for policy 0, policy_version 30161 (0.0056) [2024-08-06 01:24:47,652][52668] DAMAGECOUNT value on done: 199989.0 [2024-08-06 01:24:47,654][52668] Sum rewards: 60.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.983', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.214', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '52.000'} [2024-08-06 01:24:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.4). Total num frames: 247103488. Throughput: 0: 4378.0. Samples: 61776190. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:24:47,794][52567] Avg episode reward: [(0, '60.234')] [2024-08-06 01:24:49,830][52662] DAMAGECOUNT value on done: 202902.0 [2024-08-06 01:24:49,830][52662] Sum rewards: 63.824, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.076', 'AMMO4': '0.141', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.328', 'weapon4': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '54.000'} [2024-08-06 01:24:50,432][52668] DAMAGECOUNT value on done: 201571.0 [2024-08-06 01:24:50,434][52668] Sum rewards: 63.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.061', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.070', 'AMMO3': '0.198', 'AMMO4': '0.219', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '53.000'} [2024-08-06 01:24:50,809][52650] Updated weights for policy 0, policy_version 30171 (0.0013) [2024-08-06 01:24:52,763][52662] DAMAGECOUNT value on done: 205416.0 [2024-08-06 01:24:52,771][52662] Sum rewards: 52.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.181', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.372', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '44.000'} [2024-08-06 01:24:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 247193600. Throughput: 0: 4364.2. Samples: 61802180. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:24:52,794][52567] Avg episode reward: [(0, '60.322')] [2024-08-06 01:24:53,437][52668] DAMAGECOUNT value on done: 194612.0 [2024-08-06 01:24:53,438][52668] Sum rewards: 55.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.104', 'AMMO5': '0.011', 'AMMO2': '0.043', 'AMMO3': '0.148', 'weapon5': '0.200', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.442', 'WEAPON4': '0.550', 'weapon2': '0.806', 'WEAPON3': '1.000', 'weapon3': '2.218', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '44.500'} [2024-08-06 01:24:55,296][52650] Updated weights for policy 0, policy_version 30181 (0.0012) [2024-08-06 01:24:55,738][52662] DAMAGECOUNT value on done: 203034.0 [2024-08-06 01:24:55,738][52662] Sum rewards: 52.653, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.412', 'ARMOR': '0.004', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon4': '0.120', 'AMMO3': '0.279', 'weapon2': '0.392', 'WEAPON3': '1.850', 'HITCOUNT': '2.970', 'weapon3': '3.270', 'DAMAGECOUNT': '13.443', 'FRAGCOUNT': '51.000'} [2024-08-06 01:24:56,518][52668] DAMAGECOUNT value on done: 197185.0 [2024-08-06 01:24:56,520][52668] Sum rewards: 61.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.172', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2024-08-06 01:24:57,016][52660] DAMAGECOUNT value on done: 195798.0 [2024-08-06 01:24:57,018][52660] Sum rewards: 49.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.212', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.154', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '2.620', 'weapon3': '2.928', 'DAMAGECOUNT': '12.189', 'FRAGCOUNT': '41.000'} [2024-08-06 01:24:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 247283712. Throughput: 0: 4373.3. Samples: 61828790. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:24:57,795][52567] Avg episode reward: [(0, '60.001')] [2024-08-06 01:24:58,725][52662] DAMAGECOUNT value on done: 194784.0 [2024-08-06 01:24:58,725][52662] Sum rewards: 66.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.222', 'AMMO3': '0.224', 'weapon4': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '57.000'} [2024-08-06 01:24:58,851][52667] DAMAGECOUNT value on done: 199380.0 [2024-08-06 01:24:58,852][52667] Sum rewards: 74.275, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon2': '0.256', 'AMMO3': '0.282', 'weapon4': '0.288', 'WEAPON3': '1.750', 'weapon3': '3.050', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '66.000'} [2024-08-06 01:24:59,466][52668] DAMAGECOUNT value on done: 196490.0 [2024-08-06 01:24:59,469][52668] Sum rewards: 57.238, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.096', 'AMMO3': '0.098', 'WEAPON5': '0.200', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon2': '0.834', 'weapon3': '2.726', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '44.000'} [2024-08-06 01:24:59,980][52650] Updated weights for policy 0, policy_version 30191 (0.0026) [2024-08-06 01:25:00,056][52660] DAMAGECOUNT value on done: 194378.0 [2024-08-06 01:25:00,056][52660] Sum rewards: 60.346, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.704', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.146', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.100', 'weapon3': '2.570', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:01,728][52662] DAMAGECOUNT value on done: 202588.0 [2024-08-06 01:25:01,728][52662] Sum rewards: 59.831, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.029', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.149', 'weapon4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.736', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '49.000'} [2024-08-06 01:25:02,061][52667] DAMAGECOUNT value on done: 198913.0 [2024-08-06 01:25:02,062][52667] Sum rewards: 58.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.092', 'weapon4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.560', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.072', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:02,392][52668] DAMAGECOUNT value on done: 200636.0 [2024-08-06 01:25:02,394][52668] Sum rewards: 47.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.037', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.130', 'AMMO4': '0.158', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.500', 'weapon3': '2.846', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '42.500'} [2024-08-06 01:25:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 247373824. Throughput: 0: 4371.8. Samples: 61842120. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 01:25:02,794][52567] Avg episode reward: [(0, '60.081')] [2024-08-06 01:25:02,901][52660] DAMAGECOUNT value on done: 198908.0 [2024-08-06 01:25:02,904][52660] Sum rewards: 68.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.848', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon2': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon4': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '58.000'} [2024-08-06 01:25:04,663][52667] DAMAGECOUNT value on done: 200122.0 [2024-08-06 01:25:04,664][52667] Sum rewards: 55.652, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.530', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.112', 'AMMO4': '0.156', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.306', 'WEAPON3': '1.750', 'HITCOUNT': '3.100', 'weapon3': '3.108', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:04,702][52650] Updated weights for policy 0, policy_version 30201 (0.0023) [2024-08-06 01:25:04,855][52662] DAMAGECOUNT value on done: 198834.0 [2024-08-06 01:25:04,859][52662] Sum rewards: 51.755, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.105', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.268', 'weapon4': '0.432', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.576', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.069', 'FRAGCOUNT': '44.000'} [2024-08-06 01:25:05,402][52668] DAMAGECOUNT value on done: 197922.0 [2024-08-06 01:25:05,402][52668] Sum rewards: 51.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.104', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.038', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'AMMO4': '0.188', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '44.000'} [2024-08-06 01:25:05,862][52660] DAMAGECOUNT value on done: 200636.0 [2024-08-06 01:25:05,866][52660] Sum rewards: 64.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO2': '0.035', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'weapon2': '0.198', 'AMMO3': '0.253', 'weapon4': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:07,363][52662] DAMAGECOUNT value on done: 203052.0 [2024-08-06 01:25:07,363][52662] Sum rewards: 55.986, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO2': '0.005', 'AMMO5': '0.013', 'AMMO4': '0.027', 'weapon5': '0.042', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.652', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:07,424][52667] DAMAGECOUNT value on done: 195386.0 [2024-08-06 01:25:07,425][52667] Sum rewards: 58.405, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'weapon5': '0.004', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.884', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '48.000'} [2024-08-06 01:25:07,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.1, 300 sec: 17550.3). Total num frames: 247455744. Throughput: 0: 4368.9. Samples: 61868310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:25:07,802][52567] Avg episode reward: [(0, '60.028')] [2024-08-06 01:25:08,377][52668] DAMAGECOUNT value on done: 202171.0 [2024-08-06 01:25:08,379][52668] Sum rewards: 77.570, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.400', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'weapon2': '0.282', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.384', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '68.000'} [2024-08-06 01:25:08,969][52660] DAMAGECOUNT value on done: 197533.0 [2024-08-06 01:25:08,971][52660] Sum rewards: 68.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.504', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.114', 'weapon4': '0.134', 'AMMO3': '0.179', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '57.000'} [2024-08-06 01:25:09,411][52650] Updated weights for policy 0, policy_version 30211 (0.0026) [2024-08-06 01:25:10,457][52667] DAMAGECOUNT value on done: 199264.0 [2024-08-06 01:25:10,457][52667] Sum rewards: 51.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.464', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.766', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '44.000'} [2024-08-06 01:25:10,545][52662] DAMAGECOUNT value on done: 206305.0 [2024-08-06 01:25:10,547][52662] Sum rewards: 53.910, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.654', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.228', 'AMMO4': '0.230', 'AMMO3': '0.243', 'WEAPON4': '0.500', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.864', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:11,607][52668] DAMAGECOUNT value on done: 199128.0 [2024-08-06 01:25:11,608][52668] Sum rewards: 52.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.167', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.168', 'weapon5': '0.210', 'AMMO4': '0.225', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.584', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.668', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '44.000'} [2024-08-06 01:25:12,080][52660] DAMAGECOUNT value on done: 196973.0 [2024-08-06 01:25:12,081][52660] Sum rewards: 58.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.014', 'AMMO2': '0.063', 'AMMO3': '0.190', 'weapon5': '0.214', 'AMMO4': '0.315', 'WEAPON5': '0.400', 'weapon2': '0.410', 'weapon4': '0.786', 'WEAPON4': '0.900', 'WEAPON3': '1.150', 'weapon3': '2.202', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:12,365][52669] DAMAGECOUNT value on done: 201846.0 [2024-08-06 01:25:12,365][52669] Sum rewards: 61.419, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.922', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.074', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'weapon4': '0.472', 'weapon2': '0.530', 'WEAPON3': '1.650', 'weapon3': '2.644', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '53.500'} [2024-08-06 01:25:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 247545856. Throughput: 0: 4373.3. Samples: 61894590. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:25:12,794][52567] Avg episode reward: [(0, '60.257')] [2024-08-06 01:25:13,295][52794] DAMAGECOUNT value on done: 202184.0 [2024-08-06 01:25:13,297][52794] Sum rewards: 65.565, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.092', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:13,418][52667] DAMAGECOUNT value on done: 199506.0 [2024-08-06 01:25:13,421][52667] Sum rewards: 62.962, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.173', 'HEALTH': '0.182', 'AMMO4': '0.234', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.822', 'WEAPON3': '0.950', 'weapon3': '2.410', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:13,567][52662] DAMAGECOUNT value on done: 200501.0 [2024-08-06 01:25:13,569][52662] Sum rewards: 58.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:14,084][52650] Updated weights for policy 0, policy_version 30221 (0.0027) [2024-08-06 01:25:14,578][52668] DAMAGECOUNT value on done: 194271.0 [2024-08-06 01:25:14,578][52668] Sum rewards: 43.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.112', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.464', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '2.950', 'DAMAGECOUNT': '11.547', 'FRAGCOUNT': '40.000'} [2024-08-06 01:25:15,126][52660] DAMAGECOUNT value on done: 198852.0 [2024-08-06 01:25:15,127][52660] Sum rewards: 62.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.039', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.130', 'AMMO3': '0.229', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.334', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:15,253][52669] DAMAGECOUNT value on done: 196555.0 [2024-08-06 01:25:15,253][52669] Sum rewards: 68.206, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.002', 'AMMO4': '0.010', 'HEALTH': '0.096', 'AMMO3': '0.151', 'weapon2': '0.514', 'WEAPON3': '0.900', 'HITCOUNT': '3.230', 'weapon3': '3.336', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:16,498][52794] DAMAGECOUNT value on done: 205105.0 [2024-08-06 01:25:16,499][52794] Sum rewards: 51.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.910', 'AMMO5': '0.008', 'weapon5': '0.020', 'AMMO2': '0.032', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.892', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '45.000'} [2024-08-06 01:25:16,560][52667] DAMAGECOUNT value on done: 201597.0 [2024-08-06 01:25:16,560][52667] Sum rewards: 60.056, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.376', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.242', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.136', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:16,675][52662] DAMAGECOUNT value on done: 208260.0 [2024-08-06 01:25:16,676][52662] Sum rewards: 59.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.964', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.178', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.092', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:17,520][52668] DAMAGECOUNT value on done: 189140.0 [2024-08-06 01:25:17,522][52668] Sum rewards: 63.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO4': '0.140', 'weapon2': '0.198', 'weapon4': '0.224', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 247635968. Throughput: 0: 4375.1. Samples: 61907700. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:25:17,794][52567] Avg episode reward: [(0, '60.229')] [2024-08-06 01:25:17,919][52660] DAMAGECOUNT value on done: 201635.0 [2024-08-06 01:25:17,921][52660] Sum rewards: 64.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.124', 'AMMO3': '0.216', 'AMMO4': '0.256', 'weapon4': '0.356', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:17,996][52669] DAMAGECOUNT value on done: 201226.0 [2024-08-06 01:25:17,997][52669] Sum rewards: 66.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.416', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:18,675][52650] Updated weights for policy 0, policy_version 30231 (0.0012) [2024-08-06 01:25:19,320][52794] DAMAGECOUNT value on done: 199108.0 [2024-08-06 01:25:19,322][52794] Sum rewards: 58.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.735', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.182', 'weapon5': '0.186', 'weapon4': '0.282', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.004', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '49.000'} [2024-08-06 01:25:19,540][52667] DAMAGECOUNT value on done: 197384.0 [2024-08-06 01:25:19,541][52667] Sum rewards: 64.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.062', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:19,583][52662] DAMAGECOUNT value on done: 199737.0 [2024-08-06 01:25:19,584][52662] Sum rewards: 71.806, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.113', 'AMMO3': '0.158', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.276', 'HEALTH': '0.470', 'WEAPON3': '0.850', 'weapon3': '3.260', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '57.000'} [2024-08-06 01:25:20,313][52669] DAMAGECOUNT value on done: 197002.0 [2024-08-06 01:25:20,314][52669] Sum rewards: 57.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.697', 'ARMOR': '0.004', 'AMMO5': '0.010', 'weapon5': '0.044', 'AMMO2': '0.048', 'WEAPON5': '0.200', 'AMMO4': '0.239', 'weapon4': '0.268', 'AMMO3': '0.274', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.064', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '52.000'} [2024-08-06 01:25:20,486][52668] DAMAGECOUNT value on done: 195265.0 [2024-08-06 01:25:20,487][52668] Sum rewards: 64.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.723', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO4': '0.153', 'AMMO3': '0.228', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:21,043][52660] DAMAGECOUNT value on done: 201169.0 [2024-08-06 01:25:21,044][52660] Sum rewards: 58.199, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '49.000'} [2024-08-06 01:25:22,007][52667] DAMAGECOUNT value on done: 197416.0 [2024-08-06 01:25:22,008][52667] Sum rewards: 58.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.890', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '49.000'} [2024-08-06 01:25:22,209][52794] DAMAGECOUNT value on done: 200142.0 [2024-08-06 01:25:22,210][52794] Sum rewards: 59.250, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.500', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'AMMO3': '0.248', 'weapon2': '0.274', 'weapon4': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.946', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '52.000'} [2024-08-06 01:25:22,480][52662] DAMAGECOUNT value on done: 200696.0 [2024-08-06 01:25:22,481][52662] Sum rewards: 48.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.702', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.924', 'FRAGCOUNT': '44.000'} [2024-08-06 01:25:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 247726080. Throughput: 0: 4391.5. Samples: 61934320. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:25:22,794][52567] Avg episode reward: [(0, '60.453')] [2024-08-06 01:25:23,007][52669] DAMAGECOUNT value on done: 197799.0 [2024-08-06 01:25:23,009][52669] Sum rewards: 56.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.640', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '49.500'} [2024-08-06 01:25:23,408][52650] Updated weights for policy 0, policy_version 30241 (0.0020) [2024-08-06 01:25:23,928][52668] DAMAGECOUNT value on done: 194331.0 [2024-08-06 01:25:23,928][52668] Sum rewards: 65.204, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.214', 'AMMO3': '0.283', 'WEAPON4': '0.450', 'weapon2': '0.464', 'weapon4': '0.578', 'WEAPON3': '1.650', 'weapon3': '2.594', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:24,463][52660] DAMAGECOUNT value on done: 197067.0 [2024-08-06 01:25:24,466][52660] Sum rewards: 65.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.132', 'AMMO3': '0.182', 'AMMO4': '0.188', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:24,678][52667] DAMAGECOUNT value on done: 202097.0 [2024-08-06 01:25:24,678][52667] Sum rewards: 54.866, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.642', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon5': '0.194', 'weapon4': '0.244', 'AMMO3': '0.257', 'AMMO4': '0.295', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:25,281][52794] DAMAGECOUNT value on done: 199817.0 [2024-08-06 01:25:25,283][52794] Sum rewards: 60.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.504', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.596', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.116', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:25,507][52662] DAMAGECOUNT value on done: 198561.0 [2024-08-06 01:25:25,508][52662] Sum rewards: 55.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.508', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.566', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '48.500'} [2024-08-06 01:25:26,157][52669] DAMAGECOUNT value on done: 196680.0 [2024-08-06 01:25:26,160][52669] Sum rewards: 62.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.304', 'WEAPON4': '0.500', 'weapon4': '0.728', 'WEAPON3': '1.500', 'weapon3': '2.472', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:27,050][52668] DAMAGECOUNT value on done: 199221.0 [2024-08-06 01:25:27,052][52668] Sum rewards: 60.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'weapon7': '0.162', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.212', 'weapon2': '0.342', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:27,584][52667] DAMAGECOUNT value on done: 200573.0 [2024-08-06 01:25:27,584][52667] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.318', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.418', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '63.000'} [2024-08-06 01:25:27,590][52660] DAMAGECOUNT value on done: 203769.0 [2024-08-06 01:25:27,592][52660] Sum rewards: 66.498, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.702', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.044', 'weapon7': '0.064', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.267', 'weapon2': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.696', 'WEAPON3': '1.550', 'weapon3': '2.584', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '58.000'} [2024-08-06 01:25:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17578.1). Total num frames: 247808000. Throughput: 0: 4395.1. Samples: 61960680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:25:27,794][52567] Avg episode reward: [(0, '60.548')] [2024-08-06 01:25:27,842][52794] DAMAGECOUNT value on done: 200763.0 [2024-08-06 01:25:27,842][52794] Sum rewards: 65.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:28,098][52650] Updated weights for policy 0, policy_version 30251 (0.0012) [2024-08-06 01:25:28,157][52662] DAMAGECOUNT value on done: 206302.0 [2024-08-06 01:25:28,157][52662] Sum rewards: 63.054, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.496', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.083', 'AMMO3': '0.266', 'weapon2': '0.288', 'WEAPON3': '1.500', 'weapon3': '3.426', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:28,538][52669] DAMAGECOUNT value on done: 199246.0 [2024-08-06 01:25:28,539][52669] Sum rewards: 52.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.581', 'AMMO5': '0.007', 'AMMO2': '0.058', 'weapon5': '0.120', 'AMMO3': '0.213', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO4': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '45.000'} [2024-08-06 01:25:30,229][52668] DAMAGECOUNT value on done: 195072.0 [2024-08-06 01:25:30,229][52668] Sum rewards: 53.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.153', 'weapon5': '0.178', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.350', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.788', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:30,239][52667] DAMAGECOUNT value on done: 198017.0 [2024-08-06 01:25:30,250][52667] Sum rewards: 64.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.615', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.052', 'AMMO3': '0.147', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:30,831][52794] DAMAGECOUNT value on done: 205439.0 [2024-08-06 01:25:30,834][52794] Sum rewards: 62.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.105', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.178', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '2.990', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:30,917][52660] DAMAGECOUNT value on done: 192491.0 [2024-08-06 01:25:30,917][52660] Sum rewards: 53.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.474', 'WEAPON3': '1.550', 'weapon3': '2.858', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:31,137][52662] DAMAGECOUNT value on done: 203139.0 [2024-08-06 01:25:31,139][52662] Sum rewards: 66.123, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.370', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.268', 'weapon4': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:31,503][52669] DAMAGECOUNT value on done: 198290.0 [2024-08-06 01:25:31,503][52669] Sum rewards: 57.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO2': '0.012', 'AMMO4': '0.057', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.374', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.000'} [2024-08-06 01:25:32,727][52667] DAMAGECOUNT value on done: 201290.0 [2024-08-06 01:25:32,727][52667] Sum rewards: 67.829, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.001', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.148', 'AMMO4': '0.176', 'weapon5': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.462', 'weapon2': '0.506', 'WEAPON3': '0.850', 'weapon3': '2.466', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 247889920. Throughput: 0: 4390.0. Samples: 61973740. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:25:32,795][52567] Avg episode reward: [(0, '60.533')] [2024-08-06 01:25:32,894][52650] Updated weights for policy 0, policy_version 30261 (0.0012) [2024-08-06 01:25:33,367][52668] DAMAGECOUNT value on done: 201079.0 [2024-08-06 01:25:33,371][52668] Sum rewards: 60.301, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.770', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.108', 'weapon4': '0.176', 'AMMO3': '0.258', 'AMMO4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.500', 'weapon3': '2.846', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:33,797][52794] DAMAGECOUNT value on done: 201040.0 [2024-08-06 01:25:33,797][52794] Sum rewards: 55.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.647', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.132', 'weapon2': '0.178', 'AMMO3': '0.185', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.886', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:33,973][52660] DAMAGECOUNT value on done: 196595.0 [2024-08-06 01:25:33,974][52660] Sum rewards: 40.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.374', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.136', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '1.450', 'weapon3': '1.742', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '10.509', 'FRAGCOUNT': '34.000'} [2024-08-06 01:25:33,992][52662] DAMAGECOUNT value on done: 207859.0 [2024-08-06 01:25:33,994][52662] Sum rewards: 80.045, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon2': '0.388', 'weapon4': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '64.000'} [2024-08-06 01:25:34,655][52669] DAMAGECOUNT value on done: 199229.0 [2024-08-06 01:25:34,657][52669] Sum rewards: 71.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.315', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.170', 'AMMO4': '0.212', 'weapon5': '0.218', 'weapon2': '0.278', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '58.000'} [2024-08-06 01:25:35,694][52667] DAMAGECOUNT value on done: 196636.0 [2024-08-06 01:25:35,694][52667] Sum rewards: 56.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.451', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.126', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'weapon4': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.774', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '47.000'} [2024-08-06 01:25:36,359][52794] DAMAGECOUNT value on done: 205177.0 [2024-08-06 01:25:36,361][52794] Sum rewards: 61.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.917', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.068', 'AMMO3': '0.206', 'AMMO4': '0.215', 'weapon2': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:36,547][52662] DAMAGECOUNT value on done: 199713.0 [2024-08-06 01:25:36,548][52662] Sum rewards: 66.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.203', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.428', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:36,677][52668] DAMAGECOUNT value on done: 201263.0 [2024-08-06 01:25:36,678][52668] Sum rewards: 59.193, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.068', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon2': '0.546', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.198', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '49.000'} [2024-08-06 01:25:36,933][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:25:37,079][52660] DAMAGECOUNT value on done: 202208.0 [2024-08-06 01:25:37,083][52660] Sum rewards: 68.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.214', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 01:25:37,212][52669] DAMAGECOUNT value on done: 195960.0 [2024-08-06 01:25:37,212][52669] Sum rewards: 58.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.838', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.196', 'AMMO4': '0.203', 'AMMO3': '0.205', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.716', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:37,372][52650] Updated weights for policy 0, policy_version 30271 (0.0014) [2024-08-06 01:25:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 247980032. Throughput: 0: 4402.2. Samples: 62000280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:25:37,802][52567] Avg episode reward: [(0, '60.807')] [2024-08-06 01:25:38,275][52667] DAMAGECOUNT value on done: 203086.0 [2024-08-06 01:25:38,279][52667] Sum rewards: 64.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.204', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:39,185][52794] DAMAGECOUNT value on done: 204493.0 [2024-08-06 01:25:39,188][52794] Sum rewards: 59.970, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.410', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO4': '0.213', 'AMMO3': '0.220', 'weapon5': '0.246', 'weapon4': '0.322', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:39,422][52662] DAMAGECOUNT value on done: 202952.0 [2024-08-06 01:25:39,425][52662] Sum rewards: 63.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.055', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.264', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:39,626][52668] DAMAGECOUNT value on done: 197851.0 [2024-08-06 01:25:39,626][52668] Sum rewards: 48.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.584', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.131', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.476', 'weapon2': '0.760', 'WEAPON3': '0.850', 'weapon3': '2.330', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '11.742', 'FRAGCOUNT': '39.000'} [2024-08-06 01:25:40,027][52669] DAMAGECOUNT value on done: 200087.0 [2024-08-06 01:25:40,029][52669] Sum rewards: 78.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.653', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.154', 'AMMO3': '0.171', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '65.000'} [2024-08-06 01:25:40,171][52660] DAMAGECOUNT value on done: 208134.0 [2024-08-06 01:25:40,173][52660] Sum rewards: 61.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.317', 'ARMOR': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.176', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.944', 'WEAPON3': '1.050', 'weapon3': '2.342', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:41,234][52667] DAMAGECOUNT value on done: 207579.0 [2024-08-06 01:25:41,234][52667] Sum rewards: 65.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.198', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.052', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:41,393][52658] DAMAGECOUNT value on done: 203317.0 [2024-08-06 01:25:41,394][52658] Sum rewards: 62.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO2': '0.028', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.188', 'weapon4': '0.230', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.338', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:41,397][52795] DAMAGECOUNT value on done: 183599.0 [2024-08-06 01:25:41,398][52795] Sum rewards: 57.212, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.453', 'ARMOR': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.057', 'AMMO3': '0.162', 'AMMO4': '0.284', 'weapon5': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.456', 'weapon4': '0.582', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.372', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '45.000'} [2024-08-06 01:25:41,686][52650] Updated weights for policy 0, policy_version 30281 (0.0037) [2024-08-06 01:25:42,280][52794] DAMAGECOUNT value on done: 200757.0 [2024-08-06 01:25:42,281][52794] Sum rewards: 59.951, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.158', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON4': '0.450', 'weapon4': '0.830', 'WEAPON3': '1.200', 'weapon3': '2.308', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:42,602][52662] DAMAGECOUNT value on done: 200336.0 [2024-08-06 01:25:42,602][52662] Sum rewards: 57.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.244', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.166', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:42,678][52669] DAMAGECOUNT value on done: 201051.0 [2024-08-06 01:25:42,678][52669] Sum rewards: 53.471, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.420', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.164', 'AMMO4': '0.228', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.342', 'weapon4': '0.402', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '48.000'} [2024-08-06 01:25:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 248070144. Throughput: 0: 4400.0. Samples: 62026790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:25:42,794][52567] Avg episode reward: [(0, '60.714')] [2024-08-06 01:25:43,201][52660] DAMAGECOUNT value on done: 193138.0 [2024-08-06 01:25:43,201][52660] Sum rewards: 50.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon7': '0.152', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'AMMO4': '0.208', 'weapon2': '0.232', 'weapon4': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.834', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '45.000'} [2024-08-06 01:25:44,412][52667] DAMAGECOUNT value on done: 202145.0 [2024-08-06 01:25:44,415][52667] Sum rewards: 60.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.006', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.178', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:44,516][52795] DAMAGECOUNT value on done: 180899.0 [2024-08-06 01:25:44,517][52795] Sum rewards: 61.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.161', 'weapon4': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.000', 'HITCOUNT': '3.180', 'weapon3': '3.266', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '49.500'} [2024-08-06 01:25:44,615][52658] DAMAGECOUNT value on done: 200288.0 [2024-08-06 01:25:44,617][52658] Sum rewards: 72.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.598', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.012', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.108', 'AMMO4': '0.151', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '62.000'} [2024-08-06 01:25:45,220][52669] DAMAGECOUNT value on done: 195457.0 [2024-08-06 01:25:45,222][52669] Sum rewards: 47.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.461', 'AMMO5': '0.009', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.194', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.332', 'weapon2': '0.370', 'WEAPON3': '2.000', 'HITCOUNT': '2.730', 'weapon3': '2.962', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '45.000'} [2024-08-06 01:25:45,583][52647] DAMAGECOUNT value on done: 212533.0 [2024-08-06 01:25:45,584][52647] Sum rewards: 75.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'WEAPON4': '0.400', 'weapon2': '0.484', 'weapon4': '0.876', 'WEAPON3': '1.200', 'weapon3': '2.324', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '62.000'} [2024-08-06 01:25:45,591][52794] DAMAGECOUNT value on done: 200921.0 [2024-08-06 01:25:45,592][52794] Sum rewards: 65.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.074', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.219', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '57.000'} [2024-08-06 01:25:45,871][52662] DAMAGECOUNT value on done: 198258.0 [2024-08-06 01:25:45,873][52662] Sum rewards: 63.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.108', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.424', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:46,143][52660] DAMAGECOUNT value on done: 201821.0 [2024-08-06 01:25:46,145][52660] Sum rewards: 63.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.926', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.052', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.230', 'WEAPON4': '0.450', 'weapon4': '0.590', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:46,594][52650] Updated weights for policy 0, policy_version 30291 (0.0032) [2024-08-06 01:25:47,214][52667] DAMAGECOUNT value on done: 204770.0 [2024-08-06 01:25:47,215][52667] Sum rewards: 75.946, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.171', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.386', 'HEALTH': '0.437', 'weapon4': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '62.000'} [2024-08-06 01:25:47,343][52658] DAMAGECOUNT value on done: 202071.0 [2024-08-06 01:25:47,343][52658] Sum rewards: 51.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.228', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.224', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '45.000'} [2024-08-06 01:25:47,609][52795] DAMAGECOUNT value on done: 180948.0 [2024-08-06 01:25:47,611][52795] Sum rewards: 54.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.382', 'weapon2': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.596', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:47,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 248160256. Throughput: 0: 4393.5. Samples: 62039830. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:25:47,795][52567] Avg episode reward: [(0, '60.743')] [2024-08-06 01:25:47,891][52671] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:25:48,147][52669] DAMAGECOUNT value on done: 202661.0 [2024-08-06 01:25:48,150][52669] Sum rewards: 50.646, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon7': '0.066', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '0.800', 'weapon4': '0.930', 'weapon3': '2.302', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '40.000'} [2024-08-06 01:25:48,444][52794] DAMAGECOUNT value on done: 198382.0 [2024-08-06 01:25:48,444][52794] Sum rewards: 71.411, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.044', 'HEALTH': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.174', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '3.042', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 01:25:48,577][52647] DAMAGECOUNT value on done: 209591.0 [2024-08-06 01:25:48,577][52647] Sum rewards: 58.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.516', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.184', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '51.000'} [2024-08-06 01:25:48,971][52660] DAMAGECOUNT value on done: 190728.0 [2024-08-06 01:25:48,974][52660] Sum rewards: 64.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.048', 'AMMO3': '0.190', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.288', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.130', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:50,229][52667] DAMAGECOUNT value on done: 194255.0 [2024-08-06 01:25:50,230][52667] Sum rewards: 31.281, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.812', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon7': '0.064', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.125', 'WEAPON3': '0.700', 'weapon2': '0.796', 'weapon4': '1.284', 'HITCOUNT': '1.570', 'weapon3': '1.690', 'DAMAGECOUNT': '7.377', 'FRAGCOUNT': '24.000'} [2024-08-06 01:25:50,389][52658] DAMAGECOUNT value on done: 202569.0 [2024-08-06 01:25:50,391][52658] Sum rewards: 48.702, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.102', 'AMMO5': '0.013', 'AMMO2': '0.072', 'weapon5': '0.076', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'weapon2': '0.350', 'AMMO4': '0.359', 'weapon4': '0.656', 'WEAPON4': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.616', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:50,719][52795] DAMAGECOUNT value on done: 183379.0 [2024-08-06 01:25:50,723][52795] Sum rewards: 62.410, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.996', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.048', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.242', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:50,797][52669] DAMAGECOUNT value on done: 206063.0 [2024-08-06 01:25:50,799][52669] Sum rewards: 65.735, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.721', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.150', 'weapon5': '0.178', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon4': '0.980', 'weapon3': '2.364', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.000'} [2024-08-06 01:25:51,145][52794] DAMAGECOUNT value on done: 211081.0 [2024-08-06 01:25:51,147][52794] Sum rewards: 45.694, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.672', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.126', 'weapon4': '0.134', 'AMMO4': '0.146', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.700', 'weapon3': '3.122', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '43.000'} [2024-08-06 01:25:51,177][52650] Updated weights for policy 0, policy_version 30301 (0.0011) [2024-08-06 01:25:51,337][52647] DAMAGECOUNT value on done: 210658.0 [2024-08-06 01:25:51,337][52647] Sum rewards: 54.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.969', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.170', 'AMMO3': '0.176', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON4': '0.400', 'weapon4': '0.882', 'WEAPON3': '1.150', 'weapon3': '2.414', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '43.500'} [2024-08-06 01:25:52,070][52660] DAMAGECOUNT value on done: 199815.0 [2024-08-06 01:25:52,076][52660] Sum rewards: 68.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.088', 'weapon5': '0.102', 'AMMO4': '0.113', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.112', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '58.000'} [2024-08-06 01:25:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 248250368. Throughput: 0: 4399.8. Samples: 62066300. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:25:52,794][52567] Avg episode reward: [(0, '60.399')] [2024-08-06 01:25:53,156][52667] DAMAGECOUNT value on done: 203848.0 [2024-08-06 01:25:53,158][52667] Sum rewards: 70.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.849', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.340', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '61.000'} [2024-08-06 01:25:53,357][52658] DAMAGECOUNT value on done: 202251.0 [2024-08-06 01:25:53,359][52658] Sum rewards: 63.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.182', 'AMMO3': '0.213', 'weapon2': '0.310', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:53,529][52647] DAMAGECOUNT value on done: 211655.0 [2024-08-06 01:25:53,529][52647] Sum rewards: 75.414, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.163', 'weapon4': '0.252', 'weapon2': '0.566', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '58.000'} [2024-08-06 01:25:53,710][52669] DAMAGECOUNT value on done: 211694.0 [2024-08-06 01:25:53,710][52669] Sum rewards: 64.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.424', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.211', 'weapon4': '0.308', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.182', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:53,844][52795] DAMAGECOUNT value on done: 186957.0 [2024-08-06 01:25:53,846][52795] Sum rewards: 53.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.869', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.370', 'weapon4': '0.372', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:54,088][52794] DAMAGECOUNT value on done: 197260.0 [2024-08-06 01:25:54,090][52794] Sum rewards: 61.041, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.070', 'AMMO4': '0.164', 'weapon4': '0.190', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '54.000'} [2024-08-06 01:25:55,306][52660] DAMAGECOUNT value on done: 195967.0 [2024-08-06 01:25:55,307][52660] Sum rewards: 69.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.102', 'AMMO3': '0.185', 'WEAPON3': '1.250', 'HITCOUNT': '3.430', 'weapon3': '3.676', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 01:25:55,868][52647] DAMAGECOUNT value on done: 211450.0 [2024-08-06 01:25:55,870][52647] Sum rewards: 55.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.732', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.764', 'FRAGCOUNT': '49.000'} [2024-08-06 01:25:56,105][52650] Updated weights for policy 0, policy_version 30311 (0.0027) [2024-08-06 01:25:56,270][52669] DAMAGECOUNT value on done: 198460.0 [2024-08-06 01:25:56,271][52669] Sum rewards: 64.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.686', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:56,357][52658] DAMAGECOUNT value on done: 197716.0 [2024-08-06 01:25:56,357][52658] Sum rewards: 69.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.158', 'AMMO4': '0.175', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.294', 'weapon4': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '59.000'} [2024-08-06 01:25:57,096][52795] DAMAGECOUNT value on done: 184344.0 [2024-08-06 01:25:57,097][52795] Sum rewards: 53.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.054', 'AMMO4': '0.177', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.502', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '46.000'} [2024-08-06 01:25:57,173][52794] DAMAGECOUNT value on done: 207756.0 [2024-08-06 01:25:57,174][52794] Sum rewards: 73.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.239', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.442', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '64.000'} [2024-08-06 01:25:57,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 248340480. Throughput: 0: 4394.9. Samples: 62092360. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:25:57,802][52567] Avg episode reward: [(0, '61.120')] [2024-08-06 01:25:58,864][52647] DAMAGECOUNT value on done: 214466.0 [2024-08-06 01:25:58,865][52647] Sum rewards: 85.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.244', 'weapon2': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.480', 'HITCOUNT': '4.370', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '71.000'} [2024-08-06 01:25:59,299][52666] DAMAGECOUNT value on done: 203734.0 [2024-08-06 01:25:59,299][52666] Sum rewards: 63.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.076', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.356', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '55.000'} [2024-08-06 01:25:59,485][52658] DAMAGECOUNT value on done: 205694.0 [2024-08-06 01:25:59,485][52658] Sum rewards: 63.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.132', 'AMMO4': '0.148', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.168', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '53.000'} [2024-08-06 01:25:59,630][52669] DAMAGECOUNT value on done: 203237.0 [2024-08-06 01:25:59,631][52669] Sum rewards: 57.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.796', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.160', 'weapon4': '0.186', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'AMMO4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.982', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.000'} [2024-08-06 01:25:59,775][52794] DAMAGECOUNT value on done: 204623.0 [2024-08-06 01:25:59,776][52794] Sum rewards: 68.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.771', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.112', 'AMMO3': '0.180', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:00,283][52795] DAMAGECOUNT value on done: 189443.0 [2024-08-06 01:26:00,283][52795] Sum rewards: 54.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.922', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.172', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon5': '0.224', 'weapon2': '0.294', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.906', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '44.000'} [2024-08-06 01:26:00,401][52650] Updated weights for policy 0, policy_version 30321 (0.0049) [2024-08-06 01:26:01,759][52647] DAMAGECOUNT value on done: 209345.0 [2024-08-06 01:26:01,759][52647] Sum rewards: 50.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.168', 'AMMO4': '0.180', 'AMMO3': '0.196', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '2.904', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '44.000'} [2024-08-06 01:26:02,345][52658] DAMAGECOUNT value on done: 195684.0 [2024-08-06 01:26:02,347][52658] Sum rewards: 59.153, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon4': '0.224', 'AMMO4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.068', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:02,446][52666] DAMAGECOUNT value on done: 203445.0 [2024-08-06 01:26:02,446][52666] Sum rewards: 60.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.074', 'weapon4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:02,733][52669] DAMAGECOUNT value on done: 203508.0 [2024-08-06 01:26:02,735][52669] Sum rewards: 59.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.749', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.187', 'weapon5': '0.216', 'AMMO4': '0.262', 'weapon4': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon2': '0.678', 'WEAPON3': '1.150', 'weapon3': '2.522', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '49.500'} [2024-08-06 01:26:02,751][52794] DAMAGECOUNT value on done: 203790.0 [2024-08-06 01:26:02,751][52794] Sum rewards: 55.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.072', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon4': '0.304', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '2.860', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 248422400. Throughput: 0: 4395.6. Samples: 62105500. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:26:02,794][52567] Avg episode reward: [(0, '61.405')] [2024-08-06 01:26:03,412][52795] DAMAGECOUNT value on done: 186361.0 [2024-08-06 01:26:03,412][52795] Sum rewards: 65.756, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO2': '0.020', 'weapon7': '0.056', 'AMMO4': '0.099', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.134', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.946', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:04,858][52647] DAMAGECOUNT value on done: 208733.0 [2024-08-06 01:26:04,858][52647] Sum rewards: 56.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.305', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.156', 'AMMO3': '0.217', 'weapon4': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.400', 'weapon3': '2.742', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '49.500'} [2024-08-06 01:26:05,171][52650] Updated weights for policy 0, policy_version 30331 (0.0013) [2024-08-06 01:26:05,312][52666] DAMAGECOUNT value on done: 201783.0 [2024-08-06 01:26:05,313][52666] Sum rewards: 60.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.325', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.116', 'AMMO3': '0.138', 'AMMO4': '0.251', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.794', 'weapon3': '2.552', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:05,421][52794] DAMAGECOUNT value on done: 209102.0 [2024-08-06 01:26:05,421][52794] Sum rewards: 70.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.144', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.356', 'weapon4': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '57.000'} [2024-08-06 01:26:05,448][52658] DAMAGECOUNT value on done: 204977.0 [2024-08-06 01:26:05,449][52658] Sum rewards: 58.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.156', 'AMMO4': '0.209', 'weapon5': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.816', 'WEAPON3': '0.900', 'weapon3': '2.232', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:05,727][52669] DAMAGECOUNT value on done: 206571.0 [2024-08-06 01:26:05,728][52669] Sum rewards: 75.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.873', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.147', 'weapon5': '0.178', 'AMMO4': '0.217', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '60.000'} [2024-08-06 01:26:06,598][52795] DAMAGECOUNT value on done: 182116.0 [2024-08-06 01:26:06,599][52795] Sum rewards: 62.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.879', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.054', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.754', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:07,735][52647] DAMAGECOUNT value on done: 211433.0 [2024-08-06 01:26:07,736][52647] Sum rewards: 53.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'weapon5': '0.002', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO4': '0.295', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '3.006', 'DAMAGECOUNT': '12.699', 'FRAGCOUNT': '45.000'} [2024-08-06 01:26:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 248512512. Throughput: 0: 4397.8. Samples: 62132220. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:26:07,795][52567] Avg episode reward: [(0, '61.318')] [2024-08-06 01:26:08,040][52666] DAMAGECOUNT value on done: 199400.0 [2024-08-06 01:26:08,042][52666] Sum rewards: 61.115, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.274', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.282', 'weapon2': '0.502', 'WEAPON3': '1.750', 'weapon3': '3.310', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:08,325][52794] DAMAGECOUNT value on done: 203231.0 [2024-08-06 01:26:08,325][52794] Sum rewards: 63.106, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.082', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'HEALTH': '0.422', 'weapon2': '0.466', 'weapon4': '0.596', 'WEAPON3': '0.750', 'weapon3': '2.634', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:08,521][52658] DAMAGECOUNT value on done: 203913.0 [2024-08-06 01:26:08,531][52658] Sum rewards: 50.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.885', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.096', 'weapon5': '0.098', 'AMMO4': '0.129', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.944', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '42.000'} [2024-08-06 01:26:09,038][52670] DAMAGECOUNT value on done: 198320.0 [2024-08-06 01:26:09,041][52670] Sum rewards: 65.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.415', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.092', 'weapon4': '0.108', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:09,772][52795] DAMAGECOUNT value on done: 186961.0 [2024-08-06 01:26:09,778][52795] Sum rewards: 64.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.086', 'weapon5': '0.128', 'AMMO4': '0.179', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:09,782][52650] Updated weights for policy 0, policy_version 30341 (0.0014) [2024-08-06 01:26:09,932][52647] DAMAGECOUNT value on done: 207258.0 [2024-08-06 01:26:09,932][52647] Sum rewards: 54.649, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.217', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.782', 'WEAPON3': '0.900', 'weapon3': '2.858', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '44.000'} [2024-08-06 01:26:11,064][52666] DAMAGECOUNT value on done: 196235.0 [2024-08-06 01:26:11,065][52666] Sum rewards: 56.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.978', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.096', 'weapon5': '0.102', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.326', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.244', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:11,647][52670] DAMAGECOUNT value on done: 201343.0 [2024-08-06 01:26:11,648][52670] Sum rewards: 55.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.445', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.234', 'weapon2': '0.320', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.284', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:11,676][52658] DAMAGECOUNT value on done: 206475.0 [2024-08-06 01:26:11,678][52658] Sum rewards: 53.300, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.718', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.172', 'AMMO4': '0.240', 'weapon4': '0.266', 'AMMO3': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.838', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 248602624. Throughput: 0: 4394.9. Samples: 62158450. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:26:12,794][52567] Avg episode reward: [(0, '61.302')] [2024-08-06 01:26:12,917][52647] DAMAGECOUNT value on done: 209816.0 [2024-08-06 01:26:12,920][52647] Sum rewards: 67.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.365', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.098', 'AMMO3': '0.189', 'weapon4': '0.194', 'AMMO4': '0.212', 'weapon2': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.262', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '55.000'} [2024-08-06 01:26:12,959][52795] DAMAGECOUNT value on done: 184707.0 [2024-08-06 01:26:12,959][52795] Sum rewards: 68.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.596', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.213', 'weapon2': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '59.000'} [2024-08-06 01:26:13,617][52666] DAMAGECOUNT value on done: 192995.0 [2024-08-06 01:26:13,619][52666] Sum rewards: 57.691, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.015', 'AMMO2': '0.066', 'weapon5': '0.126', 'AMMO3': '0.144', 'WEAPON5': '0.300', 'HEALTH': '0.322', 'AMMO4': '0.329', 'weapon4': '0.396', 'weapon2': '0.498', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon3': '2.698', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '46.500'} [2024-08-06 01:26:13,758][52671] DAMAGECOUNT value on done: 205409.0 [2024-08-06 01:26:13,758][52671] Sum rewards: 59.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.791', 'AMMO5': '0.007', 'AMMO2': '0.057', 'weapon5': '0.152', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'AMMO4': '0.284', 'weapon2': '0.324', 'weapon4': '0.474', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:14,250][52670] DAMAGECOUNT value on done: 196657.0 [2024-08-06 01:26:14,252][52670] Sum rewards: 64.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.186', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.098', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.308', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '55.000'} [2024-08-06 01:26:14,662][52650] Updated weights for policy 0, policy_version 30351 (0.0012) [2024-08-06 01:26:15,004][52658] DAMAGECOUNT value on done: 195684.0 [2024-08-06 01:26:15,006][52658] Sum rewards: 55.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.175', 'AMMO3': '0.213', 'weapon4': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:15,232][52647] DAMAGECOUNT value on done: 206827.0 [2024-08-06 01:26:15,232][52647] Sum rewards: 70.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '60.000'} [2024-08-06 01:26:15,972][52795] DAMAGECOUNT value on done: 181644.0 [2024-08-06 01:26:15,972][52795] Sum rewards: 54.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.340', 'weapon4': '0.480', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '2.826', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '46.000'} [2024-08-06 01:26:16,271][52666] DAMAGECOUNT value on done: 199695.0 [2024-08-06 01:26:16,271][52666] Sum rewards: 68.377, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.516', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.141', 'weapon4': '0.180', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '61.000'} [2024-08-06 01:26:16,797][52671] DAMAGECOUNT value on done: 198752.0 [2024-08-06 01:26:16,797][52671] Sum rewards: 57.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.148', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.326', 'DAMAGECOUNT': '13.287', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:17,041][52670] DAMAGECOUNT value on done: 197663.0 [2024-08-06 01:26:17,042][52670] Sum rewards: 66.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.172', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 248684544. Throughput: 0: 4401.8. Samples: 62171820. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:26:17,802][52567] Avg episode reward: [(0, '61.380')] [2024-08-06 01:26:18,024][52647] DAMAGECOUNT value on done: 207735.0 [2024-08-06 01:26:18,024][52647] Sum rewards: 59.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.866', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.152', 'AMMO3': '0.228', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:18,286][52658] DAMAGECOUNT value on done: 198434.0 [2024-08-06 01:26:18,287][52658] Sum rewards: 45.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.776', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.370', 'ARMOR': '0.455', 'WEAPON3': '1.350', 'HITCOUNT': '2.460', 'weapon3': '2.910', 'DAMAGECOUNT': '12.255', 'FRAGCOUNT': '41.000'} [2024-08-06 01:26:18,931][52666] DAMAGECOUNT value on done: 198769.0 [2024-08-06 01:26:18,931][52666] Sum rewards: 51.967, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.790', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.078', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.452', 'WEAPON3': '1.750', 'HITCOUNT': '2.850', 'weapon3': '3.122', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:19,011][52650] Updated weights for policy 0, policy_version 30361 (0.0014) [2024-08-06 01:26:19,077][52795] DAMAGECOUNT value on done: 182133.0 [2024-08-06 01:26:19,078][52795] Sum rewards: 68.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.085', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.212', 'AMMO4': '0.222', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.682', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '57.000'} [2024-08-06 01:26:19,662][52671] DAMAGECOUNT value on done: 203439.0 [2024-08-06 01:26:19,662][52671] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.450', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.037', 'weapon4': '0.064', 'AMMO3': '0.164', 'AMMO4': '0.186', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.868', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:19,918][52670] DAMAGECOUNT value on done: 198578.0 [2024-08-06 01:26:19,919][52670] Sum rewards: 63.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.044', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'AMMO4': '0.221', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:20,773][52647] DAMAGECOUNT value on done: 210016.0 [2024-08-06 01:26:20,773][52647] Sum rewards: 62.667, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.110', 'AMMO4': '0.157', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.298', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '56.500'} [2024-08-06 01:26:21,010][52658] DAMAGECOUNT value on done: 200647.0 [2024-08-06 01:26:21,011][52658] Sum rewards: 59.727, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.444', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.078', 'weapon4': '0.096', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:22,092][52664] DAMAGECOUNT value on done: 206733.0 [2024-08-06 01:26:22,095][52664] Sum rewards: 55.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.385', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.506', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.126', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:22,219][52795] DAMAGECOUNT value on done: 186749.0 [2024-08-06 01:26:22,220][52795] Sum rewards: 53.401, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.172', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.080', 'weapon4': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'AMMO3': '0.281', 'weapon2': '0.342', 'WEAPON3': '1.700', 'HITCOUNT': '2.920', 'weapon3': '3.276', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:22,365][52666] DAMAGECOUNT value on done: 198469.0 [2024-08-06 01:26:22,365][52666] Sum rewards: 57.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.925', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.126', 'AMMO4': '0.130', 'AMMO3': '0.192', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.052', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 248782848. Throughput: 0: 4398.9. Samples: 62198230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:26:22,802][52567] Avg episode reward: [(0, '61.008')] [2024-08-06 01:26:22,894][52671] DAMAGECOUNT value on done: 197889.0 [2024-08-06 01:26:22,894][52671] Sum rewards: 49.510, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.420', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.228', 'AMMO3': '0.245', 'AMMO4': '0.286', 'weapon2': '0.364', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.610', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '45.000'} [2024-08-06 01:26:23,291][52647] DAMAGECOUNT value on done: 211892.0 [2024-08-06 01:26:23,291][52647] Sum rewards: 71.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.366', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.197', 'weapon4': '0.374', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '58.000'} [2024-08-06 01:26:23,309][52670] DAMAGECOUNT value on done: 200007.0 [2024-08-06 01:26:23,311][52670] Sum rewards: 57.806, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.084', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'weapon5': '0.206', 'AMMO4': '0.228', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon2': '1.088', 'weapon3': '2.162', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '45.000'} [2024-08-06 01:26:23,848][52650] Updated weights for policy 0, policy_version 30371 (0.0014) [2024-08-06 01:26:23,911][52658] DAMAGECOUNT value on done: 195628.0 [2024-08-06 01:26:23,911][52658] Sum rewards: 58.781, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.562', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.090', 'weapon4': '0.116', 'AMMO4': '0.125', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.092', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:24,512][52664] DAMAGECOUNT value on done: 207364.0 [2024-08-06 01:26:24,513][52664] Sum rewards: 54.279, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'AMMO4': '0.244', 'weapon2': '0.308', 'WEAPON4': '0.400', 'weapon4': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:25,023][52614] Signal inference workers to stop experience collection... (5550 times) [2024-08-06 01:26:25,023][52614] Signal inference workers to resume experience collection... (5550 times) [2024-08-06 01:26:25,059][52650] InferenceWorker_p0-w0: stopping experience collection (5550 times) [2024-08-06 01:26:25,059][52650] InferenceWorker_p0-w0: resuming experience collection (5550 times) [2024-08-06 01:26:25,422][52795] DAMAGECOUNT value on done: 179586.0 [2024-08-06 01:26:25,424][52795] Sum rewards: 61.421, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.215', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.098', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '1.032', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:25,486][52666] DAMAGECOUNT value on done: 199542.0 [2024-08-06 01:26:25,488][52666] Sum rewards: 65.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.016', 'AMMO2': '0.059', 'AMMO3': '0.132', 'weapon5': '0.230', 'AMMO4': '0.295', 'weapon2': '0.402', 'WEAPON5': '0.500', 'weapon4': '0.564', 'WEAPON4': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.516', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:25,588][52671] DAMAGECOUNT value on done: 202560.0 [2024-08-06 01:26:25,589][52671] Sum rewards: 67.774, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.365', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon2': '0.216', 'weapon4': '0.306', 'AMMO3': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.950', 'weapon3': '3.102', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '62.000'} [2024-08-06 01:26:26,013][52647] DAMAGECOUNT value on done: 207432.0 [2024-08-06 01:26:26,013][52647] Sum rewards: 55.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.086', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon4': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:26,118][52649] DAMAGECOUNT value on done: 195843.0 [2024-08-06 01:26:26,118][52649] Sum rewards: 78.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.455', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon5': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '62.000'} [2024-08-06 01:26:26,314][52670] DAMAGECOUNT value on done: 193851.0 [2024-08-06 01:26:26,316][52670] Sum rewards: 58.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.082', 'weapon4': '0.114', 'AMMO4': '0.153', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.146', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:26,439][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:26:26,884][52658] DAMAGECOUNT value on done: 202131.0 [2024-08-06 01:26:26,884][52658] Sum rewards: 55.174, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.711', 'AMMO5': '0.012', 'AMMO2': '0.082', 'weapon5': '0.090', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.370', 'weapon4': '0.386', 'AMMO4': '0.409', 'WEAPON4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:27,180][52664] DAMAGECOUNT value on done: 208395.0 [2024-08-06 01:26:27,183][52664] Sum rewards: 61.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.255', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.212', 'weapon2': '0.528', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.324', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:27,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 248864768. Throughput: 0: 4384.9. Samples: 62224110. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:26:27,794][52567] Avg episode reward: [(0, '60.874')] [2024-08-06 01:26:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030379_248864768.pth... [2024-08-06 01:26:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000029864_244645888.pth [2024-08-06 01:26:28,089][52671] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:26:28,269][52671] DAMAGECOUNT value on done: 201401.0 [2024-08-06 01:26:28,270][52671] Sum rewards: 55.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.048', 'weapon5': '0.158', 'AMMO4': '0.189', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.258', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:28,382][52666] DAMAGECOUNT value on done: 196129.0 [2024-08-06 01:26:28,383][52666] Sum rewards: 50.599, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.094', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.000', 'HITCOUNT': '2.640', 'weapon3': '3.274', 'DAMAGECOUNT': '12.321', 'FRAGCOUNT': '42.000'} [2024-08-06 01:26:28,601][52795] DAMAGECOUNT value on done: 190512.0 [2024-08-06 01:26:28,604][52795] Sum rewards: 61.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO2': '0.026', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon4': '0.230', 'weapon2': '0.582', 'WEAPON3': '0.900', 'weapon3': '2.924', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:28,646][52650] Updated weights for policy 0, policy_version 30381 (0.0013) [2024-08-06 01:26:28,826][52647] DAMAGECOUNT value on done: 205450.0 [2024-08-06 01:26:28,826][52647] Sum rewards: 57.411, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.223', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.219', 'weapon2': '0.438', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.124', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '50.000'} [2024-08-06 01:26:29,147][52649] DAMAGECOUNT value on done: 190267.0 [2024-08-06 01:26:29,148][52649] Sum rewards: 57.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.416', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon4': '0.262', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:29,355][52670] DAMAGECOUNT value on done: 198456.0 [2024-08-06 01:26:29,357][52670] Sum rewards: 53.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.009', 'AMMO2': '0.054', 'weapon5': '0.110', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.268', 'weapon2': '0.418', 'weapon4': '0.526', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.646', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.086', 'FRAGCOUNT': '44.000'} [2024-08-06 01:26:29,666][52658] DAMAGECOUNT value on done: 203926.0 [2024-08-06 01:26:29,666][52658] Sum rewards: 67.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.104', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.208', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.274', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '58.000'} [2024-08-06 01:26:29,909][52664] DAMAGECOUNT value on done: 206748.0 [2024-08-06 01:26:29,909][52664] Sum rewards: 63.304, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:30,849][52671] DAMAGECOUNT value on done: 202490.0 [2024-08-06 01:26:30,849][52671] Sum rewards: 55.771, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.475', 'AMMO2': '0.035', 'WEAPON4': '0.150', 'AMMO4': '0.174', 'weapon4': '0.192', 'weapon2': '0.216', 'AMMO3': '0.253', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.366', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:31,166][52666] DAMAGECOUNT value on done: 193653.0 [2024-08-06 01:26:31,167][52666] Sum rewards: 63.986, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.350', 'WEAPON3': '0.950', 'weapon3': '2.918', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:31,668][52795] DAMAGECOUNT value on done: 189372.0 [2024-08-06 01:26:31,669][52795] Sum rewards: 53.461, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.056', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon4': '0.276', 'AMMO4': '0.279', 'weapon2': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '48.500'} [2024-08-06 01:26:31,925][52647] DAMAGECOUNT value on done: 208789.0 [2024-08-06 01:26:31,925][52647] Sum rewards: 62.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.256', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:32,206][52670] DAMAGECOUNT value on done: 195402.0 [2024-08-06 01:26:32,208][52670] Sum rewards: 70.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.127', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 01:26:32,346][52649] DAMAGECOUNT value on done: 196357.0 [2024-08-06 01:26:32,346][52649] Sum rewards: 68.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.244', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'AMMO4': '0.243', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '58.000'} [2024-08-06 01:26:32,415][52663] DAMAGECOUNT value on done: 202631.0 [2024-08-06 01:26:32,417][52663] Sum rewards: 60.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'AMMO3': '0.158', 'weapon2': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.672', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '49.500'} [2024-08-06 01:26:32,692][52658] DAMAGECOUNT value on done: 197295.0 [2024-08-06 01:26:32,696][52658] Sum rewards: 55.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.325', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.388', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 248946688. Throughput: 0: 4381.6. Samples: 62237000. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:26:32,794][52567] Avg episode reward: [(0, '60.685')] [2024-08-06 01:26:32,932][52664] DAMAGECOUNT value on done: 207213.0 [2024-08-06 01:26:32,933][52664] Sum rewards: 59.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.748', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.116', 'weapon4': '0.156', 'AMMO3': '0.243', 'AMMO4': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:33,115][52650] Updated weights for policy 0, policy_version 30391 (0.0013) [2024-08-06 01:26:33,488][52671] DAMAGECOUNT value on done: 203918.0 [2024-08-06 01:26:33,490][52671] Sum rewards: 64.217, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'weapon4': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:34,256][52647] DAMAGECOUNT value on done: 204405.0 [2024-08-06 01:26:34,256][52647] Sum rewards: 66.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.212', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.368', 'weapon4': '0.396', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:34,387][52666] DAMAGECOUNT value on done: 201113.0 [2024-08-06 01:26:34,389][52666] Sum rewards: 56.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.872', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.088', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon4': '0.480', 'weapon2': '0.508', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.604', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:34,859][52795] DAMAGECOUNT value on done: 178427.0 [2024-08-06 01:26:34,863][52795] Sum rewards: 46.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.196', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.233', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.336', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '41.000'} [2024-08-06 01:26:35,334][52664] DAMAGECOUNT value on done: 209507.0 [2024-08-06 01:26:35,334][52664] Sum rewards: 60.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.344', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.408', 'weapon2': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.816', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:35,422][52670] DAMAGECOUNT value on done: 190641.0 [2024-08-06 01:26:35,423][52670] Sum rewards: 56.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.392', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.154', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:35,441][52658] DAMAGECOUNT value on done: 199838.0 [2024-08-06 01:26:35,441][52658] Sum rewards: 65.642, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.324', 'weapon4': '0.420', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:35,547][52649] DAMAGECOUNT value on done: 195046.0 [2024-08-06 01:26:35,547][52649] Sum rewards: 66.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '56.000'} [2024-08-06 01:26:35,594][52663] DAMAGECOUNT value on done: 200059.0 [2024-08-06 01:26:35,594][52663] Sum rewards: 60.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.082', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'weapon2': '0.408', 'weapon4': '0.580', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.678', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:36,591][52671] DAMAGECOUNT value on done: 200336.0 [2024-08-06 01:26:36,592][52671] Sum rewards: 66.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.532', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.074', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '56.000'} [2024-08-06 01:26:36,647][52647] DAMAGECOUNT value on done: 211582.0 [2024-08-06 01:26:36,649][52647] Sum rewards: 58.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.219', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.358', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 249036800. Throughput: 0: 4373.3. Samples: 62263100. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:26:37,794][52567] Avg episode reward: [(0, '60.865')] [2024-08-06 01:26:37,796][52666] DAMAGECOUNT value on done: 201170.0 [2024-08-06 01:26:37,797][52666] Sum rewards: 52.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.044', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.206', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.614', 'WEAPON3': '0.850', 'weapon3': '2.862', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.458', 'FRAGCOUNT': '41.500'} [2024-08-06 01:26:37,896][52795] DAMAGECOUNT value on done: 191958.0 [2024-08-06 01:26:37,896][52795] Sum rewards: 51.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.135', 'AMMO5': '0.008', 'weapon5': '0.042', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.448', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '44.000'} [2024-08-06 01:26:37,975][52658] DAMAGECOUNT value on done: 204026.0 [2024-08-06 01:26:37,976][52658] Sum rewards: 64.665, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.361', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO4': '0.181', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.402', 'weapon2': '0.644', 'WEAPON3': '1.400', 'weapon3': '2.518', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '55.000'} [2024-08-06 01:26:37,977][52650] Updated weights for policy 0, policy_version 30401 (0.0034) [2024-08-06 01:26:37,976][52664] DAMAGECOUNT value on done: 213304.0 [2024-08-06 01:26:37,984][52664] Sum rewards: 58.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.964', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:38,093][52803] DAMAGECOUNT value on done: 187594.0 [2024-08-06 01:26:38,093][52803] Sum rewards: 46.221, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.071', 'AMMO3': '0.166', 'weapon4': '0.248', 'weapon5': '0.266', 'weapon2': '0.318', 'WEAPON5': '0.350', 'AMMO4': '0.356', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '2.640', 'weapon3': '2.894', 'DAMAGECOUNT': '12.816', 'FRAGCOUNT': '41.000'} [2024-08-06 01:26:38,250][52663] DAMAGECOUNT value on done: 197415.0 [2024-08-06 01:26:38,250][52663] Sum rewards: 51.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.584', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.026', 'AMMO2': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.204', 'AMMO4': '0.206', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '46.000'} [2024-08-06 01:26:38,649][52649] DAMAGECOUNT value on done: 187660.0 [2024-08-06 01:26:38,657][52649] Sum rewards: 63.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.170', 'weapon5': '0.200', 'weapon4': '0.232', 'AMMO4': '0.317', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.806', 'WEAPON3': '1.050', 'weapon3': '2.492', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:38,662][52670] DAMAGECOUNT value on done: 200944.0 [2024-08-06 01:26:38,663][52670] Sum rewards: 60.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.645', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.120', 'weapon2': '0.236', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.472', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:39,678][52671] DAMAGECOUNT value on done: 203432.0 [2024-08-06 01:26:39,685][52671] Sum rewards: 46.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.606', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon2': '0.326', 'weapon4': '0.520', 'WEAPON3': '1.600', 'weapon3': '2.796', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '42.000'} [2024-08-06 01:26:40,648][52666] DAMAGECOUNT value on done: 194702.0 [2024-08-06 01:26:40,650][52666] Sum rewards: 63.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.202', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.266', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:40,983][52795] DAMAGECOUNT value on done: 190923.0 [2024-08-06 01:26:40,983][52795] Sum rewards: 56.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.810', 'AMMO2': '0.014', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.215', 'weapon2': '0.528', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.254', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:41,190][52663] DAMAGECOUNT value on done: 201563.0 [2024-08-06 01:26:41,191][52663] Sum rewards: 64.716, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'weapon5': '0.076', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'weapon4': '0.472', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:41,207][52664] DAMAGECOUNT value on done: 201514.0 [2024-08-06 01:26:41,209][52664] Sum rewards: 51.478, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon7': '0.058', 'weapon5': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.518', 'weapon2': '0.570', 'WEAPON3': '0.900', 'weapon3': '2.630', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.675', 'FRAGCOUNT': '40.000'} [2024-08-06 01:26:41,285][52649] DAMAGECOUNT value on done: 195139.0 [2024-08-06 01:26:41,285][52649] Sum rewards: 58.327, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.246', 'AMMO4': '0.261', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon4': '0.974', 'weapon3': '2.166', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:41,313][52803] DAMAGECOUNT value on done: 189864.0 [2024-08-06 01:26:41,313][52803] Sum rewards: 62.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.713', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.316', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:41,488][52670] DAMAGECOUNT value on done: 200154.0 [2024-08-06 01:26:41,489][52670] Sum rewards: 67.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.990', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.085', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.228', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '59.000'} [2024-08-06 01:26:41,799][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:26:42,748][52650] Updated weights for policy 0, policy_version 30411 (0.0018) [2024-08-06 01:26:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 249126912. Throughput: 0: 4384.9. Samples: 62289680. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:26:42,795][52567] Avg episode reward: [(0, '59.988')] [2024-08-06 01:26:42,975][52671] DAMAGECOUNT value on done: 203125.0 [2024-08-06 01:26:42,977][52671] Sum rewards: 66.856, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.138', 'weapon2': '0.486', 'WEAPON3': '0.950', 'HITCOUNT': '3.180', 'weapon3': '3.280', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:43,544][52666] DAMAGECOUNT value on done: 197639.0 [2024-08-06 01:26:43,548][52666] Sum rewards: 66.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.205', 'weapon2': '0.438', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.318', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '56.000'} [2024-08-06 01:26:43,874][52664] DAMAGECOUNT value on done: 216494.0 [2024-08-06 01:26:43,874][52664] Sum rewards: 54.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO2': '0.050', 'AMMO3': '0.175', 'AMMO4': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.474', 'weapon2': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.418', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.954', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:44,168][52663] DAMAGECOUNT value on done: 198771.0 [2024-08-06 01:26:44,169][52663] Sum rewards: 61.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.164', 'AMMO2': '0.024', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon4': '0.326', 'weapon2': '0.332', 'WEAPON3': '1.600', 'weapon3': '3.108', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:44,503][52649] DAMAGECOUNT value on done: 193478.0 [2024-08-06 01:26:44,503][52649] Sum rewards: 52.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.814', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.090', 'AMMO4': '0.146', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.622', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '3.012', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '45.000'} [2024-08-06 01:26:44,561][52803] DAMAGECOUNT value on done: 186148.0 [2024-08-06 01:26:44,565][52803] Sum rewards: 65.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.090', 'weapon5': '0.102', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.652', 'WEAPON3': '0.800', 'weapon3': '2.998', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:44,669][52670] DAMAGECOUNT value on done: 199762.0 [2024-08-06 01:26:44,670][52670] Sum rewards: 47.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.595', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.304', 'weapon4': '0.328', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.088', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '43.000'} [2024-08-06 01:26:45,814][52671] DAMAGECOUNT value on done: 199511.0 [2024-08-06 01:26:45,816][52671] Sum rewards: 61.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.766', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon4': '0.216', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.748', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:46,217][52811] DAMAGECOUNT value on done: 196825.0 [2024-08-06 01:26:46,219][52811] Sum rewards: 54.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.357', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'weapon4': '0.180', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.210', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:46,330][52659] DAMAGECOUNT value on done: 201344.0 [2024-08-06 01:26:46,330][52659] Sum rewards: 59.595, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.560', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.180', 'AMMO3': '0.213', 'AMMO4': '0.268', 'weapon4': '0.274', 'WEAPON5': '0.400', 'weapon2': '0.604', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.628', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '54.500'} [2024-08-06 01:26:46,528][52664] DAMAGECOUNT value on done: 211109.0 [2024-08-06 01:26:46,528][52664] Sum rewards: 53.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.305', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.152', 'weapon5': '0.174', 'AMMO3': '0.187', 'AMMO4': '0.214', 'weapon2': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.282', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '44.000'} [2024-08-06 01:26:46,749][52666] DAMAGECOUNT value on done: 197535.0 [2024-08-06 01:26:46,749][52666] Sum rewards: 67.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon4': '0.208', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '56.000'} [2024-08-06 01:26:47,016][52663] DAMAGECOUNT value on done: 205881.0 [2024-08-06 01:26:47,016][52663] Sum rewards: 61.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon4': '0.260', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:47,215][52650] Updated weights for policy 0, policy_version 30421 (0.0012) [2024-08-06 01:26:47,632][52649] DAMAGECOUNT value on done: 200396.0 [2024-08-06 01:26:47,634][52649] Sum rewards: 53.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.920', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.146', 'weapon4': '0.168', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.804', 'WEAPON3': '1.650', 'weapon3': '2.610', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '46.000'} [2024-08-06 01:26:47,761][52670] DAMAGECOUNT value on done: 200631.0 [2024-08-06 01:26:47,761][52670] Sum rewards: 68.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.215', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.253', 'weapon4': '0.272', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '57.000'} [2024-08-06 01:26:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 249217024. Throughput: 0: 4384.7. Samples: 62302810. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 01:26:47,794][52567] Avg episode reward: [(0, '59.624')] [2024-08-06 01:26:47,843][52803] DAMAGECOUNT value on done: 188324.0 [2024-08-06 01:26:47,845][52803] Sum rewards: 63.188, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.892', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:48,853][52664] DAMAGECOUNT value on done: 211030.0 [2024-08-06 01:26:48,855][52664] Sum rewards: 60.350, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.275', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '53.000'} [2024-08-06 01:26:48,870][52671] DAMAGECOUNT value on done: 209545.0 [2024-08-06 01:26:48,871][52671] Sum rewards: 48.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.801', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.244', 'weapon2': '0.396', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.056', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '43.000'} [2024-08-06 01:26:49,153][52811] DAMAGECOUNT value on done: 182658.0 [2024-08-06 01:26:49,155][52811] Sum rewards: 66.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.154', 'AMMO4': '0.193', 'AMMO3': '0.220', 'weapon4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '56.000'} [2024-08-06 01:26:49,366][52659] DAMAGECOUNT value on done: 200037.0 [2024-08-06 01:26:49,366][52659] Sum rewards: 53.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.216', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '47.500'} [2024-08-06 01:26:49,547][52666] DAMAGECOUNT value on done: 201291.0 [2024-08-06 01:26:49,548][52666] Sum rewards: 69.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.927', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2024-08-06 01:26:49,951][52663] DAMAGECOUNT value on done: 201139.0 [2024-08-06 01:26:49,951][52663] Sum rewards: 57.260, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.147', 'weapon4': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.894', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '45.000'} [2024-08-06 01:26:50,003][52820] DAMAGECOUNT value on done: 182995.0 [2024-08-06 01:26:50,006][52820] Sum rewards: 64.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.188', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.086', 'weapon5': '0.120', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:50,616][52670] DAMAGECOUNT value on done: 201936.0 [2024-08-06 01:26:50,617][52670] Sum rewards: 55.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'weapon2': '0.258', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'weapon4': '0.446', 'WEAPON3': '1.600', 'weapon3': '2.994', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:50,643][52649] DAMAGECOUNT value on done: 194812.0 [2024-08-06 01:26:50,643][52649] Sum rewards: 65.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.392', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.456', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '55.000'} [2024-08-06 01:26:51,010][52803] DAMAGECOUNT value on done: 190582.0 [2024-08-06 01:26:51,011][52803] Sum rewards: 64.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.124', 'weapon4': '0.180', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '55.000'} [2024-08-06 01:26:51,717][52664] DAMAGECOUNT value on done: 207116.0 [2024-08-06 01:26:51,719][52664] Sum rewards: 59.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.034', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.036', 'weapon4': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.251', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:51,742][52671] DAMAGECOUNT value on done: 202174.0 [2024-08-06 01:26:51,745][52671] Sum rewards: 67.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '56.000'} [2024-08-06 01:26:52,050][52650] Updated weights for policy 0, policy_version 30431 (0.0012) [2024-08-06 01:26:52,128][52811] DAMAGECOUNT value on done: 189464.0 [2024-08-06 01:26:52,129][52811] Sum rewards: 56.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.230', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.144', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.148', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '49.000'} [2024-08-06 01:26:52,350][52659] DAMAGECOUNT value on done: 201367.0 [2024-08-06 01:26:52,351][52659] Sum rewards: 49.900, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.244', 'AMMO3': '0.262', 'weapon2': '0.648', 'WEAPON3': '1.500', 'weapon3': '2.838', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '46.000'} [2024-08-06 01:26:52,582][52666] DAMAGECOUNT value on done: 195447.0 [2024-08-06 01:26:52,582][52666] Sum rewards: 59.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.126', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.148', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.382', 'weapon4': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:52,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 249290752. Throughput: 0: 4377.1. Samples: 62329190. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 01:26:52,794][52567] Avg episode reward: [(0, '59.683')] [2024-08-06 01:26:53,021][52663] DAMAGECOUNT value on done: 200954.0 [2024-08-06 01:26:53,023][52663] Sum rewards: 58.374, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.296', 'weapon2': '0.376', 'WEAPON3': '1.750', 'HITCOUNT': '3.190', 'weapon3': '3.378', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:53,296][52820] DAMAGECOUNT value on done: 186369.0 [2024-08-06 01:26:53,297][52820] Sum rewards: 71.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.415', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.023', 'weapon5': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.115', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '60.000'} [2024-08-06 01:26:53,509][52649] DAMAGECOUNT value on done: 197128.0 [2024-08-06 01:26:53,511][52649] Sum rewards: 58.040, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.190', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'AMMO4': '0.237', 'weapon2': '0.322', 'weapon4': '0.352', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:53,562][52670] DAMAGECOUNT value on done: 190184.0 [2024-08-06 01:26:53,562][52670] Sum rewards: 61.915, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.773', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.189', 'weapon5': '0.210', 'AMMO4': '0.221', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:54,237][52803] DAMAGECOUNT value on done: 189384.0 [2024-08-06 01:26:54,245][52803] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.630', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '55.000'} [2024-08-06 01:26:54,372][52664] DAMAGECOUNT value on done: 205887.0 [2024-08-06 01:26:54,372][52664] Sum rewards: 72.058, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.310', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.228', 'WEAPON4': '0.250', 'AMMO3': '0.296', 'weapon4': '0.384', 'WEAPON3': '1.700', 'weapon3': '3.158', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '64.000'} [2024-08-06 01:26:54,936][52671] DAMAGECOUNT value on done: 195191.0 [2024-08-06 01:26:54,937][52671] Sum rewards: 60.241, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.156', 'AMMO3': '0.176', 'weapon2': '0.784', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:55,038][52666] DAMAGECOUNT value on done: 197557.0 [2024-08-06 01:26:55,039][52666] Sum rewards: 60.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.745', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.224', 'ARMOR': '0.457', 'weapon2': '0.618', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:55,225][52811] DAMAGECOUNT value on done: 188992.0 [2024-08-06 01:26:55,225][52811] Sum rewards: 66.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.100', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '58.000'} [2024-08-06 01:26:55,505][52659] DAMAGECOUNT value on done: 201259.0 [2024-08-06 01:26:55,505][52659] Sum rewards: 56.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.264', 'AMMO5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.127', 'weapon5': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.706', 'WEAPON3': '0.850', 'weapon3': '2.694', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '46.000'} [2024-08-06 01:26:55,830][52670] DAMAGECOUNT value on done: 201116.0 [2024-08-06 01:26:55,831][52670] Sum rewards: 63.683, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.006', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.099', 'weapon4': '0.172', 'AMMO3': '0.181', 'weapon2': '0.468', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.108', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:56,176][52663] DAMAGECOUNT value on done: 199382.0 [2024-08-06 01:26:56,178][52663] Sum rewards: 58.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.203', 'weapon2': '0.524', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.124', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:56,489][52820] DAMAGECOUNT value on done: 183721.0 [2024-08-06 01:26:56,490][52820] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.877', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '57.000'} [2024-08-06 01:26:56,630][52649] DAMAGECOUNT value on done: 198355.0 [2024-08-06 01:26:56,633][52649] Sum rewards: 54.802, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.315', 'AMMO5': '0.007', 'weapon7': '0.032', 'AMMO2': '0.042', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.211', 'weapon4': '0.272', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'weapon2': '0.306', 'WEAPON3': '1.750', 'HITCOUNT': '2.820', 'weapon3': '2.952', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '52.000'} [2024-08-06 01:26:56,643][52650] Updated weights for policy 0, policy_version 30441 (0.0033) [2024-08-06 01:26:56,687][52664] DAMAGECOUNT value on done: 207914.0 [2024-08-06 01:26:56,687][52664] Sum rewards: 61.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.150', 'weapon5': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.340', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:57,032][52820] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:26:57,258][52803] DAMAGECOUNT value on done: 188446.0 [2024-08-06 01:26:57,261][52803] Sum rewards: 56.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.038', 'weapon4': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.442', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.246', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 249389056. Throughput: 0: 4375.3. Samples: 62355340. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 01:26:57,794][52567] Avg episode reward: [(0, '60.161')] [2024-08-06 01:26:57,966][52671] DAMAGECOUNT value on done: 205319.0 [2024-08-06 01:26:57,966][52671] Sum rewards: 54.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.496', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.094', 'AMMO3': '0.178', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON4': '0.450', 'weapon4': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.440', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '46.000'} [2024-08-06 01:26:58,328][52811] DAMAGECOUNT value on done: 187910.0 [2024-08-06 01:26:58,329][52811] Sum rewards: 60.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.223', 'weapon2': '0.284', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:58,464][52670] DAMAGECOUNT value on done: 204457.0 [2024-08-06 01:26:58,465][52670] Sum rewards: 55.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.135', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.244', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:58,507][52659] DAMAGECOUNT value on done: 200996.0 [2024-08-06 01:26:58,507][52659] Sum rewards: 55.651, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.282', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.284', 'weapon2': '0.662', 'WEAPON3': '1.700', 'weapon3': '3.008', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '51.000'} [2024-08-06 01:26:59,127][52665] DAMAGECOUNT value on done: 198686.0 [2024-08-06 01:26:59,129][52665] Sum rewards: 58.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.044', 'weapon5': '0.048', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'AMMO4': '0.219', 'WEAPON4': '0.300', 'weapon2': '1.048', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '47.000'} [2024-08-06 01:26:59,181][52664] DAMAGECOUNT value on done: 209097.0 [2024-08-06 01:26:59,182][52664] Sum rewards: 42.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '3.076', 'DAMAGECOUNT': '11.103', 'FRAGCOUNT': '40.000'} [2024-08-06 01:26:59,264][52663] DAMAGECOUNT value on done: 203374.0 [2024-08-06 01:26:59,264][52663] Sum rewards: 62.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.518', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '54.000'} [2024-08-06 01:26:59,670][52820] DAMAGECOUNT value on done: 177549.0 [2024-08-06 01:26:59,670][52820] Sum rewards: 60.783, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.670', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.154', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '48.000'} [2024-08-06 01:26:59,869][52649] DAMAGECOUNT value on done: 193887.0 [2024-08-06 01:26:59,873][52649] Sum rewards: 63.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.416', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:00,328][52803] DAMAGECOUNT value on done: 183796.0 [2024-08-06 01:27:00,329][52803] Sum rewards: 67.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.874', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.173', 'AMMO3': '0.231', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '58.000'} [2024-08-06 01:27:01,039][52671] DAMAGECOUNT value on done: 204525.0 [2024-08-06 01:27:01,041][52671] Sum rewards: 50.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'weapon5': '0.026', 'AMMO2': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'AMMO3': '0.211', 'weapon4': '0.240', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.990', 'DAMAGECOUNT': '12.552', 'FRAGCOUNT': '46.000'} [2024-08-06 01:27:01,314][52811] DAMAGECOUNT value on done: 192698.0 [2024-08-06 01:27:01,315][52811] Sum rewards: 72.296, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.115', 'weapon4': '0.162', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '59.000'} [2024-08-06 01:27:01,399][52670] DAMAGECOUNT value on done: 198709.0 [2024-08-06 01:27:01,400][52670] Sum rewards: 60.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.504', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '53.000'} [2024-08-06 01:27:01,572][52659] DAMAGECOUNT value on done: 199093.0 [2024-08-06 01:27:01,573][52659] Sum rewards: 56.270, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.193', 'weapon4': '0.212', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '48.000'} [2024-08-06 01:27:01,581][52664] DAMAGECOUNT value on done: 206795.0 [2024-08-06 01:27:01,582][52664] Sum rewards: 71.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.324', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:01,606][52650] Updated weights for policy 0, policy_version 30451 (0.0012) [2024-08-06 01:27:02,252][52663] DAMAGECOUNT value on done: 202790.0 [2024-08-06 01:27:02,254][52663] Sum rewards: 64.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.421', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.388', 'weapon4': '0.392', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.500'} [2024-08-06 01:27:02,309][52665] DAMAGECOUNT value on done: 202926.0 [2024-08-06 01:27:02,310][52665] Sum rewards: 50.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.396', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.940', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '44.000'} [2024-08-06 01:27:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 249479168. Throughput: 0: 4368.9. Samples: 62368420. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 01:27:02,794][52567] Avg episode reward: [(0, '59.977')] [2024-08-06 01:27:02,858][52820] DAMAGECOUNT value on done: 186766.0 [2024-08-06 01:27:02,862][52820] Sum rewards: 64.542, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.216', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'weapon2': '0.444', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:03,018][52649] DAMAGECOUNT value on done: 198973.0 [2024-08-06 01:27:03,018][52649] Sum rewards: 60.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.968', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon2': '0.128', 'AMMO3': '0.202', 'weapon4': '0.224', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.470', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:03,438][52803] DAMAGECOUNT value on done: 188168.0 [2024-08-06 01:27:03,438][52803] Sum rewards: 60.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.555', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.091', 'weapon4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.932', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:04,029][52664] DAMAGECOUNT value on done: 209790.0 [2024-08-06 01:27:04,031][52664] Sum rewards: 62.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.216', 'AMMO3': '0.223', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:04,292][52671] DAMAGECOUNT value on done: 204784.0 [2024-08-06 01:27:04,300][52671] Sum rewards: 61.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.204', 'weapon2': '0.618', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:04,322][52811] DAMAGECOUNT value on done: 189938.0 [2024-08-06 01:27:04,324][52811] Sum rewards: 69.469, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.035', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon4': '0.334', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '60.000'} [2024-08-06 01:27:04,533][52670] DAMAGECOUNT value on done: 199502.0 [2024-08-06 01:27:04,533][52670] Sum rewards: 71.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.160', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.336', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '60.000'} [2024-08-06 01:27:04,914][52659] DAMAGECOUNT value on done: 198742.0 [2024-08-06 01:27:04,915][52659] Sum rewards: 44.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.058', 'AMMO3': '0.228', 'weapon4': '0.228', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '3.028', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '41.000'} [2024-08-06 01:27:05,266][52663] DAMAGECOUNT value on done: 200765.0 [2024-08-06 01:27:05,268][52663] Sum rewards: 62.640, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.362', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.261', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:05,408][52665] DAMAGECOUNT value on done: 198894.0 [2024-08-06 01:27:05,410][52665] Sum rewards: 61.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.617', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.185', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.096', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:05,846][52650] Updated weights for policy 0, policy_version 30461 (0.0018) [2024-08-06 01:27:06,106][52820] DAMAGECOUNT value on done: 182483.0 [2024-08-06 01:27:06,107][52820] Sum rewards: 63.668, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.760', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.146', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '56.000'} [2024-08-06 01:27:06,120][52649] DAMAGECOUNT value on done: 197486.0 [2024-08-06 01:27:06,120][52649] Sum rewards: 60.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.834', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.056', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.246', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:06,582][52664] DAMAGECOUNT value on done: 212629.0 [2024-08-06 01:27:06,582][52664] Sum rewards: 68.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.796', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.146', 'AMMO4': '0.177', 'weapon5': '0.212', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '59.000'} [2024-08-06 01:27:06,630][52803] DAMAGECOUNT value on done: 183884.0 [2024-08-06 01:27:06,631][52803] Sum rewards: 58.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.556', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.090', 'AMMO3': '0.183', 'AMMO4': '0.189', 'weapon4': '0.360', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:07,297][52671] DAMAGECOUNT value on done: 204819.0 [2024-08-06 01:27:07,298][52671] Sum rewards: 66.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.122', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.240', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:07,522][52811] DAMAGECOUNT value on done: 187366.0 [2024-08-06 01:27:07,522][52811] Sum rewards: 52.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.962', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.088', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'AMMO4': '0.235', 'WEAPON4': '0.350', 'weapon2': '0.684', 'WEAPON3': '1.500', 'weapon3': '2.910', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '47.000'} [2024-08-06 01:27:07,671][52659] DAMAGECOUNT value on done: 196807.0 [2024-08-06 01:27:07,672][52659] Sum rewards: 64.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.364', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '53.000'} [2024-08-06 01:27:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 249561088. Throughput: 0: 4365.1. Samples: 62394660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:07,794][52567] Avg episode reward: [(0, '60.183')] [2024-08-06 01:27:08,348][52663] DAMAGECOUNT value on done: 194725.0 [2024-08-06 01:27:08,349][52663] Sum rewards: 62.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.413', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.212', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.576', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:08,594][52665] DAMAGECOUNT value on done: 194808.0 [2024-08-06 01:27:08,595][52665] Sum rewards: 63.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.932', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.094', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.336', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.148', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:09,065][52664] DAMAGECOUNT value on done: 208133.0 [2024-08-06 01:27:09,066][52664] Sum rewards: 74.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.738', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon2': '0.442', 'WEAPON3': '1.600', 'weapon3': '3.328', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 01:27:09,178][52820] DAMAGECOUNT value on done: 185965.0 [2024-08-06 01:27:09,180][52820] Sum rewards: 54.825, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.964', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.169', 'weapon5': '0.200', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.050', 'HITCOUNT': '2.660', 'weapon3': '2.830', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '45.000'} [2024-08-06 01:27:09,368][52649] DAMAGECOUNT value on done: 190658.0 [2024-08-06 01:27:09,378][52649] Sum rewards: 57.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.222', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:09,650][52803] DAMAGECOUNT value on done: 193934.0 [2024-08-06 01:27:09,651][52803] Sum rewards: 58.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.640', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.201', 'weapon2': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:09,787][52671] DAMAGECOUNT value on done: 201298.0 [2024-08-06 01:27:09,789][52671] Sum rewards: 64.522, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.126', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:10,106][52659] DAMAGECOUNT value on done: 204857.0 [2024-08-06 01:27:10,141][52659] Sum rewards: 63.590, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'weapon4': '0.504', 'WEAPON3': '1.500', 'weapon3': '2.886', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:10,560][52811] DAMAGECOUNT value on done: 194119.0 [2024-08-06 01:27:10,562][52811] Sum rewards: 55.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.697', 'AMMO5': '0.003', 'AMMO2': '0.004', 'ARMOR': '0.004', 'weapon4': '0.014', 'AMMO4': '0.018', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.156', 'weapon2': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.410', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '46.000'} [2024-08-06 01:27:10,734][52650] Updated weights for policy 0, policy_version 30471 (0.0035) [2024-08-06 01:27:10,948][52663] DAMAGECOUNT value on done: 193251.0 [2024-08-06 01:27:10,948][52663] Sum rewards: 62.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.854', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.260', 'weapon2': '0.504', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.196', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '56.000'} [2024-08-06 01:27:11,449][52664] DAMAGECOUNT value on done: 209007.0 [2024-08-06 01:27:11,449][52664] Sum rewards: 67.297, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon5': '0.086', 'weapon2': '0.178', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '56.000'} [2024-08-06 01:27:11,626][52665] DAMAGECOUNT value on done: 195286.0 [2024-08-06 01:27:11,627][52665] Sum rewards: 60.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.968', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'weapon4': '0.152', 'AMMO3': '0.206', 'weapon2': '0.840', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:12,403][52649] DAMAGECOUNT value on done: 196146.0 [2024-08-06 01:27:12,405][52649] Sum rewards: 50.800, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'weapon4': '0.232', 'AMMO3': '0.248', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '3.080', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '45.000'} [2024-08-06 01:27:12,427][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:27:12,463][52820] DAMAGECOUNT value on done: 189720.0 [2024-08-06 01:27:12,463][52820] Sum rewards: 63.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.722', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:12,671][52659] DAMAGECOUNT value on done: 206205.0 [2024-08-06 01:27:12,671][52659] Sum rewards: 54.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.230', 'AMMO5': '0.004', 'AMMO2': '0.035', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.226', 'weapon4': '0.258', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.182', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '47.000'} [2024-08-06 01:27:12,690][52803] DAMAGECOUNT value on done: 192654.0 [2024-08-06 01:27:12,692][52803] Sum rewards: 61.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.119', 'AMMO3': '0.179', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 249651200. Throughput: 0: 4380.9. Samples: 62421250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:12,794][52567] Avg episode reward: [(0, '60.779')] [2024-08-06 01:27:13,611][52649] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:27:13,638][52811] DAMAGECOUNT value on done: 189681.0 [2024-08-06 01:27:13,639][52811] Sum rewards: 61.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.295', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.057', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.316', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:14,205][52663] DAMAGECOUNT value on done: 201529.0 [2024-08-06 01:27:14,207][52663] Sum rewards: 59.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon2': '0.922', 'WEAPON3': '1.000', 'weapon3': '2.788', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '48.000'} [2024-08-06 01:27:14,543][52665] DAMAGECOUNT value on done: 196763.0 [2024-08-06 01:27:14,548][52665] Sum rewards: 48.868, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO2': '0.008', 'AMMO4': '0.037', 'HEALTH': '0.040', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.172', 'WEAPON7': '0.200', 'weapon7': '0.270', 'WEAPON3': '0.650', 'weapon4': '1.222', 'HITCOUNT': '2.160', 'weapon3': '2.206', 'DAMAGECOUNT': '9.897', 'FRAGCOUNT': '39.000'} [2024-08-06 01:27:15,270][52650] Updated weights for policy 0, policy_version 30481 (0.0012) [2024-08-06 01:27:15,308][52649] DAMAGECOUNT value on done: 195340.0 [2024-08-06 01:27:15,326][52649] Sum rewards: 65.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.164', 'AMMO3': '0.226', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '54.000'} [2024-08-06 01:27:15,365][52659] DAMAGECOUNT value on done: 200272.0 [2024-08-06 01:27:15,366][52659] Sum rewards: 66.302, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.276', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.360', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '56.000'} [2024-08-06 01:27:15,658][52803] DAMAGECOUNT value on done: 188715.0 [2024-08-06 01:27:15,659][52803] Sum rewards: 69.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.233', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'weapon5': '0.140', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.706', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:15,779][52820] DAMAGECOUNT value on done: 185968.0 [2024-08-06 01:27:15,782][52820] Sum rewards: 62.371, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.183', 'HEALTH': '0.204', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.000', 'weapon3': '3.178', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:16,563][52811] DAMAGECOUNT value on done: 188025.0 [2024-08-06 01:27:16,564][52811] Sum rewards: 63.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.076', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.422', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.236', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 01:27:16,974][52663] DAMAGECOUNT value on done: 203063.0 [2024-08-06 01:27:16,975][52663] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.699', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.183', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'weapon4': '0.362', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '59.000'} [2024-08-06 01:27:17,674][52665] DAMAGECOUNT value on done: 200427.0 [2024-08-06 01:27:17,675][52665] Sum rewards: 60.319, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.306', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '50.000'} [2024-08-06 01:27:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 249733120. Throughput: 0: 4385.1. Samples: 62434330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:17,795][52567] Avg episode reward: [(0, '61.012')] [2024-08-06 01:27:18,462][52649] DAMAGECOUNT value on done: 201695.0 [2024-08-06 01:27:18,463][52649] Sum rewards: 52.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.329', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon4': '0.244', 'weapon2': '0.710', 'WEAPON3': '1.050', 'weapon3': '2.666', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '43.000'} [2024-08-06 01:27:18,522][52659] DAMAGECOUNT value on done: 198211.0 [2024-08-06 01:27:18,526][52659] Sum rewards: 74.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.638', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.184', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '61.000'} [2024-08-06 01:27:18,863][52803] DAMAGECOUNT value on done: 191221.0 [2024-08-06 01:27:18,866][52803] Sum rewards: 60.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.537', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:18,963][52820] DAMAGECOUNT value on done: 188989.0 [2024-08-06 01:27:18,964][52820] Sum rewards: 65.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.137', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'weapon4': '0.394', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '54.000'} [2024-08-06 01:27:19,578][52811] DAMAGECOUNT value on done: 189263.0 [2024-08-06 01:27:19,578][52811] Sum rewards: 53.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.744', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.690', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '45.000'} [2024-08-06 01:27:19,644][52663] DAMAGECOUNT value on done: 202490.0 [2024-08-06 01:27:19,645][52663] Sum rewards: 63.049, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.096', 'weapon4': '0.108', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '3.294', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:20,000][52650] Updated weights for policy 0, policy_version 30491 (0.0028) [2024-08-06 01:27:20,842][52665] DAMAGECOUNT value on done: 200032.0 [2024-08-06 01:27:20,845][52665] Sum rewards: 59.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon4': '0.532', 'weapon2': '0.606', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '50.000'} [2024-08-06 01:27:21,443][52659] DAMAGECOUNT value on done: 195410.0 [2024-08-06 01:27:21,446][52659] Sum rewards: 71.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.118', 'AMMO3': '0.177', 'AMMO4': '0.296', 'weapon4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '61.000'} [2024-08-06 01:27:21,665][52649] DAMAGECOUNT value on done: 200588.0 [2024-08-06 01:27:21,665][52649] Sum rewards: 56.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.508', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.144', 'AMMO3': '0.227', 'AMMO4': '0.229', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '1.008', 'WEAPON3': '1.200', 'weapon3': '2.298', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '47.000'} [2024-08-06 01:27:21,838][52803] DAMAGECOUNT value on done: 189121.0 [2024-08-06 01:27:21,838][52803] Sum rewards: 65.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.913', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.051', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:21,905][52820] DAMAGECOUNT value on done: 187311.0 [2024-08-06 01:27:21,905][52820] Sum rewards: 60.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.804', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.152', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:22,635][52811] DAMAGECOUNT value on done: 188018.0 [2024-08-06 01:27:22,638][52811] Sum rewards: 64.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.058', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.190', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:22,663][52663] DAMAGECOUNT value on done: 205637.0 [2024-08-06 01:27:22,663][52663] Sum rewards: 66.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.966', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.282', 'weapon4': '0.334', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.888', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '59.000'} [2024-08-06 01:27:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 249823232. Throughput: 0: 4395.8. Samples: 62460910. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:22,794][52567] Avg episode reward: [(0, '61.428')] [2024-08-06 01:27:23,843][52659] DAMAGECOUNT value on done: 201072.0 [2024-08-06 01:27:23,845][52659] Sum rewards: 63.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.503', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon4': '0.204', 'weapon2': '0.434', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:23,881][52665] DAMAGECOUNT value on done: 204549.0 [2024-08-06 01:27:23,881][52665] Sum rewards: 65.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.878', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '56.000'} [2024-08-06 01:27:24,514][52650] Updated weights for policy 0, policy_version 30501 (0.0029) [2024-08-06 01:27:24,682][52649] DAMAGECOUNT value on done: 205450.0 [2024-08-06 01:27:24,682][52649] Sum rewards: 58.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.998', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.224', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.550', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:24,949][52820] DAMAGECOUNT value on done: 190296.0 [2024-08-06 01:27:24,949][52820] Sum rewards: 52.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.172', 'weapon5': '0.190', 'weapon2': '0.418', 'weapon4': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.660', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '45.000'} [2024-08-06 01:27:24,970][52803] DAMAGECOUNT value on done: 186272.0 [2024-08-06 01:27:24,970][52803] Sum rewards: 68.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.914', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.065', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '58.000'} [2024-08-06 01:27:25,883][52663] DAMAGECOUNT value on done: 203749.0 [2024-08-06 01:27:25,884][52663] Sum rewards: 62.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.148', 'WEAPON4': '0.300', 'weapon2': '0.456', 'weapon4': '0.580', 'WEAPON3': '0.850', 'weapon3': '2.680', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:25,887][52811] DAMAGECOUNT value on done: 191301.0 [2024-08-06 01:27:25,887][52811] Sum rewards: 61.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.362', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.166', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '52.500'} [2024-08-06 01:27:26,415][52665] DAMAGECOUNT value on done: 201303.0 [2024-08-06 01:27:26,416][52665] Sum rewards: 65.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.134', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.162', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:26,494][52659] DAMAGECOUNT value on done: 204408.0 [2024-08-06 01:27:26,495][52659] Sum rewards: 62.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.402', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.180', 'AMMO4': '0.185', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:27,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 249921536. Throughput: 0: 4387.8. Samples: 62487130. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:27,802][52567] Avg episode reward: [(0, '61.456')] [2024-08-06 01:27:28,067][52820] DAMAGECOUNT value on done: 185830.0 [2024-08-06 01:27:28,067][52820] Sum rewards: 57.746, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.546', 'AMMO2': '0.044', 'AMMO4': '0.222', 'AMMO3': '0.234', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '50.000'} [2024-08-06 01:27:28,073][52803] DAMAGECOUNT value on done: 193193.0 [2024-08-06 01:27:28,076][52803] Sum rewards: 53.434, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.856', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.278', 'weapon4': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.058', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '48.000'} [2024-08-06 01:27:28,989][52663] DAMAGECOUNT value on done: 200219.0 [2024-08-06 01:27:28,990][52663] Sum rewards: 67.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'AMMO3': '0.172', 'weapon4': '0.192', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.258', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '53.000'} [2024-08-06 01:27:28,994][52811] DAMAGECOUNT value on done: 189924.0 [2024-08-06 01:27:28,995][52811] Sum rewards: 66.498, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.240', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.162', 'AMMO3': '0.252', 'weapon2': '0.272', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '59.500'} [2024-08-06 01:27:29,148][52665] DAMAGECOUNT value on done: 205771.0 [2024-08-06 01:27:29,149][52665] Sum rewards: 72.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.217', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '62.000'} [2024-08-06 01:27:29,460][52659] DAMAGECOUNT value on done: 205901.0 [2024-08-06 01:27:29,461][52659] Sum rewards: 60.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:29,465][52650] Updated weights for policy 0, policy_version 30511 (0.0010) [2024-08-06 01:27:31,111][52803] DAMAGECOUNT value on done: 186643.0 [2024-08-06 01:27:31,111][52803] Sum rewards: 42.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.062', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO4': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.100', 'weapon4': '1.272', 'weapon3': '1.980', 'HITCOUNT': '2.370', 'DAMAGECOUNT': '10.929', 'FRAGCOUNT': '36.000'} [2024-08-06 01:27:31,184][52820] DAMAGECOUNT value on done: 189020.0 [2024-08-06 01:27:31,185][52820] Sum rewards: 69.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.209', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.188', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '3.296', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '58.000'} [2024-08-06 01:27:31,952][52811] DAMAGECOUNT value on done: 189347.0 [2024-08-06 01:27:31,953][52811] Sum rewards: 58.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.192', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.176', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '48.500'} [2024-08-06 01:27:31,974][52665] DAMAGECOUNT value on done: 203653.0 [2024-08-06 01:27:31,976][52665] Sum rewards: 60.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.604', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.168', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:32,263][52659] DAMAGECOUNT value on done: 206301.0 [2024-08-06 01:27:32,280][52659] Sum rewards: 63.900, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.915', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.106', 'AMMO4': '0.175', 'AMMO3': '0.215', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.654', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 250003456. Throughput: 0: 4385.6. Samples: 62500160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:32,802][52567] Avg episode reward: [(0, '61.333')] [2024-08-06 01:27:33,917][52650] Updated weights for policy 0, policy_version 30521 (0.0013) [2024-08-06 01:27:34,199][52803] DAMAGECOUNT value on done: 192751.0 [2024-08-06 01:27:34,199][52803] Sum rewards: 56.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '47.000'} [2024-08-06 01:27:34,249][52820] DAMAGECOUNT value on done: 189149.0 [2024-08-06 01:27:34,250][52820] Sum rewards: 49.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.740', 'AMMO5': '0.014', 'AMMO2': '0.061', 'AMMO3': '0.223', 'AMMO4': '0.304', 'weapon5': '0.304', 'WEAPON5': '0.450', 'weapon2': '0.474', 'weapon4': '0.488', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.374', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '45.000'} [2024-08-06 01:27:34,964][52665] DAMAGECOUNT value on done: 200013.0 [2024-08-06 01:27:34,966][52665] Sum rewards: 66.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.366', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:35,124][52811] DAMAGECOUNT value on done: 187579.0 [2024-08-06 01:27:35,125][52811] Sum rewards: 51.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.798', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.726', 'WEAPON3': '1.350', 'weapon3': '2.512', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '43.000'} [2024-08-06 01:27:35,546][52659] DAMAGECOUNT value on done: 201009.0 [2024-08-06 01:27:35,548][52659] Sum rewards: 57.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon2': '0.468', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.326', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '50.000'} [2024-08-06 01:27:37,202][52803] DAMAGECOUNT value on done: 183930.0 [2024-08-06 01:27:37,203][52803] Sum rewards: 54.458, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.256', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.136', 'AMMO4': '0.161', 'weapon5': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.890', 'weapon3': '3.052', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:37,458][52820] DAMAGECOUNT value on done: 188570.0 [2024-08-06 01:27:37,458][52820] Sum rewards: 56.429, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.565', 'AMMO5': '0.007', 'weapon5': '0.046', 'AMMO2': '0.051', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.256', 'weapon4': '0.310', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '48.000'} [2024-08-06 01:27:37,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 250085376. Throughput: 0: 4387.1. Samples: 62526610. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:37,803][52567] Avg episode reward: [(0, '61.050')] [2024-08-06 01:27:38,084][52659] DAMAGECOUNT value on done: 206420.0 [2024-08-06 01:27:38,085][52659] Sum rewards: 67.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.629', 'AMMO5': '0.007', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:38,095][52665] DAMAGECOUNT value on done: 199255.0 [2024-08-06 01:27:38,095][52665] Sum rewards: 49.796, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.135', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.128', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'weapon4': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.696', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.237', 'FRAGCOUNT': '41.000'} [2024-08-06 01:27:38,215][52811] DAMAGECOUNT value on done: 192184.0 [2024-08-06 01:27:38,218][52811] Sum rewards: 73.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.325', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.201', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '59.000'} [2024-08-06 01:27:38,604][52650] Updated weights for policy 0, policy_version 30531 (0.0015) [2024-08-06 01:27:40,653][52820] DAMAGECOUNT value on done: 184796.0 [2024-08-06 01:27:40,656][52820] Sum rewards: 60.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO5': '0.006', 'AMMO2': '0.060', 'weapon5': '0.118', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.299', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.034', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '54.000'} [2024-08-06 01:27:41,139][52665] DAMAGECOUNT value on done: 199500.0 [2024-08-06 01:27:41,140][52665] Sum rewards: 68.169, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.717', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.244', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '55.000'} [2024-08-06 01:27:41,251][52659] DAMAGECOUNT value on done: 205091.0 [2024-08-06 01:27:41,253][52659] Sum rewards: 54.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.926', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.166', 'AMMO3': '0.184', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '45.500'} [2024-08-06 01:27:41,311][52811] DAMAGECOUNT value on done: 188749.0 [2024-08-06 01:27:41,311][52811] Sum rewards: 73.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '62.000'} [2024-08-06 01:27:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 250175488. Throughput: 0: 4392.4. Samples: 62553000. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:27:42,795][52567] Avg episode reward: [(0, '61.643')] [2024-08-06 01:27:43,658][52650] Updated weights for policy 0, policy_version 30541 (0.0031) [2024-08-06 01:27:43,775][52820] DAMAGECOUNT value on done: 192924.0 [2024-08-06 01:27:43,779][52820] Sum rewards: 73.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.516', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.472', 'WEAPON3': '0.900', 'weapon3': '2.996', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '58.000'} [2024-08-06 01:27:44,297][52665] DAMAGECOUNT value on done: 197731.0 [2024-08-06 01:27:44,299][52665] Sum rewards: 58.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.312', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '50.000'} [2024-08-06 01:27:44,365][52811] DAMAGECOUNT value on done: 192438.0 [2024-08-06 01:27:44,365][52811] Sum rewards: 64.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.324', 'WEAPON4': '0.450', 'weapon2': '0.902', 'WEAPON3': '1.250', 'weapon3': '2.478', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:46,794][52820] DAMAGECOUNT value on done: 194830.0 [2024-08-06 01:27:46,797][52820] Sum rewards: 68.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.646', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon4': '0.296', 'weapon2': '0.524', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:47,018][52665] DAMAGECOUNT value on done: 198203.0 [2024-08-06 01:27:47,019][52665] Sum rewards: 60.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.516', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.205', 'AMMO4': '0.229', 'weapon5': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:47,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17578.2). Total num frames: 250265600. Throughput: 0: 4397.1. Samples: 62566290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:27:47,802][52567] Avg episode reward: [(0, '61.742')] [2024-08-06 01:27:47,937][52650] Updated weights for policy 0, policy_version 30551 (0.0016) [2024-08-06 01:27:49,907][52820] DAMAGECOUNT value on done: 185012.0 [2024-08-06 01:27:49,909][52820] Sum rewards: 61.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.238', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '51.000'} [2024-08-06 01:27:50,456][52665] DAMAGECOUNT value on done: 195548.0 [2024-08-06 01:27:50,459][52665] Sum rewards: 62.396, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.750', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.176', 'AMMO3': '0.234', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '57.000'} [2024-08-06 01:27:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 250347520. Throughput: 0: 4388.9. Samples: 62592160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:27:52,794][52567] Avg episode reward: [(0, '61.667')] [2024-08-06 01:27:52,830][52650] Updated weights for policy 0, policy_version 30561 (0.0012) [2024-08-06 01:27:53,719][52665] DAMAGECOUNT value on done: 201383.0 [2024-08-06 01:27:53,727][52665] Sum rewards: 62.518, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.848', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.318', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:54,108][52668] DAMAGECOUNT value on done: 200102.0 [2024-08-06 01:27:54,111][52668] Sum rewards: 58.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '49.000'} [2024-08-06 01:27:54,723][52795] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:27:56,980][52665] DAMAGECOUNT value on done: 199076.0 [2024-08-06 01:27:56,982][52665] Sum rewards: 66.488, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.508', 'weapon4': '0.642', 'WEAPON3': '1.550', 'weapon3': '2.314', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '60.000'} [2024-08-06 01:27:57,237][52668] DAMAGECOUNT value on done: 208090.0 [2024-08-06 01:27:57,238][52668] Sum rewards: 60.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.080', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.233', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '52.000'} [2024-08-06 01:27:57,702][52650] Updated weights for policy 0, policy_version 30571 (0.0035) [2024-08-06 01:27:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 250437632. Throughput: 0: 4370.7. Samples: 62617930. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:27:57,794][52567] Avg episode reward: [(0, '61.796')] [2024-08-06 01:28:00,684][52668] DAMAGECOUNT value on done: 204558.0 [2024-08-06 01:28:00,684][52668] Sum rewards: 58.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.228', 'weapon2': '0.232', 'weapon4': '0.232', 'AMMO3': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '2.940', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '51.000'} [2024-08-06 01:28:01,536][52662] DAMAGECOUNT value on done: 208712.0 [2024-08-06 01:28:01,545][52662] Sum rewards: 65.732, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.095', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.052', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO4': '0.259', 'AMMO3': '0.292', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.972', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '59.000'} [2024-08-06 01:28:02,339][52650] Updated weights for policy 0, policy_version 30581 (0.0032) [2024-08-06 01:28:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 250527744. Throughput: 0: 4371.6. Samples: 62631050. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:28:02,794][52567] Avg episode reward: [(0, '61.828')] [2024-08-06 01:28:03,720][52668] DAMAGECOUNT value on done: 206492.0 [2024-08-06 01:28:03,720][52668] Sum rewards: 62.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.564', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.243', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.270', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:04,629][52662] DAMAGECOUNT value on done: 210771.0 [2024-08-06 01:28:04,630][52662] Sum rewards: 64.796, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.026', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'weapon2': '0.256', 'AMMO3': '0.258', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '57.000'} [2024-08-06 01:28:05,501][52667] DAMAGECOUNT value on done: 204649.0 [2024-08-06 01:28:05,501][52667] Sum rewards: 70.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.853', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.207', 'weapon4': '0.210', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '60.000'} [2024-08-06 01:28:06,902][52668] DAMAGECOUNT value on done: 198634.0 [2024-08-06 01:28:06,902][52668] Sum rewards: 43.277, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.132', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon5': '0.228', 'AMMO3': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.374', 'weapon2': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.506', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.066', 'FRAGCOUNT': '41.000'} [2024-08-06 01:28:07,066][52650] Updated weights for policy 0, policy_version 30591 (0.0020) [2024-08-06 01:28:07,592][52662] DAMAGECOUNT value on done: 208750.0 [2024-08-06 01:28:07,593][52662] Sum rewards: 67.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '56.000'} [2024-08-06 01:28:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 250609664. Throughput: 0: 4360.0. Samples: 62657110. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:28:07,795][52567] Avg episode reward: [(0, '61.821')] [2024-08-06 01:28:07,983][52667] DAMAGECOUNT value on done: 203968.0 [2024-08-06 01:28:07,983][52667] Sum rewards: 56.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon7': '0.072', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.578', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '47.000'} [2024-08-06 01:28:10,060][52668] DAMAGECOUNT value on done: 202795.0 [2024-08-06 01:28:10,060][52668] Sum rewards: 73.587, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.314', 'weapon2': '0.704', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '59.000'} [2024-08-06 01:28:10,112][52662] DAMAGECOUNT value on done: 199831.0 [2024-08-06 01:28:10,113][52662] Sum rewards: 54.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.144', 'weapon4': '0.186', 'AMMO3': '0.201', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '46.000'} [2024-08-06 01:28:10,787][52660] DAMAGECOUNT value on done: 201270.0 [2024-08-06 01:28:10,790][52660] Sum rewards: 69.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.140', 'weapon4': '0.186', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '58.000'} [2024-08-06 01:28:10,812][52667] DAMAGECOUNT value on done: 205120.0 [2024-08-06 01:28:10,814][52667] Sum rewards: 59.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.655', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'weapon2': '0.184', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:11,446][52650] Updated weights for policy 0, policy_version 30601 (0.0042) [2024-08-06 01:28:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 250699776. Throughput: 0: 4367.6. Samples: 62683670. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:28:12,794][52567] Avg episode reward: [(0, '61.781')] [2024-08-06 01:28:13,121][52668] DAMAGECOUNT value on done: 201283.0 [2024-08-06 01:28:13,123][52668] Sum rewards: 59.720, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.058', 'AMMO3': '0.131', 'AMMO4': '0.167', 'weapon5': '0.240', 'WEAPON4': '0.250', 'HEALTH': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.708', 'WEAPON3': '0.750', 'weapon3': '2.832', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '45.000'} [2024-08-06 01:28:13,146][52662] DAMAGECOUNT value on done: 207277.0 [2024-08-06 01:28:13,146][52662] Sum rewards: 55.411, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.716', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.128', 'weapon5': '0.140', 'AMMO4': '0.259', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon4': '0.842', 'weapon3': '2.380', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '43.000'} [2024-08-06 01:28:13,975][52660] DAMAGECOUNT value on done: 199207.0 [2024-08-06 01:28:13,977][52660] Sum rewards: 59.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.112', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.140', 'AMMO4': '0.189', 'AMMO3': '0.229', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:14,055][52667] DAMAGECOUNT value on done: 201256.0 [2024-08-06 01:28:14,057][52667] Sum rewards: 72.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.987', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.500'} [2024-08-06 01:28:15,665][52662] DAMAGECOUNT value on done: 203594.0 [2024-08-06 01:28:15,666][52662] Sum rewards: 52.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.446', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.131', 'weapon4': '0.178', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.156', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '44.000'} [2024-08-06 01:28:16,061][52650] Updated weights for policy 0, policy_version 30611 (0.0022) [2024-08-06 01:28:16,151][52668] DAMAGECOUNT value on done: 205011.0 [2024-08-06 01:28:16,151][52668] Sum rewards: 51.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.229', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '2.984', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '44.000'} [2024-08-06 01:28:16,769][52660] DAMAGECOUNT value on done: 204338.0 [2024-08-06 01:28:16,771][52660] Sum rewards: 64.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'AMMO4': '0.216', 'weapon4': '0.290', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '53.000'} [2024-08-06 01:28:17,199][52667] DAMAGECOUNT value on done: 205069.0 [2024-08-06 01:28:17,200][52667] Sum rewards: 69.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.010', 'AMMO4': '0.036', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.694', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 01:28:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 250789888. Throughput: 0: 4373.7. Samples: 62696980. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:28:17,795][52567] Avg episode reward: [(0, '61.654')] [2024-08-06 01:28:18,394][52662] DAMAGECOUNT value on done: 207887.0 [2024-08-06 01:28:18,394][52662] Sum rewards: 56.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.074', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '45.000'} [2024-08-06 01:28:19,225][52668] DAMAGECOUNT value on done: 203830.0 [2024-08-06 01:28:19,227][52668] Sum rewards: 71.935, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.126', 'weapon5': '0.158', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '58.000'} [2024-08-06 01:28:20,000][52660] DAMAGECOUNT value on done: 205570.0 [2024-08-06 01:28:20,001][52660] Sum rewards: 62.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.684', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:20,297][52667] DAMAGECOUNT value on done: 204223.0 [2024-08-06 01:28:20,298][52667] Sum rewards: 56.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.206', 'weapon4': '0.212', 'AMMO4': '0.223', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.168', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '47.000'} [2024-08-06 01:28:21,065][52662] DAMAGECOUNT value on done: 212174.0 [2024-08-06 01:28:21,066][52662] Sum rewards: 68.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.201', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 01:28:21,093][52650] Updated weights for policy 0, policy_version 30621 (0.0035) [2024-08-06 01:28:21,925][52668] DAMAGECOUNT value on done: 206125.0 [2024-08-06 01:28:21,926][52668] Sum rewards: 47.726, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'WEAPON4': '0.300', 'weapon4': '0.412', 'weapon2': '0.510', 'WEAPON3': '0.950', 'weapon3': '2.772', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '11.862', 'FRAGCOUNT': '38.000'} [2024-08-06 01:28:22,694][52660] DAMAGECOUNT value on done: 202942.0 [2024-08-06 01:28:22,695][52660] Sum rewards: 62.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.312', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:22,787][52669] DAMAGECOUNT value on done: 205847.0 [2024-08-06 01:28:22,788][52669] Sum rewards: 42.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.185', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.440', 'weapon3': '2.836', 'DAMAGECOUNT': '12.003', 'FRAGCOUNT': '37.000'} [2024-08-06 01:28:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 250880000. Throughput: 0: 4371.1. Samples: 62723310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:28:22,802][52567] Avg episode reward: [(0, '61.610')] [2024-08-06 01:28:23,425][52667] DAMAGECOUNT value on done: 206700.0 [2024-08-06 01:28:23,426][52667] Sum rewards: 63.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.555', 'AMMO5': '0.004', 'weapon5': '0.034', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.175', 'weapon4': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '53.000'} [2024-08-06 01:28:23,818][52662] DAMAGECOUNT value on done: 205241.0 [2024-08-06 01:28:23,818][52662] Sum rewards: 55.846, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.447', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.120', 'weapon4': '0.214', 'AMMO4': '0.238', 'AMMO3': '0.264', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.096', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:24,194][52794] DAMAGECOUNT value on done: 207867.0 [2024-08-06 01:28:24,194][52794] Sum rewards: 66.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.105', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.134', 'weapon4': '0.184', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.700', 'weapon3': '2.802', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 01:28:25,325][52650] Updated weights for policy 0, policy_version 30631 (0.0013) [2024-08-06 01:28:25,498][52668] DAMAGECOUNT value on done: 204973.0 [2024-08-06 01:28:25,498][52668] Sum rewards: 71.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.222', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '61.000'} [2024-08-06 01:28:25,523][52669] DAMAGECOUNT value on done: 201336.0 [2024-08-06 01:28:25,523][52669] Sum rewards: 54.250, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.058', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.128', 'AMMO3': '0.185', 'AMMO4': '0.227', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.722', 'WEAPON3': '1.050', 'weapon3': '2.668', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '47.500'} [2024-08-06 01:28:26,097][52660] DAMAGECOUNT value on done: 201128.0 [2024-08-06 01:28:26,099][52660] Sum rewards: 46.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.042', 'AMMO4': '0.110', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '1.122', 'WEAPON3': '1.200', 'weapon3': '2.620', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '40.000'} [2024-08-06 01:28:26,155][52667] DAMAGECOUNT value on done: 203049.0 [2024-08-06 01:28:26,156][52667] Sum rewards: 69.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.814', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.214', 'weapon2': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.360', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '57.000'} [2024-08-06 01:28:27,106][52662] DAMAGECOUNT value on done: 214308.0 [2024-08-06 01:28:27,111][52662] Sum rewards: 80.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.413', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '66.000'} [2024-08-06 01:28:27,430][52794] DAMAGECOUNT value on done: 210422.0 [2024-08-06 01:28:27,430][52794] Sum rewards: 60.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.836', 'AMMO2': '0.030', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.225', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '51.000'} [2024-08-06 01:28:27,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 250970112. Throughput: 0: 4371.1. Samples: 62749700. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 01:28:27,802][52567] Avg episode reward: [(0, '61.805')] [2024-08-06 01:28:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030636_250970112.pth... [2024-08-06 01:28:27,961][52614] Signal inference workers to stop experience collection... (5600 times) [2024-08-06 01:28:27,961][52614] Signal inference workers to resume experience collection... (5600 times) [2024-08-06 01:28:27,967][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030123_246767616.pth [2024-08-06 01:28:28,009][52650] InferenceWorker_p0-w0: stopping experience collection (5600 times) [2024-08-06 01:28:28,009][52650] InferenceWorker_p0-w0: resuming experience collection (5600 times) [2024-08-06 01:28:28,283][52668] DAMAGECOUNT value on done: 199529.0 [2024-08-06 01:28:28,283][52668] Sum rewards: 57.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '48.000'} [2024-08-06 01:28:28,662][52669] DAMAGECOUNT value on done: 205629.0 [2024-08-06 01:28:28,664][52669] Sum rewards: 46.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.693', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'AMMO3': '0.196', 'WEAPON4': '0.500', 'weapon2': '0.552', 'weapon4': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.570', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '41.000'} [2024-08-06 01:28:29,149][52660] DAMAGECOUNT value on done: 203997.0 [2024-08-06 01:28:29,149][52660] Sum rewards: 67.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.763', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.278', 'weapon4': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '59.000'} [2024-08-06 01:28:29,260][52667] DAMAGECOUNT value on done: 203019.0 [2024-08-06 01:28:29,261][52667] Sum rewards: 71.368, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.258', 'weapon4': '0.014', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.227', 'weapon2': '0.640', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '61.000'} [2024-08-06 01:28:29,972][52662] DAMAGECOUNT value on done: 205084.0 [2024-08-06 01:28:29,974][52662] Sum rewards: 64.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.068', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.220', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:30,248][52794] DAMAGECOUNT value on done: 204535.0 [2024-08-06 01:28:30,249][52794] Sum rewards: 60.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.976', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.118', 'AMMO4': '0.183', 'weapon2': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.310', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '51.000'} [2024-08-06 01:28:30,366][52650] Updated weights for policy 0, policy_version 30641 (0.0023) [2024-08-06 01:28:31,254][52668] DAMAGECOUNT value on done: 193788.0 [2024-08-06 01:28:31,255][52668] Sum rewards: 50.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.602', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.074', 'weapon5': '0.082', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '44.000'} [2024-08-06 01:28:31,774][52669] DAMAGECOUNT value on done: 201821.0 [2024-08-06 01:28:31,774][52669] Sum rewards: 56.229, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.412', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.055', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.277', 'weapon4': '0.422', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '0.900', 'weapon3': '2.798', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '47.500'} [2024-08-06 01:28:31,916][52660] DAMAGECOUNT value on done: 206730.0 [2024-08-06 01:28:31,917][52660] Sum rewards: 62.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.154', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.050', 'weapon3': '2.732', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:31,955][52667] DAMAGECOUNT value on done: 206549.0 [2024-08-06 01:28:31,958][52667] Sum rewards: 50.133, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.606', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.264', 'weapon2': '0.304', 'WEAPON4': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.500', 'weapon3': '2.764', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '46.000'} [2024-08-06 01:28:32,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 251043840. Throughput: 0: 4357.8. Samples: 62762390. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 01:28:32,795][52567] Avg episode reward: [(0, '61.364')] [2024-08-06 01:28:32,962][52662] DAMAGECOUNT value on done: 206080.0 [2024-08-06 01:28:32,964][52662] Sum rewards: 71.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.683', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '60.000'} [2024-08-06 01:28:33,244][52794] DAMAGECOUNT value on done: 204770.0 [2024-08-06 01:28:33,254][52794] Sum rewards: 59.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.199', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.155', 'AMMO3': '0.215', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.030', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:33,861][52669] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:28:34,086][52668] DAMAGECOUNT value on done: 200334.0 [2024-08-06 01:28:34,088][52668] Sum rewards: 57.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.868', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.220', 'AMMO3': '0.232', 'weapon2': '0.306', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.238', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '48.000'} [2024-08-06 01:28:34,123][52820] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:28:34,487][52669] DAMAGECOUNT value on done: 203327.0 [2024-08-06 01:28:34,489][52669] Sum rewards: 69.102, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'weapon4': '0.026', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.174', 'weapon2': '0.622', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.192', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '56.000'} [2024-08-06 01:28:34,751][52660] DAMAGECOUNT value on done: 205956.0 [2024-08-06 01:28:34,751][52660] Sum rewards: 58.831, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.302', 'weapon4': '0.394', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:34,788][52650] Updated weights for policy 0, policy_version 30651 (0.0022) [2024-08-06 01:28:34,844][52667] DAMAGECOUNT value on done: 206820.0 [2024-08-06 01:28:34,845][52667] Sum rewards: 78.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.128', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.658', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '63.000'} [2024-08-06 01:28:36,082][52662] DAMAGECOUNT value on done: 203124.0 [2024-08-06 01:28:36,084][52662] Sum rewards: 50.242, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.683', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon7': '0.194', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'weapon2': '0.358', 'weapon4': '0.564', 'WEAPON3': '1.650', 'weapon3': '2.596', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '47.000'} [2024-08-06 01:28:36,436][52794] DAMAGECOUNT value on done: 204782.0 [2024-08-06 01:28:36,436][52794] Sum rewards: 64.842, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.466', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.203', 'weapon4': '0.464', 'WEAPON4': '0.500', 'weapon2': '0.676', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '53.000'} [2024-08-06 01:28:37,090][52668] DAMAGECOUNT value on done: 198621.0 [2024-08-06 01:28:37,090][52668] Sum rewards: 56.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.396', 'weapon2': '0.786', 'WEAPON3': '1.000', 'weapon3': '2.640', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '12.870', 'FRAGCOUNT': '46.000'} [2024-08-06 01:28:37,165][52667] DAMAGECOUNT value on done: 203908.0 [2024-08-06 01:28:37,167][52667] Sum rewards: 67.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon4': '0.364', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '55.000'} [2024-08-06 01:28:37,597][52669] DAMAGECOUNT value on done: 201495.0 [2024-08-06 01:28:37,597][52669] Sum rewards: 54.829, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.028', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.279', 'weapon2': '0.454', 'WEAPON3': '1.700', 'HITCOUNT': '3.170', 'weapon3': '3.224', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 251142144. Throughput: 0: 4371.1. Samples: 62788860. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 01:28:37,794][52567] Avg episode reward: [(0, '61.298')] [2024-08-06 01:28:37,846][52660] DAMAGECOUNT value on done: 201853.0 [2024-08-06 01:28:37,847][52660] Sum rewards: 58.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.000', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.880', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:39,093][52662] DAMAGECOUNT value on done: 211659.0 [2024-08-06 01:28:39,094][52662] Sum rewards: 59.120, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO4': '0.180', 'WEAPON5': '0.300', 'weapon2': '0.300', 'AMMO3': '0.303', 'WEAPON4': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.830', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:39,330][52794] DAMAGECOUNT value on done: 206011.0 [2024-08-06 01:28:39,330][52794] Sum rewards: 58.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.218', 'AMMO3': '0.229', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '2.946', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:39,416][52650] Updated weights for policy 0, policy_version 30661 (0.0011) [2024-08-06 01:28:39,885][52668] DAMAGECOUNT value on done: 205054.0 [2024-08-06 01:28:39,888][52668] Sum rewards: 68.073, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.844', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'AMMO4': '0.230', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.656', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '58.500'} [2024-08-06 01:28:39,970][52647] DAMAGECOUNT value on done: 217652.0 [2024-08-06 01:28:39,970][52647] Sum rewards: 60.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.142', 'weapon4': '0.164', 'AMMO4': '0.188', 'AMMO3': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '51.000'} [2024-08-06 01:28:40,017][52667] DAMAGECOUNT value on done: 206053.0 [2024-08-06 01:28:40,018][52667] Sum rewards: 62.297, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.615', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.520', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.234', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '53.000'} [2024-08-06 01:28:40,452][52660] DAMAGECOUNT value on done: 208906.0 [2024-08-06 01:28:40,453][52660] Sum rewards: 58.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.171', 'weapon4': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.646', 'WEAPON3': '0.800', 'weapon3': '2.720', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '46.000'} [2024-08-06 01:28:40,580][52669] DAMAGECOUNT value on done: 204869.0 [2024-08-06 01:28:40,581][52669] Sum rewards: 67.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.264', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '59.000'} [2024-08-06 01:28:42,113][52662] DAMAGECOUNT value on done: 208464.0 [2024-08-06 01:28:42,113][52662] Sum rewards: 71.135, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.370', 'weapon4': '0.478', 'WEAPON3': '0.950', 'weapon3': '2.914', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '57.000'} [2024-08-06 01:28:42,403][52668] DAMAGECOUNT value on done: 198102.0 [2024-08-06 01:28:42,405][52668] Sum rewards: 37.237, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.046', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.133', 'weapon2': '0.158', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon3': '1.416', 'weapon4': '1.948', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '9.090', 'FRAGCOUNT': '30.000'} [2024-08-06 01:28:42,416][52667] DAMAGECOUNT value on done: 201464.0 [2024-08-06 01:28:42,419][52667] Sum rewards: 52.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.226', 'weapon4': '0.464', 'WEAPON4': '0.500', 'weapon2': '0.714', 'WEAPON3': '1.300', 'weapon3': '2.386', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '44.000'} [2024-08-06 01:28:42,565][52794] DAMAGECOUNT value on done: 210191.0 [2024-08-06 01:28:42,566][52794] Sum rewards: 58.527, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.075', 'weapon4': '0.142', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.808', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '48.500'} [2024-08-06 01:28:42,726][52647] DAMAGECOUNT value on done: 214319.0 [2024-08-06 01:28:42,726][52647] Sum rewards: 60.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.590', 'AMMO5': '0.012', 'AMMO2': '0.071', 'weapon5': '0.168', 'AMMO3': '0.169', 'weapon2': '0.276', 'WEAPON5': '0.300', 'AMMO4': '0.355', 'WEAPON4': '0.450', 'weapon4': '0.746', 'WEAPON3': '0.950', 'weapon3': '2.466', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '50.000'} [2024-08-06 01:28:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 251232256. Throughput: 0: 4390.4. Samples: 62815500. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 01:28:42,794][52567] Avg episode reward: [(0, '61.079')] [2024-08-06 01:28:42,955][52660] DAMAGECOUNT value on done: 197601.0 [2024-08-06 01:28:42,956][52660] Sum rewards: 64.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.108', 'AMMO3': '0.175', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.378', 'weapon4': '0.518', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:43,801][52669] DAMAGECOUNT value on done: 204018.0 [2024-08-06 01:28:43,801][52669] Sum rewards: 69.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '56.000'} [2024-08-06 01:28:44,332][52650] Updated weights for policy 0, policy_version 30671 (0.0011) [2024-08-06 01:28:44,721][52668] DAMAGECOUNT value on done: 206328.0 [2024-08-06 01:28:44,722][52668] Sum rewards: 58.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.625', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.148', 'AMMO3': '0.225', 'weapon2': '0.312', 'WEAPON4': '0.500', 'weapon4': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.754', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '49.000'} [2024-08-06 01:28:45,185][52660] DAMAGECOUNT value on done: 201810.0 [2024-08-06 01:28:45,186][52660] Sum rewards: 60.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.166', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.426', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '51.000'} [2024-08-06 01:28:45,403][52662] DAMAGECOUNT value on done: 213498.0 [2024-08-06 01:28:45,409][52662] Sum rewards: 62.806, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.454', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.148', 'weapon4': '0.158', 'weapon2': '0.192', 'AMMO3': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:45,579][52667] DAMAGECOUNT value on done: 208112.0 [2024-08-06 01:28:45,579][52667] Sum rewards: 62.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'ARMOR': '0.004', 'AMMO2': '0.039', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.100', 'AMMO3': '0.187', 'AMMO4': '0.193', 'WEAPON4': '0.400', 'weapon4': '0.452', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '53.000'} [2024-08-06 01:28:45,584][52647] DAMAGECOUNT value on done: 215690.0 [2024-08-06 01:28:45,585][52647] Sum rewards: 65.930, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.699', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:45,698][52794] DAMAGECOUNT value on done: 205176.0 [2024-08-06 01:28:45,698][52794] Sum rewards: 43.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.604', 'AMMO5': '0.007', 'AMMO2': '0.073', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.136', 'weapon7': '0.168', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO4': '0.364', 'WEAPON4': '0.750', 'weapon4': '1.026', 'WEAPON3': '1.250', 'weapon3': '2.078', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '37.000'} [2024-08-06 01:28:46,690][52669] DAMAGECOUNT value on done: 204128.0 [2024-08-06 01:28:46,692][52669] Sum rewards: 57.521, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon4': '0.098', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'AMMO4': '0.254', 'WEAPON4': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.450', 'weapon3': '2.946', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '51.000'} [2024-08-06 01:28:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 251322368. Throughput: 0: 4394.0. Samples: 62828780. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:28:47,794][52567] Avg episode reward: [(0, '61.187')] [2024-08-06 01:28:47,955][52668] DAMAGECOUNT value on done: 206187.0 [2024-08-06 01:28:47,956][52668] Sum rewards: 61.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.255', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:47,962][52647] DAMAGECOUNT value on done: 216543.0 [2024-08-06 01:28:47,964][52647] Sum rewards: 54.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.801', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.138', 'weapon5': '0.154', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO4': '0.268', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '44.000'} [2024-08-06 01:28:48,049][52662] DAMAGECOUNT value on done: 204619.0 [2024-08-06 01:28:48,050][52662] Sum rewards: 55.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.502', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.036', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '48.000'} [2024-08-06 01:28:48,316][52667] DAMAGECOUNT value on done: 212899.0 [2024-08-06 01:28:48,317][52667] Sum rewards: 63.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:48,448][52794] DAMAGECOUNT value on done: 210384.0 [2024-08-06 01:28:48,449][52794] Sum rewards: 54.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.224', 'weapon5': '0.282', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.350', 'weapon3': '2.620', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '47.000'} [2024-08-06 01:28:48,475][52660] DAMAGECOUNT value on done: 206956.0 [2024-08-06 01:28:48,478][52660] Sum rewards: 50.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.790', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.358', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.806', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '44.000'} [2024-08-06 01:28:48,713][52650] Updated weights for policy 0, policy_version 30681 (0.0050) [2024-08-06 01:28:49,390][52669] DAMAGECOUNT value on done: 200941.0 [2024-08-06 01:28:49,398][52669] Sum rewards: 57.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.110', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.308', 'weapon4': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '49.000'} [2024-08-06 01:28:49,404][52658] DAMAGECOUNT value on done: 208637.0 [2024-08-06 01:28:49,404][52658] Sum rewards: 59.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.018', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.198', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.256', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:50,426][52647] DAMAGECOUNT value on done: 216064.0 [2024-08-06 01:28:50,426][52647] Sum rewards: 58.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.210', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '47.000'} [2024-08-06 01:28:50,892][52667] DAMAGECOUNT value on done: 207899.0 [2024-08-06 01:28:50,892][52667] Sum rewards: 68.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.160', 'AMMO3': '0.192', 'weapon5': '0.202', 'weapon2': '0.230', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '55.000'} [2024-08-06 01:28:51,147][52668] DAMAGECOUNT value on done: 202929.0 [2024-08-06 01:28:51,149][52668] Sum rewards: 59.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.096', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.284', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.152', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '48.000'} [2024-08-06 01:28:51,255][52662] DAMAGECOUNT value on done: 208118.0 [2024-08-06 01:28:51,256][52662] Sum rewards: 59.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon5': '0.126', 'AMMO3': '0.174', 'AMMO4': '0.285', 'weapon4': '0.348', 'weapon2': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '51.500'} [2024-08-06 01:28:51,459][52669] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 01:28:51,545][52794] DAMAGECOUNT value on done: 209181.0 [2024-08-06 01:28:51,545][52794] Sum rewards: 52.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.041', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.122', 'AMMO4': '0.151', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '46.000'} [2024-08-06 01:28:51,554][52660] DAMAGECOUNT value on done: 212877.0 [2024-08-06 01:28:51,555][52660] Sum rewards: 48.714, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.572', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO4': '0.205', 'weapon4': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.750', 'weapon3': '2.844', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '45.500'} [2024-08-06 01:28:52,273][52658] DAMAGECOUNT value on done: 205897.0 [2024-08-06 01:28:52,273][52658] Sum rewards: 65.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'weapon7': '0.116', 'AMMO3': '0.196', 'weapon4': '0.216', 'weapon2': '0.744', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:52,294][52669] DAMAGECOUNT value on done: 204933.0 [2024-08-06 01:28:52,295][52669] Sum rewards: 61.182, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.220', 'weapon2': '0.236', 'HEALTH': '0.262', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.086', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 251404288. Throughput: 0: 4406.2. Samples: 62855390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:28:52,794][52567] Avg episode reward: [(0, '60.429')] [2024-08-06 01:28:53,324][52650] Updated weights for policy 0, policy_version 30691 (0.0013) [2024-08-06 01:28:53,591][52647] DAMAGECOUNT value on done: 220079.0 [2024-08-06 01:28:53,591][52647] Sum rewards: 68.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO4': '0.210', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.000'} [2024-08-06 01:28:53,986][52667] DAMAGECOUNT value on done: 209943.0 [2024-08-06 01:28:53,987][52667] Sum rewards: 61.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.912', 'AMMO5': '0.014', 'AMMO2': '0.069', 'weapon5': '0.114', 'AMMO3': '0.195', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.322', 'AMMO4': '0.343', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.046', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:54,013][52660] DAMAGECOUNT value on done: 198845.0 [2024-08-06 01:28:54,015][52660] Sum rewards: 67.504, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.700', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.266', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.282', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '59.000'} [2024-08-06 01:28:54,204][52662] DAMAGECOUNT value on done: 205923.0 [2024-08-06 01:28:54,205][52662] Sum rewards: 62.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.052', 'AMMO4': '0.155', 'AMMO3': '0.170', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '52.500'} [2024-08-06 01:28:54,384][52794] DAMAGECOUNT value on done: 206470.0 [2024-08-06 01:28:54,385][52794] Sum rewards: 75.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.764', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO3': '0.174', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '62.000'} [2024-08-06 01:28:55,069][52669] DAMAGECOUNT value on done: 206436.0 [2024-08-06 01:28:55,078][52669] Sum rewards: 60.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.050', 'AMMO4': '0.131', 'weapon4': '0.156', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '51.000'} [2024-08-06 01:28:55,158][52658] DAMAGECOUNT value on done: 207201.0 [2024-08-06 01:28:55,158][52658] Sum rewards: 54.550, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.106', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.280', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.174', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '47.000'} [2024-08-06 01:28:56,738][52647] DAMAGECOUNT value on done: 214590.0 [2024-08-06 01:28:56,739][52647] Sum rewards: 67.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.446', 'ARMOR': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.444', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.810', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '57.000'} [2024-08-06 01:28:56,777][52662] DAMAGECOUNT value on done: 203821.0 [2024-08-06 01:28:56,778][52662] Sum rewards: 73.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.480', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.866', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '60.000'} [2024-08-06 01:28:56,940][52667] DAMAGECOUNT value on done: 199358.0 [2024-08-06 01:28:56,943][52667] Sum rewards: 60.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO3': '0.225', 'AMMO4': '0.229', 'weapon2': '0.302', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.782', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:56,977][52660] DAMAGECOUNT value on done: 205641.0 [2024-08-06 01:28:56,978][52660] Sum rewards: 45.857, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.856', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'AMMO4': '0.199', 'WEAPON7': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.904', 'weapon3': '2.126', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '11.460', 'FRAGCOUNT': '36.000'} [2024-08-06 01:28:57,099][52794] DAMAGECOUNT value on done: 206485.0 [2024-08-06 01:28:57,102][52794] Sum rewards: 68.149, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.778', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.146', 'AMMO3': '0.161', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '3.274', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 251494400. Throughput: 0: 4393.1. Samples: 62881360. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:28:57,795][52567] Avg episode reward: [(0, '60.715')] [2024-08-06 01:28:58,040][52669] DAMAGECOUNT value on done: 199789.0 [2024-08-06 01:28:58,041][52669] Sum rewards: 50.115, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.815', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.306', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON4': '0.700', 'weapon4': '0.768', 'WEAPON3': '1.200', 'weapon3': '2.236', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '45.000'} [2024-08-06 01:28:58,048][52650] Updated weights for policy 0, policy_version 30701 (0.0031) [2024-08-06 01:28:58,202][52658] DAMAGECOUNT value on done: 207660.0 [2024-08-06 01:28:58,202][52658] Sum rewards: 59.991, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.857', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.036', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.266', 'AMMO3': '0.283', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.222', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '53.000'} [2024-08-06 01:28:59,209][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:28:59,674][52647] DAMAGECOUNT value on done: 214070.0 [2024-08-06 01:28:59,679][52647] Sum rewards: 61.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.192', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.054', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.474', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.228', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '52.000'} [2024-08-06 01:28:59,742][52668] Large shaping reward 3.572 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 01:28:59,758][52660] DAMAGECOUNT value on done: 196225.0 [2024-08-06 01:28:59,758][52660] Sum rewards: 63.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'weapon4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.218', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '54.000'} [2024-08-06 01:28:59,870][52794] DAMAGECOUNT value on done: 203812.0 [2024-08-06 01:28:59,872][52794] Sum rewards: 64.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.164', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.280', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '55.000'} [2024-08-06 01:28:59,885][52667] DAMAGECOUNT value on done: 209331.0 [2024-08-06 01:28:59,886][52667] Sum rewards: 68.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.392', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon4': '0.040', 'weapon5': '0.044', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '59.000'} [2024-08-06 01:29:01,067][52658] DAMAGECOUNT value on done: 206530.0 [2024-08-06 01:29:01,069][52658] Sum rewards: 53.251, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.560', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'AMMO3': '0.164', 'weapon2': '0.770', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.112', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '44.000'} [2024-08-06 01:29:01,132][52669] DAMAGECOUNT value on done: 207247.0 [2024-08-06 01:29:01,133][52669] Sum rewards: 52.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.916', 'ARMOR': '0.008', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.201', 'WEAPON4': '0.450', 'weapon4': '0.458', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '44.000'} [2024-08-06 01:29:02,660][52794] DAMAGECOUNT value on done: 216758.0 [2024-08-06 01:29:02,661][52794] Sum rewards: 71.238, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.008', 'AMMO2': '0.064', 'AMMO3': '0.182', 'weapon5': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO4': '0.319', 'weapon4': '0.398', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:02,721][52650] Updated weights for policy 0, policy_version 30711 (0.0018) [2024-08-06 01:29:02,728][52660] DAMAGECOUNT value on done: 205814.0 [2024-08-06 01:29:02,730][52660] Sum rewards: 70.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.193', 'weapon5': '0.258', 'weapon4': '0.344', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '59.000'} [2024-08-06 01:29:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 251584512. Throughput: 0: 4392.0. Samples: 62894620. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:29:02,794][52567] Avg episode reward: [(0, '60.807')] [2024-08-06 01:29:02,812][52647] DAMAGECOUNT value on done: 215831.0 [2024-08-06 01:29:02,813][52647] Sum rewards: 54.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO2': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO4': '0.159', 'AMMO3': '0.212', 'weapon2': '0.674', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '2.990', 'DAMAGECOUNT': '13.194', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:03,698][52658] DAMAGECOUNT value on done: 203064.0 [2024-08-06 01:29:03,700][52658] Sum rewards: 65.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.206', 'AMMO3': '0.245', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:03,808][52669] DAMAGECOUNT value on done: 210368.0 [2024-08-06 01:29:03,810][52669] Sum rewards: 51.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.151', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.172', 'AMMO4': '0.191', 'weapon2': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.910', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '44.000'} [2024-08-06 01:29:05,115][52647] DAMAGECOUNT value on done: 212375.0 [2024-08-06 01:29:05,117][52647] Sum rewards: 63.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.038', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.192', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.340', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:05,430][52660] DAMAGECOUNT value on done: 201869.0 [2024-08-06 01:29:05,431][52660] Sum rewards: 72.544, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.585', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.166', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.336', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:05,715][52794] DAMAGECOUNT value on done: 202577.0 [2024-08-06 01:29:05,715][52794] Sum rewards: 60.521, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.250', 'weapon4': '0.250', 'AMMO3': '0.277', 'weapon2': '0.288', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:06,728][52658] DAMAGECOUNT value on done: 211405.0 [2024-08-06 01:29:06,730][52658] Sum rewards: 68.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.068', 'weapon5': '0.176', 'AMMO3': '0.251', 'weapon4': '0.268', 'AMMO4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.782', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:06,895][52669] DAMAGECOUNT value on done: 216748.0 [2024-08-06 01:29:06,895][52669] Sum rewards: 56.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.205', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO4': '0.188', 'weapon2': '0.202', 'AMMO3': '0.211', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:06,897][52795] DAMAGECOUNT value on done: 189389.0 [2024-08-06 01:29:06,897][52795] Sum rewards: 72.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.054', 'weapon2': '0.180', 'weapon4': '0.180', 'AMMO3': '0.215', 'WEAPON3': '1.350', 'weapon3': '3.442', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 01:29:06,948][52666] DAMAGECOUNT value on done: 208756.0 [2024-08-06 01:29:06,949][52666] Sum rewards: 57.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.881', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.090', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.210', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '48.500'} [2024-08-06 01:29:07,331][52650] Updated weights for policy 0, policy_version 30721 (0.0018) [2024-08-06 01:29:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 251674624. Throughput: 0: 4400.7. Samples: 62921340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:29:07,795][52567] Avg episode reward: [(0, '60.998')] [2024-08-06 01:29:08,157][52647] DAMAGECOUNT value on done: 213729.0 [2024-08-06 01:29:08,158][52647] Sum rewards: 49.504, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'HEALTH': '0.015', 'AMMO2': '0.020', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.128', 'WEAPON4': '0.300', 'weapon2': '0.460', 'weapon4': '0.642', 'WEAPON3': '0.700', 'HITCOUNT': '2.540', 'weapon3': '2.696', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '39.000'} [2024-08-06 01:29:08,683][52794] DAMAGECOUNT value on done: 213709.0 [2024-08-06 01:29:08,684][52794] Sum rewards: 67.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:09,744][52666] DAMAGECOUNT value on done: 208628.0 [2024-08-06 01:29:09,744][52666] Sum rewards: 63.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.358', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:09,892][52658] DAMAGECOUNT value on done: 201791.0 [2024-08-06 01:29:09,892][52658] Sum rewards: 68.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.574', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:10,042][52795] DAMAGECOUNT value on done: 186747.0 [2024-08-06 01:29:10,043][52795] Sum rewards: 69.092, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.435', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.170', 'AMMO4': '0.198', 'weapon2': '0.214', 'AMMO3': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:10,054][52669] DAMAGECOUNT value on done: 203025.0 [2024-08-06 01:29:10,056][52669] Sum rewards: 59.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'weapon2': '0.548', 'weapon4': '0.610', 'WEAPON3': '1.300', 'weapon3': '2.460', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:10,644][52647] DAMAGECOUNT value on done: 211973.0 [2024-08-06 01:29:10,646][52647] Sum rewards: 61.679, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.750', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.296', 'weapon2': '0.670', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:11,670][52794] DAMAGECOUNT value on done: 208961.0 [2024-08-06 01:29:11,671][52794] Sum rewards: 51.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.602', 'AMMO5': '0.016', 'AMMO2': '0.064', 'AMMO3': '0.187', 'weapon5': '0.252', 'AMMO4': '0.320', 'WEAPON5': '0.400', 'weapon2': '0.402', 'weapon4': '0.486', 'WEAPON4': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.560', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '45.000'} [2024-08-06 01:29:12,032][52650] Updated weights for policy 0, policy_version 30731 (0.0016) [2024-08-06 01:29:12,603][52658] DAMAGECOUNT value on done: 210044.0 [2024-08-06 01:29:12,603][52658] Sum rewards: 60.831, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.039', 'HEALTH': '0.076', 'weapon5': '0.136', 'AMMO3': '0.149', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.550', 'WEAPON3': '0.800', 'weapon3': '2.616', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '49.500'} [2024-08-06 01:29:12,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 251756544. Throughput: 0: 4395.5. Samples: 62947500. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:29:12,795][52567] Avg episode reward: [(0, '60.814')] [2024-08-06 01:29:12,931][52666] DAMAGECOUNT value on done: 207307.0 [2024-08-06 01:29:12,932][52666] Sum rewards: 67.604, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.254', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.100', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.260', 'weapon3': '3.358', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '61.000'} [2024-08-06 01:29:13,013][52669] DAMAGECOUNT value on done: 209140.0 [2024-08-06 01:29:13,014][52669] Sum rewards: 68.333, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.248', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.223', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '57.000'} [2024-08-06 01:29:13,024][52647] DAMAGECOUNT value on done: 212880.0 [2024-08-06 01:29:13,025][52647] Sum rewards: 58.581, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.192', 'AMMO5': '0.013', 'AMMO2': '0.069', 'weapon5': '0.112', 'AMMO3': '0.206', 'weapon4': '0.220', 'AMMO4': '0.347', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '49.000'} [2024-08-06 01:29:13,262][52795] DAMAGECOUNT value on done: 185989.0 [2024-08-06 01:29:13,262][52795] Sum rewards: 64.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.520', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:14,878][52794] DAMAGECOUNT value on done: 209074.0 [2024-08-06 01:29:14,878][52794] Sum rewards: 63.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.379', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.186', 'AMMO3': '0.188', 'weapon2': '0.294', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:15,429][52658] DAMAGECOUNT value on done: 208998.0 [2024-08-06 01:29:15,429][52658] Sum rewards: 58.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.088', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.648', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:15,684][52666] DAMAGECOUNT value on done: 204335.0 [2024-08-06 01:29:15,686][52666] Sum rewards: 54.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.218', 'AMMO3': '0.223', 'AMMO4': '0.242', 'weapon4': '0.276', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.726', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '46.000'} [2024-08-06 01:29:15,705][52647] DAMAGECOUNT value on done: 215138.0 [2024-08-06 01:29:15,705][52647] Sum rewards: 58.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.096', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'weapon4': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.830', 'WEAPON3': '0.950', 'weapon3': '2.588', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:15,799][52669] DAMAGECOUNT value on done: 209680.0 [2024-08-06 01:29:15,800][52669] Sum rewards: 78.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.221', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '65.000'} [2024-08-06 01:29:16,454][52795] DAMAGECOUNT value on done: 188333.0 [2024-08-06 01:29:16,456][52795] Sum rewards: 57.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.156', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.130', 'weapon4': '0.138', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:16,806][52650] Updated weights for policy 0, policy_version 30741 (0.0029) [2024-08-06 01:29:17,123][52670] DAMAGECOUNT value on done: 202026.0 [2024-08-06 01:29:17,123][52670] Sum rewards: 46.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.365', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.742', 'WEAPON3': '1.100', 'HITCOUNT': '2.420', 'weapon3': '2.912', 'DAMAGECOUNT': '11.118', 'FRAGCOUNT': '40.000'} [2024-08-06 01:29:17,777][52794] DAMAGECOUNT value on done: 215182.0 [2024-08-06 01:29:17,787][52794] Sum rewards: 71.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.179', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 01:29:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 251846656. Throughput: 0: 4404.2. Samples: 62960580. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:29:17,795][52567] Avg episode reward: [(0, '60.988')] [2024-08-06 01:29:18,437][52658] DAMAGECOUNT value on done: 211740.0 [2024-08-06 01:29:18,438][52658] Sum rewards: 67.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.091', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:18,496][52669] DAMAGECOUNT value on done: 211401.0 [2024-08-06 01:29:18,497][52669] Sum rewards: 59.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.612', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.130', 'AMMO4': '0.152', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:18,552][52647] DAMAGECOUNT value on done: 216152.0 [2024-08-06 01:29:18,555][52647] Sum rewards: 46.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.015', 'AMMO5': '0.006', 'AMMO2': '0.052', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'AMMO4': '0.262', 'weapon4': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.786', 'WEAPON3': '1.400', 'weapon3': '2.334', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '12.780', 'FRAGCOUNT': '39.000'} [2024-08-06 01:29:18,873][52666] DAMAGECOUNT value on done: 201201.0 [2024-08-06 01:29:18,875][52666] Sum rewards: 56.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.860', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'AMMO3': '0.251', 'weapon4': '0.440', 'weapon2': '0.536', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.728', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:19,547][52795] DAMAGECOUNT value on done: 191670.0 [2024-08-06 01:29:19,549][52795] Sum rewards: 52.311, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.238', 'AMMO3': '0.274', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.170', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:19,872][52664] DAMAGECOUNT value on done: 211923.0 [2024-08-06 01:29:19,872][52664] Sum rewards: 66.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.024', 'AMMO4': '0.046', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.394', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.320', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:20,263][52670] DAMAGECOUNT value on done: 205677.0 [2024-08-06 01:29:20,264][52670] Sum rewards: 51.750, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.442', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.227', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.002', 'FRAGCOUNT': '46.000'} [2024-08-06 01:29:20,435][52794] DAMAGECOUNT value on done: 208998.0 [2024-08-06 01:29:20,435][52794] Sum rewards: 69.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.108', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '57.000'} [2024-08-06 01:29:21,070][52650] Updated weights for policy 0, policy_version 30751 (0.0012) [2024-08-06 01:29:21,567][52647] DAMAGECOUNT value on done: 213132.0 [2024-08-06 01:29:21,567][52647] Sum rewards: 70.414, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.087', 'AMMO3': '0.143', 'weapon4': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.808', 'WEAPON3': '0.950', 'weapon3': '2.778', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:21,574][52658] DAMAGECOUNT value on done: 199811.0 [2024-08-06 01:29:21,574][52658] Sum rewards: 49.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'weapon4': '0.366', 'WEAPON3': '0.900', 'weapon2': '0.948', 'weapon3': '2.488', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.381', 'FRAGCOUNT': '39.000'} [2024-08-06 01:29:21,646][52666] DAMAGECOUNT value on done: 197624.0 [2024-08-06 01:29:21,647][52666] Sum rewards: 53.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.537', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.208', 'AMMO3': '0.237', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.534', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:22,364][52671] DAMAGECOUNT value on done: 211436.0 [2024-08-06 01:29:22,364][52671] Sum rewards: 77.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.544', 'AMMO5': '0.003', 'AMMO2': '0.006', 'ARMOR': '0.008', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '64.000'} [2024-08-06 01:29:22,475][52664] DAMAGECOUNT value on done: 212439.0 [2024-08-06 01:29:22,475][52664] Sum rewards: 57.430, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.622', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.170', 'weapon2': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.444', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '50.000'} [2024-08-06 01:29:22,680][52795] DAMAGECOUNT value on done: 189722.0 [2024-08-06 01:29:22,680][52795] Sum rewards: 67.059, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.231', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.368', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 251936768. Throughput: 0: 4405.3. Samples: 62987100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:29:22,794][52567] Avg episode reward: [(0, '60.932')] [2024-08-06 01:29:22,885][52670] DAMAGECOUNT value on done: 201702.0 [2024-08-06 01:29:22,887][52670] Sum rewards: 62.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.206', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.270', 'weapon2': '0.318', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:23,984][52647] DAMAGECOUNT value on done: 211219.0 [2024-08-06 01:29:23,992][52647] Sum rewards: 67.389, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.070', 'weapon4': '0.096', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:24,111][52666] DAMAGECOUNT value on done: 204578.0 [2024-08-06 01:29:24,111][52666] Sum rewards: 58.029, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.160', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.160', 'AMMO3': '0.177', 'AMMO4': '0.207', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '46.000'} [2024-08-06 01:29:24,421][52658] DAMAGECOUNT value on done: 204068.0 [2024-08-06 01:29:24,421][52658] Sum rewards: 63.104, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.909', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.120', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:25,114][52664] DAMAGECOUNT value on done: 214093.0 [2024-08-06 01:29:25,115][52664] Sum rewards: 70.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.170', 'weapon2': '0.176', 'AMMO3': '0.186', 'AMMO4': '0.240', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '60.000'} [2024-08-06 01:29:25,247][52670] DAMAGECOUNT value on done: 202909.0 [2024-08-06 01:29:25,247][52670] Sum rewards: 65.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.203', 'weapon4': '0.240', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:25,493][52671] DAMAGECOUNT value on done: 203775.0 [2024-08-06 01:29:25,497][52671] Sum rewards: 61.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.305', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.116', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:25,806][52795] DAMAGECOUNT value on done: 194049.0 [2024-08-06 01:29:25,806][52795] Sum rewards: 56.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.146', 'AMMO4': '0.179', 'WEAPON4': '0.350', 'weapon4': '0.402', 'weapon2': '0.664', 'WEAPON3': '0.900', 'weapon3': '2.638', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '46.000'} [2024-08-06 01:29:26,221][52650] Updated weights for policy 0, policy_version 30761 (0.0016) [2024-08-06 01:29:26,680][52666] DAMAGECOUNT value on done: 204377.0 [2024-08-06 01:29:26,682][52666] Sum rewards: 68.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.893', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon4': '0.308', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:26,892][52647] DAMAGECOUNT value on done: 213712.0 [2024-08-06 01:29:26,892][52647] Sum rewards: 63.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.692', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.164', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:27,355][52658] DAMAGECOUNT value on done: 205282.0 [2024-08-06 01:29:27,355][52658] Sum rewards: 52.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'ARMOR': '0.036', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon4': '0.264', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.022', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:27,792][52670] DAMAGECOUNT value on done: 203984.0 [2024-08-06 01:29:27,792][52670] Sum rewards: 62.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.672', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.180', 'weapon5': '0.204', 'weapon4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:27,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 252018688. Throughput: 0: 4395.6. Samples: 63013300. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:29:27,794][52567] Avg episode reward: [(0, '61.218')] [2024-08-06 01:29:28,147][52664] DAMAGECOUNT value on done: 211550.0 [2024-08-06 01:29:28,147][52664] Sum rewards: 61.818, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'HEALTH': '0.010', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.374', 'WEAPON3': '0.950', 'HITCOUNT': '3.010', 'weapon3': '3.362', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:28,160][52671] DAMAGECOUNT value on done: 208021.0 [2024-08-06 01:29:28,160][52671] Sum rewards: 44.037, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.431', 'AMMO5': '0.013', 'ARMOR': '0.032', 'AMMO2': '0.081', 'weapon5': '0.152', 'weapon4': '0.188', 'AMMO3': '0.212', 'WEAPON5': '0.400', 'AMMO4': '0.404', 'weapon2': '0.576', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.814', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '40.500'} [2024-08-06 01:29:29,140][52795] DAMAGECOUNT value on done: 191511.0 [2024-08-06 01:29:29,142][52795] Sum rewards: 58.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.710', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.222', 'AMMO3': '0.245', 'weapon2': '0.366', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:29,353][52647] DAMAGECOUNT value on done: 209260.0 [2024-08-06 01:29:29,353][52647] Sum rewards: 65.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.619', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.436', 'weapon2': '0.568', 'WEAPON3': '0.900', 'weapon3': '2.672', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:29,466][52666] DAMAGECOUNT value on done: 204129.0 [2024-08-06 01:29:29,466][52666] Sum rewards: 79.963, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'HEALTH': '0.286', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '66.000'} [2024-08-06 01:29:30,523][52670] DAMAGECOUNT value on done: 204867.0 [2024-08-06 01:29:30,524][52670] Sum rewards: 62.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.885', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.179', 'weapon2': '0.334', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.352', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:30,527][52658] DAMAGECOUNT value on done: 200680.0 [2024-08-06 01:29:30,527][52658] Sum rewards: 60.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.794', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.058', 'weapon5': '0.080', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:30,716][52664] DAMAGECOUNT value on done: 212362.0 [2024-08-06 01:29:30,716][52664] Sum rewards: 64.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.307', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.222', 'weapon4': '0.230', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:30,892][52650] Updated weights for policy 0, policy_version 30771 (0.0020) [2024-08-06 01:29:30,902][52671] DAMAGECOUNT value on done: 203119.0 [2024-08-06 01:29:30,904][52671] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.604', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon5': '0.058', 'weapon4': '0.124', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:32,115][52666] DAMAGECOUNT value on done: 203154.0 [2024-08-06 01:29:32,117][52666] Sum rewards: 46.178, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.033', 'AMMO3': '0.087', 'AMMO4': '0.164', 'weapon7': '0.188', 'AMMO6': '0.200', 'AMMO7': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '0.500', 'HEALTH': '0.510', 'weapon3': '1.654', 'weapon4': '1.678', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.836', 'FRAGCOUNT': '35.000'} [2024-08-06 01:29:32,149][52647] DAMAGECOUNT value on done: 216668.0 [2024-08-06 01:29:32,150][52647] Sum rewards: 62.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.162', 'AMMO4': '0.221', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.392', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:32,220][52795] DAMAGECOUNT value on done: 187352.0 [2024-08-06 01:29:32,220][52795] Sum rewards: 62.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.269', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO4': '0.175', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 252108800. Throughput: 0: 4398.4. Samples: 63026710. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:29:32,794][52567] Avg episode reward: [(0, '61.661')] [2024-08-06 01:29:33,137][52670] DAMAGECOUNT value on done: 199717.0 [2024-08-06 01:29:33,138][52670] Sum rewards: 74.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.819', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.220', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.478', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '62.000'} [2024-08-06 01:29:33,344][52664] DAMAGECOUNT value on done: 215312.0 [2024-08-06 01:29:33,344][52664] Sum rewards: 69.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.367', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.199', 'weapon2': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:33,595][52658] DAMAGECOUNT value on done: 204739.0 [2024-08-06 01:29:33,596][52658] Sum rewards: 33.901, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.074', 'weapon7': '0.088', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.700', 'weapon4': '1.388', 'HITCOUNT': '1.560', 'weapon3': '1.918', 'DAMAGECOUNT': '7.824', 'FRAGCOUNT': '28.000'} [2024-08-06 01:29:33,892][52671] DAMAGECOUNT value on done: 208025.0 [2024-08-06 01:29:33,892][52671] Sum rewards: 65.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.105', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.040', 'AMMO4': '0.163', 'weapon5': '0.174', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.140', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:34,644][52666] DAMAGECOUNT value on done: 201343.0 [2024-08-06 01:29:34,647][52666] Sum rewards: 64.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.567', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.117', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.702', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:35,271][52795] DAMAGECOUNT value on done: 192120.0 [2024-08-06 01:29:35,271][52795] Sum rewards: 61.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.745', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.130', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:35,563][52650] Updated weights for policy 0, policy_version 30781 (0.0036) [2024-08-06 01:29:35,939][52664] DAMAGECOUNT value on done: 218008.0 [2024-08-06 01:29:35,939][52664] Sum rewards: 54.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.658', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.096', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.219', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.556', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:35,962][52670] DAMAGECOUNT value on done: 203312.0 [2024-08-06 01:29:35,966][52670] Sum rewards: 58.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon4': '0.246', 'weapon2': '0.412', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '3.084', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:36,300][52658] DAMAGECOUNT value on done: 209951.0 [2024-08-06 01:29:36,300][52658] Sum rewards: 73.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.786', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'weapon4': '0.206', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '63.000'} [2024-08-06 01:29:37,033][52671] DAMAGECOUNT value on done: 207308.0 [2024-08-06 01:29:37,036][52671] Sum rewards: 73.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.224', 'weapon2': '0.504', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '59.000'} [2024-08-06 01:29:37,355][52666] DAMAGECOUNT value on done: 198340.0 [2024-08-06 01:29:37,355][52666] Sum rewards: 53.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.724', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.918', 'WEAPON3': '1.000', 'weapon3': '2.742', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '43.000'} [2024-08-06 01:29:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 252190720. Throughput: 0: 4394.0. Samples: 63053120. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:29:37,794][52567] Avg episode reward: [(0, '61.853')] [2024-08-06 01:29:38,491][52795] DAMAGECOUNT value on done: 189574.0 [2024-08-06 01:29:38,491][52795] Sum rewards: 58.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.174', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.748', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:38,602][52664] DAMAGECOUNT value on done: 206932.0 [2024-08-06 01:29:38,604][52664] Sum rewards: 70.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.284', 'weapon4': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '59.000'} [2024-08-06 01:29:38,721][52670] DAMAGECOUNT value on done: 200465.0 [2024-08-06 01:29:38,723][52670] Sum rewards: 63.006, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:39,157][52671] DAMAGECOUNT value on done: 208285.0 [2024-08-06 01:29:39,159][52671] Sum rewards: 67.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.805', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.228', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:39,394][52658] DAMAGECOUNT value on done: 202744.0 [2024-08-06 01:29:39,395][52658] Sum rewards: 60.576, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.534', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.058', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.432', 'WEAPON3': '1.500', 'weapon3': '2.934', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:39,865][52650] Updated weights for policy 0, policy_version 30791 (0.0012) [2024-08-06 01:29:40,490][52666] DAMAGECOUNT value on done: 206783.0 [2024-08-06 01:29:40,491][52666] Sum rewards: 66.614, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon5': '0.066', 'AMMO3': '0.288', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.414', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:41,042][52664] DAMAGECOUNT value on done: 221778.0 [2024-08-06 01:29:41,050][52664] Sum rewards: 64.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.146', 'weapon5': '0.178', 'AMMO3': '0.202', 'AMMO4': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:41,575][52795] DAMAGECOUNT value on done: 186569.0 [2024-08-06 01:29:41,578][52795] Sum rewards: 61.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.882', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.152', 'weapon4': '0.164', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:41,658][52670] DAMAGECOUNT value on done: 195706.0 [2024-08-06 01:29:41,659][52670] Sum rewards: 57.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.698', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:42,078][52671] DAMAGECOUNT value on done: 209250.0 [2024-08-06 01:29:42,078][52671] Sum rewards: 61.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.112', 'AMMO3': '0.181', 'AMMO4': '0.194', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:42,655][52658] DAMAGECOUNT value on done: 204300.0 [2024-08-06 01:29:42,656][52658] Sum rewards: 54.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.186', 'AMMO3': '0.188', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.430', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:42,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 252289024. Throughput: 0: 4404.6. Samples: 63079570. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:29:42,795][52567] Avg episode reward: [(0, '61.856')] [2024-08-06 01:29:43,136][52666] DAMAGECOUNT value on done: 207103.0 [2024-08-06 01:29:43,138][52666] Sum rewards: 73.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.152', 'AMMO3': '0.189', 'AMMO4': '0.236', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 01:29:43,294][52649] DAMAGECOUNT value on done: 200322.0 [2024-08-06 01:29:43,295][52649] Sum rewards: 53.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.274', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.028', 'weapon4': '0.036', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon2': '0.714', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.044', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '44.000'} [2024-08-06 01:29:43,657][52664] DAMAGECOUNT value on done: 215734.0 [2024-08-06 01:29:43,658][52664] Sum rewards: 56.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.201', 'weapon2': '0.286', 'WEAPON4': '0.350', 'weapon4': '0.554', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:44,047][52670] DAMAGECOUNT value on done: 206459.0 [2024-08-06 01:29:44,048][52670] Sum rewards: 63.738, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.828', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:44,565][52795] DAMAGECOUNT value on done: 187330.0 [2024-08-06 01:29:44,566][52795] Sum rewards: 63.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.122', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.458', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '2.648', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '52.000'} [2024-08-06 01:29:44,629][52650] Updated weights for policy 0, policy_version 30801 (0.0039) [2024-08-06 01:29:45,297][52671] DAMAGECOUNT value on done: 205608.0 [2024-08-06 01:29:45,299][52671] Sum rewards: 63.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.774', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.090', 'AMMO3': '0.200', 'weapon4': '0.244', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:45,316][52663] DAMAGECOUNT value on done: 207832.0 [2024-08-06 01:29:45,318][52663] Sum rewards: 62.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.145', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.118', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'weapon2': '0.566', 'WEAPON3': '0.900', 'weapon3': '3.132', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '48.500'} [2024-08-06 01:29:45,569][52658] DAMAGECOUNT value on done: 208759.0 [2024-08-06 01:29:45,570][52658] Sum rewards: 54.925, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.132', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.550', 'HITCOUNT': '2.710', 'weapon3': '3.344', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '50.000'} [2024-08-06 01:29:45,837][52666] DAMAGECOUNT value on done: 198849.0 [2024-08-06 01:29:45,837][52666] Sum rewards: 40.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.325', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.106', 'AMMO4': '0.211', 'AMMO3': '0.226', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.630', 'weapon3': '3.134', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '36.000'} [2024-08-06 01:29:46,085][52649] DAMAGECOUNT value on done: 196033.0 [2024-08-06 01:29:46,086][52649] Sum rewards: 69.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.025', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.228', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '60.000'} [2024-08-06 01:29:46,389][52664] DAMAGECOUNT value on done: 216797.0 [2024-08-06 01:29:46,389][52664] Sum rewards: 67.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO4': '0.163', 'AMMO3': '0.217', 'weapon4': '0.230', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '56.000'} [2024-08-06 01:29:47,180][52670] DAMAGECOUNT value on done: 205971.0 [2024-08-06 01:29:47,180][52670] Sum rewards: 65.927, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.806', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.046', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.310', 'weapon2': '0.524', 'WEAPON3': '1.850', 'weapon3': '3.090', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:47,762][52795] DAMAGECOUNT value on done: 191704.0 [2024-08-06 01:29:47,763][52795] Sum rewards: 68.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.052', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.474', 'weapon4': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.898', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 252370944. Throughput: 0: 4400.7. Samples: 63092650. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:29:47,794][52567] Avg episode reward: [(0, '61.822')] [2024-08-06 01:29:48,281][52663] DAMAGECOUNT value on done: 205676.0 [2024-08-06 01:29:48,285][52663] Sum rewards: 73.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.790', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.151', 'weapon2': '0.228', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.408', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '63.000'} [2024-08-06 01:29:48,422][52671] DAMAGECOUNT value on done: 208405.0 [2024-08-06 01:29:48,422][52671] Sum rewards: 63.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.049', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.246', 'weapon4': '0.346', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.024', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:48,538][52666] DAMAGECOUNT value on done: 202468.0 [2024-08-06 01:29:48,538][52666] Sum rewards: 57.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.879', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'weapon5': '0.024', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.196', 'weapon2': '0.412', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.422', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:48,822][52664] DAMAGECOUNT value on done: 212237.0 [2024-08-06 01:29:48,822][52664] Sum rewards: 63.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.605', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.110', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:49,138][52650] Updated weights for policy 0, policy_version 30811 (0.0042) [2024-08-06 01:29:49,363][52649] DAMAGECOUNT value on done: 200931.0 [2024-08-06 01:29:49,365][52649] Sum rewards: 53.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.044', 'AMMO2': '0.048', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'AMMO4': '0.240', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '46.000'} [2024-08-06 01:29:49,900][52670] DAMAGECOUNT value on done: 204542.0 [2024-08-06 01:29:49,901][52670] Sum rewards: 56.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.720', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '48.000'} [2024-08-06 01:29:51,008][52795] DAMAGECOUNT value on done: 183626.0 [2024-08-06 01:29:51,009][52795] Sum rewards: 40.822, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.852', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.334', 'AMMO3': '0.361', 'WEAPON3': '2.050', 'HITCOUNT': '2.770', 'weapon3': '2.972', 'DAMAGECOUNT': '12.120', 'FRAGCOUNT': '41.000'} [2024-08-06 01:29:51,215][52671] DAMAGECOUNT value on done: 208052.0 [2024-08-06 01:29:51,226][52671] Sum rewards: 55.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.156', 'AMMO4': '0.184', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.886', 'WEAPON3': '1.250', 'weapon3': '2.324', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:51,274][52666] DAMAGECOUNT value on done: 202230.0 [2024-08-06 01:29:51,276][52666] Sum rewards: 57.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.508', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.186', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:51,352][52663] DAMAGECOUNT value on done: 202643.0 [2024-08-06 01:29:51,353][52663] Sum rewards: 59.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.063', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.210', 'AMMO3': '0.232', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.350', 'weapon3': '2.616', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '50.000'} [2024-08-06 01:29:51,589][52664] DAMAGECOUNT value on done: 211352.0 [2024-08-06 01:29:51,591][52664] Sum rewards: 58.620, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.548', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.122', 'AMMO3': '0.222', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.550', 'weapon2': '0.628', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '50.000'} [2024-08-06 01:29:52,191][52649] DAMAGECOUNT value on done: 199863.0 [2024-08-06 01:29:52,193][52649] Sum rewards: 59.994, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.278', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon4': '0.102', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.281', 'weapon2': '0.688', 'WEAPON3': '1.650', 'weapon3': '2.990', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:52,212][52670] DAMAGECOUNT value on done: 206539.0 [2024-08-06 01:29:52,212][52670] Sum rewards: 64.750, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.492', 'AMMO2': '0.028', 'weapon7': '0.066', 'AMMO4': '0.140', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon2': '0.228', 'AMMO3': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.366', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '54.000'} [2024-08-06 01:29:52,795][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 252461056. Throughput: 0: 4397.7. Samples: 63119240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:29:52,795][52567] Avg episode reward: [(0, '61.263')] [2024-08-06 01:29:53,538][52666] DAMAGECOUNT value on done: 207538.0 [2024-08-06 01:29:53,538][52666] Sum rewards: 75.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.244', 'weapon4': '0.280', 'weapon2': '0.288', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '63.000'} [2024-08-06 01:29:54,019][52664] DAMAGECOUNT value on done: 213219.0 [2024-08-06 01:29:54,019][52664] Sum rewards: 63.155, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.208', 'weapon5': '0.212', 'AMMO4': '0.234', 'AMMO3': '0.279', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.950', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:54,072][52795] DAMAGECOUNT value on done: 195206.0 [2024-08-06 01:29:54,075][52795] Sum rewards: 56.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.123', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.188', 'weapon2': '0.214', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.184', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '51.000'} [2024-08-06 01:29:54,102][52650] Updated weights for policy 0, policy_version 30821 (0.0013) [2024-08-06 01:29:54,328][52671] DAMAGECOUNT value on done: 203775.0 [2024-08-06 01:29:54,330][52671] Sum rewards: 52.759, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.595', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'AMMO4': '0.156', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon2': '1.104', 'weapon3': '2.458', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '43.000'} [2024-08-06 01:29:54,751][52663] DAMAGECOUNT value on done: 206481.0 [2024-08-06 01:29:54,752][52663] Sum rewards: 57.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.054', 'weapon4': '0.074', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.254', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '46.000'} [2024-08-06 01:29:54,990][52670] DAMAGECOUNT value on done: 207321.0 [2024-08-06 01:29:54,991][52670] Sum rewards: 65.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.511', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.193', 'weapon5': '0.244', 'AMMO3': '0.259', 'weapon2': '0.300', 'weapon4': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.792', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '58.000'} [2024-08-06 01:29:55,270][52649] DAMAGECOUNT value on done: 193084.0 [2024-08-06 01:29:55,272][52649] Sum rewards: 65.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'AMMO2': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'AMMO4': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.354', 'weapon4': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:55,533][52659] DAMAGECOUNT value on done: 207238.0 [2024-08-06 01:29:55,534][52659] Sum rewards: 68.944, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.682', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon4': '0.156', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '59.000'} [2024-08-06 01:29:56,447][52664] DAMAGECOUNT value on done: 215524.0 [2024-08-06 01:29:56,448][52664] Sum rewards: 75.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.946', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.144', 'AMMO3': '0.247', 'WEAPON3': '1.650', 'weapon3': '3.588', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '64.000'} [2024-08-06 01:29:56,956][52666] DAMAGECOUNT value on done: 200890.0 [2024-08-06 01:29:56,957][52666] Sum rewards: 68.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '59.000'} [2024-08-06 01:29:57,236][52671] DAMAGECOUNT value on done: 214332.0 [2024-08-06 01:29:57,238][52671] Sum rewards: 55.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.068', 'weapon4': '0.092', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '3.464', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '49.000'} [2024-08-06 01:29:57,258][52795] DAMAGECOUNT value on done: 194819.0 [2024-08-06 01:29:57,260][52795] Sum rewards: 63.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.532', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.170', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.368', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:57,759][52663] DAMAGECOUNT value on done: 203933.0 [2024-08-06 01:29:57,761][52663] Sum rewards: 58.374, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.782', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.044', 'AMMO3': '0.163', 'AMMO4': '0.218', 'weapon5': '0.350', 'weapon4': '0.376', 'weapon2': '0.392', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.624', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '47.000'} [2024-08-06 01:29:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 252551168. Throughput: 0: 4398.9. Samples: 63145450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:29:57,794][52567] Avg episode reward: [(0, '61.531')] [2024-08-06 01:29:58,128][52670] DAMAGECOUNT value on done: 195352.0 [2024-08-06 01:29:58,130][52670] Sum rewards: 60.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.332', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '49.000'} [2024-08-06 01:29:58,389][52649] DAMAGECOUNT value on done: 200245.0 [2024-08-06 01:29:58,392][52649] Sum rewards: 63.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.124', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '53.000'} [2024-08-06 01:29:58,397][52659] DAMAGECOUNT value on done: 205268.0 [2024-08-06 01:29:58,397][52659] Sum rewards: 63.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.199', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.266', 'weapon4': '0.434', 'weapon2': '0.608', 'WEAPON3': '1.550', 'weapon3': '2.780', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '55.000'} [2024-08-06 01:29:58,871][52650] Updated weights for policy 0, policy_version 30831 (0.0012) [2024-08-06 01:29:59,565][52664] DAMAGECOUNT value on done: 211204.0 [2024-08-06 01:29:59,567][52664] Sum rewards: 49.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.180', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.870', 'WEAPON3': '1.300', 'weapon3': '2.596', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '42.000'} [2024-08-06 01:29:59,788][52666] DAMAGECOUNT value on done: 201556.0 [2024-08-06 01:29:59,789][52666] Sum rewards: 47.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.020', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon5': '0.206', 'AMMO3': '0.220', 'weapon4': '0.256', 'AMMO4': '0.267', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.604', 'WEAPON3': '1.200', 'HITCOUNT': '2.430', 'weapon3': '2.578', 'DAMAGECOUNT': '11.997', 'FRAGCOUNT': '43.000'} [2024-08-06 01:29:59,963][52671] DAMAGECOUNT value on done: 207260.0 [2024-08-06 01:29:59,965][52671] Sum rewards: 67.051, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon4': '0.064', 'AMMO3': '0.184', 'weapon2': '0.470', 'HEALTH': '0.510', 'WEAPON3': '1.000', 'HITCOUNT': '3.110', 'weapon3': '3.334', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:00,376][52795] DAMAGECOUNT value on done: 183482.0 [2024-08-06 01:30:00,377][52795] Sum rewards: 63.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.110', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon5': '0.214', 'weapon2': '0.412', 'WEAPON3': '1.000', 'HITCOUNT': '3.020', 'weapon3': '3.040', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '52.000'} [2024-08-06 01:30:00,649][52803] DAMAGECOUNT value on done: 192537.0 [2024-08-06 01:30:00,649][52803] Sum rewards: 57.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.334', 'AMMO2': '0.028', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.221', 'weapon2': '0.626', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.126', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:00,662][52663] DAMAGECOUNT value on done: 210081.0 [2024-08-06 01:30:00,663][52663] Sum rewards: 50.433, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.940', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon4': '0.410', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '42.000'} [2024-08-06 01:30:01,156][52670] DAMAGECOUNT value on done: 206350.0 [2024-08-06 01:30:01,156][52670] Sum rewards: 69.729, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.174', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.544', 'weapon2': '0.610', 'WEAPON3': '0.850', 'weapon3': '2.620', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:01,200][52659] DAMAGECOUNT value on done: 206646.0 [2024-08-06 01:30:01,200][52659] Sum rewards: 66.083, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.832', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.112', 'AMMO3': '0.243', 'AMMO4': '0.243', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '58.000'} [2024-08-06 01:30:01,581][52649] DAMAGECOUNT value on done: 198431.0 [2024-08-06 01:30:01,582][52649] Sum rewards: 55.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.208', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.180', 'AMMO3': '0.201', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '49.500'} [2024-08-06 01:30:02,069][52664] DAMAGECOUNT value on done: 215746.0 [2024-08-06 01:30:02,072][52664] Sum rewards: 73.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.842', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.133', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '62.000'} [2024-08-06 01:30:02,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 252641280. Throughput: 0: 4398.9. Samples: 63158530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:30:02,794][52567] Avg episode reward: [(0, '61.613')] [2024-08-06 01:30:03,053][52671] DAMAGECOUNT value on done: 200656.0 [2024-08-06 01:30:03,053][52671] Sum rewards: 67.393, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '58.500'} [2024-08-06 01:30:03,203][52650] Updated weights for policy 0, policy_version 30841 (0.0013) [2024-08-06 01:30:03,346][52663] DAMAGECOUNT value on done: 205677.0 [2024-08-06 01:30:03,346][52663] Sum rewards: 60.843, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.008', 'weapon4': '0.024', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.157', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.580', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.198', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:03,632][52795] DAMAGECOUNT value on done: 196624.0 [2024-08-06 01:30:03,634][52795] Sum rewards: 54.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon4': '0.098', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.224', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:03,671][52803] DAMAGECOUNT value on done: 194218.0 [2024-08-06 01:30:03,672][52803] Sum rewards: 45.211, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.320', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.234', 'weapon5': '0.236', 'AMMO4': '0.272', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON4': '0.800', 'weapon4': '0.994', 'WEAPON3': '1.350', 'weapon3': '2.032', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '43.000'} [2024-08-06 01:30:04,107][52670] DAMAGECOUNT value on done: 208865.0 [2024-08-06 01:30:04,108][52670] Sum rewards: 53.518, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.898', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.096', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.612', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '3.012', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '43.000'} [2024-08-06 01:30:04,194][52659] DAMAGECOUNT value on done: 205787.0 [2024-08-06 01:30:04,194][52659] Sum rewards: 57.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.197', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '49.000'} [2024-08-06 01:30:04,679][52664] DAMAGECOUNT value on done: 216922.0 [2024-08-06 01:30:04,680][52664] Sum rewards: 56.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.220', 'WEAPON4': '0.400', 'weapon2': '0.522', 'weapon4': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.504', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:04,759][52649] DAMAGECOUNT value on done: 205302.0 [2024-08-06 01:30:04,760][52649] Sum rewards: 62.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.394', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.394', 'weapon2': '0.652', 'WEAPON3': '0.900', 'weapon3': '2.608', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:05,790][52671] DAMAGECOUNT value on done: 210338.0 [2024-08-06 01:30:05,791][52671] Sum rewards: 65.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.176', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'weapon5': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.228', 'weapon4': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.722', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:06,563][52663] DAMAGECOUNT value on done: 206515.0 [2024-08-06 01:30:06,564][52663] Sum rewards: 67.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.146', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.638', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '53.000'} [2024-08-06 01:30:06,752][52795] DAMAGECOUNT value on done: 195979.0 [2024-08-06 01:30:06,752][52795] Sum rewards: 64.639, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon4': '0.216', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '56.000'} [2024-08-06 01:30:06,812][52670] DAMAGECOUNT value on done: 204540.0 [2024-08-06 01:30:06,813][52670] Sum rewards: 67.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'AMMO3': '0.294', 'weapon4': '0.310', 'weapon2': '0.320', 'WEAPON3': '1.750', 'weapon3': '3.134', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '59.000'} [2024-08-06 01:30:06,841][52659] DAMAGECOUNT value on done: 205746.0 [2024-08-06 01:30:06,841][52659] Sum rewards: 57.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.434', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO4': '0.161', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon2': '0.964', 'WEAPON3': '1.050', 'weapon3': '2.658', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '47.000'} [2024-08-06 01:30:06,869][52803] DAMAGECOUNT value on done: 190811.0 [2024-08-06 01:30:06,869][52803] Sum rewards: 48.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.936', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO4': '0.013', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.197', 'weapon2': '0.744', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '40.000'} [2024-08-06 01:30:07,429][52664] DAMAGECOUNT value on done: 213059.0 [2024-08-06 01:30:07,430][52664] Sum rewards: 61.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.506', 'WEAPON3': '0.950', 'weapon3': '3.056', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:07,616][52649] DAMAGECOUNT value on done: 199983.0 [2024-08-06 01:30:07,617][52649] Sum rewards: 61.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.354', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.684', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '51.500'} [2024-08-06 01:30:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 252723200. Throughput: 0: 4395.6. Samples: 63184900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:07,794][52567] Avg episode reward: [(0, '61.311')] [2024-08-06 01:30:07,968][52811] DAMAGECOUNT value on done: 202111.0 [2024-08-06 01:30:07,969][52811] Sum rewards: 54.509, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.366', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon4': '0.246', 'AMMO3': '0.249', 'WEAPON4': '0.450', 'weapon2': '0.598', 'WEAPON3': '1.500', 'weapon3': '2.818', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '49.000'} [2024-08-06 01:30:08,306][52650] Updated weights for policy 0, policy_version 30851 (0.0055) [2024-08-06 01:30:08,755][52671] DAMAGECOUNT value on done: 208735.0 [2024-08-06 01:30:08,756][52671] Sum rewards: 48.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon2': '0.186', 'AMMO3': '0.196', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.146', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '42.500'} [2024-08-06 01:30:09,442][52663] DAMAGECOUNT value on done: 204455.0 [2024-08-06 01:30:09,443][52663] Sum rewards: 60.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.041', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:09,724][52670] DAMAGECOUNT value on done: 205625.0 [2024-08-06 01:30:09,725][52670] Sum rewards: 70.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.363', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'weapon4': '0.114', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '59.000'} [2024-08-06 01:30:09,734][52659] DAMAGECOUNT value on done: 203739.0 [2024-08-06 01:30:09,735][52659] Sum rewards: 50.930, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.174', 'AMMO4': '0.217', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.600', 'HITCOUNT': '2.930', 'weapon3': '2.946', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '46.000'} [2024-08-06 01:30:09,965][52803] DAMAGECOUNT value on done: 192712.0 [2024-08-06 01:30:09,966][52803] Sum rewards: 49.175, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.996', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.236', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.094', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '48.500'} [2024-08-06 01:30:10,234][52664] DAMAGECOUNT value on done: 214988.0 [2024-08-06 01:30:10,235][52664] Sum rewards: 71.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.045', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.184', 'AMMO3': '0.186', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '58.000'} [2024-08-06 01:30:10,784][52649] DAMAGECOUNT value on done: 201613.0 [2024-08-06 01:30:10,784][52649] Sum rewards: 57.330, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.533', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.156', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '3.248', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '46.000'} [2024-08-06 01:30:11,088][52811] DAMAGECOUNT value on done: 188609.0 [2024-08-06 01:30:11,088][52811] Sum rewards: 76.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '64.000'} [2024-08-06 01:30:11,419][52671] DAMAGECOUNT value on done: 210225.0 [2024-08-06 01:30:11,420][52671] Sum rewards: 67.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'AMMO5': '0.012', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.162', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:11,907][52663] DAMAGECOUNT value on done: 207312.0 [2024-08-06 01:30:11,917][52663] Sum rewards: 46.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.064', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.954', 'WEAPON3': '1.050', 'weapon3': '2.406', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '11.814', 'FRAGCOUNT': '39.000'} [2024-08-06 01:30:12,429][52650] Updated weights for policy 0, policy_version 30861 (0.0018) [2024-08-06 01:30:12,553][52659] DAMAGECOUNT value on done: 205053.0 [2024-08-06 01:30:12,553][52659] Sum rewards: 75.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.672', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.247', 'weapon4': '0.256', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.280', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '63.000'} [2024-08-06 01:30:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 252813312. Throughput: 0: 4400.7. Samples: 63211330. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:12,795][52567] Avg episode reward: [(0, '60.884')] [2024-08-06 01:30:13,226][52803] DAMAGECOUNT value on done: 195937.0 [2024-08-06 01:30:13,228][52803] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.102', 'AMMO4': '0.167', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '59.000'} [2024-08-06 01:30:13,723][52649] DAMAGECOUNT value on done: 202740.0 [2024-08-06 01:30:13,724][52649] Sum rewards: 47.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.796', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.184', 'weapon5': '0.234', 'AMMO4': '0.235', 'weapon2': '0.320', 'WEAPON5': '0.450', 'weapon4': '0.536', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.604', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '42.000'} [2024-08-06 01:30:13,981][52665] DAMAGECOUNT value on done: 203969.0 [2024-08-06 01:30:13,982][52665] Sum rewards: 60.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.181', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:14,218][52811] DAMAGECOUNT value on done: 194043.0 [2024-08-06 01:30:14,218][52811] Sum rewards: 57.370, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.100', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.476', 'weapon2': '0.668', 'WEAPON3': '1.050', 'weapon3': '2.526', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '47.000'} [2024-08-06 01:30:14,335][52671] DAMAGECOUNT value on done: 208955.0 [2024-08-06 01:30:14,337][52671] Sum rewards: 52.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.958', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO4': '0.174', 'weapon5': '0.182', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '3.156', 'DAMAGECOUNT': '12.408', 'FRAGCOUNT': '45.000'} [2024-08-06 01:30:14,396][52820] DAMAGECOUNT value on done: 188770.0 [2024-08-06 01:30:14,398][52820] Sum rewards: 67.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.365', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.148', 'weapon2': '0.412', 'WEAPON3': '1.050', 'HITCOUNT': '3.340', 'weapon3': '3.382', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '52.000'} [2024-08-06 01:30:14,459][52663] DAMAGECOUNT value on done: 208151.0 [2024-08-06 01:30:14,459][52663] Sum rewards: 70.064, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.144', 'weapon4': '0.316', 'weapon2': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.828', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:15,582][52659] DAMAGECOUNT value on done: 201532.0 [2024-08-06 01:30:15,587][52659] Sum rewards: 60.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.162', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:16,303][52649] DAMAGECOUNT value on done: 198735.0 [2024-08-06 01:30:16,304][52649] Sum rewards: 55.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.467', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO3': '0.176', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.422', 'weapon2': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.570', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:16,304][52803] DAMAGECOUNT value on done: 194497.0 [2024-08-06 01:30:16,304][52803] Sum rewards: 59.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.158', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.206', 'AMMO3': '0.213', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO4': '0.254', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.786', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:16,380][52665] DAMAGECOUNT value on done: 207780.0 [2024-08-06 01:30:16,380][52665] Sum rewards: 61.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon4': '0.478', 'weapon2': '0.560', 'WEAPON3': '1.500', 'weapon3': '2.690', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:16,986][52663] DAMAGECOUNT value on done: 206665.0 [2024-08-06 01:30:16,994][52663] Sum rewards: 74.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '62.000'} [2024-08-06 01:30:17,251][52811] DAMAGECOUNT value on done: 193566.0 [2024-08-06 01:30:17,252][52811] Sum rewards: 57.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.093', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.516', 'weapon4': '0.728', 'WEAPON3': '0.950', 'weapon3': '2.428', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:17,383][52650] Updated weights for policy 0, policy_version 30871 (0.0011) [2024-08-06 01:30:17,497][52671] DAMAGECOUNT value on done: 206053.0 [2024-08-06 01:30:17,497][52671] Sum rewards: 59.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.056', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.422', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.168', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:17,585][52820] DAMAGECOUNT value on done: 190726.0 [2024-08-06 01:30:17,585][52820] Sum rewards: 47.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.438', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.040', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '40.000'} [2024-08-06 01:30:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 252903424. Throughput: 0: 4393.6. Samples: 63224420. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:17,794][52567] Avg episode reward: [(0, '60.677')] [2024-08-06 01:30:18,276][52664] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.405, 135.0), ('HEALTH', -0.045, -15.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 01:30:18,725][52659] DAMAGECOUNT value on done: 210256.0 [2024-08-06 01:30:18,726][52659] Sum rewards: 69.750, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.465', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '57.000'} [2024-08-06 01:30:18,808][52649] DAMAGECOUNT value on done: 203254.0 [2024-08-06 01:30:18,809][52649] Sum rewards: 53.684, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.618', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.170', 'AMMO3': '0.211', 'weapon4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.984', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:18,932][52665] DAMAGECOUNT value on done: 204004.0 [2024-08-06 01:30:18,934][52665] Sum rewards: 59.038, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.881', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.242', 'weapon2': '0.684', 'WEAPON3': '1.400', 'weapon3': '2.896', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '53.000'} [2024-08-06 01:30:19,460][52803] DAMAGECOUNT value on done: 193917.0 [2024-08-06 01:30:19,460][52803] Sum rewards: 67.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.099', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '58.000'} [2024-08-06 01:30:19,529][52663] DAMAGECOUNT value on done: 199926.0 [2024-08-06 01:30:19,529][52663] Sum rewards: 62.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.745', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon4': '0.202', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:20,297][52811] DAMAGECOUNT value on done: 193192.0 [2024-08-06 01:30:20,298][52811] Sum rewards: 62.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.328', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:20,772][52820] DAMAGECOUNT value on done: 188830.0 [2024-08-06 01:30:20,773][52820] Sum rewards: 60.019, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.135', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.128', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon4': '0.386', 'weapon2': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:21,662][52659] DAMAGECOUNT value on done: 211649.0 [2024-08-06 01:30:21,663][52659] Sum rewards: 57.099, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.190', 'weapon2': '0.210', 'AMMO3': '0.240', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.004', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '49.000'} [2024-08-06 01:30:21,811][52650] Updated weights for policy 0, policy_version 30881 (0.0011) [2024-08-06 01:30:22,023][52663] DAMAGECOUNT value on done: 198574.0 [2024-08-06 01:30:22,031][52663] Sum rewards: 63.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.116', 'weapon4': '0.136', 'AMMO4': '0.187', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:22,123][52649] DAMAGECOUNT value on done: 203314.0 [2024-08-06 01:30:22,124][52649] Sum rewards: 66.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.035', 'AMMO5': '0.007', 'weapon5': '0.008', 'ARMOR': '0.028', 'AMMO2': '0.032', 'weapon4': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.466', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '55.500'} [2024-08-06 01:30:22,266][52665] DAMAGECOUNT value on done: 200660.0 [2024-08-06 01:30:22,266][52665] Sum rewards: 66.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.727', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.170', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '57.000'} [2024-08-06 01:30:22,523][52803] DAMAGECOUNT value on done: 189062.0 [2024-08-06 01:30:22,524][52803] Sum rewards: 65.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.150', 'AMMO3': '0.188', 'weapon5': '0.228', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.224', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 252985344. Throughput: 0: 4395.3. Samples: 63250910. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:22,794][52567] Avg episode reward: [(0, '60.878')] [2024-08-06 01:30:23,334][52811] DAMAGECOUNT value on done: 197691.0 [2024-08-06 01:30:23,338][52811] Sum rewards: 61.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.154', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '53.000'} [2024-08-06 01:30:23,860][52820] DAMAGECOUNT value on done: 182860.0 [2024-08-06 01:30:23,860][52820] Sum rewards: 60.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.346', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.191', 'AMMO4': '0.213', 'weapon2': '0.296', 'weapon5': '0.314', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.696', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:24,578][52659] DAMAGECOUNT value on done: 205326.0 [2024-08-06 01:30:24,578][52659] Sum rewards: 61.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.432', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:24,639][52649] DAMAGECOUNT value on done: 195360.0 [2024-08-06 01:30:24,639][52649] Sum rewards: 57.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.006', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.920', 'WEAPON3': '1.100', 'weapon3': '2.556', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:24,765][52665] DAMAGECOUNT value on done: 200174.0 [2024-08-06 01:30:24,766][52665] Sum rewards: 55.299, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.234', 'weapon2': '0.380', 'weapon4': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:24,829][52663] DAMAGECOUNT value on done: 206263.0 [2024-08-06 01:30:24,831][52663] Sum rewards: 54.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.068', 'AMMO4': '0.164', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '46.000'} [2024-08-06 01:30:25,646][52803] DAMAGECOUNT value on done: 192791.0 [2024-08-06 01:30:25,646][52803] Sum rewards: 50.664, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.995', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.170', 'AMMO3': '0.204', 'weapon4': '0.230', 'AMMO4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '44.000'} [2024-08-06 01:30:26,481][52811] DAMAGECOUNT value on done: 195241.0 [2024-08-06 01:30:26,483][52811] Sum rewards: 58.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.623', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO4': '0.181', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.468', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:26,673][52650] Updated weights for policy 0, policy_version 30891 (0.0019) [2024-08-06 01:30:27,007][52820] DAMAGECOUNT value on done: 191999.0 [2024-08-06 01:30:27,008][52820] Sum rewards: 63.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.850', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon2': '0.188', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.602', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:27,136][52659] DAMAGECOUNT value on done: 203814.0 [2024-08-06 01:30:27,144][52659] Sum rewards: 68.177, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.080', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '59.000'} [2024-08-06 01:30:27,535][52665] DAMAGECOUNT value on done: 201164.0 [2024-08-06 01:30:27,535][52665] Sum rewards: 53.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.244', 'AMMO5': '0.016', 'ARMOR': '0.028', 'AMMO2': '0.039', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.194', 'weapon5': '0.196', 'AMMO3': '0.207', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.986', 'WEAPON3': '1.200', 'weapon3': '2.186', 'HITCOUNT': '2.420', 'DAMAGECOUNT': '13.203', 'FRAGCOUNT': '45.500'} [2024-08-06 01:30:27,570][52649] DAMAGECOUNT value on done: 200624.0 [2024-08-06 01:30:27,570][52649] Sum rewards: 53.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.465', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.152', 'AMMO3': '0.183', 'AMMO4': '0.201', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.758', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '46.000'} [2024-08-06 01:30:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 253075456. Throughput: 0: 4396.0. Samples: 63277390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:27,794][52567] Avg episode reward: [(0, '60.506')] [2024-08-06 01:30:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030893_253075456.pth... [2024-08-06 01:30:27,963][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030379_248864768.pth [2024-08-06 01:30:28,132][52663] DAMAGECOUNT value on done: 207423.0 [2024-08-06 01:30:28,132][52663] Sum rewards: 47.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.686', 'AMMO5': '0.003', 'ARMOR': '0.004', 'weapon5': '0.032', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.209', 'weapon4': '0.310', 'weapon2': '0.744', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '42.000'} [2024-08-06 01:30:28,685][52803] DAMAGECOUNT value on done: 189898.0 [2024-08-06 01:30:28,686][52803] Sum rewards: 70.553, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.766', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.277', 'weapon2': '0.352', 'weapon4': '0.582', 'WEAPON3': '1.600', 'weapon3': '2.762', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 01:30:29,670][52659] DAMAGECOUNT value on done: 200603.0 [2024-08-06 01:30:29,670][52659] Sum rewards: 67.222, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.050', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '56.000'} [2024-08-06 01:30:29,691][52811] DAMAGECOUNT value on done: 192521.0 [2024-08-06 01:30:29,692][52811] Sum rewards: 65.700, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.123', 'weapon5': '0.168', 'AMMO4': '0.184', 'HEALTH': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.656', 'WEAPON3': '0.700', 'weapon3': '2.610', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '50.500'} [2024-08-06 01:30:30,242][52820] DAMAGECOUNT value on done: 188406.0 [2024-08-06 01:30:30,242][52820] Sum rewards: 67.812, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.104', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.057', 'weapon5': '0.160', 'AMMO3': '0.227', 'weapon2': '0.240', 'AMMO4': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '58.000'} [2024-08-06 01:30:30,662][52649] DAMAGECOUNT value on done: 200977.0 [2024-08-06 01:30:30,663][52665] DAMAGECOUNT value on done: 205565.0 [2024-08-06 01:30:30,665][52649] Sum rewards: 61.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.199', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'weapon2': '0.440', 'weapon4': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:30,667][52665] Sum rewards: 61.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.943', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.104', 'AMMO4': '0.123', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '3.140', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '50.500'} [2024-08-06 01:30:31,015][52663] DAMAGECOUNT value on done: 207692.0 [2024-08-06 01:30:31,017][52663] Sum rewards: 59.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.312', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.526', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.490', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:31,281][52650] Updated weights for policy 0, policy_version 30901 (0.0041) [2024-08-06 01:30:31,781][52803] DAMAGECOUNT value on done: 198314.0 [2024-08-06 01:30:31,783][52803] Sum rewards: 53.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.090', 'AMMO5': '0.010', 'AMMO2': '0.032', 'ARMOR': '0.036', 'weapon5': '0.096', 'AMMO4': '0.160', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '46.000'} [2024-08-06 01:30:32,515][52659] DAMAGECOUNT value on done: 206039.0 [2024-08-06 01:30:32,518][52659] Sum rewards: 56.521, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.272', 'AMMO3': '0.293', 'weapon2': '0.416', 'WEAPON3': '1.750', 'HITCOUNT': '3.050', 'weapon3': '3.098', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '52.000'} [2024-08-06 01:30:32,772][52811] DAMAGECOUNT value on done: 199403.0 [2024-08-06 01:30:32,774][52811] Sum rewards: 60.530, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '2.976', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 253165568. Throughput: 0: 4394.9. Samples: 63290420. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:32,795][52567] Avg episode reward: [(0, '60.708')] [2024-08-06 01:30:33,247][52663] DAMAGECOUNT value on done: 210525.0 [2024-08-06 01:30:33,247][52663] Sum rewards: 57.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.727', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.176', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:33,425][52820] DAMAGECOUNT value on done: 190434.0 [2024-08-06 01:30:33,426][52820] Sum rewards: 53.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.278', 'weapon4': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '45.000'} [2024-08-06 01:30:33,580][52665] DAMAGECOUNT value on done: 204854.0 [2024-08-06 01:30:33,583][52665] Sum rewards: 54.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.169', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.024', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:33,606][52649] DAMAGECOUNT value on done: 206834.0 [2024-08-06 01:30:33,606][52649] Sum rewards: 64.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.094', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.252', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:34,852][52803] DAMAGECOUNT value on done: 197205.0 [2024-08-06 01:30:34,853][52803] Sum rewards: 51.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.058', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.272', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '44.000'} [2024-08-06 01:30:35,576][52659] DAMAGECOUNT value on done: 209606.0 [2024-08-06 01:30:35,579][52659] Sum rewards: 54.411, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.131', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '2.830', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:35,756][52650] Updated weights for policy 0, policy_version 30911 (0.0056) [2024-08-06 01:30:35,998][52649] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:30:36,103][52811] DAMAGECOUNT value on done: 194885.0 [2024-08-06 01:30:36,103][52811] Sum rewards: 60.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.807', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.264', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '53.000'} [2024-08-06 01:30:36,433][52820] DAMAGECOUNT value on done: 195609.0 [2024-08-06 01:30:36,434][52820] Sum rewards: 70.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.224', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '58.000'} [2024-08-06 01:30:36,457][52663] DAMAGECOUNT value on done: 209234.0 [2024-08-06 01:30:36,460][52663] Sum rewards: 68.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.915', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '59.000'} [2024-08-06 01:30:36,620][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:30:36,806][52665] DAMAGECOUNT value on done: 209406.0 [2024-08-06 01:30:36,806][52665] Sum rewards: 63.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.819', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'AMMO3': '0.201', 'weapon4': '0.242', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '53.000'} [2024-08-06 01:30:36,852][52649] DAMAGECOUNT value on done: 205977.0 [2024-08-06 01:30:36,852][52649] Sum rewards: 60.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.008', 'weapon5': '0.018', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon7': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.470', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.248', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 253247488. Throughput: 0: 4391.2. Samples: 63316840. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:37,794][52567] Avg episode reward: [(0, '60.357')] [2024-08-06 01:30:37,940][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:30:38,035][52803] DAMAGECOUNT value on done: 193974.0 [2024-08-06 01:30:38,037][52803] Sum rewards: 64.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.825', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.170', 'AMMO3': '0.202', 'AMMO4': '0.217', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:38,182][52614] Signal inference workers to stop experience collection... (5650 times) [2024-08-06 01:30:38,183][52614] Signal inference workers to resume experience collection... (5650 times) [2024-08-06 01:30:38,228][52650] InferenceWorker_p0-w0: stopping experience collection (5650 times) [2024-08-06 01:30:38,228][52650] InferenceWorker_p0-w0: resuming experience collection (5650 times) [2024-08-06 01:30:38,398][52659] DAMAGECOUNT value on done: 211378.0 [2024-08-06 01:30:38,406][52659] Sum rewards: 71.733, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.230', 'WEAPON4': '0.250', 'HEALTH': '0.424', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '58.000'} [2024-08-06 01:30:39,090][52811] DAMAGECOUNT value on done: 192037.0 [2024-08-06 01:30:39,090][52811] Sum rewards: 42.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.852', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.046', 'weapon7': '0.064', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.472', 'weapon4': '0.828', 'WEAPON3': '1.350', 'weapon3': '2.438', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '36.000'} [2024-08-06 01:30:39,332][52663] DAMAGECOUNT value on done: 205438.0 [2024-08-06 01:30:39,333][52663] Sum rewards: 63.206, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.787', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.176', 'AMMO4': '0.194', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '52.500'} [2024-08-06 01:30:39,583][52665] DAMAGECOUNT value on done: 206399.0 [2024-08-06 01:30:39,585][52665] Sum rewards: 60.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.234', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.144', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.412', 'weapon2': '0.624', 'WEAPON3': '0.950', 'weapon3': '2.518', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '48.000'} [2024-08-06 01:30:39,609][52649] DAMAGECOUNT value on done: 210717.0 [2024-08-06 01:30:39,611][52649] Sum rewards: 63.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.104', 'AMMO4': '0.208', 'AMMO3': '0.209', 'weapon5': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.076', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:39,627][52820] DAMAGECOUNT value on done: 191016.0 [2024-08-06 01:30:39,627][52820] Sum rewards: 59.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.336', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.058', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.788', 'WEAPON3': '1.050', 'weapon3': '2.890', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:40,746][52650] Updated weights for policy 0, policy_version 30921 (0.0012) [2024-08-06 01:30:40,947][52803] DAMAGECOUNT value on done: 196165.0 [2024-08-06 01:30:40,949][52803] Sum rewards: 61.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.612', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.158', 'weapon4': '0.186', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '2.994', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '53.000'} [2024-08-06 01:30:41,199][52659] DAMAGECOUNT value on done: 211444.0 [2024-08-06 01:30:41,201][52659] Sum rewards: 65.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.186', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:42,102][52811] DAMAGECOUNT value on done: 195271.0 [2024-08-06 01:30:42,103][52811] Sum rewards: 74.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.432', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '60.000'} [2024-08-06 01:30:42,427][52665] DAMAGECOUNT value on done: 211123.0 [2024-08-06 01:30:42,428][52665] Sum rewards: 62.986, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.099', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.104', 'AMMO4': '0.148', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.300', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '52.500'} [2024-08-06 01:30:42,696][52820] DAMAGECOUNT value on done: 194023.0 [2024-08-06 01:30:42,696][52820] Sum rewards: 58.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.148', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '51.500'} [2024-08-06 01:30:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 253337600. Throughput: 0: 4397.8. Samples: 63343350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 01:30:42,794][52567] Avg episode reward: [(0, '60.517')] [2024-08-06 01:30:43,765][52659] DAMAGECOUNT value on done: 206318.0 [2024-08-06 01:30:43,773][52659] Sum rewards: 67.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.849', 'weapon4': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:43,926][52803] DAMAGECOUNT value on done: 193938.0 [2024-08-06 01:30:43,928][52803] Sum rewards: 65.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.145', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'weapon2': '0.796', 'WEAPON3': '0.950', 'weapon3': '2.830', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '54.000'} [2024-08-06 01:30:44,995][52650] Updated weights for policy 0, policy_version 30931 (0.0019) [2024-08-06 01:30:45,188][52811] DAMAGECOUNT value on done: 192482.0 [2024-08-06 01:30:45,188][52811] Sum rewards: 50.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.104', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.566', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.112', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '43.000'} [2024-08-06 01:30:45,602][52665] DAMAGECOUNT value on done: 208477.0 [2024-08-06 01:30:45,604][52665] Sum rewards: 59.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.146', 'weapon4': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.240', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:45,835][52820] DAMAGECOUNT value on done: 193072.0 [2024-08-06 01:30:45,835][52820] Sum rewards: 61.847, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.100', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.260', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.700', 'weapon3': '2.874', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:46,836][52659] DAMAGECOUNT value on done: 211922.0 [2024-08-06 01:30:46,836][52659] Sum rewards: 69.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.998', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.096', 'AMMO4': '0.130', 'weapon5': '0.136', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '58.000'} [2024-08-06 01:30:46,950][52803] DAMAGECOUNT value on done: 190928.0 [2024-08-06 01:30:46,951][52803] Sum rewards: 50.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.141', 'weapon4': '0.170', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '42.500'} [2024-08-06 01:30:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 253427712. Throughput: 0: 4397.5. Samples: 63356420. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:30:47,794][52567] Avg episode reward: [(0, '60.855')] [2024-08-06 01:30:48,317][52811] DAMAGECOUNT value on done: 196677.0 [2024-08-06 01:30:48,321][52811] Sum rewards: 60.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.132', 'AMMO3': '0.176', 'AMMO4': '0.208', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:48,564][52665] DAMAGECOUNT value on done: 205255.0 [2024-08-06 01:30:48,565][52665] Sum rewards: 60.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.172', 'weapon5': '0.224', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.550', 'weapon4': '0.762', 'WEAPON3': '1.000', 'weapon3': '2.208', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:48,942][52820] DAMAGECOUNT value on done: 194649.0 [2024-08-06 01:30:48,950][52820] Sum rewards: 52.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.828', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.406', 'weapon2': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '2.858', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '47.000'} [2024-08-06 01:30:49,865][52659] DAMAGECOUNT value on done: 210527.0 [2024-08-06 01:30:49,866][52659] Sum rewards: 68.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.362', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '57.000'} [2024-08-06 01:30:50,092][52650] Updated weights for policy 0, policy_version 30941 (0.0013) [2024-08-06 01:30:50,104][52803] DAMAGECOUNT value on done: 198674.0 [2024-08-06 01:30:50,104][52803] Sum rewards: 54.049, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.128', 'AMMO5': '0.026', 'AMMO2': '0.066', 'AMMO3': '0.217', 'AMMO4': '0.328', 'weapon5': '0.336', 'weapon2': '0.372', 'weapon4': '0.444', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.444', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '48.500'} [2024-08-06 01:30:51,499][52665] DAMAGECOUNT value on done: 205022.0 [2024-08-06 01:30:51,499][52665] Sum rewards: 72.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.934', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 01:30:51,510][52811] DAMAGECOUNT value on done: 194154.0 [2024-08-06 01:30:51,511][52811] Sum rewards: 49.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.245', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.100', 'AMMO4': '0.125', 'weapon5': '0.148', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.900', 'DAMAGECOUNT': '12.690', 'FRAGCOUNT': '41.000'} [2024-08-06 01:30:52,058][52820] DAMAGECOUNT value on done: 191061.0 [2024-08-06 01:30:52,060][52820] Sum rewards: 63.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.092', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '51.000'} [2024-08-06 01:30:52,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 253509632. Throughput: 0: 4394.4. Samples: 63382650. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:30:52,795][52567] Avg episode reward: [(0, '60.724')] [2024-08-06 01:30:53,115][52803] DAMAGECOUNT value on done: 191978.0 [2024-08-06 01:30:53,116][52803] Sum rewards: 67.386, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.276', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.262', 'weapon4': '0.288', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '55.000'} [2024-08-06 01:30:54,632][52811] DAMAGECOUNT value on done: 193192.0 [2024-08-06 01:30:54,633][52811] Sum rewards: 50.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.053', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.172', 'AMMO4': '0.264', 'weapon2': '0.320', 'WEAPON4': '0.550', 'weapon4': '0.580', 'WEAPON3': '1.000', 'HITCOUNT': '2.580', 'weapon3': '2.772', 'DAMAGECOUNT': '11.535', 'FRAGCOUNT': '42.000'} [2024-08-06 01:30:54,640][52650] Updated weights for policy 0, policy_version 30951 (0.0037) [2024-08-06 01:30:54,674][52665] DAMAGECOUNT value on done: 205233.0 [2024-08-06 01:30:54,675][52665] Sum rewards: 70.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.446', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.050', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.230', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.246', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '61.000'} [2024-08-06 01:30:55,294][52820] DAMAGECOUNT value on done: 194061.0 [2024-08-06 01:30:55,297][52820] Sum rewards: 57.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.196', 'AMMO4': '0.201', 'AMMO3': '0.228', 'weapon5': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '2.890', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:56,196][52803] DAMAGECOUNT value on done: 197739.0 [2024-08-06 01:30:56,198][52803] Sum rewards: 58.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.134', 'AMMO3': '0.224', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '2.980', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '50.000'} [2024-08-06 01:30:57,505][52811] DAMAGECOUNT value on done: 193664.0 [2024-08-06 01:30:57,507][52811] Sum rewards: 72.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.046', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.384', 'ARMOR': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2024-08-06 01:30:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 253607936. Throughput: 0: 4394.2. Samples: 63409070. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:30:57,794][52567] Avg episode reward: [(0, '61.152')] [2024-08-06 01:30:57,812][52665] DAMAGECOUNT value on done: 203878.0 [2024-08-06 01:30:57,814][52665] Sum rewards: 79.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.888', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.222', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '64.000'} [2024-08-06 01:30:57,836][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:30:58,371][52820] DAMAGECOUNT value on done: 194372.0 [2024-08-06 01:30:58,372][52820] Sum rewards: 59.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.096', 'AMMO4': '0.184', 'AMMO3': '0.206', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '50.500'} [2024-08-06 01:30:59,255][52803] DAMAGECOUNT value on done: 188158.0 [2024-08-06 01:30:59,255][52803] Sum rewards: 47.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.110', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.248', 'AMMO4': '0.259', 'WEAPON4': '0.500', 'weapon4': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '40.000'} [2024-08-06 01:30:59,529][52650] Updated weights for policy 0, policy_version 30961 (0.0019) [2024-08-06 01:31:00,587][52665] DAMAGECOUNT value on done: 203234.0 [2024-08-06 01:31:00,588][52665] Sum rewards: 61.795, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'WEAPON4': '0.400', 'weapon2': '0.602', 'weapon4': '0.720', 'WEAPON3': '1.050', 'weapon3': '2.474', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '51.000'} [2024-08-06 01:31:00,650][52811] DAMAGECOUNT value on done: 197946.0 [2024-08-06 01:31:00,651][52811] Sum rewards: 71.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 01:31:01,633][52820] DAMAGECOUNT value on done: 193900.0 [2024-08-06 01:31:01,634][52820] Sum rewards: 65.932, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO4': '0.163', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.890', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '59.000'} [2024-08-06 01:31:02,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 253689856. Throughput: 0: 4390.0. Samples: 63421970. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:31:02,794][52567] Avg episode reward: [(0, '61.064')] [2024-08-06 01:31:03,068][52665] DAMAGECOUNT value on done: 201169.0 [2024-08-06 01:31:03,068][52665] Sum rewards: 70.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.160', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '58.000'} [2024-08-06 01:31:03,721][52811] DAMAGECOUNT value on done: 193708.0 [2024-08-06 01:31:03,723][52811] Sum rewards: 61.476, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.685', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.178', 'weapon2': '0.356', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.190', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '50.000'} [2024-08-06 01:31:03,879][52650] Updated weights for policy 0, policy_version 30971 (0.0023) [2024-08-06 01:31:04,736][52820] DAMAGECOUNT value on done: 189564.0 [2024-08-06 01:31:04,739][52820] Sum rewards: 54.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.545', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO4': '0.213', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.638', 'WEAPON3': '1.500', 'weapon3': '2.582', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '48.000'} [2024-08-06 01:31:06,293][52668] DAMAGECOUNT value on done: 205487.0 [2024-08-06 01:31:06,293][52668] Sum rewards: 66.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.272', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon4': '0.132', 'AMMO4': '0.151', 'weapon5': '0.162', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '54.000'} [2024-08-06 01:31:06,454][52665] DAMAGECOUNT value on done: 207492.0 [2024-08-06 01:31:06,454][52665] Sum rewards: 70.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.155', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.428', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.000'} [2024-08-06 01:31:06,806][52811] DAMAGECOUNT value on done: 198298.0 [2024-08-06 01:31:06,807][52811] Sum rewards: 75.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.800', 'AMMO5': '0.007', 'AMMO2': '0.062', 'weapon5': '0.124', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.290', 'AMMO4': '0.309', 'weapon4': '0.642', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.594', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '65.000'} [2024-08-06 01:31:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 253779968. Throughput: 0: 4387.8. Samples: 63448360. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:31:07,794][52567] Avg episode reward: [(0, '61.486')] [2024-08-06 01:31:07,812][52820] DAMAGECOUNT value on done: 197581.0 [2024-08-06 01:31:07,814][52820] Sum rewards: 56.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon4': '0.096', 'weapon5': '0.118', 'AMMO3': '0.203', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.246', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '49.500'} [2024-08-06 01:31:07,927][52663] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:31:08,342][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:31:08,604][52650] Updated weights for policy 0, policy_version 30981 (0.0025) [2024-08-06 01:31:09,341][52665] DAMAGECOUNT value on done: 204131.0 [2024-08-06 01:31:09,344][52665] Sum rewards: 63.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.665', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.166', 'weapon5': '0.212', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.816', 'WEAPON3': '1.000', 'weapon3': '2.332', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '53.000'} [2024-08-06 01:31:09,519][52668] DAMAGECOUNT value on done: 213678.0 [2024-08-06 01:31:09,519][52668] Sum rewards: 71.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.175', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'AMMO4': '0.155', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.544', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.504', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '60.000'} [2024-08-06 01:31:10,809][52820] DAMAGECOUNT value on done: 199801.0 [2024-08-06 01:31:10,809][52820] Sum rewards: 60.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.096', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.966', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '51.000'} [2024-08-06 01:31:12,568][52668] DAMAGECOUNT value on done: 210183.0 [2024-08-06 01:31:12,570][52668] Sum rewards: 65.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.098', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 01:31:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 253861888. Throughput: 0: 4389.3. Samples: 63474910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:31:12,794][52567] Avg episode reward: [(0, '61.583')] [2024-08-06 01:31:13,144][52667] DAMAGECOUNT value on done: 209796.0 [2024-08-06 01:31:13,145][52667] Sum rewards: 60.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.176', 'AMMO3': '0.208', 'AMMO4': '0.258', 'weapon2': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.502', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.700', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '51.000'} [2024-08-06 01:31:13,183][52650] Updated weights for policy 0, policy_version 30991 (0.0027) [2024-08-06 01:31:13,982][52820] DAMAGECOUNT value on done: 190360.0 [2024-08-06 01:31:13,985][52820] Sum rewards: 57.598, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.807', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.610', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '50.000'} [2024-08-06 01:31:15,318][52668] DAMAGECOUNT value on done: 211649.0 [2024-08-06 01:31:15,321][52668] Sum rewards: 52.627, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.800', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.243', 'weapon2': '0.446', 'WEAPON4': '0.450', 'weapon4': '0.562', 'WEAPON3': '1.500', 'weapon3': '2.762', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '48.000'} [2024-08-06 01:31:15,517][52662] DAMAGECOUNT value on done: 213083.0 [2024-08-06 01:31:15,517][52662] Sum rewards: 58.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO5': '0.005', 'AMMO2': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.037', 'weapon5': '0.062', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.606', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.072', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '49.000'} [2024-08-06 01:31:15,660][52667] DAMAGECOUNT value on done: 209666.0 [2024-08-06 01:31:15,660][52667] Sum rewards: 67.866, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '56.000'} [2024-08-06 01:31:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 253952000. Throughput: 0: 4391.8. Samples: 63488050. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:31:17,802][52567] Avg episode reward: [(0, '61.470')] [2024-08-06 01:31:17,918][52650] Updated weights for policy 0, policy_version 31001 (0.0025) [2024-08-06 01:31:17,922][52668] DAMAGECOUNT value on done: 203988.0 [2024-08-06 01:31:17,924][52668] Sum rewards: 63.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.515', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.222', 'weapon2': '0.398', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.068', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '54.000'} [2024-08-06 01:31:18,182][52667] DAMAGECOUNT value on done: 211552.0 [2024-08-06 01:31:18,183][52667] Sum rewards: 75.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.895', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.187', 'weapon4': '0.310', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '59.000'} [2024-08-06 01:31:18,427][52662] DAMAGECOUNT value on done: 215669.0 [2024-08-06 01:31:18,428][52662] Sum rewards: 62.514, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.387', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.178', 'WEAPON7': '0.200', 'AMMO4': '0.203', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.966', 'WEAPON3': '1.050', 'weapon3': '2.382', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:19,377][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:31:20,921][52667] DAMAGECOUNT value on done: 206916.0 [2024-08-06 01:31:20,923][52667] Sum rewards: 68.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.262', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '57.000'} [2024-08-06 01:31:21,060][52662] DAMAGECOUNT value on done: 214807.0 [2024-08-06 01:31:21,061][52662] Sum rewards: 76.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.525', 'AMMO5': '0.006', 'AMMO2': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.251', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '63.000'} [2024-08-06 01:31:21,249][52668] DAMAGECOUNT value on done: 208367.0 [2024-08-06 01:31:21,250][52668] Sum rewards: 65.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.168', 'AMMO3': '0.197', 'AMMO4': '0.217', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.508', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.000'} [2024-08-06 01:31:21,478][52660] DAMAGECOUNT value on done: 207123.0 [2024-08-06 01:31:21,479][52660] Sum rewards: 69.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.086', 'AMMO4': '0.213', 'AMMO3': '0.229', 'weapon2': '0.232', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '59.000'} [2024-08-06 01:31:22,528][52650] Updated weights for policy 0, policy_version 31011 (0.0013) [2024-08-06 01:31:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 254042112. Throughput: 0: 4392.0. Samples: 63514480. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:31:22,794][52567] Avg episode reward: [(0, '62.044')] [2024-08-06 01:31:23,833][52667] DAMAGECOUNT value on done: 210770.0 [2024-08-06 01:31:23,834][52667] Sum rewards: 64.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.221', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '54.000'} [2024-08-06 01:31:23,924][52662] DAMAGECOUNT value on done: 205565.0 [2024-08-06 01:31:23,924][52662] Sum rewards: 58.780, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.770', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.092', 'weapon4': '0.124', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.297', 'weapon2': '0.436', 'WEAPON3': '1.650', 'weapon3': '3.048', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:24,380][52668] DAMAGECOUNT value on done: 206394.0 [2024-08-06 01:31:24,382][52668] Sum rewards: 53.645, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.255', 'AMMO5': '0.007', 'AMMO2': '0.058', 'weapon5': '0.144', 'WEAPON5': '0.250', 'weapon2': '0.276', 'AMMO4': '0.290', 'AMMO3': '0.295', 'weapon4': '0.434', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.752', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:24,683][52660] DAMAGECOUNT value on done: 205898.0 [2024-08-06 01:31:24,683][52660] Sum rewards: 79.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.572', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '65.000'} [2024-08-06 01:31:26,384][52662] DAMAGECOUNT value on done: 212920.0 [2024-08-06 01:31:26,385][52662] Sum rewards: 69.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.007', 'ARMOR': '0.028', 'AMMO2': '0.040', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.233', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '59.000'} [2024-08-06 01:31:26,739][52667] DAMAGECOUNT value on done: 209596.0 [2024-08-06 01:31:26,740][52667] Sum rewards: 68.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.162', 'AMMO3': '0.206', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '57.000'} [2024-08-06 01:31:27,232][52668] DAMAGECOUNT value on done: 210113.0 [2024-08-06 01:31:27,232][52668] Sum rewards: 60.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.162', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'weapon4': '0.246', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '53.000'} [2024-08-06 01:31:27,407][52660] DAMAGECOUNT value on done: 209098.0 [2024-08-06 01:31:27,407][52660] Sum rewards: 64.008, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.216', 'weapon4': '0.218', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.382', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '54.000'} [2024-08-06 01:31:27,521][52650] Updated weights for policy 0, policy_version 31021 (0.0014) [2024-08-06 01:31:27,788][52663] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:31:27,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 254132224. Throughput: 0: 4393.1. Samples: 63541040. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:31:27,799][52567] Avg episode reward: [(0, '62.191')] [2024-08-06 01:31:28,730][52669] DAMAGECOUNT value on done: 210886.0 [2024-08-06 01:31:28,732][52669] Sum rewards: 60.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '50.000'} [2024-08-06 01:31:29,069][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:31:29,384][52662] DAMAGECOUNT value on done: 208454.0 [2024-08-06 01:31:29,385][52662] Sum rewards: 55.153, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.318', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO3': '0.195', 'AMMO4': '0.206', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '45.000'} [2024-08-06 01:31:29,453][52667] DAMAGECOUNT value on done: 212087.0 [2024-08-06 01:31:29,456][52667] Sum rewards: 65.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.231', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon5': '0.140', 'AMMO3': '0.212', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '54.000'} [2024-08-06 01:31:30,535][52668] DAMAGECOUNT value on done: 209307.0 [2024-08-06 01:31:30,538][52668] Sum rewards: 61.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.984', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.212', 'weapon2': '0.330', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:30,702][52660] DAMAGECOUNT value on done: 210179.0 [2024-08-06 01:31:30,703][52660] Sum rewards: 54.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.548', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:31,844][52669] DAMAGECOUNT value on done: 205662.0 [2024-08-06 01:31:31,845][52669] Sum rewards: 49.388, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.228', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.076', 'AMMO3': '0.146', 'AMMO4': '0.152', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.842', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '39.000'} [2024-08-06 01:31:31,853][52650] Updated weights for policy 0, policy_version 31031 (0.0020) [2024-08-06 01:31:31,915][52662] DAMAGECOUNT value on done: 213279.0 [2024-08-06 01:31:31,917][52662] Sum rewards: 59.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.212', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.201', 'weapon5': '0.226', 'AMMO4': '0.261', 'WEAPON5': '0.450', 'weapon4': '0.454', 'WEAPON4': '0.500', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.324', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '50.000'} [2024-08-06 01:31:32,499][52667] DAMAGECOUNT value on done: 207505.0 [2024-08-06 01:31:32,499][52667] Sum rewards: 54.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.211', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.182', 'weapon5': '0.200', 'AMMO4': '0.302', 'WEAPON5': '0.500', 'weapon4': '0.548', 'WEAPON4': '0.800', 'weapon2': '0.816', 'WEAPON3': '0.950', 'weapon3': '2.198', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 254222336. Throughput: 0: 4399.6. Samples: 63554400. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:31:32,794][52567] Avg episode reward: [(0, '62.211')] [2024-08-06 01:31:33,254][52668] DAMAGECOUNT value on done: 210607.0 [2024-08-06 01:31:33,254][52668] Sum rewards: 53.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.112', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.348', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.322', 'DAMAGECOUNT': '13.446', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:33,373][52660] DAMAGECOUNT value on done: 209349.0 [2024-08-06 01:31:33,375][52660] Sum rewards: 76.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.172', 'AMMO3': '0.225', 'AMMO4': '0.240', 'weapon4': '0.274', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '63.000'} [2024-08-06 01:31:34,669][52662] DAMAGECOUNT value on done: 217767.0 [2024-08-06 01:31:34,670][52662] Sum rewards: 71.620, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.825', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.152', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.262', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '60.000'} [2024-08-06 01:31:34,728][52669] DAMAGECOUNT value on done: 210531.0 [2024-08-06 01:31:34,730][52669] Sum rewards: 53.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.226', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON4': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.616', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '46.000'} [2024-08-06 01:31:35,548][52667] DAMAGECOUNT value on done: 208679.0 [2024-08-06 01:31:35,548][52667] Sum rewards: 72.094, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.207', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.248', 'weapon4': '0.290', 'ARMOR': '0.460', 'weapon2': '0.586', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '62.000'} [2024-08-06 01:31:36,183][52668] DAMAGECOUNT value on done: 210885.0 [2024-08-06 01:31:36,184][52668] Sum rewards: 75.739, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.602', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.102', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.220', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '65.000'} [2024-08-06 01:31:36,340][52660] DAMAGECOUNT value on done: 205652.0 [2024-08-06 01:31:36,351][52660] Sum rewards: 51.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.192', 'weapon2': '0.308', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'weapon4': '0.604', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.850', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '42.000'} [2024-08-06 01:31:36,549][52650] Updated weights for policy 0, policy_version 31041 (0.0023) [2024-08-06 01:31:37,434][52662] DAMAGECOUNT value on done: 210503.0 [2024-08-06 01:31:37,434][52662] Sum rewards: 64.012, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.511', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.154', 'weapon4': '0.194', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '58.000'} [2024-08-06 01:31:37,644][52669] DAMAGECOUNT value on done: 207352.0 [2024-08-06 01:31:37,645][52669] Sum rewards: 68.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.372', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon5': '0.248', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '57.000'} [2024-08-06 01:31:37,726][52647] DAMAGECOUNT value on done: 223011.0 [2024-08-06 01:31:37,728][52647] Sum rewards: 60.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.550', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.167', 'AMMO3': '0.229', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.500', 'weapon3': '2.674', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '53.000'} [2024-08-06 01:31:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 254304256. Throughput: 0: 4400.0. Samples: 63580650. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:31:37,802][52567] Avg episode reward: [(0, '62.566')] [2024-08-06 01:31:38,058][52794] DAMAGECOUNT value on done: 212467.0 [2024-08-06 01:31:38,061][52794] Sum rewards: 53.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.657', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.048', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.254', 'weapon2': '0.332', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.400', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:38,397][52667] DAMAGECOUNT value on done: 211673.0 [2024-08-06 01:31:38,398][52667] Sum rewards: 70.018, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'HEALTH': '0.026', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'weapon2': '0.326', 'WEAPON4': '0.400', 'ARMOR': '0.503', 'WEAPON3': '0.750', 'weapon4': '0.840', 'weapon3': '2.362', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '55.000'} [2024-08-06 01:31:39,384][52668] DAMAGECOUNT value on done: 204612.0 [2024-08-06 01:31:39,385][52668] Sum rewards: 59.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.192', 'AMMO4': '0.192', 'AMMO3': '0.233', 'weapon2': '0.296', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.886', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '51.500'} [2024-08-06 01:31:39,511][52660] DAMAGECOUNT value on done: 210277.0 [2024-08-06 01:31:39,512][52660] Sum rewards: 67.524, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.142', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '57.000'} [2024-08-06 01:31:40,225][52647] DAMAGECOUNT value on done: 218454.0 [2024-08-06 01:31:40,226][52647] Sum rewards: 48.515, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.742', 'AMMO5': '0.004', 'weapon5': '0.040', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.570', 'weapon4': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.520', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '40.000'} [2024-08-06 01:31:40,314][52662] DAMAGECOUNT value on done: 219648.0 [2024-08-06 01:31:40,315][52662] Sum rewards: 63.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.123', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon4': '0.248', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:40,769][52669] DAMAGECOUNT value on done: 209449.0 [2024-08-06 01:31:40,769][52669] Sum rewards: 72.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.046', 'AMMO4': '0.181', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '63.000'} [2024-08-06 01:31:40,977][52794] DAMAGECOUNT value on done: 215537.0 [2024-08-06 01:31:40,978][52794] Sum rewards: 58.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon2': '0.344', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.166', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '49.000'} [2024-08-06 01:31:41,062][52650] Updated weights for policy 0, policy_version 31051 (0.0011) [2024-08-06 01:31:41,377][52667] DAMAGECOUNT value on done: 212039.0 [2024-08-06 01:31:41,377][52667] Sum rewards: 64.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.122', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.706', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '53.000'} [2024-08-06 01:31:42,116][52668] DAMAGECOUNT value on done: 199032.0 [2024-08-06 01:31:42,117][52668] Sum rewards: 60.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.152', 'AMMO3': '0.203', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '50.500'} [2024-08-06 01:31:42,272][52660] DAMAGECOUNT value on done: 212674.0 [2024-08-06 01:31:42,273][52660] Sum rewards: 72.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'weapon4': '0.246', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '63.000'} [2024-08-06 01:31:42,638][52647] DAMAGECOUNT value on done: 220562.0 [2024-08-06 01:31:42,639][52647] Sum rewards: 60.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.205', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.148', 'AMMO4': '0.221', 'weapon5': '0.230', 'weapon4': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.814', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '50.500'} [2024-08-06 01:31:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 254394368. Throughput: 0: 4402.0. Samples: 63607160. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:31:42,794][52567] Avg episode reward: [(0, '62.893')] [2024-08-06 01:31:42,803][52614] Saving new best policy, reward=62.893! [2024-08-06 01:31:43,437][52662] DAMAGECOUNT value on done: 209607.0 [2024-08-06 01:31:43,438][52662] Sum rewards: 55.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.022', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.188', 'weapon2': '0.444', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.194', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:43,709][52669] DAMAGECOUNT value on done: 206875.0 [2024-08-06 01:31:43,709][52669] Sum rewards: 65.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.119', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '55.000'} [2024-08-06 01:31:44,186][52794] DAMAGECOUNT value on done: 209261.0 [2024-08-06 01:31:44,187][52794] Sum rewards: 58.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.302', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.074', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '51.000'} [2024-08-06 01:31:44,552][52667] DAMAGECOUNT value on done: 209236.0 [2024-08-06 01:31:44,552][52667] Sum rewards: 66.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.784', 'AMMO5': '0.013', 'AMMO2': '0.059', 'AMMO3': '0.168', 'weapon5': '0.196', 'AMMO4': '0.297', 'weapon4': '0.316', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.746', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '56.000'} [2024-08-06 01:31:45,364][52668] DAMAGECOUNT value on done: 205470.0 [2024-08-06 01:31:45,365][52668] Sum rewards: 57.307, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.900', 'AMMO2': '0.044', 'AMMO4': '0.221', 'AMMO3': '0.262', 'weapon2': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.546', 'WEAPON3': '1.650', 'weapon3': '2.916', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '51.000'} [2024-08-06 01:31:45,462][52660] DAMAGECOUNT value on done: 211889.0 [2024-08-06 01:31:45,463][52660] Sum rewards: 74.701, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.125', 'AMMO5': '0.009', 'weapon5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.092', 'AMMO4': '0.135', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.050', 'HITCOUNT': '3.410', 'weapon3': '3.412', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 01:31:45,680][52647] DAMAGECOUNT value on done: 221931.0 [2024-08-06 01:31:45,682][52647] Sum rewards: 65.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.822', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.267', 'weapon2': '0.340', 'WEAPON3': '1.650', 'HITCOUNT': '3.300', 'weapon3': '3.394', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '57.000'} [2024-08-06 01:31:45,773][52650] Updated weights for policy 0, policy_version 31061 (0.0016) [2024-08-06 01:31:46,328][52669] DAMAGECOUNT value on done: 210116.0 [2024-08-06 01:31:46,330][52669] Sum rewards: 63.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.064', 'weapon4': '0.156', 'AMMO4': '0.187', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '53.000'} [2024-08-06 01:31:46,553][52662] DAMAGECOUNT value on done: 210482.0 [2024-08-06 01:31:46,555][52662] Sum rewards: 50.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.184', 'AMMO4': '0.214', 'weapon5': '0.266', 'weapon4': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.840', 'WEAPON3': '1.100', 'weapon3': '2.298', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '44.000'} [2024-08-06 01:31:47,342][52794] DAMAGECOUNT value on done: 210942.0 [2024-08-06 01:31:47,342][52794] Sum rewards: 72.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon2': '0.210', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.594', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '60.000'} [2024-08-06 01:31:47,649][52667] DAMAGECOUNT value on done: 211518.0 [2024-08-06 01:31:47,651][52667] Sum rewards: 66.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.999', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.142', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon4': '0.332', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.898', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '58.000'} [2024-08-06 01:31:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 254484480. Throughput: 0: 4405.1. Samples: 63620200. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:31:47,794][52567] Avg episode reward: [(0, '62.956')] [2024-08-06 01:31:47,798][52614] Saving new best policy, reward=62.956! [2024-08-06 01:31:48,267][52647] DAMAGECOUNT value on done: 221077.0 [2024-08-06 01:31:48,268][52647] Sum rewards: 60.186, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.875', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.056', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.870', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '48.000'} [2024-08-06 01:31:48,311][52668] DAMAGECOUNT value on done: 203780.0 [2024-08-06 01:31:48,313][52668] Sum rewards: 59.313, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.094', 'weapon4': '0.148', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:48,475][52660] DAMAGECOUNT value on done: 206625.0 [2024-08-06 01:31:48,477][52660] Sum rewards: 57.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.372', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.217', 'WEAPON4': '0.250', 'weapon4': '0.514', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.604', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '48.000'} [2024-08-06 01:31:49,196][52669] DAMAGECOUNT value on done: 209257.0 [2024-08-06 01:31:49,196][52669] Sum rewards: 64.173, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.209', 'WEAPON4': '0.450', 'weapon2': '0.462', 'weapon4': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '55.000'} [2024-08-06 01:31:49,736][52662] DAMAGECOUNT value on done: 207905.0 [2024-08-06 01:31:49,737][52662] Sum rewards: 56.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.058', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.598', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:50,265][52667] DAMAGECOUNT value on done: 206954.0 [2024-08-06 01:31:50,266][52667] Sum rewards: 68.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.296', 'weapon4': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '55.000'} [2024-08-06 01:31:50,449][52794] DAMAGECOUNT value on done: 208552.0 [2024-08-06 01:31:50,451][52794] Sum rewards: 47.091, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.360', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.456', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '3.098', 'DAMAGECOUNT': '11.310', 'FRAGCOUNT': '39.000'} [2024-08-06 01:31:50,733][52650] Updated weights for policy 0, policy_version 31071 (0.0013) [2024-08-06 01:31:50,776][52647] DAMAGECOUNT value on done: 225940.0 [2024-08-06 01:31:50,777][52647] Sum rewards: 68.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.692', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.128', 'AMMO3': '0.180', 'weapon2': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '55.000'} [2024-08-06 01:31:51,407][52668] DAMAGECOUNT value on done: 209517.0 [2024-08-06 01:31:51,408][52668] Sum rewards: 53.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.706', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.126', 'AMMO4': '0.156', 'weapon5': '0.196', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.400', 'weapon4': '0.806', 'WEAPON3': '1.150', 'weapon3': '2.330', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '45.000'} [2024-08-06 01:31:51,546][52660] DAMAGECOUNT value on done: 214104.0 [2024-08-06 01:31:51,546][52660] Sum rewards: 57.047, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.050', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.291', 'weapon2': '0.388', 'WEAPON3': '1.750', 'HITCOUNT': '3.150', 'weapon3': '3.196', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:52,312][52669] DAMAGECOUNT value on done: 209682.0 [2024-08-06 01:31:52,312][52669] Sum rewards: 65.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.158', 'weapon4': '0.178', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '56.500'} [2024-08-06 01:31:52,605][52662] DAMAGECOUNT value on done: 217414.0 [2024-08-06 01:31:52,606][52662] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.518', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon4': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '62.000'} [2024-08-06 01:31:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 254566400. Throughput: 0: 4400.9. Samples: 63646400. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:31:52,795][52567] Avg episode reward: [(0, '63.021')] [2024-08-06 01:31:52,819][52614] Saving new best policy, reward=63.021! [2024-08-06 01:31:53,110][52667] DAMAGECOUNT value on done: 213507.0 [2024-08-06 01:31:53,110][52667] Sum rewards: 62.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.122', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.144', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.214', 'AMMO3': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.202', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 01:31:53,230][52794] DAMAGECOUNT value on done: 210737.0 [2024-08-06 01:31:53,232][52794] Sum rewards: 54.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.092', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '3.224', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '49.000'} [2024-08-06 01:31:53,506][52647] DAMAGECOUNT value on done: 219264.0 [2024-08-06 01:31:53,509][52647] Sum rewards: 56.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.628', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.144', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '50.000'} [2024-08-06 01:31:54,135][52668] DAMAGECOUNT value on done: 202987.0 [2024-08-06 01:31:54,136][52668] Sum rewards: 52.274, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.925', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.122', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.212', 'weapon2': '0.224', 'AMMO3': '0.297', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '2.770', 'weapon3': '3.236', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2024-08-06 01:31:54,388][52660] DAMAGECOUNT value on done: 202375.0 [2024-08-06 01:31:54,390][52660] Sum rewards: 65.093, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.349', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.924', 'WEAPON3': '0.950', 'weapon3': '2.852', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:55,111][52650] Updated weights for policy 0, policy_version 31081 (0.0014) [2024-08-06 01:31:55,116][52669] DAMAGECOUNT value on done: 205718.0 [2024-08-06 01:31:55,116][52669] Sum rewards: 54.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.626', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.098', 'AMMO4': '0.185', 'AMMO3': '0.215', 'weapon2': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.436', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.008', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:55,391][52662] DAMAGECOUNT value on done: 214073.0 [2024-08-06 01:31:55,391][52662] Sum rewards: 65.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.655', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.294', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '54.000'} [2024-08-06 01:31:56,209][52667] DAMAGECOUNT value on done: 218129.0 [2024-08-06 01:31:56,210][52667] Sum rewards: 62.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.418', 'ARMOR': '0.016', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon5': '0.184', 'AMMO3': '0.189', 'AMMO4': '0.264', 'weapon4': '0.352', 'weapon2': '0.426', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:56,217][52647] DAMAGECOUNT value on done: 218991.0 [2024-08-06 01:31:56,217][52647] Sum rewards: 56.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.295', 'AMMO5': '0.012', 'AMMO2': '0.060', 'AMMO3': '0.178', 'weapon5': '0.246', 'weapon2': '0.258', 'AMMO4': '0.298', 'WEAPON5': '0.350', 'weapon4': '0.588', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.542', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '48.000'} [2024-08-06 01:31:56,319][52794] DAMAGECOUNT value on done: 215105.0 [2024-08-06 01:31:56,320][52794] Sum rewards: 56.520, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.818', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.063', 'weapon5': '0.126', 'AMMO3': '0.189', 'weapon2': '0.244', 'WEAPON5': '0.250', 'AMMO4': '0.314', 'WEAPON4': '0.500', 'weapon4': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.684', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:56,787][52668] DAMAGECOUNT value on done: 212327.0 [2024-08-06 01:31:56,787][52668] Sum rewards: 67.880, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.986', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.207', 'AMMO3': '0.240', 'weapon4': '0.440', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.714', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '59.000'} [2024-08-06 01:31:57,021][52658] DAMAGECOUNT value on done: 213588.0 [2024-08-06 01:31:57,022][52658] Sum rewards: 63.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.074', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.156', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '53.000'} [2024-08-06 01:31:57,141][52660] DAMAGECOUNT value on done: 207145.0 [2024-08-06 01:31:57,141][52660] Sum rewards: 71.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.244', 'weapon4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '62.000'} [2024-08-06 01:31:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 254656512. Throughput: 0: 4388.4. Samples: 63672390. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:31:57,794][52567] Avg episode reward: [(0, '62.857')] [2024-08-06 01:31:58,353][52669] DAMAGECOUNT value on done: 209957.0 [2024-08-06 01:31:58,354][52669] Sum rewards: 62.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.146', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '53.000'} [2024-08-06 01:31:58,368][52662] DAMAGECOUNT value on done: 218631.0 [2024-08-06 01:31:58,368][52662] Sum rewards: 66.844, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.264', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.148', 'AMMO3': '0.155', 'AMMO4': '0.161', 'weapon5': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.628', 'WEAPON3': '0.950', 'weapon3': '2.762', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '55.000'} [2024-08-06 01:31:59,103][52794] DAMAGECOUNT value on done: 210714.0 [2024-08-06 01:31:59,103][52794] Sum rewards: 67.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.552', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'weapon4': '0.398', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 01:31:59,183][52667] DAMAGECOUNT value on done: 213147.0 [2024-08-06 01:31:59,183][52667] Sum rewards: 57.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.488', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.190', 'AMMO3': '0.216', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.400', 'weapon4': '0.442', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.646', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '49.000'} [2024-08-06 01:31:59,293][52647] DAMAGECOUNT value on done: 220809.0 [2024-08-06 01:31:59,294][52647] Sum rewards: 56.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.697', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.616', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.094', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '47.000'} [2024-08-06 01:31:59,396][52668] DAMAGECOUNT value on done: 211228.0 [2024-08-06 01:31:59,396][52668] Sum rewards: 61.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.763', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.146', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '50.500'} [2024-08-06 01:31:59,670][52660] DAMAGECOUNT value on done: 212217.0 [2024-08-06 01:31:59,671][52660] Sum rewards: 62.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '52.000'} [2024-08-06 01:31:59,875][52650] Updated weights for policy 0, policy_version 31091 (0.0023) [2024-08-06 01:32:00,030][52658] DAMAGECOUNT value on done: 211402.0 [2024-08-06 01:32:00,030][52658] Sum rewards: 74.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.404', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '61.000'} [2024-08-06 01:32:01,121][52662] DAMAGECOUNT value on done: 209503.0 [2024-08-06 01:32:01,122][52662] Sum rewards: 55.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.103', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.274', 'weapon2': '0.294', 'WEAPON3': '1.700', 'HITCOUNT': '3.100', 'weapon3': '3.514', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '50.000'} [2024-08-06 01:32:01,205][52669] DAMAGECOUNT value on done: 212294.0 [2024-08-06 01:32:01,206][52669] Sum rewards: 69.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.816', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.156', 'AMMO3': '0.166', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'weapon4': '0.352', 'weapon2': '0.386', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.826', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:01,872][52667] DAMAGECOUNT value on done: 214730.0 [2024-08-06 01:32:01,873][52667] Sum rewards: 59.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.189', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.167', 'AMMO3': '0.182', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.056', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '51.000'} [2024-08-06 01:32:01,916][52794] DAMAGECOUNT value on done: 215376.0 [2024-08-06 01:32:01,917][52794] Sum rewards: 58.928, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.205', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.251', 'weapon4': '0.286', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '51.000'} [2024-08-06 01:32:02,415][52668] DAMAGECOUNT value on done: 208284.0 [2024-08-06 01:32:02,416][52668] Sum rewards: 63.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.710', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.422', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:02,458][52647] DAMAGECOUNT value on done: 217495.0 [2024-08-06 01:32:02,458][52647] Sum rewards: 58.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.510', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '2.758', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '51.000'} [2024-08-06 01:32:02,666][52660] DAMAGECOUNT value on done: 218971.0 [2024-08-06 01:32:02,667][52660] Sum rewards: 70.919, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.744', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.295', 'weapon2': '0.458', 'WEAPON3': '1.750', 'weapon3': '3.158', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 01:32:02,710][52658] DAMAGECOUNT value on done: 212371.0 [2024-08-06 01:32:02,712][52658] Sum rewards: 61.490, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.130', 'AMMO5': '0.016', 'AMMO2': '0.069', 'weapon5': '0.100', 'AMMO3': '0.202', 'AMMO4': '0.346', 'WEAPON5': '0.400', 'weapon2': '0.470', 'weapon4': '0.508', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.668', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 254746624. Throughput: 0: 4390.9. Samples: 63685640. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:32:02,794][52567] Avg episode reward: [(0, '62.599')] [2024-08-06 01:32:03,905][52669] DAMAGECOUNT value on done: 205241.0 [2024-08-06 01:32:03,908][52669] Sum rewards: 69.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.715', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.080', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '59.000'} [2024-08-06 01:32:04,101][52662] DAMAGECOUNT value on done: 213134.0 [2024-08-06 01:32:04,101][52662] Sum rewards: 63.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.724', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.160', 'AMMO3': '0.244', 'weapon5': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '2.808', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '55.000'} [2024-08-06 01:32:04,607][52650] Updated weights for policy 0, policy_version 31101 (0.0040) [2024-08-06 01:32:04,890][52667] DAMAGECOUNT value on done: 204643.0 [2024-08-06 01:32:04,890][52667] Sum rewards: 63.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.444', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'weapon4': '0.216', 'AMMO3': '0.234', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:04,961][52794] DAMAGECOUNT value on done: 214223.0 [2024-08-06 01:32:04,961][52794] Sum rewards: 63.468, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.128', 'weapon5': '0.136', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.416', 'HEALTH': '0.428', 'weapon2': '0.550', 'WEAPON3': '0.750', 'weapon3': '2.680', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:05,539][52660] DAMAGECOUNT value on done: 204691.0 [2024-08-06 01:32:05,541][52660] Sum rewards: 75.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.068', 'weapon5': '0.114', 'weapon4': '0.118', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '62.000'} [2024-08-06 01:32:05,545][52647] DAMAGECOUNT value on done: 219324.0 [2024-08-06 01:32:05,545][52647] Sum rewards: 72.307, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.938', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.150', 'weapon5': '0.164', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '0.950', 'weapon3': '2.990', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '58.000'} [2024-08-06 01:32:05,739][52658] DAMAGECOUNT value on done: 212592.0 [2024-08-06 01:32:05,740][52658] Sum rewards: 56.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.274', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.118', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '48.000'} [2024-08-06 01:32:07,028][52662] DAMAGECOUNT value on done: 211382.0 [2024-08-06 01:32:07,028][52662] Sum rewards: 55.384, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.102', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.130', 'AMMO4': '0.193', 'AMMO3': '0.240', 'weapon5': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '2.876', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '47.500'} [2024-08-06 01:32:07,182][52669] DAMAGECOUNT value on done: 212876.0 [2024-08-06 01:32:07,183][52669] Sum rewards: 63.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.424', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.176', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.352', 'WEAPON4': '0.400', 'weapon4': '0.680', 'WEAPON3': '1.500', 'weapon3': '2.528', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.000'} [2024-08-06 01:32:07,343][52667] DAMAGECOUNT value on done: 213702.0 [2024-08-06 01:32:07,345][52667] Sum rewards: 56.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.035', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.310', 'weapon4': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.068', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '47.000'} [2024-08-06 01:32:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 254836736. Throughput: 0: 4389.3. Samples: 63712000. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:32:07,794][52567] Avg episode reward: [(0, '62.400')] [2024-08-06 01:32:07,958][52794] DAMAGECOUNT value on done: 211421.0 [2024-08-06 01:32:07,960][52794] Sum rewards: 63.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.754', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO4': '0.188', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:08,267][52647] DAMAGECOUNT value on done: 216799.0 [2024-08-06 01:32:08,267][52647] Sum rewards: 57.225, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.980', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.213', 'weapon5': '0.244', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'weapon4': '0.466', 'weapon2': '0.540', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.420', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '50.000'} [2024-08-06 01:32:08,344][52658] DAMAGECOUNT value on done: 211757.0 [2024-08-06 01:32:08,346][52658] Sum rewards: 65.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.100', 'AMMO3': '0.185', 'weapon5': '0.196', 'AMMO4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '55.000'} [2024-08-06 01:32:08,592][52660] DAMAGECOUNT value on done: 210725.0 [2024-08-06 01:32:08,593][52660] Sum rewards: 63.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.898', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.062', 'AMMO4': '0.083', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.542', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.118', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:09,345][52650] Updated weights for policy 0, policy_version 31111 (0.0010) [2024-08-06 01:32:10,145][52662] DAMAGECOUNT value on done: 209618.0 [2024-08-06 01:32:10,147][52662] Sum rewards: 71.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO3': '0.194', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2024-08-06 01:32:10,491][52669] DAMAGECOUNT value on done: 215122.0 [2024-08-06 01:32:10,492][52669] Sum rewards: 59.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.691', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.376', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.946', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:10,829][52794] DAMAGECOUNT value on done: 211709.0 [2024-08-06 01:32:10,829][52794] Sum rewards: 68.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.264', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '61.000'} [2024-08-06 01:32:10,973][52658] DAMAGECOUNT value on done: 208132.0 [2024-08-06 01:32:10,975][52658] Sum rewards: 64.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.868', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.424', 'weapon4': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.728', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:11,051][52647] DAMAGECOUNT value on done: 218453.0 [2024-08-06 01:32:11,051][52647] Sum rewards: 69.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.194', 'weapon2': '0.830', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:11,362][52660] DAMAGECOUNT value on done: 201355.0 [2024-08-06 01:32:11,362][52660] Sum rewards: 63.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'weapon2': '0.350', 'weapon4': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:11,612][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:32:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 254918656. Throughput: 0: 4385.3. Samples: 63738380. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:32:12,794][52567] Avg episode reward: [(0, '62.541')] [2024-08-06 01:32:13,273][52794] DAMAGECOUNT value on done: 208334.0 [2024-08-06 01:32:13,274][52794] Sum rewards: 51.294, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.764', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.180', 'AMMO3': '0.267', 'AMMO4': '0.293', 'WEAPON5': '0.300', 'weapon2': '0.468', 'weapon4': '0.574', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.490', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '48.500'} [2024-08-06 01:32:13,569][52669] DAMAGECOUNT value on done: 222136.0 [2024-08-06 01:32:13,569][52669] Sum rewards: 62.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.596', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.124', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'AMMO4': '0.285', 'weapon2': '0.364', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.792', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:13,651][52650] Updated weights for policy 0, policy_version 31121 (0.0012) [2024-08-06 01:32:13,868][52658] DAMAGECOUNT value on done: 216926.0 [2024-08-06 01:32:13,868][52658] Sum rewards: 68.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.804', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.140', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:14,059][52660] DAMAGECOUNT value on done: 211256.0 [2024-08-06 01:32:14,061][52660] Sum rewards: 65.369, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.152', 'AMMO3': '0.166', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon4': '0.278', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:14,110][52647] DAMAGECOUNT value on done: 220405.0 [2024-08-06 01:32:14,110][52647] Sum rewards: 63.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'weapon4': '0.092', 'AMMO3': '0.204', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:15,292][52666] DAMAGECOUNT value on done: 214464.0 [2024-08-06 01:32:15,301][52666] Sum rewards: 64.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.014', 'AMMO2': '0.069', 'weapon5': '0.160', 'weapon4': '0.168', 'AMMO3': '0.226', 'AMMO4': '0.343', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.628', 'WEAPON3': '1.400', 'weapon3': '2.744', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '56.500'} [2024-08-06 01:32:15,690][52794] DAMAGECOUNT value on done: 221376.0 [2024-08-06 01:32:15,691][52794] Sum rewards: 52.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.057', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'AMMO4': '0.284', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.666', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '46.000'} [2024-08-06 01:32:16,112][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:32:16,505][52647] DAMAGECOUNT value on done: 221820.0 [2024-08-06 01:32:16,535][52647] Sum rewards: 66.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.988', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.032', 'weapon4': '0.044', 'weapon7': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.239', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:16,698][52669] DAMAGECOUNT value on done: 207908.0 [2024-08-06 01:32:16,700][52669] Sum rewards: 59.125, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'ARMOR': '0.008', 'weapon5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.230', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:16,911][52658] DAMAGECOUNT value on done: 205994.0 [2024-08-06 01:32:16,912][52658] Sum rewards: 49.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.312', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.069', 'AMMO3': '0.197', 'weapon5': '0.198', 'weapon2': '0.272', 'AMMO4': '0.347', 'WEAPON5': '0.350', 'WEAPON4': '0.700', 'weapon4': '0.874', 'WEAPON3': '1.200', 'weapon3': '2.412', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '12.609', 'FRAGCOUNT': '43.000'} [2024-08-06 01:32:16,918][52660] DAMAGECOUNT value on done: 207398.0 [2024-08-06 01:32:16,918][52660] Sum rewards: 64.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.186', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 255008768. Throughput: 0: 4383.3. Samples: 63751650. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:32:17,794][52567] Avg episode reward: [(0, '62.516')] [2024-08-06 01:32:17,818][52666] DAMAGECOUNT value on done: 214075.0 [2024-08-06 01:32:17,820][52666] Sum rewards: 64.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '55.000'} [2024-08-06 01:32:18,567][52650] Updated weights for policy 0, policy_version 31131 (0.0018) [2024-08-06 01:32:18,894][52794] DAMAGECOUNT value on done: 208468.0 [2024-08-06 01:32:18,898][52794] Sum rewards: 64.768, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.549', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.136', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.392', 'WEAPON4': '0.450', 'weapon4': '0.470', 'WEAPON3': '1.600', 'weapon3': '2.662', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:19,160][52647] DAMAGECOUNT value on done: 218309.0 [2024-08-06 01:32:19,162][52647] Sum rewards: 66.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.661', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.162', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.698', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:19,519][52669] DAMAGECOUNT value on done: 215206.0 [2024-08-06 01:32:19,522][52669] Sum rewards: 72.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.233', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon4': '0.206', 'AMMO3': '0.216', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '61.000'} [2024-08-06 01:32:19,933][52658] DAMAGECOUNT value on done: 215401.0 [2024-08-06 01:32:19,936][52658] Sum rewards: 63.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.525', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.172', 'AMMO3': '0.179', 'AMMO4': '0.216', 'weapon4': '0.316', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:20,795][52666] DAMAGECOUNT value on done: 213881.0 [2024-08-06 01:32:20,796][52666] Sum rewards: 78.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.436', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.042', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.416', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '63.000'} [2024-08-06 01:32:21,062][52664] DAMAGECOUNT value on done: 216456.0 [2024-08-06 01:32:21,062][52664] Sum rewards: 44.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.118', 'AMMO5': '0.004', 'weapon5': '0.038', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'AMMO4': '0.205', 'AMMO3': '0.232', 'weapon2': '0.280', 'WEAPON4': '0.500', 'weapon4': '0.716', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '39.000'} [2024-08-06 01:32:21,491][52647] DAMAGECOUNT value on done: 216319.0 [2024-08-06 01:32:21,493][52647] Sum rewards: 60.799, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.428', 'WEAPON3': '1.650', 'weapon3': '2.928', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:21,655][52794] DAMAGECOUNT value on done: 219105.0 [2024-08-06 01:32:21,656][52794] Sum rewards: 64.002, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.082', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.186', 'weapon5': '0.202', 'AMMO3': '0.247', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.838', 'WEAPON3': '1.400', 'weapon3': '2.494', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:22,677][52669] DAMAGECOUNT value on done: 216053.0 [2024-08-06 01:32:22,678][52669] Sum rewards: 74.735, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.251', 'weapon4': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '63.000'} [2024-08-06 01:32:22,678][52658] DAMAGECOUNT value on done: 213662.0 [2024-08-06 01:32:22,678][52658] Sum rewards: 51.995, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.600', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.118', 'weapon5': '0.162', 'AMMO3': '0.246', 'AMMO4': '0.292', 'weapon2': '0.292', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:22,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 255098880. Throughput: 0: 4390.4. Samples: 63778220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:32:22,795][52567] Avg episode reward: [(0, '62.751')] [2024-08-06 01:32:23,070][52650] Updated weights for policy 0, policy_version 31141 (0.0012) [2024-08-06 01:32:23,818][52664] DAMAGECOUNT value on done: 217920.0 [2024-08-06 01:32:23,819][52664] Sum rewards: 65.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.334', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:23,945][52666] DAMAGECOUNT value on done: 209438.0 [2024-08-06 01:32:23,947][52666] Sum rewards: 60.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.221', 'weapon5': '0.242', 'AMMO4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:24,322][52647] DAMAGECOUNT value on done: 219157.0 [2024-08-06 01:32:24,322][52647] Sum rewards: 59.234, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.634', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.258', 'AMMO3': '0.292', 'weapon2': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.036', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:24,478][52794] DAMAGECOUNT value on done: 214286.0 [2024-08-06 01:32:24,480][52794] Sum rewards: 62.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.116', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:25,318][52669] DAMAGECOUNT value on done: 217162.0 [2024-08-06 01:32:25,321][52669] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.962', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon5': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '60.000'} [2024-08-06 01:32:25,617][52658] DAMAGECOUNT value on done: 217143.0 [2024-08-06 01:32:25,618][52658] Sum rewards: 65.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:25,912][52670] DAMAGECOUNT value on done: 207365.0 [2024-08-06 01:32:25,920][52670] Sum rewards: 65.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:26,927][52666] DAMAGECOUNT value on done: 206484.0 [2024-08-06 01:32:26,929][52666] Sum rewards: 64.018, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon7': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO4': '0.197', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'weapon2': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '55.000'} [2024-08-06 01:32:26,983][52664] DAMAGECOUNT value on done: 218605.0 [2024-08-06 01:32:26,983][52664] Sum rewards: 53.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon5': '0.114', 'AMMO3': '0.178', 'WEAPON5': '0.300', 'AMMO4': '0.316', 'weapon2': '0.320', 'WEAPON4': '0.500', 'weapon4': '0.740', 'WEAPON3': '1.100', 'weapon3': '2.468', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '45.000'} [2024-08-06 01:32:27,302][52794] DAMAGECOUNT value on done: 213582.0 [2024-08-06 01:32:27,305][52794] Sum rewards: 53.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.342', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.110', 'weapon5': '0.148', 'AMMO3': '0.151', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.822', 'WEAPON3': '1.000', 'weapon3': '2.694', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.524', 'FRAGCOUNT': '43.000'} [2024-08-06 01:32:27,459][52647] DAMAGECOUNT value on done: 213847.0 [2024-08-06 01:32:27,460][52647] Sum rewards: 54.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.665', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.176', 'AMMO4': '0.227', 'weapon5': '0.282', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.678', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '46.000'} [2024-08-06 01:32:27,719][52650] Updated weights for policy 0, policy_version 31151 (0.0020) [2024-08-06 01:32:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 255188992. Throughput: 0: 4388.2. Samples: 63804630. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:32:27,794][52567] Avg episode reward: [(0, '62.573')] [2024-08-06 01:32:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031151_255188992.pth... [2024-08-06 01:32:27,860][52671] DAMAGECOUNT value on done: 216687.0 [2024-08-06 01:32:27,861][52671] Sum rewards: 59.797, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.855', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.255', 'AMMO3': '0.286', 'weapon2': '0.316', 'weapon4': '0.346', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2024-08-06 01:32:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030636_250970112.pth [2024-08-06 01:32:28,666][52670] DAMAGECOUNT value on done: 211180.0 [2024-08-06 01:32:28,668][52670] Sum rewards: 66.683, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.634', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO4': '0.225', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '58.000'} [2024-08-06 01:32:28,711][52658] DAMAGECOUNT value on done: 204084.0 [2024-08-06 01:32:28,714][52658] Sum rewards: 50.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.156', 'AMMO4': '0.223', 'weapon5': '0.238', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON4': '0.550', 'weapon4': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.138', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.819', 'FRAGCOUNT': '42.000'} [2024-08-06 01:32:29,639][52664] DAMAGECOUNT value on done: 216035.0 [2024-08-06 01:32:29,639][52664] Sum rewards: 55.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.584', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '2.802', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '48.000'} [2024-08-06 01:32:29,663][52666] DAMAGECOUNT value on done: 201820.0 [2024-08-06 01:32:29,663][52666] Sum rewards: 45.055, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.212', 'AMMO5': '0.011', 'AMMO2': '0.058', 'weapon4': '0.118', 'weapon5': '0.148', 'AMMO3': '0.291', 'AMMO4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.762', 'WEAPON3': '1.700', 'HITCOUNT': '2.640', 'weapon3': '2.658', 'DAMAGECOUNT': '12.588', 'FRAGCOUNT': '41.000'} [2024-08-06 01:32:30,052][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:32:30,207][52647] DAMAGECOUNT value on done: 220581.0 [2024-08-06 01:32:30,208][52647] Sum rewards: 46.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.231', 'weapon2': '0.370', 'weapon4': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '2.888', 'DAMAGECOUNT': '11.739', 'FRAGCOUNT': '43.000'} [2024-08-06 01:32:30,259][52794] DAMAGECOUNT value on done: 220427.0 [2024-08-06 01:32:30,261][52794] Sum rewards: 62.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.132', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:30,529][52671] DAMAGECOUNT value on done: 209270.0 [2024-08-06 01:32:30,530][52671] Sum rewards: 65.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.852', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.260', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:31,135][52658] DAMAGECOUNT value on done: 209103.0 [2024-08-06 01:32:31,135][52658] Sum rewards: 59.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.045', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.064', 'weapon5': '0.072', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'HITCOUNT': '3.100', 'weapon3': '3.410', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:31,494][52670] DAMAGECOUNT value on done: 206577.0 [2024-08-06 01:32:31,495][52670] Sum rewards: 67.113, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.091', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.432', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.180', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:32,202][52795] DAMAGECOUNT value on done: 194540.0 [2024-08-06 01:32:32,203][52795] Sum rewards: 56.717, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'weapon2': '0.494', 'weapon4': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.606', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:32,395][52666] DAMAGECOUNT value on done: 210119.0 [2024-08-06 01:32:32,395][52666] Sum rewards: 67.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.686', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.223', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.498', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:32,502][52650] Updated weights for policy 0, policy_version 31161 (0.0016) [2024-08-06 01:32:32,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 255270912. Throughput: 0: 4382.7. Samples: 63817420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:32:32,794][52567] Avg episode reward: [(0, '62.020')] [2024-08-06 01:32:32,900][52664] DAMAGECOUNT value on done: 217542.0 [2024-08-06 01:32:32,901][52664] Sum rewards: 67.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.440', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:33,198][52794] DAMAGECOUNT value on done: 213296.0 [2024-08-06 01:32:33,200][52794] Sum rewards: 51.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'weapon7': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.072', 'weapon5': '0.084', 'AMMO4': '0.137', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.010', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '42.000'} [2024-08-06 01:32:33,648][52671] DAMAGECOUNT value on done: 213063.0 [2024-08-06 01:32:33,650][52671] Sum rewards: 59.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.376', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.182', 'WEAPON7': '0.200', 'AMMO4': '0.219', 'AMMO3': '0.254', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.730', 'WEAPON3': '1.600', 'weapon3': '2.410', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:33,997][52658] DAMAGECOUNT value on done: 210737.0 [2024-08-06 01:32:33,997][52658] Sum rewards: 64.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.371', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.229', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:34,105][52670] DAMAGECOUNT value on done: 207844.0 [2024-08-06 01:32:34,106][52670] Sum rewards: 63.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.713', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.045', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.432', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.300', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:35,258][52795] DAMAGECOUNT value on done: 191964.0 [2024-08-06 01:32:35,258][52795] Sum rewards: 53.123, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.490', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.150', 'AMMO4': '0.198', 'weapon2': '0.256', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:35,343][52666] DAMAGECOUNT value on done: 208703.0 [2024-08-06 01:32:35,347][52666] Sum rewards: 43.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.473', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.148', 'AMMO3': '0.170', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.550', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.978', 'FRAGCOUNT': '39.000'} [2024-08-06 01:32:35,851][52664] DAMAGECOUNT value on done: 220472.0 [2024-08-06 01:32:35,851][52664] Sum rewards: 61.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.835', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.166', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.232', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:36,741][52658] DAMAGECOUNT value on done: 205358.0 [2024-08-06 01:32:36,741][52658] Sum rewards: 53.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.948', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.179', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '46.000'} [2024-08-06 01:32:36,778][52671] DAMAGECOUNT value on done: 208475.0 [2024-08-06 01:32:36,778][52671] Sum rewards: 68.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.240', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.166', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '55.000'} [2024-08-06 01:32:36,938][52650] Updated weights for policy 0, policy_version 31171 (0.0031) [2024-08-06 01:32:37,476][52670] DAMAGECOUNT value on done: 209526.0 [2024-08-06 01:32:37,479][52670] Sum rewards: 62.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.370', 'weapon4': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '50.000'} [2024-08-06 01:32:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 255361024. Throughput: 0: 4386.2. Samples: 63843780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:32:37,795][52567] Avg episode reward: [(0, '61.946')] [2024-08-06 01:32:38,408][52795] DAMAGECOUNT value on done: 190605.0 [2024-08-06 01:32:38,408][52795] Sum rewards: 60.666, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.439', 'ARMOR': '0.004', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.164', 'weapon2': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:38,607][52666] DAMAGECOUNT value on done: 209019.0 [2024-08-06 01:32:38,608][52666] Sum rewards: 62.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.042', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.037', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.346', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:39,095][52664] DAMAGECOUNT value on done: 223853.0 [2024-08-06 01:32:39,095][52664] Sum rewards: 70.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.396', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.170', 'weapon5': '0.220', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.494', 'weapon4': '0.608', 'WEAPON3': '0.950', 'weapon3': '2.398', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:39,475][52671] DAMAGECOUNT value on done: 213776.0 [2024-08-06 01:32:39,476][52671] Sum rewards: 68.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.284', 'AMMO5': '0.003', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.330', 'weapon4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:39,711][52658] DAMAGECOUNT value on done: 209786.0 [2024-08-06 01:32:39,714][52658] Sum rewards: 58.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.406', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.178', 'AMMO3': '0.223', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.878', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '51.000'} [2024-08-06 01:32:40,432][52670] DAMAGECOUNT value on done: 209548.0 [2024-08-06 01:32:40,434][52670] Sum rewards: 53.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.638', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.154', 'AMMO3': '0.177', 'AMMO4': '0.238', 'weapon2': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.728', 'WEAPON3': '1.050', 'weapon3': '2.552', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '46.000'} [2024-08-06 01:32:41,364][52666] DAMAGECOUNT value on done: 207987.0 [2024-08-06 01:32:41,364][52666] Sum rewards: 60.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.205', 'AMMO5': '0.003', 'AMMO2': '0.044', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:41,447][52795] DAMAGECOUNT value on done: 192737.0 [2024-08-06 01:32:41,448][52795] Sum rewards: 45.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.134', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.165', 'AMMO4': '0.181', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.434', 'weapon2': '0.738', 'WEAPON3': '0.950', 'weapon3': '2.378', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '36.500'} [2024-08-06 01:32:41,849][52650] Updated weights for policy 0, policy_version 31181 (0.0016) [2024-08-06 01:32:41,979][52664] DAMAGECOUNT value on done: 211838.0 [2024-08-06 01:32:41,980][52664] Sum rewards: 57.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.772', 'AMMO5': '0.010', 'AMMO2': '0.023', 'ARMOR': '0.024', 'AMMO4': '0.116', 'weapon5': '0.154', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'weapon4': '0.382', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.002', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '46.000'} [2024-08-06 01:32:42,178][52671] DAMAGECOUNT value on done: 212118.0 [2024-08-06 01:32:42,179][52671] Sum rewards: 56.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.228', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.222', 'AMMO3': '0.272', 'weapon5': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.698', 'WEAPON3': '1.600', 'weapon3': '2.466', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '51.000'} [2024-08-06 01:32:42,729][52658] DAMAGECOUNT value on done: 214957.0 [2024-08-06 01:32:42,731][52658] Sum rewards: 52.071, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.762', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.094', 'weapon5': '0.106', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.700', 'weapon3': '3.004', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '48.000'} [2024-08-06 01:32:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 255451136. Throughput: 0: 4397.6. Samples: 63870280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:32:42,794][52567] Avg episode reward: [(0, '61.637')] [2024-08-06 01:32:42,843][52670] DAMAGECOUNT value on done: 205179.0 [2024-08-06 01:32:42,843][52670] Sum rewards: 61.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO3': '0.173', 'AMMO4': '0.174', 'weapon4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '53.500'} [2024-08-06 01:32:43,651][52666] DAMAGECOUNT value on done: 206142.0 [2024-08-06 01:32:43,651][52666] Sum rewards: 55.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.086', 'AMMO4': '0.160', 'weapon4': '0.162', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '47.000'} [2024-08-06 01:32:44,432][52664] DAMAGECOUNT value on done: 225900.0 [2024-08-06 01:32:44,433][52664] Sum rewards: 53.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.104', 'AMMO3': '0.139', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.490', 'weapon3': '2.862', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '45.000'} [2024-08-06 01:32:44,547][52795] DAMAGECOUNT value on done: 196765.0 [2024-08-06 01:32:44,548][52795] Sum rewards: 62.476, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.020', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.166', 'weapon4': '0.216', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '3.034', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:44,933][52671] DAMAGECOUNT value on done: 213967.0 [2024-08-06 01:32:44,934][52671] Sum rewards: 67.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.609', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.075', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.318', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:45,638][52658] DAMAGECOUNT value on done: 207169.0 [2024-08-06 01:32:45,639][52658] Sum rewards: 45.104, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.746', 'AMMO5': '0.012', 'AMMO2': '0.063', 'weapon5': '0.202', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'AMMO4': '0.316', 'weapon2': '0.316', 'WEAPON4': '0.600', 'weapon4': '0.636', 'WEAPON3': '1.250', 'weapon3': '2.514', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '39.000'} [2024-08-06 01:32:45,662][52670] DAMAGECOUNT value on done: 208564.0 [2024-08-06 01:32:45,663][52670] Sum rewards: 65.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.193', 'weapon2': '0.224', 'weapon4': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:46,551][52650] Updated weights for policy 0, policy_version 31191 (0.0019) [2024-08-06 01:32:46,649][52666] DAMAGECOUNT value on done: 203737.0 [2024-08-06 01:32:46,651][52666] Sum rewards: 67.821, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.430', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:47,271][52664] DAMAGECOUNT value on done: 220927.0 [2024-08-06 01:32:47,273][52664] Sum rewards: 57.045, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.054', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon5': '0.020', 'weapon4': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.492', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.194', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '51.000'} [2024-08-06 01:32:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 255533056. Throughput: 0: 4393.7. Samples: 63883360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:32:47,795][52567] Avg episode reward: [(0, '61.274')] [2024-08-06 01:32:47,853][52795] DAMAGECOUNT value on done: 194711.0 [2024-08-06 01:32:47,854][52795] Sum rewards: 57.876, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.746', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.180', 'weapon5': '0.214', 'AMMO4': '0.268', 'weapon2': '0.442', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.528', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:47,930][52671] DAMAGECOUNT value on done: 214902.0 [2024-08-06 01:32:47,932][52671] Sum rewards: 68.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.002', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.172', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:48,261][52670] DAMAGECOUNT value on done: 205898.0 [2024-08-06 01:32:48,263][52670] Sum rewards: 66.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:48,549][52658] DAMAGECOUNT value on done: 209768.0 [2024-08-06 01:32:48,549][52658] Sum rewards: 63.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.452', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.180', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '50.000'} [2024-08-06 01:32:49,266][52666] DAMAGECOUNT value on done: 212599.0 [2024-08-06 01:32:49,266][52666] Sum rewards: 73.797, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.115', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.010', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.177', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.366', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '59.000'} [2024-08-06 01:32:50,062][52664] DAMAGECOUNT value on done: 222436.0 [2024-08-06 01:32:50,063][52664] Sum rewards: 72.008, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.725', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.102', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '59.000'} [2024-08-06 01:32:50,975][52795] DAMAGECOUNT value on done: 199054.0 [2024-08-06 01:32:50,977][52795] Sum rewards: 57.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.655', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.236', 'weapon4': '0.244', 'weapon5': '0.330', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:51,108][52671] DAMAGECOUNT value on done: 210128.0 [2024-08-06 01:32:51,110][52671] Sum rewards: 55.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.106', 'weapon7': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.414', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '48.000'} [2024-08-06 01:32:51,116][52650] Updated weights for policy 0, policy_version 31201 (0.0021) [2024-08-06 01:32:51,144][52658] DAMAGECOUNT value on done: 213561.0 [2024-08-06 01:32:51,146][52658] Sum rewards: 55.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.504', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.044', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.402', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '46.000'} [2024-08-06 01:32:51,236][52670] DAMAGECOUNT value on done: 201251.0 [2024-08-06 01:32:51,236][52670] Sum rewards: 66.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.352', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.209', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '54.000'} [2024-08-06 01:32:52,398][52666] DAMAGECOUNT value on done: 211856.0 [2024-08-06 01:32:52,399][52666] Sum rewards: 60.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.676', 'WEAPON3': '0.950', 'weapon3': '2.856', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '49.000'} [2024-08-06 01:32:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 255623168. Throughput: 0: 4397.3. Samples: 63909880. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 01:32:52,794][52567] Avg episode reward: [(0, '61.059')] [2024-08-06 01:32:53,275][52664] DAMAGECOUNT value on done: 217680.0 [2024-08-06 01:32:53,275][52664] Sum rewards: 70.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '59.000'} [2024-08-06 01:32:53,506][52663] DAMAGECOUNT value on done: 212721.0 [2024-08-06 01:32:53,507][52663] Sum rewards: 59.190, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.274', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon2': '0.182', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.444', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:53,880][52671] DAMAGECOUNT value on done: 213950.0 [2024-08-06 01:32:53,883][52671] Sum rewards: 68.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.055', 'weapon5': '0.150', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'AMMO4': '0.277', 'weapon2': '0.290', 'WEAPON4': '0.500', 'weapon4': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:54,070][52795] DAMAGECOUNT value on done: 196860.0 [2024-08-06 01:32:54,070][52795] Sum rewards: 58.629, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.178', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.307', 'weapon4': '0.384', 'weapon2': '0.408', 'WEAPON3': '1.750', 'weapon3': '2.826', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 01:32:54,296][52670] DAMAGECOUNT value on done: 212278.0 [2024-08-06 01:32:54,298][52670] Sum rewards: 64.361, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon2': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.300', 'weapon4': '0.392', 'WEAPON3': '1.750', 'weapon3': '3.072', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:55,254][52666] DAMAGECOUNT value on done: 204964.0 [2024-08-06 01:32:55,254][52666] Sum rewards: 67.444, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon4': '0.220', 'AMMO3': '0.232', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '57.000'} [2024-08-06 01:32:55,620][52664] DAMAGECOUNT value on done: 217525.0 [2024-08-06 01:32:55,622][52664] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.975', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.282', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '56.500'} [2024-08-06 01:32:55,798][52650] Updated weights for policy 0, policy_version 31211 (0.0023) [2024-08-06 01:32:56,052][52663] DAMAGECOUNT value on done: 210954.0 [2024-08-06 01:32:56,054][52663] Sum rewards: 65.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.347', 'AMMO5': '0.003', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.526', 'weapon2': '0.556', 'WEAPON3': '0.900', 'weapon3': '2.758', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '52.000'} [2024-08-06 01:32:56,823][52670] DAMAGECOUNT value on done: 210678.0 [2024-08-06 01:32:56,824][52670] Sum rewards: 52.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.656', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.454', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '43.500'} [2024-08-06 01:32:56,978][52671] DAMAGECOUNT value on done: 213653.0 [2024-08-06 01:32:56,981][52671] Sum rewards: 70.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.808', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.088', 'weapon5': '0.104', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '61.000'} [2024-08-06 01:32:57,194][52795] DAMAGECOUNT value on done: 192427.0 [2024-08-06 01:32:57,196][52795] Sum rewards: 58.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.108', 'weapon5': '0.122', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.244', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '50.000'} [2024-08-06 01:32:57,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 255713280. Throughput: 0: 4398.2. Samples: 63936300. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 01:32:57,794][52567] Avg episode reward: [(0, '61.217')] [2024-08-06 01:32:58,035][52666] DAMAGECOUNT value on done: 208099.0 [2024-08-06 01:32:58,044][52666] Sum rewards: 67.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.188', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.121', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.244', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '59.000'} [2024-08-06 01:32:58,469][52664] DAMAGECOUNT value on done: 218616.0 [2024-08-06 01:32:58,469][52664] Sum rewards: 62.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.161', 'weapon5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:58,564][52649] DAMAGECOUNT value on done: 205348.0 [2024-08-06 01:32:58,564][52649] Sum rewards: 67.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.464', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.242', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '58.000'} [2024-08-06 01:32:59,042][52663] DAMAGECOUNT value on done: 207615.0 [2024-08-06 01:32:59,044][52663] Sum rewards: 59.492, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.135', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon7': '0.072', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.572', 'WEAPON3': '1.500', 'weapon3': '2.578', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '53.000'} [2024-08-06 01:32:59,888][52670] DAMAGECOUNT value on done: 208317.0 [2024-08-06 01:32:59,890][52670] Sum rewards: 48.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.514', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.232', 'weapon2': '0.630', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.778', 'DAMAGECOUNT': '11.325', 'FRAGCOUNT': '43.000'} [2024-08-06 01:32:59,911][52671] DAMAGECOUNT value on done: 209552.0 [2024-08-06 01:32:59,912][52671] Sum rewards: 68.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.640', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 01:33:00,294][52795] DAMAGECOUNT value on done: 197606.0 [2024-08-06 01:33:00,294][52795] Sum rewards: 59.466, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.150', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.173', 'weapon4': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '53.000'} [2024-08-06 01:33:00,569][52650] Updated weights for policy 0, policy_version 31221 (0.0011) [2024-08-06 01:33:01,100][52666] DAMAGECOUNT value on done: 206944.0 [2024-08-06 01:33:01,100][52666] Sum rewards: 58.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.278', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.191', 'weapon4': '0.228', 'weapon2': '0.254', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.224', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:01,580][52663] DAMAGECOUNT value on done: 211424.0 [2024-08-06 01:33:01,580][52663] Sum rewards: 52.942, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.166', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.672', 'weapon4': '0.716', 'WEAPON3': '1.650', 'weapon3': '2.354', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '47.000'} [2024-08-06 01:33:01,678][52649] DAMAGECOUNT value on done: 200675.0 [2024-08-06 01:33:01,678][52649] Sum rewards: 53.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.945', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.102', 'AMMO3': '0.192', 'weapon5': '0.226', 'AMMO4': '0.241', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.624', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '2.808', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:01,742][52659] DAMAGECOUNT value on done: 211952.0 [2024-08-06 01:33:01,743][52659] Sum rewards: 59.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.037', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.120', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:01,752][52664] DAMAGECOUNT value on done: 220847.0 [2024-08-06 01:33:01,752][52664] Sum rewards: 56.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.657', 'AMMO5': '0.014', 'AMMO2': '0.051', 'AMMO3': '0.192', 'weapon5': '0.236', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.500', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '47.000'} [2024-08-06 01:33:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 255803392. Throughput: 0: 4394.0. Samples: 63949380. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 01:33:02,795][52567] Avg episode reward: [(0, '60.863')] [2024-08-06 01:33:02,896][52671] DAMAGECOUNT value on done: 219492.0 [2024-08-06 01:33:02,896][52671] Sum rewards: 61.249, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.132', 'AMMO5': '0.008', 'weapon5': '0.022', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.179', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '52.500'} [2024-08-06 01:33:02,980][52670] DAMAGECOUNT value on done: 210934.0 [2024-08-06 01:33:02,980][52670] Sum rewards: 51.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '2.976', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '46.000'} [2024-08-06 01:33:03,407][52795] DAMAGECOUNT value on done: 195258.0 [2024-08-06 01:33:03,407][52795] Sum rewards: 67.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon2': '0.176', 'AMMO3': '0.232', 'weapon4': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:04,096][52666] DAMAGECOUNT value on done: 212690.0 [2024-08-06 01:33:04,097][52666] Sum rewards: 60.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.352', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.229', 'weapon5': '0.240', 'AMMO4': '0.265', 'weapon2': '0.306', 'WEAPON5': '0.450', 'weapon4': '0.456', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.620', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '53.000'} [2024-08-06 01:33:04,333][52663] DAMAGECOUNT value on done: 209115.0 [2024-08-06 01:33:04,335][52663] Sum rewards: 62.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.815', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.408', 'WEAPON4': '0.500', 'weapon4': '0.916', 'WEAPON3': '1.250', 'weapon3': '2.308', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:04,346][52664] DAMAGECOUNT value on done: 216230.0 [2024-08-06 01:33:04,346][52664] Sum rewards: 57.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.462', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.062', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'weapon4': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.722', 'WEAPON3': '0.850', 'weapon3': '2.660', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '46.000'} [2024-08-06 01:33:04,664][52649] DAMAGECOUNT value on done: 206651.0 [2024-08-06 01:33:04,664][52649] Sum rewards: 63.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.162', 'weapon4': '0.168', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.712', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:04,833][52659] DAMAGECOUNT value on done: 210158.0 [2024-08-06 01:33:04,834][52659] Sum rewards: 63.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.128', 'weapon5': '0.162', 'AMMO3': '0.180', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.902', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '51.000'} [2024-08-06 01:33:05,145][52650] Updated weights for policy 0, policy_version 31231 (0.0014) [2024-08-06 01:33:05,663][52671] DAMAGECOUNT value on done: 212069.0 [2024-08-06 01:33:05,665][52671] Sum rewards: 60.813, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.065', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'AMMO4': '0.167', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.842', 'WEAPON3': '1.050', 'weapon3': '2.610', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:05,760][52670] DAMAGECOUNT value on done: 213112.0 [2024-08-06 01:33:05,761][52670] Sum rewards: 68.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.094', 'weapon5': '0.124', 'weapon2': '0.238', 'AMMO4': '0.242', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.362', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:06,489][52795] DAMAGECOUNT value on done: 192238.0 [2024-08-06 01:33:06,492][52795] Sum rewards: 70.941, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.375', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.208', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '61.000'} [2024-08-06 01:33:06,779][52663] DAMAGECOUNT value on done: 214300.0 [2024-08-06 01:33:06,781][52663] Sum rewards: 54.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.869', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.199', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.676', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '49.000'} [2024-08-06 01:33:07,082][52666] DAMAGECOUNT value on done: 205661.0 [2024-08-06 01:33:07,082][52666] Sum rewards: 55.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.996', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.432', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.636', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '47.000'} [2024-08-06 01:33:07,240][52649] DAMAGECOUNT value on done: 205356.0 [2024-08-06 01:33:07,241][52649] Sum rewards: 67.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.144', 'AMMO4': '0.164', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '56.000'} [2024-08-06 01:33:07,446][52664] DAMAGECOUNT value on done: 220788.0 [2024-08-06 01:33:07,448][52664] Sum rewards: 57.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.784', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon7': '0.062', 'weapon5': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.155', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.550', 'weapon2': '0.618', 'weapon4': '0.764', 'WEAPON3': '0.950', 'weapon3': '2.178', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '47.000'} [2024-08-06 01:33:07,451][52659] DAMAGECOUNT value on done: 211170.0 [2024-08-06 01:33:07,452][52659] Sum rewards: 51.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.389', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.146', 'AMMO3': '0.161', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.474', 'weapon4': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.560', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '42.000'} [2024-08-06 01:33:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 255893504. Throughput: 0: 4390.7. Samples: 63975800. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 01:33:07,794][52567] Avg episode reward: [(0, '60.564')] [2024-08-06 01:33:08,264][52671] DAMAGECOUNT value on done: 206460.0 [2024-08-06 01:33:08,266][52671] Sum rewards: 69.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:08,584][52670] DAMAGECOUNT value on done: 200006.0 [2024-08-06 01:33:08,585][52670] Sum rewards: 55.684, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.022', 'HEALTH': '0.030', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon5': '0.248', 'weapon2': '0.302', 'weapon4': '0.420', 'WEAPON3': '0.950', 'weapon3': '2.610', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '45.000'} [2024-08-06 01:33:09,528][52795] DAMAGECOUNT value on done: 191682.0 [2024-08-06 01:33:09,529][52795] Sum rewards: 48.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.148', 'weapon5': '0.194', 'AMMO4': '0.252', 'WEAPON5': '0.450', 'weapon2': '0.458', 'weapon4': '0.490', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.554', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '42.500'} [2024-08-06 01:33:09,578][52663] DAMAGECOUNT value on done: 211159.0 [2024-08-06 01:33:09,579][52663] Sum rewards: 69.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.233', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon4': '0.104', 'weapon5': '0.146', 'AMMO4': '0.159', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:09,633][52666] DAMAGECOUNT value on done: 206976.0 [2024-08-06 01:33:09,637][52666] Sum rewards: 67.938, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.484', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon5': '0.100', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.464', 'WEAPON3': '0.900', 'HITCOUNT': '3.200', 'weapon3': '3.306', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:09,658][52649] DAMAGECOUNT value on done: 198867.0 [2024-08-06 01:33:09,658][52649] Sum rewards: 63.830, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.578', 'AMMO5': '0.017', 'AMMO2': '0.074', 'weapon5': '0.148', 'AMMO3': '0.263', 'weapon2': '0.358', 'AMMO4': '0.370', 'WEAPON5': '0.500', 'weapon4': '0.644', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.464', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:09,801][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:33:09,976][52650] Updated weights for policy 0, policy_version 31241 (0.0013) [2024-08-06 01:33:10,052][52659] DAMAGECOUNT value on done: 211118.0 [2024-08-06 01:33:10,052][52659] Sum rewards: 67.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.195', 'AMMO5': '0.003', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.171', 'AMMO4': '0.247', 'weapon4': '0.340', 'WEAPON4': '0.500', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.788', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:10,641][52664] DAMAGECOUNT value on done: 222206.0 [2024-08-06 01:33:10,641][52664] Sum rewards: 63.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.099', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.262', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.206', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:10,951][52671] DAMAGECOUNT value on done: 214871.0 [2024-08-06 01:33:10,951][52671] Sum rewards: 58.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.525', 'AMMO5': '0.004', 'AMMO2': '0.006', 'weapon4': '0.010', 'weapon5': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.662', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '3.172', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:11,621][52670] DAMAGECOUNT value on done: 210901.0 [2024-08-06 01:33:11,623][52670] Sum rewards: 50.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.667', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.006', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '45.500'} [2024-08-06 01:33:12,163][52663] DAMAGECOUNT value on done: 211079.0 [2024-08-06 01:33:12,164][52663] Sum rewards: 56.874, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.425', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.222', 'weapon2': '0.552', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.020', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:12,343][52649] DAMAGECOUNT value on done: 205735.0 [2024-08-06 01:33:12,344][52649] Sum rewards: 70.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon4': '0.162', 'AMMO3': '0.218', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '60.000'} [2024-08-06 01:33:12,576][52795] DAMAGECOUNT value on done: 196672.0 [2024-08-06 01:33:12,579][52795] Sum rewards: 64.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 255975424. Throughput: 0: 4395.8. Samples: 64002440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:33:12,795][52567] Avg episode reward: [(0, '61.107')] [2024-08-06 01:33:13,027][52659] DAMAGECOUNT value on done: 210342.0 [2024-08-06 01:33:13,028][52659] Sum rewards: 49.246, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-5.000', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon5': '0.240', 'weapon4': '0.264', 'AMMO4': '0.285', 'AMMO3': '0.294', 'WEAPON5': '0.450', 'weapon2': '0.516', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.652', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:13,674][52664] DAMAGECOUNT value on done: 218061.0 [2024-08-06 01:33:13,674][52664] Sum rewards: 64.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:13,954][52671] DAMAGECOUNT value on done: 213969.0 [2024-08-06 01:33:13,955][52671] Sum rewards: 63.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.914', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.060', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon2': '0.190', 'weapon4': '0.212', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.318', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:14,148][52650] Updated weights for policy 0, policy_version 31251 (0.0016) [2024-08-06 01:33:14,594][52670] DAMAGECOUNT value on done: 214402.0 [2024-08-06 01:33:14,595][52670] Sum rewards: 64.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.177', 'weapon5': '0.182', 'weapon4': '0.230', 'AMMO4': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:15,051][52663] DAMAGECOUNT value on done: 210072.0 [2024-08-06 01:33:15,053][52663] Sum rewards: 68.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.785', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.237', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:15,073][52649] DAMAGECOUNT value on done: 202996.0 [2024-08-06 01:33:15,073][52649] Sum rewards: 53.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.114', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.470', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '44.500'} [2024-08-06 01:33:15,650][52795] DAMAGECOUNT value on done: 188910.0 [2024-08-06 01:33:15,650][52795] Sum rewards: 62.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.710', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'weapon5': '0.082', 'AMMO4': '0.119', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.312', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.500'} [2024-08-06 01:33:16,214][52659] DAMAGECOUNT value on done: 209324.0 [2024-08-06 01:33:16,215][52659] Sum rewards: 66.607, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.957', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.033', 'weapon5': '0.056', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.280', 'weapon2': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.278', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:16,266][52664] DAMAGECOUNT value on done: 220462.0 [2024-08-06 01:33:16,266][52664] Sum rewards: 67.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.448', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.066', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '55.000'} [2024-08-06 01:33:17,055][52671] DAMAGECOUNT value on done: 216242.0 [2024-08-06 01:33:17,057][52671] Sum rewards: 72.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.104', 'weapon4': '0.138', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '62.000'} [2024-08-06 01:33:17,498][52670] DAMAGECOUNT value on done: 209767.0 [2024-08-06 01:33:17,501][52670] Sum rewards: 59.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.175', 'weapon4': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.210', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 256057344. Throughput: 0: 4400.0. Samples: 64015420. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:33:17,794][52567] Avg episode reward: [(0, '61.178')] [2024-08-06 01:33:17,832][52649] DAMAGECOUNT value on done: 210561.0 [2024-08-06 01:33:17,832][52649] Sum rewards: 59.282, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.512', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.217', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.396', 'WEAPON3': '1.700', 'weapon3': '2.866', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:17,920][52663] DAMAGECOUNT value on done: 212048.0 [2024-08-06 01:33:17,921][52663] Sum rewards: 59.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:18,856][52659] DAMAGECOUNT value on done: 210157.0 [2024-08-06 01:33:18,865][52659] Sum rewards: 56.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.404', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.106', 'AMMO4': '0.200', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.998', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '49.500'} [2024-08-06 01:33:18,897][52614] Signal inference workers to stop experience collection... (5700 times) [2024-08-06 01:33:18,898][52614] Signal inference workers to resume experience collection... (5700 times) [2024-08-06 01:33:18,946][52795] DAMAGECOUNT value on done: 200709.0 [2024-08-06 01:33:18,948][52795] Sum rewards: 68.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.136', 'AMMO4': '0.158', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.844', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '56.000'} [2024-08-06 01:33:18,980][52650] InferenceWorker_p0-w0: stopping experience collection (5700 times) [2024-08-06 01:33:18,992][52650] InferenceWorker_p0-w0: resuming experience collection (5700 times) [2024-08-06 01:33:18,993][52650] Updated weights for policy 0, policy_version 31261 (0.0024) [2024-08-06 01:33:19,789][52671] DAMAGECOUNT value on done: 214927.0 [2024-08-06 01:33:19,789][52671] Sum rewards: 73.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.422', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.088', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.314', 'weapon4': '0.384', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '60.000'} [2024-08-06 01:33:20,648][52649] DAMAGECOUNT value on done: 205608.0 [2024-08-06 01:33:20,648][52649] Sum rewards: 61.722, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.204', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.132', 'weapon4': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.600', 'weapon3': '2.782', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:20,672][52670] DAMAGECOUNT value on done: 210905.0 [2024-08-06 01:33:20,672][52670] Sum rewards: 59.492, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.062', 'weapon5': '0.152', 'weapon4': '0.172', 'AMMO3': '0.209', 'AMMO4': '0.311', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '52.500'} [2024-08-06 01:33:20,809][52663] DAMAGECOUNT value on done: 213904.0 [2024-08-06 01:33:20,810][52663] Sum rewards: 61.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.834', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.132', 'AMMO4': '0.202', 'AMMO3': '0.236', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:21,674][52659] DAMAGECOUNT value on done: 206680.0 [2024-08-06 01:33:21,674][52659] Sum rewards: 60.338, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.062', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'weapon4': '0.198', 'AMMO3': '0.302', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.700', 'weapon3': '2.916', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '54.500'} [2024-08-06 01:33:22,117][52795] DAMAGECOUNT value on done: 199511.0 [2024-08-06 01:33:22,119][52795] Sum rewards: 51.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.532', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.180', 'AMMO3': '0.200', 'weapon4': '0.238', 'AMMO4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.792', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '45.000'} [2024-08-06 01:33:22,467][52671] DAMAGECOUNT value on done: 211515.0 [2024-08-06 01:33:22,467][52671] Sum rewards: 68.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.088', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'AMMO4': '0.269', 'weapon2': '0.366', 'weapon4': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '59.000'} [2024-08-06 01:33:22,643][52803] DAMAGECOUNT value on done: 197377.0 [2024-08-06 01:33:22,643][52803] Sum rewards: 55.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'weapon4': '0.234', 'AMMO3': '0.235', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.248', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '49.000'} [2024-08-06 01:33:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 256147456. Throughput: 0: 4392.0. Samples: 64041420. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:33:22,795][52567] Avg episode reward: [(0, '61.359')] [2024-08-06 01:33:23,420][52649] DAMAGECOUNT value on done: 207068.0 [2024-08-06 01:33:23,422][52649] Sum rewards: 67.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.332', 'WEAPON4': '0.650', 'weapon4': '1.098', 'WEAPON3': '1.250', 'weapon3': '2.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '59.000'} [2024-08-06 01:33:23,818][52663] DAMAGECOUNT value on done: 212073.0 [2024-08-06 01:33:23,820][52663] Sum rewards: 64.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.568', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.132', 'weapon5': '0.148', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.880', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:23,963][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:33:24,078][52650] Updated weights for policy 0, policy_version 31271 (0.0012) [2024-08-06 01:33:24,679][52659] DAMAGECOUNT value on done: 216190.0 [2024-08-06 01:33:24,680][52659] Sum rewards: 67.561, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.346', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.204', 'AMMO4': '0.229', 'weapon4': '0.254', 'AMMO3': '0.271', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.856', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '60.000'} [2024-08-06 01:33:24,698][52665] DAMAGECOUNT value on done: 208870.0 [2024-08-06 01:33:24,699][52665] Sum rewards: 58.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.844', 'AMMO5': '0.006', 'AMMO2': '0.061', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon4': '0.298', 'AMMO4': '0.304', 'weapon2': '0.316', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.080', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '51.000'} [2024-08-06 01:33:25,312][52795] DAMAGECOUNT value on done: 188503.0 [2024-08-06 01:33:25,314][52795] Sum rewards: 60.008, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.873', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO4': '0.179', 'AMMO3': '0.256', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.468', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '55.000'} [2024-08-06 01:33:25,387][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:33:25,667][52803] DAMAGECOUNT value on done: 199034.0 [2024-08-06 01:33:25,669][52803] Sum rewards: 55.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.188', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.044', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.264', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '47.000'} [2024-08-06 01:33:26,402][52649] DAMAGECOUNT value on done: 207211.0 [2024-08-06 01:33:26,402][52649] Sum rewards: 59.659, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.596', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.092', 'AMMO4': '0.109', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.190', 'WEAPON3': '0.850', 'weapon2': '0.854', 'weapon3': '2.734', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:26,981][52663] DAMAGECOUNT value on done: 204771.0 [2024-08-06 01:33:26,982][52663] Sum rewards: 49.987, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.270', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.194', 'AMMO4': '0.243', 'weapon4': '0.294', 'AMMO3': '0.319', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON4': '0.600', 'WEAPON3': '1.900', 'weapon3': '2.688', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:27,477][52659] DAMAGECOUNT value on done: 217058.0 [2024-08-06 01:33:27,478][52659] Sum rewards: 64.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.280', 'weapon4': '0.358', 'ARMOR': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.810', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:27,697][52665] DAMAGECOUNT value on done: 212831.0 [2024-08-06 01:33:27,697][52665] Sum rewards: 63.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.418', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.206', 'weapon2': '0.518', 'WEAPON3': '0.900', 'HITCOUNT': '2.990', 'weapon3': '3.006', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:27,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17605.8). Total num frames: 256237568. Throughput: 0: 4388.2. Samples: 64067750. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:33:27,795][52567] Avg episode reward: [(0, '61.760')] [2024-08-06 01:33:28,414][52650] Updated weights for policy 0, policy_version 31281 (0.0020) [2024-08-06 01:33:28,424][52795] DAMAGECOUNT value on done: 201881.0 [2024-08-06 01:33:28,424][52795] Sum rewards: 66.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.337', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.130', 'weapon5': '0.146', 'AMMO4': '0.189', 'AMMO3': '0.191', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.684', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:28,932][52803] DAMAGECOUNT value on done: 195407.0 [2024-08-06 01:33:28,934][52803] Sum rewards: 59.484, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.768', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO3': '0.128', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '0.850', 'HITCOUNT': '2.910', 'weapon3': '2.924', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '47.000'} [2024-08-06 01:33:28,995][52659] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:33:29,476][52649] DAMAGECOUNT value on done: 204539.0 [2024-08-06 01:33:29,478][52649] Sum rewards: 66.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.170', 'AMMO3': '0.230', 'weapon2': '0.258', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.846', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '56.000'} [2024-08-06 01:33:30,218][52663] DAMAGECOUNT value on done: 204069.0 [2024-08-06 01:33:30,218][52663] Sum rewards: 67.723, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.003', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.091', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.396', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.880', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '53.000'} [2024-08-06 01:33:30,341][52659] DAMAGECOUNT value on done: 210336.0 [2024-08-06 01:33:30,341][52659] Sum rewards: 58.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.078', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.650', 'weapon3': '3.164', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:30,445][52811] DAMAGECOUNT value on done: 207387.0 [2024-08-06 01:33:30,445][52811] Sum rewards: 67.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.222', 'WEAPON4': '0.400', 'weapon2': '0.418', 'weapon4': '0.648', 'WEAPON3': '1.300', 'weapon3': '2.630', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:30,492][52665] DAMAGECOUNT value on done: 209086.0 [2024-08-06 01:33:30,493][52665] Sum rewards: 59.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.315', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.068', 'AMMO4': '0.114', 'weapon5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '49.500'} [2024-08-06 01:33:31,589][52795] DAMAGECOUNT value on done: 200835.0 [2024-08-06 01:33:31,591][52795] Sum rewards: 56.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.209', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:31,969][52803] DAMAGECOUNT value on done: 197931.0 [2024-08-06 01:33:31,970][52803] Sum rewards: 63.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.830', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.236', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.520', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '55.000'} [2024-08-06 01:33:32,521][52649] DAMAGECOUNT value on done: 208012.0 [2024-08-06 01:33:32,521][52649] Sum rewards: 53.373, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.701', 'AMMO5': '0.025', 'AMMO2': '0.080', 'weapon5': '0.208', 'weapon4': '0.238', 'AMMO3': '0.275', 'AMMO4': '0.398', 'weapon2': '0.414', 'WEAPON5': '0.650', 'WEAPON4': '0.850', 'WEAPON3': '1.650', 'weapon3': '2.802', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '51.000'} [2024-08-06 01:33:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 256327680. Throughput: 0: 4393.4. Samples: 64081060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:33:32,794][52567] Avg episode reward: [(0, '61.573')] [2024-08-06 01:33:32,897][52663] DAMAGECOUNT value on done: 211597.0 [2024-08-06 01:33:32,898][52663] Sum rewards: 61.211, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.700', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '53.000'} [2024-08-06 01:33:33,144][52650] Updated weights for policy 0, policy_version 31291 (0.0012) [2024-08-06 01:33:33,180][52659] DAMAGECOUNT value on done: 208978.0 [2024-08-06 01:33:33,182][52659] Sum rewards: 63.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.736', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.171', 'weapon4': '0.366', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:33,309][52665] DAMAGECOUNT value on done: 206403.0 [2024-08-06 01:33:33,310][52665] Sum rewards: 62.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.083', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '51.000'} [2024-08-06 01:33:33,545][52811] DAMAGECOUNT value on done: 194834.0 [2024-08-06 01:33:33,545][52811] Sum rewards: 79.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.238', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.164', 'weapon4': '0.224', 'weapon2': '0.246', 'WEAPON3': '1.000', 'weapon3': '3.342', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '63.000'} [2024-08-06 01:33:35,058][52803] DAMAGECOUNT value on done: 200505.0 [2024-08-06 01:33:35,066][52803] Sum rewards: 53.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.237', 'weapon5': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'weapon4': '0.216', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.166', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '46.000'} [2024-08-06 01:33:35,352][52649] DAMAGECOUNT value on done: 208660.0 [2024-08-06 01:33:35,353][52649] Sum rewards: 61.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.066', 'weapon4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.193', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.000'} [2024-08-06 01:33:35,950][52665] DAMAGECOUNT value on done: 205313.0 [2024-08-06 01:33:35,950][52665] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.074', 'AMMO5': '0.010', 'AMMO2': '0.061', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.305', 'weapon2': '0.398', 'weapon4': '0.440', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:35,995][52663] DAMAGECOUNT value on done: 212640.0 [2024-08-06 01:33:35,997][52663] Sum rewards: 64.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon2': '0.216', 'weapon4': '0.252', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:36,107][52659] DAMAGECOUNT value on done: 205686.0 [2024-08-06 01:33:36,107][52659] Sum rewards: 60.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.491', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.118', 'AMMO3': '0.257', 'weapon2': '0.330', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.330', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '53.000'} [2024-08-06 01:33:36,524][52811] DAMAGECOUNT value on done: 199269.0 [2024-08-06 01:33:36,525][52811] Sum rewards: 64.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.060', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.256', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.172', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:37,671][52649] DAMAGECOUNT value on done: 200542.0 [2024-08-06 01:33:37,672][52649] Sum rewards: 62.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.153', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.204', 'weapon5': '0.258', 'weapon2': '0.274', 'WEAPON5': '0.400', 'weapon4': '0.578', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '53.000'} [2024-08-06 01:33:37,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 256409600. Throughput: 0: 4393.3. Samples: 64107580. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:33:37,794][52567] Avg episode reward: [(0, '61.715')] [2024-08-06 01:33:37,923][52650] Updated weights for policy 0, policy_version 31301 (0.0024) [2024-08-06 01:33:38,101][52803] DAMAGECOUNT value on done: 199664.0 [2024-08-06 01:33:38,103][52803] Sum rewards: 61.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.280', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO3': '0.160', 'AMMO4': '0.176', 'weapon2': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '0.900', 'weapon3': '3.006', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '48.500'} [2024-08-06 01:33:38,422][52665] DAMAGECOUNT value on done: 204852.0 [2024-08-06 01:33:38,424][52665] Sum rewards: 41.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.094', 'AMMO3': '0.194', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON4': '0.600', 'weapon4': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.384', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '11.064', 'FRAGCOUNT': '38.000'} [2024-08-06 01:33:39,088][52663] DAMAGECOUNT value on done: 212373.0 [2024-08-06 01:33:39,088][52663] Sum rewards: 52.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.075', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon2': '0.148', 'weapon4': '0.180', 'AMMO4': '0.212', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.298', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '46.000'} [2024-08-06 01:33:39,128][52820] DAMAGECOUNT value on done: 194819.0 [2024-08-06 01:33:39,131][52820] Sum rewards: 68.713, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.545', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.256', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '59.000'} [2024-08-06 01:33:39,219][52659] DAMAGECOUNT value on done: 211817.0 [2024-08-06 01:33:39,222][52659] Sum rewards: 65.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.336', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.216', 'AMMO3': '0.236', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.678', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '56.000'} [2024-08-06 01:33:39,295][52667] Large shaping reward 3.486 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.435, 145.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:33:39,719][52811] DAMAGECOUNT value on done: 197895.0 [2024-08-06 01:33:39,719][52811] Sum rewards: 47.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.121', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO4': '0.217', 'weapon5': '0.246', 'AMMO3': '0.250', 'weapon4': '0.288', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.987', 'FRAGCOUNT': '41.000'} [2024-08-06 01:33:40,494][52649] DAMAGECOUNT value on done: 206213.0 [2024-08-06 01:33:40,502][52649] Sum rewards: 59.087, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.733', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.185', 'weapon4': '0.240', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '53.500'} [2024-08-06 01:33:41,340][52803] DAMAGECOUNT value on done: 199006.0 [2024-08-06 01:33:41,340][52803] Sum rewards: 66.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.096', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.054', 'weapon4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.215', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:41,342][52665] DAMAGECOUNT value on done: 210606.0 [2024-08-06 01:33:41,342][52665] Sum rewards: 55.903, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.658', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.160', 'weapon5': '0.174', 'AMMO4': '0.230', 'AMMO3': '0.289', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.042', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:41,888][52659] DAMAGECOUNT value on done: 214778.0 [2024-08-06 01:33:41,890][52659] Sum rewards: 64.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.176', 'weapon2': '0.220', 'WEAPON4': '0.450', 'weapon4': '0.580', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 01:33:42,190][52820] DAMAGECOUNT value on done: 195965.0 [2024-08-06 01:33:42,191][52820] Sum rewards: 64.023, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.131', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.450', 'weapon2': '0.734', 'WEAPON3': '0.950', 'weapon3': '2.432', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '51.000'} [2024-08-06 01:33:42,283][52650] Updated weights for policy 0, policy_version 31311 (0.0030) [2024-08-06 01:33:42,312][52663] DAMAGECOUNT value on done: 216195.0 [2024-08-06 01:33:42,315][52663] Sum rewards: 67.172, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.030', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.231', 'AMMO3': '0.273', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '61.000'} [2024-08-06 01:33:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 256507904. Throughput: 0: 4389.8. Samples: 64133840. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:33:42,794][52567] Avg episode reward: [(0, '61.345')] [2024-08-06 01:33:42,832][52811] DAMAGECOUNT value on done: 198086.0 [2024-08-06 01:33:42,834][52811] Sum rewards: 61.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.895', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.318', 'weapon2': '0.456', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '2.938', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:43,001][52649] DAMAGECOUNT value on done: 205657.0 [2024-08-06 01:33:43,002][52649] Sum rewards: 53.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.159', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.055', 'weapon4': '0.188', 'AMMO3': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.198', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '47.000'} [2024-08-06 01:33:43,739][52665] DAMAGECOUNT value on done: 210310.0 [2024-08-06 01:33:43,739][52665] Sum rewards: 63.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.440', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:44,363][52803] DAMAGECOUNT value on done: 193499.0 [2024-08-06 01:33:44,365][52803] Sum rewards: 45.980, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.634', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.256', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.126', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '42.000'} [2024-08-06 01:33:44,548][52659] DAMAGECOUNT value on done: 217254.0 [2024-08-06 01:33:44,548][52659] Sum rewards: 69.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.892', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'weapon5': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.255', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '61.000'} [2024-08-06 01:33:45,396][52820] DAMAGECOUNT value on done: 193899.0 [2024-08-06 01:33:45,397][52820] Sum rewards: 58.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.874', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:45,427][52663] DAMAGECOUNT value on done: 214027.0 [2024-08-06 01:33:45,428][52663] Sum rewards: 60.368, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.248', 'weapon2': '0.906', 'WEAPON3': '1.000', 'weapon3': '2.618', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '49.000'} [2024-08-06 01:33:45,760][52649] DAMAGECOUNT value on done: 211134.0 [2024-08-06 01:33:45,762][52649] Sum rewards: 51.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.204', 'AMMO4': '0.205', 'weapon4': '0.212', 'weapon5': '0.254', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '3.050', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '44.000'} [2024-08-06 01:33:45,924][52811] DAMAGECOUNT value on done: 203082.0 [2024-08-06 01:33:45,924][52811] Sum rewards: 64.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO4': '0.168', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.794', 'WEAPON3': '1.200', 'weapon3': '2.510', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '54.500'} [2024-08-06 01:33:46,551][52665] DAMAGECOUNT value on done: 214492.0 [2024-08-06 01:33:46,551][52665] Sum rewards: 59.744, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.023', 'HEALTH': '0.035', 'AMMO4': '0.117', 'AMMO3': '0.124', 'weapon5': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.750', 'weapon3': '2.950', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '45.000'} [2024-08-06 01:33:47,025][52650] Updated weights for policy 0, policy_version 31321 (0.0010) [2024-08-06 01:33:47,125][52659] DAMAGECOUNT value on done: 215924.0 [2024-08-06 01:33:47,127][52659] Sum rewards: 52.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon7': '0.052', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'WEAPON7': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.440', 'weapon4': '0.520', 'WEAPON3': '1.450', 'weapon3': '2.676', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:47,405][52803] DAMAGECOUNT value on done: 198211.0 [2024-08-06 01:33:47,406][52803] Sum rewards: 62.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.178', 'AMMO3': '0.209', 'AMMO4': '0.238', 'weapon2': '0.238', 'WEAPON5': '0.450', 'weapon4': '0.558', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 256589824. Throughput: 0: 4392.9. Samples: 64147060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:33:47,795][52567] Avg episode reward: [(0, '61.329')] [2024-08-06 01:33:48,461][52820] DAMAGECOUNT value on done: 188149.0 [2024-08-06 01:33:48,462][52820] Sum rewards: 54.219, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.950', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon2': '0.292', 'AMMO3': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.210', 'weapon3': '3.368', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:48,703][52663] DAMAGECOUNT value on done: 211103.0 [2024-08-06 01:33:48,703][52663] Sum rewards: 74.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.793', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.370', 'WEAPON3': '1.100', 'HITCOUNT': '3.270', 'weapon3': '3.282', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '62.000'} [2024-08-06 01:33:48,756][52649] DAMAGECOUNT value on done: 211758.0 [2024-08-06 01:33:48,756][52649] Sum rewards: 72.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.721', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON1': '0.020', 'AMMO3': '0.227', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.414', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '61.000'} [2024-08-06 01:33:49,096][52811] DAMAGECOUNT value on done: 200604.0 [2024-08-06 01:33:49,096][52811] Sum rewards: 66.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.190', 'weapon4': '0.202', 'AMMO4': '0.210', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:49,535][52811] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:33:49,602][52665] DAMAGECOUNT value on done: 211382.0 [2024-08-06 01:33:49,603][52665] Sum rewards: 56.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.685', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.236', 'weapon2': '0.284', 'weapon4': '0.344', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '49.000'} [2024-08-06 01:33:49,791][52659] DAMAGECOUNT value on done: 210971.0 [2024-08-06 01:33:49,791][52659] Sum rewards: 54.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.305', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '44.000'} [2024-08-06 01:33:50,506][52803] DAMAGECOUNT value on done: 195202.0 [2024-08-06 01:33:50,509][52803] Sum rewards: 57.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.685', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.181', 'weapon5': '0.234', 'AMMO4': '0.307', 'weapon4': '0.372', 'weapon2': '0.416', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.668', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:51,607][52820] DAMAGECOUNT value on done: 197380.0 [2024-08-06 01:33:51,608][52650] Updated weights for policy 0, policy_version 31331 (0.0027) [2024-08-06 01:33:51,613][52820] Sum rewards: 62.054, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.781', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO4': '0.181', 'weapon4': '0.190', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.192', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '56.000'} [2024-08-06 01:33:52,081][52649] DAMAGECOUNT value on done: 215931.0 [2024-08-06 01:33:52,081][52649] Sum rewards: 60.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.986', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.170', 'weapon2': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.500', 'weapon4': '0.698', 'WEAPON3': '1.450', 'weapon3': '2.658', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:52,409][52811] DAMAGECOUNT value on done: 198334.0 [2024-08-06 01:33:52,411][52811] Sum rewards: 67.848, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.231', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.372', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '58.000'} [2024-08-06 01:33:52,699][52659] DAMAGECOUNT value on done: 216911.0 [2024-08-06 01:33:52,701][52659] Sum rewards: 56.678, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.832', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.232', 'AMMO4': '0.317', 'weapon4': '0.318', 'weapon5': '0.324', 'weapon2': '0.562', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.456', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 256679936. Throughput: 0: 4389.8. Samples: 64173340. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:33:52,794][52567] Avg episode reward: [(0, '61.407')] [2024-08-06 01:33:52,875][52665] DAMAGECOUNT value on done: 216214.0 [2024-08-06 01:33:52,876][52665] Sum rewards: 58.048, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.072', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO4': '0.233', 'weapon4': '0.236', 'AMMO3': '0.298', 'weapon5': '0.302', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.616', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:53,602][52803] DAMAGECOUNT value on done: 203835.0 [2024-08-06 01:33:53,603][52803] Sum rewards: 63.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.154', 'weapon4': '0.198', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.102', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '54.000'} [2024-08-06 01:33:54,688][52820] DAMAGECOUNT value on done: 193882.0 [2024-08-06 01:33:54,689][52820] Sum rewards: 61.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.188', 'weapon4': '0.194', 'AMMO4': '0.212', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '52.000'} [2024-08-06 01:33:55,440][52665] DAMAGECOUNT value on done: 213834.0 [2024-08-06 01:33:55,442][52665] Sum rewards: 66.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.068', 'AMMO3': '0.230', 'AMMO4': '0.233', 'weapon2': '0.236', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.152', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '57.000'} [2024-08-06 01:33:55,626][52811] DAMAGECOUNT value on done: 204259.0 [2024-08-06 01:33:55,626][52811] Sum rewards: 60.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.934', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon4': '0.296', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '50.000'} [2024-08-06 01:33:55,823][52659] DAMAGECOUNT value on done: 216640.0 [2024-08-06 01:33:55,823][52659] Sum rewards: 76.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.216', 'weapon4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '64.000'} [2024-08-06 01:33:56,469][52650] Updated weights for policy 0, policy_version 31341 (0.0021) [2024-08-06 01:33:56,686][52803] DAMAGECOUNT value on done: 200834.0 [2024-08-06 01:33:56,687][52803] Sum rewards: 42.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.262', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.626', 'WEAPON3': '1.050', 'HITCOUNT': '2.550', 'weapon3': '2.710', 'DAMAGECOUNT': '10.887', 'FRAGCOUNT': '37.000'} [2024-08-06 01:33:57,507][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:33:57,762][52820] DAMAGECOUNT value on done: 195215.0 [2024-08-06 01:33:57,762][52820] Sum rewards: 50.432, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.395', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.263', 'weapon2': '0.460', 'WEAPON4': '0.600', 'weapon4': '0.654', 'WEAPON3': '1.550', 'weapon3': '2.426', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '48.000'} [2024-08-06 01:33:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 256770048. Throughput: 0: 4384.7. Samples: 64199750. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:33:57,794][52567] Avg episode reward: [(0, '61.310')] [2024-08-06 01:33:58,169][52665] DAMAGECOUNT value on done: 210791.0 [2024-08-06 01:33:58,171][52665] Sum rewards: 71.132, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '62.000'} [2024-08-06 01:33:58,647][52811] DAMAGECOUNT value on done: 199548.0 [2024-08-06 01:33:58,647][52811] Sum rewards: 54.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.469', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.202', 'weapon2': '0.264', 'weapon4': '0.296', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.120', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '45.000'} [2024-08-06 01:33:59,746][52803] DAMAGECOUNT value on done: 199361.0 [2024-08-06 01:33:59,747][52803] Sum rewards: 66.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.492', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.196', 'AMMO3': '0.207', 'weapon2': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:00,846][52820] DAMAGECOUNT value on done: 200766.0 [2024-08-06 01:34:00,847][52820] Sum rewards: 63.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.186', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.094', 'weapon4': '0.160', 'AMMO3': '0.200', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '55.000'} [2024-08-06 01:34:01,054][52650] Updated weights for policy 0, policy_version 31351 (0.0012) [2024-08-06 01:34:01,216][52665] DAMAGECOUNT value on done: 209913.0 [2024-08-06 01:34:01,216][52665] Sum rewards: 57.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.336', 'AMMO5': '0.015', 'AMMO2': '0.064', 'AMMO3': '0.234', 'weapon5': '0.258', 'AMMO4': '0.319', 'weapon4': '0.360', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.644', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:01,759][52811] DAMAGECOUNT value on done: 197540.0 [2024-08-06 01:34:01,767][52811] Sum rewards: 64.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.102', 'weapon4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.668', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '53.000'} [2024-08-06 01:34:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 256851968. Throughput: 0: 4388.9. Samples: 64212920. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:34:02,794][52567] Avg episode reward: [(0, '61.400')] [2024-08-06 01:34:02,891][52811] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:34:02,895][52803] DAMAGECOUNT value on done: 201418.0 [2024-08-06 01:34:02,899][52803] Sum rewards: 62.405, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.242', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:03,998][52820] DAMAGECOUNT value on done: 196612.0 [2024-08-06 01:34:04,000][52820] Sum rewards: 66.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.401', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.178', 'AMMO3': '0.211', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:04,326][52665] DAMAGECOUNT value on done: 210197.0 [2024-08-06 01:34:04,329][52665] Sum rewards: 58.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.804', 'AMMO5': '0.007', 'ARMOR': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.104', 'AMMO4': '0.147', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '3.224', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:04,876][52811] DAMAGECOUNT value on done: 200349.0 [2024-08-06 01:34:04,876][52811] Sum rewards: 60.742, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.484', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.116', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.874', 'WEAPON3': '0.950', 'weapon3': '2.594', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '48.000'} [2024-08-06 01:34:05,574][52650] Updated weights for policy 0, policy_version 31361 (0.0016) [2024-08-06 01:34:05,901][52803] DAMAGECOUNT value on done: 198062.0 [2024-08-06 01:34:05,901][52803] Sum rewards: 49.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.202', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO3': '0.158', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.596', 'weapon2': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.268', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '12.372', 'FRAGCOUNT': '41.000'} [2024-08-06 01:34:07,133][52820] DAMAGECOUNT value on done: 198867.0 [2024-08-06 01:34:07,141][52820] Sum rewards: 53.817, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.540', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.152', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'AMMO4': '0.260', 'weapon4': '0.308', 'weapon2': '0.326', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.938', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '49.500'} [2024-08-06 01:34:07,479][52665] DAMAGECOUNT value on done: 208753.0 [2024-08-06 01:34:07,481][52665] Sum rewards: 58.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.297', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.160', 'AMMO3': '0.163', 'AMMO4': '0.225', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.096', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 256942080. Throughput: 0: 4398.9. Samples: 64239370. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:34:07,794][52567] Avg episode reward: [(0, '60.950')] [2024-08-06 01:34:07,984][52811] DAMAGECOUNT value on done: 197499.0 [2024-08-06 01:34:07,985][52811] Sum rewards: 59.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.121', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.060', 'AMMO4': '0.117', 'AMMO3': '0.214', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '51.000'} [2024-08-06 01:34:09,115][52803] DAMAGECOUNT value on done: 196074.0 [2024-08-06 01:34:09,115][52803] Sum rewards: 62.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.689', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.125', 'WEAPON5': '0.150', 'weapon5': '0.162', 'WEAPON4': '0.350', 'weapon4': '0.482', 'WEAPON3': '0.800', 'weapon2': '0.938', 'weapon3': '2.218', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:10,203][52820] DAMAGECOUNT value on done: 198972.0 [2024-08-06 01:34:10,204][52820] Sum rewards: 74.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '63.000'} [2024-08-06 01:34:10,322][52650] Updated weights for policy 0, policy_version 31371 (0.0012) [2024-08-06 01:34:10,405][52665] DAMAGECOUNT value on done: 208384.0 [2024-08-06 01:34:10,405][52665] Sum rewards: 61.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.040', 'AMMO4': '0.145', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '53.000'} [2024-08-06 01:34:11,141][52811] DAMAGECOUNT value on done: 203093.0 [2024-08-06 01:34:11,142][52811] Sum rewards: 81.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.018', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO4': '0.222', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '68.000'} [2024-08-06 01:34:12,246][52803] DAMAGECOUNT value on done: 205511.0 [2024-08-06 01:34:12,247][52803] Sum rewards: 80.063, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.908', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.176', 'weapon4': '0.202', 'weapon2': '0.262', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '67.000'} [2024-08-06 01:34:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 257032192. Throughput: 0: 4400.2. Samples: 64265760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:34:12,794][52567] Avg episode reward: [(0, '61.369')] [2024-08-06 01:34:13,227][52665] DAMAGECOUNT value on done: 206601.0 [2024-08-06 01:34:13,229][52665] Sum rewards: 57.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.162', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.239', 'weapon4': '0.248', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.500', 'weapon3': '2.808', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '49.500'} [2024-08-06 01:34:13,321][52820] DAMAGECOUNT value on done: 199419.0 [2024-08-06 01:34:13,321][52820] Sum rewards: 61.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.094', 'AMMO4': '0.168', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.166', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:14,190][52811] DAMAGECOUNT value on done: 199664.0 [2024-08-06 01:34:14,193][52811] Sum rewards: 70.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.485', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.145', 'WEAPON4': '0.350', 'weapon4': '0.448', 'weapon2': '0.582', 'WEAPON3': '0.950', 'weapon3': '2.648', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2024-08-06 01:34:15,059][52650] Updated weights for policy 0, policy_version 31381 (0.0029) [2024-08-06 01:34:15,253][52803] DAMAGECOUNT value on done: 197938.0 [2024-08-06 01:34:15,253][52803] Sum rewards: 76.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.815', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.324', 'weapon2': '0.364', 'WEAPON3': '0.950', 'weapon3': '3.088', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '62.000'} [2024-08-06 01:34:15,490][52665] DAMAGECOUNT value on done: 212427.0 [2024-08-06 01:34:15,490][52665] Sum rewards: 59.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.118', 'AMMO3': '0.184', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '50.000'} [2024-08-06 01:34:16,610][52820] DAMAGECOUNT value on done: 195737.0 [2024-08-06 01:34:16,610][52820] Sum rewards: 54.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.305', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO4': '0.221', 'weapon2': '0.232', 'AMMO3': '0.242', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.954', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:16,699][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:34:17,063][52811] DAMAGECOUNT value on done: 198355.0 [2024-08-06 01:34:17,065][52811] Sum rewards: 61.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.024', 'AMMO5': '0.007', 'AMMO2': '0.072', 'weapon5': '0.128', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.360', 'weapon4': '0.514', 'WEAPON4': '0.550', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.490', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 257114112. Throughput: 0: 4399.6. Samples: 64279040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:34:17,794][52567] Avg episode reward: [(0, '61.603')] [2024-08-06 01:34:18,001][52665] DAMAGECOUNT value on done: 209675.0 [2024-08-06 01:34:18,002][52665] Sum rewards: 73.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.086', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.157', 'weapon4': '0.192', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.158', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '60.000'} [2024-08-06 01:34:18,151][52668] DAMAGECOUNT value on done: 210367.0 [2024-08-06 01:34:18,152][52668] Sum rewards: 51.826, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.970', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon2': '0.268', 'AMMO3': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.720', 'WEAPON3': '1.750', 'weapon3': '2.606', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:18,365][52803] DAMAGECOUNT value on done: 202917.0 [2024-08-06 01:34:18,367][52803] Sum rewards: 53.762, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.700', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.180', 'weapon2': '0.246', 'WEAPON4': '0.300', 'AMMO3': '0.360', 'WEAPON3': '2.100', 'weapon3': '3.272', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '53.000'} [2024-08-06 01:34:19,773][52820] DAMAGECOUNT value on done: 199038.0 [2024-08-06 01:34:19,774][52820] Sum rewards: 48.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.385', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.166', 'AMMO3': '0.199', 'weapon2': '0.312', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '41.500'} [2024-08-06 01:34:20,055][52650] Updated weights for policy 0, policy_version 31391 (0.0014) [2024-08-06 01:34:20,308][52811] DAMAGECOUNT value on done: 198617.0 [2024-08-06 01:34:20,309][52811] Sum rewards: 59.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'AMMO4': '0.043', 'weapon5': '0.132', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:20,372][52667] DAMAGECOUNT value on done: 214179.0 [2024-08-06 01:34:20,372][52667] Sum rewards: 54.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.888', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.291', 'weapon4': '0.308', 'weapon2': '0.452', 'WEAPON3': '1.650', 'HITCOUNT': '2.790', 'weapon3': '2.884', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '51.000'} [2024-08-06 01:34:21,270][52668] DAMAGECOUNT value on done: 219355.0 [2024-08-06 01:34:21,270][52668] Sum rewards: 68.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.305', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.194', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:21,326][52803] DAMAGECOUNT value on done: 193344.0 [2024-08-06 01:34:21,326][52803] Sum rewards: 59.500, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.366', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.138', 'AMMO3': '0.191', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.486', 'weapon4': '0.528', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.500', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.000'} [2024-08-06 01:34:22,622][52662] DAMAGECOUNT value on done: 218924.0 [2024-08-06 01:34:22,623][52662] Sum rewards: 71.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.070', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 257204224. Throughput: 0: 4393.3. Samples: 64305280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:34:22,802][52567] Avg episode reward: [(0, '61.536')] [2024-08-06 01:34:23,009][52820] DAMAGECOUNT value on done: 199901.0 [2024-08-06 01:34:23,012][52820] Sum rewards: 64.925, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.110', 'AMMO5': '0.014', 'weapon4': '0.042', 'AMMO2': '0.059', 'weapon5': '0.120', 'weapon2': '0.224', 'AMMO3': '0.284', 'AMMO4': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.910', 'weapon3': '3.300', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '59.000'} [2024-08-06 01:34:23,352][52667] DAMAGECOUNT value on done: 214045.0 [2024-08-06 01:34:23,354][52667] Sum rewards: 56.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.010', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.192', 'weapon2': '0.736', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '2.922', 'DAMAGECOUNT': '13.137', 'FRAGCOUNT': '47.000'} [2024-08-06 01:34:23,424][52811] DAMAGECOUNT value on done: 203906.0 [2024-08-06 01:34:23,427][52811] Sum rewards: 81.554, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.762', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.292', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '65.000'} [2024-08-06 01:34:24,173][52650] Updated weights for policy 0, policy_version 31401 (0.0012) [2024-08-06 01:34:24,341][52668] DAMAGECOUNT value on done: 215610.0 [2024-08-06 01:34:24,341][52668] Sum rewards: 61.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.635', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.168', 'AMMO3': '0.172', 'AMMO4': '0.237', 'weapon4': '0.282', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.734', 'WEAPON3': '1.150', 'weapon3': '2.528', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:25,482][52662] DAMAGECOUNT value on done: 221111.0 [2024-08-06 01:34:25,484][52662] Sum rewards: 59.356, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.572', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.161', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.318', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '51.500'} [2024-08-06 01:34:26,135][52820] DAMAGECOUNT value on done: 199501.0 [2024-08-06 01:34:26,137][52820] Sum rewards: 70.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.135', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.034', 'AMMO4': '0.081', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '60.500'} [2024-08-06 01:34:26,227][52667] DAMAGECOUNT value on done: 217617.0 [2024-08-06 01:34:26,228][52667] Sum rewards: 69.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.988', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '59.000'} [2024-08-06 01:34:26,681][52811] DAMAGECOUNT value on done: 198843.0 [2024-08-06 01:34:26,684][52811] Sum rewards: 60.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.395', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.576', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.142', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '51.000'} [2024-08-06 01:34:27,335][52668] DAMAGECOUNT value on done: 217174.0 [2024-08-06 01:34:27,335][52668] Sum rewards: 71.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.686', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.062', 'weapon5': '0.084', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.292', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.388', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '58.000'} [2024-08-06 01:34:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 257294336. Throughput: 0: 4395.6. Samples: 64331640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:34:27,802][52567] Avg episode reward: [(0, '61.836')] [2024-08-06 01:34:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031408_257294336.pth... [2024-08-06 01:34:27,944][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000030893_253075456.pth [2024-08-06 01:34:28,363][52662] DAMAGECOUNT value on done: 220208.0 [2024-08-06 01:34:28,364][52662] Sum rewards: 65.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.560', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.092', 'weapon4': '0.144', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 01:34:29,149][52650] Updated weights for policy 0, policy_version 31411 (0.0013) [2024-08-06 01:34:29,259][52667] DAMAGECOUNT value on done: 211051.0 [2024-08-06 01:34:29,260][52667] Sum rewards: 49.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.966', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.115', 'weapon4': '0.132', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '2.930', 'DAMAGECOUNT': '12.405', 'FRAGCOUNT': '43.000'} [2024-08-06 01:34:29,494][52820] DAMAGECOUNT value on done: 194118.0 [2024-08-06 01:34:29,496][52820] Sum rewards: 49.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.008', 'weapon5': '0.018', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.248', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '44.000'} [2024-08-06 01:34:29,837][52811] DAMAGECOUNT value on done: 202840.0 [2024-08-06 01:34:29,839][52811] Sum rewards: 55.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.009', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon2': '0.598', 'WEAPON3': '0.900', 'HITCOUNT': '2.950', 'weapon3': '3.174', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '44.000'} [2024-08-06 01:34:30,426][52668] DAMAGECOUNT value on done: 208673.0 [2024-08-06 01:34:30,429][52668] Sum rewards: 48.768, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.345', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon5': '0.146', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'AMMO4': '0.328', 'weapon2': '0.420', 'weapon4': '0.678', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.442', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '47.000'} [2024-08-06 01:34:31,273][52662] DAMAGECOUNT value on done: 210866.0 [2024-08-06 01:34:31,274][52662] Sum rewards: 65.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '55.000'} [2024-08-06 01:34:32,268][52667] DAMAGECOUNT value on done: 217176.0 [2024-08-06 01:34:32,268][52667] Sum rewards: 74.710, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.262', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.238', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '64.000'} [2024-08-06 01:34:32,634][52820] DAMAGECOUNT value on done: 203051.0 [2024-08-06 01:34:32,635][52820] Sum rewards: 64.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.759', 'ARMOR': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.434', 'weapon2': '0.634', 'WEAPON3': '1.000', 'weapon3': '2.718', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 257376256. Throughput: 0: 4385.6. Samples: 64344410. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:34:32,794][52567] Avg episode reward: [(0, '61.571')] [2024-08-06 01:34:33,304][52668] DAMAGECOUNT value on done: 213077.0 [2024-08-06 01:34:33,305][52668] Sum rewards: 55.709, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.415', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.278', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:33,651][52650] Updated weights for policy 0, policy_version 31421 (0.0013) [2024-08-06 01:34:33,956][52660] DAMAGECOUNT value on done: 211475.0 [2024-08-06 01:34:33,956][52660] Sum rewards: 51.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.951', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.187', 'weapon5': '0.252', 'AMMO4': '0.285', 'weapon4': '0.444', 'WEAPON5': '0.450', 'weapon2': '0.602', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.418', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '45.000'} [2024-08-06 01:34:34,120][52662] DAMAGECOUNT value on done: 217936.0 [2024-08-06 01:34:34,122][52662] Sum rewards: 61.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.077', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO4': '0.221', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.362', 'weapon4': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.764', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '54.000'} [2024-08-06 01:34:35,341][52667] DAMAGECOUNT value on done: 214647.0 [2024-08-06 01:34:35,343][52667] Sum rewards: 61.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.362', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.450', 'weapon3': '2.792', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '54.000'} [2024-08-06 01:34:35,839][52820] DAMAGECOUNT value on done: 205972.0 [2024-08-06 01:34:35,847][52820] Sum rewards: 68.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.198', 'weapon5': '0.202', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:36,292][52668] DAMAGECOUNT value on done: 211779.0 [2024-08-06 01:34:36,293][52668] Sum rewards: 65.034, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.105', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.236', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:36,656][52660] DAMAGECOUNT value on done: 211251.0 [2024-08-06 01:34:36,657][52660] Sum rewards: 63.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.549', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '55.000'} [2024-08-06 01:34:37,014][52662] DAMAGECOUNT value on done: 213310.0 [2024-08-06 01:34:37,018][52662] Sum rewards: 64.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.838', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.172', 'weapon2': '0.504', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.280', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '54.000'} [2024-08-06 01:34:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 257466368. Throughput: 0: 4387.6. Samples: 64370780. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:34:37,794][52567] Avg episode reward: [(0, '61.781')] [2024-08-06 01:34:38,451][52650] Updated weights for policy 0, policy_version 31431 (0.0012) [2024-08-06 01:34:38,555][52667] DAMAGECOUNT value on done: 218175.0 [2024-08-06 01:34:38,555][52667] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '63.000'} [2024-08-06 01:34:38,765][52820] DAMAGECOUNT value on done: 194772.0 [2024-08-06 01:34:38,765][52820] Sum rewards: 57.396, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.075', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.268', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.530', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:38,899][52668] DAMAGECOUNT value on done: 215180.0 [2024-08-06 01:34:38,899][52668] Sum rewards: 55.095, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.168', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.102', 'weapon5': '0.134', 'AMMO4': '0.164', 'weapon2': '0.246', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.202', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '50.000'} [2024-08-06 01:34:39,215][52647] DAMAGECOUNT value on done: 227862.0 [2024-08-06 01:34:39,216][52647] Sum rewards: 60.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.968', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.136', 'weapon4': '0.156', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:39,331][52660] DAMAGECOUNT value on done: 214583.0 [2024-08-06 01:34:39,332][52660] Sum rewards: 64.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.224', 'AMMO4': '0.234', 'weapon5': '0.256', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.636', 'WEAPON3': '1.300', 'weapon3': '2.528', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.000'} [2024-08-06 01:34:39,640][52662] DAMAGECOUNT value on done: 219168.0 [2024-08-06 01:34:39,640][52662] Sum rewards: 67.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '58.000'} [2024-08-06 01:34:40,352][52669] DAMAGECOUNT value on done: 216275.0 [2024-08-06 01:34:40,353][52669] Sum rewards: 60.511, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon4': '0.208', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '2.880', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '55.000'} [2024-08-06 01:34:41,386][52668] DAMAGECOUNT value on done: 214422.0 [2024-08-06 01:34:41,394][52668] Sum rewards: 51.805, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.598', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO4': '0.161', 'AMMO3': '0.226', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.112', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '45.000'} [2024-08-06 01:34:41,666][52667] DAMAGECOUNT value on done: 212559.0 [2024-08-06 01:34:41,666][52667] Sum rewards: 62.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.669', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon5': '0.172', 'weapon4': '0.194', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '54.000'} [2024-08-06 01:34:41,921][52660] DAMAGECOUNT value on done: 215170.0 [2024-08-06 01:34:41,921][52660] Sum rewards: 58.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.104', 'AMMO4': '0.113', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '47.000'} [2024-08-06 01:34:42,061][52662] DAMAGECOUNT value on done: 223344.0 [2024-08-06 01:34:42,062][52662] Sum rewards: 60.955, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'AMMO3': '0.291', 'weapon2': '0.332', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.772', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '53.000'} [2024-08-06 01:34:42,241][52647] DAMAGECOUNT value on done: 224374.0 [2024-08-06 01:34:42,242][52647] Sum rewards: 75.220, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.618', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '62.000'} [2024-08-06 01:34:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 257556480. Throughput: 0: 4393.3. Samples: 64397450. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:34:42,794][52567] Avg episode reward: [(0, '61.884')] [2024-08-06 01:34:43,097][52650] Updated weights for policy 0, policy_version 31441 (0.0019) [2024-08-06 01:34:43,138][52663] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:34:43,426][52669] DAMAGECOUNT value on done: 211449.0 [2024-08-06 01:34:43,429][52669] Sum rewards: 72.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.114', 'AMMO4': '0.129', 'weapon5': '0.158', 'weapon2': '0.198', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.500'} [2024-08-06 01:34:43,978][52668] DAMAGECOUNT value on done: 215617.0 [2024-08-06 01:34:43,978][52668] Sum rewards: 60.812, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.174', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.428', 'HEALTH': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.932', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '51.000'} [2024-08-06 01:34:44,501][52660] DAMAGECOUNT value on done: 215078.0 [2024-08-06 01:34:44,503][52660] Sum rewards: 74.857, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '61.000'} [2024-08-06 01:34:44,663][52662] DAMAGECOUNT value on done: 215994.0 [2024-08-06 01:34:44,665][52662] Sum rewards: 63.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.185', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.386', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '54.000'} [2024-08-06 01:34:44,684][52667] DAMAGECOUNT value on done: 213742.0 [2024-08-06 01:34:44,685][52667] Sum rewards: 67.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.090', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.620', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:45,348][52647] DAMAGECOUNT value on done: 226178.0 [2024-08-06 01:34:45,349][52647] Sum rewards: 68.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.225', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:45,451][52811] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:34:45,646][52794] DAMAGECOUNT value on done: 217184.0 [2024-08-06 01:34:45,647][52794] Sum rewards: 57.570, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO3': '0.187', 'weapon2': '0.722', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '47.000'} [2024-08-06 01:34:46,186][52669] DAMAGECOUNT value on done: 216217.0 [2024-08-06 01:34:46,186][52669] Sum rewards: 66.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.070', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:47,131][52668] DAMAGECOUNT value on done: 217090.0 [2024-08-06 01:34:47,140][52668] Sum rewards: 70.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.130', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon4': '0.268', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '59.000'} [2024-08-06 01:34:47,342][52662] DAMAGECOUNT value on done: 224814.0 [2024-08-06 01:34:47,342][52662] Sum rewards: 63.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '53.000'} [2024-08-06 01:34:47,401][52660] DAMAGECOUNT value on done: 211005.0 [2024-08-06 01:34:47,402][52660] Sum rewards: 60.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.866', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'weapon4': '0.220', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:47,451][52667] DAMAGECOUNT value on done: 217081.0 [2024-08-06 01:34:47,451][52667] Sum rewards: 69.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO4': '0.119', 'AMMO3': '0.192', 'weapon2': '0.288', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.354', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '58.000'} [2024-08-06 01:34:47,726][52650] Updated weights for policy 0, policy_version 31451 (0.0027) [2024-08-06 01:34:47,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 257646592. Throughput: 0: 4391.3. Samples: 64410530. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:34:47,795][52567] Avg episode reward: [(0, '62.557')] [2024-08-06 01:34:48,541][52794] DAMAGECOUNT value on done: 220272.0 [2024-08-06 01:34:48,542][52794] Sum rewards: 60.701, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.098', 'AMMO4': '0.170', 'AMMO3': '0.191', 'weapon5': '0.192', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.627', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '3.144', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '51.000'} [2024-08-06 01:34:48,615][52647] DAMAGECOUNT value on done: 227488.0 [2024-08-06 01:34:48,618][52647] Sum rewards: 65.734, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.344', 'weapon4': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '56.000'} [2024-08-06 01:34:49,084][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:34:49,300][52669] DAMAGECOUNT value on done: 212957.0 [2024-08-06 01:34:49,302][52669] Sum rewards: 66.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.718', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO3': '0.161', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.550', 'weapon4': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.738', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:49,790][52668] DAMAGECOUNT value on done: 210129.0 [2024-08-06 01:34:49,792][52668] Sum rewards: 64.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon5': '0.120', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '54.000'} [2024-08-06 01:34:50,152][52660] DAMAGECOUNT value on done: 216170.0 [2024-08-06 01:34:50,153][52660] Sum rewards: 71.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.160', 'weapon4': '0.164', 'AMMO3': '0.234', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '60.000'} [2024-08-06 01:34:50,397][52662] DAMAGECOUNT value on done: 214473.0 [2024-08-06 01:34:50,399][52662] Sum rewards: 57.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.187', 'weapon5': '0.198', 'AMMO4': '0.221', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.780', 'WEAPON3': '1.100', 'weapon3': '2.328', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '47.000'} [2024-08-06 01:34:50,424][52667] DAMAGECOUNT value on done: 217092.0 [2024-08-06 01:34:50,424][52667] Sum rewards: 55.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '2.670', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:50,819][52647] DAMAGECOUNT value on done: 226212.0 [2024-08-06 01:34:50,820][52647] Sum rewards: 58.914, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.215', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.162', 'weapon4': '0.184', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.078', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:51,556][52794] DAMAGECOUNT value on done: 214518.0 [2024-08-06 01:34:51,558][52794] Sum rewards: 62.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.152', 'AMMO3': '0.157', 'AMMO4': '0.208', 'weapon4': '0.412', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.724', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.500'} [2024-08-06 01:34:52,301][52650] Updated weights for policy 0, policy_version 31461 (0.0023) [2024-08-06 01:34:52,397][52669] DAMAGECOUNT value on done: 214499.0 [2024-08-06 01:34:52,397][52669] Sum rewards: 59.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.402', 'ARMOR': '0.004', 'AMMO2': '0.029', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.217', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.368', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '50.000'} [2024-08-06 01:34:52,633][52668] DAMAGECOUNT value on done: 204416.0 [2024-08-06 01:34:52,636][52668] Sum rewards: 63.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.112', 'weapon2': '0.200', 'AMMO4': '0.223', 'AMMO3': '0.241', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.210', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '56.000'} [2024-08-06 01:34:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 257728512. Throughput: 0: 4393.3. Samples: 64437070. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:34:52,794][52567] Avg episode reward: [(0, '62.757')] [2024-08-06 01:34:52,925][52660] DAMAGECOUNT value on done: 217960.0 [2024-08-06 01:34:52,926][52660] Sum rewards: 59.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.215', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'weapon2': '0.332', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.074', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:53,388][52667] DAMAGECOUNT value on done: 215211.0 [2024-08-06 01:34:53,390][52667] Sum rewards: 78.161, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.118', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.172', 'weapon5': '0.180', 'weapon2': '0.346', 'WEAPON3': '1.000', 'weapon3': '3.332', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 01:34:53,430][52662] DAMAGECOUNT value on done: 216754.0 [2024-08-06 01:34:53,431][52662] Sum rewards: 78.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '64.500'} [2024-08-06 01:34:53,926][52647] DAMAGECOUNT value on done: 231031.0 [2024-08-06 01:34:53,948][52647] Sum rewards: 55.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.130', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'AMMO4': '0.258', 'weapon2': '0.488', 'WEAPON4': '0.550', 'weapon4': '0.736', 'WEAPON3': '1.200', 'weapon3': '2.356', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '46.000'} [2024-08-06 01:34:54,392][52794] DAMAGECOUNT value on done: 215612.0 [2024-08-06 01:34:54,393][52794] Sum rewards: 57.038, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.657', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.229', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:55,311][52669] DAMAGECOUNT value on done: 211845.0 [2024-08-06 01:34:55,313][52669] Sum rewards: 56.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.136', 'AMMO4': '0.177', 'AMMO3': '0.255', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '51.000'} [2024-08-06 01:34:55,502][52668] DAMAGECOUNT value on done: 210121.0 [2024-08-06 01:34:55,504][52668] Sum rewards: 51.151, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.098', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.642', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.848', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '46.500'} [2024-08-06 01:34:55,757][52660] DAMAGECOUNT value on done: 217349.0 [2024-08-06 01:34:55,757][52660] Sum rewards: 72.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.106', 'AMMO3': '0.164', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.622', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '59.000'} [2024-08-06 01:34:55,820][52794] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:34:55,928][52662] DAMAGECOUNT value on done: 212594.0 [2024-08-06 01:34:55,929][52662] Sum rewards: 52.714, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.312', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '43.000'} [2024-08-06 01:34:56,209][52667] DAMAGECOUNT value on done: 217044.0 [2024-08-06 01:34:56,210][52667] Sum rewards: 63.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.443', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.182', 'AMMO4': '0.183', 'AMMO3': '0.239', 'weapon2': '0.262', 'WEAPON5': '0.300', 'weapon5': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '54.000'} [2024-08-06 01:34:56,637][52647] DAMAGECOUNT value on done: 224936.0 [2024-08-06 01:34:56,637][52647] Sum rewards: 69.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '56.000'} [2024-08-06 01:34:56,796][52650] Updated weights for policy 0, policy_version 31471 (0.0024) [2024-08-06 01:34:57,191][52794] DAMAGECOUNT value on done: 213692.0 [2024-08-06 01:34:57,191][52794] Sum rewards: 61.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.902', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '49.000'} [2024-08-06 01:34:57,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 257810432. Throughput: 0: 4393.3. Samples: 64463460. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:34:57,794][52567] Avg episode reward: [(0, '62.954')] [2024-08-06 01:34:58,007][52668] DAMAGECOUNT value on done: 208551.0 [2024-08-06 01:34:58,008][52668] Sum rewards: 55.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.885', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.063', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.264', 'AMMO4': '0.317', 'WEAPON4': '0.500', 'weapon4': '0.954', 'WEAPON3': '1.250', 'weapon3': '2.346', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '48.000'} [2024-08-06 01:34:58,210][52669] DAMAGECOUNT value on done: 215659.0 [2024-08-06 01:34:58,210][52669] Sum rewards: 66.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'ARMOR': '0.008', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.047', 'weapon5': '0.088', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.356', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '55.000'} [2024-08-06 01:34:58,359][52660] DAMAGECOUNT value on done: 212729.0 [2024-08-06 01:34:58,359][52660] Sum rewards: 68.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.212', 'weapon4': '0.388', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '56.000'} [2024-08-06 01:34:58,987][52662] DAMAGECOUNT value on done: 222772.0 [2024-08-06 01:34:58,987][52662] Sum rewards: 63.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.184', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '52.000'} [2024-08-06 01:34:59,081][52667] DAMAGECOUNT value on done: 211564.0 [2024-08-06 01:34:59,081][52667] Sum rewards: 54.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO2': '0.035', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.203', 'weapon2': '0.766', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '45.000'} [2024-08-06 01:34:59,751][52647] DAMAGECOUNT value on done: 224787.0 [2024-08-06 01:34:59,751][52647] Sum rewards: 69.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '57.000'} [2024-08-06 01:34:59,777][52794] DAMAGECOUNT value on done: 215758.0 [2024-08-06 01:34:59,777][52794] Sum rewards: 61.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.464', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.202', 'weapon2': '0.240', 'AMMO3': '0.242', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.050', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:00,327][52668] DAMAGECOUNT value on done: 213055.0 [2024-08-06 01:35:00,328][52668] Sum rewards: 39.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.048', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.180', 'WEAPON4': '0.550', 'weapon2': '0.570', 'WEAPON3': '0.900', 'weapon4': '1.010', 'weapon3': '2.070', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '10.614', 'FRAGCOUNT': '34.000'} [2024-08-06 01:35:00,549][52660] DAMAGECOUNT value on done: 219558.0 [2024-08-06 01:35:00,550][52660] Sum rewards: 59.695, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.176', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON3': '1.400', 'weapon3': '2.846', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:01,279][52662] DAMAGECOUNT value on done: 219673.0 [2024-08-06 01:35:01,280][52662] Sum rewards: 69.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.332', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'AMMO4': '0.208', 'weapon4': '0.234', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '59.000'} [2024-08-06 01:35:01,476][52669] DAMAGECOUNT value on done: 214121.0 [2024-08-06 01:35:01,477][52669] Sum rewards: 54.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.339', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.450', 'weapon2': '0.542', 'weapon4': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '47.500'} [2024-08-06 01:35:01,641][52650] Updated weights for policy 0, policy_version 31481 (0.0017) [2024-08-06 01:35:01,732][52667] DAMAGECOUNT value on done: 218994.0 [2024-08-06 01:35:01,734][52667] Sum rewards: 65.352, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.664', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.130', 'AMMO4': '0.176', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '55.000'} [2024-08-06 01:35:02,432][52794] DAMAGECOUNT value on done: 220164.0 [2024-08-06 01:35:02,435][52794] Sum rewards: 59.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.215', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.240', 'weapon2': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.432', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:02,656][52647] DAMAGECOUNT value on done: 226487.0 [2024-08-06 01:35:02,658][52647] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.138', 'weapon4': '0.152', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 01:35:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 257908736. Throughput: 0: 4388.7. Samples: 64476530. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:35:02,795][52567] Avg episode reward: [(0, '62.675')] [2024-08-06 01:35:03,322][52668] DAMAGECOUNT value on done: 208381.0 [2024-08-06 01:35:03,322][52668] Sum rewards: 69.052, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.716', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.232', 'WEAPON5': '0.250', 'weapon5': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '57.000'} [2024-08-06 01:35:03,695][52660] DAMAGECOUNT value on done: 207016.0 [2024-08-06 01:35:03,697][52660] Sum rewards: 57.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.944', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.154', 'AMMO3': '0.220', 'weapon2': '0.254', 'weapon4': '0.272', 'AMMO4': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.008', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:04,149][52662] DAMAGECOUNT value on done: 223802.0 [2024-08-06 01:35:04,149][52662] Sum rewards: 66.910, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.309', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.430', 'weapon4': '0.438', 'WEAPON3': '0.950', 'weapon3': '2.816', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:04,579][52669] DAMAGECOUNT value on done: 215261.0 [2024-08-06 01:35:04,581][52669] Sum rewards: 65.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.336', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:04,841][52667] DAMAGECOUNT value on done: 224198.0 [2024-08-06 01:35:04,841][52667] Sum rewards: 75.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.334', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.144', 'weapon2': '0.212', 'AMMO3': '0.216', 'AMMO4': '0.226', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '64.000'} [2024-08-06 01:35:04,858][52647] DAMAGECOUNT value on done: 222818.0 [2024-08-06 01:35:04,858][52647] Sum rewards: 62.074, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.156', 'AMMO3': '0.241', 'AMMO4': '0.306', 'weapon2': '0.348', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '56.000'} [2024-08-06 01:35:05,348][52794] DAMAGECOUNT value on done: 216562.0 [2024-08-06 01:35:05,349][52794] Sum rewards: 71.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon4': '0.254', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '58.000'} [2024-08-06 01:35:05,592][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:35:05,880][52658] DAMAGECOUNT value on done: 218067.0 [2024-08-06 01:35:05,880][52658] Sum rewards: 49.251, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.865', 'AMMO5': '0.016', 'AMMO2': '0.069', 'AMMO3': '0.175', 'weapon5': '0.256', 'weapon4': '0.330', 'AMMO4': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon2': '1.062', 'weapon3': '2.080', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '44.000'} [2024-08-06 01:35:06,527][52650] Updated weights for policy 0, policy_version 31491 (0.0037) [2024-08-06 01:35:06,637][52668] DAMAGECOUNT value on done: 218449.0 [2024-08-06 01:35:06,637][52668] Sum rewards: 69.698, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.726', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.340', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '58.000'} [2024-08-06 01:35:06,674][52662] DAMAGECOUNT value on done: 213813.0 [2024-08-06 01:35:06,675][52662] Sum rewards: 52.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'weapon4': '0.520', 'weapon2': '0.872', 'WEAPON3': '0.950', 'weapon3': '2.364', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '12.930', 'FRAGCOUNT': '44.000'} [2024-08-06 01:35:06,991][52660] DAMAGECOUNT value on done: 212280.0 [2024-08-06 01:35:07,007][52660] Sum rewards: 58.341, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.450', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:07,500][52667] DAMAGECOUNT value on done: 218432.0 [2024-08-06 01:35:07,500][52667] Sum rewards: 66.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.010', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '58.000'} [2024-08-06 01:35:07,589][52647] DAMAGECOUNT value on done: 224605.0 [2024-08-06 01:35:07,589][52647] Sum rewards: 62.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.760', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.344', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.004', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:07,687][52669] DAMAGECOUNT value on done: 210703.0 [2024-08-06 01:35:07,691][52669] Sum rewards: 54.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.326', 'ARMOR': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.049', 'weapon5': '0.176', 'AMMO3': '0.183', 'AMMO4': '0.244', 'weapon4': '0.514', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.684', 'WEAPON3': '1.050', 'weapon3': '2.124', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '45.000'} [2024-08-06 01:35:07,703][52794] DAMAGECOUNT value on done: 221762.0 [2024-08-06 01:35:07,704][52794] Sum rewards: 76.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.044', 'AMMO4': '0.171', 'AMMO3': '0.177', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '64.000'} [2024-08-06 01:35:07,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 257998848. Throughput: 0: 4392.7. Samples: 64502950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:35:07,794][52567] Avg episode reward: [(0, '62.954')] [2024-08-06 01:35:08,388][52658] DAMAGECOUNT value on done: 216729.0 [2024-08-06 01:35:08,390][52658] Sum rewards: 63.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.659', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.184', 'AMMO4': '0.237', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.292', 'weapon4': '0.536', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.678', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '56.000'} [2024-08-06 01:35:09,089][52662] DAMAGECOUNT value on done: 218624.0 [2024-08-06 01:35:09,092][52662] Sum rewards: 64.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.725', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon7': '0.044', 'weapon5': '0.136', 'AMMO3': '0.145', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.424', 'weapon4': '0.496', 'WEAPON3': '0.900', 'weapon3': '2.692', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:09,744][52668] DAMAGECOUNT value on done: 217073.0 [2024-08-06 01:35:09,755][52668] Sum rewards: 65.021, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.065', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO4': '0.217', 'weapon5': '0.248', 'weapon4': '0.258', 'AMMO3': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.692', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '59.000'} [2024-08-06 01:35:10,128][52660] DAMAGECOUNT value on done: 218197.0 [2024-08-06 01:35:10,128][52660] Sum rewards: 72.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.206', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.500'} [2024-08-06 01:35:10,165][52667] DAMAGECOUNT value on done: 219728.0 [2024-08-06 01:35:10,165][52667] Sum rewards: 54.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.194', 'weapon5': '0.208', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon4': '0.444', 'weapon2': '0.446', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '47.000'} [2024-08-06 01:35:10,262][52647] DAMAGECOUNT value on done: 221884.0 [2024-08-06 01:35:10,263][52647] Sum rewards: 57.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.874', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '47.000'} [2024-08-06 01:35:10,547][52794] DAMAGECOUNT value on done: 219370.0 [2024-08-06 01:35:10,549][52794] Sum rewards: 65.408, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.447', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'weapon4': '0.212', 'weapon2': '0.386', 'WEAPON3': '0.900', 'weapon3': '3.248', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:10,914][52669] DAMAGECOUNT value on done: 215485.0 [2024-08-06 01:35:10,915][52669] Sum rewards: 60.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.138', 'weapon5': '0.170', 'AMMO4': '0.190', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.718', 'WEAPON3': '1.400', 'weapon3': '2.704', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:11,056][52650] Updated weights for policy 0, policy_version 31501 (0.0026) [2024-08-06 01:35:11,106][52658] DAMAGECOUNT value on done: 217035.0 [2024-08-06 01:35:11,108][52658] Sum rewards: 58.179, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.785', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.052', 'AMMO3': '0.131', 'weapon5': '0.144', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.784', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '45.500'} [2024-08-06 01:35:12,289][52662] DAMAGECOUNT value on done: 215881.0 [2024-08-06 01:35:12,290][52662] Sum rewards: 45.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.374', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.124', 'AMMO3': '0.169', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'weapon4': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.794', 'WEAPON3': '1.100', 'weapon3': '2.344', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '40.000'} [2024-08-06 01:35:12,651][52668] DAMAGECOUNT value on done: 214022.0 [2024-08-06 01:35:12,651][52668] Sum rewards: 73.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.456', 'weapon4': '0.484', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '61.000'} [2024-08-06 01:35:12,694][52667] DAMAGECOUNT value on done: 209586.0 [2024-08-06 01:35:12,695][52667] Sum rewards: 62.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.078', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '52.000'} [2024-08-06 01:35:12,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 258088960. Throughput: 0: 4389.8. Samples: 64529180. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:12,795][52567] Avg episode reward: [(0, '62.888')] [2024-08-06 01:35:12,857][52647] DAMAGECOUNT value on done: 224133.0 [2024-08-06 01:35:12,857][52647] Sum rewards: 71.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.946', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.288', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '58.000'} [2024-08-06 01:35:12,864][52660] DAMAGECOUNT value on done: 224348.0 [2024-08-06 01:35:12,865][52660] Sum rewards: 64.971, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '58.000'} [2024-08-06 01:35:13,498][52658] DAMAGECOUNT value on done: 217818.0 [2024-08-06 01:35:13,498][52658] Sum rewards: 67.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.154', 'AMMO3': '0.163', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.872', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 01:35:13,643][52794] DAMAGECOUNT value on done: 216689.0 [2024-08-06 01:35:13,644][52794] Sum rewards: 57.046, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.310', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.175', 'AMMO4': '0.291', 'weapon5': '0.348', 'weapon2': '0.480', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'weapon4': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.038', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '48.000'} [2024-08-06 01:35:14,136][52669] DAMAGECOUNT value on done: 217906.0 [2024-08-06 01:35:14,137][52669] Sum rewards: 60.114, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.096', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.164', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.650', 'weapon3': '2.728', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '55.000'} [2024-08-06 01:35:15,107][52662] DAMAGECOUNT value on done: 214622.0 [2024-08-06 01:35:15,108][52662] Sum rewards: 60.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.157', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:15,220][52647] DAMAGECOUNT value on done: 225420.0 [2024-08-06 01:35:15,221][52647] Sum rewards: 65.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.628', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '54.500'} [2024-08-06 01:35:15,334][52667] DAMAGECOUNT value on done: 219600.0 [2024-08-06 01:35:15,334][52667] Sum rewards: 72.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.256', 'AMMO5': '0.008', 'AMMO2': '0.036', 'AMMO3': '0.138', 'weapon5': '0.156', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '0.800', 'weapon3': '2.720', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '57.000'} [2024-08-06 01:35:15,684][52650] Updated weights for policy 0, policy_version 31511 (0.0025) [2024-08-06 01:35:15,801][52660] DAMAGECOUNT value on done: 209573.0 [2024-08-06 01:35:15,801][52660] Sum rewards: 58.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'weapon5': '0.050', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.279', 'weapon2': '0.290', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon4': '1.140', 'weapon3': '2.360', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '50.000'} [2024-08-06 01:35:16,135][52794] DAMAGECOUNT value on done: 216392.0 [2024-08-06 01:35:16,137][52794] Sum rewards: 58.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.118', 'AMMO3': '0.127', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.954', 'weapon3': '2.346', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '48.000'} [2024-08-06 01:35:16,225][52658] DAMAGECOUNT value on done: 216878.0 [2024-08-06 01:35:16,226][52658] Sum rewards: 56.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.655', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.188', 'AMMO3': '0.216', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '47.000'} [2024-08-06 01:35:17,270][52669] DAMAGECOUNT value on done: 211015.0 [2024-08-06 01:35:17,272][52669] Sum rewards: 69.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.266', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '57.000'} [2024-08-06 01:35:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 258170880. Throughput: 0: 4401.1. Samples: 64542460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:17,802][52567] Avg episode reward: [(0, '63.041')] [2024-08-06 01:35:17,866][52614] Saving new best policy, reward=63.041! [2024-08-06 01:35:18,073][52647] DAMAGECOUNT value on done: 227797.0 [2024-08-06 01:35:18,073][52647] Sum rewards: 63.541, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.095', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.202', 'AMMO3': '0.272', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.650', 'weapon3': '2.716', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '57.000'} [2024-08-06 01:35:18,227][52660] DAMAGECOUNT value on done: 216001.0 [2024-08-06 01:35:18,230][52660] Sum rewards: 59.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.374', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:18,824][52794] DAMAGECOUNT value on done: 214553.0 [2024-08-06 01:35:18,828][52794] Sum rewards: 76.518, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.572', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.101', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.242', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '65.000'} [2024-08-06 01:35:19,433][52658] DAMAGECOUNT value on done: 213424.0 [2024-08-06 01:35:19,434][52658] Sum rewards: 65.083, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.496', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.183', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '57.000'} [2024-08-06 01:35:20,331][52669] DAMAGECOUNT value on done: 217221.0 [2024-08-06 01:35:20,333][52669] Sum rewards: 46.319, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.794', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.144', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.744', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '43.000'} [2024-08-06 01:35:20,634][52650] Updated weights for policy 0, policy_version 31521 (0.0038) [2024-08-06 01:35:21,029][52647] DAMAGECOUNT value on done: 222417.0 [2024-08-06 01:35:21,031][52647] Sum rewards: 51.883, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO3': '0.137', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon2': '0.556', 'weapon4': '0.610', 'WEAPON3': '0.900', 'weapon3': '2.526', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '12.324', 'FRAGCOUNT': '41.000'} [2024-08-06 01:35:21,347][52660] DAMAGECOUNT value on done: 206005.0 [2024-08-06 01:35:21,349][52660] Sum rewards: 57.922, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.426', 'AMMO5': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.117', 'weapon5': '0.192', 'AMMO4': '0.277', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON4': '0.500', 'weapon4': '0.678', 'WEAPON3': '0.800', 'weapon3': '2.536', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '45.000'} [2024-08-06 01:35:21,909][52794] DAMAGECOUNT value on done: 226739.0 [2024-08-06 01:35:21,909][52794] Sum rewards: 62.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.025', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:22,564][52658] DAMAGECOUNT value on done: 222883.0 [2024-08-06 01:35:22,566][52658] Sum rewards: 74.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.174', 'weapon2': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '60.000'} [2024-08-06 01:35:22,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 258252800. Throughput: 0: 4398.0. Samples: 64568690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:22,794][52567] Avg episode reward: [(0, '63.082')] [2024-08-06 01:35:22,795][52614] Saving new best policy, reward=63.082! [2024-08-06 01:35:23,197][52647] DAMAGECOUNT value on done: 220967.0 [2024-08-06 01:35:23,198][52647] Sum rewards: 60.264, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.402', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.076', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:23,275][52669] DAMAGECOUNT value on done: 219540.0 [2024-08-06 01:35:23,277][52669] Sum rewards: 52.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.477', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO3': '0.127', 'AMMO4': '0.140', 'weapon5': '0.168', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.482', 'weapon2': '0.504', 'WEAPON3': '0.850', 'HITCOUNT': '2.670', 'weapon3': '2.678', 'DAMAGECOUNT': '13.254', 'FRAGCOUNT': '42.000'} [2024-08-06 01:35:23,865][52660] DAMAGECOUNT value on done: 215927.0 [2024-08-06 01:35:23,867][52660] Sum rewards: 56.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.165', 'AMMO5': '0.007', 'AMMO2': '0.057', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.284', 'weapon4': '0.386', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:24,610][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:35:24,814][52650] Updated weights for policy 0, policy_version 31531 (0.0013) [2024-08-06 01:35:25,148][52794] DAMAGECOUNT value on done: 213568.0 [2024-08-06 01:35:25,150][52794] Sum rewards: 54.680, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.606', 'AMMO5': '0.017', 'ARMOR': '0.020', 'AMMO2': '0.076', 'AMMO3': '0.183', 'weapon5': '0.246', 'AMMO4': '0.381', 'WEAPON5': '0.450', 'weapon2': '0.466', 'weapon4': '0.502', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.394', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '49.000'} [2024-08-06 01:35:25,214][52664] DAMAGECOUNT value on done: 220967.0 [2024-08-06 01:35:25,215][52664] Sum rewards: 53.871, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.132', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.100', 'AMMO3': '0.148', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.442', 'WEAPON3': '0.900', 'weapon3': '2.866', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '42.000'} [2024-08-06 01:35:25,597][52658] DAMAGECOUNT value on done: 210631.0 [2024-08-06 01:35:25,599][52658] Sum rewards: 54.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.226', 'AMMO5': '0.007', 'ARMOR': '0.032', 'AMMO2': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.440', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.662', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '48.000'} [2024-08-06 01:35:25,707][52647] DAMAGECOUNT value on done: 223567.0 [2024-08-06 01:35:25,708][52647] Sum rewards: 50.698, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.726', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.700', 'HITCOUNT': '2.850', 'weapon3': '3.070', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '49.000'} [2024-08-06 01:35:26,196][52666] DAMAGECOUNT value on done: 218971.0 [2024-08-06 01:35:26,198][52666] Sum rewards: 51.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.444', 'weapon2': '0.768', 'WEAPON3': '1.050', 'weapon3': '2.582', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '43.000'} [2024-08-06 01:35:26,231][52669] DAMAGECOUNT value on done: 228083.0 [2024-08-06 01:35:26,235][52669] Sum rewards: 76.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.148', 'AMMO3': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.250', 'weapon3': '3.434', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '63.000'} [2024-08-06 01:35:26,604][52660] DAMAGECOUNT value on done: 212880.0 [2024-08-06 01:35:26,604][52660] Sum rewards: 64.718, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.022', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.126', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.338', 'weapon4': '0.374', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.840', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '59.500'} [2024-08-06 01:35:27,619][52794] DAMAGECOUNT value on done: 225146.0 [2024-08-06 01:35:27,619][52794] Sum rewards: 68.184, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.336', 'HEALTH': '0.439', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '55.000'} [2024-08-06 01:35:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 258351104. Throughput: 0: 4383.1. Samples: 64594690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:27,794][52567] Avg episode reward: [(0, '62.277')] [2024-08-06 01:35:27,801][52664] DAMAGECOUNT value on done: 223065.0 [2024-08-06 01:35:27,801][52664] Sum rewards: 61.876, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.605', 'AMMO5': '0.009', 'AMMO2': '0.061', 'weapon5': '0.106', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'AMMO4': '0.306', 'weapon2': '0.356', 'WEAPON4': '0.450', 'weapon4': '0.668', 'WEAPON3': '1.450', 'weapon3': '2.614', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '56.000'} [2024-08-06 01:35:28,258][52647] DAMAGECOUNT value on done: 219529.0 [2024-08-06 01:35:28,266][52647] Sum rewards: 65.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.680', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:28,744][52658] DAMAGECOUNT value on done: 220206.0 [2024-08-06 01:35:28,745][52658] Sum rewards: 61.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.746', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.179', 'weapon5': '0.214', 'AMMO4': '0.301', 'WEAPON5': '0.350', 'weapon2': '0.392', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.666', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '54.500'} [2024-08-06 01:35:29,204][52669] DAMAGECOUNT value on done: 213630.0 [2024-08-06 01:35:29,205][52669] Sum rewards: 64.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.184', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.181', 'AMMO4': '0.197', 'weapon5': '0.234', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '54.500'} [2024-08-06 01:35:29,712][52666] DAMAGECOUNT value on done: 218471.0 [2024-08-06 01:35:29,712][52666] Sum rewards: 50.878, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.609', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.260', 'WEAPON4': '0.450', 'weapon4': '0.638', 'WEAPON3': '1.350', 'weapon3': '2.682', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '46.000'} [2024-08-06 01:35:29,823][52650] Updated weights for policy 0, policy_version 31541 (0.0011) [2024-08-06 01:35:30,096][52664] DAMAGECOUNT value on done: 223802.0 [2024-08-06 01:35:30,097][52664] Sum rewards: 56.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.059', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.156', 'AMMO4': '0.181', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.136', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '48.500'} [2024-08-06 01:35:30,755][52647] DAMAGECOUNT value on done: 227004.0 [2024-08-06 01:35:30,755][52647] Sum rewards: 74.936, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.601', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.148', 'AMMO3': '0.216', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '64.000'} [2024-08-06 01:35:30,921][52794] DAMAGECOUNT value on done: 219651.0 [2024-08-06 01:35:30,925][52794] Sum rewards: 62.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.126', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:31,343][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:35:31,548][52658] DAMAGECOUNT value on done: 218514.0 [2024-08-06 01:35:31,549][52658] Sum rewards: 56.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.473', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.133', 'weapon4': '0.184', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.174', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '47.000'} [2024-08-06 01:35:32,153][52669] DAMAGECOUNT value on done: 220319.0 [2024-08-06 01:35:32,155][52669] Sum rewards: 62.264, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.342', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.210', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.424', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '52.000'} [2024-08-06 01:35:32,370][52666] DAMAGECOUNT value on done: 218101.0 [2024-08-06 01:35:32,371][52666] Sum rewards: 47.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.982', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.740', 'WEAPON3': '1.000', 'HITCOUNT': '2.750', 'weapon3': '2.766', 'DAMAGECOUNT': '12.660', 'FRAGCOUNT': '38.000'} [2024-08-06 01:35:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 258433024. Throughput: 0: 4387.8. Samples: 64607980. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:32,794][52567] Avg episode reward: [(0, '61.867')] [2024-08-06 01:35:33,063][52664] DAMAGECOUNT value on done: 220717.0 [2024-08-06 01:35:33,065][52664] Sum rewards: 62.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.090', 'weapon5': '0.090', 'AMMO4': '0.183', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.146', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:33,681][52794] DAMAGECOUNT value on done: 218688.0 [2024-08-06 01:35:33,682][52794] Sum rewards: 51.442, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'AMMO3': '0.317', 'weapon4': '0.382', 'weapon2': '0.416', 'WEAPON3': '1.800', 'weapon3': '2.814', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '48.000'} [2024-08-06 01:35:34,488][52650] Updated weights for policy 0, policy_version 31551 (0.0032) [2024-08-06 01:35:34,556][52658] DAMAGECOUNT value on done: 222083.0 [2024-08-06 01:35:34,558][52658] Sum rewards: 57.487, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.136', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'HEALTH': '0.220', 'weapon4': '0.274', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '47.000'} [2024-08-06 01:35:34,986][52669] DAMAGECOUNT value on done: 221422.0 [2024-08-06 01:35:34,988][52669] Sum rewards: 62.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.601', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.134', 'weapon5': '0.154', 'AMMO3': '0.190', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '52.000'} [2024-08-06 01:35:35,590][52664] DAMAGECOUNT value on done: 222366.0 [2024-08-06 01:35:35,592][52664] Sum rewards: 59.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.054', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.166', 'AMMO4': '0.176', 'WEAPON4': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '48.500'} [2024-08-06 01:35:35,648][52666] DAMAGECOUNT value on done: 214142.0 [2024-08-06 01:35:35,650][52666] Sum rewards: 63.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.202', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.175', 'weapon2': '0.498', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '3.328', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:36,205][52794] DAMAGECOUNT value on done: 226545.0 [2024-08-06 01:35:36,206][52794] Sum rewards: 72.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.942', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.098', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.340', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '61.000'} [2024-08-06 01:35:37,421][52658] DAMAGECOUNT value on done: 210203.0 [2024-08-06 01:35:37,424][52658] Sum rewards: 68.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.225', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.210', 'AMMO4': '0.224', 'weapon4': '0.228', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '56.000'} [2024-08-06 01:35:37,736][52671] DAMAGECOUNT value on done: 221300.0 [2024-08-06 01:35:37,736][52671] Sum rewards: 53.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.230', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.240', 'WEAPON3': '1.600', 'HITCOUNT': '2.700', 'weapon3': '3.466', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '48.000'} [2024-08-06 01:35:37,753][52669] DAMAGECOUNT value on done: 223345.0 [2024-08-06 01:35:37,753][52669] Sum rewards: 79.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '68.000'} [2024-08-06 01:35:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 258523136. Throughput: 0: 4386.4. Samples: 64634460. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:37,794][52567] Avg episode reward: [(0, '61.644')] [2024-08-06 01:35:37,883][52670] DAMAGECOUNT value on done: 212538.0 [2024-08-06 01:35:37,883][52670] Sum rewards: 59.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.462', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.201', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '49.000'} [2024-08-06 01:35:38,498][52666] DAMAGECOUNT value on done: 211504.0 [2024-08-06 01:35:38,498][52666] Sum rewards: 55.702, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.455', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.076', 'AMMO4': '0.205', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '47.500'} [2024-08-06 01:35:38,509][52664] DAMAGECOUNT value on done: 225385.0 [2024-08-06 01:35:38,510][52664] Sum rewards: 63.940, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.798', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.050', 'AMMO3': '0.130', 'weapon4': '0.216', 'weapon2': '0.864', 'WEAPON3': '0.900', 'weapon3': '2.828', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2024-08-06 01:35:38,882][52650] Updated weights for policy 0, policy_version 31561 (0.0026) [2024-08-06 01:35:39,362][52794] DAMAGECOUNT value on done: 218230.0 [2024-08-06 01:35:39,364][52794] Sum rewards: 55.601, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.350', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'weapon2': '0.454', 'WEAPON3': '1.700', 'weapon3': '3.132', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:40,057][52658] DAMAGECOUNT value on done: 213626.0 [2024-08-06 01:35:40,058][52658] Sum rewards: 47.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.728', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.232', 'WEAPON4': '0.450', 'weapon2': '0.508', 'weapon4': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.526', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '40.000'} [2024-08-06 01:35:40,658][52670] DAMAGECOUNT value on done: 215857.0 [2024-08-06 01:35:40,658][52670] Sum rewards: 51.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.050', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.292', 'WEAPON4': '0.500', 'weapon4': '0.720', 'WEAPON3': '1.250', 'weapon3': '2.626', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '44.500'} [2024-08-06 01:35:40,897][52671] DAMAGECOUNT value on done: 214811.0 [2024-08-06 01:35:40,898][52671] Sum rewards: 63.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.682', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:41,179][52664] DAMAGECOUNT value on done: 229067.0 [2024-08-06 01:35:41,181][52664] Sum rewards: 61.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.220', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:41,321][52666] DAMAGECOUNT value on done: 206547.0 [2024-08-06 01:35:41,321][52666] Sum rewards: 54.700, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.762', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.118', 'AMMO3': '0.162', 'AMMO4': '0.231', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '45.500'} [2024-08-06 01:35:42,621][52658] DAMAGECOUNT value on done: 215798.0 [2024-08-06 01:35:42,621][52658] Sum rewards: 62.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.003', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon4': '0.318', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '55.000'} [2024-08-06 01:35:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 258613248. Throughput: 0: 4389.3. Samples: 64660980. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:42,794][52567] Avg episode reward: [(0, '61.374')] [2024-08-06 01:35:43,525][52650] Updated weights for policy 0, policy_version 31571 (0.0012) [2024-08-06 01:35:43,593][52670] DAMAGECOUNT value on done: 211447.0 [2024-08-06 01:35:43,593][52670] Sum rewards: 55.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.682', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '48.000'} [2024-08-06 01:35:44,054][52671] DAMAGECOUNT value on done: 218007.0 [2024-08-06 01:35:44,054][52671] Sum rewards: 62.858, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.340', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.310', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.840', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:44,111][52664] DAMAGECOUNT value on done: 217636.0 [2024-08-06 01:35:44,111][52664] Sum rewards: 57.333, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.830', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO4': '0.202', 'AMMO3': '0.238', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.480', 'WEAPON3': '1.500', 'weapon3': '2.778', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '49.500'} [2024-08-06 01:35:44,380][52666] DAMAGECOUNT value on done: 215395.0 [2024-08-06 01:35:44,381][52666] Sum rewards: 57.343, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.213', 'AMMO5': '0.003', 'AMMO2': '0.053', 'weapon7': '0.064', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO4': '0.267', 'AMMO3': '0.273', 'weapon2': '0.334', 'weapon4': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.718', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:45,011][52658] DAMAGECOUNT value on done: 211457.0 [2024-08-06 01:35:45,012][52658] Sum rewards: 80.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'AMMO5': '0.003', 'weapon5': '0.042', 'AMMO2': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.195', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '66.000'} [2024-08-06 01:35:46,650][52664] DAMAGECOUNT value on done: 230699.0 [2024-08-06 01:35:46,650][52664] Sum rewards: 64.481, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.235', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.166', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.948', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:46,752][52670] DAMAGECOUNT value on done: 212575.0 [2024-08-06 01:35:46,753][52670] Sum rewards: 46.001, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.772', 'AMMO5': '0.003', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.225', 'AMMO3': '0.263', 'weapon4': '0.382', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '43.000'} [2024-08-06 01:35:47,013][52671] DAMAGECOUNT value on done: 214127.0 [2024-08-06 01:35:47,016][52671] Sum rewards: 69.371, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.693', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.134', 'AMMO3': '0.213', 'AMMO4': '0.223', 'weapon4': '0.256', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '59.000'} [2024-08-06 01:35:47,563][52666] DAMAGECOUNT value on done: 214036.0 [2024-08-06 01:35:47,564][52666] Sum rewards: 66.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.150', 'weapon5': '0.168', 'AMMO4': '0.187', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON3': '1.000', 'weapon3': '2.956', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:47,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 258695168. Throughput: 0: 4395.8. Samples: 64674340. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:47,795][52567] Avg episode reward: [(0, '61.633')] [2024-08-06 01:35:48,032][52650] Updated weights for policy 0, policy_version 31581 (0.0011) [2024-08-06 01:35:48,097][52658] DAMAGECOUNT value on done: 214737.0 [2024-08-06 01:35:48,097][52658] Sum rewards: 59.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO4': '0.215', 'AMMO3': '0.218', 'weapon2': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.066', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '50.000'} [2024-08-06 01:35:49,417][52664] DAMAGECOUNT value on done: 225827.0 [2024-08-06 01:35:49,425][52664] Sum rewards: 58.796, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon2': '0.270', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'HITCOUNT': '3.080', 'weapon3': '3.428', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:49,543][52671] DAMAGECOUNT value on done: 219366.0 [2024-08-06 01:35:49,547][52671] Sum rewards: 64.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.130', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:49,978][52670] DAMAGECOUNT value on done: 215283.0 [2024-08-06 01:35:49,980][52670] Sum rewards: 68.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.795', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.134', 'weapon2': '0.202', 'AMMO4': '0.210', 'AMMO3': '0.225', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.212', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '59.000'} [2024-08-06 01:35:50,645][52666] DAMAGECOUNT value on done: 214503.0 [2024-08-06 01:35:50,645][52666] Sum rewards: 64.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.116', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.162', 'AMMO4': '0.221', 'weapon5': '0.240', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.604', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2024-08-06 01:35:50,982][52658] DAMAGECOUNT value on done: 220684.0 [2024-08-06 01:35:50,983][52658] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.334', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.169', 'weapon2': '0.852', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 01:35:52,383][52664] DAMAGECOUNT value on done: 228097.0 [2024-08-06 01:35:52,384][52664] Sum rewards: 71.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.675', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.183', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '59.000'} [2024-08-06 01:35:52,524][52671] DAMAGECOUNT value on done: 217431.0 [2024-08-06 01:35:52,526][52671] Sum rewards: 62.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.412', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.152', 'AMMO3': '0.194', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:52,775][52670] DAMAGECOUNT value on done: 215126.0 [2024-08-06 01:35:52,775][52670] Sum rewards: 69.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.365', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO3': '0.135', 'weapon5': '0.136', 'AMMO4': '0.153', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '0.950', 'weapon3': '2.812', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 01:35:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 258785280. Throughput: 0: 4398.2. Samples: 64700870. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:35:52,794][52567] Avg episode reward: [(0, '61.489')] [2024-08-06 01:35:53,038][52650] Updated weights for policy 0, policy_version 31591 (0.0013) [2024-08-06 01:35:53,670][52666] DAMAGECOUNT value on done: 212850.0 [2024-08-06 01:35:53,670][52666] Sum rewards: 58.309, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.072', 'AMMO4': '0.086', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.406', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.144', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:53,798][52658] DAMAGECOUNT value on done: 212518.0 [2024-08-06 01:35:53,798][52658] Sum rewards: 61.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.735', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.190', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:55,349][52671] DAMAGECOUNT value on done: 218764.0 [2024-08-06 01:35:55,350][52671] Sum rewards: 53.913, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'weapon4': '0.284', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.650', 'weapon3': '2.948', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '52.000'} [2024-08-06 01:35:55,463][52664] DAMAGECOUNT value on done: 222234.0 [2024-08-06 01:35:55,465][52664] Sum rewards: 57.519, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.132', 'AMMO4': '0.200', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.708', 'WEAPON3': '0.850', 'weapon3': '2.756', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '45.000'} [2024-08-06 01:35:55,886][52670] DAMAGECOUNT value on done: 210018.0 [2024-08-06 01:35:55,887][52670] Sum rewards: 60.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.044', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.856', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '50.500'} [2024-08-06 01:35:56,603][52666] DAMAGECOUNT value on done: 211435.0 [2024-08-06 01:35:56,603][52666] Sum rewards: 58.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.530', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.094', 'AMMO3': '0.228', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.458', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '51.000'} [2024-08-06 01:35:56,681][52658] DAMAGECOUNT value on done: 215058.0 [2024-08-06 01:35:56,683][52658] Sum rewards: 63.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.971', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.173', 'weapon5': '0.188', 'AMMO4': '0.230', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.000', 'weapon3': '2.616', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 01:35:56,915][52795] DAMAGECOUNT value on done: 200122.0 [2024-08-06 01:35:56,915][52795] Sum rewards: 69.016, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.388', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.038', 'weapon4': '0.076', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.267', 'weapon2': '0.294', 'WEAPON3': '1.600', 'HITCOUNT': '3.390', 'weapon3': '3.394', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '61.000'} [2024-08-06 01:35:57,574][52650] Updated weights for policy 0, policy_version 31601 (0.0013) [2024-08-06 01:35:57,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 258875392. Throughput: 0: 4399.1. Samples: 64727140. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:35:57,794][52567] Avg episode reward: [(0, '61.482')] [2024-08-06 01:35:58,163][52664] DAMAGECOUNT value on done: 223383.0 [2024-08-06 01:35:58,164][52664] Sum rewards: 70.293, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.006', 'AMMO2': '0.050', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'AMMO4': '0.252', 'weapon4': '0.342', 'weapon2': '0.544', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.792', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '58.000'} [2024-08-06 01:35:58,417][52671] DAMAGECOUNT value on done: 219485.0 [2024-08-06 01:35:58,417][52671] Sum rewards: 56.399, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.157', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.430', 'weapon4': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.732', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '47.000'} [2024-08-06 01:35:58,689][52670] DAMAGECOUNT value on done: 214028.0 [2024-08-06 01:35:58,692][52670] Sum rewards: 66.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.179', 'weapon4': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '54.000'} [2024-08-06 01:35:59,458][52666] DAMAGECOUNT value on done: 208314.0 [2024-08-06 01:35:59,459][52666] Sum rewards: 51.711, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.095', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.110', 'weapon5': '0.136', 'AMMO4': '0.166', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.060', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '48.000'} [2024-08-06 01:35:59,462][52658] DAMAGECOUNT value on done: 219079.0 [2024-08-06 01:35:59,464][52658] Sum rewards: 64.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.156', 'AMMO4': '0.177', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:00,002][52795] DAMAGECOUNT value on done: 197573.0 [2024-08-06 01:36:00,002][52795] Sum rewards: 67.047, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.864', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.268', 'weapon4': '0.396', 'WEAPON3': '1.600', 'weapon3': '2.948', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '59.000'} [2024-08-06 01:36:01,062][52664] DAMAGECOUNT value on done: 223495.0 [2024-08-06 01:36:01,062][52664] Sum rewards: 56.017, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.844', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.234', 'WEAPON4': '0.450', 'weapon2': '0.536', 'weapon4': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.416', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '50.000'} [2024-08-06 01:36:01,436][52670] DAMAGECOUNT value on done: 211348.0 [2024-08-06 01:36:01,438][52670] Sum rewards: 61.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.068', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:01,484][52671] DAMAGECOUNT value on done: 214672.0 [2024-08-06 01:36:01,484][52671] Sum rewards: 57.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.549', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.056', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.012', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:01,544][52614] Signal inference workers to stop experience collection... (5750 times) [2024-08-06 01:36:01,545][52614] Signal inference workers to resume experience collection... (5750 times) [2024-08-06 01:36:01,610][52650] InferenceWorker_p0-w0: stopping experience collection (5750 times) [2024-08-06 01:36:01,610][52650] InferenceWorker_p0-w0: resuming experience collection (5750 times) [2024-08-06 01:36:02,220][52666] DAMAGECOUNT value on done: 218948.0 [2024-08-06 01:36:02,220][52666] Sum rewards: 82.974, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.006', 'HEALTH': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.165', 'weapon2': '0.230', 'WEAPON3': '1.000', 'weapon3': '3.284', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '66.000'} [2024-08-06 01:36:02,430][52650] Updated weights for policy 0, policy_version 31611 (0.0026) [2024-08-06 01:36:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 258965504. Throughput: 0: 4397.5. Samples: 64740350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:36:02,795][52567] Avg episode reward: [(0, '61.660')] [2024-08-06 01:36:03,100][52795] DAMAGECOUNT value on done: 196222.0 [2024-08-06 01:36:03,101][52795] Sum rewards: 64.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.934', 'AMMO5': '0.004', 'AMMO2': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'AMMO3': '0.223', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:03,170][52669] Large shaping reward 2.588 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.537, 179.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:36:03,469][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:36:03,738][52664] DAMAGECOUNT value on done: 226347.0 [2024-08-06 01:36:03,738][52664] Sum rewards: 68.719, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.264', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '60.000'} [2024-08-06 01:36:04,497][52670] DAMAGECOUNT value on done: 206502.0 [2024-08-06 01:36:04,499][52670] Sum rewards: 59.691, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.068', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.308', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:04,619][52671] DAMAGECOUNT value on done: 219977.0 [2024-08-06 01:36:04,620][52671] Sum rewards: 75.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.255', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.229', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.508', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 01:36:05,189][52663] DAMAGECOUNT value on done: 217097.0 [2024-08-06 01:36:05,191][52663] Sum rewards: 49.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.872', 'AMMO5': '0.012', 'weapon5': '0.028', 'AMMO2': '0.054', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'AMMO4': '0.269', 'weapon4': '0.378', 'weapon2': '0.504', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.840', 'weapon3': '2.880', 'DAMAGECOUNT': '13.128', 'FRAGCOUNT': '43.000'} [2024-08-06 01:36:05,374][52666] DAMAGECOUNT value on done: 216541.0 [2024-08-06 01:36:05,374][52666] Sum rewards: 58.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.463', 'AMMO2': '0.032', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.161', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.242', 'weapon4': '0.322', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '3.188', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '48.000'} [2024-08-06 01:36:05,957][52649] DAMAGECOUNT value on done: 210110.0 [2024-08-06 01:36:05,958][52649] Sum rewards: 60.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.286', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '52.000'} [2024-08-06 01:36:06,254][52664] DAMAGECOUNT value on done: 221619.0 [2024-08-06 01:36:06,257][52664] Sum rewards: 68.601, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.332', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.198', 'weapon2': '0.488', 'WEAPON3': '0.950', 'weapon3': '3.062', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:06,335][52795] DAMAGECOUNT value on done: 197587.0 [2024-08-06 01:36:06,335][52795] Sum rewards: 51.819, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.273', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.058', 'weapon4': '0.128', 'AMMO3': '0.255', 'weapon5': '0.288', 'AMMO4': '0.292', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '2.926', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '47.500'} [2024-08-06 01:36:06,803][52650] Updated weights for policy 0, policy_version 31621 (0.0035) [2024-08-06 01:36:07,473][52671] DAMAGECOUNT value on done: 219092.0 [2024-08-06 01:36:07,473][52671] Sum rewards: 63.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.112', 'AMMO4': '0.218', 'weapon5': '0.218', 'AMMO3': '0.221', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.116', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:07,694][52670] DAMAGECOUNT value on done: 217667.0 [2024-08-06 01:36:07,695][52670] Sum rewards: 67.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.208', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.200', 'weapon4': '0.274', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:07,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17605.8). Total num frames: 259055616. Throughput: 0: 4399.5. Samples: 64766670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:36:07,795][52567] Avg episode reward: [(0, '61.562')] [2024-08-06 01:36:07,899][52663] DAMAGECOUNT value on done: 216577.0 [2024-08-06 01:36:07,899][52663] Sum rewards: 66.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.416', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.136', 'weapon4': '0.184', 'AMMO3': '0.217', 'AMMO4': '0.231', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '56.000'} [2024-08-06 01:36:08,533][52666] DAMAGECOUNT value on done: 210045.0 [2024-08-06 01:36:08,533][52666] Sum rewards: 62.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.024', 'weapon5': '0.024', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '52.000'} [2024-08-06 01:36:08,966][52664] DAMAGECOUNT value on done: 226666.0 [2024-08-06 01:36:08,966][52664] Sum rewards: 71.281, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.456', 'weapon4': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '59.000'} [2024-08-06 01:36:08,978][52649] DAMAGECOUNT value on done: 205135.0 [2024-08-06 01:36:08,978][52649] Sum rewards: 51.025, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.052', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.192', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.392', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.578', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '50.000'} [2024-08-06 01:36:09,654][52795] DAMAGECOUNT value on done: 203015.0 [2024-08-06 01:36:09,654][52795] Sum rewards: 78.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '67.000'} [2024-08-06 01:36:10,285][52671] DAMAGECOUNT value on done: 215576.0 [2024-08-06 01:36:10,288][52671] Sum rewards: 72.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.076', 'AMMO4': '0.145', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '60.000'} [2024-08-06 01:36:10,672][52670] DAMAGECOUNT value on done: 215692.0 [2024-08-06 01:36:10,673][52670] Sum rewards: 54.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.023', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.232', 'AMMO4': '0.281', 'weapon5': '0.294', 'weapon2': '0.448', 'WEAPON5': '0.450', 'weapon4': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.382', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '48.000'} [2024-08-06 01:36:11,197][52663] DAMAGECOUNT value on done: 212212.0 [2024-08-06 01:36:11,197][52663] Sum rewards: 61.384, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.144', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.342', 'HEALTH': '0.390', 'weapon4': '0.492', 'WEAPON3': '0.850', 'weapon3': '2.864', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '50.000'} [2024-08-06 01:36:11,281][52666] DAMAGECOUNT value on done: 213879.0 [2024-08-06 01:36:11,282][52666] Sum rewards: 64.546, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.170', 'weapon4': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.362', 'WEAPON3': '1.700', 'weapon3': '2.914', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '55.500'} [2024-08-06 01:36:11,472][52664] DAMAGECOUNT value on done: 227302.0 [2024-08-06 01:36:11,473][52664] Sum rewards: 64.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.619', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.110', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.412', 'WEAPON3': '0.900', 'weapon3': '3.036', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:11,637][52650] Updated weights for policy 0, policy_version 31631 (0.0011) [2024-08-06 01:36:12,153][52649] DAMAGECOUNT value on done: 212201.0 [2024-08-06 01:36:12,153][52649] Sum rewards: 66.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.454', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:12,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 259145728. Throughput: 0: 4406.7. Samples: 64792990. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:36:12,794][52567] Avg episode reward: [(0, '61.856')] [2024-08-06 01:36:12,956][52795] DAMAGECOUNT value on done: 198929.0 [2024-08-06 01:36:12,956][52795] Sum rewards: 51.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.123', 'AMMO5': '0.004', 'ARMOR': '0.016', 'AMMO2': '0.022', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.110', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.390', 'weapon3': '3.258', 'DAMAGECOUNT': '12.654', 'FRAGCOUNT': '45.000'} [2024-08-06 01:36:13,168][52659] DAMAGECOUNT value on done: 216643.0 [2024-08-06 01:36:13,169][52659] Sum rewards: 61.072, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.781', 'AMMO5': '0.007', 'AMMO2': '0.043', 'AMMO3': '0.134', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.400', 'weapon2': '0.498', 'weapon4': '0.620', 'WEAPON3': '0.900', 'weapon3': '2.522', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '49.000'} [2024-08-06 01:36:13,191][52671] DAMAGECOUNT value on done: 224811.0 [2024-08-06 01:36:13,192][52671] Sum rewards: 64.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.054', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.086', 'AMMO4': '0.175', 'AMMO3': '0.224', 'weapon2': '0.270', 'weapon4': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '56.000'} [2024-08-06 01:36:13,377][52670] DAMAGECOUNT value on done: 214514.0 [2024-08-06 01:36:13,380][52670] Sum rewards: 69.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO3': '0.160', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.458', 'weapon4': '0.694', 'WEAPON3': '1.000', 'weapon3': '2.496', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:14,168][52663] DAMAGECOUNT value on done: 216372.0 [2024-08-06 01:36:14,168][52663] Sum rewards: 57.127, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.260', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.078', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'AMMO3': '0.259', 'weapon4': '0.456', 'weapon2': '0.646', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.550', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '52.000'} [2024-08-06 01:36:14,256][52666] DAMAGECOUNT value on done: 211722.0 [2024-08-06 01:36:14,256][52666] Sum rewards: 52.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.854', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.241', 'weapon4': '0.340', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '2.756', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:14,550][52664] DAMAGECOUNT value on done: 223504.0 [2024-08-06 01:36:14,550][52664] Sum rewards: 66.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.163', 'weapon5': '0.182', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'weapon4': '0.478', 'WEAPON4': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.550', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:14,984][52649] DAMAGECOUNT value on done: 211463.0 [2024-08-06 01:36:14,984][52649] Sum rewards: 75.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.511', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.134', 'AMMO4': '0.173', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.346', 'weapon4': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.918', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '65.000'} [2024-08-06 01:36:15,659][52659] DAMAGECOUNT value on done: 215123.0 [2024-08-06 01:36:15,659][52659] Sum rewards: 56.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.086', 'weapon4': '0.140', 'AMMO3': '0.164', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.792', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:15,703][52671] DAMAGECOUNT value on done: 216584.0 [2024-08-06 01:36:15,703][52671] Sum rewards: 53.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.114', 'AMMO4': '0.176', 'AMMO3': '0.216', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.060', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '47.000'} [2024-08-06 01:36:16,025][52650] Updated weights for policy 0, policy_version 31641 (0.0031) [2024-08-06 01:36:16,161][52795] DAMAGECOUNT value on done: 204166.0 [2024-08-06 01:36:16,161][52795] Sum rewards: 61.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.158', 'AMMO3': '0.197', 'AMMO4': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.650', 'weapon4': '0.944', 'WEAPON3': '1.250', 'weapon3': '2.190', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:16,221][52670] DAMAGECOUNT value on done: 216154.0 [2024-08-06 01:36:16,222][52670] Sum rewards: 55.282, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.720', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.082', 'AMMO3': '0.236', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.408', 'weapon4': '0.470', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '49.000'} [2024-08-06 01:36:16,860][52666] DAMAGECOUNT value on done: 217193.0 [2024-08-06 01:36:16,862][52666] Sum rewards: 50.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.166', 'weapon4': '0.208', 'AMMO3': '0.230', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.190', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '45.000'} [2024-08-06 01:36:17,389][52663] DAMAGECOUNT value on done: 214739.0 [2024-08-06 01:36:17,389][52663] Sum rewards: 64.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.450', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.116', 'AMMO4': '0.174', 'weapon4': '0.228', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '2.902', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '57.000'} [2024-08-06 01:36:17,651][52664] DAMAGECOUNT value on done: 225298.0 [2024-08-06 01:36:17,651][52664] Sum rewards: 58.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.237', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.486', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.252', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '50.000'} [2024-08-06 01:36:17,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 259227648. Throughput: 0: 4399.6. Samples: 64805960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:36:17,794][52567] Avg episode reward: [(0, '61.862')] [2024-08-06 01:36:17,902][52649] DAMAGECOUNT value on done: 203515.0 [2024-08-06 01:36:17,904][52649] Sum rewards: 53.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.866', 'AMMO5': '0.005', 'AMMO2': '0.055', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.274', 'WEAPON4': '0.550', 'weapon2': '0.594', 'weapon4': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.478', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '44.500'} [2024-08-06 01:36:18,396][52659] DAMAGECOUNT value on done: 216359.0 [2024-08-06 01:36:18,398][52659] Sum rewards: 60.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.524', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.224', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.402', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '52.000'} [2024-08-06 01:36:18,480][52671] DAMAGECOUNT value on done: 211430.0 [2024-08-06 01:36:18,481][52671] Sum rewards: 62.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.698', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.096', 'weapon4': '0.134', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'WEAPON4': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.784', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:18,985][52670] DAMAGECOUNT value on done: 218525.0 [2024-08-06 01:36:18,987][52670] Sum rewards: 63.836, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.870', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.130', 'AMMO3': '0.201', 'AMMO4': '0.221', 'weapon4': '0.264', 'weapon2': '0.266', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '56.000'} [2024-08-06 01:36:19,292][52795] DAMAGECOUNT value on done: 201759.0 [2024-08-06 01:36:19,294][52795] Sum rewards: 48.488, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.291', 'AMMO5': '0.014', 'weapon5': '0.054', 'AMMO2': '0.063', 'AMMO3': '0.228', 'weapon4': '0.274', 'WEAPON5': '0.300', 'AMMO4': '0.313', 'weapon2': '0.378', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '45.500'} [2024-08-06 01:36:19,710][52666] DAMAGECOUNT value on done: 210684.0 [2024-08-06 01:36:19,711][52666] Sum rewards: 59.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.592', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.169', 'weapon5': '0.220', 'AMMO4': '0.282', 'weapon2': '0.342', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.824', 'WEAPON3': '1.000', 'weapon3': '2.268', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:20,279][52663] DAMAGECOUNT value on done: 219160.0 [2024-08-06 01:36:20,279][52663] Sum rewards: 63.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.123', 'AMMO4': '0.151', 'WEAPON4': '0.300', 'weapon2': '0.598', 'weapon4': '0.662', 'WEAPON3': '0.800', 'weapon3': '2.520', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:20,691][52649] DAMAGECOUNT value on done: 211430.0 [2024-08-06 01:36:20,706][52649] Sum rewards: 69.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.618', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.196', 'weapon2': '0.420', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.420', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 01:36:21,087][52650] Updated weights for policy 0, policy_version 31651 (0.0022) [2024-08-06 01:36:21,577][52659] DAMAGECOUNT value on done: 215845.0 [2024-08-06 01:36:21,580][52659] Sum rewards: 54.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.195', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.218', 'weapon5': '0.238', 'AMMO4': '0.266', 'weapon2': '0.404', 'WEAPON5': '0.450', 'weapon4': '0.508', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.524', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '47.000'} [2024-08-06 01:36:21,738][52670] DAMAGECOUNT value on done: 204131.0 [2024-08-06 01:36:21,740][52670] Sum rewards: 50.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO4': '0.145', 'AMMO3': '0.218', 'weapon2': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.254', 'DAMAGECOUNT': '12.375', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:21,752][52671] DAMAGECOUNT value on done: 220209.0 [2024-08-06 01:36:21,752][52671] Sum rewards: 67.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.099', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '59.000'} [2024-08-06 01:36:22,355][52666] DAMAGECOUNT value on done: 212691.0 [2024-08-06 01:36:22,355][52666] Sum rewards: 67.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.742', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.160', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 01:36:22,414][52795] DAMAGECOUNT value on done: 197768.0 [2024-08-06 01:36:22,415][52795] Sum rewards: 64.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.266', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.082', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.338', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2024-08-06 01:36:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 259317760. Throughput: 0: 4394.4. Samples: 64832210. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:36:22,794][52567] Avg episode reward: [(0, '62.056')] [2024-08-06 01:36:23,325][52663] DAMAGECOUNT value on done: 217069.0 [2024-08-06 01:36:23,326][52663] Sum rewards: 73.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.636', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.276', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '60.500'} [2024-08-06 01:36:23,503][52649] DAMAGECOUNT value on done: 207518.0 [2024-08-06 01:36:23,503][52649] Sum rewards: 55.802, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.144', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.364', 'weapon2': '0.684', 'WEAPON3': '1.000', 'weapon3': '2.646', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:24,313][52670] DAMAGECOUNT value on done: 216492.0 [2024-08-06 01:36:24,314][52670] Sum rewards: 74.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.219', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.442', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '62.000'} [2024-08-06 01:36:24,323][52647] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:36:24,350][52659] DAMAGECOUNT value on done: 215784.0 [2024-08-06 01:36:24,351][52659] Sum rewards: 69.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.035', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.112', 'AMMO4': '0.163', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '58.000'} [2024-08-06 01:36:24,538][52671] DAMAGECOUNT value on done: 219333.0 [2024-08-06 01:36:24,540][52671] Sum rewards: 69.696, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.510', 'HEALTH': '0.745', 'WEAPON3': '0.950', 'weapon3': '2.898', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '57.000'} [2024-08-06 01:36:25,524][52795] DAMAGECOUNT value on done: 203100.0 [2024-08-06 01:36:25,524][52795] Sum rewards: 61.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.892', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.186', 'AMMO4': '0.217', 'AMMO3': '0.223', 'weapon2': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:25,770][52650] Updated weights for policy 0, policy_version 31661 (0.0034) [2024-08-06 01:36:25,948][52663] DAMAGECOUNT value on done: 216108.0 [2024-08-06 01:36:25,948][52663] Sum rewards: 60.096, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.684', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.232', 'AMMO3': '0.247', 'weapon2': '0.346', 'WEAPON4': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.400', 'weapon3': '2.786', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:26,234][52649] DAMAGECOUNT value on done: 215512.0 [2024-08-06 01:36:26,234][52649] Sum rewards: 56.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.234', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.228', 'weapon2': '0.328', 'WEAPON4': '0.450', 'weapon4': '0.676', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '50.000'} [2024-08-06 01:36:27,392][52670] DAMAGECOUNT value on done: 219663.0 [2024-08-06 01:36:27,392][52670] Sum rewards: 62.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.802', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '52.000'} [2024-08-06 01:36:27,519][52659] DAMAGECOUNT value on done: 215291.0 [2024-08-06 01:36:27,519][52659] Sum rewards: 67.598, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.264', 'weapon4': '0.302', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '59.000'} [2024-08-06 01:36:27,606][52647] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:36:27,655][52671] DAMAGECOUNT value on done: 221855.0 [2024-08-06 01:36:27,655][52671] Sum rewards: 67.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 259407872. Throughput: 0: 4387.5. Samples: 64858420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:36:27,794][52567] Avg episode reward: [(0, '62.547')] [2024-08-06 01:36:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031666_259407872.pth... [2024-08-06 01:36:27,920][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031151_255188992.pth [2024-08-06 01:36:28,611][52795] DAMAGECOUNT value on done: 200630.0 [2024-08-06 01:36:28,611][52795] Sum rewards: 73.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.434', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '62.000'} [2024-08-06 01:36:28,847][52663] DAMAGECOUNT value on done: 215610.0 [2024-08-06 01:36:28,849][52663] Sum rewards: 70.454, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.410', 'HEALTH': '0.694', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2024-08-06 01:36:29,289][52649] DAMAGECOUNT value on done: 210734.0 [2024-08-06 01:36:29,290][52649] Sum rewards: 61.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.137', 'AMMO3': '0.168', 'weapon4': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.144', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:30,023][52650] Updated weights for policy 0, policy_version 31671 (0.0019) [2024-08-06 01:36:30,300][52670] DAMAGECOUNT value on done: 214161.0 [2024-08-06 01:36:30,301][52670] Sum rewards: 54.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.259', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.099', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.856', 'WEAPON3': '1.250', 'HITCOUNT': '2.640', 'weapon3': '2.760', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:30,440][52659] DAMAGECOUNT value on done: 215046.0 [2024-08-06 01:36:30,441][52659] Sum rewards: 58.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.774', 'AMMO5': '0.003', 'ARMOR': '0.020', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.076', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.201', 'weapon2': '0.374', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.260', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '48.000'} [2024-08-06 01:36:30,608][52671] DAMAGECOUNT value on done: 220152.0 [2024-08-06 01:36:30,610][52671] Sum rewards: 62.876, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.452', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.094', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.352', 'WEAPON4': '0.400', 'weapon4': '0.664', 'WEAPON3': '0.950', 'weapon3': '2.702', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '50.000'} [2024-08-06 01:36:31,281][52663] DAMAGECOUNT value on done: 218110.0 [2024-08-06 01:36:31,282][52663] Sum rewards: 77.415, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.094', 'weapon5': '0.098', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '65.000'} [2024-08-06 01:36:31,368][52665] DAMAGECOUNT value on done: 213784.0 [2024-08-06 01:36:31,370][52665] Sum rewards: 58.684, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.249', 'weapon2': '0.428', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.174', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:31,699][52795] DAMAGECOUNT value on done: 197464.0 [2024-08-06 01:36:31,699][52795] Sum rewards: 64.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.224', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:32,243][52649] DAMAGECOUNT value on done: 211773.0 [2024-08-06 01:36:32,244][52649] Sum rewards: 55.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.583', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'weapon2': '0.226', 'weapon7': '0.240', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '48.000'} [2024-08-06 01:36:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 259489792. Throughput: 0: 4377.4. Samples: 64871320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:36:32,794][52567] Avg episode reward: [(0, '62.887')] [2024-08-06 01:36:33,258][52670] DAMAGECOUNT value on done: 215637.0 [2024-08-06 01:36:33,266][52670] Sum rewards: 53.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.208', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.520', 'weapon2': '0.720', 'WEAPON3': '1.300', 'weapon3': '2.592', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:33,634][52659] DAMAGECOUNT value on done: 211285.0 [2024-08-06 01:36:33,636][52659] Sum rewards: 52.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.219', 'weapon2': '0.576', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.154', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:33,751][52671] DAMAGECOUNT value on done: 217382.0 [2024-08-06 01:36:33,751][52671] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.264', 'weapon4': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '59.000'} [2024-08-06 01:36:34,393][52665] DAMAGECOUNT value on done: 218379.0 [2024-08-06 01:36:34,394][52665] Sum rewards: 65.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.129', 'AMMO5': '0.019', 'AMMO2': '0.059', 'AMMO3': '0.158', 'weapon2': '0.242', 'weapon5': '0.242', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon4': '0.822', 'WEAPON3': '0.950', 'weapon3': '2.258', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:34,464][52663] DAMAGECOUNT value on done: 219325.0 [2024-08-06 01:36:34,466][52663] Sum rewards: 65.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.138', 'weapon5': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.172', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:34,856][52795] DAMAGECOUNT value on done: 197380.0 [2024-08-06 01:36:34,858][52795] Sum rewards: 71.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.493', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.157', 'weapon5': '0.216', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.432', 'weapon4': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.640', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '59.000'} [2024-08-06 01:36:35,389][52650] Updated weights for policy 0, policy_version 31681 (0.0018) [2024-08-06 01:36:35,476][52649] DAMAGECOUNT value on done: 213124.0 [2024-08-06 01:36:35,477][52649] Sum rewards: 68.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.894', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.199', 'weapon4': '0.204', 'weapon5': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '56.500'} [2024-08-06 01:36:36,368][52659] DAMAGECOUNT value on done: 221996.0 [2024-08-06 01:36:36,370][52659] Sum rewards: 71.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.125', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.474', 'weapon4': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.634', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '61.000'} [2024-08-06 01:36:37,195][52663] DAMAGECOUNT value on done: 216489.0 [2024-08-06 01:36:37,196][52663] Sum rewards: 50.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.258', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.218', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '45.000'} [2024-08-06 01:36:37,498][52665] DAMAGECOUNT value on done: 214522.0 [2024-08-06 01:36:37,499][52665] Sum rewards: 56.777, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.336', 'weapon2': '0.570', 'WEAPON3': '1.500', 'weapon3': '2.784', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:37,794][52567] Fps is (10 sec: 15564.7, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 259563520. Throughput: 0: 4376.4. Samples: 64897810. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:36:37,795][52567] Avg episode reward: [(0, '62.556')] [2024-08-06 01:36:38,066][52795] DAMAGECOUNT value on done: 202320.0 [2024-08-06 01:36:38,068][52795] Sum rewards: 64.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.288', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.214', 'AMMO3': '0.269', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:38,679][52649] DAMAGECOUNT value on done: 210269.0 [2024-08-06 01:36:38,681][52649] Sum rewards: 66.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.264', 'weapon2': '0.318', 'WEAPON3': '1.700', 'weapon3': '3.296', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '58.500'} [2024-08-06 01:36:39,234][52650] Updated weights for policy 0, policy_version 31691 (0.0022) [2024-08-06 01:36:39,473][52659] DAMAGECOUNT value on done: 222656.0 [2024-08-06 01:36:39,476][52659] Sum rewards: 69.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.124', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '58.000'} [2024-08-06 01:36:39,989][52663] DAMAGECOUNT value on done: 210180.0 [2024-08-06 01:36:39,990][52663] Sum rewards: 59.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.176', 'AMMO5': '0.007', 'AMMO2': '0.063', 'weapon5': '0.096', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.284', 'AMMO4': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.466', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '47.500'} [2024-08-06 01:36:40,517][52665] DAMAGECOUNT value on done: 211492.0 [2024-08-06 01:36:40,517][52665] Sum rewards: 61.388, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.964', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.070', 'AMMO4': '0.215', 'weapon4': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:41,115][52795] DAMAGECOUNT value on done: 193735.0 [2024-08-06 01:36:41,116][52795] Sum rewards: 62.949, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.464', 'weapon2': '0.552', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:41,865][52649] DAMAGECOUNT value on done: 213462.0 [2024-08-06 01:36:41,867][52649] Sum rewards: 70.011, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.658', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.318', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '61.000'} [2024-08-06 01:36:42,286][52659] DAMAGECOUNT value on done: 215120.0 [2024-08-06 01:36:42,287][52659] Sum rewards: 60.989, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.054', 'weapon5': '0.126', 'HEALTH': '0.156', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.271', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.414', 'WEAPON3': '0.900', 'weapon3': '2.904', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '49.000'} [2024-08-06 01:36:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 259661824. Throughput: 0: 4379.3. Samples: 64924210. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:36:42,794][52567] Avg episode reward: [(0, '62.882')] [2024-08-06 01:36:43,083][52663] DAMAGECOUNT value on done: 210408.0 [2024-08-06 01:36:43,085][52663] Sum rewards: 79.946, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '67.000'} [2024-08-06 01:36:43,611][52665] DAMAGECOUNT value on done: 210409.0 [2024-08-06 01:36:43,611][52665] Sum rewards: 61.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.256', 'WEAPON4': '0.450', 'weapon4': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.488', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:44,342][52795] DAMAGECOUNT value on done: 205578.0 [2024-08-06 01:36:44,352][52795] Sum rewards: 55.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.170', 'AMMO3': '0.215', 'AMMO4': '0.243', 'weapon4': '0.276', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.936', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '49.000'} [2024-08-06 01:36:44,464][52650] Updated weights for policy 0, policy_version 31701 (0.0040) [2024-08-06 01:36:44,793][52803] DAMAGECOUNT value on done: 202472.0 [2024-08-06 01:36:44,794][52803] Sum rewards: 58.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.427', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO3': '0.181', 'weapon4': '0.186', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '49.000'} [2024-08-06 01:36:44,973][52649] DAMAGECOUNT value on done: 214932.0 [2024-08-06 01:36:44,975][52649] Sum rewards: 68.882, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.625', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.238', 'weapon4': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '58.000'} [2024-08-06 01:36:45,307][52659] DAMAGECOUNT value on done: 214064.0 [2024-08-06 01:36:45,309][52659] Sum rewards: 65.938, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.150', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.147', 'weapon4': '0.316', 'weapon2': '0.798', 'WEAPON3': '0.900', 'weapon3': '2.710', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '52.000'} [2024-08-06 01:36:45,869][52663] DAMAGECOUNT value on done: 217199.0 [2024-08-06 01:36:45,869][52663] Sum rewards: 72.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.364', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '61.000'} [2024-08-06 01:36:46,700][52665] DAMAGECOUNT value on done: 210234.0 [2024-08-06 01:36:46,701][52665] Sum rewards: 67.595, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.032', 'HEALTH': '0.066', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.364', 'weapon2': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:47,408][52795] DAMAGECOUNT value on done: 204827.0 [2024-08-06 01:36:47,410][52795] Sum rewards: 66.795, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.948', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.254', 'weapon4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '55.000'} [2024-08-06 01:36:47,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 259751936. Throughput: 0: 4372.2. Samples: 64937100. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:36:47,794][52567] Avg episode reward: [(0, '63.228')] [2024-08-06 01:36:47,797][52614] Saving new best policy, reward=63.228! [2024-08-06 01:36:47,817][52803] DAMAGECOUNT value on done: 203337.0 [2024-08-06 01:36:47,821][52803] Sum rewards: 47.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.709', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.166', 'AMMO4': '0.185', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.012', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '42.000'} [2024-08-06 01:36:48,035][52649] DAMAGECOUNT value on done: 205407.0 [2024-08-06 01:36:48,035][52649] Sum rewards: 58.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.234', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.177', 'weapon2': '0.246', 'weapon5': '0.246', 'AMMO4': '0.248', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.340', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '49.000'} [2024-08-06 01:36:48,637][52659] DAMAGECOUNT value on done: 210636.0 [2024-08-06 01:36:48,637][52659] Sum rewards: 57.006, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.998', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.046', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.394', 'weapon4': '0.604', 'WEAPON3': '1.400', 'weapon3': '2.640', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:48,669][52663] DAMAGECOUNT value on done: 218930.0 [2024-08-06 01:36:48,670][52663] Sum rewards: 74.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.635', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '61.000'} [2024-08-06 01:36:49,304][52650] Updated weights for policy 0, policy_version 31711 (0.0026) [2024-08-06 01:36:49,867][52665] DAMAGECOUNT value on done: 215153.0 [2024-08-06 01:36:49,869][52665] Sum rewards: 48.758, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.458', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.236', 'weapon2': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.224', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '45.000'} [2024-08-06 01:36:50,596][52795] DAMAGECOUNT value on done: 193775.0 [2024-08-06 01:36:50,596][52795] Sum rewards: 61.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.476', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.138', 'AMMO3': '0.225', 'AMMO4': '0.258', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:51,030][52803] DAMAGECOUNT value on done: 201123.0 [2024-08-06 01:36:51,030][52803] Sum rewards: 62.882, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.084', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.092', 'AMMO4': '0.145', 'weapon2': '0.262', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.382', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '54.500'} [2024-08-06 01:36:51,156][52649] DAMAGECOUNT value on done: 211699.0 [2024-08-06 01:36:51,156][52649] Sum rewards: 68.504, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.236', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '0.850', 'weapon2': '0.882', 'weapon3': '2.418', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:51,379][52659] DAMAGECOUNT value on done: 217311.0 [2024-08-06 01:36:51,382][52659] Sum rewards: 67.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.940', 'AMMO5': '0.013', 'AMMO2': '0.058', 'AMMO3': '0.195', 'weapon5': '0.196', 'AMMO4': '0.289', 'WEAPON5': '0.350', 'weapon2': '0.394', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.660', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '57.000'} [2024-08-06 01:36:51,567][52663] DAMAGECOUNT value on done: 218510.0 [2024-08-06 01:36:51,568][52663] Sum rewards: 73.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.881', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.124', 'AMMO3': '0.177', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon4': '0.382', 'WEAPON4': '0.450', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.698', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '61.500'} [2024-08-06 01:36:52,509][52811] DAMAGECOUNT value on done: 212162.0 [2024-08-06 01:36:52,509][52811] Sum rewards: 60.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.082', 'AMMO3': '0.186', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.706', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 259842048. Throughput: 0: 4371.1. Samples: 64963370. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 01:36:52,795][52567] Avg episode reward: [(0, '63.057')] [2024-08-06 01:36:52,890][52665] DAMAGECOUNT value on done: 214893.0 [2024-08-06 01:36:52,892][52665] Sum rewards: 58.726, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.064', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon2': '0.662', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.070', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '48.000'} [2024-08-06 01:36:53,800][52650] Updated weights for policy 0, policy_version 31721 (0.0022) [2024-08-06 01:36:53,806][52795] DAMAGECOUNT value on done: 207044.0 [2024-08-06 01:36:53,809][52795] Sum rewards: 60.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.656', 'AMMO5': '0.022', 'AMMO2': '0.042', 'weapon5': '0.192', 'AMMO4': '0.212', 'AMMO3': '0.238', 'weapon2': '0.286', 'weapon4': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '51.000'} [2024-08-06 01:36:53,971][52803] DAMAGECOUNT value on done: 203511.0 [2024-08-06 01:36:53,973][52803] Sum rewards: 66.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.145', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.169', 'AMMO4': '0.172', 'weapon5': '0.182', 'weapon2': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon4': '0.866', 'WEAPON3': '1.050', 'weapon3': '2.422', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '54.000'} [2024-08-06 01:36:54,031][52659] DAMAGECOUNT value on done: 218968.0 [2024-08-06 01:36:54,032][52659] Sum rewards: 45.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.878', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.190', 'AMMO3': '0.206', 'AMMO4': '0.240', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '2.596', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '43.000'} [2024-08-06 01:36:54,167][52649] DAMAGECOUNT value on done: 209949.0 [2024-08-06 01:36:54,167][52649] Sum rewards: 54.778, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.807', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.694', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '3.142', 'DAMAGECOUNT': '12.876', 'FRAGCOUNT': '46.000'} [2024-08-06 01:36:54,623][52663] DAMAGECOUNT value on done: 221511.0 [2024-08-06 01:36:54,625][52663] Sum rewards: 70.101, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.695', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon4': '0.216', 'weapon2': '0.592', 'WEAPON3': '0.900', 'weapon3': '3.086', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '56.000'} [2024-08-06 01:36:55,637][52811] DAMAGECOUNT value on done: 201096.0 [2024-08-06 01:36:55,639][52811] Sum rewards: 68.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.834', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.600', 'weapon3': '2.770', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '57.000'} [2024-08-06 01:36:55,771][52665] DAMAGECOUNT value on done: 219222.0 [2024-08-06 01:36:55,773][52665] Sum rewards: 59.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.892', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.164', 'weapon5': '0.168', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.580', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '49.000'} [2024-08-06 01:36:56,875][52649] DAMAGECOUNT value on done: 216830.0 [2024-08-06 01:36:56,878][52649] Sum rewards: 66.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.300', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.148', 'weapon5': '0.190', 'AMMO3': '0.201', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '58.000'} [2024-08-06 01:36:57,028][52659] DAMAGECOUNT value on done: 222456.0 [2024-08-06 01:36:57,029][52659] Sum rewards: 63.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.741', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.106', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.256', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:57,040][52795] DAMAGECOUNT value on done: 206742.0 [2024-08-06 01:36:57,043][52795] Sum rewards: 72.807, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.039', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.126', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '60.500'} [2024-08-06 01:36:57,115][52803] DAMAGECOUNT value on done: 206497.0 [2024-08-06 01:36:57,115][52803] Sum rewards: 74.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.140', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.153', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.370', 'weapon4': '0.402', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '59.000'} [2024-08-06 01:36:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 259923968. Throughput: 0: 4371.6. Samples: 64989710. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:36:57,794][52567] Avg episode reward: [(0, '62.909')] [2024-08-06 01:36:57,896][52663] DAMAGECOUNT value on done: 219122.0 [2024-08-06 01:36:57,897][52663] Sum rewards: 64.369, reward structure: {'DEATHCOUNT': '-12.750', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon2': '0.562', 'WEAPON3': '0.950', 'HEALTH': '1.022', 'weapon3': '2.978', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '52.000'} [2024-08-06 01:36:58,360][52665] DAMAGECOUNT value on done: 216254.0 [2024-08-06 01:36:58,368][52665] Sum rewards: 60.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.194', 'AMMO3': '0.232', 'AMMO4': '0.240', 'weapon2': '0.310', 'weapon4': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '53.000'} [2024-08-06 01:36:58,516][52650] Updated weights for policy 0, policy_version 31731 (0.0032) [2024-08-06 01:36:58,801][52811] DAMAGECOUNT value on done: 202939.0 [2024-08-06 01:36:58,804][52811] Sum rewards: 47.894, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.552', 'AMMO5': '0.007', 'AMMO2': '0.035', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.310', 'WEAPON3': '0.750', 'weapon2': '1.002', 'weapon3': '2.262', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.010', 'FRAGCOUNT': '38.000'} [2024-08-06 01:36:59,523][52649] DAMAGECOUNT value on done: 216618.0 [2024-08-06 01:36:59,523][52649] Sum rewards: 53.176, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.212', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:00,025][52659] DAMAGECOUNT value on done: 221490.0 [2024-08-06 01:37:00,025][52659] Sum rewards: 70.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.375', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '60.000'} [2024-08-06 01:37:00,215][52803] DAMAGECOUNT value on done: 204821.0 [2024-08-06 01:37:00,215][52803] Sum rewards: 62.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.667', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.082', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '53.000'} [2024-08-06 01:37:00,759][52665] DAMAGECOUNT value on done: 221963.0 [2024-08-06 01:37:00,760][52665] Sum rewards: 67.591, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.285', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 01:37:00,978][52663] DAMAGECOUNT value on done: 216103.0 [2024-08-06 01:37:00,979][52663] Sum rewards: 58.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.174', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '49.000'} [2024-08-06 01:37:01,831][52811] DAMAGECOUNT value on done: 202232.0 [2024-08-06 01:37:01,831][52811] Sum rewards: 53.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.015', 'ARMOR': '0.016', 'AMMO2': '0.042', 'weapon5': '0.202', 'AMMO3': '0.204', 'AMMO4': '0.208', 'WEAPON5': '0.400', 'weapon4': '0.546', 'WEAPON4': '0.600', 'weapon2': '0.676', 'WEAPON3': '1.250', 'weapon3': '2.322', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '48.500'} [2024-08-06 01:37:01,941][52649] DAMAGECOUNT value on done: 220879.0 [2024-08-06 01:37:01,942][52649] Sum rewards: 61.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.765', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.238', 'weapon4': '0.242', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '53.000'} [2024-08-06 01:37:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 260014080. Throughput: 0: 4376.2. Samples: 65002890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:37:02,795][52567] Avg episode reward: [(0, '62.691')] [2024-08-06 01:37:02,846][52659] DAMAGECOUNT value on done: 215945.0 [2024-08-06 01:37:02,847][52659] Sum rewards: 61.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.192', 'weapon2': '0.410', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.364', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:03,045][52665] DAMAGECOUNT value on done: 218860.0 [2024-08-06 01:37:03,045][52665] Sum rewards: 59.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.056', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO4': '0.145', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.126', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:03,247][52803] DAMAGECOUNT value on done: 203960.0 [2024-08-06 01:37:03,251][52803] Sum rewards: 58.120, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.545', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'AMMO3': '0.087', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.322', 'WEAPON3': '0.750', 'weapon2': '0.770', 'weapon3': '2.688', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '45.000'} [2024-08-06 01:37:03,254][52650] Updated weights for policy 0, policy_version 31741 (0.0011) [2024-08-06 01:37:03,479][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:37:04,207][52820] DAMAGECOUNT value on done: 199593.0 [2024-08-06 01:37:04,207][52820] Sum rewards: 50.490, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon2': '0.384', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.014', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:04,945][52659] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:37:04,952][52811] DAMAGECOUNT value on done: 203388.0 [2024-08-06 01:37:04,953][52811] Sum rewards: 62.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.196', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.171', 'weapon4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.242', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '53.000'} [2024-08-06 01:37:05,491][52659] DAMAGECOUNT value on done: 222504.0 [2024-08-06 01:37:05,493][52659] Sum rewards: 67.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.838', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon5': '0.168', 'AMMO4': '0.194', 'AMMO3': '0.234', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '57.500'} [2024-08-06 01:37:05,797][52665] DAMAGECOUNT value on done: 216441.0 [2024-08-06 01:37:05,801][52665] Sum rewards: 68.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.047', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.146', 'AMMO3': '0.240', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '60.000'} [2024-08-06 01:37:06,214][52803] DAMAGECOUNT value on done: 199144.0 [2024-08-06 01:37:06,215][52803] Sum rewards: 62.559, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.237', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.066', 'weapon4': '0.124', 'AMMO4': '0.198', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.307', 'WEAPON3': '1.900', 'weapon3': '3.304', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '57.000'} [2024-08-06 01:37:07,521][52820] DAMAGECOUNT value on done: 202016.0 [2024-08-06 01:37:07,521][52820] Sum rewards: 78.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.747', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.050', 'weapon3': '3.292', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '65.000'} [2024-08-06 01:37:07,540][52650] Updated weights for policy 0, policy_version 31751 (0.0013) [2024-08-06 01:37:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 260104192. Throughput: 0: 4378.9. Samples: 65029260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:37:07,794][52567] Avg episode reward: [(0, '63.167')] [2024-08-06 01:37:08,066][52811] DAMAGECOUNT value on done: 208418.0 [2024-08-06 01:37:08,068][52811] Sum rewards: 71.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.395', 'AMMO5': '0.010', 'weapon7': '0.050', 'AMMO2': '0.051', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.135', 'WEAPON7': '0.200', 'weapon5': '0.238', 'AMMO4': '0.253', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON3': '0.750', 'weapon4': '0.790', 'weapon3': '2.044', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '59.000'} [2024-08-06 01:37:08,442][52659] DAMAGECOUNT value on done: 220509.0 [2024-08-06 01:37:08,442][52659] Sum rewards: 46.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.349', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon5': '0.174', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.257', 'weapon2': '0.488', 'WEAPON4': '0.550', 'weapon4': '0.782', 'WEAPON3': '1.150', 'weapon3': '2.312', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '11.607', 'FRAGCOUNT': '42.000'} [2024-08-06 01:37:08,944][52665] DAMAGECOUNT value on done: 215061.0 [2024-08-06 01:37:08,952][52665] Sum rewards: 59.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'weapon2': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.226', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '50.000'} [2024-08-06 01:37:09,325][52803] DAMAGECOUNT value on done: 203761.0 [2024-08-06 01:37:09,325][52803] Sum rewards: 72.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.204', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '62.000'} [2024-08-06 01:37:10,652][52820] DAMAGECOUNT value on done: 199522.0 [2024-08-06 01:37:10,653][52820] Sum rewards: 64.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.616', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '53.500'} [2024-08-06 01:37:11,122][52811] DAMAGECOUNT value on done: 205520.0 [2024-08-06 01:37:11,124][52811] Sum rewards: 66.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.306', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:11,621][52647] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.546, 182.0), ('AMMO2', -0.0001, -1.0), ('AMMO4', -0.0005, -1.0), ('weapon4', 0.002)] [2024-08-06 01:37:11,910][52665] DAMAGECOUNT value on done: 216248.0 [2024-08-06 01:37:11,912][52665] Sum rewards: 74.173, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.411', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.092', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'weapon4': '0.432', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '58.000'} [2024-08-06 01:37:12,191][52663] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:37:12,413][52803] DAMAGECOUNT value on done: 200598.0 [2024-08-06 01:37:12,415][52803] Sum rewards: 67.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.875', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.044', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.210', 'weapon2': '0.832', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:12,563][52650] Updated weights for policy 0, policy_version 31761 (0.0011) [2024-08-06 01:37:12,746][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:37:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 260186112. Throughput: 0: 4383.5. Samples: 65055680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:37:12,795][52567] Avg episode reward: [(0, '63.617')] [2024-08-06 01:37:12,828][52614] Saving new best policy, reward=63.617! [2024-08-06 01:37:13,590][52820] DAMAGECOUNT value on done: 193820.0 [2024-08-06 01:37:13,592][52820] Sum rewards: 64.312, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.964', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.204', 'weapon2': '0.276', 'AMMO3': '0.328', 'WEAPON3': '1.950', 'weapon3': '3.302', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '58.000'} [2024-08-06 01:37:14,304][52811] DAMAGECOUNT value on done: 203278.0 [2024-08-06 01:37:14,304][52811] Sum rewards: 50.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.600', 'HITCOUNT': '2.970', 'weapon3': '2.994', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '44.000'} [2024-08-06 01:37:15,074][52665] DAMAGECOUNT value on done: 214328.0 [2024-08-06 01:37:15,076][52665] Sum rewards: 67.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.749', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.187', 'weapon2': '0.772', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:15,615][52803] DAMAGECOUNT value on done: 208649.0 [2024-08-06 01:37:15,617][52803] Sum rewards: 49.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.210', 'AMMO3': '0.232', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.554', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '42.000'} [2024-08-06 01:37:16,741][52820] DAMAGECOUNT value on done: 202321.0 [2024-08-06 01:37:16,743][52820] Sum rewards: 61.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.380', 'weapon4': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:17,101][52650] Updated weights for policy 0, policy_version 31771 (0.0033) [2024-08-06 01:37:17,462][52811] DAMAGECOUNT value on done: 210593.0 [2024-08-06 01:37:17,463][52811] Sum rewards: 69.142, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.056', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'weapon2': '0.384', 'WEAPON3': '1.650', 'weapon3': '3.206', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '59.000'} [2024-08-06 01:37:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 260276224. Throughput: 0: 4383.6. Samples: 65068580. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:37:17,794][52567] Avg episode reward: [(0, '63.191')] [2024-08-06 01:37:17,924][52665] DAMAGECOUNT value on done: 213644.0 [2024-08-06 01:37:17,925][52665] Sum rewards: 66.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.198', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '57.000'} [2024-08-06 01:37:18,727][52803] DAMAGECOUNT value on done: 205912.0 [2024-08-06 01:37:18,727][52803] Sum rewards: 64.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.079', 'weapon5': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.348', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '54.000'} [2024-08-06 01:37:19,886][52820] DAMAGECOUNT value on done: 199768.0 [2024-08-06 01:37:19,886][52820] Sum rewards: 75.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon4': '0.376', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '63.000'} [2024-08-06 01:37:20,429][52665] DAMAGECOUNT value on done: 211686.0 [2024-08-06 01:37:20,429][52665] Sum rewards: 54.608, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.425', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.182', 'weapon5': '0.264', 'AMMO3': '0.285', 'AMMO4': '0.286', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.904', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '50.000'} [2024-08-06 01:37:20,477][52811] DAMAGECOUNT value on done: 204846.0 [2024-08-06 01:37:20,477][52811] Sum rewards: 66.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.314', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO4': '0.156', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.254', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:20,711][52803] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:37:21,606][52650] Updated weights for policy 0, policy_version 31781 (0.0012) [2024-08-06 01:37:21,817][52803] DAMAGECOUNT value on done: 204850.0 [2024-08-06 01:37:21,817][52803] Sum rewards: 67.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.126', 'weapon5': '0.162', 'AMMO4': '0.175', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.940', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 260366336. Throughput: 0: 4378.4. Samples: 65094840. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:37:22,794][52567] Avg episode reward: [(0, '63.356')] [2024-08-06 01:37:22,917][52665] DAMAGECOUNT value on done: 217449.0 [2024-08-06 01:37:22,917][52665] Sum rewards: 60.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.655', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.072', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.252', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '53.000'} [2024-08-06 01:37:23,039][52820] DAMAGECOUNT value on done: 200963.0 [2024-08-06 01:37:23,040][52820] Sum rewards: 70.148, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.177', 'HEALTH': '0.296', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '3.136', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:23,651][52811] DAMAGECOUNT value on done: 203863.0 [2024-08-06 01:37:23,651][52811] Sum rewards: 75.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon4': '0.112', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '61.500'} [2024-08-06 01:37:24,930][52803] DAMAGECOUNT value on done: 207446.0 [2024-08-06 01:37:24,953][52803] Sum rewards: 69.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.345', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.148', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'weapon4': '0.564', 'WEAPON3': '1.650', 'weapon3': '2.720', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '59.500'} [2024-08-06 01:37:25,888][52665] DAMAGECOUNT value on done: 214924.0 [2024-08-06 01:37:25,888][52665] Sum rewards: 68.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.159', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.562', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:25,925][52668] DAMAGECOUNT value on done: 215997.0 [2024-08-06 01:37:25,925][52668] Sum rewards: 71.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO3': '0.166', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.312', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '58.000'} [2024-08-06 01:37:26,130][52820] DAMAGECOUNT value on done: 206374.0 [2024-08-06 01:37:26,130][52820] Sum rewards: 68.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.657', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.106', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '58.000'} [2024-08-06 01:37:26,475][52650] Updated weights for policy 0, policy_version 31791 (0.0013) [2024-08-06 01:37:26,844][52811] DAMAGECOUNT value on done: 206399.0 [2024-08-06 01:37:26,847][52811] Sum rewards: 81.345, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.003', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.242', 'weapon2': '0.540', 'WEAPON3': '0.950', 'weapon3': '3.022', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.000'} [2024-08-06 01:37:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 260456448. Throughput: 0: 4381.3. Samples: 65121370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:37:27,794][52567] Avg episode reward: [(0, '63.745')] [2024-08-06 01:37:27,797][52614] Saving new best policy, reward=63.745! [2024-08-06 01:37:28,084][52803] DAMAGECOUNT value on done: 203625.0 [2024-08-06 01:37:28,085][52803] Sum rewards: 62.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.036', 'weapon5': '0.106', 'AMMO4': '0.171', 'AMMO3': '0.214', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.420', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '54.000'} [2024-08-06 01:37:29,190][52668] DAMAGECOUNT value on done: 224895.0 [2024-08-06 01:37:29,191][52668] Sum rewards: 71.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.840', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.235', 'weapon2': '0.282', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.464', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '62.000'} [2024-08-06 01:37:29,192][52820] DAMAGECOUNT value on done: 202069.0 [2024-08-06 01:37:29,193][52820] Sum rewards: 64.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.127', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.480', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '52.000'} [2024-08-06 01:37:29,334][52662] DAMAGECOUNT value on done: 225542.0 [2024-08-06 01:37:29,334][52662] Sum rewards: 84.150, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '66.000'} [2024-08-06 01:37:29,626][52667] DAMAGECOUNT value on done: 218906.0 [2024-08-06 01:37:29,626][52667] Sum rewards: 56.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon2': '0.196', 'weapon5': '0.198', 'AMMO4': '0.222', 'AMMO3': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.758', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '50.000'} [2024-08-06 01:37:30,002][52811] DAMAGECOUNT value on done: 202985.0 [2024-08-06 01:37:30,005][52811] Sum rewards: 72.844, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.070', 'HEALTH': '0.096', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.752', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '60.000'} [2024-08-06 01:37:30,440][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:37:31,201][52803] DAMAGECOUNT value on done: 201028.0 [2024-08-06 01:37:31,202][52803] Sum rewards: 58.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.595', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO4': '0.221', 'weapon2': '0.226', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.784', 'WEAPON3': '1.300', 'weapon3': '2.576', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:31,323][52650] Updated weights for policy 0, policy_version 31801 (0.0011) [2024-08-06 01:37:31,878][52668] DAMAGECOUNT value on done: 220540.0 [2024-08-06 01:37:31,878][52668] Sum rewards: 66.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.761', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.066', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.256', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:32,228][52820] DAMAGECOUNT value on done: 203864.0 [2024-08-06 01:37:32,231][52820] Sum rewards: 58.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.997', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.460', 'weapon2': '0.584', 'WEAPON3': '1.550', 'weapon3': '2.598', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:32,350][52662] DAMAGECOUNT value on done: 225635.0 [2024-08-06 01:37:32,350][52662] Sum rewards: 47.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.232', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.120', 'AMMO3': '0.189', 'AMMO4': '0.235', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.646', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '41.000'} [2024-08-06 01:37:32,540][52667] DAMAGECOUNT value on done: 220321.0 [2024-08-06 01:37:32,542][52667] Sum rewards: 74.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.213', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '59.000'} [2024-08-06 01:37:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 260538368. Throughput: 0: 4382.2. Samples: 65134300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:37:32,794][52567] Avg episode reward: [(0, '63.950')] [2024-08-06 01:37:32,795][52614] Saving new best policy, reward=63.950! [2024-08-06 01:37:33,136][52811] DAMAGECOUNT value on done: 208192.0 [2024-08-06 01:37:33,137][52811] Sum rewards: 65.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'AMMO4': '0.174', 'weapon2': '0.498', 'WEAPON4': '0.550', 'weapon4': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.688', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:34,011][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:37:34,359][52803] DAMAGECOUNT value on done: 210949.0 [2024-08-06 01:37:34,362][52803] Sum rewards: 71.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.179', 'weapon4': '0.224', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.904', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '62.000'} [2024-08-06 01:37:34,812][52668] DAMAGECOUNT value on done: 222588.0 [2024-08-06 01:37:34,814][52668] Sum rewards: 66.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.768', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.078', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.930', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:35,028][52662] DAMAGECOUNT value on done: 225793.0 [2024-08-06 01:37:35,028][52662] Sum rewards: 66.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.079', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.398', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.654', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:35,373][52820] DAMAGECOUNT value on done: 204001.0 [2024-08-06 01:37:35,374][52820] Sum rewards: 65.286, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.480', 'weapon2': '0.524', 'WEAPON3': '1.500', 'weapon3': '2.728', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '60.000'} [2024-08-06 01:37:35,657][52667] DAMAGECOUNT value on done: 222961.0 [2024-08-06 01:37:35,660][52667] Sum rewards: 72.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.198', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '59.000'} [2024-08-06 01:37:35,870][52650] Updated weights for policy 0, policy_version 31811 (0.0011) [2024-08-06 01:37:36,199][52811] DAMAGECOUNT value on done: 205667.0 [2024-08-06 01:37:36,203][52811] Sum rewards: 70.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon4': '0.366', 'WEAPON4': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.638', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '59.000'} [2024-08-06 01:37:37,486][52662] DAMAGECOUNT value on done: 216341.0 [2024-08-06 01:37:37,487][52662] Sum rewards: 63.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.705', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.104', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.282', 'weapon2': '0.384', 'WEAPON3': '1.600', 'weapon3': '3.214', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:37,628][52803] DAMAGECOUNT value on done: 202535.0 [2024-08-06 01:37:37,629][52803] Sum rewards: 50.067, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.676', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.520', 'WEAPON3': '1.750', 'weapon3': '2.830', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 260628480. Throughput: 0: 4379.8. Samples: 65160460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:37:37,794][52567] Avg episode reward: [(0, '64.258')] [2024-08-06 01:37:37,797][52614] Saving new best policy, reward=64.258! [2024-08-06 01:37:38,126][52668] DAMAGECOUNT value on done: 213688.0 [2024-08-06 01:37:38,129][52668] Sum rewards: 59.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.151', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.183', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:38,270][52667] DAMAGECOUNT value on done: 215995.0 [2024-08-06 01:37:38,272][52667] Sum rewards: 61.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.360', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '53.000'} [2024-08-06 01:37:38,467][52820] DAMAGECOUNT value on done: 204891.0 [2024-08-06 01:37:38,469][52820] Sum rewards: 56.547, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.005', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'AMMO4': '0.243', 'weapon4': '0.358', 'WEAPON4': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.400', 'weapon3': '2.748', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '48.000'} [2024-08-06 01:37:38,674][52647] DAMAGECOUNT value on done: 233291.0 [2024-08-06 01:37:38,674][52647] Sum rewards: 62.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.623', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.062', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.260', 'weapon4': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '53.500'} [2024-08-06 01:37:39,323][52811] DAMAGECOUNT value on done: 203443.0 [2024-08-06 01:37:39,323][52811] Sum rewards: 64.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.992', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.128', 'weapon4': '0.160', 'AMMO3': '0.200', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:40,262][52662] DAMAGECOUNT value on done: 222597.0 [2024-08-06 01:37:40,262][52662] Sum rewards: 54.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.432', 'AMMO5': '0.009', 'AMMO2': '0.059', 'weapon5': '0.110', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'weapon2': '0.274', 'AMMO4': '0.293', 'WEAPON4': '0.500', 'weapon4': '0.762', 'WEAPON3': '0.900', 'weapon3': '2.528', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '46.000'} [2024-08-06 01:37:40,535][52650] Updated weights for policy 0, policy_version 31821 (0.0011) [2024-08-06 01:37:40,709][52803] DAMAGECOUNT value on done: 208334.0 [2024-08-06 01:37:40,711][52803] Sum rewards: 67.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.218', 'weapon4': '0.250', 'weapon2': '0.684', 'WEAPON3': '1.400', 'weapon3': '2.908', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '57.000'} [2024-08-06 01:37:41,184][52668] DAMAGECOUNT value on done: 218552.0 [2024-08-06 01:37:41,186][52668] Sum rewards: 64.303, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.443', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.267', 'WEAPON4': '0.400', 'weapon4': '0.596', 'WEAPON3': '1.550', 'weapon3': '2.716', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2024-08-06 01:37:41,347][52667] DAMAGECOUNT value on done: 222797.0 [2024-08-06 01:37:41,347][52667] Sum rewards: 69.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.831', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.094', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.248', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.112', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '60.000'} [2024-08-06 01:37:41,425][52820] DAMAGECOUNT value on done: 201216.0 [2024-08-06 01:37:41,426][52820] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.836', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.228', 'AMMO3': '0.243', 'AMMO4': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.484', 'weapon2': '0.494', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.430', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '48.000'} [2024-08-06 01:37:41,466][52660] DAMAGECOUNT value on done: 217288.0 [2024-08-06 01:37:41,467][52660] Sum rewards: 74.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.325', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.101', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '61.000'} [2024-08-06 01:37:41,528][52647] DAMAGECOUNT value on done: 229448.0 [2024-08-06 01:37:41,528][52647] Sum rewards: 59.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon5': '0.046', 'weapon4': '0.062', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.378', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:42,327][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:37:42,436][52811] DAMAGECOUNT value on done: 203784.0 [2024-08-06 01:37:42,438][52811] Sum rewards: 64.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.134', 'AMMO3': '0.190', 'weapon4': '0.208', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '53.000'} [2024-08-06 01:37:42,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 260710400. Throughput: 0: 4374.0. Samples: 65186540. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:37:42,795][52567] Avg episode reward: [(0, '64.195')] [2024-08-06 01:37:43,124][52662] DAMAGECOUNT value on done: 217695.0 [2024-08-06 01:37:43,132][52662] Sum rewards: 55.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.742', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.652', 'weapon4': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.204', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.885', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:43,879][52803] DAMAGECOUNT value on done: 198873.0 [2024-08-06 01:37:43,879][52803] Sum rewards: 68.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.112', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.162', 'AMMO3': '0.209', 'AMMO4': '0.280', 'weapon2': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '58.000'} [2024-08-06 01:37:44,119][52647] DAMAGECOUNT value on done: 231204.0 [2024-08-06 01:37:44,124][52647] Sum rewards: 52.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'ARMOR': '0.012', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.196', 'AMMO4': '0.197', 'AMMO3': '0.210', 'WEAPON5': '0.350', 'weapon2': '0.370', 'weapon4': '0.382', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:44,175][52668] DAMAGECOUNT value on done: 217445.0 [2024-08-06 01:37:44,175][52668] Sum rewards: 69.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.814', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:44,450][52660] DAMAGECOUNT value on done: 216526.0 [2024-08-06 01:37:44,453][52660] Sum rewards: 61.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.430', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.330', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.430', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '50.000'} [2024-08-06 01:37:44,471][52667] DAMAGECOUNT value on done: 219626.0 [2024-08-06 01:37:44,471][52667] Sum rewards: 59.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.202', 'weapon5': '0.208', 'weapon2': '0.398', 'weapon4': '0.526', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.608', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '50.500'} [2024-08-06 01:37:44,571][52820] DAMAGECOUNT value on done: 202617.0 [2024-08-06 01:37:44,571][52820] Sum rewards: 42.382, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'AMMO3': '0.109', 'weapon5': '0.146', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON4': '0.550', 'WEAPON3': '0.750', 'weapon4': '1.378', 'weapon3': '1.672', 'HITCOUNT': '2.380', 'DAMAGECOUNT': '10.737', 'FRAGCOUNT': '34.000'} [2024-08-06 01:37:45,224][52650] Updated weights for policy 0, policy_version 31831 (0.0030) [2024-08-06 01:37:45,392][52649] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:37:45,499][52811] DAMAGECOUNT value on done: 209275.0 [2024-08-06 01:37:45,500][52811] Sum rewards: 61.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.366', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.154', 'AMMO4': '0.183', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.462', 'weapon4': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.560', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '53.000'} [2024-08-06 01:37:46,052][52662] DAMAGECOUNT value on done: 223816.0 [2024-08-06 01:37:46,052][52662] Sum rewards: 57.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.048', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.302', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.156', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '48.000'} [2024-08-06 01:37:46,861][52647] DAMAGECOUNT value on done: 233033.0 [2024-08-06 01:37:46,862][52647] Sum rewards: 62.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.965', 'AMMO5': '0.003', 'weapon5': '0.050', 'AMMO2': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.256', 'AMMO4': '0.297', 'WEAPON4': '0.450', 'weapon4': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '53.500'} [2024-08-06 01:37:46,954][52668] DAMAGECOUNT value on done: 220506.0 [2024-08-06 01:37:46,954][52668] Sum rewards: 62.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.315', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.106', 'AMMO3': '0.227', 'AMMO4': '0.229', 'weapon2': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:47,233][52660] DAMAGECOUNT value on done: 220349.0 [2024-08-06 01:37:47,235][52660] Sum rewards: 67.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.110', 'weapon4': '0.140', 'AMMO4': '0.145', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.332', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '57.000'} [2024-08-06 01:37:47,529][52667] DAMAGECOUNT value on done: 223378.0 [2024-08-06 01:37:47,529][52667] Sum rewards: 61.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.416', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '50.000'} [2024-08-06 01:37:47,651][52820] DAMAGECOUNT value on done: 205277.0 [2024-08-06 01:37:47,652][52820] Sum rewards: 57.211, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.375', 'AMMO5': '0.023', 'AMMO2': '0.053', 'AMMO3': '0.249', 'AMMO4': '0.263', 'weapon5': '0.266', 'weapon4': '0.324', 'weapon2': '0.442', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.588', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 260800512. Throughput: 0: 4373.5. Samples: 65199700. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:37:47,795][52567] Avg episode reward: [(0, '63.847')] [2024-08-06 01:37:48,549][52811] DAMAGECOUNT value on done: 204375.0 [2024-08-06 01:37:48,551][52811] Sum rewards: 67.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'AMMO4': '0.218', 'weapon2': '0.282', 'WEAPON4': '0.350', 'weapon4': '0.468', 'WEAPON3': '0.950', 'weapon3': '3.020', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:49,290][52662] DAMAGECOUNT value on done: 228027.0 [2024-08-06 01:37:49,292][52662] Sum rewards: 51.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.765', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.704', 'WEAPON3': '1.400', 'weapon3': '2.702', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '45.000'} [2024-08-06 01:37:49,549][52668] DAMAGECOUNT value on done: 219212.0 [2024-08-06 01:37:49,549][52668] Sum rewards: 53.414, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.248', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.328', 'weapon2': '0.592', 'WEAPON3': '1.900', 'HITCOUNT': '3.120', 'weapon3': '3.148', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:49,760][52647] DAMAGECOUNT value on done: 232313.0 [2024-08-06 01:37:49,761][52647] Sum rewards: 75.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.768', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.172', 'AMMO3': '0.242', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON4': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.500', 'weapon3': '2.566', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '64.000'} [2024-08-06 01:37:49,814][52660] DAMAGECOUNT value on done: 220192.0 [2024-08-06 01:37:49,814][52660] Sum rewards: 66.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.847', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.088', 'weapon4': '0.134', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.826', 'WEAPON3': '1.250', 'weapon3': '2.760', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:49,925][52650] Updated weights for policy 0, policy_version 31841 (0.0021) [2024-08-06 01:37:50,595][52667] DAMAGECOUNT value on done: 217838.0 [2024-08-06 01:37:50,595][52667] Sum rewards: 67.530, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.521', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.183', 'AMMO3': '0.193', 'weapon2': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.328', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '57.000'} [2024-08-06 01:37:50,758][52820] DAMAGECOUNT value on done: 203736.0 [2024-08-06 01:37:50,759][52820] Sum rewards: 53.015, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'HEALTH': '0.220', 'weapon2': '0.236', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '3.156', 'DAMAGECOUNT': '12.705', 'FRAGCOUNT': '44.500'} [2024-08-06 01:37:51,754][52811] DAMAGECOUNT value on done: 208189.0 [2024-08-06 01:37:51,754][52811] Sum rewards: 65.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.230', 'weapon4': '0.270', 'weapon2': '1.130', 'WEAPON3': '1.400', 'weapon3': '2.362', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:52,118][52668] DAMAGECOUNT value on done: 221074.0 [2024-08-06 01:37:52,118][52668] Sum rewards: 65.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.387', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'weapon4': '0.222', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '57.000'} [2024-08-06 01:37:52,210][52662] DAMAGECOUNT value on done: 220759.0 [2024-08-06 01:37:52,210][52662] Sum rewards: 49.415, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.323', 'weapon2': '0.334', 'WEAPON3': '1.850', 'weapon3': '3.084', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '48.500'} [2024-08-06 01:37:52,412][52660] DAMAGECOUNT value on done: 220715.0 [2024-08-06 01:37:52,414][52660] Sum rewards: 70.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.584', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.144', 'weapon2': '0.188', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '58.000'} [2024-08-06 01:37:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 260890624. Throughput: 0: 4377.3. Samples: 65226240. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:37:52,795][52567] Avg episode reward: [(0, '63.670')] [2024-08-06 01:37:52,832][52647] DAMAGECOUNT value on done: 235282.0 [2024-08-06 01:37:52,833][52647] Sum rewards: 52.511, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.496', 'weapon2': '0.764', 'WEAPON3': '1.150', 'weapon3': '2.310', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '45.000'} [2024-08-06 01:37:52,877][52669] DAMAGECOUNT value on done: 221940.0 [2024-08-06 01:37:52,879][52669] Sum rewards: 75.997, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.136', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.428', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '62.000'} [2024-08-06 01:37:53,494][52667] DAMAGECOUNT value on done: 218435.0 [2024-08-06 01:37:53,496][52667] Sum rewards: 61.028, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.525', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon4': '0.206', 'weapon2': '0.466', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.166', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '49.000'} [2024-08-06 01:37:53,780][52820] DAMAGECOUNT value on done: 198593.0 [2024-08-06 01:37:53,780][52820] Sum rewards: 53.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.108', 'AMMO4': '0.178', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '46.000'} [2024-08-06 01:37:54,202][52794] DAMAGECOUNT value on done: 222468.0 [2024-08-06 01:37:54,202][52794] Sum rewards: 64.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.052', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.199', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '54.000'} [2024-08-06 01:37:54,624][52650] Updated weights for policy 0, policy_version 31851 (0.0014) [2024-08-06 01:37:54,872][52668] DAMAGECOUNT value on done: 222460.0 [2024-08-06 01:37:54,873][52668] Sum rewards: 70.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.781', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.140', 'weapon2': '0.168', 'AMMO3': '0.207', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.300', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '59.000'} [2024-08-06 01:37:55,192][52660] DAMAGECOUNT value on done: 215965.0 [2024-08-06 01:37:55,194][52660] Sum rewards: 60.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.131', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.218', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '52.000'} [2024-08-06 01:37:55,336][52662] DAMAGECOUNT value on done: 230507.0 [2024-08-06 01:37:55,337][52662] Sum rewards: 72.034, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '0.950', 'weapon3': '2.940', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '56.000'} [2024-08-06 01:37:55,427][52647] DAMAGECOUNT value on done: 229893.0 [2024-08-06 01:37:55,427][52647] Sum rewards: 62.782, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.058', 'weapon4': '0.068', 'AMMO4': '0.135', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.604', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '51.000'} [2024-08-06 01:37:56,024][52669] DAMAGECOUNT value on done: 216167.0 [2024-08-06 01:37:56,026][52669] Sum rewards: 55.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.092', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.336', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:56,330][52667] DAMAGECOUNT value on done: 222191.0 [2024-08-06 01:37:56,332][52667] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.052', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.232', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '52.000'} [2024-08-06 01:37:56,998][52820] DAMAGECOUNT value on done: 208191.0 [2024-08-06 01:37:56,998][52820] Sum rewards: 59.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.327', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.160', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '52.000'} [2024-08-06 01:37:57,265][52794] DAMAGECOUNT value on done: 225959.0 [2024-08-06 01:37:57,267][52794] Sum rewards: 70.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.101', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.366', 'weapon4': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.786', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '59.000'} [2024-08-06 01:37:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 260972544. Throughput: 0: 4377.4. Samples: 65252660. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 01:37:57,794][52567] Avg episode reward: [(0, '63.942')] [2024-08-06 01:37:57,968][52668] DAMAGECOUNT value on done: 215815.0 [2024-08-06 01:37:57,968][52668] Sum rewards: 71.002, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.669', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.064', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '62.000'} [2024-08-06 01:37:58,104][52647] DAMAGECOUNT value on done: 229660.0 [2024-08-06 01:37:58,105][52647] Sum rewards: 55.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'ARMOR': '0.032', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '47.000'} [2024-08-06 01:37:58,379][52660] DAMAGECOUNT value on done: 221839.0 [2024-08-06 01:37:58,386][52660] Sum rewards: 62.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.100', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.218', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.870', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '55.000'} [2024-08-06 01:37:58,445][52662] DAMAGECOUNT value on done: 219727.0 [2024-08-06 01:37:58,446][52662] Sum rewards: 54.994, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.313', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.152', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.406', 'WEAPON4': '0.450', 'weapon4': '0.632', 'WEAPON3': '1.350', 'weapon3': '2.454', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '48.500'} [2024-08-06 01:37:59,168][52650] Updated weights for policy 0, policy_version 31861 (0.0013) [2024-08-06 01:37:59,207][52669] DAMAGECOUNT value on done: 222060.0 [2024-08-06 01:37:59,210][52669] Sum rewards: 72.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.860', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.398', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '63.000'} [2024-08-06 01:37:59,400][52667] DAMAGECOUNT value on done: 222407.0 [2024-08-06 01:37:59,403][52667] Sum rewards: 68.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.170', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '59.000'} [2024-08-06 01:38:00,202][52820] DAMAGECOUNT value on done: 211367.0 [2024-08-06 01:38:00,203][52820] Sum rewards: 64.407, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.084', 'weapon5': '0.104', 'AMMO4': '0.216', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.200', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '57.000'} [2024-08-06 01:38:00,403][52794] DAMAGECOUNT value on done: 220031.0 [2024-08-06 01:38:00,403][52794] Sum rewards: 65.079, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.931', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.092', 'weapon2': '0.266', 'AMMO3': '0.331', 'WEAPON3': '1.900', 'weapon3': '3.360', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '59.000'} [2024-08-06 01:38:00,631][52647] DAMAGECOUNT value on done: 232180.0 [2024-08-06 01:38:00,631][52647] Sum rewards: 71.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.144', 'weapon4': '0.160', 'AMMO4': '0.215', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '62.000'} [2024-08-06 01:38:00,964][52668] DAMAGECOUNT value on done: 210071.0 [2024-08-06 01:38:00,966][52668] Sum rewards: 69.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.554', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.092', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.358', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '59.000'} [2024-08-06 01:38:01,233][52660] DAMAGECOUNT value on done: 222951.0 [2024-08-06 01:38:01,235][52660] Sum rewards: 60.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.533', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.183', 'weapon5': '0.204', 'weapon2': '0.278', 'AMMO4': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.730', 'WEAPON3': '1.150', 'weapon3': '2.480', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '51.500'} [2024-08-06 01:38:01,648][52662] DAMAGECOUNT value on done: 222176.0 [2024-08-06 01:38:01,652][52662] Sum rewards: 69.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.414', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.198', 'AMMO4': '0.214', 'AMMO3': '0.229', 'weapon2': '0.248', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '58.000'} [2024-08-06 01:38:02,044][52669] DAMAGECOUNT value on done: 218119.0 [2024-08-06 01:38:02,045][52669] Sum rewards: 60.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.815', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO4': '0.201', 'weapon4': '0.222', 'AMMO3': '0.237', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.202', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '51.000'} [2024-08-06 01:38:02,427][52666] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 01:38:02,493][52667] DAMAGECOUNT value on done: 219568.0 [2024-08-06 01:38:02,494][52667] Sum rewards: 50.508, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.106', 'HEALTH': '0.145', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.400', 'weapon4': '0.574', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.390', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '42.000'} [2024-08-06 01:38:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 261062656. Throughput: 0: 4377.1. Samples: 65265550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:38:02,794][52567] Avg episode reward: [(0, '63.945')] [2024-08-06 01:38:03,175][52794] DAMAGECOUNT value on done: 220890.0 [2024-08-06 01:38:03,175][52794] Sum rewards: 65.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.038', 'weapon4': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '3.242', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2024-08-06 01:38:03,376][52668] DAMAGECOUNT value on done: 215280.0 [2024-08-06 01:38:03,386][52668] Sum rewards: 61.897, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.414', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.256', 'weapon4': '0.340', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '2.898', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '55.000'} [2024-08-06 01:38:03,412][52647] DAMAGECOUNT value on done: 228092.0 [2024-08-06 01:38:03,413][52647] Sum rewards: 70.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.104', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '60.000'} [2024-08-06 01:38:03,471][52820] DAMAGECOUNT value on done: 200237.0 [2024-08-06 01:38:03,473][52820] Sum rewards: 68.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO4': '0.086', 'AMMO3': '0.218', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '57.000'} [2024-08-06 01:38:03,678][52660] DAMAGECOUNT value on done: 222699.0 [2024-08-06 01:38:03,680][52660] Sum rewards: 60.235, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.910', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.038', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.304', 'WEAPON4': '0.400', 'weapon4': '0.464', 'WEAPON3': '1.650', 'weapon3': '2.956', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '56.000'} [2024-08-06 01:38:03,834][52650] Updated weights for policy 0, policy_version 31871 (0.0030) [2024-08-06 01:38:04,328][52662] DAMAGECOUNT value on done: 218219.0 [2024-08-06 01:38:04,330][52662] Sum rewards: 64.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '53.000'} [2024-08-06 01:38:05,133][52669] DAMAGECOUNT value on done: 219255.0 [2024-08-06 01:38:05,135][52669] Sum rewards: 61.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.090', 'AMMO3': '0.156', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.446', 'WEAPON3': '0.850', 'HITCOUNT': '3.020', 'weapon3': '3.038', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '51.000'} [2024-08-06 01:38:05,583][52667] DAMAGECOUNT value on done: 221659.0 [2024-08-06 01:38:05,584][52667] Sum rewards: 54.130, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.640', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.114', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '45.000'} [2024-08-06 01:38:05,831][52647] DAMAGECOUNT value on done: 230446.0 [2024-08-06 01:38:05,832][52647] Sum rewards: 67.467, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.580', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.082', 'weapon5': '0.140', 'AMMO4': '0.150', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.364', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 01:38:06,087][52668] DAMAGECOUNT value on done: 213412.0 [2024-08-06 01:38:06,088][52668] Sum rewards: 58.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.240', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.162', 'AMMO4': '0.201', 'weapon5': '0.254', 'weapon4': '0.478', 'weapon2': '0.494', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.530', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:06,304][52660] DAMAGECOUNT value on done: 217896.0 [2024-08-06 01:38:06,308][52660] Sum rewards: 67.355, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.785', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'weapon4': '0.374', 'weapon2': '0.608', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:06,434][52794] DAMAGECOUNT value on done: 219591.0 [2024-08-06 01:38:06,434][52794] Sum rewards: 74.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.161', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.211', 'weapon5': '0.262', 'weapon4': '0.274', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '63.000'} [2024-08-06 01:38:07,477][52662] DAMAGECOUNT value on done: 227609.0 [2024-08-06 01:38:07,477][52662] Sum rewards: 57.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.229', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 261152768. Throughput: 0: 4378.4. Samples: 65291870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:38:07,794][52567] Avg episode reward: [(0, '63.474')] [2024-08-06 01:38:08,205][52667] DAMAGECOUNT value on done: 215978.0 [2024-08-06 01:38:08,206][52667] Sum rewards: 56.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.744', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon2': '0.962', 'WEAPON3': '1.150', 'weapon3': '2.568', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.242', 'FRAGCOUNT': '48.000'} [2024-08-06 01:38:08,235][52669] DAMAGECOUNT value on done: 217946.0 [2024-08-06 01:38:08,238][52669] Sum rewards: 74.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.774', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.072', 'weapon4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.234', 'WEAPON3': '1.250', 'weapon3': '3.456', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '61.000'} [2024-08-06 01:38:08,610][52647] DAMAGECOUNT value on done: 226634.0 [2024-08-06 01:38:08,611][52647] Sum rewards: 54.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.892', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.046', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.266', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.514', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '44.500'} [2024-08-06 01:38:08,632][52650] Updated weights for policy 0, policy_version 31881 (0.0039) [2024-08-06 01:38:08,814][52668] DAMAGECOUNT value on done: 219156.0 [2024-08-06 01:38:08,817][52668] Sum rewards: 74.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.028', 'weapon4': '0.126', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '65.000'} [2024-08-06 01:38:09,041][52794] DAMAGECOUNT value on done: 221424.0 [2024-08-06 01:38:09,042][52794] Sum rewards: 64.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.576', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.235', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '55.000'} [2024-08-06 01:38:09,138][52660] DAMAGECOUNT value on done: 225571.0 [2024-08-06 01:38:09,138][52660] Sum rewards: 67.945, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.742', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.206', 'weapon4': '0.214', 'AMMO3': '0.271', 'WEAPON3': '1.700', 'weapon3': '3.318', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 01:38:10,068][52662] DAMAGECOUNT value on done: 223873.0 [2024-08-06 01:38:10,069][52662] Sum rewards: 50.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.407', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.164', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '43.000'} [2024-08-06 01:38:10,845][52667] DAMAGECOUNT value on done: 224285.0 [2024-08-06 01:38:10,846][52667] Sum rewards: 65.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.130', 'AMMO4': '0.161', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.246', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:11,185][52669] DAMAGECOUNT value on done: 220760.0 [2024-08-06 01:38:11,187][52669] Sum rewards: 59.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.840', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.094', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '50.000'} [2024-08-06 01:38:11,434][52647] DAMAGECOUNT value on done: 228971.0 [2024-08-06 01:38:11,434][52647] Sum rewards: 57.655, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.490', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.302', 'weapon2': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.218', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:11,814][52668] DAMAGECOUNT value on done: 213626.0 [2024-08-06 01:38:11,814][52668] Sum rewards: 64.550, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO3': '0.178', 'weapon2': '0.456', 'HEALTH': '0.858', 'WEAPON3': '0.950', 'HITCOUNT': '3.090', 'weapon3': '3.258', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '51.000'} [2024-08-06 01:38:11,991][52794] DAMAGECOUNT value on done: 225478.0 [2024-08-06 01:38:11,991][52794] Sum rewards: 59.343, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.718', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.650', 'weapon3': '2.750', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:11,997][52660] DAMAGECOUNT value on done: 211443.0 [2024-08-06 01:38:11,998][52660] Sum rewards: 52.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.404', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.120', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.720', 'WEAPON3': '0.800', 'weapon3': '2.608', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '40.000'} [2024-08-06 01:38:12,479][52659] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:38:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 261242880. Throughput: 0: 4376.0. Samples: 65318290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:38:12,794][52567] Avg episode reward: [(0, '62.832')] [2024-08-06 01:38:12,971][52650] Updated weights for policy 0, policy_version 31891 (0.0033) [2024-08-06 01:38:13,125][52662] DAMAGECOUNT value on done: 229120.0 [2024-08-06 01:38:13,126][52662] Sum rewards: 67.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.526', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.080', 'weapon5': '0.124', 'AMMO3': '0.159', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.000', 'weapon3': '3.110', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '55.000'} [2024-08-06 01:38:13,810][52667] DAMAGECOUNT value on done: 229352.0 [2024-08-06 01:38:13,818][52667] Sum rewards: 65.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.504', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:14,145][52669] DAMAGECOUNT value on done: 219998.0 [2024-08-06 01:38:14,146][52669] Sum rewards: 68.226, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.965', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.060', 'AMMO4': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon2': '0.438', 'WEAPON3': '1.600', 'weapon3': '2.844', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '60.000'} [2024-08-06 01:38:14,601][52647] DAMAGECOUNT value on done: 230388.0 [2024-08-06 01:38:14,603][52647] Sum rewards: 58.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.576', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.146', 'AMMO3': '0.208', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'weapon4': '0.442', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:14,627][52668] DAMAGECOUNT value on done: 222571.0 [2024-08-06 01:38:14,631][52668] Sum rewards: 50.612, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.206', 'weapon2': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.034', 'DAMAGECOUNT': '12.366', 'FRAGCOUNT': '45.000'} [2024-08-06 01:38:14,883][52660] DAMAGECOUNT value on done: 217125.0 [2024-08-06 01:38:14,884][52660] Sum rewards: 53.204, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.620', 'AMMO5': '0.019', 'AMMO2': '0.069', 'AMMO3': '0.243', 'weapon5': '0.244', 'AMMO4': '0.345', 'weapon2': '0.398', 'weapon4': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.642', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '48.000'} [2024-08-06 01:38:14,980][52794] DAMAGECOUNT value on done: 222082.0 [2024-08-06 01:38:14,982][52794] Sum rewards: 64.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.061', 'weapon5': '0.168', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:15,693][52658] DAMAGECOUNT value on done: 223161.0 [2024-08-06 01:38:15,693][52658] Sum rewards: 62.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.162', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '51.000'} [2024-08-06 01:38:16,130][52662] DAMAGECOUNT value on done: 219092.0 [2024-08-06 01:38:16,132][52662] Sum rewards: 65.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.167', 'weapon4': '0.386', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:16,550][52667] DAMAGECOUNT value on done: 222462.0 [2024-08-06 01:38:16,552][52667] Sum rewards: 50.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO2': '0.021', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.191', 'weapon2': '0.356', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.362', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '43.000'} [2024-08-06 01:38:16,614][52669] DAMAGECOUNT value on done: 219946.0 [2024-08-06 01:38:16,627][52669] Sum rewards: 51.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.518', 'weapon2': '0.738', 'WEAPON3': '1.250', 'weapon3': '2.494', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '45.000'} [2024-08-06 01:38:17,193][52647] DAMAGECOUNT value on done: 232468.0 [2024-08-06 01:38:17,194][52647] Sum rewards: 58.142, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.400', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.150', 'AMMO3': '0.229', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.336', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:17,706][52668] DAMAGECOUNT value on done: 222242.0 [2024-08-06 01:38:17,707][52668] Sum rewards: 59.076, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.548', 'AMMO5': '0.005', 'weapon5': '0.052', 'AMMO2': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.279', 'AMMO3': '0.304', 'weapon2': '0.400', 'weapon4': '0.608', 'WEAPON4': '0.650', 'WEAPON3': '1.800', 'weapon3': '2.602', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '55.000'} [2024-08-06 01:38:17,782][52794] DAMAGECOUNT value on done: 227632.0 [2024-08-06 01:38:17,783][52794] Sum rewards: 77.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '65.000'} [2024-08-06 01:38:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 261324800. Throughput: 0: 4382.4. Samples: 65331510. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:38:17,794][52567] Avg episode reward: [(0, '62.249')] [2024-08-06 01:38:17,964][52650] Updated weights for policy 0, policy_version 31901 (0.0012) [2024-08-06 01:38:17,966][52660] DAMAGECOUNT value on done: 223704.0 [2024-08-06 01:38:17,966][52660] Sum rewards: 65.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.226', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO3': '0.146', 'weapon5': '0.146', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.880', 'weapon3': '2.450', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:18,505][52658] DAMAGECOUNT value on done: 221679.0 [2024-08-06 01:38:18,505][52658] Sum rewards: 60.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.498', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.180', 'weapon5': '0.180', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:19,092][52662] DAMAGECOUNT value on done: 223683.0 [2024-08-06 01:38:19,102][52662] Sum rewards: 63.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.068', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.426', 'weapon2': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '53.000'} [2024-08-06 01:38:19,244][52669] DAMAGECOUNT value on done: 215815.0 [2024-08-06 01:38:19,246][52669] Sum rewards: 60.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.462', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.244', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:19,596][52667] DAMAGECOUNT value on done: 225513.0 [2024-08-06 01:38:19,597][52667] Sum rewards: 62.355, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.112', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '52.500'} [2024-08-06 01:38:20,171][52647] DAMAGECOUNT value on done: 227442.0 [2024-08-06 01:38:20,171][52647] Sum rewards: 63.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.047', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.138', 'AMMO3': '0.199', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '53.000'} [2024-08-06 01:38:20,382][52668] DAMAGECOUNT value on done: 219532.0 [2024-08-06 01:38:20,382][52668] Sum rewards: 61.651, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.122', 'AMMO4': '0.159', 'weapon4': '0.212', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:20,606][52660] DAMAGECOUNT value on done: 229323.0 [2024-08-06 01:38:20,608][52660] Sum rewards: 58.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.097', 'weapon4': '0.172', 'AMMO3': '0.227', 'weapon2': '0.604', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '50.000'} [2024-08-06 01:38:21,004][52794] DAMAGECOUNT value on done: 224453.0 [2024-08-06 01:38:21,005][52794] Sum rewards: 59.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.180', 'weapon5': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:21,906][52658] DAMAGECOUNT value on done: 222520.0 [2024-08-06 01:38:21,907][52658] Sum rewards: 69.524, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.136', 'AMMO3': '0.173', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.000'} [2024-08-06 01:38:22,175][52669] DAMAGECOUNT value on done: 221281.0 [2024-08-06 01:38:22,177][52669] Sum rewards: 67.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.256', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.266', 'AMMO3': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.950', 'weapon3': '3.154', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '60.000'} [2024-08-06 01:38:22,285][52662] DAMAGECOUNT value on done: 220518.0 [2024-08-06 01:38:22,286][52662] Sum rewards: 55.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.246', 'weapon2': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.948', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '46.000'} [2024-08-06 01:38:22,617][52650] Updated weights for policy 0, policy_version 31911 (0.0017) [2024-08-06 01:38:22,717][52667] DAMAGECOUNT value on done: 215580.0 [2024-08-06 01:38:22,717][52667] Sum rewards: 73.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.405', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.446', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '60.000'} [2024-08-06 01:38:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 261414912. Throughput: 0: 4380.4. Samples: 65357580. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 01:38:22,794][52567] Avg episode reward: [(0, '62.411')] [2024-08-06 01:38:22,960][52647] DAMAGECOUNT value on done: 226288.0 [2024-08-06 01:38:22,960][52647] Sum rewards: 69.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.193', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '57.000'} [2024-08-06 01:38:23,362][52660] DAMAGECOUNT value on done: 214716.0 [2024-08-06 01:38:23,363][52660] Sum rewards: 60.099, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon5': '0.212', 'AMMO3': '0.218', 'AMMO4': '0.292', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.506', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:23,935][52794] DAMAGECOUNT value on done: 222103.0 [2024-08-06 01:38:23,935][52794] Sum rewards: 71.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.098', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.054', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.218', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '60.000'} [2024-08-06 01:38:24,274][52658] DAMAGECOUNT value on done: 222241.0 [2024-08-06 01:38:24,275][52658] Sum rewards: 46.584, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.817', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '3.036', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '42.000'} [2024-08-06 01:38:24,966][52662] DAMAGECOUNT value on done: 219167.0 [2024-08-06 01:38:24,967][52662] Sum rewards: 56.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.524', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.118', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '48.000'} [2024-08-06 01:38:25,141][52667] DAMAGECOUNT value on done: 224011.0 [2024-08-06 01:38:25,141][52667] Sum rewards: 52.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.598', 'AMMO5': '0.015', 'AMMO2': '0.101', 'AMMO3': '0.104', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.508', 'WEAPON3': '0.650', 'WEAPON4': '0.850', 'weapon2': '0.866', 'weapon4': '1.176', 'weapon3': '1.512', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '44.500'} [2024-08-06 01:38:25,302][52669] DAMAGECOUNT value on done: 223079.0 [2024-08-06 01:38:25,303][52669] Sum rewards: 63.073, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.170', 'AMMO3': '0.254', 'weapon4': '0.310', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '56.000'} [2024-08-06 01:38:25,903][52647] DAMAGECOUNT value on done: 228321.0 [2024-08-06 01:38:25,904][52647] Sum rewards: 60.257, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.547', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.114', 'AMMO3': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.828', 'WEAPON3': '0.850', 'weapon3': '2.558', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '48.000'} [2024-08-06 01:38:26,402][52794] DAMAGECOUNT value on done: 220871.0 [2024-08-06 01:38:26,403][52794] Sum rewards: 53.474, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.984', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.080', 'AMMO3': '0.131', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.538', 'WEAPON3': '0.900', 'HITCOUNT': '2.880', 'weapon3': '3.124', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '44.000'} [2024-08-06 01:38:26,814][52660] DAMAGECOUNT value on done: 221495.0 [2024-08-06 01:38:26,816][52660] Sum rewards: 64.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.490', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.348', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:27,024][52658] DAMAGECOUNT value on done: 222336.0 [2024-08-06 01:38:27,026][52658] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.360', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.334', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:27,243][52650] Updated weights for policy 0, policy_version 31921 (0.0024) [2024-08-06 01:38:27,439][52664] DAMAGECOUNT value on done: 226524.0 [2024-08-06 01:38:27,440][52664] Sum rewards: 68.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.248', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '58.000'} [2024-08-06 01:38:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 261505024. Throughput: 0: 4392.0. Samples: 65384180. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 01:38:27,794][52567] Avg episode reward: [(0, '62.693')] [2024-08-06 01:38:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031922_261505024.pth... [2024-08-06 01:38:27,924][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031408_257294336.pth [2024-08-06 01:38:28,283][52669] DAMAGECOUNT value on done: 217295.0 [2024-08-06 01:38:28,285][52669] Sum rewards: 69.072, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.136', 'weapon2': '0.242', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.810', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '59.000'} [2024-08-06 01:38:28,466][52647] DAMAGECOUNT value on done: 224333.0 [2024-08-06 01:38:28,467][52647] Sum rewards: 53.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.214', 'weapon2': '0.334', 'WEAPON4': '0.550', 'weapon4': '0.718', 'WEAPON3': '1.250', 'weapon3': '2.672', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '47.000'} [2024-08-06 01:38:29,670][52794] DAMAGECOUNT value on done: 219138.0 [2024-08-06 01:38:29,670][52794] Sum rewards: 56.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.814', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:29,734][52660] DAMAGECOUNT value on done: 211047.0 [2024-08-06 01:38:29,735][52660] Sum rewards: 59.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.116', 'AMMO4': '0.119', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '2.922', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '50.000'} [2024-08-06 01:38:30,314][52658] DAMAGECOUNT value on done: 219530.0 [2024-08-06 01:38:30,316][52658] Sum rewards: 72.729, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '63.000'} [2024-08-06 01:38:30,691][52664] DAMAGECOUNT value on done: 227777.0 [2024-08-06 01:38:30,693][52664] Sum rewards: 63.742, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.174', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.264', 'weapon2': '0.438', 'weapon4': '0.566', 'WEAPON3': '0.900', 'weapon3': '2.500', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:31,131][52669] DAMAGECOUNT value on done: 223248.0 [2024-08-06 01:38:31,133][52669] Sum rewards: 73.407, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'weapon4': '0.024', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.300', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '59.000'} [2024-08-06 01:38:31,632][52647] DAMAGECOUNT value on done: 232457.0 [2024-08-06 01:38:31,633][52647] Sum rewards: 61.454, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.285', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.290', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:32,048][52650] Updated weights for policy 0, policy_version 31931 (0.0018) [2024-08-06 01:38:32,205][52660] DAMAGECOUNT value on done: 221037.0 [2024-08-06 01:38:32,207][52660] Sum rewards: 56.962, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.352', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '51.000'} [2024-08-06 01:38:32,520][52794] DAMAGECOUNT value on done: 231639.0 [2024-08-06 01:38:32,523][52794] Sum rewards: 59.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.466', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.125', 'AMMO3': '0.179', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.122', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 261586944. Throughput: 0: 4381.6. Samples: 65396870. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 01:38:32,794][52567] Avg episode reward: [(0, '62.547')] [2024-08-06 01:38:33,438][52658] DAMAGECOUNT value on done: 228016.0 [2024-08-06 01:38:33,439][52658] Sum rewards: 57.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.684', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:33,882][52664] DAMAGECOUNT value on done: 229545.0 [2024-08-06 01:38:33,882][52664] Sum rewards: 62.449, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.422', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.054', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon4': '0.276', 'AMMO3': '0.285', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.972', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '56.000'} [2024-08-06 01:38:34,029][52669] DAMAGECOUNT value on done: 224120.0 [2024-08-06 01:38:34,031][52669] Sum rewards: 52.901, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.674', 'AMMO5': '0.008', 'weapon5': '0.060', 'AMMO2': '0.064', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'AMMO4': '0.320', 'WEAPON4': '0.550', 'weapon2': '0.584', 'weapon4': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.506', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '48.000'} [2024-08-06 01:38:34,984][52660] DAMAGECOUNT value on done: 218720.0 [2024-08-06 01:38:34,989][52660] Sum rewards: 74.819, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.005', 'HEALTH': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.203', 'weapon2': '0.248', 'WEAPON3': '1.150', 'weapon3': '3.490', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '62.000'} [2024-08-06 01:38:35,145][52794] DAMAGECOUNT value on done: 218478.0 [2024-08-06 01:38:35,145][52794] Sum rewards: 60.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO3': '0.181', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.268', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.064', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:36,466][52664] DAMAGECOUNT value on done: 225660.0 [2024-08-06 01:38:36,468][52664] Sum rewards: 58.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.046', 'AMMO2': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'AMMO4': '0.247', 'weapon2': '0.340', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon4': '1.192', 'weapon3': '2.142', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:36,538][52658] DAMAGECOUNT value on done: 215498.0 [2024-08-06 01:38:36,538][52658] Sum rewards: 56.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.495', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.136', 'weapon5': '0.144', 'AMMO4': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.418', 'weapon2': '0.826', 'WEAPON3': '1.000', 'weapon3': '2.440', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '45.000'} [2024-08-06 01:38:36,619][52650] Updated weights for policy 0, policy_version 31941 (0.0012) [2024-08-06 01:38:36,810][52666] DAMAGECOUNT value on done: 225108.0 [2024-08-06 01:38:36,813][52666] Sum rewards: 74.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.824', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'AMMO3': '0.249', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.056', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '62.000'} [2024-08-06 01:38:36,952][52669] DAMAGECOUNT value on done: 233659.0 [2024-08-06 01:38:36,953][52669] Sum rewards: 65.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.828', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.155', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 01:38:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 261677056. Throughput: 0: 4383.4. Samples: 65423490. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 01:38:37,794][52567] Avg episode reward: [(0, '62.561')] [2024-08-06 01:38:38,392][52794] DAMAGECOUNT value on done: 230266.0 [2024-08-06 01:38:38,392][52794] Sum rewards: 65.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '57.000'} [2024-08-06 01:38:39,121][52664] DAMAGECOUNT value on done: 228279.0 [2024-08-06 01:38:39,132][52664] Sum rewards: 74.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.090', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.306', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '64.000'} [2024-08-06 01:38:39,353][52669] DAMAGECOUNT value on done: 217960.0 [2024-08-06 01:38:39,354][52669] Sum rewards: 54.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.050', 'weapon4': '1.090', 'weapon3': '2.206', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '46.000'} [2024-08-06 01:38:39,790][52658] DAMAGECOUNT value on done: 224867.0 [2024-08-06 01:38:39,790][52658] Sum rewards: 52.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon5': '0.196', 'AMMO3': '0.241', 'weapon4': '0.248', 'AMMO4': '0.298', 'weapon2': '0.440', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.802', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '47.000'} [2024-08-06 01:38:39,905][52666] DAMAGECOUNT value on done: 224846.0 [2024-08-06 01:38:39,906][52666] Sum rewards: 80.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.179', 'weapon2': '0.220', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.834', 'WEAPON3': '1.200', 'weapon3': '2.424', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '66.000'} [2024-08-06 01:38:41,063][52794] DAMAGECOUNT value on done: 224287.0 [2024-08-06 01:38:41,063][52794] Sum rewards: 60.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.120', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon4': '0.234', 'weapon2': '0.344', 'WEAPON3': '1.000', 'HITCOUNT': '2.960', 'weapon3': '3.182', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '50.000'} [2024-08-06 01:38:41,509][52650] Updated weights for policy 0, policy_version 31951 (0.0021) [2024-08-06 01:38:41,986][52664] DAMAGECOUNT value on done: 230952.0 [2024-08-06 01:38:41,987][52664] Sum rewards: 63.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.042', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:42,451][52658] DAMAGECOUNT value on done: 223916.0 [2024-08-06 01:38:42,452][52658] Sum rewards: 66.696, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.172', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon5': '0.170', 'AMMO3': '0.217', 'AMMO4': '0.303', 'weapon4': '0.384', 'weapon2': '0.402', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.734', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '61.000'} [2024-08-06 01:38:42,525][52669] DAMAGECOUNT value on done: 225579.0 [2024-08-06 01:38:42,525][52669] Sum rewards: 65.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.274', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '56.000'} [2024-08-06 01:38:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 261767168. Throughput: 0: 4378.7. Samples: 65449700. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:38:42,794][52567] Avg episode reward: [(0, '62.613')] [2024-08-06 01:38:43,184][52666] DAMAGECOUNT value on done: 223594.0 [2024-08-06 01:38:43,184][52666] Sum rewards: 67.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.009', 'AMMO2': '0.030', 'AMMO3': '0.152', 'AMMO4': '0.152', 'weapon5': '0.162', 'WEAPON5': '0.250', 'weapon2': '0.306', 'weapon4': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:43,491][52794] DAMAGECOUNT value on done: 224046.0 [2024-08-06 01:38:43,492][52794] Sum rewards: 64.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.126', 'weapon5': '0.162', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '53.000'} [2024-08-06 01:38:44,350][52671] DAMAGECOUNT value on done: 226047.0 [2024-08-06 01:38:44,360][52671] Sum rewards: 63.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.154', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '55.000'} [2024-08-06 01:38:45,191][52664] DAMAGECOUNT value on done: 234302.0 [2024-08-06 01:38:45,191][52664] Sum rewards: 63.744, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.604', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.052', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.268', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '56.000'} [2024-08-06 01:38:45,339][52669] DAMAGECOUNT value on done: 226667.0 [2024-08-06 01:38:45,341][52669] Sum rewards: 65.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.179', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.050', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.370', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:45,380][52658] DAMAGECOUNT value on done: 227073.0 [2024-08-06 01:38:45,382][52658] Sum rewards: 64.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.172', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.474', 'weapon4': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.434', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:46,074][52650] Updated weights for policy 0, policy_version 31961 (0.0019) [2024-08-06 01:38:46,213][52794] DAMAGECOUNT value on done: 231892.0 [2024-08-06 01:38:46,216][52794] Sum rewards: 64.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '2.960', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:46,275][52666] DAMAGECOUNT value on done: 219726.0 [2024-08-06 01:38:46,276][52666] Sum rewards: 61.287, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.474', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon4': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.290', 'WEAPON3': '1.550', 'weapon3': '3.072', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:47,460][52671] DAMAGECOUNT value on done: 219986.0 [2024-08-06 01:38:47,460][52671] Sum rewards: 59.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.156', 'weapon5': '0.158', 'AMMO4': '0.178', 'weapon4': '0.356', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.870', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '50.000'} [2024-08-06 01:38:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 261857280. Throughput: 0: 4388.9. Samples: 65463050. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:38:47,794][52567] Avg episode reward: [(0, '62.614')] [2024-08-06 01:38:47,829][52664] DAMAGECOUNT value on done: 222852.0 [2024-08-06 01:38:47,830][52664] Sum rewards: 63.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.132', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.098', 'weapon5': '0.106', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.198', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:48,167][52658] DAMAGECOUNT value on done: 214868.0 [2024-08-06 01:38:48,168][52658] Sum rewards: 61.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'weapon5': '0.048', 'AMMO2': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.288', 'weapon4': '0.364', 'WEAPON4': '0.400', 'weapon2': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '52.000'} [2024-08-06 01:38:48,459][52669] DAMAGECOUNT value on done: 228168.0 [2024-08-06 01:38:48,459][52669] Sum rewards: 63.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.074', 'weapon4': '0.134', 'WEAPON4': '0.150', 'weapon2': '0.230', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.332', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '56.000'} [2024-08-06 01:38:48,619][52670] DAMAGECOUNT value on done: 217309.0 [2024-08-06 01:38:48,619][52670] Sum rewards: 57.846, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.749', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.200', 'weapon2': '0.238', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.104', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '50.000'} [2024-08-06 01:38:48,750][52794] DAMAGECOUNT value on done: 222750.0 [2024-08-06 01:38:48,750][52794] Sum rewards: 51.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.222', 'weapon4': '0.238', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.240', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '43.000'} [2024-08-06 01:38:49,596][52666] DAMAGECOUNT value on done: 216032.0 [2024-08-06 01:38:49,597][52666] Sum rewards: 56.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.017', 'weapon5': '0.046', 'AMMO2': '0.051', 'AMMO3': '0.153', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.504', 'weapon2': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:50,492][52650] Updated weights for policy 0, policy_version 31971 (0.0030) [2024-08-06 01:38:50,535][52671] DAMAGECOUNT value on done: 223337.0 [2024-08-06 01:38:50,537][52671] Sum rewards: 68.538, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.106', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.124', 'AMMO4': '0.203', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.400', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '60.000'} [2024-08-06 01:38:50,691][52658] DAMAGECOUNT value on done: 219788.0 [2024-08-06 01:38:50,691][52658] Sum rewards: 76.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.175', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.608', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '61.000'} [2024-08-06 01:38:50,959][52664] DAMAGECOUNT value on done: 236156.0 [2024-08-06 01:38:50,959][52664] Sum rewards: 67.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.342', 'weapon7': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.238', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 01:38:51,665][52670] DAMAGECOUNT value on done: 221299.0 [2024-08-06 01:38:51,665][52670] Sum rewards: 64.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.323', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.290', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '54.000'} [2024-08-06 01:38:52,395][52666] DAMAGECOUNT value on done: 211916.0 [2024-08-06 01:38:52,396][52666] Sum rewards: 62.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.494', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.098', 'weapon5': '0.174', 'AMMO4': '0.208', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '2.906', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '53.000'} [2024-08-06 01:38:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 261947392. Throughput: 0: 4396.0. Samples: 65489690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:38:52,794][52567] Avg episode reward: [(0, '62.508')] [2024-08-06 01:38:53,646][52671] DAMAGECOUNT value on done: 219383.0 [2024-08-06 01:38:53,648][52614] Signal inference workers to stop experience collection... (5800 times) [2024-08-06 01:38:53,650][52614] Signal inference workers to resume experience collection... (5800 times) [2024-08-06 01:38:53,652][52671] Sum rewards: 56.358, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.964', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.082', 'AMMO3': '0.227', 'weapon5': '0.266', 'AMMO4': '0.411', 'WEAPON5': '0.500', 'weapon2': '0.536', 'weapon4': '0.674', 'WEAPON4': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.152', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '51.000'} [2024-08-06 01:38:53,702][52650] InferenceWorker_p0-w0: stopping experience collection (5800 times) [2024-08-06 01:38:53,702][52650] InferenceWorker_p0-w0: resuming experience collection (5800 times) [2024-08-06 01:38:53,712][52658] DAMAGECOUNT value on done: 221394.0 [2024-08-06 01:38:53,715][52658] Sum rewards: 69.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.598', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.213', 'weapon4': '0.216', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '60.000'} [2024-08-06 01:38:53,713][52664] DAMAGECOUNT value on done: 230898.0 [2024-08-06 01:38:53,721][52664] Sum rewards: 57.390, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.074', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.174', 'weapon4': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '49.500'} [2024-08-06 01:38:54,323][52670] DAMAGECOUNT value on done: 216255.0 [2024-08-06 01:38:54,328][52670] Sum rewards: 60.220, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.218', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.294', 'weapon2': '0.372', 'WEAPON3': '1.750', 'HITCOUNT': '3.020', 'weapon3': '3.290', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '57.000'} [2024-08-06 01:38:55,154][52650] Updated weights for policy 0, policy_version 31981 (0.0021) [2024-08-06 01:38:55,168][52666] DAMAGECOUNT value on done: 221354.0 [2024-08-06 01:38:55,168][52666] Sum rewards: 68.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.238', 'weapon2': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.466', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '57.000'} [2024-08-06 01:38:56,285][52671] DAMAGECOUNT value on done: 224653.0 [2024-08-06 01:38:56,285][52671] Sum rewards: 61.824, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'HEALTH': '0.022', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO3': '0.165', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.496', 'weapon2': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.578', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:56,350][52664] DAMAGECOUNT value on done: 232843.0 [2024-08-06 01:38:56,350][52664] Sum rewards: 52.939, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.912', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.228', 'weapon2': '0.346', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '2.880', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '48.000'} [2024-08-06 01:38:56,768][52658] DAMAGECOUNT value on done: 216380.0 [2024-08-06 01:38:56,770][52658] Sum rewards: 53.444, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.874', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.160', 'weapon4': '0.212', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.108', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '48.000'} [2024-08-06 01:38:57,536][52670] DAMAGECOUNT value on done: 216828.0 [2024-08-06 01:38:57,537][52670] Sum rewards: 51.651, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.138', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.382', 'WEAPON3': '0.900', 'HITCOUNT': '2.620', 'weapon3': '2.982', 'DAMAGECOUNT': '12.759', 'FRAGCOUNT': '41.000'} [2024-08-06 01:38:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 262037504. Throughput: 0: 4396.2. Samples: 65516120. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:38:57,794][52567] Avg episode reward: [(0, '62.131')] [2024-08-06 01:38:58,105][52666] DAMAGECOUNT value on done: 219469.0 [2024-08-06 01:38:58,105][52666] Sum rewards: 69.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.311', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.288', 'weapon4': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '58.000'} [2024-08-06 01:38:58,825][52664] DAMAGECOUNT value on done: 228029.0 [2024-08-06 01:38:58,827][52664] Sum rewards: 70.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2024-08-06 01:38:59,440][52671] DAMAGECOUNT value on done: 221812.0 [2024-08-06 01:38:59,441][52671] Sum rewards: 58.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.954', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.168', 'weapon2': '0.610', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.254', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '49.000'} [2024-08-06 01:38:59,882][52650] Updated weights for policy 0, policy_version 31991 (0.0041) [2024-08-06 01:39:00,088][52658] DAMAGECOUNT value on done: 220485.0 [2024-08-06 01:39:00,088][52658] Sum rewards: 65.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.920', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.078', 'weapon4': '0.146', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.500', 'weapon2': '0.786', 'WEAPON3': '1.400', 'weapon3': '2.682', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:00,340][52670] DAMAGECOUNT value on done: 220600.0 [2024-08-06 01:39:00,342][52670] Sum rewards: 59.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'weapon4': '0.122', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.454', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:01,057][52666] DAMAGECOUNT value on done: 218955.0 [2024-08-06 01:39:01,067][52666] Sum rewards: 54.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.173', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.126', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.736', 'WEAPON3': '0.950', 'weapon3': '2.572', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '45.000'} [2024-08-06 01:39:01,415][52664] DAMAGECOUNT value on done: 228660.0 [2024-08-06 01:39:01,416][52664] Sum rewards: 57.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.248', 'AMMO2': '0.017', 'AMMO4': '0.082', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon4': '0.492', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.650', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:02,041][52671] DAMAGECOUNT value on done: 223437.0 [2024-08-06 01:39:02,041][52671] Sum rewards: 55.891, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.765', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.164', 'AMMO3': '0.178', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '46.000'} [2024-08-06 01:39:02,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 262119424. Throughput: 0: 4400.4. Samples: 65529530. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:39:02,795][52567] Avg episode reward: [(0, '62.114')] [2024-08-06 01:39:03,155][52658] DAMAGECOUNT value on done: 225567.0 [2024-08-06 01:39:03,156][52658] Sum rewards: 51.180, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.015', 'AMMO2': '0.061', 'AMMO3': '0.206', 'weapon5': '0.258', 'AMMO4': '0.307', 'WEAPON5': '0.400', 'weapon4': '0.518', 'weapon2': '0.538', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.232', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '44.000'} [2024-08-06 01:39:03,188][52670] DAMAGECOUNT value on done: 220532.0 [2024-08-06 01:39:03,189][52670] Sum rewards: 61.213, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.400', 'weapon3': '2.808', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '53.000'} [2024-08-06 01:39:03,810][52666] DAMAGECOUNT value on done: 218635.0 [2024-08-06 01:39:03,811][52666] Sum rewards: 64.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.656', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '54.000'} [2024-08-06 01:39:04,152][52664] DAMAGECOUNT value on done: 228152.0 [2024-08-06 01:39:04,152][52664] Sum rewards: 52.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO3': '0.140', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.596', 'weapon2': '0.612', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.416', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '45.500'} [2024-08-06 01:39:04,467][52650] Updated weights for policy 0, policy_version 32001 (0.0014) [2024-08-06 01:39:04,963][52671] DAMAGECOUNT value on done: 225309.0 [2024-08-06 01:39:04,965][52671] Sum rewards: 68.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.878', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.340', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:05,900][52670] DAMAGECOUNT value on done: 215229.0 [2024-08-06 01:39:05,900][52670] Sum rewards: 61.317, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.332', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.812', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:05,905][52658] DAMAGECOUNT value on done: 218284.0 [2024-08-06 01:39:05,905][52658] Sum rewards: 73.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.707', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.474', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '62.000'} [2024-08-06 01:39:06,644][52666] DAMAGECOUNT value on done: 216724.0 [2024-08-06 01:39:06,644][52666] Sum rewards: 63.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.454', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.060', 'AMMO4': '0.113', 'weapon4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.348', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '55.000'} [2024-08-06 01:39:06,881][52664] DAMAGECOUNT value on done: 231394.0 [2024-08-06 01:39:06,882][52664] Sum rewards: 57.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.195', 'weapon4': '0.442', 'WEAPON4': '0.450', 'weapon2': '0.640', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 262209536. Throughput: 0: 4409.1. Samples: 65555990. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:39:07,794][52567] Avg episode reward: [(0, '62.506')] [2024-08-06 01:39:07,804][52671] DAMAGECOUNT value on done: 219650.0 [2024-08-06 01:39:07,805][52671] Sum rewards: 57.073, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.216', 'AMMO3': '0.245', 'weapon2': '0.250', 'AMMO4': '0.253', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.574', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:08,693][52658] DAMAGECOUNT value on done: 220260.0 [2024-08-06 01:39:08,693][52658] Sum rewards: 63.872, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.662', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon5': '0.204', 'AMMO3': '0.214', 'WEAPON5': '0.350', 'weapon2': '0.408', 'weapon4': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '55.500'} [2024-08-06 01:39:08,935][52650] Updated weights for policy 0, policy_version 32011 (0.0012) [2024-08-06 01:39:08,988][52670] DAMAGECOUNT value on done: 219117.0 [2024-08-06 01:39:08,988][52670] Sum rewards: 61.731, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.842', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'weapon4': '0.258', 'AMMO3': '0.282', 'weapon2': '0.434', 'WEAPON3': '1.650', 'weapon3': '2.996', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:09,516][52664] DAMAGECOUNT value on done: 226457.0 [2024-08-06 01:39:09,516][52664] Sum rewards: 59.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.803', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.164', 'weapon2': '0.228', 'weapon4': '0.242', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.112', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '52.000'} [2024-08-06 01:39:09,638][52666] DAMAGECOUNT value on done: 213488.0 [2024-08-06 01:39:09,640][52666] Sum rewards: 64.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.094', 'AMMO4': '0.176', 'AMMO3': '0.196', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '55.000'} [2024-08-06 01:39:10,987][52671] DAMAGECOUNT value on done: 226012.0 [2024-08-06 01:39:10,987][52671] Sum rewards: 72.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.548', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.092', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 01:39:11,365][52658] DAMAGECOUNT value on done: 224245.0 [2024-08-06 01:39:11,366][52658] Sum rewards: 58.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.078', 'weapon4': '0.208', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:11,613][52670] DAMAGECOUNT value on done: 217636.0 [2024-08-06 01:39:11,615][52670] Sum rewards: 75.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.654', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.138', 'weapon5': '0.188', 'weapon4': '0.240', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon3': '3.050', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '60.000'} [2024-08-06 01:39:12,183][52666] DAMAGECOUNT value on done: 224817.0 [2024-08-06 01:39:12,183][52666] Sum rewards: 72.305, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.012', 'weapon5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '60.000'} [2024-08-06 01:39:12,714][52664] DAMAGECOUNT value on done: 232213.0 [2024-08-06 01:39:12,714][52664] Sum rewards: 70.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.366', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.144', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.226', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '60.000'} [2024-08-06 01:39:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 262299648. Throughput: 0: 4406.9. Samples: 65582490. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:39:12,795][52567] Avg episode reward: [(0, '62.751')] [2024-08-06 01:39:13,354][52671] DAMAGECOUNT value on done: 224491.0 [2024-08-06 01:39:13,357][52671] Sum rewards: 68.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.728', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '56.000'} [2024-08-06 01:39:13,635][52650] Updated weights for policy 0, policy_version 32021 (0.0025) [2024-08-06 01:39:14,493][52670] DAMAGECOUNT value on done: 211552.0 [2024-08-06 01:39:14,494][52670] Sum rewards: 61.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.048', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.274', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '53.000'} [2024-08-06 01:39:15,102][52666] DAMAGECOUNT value on done: 222458.0 [2024-08-06 01:39:15,106][52666] Sum rewards: 69.003, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.124', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.412', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.500'} [2024-08-06 01:39:15,904][52664] DAMAGECOUNT value on done: 233166.0 [2024-08-06 01:39:15,904][52664] Sum rewards: 74.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon4': '0.410', 'weapon2': '0.712', 'WEAPON3': '1.250', 'weapon3': '2.570', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '61.000'} [2024-08-06 01:39:16,085][52671] DAMAGECOUNT value on done: 221939.0 [2024-08-06 01:39:16,086][52671] Sum rewards: 74.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.983', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'weapon2': '0.228', 'AMMO3': '0.261', 'WEAPON3': '1.700', 'weapon3': '3.438', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '64.000'} [2024-08-06 01:39:16,183][52649] DAMAGECOUNT value on done: 215096.0 [2024-08-06 01:39:16,183][52649] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.394', 'weapon2': '0.696', 'WEAPON3': '1.250', 'weapon3': '2.580', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '55.000'} [2024-08-06 01:39:16,907][52663] DAMAGECOUNT value on done: 223039.0 [2024-08-06 01:39:16,907][52663] Sum rewards: 66.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.705', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.064', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon2': '0.200', 'weapon4': '0.222', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.274', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '56.000'} [2024-08-06 01:39:17,279][52670] DAMAGECOUNT value on done: 223046.0 [2024-08-06 01:39:17,281][52670] Sum rewards: 68.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.386', 'AMMO5': '0.011', 'AMMO2': '0.058', 'AMMO3': '0.198', 'weapon5': '0.212', 'AMMO4': '0.288', 'WEAPON5': '0.350', 'weapon4': '0.388', 'weapon2': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '58.000'} [2024-08-06 01:39:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 262381568. Throughput: 0: 4418.7. Samples: 65595710. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 01:39:17,794][52567] Avg episode reward: [(0, '63.110')] [2024-08-06 01:39:17,845][52666] DAMAGECOUNT value on done: 215675.0 [2024-08-06 01:39:17,845][52666] Sum rewards: 62.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:18,151][52650] Updated weights for policy 0, policy_version 32031 (0.0019) [2024-08-06 01:39:18,559][52664] DAMAGECOUNT value on done: 229489.0 [2024-08-06 01:39:18,559][52664] Sum rewards: 70.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.074', 'AMMO3': '0.171', 'weapon5': '0.200', 'WEAPON5': '0.300', 'AMMO4': '0.372', 'weapon2': '0.542', 'WEAPON4': '0.700', 'weapon4': '0.996', 'WEAPON3': '1.000', 'weapon3': '1.888', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '59.000'} [2024-08-06 01:39:18,895][52671] DAMAGECOUNT value on done: 230475.0 [2024-08-06 01:39:18,896][52671] Sum rewards: 72.794, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.117', 'weapon4': '0.132', 'AMMO4': '0.166', 'weapon2': '0.544', 'WEAPON3': '0.850', 'weapon3': '3.078', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:19,295][52649] DAMAGECOUNT value on done: 208392.0 [2024-08-06 01:39:19,297][52649] Sum rewards: 36.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.037', 'weapon7': '0.078', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.152', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon4': '1.626', 'weapon3': '1.734', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '9.771', 'FRAGCOUNT': '32.000'} [2024-08-06 01:39:19,438][52663] DAMAGECOUNT value on done: 221642.0 [2024-08-06 01:39:19,439][52663] Sum rewards: 58.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.945', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.040', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.273', 'weapon2': '0.290', 'WEAPON3': '1.700', 'HITCOUNT': '3.200', 'weapon3': '3.452', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:19,740][52659] DAMAGECOUNT value on done: 222565.0 [2024-08-06 01:39:19,740][52659] Sum rewards: 74.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '60.000'} [2024-08-06 01:39:19,899][52670] DAMAGECOUNT value on done: 220433.0 [2024-08-06 01:39:19,899][52670] Sum rewards: 55.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.801', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.030', 'AMMO4': '0.122', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '3.280', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '48.000'} [2024-08-06 01:39:20,512][52666] DAMAGECOUNT value on done: 217804.0 [2024-08-06 01:39:20,513][52666] Sum rewards: 50.175, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.713', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.212', 'weapon2': '0.476', 'WEAPON3': '1.300', 'HITCOUNT': '2.680', 'weapon3': '3.360', 'DAMAGECOUNT': '11.775', 'FRAGCOUNT': '44.000'} [2024-08-06 01:39:21,605][52664] DAMAGECOUNT value on done: 230077.0 [2024-08-06 01:39:21,606][52664] Sum rewards: 58.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.535', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '50.500'} [2024-08-06 01:39:22,054][52649] DAMAGECOUNT value on done: 217823.0 [2024-08-06 01:39:22,055][52649] Sum rewards: 72.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.090', 'weapon5': '0.090', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.444', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 01:39:22,128][52671] DAMAGECOUNT value on done: 221566.0 [2024-08-06 01:39:22,128][52671] Sum rewards: 62.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.118', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.282', 'weapon4': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '53.000'} [2024-08-06 01:39:22,246][52663] DAMAGECOUNT value on done: 217427.0 [2024-08-06 01:39:22,247][52663] Sum rewards: 66.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.922', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.086', 'AMMO4': '0.111', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.150', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:22,252][52670] DAMAGECOUNT value on done: 219418.0 [2024-08-06 01:39:22,254][52670] Sum rewards: 58.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.156', 'AMMO3': '0.215', 'weapon4': '0.236', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.894', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:22,775][52666] DAMAGECOUNT value on done: 216839.0 [2024-08-06 01:39:22,776][52666] Sum rewards: 60.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.348', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.252', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 262471680. Throughput: 0: 4415.1. Samples: 65622170. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:39:22,794][52567] Avg episode reward: [(0, '63.134')] [2024-08-06 01:39:22,797][52795] DAMAGECOUNT value on done: 205358.0 [2024-08-06 01:39:22,797][52795] Sum rewards: 66.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.020', 'AMMO4': '0.051', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.554', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '56.000'} [2024-08-06 01:39:22,929][52659] DAMAGECOUNT value on done: 220033.0 [2024-08-06 01:39:22,930][52659] Sum rewards: 59.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.733', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.430', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '49.000'} [2024-08-06 01:39:23,097][52650] Updated weights for policy 0, policy_version 32041 (0.0026) [2024-08-06 01:39:24,751][52670] DAMAGECOUNT value on done: 221381.0 [2024-08-06 01:39:24,753][52670] Sum rewards: 61.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.786', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.144', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'weapon4': '0.362', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '52.000'} [2024-08-06 01:39:25,183][52649] DAMAGECOUNT value on done: 216957.0 [2024-08-06 01:39:25,183][52649] Sum rewards: 71.983, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon4': '0.222', 'HEALTH': '0.250', 'weapon2': '0.728', 'WEAPON3': '1.000', 'weapon3': '2.798', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '58.000'} [2024-08-06 01:39:25,202][52671] DAMAGECOUNT value on done: 216193.0 [2024-08-06 01:39:25,204][52671] Sum rewards: 59.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.161', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.124', 'AMMO3': '0.213', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '49.000'} [2024-08-06 01:39:25,343][52666] DAMAGECOUNT value on done: 222161.0 [2024-08-06 01:39:25,343][52666] Sum rewards: 60.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.566', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.107', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.350', 'weapon4': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:25,448][52663] DAMAGECOUNT value on done: 222568.0 [2024-08-06 01:39:25,448][52663] Sum rewards: 82.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.817', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.118', 'AMMO3': '0.182', 'weapon2': '0.222', 'WEAPON3': '1.100', 'weapon3': '3.422', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '67.000'} [2024-08-06 01:39:25,557][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:39:25,853][52659] DAMAGECOUNT value on done: 221632.0 [2024-08-06 01:39:25,854][52659] Sum rewards: 59.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.084', 'AMMO4': '0.158', 'weapon5': '0.166', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '49.500'} [2024-08-06 01:39:25,872][52795] DAMAGECOUNT value on done: 202589.0 [2024-08-06 01:39:25,872][52795] Sum rewards: 56.383, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.772', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.078', 'AMMO4': '0.168', 'AMMO3': '0.229', 'weapon4': '0.278', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.068', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.500'} [2024-08-06 01:39:27,415][52670] DAMAGECOUNT value on done: 222814.0 [2024-08-06 01:39:27,415][52670] Sum rewards: 55.428, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.842', 'AMMO5': '0.004', 'AMMO2': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.182', 'weapon4': '0.208', 'WEAPON4': '0.400', 'weapon2': '0.562', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.026', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '47.000'} [2024-08-06 01:39:27,730][52650] Updated weights for policy 0, policy_version 32051 (0.0024) [2024-08-06 01:39:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 262561792. Throughput: 0: 4417.8. Samples: 65648500. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:39:27,794][52567] Avg episode reward: [(0, '63.257')] [2024-08-06 01:39:27,918][52671] DAMAGECOUNT value on done: 225011.0 [2024-08-06 01:39:27,920][52671] Sum rewards: 60.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.854', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.066', 'AMMO4': '0.172', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.438', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.802', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:28,406][52659] DAMAGECOUNT value on done: 220365.0 [2024-08-06 01:39:28,406][52659] Sum rewards: 57.303, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.642', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.161', 'weapon2': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.534', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '47.000'} [2024-08-06 01:39:28,414][52666] DAMAGECOUNT value on done: 215605.0 [2024-08-06 01:39:28,415][52666] Sum rewards: 61.164, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.489', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.524', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.130', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:28,443][52649] DAMAGECOUNT value on done: 208359.0 [2024-08-06 01:39:28,443][52649] Sum rewards: 63.374, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.704', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.178', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.766', 'WEAPON3': '1.200', 'weapon3': '2.758', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '53.000'} [2024-08-06 01:39:28,665][52663] DAMAGECOUNT value on done: 220088.0 [2024-08-06 01:39:28,666][52663] Sum rewards: 64.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.688', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.166', 'AMMO3': '0.168', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.776', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '52.000'} [2024-08-06 01:39:28,997][52795] DAMAGECOUNT value on done: 201578.0 [2024-08-06 01:39:28,999][52795] Sum rewards: 61.751, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.846', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.136', 'weapon5': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.484', 'weapon2': '0.730', 'WEAPON3': '0.800', 'weapon3': '2.450', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '49.000'} [2024-08-06 01:39:30,058][52670] DAMAGECOUNT value on done: 209815.0 [2024-08-06 01:39:30,058][52670] Sum rewards: 64.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.162', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.196', 'AMMO3': '0.205', 'AMMO4': '0.237', 'weapon5': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.654', 'WEAPON3': '1.350', 'weapon3': '2.582', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '54.000'} [2024-08-06 01:39:30,243][52671] DAMAGECOUNT value on done: 224213.0 [2024-08-06 01:39:30,245][52671] Sum rewards: 56.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.182', 'AMMO3': '0.191', 'AMMO4': '0.231', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.776', 'WEAPON3': '1.150', 'weapon3': '2.476', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '48.000'} [2024-08-06 01:39:30,783][52666] DAMAGECOUNT value on done: 218134.0 [2024-08-06 01:39:30,784][52666] Sum rewards: 60.515, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.835', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.114', 'weapon4': '0.116', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.650', 'weapon3': '2.794', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '53.000'} [2024-08-06 01:39:30,943][52659] DAMAGECOUNT value on done: 220117.0 [2024-08-06 01:39:30,944][52659] Sum rewards: 47.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.738', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO2': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.204', 'AMMO3': '0.207', 'AMMO4': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.914', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '42.000'} [2024-08-06 01:39:31,480][52649] DAMAGECOUNT value on done: 218055.0 [2024-08-06 01:39:31,481][52649] Sum rewards: 76.036, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.115', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.154', 'AMMO4': '0.215', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.330', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '64.000'} [2024-08-06 01:39:31,999][52663] DAMAGECOUNT value on done: 224603.0 [2024-08-06 01:39:31,999][52663] Sum rewards: 62.820, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.382', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.062', 'weapon4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.628', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '52.000'} [2024-08-06 01:39:32,088][52795] DAMAGECOUNT value on done: 203164.0 [2024-08-06 01:39:32,090][52795] Sum rewards: 72.222, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.143', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.162', 'weapon4': '0.346', 'WEAPON3': '0.900', 'HITCOUNT': '3.170', 'weapon3': '3.238', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:32,302][52650] Updated weights for policy 0, policy_version 32061 (0.0023) [2024-08-06 01:39:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 262643712. Throughput: 0: 4417.3. Samples: 65661830. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:39:32,794][52567] Avg episode reward: [(0, '62.880')] [2024-08-06 01:39:32,981][52670] DAMAGECOUNT value on done: 222544.0 [2024-08-06 01:39:32,983][52670] Sum rewards: 75.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.096', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.110', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '64.000'} [2024-08-06 01:39:33,112][52671] DAMAGECOUNT value on done: 228109.0 [2024-08-06 01:39:33,112][52671] Sum rewards: 74.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.168', 'weapon5': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '61.000'} [2024-08-06 01:39:33,827][52659] DAMAGECOUNT value on done: 220998.0 [2024-08-06 01:39:33,828][52659] Sum rewards: 72.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.715', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.177', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '60.000'} [2024-08-06 01:39:34,417][52649] DAMAGECOUNT value on done: 212982.0 [2024-08-06 01:39:34,419][52649] Sum rewards: 60.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.084', 'weapon5': '0.122', 'AMMO4': '0.185', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:34,947][52663] DAMAGECOUNT value on done: 221645.0 [2024-08-06 01:39:34,948][52663] Sum rewards: 54.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.849', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.168', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.086', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:35,272][52795] DAMAGECOUNT value on done: 208347.0 [2024-08-06 01:39:35,272][52795] Sum rewards: 66.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.096', 'weapon4': '0.136', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '55.000'} [2024-08-06 01:39:35,606][52670] DAMAGECOUNT value on done: 225809.0 [2024-08-06 01:39:35,610][52670] Sum rewards: 77.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.256', 'weapon4': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '64.000'} [2024-08-06 01:39:36,273][52671] DAMAGECOUNT value on done: 225543.0 [2024-08-06 01:39:36,273][52671] Sum rewards: 61.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.004', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.398', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '52.000'} [2024-08-06 01:39:36,844][52659] DAMAGECOUNT value on done: 220431.0 [2024-08-06 01:39:36,844][52659] Sum rewards: 61.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.212', 'AMMO3': '0.218', 'AMMO4': '0.219', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.772', 'WEAPON3': '1.350', 'weapon3': '2.430', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:36,868][52649] DAMAGECOUNT value on done: 220489.0 [2024-08-06 01:39:36,868][52649] Sum rewards: 55.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.064', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.124', 'weapon5': '0.174', 'AMMO4': '0.186', 'AMMO3': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '48.000'} [2024-08-06 01:39:37,057][52650] Updated weights for policy 0, policy_version 32071 (0.0019) [2024-08-06 01:39:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 262733824. Throughput: 0: 4413.1. Samples: 65688280. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:39:37,795][52567] Avg episode reward: [(0, '63.162')] [2024-08-06 01:39:37,899][52663] DAMAGECOUNT value on done: 220733.0 [2024-08-06 01:39:37,900][52663] Sum rewards: 56.339, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.795', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.464', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '3.056', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '45.000'} [2024-08-06 01:39:38,423][52795] DAMAGECOUNT value on done: 204010.0 [2024-08-06 01:39:38,423][52795] Sum rewards: 55.206, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.442', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.110', 'weapon5': '0.122', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.222', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '48.000'} [2024-08-06 01:39:38,753][52670] DAMAGECOUNT value on done: 219558.0 [2024-08-06 01:39:38,754][52670] Sum rewards: 65.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.094', 'AMMO3': '0.218', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:39,162][52671] DAMAGECOUNT value on done: 221396.0 [2024-08-06 01:39:39,164][52671] Sum rewards: 50.550, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.102', 'AMMO3': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.358', 'weapon2': '0.498', 'WEAPON3': '0.750', 'HITCOUNT': '2.510', 'weapon3': '2.798', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '40.000'} [2024-08-06 01:39:39,800][52659] DAMAGECOUNT value on done: 216533.0 [2024-08-06 01:39:39,801][52659] Sum rewards: 62.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.236', 'weapon2': '0.240', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '54.000'} [2024-08-06 01:39:39,819][52665] DAMAGECOUNT value on done: 218665.0 [2024-08-06 01:39:39,820][52665] Sum rewards: 53.582, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon2': '0.240', 'AMMO3': '0.289', 'WEAPON3': '1.750', 'HITCOUNT': '2.930', 'weapon3': '3.402', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '48.000'} [2024-08-06 01:39:40,066][52649] DAMAGECOUNT value on done: 215957.0 [2024-08-06 01:39:40,066][52649] Sum rewards: 69.399, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.795', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.188', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '58.000'} [2024-08-06 01:39:40,968][52663] DAMAGECOUNT value on done: 221683.0 [2024-08-06 01:39:40,972][52663] Sum rewards: 70.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '58.000'} [2024-08-06 01:39:41,400][52650] Updated weights for policy 0, policy_version 32081 (0.0013) [2024-08-06 01:39:41,424][52670] DAMAGECOUNT value on done: 221578.0 [2024-08-06 01:39:41,425][52670] Sum rewards: 72.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.292', 'WEAPON3': '1.600', 'weapon3': '3.418', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '62.000'} [2024-08-06 01:39:41,610][52795] DAMAGECOUNT value on done: 209618.0 [2024-08-06 01:39:41,610][52795] Sum rewards: 70.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.082', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.122', 'AMMO3': '0.149', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.364', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.824', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:42,281][52659] DAMAGECOUNT value on done: 226562.0 [2024-08-06 01:39:42,283][52659] Sum rewards: 51.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.152', 'weapon4': '0.174', 'AMMO3': '0.208', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.862', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '44.000'} [2024-08-06 01:39:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 262823936. Throughput: 0: 4409.5. Samples: 65714550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 01:39:42,794][52665] DAMAGECOUNT value on done: 224497.0 [2024-08-06 01:39:42,794][52567] Avg episode reward: [(0, '62.992')] [2024-08-06 01:39:42,795][52665] Sum rewards: 71.160, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'HEALTH': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.176', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.434', 'weapon2': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:42,947][52649] DAMAGECOUNT value on done: 216834.0 [2024-08-06 01:39:42,948][52649] Sum rewards: 60.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon5': '0.224', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.350', 'weapon4': '0.444', 'WEAPON3': '1.600', 'weapon3': '2.576', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '54.000'} [2024-08-06 01:39:43,763][52663] DAMAGECOUNT value on done: 223444.0 [2024-08-06 01:39:43,764][52663] Sum rewards: 60.780, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.301', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.058', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.000'} [2024-08-06 01:39:44,822][52795] DAMAGECOUNT value on done: 206990.0 [2024-08-06 01:39:44,822][52795] Sum rewards: 65.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.305', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.158', 'weapon5': '0.180', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.358', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.990', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '55.000'} [2024-08-06 01:39:44,823][52659] DAMAGECOUNT value on done: 227195.0 [2024-08-06 01:39:44,823][52659] Sum rewards: 52.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO3': '0.228', 'weapon2': '0.514', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.330', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '46.000'} [2024-08-06 01:39:45,706][52665] DAMAGECOUNT value on done: 219251.0 [2024-08-06 01:39:45,728][52665] Sum rewards: 51.456, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.978', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.194', 'AMMO4': '0.202', 'AMMO3': '0.225', 'weapon4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '2.852', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '46.000'} [2024-08-06 01:39:45,971][52649] DAMAGECOUNT value on done: 217717.0 [2024-08-06 01:39:45,973][52649] Sum rewards: 52.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.375', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.155', 'weapon2': '0.190', 'AMMO3': '0.200', 'WEAPON5': '0.350', 'weapon4': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '2.912', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '45.000'} [2024-08-06 01:39:46,386][52650] Updated weights for policy 0, policy_version 32091 (0.0043) [2024-08-06 01:39:46,658][52663] DAMAGECOUNT value on done: 225569.0 [2024-08-06 01:39:46,667][52663] Sum rewards: 76.305, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.223', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.165', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '63.000'} [2024-08-06 01:39:47,246][52659] DAMAGECOUNT value on done: 220575.0 [2024-08-06 01:39:47,246][52659] Sum rewards: 58.138, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon4': '0.302', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:47,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 262922240. Throughput: 0: 4406.9. Samples: 65727840. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:39:47,795][52567] Avg episode reward: [(0, '63.030')] [2024-08-06 01:39:48,006][52795] DAMAGECOUNT value on done: 203074.0 [2024-08-06 01:39:48,007][52795] Sum rewards: 61.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.804', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.180', 'weapon5': '0.256', 'AMMO4': '0.260', 'weapon4': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.776', 'WEAPON3': '0.950', 'weapon3': '2.360', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '51.000'} [2024-08-06 01:39:48,276][52665] DAMAGECOUNT value on done: 217367.0 [2024-08-06 01:39:48,277][52665] Sum rewards: 71.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.242', 'weapon4': '0.288', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '60.000'} [2024-08-06 01:39:48,465][52649] DAMAGECOUNT value on done: 215732.0 [2024-08-06 01:39:48,467][52649] Sum rewards: 68.807, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.810', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '57.000'} [2024-08-06 01:39:49,638][52663] DAMAGECOUNT value on done: 222107.0 [2024-08-06 01:39:49,640][52663] Sum rewards: 62.317, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.508', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon5': '0.090', 'AMMO3': '0.229', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.428', 'weapon4': '0.624', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.614', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '56.000'} [2024-08-06 01:39:50,334][52659] DAMAGECOUNT value on done: 218789.0 [2024-08-06 01:39:50,337][52659] Sum rewards: 60.007, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.090', 'AMMO3': '0.172', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.948', 'WEAPON3': '1.050', 'weapon3': '2.552', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:50,665][52650] Updated weights for policy 0, policy_version 32101 (0.0025) [2024-08-06 01:39:50,944][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:39:50,944][52665] DAMAGECOUNT value on done: 216064.0 [2024-08-06 01:39:50,946][52665] Sum rewards: 70.910, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.200', 'AMMO2': '0.016', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.290', 'weapon2': '0.298', 'WEAPON3': '1.800', 'weapon3': '3.478', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '64.000'} [2024-08-06 01:39:51,070][52795] DAMAGECOUNT value on done: 208287.0 [2024-08-06 01:39:51,070][52795] Sum rewards: 58.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon4': '0.284', 'weapon2': '0.526', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:51,154][52649] DAMAGECOUNT value on done: 218639.0 [2024-08-06 01:39:51,155][52649] Sum rewards: 62.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.558', 'AMMO5': '0.003', 'ARMOR': '0.008', 'weapon5': '0.030', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON3': '0.950', 'weapon2': '0.988', 'weapon3': '2.466', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '49.000'} [2024-08-06 01:39:52,396][52663] DAMAGECOUNT value on done: 214964.0 [2024-08-06 01:39:52,404][52663] Sum rewards: 52.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '43.000'} [2024-08-06 01:39:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 263004160. Throughput: 0: 4403.8. Samples: 65754160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:39:52,795][52567] Avg episode reward: [(0, '63.426')] [2024-08-06 01:39:53,258][52659] DAMAGECOUNT value on done: 215833.0 [2024-08-06 01:39:53,259][52659] Sum rewards: 62.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.152', 'weapon4': '0.158', 'AMMO4': '0.172', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '52.500'} [2024-08-06 01:39:53,322][52665] DAMAGECOUNT value on done: 214394.0 [2024-08-06 01:39:53,324][52665] Sum rewards: 53.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.054', 'weapon5': '0.064', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.344', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '3.410', 'DAMAGECOUNT': '12.480', 'FRAGCOUNT': '44.000'} [2024-08-06 01:39:53,769][52649] DAMAGECOUNT value on done: 220097.0 [2024-08-06 01:39:53,771][52649] Sum rewards: 64.127, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.386', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '56.000'} [2024-08-06 01:39:54,175][52795] DAMAGECOUNT value on done: 206079.0 [2024-08-06 01:39:54,175][52795] Sum rewards: 59.629, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.874', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.068', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon2': '0.238', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.210', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '55.000'} [2024-08-06 01:39:55,481][52663] DAMAGECOUNT value on done: 215758.0 [2024-08-06 01:39:55,484][52663] Sum rewards: 60.945, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.278', 'weapon2': '0.408', 'WEAPON3': '1.600', 'weapon3': '3.272', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '55.000'} [2024-08-06 01:39:55,619][52650] Updated weights for policy 0, policy_version 32111 (0.0015) [2024-08-06 01:39:56,418][52659] DAMAGECOUNT value on done: 222466.0 [2024-08-06 01:39:56,418][52659] Sum rewards: 61.900, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO3': '0.159', 'AMMO4': '0.182', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.836', 'WEAPON3': '0.950', 'weapon3': '2.516', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '50.000'} [2024-08-06 01:39:56,533][52665] DAMAGECOUNT value on done: 220864.0 [2024-08-06 01:39:56,534][52665] Sum rewards: 68.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.556', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.160', 'AMMO4': '0.192', 'weapon4': '0.198', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '59.000'} [2024-08-06 01:39:57,022][52649] DAMAGECOUNT value on done: 210837.0 [2024-08-06 01:39:57,023][52649] Sum rewards: 66.862, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.950', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.176', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon2': '0.396', 'weapon4': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.616', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '59.000'} [2024-08-06 01:39:57,377][52795] DAMAGECOUNT value on done: 202460.0 [2024-08-06 01:39:57,377][52795] Sum rewards: 57.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.762', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.426', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '47.000'} [2024-08-06 01:39:57,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 263086080. Throughput: 0: 4403.3. Samples: 65780640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:39:57,794][52567] Avg episode reward: [(0, '63.379')] [2024-08-06 01:39:58,862][52663] DAMAGECOUNT value on done: 221949.0 [2024-08-06 01:39:58,863][52663] Sum rewards: 57.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.074', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.143', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.654', 'WEAPON3': '0.900', 'weapon3': '2.724', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '45.000'} [2024-08-06 01:39:59,604][52659] DAMAGECOUNT value on done: 225098.0 [2024-08-06 01:39:59,605][52659] Sum rewards: 71.949, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.542', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.027', 'weapon4': '0.108', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 01:39:59,642][52665] DAMAGECOUNT value on done: 219983.0 [2024-08-06 01:39:59,643][52665] Sum rewards: 61.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.665', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.210', 'weapon2': '0.218', 'weapon4': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2024-08-06 01:40:00,075][52649] DAMAGECOUNT value on done: 216510.0 [2024-08-06 01:40:00,076][52649] Sum rewards: 57.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.745', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.176', 'weapon4': '0.208', 'AMMO3': '0.210', 'AMMO4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.728', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '50.000'} [2024-08-06 01:40:00,417][52650] Updated weights for policy 0, policy_version 32121 (0.0012) [2024-08-06 01:40:00,549][52795] DAMAGECOUNT value on done: 202901.0 [2024-08-06 01:40:00,551][52795] Sum rewards: 64.329, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.896', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.230', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:02,047][52663] DAMAGECOUNT value on done: 225095.0 [2024-08-06 01:40:02,049][52663] Sum rewards: 81.896, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.101', 'HEALTH': '0.107', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.326', 'weapon2': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '65.000'} [2024-08-06 01:40:02,686][52659] DAMAGECOUNT value on done: 227911.0 [2024-08-06 01:40:02,688][52659] Sum rewards: 67.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.176', 'AMMO3': '0.225', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '57.000'} [2024-08-06 01:40:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 263176192. Throughput: 0: 4401.1. Samples: 65793760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:40:02,794][52567] Avg episode reward: [(0, '63.254')] [2024-08-06 01:40:03,023][52665] DAMAGECOUNT value on done: 223637.0 [2024-08-06 01:40:03,024][52665] Sum rewards: 49.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '3.112', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '41.500'} [2024-08-06 01:40:03,516][52649] DAMAGECOUNT value on done: 215752.0 [2024-08-06 01:40:03,516][52649] Sum rewards: 69.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.465', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '58.000'} [2024-08-06 01:40:03,732][52795] DAMAGECOUNT value on done: 207050.0 [2024-08-06 01:40:03,734][52795] Sum rewards: 59.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.771', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon4': '0.236', 'weapon2': '0.430', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '49.000'} [2024-08-06 01:40:04,758][52650] Updated weights for policy 0, policy_version 32131 (0.0016) [2024-08-06 01:40:05,340][52663] DAMAGECOUNT value on done: 223827.0 [2024-08-06 01:40:05,340][52663] Sum rewards: 66.888, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.812', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.634', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:05,625][52659] DAMAGECOUNT value on done: 226561.0 [2024-08-06 01:40:05,625][52659] Sum rewards: 57.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.259', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.176', 'weapon4': '0.182', 'AMMO4': '0.214', 'weapon5': '0.232', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '46.500'} [2024-08-06 01:40:05,974][52665] DAMAGECOUNT value on done: 221160.0 [2024-08-06 01:40:05,976][52665] Sum rewards: 52.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.130', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.398', 'weapon4': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '43.000'} [2024-08-06 01:40:06,609][52649] DAMAGECOUNT value on done: 221959.0 [2024-08-06 01:40:06,611][52649] Sum rewards: 64.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.143', 'AMMO4': '0.181', 'weapon5': '0.204', 'weapon2': '0.246', 'weapon4': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '2.952', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:06,777][52795] DAMAGECOUNT value on done: 198013.0 [2024-08-06 01:40:06,777][52795] Sum rewards: 44.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.180', 'AMMO4': '0.194', 'weapon2': '0.196', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '3.020', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '40.000'} [2024-08-06 01:40:07,425][52665] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:40:07,758][52803] DAMAGECOUNT value on done: 207688.0 [2024-08-06 01:40:07,759][52803] Sum rewards: 69.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.677', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '62.000'} [2024-08-06 01:40:07,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 263266304. Throughput: 0: 4394.4. Samples: 65819920. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:40:07,795][52567] Avg episode reward: [(0, '62.416')] [2024-08-06 01:40:07,811][52663] DAMAGECOUNT value on done: 227224.0 [2024-08-06 01:40:07,812][52663] Sum rewards: 70.155, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.076', 'HEALTH': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.258', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.290', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '59.000'} [2024-08-06 01:40:08,847][52659] DAMAGECOUNT value on done: 221951.0 [2024-08-06 01:40:08,847][52659] Sum rewards: 70.735, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '62.000'} [2024-08-06 01:40:08,986][52665] DAMAGECOUNT value on done: 227390.0 [2024-08-06 01:40:08,987][52665] Sum rewards: 62.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.284', 'weapon4': '0.416', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:09,539][52650] Updated weights for policy 0, policy_version 32141 (0.0024) [2024-08-06 01:40:09,649][52649] DAMAGECOUNT value on done: 222365.0 [2024-08-06 01:40:09,652][52649] Sum rewards: 67.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.102', 'AMMO3': '0.244', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '57.000'} [2024-08-06 01:40:09,968][52795] DAMAGECOUNT value on done: 210865.0 [2024-08-06 01:40:09,969][52795] Sum rewards: 70.220, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.205', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.206', 'weapon2': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.946', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:10,386][52663] DAMAGECOUNT value on done: 223656.0 [2024-08-06 01:40:10,386][52663] Sum rewards: 56.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon5': '0.142', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.372', 'weapon4': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '47.000'} [2024-08-06 01:40:10,916][52803] DAMAGECOUNT value on done: 208328.0 [2024-08-06 01:40:10,917][52803] Sum rewards: 54.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.722', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.238', 'weapon4': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '44.500'} [2024-08-06 01:40:11,594][52659] DAMAGECOUNT value on done: 227530.0 [2024-08-06 01:40:11,594][52659] Sum rewards: 56.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.733', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.068', 'AMMO4': '0.166', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '49.000'} [2024-08-06 01:40:12,101][52665] DAMAGECOUNT value on done: 224437.0 [2024-08-06 01:40:12,102][52665] Sum rewards: 64.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.592', 'AMMO5': '0.005', 'AMMO2': '0.056', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'AMMO4': '0.279', 'weapon2': '0.330', 'WEAPON4': '0.550', 'weapon4': '0.770', 'WEAPON3': '1.050', 'weapon3': '2.518', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:12,715][52649] DAMAGECOUNT value on done: 225612.0 [2024-08-06 01:40:12,716][52649] Sum rewards: 55.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.030', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.424', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '51.000'} [2024-08-06 01:40:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 263356416. Throughput: 0: 4388.7. Samples: 65845990. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:40:12,794][52567] Avg episode reward: [(0, '62.657')] [2024-08-06 01:40:13,131][52795] DAMAGECOUNT value on done: 210504.0 [2024-08-06 01:40:13,131][52795] Sum rewards: 70.403, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.650', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.181', 'weapon2': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.220', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 01:40:13,142][52663] DAMAGECOUNT value on done: 220232.0 [2024-08-06 01:40:13,146][52663] Sum rewards: 52.140, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.076', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.195', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.100', 'weapon4': '1.374', 'weapon3': '2.040', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.387', 'FRAGCOUNT': '44.000'} [2024-08-06 01:40:14,080][52659] DAMAGECOUNT value on done: 226096.0 [2024-08-06 01:40:14,082][52659] Sum rewards: 70.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.052', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '60.000'} [2024-08-06 01:40:14,135][52803] DAMAGECOUNT value on done: 205996.0 [2024-08-06 01:40:14,136][52803] Sum rewards: 57.700, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.168', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.622', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '48.000'} [2024-08-06 01:40:14,482][52650] Updated weights for policy 0, policy_version 32151 (0.0028) [2024-08-06 01:40:14,882][52665] DAMAGECOUNT value on done: 221739.0 [2024-08-06 01:40:14,882][52665] Sum rewards: 60.992, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.812', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.042', 'AMMO4': '0.171', 'weapon5': '0.176', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'WEAPON3': '1.800', 'HITCOUNT': '3.160', 'weapon3': '3.274', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:14,974][52811] DAMAGECOUNT value on done: 218447.0 [2024-08-06 01:40:14,974][52811] Sum rewards: 73.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '61.000'} [2024-08-06 01:40:16,196][52795] DAMAGECOUNT value on done: 199264.0 [2024-08-06 01:40:16,196][52795] Sum rewards: 65.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.156', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.204', 'AMMO3': '0.241', 'WEAPON3': '1.600', 'HITCOUNT': '3.290', 'weapon3': '3.506', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:17,168][52803] DAMAGECOUNT value on done: 210034.0 [2024-08-06 01:40:17,169][52803] Sum rewards: 71.265, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.038', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.066', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.312', 'AMMO3': '0.322', 'WEAPON3': '1.900', 'weapon3': '3.290', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '63.500'} [2024-08-06 01:40:17,592][52665] DAMAGECOUNT value on done: 220387.0 [2024-08-06 01:40:17,594][52665] Sum rewards: 65.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.500', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon5': '0.196', 'AMMO3': '0.247', 'weapon2': '0.272', 'AMMO4': '0.321', 'weapon4': '0.470', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.782', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 263438336. Throughput: 0: 4389.3. Samples: 65859350. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:40:17,794][52567] Avg episode reward: [(0, '62.876')] [2024-08-06 01:40:18,086][52811] DAMAGECOUNT value on done: 206253.0 [2024-08-06 01:40:18,086][52811] Sum rewards: 58.550, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.048', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.600', 'weapon3': '2.988', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:19,016][52650] Updated weights for policy 0, policy_version 32161 (0.0037) [2024-08-06 01:40:19,375][52795] DAMAGECOUNT value on done: 212065.0 [2024-08-06 01:40:19,375][52795] Sum rewards: 61.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.134', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '51.000'} [2024-08-06 01:40:20,229][52803] DAMAGECOUNT value on done: 211694.0 [2024-08-06 01:40:20,231][52803] Sum rewards: 63.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.149', 'AMMO3': '0.190', 'weapon4': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:20,873][52665] DAMAGECOUNT value on done: 221008.0 [2024-08-06 01:40:20,873][52665] Sum rewards: 58.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.817', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.672', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.012', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '48.000'} [2024-08-06 01:40:21,194][52811] DAMAGECOUNT value on done: 207897.0 [2024-08-06 01:40:21,196][52811] Sum rewards: 53.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.213', 'weapon5': '0.216', 'AMMO4': '0.292', 'weapon2': '0.388', 'WEAPON5': '0.450', 'weapon4': '0.476', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.600', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '48.000'} [2024-08-06 01:40:22,499][52795] DAMAGECOUNT value on done: 211892.0 [2024-08-06 01:40:22,499][52795] Sum rewards: 61.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.504', 'AMMO5': '0.017', 'weapon5': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 263528448. Throughput: 0: 4390.0. Samples: 65885830. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 01:40:22,802][52567] Avg episode reward: [(0, '62.738')] [2024-08-06 01:40:23,350][52803] DAMAGECOUNT value on done: 210376.0 [2024-08-06 01:40:23,353][52803] Sum rewards: 65.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.041', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'AMMO3': '0.216', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '57.000'} [2024-08-06 01:40:23,559][52650] Updated weights for policy 0, policy_version 32171 (0.0026) [2024-08-06 01:40:23,627][52665] DAMAGECOUNT value on done: 219453.0 [2024-08-06 01:40:23,629][52665] Sum rewards: 55.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.120', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.138', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.382', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '48.000'} [2024-08-06 01:40:24,315][52811] DAMAGECOUNT value on done: 207596.0 [2024-08-06 01:40:24,315][52811] Sum rewards: 65.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.368', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:26,414][52803] DAMAGECOUNT value on done: 208952.0 [2024-08-06 01:40:26,415][52803] Sum rewards: 55.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon2': '0.142', 'AMMO4': '0.163', 'AMMO3': '0.244', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.410', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '47.000'} [2024-08-06 01:40:26,712][52665] DAMAGECOUNT value on done: 219246.0 [2024-08-06 01:40:26,713][52665] Sum rewards: 67.350, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.524', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '59.000'} [2024-08-06 01:40:27,394][52811] DAMAGECOUNT value on done: 208201.0 [2024-08-06 01:40:27,394][52811] Sum rewards: 52.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.346', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.189', 'AMMO4': '0.230', 'weapon5': '0.268', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.554', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '44.000'} [2024-08-06 01:40:27,808][52567] Fps is (10 sec: 17997.5, 60 sec: 17608.7, 300 sec: 17577.3). Total num frames: 263618560. Throughput: 0: 4393.3. Samples: 65912310. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:40:27,808][52567] Avg episode reward: [(0, '62.635')] [2024-08-06 01:40:27,818][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032180_263618560.pth... [2024-08-06 01:40:27,942][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031666_259407872.pth [2024-08-06 01:40:28,381][52650] Updated weights for policy 0, policy_version 32181 (0.0012) [2024-08-06 01:40:28,947][52820] DAMAGECOUNT value on done: 204863.0 [2024-08-06 01:40:28,947][52820] Sum rewards: 64.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.336', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.064', 'AMMO4': '0.130', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.212', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:29,831][52665] DAMAGECOUNT value on done: 216812.0 [2024-08-06 01:40:29,831][52665] Sum rewards: 60.427, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.110', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.284', 'weapon2': '0.308', 'WEAPON3': '1.700', 'HITCOUNT': '3.090', 'weapon3': '3.300', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:29,902][52803] DAMAGECOUNT value on done: 204707.0 [2024-08-06 01:40:29,902][52803] Sum rewards: 69.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.644', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.104', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '59.000'} [2024-08-06 01:40:30,407][52811] DAMAGECOUNT value on done: 213901.0 [2024-08-06 01:40:30,407][52811] Sum rewards: 64.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.120', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.232', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:31,932][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:40:32,102][52820] DAMAGECOUNT value on done: 206710.0 [2024-08-06 01:40:32,103][52820] Sum rewards: 60.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'weapon7': '0.114', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.168', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.440', 'weapon4': '0.688', 'WEAPON3': '0.950', 'weapon3': '2.378', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '48.000'} [2024-08-06 01:40:32,465][52668] DAMAGECOUNT value on done: 221000.0 [2024-08-06 01:40:32,465][52668] Sum rewards: 57.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.908', 'AMMO5': '0.008', 'AMMO2': '0.058', 'weapon5': '0.162', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'AMMO4': '0.291', 'weapon4': '0.312', 'WEAPON4': '0.500', 'weapon2': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.664', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '48.000'} [2024-08-06 01:40:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 263700480. Throughput: 0: 4387.1. Samples: 65925260. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:40:32,794][52567] Avg episode reward: [(0, '62.456')] [2024-08-06 01:40:32,866][52803] DAMAGECOUNT value on done: 209303.0 [2024-08-06 01:40:32,867][52803] Sum rewards: 61.750, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.038', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.263', 'weapon2': '0.338', 'WEAPON4': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.450', 'weapon3': '2.880', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:32,898][52650] Updated weights for policy 0, policy_version 32191 (0.0027) [2024-08-06 01:40:32,955][52665] DAMAGECOUNT value on done: 222618.0 [2024-08-06 01:40:32,956][52665] Sum rewards: 54.558, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.234', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.169', 'weapon4': '0.174', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.148', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '47.000'} [2024-08-06 01:40:33,469][52811] DAMAGECOUNT value on done: 210380.0 [2024-08-06 01:40:33,479][52811] Sum rewards: 58.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.185', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.070', 'weapon4': '0.110', 'WEAPON4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.273', 'WEAPON3': '1.700', 'HITCOUNT': '2.890', 'weapon3': '3.414', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:35,201][52668] DAMAGECOUNT value on done: 229475.0 [2024-08-06 01:40:35,201][52668] Sum rewards: 53.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.549', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.179', 'weapon2': '0.456', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.148', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '44.000'} [2024-08-06 01:40:35,271][52820] DAMAGECOUNT value on done: 204922.0 [2024-08-06 01:40:35,273][52820] Sum rewards: 65.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.057', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.141', 'AMMO3': '0.180', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.948', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:35,470][52665] DAMAGECOUNT value on done: 220278.0 [2024-08-06 01:40:35,472][52665] Sum rewards: 66.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.830', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:36,027][52803] DAMAGECOUNT value on done: 205783.0 [2024-08-06 01:40:36,028][52803] Sum rewards: 56.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.392', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.132', 'weapon5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '2.970', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '47.500'} [2024-08-06 01:40:36,692][52811] DAMAGECOUNT value on done: 208338.0 [2024-08-06 01:40:36,692][52811] Sum rewards: 63.030, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.236', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:37,625][52650] Updated weights for policy 0, policy_version 32201 (0.0019) [2024-08-06 01:40:37,794][52567] Fps is (10 sec: 17227.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 263790592. Throughput: 0: 4390.0. Samples: 65951710. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:40:37,794][52567] Avg episode reward: [(0, '61.956')] [2024-08-06 01:40:38,023][52668] DAMAGECOUNT value on done: 226288.0 [2024-08-06 01:40:38,023][52668] Sum rewards: 70.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.515', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '0.850', 'weapon2': '0.872', 'weapon3': '2.682', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:38,338][52820] DAMAGECOUNT value on done: 198800.0 [2024-08-06 01:40:38,338][52820] Sum rewards: 64.456, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'HEALTH': '0.020', 'AMMO2': '0.022', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.150', 'weapon2': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.956', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '50.000'} [2024-08-06 01:40:39,192][52647] DAMAGECOUNT value on done: 238796.0 [2024-08-06 01:40:39,203][52647] Sum rewards: 69.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.395', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon4': '0.180', 'AMMO3': '0.216', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '60.000'} [2024-08-06 01:40:39,241][52803] DAMAGECOUNT value on done: 214193.0 [2024-08-06 01:40:39,242][52803] Sum rewards: 71.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.070', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.254', 'weapon2': '0.392', 'weapon4': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '60.000'} [2024-08-06 01:40:39,597][52811] DAMAGECOUNT value on done: 215958.0 [2024-08-06 01:40:39,599][52811] Sum rewards: 62.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.945', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.094', 'AMMO4': '0.120', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '0.950', 'HITCOUNT': '3.110', 'weapon3': '3.338', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '50.000'} [2024-08-06 01:40:39,763][52662] DAMAGECOUNT value on done: 230180.0 [2024-08-06 01:40:39,766][52662] Sum rewards: 50.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.882', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.215', 'weapon2': '0.564', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.206', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '43.000'} [2024-08-06 01:40:40,829][52668] DAMAGECOUNT value on done: 227731.0 [2024-08-06 01:40:40,831][52668] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.075', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.159', 'weapon2': '0.504', 'WEAPON3': '1.000', 'HITCOUNT': '3.050', 'weapon3': '3.426', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:40,911][52667] DAMAGECOUNT value on done: 224627.0 [2024-08-06 01:40:40,915][52667] Sum rewards: 71.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.131', 'weapon5': '0.136', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.478', 'weapon4': '0.632', 'WEAPON3': '0.850', 'weapon3': '2.522', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:41,628][52820] DAMAGECOUNT value on done: 207924.0 [2024-08-06 01:40:41,632][52820] Sum rewards: 66.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.487', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.161', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '58.000'} [2024-08-06 01:40:41,798][52647] DAMAGECOUNT value on done: 233817.0 [2024-08-06 01:40:41,799][52647] Sum rewards: 55.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.035', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.048', 'AMMO3': '0.153', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.442', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '2.956', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '46.000'} [2024-08-06 01:40:42,103][52650] Updated weights for policy 0, policy_version 32211 (0.0016) [2024-08-06 01:40:42,220][52803] DAMAGECOUNT value on done: 210981.0 [2024-08-06 01:40:42,223][52803] Sum rewards: 59.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.692', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.270', 'weapon2': '0.310', 'WEAPON3': '1.600', 'weapon3': '3.232', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '52.000'} [2024-08-06 01:40:42,644][52811] DAMAGECOUNT value on done: 209893.0 [2024-08-06 01:40:42,645][52811] Sum rewards: 52.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '46.500'} [2024-08-06 01:40:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 263880704. Throughput: 0: 4389.8. Samples: 65978180. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:40:42,794][52567] Avg episode reward: [(0, '62.248')] [2024-08-06 01:40:43,082][52662] DAMAGECOUNT value on done: 229990.0 [2024-08-06 01:40:43,082][52662] Sum rewards: 49.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.165', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.134', 'AMMO3': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '2.930', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '43.000'} [2024-08-06 01:40:44,017][52668] DAMAGECOUNT value on done: 218465.0 [2024-08-06 01:40:44,018][52668] Sum rewards: 48.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.151', 'AMMO4': '0.230', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.512', 'weapon2': '0.608', 'WEAPON3': '0.900', 'weapon3': '2.414', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '39.000'} [2024-08-06 01:40:44,037][52667] DAMAGECOUNT value on done: 225379.0 [2024-08-06 01:40:44,040][52667] Sum rewards: 67.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.798', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon4': '0.248', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:44,235][52647] DAMAGECOUNT value on done: 237105.0 [2024-08-06 01:40:44,236][52647] Sum rewards: 77.048, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.143', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.119', 'AMMO3': '0.139', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 01:40:44,682][52820] DAMAGECOUNT value on done: 203815.0 [2024-08-06 01:40:44,682][52820] Sum rewards: 43.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.146', 'AMMO3': '0.226', 'AMMO4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.550', 'weapon4': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.582', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '40.000'} [2024-08-06 01:40:45,300][52803] DAMAGECOUNT value on done: 209937.0 [2024-08-06 01:40:45,302][52803] Sum rewards: 62.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.495', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.416', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.130', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:45,762][52811] DAMAGECOUNT value on done: 209038.0 [2024-08-06 01:40:45,762][52811] Sum rewards: 66.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.876', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.202', 'weapon2': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:45,798][52662] DAMAGECOUNT value on done: 230917.0 [2024-08-06 01:40:45,798][52662] Sum rewards: 65.295, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.048', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.145', 'weapon5': '0.260', 'AMMO4': '0.260', 'weapon2': '0.340', 'WEAPON5': '0.500', 'weapon4': '0.666', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon3': '2.442', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '52.000'} [2024-08-06 01:40:46,756][52650] Updated weights for policy 0, policy_version 32221 (0.0013) [2024-08-06 01:40:46,790][52667] DAMAGECOUNT value on done: 227313.0 [2024-08-06 01:40:46,790][52667] Sum rewards: 57.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.545', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.050', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '49.000'} [2024-08-06 01:40:46,978][52668] DAMAGECOUNT value on done: 224938.0 [2024-08-06 01:40:46,980][52668] Sum rewards: 71.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.264', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.142', 'weapon4': '0.160', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '60.000'} [2024-08-06 01:40:47,290][52660] DAMAGECOUNT value on done: 221405.0 [2024-08-06 01:40:47,292][52660] Sum rewards: 54.067, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.500', 'weapon4': '0.696', 'weapon2': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.164', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '44.000'} [2024-08-06 01:40:47,367][52647] DAMAGECOUNT value on done: 237956.0 [2024-08-06 01:40:47,368][52647] Sum rewards: 61.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.425', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.492', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '51.000'} [2024-08-06 01:40:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 263962624. Throughput: 0: 4392.0. Samples: 65991400. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:40:47,794][52567] Avg episode reward: [(0, '61.971')] [2024-08-06 01:40:47,822][52820] DAMAGECOUNT value on done: 206016.0 [2024-08-06 01:40:47,824][52820] Sum rewards: 61.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.465', 'AMMO5': '0.008', 'AMMO2': '0.057', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'AMMO4': '0.286', 'weapon2': '0.358', 'WEAPON4': '0.750', 'weapon4': '1.036', 'WEAPON3': '1.200', 'weapon3': '2.212', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '52.000'} [2024-08-06 01:40:48,001][52662] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:40:48,315][52662] DAMAGECOUNT value on done: 221563.0 [2024-08-06 01:40:48,318][52662] Sum rewards: 69.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.265', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.140', 'AMMO4': '0.179', 'AMMO3': '0.199', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '59.000'} [2024-08-06 01:40:48,344][52803] DAMAGECOUNT value on done: 212786.0 [2024-08-06 01:40:48,367][52803] Sum rewards: 66.837, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.265', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.332', 'weapon2': '0.666', 'WEAPON3': '0.900', 'weapon3': '2.804', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:48,990][52811] DAMAGECOUNT value on done: 211315.0 [2024-08-06 01:40:48,990][52811] Sum rewards: 58.068, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.144', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.878', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '52.000'} [2024-08-06 01:40:49,033][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:40:49,927][52647] DAMAGECOUNT value on done: 236915.0 [2024-08-06 01:40:49,927][52647] Sum rewards: 52.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.132', 'AMMO3': '0.174', 'AMMO4': '0.258', 'WEAPON5': '0.400', 'weapon2': '0.450', 'weapon4': '0.648', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.502', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '46.000'} [2024-08-06 01:40:50,008][52667] DAMAGECOUNT value on done: 221620.0 [2024-08-06 01:40:50,008][52667] Sum rewards: 62.367, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.580', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon5': '0.114', 'AMMO3': '0.260', 'AMMO4': '0.290', 'weapon2': '0.348', 'weapon4': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.758', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 01:40:50,052][52668] DAMAGECOUNT value on done: 223097.0 [2024-08-06 01:40:50,053][52668] Sum rewards: 72.767, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.130', 'HEALTH': '0.190', 'AMMO4': '0.203', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '62.000'} [2024-08-06 01:40:50,465][52660] DAMAGECOUNT value on done: 220210.0 [2024-08-06 01:40:50,467][52660] Sum rewards: 45.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.520', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.344', 'weapon2': '0.364', 'WEAPON3': '1.050', 'HITCOUNT': '2.220', 'weapon3': '2.692', 'DAMAGECOUNT': '11.022', 'FRAGCOUNT': '40.000'} [2024-08-06 01:40:50,957][52820] DAMAGECOUNT value on done: 211044.0 [2024-08-06 01:40:50,958][52820] Sum rewards: 53.330, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.360', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.110', 'AMMO4': '0.199', 'weapon5': '0.248', 'AMMO3': '0.259', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.730', 'weapon3': '2.870', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '49.000'} [2024-08-06 01:40:51,477][52662] DAMAGECOUNT value on done: 227948.0 [2024-08-06 01:40:51,477][52662] Sum rewards: 66.900, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.310', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.296', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.654', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:51,614][52650] Updated weights for policy 0, policy_version 32231 (0.0030) [2024-08-06 01:40:51,624][52803] DAMAGECOUNT value on done: 209500.0 [2024-08-06 01:40:51,625][52803] Sum rewards: 74.833, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.906', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon2': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.296', 'AMMO3': '0.297', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '66.000'} [2024-08-06 01:40:52,126][52811] DAMAGECOUNT value on done: 207247.0 [2024-08-06 01:40:52,126][52811] Sum rewards: 46.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.704', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO4': '0.218', 'AMMO3': '0.228', 'weapon5': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.316', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.580', 'weapon3': '2.792', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '40.000'} [2024-08-06 01:40:52,452][52667] DAMAGECOUNT value on done: 228082.0 [2024-08-06 01:40:52,454][52667] Sum rewards: 63.162, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.800', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.426', 'weapon2': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.750', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '50.000'} [2024-08-06 01:40:52,525][52668] DAMAGECOUNT value on done: 225476.0 [2024-08-06 01:40:52,526][52668] Sum rewards: 60.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.309', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.174', 'weapon2': '0.662', 'WEAPON3': '1.000', 'weapon3': '3.000', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2024-08-06 01:40:52,772][52660] DAMAGECOUNT value on done: 225604.0 [2024-08-06 01:40:52,773][52660] Sum rewards: 64.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 264052736. Throughput: 0: 4390.7. Samples: 66017500. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:40:52,794][52567] Avg episode reward: [(0, '61.863')] [2024-08-06 01:40:52,840][52660] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon5', 0.002)] [2024-08-06 01:40:53,112][52647] DAMAGECOUNT value on done: 240110.0 [2024-08-06 01:40:53,113][52647] Sum rewards: 58.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'weapon4': '0.552', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.532', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '50.000'} [2024-08-06 01:40:53,948][52662] DAMAGECOUNT value on done: 223253.0 [2024-08-06 01:40:53,948][52662] Sum rewards: 68.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.560', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '58.000'} [2024-08-06 01:40:54,318][52820] DAMAGECOUNT value on done: 207274.0 [2024-08-06 01:40:54,318][52820] Sum rewards: 67.480, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.043', 'HEALTH': '0.070', 'weapon5': '0.132', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.214', 'weapon2': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.824', 'WEAPON3': '0.900', 'weapon3': '2.584', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:54,820][52803] DAMAGECOUNT value on done: 207163.0 [2024-08-06 01:40:54,822][52803] Sum rewards: 76.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.100', 'AMMO3': '0.210', 'AMMO4': '0.255', 'weapon4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '63.000'} [2024-08-06 01:40:55,233][52811] DAMAGECOUNT value on done: 213486.0 [2024-08-06 01:40:55,242][52811] Sum rewards: 63.728, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.071', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'HEALTH': '0.302', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:55,420][52647] DAMAGECOUNT value on done: 234606.0 [2024-08-06 01:40:55,421][52647] Sum rewards: 56.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.152', 'AMMO3': '0.182', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '48.000'} [2024-08-06 01:40:55,439][52668] DAMAGECOUNT value on done: 224154.0 [2024-08-06 01:40:55,441][52668] Sum rewards: 56.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.115', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO2': '0.052', 'weapon5': '0.054', 'AMMO3': '0.189', 'weapon2': '0.250', 'AMMO4': '0.261', 'weapon4': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '49.000'} [2024-08-06 01:40:55,440][52667] DAMAGECOUNT value on done: 225733.0 [2024-08-06 01:40:55,441][52667] Sum rewards: 72.837, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'weapon4': '0.214', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '62.000'} [2024-08-06 01:40:55,750][52660] DAMAGECOUNT value on done: 225562.0 [2024-08-06 01:40:55,751][52660] Sum rewards: 66.211, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.825', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'weapon5': '0.178', 'AMMO3': '0.202', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '55.000'} [2024-08-06 01:40:56,024][52650] Updated weights for policy 0, policy_version 32241 (0.0019) [2024-08-06 01:40:56,891][52662] DAMAGECOUNT value on done: 228973.0 [2024-08-06 01:40:56,891][52662] Sum rewards: 63.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.076', 'AMMO4': '0.086', 'AMMO3': '0.264', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:57,634][52820] DAMAGECOUNT value on done: 208443.0 [2024-08-06 01:40:57,635][52820] Sum rewards: 50.136, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon2': '0.262', 'weapon4': '0.268', 'AMMO3': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'HITCOUNT': '3.090', 'weapon3': '3.148', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '47.000'} [2024-08-06 01:40:57,795][52567] Fps is (10 sec: 18021.5, 60 sec: 17612.6, 300 sec: 17550.3). Total num frames: 264142848. Throughput: 0: 4392.8. Samples: 66043670. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:40:57,796][52567] Avg episode reward: [(0, '61.870')] [2024-08-06 01:40:57,847][52803] DAMAGECOUNT value on done: 216786.0 [2024-08-06 01:40:57,849][52803] Sum rewards: 66.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.526', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.206', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '53.000'} [2024-08-06 01:40:57,931][52647] DAMAGECOUNT value on done: 234608.0 [2024-08-06 01:40:57,931][52647] Sum rewards: 60.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.136', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.346', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.304', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '52.000'} [2024-08-06 01:40:58,255][52811] DAMAGECOUNT value on done: 210748.0 [2024-08-06 01:40:58,255][52811] Sum rewards: 58.363, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.752', 'AMMO5': '0.018', 'AMMO2': '0.084', 'weapon5': '0.132', 'AMMO3': '0.228', 'weapon2': '0.352', 'AMMO4': '0.421', 'WEAPON5': '0.500', 'weapon4': '0.644', 'WEAPON4': '0.900', 'WEAPON3': '1.400', 'weapon3': '2.462', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '51.500'} [2024-08-06 01:40:58,342][52668] DAMAGECOUNT value on done: 226906.0 [2024-08-06 01:40:58,342][52668] Sum rewards: 72.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.525', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.190', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '60.000'} [2024-08-06 01:40:58,627][52667] DAMAGECOUNT value on done: 228854.0 [2024-08-06 01:40:58,627][52667] Sum rewards: 63.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO5': '0.011', 'AMMO2': '0.057', 'AMMO3': '0.122', 'weapon5': '0.216', 'AMMO4': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.498', 'weapon4': '0.568', 'WEAPON3': '0.850', 'weapon3': '2.350', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '50.000'} [2024-08-06 01:40:58,671][52660] DAMAGECOUNT value on done: 226119.0 [2024-08-06 01:40:58,671][52660] Sum rewards: 66.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '54.000'} [2024-08-06 01:40:59,717][52662] DAMAGECOUNT value on done: 233307.0 [2024-08-06 01:40:59,718][52662] Sum rewards: 60.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.826', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.204', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '50.000'} [2024-08-06 01:40:59,998][52647] DAMAGECOUNT value on done: 237634.0 [2024-08-06 01:40:59,998][52647] Sum rewards: 65.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.011', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.230', 'weapon4': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:00,838][52820] DAMAGECOUNT value on done: 208778.0 [2024-08-06 01:41:00,839][52820] Sum rewards: 58.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.526', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.028', 'weapon4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.278', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.344', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:00,850][52650] Updated weights for policy 0, policy_version 32251 (0.0037) [2024-08-06 01:41:00,884][52803] DAMAGECOUNT value on done: 208230.0 [2024-08-06 01:41:00,884][52803] Sum rewards: 63.581, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.150', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.228', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:01,007][52668] DAMAGECOUNT value on done: 228229.0 [2024-08-06 01:41:01,007][52668] Sum rewards: 71.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'weapon4': '0.134', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 01:41:01,356][52660] DAMAGECOUNT value on done: 220528.0 [2024-08-06 01:41:01,356][52660] Sum rewards: 58.035, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.075', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.117', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.420', 'WEAPON3': '0.800', 'weapon3': '3.068', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '46.000'} [2024-08-06 01:41:01,384][52811] DAMAGECOUNT value on done: 207266.0 [2024-08-06 01:41:01,384][52811] Sum rewards: 43.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.968', 'AMMO5': '0.003', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.208', 'weapon2': '0.370', 'WEAPON4': '0.450', 'weapon4': '0.762', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '11.469', 'FRAGCOUNT': '40.000'} [2024-08-06 01:41:01,640][52667] DAMAGECOUNT value on done: 221883.0 [2024-08-06 01:41:01,642][52667] Sum rewards: 50.108, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.454', 'weapon4': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '2.760', 'weapon3': '2.854', 'DAMAGECOUNT': '12.135', 'FRAGCOUNT': '41.000'} [2024-08-06 01:41:02,463][52647] DAMAGECOUNT value on done: 233657.0 [2024-08-06 01:41:02,466][52647] Sum rewards: 62.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.016', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.184', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:02,635][52662] DAMAGECOUNT value on done: 226062.0 [2024-08-06 01:41:02,635][52662] Sum rewards: 66.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.804', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.160', 'AMMO4': '0.170', 'weapon5': '0.188', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:02,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 264224768. Throughput: 0: 4392.2. Samples: 66057000. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:02,795][52567] Avg episode reward: [(0, '61.870')] [2024-08-06 01:41:03,037][52669] DAMAGECOUNT value on done: 227278.0 [2024-08-06 01:41:03,038][52669] Sum rewards: 63.246, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.262', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:03,605][52668] DAMAGECOUNT value on done: 220555.0 [2024-08-06 01:41:03,609][52668] Sum rewards: 56.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.780', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:03,952][52803] DAMAGECOUNT value on done: 214135.0 [2024-08-06 01:41:03,952][52803] Sum rewards: 67.203, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.922', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.128', 'weapon2': '0.190', 'AMMO3': '0.297', 'WEAPON3': '1.700', 'weapon3': '3.456', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '60.000'} [2024-08-06 01:41:04,029][52820] DAMAGECOUNT value on done: 210401.0 [2024-08-06 01:41:04,030][52820] Sum rewards: 68.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2024-08-06 01:41:04,090][52660] DAMAGECOUNT value on done: 227408.0 [2024-08-06 01:41:04,092][52660] Sum rewards: 70.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.587', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '60.000'} [2024-08-06 01:41:04,355][52811] DAMAGECOUNT value on done: 208954.0 [2024-08-06 01:41:04,356][52811] Sum rewards: 64.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.563', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.174', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2024-08-06 01:41:04,817][52667] DAMAGECOUNT value on done: 223535.0 [2024-08-06 01:41:04,818][52667] Sum rewards: 64.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.362', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.130', 'AMMO3': '0.178', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON4': '0.450', 'weapon4': '0.608', 'WEAPON3': '0.950', 'weapon3': '2.468', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.000'} [2024-08-06 01:41:05,294][52647] DAMAGECOUNT value on done: 235534.0 [2024-08-06 01:41:05,294][52647] Sum rewards: 60.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.174', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:05,489][52650] Updated weights for policy 0, policy_version 32261 (0.0012) [2024-08-06 01:41:05,629][52794] DAMAGECOUNT value on done: 228172.0 [2024-08-06 01:41:05,631][52794] Sum rewards: 72.022, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon2': '0.308', 'ARMOR': '0.456', 'weapon4': '0.472', 'WEAPON3': '0.950', 'weapon3': '3.008', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:05,803][52662] DAMAGECOUNT value on done: 235325.0 [2024-08-06 01:41:05,805][52662] Sum rewards: 52.639, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO3': '0.166', 'weapon5': '0.256', 'AMMO4': '0.260', 'weapon2': '0.334', 'WEAPON5': '0.400', 'weapon4': '0.696', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.388', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '43.000'} [2024-08-06 01:41:06,063][52669] DAMAGECOUNT value on done: 221015.0 [2024-08-06 01:41:06,071][52669] Sum rewards: 62.044, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.808', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.164', 'weapon2': '0.264', 'AMMO3': '0.274', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.350', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:06,273][52668] DAMAGECOUNT value on done: 215368.0 [2024-08-06 01:41:06,275][52668] Sum rewards: 64.928, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.864', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.094', 'weapon2': '0.220', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.550', 'weapon4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.878', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '60.000'} [2024-08-06 01:41:06,662][52660] DAMAGECOUNT value on done: 228629.0 [2024-08-06 01:41:06,664][52660] Sum rewards: 69.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.028', 'AMMO5': '0.023', 'AMMO2': '0.055', 'AMMO3': '0.155', 'weapon5': '0.272', 'AMMO4': '0.273', 'weapon2': '0.350', 'weapon4': '0.494', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.604', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:07,151][52803] DAMAGECOUNT value on done: 204415.0 [2024-08-06 01:41:07,154][52803] Sum rewards: 59.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.784', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.166', 'AMMO3': '0.169', 'AMMO4': '0.225', 'weapon5': '0.254', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.730', 'weapon3': '2.904', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '47.000'} [2024-08-06 01:41:07,230][52820] DAMAGECOUNT value on done: 207378.0 [2024-08-06 01:41:07,230][52820] Sum rewards: 75.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.480', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '64.000'} [2024-08-06 01:41:07,615][52811] DAMAGECOUNT value on done: 213412.0 [2024-08-06 01:41:07,616][52811] Sum rewards: 46.265, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.617', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.203', 'WEAPON4': '0.500', 'weapon2': '0.504', 'weapon4': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '38.000'} [2024-08-06 01:41:07,666][52667] DAMAGECOUNT value on done: 227175.0 [2024-08-06 01:41:07,667][52667] Sum rewards: 59.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.948', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.234', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '53.000'} [2024-08-06 01:41:07,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 264314880. Throughput: 0: 4389.8. Samples: 66083370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:07,794][52567] Avg episode reward: [(0, '62.039')] [2024-08-06 01:41:08,172][52647] DAMAGECOUNT value on done: 231593.0 [2024-08-06 01:41:08,172][52647] Sum rewards: 57.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.486', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '49.000'} [2024-08-06 01:41:08,727][52794] DAMAGECOUNT value on done: 231197.0 [2024-08-06 01:41:08,729][52794] Sum rewards: 59.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.367', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.164', 'AMMO4': '0.278', 'weapon5': '0.336', 'weapon2': '0.376', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.362', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '47.000'} [2024-08-06 01:41:08,845][52662] DAMAGECOUNT value on done: 225690.0 [2024-08-06 01:41:08,847][52662] Sum rewards: 78.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.147', 'weapon4': '0.186', 'AMMO3': '0.197', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '65.000'} [2024-08-06 01:41:08,891][52669] DAMAGECOUNT value on done: 226715.0 [2024-08-06 01:41:08,892][52669] Sum rewards: 60.099, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.484', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.166', 'weapon5': '0.204', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.608', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:09,399][52668] DAMAGECOUNT value on done: 219709.0 [2024-08-06 01:41:09,402][52668] Sum rewards: 43.123, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.541', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.053', 'weapon5': '0.058', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.263', 'weapon4': '0.440', 'weapon2': '0.546', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.676', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '40.000'} [2024-08-06 01:41:09,922][52660] DAMAGECOUNT value on done: 228149.0 [2024-08-06 01:41:09,924][52660] Sum rewards: 68.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 01:41:10,412][52650] Updated weights for policy 0, policy_version 32271 (0.0013) [2024-08-06 01:41:10,453][52820] DAMAGECOUNT value on done: 207929.0 [2024-08-06 01:41:10,454][52820] Sum rewards: 68.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.276', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.148', 'AMMO3': '0.185', 'weapon2': '0.208', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:10,512][52647] DAMAGECOUNT value on done: 234569.0 [2024-08-06 01:41:10,513][52647] Sum rewards: 68.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO2': '0.004', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO4': '0.018', 'weapon5': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.228', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '59.000'} [2024-08-06 01:41:10,739][52811] DAMAGECOUNT value on done: 209005.0 [2024-08-06 01:41:10,740][52811] Sum rewards: 56.402, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO3': '0.173', 'AMMO4': '0.195', 'weapon2': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.580', 'weapon3': '2.630', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '47.000'} [2024-08-06 01:41:10,960][52667] DAMAGECOUNT value on done: 227418.0 [2024-08-06 01:41:10,962][52667] Sum rewards: 63.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.194', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.214', 'AMMO3': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.160', 'weapon3': '3.212', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '58.000'} [2024-08-06 01:41:11,600][52669] DAMAGECOUNT value on done: 223993.0 [2024-08-06 01:41:11,609][52669] Sum rewards: 67.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.918', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.170', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.420', 'weapon4': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:12,040][52794] DAMAGECOUNT value on done: 225338.0 [2024-08-06 01:41:12,042][52794] Sum rewards: 59.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.700', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.214', 'AMMO4': '0.215', 'weapon2': '0.238', 'weapon5': '0.276', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:12,125][52662] DAMAGECOUNT value on done: 226564.0 [2024-08-06 01:41:12,126][52662] Sum rewards: 49.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.222', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.106', 'weapon5': '0.140', 'AMMO4': '0.178', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.626', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '2.888', 'DAMAGECOUNT': '13.164', 'FRAGCOUNT': '43.000'} [2024-08-06 01:41:12,301][52668] DAMAGECOUNT value on done: 218823.0 [2024-08-06 01:41:12,303][52668] Sum rewards: 63.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.744', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.160', 'AMMO3': '0.167', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.000', 'HITCOUNT': '3.010', 'weapon3': '3.088', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:12,703][52660] DAMAGECOUNT value on done: 222696.0 [2024-08-06 01:41:12,703][52660] Sum rewards: 60.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.608', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.089', 'weapon2': '0.174', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.538', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:12,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 264404992. Throughput: 0: 4385.8. Samples: 66109610. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:12,794][52567] Avg episode reward: [(0, '62.164')] [2024-08-06 01:41:13,485][52647] DAMAGECOUNT value on done: 235076.0 [2024-08-06 01:41:13,489][52647] Sum rewards: 55.163, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.447', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.147', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.554', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '46.000'} [2024-08-06 01:41:13,525][52820] DAMAGECOUNT value on done: 210122.0 [2024-08-06 01:41:13,525][52820] Sum rewards: 68.639, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.170', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.326', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:13,643][52811] DAMAGECOUNT value on done: 213613.0 [2024-08-06 01:41:13,643][52811] Sum rewards: 62.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.624', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:14,177][52667] DAMAGECOUNT value on done: 225083.0 [2024-08-06 01:41:14,179][52667] Sum rewards: 71.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.244', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '62.000'} [2024-08-06 01:41:14,294][52669] DAMAGECOUNT value on done: 224479.0 [2024-08-06 01:41:14,295][52669] Sum rewards: 64.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.656', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.128', 'weapon4': '0.146', 'weapon5': '0.148', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'weapon2': '0.876', 'weapon3': '2.604', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:14,923][52650] Updated weights for policy 0, policy_version 32281 (0.0027) [2024-08-06 01:41:15,085][52668] DAMAGECOUNT value on done: 224255.0 [2024-08-06 01:41:15,087][52668] Sum rewards: 60.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.160', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.113', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:15,331][52794] DAMAGECOUNT value on done: 226528.0 [2024-08-06 01:41:15,332][52794] Sum rewards: 74.070, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.180', 'weapon2': '0.216', 'WEAPON3': '1.100', 'HITCOUNT': '3.380', 'weapon3': '3.424', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 01:41:15,444][52660] DAMAGECOUNT value on done: 230952.0 [2024-08-06 01:41:15,445][52660] Sum rewards: 61.554, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.254', 'weapon2': '0.266', 'WEAPON4': '0.400', 'weapon4': '0.536', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '54.000'} [2024-08-06 01:41:15,460][52662] DAMAGECOUNT value on done: 223543.0 [2024-08-06 01:41:15,460][52662] Sum rewards: 64.446, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.490', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.230', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.558', 'WEAPON3': '1.550', 'weapon3': '2.644', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '58.000'} [2024-08-06 01:41:15,959][52647] DAMAGECOUNT value on done: 238261.0 [2024-08-06 01:41:15,959][52647] Sum rewards: 67.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:16,508][52820] DAMAGECOUNT value on done: 209403.0 [2024-08-06 01:41:16,511][52820] Sum rewards: 67.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.862', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.090', 'weapon4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'weapon2': '0.418', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '59.000'} [2024-08-06 01:41:17,132][52667] DAMAGECOUNT value on done: 227154.0 [2024-08-06 01:41:17,142][52667] Sum rewards: 62.567, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.790', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.078', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon4': '0.482', 'WEAPON4': '0.550', 'weapon2': '0.612', 'WEAPON3': '1.500', 'weapon3': '2.586', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '54.500'} [2024-08-06 01:41:17,267][52669] DAMAGECOUNT value on done: 223606.0 [2024-08-06 01:41:17,267][52669] Sum rewards: 65.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.142', 'AMMO3': '0.214', 'AMMO4': '0.264', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:17,782][52668] DAMAGECOUNT value on done: 219860.0 [2024-08-06 01:41:17,784][52668] Sum rewards: 72.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.222', 'weapon4': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '58.000'} [2024-08-06 01:41:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 264495104. Throughput: 0: 4391.3. Samples: 66122870. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:17,794][52567] Avg episode reward: [(0, '62.329')] [2024-08-06 01:41:18,001][52794] DAMAGECOUNT value on done: 225008.0 [2024-08-06 01:41:18,005][52794] Sum rewards: 67.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.003', 'weapon5': '0.048', 'AMMO2': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'AMMO4': '0.255', 'weapon4': '0.402', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:18,208][52660] DAMAGECOUNT value on done: 216217.0 [2024-08-06 01:41:18,210][52660] Sum rewards: 58.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.142', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.338', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '2.992', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '49.000'} [2024-08-06 01:41:18,266][52662] DAMAGECOUNT value on done: 233432.0 [2024-08-06 01:41:18,266][52662] Sum rewards: 73.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '64.000'} [2024-08-06 01:41:18,394][52647] DAMAGECOUNT value on done: 232504.0 [2024-08-06 01:41:18,394][52647] Sum rewards: 62.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.142', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.182', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:19,518][52820] DAMAGECOUNT value on done: 203446.0 [2024-08-06 01:41:19,519][52820] Sum rewards: 58.227, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.238', 'AMMO5': '0.008', 'AMMO2': '0.058', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.292', 'ARMOR': '0.400', 'weapon2': '0.436', 'WEAPON4': '0.500', 'weapon4': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.598', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:19,584][52650] Updated weights for policy 0, policy_version 32291 (0.0020) [2024-08-06 01:41:19,936][52667] DAMAGECOUNT value on done: 220817.0 [2024-08-06 01:41:19,937][52667] Sum rewards: 62.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.086', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.131', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.000', 'weapon3': '2.998', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:20,324][52669] DAMAGECOUNT value on done: 226297.0 [2024-08-06 01:41:20,325][52669] Sum rewards: 63.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.358', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '51.500'} [2024-08-06 01:41:20,554][52668] DAMAGECOUNT value on done: 227382.0 [2024-08-06 01:41:20,556][52668] Sum rewards: 56.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.336', 'AMMO5': '0.012', 'AMMO2': '0.061', 'AMMO3': '0.230', 'weapon2': '0.240', 'weapon5': '0.244', 'AMMO4': '0.304', 'WEAPON5': '0.400', 'weapon4': '0.588', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.514', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '49.000'} [2024-08-06 01:41:20,681][52794] DAMAGECOUNT value on done: 227048.0 [2024-08-06 01:41:20,682][52794] Sum rewards: 74.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.767', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '65.000'} [2024-08-06 01:41:20,796][52660] DAMAGECOUNT value on done: 222255.0 [2024-08-06 01:41:20,798][52660] Sum rewards: 56.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '49.000'} [2024-08-06 01:41:20,836][52662] DAMAGECOUNT value on done: 228681.0 [2024-08-06 01:41:20,836][52662] Sum rewards: 57.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.176', 'AMMO3': '0.185', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.840', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '47.500'} [2024-08-06 01:41:21,532][52647] DAMAGECOUNT value on done: 232223.0 [2024-08-06 01:41:21,535][52647] Sum rewards: 74.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.930', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'weapon4': '0.076', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 01:41:22,669][52820] DAMAGECOUNT value on done: 213566.0 [2024-08-06 01:41:22,669][52820] Sum rewards: 68.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.278', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:22,769][52667] DAMAGECOUNT value on done: 229932.0 [2024-08-06 01:41:22,771][52667] Sum rewards: 69.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.170', 'weapon4': '0.202', 'AMMO3': '0.205', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '59.000'} [2024-08-06 01:41:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 264585216. Throughput: 0: 4389.6. Samples: 66149240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:22,794][52567] Avg episode reward: [(0, '63.034')] [2024-08-06 01:41:23,440][52669] DAMAGECOUNT value on done: 225321.0 [2024-08-06 01:41:23,441][52669] Sum rewards: 66.413, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.116', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.112', 'AMMO3': '0.209', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:23,496][52668] DAMAGECOUNT value on done: 226744.0 [2024-08-06 01:41:23,496][52668] Sum rewards: 61.681, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.194', 'weapon4': '0.228', 'WEAPON4': '0.250', 'HEALTH': '0.259', 'weapon2': '0.384', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.194', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:23,712][52794] DAMAGECOUNT value on done: 231584.0 [2024-08-06 01:41:23,713][52794] Sum rewards: 77.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.268', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '63.000'} [2024-08-06 01:41:23,826][52662] DAMAGECOUNT value on done: 234513.0 [2024-08-06 01:41:23,828][52662] Sum rewards: 61.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.188', 'AMMO4': '0.204', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.368', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:23,899][52660] DAMAGECOUNT value on done: 228889.0 [2024-08-06 01:41:23,899][52660] Sum rewards: 61.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.880', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.302', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:24,206][52650] Updated weights for policy 0, policy_version 32301 (0.0012) [2024-08-06 01:41:24,561][52647] DAMAGECOUNT value on done: 234503.0 [2024-08-06 01:41:24,561][52647] Sum rewards: 69.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.138', 'AMMO3': '0.171', 'AMMO4': '0.227', 'weapon2': '0.318', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.906', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:25,639][52667] DAMAGECOUNT value on done: 234756.0 [2024-08-06 01:41:25,640][52667] Sum rewards: 63.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.452', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.110', 'weapon5': '0.136', 'AMMO3': '0.210', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:25,748][52820] DAMAGECOUNT value on done: 216801.0 [2024-08-06 01:41:25,748][52820] Sum rewards: 62.090, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.676', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.271', 'weapon2': '0.372', 'weapon4': '0.396', 'WEAPON3': '1.650', 'weapon3': '2.804', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:26,033][52794] DAMAGECOUNT value on done: 226387.0 [2024-08-06 01:41:26,035][52794] Sum rewards: 51.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.169', 'weapon5': '0.184', 'AMMO4': '0.193', 'weapon2': '0.326', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon4': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.516', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '43.000'} [2024-08-06 01:41:26,151][52662] DAMAGECOUNT value on done: 224734.0 [2024-08-06 01:41:26,153][52662] Sum rewards: 68.071, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.968', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.296', 'weapon2': '0.378', 'WEAPON3': '1.750', 'weapon3': '3.348', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '61.000'} [2024-08-06 01:41:26,384][52669] DAMAGECOUNT value on done: 225338.0 [2024-08-06 01:41:26,385][52669] Sum rewards: 65.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.761', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.174', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.262', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '53.000'} [2024-08-06 01:41:26,726][52668] DAMAGECOUNT value on done: 224809.0 [2024-08-06 01:41:26,729][52668] Sum rewards: 68.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.428', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon5': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.662', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:27,160][52660] DAMAGECOUNT value on done: 234403.0 [2024-08-06 01:41:27,161][52660] Sum rewards: 59.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.544', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.154', 'AMMO4': '0.154', 'weapon4': '0.214', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:27,345][52647] DAMAGECOUNT value on done: 228834.0 [2024-08-06 01:41:27,348][52647] Sum rewards: 49.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.555', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.136', 'AMMO3': '0.183', 'AMMO4': '0.205', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.506', 'weapon4': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.450', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '43.000'} [2024-08-06 01:41:27,785][52658] DAMAGECOUNT value on done: 228313.0 [2024-08-06 01:41:27,786][52658] Sum rewards: 62.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.063', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.484', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.096', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17480.3, 300 sec: 17550.3). Total num frames: 264667136. Throughput: 0: 4386.4. Samples: 66175570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:27,794][52567] Avg episode reward: [(0, '63.428')] [2024-08-06 01:41:28,352][52667] DAMAGECOUNT value on done: 228445.0 [2024-08-06 01:41:28,353][52667] Sum rewards: 73.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.891', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.292', 'WEAPON3': '1.300', 'weapon3': '3.440', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.000'} [2024-08-06 01:41:28,907][52820] DAMAGECOUNT value on done: 205737.0 [2024-08-06 01:41:28,919][52820] Sum rewards: 63.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.184', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.275', 'weapon2': '0.520', 'WEAPON3': '1.750', 'weapon3': '3.122', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:28,980][52650] Updated weights for policy 0, policy_version 32311 (0.0017) [2024-08-06 01:41:29,036][52794] DAMAGECOUNT value on done: 233141.0 [2024-08-06 01:41:29,037][52794] Sum rewards: 71.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.905', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.066', 'weapon4': '0.090', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '61.000'} [2024-08-06 01:41:29,106][52669] DAMAGECOUNT value on done: 220612.0 [2024-08-06 01:41:29,107][52669] Sum rewards: 58.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.769', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.180', 'AMMO3': '0.217', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:29,127][52662] DAMAGECOUNT value on done: 229131.0 [2024-08-06 01:41:29,129][52662] Sum rewards: 67.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.574', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.358', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:29,711][52668] Large shaping reward 2.524 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0)] [2024-08-06 01:41:29,802][52664] DAMAGECOUNT value on done: 230552.0 [2024-08-06 01:41:29,802][52664] Sum rewards: 50.200, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.252', 'WEAPON3': '0.800', 'weapon2': '1.220', 'weapon3': '2.362', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '12.084', 'FRAGCOUNT': '40.000'} [2024-08-06 01:41:30,037][52660] DAMAGECOUNT value on done: 220103.0 [2024-08-06 01:41:30,039][52660] Sum rewards: 60.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.547', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.104', 'AMMO3': '0.198', 'AMMO4': '0.239', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.624', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:30,399][52647] DAMAGECOUNT value on done: 237489.0 [2024-08-06 01:41:30,402][52647] Sum rewards: 67.873, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.099', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.420', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:30,861][52658] DAMAGECOUNT value on done: 228224.0 [2024-08-06 01:41:30,862][52658] Sum rewards: 78.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.225', 'weapon2': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.608', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '65.000'} [2024-08-06 01:41:31,502][52667] DAMAGECOUNT value on done: 230879.0 [2024-08-06 01:41:31,502][52667] Sum rewards: 66.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.208', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.598', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:32,022][52794] DAMAGECOUNT value on done: 230691.0 [2024-08-06 01:41:32,022][52794] Sum rewards: 75.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.350', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.132', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.450', 'weapon4': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 01:41:32,138][52662] DAMAGECOUNT value on done: 226086.0 [2024-08-06 01:41:32,140][52662] Sum rewards: 64.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.784', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon4': '0.130', 'weapon5': '0.240', 'AMMO3': '0.251', 'AMMO4': '0.331', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.500', 'weapon3': '2.766', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:32,284][52669] DAMAGECOUNT value on done: 226890.0 [2024-08-06 01:41:32,286][52669] Sum rewards: 73.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.592', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO3': '0.189', 'weapon2': '0.190', 'AMMO4': '0.192', 'weapon4': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '63.000'} [2024-08-06 01:41:32,560][52660] DAMAGECOUNT value on done: 226707.0 [2024-08-06 01:41:32,561][52660] Sum rewards: 71.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.810', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.123', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.532', 'WEAPON3': '0.900', 'weapon3': '2.798', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '59.000'} [2024-08-06 01:41:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17605.9). Total num frames: 264757248. Throughput: 0: 4387.1. Samples: 66188820. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 01:41:32,795][52567] Avg episode reward: [(0, '63.842')] [2024-08-06 01:41:32,828][52664] DAMAGECOUNT value on done: 232144.0 [2024-08-06 01:41:32,830][52664] Sum rewards: 55.090, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.228', 'AMMO5': '0.005', 'ARMOR': '0.012', 'weapon5': '0.048', 'AMMO2': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.186', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.836', 'WEAPON3': '1.050', 'weapon3': '2.732', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '45.000'} [2024-08-06 01:41:33,783][52650] Updated weights for policy 0, policy_version 32321 (0.0023) [2024-08-06 01:41:33,823][52658] DAMAGECOUNT value on done: 228812.0 [2024-08-06 01:41:33,825][52658] Sum rewards: 73.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.078', 'AMMO4': '0.083', 'weapon5': '0.124', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '59.000'} [2024-08-06 01:41:34,441][52667] DAMAGECOUNT value on done: 220599.0 [2024-08-06 01:41:34,454][52667] Sum rewards: 57.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.298', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.026', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.215', 'weapon2': '0.466', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.162', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '49.500'} [2024-08-06 01:41:34,873][52794] DAMAGECOUNT value on done: 228263.0 [2024-08-06 01:41:34,874][52794] Sum rewards: 73.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.162', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO3': '0.183', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '59.000'} [2024-08-06 01:41:34,910][52669] DAMAGECOUNT value on done: 228355.0 [2024-08-06 01:41:34,911][52669] Sum rewards: 67.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.392', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.116', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon4': '0.800', 'weapon3': '2.248', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '54.000'} [2024-08-06 01:41:34,979][52662] DAMAGECOUNT value on done: 223563.0 [2024-08-06 01:41:34,982][52662] Sum rewards: 55.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.975', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO4': '0.192', 'weapon5': '0.196', 'AMMO3': '0.209', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.160', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '48.000'} [2024-08-06 01:41:35,586][52660] DAMAGECOUNT value on done: 216407.0 [2024-08-06 01:41:35,587][52660] Sum rewards: 65.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.926', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.146', 'AMMO3': '0.199', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:35,768][52664] DAMAGECOUNT value on done: 234119.0 [2024-08-06 01:41:35,769][52664] Sum rewards: 62.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.548', 'AMMO5': '0.014', 'AMMO2': '0.052', 'AMMO3': '0.136', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.636', 'weapon2': '0.696', 'WEAPON3': '0.800', 'weapon3': '2.220', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:36,803][52658] DAMAGECOUNT value on done: 227029.0 [2024-08-06 01:41:36,804][52658] Sum rewards: 62.922, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.961', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.094', 'weapon4': '0.132', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '53.000'} [2024-08-06 01:41:37,170][52667] DAMAGECOUNT value on done: 229427.0 [2024-08-06 01:41:37,171][52667] Sum rewards: 68.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.934', 'AMMO2': '0.008', 'AMMO5': '0.008', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.512', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:37,417][52794] DAMAGECOUNT value on done: 226047.0 [2024-08-06 01:41:37,418][52794] Sum rewards: 65.539, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.914', 'AMMO5': '0.005', 'weapon5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '54.000'} [2024-08-06 01:41:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 264847360. Throughput: 0: 4390.2. Samples: 66215060. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 01:41:37,802][52567] Avg episode reward: [(0, '64.252')] [2024-08-06 01:41:37,847][52669] DAMAGECOUNT value on done: 222299.0 [2024-08-06 01:41:37,848][52669] Sum rewards: 51.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.858', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.316', 'weapon4': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '41.000'} [2024-08-06 01:41:37,914][52650] Updated weights for policy 0, policy_version 32331 (0.0020) [2024-08-06 01:41:38,182][52664] DAMAGECOUNT value on done: 231292.0 [2024-08-06 01:41:38,184][52664] Sum rewards: 68.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.172', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.234', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '56.000'} [2024-08-06 01:41:38,845][52660] DAMAGECOUNT value on done: 225652.0 [2024-08-06 01:41:38,845][52660] Sum rewards: 53.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.230', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.584', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '45.000'} [2024-08-06 01:41:39,185][52658] DAMAGECOUNT value on done: 228117.0 [2024-08-06 01:41:39,186][52658] Sum rewards: 68.958, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.241', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.260', 'weapon2': '0.278', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.094', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 01:41:40,198][52794] DAMAGECOUNT value on done: 224213.0 [2024-08-06 01:41:40,199][52794] Sum rewards: 55.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.192', 'AMMO3': '0.231', 'AMMO4': '0.236', 'WEAPON5': '0.350', 'weapon2': '0.420', 'weapon4': '0.438', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.676', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '47.000'} [2024-08-06 01:41:40,943][52669] DAMAGECOUNT value on done: 227883.0 [2024-08-06 01:41:40,944][52669] Sum rewards: 58.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.447', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.214', 'weapon2': '0.558', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.098', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '49.000'} [2024-08-06 01:41:41,000][52664] DAMAGECOUNT value on done: 233784.0 [2024-08-06 01:41:41,000][52664] Sum rewards: 73.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.280', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.172', 'AMMO3': '0.195', 'weapon2': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '61.000'} [2024-08-06 01:41:41,470][52660] DAMAGECOUNT value on done: 222988.0 [2024-08-06 01:41:41,470][52660] Sum rewards: 51.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.144', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.156', 'AMMO4': '0.164', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.804', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '46.000'} [2024-08-06 01:41:42,340][52658] DAMAGECOUNT value on done: 224293.0 [2024-08-06 01:41:42,344][52658] Sum rewards: 53.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.127', 'AMMO3': '0.215', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.740', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '46.000'} [2024-08-06 01:41:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 264929280. Throughput: 0: 4398.3. Samples: 66241590. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 01:41:42,794][52567] Avg episode reward: [(0, '63.696')] [2024-08-06 01:41:42,963][52650] Updated weights for policy 0, policy_version 32341 (0.0031) [2024-08-06 01:41:43,183][52794] DAMAGECOUNT value on done: 236479.0 [2024-08-06 01:41:43,184][52794] Sum rewards: 62.713, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.261', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'weapon5': '0.152', 'WEAPON7': '0.200', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.502', 'WEAPON3': '0.900', 'weapon3': '2.684', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:43,697][52664] DAMAGECOUNT value on done: 235487.0 [2024-08-06 01:41:43,698][52664] Sum rewards: 55.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon2': '0.180', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.182', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '49.000'} [2024-08-06 01:41:43,805][52669] DAMAGECOUNT value on done: 229347.0 [2024-08-06 01:41:43,808][52669] Sum rewards: 59.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.137', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.175', 'weapon5': '0.184', 'AMMO4': '0.245', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.882', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:44,252][52666] DAMAGECOUNT value on done: 229399.0 [2024-08-06 01:41:44,252][52666] Sum rewards: 46.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.530', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '40.500'} [2024-08-06 01:41:44,938][52647] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0)] [2024-08-06 01:41:45,441][52658] DAMAGECOUNT value on done: 232879.0 [2024-08-06 01:41:45,443][52658] Sum rewards: 60.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.378', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.200', 'AMMO4': '0.212', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon4': '0.794', 'WEAPON3': '1.200', 'weapon3': '2.490', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '54.000'} [2024-08-06 01:41:45,872][52794] DAMAGECOUNT value on done: 223173.0 [2024-08-06 01:41:45,872][52794] Sum rewards: 60.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.681', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'weapon4': '0.522', 'weapon2': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.644', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '48.000'} [2024-08-06 01:41:46,565][52669] DAMAGECOUNT value on done: 238807.0 [2024-08-06 01:41:46,566][52669] Sum rewards: 64.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.893', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.168', 'AMMO4': '0.192', 'weapon5': '0.194', 'AMMO3': '0.203', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.124', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '54.500'} [2024-08-06 01:41:46,730][52664] DAMAGECOUNT value on done: 238702.0 [2024-08-06 01:41:46,733][52664] Sum rewards: 56.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.128', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.504', 'WEAPON3': '0.900', 'HITCOUNT': '2.700', 'weapon3': '2.972', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '47.000'} [2024-08-06 01:41:47,399][52666] DAMAGECOUNT value on done: 229970.0 [2024-08-06 01:41:47,403][52666] Sum rewards: 57.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.128', 'weapon4': '0.146', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.882', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '50.500'} [2024-08-06 01:41:47,431][52650] Updated weights for policy 0, policy_version 32351 (0.0022) [2024-08-06 01:41:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 265019392. Throughput: 0: 4394.5. Samples: 66254750. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 01:41:47,794][52567] Avg episode reward: [(0, '63.461')] [2024-08-06 01:41:48,128][52658] DAMAGECOUNT value on done: 220474.0 [2024-08-06 01:41:48,130][52658] Sum rewards: 53.667, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.120', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon5': '0.042', 'AMMO2': '0.046', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.382', 'weapon4': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.896', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:49,048][52794] DAMAGECOUNT value on done: 234439.0 [2024-08-06 01:41:49,049][52794] Sum rewards: 51.178, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'weapon2': '0.240', 'weapon5': '0.242', 'WEAPON4': '0.250', 'HEALTH': '0.377', 'weapon4': '0.388', 'WEAPON3': '0.850', 'HITCOUNT': '2.660', 'weapon3': '2.894', 'DAMAGECOUNT': '12.519', 'FRAGCOUNT': '40.000'} [2024-08-06 01:41:49,385][52669] DAMAGECOUNT value on done: 224143.0 [2024-08-06 01:41:49,386][52669] Sum rewards: 71.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.938', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.132', 'AMMO4': '0.253', 'AMMO3': '0.263', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.718', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '61.000'} [2024-08-06 01:41:49,477][52664] DAMAGECOUNT value on done: 228595.0 [2024-08-06 01:41:49,478][52664] Sum rewards: 70.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.425', 'AMMO5': '0.003', 'weapon5': '0.022', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.352', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '58.000'} [2024-08-06 01:41:50,316][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:41:50,449][52666] DAMAGECOUNT value on done: 228619.0 [2024-08-06 01:41:50,450][52666] Sum rewards: 58.737, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.120', 'AMMO4': '0.218', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.702', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '53.000'} [2024-08-06 01:41:50,783][52658] DAMAGECOUNT value on done: 230130.0 [2024-08-06 01:41:50,784][52658] Sum rewards: 64.041, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.640', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.196', 'weapon2': '0.216', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.264', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '56.500'} [2024-08-06 01:41:51,428][52794] DAMAGECOUNT value on done: 229129.0 [2024-08-06 01:41:51,429][52794] Sum rewards: 63.337, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.180', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.566', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.552', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '54.000'} [2024-08-06 01:41:52,147][52664] DAMAGECOUNT value on done: 241267.0 [2024-08-06 01:41:52,147][52664] Sum rewards: 62.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.482', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.104', 'weapon2': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.798', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:52,183][52650] Updated weights for policy 0, policy_version 32361 (0.0010) [2024-08-06 01:41:52,302][52669] DAMAGECOUNT value on done: 231352.0 [2024-08-06 01:41:52,304][52669] Sum rewards: 72.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.608', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 01:41:52,598][52647] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:41:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 265109504. Throughput: 0: 4398.0. Samples: 66281280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:52,794][52567] Avg episode reward: [(0, '63.476')] [2024-08-06 01:41:52,824][52671] DAMAGECOUNT value on done: 231372.0 [2024-08-06 01:41:52,824][52671] Sum rewards: 59.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'weapon4': '0.188', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.242', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '51.000'} [2024-08-06 01:41:53,191][52666] DAMAGECOUNT value on done: 224614.0 [2024-08-06 01:41:53,191][52666] Sum rewards: 61.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.915', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon4': '0.436', 'WEAPON4': '0.450', 'weapon2': '0.716', 'WEAPON3': '1.200', 'weapon3': '2.620', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '52.000'} [2024-08-06 01:41:53,538][52658] DAMAGECOUNT value on done: 229072.0 [2024-08-06 01:41:53,539][52658] Sum rewards: 61.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.126', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '53.000'} [2024-08-06 01:41:54,428][52794] DAMAGECOUNT value on done: 229411.0 [2024-08-06 01:41:54,430][52794] Sum rewards: 65.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.648', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.074', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.144', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '53.000'} [2024-08-06 01:41:54,672][52664] DAMAGECOUNT value on done: 235744.0 [2024-08-06 01:41:54,672][52664] Sum rewards: 56.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.966', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.076', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.208', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'weapon4': '0.638', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '48.000'} [2024-08-06 01:41:55,341][52669] DAMAGECOUNT value on done: 231233.0 [2024-08-06 01:41:55,342][52669] Sum rewards: 56.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.332', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.050', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '49.000'} [2024-08-06 01:41:55,360][52670] DAMAGECOUNT value on done: 222530.0 [2024-08-06 01:41:55,361][52670] Sum rewards: 62.021, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.665', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.298', 'weapon4': '0.416', 'weapon2': '0.654', 'WEAPON3': '0.850', 'weapon3': '2.360', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '47.500'} [2024-08-06 01:41:55,766][52671] DAMAGECOUNT value on done: 225139.0 [2024-08-06 01:41:55,769][52671] Sum rewards: 54.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'AMMO4': '0.233', 'weapon2': '0.420', 'WEAPON4': '0.500', 'weapon4': '0.692', 'WEAPON3': '1.250', 'weapon3': '2.554', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '46.000'} [2024-08-06 01:41:55,980][52658] DAMAGECOUNT value on done: 232478.0 [2024-08-06 01:41:55,980][52658] Sum rewards: 67.156, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'HEALTH': '0.084', 'AMMO3': '0.202', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:56,302][52666] DAMAGECOUNT value on done: 220761.0 [2024-08-06 01:41:56,302][52666] Sum rewards: 54.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.356', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.066', 'AMMO4': '0.134', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.456', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.122', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '46.000'} [2024-08-06 01:41:56,601][52650] Updated weights for policy 0, policy_version 32371 (0.0018) [2024-08-06 01:41:57,057][52794] DAMAGECOUNT value on done: 238092.0 [2024-08-06 01:41:57,058][52794] Sum rewards: 76.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.555', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.205', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '63.000'} [2024-08-06 01:41:57,458][52664] DAMAGECOUNT value on done: 237385.0 [2024-08-06 01:41:57,460][52664] Sum rewards: 53.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.162', 'weapon4': '0.194', 'AMMO3': '0.197', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.844', 'WEAPON3': '1.200', 'weapon3': '2.560', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '44.500'} [2024-08-06 01:41:57,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 265191424. Throughput: 0: 4402.0. Samples: 66307700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:41:57,795][52567] Avg episode reward: [(0, '63.194')] [2024-08-06 01:41:58,090][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:41:58,324][52669] DAMAGECOUNT value on done: 233210.0 [2024-08-06 01:41:58,324][52669] Sum rewards: 68.138, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.163', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.332', 'HEALTH': '0.489', 'WEAPON3': '0.900', 'HITCOUNT': '3.010', 'weapon3': '3.178', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '55.000'} [2024-08-06 01:41:58,371][52670] DAMAGECOUNT value on done: 227761.0 [2024-08-06 01:41:58,371][52670] Sum rewards: 78.643, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.410', 'AMMO5': '0.015', 'AMMO2': '0.067', 'AMMO3': '0.246', 'weapon5': '0.262', 'weapon2': '0.270', 'AMMO4': '0.336', 'WEAPON5': '0.400', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '66.000'} [2024-08-06 01:41:58,837][52671] DAMAGECOUNT value on done: 228866.0 [2024-08-06 01:41:58,839][52671] Sum rewards: 70.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO2': '0.000', 'AMMO4': '0.000', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.268', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:58,857][52658] DAMAGECOUNT value on done: 219784.0 [2024-08-06 01:41:58,858][52658] Sum rewards: 57.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.074', 'weapon5': '0.086', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.084', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '50.000'} [2024-08-06 01:41:59,358][52666] DAMAGECOUNT value on done: 217232.0 [2024-08-06 01:41:59,358][52666] Sum rewards: 56.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.312', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '47.000'} [2024-08-06 01:41:59,903][52794] DAMAGECOUNT value on done: 228292.0 [2024-08-06 01:41:59,903][52794] Sum rewards: 66.351, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.066', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.050', 'weapon4': '0.120', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '57.000'} [2024-08-06 01:41:59,957][52664] DAMAGECOUNT value on done: 233561.0 [2024-08-06 01:41:59,957][52664] Sum rewards: 66.929, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.050', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.063', 'AMMO3': '0.184', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '55.000'} [2024-08-06 01:42:01,231][52670] DAMAGECOUNT value on done: 221254.0 [2024-08-06 01:42:01,231][52670] Sum rewards: 63.888, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.101', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.228', 'WEAPON3': '0.850', 'weapon2': '0.864', 'weapon3': '2.734', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '50.000'} [2024-08-06 01:42:01,409][52658] DAMAGECOUNT value on done: 225136.0 [2024-08-06 01:42:01,410][52658] Sum rewards: 65.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.875', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.054', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.428', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:01,592][52820] Large shaping reward 2.649 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0)] [2024-08-06 01:42:01,656][52650] Updated weights for policy 0, policy_version 32381 (0.0014) [2024-08-06 01:42:01,665][52671] DAMAGECOUNT value on done: 225251.0 [2024-08-06 01:42:01,666][52671] Sum rewards: 77.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.017', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '66.000'} [2024-08-06 01:42:02,018][52614] Signal inference workers to stop experience collection... (5850 times) [2024-08-06 01:42:02,018][52614] Signal inference workers to resume experience collection... (5850 times) [2024-08-06 01:42:02,100][52650] InferenceWorker_p0-w0: stopping experience collection (5850 times) [2024-08-06 01:42:02,100][52650] InferenceWorker_p0-w0: resuming experience collection (5850 times) [2024-08-06 01:42:02,257][52666] DAMAGECOUNT value on done: 226509.0 [2024-08-06 01:42:02,257][52666] Sum rewards: 64.339, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.383', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO3': '0.151', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.636', 'weapon2': '0.678', 'WEAPON3': '0.950', 'weapon3': '2.182', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:02,598][52664] DAMAGECOUNT value on done: 234014.0 [2024-08-06 01:42:02,603][52664] Sum rewards: 71.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.912', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.182', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.282', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '59.000'} [2024-08-06 01:42:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 265289728. Throughput: 0: 4398.2. Samples: 66320790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:42:02,802][52567] Avg episode reward: [(0, '63.447')] [2024-08-06 01:42:03,962][52670] DAMAGECOUNT value on done: 221948.0 [2024-08-06 01:42:03,966][52670] Sum rewards: 63.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.304', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO2': '0.057', 'AMMO3': '0.249', 'AMMO4': '0.287', 'weapon2': '0.298', 'WEAPON4': '0.400', 'weapon4': '0.718', 'WEAPON3': '1.400', 'weapon3': '2.742', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '54.000'} [2024-08-06 01:42:04,128][52671] DAMAGECOUNT value on done: 230978.0 [2024-08-06 01:42:04,129][52671] Sum rewards: 76.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.343', 'AMMO5': '0.008', 'AMMO2': '0.073', 'weapon5': '0.132', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.306', 'AMMO4': '0.366', 'weapon4': '0.522', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '64.000'} [2024-08-06 01:42:04,461][52658] DAMAGECOUNT value on done: 225984.0 [2024-08-06 01:42:04,462][52658] Sum rewards: 54.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.208', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.158', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '47.000'} [2024-08-06 01:42:04,921][52666] DAMAGECOUNT value on done: 224538.0 [2024-08-06 01:42:04,922][52666] Sum rewards: 60.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.184', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '54.000'} [2024-08-06 01:42:05,803][52664] DAMAGECOUNT value on done: 233298.0 [2024-08-06 01:42:05,803][52664] Sum rewards: 60.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.302', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.434', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '52.000'} [2024-08-06 01:42:05,869][52650] Updated weights for policy 0, policy_version 32391 (0.0012) [2024-08-06 01:42:06,589][52670] DAMAGECOUNT value on done: 225418.0 [2024-08-06 01:42:06,591][52670] Sum rewards: 55.085, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.824', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.410', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '49.000'} [2024-08-06 01:42:06,852][52671] DAMAGECOUNT value on done: 227600.0 [2024-08-06 01:42:06,852][52671] Sum rewards: 67.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon4': '0.238', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:06,996][52667] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 01:42:07,282][52666] DAMAGECOUNT value on done: 224041.0 [2024-08-06 01:42:07,282][52666] Sum rewards: 60.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.664', 'AMMO5': '0.005', 'AMMO2': '0.062', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'AMMO4': '0.312', 'weapon2': '0.348', 'WEAPON4': '0.600', 'weapon4': '0.642', 'WEAPON3': '1.450', 'weapon3': '2.626', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:07,553][52658] DAMAGECOUNT value on done: 220956.0 [2024-08-06 01:42:07,554][52658] Sum rewards: 57.553, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.498', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.306', 'weapon2': '0.820', 'WEAPON3': '0.850', 'weapon3': '2.678', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.728', 'FRAGCOUNT': '46.000'} [2024-08-06 01:42:07,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 265371648. Throughput: 0: 4397.8. Samples: 66347140. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:42:07,794][52567] Avg episode reward: [(0, '63.162')] [2024-08-06 01:42:08,683][52664] DAMAGECOUNT value on done: 236976.0 [2024-08-06 01:42:08,684][52664] Sum rewards: 64.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.044', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.218', 'AMMO3': '0.243', 'weapon2': '0.246', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:09,281][52670] DAMAGECOUNT value on done: 225595.0 [2024-08-06 01:42:09,282][52670] Sum rewards: 58.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.108', 'AMMO3': '0.217', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'weapon2': '0.460', 'weapon4': '0.480', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '52.000'} [2024-08-06 01:42:09,679][52671] DAMAGECOUNT value on done: 228620.0 [2024-08-06 01:42:09,680][52671] Sum rewards: 65.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.195', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '55.000'} [2024-08-06 01:42:10,312][52666] DAMAGECOUNT value on done: 224240.0 [2024-08-06 01:42:10,313][52666] Sum rewards: 65.765, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.495', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO3': '0.256', 'weapon2': '0.626', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '58.000'} [2024-08-06 01:42:10,491][52658] DAMAGECOUNT value on done: 226653.0 [2024-08-06 01:42:10,492][52658] Sum rewards: 77.711, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.168', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '62.000'} [2024-08-06 01:42:10,780][52650] Updated weights for policy 0, policy_version 32401 (0.0012) [2024-08-06 01:42:11,132][52665] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:42:11,642][52664] DAMAGECOUNT value on done: 231846.0 [2024-08-06 01:42:11,643][52664] Sum rewards: 58.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.476', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.664', 'WEAPON3': '1.500', 'weapon3': '2.736', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '50.000'} [2024-08-06 01:42:12,185][52670] DAMAGECOUNT value on done: 219748.0 [2024-08-06 01:42:12,187][52670] Sum rewards: 57.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.772', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.452', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '48.000'} [2024-08-06 01:42:12,740][52671] DAMAGECOUNT value on done: 230564.0 [2024-08-06 01:42:12,741][52671] Sum rewards: 67.606, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.108', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'weapon4': '0.320', 'HEALTH': '0.598', 'WEAPON3': '0.750', 'weapon2': '0.784', 'weapon3': '2.606', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '53.000'} [2024-08-06 01:42:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 265461760. Throughput: 0: 4399.8. Samples: 66373560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:42:12,802][52567] Avg episode reward: [(0, '63.070')] [2024-08-06 01:42:13,008][52666] DAMAGECOUNT value on done: 222177.0 [2024-08-06 01:42:13,008][52666] Sum rewards: 67.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.695', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon5': '0.086', 'AMMO3': '0.192', 'weapon4': '0.228', 'AMMO4': '0.253', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '59.000'} [2024-08-06 01:42:13,209][52658] DAMAGECOUNT value on done: 230943.0 [2024-08-06 01:42:13,210][52658] Sum rewards: 65.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.000', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.177', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '54.000'} [2024-08-06 01:42:14,832][52670] DAMAGECOUNT value on done: 224645.0 [2024-08-06 01:42:14,832][52670] Sum rewards: 59.530, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.414', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon4': '0.068', 'weapon5': '0.068', 'AMMO4': '0.114', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.800', 'weapon3': '3.220', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 01:42:14,865][52664] DAMAGECOUNT value on done: 236903.0 [2024-08-06 01:42:14,866][52664] Sum rewards: 58.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.562', 'AMMO5': '0.003', 'AMMO2': '0.057', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'AMMO4': '0.286', 'weapon2': '0.314', 'WEAPON4': '0.500', 'weapon4': '0.720', 'WEAPON3': '0.950', 'weapon3': '2.652', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '47.000'} [2024-08-06 01:42:15,479][52650] Updated weights for policy 0, policy_version 32411 (0.0020) [2024-08-06 01:42:15,633][52671] DAMAGECOUNT value on done: 224844.0 [2024-08-06 01:42:15,634][52671] Sum rewards: 64.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.701', 'AMMO2': '0.019', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.182', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '53.000'} [2024-08-06 01:42:15,799][52666] DAMAGECOUNT value on done: 218383.0 [2024-08-06 01:42:15,799][52666] Sum rewards: 60.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.044', 'AMMO4': '0.141', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.564', 'weapon2': '0.588', 'WEAPON3': '1.000', 'weapon3': '2.564', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:16,091][52658] DAMAGECOUNT value on done: 224337.0 [2024-08-06 01:42:16,091][52658] Sum rewards: 71.570, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.616', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.140', 'weapon4': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '57.000'} [2024-08-06 01:42:17,670][52664] DAMAGECOUNT value on done: 237738.0 [2024-08-06 01:42:17,671][52664] Sum rewards: 51.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.534', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.302', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '45.000'} [2024-08-06 01:42:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 265551872. Throughput: 0: 4403.1. Samples: 66386960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:42:17,794][52567] Avg episode reward: [(0, '63.078')] [2024-08-06 01:42:17,872][52670] DAMAGECOUNT value on done: 223210.0 [2024-08-06 01:42:17,875][52670] Sum rewards: 70.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.176', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.134', 'AMMO4': '0.139', 'AMMO3': '0.204', 'weapon5': '0.224', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '59.000'} [2024-08-06 01:42:18,537][52658] DAMAGECOUNT value on done: 225033.0 [2024-08-06 01:42:18,538][52658] Sum rewards: 57.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.060', 'weapon5': '0.110', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.284', 'AMMO4': '0.299', 'WEAPON4': '0.500', 'weapon2': '0.618', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:18,776][52671] DAMAGECOUNT value on done: 231413.0 [2024-08-06 01:42:18,777][52671] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.420', 'AMMO5': '0.007', 'AMMO2': '0.064', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'weapon4': '0.300', 'AMMO4': '0.318', 'weapon2': '0.506', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.674', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:18,891][52666] DAMAGECOUNT value on done: 229873.0 [2024-08-06 01:42:18,893][52666] Sum rewards: 57.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.738', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.086', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.288', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.068', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:20,003][52650] Updated weights for policy 0, policy_version 32421 (0.0019) [2024-08-06 01:42:20,261][52664] DAMAGECOUNT value on done: 234625.0 [2024-08-06 01:42:20,261][52664] Sum rewards: 57.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.240', 'weapon2': '0.634', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '49.000'} [2024-08-06 01:42:20,712][52670] DAMAGECOUNT value on done: 217112.0 [2024-08-06 01:42:20,713][52670] Sum rewards: 68.659, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.515', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.092', 'AMMO3': '0.145', 'AMMO4': '0.161', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.934', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '53.500'} [2024-08-06 01:42:21,411][52671] DAMAGECOUNT value on done: 230360.0 [2024-08-06 01:42:21,411][52671] Sum rewards: 74.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.183', 'AMMO4': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.488', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '62.000'} [2024-08-06 01:42:21,669][52658] DAMAGECOUNT value on done: 228657.0 [2024-08-06 01:42:21,670][52658] Sum rewards: 44.798, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.980', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon4': '0.246', 'WEAPON4': '0.300', 'AMMO3': '0.361', 'weapon2': '0.482', 'WEAPON3': '2.100', 'HITCOUNT': '2.760', 'weapon3': '2.860', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '44.000'} [2024-08-06 01:42:21,767][52666] DAMAGECOUNT value on done: 228033.0 [2024-08-06 01:42:21,767][52666] Sum rewards: 64.095, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.092', 'weapon4': '0.124', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'AMMO3': '0.314', 'weapon2': '0.556', 'WEAPON3': '1.850', 'weapon3': '2.922', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '58.000'} [2024-08-06 01:42:22,392][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:42:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 265641984. Throughput: 0: 4409.6. Samples: 66413490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:42:22,794][52567] Avg episode reward: [(0, '62.811')] [2024-08-06 01:42:23,247][52664] DAMAGECOUNT value on done: 235465.0 [2024-08-06 01:42:23,250][52664] Sum rewards: 62.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon5': '0.072', 'weapon4': '0.186', 'AMMO3': '0.190', 'AMMO4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '53.000'} [2024-08-06 01:42:23,395][52670] DAMAGECOUNT value on done: 228528.0 [2024-08-06 01:42:23,396][52670] Sum rewards: 68.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.803', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon4': '0.232', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '59.000'} [2024-08-06 01:42:24,159][52671] DAMAGECOUNT value on done: 227520.0 [2024-08-06 01:42:24,160][52671] Sum rewards: 64.727, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.498', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.066', 'AMMO4': '0.143', 'WEAPON5': '0.250', 'weapon2': '0.256', 'weapon4': '0.274', 'AMMO3': '0.309', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.086', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '60.000'} [2024-08-06 01:42:24,448][52666] DAMAGECOUNT value on done: 221155.0 [2024-08-06 01:42:24,450][52666] Sum rewards: 61.923, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.192', 'weapon2': '0.218', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.608', 'WEAPON3': '1.700', 'weapon3': '2.882', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '55.000'} [2024-08-06 01:42:24,774][52650] Updated weights for policy 0, policy_version 32431 (0.0012) [2024-08-06 01:42:26,437][52670] DAMAGECOUNT value on done: 226388.0 [2024-08-06 01:42:26,439][52670] Sum rewards: 69.127, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon4': '0.330', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '60.000'} [2024-08-06 01:42:27,045][52671] DAMAGECOUNT value on done: 235158.0 [2024-08-06 01:42:27,047][52671] Sum rewards: 55.684, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.120', 'weapon5': '0.152', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '0.650', 'weapon2': '0.674', 'HEALTH': '0.920', 'weapon3': '2.642', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '43.000'} [2024-08-06 01:42:27,628][52666] DAMAGECOUNT value on done: 222631.0 [2024-08-06 01:42:27,630][52666] Sum rewards: 53.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon5': '0.114', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.150', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '46.000'} [2024-08-06 01:42:27,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17749.3, 300 sec: 17605.8). Total num frames: 265732096. Throughput: 0: 4406.9. Samples: 66439900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:42:27,795][52567] Avg episode reward: [(0, '62.453')] [2024-08-06 01:42:27,807][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032438_265732096.pth... [2024-08-06 01:42:27,952][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000031922_261505024.pth [2024-08-06 01:42:28,054][52659] DAMAGECOUNT value on done: 227762.0 [2024-08-06 01:42:28,057][52659] Sum rewards: 59.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.775', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.104', 'weapon5': '0.160', 'AMMO4': '0.164', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:29,114][52649] DAMAGECOUNT value on done: 220513.0 [2024-08-06 01:42:29,116][52649] Sum rewards: 71.893, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.140', 'HEALTH': '0.390', 'weapon2': '0.690', 'WEAPON3': '0.850', 'weapon3': '3.018', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:29,446][52650] Updated weights for policy 0, policy_version 32441 (0.0017) [2024-08-06 01:42:29,604][52663] DAMAGECOUNT value on done: 227786.0 [2024-08-06 01:42:29,604][52663] Sum rewards: 60.006, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.296', 'weapon4': '0.296', 'weapon2': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.894', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '47.000'} [2024-08-06 01:42:29,626][52670] DAMAGECOUNT value on done: 224603.0 [2024-08-06 01:42:29,628][52670] Sum rewards: 58.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.978', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.150', 'AMMO3': '0.249', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.318', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '50.000'} [2024-08-06 01:42:30,169][52671] DAMAGECOUNT value on done: 226339.0 [2024-08-06 01:42:30,170][52671] Sum rewards: 57.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.414', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '48.000'} [2024-08-06 01:42:30,679][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:42:30,840][52666] DAMAGECOUNT value on done: 222429.0 [2024-08-06 01:42:30,840][52666] Sum rewards: 65.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.235', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon5': '0.168', 'AMMO3': '0.175', 'AMMO4': '0.293', 'weapon4': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'weapon2': '0.682', 'WEAPON3': '1.000', 'weapon3': '2.504', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '53.500'} [2024-08-06 01:42:31,070][52659] DAMAGECOUNT value on done: 224997.0 [2024-08-06 01:42:31,071][52659] Sum rewards: 60.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.555', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.094', 'AMMO3': '0.213', 'AMMO4': '0.266', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON4': '0.550', 'weapon2': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.558', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '53.000'} [2024-08-06 01:42:32,107][52649] DAMAGECOUNT value on done: 213269.0 [2024-08-06 01:42:32,107][52649] Sum rewards: 56.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.544', 'AMMO5': '0.010', 'weapon4': '0.042', 'AMMO2': '0.054', 'weapon5': '0.170', 'AMMO3': '0.199', 'AMMO4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.092', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '49.000'} [2024-08-06 01:42:32,726][52663] DAMAGECOUNT value on done: 226224.0 [2024-08-06 01:42:32,728][52663] Sum rewards: 61.712, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.215', 'weapon7': '0.002', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.108', 'WEAPON4': '0.250', 'weapon4': '0.392', 'weapon2': '0.584', 'WEAPON3': '0.650', 'weapon3': '2.862', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '48.000'} [2024-08-06 01:42:32,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 265805824. Throughput: 0: 4402.7. Samples: 66452870. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 01:42:32,794][52567] Avg episode reward: [(0, '62.234')] [2024-08-06 01:42:32,878][52671] DAMAGECOUNT value on done: 220933.0 [2024-08-06 01:42:32,879][52671] Sum rewards: 56.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.414', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.592', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.006', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '46.000'} [2024-08-06 01:42:33,041][52670] DAMAGECOUNT value on done: 226497.0 [2024-08-06 01:42:33,041][52670] Sum rewards: 59.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.170', 'AMMO3': '0.228', 'weapon4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.054', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '50.000'} [2024-08-06 01:42:33,803][52659] DAMAGECOUNT value on done: 226674.0 [2024-08-06 01:42:33,806][52659] Sum rewards: 58.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.076', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.210', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '50.500'} [2024-08-06 01:42:34,018][52650] Updated weights for policy 0, policy_version 32451 (0.0013) [2024-08-06 01:42:34,033][52666] DAMAGECOUNT value on done: 227720.0 [2024-08-06 01:42:34,033][52666] Sum rewards: 69.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.300', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '60.000'} [2024-08-06 01:42:34,807][52649] DAMAGECOUNT value on done: 222679.0 [2024-08-06 01:42:34,807][52649] Sum rewards: 57.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon2': '0.160', 'weapon4': '0.226', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.460', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:35,503][52663] DAMAGECOUNT value on done: 222204.0 [2024-08-06 01:42:35,504][52663] Sum rewards: 57.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.765', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '47.000'} [2024-08-06 01:42:35,536][52670] DAMAGECOUNT value on done: 227411.0 [2024-08-06 01:42:35,536][52670] Sum rewards: 55.051, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.100', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon4': '0.282', 'weapon2': '0.518', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '2.906', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '47.000'} [2024-08-06 01:42:35,857][52671] DAMAGECOUNT value on done: 229896.0 [2024-08-06 01:42:35,858][52671] Sum rewards: 61.774, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.611', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.114', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.284', 'weapon2': '0.672', 'WEAPON3': '0.900', 'weapon3': '2.834', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '48.000'} [2024-08-06 01:42:36,710][52666] DAMAGECOUNT value on done: 219804.0 [2024-08-06 01:42:36,710][52666] Sum rewards: 52.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.267', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.159', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.998', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '45.000'} [2024-08-06 01:42:36,942][52659] DAMAGECOUNT value on done: 225718.0 [2024-08-06 01:42:36,943][52659] Sum rewards: 66.414, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO4': '0.115', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon2': '0.306', 'weapon4': '0.456', 'WEAPON3': '0.850', 'weapon3': '3.008', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '52.000'} [2024-08-06 01:42:37,559][52649] DAMAGECOUNT value on done: 222534.0 [2024-08-06 01:42:37,560][52649] Sum rewards: 65.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.390', 'weapon3': '3.424', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 265904128. Throughput: 0: 4394.4. Samples: 66479030. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 01:42:37,794][52567] Avg episode reward: [(0, '62.239')] [2024-08-06 01:42:38,245][52663] DAMAGECOUNT value on done: 228728.0 [2024-08-06 01:42:38,245][52663] Sum rewards: 72.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.280', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.153', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.650', 'weapon3': '3.422', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '62.000'} [2024-08-06 01:42:38,387][52670] DAMAGECOUNT value on done: 215061.0 [2024-08-06 01:42:38,388][52670] Sum rewards: 58.642, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.045', 'ARMOR': '0.004', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO2': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.228', 'weapon4': '0.316', 'WEAPON4': '0.450', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:38,607][52671] DAMAGECOUNT value on done: 229931.0 [2024-08-06 01:42:38,608][52671] Sum rewards: 66.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.062', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.262', 'weapon4': '0.280', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.146', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 01:42:38,936][52650] Updated weights for policy 0, policy_version 32461 (0.0013) [2024-08-06 01:42:39,487][52666] DAMAGECOUNT value on done: 224691.0 [2024-08-06 01:42:39,490][52666] Sum rewards: 80.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.203', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.386', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '65.000'} [2024-08-06 01:42:39,653][52659] DAMAGECOUNT value on done: 225288.0 [2024-08-06 01:42:39,654][52659] Sum rewards: 63.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.065', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.228', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2024-08-06 01:42:40,500][52649] DAMAGECOUNT value on done: 212812.0 [2024-08-06 01:42:40,500][52649] Sum rewards: 52.356, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.428', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.141', 'weapon5': '0.144', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'weapon2': '0.386', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.666', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '44.000'} [2024-08-06 01:42:40,859][52670] DAMAGECOUNT value on done: 227707.0 [2024-08-06 01:42:40,861][52670] Sum rewards: 61.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.090', 'weapon5': '0.158', 'AMMO4': '0.186', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '52.000'} [2024-08-06 01:42:41,235][52663] DAMAGECOUNT value on done: 224836.0 [2024-08-06 01:42:41,238][52663] Sum rewards: 57.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.184', 'weapon5': '0.184', 'weapon2': '0.218', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '48.000'} [2024-08-06 01:42:41,654][52671] DAMAGECOUNT value on done: 233064.0 [2024-08-06 01:42:41,654][52671] Sum rewards: 61.447, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.066', 'AMMO3': '0.154', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.194', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '51.000'} [2024-08-06 01:42:42,606][52659] DAMAGECOUNT value on done: 226589.0 [2024-08-06 01:42:42,606][52659] Sum rewards: 72.149, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.985', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'weapon5': '0.076', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.346', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '59.000'} [2024-08-06 01:42:42,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 265994240. Throughput: 0: 4390.2. Samples: 66505260. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 01:42:42,795][52567] Avg episode reward: [(0, '62.779')] [2024-08-06 01:42:42,952][52650] Updated weights for policy 0, policy_version 32471 (0.0012) [2024-08-06 01:42:43,208][52649] DAMAGECOUNT value on done: 223435.0 [2024-08-06 01:42:43,208][52649] Sum rewards: 69.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.215', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.102', 'AMMO3': '0.163', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '55.000'} [2024-08-06 01:42:43,534][52670] DAMAGECOUNT value on done: 229749.0 [2024-08-06 01:42:43,534][52670] Sum rewards: 49.930, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.528', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.172', 'weapon5': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '1.000', 'WEAPON3': '1.050', 'weapon3': '2.120', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '42.000'} [2024-08-06 01:42:44,586][52663] DAMAGECOUNT value on done: 229585.0 [2024-08-06 01:42:44,590][52663] Sum rewards: 60.805, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.220', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.096', 'AMMO3': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '0.600', 'weapon2': '1.144', 'weapon3': '2.180', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '47.500'} [2024-08-06 01:42:44,804][52671] DAMAGECOUNT value on done: 230284.0 [2024-08-06 01:42:44,806][52671] Sum rewards: 55.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.238', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.112', 'AMMO4': '0.234', 'AMMO3': '0.237', 'weapon5': '0.298', 'weapon2': '0.426', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.420', 'weapon3': '2.874', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '46.000'} [2024-08-06 01:42:45,792][52659] DAMAGECOUNT value on done: 226174.0 [2024-08-06 01:42:45,793][52659] Sum rewards: 64.942, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon2': '0.240', 'AMMO3': '0.308', 'weapon4': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '57.000'} [2024-08-06 01:42:46,167][52649] DAMAGECOUNT value on done: 218726.0 [2024-08-06 01:42:46,167][52649] Sum rewards: 64.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.775', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.222', 'weapon2': '0.578', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '54.000'} [2024-08-06 01:42:46,277][52670] DAMAGECOUNT value on done: 224447.0 [2024-08-06 01:42:46,278][52670] Sum rewards: 54.238, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '43.000'} [2024-08-06 01:42:47,591][52663] DAMAGECOUNT value on done: 227657.0 [2024-08-06 01:42:47,592][52663] Sum rewards: 67.829, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.036', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.094', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.298', 'WEAPON4': '0.550', 'weapon4': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '60.000'} [2024-08-06 01:42:47,757][52795] DAMAGECOUNT value on done: 210618.0 [2024-08-06 01:42:47,761][52795] Sum rewards: 64.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.048', 'weapon4': '0.162', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.604', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '54.000'} [2024-08-06 01:42:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 266076160. Throughput: 0: 4390.7. Samples: 66518370. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 01:42:47,795][52567] Avg episode reward: [(0, '62.601')] [2024-08-06 01:42:47,853][52671] DAMAGECOUNT value on done: 226147.0 [2024-08-06 01:42:47,853][52671] Sum rewards: 53.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.608', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.227', 'AMMO4': '0.239', 'weapon2': '0.246', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.748', 'WEAPON3': '1.300', 'weapon3': '2.380', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '44.000'} [2024-08-06 01:42:48,131][52650] Updated weights for policy 0, policy_version 32481 (0.0018) [2024-08-06 01:42:48,767][52659] DAMAGECOUNT value on done: 222300.0 [2024-08-06 01:42:48,769][52659] Sum rewards: 62.592, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.338', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.309', 'weapon2': '0.320', 'WEAPON3': '1.850', 'weapon3': '3.174', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:49,158][52670] DAMAGECOUNT value on done: 226881.0 [2024-08-06 01:42:49,158][52670] Sum rewards: 67.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'weapon4': '0.056', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.368', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '57.000'} [2024-08-06 01:42:49,264][52649] DAMAGECOUNT value on done: 225833.0 [2024-08-06 01:42:49,267][52649] Sum rewards: 69.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.098', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.125', 'weapon4': '0.190', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '58.000'} [2024-08-06 01:42:50,233][52665] DAMAGECOUNT value on done: 223520.0 [2024-08-06 01:42:50,243][52665] Sum rewards: 60.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.078', 'weapon5': '0.096', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.398', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.190', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '53.000'} [2024-08-06 01:42:50,618][52663] DAMAGECOUNT value on done: 227186.0 [2024-08-06 01:42:50,618][52663] Sum rewards: 69.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.590', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.288', 'weapon4': '0.388', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.850', 'weapon3': '2.900', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '62.000'} [2024-08-06 01:42:50,850][52795] DAMAGECOUNT value on done: 207995.0 [2024-08-06 01:42:50,851][52795] Sum rewards: 67.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.171', 'weapon5': '0.202', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '54.000'} [2024-08-06 01:42:51,955][52659] DAMAGECOUNT value on done: 232002.0 [2024-08-06 01:42:51,956][52659] Sum rewards: 65.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.374', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.096', 'weapon5': '0.096', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.210', 'WEAPON3': '1.250', 'weapon3': '3.378', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '56.000'} [2024-08-06 01:42:52,272][52649] DAMAGECOUNT value on done: 222224.0 [2024-08-06 01:42:52,273][52649] Sum rewards: 82.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.205', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'AMMO4': '0.193', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '0.950', 'weapon3': '2.882', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 01:42:52,606][52650] Updated weights for policy 0, policy_version 32491 (0.0018) [2024-08-06 01:42:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 266166272. Throughput: 0: 4395.3. Samples: 66544930. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:42:52,794][52567] Avg episode reward: [(0, '63.087')] [2024-08-06 01:42:53,215][52665] DAMAGECOUNT value on done: 229159.0 [2024-08-06 01:42:53,216][52665] Sum rewards: 57.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.569', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.118', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.136', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '48.000'} [2024-08-06 01:42:53,357][52663] DAMAGECOUNT value on done: 226121.0 [2024-08-06 01:42:53,362][52663] Sum rewards: 49.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.288', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.148', 'weapon2': '0.218', 'AMMO4': '0.219', 'AMMO3': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'HITCOUNT': '2.740', 'weapon3': '2.936', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '46.000'} [2024-08-06 01:42:53,962][52795] DAMAGECOUNT value on done: 206314.0 [2024-08-06 01:42:53,964][52795] Sum rewards: 56.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.618', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.119', 'weapon4': '0.162', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.792', 'WEAPON3': '1.000', 'weapon3': '2.710', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '46.000'} [2024-08-06 01:42:54,741][52659] DAMAGECOUNT value on done: 231758.0 [2024-08-06 01:42:54,741][52659] Sum rewards: 57.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.162', 'weapon4': '0.276', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.260', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '49.000'} [2024-08-06 01:42:55,298][52649] DAMAGECOUNT value on done: 222269.0 [2024-08-06 01:42:55,299][52649] Sum rewards: 66.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.210', 'weapon4': '0.418', 'WEAPON4': '0.550', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 01:42:56,229][52665] DAMAGECOUNT value on done: 224004.0 [2024-08-06 01:42:56,234][52665] Sum rewards: 55.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.598', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.026', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '46.000'} [2024-08-06 01:42:56,279][52663] DAMAGECOUNT value on done: 228159.0 [2024-08-06 01:42:56,279][52663] Sum rewards: 60.875, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.082', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.250', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '53.000'} [2024-08-06 01:42:57,229][52795] DAMAGECOUNT value on done: 208804.0 [2024-08-06 01:42:57,229][52795] Sum rewards: 70.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.158', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '59.000'} [2024-08-06 01:42:57,412][52650] Updated weights for policy 0, policy_version 32501 (0.0024) [2024-08-06 01:42:57,530][52659] DAMAGECOUNT value on done: 225956.0 [2024-08-06 01:42:57,530][52659] Sum rewards: 68.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '55.000'} [2024-08-06 01:42:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 266248192. Throughput: 0: 4392.2. Samples: 66571210. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:42:57,795][52567] Avg episode reward: [(0, '62.474')] [2024-08-06 01:42:58,401][52649] DAMAGECOUNT value on done: 222762.0 [2024-08-06 01:42:58,409][52649] Sum rewards: 58.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.334', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.218', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '49.000'} [2024-08-06 01:42:59,321][52663] DAMAGECOUNT value on done: 231651.0 [2024-08-06 01:42:59,322][52663] Sum rewards: 79.556, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.520', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.044', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.270', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '65.000'} [2024-08-06 01:42:59,352][52665] DAMAGECOUNT value on done: 221789.0 [2024-08-06 01:42:59,354][52665] Sum rewards: 56.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.404', 'weapon2': '0.752', 'WEAPON3': '0.950', 'weapon3': '2.500', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.266', 'FRAGCOUNT': '45.000'} [2024-08-06 01:43:00,379][52795] DAMAGECOUNT value on done: 214127.0 [2024-08-06 01:43:00,380][52795] Sum rewards: 69.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'weapon2': '0.174', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.306', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '56.000'} [2024-08-06 01:43:00,555][52659] DAMAGECOUNT value on done: 224603.0 [2024-08-06 01:43:00,555][52659] Sum rewards: 71.340, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.015', 'HEALTH': '0.031', 'AMMO2': '0.035', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.189', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.804', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:01,346][52649] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:43:01,521][52649] DAMAGECOUNT value on done: 220998.0 [2024-08-06 01:43:01,522][52649] Sum rewards: 63.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.358', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'AMMO3': '0.126', 'weapon5': '0.160', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '0.900', 'HITCOUNT': '2.900', 'weapon3': '3.062', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '51.000'} [2024-08-06 01:43:01,971][52650] Updated weights for policy 0, policy_version 32511 (0.0010) [2024-08-06 01:43:02,100][52663] DAMAGECOUNT value on done: 226493.0 [2024-08-06 01:43:02,100][52663] Sum rewards: 46.148, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.650', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'weapon2': '0.298', 'AMMO3': '0.306', 'WEAPON4': '0.600', 'weapon4': '0.664', 'WEAPON3': '1.750', 'weapon3': '2.572', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '45.000'} [2024-08-06 01:43:02,313][52665] DAMAGECOUNT value on done: 220512.0 [2024-08-06 01:43:02,313][52665] Sum rewards: 56.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.129', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.512', 'weapon4': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.484', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.278', 'FRAGCOUNT': '48.000'} [2024-08-06 01:43:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 266338304. Throughput: 0: 4382.2. Samples: 66584160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:43:02,794][52567] Avg episode reward: [(0, '62.424')] [2024-08-06 01:43:03,469][52795] DAMAGECOUNT value on done: 209538.0 [2024-08-06 01:43:03,477][52795] Sum rewards: 69.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.392', 'weapon4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:03,695][52659] DAMAGECOUNT value on done: 221083.0 [2024-08-06 01:43:03,695][52659] Sum rewards: 65.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.044', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.185', 'weapon5': '0.196', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'weapon2': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.754', 'WEAPON3': '1.100', 'weapon3': '2.458', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '55.000'} [2024-08-06 01:43:04,185][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:43:04,190][52649] DAMAGECOUNT value on done: 223902.0 [2024-08-06 01:43:04,192][52649] Sum rewards: 70.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.324', 'WEAPON4': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.864', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '61.000'} [2024-08-06 01:43:05,104][52665] DAMAGECOUNT value on done: 219436.0 [2024-08-06 01:43:05,106][52665] Sum rewards: 60.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.575', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.096', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.258', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.250', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:05,149][52663] DAMAGECOUNT value on done: 220059.0 [2024-08-06 01:43:05,151][52663] Sum rewards: 70.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.044', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.176', 'weapon2': '0.202', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.434', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:06,424][52659] DAMAGECOUNT value on done: 227464.0 [2024-08-06 01:43:06,425][52659] Sum rewards: 57.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.364', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon4': '0.252', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.132', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.500'} [2024-08-06 01:43:06,598][52795] DAMAGECOUNT value on done: 214124.0 [2024-08-06 01:43:06,599][52795] Sum rewards: 46.875, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.010', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon4': '0.178', 'AMMO3': '0.217', 'weapon5': '0.228', 'AMMO4': '0.311', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '2.816', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '42.000'} [2024-08-06 01:43:06,717][52650] Updated weights for policy 0, policy_version 32521 (0.0016) [2024-08-06 01:43:07,414][52649] DAMAGECOUNT value on done: 225598.0 [2024-08-06 01:43:07,416][52649] Sum rewards: 64.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.309', 'AMMO5': '0.006', 'AMMO2': '0.049', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.247', 'weapon2': '0.356', 'WEAPON4': '0.450', 'weapon4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 266428416. Throughput: 0: 4384.2. Samples: 66610780. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:43:07,794][52567] Avg episode reward: [(0, '62.315')] [2024-08-06 01:43:07,918][52663] DAMAGECOUNT value on done: 220876.0 [2024-08-06 01:43:07,918][52663] Sum rewards: 60.815, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.078', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.124', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon2': '0.298', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '48.000'} [2024-08-06 01:43:08,076][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:43:08,094][52665] DAMAGECOUNT value on done: 226387.0 [2024-08-06 01:43:08,097][52665] Sum rewards: 67.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.690', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.098', 'AMMO4': '0.166', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:09,442][52659] DAMAGECOUNT value on done: 230014.0 [2024-08-06 01:43:09,442][52659] Sum rewards: 54.020, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.058', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.240', 'weapon5': '0.274', 'weapon2': '0.434', 'WEAPON5': '0.500', 'weapon4': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.460', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '47.500'} [2024-08-06 01:43:09,722][52795] DAMAGECOUNT value on done: 211189.0 [2024-08-06 01:43:09,723][52795] Sum rewards: 47.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.204', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.124', 'weapon5': '0.136', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.050', 'HITCOUNT': '2.470', 'weapon3': '3.122', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '40.000'} [2024-08-06 01:43:10,000][52649] DAMAGECOUNT value on done: 215688.0 [2024-08-06 01:43:10,001][52649] Sum rewards: 54.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.950', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.164', 'AMMO3': '0.188', 'weapon2': '0.224', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.648', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '46.000'} [2024-08-06 01:43:10,451][52803] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:43:10,587][52663] DAMAGECOUNT value on done: 226647.0 [2024-08-06 01:43:10,587][52663] Sum rewards: 60.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.008', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:10,720][52665] DAMAGECOUNT value on done: 225418.0 [2024-08-06 01:43:10,721][52665] Sum rewards: 65.349, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.895', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.181', 'weapon2': '0.230', 'AMMO3': '0.239', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:11,364][52650] Updated weights for policy 0, policy_version 32531 (0.0012) [2024-08-06 01:43:12,571][52659] DAMAGECOUNT value on done: 234242.0 [2024-08-06 01:43:12,573][52659] Sum rewards: 79.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.096', 'AMMO4': '0.113', 'weapon5': '0.132', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '65.000'} [2024-08-06 01:43:12,646][52649] DAMAGECOUNT value on done: 222313.0 [2024-08-06 01:43:12,647][52649] Sum rewards: 71.319, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.578', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.186', 'AMMO3': '0.223', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:12,772][52795] DAMAGECOUNT value on done: 209272.0 [2024-08-06 01:43:12,773][52795] Sum rewards: 78.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'weapon5': '0.032', 'AMMO2': '0.042', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '66.000'} [2024-08-06 01:43:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 266510336. Throughput: 0: 4384.5. Samples: 66637200. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 01:43:12,794][52567] Avg episode reward: [(0, '62.341')] [2024-08-06 01:43:13,368][52663] DAMAGECOUNT value on done: 230083.0 [2024-08-06 01:43:13,368][52663] Sum rewards: 64.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.339', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.106', 'weapon4': '0.206', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.124', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '56.500'} [2024-08-06 01:43:13,398][52665] DAMAGECOUNT value on done: 227670.0 [2024-08-06 01:43:13,399][52665] Sum rewards: 49.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.072', 'AMMO5': '0.007', 'AMMO2': '0.059', 'AMMO3': '0.116', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.295', 'WEAPON4': '0.300', 'weapon4': '0.626', 'weapon2': '0.674', 'WEAPON3': '0.700', 'weapon3': '2.208', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.099', 'FRAGCOUNT': '40.000'} [2024-08-06 01:43:13,960][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:43:15,638][52659] DAMAGECOUNT value on done: 232144.0 [2024-08-06 01:43:15,639][52659] Sum rewards: 63.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.076', 'weapon5': '0.178', 'AMMO3': '0.192', 'weapon2': '0.270', 'WEAPON5': '0.300', 'AMMO4': '0.378', 'WEAPON4': '0.500', 'weapon4': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.654', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '51.000'} [2024-08-06 01:43:15,671][52649] DAMAGECOUNT value on done: 221068.0 [2024-08-06 01:43:15,671][52649] Sum rewards: 63.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.172', 'AMMO3': '0.191', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.458', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '51.000'} [2024-08-06 01:43:15,828][52795] DAMAGECOUNT value on done: 214100.0 [2024-08-06 01:43:15,828][52795] Sum rewards: 68.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.264', 'weapon2': '0.312', 'WEAPON3': '1.650', 'weapon3': '3.234', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:16,047][52650] Updated weights for policy 0, policy_version 32541 (0.0012) [2024-08-06 01:43:16,373][52665] DAMAGECOUNT value on done: 226796.0 [2024-08-06 01:43:16,374][52665] Sum rewards: 68.803, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.498', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.156', 'AMMO3': '0.177', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.450', 'weapon4': '0.540', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:16,522][52663] DAMAGECOUNT value on done: 229031.0 [2024-08-06 01:43:16,524][52663] Sum rewards: 59.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.516', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.132', 'AMMO4': '0.197', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '50.000'} [2024-08-06 01:43:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 266608640. Throughput: 0: 4390.7. Samples: 66650450. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:43:17,794][52567] Avg episode reward: [(0, '62.547')] [2024-08-06 01:43:18,539][52659] DAMAGECOUNT value on done: 228530.0 [2024-08-06 01:43:18,542][52659] Sum rewards: 77.249, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.066', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.246', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '65.000'} [2024-08-06 01:43:18,731][52649] DAMAGECOUNT value on done: 226969.0 [2024-08-06 01:43:18,731][52649] Sum rewards: 54.206, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.234', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '48.000'} [2024-08-06 01:43:18,846][52795] DAMAGECOUNT value on done: 211922.0 [2024-08-06 01:43:18,848][52795] Sum rewards: 71.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.644', 'ARMOR': '0.004', 'AMMO2': '0.036', 'WEAPON4': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.272', 'weapon2': '0.576', 'weapon4': '0.586', 'WEAPON3': '1.650', 'weapon3': '2.612', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '62.000'} [2024-08-06 01:43:19,200][52663] DAMAGECOUNT value on done: 232885.0 [2024-08-06 01:43:19,200][52663] Sum rewards: 60.180, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.770', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon4': '0.252', 'weapon2': '0.272', 'WEAPON4': '0.300', 'AMMO3': '0.351', 'WEAPON3': '2.100', 'weapon3': '3.094', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.000'} [2024-08-06 01:43:19,539][52665] DAMAGECOUNT value on done: 233056.0 [2024-08-06 01:43:19,542][52665] Sum rewards: 66.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.914', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.136', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.256', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '56.000'} [2024-08-06 01:43:20,679][52650] Updated weights for policy 0, policy_version 32551 (0.0030) [2024-08-06 01:43:21,300][52659] DAMAGECOUNT value on done: 233059.0 [2024-08-06 01:43:21,317][52659] Sum rewards: 54.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.546', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '46.000'} [2024-08-06 01:43:21,910][52663] DAMAGECOUNT value on done: 229546.0 [2024-08-06 01:43:21,912][52663] Sum rewards: 76.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.888', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.126', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '65.000'} [2024-08-06 01:43:21,983][52795] DAMAGECOUNT value on done: 207933.0 [2024-08-06 01:43:21,984][52795] Sum rewards: 62.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.646', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.106', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.209', 'AMMO4': '0.213', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:22,054][52649] DAMAGECOUNT value on done: 227780.0 [2024-08-06 01:43:22,055][52649] Sum rewards: 60.809, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.330', 'weapon4': '0.366', 'WEAPON3': '1.650', 'weapon3': '2.996', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '54.000'} [2024-08-06 01:43:22,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 266698752. Throughput: 0: 4393.8. Samples: 66676750. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:43:22,794][52567] Avg episode reward: [(0, '62.723')] [2024-08-06 01:43:22,823][52665] DAMAGECOUNT value on done: 229295.0 [2024-08-06 01:43:22,824][52665] Sum rewards: 56.868, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.220', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '51.000'} [2024-08-06 01:43:24,240][52659] DAMAGECOUNT value on done: 230708.0 [2024-08-06 01:43:24,242][52659] Sum rewards: 59.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.230', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.186', 'AMMO3': '0.194', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.314', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '50.000'} [2024-08-06 01:43:24,488][52663] DAMAGECOUNT value on done: 225789.0 [2024-08-06 01:43:24,490][52663] Sum rewards: 68.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.498', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.046', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.258', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.482', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:24,966][52649] DAMAGECOUNT value on done: 230739.0 [2024-08-06 01:43:24,968][52649] Sum rewards: 63.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.032', 'weapon4': '0.076', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2024-08-06 01:43:25,095][52795] DAMAGECOUNT value on done: 208417.0 [2024-08-06 01:43:25,097][52795] Sum rewards: 68.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.337', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.091', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '55.000'} [2024-08-06 01:43:25,284][52650] Updated weights for policy 0, policy_version 32561 (0.0011) [2024-08-06 01:43:25,704][52665] DAMAGECOUNT value on done: 227152.0 [2024-08-06 01:43:25,715][52665] Sum rewards: 60.080, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.102', 'AMMO3': '0.229', 'AMMO4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.410', 'weapon4': '0.494', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.668', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '54.000'} [2024-08-06 01:43:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17605.9). Total num frames: 266780672. Throughput: 0: 4392.9. Samples: 66702940. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:43:27,794][52567] Avg episode reward: [(0, '62.877')] [2024-08-06 01:43:28,202][52795] DAMAGECOUNT value on done: 211601.0 [2024-08-06 01:43:28,203][52795] Sum rewards: 56.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.246', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '3.030', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '48.000'} [2024-08-06 01:43:28,390][52665] DAMAGECOUNT value on done: 226036.0 [2024-08-06 01:43:28,390][52665] Sum rewards: 61.646, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.621', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.293', 'weapon2': '0.412', 'WEAPON3': '1.750', 'weapon3': '3.340', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.000'} [2024-08-06 01:43:30,310][52650] Updated weights for policy 0, policy_version 32571 (0.0035) [2024-08-06 01:43:30,486][52803] DAMAGECOUNT value on done: 212955.0 [2024-08-06 01:43:30,486][52803] Sum rewards: 58.461, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.224', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON4': '0.600', 'weapon4': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.488', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '52.000'} [2024-08-06 01:43:31,167][52665] DAMAGECOUNT value on done: 227023.0 [2024-08-06 01:43:31,176][52665] Sum rewards: 73.884, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.769', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.134', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:31,202][52795] DAMAGECOUNT value on done: 203693.0 [2024-08-06 01:43:31,203][52795] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.350', 'weapon2': '0.458', 'weapon4': '0.498', 'WEAPON3': '1.000', 'weapon3': '2.660', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '52.000'} [2024-08-06 01:43:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 266862592. Throughput: 0: 4398.0. Samples: 66716280. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 01:43:32,794][52567] Avg episode reward: [(0, '63.015')] [2024-08-06 01:43:33,683][52803] DAMAGECOUNT value on done: 213547.0 [2024-08-06 01:43:33,684][52803] Sum rewards: 56.620, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.060', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'weapon4': '0.256', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.700', 'weapon3': '2.938', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '51.000'} [2024-08-06 01:43:34,085][52665] DAMAGECOUNT value on done: 224606.0 [2024-08-06 01:43:34,086][52665] Sum rewards: 66.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '55.000'} [2024-08-06 01:43:34,405][52795] DAMAGECOUNT value on done: 216118.0 [2024-08-06 01:43:34,410][52795] Sum rewards: 61.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.205', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.158', 'AMMO3': '0.197', 'AMMO4': '0.234', 'weapon2': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:34,581][52650] Updated weights for policy 0, policy_version 32581 (0.0012) [2024-08-06 01:43:36,682][52665] DAMAGECOUNT value on done: 223828.0 [2024-08-06 01:43:36,685][52665] Sum rewards: 51.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'weapon5': '0.034', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO4': '0.183', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.172', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '44.000'} [2024-08-06 01:43:36,805][52803] DAMAGECOUNT value on done: 212249.0 [2024-08-06 01:43:36,806][52803] Sum rewards: 73.455, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.304', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon2': '0.170', 'weapon4': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.452', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '63.000'} [2024-08-06 01:43:37,098][52811] DAMAGECOUNT value on done: 223830.0 [2024-08-06 01:43:37,099][52811] Sum rewards: 68.268, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.134', 'weapon4': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '55.000'} [2024-08-06 01:43:37,365][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:43:37,547][52795] DAMAGECOUNT value on done: 216149.0 [2024-08-06 01:43:37,549][52795] Sum rewards: 69.868, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'weapon5': '0.136', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.318', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 266952704. Throughput: 0: 4387.3. Samples: 66742360. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:43:37,794][52567] Avg episode reward: [(0, '63.297')] [2024-08-06 01:43:38,161][52647] DAMAGECOUNT value on done: 243472.0 [2024-08-06 01:43:38,162][52647] Sum rewards: 57.115, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.066', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '50.000'} [2024-08-06 01:43:39,353][52665] DAMAGECOUNT value on done: 222647.0 [2024-08-06 01:43:39,354][52665] Sum rewards: 72.359, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.150', 'weapon2': '0.428', 'WEAPON3': '0.950', 'weapon3': '3.392', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '56.000'} [2024-08-06 01:43:39,678][52650] Updated weights for policy 0, policy_version 32591 (0.0013) [2024-08-06 01:43:39,934][52803] DAMAGECOUNT value on done: 215604.0 [2024-08-06 01:43:39,937][52803] Sum rewards: 66.005, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.656', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.134', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.282', 'weapon2': '0.512', 'WEAPON3': '1.700', 'weapon3': '3.060', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:40,229][52811] DAMAGECOUNT value on done: 211620.0 [2024-08-06 01:43:40,230][52811] Sum rewards: 60.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.130', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:40,492][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:43:40,745][52795] DAMAGECOUNT value on done: 203900.0 [2024-08-06 01:43:40,747][52795] Sum rewards: 50.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.320', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.086', 'AMMO3': '0.234', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '46.000'} [2024-08-06 01:43:40,831][52647] DAMAGECOUNT value on done: 238918.0 [2024-08-06 01:43:40,834][52647] Sum rewards: 57.959, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.130', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.022', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 01:43:42,482][52665] DAMAGECOUNT value on done: 228054.0 [2024-08-06 01:43:42,484][52665] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.166', 'AMMO3': '0.174', 'AMMO4': '0.223', 'weapon2': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '50.000'} [2024-08-06 01:43:42,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 267034624. Throughput: 0: 4387.7. Samples: 66768660. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:43:42,795][52567] Avg episode reward: [(0, '62.942')] [2024-08-06 01:43:42,796][52668] DAMAGECOUNT value on done: 226981.0 [2024-08-06 01:43:42,797][52668] Sum rewards: 68.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '57.000'} [2024-08-06 01:43:43,000][52803] DAMAGECOUNT value on done: 216580.0 [2024-08-06 01:43:43,001][52803] Sum rewards: 66.370, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.102', 'AMMO3': '0.126', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'weapon4': '0.402', 'WEAPON4': '0.450', 'weapon2': '0.624', 'WEAPON3': '0.950', 'weapon3': '2.724', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '52.000'} [2024-08-06 01:43:43,347][52811] DAMAGECOUNT value on done: 213329.0 [2024-08-06 01:43:43,348][52811] Sum rewards: 71.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.233', 'weapon2': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '61.000'} [2024-08-06 01:43:43,404][52647] DAMAGECOUNT value on done: 241881.0 [2024-08-06 01:43:43,405][52647] Sum rewards: 60.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '2.972', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '50.000'} [2024-08-06 01:43:43,814][52795] DAMAGECOUNT value on done: 218341.0 [2024-08-06 01:43:43,814][52795] Sum rewards: 75.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.318', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.070', 'AMMO3': '0.195', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.434', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '63.000'} [2024-08-06 01:43:44,121][52650] Updated weights for policy 0, policy_version 32601 (0.0015) [2024-08-06 01:43:45,386][52665] DAMAGECOUNT value on done: 226037.0 [2024-08-06 01:43:45,387][52665] Sum rewards: 69.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.662', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.267', 'weapon2': '0.462', 'WEAPON3': '1.550', 'weapon3': '3.354', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:46,050][52803] DAMAGECOUNT value on done: 216239.0 [2024-08-06 01:43:46,054][52803] Sum rewards: 67.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.820', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.187', 'weapon2': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon4': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.086', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:46,110][52668] DAMAGECOUNT value on done: 234605.0 [2024-08-06 01:43:46,111][52668] Sum rewards: 60.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.804', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '52.000'} [2024-08-06 01:43:46,199][52647] DAMAGECOUNT value on done: 243551.0 [2024-08-06 01:43:46,199][52647] Sum rewards: 67.057, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.372', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.200', 'weapon4': '0.264', 'AMMO3': '0.267', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:46,589][52811] DAMAGECOUNT value on done: 212105.0 [2024-08-06 01:43:46,591][52811] Sum rewards: 49.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.898', 'AMMO5': '0.007', 'AMMO2': '0.013', 'ARMOR': '0.016', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.175', 'weapon2': '0.666', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.020', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '40.000'} [2024-08-06 01:43:47,029][52795] DAMAGECOUNT value on done: 216503.0 [2024-08-06 01:43:47,029][52795] Sum rewards: 53.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.136', 'weapon4': '0.180', 'AMMO3': '0.204', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '46.000'} [2024-08-06 01:43:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 267132928. Throughput: 0: 4389.3. Samples: 66781680. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:43:47,794][52567] Avg episode reward: [(0, '63.349')] [2024-08-06 01:43:48,730][52647] DAMAGECOUNT value on done: 242895.0 [2024-08-06 01:43:48,730][52647] Sum rewards: 74.116, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.035', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.358', 'weapon2': '0.440', 'WEAPON3': '0.900', 'weapon3': '2.876', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:48,952][52650] Updated weights for policy 0, policy_version 32611 (0.0060) [2024-08-06 01:43:49,134][52803] DAMAGECOUNT value on done: 213241.0 [2024-08-06 01:43:49,138][52803] Sum rewards: 50.707, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.366', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.134', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.368', 'weapon4': '0.522', 'WEAPON3': '1.050', 'weapon3': '2.754', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '40.500'} [2024-08-06 01:43:49,322][52662] DAMAGECOUNT value on done: 235646.0 [2024-08-06 01:43:49,323][52662] Sum rewards: 61.400, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'AMMO5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.248', 'weapon5': '0.248', 'AMMO4': '0.263', 'weapon2': '0.278', 'weapon4': '0.430', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.652', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:49,328][52668] DAMAGECOUNT value on done: 233121.0 [2024-08-06 01:43:49,328][52668] Sum rewards: 85.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.012', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.076', 'weapon2': '0.154', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '72.000'} [2024-08-06 01:43:49,627][52667] DAMAGECOUNT value on done: 229138.0 [2024-08-06 01:43:49,628][52667] Sum rewards: 48.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.288', 'WEAPON4': '0.450', 'weapon4': '0.518', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '2.720', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '44.500'} [2024-08-06 01:43:49,664][52811] DAMAGECOUNT value on done: 213406.0 [2024-08-06 01:43:49,664][52811] Sum rewards: 52.672, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.165', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.130', 'weapon4': '0.198', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.332', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '2.000', 'weapon3': '3.058', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '49.000'} [2024-08-06 01:43:51,131][52647] DAMAGECOUNT value on done: 245390.0 [2024-08-06 01:43:51,131][52647] Sum rewards: 60.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.562', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.058', 'weapon4': '0.088', 'AMMO4': '0.104', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.276', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '51.000'} [2024-08-06 01:43:51,979][52662] DAMAGECOUNT value on done: 235178.0 [2024-08-06 01:43:51,981][52662] Sum rewards: 50.579, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.835', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon4': '0.176', 'weapon5': '0.222', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.750', 'weapon3': '2.852', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '46.500'} [2024-08-06 01:43:52,281][52803] DAMAGECOUNT value on done: 209877.0 [2024-08-06 01:43:52,291][52803] Sum rewards: 60.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'AMMO4': '0.245', 'weapon2': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '50.000'} [2024-08-06 01:43:52,352][52668] DAMAGECOUNT value on done: 233083.0 [2024-08-06 01:43:52,353][52668] Sum rewards: 68.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.069', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.672', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:52,472][52667] DAMAGECOUNT value on done: 230198.0 [2024-08-06 01:43:52,478][52667] Sum rewards: 61.770, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.748', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.102', 'AMMO3': '0.138', 'weapon5': '0.138', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.470', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.130', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '49.500'} [2024-08-06 01:43:52,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 267214848. Throughput: 0: 4381.1. Samples: 66807930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:43:52,794][52567] Avg episode reward: [(0, '63.101')] [2024-08-06 01:43:52,874][52811] DAMAGECOUNT value on done: 219141.0 [2024-08-06 01:43:52,874][52811] Sum rewards: 62.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.468', 'AMMO5': '0.021', 'AMMO2': '0.069', 'AMMO3': '0.171', 'weapon5': '0.190', 'weapon4': '0.330', 'AMMO4': '0.343', 'WEAPON5': '0.450', 'weapon2': '0.594', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.606', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 01:43:53,547][52650] Updated weights for policy 0, policy_version 32621 (0.0016) [2024-08-06 01:43:53,650][52647] DAMAGECOUNT value on done: 240632.0 [2024-08-06 01:43:53,650][52647] Sum rewards: 68.574, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.500', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.112', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.510', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 01:43:54,442][52820] DAMAGECOUNT value on done: 209389.0 [2024-08-06 01:43:54,446][52820] Sum rewards: 54.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.386', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.014', 'AMMO2': '0.037', 'WEAPON5': '0.100', 'AMMO4': '0.187', 'AMMO3': '0.217', 'weapon2': '0.322', 'WEAPON4': '0.350', 'weapon4': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.676', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.578', 'FRAGCOUNT': '47.000'} [2024-08-06 01:43:54,842][52662] DAMAGECOUNT value on done: 235466.0 [2024-08-06 01:43:54,845][52662] Sum rewards: 50.251, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.723', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.558', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.488', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '39.000'} [2024-08-06 01:43:55,326][52803] DAMAGECOUNT value on done: 214639.0 [2024-08-06 01:43:55,327][52803] Sum rewards: 66.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.975', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.752', 'WEAPON3': '1.600', 'weapon3': '2.538', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '59.000'} [2024-08-06 01:43:55,377][52667] DAMAGECOUNT value on done: 232370.0 [2024-08-06 01:43:55,377][52667] Sum rewards: 59.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon4': '0.314', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '50.000'} [2024-08-06 01:43:55,718][52668] DAMAGECOUNT value on done: 223739.0 [2024-08-06 01:43:55,719][52668] Sum rewards: 67.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.798', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '3.350', 'weapon3': '3.420', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:56,108][52647] DAMAGECOUNT value on done: 240480.0 [2024-08-06 01:43:56,110][52647] Sum rewards: 72.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.264', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.188', 'weapon5': '0.198', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '58.000'} [2024-08-06 01:43:56,147][52811] DAMAGECOUNT value on done: 214578.0 [2024-08-06 01:43:56,149][52811] Sum rewards: 48.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.244', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.170', 'AMMO3': '0.193', 'AMMO4': '0.214', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.854', 'DAMAGECOUNT': '12.594', 'FRAGCOUNT': '43.000'} [2024-08-06 01:43:57,377][52662] DAMAGECOUNT value on done: 226102.0 [2024-08-06 01:43:57,377][52662] Sum rewards: 56.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.728', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.774', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '49.000'} [2024-08-06 01:43:57,471][52820] DAMAGECOUNT value on done: 212581.0 [2024-08-06 01:43:57,471][52820] Sum rewards: 72.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.670', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'AMMO3': '0.222', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.458', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2024-08-06 01:43:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 267304960. Throughput: 0: 4377.6. Samples: 66834190. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:43:57,794][52567] Avg episode reward: [(0, '62.995')] [2024-08-06 01:43:58,179][52650] Updated weights for policy 0, policy_version 32631 (0.0015) [2024-08-06 01:43:58,272][52668] DAMAGECOUNT value on done: 230623.0 [2024-08-06 01:43:58,274][52668] Sum rewards: 69.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.963', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.151', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.000', 'weapon3': '2.980', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 01:43:58,439][52803] DAMAGECOUNT value on done: 209963.0 [2024-08-06 01:43:58,440][52803] Sum rewards: 50.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.042', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.228', 'weapon2': '0.474', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '12.540', 'FRAGCOUNT': '43.000'} [2024-08-06 01:43:58,463][52667] DAMAGECOUNT value on done: 227415.0 [2024-08-06 01:43:58,464][52667] Sum rewards: 76.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.394', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.146', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '62.000'} [2024-08-06 01:43:58,578][52660] DAMAGECOUNT value on done: 226045.0 [2024-08-06 01:43:58,578][52660] Sum rewards: 55.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.665', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.330', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '46.000'} [2024-08-06 01:43:58,838][52647] DAMAGECOUNT value on done: 243349.0 [2024-08-06 01:43:58,838][52647] Sum rewards: 64.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.565', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.402', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '55.000'} [2024-08-06 01:43:59,186][52811] DAMAGECOUNT value on done: 213526.0 [2024-08-06 01:43:59,188][52811] Sum rewards: 58.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.764', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.214', 'AMMO4': '0.236', 'AMMO3': '0.246', 'weapon4': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.688', 'WEAPON3': '1.400', 'weapon3': '2.478', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:00,074][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:44:00,174][52660] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:44:00,371][52662] DAMAGECOUNT value on done: 233792.0 [2024-08-06 01:44:00,374][52662] Sum rewards: 75.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.066', 'AMMO4': '0.068', 'weapon5': '0.092', 'weapon2': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.516', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '63.000'} [2024-08-06 01:44:00,594][52668] DAMAGECOUNT value on done: 229463.0 [2024-08-06 01:44:00,595][52668] Sum rewards: 82.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.913', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.191', 'weapon5': '0.216', 'weapon2': '0.236', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.640', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '67.000'} [2024-08-06 01:44:00,627][52820] DAMAGECOUNT value on done: 210204.0 [2024-08-06 01:44:00,627][52820] Sum rewards: 66.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.005', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '58.000'} [2024-08-06 01:44:01,128][52660] DAMAGECOUNT value on done: 226426.0 [2024-08-06 01:44:01,131][52660] Sum rewards: 78.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.199', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '65.000'} [2024-08-06 01:44:01,441][52667] DAMAGECOUNT value on done: 234034.0 [2024-08-06 01:44:01,441][52667] Sum rewards: 76.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.188', 'AMMO3': '0.232', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '64.000'} [2024-08-06 01:44:01,557][52803] DAMAGECOUNT value on done: 219542.0 [2024-08-06 01:44:01,558][52803] Sum rewards: 63.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.199', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:01,682][52647] DAMAGECOUNT value on done: 238832.0 [2024-08-06 01:44:01,684][52647] Sum rewards: 67.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.940', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.174', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:02,298][52811] DAMAGECOUNT value on done: 221248.0 [2024-08-06 01:44:02,300][52811] Sum rewards: 63.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.188', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 01:44:02,753][52650] Updated weights for policy 0, policy_version 32641 (0.0029) [2024-08-06 01:44:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 267395072. Throughput: 0: 4378.0. Samples: 66847460. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:44:02,794][52567] Avg episode reward: [(0, '63.543')] [2024-08-06 01:44:03,302][52668] DAMAGECOUNT value on done: 230079.0 [2024-08-06 01:44:03,302][52668] Sum rewards: 55.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.159', 'AMMO3': '0.182', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '3.028', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:03,437][52662] DAMAGECOUNT value on done: 229028.0 [2024-08-06 01:44:03,438][52662] Sum rewards: 67.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO4': '0.148', 'AMMO3': '0.232', 'weapon2': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.490', 'weapon3': '3.498', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:03,755][52820] DAMAGECOUNT value on done: 203631.0 [2024-08-06 01:44:03,757][52820] Sum rewards: 52.219, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.382', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon5': '0.098', 'weapon4': '0.258', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'AMMO4': '0.323', 'weapon2': '0.562', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.784', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:03,854][52660] DAMAGECOUNT value on done: 231035.0 [2024-08-06 01:44:03,857][52660] Sum rewards: 69.591, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.242', 'weapon4': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:03,914][52647] DAMAGECOUNT value on done: 241133.0 [2024-08-06 01:44:03,916][52647] Sum rewards: 69.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.115', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:04,357][52667] DAMAGECOUNT value on done: 231483.0 [2024-08-06 01:44:04,357][52667] Sum rewards: 67.031, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.325', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon5': '0.114', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.284', 'weapon2': '0.428', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '57.500'} [2024-08-06 01:44:04,687][52803] DAMAGECOUNT value on done: 216006.0 [2024-08-06 01:44:04,689][52803] Sum rewards: 52.412, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.895', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.172', 'AMMO3': '0.248', 'AMMO4': '0.259', 'weapon4': '0.314', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.702', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:05,382][52811] DAMAGECOUNT value on done: 215485.0 [2024-08-06 01:44:05,383][52811] Sum rewards: 68.869, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.806', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.154', 'AMMO3': '0.174', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:06,258][52647] DAMAGECOUNT value on done: 236378.0 [2024-08-06 01:44:06,258][52647] Sum rewards: 58.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.062', 'weapon4': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.844', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:06,333][52662] DAMAGECOUNT value on done: 233725.0 [2024-08-06 01:44:06,333][52662] Sum rewards: 57.819, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.346', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.234', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.924', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:06,415][52668] DAMAGECOUNT value on done: 229115.0 [2024-08-06 01:44:06,416][52668] Sum rewards: 60.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.146', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon4': '0.452', 'weapon2': '0.662', 'WEAPON3': '1.400', 'weapon3': '2.574', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:06,803][52820] DAMAGECOUNT value on done: 213720.0 [2024-08-06 01:44:06,804][52820] Sum rewards: 71.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.031', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.247', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '60.000'} [2024-08-06 01:44:06,963][52660] DAMAGECOUNT value on done: 230774.0 [2024-08-06 01:44:06,963][52660] Sum rewards: 67.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.032', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.142', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '0.850', 'weapon3': '3.026', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:07,522][52650] Updated weights for policy 0, policy_version 32651 (0.0025) [2024-08-06 01:44:07,591][52667] DAMAGECOUNT value on done: 234600.0 [2024-08-06 01:44:07,594][52667] Sum rewards: 67.871, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.858', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.682', 'WEAPON3': '1.500', 'weapon3': '2.548', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 267476992. Throughput: 0: 4374.2. Samples: 66873590. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:44:07,794][52567] Avg episode reward: [(0, '63.755')] [2024-08-06 01:44:07,942][52803] DAMAGECOUNT value on done: 215232.0 [2024-08-06 01:44:07,944][52803] Sum rewards: 61.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.190', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:08,436][52811] DAMAGECOUNT value on done: 215061.0 [2024-08-06 01:44:08,439][52811] Sum rewards: 73.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.135', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '61.000'} [2024-08-06 01:44:08,553][52647] DAMAGECOUNT value on done: 239929.0 [2024-08-06 01:44:08,553][52647] Sum rewards: 60.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.192', 'weapon5': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:08,962][52662] DAMAGECOUNT value on done: 238955.0 [2024-08-06 01:44:08,963][52662] Sum rewards: 66.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.396', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:09,569][52668] DAMAGECOUNT value on done: 231782.0 [2024-08-06 01:44:09,571][52668] Sum rewards: 56.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.404', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.156', 'AMMO3': '0.216', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '2.872', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:10,107][52820] DAMAGECOUNT value on done: 208622.0 [2024-08-06 01:44:10,108][52820] Sum rewards: 59.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.195', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.206', 'AMMO3': '0.214', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.842', 'WEAPON3': '1.300', 'weapon3': '2.388', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:10,118][52660] DAMAGECOUNT value on done: 230761.0 [2024-08-06 01:44:10,121][52660] Sum rewards: 56.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.379', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'weapon4': '0.454', 'weapon2': '0.532', 'WEAPON3': '0.950', 'weapon3': '2.768', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '45.000'} [2024-08-06 01:44:10,638][52667] DAMAGECOUNT value on done: 227470.0 [2024-08-06 01:44:10,638][52667] Sum rewards: 65.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.122', 'weapon5': '0.164', 'AMMO4': '0.166', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2024-08-06 01:44:11,170][52803] DAMAGECOUNT value on done: 218313.0 [2024-08-06 01:44:11,172][52803] Sum rewards: 64.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.900', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.096', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '53.000'} [2024-08-06 01:44:11,212][52662] DAMAGECOUNT value on done: 230920.0 [2024-08-06 01:44:11,212][52662] Sum rewards: 59.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '2.948', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:11,253][52647] DAMAGECOUNT value on done: 239545.0 [2024-08-06 01:44:11,261][52647] Sum rewards: 50.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.475', 'AMMO5': '0.015', 'AMMO2': '0.067', 'AMMO3': '0.220', 'weapon2': '0.262', 'weapon5': '0.278', 'AMMO4': '0.337', 'WEAPON5': '0.500', 'weapon4': '0.510', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.600', 'weapon3': '2.614', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '45.000'} [2024-08-06 01:44:11,486][52614] Signal inference workers to stop experience collection... (5900 times) [2024-08-06 01:44:11,486][52614] Signal inference workers to resume experience collection... (5900 times) [2024-08-06 01:44:11,579][52650] InferenceWorker_p0-w0: stopping experience collection (5900 times) [2024-08-06 01:44:11,589][52650] InferenceWorker_p0-w0: resuming experience collection (5900 times) [2024-08-06 01:44:11,605][52811] DAMAGECOUNT value on done: 217014.0 [2024-08-06 01:44:11,607][52811] Sum rewards: 64.755, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.615', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon2': '0.218', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.700', 'weapon3': '3.162', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:11,889][52650] Updated weights for policy 0, policy_version 32661 (0.0024) [2024-08-06 01:44:12,584][52669] DAMAGECOUNT value on done: 232634.0 [2024-08-06 01:44:12,586][52669] Sum rewards: 62.246, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.966', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:12,670][52668] DAMAGECOUNT value on done: 233218.0 [2024-08-06 01:44:12,671][52668] Sum rewards: 64.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.378', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 267567104. Throughput: 0: 4382.0. Samples: 66900130. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:44:12,802][52567] Avg episode reward: [(0, '63.338')] [2024-08-06 01:44:13,194][52660] DAMAGECOUNT value on done: 225631.0 [2024-08-06 01:44:13,194][52660] Sum rewards: 59.500, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.208', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:13,337][52820] DAMAGECOUNT value on done: 211145.0 [2024-08-06 01:44:13,337][52820] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.149', 'weapon4': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.752', 'WEAPON3': '1.000', 'weapon3': '2.834', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:13,431][52667] DAMAGECOUNT value on done: 228087.0 [2024-08-06 01:44:13,431][52667] Sum rewards: 61.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.126', 'weapon5': '0.140', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.574', 'WEAPON3': '0.950', 'HITCOUNT': '2.880', 'weapon3': '3.010', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:14,033][52662] DAMAGECOUNT value on done: 240680.0 [2024-08-06 01:44:14,033][52662] Sum rewards: 66.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.184', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '55.000'} [2024-08-06 01:44:14,217][52794] DAMAGECOUNT value on done: 233023.0 [2024-08-06 01:44:14,220][52794] Sum rewards: 58.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.422', 'WEAPON3': '1.000', 'weapon3': '3.032', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:14,283][52803] DAMAGECOUNT value on done: 214456.0 [2024-08-06 01:44:14,283][52803] Sum rewards: 57.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.069', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.514', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:14,520][52647] DAMAGECOUNT value on done: 244612.0 [2024-08-06 01:44:14,521][52647] Sum rewards: 79.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.819', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO4': '0.195', 'AMMO3': '0.225', 'weapon4': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '67.000'} [2024-08-06 01:44:14,657][52811] DAMAGECOUNT value on done: 212232.0 [2024-08-06 01:44:14,659][52811] Sum rewards: 56.716, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.232', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.114', 'AMMO4': '0.205', 'weapon4': '0.252', 'AMMO3': '0.303', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.866', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:14,846][52659] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:44:15,422][52669] DAMAGECOUNT value on done: 226003.0 [2024-08-06 01:44:15,424][52669] Sum rewards: 59.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.775', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.161', 'AMMO4': '0.213', 'weapon2': '0.294', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:15,652][52668] DAMAGECOUNT value on done: 227280.0 [2024-08-06 01:44:15,653][52668] Sum rewards: 80.206, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.830', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.122', 'weapon5': '0.134', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '67.000'} [2024-08-06 01:44:16,272][52660] DAMAGECOUNT value on done: 232472.0 [2024-08-06 01:44:16,275][52660] Sum rewards: 63.175, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.592', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.020', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '52.000'} [2024-08-06 01:44:16,425][52667] DAMAGECOUNT value on done: 232368.0 [2024-08-06 01:44:16,429][52667] Sum rewards: 66.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.335', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon4': '0.272', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '3.010', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:16,497][52820] DAMAGECOUNT value on done: 215628.0 [2024-08-06 01:44:16,498][52820] Sum rewards: 54.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.349', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.092', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.255', 'weapon4': '0.364', 'WEAPON4': '0.500', 'weapon2': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.618', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:17,036][52650] Updated weights for policy 0, policy_version 32671 (0.0016) [2024-08-06 01:44:17,104][52662] DAMAGECOUNT value on done: 230764.0 [2024-08-06 01:44:17,106][52662] Sum rewards: 64.304, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.535', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.118', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.776', 'WEAPON3': '1.000', 'weapon3': '2.798', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:17,119][52647] DAMAGECOUNT value on done: 238514.0 [2024-08-06 01:44:17,119][52647] Sum rewards: 71.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.058', 'AMMO3': '0.198', 'weapon5': '0.206', 'AMMO4': '0.291', 'WEAPON5': '0.350', 'weapon4': '0.370', 'weapon2': '0.386', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:17,392][52803] DAMAGECOUNT value on done: 212342.0 [2024-08-06 01:44:17,394][52803] Sum rewards: 60.782, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.433', 'weapon7': '0.002', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.277', 'weapon2': '0.480', 'WEAPON3': '1.600', 'weapon3': '3.142', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:17,420][52794] DAMAGECOUNT value on done: 236452.0 [2024-08-06 01:44:17,421][52794] Sum rewards: 71.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.084', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.032', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon5': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.560', 'WEAPON3': '0.950', 'weapon3': '3.046', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 267657216. Throughput: 0: 4380.9. Samples: 66913420. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:44:17,794][52567] Avg episode reward: [(0, '63.609')] [2024-08-06 01:44:17,903][52811] DAMAGECOUNT value on done: 219435.0 [2024-08-06 01:44:17,905][52811] Sum rewards: 67.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.277', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.136', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon5': '0.214', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.500', 'weapon3': '2.802', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:18,358][52668] DAMAGECOUNT value on done: 220992.0 [2024-08-06 01:44:18,359][52668] Sum rewards: 67.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.204', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:18,654][52669] DAMAGECOUNT value on done: 231469.0 [2024-08-06 01:44:18,654][52669] Sum rewards: 58.085, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.268', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '2.908', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '53.000'} [2024-08-06 01:44:18,804][52660] DAMAGECOUNT value on done: 234358.0 [2024-08-06 01:44:18,804][52660] Sum rewards: 70.971, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.492', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.084', 'AMMO4': '0.208', 'AMMO3': '0.228', 'weapon2': '0.294', 'WEAPON5': '0.300', 'ARMOR': '0.483', 'weapon4': '0.488', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '61.000'} [2024-08-06 01:44:19,299][52667] DAMAGECOUNT value on done: 232515.0 [2024-08-06 01:44:19,302][52667] Sum rewards: 63.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.478', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.171', 'weapon5': '0.188', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.450', 'weapon4': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:19,681][52820] DAMAGECOUNT value on done: 213116.0 [2024-08-06 01:44:19,681][52820] Sum rewards: 67.367, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.648', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.104', 'weapon5': '0.120', 'AMMO4': '0.203', 'weapon2': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.324', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:19,730][52647] DAMAGECOUNT value on done: 238857.0 [2024-08-06 01:44:19,730][52647] Sum rewards: 82.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.152', 'AMMO3': '0.231', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '69.000'} [2024-08-06 01:44:19,881][52662] DAMAGECOUNT value on done: 232170.0 [2024-08-06 01:44:19,881][52662] Sum rewards: 59.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.864', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.238', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.502', 'WEAPON3': '1.550', 'weapon3': '2.982', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:20,224][52794] DAMAGECOUNT value on done: 230637.0 [2024-08-06 01:44:20,225][52794] Sum rewards: 65.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '55.000'} [2024-08-06 01:44:20,533][52803] DAMAGECOUNT value on done: 221817.0 [2024-08-06 01:44:20,534][52803] Sum rewards: 55.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.005', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.113', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.394', 'WEAPON3': '1.700', 'weapon3': '3.080', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:20,963][52811] DAMAGECOUNT value on done: 215769.0 [2024-08-06 01:44:20,965][52811] Sum rewards: 63.414, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.635', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.123', 'weapon5': '0.196', 'AMMO4': '0.196', 'weapon2': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon4': '0.970', 'weapon3': '2.374', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:21,227][52668] DAMAGECOUNT value on done: 224899.0 [2024-08-06 01:44:21,229][52668] Sum rewards: 60.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.224', 'AMMO4': '0.225', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.164', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:21,517][52650] Updated weights for policy 0, policy_version 32681 (0.0025) [2024-08-06 01:44:21,657][52660] DAMAGECOUNT value on done: 234070.0 [2024-08-06 01:44:21,657][52660] Sum rewards: 69.855, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.484', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.150', 'weapon2': '0.276', 'AMMO3': '0.308', 'weapon4': '0.382', 'WEAPON3': '1.850', 'weapon3': '3.118', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '63.000'} [2024-08-06 01:44:21,678][52669] DAMAGECOUNT value on done: 230858.0 [2024-08-06 01:44:21,680][52669] Sum rewards: 80.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.116', 'AMMO3': '0.158', 'weapon2': '0.212', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.940', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.595', 'FRAGCOUNT': '65.000'} [2024-08-06 01:44:21,892][52667] DAMAGECOUNT value on done: 231552.0 [2024-08-06 01:44:21,893][52667] Sum rewards: 73.755, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.065', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO4': '0.227', 'AMMO3': '0.293', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.114', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '64.000'} [2024-08-06 01:44:22,461][52662] DAMAGECOUNT value on done: 229247.0 [2024-08-06 01:44:22,461][52662] Sum rewards: 74.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.541', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.181', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '62.000'} [2024-08-06 01:44:22,572][52647] DAMAGECOUNT value on done: 238779.0 [2024-08-06 01:44:22,572][52647] Sum rewards: 51.212, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.150', 'AMMO5': '0.026', 'AMMO2': '0.074', 'weapon5': '0.194', 'AMMO3': '0.254', 'AMMO4': '0.368', 'weapon2': '0.396', 'weapon4': '0.498', 'WEAPON5': '0.650', 'WEAPON4': '0.900', 'WEAPON3': '1.450', 'weapon3': '2.584', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.828', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:22,747][52820] DAMAGECOUNT value on done: 212810.0 [2024-08-06 01:44:22,751][52820] Sum rewards: 55.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.203', 'AMMO5': '0.003', 'ARMOR': '0.016', 'AMMO2': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.248', 'weapon4': '0.316', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.916', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 267747328. Throughput: 0: 4380.9. Samples: 66939500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:44:22,802][52567] Avg episode reward: [(0, '63.902')] [2024-08-06 01:44:22,808][52794] DAMAGECOUNT value on done: 231841.0 [2024-08-06 01:44:22,808][52794] Sum rewards: 69.797, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon4': '0.264', 'weapon2': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.196', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:23,656][52803] DAMAGECOUNT value on done: 212857.0 [2024-08-06 01:44:23,658][52803] Sum rewards: 49.579, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.334', 'AMMO5': '0.016', 'AMMO2': '0.064', 'AMMO3': '0.197', 'weapon5': '0.258', 'weapon2': '0.302', 'AMMO4': '0.321', 'WEAPON5': '0.350', 'weapon4': '0.602', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.522', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '43.500'} [2024-08-06 01:44:23,978][52811] DAMAGECOUNT value on done: 212016.0 [2024-08-06 01:44:23,978][52811] Sum rewards: 54.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.128', 'AMMO4': '0.179', 'AMMO3': '0.191', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.738', 'WEAPON3': '1.200', 'weapon3': '2.566', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '45.500'} [2024-08-06 01:44:24,433][52668] DAMAGECOUNT value on done: 224808.0 [2024-08-06 01:44:24,435][52668] Sum rewards: 72.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.554', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.161', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:24,547][52669] DAMAGECOUNT value on done: 228087.0 [2024-08-06 01:44:24,549][52669] Sum rewards: 40.068, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.122', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.312', 'weapon2': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.350', 'weapon3': '2.936', 'DAMAGECOUNT': '10.824', 'FRAGCOUNT': '31.500'} [2024-08-06 01:44:24,835][52660] DAMAGECOUNT value on done: 227455.0 [2024-08-06 01:44:24,838][52660] Sum rewards: 59.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.608', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.133', 'AMMO4': '0.191', 'weapon2': '0.256', 'weapon5': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.332', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:24,931][52667] DAMAGECOUNT value on done: 231520.0 [2024-08-06 01:44:24,932][52667] Sum rewards: 49.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.668', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.098', 'weapon4': '0.212', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '2.992', 'DAMAGECOUNT': '13.098', 'FRAGCOUNT': '44.000'} [2024-08-06 01:44:25,499][52662] DAMAGECOUNT value on done: 237541.0 [2024-08-06 01:44:25,502][52662] Sum rewards: 49.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.134', 'AMMO3': '0.158', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.588', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.380', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '12.327', 'FRAGCOUNT': '41.000'} [2024-08-06 01:44:25,710][52647] DAMAGECOUNT value on done: 234523.0 [2024-08-06 01:44:25,711][52647] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.614', 'AMMO5': '0.012', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.104', 'weapon4': '0.110', 'AMMO4': '0.150', 'weapon2': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.296', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:25,852][52820] DAMAGECOUNT value on done: 213835.0 [2024-08-06 01:44:25,853][52820] Sum rewards: 56.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.200', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.102', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon4': '0.344', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.550', 'weapon3': '2.732', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:25,887][52794] DAMAGECOUNT value on done: 230251.0 [2024-08-06 01:44:25,889][52794] Sum rewards: 61.584, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.011', 'AMMO2': '0.057', 'weapon5': '0.126', 'weapon4': '0.216', 'AMMO3': '0.238', 'AMMO4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.996', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:26,040][52650] Updated weights for policy 0, policy_version 32691 (0.0041) [2024-08-06 01:44:26,374][52667] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:44:26,805][52803] DAMAGECOUNT value on done: 218540.0 [2024-08-06 01:44:26,805][52803] Sum rewards: 51.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.161', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.142', 'weapon4': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon2': '1.012', 'weapon3': '2.510', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '43.000'} [2024-08-06 01:44:26,949][52811] DAMAGECOUNT value on done: 213807.0 [2024-08-06 01:44:26,949][52811] Sum rewards: 60.795, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.189', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.168', 'weapon2': '0.334', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.448', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:27,372][52669] DAMAGECOUNT value on done: 229165.0 [2024-08-06 01:44:27,374][52669] Sum rewards: 61.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.768', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.096', 'weapon4': '0.136', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.570', 'WEAPON3': '1.600', 'weapon3': '2.898', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:27,436][52668] DAMAGECOUNT value on done: 229372.0 [2024-08-06 01:44:27,439][52668] Sum rewards: 62.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.863', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.111', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:27,786][52660] DAMAGECOUNT value on done: 236634.0 [2024-08-06 01:44:27,789][52660] Sum rewards: 72.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.626', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.222', 'weapon2': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '60.000'} [2024-08-06 01:44:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 267829248. Throughput: 0: 4382.0. Samples: 66965850. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:44:27,794][52567] Avg episode reward: [(0, '63.496')] [2024-08-06 01:44:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032694_267829248.pth... [2024-08-06 01:44:27,950][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032180_263618560.pth [2024-08-06 01:44:28,082][52667] DAMAGECOUNT value on done: 227267.0 [2024-08-06 01:44:28,083][52667] Sum rewards: 79.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.258', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '64.000'} [2024-08-06 01:44:28,333][52662] DAMAGECOUNT value on done: 234118.0 [2024-08-06 01:44:28,334][52662] Sum rewards: 65.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.872', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.306', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '52.000'} [2024-08-06 01:44:28,507][52647] DAMAGECOUNT value on done: 242220.0 [2024-08-06 01:44:28,507][52647] Sum rewards: 59.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.296', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.042', 'AMMO4': '0.159', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.174', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:28,758][52794] DAMAGECOUNT value on done: 233321.0 [2024-08-06 01:44:28,759][52794] Sum rewards: 82.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.845', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.050', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '67.000'} [2024-08-06 01:44:29,164][52820] DAMAGECOUNT value on done: 216672.0 [2024-08-06 01:44:29,166][52820] Sum rewards: 75.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.878', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.104', 'AMMO4': '0.113', 'weapon5': '0.130', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '62.000'} [2024-08-06 01:44:29,868][52669] DAMAGECOUNT value on done: 231038.0 [2024-08-06 01:44:29,869][52669] Sum rewards: 55.826, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.066', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon5': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.406', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.764', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '46.000'} [2024-08-06 01:44:29,928][52811] DAMAGECOUNT value on done: 218141.0 [2024-08-06 01:44:29,928][52811] Sum rewards: 59.465, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.148', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO3': '0.145', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.336', 'WEAPON4': '0.350', 'weapon2': '0.732', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.187', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:30,061][52803] DAMAGECOUNT value on done: 209584.0 [2024-08-06 01:44:30,061][52803] Sum rewards: 58.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.624', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.174', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:30,349][52668] DAMAGECOUNT value on done: 225489.0 [2024-08-06 01:44:30,350][52668] Sum rewards: 67.868, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.138', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'weapon4': '0.138', 'weapon2': '0.208', 'AMMO3': '0.296', 'WEAPON3': '1.700', 'weapon3': '3.378', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '61.000'} [2024-08-06 01:44:30,596][52660] DAMAGECOUNT value on done: 221459.0 [2024-08-06 01:44:30,597][52660] Sum rewards: 62.766, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.155', 'WEAPON4': '0.350', 'weapon4': '0.572', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.464', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:30,832][52650] Updated weights for policy 0, policy_version 32701 (0.0023) [2024-08-06 01:44:30,870][52662] DAMAGECOUNT value on done: 239596.0 [2024-08-06 01:44:30,871][52662] Sum rewards: 59.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.412', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.198', 'weapon5': '0.212', 'AMMO4': '0.284', 'weapon4': '0.360', 'weapon2': '0.370', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.704', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:30,927][52664] DAMAGECOUNT value on done: 235641.0 [2024-08-06 01:44:30,929][52664] Sum rewards: 55.572, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.622', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'weapon4': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.270', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:31,245][52667] DAMAGECOUNT value on done: 235437.0 [2024-08-06 01:44:31,245][52667] Sum rewards: 63.381, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.455', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.102', 'AMMO3': '0.207', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.428', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '52.000'} [2024-08-06 01:44:31,264][52794] DAMAGECOUNT value on done: 236262.0 [2024-08-06 01:44:31,264][52794] Sum rewards: 62.652, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.505', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.148', 'WEAPON3': '0.900', 'weapon2': '0.924', 'weapon3': '2.848', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:32,355][52820] DAMAGECOUNT value on done: 213039.0 [2024-08-06 01:44:32,356][52820] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.048', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.257', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.382', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:32,543][52669] DAMAGECOUNT value on done: 230334.0 [2024-08-06 01:44:32,546][52669] Sum rewards: 57.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.744', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.096', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.216', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 267911168. Throughput: 0: 4383.6. Samples: 66978940. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:44:32,794][52567] Avg episode reward: [(0, '63.600')] [2024-08-06 01:44:33,018][52811] DAMAGECOUNT value on done: 213370.0 [2024-08-06 01:44:33,019][52811] Sum rewards: 52.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon4': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.082', 'DAMAGECOUNT': '13.095', 'FRAGCOUNT': '46.000'} [2024-08-06 01:44:33,303][52668] DAMAGECOUNT value on done: 232233.0 [2024-08-06 01:44:33,308][52668] Sum rewards: 55.143, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.766', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.176', 'AMMO3': '0.196', 'weapon4': '0.236', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.110', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:33,580][52662] DAMAGECOUNT value on done: 230466.0 [2024-08-06 01:44:33,581][52662] Sum rewards: 62.957, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.630', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.122', 'WEAPON5': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.297', 'weapon4': '0.298', 'WEAPON3': '1.800', 'weapon3': '3.078', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:33,645][52660] DAMAGECOUNT value on done: 227923.0 [2024-08-06 01:44:33,646][52660] Sum rewards: 68.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.252', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.074', 'AMMO3': '0.240', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:33,881][52794] DAMAGECOUNT value on done: 231993.0 [2024-08-06 01:44:33,883][52794] Sum rewards: 65.749, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.259', 'weapon2': '0.272', 'weapon4': '0.278', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:33,954][52667] DAMAGECOUNT value on done: 239799.0 [2024-08-06 01:44:33,955][52667] Sum rewards: 61.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.052', 'weapon4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.444', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.264', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 01:44:34,052][52664] DAMAGECOUNT value on done: 238281.0 [2024-08-06 01:44:34,052][52664] Sum rewards: 72.737, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.622', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '62.000'} [2024-08-06 01:44:35,135][52669] DAMAGECOUNT value on done: 231167.0 [2024-08-06 01:44:35,135][52669] Sum rewards: 68.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.165', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.158', 'weapon4': '0.160', 'AMMO3': '0.181', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:35,404][52820] DAMAGECOUNT value on done: 212024.0 [2024-08-06 01:44:35,406][52820] Sum rewards: 48.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.122', 'AMMO3': '0.162', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.000', 'HITCOUNT': '2.540', 'weapon3': '2.668', 'DAMAGECOUNT': '12.285', 'FRAGCOUNT': '42.000'} [2024-08-06 01:44:35,672][52650] Updated weights for policy 0, policy_version 32711 (0.0013) [2024-08-06 01:44:36,040][52811] DAMAGECOUNT value on done: 219325.0 [2024-08-06 01:44:36,041][52811] Sum rewards: 71.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.644', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 01:44:36,247][52664] DAMAGECOUNT value on done: 239877.0 [2024-08-06 01:44:36,248][52664] Sum rewards: 71.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.778', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.097', 'weapon2': '0.190', 'AMMO3': '0.220', 'WEAPON3': '1.450', 'HITCOUNT': '3.440', 'weapon3': '3.462', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '60.000'} [2024-08-06 01:44:36,307][52658] DAMAGECOUNT value on done: 233918.0 [2024-08-06 01:44:36,308][52658] Sum rewards: 64.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.635', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'weapon4': '0.190', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '54.500'} [2024-08-06 01:44:36,369][52668] DAMAGECOUNT value on done: 233178.0 [2024-08-06 01:44:36,369][52668] Sum rewards: 85.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.196', 'weapon2': '0.238', 'WEAPON3': '1.150', 'weapon3': '3.640', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '69.000'} [2024-08-06 01:44:36,578][52662] DAMAGECOUNT value on done: 233688.0 [2024-08-06 01:44:36,580][52662] Sum rewards: 54.859, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.832', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon2': '0.236', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'HITCOUNT': '2.910', 'weapon3': '3.532', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:36,644][52667] DAMAGECOUNT value on done: 233114.0 [2024-08-06 01:44:36,645][52667] Sum rewards: 55.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.020', 'AMMO4': '0.049', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.210', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.554', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '46.000'} [2024-08-06 01:44:36,678][52660] DAMAGECOUNT value on done: 235752.0 [2024-08-06 01:44:36,680][52660] Sum rewards: 84.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.418', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.144', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '68.000'} [2024-08-06 01:44:36,952][52794] DAMAGECOUNT value on done: 238234.0 [2024-08-06 01:44:36,953][52794] Sum rewards: 64.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.255', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO4': '0.151', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.154', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '54.000'} [2024-08-06 01:44:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 268009472. Throughput: 0: 4386.4. Samples: 67005320. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:44:37,794][52567] Avg episode reward: [(0, '63.652')] [2024-08-06 01:44:38,065][52669] DAMAGECOUNT value on done: 225779.0 [2024-08-06 01:44:38,065][52669] Sum rewards: 67.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.295', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.244', 'weapon2': '0.336', 'WEAPON3': '1.500', 'HITCOUNT': '3.370', 'weapon3': '3.440', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:38,511][52820] DAMAGECOUNT value on done: 215155.0 [2024-08-06 01:44:38,512][52820] Sum rewards: 62.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.190', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '52.000'} [2024-08-06 01:44:38,956][52664] DAMAGECOUNT value on done: 237435.0 [2024-08-06 01:44:38,957][52664] Sum rewards: 73.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.305', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.112', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.264', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '63.000'} [2024-08-06 01:44:39,240][52668] DAMAGECOUNT value on done: 229189.0 [2024-08-06 01:44:39,241][52668] Sum rewards: 52.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.272', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.908', 'WEAPON3': '1.200', 'weapon3': '2.472', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.140', 'FRAGCOUNT': '45.000'} [2024-08-06 01:44:39,260][52658] DAMAGECOUNT value on done: 233131.0 [2024-08-06 01:44:39,260][52658] Sum rewards: 55.683, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.968', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.100', 'AMMO3': '0.190', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.920', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:39,405][52662] DAMAGECOUNT value on done: 231551.0 [2024-08-06 01:44:39,405][52662] Sum rewards: 62.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.184', 'AMMO3': '0.199', 'AMMO4': '0.210', 'weapon4': '0.344', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '52.500'} [2024-08-06 01:44:39,493][52667] DAMAGECOUNT value on done: 236522.0 [2024-08-06 01:44:39,495][52667] Sum rewards: 65.309, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.582', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.115', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.380', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '52.000'} [2024-08-06 01:44:39,518][52660] DAMAGECOUNT value on done: 239326.0 [2024-08-06 01:44:39,520][52660] Sum rewards: 55.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.798', 'AMMO5': '0.012', 'AMMO2': '0.074', 'AMMO3': '0.191', 'weapon5': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.352', 'AMMO4': '0.371', 'WEAPON4': '0.550', 'weapon4': '0.860', 'WEAPON3': '1.100', 'weapon3': '2.218', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:39,728][52794] DAMAGECOUNT value on done: 235928.0 [2024-08-06 01:44:39,729][52794] Sum rewards: 58.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.230', 'AMMO3': '0.234', 'AMMO4': '0.244', 'weapon4': '0.406', 'weapon2': '0.446', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.552', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:39,892][52650] Updated weights for policy 0, policy_version 32721 (0.0021) [2024-08-06 01:44:40,863][52669] DAMAGECOUNT value on done: 231356.0 [2024-08-06 01:44:40,865][52669] Sum rewards: 50.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.132', 'AMMO3': '0.217', 'AMMO4': '0.250', 'weapon2': '0.438', 'WEAPON5': '0.450', 'weapon4': '0.480', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.628', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '46.000'} [2024-08-06 01:44:41,519][52820] DAMAGECOUNT value on done: 213859.0 [2024-08-06 01:44:41,527][52820] Sum rewards: 51.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.044', 'weapon7': '0.080', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'AMMO3': '0.175', 'WEAPON7': '0.200', 'weapon2': '0.220', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon4': '1.234', 'weapon3': '2.158', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.368', 'FRAGCOUNT': '42.000'} [2024-08-06 01:44:41,914][52662] DAMAGECOUNT value on done: 228823.0 [2024-08-06 01:44:41,915][52662] Sum rewards: 61.194, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.836', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.060', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.316', 'WEAPON3': '1.700', 'weapon3': '3.290', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:41,925][52660] DAMAGECOUNT value on done: 226261.0 [2024-08-06 01:44:41,925][52660] Sum rewards: 79.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.228', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.293', 'weapon2': '0.368', 'WEAPON3': '1.800', 'weapon3': '3.336', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '71.000'} [2024-08-06 01:44:42,174][52664] DAMAGECOUNT value on done: 239372.0 [2024-08-06 01:44:42,174][52664] Sum rewards: 63.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.216', 'AMMO5': '0.005', 'ARMOR': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.209', 'weapon4': '0.242', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.500', 'weapon3': '2.746', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '55.000'} [2024-08-06 01:44:42,230][52658] DAMAGECOUNT value on done: 233403.0 [2024-08-06 01:44:42,231][52658] Sum rewards: 52.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.141', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.746', 'WEAPON3': '0.900', 'weapon3': '2.472', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '44.000'} [2024-08-06 01:44:42,358][52794] DAMAGECOUNT value on done: 233266.0 [2024-08-06 01:44:42,359][52794] Sum rewards: 57.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'AMMO4': '0.227', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:42,452][52667] DAMAGECOUNT value on done: 226580.0 [2024-08-06 01:44:42,452][52667] Sum rewards: 68.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.048', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.208', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.5, 300 sec: 17550.3). Total num frames: 268099584. Throughput: 0: 4388.9. Samples: 67031690. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 01:44:42,794][52567] Avg episode reward: [(0, '63.446')] [2024-08-06 01:44:43,774][52669] DAMAGECOUNT value on done: 234472.0 [2024-08-06 01:44:43,775][52669] Sum rewards: 78.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '63.000'} [2024-08-06 01:44:44,704][52820] DAMAGECOUNT value on done: 209200.0 [2024-08-06 01:44:44,706][52820] Sum rewards: 66.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.132', 'AMMO4': '0.169', 'weapon5': '0.184', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 01:44:44,793][52660] DAMAGECOUNT value on done: 231622.0 [2024-08-06 01:44:44,794][52660] Sum rewards: 60.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO4': '0.184', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.752', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '51.000'} [2024-08-06 01:44:44,854][52650] Updated weights for policy 0, policy_version 32731 (0.0014) [2024-08-06 01:44:44,926][52664] DAMAGECOUNT value on done: 239606.0 [2024-08-06 01:44:44,927][52664] Sum rewards: 48.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.218', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.088', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'AMMO4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.400', 'HITCOUNT': '2.510', 'weapon3': '3.162', 'DAMAGECOUNT': '12.357', 'FRAGCOUNT': '43.000'} [2024-08-06 01:44:45,084][52658] DAMAGECOUNT value on done: 232498.0 [2024-08-06 01:44:45,086][52658] Sum rewards: 67.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.805', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.086', 'weapon5': '0.086', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'weapon3': '3.338', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '58.000'} [2024-08-06 01:44:45,291][52794] DAMAGECOUNT value on done: 230486.0 [2024-08-06 01:44:45,291][52794] Sum rewards: 48.288, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.524', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.142', 'AMMO3': '0.236', 'AMMO4': '0.260', 'weapon2': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.530', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '2.742', 'DAMAGECOUNT': '13.317', 'FRAGCOUNT': '43.000'} [2024-08-06 01:44:45,336][52667] DAMAGECOUNT value on done: 233678.0 [2024-08-06 01:44:45,337][52667] Sum rewards: 49.480, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.782', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon4': '0.238', 'weapon2': '0.424', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '2.990', 'DAMAGECOUNT': '12.753', 'FRAGCOUNT': '43.000'} [2024-08-06 01:44:46,512][52669] DAMAGECOUNT value on done: 228209.0 [2024-08-06 01:44:46,512][52669] Sum rewards: 74.020, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.626', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.090', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '65.000'} [2024-08-06 01:44:47,767][52660] DAMAGECOUNT value on done: 221691.0 [2024-08-06 01:44:47,768][52660] Sum rewards: 60.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.904', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.052', 'AMMO4': '0.166', 'AMMO3': '0.218', 'weapon5': '0.240', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '52.000'} [2024-08-06 01:44:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 268181504. Throughput: 0: 4388.0. Samples: 67044920. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 01:44:47,794][52567] Avg episode reward: [(0, '63.334')] [2024-08-06 01:44:47,907][52664] DAMAGECOUNT value on done: 244195.0 [2024-08-06 01:44:47,908][52664] Sum rewards: 69.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.104', 'AMMO3': '0.248', 'weapon2': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '60.000'} [2024-08-06 01:44:47,997][52820] DAMAGECOUNT value on done: 219342.0 [2024-08-06 01:44:47,999][52820] Sum rewards: 72.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.274', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '60.000'} [2024-08-06 01:44:48,016][52658] DAMAGECOUNT value on done: 233010.0 [2024-08-06 01:44:48,016][52658] Sum rewards: 62.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.333', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.110', 'AMMO3': '0.189', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '53.000'} [2024-08-06 01:44:48,032][52794] DAMAGECOUNT value on done: 229655.0 [2024-08-06 01:44:48,033][52794] Sum rewards: 68.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '57.000'} [2024-08-06 01:44:48,414][52660] Large shaping reward 2.570 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.549, 183.0), ('HEALTH', -0.03, -10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:44:49,293][52650] Updated weights for policy 0, policy_version 32741 (0.0012) [2024-08-06 01:44:49,455][52669] DAMAGECOUNT value on done: 232817.0 [2024-08-06 01:44:49,457][52669] Sum rewards: 55.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'weapon4': '0.424', 'weapon2': '0.546', 'WEAPON3': '1.500', 'weapon3': '2.662', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '49.000'} [2024-08-06 01:44:50,480][52664] DAMAGECOUNT value on done: 234514.0 [2024-08-06 01:44:50,480][52664] Sum rewards: 76.037, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.764', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.230', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.478', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '65.000'} [2024-08-06 01:44:50,685][52660] DAMAGECOUNT value on done: 230557.0 [2024-08-06 01:44:50,685][52660] Sum rewards: 60.430, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.108', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.350', 'weapon2': '0.740', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '48.000'} [2024-08-06 01:44:51,043][52658] DAMAGECOUNT value on done: 229872.0 [2024-08-06 01:44:51,043][52658] Sum rewards: 67.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.328', 'AMMO5': '0.012', 'AMMO2': '0.061', 'weapon5': '0.126', 'AMMO3': '0.215', 'weapon2': '0.218', 'WEAPON5': '0.300', 'AMMO4': '0.304', 'weapon4': '0.368', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:51,128][52820] DAMAGECOUNT value on done: 222119.0 [2024-08-06 01:44:51,128][52820] Sum rewards: 69.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.630', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.125', 'weapon4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.380', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '59.000'} [2024-08-06 01:44:51,180][52794] DAMAGECOUNT value on done: 240990.0 [2024-08-06 01:44:51,181][52794] Sum rewards: 54.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.024', 'AMMO4': '0.067', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.372', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.352', 'DAMAGECOUNT': '13.533', 'FRAGCOUNT': '46.000'} [2024-08-06 01:44:52,559][52669] DAMAGECOUNT value on done: 234502.0 [2024-08-06 01:44:52,559][52669] Sum rewards: 59.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.045', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.332', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 268271616. Throughput: 0: 4402.9. Samples: 67071720. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 01:44:52,794][52567] Avg episode reward: [(0, '63.127')] [2024-08-06 01:44:52,826][52666] DAMAGECOUNT value on done: 235034.0 [2024-08-06 01:44:52,826][52666] Sum rewards: 62.005, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '2.748', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '56.000'} [2024-08-06 01:44:53,025][52664] DAMAGECOUNT value on done: 247270.0 [2024-08-06 01:44:53,027][52664] Sum rewards: 70.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon4': '0.290', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '58.000'} [2024-08-06 01:44:53,662][52660] DAMAGECOUNT value on done: 226789.0 [2024-08-06 01:44:53,662][52660] Sum rewards: 46.672, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.366', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.139', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.570', 'weapon4': '0.590', 'WEAPON3': '0.900', 'HITCOUNT': '2.440', 'weapon3': '2.460', 'DAMAGECOUNT': '11.403', 'FRAGCOUNT': '37.000'} [2024-08-06 01:44:53,932][52650] Updated weights for policy 0, policy_version 32751 (0.0015) [2024-08-06 01:44:54,080][52658] DAMAGECOUNT value on done: 238343.0 [2024-08-06 01:44:54,080][52658] Sum rewards: 70.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.827', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.228', 'WEAPON3': '1.300', 'HITCOUNT': '3.350', 'weapon3': '3.356', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '60.000'} [2024-08-06 01:44:54,254][52794] DAMAGECOUNT value on done: 229018.0 [2024-08-06 01:44:54,255][52794] Sum rewards: 74.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.316', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '62.000'} [2024-08-06 01:44:54,258][52820] DAMAGECOUNT value on done: 211555.0 [2024-08-06 01:44:54,259][52820] Sum rewards: 63.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.152', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'AMMO4': '0.254', 'weapon4': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '2.774', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '53.000'} [2024-08-06 01:44:55,318][52669] DAMAGECOUNT value on done: 244420.0 [2024-08-06 01:44:55,319][52669] Sum rewards: 70.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.124', 'weapon5': '0.124', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 01:44:55,512][52666] DAMAGECOUNT value on done: 234991.0 [2024-08-06 01:44:55,514][52666] Sum rewards: 58.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.334', 'AMMO5': '0.004', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.025', 'weapon4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.251', 'weapon2': '0.524', 'WEAPON3': '1.600', 'weapon3': '3.226', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '50.000'} [2024-08-06 01:44:55,662][52664] DAMAGECOUNT value on done: 241633.0 [2024-08-06 01:44:55,664][52664] Sum rewards: 71.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.860', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.056', 'AMMO4': '0.086', 'weapon5': '0.114', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.290', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '62.000'} [2024-08-06 01:44:57,112][52658] DAMAGECOUNT value on done: 225303.0 [2024-08-06 01:44:57,112][52658] Sum rewards: 57.938, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.575', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.258', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '47.000'} [2024-08-06 01:44:57,689][52794] DAMAGECOUNT value on done: 240020.0 [2024-08-06 01:44:57,689][52794] Sum rewards: 63.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.120', 'AMMO4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.368', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '53.000'} [2024-08-06 01:44:57,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 268361728. Throughput: 0: 4392.0. Samples: 67097770. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 01:44:57,795][52567] Avg episode reward: [(0, '62.788')] [2024-08-06 01:44:58,166][52666] DAMAGECOUNT value on done: 234188.0 [2024-08-06 01:44:58,166][52666] Sum rewards: 67.530, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.290', 'weapon2': '0.390', 'HEALTH': '0.734', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '55.000'} [2024-08-06 01:44:58,318][52669] DAMAGECOUNT value on done: 229027.0 [2024-08-06 01:44:58,319][52669] Sum rewards: 57.760, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.839', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.298', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON3': '0.750', 'weapon3': '2.810', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '46.000'} [2024-08-06 01:44:58,437][52664] DAMAGECOUNT value on done: 241443.0 [2024-08-06 01:44:58,439][52664] Sum rewards: 50.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.822', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.334', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.174', 'FRAGCOUNT': '44.000'} [2024-08-06 01:44:58,882][52650] Updated weights for policy 0, policy_version 32761 (0.0020) [2024-08-06 01:44:59,624][52658] DAMAGECOUNT value on done: 236075.0 [2024-08-06 01:44:59,624][52658] Sum rewards: 75.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.198', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.136', 'weapon4': '0.144', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '63.000'} [2024-08-06 01:45:00,598][52794] DAMAGECOUNT value on done: 234418.0 [2024-08-06 01:45:00,599][52794] Sum rewards: 63.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.741', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.186', 'AMMO3': '0.201', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:01,033][52666] DAMAGECOUNT value on done: 229500.0 [2024-08-06 01:45:01,034][52666] Sum rewards: 57.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.088', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '49.000'} [2024-08-06 01:45:01,093][52664] DAMAGECOUNT value on done: 239235.0 [2024-08-06 01:45:01,094][52664] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon4': '0.260', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '61.000'} [2024-08-06 01:45:01,526][52669] DAMAGECOUNT value on done: 235942.0 [2024-08-06 01:45:01,527][52669] Sum rewards: 53.979, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.082', 'weapon4': '0.160', 'AMMO3': '0.207', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.288', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '46.000'} [2024-08-06 01:45:02,351][52658] DAMAGECOUNT value on done: 234272.0 [2024-08-06 01:45:02,353][52658] Sum rewards: 58.353, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.220', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.252', 'weapon2': '0.556', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.208', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:02,393][52670] DAMAGECOUNT value on done: 227144.0 [2024-08-06 01:45:02,394][52670] Sum rewards: 52.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.283', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.148', 'weapon5': '0.180', 'AMMO4': '0.276', 'weapon4': '0.298', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.852', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '46.000'} [2024-08-06 01:45:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 268443648. Throughput: 0: 4386.9. Samples: 67110830. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:45:02,802][52567] Avg episode reward: [(0, '63.115')] [2024-08-06 01:45:03,499][52671] DAMAGECOUNT value on done: 236364.0 [2024-08-06 01:45:03,499][52671] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.085', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.762', 'WEAPON3': '1.250', 'weapon3': '2.802', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:03,547][52650] Updated weights for policy 0, policy_version 32771 (0.0027) [2024-08-06 01:45:03,756][52794] DAMAGECOUNT value on done: 234811.0 [2024-08-06 01:45:03,758][52794] Sum rewards: 64.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.166', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon2': '0.240', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'HITCOUNT': '3.340', 'weapon3': '3.432', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '55.000'} [2024-08-06 01:45:03,812][52664] DAMAGECOUNT value on done: 239745.0 [2024-08-06 01:45:03,813][52664] Sum rewards: 62.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.100', 'weapon5': '0.190', 'AMMO4': '0.203', 'AMMO3': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:03,826][52666] DAMAGECOUNT value on done: 226968.0 [2024-08-06 01:45:03,826][52666] Sum rewards: 75.368, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.009', 'weapon4': '0.022', 'weapon5': '0.038', 'AMMO2': '0.045', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.346', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '64.000'} [2024-08-06 01:45:03,896][52669] DAMAGECOUNT value on done: 236223.0 [2024-08-06 01:45:03,897][52669] Sum rewards: 59.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.256', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:05,082][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:45:05,364][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:45:05,426][52658] DAMAGECOUNT value on done: 237883.0 [2024-08-06 01:45:05,426][52658] Sum rewards: 64.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.819', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.106', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.122', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 01:45:05,528][52670] DAMAGECOUNT value on done: 233156.0 [2024-08-06 01:45:05,528][52670] Sum rewards: 59.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.612', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.116', 'AMMO3': '0.207', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.656', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:06,109][52664] DAMAGECOUNT value on done: 238025.0 [2024-08-06 01:45:06,110][52664] Sum rewards: 53.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.086', 'AMMO3': '0.247', 'AMMO4': '0.262', 'weapon2': '0.344', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '2.984', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '46.000'} [2024-08-06 01:45:06,132][52669] DAMAGECOUNT value on done: 239004.0 [2024-08-06 01:45:06,133][52669] Sum rewards: 68.857, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.325', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon2': '0.226', 'AMMO3': '0.284', 'WEAPON3': '1.750', 'weapon3': '3.466', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '61.000'} [2024-08-06 01:45:06,566][52671] DAMAGECOUNT value on done: 230163.0 [2024-08-06 01:45:06,568][52671] Sum rewards: 68.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '57.000'} [2024-08-06 01:45:06,888][52794] DAMAGECOUNT value on done: 242829.0 [2024-08-06 01:45:06,890][52794] Sum rewards: 57.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.979', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.172', 'weapon4': '0.232', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.744', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '48.000'} [2024-08-06 01:45:06,903][52666] DAMAGECOUNT value on done: 222802.0 [2024-08-06 01:45:06,903][52666] Sum rewards: 66.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.196', 'weapon2': '0.216', 'weapon5': '0.218', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '54.500'} [2024-08-06 01:45:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 268533760. Throughput: 0: 4398.4. Samples: 67137430. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:45:07,803][52567] Avg episode reward: [(0, '63.227')] [2024-08-06 01:45:07,812][52650] Updated weights for policy 0, policy_version 32781 (0.0050) [2024-08-06 01:45:08,289][52670] DAMAGECOUNT value on done: 226689.0 [2024-08-06 01:45:08,290][52670] Sum rewards: 60.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.692', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon5': '0.204', 'AMMO3': '0.221', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '52.000'} [2024-08-06 01:45:08,520][52658] DAMAGECOUNT value on done: 224046.0 [2024-08-06 01:45:08,520][52658] Sum rewards: 49.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.100', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.208', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '3.256', 'DAMAGECOUNT': '12.786', 'FRAGCOUNT': '42.000'} [2024-08-06 01:45:09,033][52664] DAMAGECOUNT value on done: 242076.0 [2024-08-06 01:45:09,033][52664] Sum rewards: 62.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.635', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.030', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.178', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:09,048][52671] DAMAGECOUNT value on done: 234347.0 [2024-08-06 01:45:09,048][52671] Sum rewards: 63.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.652', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.205', 'weapon5': '0.246', 'weapon4': '0.336', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.682', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:09,778][52666] DAMAGECOUNT value on done: 232310.0 [2024-08-06 01:45:09,778][52666] Sum rewards: 72.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.223', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.450', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '60.000'} [2024-08-06 01:45:09,965][52794] DAMAGECOUNT value on done: 234179.0 [2024-08-06 01:45:09,965][52794] Sum rewards: 76.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.180', 'AMMO4': '0.213', 'AMMO3': '0.217', 'weapon2': '0.226', 'weapon4': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '67.000'} [2024-08-06 01:45:11,278][52658] DAMAGECOUNT value on done: 230820.0 [2024-08-06 01:45:11,280][52658] Sum rewards: 72.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.455', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'AMMO4': '0.238', 'weapon2': '0.396', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '60.000'} [2024-08-06 01:45:11,480][52670] DAMAGECOUNT value on done: 226586.0 [2024-08-06 01:45:11,482][52670] Sum rewards: 54.278, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.085', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.007', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.288', 'weapon2': '0.482', 'weapon4': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.342', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '44.000'} [2024-08-06 01:45:11,530][52671] DAMAGECOUNT value on done: 230563.0 [2024-08-06 01:45:11,531][52671] Sum rewards: 62.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.691', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.262', 'AMMO4': '0.270', 'weapon4': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.890', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '55.000'} [2024-08-06 01:45:11,633][52664] DAMAGECOUNT value on done: 237014.0 [2024-08-06 01:45:11,633][52664] Sum rewards: 63.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.738', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.152', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:12,711][52650] Updated weights for policy 0, policy_version 32791 (0.0012) [2024-08-06 01:45:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 268623872. Throughput: 0: 4396.7. Samples: 67163700. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:45:12,794][52567] Avg episode reward: [(0, '63.185')] [2024-08-06 01:45:12,853][52666] DAMAGECOUNT value on done: 229758.0 [2024-08-06 01:45:12,857][52666] Sum rewards: 62.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.271', 'weapon2': '0.468', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '55.000'} [2024-08-06 01:45:14,185][52671] DAMAGECOUNT value on done: 236132.0 [2024-08-06 01:45:14,186][52671] Sum rewards: 61.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.148', 'AMMO3': '0.179', 'AMMO4': '0.208', 'weapon4': '0.334', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:14,424][52658] DAMAGECOUNT value on done: 231000.0 [2024-08-06 01:45:14,424][52658] Sum rewards: 60.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.136', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.340', 'weapon4': '0.372', 'WEAPON3': '1.050', 'weapon3': '2.864', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:14,482][52664] DAMAGECOUNT value on done: 242246.0 [2024-08-06 01:45:14,483][52664] Sum rewards: 65.604, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.546', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.221', 'weapon2': '0.222', 'AMMO3': '0.247', 'weapon4': '0.364', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '58.000'} [2024-08-06 01:45:14,575][52670] DAMAGECOUNT value on done: 230664.0 [2024-08-06 01:45:14,577][52670] Sum rewards: 67.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.008', 'weapon5': '0.024', 'AMMO2': '0.047', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.218', 'AMMO4': '0.235', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.210', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '56.000'} [2024-08-06 01:45:15,925][52666] DAMAGECOUNT value on done: 229835.0 [2024-08-06 01:45:15,927][52666] Sum rewards: 66.980, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 01:45:16,980][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:45:17,146][52664] DAMAGECOUNT value on done: 242313.0 [2024-08-06 01:45:17,146][52664] Sum rewards: 55.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.156', 'weapon2': '0.196', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.450', 'weapon3': '2.712', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.725', 'FRAGCOUNT': '48.000'} [2024-08-06 01:45:17,173][52671] DAMAGECOUNT value on done: 232691.0 [2024-08-06 01:45:17,175][52671] Sum rewards: 61.163, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.072', 'weapon5': '0.092', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.254', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.364', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '54.000'} [2024-08-06 01:45:17,248][52650] Updated weights for policy 0, policy_version 32801 (0.0014) [2024-08-06 01:45:17,303][52670] DAMAGECOUNT value on done: 230198.0 [2024-08-06 01:45:17,303][52670] Sum rewards: 49.171, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.799', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.102', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'AMMO4': '0.307', 'weapon2': '0.552', 'weapon4': '0.614', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '44.000'} [2024-08-06 01:45:17,406][52658] DAMAGECOUNT value on done: 225543.0 [2024-08-06 01:45:17,407][52658] Sum rewards: 58.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.088', 'weapon4': '0.090', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.244', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.378', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:17,795][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.1, 300 sec: 17550.3). Total num frames: 268705792. Throughput: 0: 4400.2. Samples: 67176950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:45:17,802][52567] Avg episode reward: [(0, '63.030')] [2024-08-06 01:45:18,397][52666] DAMAGECOUNT value on done: 228655.0 [2024-08-06 01:45:18,399][52666] Sum rewards: 55.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.962', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.190', 'AMMO3': '0.205', 'AMMO4': '0.213', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '2.954', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '49.000'} [2024-08-06 01:45:19,694][52670] DAMAGECOUNT value on done: 224890.0 [2024-08-06 01:45:19,696][52670] Sum rewards: 63.053, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.146', 'AMMO3': '0.164', 'AMMO4': '0.183', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:20,072][52664] DAMAGECOUNT value on done: 239529.0 [2024-08-06 01:45:20,072][52664] Sum rewards: 58.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.973', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.080', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:20,334][52658] DAMAGECOUNT value on done: 231652.0 [2024-08-06 01:45:20,335][52658] Sum rewards: 62.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.796', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon4': '0.184', 'AMMO3': '0.190', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:20,344][52671] DAMAGECOUNT value on done: 234391.0 [2024-08-06 01:45:20,344][52671] Sum rewards: 70.135, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.122', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '61.000'} [2024-08-06 01:45:21,062][52666] DAMAGECOUNT value on done: 227589.0 [2024-08-06 01:45:21,064][52666] Sum rewards: 65.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.168', 'AMMO3': '0.179', 'AMMO4': '0.193', 'weapon5': '0.230', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '52.000'} [2024-08-06 01:45:21,944][52650] Updated weights for policy 0, policy_version 32811 (0.0012) [2024-08-06 01:45:22,499][52664] DAMAGECOUNT value on done: 240801.0 [2024-08-06 01:45:22,499][52664] Sum rewards: 64.350, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.174', 'AMMO3': '0.224', 'weapon2': '0.244', 'AMMO4': '0.261', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '55.000'} [2024-08-06 01:45:22,730][52670] DAMAGECOUNT value on done: 229905.0 [2024-08-06 01:45:22,731][52670] Sum rewards: 64.570, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.105', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'weapon4': '0.430', 'weapon2': '0.486', 'WEAPON3': '0.900', 'weapon3': '2.838', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17551.1). Total num frames: 268795904. Throughput: 0: 4398.9. Samples: 67203270. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:45:22,794][52567] Avg episode reward: [(0, '62.586')] [2024-08-06 01:45:23,478][52658] DAMAGECOUNT value on done: 236100.0 [2024-08-06 01:45:23,480][52658] Sum rewards: 72.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.310', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO4': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.180', 'weapon2': '0.382', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.374', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '60.000'} [2024-08-06 01:45:23,515][52671] DAMAGECOUNT value on done: 235648.0 [2024-08-06 01:45:23,515][52671] Sum rewards: 62.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:24,041][52666] DAMAGECOUNT value on done: 222957.0 [2024-08-06 01:45:24,043][52666] Sum rewards: 55.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.163', 'weapon5': '0.192', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.936', 'WEAPON3': '1.050', 'weapon3': '2.392', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '46.000'} [2024-08-06 01:45:25,879][52670] DAMAGECOUNT value on done: 227436.0 [2024-08-06 01:45:25,879][52670] Sum rewards: 55.470, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'AMMO4': '0.127', 'WEAPON4': '0.350', 'weapon2': '0.552', 'weapon4': '0.578', 'WEAPON3': '0.800', 'weapon3': '2.698', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '45.000'} [2024-08-06 01:45:26,332][52658] DAMAGECOUNT value on done: 228867.0 [2024-08-06 01:45:26,332][52658] Sum rewards: 55.115, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.887', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '46.000'} [2024-08-06 01:45:26,619][52650] Updated weights for policy 0, policy_version 32821 (0.0029) [2024-08-06 01:45:26,866][52671] DAMAGECOUNT value on done: 230073.0 [2024-08-06 01:45:26,868][52671] Sum rewards: 61.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.177', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'weapon4': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.620', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '49.000'} [2024-08-06 01:45:27,040][52666] DAMAGECOUNT value on done: 235629.0 [2024-08-06 01:45:27,040][52666] Sum rewards: 67.695, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.877', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.248', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '1.650', 'weapon3': '2.898', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '60.000'} [2024-08-06 01:45:27,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 268877824. Throughput: 0: 4398.2. Samples: 67229610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:45:27,803][52567] Avg episode reward: [(0, '62.575')] [2024-08-06 01:45:28,686][52670] DAMAGECOUNT value on done: 222414.0 [2024-08-06 01:45:28,687][52670] Sum rewards: 60.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.915', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.262', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '52.000'} [2024-08-06 01:45:29,363][52658] DAMAGECOUNT value on done: 230109.0 [2024-08-06 01:45:29,363][52658] Sum rewards: 58.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.156', 'AMMO4': '0.175', 'AMMO3': '0.214', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:30,061][52666] DAMAGECOUNT value on done: 232732.0 [2024-08-06 01:45:30,063][52666] Sum rewards: 57.906, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.576', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.308', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '47.000'} [2024-08-06 01:45:30,081][52671] DAMAGECOUNT value on done: 236766.0 [2024-08-06 01:45:30,082][52671] Sum rewards: 58.812, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.130', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.078', 'AMMO4': '0.252', 'AMMO3': '0.304', 'weapon2': '0.348', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.756', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '55.000'} [2024-08-06 01:45:31,059][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:45:31,314][52650] Updated weights for policy 0, policy_version 32831 (0.0013) [2024-08-06 01:45:31,522][52670] DAMAGECOUNT value on done: 234154.0 [2024-08-06 01:45:31,523][52670] Sum rewards: 71.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '59.000'} [2024-08-06 01:45:32,380][52658] DAMAGECOUNT value on done: 234326.0 [2024-08-06 01:45:32,382][52658] Sum rewards: 59.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.142', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.154', 'AMMO3': '0.229', 'weapon2': '0.252', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.650', 'weapon4': '0.760', 'WEAPON3': '1.400', 'weapon3': '2.576', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:32,494][52666] DAMAGECOUNT value on done: 227167.0 [2024-08-06 01:45:32,496][52666] Sum rewards: 80.596, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.085', 'AMMO3': '0.140', 'HEALTH': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.264', 'weapon2': '0.396', 'WEAPON3': '0.850', 'weapon3': '3.094', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '64.000'} [2024-08-06 01:45:32,569][52671] DAMAGECOUNT value on done: 235276.0 [2024-08-06 01:45:32,569][52671] Sum rewards: 59.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.174', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '52.000'} [2024-08-06 01:45:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 268967936. Throughput: 0: 4393.5. Samples: 67242630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:45:32,802][52567] Avg episode reward: [(0, '62.793')] [2024-08-06 01:45:34,221][52670] DAMAGECOUNT value on done: 231217.0 [2024-08-06 01:45:34,222][52670] Sum rewards: 57.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO4': '0.202', 'AMMO3': '0.216', 'weapon2': '0.280', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.050', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '48.000'} [2024-08-06 01:45:35,510][52666] DAMAGECOUNT value on done: 227089.0 [2024-08-06 01:45:35,510][52666] Sum rewards: 57.208, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.828', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.126', 'AMMO4': '0.149', 'weapon5': '0.172', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.754', 'WEAPON3': '0.850', 'weapon3': '2.304', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '46.000'} [2024-08-06 01:45:35,899][52650] Updated weights for policy 0, policy_version 32841 (0.0019) [2024-08-06 01:45:35,957][52671] DAMAGECOUNT value on done: 232777.0 [2024-08-06 01:45:35,958][52671] Sum rewards: 64.024, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'weapon5': '0.028', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO4': '0.213', 'weapon4': '0.216', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '56.000'} [2024-08-06 01:45:37,265][52670] DAMAGECOUNT value on done: 230044.0 [2024-08-06 01:45:37,266][52670] Sum rewards: 68.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.687', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.079', 'AMMO3': '0.231', 'weapon2': '0.268', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.470', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '58.000'} [2024-08-06 01:45:37,349][52663] DAMAGECOUNT value on done: 233274.0 [2024-08-06 01:45:37,349][52663] Sum rewards: 66.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.139', 'AMMO3': '0.178', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '56.000'} [2024-08-06 01:45:37,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 269066240. Throughput: 0: 4386.2. Samples: 67269100. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 01:45:37,794][52567] Avg episode reward: [(0, '62.721')] [2024-08-06 01:45:38,436][52671] DAMAGECOUNT value on done: 240634.0 [2024-08-06 01:45:38,438][52671] Sum rewards: 68.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.520', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'weapon4': '0.176', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '58.000'} [2024-08-06 01:45:38,595][52666] DAMAGECOUNT value on done: 226477.0 [2024-08-06 01:45:38,598][52666] Sum rewards: 48.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '3.228', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '41.000'} [2024-08-06 01:45:39,561][52659] DAMAGECOUNT value on done: 233038.0 [2024-08-06 01:45:39,562][52659] Sum rewards: 61.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.211', 'weapon4': '0.336', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:40,289][52670] DAMAGECOUNT value on done: 231349.0 [2024-08-06 01:45:40,290][52670] Sum rewards: 57.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.311', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.332', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '47.000'} [2024-08-06 01:45:40,328][52663] DAMAGECOUNT value on done: 231020.0 [2024-08-06 01:45:40,328][52663] Sum rewards: 58.036, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.934', 'AMMO5': '0.008', 'AMMO2': '0.054', 'weapon5': '0.134', 'AMMO3': '0.136', 'WEAPON5': '0.250', 'AMMO4': '0.272', 'weapon4': '0.308', 'WEAPON4': '0.450', 'weapon2': '0.556', 'WEAPON3': '0.900', 'HITCOUNT': '2.690', 'weapon3': '2.824', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '45.000'} [2024-08-06 01:45:40,496][52650] Updated weights for policy 0, policy_version 32851 (0.0014) [2024-08-06 01:45:41,210][52671] DAMAGECOUNT value on done: 231086.0 [2024-08-06 01:45:41,210][52671] Sum rewards: 60.385, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.575', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.144', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon4': '0.988', 'weapon3': '2.252', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '49.000'} [2024-08-06 01:45:41,552][52666] DAMAGECOUNT value on done: 233681.0 [2024-08-06 01:45:41,553][52666] Sum rewards: 64.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.915', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.740', 'WEAPON3': '1.400', 'weapon3': '2.828', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '52.000'} [2024-08-06 01:45:42,653][52659] DAMAGECOUNT value on done: 230676.0 [2024-08-06 01:45:42,654][52659] Sum rewards: 69.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.182', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '56.000'} [2024-08-06 01:45:42,675][52649] DAMAGECOUNT value on done: 226178.0 [2024-08-06 01:45:42,676][52649] Sum rewards: 65.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.653', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.111', 'weapon4': '0.138', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2024-08-06 01:45:42,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 269148160. Throughput: 0: 4394.2. Samples: 67295510. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 01:45:42,794][52567] Avg episode reward: [(0, '62.812')] [2024-08-06 01:45:42,979][52670] DAMAGECOUNT value on done: 232428.0 [2024-08-06 01:45:42,983][52670] Sum rewards: 61.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.794', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:43,527][52663] DAMAGECOUNT value on done: 227637.0 [2024-08-06 01:45:43,530][52663] Sum rewards: 61.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.052', 'weapon5': '0.102', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.237', 'AMMO4': '0.261', 'WEAPON4': '0.450', 'weapon4': '0.538', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:44,329][52671] DAMAGECOUNT value on done: 226018.0 [2024-08-06 01:45:44,332][52671] Sum rewards: 68.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon4': '0.096', 'weapon5': '0.156', 'AMMO3': '0.209', 'AMMO4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.172', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '58.000'} [2024-08-06 01:45:44,373][52666] DAMAGECOUNT value on done: 224596.0 [2024-08-06 01:45:44,375][52666] Sum rewards: 52.870, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.062', 'weapon4': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.354', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '48.000'} [2024-08-06 01:45:45,258][52650] Updated weights for policy 0, policy_version 32861 (0.0011) [2024-08-06 01:45:45,492][52659] DAMAGECOUNT value on done: 232226.0 [2024-08-06 01:45:45,494][52659] Sum rewards: 66.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.222', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '56.000'} [2024-08-06 01:45:45,851][52670] DAMAGECOUNT value on done: 220603.0 [2024-08-06 01:45:45,852][52670] Sum rewards: 65.100, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.045', 'AMMO5': '0.005', 'weapon5': '0.048', 'AMMO2': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'AMMO4': '0.272', 'weapon2': '0.356', 'weapon4': '0.522', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.840', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '57.000'} [2024-08-06 01:45:46,286][52649] DAMAGECOUNT value on done: 217984.0 [2024-08-06 01:45:46,286][52649] Sum rewards: 53.797, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.661', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.096', 'weapon5': '0.164', 'AMMO4': '0.186', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.008', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:46,500][52663] DAMAGECOUNT value on done: 233613.0 [2024-08-06 01:45:46,501][52663] Sum rewards: 61.280, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.307', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.124', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.428', 'weapon2': '0.464', 'WEAPON3': '1.000', 'weapon3': '2.848', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '49.000'} [2024-08-06 01:45:47,079][52666] DAMAGECOUNT value on done: 230368.0 [2024-08-06 01:45:47,081][52666] Sum rewards: 72.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.866', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.072', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO4': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.450', 'weapon4': '0.662', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '61.000'} [2024-08-06 01:45:47,268][52671] DAMAGECOUNT value on done: 235222.0 [2024-08-06 01:45:47,269][52671] Sum rewards: 63.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.035', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.120', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.702', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '52.500'} [2024-08-06 01:45:47,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 269230080. Throughput: 0: 4398.0. Samples: 67308740. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 01:45:47,794][52567] Avg episode reward: [(0, '62.609')] [2024-08-06 01:45:48,495][52670] DAMAGECOUNT value on done: 232512.0 [2024-08-06 01:45:48,497][52670] Sum rewards: 51.956, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.972', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.164', 'AMMO3': '0.230', 'weapon2': '0.248', 'AMMO4': '0.293', 'weapon4': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '2.892', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '47.000'} [2024-08-06 01:45:48,518][52659] DAMAGECOUNT value on done: 230690.0 [2024-08-06 01:45:48,519][52659] Sum rewards: 61.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.167', 'AMMO4': '0.171', 'weapon2': '0.238', 'weapon5': '0.286', 'weapon4': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.754', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '51.500'} [2024-08-06 01:45:49,452][52649] DAMAGECOUNT value on done: 227893.0 [2024-08-06 01:45:49,455][52649] Sum rewards: 68.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.234', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.112', 'AMMO4': '0.180', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '57.000'} [2024-08-06 01:45:49,580][52663] DAMAGECOUNT value on done: 231053.0 [2024-08-06 01:45:49,582][52663] Sum rewards: 80.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.162', 'AMMO5': '0.022', 'AMMO2': '0.041', 'AMMO3': '0.136', 'weapon5': '0.148', 'AMMO4': '0.207', 'weapon4': '0.294', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.866', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '65.000'} [2024-08-06 01:45:50,008][52650] Updated weights for policy 0, policy_version 32871 (0.0020) [2024-08-06 01:45:50,285][52671] DAMAGECOUNT value on done: 235586.0 [2024-08-06 01:45:50,285][52671] Sum rewards: 67.559, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.855', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.070', 'AMMO3': '0.159', 'AMMO4': '0.198', 'weapon5': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '54.000'} [2024-08-06 01:45:51,340][52659] DAMAGECOUNT value on done: 229072.0 [2024-08-06 01:45:51,340][52659] Sum rewards: 46.883, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.345', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.096', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.804', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '2.682', 'DAMAGECOUNT': '11.352', 'FRAGCOUNT': '38.000'} [2024-08-06 01:45:51,544][52670] DAMAGECOUNT value on done: 235159.0 [2024-08-06 01:45:51,544][52670] Sum rewards: 61.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '52.000'} [2024-08-06 01:45:52,565][52663] DAMAGECOUNT value on done: 235074.0 [2024-08-06 01:45:52,566][52663] Sum rewards: 68.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.124', 'AMMO4': '0.181', 'AMMO3': '0.219', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 01:45:52,588][52649] DAMAGECOUNT value on done: 227489.0 [2024-08-06 01:45:52,590][52649] Sum rewards: 58.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.110', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.276', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '48.000'} [2024-08-06 01:45:52,697][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:45:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 269328384. Throughput: 0: 4396.7. Samples: 67335280. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 01:45:52,794][52567] Avg episode reward: [(0, '62.392')] [2024-08-06 01:45:53,095][52671] DAMAGECOUNT value on done: 238424.0 [2024-08-06 01:45:53,097][52671] Sum rewards: 57.839, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.308', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon2': '0.212', 'AMMO4': '0.226', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '1.600', 'weapon3': '2.906', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '51.000'} [2024-08-06 01:45:54,170][52659] DAMAGECOUNT value on done: 231176.0 [2024-08-06 01:45:54,172][52659] Sum rewards: 51.485, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'AMMO3': '0.220', 'weapon2': '0.360', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.300', 'weapon3': '2.700', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '47.000'} [2024-08-06 01:45:54,404][52670] DAMAGECOUNT value on done: 229405.0 [2024-08-06 01:45:54,405][52670] Sum rewards: 64.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.922', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '3.290', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '53.000'} [2024-08-06 01:45:54,415][52650] Updated weights for policy 0, policy_version 32881 (0.0023) [2024-08-06 01:45:55,374][52663] DAMAGECOUNT value on done: 232852.0 [2024-08-06 01:45:55,381][52663] Sum rewards: 62.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.565', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.148', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.480', 'WEAPON3': '1.000', 'weapon3': '2.568', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '52.000'} [2024-08-06 01:45:55,575][52671] DAMAGECOUNT value on done: 235070.0 [2024-08-06 01:45:55,575][52671] Sum rewards: 49.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.910', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.122', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'weapon2': '0.354', 'WEAPON3': '1.750', 'HITCOUNT': '2.910', 'weapon3': '3.162', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '45.000'} [2024-08-06 01:45:55,594][52649] DAMAGECOUNT value on done: 217524.0 [2024-08-06 01:45:55,595][52649] Sum rewards: 60.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.246', 'weapon2': '0.388', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.134', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '50.000'} [2024-08-06 01:45:56,946][52659] DAMAGECOUNT value on done: 231603.0 [2024-08-06 01:45:56,948][52659] Sum rewards: 57.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.478', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.176', 'AMMO3': '0.223', 'AMMO4': '0.236', 'weapon4': '0.334', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '50.500'} [2024-08-06 01:45:57,250][52670] DAMAGECOUNT value on done: 232408.0 [2024-08-06 01:45:57,250][52670] Sum rewards: 68.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.060', 'AMMO3': '0.202', 'weapon4': '0.216', 'AMMO4': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '60.000'} [2024-08-06 01:45:57,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17605.9). Total num frames: 269418496. Throughput: 0: 4400.4. Samples: 67361720. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 01:45:57,794][52567] Avg episode reward: [(0, '62.191')] [2024-08-06 01:45:58,417][52671] DAMAGECOUNT value on done: 230429.0 [2024-08-06 01:45:58,419][52671] Sum rewards: 53.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.638', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.152', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '47.000'} [2024-08-06 01:45:58,570][52649] DAMAGECOUNT value on done: 228233.0 [2024-08-06 01:45:58,570][52649] Sum rewards: 57.781, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.216', 'weapon2': '0.896', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '47.000'} [2024-08-06 01:45:58,621][52663] DAMAGECOUNT value on done: 232928.0 [2024-08-06 01:45:58,622][52663] Sum rewards: 70.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.101', 'AMMO3': '0.193', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '59.000'} [2024-08-06 01:45:59,267][52650] Updated weights for policy 0, policy_version 32891 (0.0012) [2024-08-06 01:45:59,451][52811] Large shaping reward -2.512 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.261, -87.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:45:59,467][52659] DAMAGECOUNT value on done: 227332.0 [2024-08-06 01:45:59,467][52659] Sum rewards: 65.650, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.062', 'weapon5': '0.062', 'AMMO4': '0.112', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.678', 'WEAPON3': '0.950', 'weapon3': '3.000', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '53.000'} [2024-08-06 01:46:01,500][52663] DAMAGECOUNT value on done: 231034.0 [2024-08-06 01:46:01,503][52663] Sum rewards: 57.679, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.224', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.105', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.214', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '52.000'} [2024-08-06 01:46:01,671][52649] DAMAGECOUNT value on done: 224116.0 [2024-08-06 01:46:01,672][52649] Sum rewards: 62.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.756', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.146', 'AMMO4': '0.151', 'weapon5': '0.158', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.632', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '52.000'} [2024-08-06 01:46:02,335][52659] DAMAGECOUNT value on done: 237002.0 [2024-08-06 01:46:02,337][52659] Sum rewards: 60.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.632', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.134', 'AMMO4': '0.207', 'weapon4': '0.226', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '54.000'} [2024-08-06 01:46:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 269508608. Throughput: 0: 4403.6. Samples: 67375110. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 01:46:02,795][52567] Avg episode reward: [(0, '62.222')] [2024-08-06 01:46:03,764][52665] DAMAGECOUNT value on done: 229052.0 [2024-08-06 01:46:03,764][52665] Sum rewards: 64.601, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.580', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.122', 'AMMO3': '0.230', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.700', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '58.000'} [2024-08-06 01:46:03,783][52650] Updated weights for policy 0, policy_version 32901 (0.0012) [2024-08-06 01:46:04,256][52663] DAMAGECOUNT value on done: 232982.0 [2024-08-06 01:46:04,258][52663] Sum rewards: 58.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.984', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '49.000'} [2024-08-06 01:46:04,547][52649] DAMAGECOUNT value on done: 231594.0 [2024-08-06 01:46:04,548][52649] Sum rewards: 63.405, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.532', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.242', 'AMMO4': '0.249', 'AMMO3': '0.256', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.474', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 01:46:05,324][52659] DAMAGECOUNT value on done: 236573.0 [2024-08-06 01:46:05,324][52659] Sum rewards: 58.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.168', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.486', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '50.000'} [2024-08-06 01:46:06,218][52665] DAMAGECOUNT value on done: 234458.0 [2024-08-06 01:46:06,220][52665] Sum rewards: 61.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.369', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon4': '0.186', 'AMMO4': '0.211', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.074', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '52.000'} [2024-08-06 01:46:07,058][52663] DAMAGECOUNT value on done: 237025.0 [2024-08-06 01:46:07,065][52663] Sum rewards: 62.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.204', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.142', 'WEAPON5': '0.250', 'weapon4': '0.254', 'AMMO3': '0.292', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.700', 'weapon3': '2.924', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:07,237][52649] DAMAGECOUNT value on done: 227480.0 [2024-08-06 01:46:07,238][52649] Sum rewards: 61.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.761', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.174', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '52.000'} [2024-08-06 01:46:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 269590528. Throughput: 0: 4405.8. Samples: 67401530. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:46:07,794][52567] Avg episode reward: [(0, '62.037')] [2024-08-06 01:46:08,297][52659] DAMAGECOUNT value on done: 230694.0 [2024-08-06 01:46:08,297][52659] Sum rewards: 54.340, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.174', 'AMMO4': '0.176', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.076', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '47.000'} [2024-08-06 01:46:08,342][52650] Updated weights for policy 0, policy_version 32911 (0.0018) [2024-08-06 01:46:09,099][52665] DAMAGECOUNT value on done: 229009.0 [2024-08-06 01:46:09,100][52665] Sum rewards: 64.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.167', 'weapon4': '0.182', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.054', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '54.000'} [2024-08-06 01:46:09,865][52663] DAMAGECOUNT value on done: 230626.0 [2024-08-06 01:46:09,867][52663] Sum rewards: 46.521, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.705', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.192', 'AMMO3': '0.263', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.590', 'weapon3': '2.856', 'DAMAGECOUNT': '12.399', 'FRAGCOUNT': '43.500'} [2024-08-06 01:46:10,293][52649] DAMAGECOUNT value on done: 226736.0 [2024-08-06 01:46:10,293][52649] Sum rewards: 46.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.271', 'AMMO5': '0.023', 'AMMO2': '0.080', 'AMMO3': '0.209', 'weapon5': '0.246', 'weapon2': '0.374', 'AMMO4': '0.401', 'WEAPON5': '0.600', 'weapon4': '0.668', 'WEAPON4': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.354', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '43.000'} [2024-08-06 01:46:10,845][52659] DAMAGECOUNT value on done: 229742.0 [2024-08-06 01:46:10,846][52659] Sum rewards: 60.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '49.000'} [2024-08-06 01:46:12,288][52665] DAMAGECOUNT value on done: 227204.0 [2024-08-06 01:46:12,297][52665] Sum rewards: 66.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon5': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:12,580][52795] DAMAGECOUNT value on done: 216553.0 [2024-08-06 01:46:12,583][52795] Sum rewards: 70.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.855', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '57.500'} [2024-08-06 01:46:12,760][52663] DAMAGECOUNT value on done: 224726.0 [2024-08-06 01:46:12,760][52663] Sum rewards: 53.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.026', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.242', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '3.412', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '47.000'} [2024-08-06 01:46:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 269680640. Throughput: 0: 4404.0. Samples: 67427790. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:46:12,794][52567] Avg episode reward: [(0, '61.577')] [2024-08-06 01:46:13,390][52650] Updated weights for policy 0, policy_version 32921 (0.0027) [2024-08-06 01:46:13,541][52649] DAMAGECOUNT value on done: 228156.0 [2024-08-06 01:46:13,541][52649] Sum rewards: 60.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.574', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO4': '0.216', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '52.500'} [2024-08-06 01:46:13,814][52659] DAMAGECOUNT value on done: 226745.0 [2024-08-06 01:46:13,814][52659] Sum rewards: 62.661, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'weapon2': '0.286', 'AMMO3': '0.290', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.942', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '57.000'} [2024-08-06 01:46:15,276][52663] DAMAGECOUNT value on done: 226423.0 [2024-08-06 01:46:15,279][52663] Sum rewards: 68.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.560', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '60.000'} [2024-08-06 01:46:15,536][52665] DAMAGECOUNT value on done: 225591.0 [2024-08-06 01:46:15,538][52665] Sum rewards: 65.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.084', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.316', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.282', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:15,651][52795] DAMAGECOUNT value on done: 212389.0 [2024-08-06 01:46:15,653][52795] Sum rewards: 53.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.078', 'AMMO3': '0.204', 'weapon4': '0.208', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'WEAPON4': '0.550', 'weapon2': '0.712', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.792', 'DAMAGECOUNT': '13.182', 'FRAGCOUNT': '46.000'} [2024-08-06 01:46:15,761][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:46:16,364][52659] DAMAGECOUNT value on done: 232819.0 [2024-08-06 01:46:16,365][52659] Sum rewards: 61.990, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.066', 'AMMO3': '0.168', 'weapon5': '0.184', 'AMMO4': '0.323', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.106', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '50.000'} [2024-08-06 01:46:16,718][52649] DAMAGECOUNT value on done: 226514.0 [2024-08-06 01:46:16,719][52649] Sum rewards: 65.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.092', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.223', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:17,742][52650] Updated weights for policy 0, policy_version 32931 (0.0012) [2024-08-06 01:46:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.5, 300 sec: 17578.1). Total num frames: 269770752. Throughput: 0: 4410.7. Samples: 67441110. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:46:17,794][52567] Avg episode reward: [(0, '61.590')] [2024-08-06 01:46:18,328][52663] DAMAGECOUNT value on done: 231632.0 [2024-08-06 01:46:18,331][52663] Sum rewards: 58.980, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.727', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '48.000'} [2024-08-06 01:46:18,383][52665] DAMAGECOUNT value on done: 223605.0 [2024-08-06 01:46:18,386][52665] Sum rewards: 48.728, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.943', 'AMMO5': '0.007', 'weapon7': '0.014', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'weapon4': '0.220', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.580', 'weapon3': '2.862', 'DAMAGECOUNT': '12.507', 'FRAGCOUNT': '44.000'} [2024-08-06 01:46:18,715][52795] DAMAGECOUNT value on done: 211864.0 [2024-08-06 01:46:18,716][52795] Sum rewards: 68.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.954', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.446', 'weapon4': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.466', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '55.500'} [2024-08-06 01:46:18,990][52659] DAMAGECOUNT value on done: 236135.0 [2024-08-06 01:46:18,993][52659] Sum rewards: 65.797, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.932', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.098', 'AMMO3': '0.224', 'weapon4': '0.224', 'AMMO4': '0.267', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:19,722][52649] DAMAGECOUNT value on done: 229194.0 [2024-08-06 01:46:19,724][52649] Sum rewards: 58.854, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.057', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.093', 'weapon4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.281', 'weapon2': '0.474', 'WEAPON3': '1.700', 'HITCOUNT': '3.030', 'weapon3': '3.144', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '54.000'} [2024-08-06 01:46:20,203][52614] Signal inference workers to stop experience collection... (5950 times) [2024-08-06 01:46:20,218][52614] Signal inference workers to resume experience collection... (5950 times) [2024-08-06 01:46:20,247][52650] InferenceWorker_p0-w0: stopping experience collection (5950 times) [2024-08-06 01:46:20,255][52650] InferenceWorker_p0-w0: resuming experience collection (5950 times) [2024-08-06 01:46:21,001][52665] DAMAGECOUNT value on done: 232066.0 [2024-08-06 01:46:21,002][52665] Sum rewards: 66.057, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.225', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '57.000'} [2024-08-06 01:46:21,455][52663] DAMAGECOUNT value on done: 235349.0 [2024-08-06 01:46:21,458][52659] DAMAGECOUNT value on done: 239148.0 [2024-08-06 01:46:21,460][52659] Sum rewards: 58.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.142', 'AMMO3': '0.191', 'AMMO4': '0.213', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '2.994', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '48.000'} [2024-08-06 01:46:21,457][52663] Sum rewards: 55.527, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.274', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.052', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.230', 'weapon4': '0.276', 'WEAPON4': '0.450', 'weapon2': '0.652', 'WEAPON3': '1.400', 'weapon3': '2.750', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '49.000'} [2024-08-06 01:46:21,908][52795] DAMAGECOUNT value on done: 214352.0 [2024-08-06 01:46:21,909][52795] Sum rewards: 58.093, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.042', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon4': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.322', 'weapon2': '0.410', 'WEAPON3': '1.800', 'weapon3': '3.060', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '52.000'} [2024-08-06 01:46:22,653][52649] DAMAGECOUNT value on done: 231605.0 [2024-08-06 01:46:22,653][52649] Sum rewards: 76.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.084', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '64.000'} [2024-08-06 01:46:22,684][52650] Updated weights for policy 0, policy_version 32941 (0.0011) [2024-08-06 01:46:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 269852672. Throughput: 0: 4407.8. Samples: 67467450. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:46:22,802][52567] Avg episode reward: [(0, '61.726')] [2024-08-06 01:46:23,905][52665] DAMAGECOUNT value on done: 230788.0 [2024-08-06 01:46:23,907][52665] Sum rewards: 66.751, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.968', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.157', 'weapon2': '0.466', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.398', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '53.000'} [2024-08-06 01:46:24,374][52659] DAMAGECOUNT value on done: 237802.0 [2024-08-06 01:46:24,374][52659] Sum rewards: 65.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.108', 'AMMO3': '0.214', 'AMMO4': '0.214', 'weapon2': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '54.000'} [2024-08-06 01:46:24,497][52663] DAMAGECOUNT value on done: 234330.0 [2024-08-06 01:46:24,498][52663] Sum rewards: 59.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.590', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.124', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '51.500'} [2024-08-06 01:46:24,985][52649] DAMAGECOUNT value on done: 221249.0 [2024-08-06 01:46:24,986][52649] Sum rewards: 62.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.114', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.260', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.928', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '54.000'} [2024-08-06 01:46:25,023][52795] DAMAGECOUNT value on done: 219890.0 [2024-08-06 01:46:25,023][52795] Sum rewards: 69.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.653', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '57.000'} [2024-08-06 01:46:26,267][52665] DAMAGECOUNT value on done: 232990.0 [2024-08-06 01:46:26,267][52665] Sum rewards: 65.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.044', 'AMMO4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.310', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.000'} [2024-08-06 01:46:27,184][52663] DAMAGECOUNT value on done: 238725.0 [2024-08-06 01:46:27,184][52663] Sum rewards: 67.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO3': '0.219', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '57.000'} [2024-08-06 01:46:27,227][52659] DAMAGECOUNT value on done: 234625.0 [2024-08-06 01:46:27,228][52659] Sum rewards: 72.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.074', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.063', 'weapon4': '0.102', 'WEAPON4': '0.150', 'weapon2': '0.156', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.500', 'weapon3': '3.506', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.000'} [2024-08-06 01:46:27,422][52650] Updated weights for policy 0, policy_version 32951 (0.0028) [2024-08-06 01:46:27,456][52649] DAMAGECOUNT value on done: 227126.0 [2024-08-06 01:46:27,456][52649] Sum rewards: 57.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.028', 'AMMO4': '0.139', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '50.000'} [2024-08-06 01:46:27,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 269942784. Throughput: 0: 4409.1. Samples: 67493920. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:46:27,795][52567] Avg episode reward: [(0, '61.865')] [2024-08-06 01:46:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032952_269942784.pth... [2024-08-06 01:46:27,955][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032438_265732096.pth [2024-08-06 01:46:28,247][52795] DAMAGECOUNT value on done: 215182.0 [2024-08-06 01:46:28,247][52795] Sum rewards: 69.937, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.315', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon2': '0.210', 'AMMO3': '0.252', 'WEAPON3': '1.650', 'HITCOUNT': '3.560', 'weapon3': '3.594', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '61.000'} [2024-08-06 01:46:28,782][52665] DAMAGECOUNT value on done: 232879.0 [2024-08-06 01:46:28,782][52665] Sum rewards: 75.586, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.925', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.214', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.580', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '64.000'} [2024-08-06 01:46:29,875][52663] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:46:30,015][52649] DAMAGECOUNT value on done: 225687.0 [2024-08-06 01:46:30,016][52649] Sum rewards: 53.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.465', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.180', 'AMMO3': '0.202', 'weapon4': '0.212', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '47.000'} [2024-08-06 01:46:30,120][52659] DAMAGECOUNT value on done: 237985.0 [2024-08-06 01:46:30,121][52659] Sum rewards: 51.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.104', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon4': '0.138', 'AMMO3': '0.148', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '0.900', 'HITCOUNT': '2.800', 'weapon3': '2.904', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '42.500'} [2024-08-06 01:46:30,322][52663] DAMAGECOUNT value on done: 234637.0 [2024-08-06 01:46:30,322][52663] Sum rewards: 60.320, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.746', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.154', 'AMMO3': '0.169', 'AMMO4': '0.171', 'weapon4': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '2.830', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '48.000'} [2024-08-06 01:46:31,330][52665] DAMAGECOUNT value on done: 239180.0 [2024-08-06 01:46:31,330][52665] Sum rewards: 72.699, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.144', 'weapon4': '0.170', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '62.000'} [2024-08-06 01:46:31,551][52795] DAMAGECOUNT value on done: 219315.0 [2024-08-06 01:46:31,551][52795] Sum rewards: 58.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.091', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.160', 'weapon5': '0.164', 'AMMO4': '0.208', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '51.000'} [2024-08-06 01:46:31,959][52650] Updated weights for policy 0, policy_version 32961 (0.0019) [2024-08-06 01:46:32,647][52649] DAMAGECOUNT value on done: 232189.0 [2024-08-06 01:46:32,647][52649] Sum rewards: 65.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.735', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.217', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 270024704. Throughput: 0: 4395.5. Samples: 67506540. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:46:32,794][52567] Avg episode reward: [(0, '62.028')] [2024-08-06 01:46:33,290][52659] DAMAGECOUNT value on done: 235833.0 [2024-08-06 01:46:33,293][52659] Sum rewards: 64.787, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.738', 'AMMO2': '0.024', 'weapon4': '0.068', 'AMMO4': '0.119', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.452', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '53.000'} [2024-08-06 01:46:33,394][52663] DAMAGECOUNT value on done: 230479.0 [2024-08-06 01:46:33,394][52663] Sum rewards: 57.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.926', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.142', 'AMMO3': '0.206', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '51.000'} [2024-08-06 01:46:33,794][52647] DAMAGECOUNT value on done: 247757.0 [2024-08-06 01:46:33,794][52647] Sum rewards: 49.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.098', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.265', 'weapon2': '0.484', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '2.984', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '44.000'} [2024-08-06 01:46:34,112][52665] DAMAGECOUNT value on done: 234781.0 [2024-08-06 01:46:34,113][52665] Sum rewards: 62.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.126', 'weapon4': '0.156', 'AMMO3': '0.213', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.692', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '53.000'} [2024-08-06 01:46:34,597][52795] DAMAGECOUNT value on done: 216081.0 [2024-08-06 01:46:34,599][52795] Sum rewards: 65.461, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.528', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.146', 'weapon5': '0.174', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '0.900', 'weapon3': '2.812', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '53.000'} [2024-08-06 01:46:35,826][52649] DAMAGECOUNT value on done: 232714.0 [2024-08-06 01:46:35,826][52649] Sum rewards: 57.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.292', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.084', 'AMMO4': '0.183', 'AMMO3': '0.206', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '50.000'} [2024-08-06 01:46:36,256][52647] DAMAGECOUNT value on done: 244652.0 [2024-08-06 01:46:36,257][52647] Sum rewards: 67.418, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.872', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.064', 'weapon4': '0.084', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.289', 'weapon2': '0.388', 'WEAPON3': '1.750', 'weapon3': '3.194', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '60.000'} [2024-08-06 01:46:36,644][52650] Updated weights for policy 0, policy_version 32971 (0.0016) [2024-08-06 01:46:37,344][52665] DAMAGECOUNT value on done: 232931.0 [2024-08-06 01:46:37,345][52665] Sum rewards: 69.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.210', 'AMMO3': '0.245', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '59.000'} [2024-08-06 01:46:37,730][52795] DAMAGECOUNT value on done: 214155.0 [2024-08-06 01:46:37,730][52795] Sum rewards: 55.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.845', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '1.138', 'WEAPON3': '1.150', 'weapon3': '2.216', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '45.000'} [2024-08-06 01:46:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 270114816. Throughput: 0: 4382.2. Samples: 67532480. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:46:37,795][52567] Avg episode reward: [(0, '61.844')] [2024-08-06 01:46:38,698][52649] DAMAGECOUNT value on done: 236703.0 [2024-08-06 01:46:38,700][52649] Sum rewards: 72.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.126', 'AMMO3': '0.163', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '58.000'} [2024-08-06 01:46:39,090][52647] DAMAGECOUNT value on done: 246926.0 [2024-08-06 01:46:39,090][52647] Sum rewards: 62.544, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'HEALTH': '0.538', 'weapon2': '0.558', 'WEAPON3': '0.750', 'HITCOUNT': '3.060', 'weapon3': '3.282', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '47.000'} [2024-08-06 01:46:39,908][52665] DAMAGECOUNT value on done: 231664.0 [2024-08-06 01:46:39,908][52665] Sum rewards: 68.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.615', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.139', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.624', 'weapon2': '0.694', 'WEAPON3': '1.000', 'weapon3': '2.124', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '55.000'} [2024-08-06 01:46:40,835][52795] DAMAGECOUNT value on done: 219994.0 [2024-08-06 01:46:40,838][52795] Sum rewards: 65.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.205', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon5': '0.128', 'AMMO3': '0.221', 'AMMO4': '0.303', 'weapon2': '0.322', 'weapon4': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:41,474][52650] Updated weights for policy 0, policy_version 32981 (0.0014) [2024-08-06 01:46:41,809][52665] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:46:41,969][52647] DAMAGECOUNT value on done: 249078.0 [2024-08-06 01:46:41,970][52647] Sum rewards: 65.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.044', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.320', 'WEAPON4': '0.450', 'weapon4': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2024-08-06 01:46:42,568][52665] DAMAGECOUNT value on done: 232896.0 [2024-08-06 01:46:42,568][52665] Sum rewards: 72.338, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.150', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon2': '0.558', 'weapon4': '0.688', 'WEAPON3': '0.850', 'weapon3': '2.402', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 270196736. Throughput: 0: 4383.1. Samples: 67558960. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:46:42,794][52567] Avg episode reward: [(0, '62.269')] [2024-08-06 01:46:43,995][52795] DAMAGECOUNT value on done: 217391.0 [2024-08-06 01:46:44,002][52795] Sum rewards: 68.443, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.744', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.346', 'WEAPON3': '1.000', 'weapon3': '3.138', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:45,187][52647] DAMAGECOUNT value on done: 247857.0 [2024-08-06 01:46:45,190][52647] Sum rewards: 60.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon4': '0.226', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.128', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '50.000'} [2024-08-06 01:46:45,283][52665] DAMAGECOUNT value on done: 229602.0 [2024-08-06 01:46:45,286][52665] Sum rewards: 59.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO4': '0.194', 'AMMO3': '0.197', 'weapon2': '0.290', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '51.000'} [2024-08-06 01:46:46,038][52650] Updated weights for policy 0, policy_version 32991 (0.0026) [2024-08-06 01:46:47,336][52795] DAMAGECOUNT value on done: 213780.0 [2024-08-06 01:46:47,337][52795] Sum rewards: 72.089, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.460', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon4': '0.270', 'weapon2': '0.282', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '64.000'} [2024-08-06 01:46:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 270295040. Throughput: 0: 4378.7. Samples: 67572150. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:46:47,795][52567] Avg episode reward: [(0, '62.295')] [2024-08-06 01:46:48,060][52665] DAMAGECOUNT value on done: 229042.0 [2024-08-06 01:46:48,061][52665] Sum rewards: 56.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.262', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.522', 'WEAPON3': '1.500', 'weapon3': '2.718', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '49.000'} [2024-08-06 01:46:48,408][52647] DAMAGECOUNT value on done: 251034.0 [2024-08-06 01:46:48,409][52647] Sum rewards: 69.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.546', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '59.000'} [2024-08-06 01:46:50,455][52795] DAMAGECOUNT value on done: 213724.0 [2024-08-06 01:46:50,455][52795] Sum rewards: 66.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.178', 'weapon2': '0.220', 'weapon5': '0.234', 'AMMO4': '0.302', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.838', 'WEAPON3': '1.100', 'weapon3': '2.358', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '56.000'} [2024-08-06 01:46:50,550][52665] DAMAGECOUNT value on done: 228441.0 [2024-08-06 01:46:50,552][52665] Sum rewards: 72.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon4': '0.182', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 01:46:50,798][52650] Updated weights for policy 0, policy_version 33001 (0.0012) [2024-08-06 01:46:51,509][52647] DAMAGECOUNT value on done: 245556.0 [2024-08-06 01:46:51,509][52647] Sum rewards: 64.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.760', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.176', 'weapon2': '0.288', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.540', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '53.000'} [2024-08-06 01:46:51,511][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:46:52,431][52668] DAMAGECOUNT value on done: 232037.0 [2024-08-06 01:46:52,431][52668] Sum rewards: 59.583, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.042', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.212', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.552', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '50.000'} [2024-08-06 01:46:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 270376960. Throughput: 0: 4374.0. Samples: 67598360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:46:52,794][52567] Avg episode reward: [(0, '62.512')] [2024-08-06 01:46:53,303][52665] DAMAGECOUNT value on done: 232673.0 [2024-08-06 01:46:53,304][52665] Sum rewards: 51.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon2': '0.212', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.122', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '45.000'} [2024-08-06 01:46:53,581][52795] DAMAGECOUNT value on done: 217222.0 [2024-08-06 01:46:53,581][52795] Sum rewards: 69.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO3': '0.251', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.550', 'weapon3': '2.916', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '60.500'} [2024-08-06 01:46:54,257][52803] DAMAGECOUNT value on done: 217784.0 [2024-08-06 01:46:54,259][52803] Sum rewards: 62.078, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.204', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.132', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.340', 'weapon2': '0.552', 'WEAPON3': '1.000', 'weapon3': '2.788', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.487', 'FRAGCOUNT': '50.000'} [2024-08-06 01:46:54,563][52647] DAMAGECOUNT value on done: 245303.0 [2024-08-06 01:46:54,563][52647] Sum rewards: 55.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.175', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.191', 'weapon4': '0.192', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '49.000'} [2024-08-06 01:46:54,978][52668] DAMAGECOUNT value on done: 240115.0 [2024-08-06 01:46:54,981][52668] Sum rewards: 62.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.214', 'AMMO3': '0.228', 'AMMO4': '0.228', 'weapon2': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '52.500'} [2024-08-06 01:46:55,195][52662] DAMAGECOUNT value on done: 241238.0 [2024-08-06 01:46:55,196][52662] Sum rewards: 70.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.278', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '59.000'} [2024-08-06 01:46:55,498][52650] Updated weights for policy 0, policy_version 33011 (0.0018) [2024-08-06 01:46:56,058][52665] DAMAGECOUNT value on done: 231441.0 [2024-08-06 01:46:56,060][52665] Sum rewards: 63.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.674', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'AMMO4': '0.151', 'AMMO3': '0.195', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '51.500'} [2024-08-06 01:46:56,678][52795] DAMAGECOUNT value on done: 209665.0 [2024-08-06 01:46:56,678][52795] Sum rewards: 69.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.164', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.096', 'AMMO4': '0.181', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '59.000'} [2024-08-06 01:46:57,337][52647] DAMAGECOUNT value on done: 248435.0 [2024-08-06 01:46:57,339][52647] Sum rewards: 59.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'weapon4': '0.184', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 01:46:57,389][52803] DAMAGECOUNT value on done: 219498.0 [2024-08-06 01:46:57,390][52803] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.896', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.122', 'weapon5': '0.134', 'AMMO4': '0.157', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '59.000'} [2024-08-06 01:46:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 270467072. Throughput: 0: 4368.4. Samples: 67624370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:46:57,794][52567] Avg episode reward: [(0, '62.444')] [2024-08-06 01:46:57,873][52662] DAMAGECOUNT value on done: 241158.0 [2024-08-06 01:46:57,875][52662] Sum rewards: 70.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.208', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.560', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '58.500'} [2024-08-06 01:46:58,288][52668] DAMAGECOUNT value on done: 238858.0 [2024-08-06 01:46:58,289][52668] Sum rewards: 68.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.120', 'AMMO4': '0.187', 'AMMO3': '0.193', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.000'} [2024-08-06 01:46:59,821][52795] DAMAGECOUNT value on done: 222327.0 [2024-08-06 01:46:59,823][52795] Sum rewards: 75.363, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.292', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.096', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.272', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '67.000'} [2024-08-06 01:47:00,053][52811] DAMAGECOUNT value on done: 229691.0 [2024-08-06 01:47:00,054][52811] Sum rewards: 73.122, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.530', 'AMMO2': '0.022', 'weapon4': '0.110', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon2': '0.222', 'AMMO3': '0.297', 'WEAPON3': '1.850', 'weapon3': '3.486', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '65.000'} [2024-08-06 01:47:00,092][52647] DAMAGECOUNT value on done: 244545.0 [2024-08-06 01:47:00,093][52647] Sum rewards: 64.596, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.187', 'AMMO5': '0.017', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'weapon4': '0.132', 'AMMO3': '0.154', 'weapon5': '0.168', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '0.950', 'weapon3': '3.060', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:00,104][52650] Updated weights for policy 0, policy_version 33021 (0.0029) [2024-08-06 01:47:00,399][52803] DAMAGECOUNT value on done: 217130.0 [2024-08-06 01:47:00,402][52803] Sum rewards: 64.682, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon4': '0.044', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'AMMO4': '0.190', 'weapon2': '0.590', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.094', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:00,577][52667] DAMAGECOUNT value on done: 234536.0 [2024-08-06 01:47:00,580][52667] Sum rewards: 61.333, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.952', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.162', 'weapon2': '0.276', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.276', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:00,744][52662] DAMAGECOUNT value on done: 240926.0 [2024-08-06 01:47:00,744][52662] Sum rewards: 62.665, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon4': '0.188', 'weapon5': '0.196', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:01,424][52668] DAMAGECOUNT value on done: 238127.0 [2024-08-06 01:47:01,425][52668] Sum rewards: 61.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.180', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 270548992. Throughput: 0: 4367.3. Samples: 67637640. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:47:02,794][52567] Avg episode reward: [(0, '63.170')] [2024-08-06 01:47:02,907][52667] DAMAGECOUNT value on done: 235460.0 [2024-08-06 01:47:02,909][52667] Sum rewards: 61.343, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.996', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.159', 'weapon2': '0.786', 'WEAPON3': '1.000', 'weapon3': '3.008', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:02,949][52795] DAMAGECOUNT value on done: 221087.0 [2024-08-06 01:47:02,953][52795] Sum rewards: 52.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon7': '0.048', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON7': '0.200', 'AMMO4': '0.209', 'weapon4': '0.378', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.806', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '43.000'} [2024-08-06 01:47:03,150][52811] DAMAGECOUNT value on done: 216834.0 [2024-08-06 01:47:03,152][52811] Sum rewards: 61.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.110', 'weapon4': '0.128', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:03,244][52647] DAMAGECOUNT value on done: 245803.0 [2024-08-06 01:47:03,244][52647] Sum rewards: 52.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.540', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.208', 'AMMO3': '0.220', 'weapon2': '0.412', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.176', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '46.000'} [2024-08-06 01:47:03,413][52803] DAMAGECOUNT value on done: 219939.0 [2024-08-06 01:47:03,415][52803] Sum rewards: 57.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.063', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.082', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.704', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '2.990', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:03,547][52662] DAMAGECOUNT value on done: 231454.0 [2024-08-06 01:47:03,547][52662] Sum rewards: 64.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.188', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.114', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:03,993][52662] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:47:04,404][52668] DAMAGECOUNT value on done: 228356.0 [2024-08-06 01:47:04,406][52668] Sum rewards: 60.608, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.715', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.120', 'weapon4': '0.148', 'weapon2': '0.700', 'WEAPON3': '0.800', 'HITCOUNT': '2.940', 'weapon3': '2.976', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '47.000'} [2024-08-06 01:47:04,756][52650] Updated weights for policy 0, policy_version 33031 (0.0012) [2024-08-06 01:47:05,723][52667] DAMAGECOUNT value on done: 236724.0 [2024-08-06 01:47:05,725][52667] Sum rewards: 49.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.934', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.142', 'AMMO4': '0.177', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.210', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '43.000'} [2024-08-06 01:47:06,005][52662] DAMAGECOUNT value on done: 238516.0 [2024-08-06 01:47:06,005][52662] Sum rewards: 60.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO3': '0.180', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '3.184', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:06,007][52795] DAMAGECOUNT value on done: 208847.0 [2024-08-06 01:47:06,008][52795] Sum rewards: 57.902, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.266', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.360', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '52.500'} [2024-08-06 01:47:06,105][52647] DAMAGECOUNT value on done: 241291.0 [2024-08-06 01:47:06,105][52647] Sum rewards: 56.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.084', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.068', 'AMMO4': '0.164', 'weapon5': '0.188', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.072', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:06,171][52811] DAMAGECOUNT value on done: 218822.0 [2024-08-06 01:47:06,171][52811] Sum rewards: 66.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.419', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.204', 'AMMO4': '0.241', 'weapon2': '0.276', 'weapon5': '0.282', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.832', 'WEAPON3': '1.250', 'weapon3': '2.330', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:06,256][52649] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:47:06,419][52803] DAMAGECOUNT value on done: 222100.0 [2024-08-06 01:47:06,420][52803] Sum rewards: 65.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.186', 'weapon4': '0.202', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:07,164][52668] DAMAGECOUNT value on done: 236236.0 [2024-08-06 01:47:07,166][52668] Sum rewards: 70.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.385', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 01:47:07,386][52660] DAMAGECOUNT value on done: 231250.0 [2024-08-06 01:47:07,386][52660] Sum rewards: 61.074, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.589', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.196', 'weapon2': '0.278', 'WEAPON4': '0.550', 'weapon4': '0.696', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 270639104. Throughput: 0: 4371.8. Samples: 67664180. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:47:07,794][52567] Avg episode reward: [(0, '63.008')] [2024-08-06 01:47:08,383][52667] DAMAGECOUNT value on done: 232238.0 [2024-08-06 01:47:08,384][52667] Sum rewards: 58.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.598', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:08,789][52662] DAMAGECOUNT value on done: 233691.0 [2024-08-06 01:47:08,789][52662] Sum rewards: 54.203, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.730', 'AMMO5': '0.024', 'AMMO2': '0.048', 'weapon5': '0.182', 'AMMO3': '0.216', 'AMMO4': '0.241', 'weapon4': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.864', 'WEAPON3': '1.350', 'weapon3': '2.328', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:09,090][52795] DAMAGECOUNT value on done: 222946.0 [2024-08-06 01:47:09,090][52795] Sum rewards: 53.622, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.748', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.249', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.216', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:09,196][52647] DAMAGECOUNT value on done: 244485.0 [2024-08-06 01:47:09,196][52647] Sum rewards: 53.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.128', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '45.000'} [2024-08-06 01:47:09,324][52811] DAMAGECOUNT value on done: 216535.0 [2024-08-06 01:47:09,325][52811] Sum rewards: 50.845, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.022', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.298', 'weapon2': '0.506', 'WEAPON3': '1.700', 'weapon3': '2.908', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:09,477][52650] Updated weights for policy 0, policy_version 33041 (0.0021) [2024-08-06 01:47:09,504][52803] DAMAGECOUNT value on done: 220848.0 [2024-08-06 01:47:09,505][52803] Sum rewards: 53.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.191', 'weapon2': '0.294', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.042', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '46.000'} [2024-08-06 01:47:10,114][52668] DAMAGECOUNT value on done: 235278.0 [2024-08-06 01:47:10,118][52668] Sum rewards: 68.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'AMMO2': '0.014', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.244', 'weapon4': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:10,489][52660] DAMAGECOUNT value on done: 232095.0 [2024-08-06 01:47:10,490][52660] Sum rewards: 70.797, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.675', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.179', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '2.886', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '61.000'} [2024-08-06 01:47:10,885][52667] DAMAGECOUNT value on done: 239000.0 [2024-08-06 01:47:10,887][52667] Sum rewards: 59.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.092', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:11,997][52662] DAMAGECOUNT value on done: 239029.0 [2024-08-06 01:47:11,998][52662] Sum rewards: 60.289, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.580', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.075', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.304', 'weapon4': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:12,135][52647] DAMAGECOUNT value on done: 244686.0 [2024-08-06 01:47:12,135][52647] Sum rewards: 60.176, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.506', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.106', 'AMMO4': '0.170', 'weapon5': '0.236', 'AMMO3': '0.269', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.090', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:12,179][52795] DAMAGECOUNT value on done: 221658.0 [2024-08-06 01:47:12,182][52795] Sum rewards: 60.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.449', 'AMMO5': '0.025', 'AMMO2': '0.054', 'AMMO3': '0.145', 'weapon5': '0.228', 'weapon4': '0.260', 'AMMO4': '0.269', 'weapon2': '0.508', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.708', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:12,517][52803] DAMAGECOUNT value on done: 217347.0 [2024-08-06 01:47:12,519][52803] Sum rewards: 48.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '3.178', 'DAMAGECOUNT': '12.318', 'FRAGCOUNT': '42.000'} [2024-08-06 01:47:12,549][52811] DAMAGECOUNT value on done: 217634.0 [2024-08-06 01:47:12,552][52811] Sum rewards: 48.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.950', 'WEAPON3': '1.150', 'weapon3': '2.620', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '42.000'} [2024-08-06 01:47:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 270729216. Throughput: 0: 4373.8. Samples: 67690740. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:47:12,794][52567] Avg episode reward: [(0, '62.546')] [2024-08-06 01:47:13,018][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:47:13,316][52668] DAMAGECOUNT value on done: 235010.0 [2024-08-06 01:47:13,319][52668] Sum rewards: 60.791, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.022', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:13,648][52660] DAMAGECOUNT value on done: 236875.0 [2024-08-06 01:47:13,650][52660] Sum rewards: 67.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.552', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon5': '0.082', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.234', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:13,986][52667] DAMAGECOUNT value on done: 237485.0 [2024-08-06 01:47:13,987][52667] Sum rewards: 68.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.178', 'weapon5': '0.264', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.786', 'WEAPON3': '1.200', 'weapon3': '2.276', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '56.500'} [2024-08-06 01:47:14,148][52650] Updated weights for policy 0, policy_version 33051 (0.0011) [2024-08-06 01:47:14,955][52662] DAMAGECOUNT value on done: 243104.0 [2024-08-06 01:47:14,956][52662] Sum rewards: 46.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.222', 'weapon2': '0.222', 'AMMO4': '0.237', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'weapon4': '0.824', 'WEAPON3': '1.200', 'weapon3': '2.310', 'HITCOUNT': '2.520', 'DAMAGECOUNT': '12.447', 'FRAGCOUNT': '41.000'} [2024-08-06 01:47:15,129][52647] DAMAGECOUNT value on done: 250675.0 [2024-08-06 01:47:15,130][52647] Sum rewards: 74.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.604', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.020', 'AMMO4': '0.033', 'weapon4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.235', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '62.000'} [2024-08-06 01:47:15,631][52811] DAMAGECOUNT value on done: 224461.0 [2024-08-06 01:47:15,632][52811] Sum rewards: 66.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.130', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.452', 'weapon2': '0.664', 'WEAPON3': '1.000', 'weapon3': '2.386', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:15,728][52803] DAMAGECOUNT value on done: 215041.0 [2024-08-06 01:47:15,729][52803] Sum rewards: 60.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.033', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.252', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:16,477][52668] DAMAGECOUNT value on done: 235184.0 [2024-08-06 01:47:16,478][52668] Sum rewards: 71.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.835', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.074', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.198', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '59.000'} [2024-08-06 01:47:16,783][52660] DAMAGECOUNT value on done: 236642.0 [2024-08-06 01:47:16,783][52660] Sum rewards: 75.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.196', 'weapon2': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '63.000'} [2024-08-06 01:47:16,954][52667] DAMAGECOUNT value on done: 238921.0 [2024-08-06 01:47:16,955][52667] Sum rewards: 54.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'weapon2': '0.490', 'weapon4': '0.682', 'WEAPON3': '0.800', 'weapon3': '2.536', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '12.963', 'FRAGCOUNT': '44.000'} [2024-08-06 01:47:17,576][52662] DAMAGECOUNT value on done: 235464.0 [2024-08-06 01:47:17,577][52662] Sum rewards: 50.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.466', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.056', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.308', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '2.960', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '44.000'} [2024-08-06 01:47:17,763][52647] DAMAGECOUNT value on done: 244311.0 [2024-08-06 01:47:17,763][52647] Sum rewards: 72.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.096', 'AMMO3': '0.186', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '60.000'} [2024-08-06 01:47:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 270819328. Throughput: 0: 4384.2. Samples: 67703830. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:47:17,794][52567] Avg episode reward: [(0, '62.771')] [2024-08-06 01:47:18,566][52650] Updated weights for policy 0, policy_version 33061 (0.0014) [2024-08-06 01:47:18,736][52811] DAMAGECOUNT value on done: 220056.0 [2024-08-06 01:47:18,738][52811] Sum rewards: 62.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:18,928][52803] DAMAGECOUNT value on done: 219045.0 [2024-08-06 01:47:18,930][52803] Sum rewards: 54.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.618', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.108', 'weapon5': '0.154', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.550', 'WEAPON3': '0.650', 'weapon4': '0.718', 'weapon3': '2.466', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '42.000'} [2024-08-06 01:47:19,272][52668] DAMAGECOUNT value on done: 236320.0 [2024-08-06 01:47:19,274][52668] Sum rewards: 47.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.945', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.180', 'AMMO3': '0.222', 'AMMO4': '0.240', 'weapon2': '0.316', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '2.768', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '42.000'} [2024-08-06 01:47:19,571][52660] DAMAGECOUNT value on done: 236247.0 [2024-08-06 01:47:19,582][52660] Sum rewards: 67.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.100', 'weapon4': '0.142', 'AMMO4': '0.193', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:19,708][52820] DAMAGECOUNT value on done: 214787.0 [2024-08-06 01:47:19,708][52820] Sum rewards: 56.356, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:20,143][52667] DAMAGECOUNT value on done: 233269.0 [2024-08-06 01:47:20,146][52667] Sum rewards: 70.836, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.132', 'HEALTH': '0.139', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.396', 'weapon4': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:20,153][52662] DAMAGECOUNT value on done: 245805.0 [2024-08-06 01:47:20,155][52662] Sum rewards: 56.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.405', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.198', 'AMMO4': '0.247', 'weapon5': '0.266', 'weapon4': '0.310', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.522', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:20,257][52647] DAMAGECOUNT value on done: 243918.0 [2024-08-06 01:47:20,257][52647] Sum rewards: 57.772, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.450', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.088', 'AMMO4': '0.198', 'weapon4': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '3.080', 'weapon3': '3.084', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:21,025][52669] DAMAGECOUNT value on done: 238022.0 [2024-08-06 01:47:21,031][52669] Sum rewards: 64.133, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.124', 'weapon5': '0.198', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.552', 'WEAPON3': '0.800', 'weapon3': '2.722', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:21,033][52794] DAMAGECOUNT value on done: 237918.0 [2024-08-06 01:47:21,033][52794] Sum rewards: 61.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.972', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO3': '0.155', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.450', 'weapon4': '0.514', 'WEAPON3': '0.950', 'weapon3': '2.770', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:21,930][52811] DAMAGECOUNT value on done: 218367.0 [2024-08-06 01:47:21,932][52811] Sum rewards: 58.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'AMMO4': '0.246', 'weapon4': '0.366', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '51.500'} [2024-08-06 01:47:21,993][52668] DAMAGECOUNT value on done: 237966.0 [2024-08-06 01:47:21,996][52668] Sum rewards: 54.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'weapon5': '0.038', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'AMMO4': '0.224', 'weapon2': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '47.000'} [2024-08-06 01:47:22,105][52803] DAMAGECOUNT value on done: 215369.0 [2024-08-06 01:47:22,106][52803] Sum rewards: 66.566, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.149', 'weapon2': '0.278', 'WEAPON4': '0.450', 'weapon4': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:22,347][52660] DAMAGECOUNT value on done: 231101.0 [2024-08-06 01:47:22,348][52660] Sum rewards: 66.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.156', 'weapon4': '0.158', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:22,748][52820] DAMAGECOUNT value on done: 217658.0 [2024-08-06 01:47:22,750][52820] Sum rewards: 52.995, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.740', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.190', 'AMMO4': '0.201', 'AMMO3': '0.262', 'weapon2': '0.354', 'WEAPON5': '0.400', 'weapon4': '0.440', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.696', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 270909440. Throughput: 0: 4390.0. Samples: 67730030. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:47:22,794][52567] Avg episode reward: [(0, '62.102')] [2024-08-06 01:47:22,895][52662] DAMAGECOUNT value on done: 236204.0 [2024-08-06 01:47:22,897][52662] Sum rewards: 67.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.898', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.154', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.050', 'weapon3': '3.256', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:22,994][52667] DAMAGECOUNT value on done: 233765.0 [2024-08-06 01:47:22,994][52667] Sum rewards: 68.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.308', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 01:47:23,173][52647] DAMAGECOUNT value on done: 244097.0 [2024-08-06 01:47:23,175][52647] Sum rewards: 65.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.195', 'weapon2': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.318', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:23,500][52650] Updated weights for policy 0, policy_version 33071 (0.0035) [2024-08-06 01:47:24,034][52794] DAMAGECOUNT value on done: 241907.0 [2024-08-06 01:47:24,034][52794] Sum rewards: 66.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.154', 'AMMO4': '0.197', 'AMMO3': '0.199', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '57.000'} [2024-08-06 01:47:24,144][52669] DAMAGECOUNT value on done: 231748.0 [2024-08-06 01:47:24,145][52669] Sum rewards: 67.176, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.817', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.156', 'weapon5': '0.158', 'AMMO3': '0.191', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:24,963][52668] DAMAGECOUNT value on done: 233128.0 [2024-08-06 01:47:24,964][52668] Sum rewards: 62.901, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.645', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.278', 'weapon2': '0.314', 'WEAPON3': '1.750', 'weapon3': '3.368', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:24,973][52811] DAMAGECOUNT value on done: 226687.0 [2024-08-06 01:47:24,974][52811] Sum rewards: 63.382, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.580', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.164', 'weapon2': '0.222', 'WEAPON5': '0.300', 'AMMO3': '0.309', 'weapon4': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.014', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '58.000'} [2024-08-06 01:47:25,230][52803] DAMAGECOUNT value on done: 224603.0 [2024-08-06 01:47:25,231][52803] Sum rewards: 57.990, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.260', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '47.500'} [2024-08-06 01:47:25,359][52660] DAMAGECOUNT value on done: 238189.0 [2024-08-06 01:47:25,361][52660] Sum rewards: 66.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.053', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.860', 'WEAPON3': '0.950', 'weapon3': '2.600', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:25,839][52667] DAMAGECOUNT value on done: 237379.0 [2024-08-06 01:47:25,839][52667] Sum rewards: 60.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.932', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO2': '0.054', 'AMMO3': '0.219', 'AMMO4': '0.271', 'WEAPON4': '0.500', 'weapon2': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.618', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:25,880][52820] DAMAGECOUNT value on done: 215402.0 [2024-08-06 01:47:25,882][52820] Sum rewards: 61.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.049', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.209', 'weapon4': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:25,897][52662] DAMAGECOUNT value on done: 236784.0 [2024-08-06 01:47:25,897][52662] Sum rewards: 56.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.612', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.042', 'AMMO4': '0.100', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.516', 'DAMAGECOUNT': '13.842', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:26,299][52647] DAMAGECOUNT value on done: 240236.0 [2024-08-06 01:47:26,299][52647] Sum rewards: 70.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.096', 'AMMO3': '0.178', 'AMMO4': '0.237', 'weapon2': '0.308', 'weapon5': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '2.976', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '57.000'} [2024-08-06 01:47:27,036][52794] DAMAGECOUNT value on done: 236420.0 [2024-08-06 01:47:27,037][52794] Sum rewards: 68.351, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.478', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '60.000'} [2024-08-06 01:47:27,440][52669] DAMAGECOUNT value on done: 236964.0 [2024-08-06 01:47:27,441][52669] Sum rewards: 69.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.047', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.236', 'weapon2': '0.304', 'weapon4': '0.504', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '59.000'} [2024-08-06 01:47:27,727][52668] DAMAGECOUNT value on done: 226862.0 [2024-08-06 01:47:27,728][52668] Sum rewards: 71.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.721', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.091', 'weapon5': '0.156', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2024-08-06 01:47:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17578.1). Total num frames: 270991360. Throughput: 0: 4385.1. Samples: 67756290. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 01:47:27,796][52567] Avg episode reward: [(0, '62.298')] [2024-08-06 01:47:27,944][52811] DAMAGECOUNT value on done: 220341.0 [2024-08-06 01:47:27,944][52650] Updated weights for policy 0, policy_version 33081 (0.0014) [2024-08-06 01:47:27,944][52811] Sum rewards: 58.536, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.156', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.157', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.012', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:27,990][52660] DAMAGECOUNT value on done: 239704.0 [2024-08-06 01:47:27,991][52660] Sum rewards: 62.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.159', 'AMMO3': '0.211', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.856', 'WEAPON3': '1.250', 'weapon3': '2.426', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:28,386][52803] DAMAGECOUNT value on done: 221064.0 [2024-08-06 01:47:28,388][52803] Sum rewards: 60.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.174', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.322', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.878', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:28,818][52662] DAMAGECOUNT value on done: 235677.0 [2024-08-06 01:47:28,818][52662] Sum rewards: 75.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.216', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '61.000'} [2024-08-06 01:47:28,900][52667] DAMAGECOUNT value on done: 237075.0 [2024-08-06 01:47:28,901][52667] Sum rewards: 56.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.026', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.428', 'weapon4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:29,003][52820] DAMAGECOUNT value on done: 207590.0 [2024-08-06 01:47:29,005][52820] Sum rewards: 42.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon7': '0.064', 'weapon5': '0.084', 'AMMO4': '0.095', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.207', 'weapon2': '0.564', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.780', 'DAMAGECOUNT': '11.877', 'FRAGCOUNT': '37.000'} [2024-08-06 01:47:29,554][52647] DAMAGECOUNT value on done: 247340.0 [2024-08-06 01:47:29,563][52647] Sum rewards: 62.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.155', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.185', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '2.880', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:29,905][52794] DAMAGECOUNT value on done: 237780.0 [2024-08-06 01:47:29,907][52794] Sum rewards: 72.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.075', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.618', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '57.000'} [2024-08-06 01:47:30,136][52669] DAMAGECOUNT value on done: 236086.0 [2024-08-06 01:47:30,138][52669] Sum rewards: 60.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.584', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.283', 'weapon2': '0.522', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.160', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:30,898][52811] DAMAGECOUNT value on done: 220760.0 [2024-08-06 01:47:30,900][52811] Sum rewards: 72.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.257', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.338', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '63.000'} [2024-08-06 01:47:30,912][52668] DAMAGECOUNT value on done: 230061.0 [2024-08-06 01:47:30,912][52668] Sum rewards: 60.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.508', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.396', 'weapon4': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:31,166][52660] DAMAGECOUNT value on done: 239339.0 [2024-08-06 01:47:31,168][52660] Sum rewards: 69.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '58.000'} [2024-08-06 01:47:31,523][52803] DAMAGECOUNT value on done: 220340.0 [2024-08-06 01:47:31,532][52803] Sum rewards: 60.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.439', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:31,615][52667] DAMAGECOUNT value on done: 236498.0 [2024-08-06 01:47:31,616][52667] Sum rewards: 56.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.557', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon2': '0.232', 'AMMO3': '0.274', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.582', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:31,744][52662] DAMAGECOUNT value on done: 243177.0 [2024-08-06 01:47:31,744][52662] Sum rewards: 65.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.258', 'weapon4': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '57.000'} [2024-08-06 01:47:32,108][52820] DAMAGECOUNT value on done: 218987.0 [2024-08-06 01:47:32,112][52820] Sum rewards: 61.909, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.515', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.058', 'weapon4': '0.160', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.305', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.236', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '57.000'} [2024-08-06 01:47:32,762][52650] Updated weights for policy 0, policy_version 33091 (0.0030) [2024-08-06 01:47:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 271081472. Throughput: 0: 4384.7. Samples: 67769460. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 01:47:32,794][52567] Avg episode reward: [(0, '62.127')] [2024-08-06 01:47:32,842][52794] DAMAGECOUNT value on done: 234804.0 [2024-08-06 01:47:32,844][52794] Sum rewards: 55.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.926', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.990', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:32,974][52669] DAMAGECOUNT value on done: 232602.0 [2024-08-06 01:47:32,977][52669] Sum rewards: 52.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.954', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon4': '0.120', 'weapon5': '0.184', 'AMMO3': '0.202', 'AMMO4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.910', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '45.000'} [2024-08-06 01:47:33,834][52668] DAMAGECOUNT value on done: 230285.0 [2024-08-06 01:47:33,834][52668] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.808', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.340', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:33,975][52660] DAMAGECOUNT value on done: 232464.0 [2024-08-06 01:47:33,975][52660] Sum rewards: 62.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.130', 'weapon4': '0.132', 'AMMO4': '0.167', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.756', 'WEAPON3': '1.550', 'weapon3': '2.702', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:34,031][52811] DAMAGECOUNT value on done: 222449.0 [2024-08-06 01:47:34,031][52811] Sum rewards: 66.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.858', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:34,165][52667] DAMAGECOUNT value on done: 237140.0 [2024-08-06 01:47:34,166][52667] Sum rewards: 57.529, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.199', 'weapon5': '0.248', 'AMMO4': '0.270', 'weapon4': '0.286', 'weapon2': '0.436', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:34,673][52803] DAMAGECOUNT value on done: 223745.0 [2024-08-06 01:47:34,674][52803] Sum rewards: 65.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.605', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.032', 'weapon5': '0.052', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.414', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:34,829][52662] DAMAGECOUNT value on done: 239105.0 [2024-08-06 01:47:34,834][52662] Sum rewards: 58.913, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.684', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:35,243][52664] DAMAGECOUNT value on done: 241745.0 [2024-08-06 01:47:35,241][52820] DAMAGECOUNT value on done: 214645.0 [2024-08-06 01:47:35,243][52664] Sum rewards: 74.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.867', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.024', 'AMMO4': '0.067', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 01:47:35,243][52820] Sum rewards: 75.832, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.147', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '61.000'} [2024-08-06 01:47:35,862][52669] DAMAGECOUNT value on done: 233133.0 [2024-08-06 01:47:35,863][52669] Sum rewards: 47.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.402', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon4': '0.334', 'weapon2': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.770', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '42.000'} [2024-08-06 01:47:36,026][52794] DAMAGECOUNT value on done: 237845.0 [2024-08-06 01:47:36,028][52794] Sum rewards: 54.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.165', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.466', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.174', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:36,211][52668] DAMAGECOUNT value on done: 234119.0 [2024-08-06 01:47:36,211][52668] Sum rewards: 53.996, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.028', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.322', 'weapon2': '0.408', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '3.052', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '43.000'} [2024-08-06 01:47:36,425][52660] DAMAGECOUNT value on done: 241805.0 [2024-08-06 01:47:36,425][52660] Sum rewards: 61.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.314', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:36,767][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:47:36,950][52650] Updated weights for policy 0, policy_version 33101 (0.0026) [2024-08-06 01:47:37,066][52667] DAMAGECOUNT value on done: 232679.0 [2024-08-06 01:47:37,067][52667] Sum rewards: 63.974, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.082', 'weapon4': '0.118', 'AMMO4': '0.139', 'weapon2': '0.242', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.314', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '58.000'} [2024-08-06 01:47:37,143][52811] DAMAGECOUNT value on done: 217925.0 [2024-08-06 01:47:37,143][52811] Sum rewards: 71.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.236', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.492', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '60.000'} [2024-08-06 01:47:37,776][52803] DAMAGECOUNT value on done: 219850.0 [2024-08-06 01:47:37,782][52803] Sum rewards: 66.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.668', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'weapon4': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:37,783][52664] DAMAGECOUNT value on done: 243866.0 [2024-08-06 01:47:37,786][52664] Sum rewards: 57.924, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.764', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.154', 'AMMO4': '0.195', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 271163392. Throughput: 0: 4385.3. Samples: 67795700. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 01:47:37,795][52567] Avg episode reward: [(0, '61.716')] [2024-08-06 01:47:37,965][52662] DAMAGECOUNT value on done: 244764.0 [2024-08-06 01:47:37,965][52662] Sum rewards: 61.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.209', 'AMMO3': '0.222', 'weapon4': '0.270', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:38,271][52669] DAMAGECOUNT value on done: 236677.0 [2024-08-06 01:47:38,274][52669] Sum rewards: 64.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.151', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:38,452][52820] DAMAGECOUNT value on done: 216725.0 [2024-08-06 01:47:38,452][52820] Sum rewards: 63.254, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.298', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.104', 'AMMO3': '0.236', 'AMMO4': '0.252', 'weapon4': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:38,941][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:47:39,047][52794] DAMAGECOUNT value on done: 241664.0 [2024-08-06 01:47:39,051][52794] Sum rewards: 63.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.130', 'AMMO3': '0.220', 'weapon2': '0.318', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.346', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:39,367][52664] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:47:39,375][52668] DAMAGECOUNT value on done: 231211.0 [2024-08-06 01:47:39,379][52668] Sum rewards: 66.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.221', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.408', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:39,512][52660] DAMAGECOUNT value on done: 226200.0 [2024-08-06 01:47:39,514][52660] Sum rewards: 56.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.769', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon5': '0.234', 'weapon2': '0.374', 'weapon4': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.564', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '46.500'} [2024-08-06 01:47:40,235][52811] DAMAGECOUNT value on done: 224525.0 [2024-08-06 01:47:40,236][52811] Sum rewards: 55.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.505', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.240', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.906', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:40,261][52664] DAMAGECOUNT value on done: 244269.0 [2024-08-06 01:47:40,263][52664] Sum rewards: 48.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.121', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon7': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO4': '0.267', 'WEAPON4': '0.350', 'weapon4': '0.536', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.758', 'DAMAGECOUNT': '13.176', 'FRAGCOUNT': '41.000'} [2024-08-06 01:47:40,324][52667] DAMAGECOUNT value on done: 241338.0 [2024-08-06 01:47:40,324][52667] Sum rewards: 62.649, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.218', 'AMMO4': '0.242', 'weapon5': '0.260', 'weapon2': '0.264', 'weapon4': '0.334', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:40,892][52803] DAMAGECOUNT value on done: 217996.0 [2024-08-06 01:47:40,893][52803] Sum rewards: 68.151, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon4': '0.178', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.190', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 01:47:40,984][52669] DAMAGECOUNT value on done: 235398.0 [2024-08-06 01:47:40,985][52669] Sum rewards: 56.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'weapon4': '0.016', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.548', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '48.000'} [2024-08-06 01:47:41,082][52662] DAMAGECOUNT value on done: 237105.0 [2024-08-06 01:47:41,084][52662] Sum rewards: 73.806, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.425', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'weapon4': '0.238', 'AMMO3': '0.317', 'weapon2': '0.320', 'WEAPON3': '1.850', 'weapon3': '3.096', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '65.000'} [2024-08-06 01:47:41,559][52820] DAMAGECOUNT value on done: 219942.0 [2024-08-06 01:47:41,559][52820] Sum rewards: 50.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'AMMO4': '0.209', 'weapon2': '0.324', 'WEAPON4': '0.400', 'weapon4': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '44.000'} [2024-08-06 01:47:41,877][52794] DAMAGECOUNT value on done: 237003.0 [2024-08-06 01:47:41,885][52794] Sum rewards: 59.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.092', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.460', 'WEAPON3': '1.600', 'weapon3': '2.890', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:42,051][52650] Updated weights for policy 0, policy_version 33111 (0.0021) [2024-08-06 01:47:42,406][52668] DAMAGECOUNT value on done: 237529.0 [2024-08-06 01:47:42,406][52668] Sum rewards: 65.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.765', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.228', 'weapon2': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '57.500'} [2024-08-06 01:47:42,522][52660] DAMAGECOUNT value on done: 232907.0 [2024-08-06 01:47:42,524][52660] Sum rewards: 56.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.229', 'weapon2': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.736', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 271253504. Throughput: 0: 4392.5. Samples: 67822030. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 01:47:42,794][52567] Avg episode reward: [(0, '62.051')] [2024-08-06 01:47:43,083][52664] DAMAGECOUNT value on done: 242905.0 [2024-08-06 01:47:43,083][52664] Sum rewards: 68.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.754', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '58.500'} [2024-08-06 01:47:43,133][52667] DAMAGECOUNT value on done: 245202.0 [2024-08-06 01:47:43,134][52667] Sum rewards: 63.064, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.756', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.114', 'AMMO4': '0.126', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.100', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:43,312][52811] DAMAGECOUNT value on done: 221092.0 [2024-08-06 01:47:43,312][52811] Sum rewards: 61.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.474', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.310', 'weapon3': '3.592', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:43,679][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:47:43,708][52669] DAMAGECOUNT value on done: 236206.0 [2024-08-06 01:47:43,708][52669] Sum rewards: 58.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon5': '0.110', 'AMMO3': '0.224', 'AMMO4': '0.244', 'weapon2': '0.260', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.018', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:43,756][52662] DAMAGECOUNT value on done: 239965.0 [2024-08-06 01:47:43,756][52662] Sum rewards: 78.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.486', 'AMMO5': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.181', 'weapon5': '0.188', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '64.000'} [2024-08-06 01:47:44,171][52803] DAMAGECOUNT value on done: 227289.0 [2024-08-06 01:47:44,173][52803] Sum rewards: 67.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.365', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.143', 'weapon5': '0.166', 'weapon4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.786', 'WEAPON3': '0.900', 'weapon3': '2.708', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '52.500'} [2024-08-06 01:47:44,578][52820] DAMAGECOUNT value on done: 217865.0 [2024-08-06 01:47:44,578][52820] Sum rewards: 59.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.267', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.592', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.128', 'DAMAGECOUNT': '14.247', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:44,781][52794] DAMAGECOUNT value on done: 243378.0 [2024-08-06 01:47:44,783][52794] Sum rewards: 63.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.860', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon4': '0.324', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:45,366][52668] DAMAGECOUNT value on done: 238654.0 [2024-08-06 01:47:45,369][52668] Sum rewards: 63.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:45,389][52658] DAMAGECOUNT value on done: 238627.0 [2024-08-06 01:47:45,389][52658] Sum rewards: 56.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.506', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.142', 'weapon2': '0.188', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '3.156', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '47.000'} [2024-08-06 01:47:45,476][52660] DAMAGECOUNT value on done: 240343.0 [2024-08-06 01:47:45,476][52660] Sum rewards: 53.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.090', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.240', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '3.010', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '47.000'} [2024-08-06 01:47:45,759][52667] DAMAGECOUNT value on done: 238874.0 [2024-08-06 01:47:45,760][52667] Sum rewards: 62.527, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.485', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.192', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '53.000'} [2024-08-06 01:47:46,399][52811] DAMAGECOUNT value on done: 216657.0 [2024-08-06 01:47:46,399][52811] Sum rewards: 53.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.062', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.159', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.560', 'weapon4': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '46.000'} [2024-08-06 01:47:46,476][52664] DAMAGECOUNT value on done: 245102.0 [2024-08-06 01:47:46,477][52664] Sum rewards: 70.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.256', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.110', 'AMMO3': '0.214', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '58.000'} [2024-08-06 01:47:46,552][52669] DAMAGECOUNT value on done: 230749.0 [2024-08-06 01:47:46,553][52669] Sum rewards: 58.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.512', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.080', 'AMMO4': '0.218', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.370', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:46,660][52662] DAMAGECOUNT value on done: 237131.0 [2024-08-06 01:47:46,663][52662] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.684', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.086', 'AMMO3': '0.209', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.366', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.500'} [2024-08-06 01:47:46,909][52650] Updated weights for policy 0, policy_version 33121 (0.0021) [2024-08-06 01:47:47,331][52803] DAMAGECOUNT value on done: 217680.0 [2024-08-06 01:47:47,333][52803] Sum rewards: 61.982, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.126', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.614', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '50.500'} [2024-08-06 01:47:47,545][52794] DAMAGECOUNT value on done: 239881.0 [2024-08-06 01:47:47,546][52794] Sum rewards: 46.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.602', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.200', 'AMMO4': '0.269', 'weapon2': '0.272', 'weapon5': '0.284', 'weapon4': '0.466', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.490', 'weapon3': '2.552', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '42.000'} [2024-08-06 01:47:47,626][52820] DAMAGECOUNT value on done: 218346.0 [2024-08-06 01:47:47,628][52820] Sum rewards: 60.228, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.620', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.128', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'AMMO4': '0.265', 'weapon4': '0.324', 'weapon2': '0.330', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 271343616. Throughput: 0: 4393.1. Samples: 67835330. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 01:47:47,794][52567] Avg episode reward: [(0, '61.966')] [2024-08-06 01:47:48,535][52658] DAMAGECOUNT value on done: 238407.0 [2024-08-06 01:47:48,536][52658] Sum rewards: 62.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.336', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.168', 'weapon4': '0.210', 'AMMO3': '0.219', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.156', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:48,571][52668] DAMAGECOUNT value on done: 234195.0 [2024-08-06 01:47:48,573][52668] Sum rewards: 60.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.142', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.270', 'weapon2': '0.472', 'WEAPON3': '0.900', 'weapon3': '2.824', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:48,605][52660] DAMAGECOUNT value on done: 244371.0 [2024-08-06 01:47:48,607][52660] Sum rewards: 62.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.173', 'weapon4': '0.174', 'weapon2': '0.328', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.272', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:48,893][52664] DAMAGECOUNT value on done: 244587.0 [2024-08-06 01:47:48,897][52664] Sum rewards: 61.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.627', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.162', 'AMMO3': '0.188', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'weapon4': '0.470', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:48,904][52667] DAMAGECOUNT value on done: 240903.0 [2024-08-06 01:47:48,904][52667] Sum rewards: 53.861, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.616', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.172', 'AMMO3': '0.231', 'weapon2': '0.236', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.886', 'DAMAGECOUNT': '13.143', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:49,344][52662] DAMAGECOUNT value on done: 233776.0 [2024-08-06 01:47:49,345][52662] Sum rewards: 52.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.088', 'AMMO3': '0.179', 'AMMO4': '0.307', 'weapon5': '0.310', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '45.000'} [2024-08-06 01:47:49,636][52669] DAMAGECOUNT value on done: 237399.0 [2024-08-06 01:47:49,637][52811] DAMAGECOUNT value on done: 219185.0 [2024-08-06 01:47:49,638][52669] Sum rewards: 73.140, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.742', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.098', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '64.000'} [2024-08-06 01:47:49,641][52811] Sum rewards: 69.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.353', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.182', 'AMMO4': '0.197', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '2.782', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '59.000'} [2024-08-06 01:47:50,438][52794] DAMAGECOUNT value on done: 238324.0 [2024-08-06 01:47:50,438][52794] Sum rewards: 68.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.149', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.179', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.264', 'weapon4': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '58.000'} [2024-08-06 01:47:50,485][52803] DAMAGECOUNT value on done: 223398.0 [2024-08-06 01:47:50,486][52803] Sum rewards: 61.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.525', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.207', 'weapon5': '0.230', 'weapon2': '0.244', 'AMMO4': '0.245', 'weapon4': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.540', 'weapon3': '2.986', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:50,716][52820] DAMAGECOUNT value on done: 218380.0 [2024-08-06 01:47:50,716][52820] Sum rewards: 59.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.268', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'AMMO4': '0.236', 'weapon4': '0.238', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.106', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '52.500'} [2024-08-06 01:47:51,150][52658] DAMAGECOUNT value on done: 238754.0 [2024-08-06 01:47:51,150][52658] Sum rewards: 63.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.165', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.084', 'AMMO4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '51.000'} [2024-08-06 01:47:51,395][52650] Updated weights for policy 0, policy_version 33131 (0.0021) [2024-08-06 01:47:51,417][52667] DAMAGECOUNT value on done: 231389.0 [2024-08-06 01:47:51,418][52667] Sum rewards: 54.202, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.008', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon4': '0.284', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.788', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '47.000'} [2024-08-06 01:47:51,461][52664] DAMAGECOUNT value on done: 249099.0 [2024-08-06 01:47:51,461][52664] Sum rewards: 53.193, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.572', 'AMMO5': '0.027', 'AMMO2': '0.081', 'AMMO3': '0.246', 'weapon5': '0.328', 'weapon2': '0.378', 'AMMO4': '0.403', 'weapon4': '0.442', 'WEAPON5': '0.650', 'WEAPON4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.448', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:51,554][52660] DAMAGECOUNT value on done: 230997.0 [2024-08-06 01:47:51,555][52660] Sum rewards: 59.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.860', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.482', 'weapon4': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:52,421][52669] DAMAGECOUNT value on done: 239220.0 [2024-08-06 01:47:52,429][52669] Sum rewards: 53.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.065', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'weapon5': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.938', 'WEAPON3': '0.950', 'weapon3': '2.478', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '43.000'} [2024-08-06 01:47:52,710][52811] DAMAGECOUNT value on done: 223444.0 [2024-08-06 01:47:52,713][52811] Sum rewards: 62.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.526', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.169', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.416', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '50.000'} [2024-08-06 01:47:52,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 271425536. Throughput: 0: 4384.2. Samples: 67861470. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:47:52,795][52567] Avg episode reward: [(0, '61.961')] [2024-08-06 01:47:53,398][52794] DAMAGECOUNT value on done: 235830.0 [2024-08-06 01:47:53,400][52794] Sum rewards: 60.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.251', 'weapon2': '0.340', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.344', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:53,458][52803] DAMAGECOUNT value on done: 215169.0 [2024-08-06 01:47:53,458][52803] Sum rewards: 64.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.954', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.226', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:53,827][52820] DAMAGECOUNT value on done: 222028.0 [2024-08-06 01:47:53,828][52820] Sum rewards: 61.677, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.197', 'AMMO4': '0.201', 'weapon2': '0.242', 'WEAPON5': '0.250', 'weapon5': '0.250', 'HEALTH': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:53,934][52658] DAMAGECOUNT value on done: 238349.0 [2024-08-06 01:47:53,937][52658] Sum rewards: 73.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '62.000'} [2024-08-06 01:47:54,051][52664] DAMAGECOUNT value on done: 239886.0 [2024-08-06 01:47:54,053][52664] Sum rewards: 69.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.348', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '57.000'} [2024-08-06 01:47:54,303][52667] DAMAGECOUNT value on done: 238916.0 [2024-08-06 01:47:54,305][52667] Sum rewards: 53.081, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.275', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.237', 'AMMO3': '0.257', 'weapon2': '0.412', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.798', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '46.000'} [2024-08-06 01:47:54,361][52660] DAMAGECOUNT value on done: 236835.0 [2024-08-06 01:47:54,362][52660] Sum rewards: 59.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.131', 'AMMO5': '0.014', 'AMMO2': '0.055', 'AMMO3': '0.201', 'weapon5': '0.258', 'AMMO4': '0.274', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '51.500'} [2024-08-06 01:47:55,512][52669] DAMAGECOUNT value on done: 233801.0 [2024-08-06 01:47:55,512][52669] Sum rewards: 63.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.564', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.186', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon4': '0.256', 'AMMO4': '0.266', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:55,892][52811] DAMAGECOUNT value on done: 218696.0 [2024-08-06 01:47:55,897][52811] Sum rewards: 66.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.528', 'weapon2': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.620', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '55.000'} [2024-08-06 01:47:55,900][52650] Updated weights for policy 0, policy_version 33141 (0.0018) [2024-08-06 01:47:56,560][52664] DAMAGECOUNT value on done: 253019.0 [2024-08-06 01:47:56,560][52664] Sum rewards: 64.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.584', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.156', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.150', 'weapon3': '2.690', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '54.000'} [2024-08-06 01:47:56,712][52794] DAMAGECOUNT value on done: 234508.0 [2024-08-06 01:47:56,712][52794] Sum rewards: 60.678, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.076', 'weapon5': '0.134', 'AMMO3': '0.140', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.004', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '49.000'} [2024-08-06 01:47:56,932][52820] DAMAGECOUNT value on done: 218833.0 [2024-08-06 01:47:56,932][52820] Sum rewards: 61.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.876', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.210', 'weapon4': '0.232', 'weapon5': '0.260', 'AMMO4': '0.264', 'weapon2': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '52.000'} [2024-08-06 01:47:57,041][52658] DAMAGECOUNT value on done: 239150.0 [2024-08-06 01:47:57,041][52658] Sum rewards: 68.875, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.177', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.340', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '60.000'} [2024-08-06 01:47:57,410][52660] DAMAGECOUNT value on done: 227614.0 [2024-08-06 01:47:57,410][52660] Sum rewards: 72.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.139', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '62.000'} [2024-08-06 01:47:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 271515648. Throughput: 0: 4380.4. Samples: 67887860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:47:57,794][52567] Avg episode reward: [(0, '61.894')] [2024-08-06 01:47:58,221][52669] DAMAGECOUNT value on done: 238491.0 [2024-08-06 01:47:58,223][52669] Sum rewards: 66.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.562', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.766', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:58,995][52811] DAMAGECOUNT value on done: 224725.0 [2024-08-06 01:47:58,996][52811] Sum rewards: 63.020, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.994', 'AMMO5': '0.008', 'ARMOR': '0.008', 'weapon5': '0.024', 'AMMO2': '0.057', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.219', 'weapon2': '0.262', 'AMMO4': '0.283', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.296', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '56.000'} [2024-08-06 01:47:59,312][52664] DAMAGECOUNT value on done: 246413.0 [2024-08-06 01:47:59,312][52664] Sum rewards: 56.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.110', 'AMMO3': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.248', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '47.000'} [2024-08-06 01:47:59,527][52794] DAMAGECOUNT value on done: 246547.0 [2024-08-06 01:47:59,527][52794] Sum rewards: 69.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.160', 'AMMO3': '0.183', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '59.000'} [2024-08-06 01:47:59,786][52658] DAMAGECOUNT value on done: 235333.0 [2024-08-06 01:47:59,786][52658] Sum rewards: 65.705, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.497', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.135', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'weapon4': '0.474', 'WEAPON3': '0.950', 'weapon3': '2.974', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:00,070][52820] DAMAGECOUNT value on done: 217252.0 [2024-08-06 01:48:00,072][52820] Sum rewards: 65.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.202', 'weapon5': '0.220', 'AMMO4': '0.253', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.682', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '53.000'} [2024-08-06 01:48:00,819][52650] Updated weights for policy 0, policy_version 33151 (0.0032) [2024-08-06 01:48:00,851][52660] DAMAGECOUNT value on done: 235587.0 [2024-08-06 01:48:00,853][52660] Sum rewards: 62.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.224', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.072', 'AMMO4': '0.089', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.672', 'WEAPON3': '0.900', 'HITCOUNT': '3.090', 'weapon3': '3.092', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:01,223][52669] DAMAGECOUNT value on done: 240066.0 [2024-08-06 01:48:01,227][52669] Sum rewards: 68.318, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.899', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.160', 'AMMO4': '0.205', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.400', 'weapon4': '0.428', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '58.000'} [2024-08-06 01:48:01,680][52664] DAMAGECOUNT value on done: 247168.0 [2024-08-06 01:48:01,681][52664] Sum rewards: 70.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.050', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.320', 'weapon4': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '56.500'} [2024-08-06 01:48:01,931][52666] DAMAGECOUNT value on done: 240509.0 [2024-08-06 01:48:01,937][52666] Sum rewards: 65.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.246', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:02,622][52658] DAMAGECOUNT value on done: 243592.0 [2024-08-06 01:48:02,622][52658] Sum rewards: 64.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.474', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '52.000'} [2024-08-06 01:48:02,713][52794] DAMAGECOUNT value on done: 233545.0 [2024-08-06 01:48:02,715][52794] Sum rewards: 51.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.666', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.066', 'weapon5': '0.070', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'AMMO4': '0.332', 'weapon2': '0.434', 'weapon4': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.332', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '43.000'} [2024-08-06 01:48:02,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 271605760. Throughput: 0: 4384.0. Samples: 67901110. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:48:02,794][52567] Avg episode reward: [(0, '62.051')] [2024-08-06 01:48:03,002][52658] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2024-08-06 01:48:03,093][52820] DAMAGECOUNT value on done: 220526.0 [2024-08-06 01:48:03,095][52820] Sum rewards: 66.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '58.000'} [2024-08-06 01:48:03,554][52669] DAMAGECOUNT value on done: 249305.0 [2024-08-06 01:48:03,555][52669] Sum rewards: 58.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.185', 'weapon2': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.294', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:03,837][52660] DAMAGECOUNT value on done: 231958.0 [2024-08-06 01:48:03,838][52660] Sum rewards: 64.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.078', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.462', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.156', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:04,480][52664] DAMAGECOUNT value on done: 244171.0 [2024-08-06 01:48:04,480][52664] Sum rewards: 61.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.070', 'weapon2': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.254', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '50.000'} [2024-08-06 01:48:04,861][52666] DAMAGECOUNT value on done: 240194.0 [2024-08-06 01:48:04,864][52666] Sum rewards: 64.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.691', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.124', 'weapon4': '0.174', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.052', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '55.000'} [2024-08-06 01:48:05,256][52650] Updated weights for policy 0, policy_version 33161 (0.0013) [2024-08-06 01:48:05,348][52658] DAMAGECOUNT value on done: 230602.0 [2024-08-06 01:48:05,349][52658] Sum rewards: 57.723, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.035', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon4': '0.134', 'weapon2': '0.242', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'weapon3': '3.252', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '52.000'} [2024-08-06 01:48:05,590][52794] DAMAGECOUNT value on done: 245294.0 [2024-08-06 01:48:05,591][52794] Sum rewards: 56.574, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.027', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon5': '0.126', 'AMMO4': '0.193', 'AMMO3': '0.260', 'weapon2': '0.370', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.708', 'WEAPON3': '1.550', 'weapon3': '2.474', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:06,226][52820] DAMAGECOUNT value on done: 218509.0 [2024-08-06 01:48:06,226][52820] Sum rewards: 56.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.568', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.203', 'weapon4': '0.262', 'WEAPON4': '0.450', 'weapon2': '0.784', 'WEAPON3': '1.100', 'weapon3': '2.640', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:06,318][52669] DAMAGECOUNT value on done: 232925.0 [2024-08-06 01:48:06,320][52669] Sum rewards: 39.209, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.211', 'AMMO5': '0.005', 'AMMO2': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'AMMO4': '0.251', 'weapon4': '0.312', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '2.856', 'DAMAGECOUNT': '11.694', 'FRAGCOUNT': '38.000'} [2024-08-06 01:48:07,437][52664] DAMAGECOUNT value on done: 245323.0 [2024-08-06 01:48:07,437][52664] Sum rewards: 65.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.964', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.144', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.270', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '55.000'} [2024-08-06 01:48:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 271695872. Throughput: 0: 4386.9. Samples: 67927440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 01:48:07,794][52567] Avg episode reward: [(0, '61.878')] [2024-08-06 01:48:07,802][52663] Large shaping reward -2.503 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('weapon5', 0.002)] [2024-08-06 01:48:07,974][52658] DAMAGECOUNT value on done: 241726.0 [2024-08-06 01:48:07,974][52658] Sum rewards: 66.797, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.342', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '58.000'} [2024-08-06 01:48:08,015][52666] DAMAGECOUNT value on done: 239715.0 [2024-08-06 01:48:08,016][52666] Sum rewards: 65.348, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.194', 'AMMO3': '0.245', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.382', 'weapon4': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.696', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '57.000'} [2024-08-06 01:48:08,486][52794] DAMAGECOUNT value on done: 239185.0 [2024-08-06 01:48:08,486][52794] Sum rewards: 58.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.134', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.416', 'weapon2': '0.516', 'WEAPON3': '0.900', 'weapon3': '2.666', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:09,400][52820] DAMAGECOUNT value on done: 214435.0 [2024-08-06 01:48:09,408][52820] Sum rewards: 69.776, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.178', 'weapon2': '0.618', 'WEAPON3': '1.000', 'weapon3': '3.054', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:09,410][52669] DAMAGECOUNT value on done: 241641.0 [2024-08-06 01:48:09,414][52669] Sum rewards: 67.076, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.740', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon2': '0.252', 'AMMO3': '0.272', 'weapon5': '0.278', 'AMMO4': '0.290', 'weapon4': '0.436', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.628', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '58.000'} [2024-08-06 01:48:10,017][52664] DAMAGECOUNT value on done: 243921.0 [2024-08-06 01:48:10,019][52664] Sum rewards: 70.641, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.668', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.271', 'weapon2': '0.324', 'WEAPON3': '1.700', 'weapon3': '3.392', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '62.000'} [2024-08-06 01:48:10,053][52650] Updated weights for policy 0, policy_version 33171 (0.0020) [2024-08-06 01:48:10,473][52666] DAMAGECOUNT value on done: 234113.0 [2024-08-06 01:48:10,474][52666] Sum rewards: 51.783, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.472', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.138', 'AMMO4': '0.141', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '3.040', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '48.000'} [2024-08-06 01:48:10,597][52658] DAMAGECOUNT value on done: 239586.0 [2024-08-06 01:48:10,598][52658] Sum rewards: 61.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.092', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.154', 'AMMO4': '0.156', 'AMMO3': '0.193', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.606', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:11,578][52794] DAMAGECOUNT value on done: 239575.0 [2024-08-06 01:48:11,578][52794] Sum rewards: 54.445, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.712', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.102', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.480', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.084', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '49.500'} [2024-08-06 01:48:11,899][52671] DAMAGECOUNT value on done: 241557.0 [2024-08-06 01:48:11,899][52671] Sum rewards: 61.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.746', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon5': '0.026', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.474', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.000'} [2024-08-06 01:48:12,008][52670] DAMAGECOUNT value on done: 231844.0 [2024-08-06 01:48:12,009][52670] Sum rewards: 53.191, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.034', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.774', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:12,368][52669] DAMAGECOUNT value on done: 241273.0 [2024-08-06 01:48:12,370][52669] Sum rewards: 59.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'AMMO3': '0.203', 'weapon2': '0.344', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:12,443][52820] DAMAGECOUNT value on done: 224465.0 [2024-08-06 01:48:12,444][52820] Sum rewards: 65.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon2': '0.302', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.904', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '55.000'} [2024-08-06 01:48:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 271785984. Throughput: 0: 4394.0. Samples: 67954020. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:48:12,794][52567] Avg episode reward: [(0, '61.813')] [2024-08-06 01:48:12,874][52658] DAMAGECOUNT value on done: 243206.0 [2024-08-06 01:48:12,874][52658] Sum rewards: 63.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon2': '0.192', 'weapon4': '0.204', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.252', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '55.000'} [2024-08-06 01:48:13,117][52666] DAMAGECOUNT value on done: 232677.0 [2024-08-06 01:48:13,117][52666] Sum rewards: 64.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.104', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.240', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:13,206][52664] DAMAGECOUNT value on done: 247772.0 [2024-08-06 01:48:13,207][52664] Sum rewards: 64.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.528', 'AMMO5': '0.029', 'AMMO2': '0.071', 'AMMO3': '0.253', 'weapon5': '0.288', 'weapon2': '0.290', 'AMMO4': '0.354', 'weapon4': '0.508', 'WEAPON5': '0.800', 'WEAPON4': '0.800', 'WEAPON3': '1.650', 'weapon3': '2.520', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:14,676][52794] DAMAGECOUNT value on done: 249205.0 [2024-08-06 01:48:14,683][52794] Sum rewards: 73.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '62.000'} [2024-08-06 01:48:14,909][52650] Updated weights for policy 0, policy_version 33181 (0.0012) [2024-08-06 01:48:14,962][52671] DAMAGECOUNT value on done: 236248.0 [2024-08-06 01:48:14,963][52671] Sum rewards: 79.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.935', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO3': '0.144', 'AMMO4': '0.162', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '0.900', 'weapon3': '2.960', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '63.000'} [2024-08-06 01:48:15,238][52670] DAMAGECOUNT value on done: 238529.0 [2024-08-06 01:48:15,238][52670] Sum rewards: 61.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.086', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.484', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.160', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:15,353][52658] DAMAGECOUNT value on done: 229249.0 [2024-08-06 01:48:15,354][52658] Sum rewards: 65.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.211', 'weapon2': '0.624', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:15,356][52669] DAMAGECOUNT value on done: 244149.0 [2024-08-06 01:48:15,357][52669] Sum rewards: 61.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.410', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:15,756][52820] DAMAGECOUNT value on done: 227045.0 [2024-08-06 01:48:15,757][52820] Sum rewards: 59.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.040', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.492', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '50.000'} [2024-08-06 01:48:15,835][52664] DAMAGECOUNT value on done: 242662.0 [2024-08-06 01:48:15,835][52664] Sum rewards: 64.434, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.185', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.236', 'AMMO3': '0.248', 'AMMO4': '0.263', 'WEAPON5': '0.400', 'weapon2': '0.444', 'weapon4': '0.448', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.550', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:16,275][52666] DAMAGECOUNT value on done: 228589.0 [2024-08-06 01:48:16,275][52666] Sum rewards: 65.779, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.519', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon2': '0.312', 'AMMO3': '0.369', 'WEAPON3': '2.100', 'weapon3': '3.432', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '61.000'} [2024-08-06 01:48:17,695][52671] DAMAGECOUNT value on done: 239341.0 [2024-08-06 01:48:17,695][52671] Sum rewards: 62.273, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.618', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '50.000'} [2024-08-06 01:48:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 271867904. Throughput: 0: 4384.0. Samples: 67966740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:48:17,794][52567] Avg episode reward: [(0, '62.374')] [2024-08-06 01:48:17,876][52794] DAMAGECOUNT value on done: 239832.0 [2024-08-06 01:48:17,876][52794] Sum rewards: 68.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '57.000'} [2024-08-06 01:48:18,099][52670] DAMAGECOUNT value on done: 231545.0 [2024-08-06 01:48:18,099][52670] Sum rewards: 53.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.060', 'weapon4': '0.098', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.254', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '45.000'} [2024-08-06 01:48:18,406][52664] DAMAGECOUNT value on done: 246302.0 [2024-08-06 01:48:18,407][52664] Sum rewards: 50.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.598', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.156', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.392', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.750', 'weapon3': '2.778', 'DAMAGECOUNT': '12.168', 'FRAGCOUNT': '48.000'} [2024-08-06 01:48:18,489][52658] DAMAGECOUNT value on done: 236316.0 [2024-08-06 01:48:18,490][52658] Sum rewards: 61.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.465', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'weapon2': '0.524', 'weapon4': '0.592', 'WEAPON3': '1.350', 'weapon3': '2.532', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '53.000'} [2024-08-06 01:48:18,784][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:48:18,877][52820] DAMAGECOUNT value on done: 216201.0 [2024-08-06 01:48:18,877][52820] Sum rewards: 52.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.566', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '45.000'} [2024-08-06 01:48:19,251][52666] DAMAGECOUNT value on done: 236984.0 [2024-08-06 01:48:19,251][52666] Sum rewards: 58.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.132', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.404', 'weapon2': '0.666', 'WEAPON3': '1.050', 'weapon3': '2.562', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '50.000'} [2024-08-06 01:48:19,482][52650] Updated weights for policy 0, policy_version 33191 (0.0015) [2024-08-06 01:48:19,797][52668] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:48:20,554][52671] DAMAGECOUNT value on done: 235389.0 [2024-08-06 01:48:20,554][52671] Sum rewards: 57.884, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'weapon4': '0.102', 'AMMO4': '0.126', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.124', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:21,019][52670] DAMAGECOUNT value on done: 231838.0 [2024-08-06 01:48:21,021][52670] Sum rewards: 62.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.964', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.239', 'weapon2': '0.240', 'WEAPON3': '1.500', 'HITCOUNT': '3.380', 'weapon3': '3.402', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '53.500'} [2024-08-06 01:48:21,035][52658] DAMAGECOUNT value on done: 236220.0 [2024-08-06 01:48:21,036][52658] Sum rewards: 65.319, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.092', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.296', 'weapon2': '0.436', 'WEAPON3': '0.950', 'HITCOUNT': '2.950', 'weapon3': '3.044', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '53.000'} [2024-08-06 01:48:21,372][52664] DAMAGECOUNT value on done: 247094.0 [2024-08-06 01:48:21,375][52664] Sum rewards: 55.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.205', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:22,044][52666] DAMAGECOUNT value on done: 235025.0 [2024-08-06 01:48:22,044][52666] Sum rewards: 63.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.298', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.209', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 271958016. Throughput: 0: 4388.7. Samples: 67993190. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:48:22,794][52567] Avg episode reward: [(0, '61.872')] [2024-08-06 01:48:23,373][52671] DAMAGECOUNT value on done: 241794.0 [2024-08-06 01:48:23,373][52671] Sum rewards: 66.479, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO4': '0.133', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.284', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '52.500'} [2024-08-06 01:48:23,935][52670] DAMAGECOUNT value on done: 236805.0 [2024-08-06 01:48:23,935][52670] Sum rewards: 68.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.102', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.140', 'weapon4': '0.160', 'AMMO3': '0.207', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:23,984][52664] DAMAGECOUNT value on done: 245076.0 [2024-08-06 01:48:23,984][52664] Sum rewards: 73.288, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.770', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '3.146', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '58.000'} [2024-08-06 01:48:24,017][52650] Updated weights for policy 0, policy_version 33201 (0.0020) [2024-08-06 01:48:24,322][52658] DAMAGECOUNT value on done: 230279.0 [2024-08-06 01:48:24,324][52658] Sum rewards: 54.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.954', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon5': '0.160', 'AMMO3': '0.191', 'AMMO4': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.508', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.502', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '48.000'} [2024-08-06 01:48:24,915][52666] DAMAGECOUNT value on done: 235768.0 [2024-08-06 01:48:24,916][52666] Sum rewards: 74.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.833', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.253', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '64.000'} [2024-08-06 01:48:25,858][52671] DAMAGECOUNT value on done: 237664.0 [2024-08-06 01:48:25,859][52671] Sum rewards: 62.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.062', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.196', 'weapon2': '0.198', 'WEAPON4': '0.400', 'weapon4': '0.554', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '53.000'} [2024-08-06 01:48:26,608][52670] DAMAGECOUNT value on done: 235909.0 [2024-08-06 01:48:26,608][52670] Sum rewards: 73.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.044', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.100', 'HITCOUNT': '3.450', 'weapon3': '3.490', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 01:48:27,159][52664] DAMAGECOUNT value on done: 246405.0 [2024-08-06 01:48:27,159][52664] Sum rewards: 67.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.128', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.500', 'weapon2': '0.506', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.630', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '58.000'} [2024-08-06 01:48:27,280][52658] DAMAGECOUNT value on done: 236915.0 [2024-08-06 01:48:27,280][52658] Sum rewards: 64.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO5': '0.021', 'AMMO2': '0.036', 'weapon4': '0.064', 'AMMO3': '0.168', 'weapon5': '0.168', 'AMMO4': '0.179', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 272039936. Throughput: 0: 4388.2. Samples: 68019500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:48:27,794][52567] Avg episode reward: [(0, '62.468')] [2024-08-06 01:48:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033208_272039936.pth... [2024-08-06 01:48:27,901][52666] DAMAGECOUNT value on done: 234841.0 [2024-08-06 01:48:27,901][52666] Sum rewards: 70.800, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.228', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.189', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.500', 'weapon4': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '61.000'} [2024-08-06 01:48:27,944][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032694_267829248.pth [2024-08-06 01:48:28,487][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:48:28,610][52671] DAMAGECOUNT value on done: 240082.0 [2024-08-06 01:48:28,610][52671] Sum rewards: 58.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.175', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.157', 'AMMO3': '0.217', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '50.000'} [2024-08-06 01:48:28,981][52650] Updated weights for policy 0, policy_version 33211 (0.0020) [2024-08-06 01:48:29,846][52658] DAMAGECOUNT value on done: 242045.0 [2024-08-06 01:48:29,846][52658] Sum rewards: 73.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.739', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '63.000'} [2024-08-06 01:48:29,973][52670] DAMAGECOUNT value on done: 230034.0 [2024-08-06 01:48:29,974][52670] Sum rewards: 66.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.353', 'AMMO5': '0.008', 'ARMOR': '0.020', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.128', 'AMMO4': '0.175', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.208', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '55.500'} [2024-08-06 01:48:31,003][52666] DAMAGECOUNT value on done: 233210.0 [2024-08-06 01:48:31,007][52666] Sum rewards: 70.302, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.575', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.508', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.228', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '58.000'} [2024-08-06 01:48:31,806][52671] DAMAGECOUNT value on done: 241073.0 [2024-08-06 01:48:31,808][52671] Sum rewards: 64.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.128', 'weapon4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '55.000'} [2024-08-06 01:48:32,443][52614] Signal inference workers to stop experience collection... (6000 times) [2024-08-06 01:48:32,444][52614] Signal inference workers to resume experience collection... (6000 times) [2024-08-06 01:48:32,482][52650] InferenceWorker_p0-w0: stopping experience collection (6000 times) [2024-08-06 01:48:32,482][52650] InferenceWorker_p0-w0: resuming experience collection (6000 times) [2024-08-06 01:48:32,733][52658] DAMAGECOUNT value on done: 233844.0 [2024-08-06 01:48:32,733][52658] Sum rewards: 60.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon4': '0.140', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.014', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '49.000'} [2024-08-06 01:48:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 272138240. Throughput: 0: 4376.2. Samples: 68032260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:48:32,794][52567] Avg episode reward: [(0, '63.050')] [2024-08-06 01:48:32,814][52670] DAMAGECOUNT value on done: 234113.0 [2024-08-06 01:48:32,814][52670] Sum rewards: 45.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.014', 'AMMO2': '0.070', 'weapon5': '0.076', 'AMMO3': '0.209', 'weapon4': '0.348', 'WEAPON5': '0.350', 'AMMO4': '0.351', 'weapon2': '0.384', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '2.954', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '42.000'} [2024-08-06 01:48:33,577][52666] DAMAGECOUNT value on done: 227791.0 [2024-08-06 01:48:33,577][52666] Sum rewards: 61.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.327', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.068', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.602', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.118', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:33,879][52650] Updated weights for policy 0, policy_version 33221 (0.0029) [2024-08-06 01:48:34,517][52671] DAMAGECOUNT value on done: 234631.0 [2024-08-06 01:48:34,520][52671] Sum rewards: 53.211, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.028', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.136', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '46.000'} [2024-08-06 01:48:35,546][52670] DAMAGECOUNT value on done: 232579.0 [2024-08-06 01:48:35,548][52670] Sum rewards: 68.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.914', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.196', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '57.000'} [2024-08-06 01:48:35,754][52658] DAMAGECOUNT value on done: 236103.0 [2024-08-06 01:48:35,755][52658] Sum rewards: 72.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.221', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '60.000'} [2024-08-06 01:48:36,494][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:48:36,548][52666] DAMAGECOUNT value on done: 240284.0 [2024-08-06 01:48:36,551][52666] Sum rewards: 59.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.062', 'AMMO3': '0.168', 'AMMO4': '0.203', 'weapon2': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.084', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '50.000'} [2024-08-06 01:48:37,453][52671] DAMAGECOUNT value on done: 242038.0 [2024-08-06 01:48:37,454][52671] Sum rewards: 62.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.845', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.458', 'weapon4': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 272220160. Throughput: 0: 4384.0. Samples: 68058750. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 01:48:37,794][52567] Avg episode reward: [(0, '62.807')] [2024-08-06 01:48:38,155][52650] Updated weights for policy 0, policy_version 33231 (0.0012) [2024-08-06 01:48:38,233][52670] DAMAGECOUNT value on done: 227546.0 [2024-08-06 01:48:38,233][52670] Sum rewards: 67.017, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.214', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.141', 'AMMO4': '0.143', 'weapon5': '0.190', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon4': '0.912', 'weapon3': '2.394', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '52.000'} [2024-08-06 01:48:38,699][52658] DAMAGECOUNT value on done: 239412.0 [2024-08-06 01:48:38,709][52658] Sum rewards: 62.574, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.845', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.234', 'weapon4': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '50.000'} [2024-08-06 01:48:39,375][52666] DAMAGECOUNT value on done: 237981.0 [2024-08-06 01:48:39,375][52666] Sum rewards: 67.605, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.162', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:40,234][52671] DAMAGECOUNT value on done: 241894.0 [2024-08-06 01:48:40,238][52671] Sum rewards: 77.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.075', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '66.000'} [2024-08-06 01:48:41,496][52670] DAMAGECOUNT value on done: 239575.0 [2024-08-06 01:48:41,497][52670] Sum rewards: 63.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.814', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:42,297][52666] DAMAGECOUNT value on done: 233268.0 [2024-08-06 01:48:42,297][52666] Sum rewards: 82.522, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.212', 'weapon2': '0.368', 'HEALTH': '0.554', 'WEAPON3': '1.200', 'weapon3': '3.364', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '68.000'} [2024-08-06 01:48:42,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 272302080. Throughput: 0: 4383.3. Samples: 68085110. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 01:48:42,794][52567] Avg episode reward: [(0, '63.572')] [2024-08-06 01:48:43,005][52650] Updated weights for policy 0, policy_version 33241 (0.0012) [2024-08-06 01:48:43,369][52671] DAMAGECOUNT value on done: 238366.0 [2024-08-06 01:48:43,369][52671] Sum rewards: 68.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.114', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.178', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '3.200', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '56.000'} [2024-08-06 01:48:44,198][52670] DAMAGECOUNT value on done: 236190.0 [2024-08-06 01:48:44,206][52670] Sum rewards: 48.846, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.290', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.082', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'AMMO3': '0.305', 'weapon2': '0.418', 'weapon4': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.698', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:45,354][52666] DAMAGECOUNT value on done: 232461.0 [2024-08-06 01:48:45,355][52666] Sum rewards: 66.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.066', 'weapon4': '0.128', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '57.000'} [2024-08-06 01:48:45,485][52794] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:48:45,971][52663] DAMAGECOUNT value on done: 240850.0 [2024-08-06 01:48:45,971][52663] Sum rewards: 92.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.193', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.212', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '22.578', 'FRAGCOUNT': '75.500'} [2024-08-06 01:48:46,304][52671] DAMAGECOUNT value on done: 245861.0 [2024-08-06 01:48:46,306][52671] Sum rewards: 65.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.085', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.170', 'weapon5': '0.232', 'AMMO4': '0.238', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.840', 'WEAPON3': '1.000', 'weapon3': '2.058', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:47,357][52650] Updated weights for policy 0, policy_version 33251 (0.0021) [2024-08-06 01:48:47,367][52670] DAMAGECOUNT value on done: 234302.0 [2024-08-06 01:48:47,369][52670] Sum rewards: 51.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.106', 'AMMO4': '0.141', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '2.976', 'DAMAGECOUNT': '12.774', 'FRAGCOUNT': '43.000'} [2024-08-06 01:48:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 272392192. Throughput: 0: 4384.4. Samples: 68098410. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 01:48:47,795][52567] Avg episode reward: [(0, '63.696')] [2024-08-06 01:48:47,890][52659] DAMAGECOUNT value on done: 238246.0 [2024-08-06 01:48:47,890][52659] Sum rewards: 64.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.412', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.072', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:48,386][52666] DAMAGECOUNT value on done: 230580.0 [2024-08-06 01:48:48,386][52666] Sum rewards: 47.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.468', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.244', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '2.530', 'weapon3': '3.214', 'DAMAGECOUNT': '12.309', 'FRAGCOUNT': '43.000'} [2024-08-06 01:48:48,591][52663] DAMAGECOUNT value on done: 236740.0 [2024-08-06 01:48:48,591][52663] Sum rewards: 67.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.237', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.412', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '57.000'} [2024-08-06 01:48:49,052][52671] DAMAGECOUNT value on done: 235704.0 [2024-08-06 01:48:49,055][52671] Sum rewards: 48.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon7': '0.050', 'weapon5': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'AMMO4': '0.189', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '39.000'} [2024-08-06 01:48:50,153][52670] DAMAGECOUNT value on done: 237092.0 [2024-08-06 01:48:50,153][52670] Sum rewards: 76.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.914', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.126', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '62.000'} [2024-08-06 01:48:50,807][52659] DAMAGECOUNT value on done: 235987.0 [2024-08-06 01:48:50,807][52659] Sum rewards: 67.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.320', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.047', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.540', 'WEAPON3': '1.050', 'weapon3': '3.176', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '55.000'} [2024-08-06 01:48:51,015][52666] DAMAGECOUNT value on done: 238717.0 [2024-08-06 01:48:51,016][52666] Sum rewards: 59.896, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.703', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.206', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '52.000'} [2024-08-06 01:48:51,830][52663] DAMAGECOUNT value on done: 232940.0 [2024-08-06 01:48:51,831][52663] Sum rewards: 58.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'weapon2': '0.228', 'AMMO3': '0.247', 'weapon4': '0.434', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '49.000'} [2024-08-06 01:48:51,862][52671] DAMAGECOUNT value on done: 230329.0 [2024-08-06 01:48:51,863][52671] Sum rewards: 48.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.688', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.230', 'weapon2': '0.470', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.196', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '40.000'} [2024-08-06 01:48:52,033][52650] Updated weights for policy 0, policy_version 33261 (0.0018) [2024-08-06 01:48:52,736][52670] DAMAGECOUNT value on done: 237705.0 [2024-08-06 01:48:52,736][52670] Sum rewards: 65.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.164', 'AMMO2': '0.025', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '57.000'} [2024-08-06 01:48:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 272482304. Throughput: 0: 4381.5. Samples: 68124610. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 01:48:52,795][52567] Avg episode reward: [(0, '63.275')] [2024-08-06 01:48:53,669][52666] DAMAGECOUNT value on done: 230084.0 [2024-08-06 01:48:53,669][52666] Sum rewards: 63.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.148', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '53.000'} [2024-08-06 01:48:53,740][52659] DAMAGECOUNT value on done: 236702.0 [2024-08-06 01:48:53,740][52659] Sum rewards: 48.389, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.486', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.158', 'AMMO3': '0.234', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.534', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.700', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '43.000'} [2024-08-06 01:48:54,761][52671] DAMAGECOUNT value on done: 239779.0 [2024-08-06 01:48:54,762][52671] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.375', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.224', 'weapon2': '0.472', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.114', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '49.000'} [2024-08-06 01:48:54,883][52666] Large shaping reward -2.510 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.261, -87.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:48:55,029][52663] DAMAGECOUNT value on done: 238718.0 [2024-08-06 01:48:55,029][52663] Sum rewards: 58.876, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.110', 'ARMOR': '0.004', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.036', 'AMMO4': '0.101', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '55.000'} [2024-08-06 01:48:55,218][52670] DAMAGECOUNT value on done: 225445.0 [2024-08-06 01:48:55,226][52670] Sum rewards: 58.645, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.895', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.176', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '52.000'} [2024-08-06 01:48:56,232][52659] DAMAGECOUNT value on done: 235688.0 [2024-08-06 01:48:56,233][52659] Sum rewards: 59.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.972', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:56,259][52666] DAMAGECOUNT value on done: 235704.0 [2024-08-06 01:48:56,260][52666] Sum rewards: 65.536, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.149', 'HEALTH': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.502', 'WEAPON3': '0.900', 'weapon3': '3.008', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:56,379][52650] Updated weights for policy 0, policy_version 33271 (0.0030) [2024-08-06 01:48:56,843][52649] DAMAGECOUNT value on done: 230109.0 [2024-08-06 01:48:56,844][52649] Sum rewards: 48.407, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.445', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO3': '0.129', 'AMMO4': '0.142', 'weapon5': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON5': '0.350', 'weapon2': '0.564', 'WEAPON3': '0.850', 'HITCOUNT': '2.510', 'weapon3': '2.752', 'DAMAGECOUNT': '11.793', 'FRAGCOUNT': '39.000'} [2024-08-06 01:48:56,940][52671] DAMAGECOUNT value on done: 240513.0 [2024-08-06 01:48:56,941][52671] Sum rewards: 61.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.934', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.148', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.626', 'weapon2': '0.688', 'WEAPON3': '1.000', 'weapon3': '2.334', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '51.000'} [2024-08-06 01:48:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 272572416. Throughput: 0: 4379.3. Samples: 68151090. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:48:57,795][52567] Avg episode reward: [(0, '62.685')] [2024-08-06 01:48:58,127][52670] DAMAGECOUNT value on done: 238938.0 [2024-08-06 01:48:58,127][52670] Sum rewards: 76.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '62.000'} [2024-08-06 01:48:58,275][52663] DAMAGECOUNT value on done: 236093.0 [2024-08-06 01:48:58,276][52663] Sum rewards: 59.496, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.542', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'weapon4': '0.428', 'WEAPON3': '1.750', 'weapon3': '3.104', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '54.000'} [2024-08-06 01:48:59,097][52659] DAMAGECOUNT value on done: 233387.0 [2024-08-06 01:48:59,097][52659] Sum rewards: 53.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon5': '0.198', 'AMMO3': '0.203', 'AMMO4': '0.255', 'weapon4': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.656', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '47.000'} [2024-08-06 01:48:59,999][52649] DAMAGECOUNT value on done: 223632.0 [2024-08-06 01:49:00,000][52649] Sum rewards: 64.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.308', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:00,182][52671] DAMAGECOUNT value on done: 244133.0 [2024-08-06 01:49:00,182][52671] Sum rewards: 67.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.330', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.170', 'weapon4': '0.178', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '55.000'} [2024-08-06 01:49:01,376][52670] DAMAGECOUNT value on done: 239760.0 [2024-08-06 01:49:01,376][52670] Sum rewards: 54.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.156', 'AMMO4': '0.175', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.176', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '46.000'} [2024-08-06 01:49:01,486][52663] DAMAGECOUNT value on done: 241393.0 [2024-08-06 01:49:01,490][52663] Sum rewards: 77.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.948', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.044', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'weapon4': '0.298', 'WEAPON4': '0.400', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '62.000'} [2024-08-06 01:49:01,550][52650] Updated weights for policy 0, policy_version 33281 (0.0020) [2024-08-06 01:49:02,061][52659] DAMAGECOUNT value on done: 236514.0 [2024-08-06 01:49:02,063][52659] Sum rewards: 64.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.214', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.180', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:02,695][52649] DAMAGECOUNT value on done: 232583.0 [2024-08-06 01:49:02,695][52649] Sum rewards: 53.386, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.738', 'weapon5': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.057', 'AMMO3': '0.228', 'AMMO4': '0.286', 'weapon4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.646', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '49.000'} [2024-08-06 01:49:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 272662528. Throughput: 0: 4386.0. Samples: 68164110. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:49:02,795][52567] Avg episode reward: [(0, '63.151')] [2024-08-06 01:49:03,146][52671] DAMAGECOUNT value on done: 239846.0 [2024-08-06 01:49:03,149][52671] Sum rewards: 53.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.132', 'AMMO3': '0.222', 'AMMO4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '45.500'} [2024-08-06 01:49:04,480][52670] DAMAGECOUNT value on done: 234379.0 [2024-08-06 01:49:04,481][52670] Sum rewards: 65.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.044', 'AMMO4': '0.171', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.116', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:04,530][52663] DAMAGECOUNT value on done: 237940.0 [2024-08-06 01:49:04,530][52663] Sum rewards: 60.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.925', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '2.758', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:05,032][52659] DAMAGECOUNT value on done: 236596.0 [2024-08-06 01:49:05,033][52659] Sum rewards: 63.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.855', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO3': '0.234', 'weapon2': '0.442', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.222', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '55.000'} [2024-08-06 01:49:05,416][52649] DAMAGECOUNT value on done: 233281.0 [2024-08-06 01:49:05,418][52649] Sum rewards: 65.501, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.898', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.128', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.930', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '57.000'} [2024-08-06 01:49:05,843][52671] DAMAGECOUNT value on done: 236583.0 [2024-08-06 01:49:05,844][52671] Sum rewards: 79.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.208', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.508', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '66.000'} [2024-08-06 01:49:05,968][52650] Updated weights for policy 0, policy_version 33291 (0.0011) [2024-08-06 01:49:07,410][52663] DAMAGECOUNT value on done: 238040.0 [2024-08-06 01:49:07,411][52663] Sum rewards: 62.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.195', 'weapon2': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.840', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '51.000'} [2024-08-06 01:49:07,441][52670] DAMAGECOUNT value on done: 237689.0 [2024-08-06 01:49:07,441][52670] Sum rewards: 63.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.934', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.159', 'weapon4': '0.286', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.196', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '52.000'} [2024-08-06 01:49:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 272752640. Throughput: 0: 4389.1. Samples: 68190700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:49:07,794][52567] Avg episode reward: [(0, '63.116')] [2024-08-06 01:49:07,881][52659] DAMAGECOUNT value on done: 232409.0 [2024-08-06 01:49:07,882][52659] Sum rewards: 59.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '50.000'} [2024-08-06 01:49:08,096][52649] DAMAGECOUNT value on done: 223653.0 [2024-08-06 01:49:08,097][52649] Sum rewards: 75.588, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.177', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.152', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '61.000'} [2024-08-06 01:49:10,183][52663] DAMAGECOUNT value on done: 236199.0 [2024-08-06 01:49:10,183][52663] Sum rewards: 59.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.275', 'WEAPON5': '0.400', 'weapon2': '0.440', 'weapon4': '0.582', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.430', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '49.000'} [2024-08-06 01:49:10,380][52659] DAMAGECOUNT value on done: 242380.0 [2024-08-06 01:49:10,380][52659] Sum rewards: 64.583, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.069', 'weapon4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:10,626][52650] Updated weights for policy 0, policy_version 33301 (0.0012) [2024-08-06 01:49:10,644][52649] DAMAGECOUNT value on done: 233995.0 [2024-08-06 01:49:10,646][52649] Sum rewards: 72.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.220', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '61.000'} [2024-08-06 01:49:11,655][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:49:12,653][52665] DAMAGECOUNT value on done: 234061.0 [2024-08-06 01:49:12,653][52665] Sum rewards: 61.300, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.204', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.218', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'HITCOUNT': '3.260', 'weapon3': '3.506', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 272834560. Throughput: 0: 4391.3. Samples: 68217110. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:49:12,794][52567] Avg episode reward: [(0, '63.488')] [2024-08-06 01:49:12,919][52659] DAMAGECOUNT value on done: 241640.0 [2024-08-06 01:49:12,920][52659] Sum rewards: 63.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.367', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.108', 'weapon4': '0.138', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:13,364][52649] DAMAGECOUNT value on done: 229160.0 [2024-08-06 01:49:13,365][52649] Sum rewards: 60.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.384', 'AMMO5': '0.005', 'ARMOR': '0.008', 'weapon5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.506', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.248', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '52.000'} [2024-08-06 01:49:13,540][52663] DAMAGECOUNT value on done: 238550.0 [2024-08-06 01:49:13,541][52663] Sum rewards: 70.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.812', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.174', 'weapon5': '0.176', 'AMMO4': '0.213', 'weapon2': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '58.000'} [2024-08-06 01:49:15,137][52650] Updated weights for policy 0, policy_version 33311 (0.0022) [2024-08-06 01:49:15,565][52659] DAMAGECOUNT value on done: 236298.0 [2024-08-06 01:49:15,566][52659] Sum rewards: 64.104, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.420', 'AMMO5': '0.010', 'weapon5': '0.044', 'AMMO2': '0.045', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.600', 'weapon3': '2.980', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '57.000'} [2024-08-06 01:49:15,895][52665] DAMAGECOUNT value on done: 239620.0 [2024-08-06 01:49:15,896][52665] Sum rewards: 64.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.614', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.166', 'AMMO3': '0.201', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '55.500'} [2024-08-06 01:49:16,393][52663] DAMAGECOUNT value on done: 241747.0 [2024-08-06 01:49:16,394][52663] Sum rewards: 55.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.012', 'AMMO2': '0.067', 'weapon5': '0.176', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.336', 'weapon2': '0.360', 'WEAPON4': '0.650', 'weapon4': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.262', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '47.000'} [2024-08-06 01:49:16,617][52649] DAMAGECOUNT value on done: 237062.0 [2024-08-06 01:49:16,619][52649] Sum rewards: 67.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.820', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 272924672. Throughput: 0: 4404.4. Samples: 68230460. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:49:17,794][52567] Avg episode reward: [(0, '63.223')] [2024-08-06 01:49:18,468][52659] DAMAGECOUNT value on done: 235615.0 [2024-08-06 01:49:18,469][52659] Sum rewards: 69.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.136', 'AMMO4': '0.165', 'weapon2': '0.196', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '58.000'} [2024-08-06 01:49:19,010][52665] DAMAGECOUNT value on done: 233968.0 [2024-08-06 01:49:19,011][52665] Sum rewards: 59.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.747', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.190', 'weapon5': '0.202', 'AMMO4': '0.209', 'WEAPON5': '0.300', 'weapon4': '0.480', 'WEAPON4': '0.500', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.454', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '51.000'} [2024-08-06 01:49:19,491][52649] DAMAGECOUNT value on done: 233033.0 [2024-08-06 01:49:19,491][52649] Sum rewards: 62.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.310', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.044', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.934', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:19,558][52663] DAMAGECOUNT value on done: 235648.0 [2024-08-06 01:49:19,558][52663] Sum rewards: 67.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.180', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '58.000'} [2024-08-06 01:49:20,157][52650] Updated weights for policy 0, policy_version 33321 (0.0015) [2024-08-06 01:49:20,945][52659] DAMAGECOUNT value on done: 232319.0 [2024-08-06 01:49:20,947][52659] Sum rewards: 57.636, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.420', 'AMMO5': '0.019', 'AMMO2': '0.061', 'AMMO3': '0.222', 'weapon5': '0.252', 'weapon4': '0.296', 'AMMO4': '0.304', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '51.000'} [2024-08-06 01:49:21,875][52665] DAMAGECOUNT value on done: 233528.0 [2024-08-06 01:49:21,875][52665] Sum rewards: 74.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.077', 'weapon4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '62.000'} [2024-08-06 01:49:22,363][52649] DAMAGECOUNT value on done: 231494.0 [2024-08-06 01:49:22,363][52649] Sum rewards: 51.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.475', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.386', 'weapon4': '0.478', 'WEAPON3': '1.550', 'weapon3': '2.840', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '46.000'} [2024-08-06 01:49:22,685][52663] DAMAGECOUNT value on done: 230444.0 [2024-08-06 01:49:22,685][52663] Sum rewards: 66.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon2': '0.206', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.390', 'weapon3': '3.468', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 01:49:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 273006592. Throughput: 0: 4392.0. Samples: 68256390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:49:22,802][52567] Avg episode reward: [(0, '63.452')] [2024-08-06 01:49:23,329][52659] DAMAGECOUNT value on done: 238173.0 [2024-08-06 01:49:23,344][52659] Sum rewards: 63.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.598', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon4': '0.194', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.172', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '53.000'} [2024-08-06 01:49:24,389][52665] DAMAGECOUNT value on done: 230523.0 [2024-08-06 01:49:24,389][52665] Sum rewards: 59.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.102', 'AMMO4': '0.177', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '50.000'} [2024-08-06 01:49:24,510][52650] Updated weights for policy 0, policy_version 33331 (0.0010) [2024-08-06 01:49:25,058][52649] DAMAGECOUNT value on done: 233903.0 [2024-08-06 01:49:25,059][52649] Sum rewards: 70.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '60.000'} [2024-08-06 01:49:25,686][52663] DAMAGECOUNT value on done: 231624.0 [2024-08-06 01:49:25,686][52663] Sum rewards: 65.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.735', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.248', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.490', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:26,099][52659] DAMAGECOUNT value on done: 241232.0 [2024-08-06 01:49:26,099][52659] Sum rewards: 58.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.065', 'AMMO3': '0.164', 'weapon5': '0.216', 'weapon2': '0.296', 'WEAPON5': '0.300', 'AMMO4': '0.326', 'WEAPON4': '0.550', 'weapon4': '0.792', 'WEAPON3': '1.050', 'weapon3': '2.410', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '45.000'} [2024-08-06 01:49:27,664][52665] DAMAGECOUNT value on done: 227887.0 [2024-08-06 01:49:27,666][52665] Sum rewards: 53.996, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.192', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon4': '0.274', 'weapon2': '0.912', 'WEAPON3': '0.950', 'weapon3': '2.530', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.846', 'FRAGCOUNT': '44.000'} [2024-08-06 01:49:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 273096704. Throughput: 0: 4396.4. Samples: 68282950. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:49:27,794][52567] Avg episode reward: [(0, '63.575')] [2024-08-06 01:49:28,363][52649] DAMAGECOUNT value on done: 231730.0 [2024-08-06 01:49:28,365][52649] Sum rewards: 64.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.295', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.147', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.306', 'weapon2': '0.446', 'WEAPON3': '1.000', 'weapon3': '2.860', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '51.500'} [2024-08-06 01:49:28,828][52663] DAMAGECOUNT value on done: 237360.0 [2024-08-06 01:49:28,832][52663] Sum rewards: 68.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.989', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.172', 'weapon5': '0.208', 'AMMO4': '0.215', 'weapon2': '0.254', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.808', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:29,020][52659] DAMAGECOUNT value on done: 245134.0 [2024-08-06 01:49:29,020][52659] Sum rewards: 72.494, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.548', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.134', 'AMMO3': '0.208', 'AMMO4': '0.269', 'weapon4': '0.336', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '62.000'} [2024-08-06 01:49:29,393][52650] Updated weights for policy 0, policy_version 33341 (0.0014) [2024-08-06 01:49:30,718][52665] DAMAGECOUNT value on done: 237187.0 [2024-08-06 01:49:30,718][52665] Sum rewards: 62.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.046', 'AMMO2': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.189', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '51.000'} [2024-08-06 01:49:31,455][52663] DAMAGECOUNT value on done: 241028.0 [2024-08-06 01:49:31,458][52663] Sum rewards: 70.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '60.000'} [2024-08-06 01:49:31,475][52659] DAMAGECOUNT value on done: 242619.0 [2024-08-06 01:49:31,477][52659] Sum rewards: 58.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO2': '0.022', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.203', 'weapon2': '0.548', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.118', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '49.000'} [2024-08-06 01:49:31,509][52649] DAMAGECOUNT value on done: 233727.0 [2024-08-06 01:49:31,511][52649] Sum rewards: 51.656, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.123', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.182', 'AMMO4': '0.183', 'AMMO3': '0.186', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON4': '0.450', 'weapon4': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '41.000'} [2024-08-06 01:49:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 273186816. Throughput: 0: 4393.3. Samples: 68296110. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:49:32,795][52567] Avg episode reward: [(0, '63.502')] [2024-08-06 01:49:33,699][52665] DAMAGECOUNT value on done: 235892.0 [2024-08-06 01:49:33,700][52665] Sum rewards: 55.714, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.150', 'weapon5': '0.196', 'AMMO4': '0.212', 'weapon2': '0.254', 'AMMO3': '0.273', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.052', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '49.000'} [2024-08-06 01:49:34,094][52650] Updated weights for policy 0, policy_version 33351 (0.0012) [2024-08-06 01:49:34,304][52649] DAMAGECOUNT value on done: 235901.0 [2024-08-06 01:49:34,304][52649] Sum rewards: 55.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.218', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.183', 'AMMO4': '0.195', 'weapon5': '0.198', 'weapon4': '0.380', 'weapon2': '0.442', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.630', 'weapon3': '2.654', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '47.000'} [2024-08-06 01:49:34,471][52659] DAMAGECOUNT value on done: 240179.0 [2024-08-06 01:49:34,472][52659] Sum rewards: 70.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.349', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.372', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.384', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '59.000'} [2024-08-06 01:49:34,646][52663] DAMAGECOUNT value on done: 239696.0 [2024-08-06 01:49:34,646][52663] Sum rewards: 61.882, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.264', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.306', 'weapon2': '0.372', 'WEAPON3': '1.750', 'weapon3': '3.322', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 01:49:36,171][52665] DAMAGECOUNT value on done: 238204.0 [2024-08-06 01:49:36,179][52665] Sum rewards: 55.951, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.704', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.128', 'weapon4': '0.166', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '49.000'} [2024-08-06 01:49:36,464][52647] DAMAGECOUNT value on done: 252477.0 [2024-08-06 01:49:36,464][52647] Sum rewards: 62.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.142', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'weapon4': '0.332', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '3.010', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '53.000'} [2024-08-06 01:49:36,757][52649] DAMAGECOUNT value on done: 227019.0 [2024-08-06 01:49:36,759][52649] Sum rewards: 66.972, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.236', 'weapon4': '0.368', 'HEALTH': '0.718', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:37,467][52659] DAMAGECOUNT value on done: 243450.0 [2024-08-06 01:49:37,467][52659] Sum rewards: 64.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.176', 'weapon4': '0.182', 'AMMO3': '0.252', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:37,648][52663] DAMAGECOUNT value on done: 245194.0 [2024-08-06 01:49:37,648][52795] DAMAGECOUNT value on done: 222758.0 [2024-08-06 01:49:37,653][52663] Sum rewards: 72.396, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.715', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.280', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '60.000'} [2024-08-06 01:49:37,653][52795] Sum rewards: 79.624, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.615', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.114', 'AMMO3': '0.142', 'weapon4': '0.188', 'weapon2': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.172', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '61.000'} [2024-08-06 01:49:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 273276928. Throughput: 0: 4398.0. Samples: 68322520. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 01:49:37,795][52567] Avg episode reward: [(0, '63.231')] [2024-08-06 01:49:38,405][52650] Updated weights for policy 0, policy_version 33361 (0.0014) [2024-08-06 01:49:38,806][52665] DAMAGECOUNT value on done: 238252.0 [2024-08-06 01:49:38,807][52665] Sum rewards: 59.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.186', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.574', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '48.000'} [2024-08-06 01:49:39,109][52647] DAMAGECOUNT value on done: 249812.0 [2024-08-06 01:49:39,111][52647] Sum rewards: 63.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.314', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.106', 'weapon4': '0.118', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '57.000'} [2024-08-06 01:49:39,663][52649] DAMAGECOUNT value on done: 232626.0 [2024-08-06 01:49:39,664][52649] Sum rewards: 63.962, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.725', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.180', 'AMMO3': '0.183', 'weapon4': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '52.000'} [2024-08-06 01:49:40,361][52659] DAMAGECOUNT value on done: 241638.0 [2024-08-06 01:49:40,361][52659] Sum rewards: 69.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.193', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 01:49:40,610][52795] DAMAGECOUNT value on done: 217427.0 [2024-08-06 01:49:40,610][52795] Sum rewards: 59.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.393', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.180', 'AMMO3': '0.185', 'weapon5': '0.204', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '49.000'} [2024-08-06 01:49:40,759][52663] DAMAGECOUNT value on done: 240106.0 [2024-08-06 01:49:40,759][52663] Sum rewards: 65.343, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.143', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.152', 'AMMO3': '0.228', 'weapon4': '0.230', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.302', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:41,557][52647] DAMAGECOUNT value on done: 251699.0 [2024-08-06 01:49:41,557][52647] Sum rewards: 55.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.802', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.040', 'AMMO4': '0.196', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.196', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '46.000'} [2024-08-06 01:49:41,605][52665] Large shaping reward 2.504 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.453, 151.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:49:41,826][52665] DAMAGECOUNT value on done: 245175.0 [2024-08-06 01:49:41,827][52665] Sum rewards: 69.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.678', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.206', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '57.000'} [2024-08-06 01:49:42,497][52649] DAMAGECOUNT value on done: 231394.0 [2024-08-06 01:49:42,499][52649] Sum rewards: 70.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '61.000'} [2024-08-06 01:49:42,797][52567] Fps is (10 sec: 17198.5, 60 sec: 17612.0, 300 sec: 17550.2). Total num frames: 273358848. Throughput: 0: 4398.0. Samples: 68349010. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:49:42,799][52567] Avg episode reward: [(0, '63.479')] [2024-08-06 01:49:43,370][52650] Updated weights for policy 0, policy_version 33371 (0.0021) [2024-08-06 01:49:43,607][52795] DAMAGECOUNT value on done: 216528.0 [2024-08-06 01:49:43,608][52795] Sum rewards: 59.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'AMMO3': '0.188', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '51.000'} [2024-08-06 01:49:43,848][52663] DAMAGECOUNT value on done: 235315.0 [2024-08-06 01:49:43,851][52663] Sum rewards: 57.880, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.754', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.242', 'AMMO4': '0.245', 'AMMO3': '0.253', 'weapon2': '0.310', 'WEAPON5': '0.450', 'weapon4': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.610', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '52.000'} [2024-08-06 01:49:44,282][52647] DAMAGECOUNT value on done: 255045.0 [2024-08-06 01:49:44,284][52647] Sum rewards: 77.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.162', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.050', 'HITCOUNT': '3.510', 'weapon3': '3.580', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '62.000'} [2024-08-06 01:49:44,536][52665] DAMAGECOUNT value on done: 240552.0 [2024-08-06 01:49:44,537][52665] Sum rewards: 64.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.268', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:45,387][52649] DAMAGECOUNT value on done: 237606.0 [2024-08-06 01:49:45,388][52649] Sum rewards: 64.481, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.090', 'weapon2': '0.224', 'AMMO4': '0.242', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.682', 'WEAPON3': '1.450', 'weapon3': '2.666', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '57.000'} [2024-08-06 01:49:46,781][52795] DAMAGECOUNT value on done: 220381.0 [2024-08-06 01:49:46,782][52795] Sum rewards: 74.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon2': '0.146', 'AMMO3': '0.216', 'weapon4': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '61.000'} [2024-08-06 01:49:47,003][52647] DAMAGECOUNT value on done: 252912.0 [2024-08-06 01:49:47,003][52647] Sum rewards: 59.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon5': '0.184', 'AMMO3': '0.245', 'AMMO4': '0.278', 'weapon2': '0.380', 'WEAPON5': '0.400', 'weapon4': '0.448', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.744', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '53.000'} [2024-08-06 01:49:47,578][52665] DAMAGECOUNT value on done: 238835.0 [2024-08-06 01:49:47,580][52665] Sum rewards: 70.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.432', 'weapon2': '0.558', 'WEAPON3': '1.500', 'weapon3': '2.604', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 01:49:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 273448960. Throughput: 0: 4404.5. Samples: 68362310. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:49:47,794][52567] Avg episode reward: [(0, '63.395')] [2024-08-06 01:49:48,021][52650] Updated weights for policy 0, policy_version 33381 (0.0013) [2024-08-06 01:49:48,107][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:49:48,319][52649] DAMAGECOUNT value on done: 238056.0 [2024-08-06 01:49:48,321][52649] Sum rewards: 68.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.421', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '60.000'} [2024-08-06 01:49:49,764][52647] DAMAGECOUNT value on done: 256116.0 [2024-08-06 01:49:49,765][52647] Sum rewards: 60.570, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.837', 'AMMO5': '0.010', 'weapon7': '0.046', 'AMMO2': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.144', 'WEAPON7': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.650', 'weapon4': '0.870', 'WEAPON3': '1.200', 'weapon3': '2.284', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2024-08-06 01:49:49,937][52795] DAMAGECOUNT value on done: 225110.0 [2024-08-06 01:49:49,937][52795] Sum rewards: 62.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.224', 'weapon4': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '51.500'} [2024-08-06 01:49:50,458][52665] DAMAGECOUNT value on done: 236321.0 [2024-08-06 01:49:50,460][52665] Sum rewards: 56.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.935', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.140', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'weapon2': '0.620', 'WEAPON3': '0.900', 'weapon3': '3.040', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '46.000'} [2024-08-06 01:49:51,376][52649] DAMAGECOUNT value on done: 240888.0 [2024-08-06 01:49:51,379][52649] Sum rewards: 45.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.922', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.241', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '3.052', 'DAMAGECOUNT': '12.555', 'FRAGCOUNT': '40.000'} [2024-08-06 01:49:52,088][52647] DAMAGECOUNT value on done: 251560.0 [2024-08-06 01:49:52,096][52647] Sum rewards: 71.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.724', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.167', 'AMMO4': '0.206', 'weapon5': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.416', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '58.000'} [2024-08-06 01:49:52,542][52650] Updated weights for policy 0, policy_version 33391 (0.0020) [2024-08-06 01:49:52,794][52567] Fps is (10 sec: 18027.5, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 273539072. Throughput: 0: 4397.3. Samples: 68388580. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:49:52,794][52567] Avg episode reward: [(0, '63.169')] [2024-08-06 01:49:53,009][52795] DAMAGECOUNT value on done: 220292.0 [2024-08-06 01:49:53,010][52795] Sum rewards: 61.000, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon4': '0.316', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '2.894', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '54.000'} [2024-08-06 01:49:53,585][52665] DAMAGECOUNT value on done: 237698.0 [2024-08-06 01:49:53,587][52665] Sum rewards: 62.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.561', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.198', 'weapon4': '0.220', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '2.986', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '52.000'} [2024-08-06 01:49:54,828][52647] DAMAGECOUNT value on done: 250525.0 [2024-08-06 01:49:54,828][52647] Sum rewards: 55.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.148', 'weapon5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '47.000'} [2024-08-06 01:49:56,173][52795] DAMAGECOUNT value on done: 224687.0 [2024-08-06 01:49:56,173][52795] Sum rewards: 66.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.456', 'AMMO5': '0.003', 'AMMO2': '0.010', 'ARMOR': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.052', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.304', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2024-08-06 01:49:56,657][52665] DAMAGECOUNT value on done: 235486.0 [2024-08-06 01:49:56,658][52665] Sum rewards: 69.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.952', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '58.000'} [2024-08-06 01:49:56,962][52647] DAMAGECOUNT value on done: 253835.0 [2024-08-06 01:49:56,964][52647] Sum rewards: 68.235, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.123', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon5': '0.158', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.862', 'WEAPON3': '0.900', 'weapon3': '2.358', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '53.000'} [2024-08-06 01:49:57,257][52650] Updated weights for policy 0, policy_version 33401 (0.0013) [2024-08-06 01:49:57,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 273629184. Throughput: 0: 4400.2. Samples: 68415120. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 01:49:57,795][52567] Avg episode reward: [(0, '63.422')] [2024-08-06 01:49:58,914][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:49:59,335][52795] DAMAGECOUNT value on done: 221708.0 [2024-08-06 01:49:59,335][52795] Sum rewards: 63.810, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.626', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.092', 'weapon4': '0.196', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.252', 'AMMO3': '0.293', 'WEAPON3': '1.650', 'weapon3': '3.152', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.500'} [2024-08-06 01:50:00,026][52665] DAMAGECOUNT value on done: 234748.0 [2024-08-06 01:50:00,027][52665] Sum rewards: 67.868, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon4': '0.088', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.538', 'WEAPON3': '1.600', 'weapon3': '2.930', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '59.000'} [2024-08-06 01:50:00,058][52647] DAMAGECOUNT value on done: 249482.0 [2024-08-06 01:50:00,061][52647] Sum rewards: 61.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.526', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.110', 'weapon5': '0.158', 'AMMO3': '0.207', 'AMMO4': '0.215', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '2.964', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:02,061][52650] Updated weights for policy 0, policy_version 33411 (0.0014) [2024-08-06 01:50:02,401][52647] DAMAGECOUNT value on done: 251450.0 [2024-08-06 01:50:02,402][52647] Sum rewards: 66.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.860', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.212', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.520', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:02,493][52795] DAMAGECOUNT value on done: 219281.0 [2024-08-06 01:50:02,496][52795] Sum rewards: 61.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.748', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.046', 'weapon4': '0.152', 'AMMO3': '0.179', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.326', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:02,722][52668] DAMAGECOUNT value on done: 237370.0 [2024-08-06 01:50:02,723][52668] Sum rewards: 69.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.725', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.306', 'WEAPON3': '1.050', 'HITCOUNT': '3.260', 'weapon3': '3.356', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 273711104. Throughput: 0: 4390.9. Samples: 68428050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:50:02,795][52567] Avg episode reward: [(0, '63.784')] [2024-08-06 01:50:02,966][52665] DAMAGECOUNT value on done: 233410.0 [2024-08-06 01:50:02,966][52665] Sum rewards: 57.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.414', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon5': '0.068', 'AMMO4': '0.071', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.342', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.242', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:05,152][52668] DAMAGECOUNT value on done: 245450.0 [2024-08-06 01:50:05,153][52668] Sum rewards: 60.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.009', 'AMMO2': '0.055', 'weapon5': '0.122', 'weapon4': '0.164', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'AMMO4': '0.273', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.094', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:05,376][52647] DAMAGECOUNT value on done: 246645.0 [2024-08-06 01:50:05,377][52647] Sum rewards: 66.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.164', 'AMMO3': '0.200', 'AMMO4': '0.211', 'weapon2': '0.244', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:05,591][52795] DAMAGECOUNT value on done: 225793.0 [2024-08-06 01:50:05,592][52795] Sum rewards: 65.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.132', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.134', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:06,116][52665] DAMAGECOUNT value on done: 237354.0 [2024-08-06 01:50:06,116][52665] Sum rewards: 55.476, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.977', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.130', 'AMMO3': '0.226', 'AMMO4': '0.252', 'weapon4': '0.268', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '49.000'} [2024-08-06 01:50:06,141][52667] DAMAGECOUNT value on done: 239647.0 [2024-08-06 01:50:06,142][52667] Sum rewards: 59.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.886', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon4': '0.278', 'weapon2': '0.886', 'WEAPON3': '1.350', 'weapon3': '2.674', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '52.000'} [2024-08-06 01:50:06,751][52658] Large shaping reward 2.542 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2024-08-06 01:50:06,754][52650] Updated weights for policy 0, policy_version 33421 (0.0022) [2024-08-06 01:50:07,776][52662] DAMAGECOUNT value on done: 246512.0 [2024-08-06 01:50:07,777][52662] Sum rewards: 65.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.398', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.197', 'weapon4': '0.236', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:07,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 273801216. Throughput: 0: 4404.2. Samples: 68454580. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:50:07,794][52567] Avg episode reward: [(0, '63.725')] [2024-08-06 01:50:07,844][52668] DAMAGECOUNT value on done: 244094.0 [2024-08-06 01:50:07,846][52668] Sum rewards: 65.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.607', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.152', 'AMMO4': '0.316', 'weapon5': '0.318', 'weapon2': '0.404', 'weapon4': '0.480', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '0.850', 'weapon3': '2.406', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:08,226][52647] DAMAGECOUNT value on done: 250518.0 [2024-08-06 01:50:08,226][52647] Sum rewards: 74.781, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.815', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.076', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.364', 'weapon2': '0.472', 'WEAPON3': '0.900', 'weapon3': '2.962', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '59.000'} [2024-08-06 01:50:08,632][52795] DAMAGECOUNT value on done: 221773.0 [2024-08-06 01:50:08,633][52795] Sum rewards: 46.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.954', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.173', 'weapon5': '0.226', 'AMMO4': '0.293', 'WEAPON5': '0.450', 'weapon4': '0.462', 'weapon2': '0.554', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.342', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '41.500'} [2024-08-06 01:50:08,985][52665] DAMAGECOUNT value on done: 236810.0 [2024-08-06 01:50:08,987][52665] Sum rewards: 62.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.593', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.830', 'WEAPON3': '1.300', 'weapon3': '2.562', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:09,266][52667] DAMAGECOUNT value on done: 241174.0 [2024-08-06 01:50:09,267][52667] Sum rewards: 71.711, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.253', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO3': '0.182', 'AMMO4': '0.186', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:10,304][52668] DAMAGECOUNT value on done: 244422.0 [2024-08-06 01:50:10,304][52668] Sum rewards: 71.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.188', 'AMMO3': '0.218', 'AMMO4': '0.220', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.602', 'WEAPON3': '1.400', 'weapon3': '2.646', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '58.500'} [2024-08-06 01:50:10,558][52662] DAMAGECOUNT value on done: 246512.0 [2024-08-06 01:50:10,559][52662] Sum rewards: 66.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.588', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon7': '0.054', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'AMMO3': '0.178', 'weapon2': '0.178', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:10,963][52647] DAMAGECOUNT value on done: 249899.0 [2024-08-06 01:50:10,964][52647] Sum rewards: 65.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.853', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.166', 'AMMO4': '0.199', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.500', 'weapon4': '0.740', 'WEAPON3': '1.150', 'weapon3': '2.446', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:11,424][52650] Updated weights for policy 0, policy_version 33431 (0.0011) [2024-08-06 01:50:11,699][52795] DAMAGECOUNT value on done: 219148.0 [2024-08-06 01:50:11,700][52795] Sum rewards: 67.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.365', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.070', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.494', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:11,912][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 01:50:12,662][52667] DAMAGECOUNT value on done: 242143.0 [2024-08-06 01:50:12,662][52667] Sum rewards: 67.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO3': '0.189', 'AMMO4': '0.221', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.526', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:12,733][52668] DAMAGECOUNT value on done: 232656.0 [2024-08-06 01:50:12,733][52668] Sum rewards: 47.417, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.162', 'AMMO4': '0.180', 'weapon5': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.050', 'HITCOUNT': '2.440', 'weapon3': '2.716', 'DAMAGECOUNT': '12.900', 'FRAGCOUNT': '39.000'} [2024-08-06 01:50:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 273891328. Throughput: 0: 4393.7. Samples: 68480670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:50:12,795][52567] Avg episode reward: [(0, '64.019')] [2024-08-06 01:50:13,301][52662] DAMAGECOUNT value on done: 246240.0 [2024-08-06 01:50:13,301][52662] Sum rewards: 56.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.167', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '2.716', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '49.000'} [2024-08-06 01:50:13,759][52647] DAMAGECOUNT value on done: 255878.0 [2024-08-06 01:50:13,761][52647] Sum rewards: 63.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.202', 'AMMO3': '0.215', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:14,254][52668] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:50:14,823][52795] DAMAGECOUNT value on done: 218623.0 [2024-08-06 01:50:14,823][52795] Sum rewards: 58.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.092', 'WEAPON5': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.612', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '2.970', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '49.000'} [2024-08-06 01:50:15,553][52667] DAMAGECOUNT value on done: 237501.0 [2024-08-06 01:50:15,555][52667] Sum rewards: 62.759, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.424', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.656', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:15,568][52668] DAMAGECOUNT value on done: 242100.0 [2024-08-06 01:50:15,568][52668] Sum rewards: 70.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.585', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.182', 'AMMO3': '0.184', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:15,826][52660] DAMAGECOUNT value on done: 237020.0 [2024-08-06 01:50:15,828][52660] Sum rewards: 77.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.448', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.151', 'AMMO4': '0.209', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.700', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '61.000'} [2024-08-06 01:50:16,095][52650] Updated weights for policy 0, policy_version 33441 (0.0012) [2024-08-06 01:50:16,208][52662] DAMAGECOUNT value on done: 237184.0 [2024-08-06 01:50:16,210][52662] Sum rewards: 70.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.167', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.896', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '60.000'} [2024-08-06 01:50:16,282][52803] DAMAGECOUNT value on done: 223089.0 [2024-08-06 01:50:16,284][52803] Sum rewards: 63.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.152', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.114', 'weapon5': '0.138', 'AMMO4': '0.171', 'weapon2': '0.190', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.328', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:16,588][52647] DAMAGECOUNT value on done: 249339.0 [2024-08-06 01:50:16,589][52647] Sum rewards: 55.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.624', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.272', 'weapon4': '0.574', 'WEAPON3': '1.500', 'weapon3': '2.842', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '47.000'} [2024-08-06 01:50:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 273981440. Throughput: 0: 4396.2. Samples: 68493940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:50:17,802][52567] Avg episode reward: [(0, '63.817')] [2024-08-06 01:50:17,934][52795] DAMAGECOUNT value on done: 221852.0 [2024-08-06 01:50:17,935][52795] Sum rewards: 52.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.134', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.296', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '44.000'} [2024-08-06 01:50:18,362][52668] DAMAGECOUNT value on done: 240683.0 [2024-08-06 01:50:18,363][52668] Sum rewards: 65.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.058', 'weapon5': '0.152', 'AMMO3': '0.176', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:18,651][52660] DAMAGECOUNT value on done: 236977.0 [2024-08-06 01:50:18,651][52660] Sum rewards: 54.123, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.535', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.410', 'WEAPON3': '1.700', 'weapon3': '2.824', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:18,754][52667] DAMAGECOUNT value on done: 244689.0 [2024-08-06 01:50:18,759][52667] Sum rewards: 63.939, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.360', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon5': '0.104', 'AMMO4': '0.199', 'AMMO3': '0.237', 'weapon4': '0.240', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:19,147][52662] DAMAGECOUNT value on done: 243252.0 [2024-08-06 01:50:19,149][52662] Sum rewards: 58.536, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.784', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.142', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '47.000'} [2024-08-06 01:50:19,308][52647] DAMAGECOUNT value on done: 249750.0 [2024-08-06 01:50:19,310][52647] Sum rewards: 66.646, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.788', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:19,375][52803] DAMAGECOUNT value on done: 224366.0 [2024-08-06 01:50:19,376][52803] Sum rewards: 58.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO4': '0.212', 'weapon4': '0.212', 'AMMO3': '0.214', 'weapon5': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.690', 'WEAPON3': '1.350', 'weapon3': '2.632', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '49.000'} [2024-08-06 01:50:20,536][52650] Updated weights for policy 0, policy_version 33451 (0.0020) [2024-08-06 01:50:20,956][52795] DAMAGECOUNT value on done: 214786.0 [2024-08-06 01:50:20,957][52795] Sum rewards: 62.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.945', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.048', 'AMMO4': '0.051', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:21,263][52668] DAMAGECOUNT value on done: 240943.0 [2024-08-06 01:50:21,264][52668] Sum rewards: 70.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.227', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '60.000'} [2024-08-06 01:50:21,716][52660] DAMAGECOUNT value on done: 242698.0 [2024-08-06 01:50:21,719][52660] Sum rewards: 71.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.802', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.208', 'AMMO3': '0.213', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:21,887][52667] DAMAGECOUNT value on done: 242315.0 [2024-08-06 01:50:21,888][52667] Sum rewards: 60.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.043', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.060', 'AMMO4': '0.112', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '52.500'} [2024-08-06 01:50:22,034][52662] DAMAGECOUNT value on done: 238637.0 [2024-08-06 01:50:22,035][52662] Sum rewards: 61.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.342', 'weapon4': '0.544', 'WEAPON3': '1.600', 'weapon3': '2.826', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:22,053][52811] DAMAGECOUNT value on done: 234183.0 [2024-08-06 01:50:22,054][52811] Sum rewards: 52.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'weapon4': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.108', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '46.000'} [2024-08-06 01:50:22,137][52647] DAMAGECOUNT value on done: 248633.0 [2024-08-06 01:50:22,137][52647] Sum rewards: 53.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.921', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.152', 'weapon4': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.150', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '46.000'} [2024-08-06 01:50:22,400][52803] DAMAGECOUNT value on done: 223350.0 [2024-08-06 01:50:22,402][52803] Sum rewards: 72.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.314', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.274', 'weapon2': '0.304', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.036', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '62.000'} [2024-08-06 01:50:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 274071552. Throughput: 0: 4397.1. Samples: 68520390. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:50:22,795][52567] Avg episode reward: [(0, '63.514')] [2024-08-06 01:50:23,988][52668] DAMAGECOUNT value on done: 241150.0 [2024-08-06 01:50:23,988][52668] Sum rewards: 69.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.394', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.158', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.088', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:24,077][52795] DAMAGECOUNT value on done: 227063.0 [2024-08-06 01:50:24,078][52795] Sum rewards: 62.140, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.649', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.154', 'weapon4': '0.182', 'AMMO3': '0.183', 'AMMO4': '0.197', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.804', 'WEAPON3': '1.100', 'weapon3': '2.644', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:24,356][52667] DAMAGECOUNT value on done: 244536.0 [2024-08-06 01:50:24,357][52667] Sum rewards: 66.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.055', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.032', 'weapon4': '0.036', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.216', 'weapon2': '0.604', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:24,469][52660] DAMAGECOUNT value on done: 242388.0 [2024-08-06 01:50:24,471][52660] Sum rewards: 71.544, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.054', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.175', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.454', 'weapon4': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '56.500'} [2024-08-06 01:50:25,060][52811] DAMAGECOUNT value on done: 222908.0 [2024-08-06 01:50:25,060][52811] Sum rewards: 74.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '60.000'} [2024-08-06 01:50:25,145][52662] DAMAGECOUNT value on done: 244903.0 [2024-08-06 01:50:25,146][52662] Sum rewards: 66.729, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.285', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO4': '0.161', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:25,161][52647] DAMAGECOUNT value on done: 245376.0 [2024-08-06 01:50:25,162][52647] Sum rewards: 62.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'weapon4': '0.152', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '52.000'} [2024-08-06 01:50:25,282][52650] Updated weights for policy 0, policy_version 33461 (0.0025) [2024-08-06 01:50:25,403][52803] DAMAGECOUNT value on done: 224672.0 [2024-08-06 01:50:25,405][52803] Sum rewards: 57.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.360', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.658', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:26,623][52668] DAMAGECOUNT value on done: 241526.0 [2024-08-06 01:50:26,624][52668] Sum rewards: 60.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.800', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.084', 'weapon5': '0.178', 'AMMO4': '0.218', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '2.990', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '53.500'} [2024-08-06 01:50:26,928][52660] DAMAGECOUNT value on done: 240975.0 [2024-08-06 01:50:26,929][52660] Sum rewards: 58.065, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.122', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.976', 'WEAPON3': '1.050', 'weapon3': '2.728', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '46.000'} [2024-08-06 01:50:27,075][52795] DAMAGECOUNT value on done: 225612.0 [2024-08-06 01:50:27,077][52795] Sum rewards: 52.582, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.347', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO4': '0.226', 'weapon5': '0.238', 'AMMO3': '0.247', 'weapon2': '0.260', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.810', 'WEAPON3': '1.400', 'weapon3': '2.378', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '46.000'} [2024-08-06 01:50:27,374][52667] DAMAGECOUNT value on done: 239226.0 [2024-08-06 01:50:27,376][52667] Sum rewards: 73.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.162', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '60.000'} [2024-08-06 01:50:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 274145280. Throughput: 0: 4398.9. Samples: 68546950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:50:27,794][52567] Avg episode reward: [(0, '63.597')] [2024-08-06 01:50:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033465_274145280.pth... [2024-08-06 01:50:27,851][52647] DAMAGECOUNT value on done: 252758.0 [2024-08-06 01:50:27,853][52647] Sum rewards: 61.553, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.361', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.100', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.308', 'WEAPON3': '1.850', 'HITCOUNT': '3.090', 'weapon3': '3.168', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:27,995][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000032952_269942784.pth [2024-08-06 01:50:28,248][52811] DAMAGECOUNT value on done: 223341.0 [2024-08-06 01:50:28,248][52811] Sum rewards: 52.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.373', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.114', 'AMMO3': '0.145', 'AMMO4': '0.213', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.510', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '2.948', 'DAMAGECOUNT': '13.257', 'FRAGCOUNT': '43.000'} [2024-08-06 01:50:28,617][52803] DAMAGECOUNT value on done: 227031.0 [2024-08-06 01:50:28,618][52803] Sum rewards: 59.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.889', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.430', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:28,741][52662] DAMAGECOUNT value on done: 248716.0 [2024-08-06 01:50:28,743][52662] Sum rewards: 65.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.817', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO4': '0.214', 'AMMO3': '0.222', 'weapon5': '0.222', 'weapon4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:29,495][52668] DAMAGECOUNT value on done: 243225.0 [2024-08-06 01:50:29,496][52668] Sum rewards: 61.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.862', 'AMMO5': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.234', 'weapon4': '0.314', 'WEAPON5': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '49.500'} [2024-08-06 01:50:29,914][52660] DAMAGECOUNT value on done: 236685.0 [2024-08-06 01:50:29,916][52660] Sum rewards: 67.192, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.776', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.184', 'AMMO4': '0.220', 'AMMO3': '0.230', 'WEAPON5': '0.450', 'weapon4': '0.454', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.606', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:30,184][52795] DAMAGECOUNT value on done: 215202.0 [2024-08-06 01:50:30,187][52795] Sum rewards: 74.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.479', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.090', 'AMMO4': '0.116', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.262', 'WEAPON3': '1.700', 'weapon3': '3.222', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '63.000'} [2024-08-06 01:50:30,302][52650] Updated weights for policy 0, policy_version 33471 (0.0012) [2024-08-06 01:50:30,570][52667] DAMAGECOUNT value on done: 238676.0 [2024-08-06 01:50:30,572][52667] Sum rewards: 67.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.208', 'weapon2': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.504', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '59.000'} [2024-08-06 01:50:30,814][52669] DAMAGECOUNT value on done: 242832.0 [2024-08-06 01:50:30,815][52669] Sum rewards: 60.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.058', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.140', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.226', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:31,496][52811] DAMAGECOUNT value on done: 221943.0 [2024-08-06 01:50:31,497][52811] Sum rewards: 68.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.458', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:31,615][52803] DAMAGECOUNT value on done: 225505.0 [2024-08-06 01:50:31,615][52803] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.173', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.183', 'weapon4': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:31,898][52662] DAMAGECOUNT value on done: 241033.0 [2024-08-06 01:50:31,901][52662] Sum rewards: 71.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '60.000'} [2024-08-06 01:50:32,453][52668] DAMAGECOUNT value on done: 238425.0 [2024-08-06 01:50:32,454][52668] Sum rewards: 67.224, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.257', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.318', 'weapon2': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 274243584. Throughput: 0: 4382.9. Samples: 68559540. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:50:32,794][52567] Avg episode reward: [(0, '63.754')] [2024-08-06 01:50:33,014][52660] DAMAGECOUNT value on done: 243675.0 [2024-08-06 01:50:33,014][52660] Sum rewards: 65.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.533', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.164', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:33,282][52795] DAMAGECOUNT value on done: 228815.0 [2024-08-06 01:50:33,283][52795] Sum rewards: 65.591, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.037', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.078', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:33,564][52667] DAMAGECOUNT value on done: 241882.0 [2024-08-06 01:50:33,566][52667] Sum rewards: 53.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.184', 'AMMO5': '0.022', 'AMMO2': '0.040', 'weapon5': '0.110', 'AMMO3': '0.135', 'AMMO4': '0.202', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'weapon4': '0.656', 'weapon2': '0.768', 'WEAPON3': '0.800', 'weapon3': '2.152', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.509', 'FRAGCOUNT': '46.000'} [2024-08-06 01:50:33,975][52669] DAMAGECOUNT value on done: 237090.0 [2024-08-06 01:50:33,975][52669] Sum rewards: 58.804, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.360', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.130', 'weapon5': '0.156', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.600', 'weapon3': '2.942', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:34,551][52650] Updated weights for policy 0, policy_version 33481 (0.0029) [2024-08-06 01:50:34,592][52811] DAMAGECOUNT value on done: 223539.0 [2024-08-06 01:50:34,594][52811] Sum rewards: 73.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.463', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.122', 'weapon4': '0.130', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '61.000'} [2024-08-06 01:50:34,680][52803] DAMAGECOUNT value on done: 222192.0 [2024-08-06 01:50:34,682][52803] Sum rewards: 62.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.024', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.388', 'weapon4': '0.718', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:34,974][52662] DAMAGECOUNT value on done: 251202.0 [2024-08-06 01:50:34,975][52662] Sum rewards: 65.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.956', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.064', 'weapon5': '0.068', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.192', 'AMMO3': '0.206', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.478', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:35,373][52668] DAMAGECOUNT value on done: 231913.0 [2024-08-06 01:50:35,374][52668] Sum rewards: 58.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.218', 'weapon5': '0.220', 'AMMO4': '0.320', 'weapon2': '0.362', 'weapon4': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:35,907][52660] DAMAGECOUNT value on done: 244509.0 [2024-08-06 01:50:35,909][52660] Sum rewards: 61.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon2': '0.158', 'weapon4': '0.214', 'AMMO3': '0.240', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.430', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:35,997][52664] DAMAGECOUNT value on done: 246403.0 [2024-08-06 01:50:36,000][52664] Sum rewards: 47.913, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.740', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.207', 'AMMO3': '0.275', 'weapon2': '0.362', 'WEAPON4': '0.500', 'weapon4': '0.572', 'WEAPON3': '1.700', 'weapon3': '2.668', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '44.000'} [2024-08-06 01:50:36,174][52794] DAMAGECOUNT value on done: 242688.0 [2024-08-06 01:50:36,177][52794] Sum rewards: 50.835, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-5.760', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'weapon4': '0.276', 'AMMO3': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '2.000', 'weapon3': '2.922', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:36,353][52795] DAMAGECOUNT value on done: 226533.0 [2024-08-06 01:50:36,356][52795] Sum rewards: 62.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.335', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.022', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:36,366][52667] DAMAGECOUNT value on done: 242315.0 [2024-08-06 01:50:36,368][52667] Sum rewards: 62.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.344', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'weapon5': '0.242', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon4': '0.356', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '2.576', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:36,734][52669] DAMAGECOUNT value on done: 242405.0 [2024-08-06 01:50:36,734][52669] Sum rewards: 63.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:37,388][52662] DAMAGECOUNT value on done: 242521.0 [2024-08-06 01:50:37,388][52662] Sum rewards: 77.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon4': '0.110', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '65.000'} [2024-08-06 01:50:37,636][52811] DAMAGECOUNT value on done: 229481.0 [2024-08-06 01:50:37,639][52811] Sum rewards: 64.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon5': '0.062', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.215', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:37,743][52803] DAMAGECOUNT value on done: 220094.0 [2024-08-06 01:50:37,745][52803] Sum rewards: 56.119, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.237', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.434', 'WEAPON3': '1.700', 'weapon3': '2.798', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:37,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 274325504. Throughput: 0: 4382.4. Samples: 68585790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:50:37,795][52567] Avg episode reward: [(0, '63.203')] [2024-08-06 01:50:38,182][52668] DAMAGECOUNT value on done: 235771.0 [2024-08-06 01:50:38,184][52668] Sum rewards: 66.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.421', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.227', 'weapon5': '0.286', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.498', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:38,582][52660] DAMAGECOUNT value on done: 244736.0 [2024-08-06 01:50:38,584][52660] Sum rewards: 67.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.356', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.316', 'weapon4': '0.332', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:38,768][52667] DAMAGECOUNT value on done: 242180.0 [2024-08-06 01:50:38,769][52667] Sum rewards: 70.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.120', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.380', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '62.000'} [2024-08-06 01:50:38,942][52664] DAMAGECOUNT value on done: 247998.0 [2024-08-06 01:50:38,944][52664] Sum rewards: 51.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.136', 'weapon5': '0.138', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '3.084', 'DAMAGECOUNT': '12.396', 'FRAGCOUNT': '45.000'} [2024-08-06 01:50:38,953][52794] DAMAGECOUNT value on done: 246888.0 [2024-08-06 01:50:38,955][52794] Sum rewards: 56.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.109', 'weapon5': '0.194', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '3.050', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '49.000'} [2024-08-06 01:50:39,531][52650] Updated weights for policy 0, policy_version 33491 (0.0012) [2024-08-06 01:50:39,758][52669] DAMAGECOUNT value on done: 240977.0 [2024-08-06 01:50:39,759][52669] Sum rewards: 52.876, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.112', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.136', 'AMMO4': '0.155', 'AMMO3': '0.237', 'weapon2': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '2.984', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '47.000'} [2024-08-06 01:50:40,375][52662] DAMAGECOUNT value on done: 240959.0 [2024-08-06 01:50:40,376][52662] Sum rewards: 52.754, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.650', 'weapon2': '0.754', 'WEAPON3': '0.950', 'weapon3': '2.346', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '43.000'} [2024-08-06 01:50:40,590][52668] DAMAGECOUNT value on done: 235972.0 [2024-08-06 01:50:40,590][52668] Sum rewards: 66.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.545', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.036', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.216', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '56.500'} [2024-08-06 01:50:40,771][52803] DAMAGECOUNT value on done: 224374.0 [2024-08-06 01:50:40,773][52811] DAMAGECOUNT value on done: 225018.0 [2024-08-06 01:50:40,776][52811] Sum rewards: 62.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.004', 'weapon4': '0.008', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.256', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.554', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:40,773][52803] Sum rewards: 65.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.248', 'weapon4': '0.296', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '52.000'} [2024-08-06 01:50:41,257][52660] DAMAGECOUNT value on done: 238181.0 [2024-08-06 01:50:41,263][52660] Sum rewards: 71.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.152', 'AMMO3': '0.159', 'AMMO4': '0.199', 'weapon2': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.498', 'WEAPON3': '1.000', 'weapon3': '2.906', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:41,778][52667] DAMAGECOUNT value on done: 242562.0 [2024-08-06 01:50:41,779][52667] Sum rewards: 72.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.376', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.036', 'AMMO4': '0.118', 'weapon5': '0.146', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '63.000'} [2024-08-06 01:50:41,881][52794] DAMAGECOUNT value on done: 241287.0 [2024-08-06 01:50:41,882][52794] Sum rewards: 66.038, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.340', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.231', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:41,915][52664] DAMAGECOUNT value on done: 250728.0 [2024-08-06 01:50:41,916][52664] Sum rewards: 80.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.496', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.115', 'weapon4': '0.136', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '63.000'} [2024-08-06 01:50:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17613.6, 300 sec: 17578.1). Total num frames: 274415616. Throughput: 0: 4380.3. Samples: 68612230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 01:50:42,794][52567] Avg episode reward: [(0, '63.377')] [2024-08-06 01:50:42,906][52669] DAMAGECOUNT value on done: 237837.0 [2024-08-06 01:50:42,907][52669] Sum rewards: 61.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.177', 'weapon5': '0.188', 'AMMO4': '0.192', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.458', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.606', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:43,390][52668] DAMAGECOUNT value on done: 239047.0 [2024-08-06 01:50:43,398][52668] Sum rewards: 60.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.061', 'weapon2': '0.140', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.434', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.184', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:43,475][52662] DAMAGECOUNT value on done: 241251.0 [2024-08-06 01:50:43,480][52662] Sum rewards: 63.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.638', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.088', 'AMMO3': '0.223', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:43,776][52803] DAMAGECOUNT value on done: 221868.0 [2024-08-06 01:50:43,779][52803] Sum rewards: 75.973, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.740', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.292', 'weapon2': '0.312', 'WEAPON3': '1.750', 'weapon3': '3.374', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '65.000'} [2024-08-06 01:50:43,784][52811] DAMAGECOUNT value on done: 223997.0 [2024-08-06 01:50:43,785][52811] Sum rewards: 63.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'weapon5': '0.006', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '3.430', 'weapon3': '3.472', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '52.000'} [2024-08-06 01:50:43,832][52660] DAMAGECOUNT value on done: 247069.0 [2024-08-06 01:50:43,833][52660] Sum rewards: 67.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.132', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.181', 'weapon2': '0.840', 'WEAPON3': '1.100', 'weapon3': '2.678', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '54.000'} [2024-08-06 01:50:44,001][52650] Updated weights for policy 0, policy_version 33501 (0.0010) [2024-08-06 01:50:44,731][52667] DAMAGECOUNT value on done: 237717.0 [2024-08-06 01:50:44,734][52667] Sum rewards: 62.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.615', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.092', 'AMMO3': '0.155', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.050', 'HITCOUNT': '3.200', 'weapon3': '3.210', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:44,956][52794] DAMAGECOUNT value on done: 243322.0 [2024-08-06 01:50:44,956][52794] Sum rewards: 69.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.187', 'weapon2': '0.512', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.262', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:44,992][52664] DAMAGECOUNT value on done: 248283.0 [2024-08-06 01:50:44,992][52664] Sum rewards: 64.264, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'AMMO2': '0.059', 'weapon5': '0.116', 'AMMO3': '0.230', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO4': '0.295', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:45,320][52820] DAMAGECOUNT value on done: 219783.0 [2024-08-06 01:50:45,323][52820] Sum rewards: 63.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.774', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.336', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:45,768][52669] DAMAGECOUNT value on done: 238624.0 [2024-08-06 01:50:45,770][52669] Sum rewards: 69.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.167', 'AMMO5': '0.021', 'AMMO2': '0.070', 'AMMO3': '0.175', 'weapon5': '0.268', 'weapon2': '0.342', 'AMMO4': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'weapon4': '0.774', 'WEAPON3': '1.150', 'weapon3': '2.288', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:46,036][52668] DAMAGECOUNT value on done: 237446.0 [2024-08-06 01:50:46,036][52668] Sum rewards: 72.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.417', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.242', 'AMMO3': '0.243', 'weapon4': '0.272', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.726', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '61.000'} [2024-08-06 01:50:46,330][52662] DAMAGECOUNT value on done: 247465.0 [2024-08-06 01:50:46,331][52662] Sum rewards: 54.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.779', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '3.240', 'DAMAGECOUNT': '12.864', 'FRAGCOUNT': '48.000'} [2024-08-06 01:50:46,333][52658] Large shaping reward 3.531 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:50:46,492][52660] DAMAGECOUNT value on done: 231569.0 [2024-08-06 01:50:46,493][52660] Sum rewards: 68.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.158', 'AMMO4': '0.164', 'weapon5': '0.186', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '59.000'} [2024-08-06 01:50:46,907][52811] DAMAGECOUNT value on done: 232767.0 [2024-08-06 01:50:46,907][52811] Sum rewards: 72.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.066', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 01:50:46,922][52803] DAMAGECOUNT value on done: 229344.0 [2024-08-06 01:50:46,923][52803] Sum rewards: 51.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.156', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.380', 'weapon2': '0.532', 'WEAPON3': '1.600', 'weapon3': '2.732', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '47.000'} [2024-08-06 01:50:47,450][52667] DAMAGECOUNT value on done: 247243.0 [2024-08-06 01:50:47,452][52667] Sum rewards: 70.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.146', 'weapon4': '0.148', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:47,536][52794] DAMAGECOUNT value on done: 239654.0 [2024-08-06 01:50:47,536][52794] Sum rewards: 58.945, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.636', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.648', 'WEAPON3': '1.650', 'weapon3': '2.780', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:47,656][52664] DAMAGECOUNT value on done: 249718.0 [2024-08-06 01:50:47,657][52664] Sum rewards: 55.388, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.255', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.070', 'AMMO3': '0.216', 'weapon5': '0.302', 'weapon4': '0.336', 'AMMO4': '0.350', 'weapon2': '0.438', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.496', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 274505728. Throughput: 0: 4387.3. Samples: 68625480. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:50:47,794][52567] Avg episode reward: [(0, '63.424')] [2024-08-06 01:50:48,405][52650] Updated weights for policy 0, policy_version 33511 (0.0013) [2024-08-06 01:50:48,454][52820] DAMAGECOUNT value on done: 222774.0 [2024-08-06 01:50:48,456][52820] Sum rewards: 59.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.302', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.088', 'AMMO3': '0.200', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:48,661][52668] DAMAGECOUNT value on done: 241920.0 [2024-08-06 01:50:48,662][52668] Sum rewards: 52.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.478', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.126', 'AMMO3': '0.156', 'weapon4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.792', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.173', 'FRAGCOUNT': '44.000'} [2024-08-06 01:50:48,912][52669] DAMAGECOUNT value on done: 242435.0 [2024-08-06 01:50:48,912][52669] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.852', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.126', 'AMMO3': '0.190', 'AMMO4': '0.228', 'weapon2': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '63.000'} [2024-08-06 01:50:48,990][52662] DAMAGECOUNT value on done: 243720.0 [2024-08-06 01:50:48,990][52662] Sum rewards: 55.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.052', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '48.000'} [2024-08-06 01:50:49,186][52660] DAMAGECOUNT value on done: 237227.0 [2024-08-06 01:50:49,186][52660] Sum rewards: 50.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.176', 'AMMO4': '0.179', 'weapon5': '0.206', 'weapon4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.962', 'DAMAGECOUNT': '12.960', 'FRAGCOUNT': '44.500'} [2024-08-06 01:50:49,861][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:50:50,006][52667] DAMAGECOUNT value on done: 250492.0 [2024-08-06 01:50:50,007][52667] Sum rewards: 67.869, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'weapon2': '0.582', 'WEAPON3': '0.950', 'HITCOUNT': '3.210', 'weapon3': '3.248', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:50,015][52811] DAMAGECOUNT value on done: 225946.0 [2024-08-06 01:50:50,016][52811] Sum rewards: 70.429, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.224', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.334', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:50,016][52803] DAMAGECOUNT value on done: 226604.0 [2024-08-06 01:50:50,016][52803] Sum rewards: 65.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.212', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.210', 'weapon2': '0.220', 'WEAPON3': '1.400', 'weapon3': '3.440', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:50,189][52794] DAMAGECOUNT value on done: 243208.0 [2024-08-06 01:50:50,190][52794] Sum rewards: 62.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.205', 'weapon4': '0.206', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:50,469][52664] DAMAGECOUNT value on done: 249322.0 [2024-08-06 01:50:50,471][52664] Sum rewards: 60.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.285', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.180', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:51,299][52668] DAMAGECOUNT value on done: 243966.0 [2024-08-06 01:50:51,299][52668] Sum rewards: 64.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.170', 'AMMO3': '0.238', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:51,497][52820] DAMAGECOUNT value on done: 221641.0 [2024-08-06 01:50:51,498][52820] Sum rewards: 72.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.767', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.190', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:51,518][52662] DAMAGECOUNT value on done: 250205.0 [2024-08-06 01:50:51,518][52662] Sum rewards: 65.789, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon2': '0.192', 'weapon5': '0.196', 'AMMO3': '0.279', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.962', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:51,969][52660] DAMAGECOUNT value on done: 245876.0 [2024-08-06 01:50:51,970][52660] Sum rewards: 63.378, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.385', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.122', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.268', 'AMMO3': '0.356', 'WEAPON3': '2.050', 'weapon3': '3.266', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '59.000'} [2024-08-06 01:50:52,112][52669] DAMAGECOUNT value on done: 240631.0 [2024-08-06 01:50:52,112][52669] Sum rewards: 62.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.552', 'AMMO5': '0.015', 'AMMO2': '0.066', 'weapon5': '0.106', 'AMMO3': '0.207', 'weapon4': '0.318', 'AMMO4': '0.328', 'WEAPON5': '0.350', 'weapon2': '0.716', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '52.000'} [2024-08-06 01:50:52,615][52667] DAMAGECOUNT value on done: 244361.0 [2024-08-06 01:50:52,617][52667] Sum rewards: 68.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.126', 'weapon5': '0.128', 'AMMO3': '0.189', 'AMMO4': '0.205', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.284', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '56.000'} [2024-08-06 01:50:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 274587648. Throughput: 0: 4386.7. Samples: 68651980. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:50:52,794][52567] Avg episode reward: [(0, '63.714')] [2024-08-06 01:50:52,817][52794] DAMAGECOUNT value on done: 246078.0 [2024-08-06 01:50:52,818][52794] Sum rewards: 48.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.252', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.026', 'weapon5': '0.042', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.864', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '42.000'} [2024-08-06 01:50:52,856][52658] DAMAGECOUNT value on done: 243866.0 [2024-08-06 01:50:52,856][52658] Sum rewards: 51.732, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.100', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.176', 'WEAPON5': '0.300', 'AMMO3': '0.332', 'weapon2': '0.358', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.950', 'weapon3': '2.706', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:52,975][52664] DAMAGECOUNT value on done: 254175.0 [2024-08-06 01:50:52,978][52664] Sum rewards: 56.612, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.950', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.086', 'AMMO4': '0.217', 'weapon4': '0.234', 'AMMO3': '0.295', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.700', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:53,178][52803] DAMAGECOUNT value on done: 225415.0 [2024-08-06 01:50:53,179][52803] Sum rewards: 58.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.050', 'AMMO4': '0.173', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '49.000'} [2024-08-06 01:50:53,283][52811] DAMAGECOUNT value on done: 226068.0 [2024-08-06 01:50:53,286][52811] Sum rewards: 65.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.267', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'weapon2': '0.138', 'weapon4': '0.188', 'AMMO3': '0.213', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.514', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:53,374][52650] Updated weights for policy 0, policy_version 33521 (0.0011) [2024-08-06 01:50:54,021][52668] DAMAGECOUNT value on done: 240098.0 [2024-08-06 01:50:54,025][52668] Sum rewards: 67.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.118', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.154', 'AMMO3': '0.189', 'weapon2': '0.198', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.948', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:54,248][52662] DAMAGECOUNT value on done: 243161.0 [2024-08-06 01:50:54,249][52662] Sum rewards: 67.626, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.257', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.227', 'weapon2': '0.262', 'AMMO3': '0.274', 'weapon4': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.822', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '61.000'} [2024-08-06 01:50:54,613][52660] DAMAGECOUNT value on done: 250282.0 [2024-08-06 01:50:54,614][52660] Sum rewards: 68.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'weapon4': '0.144', 'AMMO4': '0.157', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.728', 'WEAPON3': '1.300', 'weapon3': '2.754', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '55.000'} [2024-08-06 01:50:54,669][52820] DAMAGECOUNT value on done: 213318.0 [2024-08-06 01:50:54,669][52820] Sum rewards: 68.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon4': '0.246', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:54,889][52669] DAMAGECOUNT value on done: 241988.0 [2024-08-06 01:50:54,889][52669] Sum rewards: 73.214, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.560', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.184', 'weapon2': '0.274', 'WEAPON3': '1.150', 'HITCOUNT': '3.460', 'weapon3': '3.606', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 01:50:55,489][52794] DAMAGECOUNT value on done: 242739.0 [2024-08-06 01:50:55,491][52794] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.208', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.112', 'AMMO4': '0.171', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.144', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '59.500'} [2024-08-06 01:50:55,811][52667] DAMAGECOUNT value on done: 246533.0 [2024-08-06 01:50:55,812][52667] Sum rewards: 62.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.614', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO4': '0.209', 'weapon5': '0.230', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.714', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:55,996][52664] DAMAGECOUNT value on done: 245069.0 [2024-08-06 01:50:55,997][52664] Sum rewards: 63.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.681', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.180', 'AMMO3': '0.181', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.640', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '51.000'} [2024-08-06 01:50:56,068][52658] DAMAGECOUNT value on done: 244097.0 [2024-08-06 01:50:56,069][52658] Sum rewards: 70.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:56,409][52803] DAMAGECOUNT value on done: 229592.0 [2024-08-06 01:50:56,410][52803] Sum rewards: 72.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.206', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 01:50:56,412][52811] DAMAGECOUNT value on done: 227784.0 [2024-08-06 01:50:56,413][52811] Sum rewards: 68.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon4': '0.178', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '59.000'} [2024-08-06 01:50:57,064][52662] DAMAGECOUNT value on done: 245647.0 [2024-08-06 01:50:57,067][52662] Sum rewards: 64.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.066', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.116', 'AMMO4': '0.208', 'AMMO3': '0.242', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '57.000'} [2024-08-06 01:50:57,563][52660] DAMAGECOUNT value on done: 236237.0 [2024-08-06 01:50:57,564][52660] Sum rewards: 61.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.438', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.070', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.426', 'weapon4': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.708', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:57,749][52820] DAMAGECOUNT value on done: 225320.0 [2024-08-06 01:50:57,752][52820] Sum rewards: 78.333, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon4': '0.308', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '69.000'} [2024-08-06 01:50:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 274677760. Throughput: 0: 4393.6. Samples: 68678380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:50:57,794][52567] Avg episode reward: [(0, '63.720')] [2024-08-06 01:50:57,847][52669] DAMAGECOUNT value on done: 236583.0 [2024-08-06 01:50:57,848][52669] Sum rewards: 72.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.315', 'AMMO5': '0.010', 'AMMO2': '0.060', 'AMMO3': '0.155', 'weapon5': '0.174', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.392', 'weapon4': '0.440', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.768', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 01:50:57,912][52650] Updated weights for policy 0, policy_version 33531 (0.0012) [2024-08-06 01:50:58,189][52794] DAMAGECOUNT value on done: 247927.0 [2024-08-06 01:50:58,190][52794] Sum rewards: 53.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.795', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.144', 'AMMO3': '0.191', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.724', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '46.000'} [2024-08-06 01:50:58,433][52667] DAMAGECOUNT value on done: 236890.0 [2024-08-06 01:50:58,433][52667] Sum rewards: 65.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.156', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:58,598][52658] DAMAGECOUNT value on done: 244080.0 [2024-08-06 01:50:58,598][52658] Sum rewards: 65.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.082', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.074', 'weapon4': '0.096', 'AMMO4': '0.151', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '3.230', 'weapon3': '3.378', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '53.000'} [2024-08-06 01:50:58,940][52664] DAMAGECOUNT value on done: 258048.0 [2024-08-06 01:50:58,942][52664] Sum rewards: 61.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.242', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.062', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.408', 'weapon4': '0.632', 'WEAPON3': '0.900', 'weapon3': '2.604', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '50.000'} [2024-08-06 01:50:59,484][52803] DAMAGECOUNT value on done: 224822.0 [2024-08-06 01:50:59,487][52803] Sum rewards: 58.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO4': '0.179', 'AMMO3': '0.201', 'WEAPON5': '0.350', 'weapon4': '0.406', 'weapon2': '0.434', 'WEAPON4': '0.450', 'ARMOR': '0.456', 'WEAPON3': '1.200', 'weapon3': '2.772', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '48.000'} [2024-08-06 01:50:59,583][52811] DAMAGECOUNT value on done: 222554.0 [2024-08-06 01:50:59,584][52811] Sum rewards: 53.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.573', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.700', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '42.000'} [2024-08-06 01:50:59,749][52662] DAMAGECOUNT value on done: 242235.0 [2024-08-06 01:50:59,749][52662] Sum rewards: 61.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.160', 'AMMO4': '0.249', 'weapon5': '0.322', 'weapon4': '0.352', 'weapon2': '0.392', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.630', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '50.000'} [2024-08-06 01:51:00,387][52660] DAMAGECOUNT value on done: 241560.0 [2024-08-06 01:51:00,387][52660] Sum rewards: 59.072, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.732', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.118', 'AMMO3': '0.148', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.306', 'WEAPON3': '0.900', 'HITCOUNT': '2.830', 'weapon3': '3.156', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '47.000'} [2024-08-06 01:51:00,670][52669] DAMAGECOUNT value on done: 243006.0 [2024-08-06 01:51:00,672][52669] Sum rewards: 66.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.084', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.209', 'weapon4': '0.460', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.712', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:00,830][52820] DAMAGECOUNT value on done: 220282.0 [2024-08-06 01:51:00,830][52820] Sum rewards: 69.926, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.825', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.150', 'weapon4': '0.258', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.824', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:00,969][52794] DAMAGECOUNT value on done: 244821.0 [2024-08-06 01:51:00,971][52794] Sum rewards: 58.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.787', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.190', 'weapon2': '0.202', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '49.500'} [2024-08-06 01:51:01,212][52667] DAMAGECOUNT value on done: 244341.0 [2024-08-06 01:51:01,213][52667] Sum rewards: 59.045, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.070', 'weapon4': '0.092', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.292', 'weapon2': '0.408', 'WEAPON3': '1.750', 'HITCOUNT': '3.180', 'weapon3': '3.202', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '53.500'} [2024-08-06 01:51:01,430][52658] DAMAGECOUNT value on done: 243447.0 [2024-08-06 01:51:01,431][52658] Sum rewards: 56.862, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.920', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO4': '0.202', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.318', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.720', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '53.000'} [2024-08-06 01:51:02,055][52662] DAMAGECOUNT value on done: 238689.0 [2024-08-06 01:51:02,056][52662] Sum rewards: 66.820, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.161', 'weapon4': '0.266', 'HEALTH': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.910', 'weapon3': '3.308', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '54.000'} [2024-08-06 01:51:02,129][52664] DAMAGECOUNT value on done: 250552.0 [2024-08-06 01:51:02,131][52664] Sum rewards: 50.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.025', 'AMMO2': '0.061', 'AMMO3': '0.204', 'weapon5': '0.262', 'AMMO4': '0.305', 'weapon4': '0.356', 'weapon2': '0.478', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '46.500'} [2024-08-06 01:51:02,136][52614] Signal inference workers to stop experience collection... (6050 times) [2024-08-06 01:51:02,141][52614] Signal inference workers to resume experience collection... (6050 times) [2024-08-06 01:51:02,225][52650] InferenceWorker_p0-w0: stopping experience collection (6050 times) [2024-08-06 01:51:02,228][52650] InferenceWorker_p0-w0: resuming experience collection (6050 times) [2024-08-06 01:51:02,491][52650] Updated weights for policy 0, policy_version 33541 (0.0038) [2024-08-06 01:51:02,557][52803] DAMAGECOUNT value on done: 223449.0 [2024-08-06 01:51:02,558][52803] Sum rewards: 71.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.101', 'weapon5': '0.126', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.474', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '61.000'} [2024-08-06 01:51:02,559][52811] DAMAGECOUNT value on done: 230297.0 [2024-08-06 01:51:02,560][52811] Sum rewards: 65.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.830', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.940', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '54.000'} [2024-08-06 01:51:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 274767872. Throughput: 0: 4389.6. Samples: 68691470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:51:02,794][52567] Avg episode reward: [(0, '63.625')] [2024-08-06 01:51:03,223][52669] DAMAGECOUNT value on done: 243543.0 [2024-08-06 01:51:03,224][52669] Sum rewards: 53.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.092', 'AMMO3': '0.178', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.382', 'weapon2': '0.510', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.794', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:03,433][52660] DAMAGECOUNT value on done: 232265.0 [2024-08-06 01:51:03,435][52660] Sum rewards: 53.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.303', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.138', 'weapon4': '0.160', 'AMMO4': '0.234', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '3.062', 'DAMAGECOUNT': '13.953', 'FRAGCOUNT': '48.000'} [2024-08-06 01:51:03,759][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:51:03,864][52794] DAMAGECOUNT value on done: 242998.0 [2024-08-06 01:51:03,864][52794] Sum rewards: 60.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.132', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.048', 'DAMAGECOUNT': '14.022', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:04,144][52820] DAMAGECOUNT value on done: 222756.0 [2024-08-06 01:51:04,154][52820] Sum rewards: 73.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.450', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon2': '0.214', 'AMMO3': '0.284', 'WEAPON3': '1.650', 'weapon3': '3.426', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '64.000'} [2024-08-06 01:51:04,193][52658] DAMAGECOUNT value on done: 244059.0 [2024-08-06 01:51:04,197][52658] Sum rewards: 59.699, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.722', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon5': '0.082', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.316', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '48.500'} [2024-08-06 01:51:04,803][52664] DAMAGECOUNT value on done: 252637.0 [2024-08-06 01:51:04,806][52664] Sum rewards: 66.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon2': '0.222', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '58.000'} [2024-08-06 01:51:04,990][52658] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:51:05,513][52803] DAMAGECOUNT value on done: 231788.0 [2024-08-06 01:51:05,514][52803] Sum rewards: 65.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.748', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:05,689][52811] DAMAGECOUNT value on done: 226330.0 [2024-08-06 01:51:05,689][52811] Sum rewards: 56.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.058', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.250', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '46.000'} [2024-08-06 01:51:05,987][52669] DAMAGECOUNT value on done: 239338.0 [2024-08-06 01:51:05,991][52669] Sum rewards: 64.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.482', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.134', 'AMMO3': '0.216', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:06,277][52660] DAMAGECOUNT value on done: 241412.0 [2024-08-06 01:51:06,278][52660] Sum rewards: 67.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.007', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.268', 'weapon2': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.202', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:06,787][52658] DAMAGECOUNT value on done: 240065.0 [2024-08-06 01:51:06,789][52658] Sum rewards: 55.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.112', 'weapon4': '0.214', 'AMMO3': '0.228', 'AMMO4': '0.289', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.126', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:06,915][52794] DAMAGECOUNT value on done: 241053.0 [2024-08-06 01:51:06,915][52794] Sum rewards: 59.710, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon5': '0.190', 'AMMO3': '0.273', 'AMMO4': '0.297', 'WEAPON5': '0.300', 'weapon4': '0.472', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.548', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '53.000'} [2024-08-06 01:51:07,323][52650] Updated weights for policy 0, policy_version 33551 (0.0020) [2024-08-06 01:51:07,382][52820] DAMAGECOUNT value on done: 225979.0 [2024-08-06 01:51:07,386][52820] Sum rewards: 73.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.446', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon2': '0.222', 'AMMO3': '0.232', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '62.000'} [2024-08-06 01:51:07,670][52664] DAMAGECOUNT value on done: 248629.0 [2024-08-06 01:51:07,671][52664] Sum rewards: 56.032, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.085', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.324', 'weapon4': '0.364', 'WEAPON3': '1.000', 'weapon3': '3.062', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '13.374', 'FRAGCOUNT': '45.000'} [2024-08-06 01:51:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 274857984. Throughput: 0: 4392.5. Samples: 68718050. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:51:07,794][52567] Avg episode reward: [(0, '63.613')] [2024-08-06 01:51:08,554][52811] DAMAGECOUNT value on done: 221242.0 [2024-08-06 01:51:08,554][52811] Sum rewards: 59.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.857', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.212', 'weapon2': '0.442', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '2.996', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '50.000'} [2024-08-06 01:51:08,710][52803] DAMAGECOUNT value on done: 222917.0 [2024-08-06 01:51:08,712][52803] Sum rewards: 60.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.864', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon2': '0.190', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 01:51:08,767][52669] DAMAGECOUNT value on done: 244205.0 [2024-08-06 01:51:08,769][52669] Sum rewards: 66.767, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.174', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.184', 'weapon4': '0.190', 'AMMO4': '0.192', 'weapon2': '0.224', 'AMMO3': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '58.000'} [2024-08-06 01:51:09,204][52660] DAMAGECOUNT value on done: 237318.0 [2024-08-06 01:51:09,204][52660] Sum rewards: 65.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.573', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.090', 'AMMO3': '0.208', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'weapon4': '0.442', 'weapon2': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:09,578][52794] DAMAGECOUNT value on done: 239595.0 [2024-08-06 01:51:09,578][52794] Sum rewards: 59.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.008', 'weapon5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.280', 'ARMOR': '0.458', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.352', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '51.000'} [2024-08-06 01:51:09,855][52658] DAMAGECOUNT value on done: 248458.0 [2024-08-06 01:51:09,856][52658] Sum rewards: 52.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.403', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.318', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '44.000'} [2024-08-06 01:51:10,037][52664] DAMAGECOUNT value on done: 252290.0 [2024-08-06 01:51:10,037][52664] Sum rewards: 76.460, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.706', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.070', 'WEAPON4': '0.100', 'weapon2': '0.274', 'AMMO3': '0.312', 'WEAPON3': '1.850', 'weapon3': '3.360', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '65.000'} [2024-08-06 01:51:10,480][52820] DAMAGECOUNT value on done: 222973.0 [2024-08-06 01:51:10,481][52820] Sum rewards: 60.440, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'weapon4': '0.526', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.648', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:11,550][52669] DAMAGECOUNT value on done: 245430.0 [2024-08-06 01:51:11,552][52669] Sum rewards: 69.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.098', 'weapon5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.206', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '58.000'} [2024-08-06 01:51:11,560][52811] DAMAGECOUNT value on done: 224327.0 [2024-08-06 01:51:11,560][52811] Sum rewards: 65.123, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.725', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.072', 'AMMO4': '0.101', 'weapon5': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.230', 'weapon3': '3.294', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:11,808][52650] Updated weights for policy 0, policy_version 33561 (0.0011) [2024-08-06 01:51:11,853][52803] DAMAGECOUNT value on done: 229552.0 [2024-08-06 01:51:11,854][52803] Sum rewards: 73.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.394', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.288', 'weapon4': '0.372', 'WEAPON3': '1.600', 'weapon3': '3.026', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '63.000'} [2024-08-06 01:51:12,390][52794] DAMAGECOUNT value on done: 252184.0 [2024-08-06 01:51:12,392][52794] Sum rewards: 65.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.159', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.196', 'AMMO4': '0.196', 'weapon4': '0.234', 'AMMO3': '0.264', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.880', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:12,574][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:51:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 274948096. Throughput: 0: 4390.2. Samples: 68744510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:51:12,795][52567] Avg episode reward: [(0, '63.807')] [2024-08-06 01:51:12,893][52658] DAMAGECOUNT value on done: 235393.0 [2024-08-06 01:51:12,894][52658] Sum rewards: 59.180, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.299', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.176', 'weapon5': '0.188', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.046', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:13,082][52664] DAMAGECOUNT value on done: 249683.0 [2024-08-06 01:51:13,082][52664] Sum rewards: 70.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.238', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.100', 'weapon5': '0.130', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'HITCOUNT': '3.340', 'weapon3': '3.378', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '61.000'} [2024-08-06 01:51:13,559][52666] DAMAGECOUNT value on done: 245954.0 [2024-08-06 01:51:13,560][52666] Sum rewards: 70.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.042', 'weapon4': '0.074', 'AMMO4': '0.129', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:13,632][52820] DAMAGECOUNT value on done: 224130.0 [2024-08-06 01:51:13,632][52820] Sum rewards: 71.987, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.986', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.156', 'weapon2': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'WEAPON3': '1.700', 'weapon3': '3.304', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '63.500'} [2024-08-06 01:51:14,339][52669] DAMAGECOUNT value on done: 254400.0 [2024-08-06 01:51:14,347][52669] Sum rewards: 57.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.136', 'AMMO3': '0.184', 'weapon2': '0.194', 'AMMO4': '0.203', 'weapon4': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.176', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '47.500'} [2024-08-06 01:51:14,468][52811] DAMAGECOUNT value on done: 228106.0 [2024-08-06 01:51:14,469][52811] Sum rewards: 62.837, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'AMMO4': '0.166', 'weapon4': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.000', 'HITCOUNT': '3.050', 'weapon3': '3.252', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '50.000'} [2024-08-06 01:51:14,858][52803] DAMAGECOUNT value on done: 220490.0 [2024-08-06 01:51:14,859][52803] Sum rewards: 67.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.202', 'weapon2': '0.288', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:15,255][52794] DAMAGECOUNT value on done: 238429.0 [2024-08-06 01:51:15,256][52794] Sum rewards: 57.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.348', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.132', 'AMMO3': '0.182', 'weapon4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.010', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '47.000'} [2024-08-06 01:51:15,700][52671] DAMAGECOUNT value on done: 245791.0 [2024-08-06 01:51:15,703][52671] Sum rewards: 52.612, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.805', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.135', 'weapon5': '0.138', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.546', 'WEAPON3': '0.850', 'weapon2': '0.896', 'weapon3': '2.144', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '44.000'} [2024-08-06 01:51:15,928][52658] DAMAGECOUNT value on done: 247174.0 [2024-08-06 01:51:15,931][52658] Sum rewards: 68.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.792', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.224', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 01:51:16,204][52664] DAMAGECOUNT value on done: 252955.0 [2024-08-06 01:51:16,204][52664] Sum rewards: 57.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.178', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.734', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:16,234][52666] DAMAGECOUNT value on done: 245658.0 [2024-08-06 01:51:16,235][52666] Sum rewards: 65.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'weapon4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.326', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:16,447][52650] Updated weights for policy 0, policy_version 33571 (0.0022) [2024-08-06 01:51:16,703][52820] DAMAGECOUNT value on done: 223364.0 [2024-08-06 01:51:16,705][52820] Sum rewards: 63.215, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.169', 'weapon2': '0.178', 'HEALTH': '0.386', 'WEAPON3': '0.950', 'HITCOUNT': '3.170', 'weapon3': '3.422', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '50.000'} [2024-08-06 01:51:17,482][52669] DAMAGECOUNT value on done: 238261.0 [2024-08-06 01:51:17,483][52669] Sum rewards: 63.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.094', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon4': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:17,527][52811] DAMAGECOUNT value on done: 223176.0 [2024-08-06 01:51:17,528][52811] Sum rewards: 60.581, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.080', 'weapon7': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.184', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.886', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 275030016. Throughput: 0: 4405.6. Samples: 68757790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:51:17,794][52567] Avg episode reward: [(0, '63.351')] [2024-08-06 01:51:18,415][52794] DAMAGECOUNT value on done: 250875.0 [2024-08-06 01:51:18,415][52794] Sum rewards: 72.265, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.220', 'AMMO3': '0.236', 'weapon2': '0.312', 'HEALTH': '0.554', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:18,796][52671] DAMAGECOUNT value on done: 241550.0 [2024-08-06 01:51:18,798][52671] Sum rewards: 64.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.045', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.174', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '54.000'} [2024-08-06 01:51:18,994][52658] DAMAGECOUNT value on done: 245531.0 [2024-08-06 01:51:18,996][52658] Sum rewards: 68.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.114', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.648', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:19,391][52666] DAMAGECOUNT value on done: 245315.0 [2024-08-06 01:51:19,392][52666] Sum rewards: 67.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.100', 'weapon4': '0.138', 'AMMO4': '0.160', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:19,435][52664] DAMAGECOUNT value on done: 247519.0 [2024-08-06 01:51:19,435][52664] Sum rewards: 62.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.186', 'weapon5': '0.186', 'AMMO4': '0.251', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.766', 'WEAPON3': '1.200', 'weapon3': '2.418', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '53.000'} [2024-08-06 01:51:20,007][52669] DAMAGECOUNT value on done: 247195.0 [2024-08-06 01:51:20,009][52669] Sum rewards: 65.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.600', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:20,031][52820] DAMAGECOUNT value on done: 226905.0 [2024-08-06 01:51:20,033][52820] Sum rewards: 69.747, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.701', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.123', 'weapon5': '0.136', 'AMMO3': '0.156', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.408', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:20,705][52811] DAMAGECOUNT value on done: 230946.0 [2024-08-06 01:51:20,708][52811] Sum rewards: 74.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.178', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '61.000'} [2024-08-06 01:51:21,052][52650] Updated weights for policy 0, policy_version 33581 (0.0014) [2024-08-06 01:51:21,304][52794] DAMAGECOUNT value on done: 244988.0 [2024-08-06 01:51:21,305][52794] Sum rewards: 64.678, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.707', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO4': '0.193', 'weapon2': '0.220', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.324', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:21,585][52671] DAMAGECOUNT value on done: 244810.0 [2024-08-06 01:51:21,586][52671] Sum rewards: 61.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.234', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '51.000'} [2024-08-06 01:51:21,980][52666] DAMAGECOUNT value on done: 239600.0 [2024-08-06 01:51:21,982][52666] Sum rewards: 63.520, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.070', 'AMMO4': '0.152', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.318', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:22,507][52658] DAMAGECOUNT value on done: 248675.0 [2024-08-06 01:51:22,511][52658] Sum rewards: 70.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.168', 'AMMO4': '0.199', 'weapon2': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '58.000'} [2024-08-06 01:51:22,621][52664] DAMAGECOUNT value on done: 251659.0 [2024-08-06 01:51:22,624][52664] Sum rewards: 67.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.255', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'weapon5': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.240', 'weapon4': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 275120128. Throughput: 0: 4406.2. Samples: 68784070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:51:22,795][52567] Avg episode reward: [(0, '64.052')] [2024-08-06 01:51:22,911][52669] DAMAGECOUNT value on done: 245977.0 [2024-08-06 01:51:22,913][52669] Sum rewards: 52.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.104', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.182', 'AMMO3': '0.264', 'weapon4': '0.312', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.842', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '46.500'} [2024-08-06 01:51:23,136][52820] DAMAGECOUNT value on done: 223931.0 [2024-08-06 01:51:23,137][52820] Sum rewards: 59.552, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.157', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.492', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.552', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '51.000'} [2024-08-06 01:51:23,563][52670] DAMAGECOUNT value on done: 237631.0 [2024-08-06 01:51:23,565][52670] Sum rewards: 68.346, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.431', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.257', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:24,295][52671] DAMAGECOUNT value on done: 240398.0 [2024-08-06 01:51:24,295][52671] Sum rewards: 58.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.165', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.207', 'WEAPON4': '0.400', 'weapon4': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.000'} [2024-08-06 01:51:24,341][52794] DAMAGECOUNT value on done: 245122.0 [2024-08-06 01:51:24,341][52794] Sum rewards: 67.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO3': '0.181', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:24,403][52670] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:51:24,731][52666] DAMAGECOUNT value on done: 237012.0 [2024-08-06 01:51:24,756][52666] Sum rewards: 47.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.614', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.251', 'weapon4': '0.348', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.818', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '41.500'} [2024-08-06 01:51:25,515][52669] DAMAGECOUNT value on done: 249129.0 [2024-08-06 01:51:25,515][52669] Sum rewards: 60.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.076', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '50.000'} [2024-08-06 01:51:25,539][52658] DAMAGECOUNT value on done: 233727.0 [2024-08-06 01:51:25,540][52658] Sum rewards: 56.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.280', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon4': '0.276', 'weapon2': '0.340', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.184', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '48.000'} [2024-08-06 01:51:25,596][52664] DAMAGECOUNT value on done: 252073.0 [2024-08-06 01:51:25,598][52664] Sum rewards: 61.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.701', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.136', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.302', 'WEAPON3': '1.600', 'HITCOUNT': '2.920', 'weapon3': '3.272', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '54.000'} [2024-08-06 01:51:25,819][52650] Updated weights for policy 0, policy_version 33591 (0.0024) [2024-08-06 01:51:26,280][52670] DAMAGECOUNT value on done: 242874.0 [2024-08-06 01:51:26,281][52670] Sum rewards: 49.802, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.108', 'AMMO5': '0.022', 'AMMO2': '0.070', 'weapon5': '0.090', 'AMMO3': '0.211', 'AMMO4': '0.352', 'weapon4': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'weapon2': '0.888', 'WEAPON3': '1.250', 'weapon3': '2.324', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '44.000'} [2024-08-06 01:51:26,289][52820] DAMAGECOUNT value on done: 223383.0 [2024-08-06 01:51:26,289][52820] Sum rewards: 71.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.341', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.118', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:27,193][52794] DAMAGECOUNT value on done: 255103.0 [2024-08-06 01:51:27,196][52794] Sum rewards: 68.133, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'weapon4': '0.190', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.328', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:27,263][52671] DAMAGECOUNT value on done: 247860.0 [2024-08-06 01:51:27,263][52671] Sum rewards: 74.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'weapon5': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:27,550][52666] DAMAGECOUNT value on done: 234109.0 [2024-08-06 01:51:27,551][52666] Sum rewards: 65.638, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.674', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO4': '0.130', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.254', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '58.000'} [2024-08-06 01:51:27,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 275202048. Throughput: 0: 4401.5. Samples: 68810300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:51:27,795][52567] Avg episode reward: [(0, '63.947')] [2024-08-06 01:51:28,056][52664] DAMAGECOUNT value on done: 249642.0 [2024-08-06 01:51:28,057][52664] Sum rewards: 51.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '2.590', 'weapon3': '3.224', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '43.000'} [2024-08-06 01:51:28,535][52658] DAMAGECOUNT value on done: 241873.0 [2024-08-06 01:51:28,536][52658] Sum rewards: 62.639, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.223', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.776', 'WEAPON3': '1.450', 'weapon3': '2.468', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '53.500'} [2024-08-06 01:51:29,410][52820] DAMAGECOUNT value on done: 225301.0 [2024-08-06 01:51:29,410][52820] Sum rewards: 58.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO4': '0.213', 'AMMO3': '0.218', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:29,498][52670] DAMAGECOUNT value on done: 235682.0 [2024-08-06 01:51:29,498][52670] Sum rewards: 49.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.902', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.249', 'weapon4': '0.368', 'WEAPON5': '0.400', 'weapon2': '0.598', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.580', 'weapon3': '2.622', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '44.000'} [2024-08-06 01:51:29,997][52794] DAMAGECOUNT value on done: 245102.0 [2024-08-06 01:51:30,005][52794] Sum rewards: 64.549, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.426', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.132', 'weapon5': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.309', 'weapon2': '0.386', 'WEAPON3': '1.650', 'HITCOUNT': '3.030', 'weapon3': '3.042', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:30,567][52671] DAMAGECOUNT value on done: 242989.0 [2024-08-06 01:51:30,567][52671] Sum rewards: 65.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.429', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO4': '0.157', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:30,616][52666] DAMAGECOUNT value on done: 242003.0 [2024-08-06 01:51:30,619][52666] Sum rewards: 59.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.044', 'weapon5': '0.048', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.594', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '51.000'} [2024-08-06 01:51:30,744][52650] Updated weights for policy 0, policy_version 33601 (0.0036) [2024-08-06 01:51:30,889][52658] DAMAGECOUNT value on done: 241575.0 [2024-08-06 01:51:30,889][52658] Sum rewards: 62.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.748', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.231', 'weapon2': '0.578', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '54.000'} [2024-08-06 01:51:31,155][52664] DAMAGECOUNT value on done: 251832.0 [2024-08-06 01:51:31,156][52664] Sum rewards: 65.115, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:32,256][52670] DAMAGECOUNT value on done: 236914.0 [2024-08-06 01:51:32,257][52670] Sum rewards: 65.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.326', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.049', 'weapon4': '0.134', 'AMMO3': '0.139', 'weapon5': '0.180', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.854', 'weapon3': '2.634', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:32,446][52820] DAMAGECOUNT value on done: 224738.0 [2024-08-06 01:51:32,446][52820] Sum rewards: 75.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.104', 'weapon5': '0.108', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '62.000'} [2024-08-06 01:51:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 275292160. Throughput: 0: 4401.1. Samples: 68823530. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:51:32,794][52567] Avg episode reward: [(0, '63.247')] [2024-08-06 01:51:32,947][52671] DAMAGECOUNT value on done: 244836.0 [2024-08-06 01:51:32,949][52671] Sum rewards: 58.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon5': '0.230', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.828', 'WEAPON3': '1.150', 'weapon3': '2.422', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '48.000'} [2024-08-06 01:51:33,360][52666] DAMAGECOUNT value on done: 240334.0 [2024-08-06 01:51:33,361][52666] Sum rewards: 62.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon4': '0.274', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '52.000'} [2024-08-06 01:51:33,877][52658] DAMAGECOUNT value on done: 236339.0 [2024-08-06 01:51:33,877][52658] Sum rewards: 67.563, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.168', 'weapon4': '0.206', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'WEAPON3': '1.650', 'weapon3': '3.230', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:34,967][52670] DAMAGECOUNT value on done: 243319.0 [2024-08-06 01:51:34,968][52670] Sum rewards: 81.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.118', 'weapon4': '0.214', 'weapon2': '0.244', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.142', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '70.000'} [2024-08-06 01:51:35,065][52650] Updated weights for policy 0, policy_version 33611 (0.0030) [2024-08-06 01:51:35,578][52820] DAMAGECOUNT value on done: 219388.0 [2024-08-06 01:51:35,578][52820] Sum rewards: 61.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.444', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.127', 'AMMO3': '0.200', 'weapon2': '0.216', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.180', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '53.000'} [2024-08-06 01:51:35,859][52662] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:51:35,931][52666] DAMAGECOUNT value on done: 239762.0 [2024-08-06 01:51:35,935][52666] Sum rewards: 47.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.140', 'weapon5': '0.172', 'AMMO4': '0.216', 'weapon4': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.852', 'WEAPON3': '0.950', 'weapon3': '2.320', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '11.982', 'FRAGCOUNT': '38.000'} [2024-08-06 01:51:36,054][52671] DAMAGECOUNT value on done: 246892.0 [2024-08-06 01:51:36,055][52671] Sum rewards: 71.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:36,513][52658] DAMAGECOUNT value on done: 242128.0 [2024-08-06 01:51:36,513][52658] Sum rewards: 60.403, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.292', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.250', 'AMMO3': '0.295', 'weapon2': '0.316', 'WEAPON3': '1.800', 'HITCOUNT': '3.170', 'weapon3': '3.182', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:37,578][52670] DAMAGECOUNT value on done: 241090.0 [2024-08-06 01:51:37,580][52670] Sum rewards: 67.820, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.098', 'AMMO3': '0.177', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:37,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 275390464. Throughput: 0: 4395.8. Samples: 68849790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:51:37,794][52567] Avg episode reward: [(0, '63.221')] [2024-08-06 01:51:38,548][52820] DAMAGECOUNT value on done: 229994.0 [2024-08-06 01:51:38,548][52820] Sum rewards: 70.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.484', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.176', 'AMMO3': '0.234', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.550', 'weapon3': '2.758', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:38,693][52666] DAMAGECOUNT value on done: 240489.0 [2024-08-06 01:51:38,693][52666] Sum rewards: 68.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.899', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.304', 'weapon4': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:38,897][52671] DAMAGECOUNT value on done: 240017.0 [2024-08-06 01:51:38,898][52671] Sum rewards: 68.433, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.518', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO3': '0.118', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.450', 'weapon2': '0.628', 'WEAPON3': '0.800', 'weapon3': '2.696', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '52.000'} [2024-08-06 01:51:39,197][52658] DAMAGECOUNT value on done: 247885.0 [2024-08-06 01:51:39,199][52658] Sum rewards: 71.398, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.695', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.120', 'weapon5': '0.158', 'AMMO4': '0.184', 'AMMO3': '0.193', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:39,865][52650] Updated weights for policy 0, policy_version 33621 (0.0030) [2024-08-06 01:51:40,379][52670] DAMAGECOUNT value on done: 235562.0 [2024-08-06 01:51:40,381][52670] Sum rewards: 68.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.210', 'WEAPON3': '1.250', 'HITCOUNT': '3.350', 'weapon3': '3.408', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:41,597][52658] DAMAGECOUNT value on done: 239207.0 [2024-08-06 01:51:41,599][52658] Sum rewards: 68.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.865', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.294', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.354', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:41,609][52820] DAMAGECOUNT value on done: 232390.0 [2024-08-06 01:51:41,610][52820] Sum rewards: 65.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.268', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.476', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2024-08-06 01:51:41,883][52666] DAMAGECOUNT value on done: 238089.0 [2024-08-06 01:51:41,884][52666] Sum rewards: 57.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.117', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.110', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'weapon2': '0.230', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:41,933][52671] DAMAGECOUNT value on done: 248480.0 [2024-08-06 01:51:41,934][52671] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.504', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.220', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.246', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 275472384. Throughput: 0: 4391.1. Samples: 68875980. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:51:42,794][52567] Avg episode reward: [(0, '63.806')] [2024-08-06 01:51:43,280][52670] DAMAGECOUNT value on done: 239074.0 [2024-08-06 01:51:43,281][52670] Sum rewards: 58.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.476', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.252', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '52.000'} [2024-08-06 01:51:44,345][52666] DAMAGECOUNT value on done: 232123.0 [2024-08-06 01:51:44,345][52666] Sum rewards: 51.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon5': '0.152', 'AMMO3': '0.214', 'weapon2': '0.218', 'AMMO4': '0.309', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'weapon4': '0.840', 'WEAPON3': '1.350', 'weapon3': '2.476', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '45.000'} [2024-08-06 01:51:44,693][52658] DAMAGECOUNT value on done: 242082.0 [2024-08-06 01:51:44,696][52658] Sum rewards: 71.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.508', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.072', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '60.000'} [2024-08-06 01:51:44,700][52820] DAMAGECOUNT value on done: 221459.0 [2024-08-06 01:51:44,702][52820] Sum rewards: 63.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.570', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon2': '0.180', 'weapon4': '0.242', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.600', 'HITCOUNT': '3.310', 'weapon3': '3.346', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:44,731][52650] Updated weights for policy 0, policy_version 33631 (0.0042) [2024-08-06 01:51:44,867][52671] DAMAGECOUNT value on done: 247570.0 [2024-08-06 01:51:44,868][52671] Sum rewards: 68.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.138', 'AMMO4': '0.141', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.202', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:46,040][52670] DAMAGECOUNT value on done: 237672.0 [2024-08-06 01:51:46,041][52670] Sum rewards: 61.636, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.147', 'weapon5': '0.276', 'weapon4': '0.300', 'AMMO4': '0.306', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '2.758', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '49.000'} [2024-08-06 01:51:47,387][52666] DAMAGECOUNT value on done: 245303.0 [2024-08-06 01:51:47,397][52666] Sum rewards: 61.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.245', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.132', 'weapon4': '0.208', 'AMMO4': '0.245', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '54.000'} [2024-08-06 01:51:47,458][52658] DAMAGECOUNT value on done: 243747.0 [2024-08-06 01:51:47,458][52658] Sum rewards: 50.051, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.932', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.144', 'weapon5': '0.186', 'AMMO4': '0.255', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.716', 'WEAPON3': '0.800', 'weapon3': '2.454', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '13.005', 'FRAGCOUNT': '41.500'} [2024-08-06 01:51:47,714][52671] DAMAGECOUNT value on done: 243829.0 [2024-08-06 01:51:47,714][52671] Sum rewards: 67.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.889', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.260', 'weapon4': '0.478', 'WEAPON3': '1.450', 'weapon3': '2.716', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 275554304. Throughput: 0: 4396.0. Samples: 68889290. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 01:51:47,794][52567] Avg episode reward: [(0, '63.809')] [2024-08-06 01:51:48,981][52650] Updated weights for policy 0, policy_version 33641 (0.0013) [2024-08-06 01:51:49,093][52670] DAMAGECOUNT value on done: 233620.0 [2024-08-06 01:51:49,094][52670] Sum rewards: 72.018, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.828', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.546', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 01:51:50,293][52671] DAMAGECOUNT value on done: 251073.0 [2024-08-06 01:51:50,293][52671] Sum rewards: 64.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.096', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.157', 'weapon2': '0.298', 'WEAPON3': '1.000', 'HITCOUNT': '3.320', 'weapon3': '3.436', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 01:51:50,429][52666] DAMAGECOUNT value on done: 243729.0 [2024-08-06 01:51:50,432][52666] Sum rewards: 70.525, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '55.000'} [2024-08-06 01:51:52,124][52670] DAMAGECOUNT value on done: 244938.0 [2024-08-06 01:51:52,124][52670] Sum rewards: 60.524, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.168', 'weapon4': '0.196', 'AMMO3': '0.220', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.886', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 01:51:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 275644416. Throughput: 0: 4393.8. Samples: 68915770. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:51:52,794][52567] Avg episode reward: [(0, '63.948')] [2024-08-06 01:51:52,943][52671] DAMAGECOUNT value on done: 240481.0 [2024-08-06 01:51:52,945][52671] Sum rewards: 59.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.454', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.266', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '50.000'} [2024-08-06 01:51:53,133][52659] DAMAGECOUNT value on done: 243095.0 [2024-08-06 01:51:53,133][52659] Sum rewards: 59.119, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.037', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'HEALTH': '0.236', 'weapon5': '0.268', 'weapon4': '0.390', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.458', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '47.000'} [2024-08-06 01:51:53,387][52666] DAMAGECOUNT value on done: 239041.0 [2024-08-06 01:51:53,389][52666] Sum rewards: 68.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.084', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 01:51:53,755][52650] Updated weights for policy 0, policy_version 33651 (0.0024) [2024-08-06 01:51:55,161][52670] DAMAGECOUNT value on done: 241458.0 [2024-08-06 01:51:55,161][52670] Sum rewards: 64.127, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.706', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.094', 'weapon4': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '56.000'} [2024-08-06 01:51:55,588][52671] DAMAGECOUNT value on done: 235342.0 [2024-08-06 01:51:55,591][52671] Sum rewards: 57.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.010', 'AMMO2': '0.060', 'weapon5': '0.120', 'AMMO3': '0.179', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO4': '0.300', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '51.000'} [2024-08-06 01:51:55,770][52659] DAMAGECOUNT value on done: 241210.0 [2024-08-06 01:51:55,771][52659] Sum rewards: 65.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.073', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon4': '0.280', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '57.000'} [2024-08-06 01:51:56,707][52666] DAMAGECOUNT value on done: 238174.0 [2024-08-06 01:51:56,709][52666] Sum rewards: 69.824, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.741', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.112', 'AMMO4': '0.148', 'AMMO3': '0.188', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.448', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '58.000'} [2024-08-06 01:51:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 275734528. Throughput: 0: 4387.8. Samples: 68941960. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:51:57,794][52567] Avg episode reward: [(0, '64.079')] [2024-08-06 01:51:58,190][52671] DAMAGECOUNT value on done: 244549.0 [2024-08-06 01:51:58,192][52671] Sum rewards: 58.059, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.698', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.262', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.484', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '52.000'} [2024-08-06 01:51:58,377][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:51:58,408][52670] DAMAGECOUNT value on done: 240234.0 [2024-08-06 01:51:58,409][52670] Sum rewards: 74.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.647', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '65.000'} [2024-08-06 01:51:58,420][52659] DAMAGECOUNT value on done: 242200.0 [2024-08-06 01:51:58,420][52659] Sum rewards: 62.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.236', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '50.000'} [2024-08-06 01:51:58,652][52650] Updated weights for policy 0, policy_version 33661 (0.0012) [2024-08-06 01:51:59,613][52666] DAMAGECOUNT value on done: 235065.0 [2024-08-06 01:51:59,613][52666] Sum rewards: 55.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.695', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'weapon5': '0.094', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.308', 'weapon2': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.718', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '45.000'} [2024-08-06 01:51:59,856][52663] DAMAGECOUNT value on done: 246011.0 [2024-08-06 01:51:59,856][52663] Sum rewards: 67.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.078', 'weapon4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '58.000'} [2024-08-06 01:52:00,631][52671] DAMAGECOUNT value on done: 246055.0 [2024-08-06 01:52:00,632][52671] Sum rewards: 67.279, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.944', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.154', 'weapon4': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '59.000'} [2024-08-06 01:52:00,793][52659] DAMAGECOUNT value on done: 241219.0 [2024-08-06 01:52:00,793][52659] Sum rewards: 64.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.129', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.792', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '55.000'} [2024-08-06 01:52:01,383][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:52:01,445][52670] DAMAGECOUNT value on done: 242747.0 [2024-08-06 01:52:01,445][52670] Sum rewards: 63.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.666', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '53.000'} [2024-08-06 01:52:02,594][52666] DAMAGECOUNT value on done: 243622.0 [2024-08-06 01:52:02,596][52666] Sum rewards: 58.812, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.080', 'weapon4': '0.156', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.292', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '52.500'} [2024-08-06 01:52:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 275824640. Throughput: 0: 4389.8. Samples: 68955330. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:52:02,794][52567] Avg episode reward: [(0, '63.908')] [2024-08-06 01:52:02,802][52663] DAMAGECOUNT value on done: 242274.0 [2024-08-06 01:52:02,802][52663] Sum rewards: 67.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.621', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.450', 'weapon3': '2.916', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:02,976][52650] Updated weights for policy 0, policy_version 33671 (0.0021) [2024-08-06 01:52:03,245][52671] DAMAGECOUNT value on done: 249704.0 [2024-08-06 01:52:03,247][52671] Sum rewards: 59.046, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.058', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO4': '0.291', 'AMMO3': '0.300', 'weapon2': '0.372', 'weapon4': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.832', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '51.000'} [2024-08-06 01:52:03,506][52659] DAMAGECOUNT value on done: 238586.0 [2024-08-06 01:52:03,508][52659] Sum rewards: 70.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.416', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.154', 'AMMO3': '0.163', 'weapon2': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.916', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:04,264][52670] DAMAGECOUNT value on done: 242533.0 [2024-08-06 01:52:04,265][52670] Sum rewards: 61.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.094', 'weapon4': '0.114', 'AMMO4': '0.120', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.862', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '50.000'} [2024-08-06 01:52:05,574][52666] DAMAGECOUNT value on done: 234936.0 [2024-08-06 01:52:05,574][52666] Sum rewards: 56.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.816', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.224', 'weapon5': '0.250', 'AMMO4': '0.266', 'weapon2': '0.340', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.734', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '48.500'} [2024-08-06 01:52:05,754][52663] DAMAGECOUNT value on done: 238514.0 [2024-08-06 01:52:05,755][52663] Sum rewards: 67.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.230', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.056', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.450', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '54.000'} [2024-08-06 01:52:06,329][52671] DAMAGECOUNT value on done: 245642.0 [2024-08-06 01:52:06,331][52671] Sum rewards: 73.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.137', 'weapon4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '61.000'} [2024-08-06 01:52:06,639][52659] DAMAGECOUNT value on done: 241641.0 [2024-08-06 01:52:06,642][52659] Sum rewards: 58.808, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.052', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.170', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'HITCOUNT': '2.970', 'weapon3': '3.380', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '53.000'} [2024-08-06 01:52:07,341][52670] DAMAGECOUNT value on done: 230339.0 [2024-08-06 01:52:07,342][52670] Sum rewards: 54.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.078', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.192', 'weapon4': '0.202', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '2.896', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '47.000'} [2024-08-06 01:52:07,639][52650] Updated weights for policy 0, policy_version 33681 (0.0037) [2024-08-06 01:52:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 275914752. Throughput: 0: 4393.1. Samples: 68981760. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:52:07,802][52567] Avg episode reward: [(0, '63.892')] [2024-08-06 01:52:08,478][52666] DAMAGECOUNT value on done: 240952.0 [2024-08-06 01:52:08,478][52666] Sum rewards: 55.260, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.156', 'weapon5': '0.192', 'AMMO4': '0.232', 'AMMO3': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.650', 'weapon3': '2.734', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '49.000'} [2024-08-06 01:52:08,645][52649] DAMAGECOUNT value on done: 235291.0 [2024-08-06 01:52:08,645][52649] Sum rewards: 67.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.076', 'AMMO3': '0.154', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.500', 'weapon2': '0.756', 'WEAPON3': '1.000', 'weapon3': '2.516', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '57.000'} [2024-08-06 01:52:08,914][52663] DAMAGECOUNT value on done: 243171.0 [2024-08-06 01:52:08,916][52663] Sum rewards: 54.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.013', 'weapon7': '0.026', 'AMMO2': '0.053', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.170', 'weapon5': '0.188', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'weapon4': '0.430', 'WEAPON4': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.520', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.999', 'FRAGCOUNT': '46.000'} [2024-08-06 01:52:09,283][52671] DAMAGECOUNT value on done: 241812.0 [2024-08-06 01:52:09,284][52671] Sum rewards: 63.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.230', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '3.346', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2024-08-06 01:52:09,491][52659] DAMAGECOUNT value on done: 241937.0 [2024-08-06 01:52:09,493][52659] Sum rewards: 68.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.119', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.187', 'weapon2': '0.332', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:10,031][52670] DAMAGECOUNT value on done: 243751.0 [2024-08-06 01:52:10,032][52670] Sum rewards: 56.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.225', 'AMMO5': '0.010', 'AMMO2': '0.080', 'weapon5': '0.108', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'AMMO4': '0.398', 'weapon2': '0.534', 'WEAPON4': '0.550', 'weapon4': '0.816', 'WEAPON3': '1.100', 'weapon3': '2.224', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '49.000'} [2024-08-06 01:52:11,659][52649] DAMAGECOUNT value on done: 229231.0 [2024-08-06 01:52:11,659][52649] Sum rewards: 66.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.244', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '57.000'} [2024-08-06 01:52:11,694][52663] DAMAGECOUNT value on done: 241913.0 [2024-08-06 01:52:11,695][52663] Sum rewards: 69.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.163', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO4': '0.193', 'AMMO3': '0.215', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '58.000'} [2024-08-06 01:52:12,059][52659] DAMAGECOUNT value on done: 237810.0 [2024-08-06 01:52:12,060][52659] Sum rewards: 64.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.435', 'AMMO5': '0.006', 'weapon5': '0.032', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.247', 'weapon4': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:12,569][52650] Updated weights for policy 0, policy_version 33691 (0.0039) [2024-08-06 01:52:12,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 275996672. Throughput: 0: 4396.9. Samples: 69008160. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:52:12,795][52567] Avg episode reward: [(0, '63.703')] [2024-08-06 01:52:12,842][52670] DAMAGECOUNT value on done: 246161.0 [2024-08-06 01:52:12,842][52670] Sum rewards: 74.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.835', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.255', 'weapon2': '0.320', 'WEAPON3': '1.700', 'weapon3': '3.396', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '64.000'} [2024-08-06 01:52:14,560][52649] DAMAGECOUNT value on done: 237532.0 [2024-08-06 01:52:14,561][52649] Sum rewards: 61.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.019', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.218', 'weapon4': '0.244', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.152', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '52.000'} [2024-08-06 01:52:14,821][52663] DAMAGECOUNT value on done: 246225.0 [2024-08-06 01:52:14,822][52663] Sum rewards: 58.343, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.446', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.350', 'weapon4': '0.352', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.408', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '47.000'} [2024-08-06 01:52:14,859][52659] DAMAGECOUNT value on done: 247942.0 [2024-08-06 01:52:14,861][52659] Sum rewards: 68.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.889', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.045', 'weapon5': '0.086', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'weapon2': '0.378', 'weapon4': '0.562', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '55.000'} [2024-08-06 01:52:15,640][52670] DAMAGECOUNT value on done: 239945.0 [2024-08-06 01:52:15,640][52670] Sum rewards: 71.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.884', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.143', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '59.000'} [2024-08-06 01:52:15,729][52667] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2024-08-06 01:52:16,980][52650] Updated weights for policy 0, policy_version 33701 (0.0038) [2024-08-06 01:52:17,366][52659] DAMAGECOUNT value on done: 247212.0 [2024-08-06 01:52:17,367][52659] Sum rewards: 69.982, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.245', 'weapon4': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '60.000'} [2024-08-06 01:52:17,391][52649] DAMAGECOUNT value on done: 238736.0 [2024-08-06 01:52:17,391][52649] Sum rewards: 64.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.786', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.217', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.410', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2024-08-06 01:52:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 276086784. Throughput: 0: 4393.6. Samples: 69021240. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:52:17,794][52567] Avg episode reward: [(0, '63.738')] [2024-08-06 01:52:17,969][52663] DAMAGECOUNT value on done: 242679.0 [2024-08-06 01:52:17,970][52663] Sum rewards: 55.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.165', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.434', 'weapon2': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.356', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '46.000'} [2024-08-06 01:52:18,167][52670] DAMAGECOUNT value on done: 242328.0 [2024-08-06 01:52:18,167][52670] Sum rewards: 58.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.922', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.206', 'AMMO3': '0.249', 'weapon2': '0.268', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.238', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '51.000'} [2024-08-06 01:52:19,893][52659] DAMAGECOUNT value on done: 241584.0 [2024-08-06 01:52:19,894][52659] Sum rewards: 62.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.512', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.000'} [2024-08-06 01:52:20,637][52649] DAMAGECOUNT value on done: 228433.0 [2024-08-06 01:52:20,637][52649] Sum rewards: 59.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.915', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.204', 'weapon2': '0.226', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.454', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '52.000'} [2024-08-06 01:52:20,743][52663] DAMAGECOUNT value on done: 242532.0 [2024-08-06 01:52:20,744][52663] Sum rewards: 53.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.200', 'AMMO3': '0.243', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.500', 'weapon3': '2.650', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '48.000'} [2024-08-06 01:52:21,577][52650] Updated weights for policy 0, policy_version 33711 (0.0021) [2024-08-06 01:52:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 276168704. Throughput: 0: 4389.7. Samples: 69047330. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:52:22,803][52567] Avg episode reward: [(0, '63.503')] [2024-08-06 01:52:23,050][52663] DAMAGECOUNT value on done: 241928.0 [2024-08-06 01:52:23,051][52663] Sum rewards: 66.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.594', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '54.000'} [2024-08-06 01:52:23,165][52659] DAMAGECOUNT value on done: 241217.0 [2024-08-06 01:52:23,166][52659] Sum rewards: 67.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.914', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.176', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:23,821][52649] DAMAGECOUNT value on done: 239698.0 [2024-08-06 01:52:23,822][52649] Sum rewards: 63.514, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.528', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.058', 'AMMO3': '0.220', 'AMMO4': '0.289', 'weapon5': '0.298', 'weapon4': '0.358', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.584', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '55.000'} [2024-08-06 01:52:24,794][52665] DAMAGECOUNT value on done: 239748.0 [2024-08-06 01:52:24,800][52665] Sum rewards: 66.887, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.113', 'weapon2': '0.202', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.852', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 01:52:25,642][52663] DAMAGECOUNT value on done: 243778.0 [2024-08-06 01:52:25,645][52663] Sum rewards: 66.330, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.278', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.292', 'weapon2': '0.318', 'WEAPON3': '1.750', 'HITCOUNT': '3.260', 'weapon3': '3.348', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '60.000'} [2024-08-06 01:52:25,811][52659] DAMAGECOUNT value on done: 237567.0 [2024-08-06 01:52:25,812][52659] Sum rewards: 67.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.186', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '57.000'} [2024-08-06 01:52:26,479][52650] Updated weights for policy 0, policy_version 33721 (0.0023) [2024-08-06 01:52:27,017][52649] DAMAGECOUNT value on done: 234075.0 [2024-08-06 01:52:27,017][52649] Sum rewards: 53.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.126', 'AMMO3': '0.195', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '3.168', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '45.000'} [2024-08-06 01:52:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 276267008. Throughput: 0: 4389.3. Samples: 69073500. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:52:27,794][52567] Avg episode reward: [(0, '63.839')] [2024-08-06 01:52:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033724_276267008.pth... [2024-08-06 01:52:27,909][52665] DAMAGECOUNT value on done: 245430.0 [2024-08-06 01:52:27,911][52665] Sum rewards: 67.099, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.470', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.096', 'AMMO3': '0.175', 'AMMO4': '0.244', 'weapon2': '0.280', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '54.000'} [2024-08-06 01:52:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033208_272039936.pth [2024-08-06 01:52:28,493][52663] DAMAGECOUNT value on done: 247343.0 [2024-08-06 01:52:28,494][52663] Sum rewards: 66.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.142', 'AMMO3': '0.190', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:29,012][52659] DAMAGECOUNT value on done: 243363.0 [2024-08-06 01:52:29,014][52659] Sum rewards: 61.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.176', 'AMMO5': '0.007', 'AMMO2': '0.069', 'weapon5': '0.092', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.345', 'weapon2': '0.370', 'WEAPON4': '0.800', 'WEAPON3': '1.000', 'weapon4': '1.060', 'weapon3': '2.168', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 01:52:29,851][52649] DAMAGECOUNT value on done: 241135.0 [2024-08-06 01:52:29,852][52649] Sum rewards: 48.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.980', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.086', 'weapon5': '0.088', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.450', 'weapon4': '0.934', 'WEAPON3': '1.150', 'weapon3': '2.314', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '12.219', 'FRAGCOUNT': '41.000'} [2024-08-06 01:52:30,531][52665] DAMAGECOUNT value on done: 239787.0 [2024-08-06 01:52:30,531][52665] Sum rewards: 75.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.565', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.146', 'AMMO3': '0.168', 'weapon2': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '62.000'} [2024-08-06 01:52:31,187][52650] Updated weights for policy 0, policy_version 33731 (0.0011) [2024-08-06 01:52:31,438][52663] DAMAGECOUNT value on done: 240507.0 [2024-08-06 01:52:31,439][52663] Sum rewards: 58.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.096', 'AMMO4': '0.172', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '51.000'} [2024-08-06 01:52:31,726][52659] DAMAGECOUNT value on done: 246340.0 [2024-08-06 01:52:31,727][52659] Sum rewards: 63.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.266', 'weapon4': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '53.000'} [2024-08-06 01:52:32,422][52649] DAMAGECOUNT value on done: 239005.0 [2024-08-06 01:52:32,423][52649] Sum rewards: 68.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.585', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.272', 'weapon2': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.442', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '59.000'} [2024-08-06 01:52:32,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 276348928. Throughput: 0: 4385.1. Samples: 69086620. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 01:52:32,794][52567] Avg episode reward: [(0, '63.905')] [2024-08-06 01:52:33,252][52665] DAMAGECOUNT value on done: 238628.0 [2024-08-06 01:52:33,252][52665] Sum rewards: 59.176, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.914', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon5': '0.224', 'weapon4': '0.270', 'AMMO3': '0.276', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.816', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '54.000'} [2024-08-06 01:52:34,213][52659] DAMAGECOUNT value on done: 250887.0 [2024-08-06 01:52:34,213][52659] Sum rewards: 72.599, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.329', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon4': '0.144', 'weapon5': '0.144', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.231', 'AMMO4': '0.236', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '63.000'} [2024-08-06 01:52:34,486][52663] DAMAGECOUNT value on done: 236665.0 [2024-08-06 01:52:34,486][52663] Sum rewards: 75.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.442', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon4': '0.120', 'weapon5': '0.128', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'AMMO4': '0.269', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '64.000'} [2024-08-06 01:52:35,163][52649] DAMAGECOUNT value on done: 236791.0 [2024-08-06 01:52:35,164][52649] Sum rewards: 66.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.140', 'weapon4': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:35,457][52803] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:52:35,652][52650] Updated weights for policy 0, policy_version 33741 (0.0023) [2024-08-06 01:52:36,092][52665] DAMAGECOUNT value on done: 234667.0 [2024-08-06 01:52:36,092][52665] Sum rewards: 49.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.154', 'AMMO4': '0.196', 'AMMO3': '0.207', 'weapon4': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.606', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.432', 'FRAGCOUNT': '43.000'} [2024-08-06 01:52:37,188][52663] DAMAGECOUNT value on done: 236909.0 [2024-08-06 01:52:37,190][52663] Sum rewards: 62.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.098', 'weapon4': '0.170', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '53.000'} [2024-08-06 01:52:37,297][52659] DAMAGECOUNT value on done: 247804.0 [2024-08-06 01:52:37,298][52659] Sum rewards: 64.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.627', 'AMMO2': '0.015', 'ARMOR': '0.032', 'AMMO4': '0.076', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.098', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '53.000'} [2024-08-06 01:52:37,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 276430848. Throughput: 0: 4387.1. Samples: 69113190. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:52:37,795][52567] Avg episode reward: [(0, '64.098')] [2024-08-06 01:52:38,394][52647] DAMAGECOUNT value on done: 257752.0 [2024-08-06 01:52:38,395][52647] Sum rewards: 62.099, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.994', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.494', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '55.000'} [2024-08-06 01:52:38,462][52649] DAMAGECOUNT value on done: 239149.0 [2024-08-06 01:52:38,465][52649] Sum rewards: 58.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.098', 'AMMO5': '0.010', 'AMMO2': '0.050', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'weapon5': '0.258', 'AMMO3': '0.268', 'weapon2': '0.348', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.702', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '50.000'} [2024-08-06 01:52:39,380][52665] DAMAGECOUNT value on done: 232630.0 [2024-08-06 01:52:39,384][52665] Sum rewards: 51.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.132', 'weapon4': '0.202', 'AMMO4': '0.204', 'AMMO3': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.940', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '44.000'} [2024-08-06 01:52:40,432][52663] DAMAGECOUNT value on done: 242346.0 [2024-08-06 01:52:40,434][52663] Sum rewards: 60.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.044', 'weapon4': '0.078', 'AMMO4': '0.156', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '50.000'} [2024-08-06 01:52:40,511][52659] DAMAGECOUNT value on done: 245695.0 [2024-08-06 01:52:40,513][52659] Sum rewards: 67.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.541', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.386', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.414', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:40,734][52650] Updated weights for policy 0, policy_version 33751 (0.0011) [2024-08-06 01:52:40,758][52647] DAMAGECOUNT value on done: 254781.0 [2024-08-06 01:52:40,758][52647] Sum rewards: 57.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.252', 'weapon4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '48.000'} [2024-08-06 01:52:41,613][52649] DAMAGECOUNT value on done: 237944.0 [2024-08-06 01:52:41,615][52649] Sum rewards: 74.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.016', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.216', 'AMMO3': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.522', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.000'} [2024-08-06 01:52:42,452][52665] DAMAGECOUNT value on done: 243236.0 [2024-08-06 01:52:42,454][52665] Sum rewards: 71.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.685', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO3': '0.194', 'AMMO4': '0.197', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '58.000'} [2024-08-06 01:52:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 276520960. Throughput: 0: 4382.0. Samples: 69139150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:52:42,794][52567] Avg episode reward: [(0, '63.870')] [2024-08-06 01:52:43,195][52659] DAMAGECOUNT value on done: 248457.0 [2024-08-06 01:52:43,195][52659] Sum rewards: 60.416, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.940', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO3': '0.165', 'AMMO4': '0.179', 'WEAPON5': '0.300', 'weapon2': '0.308', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.942', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '48.000'} [2024-08-06 01:52:43,560][52663] DAMAGECOUNT value on done: 245748.0 [2024-08-06 01:52:43,569][52663] Sum rewards: 53.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.506', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.054', 'weapon5': '0.074', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon2': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON3': '1.350', 'HITCOUNT': '2.660', 'weapon3': '3.538', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '47.000'} [2024-08-06 01:52:43,840][52647] DAMAGECOUNT value on done: 256600.0 [2024-08-06 01:52:43,840][52647] Sum rewards: 60.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.113', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.016', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '50.000'} [2024-08-06 01:52:44,989][52650] Updated weights for policy 0, policy_version 33761 (0.0026) [2024-08-06 01:52:45,079][52649] DAMAGECOUNT value on done: 238854.0 [2024-08-06 01:52:45,079][52649] Sum rewards: 59.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.184', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '49.000'} [2024-08-06 01:52:45,578][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:52:45,903][52659] DAMAGECOUNT value on done: 246692.0 [2024-08-06 01:52:45,903][52659] Sum rewards: 57.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.184', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.448', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '46.000'} [2024-08-06 01:52:45,916][52665] DAMAGECOUNT value on done: 241956.0 [2024-08-06 01:52:45,916][52665] Sum rewards: 73.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.493', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon4': '0.062', 'AMMO3': '0.166', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '3.312', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '58.000'} [2024-08-06 01:52:46,143][52647] DAMAGECOUNT value on done: 260384.0 [2024-08-06 01:52:46,144][52647] Sum rewards: 66.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'AMMO4': '0.209', 'weapon2': '0.304', 'WEAPON4': '0.550', 'weapon4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:46,599][52663] DAMAGECOUNT value on done: 245642.0 [2024-08-06 01:52:46,602][52663] Sum rewards: 73.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.030', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.064', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.396', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '62.000'} [2024-08-06 01:52:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 276611072. Throughput: 0: 4380.7. Samples: 69152460. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:52:47,794][52567] Avg episode reward: [(0, '63.511')] [2024-08-06 01:52:48,394][52649] DAMAGECOUNT value on done: 240543.0 [2024-08-06 01:52:48,395][52649] Sum rewards: 57.956, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.236', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.088', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '50.000'} [2024-08-06 01:52:48,726][52647] DAMAGECOUNT value on done: 258468.0 [2024-08-06 01:52:48,728][52647] Sum rewards: 67.405, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.035', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.254', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2024-08-06 01:52:49,146][52665] DAMAGECOUNT value on done: 244075.0 [2024-08-06 01:52:49,146][52665] Sum rewards: 67.144, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.748', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon5': '0.190', 'weapon4': '0.206', 'AMMO3': '0.259', 'weapon2': '0.292', 'AMMO4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.036', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '58.000'} [2024-08-06 01:52:49,485][52663] DAMAGECOUNT value on done: 251023.0 [2024-08-06 01:52:49,486][52663] Sum rewards: 73.631, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.315', 'AMMO2': '0.016', 'weapon4': '0.064', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon2': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.554', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '62.000'} [2024-08-06 01:52:49,910][52650] Updated weights for policy 0, policy_version 33771 (0.0013) [2024-08-06 01:52:51,474][52649] DAMAGECOUNT value on done: 232255.0 [2024-08-06 01:52:51,474][52649] Sum rewards: 58.088, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.795', 'AMMO5': '0.013', 'AMMO2': '0.083', 'weapon4': '0.128', 'weapon5': '0.174', 'AMMO3': '0.256', 'WEAPON5': '0.350', 'AMMO4': '0.416', 'WEAPON4': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.550', 'weapon3': '2.816', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '52.000'} [2024-08-06 01:52:51,872][52647] DAMAGECOUNT value on done: 261627.0 [2024-08-06 01:52:51,872][52647] Sum rewards: 69.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.746', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.136', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.200', 'weapon2': '0.306', 'WEAPON3': '0.950', 'weapon3': '3.122', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '56.000'} [2024-08-06 01:52:52,058][52663] DAMAGECOUNT value on done: 244891.0 [2024-08-06 01:52:52,058][52663] Sum rewards: 61.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.186', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.088', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '2.916', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '54.500'} [2024-08-06 01:52:52,387][52665] DAMAGECOUNT value on done: 242876.0 [2024-08-06 01:52:52,387][52665] Sum rewards: 45.737, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.649', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.132', 'AMMO3': '0.260', 'AMMO4': '0.281', 'WEAPON5': '0.350', 'weapon4': '0.448', 'weapon2': '0.486', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.576', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '43.000'} [2024-08-06 01:52:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 276701184. Throughput: 0: 4376.9. Samples: 69178720. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:52:52,794][52567] Avg episode reward: [(0, '63.401')] [2024-08-06 01:52:54,408][52650] Updated weights for policy 0, policy_version 33781 (0.0034) [2024-08-06 01:52:54,569][52647] DAMAGECOUNT value on done: 257201.0 [2024-08-06 01:52:54,569][52647] Sum rewards: 63.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.366', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.182', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.346', 'weapon4': '0.356', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '52.000'} [2024-08-06 01:52:54,716][52649] DAMAGECOUNT value on done: 239087.0 [2024-08-06 01:52:54,718][52649] Sum rewards: 75.191, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.640', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.062', 'AMMO4': '0.102', 'weapon4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '65.000'} [2024-08-06 01:52:55,222][52663] DAMAGECOUNT value on done: 241372.0 [2024-08-06 01:52:55,222][52663] Sum rewards: 74.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.094', 'weapon4': '0.098', 'AMMO4': '0.114', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.684', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '63.000'} [2024-08-06 01:52:55,489][52665] DAMAGECOUNT value on done: 249929.0 [2024-08-06 01:52:55,490][52665] Sum rewards: 53.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.260', 'AMMO5': '0.011', 'AMMO2': '0.063', 'weapon5': '0.120', 'weapon4': '0.172', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'AMMO4': '0.314', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '49.000'} [2024-08-06 01:52:57,266][52647] DAMAGECOUNT value on done: 255777.0 [2024-08-06 01:52:57,266][52647] Sum rewards: 63.733, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.204', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.368', 'HEALTH': '0.718', 'WEAPON3': '1.100', 'weapon3': '3.120', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '51.000'} [2024-08-06 01:52:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 276791296. Throughput: 0: 4372.3. Samples: 69204910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:52:57,794][52567] Avg episode reward: [(0, '63.582')] [2024-08-06 01:52:57,820][52649] DAMAGECOUNT value on done: 237698.0 [2024-08-06 01:52:57,820][52649] Sum rewards: 77.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.440', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.080', 'AMMO4': '0.131', 'AMMO3': '0.176', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '2.940', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '62.000'} [2024-08-06 01:52:58,584][52665] DAMAGECOUNT value on done: 246640.0 [2024-08-06 01:52:58,584][52665] Sum rewards: 69.999, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.964', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.146', 'weapon5': '0.206', 'AMMO4': '0.222', 'AMMO3': '0.251', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.028', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 01:52:59,276][52650] Updated weights for policy 0, policy_version 33791 (0.0013) [2024-08-06 01:52:59,636][52647] DAMAGECOUNT value on done: 259648.0 [2024-08-06 01:52:59,636][52647] Sum rewards: 64.759, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.543', 'ARMOR': '0.004', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.022', 'weapon4': '0.070', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.272', 'weapon2': '0.286', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:01,013][52649] DAMAGECOUNT value on done: 243203.0 [2024-08-06 01:53:01,015][52649] Sum rewards: 72.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.286', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.302', 'weapon4': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '59.000'} [2024-08-06 01:53:01,627][52665] DAMAGECOUNT value on done: 243703.0 [2024-08-06 01:53:01,628][52665] Sum rewards: 61.137, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.103', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.282', 'weapon2': '0.596', 'WEAPON3': '0.900', 'weapon3': '2.918', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:02,267][52647] DAMAGECOUNT value on done: 254247.0 [2024-08-06 01:53:02,268][52647] Sum rewards: 58.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'AMMO2': '0.047', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.235', 'WEAPON4': '0.350', 'weapon4': '0.372', 'weapon2': '0.430', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '48.000'} [2024-08-06 01:53:02,325][52795] DAMAGECOUNT value on done: 227545.0 [2024-08-06 01:53:02,325][52795] Sum rewards: 54.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.199', 'weapon4': '0.204', 'AMMO4': '0.205', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.188', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '48.000'} [2024-08-06 01:53:02,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 276873216. Throughput: 0: 4375.1. Samples: 69218120. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:53:02,795][52567] Avg episode reward: [(0, '63.710')] [2024-08-06 01:53:03,705][52650] Updated weights for policy 0, policy_version 33801 (0.0039) [2024-08-06 01:53:03,984][52649] DAMAGECOUNT value on done: 242660.0 [2024-08-06 01:53:03,986][52649] Sum rewards: 48.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.247', 'AMMO5': '0.007', 'AMMO2': '0.043', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.217', 'weapon2': '0.228', 'AMMO3': '0.272', 'weapon4': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.690', 'weapon3': '2.918', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '43.500'} [2024-08-06 01:53:04,180][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:53:04,551][52665] DAMAGECOUNT value on done: 241478.0 [2024-08-06 01:53:04,560][52665] Sum rewards: 56.235, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.004', 'AMMO5': '0.020', 'AMMO2': '0.068', 'weapon5': '0.102', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'AMMO4': '0.339', 'weapon2': '0.476', 'weapon4': '0.524', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.586', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '51.000'} [2024-08-06 01:53:05,175][52647] DAMAGECOUNT value on done: 257588.0 [2024-08-06 01:53:05,175][52647] Sum rewards: 76.997, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.978', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.082', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '62.000'} [2024-08-06 01:53:05,521][52795] DAMAGECOUNT value on done: 222225.0 [2024-08-06 01:53:05,523][52795] Sum rewards: 59.936, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.510', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.196', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '50.000'} [2024-08-06 01:53:06,917][52649] DAMAGECOUNT value on done: 246003.0 [2024-08-06 01:53:06,921][52649] Sum rewards: 63.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.076', 'AMMO3': '0.221', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:07,393][52665] DAMAGECOUNT value on done: 242912.0 [2024-08-06 01:53:07,395][52665] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'weapon4': '0.070', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.590', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '61.000'} [2024-08-06 01:53:07,752][52647] DAMAGECOUNT value on done: 251525.0 [2024-08-06 01:53:07,753][52647] Sum rewards: 57.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'weapon4': '0.180', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 276955136. Throughput: 0: 4379.6. Samples: 69244410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:53:07,794][52567] Avg episode reward: [(0, '63.600')] [2024-08-06 01:53:08,004][52668] DAMAGECOUNT value on done: 242153.0 [2024-08-06 01:53:08,006][52668] Sum rewards: 58.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.230', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.594', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '50.000'} [2024-08-06 01:53:08,365][52811] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('weapon5', 0.002)] [2024-08-06 01:53:08,543][52650] Updated weights for policy 0, policy_version 33811 (0.0011) [2024-08-06 01:53:08,674][52795] DAMAGECOUNT value on done: 222122.0 [2024-08-06 01:53:08,674][52795] Sum rewards: 66.550, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.130', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.081', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.246', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:10,128][52665] DAMAGECOUNT value on done: 240725.0 [2024-08-06 01:53:10,137][52665] Sum rewards: 65.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.220', 'weapon4': '0.256', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:10,715][52647] DAMAGECOUNT value on done: 255089.0 [2024-08-06 01:53:10,715][52647] Sum rewards: 56.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.034', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.164', 'weapon4': '0.174', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.910', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:11,094][52668] DAMAGECOUNT value on done: 250786.0 [2024-08-06 01:53:11,100][52668] Sum rewards: 61.236, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.990', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO4': '0.158', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.316', 'weapon2': '0.424', 'WEAPON3': '1.900', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:11,829][52795] DAMAGECOUNT value on done: 226270.0 [2024-08-06 01:53:11,829][52795] Sum rewards: 73.987, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.154', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.542', 'WEAPON3': '1.050', 'weapon3': '2.712', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:12,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 277053440. Throughput: 0: 4384.9. Samples: 69270820. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:53:12,794][52567] Avg episode reward: [(0, '63.533')] [2024-08-06 01:53:12,905][52665] DAMAGECOUNT value on done: 240425.0 [2024-08-06 01:53:12,905][52665] Sum rewards: 68.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.225', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:13,399][52650] Updated weights for policy 0, policy_version 33821 (0.0025) [2024-08-06 01:53:13,870][52647] DAMAGECOUNT value on done: 254363.0 [2024-08-06 01:53:13,870][52647] Sum rewards: 58.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.135', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.304', 'weapon2': '0.474', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '2.978', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '48.000'} [2024-08-06 01:53:14,134][52668] DAMAGECOUNT value on done: 249382.0 [2024-08-06 01:53:14,134][52668] Sum rewards: 67.677, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.237', 'weapon4': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:14,987][52795] DAMAGECOUNT value on done: 229870.0 [2024-08-06 01:53:14,987][52795] Sum rewards: 59.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.194', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.064', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '52.000'} [2024-08-06 01:53:15,118][52667] DAMAGECOUNT value on done: 244082.0 [2024-08-06 01:53:15,118][52667] Sum rewards: 55.134, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.299', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'weapon4': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.814', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '2.958', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '44.000'} [2024-08-06 01:53:15,298][52665] DAMAGECOUNT value on done: 238757.0 [2024-08-06 01:53:15,306][52665] Sum rewards: 61.360, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.368', 'weapon4': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '52.000'} [2024-08-06 01:53:15,495][52669] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:53:16,762][52647] DAMAGECOUNT value on done: 260794.0 [2024-08-06 01:53:16,762][52647] Sum rewards: 57.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.190', 'AMMO3': '0.234', 'weapon5': '0.258', 'AMMO4': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.612', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:17,057][52668] DAMAGECOUNT value on done: 250039.0 [2024-08-06 01:53:17,058][52668] Sum rewards: 68.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.334', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:17,225][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:53:17,262][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:53:17,664][52650] Updated weights for policy 0, policy_version 33831 (0.0023) [2024-08-06 01:53:17,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 277143552. Throughput: 0: 4387.3. Samples: 69284050. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:53:17,794][52567] Avg episode reward: [(0, '63.486')] [2024-08-06 01:53:18,053][52667] DAMAGECOUNT value on done: 247534.0 [2024-08-06 01:53:18,053][52667] Sum rewards: 78.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.410', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.016', 'weapon4': '0.022', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.199', 'weapon2': '0.268', 'WEAPON3': '1.200', 'weapon3': '3.518', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '64.000'} [2024-08-06 01:53:18,179][52662] DAMAGECOUNT value on done: 251581.0 [2024-08-06 01:53:18,179][52662] Sum rewards: 56.474, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.168', 'AMMO4': '0.173', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.600', 'HITCOUNT': '2.900', 'weapon3': '3.074', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '52.000'} [2024-08-06 01:53:18,236][52795] DAMAGECOUNT value on done: 226039.0 [2024-08-06 01:53:18,236][52795] Sum rewards: 69.304, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.457', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.112', 'AMMO4': '0.201', 'AMMO3': '0.209', 'weapon4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '58.000'} [2024-08-06 01:53:18,474][52665] DAMAGECOUNT value on done: 242645.0 [2024-08-06 01:53:18,474][52665] Sum rewards: 67.191, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.222', 'weapon2': '0.728', 'WEAPON3': '0.850', 'weapon3': '2.876', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:19,304][52647] DAMAGECOUNT value on done: 255082.0 [2024-08-06 01:53:19,305][52647] Sum rewards: 68.677, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'AMMO3': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.426', 'WEAPON3': '0.800', 'weapon3': '2.994', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '52.000'} [2024-08-06 01:53:20,164][52668] DAMAGECOUNT value on done: 238674.0 [2024-08-06 01:53:20,165][52668] Sum rewards: 79.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.167', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '66.000'} [2024-08-06 01:53:20,448][52667] DAMAGECOUNT value on done: 246320.0 [2024-08-06 01:53:20,455][52667] Sum rewards: 46.142, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.064', 'AMMO3': '0.161', 'weapon2': '0.240', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.850', 'weapon3': '3.092', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '37.000'} [2024-08-06 01:53:21,128][52662] DAMAGECOUNT value on done: 251447.0 [2024-08-06 01:53:21,129][52662] Sum rewards: 62.054, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.272', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.280', 'weapon2': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.064', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '51.000'} [2024-08-06 01:53:21,371][52795] DAMAGECOUNT value on done: 229958.0 [2024-08-06 01:53:21,371][52795] Sum rewards: 59.593, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.960', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.064', 'AMMO4': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.374', 'weapon4': '0.386', 'WEAPON3': '1.550', 'weapon3': '2.878', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:21,497][52665] DAMAGECOUNT value on done: 242238.0 [2024-08-06 01:53:21,497][52665] Sum rewards: 59.900, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.380', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.244', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:22,262][52647] DAMAGECOUNT value on done: 255200.0 [2024-08-06 01:53:22,262][52647] Sum rewards: 64.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:22,629][52650] Updated weights for policy 0, policy_version 33841 (0.0012) [2024-08-06 01:53:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 277225472. Throughput: 0: 4380.2. Samples: 69310300. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:53:22,794][52567] Avg episode reward: [(0, '63.582')] [2024-08-06 01:53:23,313][52668] DAMAGECOUNT value on done: 248066.0 [2024-08-06 01:53:23,316][52668] Sum rewards: 71.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.102', 'AMMO3': '0.246', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.422', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:23,367][52667] DAMAGECOUNT value on done: 242813.0 [2024-08-06 01:53:23,368][52667] Sum rewards: 62.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.348', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.162', 'weapon4': '0.180', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:23,783][52662] DAMAGECOUNT value on done: 250944.0 [2024-08-06 01:53:23,784][52662] Sum rewards: 54.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.711', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.050', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.458', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '44.000'} [2024-08-06 01:53:24,450][52795] DAMAGECOUNT value on done: 227156.0 [2024-08-06 01:53:24,450][52795] Sum rewards: 66.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.098', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.708', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:24,677][52660] DAMAGECOUNT value on done: 242255.0 [2024-08-06 01:53:24,677][52660] Sum rewards: 63.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.220', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.368', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '54.000'} [2024-08-06 01:53:24,811][52647] DAMAGECOUNT value on done: 254403.0 [2024-08-06 01:53:24,811][52647] Sum rewards: 63.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.942', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.211', 'weapon5': '0.220', 'weapon2': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:26,244][52667] DAMAGECOUNT value on done: 249474.0 [2024-08-06 01:53:26,246][52667] Sum rewards: 61.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.880', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.066', 'AMMO3': '0.142', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.404', 'weapon2': '0.896', 'WEAPON3': '0.900', 'weapon3': '2.444', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '50.500'} [2024-08-06 01:53:26,264][52662] DAMAGECOUNT value on done: 242229.0 [2024-08-06 01:53:26,265][52662] Sum rewards: 55.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.301', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.269', 'weapon2': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '50.000'} [2024-08-06 01:53:26,356][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:53:26,407][52668] DAMAGECOUNT value on done: 246047.0 [2024-08-06 01:53:26,408][52668] Sum rewards: 58.220, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.070', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.231', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON4': '0.500', 'weapon2': '0.602', 'WEAPON3': '1.400', 'weapon3': '2.412', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:27,339][52650] Updated weights for policy 0, policy_version 33851 (0.0012) [2024-08-06 01:53:27,482][52795] DAMAGECOUNT value on done: 224744.0 [2024-08-06 01:53:27,486][52795] Sum rewards: 65.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.638', 'AMMO5': '0.012', 'AMMO2': '0.063', 'weapon5': '0.184', 'AMMO3': '0.235', 'weapon2': '0.256', 'WEAPON5': '0.300', 'AMMO4': '0.313', 'weapon4': '0.480', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.792', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:27,600][52647] DAMAGECOUNT value on done: 249923.0 [2024-08-06 01:53:27,601][52647] Sum rewards: 52.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.168', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.172', 'weapon5': '0.274', 'AMMO4': '0.291', 'weapon2': '0.356', 'weapon4': '0.484', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.558', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '45.500'} [2024-08-06 01:53:27,674][52660] DAMAGECOUNT value on done: 240660.0 [2024-08-06 01:53:27,675][52660] Sum rewards: 39.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.204', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.200', 'HITCOUNT': '2.330', 'weapon3': '3.088', 'DAMAGECOUNT': '11.049', 'FRAGCOUNT': '37.000'} [2024-08-06 01:53:27,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 277307392. Throughput: 0: 4393.3. Samples: 69336850. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:53:27,795][52567] Avg episode reward: [(0, '63.141')] [2024-08-06 01:53:29,247][52667] DAMAGECOUNT value on done: 247115.0 [2024-08-06 01:53:29,248][52667] Sum rewards: 56.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.415', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon4': '0.274', 'weapon2': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.094', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:29,390][52662] DAMAGECOUNT value on done: 248411.0 [2024-08-06 01:53:29,394][52662] Sum rewards: 68.484, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.344', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.076', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.212', 'weapon2': '0.258', 'WEAPON3': '1.050', 'weapon3': '3.232', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:29,424][52668] DAMAGECOUNT value on done: 246473.0 [2024-08-06 01:53:29,425][52668] Sum rewards: 71.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.084', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.438', 'weapon4': '0.462', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '62.000'} [2024-08-06 01:53:30,373][52647] DAMAGECOUNT value on done: 257361.0 [2024-08-06 01:53:30,375][52647] Sum rewards: 51.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.955', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.213', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.104', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '44.000'} [2024-08-06 01:53:30,622][52795] DAMAGECOUNT value on done: 231222.0 [2024-08-06 01:53:30,624][52795] Sum rewards: 70.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.724', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.142', 'AMMO3': '0.168', 'AMMO4': '0.212', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.876', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:30,637][52660] DAMAGECOUNT value on done: 248493.0 [2024-08-06 01:53:30,638][52660] Sum rewards: 63.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.646', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.098', 'AMMO3': '0.170', 'AMMO4': '0.198', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '51.500'} [2024-08-06 01:53:31,687][52650] Updated weights for policy 0, policy_version 33861 (0.0013) [2024-08-06 01:53:32,080][52667] DAMAGECOUNT value on done: 250284.0 [2024-08-06 01:53:32,082][52667] Sum rewards: 67.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.085', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:32,167][52662] DAMAGECOUNT value on done: 244390.0 [2024-08-06 01:53:32,168][52662] Sum rewards: 64.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.088', 'AMMO4': '0.203', 'weapon2': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:32,398][52668] DAMAGECOUNT value on done: 246667.0 [2024-08-06 01:53:32,398][52668] Sum rewards: 65.432, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.060', 'weapon4': '0.116', 'weapon5': '0.146', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.282', 'AMMO4': '0.299', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.242', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 277397504. Throughput: 0: 4387.1. Samples: 69349880. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:53:32,795][52567] Avg episode reward: [(0, '63.296')] [2024-08-06 01:53:33,632][52660] DAMAGECOUNT value on done: 247341.0 [2024-08-06 01:53:33,635][52660] Sum rewards: 56.864, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.270', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.158', 'weapon5': '0.218', 'AMMO4': '0.254', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.630', 'WEAPON3': '0.900', 'weapon3': '2.588', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '44.000'} [2024-08-06 01:53:33,750][52795] DAMAGECOUNT value on done: 227202.0 [2024-08-06 01:53:33,750][52795] Sum rewards: 64.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.270', 'AMMO5': '0.011', 'AMMO2': '0.062', 'weapon5': '0.180', 'AMMO3': '0.206', 'AMMO4': '0.308', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:34,738][52662] DAMAGECOUNT value on done: 250154.0 [2024-08-06 01:53:34,740][52662] Sum rewards: 59.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.341', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.056', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '52.000'} [2024-08-06 01:53:35,243][52668] DAMAGECOUNT value on done: 246151.0 [2024-08-06 01:53:35,244][52668] Sum rewards: 52.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.064', 'AMMO3': '0.191', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.414', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '46.000'} [2024-08-06 01:53:35,244][52667] DAMAGECOUNT value on done: 244265.0 [2024-08-06 01:53:35,244][52667] Sum rewards: 62.983, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.118', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.178', 'weapon2': '0.274', 'WEAPON3': '0.950', 'HITCOUNT': '3.210', 'weapon3': '3.224', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '50.000'} [2024-08-06 01:53:36,738][52660] DAMAGECOUNT value on done: 246333.0 [2024-08-06 01:53:36,738][52660] Sum rewards: 55.705, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.222', 'AMMO4': '0.223', 'weapon4': '0.256', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.650', 'weapon3': '2.518', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:36,776][52650] Updated weights for policy 0, policy_version 33871 (0.0038) [2024-08-06 01:53:36,903][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:53:36,928][52795] DAMAGECOUNT value on done: 225169.0 [2024-08-06 01:53:36,931][52795] Sum rewards: 75.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.041', 'weapon5': '0.066', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '62.000'} [2024-08-06 01:53:37,581][52662] DAMAGECOUNT value on done: 254084.0 [2024-08-06 01:53:37,584][52662] Sum rewards: 66.424, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.455', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.050', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.235', 'weapon2': '0.266', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '58.000'} [2024-08-06 01:53:37,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 277495808. Throughput: 0: 4390.0. Samples: 69376270. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 01:53:37,794][52567] Avg episode reward: [(0, '62.853')] [2024-08-06 01:53:37,857][52667] DAMAGECOUNT value on done: 244455.0 [2024-08-06 01:53:37,858][52667] Sum rewards: 65.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.535', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.196', 'WEAPON4': '0.450', 'weapon4': '0.472', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:38,255][52668] DAMAGECOUNT value on done: 247640.0 [2024-08-06 01:53:38,256][52668] Sum rewards: 55.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.787', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.183', 'weapon2': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.126', 'DAMAGECOUNT': '13.245', 'FRAGCOUNT': '46.000'} [2024-08-06 01:53:38,393][52803] DAMAGECOUNT value on done: 229109.0 [2024-08-06 01:53:38,396][52803] Sum rewards: 76.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.514', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.210', 'weapon2': '0.222', 'WEAPON3': '1.000', 'weapon3': '3.184', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:39,293][52660] DAMAGECOUNT value on done: 242301.0 [2024-08-06 01:53:39,296][52660] Sum rewards: 59.951, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.910', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'weapon4': '0.080', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.368', 'WEAPON3': '2.200', 'HITCOUNT': '3.310', 'weapon3': '3.388', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:40,073][52795] DAMAGECOUNT value on done: 223949.0 [2024-08-06 01:53:40,073][52795] Sum rewards: 59.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.824', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.046', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.232', 'weapon2': '0.254', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.416', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '52.000'} [2024-08-06 01:53:40,606][52668] DAMAGECOUNT value on done: 243602.0 [2024-08-06 01:53:40,607][52668] Sum rewards: 61.767, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.214', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:40,703][52669] DAMAGECOUNT value on done: 247927.0 [2024-08-06 01:53:40,706][52669] Sum rewards: 55.816, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.456', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.162', 'AMMO4': '0.243', 'AMMO3': '0.277', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.576', 'WEAPON3': '1.600', 'weapon3': '2.634', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '51.000'} [2024-08-06 01:53:40,815][52667] DAMAGECOUNT value on done: 247923.0 [2024-08-06 01:53:40,817][52667] Sum rewards: 74.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.435', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.246', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '62.000'} [2024-08-06 01:53:40,897][52662] DAMAGECOUNT value on done: 246013.0 [2024-08-06 01:53:40,901][52662] Sum rewards: 65.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.280', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.128', 'weapon5': '0.146', 'AMMO4': '0.180', 'WEAPON5': '0.400', 'weapon4': '0.528', 'WEAPON4': '0.550', 'weapon2': '0.570', 'WEAPON3': '0.950', 'weapon3': '2.446', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:41,159][52650] Updated weights for policy 0, policy_version 33881 (0.0028) [2024-08-06 01:53:41,504][52803] DAMAGECOUNT value on done: 228997.0 [2024-08-06 01:53:41,504][52803] Sum rewards: 58.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.634', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon4': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.016', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:41,706][52660] DAMAGECOUNT value on done: 248610.0 [2024-08-06 01:53:41,709][52660] Sum rewards: 67.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.251', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.452', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '58.000'} [2024-08-06 01:53:42,433][52664] DAMAGECOUNT value on done: 252203.0 [2024-08-06 01:53:42,434][52664] Sum rewards: 77.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.817', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.196', 'weapon4': '0.214', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '66.000'} [2024-08-06 01:53:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 277577728. Throughput: 0: 4389.1. Samples: 69402420. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:53:42,794][52567] Avg episode reward: [(0, '63.238')] [2024-08-06 01:53:43,187][52668] DAMAGECOUNT value on done: 236427.0 [2024-08-06 01:53:43,187][52668] Sum rewards: 51.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.166', 'weapon2': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '42.000'} [2024-08-06 01:53:43,251][52795] DAMAGECOUNT value on done: 226061.0 [2024-08-06 01:53:43,254][52795] Sum rewards: 51.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.995', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.186', 'weapon2': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '3.278', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '46.000'} [2024-08-06 01:53:43,937][52667] DAMAGECOUNT value on done: 247828.0 [2024-08-06 01:53:43,938][52667] Sum rewards: 73.300, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.188', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.330', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:43,959][52669] DAMAGECOUNT value on done: 242784.0 [2024-08-06 01:53:43,959][52669] Sum rewards: 68.737, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.675', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.148', 'AMMO4': '0.238', 'weapon4': '0.264', 'AMMO3': '0.267', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.028', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:44,000][52811] DAMAGECOUNT value on done: 239230.0 [2024-08-06 01:53:44,000][52811] Sum rewards: 60.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.336', 'weapon4': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '51.000'} [2024-08-06 01:53:44,029][52662] DAMAGECOUNT value on done: 256984.0 [2024-08-06 01:53:44,029][52662] Sum rewards: 71.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.073', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.129', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '3.390', 'weapon3': '3.400', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 01:53:44,692][52660] DAMAGECOUNT value on done: 250565.0 [2024-08-06 01:53:44,692][52660] Sum rewards: 66.662, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.185', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.260', 'AMMO3': '0.303', 'WEAPON3': '1.800', 'weapon3': '3.376', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '59.000'} [2024-08-06 01:53:44,757][52803] DAMAGECOUNT value on done: 228877.0 [2024-08-06 01:53:44,757][52803] Sum rewards: 68.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.294', 'weapon4': '0.420', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:45,146][52664] DAMAGECOUNT value on done: 252833.0 [2024-08-06 01:53:45,147][52664] Sum rewards: 57.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:45,973][52794] DAMAGECOUNT value on done: 248505.0 [2024-08-06 01:53:45,974][52794] Sum rewards: 66.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.046', 'AMMO3': '0.214', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.362', 'weapon4': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:45,980][52650] Updated weights for policy 0, policy_version 33891 (0.0011) [2024-08-06 01:53:46,320][52668] DAMAGECOUNT value on done: 240598.0 [2024-08-06 01:53:46,320][52668] Sum rewards: 57.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.184', 'AMMO3': '0.195', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:46,323][52795] DAMAGECOUNT value on done: 218978.0 [2024-08-06 01:53:46,324][52795] Sum rewards: 54.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.779', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.182', 'AMMO3': '0.196', 'weapon4': '0.222', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.540', 'weapon3': '3.022', 'DAMAGECOUNT': '12.576', 'FRAGCOUNT': '46.000'} [2024-08-06 01:53:46,329][52667] DAMAGECOUNT value on done: 247704.0 [2024-08-06 01:53:46,329][52667] Sum rewards: 65.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.345', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.109', 'weapon5': '0.116', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:46,676][52662] DAMAGECOUNT value on done: 247376.0 [2024-08-06 01:53:46,678][52662] Sum rewards: 54.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.148', 'AMMO3': '0.210', 'weapon2': '0.238', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.776', 'WEAPON3': '1.250', 'weapon3': '2.598', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.000'} [2024-08-06 01:53:46,944][52669] DAMAGECOUNT value on done: 248244.0 [2024-08-06 01:53:46,945][52669] Sum rewards: 72.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.688', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.196', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '59.000'} [2024-08-06 01:53:47,113][52614] Signal inference workers to stop experience collection... (6100 times) [2024-08-06 01:53:47,123][52614] Signal inference workers to resume experience collection... (6100 times) [2024-08-06 01:53:47,197][52650] InferenceWorker_p0-w0: stopping experience collection (6100 times) [2024-08-06 01:53:47,198][52650] InferenceWorker_p0-w0: resuming experience collection (6100 times) [2024-08-06 01:53:47,271][52811] DAMAGECOUNT value on done: 227708.0 [2024-08-06 01:53:47,271][52811] Sum rewards: 60.647, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.580', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.102', 'weapon5': '0.184', 'AMMO4': '0.233', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '0.700', 'weapon4': '1.156', 'weapon3': '2.088', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '47.000'} [2024-08-06 01:53:47,570][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:53:47,583][52660] DAMAGECOUNT value on done: 250249.0 [2024-08-06 01:53:47,584][52660] Sum rewards: 72.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.268', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 277667840. Throughput: 0: 4384.7. Samples: 69415430. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:53:47,795][52567] Avg episode reward: [(0, '63.114')] [2024-08-06 01:53:47,881][52803] DAMAGECOUNT value on done: 230797.0 [2024-08-06 01:53:47,882][52803] Sum rewards: 77.829, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.458', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.172', 'AMMO4': '0.187', 'weapon4': '0.214', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '62.000'} [2024-08-06 01:53:47,924][52664] DAMAGECOUNT value on done: 255758.0 [2024-08-06 01:53:47,924][52664] Sum rewards: 61.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.482', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.200', 'weapon3': '2.802', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '51.000'} [2024-08-06 01:53:48,876][52794] DAMAGECOUNT value on done: 252236.0 [2024-08-06 01:53:48,876][52794] Sum rewards: 67.495, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.015', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.132', 'AMMO3': '0.162', 'weapon4': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.138', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:48,915][52667] DAMAGECOUNT value on done: 248057.0 [2024-08-06 01:53:48,915][52667] Sum rewards: 73.199, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon4': '0.246', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:49,273][52668] DAMAGECOUNT value on done: 240771.0 [2024-08-06 01:53:49,276][52668] Sum rewards: 60.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.074', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.058', 'weapon4': '0.060', 'AMMO4': '0.152', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '1.068', 'WEAPON3': '1.150', 'weapon3': '2.654', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '50.000'} [2024-08-06 01:53:49,493][52795] DAMAGECOUNT value on done: 232666.0 [2024-08-06 01:53:49,495][52795] Sum rewards: 74.497, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.137', 'weapon5': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'weapon2': '0.352', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.872', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 01:53:50,008][52662] DAMAGECOUNT value on done: 247229.0 [2024-08-06 01:53:50,011][52662] Sum rewards: 76.538, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.142', 'weapon5': '0.190', 'weapon2': '0.206', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON3': '0.950', 'weapon3': '2.902', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '59.000'} [2024-08-06 01:53:50,047][52669] DAMAGECOUNT value on done: 246723.0 [2024-08-06 01:53:50,047][52669] Sum rewards: 68.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.883', 'AMMO5': '0.024', 'AMMO2': '0.067', 'AMMO3': '0.243', 'weapon2': '0.262', 'weapon5': '0.292', 'AMMO4': '0.335', 'weapon4': '0.486', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.596', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 01:53:50,310][52664] DAMAGECOUNT value on done: 253098.0 [2024-08-06 01:53:50,312][52664] Sum rewards: 57.177, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO5': '0.009', 'AMMO2': '0.057', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.286', 'weapon4': '0.422', 'WEAPON4': '0.550', 'weapon2': '0.706', 'WEAPON3': '1.200', 'weapon3': '2.528', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '51.000'} [2024-08-06 01:53:50,343][52811] DAMAGECOUNT value on done: 228670.0 [2024-08-06 01:53:50,343][52811] Sum rewards: 65.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.062', 'AMMO3': '0.168', 'AMMO4': '0.178', 'weapon4': '0.184', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '3.210', 'weapon3': '3.284', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '55.500'} [2024-08-06 01:53:50,419][52660] DAMAGECOUNT value on done: 242879.0 [2024-08-06 01:53:50,420][52660] Sum rewards: 63.662, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.125', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.111', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.268', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '52.000'} [2024-08-06 01:53:50,818][52650] Updated weights for policy 0, policy_version 33901 (0.0013) [2024-08-06 01:53:50,866][52803] DAMAGECOUNT value on done: 232378.0 [2024-08-06 01:53:50,867][52803] Sum rewards: 68.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.748', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.272', 'weapon2': '0.348', 'WEAPON3': '1.750', 'weapon3': '3.246', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '62.000'} [2024-08-06 01:53:51,816][52668] DAMAGECOUNT value on done: 244263.0 [2024-08-06 01:53:51,816][52668] Sum rewards: 59.354, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.594', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:51,848][52667] DAMAGECOUNT value on done: 242979.0 [2024-08-06 01:53:51,850][52667] Sum rewards: 60.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.173', 'AMMO3': '0.205', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:52,068][52658] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon5', 0.002)] [2024-08-06 01:53:52,107][52794] DAMAGECOUNT value on done: 246711.0 [2024-08-06 01:53:52,109][52794] Sum rewards: 67.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.298', 'weapon4': '0.326', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:52,653][52795] DAMAGECOUNT value on done: 229897.0 [2024-08-06 01:53:52,653][52795] Sum rewards: 46.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.104', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.214', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.882', 'WEAPON3': '1.250', 'weapon3': '2.358', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '42.000'} [2024-08-06 01:53:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 277757952. Throughput: 0: 4386.6. Samples: 69441810. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:53:52,795][52567] Avg episode reward: [(0, '63.336')] [2024-08-06 01:53:52,983][52662] DAMAGECOUNT value on done: 247142.0 [2024-08-06 01:53:52,984][52662] Sum rewards: 72.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.272', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.152', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:53,036][52664] DAMAGECOUNT value on done: 254749.0 [2024-08-06 01:53:53,036][52664] Sum rewards: 62.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.100', 'AMMO3': '0.227', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.302', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '55.000'} [2024-08-06 01:53:53,058][52660] DAMAGECOUNT value on done: 252119.0 [2024-08-06 01:53:53,059][52660] Sum rewards: 48.635, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.720', 'AMMO5': '0.016', 'AMMO2': '0.075', 'weapon5': '0.234', 'weapon4': '0.236', 'AMMO3': '0.271', 'weapon2': '0.276', 'AMMO4': '0.373', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.880', 'weapon3': '2.894', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '46.000'} [2024-08-06 01:53:53,174][52669] DAMAGECOUNT value on done: 243368.0 [2024-08-06 01:53:53,174][52669] Sum rewards: 61.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon4': '0.122', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'weapon2': '0.418', 'WEAPON3': '1.650', 'weapon3': '3.012', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '54.000'} [2024-08-06 01:53:53,497][52811] DAMAGECOUNT value on done: 227396.0 [2024-08-06 01:53:53,497][52811] Sum rewards: 68.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon4': '0.474', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.510', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:53,981][52803] DAMAGECOUNT value on done: 230988.0 [2024-08-06 01:53:53,983][52803] Sum rewards: 66.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.147', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.230', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.566', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:54,610][52668] DAMAGECOUNT value on done: 243490.0 [2024-08-06 01:53:54,612][52668] Sum rewards: 73.404, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.342', 'AMMO5': '0.003', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.159', 'AMMO3': '0.185', 'weapon4': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:54,911][52667] DAMAGECOUNT value on done: 253037.0 [2024-08-06 01:53:54,913][52667] Sum rewards: 71.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.764', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon4': '0.142', 'weapon5': '0.162', 'AMMO3': '0.207', 'AMMO4': '0.290', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.000'} [2024-08-06 01:53:54,963][52794] DAMAGECOUNT value on done: 248380.0 [2024-08-06 01:53:54,963][52794] Sum rewards: 55.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.865', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.081', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'weapon7': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.442', 'weapon4': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.568', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '47.500'} [2024-08-06 01:53:55,259][52650] Updated weights for policy 0, policy_version 33911 (0.0021) [2024-08-06 01:53:55,371][52664] DAMAGECOUNT value on done: 254437.0 [2024-08-06 01:53:55,371][52664] Sum rewards: 58.689, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'weapon2': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.305', 'WEAPON3': '1.800', 'HITCOUNT': '3.060', 'weapon3': '3.512', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '54.000'} [2024-08-06 01:53:55,744][52795] DAMAGECOUNT value on done: 219914.0 [2024-08-06 01:53:55,746][52795] Sum rewards: 54.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.810', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.092', 'AMMO4': '0.137', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.122', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.500'} [2024-08-06 01:53:55,959][52662] DAMAGECOUNT value on done: 253516.0 [2024-08-06 01:53:55,960][52662] Sum rewards: 68.808, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.693', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon5': '0.222', 'AMMO3': '0.252', 'weapon2': '0.288', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '59.000'} [2024-08-06 01:53:55,971][52660] DAMAGECOUNT value on done: 236449.0 [2024-08-06 01:53:55,971][52660] Sum rewards: 54.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.525', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO4': '0.192', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.404', 'weapon4': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.704', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '45.000'} [2024-08-06 01:53:56,116][52669] DAMAGECOUNT value on done: 244706.0 [2024-08-06 01:53:56,116][52669] Sum rewards: 73.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.494', 'AMMO5': '0.022', 'AMMO2': '0.058', 'AMMO3': '0.175', 'weapon5': '0.228', 'AMMO4': '0.292', 'weapon2': '0.346', 'weapon4': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '61.000'} [2024-08-06 01:53:56,584][52811] DAMAGECOUNT value on done: 228915.0 [2024-08-06 01:53:56,584][52811] Sum rewards: 57.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.370', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.078', 'AMMO4': '0.186', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:57,128][52803] DAMAGECOUNT value on done: 227340.0 [2024-08-06 01:53:57,128][52803] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.558', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.148', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.258', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.118', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:57,476][52668] DAMAGECOUNT value on done: 246621.0 [2024-08-06 01:53:57,477][52668] Sum rewards: 56.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '49.000'} [2024-08-06 01:53:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 277839872. Throughput: 0: 4378.9. Samples: 69467870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:53:57,794][52567] Avg episode reward: [(0, '63.339')] [2024-08-06 01:53:57,944][52667] DAMAGECOUNT value on done: 255754.0 [2024-08-06 01:53:57,947][52667] Sum rewards: 62.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO4': '0.177', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON4': '0.450', 'weapon2': '0.606', 'WEAPON3': '1.350', 'weapon3': '2.604', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '53.000'} [2024-08-06 01:53:57,989][52794] DAMAGECOUNT value on done: 245198.0 [2024-08-06 01:53:57,990][52794] Sum rewards: 69.228, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.191', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.252', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:58,366][52664] DAMAGECOUNT value on done: 259329.0 [2024-08-06 01:53:58,367][52664] Sum rewards: 52.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.465', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.126', 'weapon5': '0.160', 'AMMO4': '0.203', 'AMMO3': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '45.000'} [2024-08-06 01:53:58,792][52660] DAMAGECOUNT value on done: 242327.0 [2024-08-06 01:53:58,793][52660] Sum rewards: 63.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.344', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '2.852', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:58,813][52669] DAMAGECOUNT value on done: 247832.0 [2024-08-06 01:53:58,813][52669] Sum rewards: 69.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.312', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.768', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '58.000'} [2024-08-06 01:53:58,827][52795] DAMAGECOUNT value on done: 234168.0 [2024-08-06 01:53:58,827][52795] Sum rewards: 67.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.756', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.254', 'weapon4': '0.294', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '56.000'} [2024-08-06 01:53:58,866][52662] DAMAGECOUNT value on done: 248775.0 [2024-08-06 01:53:58,867][52662] Sum rewards: 59.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'weapon4': '0.172', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.074', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '51.000'} [2024-08-06 01:53:59,732][52811] DAMAGECOUNT value on done: 235000.0 [2024-08-06 01:53:59,733][52811] Sum rewards: 70.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.358', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '60.000'} [2024-08-06 01:53:59,850][52650] Updated weights for policy 0, policy_version 33921 (0.0023) [2024-08-06 01:54:00,307][52803] DAMAGECOUNT value on done: 225139.0 [2024-08-06 01:54:00,309][52803] Sum rewards: 55.637, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.108', 'AMMO3': '0.183', 'AMMO4': '0.235', 'weapon2': '0.274', 'weapon4': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '48.000'} [2024-08-06 01:54:00,341][52668] DAMAGECOUNT value on done: 249077.0 [2024-08-06 01:54:00,341][52668] Sum rewards: 58.306, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.852', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '2.904', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:00,650][52664] DAMAGECOUNT value on done: 249685.0 [2024-08-06 01:54:00,650][52664] Sum rewards: 61.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.194', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.122', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:00,713][52794] DAMAGECOUNT value on done: 247890.0 [2024-08-06 01:54:00,713][52794] Sum rewards: 54.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.850', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.162', 'weapon4': '0.168', 'AMMO4': '0.257', 'weapon2': '0.260', 'AMMO3': '0.267', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.890', 'weapon3': '3.118', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '48.000'} [2024-08-06 01:54:00,716][52667] DAMAGECOUNT value on done: 250253.0 [2024-08-06 01:54:00,718][52667] Sum rewards: 68.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.308', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.000'} [2024-08-06 01:54:00,911][52658] DAMAGECOUNT value on done: 249524.0 [2024-08-06 01:54:00,911][52658] Sum rewards: 69.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.796', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.114', 'AMMO4': '0.115', 'weapon5': '0.156', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.204', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '57.000'} [2024-08-06 01:54:01,678][52669] DAMAGECOUNT value on done: 246246.0 [2024-08-06 01:54:01,679][52669] Sum rewards: 62.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.164', 'AMMO3': '0.196', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.900', 'WEAPON3': '1.100', 'weapon3': '2.378', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:01,750][52660] DAMAGECOUNT value on done: 251887.0 [2024-08-06 01:54:01,751][52660] Sum rewards: 76.243, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon2': '0.180', 'AMMO3': '0.214', 'HEALTH': '0.653', 'WEAPON3': '1.200', 'weapon3': '3.478', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '62.000'} [2024-08-06 01:54:01,758][52662] DAMAGECOUNT value on done: 256142.0 [2024-08-06 01:54:01,759][52662] Sum rewards: 72.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2024-08-06 01:54:01,959][52795] DAMAGECOUNT value on done: 232014.0 [2024-08-06 01:54:01,959][52795] Sum rewards: 64.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.352', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.094', 'weapon5': '0.096', 'AMMO3': '0.143', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '0.950', 'HITCOUNT': '3.090', 'weapon3': '3.150', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 277929984. Throughput: 0: 4384.9. Samples: 69481370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:54:02,795][52567] Avg episode reward: [(0, '63.600')] [2024-08-06 01:54:02,935][52811] DAMAGECOUNT value on done: 230099.0 [2024-08-06 01:54:02,937][52811] Sum rewards: 63.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.199', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:03,011][52664] DAMAGECOUNT value on done: 262518.0 [2024-08-06 01:54:03,013][52664] Sum rewards: 46.769, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.980', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.252', 'AMMO3': '0.282', 'weapon2': '0.354', 'WEAPON3': '1.750', 'HITCOUNT': '2.740', 'weapon3': '3.050', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '45.000'} [2024-08-06 01:54:03,137][52668] DAMAGECOUNT value on done: 245945.0 [2024-08-06 01:54:03,138][52668] Sum rewards: 68.470, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 01:54:03,477][52794] DAMAGECOUNT value on done: 251528.0 [2024-08-06 01:54:03,480][52794] Sum rewards: 67.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'AMMO4': '0.230', 'weapon2': '0.330', 'weapon4': '0.554', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:03,589][52803] DAMAGECOUNT value on done: 229400.0 [2024-08-06 01:54:03,590][52803] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-4.035', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.084', 'AMMO3': '0.162', 'AMMO4': '0.215', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON4': '0.550', 'weapon4': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.478', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:03,686][52667] DAMAGECOUNT value on done: 251990.0 [2024-08-06 01:54:03,687][52667] Sum rewards: 71.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.490', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.060', 'weapon4': '0.124', 'AMMO3': '0.190', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '60.000'} [2024-08-06 01:54:04,013][52658] DAMAGECOUNT value on done: 249626.0 [2024-08-06 01:54:04,014][52658] Sum rewards: 70.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.088', 'AMMO4': '0.168', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:04,409][52660] DAMAGECOUNT value on done: 256378.0 [2024-08-06 01:54:04,409][52660] Sum rewards: 71.981, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.018', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.291', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.076', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '63.000'} [2024-08-06 01:54:04,532][52662] DAMAGECOUNT value on done: 248595.0 [2024-08-06 01:54:04,532][52662] Sum rewards: 62.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.602', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:04,680][52650] Updated weights for policy 0, policy_version 33931 (0.0030) [2024-08-06 01:54:04,825][52669] DAMAGECOUNT value on done: 247635.0 [2024-08-06 01:54:04,826][52669] Sum rewards: 69.021, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.036', 'weapon4': '0.082', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '61.000'} [2024-08-06 01:54:05,563][52664] DAMAGECOUNT value on done: 255115.0 [2024-08-06 01:54:05,565][52664] Sum rewards: 50.460, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.238', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.182', 'AMMO3': '0.274', 'weapon2': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.240', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '46.000'} [2024-08-06 01:54:06,038][52811] DAMAGECOUNT value on done: 229098.0 [2024-08-06 01:54:06,041][52811] Sum rewards: 63.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.109', 'weapon4': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.308', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:06,079][52803] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:54:06,593][52667] DAMAGECOUNT value on done: 242519.0 [2024-08-06 01:54:06,595][52667] Sum rewards: 69.103, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.064', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon2': '0.750', 'WEAPON3': '0.850', 'HEALTH': '0.879', 'weapon3': '2.954', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:06,611][52803] DAMAGECOUNT value on done: 227401.0 [2024-08-06 01:54:06,612][52803] Sum rewards: 67.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.437', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.148', 'AMMO3': '0.177', 'weapon2': '0.196', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:06,714][52794] DAMAGECOUNT value on done: 247510.0 [2024-08-06 01:54:06,717][52794] Sum rewards: 59.163, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.161', 'weapon5': '0.186', 'AMMO4': '0.189', 'weapon4': '0.214', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '2.860', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '49.000'} [2024-08-06 01:54:06,793][52658] DAMAGECOUNT value on done: 249157.0 [2024-08-06 01:54:06,793][52658] Sum rewards: 56.619, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.366', 'weapon4': '0.374', 'WEAPON3': '1.550', 'weapon3': '2.992', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:07,201][52660] DAMAGECOUNT value on done: 241241.0 [2024-08-06 01:54:07,201][52660] Sum rewards: 64.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.094', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.598', 'weapon4': '0.680', 'WEAPON3': '1.100', 'weapon3': '2.428', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:07,421][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:54:07,518][52662] DAMAGECOUNT value on done: 249946.0 [2024-08-06 01:54:07,518][52662] Sum rewards: 45.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.212', 'AMMO3': '0.233', 'weapon2': '0.236', 'WEAPON4': '0.550', 'weapon4': '0.802', 'WEAPON3': '1.400', 'weapon3': '2.618', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '41.000'} [2024-08-06 01:54:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 278011904. Throughput: 0: 4384.9. Samples: 69507620. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:54:07,794][52567] Avg episode reward: [(0, '64.017')] [2024-08-06 01:54:08,108][52664] DAMAGECOUNT value on done: 257511.0 [2024-08-06 01:54:08,108][52664] Sum rewards: 66.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.460', 'AMMO2': '0.022', 'weapon4': '0.072', 'AMMO4': '0.110', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.590', 'WEAPON3': '0.950', 'HITCOUNT': '3.160', 'weapon3': '3.222', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:08,176][52669] DAMAGECOUNT value on done: 242208.0 [2024-08-06 01:54:08,178][52669] Sum rewards: 59.928, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon2': '0.272', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'HITCOUNT': '3.310', 'weapon3': '3.392', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '53.500'} [2024-08-06 01:54:08,901][52820] DAMAGECOUNT value on done: 224616.0 [2024-08-06 01:54:08,901][52820] Sum rewards: 61.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.101', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.260', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '3.216', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:09,106][52811] DAMAGECOUNT value on done: 238117.0 [2024-08-06 01:54:09,106][52811] Sum rewards: 60.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.249', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.245', 'weapon2': '0.268', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.264', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:09,229][52650] Updated weights for policy 0, policy_version 33941 (0.0042) [2024-08-06 01:54:09,507][52794] DAMAGECOUNT value on done: 252889.0 [2024-08-06 01:54:09,508][52794] Sum rewards: 62.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'weapon4': '0.190', 'AMMO3': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.130', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:09,510][52667] DAMAGECOUNT value on done: 249182.0 [2024-08-06 01:54:09,511][52667] Sum rewards: 60.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.178', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.674', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:09,584][52803] DAMAGECOUNT value on done: 235062.0 [2024-08-06 01:54:09,585][52803] Sum rewards: 69.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.204', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 01:54:09,730][52658] DAMAGECOUNT value on done: 248408.0 [2024-08-06 01:54:09,732][52658] Sum rewards: 55.240, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.119', 'weapon4': '0.154', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '47.000'} [2024-08-06 01:54:10,228][52660] DAMAGECOUNT value on done: 246828.0 [2024-08-06 01:54:10,232][52660] Sum rewards: 64.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.735', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.136', 'AMMO3': '0.201', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.102', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:10,323][52664] DAMAGECOUNT value on done: 254614.0 [2024-08-06 01:54:10,324][52664] Sum rewards: 77.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.197', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.218', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.266', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '63.000'} [2024-08-06 01:54:10,394][52662] DAMAGECOUNT value on done: 247344.0 [2024-08-06 01:54:10,395][52662] Sum rewards: 66.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.641', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.051', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'AMMO4': '0.257', 'weapon2': '0.258', 'WEAPON4': '0.500', 'weapon4': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:11,213][52669] DAMAGECOUNT value on done: 248592.0 [2024-08-06 01:54:11,215][52669] Sum rewards: 62.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.465', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon7': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.154', 'WEAPON7': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:12,022][52820] DAMAGECOUNT value on done: 228389.0 [2024-08-06 01:54:12,023][52820] Sum rewards: 72.264, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.098', 'AMMO3': '0.145', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '0.950', 'weapon3': '3.292', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.000'} [2024-08-06 01:54:12,320][52811] DAMAGECOUNT value on done: 231014.0 [2024-08-06 01:54:12,322][52811] Sum rewards: 59.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.445', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO4': '0.213', 'AMMO3': '0.214', 'weapon5': '0.320', 'weapon2': '0.352', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.572', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:12,401][52664] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:54:12,627][52658] DAMAGECOUNT value on done: 248719.0 [2024-08-06 01:54:12,627][52658] Sum rewards: 53.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.025', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.152', 'AMMO4': '0.205', 'weapon4': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.770', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '43.000'} [2024-08-06 01:54:12,659][52794] DAMAGECOUNT value on done: 249507.0 [2024-08-06 01:54:12,659][52794] Sum rewards: 58.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.697', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.106', 'weapon4': '0.118', 'AMMO4': '0.146', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '2.620', 'weapon3': '3.302', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '49.000'} [2024-08-06 01:54:12,773][52803] DAMAGECOUNT value on done: 232302.0 [2024-08-06 01:54:12,773][52803] Sum rewards: 71.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.791', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.069', 'AMMO3': '0.215', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '59.000'} [2024-08-06 01:54:12,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 278102016. Throughput: 0: 4379.6. Samples: 69533930. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:54:12,794][52567] Avg episode reward: [(0, '63.889')] [2024-08-06 01:54:12,961][52660] DAMAGECOUNT value on done: 237117.0 [2024-08-06 01:54:12,961][52660] Sum rewards: 57.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.246', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.236', 'weapon2': '0.276', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.328', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '48.000'} [2024-08-06 01:54:13,032][52664] DAMAGECOUNT value on done: 257640.0 [2024-08-06 01:54:13,033][52664] Sum rewards: 69.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.146', 'AMMO3': '0.174', 'AMMO4': '0.205', 'weapon2': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '57.000'} [2024-08-06 01:54:13,407][52662] DAMAGECOUNT value on done: 244274.0 [2024-08-06 01:54:13,407][52662] Sum rewards: 67.271, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.302', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'weapon2': '0.382', 'weapon4': '0.452', 'WEAPON3': '1.450', 'weapon3': '2.602', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:14,000][52650] Updated weights for policy 0, policy_version 33951 (0.0020) [2024-08-06 01:54:14,168][52669] DAMAGECOUNT value on done: 248505.0 [2024-08-06 01:54:14,169][52669] Sum rewards: 59.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.134', 'weapon5': '0.162', 'AMMO3': '0.172', 'weapon2': '0.246', 'AMMO4': '0.285', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.172', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:14,939][52820] DAMAGECOUNT value on done: 226604.0 [2024-08-06 01:54:14,939][52820] Sum rewards: 60.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.216', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon4': '0.420', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:15,309][52811] DAMAGECOUNT value on done: 231739.0 [2024-08-06 01:54:15,309][52811] Sum rewards: 59.759, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.525', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'AMMO3': '0.270', 'weapon2': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:15,710][52794] DAMAGECOUNT value on done: 247678.0 [2024-08-06 01:54:15,710][52794] Sum rewards: 54.733, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.067', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.184', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.362', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.118', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '46.000'} [2024-08-06 01:54:15,740][52658] DAMAGECOUNT value on done: 245901.0 [2024-08-06 01:54:15,742][52658] Sum rewards: 64.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.182', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.150', 'weapon4': '0.162', 'AMMO4': '0.206', 'AMMO3': '0.227', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:15,794][52664] DAMAGECOUNT value on done: 254876.0 [2024-08-06 01:54:15,794][52664] Sum rewards: 61.620, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.568', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.146', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:15,818][52660] DAMAGECOUNT value on done: 246490.0 [2024-08-06 01:54:15,819][52660] Sum rewards: 57.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.045', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.172', 'AMMO3': '0.209', 'weapon5': '0.218', 'AMMO4': '0.223', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '2.994', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '48.000'} [2024-08-06 01:54:15,984][52803] DAMAGECOUNT value on done: 230662.0 [2024-08-06 01:54:15,989][52803] Sum rewards: 63.672, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.705', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.247', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '57.000'} [2024-08-06 01:54:16,804][52669] DAMAGECOUNT value on done: 245778.0 [2024-08-06 01:54:16,804][52669] Sum rewards: 76.626, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.138', 'weapon4': '0.172', 'AMMO3': '0.176', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.478', 'HEALTH': '0.928', 'WEAPON3': '0.950', 'weapon3': '2.940', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '60.500'} [2024-08-06 01:54:17,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 278192128. Throughput: 0: 4386.9. Samples: 69547290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:54:17,795][52567] Avg episode reward: [(0, '63.774')] [2024-08-06 01:54:17,803][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:54:18,023][52820] DAMAGECOUNT value on done: 218943.0 [2024-08-06 01:54:18,023][52820] Sum rewards: 69.198, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.194', 'weapon2': '0.702', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:18,340][52811] DAMAGECOUNT value on done: 232881.0 [2024-08-06 01:54:18,341][52811] Sum rewards: 62.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.172', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.472', 'weapon2': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.520', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:18,360][52658] DAMAGECOUNT value on done: 254139.0 [2024-08-06 01:54:18,361][52658] Sum rewards: 65.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.192', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.126', 'weapon4': '0.168', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:18,521][52665] Large shaping reward -2.507 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.258, -86.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:54:18,541][52794] DAMAGECOUNT value on done: 246963.0 [2024-08-06 01:54:18,541][52794] Sum rewards: 69.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.955', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.078', 'weapon4': '0.132', 'AMMO4': '0.137', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:18,642][52664] DAMAGECOUNT value on done: 258770.0 [2024-08-06 01:54:18,644][52664] Sum rewards: 65.775, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.260', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:18,844][52650] Updated weights for policy 0, policy_version 33961 (0.0011) [2024-08-06 01:54:18,914][52660] DAMAGECOUNT value on done: 241868.0 [2024-08-06 01:54:18,914][52660] Sum rewards: 48.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.567', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.065', 'WEAPON5': '0.150', 'weapon5': '0.192', 'AMMO3': '0.235', 'weapon2': '0.276', 'weapon4': '0.306', 'AMMO4': '0.327', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.690', 'weapon3': '2.914', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '43.000'} [2024-08-06 01:54:18,955][52803] DAMAGECOUNT value on done: 234628.0 [2024-08-06 01:54:18,957][52803] Sum rewards: 56.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO2': '0.016', 'weapon4': '0.064', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.218', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.370', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '47.000'} [2024-08-06 01:54:19,143][52820] Large shaping reward 3.632 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:54:19,843][52669] DAMAGECOUNT value on done: 249371.0 [2024-08-06 01:54:19,843][52669] Sum rewards: 64.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.190', 'weapon4': '0.288', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:21,084][52820] DAMAGECOUNT value on done: 229368.0 [2024-08-06 01:54:21,084][52820] Sum rewards: 42.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon5': '0.118', 'AMMO3': '0.136', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'weapon2': '0.966', 'HITCOUNT': '2.530', 'weapon3': '2.690', 'DAMAGECOUNT': '12.144', 'FRAGCOUNT': '33.000'} [2024-08-06 01:54:21,147][52658] DAMAGECOUNT value on done: 240896.0 [2024-08-06 01:54:21,148][52658] Sum rewards: 60.056, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.572', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:21,515][52811] DAMAGECOUNT value on done: 228115.0 [2024-08-06 01:54:21,515][52811] Sum rewards: 71.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.335', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.096', 'AMMO3': '0.259', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '63.000'} [2024-08-06 01:54:21,579][52794] DAMAGECOUNT value on done: 244588.0 [2024-08-06 01:54:21,582][52794] Sum rewards: 55.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.080', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.070', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.182', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '46.000'} [2024-08-06 01:54:21,783][52664] DAMAGECOUNT value on done: 252687.0 [2024-08-06 01:54:21,783][52664] Sum rewards: 61.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.801', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.084', 'AMMO3': '0.190', 'weapon2': '0.198', 'AMMO4': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:21,824][52671] DAMAGECOUNT value on done: 250926.0 [2024-08-06 01:54:21,825][52671] Sum rewards: 60.466, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.163', 'weapon2': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '3.050', 'weapon3': '3.156', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '46.000'} [2024-08-06 01:54:22,018][52803] DAMAGECOUNT value on done: 230802.0 [2024-08-06 01:54:22,018][52803] Sum rewards: 70.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.406', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.024', 'weapon4': '0.076', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.424', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 01:54:22,534][52669] DAMAGECOUNT value on done: 250719.0 [2024-08-06 01:54:22,535][52669] Sum rewards: 66.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.566', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.134', 'AMMO3': '0.207', 'AMMO4': '0.208', 'WEAPON5': '0.400', 'weapon4': '0.458', 'WEAPON4': '0.500', 'weapon2': '0.672', 'WEAPON3': '1.400', 'weapon3': '2.494', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:22,560][52666] DAMAGECOUNT value on done: 250985.0 [2024-08-06 01:54:22,561][52666] Sum rewards: 54.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.181', 'weapon5': '0.190', 'weapon4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '46.500'} [2024-08-06 01:54:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 278282240. Throughput: 0: 4390.0. Samples: 69573820. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:54:22,794][52567] Avg episode reward: [(0, '62.877')] [2024-08-06 01:54:23,055][52647] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 01:54:23,064][52650] Updated weights for policy 0, policy_version 33971 (0.0039) [2024-08-06 01:54:24,023][52794] DAMAGECOUNT value on done: 257485.0 [2024-08-06 01:54:24,023][52794] Sum rewards: 67.044, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.018', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.132', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.224', 'weapon2': '0.764', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:24,164][52658] DAMAGECOUNT value on done: 252358.0 [2024-08-06 01:54:24,164][52658] Sum rewards: 61.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.386', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.130', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.022', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:24,181][52820] DAMAGECOUNT value on done: 226052.0 [2024-08-06 01:54:24,181][52820] Sum rewards: 71.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon4': '0.276', 'weapon2': '0.640', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '59.000'} [2024-08-06 01:54:24,594][52811] DAMAGECOUNT value on done: 234836.0 [2024-08-06 01:54:24,596][52811] Sum rewards: 54.150, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.647', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.056', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.210', 'weapon4': '0.220', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '3.296', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '44.000'} [2024-08-06 01:54:24,707][52664] DAMAGECOUNT value on done: 256939.0 [2024-08-06 01:54:24,708][52664] Sum rewards: 57.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.123', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:24,883][52671] DAMAGECOUNT value on done: 247600.0 [2024-08-06 01:54:24,884][52671] Sum rewards: 76.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.202', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.472', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '63.000'} [2024-08-06 01:54:25,148][52803] DAMAGECOUNT value on done: 229059.0 [2024-08-06 01:54:25,148][52803] Sum rewards: 63.328, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.006', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'weapon2': '0.446', 'weapon4': '0.648', 'WEAPON3': '1.400', 'weapon3': '2.532', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:25,409][52669] DAMAGECOUNT value on done: 259428.0 [2024-08-06 01:54:25,410][52669] Sum rewards: 61.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.159', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.146', 'AMMO3': '0.150', 'weapon4': '0.212', 'AMMO4': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:25,644][52666] DAMAGECOUNT value on done: 251005.0 [2024-08-06 01:54:25,644][52666] Sum rewards: 64.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.810', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.104', 'AMMO4': '0.180', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.230', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:26,446][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:54:26,566][52794] DAMAGECOUNT value on done: 243269.0 [2024-08-06 01:54:26,569][52794] Sum rewards: 62.543, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'weapon5': '0.050', 'AMMO2': '0.061', 'AMMO3': '0.134', 'WEAPON5': '0.250', 'weapon2': '0.276', 'AMMO4': '0.307', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon3': '2.932', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:27,214][52820] DAMAGECOUNT value on done: 228218.0 [2024-08-06 01:54:27,215][52820] Sum rewards: 63.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.263', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.102', 'weapon4': '0.124', 'AMMO4': '0.190', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.242', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:27,278][52664] DAMAGECOUNT value on done: 257815.0 [2024-08-06 01:54:27,278][52664] Sum rewards: 72.302, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.158', 'weapon4': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '0.950', 'weapon3': '3.192', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:27,488][52658] DAMAGECOUNT value on done: 250640.0 [2024-08-06 01:54:27,489][52658] Sum rewards: 59.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '50.500'} [2024-08-06 01:54:27,528][52671] DAMAGECOUNT value on done: 249951.0 [2024-08-06 01:54:27,528][52671] Sum rewards: 63.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.040', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO4': '0.199', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.132', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:27,785][52650] Updated weights for policy 0, policy_version 33981 (0.0016) [2024-08-06 01:54:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 278372352. Throughput: 0: 4394.9. Samples: 69600190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:54:27,795][52567] Avg episode reward: [(0, '63.222')] [2024-08-06 01:54:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033981_278372352.pth... [2024-08-06 01:54:27,912][52811] DAMAGECOUNT value on done: 231311.0 [2024-08-06 01:54:27,915][52811] Sum rewards: 66.027, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.464', 'AMMO2': '0.016', 'weapon4': '0.064', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon2': '0.952', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033465_274145280.pth [2024-08-06 01:54:28,402][52666] DAMAGECOUNT value on done: 250723.0 [2024-08-06 01:54:28,404][52666] Sum rewards: 68.052, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.057', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'weapon2': '0.632', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.216', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:28,448][52803] DAMAGECOUNT value on done: 237734.0 [2024-08-06 01:54:28,449][52803] Sum rewards: 73.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon4': '0.178', 'AMMO3': '0.210', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '62.000'} [2024-08-06 01:54:28,636][52669] DAMAGECOUNT value on done: 243735.0 [2024-08-06 01:54:28,638][52669] Sum rewards: 62.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.819', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.216', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:28,779][52670] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:54:29,527][52794] DAMAGECOUNT value on done: 255837.0 [2024-08-06 01:54:29,531][52794] Sum rewards: 54.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.195', 'weapon5': '0.266', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.714', 'WEAPON3': '1.150', 'weapon3': '2.184', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '46.000'} [2024-08-06 01:54:30,046][52658] DAMAGECOUNT value on done: 253985.0 [2024-08-06 01:54:30,046][52658] Sum rewards: 62.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.075', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.118', 'weapon4': '0.154', 'AMMO4': '0.172', 'AMMO3': '0.260', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.232', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:30,133][52664] DAMAGECOUNT value on done: 254320.0 [2024-08-06 01:54:30,133][52664] Sum rewards: 54.524, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.957', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.242', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.204', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:30,247][52820] DAMAGECOUNT value on done: 231331.0 [2024-08-06 01:54:30,249][52820] Sum rewards: 62.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.194', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon2': '0.402', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.252', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:30,677][52671] DAMAGECOUNT value on done: 245240.0 [2024-08-06 01:54:30,679][52671] Sum rewards: 58.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.112', 'AMMO3': '0.167', 'AMMO4': '0.218', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '49.500'} [2024-08-06 01:54:30,948][52811] DAMAGECOUNT value on done: 226444.0 [2024-08-06 01:54:30,950][52811] Sum rewards: 63.368, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.710', 'AMMO2': '0.008', 'AMMO5': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.133', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:31,374][52669] DAMAGECOUNT value on done: 252830.0 [2024-08-06 01:54:31,376][52669] Sum rewards: 67.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon2': '0.242', 'AMMO3': '0.246', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:31,431][52666] DAMAGECOUNT value on done: 244662.0 [2024-08-06 01:54:31,432][52666] Sum rewards: 60.530, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.188', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.098', 'weapon2': '0.168', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:31,700][52803] DAMAGECOUNT value on done: 228486.0 [2024-08-06 01:54:31,701][52803] Sum rewards: 65.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.652', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.124', 'weapon4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:31,746][52795] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:54:32,444][52670] DAMAGECOUNT value on done: 243114.0 [2024-08-06 01:54:32,444][52670] Sum rewards: 59.173, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.256', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.141', 'weapon5': '0.212', 'AMMO4': '0.267', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.514', 'weapon4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.430', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '46.000'} [2024-08-06 01:54:32,594][52794] DAMAGECOUNT value on done: 250839.0 [2024-08-06 01:54:32,596][52794] Sum rewards: 70.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.364', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.150', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.284', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:32,602][52658] DAMAGECOUNT value on done: 239508.0 [2024-08-06 01:54:32,604][52658] Sum rewards: 73.720, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.142', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.129', 'weapon4': '0.136', 'WEAPON4': '0.150', 'weapon2': '0.748', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:32,763][52650] Updated weights for policy 0, policy_version 33991 (0.0024) [2024-08-06 01:54:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 278454272. Throughput: 0: 4390.5. Samples: 69613000. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:54:32,794][52567] Avg episode reward: [(0, '63.322')] [2024-08-06 01:54:33,283][52664] DAMAGECOUNT value on done: 257689.0 [2024-08-06 01:54:33,283][52664] Sum rewards: 64.072, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.795', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.108', 'AMMO4': '0.112', 'weapon2': '0.194', 'WEAPON4': '0.250', 'AMMO3': '0.333', 'WEAPON3': '1.950', 'HITCOUNT': '3.370', 'weapon3': '3.378', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '59.000'} [2024-08-06 01:54:33,472][52820] DAMAGECOUNT value on done: 227971.0 [2024-08-06 01:54:33,473][52820] Sum rewards: 62.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.218', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.182', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '2.952', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:33,751][52671] DAMAGECOUNT value on done: 253769.0 [2024-08-06 01:54:33,753][52671] Sum rewards: 72.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.114', 'AMMO3': '0.171', 'AMMO4': '0.174', 'weapon4': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.932', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:34,087][52811] DAMAGECOUNT value on done: 230629.0 [2024-08-06 01:54:34,087][52811] Sum rewards: 75.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon4': '0.124', 'weapon5': '0.142', 'AMMO3': '0.226', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '63.000'} [2024-08-06 01:54:34,300][52669] DAMAGECOUNT value on done: 251233.0 [2024-08-06 01:54:34,301][52669] Sum rewards: 63.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:34,406][52666] DAMAGECOUNT value on done: 241810.0 [2024-08-06 01:54:34,409][52666] Sum rewards: 58.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.664', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.194', 'weapon5': '0.254', 'AMMO4': '0.265', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.532', 'weapon4': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.274', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '48.000'} [2024-08-06 01:54:34,771][52803] DAMAGECOUNT value on done: 234969.0 [2024-08-06 01:54:34,771][52803] Sum rewards: 60.237, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'weapon5': '0.064', 'weapon4': '0.066', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.244', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '52.500'} [2024-08-06 01:54:35,109][52670] DAMAGECOUNT value on done: 247911.0 [2024-08-06 01:54:35,109][52670] Sum rewards: 60.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon4': '0.054', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.516', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.186', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:35,245][52658] DAMAGECOUNT value on done: 247123.0 [2024-08-06 01:54:35,245][52658] Sum rewards: 68.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.790', 'WEAPON3': '1.500', 'weapon3': '2.902', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '60.000'} [2024-08-06 01:54:35,777][52794] DAMAGECOUNT value on done: 250763.0 [2024-08-06 01:54:35,785][52794] Sum rewards: 67.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.258', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:36,749][52820] DAMAGECOUNT value on done: 229639.0 [2024-08-06 01:54:36,750][52820] Sum rewards: 69.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.506', 'AMMO5': '0.008', 'AMMO2': '0.049', 'AMMO3': '0.156', 'weapon5': '0.164', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '0.900', 'weapon3': '2.460', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:36,835][52669] DAMAGECOUNT value on done: 254560.0 [2024-08-06 01:54:36,835][52669] Sum rewards: 65.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.080', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO4': '0.185', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:36,900][52666] DAMAGECOUNT value on done: 238593.0 [2024-08-06 01:54:36,901][52666] Sum rewards: 51.436, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.980', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.175', 'weapon5': '0.196', 'AMMO4': '0.226', 'weapon2': '0.294', 'WEAPON5': '0.450', 'weapon4': '0.496', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '43.000'} [2024-08-06 01:54:37,000][52671] DAMAGECOUNT value on done: 248797.0 [2024-08-06 01:54:37,001][52671] Sum rewards: 66.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.054', 'AMMO4': '0.180', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:37,034][52650] Updated weights for policy 0, policy_version 34001 (0.0015) [2024-08-06 01:54:37,201][52811] DAMAGECOUNT value on done: 232934.0 [2024-08-06 01:54:37,202][52811] Sum rewards: 65.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.611', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.168', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.206', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17578.3). Total num frames: 278544384. Throughput: 0: 4385.8. Samples: 69639170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:54:37,794][52567] Avg episode reward: [(0, '63.220')] [2024-08-06 01:54:37,822][52670] DAMAGECOUNT value on done: 241467.0 [2024-08-06 01:54:37,822][52670] Sum rewards: 73.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.370', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '60.000'} [2024-08-06 01:54:37,901][52803] DAMAGECOUNT value on done: 225558.0 [2024-08-06 01:54:37,903][52803] Sum rewards: 60.767, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.504', 'weapon2': '0.532', 'WEAPON3': '1.600', 'weapon3': '2.618', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:38,126][52658] DAMAGECOUNT value on done: 246903.0 [2024-08-06 01:54:38,127][52658] Sum rewards: 61.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.833', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO3': '0.132', 'weapon5': '0.142', 'AMMO4': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '0.900', 'weapon2': '1.044', 'weapon3': '2.096', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '49.000'} [2024-08-06 01:54:38,970][52794] DAMAGECOUNT value on done: 260857.0 [2024-08-06 01:54:38,970][52794] Sum rewards: 65.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.454', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.096', 'AMMO4': '0.219', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.356', 'weapon4': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.846', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:39,738][52666] DAMAGECOUNT value on done: 247531.0 [2024-08-06 01:54:39,738][52666] Sum rewards: 64.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.118', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.058', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:39,818][52671] DAMAGECOUNT value on done: 250181.0 [2024-08-06 01:54:39,819][52671] Sum rewards: 66.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.208', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:39,874][52820] DAMAGECOUNT value on done: 228940.0 [2024-08-06 01:54:39,875][52820] Sum rewards: 68.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.015', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.632', 'WEAPON3': '0.950', 'weapon3': '3.158', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:40,267][52811] DAMAGECOUNT value on done: 227961.0 [2024-08-06 01:54:40,269][52811] Sum rewards: 58.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.272', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.114', 'AMMO4': '0.203', 'AMMO3': '0.209', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.512', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:40,673][52670] DAMAGECOUNT value on done: 241985.0 [2024-08-06 01:54:40,675][52670] Sum rewards: 58.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.722', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.048', 'AMMO4': '0.107', 'weapon4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '48.000'} [2024-08-06 01:54:41,027][52658] DAMAGECOUNT value on done: 241021.0 [2024-08-06 01:54:41,027][52658] Sum rewards: 54.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.874', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.176', 'weapon5': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.788', 'WEAPON3': '1.050', 'weapon3': '2.482', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '45.000'} [2024-08-06 01:54:42,061][52650] Updated weights for policy 0, policy_version 34011 (0.0012) [2024-08-06 01:54:42,272][52671] DAMAGECOUNT value on done: 251890.0 [2024-08-06 01:54:42,273][52671] Sum rewards: 45.702, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.186', 'AMMO3': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '41.000'} [2024-08-06 01:54:42,440][52794] DAMAGECOUNT value on done: 250858.0 [2024-08-06 01:54:42,442][52794] Sum rewards: 70.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.960', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'weapon4': '0.196', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '59.000'} [2024-08-06 01:54:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 278634496. Throughput: 0: 4396.9. Samples: 69665730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 01:54:42,794][52567] Avg episode reward: [(0, '63.369')] [2024-08-06 01:54:42,877][52666] DAMAGECOUNT value on done: 244828.0 [2024-08-06 01:54:42,879][52666] Sum rewards: 55.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'AMMO3': '0.178', 'WEAPON4': '0.350', 'weapon4': '0.536', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.622', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '47.000'} [2024-08-06 01:54:42,984][52820] DAMAGECOUNT value on done: 232651.0 [2024-08-06 01:54:42,984][52820] Sum rewards: 70.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.905', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.162', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:43,332][52664] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:54:43,516][52811] DAMAGECOUNT value on done: 236650.0 [2024-08-06 01:54:43,516][52811] Sum rewards: 63.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.458', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.167', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'weapon4': '0.340', 'WEAPON3': '1.100', 'weapon3': '2.892', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:43,816][52670] DAMAGECOUNT value on done: 248909.0 [2024-08-06 01:54:43,817][52670] Sum rewards: 67.660, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.305', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.094', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.270', 'AMMO4': '0.279', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '60.000'} [2024-08-06 01:54:44,413][52658] DAMAGECOUNT value on done: 247046.0 [2024-08-06 01:54:44,414][52658] Sum rewards: 62.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.032', 'AMMO5': '0.005', 'AMMO2': '0.049', 'WEAPON5': '0.100', 'weapon5': '0.124', 'weapon2': '0.236', 'AMMO3': '0.243', 'AMMO4': '0.243', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:45,322][52671] DAMAGECOUNT value on done: 245507.0 [2024-08-06 01:54:45,323][52671] Sum rewards: 58.738, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.370', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.092', 'AMMO4': '0.194', 'weapon5': '0.200', 'weapon2': '0.298', 'AMMO3': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.044', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '54.000'} [2024-08-06 01:54:46,077][52666] DAMAGECOUNT value on done: 245006.0 [2024-08-06 01:54:46,087][52666] Sum rewards: 64.536, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.610', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon4': '0.184', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '57.000'} [2024-08-06 01:54:46,151][52820] DAMAGECOUNT value on done: 229210.0 [2024-08-06 01:54:46,155][52820] Sum rewards: 60.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.258', 'weapon2': '0.352', 'WEAPON4': '0.450', 'weapon4': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.634', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:46,496][52650] Updated weights for policy 0, policy_version 34021 (0.0040) [2024-08-06 01:54:46,948][52658] DAMAGECOUNT value on done: 253182.0 [2024-08-06 01:54:46,949][52658] Sum rewards: 63.362, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.431', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.054', 'AMMO4': '0.199', 'weapon2': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon4': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.160', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '58.000'} [2024-08-06 01:54:46,971][52670] DAMAGECOUNT value on done: 246256.0 [2024-08-06 01:54:46,971][52670] Sum rewards: 61.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.150', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'WEAPON4': '0.400', 'weapon4': '0.418', 'weapon2': '0.428', 'WEAPON3': '1.700', 'weapon3': '2.758', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 278716416. Throughput: 0: 4384.2. Samples: 69678660. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:54:47,795][52567] Avg episode reward: [(0, '63.143')] [2024-08-06 01:54:48,263][52671] DAMAGECOUNT value on done: 252930.0 [2024-08-06 01:54:48,266][52671] Sum rewards: 52.687, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.009', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.056', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.286', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.530', 'weapon3': '3.142', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '42.000'} [2024-08-06 01:54:49,166][52666] DAMAGECOUNT value on done: 244757.0 [2024-08-06 01:54:49,167][52666] Sum rewards: 48.132, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.310', 'AMMO5': '0.009', 'AMMO2': '0.073', 'weapon5': '0.110', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.360', 'AMMO4': '0.365', 'weapon4': '0.568', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.676', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '12.804', 'FRAGCOUNT': '44.000'} [2024-08-06 01:54:49,221][52820] DAMAGECOUNT value on done: 228954.0 [2024-08-06 01:54:49,222][52820] Sum rewards: 66.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.155', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'weapon5': '0.200', 'weapon4': '0.218', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.074', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '53.500'} [2024-08-06 01:54:49,506][52658] DAMAGECOUNT value on done: 244104.0 [2024-08-06 01:54:49,507][52658] Sum rewards: 57.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.784', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.037', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.183', 'weapon2': '0.720', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '47.000'} [2024-08-06 01:54:50,067][52670] DAMAGECOUNT value on done: 240288.0 [2024-08-06 01:54:50,067][52670] Sum rewards: 60.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '50.000'} [2024-08-06 01:54:51,137][52650] Updated weights for policy 0, policy_version 34031 (0.0013) [2024-08-06 01:54:51,278][52671] DAMAGECOUNT value on done: 252285.0 [2024-08-06 01:54:51,279][52671] Sum rewards: 55.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.188', 'AMMO3': '0.230', 'weapon4': '0.306', 'WEAPON4': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '48.000'} [2024-08-06 01:54:52,164][52658] DAMAGECOUNT value on done: 246836.0 [2024-08-06 01:54:52,166][52658] Sum rewards: 62.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.185', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.175', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.394', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '52.000'} [2024-08-06 01:54:52,258][52666] DAMAGECOUNT value on done: 243384.0 [2024-08-06 01:54:52,258][52666] Sum rewards: 63.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.492', 'WEAPON3': '1.600', 'weapon3': '3.206', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '55.000'} [2024-08-06 01:54:52,286][52820] DAMAGECOUNT value on done: 231168.0 [2024-08-06 01:54:52,286][52820] Sum rewards: 75.607, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.358', 'weapon2': '0.386', 'WEAPON3': '0.900', 'weapon3': '3.016', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '59.000'} [2024-08-06 01:54:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 278806528. Throughput: 0: 4394.2. Samples: 69705360. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:54:52,794][52567] Avg episode reward: [(0, '62.983')] [2024-08-06 01:54:53,122][52670] DAMAGECOUNT value on done: 243984.0 [2024-08-06 01:54:53,122][52670] Sum rewards: 57.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.180', 'weapon5': '0.182', 'AMMO4': '0.214', 'weapon4': '0.338', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '49.000'} [2024-08-06 01:54:54,292][52671] DAMAGECOUNT value on done: 248844.0 [2024-08-06 01:54:54,292][52671] Sum rewards: 63.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.112', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.034', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:55,047][52666] DAMAGECOUNT value on done: 238198.0 [2024-08-06 01:54:55,048][52666] Sum rewards: 78.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.648', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon5': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.358', 'WEAPON3': '1.050', 'weapon3': '2.750', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '63.000'} [2024-08-06 01:54:55,089][52658] DAMAGECOUNT value on done: 249215.0 [2024-08-06 01:54:55,091][52658] Sum rewards: 66.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.984', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '57.000'} [2024-08-06 01:54:55,522][52820] DAMAGECOUNT value on done: 230995.0 [2024-08-06 01:54:55,525][52820] Sum rewards: 76.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.132', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.171', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '3.092', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '63.000'} [2024-08-06 01:54:55,704][52670] DAMAGECOUNT value on done: 242956.0 [2024-08-06 01:54:55,704][52670] Sum rewards: 63.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'weapon4': '0.238', 'weapon2': '0.278', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.154', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '56.000'} [2024-08-06 01:54:56,040][52650] Updated weights for policy 0, policy_version 34041 (0.0011) [2024-08-06 01:54:57,420][52671] DAMAGECOUNT value on done: 256500.0 [2024-08-06 01:54:57,420][52671] Sum rewards: 69.954, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.259', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.480', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '62.000'} [2024-08-06 01:54:57,467][52666] DAMAGECOUNT value on done: 249700.0 [2024-08-06 01:54:57,469][52666] Sum rewards: 48.862, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.287', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.416', 'WEAPON3': '1.550', 'HITCOUNT': '2.750', 'weapon3': '2.790', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '46.000'} [2024-08-06 01:54:57,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17605.9). Total num frames: 278904832. Throughput: 0: 4392.7. Samples: 69731600. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:54:57,794][52567] Avg episode reward: [(0, '63.151')] [2024-08-06 01:54:58,052][52670] DAMAGECOUNT value on done: 238144.0 [2024-08-06 01:54:58,054][52670] Sum rewards: 59.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.901', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.188', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '2.948', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '51.000'} [2024-08-06 01:54:58,638][52820] DAMAGECOUNT value on done: 224635.0 [2024-08-06 01:54:58,638][52820] Sum rewards: 62.905, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.478', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.124', 'AMMO3': '0.217', 'AMMO4': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.370', 'weapon4': '0.552', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.548', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '53.000'} [2024-08-06 01:54:59,827][52666] DAMAGECOUNT value on done: 248353.0 [2024-08-06 01:54:59,828][52666] Sum rewards: 61.447, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.596', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '51.000'} [2024-08-06 01:55:00,393][52671] DAMAGECOUNT value on done: 245901.0 [2024-08-06 01:55:00,397][52671] Sum rewards: 59.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.945', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.091', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.378', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '50.000'} [2024-08-06 01:55:00,430][52650] Updated weights for policy 0, policy_version 34051 (0.0058) [2024-08-06 01:55:00,743][52670] DAMAGECOUNT value on done: 249864.0 [2024-08-06 01:55:00,744][52670] Sum rewards: 59.690, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.265', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.106', 'weapon4': '0.132', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '49.000'} [2024-08-06 01:55:01,496][52659] DAMAGECOUNT value on done: 248803.0 [2024-08-06 01:55:01,498][52659] Sum rewards: 68.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.754', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.128', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:01,882][52820] DAMAGECOUNT value on done: 235628.0 [2024-08-06 01:55:01,883][52820] Sum rewards: 65.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.230', 'weapon4': '0.240', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.354', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '54.000'} [2024-08-06 01:55:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 278978560. Throughput: 0: 4383.1. Samples: 69744530. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 01:55:02,794][52567] Avg episode reward: [(0, '63.200')] [2024-08-06 01:55:02,949][52666] DAMAGECOUNT value on done: 244922.0 [2024-08-06 01:55:02,950][52666] Sum rewards: 68.825, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.997', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.218', 'weapon2': '0.378', 'weapon4': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '59.000'} [2024-08-06 01:55:03,491][52671] DAMAGECOUNT value on done: 240310.0 [2024-08-06 01:55:03,493][52671] Sum rewards: 60.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.087', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.218', 'weapon4': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '2.966', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '51.000'} [2024-08-06 01:55:03,766][52670] DAMAGECOUNT value on done: 246710.0 [2024-08-06 01:55:03,769][52670] Sum rewards: 64.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.765', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:04,534][52659] DAMAGECOUNT value on done: 247089.0 [2024-08-06 01:55:04,534][52659] Sum rewards: 77.199, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.310', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.710', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '62.000'} [2024-08-06 01:55:04,923][52820] DAMAGECOUNT value on done: 238400.0 [2024-08-06 01:55:04,924][52820] Sum rewards: 70.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'weapon4': '0.216', 'weapon2': '0.218', 'AMMO3': '0.262', 'WEAPON3': '1.700', 'weapon3': '3.388', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 01:55:05,400][52650] Updated weights for policy 0, policy_version 34061 (0.0023) [2024-08-06 01:55:05,944][52666] DAMAGECOUNT value on done: 243306.0 [2024-08-06 01:55:05,944][52666] Sum rewards: 61.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.173', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'weapon4': '0.266', 'WEAPON4': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '50.000'} [2024-08-06 01:55:06,624][52671] DAMAGECOUNT value on done: 250044.0 [2024-08-06 01:55:06,624][52671] Sum rewards: 67.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.483', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.252', 'weapon4': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:06,633][52670] DAMAGECOUNT value on done: 244869.0 [2024-08-06 01:55:06,635][52670] Sum rewards: 50.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.178', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.228', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '42.000'} [2024-08-06 01:55:07,770][52659] DAMAGECOUNT value on done: 247758.0 [2024-08-06 01:55:07,770][52659] Sum rewards: 67.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.114', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '58.000'} [2024-08-06 01:55:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 279068672. Throughput: 0: 4384.7. Samples: 69771130. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:55:07,802][52567] Avg episode reward: [(0, '63.495')] [2024-08-06 01:55:08,005][52820] DAMAGECOUNT value on done: 225870.0 [2024-08-06 01:55:08,007][52820] Sum rewards: 40.783, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.760', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.072', 'weapon4': '0.146', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'AMMO3': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.750', 'HITCOUNT': '2.660', 'weapon3': '2.986', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '40.000'} [2024-08-06 01:55:08,644][52666] DAMAGECOUNT value on done: 241187.0 [2024-08-06 01:55:08,644][52666] Sum rewards: 76.002, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.116', 'AMMO3': '0.262', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.336', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '66.000'} [2024-08-06 01:55:09,521][52670] DAMAGECOUNT value on done: 248197.0 [2024-08-06 01:55:09,523][52670] Sum rewards: 66.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.583', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.190', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:09,682][52650] Updated weights for policy 0, policy_version 34071 (0.0025) [2024-08-06 01:55:09,792][52671] DAMAGECOUNT value on done: 251443.0 [2024-08-06 01:55:09,792][52671] Sum rewards: 66.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.514', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.384', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.210', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:10,902][52659] DAMAGECOUNT value on done: 246828.0 [2024-08-06 01:55:10,904][52659] Sum rewards: 66.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.208', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON4': '0.400', 'weapon4': '0.620', 'WEAPON3': '1.450', 'weapon3': '2.500', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:11,837][52666] DAMAGECOUNT value on done: 249368.0 [2024-08-06 01:55:11,838][52666] Sum rewards: 67.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.230', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '57.000'} [2024-08-06 01:55:12,633][52670] DAMAGECOUNT value on done: 248677.0 [2024-08-06 01:55:12,634][52670] Sum rewards: 68.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.070', 'AMMO4': '0.089', 'weapon5': '0.090', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '54.000'} [2024-08-06 01:55:12,754][52671] DAMAGECOUNT value on done: 254682.0 [2024-08-06 01:55:12,755][52671] Sum rewards: 55.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.586', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.092', 'AMMO3': '0.168', 'weapon4': '0.240', 'AMMO4': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '46.000'} [2024-08-06 01:55:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 279158784. Throughput: 0: 4384.2. Samples: 69797480. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:55:12,802][52567] Avg episode reward: [(0, '63.644')] [2024-08-06 01:55:12,889][52663] DAMAGECOUNT value on done: 251876.0 [2024-08-06 01:55:12,889][52663] Sum rewards: 68.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.387', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.196', 'weapon5': '0.212', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.500', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.436', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:13,877][52659] DAMAGECOUNT value on done: 243859.0 [2024-08-06 01:55:13,877][52659] Sum rewards: 62.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.176', 'weapon4': '0.198', 'AMMO3': '0.215', 'AMMO4': '0.268', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.828', 'WEAPON3': '1.300', 'weapon3': '2.474', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:14,563][52650] Updated weights for policy 0, policy_version 34081 (0.0037) [2024-08-06 01:55:14,828][52666] DAMAGECOUNT value on done: 240040.0 [2024-08-06 01:55:14,830][52666] Sum rewards: 64.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.975', 'AMMO5': '0.004', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.192', 'AMMO4': '0.202', 'weapon2': '0.260', 'WEAPON4': '0.450', 'weapon4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '54.000'} [2024-08-06 01:55:15,517][52670] DAMAGECOUNT value on done: 235927.0 [2024-08-06 01:55:15,519][52670] Sum rewards: 70.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.262', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2024-08-06 01:55:15,700][52663] DAMAGECOUNT value on done: 248475.0 [2024-08-06 01:55:15,702][52663] Sum rewards: 75.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.210', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '62.000'} [2024-08-06 01:55:15,738][52671] DAMAGECOUNT value on done: 251722.0 [2024-08-06 01:55:15,739][52671] Sum rewards: 69.569, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.829', 'AMMO5': '0.010', 'AMMO2': '0.060', 'weapon5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.229', 'weapon2': '0.280', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '60.000'} [2024-08-06 01:55:16,780][52659] DAMAGECOUNT value on done: 247034.0 [2024-08-06 01:55:16,781][52659] Sum rewards: 61.147, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.708', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.165', 'weapon4': '0.226', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO3': '0.313', 'WEAPON4': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.062', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:17,763][52666] DAMAGECOUNT value on done: 246632.0 [2024-08-06 01:55:17,763][52666] Sum rewards: 56.204, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.514', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.250', 'AMMO3': '0.292', 'weapon2': '0.382', 'WEAPON3': '1.750', 'weapon3': '3.040', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '50.000'} [2024-08-06 01:55:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 279248896. Throughput: 0: 4391.3. Samples: 69810610. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:55:17,802][52567] Avg episode reward: [(0, '63.792')] [2024-08-06 01:55:18,241][52663] DAMAGECOUNT value on done: 244199.0 [2024-08-06 01:55:18,242][52663] Sum rewards: 65.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.052', 'weapon4': '0.126', 'AMMO4': '0.165', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:18,463][52670] DAMAGECOUNT value on done: 248714.0 [2024-08-06 01:55:18,464][52670] Sum rewards: 61.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.136', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.250', 'weapon2': '0.326', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:18,828][52671] DAMAGECOUNT value on done: 246643.0 [2024-08-06 01:55:18,832][52671] Sum rewards: 59.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.248', 'weapon2': '0.458', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.020', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '49.000'} [2024-08-06 01:55:19,234][52650] Updated weights for policy 0, policy_version 34091 (0.0014) [2024-08-06 01:55:19,974][52659] DAMAGECOUNT value on done: 248543.0 [2024-08-06 01:55:19,977][52659] Sum rewards: 85.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.172', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.498', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '70.000'} [2024-08-06 01:55:21,095][52663] DAMAGECOUNT value on done: 248764.0 [2024-08-06 01:55:21,095][52663] Sum rewards: 66.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.978', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.140', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:21,445][52670] DAMAGECOUNT value on done: 252688.0 [2024-08-06 01:55:21,446][52670] Sum rewards: 81.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.603', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.284', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '67.000'} [2024-08-06 01:55:21,617][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:55:21,961][52649] DAMAGECOUNT value on done: 241052.0 [2024-08-06 01:55:21,962][52649] Sum rewards: 64.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.727', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.148', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '52.000'} [2024-08-06 01:55:22,506][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:55:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 279330816. Throughput: 0: 4399.1. Samples: 69837130. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:55:22,795][52567] Avg episode reward: [(0, '64.219')] [2024-08-06 01:55:23,090][52659] DAMAGECOUNT value on done: 242679.0 [2024-08-06 01:55:23,092][52659] Sum rewards: 65.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.291', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.066', 'AMMO4': '0.080', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.124', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:23,720][52650] Updated weights for policy 0, policy_version 34101 (0.0018) [2024-08-06 01:55:23,812][52663] DAMAGECOUNT value on done: 247463.0 [2024-08-06 01:55:23,813][52663] Sum rewards: 66.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.070', 'AMMO4': '0.140', 'weapon5': '0.146', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:24,366][52670] DAMAGECOUNT value on done: 245789.0 [2024-08-06 01:55:24,368][52670] Sum rewards: 65.524, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.048', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO4': '0.240', 'AMMO3': '0.260', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '57.000'} [2024-08-06 01:55:24,672][52659] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:55:25,156][52649] DAMAGECOUNT value on done: 234946.0 [2024-08-06 01:55:25,156][52649] Sum rewards: 74.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.382', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.185', 'weapon2': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.450', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '60.000'} [2024-08-06 01:55:26,065][52659] DAMAGECOUNT value on done: 253497.0 [2024-08-06 01:55:26,066][52659] Sum rewards: 71.799, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.322', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO4': '0.093', 'AMMO3': '0.135', 'weapon2': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.530', 'WEAPON3': '0.850', 'weapon3': '3.044', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.500'} [2024-08-06 01:55:26,984][52663] DAMAGECOUNT value on done: 251467.0 [2024-08-06 01:55:26,985][52663] Sum rewards: 58.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.502', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.180', 'AMMO4': '0.184', 'weapon5': '0.210', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.598', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '48.000'} [2024-08-06 01:55:27,231][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:55:27,332][52670] DAMAGECOUNT value on done: 248138.0 [2024-08-06 01:55:27,333][52670] Sum rewards: 74.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.160', 'weapon4': '0.202', 'weapon2': '0.280', 'WEAPON3': '1.100', 'weapon3': '3.378', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '60.000'} [2024-08-06 01:55:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.8, 300 sec: 17522.5). Total num frames: 279412736. Throughput: 0: 4392.7. Samples: 69863400. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 01:55:27,794][52567] Avg episode reward: [(0, '64.383')] [2024-08-06 01:55:27,805][52614] Saving new best policy, reward=64.383! [2024-08-06 01:55:28,199][52649] DAMAGECOUNT value on done: 242951.0 [2024-08-06 01:55:28,200][52649] Sum rewards: 69.842, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.858', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.180', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.314', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:28,739][52650] Updated weights for policy 0, policy_version 34111 (0.0033) [2024-08-06 01:55:29,375][52659] DAMAGECOUNT value on done: 253085.0 [2024-08-06 01:55:29,375][52659] Sum rewards: 70.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.556', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.198', 'weapon2': '0.218', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '57.000'} [2024-08-06 01:55:30,043][52663] DAMAGECOUNT value on done: 248035.0 [2024-08-06 01:55:30,044][52663] Sum rewards: 66.928, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.282', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.131', 'AMMO4': '0.179', 'weapon5': '0.216', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON4': '0.550', 'weapon4': '0.554', 'WEAPON3': '0.950', 'weapon3': '2.482', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:30,686][52649] DAMAGECOUNT value on done: 243870.0 [2024-08-06 01:55:30,686][52649] Sum rewards: 66.133, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.030', 'AMMO3': '0.123', 'weapon5': '0.130', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.690', 'WEAPON3': '0.750', 'weapon4': '0.888', 'weapon3': '2.088', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '52.000'} [2024-08-06 01:55:32,116][52659] DAMAGECOUNT value on done: 247122.0 [2024-08-06 01:55:32,118][52659] Sum rewards: 65.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.782', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.084', 'AMMO3': '0.176', 'weapon2': '0.308', 'weapon5': '0.376', 'AMMO4': '0.418', 'weapon4': '0.532', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.436', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:32,667][52663] DAMAGECOUNT value on done: 247312.0 [2024-08-06 01:55:32,669][52663] Sum rewards: 52.381, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon5': '0.166', 'AMMO3': '0.225', 'weapon4': '0.292', 'AMMO4': '0.335', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.696', 'WEAPON3': '1.250', 'weapon3': '2.574', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '46.000'} [2024-08-06 01:55:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 279502848. Throughput: 0: 4391.8. Samples: 69876290. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 01:55:32,795][52567] Avg episode reward: [(0, '64.337')] [2024-08-06 01:55:33,199][52649] DAMAGECOUNT value on done: 234333.0 [2024-08-06 01:55:33,207][52649] Sum rewards: 68.442, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.277', 'weapon2': '0.356', 'WEAPON3': '1.700', 'weapon3': '3.192', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '59.000'} [2024-08-06 01:55:33,507][52650] Updated weights for policy 0, policy_version 34121 (0.0012) [2024-08-06 01:55:35,206][52647] DAMAGECOUNT value on done: 263406.0 [2024-08-06 01:55:35,207][52647] Sum rewards: 69.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.336', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.195', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '57.000'} [2024-08-06 01:55:35,491][52663] DAMAGECOUNT value on done: 247110.0 [2024-08-06 01:55:35,492][52663] Sum rewards: 59.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.178', 'weapon2': '0.214', 'AMMO3': '0.221', 'AMMO4': '0.282', 'weapon4': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '52.000'} [2024-08-06 01:55:35,502][52665] DAMAGECOUNT value on done: 245031.0 [2024-08-06 01:55:35,502][52665] Sum rewards: 65.927, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.268', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.112', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.292', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '57.000'} [2024-08-06 01:55:35,610][52659] DAMAGECOUNT value on done: 246712.0 [2024-08-06 01:55:35,610][52659] Sum rewards: 67.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.141', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.168', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.324', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '57.000'} [2024-08-06 01:55:36,235][52649] DAMAGECOUNT value on done: 245473.0 [2024-08-06 01:55:36,237][52649] Sum rewards: 63.636, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.244', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO4': '0.221', 'weapon5': '0.226', 'AMMO3': '0.238', 'weapon2': '0.278', 'weapon4': '0.350', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:37,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 279601152. Throughput: 0: 4384.2. Samples: 69902650. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 01:55:37,795][52567] Avg episode reward: [(0, '64.357')] [2024-08-06 01:55:37,803][52650] Updated weights for policy 0, policy_version 34131 (0.0029) [2024-08-06 01:55:37,950][52663] DAMAGECOUNT value on done: 249895.0 [2024-08-06 01:55:37,952][52663] Sum rewards: 72.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.120', 'weapon5': '0.130', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '61.000'} [2024-08-06 01:55:38,160][52647] DAMAGECOUNT value on done: 260950.0 [2024-08-06 01:55:38,162][52647] Sum rewards: 72.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.131', 'weapon5': '0.222', 'AMMO3': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.720', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '60.000'} [2024-08-06 01:55:38,567][52659] DAMAGECOUNT value on done: 242931.0 [2024-08-06 01:55:38,567][52659] Sum rewards: 63.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.645', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon5': '0.210', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.366', 'weapon4': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.666', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '51.500'} [2024-08-06 01:55:38,587][52665] DAMAGECOUNT value on done: 250582.0 [2024-08-06 01:55:38,588][52665] Sum rewards: 64.165, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.333', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.168', 'AMMO4': '0.209', 'weapon5': '0.284', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '52.000'} [2024-08-06 01:55:39,347][52649] DAMAGECOUNT value on done: 240342.0 [2024-08-06 01:55:39,351][52649] Sum rewards: 74.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '62.500'} [2024-08-06 01:55:40,524][52647] DAMAGECOUNT value on done: 261836.0 [2024-08-06 01:55:40,524][52647] Sum rewards: 61.154, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.610', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.076', 'AMMO4': '0.163', 'weapon4': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.100', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:40,747][52663] DAMAGECOUNT value on done: 252110.0 [2024-08-06 01:55:40,748][52663] Sum rewards: 62.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.495', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.178', 'weapon2': '0.444', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.106', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '52.000'} [2024-08-06 01:55:41,598][52659] DAMAGECOUNT value on done: 248767.0 [2024-08-06 01:55:41,599][52659] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.116', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'AMMO4': '0.265', 'weapon4': '0.322', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '52.000'} [2024-08-06 01:55:41,693][52665] DAMAGECOUNT value on done: 244776.0 [2024-08-06 01:55:41,694][52665] Sum rewards: 54.229, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.076', 'AMMO5': '0.018', 'AMMO2': '0.067', 'weapon5': '0.210', 'AMMO3': '0.241', 'AMMO4': '0.337', 'weapon2': '0.338', 'weapon4': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.788', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '48.000'} [2024-08-06 01:55:42,449][52649] DAMAGECOUNT value on done: 246410.0 [2024-08-06 01:55:42,451][52649] Sum rewards: 62.352, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.004', 'weapon4': '0.018', 'weapon5': '0.022', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.154', 'weapon2': '0.692', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '50.000'} [2024-08-06 01:55:42,749][52647] DAMAGECOUNT value on done: 265578.0 [2024-08-06 01:55:42,751][52647] Sum rewards: 57.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.701', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon2': '0.174', 'weapon4': '0.226', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.272', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '50.000'} [2024-08-06 01:55:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 279674880. Throughput: 0: 4382.0. Samples: 69928790. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 01:55:42,795][52567] Avg episode reward: [(0, '64.417')] [2024-08-06 01:55:42,795][52614] Saving new best policy, reward=64.417! [2024-08-06 01:55:43,044][52650] Updated weights for policy 0, policy_version 34141 (0.0020) [2024-08-06 01:55:43,555][52663] DAMAGECOUNT value on done: 246015.0 [2024-08-06 01:55:43,557][52663] Sum rewards: 72.260, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.662', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.148', 'AMMO3': '0.166', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '58.000'} [2024-08-06 01:55:44,677][52659] DAMAGECOUNT value on done: 251521.0 [2024-08-06 01:55:44,680][52659] Sum rewards: 66.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.294', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.163', 'weapon2': '0.666', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:44,790][52665] DAMAGECOUNT value on done: 243491.0 [2024-08-06 01:55:44,790][52665] Sum rewards: 61.296, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.184', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.304', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '51.000'} [2024-08-06 01:55:45,415][52647] DAMAGECOUNT value on done: 262659.0 [2024-08-06 01:55:45,417][52647] Sum rewards: 55.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.311', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.116', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '48.000'} [2024-08-06 01:55:45,662][52665] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:55:45,666][52649] DAMAGECOUNT value on done: 243207.0 [2024-08-06 01:55:45,666][52649] Sum rewards: 48.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.035', 'AMMO5': '0.020', 'AMMO2': '0.062', 'AMMO3': '0.173', 'weapon2': '0.308', 'AMMO4': '0.310', 'weapon5': '0.366', 'WEAPON5': '0.700', 'weapon4': '0.722', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.152', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.606', 'FRAGCOUNT': '42.000'} [2024-08-06 01:55:45,755][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:55:46,896][52663] DAMAGECOUNT value on done: 242074.0 [2024-08-06 01:55:46,898][52663] Sum rewards: 64.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.842', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.076', 'weapon4': '0.126', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.240', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '55.000'} [2024-08-06 01:55:47,387][52650] Updated weights for policy 0, policy_version 34151 (0.0015) [2024-08-06 01:55:47,544][52659] DAMAGECOUNT value on done: 255555.0 [2024-08-06 01:55:47,545][52659] Sum rewards: 53.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.189', 'weapon5': '0.238', 'weapon4': '0.250', 'AMMO4': '0.263', 'weapon2': '0.286', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.930', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '45.000'} [2024-08-06 01:55:47,793][52665] DAMAGECOUNT value on done: 240441.0 [2024-08-06 01:55:47,793][52665] Sum rewards: 69.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.766', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.185', 'weapon2': '0.262', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:47,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 279764992. Throughput: 0: 4372.2. Samples: 69941280. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 01:55:47,794][52567] Avg episode reward: [(0, '64.438')] [2024-08-06 01:55:47,797][52614] Saving new best policy, reward=64.438! [2024-08-06 01:55:47,966][52647] DAMAGECOUNT value on done: 267135.0 [2024-08-06 01:55:47,966][52647] Sum rewards: 68.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '58.000'} [2024-08-06 01:55:48,674][52649] DAMAGECOUNT value on done: 242632.0 [2024-08-06 01:55:48,674][52649] Sum rewards: 69.338, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.448', 'WEAPON3': '1.600', 'weapon3': '3.076', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '60.000'} [2024-08-06 01:55:49,930][52663] DAMAGECOUNT value on done: 241796.0 [2024-08-06 01:55:49,931][52663] Sum rewards: 59.079, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.212', 'HEALTH': '0.356', 'weapon2': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.788', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '47.000'} [2024-08-06 01:55:50,229][52659] DAMAGECOUNT value on done: 253510.0 [2024-08-06 01:55:50,229][52659] Sum rewards: 72.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.778', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.100', 'weapon2': '0.186', 'AMMO3': '0.205', 'WEAPON3': '1.350', 'HITCOUNT': '3.500', 'weapon3': '3.572', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '60.000'} [2024-08-06 01:55:50,880][52665] DAMAGECOUNT value on done: 239211.0 [2024-08-06 01:55:50,880][52665] Sum rewards: 77.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.265', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.085', 'AMMO3': '0.219', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '62.000'} [2024-08-06 01:55:51,143][52647] DAMAGECOUNT value on done: 262312.0 [2024-08-06 01:55:51,148][52647] Sum rewards: 63.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.798', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.348', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '53.000'} [2024-08-06 01:55:51,742][52649] DAMAGECOUNT value on done: 244337.0 [2024-08-06 01:55:51,745][52649] Sum rewards: 70.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.916', 'AMMO5': '0.004', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.025', 'weapon5': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.640', 'WEAPON3': '1.000', 'HITCOUNT': '3.160', 'weapon3': '3.198', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '58.000'} [2024-08-06 01:55:52,183][52650] Updated weights for policy 0, policy_version 34161 (0.0030) [2024-08-06 01:55:52,737][52663] DAMAGECOUNT value on done: 248560.0 [2024-08-06 01:55:52,740][52663] Sum rewards: 72.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.096', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.208', 'AMMO4': '0.248', 'weapon5': '0.264', 'weapon4': '0.272', 'weapon2': '0.286', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '59.000'} [2024-08-06 01:55:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 279855104. Throughput: 0: 4362.0. Samples: 69967420. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 01:55:52,795][52567] Avg episode reward: [(0, '65.266')] [2024-08-06 01:55:52,795][52614] Saving new best policy, reward=65.266! [2024-08-06 01:55:53,009][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:55:53,414][52659] DAMAGECOUNT value on done: 250275.0 [2024-08-06 01:55:53,415][52659] Sum rewards: 57.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.296', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.164', 'AMMO4': '0.165', 'weapon5': '0.196', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '47.000'} [2024-08-06 01:55:53,761][52665] DAMAGECOUNT value on done: 249339.0 [2024-08-06 01:55:53,763][52665] Sum rewards: 72.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.622', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.134', 'weapon4': '0.166', 'AMMO3': '0.207', 'AMMO4': '0.233', 'weapon2': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '59.000'} [2024-08-06 01:55:53,966][52647] DAMAGECOUNT value on done: 260745.0 [2024-08-06 01:55:53,966][52647] Sum rewards: 64.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.173', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '54.000'} [2024-08-06 01:55:54,679][52649] DAMAGECOUNT value on done: 243345.0 [2024-08-06 01:55:54,679][52649] Sum rewards: 69.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.485', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.152', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:55,407][52663] DAMAGECOUNT value on done: 250767.0 [2024-08-06 01:55:55,409][52663] Sum rewards: 63.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'weapon4': '0.124', 'AMMO3': '0.177', 'weapon2': '0.314', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.378', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '51.000'} [2024-08-06 01:55:56,581][52647] DAMAGECOUNT value on done: 265206.0 [2024-08-06 01:55:56,581][52647] Sum rewards: 70.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.356', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.160', 'AMMO3': '0.165', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.708', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '58.000'} [2024-08-06 01:55:56,590][52659] DAMAGECOUNT value on done: 253791.0 [2024-08-06 01:55:56,590][52659] Sum rewards: 63.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.625', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '51.500'} [2024-08-06 01:55:56,728][52665] DAMAGECOUNT value on done: 246723.0 [2024-08-06 01:55:56,728][52665] Sum rewards: 50.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.177', 'weapon5': '0.210', 'AMMO4': '0.260', 'weapon2': '0.414', 'WEAPON5': '0.500', 'weapon4': '0.516', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.612', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '42.500'} [2024-08-06 01:55:56,849][52650] Updated weights for policy 0, policy_version 34171 (0.0061) [2024-08-06 01:55:57,234][52662] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:55:57,679][52649] DAMAGECOUNT value on done: 244454.0 [2024-08-06 01:55:57,679][52649] Sum rewards: 71.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '58.000'} [2024-08-06 01:55:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17203.2, 300 sec: 17522.5). Total num frames: 279937024. Throughput: 0: 4354.7. Samples: 69993440. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 01:55:57,794][52567] Avg episode reward: [(0, '65.472')] [2024-08-06 01:55:57,798][52614] Saving new best policy, reward=65.472! [2024-08-06 01:55:57,812][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:55:57,954][52663] DAMAGECOUNT value on done: 251328.0 [2024-08-06 01:55:57,954][52663] Sum rewards: 68.966, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.220', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO4': '0.220', 'weapon5': '0.234', 'AMMO3': '0.269', 'weapon2': '0.310', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.748', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '61.000'} [2024-08-06 01:55:59,327][52647] DAMAGECOUNT value on done: 259020.0 [2024-08-06 01:55:59,329][52647] Sum rewards: 60.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.915', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.532', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.192', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '52.000'} [2024-08-06 01:55:59,642][52665] DAMAGECOUNT value on done: 249526.0 [2024-08-06 01:55:59,642][52665] Sum rewards: 65.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.995', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.234', 'weapon2': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 01:55:59,957][52659] DAMAGECOUNT value on done: 252558.0 [2024-08-06 01:55:59,958][52659] Sum rewards: 68.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.598', 'AMMO5': '0.015', 'AMMO2': '0.057', 'AMMO3': '0.198', 'weapon5': '0.202', 'AMMO4': '0.286', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.570', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '56.000'} [2024-08-06 01:56:00,598][52649] DAMAGECOUNT value on done: 245879.0 [2024-08-06 01:56:00,598][52649] Sum rewards: 63.080, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.514', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO4': '0.229', 'weapon5': '0.230', 'AMMO3': '0.265', 'weapon2': '0.364', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.592', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:01,006][52663] DAMAGECOUNT value on done: 256628.0 [2024-08-06 01:56:01,008][52663] Sum rewards: 69.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.114', 'weapon4': '0.218', 'AMMO3': '0.222', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.656', 'WEAPON3': '1.400', 'weapon3': '2.740', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '58.000'} [2024-08-06 01:56:01,597][52650] Updated weights for policy 0, policy_version 34181 (0.0038) [2024-08-06 01:56:01,820][52647] DAMAGECOUNT value on done: 263167.0 [2024-08-06 01:56:01,821][52647] Sum rewards: 64.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.594', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 280027136. Throughput: 0: 4347.3. Samples: 70006240. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 01:56:02,794][52567] Avg episode reward: [(0, '65.437')] [2024-08-06 01:56:02,835][52665] DAMAGECOUNT value on done: 248018.0 [2024-08-06 01:56:02,835][52665] Sum rewards: 70.539, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'HEALTH': '0.141', 'AMMO3': '0.150', 'weapon4': '0.160', 'weapon2': '0.532', 'WEAPON3': '0.900', 'weapon3': '3.116', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:03,731][52649] DAMAGECOUNT value on done: 237860.0 [2024-08-06 01:56:03,731][52649] Sum rewards: 71.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.902', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.082', 'weapon4': '0.104', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '60.000'} [2024-08-06 01:56:04,093][52663] DAMAGECOUNT value on done: 250828.0 [2024-08-06 01:56:04,095][52663] Sum rewards: 73.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.145', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '60.000'} [2024-08-06 01:56:04,466][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:56:04,798][52647] DAMAGECOUNT value on done: 256971.0 [2024-08-06 01:56:04,798][52647] Sum rewards: 70.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.436', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.184', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:05,706][52665] DAMAGECOUNT value on done: 254664.0 [2024-08-06 01:56:05,707][52665] Sum rewards: 54.091, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.706', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.126', 'weapon2': '0.174', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '47.000'} [2024-08-06 01:56:06,266][52650] Updated weights for policy 0, policy_version 34191 (0.0015) [2024-08-06 01:56:06,614][52649] DAMAGECOUNT value on done: 244018.0 [2024-08-06 01:56:06,614][52649] Sum rewards: 62.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.472', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.128', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.280', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:07,286][52663] DAMAGECOUNT value on done: 246850.0 [2024-08-06 01:56:07,287][52663] Sum rewards: 65.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.200', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.110', 'weapon4': '0.244', 'AMMO4': '0.252', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.966', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 280117248. Throughput: 0: 4342.7. Samples: 70032550. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 01:56:07,795][52567] Avg episode reward: [(0, '65.657')] [2024-08-06 01:56:07,799][52614] Saving new best policy, reward=65.657! [2024-08-06 01:56:07,970][52647] DAMAGECOUNT value on done: 259754.0 [2024-08-06 01:56:07,971][52647] Sum rewards: 58.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.533', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.196', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.318', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.824', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '53.000'} [2024-08-06 01:56:08,763][52665] DAMAGECOUNT value on done: 251533.0 [2024-08-06 01:56:08,763][52665] Sum rewards: 62.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.958', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.184', 'weapon2': '0.232', 'weapon5': '0.244', 'AMMO4': '0.284', 'weapon4': '0.450', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '53.000'} [2024-08-06 01:56:09,469][52649] DAMAGECOUNT value on done: 242388.0 [2024-08-06 01:56:09,470][52649] Sum rewards: 61.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'AMMO4': '0.146', 'weapon5': '0.148', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.936', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:10,855][52650] Updated weights for policy 0, policy_version 34201 (0.0012) [2024-08-06 01:56:11,097][52647] DAMAGECOUNT value on done: 260034.0 [2024-08-06 01:56:11,097][52647] Sum rewards: 66.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.158', 'AMMO3': '0.194', 'AMMO4': '0.223', 'weapon4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:11,137][52665] DAMAGECOUNT value on done: 249301.0 [2024-08-06 01:56:11,137][52665] Sum rewards: 66.719, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.866', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.190', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '59.000'} [2024-08-06 01:56:12,116][52649] DAMAGECOUNT value on done: 248587.0 [2024-08-06 01:56:12,117][52649] Sum rewards: 67.809, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.392', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.376', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:12,775][52614] Signal inference workers to stop experience collection... (6150 times) [2024-08-06 01:56:12,782][52614] Signal inference workers to resume experience collection... (6150 times) [2024-08-06 01:56:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 280199168. Throughput: 0: 4332.7. Samples: 70058370. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 01:56:12,795][52567] Avg episode reward: [(0, '65.659')] [2024-08-06 01:56:12,861][52614] Saving new best policy, reward=65.659! [2024-08-06 01:56:12,867][52650] InferenceWorker_p0-w0: stopping experience collection (6150 times) [2024-08-06 01:56:12,867][52650] InferenceWorker_p0-w0: resuming experience collection (6150 times) [2024-08-06 01:56:13,860][52647] DAMAGECOUNT value on done: 266183.0 [2024-08-06 01:56:13,860][52647] Sum rewards: 64.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.204', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '53.000'} [2024-08-06 01:56:13,939][52665] DAMAGECOUNT value on done: 247167.0 [2024-08-06 01:56:13,940][52665] Sum rewards: 68.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.042', 'weapon4': '0.096', 'AMMO4': '0.179', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:15,021][52649] DAMAGECOUNT value on done: 248289.0 [2024-08-06 01:56:15,023][52649] Sum rewards: 69.605, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'HEALTH': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.588', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '58.000'} [2024-08-06 01:56:15,848][52650] Updated weights for policy 0, policy_version 34211 (0.0038) [2024-08-06 01:56:16,276][52647] DAMAGECOUNT value on done: 260294.0 [2024-08-06 01:56:16,278][52647] Sum rewards: 62.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.979', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon5': '0.154', 'AMMO3': '0.232', 'weapon4': '0.276', 'AMMO4': '0.281', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.670', 'WEAPON3': '1.300', 'weapon3': '2.624', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '54.000'} [2024-08-06 01:56:17,179][52665] DAMAGECOUNT value on done: 247541.0 [2024-08-06 01:56:17,179][52665] Sum rewards: 53.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.094', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'AMMO4': '0.275', 'weapon2': '0.340', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '47.000'} [2024-08-06 01:56:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17203.1, 300 sec: 17494.8). Total num frames: 280281088. Throughput: 0: 4337.1. Samples: 70071460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:56:17,795][52567] Avg episode reward: [(0, '65.664')] [2024-08-06 01:56:17,810][52614] Saving new best policy, reward=65.664! [2024-08-06 01:56:18,423][52649] DAMAGECOUNT value on done: 251247.0 [2024-08-06 01:56:18,426][52649] Sum rewards: 52.058, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.474', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.246', 'AMMO4': '0.294', 'weapon5': '0.324', 'weapon2': '0.344', 'WEAPON5': '0.450', 'weapon4': '0.492', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.414', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '46.500'} [2024-08-06 01:56:18,697][52647] DAMAGECOUNT value on done: 259756.0 [2024-08-06 01:56:18,697][52647] Sum rewards: 57.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.090', 'AMMO4': '0.204', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.416', 'weapon2': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '50.000'} [2024-08-06 01:56:20,172][52668] DAMAGECOUNT value on done: 247755.0 [2024-08-06 01:56:20,173][52668] Sum rewards: 66.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.586', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.166', 'AMMO4': '0.203', 'weapon2': '0.228', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON3': '1.450', 'weapon3': '2.778', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 01:56:20,204][52667] DAMAGECOUNT value on done: 249833.0 [2024-08-06 01:56:20,205][52667] Sum rewards: 65.583, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.738', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.304', 'weapon4': '0.342', 'WEAPON3': '1.800', 'weapon3': '3.070', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '59.000'} [2024-08-06 01:56:20,406][52665] DAMAGECOUNT value on done: 245783.0 [2024-08-06 01:56:20,407][52665] Sum rewards: 64.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.032', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.512', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.206', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:20,751][52650] Updated weights for policy 0, policy_version 34221 (0.0027) [2024-08-06 01:56:21,365][52647] DAMAGECOUNT value on done: 259523.0 [2024-08-06 01:56:21,366][52647] Sum rewards: 63.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.380', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO4': '0.042', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon5': '0.226', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 280371200. Throughput: 0: 4328.7. Samples: 70097440. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:56:22,794][52567] Avg episode reward: [(0, '65.423')] [2024-08-06 01:56:22,882][52668] DAMAGECOUNT value on done: 256165.0 [2024-08-06 01:56:22,882][52668] Sum rewards: 60.878, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.451', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.266', 'weapon2': '0.320', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.894', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '54.000'} [2024-08-06 01:56:23,046][52667] DAMAGECOUNT value on done: 253000.0 [2024-08-06 01:56:23,046][52667] Sum rewards: 64.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.718', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.091', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:23,531][52665] DAMAGECOUNT value on done: 245520.0 [2024-08-06 01:56:23,531][52665] Sum rewards: 58.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.094', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.308', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '49.000'} [2024-08-06 01:56:23,953][52647] DAMAGECOUNT value on done: 254369.0 [2024-08-06 01:56:23,955][52647] Sum rewards: 54.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.708', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.178', 'weapon2': '0.312', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.046', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '47.000'} [2024-08-06 01:56:25,352][52650] Updated weights for policy 0, policy_version 34231 (0.0032) [2024-08-06 01:56:25,667][52668] DAMAGECOUNT value on done: 254371.0 [2024-08-06 01:56:25,668][52668] Sum rewards: 57.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.238', 'AMMO5': '0.023', 'AMMO2': '0.047', 'weapon5': '0.060', 'weapon4': '0.156', 'AMMO3': '0.181', 'AMMO4': '0.235', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.892', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '48.000'} [2024-08-06 01:56:25,693][52667] DAMAGECOUNT value on done: 252457.0 [2024-08-06 01:56:25,693][52667] Sum rewards: 72.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.062', 'AMMO4': '0.062', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'weapon3': '3.438', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '61.000'} [2024-08-06 01:56:26,475][52647] DAMAGECOUNT value on done: 262996.0 [2024-08-06 01:56:26,475][52647] Sum rewards: 61.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.570', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon4': '0.242', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:26,635][52665] DAMAGECOUNT value on done: 244259.0 [2024-08-06 01:56:26,637][52665] Sum rewards: 62.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.081', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '53.000'} [2024-08-06 01:56:27,251][52795] DAMAGECOUNT value on done: 232611.0 [2024-08-06 01:56:27,252][52795] Sum rewards: 60.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.104', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.830', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '49.000'} [2024-08-06 01:56:27,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 280461312. Throughput: 0: 4332.5. Samples: 70123750. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:56:27,794][52567] Avg episode reward: [(0, '65.075')] [2024-08-06 01:56:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000034236_280461312.pth... [2024-08-06 01:56:27,920][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033724_276267008.pth [2024-08-06 01:56:28,193][52668] DAMAGECOUNT value on done: 255166.0 [2024-08-06 01:56:28,194][52668] Sum rewards: 59.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.157', 'AMMO3': '0.216', 'weapon4': '0.264', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:28,508][52662] DAMAGECOUNT value on done: 257330.0 [2024-08-06 01:56:28,509][52662] Sum rewards: 65.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon5': '0.140', 'weapon4': '0.156', 'AMMO3': '0.218', 'AMMO4': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:28,968][52667] DAMAGECOUNT value on done: 248654.0 [2024-08-06 01:56:28,968][52667] Sum rewards: 61.559, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.800', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.202', 'AMMO3': '0.264', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.882', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '56.000'} [2024-08-06 01:56:29,747][52665] DAMAGECOUNT value on done: 248594.0 [2024-08-06 01:56:29,749][52665] Sum rewards: 78.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon2': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '66.000'} [2024-08-06 01:56:30,018][52650] Updated weights for policy 0, policy_version 34241 (0.0011) [2024-08-06 01:56:30,368][52795] DAMAGECOUNT value on done: 226663.0 [2024-08-06 01:56:30,370][52795] Sum rewards: 51.420, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.148', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.500', 'weapon4': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.648', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.314', 'FRAGCOUNT': '43.000'} [2024-08-06 01:56:30,918][52662] DAMAGECOUNT value on done: 257071.0 [2024-08-06 01:56:30,918][52662] Sum rewards: 66.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.333', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.208', 'weapon2': '0.220', 'AMMO3': '0.224', 'WEAPON4': '0.450', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '56.000'} [2024-08-06 01:56:31,073][52668] DAMAGECOUNT value on done: 244146.0 [2024-08-06 01:56:31,074][52668] Sum rewards: 66.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.014', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.192', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.246', 'weapon4': '0.322', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:31,655][52667] DAMAGECOUNT value on done: 255055.0 [2024-08-06 01:56:31,657][52667] Sum rewards: 66.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.949', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.196', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '53.000'} [2024-08-06 01:56:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 280551424. Throughput: 0: 4343.8. Samples: 70136750. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 01:56:32,794][52567] Avg episode reward: [(0, '64.696')] [2024-08-06 01:56:33,137][52665] DAMAGECOUNT value on done: 247856.0 [2024-08-06 01:56:33,146][52665] Sum rewards: 70.104, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.126', 'weapon4': '0.136', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'HEALTH': '0.333', 'WEAPON4': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:33,462][52662] DAMAGECOUNT value on done: 256184.0 [2024-08-06 01:56:33,464][52662] Sum rewards: 59.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.173', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.236', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '48.000'} [2024-08-06 01:56:33,659][52795] DAMAGECOUNT value on done: 227637.0 [2024-08-06 01:56:33,660][52795] Sum rewards: 70.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.365', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.210', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '59.000'} [2024-08-06 01:56:34,167][52668] DAMAGECOUNT value on done: 253121.0 [2024-08-06 01:56:34,167][52668] Sum rewards: 64.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.153', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.398', 'weapon4': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.676', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:34,734][52650] Updated weights for policy 0, policy_version 34251 (0.0023) [2024-08-06 01:56:34,904][52667] DAMAGECOUNT value on done: 253043.0 [2024-08-06 01:56:34,905][52667] Sum rewards: 77.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.560', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.170', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '66.000'} [2024-08-06 01:56:36,086][52660] DAMAGECOUNT value on done: 247547.0 [2024-08-06 01:56:36,089][52660] Sum rewards: 58.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.319', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.213', 'weapon2': '0.272', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.386', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '49.000'} [2024-08-06 01:56:36,267][52662] DAMAGECOUNT value on done: 246636.0 [2024-08-06 01:56:36,269][52662] Sum rewards: 54.895, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.793', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon4': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '0.850', 'HITCOUNT': '2.730', 'weapon3': '3.168', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '45.000'} [2024-08-06 01:56:36,730][52795] DAMAGECOUNT value on done: 232230.0 [2024-08-06 01:56:36,731][52795] Sum rewards: 81.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.195', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.540', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '68.000'} [2024-08-06 01:56:37,403][52668] DAMAGECOUNT value on done: 251282.0 [2024-08-06 01:56:37,405][52668] Sum rewards: 55.291, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.712', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon4': '0.114', 'weapon5': '0.144', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'weapon2': '0.760', 'WEAPON3': '1.700', 'weapon3': '2.680', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '48.000'} [2024-08-06 01:56:37,582][52667] DAMAGECOUNT value on done: 256238.0 [2024-08-06 01:56:37,583][52667] Sum rewards: 71.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon4': '0.236', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '61.000'} [2024-08-06 01:56:37,620][52665] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:56:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.2, 300 sec: 17494.8). Total num frames: 280633344. Throughput: 0: 4347.3. Samples: 70163050. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:56:37,795][52567] Avg episode reward: [(0, '64.623')] [2024-08-06 01:56:39,251][52660] DAMAGECOUNT value on done: 246287.0 [2024-08-06 01:56:39,254][52660] Sum rewards: 65.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.172', 'AMMO3': '0.243', 'weapon4': '0.264', 'AMMO4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.914', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:39,350][52650] Updated weights for policy 0, policy_version 34261 (0.0027) [2024-08-06 01:56:39,377][52664] DAMAGECOUNT value on done: 257699.0 [2024-08-06 01:56:39,377][52664] Sum rewards: 62.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.435', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.157', 'AMMO3': '0.177', 'weapon4': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:39,672][52662] DAMAGECOUNT value on done: 253297.0 [2024-08-06 01:56:39,673][52662] Sum rewards: 56.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.095', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '47.500'} [2024-08-06 01:56:39,946][52795] DAMAGECOUNT value on done: 235135.0 [2024-08-06 01:56:39,950][52795] Sum rewards: 59.429, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.734', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.088', 'weapon4': '0.164', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.234', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:40,358][52667] DAMAGECOUNT value on done: 249229.0 [2024-08-06 01:56:40,358][52667] Sum rewards: 59.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.056', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon5': '0.178', 'AMMO3': '0.200', 'AMMO4': '0.319', 'weapon2': '0.422', 'weapon4': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '51.000'} [2024-08-06 01:56:40,518][52668] DAMAGECOUNT value on done: 252036.0 [2024-08-06 01:56:40,518][52668] Sum rewards: 62.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.097', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.390', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.212', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '51.500'} [2024-08-06 01:56:42,261][52664] DAMAGECOUNT value on done: 257907.0 [2024-08-06 01:56:42,262][52664] Sum rewards: 57.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.962', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon2': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.504', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '51.000'} [2024-08-06 01:56:42,412][52660] DAMAGECOUNT value on done: 253730.0 [2024-08-06 01:56:42,415][52660] Sum rewards: 66.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.058', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.274', 'AMMO4': '0.291', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:42,755][52667] DAMAGECOUNT value on done: 250190.0 [2024-08-06 01:56:42,756][52667] Sum rewards: 70.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.156', 'AMMO3': '0.166', 'AMMO4': '0.210', 'weapon4': '0.306', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.914', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '59.000'} [2024-08-06 01:56:42,795][52567] Fps is (10 sec: 17201.5, 60 sec: 17476.0, 300 sec: 17522.5). Total num frames: 280723456. Throughput: 0: 4349.9. Samples: 70189190. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:56:42,795][52567] Avg episode reward: [(0, '64.127')] [2024-08-06 01:56:42,801][52662] DAMAGECOUNT value on done: 249828.0 [2024-08-06 01:56:42,801][52662] Sum rewards: 70.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '59.000'} [2024-08-06 01:56:43,068][52795] DAMAGECOUNT value on done: 231949.0 [2024-08-06 01:56:43,068][52795] Sum rewards: 71.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.406', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '60.000'} [2024-08-06 01:56:43,863][52668] DAMAGECOUNT value on done: 251752.0 [2024-08-06 01:56:43,863][52668] Sum rewards: 57.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.025', 'AMMO2': '0.046', 'AMMO3': '0.188', 'AMMO4': '0.230', 'weapon5': '0.234', 'weapon4': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.532', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '47.000'} [2024-08-06 01:56:44,119][52650] Updated weights for policy 0, policy_version 34271 (0.0024) [2024-08-06 01:56:44,553][52664] DAMAGECOUNT value on done: 261282.0 [2024-08-06 01:56:44,553][52664] Sum rewards: 59.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.692', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.130', 'weapon4': '0.220', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:45,507][52660] DAMAGECOUNT value on done: 252715.0 [2024-08-06 01:56:45,508][52660] Sum rewards: 64.906, reward structure: {'DEATHCOUNT': '-11.250', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.167', 'AMMO4': '0.218', 'weapon5': '0.222', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.399', 'weapon2': '0.690', 'WEAPON3': '0.900', 'weapon3': '2.490', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '51.000'} [2024-08-06 01:56:45,549][52667] DAMAGECOUNT value on done: 253661.0 [2024-08-06 01:56:45,549][52667] Sum rewards: 72.939, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.242', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.096', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.264', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '64.000'} [2024-08-06 01:56:45,945][52662] DAMAGECOUNT value on done: 255496.0 [2024-08-06 01:56:45,947][52662] Sum rewards: 68.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.700', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.154', 'AMMO3': '0.157', 'weapon4': '0.198', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:46,187][52795] DAMAGECOUNT value on done: 235575.0 [2024-08-06 01:56:46,189][52795] Sum rewards: 62.740, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.006', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.202', 'AMMO4': '0.237', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.646', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '54.000'} [2024-08-06 01:56:46,838][52668] DAMAGECOUNT value on done: 251185.0 [2024-08-06 01:56:46,839][52668] Sum rewards: 60.473, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.275', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon5': '0.136', 'AMMO3': '0.237', 'AMMO4': '0.287', 'weapon2': '0.310', 'WEAPON5': '0.450', 'weapon4': '0.674', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.528', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '53.500'} [2024-08-06 01:56:47,154][52664] DAMAGECOUNT value on done: 259130.0 [2024-08-06 01:56:47,154][52664] Sum rewards: 68.320, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.370', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.146', 'AMMO4': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.350', 'weapon2': '0.412', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.682', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 01:56:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 280813568. Throughput: 0: 4353.1. Samples: 70202130. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:56:47,794][52567] Avg episode reward: [(0, '64.380')] [2024-08-06 01:56:48,098][52667] DAMAGECOUNT value on done: 253426.0 [2024-08-06 01:56:48,099][52667] Sum rewards: 63.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.046', 'weapon5': '0.080', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:48,498][52660] DAMAGECOUNT value on done: 250613.0 [2024-08-06 01:56:48,498][52660] Sum rewards: 50.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.149', 'AMMO3': '0.223', 'weapon2': '0.404', 'WEAPON3': '1.450', 'HITCOUNT': '2.690', 'weapon3': '3.240', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '45.000'} [2024-08-06 01:56:48,817][52650] Updated weights for policy 0, policy_version 34281 (0.0012) [2024-08-06 01:56:49,123][52662] DAMAGECOUNT value on done: 259434.0 [2024-08-06 01:56:49,125][52662] Sum rewards: 66.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.140', 'AMMO4': '0.148', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '56.000'} [2024-08-06 01:56:49,395][52795] DAMAGECOUNT value on done: 232976.0 [2024-08-06 01:56:49,396][52795] Sum rewards: 69.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '58.000'} [2024-08-06 01:56:49,922][52668] DAMAGECOUNT value on done: 252551.0 [2024-08-06 01:56:49,922][52668] Sum rewards: 57.437, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.522', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.082', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.274', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '51.000'} [2024-08-06 01:56:50,203][52664] DAMAGECOUNT value on done: 259233.0 [2024-08-06 01:56:50,205][52664] Sum rewards: 49.344, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.356', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon5': '0.222', 'AMMO3': '0.226', 'weapon4': '0.238', 'weapon2': '0.252', 'AMMO4': '0.321', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '2.978', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '44.000'} [2024-08-06 01:56:51,072][52669] DAMAGECOUNT value on done: 253486.0 [2024-08-06 01:56:51,073][52669] Sum rewards: 66.371, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.086', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.315', 'weapon2': '0.412', 'WEAPON3': '1.800', 'weapon3': '3.216', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '59.000'} [2024-08-06 01:56:51,134][52667] DAMAGECOUNT value on done: 253563.0 [2024-08-06 01:56:51,134][52667] Sum rewards: 70.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '60.500'} [2024-08-06 01:56:51,536][52660] DAMAGECOUNT value on done: 247092.0 [2024-08-06 01:56:51,536][52660] Sum rewards: 60.761, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO5': '0.004', 'weapon5': '0.028', 'AMMO2': '0.039', 'AMMO3': '0.099', 'WEAPON5': '0.100', 'AMMO4': '0.197', 'WEAPON4': '0.450', 'weapon4': '0.558', 'weapon2': '0.684', 'WEAPON3': '0.700', 'weapon3': '2.598', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '49.000'} [2024-08-06 01:56:51,963][52662] DAMAGECOUNT value on done: 251319.0 [2024-08-06 01:56:51,964][52662] Sum rewards: 63.327, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.182', 'weapon2': '0.198', 'AMMO3': '0.229', 'AMMO4': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.006', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:52,485][52795] DAMAGECOUNT value on done: 230514.0 [2024-08-06 01:56:52,486][52795] Sum rewards: 63.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.681', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.450', 'weapon4': '0.452', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '53.000'} [2024-08-06 01:56:52,680][52668] DAMAGECOUNT value on done: 249058.0 [2024-08-06 01:56:52,681][52668] Sum rewards: 63.234, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.264', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon2': '0.182', 'weapon5': '0.186', 'AMMO4': '0.206', 'weapon4': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:52,725][52664] DAMAGECOUNT value on done: 260315.0 [2024-08-06 01:56:52,728][52664] Sum rewards: 74.618, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.458', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.161', 'weapon2': '0.192', 'weapon4': '0.384', 'WEAPON3': '1.000', 'weapon3': '3.190', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '59.000'} [2024-08-06 01:56:52,794][52567] Fps is (10 sec: 18023.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 280903680. Throughput: 0: 4360.2. Samples: 70228760. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 01:56:52,794][52567] Avg episode reward: [(0, '64.244')] [2024-08-06 01:56:53,503][52650] Updated weights for policy 0, policy_version 34291 (0.0012) [2024-08-06 01:56:54,076][52669] DAMAGECOUNT value on done: 248341.0 [2024-08-06 01:56:54,076][52669] Sum rewards: 70.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.716', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.178', 'weapon4': '0.188', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.088', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '63.000'} [2024-08-06 01:56:54,112][52667] DAMAGECOUNT value on done: 253170.0 [2024-08-06 01:56:54,112][52667] Sum rewards: 57.163, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.638', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon4': '0.280', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '50.000'} [2024-08-06 01:56:54,115][52660] DAMAGECOUNT value on done: 253762.0 [2024-08-06 01:56:54,116][52660] Sum rewards: 64.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.158', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.318', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.216', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:55,137][52662] DAMAGECOUNT value on done: 263141.0 [2024-08-06 01:56:55,138][52662] Sum rewards: 78.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.766', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.096', 'AMMO4': '0.108', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '66.000'} [2024-08-06 01:56:55,176][52664] DAMAGECOUNT value on done: 264585.0 [2024-08-06 01:56:55,176][52664] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.157', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'HEALTH': '0.272', 'weapon2': '0.586', 'WEAPON3': '0.950', 'weapon3': '2.748', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '49.500'} [2024-08-06 01:56:55,338][52668] DAMAGECOUNT value on done: 241888.0 [2024-08-06 01:56:55,338][52668] Sum rewards: 63.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.140', 'AMMO3': '0.204', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '55.000'} [2024-08-06 01:56:55,563][52795] DAMAGECOUNT value on done: 236508.0 [2024-08-06 01:56:55,565][52795] Sum rewards: 56.744, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.060', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.236', 'AMMO3': '0.285', 'weapon2': '0.436', 'WEAPON4': '0.550', 'weapon4': '0.664', 'WEAPON3': '1.650', 'weapon3': '2.512', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:56,836][52660] DAMAGECOUNT value on done: 256197.0 [2024-08-06 01:56:56,836][52660] Sum rewards: 71.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.438', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.472', 'weapon2': '0.774', 'WEAPON3': '0.900', 'weapon3': '2.504', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '57.000'} [2024-08-06 01:56:57,021][52667] DAMAGECOUNT value on done: 247649.0 [2024-08-06 01:56:57,021][52667] Sum rewards: 58.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.205', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.128', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'weapon4': '0.414', 'weapon2': '0.418', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '50.000'} [2024-08-06 01:56:57,090][52669] DAMAGECOUNT value on done: 253965.0 [2024-08-06 01:56:57,091][52669] Sum rewards: 62.255, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.346', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.186', 'AMMO3': '0.210', 'AMMO4': '0.223', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.658', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '52.000'} [2024-08-06 01:56:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 280985600. Throughput: 0: 4370.4. Samples: 70255040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:56:57,794][52567] Avg episode reward: [(0, '64.166')] [2024-08-06 01:56:57,956][52650] Updated weights for policy 0, policy_version 34301 (0.0025) [2024-08-06 01:56:58,064][52662] DAMAGECOUNT value on done: 252690.0 [2024-08-06 01:56:58,064][52662] Sum rewards: 57.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.204', 'weapon5': '0.258', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.536', 'weapon4': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.368', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '48.500'} [2024-08-06 01:56:58,094][52664] DAMAGECOUNT value on done: 255439.0 [2024-08-06 01:56:58,097][52664] Sum rewards: 66.636, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.102', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.486', 'WEAPON3': '1.500', 'weapon3': '2.906', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 01:56:58,333][52668] DAMAGECOUNT value on done: 244891.0 [2024-08-06 01:56:58,335][52668] Sum rewards: 55.673, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.233', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon4': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.888', 'WEAPON3': '0.900', 'weapon3': '2.696', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '12.879', 'FRAGCOUNT': '44.000'} [2024-08-06 01:56:58,352][52794] DAMAGECOUNT value on done: 253970.0 [2024-08-06 01:56:58,354][52794] Sum rewards: 69.140, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.044', 'AMMO4': '0.170', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.394', 'WEAPON4': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '56.000'} [2024-08-06 01:56:58,647][52795] DAMAGECOUNT value on done: 232697.0 [2024-08-06 01:56:58,647][52795] Sum rewards: 59.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.988', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.124', 'weapon5': '0.178', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.550', 'weapon2': '0.618', 'WEAPON3': '0.800', 'weapon3': '2.430', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '47.000'} [2024-08-06 01:56:59,094][52660] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:56:59,118][52820] Large shaping reward 3.632 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:56:59,715][52667] DAMAGECOUNT value on done: 257269.0 [2024-08-06 01:56:59,716][52667] Sum rewards: 50.913, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.040', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.080', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.217', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '1.190', 'weapon3': '2.138', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '39.000'} [2024-08-06 01:56:59,816][52669] DAMAGECOUNT value on done: 250950.0 [2024-08-06 01:56:59,817][52669] Sum rewards: 50.352, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'AMMO4': '0.210', 'weapon4': '0.262', 'weapon2': '0.438', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.014', 'DAMAGECOUNT': '12.681', 'FRAGCOUNT': '42.000'} [2024-08-06 01:57:00,001][52660] DAMAGECOUNT value on done: 255011.0 [2024-08-06 01:57:00,002][52660] Sum rewards: 63.293, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.906', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:01,180][52662] DAMAGECOUNT value on done: 252721.0 [2024-08-06 01:57:01,182][52662] Sum rewards: 62.348, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.047', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO4': '0.237', 'AMMO3': '0.291', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:01,290][52664] DAMAGECOUNT value on done: 268116.0 [2024-08-06 01:57:01,290][52664] Sum rewards: 66.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.894', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.237', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:01,321][52668] DAMAGECOUNT value on done: 246738.0 [2024-08-06 01:57:01,323][52668] Sum rewards: 71.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.020', 'AMMO2': '0.030', 'weapon4': '0.124', 'AMMO4': '0.151', 'weapon5': '0.222', 'AMMO3': '0.239', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '63.000'} [2024-08-06 01:57:01,502][52794] DAMAGECOUNT value on done: 257881.0 [2024-08-06 01:57:01,502][52794] Sum rewards: 72.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'AMMO5': '0.008', 'weapon5': '0.032', 'AMMO2': '0.046', 'weapon4': '0.084', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '62.000'} [2024-08-06 01:57:01,604][52671] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:57:01,872][52795] DAMAGECOUNT value on done: 230423.0 [2024-08-06 01:57:01,873][52795] Sum rewards: 63.473, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.054', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:02,104][52803] DAMAGECOUNT value on done: 234554.0 [2024-08-06 01:57:02,104][52803] Sum rewards: 59.071, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.520', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.154', 'AMMO4': '0.229', 'weapon4': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.028', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:02,486][52660] DAMAGECOUNT value on done: 248567.0 [2024-08-06 01:57:02,488][52660] Sum rewards: 68.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.117', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.360', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.852', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:02,728][52669] DAMAGECOUNT value on done: 248595.0 [2024-08-06 01:57:02,728][52669] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.917', 'AMMO5': '0.007', 'AMMO2': '0.069', 'weapon5': '0.106', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon4': '0.304', 'AMMO4': '0.343', 'weapon2': '0.392', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.916', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 281067520. Throughput: 0: 4370.9. Samples: 70268150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:57:02,795][52567] Avg episode reward: [(0, '63.683')] [2024-08-06 01:57:02,833][52650] Updated weights for policy 0, policy_version 34311 (0.0030) [2024-08-06 01:57:03,002][52667] DAMAGECOUNT value on done: 260796.0 [2024-08-06 01:57:03,003][52667] Sum rewards: 60.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.886', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.116', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'weapon2': '0.424', 'weapon4': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.726', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:03,971][52664] DAMAGECOUNT value on done: 260470.0 [2024-08-06 01:57:03,972][52664] Sum rewards: 64.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.625', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.360', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '53.500'} [2024-08-06 01:57:03,977][52668] DAMAGECOUNT value on done: 249421.0 [2024-08-06 01:57:03,977][52668] Sum rewards: 55.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.040', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon5': '0.206', 'weapon2': '0.276', 'WEAPON4': '0.450', 'weapon4': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '46.000'} [2024-08-06 01:57:04,275][52662] DAMAGECOUNT value on done: 252467.0 [2024-08-06 01:57:04,275][52662] Sum rewards: 64.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.687', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'weapon2': '0.226', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:04,531][52794] DAMAGECOUNT value on done: 253628.0 [2024-08-06 01:57:04,533][52794] Sum rewards: 84.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.534', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon5': '0.190', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '68.000'} [2024-08-06 01:57:05,056][52795] DAMAGECOUNT value on done: 228844.0 [2024-08-06 01:57:05,058][52795] Sum rewards: 61.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.327', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.282', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:05,316][52803] DAMAGECOUNT value on done: 234063.0 [2024-08-06 01:57:05,316][52803] Sum rewards: 57.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'weapon2': '0.176', 'AMMO3': '0.196', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.438', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '48.000'} [2024-08-06 01:57:05,358][52660] DAMAGECOUNT value on done: 257655.0 [2024-08-06 01:57:05,358][52660] Sum rewards: 71.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '60.000'} [2024-08-06 01:57:05,655][52669] DAMAGECOUNT value on done: 250583.0 [2024-08-06 01:57:05,658][52669] Sum rewards: 69.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.386', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.148', 'AMMO4': '0.209', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.776', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:05,672][52667] DAMAGECOUNT value on done: 255749.0 [2024-08-06 01:57:05,676][52667] Sum rewards: 69.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.850', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:06,741][52664] DAMAGECOUNT value on done: 263102.0 [2024-08-06 01:57:06,741][52664] Sum rewards: 63.478, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.966', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon2': '0.214', 'weapon5': '0.246', 'AMMO3': '0.287', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.758', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:06,795][52658] DAMAGECOUNT value on done: 254338.0 [2024-08-06 01:57:06,796][52658] Sum rewards: 54.190, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.754', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.194', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.016', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '47.000'} [2024-08-06 01:57:06,855][52668] DAMAGECOUNT value on done: 249008.0 [2024-08-06 01:57:06,855][52668] Sum rewards: 67.151, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.645', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.073', 'weapon2': '0.268', 'AMMO3': '0.279', 'WEAPON3': '1.750', 'HITCOUNT': '3.230', 'weapon3': '3.414', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 01:57:07,066][52662] DAMAGECOUNT value on done: 259449.0 [2024-08-06 01:57:07,067][52662] Sum rewards: 72.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.065', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.169', 'AMMO4': '0.172', 'weapon5': '0.188', 'weapon2': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.416', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:07,302][52650] Updated weights for policy 0, policy_version 34321 (0.0016) [2024-08-06 01:57:07,326][52794] DAMAGECOUNT value on done: 252584.0 [2024-08-06 01:57:07,326][52794] Sum rewards: 52.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.323', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.470', 'WEAPON3': '0.900', 'HITCOUNT': '2.670', 'weapon3': '3.180', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '44.000'} [2024-08-06 01:57:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 281165824. Throughput: 0: 4367.3. Samples: 70293970. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:57:07,795][52567] Avg episode reward: [(0, '63.839')] [2024-08-06 01:57:08,181][52669] DAMAGECOUNT value on done: 252639.0 [2024-08-06 01:57:08,181][52669] Sum rewards: 54.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.225', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.147', 'weapon2': '0.154', 'weapon4': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.400', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '47.000'} [2024-08-06 01:57:08,228][52795] DAMAGECOUNT value on done: 231959.0 [2024-08-06 01:57:08,229][52795] Sum rewards: 71.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.140', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '61.000'} [2024-08-06 01:57:08,393][52803] DAMAGECOUNT value on done: 234056.0 [2024-08-06 01:57:08,393][52803] Sum rewards: 61.934, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.138', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.436', 'weapon2': '0.478', 'WEAPON3': '0.850', 'weapon3': '2.760', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '48.500'} [2024-08-06 01:57:08,440][52660] DAMAGECOUNT value on done: 241434.0 [2024-08-06 01:57:08,441][52660] Sum rewards: 67.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.204', 'weapon4': '0.252', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:08,443][52811] DAMAGECOUNT value on done: 244521.0 [2024-08-06 01:57:08,444][52811] Sum rewards: 59.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.157', 'AMMO3': '0.218', 'weapon2': '0.324', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:08,718][52667] DAMAGECOUNT value on done: 257524.0 [2024-08-06 01:57:08,719][52667] Sum rewards: 66.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.024', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:08,972][52658] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:57:09,378][52664] DAMAGECOUNT value on done: 259995.0 [2024-08-06 01:57:09,378][52664] Sum rewards: 60.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.009', 'AMMO2': '0.067', 'weapon5': '0.116', 'AMMO3': '0.229', 'weapon4': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.276', 'AMMO4': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '51.500'} [2024-08-06 01:57:09,684][52658] DAMAGECOUNT value on done: 255008.0 [2024-08-06 01:57:09,686][52658] Sum rewards: 61.777, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.795', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.154', 'AMMO3': '0.208', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:09,989][52662] DAMAGECOUNT value on done: 254410.0 [2024-08-06 01:57:09,990][52662] Sum rewards: 73.005, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.308', 'HEALTH': '0.432', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.962', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:10,020][52668] DAMAGECOUNT value on done: 251397.0 [2024-08-06 01:57:10,020][52668] Sum rewards: 63.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.318', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.134', 'AMMO3': '0.216', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.356', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:10,390][52794] DAMAGECOUNT value on done: 250356.0 [2024-08-06 01:57:10,390][52794] Sum rewards: 60.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.094', 'AMMO4': '0.103', 'weapon5': '0.134', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:10,611][52669] DAMAGECOUNT value on done: 251363.0 [2024-08-06 01:57:10,612][52669] Sum rewards: 65.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.494', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.207', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.290', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:11,411][52667] DAMAGECOUNT value on done: 247745.0 [2024-08-06 01:57:11,412][52667] Sum rewards: 61.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.570', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.194', 'weapon4': '0.196', 'AMMO4': '0.197', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '52.500'} [2024-08-06 01:57:11,422][52795] DAMAGECOUNT value on done: 224406.0 [2024-08-06 01:57:11,438][52795] Sum rewards: 65.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.050', 'weapon4': '0.164', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:11,608][52811] DAMAGECOUNT value on done: 233068.0 [2024-08-06 01:57:11,610][52811] Sum rewards: 66.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.571', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.028', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:11,618][52803] DAMAGECOUNT value on done: 235862.0 [2024-08-06 01:57:11,619][52803] Sum rewards: 65.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.191', 'weapon5': '0.208', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.486', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:11,658][52660] DAMAGECOUNT value on done: 247670.0 [2024-08-06 01:57:11,659][52660] Sum rewards: 64.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.164', 'weapon5': '0.198', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.000', 'weapon3': '2.754', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '52.500'} [2024-08-06 01:57:11,993][52650] Updated weights for policy 0, policy_version 34331 (0.0025) [2024-08-06 01:57:12,224][52664] DAMAGECOUNT value on done: 263191.0 [2024-08-06 01:57:12,225][52664] Sum rewards: 64.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.475', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.198', 'weapon5': '0.292', 'weapon4': '0.348', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.630', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:12,725][52658] DAMAGECOUNT value on done: 254205.0 [2024-08-06 01:57:12,725][52658] Sum rewards: 60.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.668', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.252', 'weapon2': '0.294', 'WEAPON3': '1.600', 'weapon3': '3.226', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 281247744. Throughput: 0: 4369.3. Samples: 70320370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:57:12,795][52567] Avg episode reward: [(0, '64.004')] [2024-08-06 01:57:12,933][52662] DAMAGECOUNT value on done: 261961.0 [2024-08-06 01:57:12,933][52662] Sum rewards: 72.173, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.172', 'HEALTH': '0.189', 'AMMO3': '0.208', 'weapon2': '0.208', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:13,047][52668] DAMAGECOUNT value on done: 254653.0 [2024-08-06 01:57:13,049][52668] Sum rewards: 69.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.128', 'weapon5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.676', 'WEAPON3': '1.400', 'weapon3': '2.770', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:13,117][52669] DAMAGECOUNT value on done: 252688.0 [2024-08-06 01:57:13,120][52669] Sum rewards: 61.289, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.522', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.056', 'weapon5': '0.082', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.258', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:13,292][52794] DAMAGECOUNT value on done: 253086.0 [2024-08-06 01:57:13,292][52794] Sum rewards: 65.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.088', 'weapon5': '0.094', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.216', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:14,192][52667] DAMAGECOUNT value on done: 254383.0 [2024-08-06 01:57:14,194][52667] Sum rewards: 64.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.042', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.326', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:14,633][52660] DAMAGECOUNT value on done: 256488.0 [2024-08-06 01:57:14,633][52660] Sum rewards: 55.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'AMMO4': '0.241', 'weapon4': '0.452', 'weapon2': '0.490', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:14,663][52811] DAMAGECOUNT value on done: 234384.0 [2024-08-06 01:57:14,664][52811] Sum rewards: 72.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.582', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.166', 'weapon2': '0.202', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '64.000'} [2024-08-06 01:57:14,706][52795] DAMAGECOUNT value on done: 238245.0 [2024-08-06 01:57:14,707][52795] Sum rewards: 60.824, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.555', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.140', 'weapon2': '0.204', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.062', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:14,769][52803] DAMAGECOUNT value on done: 236973.0 [2024-08-06 01:57:14,769][52803] Sum rewards: 55.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.745', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '45.000'} [2024-08-06 01:57:15,207][52664] DAMAGECOUNT value on done: 260102.0 [2024-08-06 01:57:15,207][52664] Sum rewards: 63.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.139', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.149', 'weapon5': '0.190', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.870', 'WEAPON3': '0.900', 'weapon3': '2.040', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:15,462][52658] DAMAGECOUNT value on done: 253738.0 [2024-08-06 01:57:15,463][52658] Sum rewards: 70.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.776', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.266', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.192', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:15,604][52669] DAMAGECOUNT value on done: 248007.0 [2024-08-06 01:57:15,606][52669] Sum rewards: 68.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.138', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon2': '0.198', 'AMMO3': '0.204', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.412', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:15,825][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:57:16,074][52662] DAMAGECOUNT value on done: 253905.0 [2024-08-06 01:57:16,074][52662] Sum rewards: 62.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.469', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.166', 'AMMO3': '0.169', 'weapon4': '0.248', 'weapon2': '0.260', 'AMMO4': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '51.500'} [2024-08-06 01:57:16,083][52668] DAMAGECOUNT value on done: 250673.0 [2024-08-06 01:57:16,083][52668] Sum rewards: 58.224, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.146', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.260', 'weapon2': '0.594', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '2.858', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '47.000'} [2024-08-06 01:57:16,403][52794] DAMAGECOUNT value on done: 257287.0 [2024-08-06 01:57:16,403][52794] Sum rewards: 69.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:16,844][52650] Updated weights for policy 0, policy_version 34341 (0.0021) [2024-08-06 01:57:17,355][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:57:17,566][52660] DAMAGECOUNT value on done: 260926.0 [2024-08-06 01:57:17,566][52660] Sum rewards: 53.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.372', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon5': '0.068', 'AMMO4': '0.082', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.088', 'DAMAGECOUNT': '13.644', 'FRAGCOUNT': '47.500'} [2024-08-06 01:57:17,697][52664] DAMAGECOUNT value on done: 264137.0 [2024-08-06 01:57:17,699][52664] Sum rewards: 62.945, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.271', 'weapon2': '0.374', 'WEAPON3': '1.600', 'HITCOUNT': '3.350', 'weapon3': '3.428', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:17,777][52811] DAMAGECOUNT value on done: 233385.0 [2024-08-06 01:57:17,778][52811] Sum rewards: 66.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.694', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.148', 'AMMO4': '0.199', 'AMMO3': '0.209', 'weapon4': '0.220', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 281337856. Throughput: 0: 4373.8. Samples: 70333570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 01:57:17,794][52567] Avg episode reward: [(0, '63.930')] [2024-08-06 01:57:17,807][52795] DAMAGECOUNT value on done: 235128.0 [2024-08-06 01:57:17,809][52795] Sum rewards: 60.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.488', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:18,013][52803] DAMAGECOUNT value on done: 237026.0 [2024-08-06 01:57:18,013][52803] Sum rewards: 75.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.046', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.198', 'weapon2': '0.210', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'weapon3': '3.470', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '65.000'} [2024-08-06 01:57:18,137][52658] DAMAGECOUNT value on done: 254081.0 [2024-08-06 01:57:18,139][52658] Sum rewards: 62.858, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.285', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.156', 'weapon4': '0.228', 'AMMO3': '0.238', 'AMMO4': '0.284', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:18,251][52669] DAMAGECOUNT value on done: 253991.0 [2024-08-06 01:57:18,254][52669] Sum rewards: 74.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.492', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.144', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '3.276', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '60.000'} [2024-08-06 01:57:19,225][52662] DAMAGECOUNT value on done: 255038.0 [2024-08-06 01:57:19,225][52662] Sum rewards: 63.522, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon2': '0.472', 'HEALTH': '0.760', 'WEAPON3': '0.800', 'HITCOUNT': '3.150', 'weapon3': '3.270', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '49.000'} [2024-08-06 01:57:19,392][52794] DAMAGECOUNT value on done: 252818.0 [2024-08-06 01:57:19,392][52794] Sum rewards: 67.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.650', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.106', 'AMMO3': '0.150', 'weapon4': '0.212', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '3.010', 'weapon3': '3.068', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:20,173][52664] DAMAGECOUNT value on done: 257585.0 [2024-08-06 01:57:20,174][52664] Sum rewards: 60.916, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'HEALTH': '0.024', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '2.780', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:20,434][52660] DAMAGECOUNT value on done: 246722.0 [2024-08-06 01:57:20,435][52660] Sum rewards: 66.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.290', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.128', 'AMMO4': '0.133', 'weapon5': '0.180', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.714', 'WEAPON3': '1.400', 'weapon3': '2.738', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:20,801][52811] DAMAGECOUNT value on done: 234279.0 [2024-08-06 01:57:20,802][52811] Sum rewards: 62.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.138', 'AMMO4': '0.172', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:20,857][52795] DAMAGECOUNT value on done: 225456.0 [2024-08-06 01:57:20,858][52795] Sum rewards: 65.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'AMMO4': '0.203', 'WEAPON4': '0.400', 'weapon4': '0.434', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:20,866][52658] DAMAGECOUNT value on done: 251377.0 [2024-08-06 01:57:20,867][52658] Sum rewards: 65.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.546', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.434', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.224', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:20,954][52669] DAMAGECOUNT value on done: 253216.0 [2024-08-06 01:57:20,956][52669] Sum rewards: 54.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.285', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.122', 'AMMO4': '0.207', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.458', 'weapon2': '0.654', 'WEAPON3': '1.450', 'HITCOUNT': '2.500', 'weapon3': '2.540', 'DAMAGECOUNT': '13.818', 'FRAGCOUNT': '48.000'} [2024-08-06 01:57:21,066][52803] DAMAGECOUNT value on done: 232266.0 [2024-08-06 01:57:21,066][52803] Sum rewards: 57.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.224', 'weapon2': '0.616', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.140', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '49.000'} [2024-08-06 01:57:21,550][52650] Updated weights for policy 0, policy_version 34351 (0.0017) [2024-08-06 01:57:21,942][52662] DAMAGECOUNT value on done: 253256.0 [2024-08-06 01:57:21,944][52662] Sum rewards: 73.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.214', 'WEAPON3': '1.300', 'weapon3': '3.430', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '61.000'} [2024-08-06 01:57:22,120][52794] DAMAGECOUNT value on done: 258533.0 [2024-08-06 01:57:22,122][52794] Sum rewards: 70.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.234', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 281419776. Throughput: 0: 4372.2. Samples: 70359800. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:57:22,802][52567] Avg episode reward: [(0, '64.261')] [2024-08-06 01:57:22,912][52664] DAMAGECOUNT value on done: 262285.0 [2024-08-06 01:57:22,914][52664] Sum rewards: 64.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.016', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.078', 'AMMO3': '0.204', 'weapon4': '0.214', 'WEAPON5': '0.250', 'AMMO4': '0.280', 'WEAPON4': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:22,936][52811] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:57:23,454][52669] DAMAGECOUNT value on done: 250004.0 [2024-08-06 01:57:23,455][52669] Sum rewards: 51.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'weapon5': '0.050', 'AMMO2': '0.050', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.190', 'AMMO4': '0.251', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.232', 'DAMAGECOUNT': '12.678', 'FRAGCOUNT': '45.000'} [2024-08-06 01:57:23,613][52660] DAMAGECOUNT value on done: 252320.0 [2024-08-06 01:57:23,617][52660] Sum rewards: 66.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.058', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.150', 'weapon4': '0.278', 'AMMO3': '0.279', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:23,774][52658] DAMAGECOUNT value on done: 259525.0 [2024-08-06 01:57:23,774][52658] Sum rewards: 64.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.146', 'AMMO3': '0.198', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:23,924][52811] DAMAGECOUNT value on done: 240490.0 [2024-08-06 01:57:23,924][52811] Sum rewards: 65.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.125', 'weapon4': '0.184', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:24,105][52795] DAMAGECOUNT value on done: 238584.0 [2024-08-06 01:57:24,105][52795] Sum rewards: 54.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.816', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.132', 'weapon4': '0.184', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '2.966', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '46.000'} [2024-08-06 01:57:24,147][52803] DAMAGECOUNT value on done: 230871.0 [2024-08-06 01:57:24,148][52803] Sum rewards: 70.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.762', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.104', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:24,623][52662] DAMAGECOUNT value on done: 249239.0 [2024-08-06 01:57:24,627][52662] Sum rewards: 59.070, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.074', 'weapon4': '0.176', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:24,829][52794] DAMAGECOUNT value on done: 254932.0 [2024-08-06 01:57:24,834][52794] Sum rewards: 65.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.797', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.072', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.240', 'AMMO4': '0.244', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:25,793][52664] DAMAGECOUNT value on done: 262978.0 [2024-08-06 01:57:25,793][52664] Sum rewards: 61.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.908', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.176', 'AMMO3': '0.200', 'AMMO4': '0.261', 'weapon4': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:25,864][52669] DAMAGECOUNT value on done: 254632.0 [2024-08-06 01:57:25,865][52669] Sum rewards: 66.334, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.834', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.145', 'weapon5': '0.186', 'AMMO4': '0.226', 'weapon2': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.742', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:26,181][52650] Updated weights for policy 0, policy_version 34361 (0.0012) [2024-08-06 01:57:26,415][52660] DAMAGECOUNT value on done: 242706.0 [2024-08-06 01:57:26,418][52660] Sum rewards: 64.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'weapon2': '0.146', 'AMMO4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.296', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:26,665][52658] DAMAGECOUNT value on done: 246499.0 [2024-08-06 01:57:26,666][52658] Sum rewards: 63.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.146', 'AMMO3': '0.161', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.804', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:26,973][52811] DAMAGECOUNT value on done: 235172.0 [2024-08-06 01:57:26,976][52811] Sum rewards: 65.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.651', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.054', 'weapon5': '0.090', 'weapon4': '0.104', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'AMMO4': '0.270', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.308', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:27,198][52795] DAMAGECOUNT value on done: 237539.0 [2024-08-06 01:57:27,198][52795] Sum rewards: 66.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.873', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.161', 'weapon2': '0.192', 'AMMO3': '0.230', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:27,350][52803] DAMAGECOUNT value on done: 234236.0 [2024-08-06 01:57:27,353][52803] Sum rewards: 58.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO3': '0.239', 'weapon2': '0.538', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.052', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:27,773][52794] DAMAGECOUNT value on done: 253714.0 [2024-08-06 01:57:27,773][52794] Sum rewards: 70.008, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.074', 'weapon4': '0.084', 'AMMO4': '0.129', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 281509888. Throughput: 0: 4374.3. Samples: 70386030. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:57:27,794][52567] Avg episode reward: [(0, '63.876')] [2024-08-06 01:57:28,681][52664] DAMAGECOUNT value on done: 260301.0 [2024-08-06 01:57:28,681][52664] Sum rewards: 67.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.131', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.225', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:28,975][52669] DAMAGECOUNT value on done: 255888.0 [2024-08-06 01:57:28,977][52669] Sum rewards: 59.707, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.394', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.286', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:29,437][52660] DAMAGECOUNT value on done: 251861.0 [2024-08-06 01:57:29,438][52660] Sum rewards: 65.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.338', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.247', 'weapon2': '0.454', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.262', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:29,670][52658] DAMAGECOUNT value on done: 258314.0 [2024-08-06 01:57:29,671][52658] Sum rewards: 72.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.568', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.216', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '60.000'} [2024-08-06 01:57:30,053][52811] DAMAGECOUNT value on done: 235473.0 [2024-08-06 01:57:30,055][52811] Sum rewards: 81.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.108', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.262', 'WEAPON3': '1.000', 'weapon3': '3.120', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '64.000'} [2024-08-06 01:57:30,440][52803] DAMAGECOUNT value on done: 231687.0 [2024-08-06 01:57:30,444][52803] Sum rewards: 47.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.950', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO4': '0.182', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '3.042', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '39.000'} [2024-08-06 01:57:30,452][52794] DAMAGECOUNT value on done: 252506.0 [2024-08-06 01:57:30,454][52794] Sum rewards: 63.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.162', 'AMMO3': '0.280', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:31,020][52650] Updated weights for policy 0, policy_version 34371 (0.0011) [2024-08-06 01:57:31,178][52664] DAMAGECOUNT value on done: 262411.0 [2024-08-06 01:57:31,181][52664] Sum rewards: 54.883, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.302', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.146', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.490', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.612', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '45.000'} [2024-08-06 01:57:31,534][52669] DAMAGECOUNT value on done: 264723.0 [2024-08-06 01:57:31,534][52669] Sum rewards: 66.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.224', 'weapon5': '0.304', 'weapon2': '0.314', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:32,423][52660] DAMAGECOUNT value on done: 248189.0 [2024-08-06 01:57:32,425][52660] Sum rewards: 72.065, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.185', 'weapon2': '0.212', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '60.000'} [2024-08-06 01:57:32,539][52658] DAMAGECOUNT value on done: 255934.0 [2024-08-06 01:57:32,540][52658] Sum rewards: 55.090, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.210', 'AMMO3': '0.294', 'weapon2': '0.370', 'WEAPON3': '1.750', 'weapon3': '3.058', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 281600000. Throughput: 0: 4384.0. Samples: 70399410. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:57:32,802][52567] Avg episode reward: [(0, '64.267')] [2024-08-06 01:57:32,983][52811] DAMAGECOUNT value on done: 243324.0 [2024-08-06 01:57:32,983][52811] Sum rewards: 58.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.520', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.156', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:32,993][52794] DAMAGECOUNT value on done: 249092.0 [2024-08-06 01:57:32,993][52794] Sum rewards: 51.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.834', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.229', 'weapon4': '0.270', 'WEAPON4': '0.400', 'weapon2': '0.762', 'WEAPON3': '1.400', 'weapon3': '2.642', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '47.000'} [2024-08-06 01:57:33,677][52803] DAMAGECOUNT value on done: 240410.0 [2024-08-06 01:57:33,680][52803] Sum rewards: 69.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.102', 'weapon2': '0.166', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:34,182][52669] DAMAGECOUNT value on done: 250316.0 [2024-08-06 01:57:34,182][52669] Sum rewards: 76.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.178', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '62.000'} [2024-08-06 01:57:34,430][52820] DAMAGECOUNT value on done: 229809.0 [2024-08-06 01:57:34,431][52820] Sum rewards: 53.285, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.142', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.196', 'AMMO3': '0.201', 'AMMO4': '0.314', 'weapon2': '0.322', 'WEAPON5': '0.400', 'weapon4': '0.664', 'WEAPON4': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.446', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '47.000'} [2024-08-06 01:57:35,452][52650] Updated weights for policy 0, policy_version 34381 (0.0019) [2024-08-06 01:57:35,594][52658] DAMAGECOUNT value on done: 259010.0 [2024-08-06 01:57:35,595][52658] Sum rewards: 64.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.310', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'weapon4': '0.280', 'weapon2': '0.584', 'WEAPON3': '0.800', 'weapon3': '3.022', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:35,804][52794] DAMAGECOUNT value on done: 262878.0 [2024-08-06 01:57:35,804][52794] Sum rewards: 63.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.058', 'weapon4': '0.082', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.344', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.280', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:35,881][52666] DAMAGECOUNT value on done: 256963.0 [2024-08-06 01:57:35,884][52666] Sum rewards: 70.457, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.004', 'weapon5': '0.026', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'AMMO4': '0.139', 'HEALTH': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.646', 'WEAPON3': '0.750', 'weapon3': '2.928', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:35,920][52811] DAMAGECOUNT value on done: 236885.0 [2024-08-06 01:57:35,921][52811] Sum rewards: 70.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.755', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.186', 'weapon5': '0.224', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.650', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:36,082][52670] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:57:36,426][52671] DAMAGECOUNT value on done: 256484.0 [2024-08-06 01:57:36,427][52671] Sum rewards: 65.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:36,535][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:57:36,723][52803] DAMAGECOUNT value on done: 237689.0 [2024-08-06 01:57:36,724][52803] Sum rewards: 72.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.443', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'weapon5': '0.278', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:37,035][52669] DAMAGECOUNT value on done: 258405.0 [2024-08-06 01:57:37,037][52669] Sum rewards: 73.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.418', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '63.000'} [2024-08-06 01:57:37,435][52820] DAMAGECOUNT value on done: 233907.0 [2024-08-06 01:57:37,436][52820] Sum rewards: 69.068, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'weapon4': '0.312', 'weapon2': '0.328', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:37,743][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 01:57:37,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 281690112. Throughput: 0: 4379.1. Samples: 70425820. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 01:57:37,802][52567] Avg episode reward: [(0, '64.430')] [2024-08-06 01:57:38,458][52666] DAMAGECOUNT value on done: 255725.0 [2024-08-06 01:57:38,459][52666] Sum rewards: 56.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.182', 'AMMO3': '0.191', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon4': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.576', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '47.000'} [2024-08-06 01:57:38,714][52658] DAMAGECOUNT value on done: 244884.0 [2024-08-06 01:57:38,715][52658] Sum rewards: 69.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.112', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.156', 'AMMO3': '0.159', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.686', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:38,812][52794] DAMAGECOUNT value on done: 248623.0 [2024-08-06 01:57:38,813][52794] Sum rewards: 64.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.682', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.195', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.682', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:38,957][52811] DAMAGECOUNT value on done: 235894.0 [2024-08-06 01:57:38,958][52811] Sum rewards: 45.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.058', 'AMMO3': '0.218', 'weapon5': '0.226', 'AMMO4': '0.288', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.498', 'WEAPON3': '1.400', 'HITCOUNT': '2.600', 'weapon3': '2.656', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '40.000'} [2024-08-06 01:57:39,640][52671] DAMAGECOUNT value on done: 253515.0 [2024-08-06 01:57:39,644][52671] Sum rewards: 65.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.872', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO4': '0.153', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:39,916][52803] DAMAGECOUNT value on done: 235955.0 [2024-08-06 01:57:39,920][52803] Sum rewards: 67.120, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.583', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.488', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:40,003][52650] Updated weights for policy 0, policy_version 34391 (0.0033) [2024-08-06 01:57:40,050][52669] DAMAGECOUNT value on done: 256933.0 [2024-08-06 01:57:40,052][52669] Sum rewards: 70.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.788', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.134', 'AMMO3': '0.198', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:40,050][52820] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:57:40,620][52820] DAMAGECOUNT value on done: 231753.0 [2024-08-06 01:57:40,623][52820] Sum rewards: 60.206, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.125', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.082', 'WEAPON4': '0.150', 'weapon2': '0.158', 'AMMO3': '0.315', 'WEAPON3': '1.850', 'HITCOUNT': '3.160', 'weapon3': '3.494', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:41,226][52666] DAMAGECOUNT value on done: 255541.0 [2024-08-06 01:57:41,228][52666] Sum rewards: 58.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.430', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.178', 'AMMO3': '0.271', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.040', 'weapon3': '3.298', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '53.500'} [2024-08-06 01:57:41,508][52658] DAMAGECOUNT value on done: 253119.0 [2024-08-06 01:57:41,510][52658] Sum rewards: 70.933, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.280', 'AMMO3': '0.301', 'WEAPON3': '1.800', 'weapon3': '3.288', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 01:57:41,947][52794] DAMAGECOUNT value on done: 261156.0 [2024-08-06 01:57:41,950][52811] DAMAGECOUNT value on done: 239219.0 [2024-08-06 01:57:41,950][52794] Sum rewards: 70.083, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.813', 'AMMO5': '0.004', 'weapon4': '0.006', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.258', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.562', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:41,952][52811] Sum rewards: 72.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.392', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '61.000'} [2024-08-06 01:57:42,460][52671] DAMAGECOUNT value on done: 255366.0 [2024-08-06 01:57:42,461][52671] Sum rewards: 73.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.996', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon5': '0.164', 'AMMO3': '0.192', 'AMMO4': '0.277', 'weapon2': '0.324', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '63.000'} [2024-08-06 01:57:42,795][52567] Fps is (10 sec: 17201.1, 60 sec: 17476.2, 300 sec: 17494.7). Total num frames: 281772032. Throughput: 0: 4383.0. Samples: 70452280. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:57:42,804][52567] Avg episode reward: [(0, '64.563')] [2024-08-06 01:57:42,909][52669] DAMAGECOUNT value on done: 259950.0 [2024-08-06 01:57:42,912][52669] Sum rewards: 67.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.748', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.132', 'weapon2': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:43,052][52803] DAMAGECOUNT value on done: 239398.0 [2024-08-06 01:57:43,052][52803] Sum rewards: 55.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.548', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.258', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '46.000'} [2024-08-06 01:57:43,696][52820] DAMAGECOUNT value on done: 225168.0 [2024-08-06 01:57:43,702][52820] Sum rewards: 76.014, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon4': '0.304', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '63.000'} [2024-08-06 01:57:43,897][52666] DAMAGECOUNT value on done: 250641.0 [2024-08-06 01:57:43,899][52666] Sum rewards: 66.620, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.688', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.244', 'AMMO3': '0.258', 'weapon4': '0.408', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.712', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:44,391][52670] DAMAGECOUNT value on done: 248899.0 [2024-08-06 01:57:44,391][52670] Sum rewards: 64.134, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.108', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.082', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'weapon2': '0.266', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.262', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:44,510][52658] DAMAGECOUNT value on done: 252038.0 [2024-08-06 01:57:44,510][52658] Sum rewards: 65.624, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.410', 'weapon2': '0.534', 'HEALTH': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.800', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:44,567][52650] Updated weights for policy 0, policy_version 34401 (0.0014) [2024-08-06 01:57:45,110][52811] DAMAGECOUNT value on done: 234304.0 [2024-08-06 01:57:45,112][52811] Sum rewards: 77.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.076', 'weapon4': '0.106', 'weapon2': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON3': '1.300', 'weapon3': '3.516', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '63.000'} [2024-08-06 01:57:45,305][52794] DAMAGECOUNT value on done: 255384.0 [2024-08-06 01:57:45,306][52794] Sum rewards: 54.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.674', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.232', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.062', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '44.000'} [2024-08-06 01:57:45,492][52671] DAMAGECOUNT value on done: 251618.0 [2024-08-06 01:57:45,492][52671] Sum rewards: 81.783, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.134', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '68.000'} [2024-08-06 01:57:46,196][52803] DAMAGECOUNT value on done: 237048.0 [2024-08-06 01:57:46,197][52803] Sum rewards: 78.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.366', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '67.000'} [2024-08-06 01:57:46,823][52820] DAMAGECOUNT value on done: 234478.0 [2024-08-06 01:57:46,824][52820] Sum rewards: 59.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon7': '0.060', 'weapon5': '0.082', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.484', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '49.000'} [2024-08-06 01:57:47,002][52666] DAMAGECOUNT value on done: 247025.0 [2024-08-06 01:57:47,003][52666] Sum rewards: 65.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:47,486][52658] DAMAGECOUNT value on done: 246816.0 [2024-08-06 01:57:47,487][52658] Sum rewards: 68.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.832', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.144', 'AMMO3': '0.219', 'AMMO4': '0.263', 'weapon2': '0.264', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.500'} [2024-08-06 01:57:47,500][52670] DAMAGECOUNT value on done: 253174.0 [2024-08-06 01:57:47,501][52670] Sum rewards: 59.727, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.052', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.068', 'weapon4': '0.080', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:47,762][52794] DAMAGECOUNT value on done: 255788.0 [2024-08-06 01:57:47,764][52794] Sum rewards: 62.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.083', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'AMMO4': '0.222', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 281862144. Throughput: 0: 4378.0. Samples: 70465160. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:57:47,794][52567] Avg episode reward: [(0, '64.933')] [2024-08-06 01:57:48,142][52811] DAMAGECOUNT value on done: 240316.0 [2024-08-06 01:57:48,144][52811] Sum rewards: 59.360, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.572', 'AMMO5': '0.003', 'AMMO2': '0.027', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'AMMO3': '0.299', 'weapon4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.750', 'weapon3': '2.994', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:48,619][52671] DAMAGECOUNT value on done: 259392.0 [2024-08-06 01:57:48,619][52671] Sum rewards: 68.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:49,347][52803] DAMAGECOUNT value on done: 234137.0 [2024-08-06 01:57:49,349][52803] Sum rewards: 62.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.724', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.070', 'AMMO3': '0.207', 'weapon5': '0.208', 'weapon4': '0.316', 'AMMO4': '0.351', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.704', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:49,563][52650] Updated weights for policy 0, policy_version 34411 (0.0014) [2024-08-06 01:57:49,897][52820] DAMAGECOUNT value on done: 231102.0 [2024-08-06 01:57:49,897][52820] Sum rewards: 66.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.024', 'weapon5': '0.054', 'AMMO4': '0.104', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.778', 'WEAPON3': '0.900', 'weapon3': '3.038', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:50,125][52666] DAMAGECOUNT value on done: 243513.0 [2024-08-06 01:57:50,127][52666] Sum rewards: 58.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.465', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.168', 'weapon5': '0.180', 'AMMO4': '0.216', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:50,568][52794] DAMAGECOUNT value on done: 266157.0 [2024-08-06 01:57:50,569][52794] Sum rewards: 60.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon4': '0.212', 'weapon2': '0.252', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.346', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:50,631][52670] DAMAGECOUNT value on done: 246589.0 [2024-08-06 01:57:50,633][52670] Sum rewards: 59.931, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.329', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'weapon4': '0.070', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.030', 'weapon3': '3.380', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:50,636][52658] DAMAGECOUNT value on done: 251424.0 [2024-08-06 01:57:50,637][52658] Sum rewards: 57.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.474', 'weapon4': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.858', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '49.000'} [2024-08-06 01:57:50,963][52671] DAMAGECOUNT value on done: 253956.0 [2024-08-06 01:57:50,963][52671] Sum rewards: 61.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.437', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.121', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.400', 'weapon4': '0.572', 'WEAPON3': '0.850', 'weapon3': '2.664', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '48.000'} [2024-08-06 01:57:51,214][52811] DAMAGECOUNT value on done: 236739.0 [2024-08-06 01:57:51,214][52811] Sum rewards: 72.753, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.616', 'AMMO5': '0.003', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'weapon2': '0.400', 'weapon4': '0.756', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '58.000'} [2024-08-06 01:57:52,479][52803] DAMAGECOUNT value on done: 243125.0 [2024-08-06 01:57:52,482][52803] Sum rewards: 69.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.820', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.116', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '61.000'} [2024-08-06 01:57:52,794][52567] Fps is (10 sec: 18024.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 281952256. Throughput: 0: 4392.0. Samples: 70491610. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:57:52,794][52567] Avg episode reward: [(0, '64.831')] [2024-08-06 01:57:53,076][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:57:53,155][52820] DAMAGECOUNT value on done: 233534.0 [2024-08-06 01:57:53,156][52820] Sum rewards: 65.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.120', 'AMMO3': '0.155', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '3.060', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:53,364][52671] DAMAGECOUNT value on done: 255369.0 [2024-08-06 01:57:53,365][52671] Sum rewards: 58.988, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.234', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.125', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:53,421][52666] DAMAGECOUNT value on done: 252277.0 [2024-08-06 01:57:53,421][52666] Sum rewards: 58.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'weapon4': '0.108', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.146', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '51.000'} [2024-08-06 01:57:53,740][52658] DAMAGECOUNT value on done: 258377.0 [2024-08-06 01:57:53,741][52658] Sum rewards: 64.942, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.838', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.038', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.582', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.130', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:53,864][52794] DAMAGECOUNT value on done: 255625.0 [2024-08-06 01:57:53,865][52794] Sum rewards: 55.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.730', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.155', 'weapon2': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.700', 'weapon3': '2.856', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:54,066][52670] DAMAGECOUNT value on done: 247521.0 [2024-08-06 01:57:54,066][52670] Sum rewards: 64.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO3': '0.193', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'weapon2': '0.344', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:54,076][52650] Updated weights for policy 0, policy_version 34421 (0.0025) [2024-08-06 01:57:54,306][52811] DAMAGECOUNT value on done: 231868.0 [2024-08-06 01:57:54,308][52811] Sum rewards: 61.092, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.080', 'AMMO5': '0.022', 'AMMO2': '0.035', 'weapon5': '0.120', 'AMMO4': '0.173', 'AMMO3': '0.252', 'weapon2': '0.308', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.758', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.000'} [2024-08-06 01:57:55,662][52803] DAMAGECOUNT value on done: 234052.0 [2024-08-06 01:57:55,663][52803] Sum rewards: 65.553, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.310', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.070', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon4': '0.328', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:55,951][52671] DAMAGECOUNT value on done: 257204.0 [2024-08-06 01:57:55,951][52671] Sum rewards: 64.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.336', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.162', 'AMMO3': '0.192', 'weapon4': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:56,311][52820] DAMAGECOUNT value on done: 236559.0 [2024-08-06 01:57:56,311][52820] Sum rewards: 59.115, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.369', 'AMMO5': '0.024', 'AMMO2': '0.073', 'weapon5': '0.210', 'AMMO3': '0.219', 'weapon2': '0.276', 'AMMO4': '0.367', 'WEAPON5': '0.650', 'weapon4': '0.660', 'WEAPON4': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.490', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '52.000'} [2024-08-06 01:57:56,579][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:57:56,594][52666] DAMAGECOUNT value on done: 251049.0 [2024-08-06 01:57:56,596][52666] Sum rewards: 82.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.345', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.104', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.396', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '68.000'} [2024-08-06 01:57:56,782][52658] DAMAGECOUNT value on done: 249183.0 [2024-08-06 01:57:56,783][52658] Sum rewards: 60.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'AMMO4': '0.195', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.774', 'WEAPON3': '1.200', 'weapon3': '2.642', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '50.000'} [2024-08-06 01:57:57,089][52670] DAMAGECOUNT value on done: 254733.0 [2024-08-06 01:57:57,090][52670] Sum rewards: 69.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.426', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.200', 'weapon5': '0.204', 'AMMO3': '0.216', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '57.000'} [2024-08-06 01:57:57,432][52811] DAMAGECOUNT value on done: 235964.0 [2024-08-06 01:57:57,433][52811] Sum rewards: 65.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.050', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.282', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.432', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '55.000'} [2024-08-06 01:57:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 282042368. Throughput: 0: 4394.0. Samples: 70518100. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:57:57,795][52567] Avg episode reward: [(0, '64.752')] [2024-08-06 01:57:58,511][52650] Updated weights for policy 0, policy_version 34431 (0.0013) [2024-08-06 01:57:58,695][52803] DAMAGECOUNT value on done: 240784.0 [2024-08-06 01:57:58,697][52803] Sum rewards: 70.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.243', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 01:57:58,727][52671] DAMAGECOUNT value on done: 249952.0 [2024-08-06 01:57:58,727][52671] Sum rewards: 49.745, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.239', 'AMMO5': '0.021', 'weapon7': '0.066', 'AMMO2': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.216', 'AMMO3': '0.218', 'weapon2': '0.316', 'AMMO4': '0.380', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.726', 'WEAPON3': '1.200', 'weapon3': '2.260', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '43.500'} [2024-08-06 01:57:59,370][52820] DAMAGECOUNT value on done: 233195.0 [2024-08-06 01:57:59,370][52820] Sum rewards: 62.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.088', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.344', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '53.000'} [2024-08-06 01:57:59,422][52666] DAMAGECOUNT value on done: 250267.0 [2024-08-06 01:57:59,422][52666] Sum rewards: 66.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.939', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.348', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.218', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '54.000'} [2024-08-06 01:57:59,863][52670] DAMAGECOUNT value on done: 251123.0 [2024-08-06 01:57:59,863][52670] Sum rewards: 57.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.301', 'weapon2': '0.342', 'WEAPON4': '0.550', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '49.000'} [2024-08-06 01:57:59,937][52658] DAMAGECOUNT value on done: 252161.0 [2024-08-06 01:57:59,938][52658] Sum rewards: 59.939, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'weapon5': '0.040', 'AMMO2': '0.043', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon4': '0.242', 'AMMO3': '0.249', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.156', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:00,435][52811] DAMAGECOUNT value on done: 239318.0 [2024-08-06 01:58:00,436][52811] Sum rewards: 76.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.136', 'AMMO3': '0.217', 'AMMO4': '0.221', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '62.000'} [2024-08-06 01:58:01,747][52803] DAMAGECOUNT value on done: 232281.0 [2024-08-06 01:58:01,749][52803] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.432', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.206', 'AMMO4': '0.263', 'weapon5': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.426', 'weapon4': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.546', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '60.000'} [2024-08-06 01:58:01,843][52666] DAMAGECOUNT value on done: 249609.0 [2024-08-06 01:58:01,845][52666] Sum rewards: 58.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.110', 'AMMO3': '0.179', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '49.500'} [2024-08-06 01:58:01,893][52671] DAMAGECOUNT value on done: 258221.0 [2024-08-06 01:58:01,893][52671] Sum rewards: 65.398, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.169', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.168', 'weapon2': '0.534', 'WEAPON3': '1.050', 'HITCOUNT': '3.250', 'weapon3': '3.304', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:02,299][52670] DAMAGECOUNT value on done: 245318.0 [2024-08-06 01:58:02,300][52670] Sum rewards: 58.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.199', 'weapon2': '0.228', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.032', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '49.000'} [2024-08-06 01:58:02,503][52820] DAMAGECOUNT value on done: 234655.0 [2024-08-06 01:58:02,504][52820] Sum rewards: 63.963, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.314', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2024-08-06 01:58:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 282124288. Throughput: 0: 4388.0. Samples: 70531030. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 01:58:02,795][52567] Avg episode reward: [(0, '64.864')] [2024-08-06 01:58:02,909][52658] DAMAGECOUNT value on done: 254996.0 [2024-08-06 01:58:02,913][52658] Sum rewards: 71.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.436', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.210', 'weapon2': '0.264', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '60.000'} [2024-08-06 01:58:03,428][52811] DAMAGECOUNT value on done: 233494.0 [2024-08-06 01:58:03,428][52811] Sum rewards: 62.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.276', 'AMMO5': '0.014', 'weapon5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.158', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'AMMO4': '0.311', 'weapon2': '0.334', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.234', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '55.500'} [2024-08-06 01:58:03,478][52650] Updated weights for policy 0, policy_version 34441 (0.0014) [2024-08-06 01:58:04,454][52671] DAMAGECOUNT value on done: 257998.0 [2024-08-06 01:58:04,462][52671] Sum rewards: 72.956, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.146', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.336', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:04,709][52666] DAMAGECOUNT value on done: 247991.0 [2024-08-06 01:58:04,711][52666] Sum rewards: 57.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.642', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2024-08-06 01:58:05,374][52670] DAMAGECOUNT value on done: 248151.0 [2024-08-06 01:58:05,376][52670] Sum rewards: 53.979, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.587', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.111', 'weapon5': '0.184', 'AMMO4': '0.248', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.650', 'weapon2': '0.768', 'HITCOUNT': '2.320', 'weapon3': '2.438', 'DAMAGECOUNT': '12.420', 'FRAGCOUNT': '44.000'} [2024-08-06 01:58:05,681][52820] DAMAGECOUNT value on done: 235563.0 [2024-08-06 01:58:05,682][52820] Sum rewards: 87.469, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.236', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '74.000'} [2024-08-06 01:58:06,443][52811] DAMAGECOUNT value on done: 241035.0 [2024-08-06 01:58:06,445][52811] Sum rewards: 47.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.016', 'AMMO2': '0.076', 'weapon5': '0.134', 'AMMO3': '0.224', 'WEAPON5': '0.350', 'AMMO4': '0.379', 'weapon2': '0.658', 'weapon4': '0.674', 'WEAPON4': '0.850', 'WEAPON3': '1.350', 'weapon3': '2.220', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '42.000'} [2024-08-06 01:58:07,602][52671] DAMAGECOUNT value on done: 254744.0 [2024-08-06 01:58:07,603][52671] Sum rewards: 69.122, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.174', 'AMMO4': '0.213', 'weapon4': '0.224', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 01:58:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 282214400. Throughput: 0: 4396.2. Samples: 70557630. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:58:07,795][52567] Avg episode reward: [(0, '64.925')] [2024-08-06 01:58:07,858][52666] DAMAGECOUNT value on done: 244135.0 [2024-08-06 01:58:07,858][52666] Sum rewards: 71.803, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.131', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon5': '0.026', 'weapon4': '0.026', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.438', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '61.500'} [2024-08-06 01:58:08,226][52650] Updated weights for policy 0, policy_version 34451 (0.0011) [2024-08-06 01:58:08,259][52670] DAMAGECOUNT value on done: 248237.0 [2024-08-06 01:58:08,260][52670] Sum rewards: 67.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.795', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.388', 'weapon4': '0.394', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.000'} [2024-08-06 01:58:08,757][52820] DAMAGECOUNT value on done: 237649.0 [2024-08-06 01:58:08,758][52820] Sum rewards: 58.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.078', 'AMMO4': '0.173', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.124', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 01:58:10,332][52671] DAMAGECOUNT value on done: 262908.0 [2024-08-06 01:58:10,339][52671] Sum rewards: 74.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.072', 'weapon2': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'ARMOR': '0.448', 'weapon4': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '61.000'} [2024-08-06 01:58:10,675][52666] DAMAGECOUNT value on done: 255815.0 [2024-08-06 01:58:10,675][52666] Sum rewards: 76.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.054', 'weapon4': '0.128', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.448', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '64.000'} [2024-08-06 01:58:11,161][52670] DAMAGECOUNT value on done: 242909.0 [2024-08-06 01:58:11,161][52670] Sum rewards: 56.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.034', 'weapon5': '0.042', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.346', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.446', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '48.000'} [2024-08-06 01:58:11,876][52820] DAMAGECOUNT value on done: 235822.0 [2024-08-06 01:58:11,880][52820] Sum rewards: 80.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.008', 'WEAPON5': '0.050', 'AMMO3': '0.273', 'weapon2': '0.314', 'WEAPON3': '1.700', 'weapon3': '3.440', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '69.000'} [2024-08-06 01:58:12,099][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:58:12,736][52650] Updated weights for policy 0, policy_version 34461 (0.0040) [2024-08-06 01:58:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 282304512. Throughput: 0: 4398.4. Samples: 70583960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:58:12,794][52567] Avg episode reward: [(0, '65.182')] [2024-08-06 01:58:12,961][52671] DAMAGECOUNT value on done: 251424.0 [2024-08-06 01:58:12,961][52671] Sum rewards: 62.660, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.632', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.257', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '55.000'} [2024-08-06 01:58:13,537][52666] DAMAGECOUNT value on done: 252519.0 [2024-08-06 01:58:13,539][52666] Sum rewards: 49.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.713', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.255', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.400', 'HITCOUNT': '2.580', 'weapon3': '3.112', 'DAMAGECOUNT': '12.498', 'FRAGCOUNT': '43.000'} [2024-08-06 01:58:13,979][52670] DAMAGECOUNT value on done: 255479.0 [2024-08-06 01:58:13,990][52670] Sum rewards: 70.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO2': '0.017', 'weapon4': '0.056', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon2': '0.414', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.342', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '58.000'} [2024-08-06 01:58:14,858][52820] DAMAGECOUNT value on done: 234708.0 [2024-08-06 01:58:14,858][52820] Sum rewards: 70.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.052', 'weapon4': '0.112', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.416', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '57.000'} [2024-08-06 01:58:15,000][52659] DAMAGECOUNT value on done: 254829.0 [2024-08-06 01:58:15,001][52659] Sum rewards: 73.552, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.025', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.097', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:16,037][52671] DAMAGECOUNT value on done: 245110.0 [2024-08-06 01:58:16,038][52671] Sum rewards: 58.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.225', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'weapon4': '0.142', 'AMMO3': '0.212', 'weapon2': '0.456', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.220', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '50.000'} [2024-08-06 01:58:16,558][52666] DAMAGECOUNT value on done: 250594.0 [2024-08-06 01:58:16,559][52666] Sum rewards: 68.933, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.560', 'AMMO5': '0.023', 'AMMO2': '0.039', 'weapon4': '0.152', 'AMMO4': '0.194', 'AMMO3': '0.211', 'weapon5': '0.292', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '62.000'} [2024-08-06 01:58:17,073][52670] DAMAGECOUNT value on done: 251469.0 [2024-08-06 01:58:17,077][52670] Sum rewards: 60.795, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.181', 'weapon4': '0.214', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.366', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '51.000'} [2024-08-06 01:58:17,313][52663] DAMAGECOUNT value on done: 257364.0 [2024-08-06 01:58:17,314][52663] Sum rewards: 69.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.462', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.200', 'weapon4': '0.240', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:17,554][52650] Updated weights for policy 0, policy_version 34471 (0.0013) [2024-08-06 01:58:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 282386432. Throughput: 0: 4392.7. Samples: 70597080. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:58:17,794][52567] Avg episode reward: [(0, '65.516')] [2024-08-06 01:58:17,917][52659] DAMAGECOUNT value on done: 252110.0 [2024-08-06 01:58:17,919][52659] Sum rewards: 63.191, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.086', 'weapon4': '0.128', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.138', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:17,989][52820] DAMAGECOUNT value on done: 236191.0 [2024-08-06 01:58:17,989][52820] Sum rewards: 58.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.714', 'AMMO5': '0.010', 'AMMO2': '0.065', 'weapon5': '0.088', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.306', 'AMMO4': '0.324', 'weapon4': '0.514', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '50.000'} [2024-08-06 01:58:18,598][52671] DAMAGECOUNT value on done: 255806.0 [2024-08-06 01:58:18,601][52671] Sum rewards: 69.437, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.101', 'weapon4': '0.130', 'weapon2': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.476', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '58.000'} [2024-08-06 01:58:19,570][52666] DAMAGECOUNT value on done: 248868.0 [2024-08-06 01:58:19,573][52666] Sum rewards: 63.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.032', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:20,051][52670] DAMAGECOUNT value on done: 250103.0 [2024-08-06 01:58:20,053][52670] Sum rewards: 55.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.798', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.542', 'WEAPON3': '1.650', 'weapon3': '2.640', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '49.000'} [2024-08-06 01:58:20,180][52614] Signal inference workers to stop experience collection... (6200 times) [2024-08-06 01:58:20,181][52614] Signal inference workers to resume experience collection... (6200 times) [2024-08-06 01:58:20,218][52659] DAMAGECOUNT value on done: 253586.0 [2024-08-06 01:58:20,220][52659] Sum rewards: 71.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.068', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.114', 'AMMO3': '0.153', 'AMMO4': '0.159', 'WEAPON5': '0.300', 'weapon4': '0.446', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.696', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:20,227][52650] InferenceWorker_p0-w0: stopping experience collection (6200 times) [2024-08-06 01:58:20,243][52650] InferenceWorker_p0-w0: resuming experience collection (6200 times) [2024-08-06 01:58:20,341][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:58:20,594][52663] DAMAGECOUNT value on done: 254029.0 [2024-08-06 01:58:20,605][52663] Sum rewards: 66.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.699', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO4': '0.031', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.394', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.000'} [2024-08-06 01:58:21,050][52820] DAMAGECOUNT value on done: 236905.0 [2024-08-06 01:58:21,052][52820] Sum rewards: 74.963, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.123', 'weapon4': '0.134', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.290', 'HEALTH': '0.556', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '61.000'} [2024-08-06 01:58:21,202][52671] DAMAGECOUNT value on done: 257363.0 [2024-08-06 01:58:21,202][52671] Sum rewards: 68.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.234', 'weapon4': '0.254', 'weapon5': '0.294', 'AMMO4': '0.299', 'weapon2': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.778', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '58.000'} [2024-08-06 01:58:21,938][52650] Updated weights for policy 0, policy_version 34481 (0.0012) [2024-08-06 01:58:22,054][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:58:22,370][52666] DAMAGECOUNT value on done: 247283.0 [2024-08-06 01:58:22,370][52666] Sum rewards: 73.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '62.000'} [2024-08-06 01:58:22,748][52670] DAMAGECOUNT value on done: 254601.0 [2024-08-06 01:58:22,750][52670] Sum rewards: 68.942, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.070', 'AMMO5': '0.020', 'AMMO2': '0.069', 'weapon5': '0.230', 'AMMO3': '0.247', 'AMMO4': '0.347', 'weapon2': '0.370', 'weapon4': '0.468', 'WEAPON5': '0.500', 'WEAPON4': '0.850', 'WEAPON3': '1.400', 'weapon3': '2.534', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '60.000'} [2024-08-06 01:58:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 282476544. Throughput: 0: 4389.3. Samples: 70623340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 01:58:22,795][52567] Avg episode reward: [(0, '65.361')] [2024-08-06 01:58:23,268][52659] DAMAGECOUNT value on done: 252019.0 [2024-08-06 01:58:23,268][52659] Sum rewards: 63.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.074', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.270', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.328', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '56.000'} [2024-08-06 01:58:23,309][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:58:23,644][52663] DAMAGECOUNT value on done: 249770.0 [2024-08-06 01:58:23,646][52663] Sum rewards: 68.975, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.524', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.141', 'weapon5': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.694', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:24,145][52820] DAMAGECOUNT value on done: 229764.0 [2024-08-06 01:58:24,147][52820] Sum rewards: 58.906, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.804', 'AMMO5': '0.005', 'AMMO2': '0.070', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.322', 'AMMO4': '0.351', 'weapon4': '0.458', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.838', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:24,173][52671] DAMAGECOUNT value on done: 260248.0 [2024-08-06 01:58:24,175][52671] Sum rewards: 62.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.043', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.168', 'AMMO3': '0.181', 'AMMO4': '0.223', 'weapon4': '0.224', 'weapon2': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '51.500'} [2024-08-06 01:58:25,245][52666] DAMAGECOUNT value on done: 254839.0 [2024-08-06 01:58:25,248][52666] Sum rewards: 62.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.712', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.168', 'AMMO3': '0.189', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.560', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.402', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '51.000'} [2024-08-06 01:58:25,744][52670] DAMAGECOUNT value on done: 252886.0 [2024-08-06 01:58:25,746][52670] Sum rewards: 51.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.118', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.176', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon4': '0.446', 'WEAPON3': '1.000', 'HITCOUNT': '2.460', 'weapon3': '2.704', 'DAMAGECOUNT': '12.627', 'FRAGCOUNT': '44.000'} [2024-08-06 01:58:26,086][52659] DAMAGECOUNT value on done: 249338.0 [2024-08-06 01:58:26,095][52659] Sum rewards: 62.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.853', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.190', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.436', 'weapon2': '0.728', 'WEAPON3': '1.350', 'weapon3': '2.378', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:26,878][52650] Updated weights for policy 0, policy_version 34491 (0.0012) [2024-08-06 01:58:26,966][52671] DAMAGECOUNT value on done: 256502.0 [2024-08-06 01:58:26,968][52671] Sum rewards: 61.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon4': '0.256', 'weapon2': '0.548', 'WEAPON3': '1.600', 'weapon3': '2.974', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '55.000'} [2024-08-06 01:58:26,988][52663] DAMAGECOUNT value on done: 253845.0 [2024-08-06 01:58:26,990][52663] Sum rewards: 55.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.652', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.152', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.600', 'HITCOUNT': '2.820', 'weapon3': '3.144', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '50.000'} [2024-08-06 01:58:27,250][52820] DAMAGECOUNT value on done: 241098.0 [2024-08-06 01:58:27,251][52820] Sum rewards: 67.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.187', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.000'} [2024-08-06 01:58:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 282566656. Throughput: 0: 4384.8. Samples: 70649590. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:58:27,794][52567] Avg episode reward: [(0, '65.234')] [2024-08-06 01:58:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000034493_282566656.pth... [2024-08-06 01:58:27,928][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000033981_278372352.pth [2024-08-06 01:58:28,212][52666] DAMAGECOUNT value on done: 245181.0 [2024-08-06 01:58:28,212][52666] Sum rewards: 61.103, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.316', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO4': '0.192', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.338', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.936', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '56.000'} [2024-08-06 01:58:28,667][52670] DAMAGECOUNT value on done: 241594.0 [2024-08-06 01:58:28,668][52670] Sum rewards: 69.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.422', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.114', 'AMMO3': '0.166', 'AMMO4': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.416', 'weapon4': '0.508', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:29,161][52659] DAMAGECOUNT value on done: 251593.0 [2024-08-06 01:58:29,161][52659] Sum rewards: 50.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.615', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.142', 'weapon4': '0.146', 'AMMO4': '0.161', 'AMMO3': '0.190', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '3.198', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '43.000'} [2024-08-06 01:58:29,906][52663] DAMAGECOUNT value on done: 253575.0 [2024-08-06 01:58:29,907][52663] Sum rewards: 74.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.172', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'weapon4': '0.236', 'AMMO3': '0.240', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.264', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '62.000'} [2024-08-06 01:58:29,999][52671] DAMAGECOUNT value on done: 251768.0 [2024-08-06 01:58:29,999][52671] Sum rewards: 55.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO4': '0.173', 'weapon4': '0.218', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.178', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '48.000'} [2024-08-06 01:58:30,330][52820] DAMAGECOUNT value on done: 243915.0 [2024-08-06 01:58:30,333][52820] Sum rewards: 63.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.110', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.179', 'weapon4': '0.186', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '55.000'} [2024-08-06 01:58:30,929][52666] DAMAGECOUNT value on done: 253225.0 [2024-08-06 01:58:30,931][52666] Sum rewards: 81.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.726', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.096', 'weapon2': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '67.000'} [2024-08-06 01:58:31,450][52670] DAMAGECOUNT value on done: 254335.0 [2024-08-06 01:58:31,451][52670] Sum rewards: 67.829, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.260', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '58.000'} [2024-08-06 01:58:31,579][52650] Updated weights for policy 0, policy_version 34501 (0.0012) [2024-08-06 01:58:32,338][52659] DAMAGECOUNT value on done: 253837.0 [2024-08-06 01:58:32,339][52659] Sum rewards: 56.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.195', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.126', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.284', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '48.000'} [2024-08-06 01:58:32,435][52647] DAMAGECOUNT value on done: 268733.0 [2024-08-06 01:58:32,437][52647] Sum rewards: 67.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.860', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '56.000'} [2024-08-06 01:58:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 282648576. Throughput: 0: 4385.3. Samples: 70662500. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:58:32,795][52567] Avg episode reward: [(0, '64.804')] [2024-08-06 01:58:33,023][52663] DAMAGECOUNT value on done: 256701.0 [2024-08-06 01:58:33,025][52663] Sum rewards: 58.775, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.155', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.066', 'AMMO4': '0.222', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '53.000'} [2024-08-06 01:58:33,430][52820] DAMAGECOUNT value on done: 231322.0 [2024-08-06 01:58:33,438][52820] Sum rewards: 69.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.080', 'AMMO4': '0.093', 'weapon5': '0.098', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:34,360][52670] DAMAGECOUNT value on done: 259288.0 [2024-08-06 01:58:34,362][52670] Sum rewards: 79.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.352', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.192', 'weapon4': '0.192', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '66.000'} [2024-08-06 01:58:35,245][52659] DAMAGECOUNT value on done: 248551.0 [2024-08-06 01:58:35,246][52659] Sum rewards: 71.844, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.945', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.396', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:35,339][52647] DAMAGECOUNT value on done: 265800.0 [2024-08-06 01:58:35,339][52647] Sum rewards: 62.196, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.480', 'weapon2': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.536', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '50.000'} [2024-08-06 01:58:36,047][52650] Updated weights for policy 0, policy_version 34511 (0.0013) [2024-08-06 01:58:36,158][52663] DAMAGECOUNT value on done: 253177.0 [2024-08-06 01:58:36,160][52663] Sum rewards: 61.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.155', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.180', 'AMMO3': '0.222', 'weapon2': '0.226', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:37,320][52649] DAMAGECOUNT value on done: 246068.0 [2024-08-06 01:58:37,321][52649] Sum rewards: 54.623, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.754', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO4': '0.197', 'AMMO3': '0.206', 'weapon2': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.020', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '48.000'} [2024-08-06 01:58:37,468][52670] DAMAGECOUNT value on done: 252064.0 [2024-08-06 01:58:37,468][52670] Sum rewards: 78.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.146', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 01:58:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 282738688. Throughput: 0: 4384.0. Samples: 70688890. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:58:37,794][52567] Avg episode reward: [(0, '64.851')] [2024-08-06 01:58:38,290][52659] DAMAGECOUNT value on done: 259630.0 [2024-08-06 01:58:38,292][52659] Sum rewards: 76.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.444', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.242', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '64.000'} [2024-08-06 01:58:38,312][52647] DAMAGECOUNT value on done: 266956.0 [2024-08-06 01:58:38,313][52647] Sum rewards: 61.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO2': '0.012', 'AMMO5': '0.014', 'AMMO4': '0.060', 'weapon5': '0.136', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.468', 'weapon4': '0.574', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '53.000'} [2024-08-06 01:58:39,227][52663] DAMAGECOUNT value on done: 252516.0 [2024-08-06 01:58:39,230][52663] Sum rewards: 64.029, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.597', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.062', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '54.000'} [2024-08-06 01:58:39,889][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:58:40,214][52649] DAMAGECOUNT value on done: 239869.0 [2024-08-06 01:58:40,214][52649] Sum rewards: 58.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.928', 'AMMO5': '0.014', 'AMMO2': '0.051', 'AMMO3': '0.198', 'weapon5': '0.224', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'weapon2': '0.334', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '50.000'} [2024-08-06 01:58:40,311][52670] DAMAGECOUNT value on done: 253376.0 [2024-08-06 01:58:40,311][52670] Sum rewards: 65.774, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.645', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.167', 'weapon2': '0.554', 'WEAPON3': '1.000', 'weapon3': '3.188', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:40,616][52650] Updated weights for policy 0, policy_version 34521 (0.0024) [2024-08-06 01:58:41,265][52647] DAMAGECOUNT value on done: 271392.0 [2024-08-06 01:58:41,266][52647] Sum rewards: 65.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.775', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.107', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '54.000'} [2024-08-06 01:58:41,354][52659] DAMAGECOUNT value on done: 258822.0 [2024-08-06 01:58:41,354][52659] Sum rewards: 69.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.061', 'AMMO3': '0.190', 'weapon5': '0.228', 'AMMO4': '0.303', 'weapon2': '0.358', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.640', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '56.000'} [2024-08-06 01:58:42,180][52663] DAMAGECOUNT value on done: 252365.0 [2024-08-06 01:58:42,181][52663] Sum rewards: 62.328, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'ARMOR': '0.005', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.263', 'weapon2': '0.320', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '55.000'} [2024-08-06 01:58:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.1, 300 sec: 17494.8). Total num frames: 282828800. Throughput: 0: 4381.1. Samples: 70715250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:58:42,795][52567] Avg episode reward: [(0, '65.149')] [2024-08-06 01:58:42,930][52649] DAMAGECOUNT value on done: 248953.0 [2024-08-06 01:58:42,930][52649] Sum rewards: 67.031, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.102', 'AMMO4': '0.152', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '59.000'} [2024-08-06 01:58:44,487][52647] DAMAGECOUNT value on done: 267471.0 [2024-08-06 01:58:44,495][52647] Sum rewards: 54.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.517', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.194', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.720', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '48.000'} [2024-08-06 01:58:44,521][52659] DAMAGECOUNT value on done: 252390.0 [2024-08-06 01:58:44,522][52659] Sum rewards: 63.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.517', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.207', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:45,168][52663] DAMAGECOUNT value on done: 255476.0 [2024-08-06 01:58:45,171][52663] Sum rewards: 66.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO4': '0.171', 'AMMO3': '0.193', 'weapon5': '0.196', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.136', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2024-08-06 01:58:45,614][52650] Updated weights for policy 0, policy_version 34531 (0.0025) [2024-08-06 01:58:46,045][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 01:58:46,174][52649] DAMAGECOUNT value on done: 248813.0 [2024-08-06 01:58:46,174][52649] Sum rewards: 63.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.544', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.193', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '54.000'} [2024-08-06 01:58:47,202][52647] DAMAGECOUNT value on done: 272313.0 [2024-08-06 01:58:47,202][52647] Sum rewards: 59.683, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.156', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.078', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.230', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '51.500'} [2024-08-06 01:58:47,422][52659] DAMAGECOUNT value on done: 252267.0 [2024-08-06 01:58:47,424][52659] Sum rewards: 68.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.076', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.132', 'AMMO4': '0.169', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '58.000'} [2024-08-06 01:58:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 282910720. Throughput: 0: 4385.8. Samples: 70728390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 01:58:47,794][52567] Avg episode reward: [(0, '65.060')] [2024-08-06 01:58:47,974][52649] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:58:48,292][52663] DAMAGECOUNT value on done: 257328.0 [2024-08-06 01:58:48,293][52663] Sum rewards: 67.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.076', 'weapon5': '0.088', 'AMMO4': '0.114', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '56.000'} [2024-08-06 01:58:49,468][52649] DAMAGECOUNT value on done: 238969.0 [2024-08-06 01:58:49,469][52649] Sum rewards: 53.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.054', 'AMMO4': '0.092', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.360', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '3.174', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '48.500'} [2024-08-06 01:58:49,818][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:58:49,841][52665] DAMAGECOUNT value on done: 249666.0 [2024-08-06 01:58:49,843][52665] Sum rewards: 46.821, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.890', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.186', 'AMMO3': '0.268', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.408', 'WEAPON3': '1.400', 'HITCOUNT': '2.720', 'weapon3': '2.808', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '42.000'} [2024-08-06 01:58:49,878][52647] DAMAGECOUNT value on done: 267820.0 [2024-08-06 01:58:49,879][52647] Sum rewards: 63.943, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.116', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.276', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.600', 'weapon3': '2.914', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.000'} [2024-08-06 01:58:50,057][52650] Updated weights for policy 0, policy_version 34541 (0.0028) [2024-08-06 01:58:50,374][52659] DAMAGECOUNT value on done: 247828.0 [2024-08-06 01:58:50,385][52659] Sum rewards: 64.271, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.762', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '53.000'} [2024-08-06 01:58:51,409][52663] DAMAGECOUNT value on done: 251537.0 [2024-08-06 01:58:51,413][52663] Sum rewards: 68.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO3': '0.150', 'AMMO4': '0.176', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.600', 'weapon4': '0.788', 'WEAPON3': '0.950', 'weapon3': '2.580', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '57.000'} [2024-08-06 01:58:51,996][52647] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:58:52,389][52647] DAMAGECOUNT value on done: 265664.0 [2024-08-06 01:58:52,391][52647] Sum rewards: 61.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:52,544][52649] DAMAGECOUNT value on done: 250373.0 [2024-08-06 01:58:52,544][52649] Sum rewards: 65.517, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.406', 'WEAPON4': '0.450', 'weapon4': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.656', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '53.000'} [2024-08-06 01:58:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 283000832. Throughput: 0: 4386.2. Samples: 70755010. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:58:52,794][52567] Avg episode reward: [(0, '64.839')] [2024-08-06 01:58:52,939][52665] DAMAGECOUNT value on done: 255579.0 [2024-08-06 01:58:52,940][52665] Sum rewards: 58.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.182', 'weapon4': '0.216', 'AMMO4': '0.234', 'AMMO3': '0.253', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '2.982', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '51.000'} [2024-08-06 01:58:53,102][52659] DAMAGECOUNT value on done: 254257.0 [2024-08-06 01:58:53,102][52659] Sum rewards: 62.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.165', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.274', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.700', 'weapon3': '2.986', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '54.000'} [2024-08-06 01:58:54,365][52663] DAMAGECOUNT value on done: 247627.0 [2024-08-06 01:58:54,366][52663] Sum rewards: 62.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.176', 'weapon4': '0.210', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '51.000'} [2024-08-06 01:58:54,735][52647] DAMAGECOUNT value on done: 271398.0 [2024-08-06 01:58:54,736][52647] Sum rewards: 75.212, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.086', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.874', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '64.000'} [2024-08-06 01:58:54,782][52650] Updated weights for policy 0, policy_version 34551 (0.0016) [2024-08-06 01:58:55,320][52666] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 01:58:55,575][52649] DAMAGECOUNT value on done: 245227.0 [2024-08-06 01:58:55,575][52649] Sum rewards: 57.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.624', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'weapon2': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'weapon4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.680', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2024-08-06 01:58:55,897][52665] DAMAGECOUNT value on done: 251757.0 [2024-08-06 01:58:55,898][52665] Sum rewards: 78.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.178', 'AMMO3': '0.238', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.782', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '63.000'} [2024-08-06 01:58:56,103][52659] DAMAGECOUNT value on done: 257439.0 [2024-08-06 01:58:56,104][52659] Sum rewards: 67.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.815', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.114', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '55.000'} [2024-08-06 01:58:57,081][52647] DAMAGECOUNT value on done: 264263.0 [2024-08-06 01:58:57,083][52647] Sum rewards: 64.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'weapon4': '0.134', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.394', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '52.000'} [2024-08-06 01:58:57,565][52663] DAMAGECOUNT value on done: 247275.0 [2024-08-06 01:58:57,566][52663] Sum rewards: 64.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.298', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO3': '0.152', 'AMMO4': '0.176', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.626', 'WEAPON3': '0.950', 'weapon3': '2.872', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '51.000'} [2024-08-06 01:58:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 283090944. Throughput: 0: 4386.9. Samples: 70781370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:58:57,795][52567] Avg episode reward: [(0, '64.973')] [2024-08-06 01:58:58,576][52649] DAMAGECOUNT value on done: 252399.0 [2024-08-06 01:58:58,577][52649] Sum rewards: 70.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.616', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.163', 'weapon4': '0.168', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '3.186', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '57.000'} [2024-08-06 01:58:58,874][52665] DAMAGECOUNT value on done: 249597.0 [2024-08-06 01:58:58,876][52665] Sum rewards: 75.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO2': '0.010', 'weapon4': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'weapon2': '0.238', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'weapon3': '3.540', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '65.000'} [2024-08-06 01:58:59,231][52650] Updated weights for policy 0, policy_version 34561 (0.0028) [2024-08-06 01:58:59,270][52659] DAMAGECOUNT value on done: 261059.0 [2024-08-06 01:58:59,271][52659] Sum rewards: 61.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.844', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.124', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON5': '0.250', 'AMMO4': '0.299', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '52.500'} [2024-08-06 01:58:59,921][52647] DAMAGECOUNT value on done: 268446.0 [2024-08-06 01:58:59,921][52647] Sum rewards: 61.436, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.620', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.235', 'AMMO3': '0.295', 'weapon4': '0.332', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.750', 'weapon3': '2.756', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:00,870][52663] DAMAGECOUNT value on done: 253226.0 [2024-08-06 01:59:00,878][52663] Sum rewards: 54.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO4': '0.161', 'weapon4': '0.202', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '47.000'} [2024-08-06 01:59:01,872][52649] DAMAGECOUNT value on done: 248112.0 [2024-08-06 01:59:01,874][52649] Sum rewards: 66.019, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.067', 'AMMO5': '0.004', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.736', 'WEAPON3': '1.000', 'weapon3': '3.068', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:02,191][52665] DAMAGECOUNT value on done: 245610.0 [2024-08-06 01:59:02,194][52665] Sum rewards: 66.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.163', 'AMMO3': '0.219', 'weapon2': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.146', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '58.000'} [2024-08-06 01:59:02,241][52659] DAMAGECOUNT value on done: 258823.0 [2024-08-06 01:59:02,241][52659] Sum rewards: 61.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.117', 'AMMO3': '0.177', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '51.000'} [2024-08-06 01:59:02,414][52647] DAMAGECOUNT value on done: 263221.0 [2024-08-06 01:59:02,414][52647] Sum rewards: 79.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.696', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon4': '0.348', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.750', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '64.000'} [2024-08-06 01:59:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 283181056. Throughput: 0: 4391.1. Samples: 70794680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:59:02,794][52567] Avg episode reward: [(0, '65.082')] [2024-08-06 01:59:03,611][52663] DAMAGECOUNT value on done: 255651.0 [2024-08-06 01:59:03,613][52663] Sum rewards: 63.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO3': '0.158', 'AMMO4': '0.223', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '0.950', 'weapon3': '2.856', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:04,298][52650] Updated weights for policy 0, policy_version 34571 (0.0025) [2024-08-06 01:59:04,755][52647] DAMAGECOUNT value on done: 265318.0 [2024-08-06 01:59:04,755][52647] Sum rewards: 64.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.048', 'AMMO4': '0.128', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.284', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.158', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:04,894][52649] DAMAGECOUNT value on done: 248344.0 [2024-08-06 01:59:04,896][52649] Sum rewards: 71.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.730', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.141', 'AMMO4': '0.169', 'weapon2': '0.172', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'ARMOR': '0.447', 'weapon4': '0.674', 'WEAPON3': '0.850', 'weapon3': '2.638', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '56.000'} [2024-08-06 01:59:05,211][52665] DAMAGECOUNT value on done: 244179.0 [2024-08-06 01:59:05,213][52665] Sum rewards: 52.833, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.923', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.174', 'AMMO4': '0.220', 'AMMO3': '0.243', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.744', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '48.000'} [2024-08-06 01:59:05,265][52659] DAMAGECOUNT value on done: 255265.0 [2024-08-06 01:59:05,267][52659] Sum rewards: 61.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.586', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.267', 'weapon2': '0.438', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.224', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:06,317][52659] Large shaping reward 2.600 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0)] [2024-08-06 01:59:06,822][52663] DAMAGECOUNT value on done: 256624.0 [2024-08-06 01:59:06,827][52663] Sum rewards: 63.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.935', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.198', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:07,500][52647] DAMAGECOUNT value on done: 265274.0 [2024-08-06 01:59:07,500][52647] Sum rewards: 62.234, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.062', 'AMMO5': '0.016', 'AMMO2': '0.059', 'AMMO3': '0.226', 'weapon5': '0.232', 'AMMO4': '0.297', 'weapon2': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.624', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.456', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:07,733][52649] DAMAGECOUNT value on done: 249256.0 [2024-08-06 01:59:07,734][52649] Sum rewards: 60.763, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.159', 'weapon5': '0.198', 'AMMO4': '0.229', 'weapon4': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '49.000'} [2024-08-06 01:59:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 283262976. Throughput: 0: 4390.2. Samples: 70820900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 01:59:07,794][52567] Avg episode reward: [(0, '64.783')] [2024-08-06 01:59:07,995][52665] DAMAGECOUNT value on done: 254899.0 [2024-08-06 01:59:07,997][52665] Sum rewards: 69.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.138', 'AMMO4': '0.203', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '59.000'} [2024-08-06 01:59:08,247][52659] DAMAGECOUNT value on done: 258437.0 [2024-08-06 01:59:08,248][52659] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.622', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.132', 'weapon5': '0.168', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.678', 'WEAPON3': '0.850', 'weapon2': '0.866', 'weapon3': '2.068', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:08,696][52650] Updated weights for policy 0, policy_version 34581 (0.0024) [2024-08-06 01:59:09,317][52663] DAMAGECOUNT value on done: 261343.0 [2024-08-06 01:59:09,318][52663] Sum rewards: 55.505, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.075', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon5': '0.206', 'AMMO3': '0.247', 'weapon4': '0.314', 'AMMO4': '0.327', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.672', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '51.000'} [2024-08-06 01:59:10,561][52649] DAMAGECOUNT value on done: 248680.0 [2024-08-06 01:59:10,564][52649] Sum rewards: 65.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.178', 'weapon4': '0.190', 'AMMO4': '0.226', 'weapon2': '0.252', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.124', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '56.000'} [2024-08-06 01:59:10,716][52647] DAMAGECOUNT value on done: 271120.0 [2024-08-06 01:59:10,716][52647] Sum rewards: 59.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.103', 'weapon4': '0.126', 'weapon2': '0.180', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '3.444', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '51.000'} [2024-08-06 01:59:10,751][52665] DAMAGECOUNT value on done: 251602.0 [2024-08-06 01:59:10,752][52665] Sum rewards: 57.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.038', 'AMMO3': '0.189', 'AMMO4': '0.193', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '48.000'} [2024-08-06 01:59:10,951][52659] DAMAGECOUNT value on done: 258273.0 [2024-08-06 01:59:10,953][52659] Sum rewards: 69.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.864', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.132', 'weapon4': '0.142', 'AMMO4': '0.165', 'AMMO3': '0.209', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 01:59:12,014][52663] DAMAGECOUNT value on done: 256537.0 [2024-08-06 01:59:12,014][52663] Sum rewards: 73.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.418', 'weapon4': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '60.000'} [2024-08-06 01:59:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 283353088. Throughput: 0: 4388.4. Samples: 70847070. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:59:12,794][52567] Avg episode reward: [(0, '64.535')] [2024-08-06 01:59:13,518][52649] DAMAGECOUNT value on done: 249315.0 [2024-08-06 01:59:13,520][52649] Sum rewards: 59.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.156', 'AMMO3': '0.167', 'weapon2': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.884', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '49.000'} [2024-08-06 01:59:13,545][52647] DAMAGECOUNT value on done: 265754.0 [2024-08-06 01:59:13,545][52647] Sum rewards: 70.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.289', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '59.000'} [2024-08-06 01:59:13,619][52650] Updated weights for policy 0, policy_version 34591 (0.0011) [2024-08-06 01:59:13,750][52665] DAMAGECOUNT value on done: 254859.0 [2024-08-06 01:59:13,751][52665] Sum rewards: 66.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.531', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.118', 'AMMO4': '0.178', 'weapon4': '0.182', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:14,580][52663] DAMAGECOUNT value on done: 252022.0 [2024-08-06 01:59:14,581][52663] Sum rewards: 55.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.060', 'AMMO5': '0.020', 'AMMO2': '0.082', 'AMMO3': '0.225', 'weapon5': '0.256', 'weapon2': '0.288', 'AMMO4': '0.410', 'weapon4': '0.498', 'WEAPON5': '0.600', 'WEAPON4': '0.950', 'WEAPON3': '1.400', 'weapon3': '2.564', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '49.000'} [2024-08-06 01:59:16,335][52649] DAMAGECOUNT value on done: 252107.0 [2024-08-06 01:59:16,337][52649] Sum rewards: 74.371, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.264', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.354', 'weapon4': '0.806', 'WEAPON3': '1.500', 'weapon3': '2.548', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '65.000'} [2024-08-06 01:59:16,435][52665] DAMAGECOUNT value on done: 253238.0 [2024-08-06 01:59:16,435][52665] Sum rewards: 63.684, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.130', 'weapon5': '0.138', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.138', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:16,640][52647] DAMAGECOUNT value on done: 264954.0 [2024-08-06 01:59:16,641][52647] Sum rewards: 63.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.184', 'weapon5': '0.212', 'AMMO3': '0.244', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.450', 'weapon3': '2.738', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 283443200. Throughput: 0: 4396.0. Samples: 70860320. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:59:17,794][52567] Avg episode reward: [(0, '64.589')] [2024-08-06 01:59:17,861][52650] Updated weights for policy 0, policy_version 34601 (0.0014) [2024-08-06 01:59:19,145][52649] DAMAGECOUNT value on done: 243730.0 [2024-08-06 01:59:19,145][52649] Sum rewards: 68.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.418', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.556', 'WEAPON3': '1.550', 'weapon3': '3.016', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '58.000'} [2024-08-06 01:59:19,147][52665] DAMAGECOUNT value on done: 259694.0 [2024-08-06 01:59:19,149][52665] Sum rewards: 62.153, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'AMMO4': '0.238', 'weapon2': '0.402', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:19,231][52647] DAMAGECOUNT value on done: 265062.0 [2024-08-06 01:59:19,231][52647] Sum rewards: 73.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.042', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.252', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '60.000'} [2024-08-06 01:59:21,827][52647] DAMAGECOUNT value on done: 259680.0 [2024-08-06 01:59:21,827][52647] Sum rewards: 70.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.094', 'AMMO3': '0.211', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.428', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '60.000'} [2024-08-06 01:59:22,196][52665] DAMAGECOUNT value on done: 256337.0 [2024-08-06 01:59:22,197][52665] Sum rewards: 53.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.938', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.172', 'AMMO4': '0.240', 'weapon5': '0.270', 'weapon2': '0.360', 'weapon4': '0.476', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.518', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '45.500'} [2024-08-06 01:59:22,226][52649] DAMAGECOUNT value on done: 249241.0 [2024-08-06 01:59:22,228][52649] Sum rewards: 60.065, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.768', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.096', 'weapon4': '0.182', 'AMMO4': '0.248', 'AMMO3': '0.253', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.134', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 283525120. Throughput: 0: 4393.8. Samples: 70886610. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:59:22,794][52567] Avg episode reward: [(0, '64.455')] [2024-08-06 01:59:23,063][52650] Updated weights for policy 0, policy_version 34611 (0.0024) [2024-08-06 01:59:25,087][52647] DAMAGECOUNT value on done: 267660.0 [2024-08-06 01:59:25,087][52647] Sum rewards: 63.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.605', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.074', 'AMMO4': '0.075', 'weapon2': '0.110', 'AMMO3': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.704', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:25,424][52665] DAMAGECOUNT value on done: 255521.0 [2024-08-06 01:59:25,426][52665] Sum rewards: 78.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.713', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.207', 'weapon2': '0.244', 'weapon4': '0.246', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 01:59:25,437][52649] DAMAGECOUNT value on done: 247420.0 [2024-08-06 01:59:25,437][52649] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.166', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.344', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.640', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:27,359][52650] Updated weights for policy 0, policy_version 34621 (0.0014) [2024-08-06 01:59:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 283623424. Throughput: 0: 4382.9. Samples: 70912480. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:59:27,794][52567] Avg episode reward: [(0, '64.459')] [2024-08-06 01:59:27,895][52665] DAMAGECOUNT value on done: 252095.0 [2024-08-06 01:59:27,896][52665] Sum rewards: 59.916, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:27,995][52649] DAMAGECOUNT value on done: 253292.0 [2024-08-06 01:59:27,997][52649] Sum rewards: 52.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.144', 'weapon5': '0.174', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '3.048', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '44.000'} [2024-08-06 01:59:28,848][52668] DAMAGECOUNT value on done: 253564.0 [2024-08-06 01:59:28,849][52668] Sum rewards: 68.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.758', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.204', 'weapon5': '0.258', 'AMMO4': '0.263', 'WEAPON5': '0.400', 'weapon2': '0.532', 'WEAPON4': '0.550', 'weapon4': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.306', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '56.500'} [2024-08-06 01:59:29,390][52667] DAMAGECOUNT value on done: 255526.0 [2024-08-06 01:59:29,393][52667] Sum rewards: 69.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.114', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 01:59:30,991][52665] DAMAGECOUNT value on done: 252293.0 [2024-08-06 01:59:30,992][52665] Sum rewards: 59.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO4': '0.194', 'weapon4': '0.194', 'AMMO3': '0.209', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.198', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '50.000'} [2024-08-06 01:59:31,224][52649] DAMAGECOUNT value on done: 253686.0 [2024-08-06 01:59:31,225][52649] Sum rewards: 68.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.032', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '59.000'} [2024-08-06 01:59:31,780][52668] DAMAGECOUNT value on done: 261185.0 [2024-08-06 01:59:31,780][52668] Sum rewards: 60.987, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.164', 'weapon5': '0.170', 'weapon4': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '3.048', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '50.000'} [2024-08-06 01:59:32,071][52667] DAMAGECOUNT value on done: 259329.0 [2024-08-06 01:59:32,071][52667] Sum rewards: 74.865, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.108', 'HEALTH': '0.208', 'AMMO3': '0.219', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '61.000'} [2024-08-06 01:59:32,306][52650] Updated weights for policy 0, policy_version 34631 (0.0019) [2024-08-06 01:59:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 283705344. Throughput: 0: 4382.2. Samples: 70925590. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 01:59:32,794][52567] Avg episode reward: [(0, '64.754')] [2024-08-06 01:59:34,037][52665] DAMAGECOUNT value on done: 249920.0 [2024-08-06 01:59:34,041][52665] Sum rewards: 50.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.098', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO4': '0.223', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'weapon4': '0.676', 'WEAPON3': '1.400', 'HITCOUNT': '2.480', 'weapon3': '2.792', 'DAMAGECOUNT': '12.411', 'FRAGCOUNT': '46.000'} [2024-08-06 01:59:34,190][52649] DAMAGECOUNT value on done: 256435.0 [2024-08-06 01:59:34,193][52649] Sum rewards: 57.431, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.082', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.136', 'AMMO4': '0.248', 'AMMO3': '0.283', 'weapon4': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.826', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:34,709][52668] DAMAGECOUNT value on done: 260140.0 [2024-08-06 01:59:34,711][52668] Sum rewards: 70.783, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.188', 'AMMO3': '0.209', 'weapon4': '0.212', 'AMMO4': '0.239', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '58.000'} [2024-08-06 01:59:34,843][52667] DAMAGECOUNT value on done: 257599.0 [2024-08-06 01:59:34,844][52667] Sum rewards: 56.779, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.102', 'weapon5': '0.172', 'AMMO3': '0.207', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.188', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '49.000'} [2024-08-06 01:59:36,659][52650] Updated weights for policy 0, policy_version 34641 (0.0023) [2024-08-06 01:59:37,212][52665] DAMAGECOUNT value on done: 251446.0 [2024-08-06 01:59:37,213][52665] Sum rewards: 67.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.092', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.164', 'weapon4': '0.210', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '57.000'} [2024-08-06 01:59:37,229][52662] DAMAGECOUNT value on done: 262122.0 [2024-08-06 01:59:37,231][52662] Sum rewards: 52.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.746', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.168', 'AMMO3': '0.235', 'AMMO4': '0.237', 'weapon5': '0.238', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '44.500'} [2024-08-06 01:59:37,536][52668] DAMAGECOUNT value on done: 260472.0 [2024-08-06 01:59:37,539][52668] Sum rewards: 63.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.176', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.702', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '52.000'} [2024-08-06 01:59:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 283795456. Throughput: 0: 4379.6. Samples: 70952090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:59:37,794][52567] Avg episode reward: [(0, '64.522')] [2024-08-06 01:59:38,055][52667] DAMAGECOUNT value on done: 254058.0 [2024-08-06 01:59:38,057][52667] Sum rewards: 68.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.953', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.108', 'AMMO3': '0.209', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '56.000'} [2024-08-06 01:59:40,055][52665] DAMAGECOUNT value on done: 249484.0 [2024-08-06 01:59:40,057][52665] Sum rewards: 65.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.152', 'AMMO4': '0.224', 'AMMO3': '0.226', 'weapon2': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '56.000'} [2024-08-06 01:59:40,237][52662] DAMAGECOUNT value on done: 262200.0 [2024-08-06 01:59:40,238][52662] Sum rewards: 64.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.215', 'AMMO4': '0.225', 'weapon5': '0.276', 'weapon4': '0.280', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:40,517][52668] DAMAGECOUNT value on done: 249655.0 [2024-08-06 01:59:40,521][52668] Sum rewards: 66.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.162', 'AMMO3': '0.187', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'weapon2': '0.360', 'weapon4': '0.386', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:40,680][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 01:59:41,098][52667] DAMAGECOUNT value on done: 260278.0 [2024-08-06 01:59:41,099][52667] Sum rewards: 67.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.462', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.151', 'weapon5': '0.194', 'AMMO4': '0.208', 'weapon2': '0.250', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.910', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:41,540][52664] DAMAGECOUNT value on done: 263289.0 [2024-08-06 01:59:41,541][52664] Sum rewards: 64.146, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.752', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.102', 'AMMO4': '0.167', 'weapon2': '0.214', 'AMMO3': '0.241', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:41,766][52650] Updated weights for policy 0, policy_version 34651 (0.0024) [2024-08-06 01:59:42,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 283885568. Throughput: 0: 4373.5. Samples: 70978180. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:59:42,795][52567] Avg episode reward: [(0, '64.487')] [2024-08-06 01:59:43,057][52665] DAMAGECOUNT value on done: 253458.0 [2024-08-06 01:59:43,058][52665] Sum rewards: 51.868, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.676', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.124', 'weapon4': '0.206', 'AMMO3': '0.251', 'AMMO4': '0.266', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '3.064', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '48.000'} [2024-08-06 01:59:43,472][52668] DAMAGECOUNT value on done: 259042.0 [2024-08-06 01:59:43,470][52662] DAMAGECOUNT value on done: 261853.0 [2024-08-06 01:59:43,472][52668] Sum rewards: 67.712, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.725', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.152', 'AMMO4': '0.208', 'AMMO3': '0.233', 'weapon4': '0.250', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '59.000'} [2024-08-06 01:59:43,472][52662] Sum rewards: 72.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.136', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.156', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.706', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '60.000'} [2024-08-06 01:59:43,678][52667] DAMAGECOUNT value on done: 258094.0 [2024-08-06 01:59:43,679][52667] Sum rewards: 60.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.241', 'weapon2': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '52.000'} [2024-08-06 01:59:43,975][52664] DAMAGECOUNT value on done: 265064.0 [2024-08-06 01:59:43,975][52664] Sum rewards: 95.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.120', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.396', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.441', 'FRAGCOUNT': '77.000'} [2024-08-06 01:59:45,174][52660] DAMAGECOUNT value on done: 252836.0 [2024-08-06 01:59:45,175][52660] Sum rewards: 61.936, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.370', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.180', 'AMMO4': '0.226', 'AMMO3': '0.248', 'weapon2': '0.392', 'WEAPON5': '0.400', 'weapon4': '0.538', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.542', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:45,801][52665] DAMAGECOUNT value on done: 252401.0 [2024-08-06 01:59:45,802][52665] Sum rewards: 59.903, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.781', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.117', 'weapon5': '0.124', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.808', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '48.000'} [2024-08-06 01:59:45,961][52650] Updated weights for policy 0, policy_version 34661 (0.0024) [2024-08-06 01:59:45,986][52795] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 01:59:46,071][52662] DAMAGECOUNT value on done: 252404.0 [2024-08-06 01:59:46,072][52662] Sum rewards: 67.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'weapon4': '0.232', 'AMMO3': '0.274', 'weapon2': '0.320', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '58.000'} [2024-08-06 01:59:46,540][52667] DAMAGECOUNT value on done: 261525.0 [2024-08-06 01:59:46,540][52667] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.058', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.272', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.294', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '55.000'} [2024-08-06 01:59:46,610][52668] DAMAGECOUNT value on done: 256493.0 [2024-08-06 01:59:46,611][52668] Sum rewards: 64.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.925', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.088', 'weapon2': '0.116', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.582', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '56.000'} [2024-08-06 01:59:46,858][52664] DAMAGECOUNT value on done: 266147.0 [2024-08-06 01:59:46,859][52664] Sum rewards: 58.078, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.054', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'AMMO4': '0.268', 'WEAPON4': '0.450', 'weapon2': '0.554', 'weapon4': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.554', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '46.000'} [2024-08-06 01:59:47,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 283959296. Throughput: 0: 4374.4. Samples: 70991530. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:59:47,795][52567] Avg episode reward: [(0, '64.379')] [2024-08-06 01:59:48,303][52660] DAMAGECOUNT value on done: 252290.0 [2024-08-06 01:59:48,307][52660] Sum rewards: 67.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.370', 'AMMO5': '0.007', 'AMMO2': '0.069', 'weapon5': '0.110', 'weapon4': '0.164', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'AMMO4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.002', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '58.000'} [2024-08-06 01:59:48,851][52662] DAMAGECOUNT value on done: 257988.0 [2024-08-06 01:59:48,851][52662] Sum rewards: 59.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.982', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.096', 'weapon5': '0.106', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.256', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '51.000'} [2024-08-06 01:59:49,118][52667] DAMAGECOUNT value on done: 253722.0 [2024-08-06 01:59:49,119][52667] Sum rewards: 59.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.416', 'weapon2': '0.460', 'WEAPON3': '0.850', 'weapon3': '2.658', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '49.000'} [2024-08-06 01:59:49,632][52664] DAMAGECOUNT value on done: 264312.0 [2024-08-06 01:59:49,632][52664] Sum rewards: 61.727, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.300', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.100', 'weapon5': '0.162', 'AMMO3': '0.217', 'AMMO4': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:49,716][52668] DAMAGECOUNT value on done: 257562.0 [2024-08-06 01:59:49,718][52668] Sum rewards: 69.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.568', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.046', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'AMMO4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.144', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '58.000'} [2024-08-06 01:59:50,953][52650] Updated weights for policy 0, policy_version 34671 (0.0013) [2024-08-06 01:59:51,087][52660] DAMAGECOUNT value on done: 259344.0 [2024-08-06 01:59:51,087][52660] Sum rewards: 70.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.624', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.170', 'weapon2': '0.222', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.346', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '60.000'} [2024-08-06 01:59:51,866][52662] DAMAGECOUNT value on done: 254323.0 [2024-08-06 01:59:51,874][52662] Sum rewards: 54.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.182', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.322', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.040', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '46.000'} [2024-08-06 01:59:52,027][52667] DAMAGECOUNT value on done: 256197.0 [2024-08-06 01:59:52,038][52667] Sum rewards: 75.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.381', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '63.000'} [2024-08-06 01:59:52,108][52668] DAMAGECOUNT value on done: 257801.0 [2024-08-06 01:59:52,109][52668] Sum rewards: 76.675, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.231', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.490', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '64.000'} [2024-08-06 01:59:52,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 284057600. Throughput: 0: 4376.7. Samples: 71017850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 01:59:52,794][52567] Avg episode reward: [(0, '64.606')] [2024-08-06 01:59:52,892][52664] DAMAGECOUNT value on done: 265498.0 [2024-08-06 01:59:52,892][52664] Sum rewards: 74.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.233', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon2': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.264', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.178', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '63.000'} [2024-08-06 01:59:53,211][52795] DAMAGECOUNT value on done: 238669.0 [2024-08-06 01:59:53,212][52795] Sum rewards: 76.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.096', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.532', 'WEAPON3': '1.600', 'weapon3': '3.084', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '65.000'} [2024-08-06 01:59:53,716][52660] DAMAGECOUNT value on done: 258612.0 [2024-08-06 01:59:53,719][52660] Sum rewards: 74.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.050', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.826', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.000'} [2024-08-06 01:59:54,602][52667] DAMAGECOUNT value on done: 258840.0 [2024-08-06 01:59:54,602][52667] Sum rewards: 66.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '57.000'} [2024-08-06 01:59:54,650][52662] DAMAGECOUNT value on done: 261077.0 [2024-08-06 01:59:54,650][52662] Sum rewards: 63.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.276', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.142', 'weapon4': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.550', 'weapon3': '2.790', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:55,105][52668] DAMAGECOUNT value on done: 256841.0 [2024-08-06 01:59:55,107][52668] Sum rewards: 65.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.506', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.162', 'AMMO3': '0.210', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.828', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:55,431][52650] Updated weights for policy 0, policy_version 34681 (0.0011) [2024-08-06 01:59:55,554][52664] DAMAGECOUNT value on done: 265672.0 [2024-08-06 01:59:55,557][52664] Sum rewards: 60.616, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.382', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.182', 'AMMO4': '0.182', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.410', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:56,322][52795] DAMAGECOUNT value on done: 231436.0 [2024-08-06 01:59:56,324][52795] Sum rewards: 57.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.947', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.172', 'weapon5': '0.178', 'AMMO4': '0.272', 'weapon2': '0.386', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.760', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2024-08-06 01:59:56,730][52660] DAMAGECOUNT value on done: 255954.0 [2024-08-06 01:59:56,730][52660] Sum rewards: 71.716, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.031', 'HEALTH': '0.106', 'AMMO3': '0.140', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.572', 'WEAPON3': '0.850', 'weapon3': '2.646', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2024-08-06 01:59:57,385][52667] DAMAGECOUNT value on done: 258194.0 [2024-08-06 01:59:57,393][52667] Sum rewards: 47.537, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.164', 'AMMO5': '0.023', 'ARMOR': '0.032', 'AMMO2': '0.052', 'weapon2': '0.240', 'AMMO4': '0.258', 'AMMO3': '0.296', 'weapon5': '0.322', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.824', 'WEAPON3': '1.700', 'weapon3': '2.110', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '44.000'} [2024-08-06 01:59:57,406][52669] DAMAGECOUNT value on done: 258685.0 [2024-08-06 01:59:57,408][52669] Sum rewards: 65.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.428', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.138', 'weapon4': '0.166', 'AMMO4': '0.169', 'AMMO3': '0.170', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.130', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 01:59:57,454][52662] DAMAGECOUNT value on done: 264753.0 [2024-08-06 01:59:57,454][52662] Sum rewards: 62.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.258', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.128', 'weapon4': '0.154', 'AMMO3': '0.221', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 01:59:57,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 284147712. Throughput: 0: 4385.1. Samples: 71044400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 01:59:57,794][52567] Avg episode reward: [(0, '65.045')] [2024-08-06 01:59:57,936][52668] DAMAGECOUNT value on done: 258271.0 [2024-08-06 01:59:57,939][52668] Sum rewards: 67.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '56.000'} [2024-08-06 01:59:58,128][52664] DAMAGECOUNT value on done: 269261.0 [2024-08-06 01:59:58,136][52664] Sum rewards: 61.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.587', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.258', 'weapon4': '0.286', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.316', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '52.000'} [2024-08-06 01:59:59,436][52795] DAMAGECOUNT value on done: 232661.0 [2024-08-06 01:59:59,438][52795] Sum rewards: 59.109, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.672', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.097', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.148', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '48.500'} [2024-08-06 01:59:59,523][52660] DAMAGECOUNT value on done: 251617.0 [2024-08-06 01:59:59,525][52660] Sum rewards: 52.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.230', 'weapon2': '0.492', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '3.012', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '45.000'} [2024-08-06 01:59:59,680][52667] DAMAGECOUNT value on done: 259071.0 [2024-08-06 01:59:59,680][52667] Sum rewards: 69.605, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.082', 'AMMO4': '0.107', 'weapon5': '0.140', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '2.960', 'weapon3': '2.986', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:00,151][52669] DAMAGECOUNT value on done: 253212.0 [2024-08-06 02:00:00,152][52669] Sum rewards: 59.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '49.000'} [2024-08-06 02:00:00,276][52650] Updated weights for policy 0, policy_version 34691 (0.0025) [2024-08-06 02:00:00,529][52662] DAMAGECOUNT value on done: 256689.0 [2024-08-06 02:00:00,530][52662] Sum rewards: 57.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.795', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.152', 'AMMO4': '0.220', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '49.000'} [2024-08-06 02:00:00,934][52664] DAMAGECOUNT value on done: 260109.0 [2024-08-06 02:00:00,936][52664] Sum rewards: 54.874, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.970', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.108', 'AMMO3': '0.212', 'AMMO4': '0.213', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '46.500'} [2024-08-06 02:00:00,961][52668] DAMAGECOUNT value on done: 253840.0 [2024-08-06 02:00:00,962][52668] Sum rewards: 56.794, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.044', 'AMMO3': '0.131', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.222', 'HEALTH': '0.317', 'WEAPON4': '0.400', 'weapon4': '0.520', 'WEAPON3': '0.750', 'weapon2': '1.040', 'weapon3': '2.036', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '44.000'} [2024-08-06 02:00:02,478][52795] DAMAGECOUNT value on done: 237230.0 [2024-08-06 02:00:02,479][52795] Sum rewards: 56.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.168', 'AMMO4': '0.269', 'weapon5': '0.290', 'weapon4': '0.396', 'WEAPON5': '0.550', 'weapon2': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.420', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '47.500'} [2024-08-06 02:00:02,567][52660] DAMAGECOUNT value on done: 259879.0 [2024-08-06 02:00:02,569][52660] Sum rewards: 78.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO3': '0.228', 'AMMO4': '0.260', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '65.000'} [2024-08-06 02:00:02,654][52669] DAMAGECOUNT value on done: 258302.0 [2024-08-06 02:00:02,654][52669] Sum rewards: 50.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '3.090', 'DAMAGECOUNT': '12.651', 'FRAGCOUNT': '43.000'} [2024-08-06 02:00:02,754][52667] DAMAGECOUNT value on done: 257944.0 [2024-08-06 02:00:02,754][52667] Sum rewards: 55.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.410', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.156', 'AMMO3': '0.222', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.414', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '48.000'} [2024-08-06 02:00:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 284229632. Throughput: 0: 4382.0. Samples: 71057510. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 02:00:02,794][52567] Avg episode reward: [(0, '64.198')] [2024-08-06 02:00:03,438][52662] DAMAGECOUNT value on done: 269260.0 [2024-08-06 02:00:03,440][52662] Sum rewards: 71.599, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.463', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.140', 'weapon4': '0.232', 'AMMO4': '0.248', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '61.500'} [2024-08-06 02:00:03,929][52664] DAMAGECOUNT value on done: 272813.0 [2024-08-06 02:00:03,930][52664] Sum rewards: 58.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.420', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.290', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '48.000'} [2024-08-06 02:00:04,059][52668] DAMAGECOUNT value on done: 247350.0 [2024-08-06 02:00:04,060][52668] Sum rewards: 64.838, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO4': '0.168', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:04,609][52650] Updated weights for policy 0, policy_version 34701 (0.0012) [2024-08-06 02:00:05,318][52660] DAMAGECOUNT value on done: 262543.0 [2024-08-06 02:00:05,319][52660] Sum rewards: 77.447, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.264', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.262', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '63.000'} [2024-08-06 02:00:05,384][52667] DAMAGECOUNT value on done: 253401.0 [2024-08-06 02:00:05,384][52667] Sum rewards: 65.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.132', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.216', 'weapon5': '0.244', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.450', 'weapon4': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.440', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:05,571][52795] DAMAGECOUNT value on done: 240410.0 [2024-08-06 02:00:05,574][52795] Sum rewards: 61.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.537', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.410', 'weapon4': '0.438', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:05,767][52669] DAMAGECOUNT value on done: 256146.0 [2024-08-06 02:00:05,767][52669] Sum rewards: 66.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.101', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.146', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.690', 'WEAPON3': '0.850', 'weapon3': '2.850', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:06,195][52662] DAMAGECOUNT value on done: 258010.0 [2024-08-06 02:00:06,197][52662] Sum rewards: 62.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.845', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.114', 'weapon5': '0.214', 'AMMO4': '0.232', 'AMMO3': '0.238', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:06,329][52794] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 02:00:06,512][52664] DAMAGECOUNT value on done: 265131.0 [2024-08-06 02:00:06,513][52664] Sum rewards: 55.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.034', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.562', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.176', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '47.000'} [2024-08-06 02:00:06,781][52794] DAMAGECOUNT value on done: 259814.0 [2024-08-06 02:00:06,781][52794] Sum rewards: 76.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.586', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO3': '0.199', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.450', 'weapon3': '3.514', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '63.000'} [2024-08-06 02:00:06,840][52668] DAMAGECOUNT value on done: 249932.0 [2024-08-06 02:00:06,841][52668] Sum rewards: 56.863, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.315', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.160', 'weapon4': '0.166', 'AMMO4': '0.175', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.000', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 284319744. Throughput: 0: 4387.8. Samples: 71084060. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 02:00:07,794][52567] Avg episode reward: [(0, '64.253')] [2024-08-06 02:00:08,043][52660] DAMAGECOUNT value on done: 259964.0 [2024-08-06 02:00:08,044][52660] Sum rewards: 62.038, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.118', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.060', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '49.000'} [2024-08-06 02:00:08,328][52667] DAMAGECOUNT value on done: 262325.0 [2024-08-06 02:00:08,329][52667] Sum rewards: 61.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.017', 'weapon5': '0.042', 'AMMO2': '0.045', 'weapon4': '0.132', 'AMMO3': '0.175', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.756', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:08,648][52795] DAMAGECOUNT value on done: 237372.0 [2024-08-06 02:00:08,648][52795] Sum rewards: 69.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.358', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.462', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:08,856][52662] DAMAGECOUNT value on done: 257241.0 [2024-08-06 02:00:08,858][52662] Sum rewards: 53.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.418', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.126', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.560', 'FRAGCOUNT': '45.000'} [2024-08-06 02:00:08,874][52669] DAMAGECOUNT value on done: 253604.0 [2024-08-06 02:00:08,874][52669] Sum rewards: 55.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.671', 'weapon7': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.690', 'WEAPON3': '1.350', 'weapon3': '2.796', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '47.500'} [2024-08-06 02:00:09,184][52668] DAMAGECOUNT value on done: 252620.0 [2024-08-06 02:00:09,184][52668] Sum rewards: 69.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.542', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.091', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '58.000'} [2024-08-06 02:00:09,280][52650] Updated weights for policy 0, policy_version 34711 (0.0012) [2024-08-06 02:00:09,560][52664] DAMAGECOUNT value on done: 268884.0 [2024-08-06 02:00:09,562][52664] Sum rewards: 69.563, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.108', 'AMMO3': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.362', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:09,641][52794] DAMAGECOUNT value on done: 263132.0 [2024-08-06 02:00:09,641][52794] Sum rewards: 62.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon7': '0.048', 'weapon5': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.154', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.233', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.146', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '52.000'} [2024-08-06 02:00:10,563][52660] DAMAGECOUNT value on done: 253976.0 [2024-08-06 02:00:10,564][52660] Sum rewards: 67.445, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.034', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.020', 'AMMO4': '0.089', 'weapon5': '0.122', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.346', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:11,133][52667] DAMAGECOUNT value on done: 266196.0 [2024-08-06 02:00:11,134][52667] Sum rewards: 66.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.872', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.238', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:11,247][52660] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:00:11,554][52669] DAMAGECOUNT value on done: 255874.0 [2024-08-06 02:00:11,554][52669] Sum rewards: 68.007, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.126', 'AMMO4': '0.143', 'weapon5': '0.166', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:11,731][52795] DAMAGECOUNT value on done: 240473.0 [2024-08-06 02:00:11,732][52795] Sum rewards: 56.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.144', 'AMMO4': '0.212', 'AMMO3': '0.215', 'weapon2': '0.220', 'weapon5': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '2.948', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '48.000'} [2024-08-06 02:00:11,878][52664] DAMAGECOUNT value on done: 265742.0 [2024-08-06 02:00:11,878][52664] Sum rewards: 74.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.652', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '64.000'} [2024-08-06 02:00:11,926][52662] DAMAGECOUNT value on done: 257699.0 [2024-08-06 02:00:11,927][52662] Sum rewards: 60.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.865', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.106', 'AMMO4': '0.136', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '52.000'} [2024-08-06 02:00:11,928][52668] DAMAGECOUNT value on done: 254593.0 [2024-08-06 02:00:11,931][52668] Sum rewards: 66.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.765', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.076', 'weapon2': '0.150', 'AMMO3': '0.157', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.698', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:12,773][52794] DAMAGECOUNT value on done: 258323.0 [2024-08-06 02:00:12,784][52794] Sum rewards: 53.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.446', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.110', 'AMMO4': '0.112', 'weapon4': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '3.238', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '46.000'} [2024-08-06 02:00:12,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17522.5). Total num frames: 284418048. Throughput: 0: 4400.2. Samples: 71110490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 02:00:12,794][52567] Avg episode reward: [(0, '64.276')] [2024-08-06 02:00:13,577][52660] DAMAGECOUNT value on done: 262109.0 [2024-08-06 02:00:13,581][52660] Sum rewards: 53.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.134', 'AMMO3': '0.189', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.950', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '45.000'} [2024-08-06 02:00:13,721][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:00:14,030][52669] DAMAGECOUNT value on done: 258898.0 [2024-08-06 02:00:14,032][52669] Sum rewards: 73.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.208', 'weapon2': '0.302', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:14,219][52667] DAMAGECOUNT value on done: 261309.0 [2024-08-06 02:00:14,220][52667] Sum rewards: 64.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.868', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon2': '0.238', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.374', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:14,342][52650] Updated weights for policy 0, policy_version 34721 (0.0011) [2024-08-06 02:00:14,838][52795] DAMAGECOUNT value on done: 238187.0 [2024-08-06 02:00:14,839][52795] Sum rewards: 63.684, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.228', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.173', 'weapon2': '0.184', 'AMMO3': '0.251', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.264', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:14,915][52668] DAMAGECOUNT value on done: 254705.0 [2024-08-06 02:00:14,915][52668] Sum rewards: 64.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.190', 'weapon2': '0.194', 'weapon5': '0.216', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '54.000'} [2024-08-06 02:00:14,945][52664] DAMAGECOUNT value on done: 268876.0 [2024-08-06 02:00:14,945][52664] Sum rewards: 71.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.882', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.185', 'AMMO3': '0.193', 'weapon4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:15,253][52662] DAMAGECOUNT value on done: 265402.0 [2024-08-06 02:00:15,254][52662] Sum rewards: 69.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.100', 'AMMO4': '0.204', 'AMMO3': '0.212', 'weapon2': '0.284', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:15,482][52658] DAMAGECOUNT value on done: 259040.0 [2024-08-06 02:00:15,482][52658] Sum rewards: 62.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.416', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '54.000'} [2024-08-06 02:00:15,871][52794] DAMAGECOUNT value on done: 258975.0 [2024-08-06 02:00:15,876][52794] Sum rewards: 81.939, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.482', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.249', 'weapon4': '0.420', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '71.000'} [2024-08-06 02:00:16,622][52669] DAMAGECOUNT value on done: 256694.0 [2024-08-06 02:00:16,623][52669] Sum rewards: 64.210, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.100', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.036', 'weapon5': '0.154', 'AMMO4': '0.178', 'weapon4': '0.218', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:16,641][52660] DAMAGECOUNT value on done: 246546.0 [2024-08-06 02:00:16,644][52660] Sum rewards: 66.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.546', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:17,040][52667] DAMAGECOUNT value on done: 262857.0 [2024-08-06 02:00:17,043][52667] Sum rewards: 69.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.071', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.166', 'weapon4': '0.170', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:17,592][52662] DAMAGECOUNT value on done: 258682.0 [2024-08-06 02:00:17,593][52662] Sum rewards: 46.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.898', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon5': '0.144', 'weapon4': '0.164', 'AMMO4': '0.172', 'weapon2': '0.228', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.440', 'weapon3': '3.132', 'DAMAGECOUNT': '12.636', 'FRAGCOUNT': '44.000'} [2024-08-06 02:00:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 284499968. Throughput: 0: 4402.9. Samples: 71123720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:00:17,802][52567] Avg episode reward: [(0, '64.246')] [2024-08-06 02:00:17,921][52664] DAMAGECOUNT value on done: 265612.0 [2024-08-06 02:00:17,921][52664] Sum rewards: 71.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.406', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO3': '0.165', 'AMMO4': '0.180', 'weapon4': '0.262', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '61.000'} [2024-08-06 02:00:17,972][52795] DAMAGECOUNT value on done: 235416.0 [2024-08-06 02:00:17,975][52795] Sum rewards: 60.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.785', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.134', 'AMMO4': '0.195', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:17,986][52668] DAMAGECOUNT value on done: 256788.0 [2024-08-06 02:00:17,986][52668] Sum rewards: 64.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.126', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.322', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '55.500'} [2024-08-06 02:00:18,255][52650] Updated weights for policy 0, policy_version 34731 (0.0029) [2024-08-06 02:00:18,343][52658] DAMAGECOUNT value on done: 259577.0 [2024-08-06 02:00:18,343][52658] Sum rewards: 58.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.215', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:18,589][52794] DAMAGECOUNT value on done: 255683.0 [2024-08-06 02:00:18,591][52794] Sum rewards: 59.957, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.830', 'ARMOR': '0.004', 'AMMO2': '0.036', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.178', 'weapon2': '0.230', 'AMMO3': '0.282', 'WEAPON3': '1.700', 'HITCOUNT': '3.230', 'weapon3': '3.462', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '54.000'} [2024-08-06 02:00:19,576][52669] DAMAGECOUNT value on done: 257931.0 [2024-08-06 02:00:19,578][52669] Sum rewards: 58.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.810', 'AMMO5': '0.015', 'AMMO2': '0.062', 'AMMO3': '0.234', 'weapon5': '0.238', 'weapon4': '0.278', 'weapon2': '0.304', 'AMMO4': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '48.000'} [2024-08-06 02:00:19,587][52660] DAMAGECOUNT value on done: 253087.0 [2024-08-06 02:00:19,588][52660] Sum rewards: 67.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.284', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '58.000'} [2024-08-06 02:00:19,748][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:00:20,404][52667] DAMAGECOUNT value on done: 253439.0 [2024-08-06 02:00:20,404][52667] Sum rewards: 70.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.985', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO3': '0.153', 'AMMO4': '0.178', 'weapon2': '0.302', 'WEAPON5': '0.400', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:20,812][52664] DAMAGECOUNT value on done: 269190.0 [2024-08-06 02:00:20,813][52664] Sum rewards: 57.134, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.465', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'weapon4': '0.190', 'AMMO3': '0.282', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.012', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '52.000'} [2024-08-06 02:00:20,824][52662] DAMAGECOUNT value on done: 267231.0 [2024-08-06 02:00:20,826][52662] Sum rewards: 66.548, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.506', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.167', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '3.334', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:20,884][52668] DAMAGECOUNT value on done: 259514.0 [2024-08-06 02:00:20,887][52668] Sum rewards: 58.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.155', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.210', 'AMMO3': '0.211', 'weapon2': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.194', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '48.500'} [2024-08-06 02:00:20,949][52795] DAMAGECOUNT value on done: 242449.0 [2024-08-06 02:00:20,950][52795] Sum rewards: 68.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.016', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.145', 'AMMO3': '0.190', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '56.500'} [2024-08-06 02:00:21,388][52658] DAMAGECOUNT value on done: 259230.0 [2024-08-06 02:00:21,389][52658] Sum rewards: 55.588, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.054', 'weapon4': '0.080', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.310', 'WEAPON3': '1.750', 'HITCOUNT': '3.080', 'weapon3': '3.422', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:21,686][52794] DAMAGECOUNT value on done: 258768.0 [2024-08-06 02:00:21,687][52794] Sum rewards: 70.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.908', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon4': '0.086', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.215', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:22,333][52660] DAMAGECOUNT value on done: 261852.0 [2024-08-06 02:00:22,333][52660] Sum rewards: 69.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.102', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:22,633][52667] DAMAGECOUNT value on done: 259166.0 [2024-08-06 02:00:22,635][52667] Sum rewards: 60.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO3': '0.155', 'AMMO4': '0.159', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '0.850', 'weapon3': '2.902', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '49.000'} [2024-08-06 02:00:22,672][52669] DAMAGECOUNT value on done: 252914.0 [2024-08-06 02:00:22,673][52669] Sum rewards: 59.853, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.148', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon2': '0.142', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon4': '0.352', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.258', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '54.000'} [2024-08-06 02:00:22,794][52567] Fps is (10 sec: 15564.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 284573696. Throughput: 0: 4402.9. Samples: 71150220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:00:22,802][52567] Avg episode reward: [(0, '64.264')] [2024-08-06 02:00:23,306][52662] DAMAGECOUNT value on done: 259908.0 [2024-08-06 02:00:23,307][52662] Sum rewards: 75.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.066', 'WEAPON4': '0.150', 'AMMO4': '0.171', 'weapon2': '0.214', 'AMMO3': '0.216', 'weapon4': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 02:00:23,363][52650] Updated weights for policy 0, policy_version 34741 (0.0016) [2024-08-06 02:00:23,700][52664] DAMAGECOUNT value on done: 262530.0 [2024-08-06 02:00:23,700][52664] Sum rewards: 61.094, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'HEALTH': '0.040', 'AMMO2': '0.040', 'weapon5': '0.078', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.200', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.864', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:23,786][52668] DAMAGECOUNT value on done: 255034.0 [2024-08-06 02:00:23,786][52668] Sum rewards: 52.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.222', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.178', 'AMMO3': '0.233', 'weapon2': '0.272', 'WEAPON5': '0.300', 'AMMO4': '0.301', 'WEAPON4': '0.550', 'weapon4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.516', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '46.000'} [2024-08-06 02:00:23,894][52658] DAMAGECOUNT value on done: 258378.0 [2024-08-06 02:00:23,897][52658] Sum rewards: 57.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.276', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.046', 'AMMO4': '0.141', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.470', 'weapon4': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:24,201][52795] DAMAGECOUNT value on done: 237583.0 [2024-08-06 02:00:24,201][52795] Sum rewards: 54.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.156', 'weapon4': '0.202', 'AMMO3': '0.218', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.112', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '47.000'} [2024-08-06 02:00:24,207][52803] DAMAGECOUNT value on done: 238950.0 [2024-08-06 02:00:24,207][52803] Sum rewards: 56.754, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.215', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.151', 'AMMO4': '0.204', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.438', 'weapon4': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.536', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '45.000'} [2024-08-06 02:00:24,315][52794] DAMAGECOUNT value on done: 262603.0 [2024-08-06 02:00:24,315][52794] Sum rewards: 69.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.632', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.052', 'AMMO4': '0.161', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '58.000'} [2024-08-06 02:00:25,396][52660] DAMAGECOUNT value on done: 265628.0 [2024-08-06 02:00:25,399][52660] Sum rewards: 60.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.446', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.232', 'AMMO4': '0.264', 'weapon5': '0.312', 'weapon4': '0.334', 'weapon2': '0.380', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.568', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '54.500'} [2024-08-06 02:00:25,672][52669] DAMAGECOUNT value on done: 259757.0 [2024-08-06 02:00:25,672][52669] Sum rewards: 64.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.765', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.166', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '53.500'} [2024-08-06 02:00:26,241][52664] DAMAGECOUNT value on done: 267966.0 [2024-08-06 02:00:26,242][52664] Sum rewards: 74.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.321', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.189', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '61.000'} [2024-08-06 02:00:26,388][52662] DAMAGECOUNT value on done: 261274.0 [2024-08-06 02:00:26,391][52662] Sum rewards: 72.565, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.254', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon4': '0.284', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '60.000'} [2024-08-06 02:00:27,046][52658] DAMAGECOUNT value on done: 259732.0 [2024-08-06 02:00:27,051][52658] Sum rewards: 73.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.114', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '3.136', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '61.000'} [2024-08-06 02:00:27,357][52803] DAMAGECOUNT value on done: 239345.0 [2024-08-06 02:00:27,359][52803] Sum rewards: 60.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.178', 'AMMO3': '0.195', 'AMMO4': '0.230', 'weapon4': '0.320', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.836', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '49.000'} [2024-08-06 02:00:27,395][52795] DAMAGECOUNT value on done: 235585.0 [2024-08-06 02:00:27,399][52795] Sum rewards: 62.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.140', 'AMMO4': '0.205', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '54.000'} [2024-08-06 02:00:27,477][52794] DAMAGECOUNT value on done: 257606.0 [2024-08-06 02:00:27,477][52794] Sum rewards: 55.778, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.028', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'weapon2': '0.306', 'AMMO3': '0.314', 'WEAPON3': '1.850', 'HITCOUNT': '3.000', 'weapon3': '3.320', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 284672000. Throughput: 0: 4407.4. Samples: 71176510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:00:27,795][52567] Avg episode reward: [(0, '63.886')] [2024-08-06 02:00:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000034750_284672000.pth... [2024-08-06 02:00:27,975][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000034236_280461312.pth [2024-08-06 02:00:28,088][52650] Updated weights for policy 0, policy_version 34751 (0.0033) [2024-08-06 02:00:28,260][52669] DAMAGECOUNT value on done: 257914.0 [2024-08-06 02:00:28,260][52669] Sum rewards: 56.157, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.050', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.156', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '3.550', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '50.500'} [2024-08-06 02:00:28,538][52660] DAMAGECOUNT value on done: 252481.0 [2024-08-06 02:00:28,539][52660] Sum rewards: 71.642, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.106', 'AMMO3': '0.198', 'weapon5': '0.228', 'AMMO4': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 02:00:29,081][52664] DAMAGECOUNT value on done: 268459.0 [2024-08-06 02:00:29,082][52664] Sum rewards: 65.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.218', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon2': '0.220', 'AMMO3': '0.231', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.538', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:29,372][52614] Signal inference workers to stop experience collection... (6250 times) [2024-08-06 02:00:29,373][52614] Signal inference workers to resume experience collection... (6250 times) [2024-08-06 02:00:29,454][52650] InferenceWorker_p0-w0: stopping experience collection (6250 times) [2024-08-06 02:00:29,454][52650] InferenceWorker_p0-w0: resuming experience collection (6250 times) [2024-08-06 02:00:29,789][52662] DAMAGECOUNT value on done: 258863.0 [2024-08-06 02:00:29,791][52662] Sum rewards: 65.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.084', 'AMMO3': '0.204', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.354', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:29,942][52658] DAMAGECOUNT value on done: 256024.0 [2024-08-06 02:00:29,942][52658] Sum rewards: 61.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon2': '0.182', 'AMMO3': '0.188', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '3.618', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '52.000'} [2024-08-06 02:00:30,458][52803] DAMAGECOUNT value on done: 239348.0 [2024-08-06 02:00:30,459][52803] Sum rewards: 60.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.122', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:30,462][52794] DAMAGECOUNT value on done: 263327.0 [2024-08-06 02:00:30,464][52794] Sum rewards: 57.242, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.156', 'AMMO4': '0.157', 'weapon5': '0.172', 'weapon2': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.124', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:30,576][52795] DAMAGECOUNT value on done: 234081.0 [2024-08-06 02:00:30,576][52795] Sum rewards: 63.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.190', 'AMMO4': '0.191', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.324', 'weapon4': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '54.000'} [2024-08-06 02:00:30,588][52811] DAMAGECOUNT value on done: 249924.0 [2024-08-06 02:00:30,589][52811] Sum rewards: 59.045, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '52.500'} [2024-08-06 02:00:31,173][52660] DAMAGECOUNT value on done: 257990.0 [2024-08-06 02:00:31,173][52660] Sum rewards: 71.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.037', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.322', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '63.000'} [2024-08-06 02:00:31,211][52669] DAMAGECOUNT value on done: 255190.0 [2024-08-06 02:00:31,211][52669] Sum rewards: 64.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.136', 'AMMO3': '0.189', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.700', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '54.000'} [2024-08-06 02:00:31,691][52664] DAMAGECOUNT value on done: 266127.0 [2024-08-06 02:00:31,692][52664] Sum rewards: 69.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.084', 'weapon4': '0.178', 'AMMO3': '0.190', 'AMMO4': '0.196', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:32,403][52662] DAMAGECOUNT value on done: 254207.0 [2024-08-06 02:00:32,407][52662] Sum rewards: 58.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.148', 'weapon4': '0.154', 'AMMO3': '0.188', 'AMMO4': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '49.000'} [2024-08-06 02:00:32,573][52650] Updated weights for policy 0, policy_version 34761 (0.0027) [2024-08-06 02:00:32,763][52658] DAMAGECOUNT value on done: 264038.0 [2024-08-06 02:00:32,764][52658] Sum rewards: 55.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.465', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.070', 'AMMO3': '0.202', 'AMMO4': '0.207', 'weapon4': '0.266', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.040', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '48.000'} [2024-08-06 02:00:32,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 284762112. Throughput: 0: 4393.6. Samples: 71189240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:00:32,794][52567] Avg episode reward: [(0, '63.470')] [2024-08-06 02:00:33,267][52794] DAMAGECOUNT value on done: 260643.0 [2024-08-06 02:00:33,275][52794] Sum rewards: 70.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.092', 'weapon4': '0.142', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:33,530][52803] DAMAGECOUNT value on done: 241400.0 [2024-08-06 02:00:33,531][52803] Sum rewards: 67.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.015', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.257', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2024-08-06 02:00:33,604][52811] DAMAGECOUNT value on done: 238264.0 [2024-08-06 02:00:33,607][52811] Sum rewards: 77.502, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon5': '0.126', 'AMMO3': '0.130', 'weapon4': '0.348', 'weapon2': '0.364', 'HEALTH': '0.647', 'WEAPON3': '0.750', 'weapon3': '2.910', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '62.000'} [2024-08-06 02:00:33,637][52795] DAMAGECOUNT value on done: 236997.0 [2024-08-06 02:00:33,640][52795] Sum rewards: 61.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon4': '0.214', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.138', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:33,919][52669] DAMAGECOUNT value on done: 259764.0 [2024-08-06 02:00:33,919][52669] Sum rewards: 67.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.076', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.268', 'weapon4': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:34,245][52660] DAMAGECOUNT value on done: 247708.0 [2024-08-06 02:00:34,245][52660] Sum rewards: 61.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon2': '0.374', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.048', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:34,461][52664] DAMAGECOUNT value on done: 267972.0 [2024-08-06 02:00:34,462][52664] Sum rewards: 71.210, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.923', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:36,024][52658] DAMAGECOUNT value on done: 252186.0 [2024-08-06 02:00:36,026][52658] Sum rewards: 71.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.322', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.090', 'weapon5': '0.092', 'AMMO4': '0.139', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.738', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:36,296][52794] DAMAGECOUNT value on done: 259232.0 [2024-08-06 02:00:36,297][52794] Sum rewards: 66.899, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.475', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO3': '0.252', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 02:00:36,489][52803] DAMAGECOUNT value on done: 242039.0 [2024-08-06 02:00:36,491][52803] Sum rewards: 64.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon5': '0.062', 'AMMO3': '0.225', 'weapon2': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.340', 'weapon3': '3.578', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:36,698][52811] DAMAGECOUNT value on done: 239911.0 [2024-08-06 02:00:36,699][52811] Sum rewards: 69.147, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.447', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.082', 'weapon5': '0.098', 'AMMO4': '0.109', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '61.000'} [2024-08-06 02:00:36,781][52669] DAMAGECOUNT value on done: 261358.0 [2024-08-06 02:00:36,783][52669] Sum rewards: 67.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.110', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:36,813][52795] DAMAGECOUNT value on done: 229795.0 [2024-08-06 02:00:36,813][52795] Sum rewards: 63.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.259', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.196', 'AMMO3': '0.205', 'AMMO4': '0.229', 'weapon2': '0.380', 'WEAPON5': '0.400', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.646', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:37,265][52660] DAMAGECOUNT value on done: 257165.0 [2024-08-06 02:00:37,265][52660] Sum rewards: 60.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.220', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:37,525][52650] Updated weights for policy 0, policy_version 34771 (0.0013) [2024-08-06 02:00:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 284844032. Throughput: 0: 4390.2. Samples: 71215410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:00:37,795][52567] Avg episode reward: [(0, '64.345')] [2024-08-06 02:00:38,874][52658] DAMAGECOUNT value on done: 263907.0 [2024-08-06 02:00:38,877][52658] Sum rewards: 72.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.125', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.100', 'AMMO4': '0.142', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '62.000'} [2024-08-06 02:00:39,122][52794] DAMAGECOUNT value on done: 257957.0 [2024-08-06 02:00:39,122][52794] Sum rewards: 70.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.060', 'weapon5': '0.078', 'AMMO4': '0.105', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.330', 'weapon3': '3.344', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:39,593][52669] DAMAGECOUNT value on done: 270439.0 [2024-08-06 02:00:39,593][52669] Sum rewards: 70.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon4': '0.132', 'weapon5': '0.178', 'AMMO3': '0.206', 'weapon2': '0.252', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.000'} [2024-08-06 02:00:39,604][52803] DAMAGECOUNT value on done: 242032.0 [2024-08-06 02:00:39,604][52803] Sum rewards: 58.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.114', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.364', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '3.236', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:39,993][52795] DAMAGECOUNT value on done: 244112.0 [2024-08-06 02:00:39,993][52795] Sum rewards: 67.628, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.551', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.229', 'weapon2': '0.230', 'AMMO3': '0.264', 'weapon4': '0.296', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.174', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 02:00:40,155][52811] DAMAGECOUNT value on done: 238917.0 [2024-08-06 02:00:40,156][52811] Sum rewards: 70.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.410', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.147', 'weapon5': '0.166', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'weapon4': '0.560', 'WEAPON3': '0.850', 'weapon3': '2.568', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:40,492][52660] DAMAGECOUNT value on done: 253731.0 [2024-08-06 02:00:40,492][52660] Sum rewards: 66.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.245', 'weapon2': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '3.340', 'weapon3': '3.560', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:41,541][52658] DAMAGECOUNT value on done: 260829.0 [2024-08-06 02:00:41,542][52658] Sum rewards: 57.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.525', 'AMMO5': '0.022', 'AMMO2': '0.070', 'AMMO3': '0.205', 'weapon2': '0.264', 'weapon5': '0.298', 'AMMO4': '0.348', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'weapon4': '0.938', 'WEAPON3': '1.150', 'weapon3': '2.084', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '49.000'} [2024-08-06 02:00:41,926][52794] DAMAGECOUNT value on done: 254717.0 [2024-08-06 02:00:41,927][52794] Sum rewards: 64.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.304', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.134', 'weapon5': '0.146', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.750', 'weapon3': '3.098', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:42,153][52650] Updated weights for policy 0, policy_version 34781 (0.0014) [2024-08-06 02:00:42,357][52669] DAMAGECOUNT value on done: 256396.0 [2024-08-06 02:00:42,357][52669] Sum rewards: 70.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.711', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.044', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.318', 'weapon2': '0.436', 'WEAPON3': '1.850', 'weapon3': '3.204', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '62.000'} [2024-08-06 02:00:42,628][52803] DAMAGECOUNT value on done: 237282.0 [2024-08-06 02:00:42,629][52803] Sum rewards: 53.897, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.424', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.054', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'AMMO3': '0.308', 'weapon2': '0.322', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.928', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2024-08-06 02:00:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 284934144. Throughput: 0: 4382.7. Samples: 71241620. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:00:42,794][52567] Avg episode reward: [(0, '64.404')] [2024-08-06 02:00:43,024][52795] DAMAGECOUNT value on done: 240237.0 [2024-08-06 02:00:43,025][52795] Sum rewards: 63.367, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.119', 'AMMO4': '0.135', 'weapon5': '0.186', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '1.092', 'weapon3': '2.130', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:43,319][52811] DAMAGECOUNT value on done: 239398.0 [2024-08-06 02:00:43,320][52811] Sum rewards: 67.453, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.278', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:44,433][52658] DAMAGECOUNT value on done: 264910.0 [2024-08-06 02:00:44,433][52658] Sum rewards: 64.523, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.158', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.700', 'weapon3': '3.166', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:44,953][52669] DAMAGECOUNT value on done: 263877.0 [2024-08-06 02:00:44,956][52669] Sum rewards: 62.831, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.108', 'weapon4': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.302', 'AMMO3': '0.317', 'WEAPON3': '1.850', 'weapon3': '3.142', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:45,253][52794] DAMAGECOUNT value on done: 267780.0 [2024-08-06 02:00:45,253][52794] Sum rewards: 62.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.168', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '52.000'} [2024-08-06 02:00:45,339][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:00:45,515][52671] DAMAGECOUNT value on done: 261753.0 [2024-08-06 02:00:45,516][52671] Sum rewards: 63.214, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.038', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.472', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '55.500'} [2024-08-06 02:00:45,846][52803] DAMAGECOUNT value on done: 235962.0 [2024-08-06 02:00:45,848][52803] Sum rewards: 57.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.405', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.202', 'weapon2': '0.220', 'AMMO3': '0.242', 'weapon5': '0.246', 'AMMO4': '0.307', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.088', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:45,937][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:00:46,272][52795] DAMAGECOUNT value on done: 230809.0 [2024-08-06 02:00:46,272][52795] Sum rewards: 62.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.024', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.484', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:46,308][52811] DAMAGECOUNT value on done: 246210.0 [2024-08-06 02:00:46,310][52811] Sum rewards: 70.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.178', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.296', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '60.000'} [2024-08-06 02:00:46,724][52650] Updated weights for policy 0, policy_version 34791 (0.0014) [2024-08-06 02:00:47,303][52658] DAMAGECOUNT value on done: 250197.0 [2024-08-06 02:00:47,304][52658] Sum rewards: 66.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.400', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.124', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.260', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:47,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17749.4, 300 sec: 17522.6). Total num frames: 285024256. Throughput: 0: 4384.4. Samples: 71254810. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:00:47,794][52567] Avg episode reward: [(0, '64.434')] [2024-08-06 02:00:48,124][52669] DAMAGECOUNT value on done: 262323.0 [2024-08-06 02:00:48,125][52669] Sum rewards: 60.974, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.828', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.159', 'weapon2': '0.222', 'AMMO3': '0.269', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:48,240][52794] DAMAGECOUNT value on done: 254333.0 [2024-08-06 02:00:48,241][52794] Sum rewards: 70.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.325', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.255', 'weapon2': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.394', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '61.000'} [2024-08-06 02:00:48,340][52671] DAMAGECOUNT value on done: 258392.0 [2024-08-06 02:00:48,340][52671] Sum rewards: 54.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.049', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.044', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.152', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '3.410', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '45.000'} [2024-08-06 02:00:48,366][52666] DAMAGECOUNT value on done: 262289.0 [2024-08-06 02:00:48,368][52666] Sum rewards: 64.465, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.982', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.149', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:48,936][52803] DAMAGECOUNT value on done: 240197.0 [2024-08-06 02:00:48,938][52803] Sum rewards: 75.666, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.172', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon4': '0.266', 'weapon2': '0.552', 'WEAPON3': '0.950', 'weapon3': '2.890', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 02:00:49,312][52795] DAMAGECOUNT value on done: 243480.0 [2024-08-06 02:00:49,314][52795] Sum rewards: 52.346, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.870', 'AMMO5': '0.007', 'weapon5': '0.060', 'AMMO2': '0.069', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon4': '0.260', 'AMMO4': '0.347', 'weapon2': '0.348', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.050', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:49,421][52811] DAMAGECOUNT value on done: 240874.0 [2024-08-06 02:00:49,421][52811] Sum rewards: 61.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.475', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.148', 'weapon5': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.203', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.654', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '52.500'} [2024-08-06 02:00:50,220][52658] DAMAGECOUNT value on done: 258815.0 [2024-08-06 02:00:50,220][52658] Sum rewards: 70.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.237', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.332', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '60.000'} [2024-08-06 02:00:50,932][52794] DAMAGECOUNT value on done: 266359.0 [2024-08-06 02:00:50,933][52794] Sum rewards: 60.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.133', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.169', 'weapon4': '0.206', 'AMMO3': '0.231', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '52.000'} [2024-08-06 02:00:51,059][52658] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:00:51,155][52666] DAMAGECOUNT value on done: 262275.0 [2024-08-06 02:00:51,155][52666] Sum rewards: 80.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon4': '0.206', 'AMMO3': '0.256', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.134', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '68.000'} [2024-08-06 02:00:51,164][52671] DAMAGECOUNT value on done: 261312.0 [2024-08-06 02:00:51,164][52671] Sum rewards: 67.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.997', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '58.000'} [2024-08-06 02:00:51,326][52669] DAMAGECOUNT value on done: 264797.0 [2024-08-06 02:00:51,326][52669] Sum rewards: 58.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.128', 'weapon5': '0.204', 'AMMO4': '0.218', 'AMMO3': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.098', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:51,637][52650] Updated weights for policy 0, policy_version 34801 (0.0053) [2024-08-06 02:00:51,934][52803] DAMAGECOUNT value on done: 236870.0 [2024-08-06 02:00:51,936][52803] Sum rewards: 65.053, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.422', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.102', 'weapon4': '0.124', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '0.900', 'weapon3': '3.022', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:52,520][52795] DAMAGECOUNT value on done: 241911.0 [2024-08-06 02:00:52,521][52795] Sum rewards: 57.248, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.342', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '3.132', 'DAMAGECOUNT': '13.116', 'FRAGCOUNT': '48.000'} [2024-08-06 02:00:52,655][52811] DAMAGECOUNT value on done: 240969.0 [2024-08-06 02:00:52,656][52811] Sum rewards: 71.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.698', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.060', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.238', 'WEAPON4': '0.400', 'weapon4': '0.538', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '60.000'} [2024-08-06 02:00:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 285114368. Throughput: 0: 4381.1. Samples: 71281210. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:00:52,794][52567] Avg episode reward: [(0, '64.287')] [2024-08-06 02:00:53,230][52658] DAMAGECOUNT value on done: 258382.0 [2024-08-06 02:00:53,231][52658] Sum rewards: 83.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.254', 'AMMO2': '0.038', 'weapon4': '0.138', 'AMMO3': '0.181', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.242', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '69.000'} [2024-08-06 02:00:54,075][52794] DAMAGECOUNT value on done: 260371.0 [2024-08-06 02:00:54,076][52794] Sum rewards: 52.795, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.458', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.468', 'WEAPON3': '1.500', 'weapon3': '2.988', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '46.000'} [2024-08-06 02:00:54,218][52671] DAMAGECOUNT value on done: 257187.0 [2024-08-06 02:00:54,220][52671] Sum rewards: 62.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.110', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.187', 'weapon4': '0.210', 'AMMO3': '0.236', 'weapon5': '0.238', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '2.988', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '52.000'} [2024-08-06 02:00:54,363][52666] DAMAGECOUNT value on done: 261229.0 [2024-08-06 02:00:54,364][52666] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.164', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.174', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '61.000'} [2024-08-06 02:00:54,938][52803] DAMAGECOUNT value on done: 245626.0 [2024-08-06 02:00:54,938][52803] Sum rewards: 60.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.497', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO4': '0.169', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.454', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '51.000'} [2024-08-06 02:00:55,835][52811] DAMAGECOUNT value on done: 248854.0 [2024-08-06 02:00:55,836][52811] Sum rewards: 72.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '62.000'} [2024-08-06 02:00:56,094][52650] Updated weights for policy 0, policy_version 34811 (0.0026) [2024-08-06 02:00:56,173][52658] DAMAGECOUNT value on done: 251643.0 [2024-08-06 02:00:56,173][52658] Sum rewards: 65.530, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.882', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.252', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.972', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '55.000'} [2024-08-06 02:00:56,833][52666] DAMAGECOUNT value on done: 255597.0 [2024-08-06 02:00:56,833][52666] Sum rewards: 58.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.278', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.186', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '50.000'} [2024-08-06 02:00:56,882][52671] DAMAGECOUNT value on done: 265549.0 [2024-08-06 02:00:56,883][52671] Sum rewards: 75.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.064', 'weapon5': '0.100', 'weapon2': '0.146', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.498', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 02:00:56,936][52670] DAMAGECOUNT value on done: 254302.0 [2024-08-06 02:00:56,936][52670] Sum rewards: 66.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.852', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO4': '0.216', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.582', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '56.000'} [2024-08-06 02:00:56,978][52794] DAMAGECOUNT value on done: 261165.0 [2024-08-06 02:00:56,978][52794] Sum rewards: 58.833, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.142', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.550', 'weapon3': '2.864', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '52.500'} [2024-08-06 02:00:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 285188096. Throughput: 0: 4383.3. Samples: 71307740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:00:57,794][52567] Avg episode reward: [(0, '64.695')] [2024-08-06 02:00:58,083][52820] DAMAGECOUNT value on done: 235649.0 [2024-08-06 02:00:58,083][52820] Sum rewards: 74.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.574', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon2': '0.146', 'AMMO3': '0.188', 'AMMO4': '0.197', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 02:00:58,149][52803] DAMAGECOUNT value on done: 243434.0 [2024-08-06 02:00:58,149][52803] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.552', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon4': '0.222', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '57.000'} [2024-08-06 02:00:58,929][52658] DAMAGECOUNT value on done: 256749.0 [2024-08-06 02:00:58,930][52658] Sum rewards: 62.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.506', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.176', 'weapon2': '0.210', 'AMMO4': '0.227', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.770', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '49.500'} [2024-08-06 02:00:58,931][52811] DAMAGECOUNT value on done: 242912.0 [2024-08-06 02:00:58,932][52811] Sum rewards: 77.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon4': '0.308', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '64.000'} [2024-08-06 02:00:59,474][52666] DAMAGECOUNT value on done: 253186.0 [2024-08-06 02:00:59,476][52666] Sum rewards: 76.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.088', 'weapon2': '0.148', 'AMMO4': '0.169', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '62.000'} [2024-08-06 02:00:59,571][52670] DAMAGECOUNT value on done: 259443.0 [2024-08-06 02:00:59,572][52670] Sum rewards: 76.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.276', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '62.000'} [2024-08-06 02:00:59,598][52671] DAMAGECOUNT value on done: 259390.0 [2024-08-06 02:00:59,599][52671] Sum rewards: 57.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.017', 'AMMO2': '0.074', 'AMMO3': '0.190', 'weapon2': '0.202', 'weapon5': '0.274', 'weapon4': '0.366', 'AMMO4': '0.368', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '46.000'} [2024-08-06 02:00:59,832][52794] DAMAGECOUNT value on done: 272700.0 [2024-08-06 02:00:59,833][52794] Sum rewards: 75.348, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.896', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.336', 'WEAPON3': '2.050', 'weapon3': '3.374', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '68.000'} [2024-08-06 02:01:01,007][52650] Updated weights for policy 0, policy_version 34821 (0.0029) [2024-08-06 02:01:01,090][52820] DAMAGECOUNT value on done: 238806.0 [2024-08-06 02:01:01,090][52820] Sum rewards: 59.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.324', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.108', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:01,121][52803] DAMAGECOUNT value on done: 240634.0 [2024-08-06 02:01:01,123][52803] Sum rewards: 52.706, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.500', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.126', 'AMMO4': '0.223', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'weapon2': '0.362', 'weapon4': '0.392', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.762', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '48.000'} [2024-08-06 02:01:01,764][52658] DAMAGECOUNT value on done: 263782.0 [2024-08-06 02:01:01,766][52658] Sum rewards: 65.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.535', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '54.000'} [2024-08-06 02:01:02,000][52811] DAMAGECOUNT value on done: 241879.0 [2024-08-06 02:01:02,003][52811] Sum rewards: 69.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.138', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '57.000'} [2024-08-06 02:01:02,316][52666] DAMAGECOUNT value on done: 249051.0 [2024-08-06 02:01:02,319][52666] Sum rewards: 63.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.706', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '54.000'} [2024-08-06 02:01:02,404][52671] DAMAGECOUNT value on done: 261354.0 [2024-08-06 02:01:02,406][52671] Sum rewards: 78.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.422', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.152', 'weapon5': '0.168', 'weapon2': '0.182', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '65.000'} [2024-08-06 02:01:02,469][52670] DAMAGECOUNT value on done: 252457.0 [2024-08-06 02:01:02,469][52670] Sum rewards: 74.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.919', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:02,756][52794] DAMAGECOUNT value on done: 260951.0 [2024-08-06 02:01:02,756][52794] Sum rewards: 68.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO2': '0.030', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.184', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 02:01:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 285278208. Throughput: 0: 4378.4. Samples: 71320750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:01:02,795][52567] Avg episode reward: [(0, '65.790')] [2024-08-06 02:01:02,864][52614] Saving new best policy, reward=65.790! [2024-08-06 02:01:03,114][52665] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:01:04,178][52820] DAMAGECOUNT value on done: 237216.0 [2024-08-06 02:01:04,178][52820] Sum rewards: 67.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.584', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.174', 'weapon2': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.250', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:04,187][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:01:04,283][52803] DAMAGECOUNT value on done: 244988.0 [2024-08-06 02:01:04,283][52803] Sum rewards: 71.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.448', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.208', 'weapon5': '0.234', 'AMMO3': '0.251', 'AMMO4': '0.263', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.894', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:04,899][52658] DAMAGECOUNT value on done: 254749.0 [2024-08-06 02:01:04,899][52658] Sum rewards: 63.439, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.566', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.198', 'AMMO4': '0.235', 'AMMO3': '0.296', 'weapon4': '0.296', 'weapon2': '0.332', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.794', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:04,939][52671] DAMAGECOUNT value on done: 262510.0 [2024-08-06 02:01:04,939][52671] Sum rewards: 62.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.068', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.636', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '54.000'} [2024-08-06 02:01:05,232][52811] DAMAGECOUNT value on done: 244843.0 [2024-08-06 02:01:05,232][52811] Sum rewards: 71.211, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.138', 'weapon4': '0.146', 'AMMO4': '0.167', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '0.900', 'weapon3': '2.890', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '57.000'} [2024-08-06 02:01:05,395][52666] DAMAGECOUNT value on done: 257972.0 [2024-08-06 02:01:05,398][52666] Sum rewards: 70.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '60.000'} [2024-08-06 02:01:05,546][52670] DAMAGECOUNT value on done: 253068.0 [2024-08-06 02:01:05,548][52670] Sum rewards: 69.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 02:01:05,718][52650] Updated weights for policy 0, policy_version 34831 (0.0010) [2024-08-06 02:01:07,203][52820] DAMAGECOUNT value on done: 230743.0 [2024-08-06 02:01:07,204][52820] Sum rewards: 73.403, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.208', 'AMMO3': '0.292', 'weapon4': '0.394', 'WEAPON3': '1.650', 'weapon3': '3.074', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '65.000'} [2024-08-06 02:01:07,518][52803] DAMAGECOUNT value on done: 242289.0 [2024-08-06 02:01:07,518][52803] Sum rewards: 64.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.108', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '53.000'} [2024-08-06 02:01:07,689][52671] DAMAGECOUNT value on done: 255593.0 [2024-08-06 02:01:07,689][52671] Sum rewards: 71.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.020', 'AMMO4': '0.068', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 285376512. Throughput: 0: 4371.8. Samples: 71346950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:01:07,794][52567] Avg episode reward: [(0, '66.149')] [2024-08-06 02:01:07,797][52614] Saving new best policy, reward=66.149! [2024-08-06 02:01:08,035][52658] DAMAGECOUNT value on done: 257722.0 [2024-08-06 02:01:08,037][52658] Sum rewards: 69.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.752', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.076', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.380', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:08,292][52811] DAMAGECOUNT value on done: 239405.0 [2024-08-06 02:01:08,293][52811] Sum rewards: 59.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.328', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.158', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.376', 'weapon4': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '51.500'} [2024-08-06 02:01:08,532][52666] DAMAGECOUNT value on done: 255808.0 [2024-08-06 02:01:08,532][52666] Sum rewards: 47.183, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.334', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.194', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon2': '0.274', 'WEAPON4': '0.500', 'weapon4': '0.582', 'WEAPON3': '1.450', 'weapon3': '2.634', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '42.000'} [2024-08-06 02:01:08,676][52670] DAMAGECOUNT value on done: 260239.0 [2024-08-06 02:01:08,677][52670] Sum rewards: 65.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.093', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.712', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 02:01:10,303][52820] DAMAGECOUNT value on done: 239836.0 [2024-08-06 02:01:10,303][52820] Sum rewards: 65.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.064', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.078', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.298', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.476', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '55.000'} [2024-08-06 02:01:10,445][52650] Updated weights for policy 0, policy_version 34841 (0.0018) [2024-08-06 02:01:10,689][52803] DAMAGECOUNT value on done: 238914.0 [2024-08-06 02:01:10,690][52803] Sum rewards: 59.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.028', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.114', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '49.000'} [2024-08-06 02:01:10,799][52671] DAMAGECOUNT value on done: 263520.0 [2024-08-06 02:01:10,801][52671] Sum rewards: 58.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.128', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.056', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.279', 'weapon2': '0.302', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '48.000'} [2024-08-06 02:01:11,009][52658] DAMAGECOUNT value on done: 260876.0 [2024-08-06 02:01:11,010][52658] Sum rewards: 67.473, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.220', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:11,431][52811] DAMAGECOUNT value on done: 245278.0 [2024-08-06 02:01:11,435][52811] Sum rewards: 62.575, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.245', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon4': '0.084', 'AMMO3': '0.135', 'weapon2': '0.442', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.362', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:11,725][52666] DAMAGECOUNT value on done: 255926.0 [2024-08-06 02:01:11,728][52666] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.955', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.098', 'AMMO4': '0.161', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '60.000'} [2024-08-06 02:01:11,895][52670] DAMAGECOUNT value on done: 256424.0 [2024-08-06 02:01:11,897][52670] Sum rewards: 65.243, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.881', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.115', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.510', 'WEAPON3': '0.900', 'weapon3': '2.834', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 285458432. Throughput: 0: 4370.9. Samples: 71373200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:01:12,794][52567] Avg episode reward: [(0, '65.961')] [2024-08-06 02:01:13,190][52671] DAMAGECOUNT value on done: 264221.0 [2024-08-06 02:01:13,198][52671] Sum rewards: 77.702, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.305', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '66.500'} [2024-08-06 02:01:13,474][52820] DAMAGECOUNT value on done: 237474.0 [2024-08-06 02:01:13,478][52820] Sum rewards: 78.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.752', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.161', 'AMMO3': '0.178', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '64.500'} [2024-08-06 02:01:13,599][52803] DAMAGECOUNT value on done: 247070.0 [2024-08-06 02:01:13,600][52803] Sum rewards: 49.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'ARMOR': '0.005', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon7': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.166', 'AMMO4': '0.186', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.660', 'WEAPON3': '1.050', 'HITCOUNT': '2.460', 'weapon3': '2.584', 'DAMAGECOUNT': '11.820', 'FRAGCOUNT': '41.000'} [2024-08-06 02:01:14,613][52811] DAMAGECOUNT value on done: 242012.0 [2024-08-06 02:01:14,616][52811] Sum rewards: 68.102, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'weapon2': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'HEALTH': '0.235', 'weapon4': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '56.000'} [2024-08-06 02:01:14,890][52650] Updated weights for policy 0, policy_version 34851 (0.0029) [2024-08-06 02:01:14,977][52666] DAMAGECOUNT value on done: 254466.0 [2024-08-06 02:01:14,980][52666] Sum rewards: 53.104, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.289', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.030', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '49.000'} [2024-08-06 02:01:15,147][52670] DAMAGECOUNT value on done: 250618.0 [2024-08-06 02:01:15,148][52670] Sum rewards: 64.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.160', 'AMMO3': '0.160', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.924', 'weapon3': '2.312', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:16,121][52671] DAMAGECOUNT value on done: 259105.0 [2024-08-06 02:01:16,122][52671] Sum rewards: 53.639, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.147', 'weapon4': '0.190', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.710', 'WEAPON3': '0.900', 'HITCOUNT': '2.520', 'weapon3': '2.716', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '41.500'} [2024-08-06 02:01:16,505][52803] DAMAGECOUNT value on done: 238211.0 [2024-08-06 02:01:16,508][52803] Sum rewards: 50.601, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.850', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.126', 'weapon5': '0.182', 'AMMO3': '0.187', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '2.926', 'DAMAGECOUNT': '12.477', 'FRAGCOUNT': '41.000'} [2024-08-06 02:01:16,616][52820] DAMAGECOUNT value on done: 239836.0 [2024-08-06 02:01:16,618][52820] Sum rewards: 75.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.025', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.204', 'AMMO4': '0.205', 'AMMO3': '0.211', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '62.000'} [2024-08-06 02:01:17,765][52811] DAMAGECOUNT value on done: 236870.0 [2024-08-06 02:01:17,767][52811] Sum rewards: 58.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.068', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.238', 'weapon2': '0.306', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 285548544. Throughput: 0: 4381.3. Samples: 71386400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:01:17,795][52567] Avg episode reward: [(0, '65.771')] [2024-08-06 02:01:18,021][52666] DAMAGECOUNT value on done: 253452.0 [2024-08-06 02:01:18,023][52666] Sum rewards: 68.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.721', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.246', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.460', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:18,175][52670] DAMAGECOUNT value on done: 254216.0 [2024-08-06 02:01:18,178][52670] Sum rewards: 73.447, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.574', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.040', 'AMMO4': '0.121', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.348', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:19,068][52671] DAMAGECOUNT value on done: 268542.0 [2024-08-06 02:01:19,068][52671] Sum rewards: 65.769, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.062', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.294', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '52.500'} [2024-08-06 02:01:19,574][52803] DAMAGECOUNT value on done: 245180.0 [2024-08-06 02:01:19,575][52803] Sum rewards: 52.007, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.297', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.135', 'weapon2': '0.138', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '3.320', 'DAMAGECOUNT': '13.188', 'FRAGCOUNT': '43.000'} [2024-08-06 02:01:19,638][52820] DAMAGECOUNT value on done: 241890.0 [2024-08-06 02:01:19,639][52820] Sum rewards: 65.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.364', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.190', 'weapon2': '0.198', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '54.000'} [2024-08-06 02:01:19,774][52650] Updated weights for policy 0, policy_version 34861 (0.0018) [2024-08-06 02:01:20,792][52666] DAMAGECOUNT value on done: 249370.0 [2024-08-06 02:01:20,792][52666] Sum rewards: 62.126, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.244', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.090', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.207', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'weapon2': '0.760', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '56.000'} [2024-08-06 02:01:20,818][52811] DAMAGECOUNT value on done: 241637.0 [2024-08-06 02:01:20,819][52811] Sum rewards: 68.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.028', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.128', 'AMMO3': '0.181', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '57.000'} [2024-08-06 02:01:21,052][52670] DAMAGECOUNT value on done: 253091.0 [2024-08-06 02:01:21,053][52670] Sum rewards: 55.274, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.441', 'AMMO5': '0.020', 'AMMO2': '0.084', 'AMMO3': '0.283', 'weapon5': '0.324', 'weapon2': '0.336', 'AMMO4': '0.421', 'weapon4': '0.534', 'WEAPON5': '0.650', 'WEAPON4': '0.900', 'WEAPON3': '1.650', 'weapon3': '2.410', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:21,656][52671] DAMAGECOUNT value on done: 256530.0 [2024-08-06 02:01:21,656][52671] Sum rewards: 62.095, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.105', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO3': '0.162', 'AMMO4': '0.174', 'weapon4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 02:01:21,943][52665] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:01:22,689][52820] DAMAGECOUNT value on done: 238574.0 [2024-08-06 02:01:22,689][52820] Sum rewards: 60.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.169', 'weapon5': '0.208', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 285630464. Throughput: 0: 4391.8. Samples: 71413040. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:01:22,794][52567] Avg episode reward: [(0, '65.341')] [2024-08-06 02:01:22,872][52803] DAMAGECOUNT value on done: 237641.0 [2024-08-06 02:01:22,875][52803] Sum rewards: 68.684, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.221', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.159', 'weapon2': '0.362', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.268', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2024-08-06 02:01:23,772][52666] DAMAGECOUNT value on done: 261956.0 [2024-08-06 02:01:23,773][52666] Sum rewards: 71.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.782', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.214', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '59.000'} [2024-08-06 02:01:23,784][52811] DAMAGECOUNT value on done: 245734.0 [2024-08-06 02:01:23,784][52811] Sum rewards: 80.763, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon4': '0.190', 'AMMO3': '0.199', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '66.000'} [2024-08-06 02:01:24,027][52650] Updated weights for policy 0, policy_version 34871 (0.0015) [2024-08-06 02:01:24,032][52670] DAMAGECOUNT value on done: 248050.0 [2024-08-06 02:01:24,032][52670] Sum rewards: 58.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.322', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'weapon4': '0.194', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.540', 'WEAPON3': '1.600', 'weapon3': '3.026', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:24,609][52659] DAMAGECOUNT value on done: 260751.0 [2024-08-06 02:01:24,610][52659] Sum rewards: 75.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.126', 'weapon4': '0.176', 'AMMO3': '0.192', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '62.000'} [2024-08-06 02:01:24,699][52671] DAMAGECOUNT value on done: 250247.0 [2024-08-06 02:01:24,699][52671] Sum rewards: 70.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.275', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.324', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '59.000'} [2024-08-06 02:01:25,552][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:01:25,870][52820] DAMAGECOUNT value on done: 240628.0 [2024-08-06 02:01:25,871][52820] Sum rewards: 68.670, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.420', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.072', 'weapon5': '0.096', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.850', 'weapon3': '3.004', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:26,731][52666] DAMAGECOUNT value on done: 258525.0 [2024-08-06 02:01:26,733][52666] Sum rewards: 70.985, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.543', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.148', 'weapon5': '0.176', 'AMMO4': '0.260', 'AMMO3': '0.303', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '2.928', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '64.000'} [2024-08-06 02:01:26,812][52811] DAMAGECOUNT value on done: 239197.0 [2024-08-06 02:01:26,813][52811] Sum rewards: 69.090, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.265', 'weapon2': '0.294', 'weapon4': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '60.000'} [2024-08-06 02:01:26,859][52670] DAMAGECOUNT value on done: 260950.0 [2024-08-06 02:01:26,860][52670] Sum rewards: 62.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.745', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.232', 'weapon4': '0.278', 'WEAPON4': '0.550', 'weapon2': '0.584', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '53.500'} [2024-08-06 02:01:27,424][52659] DAMAGECOUNT value on done: 257550.0 [2024-08-06 02:01:27,424][52659] Sum rewards: 68.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.225', 'weapon2': '0.342', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:27,527][52671] DAMAGECOUNT value on done: 260945.0 [2024-08-06 02:01:27,529][52671] Sum rewards: 67.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.660', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.166', 'AMMO3': '0.174', 'weapon2': '0.268', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'weapon4': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.854', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '56.000'} [2024-08-06 02:01:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 285720576. Throughput: 0: 4391.8. Samples: 71439250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:01:27,794][52567] Avg episode reward: [(0, '65.956')] [2024-08-06 02:01:27,976][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:01:28,741][52650] Updated weights for policy 0, policy_version 34881 (0.0011) [2024-08-06 02:01:28,925][52647] DAMAGECOUNT value on done: 275126.0 [2024-08-06 02:01:28,925][52647] Sum rewards: 78.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.487', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '66.000'} [2024-08-06 02:01:28,935][52663] DAMAGECOUNT value on done: 263079.0 [2024-08-06 02:01:28,935][52663] Sum rewards: 73.862, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.086', 'AMMO3': '0.197', 'weapon2': '0.312', 'HEALTH': '0.457', 'WEAPON3': '1.100', 'weapon3': '3.436', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:28,944][52820] DAMAGECOUNT value on done: 242069.0 [2024-08-06 02:01:28,944][52820] Sum rewards: 86.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.124', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.158', 'AMMO4': '0.197', 'AMMO3': '0.206', 'weapon2': '0.214', 'weapon5': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '72.000'} [2024-08-06 02:01:29,695][52666] DAMAGECOUNT value on done: 256013.0 [2024-08-06 02:01:29,705][52666] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '55.000'} [2024-08-06 02:01:29,824][52670] DAMAGECOUNT value on done: 256372.0 [2024-08-06 02:01:29,828][52670] Sum rewards: 53.431, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.310', 'ARMOR': '0.008', 'AMMO5': '0.025', 'AMMO2': '0.065', 'weapon5': '0.218', 'AMMO3': '0.272', 'weapon4': '0.326', 'AMMO4': '0.327', 'weapon2': '0.382', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.600', 'HITCOUNT': '2.640', 'weapon3': '2.718', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '51.000'} [2024-08-06 02:01:29,830][52811] DAMAGECOUNT value on done: 246710.0 [2024-08-06 02:01:29,831][52811] Sum rewards: 69.317, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.442', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.284', 'weapon2': '0.686', 'WEAPON3': '1.700', 'weapon3': '2.982', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:30,590][52659] DAMAGECOUNT value on done: 257914.0 [2024-08-06 02:01:30,592][52659] Sum rewards: 58.945, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.240', 'weapon4': '0.338', 'WEAPON4': '0.500', 'weapon2': '0.594', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.816', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '49.000'} [2024-08-06 02:01:30,666][52671] DAMAGECOUNT value on done: 263202.0 [2024-08-06 02:01:30,668][52671] Sum rewards: 73.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.032', 'AMMO4': '0.069', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'HITCOUNT': '3.390', 'weapon3': '3.516', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '62.000'} [2024-08-06 02:01:31,270][52647] DAMAGECOUNT value on done: 271486.0 [2024-08-06 02:01:31,270][52647] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:31,933][52663] DAMAGECOUNT value on done: 259976.0 [2024-08-06 02:01:31,934][52663] Sum rewards: 73.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.124', 'AMMO4': '0.139', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon5': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:32,098][52820] DAMAGECOUNT value on done: 243981.0 [2024-08-06 02:01:32,099][52820] Sum rewards: 74.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '62.000'} [2024-08-06 02:01:32,689][52666] DAMAGECOUNT value on done: 253761.0 [2024-08-06 02:01:32,690][52666] Sum rewards: 62.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.655', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 285810688. Throughput: 0: 4388.2. Samples: 71452280. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:01:32,794][52567] Avg episode reward: [(0, '66.779')] [2024-08-06 02:01:32,795][52614] Saving new best policy, reward=66.779! [2024-08-06 02:01:32,818][52670] DAMAGECOUNT value on done: 255761.0 [2024-08-06 02:01:32,820][52670] Sum rewards: 66.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.884', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.214', 'AMMO3': '0.219', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '55.000'} [2024-08-06 02:01:33,356][52650] Updated weights for policy 0, policy_version 34891 (0.0014) [2024-08-06 02:01:33,484][52671] DAMAGECOUNT value on done: 265812.0 [2024-08-06 02:01:33,485][52659] DAMAGECOUNT value on done: 257529.0 [2024-08-06 02:01:33,485][52671] Sum rewards: 69.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.045', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.149', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:33,486][52659] Sum rewards: 69.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.584', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.244', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '57.000'} [2024-08-06 02:01:34,103][52647] DAMAGECOUNT value on done: 271654.0 [2024-08-06 02:01:34,103][52647] Sum rewards: 58.289, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.126', 'WEAPON4': '0.150', 'HEALTH': '0.182', 'AMMO3': '0.217', 'weapon2': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.202', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '48.000'} [2024-08-06 02:01:34,651][52663] DAMAGECOUNT value on done: 254481.0 [2024-08-06 02:01:34,651][52663] Sum rewards: 63.412, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'weapon4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.930', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '53.000'} [2024-08-06 02:01:35,257][52820] DAMAGECOUNT value on done: 240962.0 [2024-08-06 02:01:35,257][52820] Sum rewards: 53.753, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.920', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.137', 'weapon4': '0.150', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.700', 'weapon3': '2.798', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '48.500'} [2024-08-06 02:01:35,442][52666] DAMAGECOUNT value on done: 252206.0 [2024-08-06 02:01:35,443][52666] Sum rewards: 61.965, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.048', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.116', 'AMMO3': '0.121', 'AMMO4': '0.132', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon2': '0.856', 'weapon3': '2.682', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '48.000'} [2024-08-06 02:01:35,681][52670] DAMAGECOUNT value on done: 260991.0 [2024-08-06 02:01:35,681][52670] Sum rewards: 76.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.455', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.142', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon2': '0.328', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '62.000'} [2024-08-06 02:01:35,979][52671] DAMAGECOUNT value on done: 261592.0 [2024-08-06 02:01:35,981][52671] Sum rewards: 56.056, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.480', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon2': '0.260', 'AMMO3': '0.324', 'WEAPON3': '1.900', 'HITCOUNT': '3.190', 'weapon3': '3.426', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:36,078][52659] DAMAGECOUNT value on done: 255146.0 [2024-08-06 02:01:36,079][52659] Sum rewards: 69.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.858', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.106', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:36,939][52647] DAMAGECOUNT value on done: 275567.0 [2024-08-06 02:01:36,939][52647] Sum rewards: 48.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.260', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.126', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '2.610', 'weapon3': '3.334', 'DAMAGECOUNT': '12.525', 'FRAGCOUNT': '43.000'} [2024-08-06 02:01:37,656][52663] DAMAGECOUNT value on done: 259045.0 [2024-08-06 02:01:37,656][52663] Sum rewards: 59.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.110', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.108', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'weapon4': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '48.000'} [2024-08-06 02:01:37,780][52666] DAMAGECOUNT value on done: 259484.0 [2024-08-06 02:01:37,782][52666] Sum rewards: 60.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon2': '0.170', 'AMMO4': '0.182', 'AMMO3': '0.205', 'weapon5': '0.210', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.026', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '51.000'} [2024-08-06 02:01:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.4). Total num frames: 285900800. Throughput: 0: 4373.3. Samples: 71478010. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:01:37,794][52567] Avg episode reward: [(0, '66.303')] [2024-08-06 02:01:37,993][52670] DAMAGECOUNT value on done: 258983.0 [2024-08-06 02:01:37,995][52670] Sum rewards: 74.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.593', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.166', 'weapon5': '0.264', 'AMMO4': '0.297', 'weapon2': '0.330', 'WEAPON5': '0.550', 'weapon4': '0.594', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.470', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:38,417][52820] DAMAGECOUNT value on done: 239922.0 [2024-08-06 02:01:38,419][52820] Sum rewards: 57.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.240', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '47.000'} [2024-08-06 02:01:38,570][52650] Updated weights for policy 0, policy_version 34901 (0.0033) [2024-08-06 02:01:39,081][52671] DAMAGECOUNT value on done: 257045.0 [2024-08-06 02:01:39,081][52671] Sum rewards: 60.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.992', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.185', 'weapon5': '0.194', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'weapon4': '0.524', 'weapon2': '0.598', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.470', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:39,138][52659] DAMAGECOUNT value on done: 256637.0 [2024-08-06 02:01:39,138][52659] Sum rewards: 63.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.472', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon7': '0.068', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.182', 'WEAPON7': '0.200', 'AMMO3': '0.243', 'weapon4': '0.516', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '55.000'} [2024-08-06 02:01:40,032][52647] DAMAGECOUNT value on done: 272903.0 [2024-08-06 02:01:40,033][52647] Sum rewards: 67.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.502', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:40,367][52666] DAMAGECOUNT value on done: 250768.0 [2024-08-06 02:01:40,369][52666] Sum rewards: 71.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO3': '0.157', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.684', 'WEAPON3': '0.950', 'weapon3': '2.494', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:40,582][52663] DAMAGECOUNT value on done: 259074.0 [2024-08-06 02:01:40,583][52663] Sum rewards: 64.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon4': '0.110', 'AMMO4': '0.115', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '53.500'} [2024-08-06 02:01:40,605][52670] DAMAGECOUNT value on done: 246082.0 [2024-08-06 02:01:40,607][52670] Sum rewards: 48.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.045', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.198', 'AMMO3': '0.227', 'AMMO4': '0.229', 'weapon2': '0.282', 'weapon4': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '2.936', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '42.000'} [2024-08-06 02:01:41,623][52820] DAMAGECOUNT value on done: 241694.0 [2024-08-06 02:01:41,627][52820] Sum rewards: 65.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon5': '0.122', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '54.000'} [2024-08-06 02:01:41,907][52659] DAMAGECOUNT value on done: 259224.0 [2024-08-06 02:01:41,908][52659] Sum rewards: 61.533, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.098', 'weapon4': '0.110', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:42,580][52650] Updated weights for policy 0, policy_version 34911 (0.0012) [2024-08-06 02:01:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 285990912. Throughput: 0: 4367.6. Samples: 71504280. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:01:42,794][52567] Avg episode reward: [(0, '65.853')] [2024-08-06 02:01:43,111][52647] DAMAGECOUNT value on done: 277617.0 [2024-08-06 02:01:43,112][52647] Sum rewards: 62.473, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.116', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.200', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:43,178][52666] DAMAGECOUNT value on done: 258312.0 [2024-08-06 02:01:43,186][52666] Sum rewards: 65.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.262', 'WEAPON4': '0.450', 'weapon4': '0.688', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '56.000'} [2024-08-06 02:01:43,350][52670] DAMAGECOUNT value on done: 258545.0 [2024-08-06 02:01:43,350][52670] Sum rewards: 52.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.146', 'weapon4': '0.158', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.960', 'WEAPON3': '1.000', 'weapon3': '2.592', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.630', 'FRAGCOUNT': '44.000'} [2024-08-06 02:01:43,363][52663] DAMAGECOUNT value on done: 263403.0 [2024-08-06 02:01:43,367][52663] Sum rewards: 79.265, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.893', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.138', 'weapon2': '0.260', 'AMMO3': '0.330', 'WEAPON3': '2.050', 'weapon3': '3.304', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '70.000'} [2024-08-06 02:01:44,799][52820] DAMAGECOUNT value on done: 243174.0 [2024-08-06 02:01:44,805][52820] Sum rewards: 75.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO3': '0.163', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.108', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '60.000'} [2024-08-06 02:01:45,073][52659] DAMAGECOUNT value on done: 253905.0 [2024-08-06 02:01:45,074][52659] Sum rewards: 60.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.148', 'AMMO4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:45,383][52647] DAMAGECOUNT value on done: 272831.0 [2024-08-06 02:01:45,384][52647] Sum rewards: 60.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.780', 'WEAPON3': '1.150', 'weapon3': '2.662', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '50.000'} [2024-08-06 02:01:46,043][52670] DAMAGECOUNT value on done: 265006.0 [2024-08-06 02:01:46,043][52670] Sum rewards: 72.942, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.155', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.219', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '64.000'} [2024-08-06 02:01:46,481][52663] DAMAGECOUNT value on done: 258732.0 [2024-08-06 02:01:46,482][52663] Sum rewards: 63.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.814', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '52.000'} [2024-08-06 02:01:47,544][52650] Updated weights for policy 0, policy_version 34921 (0.0011) [2024-08-06 02:01:47,709][52659] DAMAGECOUNT value on done: 264690.0 [2024-08-06 02:01:47,710][52659] Sum rewards: 66.992, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.152', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '55.000'} [2024-08-06 02:01:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 286072832. Throughput: 0: 4374.7. Samples: 71517610. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:01:47,794][52567] Avg episode reward: [(0, '65.683')] [2024-08-06 02:01:47,884][52820] DAMAGECOUNT value on done: 235150.0 [2024-08-06 02:01:47,884][52820] Sum rewards: 67.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.693', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.170', 'AMMO3': '0.214', 'weapon2': '0.236', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon4': '0.454', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '59.000'} [2024-08-06 02:01:47,896][52647] DAMAGECOUNT value on done: 271173.0 [2024-08-06 02:01:47,897][52647] Sum rewards: 64.509, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.218', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '51.000'} [2024-08-06 02:01:48,660][52670] DAMAGECOUNT value on done: 258203.0 [2024-08-06 02:01:48,663][52670] Sum rewards: 72.179, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.552', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.088', 'weapon5': '0.144', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.321', 'WEAPON3': '1.900', 'weapon3': '3.180', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '65.000'} [2024-08-06 02:01:49,175][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:01:49,488][52663] DAMAGECOUNT value on done: 257060.0 [2024-08-06 02:01:49,490][52663] Sum rewards: 54.212, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.120', 'weapon5': '0.188', 'AMMO4': '0.203', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.668', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '2.754', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '48.000'} [2024-08-06 02:01:50,314][52647] DAMAGECOUNT value on done: 275868.0 [2024-08-06 02:01:50,314][52647] Sum rewards: 56.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.164', 'weapon5': '0.186', 'AMMO4': '0.237', 'weapon4': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.880', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '49.000'} [2024-08-06 02:01:50,419][52659] DAMAGECOUNT value on done: 263990.0 [2024-08-06 02:01:50,420][52659] Sum rewards: 60.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.017', 'AMMO2': '0.063', 'AMMO3': '0.220', 'weapon5': '0.234', 'weapon4': '0.294', 'AMMO4': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon2': '0.732', 'WEAPON3': '1.300', 'weapon3': '2.422', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '51.000'} [2024-08-06 02:01:50,889][52820] DAMAGECOUNT value on done: 247051.0 [2024-08-06 02:01:50,889][52820] Sum rewards: 71.206, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.182', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'weapon4': '0.360', 'WEAPON3': '1.150', 'weapon3': '2.836', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '56.000'} [2024-08-06 02:01:51,609][52670] DAMAGECOUNT value on done: 258734.0 [2024-08-06 02:01:51,609][52670] Sum rewards: 62.025, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.178', 'AMMO4': '0.266', 'AMMO3': '0.289', 'weapon4': '0.348', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.810', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '56.000'} [2024-08-06 02:01:52,104][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:01:52,187][52663] DAMAGECOUNT value on done: 258604.0 [2024-08-06 02:01:52,189][52663] Sum rewards: 75.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.878', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.022', 'weapon4': '0.088', 'AMMO4': '0.110', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '64.000'} [2024-08-06 02:01:52,560][52650] Updated weights for policy 0, policy_version 34931 (0.0013) [2024-08-06 02:01:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 286162944. Throughput: 0: 4382.2. Samples: 71544150. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:01:52,795][52567] Avg episode reward: [(0, '65.328')] [2024-08-06 02:01:53,123][52659] DAMAGECOUNT value on done: 257799.0 [2024-08-06 02:01:53,124][52659] Sum rewards: 66.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.424', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.148', 'AMMO3': '0.213', 'weapon2': '0.216', 'weapon5': '0.228', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '57.000'} [2024-08-06 02:01:53,161][52647] DAMAGECOUNT value on done: 270555.0 [2024-08-06 02:01:53,161][52647] Sum rewards: 78.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.586', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '66.000'} [2024-08-06 02:01:53,978][52820] DAMAGECOUNT value on done: 250347.0 [2024-08-06 02:01:53,981][52820] Sum rewards: 82.009, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.376', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '67.000'} [2024-08-06 02:01:54,642][52649] DAMAGECOUNT value on done: 251422.0 [2024-08-06 02:01:54,642][52649] Sum rewards: 62.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.358', 'weapon4': '0.424', 'WEAPON3': '1.600', 'weapon3': '2.888', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '54.000'} [2024-08-06 02:01:55,238][52663] DAMAGECOUNT value on done: 261356.0 [2024-08-06 02:01:55,238][52663] Sum rewards: 72.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.246', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon2': '0.222', 'AMMO3': '0.232', 'weapon5': '0.270', 'AMMO4': '0.302', 'WEAPON5': '0.500', 'weapon4': '0.544', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.478', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:55,807][52659] DAMAGECOUNT value on done: 257765.0 [2024-08-06 02:01:55,809][52659] Sum rewards: 64.368, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.264', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.265', 'weapon2': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.416', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '58.000'} [2024-08-06 02:01:55,970][52647] DAMAGECOUNT value on done: 273944.0 [2024-08-06 02:01:55,971][52647] Sum rewards: 66.474, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.929', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.088', 'weapon4': '0.122', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '3.190', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '53.000'} [2024-08-06 02:01:56,749][52650] Updated weights for policy 0, policy_version 34941 (0.0024) [2024-08-06 02:01:57,184][52820] DAMAGECOUNT value on done: 236401.0 [2024-08-06 02:01:57,185][52820] Sum rewards: 57.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.302', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.282', 'WEAPON4': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '49.000'} [2024-08-06 02:01:57,786][52649] DAMAGECOUNT value on done: 245353.0 [2024-08-06 02:01:57,786][52649] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon5': '0.228', 'weapon2': '0.356', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '60.000'} [2024-08-06 02:01:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 286253056. Throughput: 0: 4386.2. Samples: 71570580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:01:57,794][52567] Avg episode reward: [(0, '65.672')] [2024-08-06 02:01:58,193][52659] DAMAGECOUNT value on done: 254142.0 [2024-08-06 02:01:58,193][52659] Sum rewards: 71.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.114', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.104', 'weapon4': '0.168', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.310', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '61.000'} [2024-08-06 02:01:58,266][52663] DAMAGECOUNT value on done: 262419.0 [2024-08-06 02:01:58,268][52663] Sum rewards: 64.413, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.475', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.106', 'AMMO3': '0.146', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.410', 'weapon4': '0.442', 'WEAPON3': '0.900', 'weapon3': '2.802', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '53.000'} [2024-08-06 02:01:59,020][52647] DAMAGECOUNT value on done: 268325.0 [2024-08-06 02:01:59,020][52647] Sum rewards: 60.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.162', 'weapon4': '0.180', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '51.500'} [2024-08-06 02:01:59,700][52614] Signal inference workers to stop experience collection... (6300 times) [2024-08-06 02:01:59,700][52614] Signal inference workers to resume experience collection... (6300 times) [2024-08-06 02:01:59,736][52650] InferenceWorker_p0-w0: stopping experience collection (6300 times) [2024-08-06 02:01:59,739][52650] InferenceWorker_p0-w0: resuming experience collection (6300 times) [2024-08-06 02:02:00,427][52649] DAMAGECOUNT value on done: 254202.0 [2024-08-06 02:02:00,430][52649] Sum rewards: 59.923, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.828', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.240', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '53.000'} [2024-08-06 02:02:00,850][52663] DAMAGECOUNT value on done: 257496.0 [2024-08-06 02:02:00,852][52663] Sum rewards: 71.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon5': '0.228', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '59.000'} [2024-08-06 02:02:01,421][52659] DAMAGECOUNT value on done: 258132.0 [2024-08-06 02:02:01,421][52659] Sum rewards: 49.628, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.165', 'weapon2': '0.188', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '3.302', 'DAMAGECOUNT': '11.625', 'FRAGCOUNT': '41.000'} [2024-08-06 02:02:01,718][52650] Updated weights for policy 0, policy_version 34951 (0.0011) [2024-08-06 02:02:02,330][52647] DAMAGECOUNT value on done: 271237.0 [2024-08-06 02:02:02,332][52647] Sum rewards: 69.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon5': '0.064', 'AMMO4': '0.067', 'weapon2': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.226', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '59.000'} [2024-08-06 02:02:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 286343168. Throughput: 0: 4383.8. Samples: 71583670. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:02:02,794][52567] Avg episode reward: [(0, '65.482')] [2024-08-06 02:02:03,084][52649] DAMAGECOUNT value on done: 254543.0 [2024-08-06 02:02:03,084][52649] Sum rewards: 67.973, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.040', 'AMMO4': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.350', 'weapon3': '3.430', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '60.000'} [2024-08-06 02:02:03,387][52663] DAMAGECOUNT value on done: 253126.0 [2024-08-06 02:02:03,388][52663] Sum rewards: 63.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.748', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.203', 'weapon5': '0.216', 'weapon2': '0.260', 'AMMO3': '0.284', 'weapon4': '0.386', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.844', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '57.000'} [2024-08-06 02:02:04,283][52667] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:02:04,301][52665] DAMAGECOUNT value on done: 255901.0 [2024-08-06 02:02:04,301][52665] Sum rewards: 76.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.343', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.126', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.258', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '62.000'} [2024-08-06 02:02:04,763][52659] DAMAGECOUNT value on done: 263050.0 [2024-08-06 02:02:04,768][52659] Sum rewards: 70.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.007', 'AMMO2': '0.059', 'weapon5': '0.136', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.258', 'AMMO4': '0.295', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '59.000'} [2024-08-06 02:02:05,363][52647] DAMAGECOUNT value on done: 270589.0 [2024-08-06 02:02:05,363][52647] Sum rewards: 69.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.234', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '59.000'} [2024-08-06 02:02:05,888][52650] Updated weights for policy 0, policy_version 34961 (0.0027) [2024-08-06 02:02:06,138][52649] DAMAGECOUNT value on done: 244966.0 [2024-08-06 02:02:06,139][52649] Sum rewards: 71.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.134', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.724', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '58.000'} [2024-08-06 02:02:06,262][52663] DAMAGECOUNT value on done: 252400.0 [2024-08-06 02:02:06,262][52663] Sum rewards: 60.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '51.000'} [2024-08-06 02:02:06,913][52665] DAMAGECOUNT value on done: 260649.0 [2024-08-06 02:02:06,914][52665] Sum rewards: 61.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.789', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.260', 'weapon2': '0.702', 'WEAPON3': '1.550', 'weapon3': '2.982', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '55.000'} [2024-08-06 02:02:07,476][52659] DAMAGECOUNT value on done: 266448.0 [2024-08-06 02:02:07,477][52659] Sum rewards: 67.944, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.916', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.262', 'weapon4': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '56.000'} [2024-08-06 02:02:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 286425088. Throughput: 0: 4384.2. Samples: 71610330. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:02:07,794][52567] Avg episode reward: [(0, '66.165')] [2024-08-06 02:02:08,478][52647] DAMAGECOUNT value on done: 277153.0 [2024-08-06 02:02:08,479][52647] Sum rewards: 75.625, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.060', 'weapon4': '0.066', 'AMMO4': '0.143', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '61.000'} [2024-08-06 02:02:08,739][52649] DAMAGECOUNT value on done: 255360.0 [2024-08-06 02:02:08,741][52649] Sum rewards: 53.567, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.220', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.108', 'AMMO4': '0.269', 'weapon4': '0.274', 'AMMO3': '0.294', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.886', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:09,046][52663] DAMAGECOUNT value on done: 257757.0 [2024-08-06 02:02:09,047][52663] Sum rewards: 50.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.312', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.114', 'AMMO4': '0.127', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.593', 'FRAGCOUNT': '43.000'} [2024-08-06 02:02:09,855][52665] DAMAGECOUNT value on done: 256629.0 [2024-08-06 02:02:09,857][52665] Sum rewards: 56.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.845', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.160', 'AMMO4': '0.216', 'AMMO3': '0.234', 'weapon2': '0.334', 'weapon4': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.908', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '49.000'} [2024-08-06 02:02:10,536][52659] DAMAGECOUNT value on done: 264361.0 [2024-08-06 02:02:10,537][52659] Sum rewards: 67.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.295', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.159', 'weapon2': '0.238', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 02:02:10,733][52650] Updated weights for policy 0, policy_version 34971 (0.0018) [2024-08-06 02:02:11,136][52647] DAMAGECOUNT value on done: 271120.0 [2024-08-06 02:02:11,136][52647] Sum rewards: 64.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.415', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.098', 'AMMO4': '0.144', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.364', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '53.500'} [2024-08-06 02:02:11,393][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:02:11,831][52649] DAMAGECOUNT value on done: 250703.0 [2024-08-06 02:02:11,831][52649] Sum rewards: 63.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.012', 'AMMO2': '0.033', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.164', 'AMMO3': '0.189', 'weapon4': '0.212', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '53.500'} [2024-08-06 02:02:11,884][52663] DAMAGECOUNT value on done: 261275.0 [2024-08-06 02:02:11,888][52663] Sum rewards: 69.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.066', 'weapon5': '0.108', 'AMMO4': '0.113', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 02:02:12,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 286507008. Throughput: 0: 4392.4. Samples: 71636910. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:02:12,795][52567] Avg episode reward: [(0, '66.135')] [2024-08-06 02:02:13,003][52665] DAMAGECOUNT value on done: 255291.0 [2024-08-06 02:02:13,004][52665] Sum rewards: 67.535, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.211', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.126', 'AMMO4': '0.166', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '59.500'} [2024-08-06 02:02:13,611][52659] DAMAGECOUNT value on done: 259312.0 [2024-08-06 02:02:13,614][52659] Sum rewards: 51.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.492', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.818', 'DAMAGECOUNT': '12.141', 'FRAGCOUNT': '46.000'} [2024-08-06 02:02:13,750][52647] DAMAGECOUNT value on done: 269336.0 [2024-08-06 02:02:13,751][52647] Sum rewards: 42.544, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.700', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.154', 'weapon2': '0.256', 'WEAPON5': '0.300', 'AMMO3': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.850', 'HITCOUNT': '2.450', 'weapon3': '2.780', 'DAMAGECOUNT': '13.146', 'FRAGCOUNT': '42.000'} [2024-08-06 02:02:14,943][52663] DAMAGECOUNT value on done: 262450.0 [2024-08-06 02:02:14,951][52663] Sum rewards: 72.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 02:02:15,030][52649] DAMAGECOUNT value on done: 257899.0 [2024-08-06 02:02:15,032][52649] Sum rewards: 70.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.204', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.197', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '58.000'} [2024-08-06 02:02:15,720][52650] Updated weights for policy 0, policy_version 34981 (0.0026) [2024-08-06 02:02:16,150][52665] DAMAGECOUNT value on done: 250672.0 [2024-08-06 02:02:16,151][52665] Sum rewards: 62.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.390', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon4': '0.154', 'AMMO3': '0.178', 'weapon2': '0.974', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '51.000'} [2024-08-06 02:02:16,379][52647] DAMAGECOUNT value on done: 269727.0 [2024-08-06 02:02:16,379][52647] Sum rewards: 53.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.174', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '3.242', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '43.000'} [2024-08-06 02:02:16,390][52659] DAMAGECOUNT value on done: 263616.0 [2024-08-06 02:02:16,390][52659] Sum rewards: 57.347, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.600', 'AMMO5': '0.026', 'AMMO2': '0.083', 'AMMO3': '0.197', 'weapon5': '0.258', 'AMMO4': '0.415', 'weapon4': '0.574', 'WEAPON5': '0.650', 'weapon2': '0.652', 'WEAPON4': '0.950', 'WEAPON3': '1.150', 'weapon3': '2.116', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:17,793][52663] DAMAGECOUNT value on done: 266268.0 [2024-08-06 02:02:17,793][52663] Sum rewards: 56.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.138', 'AMMO3': '0.168', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.066', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '47.000'} [2024-08-06 02:02:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 286597120. Throughput: 0: 4391.6. Samples: 71649900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:02:17,794][52567] Avg episode reward: [(0, '65.364')] [2024-08-06 02:02:18,027][52649] DAMAGECOUNT value on done: 253415.0 [2024-08-06 02:02:18,029][52649] Sum rewards: 64.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO4': '0.146', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.324', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '56.000'} [2024-08-06 02:02:18,214][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:02:18,976][52659] DAMAGECOUNT value on done: 264203.0 [2024-08-06 02:02:18,977][52659] Sum rewards: 74.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.178', 'weapon4': '0.194', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '60.000'} [2024-08-06 02:02:19,084][52665] DAMAGECOUNT value on done: 249382.0 [2024-08-06 02:02:19,085][52665] Sum rewards: 63.151, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.152', 'weapon5': '0.214', 'AMMO4': '0.249', 'AMMO3': '0.256', 'weapon2': '0.326', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.010', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '55.000'} [2024-08-06 02:02:19,159][52647] DAMAGECOUNT value on done: 264650.0 [2024-08-06 02:02:19,160][52647] Sum rewards: 59.754, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.106', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.179', 'weapon4': '0.204', 'AMMO4': '0.261', 'weapon5': '0.284', 'weapon2': '0.414', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '48.000'} [2024-08-06 02:02:19,981][52650] Updated weights for policy 0, policy_version 34991 (0.0011) [2024-08-06 02:02:20,750][52663] DAMAGECOUNT value on done: 262072.0 [2024-08-06 02:02:20,758][52663] Sum rewards: 68.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.020', 'weapon5': '0.030', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.204', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.560', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '56.000'} [2024-08-06 02:02:21,123][52649] DAMAGECOUNT value on done: 253516.0 [2024-08-06 02:02:21,123][52649] Sum rewards: 67.300, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.117', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '55.000'} [2024-08-06 02:02:21,626][52647] DAMAGECOUNT value on done: 272727.0 [2024-08-06 02:02:21,627][52647] Sum rewards: 56.783, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.635', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.098', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '48.000'} [2024-08-06 02:02:22,008][52665] DAMAGECOUNT value on done: 261183.0 [2024-08-06 02:02:22,009][52665] Sum rewards: 78.766, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.370', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon2': '0.202', 'weapon4': '0.242', 'AMMO3': '0.277', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '68.000'} [2024-08-06 02:02:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 286687232. Throughput: 0: 4405.3. Samples: 71676250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:02:22,794][52567] Avg episode reward: [(0, '64.812')] [2024-08-06 02:02:23,942][52649] DAMAGECOUNT value on done: 254571.0 [2024-08-06 02:02:23,944][52649] Sum rewards: 62.507, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.157', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.258', 'weapon4': '0.260', 'AMMO4': '0.262', 'weapon5': '0.276', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.802', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '55.500'} [2024-08-06 02:02:24,029][52663] DAMAGECOUNT value on done: 257113.0 [2024-08-06 02:02:24,030][52663] Sum rewards: 61.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.178', 'AMMO3': '0.181', 'AMMO4': '0.221', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.708', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:24,268][52660] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:02:24,655][52665] DAMAGECOUNT value on done: 257710.0 [2024-08-06 02:02:24,656][52665] Sum rewards: 74.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.226', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '61.000'} [2024-08-06 02:02:25,089][52650] Updated weights for policy 0, policy_version 35001 (0.0023) [2024-08-06 02:02:26,213][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:02:26,608][52649] DAMAGECOUNT value on done: 254087.0 [2024-08-06 02:02:26,610][52649] Sum rewards: 64.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'ARMOR': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.216', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '53.000'} [2024-08-06 02:02:27,560][52665] DAMAGECOUNT value on done: 261113.0 [2024-08-06 02:02:27,561][52665] Sum rewards: 79.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.962', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.086', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.656', 'WEAPON3': '0.950', 'weapon3': '2.894', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 02:02:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 286777344. Throughput: 0: 4405.8. Samples: 71702540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:02:27,794][52567] Avg episode reward: [(0, '64.991')] [2024-08-06 02:02:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035007_286777344.pth... [2024-08-06 02:02:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000034493_282566656.pth [2024-08-06 02:02:29,438][52650] Updated weights for policy 0, policy_version 35011 (0.0040) [2024-08-06 02:02:29,711][52649] DAMAGECOUNT value on done: 255421.0 [2024-08-06 02:02:29,714][52649] Sum rewards: 70.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.117', 'weapon4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '59.000'} [2024-08-06 02:02:30,485][52665] DAMAGECOUNT value on done: 258484.0 [2024-08-06 02:02:30,486][52665] Sum rewards: 62.919, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.821', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.240', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '49.000'} [2024-08-06 02:02:32,395][52649] DAMAGECOUNT value on done: 257337.0 [2024-08-06 02:02:32,404][52649] Sum rewards: 62.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.825', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.176', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:32,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 286867456. Throughput: 0: 4401.1. Samples: 71715660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:02:32,795][52567] Avg episode reward: [(0, '64.838')] [2024-08-06 02:02:33,430][52665] DAMAGECOUNT value on done: 265334.0 [2024-08-06 02:02:33,431][52665] Sum rewards: 72.427, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.067', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.217', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '61.000'} [2024-08-06 02:02:34,289][52650] Updated weights for policy 0, policy_version 35021 (0.0015) [2024-08-06 02:02:35,123][52649] DAMAGECOUNT value on done: 250200.0 [2024-08-06 02:02:35,124][52649] Sum rewards: 83.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO5': '0.006', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.242', 'WEAPON3': '1.200', 'weapon3': '3.528', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '68.000'} [2024-08-06 02:02:35,882][52665] DAMAGECOUNT value on done: 261180.0 [2024-08-06 02:02:35,883][52665] Sum rewards: 54.729, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.904', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.114', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.140', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '48.000'} [2024-08-06 02:02:36,180][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:02:37,600][52649] DAMAGECOUNT value on done: 254571.0 [2024-08-06 02:02:37,601][52649] Sum rewards: 70.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.940', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.256', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '62.000'} [2024-08-06 02:02:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.4). Total num frames: 286949376. Throughput: 0: 4398.2. Samples: 71742070. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:02:37,794][52567] Avg episode reward: [(0, '64.999')] [2024-08-06 02:02:38,443][52665] DAMAGECOUNT value on done: 259801.0 [2024-08-06 02:02:38,445][52665] Sum rewards: 51.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO4': '0.192', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.720', 'WEAPON3': '1.300', 'HITCOUNT': '2.600', 'weapon3': '2.640', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '44.000'} [2024-08-06 02:02:38,607][52650] Updated weights for policy 0, policy_version 35031 (0.0013) [2024-08-06 02:02:39,407][52667] DAMAGECOUNT value on done: 260845.0 [2024-08-06 02:02:39,408][52667] Sum rewards: 63.248, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.076', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.120', 'weapon4': '0.202', 'AMMO3': '0.221', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '54.000'} [2024-08-06 02:02:39,501][52668] DAMAGECOUNT value on done: 258637.0 [2024-08-06 02:02:39,501][52668] Sum rewards: 59.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.624', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.430', 'weapon3': '3.432', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '51.000'} [2024-08-06 02:02:40,289][52649] DAMAGECOUNT value on done: 252784.0 [2024-08-06 02:02:40,291][52649] Sum rewards: 62.108, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.253', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.154', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.040', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 02:02:41,047][52665] DAMAGECOUNT value on done: 258286.0 [2024-08-06 02:02:41,047][52665] Sum rewards: 76.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '65.000'} [2024-08-06 02:02:42,377][52668] DAMAGECOUNT value on done: 266428.0 [2024-08-06 02:02:42,378][52668] Sum rewards: 67.297, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.746', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.118', 'AMMO4': '0.147', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.288', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '55.000'} [2024-08-06 02:02:42,394][52658] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:02:42,482][52667] DAMAGECOUNT value on done: 264334.0 [2024-08-06 02:02:42,482][52667] Sum rewards: 64.821, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.122', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.310', 'weapon4': '0.396', 'WEAPON3': '1.000', 'weapon3': '3.034', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '51.000'} [2024-08-06 02:02:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 287039488. Throughput: 0: 4397.6. Samples: 71768470. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:02:42,794][52567] Avg episode reward: [(0, '65.163')] [2024-08-06 02:02:43,008][52649] DAMAGECOUNT value on done: 258181.0 [2024-08-06 02:02:43,008][52649] Sum rewards: 56.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.464', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.140', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon5': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.002', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:43,185][52664] DAMAGECOUNT value on done: 269005.0 [2024-08-06 02:02:43,188][52664] Sum rewards: 69.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '59.000'} [2024-08-06 02:02:43,429][52650] Updated weights for policy 0, policy_version 35041 (0.0012) [2024-08-06 02:02:43,729][52665] DAMAGECOUNT value on done: 256959.0 [2024-08-06 02:02:43,737][52665] Sum rewards: 56.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.232', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon2': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.400', 'ARMOR': '0.460', 'weapon4': '0.596', 'WEAPON3': '1.700', 'weapon3': '2.794', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '52.000'} [2024-08-06 02:02:45,280][52668] DAMAGECOUNT value on done: 265031.0 [2024-08-06 02:02:45,282][52668] Sum rewards: 60.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.104', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:45,441][52669] Large shaping reward 3.216 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.165, 55.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:02:45,559][52667] DAMAGECOUNT value on done: 262253.0 [2024-08-06 02:02:45,560][52667] Sum rewards: 57.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO3': '0.153', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.926', 'WEAPON3': '1.000', 'weapon3': '2.432', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '46.500'} [2024-08-06 02:02:45,696][52664] DAMAGECOUNT value on done: 271144.0 [2024-08-06 02:02:45,697][52664] Sum rewards: 72.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.191', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 02:02:46,163][52649] DAMAGECOUNT value on done: 259542.0 [2024-08-06 02:02:46,163][52649] Sum rewards: 71.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.748', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.132', 'weapon4': '0.134', 'AMMO3': '0.166', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.772', 'WEAPON3': '1.000', 'weapon3': '2.658', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '57.000'} [2024-08-06 02:02:46,878][52665] DAMAGECOUNT value on done: 255299.0 [2024-08-06 02:02:46,879][52665] Sum rewards: 66.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.419', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '59.000'} [2024-08-06 02:02:47,220][52662] DAMAGECOUNT value on done: 267548.0 [2024-08-06 02:02:47,220][52662] Sum rewards: 58.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.492', 'AMMO5': '0.019', 'AMMO2': '0.074', 'AMMO3': '0.262', 'weapon5': '0.304', 'AMMO4': '0.371', 'weapon4': '0.464', 'WEAPON5': '0.600', 'weapon2': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.202', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 287129600. Throughput: 0: 4404.0. Samples: 71781850. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:02:47,794][52567] Avg episode reward: [(0, '65.224')] [2024-08-06 02:02:47,879][52650] Updated weights for policy 0, policy_version 35051 (0.0012) [2024-08-06 02:02:48,259][52664] DAMAGECOUNT value on done: 270813.0 [2024-08-06 02:02:48,259][52664] Sum rewards: 60.221, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.649', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.201', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '50.000'} [2024-08-06 02:02:48,305][52668] DAMAGECOUNT value on done: 265483.0 [2024-08-06 02:02:48,307][52668] Sum rewards: 65.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.824', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.172', 'weapon2': '0.256', 'weapon4': '0.310', 'AMMO4': '0.332', 'weapon5': '0.342', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.766', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '55.000'} [2024-08-06 02:02:48,630][52667] DAMAGECOUNT value on done: 259518.0 [2024-08-06 02:02:48,630][52667] Sum rewards: 71.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '60.000'} [2024-08-06 02:02:49,361][52649] DAMAGECOUNT value on done: 262085.0 [2024-08-06 02:02:49,369][52649] Sum rewards: 68.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.125', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '57.000'} [2024-08-06 02:02:50,067][52665] DAMAGECOUNT value on done: 257271.0 [2024-08-06 02:02:50,067][52665] Sum rewards: 66.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.334', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.206', 'AMMO3': '0.231', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '55.500'} [2024-08-06 02:02:50,227][52662] DAMAGECOUNT value on done: 267548.0 [2024-08-06 02:02:50,227][52662] Sum rewards: 66.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.142', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.232', 'weapon2': '0.448', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.346', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '57.000'} [2024-08-06 02:02:50,963][52664] DAMAGECOUNT value on done: 269337.0 [2024-08-06 02:02:50,963][52664] Sum rewards: 57.124, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.362', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO4': '0.169', 'weapon4': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '51.000'} [2024-08-06 02:02:51,286][52668] DAMAGECOUNT value on done: 255443.0 [2024-08-06 02:02:51,287][52668] Sum rewards: 70.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.132', 'AMMO4': '0.210', 'AMMO3': '0.217', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '58.000'} [2024-08-06 02:02:51,718][52667] DAMAGECOUNT value on done: 265176.0 [2024-08-06 02:02:51,718][52667] Sum rewards: 56.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.135', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'AMMO3': '0.229', 'AMMO4': '0.258', 'weapon2': '0.388', 'weapon4': '0.530', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.452', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '49.000'} [2024-08-06 02:02:52,581][52650] Updated weights for policy 0, policy_version 35061 (0.0029) [2024-08-06 02:02:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 287219712. Throughput: 0: 4397.8. Samples: 71808230. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:02:52,794][52567] Avg episode reward: [(0, '65.192')] [2024-08-06 02:02:52,806][52662] DAMAGECOUNT value on done: 267741.0 [2024-08-06 02:02:52,807][52662] Sum rewards: 65.524, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.421', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.064', 'weapon4': '0.068', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.252', 'weapon2': '0.316', 'WEAPON3': '1.600', 'weapon3': '3.330', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '56.000'} [2024-08-06 02:02:53,004][52665] DAMAGECOUNT value on done: 255158.0 [2024-08-06 02:02:53,005][52665] Sum rewards: 63.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.258', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.124', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.227', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '53.000'} [2024-08-06 02:02:53,856][52668] DAMAGECOUNT value on done: 264347.0 [2024-08-06 02:02:53,858][52668] Sum rewards: 69.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '57.000'} [2024-08-06 02:02:54,065][52664] DAMAGECOUNT value on done: 270984.0 [2024-08-06 02:02:54,066][52664] Sum rewards: 65.572, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.612', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.080', 'AMMO4': '0.111', 'weapon5': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.248', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '57.000'} [2024-08-06 02:02:54,700][52667] DAMAGECOUNT value on done: 263686.0 [2024-08-06 02:02:54,700][52667] Sum rewards: 64.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.150', 'AMMO4': '0.199', 'AMMO3': '0.219', 'weapon2': '0.340', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '55.000'} [2024-08-06 02:02:55,105][52660] DAMAGECOUNT value on done: 257968.0 [2024-08-06 02:02:55,105][52660] Sum rewards: 57.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.022', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.150', 'weapon5': '0.204', 'AMMO4': '0.212', 'AMMO3': '0.241', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '2.852', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2024-08-06 02:02:55,737][52662] DAMAGECOUNT value on done: 258541.0 [2024-08-06 02:02:55,740][52662] Sum rewards: 75.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.149', 'AMMO4': '0.217', 'weapon5': '0.274', 'weapon4': '0.380', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.442', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '60.000'} [2024-08-06 02:02:56,139][52665] DAMAGECOUNT value on done: 259462.0 [2024-08-06 02:02:56,139][52665] Sum rewards: 77.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.928', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.173', 'weapon2': '0.222', 'WEAPON3': '1.150', 'weapon3': '3.372', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '63.000'} [2024-08-06 02:02:56,821][52668] DAMAGECOUNT value on done: 261727.0 [2024-08-06 02:02:56,822][52668] Sum rewards: 66.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.532', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.195', 'weapon2': '0.322', 'weapon4': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '56.000'} [2024-08-06 02:02:56,937][52664] DAMAGECOUNT value on done: 271160.0 [2024-08-06 02:02:56,937][52664] Sum rewards: 67.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.158', 'AMMO3': '0.175', 'AMMO4': '0.233', 'weapon5': '0.240', 'weapon2': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.088', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '55.000'} [2024-08-06 02:02:57,539][52650] Updated weights for policy 0, policy_version 35071 (0.0023) [2024-08-06 02:02:57,765][52667] DAMAGECOUNT value on done: 266162.0 [2024-08-06 02:02:57,765][52667] Sum rewards: 57.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO3': '0.157', 'AMMO4': '0.176', 'weapon2': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.554', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '45.000'} [2024-08-06 02:02:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 287301632. Throughput: 0: 4392.9. Samples: 71834590. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:02:57,794][52567] Avg episode reward: [(0, '65.540')] [2024-08-06 02:02:58,015][52660] DAMAGECOUNT value on done: 257470.0 [2024-08-06 02:02:58,016][52660] Sum rewards: 62.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.362', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.164', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '52.000'} [2024-08-06 02:02:58,621][52662] DAMAGECOUNT value on done: 263169.0 [2024-08-06 02:02:58,623][52662] Sum rewards: 60.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.145', 'weapon4': '0.158', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.254', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '49.000'} [2024-08-06 02:02:58,790][52665] DAMAGECOUNT value on done: 257752.0 [2024-08-06 02:02:58,791][52665] Sum rewards: 64.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.894', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.212', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '54.000'} [2024-08-06 02:02:59,319][52668] DAMAGECOUNT value on done: 262394.0 [2024-08-06 02:02:59,327][52668] Sum rewards: 59.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.226', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.151', 'weapon5': '0.160', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.196', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '48.000'} [2024-08-06 02:03:00,041][52664] DAMAGECOUNT value on done: 274816.0 [2024-08-06 02:03:00,042][52664] Sum rewards: 67.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.797', 'AMMO5': '0.016', 'AMMO2': '0.065', 'weapon5': '0.232', 'weapon2': '0.248', 'AMMO3': '0.249', 'AMMO4': '0.324', 'WEAPON5': '0.450', 'weapon4': '0.576', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.636', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 02:03:00,418][52667] DAMAGECOUNT value on done: 259777.0 [2024-08-06 02:03:00,418][52667] Sum rewards: 71.739, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.982', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.284', 'AMMO3': '0.295', 'WEAPON3': '1.800', 'weapon3': '3.396', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 02:03:00,468][52660] DAMAGECOUNT value on done: 264512.0 [2024-08-06 02:03:00,470][52660] Sum rewards: 60.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.068', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon2': '0.462', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.286', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '50.000'} [2024-08-06 02:03:01,758][52662] DAMAGECOUNT value on done: 259251.0 [2024-08-06 02:03:01,760][52662] Sum rewards: 61.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.152', 'weapon2': '0.162', 'AMMO3': '0.214', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.326', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:01,767][52668] DAMAGECOUNT value on done: 263010.0 [2024-08-06 02:03:01,767][52668] Sum rewards: 59.117, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.835', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.368', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.246', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:01,844][52650] Updated weights for policy 0, policy_version 35081 (0.0015) [2024-08-06 02:03:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 287399936. Throughput: 0: 4396.9. Samples: 71847760. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:03:02,794][52567] Avg episode reward: [(0, '64.751')] [2024-08-06 02:03:02,979][52667] DAMAGECOUNT value on done: 262126.0 [2024-08-06 02:03:02,980][52667] Sum rewards: 69.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.414', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.248', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.476', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:03,077][52660] DAMAGECOUNT value on done: 263984.0 [2024-08-06 02:03:03,077][52660] Sum rewards: 67.722, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.258', 'HEALTH': '0.350', 'weapon2': '0.652', 'WEAPON3': '0.950', 'weapon3': '2.752', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:03,081][52664] DAMAGECOUNT value on done: 266110.0 [2024-08-06 02:03:03,082][52664] Sum rewards: 74.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '61.000'} [2024-08-06 02:03:04,236][52668] DAMAGECOUNT value on done: 261923.0 [2024-08-06 02:03:04,237][52668] Sum rewards: 65.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.995', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.158', 'AMMO4': '0.221', 'weapon5': '0.238', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.636', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:04,765][52662] DAMAGECOUNT value on done: 266553.0 [2024-08-06 02:03:04,766][52662] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.188', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:05,594][52664] DAMAGECOUNT value on done: 277540.0 [2024-08-06 02:03:05,595][52664] Sum rewards: 55.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.166', 'AMMO3': '0.194', 'weapon4': '0.212', 'weapon2': '0.272', 'AMMO4': '0.281', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.130', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '48.000'} [2024-08-06 02:03:05,622][52667] DAMAGECOUNT value on done: 263546.0 [2024-08-06 02:03:05,622][52667] Sum rewards: 59.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.160', 'weapon5': '0.178', 'weapon4': '0.208', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.890', 'WEAPON3': '0.950', 'weapon3': '2.470', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.118', 'FRAGCOUNT': '47.000'} [2024-08-06 02:03:05,751][52660] DAMAGECOUNT value on done: 261008.0 [2024-08-06 02:03:05,752][52660] Sum rewards: 59.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.621', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.090', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.274', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.336', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:05,915][52669] DAMAGECOUNT value on done: 264363.0 [2024-08-06 02:03:05,915][52669] Sum rewards: 56.048, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.020', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.086', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.362', 'AMMO3': '0.365', 'WEAPON4': '0.400', 'WEAPON3': '2.100', 'weapon3': '2.952', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:06,747][52650] Updated weights for policy 0, policy_version 35091 (0.0030) [2024-08-06 02:03:07,072][52668] DAMAGECOUNT value on done: 263578.0 [2024-08-06 02:03:07,073][52668] Sum rewards: 67.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.835', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.038', 'AMMO4': '0.055', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:07,503][52662] DAMAGECOUNT value on done: 270035.0 [2024-08-06 02:03:07,504][52662] Sum rewards: 66.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.470', 'AMMO5': '0.003', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.076', 'weapon4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 287481856. Throughput: 0: 4401.3. Samples: 71874310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:03:07,794][52567] Avg episode reward: [(0, '64.724')] [2024-08-06 02:03:08,351][52664] DAMAGECOUNT value on done: 269625.0 [2024-08-06 02:03:08,353][52664] Sum rewards: 55.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.164', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.177', 'AMMO4': '0.192', 'weapon4': '0.210', 'weapon5': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.050', 'HITCOUNT': '2.450', 'weapon3': '2.730', 'DAMAGECOUNT': '13.482', 'FRAGCOUNT': '46.000'} [2024-08-06 02:03:08,547][52660] DAMAGECOUNT value on done: 257061.0 [2024-08-06 02:03:08,547][52660] Sum rewards: 64.574, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.162', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.144', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:08,550][52667] DAMAGECOUNT value on done: 263405.0 [2024-08-06 02:03:08,550][52667] Sum rewards: 66.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.153', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '57.000'} [2024-08-06 02:03:08,971][52669] DAMAGECOUNT value on done: 258596.0 [2024-08-06 02:03:08,972][52669] Sum rewards: 66.343, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.989', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.079', 'weapon5': '0.106', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.124', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:10,266][52668] DAMAGECOUNT value on done: 258937.0 [2024-08-06 02:03:10,274][52668] Sum rewards: 61.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.377', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:10,527][52662] DAMAGECOUNT value on done: 262544.0 [2024-08-06 02:03:10,528][52662] Sum rewards: 73.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.110', 'weapon4': '0.178', 'AMMO3': '0.186', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '60.000'} [2024-08-06 02:03:10,939][52664] DAMAGECOUNT value on done: 274210.0 [2024-08-06 02:03:10,940][52664] Sum rewards: 62.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.408', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.046', 'AMMO4': '0.138', 'weapon5': '0.140', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.450', 'weapon3': '3.002', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:11,230][52650] Updated weights for policy 0, policy_version 35101 (0.0012) [2024-08-06 02:03:11,450][52667] DAMAGECOUNT value on done: 264472.0 [2024-08-06 02:03:11,451][52667] Sum rewards: 69.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.268', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '59.000'} [2024-08-06 02:03:11,623][52660] DAMAGECOUNT value on done: 265115.0 [2024-08-06 02:03:11,623][52660] Sum rewards: 60.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.977', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.278', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:12,112][52669] DAMAGECOUNT value on done: 263258.0 [2024-08-06 02:03:12,112][52669] Sum rewards: 56.808, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.385', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.110', 'weapon4': '0.118', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.278', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '51.000'} [2024-08-06 02:03:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 287571968. Throughput: 0: 4399.3. Samples: 71900510. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:03:12,795][52567] Avg episode reward: [(0, '64.509')] [2024-08-06 02:03:12,866][52668] DAMAGECOUNT value on done: 252431.0 [2024-08-06 02:03:12,868][52668] Sum rewards: 62.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon4': '0.126', 'AMMO4': '0.141', 'weapon5': '0.142', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:13,408][52662] DAMAGECOUNT value on done: 275565.0 [2024-08-06 02:03:13,408][52662] Sum rewards: 79.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.448', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '66.000'} [2024-08-06 02:03:13,410][52664] DAMAGECOUNT value on done: 270879.0 [2024-08-06 02:03:13,410][52664] Sum rewards: 60.416, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.436', 'weapon2': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.712', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '48.000'} [2024-08-06 02:03:14,270][52660] DAMAGECOUNT value on done: 267669.0 [2024-08-06 02:03:14,270][52660] Sum rewards: 57.081, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.882', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.808', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '50.000'} [2024-08-06 02:03:14,469][52667] DAMAGECOUNT value on done: 262875.0 [2024-08-06 02:03:14,473][52667] Sum rewards: 60.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.859', 'AMMO5': '0.010', 'ARMOR': '0.040', 'AMMO2': '0.054', 'AMMO3': '0.170', 'weapon2': '0.218', 'weapon5': '0.220', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.674', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '50.000'} [2024-08-06 02:03:14,763][52669] DAMAGECOUNT value on done: 261452.0 [2024-08-06 02:03:14,764][52669] Sum rewards: 61.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.469', 'AMMO5': '0.013', 'AMMO2': '0.064', 'weapon5': '0.264', 'AMMO3': '0.270', 'weapon2': '0.272', 'weapon4': '0.274', 'AMMO4': '0.319', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.890', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:15,870][52668] DAMAGECOUNT value on done: 254928.0 [2024-08-06 02:03:15,872][52668] Sum rewards: 59.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.282', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.264', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.396', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '50.500'} [2024-08-06 02:03:15,987][52664] DAMAGECOUNT value on done: 274720.0 [2024-08-06 02:03:15,989][52664] Sum rewards: 67.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.012', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.096', 'weapon4': '0.196', 'AMMO3': '0.242', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '59.000'} [2024-08-06 02:03:16,027][52650] Updated weights for policy 0, policy_version 35111 (0.0040) [2024-08-06 02:03:16,143][52662] DAMAGECOUNT value on done: 262994.0 [2024-08-06 02:03:16,144][52662] Sum rewards: 60.403, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.952', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO3': '0.158', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.432', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2024-08-06 02:03:17,323][52794] DAMAGECOUNT value on done: 264970.0 [2024-08-06 02:03:17,323][52794] Sum rewards: 64.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.173', 'weapon5': '0.208', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'weapon4': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.488', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '51.000'} [2024-08-06 02:03:17,441][52667] DAMAGECOUNT value on done: 258689.0 [2024-08-06 02:03:17,443][52667] Sum rewards: 63.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:17,556][52660] DAMAGECOUNT value on done: 265652.0 [2024-08-06 02:03:17,556][52660] Sum rewards: 65.290, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.269', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:17,668][52669] DAMAGECOUNT value on done: 258849.0 [2024-08-06 02:03:17,669][52669] Sum rewards: 58.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.075', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'weapon4': '0.190', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 287653888. Throughput: 0: 4402.0. Samples: 71913750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:03:17,795][52567] Avg episode reward: [(0, '64.720')] [2024-08-06 02:03:18,554][52664] DAMAGECOUNT value on done: 270462.0 [2024-08-06 02:03:18,554][52664] Sum rewards: 55.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.622', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'weapon4': '0.228', 'AMMO3': '0.233', 'weapon2': '0.430', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '49.000'} [2024-08-06 02:03:18,592][52795] DAMAGECOUNT value on done: 243929.0 [2024-08-06 02:03:18,593][52795] Sum rewards: 68.925, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.124', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'HEALTH': '0.485', 'weapon2': '0.610', 'WEAPON3': '0.950', 'weapon3': '3.014', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:18,811][52668] DAMAGECOUNT value on done: 256923.0 [2024-08-06 02:03:18,812][52668] Sum rewards: 54.407, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.037', 'AMMO3': '0.173', 'AMMO4': '0.187', 'HEALTH': '0.192', 'weapon5': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.450', 'weapon4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '2.724', 'DAMAGECOUNT': '12.909', 'FRAGCOUNT': '44.000'} [2024-08-06 02:03:19,074][52662] DAMAGECOUNT value on done: 261454.0 [2024-08-06 02:03:19,074][52662] Sum rewards: 45.429, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.278', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.317', 'weapon2': '0.420', 'WEAPON3': '1.800', 'HITCOUNT': '2.860', 'weapon3': '3.216', 'DAMAGECOUNT': '12.639', 'FRAGCOUNT': '44.000'} [2024-08-06 02:03:20,043][52660] DAMAGECOUNT value on done: 259569.0 [2024-08-06 02:03:20,044][52660] Sum rewards: 63.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.166', 'weapon2': '0.244', 'AMMO3': '0.251', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:20,156][52667] DAMAGECOUNT value on done: 268084.0 [2024-08-06 02:03:20,156][52667] Sum rewards: 68.979, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.359', 'AMMO5': '0.007', 'AMMO2': '0.054', 'weapon5': '0.068', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.268', 'AMMO3': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.700', 'weapon3': '3.056', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '60.500'} [2024-08-06 02:03:20,646][52794] DAMAGECOUNT value on done: 268038.0 [2024-08-06 02:03:20,647][52794] Sum rewards: 51.378, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.242', 'weapon5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.324', 'weapon4': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.590', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '45.000'} [2024-08-06 02:03:20,693][52669] DAMAGECOUNT value on done: 260647.0 [2024-08-06 02:03:20,695][52669] Sum rewards: 60.362, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.534', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.102', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.252', 'weapon4': '0.356', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:20,858][52650] Updated weights for policy 0, policy_version 35121 (0.0012) [2024-08-06 02:03:21,177][52668] DAMAGECOUNT value on done: 259762.0 [2024-08-06 02:03:21,185][52668] Sum rewards: 63.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.210', 'weapon4': '0.214', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.298', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:21,184][52664] DAMAGECOUNT value on done: 274951.0 [2024-08-06 02:03:21,186][52664] Sum rewards: 60.277, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.151', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon4': '0.414', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.706', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '54.500'} [2024-08-06 02:03:21,759][52795] DAMAGECOUNT value on done: 237272.0 [2024-08-06 02:03:21,764][52795] Sum rewards: 69.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.492', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon2': '0.220', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.600', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2024-08-06 02:03:22,314][52662] DAMAGECOUNT value on done: 263726.0 [2024-08-06 02:03:22,314][52662] Sum rewards: 74.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.106', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 02:03:22,510][52660] DAMAGECOUNT value on done: 267558.0 [2024-08-06 02:03:22,511][52660] Sum rewards: 66.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.371', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.086', 'weapon2': '0.144', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.566', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 287744000. Throughput: 0: 4402.0. Samples: 71940160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:03:22,794][52567] Avg episode reward: [(0, '64.221')] [2024-08-06 02:03:23,194][52667] DAMAGECOUNT value on done: 271525.0 [2024-08-06 02:03:23,194][52667] Sum rewards: 63.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.180', 'weapon4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:23,603][52664] DAMAGECOUNT value on done: 267731.0 [2024-08-06 02:03:23,603][52794] DAMAGECOUNT value on done: 263061.0 [2024-08-06 02:03:23,604][52664] Sum rewards: 62.800, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.060', 'AMMO4': '0.232', 'AMMO3': '0.275', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.650', 'weapon3': '2.894', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:23,605][52794] Sum rewards: 53.862, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.390', 'AMMO5': '0.010', 'AMMO2': '0.066', 'weapon5': '0.116', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'AMMO4': '0.328', 'weapon4': '0.356', 'weapon2': '0.446', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.740', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '49.000'} [2024-08-06 02:03:23,753][52669] DAMAGECOUNT value on done: 264557.0 [2024-08-06 02:03:23,753][52669] Sum rewards: 70.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.742', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '59.000'} [2024-08-06 02:03:24,245][52668] DAMAGECOUNT value on done: 260464.0 [2024-08-06 02:03:24,246][52668] Sum rewards: 72.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.986', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.154', 'weapon5': '0.184', 'weapon2': '0.342', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:24,902][52795] DAMAGECOUNT value on done: 238208.0 [2024-08-06 02:03:24,903][52795] Sum rewards: 61.531, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.168', 'weapon4': '0.178', 'AMMO4': '0.217', 'AMMO3': '0.249', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.114', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:25,048][52662] DAMAGECOUNT value on done: 270925.0 [2024-08-06 02:03:25,049][52662] Sum rewards: 71.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.179', 'weapon2': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 02:03:25,577][52650] Updated weights for policy 0, policy_version 35131 (0.0026) [2024-08-06 02:03:25,984][52664] DAMAGECOUNT value on done: 272518.0 [2024-08-06 02:03:25,984][52664] Sum rewards: 57.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.120', 'weapon5': '0.148', 'AMMO4': '0.183', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '3.194', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '50.000'} [2024-08-06 02:03:26,089][52660] DAMAGECOUNT value on done: 253268.0 [2024-08-06 02:03:26,089][52660] Sum rewards: 79.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.066', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.138', 'AMMO3': '0.218', 'weapon2': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '67.000'} [2024-08-06 02:03:26,263][52667] DAMAGECOUNT value on done: 266691.0 [2024-08-06 02:03:26,263][52667] Sum rewards: 57.945, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.032', 'ARMOR': '0.008', 'AMMO5': '0.023', 'AMMO2': '0.087', 'AMMO3': '0.259', 'weapon5': '0.272', 'weapon4': '0.366', 'weapon2': '0.412', 'AMMO4': '0.434', 'WEAPON5': '0.750', 'WEAPON4': '0.900', 'WEAPON3': '1.600', 'weapon3': '2.460', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:26,725][52794] DAMAGECOUNT value on done: 263645.0 [2024-08-06 02:03:26,725][52794] Sum rewards: 52.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.150', 'weapon4': '0.196', 'AMMO4': '0.212', 'weapon2': '0.238', 'AMMO3': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.172', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '46.000'} [2024-08-06 02:03:26,954][52669] DAMAGECOUNT value on done: 262524.0 [2024-08-06 02:03:26,957][52669] Sum rewards: 68.718, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon4': '0.166', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '3.274', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:27,319][52668] DAMAGECOUNT value on done: 261713.0 [2024-08-06 02:03:27,320][52668] Sum rewards: 59.358, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.465', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.110', 'AMMO4': '0.111', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.432', 'weapon2': '0.534', 'WEAPON3': '0.950', 'weapon3': '2.614', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '47.000'} [2024-08-06 02:03:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 287834112. Throughput: 0: 4401.3. Samples: 71966530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:03:27,794][52567] Avg episode reward: [(0, '63.822')] [2024-08-06 02:03:27,922][52795] DAMAGECOUNT value on done: 242364.0 [2024-08-06 02:03:27,922][52795] Sum rewards: 59.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.822', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO4': '0.140', 'weapon5': '0.182', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.170', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '49.000'} [2024-08-06 02:03:28,099][52658] DAMAGECOUNT value on done: 264725.0 [2024-08-06 02:03:28,100][52658] Sum rewards: 61.338, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.180', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.205', 'weapon2': '0.214', 'AMMO3': '0.296', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.750', 'weapon3': '2.900', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:28,300][52662] DAMAGECOUNT value on done: 263618.0 [2024-08-06 02:03:28,301][52662] Sum rewards: 60.763, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.187', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.147', 'weapon5': '0.178', 'AMMO4': '0.198', 'weapon4': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.700', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '49.000'} [2024-08-06 02:03:28,387][52664] DAMAGECOUNT value on done: 273621.0 [2024-08-06 02:03:28,387][52664] Sum rewards: 69.826, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.961', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.147', 'weapon2': '0.860', 'WEAPON3': '1.050', 'weapon3': '2.870', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:28,568][52660] DAMAGECOUNT value on done: 258396.0 [2024-08-06 02:03:28,569][52660] Sum rewards: 67.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.357', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'weapon4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '2.630', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:29,442][52667] DAMAGECOUNT value on done: 268279.0 [2024-08-06 02:03:29,443][52667] Sum rewards: 67.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.223', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.128', 'weapon5': '0.144', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.100', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:29,667][52650] Updated weights for policy 0, policy_version 35141 (0.0033) [2024-08-06 02:03:29,712][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:03:29,897][52668] DAMAGECOUNT value on done: 264276.0 [2024-08-06 02:03:29,898][52668] Sum rewards: 58.019, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.144', 'weapon5': '0.148', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '3.136', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:29,947][52669] DAMAGECOUNT value on done: 264063.0 [2024-08-06 02:03:29,947][52669] Sum rewards: 77.699, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.281', 'weapon2': '0.446', 'WEAPON3': '1.600', 'weapon3': '3.214', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '69.000'} [2024-08-06 02:03:30,045][52794] DAMAGECOUNT value on done: 260950.0 [2024-08-06 02:03:30,046][52794] Sum rewards: 61.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.050', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:30,349][52647] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:03:30,957][52658] DAMAGECOUNT value on done: 263856.0 [2024-08-06 02:03:30,957][52658] Sum rewards: 48.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.758', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.564', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '2.982', 'DAMAGECOUNT': '12.837', 'FRAGCOUNT': '42.000'} [2024-08-06 02:03:31,086][52660] DAMAGECOUNT value on done: 267436.0 [2024-08-06 02:03:31,090][52660] Sum rewards: 63.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.015', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.224', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:31,147][52795] DAMAGECOUNT value on done: 246244.0 [2024-08-06 02:03:31,147][52795] Sum rewards: 67.235, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.485', 'AMMO5': '0.022', 'AMMO2': '0.068', 'weapon5': '0.106', 'AMMO3': '0.258', 'AMMO4': '0.341', 'weapon2': '0.352', 'weapon4': '0.366', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '60.000'} [2024-08-06 02:03:31,340][52664] DAMAGECOUNT value on done: 271846.0 [2024-08-06 02:03:31,341][52664] Sum rewards: 69.370, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.565', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '59.000'} [2024-08-06 02:03:31,585][52662] DAMAGECOUNT value on done: 273111.0 [2024-08-06 02:03:31,586][52662] Sum rewards: 73.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.082', 'weapon4': '0.142', 'AMMO3': '0.217', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '63.000'} [2024-08-06 02:03:32,097][52667] DAMAGECOUNT value on done: 258683.0 [2024-08-06 02:03:32,097][52667] Sum rewards: 66.718, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.514', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.166', 'AMMO3': '0.171', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:32,778][52669] DAMAGECOUNT value on done: 258713.0 [2024-08-06 02:03:32,778][52669] Sum rewards: 67.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.480', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.154', 'AMMO3': '0.190', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:32,785][52794] DAMAGECOUNT value on done: 264178.0 [2024-08-06 02:03:32,785][52794] Sum rewards: 63.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.608', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.092', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '2.636', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '52.500'} [2024-08-06 02:03:32,786][52668] DAMAGECOUNT value on done: 261597.0 [2024-08-06 02:03:32,786][52668] Sum rewards: 78.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon4': '0.226', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '65.000'} [2024-08-06 02:03:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 287924224. Throughput: 0: 4395.3. Samples: 71979640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:03:32,794][52567] Avg episode reward: [(0, '63.857')] [2024-08-06 02:03:33,870][52664] DAMAGECOUNT value on done: 274130.0 [2024-08-06 02:03:33,870][52664] Sum rewards: 75.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.545', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.148', 'AMMO4': '0.177', 'AMMO3': '0.221', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '62.000'} [2024-08-06 02:03:33,882][52658] DAMAGECOUNT value on done: 264840.0 [2024-08-06 02:03:33,883][52658] Sum rewards: 71.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.124', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.070', 'weapon4': '0.096', 'AMMO4': '0.131', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:34,039][52662] DAMAGECOUNT value on done: 264338.0 [2024-08-06 02:03:34,041][52662] Sum rewards: 48.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.182', 'AMMO4': '0.191', 'AMMO3': '0.208', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '2.772', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '42.000'} [2024-08-06 02:03:34,045][52660] DAMAGECOUNT value on done: 271638.0 [2024-08-06 02:03:34,046][52660] Sum rewards: 69.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.146', 'weapon5': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.588', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:34,273][52795] DAMAGECOUNT value on done: 242619.0 [2024-08-06 02:03:34,273][52795] Sum rewards: 68.742, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'HEALTH': '0.185', 'AMMO3': '0.192', 'weapon2': '0.274', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.440', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '57.000'} [2024-08-06 02:03:34,770][52650] Updated weights for policy 0, policy_version 35151 (0.0012) [2024-08-06 02:03:35,249][52667] DAMAGECOUNT value on done: 265017.0 [2024-08-06 02:03:35,250][52667] Sum rewards: 69.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.333', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.298', 'weapon4': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.000'} [2024-08-06 02:03:35,326][52794] DAMAGECOUNT value on done: 268253.0 [2024-08-06 02:03:35,328][52794] Sum rewards: 63.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.531', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.164', 'AMMO3': '0.230', 'AMMO4': '0.232', 'weapon2': '0.258', 'WEAPON5': '0.300', 'weapon4': '0.478', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:35,687][52669] DAMAGECOUNT value on done: 265436.0 [2024-08-06 02:03:35,687][52669] Sum rewards: 70.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.929', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.220', 'AMMO4': '0.245', 'weapon4': '0.246', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '61.000'} [2024-08-06 02:03:36,830][52660] DAMAGECOUNT value on done: 257583.0 [2024-08-06 02:03:36,831][52660] Sum rewards: 67.727, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.058', 'weapon4': '0.106', 'AMMO3': '0.133', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '0.904', 'weapon3': '2.792', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:36,974][52662] DAMAGECOUNT value on done: 266180.0 [2024-08-06 02:03:36,974][52662] Sum rewards: 60.049, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.096', 'weapon4': '0.138', 'AMMO4': '0.175', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.076', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '49.000'} [2024-08-06 02:03:37,136][52658] DAMAGECOUNT value on done: 263974.0 [2024-08-06 02:03:37,136][52658] Sum rewards: 66.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.510', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.134', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:37,407][52795] DAMAGECOUNT value on done: 247299.0 [2024-08-06 02:03:37,409][52795] Sum rewards: 86.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.244', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.388', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '72.000'} [2024-08-06 02:03:37,804][52567] Fps is (10 sec: 17186.4, 60 sec: 17609.9, 300 sec: 17549.7). Total num frames: 288006144. Throughput: 0: 4395.5. Samples: 72006070. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:03:37,804][52567] Avg episode reward: [(0, '64.226')] [2024-08-06 02:03:38,520][52794] DAMAGECOUNT value on done: 263816.0 [2024-08-06 02:03:38,520][52794] Sum rewards: 74.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.784', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.036', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.236', 'WEAPON3': '1.400', 'weapon3': '3.438', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '62.500'} [2024-08-06 02:03:38,641][52669] DAMAGECOUNT value on done: 263206.0 [2024-08-06 02:03:38,641][52669] Sum rewards: 62.811, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.414', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.116', 'weapon4': '0.122', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.304', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '51.000'} [2024-08-06 02:03:39,390][52650] Updated weights for policy 0, policy_version 35161 (0.0018) [2024-08-06 02:03:39,865][52660] DAMAGECOUNT value on done: 263140.0 [2024-08-06 02:03:39,865][52660] Sum rewards: 63.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.660', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.180', 'AMMO4': '0.194', 'weapon5': '0.214', 'weapon2': '0.274', 'WEAPON5': '0.350', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:40,034][52662] DAMAGECOUNT value on done: 264469.0 [2024-08-06 02:03:40,034][52662] Sum rewards: 63.529, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.266', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.104', 'weapon4': '0.164', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:40,176][52658] DAMAGECOUNT value on done: 264103.0 [2024-08-06 02:03:40,178][52658] Sum rewards: 46.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.006', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.114', 'AMMO4': '0.184', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.746', 'WEAPON3': '1.350', 'weapon3': '2.460', 'HITCOUNT': '2.500', 'DAMAGECOUNT': '13.113', 'FRAGCOUNT': '40.000'} [2024-08-06 02:03:40,575][52795] DAMAGECOUNT value on done: 243786.0 [2024-08-06 02:03:40,577][52795] Sum rewards: 62.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.950', 'AMMO2': '0.018', 'AMMO5': '0.018', 'weapon4': '0.046', 'AMMO4': '0.088', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.301', 'weapon2': '0.386', 'WEAPON3': '1.850', 'weapon3': '3.194', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:41,186][52794] DAMAGECOUNT value on done: 268870.0 [2024-08-06 02:03:41,187][52794] Sum rewards: 69.794, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.624', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'weapon2': '0.250', 'AMMO3': '0.259', 'weapon4': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '61.000'} [2024-08-06 02:03:41,741][52669] DAMAGECOUNT value on done: 260571.0 [2024-08-06 02:03:41,743][52669] Sum rewards: 62.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.086', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO4': '0.186', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '50.000'} [2024-08-06 02:03:42,584][52662] DAMAGECOUNT value on done: 258652.0 [2024-08-06 02:03:42,585][52662] Sum rewards: 51.914, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.085', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'weapon4': '0.420', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '42.000'} [2024-08-06 02:03:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 288096256. Throughput: 0: 4400.2. Samples: 72032600. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:03:42,794][52567] Avg episode reward: [(0, '64.156')] [2024-08-06 02:03:42,839][52660] DAMAGECOUNT value on done: 253409.0 [2024-08-06 02:03:42,841][52660] Sum rewards: 69.659, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.080', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.064', 'weapon4': '0.096', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO4': '0.193', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.434', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '59.000'} [2024-08-06 02:03:42,913][52658] DAMAGECOUNT value on done: 261542.0 [2024-08-06 02:03:42,913][52658] Sum rewards: 68.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.052', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 02:03:43,756][52795] DAMAGECOUNT value on done: 239715.0 [2024-08-06 02:03:43,757][52795] Sum rewards: 52.759, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.010', 'AMMO5': '0.017', 'weapon4': '0.024', 'AMMO2': '0.026', 'weapon5': '0.056', 'AMMO4': '0.128', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.686', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.902', 'DAMAGECOUNT': '12.897', 'FRAGCOUNT': '45.000'} [2024-08-06 02:03:43,925][52650] Updated weights for policy 0, policy_version 35171 (0.0028) [2024-08-06 02:03:44,074][52794] DAMAGECOUNT value on done: 266083.0 [2024-08-06 02:03:44,076][52794] Sum rewards: 65.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.164', 'AMMO3': '0.187', 'weapon2': '0.340', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:44,293][52669] DAMAGECOUNT value on done: 265260.0 [2024-08-06 02:03:44,293][52669] Sum rewards: 66.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.264', 'AMMO5': '0.012', 'ARMOR': '0.028', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.814', 'WEAPON3': '1.200', 'weapon3': '2.580', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:45,871][52660] DAMAGECOUNT value on done: 262431.0 [2024-08-06 02:03:45,871][52660] Sum rewards: 66.520, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.208', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:45,919][52658] DAMAGECOUNT value on done: 268580.0 [2024-08-06 02:03:45,919][52658] Sum rewards: 55.468, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.369', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.632', 'weapon4': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.338', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.626', 'FRAGCOUNT': '46.000'} [2024-08-06 02:03:46,445][52803] DAMAGECOUNT value on done: 244324.0 [2024-08-06 02:03:46,446][52803] Sum rewards: 66.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.502', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.080', 'weapon2': '0.138', 'weapon4': '0.172', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.376', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:46,813][52669] DAMAGECOUNT value on done: 266908.0 [2024-08-06 02:03:46,813][52669] Sum rewards: 65.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.161', 'AMMO4': '0.244', 'weapon4': '0.272', 'weapon2': '0.274', 'weapon5': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:46,892][52795] DAMAGECOUNT value on done: 248089.0 [2024-08-06 02:03:46,892][52795] Sum rewards: 67.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.970', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO3': '0.168', 'AMMO4': '0.220', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.152', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:47,224][52794] DAMAGECOUNT value on done: 264591.0 [2024-08-06 02:03:47,227][52794] Sum rewards: 66.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.055', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.124', 'weapon2': '0.182', 'AMMO3': '0.197', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:47,794][52567] Fps is (10 sec: 17219.9, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 288178176. Throughput: 0: 4399.8. Samples: 72045750. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:03:47,795][52567] Avg episode reward: [(0, '64.263')] [2024-08-06 02:03:48,465][52660] DAMAGECOUNT value on done: 258752.0 [2024-08-06 02:03:48,466][52660] Sum rewards: 62.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.897', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO4': '0.155', 'AMMO3': '0.180', 'weapon2': '0.224', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:48,559][52650] Updated weights for policy 0, policy_version 35181 (0.0013) [2024-08-06 02:03:48,902][52658] DAMAGECOUNT value on done: 257340.0 [2024-08-06 02:03:48,902][52658] Sum rewards: 69.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.078', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.152', 'weapon5': '0.162', 'AMMO3': '0.204', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.450', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '59.000'} [2024-08-06 02:03:49,558][52803] DAMAGECOUNT value on done: 244867.0 [2024-08-06 02:03:49,561][52803] Sum rewards: 64.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.698', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon4': '0.212', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:49,902][52795] DAMAGECOUNT value on done: 242874.0 [2024-08-06 02:03:49,902][52795] Sum rewards: 66.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.276', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.106', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:49,920][52671] DAMAGECOUNT value on done: 266913.0 [2024-08-06 02:03:49,920][52669] DAMAGECOUNT value on done: 275965.0 [2024-08-06 02:03:49,921][52671] Sum rewards: 61.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.645', 'AMMO5': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.186', 'weapon5': '0.214', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON4': '0.600', 'weapon4': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.394', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '51.000'} [2024-08-06 02:03:49,921][52669] Sum rewards: 64.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.020', 'AMMO4': '0.069', 'weapon5': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.230', 'weapon2': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:50,425][52794] DAMAGECOUNT value on done: 262919.0 [2024-08-06 02:03:50,426][52794] Sum rewards: 56.776, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.516', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.138', 'WEAPON4': '0.250', 'AMMO3': '0.317', 'weapon2': '0.356', 'WEAPON3': '1.750', 'HITCOUNT': '3.150', 'weapon3': '3.182', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:51,877][52658] DAMAGECOUNT value on done: 268675.0 [2024-08-06 02:03:51,878][52658] Sum rewards: 61.975, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON5': '0.100', 'HEALTH': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon2': '0.192', 'AMMO3': '0.203', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.322', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '52.000'} [2024-08-06 02:03:52,388][52811] DAMAGECOUNT value on done: 254909.0 [2024-08-06 02:03:52,391][52811] Sum rewards: 64.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.284', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.127', 'weapon5': '0.128', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.238', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:52,600][52669] DAMAGECOUNT value on done: 262679.0 [2024-08-06 02:03:52,602][52669] Sum rewards: 75.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.054', 'weapon4': '0.088', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.271', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '64.000'} [2024-08-06 02:03:52,662][52803] DAMAGECOUNT value on done: 244972.0 [2024-08-06 02:03:52,664][52803] Sum rewards: 65.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.395', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.042', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.312', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:52,731][52671] DAMAGECOUNT value on done: 264379.0 [2024-08-06 02:03:52,731][52671] Sum rewards: 68.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.148', 'weapon4': '0.164', 'AMMO4': '0.197', 'weapon2': '0.230', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '57.000'} [2024-08-06 02:03:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 288276480. Throughput: 0: 4395.3. Samples: 72072100. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:03:52,794][52567] Avg episode reward: [(0, '64.424')] [2024-08-06 02:03:53,085][52795] DAMAGECOUNT value on done: 240905.0 [2024-08-06 02:03:53,087][52795] Sum rewards: 63.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.140', 'weapon4': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.000'} [2024-08-06 02:03:53,157][52794] DAMAGECOUNT value on done: 259416.0 [2024-08-06 02:03:53,159][52794] Sum rewards: 56.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.372', 'AMMO5': '0.004', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.056', 'weapon4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon2': '0.532', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.194', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '47.000'} [2024-08-06 02:03:53,554][52650] Updated weights for policy 0, policy_version 35191 (0.0028) [2024-08-06 02:03:54,927][52658] DAMAGECOUNT value on done: 266460.0 [2024-08-06 02:03:54,932][52658] Sum rewards: 64.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.120', 'weapon5': '0.184', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.246', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '54.500'} [2024-08-06 02:03:55,301][52671] DAMAGECOUNT value on done: 266183.0 [2024-08-06 02:03:55,302][52671] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.765', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.234', 'weapon2': '0.324', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.400', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:55,421][52811] DAMAGECOUNT value on done: 243239.0 [2024-08-06 02:03:55,422][52811] Sum rewards: 61.909, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.523', 'AMMO5': '0.014', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.157', 'weapon5': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.496', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '50.000'} [2024-08-06 02:03:55,593][52669] DAMAGECOUNT value on done: 268740.0 [2024-08-06 02:03:55,597][52669] Sum rewards: 60.522, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.948', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.088', 'AMMO3': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.350', 'weapon4': '0.518', 'weapon2': '0.524', 'WEAPON3': '0.750', 'weapon3': '2.734', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '48.000'} [2024-08-06 02:03:55,700][52803] DAMAGECOUNT value on done: 246537.0 [2024-08-06 02:03:55,701][52803] Sum rewards: 62.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.716', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:56,241][52794] DAMAGECOUNT value on done: 272556.0 [2024-08-06 02:03:56,245][52794] Sum rewards: 59.689, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.766', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.142', 'weapon4': '0.202', 'AMMO4': '0.265', 'AMMO3': '0.291', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'HITCOUNT': '2.900', 'weapon3': '2.968', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '55.000'} [2024-08-06 02:03:56,431][52795] DAMAGECOUNT value on done: 238691.0 [2024-08-06 02:03:56,431][52795] Sum rewards: 55.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.266', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.205', 'weapon2': '0.664', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.108', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '47.000'} [2024-08-06 02:03:57,482][52666] DAMAGECOUNT value on done: 267612.0 [2024-08-06 02:03:57,483][52666] Sum rewards: 63.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.141', 'AMMO3': '0.196', 'weapon4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 02:03:57,599][52650] Updated weights for policy 0, policy_version 35201 (0.0022) [2024-08-06 02:03:57,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 288366592. Throughput: 0: 4396.5. Samples: 72098350. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:03:57,802][52567] Avg episode reward: [(0, '64.155')] [2024-08-06 02:03:57,977][52671] DAMAGECOUNT value on done: 262698.0 [2024-08-06 02:03:57,979][52671] Sum rewards: 59.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.146', 'weapon4': '0.146', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '51.000'} [2024-08-06 02:03:58,055][52658] DAMAGECOUNT value on done: 270220.0 [2024-08-06 02:03:58,056][52658] Sum rewards: 63.443, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.562', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.126', 'weapon4': '0.214', 'AMMO4': '0.242', 'AMMO3': '0.253', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.060', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:58,452][52811] DAMAGECOUNT value on done: 246656.0 [2024-08-06 02:03:58,454][52811] Sum rewards: 81.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.896', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'AMMO3': '0.230', 'weapon2': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.554', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '67.000'} [2024-08-06 02:03:58,484][52669] DAMAGECOUNT value on done: 267867.0 [2024-08-06 02:03:58,484][52669] Sum rewards: 68.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'weapon2': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon4': '0.666', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 02:03:58,800][52803] DAMAGECOUNT value on done: 248167.0 [2024-08-06 02:03:58,802][52803] Sum rewards: 73.044, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.346', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.160', 'weapon5': '0.180', 'weapon4': '0.190', 'AMMO4': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '58.000'} [2024-08-06 02:03:59,232][52794] DAMAGECOUNT value on done: 260301.0 [2024-08-06 02:03:59,236][52794] Sum rewards: 76.203, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.619', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon5': '0.206', 'weapon2': '0.370', 'WEAPON3': '1.000', 'weapon3': '3.248', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.000'} [2024-08-06 02:03:59,825][52795] DAMAGECOUNT value on done: 243272.0 [2024-08-06 02:03:59,825][52795] Sum rewards: 78.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.953', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.139', 'weapon4': '0.168', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.500'} [2024-08-06 02:04:00,549][52666] DAMAGECOUNT value on done: 267512.0 [2024-08-06 02:04:00,551][52666] Sum rewards: 61.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.244', 'weapon2': '0.454', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.282', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 02:04:00,652][52658] DAMAGECOUNT value on done: 256093.0 [2024-08-06 02:04:00,652][52658] Sum rewards: 63.994, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.500', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'HITCOUNT': '3.370', 'weapon3': '3.398', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:01,038][52671] DAMAGECOUNT value on done: 271322.0 [2024-08-06 02:04:01,038][52671] Sum rewards: 71.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.954', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.117', 'weapon4': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '60.000'} [2024-08-06 02:04:01,307][52669] DAMAGECOUNT value on done: 270024.0 [2024-08-06 02:04:01,308][52669] Sum rewards: 64.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.219', 'weapon4': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:01,462][52811] DAMAGECOUNT value on done: 243376.0 [2024-08-06 02:04:01,465][52811] Sum rewards: 52.383, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.947', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.110', 'AMMO3': '0.164', 'AMMO4': '0.197', 'weapon5': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.050', 'HITCOUNT': '2.510', 'weapon3': '2.844', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '43.000'} [2024-08-06 02:04:01,803][52803] DAMAGECOUNT value on done: 247142.0 [2024-08-06 02:04:01,806][52803] Sum rewards: 57.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.232', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.132', 'weapon4': '0.180', 'AMMO4': '0.214', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.970', 'weapon3': '2.978', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:02,296][52794] DAMAGECOUNT value on done: 271741.0 [2024-08-06 02:04:02,298][52794] Sum rewards: 62.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.308', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.202', 'weapon5': '0.232', 'weapon4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.768', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '52.500'} [2024-08-06 02:04:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 288440320. Throughput: 0: 4395.8. Samples: 72111560. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:04:02,794][52567] Avg episode reward: [(0, '64.901')] [2024-08-06 02:04:02,855][52650] Updated weights for policy 0, policy_version 35211 (0.0031) [2024-08-06 02:04:02,960][52795] DAMAGECOUNT value on done: 235648.0 [2024-08-06 02:04:02,961][52795] Sum rewards: 73.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.154', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '60.000'} [2024-08-06 02:04:03,361][52666] DAMAGECOUNT value on done: 267430.0 [2024-08-06 02:04:03,361][52666] Sum rewards: 74.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.110', 'weapon4': '0.134', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '62.000'} [2024-08-06 02:04:03,784][52658] DAMAGECOUNT value on done: 264522.0 [2024-08-06 02:04:03,784][52658] Sum rewards: 75.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.925', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.151', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.360', 'WEAPON3': '1.000', 'weapon3': '3.286', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '62.000'} [2024-08-06 02:04:03,873][52671] DAMAGECOUNT value on done: 264628.0 [2024-08-06 02:04:03,874][52671] Sum rewards: 58.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.186', 'AMMO4': '0.199', 'weapon5': '0.210', 'AMMO3': '0.218', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:04,672][52811] DAMAGECOUNT value on done: 244722.0 [2024-08-06 02:04:04,672][52811] Sum rewards: 58.763, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.552', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.184', 'AMMO3': '0.229', 'AMMO4': '0.296', 'weapon4': '0.374', 'weapon2': '0.402', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '52.000'} [2024-08-06 02:04:04,854][52803] DAMAGECOUNT value on done: 243114.0 [2024-08-06 02:04:04,855][52803] Sum rewards: 67.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.398', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.104', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.279', 'WEAPON3': '1.650', 'weapon3': '3.268', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 02:04:05,638][52794] DAMAGECOUNT value on done: 265512.0 [2024-08-06 02:04:05,639][52794] Sum rewards: 64.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.084', 'AMMO5': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.038', 'AMMO4': '0.061', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.424', 'WEAPON3': '1.750', 'weapon3': '3.168', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '59.000'} [2024-08-06 02:04:05,866][52658] DAMAGECOUNT value on done: 263290.0 [2024-08-06 02:04:05,866][52658] Sum rewards: 53.726, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.415', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.208', 'AMMO3': '0.252', 'AMMO4': '0.284', 'weapon2': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.738', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:05,932][52670] DAMAGECOUNT value on done: 260626.0 [2024-08-06 02:04:05,933][52670] Sum rewards: 79.537, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'HEALTH': '0.203', 'weapon4': '0.226', 'weapon2': '0.440', 'WEAPON3': '0.900', 'weapon3': '3.090', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '62.500'} [2024-08-06 02:04:05,980][52795] DAMAGECOUNT value on done: 249805.0 [2024-08-06 02:04:05,980][52795] Sum rewards: 68.260, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.003', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.247', 'weapon2': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 02:04:06,349][52666] DAMAGECOUNT value on done: 261771.0 [2024-08-06 02:04:06,351][52666] Sum rewards: 76.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.806', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'weapon4': '0.170', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.150', 'weapon3': '3.368', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '61.000'} [2024-08-06 02:04:06,525][52614] Signal inference workers to stop experience collection... (6350 times) [2024-08-06 02:04:06,527][52614] Signal inference workers to resume experience collection... (6350 times) [2024-08-06 02:04:06,586][52650] InferenceWorker_p0-w0: stopping experience collection (6350 times) [2024-08-06 02:04:06,587][52650] InferenceWorker_p0-w0: resuming experience collection (6350 times) [2024-08-06 02:04:06,866][52650] Updated weights for policy 0, policy_version 35221 (0.0013) [2024-08-06 02:04:06,979][52671] DAMAGECOUNT value on done: 266284.0 [2024-08-06 02:04:06,979][52671] Sum rewards: 58.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.905', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.213', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.246', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 288538624. Throughput: 0: 4392.9. Samples: 72137840. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:04:07,794][52567] Avg episode reward: [(0, '65.301')] [2024-08-06 02:04:07,887][52811] DAMAGECOUNT value on done: 251946.0 [2024-08-06 02:04:07,888][52811] Sum rewards: 63.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.196', 'weapon5': '0.198', 'AMMO4': '0.291', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '52.500'} [2024-08-06 02:04:07,889][52803] DAMAGECOUNT value on done: 241125.0 [2024-08-06 02:04:07,889][52803] Sum rewards: 62.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.011', 'AMMO5': '0.018', 'AMMO2': '0.067', 'weapon4': '0.174', 'AMMO3': '0.182', 'weapon5': '0.222', 'weapon2': '0.258', 'AMMO4': '0.338', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.008', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '52.000'} [2024-08-06 02:04:08,672][52794] DAMAGECOUNT value on done: 266219.0 [2024-08-06 02:04:08,674][52794] Sum rewards: 55.650, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.745', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.188', 'AMMO3': '0.218', 'AMMO4': '0.222', 'weapon2': '0.294', 'weapon4': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '49.500'} [2024-08-06 02:04:08,847][52658] DAMAGECOUNT value on done: 257573.0 [2024-08-06 02:04:08,847][52658] Sum rewards: 69.183, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.955', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.146', 'AMMO4': '0.195', 'weapon2': '0.228', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.282', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '60.500'} [2024-08-06 02:04:09,070][52795] DAMAGECOUNT value on done: 246282.0 [2024-08-06 02:04:09,070][52795] Sum rewards: 77.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.094', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.232', 'WEAPON3': '1.200', 'weapon3': '3.388', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '63.000'} [2024-08-06 02:04:09,078][52670] DAMAGECOUNT value on done: 265214.0 [2024-08-06 02:04:09,078][52670] Sum rewards: 74.383, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.196', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'weapon4': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.012', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '66.000'} [2024-08-06 02:04:09,570][52666] DAMAGECOUNT value on done: 258934.0 [2024-08-06 02:04:09,574][52666] Sum rewards: 71.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.560', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.262', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.322', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '62.000'} [2024-08-06 02:04:09,975][52671] DAMAGECOUNT value on done: 267712.0 [2024-08-06 02:04:09,976][52671] Sum rewards: 63.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.715', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.112', 'AMMO3': '0.162', 'AMMO4': '0.164', 'weapon5': '0.168', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:11,033][52803] DAMAGECOUNT value on done: 245289.0 [2024-08-06 02:04:11,033][52803] Sum rewards: 63.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.046', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.272', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.198', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:11,213][52811] DAMAGECOUNT value on done: 246111.0 [2024-08-06 02:04:11,214][52811] Sum rewards: 56.617, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.425', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.126', 'AMMO3': '0.243', 'weapon5': '0.262', 'AMMO4': '0.269', 'weapon2': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '2.996', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:11,673][52794] DAMAGECOUNT value on done: 277877.0 [2024-08-06 02:04:11,674][52794] Sum rewards: 61.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.015', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.056', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '53.000'} [2024-08-06 02:04:11,684][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:04:11,845][52658] DAMAGECOUNT value on done: 261676.0 [2024-08-06 02:04:11,845][52658] Sum rewards: 54.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.005', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.180', 'AMMO4': '0.249', 'AMMO3': '0.263', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.730', 'WEAPON3': '1.600', 'weapon3': '2.526', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:12,091][52650] Updated weights for policy 0, policy_version 35231 (0.0011) [2024-08-06 02:04:12,268][52670] DAMAGECOUNT value on done: 257190.0 [2024-08-06 02:04:12,270][52670] Sum rewards: 57.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.478', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.217', 'weapon4': '0.280', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.012', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:12,371][52795] DAMAGECOUNT value on done: 235643.0 [2024-08-06 02:04:12,371][52795] Sum rewards: 56.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO4': '0.193', 'AMMO3': '0.221', 'weapon2': '0.224', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.158', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '49.000'} [2024-08-06 02:04:12,463][52671] DAMAGECOUNT value on done: 260799.0 [2024-08-06 02:04:12,464][52671] Sum rewards: 59.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.169', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.378', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:12,781][52666] DAMAGECOUNT value on done: 254213.0 [2024-08-06 02:04:12,783][52666] Sum rewards: 58.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.130', 'weapon4': '0.160', 'AMMO3': '0.196', 'AMMO4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.886', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:12,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 288628736. Throughput: 0: 4384.4. Samples: 72163830. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:04:12,794][52567] Avg episode reward: [(0, '65.169')] [2024-08-06 02:04:13,573][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:04:14,140][52803] DAMAGECOUNT value on done: 241276.0 [2024-08-06 02:04:14,140][52803] Sum rewards: 52.112, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.121', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '2.958', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '41.500'} [2024-08-06 02:04:14,284][52811] DAMAGECOUNT value on done: 246530.0 [2024-08-06 02:04:14,286][52811] Sum rewards: 68.352, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.122', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.246', 'weapon4': '0.246', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '2.822', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '60.000'} [2024-08-06 02:04:14,479][52794] DAMAGECOUNT value on done: 266846.0 [2024-08-06 02:04:14,480][52794] Sum rewards: 66.029, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.642', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.046', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.291', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.088', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '59.000'} [2024-08-06 02:04:14,578][52658] DAMAGECOUNT value on done: 269262.0 [2024-08-06 02:04:14,579][52658] Sum rewards: 68.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.062', 'weapon4': '0.124', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:15,112][52671] DAMAGECOUNT value on done: 268883.0 [2024-08-06 02:04:15,113][52671] Sum rewards: 64.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.694', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.220', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:15,440][52670] DAMAGECOUNT value on done: 258387.0 [2024-08-06 02:04:15,441][52670] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.739', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.070', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.482', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:15,547][52795] DAMAGECOUNT value on done: 248910.0 [2024-08-06 02:04:15,547][52795] Sum rewards: 65.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.832', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.171', 'weapon4': '0.172', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:15,864][52666] DAMAGECOUNT value on done: 263271.0 [2024-08-06 02:04:15,866][52666] Sum rewards: 64.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '54.500'} [2024-08-06 02:04:16,682][52650] Updated weights for policy 0, policy_version 35241 (0.0028) [2024-08-06 02:04:17,184][52803] DAMAGECOUNT value on done: 251666.0 [2024-08-06 02:04:17,185][52803] Sum rewards: 76.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 02:04:17,330][52811] DAMAGECOUNT value on done: 253789.0 [2024-08-06 02:04:17,332][52811] Sum rewards: 60.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.387', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.706', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.078', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:17,444][52658] DAMAGECOUNT value on done: 260556.0 [2024-08-06 02:04:17,446][52658] Sum rewards: 72.169, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.011', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.242', 'AMMO3': '0.280', 'WEAPON3': '1.750', 'weapon3': '3.360', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '64.000'} [2024-08-06 02:04:17,476][52671] DAMAGECOUNT value on done: 270653.0 [2024-08-06 02:04:17,477][52671] Sum rewards: 76.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.040', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'weapon5': '0.224', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '64.000'} [2024-08-06 02:04:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 288710656. Throughput: 0: 4389.3. Samples: 72177160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:04:17,795][52567] Avg episode reward: [(0, '64.899')] [2024-08-06 02:04:18,136][52670] DAMAGECOUNT value on done: 265722.0 [2024-08-06 02:04:18,136][52670] Sum rewards: 66.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.099', 'AMMO5': '0.009', 'ARMOR': '0.024', 'AMMO2': '0.046', 'weapon5': '0.132', 'AMMO3': '0.201', 'weapon4': '0.220', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:18,548][52666] DAMAGECOUNT value on done: 260588.0 [2024-08-06 02:04:18,548][52666] Sum rewards: 61.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.115', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.254', 'weapon4': '0.334', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.068', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:18,831][52795] DAMAGECOUNT value on done: 247643.0 [2024-08-06 02:04:18,832][52795] Sum rewards: 67.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.154', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.225', 'weapon5': '0.238', 'weapon4': '0.364', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.624', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:20,141][52671] DAMAGECOUNT value on done: 263714.0 [2024-08-06 02:04:20,143][52671] Sum rewards: 51.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.188', 'AMMO4': '0.229', 'AMMO3': '0.240', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.688', 'WEAPON3': '1.400', 'weapon3': '2.546', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '13.746', 'FRAGCOUNT': '45.000'} [2024-08-06 02:04:20,325][52803] DAMAGECOUNT value on done: 248848.0 [2024-08-06 02:04:20,325][52803] Sum rewards: 57.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.188', 'weapon5': '0.202', 'AMMO3': '0.229', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '47.500'} [2024-08-06 02:04:20,390][52811] DAMAGECOUNT value on done: 247930.0 [2024-08-06 02:04:20,390][52811] Sum rewards: 59.075, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.732', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '53.000'} [2024-08-06 02:04:20,561][52658] DAMAGECOUNT value on done: 263254.0 [2024-08-06 02:04:20,561][52658] Sum rewards: 67.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.012', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.176', 'AMMO3': '0.220', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:20,875][52803] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:04:21,084][52670] DAMAGECOUNT value on done: 261649.0 [2024-08-06 02:04:21,085][52670] Sum rewards: 65.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.008', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.203', 'weapon2': '0.744', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:21,358][52650] Updated weights for policy 0, policy_version 35251 (0.0012) [2024-08-06 02:04:21,375][52820] DAMAGECOUNT value on done: 240530.0 [2024-08-06 02:04:21,380][52820] Sum rewards: 60.650, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.549', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.068', 'AMMO3': '0.153', 'weapon5': '0.182', 'AMMO4': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.100', 'HITCOUNT': '2.640', 'weapon3': '3.076', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:21,514][52666] DAMAGECOUNT value on done: 260952.0 [2024-08-06 02:04:21,515][52666] Sum rewards: 56.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.380', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon5': '0.178', 'AMMO4': '0.241', 'AMMO3': '0.253', 'weapon4': '0.350', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.606', 'WEAPON3': '1.550', 'weapon3': '2.474', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:22,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17749.2, 300 sec: 17578.1). Total num frames: 288808960. Throughput: 0: 4398.5. Samples: 72203960. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:04:22,795][52567] Avg episode reward: [(0, '64.489')] [2024-08-06 02:04:23,120][52658] DAMAGECOUNT value on done: 266807.0 [2024-08-06 02:04:23,120][52658] Sum rewards: 69.640, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.320', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon2': '0.242', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon4': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.072', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '61.000'} [2024-08-06 02:04:23,186][52671] DAMAGECOUNT value on done: 273795.0 [2024-08-06 02:04:23,186][52671] Sum rewards: 60.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.691', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.080', 'weapon5': '0.136', 'AMMO3': '0.181', 'weapon2': '0.230', 'AMMO4': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.276', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '49.500'} [2024-08-06 02:04:23,413][52803] DAMAGECOUNT value on done: 245106.0 [2024-08-06 02:04:23,414][52803] Sum rewards: 56.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.213', 'weapon2': '0.382', 'WEAPON3': '1.250', 'HITCOUNT': '2.620', 'weapon3': '3.404', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:23,554][52811] DAMAGECOUNT value on done: 247647.0 [2024-08-06 02:04:23,556][52811] Sum rewards: 69.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.390', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.276', 'weapon2': '0.496', 'WEAPON3': '1.700', 'weapon3': '3.252', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '62.000'} [2024-08-06 02:04:23,990][52647] DAMAGECOUNT value on done: 280341.0 [2024-08-06 02:04:23,991][52647] Sum rewards: 59.386, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.126', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.150', 'weapon5': '0.182', 'AMMO4': '0.191', 'weapon2': '0.230', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '3.124', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:24,138][52670] DAMAGECOUNT value on done: 255553.0 [2024-08-06 02:04:24,138][52670] Sum rewards: 61.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.116', 'weapon4': '0.146', 'AMMO3': '0.241', 'AMMO4': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:24,412][52820] DAMAGECOUNT value on done: 244524.0 [2024-08-06 02:04:24,413][52820] Sum rewards: 61.136, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.788', 'AMMO5': '0.018', 'AMMO2': '0.068', 'weapon5': '0.218', 'AMMO3': '0.241', 'AMMO4': '0.339', 'weapon4': '0.432', 'weapon2': '0.442', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.562', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '53.500'} [2024-08-06 02:04:24,469][52667] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0)] [2024-08-06 02:04:24,485][52666] DAMAGECOUNT value on done: 259952.0 [2024-08-06 02:04:24,486][52666] Sum rewards: 62.014, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.782', 'AMMO5': '0.016', 'AMMO2': '0.068', 'weapon5': '0.212', 'AMMO3': '0.268', 'AMMO4': '0.338', 'weapon4': '0.358', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.524', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:25,504][52650] Updated weights for policy 0, policy_version 35261 (0.0012) [2024-08-06 02:04:25,837][52671] DAMAGECOUNT value on done: 261953.0 [2024-08-06 02:04:25,837][52671] Sum rewards: 69.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.260', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.134', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.366', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:26,394][52803] DAMAGECOUNT value on done: 250525.0 [2024-08-06 02:04:26,394][52803] Sum rewards: 64.142, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.137', 'AMMO4': '0.188', 'weapon5': '0.270', 'weapon2': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.424', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '50.500'} [2024-08-06 02:04:26,606][52811] DAMAGECOUNT value on done: 251001.0 [2024-08-06 02:04:26,608][52811] Sum rewards: 77.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.652', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.090', 'weapon4': '0.160', 'AMMO3': '0.216', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '63.000'} [2024-08-06 02:04:26,617][52647] DAMAGECOUNT value on done: 277773.0 [2024-08-06 02:04:26,618][52647] Sum rewards: 80.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.262', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.164', 'AMMO3': '0.166', 'weapon5': '0.184', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.000', 'weapon3': '2.954', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '65.000'} [2024-08-06 02:04:27,220][52670] DAMAGECOUNT value on done: 259801.0 [2024-08-06 02:04:27,220][52670] Sum rewards: 69.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.306', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:27,537][52820] DAMAGECOUNT value on done: 242419.0 [2024-08-06 02:04:27,538][52820] Sum rewards: 68.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.412', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.127', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.420', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '54.500'} [2024-08-06 02:04:27,626][52666] DAMAGECOUNT value on done: 258625.0 [2024-08-06 02:04:27,626][52666] Sum rewards: 64.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.154', 'AMMO3': '0.200', 'AMMO4': '0.203', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.868', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 288890880. Throughput: 0: 4392.4. Samples: 72230260. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:04:27,795][52567] Avg episode reward: [(0, '64.844')] [2024-08-06 02:04:27,807][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035265_288890880.pth... [2024-08-06 02:04:27,983][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000034750_284672000.pth [2024-08-06 02:04:28,603][52671] DAMAGECOUNT value on done: 255545.0 [2024-08-06 02:04:28,607][52671] Sum rewards: 67.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.638', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon4': '0.154', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.708', 'WEAPON3': '0.900', 'weapon3': '2.950', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:28,946][52659] DAMAGECOUNT value on done: 266189.0 [2024-08-06 02:04:28,947][52659] Sum rewards: 64.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.051', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.418', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.280', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '54.500'} [2024-08-06 02:04:29,452][52647] DAMAGECOUNT value on done: 277410.0 [2024-08-06 02:04:29,452][52647] Sum rewards: 65.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.011', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon5': '0.144', 'weapon4': '0.150', 'weapon2': '0.196', 'AMMO4': '0.210', 'AMMO3': '0.218', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:29,478][52803] DAMAGECOUNT value on done: 247676.0 [2024-08-06 02:04:29,478][52803] Sum rewards: 52.363, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.260', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.124', 'weapon4': '0.192', 'AMMO4': '0.251', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.998', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:29,715][52811] DAMAGECOUNT value on done: 245302.0 [2024-08-06 02:04:29,716][52811] Sum rewards: 74.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.612', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.058', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'AMMO3': '0.198', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '62.000'} [2024-08-06 02:04:30,011][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:04:30,309][52670] DAMAGECOUNT value on done: 258478.0 [2024-08-06 02:04:30,311][52670] Sum rewards: 58.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.968', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'AMMO4': '0.254', 'weapon4': '0.284', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '49.500'} [2024-08-06 02:04:30,648][52650] Updated weights for policy 0, policy_version 35271 (0.0046) [2024-08-06 02:04:30,743][52666] DAMAGECOUNT value on done: 255409.0 [2024-08-06 02:04:30,745][52666] Sum rewards: 69.235, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.192', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.160', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'weapon2': '0.376', 'WEAPON3': '1.700', 'weapon3': '2.944', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '60.500'} [2024-08-06 02:04:30,769][52820] DAMAGECOUNT value on done: 236326.0 [2024-08-06 02:04:30,769][52820] Sum rewards: 71.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.655', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.096', 'weapon4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '59.000'} [2024-08-06 02:04:31,769][52671] DAMAGECOUNT value on done: 265965.0 [2024-08-06 02:04:31,772][52671] Sum rewards: 54.069, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.271', 'weapon2': '0.278', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.228', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:32,074][52647] DAMAGECOUNT value on done: 280684.0 [2024-08-06 02:04:32,074][52647] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.538', 'WEAPON3': '1.450', 'weapon3': '2.778', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:32,123][52659] DAMAGECOUNT value on done: 262665.0 [2024-08-06 02:04:32,125][52659] Sum rewards: 57.631, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.786', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.216', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:32,620][52803] DAMAGECOUNT value on done: 244493.0 [2024-08-06 02:04:32,622][52803] Sum rewards: 57.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.053', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.138', 'AMMO3': '0.228', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.464', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '49.000'} [2024-08-06 02:04:32,786][52811] DAMAGECOUNT value on done: 251248.0 [2024-08-06 02:04:32,787][52811] Sum rewards: 74.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.208', 'AMMO3': '0.211', 'AMMO4': '0.229', 'weapon2': '0.342', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '62.000'} [2024-08-06 02:04:32,794][52567] Fps is (10 sec: 15565.3, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 288964608. Throughput: 0: 4383.3. Samples: 72243000. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:04:32,794][52567] Avg episode reward: [(0, '64.594')] [2024-08-06 02:04:33,451][52670] DAMAGECOUNT value on done: 253375.0 [2024-08-06 02:04:33,451][52670] Sum rewards: 61.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.215', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon2': '0.222', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.160', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:33,932][52820] DAMAGECOUNT value on done: 245125.0 [2024-08-06 02:04:33,935][52820] Sum rewards: 68.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.220', 'weapon2': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.094', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:33,946][52666] DAMAGECOUNT value on done: 266884.0 [2024-08-06 02:04:33,946][52666] Sum rewards: 57.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.751', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.352', 'weapon4': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.692', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:34,760][52671] DAMAGECOUNT value on done: 269055.0 [2024-08-06 02:04:34,761][52671] Sum rewards: 72.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.084', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '61.000'} [2024-08-06 02:04:35,154][52647] DAMAGECOUNT value on done: 278887.0 [2024-08-06 02:04:35,158][52647] Sum rewards: 71.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.039', 'weapon4': '0.188', 'AMMO4': '0.195', 'AMMO3': '0.199', 'weapon5': '0.286', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 02:04:35,222][52659] DAMAGECOUNT value on done: 263624.0 [2024-08-06 02:04:35,226][52659] Sum rewards: 70.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.120', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:35,660][52650] Updated weights for policy 0, policy_version 35281 (0.0029) [2024-08-06 02:04:35,722][52803] DAMAGECOUNT value on done: 252086.0 [2024-08-06 02:04:35,723][52803] Sum rewards: 65.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.176', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.046', 'AMMO4': '0.164', 'AMMO3': '0.172', 'weapon4': '0.230', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:35,861][52811] DAMAGECOUNT value on done: 247054.0 [2024-08-06 02:04:35,863][52811] Sum rewards: 61.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'weapon4': '0.240', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '53.000'} [2024-08-06 02:04:36,372][52670] DAMAGECOUNT value on done: 266445.0 [2024-08-06 02:04:36,372][52670] Sum rewards: 64.345, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.050', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.062', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.048', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '57.500'} [2024-08-06 02:04:36,810][52666] DAMAGECOUNT value on done: 264199.0 [2024-08-06 02:04:36,812][52666] Sum rewards: 65.946, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.742', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.264', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:36,992][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:04:37,042][52820] DAMAGECOUNT value on done: 241933.0 [2024-08-06 02:04:37,042][52820] Sum rewards: 54.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon5': '0.284', 'weapon4': '0.354', 'weapon2': '0.378', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.670', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:37,686][52671] DAMAGECOUNT value on done: 271651.0 [2024-08-06 02:04:37,688][52671] Sum rewards: 70.201, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.224', 'AMMO3': '0.249', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '61.000'} [2024-08-06 02:04:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17615.7, 300 sec: 17550.3). Total num frames: 289062912. Throughput: 0: 4378.9. Samples: 72269150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:04:37,794][52567] Avg episode reward: [(0, '65.008')] [2024-08-06 02:04:38,146][52647] DAMAGECOUNT value on done: 283152.0 [2024-08-06 02:04:38,148][52647] Sum rewards: 68.707, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'weapon5': '0.044', 'AMMO2': '0.049', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'AMMO4': '0.246', 'weapon4': '0.316', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '60.000'} [2024-08-06 02:04:38,212][52659] DAMAGECOUNT value on done: 263175.0 [2024-08-06 02:04:38,212][52659] Sum rewards: 69.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.500'} [2024-08-06 02:04:38,770][52811] DAMAGECOUNT value on done: 241575.0 [2024-08-06 02:04:38,771][52811] Sum rewards: 54.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.052', 'weapon4': '0.170', 'AMMO3': '0.223', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:38,801][52803] DAMAGECOUNT value on done: 243784.0 [2024-08-06 02:04:38,802][52803] Sum rewards: 67.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.136', 'weapon4': '0.142', 'AMMO4': '0.173', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.176', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:38,923][52670] DAMAGECOUNT value on done: 261287.0 [2024-08-06 02:04:38,925][52670] Sum rewards: 54.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.836', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.185', 'weapon5': '0.194', 'AMMO4': '0.280', 'WEAPON5': '0.350', 'weapon2': '0.376', 'weapon4': '0.512', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.620', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '46.000'} [2024-08-06 02:04:39,423][52666] DAMAGECOUNT value on done: 261091.0 [2024-08-06 02:04:39,425][52666] Sum rewards: 66.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.048', 'AMMO4': '0.180', 'weapon5': '0.194', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '2.954', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:40,127][52650] Updated weights for policy 0, policy_version 35291 (0.0011) [2024-08-06 02:04:40,151][52663] DAMAGECOUNT value on done: 268218.0 [2024-08-06 02:04:40,151][52663] Sum rewards: 63.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.083', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.054', 'AMMO3': '0.185', 'weapon2': '0.396', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.406', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.000'} [2024-08-06 02:04:40,201][52820] DAMAGECOUNT value on done: 244784.0 [2024-08-06 02:04:40,202][52820] Sum rewards: 56.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.393', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.162', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:40,797][52671] DAMAGECOUNT value on done: 266962.0 [2024-08-06 02:04:40,805][52671] Sum rewards: 66.329, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.153', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:40,940][52647] DAMAGECOUNT value on done: 277801.0 [2024-08-06 02:04:40,941][52647] Sum rewards: 57.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.718', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.126', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:41,162][52659] DAMAGECOUNT value on done: 260432.0 [2024-08-06 02:04:41,162][52659] Sum rewards: 65.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.308', 'weapon4': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:41,442][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:04:41,734][52670] DAMAGECOUNT value on done: 261738.0 [2024-08-06 02:04:41,736][52670] Sum rewards: 71.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.456', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.142', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.176', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '59.500'} [2024-08-06 02:04:41,753][52811] DAMAGECOUNT value on done: 246984.0 [2024-08-06 02:04:41,756][52811] Sum rewards: 68.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.128', 'AMMO3': '0.220', 'AMMO4': '0.222', 'weapon2': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:41,917][52803] DAMAGECOUNT value on done: 250641.0 [2024-08-06 02:04:41,917][52803] Sum rewards: 63.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.236', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.072', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.320', 'weapon4': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '52.000'} [2024-08-06 02:04:42,283][52666] DAMAGECOUNT value on done: 259315.0 [2024-08-06 02:04:42,286][52666] Sum rewards: 71.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.130', 'AMMO3': '0.160', 'weapon5': '0.192', 'AMMO4': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '59.500'} [2024-08-06 02:04:42,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 289153024. Throughput: 0: 4381.1. Samples: 72295500. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:04:42,794][52567] Avg episode reward: [(0, '64.644')] [2024-08-06 02:04:43,156][52663] DAMAGECOUNT value on done: 264668.0 [2024-08-06 02:04:43,157][52663] Sum rewards: 57.570, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.595', 'AMMO5': '0.007', 'AMMO2': '0.046', 'AMMO3': '0.121', 'weapon5': '0.126', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.274', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.588', 'WEAPON3': '0.850', 'weapon3': '2.844', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '45.000'} [2024-08-06 02:04:43,168][52820] DAMAGECOUNT value on done: 247671.0 [2024-08-06 02:04:43,170][52820] Sum rewards: 67.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.683', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.140', 'AMMO4': '0.172', 'weapon2': '0.202', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:43,657][52671] DAMAGECOUNT value on done: 262265.0 [2024-08-06 02:04:43,659][52671] Sum rewards: 66.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.090', 'weapon5': '0.096', 'AMMO4': '0.162', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:44,020][52659] DAMAGECOUNT value on done: 262447.0 [2024-08-06 02:04:44,023][52659] Sum rewards: 72.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.218', 'weapon2': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '60.500'} [2024-08-06 02:04:44,137][52647] DAMAGECOUNT value on done: 276597.0 [2024-08-06 02:04:44,138][52647] Sum rewards: 62.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.032', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.958', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:44,656][52670] DAMAGECOUNT value on done: 266231.0 [2024-08-06 02:04:44,657][52670] Sum rewards: 66.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.214', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.068', 'weapon4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.262', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:44,703][52650] Updated weights for policy 0, policy_version 35301 (0.0014) [2024-08-06 02:04:44,874][52811] DAMAGECOUNT value on done: 250339.0 [2024-08-06 02:04:44,874][52811] Sum rewards: 57.193, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.310', 'HEALTH': '0.355', 'weapon2': '0.402', 'WEAPON3': '0.850', 'HITCOUNT': '2.830', 'weapon3': '2.978', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '44.000'} [2024-08-06 02:04:45,033][52803] DAMAGECOUNT value on done: 243296.0 [2024-08-06 02:04:45,036][52803] Sum rewards: 67.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.464', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:45,262][52666] DAMAGECOUNT value on done: 258298.0 [2024-08-06 02:04:45,264][52666] Sum rewards: 68.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'weapon4': '0.216', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:45,733][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:04:46,309][52663] DAMAGECOUNT value on done: 259743.0 [2024-08-06 02:04:46,317][52663] Sum rewards: 68.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.275', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.124', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:46,336][52820] DAMAGECOUNT value on done: 243919.0 [2024-08-06 02:04:46,337][52820] Sum rewards: 58.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.133', 'weapon4': '0.138', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '50.000'} [2024-08-06 02:04:47,006][52659] DAMAGECOUNT value on done: 265212.0 [2024-08-06 02:04:47,006][52659] Sum rewards: 72.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.141', 'weapon4': '0.190', 'weapon2': '0.192', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '63.000'} [2024-08-06 02:04:47,074][52647] DAMAGECOUNT value on done: 281182.0 [2024-08-06 02:04:47,074][52647] Sum rewards: 64.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.018', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.142', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 289234944. Throughput: 0: 4376.7. Samples: 72308510. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:04:47,794][52567] Avg episode reward: [(0, '64.435')] [2024-08-06 02:04:47,825][52670] DAMAGECOUNT value on done: 264110.0 [2024-08-06 02:04:47,826][52670] Sum rewards: 63.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.412', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.188', 'AMMO4': '0.214', 'AMMO3': '0.216', 'WEAPON5': '0.350', 'weapon4': '0.356', 'weapon2': '0.534', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:48,079][52811] DAMAGECOUNT value on done: 243966.0 [2024-08-06 02:04:48,083][52811] Sum rewards: 59.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.353', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO4': '0.167', 'weapon4': '0.170', 'AMMO3': '0.218', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.194', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:48,350][52666] DAMAGECOUNT value on done: 265553.0 [2024-08-06 02:04:48,351][52666] Sum rewards: 74.462, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.007', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.197', 'weapon4': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:49,286][52663] DAMAGECOUNT value on done: 263744.0 [2024-08-06 02:04:49,287][52663] Sum rewards: 58.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.076', 'weapon4': '0.078', 'AMMO4': '0.145', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.860', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '51.500'} [2024-08-06 02:04:49,472][52820] DAMAGECOUNT value on done: 245692.0 [2024-08-06 02:04:49,474][52820] Sum rewards: 55.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon4': '0.322', 'weapon2': '0.592', 'WEAPON3': '1.450', 'weapon3': '2.740', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '48.000'} [2024-08-06 02:04:49,557][52647] DAMAGECOUNT value on done: 275585.0 [2024-08-06 02:04:49,558][52647] Sum rewards: 55.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.600', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.116', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.234', 'AMMO3': '0.284', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '3.060', 'weapon3': '3.164', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:49,700][52650] Updated weights for policy 0, policy_version 35311 (0.0012) [2024-08-06 02:04:49,933][52659] DAMAGECOUNT value on done: 260107.0 [2024-08-06 02:04:49,935][52659] Sum rewards: 77.777, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.765', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.198', 'weapon4': '0.244', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '63.000'} [2024-08-06 02:04:50,730][52670] DAMAGECOUNT value on done: 251434.0 [2024-08-06 02:04:50,732][52670] Sum rewards: 72.075, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.054', 'HEALTH': '0.130', 'weapon4': '0.174', 'AMMO3': '0.185', 'weapon5': '0.188', 'weapon2': '0.238', 'AMMO4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:51,172][52811] DAMAGECOUNT value on done: 252291.0 [2024-08-06 02:04:51,173][52811] Sum rewards: 67.731, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.163', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.414', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '55.000'} [2024-08-06 02:04:51,272][52666] DAMAGECOUNT value on done: 255979.0 [2024-08-06 02:04:51,272][52666] Sum rewards: 62.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.443', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.058', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.236', 'WEAPON4': '0.500', 'weapon4': '0.540', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '53.000'} [2024-08-06 02:04:51,977][52647] DAMAGECOUNT value on done: 279191.0 [2024-08-06 02:04:51,977][52647] Sum rewards: 64.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.968', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.160', 'weapon4': '0.196', 'AMMO4': '0.198', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '56.000'} [2024-08-06 02:04:52,333][52663] DAMAGECOUNT value on done: 264223.0 [2024-08-06 02:04:52,334][52663] Sum rewards: 59.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.531', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon5': '0.152', 'AMMO3': '0.239', 'weapon2': '0.246', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.246', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:52,684][52820] DAMAGECOUNT value on done: 247493.0 [2024-08-06 02:04:52,685][52820] Sum rewards: 63.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.341', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon5': '0.110', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.226', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.172', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '52.000'} [2024-08-06 02:04:52,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 289316864. Throughput: 0: 4374.2. Samples: 72334680. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:04:52,795][52567] Avg episode reward: [(0, '64.873')] [2024-08-06 02:04:53,346][52659] DAMAGECOUNT value on done: 270353.0 [2024-08-06 02:04:53,346][52659] Sum rewards: 67.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon4': '0.088', 'AMMO3': '0.219', 'weapon2': '0.264', 'WEAPON3': '1.450', 'HITCOUNT': '3.420', 'weapon3': '3.424', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 02:04:53,647][52670] DAMAGECOUNT value on done: 264370.0 [2024-08-06 02:04:53,648][52670] Sum rewards: 70.221, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.826', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.166', 'weapon2': '0.190', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:53,740][52650] Updated weights for policy 0, policy_version 35321 (0.0020) [2024-08-06 02:04:54,247][52666] DAMAGECOUNT value on done: 263040.0 [2024-08-06 02:04:54,250][52666] Sum rewards: 55.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '2.620', 'weapon3': '2.890', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '49.000'} [2024-08-06 02:04:54,773][52647] DAMAGECOUNT value on done: 272954.0 [2024-08-06 02:04:54,774][52647] Sum rewards: 56.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.998', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.244', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '49.500'} [2024-08-06 02:04:54,944][52663] DAMAGECOUNT value on done: 269387.0 [2024-08-06 02:04:54,945][52663] Sum rewards: 75.774, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.139', 'weapon5': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '0.950', 'weapon3': '2.812', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '59.000'} [2024-08-06 02:04:55,854][52820] DAMAGECOUNT value on done: 248814.0 [2024-08-06 02:04:55,854][52820] Sum rewards: 60.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.836', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.214', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.544', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '53.000'} [2024-08-06 02:04:56,347][52659] DAMAGECOUNT value on done: 269732.0 [2024-08-06 02:04:56,349][52659] Sum rewards: 72.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.398', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.144', 'weapon5': '0.158', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:56,680][52670] DAMAGECOUNT value on done: 270422.0 [2024-08-06 02:04:56,680][52670] Sum rewards: 69.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.282', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '58.000'} [2024-08-06 02:04:57,394][52647] DAMAGECOUNT value on done: 276809.0 [2024-08-06 02:04:57,395][52647] Sum rewards: 73.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.958', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.044', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '61.000'} [2024-08-06 02:04:57,561][52663] DAMAGECOUNT value on done: 264829.0 [2024-08-06 02:04:57,561][52663] Sum rewards: 75.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.643', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON3': '1.250', 'weapon3': '3.404', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.000'} [2024-08-06 02:04:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 289406976. Throughput: 0: 4387.3. Samples: 72361260. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:04:57,795][52567] Avg episode reward: [(0, '64.818')] [2024-08-06 02:04:58,723][52650] Updated weights for policy 0, policy_version 35331 (0.0012) [2024-08-06 02:04:58,879][52820] DAMAGECOUNT value on done: 246131.0 [2024-08-06 02:04:58,879][52820] Sum rewards: 61.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.213', 'AMMO4': '0.226', 'weapon2': '0.272', 'weapon5': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.570', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '51.000'} [2024-08-06 02:04:59,102][52670] DAMAGECOUNT value on done: 263394.0 [2024-08-06 02:04:59,104][52670] Sum rewards: 62.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.565', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '54.000'} [2024-08-06 02:04:59,409][52659] DAMAGECOUNT value on done: 264757.0 [2024-08-06 02:04:59,409][52659] Sum rewards: 81.658, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.717', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.122', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '68.000'} [2024-08-06 02:05:00,226][52647] DAMAGECOUNT value on done: 275982.0 [2024-08-06 02:05:00,226][52647] Sum rewards: 62.275, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.452', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.277', 'weapon2': '0.342', 'WEAPON3': '1.600', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:00,474][52663] DAMAGECOUNT value on done: 262373.0 [2024-08-06 02:05:00,475][52663] Sum rewards: 63.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.131', 'weapon5': '0.242', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.600', 'weapon3': '2.976', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:01,841][52820] DAMAGECOUNT value on done: 245605.0 [2024-08-06 02:05:01,841][52820] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.011', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.556', 'WEAPON3': '1.000', 'weapon3': '3.158', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '58.000'} [2024-08-06 02:05:01,969][52670] DAMAGECOUNT value on done: 263800.0 [2024-08-06 02:05:01,971][52670] Sum rewards: 62.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.102', 'AMMO3': '0.233', 'AMMO4': '0.273', 'weapon4': '0.304', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:02,247][52659] DAMAGECOUNT value on done: 263847.0 [2024-08-06 02:05:02,252][52659] Sum rewards: 72.365, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.102', 'weapon2': '0.116', 'AMMO3': '0.239', 'WEAPON3': '1.450', 'HITCOUNT': '3.480', 'weapon3': '3.612', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '62.000'} [2024-08-06 02:05:02,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.2, 300 sec: 17578.1). Total num frames: 289505280. Throughput: 0: 4384.9. Samples: 72374480. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:05:02,795][52567] Avg episode reward: [(0, '65.322')] [2024-08-06 02:05:03,206][52647] DAMAGECOUNT value on done: 282439.0 [2024-08-06 02:05:03,208][52647] Sum rewards: 69.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.641', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.153', 'weapon5': '0.192', 'AMMO4': '0.196', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.706', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '56.000'} [2024-08-06 02:05:03,281][52663] DAMAGECOUNT value on done: 263250.0 [2024-08-06 02:05:03,283][52663] Sum rewards: 59.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.042', 'weapon4': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'ARMOR': '0.517', 'weapon2': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.038', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:03,454][52650] Updated weights for policy 0, policy_version 35341 (0.0043) [2024-08-06 02:05:04,891][52820] DAMAGECOUNT value on done: 247162.0 [2024-08-06 02:05:04,895][52820] Sum rewards: 62.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.275', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.082', 'weapon5': '0.086', 'AMMO3': '0.213', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.292', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '53.000'} [2024-08-06 02:05:05,366][52659] DAMAGECOUNT value on done: 259457.0 [2024-08-06 02:05:05,367][52659] Sum rewards: 58.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.694', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO4': '0.203', 'AMMO3': '0.212', 'weapon5': '0.240', 'weapon4': '0.464', 'weapon2': '0.498', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.484', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '49.500'} [2024-08-06 02:05:06,061][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:05:06,366][52663] DAMAGECOUNT value on done: 265960.0 [2024-08-06 02:05:06,367][52663] Sum rewards: 57.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.129', 'weapon4': '0.156', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '49.000'} [2024-08-06 02:05:06,519][52647] DAMAGECOUNT value on done: 276336.0 [2024-08-06 02:05:06,519][52647] Sum rewards: 61.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO2': '0.020', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.272', 'weapon2': '0.426', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.308', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:07,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 289587200. Throughput: 0: 4377.8. Samples: 72400960. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:05:07,794][52567] Avg episode reward: [(0, '65.296')] [2024-08-06 02:05:08,010][52820] DAMAGECOUNT value on done: 247313.0 [2024-08-06 02:05:08,011][52820] Sum rewards: 43.848, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.009', 'weapon5': '0.012', 'ARMOR': '0.015', 'AMMO2': '0.058', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'AMMO4': '0.288', 'weapon2': '0.328', 'WEAPON4': '0.500', 'weapon4': '0.508', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '2.962', 'DAMAGECOUNT': '12.417', 'FRAGCOUNT': '41.000'} [2024-08-06 02:05:08,030][52650] Updated weights for policy 0, policy_version 35351 (0.0012) [2024-08-06 02:05:08,127][52659] DAMAGECOUNT value on done: 263189.0 [2024-08-06 02:05:08,128][52659] Sum rewards: 50.318, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.662', 'AMMO5': '0.010', 'AMMO2': '0.049', 'WEAPON5': '0.200', 'weapon5': '0.240', 'AMMO4': '0.247', 'AMMO3': '0.251', 'weapon4': '0.312', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.810', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '44.000'} [2024-08-06 02:05:09,154][52663] DAMAGECOUNT value on done: 268078.0 [2024-08-06 02:05:09,154][52663] Sum rewards: 62.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.949', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.153', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.650', 'weapon3': '3.250', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '53.000'} [2024-08-06 02:05:09,445][52647] DAMAGECOUNT value on done: 276082.0 [2024-08-06 02:05:09,447][52647] Sum rewards: 75.929, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.114', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.042', 'weapon4': '0.066', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.394', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '64.000'} [2024-08-06 02:05:10,242][52649] DAMAGECOUNT value on done: 255950.0 [2024-08-06 02:05:10,242][52649] Sum rewards: 52.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.035', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.223', 'weapon2': '0.414', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.036', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '46.000'} [2024-08-06 02:05:10,878][52659] DAMAGECOUNT value on done: 268571.0 [2024-08-06 02:05:10,878][52659] Sum rewards: 69.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.086', 'AMMO3': '0.153', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'weapon4': '0.292', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.118', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '56.000'} [2024-08-06 02:05:11,122][52820] DAMAGECOUNT value on done: 240730.0 [2024-08-06 02:05:11,123][52820] Sum rewards: 73.638, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.192', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '60.000'} [2024-08-06 02:05:12,006][52647] DAMAGECOUNT value on done: 275415.0 [2024-08-06 02:05:12,006][52647] Sum rewards: 71.551, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.789', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.098', 'AMMO4': '0.121', 'weapon5': '0.136', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.462', 'WEAPON3': '0.950', 'weapon3': '3.054', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '56.000'} [2024-08-06 02:05:12,242][52663] DAMAGECOUNT value on done: 262964.0 [2024-08-06 02:05:12,242][52663] Sum rewards: 66.553, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.890', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.054', 'AMMO4': '0.132', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.286', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.222', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '53.000'} [2024-08-06 02:05:12,796][52567] Fps is (10 sec: 17200.0, 60 sec: 17475.6, 300 sec: 17550.2). Total num frames: 289677312. Throughput: 0: 4380.7. Samples: 72427400. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:05:12,798][52650] Updated weights for policy 0, policy_version 35361 (0.0034) [2024-08-06 02:05:12,804][52567] Avg episode reward: [(0, '64.840')] [2024-08-06 02:05:13,355][52649] DAMAGECOUNT value on done: 250605.0 [2024-08-06 02:05:13,355][52649] Sum rewards: 61.352, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.930', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.088', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.309', 'weapon4': '0.316', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.982', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '56.000'} [2024-08-06 02:05:14,068][52659] DAMAGECOUNT value on done: 272278.0 [2024-08-06 02:05:14,069][52659] Sum rewards: 64.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.926', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.096', 'weapon4': '0.172', 'AMMO4': '0.178', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.270', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:14,193][52820] DAMAGECOUNT value on done: 252454.0 [2024-08-06 02:05:14,194][52820] Sum rewards: 59.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.868', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:14,408][52647] DAMAGECOUNT value on done: 269260.0 [2024-08-06 02:05:14,408][52647] Sum rewards: 49.440, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.750', 'HITCOUNT': '2.810', 'weapon3': '3.176', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '46.000'} [2024-08-06 02:05:15,162][52663] DAMAGECOUNT value on done: 256963.0 [2024-08-06 02:05:15,165][52663] Sum rewards: 48.460, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.280', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.026', 'weapon7': '0.048', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.372', 'weapon2': '0.762', 'WEAPON3': '0.800', 'HITCOUNT': '2.450', 'weapon3': '2.500', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '39.000'} [2024-08-06 02:05:16,567][52649] DAMAGECOUNT value on done: 259543.0 [2024-08-06 02:05:16,567][52649] Sum rewards: 62.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.648', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.160', 'AMMO4': '0.226', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '2.744', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '54.000'} [2024-08-06 02:05:16,636][52659] DAMAGECOUNT value on done: 269043.0 [2024-08-06 02:05:16,638][52659] Sum rewards: 54.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.114', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.310', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.032', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '48.000'} [2024-08-06 02:05:16,715][52647] DAMAGECOUNT value on done: 277870.0 [2024-08-06 02:05:16,717][52647] Sum rewards: 62.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.254', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:17,286][52820] DAMAGECOUNT value on done: 255365.0 [2024-08-06 02:05:17,286][52820] Sum rewards: 63.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.822', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.162', 'weapon5': '0.172', 'weapon2': '0.190', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.652', 'WEAPON3': '1.450', 'weapon3': '2.642', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:17,435][52650] Updated weights for policy 0, policy_version 35371 (0.0013) [2024-08-06 02:05:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 289767424. Throughput: 0: 4387.5. Samples: 72440440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:05:17,795][52567] Avg episode reward: [(0, '64.242')] [2024-08-06 02:05:18,015][52663] DAMAGECOUNT value on done: 258402.0 [2024-08-06 02:05:18,023][52663] Sum rewards: 74.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.174', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.264', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '60.000'} [2024-08-06 02:05:18,208][52665] DAMAGECOUNT value on done: 260766.0 [2024-08-06 02:05:18,210][52665] Sum rewards: 56.088, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.140', 'weapon5': '0.152', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '2.930', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '43.000'} [2024-08-06 02:05:19,160][52659] DAMAGECOUNT value on done: 264768.0 [2024-08-06 02:05:19,160][52659] Sum rewards: 62.090, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.453', 'ARMOR': '0.004', 'AMMO5': '0.012', 'weapon5': '0.042', 'AMMO2': '0.059', 'weapon4': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'AMMO4': '0.295', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:19,584][52649] DAMAGECOUNT value on done: 260147.0 [2024-08-06 02:05:19,585][52649] Sum rewards: 70.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.036', 'weapon4': '0.076', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.208', 'AMMO3': '0.215', 'WEAPON3': '1.450', 'weapon3': '3.504', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '59.000'} [2024-08-06 02:05:20,260][52820] DAMAGECOUNT value on done: 242282.0 [2024-08-06 02:05:20,260][52820] Sum rewards: 68.857, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.757', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.116', 'AMMO4': '0.130', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.476', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:20,965][52663] DAMAGECOUNT value on done: 263003.0 [2024-08-06 02:05:20,965][52663] Sum rewards: 70.528, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.559', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.192', 'AMMO3': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '60.000'} [2024-08-06 02:05:21,119][52665] DAMAGECOUNT value on done: 266515.0 [2024-08-06 02:05:21,119][52665] Sum rewards: 69.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.084', 'weapon4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '60.000'} [2024-08-06 02:05:21,628][52659] DAMAGECOUNT value on done: 268274.0 [2024-08-06 02:05:21,630][52659] Sum rewards: 56.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.072', 'weapon4': '0.146', 'AMMO4': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.146', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '46.000'} [2024-08-06 02:05:21,884][52650] Updated weights for policy 0, policy_version 35381 (0.0025) [2024-08-06 02:05:22,232][52649] DAMAGECOUNT value on done: 251101.0 [2024-08-06 02:05:22,232][52649] Sum rewards: 73.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.581', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.062', 'weapon4': '0.130', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '64.000'} [2024-08-06 02:05:22,794][52567] Fps is (10 sec: 17207.0, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 289849344. Throughput: 0: 4394.2. Samples: 72466890. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:05:22,794][52567] Avg episode reward: [(0, '64.563')] [2024-08-06 02:05:23,738][52663] DAMAGECOUNT value on done: 266616.0 [2024-08-06 02:05:23,741][52663] Sum rewards: 63.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.062', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.260', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.416', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2024-08-06 02:05:23,741][52665] DAMAGECOUNT value on done: 261997.0 [2024-08-06 02:05:23,742][52665] Sum rewards: 64.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:24,755][52659] DAMAGECOUNT value on done: 269784.0 [2024-08-06 02:05:24,755][52659] Sum rewards: 66.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.454', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.207', 'weapon2': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '55.000'} [2024-08-06 02:05:25,191][52649] DAMAGECOUNT value on done: 260421.0 [2024-08-06 02:05:25,193][52649] Sum rewards: 61.751, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon4': '0.158', 'weapon2': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '48.000'} [2024-08-06 02:05:26,523][52650] Updated weights for policy 0, policy_version 35391 (0.0011) [2024-08-06 02:05:26,664][52663] DAMAGECOUNT value on done: 267648.0 [2024-08-06 02:05:26,664][52663] Sum rewards: 67.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.213', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.213', 'weapon4': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '57.000'} [2024-08-06 02:05:26,703][52665] DAMAGECOUNT value on done: 260032.0 [2024-08-06 02:05:26,703][52665] Sum rewards: 60.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon4': '0.170', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.202', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '51.000'} [2024-08-06 02:05:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 289939456. Throughput: 0: 4396.5. Samples: 72493340. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:05:27,794][52567] Avg episode reward: [(0, '64.422')] [2024-08-06 02:05:27,997][52649] DAMAGECOUNT value on done: 256028.0 [2024-08-06 02:05:27,997][52649] Sum rewards: 70.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.078', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.646', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.124', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '58.000'} [2024-08-06 02:05:28,521][52665] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:05:29,322][52665] DAMAGECOUNT value on done: 255379.0 [2024-08-06 02:05:29,323][52665] Sum rewards: 50.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.866', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.184', 'AMMO3': '0.193', 'AMMO4': '0.255', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.500', 'weapon4': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.378', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.956', 'FRAGCOUNT': '42.000'} [2024-08-06 02:05:29,899][52663] DAMAGECOUNT value on done: 271763.0 [2024-08-06 02:05:29,902][52663] Sum rewards: 65.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.086', 'weapon4': '0.178', 'AMMO3': '0.213', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '57.000'} [2024-08-06 02:05:30,885][52649] DAMAGECOUNT value on done: 263839.0 [2024-08-06 02:05:30,886][52649] Sum rewards: 76.789, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.409', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.178', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '3.460', 'weapon3': '3.478', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '62.000'} [2024-08-06 02:05:31,432][52650] Updated weights for policy 0, policy_version 35401 (0.0010) [2024-08-06 02:05:31,701][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:05:32,386][52665] DAMAGECOUNT value on done: 255554.0 [2024-08-06 02:05:32,389][52665] Sum rewards: 77.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.691', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.177', 'AMMO3': '0.202', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '64.000'} [2024-08-06 02:05:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 290029568. Throughput: 0: 4406.0. Samples: 72506780. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:05:32,794][52567] Avg episode reward: [(0, '64.661')] [2024-08-06 02:05:32,862][52663] DAMAGECOUNT value on done: 267511.0 [2024-08-06 02:05:32,866][52663] Sum rewards: 68.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '57.000'} [2024-08-06 02:05:34,173][52649] DAMAGECOUNT value on done: 258964.0 [2024-08-06 02:05:34,174][52649] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.525', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.188', 'AMMO4': '0.207', 'AMMO3': '0.242', 'weapon2': '0.288', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '53.000'} [2024-08-06 02:05:35,381][52665] DAMAGECOUNT value on done: 265463.0 [2024-08-06 02:05:35,381][52665] Sum rewards: 57.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.906', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.153', 'weapon4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '3.036', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '51.000'} [2024-08-06 02:05:35,543][52663] DAMAGECOUNT value on done: 261443.0 [2024-08-06 02:05:35,545][52663] Sum rewards: 54.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.622', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.280', 'weapon2': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.760', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.990', 'FRAGCOUNT': '43.000'} [2024-08-06 02:05:35,884][52650] Updated weights for policy 0, policy_version 35411 (0.0011) [2024-08-06 02:05:37,120][52649] DAMAGECOUNT value on done: 258811.0 [2024-08-06 02:05:37,121][52649] Sum rewards: 63.619, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.108', 'weapon5': '0.138', 'AMMO3': '0.183', 'AMMO4': '0.205', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.046', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 290119680. Throughput: 0: 4410.9. Samples: 72533170. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:05:37,794][52567] Avg episode reward: [(0, '64.642')] [2024-08-06 02:05:38,286][52665] DAMAGECOUNT value on done: 263832.0 [2024-08-06 02:05:38,288][52665] Sum rewards: 71.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.515', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.150', 'AMMO3': '0.190', 'weapon5': '0.208', 'AMMO4': '0.286', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '56.500'} [2024-08-06 02:05:40,084][52649] DAMAGECOUNT value on done: 261031.0 [2024-08-06 02:05:40,087][52649] Sum rewards: 74.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'weapon4': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.430', 'WEAPON3': '1.650', 'weapon3': '3.132', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '62.000'} [2024-08-06 02:05:40,646][52650] Updated weights for policy 0, policy_version 35421 (0.0031) [2024-08-06 02:05:41,380][52665] DAMAGECOUNT value on done: 266081.0 [2024-08-06 02:05:41,381][52665] Sum rewards: 58.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.225', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.414', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '49.000'} [2024-08-06 02:05:41,428][52664] DAMAGECOUNT value on done: 274702.0 [2024-08-06 02:05:41,430][52664] Sum rewards: 70.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.226', 'weapon4': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 02:05:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 290201600. Throughput: 0: 4405.4. Samples: 72559500. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:05:42,794][52567] Avg episode reward: [(0, '64.773')] [2024-08-06 02:05:43,226][52649] DAMAGECOUNT value on done: 259778.0 [2024-08-06 02:05:43,226][52649] Sum rewards: 66.580, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.015', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.074', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.238', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '60.000'} [2024-08-06 02:05:44,025][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:05:44,083][52664] DAMAGECOUNT value on done: 276647.0 [2024-08-06 02:05:44,083][52664] Sum rewards: 64.920, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.325', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.062', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '53.500'} [2024-08-06 02:05:44,349][52665] DAMAGECOUNT value on done: 262649.0 [2024-08-06 02:05:44,350][52665] Sum rewards: 41.299, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.808', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.194', 'weapon5': '0.258', 'AMMO4': '0.285', 'AMMO3': '0.286', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.420', 'weapon3': '2.882', 'DAMAGECOUNT': '12.495', 'FRAGCOUNT': '38.500'} [2024-08-06 02:05:45,051][52668] DAMAGECOUNT value on done: 264538.0 [2024-08-06 02:05:45,052][52668] Sum rewards: 73.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.073', 'weapon4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '62.000'} [2024-08-06 02:05:45,183][52650] Updated weights for policy 0, policy_version 35431 (0.0022) [2024-08-06 02:05:46,234][52649] DAMAGECOUNT value on done: 260330.0 [2024-08-06 02:05:46,243][52649] Sum rewards: 63.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.896', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.120', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.246', 'weapon4': '0.540', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '2.856', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:46,774][52664] DAMAGECOUNT value on done: 276782.0 [2024-08-06 02:05:46,774][52664] Sum rewards: 76.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '63.000'} [2024-08-06 02:05:47,411][52665] DAMAGECOUNT value on done: 270078.0 [2024-08-06 02:05:47,411][52665] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.193', 'weapon2': '0.198', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.392', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '50.000'} [2024-08-06 02:05:47,718][52668] DAMAGECOUNT value on done: 271350.0 [2024-08-06 02:05:47,718][52668] Sum rewards: 64.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.134', 'AMMO3': '0.149', 'weapon4': '0.178', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.184', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 290283520. Throughput: 0: 4397.3. Samples: 72572360. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:05:47,795][52567] Avg episode reward: [(0, '64.573')] [2024-08-06 02:05:47,949][52614] Signal inference workers to stop experience collection... (6400 times) [2024-08-06 02:05:47,950][52614] Signal inference workers to resume experience collection... (6400 times) [2024-08-06 02:05:48,040][52650] InferenceWorker_p0-w0: stopping experience collection (6400 times) [2024-08-06 02:05:48,040][52650] InferenceWorker_p0-w0: resuming experience collection (6400 times) [2024-08-06 02:05:48,258][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:05:48,388][52667] DAMAGECOUNT value on done: 266687.0 [2024-08-06 02:05:48,388][52667] Sum rewards: 72.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.046', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.504', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 02:05:49,346][52664] DAMAGECOUNT value on done: 274209.0 [2024-08-06 02:05:49,349][52664] Sum rewards: 64.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.197', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.140', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '54.000'} [2024-08-06 02:05:49,382][52649] DAMAGECOUNT value on done: 263142.0 [2024-08-06 02:05:49,383][52649] Sum rewards: 71.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.996', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.193', 'weapon2': '0.194', 'WEAPON4': '0.350', 'weapon4': '0.560', 'WEAPON3': '1.100', 'weapon3': '3.088', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '59.000'} [2024-08-06 02:05:49,684][52650] Updated weights for policy 0, policy_version 35441 (0.0013) [2024-08-06 02:05:50,467][52665] DAMAGECOUNT value on done: 266231.0 [2024-08-06 02:05:50,469][52665] Sum rewards: 61.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.124', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.278', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:50,680][52668] DAMAGECOUNT value on done: 271138.0 [2024-08-06 02:05:50,681][52668] Sum rewards: 75.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.023', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.068', 'AMMO4': '0.143', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '64.000'} [2024-08-06 02:05:51,308][52667] DAMAGECOUNT value on done: 269840.0 [2024-08-06 02:05:51,309][52667] Sum rewards: 66.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.110', 'AMMO4': '0.178', 'AMMO3': '0.207', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '57.000'} [2024-08-06 02:05:51,985][52664] DAMAGECOUNT value on done: 276622.0 [2024-08-06 02:05:51,985][52664] Sum rewards: 68.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.151', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.438', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '58.000'} [2024-08-06 02:05:52,235][52649] DAMAGECOUNT value on done: 254867.0 [2024-08-06 02:05:52,236][52649] Sum rewards: 52.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.554', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'weapon7': '0.076', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.560', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.870', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '43.000'} [2024-08-06 02:05:52,437][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:05:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 290381824. Throughput: 0: 4395.6. Samples: 72598760. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:05:52,794][52567] Avg episode reward: [(0, '64.655')] [2024-08-06 02:05:53,282][52665] DAMAGECOUNT value on done: 265080.0 [2024-08-06 02:05:53,283][52665] Sum rewards: 61.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.163', 'weapon5': '0.226', 'AMMO4': '0.249', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.508', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.394', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '51.000'} [2024-08-06 02:05:53,635][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:05:54,028][52668] DAMAGECOUNT value on done: 270401.0 [2024-08-06 02:05:54,033][52668] Sum rewards: 63.774, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.395', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.098', 'AMMO3': '0.157', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON4': '0.500', 'weapon4': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '51.000'} [2024-08-06 02:05:54,388][52667] DAMAGECOUNT value on done: 267383.0 [2024-08-06 02:05:54,389][52667] Sum rewards: 67.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.183', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.172', 'weapon4': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.684', 'WEAPON3': '1.400', 'weapon3': '2.790', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '58.000'} [2024-08-06 02:05:54,440][52664] DAMAGECOUNT value on done: 275351.0 [2024-08-06 02:05:54,441][52664] Sum rewards: 48.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.372', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon5': '0.024', 'AMMO4': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.308', 'WEAPON3': '1.550', 'HITCOUNT': '2.650', 'weapon3': '3.214', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '43.000'} [2024-08-06 02:05:54,599][52650] Updated weights for policy 0, policy_version 35451 (0.0036) [2024-08-06 02:05:55,354][52662] DAMAGECOUNT value on done: 273222.0 [2024-08-06 02:05:55,355][52662] Sum rewards: 63.875, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.892', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.170', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '54.000'} [2024-08-06 02:05:55,468][52649] DAMAGECOUNT value on done: 260101.0 [2024-08-06 02:05:55,468][52649] Sum rewards: 61.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.138', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '52.000'} [2024-08-06 02:05:56,527][52665] DAMAGECOUNT value on done: 264531.0 [2024-08-06 02:05:56,528][52665] Sum rewards: 79.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.189', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.000'} [2024-08-06 02:05:56,966][52668] DAMAGECOUNT value on done: 260623.0 [2024-08-06 02:05:56,966][52668] Sum rewards: 54.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.880', 'AMMO5': '0.006', 'weapon5': '0.046', 'AMMO2': '0.047', 'weapon4': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'AMMO4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.310', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '48.000'} [2024-08-06 02:05:57,055][52667] DAMAGECOUNT value on done: 265202.0 [2024-08-06 02:05:57,056][52667] Sum rewards: 72.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.134', 'AMMO3': '0.170', 'AMMO4': '0.198', 'weapon2': '0.206', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.236', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 02:05:57,138][52664] DAMAGECOUNT value on done: 280561.0 [2024-08-06 02:05:57,138][52664] Sum rewards: 66.839, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.745', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.076', 'weapon4': '0.114', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.300', 'AMMO3': '0.313', 'WEAPON3': '2.000', 'weapon3': '3.310', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '60.000'} [2024-08-06 02:05:57,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17749.4, 300 sec: 17605.9). Total num frames: 290471936. Throughput: 0: 4396.2. Samples: 72625220. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:05:57,794][52567] Avg episode reward: [(0, '64.576')] [2024-08-06 02:05:57,877][52662] DAMAGECOUNT value on done: 272956.0 [2024-08-06 02:05:57,879][52662] Sum rewards: 61.057, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.092', 'weapon4': '0.114', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '53.000'} [2024-08-06 02:05:58,615][52649] DAMAGECOUNT value on done: 258302.0 [2024-08-06 02:05:58,615][52649] Sum rewards: 64.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.534', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.086', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.156', 'AMMO3': '0.227', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.480', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '54.000'} [2024-08-06 02:05:59,287][52650] Updated weights for policy 0, policy_version 35461 (0.0013) [2024-08-06 02:05:59,657][52664] DAMAGECOUNT value on done: 270515.0 [2024-08-06 02:05:59,658][52664] Sum rewards: 56.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.843', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.180', 'weapon2': '0.380', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '3.282', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '46.000'} [2024-08-06 02:05:59,707][52665] DAMAGECOUNT value on done: 263197.0 [2024-08-06 02:05:59,707][52665] Sum rewards: 83.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.108', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.206', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '70.000'} [2024-08-06 02:05:59,966][52668] DAMAGECOUNT value on done: 270347.0 [2024-08-06 02:05:59,966][52668] Sum rewards: 76.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.542', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.088', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '62.000'} [2024-08-06 02:06:00,004][52667] DAMAGECOUNT value on done: 271034.0 [2024-08-06 02:06:00,004][52667] Sum rewards: 72.792, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.420', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'AMMO4': '0.296', 'weapon2': '0.330', 'weapon4': '0.426', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.810', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '64.000'} [2024-08-06 02:06:00,639][52662] DAMAGECOUNT value on done: 273177.0 [2024-08-06 02:06:00,642][52662] Sum rewards: 66.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.850', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.129', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.000'} [2024-08-06 02:06:01,521][52660] DAMAGECOUNT value on done: 263428.0 [2024-08-06 02:06:01,522][52660] Sum rewards: 72.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.325', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.127', 'weapon2': '0.138', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.490', 'WEAPON3': '1.050', 'weapon3': '3.116', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:01,940][52649] DAMAGECOUNT value on done: 263906.0 [2024-08-06 02:06:01,940][52649] Sum rewards: 62.690, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.474', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.176', 'weapon5': '0.180', 'AMMO4': '0.199', 'AMMO3': '0.222', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:02,680][52668] DAMAGECOUNT value on done: 267087.0 [2024-08-06 02:06:02,681][52668] Sum rewards: 64.248, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.837', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon5': '0.144', 'AMMO3': '0.187', 'AMMO4': '0.240', 'weapon4': '0.386', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:02,706][52667] DAMAGECOUNT value on done: 268517.0 [2024-08-06 02:06:02,708][52667] Sum rewards: 57.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO2': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.231', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '50.000'} [2024-08-06 02:06:02,723][52664] DAMAGECOUNT value on done: 282772.0 [2024-08-06 02:06:02,724][52664] Sum rewards: 63.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.092', 'weapon4': '0.152', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'WEAPON4': '0.400', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 290553856. Throughput: 0: 4396.9. Samples: 72638300. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:06:02,795][52567] Avg episode reward: [(0, '64.720')] [2024-08-06 02:06:02,879][52665] DAMAGECOUNT value on done: 260838.0 [2024-08-06 02:06:02,880][52665] Sum rewards: 64.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.235', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.094', 'weapon2': '0.228', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.254', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '56.000'} [2024-08-06 02:06:03,694][52662] DAMAGECOUNT value on done: 264270.0 [2024-08-06 02:06:03,695][52662] Sum rewards: 69.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO4': '0.193', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:03,787][52650] Updated weights for policy 0, policy_version 35471 (0.0022) [2024-08-06 02:06:04,378][52660] DAMAGECOUNT value on done: 262546.0 [2024-08-06 02:06:04,379][52660] Sum rewards: 59.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.068', 'AMMO4': '0.076', 'weapon4': '0.082', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.204', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '49.000'} [2024-08-06 02:06:04,733][52649] DAMAGECOUNT value on done: 263716.0 [2024-08-06 02:06:04,734][52649] Sum rewards: 46.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.336', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.164', 'AMMO4': '0.172', 'weapon2': '0.208', 'weapon5': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '1.000', 'HITCOUNT': '2.280', 'weapon3': '2.754', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '39.000'} [2024-08-06 02:06:05,278][52664] DAMAGECOUNT value on done: 274723.0 [2024-08-06 02:06:05,280][52664] Sum rewards: 68.865, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.400', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO3': '0.132', 'weapon4': '0.146', 'AMMO4': '0.146', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.824', 'WEAPON3': '1.000', 'weapon3': '2.774', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:05,444][52667] DAMAGECOUNT value on done: 271600.0 [2024-08-06 02:06:05,444][52667] Sum rewards: 71.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.026', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.182', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:05,747][52668] DAMAGECOUNT value on done: 267687.0 [2024-08-06 02:06:05,747][52668] Sum rewards: 65.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.267', 'weapon4': '0.314', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.278', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:05,781][52665] DAMAGECOUNT value on done: 262068.0 [2024-08-06 02:06:05,782][52665] Sum rewards: 58.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.493', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.124', 'weapon5': '0.168', 'AMMO4': '0.196', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.752', 'WEAPON3': '1.300', 'weapon3': '2.682', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:06,669][52662] DAMAGECOUNT value on done: 269217.0 [2024-08-06 02:06:06,670][52662] Sum rewards: 73.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon2': '0.182', 'AMMO3': '0.200', 'WEAPON3': '1.350', 'HITCOUNT': '3.520', 'weapon3': '3.578', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '62.000'} [2024-08-06 02:06:07,472][52660] DAMAGECOUNT value on done: 269627.0 [2024-08-06 02:06:07,474][52660] Sum rewards: 57.658, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.890', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.218', 'weapon4': '0.244', 'AMMO4': '0.275', 'AMMO3': '0.300', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.822', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '53.000'} [2024-08-06 02:06:07,635][52649] DAMAGECOUNT value on done: 267185.0 [2024-08-06 02:06:07,635][52649] Sum rewards: 59.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.095', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.356', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.268', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 290643968. Throughput: 0: 4392.6. Samples: 72664560. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:06:07,795][52567] Avg episode reward: [(0, '64.230')] [2024-08-06 02:06:08,100][52664] DAMAGECOUNT value on done: 278740.0 [2024-08-06 02:06:08,100][52664] Sum rewards: 52.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.150', 'AMMO4': '0.239', 'AMMO3': '0.247', 'weapon5': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.590', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.590', 'FRAGCOUNT': '45.000'} [2024-08-06 02:06:08,280][52667] DAMAGECOUNT value on done: 265029.0 [2024-08-06 02:06:08,282][52667] Sum rewards: 66.844, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.209', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.159', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.722', 'WEAPON3': '0.750', 'weapon3': '2.806', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '51.000'} [2024-08-06 02:06:08,553][52650] Updated weights for policy 0, policy_version 35481 (0.0024) [2024-08-06 02:06:08,610][52665] DAMAGECOUNT value on done: 260732.0 [2024-08-06 02:06:08,610][52665] Sum rewards: 68.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.492', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.046', 'weapon5': '0.078', 'AMMO4': '0.214', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:08,693][52668] DAMAGECOUNT value on done: 268730.0 [2024-08-06 02:06:08,693][52668] Sum rewards: 68.028, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.292', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.138', 'AMMO3': '0.249', 'weapon5': '0.252', 'AMMO4': '0.253', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.000'} [2024-08-06 02:06:09,343][52662] DAMAGECOUNT value on done: 264117.0 [2024-08-06 02:06:09,344][52662] Sum rewards: 63.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.144', 'AMMO3': '0.179', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '53.000'} [2024-08-06 02:06:10,462][52660] DAMAGECOUNT value on done: 269277.0 [2024-08-06 02:06:10,462][52660] Sum rewards: 60.850, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.758', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.110', 'AMMO4': '0.198', 'AMMO3': '0.223', 'weapon2': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:10,932][52664] DAMAGECOUNT value on done: 276702.0 [2024-08-06 02:06:10,932][52664] Sum rewards: 70.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.092', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.170', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'HITCOUNT': '3.440', 'weapon3': '3.604', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2024-08-06 02:06:11,167][52667] DAMAGECOUNT value on done: 267748.0 [2024-08-06 02:06:11,169][52667] Sum rewards: 65.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.035', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '54.000'} [2024-08-06 02:06:11,636][52668] DAMAGECOUNT value on done: 267246.0 [2024-08-06 02:06:11,636][52668] Sum rewards: 65.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.379', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.134', 'weapon4': '0.154', 'AMMO3': '0.227', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '56.000'} [2024-08-06 02:06:11,804][52665] DAMAGECOUNT value on done: 264707.0 [2024-08-06 02:06:11,806][52665] Sum rewards: 67.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.896', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.370', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.336', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:12,183][52662] DAMAGECOUNT value on done: 272220.0 [2024-08-06 02:06:12,186][52662] Sum rewards: 68.098, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.928', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.650', 'weapon3': '2.904', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17613.4, 300 sec: 17578.1). Total num frames: 290734080. Throughput: 0: 4390.0. Samples: 72690890. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:06:12,794][52567] Avg episode reward: [(0, '64.718')] [2024-08-06 02:06:13,227][52650] Updated weights for policy 0, policy_version 35491 (0.0025) [2024-08-06 02:06:13,482][52660] DAMAGECOUNT value on done: 265905.0 [2024-08-06 02:06:13,482][52660] Sum rewards: 55.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'AMMO3': '0.203', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.136', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '46.000'} [2024-08-06 02:06:13,512][52664] DAMAGECOUNT value on done: 280813.0 [2024-08-06 02:06:13,512][52664] Sum rewards: 73.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.148', 'weapon4': '0.152', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:14,198][52667] DAMAGECOUNT value on done: 269200.0 [2024-08-06 02:06:14,198][52667] Sum rewards: 59.946, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.232', 'AMMO5': '0.016', 'AMMO2': '0.065', 'AMMO3': '0.224', 'weapon4': '0.236', 'weapon5': '0.244', 'AMMO4': '0.326', 'weapon2': '0.460', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.744', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '49.000'} [2024-08-06 02:06:14,553][52668] DAMAGECOUNT value on done: 268637.0 [2024-08-06 02:06:14,554][52668] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.106', 'weapon5': '0.136', 'AMMO3': '0.207', 'AMMO4': '0.263', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.184', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:14,774][52662] DAMAGECOUNT value on done: 275940.0 [2024-08-06 02:06:14,775][52662] Sum rewards: 69.537, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.070', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.134', 'AMMO3': '0.172', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:14,825][52665] DAMAGECOUNT value on done: 263963.0 [2024-08-06 02:06:14,826][52665] Sum rewards: 78.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.136', 'weapon4': '0.146', 'weapon2': '0.196', 'AMMO3': '0.201', 'AMMO4': '0.229', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '66.500'} [2024-08-06 02:06:16,169][52664] DAMAGECOUNT value on done: 275873.0 [2024-08-06 02:06:16,170][52664] Sum rewards: 65.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.167', 'weapon2': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.172', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:16,241][52660] DAMAGECOUNT value on done: 261993.0 [2024-08-06 02:06:16,241][52660] Sum rewards: 58.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.832', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.178', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.908', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:17,027][52669] DAMAGECOUNT value on done: 269959.0 [2024-08-06 02:06:17,035][52669] Sum rewards: 64.171, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.136', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.152', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.664', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:17,235][52667] DAMAGECOUNT value on done: 268294.0 [2024-08-06 02:06:17,237][52667] Sum rewards: 58.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.828', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.198', 'weapon2': '0.446', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '3.110', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '49.000'} [2024-08-06 02:06:17,405][52662] DAMAGECOUNT value on done: 268040.0 [2024-08-06 02:06:17,407][52662] Sum rewards: 62.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.901', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.104', 'weapon5': '0.136', 'weapon2': '0.178', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.313', 'WEAPON3': '1.800', 'HITCOUNT': '3.220', 'weapon3': '3.292', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:17,565][52668] DAMAGECOUNT value on done: 263680.0 [2024-08-06 02:06:17,565][52668] Sum rewards: 57.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.602', 'AMMO5': '0.007', 'AMMO2': '0.060', 'weapon5': '0.140', 'weapon2': '0.228', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'AMMO4': '0.301', 'weapon4': '0.302', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.036', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '51.000'} [2024-08-06 02:06:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 290816000. Throughput: 0: 4393.1. Samples: 72704470. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:06:17,794][52567] Avg episode reward: [(0, '64.987')] [2024-08-06 02:06:18,107][52650] Updated weights for policy 0, policy_version 35501 (0.0013) [2024-08-06 02:06:18,972][52664] DAMAGECOUNT value on done: 280360.0 [2024-08-06 02:06:18,973][52664] Sum rewards: 57.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.510', 'AMMO5': '0.019', 'AMMO2': '0.071', 'weapon4': '0.244', 'AMMO3': '0.247', 'weapon5': '0.312', 'AMMO4': '0.355', 'weapon2': '0.532', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.514', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '50.500'} [2024-08-06 02:06:19,372][52669] DAMAGECOUNT value on done: 264062.0 [2024-08-06 02:06:19,373][52669] Sum rewards: 64.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.095', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.140', 'weapon4': '0.198', 'AMMO4': '0.207', 'AMMO3': '0.247', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:19,378][52660] DAMAGECOUNT value on done: 270782.0 [2024-08-06 02:06:19,380][52660] Sum rewards: 62.773, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.586', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.077', 'weapon2': '0.198', 'AMMO3': '0.311', 'WEAPON3': '1.850', 'weapon3': '3.526', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '56.000'} [2024-08-06 02:06:20,087][52662] DAMAGECOUNT value on done: 281576.0 [2024-08-06 02:06:20,089][52662] Sum rewards: 73.090, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.805', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.168', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '2.864', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '63.000'} [2024-08-06 02:06:20,379][52667] DAMAGECOUNT value on done: 269580.0 [2024-08-06 02:06:20,380][52667] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.375', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.167', 'weapon5': '0.178', 'weapon4': '0.204', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.040', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '56.000'} [2024-08-06 02:06:20,705][52668] DAMAGECOUNT value on done: 257759.0 [2024-08-06 02:06:20,707][52668] Sum rewards: 62.531, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.915', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.166', 'weapon4': '0.178', 'AMMO4': '0.193', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '54.000'} [2024-08-06 02:06:21,630][52664] DAMAGECOUNT value on done: 272348.0 [2024-08-06 02:06:21,630][52664] Sum rewards: 56.639, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.484', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.052', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '45.000'} [2024-08-06 02:06:22,011][52669] DAMAGECOUNT value on done: 269071.0 [2024-08-06 02:06:22,012][52669] Sum rewards: 71.070, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.089', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.082', 'weapon5': '0.082', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.296', 'weapon2': '0.340', 'WEAPON3': '1.750', 'weapon3': '3.202', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '65.000'} [2024-08-06 02:06:22,313][52650] Updated weights for policy 0, policy_version 35511 (0.0030) [2024-08-06 02:06:22,588][52660] DAMAGECOUNT value on done: 273297.0 [2024-08-06 02:06:22,588][52660] Sum rewards: 71.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.701', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.064', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.266', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 290906112. Throughput: 0: 4387.6. Samples: 72730610. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:06:22,794][52567] Avg episode reward: [(0, '64.942')] [2024-08-06 02:06:23,031][52667] DAMAGECOUNT value on done: 267483.0 [2024-08-06 02:06:23,031][52667] Sum rewards: 51.167, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.444', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.065', 'AMMO3': '0.223', 'weapon4': '0.226', 'weapon5': '0.282', 'AMMO4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.520', 'weapon3': '2.702', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '47.000'} [2024-08-06 02:06:23,135][52662] DAMAGECOUNT value on done: 267069.0 [2024-08-06 02:06:23,135][52662] Sum rewards: 45.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.161', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.086', 'weapon4': '0.172', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'AMMO4': '0.261', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '2.974', 'DAMAGECOUNT': '12.225', 'FRAGCOUNT': '43.000'} [2024-08-06 02:06:23,765][52668] DAMAGECOUNT value on done: 260546.0 [2024-08-06 02:06:23,765][52668] Sum rewards: 68.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.086', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.170', 'weapon5': '0.174', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:24,302][52664] DAMAGECOUNT value on done: 277577.0 [2024-08-06 02:06:24,303][52664] Sum rewards: 60.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.132', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'weapon4': '0.270', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.036', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '50.000'} [2024-08-06 02:06:25,144][52669] DAMAGECOUNT value on done: 266381.0 [2024-08-06 02:06:25,145][52669] Sum rewards: 56.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.028', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.104', 'AMMO4': '0.180', 'weapon5': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.978', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:25,182][52660] DAMAGECOUNT value on done: 271581.0 [2024-08-06 02:06:25,183][52660] Sum rewards: 68.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.178', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.304', 'weapon2': '0.522', 'WEAPON3': '1.550', 'weapon3': '2.912', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 02:06:25,468][52794] DAMAGECOUNT value on done: 271582.0 [2024-08-06 02:06:25,471][52794] Sum rewards: 80.655, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.884', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon4': '0.260', 'weapon2': '0.310', 'ARMOR': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '67.000'} [2024-08-06 02:06:25,714][52667] DAMAGECOUNT value on done: 265215.0 [2024-08-06 02:06:25,715][52667] Sum rewards: 82.465, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.029', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.216', 'AMMO3': '0.230', 'HEALTH': '0.920', 'WEAPON3': '1.200', 'weapon3': '3.554', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '67.000'} [2024-08-06 02:06:26,023][52662] DAMAGECOUNT value on done: 266450.0 [2024-08-06 02:06:26,025][52662] Sum rewards: 58.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.078', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.166', 'AMMO4': '0.202', 'AMMO3': '0.234', 'weapon4': '0.336', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '50.000'} [2024-08-06 02:06:26,449][52668] DAMAGECOUNT value on done: 261880.0 [2024-08-06 02:06:26,451][52668] Sum rewards: 53.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.100', 'AMMO4': '0.194', 'AMMO3': '0.237', 'weapon5': '0.264', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '3.042', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '45.500'} [2024-08-06 02:06:26,971][52664] DAMAGECOUNT value on done: 279521.0 [2024-08-06 02:06:26,972][52664] Sum rewards: 75.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.366', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.386', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '61.000'} [2024-08-06 02:06:27,269][52650] Updated weights for policy 0, policy_version 35521 (0.0015) [2024-08-06 02:06:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 290996224. Throughput: 0: 4384.7. Samples: 72756810. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:06:27,794][52567] Avg episode reward: [(0, '64.656')] [2024-08-06 02:06:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035522_290996224.pth... [2024-08-06 02:06:27,915][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035007_286777344.pth [2024-08-06 02:06:28,044][52669] DAMAGECOUNT value on done: 264555.0 [2024-08-06 02:06:28,046][52669] Sum rewards: 68.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.174', 'AMMO3': '0.202', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:28,193][52660] DAMAGECOUNT value on done: 266222.0 [2024-08-06 02:06:28,194][52660] Sum rewards: 81.244, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.881', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.107', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '66.000'} [2024-08-06 02:06:28,215][52794] DAMAGECOUNT value on done: 272781.0 [2024-08-06 02:06:28,218][52794] Sum rewards: 57.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.196', 'weapon5': '0.252', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '47.000'} [2024-08-06 02:06:28,749][52662] DAMAGECOUNT value on done: 268483.0 [2024-08-06 02:06:28,749][52662] Sum rewards: 47.075, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.148', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.146', 'AMMO4': '0.192', 'weapon4': '0.228', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.852', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '41.500'} [2024-08-06 02:06:28,882][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:06:28,943][52667] DAMAGECOUNT value on done: 273518.0 [2024-08-06 02:06:28,943][52667] Sum rewards: 69.481, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.165', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.068', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.504', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.252', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:29,443][52668] DAMAGECOUNT value on done: 265711.0 [2024-08-06 02:06:29,443][52668] Sum rewards: 66.894, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.148', 'weapon2': '0.216', 'weapon5': '0.218', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:30,242][52664] DAMAGECOUNT value on done: 277858.0 [2024-08-06 02:06:30,242][52664] Sum rewards: 73.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.102', 'weapon4': '0.136', 'weapon2': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '3.290', 'weapon3': '3.370', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '63.000'} [2024-08-06 02:06:30,596][52794] DAMAGECOUNT value on done: 268395.0 [2024-08-06 02:06:30,598][52669] DAMAGECOUNT value on done: 266263.0 [2024-08-06 02:06:30,597][52794] Sum rewards: 65.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.972', 'AMMO5': '0.010', 'ARMOR': '0.028', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.164', 'AMMO4': '0.167', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.000'} [2024-08-06 02:06:30,599][52669] Sum rewards: 62.479, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.665', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.166', 'weapon4': '0.192', 'weapon2': '0.208', 'AMMO3': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.134', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:31,215][52662] DAMAGECOUNT value on done: 276260.0 [2024-08-06 02:06:31,215][52662] Sum rewards: 62.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.944', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.092', 'weapon5': '0.180', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.162', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:31,393][52660] DAMAGECOUNT value on done: 272556.0 [2024-08-06 02:06:31,393][52660] Sum rewards: 59.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon2': '0.192', 'weapon4': '0.202', 'weapon5': '0.208', 'AMMO4': '0.222', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.144', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 02:06:32,049][52667] DAMAGECOUNT value on done: 276736.0 [2024-08-06 02:06:32,049][52667] Sum rewards: 65.440, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.855', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO4': '0.134', 'weapon5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.244', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '53.000'} [2024-08-06 02:06:32,249][52650] Updated weights for policy 0, policy_version 35531 (0.0033) [2024-08-06 02:06:32,736][52668] DAMAGECOUNT value on done: 267267.0 [2024-08-06 02:06:32,736][52668] Sum rewards: 79.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.770', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '64.000'} [2024-08-06 02:06:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 291086336. Throughput: 0: 4386.2. Samples: 72769740. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:06:32,794][52567] Avg episode reward: [(0, '65.037')] [2024-08-06 02:06:32,977][52664] DAMAGECOUNT value on done: 279270.0 [2024-08-06 02:06:32,978][52664] Sum rewards: 58.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.075', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.298', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.394', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '53.000'} [2024-08-06 02:06:33,091][52669] DAMAGECOUNT value on done: 270323.0 [2024-08-06 02:06:33,101][52669] Sum rewards: 71.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.995', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.082', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.420', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:33,587][52794] DAMAGECOUNT value on done: 268695.0 [2024-08-06 02:06:33,589][52794] Sum rewards: 61.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'weapon2': '0.426', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.376', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '51.000'} [2024-08-06 02:06:34,045][52662] DAMAGECOUNT value on done: 268327.0 [2024-08-06 02:06:34,047][52662] Sum rewards: 59.165, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.494', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.114', 'weapon4': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:34,464][52660] DAMAGECOUNT value on done: 258355.0 [2024-08-06 02:06:34,464][52660] Sum rewards: 59.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.240', 'weapon4': '0.240', 'weapon5': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '2.790', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:35,298][52667] DAMAGECOUNT value on done: 271962.0 [2024-08-06 02:06:35,301][52667] Sum rewards: 53.594, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.644', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.124', 'weapon5': '0.154', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'AMMO3': '0.318', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'HITCOUNT': '2.930', 'weapon3': '3.090', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '49.500'} [2024-08-06 02:06:35,695][52669] DAMAGECOUNT value on done: 267582.0 [2024-08-06 02:06:35,695][52669] Sum rewards: 58.172, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.891', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.196', 'weapon4': '0.196', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.336', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '49.000'} [2024-08-06 02:06:35,773][52668] DAMAGECOUNT value on done: 266496.0 [2024-08-06 02:06:35,774][52668] Sum rewards: 59.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.189', 'weapon2': '0.198', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.644', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:36,383][52794] DAMAGECOUNT value on done: 267246.0 [2024-08-06 02:06:36,384][52794] Sum rewards: 72.843, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.064', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.146', 'weapon2': '0.214', 'AMMO4': '0.278', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'weapon4': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.050', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '63.000'} [2024-08-06 02:06:36,684][52650] Updated weights for policy 0, policy_version 35541 (0.0018) [2024-08-06 02:06:37,260][52662] DAMAGECOUNT value on done: 279763.0 [2024-08-06 02:06:37,260][52662] Sum rewards: 80.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.062', 'weapon4': '0.120', 'AMMO4': '0.168', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '65.500'} [2024-08-06 02:06:37,543][52660] DAMAGECOUNT value on done: 263451.0 [2024-08-06 02:06:37,545][52660] Sum rewards: 60.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.536', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '49.000'} [2024-08-06 02:06:37,682][52658] DAMAGECOUNT value on done: 269452.0 [2024-08-06 02:06:37,685][52658] Sum rewards: 51.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.558', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '45.000'} [2024-08-06 02:06:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 291168256. Throughput: 0: 4382.7. Samples: 72795980. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:06:37,794][52567] Avg episode reward: [(0, '64.552')] [2024-08-06 02:06:38,516][52667] DAMAGECOUNT value on done: 273592.0 [2024-08-06 02:06:38,516][52667] Sum rewards: 57.744, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.398', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.222', 'AMMO4': '0.257', 'AMMO3': '0.275', 'weapon4': '0.276', 'weapon2': '0.292', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.862', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '51.000'} [2024-08-06 02:06:38,554][52669] DAMAGECOUNT value on done: 269688.0 [2024-08-06 02:06:38,554][52669] Sum rewards: 75.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.072', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.260', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '65.000'} [2024-08-06 02:06:38,819][52668] DAMAGECOUNT value on done: 270144.0 [2024-08-06 02:06:38,819][52668] Sum rewards: 78.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.813', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.072', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '66.000'} [2024-08-06 02:06:39,558][52794] DAMAGECOUNT value on done: 270343.0 [2024-08-06 02:06:39,560][52794] Sum rewards: 71.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.450', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:40,204][52662] DAMAGECOUNT value on done: 269481.0 [2024-08-06 02:06:40,215][52662] Sum rewards: 65.359, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.134', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.234', 'weapon2': '0.502', 'WEAPON3': '0.950', 'weapon3': '2.860', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:40,563][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:06:40,582][52658] DAMAGECOUNT value on done: 269009.0 [2024-08-06 02:06:40,584][52658] Sum rewards: 65.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.360', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.133', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.596', 'WEAPON3': '0.950', 'weapon3': '2.810', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:40,755][52660] DAMAGECOUNT value on done: 272599.0 [2024-08-06 02:06:40,756][52660] Sum rewards: 64.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.164', 'AMMO3': '0.209', 'AMMO4': '0.226', 'weapon5': '0.246', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '2.886', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:41,321][52650] Updated weights for policy 0, policy_version 35551 (0.0026) [2024-08-06 02:06:41,419][52669] DAMAGECOUNT value on done: 264582.0 [2024-08-06 02:06:41,421][52669] Sum rewards: 70.848, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.036', 'AMMO4': '0.045', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.370', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '61.000'} [2024-08-06 02:06:41,509][52667] DAMAGECOUNT value on done: 264346.0 [2024-08-06 02:06:41,509][52667] Sum rewards: 72.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.117', 'weapon5': '0.136', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.340', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:42,120][52668] DAMAGECOUNT value on done: 266684.0 [2024-08-06 02:06:42,121][52668] Sum rewards: 54.618, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.899', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.233', 'weapon5': '0.262', 'weapon2': '0.296', 'AMMO4': '0.325', 'weapon4': '0.520', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.494', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '49.000'} [2024-08-06 02:06:42,398][52794] DAMAGECOUNT value on done: 274152.0 [2024-08-06 02:06:42,399][52794] Sum rewards: 73.484, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.978', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.038', 'weapon5': '0.098', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.322', 'WEAPON3': '1.700', 'weapon3': '3.256', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '64.000'} [2024-08-06 02:06:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 291258368. Throughput: 0: 4378.4. Samples: 72822250. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:06:42,794][52567] Avg episode reward: [(0, '65.013')] [2024-08-06 02:06:43,057][52662] DAMAGECOUNT value on done: 271254.0 [2024-08-06 02:06:43,058][52662] Sum rewards: 62.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.334', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:43,506][52658] DAMAGECOUNT value on done: 270507.0 [2024-08-06 02:06:43,507][52658] Sum rewards: 68.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.050', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.203', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:43,752][52660] DAMAGECOUNT value on done: 276464.0 [2024-08-06 02:06:43,760][52660] Sum rewards: 52.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.937', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.120', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'weapon2': '0.352', 'WEAPON3': '1.700', 'HITCOUNT': '2.990', 'weapon3': '3.126', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '47.000'} [2024-08-06 02:06:44,191][52667] DAMAGECOUNT value on done: 270296.0 [2024-08-06 02:06:44,191][52667] Sum rewards: 64.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.114', 'weapon5': '0.160', 'AMMO4': '0.239', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.022', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '57.000'} [2024-08-06 02:06:44,376][52669] DAMAGECOUNT value on done: 270750.0 [2024-08-06 02:06:44,378][52669] Sum rewards: 69.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.313', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.126', 'AMMO4': '0.163', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.262', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '61.000'} [2024-08-06 02:06:44,913][52795] DAMAGECOUNT value on done: 249159.0 [2024-08-06 02:06:44,913][52795] Sum rewards: 62.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.872', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.208', 'AMMO3': '0.214', 'WEAPON5': '0.350', 'weapon4': '0.432', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.630', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2024-08-06 02:06:45,283][52794] DAMAGECOUNT value on done: 269941.0 [2024-08-06 02:06:45,283][52794] Sum rewards: 80.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon4': '0.202', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '66.000'} [2024-08-06 02:06:45,940][52662] DAMAGECOUNT value on done: 270354.0 [2024-08-06 02:06:45,941][52662] Sum rewards: 71.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '60.000'} [2024-08-06 02:06:46,289][52650] Updated weights for policy 0, policy_version 35561 (0.0019) [2024-08-06 02:06:46,409][52658] DAMAGECOUNT value on done: 268771.0 [2024-08-06 02:06:46,410][52658] Sum rewards: 60.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.816', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.082', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'weapon2': '0.768', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '51.000'} [2024-08-06 02:06:46,626][52660] DAMAGECOUNT value on done: 263350.0 [2024-08-06 02:06:46,627][52660] Sum rewards: 71.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.180', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.177', 'weapon2': '0.236', 'weapon4': '0.270', 'WEAPON3': '1.050', 'weapon3': '3.210', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:47,123][52669] DAMAGECOUNT value on done: 268776.0 [2024-08-06 02:06:47,125][52669] Sum rewards: 68.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.938', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.118', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.194', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 291348480. Throughput: 0: 4378.9. Samples: 72835350. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:06:47,794][52567] Avg episode reward: [(0, '64.942')] [2024-08-06 02:06:47,848][52794] DAMAGECOUNT value on done: 275178.0 [2024-08-06 02:06:47,850][52794] Sum rewards: 78.347, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.197', 'weapon2': '0.242', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.300', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '68.000'} [2024-08-06 02:06:48,033][52795] DAMAGECOUNT value on done: 242848.0 [2024-08-06 02:06:48,033][52795] Sum rewards: 67.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.774', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.168', 'AMMO4': '0.282', 'weapon2': '0.292', 'weapon5': '0.482', 'weapon4': '0.514', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.346', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '54.000'} [2024-08-06 02:06:48,267][52668] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:06:48,431][52662] DAMAGECOUNT value on done: 263377.0 [2024-08-06 02:06:48,431][52662] Sum rewards: 59.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.584', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.240', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.170', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:49,062][52658] DAMAGECOUNT value on done: 269115.0 [2024-08-06 02:06:49,064][52658] Sum rewards: 61.017, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.957', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.156', 'AMMO4': '0.171', 'weapon5': '0.192', 'weapon2': '0.208', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.206', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:49,720][52660] DAMAGECOUNT value on done: 268004.0 [2024-08-06 02:06:49,720][52660] Sum rewards: 56.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.763', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.058', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.318', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '47.000'} [2024-08-06 02:06:50,160][52669] DAMAGECOUNT value on done: 265849.0 [2024-08-06 02:06:50,161][52669] Sum rewards: 70.508, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.160', 'weapon5': '0.272', 'AMMO4': '0.280', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'HEALTH': '0.423', 'weapon2': '0.494', 'WEAPON3': '0.800', 'weapon3': '2.564', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:50,250][52794] DAMAGECOUNT value on done: 271847.0 [2024-08-06 02:06:50,250][52794] Sum rewards: 68.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.036', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon2': '0.230', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'weapon3': '3.374', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '61.000'} [2024-08-06 02:06:50,452][52650] Updated weights for policy 0, policy_version 35571 (0.0010) [2024-08-06 02:06:51,160][52795] DAMAGECOUNT value on done: 243696.0 [2024-08-06 02:06:51,160][52795] Sum rewards: 64.109, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'weapon4': '0.094', 'weapon5': '0.108', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '0.926', 'weapon3': '2.560', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '51.000'} [2024-08-06 02:06:52,009][52658] DAMAGECOUNT value on done: 267229.0 [2024-08-06 02:06:52,011][52658] Sum rewards: 68.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.482', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO4': '0.168', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.364', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:52,519][52660] DAMAGECOUNT value on done: 258885.0 [2024-08-06 02:06:52,519][52660] Sum rewards: 56.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.690', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.071', 'AMMO3': '0.213', 'weapon5': '0.276', 'AMMO4': '0.354', 'weapon2': '0.384', 'weapon4': '0.482', 'WEAPON5': '0.600', 'WEAPON4': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.476', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '49.000'} [2024-08-06 02:06:52,747][52794] DAMAGECOUNT value on done: 269690.0 [2024-08-06 02:06:52,748][52794] Sum rewards: 66.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.682', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.197', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.102', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '56.000'} [2024-08-06 02:06:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 291430400. Throughput: 0: 4386.9. Samples: 72861970. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:06:52,794][52567] Avg episode reward: [(0, '65.289')] [2024-08-06 02:06:53,347][52669] DAMAGECOUNT value on done: 270371.0 [2024-08-06 02:06:53,350][52669] Sum rewards: 62.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.072', 'weapon4': '0.134', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO4': '0.212', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.424', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '55.000'} [2024-08-06 02:06:54,446][52795] DAMAGECOUNT value on done: 247454.0 [2024-08-06 02:06:54,446][52795] Sum rewards: 62.946, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.066', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.352', 'weapon4': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '50.000'} [2024-08-06 02:06:54,694][52658] DAMAGECOUNT value on done: 273270.0 [2024-08-06 02:06:54,694][52658] Sum rewards: 59.560, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'HEALTH': '0.037', 'AMMO2': '0.055', 'weapon5': '0.086', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'AMMO4': '0.275', 'weapon2': '0.364', 'ARMOR': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.670', 'WEAPON3': '0.950', 'weapon3': '2.670', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:55,398][52794] DAMAGECOUNT value on done: 269037.0 [2024-08-06 02:06:55,399][52794] Sum rewards: 70.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.782', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.234', 'AMMO3': '0.244', 'weapon2': '0.286', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '59.500'} [2024-08-06 02:06:55,405][52650] Updated weights for policy 0, policy_version 35581 (0.0027) [2024-08-06 02:06:55,817][52660] DAMAGECOUNT value on done: 268624.0 [2024-08-06 02:06:55,820][52660] Sum rewards: 72.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.672', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.146', 'weapon5': '0.158', 'AMMO3': '0.172', 'AMMO4': '0.182', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:56,352][52669] DAMAGECOUNT value on done: 273199.0 [2024-08-06 02:06:56,354][52669] Sum rewards: 77.743, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.518', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.164', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.288', 'weapon4': '0.312', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.954', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '68.000'} [2024-08-06 02:06:56,992][52671] DAMAGECOUNT value on done: 272356.0 [2024-08-06 02:06:56,992][52671] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon4': '0.222', 'weapon2': '0.290', 'HEALTH': '0.678', 'WEAPON3': '0.900', 'weapon3': '3.098', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '56.000'} [2024-08-06 02:06:57,661][52795] DAMAGECOUNT value on done: 251908.0 [2024-08-06 02:06:57,665][52795] Sum rewards: 68.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.129', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.113', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '58.000'} [2024-08-06 02:06:57,712][52658] DAMAGECOUNT value on done: 261955.0 [2024-08-06 02:06:57,712][52658] Sum rewards: 54.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.267', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.229', 'weapon2': '0.530', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.288', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '47.000'} [2024-08-06 02:06:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 291520512. Throughput: 0: 4388.7. Samples: 72888380. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:06:57,794][52567] Avg episode reward: [(0, '65.310')] [2024-08-06 02:06:58,285][52794] DAMAGECOUNT value on done: 263441.0 [2024-08-06 02:06:58,287][52794] Sum rewards: 50.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon5': '0.180', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.656', 'DAMAGECOUNT': '11.886', 'FRAGCOUNT': '43.000'} [2024-08-06 02:06:58,938][52669] DAMAGECOUNT value on done: 281071.0 [2024-08-06 02:06:58,940][52669] Sum rewards: 57.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.103', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.142', 'weapon5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:59,066][52660] DAMAGECOUNT value on done: 263724.0 [2024-08-06 02:06:59,068][52660] Sum rewards: 61.331, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon2': '0.150', 'AMMO3': '0.151', 'weapon4': '0.180', 'WEAPON4': '0.200', 'HEALTH': '0.652', 'WEAPON3': '0.850', 'HITCOUNT': '3.060', 'weapon3': '3.436', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '48.000'} [2024-08-06 02:06:59,758][52671] DAMAGECOUNT value on done: 269937.0 [2024-08-06 02:06:59,758][52671] Sum rewards: 75.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.102', 'AMMO4': '0.159', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '63.000'} [2024-08-06 02:06:59,878][52650] Updated weights for policy 0, policy_version 35591 (0.0013) [2024-08-06 02:07:00,756][52795] DAMAGECOUNT value on done: 247832.0 [2024-08-06 02:07:00,756][52795] Sum rewards: 66.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.142', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.154', 'weapon5': '0.158', 'AMMO3': '0.163', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:00,830][52658] DAMAGECOUNT value on done: 274496.0 [2024-08-06 02:07:00,830][52658] Sum rewards: 70.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.098', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.126', 'AMMO4': '0.174', 'weapon2': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.432', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:01,317][52794] DAMAGECOUNT value on done: 277349.0 [2024-08-06 02:07:01,317][52794] Sum rewards: 55.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon4': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'HITCOUNT': '2.840', 'weapon3': '3.214', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '49.000'} [2024-08-06 02:07:01,870][52669] DAMAGECOUNT value on done: 269789.0 [2024-08-06 02:07:01,872][52669] Sum rewards: 83.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.112', 'AMMO4': '0.190', 'weapon5': '0.206', 'AMMO3': '0.213', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '68.000'} [2024-08-06 02:07:02,424][52671] DAMAGECOUNT value on done: 271487.0 [2024-08-06 02:07:02,425][52671] Sum rewards: 67.827, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.421', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon4': '0.156', 'weapon2': '0.652', 'WEAPON3': '0.850', 'weapon3': '2.836', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:02,768][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:07:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 291610624. Throughput: 0: 4373.3. Samples: 72901270. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:07:02,794][52567] Avg episode reward: [(0, '65.258')] [2024-08-06 02:07:03,699][52658] DAMAGECOUNT value on done: 272998.0 [2024-08-06 02:07:03,701][52658] Sum rewards: 79.259, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.214', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.098', 'weapon5': '0.116', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.246', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '67.000'} [2024-08-06 02:07:04,013][52795] DAMAGECOUNT value on done: 252232.0 [2024-08-06 02:07:04,014][52795] Sum rewards: 56.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon5': '0.156', 'weapon4': '0.198', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.034', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '49.500'} [2024-08-06 02:07:04,292][52794] DAMAGECOUNT value on done: 265804.0 [2024-08-06 02:07:04,292][52794] Sum rewards: 66.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.601', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.236', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.442', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:04,773][52650] Updated weights for policy 0, policy_version 35601 (0.0033) [2024-08-06 02:07:04,834][52669] DAMAGECOUNT value on done: 274913.0 [2024-08-06 02:07:04,836][52669] Sum rewards: 78.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.099', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.140', 'AMMO3': '0.191', 'AMMO4': '0.206', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2024-08-06 02:07:05,554][52671] DAMAGECOUNT value on done: 268075.0 [2024-08-06 02:07:05,555][52671] Sum rewards: 68.694, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.039', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO3': '0.132', 'AMMO4': '0.139', 'weapon4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.830', 'WEAPON3': '0.900', 'weapon3': '2.722', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:06,201][52658] DAMAGECOUNT value on done: 275977.0 [2024-08-06 02:07:06,202][52658] Sum rewards: 75.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.628', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.162', 'AMMO4': '0.173', 'weapon5': '0.226', 'weapon2': '0.326', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '61.000'} [2024-08-06 02:07:07,192][52795] DAMAGECOUNT value on done: 248560.0 [2024-08-06 02:07:07,192][52795] Sum rewards: 62.448, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.052', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.192', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '51.000'} [2024-08-06 02:07:07,263][52669] DAMAGECOUNT value on done: 272372.0 [2024-08-06 02:07:07,264][52669] Sum rewards: 51.178, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.206', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.272', 'weapon2': '0.408', 'WEAPON3': '1.550', 'HITCOUNT': '2.750', 'weapon3': '3.246', 'DAMAGECOUNT': '13.515', 'FRAGCOUNT': '46.000'} [2024-08-06 02:07:07,432][52794] DAMAGECOUNT value on done: 277295.0 [2024-08-06 02:07:07,432][52794] Sum rewards: 63.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.856', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.222', 'AMMO3': '0.267', 'AMMO4': '0.268', 'weapon2': '0.308', 'weapon4': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.848', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '55.000'} [2024-08-06 02:07:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 291692544. Throughput: 0: 4383.5. Samples: 72927870. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 02:07:07,795][52567] Avg episode reward: [(0, '65.581')] [2024-08-06 02:07:08,731][52671] DAMAGECOUNT value on done: 277001.0 [2024-08-06 02:07:08,733][52671] Sum rewards: 71.428, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.458', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.134', 'AMMO3': '0.152', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:08,844][52658] DAMAGECOUNT value on done: 261970.0 [2024-08-06 02:07:08,846][52658] Sum rewards: 69.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.086', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO4': '0.242', 'AMMO3': '0.245', 'weapon4': '0.370', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '58.000'} [2024-08-06 02:07:09,179][52650] Updated weights for policy 0, policy_version 35611 (0.0017) [2024-08-06 02:07:09,441][52803] DAMAGECOUNT value on done: 249322.0 [2024-08-06 02:07:09,444][52803] Sum rewards: 59.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.097', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.211', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 02:07:10,234][52794] DAMAGECOUNT value on done: 270992.0 [2024-08-06 02:07:10,244][52794] Sum rewards: 69.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.476', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.276', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:10,326][52669] DAMAGECOUNT value on done: 275674.0 [2024-08-06 02:07:10,326][52669] Sum rewards: 72.173, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.185', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.070', 'weapon4': '0.088', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '63.000'} [2024-08-06 02:07:10,423][52795] DAMAGECOUNT value on done: 245010.0 [2024-08-06 02:07:10,424][52795] Sum rewards: 72.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.151', 'AMMO5': '0.014', 'AMMO2': '0.054', 'AMMO3': '0.166', 'weapon4': '0.218', 'weapon5': '0.220', 'AMMO4': '0.268', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:11,571][52666] DAMAGECOUNT value on done: 272978.0 [2024-08-06 02:07:11,573][52666] Sum rewards: 60.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.074', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.170', 'AMMO3': '0.211', 'weapon4': '0.226', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '2.968', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '51.500'} [2024-08-06 02:07:11,673][52658] DAMAGECOUNT value on done: 269623.0 [2024-08-06 02:07:11,674][52658] Sum rewards: 62.999, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:11,757][52671] DAMAGECOUNT value on done: 269160.0 [2024-08-06 02:07:11,758][52671] Sum rewards: 55.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.240', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.292', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '47.500'} [2024-08-06 02:07:12,645][52803] DAMAGECOUNT value on done: 250521.0 [2024-08-06 02:07:12,645][52803] Sum rewards: 65.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.015', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.116', 'weapon5': '0.138', 'AMMO4': '0.188', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17605.9). Total num frames: 291790848. Throughput: 0: 4377.6. Samples: 72953800. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 02:07:12,794][52567] Avg episode reward: [(0, '66.053')] [2024-08-06 02:07:13,131][52794] DAMAGECOUNT value on done: 271502.0 [2024-08-06 02:07:13,132][52794] Sum rewards: 59.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.570', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.138', 'AMMO3': '0.193', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.026', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '48.500'} [2024-08-06 02:07:13,575][52795] DAMAGECOUNT value on done: 254283.0 [2024-08-06 02:07:13,575][52795] Sum rewards: 78.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.325', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.204', 'weapon2': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.592', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '65.000'} [2024-08-06 02:07:14,131][52650] Updated weights for policy 0, policy_version 35621 (0.0022) [2024-08-06 02:07:14,353][52666] DAMAGECOUNT value on done: 274004.0 [2024-08-06 02:07:14,355][52666] Sum rewards: 78.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.782', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'weapon4': '0.214', 'AMMO3': '0.259', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.234', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '67.000'} [2024-08-06 02:07:14,374][52811] DAMAGECOUNT value on done: 260717.0 [2024-08-06 02:07:14,374][52811] Sum rewards: 65.494, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.511', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon5': '0.168', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '55.000'} [2024-08-06 02:07:14,517][52658] DAMAGECOUNT value on done: 269153.0 [2024-08-06 02:07:14,519][52658] Sum rewards: 71.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.140', 'weapon2': '0.188', 'AMMO4': '0.193', 'AMMO3': '0.222', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:14,756][52671] DAMAGECOUNT value on done: 272788.0 [2024-08-06 02:07:14,756][52671] Sum rewards: 77.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.146', 'AMMO3': '0.193', 'weapon4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '63.000'} [2024-08-06 02:07:15,686][52803] DAMAGECOUNT value on done: 250599.0 [2024-08-06 02:07:15,688][52803] Sum rewards: 70.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.594', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.262', 'weapon4': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:16,071][52794] DAMAGECOUNT value on done: 283000.0 [2024-08-06 02:07:16,072][52794] Sum rewards: 63.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.076', 'weapon4': '0.090', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.406', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:16,756][52795] DAMAGECOUNT value on done: 248487.0 [2024-08-06 02:07:16,756][52795] Sum rewards: 68.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon4': '0.288', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:17,019][52666] DAMAGECOUNT value on done: 272570.0 [2024-08-06 02:07:17,020][52666] Sum rewards: 59.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.256', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.090', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '51.000'} [2024-08-06 02:07:17,484][52811] DAMAGECOUNT value on done: 248222.0 [2024-08-06 02:07:17,486][52811] Sum rewards: 65.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.398', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO4': '0.143', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:17,626][52658] DAMAGECOUNT value on done: 263684.0 [2024-08-06 02:07:17,626][52658] Sum rewards: 69.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.768', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.086', 'weapon5': '0.138', 'AMMO3': '0.191', 'weapon2': '0.238', 'AMMO4': '0.269', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.338', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 291864576. Throughput: 0: 4385.1. Samples: 72967070. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 02:07:17,794][52567] Avg episode reward: [(0, '66.179')] [2024-08-06 02:07:18,052][52671] DAMAGECOUNT value on done: 273353.0 [2024-08-06 02:07:18,052][52671] Sum rewards: 70.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.158', 'AMMO4': '0.182', 'weapon5': '0.184', 'weapon2': '0.256', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:18,499][52650] Updated weights for policy 0, policy_version 35631 (0.0034) [2024-08-06 02:07:18,925][52803] DAMAGECOUNT value on done: 251852.0 [2024-08-06 02:07:18,928][52803] Sum rewards: 66.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.171', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.308', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 02:07:18,976][52670] DAMAGECOUNT value on done: 265850.0 [2024-08-06 02:07:18,977][52670] Sum rewards: 60.009, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.978', 'AMMO5': '0.012', 'AMMO2': '0.073', 'weapon5': '0.224', 'AMMO3': '0.271', 'AMMO4': '0.365', 'weapon2': '0.414', 'weapon4': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.508', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:19,040][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:07:19,298][52794] DAMAGECOUNT value on done: 271902.0 [2024-08-06 02:07:19,299][52794] Sum rewards: 54.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.034', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '47.000'} [2024-08-06 02:07:19,492][52666] DAMAGECOUNT value on done: 268012.0 [2024-08-06 02:07:19,494][52666] Sum rewards: 70.012, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.241', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.204', 'AMMO3': '0.292', 'weapon2': '0.302', 'weapon5': '0.308', 'AMMO4': '0.310', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.860', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '60.500'} [2024-08-06 02:07:20,006][52795] DAMAGECOUNT value on done: 246300.0 [2024-08-06 02:07:20,007][52795] Sum rewards: 67.528, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.082', 'AMMO4': '0.090', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:20,566][52811] DAMAGECOUNT value on done: 252544.0 [2024-08-06 02:07:20,566][52811] Sum rewards: 68.662, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-0.004', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.190', 'AMMO4': '0.238', 'weapon4': '0.254', 'weapon2': '0.270', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.894', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '62.000'} [2024-08-06 02:07:20,916][52658] DAMAGECOUNT value on done: 266389.0 [2024-08-06 02:07:20,924][52658] Sum rewards: 54.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.232', 'weapon2': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.338', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '48.000'} [2024-08-06 02:07:20,962][52671] DAMAGECOUNT value on done: 266123.0 [2024-08-06 02:07:20,962][52671] Sum rewards: 68.906, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.005', 'AMMO5': '0.006', 'AMMO2': '0.049', 'weapon5': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO4': '0.244', 'AMMO3': '0.270', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.076', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '62.000'} [2024-08-06 02:07:21,747][52670] DAMAGECOUNT value on done: 270616.0 [2024-08-06 02:07:21,747][52670] Sum rewards: 60.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.972', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.154', 'AMMO4': '0.168', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '50.000'} [2024-08-06 02:07:22,247][52803] DAMAGECOUNT value on done: 253822.0 [2024-08-06 02:07:22,247][52803] Sum rewards: 74.127, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.072', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.240', 'WEAPON3': '1.100', 'weapon3': '3.424', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '61.000'} [2024-08-06 02:07:22,624][52666] DAMAGECOUNT value on done: 265067.0 [2024-08-06 02:07:22,625][52666] Sum rewards: 69.405, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 291954688. Throughput: 0: 4388.0. Samples: 72993440. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 02:07:22,794][52567] Avg episode reward: [(0, '66.446')] [2024-08-06 02:07:22,799][52647] DAMAGECOUNT value on done: 285553.0 [2024-08-06 02:07:22,799][52647] Sum rewards: 61.242, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.666', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.110', 'weapon4': '0.116', 'AMMO4': '0.163', 'WEAPON5': '0.250', 'AMMO3': '0.318', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.120', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '58.000'} [2024-08-06 02:07:23,071][52795] DAMAGECOUNT value on done: 243154.0 [2024-08-06 02:07:23,071][52795] Sum rewards: 54.224, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.160', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.550', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.568', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '44.000'} [2024-08-06 02:07:23,464][52650] Updated weights for policy 0, policy_version 35641 (0.0011) [2024-08-06 02:07:23,494][52658] DAMAGECOUNT value on done: 274770.0 [2024-08-06 02:07:23,495][52658] Sum rewards: 72.506, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:23,662][52811] DAMAGECOUNT value on done: 248847.0 [2024-08-06 02:07:23,662][52811] Sum rewards: 66.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.173', 'weapon4': '0.188', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:23,989][52671] DAMAGECOUNT value on done: 273779.0 [2024-08-06 02:07:23,992][52671] Sum rewards: 60.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.733', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.104', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2024-08-06 02:07:24,748][52670] DAMAGECOUNT value on done: 262784.0 [2024-08-06 02:07:24,749][52670] Sum rewards: 66.929, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.104', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'AMMO3': '0.296', 'WEAPON3': '1.650', 'weapon3': '3.222', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:25,322][52666] DAMAGECOUNT value on done: 259403.0 [2024-08-06 02:07:25,324][52666] Sum rewards: 58.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO3': '0.188', 'weapon4': '0.188', 'AMMO4': '0.207', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '48.500'} [2024-08-06 02:07:25,347][52803] DAMAGECOUNT value on done: 251654.0 [2024-08-06 02:07:25,351][52803] Sum rewards: 54.073, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.181', 'weapon5': '0.198', 'AMMO4': '0.200', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.646', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '45.000'} [2024-08-06 02:07:25,941][52658] DAMAGECOUNT value on done: 265251.0 [2024-08-06 02:07:25,942][52658] Sum rewards: 61.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.024', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.424', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:26,038][52647] DAMAGECOUNT value on done: 283049.0 [2024-08-06 02:07:26,038][52647] Sum rewards: 63.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'AMMO4': '0.253', 'weapon4': '0.256', 'weapon2': '0.268', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.996', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:26,248][52795] DAMAGECOUNT value on done: 248863.0 [2024-08-06 02:07:26,250][52795] Sum rewards: 68.063, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.480', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.158', 'weapon5': '0.164', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '0.950', 'weapon3': '2.822', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:26,693][52811] DAMAGECOUNT value on done: 249623.0 [2024-08-06 02:07:26,693][52811] Sum rewards: 57.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.210', 'WEAPON4': '0.500', 'weapon2': '0.534', 'weapon4': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.514', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '47.000'} [2024-08-06 02:07:27,167][52671] DAMAGECOUNT value on done: 275274.0 [2024-08-06 02:07:27,167][52671] Sum rewards: 58.813, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.025', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.406', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.728', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '48.000'} [2024-08-06 02:07:27,252][52670] DAMAGECOUNT value on done: 263607.0 [2024-08-06 02:07:27,253][52670] Sum rewards: 65.694, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.698', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.159', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'weapon4': '0.764', 'WEAPON3': '1.050', 'weapon3': '2.334', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 292044800. Throughput: 0: 4389.3. Samples: 73019770. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 02:07:27,794][52567] Avg episode reward: [(0, '65.806')] [2024-08-06 02:07:27,907][52650] Updated weights for policy 0, policy_version 35651 (0.0022) [2024-08-06 02:07:28,045][52666] DAMAGECOUNT value on done: 268538.0 [2024-08-06 02:07:28,045][52666] Sum rewards: 64.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.554', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.161', 'weapon5': '0.172', 'weapon4': '0.218', 'AMMO4': '0.236', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '3.010', 'weapon3': '3.050', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:28,611][52803] DAMAGECOUNT value on done: 248369.0 [2024-08-06 02:07:28,612][52803] Sum rewards: 67.716, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.720', 'AMMO5': '0.023', 'AMMO2': '0.071', 'weapon5': '0.132', 'AMMO3': '0.266', 'weapon2': '0.294', 'WEAPON5': '0.350', 'AMMO4': '0.356', 'weapon4': '0.520', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.748', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:28,798][52647] DAMAGECOUNT value on done: 282886.0 [2024-08-06 02:07:28,799][52647] Sum rewards: 65.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '55.000'} [2024-08-06 02:07:28,890][52658] DAMAGECOUNT value on done: 268787.0 [2024-08-06 02:07:28,891][52658] Sum rewards: 62.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.082', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon5': '0.160', 'AMMO3': '0.189', 'AMMO4': '0.261', 'weapon2': '0.262', 'weapon4': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:29,448][52795] DAMAGECOUNT value on done: 240481.0 [2024-08-06 02:07:29,448][52795] Sum rewards: 58.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.494', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.134', 'weapon2': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.213', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.964', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '48.000'} [2024-08-06 02:07:29,818][52811] DAMAGECOUNT value on done: 257118.0 [2024-08-06 02:07:29,821][52811] Sum rewards: 62.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.998', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.229', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.464', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:30,156][52670] DAMAGECOUNT value on done: 271407.0 [2024-08-06 02:07:30,157][52670] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.768', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO4': '0.153', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '58.000'} [2024-08-06 02:07:30,198][52671] DAMAGECOUNT value on done: 268586.0 [2024-08-06 02:07:30,199][52671] Sum rewards: 59.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.116', 'AMMO4': '0.147', 'weapon2': '0.198', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.406', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '51.000'} [2024-08-06 02:07:30,912][52666] DAMAGECOUNT value on done: 266448.0 [2024-08-06 02:07:30,914][52666] Sum rewards: 75.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.276', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '63.000'} [2024-08-06 02:07:31,387][52647] DAMAGECOUNT value on done: 286368.0 [2024-08-06 02:07:31,394][52647] Sum rewards: 75.428, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.046', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon4': '0.328', 'weapon2': '0.398', 'ARMOR': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.056', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:31,648][52803] DAMAGECOUNT value on done: 246829.0 [2024-08-06 02:07:31,651][52803] Sum rewards: 68.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO4': '0.168', 'weapon4': '0.172', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:31,719][52658] DAMAGECOUNT value on done: 272332.0 [2024-08-06 02:07:31,719][52658] Sum rewards: 69.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon5': '0.068', 'AMMO3': '0.260', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:32,504][52795] DAMAGECOUNT value on done: 256335.0 [2024-08-06 02:07:32,505][52795] Sum rewards: 76.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.280', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '65.000'} [2024-08-06 02:07:32,556][52650] Updated weights for policy 0, policy_version 35661 (0.0023) [2024-08-06 02:07:32,723][52670] DAMAGECOUNT value on done: 267706.0 [2024-08-06 02:07:32,725][52670] Sum rewards: 69.738, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.700', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.178', 'AMMO4': '0.238', 'AMMO3': '0.281', 'weapon2': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.720', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '62.000'} [2024-08-06 02:07:32,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17578.1). Total num frames: 292134912. Throughput: 0: 4391.5. Samples: 73032970. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:07:32,795][52567] Avg episode reward: [(0, '65.927')] [2024-08-06 02:07:32,894][52811] DAMAGECOUNT value on done: 251258.0 [2024-08-06 02:07:32,895][52811] Sum rewards: 56.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.587', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.160', 'weapon4': '0.184', 'AMMO3': '0.208', 'AMMO4': '0.219', 'weapon2': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '3.190', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '47.000'} [2024-08-06 02:07:33,362][52666] DAMAGECOUNT value on done: 266959.0 [2024-08-06 02:07:33,362][52666] Sum rewards: 71.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO3': '0.184', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.398', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '59.500'} [2024-08-06 02:07:33,402][52671] DAMAGECOUNT value on done: 279159.0 [2024-08-06 02:07:33,402][52671] Sum rewards: 72.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.117', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.104', 'AMMO3': '0.117', 'weapon4': '0.142', 'AMMO4': '0.205', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.800', 'weapon2': '0.802', 'weapon3': '2.756', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:34,146][52647] DAMAGECOUNT value on done: 283801.0 [2024-08-06 02:07:34,146][52647] Sum rewards: 55.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.792', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.378', 'weapon4': '0.394', 'WEAPON3': '1.650', 'weapon3': '2.970', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:34,838][52803] DAMAGECOUNT value on done: 250698.0 [2024-08-06 02:07:34,838][52803] Sum rewards: 69.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.104', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.360', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '58.000'} [2024-08-06 02:07:35,178][52670] DAMAGECOUNT value on done: 260835.0 [2024-08-06 02:07:35,178][52670] Sum rewards: 56.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.736', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.516', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.534', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '46.000'} [2024-08-06 02:07:35,587][52795] DAMAGECOUNT value on done: 252056.0 [2024-08-06 02:07:35,587][52795] Sum rewards: 70.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.661', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.132', 'AMMO4': '0.219', 'AMMO3': '0.226', 'weapon5': '0.276', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:36,021][52666] DAMAGECOUNT value on done: 265934.0 [2024-08-06 02:07:36,023][52666] Sum rewards: 78.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.959', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.154', 'AMMO3': '0.163', 'weapon4': '0.164', 'AMMO4': '0.198', 'weapon2': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '64.000'} [2024-08-06 02:07:36,063][52671] DAMAGECOUNT value on done: 268544.0 [2024-08-06 02:07:36,064][52671] Sum rewards: 76.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.591', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.098', 'weapon5': '0.158', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.650', 'weapon3': '2.890', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '64.000'} [2024-08-06 02:07:36,197][52811] DAMAGECOUNT value on done: 252426.0 [2024-08-06 02:07:36,198][52811] Sum rewards: 66.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.074', 'weapon5': '0.136', 'AMMO3': '0.225', 'AMMO4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:36,667][52647] DAMAGECOUNT value on done: 288939.0 [2024-08-06 02:07:36,667][52647] Sum rewards: 64.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.788', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.180', 'weapon2': '0.206', 'AMMO4': '0.209', 'AMMO3': '0.215', 'weapon4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:37,122][52650] Updated weights for policy 0, policy_version 35671 (0.0023) [2024-08-06 02:07:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 292216832. Throughput: 0: 4386.5. Samples: 73059360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:07:37,794][52567] Avg episode reward: [(0, '66.137')] [2024-08-06 02:07:37,857][52670] DAMAGECOUNT value on done: 265263.0 [2024-08-06 02:07:37,858][52670] Sum rewards: 64.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.137', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.157', 'weapon4': '0.192', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.088', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:37,963][52803] DAMAGECOUNT value on done: 246671.0 [2024-08-06 02:07:37,963][52803] Sum rewards: 60.683, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.875', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.056', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.309', 'weapon2': '0.370', 'WEAPON3': '1.800', 'weapon3': '3.258', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:38,621][52666] DAMAGECOUNT value on done: 264069.0 [2024-08-06 02:07:38,621][52666] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.825', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon2': '0.154', 'AMMO4': '0.155', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'weapon4': '0.384', 'WEAPON3': '1.000', 'weapon3': '3.232', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '58.000'} [2024-08-06 02:07:38,654][52671] DAMAGECOUNT value on done: 260999.0 [2024-08-06 02:07:38,655][52671] Sum rewards: 63.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.327', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:38,731][52795] DAMAGECOUNT value on done: 241179.0 [2024-08-06 02:07:38,731][52795] Sum rewards: 65.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.052', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO3': '0.204', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.426', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:39,276][52811] DAMAGECOUNT value on done: 259253.0 [2024-08-06 02:07:39,276][52811] Sum rewards: 68.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.298', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.330', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:39,782][52647] DAMAGECOUNT value on done: 283484.0 [2024-08-06 02:07:39,783][52647] Sum rewards: 71.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'AMMO4': '0.210', 'weapon4': '0.250', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:40,194][52659] DAMAGECOUNT value on done: 271932.0 [2024-08-06 02:07:40,196][52659] Sum rewards: 68.338, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.092', 'weapon4': '0.118', 'AMMO4': '0.215', 'weapon2': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.318', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '60.000'} [2024-08-06 02:07:40,773][52670] DAMAGECOUNT value on done: 264109.0 [2024-08-06 02:07:40,775][52670] Sum rewards: 69.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'AMMO5': '0.007', 'weapon5': '0.042', 'AMMO2': '0.055', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.273', 'weapon2': '0.336', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:41,062][52803] DAMAGECOUNT value on done: 257459.0 [2024-08-06 02:07:41,063][52803] Sum rewards: 66.800, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:41,480][52671] DAMAGECOUNT value on done: 271017.0 [2024-08-06 02:07:41,481][52671] Sum rewards: 60.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.753', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.248', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:41,515][52666] DAMAGECOUNT value on done: 261248.0 [2024-08-06 02:07:41,519][52666] Sum rewards: 66.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.902', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon4': '0.186', 'weapon2': '0.222', 'weapon5': '0.232', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:41,835][52650] Updated weights for policy 0, policy_version 35681 (0.0023) [2024-08-06 02:07:41,846][52795] DAMAGECOUNT value on done: 253700.0 [2024-08-06 02:07:41,847][52795] Sum rewards: 55.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.182', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.462', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '45.000'} [2024-08-06 02:07:42,545][52811] DAMAGECOUNT value on done: 253064.0 [2024-08-06 02:07:42,547][52811] Sum rewards: 68.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.054', 'weapon4': '0.076', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.278', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.396', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:42,603][52647] DAMAGECOUNT value on done: 281819.0 [2024-08-06 02:07:42,603][52647] Sum rewards: 65.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.154', 'AMMO3': '0.166', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.738', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:42,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 292306944. Throughput: 0: 4384.4. Samples: 73085680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:07:42,794][52567] Avg episode reward: [(0, '66.205')] [2024-08-06 02:07:42,929][52659] DAMAGECOUNT value on done: 267947.0 [2024-08-06 02:07:42,930][52659] Sum rewards: 67.001, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.540', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.172', 'AMMO4': '0.176', 'weapon5': '0.204', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:43,860][52670] DAMAGECOUNT value on done: 258763.0 [2024-08-06 02:07:43,862][52670] Sum rewards: 69.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'weapon4': '0.066', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.388', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:44,139][52803] DAMAGECOUNT value on done: 254652.0 [2024-08-06 02:07:44,140][52803] Sum rewards: 73.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.254', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '62.000'} [2024-08-06 02:07:44,338][52671] DAMAGECOUNT value on done: 274218.0 [2024-08-06 02:07:44,338][52671] Sum rewards: 62.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.184', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.138', 'weapon5': '0.188', 'AMMO3': '0.228', 'AMMO4': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.718', 'WEAPON3': '1.300', 'weapon3': '2.660', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:44,543][52666] DAMAGECOUNT value on done: 271237.0 [2024-08-06 02:07:44,543][52666] Sum rewards: 49.360, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.132', 'AMMO4': '0.235', 'weapon4': '0.238', 'weapon5': '0.288', 'weapon2': '0.394', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'HITCOUNT': '2.480', 'weapon3': '2.824', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '39.000'} [2024-08-06 02:07:44,929][52795] DAMAGECOUNT value on done: 253355.0 [2024-08-06 02:07:44,929][52795] Sum rewards: 67.680, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.578', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.088', 'AMMO4': '0.090', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.316', 'WEAPON3': '2.000', 'HITCOUNT': '3.290', 'weapon3': '3.354', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '61.000'} [2024-08-06 02:07:44,939][52820] DAMAGECOUNT value on done: 246549.0 [2024-08-06 02:07:44,942][52820] Sum rewards: 70.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.594', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.209', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:45,321][52647] DAMAGECOUNT value on done: 285936.0 [2024-08-06 02:07:45,322][52647] Sum rewards: 60.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.142', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.364', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.234', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:45,640][52811] DAMAGECOUNT value on done: 252893.0 [2024-08-06 02:07:45,641][52811] Sum rewards: 64.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.362', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '55.000'} [2024-08-06 02:07:45,800][52659] DAMAGECOUNT value on done: 269159.0 [2024-08-06 02:07:45,801][52659] Sum rewards: 72.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.175', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.562', 'WEAPON3': '1.000', 'weapon3': '2.902', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '58.000'} [2024-08-06 02:07:46,636][52650] Updated weights for policy 0, policy_version 35691 (0.0023) [2024-08-06 02:07:46,744][52671] DAMAGECOUNT value on done: 276690.0 [2024-08-06 02:07:46,746][52671] Sum rewards: 59.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.443', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.128', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '50.000'} [2024-08-06 02:07:46,787][52670] DAMAGECOUNT value on done: 271443.0 [2024-08-06 02:07:46,788][52670] Sum rewards: 65.575, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.024', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.140', 'AMMO3': '0.154', 'weapon4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '0.900', 'HITCOUNT': '2.850', 'weapon3': '3.072', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:47,135][52803] DAMAGECOUNT value on done: 250579.0 [2024-08-06 02:07:47,145][52803] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.203', 'HEALTH': '0.682', 'weapon2': '0.714', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:47,670][52666] DAMAGECOUNT value on done: 269957.0 [2024-08-06 02:07:47,672][52666] Sum rewards: 72.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.740', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.084', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '62.000'} [2024-08-06 02:07:47,778][52811] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:07:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 292397056. Throughput: 0: 4391.1. Samples: 73098870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:07:47,795][52567] Avg episode reward: [(0, '65.967')] [2024-08-06 02:07:48,119][52820] DAMAGECOUNT value on done: 250262.0 [2024-08-06 02:07:48,122][52820] Sum rewards: 69.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.591', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '57.000'} [2024-08-06 02:07:48,468][52647] DAMAGECOUNT value on done: 280436.0 [2024-08-06 02:07:48,469][52647] Sum rewards: 60.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO4': '0.165', 'AMMO3': '0.190', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '51.000'} [2024-08-06 02:07:48,583][52659] DAMAGECOUNT value on done: 268507.0 [2024-08-06 02:07:48,583][52659] Sum rewards: 65.472, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.752', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.036', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.258', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.544', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:48,794][52811] DAMAGECOUNT value on done: 256431.0 [2024-08-06 02:07:48,794][52811] Sum rewards: 62.294, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.565', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.152', 'weapon4': '0.224', 'AMMO4': '0.243', 'AMMO3': '0.263', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.550', 'weapon3': '2.838', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:48,922][52663] DAMAGECOUNT value on done: 273540.0 [2024-08-06 02:07:48,922][52663] Sum rewards: 62.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.845', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.200', 'weapon4': '0.258', 'weapon5': '0.320', 'AMMO4': '0.321', 'weapon2': '0.332', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:49,904][52671] DAMAGECOUNT value on done: 272318.0 [2024-08-06 02:07:49,905][52671] Sum rewards: 69.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.825', 'AMMO5': '0.008', 'AMMO2': '0.059', 'weapon5': '0.076', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.293', 'weapon4': '0.410', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '61.000'} [2024-08-06 02:07:50,017][52670] DAMAGECOUNT value on done: 267303.0 [2024-08-06 02:07:50,017][52670] Sum rewards: 73.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.181', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.134', 'weapon5': '0.146', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:50,233][52803] DAMAGECOUNT value on done: 255595.0 [2024-08-06 02:07:50,236][52803] Sum rewards: 64.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.136', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.374', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '55.000'} [2024-08-06 02:07:50,782][52666] DAMAGECOUNT value on done: 266276.0 [2024-08-06 02:07:50,784][52666] Sum rewards: 59.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.250', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.134', 'AMMO3': '0.183', 'AMMO4': '0.235', 'weapon2': '0.244', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2024-08-06 02:07:51,060][52647] DAMAGECOUNT value on done: 284761.0 [2024-08-06 02:07:51,060][52647] Sum rewards: 64.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.914', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO3': '0.137', 'AMMO4': '0.143', 'weapon5': '0.160', 'weapon4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '0.850', 'weapon3': '2.934', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:51,137][52820] DAMAGECOUNT value on done: 247787.0 [2024-08-06 02:07:51,141][52820] Sum rewards: 63.631, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.746', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.258', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.492', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:51,372][52659] DAMAGECOUNT value on done: 265561.0 [2024-08-06 02:07:51,374][52659] Sum rewards: 62.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.326', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.169', 'weapon5': '0.180', 'AMMO4': '0.230', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.580', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '51.000'} [2024-08-06 02:07:51,471][52650] Updated weights for policy 0, policy_version 35701 (0.0023) [2024-08-06 02:07:51,773][52663] DAMAGECOUNT value on done: 270886.0 [2024-08-06 02:07:51,773][52663] Sum rewards: 77.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.520', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.206', 'weapon5': '0.294', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.532', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '63.000'} [2024-08-06 02:07:52,104][52811] DAMAGECOUNT value on done: 251004.0 [2024-08-06 02:07:52,104][52811] Sum rewards: 69.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.102', 'AMMO4': '0.165', 'AMMO3': '0.198', 'weapon4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:52,791][52670] DAMAGECOUNT value on done: 267275.0 [2024-08-06 02:07:52,791][52670] Sum rewards: 67.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.008', 'AMMO2': '0.056', 'weapon5': '0.122', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.242', 'AMMO4': '0.279', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.806', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '58.000'} [2024-08-06 02:07:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 292487168. Throughput: 0: 4386.2. Samples: 73125250. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:07:52,794][52567] Avg episode reward: [(0, '65.738')] [2024-08-06 02:07:52,813][52671] DAMAGECOUNT value on done: 268089.0 [2024-08-06 02:07:52,815][52671] Sum rewards: 64.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.755', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.086', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:53,296][52803] DAMAGECOUNT value on done: 252663.0 [2024-08-06 02:07:53,299][52803] Sum rewards: 60.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.096', 'AMMO4': '0.217', 'AMMO3': '0.219', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '2.790', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:53,469][52666] DAMAGECOUNT value on done: 265436.0 [2024-08-06 02:07:53,470][52666] Sum rewards: 78.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.886', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '64.000'} [2024-08-06 02:07:54,205][52820] DAMAGECOUNT value on done: 242141.0 [2024-08-06 02:07:54,207][52820] Sum rewards: 68.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.094', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.636', 'WEAPON3': '1.600', 'weapon3': '2.640', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 02:07:54,231][52647] DAMAGECOUNT value on done: 278096.0 [2024-08-06 02:07:54,231][52647] Sum rewards: 66.139, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.755', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.150', 'weapon4': '0.178', 'AMMO4': '0.186', 'weapon5': '0.278', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:54,382][52659] DAMAGECOUNT value on done: 267865.0 [2024-08-06 02:07:54,382][52659] Sum rewards: 67.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.206', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:54,857][52663] DAMAGECOUNT value on done: 265547.0 [2024-08-06 02:07:54,858][52663] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.688', 'AMMO5': '0.009', 'weapon4': '0.044', 'AMMO2': '0.047', 'weapon5': '0.130', 'AMMO3': '0.189', 'AMMO4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:55,179][52811] DAMAGECOUNT value on done: 256849.0 [2024-08-06 02:07:55,180][52811] Sum rewards: 64.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.424', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.106', 'weapon5': '0.148', 'AMMO4': '0.154', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:55,598][52670] DAMAGECOUNT value on done: 271538.0 [2024-08-06 02:07:55,600][52670] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.173', 'weapon4': '0.190', 'AMMO4': '0.244', 'weapon5': '0.248', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '2.950', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '54.000'} [2024-08-06 02:07:55,976][52650] Updated weights for policy 0, policy_version 35711 (0.0027) [2024-08-06 02:07:56,395][52803] DAMAGECOUNT value on done: 250083.0 [2024-08-06 02:07:56,395][52803] Sum rewards: 72.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.867', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.096', 'weapon4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.256', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.370', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '61.000'} [2024-08-06 02:07:56,438][52666] DAMAGECOUNT value on done: 265017.0 [2024-08-06 02:07:56,439][52666] Sum rewards: 81.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.355', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.147', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '66.000'} [2024-08-06 02:07:57,344][52647] DAMAGECOUNT value on done: 281802.0 [2024-08-06 02:07:57,344][52647] Sum rewards: 57.732, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.490', 'AMMO5': '0.021', 'AMMO2': '0.073', 'AMMO3': '0.223', 'weapon5': '0.226', 'AMMO4': '0.366', 'weapon4': '0.408', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.626', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '52.000'} [2024-08-06 02:07:57,466][52820] DAMAGECOUNT value on done: 249716.0 [2024-08-06 02:07:57,466][52820] Sum rewards: 53.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.595', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.221', 'weapon2': '0.236', 'weapon4': '0.242', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.620', 'weapon3': '3.206', 'DAMAGECOUNT': '13.773', 'FRAGCOUNT': '47.000'} [2024-08-06 02:07:57,522][52663] DAMAGECOUNT value on done: 270213.0 [2024-08-06 02:07:57,526][52663] Sum rewards: 78.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.298', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.136', 'AMMO3': '0.242', 'weapon2': '0.252', 'weapon5': '0.260', 'AMMO4': '0.267', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '66.000'} [2024-08-06 02:07:57,623][52659] DAMAGECOUNT value on done: 271087.0 [2024-08-06 02:07:57,626][52659] Sum rewards: 78.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.270', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.038', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '3.120', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '62.000'} [2024-08-06 02:07:57,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 292569088. Throughput: 0: 4386.8. Samples: 73151210. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 02:07:57,795][52567] Avg episode reward: [(0, '66.287')] [2024-08-06 02:07:58,257][52811] DAMAGECOUNT value on done: 252467.0 [2024-08-06 02:07:58,257][52811] Sum rewards: 65.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.427', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.068', 'AMMO4': '0.167', 'weapon5': '0.190', 'AMMO3': '0.236', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.166', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '56.000'} [2024-08-06 02:07:58,850][52670] DAMAGECOUNT value on done: 268967.0 [2024-08-06 02:07:58,851][52670] Sum rewards: 60.689, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.090', 'weapon5': '0.094', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.406', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '53.000'} [2024-08-06 02:07:59,504][52803] DAMAGECOUNT value on done: 257013.0 [2024-08-06 02:07:59,505][52803] Sum rewards: 60.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.058', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.164', 'weapon2': '0.196', 'AMMO3': '0.232', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.254', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '51.000'} [2024-08-06 02:07:59,513][52666] DAMAGECOUNT value on done: 271273.0 [2024-08-06 02:07:59,513][52666] Sum rewards: 65.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.916', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.152', 'weapon5': '0.156', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:00,294][52647] DAMAGECOUNT value on done: 281009.0 [2024-08-06 02:08:00,297][52647] Sum rewards: 58.432, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.567', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.166', 'weapon4': '0.198', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.650', 'weapon3': '2.792', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '53.000'} [2024-08-06 02:08:00,331][52659] DAMAGECOUNT value on done: 265884.0 [2024-08-06 02:08:00,332][52659] Sum rewards: 64.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.428', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.142', 'weapon5': '0.176', 'AMMO3': '0.232', 'AMMO4': '0.246', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:00,593][52663] DAMAGECOUNT value on done: 270241.0 [2024-08-06 02:08:00,594][52663] Sum rewards: 70.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.964', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '59.000'} [2024-08-06 02:08:00,690][52820] DAMAGECOUNT value on done: 246815.0 [2024-08-06 02:08:00,693][52820] Sum rewards: 57.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.999', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.176', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'weapon4': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.974', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '46.500'} [2024-08-06 02:08:00,740][52650] Updated weights for policy 0, policy_version 35721 (0.0015) [2024-08-06 02:08:01,228][52811] DAMAGECOUNT value on done: 246921.0 [2024-08-06 02:08:01,229][52811] Sum rewards: 67.396, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.090', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.158', 'weapon4': '0.184', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '61.000'} [2024-08-06 02:08:01,307][52670] DAMAGECOUNT value on done: 255308.0 [2024-08-06 02:08:01,308][52670] Sum rewards: 44.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.735', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.106', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.534', 'WEAPON3': '1.250', 'HITCOUNT': '2.420', 'weapon3': '3.044', 'DAMAGECOUNT': '11.622', 'FRAGCOUNT': '40.000'} [2024-08-06 02:08:01,957][52664] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:08:02,093][52666] DAMAGECOUNT value on done: 260892.0 [2024-08-06 02:08:02,093][52666] Sum rewards: 61.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.206', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.590', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '52.000'} [2024-08-06 02:08:02,573][52803] DAMAGECOUNT value on done: 249250.0 [2024-08-06 02:08:02,575][52803] Sum rewards: 61.037, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.560', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon5': '0.166', 'AMMO4': '0.177', 'weapon4': '0.208', 'AMMO3': '0.276', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.006', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 02:08:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 292659200. Throughput: 0: 4384.9. Samples: 73164390. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 02:08:02,794][52567] Avg episode reward: [(0, '66.029')] [2024-08-06 02:08:02,896][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:08:03,185][52647] DAMAGECOUNT value on done: 288809.0 [2024-08-06 02:08:03,186][52647] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.088', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.235', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '2.982', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '65.000'} [2024-08-06 02:08:03,389][52663] DAMAGECOUNT value on done: 274050.0 [2024-08-06 02:08:03,389][52663] Sum rewards: 54.296, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.722', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.226', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.650', 'weapon3': '2.808', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '44.000'} [2024-08-06 02:08:03,818][52659] DAMAGECOUNT value on done: 275110.0 [2024-08-06 02:08:03,821][52659] Sum rewards: 57.369, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.095', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.152', 'weapon5': '0.238', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'weapon4': '0.424', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.612', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '46.000'} [2024-08-06 02:08:03,852][52820] DAMAGECOUNT value on done: 249539.0 [2024-08-06 02:08:03,854][52820] Sum rewards: 59.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.592', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.352', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '3.120', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '48.000'} [2024-08-06 02:08:04,307][52670] DAMAGECOUNT value on done: 269616.0 [2024-08-06 02:08:04,307][52670] Sum rewards: 61.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.865', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.264', 'weapon4': '0.398', 'WEAPON3': '1.650', 'weapon3': '3.052', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '55.000'} [2024-08-06 02:08:04,435][52811] DAMAGECOUNT value on done: 251901.0 [2024-08-06 02:08:04,435][52811] Sum rewards: 59.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.338', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon4': '0.178', 'AMMO3': '0.217', 'weapon2': '0.244', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.288', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '49.000'} [2024-08-06 02:08:04,879][52666] DAMAGECOUNT value on done: 268029.0 [2024-08-06 02:08:04,880][52666] Sum rewards: 64.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.296', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO3': '0.149', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '3.240', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '51.000'} [2024-08-06 02:08:05,322][52650] Updated weights for policy 0, policy_version 35731 (0.0022) [2024-08-06 02:08:05,601][52803] DAMAGECOUNT value on done: 255591.0 [2024-08-06 02:08:05,601][52803] Sum rewards: 59.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.152', 'AMMO3': '0.227', 'weapon2': '0.250', 'AMMO4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.644', 'WEAPON3': '1.350', 'weapon3': '2.666', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '51.000'} [2024-08-06 02:08:06,255][52647] DAMAGECOUNT value on done: 281915.0 [2024-08-06 02:08:06,256][52647] Sum rewards: 74.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.529', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.496', 'weapon2': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.636', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '61.000'} [2024-08-06 02:08:06,408][52663] DAMAGECOUNT value on done: 271035.0 [2024-08-06 02:08:06,409][52663] Sum rewards: 76.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.695', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon2': '0.218', 'AMMO3': '0.246', 'WEAPON3': '1.550', 'weapon3': '3.434', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '66.000'} [2024-08-06 02:08:06,903][52659] DAMAGECOUNT value on done: 275320.0 [2024-08-06 02:08:06,903][52659] Sum rewards: 67.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.119', 'weapon5': '0.140', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.258', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2024-08-06 02:08:06,920][52820] DAMAGECOUNT value on done: 252611.0 [2024-08-06 02:08:06,922][52820] Sum rewards: 65.597, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.158', 'weapon2': '0.660', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:06,997][52670] DAMAGECOUNT value on done: 276174.0 [2024-08-06 02:08:06,999][52670] Sum rewards: 63.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.764', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.150', 'AMMO3': '0.247', 'AMMO4': '0.248', 'weapon4': '0.252', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:07,558][52811] DAMAGECOUNT value on done: 255453.0 [2024-08-06 02:08:07,559][52811] Sum rewards: 64.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.142', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.412', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:07,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 292741120. Throughput: 0: 4379.6. Samples: 73190520. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 02:08:07,794][52567] Avg episode reward: [(0, '65.953')] [2024-08-06 02:08:08,619][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:08:08,736][52647] DAMAGECOUNT value on done: 281494.0 [2024-08-06 02:08:08,737][52647] Sum rewards: 67.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.944', 'AMMO5': '0.011', 'AMMO2': '0.043', 'AMMO3': '0.151', 'weapon4': '0.166', 'AMMO4': '0.216', 'weapon5': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '2.966', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '53.000'} [2024-08-06 02:08:08,789][52803] DAMAGECOUNT value on done: 247805.0 [2024-08-06 02:08:08,789][52803] Sum rewards: 55.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.129', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.994', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '47.000'} [2024-08-06 02:08:09,491][52670] DAMAGECOUNT value on done: 268082.0 [2024-08-06 02:08:09,499][52670] Sum rewards: 56.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.760', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon5': '0.192', 'AMMO3': '0.247', 'weapon4': '0.252', 'AMMO4': '0.312', 'weapon2': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.660', 'weapon3': '2.892', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '51.000'} [2024-08-06 02:08:09,557][52659] DAMAGECOUNT value on done: 270817.0 [2024-08-06 02:08:09,558][52659] Sum rewards: 74.624, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon4': '0.216', 'weapon2': '0.262', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '59.000'} [2024-08-06 02:08:09,569][52663] DAMAGECOUNT value on done: 267607.0 [2024-08-06 02:08:09,570][52663] Sum rewards: 60.471, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.052', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.246', 'AMMO3': '0.293', 'WEAPON3': '1.700', 'HITCOUNT': '3.160', 'weapon3': '3.434', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:09,869][52820] DAMAGECOUNT value on done: 250022.0 [2024-08-06 02:08:09,869][52820] Sum rewards: 75.316, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.401', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.144', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'weapon4': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '59.000'} [2024-08-06 02:08:10,187][52650] Updated weights for policy 0, policy_version 35741 (0.0024) [2024-08-06 02:08:10,335][52614] Signal inference workers to stop experience collection... (6450 times) [2024-08-06 02:08:10,337][52614] Signal inference workers to resume experience collection... (6450 times) [2024-08-06 02:08:10,420][52650] InferenceWorker_p0-w0: stopping experience collection (6450 times) [2024-08-06 02:08:10,421][52650] InferenceWorker_p0-w0: resuming experience collection (6450 times) [2024-08-06 02:08:10,663][52811] DAMAGECOUNT value on done: 249773.0 [2024-08-06 02:08:10,666][52811] Sum rewards: 71.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.615', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.122', 'AMMO4': '0.204', 'AMMO3': '0.245', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.612', 'WEAPON3': '1.500', 'weapon3': '2.676', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '63.000'} [2024-08-06 02:08:11,135][52647] DAMAGECOUNT value on done: 280612.0 [2024-08-06 02:08:11,136][52647] Sum rewards: 66.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.462', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.129', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '55.000'} [2024-08-06 02:08:11,720][52666] Large shaping reward -2.509 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.03, 10.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:08:12,388][52659] DAMAGECOUNT value on done: 269142.0 [2024-08-06 02:08:12,390][52659] Sum rewards: 62.055, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.128', 'weapon4': '0.190', 'AMMO4': '0.201', 'AMMO3': '0.229', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.094', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:12,429][52670] DAMAGECOUNT value on done: 269741.0 [2024-08-06 02:08:12,429][52670] Sum rewards: 74.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.672', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.160', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.788', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '59.500'} [2024-08-06 02:08:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 292831232. Throughput: 0: 4376.9. Samples: 73216730. Policy #0 lag: (min: 1.0, avg: 4.2, max: 7.0) [2024-08-06 02:08:12,794][52567] Avg episode reward: [(0, '65.935')] [2024-08-06 02:08:12,816][52663] DAMAGECOUNT value on done: 268653.0 [2024-08-06 02:08:12,816][52663] Sum rewards: 65.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.122', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.240', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '55.000'} [2024-08-06 02:08:13,051][52820] DAMAGECOUNT value on done: 250994.0 [2024-08-06 02:08:13,053][52820] Sum rewards: 66.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.171', 'weapon4': '0.192', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:13,630][52647] DAMAGECOUNT value on done: 273896.0 [2024-08-06 02:08:13,632][52647] Sum rewards: 49.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.110', 'AMMO4': '0.190', 'AMMO3': '0.216', 'weapon2': '0.318', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.590', 'weapon3': '2.962', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '43.000'} [2024-08-06 02:08:13,708][52811] DAMAGECOUNT value on done: 257678.0 [2024-08-06 02:08:13,709][52811] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.875', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.262', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '3.130', 'weapon3': '3.146', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '56.000'} [2024-08-06 02:08:15,010][52650] Updated weights for policy 0, policy_version 35751 (0.0024) [2024-08-06 02:08:15,224][52659] DAMAGECOUNT value on done: 264479.0 [2024-08-06 02:08:15,225][52659] Sum rewards: 62.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.039', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO4': '0.195', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '53.000'} [2024-08-06 02:08:15,689][52663] DAMAGECOUNT value on done: 271681.0 [2024-08-06 02:08:15,691][52663] Sum rewards: 71.669, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'weapon5': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.646', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '56.000'} [2024-08-06 02:08:16,010][52647] DAMAGECOUNT value on done: 283257.0 [2024-08-06 02:08:16,011][52647] Sum rewards: 62.811, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO2': '0.040', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.270', 'AMMO3': '0.311', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '58.000'} [2024-08-06 02:08:16,204][52820] DAMAGECOUNT value on done: 252542.0 [2024-08-06 02:08:16,204][52820] Sum rewards: 57.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.735', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.233', 'weapon2': '0.312', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.416', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '49.000'} [2024-08-06 02:08:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 292913152. Throughput: 0: 4375.4. Samples: 73229860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:08:17,794][52567] Avg episode reward: [(0, '65.404')] [2024-08-06 02:08:18,277][52659] DAMAGECOUNT value on done: 268360.0 [2024-08-06 02:08:18,278][52659] Sum rewards: 62.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon2': '0.182', 'AMMO4': '0.189', 'weapon5': '0.212', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '52.000'} [2024-08-06 02:08:18,814][52663] DAMAGECOUNT value on done: 273489.0 [2024-08-06 02:08:18,815][52663] Sum rewards: 62.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'weapon4': '0.034', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.414', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.130', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:19,230][52820] DAMAGECOUNT value on done: 254340.0 [2024-08-06 02:08:19,230][52820] Sum rewards: 67.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.140', 'weapon4': '0.160', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:19,486][52650] Updated weights for policy 0, policy_version 35761 (0.0011) [2024-08-06 02:08:21,320][52659] DAMAGECOUNT value on done: 274091.0 [2024-08-06 02:08:21,320][52659] Sum rewards: 71.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.104', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.246', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '61.000'} [2024-08-06 02:08:21,585][52663] DAMAGECOUNT value on done: 268803.0 [2024-08-06 02:08:21,586][52663] Sum rewards: 79.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.142', 'weapon2': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '67.000'} [2024-08-06 02:08:22,428][52820] DAMAGECOUNT value on done: 252469.0 [2024-08-06 02:08:22,429][52820] Sum rewards: 75.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.788', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'AMMO4': '0.170', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '62.000'} [2024-08-06 02:08:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 293011456. Throughput: 0: 4378.7. Samples: 73256400. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:08:22,794][52567] Avg episode reward: [(0, '65.515')] [2024-08-06 02:08:22,862][52649] DAMAGECOUNT value on done: 261291.0 [2024-08-06 02:08:22,864][52649] Sum rewards: 64.287, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.178', 'weapon2': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.962', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:23,794][52650] Updated weights for policy 0, policy_version 35771 (0.0030) [2024-08-06 02:08:23,873][52659] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:08:24,358][52663] DAMAGECOUNT value on done: 261673.0 [2024-08-06 02:08:24,358][52663] Sum rewards: 55.677, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.090', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.066', 'weapon4': '0.112', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.874', 'WEAPON3': '1.100', 'weapon3': '2.828', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '44.000'} [2024-08-06 02:08:24,490][52659] DAMAGECOUNT value on done: 277881.0 [2024-08-06 02:08:24,492][52659] Sum rewards: 66.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.006', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon5': '0.228', 'AMMO3': '0.229', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '55.500'} [2024-08-06 02:08:25,501][52820] DAMAGECOUNT value on done: 252337.0 [2024-08-06 02:08:25,501][52820] Sum rewards: 72.680, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.225', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO4': '0.215', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.450', 'weapon4': '0.452', 'WEAPON3': '1.500', 'weapon3': '2.738', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '63.000'} [2024-08-06 02:08:26,017][52649] DAMAGECOUNT value on done: 255961.0 [2024-08-06 02:08:26,018][52649] Sum rewards: 67.651, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.380', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.140', 'AMMO4': '0.140', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.302', 'WEAPON3': '0.850', 'weapon3': '2.982', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '53.000'} [2024-08-06 02:08:27,252][52663] DAMAGECOUNT value on done: 263976.0 [2024-08-06 02:08:27,255][52663] Sum rewards: 64.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.356', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '53.000'} [2024-08-06 02:08:27,543][52659] DAMAGECOUNT value on done: 275218.0 [2024-08-06 02:08:27,543][52659] Sum rewards: 73.033, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.122', 'weapon4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 02:08:27,795][52567] Fps is (10 sec: 18021.5, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 293093376. Throughput: 0: 4389.1. Samples: 73283190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:08:27,795][52567] Avg episode reward: [(0, '65.661')] [2024-08-06 02:08:27,858][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035779_293101568.pth... [2024-08-06 02:08:27,999][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035265_288890880.pth [2024-08-06 02:08:28,726][52650] Updated weights for policy 0, policy_version 35781 (0.0030) [2024-08-06 02:08:28,918][52665] DAMAGECOUNT value on done: 265525.0 [2024-08-06 02:08:28,919][52665] Sum rewards: 57.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.723', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.132', 'AMMO4': '0.134', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.202', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '48.000'} [2024-08-06 02:08:28,935][52820] DAMAGECOUNT value on done: 253215.0 [2024-08-06 02:08:28,937][52820] Sum rewards: 73.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.300', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon2': '0.160', 'weapon4': '0.162', 'AMMO4': '0.169', 'weapon5': '0.182', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '59.000'} [2024-08-06 02:08:29,211][52649] DAMAGECOUNT value on done: 264144.0 [2024-08-06 02:08:29,211][52649] Sum rewards: 62.037, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.487', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.300', 'weapon2': '0.420', 'weapon4': '0.420', 'WEAPON3': '0.900', 'weapon3': '2.904', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '50.000'} [2024-08-06 02:08:29,626][52663] DAMAGECOUNT value on done: 269265.0 [2024-08-06 02:08:29,627][52663] Sum rewards: 74.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.112', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '63.000'} [2024-08-06 02:08:30,515][52659] DAMAGECOUNT value on done: 270008.0 [2024-08-06 02:08:30,516][52659] Sum rewards: 69.143, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.499', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.080', 'weapon5': '0.102', 'AMMO4': '0.116', 'weapon2': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.536', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '56.000'} [2024-08-06 02:08:31,615][52665] DAMAGECOUNT value on done: 271802.0 [2024-08-06 02:08:31,616][52665] Sum rewards: 62.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.015', 'AMMO2': '0.064', 'weapon4': '0.088', 'weapon5': '0.122', 'AMMO3': '0.209', 'AMMO4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:31,843][52649] DAMAGECOUNT value on done: 265685.0 [2024-08-06 02:08:31,844][52649] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.689', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.048', 'AMMO4': '0.146', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon5': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2024-08-06 02:08:32,058][52820] DAMAGECOUNT value on done: 252242.0 [2024-08-06 02:08:32,060][52820] Sum rewards: 50.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.142', 'AMMO4': '0.172', 'AMMO3': '0.265', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.268', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '43.000'} [2024-08-06 02:08:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17550.9). Total num frames: 293183488. Throughput: 0: 4379.6. Samples: 73295950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:08:32,794][52567] Avg episode reward: [(0, '65.689')] [2024-08-06 02:08:32,964][52659] DAMAGECOUNT value on done: 273728.0 [2024-08-06 02:08:32,966][52659] Sum rewards: 67.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.024', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.108', 'weapon2': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.518', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:33,063][52663] DAMAGECOUNT value on done: 272423.0 [2024-08-06 02:08:33,071][52663] Sum rewards: 66.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.092', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.336', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '56.000'} [2024-08-06 02:08:33,424][52650] Updated weights for policy 0, policy_version 35791 (0.0019) [2024-08-06 02:08:33,914][52665] DAMAGECOUNT value on done: 267643.0 [2024-08-06 02:08:33,914][52665] Sum rewards: 72.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.181', 'weapon2': '0.340', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '60.000'} [2024-08-06 02:08:34,120][52649] DAMAGECOUNT value on done: 256690.0 [2024-08-06 02:08:34,120][52649] Sum rewards: 63.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon5': '0.068', 'weapon4': '0.174', 'AMMO3': '0.184', 'AMMO4': '0.246', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.518', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '53.000'} [2024-08-06 02:08:35,290][52820] DAMAGECOUNT value on done: 246305.0 [2024-08-06 02:08:35,290][52820] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.117', 'weapon4': '0.162', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '58.000'} [2024-08-06 02:08:35,332][52659] DAMAGECOUNT value on done: 274908.0 [2024-08-06 02:08:35,334][52659] Sum rewards: 58.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.192', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.194', 'weapon5': '0.196', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '49.000'} [2024-08-06 02:08:35,916][52663] DAMAGECOUNT value on done: 272540.0 [2024-08-06 02:08:35,917][52663] Sum rewards: 60.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.808', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.418', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.254', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '49.500'} [2024-08-06 02:08:36,864][52668] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:08:37,091][52665] DAMAGECOUNT value on done: 265339.0 [2024-08-06 02:08:37,093][52665] Sum rewards: 55.750, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.169', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.220', 'weapon5': '0.264', 'AMMO4': '0.269', 'weapon4': '0.362', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.590', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '49.000'} [2024-08-06 02:08:37,443][52649] DAMAGECOUNT value on done: 265681.0 [2024-08-06 02:08:37,444][52649] Sum rewards: 63.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.070', 'AMMO4': '0.142', 'weapon5': '0.188', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.104', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:37,716][52650] Updated weights for policy 0, policy_version 35801 (0.0010) [2024-08-06 02:08:37,794][52567] Fps is (10 sec: 18842.6, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 293281792. Throughput: 0: 4382.4. Samples: 73322460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:08:37,794][52567] Avg episode reward: [(0, '65.498')] [2024-08-06 02:08:38,409][52820] DAMAGECOUNT value on done: 257774.0 [2024-08-06 02:08:38,417][52820] Sum rewards: 69.679, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.086', 'AMMO4': '0.103', 'weapon5': '0.146', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.206', 'weapon2': '0.302', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.188', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:38,791][52663] DAMAGECOUNT value on done: 276790.0 [2024-08-06 02:08:38,791][52663] Sum rewards: 61.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.982', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.188', 'weapon5': '0.198', 'weapon4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.108', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '50.000'} [2024-08-06 02:08:40,345][52665] DAMAGECOUNT value on done: 260777.0 [2024-08-06 02:08:40,346][52665] Sum rewards: 64.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.295', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.197', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '52.000'} [2024-08-06 02:08:40,573][52649] DAMAGECOUNT value on done: 261576.0 [2024-08-06 02:08:40,573][52649] Sum rewards: 69.031, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.203', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.648', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.000'} [2024-08-06 02:08:41,285][52663] DAMAGECOUNT value on done: 273609.0 [2024-08-06 02:08:41,285][52663] Sum rewards: 71.753, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.525', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.168', 'AMMO4': '0.181', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '62.000'} [2024-08-06 02:08:41,624][52820] DAMAGECOUNT value on done: 260936.0 [2024-08-06 02:08:41,624][52820] Sum rewards: 68.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'AMMO3': '0.225', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:42,711][52664] DAMAGECOUNT value on done: 280796.0 [2024-08-06 02:08:42,712][52664] Sum rewards: 65.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.226', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:42,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 293363712. Throughput: 0: 4389.6. Samples: 73348740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:08:42,795][52567] Avg episode reward: [(0, '65.619')] [2024-08-06 02:08:42,801][52650] Updated weights for policy 0, policy_version 35811 (0.0013) [2024-08-06 02:08:42,929][52666] Large shaping reward 2.537 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('HEALTH', -0.054, -18.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:08:43,611][52665] DAMAGECOUNT value on done: 261168.0 [2024-08-06 02:08:43,612][52665] Sum rewards: 69.166, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.230', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.140', 'weapon2': '0.156', 'AMMO4': '0.222', 'weapon5': '0.228', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '59.000'} [2024-08-06 02:08:43,783][52649] DAMAGECOUNT value on done: 269301.0 [2024-08-06 02:08:43,783][52649] Sum rewards: 71.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '3.260', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '59.000'} [2024-08-06 02:08:44,134][52663] DAMAGECOUNT value on done: 266699.0 [2024-08-06 02:08:44,135][52663] Sum rewards: 56.873, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.316', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '50.000'} [2024-08-06 02:08:44,758][52820] DAMAGECOUNT value on done: 248033.0 [2024-08-06 02:08:44,759][52820] Sum rewards: 69.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.050', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:45,660][52664] DAMAGECOUNT value on done: 281970.0 [2024-08-06 02:08:45,663][52664] Sum rewards: 66.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.498', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon5': '0.228', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.048', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:46,420][52665] DAMAGECOUNT value on done: 270523.0 [2024-08-06 02:08:46,422][52665] Sum rewards: 55.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon4': '0.386', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '46.000'} [2024-08-06 02:08:46,672][52649] DAMAGECOUNT value on done: 264375.0 [2024-08-06 02:08:46,674][52649] Sum rewards: 62.558, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.272', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '55.000'} [2024-08-06 02:08:47,504][52650] Updated weights for policy 0, policy_version 35821 (0.0040) [2024-08-06 02:08:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 293453824. Throughput: 0: 4389.3. Samples: 73361910. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:08:47,794][52567] Avg episode reward: [(0, '65.328')] [2024-08-06 02:08:48,108][52664] DAMAGECOUNT value on done: 282394.0 [2024-08-06 02:08:48,108][52664] Sum rewards: 72.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.823', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.436', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 02:08:49,376][52665] DAMAGECOUNT value on done: 269304.0 [2024-08-06 02:08:49,376][52665] Sum rewards: 64.550, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.637', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.140', 'AMMO3': '0.196', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.364', 'weapon4': '0.380', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '56.000'} [2024-08-06 02:08:49,665][52649] DAMAGECOUNT value on done: 264530.0 [2024-08-06 02:08:49,666][52649] Sum rewards: 68.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.841', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.046', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '58.000'} [2024-08-06 02:08:50,874][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:08:51,065][52664] DAMAGECOUNT value on done: 279910.0 [2024-08-06 02:08:51,065][52664] Sum rewards: 67.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.620', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.082', 'weapon4': '0.104', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '56.000'} [2024-08-06 02:08:52,376][52650] Updated weights for policy 0, policy_version 35831 (0.0012) [2024-08-06 02:08:52,467][52665] DAMAGECOUNT value on done: 271478.0 [2024-08-06 02:08:52,467][52665] Sum rewards: 58.992, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.890', 'AMMO5': '0.012', 'weapon5': '0.054', 'AMMO2': '0.073', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'AMMO4': '0.366', 'weapon4': '0.396', 'weapon2': '0.464', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.796', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '52.000'} [2024-08-06 02:08:52,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 293535744. Throughput: 0: 4394.0. Samples: 73388250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:08:52,795][52567] Avg episode reward: [(0, '65.306')] [2024-08-06 02:08:52,806][52649] DAMAGECOUNT value on done: 265652.0 [2024-08-06 02:08:52,806][52649] Sum rewards: 53.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.122', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.203', 'weapon5': '0.236', 'weapon2': '0.256', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '2.902', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '45.000'} [2024-08-06 02:08:54,115][52664] DAMAGECOUNT value on done: 282136.0 [2024-08-06 02:08:54,115][52664] Sum rewards: 67.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.462', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.222', 'AMMO3': '0.227', 'AMMO4': '0.268', 'weapon2': '0.330', 'weapon5': '0.344', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:55,012][52665] DAMAGECOUNT value on done: 267026.0 [2024-08-06 02:08:55,013][52665] Sum rewards: 52.063, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.908', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.188', 'weapon5': '0.204', 'AMMO4': '0.299', 'weapon4': '0.324', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon2': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.462', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '48.000'} [2024-08-06 02:08:55,259][52649] DAMAGECOUNT value on done: 264915.0 [2024-08-06 02:08:55,259][52649] Sum rewards: 66.868, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.156', 'weapon2': '0.690', 'WEAPON3': '1.000', 'HITCOUNT': '3.000', 'weapon3': '3.066', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '54.000'} [2024-08-06 02:08:56,617][52650] Updated weights for policy 0, policy_version 35841 (0.0034) [2024-08-06 02:08:56,961][52664] DAMAGECOUNT value on done: 281019.0 [2024-08-06 02:08:56,961][52664] Sum rewards: 60.597, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.630', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.066', 'weapon5': '0.120', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.299', 'weapon2': '0.308', 'WEAPON3': '1.850', 'HITCOUNT': '3.160', 'weapon3': '3.262', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '55.000'} [2024-08-06 02:08:57,209][52667] DAMAGECOUNT value on done: 272079.0 [2024-08-06 02:08:57,209][52667] Sum rewards: 70.577, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.072', 'AMMO3': '0.166', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '57.000'} [2024-08-06 02:08:57,548][52665] DAMAGECOUNT value on done: 275279.0 [2024-08-06 02:08:57,548][52665] Sum rewards: 66.863, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.945', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.161', 'weapon5': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.264', 'weapon4': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.616', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '53.000'} [2024-08-06 02:08:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 293617664. Throughput: 0: 4397.6. Samples: 73414620. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:08:57,795][52567] Avg episode reward: [(0, '64.805')] [2024-08-06 02:08:57,833][52649] DAMAGECOUNT value on done: 266391.0 [2024-08-06 02:08:57,834][52649] Sum rewards: 71.976, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.220', 'AMMO3': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.232', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '63.000'} [2024-08-06 02:08:59,824][52670] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:08:59,861][52664] DAMAGECOUNT value on done: 286084.0 [2024-08-06 02:08:59,861][52664] Sum rewards: 67.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.126', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon4': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:00,089][52667] DAMAGECOUNT value on done: 275383.0 [2024-08-06 02:09:00,097][52667] Sum rewards: 73.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.302', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '60.000'} [2024-08-06 02:09:00,279][52665] DAMAGECOUNT value on done: 271786.0 [2024-08-06 02:09:00,279][52665] Sum rewards: 67.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.102', 'AMMO5': '0.015', 'AMMO2': '0.061', 'AMMO3': '0.172', 'weapon5': '0.266', 'weapon2': '0.274', 'AMMO4': '0.305', 'weapon4': '0.386', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:00,307][52668] DAMAGECOUNT value on done: 269407.0 [2024-08-06 02:09:00,308][52668] Sum rewards: 61.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.590', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:00,668][52649] DAMAGECOUNT value on done: 269663.0 [2024-08-06 02:09:00,670][52649] Sum rewards: 81.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.230', 'WEAPON3': '1.150', 'weapon3': '3.576', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '65.500'} [2024-08-06 02:09:01,325][52650] Updated weights for policy 0, policy_version 35851 (0.0039) [2024-08-06 02:09:01,327][52662] DAMAGECOUNT value on done: 278623.0 [2024-08-06 02:09:01,327][52662] Sum rewards: 62.850, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.769', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.116', 'weapon4': '0.188', 'AMMO4': '0.202', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:02,441][52664] DAMAGECOUNT value on done: 275884.0 [2024-08-06 02:09:02,442][52664] Sum rewards: 67.583, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 293715968. Throughput: 0: 4400.0. Samples: 73427860. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:09:02,794][52567] Avg episode reward: [(0, '65.321')] [2024-08-06 02:09:03,152][52667] DAMAGECOUNT value on done: 272594.0 [2024-08-06 02:09:03,154][52667] Sum rewards: 61.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.985', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.136', 'weapon4': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.234', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.210', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:03,438][52668] DAMAGECOUNT value on done: 276902.0 [2024-08-06 02:09:03,438][52668] Sum rewards: 66.005, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.190', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.269', 'weapon2': '0.514', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '58.000'} [2024-08-06 02:09:03,444][52665] DAMAGECOUNT value on done: 269899.0 [2024-08-06 02:09:03,445][52665] Sum rewards: 64.324, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.152', 'weapon5': '0.152', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.534', 'weapon4': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.422', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '52.000'} [2024-08-06 02:09:03,982][52649] DAMAGECOUNT value on done: 260732.0 [2024-08-06 02:09:03,983][52649] Sum rewards: 74.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.833', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.152', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.234', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '63.000'} [2024-08-06 02:09:03,989][52662] DAMAGECOUNT value on done: 279614.0 [2024-08-06 02:09:03,991][52662] Sum rewards: 80.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '67.000'} [2024-08-06 02:09:05,812][52664] DAMAGECOUNT value on done: 288159.0 [2024-08-06 02:09:05,813][52664] Sum rewards: 61.944, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.626', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.148', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.274', 'AMMO3': '0.295', 'WEAPON3': '1.700', 'weapon3': '2.944', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:06,023][52650] Updated weights for policy 0, policy_version 35861 (0.0010) [2024-08-06 02:09:06,026][52668] DAMAGECOUNT value on done: 276851.0 [2024-08-06 02:09:06,026][52668] Sum rewards: 66.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.174', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.134', 'weapon4': '0.144', 'AMMO4': '0.183', 'AMMO3': '0.239', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:06,273][52667] DAMAGECOUNT value on done: 270941.0 [2024-08-06 02:09:06,273][52667] Sum rewards: 68.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.158', 'weapon5': '0.212', 'AMMO3': '0.236', 'weapon2': '0.272', 'AMMO4': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '59.000'} [2024-08-06 02:09:06,401][52665] DAMAGECOUNT value on done: 269439.0 [2024-08-06 02:09:06,402][52665] Sum rewards: 60.746, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.158', 'AMMO4': '0.159', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.748', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '48.000'} [2024-08-06 02:09:06,850][52649] DAMAGECOUNT value on done: 266112.0 [2024-08-06 02:09:06,851][52649] Sum rewards: 75.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.224', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.378', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '61.000'} [2024-08-06 02:09:06,888][52662] DAMAGECOUNT value on done: 278392.0 [2024-08-06 02:09:06,889][52662] Sum rewards: 63.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.048', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '52.000'} [2024-08-06 02:09:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 293797888. Throughput: 0: 4397.1. Samples: 73454270. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:09:07,794][52567] Avg episode reward: [(0, '66.103')] [2024-08-06 02:09:08,491][52664] DAMAGECOUNT value on done: 280222.0 [2024-08-06 02:09:08,492][52664] Sum rewards: 64.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.040', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.104', 'AMMO3': '0.191', 'AMMO4': '0.202', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.080', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '55.500'} [2024-08-06 02:09:08,581][52668] DAMAGECOUNT value on done: 276253.0 [2024-08-06 02:09:08,582][52668] Sum rewards: 70.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO4': '0.167', 'AMMO3': '0.187', 'weapon2': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '58.000'} [2024-08-06 02:09:09,430][52667] DAMAGECOUNT value on done: 276832.0 [2024-08-06 02:09:09,430][52667] Sum rewards: 66.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.524', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon2': '0.320', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.854', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:09,536][52665] DAMAGECOUNT value on done: 268882.0 [2024-08-06 02:09:09,538][52665] Sum rewards: 63.164, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:09,994][52649] DAMAGECOUNT value on done: 264029.0 [2024-08-06 02:09:09,997][52649] Sum rewards: 76.054, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'HEALTH': '0.031', 'AMMO4': '0.113', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.398', 'weapon4': '0.670', 'WEAPON3': '0.850', 'weapon3': '2.500', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '59.000'} [2024-08-06 02:09:10,110][52662] DAMAGECOUNT value on done: 269772.0 [2024-08-06 02:09:10,110][52662] Sum rewards: 63.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.364', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '52.000'} [2024-08-06 02:09:10,669][52664] DAMAGECOUNT value on done: 284266.0 [2024-08-06 02:09:10,669][52664] Sum rewards: 70.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.306', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.132', 'weapon4': '0.134', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '60.000'} [2024-08-06 02:09:10,835][52650] Updated weights for policy 0, policy_version 35871 (0.0011) [2024-08-06 02:09:11,469][52668] DAMAGECOUNT value on done: 265356.0 [2024-08-06 02:09:11,469][52668] Sum rewards: 56.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '50.000'} [2024-08-06 02:09:12,477][52667] DAMAGECOUNT value on done: 273663.0 [2024-08-06 02:09:12,477][52667] Sum rewards: 65.235, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.514', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.210', 'AMMO4': '0.229', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.500', 'weapon3': '2.876', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '59.000'} [2024-08-06 02:09:12,662][52665] DAMAGECOUNT value on done: 265445.0 [2024-08-06 02:09:12,662][52665] Sum rewards: 55.962, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.250', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '47.000'} [2024-08-06 02:09:12,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 293879808. Throughput: 0: 4388.7. Samples: 73480680. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:09:12,794][52567] Avg episode reward: [(0, '66.119')] [2024-08-06 02:09:13,062][52649] DAMAGECOUNT value on done: 269041.0 [2024-08-06 02:09:13,063][52649] Sum rewards: 54.296, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon5': '0.260', 'weapon2': '0.286', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '2.996', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '47.000'} [2024-08-06 02:09:13,174][52794] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 02:09:13,261][52662] DAMAGECOUNT value on done: 274932.0 [2024-08-06 02:09:13,261][52662] Sum rewards: 74.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.344', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.046', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'weapon2': '0.258', 'weapon4': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.190', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '64.000'} [2024-08-06 02:09:13,856][52664] DAMAGECOUNT value on done: 282282.0 [2024-08-06 02:09:13,857][52664] Sum rewards: 72.458, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.715', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.068', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '59.000'} [2024-08-06 02:09:13,999][52668] DAMAGECOUNT value on done: 275477.0 [2024-08-06 02:09:14,000][52668] Sum rewards: 54.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.350', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.110', 'weapon5': '0.200', 'AMMO3': '0.223', 'AMMO4': '0.229', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.040', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '44.000'} [2024-08-06 02:09:15,147][52660] DAMAGECOUNT value on done: 268489.0 [2024-08-06 02:09:15,147][52660] Sum rewards: 55.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.840', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.074', 'weapon5': '0.138', 'AMMO4': '0.191', 'AMMO3': '0.229', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '3.268', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '48.000'} [2024-08-06 02:09:15,301][52667] DAMAGECOUNT value on done: 276146.0 [2024-08-06 02:09:15,302][52667] Sum rewards: 51.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.925', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.432', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.042', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '46.000'} [2024-08-06 02:09:15,369][52665] DAMAGECOUNT value on done: 266802.0 [2024-08-06 02:09:15,369][52665] Sum rewards: 53.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.152', 'AMMO3': '0.219', 'AMMO4': '0.272', 'weapon2': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '44.000'} [2024-08-06 02:09:15,703][52650] Updated weights for policy 0, policy_version 35881 (0.0020) [2024-08-06 02:09:15,859][52649] DAMAGECOUNT value on done: 268413.0 [2024-08-06 02:09:15,860][52649] Sum rewards: 58.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.078', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.314', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '49.000'} [2024-08-06 02:09:16,391][52662] DAMAGECOUNT value on done: 268263.0 [2024-08-06 02:09:16,396][52662] Sum rewards: 43.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.601', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.102', 'AMMO3': '0.226', 'AMMO4': '0.228', 'weapon2': '0.230', 'WEAPON5': '0.350', 'weapon4': '0.362', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.370', 'weapon3': '3.092', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '41.500'} [2024-08-06 02:09:16,532][52668] DAMAGECOUNT value on done: 273002.0 [2024-08-06 02:09:16,533][52668] Sum rewards: 73.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.152', 'weapon2': '0.184', 'weapon4': '0.212', 'AMMO4': '0.235', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.200', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '63.000'} [2024-08-06 02:09:16,937][52664] DAMAGECOUNT value on done: 285718.0 [2024-08-06 02:09:16,938][52664] Sum rewards: 63.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.107', 'weapon4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.388', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17522.6). Total num frames: 293978112. Throughput: 0: 4398.9. Samples: 73493900. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:09:17,794][52567] Avg episode reward: [(0, '65.359')] [2024-08-06 02:09:17,813][52660] DAMAGECOUNT value on done: 267796.0 [2024-08-06 02:09:17,814][52660] Sum rewards: 68.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '58.000'} [2024-08-06 02:09:18,068][52667] DAMAGECOUNT value on done: 269821.0 [2024-08-06 02:09:18,071][52667] Sum rewards: 53.389, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.440', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO4': '0.182', 'AMMO3': '0.214', 'weapon4': '0.312', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.028', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '49.000'} [2024-08-06 02:09:18,373][52665] DAMAGECOUNT value on done: 266283.0 [2024-08-06 02:09:18,373][52665] Sum rewards: 59.791, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.201', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon2': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.058', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:18,692][52649] DAMAGECOUNT value on done: 272438.0 [2024-08-06 02:09:18,694][52649] Sum rewards: 63.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.288', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.072', 'weapon4': '0.138', 'AMMO4': '0.161', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:19,404][52662] DAMAGECOUNT value on done: 278183.0 [2024-08-06 02:09:19,406][52662] Sum rewards: 70.540, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.970', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.129', 'weapon2': '0.288', 'AMMO3': '0.346', 'WEAPON3': '2.050', 'HITCOUNT': '3.270', 'weapon3': '3.318', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '65.000'} [2024-08-06 02:09:19,556][52668] DAMAGECOUNT value on done: 272456.0 [2024-08-06 02:09:19,557][52668] Sum rewards: 57.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '3.078', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '47.000'} [2024-08-06 02:09:19,765][52650] Updated weights for policy 0, policy_version 35891 (0.0028) [2024-08-06 02:09:19,798][52664] DAMAGECOUNT value on done: 281417.0 [2024-08-06 02:09:19,798][52664] Sum rewards: 69.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.411', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:20,919][52665] DAMAGECOUNT value on done: 269869.0 [2024-08-06 02:09:20,927][52665] Sum rewards: 62.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.152', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.096', 'weapon5': '0.106', 'AMMO4': '0.140', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:20,936][52660] DAMAGECOUNT value on done: 274809.0 [2024-08-06 02:09:20,938][52660] Sum rewards: 60.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.718', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.042', 'weapon4': '0.080', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '52.000'} [2024-08-06 02:09:21,212][52667] DAMAGECOUNT value on done: 272157.0 [2024-08-06 02:09:21,212][52667] Sum rewards: 51.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.252', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.118', 'DAMAGECOUNT': '13.227', 'FRAGCOUNT': '46.000'} [2024-08-06 02:09:22,404][52662] DAMAGECOUNT value on done: 282182.0 [2024-08-06 02:09:22,404][52662] Sum rewards: 73.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.694', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon2': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'weapon3': '3.374', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 02:09:22,678][52668] DAMAGECOUNT value on done: 273611.0 [2024-08-06 02:09:22,679][52668] Sum rewards: 59.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.925', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon4': '0.168', 'AMMO3': '0.221', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.196', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '51.000'} [2024-08-06 02:09:22,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 294068224. Throughput: 0: 4392.4. Samples: 73520120. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 02:09:22,794][52567] Avg episode reward: [(0, '64.935')] [2024-08-06 02:09:22,857][52664] DAMAGECOUNT value on done: 286393.0 [2024-08-06 02:09:22,858][52664] Sum rewards: 75.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.435', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.144', 'AMMO4': '0.197', 'AMMO3': '0.213', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '64.000'} [2024-08-06 02:09:23,496][52665] DAMAGECOUNT value on done: 269657.0 [2024-08-06 02:09:23,496][52665] Sum rewards: 67.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.110', 'AMMO4': '0.177', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:23,951][52669] DAMAGECOUNT value on done: 276148.0 [2024-08-06 02:09:23,951][52669] Sum rewards: 72.065, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.160', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.302', 'weapon2': '0.396', 'WEAPON3': '1.750', 'weapon3': '3.188', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 02:09:24,086][52660] DAMAGECOUNT value on done: 274280.0 [2024-08-06 02:09:24,090][52660] Sum rewards: 61.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.232', 'weapon4': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.238', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:24,120][52667] DAMAGECOUNT value on done: 275964.0 [2024-08-06 02:09:24,122][52667] Sum rewards: 84.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.871', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.136', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '68.000'} [2024-08-06 02:09:24,954][52650] Updated weights for policy 0, policy_version 35901 (0.0012) [2024-08-06 02:09:25,016][52662] DAMAGECOUNT value on done: 273085.0 [2024-08-06 02:09:25,016][52662] Sum rewards: 61.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO4': '0.152', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:25,393][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:09:25,683][52668] DAMAGECOUNT value on done: 273239.0 [2024-08-06 02:09:25,685][52668] Sum rewards: 75.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '65.000'} [2024-08-06 02:09:25,948][52664] DAMAGECOUNT value on done: 278311.0 [2024-08-06 02:09:25,949][52664] Sum rewards: 77.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '64.000'} [2024-08-06 02:09:26,501][52669] DAMAGECOUNT value on done: 269892.0 [2024-08-06 02:09:26,503][52669] Sum rewards: 75.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.104', 'AMMO4': '0.120', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '62.000'} [2024-08-06 02:09:26,814][52667] DAMAGECOUNT value on done: 273886.0 [2024-08-06 02:09:26,814][52667] Sum rewards: 65.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO4': '0.151', 'weapon4': '0.194', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:26,939][52660] DAMAGECOUNT value on done: 271107.0 [2024-08-06 02:09:26,941][52660] Sum rewards: 61.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.192', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.166', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 294150144. Throughput: 0: 4391.8. Samples: 73546370. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 02:09:27,794][52567] Avg episode reward: [(0, '65.262')] [2024-08-06 02:09:28,254][52662] DAMAGECOUNT value on done: 286767.0 [2024-08-06 02:09:28,256][52662] Sum rewards: 64.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.113', 'AMMO3': '0.182', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.210', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:28,533][52668] DAMAGECOUNT value on done: 275100.0 [2024-08-06 02:09:28,536][52668] Sum rewards: 77.303, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.764', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.207', 'weapon4': '0.244', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '65.000'} [2024-08-06 02:09:29,120][52664] DAMAGECOUNT value on done: 283396.0 [2024-08-06 02:09:29,121][52664] Sum rewards: 71.337, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.784', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.140', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.298', 'weapon4': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:29,347][52669] DAMAGECOUNT value on done: 274404.0 [2024-08-06 02:09:29,347][52669] Sum rewards: 70.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.020', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.164', 'weapon2': '0.258', 'weapon4': '0.290', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:29,471][52650] Updated weights for policy 0, policy_version 35911 (0.0011) [2024-08-06 02:09:29,861][52667] DAMAGECOUNT value on done: 275585.0 [2024-08-06 02:09:29,861][52667] Sum rewards: 76.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.128', 'weapon5': '0.190', 'AMMO4': '0.203', 'AMMO3': '0.208', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '63.000'} [2024-08-06 02:09:29,913][52660] DAMAGECOUNT value on done: 267922.0 [2024-08-06 02:09:29,914][52660] Sum rewards: 72.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.766', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.088', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.280', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 02:09:31,431][52668] DAMAGECOUNT value on done: 269388.0 [2024-08-06 02:09:31,432][52668] Sum rewards: 65.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.449', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.410', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.210', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:31,668][52662] DAMAGECOUNT value on done: 272048.0 [2024-08-06 02:09:31,671][52662] Sum rewards: 59.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.052', 'AMMO4': '0.138', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.242', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '51.000'} [2024-08-06 02:09:31,804][52669] DAMAGECOUNT value on done: 271329.0 [2024-08-06 02:09:31,804][52669] Sum rewards: 58.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.320', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'weapon4': '0.140', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.442', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '48.000'} [2024-08-06 02:09:31,824][52664] DAMAGECOUNT value on done: 284950.0 [2024-08-06 02:09:31,826][52664] Sum rewards: 68.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.144', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'weapon4': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:32,674][52667] DAMAGECOUNT value on done: 272529.0 [2024-08-06 02:09:32,674][52667] Sum rewards: 66.000, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.069', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.494', 'WEAPON3': '0.750', 'weapon3': '3.082', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '51.000'} [2024-08-06 02:09:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 294240256. Throughput: 0: 4388.7. Samples: 73559400. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 02:09:32,794][52567] Avg episode reward: [(0, '65.777')] [2024-08-06 02:09:32,830][52660] DAMAGECOUNT value on done: 275107.0 [2024-08-06 02:09:32,830][52660] Sum rewards: 53.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.855', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.076', 'AMMO4': '0.101', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.348', 'weapon2': '0.454', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.946', 'DAMAGECOUNT': '12.975', 'FRAGCOUNT': '46.000'} [2024-08-06 02:09:34,022][52650] Updated weights for policy 0, policy_version 35921 (0.0022) [2024-08-06 02:09:34,169][52664] DAMAGECOUNT value on done: 282253.0 [2024-08-06 02:09:34,170][52664] Sum rewards: 57.574, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.780', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.153', 'weapon5': '0.168', 'AMMO4': '0.209', 'weapon2': '0.220', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '3.026', 'DAMAGECOUNT': '13.185', 'FRAGCOUNT': '47.000'} [2024-08-06 02:09:34,327][52668] DAMAGECOUNT value on done: 264118.0 [2024-08-06 02:09:34,329][52668] Sum rewards: 68.311, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.788', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.257', 'weapon4': '0.266', 'weapon5': '0.298', 'AMMO4': '0.313', 'weapon2': '0.354', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.720', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '58.500'} [2024-08-06 02:09:34,433][52794] DAMAGECOUNT value on done: 276957.0 [2024-08-06 02:09:34,433][52794] Sum rewards: 64.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.260', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.118', 'AMMO3': '0.200', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.560', 'WEAPON3': '1.100', 'weapon3': '2.726', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:34,579][52662] DAMAGECOUNT value on done: 272374.0 [2024-08-06 02:09:34,579][52662] Sum rewards: 69.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.058', 'AMMO4': '0.134', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.464', 'weapon4': '0.614', 'WEAPON3': '0.900', 'weapon3': '2.650', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:35,015][52669] DAMAGECOUNT value on done: 270309.0 [2024-08-06 02:09:35,017][52669] Sum rewards: 64.235, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.364', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'weapon4': '0.094', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.270', 'AMMO3': '0.294', 'WEAPON3': '1.800', 'weapon3': '3.272', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:35,304][52660] DAMAGECOUNT value on done: 278946.0 [2024-08-06 02:09:35,305][52660] Sum rewards: 64.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.090', 'weapon4': '0.112', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:35,390][52667] DAMAGECOUNT value on done: 270091.0 [2024-08-06 02:09:35,392][52667] Sum rewards: 55.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.971', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.098', 'weapon2': '0.214', 'AMMO4': '0.219', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.132', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '48.000'} [2024-08-06 02:09:36,983][52668] DAMAGECOUNT value on done: 265741.0 [2024-08-06 02:09:36,983][52668] Sum rewards: 58.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.332', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.322', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '50.000'} [2024-08-06 02:09:37,361][52664] DAMAGECOUNT value on done: 284300.0 [2024-08-06 02:09:37,364][52664] Sum rewards: 62.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.158', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.276', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '52.500'} [2024-08-06 02:09:37,444][52669] DAMAGECOUNT value on done: 271791.0 [2024-08-06 02:09:37,445][52669] Sum rewards: 65.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.355', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.057', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.248', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.450', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:37,562][52794] DAMAGECOUNT value on done: 278579.0 [2024-08-06 02:09:37,562][52794] Sum rewards: 67.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.134', 'AMMO3': '0.198', 'AMMO4': '0.199', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:37,739][52662] DAMAGECOUNT value on done: 274629.0 [2024-08-06 02:09:37,741][52662] Sum rewards: 76.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.895', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.070', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '64.000'} [2024-08-06 02:09:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 294330368. Throughput: 0: 4385.6. Samples: 73585600. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 02:09:37,794][52567] Avg episode reward: [(0, '65.464')] [2024-08-06 02:09:38,250][52667] DAMAGECOUNT value on done: 278487.0 [2024-08-06 02:09:38,251][52667] Sum rewards: 56.803, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.976', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.144', 'AMMO4': '0.182', 'weapon5': '0.198', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '2.834', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '50.000'} [2024-08-06 02:09:38,378][52660] DAMAGECOUNT value on done: 277361.0 [2024-08-06 02:09:38,378][52660] Sum rewards: 70.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.415', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.128', 'weapon4': '0.142', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '58.000'} [2024-08-06 02:09:38,739][52650] Updated weights for policy 0, policy_version 35931 (0.0028) [2024-08-06 02:09:40,070][52668] DAMAGECOUNT value on done: 267565.0 [2024-08-06 02:09:40,072][52668] Sum rewards: 69.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.006', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:40,272][52794] DAMAGECOUNT value on done: 273742.0 [2024-08-06 02:09:40,272][52794] Sum rewards: 65.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.124', 'weapon4': '0.148', 'AMMO4': '0.150', 'weapon2': '0.206', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.352', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:40,354][52669] DAMAGECOUNT value on done: 275208.0 [2024-08-06 02:09:40,355][52669] Sum rewards: 56.585, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.126', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.308', 'WEAPON3': '1.750', 'HITCOUNT': '3.080', 'weapon3': '3.312', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '52.000'} [2024-08-06 02:09:40,491][52662] DAMAGECOUNT value on done: 281945.0 [2024-08-06 02:09:40,491][52662] Sum rewards: 72.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.088', 'AMMO3': '0.177', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.314', 'WEAPON3': '1.100', 'weapon3': '3.240', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '58.000'} [2024-08-06 02:09:40,976][52667] DAMAGECOUNT value on done: 281394.0 [2024-08-06 02:09:40,976][52667] Sum rewards: 56.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.933', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon2': '0.172', 'weapon4': '0.210', 'weapon5': '0.226', 'AMMO3': '0.239', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.152', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '48.000'} [2024-08-06 02:09:41,528][52660] DAMAGECOUNT value on done: 272014.0 [2024-08-06 02:09:41,530][52660] Sum rewards: 66.704, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.214', 'HEALTH': '0.292', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 294412288. Throughput: 0: 4382.0. Samples: 73611810. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 02:09:42,794][52567] Avg episode reward: [(0, '65.464')] [2024-08-06 02:09:43,055][52794] DAMAGECOUNT value on done: 275289.0 [2024-08-06 02:09:43,055][52794] Sum rewards: 76.628, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.670', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon4': '0.086', 'weapon5': '0.200', 'AMMO4': '0.289', 'AMMO3': '0.307', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.900', 'weapon3': '3.074', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '68.000'} [2024-08-06 02:09:43,212][52668] DAMAGECOUNT value on done: 272029.0 [2024-08-06 02:09:43,212][52668] Sum rewards: 79.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.186', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'weapon3': '3.602', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '67.000'} [2024-08-06 02:09:43,255][52662] DAMAGECOUNT value on done: 273693.0 [2024-08-06 02:09:43,257][52662] Sum rewards: 62.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.336', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.115', 'weapon4': '0.208', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '52.000'} [2024-08-06 02:09:43,339][52650] Updated weights for policy 0, policy_version 35941 (0.0026) [2024-08-06 02:09:43,409][52669] DAMAGECOUNT value on done: 273977.0 [2024-08-06 02:09:43,411][52669] Sum rewards: 80.688, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.025', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.248', 'WEAPON3': '1.350', 'weapon3': '3.328', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '67.000'} [2024-08-06 02:09:43,915][52667] DAMAGECOUNT value on done: 276859.0 [2024-08-06 02:09:43,917][52667] Sum rewards: 55.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.670', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.158', 'weapon5': '0.190', 'AMMO3': '0.241', 'AMMO4': '0.256', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.010', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '48.000'} [2024-08-06 02:09:44,735][52660] DAMAGECOUNT value on done: 278864.0 [2024-08-06 02:09:44,736][52660] Sum rewards: 73.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.033', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.102', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '61.000'} [2024-08-06 02:09:46,124][52794] DAMAGECOUNT value on done: 272432.0 [2024-08-06 02:09:46,126][52794] Sum rewards: 63.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.594', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO4': '0.170', 'AMMO3': '0.228', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:46,257][52662] DAMAGECOUNT value on done: 286492.0 [2024-08-06 02:09:46,259][52662] Sum rewards: 81.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.284', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.072', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.231', 'WEAPON3': '1.550', 'weapon3': '3.446', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '68.000'} [2024-08-06 02:09:46,284][52668] DAMAGECOUNT value on done: 272505.0 [2024-08-06 02:09:46,286][52668] Sum rewards: 66.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon2': '0.356', 'weapon4': '0.492', 'WEAPON3': '0.900', 'weapon3': '2.852', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:46,428][52658] DAMAGECOUNT value on done: 274660.0 [2024-08-06 02:09:46,429][52658] Sum rewards: 72.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.064', 'weapon4': '0.122', 'weapon5': '0.186', 'AMMO3': '0.208', 'AMMO4': '0.321', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '61.000'} [2024-08-06 02:09:46,480][52669] DAMAGECOUNT value on done: 275803.0 [2024-08-06 02:09:46,481][52669] Sum rewards: 75.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '62.000'} [2024-08-06 02:09:46,747][52667] DAMAGECOUNT value on done: 279432.0 [2024-08-06 02:09:46,748][52667] Sum rewards: 72.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.494', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '59.000'} [2024-08-06 02:09:47,703][52660] DAMAGECOUNT value on done: 264466.0 [2024-08-06 02:09:47,704][52660] Sum rewards: 68.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.220', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.192', 'weapon2': '0.196', 'AMMO3': '0.201', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 294502400. Throughput: 0: 4385.1. Samples: 73625190. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 02:09:47,794][52567] Avg episode reward: [(0, '66.043')] [2024-08-06 02:09:48,100][52650] Updated weights for policy 0, policy_version 35951 (0.0011) [2024-08-06 02:09:49,077][52658] DAMAGECOUNT value on done: 274505.0 [2024-08-06 02:09:49,079][52658] Sum rewards: 65.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon4': '0.270', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:49,244][52669] DAMAGECOUNT value on done: 270092.0 [2024-08-06 02:09:49,245][52669] Sum rewards: 68.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.068', 'weapon4': '0.086', 'AMMO4': '0.145', 'AMMO3': '0.219', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.382', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '60.000'} [2024-08-06 02:09:49,352][52794] DAMAGECOUNT value on done: 275439.0 [2024-08-06 02:09:49,353][52794] Sum rewards: 57.076, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.070', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.224', 'AMMO3': '0.283', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.750', 'weapon3': '2.924', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:49,364][52667] DAMAGECOUNT value on done: 269108.0 [2024-08-06 02:09:49,365][52667] Sum rewards: 51.284, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.235', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon5': '0.102', 'AMMO3': '0.263', 'AMMO4': '0.302', 'weapon4': '0.330', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.774', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '47.000'} [2024-08-06 02:09:49,384][52668] DAMAGECOUNT value on done: 271804.0 [2024-08-06 02:09:49,384][52668] Sum rewards: 63.788, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.035', 'HEALTH': '0.102', 'weapon5': '0.140', 'AMMO4': '0.177', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.512', 'weapon4': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.424', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:49,462][52662] DAMAGECOUNT value on done: 275362.0 [2024-08-06 02:09:49,463][52662] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.048', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'weapon5': '0.284', 'weapon2': '0.288', 'weapon4': '0.314', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.892', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '60.000'} [2024-08-06 02:09:50,639][52660] DAMAGECOUNT value on done: 269816.0 [2024-08-06 02:09:50,641][52660] Sum rewards: 74.698, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.096', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '61.000'} [2024-08-06 02:09:51,714][52658] DAMAGECOUNT value on done: 275876.0 [2024-08-06 02:09:51,715][52658] Sum rewards: 65.248, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.124', 'AMMO4': '0.160', 'weapon5': '0.162', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:52,132][52667] DAMAGECOUNT value on done: 276169.0 [2024-08-06 02:09:52,132][52667] Sum rewards: 74.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.081', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '62.000'} [2024-08-06 02:09:52,197][52668] DAMAGECOUNT value on done: 275881.0 [2024-08-06 02:09:52,197][52668] Sum rewards: 69.204, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.096', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.054', 'weapon5': '0.056', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.324', 'WEAPON3': '1.950', 'weapon3': '3.398', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '64.000'} [2024-08-06 02:09:52,205][52794] DAMAGECOUNT value on done: 279617.0 [2024-08-06 02:09:52,207][52794] Sum rewards: 64.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.151', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.804', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.500'} [2024-08-06 02:09:52,289][52662] DAMAGECOUNT value on done: 276979.0 [2024-08-06 02:09:52,289][52662] Sum rewards: 61.391, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.580', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.271', 'weapon5': '0.284', 'weapon2': '0.292', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.616', 'WEAPON3': '1.600', 'weapon3': '2.438', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:52,291][52669] DAMAGECOUNT value on done: 276357.0 [2024-08-06 02:09:52,292][52669] Sum rewards: 62.233, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.876', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.170', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.256', 'weapon2': '0.612', 'WEAPON3': '1.500', 'weapon3': '2.784', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:52,729][52650] Updated weights for policy 0, policy_version 35961 (0.0024) [2024-08-06 02:09:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 294592512. Throughput: 0: 4377.8. Samples: 73651270. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:09:52,794][52567] Avg episode reward: [(0, '65.768')] [2024-08-06 02:09:53,189][52660] DAMAGECOUNT value on done: 278121.0 [2024-08-06 02:09:53,190][52660] Sum rewards: 66.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '55.000'} [2024-08-06 02:09:54,494][52658] DAMAGECOUNT value on done: 275008.0 [2024-08-06 02:09:54,494][52658] Sum rewards: 78.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.080', 'weapon2': '0.208', 'AMMO3': '0.212', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '67.000'} [2024-08-06 02:09:54,689][52794] DAMAGECOUNT value on done: 275260.0 [2024-08-06 02:09:54,691][52794] Sum rewards: 66.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.209', 'weapon5': '0.258', 'weapon2': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.820', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '56.000'} [2024-08-06 02:09:54,778][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:09:54,788][52662] DAMAGECOUNT value on done: 275536.0 [2024-08-06 02:09:54,788][52662] Sum rewards: 67.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'AMMO5': '0.003', 'weapon7': '0.014', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.143', 'weapon2': '0.238', 'AMMO3': '0.241', 'weapon4': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '58.000'} [2024-08-06 02:09:55,025][52668] DAMAGECOUNT value on done: 271369.0 [2024-08-06 02:09:55,025][52668] Sum rewards: 62.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.577', 'AMMO5': '0.007', 'AMMO2': '0.037', 'AMMO3': '0.124', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.460', 'WEAPON3': '0.800', 'weapon3': '2.900', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '50.000'} [2024-08-06 02:09:55,195][52669] DAMAGECOUNT value on done: 273592.0 [2024-08-06 02:09:55,195][52669] Sum rewards: 58.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.793', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.108', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.144', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '48.000'} [2024-08-06 02:09:56,363][52660] DAMAGECOUNT value on done: 281941.0 [2024-08-06 02:09:56,364][52660] Sum rewards: 66.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.164', 'weapon2': '0.602', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.236', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:57,049][52658] DAMAGECOUNT value on done: 274264.0 [2024-08-06 02:09:57,049][52658] Sum rewards: 63.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.335', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.219', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '53.000'} [2024-08-06 02:09:57,324][52794] DAMAGECOUNT value on done: 280839.0 [2024-08-06 02:09:57,324][52794] Sum rewards: 69.977, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.756', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.113', 'AMMO4': '0.165', 'weapon5': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON5': '0.400', 'WEAPON3': '0.750', 'weapon2': '0.764', 'weapon3': '2.512', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '54.000'} [2024-08-06 02:09:57,329][52650] Updated weights for policy 0, policy_version 35971 (0.0025) [2024-08-06 02:09:57,405][52662] DAMAGECOUNT value on done: 268984.0 [2024-08-06 02:09:57,405][52662] Sum rewards: 71.496, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.544', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon5': '0.204', 'AMMO3': '0.236', 'weapon2': '0.274', 'AMMO4': '0.296', 'weapon4': '0.422', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.764', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '62.500'} [2024-08-06 02:09:57,573][52658] Large shaping reward 3.516 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:09:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 294674432. Throughput: 0: 4382.9. Samples: 73677910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:09:57,794][52567] Avg episode reward: [(0, '66.029')] [2024-08-06 02:09:58,361][52669] DAMAGECOUNT value on done: 270815.0 [2024-08-06 02:09:58,362][52669] Sum rewards: 66.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.422', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.178', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '57.000'} [2024-08-06 02:09:59,188][52660] DAMAGECOUNT value on done: 269705.0 [2024-08-06 02:09:59,189][52660] Sum rewards: 79.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.952', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.098', 'weapon2': '0.184', 'AMMO3': '0.211', 'weapon4': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '65.000'} [2024-08-06 02:09:59,583][52658] DAMAGECOUNT value on done: 273164.0 [2024-08-06 02:09:59,583][52658] Sum rewards: 76.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.880', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:00,160][52794] DAMAGECOUNT value on done: 277827.0 [2024-08-06 02:10:00,161][52794] Sum rewards: 70.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.046', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.209', 'weapon2': '0.218', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.622', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:01,309][52669] DAMAGECOUNT value on done: 275333.0 [2024-08-06 02:10:01,309][52669] Sum rewards: 54.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.237', 'weapon4': '0.250', 'AMMO4': '0.251', 'weapon2': '0.300', 'weapon5': '0.396', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.588', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '45.500'} [2024-08-06 02:10:01,939][52650] Updated weights for policy 0, policy_version 35981 (0.0012) [2024-08-06 02:10:02,406][52660] DAMAGECOUNT value on done: 273343.0 [2024-08-06 02:10:02,407][52660] Sum rewards: 65.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.535', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.378', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '55.000'} [2024-08-06 02:10:02,478][52658] DAMAGECOUNT value on done: 279018.0 [2024-08-06 02:10:02,480][52658] Sum rewards: 75.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.105', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon2': '0.180', 'AMMO3': '0.193', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.650', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 294764544. Throughput: 0: 4379.3. Samples: 73690970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:10:02,794][52567] Avg episode reward: [(0, '67.026')] [2024-08-06 02:10:02,802][52614] Saving new best policy, reward=67.026! [2024-08-06 02:10:02,842][52794] DAMAGECOUNT value on done: 274636.0 [2024-08-06 02:10:02,843][52794] Sum rewards: 61.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.347', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '53.000'} [2024-08-06 02:10:04,489][52669] DAMAGECOUNT value on done: 278408.0 [2024-08-06 02:10:04,491][52669] Sum rewards: 56.809, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.885', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.286', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '52.000'} [2024-08-06 02:10:05,252][52660] DAMAGECOUNT value on done: 264721.0 [2024-08-06 02:10:05,254][52660] Sum rewards: 73.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.841', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.231', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:05,477][52658] DAMAGECOUNT value on done: 267888.0 [2024-08-06 02:10:05,478][52658] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.995', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.102', 'AMMO4': '0.231', 'AMMO3': '0.239', 'weapon4': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.010', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:05,765][52794] DAMAGECOUNT value on done: 275014.0 [2024-08-06 02:10:05,765][52794] Sum rewards: 67.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.070', 'AMMO4': '0.107', 'weapon5': '0.126', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '55.000'} [2024-08-06 02:10:07,031][52650] Updated weights for policy 0, policy_version 35991 (0.0021) [2024-08-06 02:10:07,171][52614] Signal inference workers to stop experience collection... (6500 times) [2024-08-06 02:10:07,172][52614] Signal inference workers to resume experience collection... (6500 times) [2024-08-06 02:10:07,246][52650] InferenceWorker_p0-w0: stopping experience collection (6500 times) [2024-08-06 02:10:07,246][52650] InferenceWorker_p0-w0: resuming experience collection (6500 times) [2024-08-06 02:10:07,509][52669] DAMAGECOUNT value on done: 286358.0 [2024-08-06 02:10:07,509][52669] Sum rewards: 61.417, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.034', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO4': '0.216', 'AMMO3': '0.266', 'weapon4': '0.298', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.882', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '56.000'} [2024-08-06 02:10:07,787][52671] DAMAGECOUNT value on done: 277354.0 [2024-08-06 02:10:07,789][52671] Sum rewards: 59.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.576', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.448', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.136', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '49.000'} [2024-08-06 02:10:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17550.4). Total num frames: 294854656. Throughput: 0: 4375.8. Samples: 73717030. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:10:07,795][52567] Avg episode reward: [(0, '67.065')] [2024-08-06 02:10:07,797][52614] Saving new best policy, reward=67.065! [2024-08-06 02:10:08,526][52660] DAMAGECOUNT value on done: 274109.0 [2024-08-06 02:10:08,529][52660] Sum rewards: 66.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.562', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.194', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'weapon4': '0.474', 'WEAPON3': '1.200', 'weapon3': '2.558', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:08,537][52658] DAMAGECOUNT value on done: 279759.0 [2024-08-06 02:10:08,538][52658] Sum rewards: 61.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.242', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.090', 'AMMO4': '0.198', 'AMMO3': '0.234', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.138', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '52.000'} [2024-08-06 02:10:08,698][52794] DAMAGECOUNT value on done: 268251.0 [2024-08-06 02:10:08,698][52794] Sum rewards: 58.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.366', 'weapon4': '0.374', 'WEAPON3': '1.600', 'weapon3': '2.782', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '52.000'} [2024-08-06 02:10:09,972][52669] DAMAGECOUNT value on done: 275248.0 [2024-08-06 02:10:09,974][52669] Sum rewards: 57.435, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.644', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon4': '0.196', 'weapon5': '0.206', 'AMMO4': '0.253', 'AMMO3': '0.286', 'weapon2': '0.426', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.794', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:10,610][52795] DAMAGECOUNT value on done: 254379.0 [2024-08-06 02:10:10,610][52795] Sum rewards: 64.391, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.126', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.142', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.264', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '51.000'} [2024-08-06 02:10:10,926][52671] DAMAGECOUNT value on done: 275214.0 [2024-08-06 02:10:10,928][52671] Sum rewards: 62.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.326', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '52.000'} [2024-08-06 02:10:11,392][52658] DAMAGECOUNT value on done: 278684.0 [2024-08-06 02:10:11,392][52658] Sum rewards: 72.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.181', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:11,593][52650] Updated weights for policy 0, policy_version 36001 (0.0013) [2024-08-06 02:10:11,625][52660] DAMAGECOUNT value on done: 270440.0 [2024-08-06 02:10:11,626][52660] Sum rewards: 82.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.475', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.032', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '66.000'} [2024-08-06 02:10:11,728][52794] DAMAGECOUNT value on done: 283049.0 [2024-08-06 02:10:11,731][52794] Sum rewards: 66.164, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.050', 'AMMO5': '0.018', 'AMMO2': '0.072', 'weapon5': '0.118', 'AMMO3': '0.193', 'AMMO4': '0.359', 'weapon2': '0.390', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:12,434][52669] DAMAGECOUNT value on done: 280186.0 [2024-08-06 02:10:12,434][52669] Sum rewards: 63.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.328', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.160', 'weapon4': '0.178', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.002', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:12,559][52668] Large shaping reward 2.742 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 02:10:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 294936576. Throughput: 0: 4369.3. Samples: 73742990. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:10:12,794][52567] Avg episode reward: [(0, '67.012')] [2024-08-06 02:10:13,522][52671] DAMAGECOUNT value on done: 276373.0 [2024-08-06 02:10:13,522][52671] Sum rewards: 56.514, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.712', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.120', 'weapon4': '0.130', 'AMMO4': '0.232', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '3.026', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '51.500'} [2024-08-06 02:10:13,639][52659] Large shaping reward 2.537 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.507, 169.0)] [2024-08-06 02:10:13,923][52795] DAMAGECOUNT value on done: 249504.0 [2024-08-06 02:10:13,924][52795] Sum rewards: 78.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.229', 'weapon2': '0.276', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '65.000'} [2024-08-06 02:10:14,442][52658] DAMAGECOUNT value on done: 282006.0 [2024-08-06 02:10:14,443][52658] Sum rewards: 74.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO4': '0.213', 'AMMO3': '0.227', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:14,476][52794] DAMAGECOUNT value on done: 271669.0 [2024-08-06 02:10:14,477][52794] Sum rewards: 72.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.000', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.108', 'weapon4': '0.146', 'AMMO3': '0.187', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '61.000'} [2024-08-06 02:10:15,127][52669] DAMAGECOUNT value on done: 278132.0 [2024-08-06 02:10:15,129][52669] Sum rewards: 72.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.545', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.144', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.232', 'WEAPON3': '0.950', 'weapon3': '3.408', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:16,230][52650] Updated weights for policy 0, policy_version 36011 (0.0011) [2024-08-06 02:10:16,281][52671] DAMAGECOUNT value on done: 273655.0 [2024-08-06 02:10:16,282][52671] Sum rewards: 68.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO3': '0.182', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.396', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 02:10:16,982][52795] DAMAGECOUNT value on done: 249595.0 [2024-08-06 02:10:16,982][52795] Sum rewards: 70.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.112', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.404', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:17,212][52794] DAMAGECOUNT value on done: 283291.0 [2024-08-06 02:10:17,213][52794] Sum rewards: 74.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.152', 'AMMO4': '0.158', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:17,311][52658] DAMAGECOUNT value on done: 267097.0 [2024-08-06 02:10:17,312][52658] Sum rewards: 61.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.156', 'AMMO3': '0.198', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '53.000'} [2024-08-06 02:10:17,795][52567] Fps is (10 sec: 18020.8, 60 sec: 17612.5, 300 sec: 17578.0). Total num frames: 295034880. Throughput: 0: 4378.3. Samples: 73756430. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:10:17,796][52567] Avg episode reward: [(0, '67.025')] [2024-08-06 02:10:18,035][52669] DAMAGECOUNT value on done: 280529.0 [2024-08-06 02:10:18,035][52669] Sum rewards: 57.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.575', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.089', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.102', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.500'} [2024-08-06 02:10:19,108][52671] DAMAGECOUNT value on done: 282105.0 [2024-08-06 02:10:19,126][52671] Sum rewards: 57.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.220', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '49.000'} [2024-08-06 02:10:20,072][52666] DAMAGECOUNT value on done: 278614.0 [2024-08-06 02:10:20,073][52666] Sum rewards: 62.065, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.646', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.072', 'AMMO3': '0.230', 'weapon5': '0.306', 'weapon2': '0.324', 'AMMO4': '0.359', 'weapon4': '0.488', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.516', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '52.500'} [2024-08-06 02:10:20,194][52795] DAMAGECOUNT value on done: 252647.0 [2024-08-06 02:10:20,194][52795] Sum rewards: 69.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.695', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.116', 'AMMO3': '0.146', 'weapon4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.720', 'WEAPON3': '0.950', 'weapon3': '2.818', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '55.000'} [2024-08-06 02:10:20,211][52658] DAMAGECOUNT value on done: 274879.0 [2024-08-06 02:10:20,213][52658] Sum rewards: 61.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.636', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO4': '0.171', 'weapon2': '0.188', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.414', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '54.500'} [2024-08-06 02:10:20,278][52794] DAMAGECOUNT value on done: 275706.0 [2024-08-06 02:10:20,279][52794] Sum rewards: 56.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon2': '0.174', 'AMMO4': '0.178', 'weapon4': '0.180', 'weapon5': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.266', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '49.000'} [2024-08-06 02:10:20,990][52650] Updated weights for policy 0, policy_version 36021 (0.0039) [2024-08-06 02:10:21,426][52671] DAMAGECOUNT value on done: 274541.0 [2024-08-06 02:10:21,426][52671] Sum rewards: 69.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 295116800. Throughput: 0: 4380.4. Samples: 73782720. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:10:22,795][52567] Avg episode reward: [(0, '66.436')] [2024-08-06 02:10:23,003][52794] DAMAGECOUNT value on done: 277219.0 [2024-08-06 02:10:23,005][52794] Sum rewards: 74.622, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.262', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:23,150][52658] DAMAGECOUNT value on done: 274336.0 [2024-08-06 02:10:23,150][52658] Sum rewards: 65.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.961', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.136', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:23,234][52666] DAMAGECOUNT value on done: 279632.0 [2024-08-06 02:10:23,234][52666] Sum rewards: 69.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.782', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.210', 'weapon5': '0.224', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.666', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '59.000'} [2024-08-06 02:10:23,569][52795] DAMAGECOUNT value on done: 257318.0 [2024-08-06 02:10:23,570][52795] Sum rewards: 71.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.100', 'AMMO3': '0.197', 'AMMO4': '0.237', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '59.000'} [2024-08-06 02:10:24,094][52671] DAMAGECOUNT value on done: 278600.0 [2024-08-06 02:10:24,094][52671] Sum rewards: 69.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.259', 'weapon2': '0.310', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.528', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:24,936][52647] DAMAGECOUNT value on done: 291208.0 [2024-08-06 02:10:24,936][52647] Sum rewards: 75.239, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'HEALTH': '0.178', 'weapon2': '0.684', 'WEAPON3': '0.900', 'weapon3': '3.160', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:25,454][52650] Updated weights for policy 0, policy_version 36031 (0.0010) [2024-08-06 02:10:25,495][52658] DAMAGECOUNT value on done: 268379.0 [2024-08-06 02:10:25,496][52658] Sum rewards: 55.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.260', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'weapon4': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.257', 'weapon2': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.900', 'weapon3': '3.326', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '50.000'} [2024-08-06 02:10:26,056][52794] DAMAGECOUNT value on done: 287777.0 [2024-08-06 02:10:26,058][52794] Sum rewards: 58.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.089', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.172', 'AMMO4': '0.216', 'AMMO3': '0.231', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '50.000'} [2024-08-06 02:10:26,524][52666] DAMAGECOUNT value on done: 278299.0 [2024-08-06 02:10:26,526][52666] Sum rewards: 69.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.120', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.224', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:26,883][52795] DAMAGECOUNT value on done: 253126.0 [2024-08-06 02:10:26,885][52795] Sum rewards: 58.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.660', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.204', 'weapon2': '0.308', 'AMMO4': '0.315', 'weapon5': '0.330', 'weapon4': '0.476', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '49.000'} [2024-08-06 02:10:27,213][52671] DAMAGECOUNT value on done: 278263.0 [2024-08-06 02:10:27,214][52671] Sum rewards: 58.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.774', 'AMMO5': '0.013', 'AMMO2': '0.057', 'AMMO3': '0.220', 'AMMO4': '0.284', 'weapon5': '0.298', 'weapon2': '0.386', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.588', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '51.000'} [2024-08-06 02:10:27,537][52647] DAMAGECOUNT value on done: 287891.0 [2024-08-06 02:10:27,538][52647] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.006', 'weapon7': '0.048', 'AMMO2': '0.054', 'weapon5': '0.062', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.258', 'AMMO4': '0.270', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.046', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '53.000'} [2024-08-06 02:10:27,794][52567] Fps is (10 sec: 16385.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 295198720. Throughput: 0: 4384.2. Samples: 73809100. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:10:27,794][52567] Avg episode reward: [(0, '66.813')] [2024-08-06 02:10:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036035_295198720.pth... [2024-08-06 02:10:27,945][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035522_290996224.pth [2024-08-06 02:10:28,257][52658] DAMAGECOUNT value on done: 270955.0 [2024-08-06 02:10:28,259][52658] Sum rewards: 59.923, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.098', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON3': '0.800', 'weapon2': '0.884', 'weapon3': '2.548', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.698', 'FRAGCOUNT': '48.000'} [2024-08-06 02:10:29,178][52670] DAMAGECOUNT value on done: 271224.0 [2024-08-06 02:10:29,178][52670] Sum rewards: 73.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.230', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '63.000'} [2024-08-06 02:10:29,483][52794] DAMAGECOUNT value on done: 276198.0 [2024-08-06 02:10:29,483][52794] Sum rewards: 57.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon2': '0.162', 'AMMO3': '0.186', 'weapon5': '0.200', 'weapon4': '0.216', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.162', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '48.000'} [2024-08-06 02:10:29,538][52666] DAMAGECOUNT value on done: 274150.0 [2024-08-06 02:10:29,539][52666] Sum rewards: 65.641, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.737', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.118', 'AMMO4': '0.194', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '56.000'} [2024-08-06 02:10:29,871][52650] Updated weights for policy 0, policy_version 36041 (0.0019) [2024-08-06 02:10:29,945][52647] DAMAGECOUNT value on done: 288321.0 [2024-08-06 02:10:29,945][52647] Sum rewards: 62.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.040', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.420', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.304', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:30,173][52795] DAMAGECOUNT value on done: 257929.0 [2024-08-06 02:10:30,174][52795] Sum rewards: 67.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.173', 'weapon5': '0.188', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:30,411][52671] DAMAGECOUNT value on done: 271576.0 [2024-08-06 02:10:30,411][52671] Sum rewards: 67.851, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.526', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.078', 'weapon4': '0.094', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.256', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:30,772][52658] DAMAGECOUNT value on done: 280270.0 [2024-08-06 02:10:30,774][52658] Sum rewards: 67.046, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.216', 'weapon2': '0.416', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.334', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 02:10:32,023][52803] DAMAGECOUNT value on done: 255069.0 [2024-08-06 02:10:32,025][52803] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.680', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'AMMO4': '0.271', 'weapon4': '0.288', 'weapon2': '0.466', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.810', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:32,410][52670] DAMAGECOUNT value on done: 276923.0 [2024-08-06 02:10:32,410][52670] Sum rewards: 77.950, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.390', 'AMMO5': '0.011', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.155', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.296', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '68.000'} [2024-08-06 02:10:32,463][52647] DAMAGECOUNT value on done: 291112.0 [2024-08-06 02:10:32,464][52647] Sum rewards: 57.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.192', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon5': '0.238', 'weapon2': '0.536', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '3.028', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '47.000'} [2024-08-06 02:10:32,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 295297024. Throughput: 0: 4370.7. Samples: 73821870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:10:32,794][52567] Avg episode reward: [(0, '66.850')] [2024-08-06 02:10:32,977][52666] DAMAGECOUNT value on done: 270654.0 [2024-08-06 02:10:32,977][52666] Sum rewards: 66.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.157', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:33,357][52795] DAMAGECOUNT value on done: 254658.0 [2024-08-06 02:10:33,365][52795] Sum rewards: 76.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.366', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.239', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '3.258', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '66.000'} [2024-08-06 02:10:33,459][52671] DAMAGECOUNT value on done: 278815.0 [2024-08-06 02:10:33,459][52671] Sum rewards: 59.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.189', 'weapon5': '0.242', 'AMMO4': '0.248', 'weapon4': '0.328', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '49.000'} [2024-08-06 02:10:33,855][52658] DAMAGECOUNT value on done: 271155.0 [2024-08-06 02:10:33,855][52658] Sum rewards: 73.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.175', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.106', 'AMMO4': '0.130', 'weapon5': '0.162', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '59.000'} [2024-08-06 02:10:34,984][52650] Updated weights for policy 0, policy_version 36051 (0.0012) [2024-08-06 02:10:35,155][52670] DAMAGECOUNT value on done: 267723.0 [2024-08-06 02:10:35,156][52670] Sum rewards: 59.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.233', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.209', 'weapon2': '0.210', 'weapon4': '0.278', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.176', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '50.000'} [2024-08-06 02:10:35,170][52647] DAMAGECOUNT value on done: 289150.0 [2024-08-06 02:10:35,171][52647] Sum rewards: 66.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.232', 'weapon2': '0.368', 'WEAPON3': '1.550', 'HITCOUNT': '3.230', 'weapon3': '3.252', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:35,186][52803] DAMAGECOUNT value on done: 256302.0 [2024-08-06 02:10:35,187][52803] Sum rewards: 65.360, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.820', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.171', 'AMMO3': '0.219', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '54.500'} [2024-08-06 02:10:35,557][52666] DAMAGECOUNT value on done: 265884.0 [2024-08-06 02:10:35,559][52666] Sum rewards: 73.935, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.598', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'weapon3': '3.498', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '64.000'} [2024-08-06 02:10:35,965][52811] DAMAGECOUNT value on done: 265958.0 [2024-08-06 02:10:35,967][52811] Sum rewards: 61.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.224', 'AMMO4': '0.298', 'weapon5': '0.310', 'weapon2': '0.392', 'weapon4': '0.402', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.382', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '52.000'} [2024-08-06 02:10:36,288][52671] DAMAGECOUNT value on done: 280716.0 [2024-08-06 02:10:36,288][52671] Sum rewards: 67.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.136', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:36,292][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:10:36,508][52795] DAMAGECOUNT value on done: 251228.0 [2024-08-06 02:10:36,509][52795] Sum rewards: 72.750, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.290', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.040', 'weapon4': '0.112', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon2': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'weapon3': '3.398', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '63.000'} [2024-08-06 02:10:36,620][52658] DAMAGECOUNT value on done: 274344.0 [2024-08-06 02:10:36,620][52658] Sum rewards: 69.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.689', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.074', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.150', 'AMMO3': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.456', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 295378944. Throughput: 0: 4379.6. Samples: 73848350. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 02:10:37,794][52567] Avg episode reward: [(0, '66.423')] [2024-08-06 02:10:37,839][52647] DAMAGECOUNT value on done: 293621.0 [2024-08-06 02:10:37,840][52647] Sum rewards: 54.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.325', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.360', 'weapon4': '0.380', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '48.000'} [2024-08-06 02:10:38,281][52803] DAMAGECOUNT value on done: 256624.0 [2024-08-06 02:10:38,281][52803] Sum rewards: 76.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.190', 'WEAPON4': '0.350', 'weapon4': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:38,343][52670] DAMAGECOUNT value on done: 268869.0 [2024-08-06 02:10:38,344][52670] Sum rewards: 65.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.338', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO3': '0.202', 'weapon2': '0.212', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.516', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:38,785][52666] DAMAGECOUNT value on done: 274291.0 [2024-08-06 02:10:38,786][52666] Sum rewards: 68.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.642', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO4': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:39,110][52811] DAMAGECOUNT value on done: 253877.0 [2024-08-06 02:10:39,110][52811] Sum rewards: 68.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.357', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.162', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:39,443][52671] DAMAGECOUNT value on done: 274229.0 [2024-08-06 02:10:39,445][52671] Sum rewards: 73.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.926', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.098', 'AMMO4': '0.201', 'AMMO3': '0.220', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:39,655][52795] DAMAGECOUNT value on done: 260400.0 [2024-08-06 02:10:39,656][52795] Sum rewards: 73.962, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.054', 'weapon4': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO4': '0.192', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.414', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '64.000'} [2024-08-06 02:10:39,781][52658] DAMAGECOUNT value on done: 278003.0 [2024-08-06 02:10:39,783][52658] Sum rewards: 68.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'weapon4': '0.178', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '59.000'} [2024-08-06 02:10:39,915][52650] Updated weights for policy 0, policy_version 36061 (0.0012) [2024-08-06 02:10:40,937][52647] DAMAGECOUNT value on done: 288669.0 [2024-08-06 02:10:40,937][52647] Sum rewards: 65.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.197', 'AMMO4': '0.226', 'weapon5': '0.234', 'weapon4': '0.286', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '53.000'} [2024-08-06 02:10:41,171][52670] DAMAGECOUNT value on done: 277093.0 [2024-08-06 02:10:41,173][52670] Sum rewards: 69.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.162', 'weapon2': '0.194', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:41,289][52803] DAMAGECOUNT value on done: 256688.0 [2024-08-06 02:10:41,290][52803] Sum rewards: 51.098, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.587', 'AMMO5': '0.018', 'AMMO2': '0.070', 'weapon5': '0.214', 'AMMO3': '0.263', 'AMMO4': '0.348', 'weapon2': '0.464', 'weapon4': '0.476', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.484', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '46.500'} [2024-08-06 02:10:41,558][52666] DAMAGECOUNT value on done: 271139.0 [2024-08-06 02:10:41,560][52666] Sum rewards: 54.667, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.600', 'AMMO5': '0.022', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.200', 'AMMO3': '0.280', 'weapon5': '0.310', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.796', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '50.000'} [2024-08-06 02:10:42,318][52811] DAMAGECOUNT value on done: 257907.0 [2024-08-06 02:10:42,319][52811] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.665', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon4': '0.212', 'AMMO3': '0.216', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:42,373][52671] DAMAGECOUNT value on done: 284916.0 [2024-08-06 02:10:42,373][52671] Sum rewards: 74.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 295460864. Throughput: 0: 4370.2. Samples: 73874570. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 02:10:42,794][52567] Avg episode reward: [(0, '66.411')] [2024-08-06 02:10:42,820][52795] DAMAGECOUNT value on done: 253542.0 [2024-08-06 02:10:42,821][52795] Sum rewards: 56.964, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '45.000'} [2024-08-06 02:10:43,388][52647] DAMAGECOUNT value on done: 286577.0 [2024-08-06 02:10:43,389][52647] Sum rewards: 56.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.199', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.496', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.108', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '50.000'} [2024-08-06 02:10:43,590][52670] DAMAGECOUNT value on done: 272843.0 [2024-08-06 02:10:43,600][52670] Sum rewards: 61.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.156', 'weapon4': '0.158', 'AMMO3': '0.206', 'AMMO4': '0.229', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '50.500'} [2024-08-06 02:10:43,900][52666] DAMAGECOUNT value on done: 272107.0 [2024-08-06 02:10:43,904][52666] Sum rewards: 59.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '51.000'} [2024-08-06 02:10:43,961][52650] Updated weights for policy 0, policy_version 36071 (0.0012) [2024-08-06 02:10:44,331][52803] DAMAGECOUNT value on done: 259588.0 [2024-08-06 02:10:44,331][52803] Sum rewards: 72.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.578', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'weapon4': '0.164', 'AMMO4': '0.176', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '61.000'} [2024-08-06 02:10:45,086][52671] DAMAGECOUNT value on done: 274095.0 [2024-08-06 02:10:45,086][52671] Sum rewards: 67.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.609', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.056', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.267', 'weapon2': '0.296', 'WEAPON3': '1.700', 'weapon3': '3.218', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '61.000'} [2024-08-06 02:10:45,585][52811] DAMAGECOUNT value on done: 253941.0 [2024-08-06 02:10:45,585][52811] Sum rewards: 54.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.914', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.261', 'AMMO4': '0.279', 'weapon5': '0.282', 'weapon4': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.602', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '48.000'} [2024-08-06 02:10:45,705][52670] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:10:46,000][52795] DAMAGECOUNT value on done: 250879.0 [2024-08-06 02:10:46,001][52795] Sum rewards: 55.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'weapon4': '0.120', 'AMMO4': '0.138', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.080', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '46.000'} [2024-08-06 02:10:46,412][52670] DAMAGECOUNT value on done: 266381.0 [2024-08-06 02:10:46,415][52670] Sum rewards: 75.845, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.777', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.140', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.550', 'weapon2': '0.562', 'WEAPON3': '0.900', 'weapon3': '2.400', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '60.000'} [2024-08-06 02:10:46,737][52666] DAMAGECOUNT value on done: 270817.0 [2024-08-06 02:10:46,738][52666] Sum rewards: 57.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.014', 'AMMO5': '0.015', 'AMMO2': '0.064', 'AMMO3': '0.184', 'weapon5': '0.222', 'AMMO4': '0.322', 'WEAPON5': '0.400', 'weapon2': '0.438', 'weapon4': '0.608', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.484', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '46.000'} [2024-08-06 02:10:46,740][52820] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:10:46,822][52647] DAMAGECOUNT value on done: 291595.0 [2024-08-06 02:10:46,823][52647] Sum rewards: 69.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.177', 'weapon5': '0.192', 'weapon2': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.640', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:47,325][52803] DAMAGECOUNT value on done: 257005.0 [2024-08-06 02:10:47,327][52803] Sum rewards: 68.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.103', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:47,769][52671] DAMAGECOUNT value on done: 266423.0 [2024-08-06 02:10:47,769][52671] Sum rewards: 72.990, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.220', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon2': '0.596', 'WEAPON3': '0.900', 'weapon3': '2.956', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 295550976. Throughput: 0: 4372.0. Samples: 73887710. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 02:10:47,794][52567] Avg episode reward: [(0, '65.968')] [2024-08-06 02:10:47,801][52659] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:10:48,655][52811] DAMAGECOUNT value on done: 256230.0 [2024-08-06 02:10:48,658][52811] Sum rewards: 79.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.180', 'AMMO4': '0.217', 'AMMO3': '0.231', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '66.000'} [2024-08-06 02:10:49,066][52650] Updated weights for policy 0, policy_version 36081 (0.0013) [2024-08-06 02:10:49,111][52795] DAMAGECOUNT value on done: 248034.0 [2024-08-06 02:10:49,112][52795] Sum rewards: 61.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.337', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon2': '0.172', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '52.000'} [2024-08-06 02:10:49,194][52670] DAMAGECOUNT value on done: 270732.0 [2024-08-06 02:10:49,196][52670] Sum rewards: 64.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.400', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.116', 'weapon4': '0.140', 'AMMO4': '0.147', 'AMMO3': '0.192', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.338', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '52.500'} [2024-08-06 02:10:49,496][52666] DAMAGECOUNT value on done: 269660.0 [2024-08-06 02:10:49,496][52666] Sum rewards: 63.634, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.057', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.052', 'AMMO4': '0.142', 'weapon5': '0.154', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.184', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '55.000'} [2024-08-06 02:10:49,912][52647] DAMAGECOUNT value on done: 285730.0 [2024-08-06 02:10:49,913][52647] Sum rewards: 62.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.836', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.201', 'AMMO3': '0.238', 'weapon2': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '53.000'} [2024-08-06 02:10:50,451][52803] DAMAGECOUNT value on done: 253669.0 [2024-08-06 02:10:50,453][52803] Sum rewards: 64.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.518', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:50,752][52659] DAMAGECOUNT value on done: 276531.0 [2024-08-06 02:10:50,752][52659] Sum rewards: 52.229, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.662', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.000', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '44.000'} [2024-08-06 02:10:50,925][52671] DAMAGECOUNT value on done: 276863.0 [2024-08-06 02:10:50,926][52671] Sum rewards: 75.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'weapon5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '63.000'} [2024-08-06 02:10:51,728][52811] DAMAGECOUNT value on done: 263403.0 [2024-08-06 02:10:51,729][52811] Sum rewards: 76.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.576', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.172', 'weapon2': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.388', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '64.000'} [2024-08-06 02:10:51,921][52670] DAMAGECOUNT value on done: 270038.0 [2024-08-06 02:10:51,923][52670] Sum rewards: 73.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO4': '0.152', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '62.000'} [2024-08-06 02:10:52,087][52647] DAMAGECOUNT value on done: 291546.0 [2024-08-06 02:10:52,088][52647] Sum rewards: 79.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.062', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'weapon4': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO4': '0.163', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.440', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '66.000'} [2024-08-06 02:10:52,159][52666] DAMAGECOUNT value on done: 265633.0 [2024-08-06 02:10:52,160][52666] Sum rewards: 52.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.832', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.086', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.242', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.424', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '45.000'} [2024-08-06 02:10:52,362][52795] DAMAGECOUNT value on done: 255109.0 [2024-08-06 02:10:52,362][52795] Sum rewards: 73.796, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.316', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.096', 'AMMO4': '0.175', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.301', 'WEAPON3': '1.850', 'weapon3': '3.362', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.500'} [2024-08-06 02:10:52,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 295641088. Throughput: 0: 4379.8. Samples: 73914120. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 02:10:52,795][52567] Avg episode reward: [(0, '66.148')] [2024-08-06 02:10:53,619][52803] DAMAGECOUNT value on done: 252981.0 [2024-08-06 02:10:53,619][52803] Sum rewards: 73.637, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.636', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.048', 'weapon4': '0.092', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '65.000'} [2024-08-06 02:10:53,721][52659] DAMAGECOUNT value on done: 272865.0 [2024-08-06 02:10:53,730][52659] Sum rewards: 56.108, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.206', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.184', 'AMMO3': '0.233', 'AMMO4': '0.235', 'weapon2': '0.296', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.862', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '50.000'} [2024-08-06 02:10:53,953][52671] DAMAGECOUNT value on done: 279758.0 [2024-08-06 02:10:53,953][52671] Sum rewards: 62.077, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.182', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'weapon4': '0.072', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.454', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.000'} [2024-08-06 02:10:54,088][52650] Updated weights for policy 0, policy_version 36091 (0.0029) [2024-08-06 02:10:54,580][52647] DAMAGECOUNT value on done: 284750.0 [2024-08-06 02:10:54,580][52647] Sum rewards: 83.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.896', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.154', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '70.000'} [2024-08-06 02:10:54,857][52811] DAMAGECOUNT value on done: 256061.0 [2024-08-06 02:10:54,858][52811] Sum rewards: 55.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.116', 'AMMO3': '0.209', 'AMMO4': '0.218', 'weapon5': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.992', 'WEAPON3': '1.250', 'weapon3': '2.400', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '47.000'} [2024-08-06 02:10:55,019][52670] DAMAGECOUNT value on done: 264266.0 [2024-08-06 02:10:55,020][52670] Sum rewards: 67.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.924', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '58.500'} [2024-08-06 02:10:55,245][52666] DAMAGECOUNT value on done: 277441.0 [2024-08-06 02:10:55,246][52666] Sum rewards: 74.774, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.261', 'weapon2': '0.264', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '65.000'} [2024-08-06 02:10:55,510][52795] DAMAGECOUNT value on done: 246873.0 [2024-08-06 02:10:55,510][52795] Sum rewards: 77.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 02:10:56,427][52663] DAMAGECOUNT value on done: 278035.0 [2024-08-06 02:10:56,430][52663] Sum rewards: 58.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.979', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.866', 'DAMAGECOUNT': '13.485', 'FRAGCOUNT': '48.000'} [2024-08-06 02:10:56,608][52795] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:10:56,759][52803] DAMAGECOUNT value on done: 256168.0 [2024-08-06 02:10:56,761][52803] Sum rewards: 69.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.098', 'weapon5': '0.116', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.194', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:56,786][52659] DAMAGECOUNT value on done: 274363.0 [2024-08-06 02:10:56,787][52659] Sum rewards: 65.103, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.952', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.352', 'weapon4': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '53.000'} [2024-08-06 02:10:56,941][52671] DAMAGECOUNT value on done: 282108.0 [2024-08-06 02:10:56,941][52671] Sum rewards: 63.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.726', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.202', 'AMMO3': '0.234', 'weapon4': '0.240', 'AMMO4': '0.254', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:57,450][52647] DAMAGECOUNT value on done: 287343.0 [2024-08-06 02:10:57,450][52647] Sum rewards: 67.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.035', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.210', 'weapon4': '0.254', 'AMMO4': '0.259', 'weapon2': '0.280', 'weapon5': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '56.000'} [2024-08-06 02:10:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 295723008. Throughput: 0: 4380.4. Samples: 73940110. Policy #0 lag: (min: 1.0, avg: 3.0, max: 8.0) [2024-08-06 02:10:57,794][52567] Avg episode reward: [(0, '66.187')] [2024-08-06 02:10:57,959][52811] DAMAGECOUNT value on done: 257949.0 [2024-08-06 02:10:57,962][52811] Sum rewards: 68.161, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.479', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.114', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.858', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '54.000'} [2024-08-06 02:10:58,172][52650] Updated weights for policy 0, policy_version 36101 (0.0011) [2024-08-06 02:10:58,220][52670] DAMAGECOUNT value on done: 277110.0 [2024-08-06 02:10:58,223][52670] Sum rewards: 76.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.125', 'weapon2': '0.134', 'weapon5': '0.138', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.502', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '64.000'} [2024-08-06 02:10:58,503][52666] DAMAGECOUNT value on done: 275640.0 [2024-08-06 02:10:58,505][52666] Sum rewards: 70.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO2': '0.034', 'WEAPON4': '0.150', 'AMMO4': '0.171', 'weapon4': '0.172', 'AMMO3': '0.229', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '58.000'} [2024-08-06 02:10:58,596][52795] DAMAGECOUNT value on done: 262030.0 [2024-08-06 02:10:58,598][52795] Sum rewards: 66.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.770', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.092', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '59.000'} [2024-08-06 02:10:59,582][52663] DAMAGECOUNT value on done: 276784.0 [2024-08-06 02:10:59,585][52663] Sum rewards: 77.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.234', 'WEAPON3': '1.150', 'weapon3': '3.344', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '64.000'} [2024-08-06 02:10:59,786][52803] DAMAGECOUNT value on done: 251747.0 [2024-08-06 02:10:59,787][52803] Sum rewards: 63.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.505', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.146', 'weapon5': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.110', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '52.000'} [2024-08-06 02:10:59,843][52659] DAMAGECOUNT value on done: 273757.0 [2024-08-06 02:10:59,847][52659] Sum rewards: 65.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.857', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.172', 'weapon5': '0.238', 'weapon2': '0.270', 'AMMO4': '0.307', 'weapon4': '0.380', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '54.500'} [2024-08-06 02:10:59,927][52647] DAMAGECOUNT value on done: 286518.0 [2024-08-06 02:10:59,928][52647] Sum rewards: 67.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '57.000'} [2024-08-06 02:10:59,964][52671] DAMAGECOUNT value on done: 278029.0 [2024-08-06 02:10:59,965][52671] Sum rewards: 65.304, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.443', 'AMMO2': '0.005', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon2': '0.236', 'AMMO3': '0.298', 'WEAPON3': '1.850', 'HITCOUNT': '3.330', 'weapon3': '3.498', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:00,742][52670] DAMAGECOUNT value on done: 273106.0 [2024-08-06 02:11:00,743][52670] Sum rewards: 64.053, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.424', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.140', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.290', 'WEAPON3': '1.800', 'weapon3': '3.272', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '57.000'} [2024-08-06 02:11:00,928][52666] DAMAGECOUNT value on done: 272112.0 [2024-08-06 02:11:00,928][52666] Sum rewards: 75.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.228', 'weapon4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '62.000'} [2024-08-06 02:11:01,035][52811] DAMAGECOUNT value on done: 265733.0 [2024-08-06 02:11:01,036][52811] Sum rewards: 78.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.308', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.224', 'weapon2': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '63.000'} [2024-08-06 02:11:01,719][52795] DAMAGECOUNT value on done: 257218.0 [2024-08-06 02:11:01,719][52795] Sum rewards: 63.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.188', 'AMMO3': '0.212', 'weapon2': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.026', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '53.000'} [2024-08-06 02:11:02,428][52659] DAMAGECOUNT value on done: 270698.0 [2024-08-06 02:11:02,430][52659] Sum rewards: 63.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.534', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:02,490][52671] DAMAGECOUNT value on done: 273155.0 [2024-08-06 02:11:02,491][52671] Sum rewards: 56.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.924', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon2': '0.190', 'AMMO3': '0.191', 'weapon5': '0.224', 'AMMO4': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '45.000'} [2024-08-06 02:11:02,650][52647] DAMAGECOUNT value on done: 295009.0 [2024-08-06 02:11:02,650][52647] Sum rewards: 76.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.236', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.151', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.476', 'WEAPON3': '1.000', 'weapon3': '2.874', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '62.000'} [2024-08-06 02:11:02,744][52663] DAMAGECOUNT value on done: 271765.0 [2024-08-06 02:11:02,744][52663] Sum rewards: 73.661, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.204', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.136', 'weapon4': '0.210', 'AMMO3': '0.216', 'AMMO4': '0.248', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 02:11:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 295813120. Throughput: 0: 4375.4. Samples: 73953320. Policy #0 lag: (min: 1.0, avg: 3.0, max: 8.0) [2024-08-06 02:11:02,796][52567] Avg episode reward: [(0, '66.578')] [2024-08-06 02:11:02,841][52803] DAMAGECOUNT value on done: 262832.0 [2024-08-06 02:11:02,841][52803] Sum rewards: 66.103, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.169', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.166', 'AMMO4': '0.173', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.388', 'ARMOR': '0.492', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.176', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '53.000'} [2024-08-06 02:11:03,185][52650] Updated weights for policy 0, policy_version 36111 (0.0010) [2024-08-06 02:11:03,753][52670] DAMAGECOUNT value on done: 273119.0 [2024-08-06 02:11:03,754][52670] Sum rewards: 73.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.238', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.194', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '62.000'} [2024-08-06 02:11:03,830][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:11:04,106][52666] DAMAGECOUNT value on done: 271387.0 [2024-08-06 02:11:04,107][52666] Sum rewards: 70.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.614', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.124', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:04,177][52811] DAMAGECOUNT value on done: 258822.0 [2024-08-06 02:11:04,177][52811] Sum rewards: 70.900, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.184', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.032', 'weapon4': '0.146', 'AMMO4': '0.161', 'weapon5': '0.188', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:04,810][52795] DAMAGECOUNT value on done: 246674.0 [2024-08-06 02:11:04,812][52795] Sum rewards: 64.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.174', 'weapon4': '0.202', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:05,297][52659] DAMAGECOUNT value on done: 273407.0 [2024-08-06 02:11:05,298][52659] Sum rewards: 65.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.861', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.127', 'weapon5': '0.146', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.150', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:05,327][52647] DAMAGECOUNT value on done: 287767.0 [2024-08-06 02:11:05,327][52647] Sum rewards: 69.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.180', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.170', 'AMMO3': '0.237', 'weapon2': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:05,338][52663] DAMAGECOUNT value on done: 275876.0 [2024-08-06 02:11:05,338][52663] Sum rewards: 72.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.095', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon2': '0.332', 'weapon4': '0.352', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:05,897][52803] DAMAGECOUNT value on done: 259297.0 [2024-08-06 02:11:05,897][52803] Sum rewards: 56.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'weapon2': '0.210', 'WEAPON3': '1.000', 'weapon4': '1.112', 'weapon3': '2.362', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '46.000'} [2024-08-06 02:11:06,807][52670] DAMAGECOUNT value on done: 277355.0 [2024-08-06 02:11:06,807][52670] Sum rewards: 67.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.252', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon2': '0.212', 'weapon4': '0.238', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:07,035][52666] DAMAGECOUNT value on done: 269884.0 [2024-08-06 02:11:07,035][52666] Sum rewards: 60.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.269', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.306', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '51.000'} [2024-08-06 02:11:07,178][52811] DAMAGECOUNT value on done: 257333.0 [2024-08-06 02:11:07,178][52811] Sum rewards: 53.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.289', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.162', 'AMMO3': '0.180', 'weapon2': '0.202', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.206', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '46.000'} [2024-08-06 02:11:07,325][52650] Updated weights for policy 0, policy_version 36121 (0.0044) [2024-08-06 02:11:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 295903232. Throughput: 0: 4376.0. Samples: 73979640. Policy #0 lag: (min: 1.0, avg: 3.0, max: 8.0) [2024-08-06 02:11:07,794][52567] Avg episode reward: [(0, '66.928')] [2024-08-06 02:11:07,977][52795] DAMAGECOUNT value on done: 258720.0 [2024-08-06 02:11:07,978][52795] Sum rewards: 60.901, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.932', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.097', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.150', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '53.000'} [2024-08-06 02:11:08,231][52647] DAMAGECOUNT value on done: 287543.0 [2024-08-06 02:11:08,233][52647] Sum rewards: 82.497, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.106', 'weapon2': '0.166', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'HEALTH': '0.282', 'weapon4': '0.430', 'WEAPON3': '1.050', 'weapon3': '3.088', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '67.000'} [2024-08-06 02:11:08,275][52663] DAMAGECOUNT value on done: 275315.0 [2024-08-06 02:11:08,277][52663] Sum rewards: 65.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.096', 'weapon4': '0.134', 'AMMO4': '0.176', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:08,359][52659] DAMAGECOUNT value on done: 276391.0 [2024-08-06 02:11:08,361][52659] Sum rewards: 64.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.107', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO4': '0.202', 'weapon4': '0.214', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:09,202][52803] DAMAGECOUNT value on done: 255796.0 [2024-08-06 02:11:09,210][52803] Sum rewards: 62.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.199', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.148', 'weapon4': '0.180', 'AMMO4': '0.187', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '53.000'} [2024-08-06 02:11:09,722][52670] DAMAGECOUNT value on done: 274573.0 [2024-08-06 02:11:09,723][52670] Sum rewards: 68.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.138', 'AMMO3': '0.161', 'AMMO4': '0.237', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:09,961][52666] DAMAGECOUNT value on done: 276731.0 [2024-08-06 02:11:09,963][52666] Sum rewards: 69.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.394', 'weapon4': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.664', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:10,176][52811] DAMAGECOUNT value on done: 261690.0 [2024-08-06 02:11:10,177][52811] Sum rewards: 60.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.495', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO4': '0.172', 'AMMO3': '0.203', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.066', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '52.500'} [2024-08-06 02:11:10,249][52820] DAMAGECOUNT value on done: 251551.0 [2024-08-06 02:11:10,249][52820] Sum rewards: 61.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'weapon4': '0.140', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.714', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '52.000'} [2024-08-06 02:11:10,839][52647] DAMAGECOUNT value on done: 286276.0 [2024-08-06 02:11:10,840][52647] Sum rewards: 63.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.184', 'weapon2': '0.240', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:10,920][52663] DAMAGECOUNT value on done: 279891.0 [2024-08-06 02:11:10,922][52663] Sum rewards: 66.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:11,109][52795] DAMAGECOUNT value on done: 258955.0 [2024-08-06 02:11:11,110][52795] Sum rewards: 69.463, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.800', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.194', 'AMMO3': '0.232', 'weapon2': '0.266', 'AMMO4': '0.295', 'weapon4': '0.360', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '61.000'} [2024-08-06 02:11:11,669][52659] DAMAGECOUNT value on done: 271970.0 [2024-08-06 02:11:11,672][52659] Sum rewards: 73.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.178', 'weapon5': '0.184', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:12,116][52803] DAMAGECOUNT value on done: 261233.0 [2024-08-06 02:11:12,118][52803] Sum rewards: 69.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.195', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.184', 'AMMO3': '0.244', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.888', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 02:11:12,270][52650] Updated weights for policy 0, policy_version 36131 (0.0018) [2024-08-06 02:11:12,288][52670] DAMAGECOUNT value on done: 260529.0 [2024-08-06 02:11:12,288][52670] Sum rewards: 63.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.461', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.152', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '2.952', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '51.000'} [2024-08-06 02:11:12,451][52666] DAMAGECOUNT value on done: 266046.0 [2024-08-06 02:11:12,451][52666] Sum rewards: 66.806, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.192', 'weapon2': '0.596', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.254', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 295985152. Throughput: 0: 4376.7. Samples: 74006050. Policy #0 lag: (min: 1.0, avg: 3.0, max: 8.0) [2024-08-06 02:11:12,795][52567] Avg episode reward: [(0, '66.872')] [2024-08-06 02:11:13,294][52811] DAMAGECOUNT value on done: 257148.0 [2024-08-06 02:11:13,296][52811] Sum rewards: 76.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.074', 'AMMO4': '0.124', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '65.000'} [2024-08-06 02:11:13,452][52820] DAMAGECOUNT value on done: 255489.0 [2024-08-06 02:11:13,455][52820] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.145', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '57.000'} [2024-08-06 02:11:13,802][52647] DAMAGECOUNT value on done: 279615.0 [2024-08-06 02:11:13,803][52647] Sum rewards: 70.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.108', 'AMMO4': '0.125', 'weapon5': '0.164', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:13,995][52663] DAMAGECOUNT value on done: 275711.0 [2024-08-06 02:11:13,997][52663] Sum rewards: 58.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.339', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.170', 'AMMO3': '0.216', 'weapon4': '0.278', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.060', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '49.500'} [2024-08-06 02:11:14,589][52659] DAMAGECOUNT value on done: 280428.0 [2024-08-06 02:11:14,591][52659] Sum rewards: 66.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.932', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.172', 'AMMO4': '0.176', 'weapon5': '0.188', 'AMMO3': '0.251', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.112', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '57.000'} [2024-08-06 02:11:15,184][52670] DAMAGECOUNT value on done: 274046.0 [2024-08-06 02:11:15,185][52670] Sum rewards: 58.458, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.176', 'weapon2': '0.502', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '3.164', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '48.000'} [2024-08-06 02:11:15,252][52803] DAMAGECOUNT value on done: 257571.0 [2024-08-06 02:11:15,253][52803] Sum rewards: 58.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.258', 'weapon2': '0.416', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.352', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '51.000'} [2024-08-06 02:11:15,379][52666] DAMAGECOUNT value on done: 274078.0 [2024-08-06 02:11:15,381][52666] Sum rewards: 72.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.226', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '62.000'} [2024-08-06 02:11:16,528][52811] DAMAGECOUNT value on done: 261975.0 [2024-08-06 02:11:16,530][52811] Sum rewards: 64.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO2': '0.045', 'AMMO3': '0.209', 'AMMO4': '0.227', 'weapon2': '0.284', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '54.000'} [2024-08-06 02:11:16,616][52663] DAMAGECOUNT value on done: 272986.0 [2024-08-06 02:11:16,618][52663] Sum rewards: 65.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.132', 'weapon2': '0.172', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:16,630][52647] DAMAGECOUNT value on done: 289056.0 [2024-08-06 02:11:16,631][52647] Sum rewards: 69.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.550', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '61.000'} [2024-08-06 02:11:16,636][52820] DAMAGECOUNT value on done: 253947.0 [2024-08-06 02:11:16,637][52820] Sum rewards: 71.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.506', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.182', 'weapon2': '0.238', 'AMMO4': '0.335', 'weapon5': '0.416', 'weapon4': '0.454', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.580', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '59.500'} [2024-08-06 02:11:16,791][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:11:17,046][52650] Updated weights for policy 0, policy_version 36141 (0.0013) [2024-08-06 02:11:17,486][52659] DAMAGECOUNT value on done: 280935.0 [2024-08-06 02:11:17,487][52659] Sum rewards: 66.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.223', 'weapon4': '0.306', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:17,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.5, 300 sec: 17550.3). Total num frames: 296083456. Throughput: 0: 4384.9. Samples: 74019190. Policy #0 lag: (min: 1.0, avg: 3.0, max: 8.0) [2024-08-06 02:11:17,795][52567] Avg episode reward: [(0, '66.780')] [2024-08-06 02:11:18,078][52666] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:11:18,120][52670] DAMAGECOUNT value on done: 281199.0 [2024-08-06 02:11:18,122][52670] Sum rewards: 57.155, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.284', 'AMMO5': '0.029', 'AMMO2': '0.073', 'AMMO3': '0.220', 'weapon5': '0.304', 'AMMO4': '0.366', 'weapon2': '0.422', 'weapon4': '0.540', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.330', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '51.000'} [2024-08-06 02:11:18,314][52803] DAMAGECOUNT value on done: 255185.0 [2024-08-06 02:11:18,316][52803] Sum rewards: 59.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.120', 'AMMO4': '0.181', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.284', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '50.000'} [2024-08-06 02:11:19,596][52663] DAMAGECOUNT value on done: 274182.0 [2024-08-06 02:11:19,606][52663] Sum rewards: 71.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '3.264', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:19,673][52811] DAMAGECOUNT value on done: 257853.0 [2024-08-06 02:11:19,675][52811] Sum rewards: 57.175, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.960', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.184', 'AMMO4': '0.256', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '2.738', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '51.500'} [2024-08-06 02:11:19,710][52820] DAMAGECOUNT value on done: 247657.0 [2024-08-06 02:11:19,710][52820] Sum rewards: 68.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.425', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.054', 'weapon4': '0.134', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:19,993][52659] DAMAGECOUNT value on done: 276345.0 [2024-08-06 02:11:19,993][52659] Sum rewards: 71.242, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:20,930][52670] DAMAGECOUNT value on done: 273991.0 [2024-08-06 02:11:20,931][52670] Sum rewards: 70.511, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.058', 'weapon5': '0.086', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'HEALTH': '0.260', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:21,417][52650] Updated weights for policy 0, policy_version 36151 (0.0013) [2024-08-06 02:11:21,640][52803] DAMAGECOUNT value on done: 263256.0 [2024-08-06 02:11:21,641][52803] Sum rewards: 73.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.962', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.084', 'AMMO4': '0.213', 'weapon4': '0.240', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 02:11:22,613][52663] DAMAGECOUNT value on done: 277572.0 [2024-08-06 02:11:22,615][52663] Sum rewards: 70.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.245', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.124', 'weapon5': '0.128', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:22,733][52820] DAMAGECOUNT value on done: 254765.0 [2024-08-06 02:11:22,734][52820] Sum rewards: 64.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.005', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.142', 'weapon4': '0.170', 'AMMO3': '0.209', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '2.978', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '53.000'} [2024-08-06 02:11:22,741][52811] DAMAGECOUNT value on done: 253458.0 [2024-08-06 02:11:22,741][52811] Sum rewards: 74.501, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.565', 'AMMO5': '0.011', 'AMMO2': '0.082', 'weapon5': '0.122', 'AMMO3': '0.268', 'weapon4': '0.296', 'weapon2': '0.322', 'WEAPON5': '0.350', 'AMMO4': '0.411', 'WEAPON4': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.952', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '65.000'} [2024-08-06 02:11:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 296165376. Throughput: 0: 4379.6. Samples: 74045430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:11:22,794][52567] Avg episode reward: [(0, '67.161')] [2024-08-06 02:11:22,795][52614] Saving new best policy, reward=67.161! [2024-08-06 02:11:23,342][52659] DAMAGECOUNT value on done: 275371.0 [2024-08-06 02:11:23,342][52659] Sum rewards: 75.987, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.456', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon2': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '66.000'} [2024-08-06 02:11:23,808][52670] DAMAGECOUNT value on done: 275376.0 [2024-08-06 02:11:23,810][52670] Sum rewards: 65.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.068', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.060', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.590', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:24,946][52803] DAMAGECOUNT value on done: 254272.0 [2024-08-06 02:11:24,949][52803] Sum rewards: 55.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.291', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO4': '0.145', 'weapon5': '0.154', 'AMMO3': '0.248', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.178', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '49.000'} [2024-08-06 02:11:25,502][52663] DAMAGECOUNT value on done: 279207.0 [2024-08-06 02:11:25,504][52663] Sum rewards: 70.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.946', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.252', 'weapon4': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '60.000'} [2024-08-06 02:11:25,764][52811] DAMAGECOUNT value on done: 257609.0 [2024-08-06 02:11:25,765][52811] Sum rewards: 68.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.602', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.210', 'AMMO4': '0.215', 'weapon4': '0.258', 'AMMO3': '0.270', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.812', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '60.000'} [2024-08-06 02:11:26,004][52820] DAMAGECOUNT value on done: 251260.0 [2024-08-06 02:11:26,008][52820] Sum rewards: 52.589, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.002', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.174', 'AMMO3': '0.237', 'AMMO4': '0.280', 'weapon2': '0.324', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '49.000'} [2024-08-06 02:11:26,212][52650] Updated weights for policy 0, policy_version 36161 (0.0027) [2024-08-06 02:11:26,268][52659] DAMAGECOUNT value on done: 270058.0 [2024-08-06 02:11:26,268][52659] Sum rewards: 63.919, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:26,436][52670] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:11:27,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 296247296. Throughput: 0: 4376.2. Samples: 74071500. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:11:27,795][52567] Avg episode reward: [(0, '67.026')] [2024-08-06 02:11:27,926][52803] DAMAGECOUNT value on done: 261054.0 [2024-08-06 02:11:27,926][52803] Sum rewards: 68.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.340', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.234', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '57.000'} [2024-08-06 02:11:28,263][52663] DAMAGECOUNT value on done: 274276.0 [2024-08-06 02:11:28,263][52663] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.229', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.140', 'weapon5': '0.202', 'AMMO3': '0.232', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.196', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '54.000'} [2024-08-06 02:11:28,958][52811] DAMAGECOUNT value on done: 261102.0 [2024-08-06 02:11:28,961][52811] Sum rewards: 68.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.472', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.184', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.430', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.564', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:29,111][52659] DAMAGECOUNT value on done: 274462.0 [2024-08-06 02:11:29,112][52659] Sum rewards: 76.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.210', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.256', 'AMMO3': '0.285', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.094', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '67.000'} [2024-08-06 02:11:29,204][52820] DAMAGECOUNT value on done: 254753.0 [2024-08-06 02:11:29,205][52820] Sum rewards: 57.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.900', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '49.000'} [2024-08-06 02:11:30,849][52663] DAMAGECOUNT value on done: 267378.0 [2024-08-06 02:11:30,851][52663] Sum rewards: 72.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO3': '0.172', 'AMMO4': '0.178', 'weapon4': '0.214', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.158', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:31,060][52650] Updated weights for policy 0, policy_version 36171 (0.0022) [2024-08-06 02:11:31,091][52803] DAMAGECOUNT value on done: 253255.0 [2024-08-06 02:11:31,091][52803] Sum rewards: 72.592, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.398', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '60.000'} [2024-08-06 02:11:32,190][52811] DAMAGECOUNT value on done: 255665.0 [2024-08-06 02:11:32,193][52811] Sum rewards: 66.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO4': '0.115', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.426', 'weapon4': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.802', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:32,229][52659] DAMAGECOUNT value on done: 279906.0 [2024-08-06 02:11:32,229][52659] Sum rewards: 70.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:32,283][52820] DAMAGECOUNT value on done: 256965.0 [2024-08-06 02:11:32,286][52820] Sum rewards: 50.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.814', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.187', 'weapon5': '0.188', 'AMMO4': '0.215', 'weapon4': '0.222', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '2.820', 'DAMAGECOUNT': '13.062', 'FRAGCOUNT': '43.000'} [2024-08-06 02:11:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 296337408. Throughput: 0: 4373.6. Samples: 74084520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:11:32,794][52567] Avg episode reward: [(0, '67.046')] [2024-08-06 02:11:34,117][52663] DAMAGECOUNT value on done: 270104.0 [2024-08-06 02:11:34,118][52663] Sum rewards: 77.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.020', 'AMMO2': '0.086', 'AMMO3': '0.166', 'weapon2': '0.262', 'weapon5': '0.358', 'weapon4': '0.428', 'AMMO4': '0.429', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.606', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '61.000'} [2024-08-06 02:11:34,775][52668] Large shaping reward 2.522 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:11:35,103][52659] DAMAGECOUNT value on done: 283610.0 [2024-08-06 02:11:35,103][52659] Sum rewards: 68.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.975', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'weapon5': '0.058', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:35,314][52811] DAMAGECOUNT value on done: 262193.0 [2024-08-06 02:11:35,317][52811] Sum rewards: 52.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.409', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.108', 'weapon5': '0.126', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.184', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '44.000'} [2024-08-06 02:11:35,373][52820] DAMAGECOUNT value on done: 255136.0 [2024-08-06 02:11:35,374][52820] Sum rewards: 64.986, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.176', 'weapon5': '0.222', 'WEAPON4': '0.450', 'weapon2': '0.454', 'weapon4': '0.546', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.486', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:35,727][52650] Updated weights for policy 0, policy_version 36181 (0.0025) [2024-08-06 02:11:37,213][52663] DAMAGECOUNT value on done: 273758.0 [2024-08-06 02:11:37,215][52663] Sum rewards: 58.132, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.900', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.149', 'weapon4': '0.246', 'AMMO4': '0.248', 'weapon5': '0.260', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.450', 'weapon3': '2.856', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '46.000'} [2024-08-06 02:11:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 296427520. Throughput: 0: 4368.0. Samples: 74110680. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:11:37,794][52567] Avg episode reward: [(0, '66.775')] [2024-08-06 02:11:37,840][52659] DAMAGECOUNT value on done: 282079.0 [2024-08-06 02:11:37,840][52659] Sum rewards: 88.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.668', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.094', 'weapon4': '0.108', 'AMMO4': '0.147', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.583', 'FRAGCOUNT': '72.000'} [2024-08-06 02:11:38,393][52649] DAMAGECOUNT value on done: 266554.0 [2024-08-06 02:11:38,395][52649] Sum rewards: 63.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.740', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.152', 'weapon5': '0.200', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.305', 'WEAPON4': '0.400', 'WEAPON3': '1.850', 'HITCOUNT': '3.120', 'weapon3': '3.122', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '57.000'} [2024-08-06 02:11:38,662][52820] DAMAGECOUNT value on done: 256594.0 [2024-08-06 02:11:38,662][52820] Sum rewards: 69.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.098', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'weapon4': '0.230', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:40,122][52663] DAMAGECOUNT value on done: 278150.0 [2024-08-06 02:11:40,122][52663] Sum rewards: 72.803, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.857', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.012', 'AMMO4': '0.055', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '63.000'} [2024-08-06 02:11:40,223][52650] Updated weights for policy 0, policy_version 36191 (0.0012) [2024-08-06 02:11:40,983][52659] DAMAGECOUNT value on done: 276477.0 [2024-08-06 02:11:40,983][52659] Sum rewards: 81.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.772', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'weapon4': '0.102', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.374', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '69.000'} [2024-08-06 02:11:41,499][52649] DAMAGECOUNT value on done: 261612.0 [2024-08-06 02:11:41,500][52649] Sum rewards: 71.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '58.000'} [2024-08-06 02:11:41,815][52820] DAMAGECOUNT value on done: 256688.0 [2024-08-06 02:11:41,815][52820] Sum rewards: 50.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.592', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.960', 'DAMAGECOUNT': '12.438', 'FRAGCOUNT': '45.000'} [2024-08-06 02:11:42,463][52665] DAMAGECOUNT value on done: 270450.0 [2024-08-06 02:11:42,464][52665] Sum rewards: 57.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.471', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.138', 'AMMO4': '0.210', 'AMMO3': '0.221', 'weapon4': '0.236', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '51.000'} [2024-08-06 02:11:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 296517632. Throughput: 0: 4382.0. Samples: 74137300. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:11:42,794][52567] Avg episode reward: [(0, '66.999')] [2024-08-06 02:11:43,104][52663] DAMAGECOUNT value on done: 276913.0 [2024-08-06 02:11:43,105][52663] Sum rewards: 51.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.670', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon7': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.160', 'AMMO3': '0.196', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '2.696', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '45.000'} [2024-08-06 02:11:43,642][52659] DAMAGECOUNT value on done: 279116.0 [2024-08-06 02:11:43,645][52659] Sum rewards: 62.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.006', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.428', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '53.000'} [2024-08-06 02:11:44,455][52664] DAMAGECOUNT value on done: 286219.0 [2024-08-06 02:11:44,456][52664] Sum rewards: 66.060, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon4': '0.142', 'AMMO4': '0.197', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '54.000'} [2024-08-06 02:11:44,608][52649] DAMAGECOUNT value on done: 269387.0 [2024-08-06 02:11:44,611][52649] Sum rewards: 63.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.105', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.074', 'weapon5': '0.170', 'AMMO3': '0.239', 'AMMO4': '0.241', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.230', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:44,888][52650] Updated weights for policy 0, policy_version 36201 (0.0022) [2024-08-06 02:11:45,078][52820] DAMAGECOUNT value on done: 258852.0 [2024-08-06 02:11:45,089][52820] Sum rewards: 63.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'ARMOR': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.143', 'weapon4': '0.176', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '2.936', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '54.000'} [2024-08-06 02:11:45,499][52665] DAMAGECOUNT value on done: 277059.0 [2024-08-06 02:11:45,500][52665] Sum rewards: 61.552, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.910', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.082', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'weapon2': '0.266', 'AMMO3': '0.312', 'WEAPON3': '1.850', 'weapon3': '3.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '57.000'} [2024-08-06 02:11:46,023][52663] DAMAGECOUNT value on done: 281953.0 [2024-08-06 02:11:46,023][52663] Sum rewards: 63.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.468', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.086', 'AMMO3': '0.199', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.344', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:46,068][52659] DAMAGECOUNT value on done: 279992.0 [2024-08-06 02:11:46,068][52659] Sum rewards: 59.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.464', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.088', 'weapon4': '0.116', 'AMMO4': '0.185', 'AMMO3': '0.235', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.324', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '52.000'} [2024-08-06 02:11:47,075][52664] DAMAGECOUNT value on done: 287557.0 [2024-08-06 02:11:47,076][52664] Sum rewards: 62.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.214', 'AMMO5': '0.013', 'AMMO2': '0.062', 'weapon5': '0.192', 'AMMO3': '0.207', 'AMMO4': '0.309', 'weapon2': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.482', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '52.000'} [2024-08-06 02:11:47,692][52649] DAMAGECOUNT value on done: 270582.0 [2024-08-06 02:11:47,694][52649] Sum rewards: 58.574, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.088', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO3': '0.197', 'AMMO4': '0.212', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '48.000'} [2024-08-06 02:11:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 296599552. Throughput: 0: 4386.4. Samples: 74150710. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:11:47,795][52567] Avg episode reward: [(0, '66.241')] [2024-08-06 02:11:48,235][52820] DAMAGECOUNT value on done: 257360.0 [2024-08-06 02:11:48,237][52820] Sum rewards: 58.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.477', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.136', 'weapon4': '0.146', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.096', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '48.000'} [2024-08-06 02:11:48,579][52665] DAMAGECOUNT value on done: 272632.0 [2024-08-06 02:11:48,579][52665] Sum rewards: 60.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.015', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.186', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon5': '0.320', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '50.000'} [2024-08-06 02:11:49,109][52663] DAMAGECOUNT value on done: 278941.0 [2024-08-06 02:11:49,109][52663] Sum rewards: 67.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.093', 'weapon4': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '57.000'} [2024-08-06 02:11:49,801][52650] Updated weights for policy 0, policy_version 36211 (0.0039) [2024-08-06 02:11:49,831][52664] DAMAGECOUNT value on done: 287599.0 [2024-08-06 02:11:49,832][52664] Sum rewards: 63.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.023', 'AMMO2': '0.071', 'AMMO3': '0.201', 'weapon2': '0.230', 'weapon5': '0.340', 'AMMO4': '0.356', 'weapon4': '0.646', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.444', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '51.000'} [2024-08-06 02:11:50,893][52649] DAMAGECOUNT value on done: 261865.0 [2024-08-06 02:11:50,895][52649] Sum rewards: 64.042, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'HEALTH': '0.045', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'weapon4': '0.252', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.082', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '53.000'} [2024-08-06 02:11:51,272][52820] DAMAGECOUNT value on done: 257589.0 [2024-08-06 02:11:51,273][52820] Sum rewards: 64.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.939', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon4': '0.094', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.306', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.320', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '55.000'} [2024-08-06 02:11:51,730][52665] DAMAGECOUNT value on done: 271187.0 [2024-08-06 02:11:51,732][52665] Sum rewards: 67.450, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.215', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.052', 'AMMO4': '0.171', 'weapon5': '0.172', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.308', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2024-08-06 02:11:52,078][52663] DAMAGECOUNT value on done: 270833.0 [2024-08-06 02:11:52,080][52663] Sum rewards: 53.351, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.058', 'weapon5': '0.076', 'AMMO4': '0.129', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.050', 'HITCOUNT': '2.570', 'weapon3': '3.256', 'DAMAGECOUNT': '12.402', 'FRAGCOUNT': '43.000'} [2024-08-06 02:11:52,359][52664] DAMAGECOUNT value on done: 285549.0 [2024-08-06 02:11:52,360][52664] Sum rewards: 73.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.246', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.500', 'weapon3': '2.942', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '63.000'} [2024-08-06 02:11:52,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 296689664. Throughput: 0: 4383.7. Samples: 74176910. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:11:52,795][52567] Avg episode reward: [(0, '65.798')] [2024-08-06 02:11:54,109][52649] DAMAGECOUNT value on done: 271171.0 [2024-08-06 02:11:54,111][52649] Sum rewards: 66.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.724', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.209', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '56.000'} [2024-08-06 02:11:54,251][52650] Updated weights for policy 0, policy_version 36221 (0.0033) [2024-08-06 02:11:54,511][52820] DAMAGECOUNT value on done: 258585.0 [2024-08-06 02:11:54,512][52820] Sum rewards: 72.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.177', 'weapon2': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '60.000'} [2024-08-06 02:11:54,869][52665] DAMAGECOUNT value on done: 266663.0 [2024-08-06 02:11:54,870][52665] Sum rewards: 75.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.167', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '63.000'} [2024-08-06 02:11:54,954][52664] DAMAGECOUNT value on done: 287346.0 [2024-08-06 02:11:54,954][52664] Sum rewards: 61.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.185', 'AMMO5': '0.013', 'AMMO2': '0.058', 'AMMO3': '0.226', 'weapon5': '0.230', 'AMMO4': '0.290', 'weapon4': '0.364', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '52.000'} [2024-08-06 02:11:57,216][52649] DAMAGECOUNT value on done: 266775.0 [2024-08-06 02:11:57,217][52649] Sum rewards: 62.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.646', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.201', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 02:11:57,382][52664] DAMAGECOUNT value on done: 285637.0 [2024-08-06 02:11:57,393][52664] Sum rewards: 56.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.138', 'weapon5': '0.202', 'AMMO3': '0.210', 'AMMO4': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '2.972', 'DAMAGECOUNT': '13.854', 'FRAGCOUNT': '49.000'} [2024-08-06 02:11:57,651][52820] DAMAGECOUNT value on done: 257495.0 [2024-08-06 02:11:57,652][52820] Sum rewards: 57.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.075', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.194', 'weapon5': '0.232', 'AMMO3': '0.258', 'AMMO4': '0.300', 'weapon2': '0.450', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '50.000'} [2024-08-06 02:11:57,683][52614] Signal inference workers to stop experience collection... (6550 times) [2024-08-06 02:11:57,684][52614] Signal inference workers to resume experience collection... (6550 times) [2024-08-06 02:11:57,773][52650] InferenceWorker_p0-w0: stopping experience collection (6550 times) [2024-08-06 02:11:57,773][52650] InferenceWorker_p0-w0: resuming experience collection (6550 times) [2024-08-06 02:11:57,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 296787968. Throughput: 0: 4384.9. Samples: 74203370. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:11:57,794][52567] Avg episode reward: [(0, '65.467')] [2024-08-06 02:11:57,987][52665] DAMAGECOUNT value on done: 266618.0 [2024-08-06 02:11:57,987][52665] Sum rewards: 65.275, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.598', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.068', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.244', 'AMMO3': '0.302', 'WEAPON3': '1.800', 'HITCOUNT': '3.240', 'weapon3': '3.380', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '60.000'} [2024-08-06 02:11:58,995][52650] Updated weights for policy 0, policy_version 36231 (0.0012) [2024-08-06 02:11:59,893][52664] DAMAGECOUNT value on done: 290415.0 [2024-08-06 02:11:59,894][52664] Sum rewards: 50.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.170', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.170', 'AMMO3': '0.175', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.524', 'weapon4': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.422', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '12.993', 'FRAGCOUNT': '41.000'} [2024-08-06 02:12:00,396][52649] DAMAGECOUNT value on done: 274219.0 [2024-08-06 02:12:00,396][52649] Sum rewards: 53.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.472', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.226', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.158', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '45.000'} [2024-08-06 02:12:00,738][52820] DAMAGECOUNT value on done: 251570.0 [2024-08-06 02:12:00,739][52820] Sum rewards: 68.313, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.283', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO3': '0.171', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.324', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:01,161][52665] DAMAGECOUNT value on done: 275816.0 [2024-08-06 02:12:01,165][52665] Sum rewards: 58.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '51.000'} [2024-08-06 02:12:01,376][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:12:02,547][52664] DAMAGECOUNT value on done: 281194.0 [2024-08-06 02:12:02,547][52664] Sum rewards: 61.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.024', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.208', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '51.000'} [2024-08-06 02:12:02,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 296869888. Throughput: 0: 4384.3. Samples: 74216480. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:02,794][52567] Avg episode reward: [(0, '65.228')] [2024-08-06 02:12:03,356][52649] DAMAGECOUNT value on done: 270432.0 [2024-08-06 02:12:03,356][52649] Sum rewards: 71.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '58.000'} [2024-08-06 02:12:03,367][52667] DAMAGECOUNT value on done: 277604.0 [2024-08-06 02:12:03,367][52667] Sum rewards: 64.598, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.379', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.262', 'AMMO3': '0.284', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.914', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.500'} [2024-08-06 02:12:03,587][52650] Updated weights for policy 0, policy_version 36241 (0.0010) [2024-08-06 02:12:03,747][52820] DAMAGECOUNT value on done: 263230.0 [2024-08-06 02:12:03,748][52820] Sum rewards: 65.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.178', 'WEAPON4': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.230', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:04,038][52665] DAMAGECOUNT value on done: 275217.0 [2024-08-06 02:12:04,038][52665] Sum rewards: 71.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.472', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '60.000'} [2024-08-06 02:12:05,498][52664] DAMAGECOUNT value on done: 293875.0 [2024-08-06 02:12:05,499][52664] Sum rewards: 66.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.678', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.222', 'AMMO3': '0.223', 'AMMO4': '0.249', 'weapon2': '0.318', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:05,874][52667] DAMAGECOUNT value on done: 280934.0 [2024-08-06 02:12:05,874][52667] Sum rewards: 74.236, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.159', 'weapon2': '0.714', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '60.000'} [2024-08-06 02:12:06,629][52649] DAMAGECOUNT value on done: 270752.0 [2024-08-06 02:12:06,630][52649] Sum rewards: 74.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.116', 'weapon5': '0.148', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:06,929][52820] DAMAGECOUNT value on done: 266349.0 [2024-08-06 02:12:06,931][52820] Sum rewards: 70.293, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.915', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:07,253][52665] DAMAGECOUNT value on done: 276806.0 [2024-08-06 02:12:07,253][52665] Sum rewards: 68.601, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.415', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.172', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 296951808. Throughput: 0: 4389.8. Samples: 74242970. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:07,794][52567] Avg episode reward: [(0, '65.677')] [2024-08-06 02:12:07,970][52664] DAMAGECOUNT value on done: 285579.0 [2024-08-06 02:12:07,972][52664] Sum rewards: 63.631, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.012', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.124', 'AMMO3': '0.223', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '53.000'} [2024-08-06 02:12:08,374][52650] Updated weights for policy 0, policy_version 36251 (0.0012) [2024-08-06 02:12:08,529][52667] DAMAGECOUNT value on done: 277896.0 [2024-08-06 02:12:08,531][52667] Sum rewards: 65.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.922', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.159', 'weapon4': '0.188', 'AMMO3': '0.196', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:09,744][52649] DAMAGECOUNT value on done: 270738.0 [2024-08-06 02:12:09,745][52649] Sum rewards: 60.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.346', 'WEAPON4': '0.400', 'weapon4': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '49.000'} [2024-08-06 02:12:10,057][52820] DAMAGECOUNT value on done: 253448.0 [2024-08-06 02:12:10,059][52820] Sum rewards: 67.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.701', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.210', 'weapon4': '0.240', 'AMMO3': '0.246', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:10,337][52665] DAMAGECOUNT value on done: 272340.0 [2024-08-06 02:12:10,337][52665] Sum rewards: 65.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.735', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.254', 'weapon2': '0.482', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:10,868][52668] DAMAGECOUNT value on done: 274936.0 [2024-08-06 02:12:10,871][52668] Sum rewards: 59.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.175', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.076', 'AMMO4': '0.144', 'weapon5': '0.210', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '48.000'} [2024-08-06 02:12:11,291][52667] DAMAGECOUNT value on done: 277115.0 [2024-08-06 02:12:11,292][52667] Sum rewards: 71.504, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.720', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.064', 'weapon4': '0.108', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '63.000'} [2024-08-06 02:12:11,333][52664] DAMAGECOUNT value on done: 289845.0 [2024-08-06 02:12:11,335][52664] Sum rewards: 66.062, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.324', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.212', 'weapon2': '0.248', 'AMMO3': '0.251', 'AMMO4': '0.277', 'weapon4': '0.392', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '58.000'} [2024-08-06 02:12:12,727][52649] DAMAGECOUNT value on done: 271198.0 [2024-08-06 02:12:12,729][52649] Sum rewards: 76.250, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.876', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.088', 'weapon5': '0.168', 'AMMO4': '0.179', 'AMMO3': '0.253', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.100', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '65.000'} [2024-08-06 02:12:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 297041920. Throughput: 0: 4395.8. Samples: 74269310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:12:12,794][52567] Avg episode reward: [(0, '65.475')] [2024-08-06 02:12:12,978][52650] Updated weights for policy 0, policy_version 36261 (0.0046) [2024-08-06 02:12:13,244][52665] DAMAGECOUNT value on done: 280856.0 [2024-08-06 02:12:13,248][52665] Sum rewards: 72.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.495', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:13,654][52668] DAMAGECOUNT value on done: 283198.0 [2024-08-06 02:12:13,656][52668] Sum rewards: 65.962, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.338', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.164', 'weapon5': '0.208', 'AMMO3': '0.213', 'AMMO4': '0.242', 'WEAPON5': '0.450', 'weapon2': '0.512', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.860', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '55.500'} [2024-08-06 02:12:13,722][52662] DAMAGECOUNT value on done: 284927.0 [2024-08-06 02:12:13,724][52662] Sum rewards: 77.352, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.078', 'weapon5': '0.132', 'AMMO3': '0.196', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '65.000'} [2024-08-06 02:12:14,168][52667] DAMAGECOUNT value on done: 282046.0 [2024-08-06 02:12:14,169][52667] Sum rewards: 62.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.776', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:14,380][52664] DAMAGECOUNT value on done: 287485.0 [2024-08-06 02:12:14,381][52664] Sum rewards: 61.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.060', 'AMMO3': '0.197', 'weapon5': '0.206', 'AMMO4': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '52.500'} [2024-08-06 02:12:15,933][52649] DAMAGECOUNT value on done: 272546.0 [2024-08-06 02:12:15,933][52649] Sum rewards: 79.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.304', 'weapon4': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 02:12:16,328][52662] DAMAGECOUNT value on done: 284628.0 [2024-08-06 02:12:16,329][52662] Sum rewards: 58.337, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.148', 'weapon5': '0.234', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.530', 'WEAPON3': '0.900', 'weapon3': '2.510', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '46.000'} [2024-08-06 02:12:16,446][52665] DAMAGECOUNT value on done: 276840.0 [2024-08-06 02:12:16,448][52665] Sum rewards: 62.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.778', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '54.000'} [2024-08-06 02:12:16,586][52668] DAMAGECOUNT value on done: 281895.0 [2024-08-06 02:12:16,586][52668] Sum rewards: 53.226, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.937', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.136', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.303', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '2.960', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '48.000'} [2024-08-06 02:12:17,058][52664] DAMAGECOUNT value on done: 290918.0 [2024-08-06 02:12:17,058][52664] Sum rewards: 67.846, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.538', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:17,177][52667] DAMAGECOUNT value on done: 279487.0 [2024-08-06 02:12:17,178][52667] Sum rewards: 67.083, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.132', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.650', 'weapon3': '3.158', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '58.000'} [2024-08-06 02:12:17,755][52650] Updated weights for policy 0, policy_version 36271 (0.0049) [2024-08-06 02:12:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 297132032. Throughput: 0: 4399.1. Samples: 74282480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:12:17,794][52567] Avg episode reward: [(0, '65.655')] [2024-08-06 02:12:18,796][52662] DAMAGECOUNT value on done: 283751.0 [2024-08-06 02:12:18,797][52662] Sum rewards: 66.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.599', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.104', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'weapon4': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '53.000'} [2024-08-06 02:12:18,995][52649] DAMAGECOUNT value on done: 274307.0 [2024-08-06 02:12:18,996][52649] Sum rewards: 55.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.192', 'weapon4': '0.204', 'weapon5': '0.214', 'AMMO4': '0.232', 'weapon2': '0.266', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '3.016', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '48.000'} [2024-08-06 02:12:19,065][52668] DAMAGECOUNT value on done: 281893.0 [2024-08-06 02:12:19,065][52668] Sum rewards: 74.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '60.000'} [2024-08-06 02:12:19,422][52665] DAMAGECOUNT value on done: 275722.0 [2024-08-06 02:12:19,423][52665] Sum rewards: 63.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.231', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.204', 'AMMO3': '0.253', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:19,928][52664] DAMAGECOUNT value on done: 286873.0 [2024-08-06 02:12:19,929][52664] Sum rewards: 64.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.590', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.052', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'weapon2': '0.564', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:20,253][52667] DAMAGECOUNT value on done: 282663.0 [2024-08-06 02:12:20,253][52667] Sum rewards: 77.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.490', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.100', 'AMMO3': '0.177', 'AMMO4': '0.198', 'weapon5': '0.220', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '61.000'} [2024-08-06 02:12:21,702][52668] DAMAGECOUNT value on done: 271591.0 [2024-08-06 02:12:21,704][52668] Sum rewards: 69.018, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.542', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.052', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.284', 'WEAPON3': '1.650', 'weapon3': '3.300', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:22,037][52649] DAMAGECOUNT value on done: 266201.0 [2024-08-06 02:12:22,039][52649] Sum rewards: 53.455, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.986', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.100', 'weapon4': '0.154', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.337', 'weapon2': '0.376', 'WEAPON3': '2.050', 'weapon3': '3.038', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:22,194][52662] DAMAGECOUNT value on done: 275352.0 [2024-08-06 02:12:22,197][52662] Sum rewards: 63.351, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.820', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.148', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'HITCOUNT': '3.280', 'weapon3': '3.512', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:22,245][52650] Updated weights for policy 0, policy_version 36281 (0.0046) [2024-08-06 02:12:22,511][52665] DAMAGECOUNT value on done: 274299.0 [2024-08-06 02:12:22,512][52665] Sum rewards: 59.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.174', 'AMMO3': '0.205', 'AMMO4': '0.256', 'weapon2': '0.290', 'weapon4': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.774', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '51.000'} [2024-08-06 02:12:22,643][52664] DAMAGECOUNT value on done: 291828.0 [2024-08-06 02:12:22,645][52664] Sum rewards: 65.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.214', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.199', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 297222144. Throughput: 0: 4405.1. Samples: 74308910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:12:22,795][52567] Avg episode reward: [(0, '65.167')] [2024-08-06 02:12:23,111][52667] DAMAGECOUNT value on done: 275163.0 [2024-08-06 02:12:23,115][52667] Sum rewards: 58.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon4': '0.362', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.650', 'weapon3': '2.752', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '51.500'} [2024-08-06 02:12:24,731][52668] DAMAGECOUNT value on done: 281779.0 [2024-08-06 02:12:24,732][52668] Sum rewards: 75.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.164', 'weapon4': '0.232', 'AMMO3': '0.237', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '63.000'} [2024-08-06 02:12:24,740][52649] DAMAGECOUNT value on done: 272202.0 [2024-08-06 02:12:24,741][52649] Sum rewards: 75.705, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.734', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.178', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.324', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 02:12:25,015][52665] DAMAGECOUNT value on done: 274323.0 [2024-08-06 02:12:25,016][52665] Sum rewards: 64.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.714', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.128', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '55.500'} [2024-08-06 02:12:25,073][52662] DAMAGECOUNT value on done: 280884.0 [2024-08-06 02:12:25,074][52662] Sum rewards: 76.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.368', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.173', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.000'} [2024-08-06 02:12:25,567][52664] DAMAGECOUNT value on done: 282591.0 [2024-08-06 02:12:25,569][52664] Sum rewards: 53.051, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.912', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.189', 'weapon5': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.450', 'weapon4': '0.632', 'WEAPON3': '1.150', 'weapon3': '2.474', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '43.000'} [2024-08-06 02:12:25,769][52667] DAMAGECOUNT value on done: 277743.0 [2024-08-06 02:12:25,770][52667] Sum rewards: 72.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.266', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon4': '0.120', 'AMMO3': '0.169', 'weapon2': '0.412', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.272', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:26,286][52660] DAMAGECOUNT value on done: 273622.0 [2024-08-06 02:12:26,289][52660] Sum rewards: 61.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.458', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.172', 'AMMO3': '0.229', 'weapon4': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.058', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '54.000'} [2024-08-06 02:12:27,011][52650] Updated weights for policy 0, policy_version 36291 (0.0022) [2024-08-06 02:12:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 297304064. Throughput: 0: 4394.0. Samples: 74335030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:12:27,802][52567] Avg episode reward: [(0, '65.435')] [2024-08-06 02:12:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036292_297304064.pth... [2024-08-06 02:12:27,929][52649] DAMAGECOUNT value on done: 269857.0 [2024-08-06 02:12:27,929][52649] Sum rewards: 68.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.265', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.228', 'weapon4': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '58.000'} [2024-08-06 02:12:27,937][52668] DAMAGECOUNT value on done: 278343.0 [2024-08-06 02:12:27,940][52668] Sum rewards: 70.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.020', 'AMMO2': '0.026', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.196', 'weapon2': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.344', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '58.000'} [2024-08-06 02:12:27,970][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000035779_293101568.pth [2024-08-06 02:12:28,206][52662] DAMAGECOUNT value on done: 274548.0 [2024-08-06 02:12:28,210][52662] Sum rewards: 81.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.711', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon4': '0.338', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '67.000'} [2024-08-06 02:12:28,336][52665] DAMAGECOUNT value on done: 272063.0 [2024-08-06 02:12:28,337][52665] Sum rewards: 76.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.355', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon2': '0.202', 'AMMO3': '0.254', 'WEAPON3': '1.650', 'weapon3': '3.540', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '65.000'} [2024-08-06 02:12:28,733][52664] DAMAGECOUNT value on done: 288431.0 [2024-08-06 02:12:28,733][52664] Sum rewards: 60.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.285', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.114', 'AMMO4': '0.146', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.222', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:28,824][52667] DAMAGECOUNT value on done: 281586.0 [2024-08-06 02:12:28,824][52667] Sum rewards: 71.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.332', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '62.000'} [2024-08-06 02:12:29,375][52660] DAMAGECOUNT value on done: 272943.0 [2024-08-06 02:12:29,378][52660] Sum rewards: 59.781, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '2.956', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '51.000'} [2024-08-06 02:12:30,562][52649] DAMAGECOUNT value on done: 274312.0 [2024-08-06 02:12:30,564][52649] Sum rewards: 63.469, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.365', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.132', 'AMMO3': '0.156', 'AMMO4': '0.190', 'weapon4': '0.202', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.210', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:30,687][52669] DAMAGECOUNT value on done: 281131.0 [2024-08-06 02:12:30,688][52669] Sum rewards: 63.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.163', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '54.000'} [2024-08-06 02:12:30,724][52665] DAMAGECOUNT value on done: 273123.0 [2024-08-06 02:12:30,725][52665] Sum rewards: 76.283, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.706', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.081', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.558', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 02:12:30,905][52649] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:12:31,018][52662] DAMAGECOUNT value on done: 283057.0 [2024-08-06 02:12:31,019][52662] Sum rewards: 49.852, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '2.970', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '44.000'} [2024-08-06 02:12:31,112][52811] Large shaping reward 3.321 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.27, 90.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:12:31,194][52668] DAMAGECOUNT value on done: 277051.0 [2024-08-06 02:12:31,195][52668] Sum rewards: 51.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'weapon4': '0.212', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.008', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '46.000'} [2024-08-06 02:12:31,464][52664] DAMAGECOUNT value on done: 290685.0 [2024-08-06 02:12:31,465][52664] Sum rewards: 70.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.102', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.280', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.386', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:31,563][52650] Updated weights for policy 0, policy_version 36301 (0.0034) [2024-08-06 02:12:31,830][52667] DAMAGECOUNT value on done: 279020.0 [2024-08-06 02:12:31,831][52667] Sum rewards: 61.382, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.418', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.266', 'weapon4': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.550', 'weapon3': '2.816', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '54.000'} [2024-08-06 02:12:32,216][52660] DAMAGECOUNT value on done: 280684.0 [2024-08-06 02:12:32,217][52660] Sum rewards: 70.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.915', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.256', 'weapon2': '0.274', 'WEAPON3': '1.650', 'weapon3': '3.500', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '61.000'} [2024-08-06 02:12:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 297394176. Throughput: 0: 4381.6. Samples: 74347880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:32,794][52567] Avg episode reward: [(0, '65.298')] [2024-08-06 02:12:33,507][52668] DAMAGECOUNT value on done: 278797.0 [2024-08-06 02:12:33,507][52668] Sum rewards: 59.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.344', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.162', 'AMMO4': '0.213', 'weapon2': '0.216', 'AMMO3': '0.249', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:33,555][52649] DAMAGECOUNT value on done: 274629.0 [2024-08-06 02:12:33,559][52649] Sum rewards: 75.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.983', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.056', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '63.000'} [2024-08-06 02:12:33,655][52665] DAMAGECOUNT value on done: 270972.0 [2024-08-06 02:12:33,658][52665] Sum rewards: 56.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.466', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon5': '0.122', 'AMMO3': '0.179', 'weapon2': '0.270', 'AMMO4': '0.323', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '2.948', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '49.000'} [2024-08-06 02:12:33,782][52669] DAMAGECOUNT value on done: 274618.0 [2024-08-06 02:12:33,784][52669] Sum rewards: 61.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.915', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.116', 'weapon4': '0.138', 'AMMO4': '0.249', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.700', 'weapon3': '2.884', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '56.000'} [2024-08-06 02:12:33,962][52664] DAMAGECOUNT value on done: 288072.0 [2024-08-06 02:12:33,962][52664] Sum rewards: 71.890, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.270', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.350', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.500'} [2024-08-06 02:12:34,069][52662] DAMAGECOUNT value on done: 287146.0 [2024-08-06 02:12:34,072][52662] Sum rewards: 55.139, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.820', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon4': '0.090', 'weapon5': '0.148', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'AMMO4': '0.302', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.136', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:34,605][52660] DAMAGECOUNT value on done: 279308.0 [2024-08-06 02:12:34,605][52660] Sum rewards: 56.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.905', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.120', 'weapon5': '0.180', 'AMMO4': '0.182', 'AMMO3': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.656', 'WEAPON3': '1.550', 'weapon3': '2.760', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '49.000'} [2024-08-06 02:12:34,975][52667] DAMAGECOUNT value on done: 280577.0 [2024-08-06 02:12:34,977][52667] Sum rewards: 59.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.262', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.136', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon4': '0.280', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:36,242][52668] DAMAGECOUNT value on done: 278417.0 [2024-08-06 02:12:36,247][52668] Sum rewards: 59.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.254', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.332', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:36,300][52650] Updated weights for policy 0, policy_version 36311 (0.0010) [2024-08-06 02:12:36,474][52664] DAMAGECOUNT value on done: 289464.0 [2024-08-06 02:12:36,474][52664] Sum rewards: 62.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.164', 'weapon5': '0.196', 'AMMO4': '0.243', 'WEAPON5': '0.350', 'weapon4': '0.430', 'WEAPON4': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.510', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:36,615][52649] DAMAGECOUNT value on done: 276845.0 [2024-08-06 02:12:36,615][52649] Sum rewards: 54.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.265', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO3': '0.205', 'AMMO4': '0.216', 'weapon2': '0.272', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.221', 'FRAGCOUNT': '47.000'} [2024-08-06 02:12:36,652][52669] DAMAGECOUNT value on done: 279723.0 [2024-08-06 02:12:36,652][52669] Sum rewards: 66.741, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.134', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.672', 'WEAPON3': '1.250', 'weapon3': '2.676', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:36,688][52665] DAMAGECOUNT value on done: 275361.0 [2024-08-06 02:12:36,688][52665] Sum rewards: 66.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.777', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.080', 'weapon5': '0.190', 'AMMO4': '0.214', 'AMMO3': '0.246', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.982', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '56.000'} [2024-08-06 02:12:36,950][52662] DAMAGECOUNT value on done: 278639.0 [2024-08-06 02:12:36,951][52662] Sum rewards: 66.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.334', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.422', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:37,756][52660] DAMAGECOUNT value on done: 277036.0 [2024-08-06 02:12:37,758][52660] Sum rewards: 67.334, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.985', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.106', 'weapon5': '0.158', 'AMMO4': '0.165', 'weapon2': '0.240', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.160', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 02:12:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 297484288. Throughput: 0: 4392.0. Samples: 74374550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:37,794][52567] Avg episode reward: [(0, '65.134')] [2024-08-06 02:12:38,174][52667] DAMAGECOUNT value on done: 277736.0 [2024-08-06 02:12:38,176][52667] Sum rewards: 61.730, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.565', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon5': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:39,373][52669] DAMAGECOUNT value on done: 276596.0 [2024-08-06 02:12:39,374][52669] Sum rewards: 65.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.737', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.044', 'AMMO4': '0.139', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.492', 'WEAPON3': '0.850', 'weapon3': '2.954', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:39,407][52668] DAMAGECOUNT value on done: 280986.0 [2024-08-06 02:12:39,408][52668] Sum rewards: 68.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.715', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.133', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:39,592][52665] DAMAGECOUNT value on done: 274767.0 [2024-08-06 02:12:39,592][52665] Sum rewards: 63.035, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.277', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO3': '0.167', 'AMMO4': '0.184', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.046', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:39,860][52662] DAMAGECOUNT value on done: 291304.0 [2024-08-06 02:12:39,861][52662] Sum rewards: 57.628, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.582', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.122', 'weapon5': '0.162', 'AMMO4': '0.169', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.410', 'weapon4': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.598', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '46.000'} [2024-08-06 02:12:40,902][52660] DAMAGECOUNT value on done: 272534.0 [2024-08-06 02:12:40,903][52660] Sum rewards: 56.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.745', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.368', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '2.548', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '48.000'} [2024-08-06 02:12:40,962][52650] Updated weights for policy 0, policy_version 36321 (0.0030) [2024-08-06 02:12:41,139][52667] DAMAGECOUNT value on done: 275007.0 [2024-08-06 02:12:41,140][52667] Sum rewards: 57.697, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.064', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.140', 'AMMO3': '0.198', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.106', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '46.000'} [2024-08-06 02:12:41,920][52669] DAMAGECOUNT value on done: 275467.0 [2024-08-06 02:12:41,921][52669] Sum rewards: 64.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.413', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.126', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:42,387][52668] DAMAGECOUNT value on done: 275773.0 [2024-08-06 02:12:42,390][52668] Sum rewards: 78.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'weapon5': '0.026', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.245', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.470', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '67.000'} [2024-08-06 02:12:42,410][52662] DAMAGECOUNT value on done: 276806.0 [2024-08-06 02:12:42,411][52662] Sum rewards: 61.906, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.157', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.088', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.640', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '2.996', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 297574400. Throughput: 0: 4391.1. Samples: 74400970. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:42,794][52567] Avg episode reward: [(0, '65.191')] [2024-08-06 02:12:43,687][52660] DAMAGECOUNT value on done: 279385.0 [2024-08-06 02:12:43,689][52660] Sum rewards: 48.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.033', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.134', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon2': '0.260', 'weapon4': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.038', 'DAMAGECOUNT': '12.834', 'FRAGCOUNT': '43.000'} [2024-08-06 02:12:44,170][52667] DAMAGECOUNT value on done: 283845.0 [2024-08-06 02:12:44,171][52667] Sum rewards: 65.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.075', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.233', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.256', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '56.000'} [2024-08-06 02:12:45,135][52669] DAMAGECOUNT value on done: 277900.0 [2024-08-06 02:12:45,136][52669] Sum rewards: 73.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.598', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.210', 'weapon4': '0.224', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '61.000'} [2024-08-06 02:12:45,418][52668] DAMAGECOUNT value on done: 269871.0 [2024-08-06 02:12:45,418][52668] Sum rewards: 62.001, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.773', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.191', 'weapon5': '0.238', 'weapon4': '0.250', 'AMMO4': '0.276', 'weapon2': '0.356', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:45,528][52662] DAMAGECOUNT value on done: 277940.0 [2024-08-06 02:12:45,530][52662] Sum rewards: 67.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.743', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.094', 'AMMO4': '0.166', 'AMMO3': '0.181', 'weapon4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '58.000'} [2024-08-06 02:12:45,753][52794] DAMAGECOUNT value on done: 282199.0 [2024-08-06 02:12:45,753][52794] Sum rewards: 61.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.094', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:45,843][52650] Updated weights for policy 0, policy_version 36331 (0.0014) [2024-08-06 02:12:46,779][52660] DAMAGECOUNT value on done: 283717.0 [2024-08-06 02:12:46,783][52660] Sum rewards: 55.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.405', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.068', 'weapon4': '0.170', 'AMMO3': '0.175', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '48.000'} [2024-08-06 02:12:46,938][52667] DAMAGECOUNT value on done: 287026.0 [2024-08-06 02:12:46,942][52667] Sum rewards: 67.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.026', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.230', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '58.000'} [2024-08-06 02:12:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 297656320. Throughput: 0: 4394.7. Samples: 74414240. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:47,794][52567] Avg episode reward: [(0, '65.172')] [2024-08-06 02:12:48,338][52669] DAMAGECOUNT value on done: 280619.0 [2024-08-06 02:12:48,338][52669] Sum rewards: 66.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.946', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.210', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:48,520][52662] DAMAGECOUNT value on done: 279929.0 [2024-08-06 02:12:48,520][52662] Sum rewards: 66.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.226', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '56.000'} [2024-08-06 02:12:48,589][52668] DAMAGECOUNT value on done: 271561.0 [2024-08-06 02:12:48,591][52668] Sum rewards: 70.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.136', 'weapon5': '0.176', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '60.000'} [2024-08-06 02:12:48,795][52794] DAMAGECOUNT value on done: 283654.0 [2024-08-06 02:12:48,795][52794] Sum rewards: 67.131, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.164', 'AMMO4': '0.175', 'weapon4': '0.202', 'weapon5': '0.214', 'HEALTH': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '0.950', 'weapon3': '3.018', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '54.000'} [2024-08-06 02:12:49,728][52660] DAMAGECOUNT value on done: 282084.0 [2024-08-06 02:12:49,728][52660] Sum rewards: 49.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.393', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.318', 'WEAPON3': '1.450', 'HITCOUNT': '2.600', 'weapon3': '3.074', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '42.000'} [2024-08-06 02:12:49,785][52667] DAMAGECOUNT value on done: 282454.0 [2024-08-06 02:12:49,787][52667] Sum rewards: 63.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.794', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.133', 'weapon5': '0.172', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '53.000'} [2024-08-06 02:12:50,035][52650] Updated weights for policy 0, policy_version 36341 (0.0011) [2024-08-06 02:12:51,362][52668] DAMAGECOUNT value on done: 273159.0 [2024-08-06 02:12:51,362][52668] Sum rewards: 62.304, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '54.000'} [2024-08-06 02:12:51,474][52669] DAMAGECOUNT value on done: 279760.0 [2024-08-06 02:12:51,474][52669] Sum rewards: 61.920, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.044', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.154', 'weapon4': '0.220', 'AMMO4': '0.287', 'AMMO3': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.870', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '57.000'} [2024-08-06 02:12:51,823][52662] DAMAGECOUNT value on done: 286842.0 [2024-08-06 02:12:51,826][52662] Sum rewards: 58.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.091', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon4': '0.268', 'weapon2': '0.330', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '2.958', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:52,127][52794] DAMAGECOUNT value on done: 280037.0 [2024-08-06 02:12:52,127][52794] Sum rewards: 74.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.105', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '61.000'} [2024-08-06 02:12:52,301][52667] DAMAGECOUNT value on done: 284274.0 [2024-08-06 02:12:52,303][52667] Sum rewards: 57.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO3': '0.238', 'weapon2': '0.244', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.542', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '50.000'} [2024-08-06 02:12:52,526][52658] DAMAGECOUNT value on done: 279706.0 [2024-08-06 02:12:52,527][52658] Sum rewards: 59.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.795', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.092', 'AMMO4': '0.194', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '53.000'} [2024-08-06 02:12:52,788][52660] DAMAGECOUNT value on done: 277603.0 [2024-08-06 02:12:52,789][52660] Sum rewards: 63.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '53.000'} [2024-08-06 02:12:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 297746432. Throughput: 0: 4388.5. Samples: 74440450. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:52,794][52567] Avg episode reward: [(0, '64.740')] [2024-08-06 02:12:54,010][52669] DAMAGECOUNT value on done: 279683.0 [2024-08-06 02:12:54,010][52669] Sum rewards: 43.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.648', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon7': '0.056', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.218', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.960', 'WEAPON3': '1.350', 'weapon3': '2.334', 'HITCOUNT': '2.350', 'DAMAGECOUNT': '11.640', 'FRAGCOUNT': '39.000'} [2024-08-06 02:12:54,431][52668] DAMAGECOUNT value on done: 277692.0 [2024-08-06 02:12:54,432][52668] Sum rewards: 75.154, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.178', 'HEALTH': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '61.000'} [2024-08-06 02:12:54,807][52650] Updated weights for policy 0, policy_version 36351 (0.0011) [2024-08-06 02:12:54,821][52662] DAMAGECOUNT value on done: 279499.0 [2024-08-06 02:12:54,822][52662] Sum rewards: 64.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.881', 'AMMO5': '0.021', 'AMMO2': '0.068', 'AMMO3': '0.212', 'weapon5': '0.254', 'AMMO4': '0.340', 'weapon4': '0.374', 'weapon2': '0.568', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.474', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '55.000'} [2024-08-06 02:12:54,970][52794] DAMAGECOUNT value on done: 280500.0 [2024-08-06 02:12:54,971][52794] Sum rewards: 61.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.344', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.218', 'weapon2': '0.284', 'weapon4': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '52.000'} [2024-08-06 02:12:55,074][52667] DAMAGECOUNT value on done: 274325.0 [2024-08-06 02:12:55,075][52667] Sum rewards: 65.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.826', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.226', 'AMMO3': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.212', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '56.000'} [2024-08-06 02:12:55,321][52658] DAMAGECOUNT value on done: 279166.0 [2024-08-06 02:12:55,322][52658] Sum rewards: 57.649, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.154', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.160', 'weapon2': '0.160', 'AMMO4': '0.203', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '2.914', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '45.000'} [2024-08-06 02:12:55,911][52660] DAMAGECOUNT value on done: 284924.0 [2024-08-06 02:12:55,913][52660] Sum rewards: 68.398, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.400', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.200', 'AMMO3': '0.330', 'weapon4': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.950', 'weapon3': '3.030', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '62.000'} [2024-08-06 02:12:56,719][52669] DAMAGECOUNT value on done: 276236.0 [2024-08-06 02:12:56,720][52669] Sum rewards: 75.103, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.195', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.143', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '65.000'} [2024-08-06 02:12:57,543][52662] DAMAGECOUNT value on done: 292111.0 [2024-08-06 02:12:57,543][52662] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO3': '0.167', 'AMMO4': '0.179', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '54.000'} [2024-08-06 02:12:57,585][52668] DAMAGECOUNT value on done: 278426.0 [2024-08-06 02:12:57,587][52668] Sum rewards: 72.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.189', 'AMMO3': '0.219', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon4': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.638', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '59.000'} [2024-08-06 02:12:57,733][52794] DAMAGECOUNT value on done: 277304.0 [2024-08-06 02:12:57,734][52794] Sum rewards: 59.295, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.304', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.130', 'weapon4': '0.144', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.858', 'WEAPON3': '0.900', 'weapon3': '2.678', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '46.000'} [2024-08-06 02:12:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 297836544. Throughput: 0: 4385.6. Samples: 74466660. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:12:57,794][52567] Avg episode reward: [(0, '64.426')] [2024-08-06 02:12:57,900][52667] DAMAGECOUNT value on done: 281799.0 [2024-08-06 02:12:57,900][52667] Sum rewards: 70.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'weapon4': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.426', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '60.000'} [2024-08-06 02:12:58,055][52658] DAMAGECOUNT value on done: 280755.0 [2024-08-06 02:12:58,056][52658] Sum rewards: 58.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.012', 'AMMO2': '0.065', 'weapon5': '0.174', 'AMMO3': '0.255', 'weapon4': '0.266', 'AMMO4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.802', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '51.000'} [2024-08-06 02:12:58,958][52660] DAMAGECOUNT value on done: 270418.0 [2024-08-06 02:12:58,959][52660] Sum rewards: 76.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.198', 'weapon2': '0.610', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '63.000'} [2024-08-06 02:12:59,375][52650] Updated weights for policy 0, policy_version 36361 (0.0013) [2024-08-06 02:12:59,503][52669] DAMAGECOUNT value on done: 282039.0 [2024-08-06 02:12:59,503][52669] Sum rewards: 65.484, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.060', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:00,134][52662] DAMAGECOUNT value on done: 281541.0 [2024-08-06 02:13:00,134][52662] Sum rewards: 77.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'weapon4': '0.114', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '64.000'} [2024-08-06 02:13:00,267][52668] DAMAGECOUNT value on done: 278126.0 [2024-08-06 02:13:00,269][52668] Sum rewards: 78.675, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon4': '0.216', 'weapon2': '0.254', 'WEAPON3': '1.050', 'weapon3': '3.300', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '62.000'} [2024-08-06 02:13:00,423][52794] DAMAGECOUNT value on done: 280908.0 [2024-08-06 02:13:00,424][52794] Sum rewards: 65.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.617', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.216', 'weapon2': '0.256', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.378', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '54.000'} [2024-08-06 02:13:00,896][52658] DAMAGECOUNT value on done: 279131.0 [2024-08-06 02:13:00,899][52658] Sum rewards: 54.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.258', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.194', 'weapon2': '0.202', 'WEAPON4': '0.400', 'weapon4': '0.536', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.982', 'DAMAGECOUNT': '12.360', 'FRAGCOUNT': '47.000'} [2024-08-06 02:13:01,814][52660] DAMAGECOUNT value on done: 275686.0 [2024-08-06 02:13:01,816][52660] Sum rewards: 72.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.126', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.217', 'AMMO4': '0.220', 'weapon5': '0.272', 'weapon2': '0.316', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.734', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 02:13:02,501][52669] DAMAGECOUNT value on done: 278542.0 [2024-08-06 02:13:02,501][52669] Sum rewards: 60.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.172', 'AMMO4': '0.227', 'AMMO3': '0.254', 'weapon4': '0.264', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.864', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '53.000'} [2024-08-06 02:13:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 297918464. Throughput: 0: 4384.2. Samples: 74479770. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:13:02,794][52567] Avg episode reward: [(0, '64.658')] [2024-08-06 02:13:02,916][52662] DAMAGECOUNT value on done: 282216.0 [2024-08-06 02:13:02,920][52662] Sum rewards: 65.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.218', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.165', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.152', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '55.000'} [2024-08-06 02:13:03,185][52668] DAMAGECOUNT value on done: 280739.0 [2024-08-06 02:13:03,185][52668] Sum rewards: 54.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.190', 'weapon5': '0.196', 'AMMO3': '0.225', 'AMMO4': '0.285', 'weapon2': '0.398', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.902', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '47.000'} [2024-08-06 02:13:03,295][52794] DAMAGECOUNT value on done: 284494.0 [2024-08-06 02:13:03,296][52794] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO3': '0.176', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.470', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '54.000'} [2024-08-06 02:13:03,752][52658] DAMAGECOUNT value on done: 278302.0 [2024-08-06 02:13:03,753][52658] Sum rewards: 48.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.360', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '12.114', 'FRAGCOUNT': '42.000'} [2024-08-06 02:13:04,176][52650] Updated weights for policy 0, policy_version 36371 (0.0026) [2024-08-06 02:13:04,675][52660] DAMAGECOUNT value on done: 283982.0 [2024-08-06 02:13:04,676][52660] Sum rewards: 75.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.092', 'AMMO3': '0.168', 'weapon2': '0.180', 'WEAPON5': '0.250', 'AMMO4': '0.282', 'WEAPON4': '0.500', 'weapon4': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '62.000'} [2024-08-06 02:13:05,535][52669] DAMAGECOUNT value on done: 276496.0 [2024-08-06 02:13:05,536][52669] Sum rewards: 70.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.064', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 02:13:05,747][52662] DAMAGECOUNT value on done: 280530.0 [2024-08-06 02:13:05,747][52662] Sum rewards: 61.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.192', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.214', 'weapon2': '0.226', 'weapon5': '0.226', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.972', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:06,085][52794] DAMAGECOUNT value on done: 280180.0 [2024-08-06 02:13:06,087][52794] Sum rewards: 56.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.685', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.148', 'weapon5': '0.180', 'AMMO3': '0.244', 'AMMO4': '0.246', 'weapon2': '0.346', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.810', 'weapon3': '3.058', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:06,441][52668] DAMAGECOUNT value on done: 277043.0 [2024-08-06 02:13:06,442][52668] Sum rewards: 71.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.964', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.153', 'weapon5': '0.214', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '58.000'} [2024-08-06 02:13:06,530][52658] DAMAGECOUNT value on done: 278272.0 [2024-08-06 02:13:06,531][52658] Sum rewards: 63.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.100', 'AMMO4': '0.210', 'weapon5': '0.218', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '55.000'} [2024-08-06 02:13:07,752][52660] DAMAGECOUNT value on done: 286902.0 [2024-08-06 02:13:07,753][52660] Sum rewards: 58.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.106', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.490', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.044', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '50.000'} [2024-08-06 02:13:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 298008576. Throughput: 0: 4387.1. Samples: 74506330. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:13:07,794][52567] Avg episode reward: [(0, '64.486')] [2024-08-06 02:13:07,939][52662] DAMAGECOUNT value on done: 274397.0 [2024-08-06 02:13:07,940][52662] Sum rewards: 66.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.974', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.223', 'weapon2': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.252', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:08,219][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:13:08,369][52794] DAMAGECOUNT value on done: 286109.0 [2024-08-06 02:13:08,371][52794] Sum rewards: 63.674, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.228', 'weapon2': '0.604', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '54.000'} [2024-08-06 02:13:08,524][52669] DAMAGECOUNT value on done: 280932.0 [2024-08-06 02:13:08,526][52669] Sum rewards: 67.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.392', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.114', 'weapon4': '0.128', 'AMMO4': '0.199', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:08,913][52650] Updated weights for policy 0, policy_version 36381 (0.0011) [2024-08-06 02:13:09,631][52658] DAMAGECOUNT value on done: 284676.0 [2024-08-06 02:13:09,633][52658] Sum rewards: 62.518, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.732', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO4': '0.088', 'weapon5': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.640', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '50.500'} [2024-08-06 02:13:10,387][52660] DAMAGECOUNT value on done: 274503.0 [2024-08-06 02:13:10,390][52660] Sum rewards: 56.877, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.650', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.134', 'AMMO4': '0.198', 'weapon5': '0.198', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.592', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '46.000'} [2024-08-06 02:13:11,579][52669] DAMAGECOUNT value on done: 283644.0 [2024-08-06 02:13:11,579][52669] Sum rewards: 64.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '53.000'} [2024-08-06 02:13:11,585][52794] DAMAGECOUNT value on done: 283002.0 [2024-08-06 02:13:11,585][52794] Sum rewards: 65.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.231', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '57.000'} [2024-08-06 02:13:12,697][52658] DAMAGECOUNT value on done: 272790.0 [2024-08-06 02:13:12,698][52658] Sum rewards: 59.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.078', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:12,796][52567] Fps is (10 sec: 18837.4, 60 sec: 17748.7, 300 sec: 17605.7). Total num frames: 298106880. Throughput: 0: 4388.2. Samples: 74532510. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:13:12,797][52567] Avg episode reward: [(0, '64.055')] [2024-08-06 02:13:13,529][52660] DAMAGECOUNT value on done: 278451.0 [2024-08-06 02:13:13,531][52660] Sum rewards: 60.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.334', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '53.000'} [2024-08-06 02:13:13,996][52650] Updated weights for policy 0, policy_version 36391 (0.0030) [2024-08-06 02:13:14,016][52794] DAMAGECOUNT value on done: 279350.0 [2024-08-06 02:13:14,016][52794] Sum rewards: 60.886, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.025', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.048', 'weapon4': '0.104', 'AMMO4': '0.135', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '0.950', 'HITCOUNT': '2.950', 'weapon3': '3.240', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:14,638][52669] DAMAGECOUNT value on done: 291462.0 [2024-08-06 02:13:14,639][52669] Sum rewards: 59.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.122', 'weapon2': '0.204', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:15,429][52658] DAMAGECOUNT value on done: 285548.0 [2024-08-06 02:13:15,439][52658] Sum rewards: 68.279, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.080', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.182', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '60.000'} [2024-08-06 02:13:16,374][52660] DAMAGECOUNT value on done: 270674.0 [2024-08-06 02:13:16,374][52660] Sum rewards: 68.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.290', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.046', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.376', 'WEAPON3': '1.650', 'weapon3': '3.340', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:17,026][52794] DAMAGECOUNT value on done: 280836.0 [2024-08-06 02:13:17,026][52794] Sum rewards: 71.303, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.134', 'weapon4': '0.148', 'AMMO4': '0.167', 'weapon2': '0.184', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.248', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '62.000'} [2024-08-06 02:13:17,133][52671] DAMAGECOUNT value on done: 282687.0 [2024-08-06 02:13:17,133][52671] Sum rewards: 60.228, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.704', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.178', 'weapon4': '0.218', 'weapon2': '0.220', 'AMMO4': '0.270', 'AMMO3': '0.299', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.800', 'HITCOUNT': '2.950', 'weapon3': '3.078', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 298180608. Throughput: 0: 4394.9. Samples: 74545650. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:13:17,795][52567] Avg episode reward: [(0, '63.744')] [2024-08-06 02:13:17,850][52669] DAMAGECOUNT value on done: 281794.0 [2024-08-06 02:13:17,854][52669] Sum rewards: 80.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '66.000'} [2024-08-06 02:13:18,162][52650] Updated weights for policy 0, policy_version 36401 (0.0024) [2024-08-06 02:13:18,718][52658] DAMAGECOUNT value on done: 284331.0 [2024-08-06 02:13:18,718][52658] Sum rewards: 70.567, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.098', 'AMMO4': '0.158', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'HEALTH': '0.616', 'WEAPON3': '1.000', 'weapon3': '3.064', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '57.000'} [2024-08-06 02:13:19,221][52660] DAMAGECOUNT value on done: 279450.0 [2024-08-06 02:13:19,222][52660] Sum rewards: 64.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.574', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.142', 'AMMO3': '0.196', 'AMMO4': '0.233', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:19,709][52794] DAMAGECOUNT value on done: 273100.0 [2024-08-06 02:13:19,711][52794] Sum rewards: 55.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.986', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.092', 'AMMO4': '0.215', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '47.000'} [2024-08-06 02:13:20,186][52671] DAMAGECOUNT value on done: 280887.0 [2024-08-06 02:13:20,186][52671] Sum rewards: 66.640, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.402', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.134', 'weapon4': '0.142', 'weapon2': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:20,276][52669] DAMAGECOUNT value on done: 285965.0 [2024-08-06 02:13:20,278][52669] Sum rewards: 70.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.266', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.258', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '3.410', 'weapon3': '3.426', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '60.000'} [2024-08-06 02:13:21,533][52658] DAMAGECOUNT value on done: 287603.0 [2024-08-06 02:13:21,543][52658] Sum rewards: 72.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.048', 'weapon4': '0.054', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.220', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '60.000'} [2024-08-06 02:13:22,415][52660] DAMAGECOUNT value on done: 275359.0 [2024-08-06 02:13:22,449][52660] Sum rewards: 57.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.366', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.230', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:22,521][52794] DAMAGECOUNT value on done: 287983.0 [2024-08-06 02:13:22,523][52794] Sum rewards: 57.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon4': '0.114', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'AMMO4': '0.242', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.286', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '50.000'} [2024-08-06 02:13:22,575][52647] DAMAGECOUNT value on done: 296421.0 [2024-08-06 02:13:22,576][52647] Sum rewards: 64.619, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.428', 'HEALTH': '0.564', 'WEAPON3': '1.000', 'HITCOUNT': '3.010', 'weapon3': '3.204', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:22,794][52567] Fps is (10 sec: 16387.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 298270720. Throughput: 0: 4384.7. Samples: 74571860. Policy #0 lag: (min: 2.0, avg: 3.6, max: 8.0) [2024-08-06 02:13:22,794][52567] Avg episode reward: [(0, '63.990')] [2024-08-06 02:13:23,059][52650] Updated weights for policy 0, policy_version 36411 (0.0013) [2024-08-06 02:13:23,153][52669] DAMAGECOUNT value on done: 282122.0 [2024-08-06 02:13:23,155][52669] Sum rewards: 45.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon5': '0.312', 'weapon2': '0.632', 'WEAPON3': '1.450', 'HITCOUNT': '2.430', 'weapon3': '2.692', 'DAMAGECOUNT': '11.970', 'FRAGCOUNT': '41.000'} [2024-08-06 02:13:23,311][52671] DAMAGECOUNT value on done: 281355.0 [2024-08-06 02:13:23,311][52671] Sum rewards: 61.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.226', 'AMMO3': '0.237', 'weapon4': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.700', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '53.000'} [2024-08-06 02:13:24,139][52658] DAMAGECOUNT value on done: 272662.0 [2024-08-06 02:13:24,139][52658] Sum rewards: 60.670, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.734', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.218', 'AMMO3': '0.249', 'weapon4': '0.268', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:25,061][52794] DAMAGECOUNT value on done: 276730.0 [2024-08-06 02:13:25,063][52794] Sum rewards: 61.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.455', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.110', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:25,574][52669] DAMAGECOUNT value on done: 285254.0 [2024-08-06 02:13:25,574][52669] Sum rewards: 52.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.142', 'AMMO4': '0.211', 'AMMO3': '0.227', 'weapon2': '0.244', 'weapon5': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '3.112', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '46.000'} [2024-08-06 02:13:25,701][52647] DAMAGECOUNT value on done: 293945.0 [2024-08-06 02:13:25,702][52647] Sum rewards: 75.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '61.000'} [2024-08-06 02:13:26,539][52671] DAMAGECOUNT value on done: 278761.0 [2024-08-06 02:13:26,550][52671] Sum rewards: 59.611, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.072', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.298', 'WEAPON3': '1.650', 'HITCOUNT': '3.240', 'weapon3': '3.278', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '55.000'} [2024-08-06 02:13:27,370][52658] DAMAGECOUNT value on done: 279841.0 [2024-08-06 02:13:27,370][52658] Sum rewards: 54.672, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.146', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.166', 'weapon4': '0.206', 'AMMO3': '0.235', 'AMMO4': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:27,608][52794] DAMAGECOUNT value on done: 286935.0 [2024-08-06 02:13:27,611][52794] Sum rewards: 47.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.496', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.212', 'weapon4': '0.346', 'WEAPON3': '1.050', 'HITCOUNT': '2.370', 'weapon3': '3.152', 'DAMAGECOUNT': '10.932', 'FRAGCOUNT': '40.000'} [2024-08-06 02:13:27,767][52650] Updated weights for policy 0, policy_version 36421 (0.0014) [2024-08-06 02:13:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 298360832. Throughput: 0: 4385.5. Samples: 74598320. Policy #0 lag: (min: 2.0, avg: 3.6, max: 8.0) [2024-08-06 02:13:27,794][52567] Avg episode reward: [(0, '63.706')] [2024-08-06 02:13:28,019][52666] DAMAGECOUNT value on done: 284135.0 [2024-08-06 02:13:28,019][52666] Sum rewards: 66.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.058', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.174', 'weapon4': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:28,814][52647] DAMAGECOUNT value on done: 293945.0 [2024-08-06 02:13:28,815][52647] Sum rewards: 70.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.046', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.288', 'weapon4': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:29,823][52671] DAMAGECOUNT value on done: 287634.0 [2024-08-06 02:13:29,824][52671] Sum rewards: 67.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.405', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.136', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '55.000'} [2024-08-06 02:13:30,222][52658] DAMAGECOUNT value on done: 279887.0 [2024-08-06 02:13:30,223][52658] Sum rewards: 62.671, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.174', 'weapon5': '0.178', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.600', 'weapon3': '3.022', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.500'} [2024-08-06 02:13:30,554][52794] DAMAGECOUNT value on done: 281718.0 [2024-08-06 02:13:30,556][52794] Sum rewards: 71.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.202', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.144', 'AMMO4': '0.188', 'weapon5': '0.218', 'weapon4': '0.224', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.084', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:30,734][52666] DAMAGECOUNT value on done: 284730.0 [2024-08-06 02:13:30,734][52666] Sum rewards: 60.937, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.812', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.201', 'weapon5': '0.218', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '50.000'} [2024-08-06 02:13:31,806][52794] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:13:31,862][52647] DAMAGECOUNT value on done: 296863.0 [2024-08-06 02:13:31,864][52647] Sum rewards: 69.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.384', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.332', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:32,553][52650] Updated weights for policy 0, policy_version 36431 (0.0012) [2024-08-06 02:13:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 298442752. Throughput: 0: 4378.7. Samples: 74611280. Policy #0 lag: (min: 2.0, avg: 3.6, max: 8.0) [2024-08-06 02:13:32,795][52567] Avg episode reward: [(0, '63.805')] [2024-08-06 02:13:32,793][52671] DAMAGECOUNT value on done: 280214.0 [2024-08-06 02:13:32,796][52671] Sum rewards: 71.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.518', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.406', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:32,977][52667] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon5', 0.002)] [2024-08-06 02:13:33,361][52658] DAMAGECOUNT value on done: 273312.0 [2024-08-06 02:13:33,362][52658] Sum rewards: 57.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.708', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.176', 'AMMO3': '0.217', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:33,363][52794] DAMAGECOUNT value on done: 283372.0 [2024-08-06 02:13:33,365][52794] Sum rewards: 77.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.104', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 02:13:33,550][52666] DAMAGECOUNT value on done: 283984.0 [2024-08-06 02:13:33,551][52666] Sum rewards: 65.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.516', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.144', 'AMMO3': '0.170', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'weapon5': '0.258', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.066', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:34,743][52647] DAMAGECOUNT value on done: 294355.0 [2024-08-06 02:13:34,743][52647] Sum rewards: 59.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.202', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '50.000'} [2024-08-06 02:13:35,468][52671] DAMAGECOUNT value on done: 284514.0 [2024-08-06 02:13:35,468][52671] Sum rewards: 81.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.159', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.045', 'weapon5': '0.154', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.308', 'weapon2': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.720', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '65.000'} [2024-08-06 02:13:35,686][52670] DAMAGECOUNT value on done: 277081.0 [2024-08-06 02:13:35,686][52670] Sum rewards: 66.896, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.016', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.160', 'weapon5': '0.172', 'AMMO4': '0.199', 'AMMO3': '0.229', 'weapon2': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.172', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:35,941][52795] DAMAGECOUNT value on done: 261255.0 [2024-08-06 02:13:35,942][52795] Sum rewards: 84.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.102', 'weapon5': '0.120', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '68.000'} [2024-08-06 02:13:36,057][52794] DAMAGECOUNT value on done: 292602.0 [2024-08-06 02:13:36,059][52794] Sum rewards: 52.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.427', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon5': '0.218', 'weapon2': '0.248', 'AMMO3': '0.269', 'weapon4': '0.286', 'AMMO4': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '2.938', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '45.500'} [2024-08-06 02:13:36,200][52666] DAMAGECOUNT value on done: 279987.0 [2024-08-06 02:13:36,201][52666] Sum rewards: 65.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.136', 'weapon4': '0.176', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '54.500'} [2024-08-06 02:13:36,376][52658] DAMAGECOUNT value on done: 276898.0 [2024-08-06 02:13:36,379][52658] Sum rewards: 74.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.154', 'AMMO4': '0.161', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '60.000'} [2024-08-06 02:13:36,870][52650] Updated weights for policy 0, policy_version 36441 (0.0025) [2024-08-06 02:13:37,391][52647] DAMAGECOUNT value on done: 298929.0 [2024-08-06 02:13:37,391][52647] Sum rewards: 62.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.789', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.200', 'weapon2': '0.320', 'weapon4': '0.322', 'AMMO4': '0.357', 'weapon5': '0.412', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.538', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 298532864. Throughput: 0: 4386.0. Samples: 74637820. Policy #0 lag: (min: 2.0, avg: 3.6, max: 8.0) [2024-08-06 02:13:37,794][52567] Avg episode reward: [(0, '64.436')] [2024-08-06 02:13:38,382][52671] DAMAGECOUNT value on done: 283814.0 [2024-08-06 02:13:38,383][52671] Sum rewards: 68.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.656', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.124', 'AMMO4': '0.186', 'AMMO3': '0.239', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.990', 'weapon3': '3.252', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:38,741][52670] DAMAGECOUNT value on done: 281772.0 [2024-08-06 02:13:38,743][52670] Sum rewards: 61.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.064', 'AMMO4': '0.070', 'weapon4': '0.136', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.430', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:38,854][52794] DAMAGECOUNT value on done: 281245.0 [2024-08-06 02:13:38,859][52794] Sum rewards: 62.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.470', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.070', 'AMMO4': '0.231', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.288', 'ARMOR': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '54.000'} [2024-08-06 02:13:39,117][52795] DAMAGECOUNT value on done: 254318.0 [2024-08-06 02:13:39,117][52795] Sum rewards: 56.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.170', 'AMMO3': '0.194', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.840', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '46.000'} [2024-08-06 02:13:39,283][52658] DAMAGECOUNT value on done: 286021.0 [2024-08-06 02:13:39,283][52658] Sum rewards: 70.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 02:13:39,403][52666] DAMAGECOUNT value on done: 275819.0 [2024-08-06 02:13:39,403][52666] Sum rewards: 57.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.822', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.147', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.422', 'weapon4': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.548', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '46.000'} [2024-08-06 02:13:40,140][52647] DAMAGECOUNT value on done: 293629.0 [2024-08-06 02:13:40,141][52647] Sum rewards: 54.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.148', 'AMMO4': '0.224', 'AMMO3': '0.229', 'weapon2': '0.284', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.938', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '46.000'} [2024-08-06 02:13:40,674][52647] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:13:41,028][52671] DAMAGECOUNT value on done: 275748.0 [2024-08-06 02:13:41,028][52671] Sum rewards: 46.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.353', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.050', 'weapon7': '0.062', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.112', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '3.490', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '39.000'} [2024-08-06 02:13:41,813][52650] Updated weights for policy 0, policy_version 36451 (0.0028) [2024-08-06 02:13:41,907][52670] DAMAGECOUNT value on done: 272532.0 [2024-08-06 02:13:41,907][52670] Sum rewards: 57.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.134', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '2.894', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:42,303][52795] DAMAGECOUNT value on done: 255482.0 [2024-08-06 02:13:42,304][52795] Sum rewards: 74.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.199', 'weapon2': '0.202', 'AMMO3': '0.257', 'weapon4': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '64.000'} [2024-08-06 02:13:42,320][52658] DAMAGECOUNT value on done: 277099.0 [2024-08-06 02:13:42,322][52658] Sum rewards: 77.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.505', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.056', 'AMMO4': '0.059', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '65.000'} [2024-08-06 02:13:42,460][52666] DAMAGECOUNT value on done: 271397.0 [2024-08-06 02:13:42,468][52666] Sum rewards: 66.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.110', 'weapon5': '0.132', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '57.000'} [2024-08-06 02:13:42,666][52647] DAMAGECOUNT value on done: 291372.0 [2024-08-06 02:13:42,668][52647] Sum rewards: 55.920, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.427', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.127', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.270', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.178', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 298622976. Throughput: 0: 4389.1. Samples: 74664170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:13:42,794][52567] Avg episode reward: [(0, '64.309')] [2024-08-06 02:13:43,800][52671] DAMAGECOUNT value on done: 284564.0 [2024-08-06 02:13:43,800][52671] Sum rewards: 68.219, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.214', 'AMMO4': '0.215', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:44,675][52670] DAMAGECOUNT value on done: 274551.0 [2024-08-06 02:13:44,675][52670] Sum rewards: 69.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.217', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.762', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '57.000'} [2024-08-06 02:13:45,271][52658] DAMAGECOUNT value on done: 280500.0 [2024-08-06 02:13:45,273][52658] Sum rewards: 74.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.765', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.128', 'AMMO3': '0.169', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '63.000'} [2024-08-06 02:13:45,359][52666] DAMAGECOUNT value on done: 279095.0 [2024-08-06 02:13:45,359][52666] Sum rewards: 56.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.262', 'WEAPON4': '0.400', 'weapon4': '0.744', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '47.000'} [2024-08-06 02:13:45,423][52647] DAMAGECOUNT value on done: 296717.0 [2024-08-06 02:13:45,423][52647] Sum rewards: 67.760, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'weapon4': '0.114', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '3.066', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:45,492][52795] DAMAGECOUNT value on done: 257522.0 [2024-08-06 02:13:45,492][52795] Sum rewards: 56.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.243', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.185', 'AMMO4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '47.000'} [2024-08-06 02:13:46,199][52650] Updated weights for policy 0, policy_version 36461 (0.0030) [2024-08-06 02:13:46,569][52671] DAMAGECOUNT value on done: 285912.0 [2024-08-06 02:13:46,571][52671] Sum rewards: 70.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.192', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '58.000'} [2024-08-06 02:13:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 298704896. Throughput: 0: 4392.2. Samples: 74677420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:13:47,795][52567] Avg episode reward: [(0, '64.617')] [2024-08-06 02:13:48,056][52670] DAMAGECOUNT value on done: 282792.0 [2024-08-06 02:13:48,058][52670] Sum rewards: 70.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.594', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.069', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.764', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:48,474][52658] DAMAGECOUNT value on done: 283827.0 [2024-08-06 02:13:48,474][52658] Sum rewards: 68.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.498', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '59.000'} [2024-08-06 02:13:48,579][52666] DAMAGECOUNT value on done: 276119.0 [2024-08-06 02:13:48,581][52666] Sum rewards: 62.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.360', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.362', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:48,597][52647] DAMAGECOUNT value on done: 291046.0 [2024-08-06 02:13:48,597][52647] Sum rewards: 59.478, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.134', 'weapon4': '0.178', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.273', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.208', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:48,699][52795] DAMAGECOUNT value on done: 262912.0 [2024-08-06 02:13:48,701][52795] Sum rewards: 72.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.536', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.180', 'AMMO3': '0.230', 'weapon2': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '60.000'} [2024-08-06 02:13:49,338][52671] DAMAGECOUNT value on done: 280220.0 [2024-08-06 02:13:49,339][52671] Sum rewards: 75.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.831', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.152', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '63.000'} [2024-08-06 02:13:50,946][52647] DAMAGECOUNT value on done: 296600.0 [2024-08-06 02:13:50,948][52647] Sum rewards: 61.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.156', 'weapon2': '0.170', 'AMMO3': '0.191', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.378', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '50.000'} [2024-08-06 02:13:51,057][52670] DAMAGECOUNT value on done: 278053.0 [2024-08-06 02:13:51,058][52670] Sum rewards: 64.309, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.142', 'AMMO4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'weapon4': '0.726', 'WEAPON3': '0.900', 'weapon3': '2.552', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:51,288][52650] Updated weights for policy 0, policy_version 36471 (0.0019) [2024-08-06 02:13:51,687][52666] DAMAGECOUNT value on done: 278394.0 [2024-08-06 02:13:51,688][52666] Sum rewards: 76.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.534', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.213', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '62.000'} [2024-08-06 02:13:51,873][52795] DAMAGECOUNT value on done: 259677.0 [2024-08-06 02:13:51,877][52795] Sum rewards: 81.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'AMMO3': '0.268', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '68.000'} [2024-08-06 02:13:52,164][52671] DAMAGECOUNT value on done: 289696.0 [2024-08-06 02:13:52,169][52671] Sum rewards: 58.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.160', 'AMMO3': '0.195', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.886', 'WEAPON3': '1.150', 'weapon3': '2.598', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '49.000'} [2024-08-06 02:13:52,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17578.1). Total num frames: 298803200. Throughput: 0: 4385.1. Samples: 74703660. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:13:52,795][52567] Avg episode reward: [(0, '64.657')] [2024-08-06 02:13:52,960][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:13:53,736][52803] DAMAGECOUNT value on done: 260285.0 [2024-08-06 02:13:53,739][52803] Sum rewards: 63.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO3': '0.180', 'AMMO4': '0.196', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '52.500'} [2024-08-06 02:13:53,822][52647] DAMAGECOUNT value on done: 290755.0 [2024-08-06 02:13:53,823][52647] Sum rewards: 76.866, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.260', 'weapon2': '0.524', 'WEAPON3': '0.800', 'HEALTH': '1.468', 'weapon3': '2.942', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '60.000'} [2024-08-06 02:13:54,070][52670] DAMAGECOUNT value on done: 271606.0 [2024-08-06 02:13:54,070][52670] Sum rewards: 64.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO4': '0.171', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.350', 'weapon4': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:54,574][52666] DAMAGECOUNT value on done: 275704.0 [2024-08-06 02:13:54,576][52666] Sum rewards: 62.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.486', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.356', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '52.000'} [2024-08-06 02:13:54,884][52671] DAMAGECOUNT value on done: 279526.0 [2024-08-06 02:13:54,885][52671] Sum rewards: 65.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.047', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.752', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:55,038][52795] DAMAGECOUNT value on done: 263375.0 [2024-08-06 02:13:55,039][52795] Sum rewards: 65.465, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.810', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon5': '0.084', 'AMMO3': '0.210', 'AMMO4': '0.297', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON4': '0.650', 'weapon4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.480', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:55,469][52650] Updated weights for policy 0, policy_version 36481 (0.0030) [2024-08-06 02:13:56,587][52647] DAMAGECOUNT value on done: 292821.0 [2024-08-06 02:13:56,587][52647] Sum rewards: 65.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.744', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.149', 'weapon4': '0.154', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '55.000'} [2024-08-06 02:13:56,753][52670] DAMAGECOUNT value on done: 276212.0 [2024-08-06 02:13:56,753][52670] Sum rewards: 67.952, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.170', 'AMMO4': '0.181', 'weapon5': '0.220', 'weapon4': '0.298', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.828', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '54.000'} [2024-08-06 02:13:56,877][52803] DAMAGECOUNT value on done: 261830.0 [2024-08-06 02:13:56,877][52803] Sum rewards: 64.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.176', 'AMMO3': '0.212', 'weapon4': '0.212', 'AMMO4': '0.225', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '53.000'} [2024-08-06 02:13:57,286][52666] DAMAGECOUNT value on done: 273898.0 [2024-08-06 02:13:57,290][52666] Sum rewards: 49.753, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.154', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.294', 'WEAPON3': '0.900', 'HITCOUNT': '2.320', 'weapon3': '3.122', 'DAMAGECOUNT': '12.714', 'FRAGCOUNT': '39.000'} [2024-08-06 02:13:57,368][52671] DAMAGECOUNT value on done: 271751.0 [2024-08-06 02:13:57,369][52671] Sum rewards: 68.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.174', 'weapon2': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '56.000'} [2024-08-06 02:13:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 298885120. Throughput: 0: 4383.5. Samples: 74729760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:13:57,802][52567] Avg episode reward: [(0, '64.728')] [2024-08-06 02:13:58,196][52795] DAMAGECOUNT value on done: 260316.0 [2024-08-06 02:13:58,198][52795] Sum rewards: 65.281, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.108', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.106', 'AMMO3': '0.178', 'AMMO4': '0.192', 'weapon5': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '52.500'} [2024-08-06 02:13:59,285][52647] DAMAGECOUNT value on done: 291606.0 [2024-08-06 02:13:59,286][52647] Sum rewards: 63.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.221', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.173', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.780', 'WEAPON3': '0.950', 'weapon3': '2.754', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:59,386][52811] DAMAGECOUNT value on done: 270928.0 [2024-08-06 02:13:59,386][52811] Sum rewards: 66.014, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.173', 'weapon2': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.306', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '54.000'} [2024-08-06 02:13:59,622][52670] DAMAGECOUNT value on done: 274888.0 [2024-08-06 02:13:59,623][52670] Sum rewards: 58.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.944', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.078', 'AMMO4': '0.174', 'weapon5': '0.210', 'AMMO3': '0.247', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.770', 'weapon3': '3.152', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '51.000'} [2024-08-06 02:13:59,994][52803] DAMAGECOUNT value on done: 261414.0 [2024-08-06 02:13:59,996][52803] Sum rewards: 55.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.658', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.330', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.422', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '48.000'} [2024-08-06 02:14:00,071][52666] DAMAGECOUNT value on done: 271242.0 [2024-08-06 02:14:00,074][52666] Sum rewards: 77.623, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.132', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.230', 'weapon2': '0.658', 'WEAPON3': '0.900', 'weapon3': '2.952', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:00,124][52671] DAMAGECOUNT value on done: 282896.0 [2024-08-06 02:14:00,124][52671] Sum rewards: 72.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.745', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.191', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '60.000'} [2024-08-06 02:14:00,341][52659] DAMAGECOUNT value on done: 281591.0 [2024-08-06 02:14:00,342][52659] Sum rewards: 63.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.382', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.296', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.430', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:00,349][52650] Updated weights for policy 0, policy_version 36491 (0.0034) [2024-08-06 02:14:01,237][52795] DAMAGECOUNT value on done: 256885.0 [2024-08-06 02:14:01,238][52795] Sum rewards: 72.212, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.320', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'AMMO3': '0.128', 'weapon4': '0.142', 'weapon2': '0.780', 'WEAPON3': '0.800', 'weapon3': '2.962', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:01,900][52647] DAMAGECOUNT value on done: 299753.0 [2024-08-06 02:14:01,900][52647] Sum rewards: 57.557, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.597', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.153', 'weapon5': '0.164', 'AMMO4': '0.212', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '2.736', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '48.000'} [2024-08-06 02:14:02,440][52811] DAMAGECOUNT value on done: 259410.0 [2024-08-06 02:14:02,442][52811] Sum rewards: 70.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.794', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.058', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:02,659][52670] DAMAGECOUNT value on done: 269956.0 [2024-08-06 02:14:02,661][52670] Sum rewards: 70.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.135', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon4': '0.326', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 298975232. Throughput: 0: 4381.4. Samples: 74742810. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:14:02,802][52567] Avg episode reward: [(0, '65.063')] [2024-08-06 02:14:03,073][52803] DAMAGECOUNT value on done: 262686.0 [2024-08-06 02:14:03,074][52803] Sum rewards: 77.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.682', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.170', 'weapon2': '0.200', 'AMMO3': '0.205', 'WEAPON3': '1.300', 'weapon3': '3.390', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '64.000'} [2024-08-06 02:14:03,154][52671] DAMAGECOUNT value on done: 285114.0 [2024-08-06 02:14:03,156][52671] Sum rewards: 62.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.485', 'AMMO5': '0.010', 'AMMO2': '0.057', 'AMMO3': '0.168', 'weapon5': '0.180', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO4': '0.284', 'WEAPON4': '0.650', 'weapon4': '0.964', 'WEAPON3': '1.000', 'weapon3': '2.330', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '51.000'} [2024-08-06 02:14:03,329][52666] DAMAGECOUNT value on done: 282798.0 [2024-08-06 02:14:03,329][52666] Sum rewards: 65.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.934', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'AMMO4': '0.170', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:03,334][52659] DAMAGECOUNT value on done: 278521.0 [2024-08-06 02:14:03,334][52659] Sum rewards: 72.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.908', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.264', 'weapon2': '0.304', 'WEAPON3': '1.700', 'weapon3': '3.182', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '64.000'} [2024-08-06 02:14:04,231][52795] DAMAGECOUNT value on done: 265779.0 [2024-08-06 02:14:04,233][52795] Sum rewards: 68.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.136', 'weapon5': '0.138', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '57.000'} [2024-08-06 02:14:04,594][52647] DAMAGECOUNT value on done: 293603.0 [2024-08-06 02:14:04,595][52647] Sum rewards: 71.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon4': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '60.000'} [2024-08-06 02:14:04,900][52650] Updated weights for policy 0, policy_version 36501 (0.0013) [2024-08-06 02:14:05,594][52811] DAMAGECOUNT value on done: 263414.0 [2024-08-06 02:14:05,595][52811] Sum rewards: 68.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.138', 'AMMO3': '0.220', 'weapon4': '0.220', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:05,689][52670] DAMAGECOUNT value on done: 282088.0 [2024-08-06 02:14:05,691][52670] Sum rewards: 64.768, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.682', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon5': '0.166', 'weapon4': '0.194', 'AMMO3': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:05,905][52671] DAMAGECOUNT value on done: 287634.0 [2024-08-06 02:14:05,906][52671] Sum rewards: 64.875, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.286', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon4': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:06,012][52659] DAMAGECOUNT value on done: 279606.0 [2024-08-06 02:14:06,012][52659] Sum rewards: 64.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.445', 'AMMO5': '0.014', 'AMMO2': '0.069', 'weapon5': '0.204', 'weapon4': '0.218', 'AMMO3': '0.260', 'weapon2': '0.328', 'AMMO4': '0.345', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.960', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:06,181][52803] DAMAGECOUNT value on done: 265792.0 [2024-08-06 02:14:06,182][52803] Sum rewards: 74.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.532', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO4': '0.146', 'AMMO3': '0.210', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:06,415][52666] DAMAGECOUNT value on done: 281669.0 [2024-08-06 02:14:06,418][52666] Sum rewards: 75.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.593', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '64.000'} [2024-08-06 02:14:06,549][52663] DAMAGECOUNT value on done: 283898.0 [2024-08-06 02:14:06,551][52663] Sum rewards: 70.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.403', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.082', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:07,223][52647] DAMAGECOUNT value on done: 293293.0 [2024-08-06 02:14:07,225][52647] Sum rewards: 71.389, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.092', 'HEALTH': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '60.000'} [2024-08-06 02:14:07,455][52795] DAMAGECOUNT value on done: 259673.0 [2024-08-06 02:14:07,455][52795] Sum rewards: 79.056, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.584', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.334', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '63.500'} [2024-08-06 02:14:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 299057152. Throughput: 0: 4382.4. Samples: 74769070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:14:07,802][52567] Avg episode reward: [(0, '65.683')] [2024-08-06 02:14:08,794][52811] DAMAGECOUNT value on done: 259539.0 [2024-08-06 02:14:08,795][52811] Sum rewards: 65.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.540', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.156', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:08,810][52670] DAMAGECOUNT value on done: 278836.0 [2024-08-06 02:14:08,810][52670] Sum rewards: 61.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.048', 'weapon4': '0.100', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.516', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '52.000'} [2024-08-06 02:14:09,112][52671] DAMAGECOUNT value on done: 283100.0 [2024-08-06 02:14:09,113][52671] Sum rewards: 63.975, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.548', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO3': '0.132', 'AMMO4': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.446', 'weapon2': '0.486', 'WEAPON3': '0.800', 'weapon3': '2.678', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:09,235][52659] DAMAGECOUNT value on done: 279663.0 [2024-08-06 02:14:09,235][52659] Sum rewards: 72.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.746', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.120', 'weapon5': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.602', 'WEAPON3': '1.500', 'weapon3': '2.824', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.000'} [2024-08-06 02:14:09,258][52803] DAMAGECOUNT value on done: 261472.0 [2024-08-06 02:14:09,258][52803] Sum rewards: 54.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO4': '0.113', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.250', 'HITCOUNT': '2.610', 'weapon3': '3.308', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '47.000'} [2024-08-06 02:14:09,495][52666] DAMAGECOUNT value on done: 277107.0 [2024-08-06 02:14:09,498][52666] Sum rewards: 59.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.115', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.112', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.214', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.268', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:09,502][52647] DAMAGECOUNT value on done: 292319.0 [2024-08-06 02:14:09,502][52647] Sum rewards: 74.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.853', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon2': '0.120', 'AMMO3': '0.228', 'weapon4': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.390', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 02:14:09,663][52663] DAMAGECOUNT value on done: 280170.0 [2024-08-06 02:14:09,664][52663] Sum rewards: 40.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.128', 'AMMO3': '0.152', 'AMMO4': '0.261', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.526', 'weapon2': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '2.020', 'weapon3': '2.494', 'DAMAGECOUNT': '9.858', 'FRAGCOUNT': '35.000'} [2024-08-06 02:14:10,061][52650] Updated weights for policy 0, policy_version 36511 (0.0013) [2024-08-06 02:14:10,557][52795] DAMAGECOUNT value on done: 256258.0 [2024-08-06 02:14:10,558][52795] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.436', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.132', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.344', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:11,789][52811] DAMAGECOUNT value on done: 261989.0 [2024-08-06 02:14:11,791][52811] Sum rewards: 72.302, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.867', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.230', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.400', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '62.000'} [2024-08-06 02:14:11,829][52671] DAMAGECOUNT value on done: 278694.0 [2024-08-06 02:14:11,830][52671] Sum rewards: 65.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.556', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.222', 'AMMO3': '0.297', 'WEAPON3': '1.850', 'HITCOUNT': '3.410', 'weapon3': '3.516', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:11,957][52659] DAMAGECOUNT value on done: 275944.0 [2024-08-06 02:14:11,957][52659] Sum rewards: 58.435, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.112', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon4': '0.204', 'AMMO3': '0.279', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.550', 'weapon3': '2.646', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '52.000'} [2024-08-06 02:14:12,030][52670] DAMAGECOUNT value on done: 278700.0 [2024-08-06 02:14:12,034][52670] Sum rewards: 65.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:12,275][52647] DAMAGECOUNT value on done: 284613.0 [2024-08-06 02:14:12,276][52647] Sum rewards: 62.828, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.460', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.134', 'weapon5': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.156', 'WEAPON4': '0.350', 'weapon4': '0.714', 'WEAPON3': '0.850', 'weapon3': '2.772', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '48.000'} [2024-08-06 02:14:12,534][52803] DAMAGECOUNT value on done: 258861.0 [2024-08-06 02:14:12,536][52803] Sum rewards: 71.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.788', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.526', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.230', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:12,687][52666] DAMAGECOUNT value on done: 277031.0 [2024-08-06 02:14:12,690][52666] Sum rewards: 65.095, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.148', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.126', 'weapon2': '0.218', 'AMMO4': '0.237', 'weapon5': '0.244', 'AMMO3': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17340.4, 300 sec: 17522.5). Total num frames: 299147264. Throughput: 0: 4374.4. Samples: 74795170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:14:12,802][52567] Avg episode reward: [(0, '66.232')] [2024-08-06 02:14:12,891][52663] DAMAGECOUNT value on done: 276149.0 [2024-08-06 02:14:12,891][52663] Sum rewards: 47.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.420', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.044', 'AMMO3': '0.194', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.442', 'weapon4': '0.582', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.544', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '12.792', 'FRAGCOUNT': '43.000'} [2024-08-06 02:14:13,694][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:14:13,733][52795] DAMAGECOUNT value on done: 252459.0 [2024-08-06 02:14:13,734][52795] Sum rewards: 57.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.345', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.138', 'weapon4': '0.178', 'AMMO4': '0.186', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '2.954', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '48.000'} [2024-08-06 02:14:14,140][52614] Signal inference workers to stop experience collection... (6600 times) [2024-08-06 02:14:14,142][52614] Signal inference workers to resume experience collection... (6600 times) [2024-08-06 02:14:14,190][52650] InferenceWorker_p0-w0: stopping experience collection (6600 times) [2024-08-06 02:14:14,190][52650] InferenceWorker_p0-w0: resuming experience collection (6600 times) [2024-08-06 02:14:14,258][52650] Updated weights for policy 0, policy_version 36521 (0.0015) [2024-08-06 02:14:14,652][52659] DAMAGECOUNT value on done: 279084.0 [2024-08-06 02:14:14,655][52659] Sum rewards: 73.046, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.090', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.346', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:14,803][52670] DAMAGECOUNT value on done: 283051.0 [2024-08-06 02:14:14,804][52670] Sum rewards: 65.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.004', 'weapon5': '0.028', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:14,946][52811] DAMAGECOUNT value on done: 269024.0 [2024-08-06 02:14:14,947][52811] Sum rewards: 70.908, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.788', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.096', 'AMMO4': '0.159', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:14,955][52647] DAMAGECOUNT value on done: 294525.0 [2024-08-06 02:14:14,958][52647] Sum rewards: 69.265, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.182', 'AMMO3': '0.198', 'weapon2': '0.202', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:15,324][52666] DAMAGECOUNT value on done: 274991.0 [2024-08-06 02:14:15,328][52666] Sum rewards: 65.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.098', 'weapon4': '0.156', 'AMMO3': '0.192', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.390', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:15,538][52803] DAMAGECOUNT value on done: 259046.0 [2024-08-06 02:14:15,541][52803] Sum rewards: 74.711, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.679', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.163', 'weapon5': '0.230', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.432', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:15,588][52663] DAMAGECOUNT value on done: 281428.0 [2024-08-06 02:14:15,589][52663] Sum rewards: 66.406, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.430', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.151', 'weapon2': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.256', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.136', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:16,823][52795] DAMAGECOUNT value on done: 261322.0 [2024-08-06 02:14:16,823][52795] Sum rewards: 72.399, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.220', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.222', 'weapon2': '0.252', 'AMMO3': '0.281', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '63.000'} [2024-08-06 02:14:17,254][52670] DAMAGECOUNT value on done: 279561.0 [2024-08-06 02:14:17,258][52670] Sum rewards: 56.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.168', 'weapon4': '0.178', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '47.000'} [2024-08-06 02:14:17,623][52659] DAMAGECOUNT value on done: 281418.0 [2024-08-06 02:14:17,625][52659] Sum rewards: 64.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.116', 'AMMO3': '0.177', 'AMMO4': '0.178', 'weapon5': '0.260', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '3.004', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '53.000'} [2024-08-06 02:14:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 299237376. Throughput: 0: 4379.1. Samples: 74808340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:14:17,794][52567] Avg episode reward: [(0, '65.886')] [2024-08-06 02:14:17,819][52666] DAMAGECOUNT value on done: 282697.0 [2024-08-06 02:14:17,819][52666] Sum rewards: 74.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.159', 'AMMO4': '0.170', 'weapon5': '0.214', 'weapon4': '0.468', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '2.386', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '60.000'} [2024-08-06 02:14:18,086][52811] DAMAGECOUNT value on done: 261751.0 [2024-08-06 02:14:18,086][52811] Sum rewards: 69.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.072', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.422', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:18,653][52803] DAMAGECOUNT value on done: 261352.0 [2024-08-06 02:14:18,653][52803] Sum rewards: 64.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.364', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.059', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.506', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.278', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '52.000'} [2024-08-06 02:14:18,962][52663] DAMAGECOUNT value on done: 280550.0 [2024-08-06 02:14:18,962][52663] Sum rewards: 59.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.094', 'weapon2': '0.156', 'AMMO4': '0.192', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.152', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '48.500'} [2024-08-06 02:14:19,091][52650] Updated weights for policy 0, policy_version 36531 (0.0016) [2024-08-06 02:14:19,967][52795] DAMAGECOUNT value on done: 252403.0 [2024-08-06 02:14:19,968][52795] Sum rewards: 67.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.048', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '57.000'} [2024-08-06 02:14:20,396][52670] DAMAGECOUNT value on done: 265812.0 [2024-08-06 02:14:20,397][52670] Sum rewards: 71.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.136', 'weapon5': '0.176', 'AMMO3': '0.185', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.120', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:20,417][52659] DAMAGECOUNT value on done: 276760.0 [2024-08-06 02:14:20,417][52659] Sum rewards: 59.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'weapon4': '0.518', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '49.000'} [2024-08-06 02:14:20,763][52666] DAMAGECOUNT value on done: 271418.0 [2024-08-06 02:14:20,763][52666] Sum rewards: 59.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.606', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.042', 'weapon4': '0.080', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.334', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.328', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:21,291][52811] DAMAGECOUNT value on done: 263144.0 [2024-08-06 02:14:21,294][52811] Sum rewards: 65.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.028', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.249', 'weapon2': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '3.420', 'weapon3': '3.434', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:21,650][52803] DAMAGECOUNT value on done: 258357.0 [2024-08-06 02:14:21,652][52803] Sum rewards: 83.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.752', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.292', 'WEAPON4': '0.400', 'weapon4': '0.662', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '67.000'} [2024-08-06 02:14:21,796][52663] DAMAGECOUNT value on done: 285505.0 [2024-08-06 02:14:21,796][52663] Sum rewards: 72.992, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.223', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.119', 'AMMO3': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '0.900', 'HITCOUNT': '3.210', 'weapon3': '3.216', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2024-08-06 02:14:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 299319296. Throughput: 0: 4371.1. Samples: 74834520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:14:22,794][52567] Avg episode reward: [(0, '66.563')] [2024-08-06 02:14:22,944][52659] DAMAGECOUNT value on done: 286616.0 [2024-08-06 02:14:22,945][52659] Sum rewards: 72.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.257', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:23,057][52795] DAMAGECOUNT value on done: 268060.0 [2024-08-06 02:14:23,058][52795] Sum rewards: 73.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.772', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '60.000'} [2024-08-06 02:14:23,346][52670] DAMAGECOUNT value on done: 278488.0 [2024-08-06 02:14:23,350][52670] Sum rewards: 51.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '3.230', 'DAMAGECOUNT': '13.326', 'FRAGCOUNT': '43.000'} [2024-08-06 02:14:23,917][52666] DAMAGECOUNT value on done: 279546.0 [2024-08-06 02:14:23,920][52666] Sum rewards: 68.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.083', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.036', 'weapon4': '0.044', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.308', 'WEAPON3': '1.150', 'weapon3': '3.470', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:23,921][52650] Updated weights for policy 0, policy_version 36541 (0.0017) [2024-08-06 02:14:24,519][52811] DAMAGECOUNT value on done: 271299.0 [2024-08-06 02:14:24,519][52811] Sum rewards: 70.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.253', 'weapon2': '0.452', 'WEAPON3': '1.600', 'weapon3': '3.316', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:24,673][52663] DAMAGECOUNT value on done: 281579.0 [2024-08-06 02:14:24,674][52663] Sum rewards: 67.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.400', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.514', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '57.000'} [2024-08-06 02:14:24,708][52803] DAMAGECOUNT value on done: 267985.0 [2024-08-06 02:14:24,709][52803] Sum rewards: 69.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.247', 'weapon2': '0.392', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.300', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:26,043][52670] DAMAGECOUNT value on done: 286229.0 [2024-08-06 02:14:26,053][52670] Sum rewards: 58.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.994', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO4': '0.218', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'weapon4': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:26,174][52795] DAMAGECOUNT value on done: 263532.0 [2024-08-06 02:14:26,176][52795] Sum rewards: 75.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.076', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:26,198][52659] DAMAGECOUNT value on done: 286982.0 [2024-08-06 02:14:26,200][52659] Sum rewards: 71.356, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.345', 'AMMO5': '0.031', 'AMMO2': '0.077', 'weapon4': '0.192', 'AMMO3': '0.203', 'weapon5': '0.268', 'weapon2': '0.296', 'AMMO4': '0.386', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '62.500'} [2024-08-06 02:14:27,543][52811] DAMAGECOUNT value on done: 262999.0 [2024-08-06 02:14:27,543][52811] Sum rewards: 56.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.106', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.736', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '2.880', 'DAMAGECOUNT': '12.531', 'FRAGCOUNT': '48.000'} [2024-08-06 02:14:27,613][52663] DAMAGECOUNT value on done: 279656.0 [2024-08-06 02:14:27,615][52663] Sum rewards: 81.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.925', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.160', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'weapon4': '0.306', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 02:14:27,640][52649] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:14:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 299417600. Throughput: 0: 4370.2. Samples: 74860830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:14:27,795][52567] Avg episode reward: [(0, '66.763')] [2024-08-06 02:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036550_299417600.pth... [2024-08-06 02:14:27,900][52803] DAMAGECOUNT value on done: 264312.0 [2024-08-06 02:14:27,902][52803] Sum rewards: 58.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.408', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.064', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:27,931][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036035_295198720.pth [2024-08-06 02:14:28,508][52650] Updated weights for policy 0, policy_version 36551 (0.0038) [2024-08-06 02:14:29,247][52670] DAMAGECOUNT value on done: 279489.0 [2024-08-06 02:14:29,247][52670] Sum rewards: 68.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.151', 'weapon5': '0.234', 'AMMO4': '0.246', 'weapon2': '0.248', 'weapon4': '0.526', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:29,335][52795] DAMAGECOUNT value on done: 252526.0 [2024-08-06 02:14:29,335][52795] Sum rewards: 65.524, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.936', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.253', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '55.500'} [2024-08-06 02:14:29,357][52659] DAMAGECOUNT value on done: 281455.0 [2024-08-06 02:14:29,357][52659] Sum rewards: 64.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.610', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'AMMO4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.290', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.170', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:30,473][52811] DAMAGECOUNT value on done: 262667.0 [2024-08-06 02:14:30,474][52811] Sum rewards: 63.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.179', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.080', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.000'} [2024-08-06 02:14:30,671][52663] DAMAGECOUNT value on done: 279933.0 [2024-08-06 02:14:30,671][52663] Sum rewards: 77.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.180', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.170', 'AMMO3': '0.178', 'weapon5': '0.190', 'AMMO4': '0.252', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '63.000'} [2024-08-06 02:14:31,021][52803] DAMAGECOUNT value on done: 261013.0 [2024-08-06 02:14:31,023][52803] Sum rewards: 64.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.100', 'weapon4': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO4': '0.220', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.330', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:32,017][52659] DAMAGECOUNT value on done: 281711.0 [2024-08-06 02:14:32,017][52659] Sum rewards: 80.787, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.952', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.104', 'AMMO3': '0.180', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.326', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 02:14:32,424][52670] DAMAGECOUNT value on done: 279934.0 [2024-08-06 02:14:32,424][52670] Sum rewards: 60.709, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.520', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'AMMO3': '0.134', 'weapon4': '0.242', 'weapon2': '0.600', 'WEAPON3': '0.800', 'weapon3': '3.076', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:32,539][52795] DAMAGECOUNT value on done: 263933.0 [2024-08-06 02:14:32,540][52795] Sum rewards: 63.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.232', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.066', 'weapon5': '0.086', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.404', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.242', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 299499520. Throughput: 0: 4364.9. Samples: 74873840. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-06 02:14:32,794][52567] Avg episode reward: [(0, '66.528')] [2024-08-06 02:14:32,939][52650] Updated weights for policy 0, policy_version 36561 (0.0015) [2024-08-06 02:14:33,227][52663] DAMAGECOUNT value on done: 282142.0 [2024-08-06 02:14:33,227][52663] Sum rewards: 51.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.326', 'weapon4': '0.328', 'AMMO4': '0.331', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '44.000'} [2024-08-06 02:14:33,584][52811] DAMAGECOUNT value on done: 266860.0 [2024-08-06 02:14:33,587][52811] Sum rewards: 61.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.400', 'AMMO2': '0.020', 'weapon4': '0.086', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.270', 'weapon2': '0.314', 'WEAPON3': '1.550', 'HITCOUNT': '3.320', 'weapon3': '3.422', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:34,204][52803] DAMAGECOUNT value on done: 267812.0 [2024-08-06 02:14:34,204][52803] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '68.000'} [2024-08-06 02:14:34,746][52659] DAMAGECOUNT value on done: 273982.0 [2024-08-06 02:14:34,750][52659] Sum rewards: 42.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.710', 'AMMO2': '0.006', 'AMMO5': '0.008', 'weapon4': '0.022', 'AMMO4': '0.031', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.544', 'WEAPON3': '1.450', 'HITCOUNT': '2.450', 'weapon3': '3.236', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '38.000'} [2024-08-06 02:14:34,896][52820] DAMAGECOUNT value on done: 257065.0 [2024-08-06 02:14:34,898][52820] Sum rewards: 62.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.116', 'AMMO5': '0.023', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.198', 'weapon5': '0.228', 'weapon2': '0.360', 'WEAPON5': '0.400', 'weapon4': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.632', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '52.000'} [2024-08-06 02:14:35,984][52795] DAMAGECOUNT value on done: 265251.0 [2024-08-06 02:14:35,984][52795] Sum rewards: 76.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '62.000'} [2024-08-06 02:14:36,158][52663] DAMAGECOUNT value on done: 284023.0 [2024-08-06 02:14:36,158][52663] Sum rewards: 58.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.978', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.760', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '48.000'} [2024-08-06 02:14:36,547][52811] DAMAGECOUNT value on done: 262307.0 [2024-08-06 02:14:36,547][52811] Sum rewards: 61.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.122', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO4': '0.204', 'AMMO3': '0.218', 'weapon4': '0.240', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.000'} [2024-08-06 02:14:37,295][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:14:37,369][52803] DAMAGECOUNT value on done: 261845.0 [2024-08-06 02:14:37,370][52803] Sum rewards: 51.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.033', 'WEAPON5': '0.050', 'AMMO4': '0.165', 'weapon4': '0.176', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.682', 'WEAPON3': '1.200', 'HITCOUNT': '2.700', 'weapon3': '2.960', 'DAMAGECOUNT': '12.822', 'FRAGCOUNT': '44.000'} [2024-08-06 02:14:37,561][52659] DAMAGECOUNT value on done: 280958.0 [2024-08-06 02:14:37,561][52659] Sum rewards: 77.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.218', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.086', 'weapon5': '0.160', 'AMMO3': '0.205', 'AMMO4': '0.273', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '64.000'} [2024-08-06 02:14:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 299581440. Throughput: 0: 4369.1. Samples: 74900270. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-06 02:14:37,794][52567] Avg episode reward: [(0, '66.224')] [2024-08-06 02:14:37,951][52820] DAMAGECOUNT value on done: 260559.0 [2024-08-06 02:14:37,953][52820] Sum rewards: 62.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.346', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.152', 'AMMO3': '0.182', 'weapon4': '0.232', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '51.000'} [2024-08-06 02:14:38,203][52650] Updated weights for policy 0, policy_version 36571 (0.0015) [2024-08-06 02:14:39,264][52663] DAMAGECOUNT value on done: 280011.0 [2024-08-06 02:14:39,266][52663] Sum rewards: 67.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:39,718][52811] DAMAGECOUNT value on done: 267015.0 [2024-08-06 02:14:39,719][52811] Sum rewards: 61.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.062', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.136', 'weapon4': '0.158', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.248', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '49.000'} [2024-08-06 02:14:40,455][52803] DAMAGECOUNT value on done: 260676.0 [2024-08-06 02:14:40,457][52803] Sum rewards: 67.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.308', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.114', 'weapon5': '0.168', 'AMMO3': '0.199', 'AMMO4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:40,569][52659] DAMAGECOUNT value on done: 286161.0 [2024-08-06 02:14:40,570][52659] Sum rewards: 75.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.593', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.372', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:40,994][52820] DAMAGECOUNT value on done: 259304.0 [2024-08-06 02:14:41,002][52820] Sum rewards: 66.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.218', 'AMMO3': '0.233', 'weapon4': '0.240', 'AMMO4': '0.280', 'weapon2': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.908', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:42,398][52650] Updated weights for policy 0, policy_version 36581 (0.0011) [2024-08-06 02:14:42,438][52663] DAMAGECOUNT value on done: 273231.0 [2024-08-06 02:14:42,438][52663] Sum rewards: 69.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.006', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.162', 'weapon2': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '57.000'} [2024-08-06 02:14:42,734][52811] DAMAGECOUNT value on done: 264088.0 [2024-08-06 02:14:42,734][52811] Sum rewards: 71.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.266', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.138', 'weapon5': '0.162', 'AMMO3': '0.189', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 299671552. Throughput: 0: 4378.7. Samples: 74926800. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-06 02:14:42,795][52567] Avg episode reward: [(0, '66.607')] [2024-08-06 02:14:43,440][52659] DAMAGECOUNT value on done: 289526.0 [2024-08-06 02:14:43,443][52659] Sum rewards: 75.656, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.225', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.168', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.906', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 02:14:43,465][52803] DAMAGECOUNT value on done: 268605.0 [2024-08-06 02:14:43,465][52803] Sum rewards: 59.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.132', 'weapon5': '0.186', 'weapon2': '0.214', 'AMMO4': '0.225', 'AMMO3': '0.229', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.210', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '49.000'} [2024-08-06 02:14:44,130][52820] DAMAGECOUNT value on done: 254390.0 [2024-08-06 02:14:44,130][52820] Sum rewards: 78.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.738', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.086', 'weapon5': '0.160', 'AMMO4': '0.195', 'weapon2': '0.214', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '66.000'} [2024-08-06 02:14:45,044][52663] DAMAGECOUNT value on done: 276112.0 [2024-08-06 02:14:45,046][52663] Sum rewards: 75.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.800', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.197', 'AMMO4': '0.210', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 02:14:45,711][52811] DAMAGECOUNT value on done: 259267.0 [2024-08-06 02:14:45,711][52811] Sum rewards: 76.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.236', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon2': '0.310', 'weapon4': '0.326', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '63.000'} [2024-08-06 02:14:45,873][52659] DAMAGECOUNT value on done: 286640.0 [2024-08-06 02:14:45,873][52659] Sum rewards: 57.129, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.035', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.147', 'AMMO4': '0.150', 'weapon5': '0.184', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.490', 'weapon3': '2.988', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '47.000'} [2024-08-06 02:14:46,593][52803] DAMAGECOUNT value on done: 259928.0 [2024-08-06 02:14:46,599][52803] Sum rewards: 70.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.504', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.088', 'weapon5': '0.088', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:47,273][52820] DAMAGECOUNT value on done: 261192.0 [2024-08-06 02:14:47,274][52820] Sum rewards: 77.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.856', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.205', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '63.000'} [2024-08-06 02:14:47,366][52650] Updated weights for policy 0, policy_version 36591 (0.0019) [2024-08-06 02:14:47,538][52664] DAMAGECOUNT value on done: 291791.0 [2024-08-06 02:14:47,539][52664] Sum rewards: 66.229, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.250', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon5': '0.060', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO4': '0.224', 'AMMO3': '0.230', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:47,775][52663] DAMAGECOUNT value on done: 278889.0 [2024-08-06 02:14:47,775][52663] Sum rewards: 56.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.140', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.184', 'weapon2': '0.206', 'AMMO3': '0.232', 'AMMO4': '0.297', 'WEAPON5': '0.300', 'weapon4': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '48.500'} [2024-08-06 02:14:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 299761664. Throughput: 0: 4382.7. Samples: 74940030. Policy #0 lag: (min: 0.0, avg: 2.8, max: 8.0) [2024-08-06 02:14:47,794][52567] Avg episode reward: [(0, '66.840')] [2024-08-06 02:14:48,653][52659] DAMAGECOUNT value on done: 282106.0 [2024-08-06 02:14:48,654][52659] Sum rewards: 67.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.055', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.164', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.500'} [2024-08-06 02:14:48,918][52811] DAMAGECOUNT value on done: 262804.0 [2024-08-06 02:14:48,918][52811] Sum rewards: 64.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.035', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.092', 'AMMO4': '0.212', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.294', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:49,625][52803] DAMAGECOUNT value on done: 265876.0 [2024-08-06 02:14:49,627][52803] Sum rewards: 59.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.560', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.187', 'AMMO4': '0.230', 'weapon5': '0.274', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.492', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '48.000'} [2024-08-06 02:14:50,054][52664] DAMAGECOUNT value on done: 292966.0 [2024-08-06 02:14:50,057][52664] Sum rewards: 62.909, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.118', 'weapon4': '0.148', 'AMMO4': '0.243', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:50,343][52820] DAMAGECOUNT value on done: 256308.0 [2024-08-06 02:14:50,345][52820] Sum rewards: 61.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO3': '0.158', 'AMMO4': '0.169', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.500', 'weapon4': '0.796', 'WEAPON3': '0.950', 'weapon3': '2.352', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:51,203][52663] DAMAGECOUNT value on done: 284174.0 [2024-08-06 02:14:51,203][52663] Sum rewards: 69.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.447', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.180', 'weapon4': '0.212', 'AMMO4': '0.213', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '59.000'} [2024-08-06 02:14:51,473][52659] DAMAGECOUNT value on done: 284527.0 [2024-08-06 02:14:51,475][52659] Sum rewards: 64.694, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.478', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO4': '0.202', 'weapon2': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.312', 'AMMO3': '0.318', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.874', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:51,576][52649] DAMAGECOUNT value on done: 272786.0 [2024-08-06 02:14:51,577][52649] Sum rewards: 78.285, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.192', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '64.000'} [2024-08-06 02:14:51,625][52650] Updated weights for policy 0, policy_version 36601 (0.0011) [2024-08-06 02:14:51,941][52811] DAMAGECOUNT value on done: 266151.0 [2024-08-06 02:14:51,941][52811] Sum rewards: 54.000, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.130', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.132', 'AMMO3': '0.277', 'AMMO4': '0.286', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.466', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.784', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 02:14:52,707][52803] DAMAGECOUNT value on done: 257911.0 [2024-08-06 02:14:52,709][52803] Sum rewards: 59.579, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.240', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.147', 'weapon2': '0.214', 'weapon5': '0.224', 'AMMO4': '0.227', 'weapon4': '0.498', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '2.788', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '47.000'} [2024-08-06 02:14:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 299851776. Throughput: 0: 4382.9. Samples: 74966300. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:14:52,794][52567] Avg episode reward: [(0, '66.169')] [2024-08-06 02:14:52,808][52665] DAMAGECOUNT value on done: 275672.0 [2024-08-06 02:14:52,810][52665] Sum rewards: 63.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.784', 'ARMOR': '0.005', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon4': '0.082', 'weapon5': '0.142', 'AMMO3': '0.229', 'AMMO4': '0.244', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.230', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:53,077][52664] DAMAGECOUNT value on done: 292745.0 [2024-08-06 02:14:53,079][52664] Sum rewards: 65.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon4': '0.116', 'AMMO3': '0.212', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '55.000'} [2024-08-06 02:14:53,490][52820] DAMAGECOUNT value on done: 259425.0 [2024-08-06 02:14:53,492][52820] Sum rewards: 58.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.305', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.216', 'weapon4': '0.216', 'AMMO3': '0.243', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.224', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '52.000'} [2024-08-06 02:14:54,140][52663] DAMAGECOUNT value on done: 281276.0 [2024-08-06 02:14:54,143][52663] Sum rewards: 49.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.080', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO4': '0.158', 'AMMO3': '0.212', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '3.304', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '43.000'} [2024-08-06 02:14:54,226][52659] DAMAGECOUNT value on done: 284459.0 [2024-08-06 02:14:54,227][52659] Sum rewards: 56.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.164', 'AMMO3': '0.189', 'AMMO4': '0.222', 'weapon4': '0.266', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '2.876', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '49.500'} [2024-08-06 02:14:54,564][52649] DAMAGECOUNT value on done: 267819.0 [2024-08-06 02:14:54,564][52649] Sum rewards: 73.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.793', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.205', 'weapon2': '0.234', 'AMMO4': '0.276', 'weapon5': '0.318', 'weapon4': '0.370', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:55,003][52811] DAMAGECOUNT value on done: 261856.0 [2024-08-06 02:14:55,003][52811] Sum rewards: 70.806, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.074', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.126', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.258', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '60.500'} [2024-08-06 02:14:55,591][52665] DAMAGECOUNT value on done: 282109.0 [2024-08-06 02:14:55,591][52665] Sum rewards: 68.026, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.048', 'weapon4': '0.072', 'AMMO4': '0.108', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.436', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '56.000'} [2024-08-06 02:14:55,972][52664] DAMAGECOUNT value on done: 290658.0 [2024-08-06 02:14:55,972][52664] Sum rewards: 64.673, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.976', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.088', 'weapon5': '0.116', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '53.000'} [2024-08-06 02:14:56,413][52650] Updated weights for policy 0, policy_version 36611 (0.0012) [2024-08-06 02:14:56,538][52820] DAMAGECOUNT value on done: 262435.0 [2024-08-06 02:14:56,538][52820] Sum rewards: 66.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.151', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.216', 'weapon2': '0.222', 'AMMO3': '0.234', 'weapon4': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.894', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '55.500'} [2024-08-06 02:14:56,730][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:14:57,052][52649] DAMAGECOUNT value on done: 274702.0 [2024-08-06 02:14:57,062][52649] Sum rewards: 63.698, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.785', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.090', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.308', 'weapon2': '0.402', 'WEAPON3': '1.000', 'weapon3': '2.862', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '51.000'} [2024-08-06 02:14:57,478][52663] DAMAGECOUNT value on done: 287044.0 [2024-08-06 02:14:57,478][52663] Sum rewards: 61.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.631', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.193', 'weapon2': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.292', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '51.000'} [2024-08-06 02:14:57,657][52659] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:14:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 299941888. Throughput: 0: 4389.6. Samples: 74992700. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:14:57,794][52567] Avg episode reward: [(0, '66.036')] [2024-08-06 02:14:57,931][52665] DAMAGECOUNT value on done: 278178.0 [2024-08-06 02:14:57,931][52665] Sum rewards: 59.454, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.955', 'AMMO5': '0.007', 'weapon5': '0.044', 'AMMO2': '0.052', 'WEAPON5': '0.200', 'AMMO4': '0.260', 'AMMO3': '0.294', 'weapon4': '0.310', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.018', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '53.000'} [2024-08-06 02:14:58,132][52811] DAMAGECOUNT value on done: 267804.0 [2024-08-06 02:14:58,133][52811] Sum rewards: 67.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.294', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.142', 'weapon4': '0.182', 'AMMO4': '0.197', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:58,989][52664] DAMAGECOUNT value on done: 292385.0 [2024-08-06 02:14:58,990][52664] Sum rewards: 61.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.152', 'AMMO4': '0.180', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.650', 'HITCOUNT': '2.920', 'weapon3': '3.130', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '54.000'} [2024-08-06 02:14:59,811][52820] DAMAGECOUNT value on done: 260593.0 [2024-08-06 02:14:59,814][52820] Sum rewards: 70.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.360', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '58.000'} [2024-08-06 02:14:59,909][52649] DAMAGECOUNT value on done: 275737.0 [2024-08-06 02:14:59,911][52649] Sum rewards: 64.996, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.930', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.448', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.272', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:00,436][52663] DAMAGECOUNT value on done: 283922.0 [2024-08-06 02:15:00,436][52663] Sum rewards: 55.835, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '3.018', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '50.000'} [2024-08-06 02:15:00,901][52665] DAMAGECOUNT value on done: 277236.0 [2024-08-06 02:15:00,901][52665] Sum rewards: 72.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.048', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:01,111][52650] Updated weights for policy 0, policy_version 36621 (0.0013) [2024-08-06 02:15:01,667][52664] DAMAGECOUNT value on done: 292291.0 [2024-08-06 02:15:01,676][52664] Sum rewards: 85.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.768', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.372', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '72.000'} [2024-08-06 02:15:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 300023808. Throughput: 0: 4389.6. Samples: 75005870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:15:02,794][52567] Avg episode reward: [(0, '66.394')] [2024-08-06 02:15:02,882][52820] DAMAGECOUNT value on done: 262119.0 [2024-08-06 02:15:02,882][52820] Sum rewards: 68.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.212', 'weapon4': '0.260', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:02,989][52649] DAMAGECOUNT value on done: 266729.0 [2024-08-06 02:15:02,990][52649] Sum rewards: 59.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.044', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.114', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '2.978', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '49.000'} [2024-08-06 02:15:03,408][52663] DAMAGECOUNT value on done: 275761.0 [2024-08-06 02:15:03,408][52663] Sum rewards: 56.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.231', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '48.000'} [2024-08-06 02:15:04,103][52665] DAMAGECOUNT value on done: 273115.0 [2024-08-06 02:15:04,105][52665] Sum rewards: 75.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.708', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.108', 'weapon4': '0.110', 'AMMO3': '0.169', 'weapon2': '0.238', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.362', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:04,159][52664] DAMAGECOUNT value on done: 295230.0 [2024-08-06 02:15:04,160][52664] Sum rewards: 55.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.019', 'AMMO2': '0.059', 'AMMO3': '0.148', 'weapon2': '0.206', 'weapon5': '0.274', 'AMMO4': '0.296', 'WEAPON5': '0.550', 'weapon4': '0.568', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.694', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '46.000'} [2024-08-06 02:15:05,869][52650] Updated weights for policy 0, policy_version 36631 (0.0013) [2024-08-06 02:15:05,938][52820] DAMAGECOUNT value on done: 262316.0 [2024-08-06 02:15:05,940][52820] Sum rewards: 63.872, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.051', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.120', 'AMMO3': '0.219', 'AMMO4': '0.220', 'weapon2': '0.272', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '55.000'} [2024-08-06 02:15:06,026][52649] DAMAGECOUNT value on done: 276538.0 [2024-08-06 02:15:06,027][52649] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.920', 'AMMO5': '0.018', 'AMMO2': '0.067', 'weapon4': '0.208', 'AMMO3': '0.258', 'weapon5': '0.274', 'AMMO4': '0.336', 'weapon2': '0.366', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '50.500'} [2024-08-06 02:15:06,837][52664] DAMAGECOUNT value on done: 285941.0 [2024-08-06 02:15:06,837][52664] Sum rewards: 50.478, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.436', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.136', 'AMMO3': '0.243', 'AMMO4': '0.274', 'weapon4': '0.378', 'weapon2': '0.388', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.770', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '45.000'} [2024-08-06 02:15:07,175][52665] DAMAGECOUNT value on done: 272179.0 [2024-08-06 02:15:07,175][52665] Sum rewards: 56.223, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.541', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.310', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.970', 'weapon3': '3.050', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '52.000'} [2024-08-06 02:15:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 300113920. Throughput: 0: 4394.9. Samples: 75032290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:15:07,794][52567] Avg episode reward: [(0, '65.776')] [2024-08-06 02:15:09,009][52649] DAMAGECOUNT value on done: 273396.0 [2024-08-06 02:15:09,010][52649] Sum rewards: 79.641, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.642', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.124', 'weapon2': '0.142', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.298', 'WEAPON3': '1.850', 'weapon3': '3.414', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '69.000'} [2024-08-06 02:15:09,227][52820] DAMAGECOUNT value on done: 264234.0 [2024-08-06 02:15:09,230][52820] Sum rewards: 69.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.155', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.112', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.480', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.666', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:09,810][52664] DAMAGECOUNT value on done: 300285.0 [2024-08-06 02:15:09,811][52664] Sum rewards: 77.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.843', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.151', 'weapon4': '0.194', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '63.000'} [2024-08-06 02:15:10,099][52665] DAMAGECOUNT value on done: 281684.0 [2024-08-06 02:15:10,103][52665] Sum rewards: 71.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.445', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.116', 'AMMO4': '0.135', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.184', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:10,291][52650] Updated weights for policy 0, policy_version 36641 (0.0017) [2024-08-06 02:15:11,704][52649] DAMAGECOUNT value on done: 279424.0 [2024-08-06 02:15:11,706][52649] Sum rewards: 68.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.156', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.218', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:12,469][52820] DAMAGECOUNT value on done: 263680.0 [2024-08-06 02:15:12,471][52820] Sum rewards: 78.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.086', 'AMMO3': '0.240', 'weapon2': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.478', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '66.000'} [2024-08-06 02:15:12,540][52665] DAMAGECOUNT value on done: 280469.0 [2024-08-06 02:15:12,540][52665] Sum rewards: 58.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.101', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.178', 'weapon4': '0.188', 'AMMO3': '0.212', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '50.000'} [2024-08-06 02:15:12,782][52664] DAMAGECOUNT value on done: 291450.0 [2024-08-06 02:15:12,784][52664] Sum rewards: 71.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO4': '0.181', 'AMMO3': '0.235', 'weapon2': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 300195840. Throughput: 0: 4388.0. Samples: 75058290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:15:12,794][52567] Avg episode reward: [(0, '66.155')] [2024-08-06 02:15:14,424][52667] DAMAGECOUNT value on done: 283193.0 [2024-08-06 02:15:14,426][52667] Sum rewards: 68.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.088', 'weapon5': '0.098', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.298', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '55.000'} [2024-08-06 02:15:14,792][52649] DAMAGECOUNT value on done: 276285.0 [2024-08-06 02:15:14,794][52649] Sum rewards: 65.930, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.866', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.081', 'weapon5': '0.166', 'AMMO3': '0.288', 'weapon4': '0.310', 'WEAPON5': '0.400', 'AMMO4': '0.406', 'weapon2': '0.418', 'WEAPON4': '0.700', 'WEAPON3': '1.800', 'weapon3': '2.802', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2024-08-06 02:15:15,111][52664] DAMAGECOUNT value on done: 294715.0 [2024-08-06 02:15:15,111][52664] Sum rewards: 56.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.160', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon5': '0.316', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '46.000'} [2024-08-06 02:15:15,409][52650] Updated weights for policy 0, policy_version 36651 (0.0034) [2024-08-06 02:15:15,667][52820] DAMAGECOUNT value on done: 262500.0 [2024-08-06 02:15:15,668][52820] Sum rewards: 56.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.171', 'AMMO3': '0.198', 'weapon2': '0.204', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '46.500'} [2024-08-06 02:15:15,839][52665] DAMAGECOUNT value on done: 281948.0 [2024-08-06 02:15:15,839][52665] Sum rewards: 58.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.180', 'AMMO3': '0.217', 'AMMO4': '0.242', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '52.000'} [2024-08-06 02:15:17,616][52664] DAMAGECOUNT value on done: 292329.0 [2024-08-06 02:15:17,617][52664] Sum rewards: 57.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.631', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.036', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.810', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.914', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '49.500'} [2024-08-06 02:15:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 300285952. Throughput: 0: 4390.9. Samples: 75071430. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:15:17,802][52567] Avg episode reward: [(0, '65.725')] [2024-08-06 02:15:17,928][52667] DAMAGECOUNT value on done: 286089.0 [2024-08-06 02:15:17,930][52667] Sum rewards: 58.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.086', 'weapon5': '0.176', 'AMMO4': '0.178', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.004', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '48.500'} [2024-08-06 02:15:18,031][52649] DAMAGECOUNT value on done: 276338.0 [2024-08-06 02:15:18,032][52649] Sum rewards: 70.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.655', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'weapon4': '0.220', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:18,759][52820] DAMAGECOUNT value on done: 264475.0 [2024-08-06 02:15:18,760][52820] Sum rewards: 68.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.154', 'AMMO3': '0.263', 'weapon4': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:19,042][52665] DAMAGECOUNT value on done: 278340.0 [2024-08-06 02:15:19,043][52665] Sum rewards: 68.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.045', 'AMMO3': '0.187', 'weapon5': '0.216', 'weapon4': '0.222', 'AMMO4': '0.226', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.880', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:19,487][52650] Updated weights for policy 0, policy_version 36661 (0.0013) [2024-08-06 02:15:19,965][52664] DAMAGECOUNT value on done: 296780.0 [2024-08-06 02:15:19,965][52664] Sum rewards: 74.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.382', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.215', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:19,993][52662] DAMAGECOUNT value on done: 289730.0 [2024-08-06 02:15:19,994][52662] Sum rewards: 60.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.158', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.214', 'weapon2': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.334', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '51.000'} [2024-08-06 02:15:20,418][52667] DAMAGECOUNT value on done: 283783.0 [2024-08-06 02:15:20,418][52667] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.345', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.172', 'AMMO4': '0.191', 'weapon2': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:21,116][52649] DAMAGECOUNT value on done: 276684.0 [2024-08-06 02:15:21,116][52649] Sum rewards: 73.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.094', 'weapon2': '0.194', 'AMMO3': '0.207', 'AMMO4': '0.223', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.400', 'weapon3': '3.420', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:21,670][52820] DAMAGECOUNT value on done: 263649.0 [2024-08-06 02:15:21,671][52820] Sum rewards: 75.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.845', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon4': '0.180', 'weapon5': '0.190', 'AMMO3': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:22,129][52665] DAMAGECOUNT value on done: 285977.0 [2024-08-06 02:15:22,130][52665] Sum rewards: 64.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.360', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:22,575][52664] DAMAGECOUNT value on done: 292208.0 [2024-08-06 02:15:22,575][52664] Sum rewards: 63.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.482', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.193', 'weapon2': '0.212', 'AMMO4': '0.271', 'weapon5': '0.294', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '52.000'} [2024-08-06 02:15:22,710][52668] DAMAGECOUNT value on done: 280080.0 [2024-08-06 02:15:22,711][52668] Sum rewards: 60.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.919', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.040', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.526', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '53.000'} [2024-08-06 02:15:22,754][52662] DAMAGECOUNT value on done: 290014.0 [2024-08-06 02:15:22,754][52662] Sum rewards: 60.055, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.478', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon5': '0.122', 'weapon4': '0.180', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO4': '0.273', 'AMMO3': '0.289', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.174', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:22,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 300384256. Throughput: 0: 4389.8. Samples: 75097810. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:15:22,795][52567] Avg episode reward: [(0, '65.612')] [2024-08-06 02:15:23,062][52667] DAMAGECOUNT value on done: 283400.0 [2024-08-06 02:15:23,063][52667] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.736', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.088', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:24,631][52650] Updated weights for policy 0, policy_version 36671 (0.0019) [2024-08-06 02:15:24,662][52649] DAMAGECOUNT value on done: 276934.0 [2024-08-06 02:15:24,662][52649] Sum rewards: 73.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.226', 'AMMO4': '0.227', 'AMMO3': '0.243', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:24,849][52820] DAMAGECOUNT value on done: 255945.0 [2024-08-06 02:15:24,851][52820] Sum rewards: 55.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.794', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.050', 'HITCOUNT': '2.620', 'weapon3': '3.372', 'DAMAGECOUNT': '13.125', 'FRAGCOUNT': '46.000'} [2024-08-06 02:15:25,247][52662] DAMAGECOUNT value on done: 289249.0 [2024-08-06 02:15:25,249][52662] Sum rewards: 61.592, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.339', 'AMMO5': '0.032', 'AMMO2': '0.074', 'weapon4': '0.140', 'weapon2': '0.218', 'weapon5': '0.256', 'AMMO3': '0.257', 'AMMO4': '0.368', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.112', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '54.500'} [2024-08-06 02:15:25,283][52664] DAMAGECOUNT value on done: 297712.0 [2024-08-06 02:15:25,286][52664] Sum rewards: 74.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.018', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.232', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:25,441][52665] DAMAGECOUNT value on done: 282156.0 [2024-08-06 02:15:25,443][52665] Sum rewards: 62.516, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.080', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.096', 'weapon4': '0.142', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.110', 'weapon3': '3.226', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:25,880][52668] DAMAGECOUNT value on done: 288187.0 [2024-08-06 02:15:25,881][52668] Sum rewards: 61.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.948', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.139', 'AMMO4': '0.170', 'weapon5': '0.192', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON3': '0.900', 'weapon3': '2.716', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '49.000'} [2024-08-06 02:15:25,965][52667] DAMAGECOUNT value on done: 287888.0 [2024-08-06 02:15:25,966][52667] Sum rewards: 65.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.952', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.296', 'weapon2': '0.406', 'WEAPON3': '1.800', 'weapon3': '3.254', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:27,641][52649] DAMAGECOUNT value on done: 277659.0 [2024-08-06 02:15:27,642][52649] Sum rewards: 54.789, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.854', 'AMMO5': '0.018', 'AMMO2': '0.062', 'AMMO3': '0.244', 'weapon5': '0.246', 'weapon4': '0.258', 'AMMO4': '0.311', 'WEAPON5': '0.500', 'weapon2': '0.662', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.522', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '49.000'} [2024-08-06 02:15:27,741][52662] DAMAGECOUNT value on done: 280907.0 [2024-08-06 02:15:27,741][52662] Sum rewards: 64.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.204', 'AMMO4': '0.241', 'AMMO3': '0.245', 'weapon2': '0.270', 'weapon4': '0.270', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 300457984. Throughput: 0: 4383.3. Samples: 75124050. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:15:27,794][52567] Avg episode reward: [(0, '65.629')] [2024-08-06 02:15:27,983][52820] DAMAGECOUNT value on done: 269298.0 [2024-08-06 02:15:27,984][52820] Sum rewards: 79.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'weapon4': '0.150', 'AMMO3': '0.156', 'weapon2': '0.422', 'WEAPON3': '0.950', 'weapon3': '3.236', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '63.000'} [2024-08-06 02:15:28,450][52664] DAMAGECOUNT value on done: 287990.0 [2024-08-06 02:15:28,450][52664] Sum rewards: 72.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.268', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.164', 'AMMO4': '0.179', 'weapon5': '0.232', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.000', 'weapon3': '2.942', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '59.000'} [2024-08-06 02:15:28,555][52665] DAMAGECOUNT value on done: 281377.0 [2024-08-06 02:15:28,556][52665] Sum rewards: 66.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.186', 'weapon2': '0.270', 'AMMO3': '0.283', 'WEAPON3': '1.600', 'weapon3': '3.182', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:28,775][52667] DAMAGECOUNT value on done: 285559.0 [2024-08-06 02:15:28,775][52667] Sum rewards: 74.770, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.417', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.086', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '64.000'} [2024-08-06 02:15:28,876][52668] DAMAGECOUNT value on done: 287132.0 [2024-08-06 02:15:28,876][52668] Sum rewards: 59.656, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.486', 'AMMO5': '0.020', 'AMMO2': '0.073', 'weapon5': '0.206', 'AMMO3': '0.263', 'weapon4': '0.288', 'AMMO4': '0.364', 'weapon2': '0.438', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.628', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:29,142][52650] Updated weights for policy 0, policy_version 36681 (0.0012) [2024-08-06 02:15:30,633][52662] DAMAGECOUNT value on done: 287004.0 [2024-08-06 02:15:30,635][52662] Sum rewards: 69.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.170', 'weapon2': '0.190', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.422', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:30,785][52649] DAMAGECOUNT value on done: 280410.0 [2024-08-06 02:15:30,785][52649] Sum rewards: 77.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.561', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.132', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:31,095][52820] DAMAGECOUNT value on done: 271502.0 [2024-08-06 02:15:31,096][52820] Sum rewards: 67.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.938', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'weapon4': '0.224', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '59.000'} [2024-08-06 02:15:31,131][52664] DAMAGECOUNT value on done: 293206.0 [2024-08-06 02:15:31,132][52664] Sum rewards: 63.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.365', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO3': '0.145', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.312', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.990', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '52.000'} [2024-08-06 02:15:31,404][52668] DAMAGECOUNT value on done: 287397.0 [2024-08-06 02:15:31,404][52668] Sum rewards: 65.574, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.681', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.044', 'weapon5': '0.090', 'AMMO3': '0.162', 'AMMO4': '0.220', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.500', 'weapon4': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '53.000'} [2024-08-06 02:15:31,635][52667] DAMAGECOUNT value on done: 288368.0 [2024-08-06 02:15:31,637][52667] Sum rewards: 64.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO4': '0.180', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.732', 'WEAPON3': '1.250', 'weapon3': '2.836', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '53.000'} [2024-08-06 02:15:31,883][52665] DAMAGECOUNT value on done: 280307.0 [2024-08-06 02:15:31,884][52665] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.199', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 300548096. Throughput: 0: 4380.7. Samples: 75137160. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:15:32,794][52567] Avg episode reward: [(0, '66.049')] [2024-08-06 02:15:33,477][52662] DAMAGECOUNT value on done: 279707.0 [2024-08-06 02:15:33,477][52662] Sum rewards: 64.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO4': '0.204', 'weapon5': '0.212', 'weapon4': '0.216', 'AMMO3': '0.219', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:33,607][52649] DAMAGECOUNT value on done: 271110.0 [2024-08-06 02:15:33,607][52649] Sum rewards: 62.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.819', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.157', 'weapon2': '0.382', 'WEAPON3': '0.950', 'HITCOUNT': '2.840', 'weapon3': '3.128', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '49.000'} [2024-08-06 02:15:33,766][52650] Updated weights for policy 0, policy_version 36691 (0.0025) [2024-08-06 02:15:34,040][52668] DAMAGECOUNT value on done: 277064.0 [2024-08-06 02:15:34,040][52668] Sum rewards: 69.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.294', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:34,063][52664] DAMAGECOUNT value on done: 296381.0 [2024-08-06 02:15:34,063][52664] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.278', 'weapon4': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.092', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:34,186][52820] DAMAGECOUNT value on done: 259377.0 [2024-08-06 02:15:34,189][52820] Sum rewards: 72.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.120', 'weapon5': '0.180', 'AMMO4': '0.216', 'AMMO3': '0.244', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:34,449][52665] DAMAGECOUNT value on done: 278710.0 [2024-08-06 02:15:34,450][52665] Sum rewards: 53.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.663', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.102', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.240', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '47.500'} [2024-08-06 02:15:34,852][52667] DAMAGECOUNT value on done: 280120.0 [2024-08-06 02:15:34,855][52667] Sum rewards: 59.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.067', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.636', 'WEAPON3': '1.700', 'HITCOUNT': '3.010', 'weapon3': '3.124', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:36,158][52662] DAMAGECOUNT value on done: 288300.0 [2024-08-06 02:15:36,159][52662] Sum rewards: 66.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.996', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.166', 'AMMO3': '0.187', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:36,432][52664] DAMAGECOUNT value on done: 293732.0 [2024-08-06 02:15:36,434][52664] Sum rewards: 72.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.178', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:36,435][52668] DAMAGECOUNT value on done: 287133.0 [2024-08-06 02:15:36,437][52668] Sum rewards: 68.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:36,746][52649] DAMAGECOUNT value on done: 277763.0 [2024-08-06 02:15:36,748][52649] Sum rewards: 68.777, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.755', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO3': '0.217', 'AMMO4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.326', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:37,631][52665] DAMAGECOUNT value on done: 277126.0 [2024-08-06 02:15:37,634][52665] Sum rewards: 58.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.172', 'AMMO3': '0.216', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.052', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '49.000'} [2024-08-06 02:15:37,654][52667] DAMAGECOUNT value on done: 283172.0 [2024-08-06 02:15:37,654][52667] Sum rewards: 63.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.035', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.228', 'AMMO3': '0.243', 'weapon4': '0.278', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.918', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '53.000'} [2024-08-06 02:15:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 300638208. Throughput: 0: 4384.2. Samples: 75163590. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:15:37,795][52567] Avg episode reward: [(0, '65.499')] [2024-08-06 02:15:38,481][52650] Updated weights for policy 0, policy_version 36701 (0.0011) [2024-08-06 02:15:38,839][52664] DAMAGECOUNT value on done: 295319.0 [2024-08-06 02:15:38,839][52664] Sum rewards: 75.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.572', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.189', 'weapon5': '0.190', 'weapon2': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:38,919][52662] DAMAGECOUNT value on done: 293684.0 [2024-08-06 02:15:38,921][52662] Sum rewards: 75.783, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.415', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.236', 'AMMO3': '0.304', 'WEAPON3': '1.900', 'weapon3': '3.382', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '67.000'} [2024-08-06 02:15:38,976][52660] DAMAGECOUNT value on done: 278389.0 [2024-08-06 02:15:38,979][52660] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.679', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.086', 'weapon5': '0.092', 'AMMO4': '0.121', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '0.950', 'HITCOUNT': '2.770', 'weapon3': '3.214', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '45.000'} [2024-08-06 02:15:39,480][52668] DAMAGECOUNT value on done: 284537.0 [2024-08-06 02:15:39,482][52668] Sum rewards: 75.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.132', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:39,805][52649] DAMAGECOUNT value on done: 274896.0 [2024-08-06 02:15:39,808][52649] Sum rewards: 58.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.288', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.316', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '50.000'} [2024-08-06 02:15:40,598][52665] DAMAGECOUNT value on done: 277406.0 [2024-08-06 02:15:40,600][52665] Sum rewards: 52.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.697', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.195', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.250', 'HITCOUNT': '2.570', 'weapon3': '2.798', 'DAMAGECOUNT': '12.849', 'FRAGCOUNT': '45.000'} [2024-08-06 02:15:40,677][52667] DAMAGECOUNT value on done: 287610.0 [2024-08-06 02:15:40,679][52667] Sum rewards: 73.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO4': '0.188', 'AMMO3': '0.201', 'weapon4': '0.248', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:41,425][52669] DAMAGECOUNT value on done: 286971.0 [2024-08-06 02:15:41,426][52669] Sum rewards: 66.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.178', 'weapon2': '0.198', 'AMMO4': '0.202', 'AMMO3': '0.239', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:41,744][52662] DAMAGECOUNT value on done: 284478.0 [2024-08-06 02:15:41,746][52662] Sum rewards: 73.879, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.152', 'AMMO3': '0.179', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:41,853][52660] DAMAGECOUNT value on done: 278723.0 [2024-08-06 02:15:41,854][52660] Sum rewards: 68.825, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.472', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO3': '0.283', 'weapon4': '0.288', 'weapon2': '0.314', 'WEAPON3': '1.650', 'weapon3': '3.140', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:42,052][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:15:42,365][52668] DAMAGECOUNT value on done: 281604.0 [2024-08-06 02:15:42,366][52668] Sum rewards: 50.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.300', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.212', 'AMMO3': '0.258', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON3': '1.550', 'weapon3': '2.616', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '44.000'} [2024-08-06 02:15:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 300728320. Throughput: 0: 4387.6. Samples: 75190140. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:15:42,794][52567] Avg episode reward: [(0, '65.749')] [2024-08-06 02:15:42,919][52650] Updated weights for policy 0, policy_version 36711 (0.0026) [2024-08-06 02:15:42,974][52649] DAMAGECOUNT value on done: 279023.0 [2024-08-06 02:15:42,976][52649] Sum rewards: 57.403, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.122', 'AMMO3': '0.189', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.056', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '47.000'} [2024-08-06 02:15:43,736][52665] DAMAGECOUNT value on done: 276373.0 [2024-08-06 02:15:43,737][52665] Sum rewards: 67.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.653', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.193', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:43,780][52667] DAMAGECOUNT value on done: 283825.0 [2024-08-06 02:15:43,780][52667] Sum rewards: 65.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.306', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.194', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:44,363][52669] DAMAGECOUNT value on done: 280030.0 [2024-08-06 02:15:44,366][52669] Sum rewards: 75.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.180', 'weapon2': '0.264', 'weapon4': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:44,702][52660] DAMAGECOUNT value on done: 286688.0 [2024-08-06 02:15:44,704][52660] Sum rewards: 73.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.158', 'AMMO4': '0.180', 'AMMO3': '0.225', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:45,027][52662] DAMAGECOUNT value on done: 297244.0 [2024-08-06 02:15:45,029][52662] Sum rewards: 71.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.072', 'weapon5': '0.122', 'AMMO3': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:45,268][52668] DAMAGECOUNT value on done: 284034.0 [2024-08-06 02:15:45,269][52668] Sum rewards: 63.006, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.631', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon4': '0.130', 'weapon5': '0.138', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '2.958', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '50.000'} [2024-08-06 02:15:46,032][52649] DAMAGECOUNT value on done: 280419.0 [2024-08-06 02:15:46,033][52649] Sum rewards: 70.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.453', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.130', 'weapon2': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.464', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:46,526][52667] DAMAGECOUNT value on done: 285922.0 [2024-08-06 02:15:46,528][52667] Sum rewards: 67.916, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.285', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.118', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:46,735][52665] DAMAGECOUNT value on done: 280881.0 [2024-08-06 02:15:46,740][52665] Sum rewards: 69.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.136', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.312', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:47,546][52660] DAMAGECOUNT value on done: 284803.0 [2024-08-06 02:15:47,546][52660] Sum rewards: 62.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.102', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '50.000'} [2024-08-06 02:15:47,685][52650] Updated weights for policy 0, policy_version 36721 (0.0034) [2024-08-06 02:15:47,736][52669] DAMAGECOUNT value on done: 285224.0 [2024-08-06 02:15:47,738][52669] Sum rewards: 65.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.051', 'weapon7': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.212', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 02:15:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 300818432. Throughput: 0: 4392.2. Samples: 75203520. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:15:47,794][52567] Avg episode reward: [(0, '66.236')] [2024-08-06 02:15:48,014][52668] DAMAGECOUNT value on done: 283787.0 [2024-08-06 02:15:48,015][52668] Sum rewards: 67.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.962', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.066', 'AMMO4': '0.173', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.412', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '59.000'} [2024-08-06 02:15:48,235][52662] DAMAGECOUNT value on done: 282551.0 [2024-08-06 02:15:48,236][52662] Sum rewards: 71.721, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.750', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:49,234][52649] DAMAGECOUNT value on done: 282346.0 [2024-08-06 02:15:49,238][52649] Sum rewards: 69.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.580', 'WEAPON3': '1.050', 'weapon3': '3.154', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 02:15:49,307][52667] DAMAGECOUNT value on done: 283579.0 [2024-08-06 02:15:49,309][52667] Sum rewards: 65.585, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.955', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon2': '0.298', 'AMMO3': '0.363', 'WEAPON3': '2.100', 'weapon3': '3.318', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:49,940][52665] DAMAGECOUNT value on done: 280547.0 [2024-08-06 02:15:49,942][52665] Sum rewards: 64.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '53.000'} [2024-08-06 02:15:50,447][52669] DAMAGECOUNT value on done: 282798.0 [2024-08-06 02:15:50,449][52669] Sum rewards: 79.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.216', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.378', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '68.000'} [2024-08-06 02:15:50,773][52660] DAMAGECOUNT value on done: 282637.0 [2024-08-06 02:15:50,775][52660] Sum rewards: 67.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.335', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.114', 'weapon5': '0.210', 'AMMO3': '0.226', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:51,107][52668] DAMAGECOUNT value on done: 286623.0 [2024-08-06 02:15:51,109][52668] Sum rewards: 68.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.452', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.168', 'weapon4': '0.184', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '60.000'} [2024-08-06 02:15:51,437][52662] DAMAGECOUNT value on done: 284046.0 [2024-08-06 02:15:51,438][52662] Sum rewards: 72.115, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.170', 'weapon5': '0.204', 'AMMO4': '0.209', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:52,094][52667] DAMAGECOUNT value on done: 280714.0 [2024-08-06 02:15:52,095][52667] Sum rewards: 73.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.189', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.106', 'weapon2': '0.158', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '64.000'} [2024-08-06 02:15:52,161][52794] DAMAGECOUNT value on done: 287294.0 [2024-08-06 02:15:52,161][52794] Sum rewards: 65.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.404', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.152', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '55.000'} [2024-08-06 02:15:52,619][52650] Updated weights for policy 0, policy_version 36731 (0.0032) [2024-08-06 02:15:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 300900352. Throughput: 0: 4377.1. Samples: 75229260. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:15:52,802][52567] Avg episode reward: [(0, '66.630')] [2024-08-06 02:15:53,513][52660] DAMAGECOUNT value on done: 278040.0 [2024-08-06 02:15:53,515][52660] Sum rewards: 67.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.729', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.694', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '56.000'} [2024-08-06 02:15:53,710][52669] DAMAGECOUNT value on done: 280231.0 [2024-08-06 02:15:53,710][52669] Sum rewards: 57.612, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.030', 'AMMO4': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.258', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '47.000'} [2024-08-06 02:15:53,782][52662] DAMAGECOUNT value on done: 286533.0 [2024-08-06 02:15:53,784][52662] Sum rewards: 82.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.092', 'weapon5': '0.124', 'AMMO4': '0.130', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.050', 'weapon3': '3.232', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '66.000'} [2024-08-06 02:15:53,864][52668] DAMAGECOUNT value on done: 280774.0 [2024-08-06 02:15:53,865][52668] Sum rewards: 56.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.444', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.126', 'weapon5': '0.152', 'AMMO4': '0.221', 'AMMO3': '0.233', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.118', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '50.000'} [2024-08-06 02:15:54,391][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:15:54,787][52794] DAMAGECOUNT value on done: 289445.0 [2024-08-06 02:15:54,787][52794] Sum rewards: 71.867, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.424', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.386', 'weapon4': '0.502', 'WEAPON3': '1.650', 'weapon3': '2.730', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '63.000'} [2024-08-06 02:15:55,157][52667] DAMAGECOUNT value on done: 288987.0 [2024-08-06 02:15:55,159][52667] Sum rewards: 62.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.606', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO3': '0.183', 'weapon4': '0.194', 'AMMO4': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '53.500'} [2024-08-06 02:15:56,566][52662] DAMAGECOUNT value on done: 291930.0 [2024-08-06 02:15:56,568][52662] Sum rewards: 64.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.827', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.128', 'weapon5': '0.158', 'AMMO4': '0.170', 'AMMO3': '0.185', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.200', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '54.000'} [2024-08-06 02:15:56,674][52660] DAMAGECOUNT value on done: 285071.0 [2024-08-06 02:15:56,675][52660] Sum rewards: 70.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.355', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.172', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.450', 'weapon3': '2.756', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '59.000'} [2024-08-06 02:15:57,051][52669] DAMAGECOUNT value on done: 283891.0 [2024-08-06 02:15:57,053][52669] Sum rewards: 71.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.237', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.166', 'AMMO3': '0.208', 'AMMO4': '0.275', 'weapon2': '0.354', 'WEAPON5': '0.400', 'weapon4': '0.442', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:57,136][52650] Updated weights for policy 0, policy_version 36741 (0.0025) [2024-08-06 02:15:57,144][52668] DAMAGECOUNT value on done: 275703.0 [2024-08-06 02:15:57,144][52668] Sum rewards: 74.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.134', 'AMMO3': '0.195', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '61.000'} [2024-08-06 02:15:57,404][52667] DAMAGECOUNT value on done: 292685.0 [2024-08-06 02:15:57,404][52667] Sum rewards: 72.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.234', 'weapon2': '0.694', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '62.000'} [2024-08-06 02:15:57,496][52794] DAMAGECOUNT value on done: 284828.0 [2024-08-06 02:15:57,497][52794] Sum rewards: 62.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.831', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO3': '0.168', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.414', 'WEAPON4': '0.450', 'weapon2': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '51.000'} [2024-08-06 02:15:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 300990464. Throughput: 0: 4386.0. Samples: 75255660. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:15:57,795][52567] Avg episode reward: [(0, '66.741')] [2024-08-06 02:15:59,190][52662] DAMAGECOUNT value on done: 284832.0 [2024-08-06 02:15:59,191][52662] Sum rewards: 65.854, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.065', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon4': '0.158', 'AMMO4': '0.203', 'AMMO3': '0.211', 'weapon5': '0.296', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.828', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '57.000'} [2024-08-06 02:15:59,306][52660] DAMAGECOUNT value on done: 289573.0 [2024-08-06 02:15:59,308][52660] Sum rewards: 72.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.268', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.164', 'AMMO3': '0.182', 'weapon4': '0.292', 'WEAPON3': '1.100', 'weapon3': '3.320', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '58.000'} [2024-08-06 02:15:59,766][52668] DAMAGECOUNT value on done: 276427.0 [2024-08-06 02:15:59,777][52668] Sum rewards: 63.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.260', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.042', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.040', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:00,052][52794] DAMAGECOUNT value on done: 286109.0 [2024-08-06 02:16:00,053][52794] Sum rewards: 70.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.536', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.185', 'AMMO4': '0.205', 'weapon2': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:00,100][52669] DAMAGECOUNT value on done: 286571.0 [2024-08-06 02:16:00,100][52669] Sum rewards: 71.476, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.292', 'weapon4': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2024-08-06 02:16:00,399][52667] DAMAGECOUNT value on done: 287532.0 [2024-08-06 02:16:00,400][52667] Sum rewards: 59.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.038', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO3': '0.192', 'AMMO4': '0.237', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '49.000'} [2024-08-06 02:16:01,881][52662] DAMAGECOUNT value on done: 297640.0 [2024-08-06 02:16:01,882][52662] Sum rewards: 68.469, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.166', 'AMMO3': '0.182', 'AMMO4': '0.199', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.196', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '56.000'} [2024-08-06 02:16:01,936][52650] Updated weights for policy 0, policy_version 36751 (0.0010) [2024-08-06 02:16:02,650][52660] DAMAGECOUNT value on done: 287677.0 [2024-08-06 02:16:02,650][52660] Sum rewards: 74.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'weapon4': '0.152', 'AMMO3': '0.249', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '64.000'} [2024-08-06 02:16:02,730][52669] DAMAGECOUNT value on done: 285471.0 [2024-08-06 02:16:02,730][52669] Sum rewards: 68.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.238', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 02:16:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 301080576. Throughput: 0: 4390.9. Samples: 75269020. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:16:02,794][52567] Avg episode reward: [(0, '67.283')] [2024-08-06 02:16:02,802][52614] Saving new best policy, reward=67.283! [2024-08-06 02:16:03,084][52794] DAMAGECOUNT value on done: 282755.0 [2024-08-06 02:16:03,086][52794] Sum rewards: 70.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.798', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.134', 'AMMO3': '0.223', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.330', 'weapon4': '0.356', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '62.000'} [2024-08-06 02:16:03,124][52668] DAMAGECOUNT value on done: 278754.0 [2024-08-06 02:16:03,129][52668] Sum rewards: 68.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.181', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.187', 'weapon5': '0.188', 'AMMO4': '0.195', 'weapon4': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.720', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2024-08-06 02:16:03,545][52667] DAMAGECOUNT value on done: 289758.0 [2024-08-06 02:16:03,546][52667] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.046', 'AMMO3': '0.154', 'AMMO4': '0.158', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:04,098][52658] DAMAGECOUNT value on done: 285338.0 [2024-08-06 02:16:04,099][52658] Sum rewards: 77.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.098', 'AMMO4': '0.127', 'weapon5': '0.134', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '65.000'} [2024-08-06 02:16:05,221][52662] DAMAGECOUNT value on done: 287031.0 [2024-08-06 02:16:05,221][52662] Sum rewards: 65.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.151', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.318', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:05,592][52669] DAMAGECOUNT value on done: 284797.0 [2024-08-06 02:16:05,593][52669] Sum rewards: 59.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.249', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.126', 'AMMO4': '0.224', 'weapon4': '0.236', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.896', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '50.000'} [2024-08-06 02:16:05,720][52660] DAMAGECOUNT value on done: 283130.0 [2024-08-06 02:16:05,720][52660] Sum rewards: 69.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.256', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.118', 'weapon4': '0.122', 'AMMO3': '0.170', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.230', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:06,259][52668] DAMAGECOUNT value on done: 282105.0 [2024-08-06 02:16:06,261][52668] Sum rewards: 54.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.927', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon4': '0.388', 'weapon2': '0.446', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '2.918', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '49.000'} [2024-08-06 02:16:06,274][52650] Updated weights for policy 0, policy_version 36761 (0.0010) [2024-08-06 02:16:06,304][52794] DAMAGECOUNT value on done: 286310.0 [2024-08-06 02:16:06,304][52794] Sum rewards: 65.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.163', 'weapon4': '0.174', 'weapon5': '0.246', 'AMMO4': '0.269', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '52.500'} [2024-08-06 02:16:06,323][52667] DAMAGECOUNT value on done: 280337.0 [2024-08-06 02:16:06,323][52667] Sum rewards: 71.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.148', 'weapon4': '0.156', 'AMMO4': '0.175', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.222', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:07,027][52658] DAMAGECOUNT value on done: 285029.0 [2024-08-06 02:16:07,029][52658] Sum rewards: 63.802, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.861', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.104', 'weapon4': '0.126', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.300', 'AMMO3': '0.329', 'WEAPON3': '2.000', 'weapon3': '3.230', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 301162496. Throughput: 0: 4384.5. Samples: 75295110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:16:07,794][52567] Avg episode reward: [(0, '67.164')] [2024-08-06 02:16:07,874][52662] DAMAGECOUNT value on done: 287496.0 [2024-08-06 02:16:07,875][52662] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.800', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.174', 'weapon5': '0.212', 'AMMO4': '0.234', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.620', 'WEAPON3': '1.000', 'weapon3': '2.568', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '53.000'} [2024-08-06 02:16:08,622][52660] DAMAGECOUNT value on done: 290704.0 [2024-08-06 02:16:08,622][52660] Sum rewards: 65.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.830', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.196', 'AMMO3': '0.243', 'weapon2': '0.258', 'weapon5': '0.260', 'AMMO4': '0.307', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.014', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '56.000'} [2024-08-06 02:16:08,748][52669] DAMAGECOUNT value on done: 282990.0 [2024-08-06 02:16:08,754][52669] Sum rewards: 78.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.264', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.090', 'AMMO4': '0.210', 'weapon5': '0.216', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.750', 'weapon3': '2.896', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '67.000'} [2024-08-06 02:16:08,935][52668] DAMAGECOUNT value on done: 285076.0 [2024-08-06 02:16:08,936][52668] Sum rewards: 76.438, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.626', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.167', 'weapon4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '64.000'} [2024-08-06 02:16:09,005][52794] DAMAGECOUNT value on done: 290109.0 [2024-08-06 02:16:09,005][52794] Sum rewards: 66.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.132', 'AMMO4': '0.164', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.280', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:09,161][52667] DAMAGECOUNT value on done: 287074.0 [2024-08-06 02:16:09,162][52667] Sum rewards: 59.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.242', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.184', 'weapon4': '0.188', 'AMMO3': '0.251', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.074', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:09,622][52658] DAMAGECOUNT value on done: 285728.0 [2024-08-06 02:16:09,623][52658] Sum rewards: 58.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.082', 'weapon5': '0.194', 'AMMO3': '0.227', 'AMMO4': '0.243', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.130', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '49.000'} [2024-08-06 02:16:10,166][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:16:10,713][52662] DAMAGECOUNT value on done: 285704.0 [2024-08-06 02:16:10,713][52662] Sum rewards: 61.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.415', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.136', 'weapon2': '0.204', 'AMMO4': '0.224', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.110', 'weapon3': '3.326', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:11,079][52650] Updated weights for policy 0, policy_version 36771 (0.0020) [2024-08-06 02:16:11,100][52660] DAMAGECOUNT value on done: 277132.0 [2024-08-06 02:16:11,101][52660] Sum rewards: 78.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.325', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon2': '0.148', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'weapon3': '3.604', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '67.000'} [2024-08-06 02:16:11,287][52668] DAMAGECOUNT value on done: 283444.0 [2024-08-06 02:16:11,288][52668] Sum rewards: 65.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.292', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO3': '0.161', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:11,616][52794] DAMAGECOUNT value on done: 285668.0 [2024-08-06 02:16:11,616][52794] Sum rewards: 67.886, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.782', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.144', 'AMMO3': '0.151', 'weapon5': '0.196', 'AMMO4': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '53.500'} [2024-08-06 02:16:11,827][52669] DAMAGECOUNT value on done: 287945.0 [2024-08-06 02:16:11,827][52669] Sum rewards: 71.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.123', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.000'} [2024-08-06 02:16:12,750][52658] DAMAGECOUNT value on done: 284848.0 [2024-08-06 02:16:12,751][52658] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.147', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.080', 'AMMO4': '0.125', 'weapon5': '0.146', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '59.000'} [2024-08-06 02:16:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 301252608. Throughput: 0: 4387.8. Samples: 75321500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:16:12,794][52567] Avg episode reward: [(0, '67.361')] [2024-08-06 02:16:12,795][52614] Saving new best policy, reward=67.361! [2024-08-06 02:16:13,518][52662] DAMAGECOUNT value on done: 280973.0 [2024-08-06 02:16:13,519][52662] Sum rewards: 77.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.058', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.292', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '66.500'} [2024-08-06 02:16:13,829][52660] DAMAGECOUNT value on done: 281117.0 [2024-08-06 02:16:13,831][52660] Sum rewards: 60.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.247', 'AMMO4': '0.260', 'weapon2': '0.280', 'weapon5': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.548', 'WEAPON3': '1.500', 'weapon3': '2.408', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '51.000'} [2024-08-06 02:16:14,144][52668] DAMAGECOUNT value on done: 286804.0 [2024-08-06 02:16:14,144][52668] Sum rewards: 76.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon4': '0.132', 'AMMO3': '0.188', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.000'} [2024-08-06 02:16:14,550][52794] DAMAGECOUNT value on done: 291109.0 [2024-08-06 02:16:14,550][52794] Sum rewards: 62.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.721', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO4': '0.175', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.164', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:14,598][52669] DAMAGECOUNT value on done: 283982.0 [2024-08-06 02:16:14,600][52669] Sum rewards: 64.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.738', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.184', 'AMMO4': '0.191', 'AMMO3': '0.223', 'weapon2': '0.248', 'weapon4': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:15,692][52658] DAMAGECOUNT value on done: 283807.0 [2024-08-06 02:16:15,692][52658] Sum rewards: 63.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.142', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.244', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:15,928][52650] Updated weights for policy 0, policy_version 36781 (0.0018) [2024-08-06 02:16:17,034][52660] DAMAGECOUNT value on done: 290107.0 [2024-08-06 02:16:17,034][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:16:17,037][52660] Sum rewards: 79.414, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.997', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.155', 'weapon2': '0.456', 'WEAPON3': '1.000', 'weapon3': '3.444', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '63.000'} [2024-08-06 02:16:17,299][52669] DAMAGECOUNT value on done: 282177.0 [2024-08-06 02:16:17,300][52669] Sum rewards: 62.800, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.490', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.220', 'AMMO4': '0.228', 'weapon2': '0.254', 'AMMO3': '0.276', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.902', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:17,375][52668] DAMAGECOUNT value on done: 282110.0 [2024-08-06 02:16:17,375][52668] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.168', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'weapon4': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon2': '0.148', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.558', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:17,391][52794] DAMAGECOUNT value on done: 288278.0 [2024-08-06 02:16:17,393][52794] Sum rewards: 63.423, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.234', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.072', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.266', 'AMMO3': '0.283', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.444', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 301342720. Throughput: 0: 4388.0. Samples: 75334620. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:16:17,794][52567] Avg episode reward: [(0, '67.451')] [2024-08-06 02:16:17,798][52614] Saving new best policy, reward=67.451! [2024-08-06 02:16:18,946][52658] DAMAGECOUNT value on done: 283589.0 [2024-08-06 02:16:18,946][52658] Sum rewards: 69.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.252', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.294', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '60.000'} [2024-08-06 02:16:19,731][52660] DAMAGECOUNT value on done: 293052.0 [2024-08-06 02:16:19,734][52660] Sum rewards: 75.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.072', 'AMMO5': '0.008', 'weapon5': '0.044', 'AMMO2': '0.050', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO4': '0.247', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '64.000'} [2024-08-06 02:16:20,110][52669] DAMAGECOUNT value on done: 286980.0 [2024-08-06 02:16:20,111][52669] Sum rewards: 70.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.202', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO4': '0.203', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.256', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:20,379][52650] Updated weights for policy 0, policy_version 36791 (0.0028) [2024-08-06 02:16:20,526][52794] DAMAGECOUNT value on done: 284454.0 [2024-08-06 02:16:20,526][52794] Sum rewards: 62.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.551', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.117', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.898', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '50.000'} [2024-08-06 02:16:20,620][52647] DAMAGECOUNT value on done: 301348.0 [2024-08-06 02:16:20,620][52647] Sum rewards: 64.176, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.148', 'weapon5': '0.170', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.290', 'weapon2': '0.580', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '2.932', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:21,722][52658] DAMAGECOUNT value on done: 290001.0 [2024-08-06 02:16:21,724][52658] Sum rewards: 67.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.189', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.378', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:22,730][52660] DAMAGECOUNT value on done: 279935.0 [2024-08-06 02:16:22,730][52660] Sum rewards: 67.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.184', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.288', 'weapon2': '0.402', 'WEAPON3': '1.750', 'weapon3': '3.114', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '60.000'} [2024-08-06 02:16:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 301432832. Throughput: 0: 4377.3. Samples: 75360570. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:16:22,794][52567] Avg episode reward: [(0, '67.597')] [2024-08-06 02:16:22,795][52614] Saving new best policy, reward=67.597! [2024-08-06 02:16:22,851][52647] DAMAGECOUNT value on done: 298970.0 [2024-08-06 02:16:22,852][52647] Sum rewards: 54.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.690', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon5': '0.180', 'AMMO4': '0.244', 'AMMO3': '0.267', 'weapon4': '0.376', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.786', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '48.000'} [2024-08-06 02:16:23,244][52669] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2024-08-06 02:16:23,274][52794] DAMAGECOUNT value on done: 286849.0 [2024-08-06 02:16:23,275][52794] Sum rewards: 68.742, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.200', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon2': '0.274', 'AMMO3': '0.313', 'WEAPON3': '1.850', 'weapon3': '3.276', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '61.000'} [2024-08-06 02:16:23,326][52669] DAMAGECOUNT value on done: 288903.0 [2024-08-06 02:16:23,327][52669] Sum rewards: 62.305, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.132', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.390', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '53.000'} [2024-08-06 02:16:23,739][52666] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:16:24,124][52671] DAMAGECOUNT value on done: 288629.0 [2024-08-06 02:16:24,125][52671] Sum rewards: 72.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.064', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.128', 'AMMO3': '0.242', 'weapon4': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.370', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2024-08-06 02:16:24,813][52658] DAMAGECOUNT value on done: 278723.0 [2024-08-06 02:16:24,813][52658] Sum rewards: 76.338, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.305', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '66.000'} [2024-08-06 02:16:25,179][52647] DAMAGECOUNT value on done: 299132.0 [2024-08-06 02:16:25,180][52647] Sum rewards: 61.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.543', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.056', 'weapon4': '0.156', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:25,338][52650] Updated weights for policy 0, policy_version 36801 (0.0020) [2024-08-06 02:16:25,913][52660] DAMAGECOUNT value on done: 283254.0 [2024-08-06 02:16:25,913][52660] Sum rewards: 60.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon4': '0.254', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.172', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '50.000'} [2024-08-06 02:16:26,023][52794] DAMAGECOUNT value on done: 279544.0 [2024-08-06 02:16:26,029][52794] Sum rewards: 77.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.955', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.154', 'AMMO4': '0.174', 'weapon2': '0.212', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '65.000'} [2024-08-06 02:16:26,531][52669] DAMAGECOUNT value on done: 297179.0 [2024-08-06 02:16:26,531][52669] Sum rewards: 68.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.121', 'weapon5': '0.140', 'weapon2': '0.210', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.320', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:27,114][52671] DAMAGECOUNT value on done: 286229.0 [2024-08-06 02:16:27,115][52671] Sum rewards: 63.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.882', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.330', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.292', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '53.000'} [2024-08-06 02:16:27,464][52658] DAMAGECOUNT value on done: 291002.0 [2024-08-06 02:16:27,465][52658] Sum rewards: 63.516, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'weapon4': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.311', 'weapon2': '0.348', 'WEAPON3': '1.800', 'weapon3': '3.114', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:27,632][52647] DAMAGECOUNT value on done: 302000.0 [2024-08-06 02:16:27,632][52647] Sum rewards: 57.381, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.749', 'AMMO2': '0.012', 'AMMO5': '0.014', 'weapon4': '0.034', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.210', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '47.000'} [2024-08-06 02:16:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 301514752. Throughput: 0: 4369.1. Samples: 75386750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:16:27,794][52567] Avg episode reward: [(0, '67.519')] [2024-08-06 02:16:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036806_301514752.pth... [2024-08-06 02:16:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036292_297304064.pth [2024-08-06 02:16:28,877][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:16:28,955][52794] DAMAGECOUNT value on done: 292726.0 [2024-08-06 02:16:28,957][52794] Sum rewards: 60.583, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.504', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.598', 'WEAPON3': '0.850', 'weapon3': '2.646', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '47.500'} [2024-08-06 02:16:29,197][52660] DAMAGECOUNT value on done: 276315.0 [2024-08-06 02:16:29,198][52660] Sum rewards: 63.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.661', 'AMMO5': '0.008', 'AMMO2': '0.059', 'weapon5': '0.134', 'AMMO3': '0.229', 'weapon4': '0.236', 'weapon2': '0.246', 'AMMO4': '0.295', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:29,747][52669] DAMAGECOUNT value on done: 287672.0 [2024-08-06 02:16:29,748][52669] Sum rewards: 71.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.086', 'weapon5': '0.088', 'AMMO3': '0.228', 'AMMO4': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '60.000'} [2024-08-06 02:16:30,034][52671] DAMAGECOUNT value on done: 286309.0 [2024-08-06 02:16:30,036][52671] Sum rewards: 61.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.182', 'AMMO3': '0.203', 'weapon2': '0.552', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.002', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '51.000'} [2024-08-06 02:16:30,172][52650] Updated weights for policy 0, policy_version 36811 (0.0019) [2024-08-06 02:16:30,357][52658] DAMAGECOUNT value on done: 290083.0 [2024-08-06 02:16:30,359][52658] Sum rewards: 69.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.204', 'AMMO3': '0.212', 'weapon2': '0.212', 'AMMO4': '0.237', 'weapon4': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.112', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:30,414][52647] DAMAGECOUNT value on done: 299940.0 [2024-08-06 02:16:30,414][52647] Sum rewards: 66.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.065', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon2': '0.470', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.340', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:31,535][52660] DAMAGECOUNT value on done: 286247.0 [2024-08-06 02:16:31,536][52660] Sum rewards: 86.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.192', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.156', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'weapon3': '3.642', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.391', 'FRAGCOUNT': '72.000'} [2024-08-06 02:16:32,062][52794] DAMAGECOUNT value on done: 282813.0 [2024-08-06 02:16:32,063][52794] Sum rewards: 75.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.174', 'AMMO4': '0.187', 'weapon5': '0.194', 'weapon2': '0.198', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '64.000'} [2024-08-06 02:16:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 301596672. Throughput: 0: 4359.1. Samples: 75399680. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:16:32,794][52567] Avg episode reward: [(0, '67.748')] [2024-08-06 02:16:32,795][52614] Saving new best policy, reward=67.748! [2024-08-06 02:16:32,857][52669] DAMAGECOUNT value on done: 291547.0 [2024-08-06 02:16:32,858][52669] Sum rewards: 74.194, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.778', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'weapon2': '0.136', 'AMMO3': '0.161', 'WEAPON3': '1.050', 'HITCOUNT': '3.200', 'weapon3': '3.520', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '61.000'} [2024-08-06 02:16:33,043][52671] DAMAGECOUNT value on done: 284155.0 [2024-08-06 02:16:33,043][52671] Sum rewards: 68.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.918', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '61.000'} [2024-08-06 02:16:33,491][52658] DAMAGECOUNT value on done: 292958.0 [2024-08-06 02:16:33,494][52658] Sum rewards: 62.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.728', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.222', 'weapon4': '0.236', 'AMMO4': '0.268', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.756', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:33,732][52647] DAMAGECOUNT value on done: 304205.0 [2024-08-06 02:16:33,733][52647] Sum rewards: 62.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.132', 'weapon5': '0.134', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.128', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:34,206][52660] DAMAGECOUNT value on done: 280672.0 [2024-08-06 02:16:34,207][52660] Sum rewards: 64.468, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.160', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO3': '0.144', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.776', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '50.500'} [2024-08-06 02:16:34,361][52650] Updated weights for policy 0, policy_version 36821 (0.0011) [2024-08-06 02:16:34,939][52794] DAMAGECOUNT value on done: 292984.0 [2024-08-06 02:16:34,941][52794] Sum rewards: 71.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.915', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.166', 'AMMO3': '0.238', 'AMMO4': '0.261', 'weapon5': '0.270', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '60.500'} [2024-08-06 02:16:35,797][52669] DAMAGECOUNT value on done: 287183.0 [2024-08-06 02:16:35,799][52669] Sum rewards: 62.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.370', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.216', 'weapon4': '0.230', 'weapon5': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '53.000'} [2024-08-06 02:16:36,262][52671] DAMAGECOUNT value on done: 292932.0 [2024-08-06 02:16:36,264][52671] Sum rewards: 63.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.106', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:36,474][52658] DAMAGECOUNT value on done: 277977.0 [2024-08-06 02:16:36,475][52658] Sum rewards: 66.985, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.054', 'weapon4': '0.120', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.316', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '59.000'} [2024-08-06 02:16:36,542][52647] DAMAGECOUNT value on done: 299023.0 [2024-08-06 02:16:36,542][52647] Sum rewards: 65.860, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.514', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon5': '0.170', 'weapon2': '0.184', 'AMMO3': '0.229', 'weapon4': '0.244', 'AMMO4': '0.281', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.176', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '56.000'} [2024-08-06 02:16:36,882][52614] Signal inference workers to stop experience collection... (6650 times) [2024-08-06 02:16:36,883][52614] Signal inference workers to resume experience collection... (6650 times) [2024-08-06 02:16:36,971][52650] InferenceWorker_p0-w0: stopping experience collection (6650 times) [2024-08-06 02:16:36,971][52650] InferenceWorker_p0-w0: resuming experience collection (6650 times) [2024-08-06 02:16:37,531][52794] DAMAGECOUNT value on done: 286869.0 [2024-08-06 02:16:37,531][52794] Sum rewards: 61.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.115', 'weapon4': '0.152', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.720', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 301686784. Throughput: 0: 4364.7. Samples: 75425670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:16:37,794][52567] Avg episode reward: [(0, '67.553')] [2024-08-06 02:16:38,401][52669] DAMAGECOUNT value on done: 290932.0 [2024-08-06 02:16:38,401][52669] Sum rewards: 69.828, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.134', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.410', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:39,037][52666] DAMAGECOUNT value on done: 289548.0 [2024-08-06 02:16:39,044][52666] Sum rewards: 62.673, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.732', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon5': '0.250', 'weapon4': '0.266', 'AMMO3': '0.279', 'weapon2': '0.280', 'AMMO4': '0.309', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.740', 'weapon3': '2.864', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:39,264][52658] DAMAGECOUNT value on done: 285435.0 [2024-08-06 02:16:39,266][52658] Sum rewards: 70.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.066', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '59.000'} [2024-08-06 02:16:39,334][52671] DAMAGECOUNT value on done: 285254.0 [2024-08-06 02:16:39,334][52671] Sum rewards: 60.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.121', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.226', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:39,348][52647] DAMAGECOUNT value on done: 296152.0 [2024-08-06 02:16:39,349][52647] Sum rewards: 59.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.679', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.148', 'weapon2': '0.154', 'weapon4': '0.154', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.444', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '50.000'} [2024-08-06 02:16:39,597][52650] Updated weights for policy 0, policy_version 36831 (0.0041) [2024-08-06 02:16:40,152][52794] DAMAGECOUNT value on done: 288633.0 [2024-08-06 02:16:40,153][52794] Sum rewards: 62.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.557', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.108', 'weapon5': '0.116', 'AMMO4': '0.143', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.242', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:40,633][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:16:41,683][52666] DAMAGECOUNT value on done: 289423.0 [2024-08-06 02:16:41,684][52666] Sum rewards: 53.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.168', 'weapon5': '0.280', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '44.000'} [2024-08-06 02:16:41,929][52647] DAMAGECOUNT value on done: 302107.0 [2024-08-06 02:16:41,929][52647] Sum rewards: 63.167, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.756', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.182', 'AMMO4': '0.210', 'AMMO3': '0.237', 'WEAPON5': '0.350', 'weapon2': '0.406', 'weapon4': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.644', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:42,037][52658] DAMAGECOUNT value on done: 284960.0 [2024-08-06 02:16:42,037][52658] Sum rewards: 63.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO3': '0.128', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon4': '1.014', 'weapon3': '2.410', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 02:16:42,298][52671] DAMAGECOUNT value on done: 289378.0 [2024-08-06 02:16:42,299][52671] Sum rewards: 57.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.612', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.169', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '48.500'} [2024-08-06 02:16:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 301776896. Throughput: 0: 4363.8. Samples: 75452030. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:16:42,794][52567] Avg episode reward: [(0, '66.794')] [2024-08-06 02:16:43,250][52794] DAMAGECOUNT value on done: 297931.0 [2024-08-06 02:16:43,258][52794] Sum rewards: 59.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.204', 'AMMO3': '0.237', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '50.000'} [2024-08-06 02:16:44,093][52650] Updated weights for policy 0, policy_version 36841 (0.0020) [2024-08-06 02:16:44,379][52666] DAMAGECOUNT value on done: 290189.0 [2024-08-06 02:16:44,379][52666] Sum rewards: 77.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.061', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.125', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '65.000'} [2024-08-06 02:16:44,419][52647] DAMAGECOUNT value on done: 296475.0 [2024-08-06 02:16:44,419][52647] Sum rewards: 61.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.932', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.068', 'AMMO3': '0.244', 'weapon5': '0.246', 'weapon2': '0.268', 'AMMO4': '0.338', 'WEAPON5': '0.450', 'weapon4': '0.458', 'WEAPON4': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.670', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:45,121][52658] DAMAGECOUNT value on done: 279457.0 [2024-08-06 02:16:45,125][52658] Sum rewards: 76.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.648', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.119', 'weapon5': '0.184', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '62.000'} [2024-08-06 02:16:45,315][52671] DAMAGECOUNT value on done: 289548.0 [2024-08-06 02:16:45,316][52671] Sum rewards: 65.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.111', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:46,169][52794] DAMAGECOUNT value on done: 285618.0 [2024-08-06 02:16:46,173][52794] Sum rewards: 55.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.052', 'weapon4': '0.154', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.370', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '3.122', 'DAMAGECOUNT': '13.119', 'FRAGCOUNT': '50.000'} [2024-08-06 02:16:46,408][52670] DAMAGECOUNT value on done: 282219.0 [2024-08-06 02:16:46,410][52670] Sum rewards: 65.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.665', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.054', 'weapon5': '0.096', 'AMMO3': '0.199', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.214', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:46,980][52666] DAMAGECOUNT value on done: 285857.0 [2024-08-06 02:16:46,982][52666] Sum rewards: 66.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.253', 'weapon4': '0.284', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.946', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:47,186][52647] DAMAGECOUNT value on done: 302785.0 [2024-08-06 02:16:47,188][52647] Sum rewards: 73.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.371', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.193', 'weapon4': '0.200', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.174', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '59.000'} [2024-08-06 02:16:47,684][52658] DAMAGECOUNT value on done: 281284.0 [2024-08-06 02:16:47,687][52658] Sum rewards: 52.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.098', 'AMMO4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.217', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '3.092', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '45.000'} [2024-08-06 02:16:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 301867008. Throughput: 0: 4363.1. Samples: 75465360. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:16:47,794][52567] Avg episode reward: [(0, '66.612')] [2024-08-06 02:16:48,368][52671] DAMAGECOUNT value on done: 280776.0 [2024-08-06 02:16:48,376][52671] Sum rewards: 67.266, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.062', 'HEALTH': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.146', 'weapon4': '0.212', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '3.190', 'weapon3': '3.320', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:48,497][52650] Updated weights for policy 0, policy_version 36851 (0.0031) [2024-08-06 02:16:49,504][52670] DAMAGECOUNT value on done: 286836.0 [2024-08-06 02:16:49,506][52670] Sum rewards: 60.744, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.262', 'weapon2': '0.406', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.326', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '53.000'} [2024-08-06 02:16:49,868][52647] DAMAGECOUNT value on done: 295644.0 [2024-08-06 02:16:49,869][52647] Sum rewards: 57.255, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.162', 'weapon5': '0.164', 'weapon2': '0.230', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.102', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:49,975][52666] DAMAGECOUNT value on done: 280951.0 [2024-08-06 02:16:49,976][52666] Sum rewards: 63.810, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.529', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon5': '0.252', 'weapon2': '0.278', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.228', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2024-08-06 02:16:50,451][52658] DAMAGECOUNT value on done: 291519.0 [2024-08-06 02:16:50,451][52658] Sum rewards: 65.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.662', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.078', 'weapon4': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:51,300][52671] DAMAGECOUNT value on done: 290278.0 [2024-08-06 02:16:51,302][52671] Sum rewards: 66.211, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.122', 'weapon5': '0.214', 'AMMO4': '0.248', 'AMMO3': '0.252', 'weapon2': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.106', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:52,442][52670] DAMAGECOUNT value on done: 278321.0 [2024-08-06 02:16:52,444][52670] Sum rewards: 69.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.102', 'weapon4': '0.128', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:52,731][52647] DAMAGECOUNT value on done: 298326.0 [2024-08-06 02:16:52,732][52647] Sum rewards: 60.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'AMMO5': '0.024', 'AMMO2': '0.060', 'AMMO3': '0.234', 'weapon5': '0.238', 'weapon4': '0.282', 'AMMO4': '0.301', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.706', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '52.000'} [2024-08-06 02:16:52,795][52567] Fps is (10 sec: 17202.2, 60 sec: 17476.1, 300 sec: 17494.7). Total num frames: 301948928. Throughput: 0: 4374.2. Samples: 75491950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:16:52,795][52567] Avg episode reward: [(0, '66.233')] [2024-08-06 02:16:53,110][52658] DAMAGECOUNT value on done: 282366.0 [2024-08-06 02:16:53,110][52658] Sum rewards: 64.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.251', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.197', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.102', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '54.000'} [2024-08-06 02:16:53,112][52666] DAMAGECOUNT value on done: 277041.0 [2024-08-06 02:16:53,112][52666] Sum rewards: 64.944, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon2': '0.178', 'weapon5': '0.182', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.308', 'WEAPON3': '1.800', 'HITCOUNT': '3.100', 'weapon3': '3.282', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:53,476][52650] Updated weights for policy 0, policy_version 36861 (0.0011) [2024-08-06 02:16:54,321][52671] DAMAGECOUNT value on done: 292052.0 [2024-08-06 02:16:54,324][52671] Sum rewards: 70.670, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.380', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:55,415][52647] DAMAGECOUNT value on done: 298205.0 [2024-08-06 02:16:55,417][52647] Sum rewards: 83.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.969', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.074', 'weapon5': '0.094', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '68.000'} [2024-08-06 02:16:55,436][52670] DAMAGECOUNT value on done: 279600.0 [2024-08-06 02:16:55,436][52670] Sum rewards: 68.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.170', 'AMMO3': '0.206', 'weapon4': '0.210', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:55,911][52666] DAMAGECOUNT value on done: 283938.0 [2024-08-06 02:16:55,913][52666] Sum rewards: 62.308, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.733', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.086', 'weapon5': '0.144', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '3.168', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '51.000'} [2024-08-06 02:16:55,997][52658] DAMAGECOUNT value on done: 286140.0 [2024-08-06 02:16:55,999][52658] Sum rewards: 66.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.405', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.103', 'weapon4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '57.000'} [2024-08-06 02:16:57,305][52671] DAMAGECOUNT value on done: 286168.0 [2024-08-06 02:16:57,306][52671] Sum rewards: 70.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.605', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.060', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 302039040. Throughput: 0: 4373.8. Samples: 75518320. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:16:57,794][52567] Avg episode reward: [(0, '66.431')] [2024-08-06 02:16:57,884][52670] DAMAGECOUNT value on done: 288529.0 [2024-08-06 02:16:57,885][52670] Sum rewards: 74.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.364', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '59.000'} [2024-08-06 02:16:58,088][52650] Updated weights for policy 0, policy_version 36871 (0.0035) [2024-08-06 02:16:58,365][52795] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:16:58,373][52647] DAMAGECOUNT value on done: 306194.0 [2024-08-06 02:16:58,373][52647] Sum rewards: 78.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.266', 'weapon2': '0.358', 'WEAPON3': '1.650', 'weapon3': '3.186', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '67.000'} [2024-08-06 02:16:58,409][52666] DAMAGECOUNT value on done: 281652.0 [2024-08-06 02:16:58,411][52666] Sum rewards: 62.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.430', 'AMMO5': '0.006', 'weapon5': '0.022', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.430', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '55.000'} [2024-08-06 02:16:58,734][52658] DAMAGECOUNT value on done: 289462.0 [2024-08-06 02:16:58,743][52658] Sum rewards: 70.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.098', 'AMMO4': '0.152', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.528', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 02:16:59,664][52666] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:17:00,352][52670] DAMAGECOUNT value on done: 283653.0 [2024-08-06 02:17:00,353][52670] Sum rewards: 68.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.097', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.286', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.286', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '58.000'} [2024-08-06 02:17:00,443][52671] DAMAGECOUNT value on done: 295545.0 [2024-08-06 02:17:00,444][52671] Sum rewards: 68.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.171', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon2': '0.128', 'weapon5': '0.146', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'HITCOUNT': '3.400', 'weapon3': '3.408', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '59.000'} [2024-08-06 02:17:00,871][52666] DAMAGECOUNT value on done: 283284.0 [2024-08-06 02:17:00,882][52666] Sum rewards: 64.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.518', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.238', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:01,203][52647] DAMAGECOUNT value on done: 299567.0 [2024-08-06 02:17:01,204][52647] Sum rewards: 79.247, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.082', 'HEALTH': '0.090', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.238', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '63.000'} [2024-08-06 02:17:01,998][52795] DAMAGECOUNT value on done: 267495.0 [2024-08-06 02:17:01,999][52795] Sum rewards: 78.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.799', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'weapon4': '0.096', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '65.000'} [2024-08-06 02:17:02,474][52650] Updated weights for policy 0, policy_version 36881 (0.0013) [2024-08-06 02:17:02,794][52567] Fps is (10 sec: 18023.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 302129152. Throughput: 0: 4373.3. Samples: 75531420. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:17:02,794][52567] Avg episode reward: [(0, '66.744')] [2024-08-06 02:17:03,368][52670] DAMAGECOUNT value on done: 277515.0 [2024-08-06 02:17:03,368][52670] Sum rewards: 68.615, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.618', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO4': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.309', 'weapon2': '0.322', 'WEAPON3': '1.800', 'weapon3': '3.064', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:03,508][52647] DAMAGECOUNT value on done: 297700.0 [2024-08-06 02:17:03,508][52647] Sum rewards: 49.769, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.160', 'AMMO5': '0.015', 'AMMO2': '0.074', 'weapon5': '0.202', 'weapon2': '0.222', 'AMMO3': '0.304', 'weapon4': '0.308', 'AMMO4': '0.369', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'HITCOUNT': '2.490', 'weapon3': '2.928', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '48.000'} [2024-08-06 02:17:03,541][52671] DAMAGECOUNT value on done: 283778.0 [2024-08-06 02:17:03,543][52671] Sum rewards: 48.097, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.021', 'HEALTH': '0.096', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.185', 'weapon2': '0.634', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '3.048', 'DAMAGECOUNT': '12.756', 'FRAGCOUNT': '40.000'} [2024-08-06 02:17:04,008][52666] DAMAGECOUNT value on done: 280894.0 [2024-08-06 02:17:04,008][52666] Sum rewards: 69.434, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.432', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.156', 'weapon2': '0.772', 'WEAPON3': '0.950', 'weapon3': '3.116', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2024-08-06 02:17:05,147][52795] DAMAGECOUNT value on done: 260023.0 [2024-08-06 02:17:05,148][52795] Sum rewards: 73.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.340', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:06,210][52670] DAMAGECOUNT value on done: 281869.0 [2024-08-06 02:17:06,210][52670] Sum rewards: 72.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.082', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:06,293][52647] DAMAGECOUNT value on done: 297902.0 [2024-08-06 02:17:06,294][52647] Sum rewards: 69.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO3': '0.169', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '57.000'} [2024-08-06 02:17:06,379][52669] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:17:06,663][52671] DAMAGECOUNT value on done: 276744.0 [2024-08-06 02:17:06,664][52671] Sum rewards: 58.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.225', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon2': '0.212', 'weapon4': '0.230', 'AMMO3': '0.247', 'AMMO4': '0.271', 'weapon5': '0.308', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '50.000'} [2024-08-06 02:17:06,970][52666] DAMAGECOUNT value on done: 278781.0 [2024-08-06 02:17:06,973][52666] Sum rewards: 57.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.120', 'weapon7': '0.132', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.204', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.550', 'weapon3': '2.880', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '50.000'} [2024-08-06 02:17:07,341][52650] Updated weights for policy 0, policy_version 36891 (0.0026) [2024-08-06 02:17:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 302219264. Throughput: 0: 4382.2. Samples: 75557770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:17:07,794][52567] Avg episode reward: [(0, '66.314')] [2024-08-06 02:17:08,020][52664] Large shaping reward 3.381 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.33, 110.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:17:08,310][52795] DAMAGECOUNT value on done: 261257.0 [2024-08-06 02:17:08,310][52795] Sum rewards: 73.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.092', 'weapon4': '0.170', 'weapon2': '0.196', 'AMMO3': '0.210', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.324', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.000'} [2024-08-06 02:17:09,162][52647] DAMAGECOUNT value on done: 290505.0 [2024-08-06 02:17:09,162][52647] Sum rewards: 73.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.124', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:09,336][52670] DAMAGECOUNT value on done: 280333.0 [2024-08-06 02:17:09,339][52670] Sum rewards: 75.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.026', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.074', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '63.000'} [2024-08-06 02:17:09,599][52671] DAMAGECOUNT value on done: 289197.0 [2024-08-06 02:17:09,600][52671] Sum rewards: 79.936, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.265', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.130', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '65.000'} [2024-08-06 02:17:10,078][52666] DAMAGECOUNT value on done: 276945.0 [2024-08-06 02:17:10,078][52666] Sum rewards: 68.376, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.042', 'weapon4': '0.074', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.328', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.340', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '59.000'} [2024-08-06 02:17:10,561][52659] DAMAGECOUNT value on done: 286956.0 [2024-08-06 02:17:10,563][52659] Sum rewards: 64.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.368', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.356', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:11,498][52795] DAMAGECOUNT value on done: 262449.0 [2024-08-06 02:17:11,500][52795] Sum rewards: 62.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.460', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.278', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '53.000'} [2024-08-06 02:17:11,860][52650] Updated weights for policy 0, policy_version 36901 (0.0025) [2024-08-06 02:17:12,145][52647] DAMAGECOUNT value on done: 300704.0 [2024-08-06 02:17:12,146][52647] Sum rewards: 79.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO4': '0.199', 'AMMO3': '0.232', 'weapon4': '0.236', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '67.000'} [2024-08-06 02:17:12,530][52670] DAMAGECOUNT value on done: 274937.0 [2024-08-06 02:17:12,531][52670] Sum rewards: 56.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO4': '0.171', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '46.000'} [2024-08-06 02:17:12,596][52671] DAMAGECOUNT value on done: 290750.0 [2024-08-06 02:17:12,597][52671] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.142', 'AMMO4': '0.185', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 302301184. Throughput: 0: 4383.8. Samples: 75584020. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:17:12,794][52567] Avg episode reward: [(0, '66.542')] [2024-08-06 02:17:13,311][52666] DAMAGECOUNT value on done: 288812.0 [2024-08-06 02:17:13,312][52666] Sum rewards: 72.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.547', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.208', 'AMMO3': '0.210', 'weapon5': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '59.000'} [2024-08-06 02:17:13,462][52659] DAMAGECOUNT value on done: 283985.0 [2024-08-06 02:17:13,464][52659] Sum rewards: 70.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.080', 'AMMO3': '0.226', 'AMMO4': '0.277', 'weapon2': '0.414', 'weapon5': '0.464', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.734', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:14,585][52795] DAMAGECOUNT value on done: 268104.0 [2024-08-06 02:17:14,586][52795] Sum rewards: 63.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.298', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.180', 'AMMO3': '0.200', 'weapon2': '0.222', 'AMMO4': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.488', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '52.500'} [2024-08-06 02:17:15,116][52671] DAMAGECOUNT value on done: 292396.0 [2024-08-06 02:17:15,119][52671] Sum rewards: 62.604, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.044', 'HEALTH': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '3.238', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '50.000'} [2024-08-06 02:17:15,649][52670] DAMAGECOUNT value on done: 287556.0 [2024-08-06 02:17:15,650][52670] Sum rewards: 66.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO3': '0.188', 'AMMO4': '0.219', 'weapon4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:15,870][52659] DAMAGECOUNT value on done: 285626.0 [2024-08-06 02:17:15,870][52659] Sum rewards: 72.619, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.094', 'AMMO4': '0.228', 'AMMO3': '0.237', 'weapon5': '0.260', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '62.500'} [2024-08-06 02:17:16,259][52666] DAMAGECOUNT value on done: 287303.0 [2024-08-06 02:17:16,261][52666] Sum rewards: 70.003, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '55.000'} [2024-08-06 02:17:16,392][52803] DAMAGECOUNT value on done: 266406.0 [2024-08-06 02:17:16,392][52803] Sum rewards: 79.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.120', 'AMMO4': '0.162', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '67.000'} [2024-08-06 02:17:16,666][52650] Updated weights for policy 0, policy_version 36911 (0.0012) [2024-08-06 02:17:17,755][52795] DAMAGECOUNT value on done: 265986.0 [2024-08-06 02:17:17,757][52795] Sum rewards: 72.376, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.569', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.199', 'weapon2': '0.226', 'weapon4': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.024', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '63.000'} [2024-08-06 02:17:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 302391296. Throughput: 0: 4390.9. Samples: 75597270. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:17:17,794][52567] Avg episode reward: [(0, '66.938')] [2024-08-06 02:17:17,888][52671] DAMAGECOUNT value on done: 288590.0 [2024-08-06 02:17:17,888][52671] Sum rewards: 65.920, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.140', 'weapon2': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.500', 'weapon3': '2.684', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '58.000'} [2024-08-06 02:17:18,449][52670] DAMAGECOUNT value on done: 284511.0 [2024-08-06 02:17:18,449][52670] Sum rewards: 58.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.128', 'weapon4': '0.168', 'AMMO4': '0.186', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '49.000'} [2024-08-06 02:17:18,840][52659] DAMAGECOUNT value on done: 285784.0 [2024-08-06 02:17:18,841][52659] Sum rewards: 74.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.118', 'weapon2': '0.154', 'weapon4': '0.190', 'AMMO4': '0.201', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:19,206][52666] DAMAGECOUNT value on done: 282531.0 [2024-08-06 02:17:19,208][52666] Sum rewards: 62.492, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.874', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.092', 'weapon5': '0.106', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.462', 'WEAPON3': '1.700', 'weapon3': '3.030', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '57.000'} [2024-08-06 02:17:19,557][52803] DAMAGECOUNT value on done: 266798.0 [2024-08-06 02:17:19,560][52803] Sum rewards: 60.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon5': '0.262', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.062', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '48.000'} [2024-08-06 02:17:20,572][52671] DAMAGECOUNT value on done: 284609.0 [2024-08-06 02:17:20,573][52671] Sum rewards: 76.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.417', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.181', 'AMMO3': '0.185', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.184', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.500'} [2024-08-06 02:17:20,830][52795] DAMAGECOUNT value on done: 269647.0 [2024-08-06 02:17:20,832][52795] Sum rewards: 76.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.825', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon4': '0.104', 'weapon5': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '64.000'} [2024-08-06 02:17:21,228][52650] Updated weights for policy 0, policy_version 36921 (0.0029) [2024-08-06 02:17:21,399][52659] DAMAGECOUNT value on done: 281424.0 [2024-08-06 02:17:21,399][52659] Sum rewards: 66.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.101', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON3': '1.050', 'HITCOUNT': '3.260', 'weapon3': '3.462', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '53.500'} [2024-08-06 02:17:21,676][52670] DAMAGECOUNT value on done: 283842.0 [2024-08-06 02:17:21,678][52670] Sum rewards: 65.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.572', 'ARMOR': '0.005', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.086', 'AMMO3': '0.156', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '53.000'} [2024-08-06 02:17:21,744][52663] DAMAGECOUNT value on done: 288565.0 [2024-08-06 02:17:21,744][52663] Sum rewards: 50.217, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.520', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.180', 'AMMO3': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.750', 'HITCOUNT': '2.840', 'weapon3': '2.876', 'DAMAGECOUNT': '14.001', 'FRAGCOUNT': '47.500'} [2024-08-06 02:17:22,042][52811] DAMAGECOUNT value on done: 276806.0 [2024-08-06 02:17:22,046][52811] Sum rewards: 65.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.264', 'AMMO3': '0.287', 'weapon4': '0.290', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:22,476][52666] DAMAGECOUNT value on done: 282954.0 [2024-08-06 02:17:22,478][52666] Sum rewards: 70.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.142', 'AMMO3': '0.196', 'weapon5': '0.206', 'AMMO4': '0.260', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '58.000'} [2024-08-06 02:17:22,620][52803] DAMAGECOUNT value on done: 267390.0 [2024-08-06 02:17:22,623][52803] Sum rewards: 74.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.756', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.132', 'AMMO3': '0.200', 'weapon5': '0.258', 'AMMO4': '0.303', 'weapon2': '0.380', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 302481408. Throughput: 0: 4399.3. Samples: 75623640. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:17:22,795][52567] Avg episode reward: [(0, '67.038')] [2024-08-06 02:17:22,866][52665] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:17:23,507][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:17:23,926][52795] DAMAGECOUNT value on done: 265843.0 [2024-08-06 02:17:23,928][52795] Sum rewards: 70.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.163', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.342', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:24,219][52663] DAMAGECOUNT value on done: 285373.0 [2024-08-06 02:17:24,219][52663] Sum rewards: 59.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.236', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.147', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '2.736', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '51.000'} [2024-08-06 02:17:24,246][52659] DAMAGECOUNT value on done: 284491.0 [2024-08-06 02:17:24,246][52659] Sum rewards: 68.480, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.368', 'weapon2': '0.416', 'WEAPON3': '0.900', 'weapon3': '2.946', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '54.500'} [2024-08-06 02:17:24,907][52670] DAMAGECOUNT value on done: 288604.0 [2024-08-06 02:17:24,915][52670] Sum rewards: 63.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.740', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '55.000'} [2024-08-06 02:17:25,135][52811] DAMAGECOUNT value on done: 264962.0 [2024-08-06 02:17:25,136][52811] Sum rewards: 60.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.354', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.247', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '50.500'} [2024-08-06 02:17:25,747][52666] DAMAGECOUNT value on done: 280937.0 [2024-08-06 02:17:25,748][52666] Sum rewards: 75.418, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.215', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.270', 'WEAPON3': '0.950', 'HITCOUNT': '3.390', 'weapon3': '3.404', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '59.000'} [2024-08-06 02:17:25,853][52803] DAMAGECOUNT value on done: 268523.0 [2024-08-06 02:17:25,855][52803] Sum rewards: 69.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.090', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.198', 'WEAPON3': '1.250', 'HITCOUNT': '3.410', 'weapon3': '3.446', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:26,001][52650] Updated weights for policy 0, policy_version 36931 (0.0013) [2024-08-06 02:17:26,792][52663] DAMAGECOUNT value on done: 282275.0 [2024-08-06 02:17:26,792][52663] Sum rewards: 75.778, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.254', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'weapon5': '0.146', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:26,888][52659] DAMAGECOUNT value on done: 286570.0 [2024-08-06 02:17:26,889][52659] Sum rewards: 64.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.094', 'AMMO4': '0.174', 'AMMO3': '0.218', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.150', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:27,110][52795] DAMAGECOUNT value on done: 261092.0 [2024-08-06 02:17:27,110][52795] Sum rewards: 48.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.852', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon7': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.146', 'AMMO4': '0.148', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'weapon4': '0.552', 'WEAPON3': '1.200', 'HITCOUNT': '2.390', 'weapon3': '2.500', 'DAMAGECOUNT': '12.621', 'FRAGCOUNT': '43.000'} [2024-08-06 02:17:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 302571520. Throughput: 0: 4390.0. Samples: 75649580. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:17:27,794][52567] Avg episode reward: [(0, '66.640')] [2024-08-06 02:17:28,000][52665] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:17:28,213][52670] DAMAGECOUNT value on done: 285867.0 [2024-08-06 02:17:28,213][52670] Sum rewards: 75.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon4': '0.154', 'weapon5': '0.158', 'AMMO3': '0.164', 'AMMO4': '0.183', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.132', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:28,339][52811] DAMAGECOUNT value on done: 269466.0 [2024-08-06 02:17:28,340][52811] Sum rewards: 65.484, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-5.300', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon4': '0.062', 'weapon5': '0.166', 'AMMO4': '0.269', 'AMMO3': '0.343', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '2.000', 'weapon3': '3.082', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:29,049][52803] DAMAGECOUNT value on done: 271358.0 [2024-08-06 02:17:29,049][52803] Sum rewards: 68.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.090', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.215', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:29,068][52666] DAMAGECOUNT value on done: 287608.0 [2024-08-06 02:17:29,068][52666] Sum rewards: 54.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.620', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.456', 'WEAPON3': '1.650', 'HITCOUNT': '2.910', 'weapon3': '3.192', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '49.000'} [2024-08-06 02:17:29,198][52659] DAMAGECOUNT value on done: 282161.0 [2024-08-06 02:17:29,199][52659] Sum rewards: 60.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.973', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.117', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.842', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '48.000'} [2024-08-06 02:17:29,621][52663] DAMAGECOUNT value on done: 287163.0 [2024-08-06 02:17:29,623][52663] Sum rewards: 73.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.430', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:29,626][52669] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 02:17:30,346][52795] DAMAGECOUNT value on done: 270919.0 [2024-08-06 02:17:30,346][52795] Sum rewards: 60.673, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.689', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.036', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'weapon4': '0.192', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:30,534][52650] Updated weights for policy 0, policy_version 36941 (0.0012) [2024-08-06 02:17:31,026][52670] DAMAGECOUNT value on done: 271230.0 [2024-08-06 02:17:31,026][52670] Sum rewards: 75.669, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.215', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO3': '0.151', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.488', 'WEAPON3': '0.900', 'weapon3': '2.922', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:31,478][52811] DAMAGECOUNT value on done: 264819.0 [2024-08-06 02:17:31,480][52811] Sum rewards: 63.011, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.616', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.062', 'AMMO4': '0.133', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.356', 'AMMO3': '0.366', 'WEAPON3': '2.000', 'weapon3': '3.112', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:31,918][52666] DAMAGECOUNT value on done: 277173.0 [2024-08-06 02:17:31,919][52666] Sum rewards: 73.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.070', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.344', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.000'} [2024-08-06 02:17:32,093][52803] DAMAGECOUNT value on done: 266385.0 [2024-08-06 02:17:32,095][52803] Sum rewards: 57.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.384', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.266', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.042', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '49.000'} [2024-08-06 02:17:32,289][52659] DAMAGECOUNT value on done: 292922.0 [2024-08-06 02:17:32,290][52659] Sum rewards: 74.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.072', 'weapon4': '0.122', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '63.000'} [2024-08-06 02:17:32,692][52663] DAMAGECOUNT value on done: 285656.0 [2024-08-06 02:17:32,693][52663] Sum rewards: 57.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.024', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.124', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.852', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '47.000'} [2024-08-06 02:17:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 302653440. Throughput: 0: 4390.2. Samples: 75662920. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:17:32,794][52567] Avg episode reward: [(0, '67.010')] [2024-08-06 02:17:33,506][52795] DAMAGECOUNT value on done: 264766.0 [2024-08-06 02:17:33,507][52795] Sum rewards: 65.020, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.078', 'weapon5': '0.094', 'AMMO4': '0.142', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '3.178', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '52.000'} [2024-08-06 02:17:34,234][52670] DAMAGECOUNT value on done: 284728.0 [2024-08-06 02:17:34,236][52670] Sum rewards: 72.665, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.104', 'AMMO4': '0.199', 'AMMO3': '0.239', 'weapon4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.888', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '62.000'} [2024-08-06 02:17:34,537][52659] DAMAGECOUNT value on done: 292241.0 [2024-08-06 02:17:34,538][52659] Sum rewards: 63.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.218', 'AMMO3': '0.242', 'weapon2': '0.278', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.188', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:34,544][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:17:34,604][52811] DAMAGECOUNT value on done: 267880.0 [2024-08-06 02:17:34,605][52811] Sum rewards: 75.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon4': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:34,868][52666] DAMAGECOUNT value on done: 285840.0 [2024-08-06 02:17:34,868][52666] Sum rewards: 69.467, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.692', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.166', 'weapon2': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.341', 'WEAPON3': '1.950', 'weapon3': '3.346', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:35,203][52650] Updated weights for policy 0, policy_version 36951 (0.0013) [2024-08-06 02:17:35,206][52803] DAMAGECOUNT value on done: 263944.0 [2024-08-06 02:17:35,206][52803] Sum rewards: 64.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.130', 'weapon5': '0.144', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.868', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '52.000'} [2024-08-06 02:17:35,883][52663] DAMAGECOUNT value on done: 290636.0 [2024-08-06 02:17:35,883][52663] Sum rewards: 61.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.028', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.330', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.408', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '51.000'} [2024-08-06 02:17:36,684][52670] DAMAGECOUNT value on done: 291424.0 [2024-08-06 02:17:36,685][52670] Sum rewards: 64.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.044', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '53.000'} [2024-08-06 02:17:36,704][52795] DAMAGECOUNT value on done: 262163.0 [2024-08-06 02:17:36,704][52795] Sum rewards: 77.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.084', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '64.000'} [2024-08-06 02:17:37,469][52659] DAMAGECOUNT value on done: 286667.0 [2024-08-06 02:17:37,471][52659] Sum rewards: 69.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.344', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.192', 'AMMO3': '0.214', 'weapon2': '0.226', 'AMMO4': '0.244', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '59.000'} [2024-08-06 02:17:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 302735360. Throughput: 0: 4387.4. Samples: 75689380. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 02:17:37,794][52567] Avg episode reward: [(0, '67.247')] [2024-08-06 02:17:37,807][52811] DAMAGECOUNT value on done: 273904.0 [2024-08-06 02:17:37,807][52811] Sum rewards: 54.968, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.114', 'weapon5': '0.214', 'AMMO4': '0.259', 'AMMO3': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.634', 'WEAPON3': '1.700', 'weapon3': '2.730', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '50.000'} [2024-08-06 02:17:38,239][52803] DAMAGECOUNT value on done: 264345.0 [2024-08-06 02:17:38,241][52803] Sum rewards: 66.638, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.092', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '3.094', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '53.000'} [2024-08-06 02:17:38,739][52663] DAMAGECOUNT value on done: 287017.0 [2024-08-06 02:17:38,742][52663] Sum rewards: 69.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.574', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.101', 'weapon5': '0.116', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.428', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:39,346][52670] DAMAGECOUNT value on done: 284386.0 [2024-08-06 02:17:39,347][52670] Sum rewards: 64.922, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.116', 'weapon4': '0.148', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:39,960][52650] Updated weights for policy 0, policy_version 36961 (0.0032) [2024-08-06 02:17:39,997][52795] DAMAGECOUNT value on done: 257947.0 [2024-08-06 02:17:39,997][52795] Sum rewards: 70.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.168', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.400', 'HITCOUNT': '3.400', 'weapon3': '3.476', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:40,568][52659] DAMAGECOUNT value on done: 287594.0 [2024-08-06 02:17:40,568][52659] Sum rewards: 70.985, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.710', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.134', 'weapon4': '0.168', 'AMMO4': '0.185', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '62.000'} [2024-08-06 02:17:40,917][52811] DAMAGECOUNT value on done: 267521.0 [2024-08-06 02:17:40,917][52811] Sum rewards: 67.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon5': '0.114', 'AMMO3': '0.183', 'weapon4': '0.202', 'weapon2': '0.218', 'AMMO4': '0.298', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '57.000'} [2024-08-06 02:17:41,312][52803] DAMAGECOUNT value on done: 267045.0 [2024-08-06 02:17:41,312][52803] Sum rewards: 66.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.005', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.202', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '55.000'} [2024-08-06 02:17:41,588][52663] DAMAGECOUNT value on done: 285144.0 [2024-08-06 02:17:41,589][52663] Sum rewards: 67.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.414', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.076', 'weapon5': '0.128', 'AMMO4': '0.132', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.000'} [2024-08-06 02:17:41,658][52670] DAMAGECOUNT value on done: 284891.0 [2024-08-06 02:17:41,658][52670] Sum rewards: 67.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.404', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.147', 'AMMO4': '0.191', 'weapon5': '0.252', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.686', 'WEAPON3': '0.850', 'weapon3': '2.534', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 302833664. Throughput: 0: 4384.7. Samples: 75715630. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:17:42,794][52567] Avg episode reward: [(0, '67.629')] [2024-08-06 02:17:43,254][52795] DAMAGECOUNT value on done: 266697.0 [2024-08-06 02:17:43,254][52795] Sum rewards: 62.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.365', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.264', 'weapon4': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.044', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:43,685][52659] DAMAGECOUNT value on done: 278938.0 [2024-08-06 02:17:43,687][52659] Sum rewards: 57.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.118', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.416', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '48.500'} [2024-08-06 02:17:44,061][52811] DAMAGECOUNT value on done: 267628.0 [2024-08-06 02:17:44,062][52811] Sum rewards: 57.135, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.468', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon2': '0.114', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon4': '0.846', 'weapon3': '2.752', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.452', 'FRAGCOUNT': '44.000'} [2024-08-06 02:17:44,343][52803] DAMAGECOUNT value on done: 263615.0 [2024-08-06 02:17:44,345][52803] Sum rewards: 60.999, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.542', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.291', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.756', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:44,497][52663] DAMAGECOUNT value on done: 285234.0 [2024-08-06 02:17:44,498][52663] Sum rewards: 68.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:45,006][52650] Updated weights for policy 0, policy_version 36971 (0.0029) [2024-08-06 02:17:46,165][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:17:46,426][52795] DAMAGECOUNT value on done: 257892.0 [2024-08-06 02:17:46,428][52795] Sum rewards: 73.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.769', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.136', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '59.000'} [2024-08-06 02:17:46,503][52659] DAMAGECOUNT value on done: 286511.0 [2024-08-06 02:17:46,503][52659] Sum rewards: 62.955, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.331', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.176', 'weapon4': '0.230', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.926', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '57.000'} [2024-08-06 02:17:47,109][52811] DAMAGECOUNT value on done: 277824.0 [2024-08-06 02:17:47,110][52811] Sum rewards: 69.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.500', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'weapon2': '0.242', 'AMMO3': '0.298', 'WEAPON4': '0.400', 'weapon4': '0.530', 'WEAPON3': '1.800', 'weapon3': '2.896', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '58.000'} [2024-08-06 02:17:47,413][52803] DAMAGECOUNT value on done: 273475.0 [2024-08-06 02:17:47,415][52803] Sum rewards: 65.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.098', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:47,418][52663] DAMAGECOUNT value on done: 287707.0 [2024-08-06 02:17:47,419][52663] Sum rewards: 65.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.626', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.072', 'AMMO4': '0.142', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 02:17:47,727][52664] DAMAGECOUNT value on done: 297735.0 [2024-08-06 02:17:47,727][52664] Sum rewards: 77.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.152', 'AMMO4': '0.166', 'AMMO3': '0.205', 'weapon2': '0.218', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '64.000'} [2024-08-06 02:17:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 302915584. Throughput: 0: 4387.3. Samples: 75728850. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:17:47,794][52567] Avg episode reward: [(0, '67.112')] [2024-08-06 02:17:49,125][52659] DAMAGECOUNT value on done: 292261.0 [2024-08-06 02:17:49,127][52659] Sum rewards: 73.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.170', 'AMMO3': '0.206', 'weapon4': '0.222', 'weapon2': '0.224', 'AMMO4': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '61.000'} [2024-08-06 02:17:49,253][52650] Updated weights for policy 0, policy_version 36981 (0.0014) [2024-08-06 02:17:49,716][52795] DAMAGECOUNT value on done: 273006.0 [2024-08-06 02:17:49,719][52795] Sum rewards: 63.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.450', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.312', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '55.000'} [2024-08-06 02:17:49,973][52663] DAMAGECOUNT value on done: 289646.0 [2024-08-06 02:17:49,973][52663] Sum rewards: 62.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.593', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.152', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.104', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '53.000'} [2024-08-06 02:17:50,170][52811] DAMAGECOUNT value on done: 268532.0 [2024-08-06 02:17:50,173][52811] Sum rewards: 71.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.985', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:50,482][52803] DAMAGECOUNT value on done: 269789.0 [2024-08-06 02:17:50,487][52803] Sum rewards: 61.484, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.214', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon4': '0.208', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '52.500'} [2024-08-06 02:17:50,958][52664] DAMAGECOUNT value on done: 298719.0 [2024-08-06 02:17:50,958][52664] Sum rewards: 74.008, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.064', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:51,906][52659] DAMAGECOUNT value on done: 296290.0 [2024-08-06 02:17:51,916][52659] Sum rewards: 78.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.462', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.146', 'weapon2': '0.152', 'AMMO4': '0.199', 'AMMO3': '0.221', 'weapon4': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '64.000'} [2024-08-06 02:17:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17613.0, 300 sec: 17522.6). Total num frames: 303005696. Throughput: 0: 4381.8. Samples: 75754950. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:17:52,794][52567] Avg episode reward: [(0, '67.182')] [2024-08-06 02:17:52,847][52795] DAMAGECOUNT value on done: 269480.0 [2024-08-06 02:17:52,847][52795] Sum rewards: 70.716, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.060', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.146', 'weapon5': '0.204', 'weapon2': '0.216', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:53,315][52811] DAMAGECOUNT value on done: 268806.0 [2024-08-06 02:17:53,316][52811] Sum rewards: 71.067, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.980', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.304', 'WEAPON3': '1.800', 'weapon3': '3.520', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '63.000'} [2024-08-06 02:17:53,388][52663] DAMAGECOUNT value on done: 285571.0 [2024-08-06 02:17:53,389][52663] Sum rewards: 66.969, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.392', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon2': '0.196', 'weapon5': '0.216', 'AMMO3': '0.270', 'AMMO4': '0.297', 'WEAPON5': '0.350', 'weapon4': '0.486', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.764', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:53,506][52803] DAMAGECOUNT value on done: 266308.0 [2024-08-06 02:17:53,506][52803] Sum rewards: 63.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.122', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.432', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '54.500'} [2024-08-06 02:17:53,612][52664] DAMAGECOUNT value on done: 298638.0 [2024-08-06 02:17:53,613][52664] Sum rewards: 82.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.058', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.052', 'weapon4': '0.084', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '71.000'} [2024-08-06 02:17:54,003][52650] Updated weights for policy 0, policy_version 36991 (0.0011) [2024-08-06 02:17:54,692][52659] DAMAGECOUNT value on done: 291865.0 [2024-08-06 02:17:54,693][52659] Sum rewards: 64.207, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.568', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.125', 'weapon4': '0.138', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.586', 'WEAPON3': '0.950', 'weapon3': '3.018', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '50.000'} [2024-08-06 02:17:56,034][52664] DAMAGECOUNT value on done: 296098.0 [2024-08-06 02:17:56,037][52664] Sum rewards: 63.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.128', 'AMMO4': '0.148', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.236', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '56.000'} [2024-08-06 02:17:56,042][52795] DAMAGECOUNT value on done: 257945.0 [2024-08-06 02:17:56,043][52795] Sum rewards: 59.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.074', 'weapon5': '0.218', 'AMMO4': '0.266', 'AMMO3': '0.268', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.920', 'weapon3': '3.104', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '51.000'} [2024-08-06 02:17:56,169][52663] DAMAGECOUNT value on done: 279104.0 [2024-08-06 02:17:56,169][52663] Sum rewards: 74.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.173', 'weapon2': '0.276', 'WEAPON3': '1.150', 'weapon3': '3.430', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '60.000'} [2024-08-06 02:17:56,476][52811] DAMAGECOUNT value on done: 272851.0 [2024-08-06 02:17:56,478][52811] Sum rewards: 70.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.668', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.096', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '59.000'} [2024-08-06 02:17:56,706][52803] DAMAGECOUNT value on done: 272953.0 [2024-08-06 02:17:56,710][52803] Sum rewards: 59.330, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.161', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.153', 'weapon5': '0.154', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'weapon4': '0.476', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '46.000'} [2024-08-06 02:17:57,535][52659] DAMAGECOUNT value on done: 287179.0 [2024-08-06 02:17:57,536][52659] Sum rewards: 60.763, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.922', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.122', 'AMMO3': '0.160', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.706', 'WEAPON3': '1.050', 'weapon3': '2.786', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '47.500'} [2024-08-06 02:17:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 303095808. Throughput: 0: 4385.5. Samples: 75781370. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 02:17:57,794][52567] Avg episode reward: [(0, '67.042')] [2024-08-06 02:17:58,436][52664] DAMAGECOUNT value on done: 297385.0 [2024-08-06 02:17:58,436][52664] Sum rewards: 56.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.400', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '47.000'} [2024-08-06 02:17:58,553][52650] Updated weights for policy 0, policy_version 37001 (0.0013) [2024-08-06 02:17:59,022][52820] DAMAGECOUNT value on done: 262422.0 [2024-08-06 02:17:59,031][52820] Sum rewards: 65.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.326', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.162', 'AMMO4': '0.186', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.168', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '54.000'} [2024-08-06 02:17:59,179][52663] DAMAGECOUNT value on done: 282453.0 [2024-08-06 02:17:59,180][52663] Sum rewards: 76.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.199', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.090', 'AMMO3': '0.193', 'weapon5': '0.220', 'AMMO4': '0.221', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '62.000'} [2024-08-06 02:17:59,191][52795] DAMAGECOUNT value on done: 269202.0 [2024-08-06 02:17:59,193][52795] Sum rewards: 66.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.540', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.234', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '57.000'} [2024-08-06 02:17:59,559][52811] DAMAGECOUNT value on done: 267819.0 [2024-08-06 02:17:59,562][52811] Sum rewards: 69.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.274', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.420', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '58.000'} [2024-08-06 02:17:59,929][52803] DAMAGECOUNT value on done: 266655.0 [2024-08-06 02:17:59,932][52803] Sum rewards: 65.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.661', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.144', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON3': '0.950', 'HITCOUNT': '3.060', 'weapon3': '3.214', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:00,323][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:18:00,509][52659] DAMAGECOUNT value on done: 290095.0 [2024-08-06 02:18:00,510][52659] Sum rewards: 65.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.985', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.215', 'AMMO4': '0.229', 'weapon5': '0.234', 'weapon4': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:00,981][52664] DAMAGECOUNT value on done: 297519.0 [2024-08-06 02:18:00,984][52664] Sum rewards: 72.116, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.848', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.248', 'weapon4': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.120', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '59.000'} [2024-08-06 02:18:02,122][52820] DAMAGECOUNT value on done: 266025.0 [2024-08-06 02:18:02,125][52820] Sum rewards: 63.771, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.870', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.066', 'weapon4': '0.080', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.000'} [2024-08-06 02:18:02,349][52795] DAMAGECOUNT value on done: 271643.0 [2024-08-06 02:18:02,350][52795] Sum rewards: 75.928, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.540', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.072', 'AMMO4': '0.194', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.500'} [2024-08-06 02:18:02,394][52663] DAMAGECOUNT value on done: 284968.0 [2024-08-06 02:18:02,395][52663] Sum rewards: 70.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.238', 'WEAPON3': '1.550', 'weapon3': '3.378', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '59.000'} [2024-08-06 02:18:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 303177728. Throughput: 0: 4380.7. Samples: 75794400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:18:02,794][52567] Avg episode reward: [(0, '67.141')] [2024-08-06 02:18:02,809][52803] DAMAGECOUNT value on done: 266492.0 [2024-08-06 02:18:02,811][52803] Sum rewards: 68.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.794', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.116', 'AMMO4': '0.147', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:02,868][52811] DAMAGECOUNT value on done: 271701.0 [2024-08-06 02:18:02,869][52811] Sum rewards: 57.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.056', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.294', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.450', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:03,121][52659] DAMAGECOUNT value on done: 290155.0 [2024-08-06 02:18:03,122][52659] Sum rewards: 59.662, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.220', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.186', 'weapon5': '0.230', 'AMMO4': '0.260', 'AMMO3': '0.342', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.950', 'weapon3': '2.772', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:03,294][52650] Updated weights for policy 0, policy_version 37011 (0.0011) [2024-08-06 02:18:03,935][52664] DAMAGECOUNT value on done: 301488.0 [2024-08-06 02:18:03,935][52664] Sum rewards: 73.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.181', 'weapon4': '0.184', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:04,897][52663] DAMAGECOUNT value on done: 290965.0 [2024-08-06 02:18:04,897][52663] Sum rewards: 82.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.565', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.070', 'weapon4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.248', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.448', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '68.000'} [2024-08-06 02:18:05,187][52820] DAMAGECOUNT value on done: 264962.0 [2024-08-06 02:18:05,187][52820] Sum rewards: 65.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.698', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.124', 'AMMO4': '0.187', 'AMMO3': '0.214', 'weapon5': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '53.000'} [2024-08-06 02:18:05,901][52803] DAMAGECOUNT value on done: 273645.0 [2024-08-06 02:18:05,903][52803] Sum rewards: 64.104, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.739', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.114', 'AMMO3': '0.161', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.838', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:05,909][52811] DAMAGECOUNT value on done: 269907.0 [2024-08-06 02:18:05,911][52811] Sum rewards: 68.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.945', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.118', 'AMMO4': '0.127', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.500'} [2024-08-06 02:18:07,101][52664] DAMAGECOUNT value on done: 291137.0 [2024-08-06 02:18:07,102][52664] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.084', 'weapon4': '0.098', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:07,404][52663] DAMAGECOUNT value on done: 286222.0 [2024-08-06 02:18:07,406][52663] Sum rewards: 60.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.117', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.284', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '3.326', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:07,738][52665] DAMAGECOUNT value on done: 280843.0 [2024-08-06 02:18:07,739][52665] Sum rewards: 65.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.580', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.134', 'AMMO4': '0.179', 'AMMO3': '0.205', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '53.000'} [2024-08-06 02:18:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.9). Total num frames: 303267840. Throughput: 0: 4381.8. Samples: 75820820. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:18:07,794][52567] Avg episode reward: [(0, '66.809')] [2024-08-06 02:18:07,941][52649] DAMAGECOUNT value on done: 278683.0 [2024-08-06 02:18:07,941][52649] Sum rewards: 73.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.555', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.336', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '63.000'} [2024-08-06 02:18:08,078][52650] Updated weights for policy 0, policy_version 37021 (0.0017) [2024-08-06 02:18:08,445][52820] DAMAGECOUNT value on done: 259260.0 [2024-08-06 02:18:08,445][52820] Sum rewards: 62.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.805', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'weapon4': '0.126', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.342', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:08,894][52811] DAMAGECOUNT value on done: 264428.0 [2024-08-06 02:18:08,895][52811] Sum rewards: 63.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.624', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.179', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.118', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:09,138][52803] DAMAGECOUNT value on done: 265832.0 [2024-08-06 02:18:09,138][52803] Sum rewards: 58.440, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.370', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon4': '0.178', 'weapon5': '0.182', 'AMMO3': '0.283', 'AMMO4': '0.323', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.914', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '53.000'} [2024-08-06 02:18:10,350][52663] DAMAGECOUNT value on done: 292748.0 [2024-08-06 02:18:10,350][52663] Sum rewards: 66.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.060', 'weapon5': '0.066', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.454', 'WEAPON3': '1.650', 'weapon3': '3.194', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 02:18:10,440][52664] DAMAGECOUNT value on done: 305492.0 [2024-08-06 02:18:10,445][52664] Sum rewards: 69.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.076', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '59.000'} [2024-08-06 02:18:10,469][52665] DAMAGECOUNT value on done: 287666.0 [2024-08-06 02:18:10,469][52665] Sum rewards: 67.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.381', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.178', 'AMMO3': '0.203', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:10,838][52649] DAMAGECOUNT value on done: 272599.0 [2024-08-06 02:18:10,838][52649] Sum rewards: 62.945, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.248', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.148', 'weapon4': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.330', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:11,582][52820] DAMAGECOUNT value on done: 267484.0 [2024-08-06 02:18:11,582][52820] Sum rewards: 88.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.253', 'weapon2': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.430', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '76.000'} [2024-08-06 02:18:11,971][52811] DAMAGECOUNT value on done: 268228.0 [2024-08-06 02:18:11,971][52811] Sum rewards: 65.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.393', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.156', 'AMMO4': '0.167', 'weapon5': '0.180', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:12,290][52803] DAMAGECOUNT value on done: 272646.0 [2024-08-06 02:18:12,291][52803] Sum rewards: 81.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.327', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.004', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '68.000'} [2024-08-06 02:18:12,714][52650] Updated weights for policy 0, policy_version 37031 (0.0032) [2024-08-06 02:18:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 303357952. Throughput: 0: 4393.6. Samples: 75847290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:18:12,794][52567] Avg episode reward: [(0, '67.182')] [2024-08-06 02:18:12,828][52665] DAMAGECOUNT value on done: 284072.0 [2024-08-06 02:18:12,828][52665] Sum rewards: 77.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.674', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.113', 'AMMO3': '0.163', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '62.000'} [2024-08-06 02:18:13,231][52649] DAMAGECOUNT value on done: 280345.0 [2024-08-06 02:18:13,232][52649] Sum rewards: 67.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.182', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '57.000'} [2024-08-06 02:18:13,386][52663] DAMAGECOUNT value on done: 289327.0 [2024-08-06 02:18:13,387][52663] Sum rewards: 71.116, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.582', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.076', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '59.000'} [2024-08-06 02:18:13,658][52664] DAMAGECOUNT value on done: 296852.0 [2024-08-06 02:18:13,659][52664] Sum rewards: 67.457, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.991', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.138', 'AMMO3': '0.148', 'weapon5': '0.154', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '53.000'} [2024-08-06 02:18:14,610][52820] DAMAGECOUNT value on done: 261652.0 [2024-08-06 02:18:14,610][52820] Sum rewards: 60.426, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.106', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.152', 'weapon5': '0.192', 'AMMO4': '0.219', 'AMMO3': '0.296', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.994', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:15,076][52811] DAMAGECOUNT value on done: 271370.0 [2024-08-06 02:18:15,078][52811] Sum rewards: 63.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.852', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon2': '0.156', 'weapon5': '0.192', 'AMMO4': '0.194', 'AMMO3': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.290', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '54.500'} [2024-08-06 02:18:15,338][52803] DAMAGECOUNT value on done: 262596.0 [2024-08-06 02:18:15,338][52803] Sum rewards: 57.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.085', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.212', 'weapon2': '1.070', 'WEAPON3': '1.300', 'weapon3': '2.572', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '49.000'} [2024-08-06 02:18:15,397][52665] DAMAGECOUNT value on done: 282271.0 [2024-08-06 02:18:15,406][52665] Sum rewards: 53.491, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.545', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.106', 'weapon4': '0.208', 'AMMO4': '0.262', 'AMMO3': '0.293', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.966', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:15,718][52649] DAMAGECOUNT value on done: 281235.0 [2024-08-06 02:18:15,718][52649] Sum rewards: 62.492, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.906', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.114', 'AMMO4': '0.173', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'WEAPON3': '1.750', 'HITCOUNT': '3.130', 'weapon3': '3.404', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '56.500'} [2024-08-06 02:18:16,431][52663] DAMAGECOUNT value on done: 281452.0 [2024-08-06 02:18:16,431][52663] Sum rewards: 70.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.238', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.088', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '61.000'} [2024-08-06 02:18:16,635][52664] DAMAGECOUNT value on done: 300921.0 [2024-08-06 02:18:16,636][52664] Sum rewards: 78.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.894', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.160', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '64.000'} [2024-08-06 02:18:17,256][52650] Updated weights for policy 0, policy_version 37041 (0.0012) [2024-08-06 02:18:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 303448064. Throughput: 0: 4390.7. Samples: 75860500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:18:17,794][52567] Avg episode reward: [(0, '67.309')] [2024-08-06 02:18:17,906][52820] DAMAGECOUNT value on done: 263633.0 [2024-08-06 02:18:17,907][52820] Sum rewards: 54.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.755', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.189', 'weapon5': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.100', 'HITCOUNT': '2.620', 'weapon3': '2.878', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '46.000'} [2024-08-06 02:18:18,087][52811] DAMAGECOUNT value on done: 267231.0 [2024-08-06 02:18:18,088][52811] Sum rewards: 66.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon4': '0.112', 'AMMO3': '0.186', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:18,114][52665] DAMAGECOUNT value on done: 279174.0 [2024-08-06 02:18:18,114][52665] Sum rewards: 74.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.780', 'AMMO5': '0.013', 'AMMO2': '0.059', 'AMMO3': '0.176', 'weapon2': '0.224', 'weapon5': '0.270', 'AMMO4': '0.295', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '58.000'} [2024-08-06 02:18:18,727][52649] DAMAGECOUNT value on done: 271526.0 [2024-08-06 02:18:18,727][52649] Sum rewards: 60.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.714', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:19,156][52664] DAMAGECOUNT value on done: 297523.0 [2024-08-06 02:18:19,156][52664] Sum rewards: 61.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.045', 'AMMO5': '0.018', 'AMMO2': '0.079', 'weapon2': '0.212', 'AMMO3': '0.231', 'weapon5': '0.318', 'AMMO4': '0.395', 'weapon4': '0.414', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:21,096][52820] DAMAGECOUNT value on done: 268276.0 [2024-08-06 02:18:21,096][52820] Sum rewards: 73.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.190', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.190', 'AMMO4': '0.199', 'AMMO3': '0.203', 'weapon2': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.792', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '61.000'} [2024-08-06 02:18:21,154][52811] DAMAGECOUNT value on done: 273338.0 [2024-08-06 02:18:21,156][52811] Sum rewards: 63.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.166', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.074', 'weapon5': '0.180', 'AMMO3': '0.203', 'AMMO4': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.072', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:21,480][52665] DAMAGECOUNT value on done: 277329.0 [2024-08-06 02:18:21,482][52665] Sum rewards: 58.684, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon4': '0.366', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:21,759][52664] DAMAGECOUNT value on done: 303145.0 [2024-08-06 02:18:21,760][52664] Sum rewards: 76.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.090', 'AMMO4': '0.127', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '61.000'} [2024-08-06 02:18:21,971][52667] DAMAGECOUNT value on done: 288261.0 [2024-08-06 02:18:21,973][52667] Sum rewards: 63.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.148', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.180', 'AMMO3': '0.200', 'weapon5': '0.246', 'AMMO4': '0.299', 'weapon2': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '2.992', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:22,053][52649] DAMAGECOUNT value on done: 282359.0 [2024-08-06 02:18:22,053][52649] Sum rewards: 72.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.783', 'AMMO5': '0.004', 'AMMO2': '0.016', 'ARMOR': '0.016', 'weapon5': '0.026', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.112', 'weapon2': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.350', 'weapon3': '3.546', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:22,164][52649] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.027, -9.0), ('weapon5', 0.002)] [2024-08-06 02:18:22,183][52650] Updated weights for policy 0, policy_version 37051 (0.0012) [2024-08-06 02:18:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 303529984. Throughput: 0: 4388.2. Samples: 75886850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:18:22,795][52567] Avg episode reward: [(0, '67.066')] [2024-08-06 02:18:24,239][52820] DAMAGECOUNT value on done: 265956.0 [2024-08-06 02:18:24,239][52820] Sum rewards: 64.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.243', 'weapon2': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '3.380', 'weapon3': '3.432', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:24,312][52665] DAMAGECOUNT value on done: 286852.0 [2024-08-06 02:18:24,313][52665] Sum rewards: 60.557, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.675', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.110', 'AMMO4': '0.166', 'AMMO3': '0.198', 'weapon5': '0.198', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.200', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:24,622][52664] DAMAGECOUNT value on done: 297779.0 [2024-08-06 02:18:24,622][52664] Sum rewards: 61.603, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.940', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.261', 'AMMO3': '0.283', 'weapon4': '0.320', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.070', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:24,756][52649] DAMAGECOUNT value on done: 279553.0 [2024-08-06 02:18:24,759][52649] Sum rewards: 77.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.076', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'AMMO4': '0.221', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.330', 'weapon3': '3.390', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 02:18:25,042][52667] DAMAGECOUNT value on done: 291914.0 [2024-08-06 02:18:25,044][52667] Sum rewards: 73.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.256', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.450', 'weapon3': '3.478', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '62.000'} [2024-08-06 02:18:26,523][52662] DAMAGECOUNT value on done: 295688.0 [2024-08-06 02:18:26,525][52662] Sum rewards: 71.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.044', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO3': '0.167', 'AMMO4': '0.170', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.356', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:26,611][52650] Updated weights for policy 0, policy_version 37061 (0.0033) [2024-08-06 02:18:26,728][52665] DAMAGECOUNT value on done: 286685.0 [2024-08-06 02:18:26,729][52665] Sum rewards: 72.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.589', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.224', 'weapon4': '0.240', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '59.000'} [2024-08-06 02:18:27,269][52649] DAMAGECOUNT value on done: 285380.0 [2024-08-06 02:18:27,271][52649] Sum rewards: 75.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.146', 'AMMO3': '0.206', 'weapon2': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '62.000'} [2024-08-06 02:18:27,555][52664] DAMAGECOUNT value on done: 303607.0 [2024-08-06 02:18:27,556][52664] Sum rewards: 74.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.335', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.472', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '63.000'} [2024-08-06 02:18:27,559][52820] DAMAGECOUNT value on done: 268394.0 [2024-08-06 02:18:27,560][52820] Sum rewards: 75.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.154', 'AMMO4': '0.226', 'weapon5': '0.228', 'AMMO3': '0.241', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '63.000'} [2024-08-06 02:18:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 303620096. Throughput: 0: 4389.8. Samples: 75913170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:18:27,794][52567] Avg episode reward: [(0, '67.503')] [2024-08-06 02:18:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037063_303620096.pth... [2024-08-06 02:18:27,834][52663] Large shaping reward 2.626 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon5', 0.002)] [2024-08-06 02:18:27,903][52667] DAMAGECOUNT value on done: 289442.0 [2024-08-06 02:18:27,903][52667] Sum rewards: 73.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.335', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:27,917][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036550_299417600.pth [2024-08-06 02:18:29,526][52662] DAMAGECOUNT value on done: 295455.0 [2024-08-06 02:18:29,527][52662] Sum rewards: 69.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.248', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.540', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '58.000'} [2024-08-06 02:18:29,828][52665] DAMAGECOUNT value on done: 286918.0 [2024-08-06 02:18:29,830][52665] Sum rewards: 63.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.053', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.448', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.208', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:30,168][52664] DAMAGECOUNT value on done: 293765.0 [2024-08-06 02:18:30,169][52664] Sum rewards: 62.436, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.110', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.224', 'AMMO3': '0.331', 'WEAPON3': '2.000', 'HITCOUNT': '3.260', 'weapon3': '3.464', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '57.000'} [2024-08-06 02:18:30,398][52649] DAMAGECOUNT value on done: 281713.0 [2024-08-06 02:18:30,400][52649] Sum rewards: 63.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.072', 'weapon5': '0.148', 'AMMO3': '0.239', 'weapon2': '0.242', 'AMMO4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.254', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:30,710][52820] DAMAGECOUNT value on done: 267895.0 [2024-08-06 02:18:30,711][52820] Sum rewards: 68.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.138', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.312', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.408', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:30,725][52667] DAMAGECOUNT value on done: 288484.0 [2024-08-06 02:18:30,726][52667] Sum rewards: 60.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.174', 'AMMO4': '0.174', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.038', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:31,444][52650] Updated weights for policy 0, policy_version 37071 (0.0019) [2024-08-06 02:18:31,465][52668] DAMAGECOUNT value on done: 285875.0 [2024-08-06 02:18:31,466][52668] Sum rewards: 69.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.885', 'AMMO5': '0.025', 'AMMO2': '0.077', 'AMMO3': '0.195', 'weapon2': '0.214', 'weapon5': '0.308', 'AMMO4': '0.385', 'weapon4': '0.612', 'WEAPON5': '0.700', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.532', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '57.000'} [2024-08-06 02:18:32,675][52662] DAMAGECOUNT value on done: 294215.0 [2024-08-06 02:18:32,675][52662] Sum rewards: 54.199, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.224', 'AMMO5': '0.022', 'AMMO2': '0.084', 'weapon4': '0.178', 'AMMO3': '0.220', 'weapon2': '0.266', 'weapon5': '0.284', 'AMMO4': '0.418', 'WEAPON5': '0.650', 'WEAPON4': '0.850', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '2.900', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 303710208. Throughput: 0: 4383.3. Samples: 75926100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:18:32,794][52567] Avg episode reward: [(0, '67.574')] [2024-08-06 02:18:32,884][52665] DAMAGECOUNT value on done: 283974.0 [2024-08-06 02:18:32,884][52665] Sum rewards: 66.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.877', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO4': '0.176', 'AMMO3': '0.180', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:33,049][52664] DAMAGECOUNT value on done: 299014.0 [2024-08-06 02:18:33,050][52664] Sum rewards: 74.027, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.166', 'weapon2': '0.248', 'WEAPON3': '1.100', 'weapon3': '3.332', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '59.000'} [2024-08-06 02:18:33,426][52649] DAMAGECOUNT value on done: 281624.0 [2024-08-06 02:18:33,426][52649] Sum rewards: 65.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.048', 'AMMO3': '0.140', 'AMMO4': '0.191', 'weapon5': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.500'} [2024-08-06 02:18:33,450][52667] DAMAGECOUNT value on done: 293700.0 [2024-08-06 02:18:33,450][52667] Sum rewards: 71.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.160', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.218', 'AMMO3': '0.251', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:33,889][52820] DAMAGECOUNT value on done: 269289.0 [2024-08-06 02:18:33,891][52820] Sum rewards: 59.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.272', 'weapon2': '0.338', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.194', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '49.000'} [2024-08-06 02:18:34,691][52668] DAMAGECOUNT value on done: 292304.0 [2024-08-06 02:18:34,691][52668] Sum rewards: 51.305, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.121', 'AMMO3': '0.142', 'weapon7': '0.148', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.420', 'weapon4': '0.524', 'WEAPON3': '0.850', 'weapon3': '2.638', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '12.351', 'FRAGCOUNT': '40.000'} [2024-08-06 02:18:35,366][52664] DAMAGECOUNT value on done: 301121.0 [2024-08-06 02:18:35,367][52664] Sum rewards: 56.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.304', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.158', 'weapon4': '0.212', 'AMMO4': '0.219', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.080', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '49.000'} [2024-08-06 02:18:35,857][52662] DAMAGECOUNT value on done: 285397.0 [2024-08-06 02:18:35,859][52662] Sum rewards: 57.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.111', 'weapon4': '0.114', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.592', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.976', 'DAMAGECOUNT': '13.470', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:36,084][52667] DAMAGECOUNT value on done: 291500.0 [2024-08-06 02:18:36,084][52667] Sum rewards: 76.522, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.593', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.182', 'AMMO4': '0.189', 'weapon4': '0.212', 'AMMO3': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '65.000'} [2024-08-06 02:18:36,089][52650] Updated weights for policy 0, policy_version 37081 (0.0011) [2024-08-06 02:18:36,110][52665] DAMAGECOUNT value on done: 291218.0 [2024-08-06 02:18:36,112][52665] Sum rewards: 63.271, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.125', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.156', 'weapon5': '0.168', 'AMMO3': '0.182', 'AMMO4': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:36,454][52649] DAMAGECOUNT value on done: 282606.0 [2024-08-06 02:18:36,456][52649] Sum rewards: 72.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.162', 'AMMO3': '0.191', 'AMMO4': '0.206', 'weapon4': '0.244', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '62.000'} [2024-08-06 02:18:37,053][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:18:37,145][52820] DAMAGECOUNT value on done: 268165.0 [2024-08-06 02:18:37,145][52820] Sum rewards: 57.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.858', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.080', 'AMMO3': '0.190', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.306', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.128', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '47.000'} [2024-08-06 02:18:37,568][52668] DAMAGECOUNT value on done: 292398.0 [2024-08-06 02:18:37,569][52668] Sum rewards: 62.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.078', 'AMMO4': '0.183', 'weapon4': '0.184', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.160', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 303792128. Throughput: 0: 4391.3. Samples: 75952560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:18:37,795][52567] Avg episode reward: [(0, '67.028')] [2024-08-06 02:18:38,492][52664] DAMAGECOUNT value on done: 298681.0 [2024-08-06 02:18:38,502][52664] Sum rewards: 59.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.109', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.256', 'weapon4': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.232', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '49.000'} [2024-08-06 02:18:38,794][52665] DAMAGECOUNT value on done: 287813.0 [2024-08-06 02:18:38,794][52665] Sum rewards: 69.214, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.492', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.176', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:38,915][52667] DAMAGECOUNT value on done: 293657.0 [2024-08-06 02:18:38,915][52667] Sum rewards: 66.805, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.062', 'AMMO4': '0.109', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon2': '0.962', 'WEAPON3': '1.100', 'weapon3': '2.706', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:39,074][52662] DAMAGECOUNT value on done: 293056.0 [2024-08-06 02:18:39,074][52662] Sum rewards: 79.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.276', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.156', 'AMMO3': '0.188', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '66.000'} [2024-08-06 02:18:39,390][52649] DAMAGECOUNT value on done: 282961.0 [2024-08-06 02:18:39,390][52649] Sum rewards: 76.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.034', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.167', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.480', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '61.000'} [2024-08-06 02:18:40,269][52668] DAMAGECOUNT value on done: 293617.0 [2024-08-06 02:18:40,272][52668] Sum rewards: 77.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.093', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '63.000'} [2024-08-06 02:18:40,348][52820] DAMAGECOUNT value on done: 268240.0 [2024-08-06 02:18:40,350][52820] Sum rewards: 68.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.734', 'AMMO5': '0.024', 'AMMO2': '0.080', 'AMMO3': '0.201', 'weapon2': '0.232', 'weapon5': '0.260', 'weapon4': '0.314', 'AMMO4': '0.401', 'WEAPON5': '0.700', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:40,670][52650] Updated weights for policy 0, policy_version 37091 (0.0017) [2024-08-06 02:18:41,171][52664] DAMAGECOUNT value on done: 299633.0 [2024-08-06 02:18:41,171][52664] Sum rewards: 53.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.252', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.064', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '47.000'} [2024-08-06 02:18:41,619][52667] DAMAGECOUNT value on done: 285974.0 [2024-08-06 02:18:41,621][52667] Sum rewards: 67.576, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.903', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.118', 'weapon5': '0.172', 'AMMO4': '0.176', 'AMMO3': '0.225', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:41,925][52665] DAMAGECOUNT value on done: 287095.0 [2024-08-06 02:18:41,926][52665] Sum rewards: 66.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.241', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.151', 'weapon5': '0.188', 'AMMO3': '0.211', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.256', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '53.000'} [2024-08-06 02:18:42,438][52662] DAMAGECOUNT value on done: 284722.0 [2024-08-06 02:18:42,438][52662] Sum rewards: 59.394, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.661', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.298', 'AMMO3': '0.311', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.000', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '54.500'} [2024-08-06 02:18:42,603][52649] DAMAGECOUNT value on done: 283928.0 [2024-08-06 02:18:42,605][52649] Sum rewards: 75.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.010', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon2': '0.228', 'AMMO3': '0.236', 'WEAPON3': '1.550', 'weapon3': '3.450', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '64.000'} [2024-08-06 02:18:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 303882240. Throughput: 0: 4388.9. Samples: 75978870. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:18:42,794][52567] Avg episode reward: [(0, '66.984')] [2024-08-06 02:18:43,032][52668] DAMAGECOUNT value on done: 283585.0 [2024-08-06 02:18:43,034][52668] Sum rewards: 76.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon7': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'weapon2': '0.182', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.231', 'weapon4': '0.232', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '63.000'} [2024-08-06 02:18:43,514][52820] DAMAGECOUNT value on done: 269796.0 [2024-08-06 02:18:43,522][52820] Sum rewards: 63.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.052', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:44,131][52667] DAMAGECOUNT value on done: 288811.0 [2024-08-06 02:18:44,132][52667] Sum rewards: 66.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.624', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.263', 'weapon2': '0.274', 'WEAPON4': '0.450', 'weapon4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:44,888][52665] DAMAGECOUNT value on done: 286020.0 [2024-08-06 02:18:44,889][52665] Sum rewards: 71.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO2': '0.016', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.212', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:45,312][52662] DAMAGECOUNT value on done: 295117.0 [2024-08-06 02:18:45,313][52662] Sum rewards: 82.105, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.334', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO4': '0.169', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.484', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '70.000'} [2024-08-06 02:18:45,466][52649] DAMAGECOUNT value on done: 286187.0 [2024-08-06 02:18:45,469][52649] Sum rewards: 71.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.775', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.186', 'AMMO3': '0.204', 'weapon4': '0.218', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:45,555][52650] Updated weights for policy 0, policy_version 37101 (0.0011) [2024-08-06 02:18:46,080][52668] DAMAGECOUNT value on done: 293108.0 [2024-08-06 02:18:46,081][52668] Sum rewards: 72.866, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.114', 'weapon4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:46,495][52667] DAMAGECOUNT value on done: 293181.0 [2024-08-06 02:18:46,496][52667] Sum rewards: 64.659, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.966', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'weapon2': '0.576', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '57.000'} [2024-08-06 02:18:46,803][52820] DAMAGECOUNT value on done: 268772.0 [2024-08-06 02:18:46,803][52820] Sum rewards: 60.796, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.640', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.193', 'weapon2': '0.562', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.334', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '49.000'} [2024-08-06 02:18:46,886][52659] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:18:47,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 303964160. Throughput: 0: 4394.4. Samples: 75992150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:18:47,795][52567] Avg episode reward: [(0, '67.287')] [2024-08-06 02:18:47,960][52665] DAMAGECOUNT value on done: 284948.0 [2024-08-06 02:18:47,961][52665] Sum rewards: 71.522, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.964', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.054', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.358', 'WEAPON3': '1.650', 'weapon3': '3.250', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '61.000'} [2024-08-06 02:18:48,348][52662] DAMAGECOUNT value on done: 299021.0 [2024-08-06 02:18:48,349][52662] Sum rewards: 62.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.869', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.127', 'weapon5': '0.148', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.208', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:48,688][52649] DAMAGECOUNT value on done: 276996.0 [2024-08-06 02:18:48,689][52649] Sum rewards: 75.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.198', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.140', 'AMMO3': '0.173', 'weapon4': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.938', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 02:18:49,113][52668] DAMAGECOUNT value on done: 290402.0 [2024-08-06 02:18:49,117][52668] Sum rewards: 66.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.196', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.201', 'weapon4': '0.376', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:49,194][52660] DAMAGECOUNT value on done: 283699.0 [2024-08-06 02:18:49,198][52660] Sum rewards: 63.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.094', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.120', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '53.000'} [2024-08-06 02:18:49,301][52667] DAMAGECOUNT value on done: 288913.0 [2024-08-06 02:18:49,301][52667] Sum rewards: 56.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.472', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.051', 'weapon4': '0.214', 'AMMO4': '0.256', 'AMMO3': '0.276', 'weapon2': '0.350', 'weapon5': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.670', 'weapon3': '2.700', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '49.500'} [2024-08-06 02:18:49,912][52650] Updated weights for policy 0, policy_version 37111 (0.0014) [2024-08-06 02:18:49,990][52820] DAMAGECOUNT value on done: 262624.0 [2024-08-06 02:18:49,990][52820] Sum rewards: 79.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'weapon4': '0.218', 'AMMO3': '0.227', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '64.000'} [2024-08-06 02:18:50,942][52662] DAMAGECOUNT value on done: 289960.0 [2024-08-06 02:18:50,945][52662] Sum rewards: 64.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.093', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.310', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.350', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:51,283][52665] DAMAGECOUNT value on done: 281818.0 [2024-08-06 02:18:51,284][52665] Sum rewards: 50.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon2': '0.218', 'AMMO3': '0.239', 'weapon5': '0.296', 'AMMO4': '0.330', 'weapon4': '0.422', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '44.000'} [2024-08-06 02:18:52,043][52668] DAMAGECOUNT value on done: 286309.0 [2024-08-06 02:18:52,045][52668] Sum rewards: 58.887, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.552', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.126', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.386', 'weapon2': '0.476', 'WEAPON3': '0.850', 'weapon3': '2.812', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '46.000'} [2024-08-06 02:18:52,052][52649] DAMAGECOUNT value on done: 283436.0 [2024-08-06 02:18:52,055][52649] Sum rewards: 69.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO4': '0.080', 'AMMO3': '0.240', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '59.000'} [2024-08-06 02:18:52,117][52660] DAMAGECOUNT value on done: 283244.0 [2024-08-06 02:18:52,117][52660] Sum rewards: 54.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.341', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon5': '0.174', 'AMMO3': '0.204', 'weapon2': '0.310', 'AMMO4': '0.326', 'WEAPON5': '0.450', 'weapon4': '0.468', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.778', 'DAMAGECOUNT': '12.984', 'FRAGCOUNT': '47.000'} [2024-08-06 02:18:52,171][52667] DAMAGECOUNT value on done: 290782.0 [2024-08-06 02:18:52,172][52667] Sum rewards: 63.724, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.258', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.144', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.350', 'weapon4': '0.396', 'weapon2': '0.496', 'WEAPON3': '0.850', 'weapon3': '2.472', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:52,298][52669] DAMAGECOUNT value on done: 291912.0 [2024-08-06 02:18:52,298][52669] Sum rewards: 62.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.734', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon4': '0.180', 'weapon5': '0.188', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '54.000'} [2024-08-06 02:18:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 304062464. Throughput: 0: 4390.0. Samples: 76018370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:18:52,794][52567] Avg episode reward: [(0, '66.879')] [2024-08-06 02:18:53,058][52820] DAMAGECOUNT value on done: 274041.0 [2024-08-06 02:18:53,061][52820] Sum rewards: 58.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.495', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.094', 'AMMO4': '0.168', 'AMMO3': '0.198', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.496', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '50.000'} [2024-08-06 02:18:53,829][52662] DAMAGECOUNT value on done: 301834.0 [2024-08-06 02:18:53,839][52662] Sum rewards: 57.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.188', 'weapon4': '0.448', 'WEAPON3': '0.950', 'HITCOUNT': '3.020', 'weapon3': '3.166', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '46.000'} [2024-08-06 02:18:54,489][52665] DAMAGECOUNT value on done: 282111.0 [2024-08-06 02:18:54,490][52665] Sum rewards: 61.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO3': '0.176', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.226', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.720', 'weapon3': '3.160', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:54,805][52650] Updated weights for policy 0, policy_version 37121 (0.0014) [2024-08-06 02:18:54,829][52669] DAMAGECOUNT value on done: 285803.0 [2024-08-06 02:18:54,830][52669] Sum rewards: 69.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.962', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.202', 'AMMO3': '0.208', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.582', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 02:18:55,034][52667] DAMAGECOUNT value on done: 288093.0 [2024-08-06 02:18:55,034][52667] Sum rewards: 56.854, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '46.000'} [2024-08-06 02:18:55,214][52668] DAMAGECOUNT value on done: 289883.0 [2024-08-06 02:18:55,214][52668] Sum rewards: 70.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.313', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.142', 'weapon4': '0.156', 'weapon2': '0.198', 'AMMO4': '0.206', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '61.000'} [2024-08-06 02:18:55,287][52660] DAMAGECOUNT value on done: 291671.0 [2024-08-06 02:18:55,287][52660] Sum rewards: 60.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.876', 'AMMO5': '0.013', 'AMMO2': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.118', 'AMMO3': '0.196', 'weapon5': '0.204', 'AMMO4': '0.285', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.336', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '50.500'} [2024-08-06 02:18:55,373][52649] DAMAGECOUNT value on done: 281125.0 [2024-08-06 02:18:55,373][52649] Sum rewards: 77.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.223', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '64.000'} [2024-08-06 02:18:56,065][52820] DAMAGECOUNT value on done: 276876.0 [2024-08-06 02:18:56,067][52820] Sum rewards: 65.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.184', 'weapon4': '0.240', 'AMMO3': '0.247', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:56,595][52662] DAMAGECOUNT value on done: 287743.0 [2024-08-06 02:18:56,595][52662] Sum rewards: 60.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.964', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO4': '0.246', 'AMMO3': '0.246', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.740', 'weapon3': '3.222', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.000'} [2024-08-06 02:18:57,418][52669] DAMAGECOUNT value on done: 291293.0 [2024-08-06 02:18:57,420][52669] Sum rewards: 80.548, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon4': '0.166', 'weapon2': '0.302', 'HEALTH': '0.485', 'WEAPON3': '0.700', 'weapon3': '3.212', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '61.000'} [2024-08-06 02:18:57,523][52667] DAMAGECOUNT value on done: 286150.0 [2024-08-06 02:18:57,524][52667] Sum rewards: 67.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.370', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.146', 'weapon2': '0.160', 'weapon5': '0.164', 'AMMO4': '0.187', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.324', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '55.000'} [2024-08-06 02:18:57,708][52665] DAMAGECOUNT value on done: 282462.0 [2024-08-06 02:18:57,708][52665] Sum rewards: 73.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.088', 'weapon4': '0.130', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '64.000'} [2024-08-06 02:18:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 304144384. Throughput: 0: 4387.7. Samples: 76044740. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:18:57,795][52567] Avg episode reward: [(0, '66.433')] [2024-08-06 02:18:58,066][52668] DAMAGECOUNT value on done: 289439.0 [2024-08-06 02:18:58,067][52668] Sum rewards: 54.307, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.630', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon5': '0.134', 'weapon4': '0.228', 'AMMO3': '0.263', 'AMMO4': '0.264', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.912', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '49.500'} [2024-08-06 02:18:58,139][52660] DAMAGECOUNT value on done: 290328.0 [2024-08-06 02:18:58,144][52660] Sum rewards: 62.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.176', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.098', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.204', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.300', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '52.000'} [2024-08-06 02:18:58,682][52649] DAMAGECOUNT value on done: 283908.0 [2024-08-06 02:18:58,683][52649] Sum rewards: 54.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.254', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.016', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '47.000'} [2024-08-06 02:18:58,922][52662] DAMAGECOUNT value on done: 288467.0 [2024-08-06 02:18:58,930][52662] Sum rewards: 49.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.087', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.144', 'AMMO4': '0.179', 'AMMO3': '0.188', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '2.798', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '41.000'} [2024-08-06 02:18:59,165][52650] Updated weights for policy 0, policy_version 37131 (0.0018) [2024-08-06 02:18:59,184][52820] DAMAGECOUNT value on done: 264573.0 [2024-08-06 02:18:59,184][52820] Sum rewards: 66.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.932', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.402', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '56.000'} [2024-08-06 02:18:59,977][52794] DAMAGECOUNT value on done: 291647.0 [2024-08-06 02:18:59,977][52794] Sum rewards: 55.292, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.738', 'WEAPON3': '1.000', 'HITCOUNT': '2.730', 'weapon3': '2.964', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '45.000'} [2024-08-06 02:19:00,158][52669] DAMAGECOUNT value on done: 287957.0 [2024-08-06 02:19:00,158][52669] Sum rewards: 58.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.468', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.056', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.268', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '49.000'} [2024-08-06 02:19:00,380][52667] DAMAGECOUNT value on done: 294310.0 [2024-08-06 02:19:00,381][52667] Sum rewards: 58.928, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.035', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.170', 'weapon2': '0.204', 'AMMO3': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '3.210', 'weapon3': '3.280', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 02:19:00,883][52665] DAMAGECOUNT value on done: 285492.0 [2024-08-06 02:19:00,884][52665] Sum rewards: 59.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.184', 'AMMO4': '0.196', 'weapon4': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.696', 'WEAPON3': '1.000', 'HITCOUNT': '2.430', 'weapon3': '2.666', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '49.000'} [2024-08-06 02:19:01,047][52668] DAMAGECOUNT value on done: 292142.0 [2024-08-06 02:19:01,047][52668] Sum rewards: 69.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.088', 'weapon4': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:01,169][52660] DAMAGECOUNT value on done: 288264.0 [2024-08-06 02:19:01,170][52660] Sum rewards: 65.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.582', 'AMMO5': '0.022', 'AMMO2': '0.070', 'AMMO3': '0.188', 'weapon4': '0.208', 'weapon2': '0.216', 'weapon5': '0.318', 'AMMO4': '0.349', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '53.000'} [2024-08-06 02:19:01,596][52662] DAMAGECOUNT value on done: 291670.0 [2024-08-06 02:19:01,596][52662] Sum rewards: 66.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.084', 'weapon4': '0.156', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:01,757][52649] DAMAGECOUNT value on done: 285946.0 [2024-08-06 02:19:01,759][52649] Sum rewards: 75.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.410', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.175', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.188', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:02,058][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:19:02,769][52669] DAMAGECOUNT value on done: 285668.0 [2024-08-06 02:19:02,769][52669] Sum rewards: 60.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.182', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.076', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.284', 'weapon2': '0.324', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.270', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 304234496. Throughput: 0: 4390.7. Samples: 76058080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:19:02,794][52567] Avg episode reward: [(0, '65.993')] [2024-08-06 02:19:02,810][52794] DAMAGECOUNT value on done: 295076.0 [2024-08-06 02:19:02,811][52794] Sum rewards: 73.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO2': '0.030', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.210', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:02,959][52667] DAMAGECOUNT value on done: 297813.0 [2024-08-06 02:19:02,961][52667] Sum rewards: 67.618, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '56.000'} [2024-08-06 02:19:03,775][52665] DAMAGECOUNT value on done: 285692.0 [2024-08-06 02:19:03,775][52665] Sum rewards: 61.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.748', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.412', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '50.000'} [2024-08-06 02:19:04,084][52614] Signal inference workers to stop experience collection... (6700 times) [2024-08-06 02:19:04,085][52614] Signal inference workers to resume experience collection... (6700 times) [2024-08-06 02:19:04,125][52650] InferenceWorker_p0-w0: stopping experience collection (6700 times) [2024-08-06 02:19:04,130][52668] DAMAGECOUNT value on done: 285337.0 [2024-08-06 02:19:04,130][52668] Sum rewards: 55.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.818', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.176', 'weapon2': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon4': '0.378', 'WEAPON4': '0.400', 'ARMOR': '0.478', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '48.000'} [2024-08-06 02:19:04,186][52650] InferenceWorker_p0-w0: resuming experience collection (6700 times) [2024-08-06 02:19:04,189][52650] Updated weights for policy 0, policy_version 37141 (0.0012) [2024-08-06 02:19:04,247][52660] DAMAGECOUNT value on done: 283558.0 [2024-08-06 02:19:04,249][52660] Sum rewards: 68.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.086', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.114', 'AMMO3': '0.187', 'weapon5': '0.236', 'AMMO4': '0.305', 'weapon2': '0.418', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '56.000'} [2024-08-06 02:19:04,519][52662] DAMAGECOUNT value on done: 297520.0 [2024-08-06 02:19:04,521][52662] Sum rewards: 63.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.056', 'weapon4': '0.064', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:04,742][52649] DAMAGECOUNT value on done: 287779.0 [2024-08-06 02:19:04,742][52649] Sum rewards: 63.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.148', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.128', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.128', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '52.000'} [2024-08-06 02:19:05,302][52669] DAMAGECOUNT value on done: 290188.0 [2024-08-06 02:19:05,303][52669] Sum rewards: 76.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO3': '0.147', 'AMMO4': '0.185', 'weapon4': '0.226', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon3': '3.066', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:05,613][52667] DAMAGECOUNT value on done: 292464.0 [2024-08-06 02:19:05,614][52667] Sum rewards: 62.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.254', 'weapon4': '0.396', 'WEAPON4': '0.450', 'ARMOR': '0.452', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:05,761][52794] DAMAGECOUNT value on done: 289660.0 [2024-08-06 02:19:05,762][52794] Sum rewards: 55.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.674', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.116', 'AMMO3': '0.198', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '46.000'} [2024-08-06 02:19:07,236][52668] DAMAGECOUNT value on done: 280123.0 [2024-08-06 02:19:07,236][52668] Sum rewards: 59.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.136', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon4': '0.482', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.684', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:07,346][52660] DAMAGECOUNT value on done: 290721.0 [2024-08-06 02:19:07,348][52660] Sum rewards: 68.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.118', 'AMMO5': '0.022', 'AMMO2': '0.058', 'AMMO3': '0.233', 'weapon5': '0.254', 'AMMO4': '0.291', 'weapon4': '0.338', 'weapon2': '0.374', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:07,461][52669] DAMAGECOUNT value on done: 291799.0 [2024-08-06 02:19:07,462][52669] Sum rewards: 60.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.144', 'AMMO3': '0.211', 'weapon4': '0.214', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '52.000'} [2024-08-06 02:19:07,733][52662] DAMAGECOUNT value on done: 290068.0 [2024-08-06 02:19:07,734][52662] Sum rewards: 68.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.194', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.368', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:07,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 304324608. Throughput: 0: 4388.0. Samples: 76084310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:19:07,795][52567] Avg episode reward: [(0, '65.388')] [2024-08-06 02:19:08,319][52667] DAMAGECOUNT value on done: 295268.0 [2024-08-06 02:19:08,321][52667] Sum rewards: 69.470, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO4': '0.223', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '62.000'} [2024-08-06 02:19:08,900][52650] Updated weights for policy 0, policy_version 37151 (0.0011) [2024-08-06 02:19:08,921][52658] DAMAGECOUNT value on done: 291823.0 [2024-08-06 02:19:08,923][52658] Sum rewards: 80.558, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.102', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON3': '1.250', 'weapon3': '3.502', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '68.000'} [2024-08-06 02:19:08,981][52794] DAMAGECOUNT value on done: 291156.0 [2024-08-06 02:19:08,981][52794] Sum rewards: 65.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.256', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '55.000'} [2024-08-06 02:19:09,938][52668] DAMAGECOUNT value on done: 282556.0 [2024-08-06 02:19:09,938][52668] Sum rewards: 76.045, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.120', 'weapon2': '0.166', 'AMMO3': '0.187', 'WEAPON3': '1.050', 'HITCOUNT': '3.440', 'weapon3': '3.618', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:10,089][52660] DAMAGECOUNT value on done: 295244.0 [2024-08-06 02:19:10,093][52660] Sum rewards: 69.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO2': '0.029', 'weapon4': '0.140', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '59.000'} [2024-08-06 02:19:10,357][52662] DAMAGECOUNT value on done: 303959.0 [2024-08-06 02:19:10,361][52662] Sum rewards: 77.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.986', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.184', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.380', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 02:19:10,373][52669] DAMAGECOUNT value on done: 292165.0 [2024-08-06 02:19:10,376][52669] Sum rewards: 87.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.224', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.438', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '74.000'} [2024-08-06 02:19:10,960][52667] DAMAGECOUNT value on done: 286487.0 [2024-08-06 02:19:10,961][52667] Sum rewards: 73.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO2': '0.022', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.248', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.378', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:10,978][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:19:11,587][52658] DAMAGECOUNT value on done: 290063.0 [2024-08-06 02:19:11,588][52658] Sum rewards: 61.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.164', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.146', 'weapon5': '0.154', 'weapon2': '0.166', 'AMMO4': '0.223', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.276', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:12,183][52794] DAMAGECOUNT value on done: 287812.0 [2024-08-06 02:19:12,183][52794] Sum rewards: 63.016, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.372', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.064', 'AMMO4': '0.132', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.276', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:12,693][52668] DAMAGECOUNT value on done: 283754.0 [2024-08-06 02:19:12,694][52668] Sum rewards: 62.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.204', 'weapon2': '0.698', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.018', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '52.000'} [2024-08-06 02:19:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 304406528. Throughput: 0: 4382.2. Samples: 76110370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:19:12,794][52567] Avg episode reward: [(0, '65.909')] [2024-08-06 02:19:12,853][52660] DAMAGECOUNT value on done: 292880.0 [2024-08-06 02:19:12,853][52660] Sum rewards: 61.014, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.850', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.188', 'AMMO3': '0.204', 'AMMO4': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.400', 'weapon4': '0.448', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:13,187][52669] DAMAGECOUNT value on done: 290189.0 [2024-08-06 02:19:13,187][52669] Sum rewards: 64.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.688', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.142', 'weapon5': '0.144', 'AMMO4': '0.158', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:13,348][52650] Updated weights for policy 0, policy_version 37161 (0.0017) [2024-08-06 02:19:13,629][52662] DAMAGECOUNT value on done: 292744.0 [2024-08-06 02:19:13,630][52662] Sum rewards: 65.956, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.038', 'weapon4': '0.076', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.456', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:13,653][52667] DAMAGECOUNT value on done: 292839.0 [2024-08-06 02:19:13,655][52667] Sum rewards: 72.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.208', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.284', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:14,499][52658] DAMAGECOUNT value on done: 292330.0 [2024-08-06 02:19:14,501][52658] Sum rewards: 76.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.324', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.316', 'WEAPON3': '1.650', 'weapon3': '3.332', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '64.000'} [2024-08-06 02:19:15,232][52668] DAMAGECOUNT value on done: 287008.0 [2024-08-06 02:19:15,233][52668] Sum rewards: 56.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.323', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.158', 'AMMO3': '0.169', 'weapon4': '0.238', 'AMMO4': '0.253', 'weapon2': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.058', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '46.000'} [2024-08-06 02:19:15,261][52794] DAMAGECOUNT value on done: 292025.0 [2024-08-06 02:19:15,262][52794] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'AMMO4': '0.166', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.236', 'ARMOR': '0.445', 'WEAPON4': '0.500', 'weapon4': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:15,439][52660] DAMAGECOUNT value on done: 287662.0 [2024-08-06 02:19:15,443][52660] Sum rewards: 62.659, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.560', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'AMMO4': '0.209', 'weapon4': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '0.850', 'weapon3': '2.736', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:16,108][52669] DAMAGECOUNT value on done: 287251.0 [2024-08-06 02:19:16,111][52669] Sum rewards: 46.317, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.500', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon5': '0.180', 'AMMO3': '0.291', 'AMMO4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.386', 'weapon4': '0.426', 'WEAPON4': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.634', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '46.000'} [2024-08-06 02:19:16,717][52662] DAMAGECOUNT value on done: 292269.0 [2024-08-06 02:19:16,717][52662] Sum rewards: 52.646, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.800', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.138', 'AMMO4': '0.188', 'weapon2': '0.208', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.950', 'weapon3': '3.330', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '49.000'} [2024-08-06 02:19:17,448][52658] DAMAGECOUNT value on done: 289456.0 [2024-08-06 02:19:17,450][52658] Sum rewards: 59.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.131', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO4': '0.171', 'AMMO3': '0.182', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.272', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '49.000'} [2024-08-06 02:19:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 304496640. Throughput: 0: 4386.0. Samples: 76123470. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:19:17,795][52567] Avg episode reward: [(0, '65.635')] [2024-08-06 02:19:18,179][52650] Updated weights for policy 0, policy_version 37171 (0.0027) [2024-08-06 02:19:18,333][52668] DAMAGECOUNT value on done: 289716.0 [2024-08-06 02:19:18,333][52794] DAMAGECOUNT value on done: 295936.0 [2024-08-06 02:19:18,334][52794] Sum rewards: 70.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.547', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.116', 'weapon2': '0.168', 'AMMO4': '0.190', 'weapon4': '0.190', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:18,335][52668] Sum rewards: 57.616, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.718', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.122', 'AMMO3': '0.129', 'AMMO4': '0.224', 'weapon4': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon3': '2.980', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '47.000'} [2024-08-06 02:19:18,586][52669] DAMAGECOUNT value on done: 293297.0 [2024-08-06 02:19:18,587][52669] Sum rewards: 61.920, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.254', 'weapon4': '0.258', 'weapon5': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.640', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:18,667][52660] DAMAGECOUNT value on done: 296704.0 [2024-08-06 02:19:18,668][52660] Sum rewards: 77.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '3.172', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:19,317][52647] DAMAGECOUNT value on done: 306605.0 [2024-08-06 02:19:19,317][52647] Sum rewards: 66.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.064', 'weapon4': '0.110', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '55.000'} [2024-08-06 02:19:19,558][52662] DAMAGECOUNT value on done: 291043.0 [2024-08-06 02:19:19,558][52662] Sum rewards: 70.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.181', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.354', 'weapon4': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.776', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:20,591][52658] DAMAGECOUNT value on done: 289927.0 [2024-08-06 02:19:20,592][52658] Sum rewards: 69.538, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.478', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.042', 'weapon4': '0.094', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.234', 'WEAPON4': '0.250', 'AMMO3': '0.299', 'WEAPON3': '1.750', 'weapon3': '3.406', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.000'} [2024-08-06 02:19:21,185][52668] DAMAGECOUNT value on done: 289706.0 [2024-08-06 02:19:21,186][52668] Sum rewards: 76.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.965', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.356', 'weapon4': '0.390', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '63.000'} [2024-08-06 02:19:21,192][52794] DAMAGECOUNT value on done: 290654.0 [2024-08-06 02:19:21,195][52794] Sum rewards: 58.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon4': '0.138', 'weapon5': '0.212', 'AMMO3': '0.219', 'AMMO4': '0.301', 'weapon2': '0.326', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '52.000'} [2024-08-06 02:19:21,407][52669] DAMAGECOUNT value on done: 289692.0 [2024-08-06 02:19:21,407][52669] Sum rewards: 73.960, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.322', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.230', 'weapon2': '0.290', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:21,558][52660] DAMAGECOUNT value on done: 282715.0 [2024-08-06 02:19:21,560][52660] Sum rewards: 74.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.676', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.212', 'weapon2': '0.396', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.512', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '63.000'} [2024-08-06 02:19:21,793][52647] DAMAGECOUNT value on done: 304797.0 [2024-08-06 02:19:21,793][52647] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.154', 'AMMO4': '0.172', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.232', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:22,337][52662] DAMAGECOUNT value on done: 286696.0 [2024-08-06 02:19:22,338][52662] Sum rewards: 75.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.951', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.148', 'AMMO4': '0.207', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '65.000'} [2024-08-06 02:19:22,776][52650] Updated weights for policy 0, policy_version 37181 (0.0013) [2024-08-06 02:19:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 304586752. Throughput: 0: 4378.9. Samples: 76149610. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:19:22,794][52567] Avg episode reward: [(0, '66.042')] [2024-08-06 02:19:23,760][52658] DAMAGECOUNT value on done: 289878.0 [2024-08-06 02:19:23,762][52658] Sum rewards: 73.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.144', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '62.000'} [2024-08-06 02:19:23,859][52794] DAMAGECOUNT value on done: 297102.0 [2024-08-06 02:19:23,863][52794] Sum rewards: 72.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.754', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.073', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.282', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:24,282][52668] DAMAGECOUNT value on done: 292280.0 [2024-08-06 02:19:24,284][52668] Sum rewards: 69.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.834', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.221', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.318', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '59.000'} [2024-08-06 02:19:24,435][52669] DAMAGECOUNT value on done: 288725.0 [2024-08-06 02:19:24,435][52669] Sum rewards: 74.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.063', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.648', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:24,485][52660] DAMAGECOUNT value on done: 286342.0 [2024-08-06 02:19:24,487][52660] Sum rewards: 68.373, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.058', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.016', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon4': '0.238', 'weapon2': '0.638', 'WEAPON3': '0.800', 'weapon3': '2.962', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2024-08-06 02:19:24,850][52647] DAMAGECOUNT value on done: 305363.0 [2024-08-06 02:19:24,853][52647] Sum rewards: 75.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.110', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.125', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '62.500'} [2024-08-06 02:19:26,466][52658] DAMAGECOUNT value on done: 294547.0 [2024-08-06 02:19:26,466][52658] Sum rewards: 49.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.137', 'weapon2': '0.148', 'AMMO3': '0.198', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '3.286', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '42.000'} [2024-08-06 02:19:27,052][52794] DAMAGECOUNT value on done: 294426.0 [2024-08-06 02:19:27,052][52794] Sum rewards: 74.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.858', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.101', 'weapon5': '0.104', 'weapon2': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'weapon3': '3.494', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '63.000'} [2024-08-06 02:19:27,115][52668] DAMAGECOUNT value on done: 287414.0 [2024-08-06 02:19:27,116][52668] Sum rewards: 67.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.154', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.092', 'AMMO3': '0.192', 'weapon2': '0.240', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:27,288][52660] DAMAGECOUNT value on done: 295028.0 [2024-08-06 02:19:27,288][52660] Sum rewards: 63.690, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.779', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.098', 'AMMO4': '0.152', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '3.026', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '50.000'} [2024-08-06 02:19:27,299][52669] DAMAGECOUNT value on done: 292374.0 [2024-08-06 02:19:27,301][52669] Sum rewards: 59.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.983', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.102', 'weapon4': '0.104', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 304668672. Throughput: 0: 4380.7. Samples: 76176000. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:19:27,794][52567] Avg episode reward: [(0, '65.771')] [2024-08-06 02:19:27,785][52650] Updated weights for policy 0, policy_version 37191 (0.0019) [2024-08-06 02:19:27,985][52647] DAMAGECOUNT value on done: 307746.0 [2024-08-06 02:19:27,985][52647] Sum rewards: 65.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.834', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.454', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:29,503][52658] DAMAGECOUNT value on done: 283206.0 [2024-08-06 02:19:29,503][52658] Sum rewards: 56.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.186', 'weapon4': '0.194', 'AMMO4': '0.198', 'weapon2': '0.200', 'weapon5': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '3.178', 'DAMAGECOUNT': '13.449', 'FRAGCOUNT': '47.000'} [2024-08-06 02:19:29,894][52794] DAMAGECOUNT value on done: 289893.0 [2024-08-06 02:19:29,895][52794] Sum rewards: 69.034, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.042', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.072', 'AMMO4': '0.091', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.202', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 02:19:30,018][52660] DAMAGECOUNT value on done: 298769.0 [2024-08-06 02:19:30,018][52660] Sum rewards: 72.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.105', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '62.000'} [2024-08-06 02:19:30,444][52669] DAMAGECOUNT value on done: 293873.0 [2024-08-06 02:19:30,444][52669] Sum rewards: 61.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.160', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '53.000'} [2024-08-06 02:19:31,200][52647] DAMAGECOUNT value on done: 304794.0 [2024-08-06 02:19:31,200][52647] Sum rewards: 56.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.502', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.082', 'AMMO4': '0.115', 'weapon5': '0.126', 'weapon2': '0.202', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.366', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '48.000'} [2024-08-06 02:19:32,069][52650] Updated weights for policy 0, policy_version 37201 (0.0021) [2024-08-06 02:19:32,231][52658] DAMAGECOUNT value on done: 296579.0 [2024-08-06 02:19:32,234][52658] Sum rewards: 67.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.137', 'weapon4': '0.152', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:32,716][52660] DAMAGECOUNT value on done: 286506.0 [2024-08-06 02:19:32,717][52660] Sum rewards: 82.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.094', 'AMMO4': '0.115', 'weapon5': '0.126', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '67.000'} [2024-08-06 02:19:32,796][52567] Fps is (10 sec: 17200.6, 60 sec: 17475.8, 300 sec: 17550.2). Total num frames: 304758784. Throughput: 0: 4373.4. Samples: 76188960. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 02:19:32,796][52567] Avg episode reward: [(0, '65.907')] [2024-08-06 02:19:33,149][52794] DAMAGECOUNT value on done: 292763.0 [2024-08-06 02:19:33,150][52794] Sum rewards: 71.267, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.734', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.094', 'weapon5': '0.160', 'AMMO3': '0.230', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:33,302][52671] DAMAGECOUNT value on done: 294208.0 [2024-08-06 02:19:33,302][52671] Sum rewards: 73.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.681', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.140', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.856', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:33,489][52669] DAMAGECOUNT value on done: 303426.0 [2024-08-06 02:19:33,489][52669] Sum rewards: 70.533, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.725', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.111', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '59.000'} [2024-08-06 02:19:33,924][52647] DAMAGECOUNT value on done: 308919.0 [2024-08-06 02:19:33,925][52647] Sum rewards: 59.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.544', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:34,243][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:19:35,168][52658] DAMAGECOUNT value on done: 295151.0 [2024-08-06 02:19:35,170][52658] Sum rewards: 61.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon5': '0.130', 'AMMO4': '0.196', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.206', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:35,544][52660] DAMAGECOUNT value on done: 288293.0 [2024-08-06 02:19:35,545][52660] Sum rewards: 57.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.102', 'AMMO4': '0.152', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '48.000'} [2024-08-06 02:19:35,704][52811] Large shaping reward 3.501 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:19:35,954][52671] DAMAGECOUNT value on done: 291455.0 [2024-08-06 02:19:35,955][52671] Sum rewards: 57.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.176', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.860', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '49.000'} [2024-08-06 02:19:36,476][52794] DAMAGECOUNT value on done: 284809.0 [2024-08-06 02:19:36,485][52794] Sum rewards: 68.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.212', 'weapon2': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.486', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:36,618][52669] DAMAGECOUNT value on done: 293097.0 [2024-08-06 02:19:36,618][52669] Sum rewards: 65.968, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.362', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO4': '0.189', 'weapon4': '0.214', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:36,762][52650] Updated weights for policy 0, policy_version 37211 (0.0022) [2024-08-06 02:19:36,908][52647] DAMAGECOUNT value on done: 305634.0 [2024-08-06 02:19:36,909][52647] Sum rewards: 76.800, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.976', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.074', 'weapon5': '0.082', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.306', 'weapon2': '0.394', 'WEAPON3': '1.800', 'weapon3': '3.140', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '67.000'} [2024-08-06 02:19:37,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 304840704. Throughput: 0: 4372.6. Samples: 76215140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:19:37,795][52567] Avg episode reward: [(0, '66.399')] [2024-08-06 02:19:38,054][52658] DAMAGECOUNT value on done: 299282.0 [2024-08-06 02:19:38,054][52658] Sum rewards: 76.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.105', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 02:19:38,156][52660] DAMAGECOUNT value on done: 281953.0 [2024-08-06 02:19:38,158][52660] Sum rewards: 75.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.024', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.664', 'WEAPON3': '0.900', 'weapon3': '3.012', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:38,615][52671] DAMAGECOUNT value on done: 291634.0 [2024-08-06 02:19:38,619][52671] Sum rewards: 66.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.432', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.174', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'weapon4': '0.226', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:38,761][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:19:39,615][52794] DAMAGECOUNT value on done: 298285.0 [2024-08-06 02:19:39,617][52794] Sum rewards: 69.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.528', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.106', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '58.500'} [2024-08-06 02:19:39,695][52647] DAMAGECOUNT value on done: 301189.0 [2024-08-06 02:19:39,695][52647] Sum rewards: 62.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.064', 'AMMO4': '0.164', 'weapon5': '0.214', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '2.934', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '53.000'} [2024-08-06 02:19:39,801][52669] DAMAGECOUNT value on done: 296177.0 [2024-08-06 02:19:39,803][52669] Sum rewards: 54.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.092', 'AMMO4': '0.205', 'weapon4': '0.210', 'AMMO3': '0.212', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.200', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '47.000'} [2024-08-06 02:19:40,953][52671] DAMAGECOUNT value on done: 290326.0 [2024-08-06 02:19:40,955][52671] Sum rewards: 73.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.705', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.094', 'weapon4': '0.202', 'AMMO3': '0.203', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '59.000'} [2024-08-06 02:19:41,107][52660] DAMAGECOUNT value on done: 291888.0 [2024-08-06 02:19:41,109][52660] Sum rewards: 69.409, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.220', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:41,170][52658] DAMAGECOUNT value on done: 283509.0 [2024-08-06 02:19:41,170][52658] Sum rewards: 64.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.968', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.108', 'AMMO4': '0.167', 'weapon5': '0.176', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '56.000'} [2024-08-06 02:19:41,680][52650] Updated weights for policy 0, policy_version 37221 (0.0023) [2024-08-06 02:19:42,503][52647] DAMAGECOUNT value on done: 308619.0 [2024-08-06 02:19:42,505][52647] Sum rewards: 87.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.150', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '71.000'} [2024-08-06 02:19:42,588][52794] DAMAGECOUNT value on done: 288469.0 [2024-08-06 02:19:42,588][52794] Sum rewards: 73.086, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.912', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.362', 'weapon4': '0.484', 'WEAPON3': '1.000', 'weapon3': '2.736', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:42,794][52567] Fps is (10 sec: 17205.8, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 304930816. Throughput: 0: 4374.0. Samples: 76241570. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:19:42,794][52567] Avg episode reward: [(0, '66.833')] [2024-08-06 02:19:42,894][52669] DAMAGECOUNT value on done: 292071.0 [2024-08-06 02:19:42,894][52669] Sum rewards: 59.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.334', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.398', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '50.000'} [2024-08-06 02:19:43,641][52671] DAMAGECOUNT value on done: 298488.0 [2024-08-06 02:19:43,644][52671] Sum rewards: 63.102, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.540', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.104', 'weapon4': '0.122', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '3.018', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '56.000'} [2024-08-06 02:19:44,107][52658] DAMAGECOUNT value on done: 291251.0 [2024-08-06 02:19:44,108][52658] Sum rewards: 70.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.196', 'weapon5': '0.198', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '59.000'} [2024-08-06 02:19:44,283][52660] DAMAGECOUNT value on done: 285827.0 [2024-08-06 02:19:44,286][52660] Sum rewards: 65.963, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.175', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.177', 'weapon2': '0.434', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:45,174][52647] DAMAGECOUNT value on done: 301062.0 [2024-08-06 02:19:45,174][52647] Sum rewards: 55.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.055', 'AMMO5': '0.012', 'AMMO2': '0.055', 'AMMO3': '0.186', 'weapon5': '0.226', 'AMMO4': '0.274', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.484', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '47.000'} [2024-08-06 02:19:45,734][52794] DAMAGECOUNT value on done: 299122.0 [2024-08-06 02:19:45,734][52794] Sum rewards: 70.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.809', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.264', 'WEAPON3': '1.700', 'weapon3': '3.530', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:46,025][52650] Updated weights for policy 0, policy_version 37231 (0.0022) [2024-08-06 02:19:46,063][52669] DAMAGECOUNT value on done: 296770.0 [2024-08-06 02:19:46,064][52669] Sum rewards: 70.268, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.113', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.130', 'AMMO3': '0.248', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO4': '0.260', 'WEAPON4': '0.450', 'weapon4': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:46,592][52671] DAMAGECOUNT value on done: 290019.0 [2024-08-06 02:19:46,592][52671] Sum rewards: 61.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.152', 'weapon5': '0.156', 'AMMO3': '0.181', 'AMMO4': '0.191', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.202', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '51.000'} [2024-08-06 02:19:47,035][52658] DAMAGECOUNT value on done: 290101.0 [2024-08-06 02:19:47,035][52658] Sum rewards: 57.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.434', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.136', 'AMMO4': '0.157', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.096', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '50.500'} [2024-08-06 02:19:47,768][52647] DAMAGECOUNT value on done: 308126.0 [2024-08-06 02:19:47,776][52647] Sum rewards: 70.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.236', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.376', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:47,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 305020928. Throughput: 0: 4365.1. Samples: 76254510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:19:47,794][52567] Avg episode reward: [(0, '67.079')] [2024-08-06 02:19:48,869][52794] DAMAGECOUNT value on done: 292538.0 [2024-08-06 02:19:48,871][52794] Sum rewards: 63.401, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.524', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.237', 'weapon5': '0.288', 'AMMO4': '0.314', 'weapon2': '0.320', 'weapon4': '0.394', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.644', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '54.000'} [2024-08-06 02:19:49,306][52671] DAMAGECOUNT value on done: 294812.0 [2024-08-06 02:19:49,306][52671] Sum rewards: 63.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '52.000'} [2024-08-06 02:19:50,061][52647] DAMAGECOUNT value on done: 300913.0 [2024-08-06 02:19:50,062][52647] Sum rewards: 60.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.240', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.524', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '49.000'} [2024-08-06 02:19:50,107][52658] DAMAGECOUNT value on done: 285448.0 [2024-08-06 02:19:50,110][52658] Sum rewards: 71.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.213', 'weapon5': '0.232', 'weapon2': '0.282', 'AMMO4': '0.302', 'weapon4': '0.344', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:50,853][52650] Updated weights for policy 0, policy_version 37241 (0.0019) [2024-08-06 02:19:52,120][52794] DAMAGECOUNT value on done: 293684.0 [2024-08-06 02:19:52,121][52794] Sum rewards: 55.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.094', 'AMMO4': '0.244', 'weapon5': '0.272', 'AMMO3': '0.301', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.840', 'weapon3': '3.020', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '48.000'} [2024-08-06 02:19:52,235][52671] DAMAGECOUNT value on done: 294793.0 [2024-08-06 02:19:52,236][52671] Sum rewards: 65.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.228', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.612', 'weapon4': '0.684', 'WEAPON3': '0.950', 'weapon3': '2.410', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '52.000'} [2024-08-06 02:19:52,512][52647] DAMAGECOUNT value on done: 304127.0 [2024-08-06 02:19:52,513][52647] Sum rewards: 62.396, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.316', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.112', 'weapon4': '0.174', 'AMMO4': '0.234', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.700', 'weapon3': '2.904', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '55.500'} [2024-08-06 02:19:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 305102848. Throughput: 0: 4365.1. Samples: 76280740. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:19:52,803][52567] Avg episode reward: [(0, '66.957')] [2024-08-06 02:19:52,793][52658] DAMAGECOUNT value on done: 285599.0 [2024-08-06 02:19:52,808][52658] Sum rewards: 52.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.571', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.116', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.296', 'DAMAGECOUNT': '12.945', 'FRAGCOUNT': '44.000'} [2024-08-06 02:19:53,383][52666] DAMAGECOUNT value on done: 295288.0 [2024-08-06 02:19:53,384][52666] Sum rewards: 68.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.012', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '57.000'} [2024-08-06 02:19:54,909][52671] DAMAGECOUNT value on done: 286920.0 [2024-08-06 02:19:54,911][52671] Sum rewards: 77.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '66.000'} [2024-08-06 02:19:55,035][52794] DAMAGECOUNT value on done: 302503.0 [2024-08-06 02:19:55,037][52794] Sum rewards: 56.737, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.098', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.142', 'AMMO3': '0.150', 'AMMO4': '0.151', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.362', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '2.880', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '45.500'} [2024-08-06 02:19:55,068][52647] DAMAGECOUNT value on done: 304072.0 [2024-08-06 02:19:55,069][52647] Sum rewards: 75.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.864', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.202', 'AMMO4': '0.231', 'weapon5': '0.256', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '62.000'} [2024-08-06 02:19:55,705][52650] Updated weights for policy 0, policy_version 37251 (0.0016) [2024-08-06 02:19:55,998][52666] DAMAGECOUNT value on done: 294942.0 [2024-08-06 02:19:56,000][52666] Sum rewards: 80.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.122', 'weapon4': '0.166', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '68.000'} [2024-08-06 02:19:56,122][52658] DAMAGECOUNT value on done: 297443.0 [2024-08-06 02:19:56,122][52658] Sum rewards: 73.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.889', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.282', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 02:19:57,743][52647] DAMAGECOUNT value on done: 312333.0 [2024-08-06 02:19:57,744][52647] Sum rewards: 76.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.166', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.167', 'weapon5': '0.172', 'weapon4': '0.178', 'AMMO4': '0.212', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.500'} [2024-08-06 02:19:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 305192960. Throughput: 0: 4378.0. Samples: 76307380. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:19:57,794][52567] Avg episode reward: [(0, '67.430')] [2024-08-06 02:19:58,088][52671] DAMAGECOUNT value on done: 295855.0 [2024-08-06 02:19:58,088][52671] Sum rewards: 70.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.432', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.072', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '61.000'} [2024-08-06 02:19:58,208][52794] DAMAGECOUNT value on done: 291563.0 [2024-08-06 02:19:58,208][52794] Sum rewards: 66.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.850', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon5': '0.174', 'weapon2': '0.236', 'AMMO4': '0.240', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '58.000'} [2024-08-06 02:19:58,592][52658] DAMAGECOUNT value on done: 287944.0 [2024-08-06 02:19:58,592][52658] Sum rewards: 66.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.734', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.480', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '56.000'} [2024-08-06 02:19:58,635][52666] DAMAGECOUNT value on done: 295750.0 [2024-08-06 02:19:58,635][52666] Sum rewards: 67.894, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.272', 'HEALTH': '0.475', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.386', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '55.000'} [2024-08-06 02:19:59,636][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:19:59,907][52650] Updated weights for policy 0, policy_version 37261 (0.0016) [2024-08-06 02:20:00,272][52647] DAMAGECOUNT value on done: 305699.0 [2024-08-06 02:20:00,272][52647] Sum rewards: 74.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.185', 'weapon5': '0.190', 'AMMO4': '0.205', 'weapon2': '0.230', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:00,422][52670] DAMAGECOUNT value on done: 287234.0 [2024-08-06 02:20:00,424][52670] Sum rewards: 61.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.166', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.082', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:01,110][52671] DAMAGECOUNT value on done: 297750.0 [2024-08-06 02:20:01,112][52671] Sum rewards: 71.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.630', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.104', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.264', 'AMMO3': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.198', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:01,393][52658] DAMAGECOUNT value on done: 292322.0 [2024-08-06 02:20:01,394][52658] Sum rewards: 72.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.175', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO4': '0.176', 'weapon5': '0.196', 'AMMO3': '0.218', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '61.000'} [2024-08-06 02:20:01,758][52666] DAMAGECOUNT value on done: 290535.0 [2024-08-06 02:20:01,758][52666] Sum rewards: 58.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.132', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '49.000'} [2024-08-06 02:20:02,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 305283072. Throughput: 0: 4379.5. Samples: 76320550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:20:02,795][52567] Avg episode reward: [(0, '66.926')] [2024-08-06 02:20:03,069][52647] DAMAGECOUNT value on done: 302834.0 [2024-08-06 02:20:03,069][52647] Sum rewards: 61.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.114', 'weapon5': '0.132', 'AMMO4': '0.168', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.500', 'HITCOUNT': '2.990', 'weapon3': '3.060', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:03,187][52670] DAMAGECOUNT value on done: 291977.0 [2024-08-06 02:20:03,188][52670] Sum rewards: 60.487, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'HEALTH': '0.184', 'AMMO3': '0.219', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:03,794][52671] DAMAGECOUNT value on done: 292295.0 [2024-08-06 02:20:03,797][52671] Sum rewards: 76.914, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon4': '0.160', 'weapon5': '0.180', 'AMMO3': '0.272', 'AMMO4': '0.337', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.998', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '68.000'} [2024-08-06 02:20:04,161][52658] DAMAGECOUNT value on done: 295347.0 [2024-08-06 02:20:04,162][52658] Sum rewards: 69.660, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.963', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.382', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:04,595][52666] DAMAGECOUNT value on done: 286985.0 [2024-08-06 02:20:04,595][52666] Sum rewards: 70.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO4': '0.201', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '58.000'} [2024-08-06 02:20:04,852][52650] Updated weights for policy 0, policy_version 37271 (0.0032) [2024-08-06 02:20:05,422][52647] DAMAGECOUNT value on done: 302983.0 [2024-08-06 02:20:05,424][52647] Sum rewards: 62.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.842', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.106', 'weapon5': '0.192', 'AMMO4': '0.194', 'AMMO3': '0.243', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.670', 'weapon3': '3.102', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:06,209][52670] DAMAGECOUNT value on done: 284980.0 [2024-08-06 02:20:06,211][52670] Sum rewards: 81.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.862', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.244', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.528', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '68.000'} [2024-08-06 02:20:06,220][52671] DAMAGECOUNT value on done: 301266.0 [2024-08-06 02:20:06,221][52671] Sum rewards: 70.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.143', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.086', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.402', 'weapon2': '0.422', 'WEAPON3': '0.900', 'weapon3': '2.852', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:07,473][52666] DAMAGECOUNT value on done: 282220.0 [2024-08-06 02:20:07,474][52666] Sum rewards: 59.380, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.972', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon4': '0.090', 'weapon5': '0.106', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.208', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '49.000'} [2024-08-06 02:20:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 305373184. Throughput: 0: 4388.7. Samples: 76347100. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:20:07,794][52567] Avg episode reward: [(0, '67.126')] [2024-08-06 02:20:08,050][52647] DAMAGECOUNT value on done: 296247.0 [2024-08-06 02:20:08,051][52647] Sum rewards: 71.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon2': '0.170', 'weapon5': '0.174', 'AMMO4': '0.181', 'AMMO3': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.758', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '60.000'} [2024-08-06 02:20:08,931][52671] DAMAGECOUNT value on done: 289363.0 [2024-08-06 02:20:08,933][52671] Sum rewards: 64.672, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.025', 'AMMO2': '0.054', 'weapon4': '0.124', 'weapon5': '0.148', 'AMMO3': '0.203', 'AMMO4': '0.269', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.124', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:09,189][52670] DAMAGECOUNT value on done: 284013.0 [2024-08-06 02:20:09,191][52670] Sum rewards: 54.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.148', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.072', 'weapon4': '0.116', 'AMMO4': '0.166', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '3.270', 'DAMAGECOUNT': '13.239', 'FRAGCOUNT': '49.000'} [2024-08-06 02:20:09,367][52650] Updated weights for policy 0, policy_version 37281 (0.0011) [2024-08-06 02:20:10,505][52666] DAMAGECOUNT value on done: 289143.0 [2024-08-06 02:20:10,506][52666] Sum rewards: 64.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.509', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.076', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.514', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.092', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:10,776][52647] DAMAGECOUNT value on done: 307049.0 [2024-08-06 02:20:10,777][52647] Sum rewards: 72.937, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.092', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon4': '0.196', 'AMMO3': '0.234', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:11,515][52647] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.075, -25.0), ('weapon5', 0.002)] [2024-08-06 02:20:11,931][52671] DAMAGECOUNT value on done: 282349.0 [2024-08-06 02:20:11,933][52671] Sum rewards: 72.324, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.180', 'weapon4': '0.274', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 02:20:11,981][52670] DAMAGECOUNT value on done: 293843.0 [2024-08-06 02:20:11,983][52670] Sum rewards: 69.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.190', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.167', 'AMMO4': '0.234', 'weapon5': '0.262', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.394', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '55.000'} [2024-08-06 02:20:12,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 305463296. Throughput: 0: 4397.1. Samples: 76373870. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:20:12,794][52567] Avg episode reward: [(0, '67.711')] [2024-08-06 02:20:13,187][52666] DAMAGECOUNT value on done: 287345.0 [2024-08-06 02:20:13,196][52666] Sum rewards: 65.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.127', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '55.000'} [2024-08-06 02:20:13,968][52650] Updated weights for policy 0, policy_version 37291 (0.0011) [2024-08-06 02:20:14,510][52671] DAMAGECOUNT value on done: 295230.0 [2024-08-06 02:20:14,511][52671] Sum rewards: 74.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.342', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '58.000'} [2024-08-06 02:20:15,224][52670] DAMAGECOUNT value on done: 289171.0 [2024-08-06 02:20:15,224][52670] Sum rewards: 63.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.096', 'AMMO4': '0.131', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:16,288][52659] DAMAGECOUNT value on done: 293111.0 [2024-08-06 02:20:16,289][52659] Sum rewards: 74.584, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.440', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.116', 'weapon4': '0.134', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:16,522][52666] DAMAGECOUNT value on done: 288031.0 [2024-08-06 02:20:16,524][52666] Sum rewards: 57.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.745', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.142', 'weapon4': '0.186', 'weapon2': '0.192', 'AMMO4': '0.204', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.750', 'weapon3': '3.262', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '49.000'} [2024-08-06 02:20:17,616][52671] DAMAGECOUNT value on done: 296171.0 [2024-08-06 02:20:17,616][52671] Sum rewards: 62.743, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.475', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.216', 'AMMO3': '0.310', 'WEAPON3': '1.850', 'HITCOUNT': '3.170', 'weapon3': '3.496', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '57.000'} [2024-08-06 02:20:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 305545216. Throughput: 0: 4404.8. Samples: 76387170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:20:17,794][52567] Avg episode reward: [(0, '67.493')] [2024-08-06 02:20:18,087][52670] DAMAGECOUNT value on done: 283758.0 [2024-08-06 02:20:18,088][52670] Sum rewards: 82.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.055', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.139', 'AMMO3': '0.177', 'weapon4': '0.182', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '68.000'} [2024-08-06 02:20:18,838][52650] Updated weights for policy 0, policy_version 37301 (0.0020) [2024-08-06 02:20:19,200][52666] DAMAGECOUNT value on done: 286208.0 [2024-08-06 02:20:19,200][52666] Sum rewards: 62.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.528', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.896', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '55.000'} [2024-08-06 02:20:19,395][52659] DAMAGECOUNT value on done: 289785.0 [2024-08-06 02:20:19,395][52659] Sum rewards: 67.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.425', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'weapon4': '0.192', 'AMMO3': '0.262', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '58.000'} [2024-08-06 02:20:20,779][52670] DAMAGECOUNT value on done: 287785.0 [2024-08-06 02:20:20,780][52670] Sum rewards: 75.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.547', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.156', 'weapon5': '0.178', 'AMMO3': '0.194', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '64.000'} [2024-08-06 02:20:20,849][52671] DAMAGECOUNT value on done: 298321.0 [2024-08-06 02:20:20,849][52671] Sum rewards: 69.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.188', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '58.000'} [2024-08-06 02:20:21,006][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:20:22,162][52666] DAMAGECOUNT value on done: 285186.0 [2024-08-06 02:20:22,163][52666] Sum rewards: 79.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.088', 'weapon2': '0.144', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.520', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '68.000'} [2024-08-06 02:20:22,618][52659] DAMAGECOUNT value on done: 290345.0 [2024-08-06 02:20:22,619][52659] Sum rewards: 58.061, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 305643520. Throughput: 0: 4403.2. Samples: 76413280. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:20:22,794][52567] Avg episode reward: [(0, '67.339')] [2024-08-06 02:20:23,563][52650] Updated weights for policy 0, policy_version 37311 (0.0030) [2024-08-06 02:20:23,734][52670] DAMAGECOUNT value on done: 285904.0 [2024-08-06 02:20:23,735][52670] Sum rewards: 69.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.105', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.718', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '55.000'} [2024-08-06 02:20:24,088][52671] DAMAGECOUNT value on done: 293666.0 [2024-08-06 02:20:24,088][52671] Sum rewards: 55.270, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.543', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.238', 'AMMO3': '0.280', 'weapon2': '0.444', 'WEAPON3': '1.650', 'weapon3': '2.964', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '49.000'} [2024-08-06 02:20:24,689][52649] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:20:24,873][52666] DAMAGECOUNT value on done: 282769.0 [2024-08-06 02:20:24,876][52666] Sum rewards: 72.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.198', 'AMMO3': '0.207', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '58.500'} [2024-08-06 02:20:25,758][52659] DAMAGECOUNT value on done: 291411.0 [2024-08-06 02:20:25,759][52659] Sum rewards: 72.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.090', 'weapon4': '0.162', 'AMMO4': '0.198', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:26,835][52670] DAMAGECOUNT value on done: 280487.0 [2024-08-06 02:20:26,835][52670] Sum rewards: 60.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.548', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.206', 'AMMO4': '0.261', 'AMMO3': '0.272', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.648', 'WEAPON3': '1.550', 'weapon3': '2.546', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:27,220][52671] DAMAGECOUNT value on done: 290127.0 [2024-08-06 02:20:27,222][52671] Sum rewards: 68.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.140', 'weapon5': '0.166', 'AMMO3': '0.176', 'AMMO4': '0.241', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '57.000'} [2024-08-06 02:20:27,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 305725440. Throughput: 0: 4404.4. Samples: 76439770. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 02:20:27,795][52567] Avg episode reward: [(0, '67.232')] [2024-08-06 02:20:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037320_305725440.pth... [2024-08-06 02:20:27,826][52666] DAMAGECOUNT value on done: 294476.0 [2024-08-06 02:20:27,827][52666] Sum rewards: 70.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.210', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '58.000'} [2024-08-06 02:20:27,930][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000036806_301514752.pth [2024-08-06 02:20:28,035][52650] Updated weights for policy 0, policy_version 37321 (0.0012) [2024-08-06 02:20:28,659][52795] DAMAGECOUNT value on done: 273414.0 [2024-08-06 02:20:28,659][52795] Sum rewards: 72.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.319', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.120', 'weapon4': '0.128', 'AMMO4': '0.170', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:28,857][52659] DAMAGECOUNT value on done: 286555.0 [2024-08-06 02:20:28,857][52659] Sum rewards: 59.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.900', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'AMMO4': '0.226', 'weapon4': '0.228', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.062', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '50.000'} [2024-08-06 02:20:29,840][52670] DAMAGECOUNT value on done: 294508.0 [2024-08-06 02:20:29,841][52670] Sum rewards: 85.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.266', 'WEAPON3': '1.350', 'weapon3': '3.466', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.856', 'FRAGCOUNT': '70.000'} [2024-08-06 02:20:29,919][52794] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0)] [2024-08-06 02:20:30,104][52663] DAMAGECOUNT value on done: 295157.0 [2024-08-06 02:20:30,105][52663] Sum rewards: 81.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.112', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.258', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '70.000'} [2024-08-06 02:20:30,806][52666] DAMAGECOUNT value on done: 293941.0 [2024-08-06 02:20:30,807][52666] Sum rewards: 80.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.092', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.096', 'weapon5': '0.144', 'AMMO4': '0.190', 'AMMO3': '0.231', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '67.500'} [2024-08-06 02:20:31,828][52795] DAMAGECOUNT value on done: 265611.0 [2024-08-06 02:20:31,829][52795] Sum rewards: 64.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.176', 'AMMO3': '0.194', 'AMMO4': '0.218', 'weapon5': '0.298', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '52.000'} [2024-08-06 02:20:32,018][52659] DAMAGECOUNT value on done: 290200.0 [2024-08-06 02:20:32,018][52659] Sum rewards: 66.463, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.143', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.037', 'weapon5': '0.068', 'AMMO3': '0.164', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.050', 'HITCOUNT': '3.280', 'weapon3': '3.290', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '52.000'} [2024-08-06 02:20:32,514][52670] DAMAGECOUNT value on done: 290900.0 [2024-08-06 02:20:32,515][52670] Sum rewards: 77.245, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.033', 'HEALTH': '0.114', 'AMMO4': '0.164', 'AMMO3': '0.192', 'weapon5': '0.226', 'weapon2': '0.300', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '61.000'} [2024-08-06 02:20:32,703][52650] Updated weights for policy 0, policy_version 37331 (0.0026) [2024-08-06 02:20:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17613.3, 300 sec: 17550.3). Total num frames: 305815552. Throughput: 0: 4399.8. Samples: 76452500. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 02:20:32,794][52567] Avg episode reward: [(0, '68.089')] [2024-08-06 02:20:32,795][52614] Saving new best policy, reward=68.089! [2024-08-06 02:20:32,828][52663] DAMAGECOUNT value on done: 290260.0 [2024-08-06 02:20:32,829][52663] Sum rewards: 58.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.887', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.076', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.168', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '50.000'} [2024-08-06 02:20:33,270][52666] DAMAGECOUNT value on done: 288371.0 [2024-08-06 02:20:33,272][52666] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.609', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.178', 'weapon2': '0.236', 'weapon4': '0.236', 'AMMO3': '0.238', 'AMMO4': '0.292', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '60.000'} [2024-08-06 02:20:34,752][52659] DAMAGECOUNT value on done: 292893.0 [2024-08-06 02:20:34,753][52659] Sum rewards: 71.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'weapon2': '0.236', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.700', 'weapon3': '3.150', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '61.000'} [2024-08-06 02:20:34,932][52795] DAMAGECOUNT value on done: 266597.0 [2024-08-06 02:20:34,935][52795] Sum rewards: 65.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.788', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:35,336][52670] DAMAGECOUNT value on done: 289459.0 [2024-08-06 02:20:35,339][52670] Sum rewards: 71.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.372', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon4': '0.190', 'AMMO4': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.000', 'weapon3': '3.258', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '57.000'} [2024-08-06 02:20:35,788][52663] DAMAGECOUNT value on done: 288036.0 [2024-08-06 02:20:35,789][52663] Sum rewards: 69.777, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.163', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.170', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.304', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:36,002][52666] DAMAGECOUNT value on done: 288100.0 [2024-08-06 02:20:36,004][52666] Sum rewards: 60.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.870', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.134', 'WEAPON5': '0.250', 'weapon2': '0.296', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.850', 'weapon3': '2.810', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '54.000'} [2024-08-06 02:20:37,372][52650] Updated weights for policy 0, policy_version 37341 (0.0017) [2024-08-06 02:20:37,547][52659] DAMAGECOUNT value on done: 286837.0 [2024-08-06 02:20:37,549][52659] Sum rewards: 58.522, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.178', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO3': '0.163', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.522', 'WEAPON3': '0.950', 'HITCOUNT': '2.670', 'weapon3': '2.866', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '47.000'} [2024-08-06 02:20:37,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17749.5, 300 sec: 17550.3). Total num frames: 305905664. Throughput: 0: 4400.7. Samples: 76478770. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 02:20:37,794][52567] Avg episode reward: [(0, '68.011')] [2024-08-06 02:20:37,845][52670] DAMAGECOUNT value on done: 294170.0 [2024-08-06 02:20:37,845][52670] Sum rewards: 66.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon2': '0.136', 'weapon5': '0.156', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.238', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '57.000'} [2024-08-06 02:20:38,064][52795] DAMAGECOUNT value on done: 267888.0 [2024-08-06 02:20:38,072][52795] Sum rewards: 66.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.248', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '58.000'} [2024-08-06 02:20:38,599][52666] DAMAGECOUNT value on done: 286152.0 [2024-08-06 02:20:38,600][52666] Sum rewards: 58.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.085', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.020', 'weapon5': '0.046', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.436', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '48.000'} [2024-08-06 02:20:38,793][52663] DAMAGECOUNT value on done: 292162.0 [2024-08-06 02:20:38,794][52663] Sum rewards: 65.609, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.630', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.137', 'weapon2': '0.628', 'WEAPON3': '0.850', 'weapon3': '3.262', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:39,177][52803] DAMAGECOUNT value on done: 272259.0 [2024-08-06 02:20:39,177][52803] Sum rewards: 67.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.842', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO4': '0.231', 'AMMO3': '0.243', 'weapon4': '0.292', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:39,792][52659] DAMAGECOUNT value on done: 298321.0 [2024-08-06 02:20:39,793][52659] Sum rewards: 66.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.128', 'AMMO3': '0.189', 'AMMO4': '0.243', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '54.000'} [2024-08-06 02:20:40,255][52670] DAMAGECOUNT value on done: 291080.0 [2024-08-06 02:20:40,255][52670] Sum rewards: 54.032, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.272', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon5': '0.184', 'weapon4': '0.194', 'AMMO3': '0.242', 'AMMO4': '0.325', 'WEAPON5': '0.450', 'weapon2': '0.542', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.764', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '47.500'} [2024-08-06 02:20:41,145][52795] DAMAGECOUNT value on done: 272684.0 [2024-08-06 02:20:41,147][52795] Sum rewards: 58.072, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.986', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.098', 'weapon4': '0.136', 'AMMO4': '0.186', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.106', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:41,299][52666] DAMAGECOUNT value on done: 292135.0 [2024-08-06 02:20:41,301][52666] Sum rewards: 48.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.656', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.158', 'AMMO3': '0.221', 'AMMO4': '0.236', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.656', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '44.000'} [2024-08-06 02:20:42,042][52663] DAMAGECOUNT value on done: 290989.0 [2024-08-06 02:20:42,046][52663] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO4': '0.210', 'weapon2': '0.212', 'weapon5': '0.228', 'AMMO3': '0.262', 'weapon4': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:42,452][52803] DAMAGECOUNT value on done: 272019.0 [2024-08-06 02:20:42,453][52803] Sum rewards: 65.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.064', 'weapon5': '0.134', 'weapon4': '0.220', 'AMMO3': '0.223', 'weapon2': '0.262', 'AMMO4': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:42,452][52659] DAMAGECOUNT value on done: 297672.0 [2024-08-06 02:20:42,455][52659] Sum rewards: 56.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.190', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.136', 'weapon5': '0.144', 'AMMO3': '0.282', 'AMMO4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.800', 'weapon3': '2.920', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:42,468][52650] Updated weights for policy 0, policy_version 37351 (0.0017) [2024-08-06 02:20:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 305987584. Throughput: 0: 4396.2. Samples: 76505210. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 02:20:42,794][52567] Avg episode reward: [(0, '67.189')] [2024-08-06 02:20:43,323][52670] DAMAGECOUNT value on done: 276833.0 [2024-08-06 02:20:43,331][52670] Sum rewards: 72.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.376', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.116', 'weapon5': '0.128', 'AMMO4': '0.159', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '60.000'} [2024-08-06 02:20:43,999][52811] DAMAGECOUNT value on done: 282171.0 [2024-08-06 02:20:44,002][52811] Sum rewards: 65.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.289', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.154', 'weapon2': '0.184', 'AMMO3': '0.205', 'AMMO4': '0.216', 'weapon5': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.078', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '54.000'} [2024-08-06 02:20:44,269][52795] DAMAGECOUNT value on done: 270701.0 [2024-08-06 02:20:44,270][52795] Sum rewards: 52.433, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.784', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.142', 'weapon4': '0.170', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.650', 'HITCOUNT': '2.750', 'weapon3': '3.046', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '47.000'} [2024-08-06 02:20:44,442][52666] DAMAGECOUNT value on done: 283540.0 [2024-08-06 02:20:44,444][52666] Sum rewards: 82.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.258', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '67.000'} [2024-08-06 02:20:45,300][52659] DAMAGECOUNT value on done: 292426.0 [2024-08-06 02:20:45,304][52659] Sum rewards: 61.822, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.383', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.178', 'AMMO3': '0.217', 'AMMO4': '0.281', 'weapon2': '0.394', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '52.000'} [2024-08-06 02:20:45,361][52663] DAMAGECOUNT value on done: 295870.0 [2024-08-06 02:20:45,361][52663] Sum rewards: 60.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.126', 'weapon2': '0.172', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.396', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.088', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:45,594][52803] DAMAGECOUNT value on done: 273685.0 [2024-08-06 02:20:45,597][52803] Sum rewards: 71.380, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.204', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'weapon3': '3.404', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '61.000'} [2024-08-06 02:20:46,283][52670] DAMAGECOUNT value on done: 291221.0 [2024-08-06 02:20:46,285][52670] Sum rewards: 79.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.018', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.128', 'AMMO3': '0.172', 'AMMO4': '0.198', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '64.000'} [2024-08-06 02:20:46,557][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:20:46,687][52650] Updated weights for policy 0, policy_version 37361 (0.0022) [2024-08-06 02:20:47,204][52666] DAMAGECOUNT value on done: 291764.0 [2024-08-06 02:20:47,206][52666] Sum rewards: 73.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '61.000'} [2024-08-06 02:20:47,316][52811] DAMAGECOUNT value on done: 269970.0 [2024-08-06 02:20:47,316][52811] Sum rewards: 59.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.820', 'WEAPON3': '1.200', 'weapon3': '2.658', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '49.000'} [2024-08-06 02:20:47,342][52795] DAMAGECOUNT value on done: 275106.0 [2024-08-06 02:20:47,343][52795] Sum rewards: 71.965, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.702', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '59.000'} [2024-08-06 02:20:47,392][52664] DAMAGECOUNT value on done: 303793.0 [2024-08-06 02:20:47,395][52664] Sum rewards: 71.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.550', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon4': '0.128', 'weapon5': '0.142', 'AMMO4': '0.237', 'AMMO3': '0.289', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.036', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:47,719][52668] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:20:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 306077696. Throughput: 0: 4392.7. Samples: 76518220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 02:20:47,794][52567] Avg episode reward: [(0, '67.377')] [2024-08-06 02:20:48,336][52663] DAMAGECOUNT value on done: 292026.0 [2024-08-06 02:20:48,347][52663] Sum rewards: 61.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.491', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.219', 'weapon5': '0.230', 'weapon4': '0.230', 'AMMO4': '0.270', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:48,394][52659] DAMAGECOUNT value on done: 293164.0 [2024-08-06 02:20:48,398][52659] Sum rewards: 64.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.052', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.186', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.234', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:48,717][52803] DAMAGECOUNT value on done: 274630.0 [2024-08-06 02:20:48,718][52803] Sum rewards: 76.914, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.084', 'AMMO4': '0.085', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '64.000'} [2024-08-06 02:20:48,922][52670] DAMAGECOUNT value on done: 297390.0 [2024-08-06 02:20:48,923][52670] Sum rewards: 72.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.120', 'weapon4': '0.146', 'AMMO4': '0.174', 'weapon2': '0.240', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '61.000'} [2024-08-06 02:20:49,793][52664] DAMAGECOUNT value on done: 303720.0 [2024-08-06 02:20:49,793][52664] Sum rewards: 58.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.108', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.175', 'AMMO4': '0.175', 'weapon4': '0.196', 'weapon5': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.704', 'WEAPON3': '1.050', 'weapon3': '2.568', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '47.000'} [2024-08-06 02:20:50,339][52811] DAMAGECOUNT value on done: 274599.0 [2024-08-06 02:20:50,346][52811] Sum rewards: 65.785, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.457', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.984', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '53.000'} [2024-08-06 02:20:50,490][52795] DAMAGECOUNT value on done: 272139.0 [2024-08-06 02:20:50,491][52795] Sum rewards: 73.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.362', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'weapon4': '0.354', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '62.000'} [2024-08-06 02:20:50,953][52663] DAMAGECOUNT value on done: 290128.0 [2024-08-06 02:20:50,955][52663] Sum rewards: 56.153, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.655', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.168', 'weapon5': '0.224', 'AMMO4': '0.232', 'weapon4': '0.248', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '2.894', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '43.500'} [2024-08-06 02:20:51,489][52659] DAMAGECOUNT value on done: 284534.0 [2024-08-06 02:20:51,490][52659] Sum rewards: 68.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.974', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.186', 'AMMO4': '0.208', 'weapon5': '0.254', 'weapon4': '0.290', 'weapon2': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:51,544][52650] Updated weights for policy 0, policy_version 37371 (0.0026) [2024-08-06 02:20:51,653][52670] DAMAGECOUNT value on done: 289591.0 [2024-08-06 02:20:51,654][52670] Sum rewards: 66.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.101', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'AMMO4': '0.207', 'weapon4': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.854', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:51,894][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:20:51,947][52803] DAMAGECOUNT value on done: 276999.0 [2024-08-06 02:20:51,950][52803] Sum rewards: 69.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.163', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.102', 'AMMO3': '0.197', 'weapon4': '0.224', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '58.000'} [2024-08-06 02:20:52,494][52664] DAMAGECOUNT value on done: 304963.0 [2024-08-06 02:20:52,494][52664] Sum rewards: 79.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.174', 'weapon4': '0.206', 'AMMO3': '0.212', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '65.000'} [2024-08-06 02:20:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 306167808. Throughput: 0: 4391.3. Samples: 76544710. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:20:52,794][52567] Avg episode reward: [(0, '67.764')] [2024-08-06 02:20:53,368][52811] DAMAGECOUNT value on done: 270667.0 [2024-08-06 02:20:53,376][52811] Sum rewards: 66.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.205', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.130', 'AMMO4': '0.148', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '57.000'} [2024-08-06 02:20:53,529][52795] DAMAGECOUNT value on done: 265904.0 [2024-08-06 02:20:53,530][52795] Sum rewards: 58.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.310', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.184', 'AMMO3': '0.188', 'AMMO4': '0.200', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '3.010', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '48.000'} [2024-08-06 02:20:53,576][52663] DAMAGECOUNT value on done: 290180.0 [2024-08-06 02:20:53,577][52663] Sum rewards: 62.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.374', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.290', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '51.000'} [2024-08-06 02:20:54,025][52659] DAMAGECOUNT value on done: 292054.0 [2024-08-06 02:20:54,027][52659] Sum rewards: 60.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.206', 'weapon2': '0.216', 'weapon5': '0.216', 'AMMO3': '0.255', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.098', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '51.500'} [2024-08-06 02:20:54,723][52670] DAMAGECOUNT value on done: 290735.0 [2024-08-06 02:20:54,724][52670] Sum rewards: 73.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.314', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 02:20:55,063][52803] DAMAGECOUNT value on done: 271493.0 [2024-08-06 02:20:55,063][52803] Sum rewards: 53.612, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.296', 'AMMO5': '0.025', 'AMMO2': '0.080', 'weapon5': '0.222', 'AMMO3': '0.262', 'weapon2': '0.362', 'weapon4': '0.382', 'AMMO4': '0.400', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.590', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '50.000'} [2024-08-06 02:20:55,457][52664] DAMAGECOUNT value on done: 301867.0 [2024-08-06 02:20:55,457][52664] Sum rewards: 69.551, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.676', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.270', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.228', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 02:20:56,029][52650] Updated weights for policy 0, policy_version 37381 (0.0024) [2024-08-06 02:20:56,417][52811] DAMAGECOUNT value on done: 273630.0 [2024-08-06 02:20:56,419][52811] Sum rewards: 65.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.065', 'weapon5': '0.178', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.316', 'AMMO4': '0.323', 'weapon4': '0.358', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.854', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '55.000'} [2024-08-06 02:20:56,605][52663] DAMAGECOUNT value on done: 293266.0 [2024-08-06 02:20:56,608][52663] Sum rewards: 72.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.102', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.086', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.252', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '63.000'} [2024-08-06 02:20:56,806][52795] DAMAGECOUNT value on done: 275590.0 [2024-08-06 02:20:56,806][52795] Sum rewards: 57.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.270', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO3': '0.168', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'weapon4': '0.438', 'WEAPON3': '0.950', 'weapon3': '2.758', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '46.000'} [2024-08-06 02:20:57,003][52659] DAMAGECOUNT value on done: 297505.0 [2024-08-06 02:20:57,005][52659] Sum rewards: 62.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.846', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO4': '0.211', 'AMMO3': '0.217', 'weapon4': '0.298', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '54.000'} [2024-08-06 02:20:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 306249728. Throughput: 0: 4384.2. Samples: 76571160. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:20:57,794][52567] Avg episode reward: [(0, '66.955')] [2024-08-06 02:20:58,058][52664] DAMAGECOUNT value on done: 303674.0 [2024-08-06 02:20:58,060][52664] Sum rewards: 76.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.921', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.125', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.270', 'AMMO3': '0.284', 'WEAPON3': '1.650', 'weapon3': '3.254', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '66.000'} [2024-08-06 02:20:58,123][52803] DAMAGECOUNT value on done: 269463.0 [2024-08-06 02:20:58,123][52803] Sum rewards: 69.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.985', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.160', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:59,277][52663] DAMAGECOUNT value on done: 294201.0 [2024-08-06 02:20:59,278][52663] Sum rewards: 63.737, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.497', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.318', 'weapon2': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '2.986', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '54.000'} [2024-08-06 02:20:59,629][52811] DAMAGECOUNT value on done: 279342.0 [2024-08-06 02:20:59,629][52811] Sum rewards: 64.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.434', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.190', 'AMMO3': '0.249', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'weapon4': '0.318', 'weapon2': '0.424', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.758', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 02:20:59,953][52795] DAMAGECOUNT value on done: 269565.0 [2024-08-06 02:20:59,955][52795] Sum rewards: 56.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.878', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.158', 'weapon5': '0.160', 'weapon4': '0.196', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.514', 'WEAPON3': '0.950', 'weapon3': '2.938', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '47.000'} [2024-08-06 02:20:59,971][52659] DAMAGECOUNT value on done: 302125.0 [2024-08-06 02:20:59,973][52659] Sum rewards: 68.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.134', 'weapon2': '0.156', 'AMMO3': '0.206', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:00,562][52664] DAMAGECOUNT value on done: 303580.0 [2024-08-06 02:21:00,562][52664] Sum rewards: 74.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.015', 'AMMO2': '0.070', 'weapon5': '0.180', 'AMMO3': '0.219', 'weapon2': '0.286', 'AMMO4': '0.351', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '62.000'} [2024-08-06 02:21:00,875][52650] Updated weights for policy 0, policy_version 37391 (0.0023) [2024-08-06 02:21:01,155][52803] DAMAGECOUNT value on done: 269716.0 [2024-08-06 02:21:01,155][52803] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.690', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.074', 'AMMO3': '0.192', 'AMMO4': '0.193', 'weapon2': '0.278', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:02,130][52663] DAMAGECOUNT value on done: 291342.0 [2024-08-06 02:21:02,132][52663] Sum rewards: 72.889, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'HEALTH': '0.380', 'weapon2': '0.406', 'WEAPON3': '0.850', 'weapon3': '3.000', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:02,728][52811] DAMAGECOUNT value on done: 272782.0 [2024-08-06 02:21:02,730][52811] Sum rewards: 66.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.195', 'weapon2': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 306339840. Throughput: 0: 4383.6. Samples: 76584430. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:21:02,794][52567] Avg episode reward: [(0, '67.020')] [2024-08-06 02:21:03,044][52659] DAMAGECOUNT value on done: 295670.0 [2024-08-06 02:21:03,044][52659] Sum rewards: 44.281, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.584', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon7': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.142', 'AMMO3': '0.217', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.450', 'weapon4': '1.060', 'WEAPON3': '1.250', 'weapon3': '1.952', 'HITCOUNT': '2.250', 'DAMAGECOUNT': '11.415', 'FRAGCOUNT': '39.500'} [2024-08-06 02:21:03,133][52795] DAMAGECOUNT value on done: 267160.0 [2024-08-06 02:21:03,133][52795] Sum rewards: 64.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.092', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:03,188][52664] DAMAGECOUNT value on done: 306938.0 [2024-08-06 02:21:03,189][52664] Sum rewards: 64.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.954', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.046', 'AMMO4': '0.140', 'weapon5': '0.220', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:04,410][52803] DAMAGECOUNT value on done: 273847.0 [2024-08-06 02:21:04,411][52803] Sum rewards: 84.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.156', 'weapon4': '0.182', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '68.000'} [2024-08-06 02:21:04,836][52663] DAMAGECOUNT value on done: 284890.0 [2024-08-06 02:21:04,846][52663] Sum rewards: 66.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.950', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.150', 'AMMO4': '0.162', 'weapon5': '0.218', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.750', 'weapon3': '2.938', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '58.000'} [2024-08-06 02:21:05,540][52650] Updated weights for policy 0, policy_version 37401 (0.0036) [2024-08-06 02:21:05,754][52811] DAMAGECOUNT value on done: 272771.0 [2024-08-06 02:21:05,756][52811] Sum rewards: 51.327, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.230', 'AMMO4': '0.235', 'AMMO3': '0.257', 'weapon5': '0.298', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.780', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '44.000'} [2024-08-06 02:21:05,904][52664] DAMAGECOUNT value on done: 296502.0 [2024-08-06 02:21:05,905][52664] Sum rewards: 67.921, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.035', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.134', 'AMMO3': '0.184', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:06,244][52659] DAMAGECOUNT value on done: 291794.0 [2024-08-06 02:21:06,246][52659] Sum rewards: 57.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.074', 'AMMO4': '0.126', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.662', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '48.000'} [2024-08-06 02:21:06,288][52795] DAMAGECOUNT value on done: 263174.0 [2024-08-06 02:21:06,290][52795] Sum rewards: 63.887, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.054', 'weapon4': '0.086', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.342', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:07,561][52803] DAMAGECOUNT value on done: 268376.0 [2024-08-06 02:21:07,563][52803] Sum rewards: 53.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.030', 'AMMO5': '0.007', 'weapon5': '0.046', 'AMMO2': '0.063', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.266', 'AMMO4': '0.313', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.054', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.000'} [2024-08-06 02:21:07,592][52663] DAMAGECOUNT value on done: 288738.0 [2024-08-06 02:21:07,593][52663] Sum rewards: 79.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.112', 'AMMO3': '0.207', 'AMMO4': '0.231', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '65.000'} [2024-08-06 02:21:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 306421760. Throughput: 0: 4380.9. Samples: 76610420. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:21:07,794][52567] Avg episode reward: [(0, '66.526')] [2024-08-06 02:21:08,111][52614] Signal inference workers to stop experience collection... (6750 times) [2024-08-06 02:21:08,117][52614] Signal inference workers to resume experience collection... (6750 times) [2024-08-06 02:21:08,177][52650] InferenceWorker_p0-w0: stopping experience collection (6750 times) [2024-08-06 02:21:08,177][52650] InferenceWorker_p0-w0: resuming experience collection (6750 times) [2024-08-06 02:21:08,765][52811] DAMAGECOUNT value on done: 282488.0 [2024-08-06 02:21:08,766][52811] Sum rewards: 54.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.885', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.108', 'weapon5': '0.184', 'AMMO3': '0.207', 'AMMO4': '0.284', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '2.988', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '47.000'} [2024-08-06 02:21:09,081][52664] DAMAGECOUNT value on done: 310364.0 [2024-08-06 02:21:09,081][52664] Sum rewards: 54.559, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.728', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.218', 'weapon4': '0.238', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.162', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '47.000'} [2024-08-06 02:21:09,336][52659] DAMAGECOUNT value on done: 295868.0 [2024-08-06 02:21:09,336][52659] Sum rewards: 70.120, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.536', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO4': '0.247', 'weapon2': '0.258', 'AMMO3': '0.274', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.996', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '62.000'} [2024-08-06 02:21:09,481][52795] DAMAGECOUNT value on done: 272724.0 [2024-08-06 02:21:09,481][52795] Sum rewards: 71.378, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.088', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.277', 'weapon2': '0.474', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 02:21:09,857][52650] Updated weights for policy 0, policy_version 37411 (0.0011) [2024-08-06 02:21:10,346][52663] DAMAGECOUNT value on done: 289988.0 [2024-08-06 02:21:10,346][52663] Sum rewards: 66.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:10,631][52803] DAMAGECOUNT value on done: 278370.0 [2024-08-06 02:21:10,633][52803] Sum rewards: 54.305, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.896', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.140', 'AMMO3': '0.256', 'weapon2': '0.258', 'weapon4': '0.262', 'AMMO4': '0.297', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.072', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '50.000'} [2024-08-06 02:21:11,820][52811] DAMAGECOUNT value on done: 273843.0 [2024-08-06 02:21:11,823][52811] Sum rewards: 62.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.177', 'weapon4': '0.188', 'AMMO3': '0.218', 'weapon2': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '53.500'} [2024-08-06 02:21:12,042][52664] DAMAGECOUNT value on done: 301987.0 [2024-08-06 02:21:12,042][52664] Sum rewards: 66.252, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'HEALTH': '0.060', 'AMMO4': '0.077', 'weapon5': '0.102', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.288', 'weapon4': '0.354', 'WEAPON3': '0.950', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 02:21:12,461][52659] DAMAGECOUNT value on done: 296167.0 [2024-08-06 02:21:12,462][52659] Sum rewards: 75.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.272', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 02:21:12,539][52795] DAMAGECOUNT value on done: 263034.0 [2024-08-06 02:21:12,540][52795] Sum rewards: 64.733, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.561', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.147', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.688', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '52.000'} [2024-08-06 02:21:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 306520064. Throughput: 0: 4383.2. Samples: 76637010. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:21:12,794][52567] Avg episode reward: [(0, '66.076')] [2024-08-06 02:21:13,053][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:21:13,384][52663] DAMAGECOUNT value on done: 297614.0 [2024-08-06 02:21:13,386][52663] Sum rewards: 79.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.104', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.198', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '64.000'} [2024-08-06 02:21:13,764][52803] DAMAGECOUNT value on done: 274847.0 [2024-08-06 02:21:13,765][52803] Sum rewards: 62.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.353', 'AMMO5': '0.007', 'AMMO2': '0.060', 'weapon5': '0.134', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.299', 'weapon4': '0.368', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '51.000'} [2024-08-06 02:21:14,867][52650] Updated weights for policy 0, policy_version 37421 (0.0010) [2024-08-06 02:21:14,900][52811] DAMAGECOUNT value on done: 274500.0 [2024-08-06 02:21:14,900][52811] Sum rewards: 63.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.126', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.198', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:15,029][52664] DAMAGECOUNT value on done: 306558.0 [2024-08-06 02:21:15,030][52664] Sum rewards: 70.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:15,744][52795] DAMAGECOUNT value on done: 279245.0 [2024-08-06 02:21:15,748][52795] Sum rewards: 78.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.202', 'AMMO3': '0.216', 'WEAPON3': '1.300', 'HITCOUNT': '3.650', 'weapon3': '3.658', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '65.000'} [2024-08-06 02:21:16,206][52663] DAMAGECOUNT value on done: 291514.0 [2024-08-06 02:21:16,208][52663] Sum rewards: 63.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.986', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.254', 'AMMO3': '0.256', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:16,804][52803] DAMAGECOUNT value on done: 271836.0 [2024-08-06 02:21:16,805][52803] Sum rewards: 62.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.454', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon4': '0.012', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '51.500'} [2024-08-06 02:21:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 306601984. Throughput: 0: 4388.7. Samples: 76649990. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 02:21:17,795][52567] Avg episode reward: [(0, '66.156')] [2024-08-06 02:21:18,007][52811] DAMAGECOUNT value on done: 278362.0 [2024-08-06 02:21:18,008][52811] Sum rewards: 67.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.510', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:18,342][52664] DAMAGECOUNT value on done: 303715.0 [2024-08-06 02:21:18,342][52664] Sum rewards: 78.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '67.000'} [2024-08-06 02:21:18,904][52795] DAMAGECOUNT value on done: 274505.0 [2024-08-06 02:21:18,906][52795] Sum rewards: 69.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.140', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.356', 'weapon4': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:19,385][52650] Updated weights for policy 0, policy_version 37431 (0.0019) [2024-08-06 02:21:19,544][52663] DAMAGECOUNT value on done: 298169.0 [2024-08-06 02:21:19,544][52663] Sum rewards: 63.174, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.246', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.062', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO4': '0.232', 'AMMO3': '0.250', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:19,917][52803] DAMAGECOUNT value on done: 278339.0 [2024-08-06 02:21:19,924][52803] Sum rewards: 63.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.040', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.372', 'WEAPON3': '1.350', 'HITCOUNT': '3.310', 'weapon3': '3.344', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '53.000'} [2024-08-06 02:21:20,637][52664] DAMAGECOUNT value on done: 309364.0 [2024-08-06 02:21:20,637][52664] Sum rewards: 73.504, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.664', 'AMMO5': '0.003', 'AMMO2': '0.045', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon2': '0.202', 'AMMO4': '0.225', 'weapon4': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.292', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '65.000'} [2024-08-06 02:21:21,165][52811] DAMAGECOUNT value on done: 273979.0 [2024-08-06 02:21:21,166][52811] Sum rewards: 71.422, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.712', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.168', 'AMMO4': '0.185', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.500', 'weapon3': '2.748', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '61.000'} [2024-08-06 02:21:21,870][52665] DAMAGECOUNT value on done: 286373.0 [2024-08-06 02:21:21,871][52665] Sum rewards: 64.336, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.717', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:22,053][52795] DAMAGECOUNT value on done: 263771.0 [2024-08-06 02:21:22,053][52795] Sum rewards: 73.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.130', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.144', 'weapon4': '0.172', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '62.000'} [2024-08-06 02:21:22,182][52663] DAMAGECOUNT value on done: 295044.0 [2024-08-06 02:21:22,182][52663] Sum rewards: 67.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.484', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.154', 'AMMO3': '0.208', 'AMMO4': '0.242', 'weapon4': '0.294', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 306692096. Throughput: 0: 4391.8. Samples: 76676400. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 02:21:22,794][52567] Avg episode reward: [(0, '65.927')] [2024-08-06 02:21:23,184][52803] DAMAGECOUNT value on done: 272093.0 [2024-08-06 02:21:23,186][52803] Sum rewards: 69.244, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.050', 'HEALTH': '0.140', 'AMMO3': '0.170', 'AMMO4': '0.171', 'WEAPON4': '0.300', 'weapon2': '0.468', 'weapon4': '0.498', 'WEAPON3': '1.000', 'weapon3': '2.742', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:23,372][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:21:23,664][52664] DAMAGECOUNT value on done: 303399.0 [2024-08-06 02:21:23,664][52664] Sum rewards: 69.988, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon5': '0.142', 'AMMO3': '0.199', 'weapon2': '0.254', 'weapon4': '0.258', 'AMMO4': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '61.000'} [2024-08-06 02:21:23,666][52649] DAMAGECOUNT value on done: 283557.0 [2024-08-06 02:21:23,666][52649] Sum rewards: 60.370, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.094', 'AMMO4': '0.106', 'AMMO3': '0.135', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '0.850', 'HITCOUNT': '2.840', 'weapon3': '3.150', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '49.000'} [2024-08-06 02:21:23,826][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:21:23,871][52820] DAMAGECOUNT value on done: 267218.0 [2024-08-06 02:21:23,872][52820] Sum rewards: 58.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.375', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'AMMO4': '0.222', 'weapon4': '0.262', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '49.000'} [2024-08-06 02:21:24,195][52650] Updated weights for policy 0, policy_version 37441 (0.0012) [2024-08-06 02:21:24,300][52811] DAMAGECOUNT value on done: 277244.0 [2024-08-06 02:21:24,301][52811] Sum rewards: 66.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.224', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.226', 'WEAPON3': '1.250', 'weapon3': '3.468', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '54.000'} [2024-08-06 02:21:24,583][52794] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:21:24,640][52665] DAMAGECOUNT value on done: 292324.0 [2024-08-06 02:21:24,640][52665] Sum rewards: 58.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.342', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.118', 'AMMO3': '0.148', 'AMMO4': '0.209', 'weapon2': '0.230', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '3.184', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '49.000'} [2024-08-06 02:21:25,083][52795] DAMAGECOUNT value on done: 274149.0 [2024-08-06 02:21:25,085][52795] Sum rewards: 61.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.654', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.056', 'weapon4': '0.132', 'AMMO3': '0.168', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.314', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '51.000'} [2024-08-06 02:21:25,169][52663] DAMAGECOUNT value on done: 287266.0 [2024-08-06 02:21:25,170][52663] Sum rewards: 72.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.392', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.241', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '62.000'} [2024-08-06 02:21:25,627][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:21:25,950][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:21:26,342][52803] DAMAGECOUNT value on done: 271645.0 [2024-08-06 02:21:26,343][52803] Sum rewards: 60.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.132', 'weapon2': '0.170', 'AMMO4': '0.236', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.616', 'WEAPON3': '1.550', 'weapon3': '2.850', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '51.000'} [2024-08-06 02:21:26,597][52664] DAMAGECOUNT value on done: 309078.0 [2024-08-06 02:21:26,599][52664] Sum rewards: 64.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.084', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.380', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.268', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 02:21:26,603][52649] DAMAGECOUNT value on done: 278767.0 [2024-08-06 02:21:26,605][52649] Sum rewards: 79.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.547', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '66.000'} [2024-08-06 02:21:27,140][52820] DAMAGECOUNT value on done: 271673.0 [2024-08-06 02:21:27,140][52820] Sum rewards: 64.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.700', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.126', 'weapon4': '0.164', 'AMMO4': '0.263', 'AMMO3': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.024', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:27,240][52811] DAMAGECOUNT value on done: 276391.0 [2024-08-06 02:21:27,240][52811] Sum rewards: 79.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.456', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.161', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '64.000'} [2024-08-06 02:21:27,274][52665] DAMAGECOUNT value on done: 290693.0 [2024-08-06 02:21:27,274][52665] Sum rewards: 78.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.028', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '63.000'} [2024-08-06 02:21:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17578.1). Total num frames: 306782208. Throughput: 0: 4390.4. Samples: 76702780. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 02:21:27,795][52567] Avg episode reward: [(0, '66.612')] [2024-08-06 02:21:28,185][52795] DAMAGECOUNT value on done: 277100.0 [2024-08-06 02:21:28,187][52795] Sum rewards: 65.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.044', 'AMMO2': '0.008', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.266', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '54.500'} [2024-08-06 02:21:28,611][52650] Updated weights for policy 0, policy_version 37451 (0.0036) [2024-08-06 02:21:28,857][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:21:29,293][52649] DAMAGECOUNT value on done: 285791.0 [2024-08-06 02:21:29,294][52649] Sum rewards: 65.327, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.312', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '52.000'} [2024-08-06 02:21:29,558][52803] DAMAGECOUNT value on done: 278729.0 [2024-08-06 02:21:29,558][52803] Sum rewards: 61.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '54.000'} [2024-08-06 02:21:29,660][52664] DAMAGECOUNT value on done: 299166.0 [2024-08-06 02:21:29,661][52664] Sum rewards: 64.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.851', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.114', 'AMMO4': '0.247', 'AMMO3': '0.250', 'weapon4': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.000', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:29,929][52665] DAMAGECOUNT value on done: 287019.0 [2024-08-06 02:21:29,930][52665] Sum rewards: 60.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.504', 'weapon4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.538', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '51.000'} [2024-08-06 02:21:30,003][52667] DAMAGECOUNT value on done: 293436.0 [2024-08-06 02:21:30,005][52667] Sum rewards: 65.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.216', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO4': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:30,278][52820] DAMAGECOUNT value on done: 270653.0 [2024-08-06 02:21:30,280][52820] Sum rewards: 72.919, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.112', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.145', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '64.000'} [2024-08-06 02:21:30,323][52811] DAMAGECOUNT value on done: 269476.0 [2024-08-06 02:21:30,325][52811] Sum rewards: 62.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.955', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.148', 'weapon5': '0.180', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.122', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:30,807][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:21:32,140][52649] DAMAGECOUNT value on done: 286559.0 [2024-08-06 02:21:32,142][52649] Sum rewards: 65.393, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.143', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.058', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:32,591][52803] DAMAGECOUNT value on done: 271848.0 [2024-08-06 02:21:32,594][52803] Sum rewards: 70.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.270', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:32,678][52665] DAMAGECOUNT value on done: 284614.0 [2024-08-06 02:21:32,678][52665] Sum rewards: 65.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.102', 'weapon4': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.500'} [2024-08-06 02:21:32,697][52667] DAMAGECOUNT value on done: 297298.0 [2024-08-06 02:21:32,697][52667] Sum rewards: 66.772, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.373', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.212', 'AMMO3': '0.217', 'weapon4': '0.244', 'AMMO4': '0.259', 'weapon2': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:32,704][52664] DAMAGECOUNT value on done: 304466.0 [2024-08-06 02:21:32,705][52664] Sum rewards: 63.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.586', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.078', 'weapon4': '0.084', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '51.000'} [2024-08-06 02:21:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 306864128. Throughput: 0: 4387.1. Samples: 76715640. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 02:21:32,794][52567] Avg episode reward: [(0, '66.435')] [2024-08-06 02:21:33,400][52820] DAMAGECOUNT value on done: 265821.0 [2024-08-06 02:21:33,400][52820] Sum rewards: 76.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.225', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.270', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '64.000'} [2024-08-06 02:21:33,524][52650] Updated weights for policy 0, policy_version 37461 (0.0012) [2024-08-06 02:21:33,690][52811] DAMAGECOUNT value on done: 274798.0 [2024-08-06 02:21:33,690][52811] Sum rewards: 79.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.458', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.158', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '65.000'} [2024-08-06 02:21:34,724][52649] DAMAGECOUNT value on done: 277448.0 [2024-08-06 02:21:34,725][52649] Sum rewards: 65.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.097', 'weapon4': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'WEAPON3': '1.650', 'weapon3': '3.350', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:34,897][52662] DAMAGECOUNT value on done: 301337.0 [2024-08-06 02:21:34,900][52662] Sum rewards: 69.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.958', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.098', 'AMMO3': '0.174', 'AMMO4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:35,373][52665] DAMAGECOUNT value on done: 282837.0 [2024-08-06 02:21:35,374][52665] Sum rewards: 66.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.162', 'weapon4': '0.182', 'AMMO3': '0.219', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:35,529][52667] DAMAGECOUNT value on done: 294801.0 [2024-08-06 02:21:35,529][52667] Sum rewards: 60.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.296', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.197', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.246', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '50.000'} [2024-08-06 02:21:35,601][52803] DAMAGECOUNT value on done: 277970.0 [2024-08-06 02:21:35,601][52803] Sum rewards: 67.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.102', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.240', 'AMMO3': '0.244', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.348', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '58.000'} [2024-08-06 02:21:35,617][52664] DAMAGECOUNT value on done: 306400.0 [2024-08-06 02:21:35,618][52664] Sum rewards: 65.046, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.092', 'weapon4': '0.118', 'AMMO3': '0.164', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.334', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '53.000'} [2024-08-06 02:21:36,740][52820] DAMAGECOUNT value on done: 273315.0 [2024-08-06 02:21:36,741][52820] Sum rewards: 74.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'weapon4': '0.016', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.576', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '62.000'} [2024-08-06 02:21:36,807][52811] DAMAGECOUNT value on done: 276950.0 [2024-08-06 02:21:36,809][52811] Sum rewards: 71.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO2': '0.012', 'ARMOR': '0.032', 'weapon4': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.274', 'WEAPON3': '1.300', 'HITCOUNT': '3.410', 'weapon3': '3.542', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:37,184][52649] DAMAGECOUNT value on done: 288338.0 [2024-08-06 02:21:37,193][52649] Sum rewards: 78.319, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.109', 'AMMO3': '0.175', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2024-08-06 02:21:37,594][52662] DAMAGECOUNT value on done: 300536.0 [2024-08-06 02:21:37,594][52662] Sum rewards: 53.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.166', 'weapon5': '0.172', 'AMMO4': '0.182', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '2.910', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '46.000'} [2024-08-06 02:21:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 306954240. Throughput: 0: 4386.9. Samples: 76742120. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:21:37,794][52567] Avg episode reward: [(0, '66.649')] [2024-08-06 02:21:37,974][52650] Updated weights for policy 0, policy_version 37471 (0.0030) [2024-08-06 02:21:37,980][52665] DAMAGECOUNT value on done: 291889.0 [2024-08-06 02:21:37,981][52665] Sum rewards: 58.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.171', 'weapon5': '0.232', 'AMMO4': '0.302', 'weapon4': '0.346', 'weapon2': '0.422', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.680', 'weapon3': '2.682', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '47.000'} [2024-08-06 02:21:38,114][52667] DAMAGECOUNT value on done: 294329.0 [2024-08-06 02:21:38,116][52667] Sum rewards: 71.480, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.212', 'weapon2': '0.240', 'WEAPON3': '1.300', 'weapon3': '3.578', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:38,315][52664] DAMAGECOUNT value on done: 305664.0 [2024-08-06 02:21:38,316][52664] Sum rewards: 82.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.074', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON3': '1.350', 'weapon3': '3.478', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '66.000'} [2024-08-06 02:21:38,778][52803] DAMAGECOUNT value on done: 268311.0 [2024-08-06 02:21:38,778][52803] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.232', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.176', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.338', 'weapon4': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '60.000'} [2024-08-06 02:21:39,399][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:21:39,923][52811] DAMAGECOUNT value on done: 272390.0 [2024-08-06 02:21:39,927][52811] Sum rewards: 62.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.786', 'AMMO5': '0.015', 'AMMO2': '0.064', 'weapon5': '0.206', 'AMMO3': '0.233', 'weapon4': '0.238', 'weapon2': '0.284', 'AMMO4': '0.319', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:40,063][52820] DAMAGECOUNT value on done: 266867.0 [2024-08-06 02:21:40,067][52820] Sum rewards: 64.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.378', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.225', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.424', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:40,330][52649] DAMAGECOUNT value on done: 284766.0 [2024-08-06 02:21:40,333][52649] Sum rewards: 74.644, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO3': '0.121', 'AMMO4': '0.136', 'weapon4': '0.162', 'WEAPON5': '0.200', 'weapon5': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.370', 'HEALTH': '0.572', 'WEAPON3': '0.700', 'HITCOUNT': '2.980', 'weapon3': '3.012', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '60.000'} [2024-08-06 02:21:40,389][52662] DAMAGECOUNT value on done: 298997.0 [2024-08-06 02:21:40,390][52662] Sum rewards: 58.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.148', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '3.214', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '48.000'} [2024-08-06 02:21:40,582][52668] DAMAGECOUNT value on done: 292064.0 [2024-08-06 02:21:40,582][52668] Sum rewards: 81.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.020', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.246', 'WEAPON3': '1.350', 'weapon3': '3.482', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '68.000'} [2024-08-06 02:21:40,590][52667] DAMAGECOUNT value on done: 298832.0 [2024-08-06 02:21:40,592][52667] Sum rewards: 59.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.019', 'AMMO2': '0.066', 'AMMO3': '0.233', 'weapon5': '0.284', 'AMMO4': '0.332', 'weapon4': '0.364', 'weapon2': '0.546', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.470', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '51.000'} [2024-08-06 02:21:40,908][52664] DAMAGECOUNT value on done: 304794.0 [2024-08-06 02:21:40,909][52664] Sum rewards: 63.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.140', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '2.896', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '53.000'} [2024-08-06 02:21:41,255][52665] DAMAGECOUNT value on done: 291923.0 [2024-08-06 02:21:41,255][52665] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.152', 'AMMO4': '0.161', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 307036160. Throughput: 0: 4384.4. Samples: 76768460. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:21:42,794][52567] Avg episode reward: [(0, '66.904')] [2024-08-06 02:21:42,947][52811] DAMAGECOUNT value on done: 278821.0 [2024-08-06 02:21:42,947][52811] Sum rewards: 61.694, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.120', 'AMMO5': '0.026', 'AMMO2': '0.049', 'AMMO3': '0.245', 'AMMO4': '0.247', 'weapon4': '0.250', 'weapon2': '0.298', 'weapon5': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '53.500'} [2024-08-06 02:21:43,007][52650] Updated weights for policy 0, policy_version 37481 (0.0015) [2024-08-06 02:21:43,187][52820] DAMAGECOUNT value on done: 269818.0 [2024-08-06 02:21:43,189][52820] Sum rewards: 66.596, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.124', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.182', 'AMMO4': '0.228', 'weapon2': '0.268', 'AMMO3': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.846', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '58.000'} [2024-08-06 02:21:43,408][52649] DAMAGECOUNT value on done: 290705.0 [2024-08-06 02:21:43,408][52649] Sum rewards: 57.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.859', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.254', 'weapon2': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.230', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '50.000'} [2024-08-06 02:21:43,473][52662] DAMAGECOUNT value on done: 291041.0 [2024-08-06 02:21:43,474][52662] Sum rewards: 70.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.782', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.136', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.436', 'weapon4': '0.492', 'WEAPON3': '1.050', 'weapon3': '2.748', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:43,580][52667] DAMAGECOUNT value on done: 297009.0 [2024-08-06 02:21:43,581][52667] Sum rewards: 64.446, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.470', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.165', 'weapon4': '0.170', 'weapon2': '0.236', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:43,713][52668] DAMAGECOUNT value on done: 297901.0 [2024-08-06 02:21:43,713][52668] Sum rewards: 69.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.298', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.042', 'AMMO4': '0.058', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 02:21:43,845][52665] DAMAGECOUNT value on done: 291237.0 [2024-08-06 02:21:43,846][52665] Sum rewards: 52.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.146', 'AMMO3': '0.204', 'AMMO4': '0.231', 'weapon2': '0.272', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '2.914', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '46.000'} [2024-08-06 02:21:45,767][52649] DAMAGECOUNT value on done: 287274.0 [2024-08-06 02:21:45,768][52649] Sum rewards: 61.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.124', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.476', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.106', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '53.000'} [2024-08-06 02:21:46,239][52820] DAMAGECOUNT value on done: 273602.0 [2024-08-06 02:21:46,241][52820] Sum rewards: 70.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.355', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:46,403][52665] DAMAGECOUNT value on done: 289572.0 [2024-08-06 02:21:46,404][52665] Sum rewards: 70.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.102', 'AMMO4': '0.150', 'weapon4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.208', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.310', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:46,443][52662] DAMAGECOUNT value on done: 298924.0 [2024-08-06 02:21:46,443][52662] Sum rewards: 66.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.422', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.062', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:46,536][52668] DAMAGECOUNT value on done: 298200.0 [2024-08-06 02:21:46,536][52668] Sum rewards: 69.509, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon4': '0.040', 'weapon5': '0.080', 'AMMO4': '0.180', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:46,670][52667] DAMAGECOUNT value on done: 299709.0 [2024-08-06 02:21:46,671][52667] Sum rewards: 73.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.062', 'weapon5': '0.180', 'AMMO3': '0.201', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '60.500'} [2024-08-06 02:21:47,667][52650] Updated weights for policy 0, policy_version 37491 (0.0026) [2024-08-06 02:21:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.4). Total num frames: 307126272. Throughput: 0: 4380.4. Samples: 76781550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:21:47,794][52567] Avg episode reward: [(0, '66.970')] [2024-08-06 02:21:48,816][52649] DAMAGECOUNT value on done: 286920.0 [2024-08-06 02:21:48,818][52649] Sum rewards: 60.426, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.548', 'AMMO5': '0.015', 'weapon5': '0.058', 'AMMO2': '0.066', 'AMMO3': '0.188', 'weapon4': '0.220', 'AMMO4': '0.329', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'weapon2': '0.674', 'WEAPON3': '1.050', 'weapon3': '2.730', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '52.000'} [2024-08-06 02:21:49,193][52820] DAMAGECOUNT value on done: 272106.0 [2024-08-06 02:21:49,195][52820] Sum rewards: 71.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.643', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.142', 'weapon5': '0.170', 'AMMO3': '0.215', 'AMMO4': '0.227', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '60.000'} [2024-08-06 02:21:49,358][52665] DAMAGECOUNT value on done: 296369.0 [2024-08-06 02:21:49,360][52665] Sum rewards: 60.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.832', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.178', 'AMMO3': '0.201', 'weapon4': '0.206', 'AMMO4': '0.212', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.160', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '49.000'} [2024-08-06 02:21:49,523][52662] DAMAGECOUNT value on done: 289688.0 [2024-08-06 02:21:49,523][52662] Sum rewards: 61.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.064', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO3': '0.158', 'AMMO4': '0.165', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '0.950', 'weapon3': '2.784', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '52.000'} [2024-08-06 02:21:49,660][52668] DAMAGECOUNT value on done: 300346.0 [2024-08-06 02:21:49,662][52668] Sum rewards: 79.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.130', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.197', 'weapon2': '0.218', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.336', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '67.000'} [2024-08-06 02:21:50,021][52667] DAMAGECOUNT value on done: 292570.0 [2024-08-06 02:21:50,022][52667] Sum rewards: 82.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.237', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.306', 'WEAPON3': '1.200', 'weapon3': '3.390', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '67.000'} [2024-08-06 02:21:51,908][52649] DAMAGECOUNT value on done: 288236.0 [2024-08-06 02:21:51,908][52649] Sum rewards: 61.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.845', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.159', 'AMMO3': '0.214', 'weapon4': '0.230', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '51.500'} [2024-08-06 02:21:52,277][52650] Updated weights for policy 0, policy_version 37501 (0.0013) [2024-08-06 02:21:52,456][52662] DAMAGECOUNT value on done: 300217.0 [2024-08-06 02:21:52,458][52662] Sum rewards: 65.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon5': '0.038', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.000'} [2024-08-06 02:21:52,476][52665] DAMAGECOUNT value on done: 292967.0 [2024-08-06 02:21:52,477][52665] Sum rewards: 68.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.804', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO3': '0.194', 'weapon2': '0.230', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.478', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '58.000'} [2024-08-06 02:21:52,561][52668] DAMAGECOUNT value on done: 288913.0 [2024-08-06 02:21:52,562][52668] Sum rewards: 64.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.134', 'AMMO4': '0.177', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:52,587][52820] DAMAGECOUNT value on done: 274279.0 [2024-08-06 02:21:52,587][52820] Sum rewards: 71.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.230', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon2': '0.182', 'AMMO3': '0.184', 'WEAPON3': '1.100', 'HITCOUNT': '3.390', 'weapon3': '3.636', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '58.000'} [2024-08-06 02:21:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 307208192. Throughput: 0: 4386.7. Samples: 76807820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:21:52,802][52567] Avg episode reward: [(0, '67.480')] [2024-08-06 02:21:52,922][52667] DAMAGECOUNT value on done: 294211.0 [2024-08-06 02:21:52,922][52667] Sum rewards: 66.831, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.060', 'weapon4': '0.102', 'AMMO4': '0.148', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:54,628][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:21:54,774][52649] DAMAGECOUNT value on done: 287676.0 [2024-08-06 02:21:54,775][52649] Sum rewards: 55.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.905', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.302', 'weapon4': '0.678', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '45.000'} [2024-08-06 02:21:55,173][52665] DAMAGECOUNT value on done: 292157.0 [2024-08-06 02:21:55,175][52665] Sum rewards: 58.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.134', 'weapon5': '0.142', 'AMMO4': '0.178', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '50.000'} [2024-08-06 02:21:55,261][52662] DAMAGECOUNT value on done: 304531.0 [2024-08-06 02:21:55,263][52662] Sum rewards: 66.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.142', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.186', 'AMMO4': '0.201', 'weapon2': '0.208', 'weapon5': '0.274', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:55,531][52649] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:21:55,601][52667] DAMAGECOUNT value on done: 299268.0 [2024-08-06 02:21:55,602][52667] Sum rewards: 70.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:55,616][52668] DAMAGECOUNT value on done: 298658.0 [2024-08-06 02:21:55,617][52668] Sum rewards: 64.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO4': '0.116', 'weapon4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.178', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '55.000'} [2024-08-06 02:21:55,950][52820] DAMAGECOUNT value on done: 273582.0 [2024-08-06 02:21:55,953][52820] Sum rewards: 65.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.402', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.102', 'AMMO4': '0.137', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '53.500'} [2024-08-06 02:21:56,674][52650] Updated weights for policy 0, policy_version 37511 (0.0028) [2024-08-06 02:21:57,284][52649] DAMAGECOUNT value on done: 289793.0 [2024-08-06 02:21:57,284][52649] Sum rewards: 68.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.124', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.201', 'weapon5': '0.264', 'AMMO4': '0.278', 'weapon2': '0.338', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.666', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '56.000'} [2024-08-06 02:21:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 307306496. Throughput: 0: 4384.7. Samples: 76834320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:21:57,794][52567] Avg episode reward: [(0, '67.345')] [2024-08-06 02:21:57,839][52665] DAMAGECOUNT value on done: 291770.0 [2024-08-06 02:21:57,839][52665] Sum rewards: 70.109, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.279', 'weapon2': '0.298', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.328', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '61.000'} [2024-08-06 02:21:57,932][52667] Large shaping reward 2.750 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 02:21:58,398][52667] DAMAGECOUNT value on done: 293891.0 [2024-08-06 02:21:58,399][52667] Sum rewards: 65.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.254', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.248', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '2.828', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '58.000'} [2024-08-06 02:21:58,419][52662] DAMAGECOUNT value on done: 295051.0 [2024-08-06 02:21:58,420][52662] Sum rewards: 55.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.022', 'AMMO2': '0.072', 'AMMO3': '0.179', 'weapon2': '0.210', 'weapon5': '0.210', 'AMMO4': '0.362', 'WEAPON5': '0.450', 'weapon4': '0.490', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '45.500'} [2024-08-06 02:21:58,465][52668] DAMAGECOUNT value on done: 296029.0 [2024-08-06 02:21:58,467][52668] Sum rewards: 70.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.025', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.534', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.246', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '59.000'} [2024-08-06 02:21:58,989][52660] DAMAGECOUNT value on done: 290314.0 [2024-08-06 02:21:58,991][52660] Sum rewards: 84.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.393', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.150', 'AMMO4': '0.170', 'weapon2': '0.242', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.294', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '71.000'} [2024-08-06 02:21:59,141][52820] DAMAGECOUNT value on done: 274040.0 [2024-08-06 02:21:59,142][52820] Sum rewards: 61.530, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.275', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon5': '0.216', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.152', 'DAMAGECOUNT': '14.253', 'FRAGCOUNT': '51.000'} [2024-08-06 02:22:00,284][52649] DAMAGECOUNT value on done: 292132.0 [2024-08-06 02:22:00,284][52649] Sum rewards: 71.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.116', 'weapon5': '0.134', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:01,032][52665] DAMAGECOUNT value on done: 290646.0 [2024-08-06 02:22:01,033][52665] Sum rewards: 72.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.138', 'AMMO3': '0.164', 'AMMO4': '0.222', 'weapon2': '0.232', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:01,184][52667] DAMAGECOUNT value on done: 296148.0 [2024-08-06 02:22:01,185][52667] Sum rewards: 68.486, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.435', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.090', 'AMMO4': '0.169', 'AMMO3': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.764', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:01,264][52668] DAMAGECOUNT value on done: 291827.0 [2024-08-06 02:22:01,265][52668] Sum rewards: 69.569, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.828', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.182', 'AMMO4': '0.199', 'weapon2': '0.252', 'AMMO3': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.136', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '63.000'} [2024-08-06 02:22:01,425][52669] DAMAGECOUNT value on done: 298101.0 [2024-08-06 02:22:01,425][52669] Sum rewards: 75.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.025', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.072', 'weapon5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.208', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '63.000'} [2024-08-06 02:22:01,587][52662] DAMAGECOUNT value on done: 306507.0 [2024-08-06 02:22:01,588][52662] Sum rewards: 56.278, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.038', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.193', 'weapon4': '0.204', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '3.092', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '45.000'} [2024-08-06 02:22:01,624][52660] DAMAGECOUNT value on done: 287827.0 [2024-08-06 02:22:01,626][52660] Sum rewards: 61.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.202', 'WEAPON5': '0.400', 'weapon4': '0.454', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.744', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:01,798][52650] Updated weights for policy 0, policy_version 37521 (0.0013) [2024-08-06 02:22:02,291][52820] DAMAGECOUNT value on done: 274995.0 [2024-08-06 02:22:02,292][52820] Sum rewards: 85.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.573', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.118', 'weapon4': '0.174', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '69.000'} [2024-08-06 02:22:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 307396608. Throughput: 0: 4386.7. Samples: 76847390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:22:02,802][52567] Avg episode reward: [(0, '67.363')] [2024-08-06 02:22:03,474][52649] DAMAGECOUNT value on done: 281540.0 [2024-08-06 02:22:03,475][52649] Sum rewards: 54.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.149', 'AMMO4': '0.191', 'weapon2': '0.282', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '3.082', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '45.000'} [2024-08-06 02:22:04,063][52665] DAMAGECOUNT value on done: 287624.0 [2024-08-06 02:22:04,063][52665] Sum rewards: 72.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.205', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.126', 'weapon4': '0.134', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '61.000'} [2024-08-06 02:22:04,217][52668] DAMAGECOUNT value on done: 295412.0 [2024-08-06 02:22:04,219][52668] Sum rewards: 59.356, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.561', 'AMMO5': '0.016', 'AMMO2': '0.065', 'weapon5': '0.160', 'AMMO3': '0.217', 'weapon4': '0.222', 'AMMO4': '0.324', 'weapon2': '0.444', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '52.500'} [2024-08-06 02:22:04,223][52662] DAMAGECOUNT value on done: 292978.0 [2024-08-06 02:22:04,225][52662] Sum rewards: 68.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon4': '0.388', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:04,420][52667] DAMAGECOUNT value on done: 294633.0 [2024-08-06 02:22:04,420][52667] Sum rewards: 80.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.199', 'AMMO4': '0.217', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '67.000'} [2024-08-06 02:22:04,542][52669] DAMAGECOUNT value on done: 291597.0 [2024-08-06 02:22:04,542][52669] Sum rewards: 67.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.414', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.160', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.800', 'weapon3': '3.074', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:04,710][52660] DAMAGECOUNT value on done: 297544.0 [2024-08-06 02:22:04,711][52660] Sum rewards: 66.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.610', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.164', 'weapon2': '0.194', 'AMMO3': '0.234', 'weapon4': '0.242', 'AMMO4': '0.281', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '56.500'} [2024-08-06 02:22:05,452][52820] DAMAGECOUNT value on done: 273814.0 [2024-08-06 02:22:05,453][52820] Sum rewards: 68.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.365', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.110', 'AMMO4': '0.231', 'AMMO3': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.960', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:06,079][52650] Updated weights for policy 0, policy_version 37531 (0.0011) [2024-08-06 02:22:06,645][52649] DAMAGECOUNT value on done: 288614.0 [2024-08-06 02:22:06,645][52649] Sum rewards: 54.942, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.515', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.154', 'AMMO4': '0.175', 'weapon5': '0.224', 'AMMO3': '0.284', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '2.960', 'weapon3': '2.982', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '49.000'} [2024-08-06 02:22:06,967][52665] DAMAGECOUNT value on done: 288138.0 [2024-08-06 02:22:06,969][52665] Sum rewards: 70.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.073', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.220', 'WEAPON3': '1.400', 'HITCOUNT': '3.400', 'weapon3': '3.454', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:06,993][52662] DAMAGECOUNT value on done: 294337.0 [2024-08-06 02:22:06,993][52662] Sum rewards: 70.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.252', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.010', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.170', 'weapon2': '0.210', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.382', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:07,015][52667] DAMAGECOUNT value on done: 291980.0 [2024-08-06 02:22:07,015][52667] Sum rewards: 66.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.212', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.354', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:07,055][52668] DAMAGECOUNT value on done: 294529.0 [2024-08-06 02:22:07,055][52668] Sum rewards: 55.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.090', 'AMMO4': '0.189', 'weapon4': '0.194', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.192', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '46.000'} [2024-08-06 02:22:07,122][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:22:07,369][52660] DAMAGECOUNT value on done: 296052.0 [2024-08-06 02:22:07,371][52660] Sum rewards: 69.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.448', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:07,503][52669] DAMAGECOUNT value on done: 296636.0 [2024-08-06 02:22:07,504][52669] Sum rewards: 62.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.036', 'AMMO4': '0.126', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.216', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.408', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '51.000'} [2024-08-06 02:22:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 307478528. Throughput: 0: 4383.5. Samples: 76873660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:22:07,795][52567] Avg episode reward: [(0, '67.292')] [2024-08-06 02:22:08,453][52820] DAMAGECOUNT value on done: 276342.0 [2024-08-06 02:22:08,456][52820] Sum rewards: 84.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.255', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.171', 'weapon2': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.454', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '67.000'} [2024-08-06 02:22:09,336][52794] DAMAGECOUNT value on done: 296691.0 [2024-08-06 02:22:09,336][52794] Sum rewards: 57.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.628', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon2': '0.180', 'AMMO3': '0.228', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.618', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '50.000'} [2024-08-06 02:22:09,501][52649] DAMAGECOUNT value on done: 286586.0 [2024-08-06 02:22:09,502][52649] Sum rewards: 69.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.216', 'weapon4': '0.264', 'weapon2': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:09,571][52668] DAMAGECOUNT value on done: 298286.0 [2024-08-06 02:22:09,572][52668] Sum rewards: 76.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.098', 'weapon4': '0.110', 'AMMO4': '0.115', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:09,670][52667] DAMAGECOUNT value on done: 299818.0 [2024-08-06 02:22:09,670][52667] Sum rewards: 70.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.246', 'weapon2': '0.822', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:09,827][52660] DAMAGECOUNT value on done: 294218.0 [2024-08-06 02:22:09,827][52660] Sum rewards: 73.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.516', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.146', 'weapon4': '0.218', 'AMMO4': '0.226', 'AMMO3': '0.242', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:10,043][52665] DAMAGECOUNT value on done: 287987.0 [2024-08-06 02:22:10,043][52665] Sum rewards: 70.085, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.800', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.088', 'weapon4': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.322', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:10,094][52662] DAMAGECOUNT value on done: 297795.0 [2024-08-06 02:22:10,097][52662] Sum rewards: 75.516, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.867', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'weapon2': '0.918', 'WEAPON3': '1.000', 'weapon3': '2.906', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:10,662][52669] DAMAGECOUNT value on done: 293712.0 [2024-08-06 02:22:10,665][52669] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.108', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.214', 'weapon2': '0.254', 'weapon4': '0.266', 'AMMO3': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.142', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '64.000'} [2024-08-06 02:22:10,798][52650] Updated weights for policy 0, policy_version 37541 (0.0012) [2024-08-06 02:22:11,472][52820] DAMAGECOUNT value on done: 273782.0 [2024-08-06 02:22:11,472][52820] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.552', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '3.054', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '48.000'} [2024-08-06 02:22:12,318][52649] DAMAGECOUNT value on done: 289822.0 [2024-08-06 02:22:12,319][52649] Sum rewards: 68.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:12,578][52794] DAMAGECOUNT value on done: 300317.0 [2024-08-06 02:22:12,580][52794] Sum rewards: 65.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.123', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.308', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:12,662][52667] DAMAGECOUNT value on done: 303182.0 [2024-08-06 02:22:12,664][52667] Sum rewards: 65.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.196', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.508', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.512', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 307568640. Throughput: 0: 4385.1. Samples: 76900110. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:22:12,802][52567] Avg episode reward: [(0, '67.558')] [2024-08-06 02:22:12,847][52665] DAMAGECOUNT value on done: 290916.0 [2024-08-06 02:22:12,849][52665] Sum rewards: 63.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.156', 'weapon5': '0.194', 'AMMO3': '0.197', 'AMMO4': '0.274', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.966', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:12,992][52668] DAMAGECOUNT value on done: 292137.0 [2024-08-06 02:22:12,993][52668] Sum rewards: 81.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.170', 'weapon2': '0.186', 'weapon4': '0.188', 'AMMO4': '0.223', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.200', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '68.000'} [2024-08-06 02:22:13,359][52662] DAMAGECOUNT value on done: 303105.0 [2024-08-06 02:22:13,362][52662] Sum rewards: 59.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.283', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.139', 'weapon5': '0.292', 'AMMO4': '0.292', 'weapon2': '0.318', 'weapon4': '0.326', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.754', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '48.500'} [2024-08-06 02:22:13,384][52660] DAMAGECOUNT value on done: 289228.0 [2024-08-06 02:22:13,384][52660] Sum rewards: 71.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:13,674][52669] DAMAGECOUNT value on done: 290743.0 [2024-08-06 02:22:13,676][52669] Sum rewards: 55.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.200', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.170', 'AMMO4': '0.174', 'weapon2': '0.198', 'AMMO3': '0.278', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.660', 'weapon3': '3.100', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '49.000'} [2024-08-06 02:22:14,651][52820] DAMAGECOUNT value on done: 267715.0 [2024-08-06 02:22:14,653][52820] Sum rewards: 55.882, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.678', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.282', 'weapon2': '0.288', 'weapon4': '0.308', 'WEAPON3': '1.650', 'weapon3': '2.918', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '49.000'} [2024-08-06 02:22:15,330][52650] Updated weights for policy 0, policy_version 37551 (0.0011) [2024-08-06 02:22:15,408][52667] DAMAGECOUNT value on done: 297814.0 [2024-08-06 02:22:15,408][52667] Sum rewards: 63.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.278', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.072', 'weapon4': '0.088', 'AMMO3': '0.213', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '55.000'} [2024-08-06 02:22:15,515][52649] DAMAGECOUNT value on done: 291652.0 [2024-08-06 02:22:15,515][52649] Sum rewards: 72.296, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.717', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.214', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '63.000'} [2024-08-06 02:22:15,610][52794] DAMAGECOUNT value on done: 295069.0 [2024-08-06 02:22:15,612][52794] Sum rewards: 65.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.090', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:15,997][52665] DAMAGECOUNT value on done: 290804.0 [2024-08-06 02:22:15,997][52665] Sum rewards: 61.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.399', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.134', 'AMMO4': '0.154', 'weapon5': '0.188', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.828', 'WEAPON3': '1.350', 'weapon3': '2.606', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '51.000'} [2024-08-06 02:22:16,055][52668] DAMAGECOUNT value on done: 285784.0 [2024-08-06 02:22:16,055][52668] Sum rewards: 65.980, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.201', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.176', 'AMMO4': '0.221', 'weapon5': '0.224', 'AMMO3': '0.251', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:16,335][52660] DAMAGECOUNT value on done: 296028.0 [2024-08-06 02:22:16,337][52660] Sum rewards: 64.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.256', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.448', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.346', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '51.000'} [2024-08-06 02:22:16,413][52662] DAMAGECOUNT value on done: 295947.0 [2024-08-06 02:22:16,413][52662] Sum rewards: 71.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.556', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.167', 'AMMO4': '0.168', 'weapon5': '0.228', 'weapon4': '0.292', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '58.500'} [2024-08-06 02:22:16,656][52669] DAMAGECOUNT value on done: 296046.0 [2024-08-06 02:22:16,656][52669] Sum rewards: 71.831, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.834', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.106', 'AMMO4': '0.219', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.426', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:16,660][52647] DAMAGECOUNT value on done: 311097.0 [2024-08-06 02:22:16,660][52647] Sum rewards: 52.310, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.774', 'WEAPON3': '1.000', 'HITCOUNT': '2.450', 'weapon3': '2.982', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '41.000'} [2024-08-06 02:22:17,724][52820] DAMAGECOUNT value on done: 279344.0 [2024-08-06 02:22:17,725][52820] Sum rewards: 60.102, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.104', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.266', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '55.000'} [2024-08-06 02:22:17,796][52567] Fps is (10 sec: 17201.1, 60 sec: 17475.9, 300 sec: 17522.5). Total num frames: 307650560. Throughput: 0: 4392.1. Samples: 76913290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:22:17,804][52567] Avg episode reward: [(0, '67.039')] [2024-08-06 02:22:18,129][52667] DAMAGECOUNT value on done: 301931.0 [2024-08-06 02:22:18,130][52667] Sum rewards: 78.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.809', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.128', 'weapon5': '0.132', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '66.000'} [2024-08-06 02:22:18,606][52794] DAMAGECOUNT value on done: 296328.0 [2024-08-06 02:22:18,606][52794] Sum rewards: 67.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.655', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.148', 'weapon4': '0.190', 'weapon2': '0.202', 'AMMO3': '0.230', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.216', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:18,673][52649] DAMAGECOUNT value on done: 292927.0 [2024-08-06 02:22:18,673][52649] Sum rewards: 62.712, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.650', 'AMMO5': '0.010', 'AMMO2': '0.065', 'weapon5': '0.142', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.306', 'AMMO4': '0.326', 'weapon4': '0.472', 'WEAPON4': '0.750', 'WEAPON3': '1.700', 'weapon3': '2.752', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:18,708][52668] DAMAGECOUNT value on done: 287743.0 [2024-08-06 02:22:18,708][52668] Sum rewards: 69.818, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.137', 'weapon4': '0.146', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.380', 'HEALTH': '0.570', 'WEAPON3': '0.900', 'weapon3': '3.186', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:18,942][52671] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:22:18,944][52660] DAMAGECOUNT value on done: 300237.0 [2024-08-06 02:22:18,945][52660] Sum rewards: 59.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.977', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.181', 'weapon2': '0.248', 'weapon5': '0.250', 'AMMO4': '0.264', 'weapon4': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '50.000'} [2024-08-06 02:22:19,106][52658] DAMAGECOUNT value on done: 296161.0 [2024-08-06 02:22:19,107][52658] Sum rewards: 53.226, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.772', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.136', 'weapon5': '0.156', 'AMMO4': '0.208', 'weapon4': '0.352', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.750', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.014', 'FRAGCOUNT': '43.000'} [2024-08-06 02:22:19,235][52662] DAMAGECOUNT value on done: 309250.0 [2024-08-06 02:22:19,235][52662] Sum rewards: 64.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.547', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.130', 'AMMO3': '0.209', 'weapon5': '0.220', 'AMMO4': '0.243', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '3.078', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '55.000'} [2024-08-06 02:22:19,369][52647] DAMAGECOUNT value on done: 310801.0 [2024-08-06 02:22:19,369][52647] Sum rewards: 76.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'weapon4': '0.122', 'AMMO4': '0.136', 'weapon2': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.210', 'weapon3': '3.394', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '67.000'} [2024-08-06 02:22:19,840][52669] DAMAGECOUNT value on done: 297040.0 [2024-08-06 02:22:19,840][52669] Sum rewards: 63.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.915', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon5': '0.132', 'AMMO3': '0.220', 'AMMO4': '0.245', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.100', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '55.000'} [2024-08-06 02:22:20,233][52650] Updated weights for policy 0, policy_version 37561 (0.0011) [2024-08-06 02:22:20,760][52820] DAMAGECOUNT value on done: 282839.0 [2024-08-06 02:22:20,762][52820] Sum rewards: 67.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.608', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.170', 'AMMO3': '0.181', 'weapon4': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '53.000'} [2024-08-06 02:22:20,908][52667] DAMAGECOUNT value on done: 292323.0 [2024-08-06 02:22:20,909][52667] Sum rewards: 70.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.106', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.224', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.280', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:21,069][52668] DAMAGECOUNT value on done: 288475.0 [2024-08-06 02:22:21,069][52668] Sum rewards: 62.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.434', 'weapon2': '0.696', 'WEAPON3': '1.250', 'weapon3': '2.508', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:21,316][52794] DAMAGECOUNT value on done: 293027.0 [2024-08-06 02:22:21,318][52794] Sum rewards: 60.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.166', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.078', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:21,456][52660] DAMAGECOUNT value on done: 298638.0 [2024-08-06 02:22:21,456][52660] Sum rewards: 65.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.582', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO4': '0.201', 'weapon4': '0.204', 'weapon2': '0.210', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:21,759][52662] DAMAGECOUNT value on done: 298494.0 [2024-08-06 02:22:21,759][52662] Sum rewards: 71.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.188', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.202', 'weapon4': '0.214', 'AMMO4': '0.236', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:21,953][52658] DAMAGECOUNT value on done: 295743.0 [2024-08-06 02:22:21,955][52658] Sum rewards: 68.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.325', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.116', 'AMMO4': '0.195', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:22,456][52647] DAMAGECOUNT value on done: 310375.0 [2024-08-06 02:22:22,456][52647] Sum rewards: 58.011, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.545', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.212', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.750', 'weapon3': '2.866', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:22,466][52669] DAMAGECOUNT value on done: 297538.0 [2024-08-06 02:22:22,468][52669] Sum rewards: 69.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.686', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.178', 'AMMO3': '0.180', 'AMMO4': '0.180', 'weapon5': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '2.958', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:22,795][52567] Fps is (10 sec: 17202.1, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 307740672. Throughput: 0: 4391.9. Samples: 76939760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:22:22,795][52567] Avg episode reward: [(0, '67.048')] [2024-08-06 02:22:23,813][52794] DAMAGECOUNT value on done: 297158.0 [2024-08-06 02:22:23,813][52794] Sum rewards: 56.900, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.072', 'weapon5': '0.086', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.300', 'AMMO4': '0.362', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.142', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '50.000'} [2024-08-06 02:22:23,894][52820] DAMAGECOUNT value on done: 270512.0 [2024-08-06 02:22:23,895][52820] Sum rewards: 71.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.126', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.221', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.000'} [2024-08-06 02:22:24,102][52667] DAMAGECOUNT value on done: 298145.0 [2024-08-06 02:22:24,104][52667] Sum rewards: 64.059, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.005', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.188', 'weapon2': '0.546', 'WEAPON3': '0.850', 'HITCOUNT': '2.930', 'weapon3': '2.988', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '49.500'} [2024-08-06 02:22:24,129][52668] DAMAGECOUNT value on done: 292515.0 [2024-08-06 02:22:24,129][52668] Sum rewards: 67.752, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.130', 'AMMO4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.202', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '59.500'} [2024-08-06 02:22:24,501][52662] DAMAGECOUNT value on done: 299055.0 [2024-08-06 02:22:24,505][52662] Sum rewards: 82.160, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.513', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '68.000'} [2024-08-06 02:22:24,620][52660] DAMAGECOUNT value on done: 292266.0 [2024-08-06 02:22:24,620][52660] Sum rewards: 48.410, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.400', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.184', 'AMMO4': '0.262', 'AMMO3': '0.301', 'weapon4': '0.302', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.780', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.812', 'FRAGCOUNT': '46.000'} [2024-08-06 02:22:24,725][52650] Updated weights for policy 0, policy_version 37571 (0.0011) [2024-08-06 02:22:24,854][52669] DAMAGECOUNT value on done: 295082.0 [2024-08-06 02:22:24,856][52669] Sum rewards: 56.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.665', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.056', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '50.000'} [2024-08-06 02:22:24,916][52658] DAMAGECOUNT value on done: 298614.0 [2024-08-06 02:22:24,918][52658] Sum rewards: 77.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.110', 'AMMO4': '0.202', 'AMMO3': '0.210', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '65.000'} [2024-08-06 02:22:25,157][52647] DAMAGECOUNT value on done: 313118.0 [2024-08-06 02:22:25,157][52647] Sum rewards: 65.380, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.137', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:26,773][52794] DAMAGECOUNT value on done: 301426.0 [2024-08-06 02:22:26,774][52794] Sum rewards: 65.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.040', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.145', 'weapon2': '0.230', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.138', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:26,968][52668] DAMAGECOUNT value on done: 294654.0 [2024-08-06 02:22:26,969][52668] Sum rewards: 58.567, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.864', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.174', 'weapon2': '0.198', 'AMMO4': '0.247', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.870', 'weapon3': '3.254', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '53.000'} [2024-08-06 02:22:27,374][52669] DAMAGECOUNT value on done: 293036.0 [2024-08-06 02:22:27,375][52669] Sum rewards: 65.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.040', 'AMMO2': '0.041', 'AMMO4': '0.203', 'AMMO3': '0.211', 'weapon2': '0.240', 'WEAPON4': '0.400', 'weapon4': '0.486', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '53.000'} [2024-08-06 02:22:27,481][52671] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:22:27,504][52660] DAMAGECOUNT value on done: 301678.0 [2024-08-06 02:22:27,504][52660] Sum rewards: 54.859, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.338', 'AMMO5': '0.018', 'AMMO2': '0.069', 'AMMO3': '0.252', 'weapon2': '0.268', 'weapon5': '0.278', 'weapon4': '0.294', 'AMMO4': '0.344', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'HITCOUNT': '2.690', 'weapon3': '2.762', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '49.000'} [2024-08-06 02:22:27,602][52662] DAMAGECOUNT value on done: 296647.0 [2024-08-06 02:22:27,603][52662] Sum rewards: 69.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.348', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.173', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.500'} [2024-08-06 02:22:27,784][52658] DAMAGECOUNT value on done: 294891.0 [2024-08-06 02:22:27,785][52658] Sum rewards: 71.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.232', 'weapon2': '0.370', 'WEAPON3': '1.450', 'HITCOUNT': '3.400', 'weapon3': '3.462', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:27,794][52567] Fps is (10 sec: 18025.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 307830784. Throughput: 0: 4391.3. Samples: 76966070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:22:27,794][52567] Avg episode reward: [(0, '66.454')] [2024-08-06 02:22:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037577_307830784.pth... [2024-08-06 02:22:27,828][52647] DAMAGECOUNT value on done: 309453.0 [2024-08-06 02:22:27,828][52647] Sum rewards: 58.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.151', 'weapon2': '0.196', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.044', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037063_303620096.pth [2024-08-06 02:22:29,419][52650] Updated weights for policy 0, policy_version 37581 (0.0013) [2024-08-06 02:22:29,863][52794] DAMAGECOUNT value on done: 296259.0 [2024-08-06 02:22:29,863][52794] Sum rewards: 60.313, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.401', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.138', 'AMMO4': '0.144', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.144', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '51.500'} [2024-08-06 02:22:30,099][52669] DAMAGECOUNT value on done: 299417.0 [2024-08-06 02:22:30,099][52669] Sum rewards: 81.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.762', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.201', 'weapon2': '0.210', 'WEAPON3': '1.200', 'weapon3': '3.596', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '67.000'} [2024-08-06 02:22:30,207][52668] DAMAGECOUNT value on done: 296196.0 [2024-08-06 02:22:30,208][52668] Sum rewards: 81.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.434', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon5': '0.052', 'weapon4': '0.062', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.466', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '69.000'} [2024-08-06 02:22:30,497][52662] DAMAGECOUNT value on done: 291774.0 [2024-08-06 02:22:30,498][52662] Sum rewards: 61.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.178', 'weapon4': '0.190', 'weapon5': '0.220', 'weapon2': '0.284', 'AMMO4': '0.293', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.048', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '50.000'} [2024-08-06 02:22:30,647][52660] DAMAGECOUNT value on done: 287463.0 [2024-08-06 02:22:30,651][52660] Sum rewards: 57.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.132', 'AMMO3': '0.202', 'AMMO4': '0.212', 'WEAPON5': '0.350', 'weapon4': '0.458', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '49.000'} [2024-08-06 02:22:30,898][52647] DAMAGECOUNT value on done: 315049.0 [2024-08-06 02:22:30,898][52647] Sum rewards: 69.053, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.939', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.160', 'AMMO3': '0.278', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:31,319][52658] DAMAGECOUNT value on done: 295327.0 [2024-08-06 02:22:31,320][52658] Sum rewards: 63.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.954', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.231', 'weapon2': '0.256', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.470', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:32,637][52794] DAMAGECOUNT value on done: 302336.0 [2024-08-06 02:22:32,638][52794] Sum rewards: 66.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.583', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.078', 'weapon4': '0.092', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.322', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:32,794][52567] Fps is (10 sec: 18023.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 307920896. Throughput: 0: 4389.3. Samples: 76979070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:22:32,795][52567] Avg episode reward: [(0, '66.636')] [2024-08-06 02:22:32,866][52669] DAMAGECOUNT value on done: 294809.0 [2024-08-06 02:22:32,867][52669] Sum rewards: 61.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.684', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.192', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '53.000'} [2024-08-06 02:22:33,402][52668] DAMAGECOUNT value on done: 298101.0 [2024-08-06 02:22:33,410][52668] Sum rewards: 74.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:33,838][52660] DAMAGECOUNT value on done: 291415.0 [2024-08-06 02:22:33,840][52660] Sum rewards: 57.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.690', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.060', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.286', 'weapon4': '0.314', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.014', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '49.500'} [2024-08-06 02:22:34,011][52650] Updated weights for policy 0, policy_version 37591 (0.0028) [2024-08-06 02:22:34,026][52658] DAMAGECOUNT value on done: 295134.0 [2024-08-06 02:22:34,027][52658] Sum rewards: 69.494, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:34,121][52647] DAMAGECOUNT value on done: 311741.0 [2024-08-06 02:22:34,121][52647] Sum rewards: 75.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.128', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.207', 'weapon2': '0.210', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:35,031][52811] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:22:35,212][52794] DAMAGECOUNT value on done: 299496.0 [2024-08-06 02:22:35,213][52794] Sum rewards: 64.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.368', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.164', 'weapon4': '0.166', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:35,746][52669] DAMAGECOUNT value on done: 294226.0 [2024-08-06 02:22:35,747][52669] Sum rewards: 66.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.094', 'AMMO4': '0.144', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 02:22:36,294][52668] DAMAGECOUNT value on done: 292385.0 [2024-08-06 02:22:36,296][52668] Sum rewards: 61.057, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.185', 'weapon5': '0.186', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '49.000'} [2024-08-06 02:22:36,479][52660] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:22:36,837][52660] DAMAGECOUNT value on done: 300604.0 [2024-08-06 02:22:36,840][52660] Sum rewards: 69.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.945', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.201', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:36,932][52647] DAMAGECOUNT value on done: 306858.0 [2024-08-06 02:22:36,933][52647] Sum rewards: 60.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.634', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.220', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '52.500'} [2024-08-06 02:22:36,951][52658] DAMAGECOUNT value on done: 299992.0 [2024-08-06 02:22:36,952][52658] Sum rewards: 69.698, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.288', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO3': '0.191', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.324', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 308002816. Throughput: 0: 4391.1. Samples: 77005420. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:22:37,794][52567] Avg episode reward: [(0, '66.275')] [2024-08-06 02:22:38,036][52794] DAMAGECOUNT value on done: 295451.0 [2024-08-06 02:22:38,037][52794] Sum rewards: 67.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.118', 'weapon4': '0.188', 'AMMO3': '0.207', 'AMMO4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:38,481][52669] DAMAGECOUNT value on done: 298411.0 [2024-08-06 02:22:38,491][52669] Sum rewards: 69.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.260', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.274', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:38,818][52650] Updated weights for policy 0, policy_version 37601 (0.0019) [2024-08-06 02:22:39,270][52671] DAMAGECOUNT value on done: 300257.0 [2024-08-06 02:22:39,271][52671] Sum rewards: 78.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.337', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '64.000'} [2024-08-06 02:22:39,462][52647] DAMAGECOUNT value on done: 314115.0 [2024-08-06 02:22:39,463][52647] Sum rewards: 67.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.080', 'AMMO3': '0.210', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.278', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:39,826][52665] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2024-08-06 02:22:40,013][52658] DAMAGECOUNT value on done: 288481.0 [2024-08-06 02:22:40,015][52658] Sum rewards: 65.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.183', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.206', 'AMMO4': '0.234', 'AMMO3': '0.237', 'weapon4': '0.314', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:40,043][52660] DAMAGECOUNT value on done: 304157.0 [2024-08-06 02:22:40,043][52660] Sum rewards: 68.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.687', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.162', 'AMMO3': '0.184', 'weapon5': '0.192', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:40,991][52794] DAMAGECOUNT value on done: 298469.0 [2024-08-06 02:22:40,991][52794] Sum rewards: 70.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.626', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.213', 'weapon2': '0.372', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.440', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:41,066][52669] DAMAGECOUNT value on done: 299103.0 [2024-08-06 02:22:41,066][52669] Sum rewards: 60.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.981', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.172', 'AMMO4': '0.185', 'weapon2': '0.190', 'weapon5': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.504', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '49.000'} [2024-08-06 02:22:42,097][52671] DAMAGECOUNT value on done: 296149.0 [2024-08-06 02:22:42,097][52671] Sum rewards: 59.253, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.688', 'AMMO5': '0.013', 'AMMO2': '0.068', 'weapon5': '0.156', 'AMMO3': '0.226', 'AMMO4': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.398', 'weapon4': '0.574', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.392', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:42,166][52647] DAMAGECOUNT value on done: 308242.0 [2024-08-06 02:22:42,166][52647] Sum rewards: 92.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.705', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.252', 'weapon2': '0.386', 'WEAPON3': '1.600', 'weapon3': '3.346', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.540', 'FRAGCOUNT': '79.000'} [2024-08-06 02:22:42,471][52658] DAMAGECOUNT value on done: 303022.0 [2024-08-06 02:22:42,473][52658] Sum rewards: 76.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.316', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.114', 'weapon4': '0.148', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 308092928. Throughput: 0: 4390.2. Samples: 77031880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:22:42,795][52567] Avg episode reward: [(0, '66.649')] [2024-08-06 02:22:43,255][52660] DAMAGECOUNT value on done: 291968.0 [2024-08-06 02:22:43,255][52660] Sum rewards: 69.402, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.756', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.128', 'weapon4': '0.142', 'AMMO4': '0.158', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.226', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:43,578][52650] Updated weights for policy 0, policy_version 37611 (0.0020) [2024-08-06 02:22:43,591][52794] DAMAGECOUNT value on done: 289805.0 [2024-08-06 02:22:43,604][52794] Sum rewards: 61.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.090', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.810', 'WEAPON3': '1.500', 'weapon3': '2.736', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '53.000'} [2024-08-06 02:22:44,158][52669] DAMAGECOUNT value on done: 309429.0 [2024-08-06 02:22:44,159][52669] Sum rewards: 73.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.148', 'AMMO4': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon5': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '0.900', 'weapon3': '2.590', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:45,094][52671] DAMAGECOUNT value on done: 297641.0 [2024-08-06 02:22:45,097][52671] Sum rewards: 73.950, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.105', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.124', 'AMMO3': '0.202', 'weapon5': '0.202', 'AMMO4': '0.222', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2024-08-06 02:22:45,171][52658] DAMAGECOUNT value on done: 300246.0 [2024-08-06 02:22:45,172][52658] Sum rewards: 65.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.226', 'weapon2': '0.494', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.362', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '57.000'} [2024-08-06 02:22:45,334][52647] DAMAGECOUNT value on done: 313931.0 [2024-08-06 02:22:45,335][52647] Sum rewards: 67.213, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.980', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.182', 'weapon2': '0.240', 'AMMO4': '0.243', 'AMMO3': '0.267', 'weapon4': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:46,225][52660] DAMAGECOUNT value on done: 293214.0 [2024-08-06 02:22:46,227][52660] Sum rewards: 53.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.909', 'AMMO5': '0.008', 'AMMO2': '0.056', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.279', 'weapon4': '0.286', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '45.000'} [2024-08-06 02:22:46,509][52794] DAMAGECOUNT value on done: 304552.0 [2024-08-06 02:22:46,510][52794] Sum rewards: 75.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.084', 'weapon4': '0.110', 'weapon2': '0.204', 'AMMO4': '0.214', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.388', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 02:22:46,707][52669] DAMAGECOUNT value on done: 298948.0 [2024-08-06 02:22:46,708][52669] Sum rewards: 69.948, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO4': '0.181', 'AMMO3': '0.246', 'weapon4': '0.260', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:47,737][52671] DAMAGECOUNT value on done: 295400.0 [2024-08-06 02:22:47,738][52671] Sum rewards: 62.838, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.854', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.096', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 308183040. Throughput: 0: 4392.9. Samples: 77045070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:22:47,794][52567] Avg episode reward: [(0, '66.770')] [2024-08-06 02:22:48,046][52658] DAMAGECOUNT value on done: 305565.0 [2024-08-06 02:22:48,048][52658] Sum rewards: 72.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.273', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.118', 'weapon5': '0.168', 'AMMO3': '0.214', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:48,053][52650] Updated weights for policy 0, policy_version 37621 (0.0010) [2024-08-06 02:22:48,176][52647] DAMAGECOUNT value on done: 305956.0 [2024-08-06 02:22:48,178][52647] Sum rewards: 66.000, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.108', 'AMMO4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.682', 'WEAPON3': '0.800', 'HEALTH': '0.958', 'weapon3': '2.924', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:49,284][52660] DAMAGECOUNT value on done: 287534.0 [2024-08-06 02:22:49,285][52660] Sum rewards: 70.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.295', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.134', 'weapon5': '0.152', 'AMMO4': '0.227', 'AMMO3': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '60.000'} [2024-08-06 02:22:49,357][52794] DAMAGECOUNT value on done: 293552.0 [2024-08-06 02:22:49,357][52794] Sum rewards: 61.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.795', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.128', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.340', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '51.000'} [2024-08-06 02:22:49,902][52669] DAMAGECOUNT value on done: 301549.0 [2024-08-06 02:22:49,902][52669] Sum rewards: 67.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.597', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.112', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.194', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '59.000'} [2024-08-06 02:22:50,412][52647] DAMAGECOUNT value on done: 309315.0 [2024-08-06 02:22:50,414][52647] Sum rewards: 62.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.090', 'weapon5': '0.160', 'AMMO4': '0.165', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '3.186', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '50.000'} [2024-08-06 02:22:50,646][52671] DAMAGECOUNT value on done: 304680.0 [2024-08-06 02:22:50,648][52671] Sum rewards: 73.107, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.492', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.174', 'weapon4': '0.202', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '64.000'} [2024-08-06 02:22:50,793][52658] DAMAGECOUNT value on done: 289083.0 [2024-08-06 02:22:50,794][52658] Sum rewards: 66.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon2': '0.170', 'weapon5': '0.184', 'AMMO4': '0.195', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '54.000'} [2024-08-06 02:22:51,997][52794] DAMAGECOUNT value on done: 304381.0 [2024-08-06 02:22:51,999][52794] Sum rewards: 60.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon2': '0.164', 'weapon5': '0.164', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.188', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '51.000'} [2024-08-06 02:22:52,161][52660] DAMAGECOUNT value on done: 297954.0 [2024-08-06 02:22:52,162][52660] Sum rewards: 74.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.380', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.500'} [2024-08-06 02:22:52,695][52650] Updated weights for policy 0, policy_version 37631 (0.0018) [2024-08-06 02:22:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 308273152. Throughput: 0: 4398.0. Samples: 77071570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:22:52,794][52567] Avg episode reward: [(0, '66.596')] [2024-08-06 02:22:53,001][52669] DAMAGECOUNT value on done: 298010.0 [2024-08-06 02:22:53,002][52669] Sum rewards: 70.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.359', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.154', 'AMMO3': '0.199', 'AMMO4': '0.258', 'weapon4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '58.000'} [2024-08-06 02:22:53,405][52647] DAMAGECOUNT value on done: 309592.0 [2024-08-06 02:22:53,407][52647] Sum rewards: 65.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon5': '0.140', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'weapon4': '0.304', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.970', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '52.500'} [2024-08-06 02:22:53,582][52658] DAMAGECOUNT value on done: 296540.0 [2024-08-06 02:22:53,583][52658] Sum rewards: 67.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.643', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.154', 'AMMO4': '0.175', 'AMMO3': '0.195', 'weapon5': '0.218', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '55.000'} [2024-08-06 02:22:53,764][52671] DAMAGECOUNT value on done: 295771.0 [2024-08-06 02:22:53,767][52671] Sum rewards: 72.437, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.102', 'weapon4': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '62.000'} [2024-08-06 02:22:54,982][52660] DAMAGECOUNT value on done: 293038.0 [2024-08-06 02:22:54,982][52660] Sum rewards: 91.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.615', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.162', 'AMMO3': '0.172', 'AMMO4': '0.242', 'weapon2': '0.288', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.633', 'FRAGCOUNT': '74.000'} [2024-08-06 02:22:55,218][52794] DAMAGECOUNT value on done: 297318.0 [2024-08-06 02:22:55,218][52794] Sum rewards: 59.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.312', 'AMMO5': '0.015', 'weapon7': '0.048', 'AMMO2': '0.057', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.180', 'AMMO3': '0.185', 'WEAPON7': '0.200', 'AMMO4': '0.286', 'weapon4': '0.432', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.666', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '50.000'} [2024-08-06 02:22:55,800][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:22:55,831][52669] DAMAGECOUNT value on done: 301591.0 [2024-08-06 02:22:55,833][52669] Sum rewards: 61.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.577', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.169', 'weapon5': '0.172', 'weapon2': '0.220', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.092', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '51.000'} [2024-08-06 02:22:56,135][52658] DAMAGECOUNT value on done: 295449.0 [2024-08-06 02:22:56,135][52658] Sum rewards: 63.629, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.695', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.084', 'weapon5': '0.142', 'AMMO4': '0.247', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.650', 'weapon3': '3.154', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:56,296][52647] DAMAGECOUNT value on done: 317793.0 [2024-08-06 02:22:56,297][52647] Sum rewards: 64.430, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.860', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.260', 'weapon2': '0.298', 'WEAPON3': '1.550', 'HITCOUNT': '3.330', 'weapon3': '3.482', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.000'} [2024-08-06 02:22:56,953][52671] DAMAGECOUNT value on done: 299171.0 [2024-08-06 02:22:56,955][52671] Sum rewards: 49.519, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.862', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.151', 'weapon4': '0.190', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.400', 'HITCOUNT': '2.650', 'weapon3': '2.896', 'DAMAGECOUNT': '13.077', 'FRAGCOUNT': '45.000'} [2024-08-06 02:22:57,326][52650] Updated weights for policy 0, policy_version 37641 (0.0012) [2024-08-06 02:22:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 308363264. Throughput: 0: 4393.8. Samples: 77097830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:22:57,794][52567] Avg episode reward: [(0, '66.758')] [2024-08-06 02:22:58,130][52794] DAMAGECOUNT value on done: 299309.0 [2024-08-06 02:22:58,131][52794] Sum rewards: 62.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.114', 'AMMO4': '0.201', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '52.000'} [2024-08-06 02:22:59,008][52647] DAMAGECOUNT value on done: 311938.0 [2024-08-06 02:22:59,016][52647] Sum rewards: 74.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.484', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.132', 'weapon5': '0.200', 'weapon2': '0.218', 'AMMO4': '0.234', 'AMMO3': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '63.000'} [2024-08-06 02:22:59,047][52658] DAMAGECOUNT value on done: 291683.0 [2024-08-06 02:22:59,047][52658] Sum rewards: 76.225, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'weapon4': '0.190', 'AMMO3': '0.194', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '61.000'} [2024-08-06 02:22:59,952][52671] DAMAGECOUNT value on done: 300379.0 [2024-08-06 02:22:59,953][52671] Sum rewards: 63.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.096', 'weapon4': '0.110', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '53.000'} [2024-08-06 02:23:01,104][52794] DAMAGECOUNT value on done: 307897.0 [2024-08-06 02:23:01,105][52794] Sum rewards: 65.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.233', 'weapon2': '0.390', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.458', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '56.000'} [2024-08-06 02:23:01,703][52647] DAMAGECOUNT value on done: 309558.0 [2024-08-06 02:23:01,703][52647] Sum rewards: 84.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.975', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.212', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.508', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '69.000'} [2024-08-06 02:23:02,103][52658] DAMAGECOUNT value on done: 290938.0 [2024-08-06 02:23:02,104][52658] Sum rewards: 67.692, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.587', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.260', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.314', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '56.000'} [2024-08-06 02:23:02,337][52650] Updated weights for policy 0, policy_version 37651 (0.0014) [2024-08-06 02:23:02,625][52666] DAMAGECOUNT value on done: 299400.0 [2024-08-06 02:23:02,626][52666] Sum rewards: 44.688, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.016', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.128', 'weapon5': '0.130', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '3.060', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '40.500'} [2024-08-06 02:23:02,784][52671] DAMAGECOUNT value on done: 292195.0 [2024-08-06 02:23:02,786][52671] Sum rewards: 58.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.125', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.066', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.226', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.824', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '51.000'} [2024-08-06 02:23:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 308445184. Throughput: 0: 4395.0. Samples: 77111060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:23:02,794][52567] Avg episode reward: [(0, '66.828')] [2024-08-06 02:23:03,240][52614] Signal inference workers to stop experience collection... (6800 times) [2024-08-06 02:23:03,241][52614] Signal inference workers to resume experience collection... (6800 times) [2024-08-06 02:23:03,305][52650] InferenceWorker_p0-w0: stopping experience collection (6800 times) [2024-08-06 02:23:03,306][52650] InferenceWorker_p0-w0: resuming experience collection (6800 times) [2024-08-06 02:23:04,318][52794] DAMAGECOUNT value on done: 296842.0 [2024-08-06 02:23:04,319][52794] Sum rewards: 62.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.624', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.460', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.288', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '53.000'} [2024-08-06 02:23:04,865][52647] DAMAGECOUNT value on done: 307754.0 [2024-08-06 02:23:04,866][52647] Sum rewards: 56.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.715', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.099', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.000', 'HITCOUNT': '2.680', 'weapon3': '3.444', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '46.000'} [2024-08-06 02:23:05,023][52658] DAMAGECOUNT value on done: 302338.0 [2024-08-06 02:23:05,024][52658] Sum rewards: 54.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.226', 'AMMO3': '0.236', 'weapon4': '0.274', 'AMMO4': '0.274', 'weapon2': '0.424', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.774', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '47.000'} [2024-08-06 02:23:05,665][52666] DAMAGECOUNT value on done: 300822.0 [2024-08-06 02:23:05,665][52666] Sum rewards: 72.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO3': '0.175', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 02:23:05,851][52671] DAMAGECOUNT value on done: 301150.0 [2024-08-06 02:23:05,851][52671] Sum rewards: 58.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.860', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.145', 'weapon4': '0.150', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.236', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '49.000'} [2024-08-06 02:23:06,700][52650] Updated weights for policy 0, policy_version 37661 (0.0016) [2024-08-06 02:23:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 308535296. Throughput: 0: 4382.7. Samples: 77136980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:23:07,794][52567] Avg episode reward: [(0, '66.595')] [2024-08-06 02:23:07,915][52647] DAMAGECOUNT value on done: 302013.0 [2024-08-06 02:23:07,915][52647] Sum rewards: 73.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.713', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.074', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.296', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:08,310][52658] DAMAGECOUNT value on done: 293291.0 [2024-08-06 02:23:08,310][52658] Sum rewards: 67.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO4': '0.108', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:08,504][52666] DAMAGECOUNT value on done: 301260.0 [2024-08-06 02:23:08,506][52666] Sum rewards: 63.474, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.260', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.315', 'weapon2': '0.376', 'WEAPON3': '1.850', 'weapon3': '3.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '57.000'} [2024-08-06 02:23:08,881][52671] DAMAGECOUNT value on done: 302558.0 [2024-08-06 02:23:08,881][52671] Sum rewards: 51.766, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.834', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.108', 'weapon5': '0.152', 'AMMO4': '0.188', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.600', 'HITCOUNT': '2.880', 'weapon3': '3.098', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '46.500'} [2024-08-06 02:23:10,394][52670] DAMAGECOUNT value on done: 292195.0 [2024-08-06 02:23:10,394][52670] Sum rewards: 61.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.824', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '51.000'} [2024-08-06 02:23:10,654][52647] DAMAGECOUNT value on done: 312548.0 [2024-08-06 02:23:10,657][52647] Sum rewards: 62.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.258', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.084', 'weapon4': '0.184', 'AMMO3': '0.186', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '52.000'} [2024-08-06 02:23:11,102][52666] DAMAGECOUNT value on done: 296286.0 [2024-08-06 02:23:11,103][52666] Sum rewards: 64.210, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.333', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.130', 'weapon5': '0.132', 'AMMO4': '0.191', 'AMMO3': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '54.500'} [2024-08-06 02:23:11,257][52671] DAMAGECOUNT value on done: 297330.0 [2024-08-06 02:23:11,257][52671] Sum rewards: 66.114, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.972', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon4': '0.226', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '54.000'} [2024-08-06 02:23:11,404][52650] Updated weights for policy 0, policy_version 37671 (0.0022) [2024-08-06 02:23:11,557][52658] DAMAGECOUNT value on done: 297248.0 [2024-08-06 02:23:11,557][52658] Sum rewards: 59.774, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.211', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.158', 'weapon4': '0.164', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.289', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '3.040', 'weapon3': '3.196', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '56.000'} [2024-08-06 02:23:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 308617216. Throughput: 0: 4388.4. Samples: 77163550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:23:12,794][52567] Avg episode reward: [(0, '66.408')] [2024-08-06 02:23:13,318][52670] DAMAGECOUNT value on done: 297416.0 [2024-08-06 02:23:13,319][52670] Sum rewards: 65.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.100', 'AMMO3': '0.190', 'AMMO4': '0.264', 'weapon5': '0.316', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.758', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '54.000'} [2024-08-06 02:23:13,502][52662] Large shaping reward 2.522 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.492, 164.0)] [2024-08-06 02:23:14,109][52666] DAMAGECOUNT value on done: 292424.0 [2024-08-06 02:23:14,109][52666] Sum rewards: 63.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.376', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.064', 'weapon4': '0.106', 'AMMO4': '0.147', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.254', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 02:23:14,123][52671] DAMAGECOUNT value on done: 306485.0 [2024-08-06 02:23:14,124][52671] Sum rewards: 59.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.144', 'weapon5': '0.176', 'AMMO4': '0.179', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.900', 'WEAPON3': '1.300', 'weapon3': '2.566', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '50.000'} [2024-08-06 02:23:14,292][52658] DAMAGECOUNT value on done: 301068.0 [2024-08-06 02:23:14,293][52658] Sum rewards: 75.549, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.128', 'HEALTH': '0.158', 'AMMO3': '0.175', 'weapon2': '0.260', 'WEAPON3': '1.000', 'weapon3': '3.444', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:15,845][52670] DAMAGECOUNT value on done: 290825.0 [2024-08-06 02:23:15,853][52670] Sum rewards: 73.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.802', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.164', 'weapon5': '0.170', 'AMMO4': '0.180', 'AMMO3': '0.242', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '61.000'} [2024-08-06 02:23:16,259][52650] Updated weights for policy 0, policy_version 37681 (0.0014) [2024-08-06 02:23:16,405][52666] DAMAGECOUNT value on done: 287766.0 [2024-08-06 02:23:16,406][52666] Sum rewards: 66.359, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.432', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.220', 'weapon4': '0.246', 'AMMO3': '0.262', 'AMMO4': '0.264', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:16,894][52671] DAMAGECOUNT value on done: 296052.0 [2024-08-06 02:23:16,895][52671] Sum rewards: 85.441, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.064', 'AMMO4': '0.126', 'AMMO3': '0.194', 'weapon4': '0.204', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.688', 'WEAPON3': '1.050', 'weapon3': '3.274', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '70.000'} [2024-08-06 02:23:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17613.2, 300 sec: 17550.3). Total num frames: 308707328. Throughput: 0: 4390.0. Samples: 77176620. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:23:17,794][52567] Avg episode reward: [(0, '66.700')] [2024-08-06 02:23:18,466][52670] DAMAGECOUNT value on done: 288759.0 [2024-08-06 02:23:18,466][52670] Sum rewards: 56.912, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.850', 'AMMO5': '0.031', 'AMMO2': '0.075', 'AMMO3': '0.192', 'weapon5': '0.220', 'weapon2': '0.338', 'weapon4': '0.368', 'AMMO4': '0.376', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '52.000'} [2024-08-06 02:23:19,330][52666] DAMAGECOUNT value on done: 295430.0 [2024-08-06 02:23:19,330][52666] Sum rewards: 78.165, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.049', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.458', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '67.000'} [2024-08-06 02:23:19,593][52671] DAMAGECOUNT value on done: 288003.0 [2024-08-06 02:23:19,595][52671] Sum rewards: 66.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.521', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.148', 'weapon5': '0.204', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:20,672][52650] Updated weights for policy 0, policy_version 37691 (0.0012) [2024-08-06 02:23:21,386][52670] DAMAGECOUNT value on done: 300321.0 [2024-08-06 02:23:21,394][52670] Sum rewards: 74.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.785', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO3': '0.193', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '61.000'} [2024-08-06 02:23:22,178][52666] DAMAGECOUNT value on done: 293043.0 [2024-08-06 02:23:22,178][52666] Sum rewards: 65.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'weapon7': '0.006', 'AMMO2': '0.046', 'weapon5': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:22,601][52671] DAMAGECOUNT value on done: 301290.0 [2024-08-06 02:23:22,602][52671] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.342', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.052', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.242', 'WEAPON3': '1.600', 'weapon3': '3.444', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '60.500'} [2024-08-06 02:23:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17613.0, 300 sec: 17550.3). Total num frames: 308797440. Throughput: 0: 4392.4. Samples: 77203080. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:23:22,794][52567] Avg episode reward: [(0, '66.941')] [2024-08-06 02:23:24,234][52670] DAMAGECOUNT value on done: 294714.0 [2024-08-06 02:23:24,237][52670] Sum rewards: 65.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.402', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.053', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.226', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.442', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '56.000'} [2024-08-06 02:23:24,978][52666] DAMAGECOUNT value on done: 293664.0 [2024-08-06 02:23:24,981][52666] Sum rewards: 69.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '58.000'} [2024-08-06 02:23:25,298][52659] DAMAGECOUNT value on done: 298545.0 [2024-08-06 02:23:25,299][52659] Sum rewards: 71.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.769', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.184', 'AMMO3': '0.243', 'weapon2': '0.292', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.948', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '63.000'} [2024-08-06 02:23:25,445][52650] Updated weights for policy 0, policy_version 37701 (0.0014) [2024-08-06 02:23:25,478][52671] DAMAGECOUNT value on done: 302480.0 [2024-08-06 02:23:25,481][52671] Sum rewards: 66.105, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.927', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.206', 'AMMO4': '0.207', 'AMMO3': '0.212', 'weapon4': '0.386', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.630', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '56.500'} [2024-08-06 02:23:27,431][52670] DAMAGECOUNT value on done: 288827.0 [2024-08-06 02:23:27,431][52670] Sum rewards: 63.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.112', 'weapon2': '0.172', 'weapon4': '0.176', 'AMMO4': '0.212', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.288', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 308879360. Throughput: 0: 4390.0. Samples: 77229430. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:23:27,794][52567] Avg episode reward: [(0, '67.141')] [2024-08-06 02:23:28,126][52666] DAMAGECOUNT value on done: 291733.0 [2024-08-06 02:23:28,126][52666] Sum rewards: 70.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.089', 'weapon5': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.043', 'WEAPON5': '0.050', 'AMMO4': '0.214', 'weapon2': '0.234', 'AMMO3': '0.245', 'weapon4': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '63.000'} [2024-08-06 02:23:28,450][52659] DAMAGECOUNT value on done: 295742.0 [2024-08-06 02:23:28,453][52659] Sum rewards: 70.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.925', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.096', 'weapon5': '0.126', 'AMMO4': '0.141', 'AMMO3': '0.237', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:28,592][52671] DAMAGECOUNT value on done: 303616.0 [2024-08-06 02:23:28,601][52671] Sum rewards: 66.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.171', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.378', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:30,070][52650] Updated weights for policy 0, policy_version 37711 (0.0021) [2024-08-06 02:23:30,543][52670] DAMAGECOUNT value on done: 293169.0 [2024-08-06 02:23:30,545][52670] Sum rewards: 71.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.202', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.084', 'weapon5': '0.200', 'AMMO3': '0.229', 'AMMO4': '0.270', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.148', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '61.000'} [2024-08-06 02:23:31,321][52666] DAMAGECOUNT value on done: 290310.0 [2024-08-06 02:23:31,323][52666] Sum rewards: 65.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.072', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '56.500'} [2024-08-06 02:23:31,549][52659] DAMAGECOUNT value on done: 295544.0 [2024-08-06 02:23:31,549][52659] Sum rewards: 59.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon4': '0.204', 'AMMO3': '0.206', 'weapon5': '0.218', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '2.968', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '49.000'} [2024-08-06 02:23:31,648][52671] DAMAGECOUNT value on done: 298273.0 [2024-08-06 02:23:31,649][52671] Sum rewards: 58.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.028', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.098', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.414', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.154', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2024-08-06 02:23:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 308977664. Throughput: 0: 4391.8. Samples: 77242700. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:23:32,794][52567] Avg episode reward: [(0, '66.959')] [2024-08-06 02:23:33,212][52670] DAMAGECOUNT value on done: 292345.0 [2024-08-06 02:23:33,213][52670] Sum rewards: 76.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon5': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'weapon2': '0.462', 'WEAPON3': '1.600', 'weapon3': '2.962', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '65.000'} [2024-08-06 02:23:33,772][52666] DAMAGECOUNT value on done: 289129.0 [2024-08-06 02:23:33,773][52666] Sum rewards: 76.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.184', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '63.500'} [2024-08-06 02:23:34,604][52650] Updated weights for policy 0, policy_version 37721 (0.0012) [2024-08-06 02:23:34,625][52671] DAMAGECOUNT value on done: 295993.0 [2024-08-06 02:23:34,625][52671] Sum rewards: 71.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.176', 'weapon2': '0.242', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.372', 'WEAPON3': '1.550', 'weapon3': '2.846', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '62.000'} [2024-08-06 02:23:34,640][52659] DAMAGECOUNT value on done: 297046.0 [2024-08-06 02:23:34,640][52659] Sum rewards: 71.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.937', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 02:23:35,973][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:23:36,051][52670] DAMAGECOUNT value on done: 285820.0 [2024-08-06 02:23:36,052][52670] Sum rewards: 72.125, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.033', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:36,599][52666] DAMAGECOUNT value on done: 299421.0 [2024-08-06 02:23:36,608][52666] Sum rewards: 59.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon7': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.130', 'weapon2': '0.226', 'AMMO3': '0.263', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.370', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '53.000'} [2024-08-06 02:23:37,470][52659] DAMAGECOUNT value on done: 291961.0 [2024-08-06 02:23:37,470][52659] Sum rewards: 65.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.619', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.106', 'weapon4': '0.132', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '54.000'} [2024-08-06 02:23:37,794][52567] Fps is (10 sec: 18841.2, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 309067776. Throughput: 0: 4382.7. Samples: 77268790. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:23:37,795][52567] Avg episode reward: [(0, '67.192')] [2024-08-06 02:23:37,945][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:23:39,040][52670] DAMAGECOUNT value on done: 300691.0 [2024-08-06 02:23:39,043][52670] Sum rewards: 76.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.227', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.332', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '64.000'} [2024-08-06 02:23:39,834][52666] DAMAGECOUNT value on done: 298465.0 [2024-08-06 02:23:39,835][52666] Sum rewards: 51.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.417', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon7': '0.066', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.126', 'weapon5': '0.172', 'WEAPON7': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.550', 'weapon4': '0.624', 'WEAPON3': '1.400', 'weapon3': '2.356', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.572', 'FRAGCOUNT': '45.000'} [2024-08-06 02:23:39,883][52650] Updated weights for policy 0, policy_version 37731 (0.0022) [2024-08-06 02:23:40,170][52659] DAMAGECOUNT value on done: 296914.0 [2024-08-06 02:23:40,171][52659] Sum rewards: 81.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.098', 'AMMO4': '0.143', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '66.000'} [2024-08-06 02:23:41,954][52670] DAMAGECOUNT value on done: 295900.0 [2024-08-06 02:23:41,958][52663] DAMAGECOUNT value on done: 301501.0 [2024-08-06 02:23:41,963][52663] Sum rewards: 77.221, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.008', 'weapon5': '0.030', 'AMMO2': '0.038', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '66.000'} [2024-08-06 02:23:41,962][52670] Sum rewards: 62.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.555', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.176', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.350', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '52.000'} [2024-08-06 02:23:42,579][52666] DAMAGECOUNT value on done: 293968.0 [2024-08-06 02:23:42,580][52666] Sum rewards: 71.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.779', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.145', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '62.500'} [2024-08-06 02:23:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 309141504. Throughput: 0: 4380.9. Samples: 77294970. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:23:42,794][52567] Avg episode reward: [(0, '67.438')] [2024-08-06 02:23:43,208][52659] DAMAGECOUNT value on done: 299153.0 [2024-08-06 02:23:43,210][52659] Sum rewards: 81.409, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.086', 'AMMO4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '66.000'} [2024-08-06 02:23:43,897][52650] Updated weights for policy 0, policy_version 37741 (0.0014) [2024-08-06 02:23:43,961][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:23:44,567][52670] DAMAGECOUNT value on done: 295207.0 [2024-08-06 02:23:44,567][52670] Sum rewards: 65.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.182', 'weapon5': '0.186', 'AMMO3': '0.225', 'AMMO4': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '53.500'} [2024-08-06 02:23:44,909][52663] DAMAGECOUNT value on done: 295769.0 [2024-08-06 02:23:44,910][52663] Sum rewards: 72.185, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.626', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.160', 'AMMO3': '0.170', 'weapon5': '0.176', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:45,472][52666] DAMAGECOUNT value on done: 294698.0 [2024-08-06 02:23:45,473][52666] Sum rewards: 74.373, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.100', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'weapon4': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.267', 'weapon2': '0.362', 'WEAPON3': '1.650', 'weapon3': '3.314', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '66.000'} [2024-08-06 02:23:45,639][52659] DAMAGECOUNT value on done: 293792.0 [2024-08-06 02:23:45,641][52659] Sum rewards: 83.680, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon2': '0.192', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.582', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.865', 'FRAGCOUNT': '71.000'} [2024-08-06 02:23:47,361][52670] DAMAGECOUNT value on done: 299565.0 [2024-08-06 02:23:47,369][52670] Sum rewards: 59.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.084', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.346', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.258', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '52.500'} [2024-08-06 02:23:47,686][52663] DAMAGECOUNT value on done: 293926.0 [2024-08-06 02:23:47,686][52663] Sum rewards: 70.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '57.500'} [2024-08-06 02:23:47,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 309231616. Throughput: 0: 4378.0. Samples: 77308070. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:23:47,794][52567] Avg episode reward: [(0, '67.797')] [2024-08-06 02:23:47,881][52666] DAMAGECOUNT value on done: 292138.0 [2024-08-06 02:23:47,882][52666] Sum rewards: 72.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon4': '0.060', 'weapon5': '0.170', 'AMMO3': '0.200', 'AMMO4': '0.266', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.262', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '62.000'} [2024-08-06 02:23:48,794][52650] Updated weights for policy 0, policy_version 37751 (0.0033) [2024-08-06 02:23:48,841][52659] DAMAGECOUNT value on done: 304807.0 [2024-08-06 02:23:48,843][52659] Sum rewards: 74.428, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.716', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.161', 'weapon2': '0.196', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '63.000'} [2024-08-06 02:23:50,170][52670] DAMAGECOUNT value on done: 297390.0 [2024-08-06 02:23:50,171][52670] Sum rewards: 75.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.680', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO4': '0.135', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '63.000'} [2024-08-06 02:23:50,490][52663] DAMAGECOUNT value on done: 298177.0 [2024-08-06 02:23:50,493][52663] Sum rewards: 76.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon4': '0.218', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.348', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '64.000'} [2024-08-06 02:23:50,939][52666] DAMAGECOUNT value on done: 296513.0 [2024-08-06 02:23:50,940][52666] Sum rewards: 53.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.902', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '13.134', 'FRAGCOUNT': '46.000'} [2024-08-06 02:23:51,657][52659] DAMAGECOUNT value on done: 303061.0 [2024-08-06 02:23:51,658][52659] Sum rewards: 62.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.162', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '52.000'} [2024-08-06 02:23:51,768][52664] DAMAGECOUNT value on done: 309522.0 [2024-08-06 02:23:51,769][52664] Sum rewards: 71.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.334', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.130', 'weapon4': '0.154', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.136', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '62.000'} [2024-08-06 02:23:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 309321728. Throughput: 0: 4381.8. Samples: 77334160. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:23:52,795][52567] Avg episode reward: [(0, '67.518')] [2024-08-06 02:23:53,304][52795] DAMAGECOUNT value on done: 278701.0 [2024-08-06 02:23:53,306][52795] Sum rewards: 60.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon5': '0.164', 'AMMO3': '0.215', 'weapon4': '0.286', 'AMMO4': '0.307', 'weapon2': '0.456', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '52.000'} [2024-08-06 02:23:53,330][52670] DAMAGECOUNT value on done: 282382.0 [2024-08-06 02:23:53,330][52670] Sum rewards: 71.459, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.340', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.156', 'weapon5': '0.180', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '57.000'} [2024-08-06 02:23:53,567][52663] DAMAGECOUNT value on done: 296615.0 [2024-08-06 02:23:53,567][52663] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.088', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.138', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.298', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.090', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:53,962][52650] Updated weights for policy 0, policy_version 37761 (0.0017) [2024-08-06 02:23:54,118][52666] DAMAGECOUNT value on done: 288800.0 [2024-08-06 02:23:54,119][52666] Sum rewards: 67.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.018', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.202', 'weapon2': '0.386', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.296', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '57.000'} [2024-08-06 02:23:54,433][52659] DAMAGECOUNT value on done: 298116.0 [2024-08-06 02:23:54,433][52659] Sum rewards: 69.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.169', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.238', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:54,596][52664] DAMAGECOUNT value on done: 309391.0 [2024-08-06 02:23:54,598][52664] Sum rewards: 72.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.070', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '60.000'} [2024-08-06 02:23:56,463][52795] DAMAGECOUNT value on done: 270500.0 [2024-08-06 02:23:56,463][52795] Sum rewards: 61.287, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.590', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.056', 'weapon4': '0.102', 'AMMO3': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '0.750', 'HITCOUNT': '3.020', 'weapon3': '3.116', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '47.000'} [2024-08-06 02:23:56,470][52670] DAMAGECOUNT value on done: 296433.0 [2024-08-06 02:23:56,470][52670] Sum rewards: 64.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.134', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.210', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.146', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '53.000'} [2024-08-06 02:23:56,793][52663] DAMAGECOUNT value on done: 300994.0 [2024-08-06 02:23:56,793][52663] Sum rewards: 63.389, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.109', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.482', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '56.000'} [2024-08-06 02:23:57,033][52659] DAMAGECOUNT value on done: 299668.0 [2024-08-06 02:23:57,033][52659] Sum rewards: 78.725, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.358', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.172', 'weapon2': '0.196', 'AMMO4': '0.239', 'weapon4': '0.250', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 02:23:57,114][52666] DAMAGECOUNT value on done: 296860.0 [2024-08-06 02:23:57,116][52666] Sum rewards: 66.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.907', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO3': '0.152', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:57,514][52664] DAMAGECOUNT value on done: 310929.0 [2024-08-06 02:23:57,514][52664] Sum rewards: 69.749, reward structure: {'DEATHCOUNT': '-15.000', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.172', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'weapon4': '0.392', 'HEALTH': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '57.000'} [2024-08-06 02:23:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 309411840. Throughput: 0: 4373.3. Samples: 77360350. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:23:57,802][52567] Avg episode reward: [(0, '67.611')] [2024-08-06 02:23:57,941][52650] Updated weights for policy 0, policy_version 37771 (0.0011) [2024-08-06 02:23:59,119][52670] DAMAGECOUNT value on done: 303425.0 [2024-08-06 02:23:59,120][52670] Sum rewards: 73.732, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.758', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '63.000'} [2024-08-06 02:23:59,540][52663] DAMAGECOUNT value on done: 297267.0 [2024-08-06 02:23:59,541][52663] Sum rewards: 66.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.128', 'weapon5': '0.174', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.204', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '55.000'} [2024-08-06 02:23:59,688][52659] DAMAGECOUNT value on done: 289938.0 [2024-08-06 02:23:59,690][52659] Sum rewards: 69.312, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.069', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '57.000'} [2024-08-06 02:23:59,767][52795] DAMAGECOUNT value on done: 272098.0 [2024-08-06 02:23:59,770][52795] Sum rewards: 66.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.896', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'AMMO4': '0.202', 'weapon2': '0.512', 'weapon4': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.544', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:00,353][52664] DAMAGECOUNT value on done: 306959.0 [2024-08-06 02:24:00,354][52664] Sum rewards: 66.176, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.131', 'weapon4': '0.134', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'WEAPON3': '0.900', 'weapon2': '0.914', 'weapon3': '2.660', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:02,491][52670] DAMAGECOUNT value on done: 295219.0 [2024-08-06 02:24:02,491][52670] Sum rewards: 70.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon4': '0.208', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '57.000'} [2024-08-06 02:24:02,535][52663] DAMAGECOUNT value on done: 295637.0 [2024-08-06 02:24:02,536][52663] Sum rewards: 68.574, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.776', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.154', 'AMMO4': '0.210', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:02,678][52803] DAMAGECOUNT value on done: 278651.0 [2024-08-06 02:24:02,679][52803] Sum rewards: 79.504, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.240', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.136', 'weapon4': '0.168', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '68.000'} [2024-08-06 02:24:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 309493760. Throughput: 0: 4372.2. Samples: 77373370. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:24:02,802][52567] Avg episode reward: [(0, '67.520')] [2024-08-06 02:24:02,820][52664] DAMAGECOUNT value on done: 308872.0 [2024-08-06 02:24:02,822][52664] Sum rewards: 65.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.148', 'AMMO3': '0.189', 'weapon4': '0.248', 'AMMO4': '0.303', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:02,888][52795] DAMAGECOUNT value on done: 273050.0 [2024-08-06 02:24:02,889][52795] Sum rewards: 68.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO3': '0.181', 'AMMO4': '0.256', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:03,032][52659] DAMAGECOUNT value on done: 298760.0 [2024-08-06 02:24:03,032][52659] Sum rewards: 71.273, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.122', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon2': '0.320', 'AMMO3': '0.339', 'WEAPON3': '2.000', 'weapon3': '3.304', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '63.000'} [2024-08-06 02:24:03,037][52650] Updated weights for policy 0, policy_version 37781 (0.0032) [2024-08-06 02:24:04,948][52670] DAMAGECOUNT value on done: 296599.0 [2024-08-06 02:24:04,948][52670] Sum rewards: 71.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.028', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.100', 'AMMO4': '0.175', 'weapon2': '0.208', 'AMMO3': '0.224', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '61.000'} [2024-08-06 02:24:05,513][52663] DAMAGECOUNT value on done: 295710.0 [2024-08-06 02:24:05,514][52663] Sum rewards: 68.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'weapon5': '0.030', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.234', 'weapon2': '0.244', 'WEAPON3': '1.400', 'HITCOUNT': '3.420', 'weapon3': '3.468', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '59.000'} [2024-08-06 02:24:05,730][52803] DAMAGECOUNT value on done: 277813.0 [2024-08-06 02:24:05,731][52803] Sum rewards: 72.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.138', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.258', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.412', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 02:24:05,852][52811] DAMAGECOUNT value on done: 287005.0 [2024-08-06 02:24:05,855][52811] Sum rewards: 62.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.178', 'AMMO4': '0.194', 'AMMO3': '0.195', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.722', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '54.000'} [2024-08-06 02:24:05,859][52659] DAMAGECOUNT value on done: 303890.0 [2024-08-06 02:24:05,861][52659] Sum rewards: 75.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.799', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.187', 'weapon4': '0.204', 'AMMO4': '0.256', 'weapon5': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:05,873][52664] DAMAGECOUNT value on done: 309985.0 [2024-08-06 02:24:05,875][52664] Sum rewards: 78.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.138', 'AMMO3': '0.196', 'weapon5': '0.230', 'AMMO4': '0.252', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '66.000'} [2024-08-06 02:24:05,950][52795] DAMAGECOUNT value on done: 277864.0 [2024-08-06 02:24:05,951][52795] Sum rewards: 66.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO4': '0.122', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 309575680. Throughput: 0: 4372.9. Samples: 77399860. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:24:07,802][52567] Avg episode reward: [(0, '68.112')] [2024-08-06 02:24:07,878][52614] Saving new best policy, reward=68.112! [2024-08-06 02:24:07,879][52650] Updated weights for policy 0, policy_version 37791 (0.0034) [2024-08-06 02:24:07,987][52663] DAMAGECOUNT value on done: 298163.0 [2024-08-06 02:24:07,987][52663] Sum rewards: 58.021, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.095', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.106', 'AMMO3': '0.176', 'weapon4': '0.200', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '3.192', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '49.500'} [2024-08-06 02:24:08,367][52664] DAMAGECOUNT value on done: 311907.0 [2024-08-06 02:24:08,369][52664] Sum rewards: 61.811, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.646', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'weapon2': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.202', 'weapon4': '0.202', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.390', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:08,829][52803] DAMAGECOUNT value on done: 278412.0 [2024-08-06 02:24:08,830][52803] Sum rewards: 61.550, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.170', 'AMMO3': '0.189', 'AMMO4': '0.246', 'weapon2': '0.326', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '50.000'} [2024-08-06 02:24:09,042][52659] DAMAGECOUNT value on done: 307292.0 [2024-08-06 02:24:09,043][52659] Sum rewards: 70.206, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.995', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.496', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.188', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '56.500'} [2024-08-06 02:24:09,049][52811] DAMAGECOUNT value on done: 275416.0 [2024-08-06 02:24:09,050][52811] Sum rewards: 65.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.708', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.220', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:09,183][52795] DAMAGECOUNT value on done: 276209.0 [2024-08-06 02:24:09,184][52795] Sum rewards: 60.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.926', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO4': '0.243', 'weapon2': '0.246', 'weapon5': '0.250', 'AMMO3': '0.276', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.882', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '54.000'} [2024-08-06 02:24:09,434][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:24:10,611][52663] DAMAGECOUNT value on done: 299534.0 [2024-08-06 02:24:10,611][52663] Sum rewards: 62.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon5': '0.176', 'AMMO3': '0.196', 'weapon4': '0.240', 'AMMO4': '0.297', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:10,698][52664] DAMAGECOUNT value on done: 302343.0 [2024-08-06 02:24:10,700][52664] Sum rewards: 68.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.160', 'AMMO3': '0.205', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:11,981][52659] DAMAGECOUNT value on done: 301067.0 [2024-08-06 02:24:11,982][52659] Sum rewards: 64.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.695', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.160', 'weapon2': '0.188', 'AMMO4': '0.201', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.356', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:12,041][52803] DAMAGECOUNT value on done: 279949.0 [2024-08-06 02:24:12,042][52803] Sum rewards: 70.747, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon2': '0.892', 'WEAPON3': '0.950', 'weapon3': '2.912', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:12,238][52811] DAMAGECOUNT value on done: 280153.0 [2024-08-06 02:24:12,239][52811] Sum rewards: 77.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO3': '0.145', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.616', 'WEAPON3': '0.950', 'weapon3': '2.914', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:12,295][52650] Updated weights for policy 0, policy_version 37801 (0.0054) [2024-08-06 02:24:12,357][52795] DAMAGECOUNT value on done: 280705.0 [2024-08-06 02:24:12,358][52795] Sum rewards: 72.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.213', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:12,796][52567] Fps is (10 sec: 17200.0, 60 sec: 17475.7, 300 sec: 17522.4). Total num frames: 309665792. Throughput: 0: 4360.5. Samples: 77425660. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:24:12,796][52567] Avg episode reward: [(0, '68.410')] [2024-08-06 02:24:12,835][52614] Saving new best policy, reward=68.410! [2024-08-06 02:24:13,242][52664] DAMAGECOUNT value on done: 315118.0 [2024-08-06 02:24:13,243][52664] Sum rewards: 51.569, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.268', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.158', 'AMMO3': '0.244', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '2.828', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '47.000'} [2024-08-06 02:24:13,476][52663] DAMAGECOUNT value on done: 296952.0 [2024-08-06 02:24:13,476][52663] Sum rewards: 68.797, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.455', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.175', 'AMMO4': '0.181', 'weapon5': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:14,705][52659] DAMAGECOUNT value on done: 297554.0 [2024-08-06 02:24:14,706][52659] Sum rewards: 73.567, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.140', 'weapon4': '0.182', 'AMMO4': '0.234', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '65.000'} [2024-08-06 02:24:15,163][52803] DAMAGECOUNT value on done: 282290.0 [2024-08-06 02:24:15,166][52803] Sum rewards: 61.803, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.105', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon2': '0.142', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.700', 'weapon3': '3.086', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:15,326][52811] DAMAGECOUNT value on done: 276993.0 [2024-08-06 02:24:15,326][52811] Sum rewards: 72.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.310', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.066', 'WEAPON4': '0.150', 'weapon2': '0.270', 'AMMO3': '0.302', 'WEAPON3': '1.900', 'weapon3': '3.406', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '64.000'} [2024-08-06 02:24:15,463][52795] DAMAGECOUNT value on done: 278082.0 [2024-08-06 02:24:15,465][52795] Sum rewards: 69.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.088', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.140', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'weapon2': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:15,973][52664] DAMAGECOUNT value on done: 306795.0 [2024-08-06 02:24:15,974][52664] Sum rewards: 58.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.042', 'AMMO4': '0.104', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.808', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '50.000'} [2024-08-06 02:24:16,425][52663] DAMAGECOUNT value on done: 289992.0 [2024-08-06 02:24:16,427][52663] Sum rewards: 62.347, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.236', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.106', 'weapon2': '0.218', 'AMMO4': '0.224', 'AMMO3': '0.242', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.094', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '54.000'} [2024-08-06 02:24:17,183][52650] Updated weights for policy 0, policy_version 37811 (0.0011) [2024-08-06 02:24:17,676][52659] DAMAGECOUNT value on done: 301047.0 [2024-08-06 02:24:17,677][52659] Sum rewards: 59.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.326', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.074', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.230', 'weapon4': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '51.000'} [2024-08-06 02:24:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 309755904. Throughput: 0: 4350.0. Samples: 77438450. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:24:17,794][52567] Avg episode reward: [(0, '68.660')] [2024-08-06 02:24:17,881][52614] Saving new best policy, reward=68.660! [2024-08-06 02:24:18,125][52803] DAMAGECOUNT value on done: 276777.0 [2024-08-06 02:24:18,125][52803] Sum rewards: 71.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:18,377][52811] DAMAGECOUNT value on done: 280536.0 [2024-08-06 02:24:18,377][52811] Sum rewards: 78.111, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.925', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.068', 'weapon4': '0.106', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.718', 'FRAGCOUNT': '65.000'} [2024-08-06 02:24:18,732][52795] DAMAGECOUNT value on done: 270287.0 [2024-08-06 02:24:18,732][52795] Sum rewards: 51.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.228', 'weapon5': '0.246', 'weapon4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '2.786', 'DAMAGECOUNT': '13.149', 'FRAGCOUNT': '46.000'} [2024-08-06 02:24:19,143][52664] DAMAGECOUNT value on done: 311358.0 [2024-08-06 02:24:19,143][52664] Sum rewards: 58.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.142', 'AMMO4': '0.201', 'AMMO3': '0.208', 'weapon2': '0.228', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '51.000'} [2024-08-06 02:24:19,425][52663] DAMAGECOUNT value on done: 293374.0 [2024-08-06 02:24:19,426][52663] Sum rewards: 56.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '49.000'} [2024-08-06 02:24:20,742][52659] DAMAGECOUNT value on done: 301610.0 [2024-08-06 02:24:20,742][52659] Sum rewards: 67.122, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.395', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.133', 'AMMO4': '0.140', 'weapon5': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.510', 'WEAPON3': '0.800', 'weapon3': '2.728', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:20,757][52820] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:24:21,277][52803] DAMAGECOUNT value on done: 274941.0 [2024-08-06 02:24:21,279][52803] Sum rewards: 65.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.080', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.308', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.294', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:21,413][52811] DAMAGECOUNT value on done: 285278.0 [2024-08-06 02:24:21,415][52811] Sum rewards: 80.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.685', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.097', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.234', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '66.000'} [2024-08-06 02:24:21,764][52664] DAMAGECOUNT value on done: 309704.0 [2024-08-06 02:24:21,764][52664] Sum rewards: 76.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.531', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '65.000'} [2024-08-06 02:24:21,823][52795] DAMAGECOUNT value on done: 281443.0 [2024-08-06 02:24:21,825][52795] Sum rewards: 72.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.443', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.038', 'AMMO4': '0.128', 'weapon5': '0.144', 'AMMO3': '0.215', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.352', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:22,090][52650] Updated weights for policy 0, policy_version 37821 (0.0024) [2024-08-06 02:24:22,214][52663] DAMAGECOUNT value on done: 294540.0 [2024-08-06 02:24:22,215][52663] Sum rewards: 50.708, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.772', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO4': '0.237', 'weapon5': '0.254', 'AMMO3': '0.261', 'weapon4': '0.266', 'weapon2': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.690', 'weapon3': '2.878', 'DAMAGECOUNT': '13.656', 'FRAGCOUNT': '45.000'} [2024-08-06 02:24:22,794][52567] Fps is (10 sec: 17206.4, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 309837824. Throughput: 0: 4350.0. Samples: 77464540. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:24:22,794][52567] Avg episode reward: [(0, '68.145')] [2024-08-06 02:24:24,241][52803] DAMAGECOUNT value on done: 275183.0 [2024-08-06 02:24:24,241][52803] Sum rewards: 64.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.064', 'weapon4': '0.106', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '57.000'} [2024-08-06 02:24:24,548][52664] DAMAGECOUNT value on done: 315777.0 [2024-08-06 02:24:24,549][52664] Sum rewards: 77.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.152', 'weapon4': '0.198', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '65.000'} [2024-08-06 02:24:24,896][52811] DAMAGECOUNT value on done: 278817.0 [2024-08-06 02:24:24,898][52811] Sum rewards: 72.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.088', 'AMMO3': '0.184', 'AMMO4': '0.220', 'weapon2': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.144', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:25,022][52795] DAMAGECOUNT value on done: 274545.0 [2024-08-06 02:24:25,023][52795] Sum rewards: 51.349, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.260', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.278', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '3.136', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '47.000'} [2024-08-06 02:24:25,485][52663] DAMAGECOUNT value on done: 302991.0 [2024-08-06 02:24:25,486][52663] Sum rewards: 65.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.145', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:26,531][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:24:26,589][52650] Updated weights for policy 0, policy_version 37831 (0.0027) [2024-08-06 02:24:26,941][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:24:27,376][52664] DAMAGECOUNT value on done: 309047.0 [2024-08-06 02:24:27,377][52664] Sum rewards: 68.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.170', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.230', 'AMMO3': '0.257', 'weapon2': '0.346', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:27,460][52803] DAMAGECOUNT value on done: 279713.0 [2024-08-06 02:24:27,463][52803] Sum rewards: 76.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.058', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '64.000'} [2024-08-06 02:24:27,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 309927936. Throughput: 0: 4350.2. Samples: 77490730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:24:27,795][52567] Avg episode reward: [(0, '68.140')] [2024-08-06 02:24:27,880][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037834_309936128.pth... [2024-08-06 02:24:28,010][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037320_305725440.pth [2024-08-06 02:24:28,111][52811] DAMAGECOUNT value on done: 278045.0 [2024-08-06 02:24:28,113][52811] Sum rewards: 67.485, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.551', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'weapon2': '0.464', 'WEAPON3': '0.900', 'HITCOUNT': '3.180', 'weapon3': '3.332', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:28,226][52795] DAMAGECOUNT value on done: 272588.0 [2024-08-06 02:24:28,226][52795] Sum rewards: 62.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.177', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON4': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '2.638', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:28,609][52663] DAMAGECOUNT value on done: 296972.0 [2024-08-06 02:24:28,609][52663] Sum rewards: 67.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.590', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.082', 'weapon5': '0.188', 'AMMO3': '0.275', 'AMMO4': '0.276', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.062', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '59.000'} [2024-08-06 02:24:29,460][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:24:30,296][52664] DAMAGECOUNT value on done: 315388.0 [2024-08-06 02:24:30,296][52664] Sum rewards: 77.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.645', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:30,440][52803] DAMAGECOUNT value on done: 274135.0 [2024-08-06 02:24:30,442][52803] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.642', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.384', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:31,236][52811] DAMAGECOUNT value on done: 288680.0 [2024-08-06 02:24:31,239][52811] Sum rewards: 74.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.042', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:31,310][52650] Updated weights for policy 0, policy_version 37841 (0.0014) [2024-08-06 02:24:31,445][52795] DAMAGECOUNT value on done: 269575.0 [2024-08-06 02:24:31,448][52795] Sum rewards: 73.731, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.254', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon2': '0.228', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '61.000'} [2024-08-06 02:24:31,508][52663] DAMAGECOUNT value on done: 303573.0 [2024-08-06 02:24:31,509][52663] Sum rewards: 65.667, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.830', 'AMMO5': '0.006', 'weapon5': '0.022', 'AMMO2': '0.029', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.244', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '57.000'} [2024-08-06 02:24:32,489][52665] DAMAGECOUNT value on done: 292180.0 [2024-08-06 02:24:32,490][52665] Sum rewards: 65.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.630', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.163', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '2.654', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '51.000'} [2024-08-06 02:24:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 310018048. Throughput: 0: 4347.1. Samples: 77503690. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:24:32,794][52567] Avg episode reward: [(0, '68.146')] [2024-08-06 02:24:33,348][52664] DAMAGECOUNT value on done: 305408.0 [2024-08-06 02:24:33,348][52664] Sum rewards: 77.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.143', 'weapon5': '0.160', 'AMMO4': '0.180', 'weapon4': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon2': '1.128', 'weapon3': '2.242', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 02:24:33,524][52803] DAMAGECOUNT value on done: 283575.0 [2024-08-06 02:24:33,524][52803] Sum rewards: 60.245, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.116', 'weapon4': '0.126', 'AMMO4': '0.149', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.302', 'weapon2': '0.358', 'WEAPON3': '1.700', 'weapon3': '3.130', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:34,219][52811] DAMAGECOUNT value on done: 278362.0 [2024-08-06 02:24:34,220][52811] Sum rewards: 53.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.052', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.164', 'AMMO3': '0.233', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.952', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '44.500'} [2024-08-06 02:24:34,365][52663] DAMAGECOUNT value on done: 301130.0 [2024-08-06 02:24:34,365][52663] Sum rewards: 75.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.382', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:34,561][52795] DAMAGECOUNT value on done: 278418.0 [2024-08-06 02:24:34,561][52795] Sum rewards: 64.768, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.394', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.108', 'AMMO4': '0.121', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'HITCOUNT': '3.210', 'weapon3': '3.364', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '57.000'} [2024-08-06 02:24:35,027][52665] DAMAGECOUNT value on done: 298822.0 [2024-08-06 02:24:35,028][52665] Sum rewards: 75.893, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.879', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.168', 'AMMO4': '0.170', 'AMMO3': '0.211', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:35,474][52649] DAMAGECOUNT value on done: 288867.0 [2024-08-06 02:24:35,475][52649] Sum rewards: 58.993, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.155', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.550', 'weapon3': '2.736', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:36,073][52650] Updated weights for policy 0, policy_version 37851 (0.0022) [2024-08-06 02:24:36,438][52664] DAMAGECOUNT value on done: 310203.0 [2024-08-06 02:24:36,438][52664] Sum rewards: 71.748, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'HEALTH': '0.144', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:36,697][52803] DAMAGECOUNT value on done: 280296.0 [2024-08-06 02:24:36,698][52803] Sum rewards: 66.923, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.143', 'weapon5': '0.184', 'AMMO3': '0.238', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:37,352][52811] DAMAGECOUNT value on done: 280253.0 [2024-08-06 02:24:37,354][52811] Sum rewards: 70.304, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.653', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.258', 'weapon2': '0.280', 'WEAPON4': '0.300', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '63.000'} [2024-08-06 02:24:37,470][52665] DAMAGECOUNT value on done: 295792.0 [2024-08-06 02:24:37,471][52665] Sum rewards: 61.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.102', 'weapon2': '0.206', 'AMMO4': '0.217', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.428', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:37,624][52795] DAMAGECOUNT value on done: 268579.0 [2024-08-06 02:24:37,625][52795] Sum rewards: 70.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.941', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon2': '0.162', 'AMMO3': '0.187', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.640', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:37,742][52663] DAMAGECOUNT value on done: 292353.0 [2024-08-06 02:24:37,743][52663] Sum rewards: 68.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.208', 'weapon2': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.370', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '59.000'} [2024-08-06 02:24:37,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17339.8, 300 sec: 17550.3). Total num frames: 310108160. Throughput: 0: 4356.2. Samples: 77530190. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:24:37,794][52567] Avg episode reward: [(0, '67.823')] [2024-08-06 02:24:38,111][52649] DAMAGECOUNT value on done: 284907.0 [2024-08-06 02:24:38,113][52649] Sum rewards: 76.245, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.914', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.196', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '61.000'} [2024-08-06 02:24:38,825][52667] DAMAGECOUNT value on done: 298135.0 [2024-08-06 02:24:38,825][52667] Sum rewards: 55.876, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.252', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.114', 'weapon5': '0.130', 'AMMO4': '0.155', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.600', 'HITCOUNT': '2.670', 'weapon3': '3.128', 'DAMAGECOUNT': '14.097', 'FRAGCOUNT': '50.000'} [2024-08-06 02:24:38,903][52664] DAMAGECOUNT value on done: 312235.0 [2024-08-06 02:24:38,903][52664] Sum rewards: 74.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.946', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.118', 'AMMO4': '0.195', 'AMMO3': '0.205', 'weapon4': '0.216', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '61.000'} [2024-08-06 02:24:39,890][52803] DAMAGECOUNT value on done: 276719.0 [2024-08-06 02:24:39,891][52803] Sum rewards: 66.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.322', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.082', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.178', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '54.000'} [2024-08-06 02:24:40,486][52650] Updated weights for policy 0, policy_version 37861 (0.0020) [2024-08-06 02:24:40,496][52811] DAMAGECOUNT value on done: 284642.0 [2024-08-06 02:24:40,498][52811] Sum rewards: 74.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.072', 'AMMO4': '0.184', 'weapon5': '0.186', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.150', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '63.000'} [2024-08-06 02:24:40,641][52665] DAMAGECOUNT value on done: 293611.0 [2024-08-06 02:24:40,642][52665] Sum rewards: 82.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.006', 'AMMO2': '0.047', 'weapon5': '0.068', 'AMMO3': '0.172', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '69.000'} [2024-08-06 02:24:40,806][52795] DAMAGECOUNT value on done: 285000.0 [2024-08-06 02:24:40,810][52795] Sum rewards: 65.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.714', 'AMMO5': '0.012', 'AMMO2': '0.064', 'AMMO3': '0.198', 'weapon5': '0.226', 'AMMO4': '0.317', 'weapon2': '0.346', 'weapon4': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:41,266][52649] DAMAGECOUNT value on done: 291754.0 [2024-08-06 02:24:41,266][52649] Sum rewards: 64.730, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.298', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.114', 'AMMO4': '0.158', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.319', 'weapon2': '0.340', 'WEAPON3': '1.850', 'weapon3': '2.994', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:41,513][52667] DAMAGECOUNT value on done: 303085.0 [2024-08-06 02:24:41,514][52667] Sum rewards: 73.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.351', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.179', 'weapon4': '0.320', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:41,584][52664] DAMAGECOUNT value on done: 311672.0 [2024-08-06 02:24:41,585][52664] Sum rewards: 73.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.521', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.064', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '60.500'} [2024-08-06 02:24:41,652][52658] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:24:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 310190080. Throughput: 0: 4357.6. Samples: 77556440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:24:42,794][52567] Avg episode reward: [(0, '67.996')] [2024-08-06 02:24:42,999][52803] DAMAGECOUNT value on done: 283959.0 [2024-08-06 02:24:43,001][52803] Sum rewards: 64.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.155', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.134', 'weapon4': '0.142', 'weapon2': '0.186', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.870', 'weapon3': '3.268', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:43,725][52811] DAMAGECOUNT value on done: 279393.0 [2024-08-06 02:24:43,725][52811] Sum rewards: 69.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.839', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO4': '0.179', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '57.000'} [2024-08-06 02:24:43,734][52665] DAMAGECOUNT value on done: 290310.0 [2024-08-06 02:24:43,734][52665] Sum rewards: 67.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.749', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.346', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '2.846', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:43,924][52795] DAMAGECOUNT value on done: 279345.0 [2024-08-06 02:24:43,924][52795] Sum rewards: 51.658, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.274', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.209', 'weapon5': '0.220', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.330', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '2.838', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '44.500'} [2024-08-06 02:24:43,940][52667] DAMAGECOUNT value on done: 298914.0 [2024-08-06 02:24:43,941][52667] Sum rewards: 53.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.117', 'weapon4': '0.120', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.710', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.882', 'DAMAGECOUNT': '12.339', 'FRAGCOUNT': '45.000'} [2024-08-06 02:24:44,439][52649] DAMAGECOUNT value on done: 291254.0 [2024-08-06 02:24:44,440][52649] Sum rewards: 59.774, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.940', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.122', 'weapon5': '0.128', 'AMMO4': '0.152', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.024', 'DAMAGECOUNT': '14.085', 'FRAGCOUNT': '49.500'} [2024-08-06 02:24:44,645][52664] DAMAGECOUNT value on done: 310717.0 [2024-08-06 02:24:44,645][52664] Sum rewards: 73.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.118', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.262', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:45,009][52662] DAMAGECOUNT value on done: 306771.0 [2024-08-06 02:24:45,011][52662] Sum rewards: 65.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.102', 'AMMO3': '0.215', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '54.000'} [2024-08-06 02:24:45,243][52650] Updated weights for policy 0, policy_version 37871 (0.0039) [2024-08-06 02:24:46,116][52803] DAMAGECOUNT value on done: 276765.0 [2024-08-06 02:24:46,116][52803] Sum rewards: 59.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.030', 'weapon4': '0.058', 'AMMO4': '0.136', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.932', 'WEAPON3': '1.000', 'weapon3': '2.796', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '51.000'} [2024-08-06 02:24:46,468][52667] DAMAGECOUNT value on done: 301228.0 [2024-08-06 02:24:46,469][52667] Sum rewards: 80.573, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.100', 'AMMO4': '0.205', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.848', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.697', 'FRAGCOUNT': '67.000'} [2024-08-06 02:24:46,777][52665] DAMAGECOUNT value on done: 288706.0 [2024-08-06 02:24:46,785][52665] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.580', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.150', 'weapon4': '0.210', 'AMMO3': '0.211', 'AMMO4': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:46,826][52811] DAMAGECOUNT value on done: 282809.0 [2024-08-06 02:24:46,826][52811] Sum rewards: 63.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.986', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.238', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:46,933][52795] DAMAGECOUNT value on done: 269235.0 [2024-08-06 02:24:46,933][52795] Sum rewards: 66.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.882', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.129', 'weapon4': '0.156', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:47,452][52649] DAMAGECOUNT value on done: 282133.0 [2024-08-06 02:24:47,454][52649] Sum rewards: 54.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.708', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.112', 'AMMO4': '0.129', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '45.000'} [2024-08-06 02:24:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 310280192. Throughput: 0: 4364.4. Samples: 77569770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:24:47,794][52567] Avg episode reward: [(0, '67.344')] [2024-08-06 02:24:48,014][52662] DAMAGECOUNT value on done: 306265.0 [2024-08-06 02:24:48,014][52662] Sum rewards: 68.969, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.618', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'AMMO4': '0.197', 'weapon2': '0.224', 'weapon4': '0.264', 'AMMO3': '0.297', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.244', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '61.000'} [2024-08-06 02:24:49,295][52803] DAMAGECOUNT value on done: 276917.0 [2024-08-06 02:24:49,295][52803] Sum rewards: 65.104, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.142', 'weapon4': '0.158', 'AMMO4': '0.170', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:49,444][52667] DAMAGECOUNT value on done: 303707.0 [2024-08-06 02:24:49,446][52667] Sum rewards: 56.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.285', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.172', 'weapon4': '0.192', 'AMMO3': '0.199', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '47.000'} [2024-08-06 02:24:49,711][52650] Updated weights for policy 0, policy_version 37881 (0.0010) [2024-08-06 02:24:49,872][52665] DAMAGECOUNT value on done: 297413.0 [2024-08-06 02:24:49,872][52665] Sum rewards: 62.476, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.800', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.107', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:49,955][52811] DAMAGECOUNT value on done: 282701.0 [2024-08-06 02:24:49,956][52811] Sum rewards: 75.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.864', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.119', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '63.000'} [2024-08-06 02:24:49,983][52795] DAMAGECOUNT value on done: 279725.0 [2024-08-06 02:24:49,983][52795] Sum rewards: 72.404, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.175', 'HEALTH': '0.210', 'weapon2': '0.256', 'WEAPON3': '1.000', 'weapon3': '3.330', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '58.000'} [2024-08-06 02:24:50,541][52649] DAMAGECOUNT value on done: 294633.0 [2024-08-06 02:24:50,544][52649] Sum rewards: 68.544, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.042', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.650', 'weapon3': '2.662', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '60.000'} [2024-08-06 02:24:50,665][52820] DAMAGECOUNT value on done: 272364.0 [2024-08-06 02:24:50,666][52820] Sum rewards: 58.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.717', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.208', 'AMMO3': '0.210', 'AMMO4': '0.215', 'weapon4': '0.354', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '48.000'} [2024-08-06 02:24:51,229][52662] DAMAGECOUNT value on done: 303943.0 [2024-08-06 02:24:51,230][52662] Sum rewards: 51.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.815', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO4': '0.222', 'weapon2': '0.242', 'AMMO3': '0.243', 'weapon5': '0.248', 'weapon4': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '2.934', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '44.500'} [2024-08-06 02:24:51,732][52667] DAMAGECOUNT value on done: 302531.0 [2024-08-06 02:24:51,733][52667] Sum rewards: 72.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.873', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.138', 'AMMO3': '0.195', 'AMMO4': '0.267', 'weapon2': '0.326', 'WEAPON5': '0.350', 'weapon4': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '61.000'} [2024-08-06 02:24:52,376][52668] DAMAGECOUNT value on done: 297054.0 [2024-08-06 02:24:52,387][52668] Sum rewards: 59.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.232', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.106', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '50.000'} [2024-08-06 02:24:52,389][52803] DAMAGECOUNT value on done: 284915.0 [2024-08-06 02:24:52,390][52803] Sum rewards: 76.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.096', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '63.000'} [2024-08-06 02:24:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 310370304. Throughput: 0: 4359.1. Samples: 77596020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:24:52,794][52567] Avg episode reward: [(0, '66.787')] [2024-08-06 02:24:53,018][52665] DAMAGECOUNT value on done: 298157.0 [2024-08-06 02:24:53,021][52665] Sum rewards: 77.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.582', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '64.000'} [2024-08-06 02:24:53,053][52811] DAMAGECOUNT value on done: 275711.0 [2024-08-06 02:24:53,054][52811] Sum rewards: 77.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.472', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.098', 'AMMO4': '0.099', 'AMMO3': '0.181', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.430', 'weapon3': '3.482', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:53,146][52795] DAMAGECOUNT value on done: 282974.0 [2024-08-06 02:24:53,147][52795] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.122', 'weapon5': '0.170', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '58.500'} [2024-08-06 02:24:53,558][52649] DAMAGECOUNT value on done: 290454.0 [2024-08-06 02:24:53,560][52649] Sum rewards: 68.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.098', 'weapon5': '0.146', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.264', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.204', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.000'} [2024-08-06 02:24:53,935][52820] DAMAGECOUNT value on done: 277020.0 [2024-08-06 02:24:53,936][52820] Sum rewards: 67.514, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.332', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.144', 'weapon4': '0.240', 'weapon2': '0.836', 'WEAPON3': '0.950', 'weapon3': '2.846', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '54.000'} [2024-08-06 02:24:54,638][52662] DAMAGECOUNT value on done: 295881.0 [2024-08-06 02:24:54,647][52662] Sum rewards: 57.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.456', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.808', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '47.000'} [2024-08-06 02:24:54,702][52650] Updated weights for policy 0, policy_version 37891 (0.0026) [2024-08-06 02:24:54,743][52667] DAMAGECOUNT value on done: 304995.0 [2024-08-06 02:24:54,745][52667] Sum rewards: 65.624, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.060', 'weapon5': '0.090', 'AMMO4': '0.104', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.784', 'WEAPON3': '0.950', 'weapon3': '2.886', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:55,523][52803] DAMAGECOUNT value on done: 277609.0 [2024-08-06 02:24:55,526][52803] Sum rewards: 68.673, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.166', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '58.500'} [2024-08-06 02:24:55,552][52668] DAMAGECOUNT value on done: 303221.0 [2024-08-06 02:24:55,552][52668] Sum rewards: 66.016, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.568', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.298', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '56.000'} [2024-08-06 02:24:55,636][52665] DAMAGECOUNT value on done: 297061.0 [2024-08-06 02:24:55,638][52665] Sum rewards: 75.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.968', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon5': '0.208', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '63.000'} [2024-08-06 02:24:56,113][52649] DAMAGECOUNT value on done: 295756.0 [2024-08-06 02:24:56,114][52649] Sum rewards: 58.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.724', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon5': '0.226', 'AMMO3': '0.264', 'weapon4': '0.270', 'AMMO4': '0.289', 'weapon2': '0.300', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.882', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '52.000'} [2024-08-06 02:24:56,221][52811] DAMAGECOUNT value on done: 280744.0 [2024-08-06 02:24:56,222][52811] Sum rewards: 73.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.160', 'AMMO3': '0.235', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '62.000'} [2024-08-06 02:24:57,130][52820] DAMAGECOUNT value on done: 275707.0 [2024-08-06 02:24:57,135][52820] Sum rewards: 55.917, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.650', 'AMMO5': '0.024', 'AMMO2': '0.063', 'AMMO3': '0.149', 'weapon2': '0.158', 'weapon5': '0.208', 'AMMO4': '0.315', 'weapon4': '0.338', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '3.058', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '45.500'} [2024-08-06 02:24:57,626][52662] DAMAGECOUNT value on done: 304398.0 [2024-08-06 02:24:57,636][52662] Sum rewards: 60.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.046', 'AMMO5': '0.021', 'AMMO2': '0.069', 'weapon5': '0.160', 'AMMO3': '0.251', 'weapon2': '0.258', 'weapon4': '0.310', 'AMMO4': '0.346', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.952', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '53.000'} [2024-08-06 02:24:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 310452224. Throughput: 0: 4364.8. Samples: 77622070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:24:57,795][52567] Avg episode reward: [(0, '66.912')] [2024-08-06 02:24:57,925][52667] DAMAGECOUNT value on done: 298939.0 [2024-08-06 02:24:57,925][52667] Sum rewards: 79.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.116', 'AMMO4': '0.150', 'AMMO3': '0.200', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '65.000'} [2024-08-06 02:24:58,361][52668] DAMAGECOUNT value on done: 303793.0 [2024-08-06 02:24:58,362][52668] Sum rewards: 65.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.377', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.207', 'weapon5': '0.222', 'AMMO4': '0.246', 'weapon2': '0.266', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '56.500'} [2024-08-06 02:24:58,518][52665] DAMAGECOUNT value on done: 294964.0 [2024-08-06 02:24:58,518][52665] Sum rewards: 64.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.905', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.022', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.212', 'AMMO3': '0.243', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.504', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:58,731][52803] DAMAGECOUNT value on done: 283641.0 [2024-08-06 02:24:58,733][52803] Sum rewards: 63.873, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.264', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '55.000'} [2024-08-06 02:24:59,220][52649] DAMAGECOUNT value on done: 292128.0 [2024-08-06 02:24:59,222][52649] Sum rewards: 63.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.859', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.114', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.232', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.786', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '54.500'} [2024-08-06 02:24:59,270][52811] DAMAGECOUNT value on done: 282593.0 [2024-08-06 02:24:59,272][52811] Sum rewards: 72.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '61.000'} [2024-08-06 02:24:59,274][52650] Updated weights for policy 0, policy_version 37901 (0.0042) [2024-08-06 02:25:00,170][52662] DAMAGECOUNT value on done: 295109.0 [2024-08-06 02:25:00,172][52662] Sum rewards: 68.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.146', 'AMMO3': '0.207', 'AMMO4': '0.210', 'weapon2': '0.264', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:00,249][52667] DAMAGECOUNT value on done: 300261.0 [2024-08-06 02:25:00,251][52667] Sum rewards: 72.731, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.185', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.248', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.560', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:00,475][52820] DAMAGECOUNT value on done: 271730.0 [2024-08-06 02:25:00,475][52820] Sum rewards: 74.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.246', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:01,495][52668] DAMAGECOUNT value on done: 305229.0 [2024-08-06 02:25:01,495][52668] Sum rewards: 55.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.166', 'weapon5': '0.224', 'weapon2': '0.228', 'AMMO4': '0.245', 'WEAPON5': '0.450', 'weapon4': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '44.000'} [2024-08-06 02:25:01,499][52665] DAMAGECOUNT value on done: 302254.0 [2024-08-06 02:25:01,499][52665] Sum rewards: 74.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.362', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.180', 'AMMO3': '0.196', 'AMMO4': '0.239', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.704', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:01,899][52803] DAMAGECOUNT value on done: 273142.0 [2024-08-06 02:25:01,900][52803] Sum rewards: 61.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.838', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.132', 'weapon2': '0.178', 'AMMO3': '0.200', 'AMMO4': '0.263', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.218', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '51.000'} [2024-08-06 02:25:02,298][52649] DAMAGECOUNT value on done: 292557.0 [2024-08-06 02:25:02,300][52649] Sum rewards: 62.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.709', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.182', 'weapon2': '0.286', 'AMMO4': '0.324', 'weapon5': '0.370', 'weapon4': '0.476', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.526', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:02,355][52811] DAMAGECOUNT value on done: 277864.0 [2024-08-06 02:25:02,356][52811] Sum rewards: 64.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.850', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.218', 'weapon4': '0.278', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.134', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 310542336. Throughput: 0: 4371.1. Samples: 77635150. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:25:02,794][52567] Avg episode reward: [(0, '67.242')] [2024-08-06 02:25:03,008][52667] DAMAGECOUNT value on done: 305646.0 [2024-08-06 02:25:03,008][52667] Sum rewards: 71.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.074', 'AMMO4': '0.167', 'weapon5': '0.218', 'AMMO3': '0.286', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.144', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:03,076][52662] DAMAGECOUNT value on done: 305723.0 [2024-08-06 02:25:03,078][52662] Sum rewards: 62.178, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.148', 'AMMO4': '0.208', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 02:25:03,746][52820] DAMAGECOUNT value on done: 278255.0 [2024-08-06 02:25:03,746][52820] Sum rewards: 58.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon5': '0.134', 'AMMO3': '0.159', 'weapon4': '0.206', 'AMMO4': '0.312', 'WEAPON5': '0.450', 'weapon2': '0.552', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.746', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:04,061][52650] Updated weights for policy 0, policy_version 37911 (0.0019) [2024-08-06 02:25:04,559][52665] DAMAGECOUNT value on done: 298431.0 [2024-08-06 02:25:04,561][52665] Sum rewards: 64.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.670', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.104', 'AMMO4': '0.168', 'weapon5': '0.266', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.870', 'weapon3': '3.006', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:04,571][52614] Signal inference workers to stop experience collection... (6850 times) [2024-08-06 02:25:04,572][52614] Signal inference workers to resume experience collection... (6850 times) [2024-08-06 02:25:04,615][52650] InferenceWorker_p0-w0: stopping experience collection (6850 times) [2024-08-06 02:25:04,623][52650] InferenceWorker_p0-w0: resuming experience collection (6850 times) [2024-08-06 02:25:04,618][52668] DAMAGECOUNT value on done: 294220.0 [2024-08-06 02:25:04,624][52668] Sum rewards: 70.910, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.088', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO4': '0.233', 'weapon2': '0.464', 'WEAPON3': '0.900', 'weapon3': '3.126', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:05,308][52649] DAMAGECOUNT value on done: 293361.0 [2024-08-06 02:25:05,310][52649] Sum rewards: 59.869, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.834', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.146', 'AMMO4': '0.190', 'weapon5': '0.224', 'weapon2': '0.238', 'AMMO3': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.630', 'weapon3': '3.088', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '53.000'} [2024-08-06 02:25:05,546][52811] DAMAGECOUNT value on done: 285036.0 [2024-08-06 02:25:05,547][52811] Sum rewards: 76.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.993', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon2': '0.264', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.448', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '66.000'} [2024-08-06 02:25:05,758][52662] DAMAGECOUNT value on done: 310106.0 [2024-08-06 02:25:05,759][52662] Sum rewards: 69.477, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.168', 'AMMO4': '0.193', 'weapon2': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon4': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '60.500'} [2024-08-06 02:25:05,864][52667] DAMAGECOUNT value on done: 298916.0 [2024-08-06 02:25:05,864][52667] Sum rewards: 54.933, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.062', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.284', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '47.500'} [2024-08-06 02:25:06,809][52820] DAMAGECOUNT value on done: 272261.0 [2024-08-06 02:25:06,809][52820] Sum rewards: 64.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.082', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.122', 'weapon4': '0.152', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:07,202][52665] DAMAGECOUNT value on done: 297230.0 [2024-08-06 02:25:07,205][52665] Sum rewards: 58.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.724', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.080', 'AMMO4': '0.097', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.120', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:07,795][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 310632448. Throughput: 0: 4377.7. Samples: 77661540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:25:07,795][52567] Avg episode reward: [(0, '67.002')] [2024-08-06 02:25:07,835][52668] DAMAGECOUNT value on done: 304010.0 [2024-08-06 02:25:07,835][52668] Sum rewards: 71.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.258', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.456', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:08,097][52649] DAMAGECOUNT value on done: 293741.0 [2024-08-06 02:25:08,098][52649] Sum rewards: 71.025, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.642', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.106', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.229', 'WEAPON3': '1.300', 'HITCOUNT': '3.390', 'weapon3': '3.410', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:08,137][52662] DAMAGECOUNT value on done: 301461.0 [2024-08-06 02:25:08,137][52662] Sum rewards: 75.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.330', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.140', 'AMMO4': '0.147', 'weapon5': '0.166', 'AMMO3': '0.219', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.150', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '63.000'} [2024-08-06 02:25:08,536][52650] Updated weights for policy 0, policy_version 37921 (0.0027) [2024-08-06 02:25:08,994][52667] DAMAGECOUNT value on done: 302304.0 [2024-08-06 02:25:08,997][52667] Sum rewards: 70.789, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.669', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '58.500'} [2024-08-06 02:25:09,699][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:25:09,869][52665] DAMAGECOUNT value on done: 297101.0 [2024-08-06 02:25:09,870][52665] Sum rewards: 67.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.894', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.114', 'AMMO4': '0.208', 'weapon5': '0.214', 'AMMO3': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:10,074][52820] DAMAGECOUNT value on done: 273930.0 [2024-08-06 02:25:10,074][52820] Sum rewards: 52.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.020', 'weapon7': '0.048', 'AMMO2': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.178', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon4': '1.018', 'weapon3': '2.190', 'HITCOUNT': '2.310', 'DAMAGECOUNT': '12.336', 'FRAGCOUNT': '44.000'} [2024-08-06 02:25:10,102][52665] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:25:10,517][52662] DAMAGECOUNT value on done: 311936.0 [2024-08-06 02:25:10,519][52662] Sum rewards: 66.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.578', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.078', 'AMMO4': '0.112', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.674', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:10,608][52649] DAMAGECOUNT value on done: 295657.0 [2024-08-06 02:25:10,608][52649] Sum rewards: 78.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.082', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'weapon4': '0.212', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '3.064', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:10,842][52668] DAMAGECOUNT value on done: 300803.0 [2024-08-06 02:25:10,845][52668] Sum rewards: 61.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.129', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.058', 'weapon4': '0.086', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.538', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.098', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '53.000'} [2024-08-06 02:25:11,593][52660] DAMAGECOUNT value on done: 296167.0 [2024-08-06 02:25:11,595][52660] Sum rewards: 64.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.578', 'AMMO5': '0.022', 'AMMO2': '0.083', 'weapon4': '0.218', 'AMMO3': '0.221', 'weapon5': '0.382', 'weapon2': '0.398', 'AMMO4': '0.413', 'WEAPON5': '0.650', 'WEAPON4': '0.850', 'WEAPON3': '1.350', 'weapon3': '2.634', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.500'} [2024-08-06 02:25:11,697][52669] DAMAGECOUNT value on done: 304015.0 [2024-08-06 02:25:11,697][52669] Sum rewards: 76.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.883', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '63.000'} [2024-08-06 02:25:12,491][52665] DAMAGECOUNT value on done: 296513.0 [2024-08-06 02:25:12,491][52665] Sum rewards: 74.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.200', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.142', 'AMMO3': '0.155', 'AMMO4': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.422', 'weapon4': '0.514', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.646', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:12,735][52667] DAMAGECOUNT value on done: 300323.0 [2024-08-06 02:25:12,736][52667] Sum rewards: 74.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.827', 'AMMO5': '0.014', 'AMMO2': '0.034', 'ARMOR': '0.036', 'weapon5': '0.126', 'AMMO4': '0.169', 'AMMO3': '0.178', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.4, 300 sec: 17550.3). Total num frames: 310722560. Throughput: 0: 4380.3. Samples: 77687840. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:25:12,794][52567] Avg episode reward: [(0, '66.926')] [2024-08-06 02:25:12,952][52662] DAMAGECOUNT value on done: 298661.0 [2024-08-06 02:25:12,960][52662] Sum rewards: 72.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.195', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:13,291][52650] Updated weights for policy 0, policy_version 37931 (0.0029) [2024-08-06 02:25:13,321][52668] DAMAGECOUNT value on done: 297114.0 [2024-08-06 02:25:13,321][52668] Sum rewards: 66.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.052', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.324', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:13,339][52820] DAMAGECOUNT value on done: 279447.0 [2024-08-06 02:25:13,339][52820] Sum rewards: 71.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.499', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.093', 'weapon2': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.398', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:13,400][52649] DAMAGECOUNT value on done: 297113.0 [2024-08-06 02:25:13,400][52649] Sum rewards: 62.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.134', 'weapon2': '0.148', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.166', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '52.000'} [2024-08-06 02:25:14,232][52660] DAMAGECOUNT value on done: 293507.0 [2024-08-06 02:25:14,234][52660] Sum rewards: 70.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.197', 'weapon2': '0.732', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:14,725][52669] DAMAGECOUNT value on done: 296662.0 [2024-08-06 02:25:14,725][52669] Sum rewards: 55.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.098', 'AMMO5': '0.011', 'AMMO2': '0.061', 'weapon5': '0.146', 'weapon4': '0.156', 'AMMO3': '0.233', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '47.000'} [2024-08-06 02:25:15,492][52665] DAMAGECOUNT value on done: 293688.0 [2024-08-06 02:25:15,495][52665] Sum rewards: 78.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.588', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '65.000'} [2024-08-06 02:25:15,496][52667] DAMAGECOUNT value on done: 297300.0 [2024-08-06 02:25:15,499][52667] Sum rewards: 59.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.442', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.121', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.162', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '51.000'} [2024-08-06 02:25:15,711][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:25:15,965][52662] DAMAGECOUNT value on done: 299226.0 [2024-08-06 02:25:15,967][52662] Sum rewards: 56.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.187', 'weapon5': '0.224', 'AMMO4': '0.243', 'weapon2': '0.418', 'weapon4': '0.418', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '47.000'} [2024-08-06 02:25:16,099][52668] DAMAGECOUNT value on done: 301450.0 [2024-08-06 02:25:16,099][52668] Sum rewards: 74.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.548', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:16,501][52649] DAMAGECOUNT value on done: 287655.0 [2024-08-06 02:25:16,502][52649] Sum rewards: 72.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.048', 'weapon4': '0.054', 'AMMO3': '0.154', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '0.950', 'weapon3': '3.482', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:16,631][52820] DAMAGECOUNT value on done: 276415.0 [2024-08-06 02:25:16,631][52820] Sum rewards: 60.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.557', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.158', 'WEAPON7': '0.200', 'weapon4': '0.244', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '2.690', 'weapon3': '2.894', 'DAMAGECOUNT': '12.927', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:16,834][52647] DAMAGECOUNT value on done: 317104.0 [2024-08-06 02:25:16,836][52647] Sum rewards: 76.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '63.000'} [2024-08-06 02:25:17,190][52660] DAMAGECOUNT value on done: 303161.0 [2024-08-06 02:25:17,192][52660] Sum rewards: 70.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.107', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.155', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:17,609][52669] DAMAGECOUNT value on done: 302414.0 [2024-08-06 02:25:17,611][52669] Sum rewards: 66.940, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon7': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.117', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.428', 'weapon2': '0.588', 'WEAPON3': '0.800', 'weapon3': '2.708', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '52.000'} [2024-08-06 02:25:17,795][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 310804480. Throughput: 0: 4389.7. Samples: 77701230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:25:17,795][52567] Avg episode reward: [(0, '67.047')] [2024-08-06 02:25:17,802][52650] Updated weights for policy 0, policy_version 37941 (0.0011) [2024-08-06 02:25:18,167][52667] DAMAGECOUNT value on done: 305441.0 [2024-08-06 02:25:18,175][52667] Sum rewards: 71.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.220', 'weapon2': '0.360', 'WEAPON3': '1.000', 'weapon3': '3.296', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:18,184][52794] DAMAGECOUNT value on done: 302309.0 [2024-08-06 02:25:18,185][52794] Sum rewards: 71.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.974', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.086', 'weapon5': '0.146', 'AMMO4': '0.159', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:18,547][52665] DAMAGECOUNT value on done: 293897.0 [2024-08-06 02:25:18,547][52665] Sum rewards: 72.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.646', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon2': '0.124', 'weapon5': '0.126', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.400', 'weapon3': '3.476', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:18,691][52662] DAMAGECOUNT value on done: 303785.0 [2024-08-06 02:25:18,691][52662] Sum rewards: 74.055, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.354', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.070', 'weapon4': '0.102', 'AMMO4': '0.172', 'weapon2': '0.226', 'WEAPON5': '0.300', 'AMMO3': '0.317', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.346', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '67.000'} [2024-08-06 02:25:19,246][52668] DAMAGECOUNT value on done: 300051.0 [2024-08-06 02:25:19,247][52668] Sum rewards: 59.054, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.174', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.304', 'AMMO3': '0.307', 'WEAPON3': '1.750', 'weapon3': '3.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '53.000'} [2024-08-06 02:25:19,348][52647] DAMAGECOUNT value on done: 316814.0 [2024-08-06 02:25:19,349][52647] Sum rewards: 69.832, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.432', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.088', 'weapon4': '0.106', 'AMMO4': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:19,636][52649] DAMAGECOUNT value on done: 293537.0 [2024-08-06 02:25:19,638][52649] Sum rewards: 60.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.537', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.190', 'weapon5': '0.222', 'AMMO3': '0.243', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '51.000'} [2024-08-06 02:25:19,870][52820] DAMAGECOUNT value on done: 279505.0 [2024-08-06 02:25:19,873][52820] Sum rewards: 68.205, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.244', 'weapon4': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:20,085][52660] DAMAGECOUNT value on done: 302338.0 [2024-08-06 02:25:20,086][52660] Sum rewards: 72.045, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.170', 'weapon4': '0.186', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.016', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '63.000'} [2024-08-06 02:25:20,447][52669] DAMAGECOUNT value on done: 298476.0 [2024-08-06 02:25:20,450][52669] Sum rewards: 63.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.142', 'weapon4': '0.178', 'weapon2': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.240', 'weapon3': '3.246', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:20,892][52667] DAMAGECOUNT value on done: 309036.0 [2024-08-06 02:25:20,892][52667] Sum rewards: 75.993, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.336', 'WEAPON3': '1.000', 'HEALTH': '1.131', 'weapon3': '3.492', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:21,324][52794] DAMAGECOUNT value on done: 306597.0 [2024-08-06 02:25:21,325][52794] Sum rewards: 73.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.504', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.168', 'weapon2': '0.206', 'AMMO3': '0.211', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:21,526][52665] DAMAGECOUNT value on done: 293586.0 [2024-08-06 02:25:21,526][52665] Sum rewards: 65.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.048', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO4': '0.166', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:21,759][52668] DAMAGECOUNT value on done: 304195.0 [2024-08-06 02:25:21,760][52668] Sum rewards: 65.421, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.512', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.068', 'weapon4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.364', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:21,831][52662] DAMAGECOUNT value on done: 308864.0 [2024-08-06 02:25:21,831][52662] Sum rewards: 71.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:22,015][52647] DAMAGECOUNT value on done: 316470.0 [2024-08-06 02:25:22,019][52647] Sum rewards: 68.746, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.276', 'WEAPON4': '0.300', 'AMMO3': '0.308', 'weapon2': '0.336', 'WEAPON3': '1.800', 'weapon3': '2.994', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:22,482][52650] Updated weights for policy 0, policy_version 37951 (0.0020) [2024-08-06 02:25:22,487][52649] DAMAGECOUNT value on done: 291651.0 [2024-08-06 02:25:22,487][52649] Sum rewards: 57.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.155', 'weapon5': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '2.858', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '48.000'} [2024-08-06 02:25:22,650][52660] DAMAGECOUNT value on done: 299656.0 [2024-08-06 02:25:22,654][52660] Sum rewards: 67.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.710', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 310894592. Throughput: 0: 4386.7. Samples: 77727590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:25:22,794][52567] Avg episode reward: [(0, '67.198')] [2024-08-06 02:25:22,943][52671] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:25:23,047][52820] DAMAGECOUNT value on done: 279090.0 [2024-08-06 02:25:23,047][52820] Sum rewards: 60.714, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.076', 'AMMO4': '0.084', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '51.500'} [2024-08-06 02:25:23,258][52669] DAMAGECOUNT value on done: 296365.0 [2024-08-06 02:25:23,268][52669] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.160', 'AMMO5': '0.016', 'AMMO2': '0.059', 'AMMO3': '0.127', 'weapon5': '0.210', 'AMMO4': '0.293', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.582', 'WEAPON3': '0.700', 'weapon3': '2.646', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '52.000'} [2024-08-06 02:25:23,529][52667] DAMAGECOUNT value on done: 303578.0 [2024-08-06 02:25:23,529][52667] Sum rewards: 59.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.028', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.210', 'weapon4': '0.228', 'AMMO3': '0.231', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '49.500'} [2024-08-06 02:25:23,905][52665] DAMAGECOUNT value on done: 296387.0 [2024-08-06 02:25:23,905][52665] Sum rewards: 70.194, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.156', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO3': '0.136', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '0.850', 'weapon3': '3.166', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 02:25:24,312][52794] DAMAGECOUNT value on done: 300479.0 [2024-08-06 02:25:24,313][52794] Sum rewards: 61.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.114', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.138', 'AMMO3': '0.204', 'AMMO4': '0.259', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:24,822][52662] DAMAGECOUNT value on done: 302222.0 [2024-08-06 02:25:24,822][52662] Sum rewards: 79.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.994', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.094', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.328', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 02:25:24,872][52668] DAMAGECOUNT value on done: 296775.0 [2024-08-06 02:25:24,873][52668] Sum rewards: 55.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.189', 'weapon5': '0.236', 'AMMO4': '0.261', 'weapon4': '0.388', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.590', 'weapon3': '2.630', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '48.000'} [2024-08-06 02:25:24,922][52649] DAMAGECOUNT value on done: 296001.0 [2024-08-06 02:25:24,922][52649] Sum rewards: 74.753, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.152', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon2': '0.514', 'WEAPON3': '1.700', 'weapon3': '2.806', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '64.000'} [2024-08-06 02:25:25,086][52647] DAMAGECOUNT value on done: 318783.0 [2024-08-06 02:25:25,087][52647] Sum rewards: 69.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.146', 'weapon4': '0.154', 'AMMO4': '0.174', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:25,836][52660] DAMAGECOUNT value on done: 294452.0 [2024-08-06 02:25:25,838][52660] Sum rewards: 66.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO3': '0.200', 'AMMO4': '0.213', 'weapon2': '0.234', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:26,028][52669] DAMAGECOUNT value on done: 301090.0 [2024-08-06 02:25:26,028][52669] Sum rewards: 63.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.529', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.102', 'AMMO3': '0.154', 'weapon4': '0.246', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.960', 'weapon3': '2.978', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '54.000'} [2024-08-06 02:25:26,298][52820] DAMAGECOUNT value on done: 280207.0 [2024-08-06 02:25:26,298][52820] Sum rewards: 75.172, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.707', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.084', 'AMMO4': '0.109', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:26,465][52665] DAMAGECOUNT value on done: 296542.0 [2024-08-06 02:25:26,466][52665] Sum rewards: 70.565, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.858', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.074', 'AMMO4': '0.126', 'weapon4': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.304', 'WEAPON3': '1.750', 'HITCOUNT': '3.290', 'weapon3': '3.296', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '63.000'} [2024-08-06 02:25:26,873][52667] DAMAGECOUNT value on done: 307433.0 [2024-08-06 02:25:26,874][52667] Sum rewards: 68.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.008', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.046', 'AMMO4': '0.147', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.242', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:27,050][52794] DAMAGECOUNT value on done: 300730.0 [2024-08-06 02:25:27,050][52794] Sum rewards: 53.691, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.047', 'AMMO5': '0.015', 'AMMO2': '0.070', 'weapon5': '0.146', 'AMMO3': '0.239', 'weapon2': '0.308', 'AMMO4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.480', 'weapon3': '2.816', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '49.000'} [2024-08-06 02:25:27,058][52650] Updated weights for policy 0, policy_version 37961 (0.0023) [2024-08-06 02:25:27,530][52662] DAMAGECOUNT value on done: 314681.0 [2024-08-06 02:25:27,532][52662] Sum rewards: 68.324, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.030', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'weapon5': '0.086', 'AMMO3': '0.165', 'weapon2': '0.446', 'WEAPON3': '0.950', 'weapon3': '3.286', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '54.000'} [2024-08-06 02:25:27,716][52649] DAMAGECOUNT value on done: 298040.0 [2024-08-06 02:25:27,716][52649] Sum rewards: 83.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.044', 'weapon5': '0.124', 'AMMO4': '0.136', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '68.000'} [2024-08-06 02:25:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 310976512. Throughput: 0: 4391.8. Samples: 77754070. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:25:27,795][52567] Avg episode reward: [(0, '67.351')] [2024-08-06 02:25:28,046][52668] DAMAGECOUNT value on done: 290934.0 [2024-08-06 02:25:28,048][52668] Sum rewards: 60.839, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.621', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.074', 'weapon4': '0.104', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '54.500'} [2024-08-06 02:25:28,126][52658] DAMAGECOUNT value on done: 300729.0 [2024-08-06 02:25:28,127][52658] Sum rewards: 52.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '3.162', 'DAMAGECOUNT': '13.704', 'FRAGCOUNT': '46.000'} [2024-08-06 02:25:28,209][52647] DAMAGECOUNT value on done: 315097.0 [2024-08-06 02:25:28,209][52647] Sum rewards: 64.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.928', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.204', 'AMMO4': '0.235', 'weapon4': '0.274', 'weapon5': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.592', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '53.000'} [2024-08-06 02:25:28,375][52669] DAMAGECOUNT value on done: 302739.0 [2024-08-06 02:25:28,385][52669] Sum rewards: 76.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.025', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.180', 'weapon2': '0.294', 'WEAPON3': '1.000', 'weapon3': '3.242', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:29,022][52660] DAMAGECOUNT value on done: 301758.0 [2024-08-06 02:25:29,024][52660] Sum rewards: 68.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.143', 'weapon5': '0.166', 'AMMO4': '0.241', 'weapon2': '0.312', 'weapon4': '0.352', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.898', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:29,081][52668] Large shaping reward 3.501 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:25:29,275][52820] DAMAGECOUNT value on done: 280253.0 [2024-08-06 02:25:29,276][52820] Sum rewards: 60.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.430', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '2.724', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '53.000'} [2024-08-06 02:25:29,900][52794] DAMAGECOUNT value on done: 298489.0 [2024-08-06 02:25:29,901][52794] Sum rewards: 63.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.104', 'weapon2': '0.186', 'AMMO4': '0.219', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:30,115][52667] DAMAGECOUNT value on done: 298157.0 [2024-08-06 02:25:30,115][52667] Sum rewards: 68.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.409', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon2': '0.180', 'AMMO3': '0.230', 'WEAPON3': '1.500', 'HITCOUNT': '3.570', 'weapon3': '3.634', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:30,268][52662] DAMAGECOUNT value on done: 304090.0 [2024-08-06 02:25:30,279][52662] Sum rewards: 73.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.878', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.193', 'weapon4': '0.246', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:30,834][52668] DAMAGECOUNT value on done: 292576.0 [2024-08-06 02:25:30,835][52668] Sum rewards: 59.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.132', 'AMMO3': '0.193', 'weapon4': '0.212', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:30,969][52647] DAMAGECOUNT value on done: 320247.0 [2024-08-06 02:25:30,969][52647] Sum rewards: 67.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.162', 'weapon2': '0.208', 'WEAPON3': '1.050', 'HITCOUNT': '3.240', 'weapon3': '3.356', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:31,004][52669] DAMAGECOUNT value on done: 302184.0 [2024-08-06 02:25:31,005][52669] Sum rewards: 53.862, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.430', 'AMMO5': '0.013', 'AMMO2': '0.073', 'weapon5': '0.152', 'AMMO3': '0.233', 'weapon4': '0.320', 'weapon2': '0.342', 'WEAPON5': '0.350', 'AMMO4': '0.366', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.934', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '13.938', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:31,061][52649] DAMAGECOUNT value on done: 297471.0 [2024-08-06 02:25:31,061][52649] Sum rewards: 52.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.132', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '44.000'} [2024-08-06 02:25:31,224][52658] DAMAGECOUNT value on done: 300703.0 [2024-08-06 02:25:31,224][52658] Sum rewards: 60.937, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.072', 'AMMO4': '0.148', 'weapon4': '0.150', 'weapon2': '0.170', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.446', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '52.000'} [2024-08-06 02:25:31,848][52650] Updated weights for policy 0, policy_version 37971 (0.0012) [2024-08-06 02:25:31,915][52660] DAMAGECOUNT value on done: 305845.0 [2024-08-06 02:25:31,917][52660] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.057', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.188', 'weapon5': '0.194', 'weapon2': '0.288', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:32,420][52820] DAMAGECOUNT value on done: 279904.0 [2024-08-06 02:25:32,422][52820] Sum rewards: 72.739, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.136', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.168', 'AMMO3': '0.210', 'AMMO4': '0.223', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:32,652][52794] DAMAGECOUNT value on done: 303130.0 [2024-08-06 02:25:32,653][52794] Sum rewards: 73.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.076', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.104', 'weapon2': '0.176', 'AMMO4': '0.193', 'weapon5': '0.206', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '63.000'} [2024-08-06 02:25:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 311074816. Throughput: 0: 4387.6. Samples: 77767210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:25:32,794][52567] Avg episode reward: [(0, '67.169')] [2024-08-06 02:25:32,944][52667] DAMAGECOUNT value on done: 304015.0 [2024-08-06 02:25:32,944][52667] Sum rewards: 72.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:32,956][52662] DAMAGECOUNT value on done: 304843.0 [2024-08-06 02:25:32,959][52662] Sum rewards: 70.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.886', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.242', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:33,635][52669] DAMAGECOUNT value on done: 300524.0 [2024-08-06 02:25:33,643][52669] Sum rewards: 60.850, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.626', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.142', 'AMMO3': '0.312', 'WEAPON3': '1.850', 'HITCOUNT': '3.290', 'weapon3': '3.558', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:33,954][52658] DAMAGECOUNT value on done: 304540.0 [2024-08-06 02:25:33,954][52658] Sum rewards: 67.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.784', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:33,981][52668] DAMAGECOUNT value on done: 293167.0 [2024-08-06 02:25:33,983][52668] Sum rewards: 50.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.039', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.157', 'AMMO3': '0.167', 'weapon5': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '41.500'} [2024-08-06 02:25:34,042][52647] DAMAGECOUNT value on done: 316671.0 [2024-08-06 02:25:34,043][52647] Sum rewards: 55.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.553', 'AMMO5': '0.025', 'AMMO2': '0.081', 'AMMO3': '0.200', 'weapon4': '0.208', 'weapon5': '0.348', 'weapon2': '0.378', 'AMMO4': '0.407', 'WEAPON5': '0.750', 'WEAPON4': '0.850', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.752', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '48.000'} [2024-08-06 02:25:35,126][52660] DAMAGECOUNT value on done: 303708.0 [2024-08-06 02:25:35,130][52660] Sum rewards: 63.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.026', 'AMMO2': '0.072', 'AMMO3': '0.219', 'weapon2': '0.298', 'weapon5': '0.306', 'weapon4': '0.310', 'AMMO4': '0.361', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.734', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:35,199][52794] DAMAGECOUNT value on done: 307114.0 [2024-08-06 02:25:35,199][52794] Sum rewards: 71.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.365', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:35,559][52820] DAMAGECOUNT value on done: 282109.0 [2024-08-06 02:25:35,559][52820] Sum rewards: 69.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.069', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.192', 'AMMO4': '0.206', 'weapon5': '0.224', 'weapon4': '0.342', 'WEAPON5': '0.450', 'weapon2': '0.468', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.670', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '57.500'} [2024-08-06 02:25:35,618][52662] DAMAGECOUNT value on done: 301659.0 [2024-08-06 02:25:35,619][52662] Sum rewards: 57.942, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.772', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.101', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.368', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '51.000'} [2024-08-06 02:25:36,236][52669] DAMAGECOUNT value on done: 298289.0 [2024-08-06 02:25:36,238][52669] Sum rewards: 59.163, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.091', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.584', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '51.500'} [2024-08-06 02:25:36,526][52658] DAMAGECOUNT value on done: 300492.0 [2024-08-06 02:25:36,527][52658] Sum rewards: 66.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.059', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.144', 'AMMO4': '0.249', 'AMMO3': '0.253', 'weapon5': '0.294', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.918', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:36,589][52647] DAMAGECOUNT value on done: 313034.0 [2024-08-06 02:25:36,590][52647] Sum rewards: 78.312, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.251', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.166', 'weapon5': '0.190', 'AMMO3': '0.213', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '64.500'} [2024-08-06 02:25:36,862][52650] Updated weights for policy 0, policy_version 37981 (0.0039) [2024-08-06 02:25:37,237][52668] DAMAGECOUNT value on done: 297345.0 [2024-08-06 02:25:37,237][52668] Sum rewards: 58.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon7': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.140', 'AMMO4': '0.198', 'AMMO3': '0.219', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.716', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:37,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 311164928. Throughput: 0: 4388.4. Samples: 77793500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:25:37,795][52567] Avg episode reward: [(0, '66.861')] [2024-08-06 02:25:37,865][52794] DAMAGECOUNT value on done: 301563.0 [2024-08-06 02:25:37,865][52794] Sum rewards: 69.950, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.289', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.130', 'weapon2': '0.822', 'WEAPON3': '0.900', 'weapon3': '3.024', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:38,256][52660] DAMAGECOUNT value on done: 297480.0 [2024-08-06 02:25:38,258][52660] Sum rewards: 62.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.336', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.100', 'weapon4': '0.210', 'AMMO4': '0.212', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.850', 'WEAPON3': '1.400', 'weapon3': '2.580', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.500'} [2024-08-06 02:25:38,462][52662] DAMAGECOUNT value on done: 297572.0 [2024-08-06 02:25:38,462][52662] Sum rewards: 64.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.442', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '54.000'} [2024-08-06 02:25:38,596][52820] DAMAGECOUNT value on done: 279148.0 [2024-08-06 02:25:38,596][52820] Sum rewards: 67.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.126', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.332', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '56.500'} [2024-08-06 02:25:39,126][52669] DAMAGECOUNT value on done: 305201.0 [2024-08-06 02:25:39,135][52669] Sum rewards: 65.718, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.914', 'AMMO5': '0.017', 'AMMO2': '0.077', 'weapon5': '0.172', 'AMMO3': '0.214', 'weapon4': '0.236', 'weapon2': '0.372', 'AMMO4': '0.383', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:39,701][52647] DAMAGECOUNT value on done: 319826.0 [2024-08-06 02:25:39,701][52647] Sum rewards: 73.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.106', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.096', 'weapon5': '0.130', 'AMMO4': '0.185', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:39,704][52658] DAMAGECOUNT value on done: 300183.0 [2024-08-06 02:25:39,706][52658] Sum rewards: 57.827, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.539', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.194', 'AMMO4': '0.249', 'weapon4': '0.252', 'weapon2': '0.256', 'AMMO3': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.820', 'weapon3': '2.990', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '52.000'} [2024-08-06 02:25:39,850][52668] DAMAGECOUNT value on done: 300073.0 [2024-08-06 02:25:39,851][52668] Sum rewards: 66.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.056', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.136', 'weapon4': '0.152', 'AMMO4': '0.174', 'weapon2': '0.178', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.250', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:40,886][52660] DAMAGECOUNT value on done: 307417.0 [2024-08-06 02:25:40,888][52660] Sum rewards: 67.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon2': '0.206', 'AMMO3': '0.210', 'weapon5': '0.230', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:41,127][52650] Updated weights for policy 0, policy_version 37991 (0.0023) [2024-08-06 02:25:41,214][52794] DAMAGECOUNT value on done: 308508.0 [2024-08-06 02:25:41,215][52794] Sum rewards: 75.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.056', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO3': '0.174', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.926', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:41,778][52820] DAMAGECOUNT value on done: 273145.0 [2024-08-06 02:25:41,779][52820] Sum rewards: 70.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.157', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.248', 'weapon2': '0.478', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:42,298][52669] DAMAGECOUNT value on done: 301037.0 [2024-08-06 02:25:42,299][52669] Sum rewards: 80.330, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.926', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.128', 'AMMO3': '0.166', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'ARMOR': '0.454', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 02:25:42,390][52658] DAMAGECOUNT value on done: 299789.0 [2024-08-06 02:25:42,391][52658] Sum rewards: 53.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.630', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.166', 'AMMO3': '0.171', 'AMMO4': '0.251', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.426', 'weapon4': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '43.000'} [2024-08-06 02:25:42,550][52668] DAMAGECOUNT value on done: 301011.0 [2024-08-06 02:25:42,550][52668] Sum rewards: 57.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.206', 'AMMO3': '0.210', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.310', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '48.500'} [2024-08-06 02:25:42,625][52647] DAMAGECOUNT value on done: 314242.0 [2024-08-06 02:25:42,625][52647] Sum rewards: 72.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 311238656. Throughput: 0: 4393.3. Samples: 77819770. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:25:42,794][52567] Avg episode reward: [(0, '66.923')] [2024-08-06 02:25:43,366][52660] DAMAGECOUNT value on done: 293047.0 [2024-08-06 02:25:43,366][52660] Sum rewards: 68.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.100', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.248', 'WEAPON3': '1.150', 'HITCOUNT': '3.350', 'weapon3': '3.360', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:43,608][52794] DAMAGECOUNT value on done: 305962.0 [2024-08-06 02:25:43,610][52794] Sum rewards: 79.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '67.000'} [2024-08-06 02:25:44,951][52820] DAMAGECOUNT value on done: 285357.0 [2024-08-06 02:25:44,953][52820] Sum rewards: 71.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.543', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.180', 'AMMO3': '0.241', 'weapon2': '0.270', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:45,073][52668] DAMAGECOUNT value on done: 302820.0 [2024-08-06 02:25:45,074][52668] Sum rewards: 49.355, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.140', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon7': '0.048', 'weapon5': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.184', 'WEAPON7': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.538', 'weapon4': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.318', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '43.500'} [2024-08-06 02:25:45,234][52658] DAMAGECOUNT value on done: 305582.0 [2024-08-06 02:25:45,234][52658] Sum rewards: 69.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO4': '0.080', 'weapon4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:45,387][52669] DAMAGECOUNT value on done: 299696.0 [2024-08-06 02:25:45,388][52669] Sum rewards: 63.880, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.975', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.076', 'weapon5': '0.078', 'AMMO4': '0.130', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '3.172', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '51.000'} [2024-08-06 02:25:45,660][52647] DAMAGECOUNT value on done: 320169.0 [2024-08-06 02:25:45,661][52647] Sum rewards: 70.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.811', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.059', 'weapon4': '0.070', 'weapon5': '0.228', 'AMMO3': '0.234', 'weapon2': '0.270', 'AMMO4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.128', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:45,863][52660] DAMAGECOUNT value on done: 296035.0 [2024-08-06 02:25:45,865][52660] Sum rewards: 57.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.046', 'weapon4': '0.094', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.748', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '49.000'} [2024-08-06 02:25:46,108][52650] Updated weights for policy 0, policy_version 38001 (0.0017) [2024-08-06 02:25:46,550][52794] DAMAGECOUNT value on done: 300425.0 [2024-08-06 02:25:46,550][52794] Sum rewards: 54.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.027', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.263', 'weapon2': '0.472', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.264', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '47.000'} [2024-08-06 02:25:47,538][52671] DAMAGECOUNT value on done: 306072.0 [2024-08-06 02:25:47,538][52671] Sum rewards: 70.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.955', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.578', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:47,735][52668] DAMAGECOUNT value on done: 297836.0 [2024-08-06 02:25:47,737][52668] Sum rewards: 66.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 311336960. Throughput: 0: 4396.2. Samples: 77832980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:25:47,795][52567] Avg episode reward: [(0, '66.580')] [2024-08-06 02:25:48,097][52658] DAMAGECOUNT value on done: 294213.0 [2024-08-06 02:25:48,098][52658] Sum rewards: 70.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.646', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO3': '0.208', 'AMMO4': '0.217', 'weapon4': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.590', 'WEAPON3': '1.400', 'weapon3': '2.556', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '58.500'} [2024-08-06 02:25:48,103][52820] DAMAGECOUNT value on done: 288546.0 [2024-08-06 02:25:48,107][52820] Sum rewards: 68.480, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.099', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.148', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '60.000'} [2024-08-06 02:25:48,224][52669] DAMAGECOUNT value on done: 304404.0 [2024-08-06 02:25:48,225][52669] Sum rewards: 68.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.224', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.064', 'weapon5': '0.146', 'AMMO4': '0.220', 'AMMO3': '0.248', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:48,350][52647] DAMAGECOUNT value on done: 310904.0 [2024-08-06 02:25:48,350][52647] Sum rewards: 61.059, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.307', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.320', 'weapon2': '0.348', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.082', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '50.000'} [2024-08-06 02:25:48,632][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:25:48,719][52660] DAMAGECOUNT value on done: 304920.0 [2024-08-06 02:25:48,720][52660] Sum rewards: 50.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.194', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.117', 'weapon4': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.610', 'WEAPON3': '1.550', 'HITCOUNT': '2.890', 'weapon3': '2.896', 'DAMAGECOUNT': '12.948', 'FRAGCOUNT': '46.000'} [2024-08-06 02:25:49,141][52660] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:25:49,503][52794] DAMAGECOUNT value on done: 304432.0 [2024-08-06 02:25:49,503][52794] Sum rewards: 71.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.335', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:50,129][52667] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:25:50,307][52671] DAMAGECOUNT value on done: 302214.0 [2024-08-06 02:25:50,307][52671] Sum rewards: 76.472, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.096', 'AMMO4': '0.120', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:50,429][52650] Updated weights for policy 0, policy_version 38011 (0.0031) [2024-08-06 02:25:50,502][52658] DAMAGECOUNT value on done: 308635.0 [2024-08-06 02:25:50,503][52658] Sum rewards: 69.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.125', 'weapon4': '0.144', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.238', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:51,181][52647] DAMAGECOUNT value on done: 313751.0 [2024-08-06 02:25:51,181][52647] Sum rewards: 56.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.160', 'weapon5': '0.166', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '48.000'} [2024-08-06 02:25:51,197][52820] DAMAGECOUNT value on done: 276092.0 [2024-08-06 02:25:51,197][52820] Sum rewards: 64.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.104', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.034', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.536', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.214', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '54.000'} [2024-08-06 02:25:51,316][52669] DAMAGECOUNT value on done: 304881.0 [2024-08-06 02:25:51,319][52669] Sum rewards: 68.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.918', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.070', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.562', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '59.000'} [2024-08-06 02:25:51,433][52660] DAMAGECOUNT value on done: 309220.0 [2024-08-06 02:25:51,434][52660] Sum rewards: 59.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.158', 'AMMO4': '0.177', 'AMMO3': '0.185', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '47.500'} [2024-08-06 02:25:52,616][52794] DAMAGECOUNT value on done: 295369.0 [2024-08-06 02:25:52,618][52794] Sum rewards: 67.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.176', 'AMMO4': '0.194', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '58.000'} [2024-08-06 02:25:52,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 311427072. Throughput: 0: 4398.5. Samples: 77859470. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:25:52,794][52567] Avg episode reward: [(0, '66.131')] [2024-08-06 02:25:53,272][52658] DAMAGECOUNT value on done: 304201.0 [2024-08-06 02:25:53,274][52658] Sum rewards: 46.648, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.066', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.254', 'weapon4': '1.014', 'WEAPON3': '1.050', 'weapon3': '2.404', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '11.865', 'FRAGCOUNT': '38.000'} [2024-08-06 02:25:53,480][52671] DAMAGECOUNT value on done: 303801.0 [2024-08-06 02:25:53,481][52671] Sum rewards: 73.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.773', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '61.000'} [2024-08-06 02:25:53,867][52647] DAMAGECOUNT value on done: 314909.0 [2024-08-06 02:25:53,867][52647] Sum rewards: 64.645, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2024-08-06 02:25:54,031][52669] DAMAGECOUNT value on done: 315625.0 [2024-08-06 02:25:54,033][52669] Sum rewards: 79.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.209', 'AMMO4': '0.225', 'weapon5': '0.234', 'weapon4': '0.290', 'WEAPON5': '0.450', 'weapon2': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '66.000'} [2024-08-06 02:25:54,421][52660] DAMAGECOUNT value on done: 296725.0 [2024-08-06 02:25:54,421][52660] Sum rewards: 63.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.522', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.072', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.348', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '3.000', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '53.000'} [2024-08-06 02:25:55,325][52650] Updated weights for policy 0, policy_version 38021 (0.0022) [2024-08-06 02:25:55,787][52658] DAMAGECOUNT value on done: 311085.0 [2024-08-06 02:25:55,787][52794] DAMAGECOUNT value on done: 309357.0 [2024-08-06 02:25:55,788][52794] Sum rewards: 62.377, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.414', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.134', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.606', 'WEAPON3': '0.900', 'weapon3': '2.764', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '49.000'} [2024-08-06 02:25:55,788][52658] Sum rewards: 65.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.404', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.382', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '54.000'} [2024-08-06 02:25:56,429][52647] DAMAGECOUNT value on done: 322853.0 [2024-08-06 02:25:56,429][52647] Sum rewards: 67.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.262', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.246', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '57.000'} [2024-08-06 02:25:56,541][52671] DAMAGECOUNT value on done: 301404.0 [2024-08-06 02:25:56,542][52671] Sum rewards: 66.210, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.344', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.158', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.302', 'weapon2': '0.514', 'WEAPON3': '1.700', 'weapon3': '2.924', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '58.500'} [2024-08-06 02:25:56,755][52669] DAMAGECOUNT value on done: 303923.0 [2024-08-06 02:25:56,757][52669] Sum rewards: 57.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.096', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'WEAPON3': '1.700', 'HITCOUNT': '3.000', 'weapon3': '3.420', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '52.000'} [2024-08-06 02:25:57,559][52660] DAMAGECOUNT value on done: 298420.0 [2024-08-06 02:25:57,560][52660] Sum rewards: 56.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.116', 'AMMO3': '0.206', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.412', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '49.000'} [2024-08-06 02:25:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 311508992. Throughput: 0: 4401.8. Samples: 77885920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:25:57,795][52567] Avg episode reward: [(0, '65.607')] [2024-08-06 02:25:58,323][52658] DAMAGECOUNT value on done: 294789.0 [2024-08-06 02:25:58,324][52658] Sum rewards: 75.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO4': '0.190', 'weapon4': '0.206', 'AMMO3': '0.213', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '63.000'} [2024-08-06 02:25:58,758][52647] DAMAGECOUNT value on done: 317993.0 [2024-08-06 02:25:58,760][52647] Sum rewards: 77.490, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.667', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.161', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:58,779][52794] DAMAGECOUNT value on done: 299219.0 [2024-08-06 02:25:58,781][52794] Sum rewards: 68.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'weapon5': '0.044', 'AMMO2': '0.045', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'AMMO4': '0.225', 'weapon2': '0.294', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '55.000'} [2024-08-06 02:25:59,570][52671] DAMAGECOUNT value on done: 310818.0 [2024-08-06 02:25:59,570][52671] Sum rewards: 76.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.325', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.124', 'AMMO4': '0.201', 'weapon2': '0.206', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '62.000'} [2024-08-06 02:25:59,651][52650] Updated weights for policy 0, policy_version 38031 (0.0020) [2024-08-06 02:25:59,755][52669] DAMAGECOUNT value on done: 307049.0 [2024-08-06 02:25:59,757][52669] Sum rewards: 62.937, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.572', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon5': '0.068', 'weapon4': '0.122', 'weapon2': '0.204', 'AMMO3': '0.214', 'AMMO4': '0.270', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.356', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.500'} [2024-08-06 02:26:00,401][52660] DAMAGECOUNT value on done: 292604.0 [2024-08-06 02:26:00,403][52660] Sum rewards: 57.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.385', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.156', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.550', 'weapon3': '2.792', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '52.000'} [2024-08-06 02:26:01,116][52658] DAMAGECOUNT value on done: 303152.0 [2024-08-06 02:26:01,118][52658] Sum rewards: 80.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.738', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.116', 'weapon5': '0.164', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.100', 'weapon3': '3.262', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '64.000'} [2024-08-06 02:26:01,320][52647] DAMAGECOUNT value on done: 314883.0 [2024-08-06 02:26:01,321][52647] Sum rewards: 63.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO4': '0.196', 'AMMO3': '0.203', 'weapon2': '0.226', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.126', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 02:26:02,035][52794] DAMAGECOUNT value on done: 309801.0 [2024-08-06 02:26:02,036][52794] Sum rewards: 63.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.179', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.144', 'weapon5': '0.146', 'AMMO4': '0.168', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.602', 'WEAPON3': '0.900', 'weapon3': '2.642', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '50.000'} [2024-08-06 02:26:02,568][52669] DAMAGECOUNT value on done: 303510.0 [2024-08-06 02:26:02,570][52669] Sum rewards: 65.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO5': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.058', 'AMMO3': '0.169', 'weapon5': '0.200', 'AMMO4': '0.291', 'weapon4': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.642', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 02:26:02,607][52671] DAMAGECOUNT value on done: 301582.0 [2024-08-06 02:26:02,607][52671] Sum rewards: 69.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.442', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 311599104. Throughput: 0: 4394.3. Samples: 77898970. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:26:02,794][52567] Avg episode reward: [(0, '65.978')] [2024-08-06 02:26:03,179][52660] DAMAGECOUNT value on done: 304082.0 [2024-08-06 02:26:03,181][52660] Sum rewards: 72.157, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'weapon4': '0.248', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.266', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 02:26:04,080][52647] DAMAGECOUNT value on done: 313000.0 [2024-08-06 02:26:04,080][52647] Sum rewards: 60.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.801', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.162', 'AMMO3': '0.181', 'weapon4': '0.302', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '49.000'} [2024-08-06 02:26:04,100][52658] DAMAGECOUNT value on done: 301211.0 [2024-08-06 02:26:04,101][52658] Sum rewards: 72.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.078', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.164', 'weapon5': '0.182', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.456', 'WEAPON3': '0.900', 'weapon3': '2.724', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 02:26:04,651][52650] Updated weights for policy 0, policy_version 38041 (0.0013) [2024-08-06 02:26:04,684][52794] DAMAGECOUNT value on done: 303282.0 [2024-08-06 02:26:04,685][52794] Sum rewards: 78.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.262', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.214', 'WEAPON3': '1.250', 'weapon3': '3.466', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '64.000'} [2024-08-06 02:26:04,730][52666] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2024-08-06 02:26:05,614][52669] DAMAGECOUNT value on done: 307237.0 [2024-08-06 02:26:05,622][52669] Sum rewards: 66.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.774', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO4': '0.139', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '55.500'} [2024-08-06 02:26:05,901][52660] DAMAGECOUNT value on done: 297674.0 [2024-08-06 02:26:05,901][52660] Sum rewards: 51.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.154', 'AMMO3': '0.249', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.368', 'ARMOR': '0.436', 'WEAPON4': '0.450', 'weapon4': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.702', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.908', 'FRAGCOUNT': '44.000'} [2024-08-06 02:26:05,954][52671] DAMAGECOUNT value on done: 304940.0 [2024-08-06 02:26:05,955][52671] Sum rewards: 70.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.998', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.182', 'weapon4': '0.208', 'AMMO4': '0.231', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '58.500'} [2024-08-06 02:26:06,930][52647] DAMAGECOUNT value on done: 307288.0 [2024-08-06 02:26:06,930][52647] Sum rewards: 67.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.457', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon5': '0.178', 'AMMO3': '0.191', 'AMMO4': '0.243', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:07,265][52658] DAMAGECOUNT value on done: 297107.0 [2024-08-06 02:26:07,266][52658] Sum rewards: 61.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.398', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.414', 'weapon2': '0.686', 'WEAPON3': '1.100', 'weapon3': '2.574', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '49.000'} [2024-08-06 02:26:07,377][52794] DAMAGECOUNT value on done: 304795.0 [2024-08-06 02:26:07,379][52794] Sum rewards: 67.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.618', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.094', 'weapon5': '0.184', 'AMMO3': '0.216', 'AMMO4': '0.244', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:07,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 311681024. Throughput: 0: 4395.1. Samples: 77925370. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:26:07,796][52567] Avg episode reward: [(0, '66.033')] [2024-08-06 02:26:08,459][52671] DAMAGECOUNT value on done: 304531.0 [2024-08-06 02:26:08,461][52671] Sum rewards: 48.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.680', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.194', 'weapon5': '0.202', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '2.824', 'DAMAGECOUNT': '12.456', 'FRAGCOUNT': '42.000'} [2024-08-06 02:26:09,298][52650] Updated weights for policy 0, policy_version 38051 (0.0021) [2024-08-06 02:26:10,028][52647] DAMAGECOUNT value on done: 317607.0 [2024-08-06 02:26:10,029][52647] Sum rewards: 61.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.078', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.181', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.212', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '52.000'} [2024-08-06 02:26:10,337][52658] DAMAGECOUNT value on done: 295885.0 [2024-08-06 02:26:10,339][52658] Sum rewards: 60.818, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.981', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.144', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '0.950', 'HITCOUNT': '3.000', 'weapon3': '3.170', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '49.000'} [2024-08-06 02:26:10,469][52794] DAMAGECOUNT value on done: 313424.0 [2024-08-06 02:26:10,470][52794] Sum rewards: 64.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.261', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.322', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:10,765][52671] DAMAGECOUNT value on done: 297893.0 [2024-08-06 02:26:10,772][52671] Sum rewards: 64.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 311779328. Throughput: 0: 4391.6. Samples: 77951690. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:26:12,794][52567] Avg episode reward: [(0, '65.700')] [2024-08-06 02:26:13,289][52794] DAMAGECOUNT value on done: 302597.0 [2024-08-06 02:26:13,289][52794] Sum rewards: 73.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.770', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.106', 'weapon5': '0.138', 'AMMO4': '0.182', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '63.000'} [2024-08-06 02:26:13,339][52671] DAMAGECOUNT value on done: 306682.0 [2024-08-06 02:26:13,339][52671] Sum rewards: 68.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.322', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.094', 'AMMO3': '0.166', 'AMMO4': '0.202', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.878', 'WEAPON3': '0.950', 'weapon3': '2.604', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:13,440][52658] DAMAGECOUNT value on done: 307921.0 [2024-08-06 02:26:13,441][52658] Sum rewards: 66.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.166', 'AMMO4': '0.167', 'weapon4': '0.170', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:14,116][52650] Updated weights for policy 0, policy_version 38061 (0.0022) [2024-08-06 02:26:14,262][52666] DAMAGECOUNT value on done: 305032.0 [2024-08-06 02:26:14,265][52666] Sum rewards: 64.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.524', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.142', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '53.000'} [2024-08-06 02:26:15,975][52658] DAMAGECOUNT value on done: 298050.0 [2024-08-06 02:26:15,975][52658] Sum rewards: 58.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.312', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '50.000'} [2024-08-06 02:26:16,430][52671] DAMAGECOUNT value on done: 308230.0 [2024-08-06 02:26:16,433][52671] Sum rewards: 73.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.168', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.226', 'weapon2': '0.636', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '64.000'} [2024-08-06 02:26:16,740][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:26:17,357][52666] DAMAGECOUNT value on done: 306502.0 [2024-08-06 02:26:17,358][52666] Sum rewards: 68.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.172', 'AMMO3': '0.225', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '2.998', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '58.000'} [2024-08-06 02:26:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 311861248. Throughput: 0: 4392.2. Samples: 77964860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:26:17,794][52567] Avg episode reward: [(0, '66.058')] [2024-08-06 02:26:18,338][52650] Updated weights for policy 0, policy_version 38071 (0.0017) [2024-08-06 02:26:19,045][52671] DAMAGECOUNT value on done: 302229.0 [2024-08-06 02:26:19,046][52671] Sum rewards: 57.636, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.072', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO4': '0.236', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '52.000'} [2024-08-06 02:26:19,232][52658] DAMAGECOUNT value on done: 302844.0 [2024-08-06 02:26:19,233][52658] Sum rewards: 67.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.196', 'weapon5': '0.236', 'AMMO4': '0.289', 'weapon2': '0.324', 'weapon4': '0.504', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:20,337][52666] DAMAGECOUNT value on done: 306316.0 [2024-08-06 02:26:20,341][52666] Sum rewards: 60.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.082', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '49.000'} [2024-08-06 02:26:22,164][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:26:22,208][52670] DAMAGECOUNT value on done: 297947.0 [2024-08-06 02:26:22,208][52670] Sum rewards: 69.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.008', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.336', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:22,231][52671] DAMAGECOUNT value on done: 311733.0 [2024-08-06 02:26:22,233][52671] Sum rewards: 65.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.131', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO3': '0.141', 'weapon4': '0.174', 'AMMO4': '0.188', 'weapon5': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.628', 'WEAPON3': '0.950', 'weapon3': '2.754', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '51.500'} [2024-08-06 02:26:22,252][52658] DAMAGECOUNT value on done: 306832.0 [2024-08-06 02:26:22,253][52658] Sum rewards: 60.477, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.100', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.124', 'weapon4': '0.134', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.329', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.950', 'weapon3': '3.012', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:22,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 311943168. Throughput: 0: 4397.3. Samples: 77991380. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:26:22,795][52567] Avg episode reward: [(0, '65.661')] [2024-08-06 02:26:22,940][52666] DAMAGECOUNT value on done: 301637.0 [2024-08-06 02:26:22,942][52666] Sum rewards: 65.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.014', 'AMMO2': '0.060', 'weapon5': '0.178', 'AMMO3': '0.258', 'weapon2': '0.262', 'AMMO4': '0.302', 'WEAPON5': '0.450', 'weapon4': '0.462', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.840', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:23,359][52650] Updated weights for policy 0, policy_version 38081 (0.0023) [2024-08-06 02:26:24,631][52670] DAMAGECOUNT value on done: 303057.0 [2024-08-06 02:26:24,631][52670] Sum rewards: 61.766, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.968', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO4': '0.250', 'weapon5': '0.256', 'weapon4': '0.258', 'AMMO3': '0.284', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.768', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:25,097][52671] DAMAGECOUNT value on done: 301333.0 [2024-08-06 02:26:25,099][52671] Sum rewards: 71.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.032', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.224', 'WEAPON3': '0.950', 'HITCOUNT': '2.980', 'weapon3': '3.546', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '58.500'} [2024-08-06 02:26:25,274][52666] DAMAGECOUNT value on done: 297796.0 [2024-08-06 02:26:25,274][52666] Sum rewards: 70.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.169', 'weapon2': '0.556', 'WEAPON3': '1.000', 'HITCOUNT': '3.280', 'weapon3': '3.350', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:27,151][52670] DAMAGECOUNT value on done: 296422.0 [2024-08-06 02:26:27,151][52670] Sum rewards: 72.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.114', 'AMMO3': '0.164', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.000', 'weapon3': '3.024', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '60.000'} [2024-08-06 02:26:27,701][52650] Updated weights for policy 0, policy_version 38091 (0.0037) [2024-08-06 02:26:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 312041472. Throughput: 0: 4387.8. Samples: 78017220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 02:26:27,794][52567] Avg episode reward: [(0, '65.982')] [2024-08-06 02:26:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038091_312041472.pth... [2024-08-06 02:26:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037577_307830784.pth [2024-08-06 02:26:27,988][52666] DAMAGECOUNT value on done: 293996.0 [2024-08-06 02:26:27,990][52666] Sum rewards: 75.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.807', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.050', 'AMMO4': '0.156', 'weapon5': '0.158', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '3.112', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '61.500'} [2024-08-06 02:26:28,278][52671] DAMAGECOUNT value on done: 293324.0 [2024-08-06 02:26:28,279][52671] Sum rewards: 62.552, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.140', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '50.000'} [2024-08-06 02:26:30,339][52670] DAMAGECOUNT value on done: 294550.0 [2024-08-06 02:26:30,344][52670] Sum rewards: 68.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.579', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.174', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'weapon4': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.554', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '57.000'} [2024-08-06 02:26:31,005][52671] DAMAGECOUNT value on done: 306337.0 [2024-08-06 02:26:31,005][52671] Sum rewards: 63.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO4': '0.184', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '52.000'} [2024-08-06 02:26:31,327][52666] DAMAGECOUNT value on done: 300625.0 [2024-08-06 02:26:31,327][52666] Sum rewards: 65.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.675', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.267', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '58.000'} [2024-08-06 02:26:32,620][52650] Updated weights for policy 0, policy_version 38101 (0.0012) [2024-08-06 02:26:32,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 312123392. Throughput: 0: 4383.4. Samples: 78030230. Policy #0 lag: (min: 1.0, avg: 4.5, max: 8.0) [2024-08-06 02:26:32,795][52567] Avg episode reward: [(0, '66.029')] [2024-08-06 02:26:33,390][52670] DAMAGECOUNT value on done: 306051.0 [2024-08-06 02:26:33,398][52670] Sum rewards: 66.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.808', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.202', 'AMMO4': '0.210', 'AMMO3': '0.224', 'weapon4': '0.244', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:33,668][52671] DAMAGECOUNT value on done: 308192.0 [2024-08-06 02:26:33,668][52671] Sum rewards: 67.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.418', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.187', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:34,202][52659] DAMAGECOUNT value on done: 304632.0 [2024-08-06 02:26:34,203][52659] Sum rewards: 77.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.436', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '65.000'} [2024-08-06 02:26:34,403][52666] DAMAGECOUNT value on done: 298252.0 [2024-08-06 02:26:34,405][52666] Sum rewards: 61.965, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'weapon2': '0.122', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.206', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '50.000'} [2024-08-06 02:26:36,427][52670] DAMAGECOUNT value on done: 300578.0 [2024-08-06 02:26:36,428][52670] Sum rewards: 66.512, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.553', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'weapon4': '0.134', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.184', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '58.000'} [2024-08-06 02:26:36,896][52671] DAMAGECOUNT value on done: 309172.0 [2024-08-06 02:26:36,896][52671] Sum rewards: 64.825, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.510', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.068', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'weapon2': '0.342', 'WEAPON3': '1.800', 'weapon3': '3.244', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '59.000'} [2024-08-06 02:26:37,423][52650] Updated weights for policy 0, policy_version 38111 (0.0019) [2024-08-06 02:26:37,466][52666] DAMAGECOUNT value on done: 299622.0 [2024-08-06 02:26:37,466][52666] Sum rewards: 71.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '61.000'} [2024-08-06 02:26:37,616][52659] DAMAGECOUNT value on done: 302082.0 [2024-08-06 02:26:37,616][52659] Sum rewards: 75.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.927', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.074', 'weapon5': '0.078', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '61.000'} [2024-08-06 02:26:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 312213504. Throughput: 0: 4382.9. Samples: 78056700. Policy #0 lag: (min: 1.0, avg: 4.5, max: 8.0) [2024-08-06 02:26:37,795][52567] Avg episode reward: [(0, '66.349')] [2024-08-06 02:26:39,632][52670] DAMAGECOUNT value on done: 295244.0 [2024-08-06 02:26:39,632][52670] Sum rewards: 76.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.718', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.142', 'weapon2': '0.220', 'AMMO3': '0.235', 'weapon5': '0.256', 'AMMO4': '0.287', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '63.000'} [2024-08-06 02:26:39,672][52671] DAMAGECOUNT value on done: 302951.0 [2024-08-06 02:26:39,673][52671] Sum rewards: 56.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.116', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.070', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.426', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '49.500'} [2024-08-06 02:26:40,329][52659] DAMAGECOUNT value on done: 301502.0 [2024-08-06 02:26:40,331][52659] Sum rewards: 74.666, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'weapon4': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '62.000'} [2024-08-06 02:26:40,522][52666] DAMAGECOUNT value on done: 296764.0 [2024-08-06 02:26:40,523][52666] Sum rewards: 56.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.568', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '48.000'} [2024-08-06 02:26:41,770][52650] Updated weights for policy 0, policy_version 38121 (0.0012) [2024-08-06 02:26:42,280][52671] DAMAGECOUNT value on done: 301209.0 [2024-08-06 02:26:42,281][52671] Sum rewards: 59.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.520', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.226', 'AMMO3': '0.228', 'weapon5': '0.232', 'AMMO4': '0.289', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '50.000'} [2024-08-06 02:26:42,351][52670] DAMAGECOUNT value on done: 298335.0 [2024-08-06 02:26:42,351][52670] Sum rewards: 68.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.162', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.228', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.396', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '58.000'} [2024-08-06 02:26:42,790][52659] DAMAGECOUNT value on done: 303073.0 [2024-08-06 02:26:42,792][52659] Sum rewards: 69.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.142', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '58.000'} [2024-08-06 02:26:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 312295424. Throughput: 0: 4381.3. Samples: 78083080. Policy #0 lag: (min: 1.0, avg: 4.5, max: 8.0) [2024-08-06 02:26:42,794][52567] Avg episode reward: [(0, '66.133')] [2024-08-06 02:26:43,379][52666] DAMAGECOUNT value on done: 295982.0 [2024-08-06 02:26:43,379][52666] Sum rewards: 70.150, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.227', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.064', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.164', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '61.000'} [2024-08-06 02:26:45,037][52670] DAMAGECOUNT value on done: 297785.0 [2024-08-06 02:26:45,045][52670] Sum rewards: 63.809, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.120', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '50.000'} [2024-08-06 02:26:45,420][52659] DAMAGECOUNT value on done: 297122.0 [2024-08-06 02:26:45,421][52659] Sum rewards: 63.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.092', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.278', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.312', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '54.000'} [2024-08-06 02:26:45,895][52666] DAMAGECOUNT value on done: 294724.0 [2024-08-06 02:26:45,897][52666] Sum rewards: 67.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.096', 'weapon2': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.584', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:46,474][52650] Updated weights for policy 0, policy_version 38131 (0.0022) [2024-08-06 02:26:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17550.3). Total num frames: 312385536. Throughput: 0: 4386.7. Samples: 78096370. Policy #0 lag: (min: 1.0, avg: 4.5, max: 8.0) [2024-08-06 02:26:47,794][52567] Avg episode reward: [(0, '65.968')] [2024-08-06 02:26:48,045][52670] DAMAGECOUNT value on done: 291469.0 [2024-08-06 02:26:48,055][52670] Sum rewards: 72.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'weapon5': '0.154', 'AMMO3': '0.207', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '59.000'} [2024-08-06 02:26:48,378][52659] DAMAGECOUNT value on done: 301414.0 [2024-08-06 02:26:48,380][52659] Sum rewards: 59.106, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.012', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.124', 'weapon4': '0.158', 'AMMO3': '0.187', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '48.000'} [2024-08-06 02:26:48,844][52666] DAMAGECOUNT value on done: 303849.0 [2024-08-06 02:26:48,847][52666] Sum rewards: 47.124, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.434', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.154', 'weapon4': '0.216', 'AMMO4': '0.231', 'weapon2': '0.272', 'AMMO3': '0.337', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '2.000', 'HITCOUNT': '2.590', 'weapon3': '3.010', 'DAMAGECOUNT': '13.284', 'FRAGCOUNT': '48.000'} [2024-08-06 02:26:49,856][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:26:50,467][52670] DAMAGECOUNT value on done: 306640.0 [2024-08-06 02:26:50,468][52670] Sum rewards: 73.617, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.275', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.078', 'weapon4': '0.096', 'AMMO4': '0.140', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '60.000'} [2024-08-06 02:26:51,067][52663] DAMAGECOUNT value on done: 307028.0 [2024-08-06 02:26:51,067][52663] Sum rewards: 68.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.266', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '60.000'} [2024-08-06 02:26:51,156][52659] DAMAGECOUNT value on done: 304305.0 [2024-08-06 02:26:51,157][52659] Sum rewards: 60.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.704', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.237', 'weapon2': '0.248', 'AMMO4': '0.249', 'weapon4': '0.250', 'weapon5': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '51.000'} [2024-08-06 02:26:51,566][52650] Updated weights for policy 0, policy_version 38141 (0.0012) [2024-08-06 02:26:51,595][52666] DAMAGECOUNT value on done: 303726.0 [2024-08-06 02:26:51,597][52666] Sum rewards: 57.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.658', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.180', 'AMMO3': '0.222', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.470', 'WEAPON3': '1.450', 'weapon3': '2.650', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '50.000'} [2024-08-06 02:26:52,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 312483840. Throughput: 0: 4387.4. Samples: 78122800. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 02:26:52,794][52567] Avg episode reward: [(0, '66.008')] [2024-08-06 02:26:53,618][52670] DAMAGECOUNT value on done: 300941.0 [2024-08-06 02:26:53,619][52670] Sum rewards: 56.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.198', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon4': '0.254', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '48.000'} [2024-08-06 02:26:53,906][52659] DAMAGECOUNT value on done: 299476.0 [2024-08-06 02:26:53,907][52659] Sum rewards: 67.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.204', 'weapon5': '0.228', 'weapon4': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '55.500'} [2024-08-06 02:26:53,940][52663] DAMAGECOUNT value on done: 300676.0 [2024-08-06 02:26:53,941][52663] Sum rewards: 57.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.718', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.054', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.276', 'weapon2': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '51.000'} [2024-08-06 02:26:54,333][52666] DAMAGECOUNT value on done: 299540.0 [2024-08-06 02:26:54,334][52666] Sum rewards: 64.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.049', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.174', 'AMMO3': '0.233', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '53.000'} [2024-08-06 02:26:55,615][52650] Updated weights for policy 0, policy_version 38151 (0.0012) [2024-08-06 02:26:56,137][52664] DAMAGECOUNT value on done: 315123.0 [2024-08-06 02:26:56,138][52664] Sum rewards: 60.474, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.708', 'AMMO5': '0.025', 'AMMO2': '0.082', 'weapon5': '0.236', 'AMMO3': '0.241', 'weapon2': '0.282', 'AMMO4': '0.408', 'weapon4': '0.410', 'WEAPON5': '0.600', 'WEAPON4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.750', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '52.000'} [2024-08-06 02:26:56,488][52670] DAMAGECOUNT value on done: 301170.0 [2024-08-06 02:26:56,490][52670] Sum rewards: 74.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.974', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.228', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '61.000'} [2024-08-06 02:26:56,861][52659] DAMAGECOUNT value on done: 310048.0 [2024-08-06 02:26:56,861][52659] Sum rewards: 63.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'weapon4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '56.000'} [2024-08-06 02:26:57,033][52663] DAMAGECOUNT value on done: 300562.0 [2024-08-06 02:26:57,033][52663] Sum rewards: 84.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.691', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.091', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '70.000'} [2024-08-06 02:26:57,185][52666] DAMAGECOUNT value on done: 300505.0 [2024-08-06 02:26:57,186][52666] Sum rewards: 67.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.142', 'weapon5': '0.158', 'AMMO3': '0.199', 'AMMO4': '0.272', 'weapon2': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '56.500'} [2024-08-06 02:26:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 312557568. Throughput: 0: 4383.8. Samples: 78148960. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 02:26:57,794][52567] Avg episode reward: [(0, '65.929')] [2024-08-06 02:26:58,988][52664] DAMAGECOUNT value on done: 314844.0 [2024-08-06 02:26:58,988][52664] Sum rewards: 63.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.025', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.194', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'weapon4': '0.322', 'WEAPON3': '1.450', 'weapon3': '2.930', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '53.000'} [2024-08-06 02:26:59,200][52670] DAMAGECOUNT value on done: 304285.0 [2024-08-06 02:26:59,200][52670] Sum rewards: 57.292, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.052', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.438', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '48.000'} [2024-08-06 02:26:59,468][52659] DAMAGECOUNT value on done: 308867.0 [2024-08-06 02:26:59,469][52659] Sum rewards: 67.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.462', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.286', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.386', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '55.000'} [2024-08-06 02:26:59,963][52666] DAMAGECOUNT value on done: 297556.0 [2024-08-06 02:26:59,965][52666] Sum rewards: 64.087, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'HEALTH': '0.058', 'AMMO4': '0.082', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.076', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '52.000'} [2024-08-06 02:27:00,119][52663] DAMAGECOUNT value on done: 303789.0 [2024-08-06 02:27:00,119][52663] Sum rewards: 67.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.702', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '58.000'} [2024-08-06 02:27:00,762][52650] Updated weights for policy 0, policy_version 38161 (0.0011) [2024-08-06 02:27:01,453][52664] DAMAGECOUNT value on done: 316137.0 [2024-08-06 02:27:01,454][52664] Sum rewards: 60.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.172', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon5': '0.058', 'weapon4': '0.064', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.316', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:01,920][52670] DAMAGECOUNT value on done: 302430.0 [2024-08-06 02:27:01,921][52670] Sum rewards: 68.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO4': '0.197', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '58.000'} [2024-08-06 02:27:02,456][52659] DAMAGECOUNT value on done: 303687.0 [2024-08-06 02:27:02,457][52659] Sum rewards: 63.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.078', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:02,609][52666] DAMAGECOUNT value on done: 301283.0 [2024-08-06 02:27:02,610][52666] Sum rewards: 64.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.240', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.516', 'WEAPON3': '0.800', 'HITCOUNT': '3.050', 'weapon3': '3.220', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 312647680. Throughput: 0: 4385.6. Samples: 78162210. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 02:27:02,794][52567] Avg episode reward: [(0, '65.886')] [2024-08-06 02:27:03,179][52663] DAMAGECOUNT value on done: 302732.0 [2024-08-06 02:27:03,182][52663] Sum rewards: 71.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.122', 'weapon4': '0.152', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.550', 'weapon3': '3.112', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '60.000'} [2024-08-06 02:27:04,464][52670] DAMAGECOUNT value on done: 287732.0 [2024-08-06 02:27:04,464][52670] Sum rewards: 62.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.876', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon4': '0.214', 'AMMO3': '0.216', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:04,516][52664] DAMAGECOUNT value on done: 312835.0 [2024-08-06 02:27:04,516][52664] Sum rewards: 70.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.156', 'weapon5': '0.174', 'AMMO3': '0.204', 'AMMO4': '0.292', 'weapon2': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:04,939][52650] Updated weights for policy 0, policy_version 38171 (0.0035) [2024-08-06 02:27:05,179][52659] DAMAGECOUNT value on done: 306092.0 [2024-08-06 02:27:05,181][52659] Sum rewards: 77.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.167', 'weapon2': '0.254', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '63.000'} [2024-08-06 02:27:05,567][52666] DAMAGECOUNT value on done: 294047.0 [2024-08-06 02:27:05,567][52666] Sum rewards: 61.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.098', 'AMMO3': '0.176', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.316', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:05,799][52663] DAMAGECOUNT value on done: 306946.0 [2024-08-06 02:27:05,800][52663] Sum rewards: 76.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.156', 'weapon4': '0.192', 'weapon5': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '64.000'} [2024-08-06 02:27:07,453][52664] DAMAGECOUNT value on done: 314562.0 [2024-08-06 02:27:07,453][52664] Sum rewards: 69.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.118', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.932', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '57.000'} [2024-08-06 02:27:07,616][52670] DAMAGECOUNT value on done: 302268.0 [2024-08-06 02:27:07,617][52670] Sum rewards: 76.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.068', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.296', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '64.000'} [2024-08-06 02:27:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.5, 300 sec: 17550.3). Total num frames: 312745984. Throughput: 0: 4377.1. Samples: 78188350. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 02:27:07,794][52567] Avg episode reward: [(0, '66.403')] [2024-08-06 02:27:08,230][52659] DAMAGECOUNT value on done: 295756.0 [2024-08-06 02:27:08,230][52659] Sum rewards: 76.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.172', 'AMMO3': '0.222', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '64.000'} [2024-08-06 02:27:08,612][52663] DAMAGECOUNT value on done: 302170.0 [2024-08-06 02:27:08,614][52663] Sum rewards: 57.289, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.124', 'weapon4': '0.172', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '3.010', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:08,740][52666] DAMAGECOUNT value on done: 302859.0 [2024-08-06 02:27:08,741][52666] Sum rewards: 69.864, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.956', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.026', 'weapon4': '0.090', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.000'} [2024-08-06 02:27:09,945][52650] Updated weights for policy 0, policy_version 38181 (0.0021) [2024-08-06 02:27:10,176][52664] DAMAGECOUNT value on done: 314759.0 [2024-08-06 02:27:10,176][52664] Sum rewards: 56.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.939', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.128', 'AMMO4': '0.137', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.460', 'weapon4': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '48.000'} [2024-08-06 02:27:10,631][52670] DAMAGECOUNT value on done: 309282.0 [2024-08-06 02:27:10,632][52670] Sum rewards: 66.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.463', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.124', 'weapon2': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '3.170', 'weapon3': '3.410', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.000'} [2024-08-06 02:27:11,223][52659] DAMAGECOUNT value on done: 303685.0 [2024-08-06 02:27:11,223][52659] Sum rewards: 56.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon4': '0.236', 'AMMO3': '0.240', 'weapon5': '0.242', 'weapon2': '0.296', 'AMMO4': '0.331', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '2.940', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '49.000'} [2024-08-06 02:27:11,485][52663] DAMAGECOUNT value on done: 300967.0 [2024-08-06 02:27:11,486][52663] Sum rewards: 60.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.130', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '52.000'} [2024-08-06 02:27:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17550.4). Total num frames: 312827904. Throughput: 0: 4393.8. Samples: 78214940. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 02:27:12,802][52567] Avg episode reward: [(0, '65.957')] [2024-08-06 02:27:13,033][52664] DAMAGECOUNT value on done: 317618.0 [2024-08-06 02:27:13,033][52664] Sum rewards: 68.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.146', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.103', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:13,741][52659] DAMAGECOUNT value on done: 309635.0 [2024-08-06 02:27:13,745][52659] Sum rewards: 64.928, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.964', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.158', 'weapon5': '0.180', 'weapon2': '0.214', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.000'} [2024-08-06 02:27:13,900][52670] DAMAGECOUNT value on done: 300487.0 [2024-08-06 02:27:13,901][52670] Sum rewards: 57.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.045', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.108', 'AMMO4': '0.158', 'weapon5': '0.164', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.120', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '48.500'} [2024-08-06 02:27:14,351][52663] DAMAGECOUNT value on done: 301519.0 [2024-08-06 02:27:14,351][52663] Sum rewards: 77.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.066', 'AMMO4': '0.087', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.354', 'weapon4': '0.358', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '63.000'} [2024-08-06 02:27:14,771][52650] Updated weights for policy 0, policy_version 38191 (0.0044) [2024-08-06 02:27:15,614][52664] DAMAGECOUNT value on done: 307880.0 [2024-08-06 02:27:15,615][52664] Sum rewards: 70.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.335', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.156', 'weapon4': '0.190', 'AMMO3': '0.226', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:16,478][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:27:16,577][52670] DAMAGECOUNT value on done: 301593.0 [2024-08-06 02:27:16,577][52670] Sum rewards: 59.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.895', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.164', 'weapon5': '0.176', 'AMMO3': '0.196', 'AMMO4': '0.253', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '2.988', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:16,975][52659] DAMAGECOUNT value on done: 312555.0 [2024-08-06 02:27:16,977][52659] Sum rewards: 59.989, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.529', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.124', 'weapon2': '0.142', 'AMMO3': '0.292', 'WEAPON3': '1.750', 'HITCOUNT': '3.230', 'weapon3': '3.562', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.000'} [2024-08-06 02:27:17,179][52663] DAMAGECOUNT value on done: 305127.0 [2024-08-06 02:27:17,180][52663] Sum rewards: 82.769, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.892', 'FRAGCOUNT': '69.000'} [2024-08-06 02:27:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 312909824. Throughput: 0: 4391.6. Samples: 78227850. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:27:17,794][52567] Avg episode reward: [(0, '65.891')] [2024-08-06 02:27:18,083][52795] DAMAGECOUNT value on done: 284177.0 [2024-08-06 02:27:18,083][52795] Sum rewards: 66.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon2': '0.182', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.380', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '55.000'} [2024-08-06 02:27:18,353][52664] DAMAGECOUNT value on done: 320882.0 [2024-08-06 02:27:18,354][52664] Sum rewards: 67.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.106', 'weapon4': '0.124', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '56.500'} [2024-08-06 02:27:19,301][52650] Updated weights for policy 0, policy_version 38201 (0.0013) [2024-08-06 02:27:19,838][52663] DAMAGECOUNT value on done: 304633.0 [2024-08-06 02:27:19,838][52663] Sum rewards: 63.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'weapon5': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.100', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.236', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '56.000'} [2024-08-06 02:27:20,112][52659] DAMAGECOUNT value on done: 306157.0 [2024-08-06 02:27:20,113][52659] Sum rewards: 58.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.574', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.204', 'weapon4': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.288', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:21,170][52664] DAMAGECOUNT value on done: 311907.0 [2024-08-06 02:27:21,173][52664] Sum rewards: 59.408, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'HEALTH': '0.155', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.274', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '48.000'} [2024-08-06 02:27:21,382][52795] DAMAGECOUNT value on done: 275705.0 [2024-08-06 02:27:21,383][52795] Sum rewards: 60.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.844', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'AMMO3': '0.244', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.520', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:22,388][52663] DAMAGECOUNT value on done: 301959.0 [2024-08-06 02:27:22,389][52663] Sum rewards: 59.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'weapon4': '0.188', 'AMMO3': '0.270', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.236', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '52.000'} [2024-08-06 02:27:22,642][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:27:22,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 312999936. Throughput: 0: 4386.4. Samples: 78254090. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:27:22,795][52567] Avg episode reward: [(0, '65.960')] [2024-08-06 02:27:23,261][52659] DAMAGECOUNT value on done: 303395.0 [2024-08-06 02:27:23,263][52659] Sum rewards: 67.737, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.710', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.088', 'weapon5': '0.186', 'AMMO4': '0.191', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.146', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '62.000'} [2024-08-06 02:27:23,665][52664] DAMAGECOUNT value on done: 316258.0 [2024-08-06 02:27:23,665][52664] Sum rewards: 64.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.772', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.171', 'weapon5': '0.192', 'AMMO4': '0.208', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '54.000'} [2024-08-06 02:27:24,065][52650] Updated weights for policy 0, policy_version 38211 (0.0033) [2024-08-06 02:27:24,457][52795] DAMAGECOUNT value on done: 277573.0 [2024-08-06 02:27:24,457][52795] Sum rewards: 70.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.571', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.182', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.454', 'weapon4': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '58.000'} [2024-08-06 02:27:25,198][52803] DAMAGECOUNT value on done: 283879.0 [2024-08-06 02:27:25,199][52803] Sum rewards: 61.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.943', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.088', 'AMMO4': '0.131', 'weapon5': '0.140', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.150', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '53.500'} [2024-08-06 02:27:25,519][52663] DAMAGECOUNT value on done: 295455.0 [2024-08-06 02:27:25,519][52663] Sum rewards: 66.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.529', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.186', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '54.000'} [2024-08-06 02:27:25,941][52659] DAMAGECOUNT value on done: 306640.0 [2024-08-06 02:27:25,944][52659] Sum rewards: 60.919, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.118', 'weapon5': '0.206', 'AMMO3': '0.239', 'AMMO4': '0.313', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:26,008][52664] DAMAGECOUNT value on done: 315427.0 [2024-08-06 02:27:26,011][52664] Sum rewards: 72.307, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.961', 'AMMO5': '0.012', 'AMMO2': '0.080', 'weapon5': '0.120', 'AMMO3': '0.220', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.390', 'AMMO4': '0.398', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '62.000'} [2024-08-06 02:27:27,393][52614] Signal inference workers to stop experience collection... (6900 times) [2024-08-06 02:27:27,395][52614] Signal inference workers to resume experience collection... (6900 times) [2024-08-06 02:27:27,401][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:27:27,476][52650] InferenceWorker_p0-w0: stopping experience collection (6900 times) [2024-08-06 02:27:27,477][52650] InferenceWorker_p0-w0: resuming experience collection (6900 times) [2024-08-06 02:27:27,565][52795] DAMAGECOUNT value on done: 278733.0 [2024-08-06 02:27:27,566][52795] Sum rewards: 70.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.800', 'AMMO5': '0.024', 'AMMO2': '0.082', 'AMMO3': '0.175', 'weapon5': '0.292', 'weapon2': '0.324', 'weapon4': '0.382', 'AMMO4': '0.408', 'WEAPON5': '0.700', 'WEAPON4': '0.900', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '58.000'} [2024-08-06 02:27:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 313090048. Throughput: 0: 4376.9. Samples: 78280040. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:27:27,794][52567] Avg episode reward: [(0, '66.103')] [2024-08-06 02:27:28,343][52803] DAMAGECOUNT value on done: 282617.0 [2024-08-06 02:27:28,344][52803] Sum rewards: 61.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.058', 'weapon5': '0.080', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.266', 'AMMO4': '0.288', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '52.000'} [2024-08-06 02:27:28,647][52650] Updated weights for policy 0, policy_version 38221 (0.0022) [2024-08-06 02:27:28,691][52663] DAMAGECOUNT value on done: 299234.0 [2024-08-06 02:27:28,692][52663] Sum rewards: 69.897, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.070', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '56.000'} [2024-08-06 02:27:28,708][52811] DAMAGECOUNT value on done: 293480.0 [2024-08-06 02:27:28,710][52811] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.233', 'AMMO4': '0.245', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '65.000'} [2024-08-06 02:27:28,799][52664] DAMAGECOUNT value on done: 321311.0 [2024-08-06 02:27:28,800][52664] Sum rewards: 61.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.862', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.184', 'weapon5': '0.230', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.534', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:29,149][52659] DAMAGECOUNT value on done: 307915.0 [2024-08-06 02:27:29,150][52659] Sum rewards: 70.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.730', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.432', 'WEAPON3': '1.700', 'weapon3': '3.184', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '60.000'} [2024-08-06 02:27:30,749][52795] DAMAGECOUNT value on done: 282954.0 [2024-08-06 02:27:30,749][52795] Sum rewards: 61.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.224', 'weapon4': '0.228', 'weapon2': '0.254', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.216', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2024-08-06 02:27:31,208][52663] DAMAGECOUNT value on done: 300671.0 [2024-08-06 02:27:31,209][52663] Sum rewards: 72.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.786', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.225', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.440', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '60.000'} [2024-08-06 02:27:31,421][52664] DAMAGECOUNT value on done: 314533.0 [2024-08-06 02:27:31,422][52664] Sum rewards: 69.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.674', 'WEAPON3': '1.250', 'weapon3': '2.710', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:31,498][52803] DAMAGECOUNT value on done: 284412.0 [2024-08-06 02:27:31,498][52803] Sum rewards: 72.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.814', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '58.500'} [2024-08-06 02:27:31,984][52811] DAMAGECOUNT value on done: 281921.0 [2024-08-06 02:27:31,989][52811] Sum rewards: 80.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.118', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '65.000'} [2024-08-06 02:27:32,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 313171968. Throughput: 0: 4374.0. Samples: 78293200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:27:32,794][52567] Avg episode reward: [(0, '66.595')] [2024-08-06 02:27:33,146][52650] Updated weights for policy 0, policy_version 38231 (0.0020) [2024-08-06 02:27:33,892][52795] DAMAGECOUNT value on done: 281314.0 [2024-08-06 02:27:33,893][52795] Sum rewards: 64.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.532', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.102', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.260', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.412', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '55.000'} [2024-08-06 02:27:34,017][52663] DAMAGECOUNT value on done: 307893.0 [2024-08-06 02:27:34,018][52663] Sum rewards: 61.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.784', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.207', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '51.000'} [2024-08-06 02:27:34,151][52664] DAMAGECOUNT value on done: 321254.0 [2024-08-06 02:27:34,151][52664] Sum rewards: 74.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.188', 'weapon2': '0.212', 'AMMO3': '0.258', 'WEAPON3': '1.700', 'weapon3': '3.318', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '65.000'} [2024-08-06 02:27:34,745][52803] DAMAGECOUNT value on done: 286396.0 [2024-08-06 02:27:34,745][52803] Sum rewards: 74.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.346', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.138', 'weapon4': '0.204', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '60.000'} [2024-08-06 02:27:35,016][52811] DAMAGECOUNT value on done: 285744.0 [2024-08-06 02:27:35,017][52811] Sum rewards: 67.947, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.126', 'HEALTH': '0.133', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.286', 'weapon2': '0.370', 'WEAPON3': '0.900', 'weapon3': '3.020', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:36,784][52664] DAMAGECOUNT value on done: 310638.0 [2024-08-06 02:27:36,784][52664] Sum rewards: 69.906, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.176', 'weapon2': '0.406', 'HEALTH': '0.516', 'WEAPON3': '1.000', 'HITCOUNT': '3.230', 'weapon3': '3.278', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '57.000'} [2024-08-06 02:27:36,976][52795] DAMAGECOUNT value on done: 286678.0 [2024-08-06 02:27:36,976][52795] Sum rewards: 70.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.008', 'weapon4': '0.020', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '57.000'} [2024-08-06 02:27:37,028][52663] DAMAGECOUNT value on done: 302982.0 [2024-08-06 02:27:37,030][52663] Sum rewards: 74.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.812', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.190', 'weapon2': '0.208', 'weapon4': '0.224', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 02:27:37,774][52803] DAMAGECOUNT value on done: 287808.0 [2024-08-06 02:27:37,774][52803] Sum rewards: 63.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.187', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon4': '0.288', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '52.500'} [2024-08-06 02:27:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 313253888. Throughput: 0: 4371.8. Samples: 78319530. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:27:37,794][52567] Avg episode reward: [(0, '66.667')] [2024-08-06 02:27:38,068][52811] DAMAGECOUNT value on done: 283242.0 [2024-08-06 02:27:38,068][52811] Sum rewards: 70.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.966', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon5': '0.192', 'AMMO3': '0.207', 'weapon2': '0.244', 'AMMO4': '0.284', 'weapon4': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '58.000'} [2024-08-06 02:27:38,125][52650] Updated weights for policy 0, policy_version 38241 (0.0013) [2024-08-06 02:27:39,156][52664] DAMAGECOUNT value on done: 316096.0 [2024-08-06 02:27:39,158][52664] Sum rewards: 72.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.183', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.070', 'weapon5': '0.164', 'AMMO3': '0.204', 'AMMO4': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '61.000'} [2024-08-06 02:27:39,737][52663] DAMAGECOUNT value on done: 308116.0 [2024-08-06 02:27:39,737][52663] Sum rewards: 55.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.878', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.130', 'weapon5': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.034', 'DAMAGECOUNT': '13.629', 'FRAGCOUNT': '49.000'} [2024-08-06 02:27:40,034][52795] DAMAGECOUNT value on done: 283527.0 [2024-08-06 02:27:40,035][52795] Sum rewards: 70.778, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.349', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.106', 'AMMO4': '0.144', 'AMMO3': '0.151', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '0.850', 'HITCOUNT': '2.930', 'weapon3': '3.184', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 02:27:40,682][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:27:40,811][52803] DAMAGECOUNT value on done: 282891.0 [2024-08-06 02:27:40,812][52803] Sum rewards: 75.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.936', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon5': '0.084', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.400', 'weapon4': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '63.000'} [2024-08-06 02:27:41,063][52811] DAMAGECOUNT value on done: 285972.0 [2024-08-06 02:27:41,063][52811] Sum rewards: 67.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.090', 'AMMO4': '0.124', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '55.000'} [2024-08-06 02:27:42,099][52664] DAMAGECOUNT value on done: 317021.0 [2024-08-06 02:27:42,099][52664] Sum rewards: 57.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.945', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.170', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.728', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:42,295][52663] DAMAGECOUNT value on done: 306319.0 [2024-08-06 02:27:42,297][52663] Sum rewards: 62.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.258', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.222', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:42,623][52650] Updated weights for policy 0, policy_version 38251 (0.0013) [2024-08-06 02:27:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 313352192. Throughput: 0: 4380.7. Samples: 78346090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:27:42,794][52567] Avg episode reward: [(0, '66.356')] [2024-08-06 02:27:43,155][52795] DAMAGECOUNT value on done: 275412.0 [2024-08-06 02:27:43,157][52795] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.337', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.274', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.852', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '55.000'} [2024-08-06 02:27:43,288][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:27:44,012][52803] DAMAGECOUNT value on done: 280860.0 [2024-08-06 02:27:44,020][52803] Sum rewards: 77.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.138', 'weapon4': '0.190', 'AMMO4': '0.196', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '65.000'} [2024-08-06 02:27:44,158][52811] DAMAGECOUNT value on done: 290515.0 [2024-08-06 02:27:44,159][52811] Sum rewards: 54.179, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.434', 'AMMO5': '0.019', 'AMMO2': '0.074', 'weapon5': '0.172', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.202', 'AMMO3': '0.237', 'AMMO4': '0.369', 'weapon2': '0.374', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '47.500'} [2024-08-06 02:27:44,238][52665] DAMAGECOUNT value on done: 298010.0 [2024-08-06 02:27:44,238][52665] Sum rewards: 72.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.224', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.364', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:44,515][52664] DAMAGECOUNT value on done: 317406.0 [2024-08-06 02:27:44,518][52664] Sum rewards: 72.908, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.390', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.116', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.480', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:44,761][52663] DAMAGECOUNT value on done: 298625.0 [2024-08-06 02:27:44,763][52663] Sum rewards: 79.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.560', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.046', 'AMMO4': '0.051', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.228', 'AMMO3': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.412', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '66.000'} [2024-08-06 02:27:45,394][52667] DAMAGECOUNT value on done: 304341.0 [2024-08-06 02:27:45,397][52667] Sum rewards: 73.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.164', 'weapon5': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.372', 'weapon4': '0.390', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:46,187][52795] DAMAGECOUNT value on done: 287471.0 [2024-08-06 02:27:46,187][52795] Sum rewards: 74.937, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.931', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.194', 'AMMO3': '0.208', 'weapon4': '0.224', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '61.000'} [2024-08-06 02:27:47,118][52803] DAMAGECOUNT value on done: 280002.0 [2024-08-06 02:27:47,119][52803] Sum rewards: 56.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.112', 'AMMO3': '0.205', 'AMMO4': '0.209', 'weapon4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:47,145][52664] DAMAGECOUNT value on done: 314804.0 [2024-08-06 02:27:47,147][52664] Sum rewards: 50.970, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.694', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon7': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.122', 'AMMO4': '0.138', 'weapon4': '0.148', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '2.872', 'DAMAGECOUNT': '12.261', 'FRAGCOUNT': '40.000'} [2024-08-06 02:27:47,274][52811] DAMAGECOUNT value on done: 284583.0 [2024-08-06 02:27:47,274][52811] Sum rewards: 75.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.584', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.052', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '63.000'} [2024-08-06 02:27:47,439][52650] Updated weights for policy 0, policy_version 38261 (0.0015) [2024-08-06 02:27:47,531][52665] DAMAGECOUNT value on done: 303707.0 [2024-08-06 02:27:47,535][52665] Sum rewards: 58.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.080', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.424', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '2.944', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '51.000'} [2024-08-06 02:27:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 313442304. Throughput: 0: 4380.0. Samples: 78359310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:27:47,794][52567] Avg episode reward: [(0, '66.689')] [2024-08-06 02:27:47,816][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:27:48,384][52667] DAMAGECOUNT value on done: 309001.0 [2024-08-06 02:27:48,387][52667] Sum rewards: 74.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '64.000'} [2024-08-06 02:27:49,238][52795] DAMAGECOUNT value on done: 280421.0 [2024-08-06 02:27:49,241][52795] Sum rewards: 67.825, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.938', 'AMMO5': '0.018', 'AMMO2': '0.075', 'weapon2': '0.216', 'AMMO3': '0.219', 'weapon5': '0.282', 'AMMO4': '0.377', 'weapon4': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '57.000'} [2024-08-06 02:27:50,167][52803] DAMAGECOUNT value on done: 285115.0 [2024-08-06 02:27:50,169][52803] Sum rewards: 57.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.458', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '49.000'} [2024-08-06 02:27:50,241][52811] DAMAGECOUNT value on done: 283798.0 [2024-08-06 02:27:50,241][52811] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.442', 'AMMO5': '0.021', 'AMMO2': '0.065', 'AMMO3': '0.214', 'weapon5': '0.252', 'AMMO4': '0.323', 'weapon2': '0.338', 'ARMOR': '0.400', 'weapon4': '0.590', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.442', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '54.000'} [2024-08-06 02:27:50,544][52649] DAMAGECOUNT value on done: 294532.0 [2024-08-06 02:27:50,548][52649] Sum rewards: 73.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.168', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.124', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '61.000'} [2024-08-06 02:27:50,583][52665] DAMAGECOUNT value on done: 300923.0 [2024-08-06 02:27:50,584][52665] Sum rewards: 57.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.116', 'weapon4': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '49.000'} [2024-08-06 02:27:51,529][52667] DAMAGECOUNT value on done: 304344.0 [2024-08-06 02:27:51,530][52667] Sum rewards: 66.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.604', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.094', 'AMMO4': '0.153', 'weapon5': '0.156', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '56.000'} [2024-08-06 02:27:51,858][52650] Updated weights for policy 0, policy_version 38271 (0.0011) [2024-08-06 02:27:52,098][52662] DAMAGECOUNT value on done: 312631.0 [2024-08-06 02:27:52,098][52662] Sum rewards: 75.425, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.704', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.113', 'weapon5': '0.126', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '61.000'} [2024-08-06 02:27:52,303][52795] DAMAGECOUNT value on done: 278417.0 [2024-08-06 02:27:52,304][52795] Sum rewards: 71.070, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.684', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '57.000'} [2024-08-06 02:27:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 313524224. Throughput: 0: 4384.9. Samples: 78385670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:27:52,795][52567] Avg episode reward: [(0, '67.247')] [2024-08-06 02:27:53,415][52811] DAMAGECOUNT value on done: 294243.0 [2024-08-06 02:27:53,415][52811] Sum rewards: 67.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.243', 'weapon2': '0.420', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.322', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '57.000'} [2024-08-06 02:27:53,428][52803] DAMAGECOUNT value on done: 280158.0 [2024-08-06 02:27:53,428][52803] Sum rewards: 76.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.084', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.438', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '63.000'} [2024-08-06 02:27:53,721][52665] DAMAGECOUNT value on done: 298492.0 [2024-08-06 02:27:53,723][52665] Sum rewards: 56.355, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.532', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.086', 'weapon4': '0.122', 'AMMO4': '0.163', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.600', 'HITCOUNT': '2.840', 'weapon3': '3.076', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '51.500'} [2024-08-06 02:27:53,747][52649] DAMAGECOUNT value on done: 289980.0 [2024-08-06 02:27:53,751][52649] Sum rewards: 58.371, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.375', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.184', 'AMMO4': '0.245', 'weapon2': '0.262', 'weapon5': '0.274', 'AMMO3': '0.291', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'HITCOUNT': '2.780', 'weapon3': '2.920', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:54,569][52667] DAMAGECOUNT value on done: 306391.0 [2024-08-06 02:27:54,569][52667] Sum rewards: 64.348, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon4': '0.224', 'WEAPON3': '0.850', 'weapon2': '0.864', 'weapon3': '2.694', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '50.000'} [2024-08-06 02:27:54,882][52662] DAMAGECOUNT value on done: 309320.0 [2024-08-06 02:27:54,882][52662] Sum rewards: 37.016, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.743', 'AMMO5': '0.007', 'AMMO2': '0.036', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.102', 'weapon7': '0.120', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon2': '0.196', 'WEAPON4': '0.300', 'WEAPON3': '0.650', 'weapon3': '1.452', 'weapon4': '1.832', 'HITCOUNT': '1.880', 'DAMAGECOUNT': '9.165', 'FRAGCOUNT': '28.000'} [2024-08-06 02:27:55,527][52795] DAMAGECOUNT value on done: 274712.0 [2024-08-06 02:27:55,527][52795] Sum rewards: 58.714, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.989', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.176', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'HITCOUNT': '2.870', 'weapon3': '3.514', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '53.000'} [2024-08-06 02:27:56,609][52803] DAMAGECOUNT value on done: 289915.0 [2024-08-06 02:27:56,609][52803] Sum rewards: 72.673, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '60.500'} [2024-08-06 02:27:56,611][52811] DAMAGECOUNT value on done: 284626.0 [2024-08-06 02:27:56,613][52811] Sum rewards: 73.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.156', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.374', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '62.000'} [2024-08-06 02:27:56,873][52665] DAMAGECOUNT value on done: 295002.0 [2024-08-06 02:27:56,873][52665] Sum rewards: 58.519, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.302', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.182', 'weapon2': '0.316', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.406', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '48.000'} [2024-08-06 02:27:56,907][52650] Updated weights for policy 0, policy_version 38281 (0.0012) [2024-08-06 02:27:56,942][52649] DAMAGECOUNT value on done: 297218.0 [2024-08-06 02:27:56,943][52649] Sum rewards: 68.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.119', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.142', 'AMMO3': '0.225', 'weapon4': '0.290', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2024-08-06 02:27:57,602][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:27:57,637][52667] DAMAGECOUNT value on done: 309212.0 [2024-08-06 02:27:57,638][52667] Sum rewards: 67.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.498', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.033', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.140', 'AMMO4': '0.166', 'AMMO3': '0.223', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.732', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '56.000'} [2024-08-06 02:27:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 313614336. Throughput: 0: 4376.7. Samples: 78411890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:27:57,795][52567] Avg episode reward: [(0, '66.838')] [2024-08-06 02:27:58,163][52662] DAMAGECOUNT value on done: 309249.0 [2024-08-06 02:27:58,164][52662] Sum rewards: 57.073, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.455', 'AMMO5': '0.023', 'AMMO2': '0.062', 'weapon5': '0.192', 'AMMO3': '0.215', 'weapon4': '0.284', 'AMMO4': '0.308', 'weapon2': '0.450', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '48.500'} [2024-08-06 02:27:58,638][52795] DAMAGECOUNT value on done: 284213.0 [2024-08-06 02:27:58,640][52795] Sum rewards: 70.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.864', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.221', 'weapon4': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:59,718][52811] DAMAGECOUNT value on done: 286407.0 [2024-08-06 02:27:59,721][52811] Sum rewards: 78.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.128', 'AMMO4': '0.151', 'AMMO3': '0.222', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '65.000'} [2024-08-06 02:27:59,721][52803] DAMAGECOUNT value on done: 286194.0 [2024-08-06 02:27:59,727][52803] Sum rewards: 71.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.855', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '59.000'} [2024-08-06 02:27:59,862][52665] DAMAGECOUNT value on done: 294547.0 [2024-08-06 02:27:59,863][52665] Sum rewards: 67.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.411', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.840', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '55.500'} [2024-08-06 02:27:59,941][52649] DAMAGECOUNT value on done: 296387.0 [2024-08-06 02:27:59,941][52649] Sum rewards: 68.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:00,769][52662] DAMAGECOUNT value on done: 300615.0 [2024-08-06 02:28:00,770][52662] Sum rewards: 58.676, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.173', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO3': '0.141', 'AMMO4': '0.209', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.614', 'WEAPON3': '0.800', 'weapon3': '2.862', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '45.000'} [2024-08-06 02:28:00,773][52667] DAMAGECOUNT value on done: 308792.0 [2024-08-06 02:28:00,773][52667] Sum rewards: 81.403, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.203', 'HEALTH': '0.253', 'weapon2': '0.386', 'WEAPON3': '0.900', 'weapon3': '3.280', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 02:28:01,156][52650] Updated weights for policy 0, policy_version 38291 (0.0012) [2024-08-06 02:28:01,789][52795] DAMAGECOUNT value on done: 273683.0 [2024-08-06 02:28:01,790][52795] Sum rewards: 65.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.190', 'weapon2': '0.210', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '2.998', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:02,737][52803] DAMAGECOUNT value on done: 281855.0 [2024-08-06 02:28:02,739][52803] Sum rewards: 66.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.062', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO4': '0.189', 'AMMO3': '0.210', 'weapon4': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 313696256. Throughput: 0: 4384.9. Samples: 78425170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 02:28:02,794][52567] Avg episode reward: [(0, '66.754')] [2024-08-06 02:28:02,817][52811] DAMAGECOUNT value on done: 290679.0 [2024-08-06 02:28:02,818][52811] Sum rewards: 72.203, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.274', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:02,925][52665] DAMAGECOUNT value on done: 303274.0 [2024-08-06 02:28:02,927][52665] Sum rewards: 73.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.042', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.124', 'weapon4': '0.138', 'AMMO4': '0.188', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '64.000'} [2024-08-06 02:28:02,951][52668] DAMAGECOUNT value on done: 302414.0 [2024-08-06 02:28:02,953][52668] Sum rewards: 61.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.273', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.154', 'weapon4': '0.234', 'weapon2': '0.268', 'AMMO4': '0.290', 'weapon5': '0.290', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.924', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:03,060][52649] DAMAGECOUNT value on done: 288069.0 [2024-08-06 02:28:03,062][52649] Sum rewards: 72.057, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.136', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:03,827][52667] DAMAGECOUNT value on done: 310540.0 [2024-08-06 02:28:03,828][52667] Sum rewards: 70.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.129', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.276', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '61.000'} [2024-08-06 02:28:04,049][52662] DAMAGECOUNT value on done: 310413.0 [2024-08-06 02:28:04,050][52662] Sum rewards: 74.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.986', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.078', 'AMMO3': '0.202', 'weapon2': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.528', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:04,933][52795] DAMAGECOUNT value on done: 291247.0 [2024-08-06 02:28:04,933][52795] Sum rewards: 77.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.056', 'weapon5': '0.102', 'weapon4': '0.140', 'AMMO3': '0.205', 'AMMO4': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '63.500'} [2024-08-06 02:28:05,682][52803] DAMAGECOUNT value on done: 289786.0 [2024-08-06 02:28:05,682][52803] Sum rewards: 71.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.358', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.188', 'AMMO3': '0.231', 'weapon2': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:05,686][52811] DAMAGECOUNT value on done: 284510.0 [2024-08-06 02:28:05,688][52811] Sum rewards: 64.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.136', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.216', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:05,688][52668] DAMAGECOUNT value on done: 307836.0 [2024-08-06 02:28:05,689][52668] Sum rewards: 56.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.047', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.044', 'weapon2': '0.168', 'AMMO3': '0.187', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '3.266', 'DAMAGECOUNT': '13.845', 'FRAGCOUNT': '48.000'} [2024-08-06 02:28:06,051][52650] Updated weights for policy 0, policy_version 38301 (0.0011) [2024-08-06 02:28:06,114][52665] DAMAGECOUNT value on done: 304128.0 [2024-08-06 02:28:06,115][52665] Sum rewards: 68.478, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.672', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.158', 'weapon4': '0.182', 'AMMO3': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:06,268][52649] DAMAGECOUNT value on done: 299644.0 [2024-08-06 02:28:06,268][52649] Sum rewards: 57.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.614', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '3.502', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:06,523][52667] DAMAGECOUNT value on done: 304747.0 [2024-08-06 02:28:06,524][52667] Sum rewards: 65.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.198', 'AMMO3': '0.232', 'weapon4': '0.238', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '55.000'} [2024-08-06 02:28:07,200][52662] DAMAGECOUNT value on done: 301649.0 [2024-08-06 02:28:07,206][52662] Sum rewards: 81.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '67.000'} [2024-08-06 02:28:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 313786368. Throughput: 0: 4389.6. Samples: 78451620. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:28:07,794][52567] Avg episode reward: [(0, '67.415')] [2024-08-06 02:28:08,220][52795] DAMAGECOUNT value on done: 284016.0 [2024-08-06 02:28:08,221][52795] Sum rewards: 61.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.110', 'AMMO4': '0.169', 'weapon5': '0.180', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '2.932', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '53.000'} [2024-08-06 02:28:08,548][52668] DAMAGECOUNT value on done: 309221.0 [2024-08-06 02:28:08,548][52668] Sum rewards: 65.170, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.182', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.182', 'AMMO4': '0.201', 'AMMO3': '0.262', 'weapon5': '0.274', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:08,697][52820] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:28:08,771][52803] DAMAGECOUNT value on done: 282453.0 [2024-08-06 02:28:08,773][52803] Sum rewards: 71.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.070', 'AMMO4': '0.123', 'weapon5': '0.144', 'weapon2': '0.186', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.396', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:08,800][52667] DAMAGECOUNT value on done: 305624.0 [2024-08-06 02:28:08,802][52667] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.228', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.070', 'weapon5': '0.162', 'AMMO4': '0.167', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:08,806][52811] DAMAGECOUNT value on done: 288225.0 [2024-08-06 02:28:08,807][52811] Sum rewards: 67.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.110', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.902', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:09,329][52665] DAMAGECOUNT value on done: 302606.0 [2024-08-06 02:28:09,331][52665] Sum rewards: 62.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.924', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO4': '0.227', 'AMMO3': '0.229', 'weapon2': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:09,538][52649] DAMAGECOUNT value on done: 295507.0 [2024-08-06 02:28:09,540][52649] Sum rewards: 61.120, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HEALTH': '0.068', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.177', 'weapon4': '0.308', 'weapon2': '0.364', 'WEAPON3': '1.000', 'weapon3': '2.970', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '48.000'} [2024-08-06 02:28:10,263][52662] DAMAGECOUNT value on done: 311550.0 [2024-08-06 02:28:10,263][52662] Sum rewards: 72.511, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.165', 'weapon4': '0.266', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:10,374][52659] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:28:10,650][52658] Large shaping reward 2.609 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:28:10,695][52650] Updated weights for policy 0, policy_version 38311 (0.0014) [2024-08-06 02:28:11,396][52795] DAMAGECOUNT value on done: 274986.0 [2024-08-06 02:28:11,396][52795] Sum rewards: 68.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.354', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:11,656][52668] DAMAGECOUNT value on done: 309665.0 [2024-08-06 02:28:11,656][52668] Sum rewards: 55.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.418', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon7': '0.060', 'AMMO4': '0.085', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.426', 'weapon4': '0.802', 'WEAPON3': '0.900', 'HITCOUNT': '2.360', 'weapon3': '2.468', 'DAMAGECOUNT': '13.308', 'FRAGCOUNT': '46.000'} [2024-08-06 02:28:11,844][52803] DAMAGECOUNT value on done: 282063.0 [2024-08-06 02:28:11,844][52803] Sum rewards: 61.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.359', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.272', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.104', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:11,847][52667] DAMAGECOUNT value on done: 311014.0 [2024-08-06 02:28:11,848][52667] Sum rewards: 60.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.228', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.234', 'weapon2': '0.318', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.384', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '50.500'} [2024-08-06 02:28:11,850][52665] DAMAGECOUNT value on done: 300424.0 [2024-08-06 02:28:11,852][52665] Sum rewards: 68.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.552', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.148', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:12,031][52649] DAMAGECOUNT value on done: 301342.0 [2024-08-06 02:28:12,032][52649] Sum rewards: 61.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.423', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.090', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:12,035][52811] DAMAGECOUNT value on done: 287632.0 [2024-08-06 02:28:12,035][52811] Sum rewards: 60.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.111', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 313876480. Throughput: 0: 4398.0. Samples: 78477950. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:28:12,794][52567] Avg episode reward: [(0, '67.221')] [2024-08-06 02:28:12,913][52662] DAMAGECOUNT value on done: 316430.0 [2024-08-06 02:28:12,913][52662] Sum rewards: 76.530, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.721', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO3': '0.176', 'weapon4': '0.204', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '61.000'} [2024-08-06 02:28:14,481][52795] DAMAGECOUNT value on done: 284892.0 [2024-08-06 02:28:14,483][52795] Sum rewards: 65.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.416', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.064', 'weapon5': '0.128', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'AMMO4': '0.318', 'weapon2': '0.352', 'WEAPON4': '0.500', 'weapon4': '0.760', 'WEAPON3': '1.000', 'weapon3': '2.492', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:14,615][52668] DAMAGECOUNT value on done: 299342.0 [2024-08-06 02:28:14,615][52668] Sum rewards: 65.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.771', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.134', 'weapon4': '0.192', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:14,709][52665] DAMAGECOUNT value on done: 308082.0 [2024-08-06 02:28:14,710][52665] Sum rewards: 75.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.578', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.182', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '3.302', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:14,882][52667] DAMAGECOUNT value on done: 304436.0 [2024-08-06 02:28:14,884][52667] Sum rewards: 71.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.210', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.276', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.252', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:14,896][52803] DAMAGECOUNT value on done: 290736.0 [2024-08-06 02:28:14,898][52803] Sum rewards: 70.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.826', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.100', 'AMMO4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:14,905][52649] DAMAGECOUNT value on done: 297902.0 [2024-08-06 02:28:14,905][52649] Sum rewards: 72.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.705', 'AMMO5': '0.006', 'AMMO2': '0.050', 'weapon5': '0.078', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.852', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:15,199][52647] DAMAGECOUNT value on done: 321846.0 [2024-08-06 02:28:15,199][52647] Sum rewards: 58.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.146', 'weapon5': '0.160', 'weapon4': '0.186', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.754', 'WEAPON3': '0.800', 'weapon3': '2.712', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.211', 'FRAGCOUNT': '45.500'} [2024-08-06 02:28:15,210][52811] DAMAGECOUNT value on done: 281695.0 [2024-08-06 02:28:15,213][52811] Sum rewards: 74.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.324', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.134', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.332', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.650', 'weapon3': '2.806', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '64.500'} [2024-08-06 02:28:15,251][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:28:15,484][52650] Updated weights for policy 0, policy_version 38321 (0.0045) [2024-08-06 02:28:16,059][52662] DAMAGECOUNT value on done: 306838.0 [2024-08-06 02:28:16,063][52662] Sum rewards: 66.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.534', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.018', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.454', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.206', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:16,396][52820] DAMAGECOUNT value on done: 278678.0 [2024-08-06 02:28:16,399][52820] Sum rewards: 70.381, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.648', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.404', 'WEAPON3': '1.650', 'weapon3': '3.164', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:17,466][52668] DAMAGECOUNT value on done: 309401.0 [2024-08-06 02:28:17,468][52668] Sum rewards: 63.404, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.360', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.178', 'weapon4': '0.258', 'AMMO3': '0.272', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.822', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:17,576][52795] DAMAGECOUNT value on done: 288092.0 [2024-08-06 02:28:17,577][52795] Sum rewards: 61.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.011', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.088', 'weapon5': '0.110', 'AMMO4': '0.132', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.192', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:17,631][52647] DAMAGECOUNT value on done: 321519.0 [2024-08-06 02:28:17,632][52647] Sum rewards: 55.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.844', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.120', 'weapon2': '0.192', 'AMMO3': '0.207', 'AMMO4': '0.241', 'weapon5': '0.252', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.838', 'WEAPON3': '1.300', 'weapon3': '2.354', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '47.000'} [2024-08-06 02:28:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 313966592. Throughput: 0: 4394.2. Samples: 78490940. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:28:17,794][52567] Avg episode reward: [(0, '67.000')] [2024-08-06 02:28:17,807][52665] DAMAGECOUNT value on done: 303546.0 [2024-08-06 02:28:17,811][52665] Sum rewards: 60.685, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.670', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.058', 'AMMO3': '0.163', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.940', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:18,000][52649] DAMAGECOUNT value on done: 298127.0 [2024-08-06 02:28:18,001][52649] Sum rewards: 65.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.856', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.184', 'AMMO4': '0.211', 'weapon5': '0.294', 'weapon4': '0.296', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '53.000'} [2024-08-06 02:28:18,024][52667] DAMAGECOUNT value on done: 308245.0 [2024-08-06 02:28:18,026][52667] Sum rewards: 66.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.928', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon4': '0.142', 'weapon5': '0.156', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.074', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '55.000'} [2024-08-06 02:28:18,045][52803] DAMAGECOUNT value on done: 283627.0 [2024-08-06 02:28:18,045][52803] Sum rewards: 73.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.475', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.223', 'weapon5': '0.256', 'AMMO4': '0.308', 'weapon4': '0.332', 'weapon2': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:18,257][52811] DAMAGECOUNT value on done: 286742.0 [2024-08-06 02:28:18,258][52811] Sum rewards: 67.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.110', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.251', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:18,859][52669] DAMAGECOUNT value on done: 309596.0 [2024-08-06 02:28:18,861][52669] Sum rewards: 67.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.489', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.174', 'weapon4': '0.180', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '55.000'} [2024-08-06 02:28:19,111][52662] DAMAGECOUNT value on done: 318059.0 [2024-08-06 02:28:19,112][52662] Sum rewards: 71.386, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.146', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'weapon2': '0.484', 'WEAPON3': '1.700', 'weapon3': '3.156', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:19,515][52820] DAMAGECOUNT value on done: 282882.0 [2024-08-06 02:28:19,515][52820] Sum rewards: 69.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.984', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.101', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:19,837][52650] Updated weights for policy 0, policy_version 38331 (0.0014) [2024-08-06 02:28:20,213][52647] DAMAGECOUNT value on done: 322095.0 [2024-08-06 02:28:20,214][52647] Sum rewards: 68.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.226', 'AMMO5': '0.004', 'AMMO2': '0.033', 'weapon5': '0.040', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.163', 'weapon2': '0.204', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.420', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:20,217][52664] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:28:20,457][52668] DAMAGECOUNT value on done: 307292.0 [2024-08-06 02:28:20,457][52668] Sum rewards: 83.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'weapon4': '0.134', 'AMMO3': '0.169', 'WEAPON7': '0.200', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '68.000'} [2024-08-06 02:28:20,731][52667] DAMAGECOUNT value on done: 305434.0 [2024-08-06 02:28:20,732][52667] Sum rewards: 64.816, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.324', 'HEALTH': '0.832', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.238', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:20,746][52665] DAMAGECOUNT value on done: 302387.0 [2024-08-06 02:28:20,747][52665] Sum rewards: 65.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:21,017][52649] DAMAGECOUNT value on done: 298769.0 [2024-08-06 02:28:21,017][52649] Sum rewards: 66.102, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.013', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.208', 'AMMO4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:21,059][52803] DAMAGECOUNT value on done: 288847.0 [2024-08-06 02:28:21,061][52803] Sum rewards: 68.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.426', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'weapon7': '0.140', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.364', 'WEAPON3': '0.900', 'weapon3': '2.920', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:21,321][52669] DAMAGECOUNT value on done: 302089.0 [2024-08-06 02:28:21,321][52669] Sum rewards: 63.593, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.032', 'AMMO2': '0.036', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.298', 'weapon2': '0.320', 'WEAPON3': '1.700', 'HITCOUNT': '3.300', 'weapon3': '3.304', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:21,355][52811] DAMAGECOUNT value on done: 288048.0 [2024-08-06 02:28:21,356][52811] Sum rewards: 66.942, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.566', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:21,503][52649] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:28:21,839][52660] DAMAGECOUNT value on done: 301940.0 [2024-08-06 02:28:21,839][52660] Sum rewards: 70.192, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.937', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.071', 'weapon5': '0.080', 'WEAPON4': '0.150', 'weapon2': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '3.370', 'weapon3': '3.442', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:22,500][52662] DAMAGECOUNT value on done: 304089.0 [2024-08-06 02:28:22,503][52662] Sum rewards: 59.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.066', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.100', 'weapon5': '0.108', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.234', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:22,605][52820] DAMAGECOUNT value on done: 281283.0 [2024-08-06 02:28:22,607][52820] Sum rewards: 64.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'AMMO5': '0.017', 'AMMO2': '0.073', 'AMMO3': '0.195', 'weapon5': '0.274', 'weapon2': '0.292', 'AMMO4': '0.365', 'weapon4': '0.394', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:22,652][52647] DAMAGECOUNT value on done: 324685.0 [2024-08-06 02:28:22,652][52647] Sum rewards: 68.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.133', 'weapon5': '0.260', 'AMMO4': '0.299', 'weapon2': '0.346', 'WEAPON5': '0.450', 'weapon4': '0.464', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon3': '2.696', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 314048512. Throughput: 0: 4393.8. Samples: 78517250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:28:22,795][52567] Avg episode reward: [(0, '66.738')] [2024-08-06 02:28:23,496][52667] DAMAGECOUNT value on done: 302778.0 [2024-08-06 02:28:23,499][52667] Sum rewards: 67.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.244', 'AMMO3': '0.248', 'AMMO4': '0.289', 'weapon2': '0.310', 'weapon5': '0.310', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '2.766', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:23,552][52668] DAMAGECOUNT value on done: 302603.0 [2024-08-06 02:28:23,554][52668] Sum rewards: 64.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.175', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'AMMO4': '0.199', 'weapon2': '0.240', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.218', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:23,882][52665] DAMAGECOUNT value on done: 301906.0 [2024-08-06 02:28:23,882][52665] Sum rewards: 55.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.137', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '2.966', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '47.000'} [2024-08-06 02:28:23,917][52669] DAMAGECOUNT value on done: 308748.0 [2024-08-06 02:28:23,918][52669] Sum rewards: 71.893, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.192', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.108', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:24,058][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:28:24,165][52649] DAMAGECOUNT value on done: 299352.0 [2024-08-06 02:28:24,165][52649] Sum rewards: 67.420, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.433', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.140', 'weapon5': '0.176', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '53.000'} [2024-08-06 02:28:24,246][52803] DAMAGECOUNT value on done: 278657.0 [2024-08-06 02:28:24,247][52803] Sum rewards: 69.445, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.425', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.124', 'AMMO4': '0.171', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:24,415][52811] DAMAGECOUNT value on done: 283328.0 [2024-08-06 02:28:24,416][52811] Sum rewards: 70.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.052', 'weapon4': '0.106', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.380', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:24,587][52650] Updated weights for policy 0, policy_version 38341 (0.0043) [2024-08-06 02:28:24,843][52660] DAMAGECOUNT value on done: 299440.0 [2024-08-06 02:28:24,844][52660] Sum rewards: 71.269, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.296', 'weapon2': '0.526', 'HEALTH': '0.846', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:25,173][52647] DAMAGECOUNT value on done: 320734.0 [2024-08-06 02:28:25,173][52647] Sum rewards: 64.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.148', 'AMMO4': '0.208', 'weapon4': '0.226', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:25,703][52662] DAMAGECOUNT value on done: 305379.0 [2024-08-06 02:28:25,703][52662] Sum rewards: 77.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.736', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.139', 'AMMO3': '0.177', 'weapon4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 02:28:25,782][52820] DAMAGECOUNT value on done: 277171.0 [2024-08-06 02:28:25,784][52820] Sum rewards: 71.097, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.146', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO3': '0.113', 'AMMO4': '0.118', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.344', 'weapon2': '0.498', 'WEAPON3': '0.750', 'weapon3': '2.746', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:26,206][52668] DAMAGECOUNT value on done: 307249.0 [2024-08-06 02:28:26,208][52668] Sum rewards: 75.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.775', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.211', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '64.000'} [2024-08-06 02:28:26,207][52667] DAMAGECOUNT value on done: 310605.0 [2024-08-06 02:28:26,210][52667] Sum rewards: 59.854, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.288', 'AMMO5': '0.021', 'AMMO2': '0.068', 'AMMO3': '0.191', 'AMMO4': '0.340', 'weapon5': '0.344', 'weapon2': '0.484', 'weapon4': '0.588', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.234', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:26,891][52669] DAMAGECOUNT value on done: 303392.0 [2024-08-06 02:28:26,891][52669] Sum rewards: 61.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.041', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO4': '0.206', 'AMMO3': '0.216', 'WEAPON4': '0.400', 'weapon4': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:26,919][52665] DAMAGECOUNT value on done: 302460.0 [2024-08-06 02:28:26,922][52665] Sum rewards: 68.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.112', 'weapon5': '0.186', 'AMMO3': '0.207', 'AMMO4': '0.216', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:27,264][52649] DAMAGECOUNT value on done: 300908.0 [2024-08-06 02:28:27,264][52649] Sum rewards: 54.633, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.442', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.114', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '49.000'} [2024-08-06 02:28:27,552][52660] DAMAGECOUNT value on done: 309910.0 [2024-08-06 02:28:27,554][52660] Sum rewards: 83.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.064', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '68.000'} [2024-08-06 02:28:27,618][52647] DAMAGECOUNT value on done: 325485.0 [2024-08-06 02:28:27,619][52647] Sum rewards: 62.540, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon2': '0.640', 'WEAPON3': '1.000', 'weapon3': '3.090', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '49.000'} [2024-08-06 02:28:27,695][52811] DAMAGECOUNT value on done: 288702.0 [2024-08-06 02:28:27,695][52811] Sum rewards: 44.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon7': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.130', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.183', 'WEAPON7': '0.200', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon4': '1.486', 'weapon3': '1.890', 'HITCOUNT': '2.150', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '38.000'} [2024-08-06 02:28:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 314138624. Throughput: 0: 4390.7. Samples: 78543670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:28:27,794][52567] Avg episode reward: [(0, '66.758')] [2024-08-06 02:28:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038347_314138624.pth... [2024-08-06 02:28:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000037834_309936128.pth [2024-08-06 02:28:29,003][52662] DAMAGECOUNT value on done: 309041.0 [2024-08-06 02:28:29,005][52662] Sum rewards: 62.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.148', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.148', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:29,006][52794] DAMAGECOUNT value on done: 307731.0 [2024-08-06 02:28:29,009][52794] Sum rewards: 61.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.400', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.137', 'weapon5': '0.186', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.718', 'WEAPON3': '1.600', 'weapon3': '2.780', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:29,020][52668] DAMAGECOUNT value on done: 306075.0 [2024-08-06 02:28:29,022][52668] Sum rewards: 74.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '61.000'} [2024-08-06 02:28:29,026][52820] DAMAGECOUNT value on done: 283585.0 [2024-08-06 02:28:29,027][52820] Sum rewards: 63.273, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.638', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.036', 'weapon4': '0.072', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:29,211][52650] Updated weights for policy 0, policy_version 38351 (0.0017) [2024-08-06 02:28:29,399][52667] DAMAGECOUNT value on done: 313838.0 [2024-08-06 02:28:29,399][52667] Sum rewards: 60.141, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.688', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.143', 'AMMO4': '0.184', 'weapon5': '0.230', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON3': '0.900', 'weapon3': '2.712', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '46.000'} [2024-08-06 02:28:29,669][52669] DAMAGECOUNT value on done: 303318.0 [2024-08-06 02:28:29,670][52669] Sum rewards: 83.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.387', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO4': '0.201', 'AMMO3': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.859', 'FRAGCOUNT': '69.000'} [2024-08-06 02:28:30,322][52665] DAMAGECOUNT value on done: 300032.0 [2024-08-06 02:28:30,323][52665] Sum rewards: 82.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.345', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '70.000'} [2024-08-06 02:28:30,343][52647] DAMAGECOUNT value on done: 322226.0 [2024-08-06 02:28:30,344][52647] Sum rewards: 60.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.172', 'weapon5': '0.182', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '2.886', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:30,428][52660] DAMAGECOUNT value on done: 308529.0 [2024-08-06 02:28:30,430][52660] Sum rewards: 72.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.922', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.084', 'weapon4': '0.088', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:30,601][52649] DAMAGECOUNT value on done: 302338.0 [2024-08-06 02:28:30,605][52649] Sum rewards: 68.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.410', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.120', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.278', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:30,716][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:28:31,989][52668] DAMAGECOUNT value on done: 310068.0 [2024-08-06 02:28:31,990][52668] Sum rewards: 68.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.181', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.186', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:32,164][52820] DAMAGECOUNT value on done: 276517.0 [2024-08-06 02:28:32,164][52820] Sum rewards: 49.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.076', 'AMMO3': '0.170', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.428', 'weapon4': '0.458', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '41.500'} [2024-08-06 02:28:32,187][52662] DAMAGECOUNT value on done: 313415.0 [2024-08-06 02:28:32,187][52662] Sum rewards: 52.106, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.122', 'AMMO3': '0.155', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.964', 'DAMAGECOUNT': '13.653', 'FRAGCOUNT': '42.000'} [2024-08-06 02:28:32,191][52794] DAMAGECOUNT value on done: 312472.0 [2024-08-06 02:28:32,194][52794] Sum rewards: 69.021, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.755', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.158', 'AMMO4': '0.172', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.306', 'weapon4': '0.334', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:32,210][52667] DAMAGECOUNT value on done: 309682.0 [2024-08-06 02:28:32,212][52667] Sum rewards: 68.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.128', 'weapon2': '0.172', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.378', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:32,266][52669] DAMAGECOUNT value on done: 306215.0 [2024-08-06 02:28:32,266][52669] Sum rewards: 59.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.067', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 314228736. Throughput: 0: 4382.0. Samples: 78556500. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:28:32,794][52567] Avg episode reward: [(0, '66.780')] [2024-08-06 02:28:33,050][52647] DAMAGECOUNT value on done: 318510.0 [2024-08-06 02:28:33,058][52647] Sum rewards: 65.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.227', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.048', 'AMMO4': '0.154', 'AMMO3': '0.208', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:33,105][52660] DAMAGECOUNT value on done: 305631.0 [2024-08-06 02:28:33,105][52660] Sum rewards: 70.561, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.814', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon4': '0.230', 'AMMO3': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '2.960', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:33,176][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:28:33,344][52665] DAMAGECOUNT value on done: 299006.0 [2024-08-06 02:28:33,346][52665] Sum rewards: 67.337, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.125', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.123', 'weapon2': '0.592', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.246', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:33,779][52649] DAMAGECOUNT value on done: 293237.0 [2024-08-06 02:28:33,780][52649] Sum rewards: 64.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.042', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:34,325][52650] Updated weights for policy 0, policy_version 38361 (0.0013) [2024-08-06 02:28:35,047][52662] DAMAGECOUNT value on done: 307047.0 [2024-08-06 02:28:35,047][52662] Sum rewards: 57.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.776', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.296', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '48.000'} [2024-08-06 02:28:35,056][52794] DAMAGECOUNT value on done: 305068.0 [2024-08-06 02:28:35,058][52794] Sum rewards: 57.313, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'weapon5': '0.030', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.185', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.368', 'ARMOR': '0.400', 'HEALTH': '0.689', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.136', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '48.000'} [2024-08-06 02:28:35,068][52668] DAMAGECOUNT value on done: 303256.0 [2024-08-06 02:28:35,069][52668] Sum rewards: 82.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.376', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '69.000'} [2024-08-06 02:28:35,116][52820] DAMAGECOUNT value on done: 279126.0 [2024-08-06 02:28:35,117][52820] Sum rewards: 62.837, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'weapon7': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.114', 'weapon4': '0.186', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'AMMO4': '0.253', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '55.000'} [2024-08-06 02:28:35,287][52647] DAMAGECOUNT value on done: 325675.0 [2024-08-06 02:28:35,288][52647] Sum rewards: 67.778, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.607', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.192', 'AMMO3': '0.210', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:35,303][52667] DAMAGECOUNT value on done: 313144.0 [2024-08-06 02:28:35,303][52667] Sum rewards: 68.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.158', 'weapon5': '0.196', 'AMMO3': '0.215', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:35,702][52669] DAMAGECOUNT value on done: 306967.0 [2024-08-06 02:28:35,703][52669] Sum rewards: 43.133, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.105', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.178', 'weapon4': '0.216', 'AMMO3': '0.244', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.690', 'WEAPON3': '1.450', 'HITCOUNT': '2.550', 'weapon3': '2.704', 'DAMAGECOUNT': '12.684', 'FRAGCOUNT': '41.000'} [2024-08-06 02:28:36,441][52660] DAMAGECOUNT value on done: 300532.0 [2024-08-06 02:28:36,443][52660] Sum rewards: 75.869, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.550', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.109', 'AMMO3': '0.154', 'weapon2': '0.738', 'WEAPON3': '0.950', 'weapon3': '3.056', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:36,459][52665] DAMAGECOUNT value on done: 299265.0 [2024-08-06 02:28:36,459][52665] Sum rewards: 66.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.335', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.210', 'AMMO3': '0.261', 'WEAPON3': '1.650', 'HITCOUNT': '3.410', 'weapon3': '3.432', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:36,636][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:28:36,974][52658] DAMAGECOUNT value on done: 306137.0 [2024-08-06 02:28:36,975][52658] Sum rewards: 61.530, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.345', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.388', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:36,983][52649] DAMAGECOUNT value on done: 299115.0 [2024-08-06 02:28:36,983][52649] Sum rewards: 74.708, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.018', 'weapon5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon2': '0.522', 'WEAPON3': '0.950', 'weapon3': '3.334', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 314318848. Throughput: 0: 4376.9. Samples: 78582630. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:28:37,795][52567] Avg episode reward: [(0, '66.481')] [2024-08-06 02:28:37,798][52647] DAMAGECOUNT value on done: 319929.0 [2024-08-06 02:28:37,798][52647] Sum rewards: 67.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.102', 'weapon4': '0.112', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'weapon2': '0.762', 'WEAPON3': '1.050', 'weapon3': '2.840', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '55.000'} [2024-08-06 02:28:38,089][52662] DAMAGECOUNT value on done: 320349.0 [2024-08-06 02:28:38,089][52662] Sum rewards: 66.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'AMMO2': '0.008', 'AMMO5': '0.015', 'AMMO4': '0.039', 'weapon5': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:38,113][52794] DAMAGECOUNT value on done: 305392.0 [2024-08-06 02:28:38,114][52794] Sum rewards: 59.405, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.698', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '49.000'} [2024-08-06 02:28:38,195][52668] DAMAGECOUNT value on done: 296222.0 [2024-08-06 02:28:38,197][52668] Sum rewards: 61.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.064', 'weapon4': '0.070', 'AMMO4': '0.151', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.290', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:38,208][52820] DAMAGECOUNT value on done: 285267.0 [2024-08-06 02:28:38,208][52820] Sum rewards: 69.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.326', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.064', 'weapon4': '0.066', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:38,394][52667] DAMAGECOUNT value on done: 303436.0 [2024-08-06 02:28:38,394][52667] Sum rewards: 64.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon2': '0.232', 'AMMO3': '0.234', 'weapon4': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2024-08-06 02:28:38,766][52650] Updated weights for policy 0, policy_version 38371 (0.0042) [2024-08-06 02:28:38,891][52669] DAMAGECOUNT value on done: 307474.0 [2024-08-06 02:28:38,892][52669] Sum rewards: 61.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.233', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.136', 'AMMO3': '0.192', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:39,537][52665] DAMAGECOUNT value on done: 301938.0 [2024-08-06 02:28:39,537][52665] Sum rewards: 64.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.322', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '53.000'} [2024-08-06 02:28:39,621][52660] DAMAGECOUNT value on done: 306956.0 [2024-08-06 02:28:39,621][52660] Sum rewards: 62.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.978', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.074', 'AMMO3': '0.237', 'weapon5': '0.260', 'weapon2': '0.278', 'weapon4': '0.364', 'AMMO4': '0.371', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '53.000'} [2024-08-06 02:28:40,018][52649] DAMAGECOUNT value on done: 297316.0 [2024-08-06 02:28:40,021][52649] Sum rewards: 74.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.066', 'AMMO4': '0.122', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '63.000'} [2024-08-06 02:28:40,131][52658] DAMAGECOUNT value on done: 306360.0 [2024-08-06 02:28:40,133][52658] Sum rewards: 77.823, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon2': '0.158', 'AMMO3': '0.168', 'weapon5': '0.176', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.320', 'weapon3': '3.362', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '63.000'} [2024-08-06 02:28:40,411][52647] DAMAGECOUNT value on done: 325930.0 [2024-08-06 02:28:40,412][52647] Sum rewards: 70.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.334', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:40,891][52668] DAMAGECOUNT value on done: 297830.0 [2024-08-06 02:28:40,893][52668] Sum rewards: 65.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.066', 'AMMO4': '0.176', 'weapon5': '0.182', 'AMMO3': '0.188', 'weapon2': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.342', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:41,162][52662] DAMAGECOUNT value on done: 310316.0 [2024-08-06 02:28:41,162][52662] Sum rewards: 75.272, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.005', 'AMMO5': '0.018', 'AMMO2': '0.069', 'weapon4': '0.134', 'AMMO3': '0.269', 'weapon5': '0.278', 'weapon2': '0.294', 'AMMO4': '0.345', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.952', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '65.000'} [2024-08-06 02:28:41,176][52667] DAMAGECOUNT value on done: 309922.0 [2024-08-06 02:28:41,176][52667] Sum rewards: 71.325, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.090', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.128', 'weapon2': '0.170', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '61.000'} [2024-08-06 02:28:41,177][52794] DAMAGECOUNT value on done: 303595.0 [2024-08-06 02:28:41,178][52794] Sum rewards: 60.763, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.120', 'AMMO4': '0.211', 'AMMO3': '0.216', 'weapon5': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '2.610', 'weapon3': '2.850', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:41,358][52820] DAMAGECOUNT value on done: 281989.0 [2024-08-06 02:28:41,358][52820] Sum rewards: 73.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon2': '0.200', 'weapon5': '0.202', 'AMMO3': '0.207', 'AMMO4': '0.231', 'weapon4': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '61.000'} [2024-08-06 02:28:42,191][52669] DAMAGECOUNT value on done: 306123.0 [2024-08-06 02:28:42,192][52669] Sum rewards: 69.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.023', 'AMMO2': '0.053', 'AMMO3': '0.163', 'AMMO4': '0.265', 'weapon2': '0.308', 'weapon5': '0.322', 'weapon4': '0.374', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.640', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:42,203][52660] DAMAGECOUNT value on done: 311714.0 [2024-08-06 02:28:42,203][52660] Sum rewards: 69.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.090', 'AMMO3': '0.202', 'AMMO4': '0.236', 'weapon2': '0.258', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:42,471][52665] DAMAGECOUNT value on done: 301957.0 [2024-08-06 02:28:42,471][52665] Sum rewards: 58.666, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.570', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon5': '0.254', 'AMMO3': '0.298', 'AMMO4': '0.300', 'weapon2': '0.400', 'weapon4': '0.444', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.504', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '53.000'} [2024-08-06 02:28:42,707][52658] DAMAGECOUNT value on done: 310165.0 [2024-08-06 02:28:42,708][52658] Sum rewards: 67.678, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.092', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '3.006', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 314400768. Throughput: 0: 4375.6. Samples: 78608790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:28:42,794][52567] Avg episode reward: [(0, '66.611')] [2024-08-06 02:28:42,932][52649] DAMAGECOUNT value on done: 301799.0 [2024-08-06 02:28:42,932][52649] Sum rewards: 67.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.099', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.290', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.304', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:43,349][52650] Updated weights for policy 0, policy_version 38381 (0.0013) [2024-08-06 02:28:43,496][52647] DAMAGECOUNT value on done: 316611.0 [2024-08-06 02:28:43,497][52647] Sum rewards: 67.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.131', 'weapon5': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.310', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:43,894][52668] DAMAGECOUNT value on done: 298626.0 [2024-08-06 02:28:43,895][52668] Sum rewards: 68.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.265', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO4': '0.126', 'AMMO3': '0.160', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.816', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '57.500'} [2024-08-06 02:28:44,022][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.03, -10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:28:44,415][52662] DAMAGECOUNT value on done: 310256.0 [2024-08-06 02:28:44,417][52662] Sum rewards: 64.717, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.476', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon4': '0.218', 'weapon5': '0.232', 'AMMO3': '0.238', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:44,421][52794] DAMAGECOUNT value on done: 309164.0 [2024-08-06 02:28:44,424][52794] Sum rewards: 65.708, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.921', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.226', 'AMMO3': '0.321', 'WEAPON3': '1.850', 'weapon3': '3.140', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:44,477][52820] DAMAGECOUNT value on done: 284532.0 [2024-08-06 02:28:44,478][52820] Sum rewards: 62.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.465', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.095', 'weapon5': '0.110', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.186', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:44,763][52669] DAMAGECOUNT value on done: 304123.0 [2024-08-06 02:28:44,764][52669] Sum rewards: 67.040, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.670', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.040', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon4': '0.292', 'AMMO3': '0.330', 'WEAPON3': '1.950', 'weapon3': '3.244', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:45,259][52660] DAMAGECOUNT value on done: 309063.0 [2024-08-06 02:28:45,260][52660] Sum rewards: 60.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.136', 'weapon5': '0.146', 'AMMO3': '0.191', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:45,881][52649] DAMAGECOUNT value on done: 303377.0 [2024-08-06 02:28:45,882][52649] Sum rewards: 65.721, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.312', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.138', 'AMMO3': '0.180', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '2.910', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:46,094][52658] DAMAGECOUNT value on done: 306309.0 [2024-08-06 02:28:46,095][52658] Sum rewards: 71.400, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.288', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon2': '0.252', 'AMMO3': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.570', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '61.000'} [2024-08-06 02:28:46,408][52647] DAMAGECOUNT value on done: 319720.0 [2024-08-06 02:28:46,408][52647] Sum rewards: 68.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.825', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.173', 'weapon4': '0.184', 'weapon5': '0.206', 'AMMO4': '0.246', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:46,414][52668] DAMAGECOUNT value on done: 302577.0 [2024-08-06 02:28:46,416][52668] Sum rewards: 69.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.113', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.680', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:47,477][52662] DAMAGECOUNT value on done: 307770.0 [2024-08-06 02:28:47,478][52662] Sum rewards: 68.599, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon4': '0.102', 'WEAPON4': '0.150', 'weapon2': '0.242', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'weapon3': '3.360', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:47,511][52794] DAMAGECOUNT value on done: 312720.0 [2024-08-06 02:28:47,513][52794] Sum rewards: 63.250, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.815', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.054', 'weapon4': '0.118', 'AMMO4': '0.192', 'AMMO3': '0.209', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.286', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '54.500'} [2024-08-06 02:28:47,587][52820] DAMAGECOUNT value on done: 284496.0 [2024-08-06 02:28:47,589][52820] Sum rewards: 63.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.128', 'AMMO3': '0.167', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.074', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:47,771][52660] DAMAGECOUNT value on done: 302913.0 [2024-08-06 02:28:47,772][52660] Sum rewards: 68.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.315', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.608', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 314490880. Throughput: 0: 4373.8. Samples: 78621990. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:28:47,794][52567] Avg episode reward: [(0, '66.615')] [2024-08-06 02:28:47,827][52669] DAMAGECOUNT value on done: 310283.0 [2024-08-06 02:28:47,828][52669] Sum rewards: 57.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.067', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.054', 'AMMO4': '0.165', 'weapon5': '0.212', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.046', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '48.000'} [2024-08-06 02:28:48,233][52650] Updated weights for policy 0, policy_version 38391 (0.0011) [2024-08-06 02:28:48,749][52649] DAMAGECOUNT value on done: 302782.0 [2024-08-06 02:28:48,750][52649] Sum rewards: 62.452, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.012', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO4': '0.195', 'AMMO3': '0.244', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:48,874][52647] DAMAGECOUNT value on done: 321254.0 [2024-08-06 02:28:48,874][52647] Sum rewards: 73.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.182', 'weapon5': '0.204', 'AMMO3': '0.230', 'AMMO4': '0.249', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:49,093][52658] DAMAGECOUNT value on done: 305994.0 [2024-08-06 02:28:49,095][52658] Sum rewards: 70.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO2': '0.020', 'weapon4': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.275', 'weapon2': '0.694', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:49,513][52668] DAMAGECOUNT value on done: 305407.0 [2024-08-06 02:28:49,513][52668] Sum rewards: 62.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon2': '0.176', 'weapon5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.186', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '51.000'} [2024-08-06 02:28:50,499][52662] DAMAGECOUNT value on done: 302945.0 [2024-08-06 02:28:50,501][52662] Sum rewards: 66.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.084', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.200', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:50,558][52794] DAMAGECOUNT value on done: 307251.0 [2024-08-06 02:28:50,559][52794] Sum rewards: 66.687, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.292', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.148', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.036', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.500'} [2024-08-06 02:28:50,596][52660] DAMAGECOUNT value on done: 313095.0 [2024-08-06 02:28:50,599][52660] Sum rewards: 62.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.348', 'AMMO5': '0.015', 'AMMO2': '0.066', 'AMMO3': '0.188', 'weapon5': '0.238', 'AMMO4': '0.329', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.650', 'weapon4': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.410', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '50.000'} [2024-08-06 02:28:50,689][52820] DAMAGECOUNT value on done: 285747.0 [2024-08-06 02:28:50,689][52820] Sum rewards: 70.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.244', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:50,777][52669] DAMAGECOUNT value on done: 306775.0 [2024-08-06 02:28:50,777][52669] Sum rewards: 69.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.691', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.216', 'AMMO3': '0.240', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.716', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:51,274][52647] DAMAGECOUNT value on done: 328716.0 [2024-08-06 02:28:51,275][52647] Sum rewards: 72.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.145', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.326', 'weapon4': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:51,909][52658] DAMAGECOUNT value on done: 305448.0 [2024-08-06 02:28:51,909][52658] Sum rewards: 68.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.842', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.152', 'weapon4': '0.200', 'AMMO3': '0.240', 'AMMO4': '0.244', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:52,273][52668] DAMAGECOUNT value on done: 307011.0 [2024-08-06 02:28:52,274][52668] Sum rewards: 75.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.310', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 02:28:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 314572800. Throughput: 0: 4368.9. Samples: 78648220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:28:52,794][52567] Avg episode reward: [(0, '66.577')] [2024-08-06 02:28:52,931][52650] Updated weights for policy 0, policy_version 38401 (0.0027) [2024-08-06 02:28:53,345][52794] DAMAGECOUNT value on done: 314241.0 [2024-08-06 02:28:53,347][52794] Sum rewards: 66.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.048', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.240', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '55.000'} [2024-08-06 02:28:53,424][52660] DAMAGECOUNT value on done: 298878.0 [2024-08-06 02:28:53,425][52660] Sum rewards: 70.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.423', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.124', 'AMMO4': '0.174', 'weapon5': '0.188', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:53,774][52820] DAMAGECOUNT value on done: 285765.0 [2024-08-06 02:28:53,779][52820] Sum rewards: 69.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.234', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.186', 'AMMO3': '0.195', 'AMMO4': '0.228', 'weapon5': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.746', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '56.000'} [2024-08-06 02:28:54,182][52669] DAMAGECOUNT value on done: 305448.0 [2024-08-06 02:28:54,184][52669] Sum rewards: 69.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.134', 'weapon4': '0.152', 'AMMO3': '0.192', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:54,242][52647] DAMAGECOUNT value on done: 322995.0 [2024-08-06 02:28:54,242][52647] Sum rewards: 65.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.133', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.354', 'weapon4': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '54.000'} [2024-08-06 02:28:54,633][52671] DAMAGECOUNT value on done: 311048.0 [2024-08-06 02:28:54,634][52671] Sum rewards: 58.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon4': '0.192', 'weapon2': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.276', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '48.000'} [2024-08-06 02:28:54,866][52658] DAMAGECOUNT value on done: 310540.0 [2024-08-06 02:28:54,867][52658] Sum rewards: 61.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.304', 'weapon4': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '52.000'} [2024-08-06 02:28:55,314][52668] DAMAGECOUNT value on done: 308326.0 [2024-08-06 02:28:55,317][52668] Sum rewards: 69.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.158', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:56,024][52794] DAMAGECOUNT value on done: 311658.0 [2024-08-06 02:28:56,024][52794] Sum rewards: 73.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.080', 'weapon4': '0.098', 'AMMO4': '0.128', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:56,525][52660] DAMAGECOUNT value on done: 301886.0 [2024-08-06 02:28:56,527][52660] Sum rewards: 72.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.485', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon5': '0.176', 'weapon2': '0.224', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.374', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '59.000'} [2024-08-06 02:28:56,784][52820] DAMAGECOUNT value on done: 285688.0 [2024-08-06 02:28:56,786][52820] Sum rewards: 69.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.182', 'AMMO3': '0.226', 'AMMO4': '0.238', 'weapon5': '0.274', 'weapon2': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:56,810][52647] DAMAGECOUNT value on done: 320489.0 [2024-08-06 02:28:56,812][52647] Sum rewards: 68.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.018', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '57.000'} [2024-08-06 02:28:57,139][52669] DAMAGECOUNT value on done: 308821.0 [2024-08-06 02:28:57,140][52669] Sum rewards: 58.238, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.779', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.150', 'weapon5': '0.238', 'AMMO4': '0.280', 'WEAPON5': '0.500', 'weapon2': '0.514', 'WEAPON4': '0.550', 'weapon4': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.352', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '47.000'} [2024-08-06 02:28:57,544][52650] Updated weights for policy 0, policy_version 38411 (0.0019) [2024-08-06 02:28:57,600][52671] DAMAGECOUNT value on done: 307972.0 [2024-08-06 02:28:57,601][52671] Sum rewards: 69.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.761', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.092', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.416', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '60.000'} [2024-08-06 02:28:57,639][52658] DAMAGECOUNT value on done: 300382.0 [2024-08-06 02:28:57,641][52658] Sum rewards: 76.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.486', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '64.500'} [2024-08-06 02:28:57,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 314662912. Throughput: 0: 4366.4. Samples: 78674440. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:28:57,795][52567] Avg episode reward: [(0, '66.622')] [2024-08-06 02:28:58,527][52668] DAMAGECOUNT value on done: 303584.0 [2024-08-06 02:28:58,527][52668] Sum rewards: 74.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.128', 'weapon4': '0.152', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.368', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '64.000'} [2024-08-06 02:28:59,079][52794] DAMAGECOUNT value on done: 305794.0 [2024-08-06 02:28:59,080][52794] Sum rewards: 71.945, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.462', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '0.950', 'weapon3': '3.102', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '58.000'} [2024-08-06 02:28:59,242][52647] DAMAGECOUNT value on done: 318252.0 [2024-08-06 02:28:59,250][52647] Sum rewards: 60.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.088', 'weapon4': '0.158', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '48.500'} [2024-08-06 02:28:59,882][52660] DAMAGECOUNT value on done: 311022.0 [2024-08-06 02:28:59,882][52660] Sum rewards: 72.309, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.154', 'AMMO4': '0.223', 'AMMO3': '0.224', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '62.000'} [2024-08-06 02:28:59,958][52820] DAMAGECOUNT value on done: 287652.0 [2024-08-06 02:28:59,959][52820] Sum rewards: 67.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.208', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.066', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.454', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '57.500'} [2024-08-06 02:29:00,170][52658] DAMAGECOUNT value on done: 314813.0 [2024-08-06 02:29:00,170][52658] Sum rewards: 67.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.802', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO4': '0.118', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '54.000'} [2024-08-06 02:29:00,186][52669] DAMAGECOUNT value on done: 311044.0 [2024-08-06 02:29:00,186][52669] Sum rewards: 76.045, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.136', 'AMMO4': '0.141', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '60.000'} [2024-08-06 02:29:00,682][52671] DAMAGECOUNT value on done: 309499.0 [2024-08-06 02:29:00,682][52671] Sum rewards: 68.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.635', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.118', 'AMMO4': '0.237', 'weapon5': '0.246', 'AMMO3': '0.263', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '60.500'} [2024-08-06 02:29:01,966][52794] DAMAGECOUNT value on done: 310568.0 [2024-08-06 02:29:01,969][52794] Sum rewards: 62.719, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.670', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.106', 'AMMO3': '0.237', 'AMMO4': '0.269', 'weapon4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.826', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '54.000'} [2024-08-06 02:29:02,343][52650] Updated weights for policy 0, policy_version 38421 (0.0017) [2024-08-06 02:29:02,389][52647] DAMAGECOUNT value on done: 312464.0 [2024-08-06 02:29:02,390][52647] Sum rewards: 58.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.168', 'AMMO3': '0.213', 'AMMO4': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.000', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '49.000'} [2024-08-06 02:29:02,665][52658] DAMAGECOUNT value on done: 309915.0 [2024-08-06 02:29:02,667][52658] Sum rewards: 69.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.154', 'AMMO4': '0.186', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '59.000'} [2024-08-06 02:29:02,701][52660] DAMAGECOUNT value on done: 315090.0 [2024-08-06 02:29:02,701][52660] Sum rewards: 69.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.076', 'AMMO4': '0.165', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 02:29:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 314753024. Throughput: 0: 4372.0. Samples: 78687680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:29:02,794][52567] Avg episode reward: [(0, '66.913')] [2024-08-06 02:29:03,109][52820] DAMAGECOUNT value on done: 285031.0 [2024-08-06 02:29:03,111][52820] Sum rewards: 71.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.132', 'AMMO3': '0.213', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '60.000'} [2024-08-06 02:29:03,309][52669] DAMAGECOUNT value on done: 321770.0 [2024-08-06 02:29:03,313][52669] Sum rewards: 75.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.104', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.078', 'weapon5': '0.112', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '64.000'} [2024-08-06 02:29:04,003][52671] DAMAGECOUNT value on done: 307375.0 [2024-08-06 02:29:04,003][52671] Sum rewards: 68.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.380', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '57.500'} [2024-08-06 02:29:04,623][52647] DAMAGECOUNT value on done: 322474.0 [2024-08-06 02:29:04,624][52647] Sum rewards: 59.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.638', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.252', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.082', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '52.000'} [2024-08-06 02:29:04,881][52794] DAMAGECOUNT value on done: 301448.0 [2024-08-06 02:29:04,881][52794] Sum rewards: 72.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.529', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.168', 'weapon5': '0.172', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '58.000'} [2024-08-06 02:29:05,477][52660] DAMAGECOUNT value on done: 303032.0 [2024-08-06 02:29:05,478][52660] Sum rewards: 83.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.039', 'weapon5': '0.092', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.000', 'weapon3': '3.354', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '66.000'} [2024-08-06 02:29:05,851][52658] DAMAGECOUNT value on done: 316443.0 [2024-08-06 02:29:05,851][52658] Sum rewards: 70.090, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.019', 'HEALTH': '0.020', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.102', 'weapon5': '0.136', 'weapon2': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON3': '1.100', 'HITCOUNT': '3.400', 'weapon3': '3.488', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '57.000'} [2024-08-06 02:29:06,016][52669] DAMAGECOUNT value on done: 309094.0 [2024-08-06 02:29:06,017][52669] Sum rewards: 67.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.954', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.092', 'AMMO4': '0.122', 'weapon5': '0.134', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.268', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:06,248][52820] DAMAGECOUNT value on done: 279304.0 [2024-08-06 02:29:06,250][52820] Sum rewards: 70.101, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.695', 'AMMO5': '0.016', 'AMMO2': '0.085', 'weapon5': '0.208', 'AMMO3': '0.278', 'weapon2': '0.368', 'weapon4': '0.394', 'WEAPON5': '0.400', 'AMMO4': '0.425', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.714', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '62.000'} [2024-08-06 02:29:06,614][52650] Updated weights for policy 0, policy_version 38431 (0.0021) [2024-08-06 02:29:06,959][52671] DAMAGECOUNT value on done: 316095.0 [2024-08-06 02:29:06,960][52671] Sum rewards: 69.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.048', 'weapon4': '0.102', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '61.000'} [2024-08-06 02:29:07,299][52794] DAMAGECOUNT value on done: 314551.0 [2024-08-06 02:29:07,300][52794] Sum rewards: 61.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.123', 'AMMO3': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.186', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '49.500'} [2024-08-06 02:29:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17522.7). Total num frames: 314834944. Throughput: 0: 4369.8. Samples: 78713890. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:29:07,795][52567] Avg episode reward: [(0, '67.489')] [2024-08-06 02:29:08,475][52660] DAMAGECOUNT value on done: 304619.0 [2024-08-06 02:29:08,476][52660] Sum rewards: 66.661, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.003', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.118', 'weapon4': '0.164', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.300', 'AMMO3': '0.332', 'WEAPON3': '1.950', 'weapon3': '3.126', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '59.000'} [2024-08-06 02:29:08,665][52669] DAMAGECOUNT value on done: 311879.0 [2024-08-06 02:29:08,667][52669] Sum rewards: 59.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.781', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.114', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '49.000'} [2024-08-06 02:29:09,038][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:29:09,213][52658] DAMAGECOUNT value on done: 299900.0 [2024-08-06 02:29:09,214][52658] Sum rewards: 60.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.753', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.094', 'AMMO4': '0.176', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.836', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '49.500'} [2024-08-06 02:29:09,343][52820] DAMAGECOUNT value on done: 290852.0 [2024-08-06 02:29:09,345][52820] Sum rewards: 66.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.164', 'AMMO3': '0.201', 'weapon5': '0.202', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.712', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '57.000'} [2024-08-06 02:29:09,850][52671] DAMAGECOUNT value on done: 306789.0 [2024-08-06 02:29:09,851][52671] Sum rewards: 54.693, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.386', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.120', 'AMMO4': '0.146', 'weapon5': '0.196', 'weapon2': '0.268', 'WEAPON4': '0.300', 'AMMO3': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'HITCOUNT': '3.010', 'weapon3': '3.064', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '51.500'} [2024-08-06 02:29:10,796][52794] DAMAGECOUNT value on done: 304026.0 [2024-08-06 02:29:10,797][52794] Sum rewards: 63.088, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.477', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.131', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.322', 'weapon2': '0.432', 'WEAPON3': '0.850', 'weapon3': '2.952', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '49.000'} [2024-08-06 02:29:11,058][52669] DAMAGECOUNT value on done: 309011.0 [2024-08-06 02:29:11,059][52669] Sum rewards: 65.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.185', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.169', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.342', 'weapon2': '0.670', 'WEAPON3': '1.000', 'weapon3': '2.532', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '52.000'} [2024-08-06 02:29:11,424][52650] Updated weights for policy 0, policy_version 38441 (0.0025) [2024-08-06 02:29:11,793][52660] DAMAGECOUNT value on done: 298403.0 [2024-08-06 02:29:11,794][52660] Sum rewards: 75.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.092', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.028', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '3.280', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '61.000'} [2024-08-06 02:29:12,074][52658] DAMAGECOUNT value on done: 308981.0 [2024-08-06 02:29:12,074][52658] Sum rewards: 74.073, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.212', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.050', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 02:29:12,562][52820] DAMAGECOUNT value on done: 293781.0 [2024-08-06 02:29:12,562][52820] Sum rewards: 58.012, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.167', 'weapon4': '0.260', 'weapon5': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '45.000'} [2024-08-06 02:29:12,611][52671] DAMAGECOUNT value on done: 310389.0 [2024-08-06 02:29:12,615][52671] Sum rewards: 68.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.340', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.098', 'weapon4': '0.128', 'AMMO4': '0.179', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.376', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '58.000'} [2024-08-06 02:29:12,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 314933248. Throughput: 0: 4365.1. Samples: 78740100. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:29:12,795][52567] Avg episode reward: [(0, '67.531')] [2024-08-06 02:29:13,743][52669] DAMAGECOUNT value on done: 312767.0 [2024-08-06 02:29:13,743][52669] Sum rewards: 65.312, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.142', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '58.000'} [2024-08-06 02:29:14,284][52794] DAMAGECOUNT value on done: 316807.0 [2024-08-06 02:29:14,284][52794] Sum rewards: 83.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.169', 'weapon5': '0.174', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.262', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '70.500'} [2024-08-06 02:29:14,818][52660] DAMAGECOUNT value on done: 308928.0 [2024-08-06 02:29:14,818][52660] Sum rewards: 58.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.054', 'weapon4': '0.088', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '49.500'} [2024-08-06 02:29:15,186][52671] DAMAGECOUNT value on done: 310091.0 [2024-08-06 02:29:15,194][52671] Sum rewards: 68.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.250', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.134', 'weapon5': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.218', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:15,234][52658] DAMAGECOUNT value on done: 306443.0 [2024-08-06 02:29:15,234][52658] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.191', 'weapon4': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:15,608][52820] DAMAGECOUNT value on done: 281875.0 [2024-08-06 02:29:15,609][52820] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.815', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO4': '0.229', 'weapon5': '0.230', 'AMMO3': '0.256', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.726', 'WEAPON3': '1.500', 'weapon3': '2.334', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '51.000'} [2024-08-06 02:29:15,952][52650] Updated weights for policy 0, policy_version 38451 (0.0015) [2024-08-06 02:29:16,585][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:29:17,253][52794] DAMAGECOUNT value on done: 309392.0 [2024-08-06 02:29:17,255][52794] Sum rewards: 68.431, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.720', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.152', 'AMMO4': '0.183', 'weapon2': '0.200', 'weapon4': '0.206', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '58.000'} [2024-08-06 02:29:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 315015168. Throughput: 0: 4371.1. Samples: 78753200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 02:29:17,795][52567] Avg episode reward: [(0, '67.556')] [2024-08-06 02:29:17,891][52660] DAMAGECOUNT value on done: 302534.0 [2024-08-06 02:29:17,892][52660] Sum rewards: 56.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon5': '0.128', 'AMMO3': '0.207', 'weapon2': '0.532', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.104', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '47.000'} [2024-08-06 02:29:17,905][52671] DAMAGECOUNT value on done: 302945.0 [2024-08-06 02:29:17,907][52671] Sum rewards: 57.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.118', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '49.000'} [2024-08-06 02:29:18,197][52658] DAMAGECOUNT value on done: 302966.0 [2024-08-06 02:29:18,198][52658] Sum rewards: 70.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.098', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '60.000'} [2024-08-06 02:29:19,779][52794] DAMAGECOUNT value on done: 309919.0 [2024-08-06 02:29:19,780][52794] Sum rewards: 67.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.072', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.196', 'AMMO4': '0.207', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '57.000'} [2024-08-06 02:29:20,730][52650] Updated weights for policy 0, policy_version 38461 (0.0016) [2024-08-06 02:29:20,861][52671] DAMAGECOUNT value on done: 311869.0 [2024-08-06 02:29:20,862][52671] Sum rewards: 66.255, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.846', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.166', 'weapon4': '0.220', 'weapon2': '0.362', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.286', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:21,178][52658] DAMAGECOUNT value on done: 300905.0 [2024-08-06 02:29:21,178][52658] Sum rewards: 59.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.609', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.114', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.340', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.168', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '52.000'} [2024-08-06 02:29:22,793][52794] DAMAGECOUNT value on done: 318280.0 [2024-08-06 02:29:22,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 315097088. Throughput: 0: 4376.0. Samples: 78779550. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:29:22,796][52567] Avg episode reward: [(0, '67.218')] [2024-08-06 02:29:22,793][52794] Sum rewards: 57.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.961', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.054', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '49.000'} [2024-08-06 02:29:23,532][52671] DAMAGECOUNT value on done: 313400.0 [2024-08-06 02:29:23,533][52671] Sum rewards: 57.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.116', 'weapon5': '0.172', 'AMMO4': '0.206', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.090', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '48.000'} [2024-08-06 02:29:24,025][52658] DAMAGECOUNT value on done: 313019.0 [2024-08-06 02:29:24,026][52658] Sum rewards: 64.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.186', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.358', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.584', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:24,691][52666] DAMAGECOUNT value on done: 310617.0 [2024-08-06 02:29:24,691][52666] Sum rewards: 64.142, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.835', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon5': '0.222', 'weapon4': '0.232', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.650', 'weapon3': '2.796', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '57.000'} [2024-08-06 02:29:25,781][52650] Updated weights for policy 0, policy_version 38471 (0.0012) [2024-08-06 02:29:25,892][52794] DAMAGECOUNT value on done: 308482.0 [2024-08-06 02:29:25,893][52794] Sum rewards: 72.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.707', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '61.000'} [2024-08-06 02:29:26,466][52671] DAMAGECOUNT value on done: 307388.0 [2024-08-06 02:29:26,467][52671] Sum rewards: 56.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.182', 'AMMO3': '0.198', 'weapon4': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '48.000'} [2024-08-06 02:29:26,824][52658] DAMAGECOUNT value on done: 304330.0 [2024-08-06 02:29:26,824][52658] Sum rewards: 75.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon2': '0.108', 'weapon4': '0.190', 'AMMO3': '0.211', 'WEAPON3': '1.250', 'weapon3': '3.594', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '61.000'} [2024-08-06 02:29:27,409][52666] DAMAGECOUNT value on done: 311436.0 [2024-08-06 02:29:27,411][52666] Sum rewards: 57.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.222', 'AMMO3': '0.251', 'weapon2': '0.668', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '50.000'} [2024-08-06 02:29:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 315195392. Throughput: 0: 4375.3. Samples: 78805680. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:29:27,794][52567] Avg episode reward: [(0, '66.829')] [2024-08-06 02:29:29,043][52671] DAMAGECOUNT value on done: 317733.0 [2024-08-06 02:29:29,044][52671] Sum rewards: 74.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.651', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO3': '0.147', 'AMMO4': '0.172', 'weapon4': '0.242', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.120', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '59.000'} [2024-08-06 02:29:29,931][52658] DAMAGECOUNT value on done: 308789.0 [2024-08-06 02:29:29,932][52658] Sum rewards: 66.936, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.660', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.118', 'weapon5': '0.178', 'weapon2': '0.236', 'AMMO3': '0.281', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.160', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2024-08-06 02:29:30,049][52650] Updated weights for policy 0, policy_version 38481 (0.0015) [2024-08-06 02:29:30,497][52666] DAMAGECOUNT value on done: 312224.0 [2024-08-06 02:29:30,498][52666] Sum rewards: 74.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon4': '0.314', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '61.000'} [2024-08-06 02:29:31,815][52671] DAMAGECOUNT value on done: 306704.0 [2024-08-06 02:29:31,817][52671] Sum rewards: 62.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.014', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.716', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:31,842][52667] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:29:32,156][52670] DAMAGECOUNT value on done: 303877.0 [2024-08-06 02:29:32,159][52670] Sum rewards: 71.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.886', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.148', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '59.000'} [2024-08-06 02:29:32,741][52614] Signal inference workers to stop experience collection... (6950 times) [2024-08-06 02:29:32,742][52614] Signal inference workers to resume experience collection... (6950 times) [2024-08-06 02:29:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 315277312. Throughput: 0: 4375.3. Samples: 78818880. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:29:32,794][52567] Avg episode reward: [(0, '66.963')] [2024-08-06 02:29:32,818][52650] InferenceWorker_p0-w0: stopping experience collection (6950 times) [2024-08-06 02:29:32,819][52650] InferenceWorker_p0-w0: resuming experience collection (6950 times) [2024-08-06 02:29:33,124][52658] DAMAGECOUNT value on done: 312004.0 [2024-08-06 02:29:33,126][52658] Sum rewards: 64.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.152', 'weapon5': '0.180', 'AMMO4': '0.227', 'weapon4': '0.284', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:33,714][52666] DAMAGECOUNT value on done: 307440.0 [2024-08-06 02:29:33,716][52666] Sum rewards: 75.151, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.560', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.062', 'weapon5': '0.160', 'AMMO4': '0.242', 'AMMO3': '0.285', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.200', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '67.000'} [2024-08-06 02:29:33,720][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:29:34,823][52671] DAMAGECOUNT value on done: 299133.0 [2024-08-06 02:29:34,823][52671] Sum rewards: 70.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.365', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon5': '0.158', 'weapon4': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '0.900', 'HITCOUNT': '3.100', 'weapon3': '3.132', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:35,239][52650] Updated weights for policy 0, policy_version 38491 (0.0012) [2024-08-06 02:29:35,540][52670] DAMAGECOUNT value on done: 307412.0 [2024-08-06 02:29:35,548][52670] Sum rewards: 53.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'AMMO3': '0.167', 'AMMO4': '0.175', 'WEAPON7': '0.200', 'weapon2': '0.326', 'weapon5': '0.346', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '13.065', 'FRAGCOUNT': '44.000'} [2024-08-06 02:29:37,141][52666] DAMAGECOUNT value on done: 303270.0 [2024-08-06 02:29:37,141][52666] Sum rewards: 70.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.088', 'weapon4': '0.106', 'AMMO3': '0.179', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.050', 'weapon3': '3.164', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '57.000'} [2024-08-06 02:29:37,534][52671] DAMAGECOUNT value on done: 312739.0 [2024-08-06 02:29:37,534][52671] Sum rewards: 78.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.678', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.098', 'AMMO4': '0.157', 'weapon5': '0.170', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.400', 'weapon3': '2.870', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '65.000'} [2024-08-06 02:29:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 315367424. Throughput: 0: 4376.2. Samples: 78845150. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:29:37,794][52567] Avg episode reward: [(0, '67.157')] [2024-08-06 02:29:38,743][52670] DAMAGECOUNT value on done: 301953.0 [2024-08-06 02:29:38,746][52670] Sum rewards: 67.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.457', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.090', 'weapon4': '0.170', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '57.000'} [2024-08-06 02:29:39,388][52650] Updated weights for policy 0, policy_version 38501 (0.0012) [2024-08-06 02:29:40,156][52671] DAMAGECOUNT value on done: 313409.0 [2024-08-06 02:29:40,159][52671] Sum rewards: 64.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO3': '0.170', 'AMMO4': '0.184', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '52.000'} [2024-08-06 02:29:40,309][52666] DAMAGECOUNT value on done: 300409.0 [2024-08-06 02:29:40,312][52666] Sum rewards: 76.905, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.258', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '64.000'} [2024-08-06 02:29:41,820][52670] DAMAGECOUNT value on done: 300320.0 [2024-08-06 02:29:41,822][52670] Sum rewards: 65.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.573', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.144', 'AMMO3': '0.222', 'weapon4': '0.240', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '55.000'} [2024-08-06 02:29:42,024][52659] DAMAGECOUNT value on done: 310377.0 [2024-08-06 02:29:42,024][52659] Sum rewards: 60.601, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.100', 'AMMO4': '0.173', 'weapon5': '0.182', 'weapon2': '0.184', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '3.110', 'weapon3': '3.266', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '52.000'} [2024-08-06 02:29:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 315457536. Throughput: 0: 4376.9. Samples: 78871400. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:29:42,794][52567] Avg episode reward: [(0, '67.177')] [2024-08-06 02:29:43,167][52666] DAMAGECOUNT value on done: 307002.0 [2024-08-06 02:29:43,167][52666] Sum rewards: 79.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.206', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '65.000'} [2024-08-06 02:29:43,505][52671] DAMAGECOUNT value on done: 315605.0 [2024-08-06 02:29:43,506][52671] Sum rewards: 81.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.722', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'weapon4': '0.230', 'AMMO3': '0.237', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '68.000'} [2024-08-06 02:29:44,357][52650] Updated weights for policy 0, policy_version 38511 (0.0012) [2024-08-06 02:29:44,903][52670] DAMAGECOUNT value on done: 311171.0 [2024-08-06 02:29:44,904][52670] Sum rewards: 68.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO2': '0.023', 'weapon4': '0.106', 'AMMO4': '0.116', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.266', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '60.000'} [2024-08-06 02:29:44,916][52659] DAMAGECOUNT value on done: 307529.0 [2024-08-06 02:29:44,917][52659] Sum rewards: 67.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.098', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.158', 'AMMO3': '0.201', 'AMMO4': '0.229', 'weapon4': '0.336', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:45,077][52670] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:29:46,111][52666] DAMAGECOUNT value on done: 304258.0 [2024-08-06 02:29:46,114][52666] Sum rewards: 73.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.312', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.100', 'weapon5': '0.128', 'AMMO4': '0.150', 'weapon2': '0.238', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '62.000'} [2024-08-06 02:29:46,580][52671] DAMAGECOUNT value on done: 307773.0 [2024-08-06 02:29:46,580][52671] Sum rewards: 62.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.096', 'AMMO4': '0.146', 'AMMO3': '0.186', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.056', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '52.000'} [2024-08-06 02:29:47,539][52670] DAMAGECOUNT value on done: 305898.0 [2024-08-06 02:29:47,539][52670] Sum rewards: 64.465, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.864', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon2': '0.476', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.218', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 315547648. Throughput: 0: 4377.6. Samples: 78884670. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:29:47,794][52567] Avg episode reward: [(0, '67.537')] [2024-08-06 02:29:48,226][52659] DAMAGECOUNT value on done: 307753.0 [2024-08-06 02:29:48,226][52659] Sum rewards: 78.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.606', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.136', 'AMMO4': '0.137', 'weapon4': '0.138', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '62.000'} [2024-08-06 02:29:48,750][52650] Updated weights for policy 0, policy_version 38521 (0.0023) [2024-08-06 02:29:48,912][52666] DAMAGECOUNT value on done: 304203.0 [2024-08-06 02:29:48,912][52666] Sum rewards: 52.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.598', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.178', 'AMMO3': '0.199', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'weapon4': '0.422', 'weapon2': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.743', 'FRAGCOUNT': '45.000'} [2024-08-06 02:29:49,481][52664] DAMAGECOUNT value on done: 320056.0 [2024-08-06 02:29:49,482][52664] Sum rewards: 61.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.145', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.160', 'weapon4': '0.202', 'weapon5': '0.228', 'AMMO4': '0.250', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.796', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '49.500'} [2024-08-06 02:29:49,728][52671] DAMAGECOUNT value on done: 307055.0 [2024-08-06 02:29:49,729][52671] Sum rewards: 66.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.140', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:50,640][52670] DAMAGECOUNT value on done: 300978.0 [2024-08-06 02:29:50,641][52670] Sum rewards: 60.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.920', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.172', 'weapon5': '0.178', 'weapon2': '0.300', 'AMMO3': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.950', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '55.000'} [2024-08-06 02:29:51,067][52659] DAMAGECOUNT value on done: 308619.0 [2024-08-06 02:29:51,067][52659] Sum rewards: 67.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.138', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.068', 'AMMO4': '0.105', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.350', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '55.500'} [2024-08-06 02:29:51,643][52666] DAMAGECOUNT value on done: 302552.0 [2024-08-06 02:29:51,645][52666] Sum rewards: 71.939, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '58.000'} [2024-08-06 02:29:52,649][52664] DAMAGECOUNT value on done: 320205.0 [2024-08-06 02:29:52,649][52664] Sum rewards: 65.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'WEAPON1': '0.010', 'AMMO3': '0.191', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '54.000'} [2024-08-06 02:29:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 315629568. Throughput: 0: 4386.2. Samples: 78911270. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:29:52,795][52567] Avg episode reward: [(0, '67.268')] [2024-08-06 02:29:52,856][52670] DAMAGECOUNT value on done: 303892.0 [2024-08-06 02:29:52,857][52670] Sum rewards: 67.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.211', 'weapon2': '0.840', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:53,552][52650] Updated weights for policy 0, policy_version 38531 (0.0012) [2024-08-06 02:29:53,972][52659] DAMAGECOUNT value on done: 303054.0 [2024-08-06 02:29:53,974][52659] Sum rewards: 72.433, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.054', 'weapon4': '0.088', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '64.000'} [2024-08-06 02:29:54,097][52666] DAMAGECOUNT value on done: 301507.0 [2024-08-06 02:29:54,097][52666] Sum rewards: 61.873, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.572', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.183', 'weapon4': '0.188', 'weapon2': '0.262', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '54.000'} [2024-08-06 02:29:55,625][52664] DAMAGECOUNT value on done: 321484.0 [2024-08-06 02:29:55,625][52664] Sum rewards: 73.095, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.982', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.134', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.408', 'WEAPON3': '0.850', 'weapon3': '3.084', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '60.000'} [2024-08-06 02:29:55,841][52670] DAMAGECOUNT value on done: 303422.0 [2024-08-06 02:29:55,841][52670] Sum rewards: 63.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon5': '0.132', 'AMMO3': '0.178', 'AMMO4': '0.285', 'weapon4': '0.322', 'WEAPON5': '0.450', 'weapon2': '0.498', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '54.000'} [2024-08-06 02:29:56,653][52659] DAMAGECOUNT value on done: 306657.0 [2024-08-06 02:29:56,653][52659] Sum rewards: 61.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.916', 'AMMO5': '0.022', 'AMMO2': '0.041', 'weapon5': '0.048', 'weapon4': '0.086', 'AMMO3': '0.184', 'AMMO4': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.180', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:57,014][52666] DAMAGECOUNT value on done: 299918.0 [2024-08-06 02:29:57,014][52666] Sum rewards: 63.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.092', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.288', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.344', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '53.000'} [2024-08-06 02:29:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 315719680. Throughput: 0: 4390.2. Samples: 78937660. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:29:57,794][52567] Avg episode reward: [(0, '67.248')] [2024-08-06 02:29:57,938][52650] Updated weights for policy 0, policy_version 38541 (0.0012) [2024-08-06 02:29:58,146][52664] DAMAGECOUNT value on done: 318419.0 [2024-08-06 02:29:58,146][52664] Sum rewards: 69.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.015', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.024', 'weapon4': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '61.000'} [2024-08-06 02:29:58,502][52670] DAMAGECOUNT value on done: 297015.0 [2024-08-06 02:29:58,503][52670] Sum rewards: 66.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.726', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.182', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.404', 'weapon4': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:58,812][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:29:59,925][52659] DAMAGECOUNT value on done: 309708.0 [2024-08-06 02:29:59,927][52659] Sum rewards: 67.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.861', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.144', 'weapon2': '0.174', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '56.000'} [2024-08-06 02:29:59,957][52666] DAMAGECOUNT value on done: 310214.0 [2024-08-06 02:29:59,959][52666] Sum rewards: 76.284, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.281', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.132', 'weapon4': '0.146', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '65.000'} [2024-08-06 02:30:00,034][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:30:00,717][52664] DAMAGECOUNT value on done: 319205.0 [2024-08-06 02:30:00,719][52664] Sum rewards: 52.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'ARMOR': '0.012', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.384', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '47.000'} [2024-08-06 02:30:00,887][52663] DAMAGECOUNT value on done: 313303.0 [2024-08-06 02:30:00,887][52663] Sum rewards: 82.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.870', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.094', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.228', 'WEAPON3': '1.100', 'weapon3': '3.548', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 02:30:01,560][52670] DAMAGECOUNT value on done: 312450.0 [2024-08-06 02:30:01,560][52670] Sum rewards: 70.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.188', 'AMMO3': '0.199', 'AMMO4': '0.216', 'weapon2': '0.234', 'weapon4': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '57.000'} [2024-08-06 02:30:02,759][52650] Updated weights for policy 0, policy_version 38551 (0.0040) [2024-08-06 02:30:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 315809792. Throughput: 0: 4390.0. Samples: 78950750. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:30:02,794][52567] Avg episode reward: [(0, '67.210')] [2024-08-06 02:30:02,988][52666] DAMAGECOUNT value on done: 309803.0 [2024-08-06 02:30:02,988][52666] Sum rewards: 66.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.078', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.104', 'weapon4': '0.110', 'AMMO4': '0.126', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON3': '1.550', 'weapon3': '3.402', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '56.000'} [2024-08-06 02:30:03,218][52659] DAMAGECOUNT value on done: 305086.0 [2024-08-06 02:30:03,218][52659] Sum rewards: 61.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '51.500'} [2024-08-06 02:30:03,292][52664] DAMAGECOUNT value on done: 320071.0 [2024-08-06 02:30:03,292][52664] Sum rewards: 60.314, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.126', 'weapon5': '0.138', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.216', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '52.000'} [2024-08-06 02:30:03,467][52663] DAMAGECOUNT value on done: 306185.0 [2024-08-06 02:30:03,467][52663] Sum rewards: 69.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.438', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.199', 'weapon2': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '59.000'} [2024-08-06 02:30:04,139][52670] DAMAGECOUNT value on done: 305653.0 [2024-08-06 02:30:04,141][52670] Sum rewards: 56.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.762', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO4': '0.190', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.876', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.500'} [2024-08-06 02:30:05,390][52666] DAMAGECOUNT value on done: 304725.0 [2024-08-06 02:30:05,390][52666] Sum rewards: 63.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.987', 'AMMO5': '0.018', 'weapon7': '0.066', 'AMMO2': '0.067', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.210', 'weapon4': '0.238', 'weapon5': '0.322', 'AMMO4': '0.334', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.568', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '53.500'} [2024-08-06 02:30:06,022][52664] DAMAGECOUNT value on done: 322719.0 [2024-08-06 02:30:06,023][52664] Sum rewards: 67.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.422', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO3': '0.174', 'AMMO4': '0.176', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.000', 'weapon3': '2.898', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:06,219][52659] DAMAGECOUNT value on done: 315232.0 [2024-08-06 02:30:06,220][52659] Sum rewards: 66.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.198', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.067', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '56.000'} [2024-08-06 02:30:06,374][52649] Large shaping reward 2.609 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.579, 193.0)] [2024-08-06 02:30:06,425][52663] DAMAGECOUNT value on done: 305757.0 [2024-08-06 02:30:06,427][52663] Sum rewards: 64.579, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.988', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.136', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '52.000'} [2024-08-06 02:30:06,830][52670] DAMAGECOUNT value on done: 306689.0 [2024-08-06 02:30:06,832][52670] Sum rewards: 66.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.045', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.157', 'AMMO4': '0.188', 'weapon5': '0.220', 'weapon4': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.660', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '53.000'} [2024-08-06 02:30:07,543][52650] Updated weights for policy 0, policy_version 38561 (0.0011) [2024-08-06 02:30:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 315891712. Throughput: 0: 4391.8. Samples: 78977180. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:30:07,802][52567] Avg episode reward: [(0, '66.826')] [2024-08-06 02:30:08,267][52666] DAMAGECOUNT value on done: 306554.0 [2024-08-06 02:30:08,269][52666] Sum rewards: 76.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.182', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.202', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '62.000'} [2024-08-06 02:30:08,520][52664] DAMAGECOUNT value on done: 312817.0 [2024-08-06 02:30:08,520][52664] Sum rewards: 52.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.998', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.870', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '46.000'} [2024-08-06 02:30:08,590][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:30:09,105][52659] DAMAGECOUNT value on done: 314217.0 [2024-08-06 02:30:09,106][52659] Sum rewards: 66.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.102', 'AMMO5': '0.005', 'AMMO2': '0.049', 'weapon5': '0.088', 'weapon4': '0.094', 'AMMO3': '0.194', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.444', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:09,482][52663] DAMAGECOUNT value on done: 309316.0 [2024-08-06 02:30:09,482][52663] Sum rewards: 66.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.752', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.246', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.336', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '53.000'} [2024-08-06 02:30:10,019][52670] DAMAGECOUNT value on done: 309871.0 [2024-08-06 02:30:10,019][52670] Sum rewards: 67.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.230', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '57.000'} [2024-08-06 02:30:10,883][52664] DAMAGECOUNT value on done: 326659.0 [2024-08-06 02:30:10,883][52664] Sum rewards: 75.941, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.832', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.252', 'weapon2': '0.354', 'WEAPON3': '0.900', 'weapon3': '3.272', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '59.000'} [2024-08-06 02:30:11,591][52666] DAMAGECOUNT value on done: 303439.0 [2024-08-06 02:30:11,592][52666] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.403', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.164', 'AMMO3': '0.180', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.592', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '61.000'} [2024-08-06 02:30:11,976][52650] Updated weights for policy 0, policy_version 38571 (0.0019) [2024-08-06 02:30:12,053][52659] DAMAGECOUNT value on done: 307930.0 [2024-08-06 02:30:12,054][52659] Sum rewards: 50.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.082', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon2': '0.160', 'AMMO3': '0.176', 'AMMO4': '0.187', 'weapon5': '0.220', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.330', 'weapon3': '3.144', 'DAMAGECOUNT': '12.729', 'FRAGCOUNT': '42.000'} [2024-08-06 02:30:12,494][52663] DAMAGECOUNT value on done: 308303.0 [2024-08-06 02:30:12,494][52663] Sum rewards: 62.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.100', 'AMMO3': '0.191', 'AMMO4': '0.194', 'weapon4': '0.324', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '52.000'} [2024-08-06 02:30:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 315981824. Throughput: 0: 4400.0. Samples: 79003680. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:30:12,802][52567] Avg episode reward: [(0, '66.354')] [2024-08-06 02:30:13,040][52670] DAMAGECOUNT value on done: 308502.0 [2024-08-06 02:30:13,041][52670] Sum rewards: 77.016, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.364', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 02:30:13,929][52664] DAMAGECOUNT value on done: 317931.0 [2024-08-06 02:30:13,930][52664] Sum rewards: 68.517, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.120', 'AMMO4': '0.178', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '57.000'} [2024-08-06 02:30:14,344][52666] DAMAGECOUNT value on done: 306744.0 [2024-08-06 02:30:14,345][52666] Sum rewards: 65.444, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.799', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.116', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.278', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.312', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '56.000'} [2024-08-06 02:30:14,502][52659] DAMAGECOUNT value on done: 311088.0 [2024-08-06 02:30:14,502][52659] Sum rewards: 66.999, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.785', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.124', 'AMMO4': '0.167', 'weapon2': '0.204', 'weapon5': '0.254', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon3': '2.904', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '53.000'} [2024-08-06 02:30:15,576][52670] DAMAGECOUNT value on done: 293149.0 [2024-08-06 02:30:15,577][52670] Sum rewards: 70.300, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.177', 'weapon5': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.410', 'HEALTH': '0.433', 'WEAPON3': '0.950', 'weapon3': '2.822', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.000'} [2024-08-06 02:30:15,853][52663] DAMAGECOUNT value on done: 312862.0 [2024-08-06 02:30:15,854][52663] Sum rewards: 70.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.150', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.232', 'AMMO4': '0.234', 'weapon4': '0.264', 'weapon5': '0.278', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '59.000'} [2024-08-06 02:30:16,313][52664] DAMAGECOUNT value on done: 321723.0 [2024-08-06 02:30:16,313][52664] Sum rewards: 68.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.011', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.152', 'AMMO4': '0.254', 'weapon5': '0.262', 'weapon4': '0.332', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.686', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:16,671][52650] Updated weights for policy 0, policy_version 38581 (0.0018) [2024-08-06 02:30:16,991][52666] DAMAGECOUNT value on done: 299228.0 [2024-08-06 02:30:16,991][52666] Sum rewards: 64.585, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.032', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.490', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.292', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '53.000'} [2024-08-06 02:30:17,583][52659] DAMAGECOUNT value on done: 300823.0 [2024-08-06 02:30:17,583][52659] Sum rewards: 59.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.055', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.180', 'AMMO3': '0.203', 'AMMO4': '0.213', 'weapon4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '50.000'} [2024-08-06 02:30:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 316063744. Throughput: 0: 4400.4. Samples: 79016900. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:30:17,794][52567] Avg episode reward: [(0, '66.708')] [2024-08-06 02:30:18,466][52670] DAMAGECOUNT value on done: 308120.0 [2024-08-06 02:30:18,468][52670] Sum rewards: 65.249, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.979', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.210', 'AMMO3': '0.216', 'AMMO4': '0.248', 'weapon4': '0.264', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '56.000'} [2024-08-06 02:30:18,877][52664] DAMAGECOUNT value on done: 320323.0 [2024-08-06 02:30:18,879][52664] Sum rewards: 59.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.152', 'AMMO4': '0.153', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.768', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2024-08-06 02:30:18,937][52663] DAMAGECOUNT value on done: 307737.0 [2024-08-06 02:30:18,937][52663] Sum rewards: 66.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.491', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.196', 'weapon5': '0.274', 'AMMO4': '0.297', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.498', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '53.000'} [2024-08-06 02:30:19,908][52666] DAMAGECOUNT value on done: 307931.0 [2024-08-06 02:30:19,908][52666] Sum rewards: 62.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.654', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.217', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '54.000'} [2024-08-06 02:30:20,711][52659] DAMAGECOUNT value on done: 309887.0 [2024-08-06 02:30:20,713][52659] Sum rewards: 69.771, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.406', 'AMMO5': '0.020', 'AMMO2': '0.070', 'weapon5': '0.190', 'weapon2': '0.228', 'weapon4': '0.230', 'AMMO3': '0.284', 'AMMO4': '0.352', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '3.026', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '62.000'} [2024-08-06 02:30:21,275][52650] Updated weights for policy 0, policy_version 38591 (0.0025) [2024-08-06 02:30:21,489][52670] DAMAGECOUNT value on done: 314293.0 [2024-08-06 02:30:21,491][52670] Sum rewards: 64.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.092', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.082', 'weapon4': '0.130', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:21,507][52664] DAMAGECOUNT value on done: 326854.0 [2024-08-06 02:30:21,507][52664] Sum rewards: 67.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '57.000'} [2024-08-06 02:30:22,253][52663] DAMAGECOUNT value on done: 306304.0 [2024-08-06 02:30:22,257][52663] Sum rewards: 66.105, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.301', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon5': '0.240', 'AMMO3': '0.266', 'AMMO4': '0.275', 'weapon4': '0.290', 'weapon2': '0.420', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.700', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '57.000'} [2024-08-06 02:30:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 316162048. Throughput: 0: 4400.7. Samples: 79043180. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:30:22,794][52567] Avg episode reward: [(0, '66.395')] [2024-08-06 02:30:23,676][52659] DAMAGECOUNT value on done: 315584.0 [2024-08-06 02:30:23,676][52659] Sum rewards: 77.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.396', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.158', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.000', 'weapon3': '3.072', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '63.000'} [2024-08-06 02:30:24,032][52664] DAMAGECOUNT value on done: 319715.0 [2024-08-06 02:30:24,033][52664] Sum rewards: 59.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.019', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.201', 'weapon4': '0.254', 'weapon5': '0.312', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '48.500'} [2024-08-06 02:30:24,492][52670] DAMAGECOUNT value on done: 306471.0 [2024-08-06 02:30:24,492][52670] Sum rewards: 72.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.795', 'AMMO5': '0.006', 'AMMO2': '0.054', 'weapon5': '0.076', 'weapon4': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'AMMO4': '0.269', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '62.000'} [2024-08-06 02:30:25,356][52663] DAMAGECOUNT value on done: 306811.0 [2024-08-06 02:30:25,356][52663] Sum rewards: 67.091, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.630', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.122', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.364', 'WEAPON3': '0.950', 'weapon3': '2.972', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '52.000'} [2024-08-06 02:30:25,986][52650] Updated weights for policy 0, policy_version 38601 (0.0019) [2024-08-06 02:30:26,695][52664] DAMAGECOUNT value on done: 326601.0 [2024-08-06 02:30:26,696][52664] Sum rewards: 66.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.048', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO3': '0.197', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.596', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '56.000'} [2024-08-06 02:30:26,742][52659] DAMAGECOUNT value on done: 318070.0 [2024-08-06 02:30:26,744][52659] Sum rewards: 66.876, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '57.000'} [2024-08-06 02:30:27,332][52670] DAMAGECOUNT value on done: 306958.0 [2024-08-06 02:30:27,334][52670] Sum rewards: 59.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.522', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO4': '0.173', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON4': '0.400', 'weapon4': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.706', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '48.500'} [2024-08-06 02:30:27,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 316243968. Throughput: 0: 4402.0. Samples: 79069490. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:30:27,803][52567] Avg episode reward: [(0, '66.756')] [2024-08-06 02:30:27,854][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038605_316252160.pth... [2024-08-06 02:30:27,998][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038091_312041472.pth [2024-08-06 02:30:28,422][52663] DAMAGECOUNT value on done: 310449.0 [2024-08-06 02:30:28,423][52663] Sum rewards: 64.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.217', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.136', 'weapon2': '0.176', 'AMMO3': '0.195', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.286', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '53.000'} [2024-08-06 02:30:29,515][52664] DAMAGECOUNT value on done: 315376.0 [2024-08-06 02:30:29,516][52664] Sum rewards: 52.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.096', 'AMMO4': '0.199', 'AMMO3': '0.253', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '2.972', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '46.000'} [2024-08-06 02:30:29,899][52659] DAMAGECOUNT value on done: 312252.0 [2024-08-06 02:30:29,901][52659] Sum rewards: 72.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.978', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon2': '0.178', 'weapon4': '0.202', 'AMMO4': '0.219', 'AMMO3': '0.224', 'weapon5': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '59.000'} [2024-08-06 02:30:30,807][52650] Updated weights for policy 0, policy_version 38611 (0.0024) [2024-08-06 02:30:30,937][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:30:31,580][52663] DAMAGECOUNT value on done: 310665.0 [2024-08-06 02:30:31,581][52663] Sum rewards: 74.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.172', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.280', 'WEAPON4': '0.400', 'weapon4': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '62.000'} [2024-08-06 02:30:32,331][52664] DAMAGECOUNT value on done: 322018.0 [2024-08-06 02:30:32,332][52664] Sum rewards: 69.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.052', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '58.000'} [2024-08-06 02:30:32,410][52659] DAMAGECOUNT value on done: 308646.0 [2024-08-06 02:30:32,410][52659] Sum rewards: 59.540, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.494', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.202', 'AMMO4': '0.208', 'weapon2': '0.210', 'AMMO3': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.020', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '52.000'} [2024-08-06 02:30:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 316334080. Throughput: 0: 4394.0. Samples: 79082400. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:30:32,794][52567] Avg episode reward: [(0, '66.894')] [2024-08-06 02:30:34,531][52663] DAMAGECOUNT value on done: 307189.0 [2024-08-06 02:30:34,531][52663] Sum rewards: 64.399, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.925', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.416', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.408', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '54.000'} [2024-08-06 02:30:35,341][52650] Updated weights for policy 0, policy_version 38621 (0.0012) [2024-08-06 02:30:35,440][52664] DAMAGECOUNT value on done: 321360.0 [2024-08-06 02:30:35,441][52664] Sum rewards: 53.458, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.593', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.139', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.050', 'HITCOUNT': '2.800', 'weapon3': '3.102', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '44.000'} [2024-08-06 02:30:35,536][52659] DAMAGECOUNT value on done: 311831.0 [2024-08-06 02:30:35,536][52659] Sum rewards: 57.328, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.870', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.132', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon4': '0.294', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '50.000'} [2024-08-06 02:30:37,590][52663] DAMAGECOUNT value on done: 301776.0 [2024-08-06 02:30:37,593][52663] Sum rewards: 66.679, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.360', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.170', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '55.500'} [2024-08-06 02:30:37,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 316416000. Throughput: 0: 4385.8. Samples: 79108630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:30:37,794][52567] Avg episode reward: [(0, '66.738')] [2024-08-06 02:30:38,060][52659] DAMAGECOUNT value on done: 313887.0 [2024-08-06 02:30:38,062][52659] Sum rewards: 73.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.268', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.202', 'AMMO4': '0.209', 'weapon4': '0.210', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '63.000'} [2024-08-06 02:30:38,526][52664] DAMAGECOUNT value on done: 322274.0 [2024-08-06 02:30:38,528][52664] Sum rewards: 66.157, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.989', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.216', 'weapon2': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.052', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '54.000'} [2024-08-06 02:30:38,625][52658] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:30:40,099][52650] Updated weights for policy 0, policy_version 38631 (0.0027) [2024-08-06 02:30:40,477][52663] DAMAGECOUNT value on done: 304326.0 [2024-08-06 02:30:40,477][52663] Sum rewards: 61.994, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.100', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon4': '0.242', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:41,210][52664] DAMAGECOUNT value on done: 320938.0 [2024-08-06 02:30:41,211][52664] Sum rewards: 79.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO4': '0.208', 'AMMO3': '0.213', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '67.000'} [2024-08-06 02:30:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 316506112. Throughput: 0: 4384.2. Samples: 79134950. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:30:42,795][52567] Avg episode reward: [(0, '66.817')] [2024-08-06 02:30:42,986][52795] DAMAGECOUNT value on done: 289092.0 [2024-08-06 02:30:42,986][52795] Sum rewards: 57.548, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.995', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.216', 'AMMO4': '0.281', 'AMMO3': '0.282', 'weapon2': '0.316', 'weapon4': '0.350', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.740', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '54.000'} [2024-08-06 02:30:43,024][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:30:43,087][52663] DAMAGECOUNT value on done: 305436.0 [2024-08-06 02:30:43,088][52663] Sum rewards: 48.064, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.696', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.088', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'weapon2': '0.330', 'weapon4': '0.360', 'WEAPON3': '1.650', 'weapon3': '2.822', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '44.000'} [2024-08-06 02:30:44,890][52660] Large shaping reward 2.556 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.537, 179.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:30:45,151][52650] Updated weights for policy 0, policy_version 38641 (0.0012) [2024-08-06 02:30:46,070][52663] DAMAGECOUNT value on done: 313675.0 [2024-08-06 02:30:46,070][52663] Sum rewards: 73.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.034', 'weapon4': '0.068', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.502', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '63.000'} [2024-08-06 02:30:46,131][52795] DAMAGECOUNT value on done: 281096.0 [2024-08-06 02:30:46,131][52795] Sum rewards: 62.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.842', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.163', 'weapon2': '0.166', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'HITCOUNT': '3.050', 'weapon3': '3.272', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:47,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 316588032. Throughput: 0: 4389.1. Samples: 79148260. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:30:47,795][52567] Avg episode reward: [(0, '66.510')] [2024-08-06 02:30:48,797][52803] DAMAGECOUNT value on done: 289539.0 [2024-08-06 02:30:48,797][52803] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.146', 'weapon4': '0.154', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:49,072][52663] DAMAGECOUNT value on done: 307843.0 [2024-08-06 02:30:49,073][52663] Sum rewards: 61.599, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.130', 'weapon4': '0.152', 'AMMO4': '0.154', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:49,277][52795] DAMAGECOUNT value on done: 282731.0 [2024-08-06 02:30:49,277][52795] Sum rewards: 62.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.792', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.116', 'weapon5': '0.166', 'AMMO4': '0.208', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.034', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '54.000'} [2024-08-06 02:30:49,470][52650] Updated weights for policy 0, policy_version 38651 (0.0011) [2024-08-06 02:30:50,550][52811] DAMAGECOUNT value on done: 299400.0 [2024-08-06 02:30:50,552][52811] Sum rewards: 69.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.226', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '58.000'} [2024-08-06 02:30:51,911][52803] DAMAGECOUNT value on done: 287705.0 [2024-08-06 02:30:51,912][52803] Sum rewards: 58.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.005', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.068', 'weapon5': '0.086', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.360', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '52.000'} [2024-08-06 02:30:51,914][52663] DAMAGECOUNT value on done: 313853.0 [2024-08-06 02:30:51,916][52663] Sum rewards: 72.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.326', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '57.000'} [2024-08-06 02:30:52,449][52795] DAMAGECOUNT value on done: 285200.0 [2024-08-06 02:30:52,450][52795] Sum rewards: 75.837, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.018', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.152', 'AMMO3': '0.174', 'weapon5': '0.178', 'AMMO4': '0.182', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '60.000'} [2024-08-06 02:30:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 316686336. Throughput: 0: 4386.4. Samples: 79174570. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:30:52,794][52567] Avg episode reward: [(0, '66.368')] [2024-08-06 02:30:53,705][52811] DAMAGECOUNT value on done: 286217.0 [2024-08-06 02:30:53,708][52811] Sum rewards: 55.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO3': '0.144', 'AMMO4': '0.170', 'weapon4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '3.130', 'DAMAGECOUNT': '12.888', 'FRAGCOUNT': '47.000'} [2024-08-06 02:30:54,116][52650] Updated weights for policy 0, policy_version 38661 (0.0037) [2024-08-06 02:30:54,304][52649] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:30:54,934][52663] DAMAGECOUNT value on done: 311544.0 [2024-08-06 02:30:54,935][52663] Sum rewards: 63.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.099', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.256', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.346', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2024-08-06 02:30:54,955][52803] DAMAGECOUNT value on done: 290020.0 [2024-08-06 02:30:54,956][52803] Sum rewards: 67.731, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.294', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.116', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.372', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:55,704][52795] DAMAGECOUNT value on done: 288926.0 [2024-08-06 02:30:55,706][52795] Sum rewards: 69.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.537', 'AMMO5': '0.013', 'AMMO2': '0.066', 'weapon5': '0.218', 'AMMO3': '0.223', 'weapon4': '0.254', 'weapon2': '0.270', 'AMMO4': '0.331', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '59.000'} [2024-08-06 02:30:56,330][52667] DAMAGECOUNT value on done: 309918.0 [2024-08-06 02:30:56,330][52667] Sum rewards: 68.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.257', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '59.000'} [2024-08-06 02:30:56,839][52811] DAMAGECOUNT value on done: 291082.0 [2024-08-06 02:30:56,841][52811] Sum rewards: 63.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.743', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.240', 'AMMO4': '0.251', 'AMMO3': '0.254', 'weapon4': '0.294', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.794', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2024-08-06 02:30:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 316768256. Throughput: 0: 4378.9. Samples: 79200730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 02:30:57,795][52567] Avg episode reward: [(0, '65.940')] [2024-08-06 02:30:57,890][52803] DAMAGECOUNT value on done: 293369.0 [2024-08-06 02:30:57,891][52803] Sum rewards: 82.892, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.467', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.098', 'weapon4': '0.130', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.700', 'weapon3': '3.330', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '71.000'} [2024-08-06 02:30:57,921][52663] DAMAGECOUNT value on done: 303255.0 [2024-08-06 02:30:57,921][52663] Sum rewards: 59.230, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.108', 'weapon4': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '3.190', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '49.000'} [2024-08-06 02:30:58,779][52795] DAMAGECOUNT value on done: 286874.0 [2024-08-06 02:30:58,781][52795] Sum rewards: 61.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.852', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '50.000'} [2024-08-06 02:30:59,003][52650] Updated weights for policy 0, policy_version 38671 (0.0023) [2024-08-06 02:30:59,034][52667] DAMAGECOUNT value on done: 314085.0 [2024-08-06 02:30:59,034][52667] Sum rewards: 58.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.872', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.185', 'AMMO4': '0.235', 'weapon5': '0.238', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.418', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '48.000'} [2024-08-06 02:30:59,132][52665] DAMAGECOUNT value on done: 303763.0 [2024-08-06 02:30:59,132][52665] Sum rewards: 72.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.855', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.134', 'weapon5': '0.176', 'AMMO4': '0.184', 'AMMO3': '0.234', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '62.000'} [2024-08-06 02:30:59,927][52811] DAMAGECOUNT value on done: 289067.0 [2024-08-06 02:30:59,928][52811] Sum rewards: 70.386, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.474', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.207', 'AMMO3': '0.257', 'weapon2': '0.384', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:00,879][52803] DAMAGECOUNT value on done: 292346.0 [2024-08-06 02:31:00,880][52803] Sum rewards: 50.615, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.851', 'AMMO5': '0.013', 'AMMO2': '0.057', 'AMMO3': '0.184', 'weapon5': '0.224', 'weapon2': '0.236', 'AMMO4': '0.284', 'WEAPON5': '0.400', 'weapon4': '0.498', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.614', 'FRAGCOUNT': '41.000'} [2024-08-06 02:31:01,606][52667] DAMAGECOUNT value on done: 311330.0 [2024-08-06 02:31:01,608][52667] Sum rewards: 81.768, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.069', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '65.000'} [2024-08-06 02:31:02,050][52795] DAMAGECOUNT value on done: 292214.0 [2024-08-06 02:31:02,050][52795] Sum rewards: 70.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.146', 'AMMO4': '0.173', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.434', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:02,175][52665] DAMAGECOUNT value on done: 309555.0 [2024-08-06 02:31:02,175][52665] Sum rewards: 72.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.855', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon4': '0.170', 'AMMO3': '0.213', 'weapon5': '0.254', 'AMMO4': '0.308', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 316858368. Throughput: 0: 4379.6. Samples: 79213980. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:31:02,794][52567] Avg episode reward: [(0, '66.160')] [2024-08-06 02:31:03,055][52811] DAMAGECOUNT value on done: 292065.0 [2024-08-06 02:31:03,055][52811] Sum rewards: 72.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.092', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.172', 'weapon2': '0.190', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '59.500'} [2024-08-06 02:31:03,646][52650] Updated weights for policy 0, policy_version 38681 (0.0012) [2024-08-06 02:31:03,979][52803] DAMAGECOUNT value on done: 287671.0 [2024-08-06 02:31:03,982][52803] Sum rewards: 55.242, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.593', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.146', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '46.500'} [2024-08-06 02:31:04,806][52667] DAMAGECOUNT value on done: 312074.0 [2024-08-06 02:31:04,806][52667] Sum rewards: 67.962, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.690', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO4': '0.251', 'AMMO3': '0.267', 'weapon5': '0.278', 'weapon2': '0.286', 'WEAPON5': '0.450', 'weapon4': '0.466', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.560', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:04,887][52665] DAMAGECOUNT value on done: 307229.0 [2024-08-06 02:31:04,889][52665] Sum rewards: 79.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.114', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.212', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:05,024][52667] Large shaping reward 2.506 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.126, -42.0), ('weapon5', 0.002)] [2024-08-06 02:31:05,183][52795] DAMAGECOUNT value on done: 289076.0 [2024-08-06 02:31:05,183][52795] Sum rewards: 62.138, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.267', 'weapon2': '0.394', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:06,142][52811] DAMAGECOUNT value on done: 295605.0 [2024-08-06 02:31:06,145][52811] Sum rewards: 61.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.849', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon2': '0.164', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:07,019][52649] DAMAGECOUNT value on done: 301352.0 [2024-08-06 02:31:07,019][52649] Sum rewards: 91.156, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.098', 'AMMO3': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.290', 'weapon2': '0.394', 'WEAPON3': '1.000', 'weapon3': '2.992', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '73.000'} [2024-08-06 02:31:07,089][52803] DAMAGECOUNT value on done: 286559.0 [2024-08-06 02:31:07,092][52803] Sum rewards: 69.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.049', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.229', 'weapon5': '0.232', 'AMMO4': '0.258', 'weapon4': '0.288', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:07,356][52662] DAMAGECOUNT value on done: 318062.0 [2024-08-06 02:31:07,358][52662] Sum rewards: 68.334, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.390', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.276', 'weapon2': '0.434', 'WEAPON3': '1.750', 'weapon3': '3.246', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 316948480. Throughput: 0: 4382.7. Samples: 79240400. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:31:07,794][52567] Avg episode reward: [(0, '66.432')] [2024-08-06 02:31:07,923][52667] DAMAGECOUNT value on done: 314183.0 [2024-08-06 02:31:07,923][52667] Sum rewards: 62.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.902', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.074', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.234', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:07,952][52665] DAMAGECOUNT value on done: 303816.0 [2024-08-06 02:31:07,952][52665] Sum rewards: 65.246, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'weapon4': '0.462', 'weapon2': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.754', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:08,150][52650] Updated weights for policy 0, policy_version 38691 (0.0024) [2024-08-06 02:31:08,303][52795] DAMAGECOUNT value on done: 279365.0 [2024-08-06 02:31:08,305][52795] Sum rewards: 48.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.744', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.160', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon4': '0.288', 'WEAPON4': '0.450', 'weapon2': '0.626', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.700', 'DAMAGECOUNT': '11.859', 'FRAGCOUNT': '43.000'} [2024-08-06 02:31:08,432][52795] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 02:31:08,669][52647] DAMAGECOUNT value on done: 327039.0 [2024-08-06 02:31:08,672][52647] Sum rewards: 61.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.955', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.056', 'weapon4': '0.080', 'AMMO4': '0.090', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.760', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:09,399][52811] DAMAGECOUNT value on done: 289877.0 [2024-08-06 02:31:09,403][52811] Sum rewards: 65.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon2': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:10,124][52803] DAMAGECOUNT value on done: 286495.0 [2024-08-06 02:31:10,126][52803] Sum rewards: 79.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.654', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.088', 'weapon4': '0.094', 'WEAPON5': '0.100', 'weapon2': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.464', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '65.000'} [2024-08-06 02:31:10,182][52649] DAMAGECOUNT value on done: 295335.0 [2024-08-06 02:31:10,186][52649] Sum rewards: 65.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.590', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.058', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.370', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.296', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:10,206][52662] DAMAGECOUNT value on done: 315040.0 [2024-08-06 02:31:10,209][52662] Sum rewards: 69.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.617', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.147', 'AMMO3': '0.221', 'weapon5': '0.240', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.172', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:10,763][52667] DAMAGECOUNT value on done: 314598.0 [2024-08-06 02:31:10,763][52667] Sum rewards: 68.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:11,122][52665] DAMAGECOUNT value on done: 300739.0 [2024-08-06 02:31:11,124][52665] Sum rewards: 68.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.208', 'weapon5': '0.234', 'weapon2': '0.290', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '57.500'} [2024-08-06 02:31:11,267][52647] DAMAGECOUNT value on done: 327002.0 [2024-08-06 02:31:11,267][52647] Sum rewards: 65.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.696', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:11,421][52795] DAMAGECOUNT value on done: 292796.0 [2024-08-06 02:31:11,423][52795] Sum rewards: 63.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.455', 'AMMO5': '0.009', 'weapon5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon4': '0.308', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '56.500'} [2024-08-06 02:31:12,564][52811] DAMAGECOUNT value on done: 290247.0 [2024-08-06 02:31:12,566][52811] Sum rewards: 78.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.116', 'AMMO3': '0.203', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 317030400. Throughput: 0: 4380.0. Samples: 79266590. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:31:12,795][52567] Avg episode reward: [(0, '66.441')] [2024-08-06 02:31:12,854][52668] DAMAGECOUNT value on done: 307392.0 [2024-08-06 02:31:12,857][52668] Sum rewards: 64.244, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.574', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.021', 'weapon7': '0.076', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon4': '0.974', 'weapon3': '2.310', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '50.000'} [2024-08-06 02:31:13,030][52650] Updated weights for policy 0, policy_version 38701 (0.0011) [2024-08-06 02:31:13,111][52649] DAMAGECOUNT value on done: 302335.0 [2024-08-06 02:31:13,114][52649] Sum rewards: 66.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.025', 'weapon4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.191', 'weapon2': '0.340', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.358', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:13,201][52662] DAMAGECOUNT value on done: 314605.0 [2024-08-06 02:31:13,201][52662] Sum rewards: 58.090, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.254', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.140', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '50.000'} [2024-08-06 02:31:13,348][52803] DAMAGECOUNT value on done: 291400.0 [2024-08-06 02:31:13,378][52803] Sum rewards: 72.667, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.700', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.288', 'WEAPON3': '1.800', 'weapon3': '3.486', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '64.000'} [2024-08-06 02:31:13,788][52667] DAMAGECOUNT value on done: 315477.0 [2024-08-06 02:31:13,788][52667] Sum rewards: 55.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.190', 'AMMO3': '0.252', 'weapon2': '0.328', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '47.000'} [2024-08-06 02:31:13,959][52665] DAMAGECOUNT value on done: 300454.0 [2024-08-06 02:31:13,960][52665] Sum rewards: 73.329, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.134', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.712', 'WEAPON3': '0.950', 'weapon3': '2.942', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:14,121][52647] DAMAGECOUNT value on done: 327396.0 [2024-08-06 02:31:14,122][52647] Sum rewards: 69.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.051', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:14,543][52795] DAMAGECOUNT value on done: 285045.0 [2024-08-06 02:31:14,543][52795] Sum rewards: 59.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.584', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.066', 'weapon4': '0.124', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'weapon2': '0.928', 'WEAPON3': '0.950', 'weapon3': '2.738', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '48.000'} [2024-08-06 02:31:15,562][52811] DAMAGECOUNT value on done: 299640.0 [2024-08-06 02:31:15,564][52811] Sum rewards: 64.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.182', 'AMMO3': '0.186', 'weapon4': '0.230', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:15,668][52668] DAMAGECOUNT value on done: 313441.0 [2024-08-06 02:31:15,668][52668] Sum rewards: 69.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.792', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.390', 'WEAPON3': '1.100', 'weapon3': '3.298', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:16,159][52649] DAMAGECOUNT value on done: 302366.0 [2024-08-06 02:31:16,160][52649] Sum rewards: 68.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.635', 'AMMO5': '0.025', 'AMMO2': '0.050', 'weapon5': '0.096', 'AMMO3': '0.164', 'AMMO4': '0.252', 'weapon4': '0.280', 'weapon2': '0.572', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '57.500'} [2024-08-06 02:31:16,165][52662] DAMAGECOUNT value on done: 305856.0 [2024-08-06 02:31:16,165][52662] Sum rewards: 61.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.017', 'AMMO2': '0.068', 'AMMO3': '0.190', 'weapon5': '0.204', 'weapon2': '0.272', 'AMMO4': '0.337', 'weapon4': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '2.874', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:16,526][52803] DAMAGECOUNT value on done: 285992.0 [2024-08-06 02:31:16,526][52803] Sum rewards: 69.612, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.552', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO4': '0.211', 'weapon4': '0.234', 'AMMO3': '0.292', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.960', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:16,875][52665] DAMAGECOUNT value on done: 308168.0 [2024-08-06 02:31:16,875][52665] Sum rewards: 56.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.207', 'AMMO4': '0.246', 'weapon2': '0.260', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.096', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '48.000'} [2024-08-06 02:31:17,045][52647] DAMAGECOUNT value on done: 329640.0 [2024-08-06 02:31:17,045][52647] Sum rewards: 61.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.037', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon7': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.173', 'AMMO3': '0.177', 'WEAPON7': '0.200', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '2.948', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:17,062][52667] DAMAGECOUNT value on done: 310353.0 [2024-08-06 02:31:17,062][52667] Sum rewards: 68.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon2': '0.180', 'AMMO3': '0.184', 'AMMO4': '0.248', 'weapon5': '0.310', 'weapon4': '0.370', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '54.500'} [2024-08-06 02:31:17,620][52650] Updated weights for policy 0, policy_version 38711 (0.0013) [2024-08-06 02:31:17,699][52795] DAMAGECOUNT value on done: 284436.0 [2024-08-06 02:31:17,700][52795] Sum rewards: 66.685, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.568', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.112', 'weapon5': '0.132', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.114', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:17,760][52664] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:31:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 317120512. Throughput: 0: 4383.6. Samples: 79279660. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:31:17,794][52567] Avg episode reward: [(0, '66.150')] [2024-08-06 02:31:18,620][52662] DAMAGECOUNT value on done: 316134.0 [2024-08-06 02:31:18,621][52662] Sum rewards: 76.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.018', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.125', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:18,654][52811] DAMAGECOUNT value on done: 290074.0 [2024-08-06 02:31:18,655][52811] Sum rewards: 65.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.471', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:18,751][52668] DAMAGECOUNT value on done: 315442.0 [2024-08-06 02:31:18,758][52668] Sum rewards: 72.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.116', 'weapon4': '0.146', 'AMMO4': '0.225', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.642', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '60.000'} [2024-08-06 02:31:18,881][52649] DAMAGECOUNT value on done: 293230.0 [2024-08-06 02:31:18,881][52649] Sum rewards: 65.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.128', 'weapon5': '0.174', 'AMMO3': '0.214', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:19,432][52803] DAMAGECOUNT value on done: 295307.0 [2024-08-06 02:31:19,432][52803] Sum rewards: 63.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.144', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:19,593][52665] DAMAGECOUNT value on done: 310017.0 [2024-08-06 02:31:19,593][52665] Sum rewards: 66.402, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.030', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.064', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon2': '0.156', 'weapon4': '0.192', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.404', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:19,909][52647] DAMAGECOUNT value on done: 326715.0 [2024-08-06 02:31:19,909][52647] Sum rewards: 75.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.108', 'weapon5': '0.134', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '64.000'} [2024-08-06 02:31:19,934][52667] DAMAGECOUNT value on done: 310949.0 [2024-08-06 02:31:19,934][52667] Sum rewards: 66.704, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO4': '0.189', 'weapon2': '0.202', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:20,827][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:31:20,849][52795] DAMAGECOUNT value on done: 280927.0 [2024-08-06 02:31:20,849][52795] Sum rewards: 63.759, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.835', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon5': '0.184', 'weapon2': '0.270', 'AMMO3': '0.283', 'AMMO4': '0.289', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.774', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '55.500'} [2024-08-06 02:31:21,592][52668] DAMAGECOUNT value on done: 315965.0 [2024-08-06 02:31:21,593][52668] Sum rewards: 77.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.955', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.448', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '67.000'} [2024-08-06 02:31:21,695][52649] DAMAGECOUNT value on done: 305193.0 [2024-08-06 02:31:21,696][52649] Sum rewards: 67.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.195', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.120', 'AMMO3': '0.195', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:21,808][52811] DAMAGECOUNT value on done: 291905.0 [2024-08-06 02:31:21,808][52811] Sum rewards: 62.417, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'AMMO3': '0.282', 'weapon4': '0.314', 'WEAPON3': '1.700', 'weapon3': '2.890', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:21,827][52662] DAMAGECOUNT value on done: 307422.0 [2024-08-06 02:31:21,827][52662] Sum rewards: 72.762, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.378', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'AMMO4': '0.241', 'weapon4': '0.310', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '64.000'} [2024-08-06 02:31:22,141][52650] Updated weights for policy 0, policy_version 38721 (0.0018) [2024-08-06 02:31:22,269][52665] DAMAGECOUNT value on done: 308661.0 [2024-08-06 02:31:22,269][52665] Sum rewards: 72.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.499', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO3': '0.214', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.330', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:22,333][52803] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:31:22,472][52803] DAMAGECOUNT value on done: 291635.0 [2024-08-06 02:31:22,473][52803] Sum rewards: 68.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.176', 'AMMO3': '0.199', 'AMMO4': '0.200', 'weapon2': '0.212', 'WEAPON5': '0.250', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.162', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 317210624. Throughput: 0: 4384.0. Samples: 79305910. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:31:22,802][52567] Avg episode reward: [(0, '66.606')] [2024-08-06 02:31:22,839][52667] DAMAGECOUNT value on done: 317084.0 [2024-08-06 02:31:22,839][52667] Sum rewards: 75.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO4': '0.184', 'AMMO3': '0.211', 'weapon2': '0.272', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '63.000'} [2024-08-06 02:31:22,948][52647] DAMAGECOUNT value on done: 331656.0 [2024-08-06 02:31:22,950][52647] Sum rewards: 71.579, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.102', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon2': '0.132', 'weapon5': '0.170', 'weapon4': '0.178', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.298', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:23,956][52795] DAMAGECOUNT value on done: 289858.0 [2024-08-06 02:31:23,958][52795] Sum rewards: 70.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.702', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.076', 'weapon5': '0.204', 'AMMO3': '0.226', 'AMMO4': '0.277', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:24,128][52668] DAMAGECOUNT value on done: 305561.0 [2024-08-06 02:31:24,131][52668] Sum rewards: 78.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.156', 'AMMO4': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:24,480][52649] DAMAGECOUNT value on done: 301425.0 [2024-08-06 02:31:24,483][52649] Sum rewards: 69.246, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.085', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:24,831][52662] DAMAGECOUNT value on done: 317059.0 [2024-08-06 02:31:24,832][52662] Sum rewards: 63.019, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.492', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.094', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.196', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:24,884][52811] DAMAGECOUNT value on done: 296327.0 [2024-08-06 02:31:24,886][52811] Sum rewards: 65.484, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.535', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.203', 'weapon4': '0.242', 'AMMO3': '0.245', 'weapon2': '0.248', 'weapon5': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:25,163][52665] DAMAGECOUNT value on done: 307012.0 [2024-08-06 02:31:25,163][52665] Sum rewards: 78.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.165', 'weapon4': '0.228', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:25,427][52667] DAMAGECOUNT value on done: 309405.0 [2024-08-06 02:31:25,429][52667] Sum rewards: 61.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.256', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.160', 'AMMO3': '0.205', 'weapon2': '0.276', 'weapon4': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:25,615][52647] DAMAGECOUNT value on done: 327997.0 [2024-08-06 02:31:25,617][52647] Sum rewards: 66.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.046', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.188', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:25,650][52803] DAMAGECOUNT value on done: 287650.0 [2024-08-06 02:31:25,652][52803] Sum rewards: 65.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.288', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.978', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:26,688][52663] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2024-08-06 02:31:26,754][52658] Large shaping reward 2.609 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.558, 186.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:31:26,999][52650] Updated weights for policy 0, policy_version 38731 (0.0020) [2024-08-06 02:31:27,047][52795] DAMAGECOUNT value on done: 278525.0 [2024-08-06 02:31:27,050][52795] Sum rewards: 59.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.135', 'AMMO5': '0.021', 'AMMO2': '0.059', 'AMMO3': '0.153', 'weapon4': '0.198', 'AMMO4': '0.296', 'weapon5': '0.344', 'weapon2': '0.350', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'HITCOUNT': '2.460', 'weapon3': '2.790', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '48.500'} [2024-08-06 02:31:27,142][52668] DAMAGECOUNT value on done: 315212.0 [2024-08-06 02:31:27,142][52668] Sum rewards: 69.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon2': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.390', 'weapon3': '3.468', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:27,521][52649] DAMAGECOUNT value on done: 307288.0 [2024-08-06 02:31:27,522][52649] Sum rewards: 76.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.134', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '62.000'} [2024-08-06 02:31:27,635][52662] DAMAGECOUNT value on done: 322029.0 [2024-08-06 02:31:27,635][52662] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.042', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.211', 'weapon2': '0.802', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 317300736. Throughput: 0: 4384.2. Samples: 79332240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:31:27,794][52567] Avg episode reward: [(0, '67.318')] [2024-08-06 02:31:27,982][52647] DAMAGECOUNT value on done: 324268.0 [2024-08-06 02:31:27,983][52647] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.159', 'AMMO4': '0.195', 'weapon5': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.436', 'weapon4': '0.714', 'WEAPON3': '0.900', 'weapon3': '2.332', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '60.000'} [2024-08-06 02:31:27,994][52811] DAMAGECOUNT value on done: 290001.0 [2024-08-06 02:31:27,995][52811] Sum rewards: 66.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.258', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.138', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.214', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '55.500'} [2024-08-06 02:31:28,196][52665] DAMAGECOUNT value on done: 314062.0 [2024-08-06 02:31:28,196][52665] Sum rewards: 71.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.170', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.166', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:28,459][52667] DAMAGECOUNT value on done: 313777.0 [2024-08-06 02:31:28,461][52667] Sum rewards: 54.908, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.380', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.142', 'weapon4': '0.176', 'AMMO4': '0.280', 'AMMO3': '0.314', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.800', 'weapon3': '2.868', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:28,744][52803] DAMAGECOUNT value on done: 295296.0 [2024-08-06 02:31:28,745][52803] Sum rewards: 70.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.110', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.229', 'weapon2': '0.246', 'WEAPON3': '1.300', 'HITCOUNT': '3.390', 'weapon3': '3.594', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '60.000'} [2024-08-06 02:31:29,650][52669] DAMAGECOUNT value on done: 316066.0 [2024-08-06 02:31:29,651][52669] Sum rewards: 82.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.204', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon4': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '70.000'} [2024-08-06 02:31:30,046][52668] DAMAGECOUNT value on done: 312333.0 [2024-08-06 02:31:30,046][52668] Sum rewards: 62.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.068', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.244', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '52.500'} [2024-08-06 02:31:30,083][52662] DAMAGECOUNT value on done: 312328.0 [2024-08-06 02:31:30,085][52662] Sum rewards: 71.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.848', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.098', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:30,169][52795] DAMAGECOUNT value on done: 296592.0 [2024-08-06 02:31:30,169][52795] Sum rewards: 76.019, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.056', 'AMMO3': '0.149', 'AMMO4': '0.175', 'weapon5': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '63.000'} [2024-08-06 02:31:30,250][52647] DAMAGECOUNT value on done: 331616.0 [2024-08-06 02:31:30,250][52647] Sum rewards: 73.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.297', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.130', 'AMMO3': '0.210', 'AMMO4': '0.252', 'weapon2': '0.302', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '62.000'} [2024-08-06 02:31:30,749][52649] DAMAGECOUNT value on done: 303497.0 [2024-08-06 02:31:30,751][52649] Sum rewards: 69.922, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.946', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.108', 'AMMO3': '0.256', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:31,145][52811] DAMAGECOUNT value on done: 293445.0 [2024-08-06 02:31:31,145][52811] Sum rewards: 63.632, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.261', 'weapon4': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:31,256][52665] DAMAGECOUNT value on done: 308831.0 [2024-08-06 02:31:31,257][52665] Sum rewards: 63.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.209', 'weapon4': '0.256', 'weapon2': '0.270', 'AMMO4': '0.283', 'weapon5': '0.304', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:31,358][52667] DAMAGECOUNT value on done: 310686.0 [2024-08-06 02:31:31,358][52667] Sum rewards: 66.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon4': '0.326', 'weapon2': '0.358', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.038', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:31,604][52660] DAMAGECOUNT value on done: 307296.0 [2024-08-06 02:31:31,605][52660] Sum rewards: 62.969, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.621', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.161', 'weapon4': '0.172', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '50.000'} [2024-08-06 02:31:31,639][52650] Updated weights for policy 0, policy_version 38741 (0.0025) [2024-08-06 02:31:31,816][52803] DAMAGECOUNT value on done: 287964.0 [2024-08-06 02:31:31,816][52803] Sum rewards: 68.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.234', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.226', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.268', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:32,537][52669] DAMAGECOUNT value on done: 307103.0 [2024-08-06 02:31:32,537][52669] Sum rewards: 69.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.220', 'weapon2': '0.480', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.264', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 317382656. Throughput: 0: 4384.0. Samples: 79345540. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:31:32,802][52567] Avg episode reward: [(0, '67.899')] [2024-08-06 02:31:33,122][52668] DAMAGECOUNT value on done: 307787.0 [2024-08-06 02:31:33,123][52668] Sum rewards: 60.354, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.120', 'weapon4': '0.138', 'AMMO3': '0.218', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:33,151][52662] DAMAGECOUNT value on done: 323346.0 [2024-08-06 02:31:33,153][52662] Sum rewards: 62.404, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.688', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.124', 'weapon5': '0.130', 'AMMO4': '0.155', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.118', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '50.000'} [2024-08-06 02:31:33,381][52795] DAMAGECOUNT value on done: 289223.0 [2024-08-06 02:31:33,381][52795] Sum rewards: 62.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.897', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO3': '0.194', 'AMMO4': '0.214', 'weapon2': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.402', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:33,518][52647] DAMAGECOUNT value on done: 324727.0 [2024-08-06 02:31:33,519][52647] Sum rewards: 51.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.658', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '44.000'} [2024-08-06 02:31:33,612][52649] DAMAGECOUNT value on done: 302449.0 [2024-08-06 02:31:33,613][52649] Sum rewards: 48.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.225', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.170', 'AMMO4': '0.204', 'weapon5': '0.270', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.510', 'weapon3': '2.898', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '45.000'} [2024-08-06 02:31:34,083][52665] DAMAGECOUNT value on done: 308302.0 [2024-08-06 02:31:34,083][52665] Sum rewards: 73.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.098', 'weapon5': '0.136', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:34,096][52811] DAMAGECOUNT value on done: 293047.0 [2024-08-06 02:31:34,097][52811] Sum rewards: 66.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.702', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO4': '0.178', 'AMMO3': '0.180', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.120', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:34,105][52667] DAMAGECOUNT value on done: 308744.0 [2024-08-06 02:31:34,106][52667] Sum rewards: 59.120, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.712', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.174', 'weapon4': '0.220', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.950', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:34,542][52660] DAMAGECOUNT value on done: 305332.0 [2024-08-06 02:31:34,543][52660] Sum rewards: 70.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.272', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:34,720][52663] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:31:35,000][52803] DAMAGECOUNT value on done: 288441.0 [2024-08-06 02:31:35,001][52803] Sum rewards: 79.592, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.309', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.140', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '64.000'} [2024-08-06 02:31:35,066][52669] DAMAGECOUNT value on done: 314653.0 [2024-08-06 02:31:35,067][52669] Sum rewards: 72.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.865', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.235', 'weapon2': '0.276', 'WEAPON3': '1.350', 'HITCOUNT': '3.450', 'weapon3': '3.498', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '60.000'} [2024-08-06 02:31:35,956][52668] DAMAGECOUNT value on done: 312251.0 [2024-08-06 02:31:35,957][52668] Sum rewards: 54.668, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon4': '0.244', 'AMMO3': '0.258', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '48.500'} [2024-08-06 02:31:36,177][52662] DAMAGECOUNT value on done: 309337.0 [2024-08-06 02:31:36,179][52662] Sum rewards: 63.079, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.377', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.115', 'AMMO4': '0.199', 'weapon5': '0.230', 'weapon2': '0.234', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'HITCOUNT': '2.930', 'weapon3': '2.942', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '49.000'} [2024-08-06 02:31:36,420][52650] Updated weights for policy 0, policy_version 38751 (0.0027) [2024-08-06 02:31:36,495][52647] DAMAGECOUNT value on done: 331773.0 [2024-08-06 02:31:36,496][52647] Sum rewards: 67.232, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.458', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.176', 'AMMO3': '0.259', 'AMMO4': '0.262', 'weapon2': '0.368', 'weapon4': '0.416', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.642', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '60.000'} [2024-08-06 02:31:36,639][52795] DAMAGECOUNT value on done: 280167.0 [2024-08-06 02:31:36,639][52795] Sum rewards: 63.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.182', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:36,684][52649] DAMAGECOUNT value on done: 304423.0 [2024-08-06 02:31:36,685][52649] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.454', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.244', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.342', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '62.500'} [2024-08-06 02:31:36,898][52667] DAMAGECOUNT value on done: 315868.0 [2024-08-06 02:31:36,899][52667] Sum rewards: 69.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.045', 'AMMO2': '0.002', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.191', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.384', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:37,021][52660] DAMAGECOUNT value on done: 315269.0 [2024-08-06 02:31:37,022][52660] Sum rewards: 66.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.623', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.134', 'AMMO3': '0.192', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.236', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:37,223][52665] DAMAGECOUNT value on done: 307773.0 [2024-08-06 02:31:37,223][52665] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.186', 'AMMO4': '0.188', 'AMMO3': '0.192', 'weapon4': '0.202', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:37,274][52811] DAMAGECOUNT value on done: 288491.0 [2024-08-06 02:31:37,274][52811] Sum rewards: 82.121, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.481', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'weapon2': '0.266', 'AMMO3': '0.326', 'WEAPON3': '1.800', 'weapon3': '3.224', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '71.000'} [2024-08-06 02:31:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 317472768. Throughput: 0: 4375.8. Samples: 79371480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:31:37,794][52567] Avg episode reward: [(0, '67.660')] [2024-08-06 02:31:38,070][52803] DAMAGECOUNT value on done: 296363.0 [2024-08-06 02:31:38,071][52803] Sum rewards: 67.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.605', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.153', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:38,191][52669] DAMAGECOUNT value on done: 309317.0 [2024-08-06 02:31:38,192][52669] Sum rewards: 78.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.285', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.030', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.452', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '67.000'} [2024-08-06 02:31:38,546][52668] DAMAGECOUNT value on done: 310972.0 [2024-08-06 02:31:38,549][52668] Sum rewards: 61.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO4': '0.201', 'AMMO3': '0.248', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.248', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:38,848][52647] DAMAGECOUNT value on done: 322095.0 [2024-08-06 02:31:38,849][52647] Sum rewards: 68.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.043', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.188', 'AMMO3': '0.189', 'AMMO4': '0.231', 'weapon2': '0.270', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:38,927][52662] DAMAGECOUNT value on done: 311150.0 [2024-08-06 02:31:38,929][52662] Sum rewards: 67.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.583', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.226', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:39,769][52795] DAMAGECOUNT value on done: 290223.0 [2024-08-06 02:31:39,771][52795] Sum rewards: 64.431, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.412', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.170', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.214', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:39,841][52667] DAMAGECOUNT value on done: 319317.0 [2024-08-06 02:31:39,842][52667] Sum rewards: 61.318, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.016', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.152', 'weapon4': '0.168', 'AMMO3': '0.244', 'AMMO4': '0.267', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.942', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:39,867][52649] DAMAGECOUNT value on done: 305035.0 [2024-08-06 02:31:39,869][52649] Sum rewards: 69.078, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.560', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.184', 'weapon4': '0.234', 'AMMO4': '0.314', 'AMMO3': '0.331', 'weapon2': '0.352', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '2.000', 'weapon3': '2.856', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '64.000'} [2024-08-06 02:31:40,009][52820] DAMAGECOUNT value on done: 284104.0 [2024-08-06 02:31:40,009][52820] Sum rewards: 68.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.195', 'AMMO4': '0.198', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:40,052][52660] DAMAGECOUNT value on done: 314244.0 [2024-08-06 02:31:40,053][52660] Sum rewards: 70.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.163', 'weapon2': '0.166', 'weapon4': '0.186', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:40,371][52811] DAMAGECOUNT value on done: 291994.0 [2024-08-06 02:31:40,371][52811] Sum rewards: 64.508, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.146', 'AMMO3': '0.174', 'AMMO4': '0.185', 'weapon5': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:40,378][52665] DAMAGECOUNT value on done: 308367.0 [2024-08-06 02:31:40,378][52665] Sum rewards: 70.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.270', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon5': '0.252', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '60.000'} [2024-08-06 02:31:40,902][52650] Updated weights for policy 0, policy_version 38761 (0.0013) [2024-08-06 02:31:40,919][52669] DAMAGECOUNT value on done: 308979.0 [2024-08-06 02:31:40,923][52669] Sum rewards: 68.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'weapon4': '0.152', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:41,307][52803] DAMAGECOUNT value on done: 289212.0 [2024-08-06 02:31:41,307][52803] Sum rewards: 64.985, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.505', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.166', 'AMMO4': '0.201', 'weapon5': '0.204', 'weapon4': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.612', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:41,434][52647] DAMAGECOUNT value on done: 325135.0 [2024-08-06 02:31:41,435][52647] Sum rewards: 67.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.197', 'weapon2': '0.272', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.478', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:41,582][52662] DAMAGECOUNT value on done: 314589.0 [2024-08-06 02:31:41,584][52662] Sum rewards: 65.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.028', 'AMMO2': '0.057', 'weapon4': '0.168', 'weapon5': '0.238', 'AMMO3': '0.239', 'weapon2': '0.272', 'AMMO4': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.022', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '54.500'} [2024-08-06 02:31:41,913][52794] DAMAGECOUNT value on done: 312373.0 [2024-08-06 02:31:41,913][52794] Sum rewards: 52.500, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.106', 'AMMO4': '0.171', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.298', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '47.000'} [2024-08-06 02:31:41,935][52668] DAMAGECOUNT value on done: 315768.0 [2024-08-06 02:31:41,936][52668] Sum rewards: 69.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.154', 'AMMO4': '0.166', 'weapon5': '0.172', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:42,756][52667] DAMAGECOUNT value on done: 316777.0 [2024-08-06 02:31:42,758][52667] Sum rewards: 87.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.164', 'AMMO3': '0.169', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.285', 'FRAGCOUNT': '69.000'} [2024-08-06 02:31:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 317562880. Throughput: 0: 4378.0. Samples: 79397740. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:31:42,802][52567] Avg episode reward: [(0, '67.453')] [2024-08-06 02:31:42,874][52795] DAMAGECOUNT value on done: 293791.0 [2024-08-06 02:31:42,874][52795] Sum rewards: 65.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.136', 'weapon4': '0.164', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:43,055][52820] DAMAGECOUNT value on done: 288681.0 [2024-08-06 02:31:43,057][52820] Sum rewards: 72.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.545', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.500'} [2024-08-06 02:31:43,191][52660] DAMAGECOUNT value on done: 311141.0 [2024-08-06 02:31:43,192][52660] Sum rewards: 63.374, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.960', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.164', 'weapon2': '0.224', 'AMMO4': '0.237', 'weapon4': '0.258', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.048', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '57.500'} [2024-08-06 02:31:43,477][52649] DAMAGECOUNT value on done: 306484.0 [2024-08-06 02:31:43,477][52649] Sum rewards: 61.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.088', 'weapon5': '0.148', 'AMMO4': '0.169', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:43,528][52811] DAMAGECOUNT value on done: 293488.0 [2024-08-06 02:31:43,528][52811] Sum rewards: 64.668, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.877', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.416', 'weapon4': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.638', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:43,586][52669] DAMAGECOUNT value on done: 311650.0 [2024-08-06 02:31:43,589][52669] Sum rewards: 62.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.475', 'AMMO5': '0.004', 'AMMO2': '0.035', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.226', 'AMMO3': '0.266', 'weapon2': '0.374', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:43,868][52665] DAMAGECOUNT value on done: 305506.0 [2024-08-06 02:31:43,870][52665] Sum rewards: 62.757, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.864', 'AMMO5': '0.022', 'AMMO2': '0.061', 'weapon5': '0.078', 'AMMO3': '0.233', 'weapon2': '0.276', 'AMMO4': '0.303', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:43,957][52662] DAMAGECOUNT value on done: 319138.0 [2024-08-06 02:31:43,959][52662] Sum rewards: 64.935, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.896', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.130', 'AMMO4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.287', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.044', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:44,193][52803] DAMAGECOUNT value on done: 294923.0 [2024-08-06 02:31:44,194][52803] Sum rewards: 82.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.146', 'weapon4': '0.186', 'AMMO3': '0.212', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '69.000'} [2024-08-06 02:31:44,438][52794] DAMAGECOUNT value on done: 318695.0 [2024-08-06 02:31:44,440][52794] Sum rewards: 73.997, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.386', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.112', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 02:31:44,505][52647] DAMAGECOUNT value on done: 326523.0 [2024-08-06 02:31:44,505][52647] Sum rewards: 63.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.227', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.140', 'weapon2': '0.160', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:44,645][52668] DAMAGECOUNT value on done: 308693.0 [2024-08-06 02:31:44,648][52668] Sum rewards: 70.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.718', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:45,653][52667] DAMAGECOUNT value on done: 318959.0 [2024-08-06 02:31:45,665][52667] Sum rewards: 65.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.266', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:45,715][52650] Updated weights for policy 0, policy_version 38771 (0.0013) [2024-08-06 02:31:45,910][52660] DAMAGECOUNT value on done: 306949.0 [2024-08-06 02:31:45,911][52660] Sum rewards: 81.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.282', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '67.000'} [2024-08-06 02:31:46,032][52820] DAMAGECOUNT value on done: 286772.0 [2024-08-06 02:31:46,032][52820] Sum rewards: 64.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.718', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.202', 'weapon2': '0.334', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:46,288][52649] DAMAGECOUNT value on done: 308608.0 [2024-08-06 02:31:46,288][52649] Sum rewards: 79.124, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon4': '0.242', 'HEALTH': '0.358', 'weapon2': '0.386', 'WEAPON3': '0.950', 'weapon3': '3.166', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '63.000'} [2024-08-06 02:31:46,534][52811] DAMAGECOUNT value on done: 289118.0 [2024-08-06 02:31:46,537][52811] Sum rewards: 71.124, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.635', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.340', 'weapon2': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:46,602][52669] DAMAGECOUNT value on done: 312892.0 [2024-08-06 02:31:46,602][52669] Sum rewards: 68.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.836', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.122', 'weapon4': '0.170', 'AMMO4': '0.213', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:46,699][52665] DAMAGECOUNT value on done: 303764.0 [2024-08-06 02:31:46,701][52665] Sum rewards: 50.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.214', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.692', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '42.000'} [2024-08-06 02:31:46,817][52658] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:31:46,851][52647] DAMAGECOUNT value on done: 334345.0 [2024-08-06 02:31:46,851][52647] Sum rewards: 63.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '2.806', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '53.500'} [2024-08-06 02:31:46,898][52662] DAMAGECOUNT value on done: 311786.0 [2024-08-06 02:31:46,898][52662] Sum rewards: 55.002, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.883', 'AMMO5': '0.021', 'AMMO2': '0.070', 'AMMO3': '0.201', 'weapon5': '0.232', 'AMMO4': '0.351', 'weapon2': '0.372', 'weapon4': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '48.000'} [2024-08-06 02:31:47,285][52665] Large shaping reward 2.704 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:31:47,356][52803] DAMAGECOUNT value on done: 284866.0 [2024-08-06 02:31:47,356][52803] Sum rewards: 79.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.701', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.182', 'AMMO4': '0.219', 'weapon2': '0.230', 'AMMO3': '0.244', 'weapon4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.072', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '67.000'} [2024-08-06 02:31:47,366][52668] DAMAGECOUNT value on done: 302094.0 [2024-08-06 02:31:47,366][52668] Sum rewards: 67.578, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.535', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.206', 'AMMO4': '0.218', 'AMMO3': '0.272', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:47,444][52794] DAMAGECOUNT value on done: 311203.0 [2024-08-06 02:31:47,447][52794] Sum rewards: 73.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.353', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.128', 'weapon4': '0.130', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:47,741][52658] DAMAGECOUNT value on done: 311676.0 [2024-08-06 02:31:47,742][52658] Sum rewards: 58.329, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.044', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO4': '0.213', 'weapon5': '0.228', 'AMMO3': '0.245', 'weapon4': '0.436', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.556', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '51.000'} [2024-08-06 02:31:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 317644800. Throughput: 0: 4376.9. Samples: 79410940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:31:47,794][52567] Avg episode reward: [(0, '67.783')] [2024-08-06 02:31:48,506][52667] DAMAGECOUNT value on done: 308826.0 [2024-08-06 02:31:48,506][52667] Sum rewards: 61.745, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.065', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon4': '0.100', 'weapon5': '0.202', 'AMMO3': '0.267', 'AMMO4': '0.298', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.880', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '55.000'} [2024-08-06 02:31:48,622][52660] DAMAGECOUNT value on done: 312624.0 [2024-08-06 02:31:48,622][52660] Sum rewards: 69.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.634', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.230', 'AMMO3': '0.235', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:49,100][52820] DAMAGECOUNT value on done: 283445.0 [2024-08-06 02:31:49,101][52820] Sum rewards: 78.603, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.042', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:49,212][52649] DAMAGECOUNT value on done: 298819.0 [2024-08-06 02:31:49,215][52649] Sum rewards: 63.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.419', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.188', 'AMMO3': '0.193', 'AMMO4': '0.221', 'weapon4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:49,420][52649] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:31:49,476][52665] DAMAGECOUNT value on done: 304705.0 [2024-08-06 02:31:49,477][52665] Sum rewards: 60.490, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.845', 'ARMOR': '0.008', 'AMMO5': '0.026', 'AMMO2': '0.078', 'AMMO3': '0.270', 'weapon5': '0.312', 'AMMO4': '0.392', 'weapon4': '0.526', 'weapon2': '0.532', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.600', 'weapon3': '2.310', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:49,552][52811] DAMAGECOUNT value on done: 294725.0 [2024-08-06 02:31:49,553][52811] Sum rewards: 81.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.171', 'weapon2': '0.190', 'WEAPON4': '0.300', 'weapon4': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.794', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '67.000'} [2024-08-06 02:31:49,572][52662] DAMAGECOUNT value on done: 324903.0 [2024-08-06 02:31:49,572][52662] Sum rewards: 60.224, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'weapon5': '0.014', 'weapon4': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.490', 'WEAPON3': '0.900', 'HITCOUNT': '2.710', 'weapon3': '3.400', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '49.000'} [2024-08-06 02:31:49,649][52669] DAMAGECOUNT value on done: 311724.0 [2024-08-06 02:31:49,649][52669] Sum rewards: 56.625, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.096', 'weapon5': '0.098', 'AMMO4': '0.099', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '0.800', 'HITCOUNT': '2.620', 'weapon3': '3.246', 'DAMAGECOUNT': '12.720', 'FRAGCOUNT': '45.000'} [2024-08-06 02:31:49,847][52647] DAMAGECOUNT value on done: 328220.0 [2024-08-06 02:31:49,847][52647] Sum rewards: 62.619, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.050', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.088', 'weapon4': '0.108', 'AMMO4': '0.218', 'AMMO3': '0.255', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.280', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:49,958][52794] DAMAGECOUNT value on done: 310888.0 [2024-08-06 02:31:49,959][52794] Sum rewards: 63.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.011', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.106', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:50,243][52668] DAMAGECOUNT value on done: 303705.0 [2024-08-06 02:31:50,244][52668] Sum rewards: 70.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.622', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon4': '0.356', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.802', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:50,388][52658] DAMAGECOUNT value on done: 311382.0 [2024-08-06 02:31:50,391][52658] Sum rewards: 59.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.092', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.228', 'weapon2': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.220', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '50.000'} [2024-08-06 02:31:50,577][52650] Updated weights for policy 0, policy_version 38781 (0.0023) [2024-08-06 02:31:51,087][52667] DAMAGECOUNT value on done: 315981.0 [2024-08-06 02:31:51,090][52667] Sum rewards: 75.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.181', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '63.000'} [2024-08-06 02:31:51,584][52660] DAMAGECOUNT value on done: 317138.0 [2024-08-06 02:31:51,584][52660] Sum rewards: 65.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.062', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.202', 'weapon5': '0.214', 'AMMO3': '0.217', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:52,201][52820] DAMAGECOUNT value on done: 288569.0 [2024-08-06 02:31:52,202][52820] Sum rewards: 59.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.026', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.120', 'AMMO4': '0.167', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.322', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:52,204][52662] DAMAGECOUNT value on done: 316722.0 [2024-08-06 02:31:52,205][52662] Sum rewards: 73.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.409', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.124', 'weapon5': '0.166', 'AMMO4': '0.217', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.174', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '62.000'} [2024-08-06 02:31:52,231][52649] DAMAGECOUNT value on done: 304847.0 [2024-08-06 02:31:52,232][52649] Sum rewards: 68.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.110', 'AMMO3': '0.194', 'AMMO4': '0.201', 'weapon4': '0.280', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:52,532][52665] DAMAGECOUNT value on done: 307729.0 [2024-08-06 02:31:52,534][52665] Sum rewards: 66.679, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.340', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.082', 'weapon4': '0.114', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.301', 'weapon2': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.156', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '60.000'} [2024-08-06 02:31:52,566][52647] DAMAGECOUNT value on done: 326125.0 [2024-08-06 02:31:52,566][52647] Sum rewards: 71.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.002', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.090', 'weapon4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:52,730][52669] DAMAGECOUNT value on done: 310982.0 [2024-08-06 02:31:52,731][52669] Sum rewards: 66.303, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.181', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.126', 'AMMO3': '0.141', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '3.010', 'weapon3': '3.188', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 317734912. Throughput: 0: 4376.0. Samples: 79437320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:31:52,802][52567] Avg episode reward: [(0, '67.311')] [2024-08-06 02:31:52,827][52794] DAMAGECOUNT value on done: 309438.0 [2024-08-06 02:31:52,829][52794] Sum rewards: 69.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.025', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.128', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.374', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:52,978][52668] DAMAGECOUNT value on done: 303500.0 [2024-08-06 02:31:52,980][52668] Sum rewards: 66.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.201', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.268', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '57.000'} [2024-08-06 02:31:53,431][52658] DAMAGECOUNT value on done: 315926.0 [2024-08-06 02:31:53,432][52658] Sum rewards: 70.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.262', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO4': '0.203', 'AMMO3': '0.239', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '59.000'} [2024-08-06 02:31:54,049][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:31:54,222][52647] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:31:54,236][52660] DAMAGECOUNT value on done: 314484.0 [2024-08-06 02:31:54,237][52660] Sum rewards: 56.102, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.850', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.178', 'weapon4': '0.192', 'AMMO4': '0.247', 'AMMO3': '0.280', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.012', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '52.000'} [2024-08-06 02:31:54,731][52650] Updated weights for policy 0, policy_version 38791 (0.0018) [2024-08-06 02:31:55,100][52649] DAMAGECOUNT value on done: 302520.0 [2024-08-06 02:31:55,101][52649] Sum rewards: 56.783, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.832', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.134', 'weapon2': '0.196', 'AMMO4': '0.217', 'weapon4': '0.232', 'WEAPON5': '0.300', 'AMMO3': '0.331', 'WEAPON4': '0.400', 'WEAPON3': '1.950', 'HITCOUNT': '3.070', 'weapon3': '3.122', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:55,229][52662] DAMAGECOUNT value on done: 315588.0 [2024-08-06 02:31:55,229][52662] Sum rewards: 62.362, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.138', 'weapon4': '0.190', 'AMMO3': '0.262', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:55,363][52647] DAMAGECOUNT value on done: 323586.0 [2024-08-06 02:31:55,364][52647] Sum rewards: 64.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.895', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.378', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.000'} [2024-08-06 02:31:55,421][52665] DAMAGECOUNT value on done: 308114.0 [2024-08-06 02:31:55,422][52665] Sum rewards: 78.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.047', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.374', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:55,486][52820] DAMAGECOUNT value on done: 282195.0 [2024-08-06 02:31:55,489][52820] Sum rewards: 65.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.236', 'weapon4': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:55,570][52668] DAMAGECOUNT value on done: 308375.0 [2024-08-06 02:31:55,571][52668] Sum rewards: 65.644, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.538', 'AMMO5': '0.017', 'AMMO2': '0.077', 'weapon5': '0.202', 'AMMO3': '0.279', 'weapon4': '0.366', 'AMMO4': '0.383', 'weapon2': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.674', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:55,744][52669] DAMAGECOUNT value on done: 309623.0 [2024-08-06 02:31:55,747][52669] Sum rewards: 63.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.072', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.230', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.266', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:55,845][52794] DAMAGECOUNT value on done: 315140.0 [2024-08-06 02:31:55,847][52794] Sum rewards: 76.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.033', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon4': '0.174', 'AMMO3': '0.186', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.758', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 02:31:56,300][52658] DAMAGECOUNT value on done: 312751.0 [2024-08-06 02:31:56,300][52658] Sum rewards: 73.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.739', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '61.000'} [2024-08-06 02:31:56,797][52660] DAMAGECOUNT value on done: 308102.0 [2024-08-06 02:31:56,797][52660] Sum rewards: 62.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.511', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.116', 'AMMO4': '0.117', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.096', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 317825024. Throughput: 0: 4380.0. Samples: 79463690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:31:57,794][52567] Avg episode reward: [(0, '67.003')] [2024-08-06 02:31:57,887][52647] DAMAGECOUNT value on done: 318999.0 [2024-08-06 02:31:57,888][52647] Sum rewards: 80.835, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.624', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '69.000'} [2024-08-06 02:31:58,113][52649] DAMAGECOUNT value on done: 307654.0 [2024-08-06 02:31:58,116][52649] Sum rewards: 67.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.502', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.203', 'AMMO3': '0.207', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '56.500'} [2024-08-06 02:31:58,157][52668] DAMAGECOUNT value on done: 310934.0 [2024-08-06 02:31:58,158][52668] Sum rewards: 69.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.934', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.209', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '58.000'} [2024-08-06 02:31:58,252][52662] DAMAGECOUNT value on done: 313207.0 [2024-08-06 02:31:58,252][52662] Sum rewards: 69.642, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.932', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '55.500'} [2024-08-06 02:31:58,524][52820] DAMAGECOUNT value on done: 285010.0 [2024-08-06 02:31:58,527][52820] Sum rewards: 71.544, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.076', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.070', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 02:31:58,754][52794] DAMAGECOUNT value on done: 319231.0 [2024-08-06 02:31:58,758][52794] Sum rewards: 81.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.352', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.211', 'weapon4': '0.228', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.226', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '66.000'} [2024-08-06 02:31:58,798][52658] DAMAGECOUNT value on done: 311976.0 [2024-08-06 02:31:58,798][52658] Sum rewards: 73.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.335', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.310', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.420', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '64.000'} [2024-08-06 02:31:59,068][52669] DAMAGECOUNT value on done: 315656.0 [2024-08-06 02:31:59,068][52669] Sum rewards: 62.618, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.973', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.164', 'AMMO4': '0.188', 'AMMO3': '0.273', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.050', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '56.000'} [2024-08-06 02:31:59,629][52660] DAMAGECOUNT value on done: 318188.0 [2024-08-06 02:31:59,630][52660] Sum rewards: 62.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.548', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.320', 'weapon4': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '54.000'} [2024-08-06 02:31:59,671][52650] Updated weights for policy 0, policy_version 38801 (0.0036) [2024-08-06 02:32:00,743][52647] DAMAGECOUNT value on done: 326834.0 [2024-08-06 02:32:00,744][52647] Sum rewards: 53.511, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.071', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.052', 'weapon4': '0.076', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.590', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '3.130', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '43.000'} [2024-08-06 02:32:00,986][52649] DAMAGECOUNT value on done: 309403.0 [2024-08-06 02:32:00,987][52649] Sum rewards: 73.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:01,026][52662] DAMAGECOUNT value on done: 308766.0 [2024-08-06 02:32:01,027][52662] Sum rewards: 70.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.148', 'weapon5': '0.178', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:01,301][52668] DAMAGECOUNT value on done: 312630.0 [2024-08-06 02:32:01,302][52668] Sum rewards: 67.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.872', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.156', 'AMMO4': '0.197', 'AMMO3': '0.198', 'weapon2': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.260', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 02:32:01,519][52820] DAMAGECOUNT value on done: 291364.0 [2024-08-06 02:32:01,521][52820] Sum rewards: 78.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.042', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.196', 'AMMO3': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.478', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '68.000'} [2024-08-06 02:32:01,601][52658] DAMAGECOUNT value on done: 310269.0 [2024-08-06 02:32:01,602][52658] Sum rewards: 55.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.086', 'AMMO4': '0.145', 'weapon5': '0.192', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.110', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '48.000'} [2024-08-06 02:32:01,724][52794] DAMAGECOUNT value on done: 312827.0 [2024-08-06 02:32:01,724][52794] Sum rewards: 66.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.185', 'weapon2': '0.222', 'AMMO4': '0.269', 'weapon5': '0.286', 'weapon4': '0.396', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '55.000'} [2024-08-06 02:32:02,073][52669] DAMAGECOUNT value on done: 312425.0 [2024-08-06 02:32:02,073][52669] Sum rewards: 68.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.746', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.173', 'AMMO4': '0.204', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '56.000'} [2024-08-06 02:32:02,528][52671] DAMAGECOUNT value on done: 317178.0 [2024-08-06 02:32:02,531][52671] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.024', 'AMMO2': '0.073', 'AMMO3': '0.218', 'weapon2': '0.280', 'AMMO4': '0.365', 'weapon5': '0.368', 'weapon4': '0.532', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.438', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '58.500'} [2024-08-06 02:32:02,619][52660] DAMAGECOUNT value on done: 303844.0 [2024-08-06 02:32:02,620][52660] Sum rewards: 65.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.415', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.056', 'AMMO4': '0.095', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.478', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '54.000'} [2024-08-06 02:32:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 317915136. Throughput: 0: 4381.6. Samples: 79476830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:32:02,794][52567] Avg episode reward: [(0, '67.675')] [2024-08-06 02:32:03,706][52649] DAMAGECOUNT value on done: 308249.0 [2024-08-06 02:32:03,708][52649] Sum rewards: 64.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '55.000'} [2024-08-06 02:32:04,039][52668] DAMAGECOUNT value on done: 314028.0 [2024-08-06 02:32:04,040][52668] Sum rewards: 65.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.023', 'AMMO2': '0.059', 'AMMO3': '0.193', 'weapon5': '0.228', 'weapon2': '0.268', 'AMMO4': '0.295', 'weapon4': '0.440', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '55.500'} [2024-08-06 02:32:04,341][52650] Updated weights for policy 0, policy_version 38811 (0.0016) [2024-08-06 02:32:04,489][52658] DAMAGECOUNT value on done: 316341.0 [2024-08-06 02:32:04,489][52658] Sum rewards: 72.156, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.254', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.110', 'weapon5': '0.160', 'AMMO4': '0.210', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '63.000'} [2024-08-06 02:32:04,786][52820] DAMAGECOUNT value on done: 287289.0 [2024-08-06 02:32:04,788][52820] Sum rewards: 71.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.217', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '3.114', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:04,832][52669] DAMAGECOUNT value on done: 311212.0 [2024-08-06 02:32:04,834][52669] Sum rewards: 68.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.711', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.068', 'AMMO3': '0.169', 'weapon5': '0.214', 'AMMO4': '0.264', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '55.000'} [2024-08-06 02:32:05,006][52794] DAMAGECOUNT value on done: 319510.0 [2024-08-06 02:32:05,006][52794] Sum rewards: 65.567, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.507', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.208', 'weapon5': '0.226', 'AMMO3': '0.268', 'AMMO4': '0.315', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.686', 'WEAPON3': '1.500', 'weapon3': '2.562', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:05,356][52660] DAMAGECOUNT value on done: 307130.0 [2024-08-06 02:32:05,356][52660] Sum rewards: 55.065, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.946', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.150', 'weapon4': '0.216', 'AMMO4': '0.224', 'weapon2': '0.322', 'AMMO3': '0.323', 'WEAPON4': '0.450', 'WEAPON3': '1.900', 'weapon3': '3.058', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '51.000'} [2024-08-06 02:32:05,448][52671] DAMAGECOUNT value on done: 313981.0 [2024-08-06 02:32:05,448][52671] Sum rewards: 66.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.180', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.356', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.720', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:06,517][52668] DAMAGECOUNT value on done: 308925.0 [2024-08-06 02:32:06,518][52668] Sum rewards: 73.247, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon2': '0.178', 'AMMO3': '0.187', 'weapon4': '0.216', 'WEAPON4': '0.250', 'HEALTH': '0.434', 'WEAPON3': '1.050', 'weapon3': '3.276', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '60.000'} [2024-08-06 02:32:07,270][52658] DAMAGECOUNT value on done: 305954.0 [2024-08-06 02:32:07,272][52658] Sum rewards: 62.672, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '54.000'} [2024-08-06 02:32:07,791][52660] DAMAGECOUNT value on done: 316517.0 [2024-08-06 02:32:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 317997056. Throughput: 0: 4396.7. Samples: 79503760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:32:07,801][52567] Avg episode reward: [(0, '67.416')] [2024-08-06 02:32:07,801][52660] Sum rewards: 71.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.184', 'AMMO3': '0.203', 'weapon4': '0.218', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:07,949][52820] DAMAGECOUNT value on done: 290182.0 [2024-08-06 02:32:07,951][52820] Sum rewards: 74.995, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.365', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.158', 'AMMO3': '0.166', 'weapon2': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.862', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:08,068][52669] DAMAGECOUNT value on done: 314016.0 [2024-08-06 02:32:08,070][52669] Sum rewards: 60.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.392', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.398', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '51.500'} [2024-08-06 02:32:08,181][52794] DAMAGECOUNT value on done: 316070.0 [2024-08-06 02:32:08,181][52794] Sum rewards: 53.003, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.114', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.066', 'AMMO4': '0.130', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.194', 'DAMAGECOUNT': '13.236', 'FRAGCOUNT': '44.000'} [2024-08-06 02:32:08,530][52671] DAMAGECOUNT value on done: 314808.0 [2024-08-06 02:32:08,530][52671] Sum rewards: 56.583, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.242', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon4': '0.146', 'weapon5': '0.178', 'AMMO4': '0.288', 'AMMO3': '0.305', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.850', 'weapon3': '2.832', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '51.000'} [2024-08-06 02:32:08,771][52650] Updated weights for policy 0, policy_version 38821 (0.0028) [2024-08-06 02:32:10,004][52658] DAMAGECOUNT value on done: 320876.0 [2024-08-06 02:32:10,006][52658] Sum rewards: 72.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO4': '0.000', 'AMMO2': '0.000', 'weapon2': '0.208', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'HITCOUNT': '3.410', 'weapon3': '3.640', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:10,757][52669] DAMAGECOUNT value on done: 316973.0 [2024-08-06 02:32:10,758][52669] Sum rewards: 72.988, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'weapon7': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.128', 'weapon4': '0.144', 'WEAPON4': '0.150', 'HEALTH': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 02:32:10,956][52820] DAMAGECOUNT value on done: 289668.0 [2024-08-06 02:32:10,957][52820] Sum rewards: 56.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.074', 'AMMO5': '0.029', 'AMMO2': '0.082', 'AMMO3': '0.169', 'weapon4': '0.270', 'weapon5': '0.328', 'AMMO4': '0.412', 'weapon2': '0.414', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.658', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '48.000'} [2024-08-06 02:32:10,962][52660] DAMAGECOUNT value on done: 320235.0 [2024-08-06 02:32:10,963][52660] Sum rewards: 64.224, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.975', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.162', 'weapon2': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.452', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '52.000'} [2024-08-06 02:32:11,133][52794] DAMAGECOUNT value on done: 311517.0 [2024-08-06 02:32:11,134][52794] Sum rewards: 66.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.380', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.116', 'weapon5': '0.180', 'AMMO3': '0.209', 'AMMO4': '0.265', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '56.000'} [2024-08-06 02:32:11,192][52671] DAMAGECOUNT value on done: 313287.0 [2024-08-06 02:32:11,194][52671] Sum rewards: 73.931, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.590', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.187', 'weapon2': '0.220', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.284', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '68.000'} [2024-08-06 02:32:12,320][52658] DAMAGECOUNT value on done: 314403.0 [2024-08-06 02:32:12,322][52658] Sum rewards: 53.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'weapon5': '0.308', 'weapon2': '0.328', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.098', 'DAMAGECOUNT': '13.464', 'FRAGCOUNT': '46.000'} [2024-08-06 02:32:12,399][52662] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:32:12,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 318087168. Throughput: 0: 4392.9. Samples: 79529920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:32:12,795][52567] Avg episode reward: [(0, '67.005')] [2024-08-06 02:32:13,563][52650] Updated weights for policy 0, policy_version 38831 (0.0028) [2024-08-06 02:32:13,761][52669] DAMAGECOUNT value on done: 327668.0 [2024-08-06 02:32:13,762][52669] Sum rewards: 71.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.416', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.176', 'weapon2': '0.202', 'AMMO4': '0.226', 'weapon4': '0.260', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:13,993][52660] DAMAGECOUNT value on done: 307877.0 [2024-08-06 02:32:13,994][52660] Sum rewards: 55.176, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.746', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.188', 'AMMO4': '0.232', 'weapon2': '0.298', 'AMMO3': '0.301', 'weapon4': '0.474', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.648', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '52.000'} [2024-08-06 02:32:14,009][52820] DAMAGECOUNT value on done: 290647.0 [2024-08-06 02:32:14,010][52820] Sum rewards: 53.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.452', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.082', 'AMMO3': '0.217', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON4': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.834', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '45.000'} [2024-08-06 02:32:14,090][52794] DAMAGECOUNT value on done: 316006.0 [2024-08-06 02:32:14,093][52794] Sum rewards: 64.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.876', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.148', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'weapon2': '0.314', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.862', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:14,338][52671] DAMAGECOUNT value on done: 321105.0 [2024-08-06 02:32:14,339][52671] Sum rewards: 60.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.187', 'AMMO4': '0.188', 'weapon5': '0.196', 'weapon2': '0.276', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '51.000'} [2024-08-06 02:32:15,147][52658] DAMAGECOUNT value on done: 322330.0 [2024-08-06 02:32:15,147][52658] Sum rewards: 72.531, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.549', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.144', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'weapon4': '0.236', 'WEAPON3': '1.050', 'weapon3': '3.164', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:16,420][52660] DAMAGECOUNT value on done: 310283.0 [2024-08-06 02:32:16,422][52660] Sum rewards: 64.648, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.990', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.150', 'weapon5': '0.222', 'AMMO3': '0.280', 'AMMO4': '0.301', 'weapon2': '0.382', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.912', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:16,706][52794] DAMAGECOUNT value on done: 306364.0 [2024-08-06 02:32:16,707][52794] Sum rewards: 63.651, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.564', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO4': '0.141', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.948', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '51.000'} [2024-08-06 02:32:17,001][52669] DAMAGECOUNT value on done: 314607.0 [2024-08-06 02:32:17,005][52669] Sum rewards: 65.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.189', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.146', 'weapon4': '0.152', 'AMMO3': '0.180', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.268', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '53.000'} [2024-08-06 02:32:17,062][52671] DAMAGECOUNT value on done: 311977.0 [2024-08-06 02:32:17,063][52671] Sum rewards: 65.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO4': '0.160', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.196', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '53.000'} [2024-08-06 02:32:17,073][52820] DAMAGECOUNT value on done: 291177.0 [2024-08-06 02:32:17,073][52820] Sum rewards: 65.325, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.226', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.152', 'AMMO4': '0.235', 'AMMO3': '0.264', 'weapon2': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.952', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '59.000'} [2024-08-06 02:32:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 318177280. Throughput: 0: 4392.7. Samples: 79543210. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:32:17,802][52567] Avg episode reward: [(0, '66.665')] [2024-08-06 02:32:18,336][52658] DAMAGECOUNT value on done: 305985.0 [2024-08-06 02:32:18,341][52658] Sum rewards: 70.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.662', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.094', 'AMMO4': '0.149', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.206', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:18,386][52650] Updated weights for policy 0, policy_version 38841 (0.0026) [2024-08-06 02:32:19,055][52660] DAMAGECOUNT value on done: 304315.0 [2024-08-06 02:32:19,057][52660] Sum rewards: 73.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'weapon5': '0.026', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.178', 'AMMO3': '0.186', 'AMMO4': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.972', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '59.000'} [2024-08-06 02:32:19,494][52671] DAMAGECOUNT value on done: 316252.0 [2024-08-06 02:32:19,495][52671] Sum rewards: 71.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.252', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.157', 'weapon5': '0.228', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'weapon4': '0.366', 'WEAPON4': '0.400', 'weapon2': '0.536', 'WEAPON3': '0.950', 'weapon3': '2.546', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:19,652][52794] DAMAGECOUNT value on done: 320730.0 [2024-08-06 02:32:19,655][52794] Sum rewards: 74.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.271', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.244', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.392', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '63.000'} [2024-08-06 02:32:19,955][52669] DAMAGECOUNT value on done: 317261.0 [2024-08-06 02:32:19,956][52669] Sum rewards: 60.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.143', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.040', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.364', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.292', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '54.000'} [2024-08-06 02:32:20,184][52820] DAMAGECOUNT value on done: 291004.0 [2024-08-06 02:32:20,186][52820] Sum rewards: 68.252, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.788', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.352', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:21,251][52658] DAMAGECOUNT value on done: 314820.0 [2024-08-06 02:32:21,253][52658] Sum rewards: 73.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.446', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.208', 'weapon2': '0.232', 'AMMO4': '0.263', 'weapon5': '0.278', 'WEAPON5': '0.450', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.646', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:21,745][52614] Signal inference workers to stop experience collection... (7000 times) [2024-08-06 02:32:21,746][52614] Signal inference workers to resume experience collection... (7000 times) [2024-08-06 02:32:21,825][52650] InferenceWorker_p0-w0: stopping experience collection (7000 times) [2024-08-06 02:32:21,834][52650] InferenceWorker_p0-w0: resuming experience collection (7000 times) [2024-08-06 02:32:22,132][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:32:22,146][52660] DAMAGECOUNT value on done: 314574.0 [2024-08-06 02:32:22,146][52660] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.859', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.203', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.368', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '59.000'} [2024-08-06 02:32:22,213][52671] DAMAGECOUNT value on done: 315878.0 [2024-08-06 02:32:22,214][52671] Sum rewards: 69.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.042', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.126', 'weapon5': '0.182', 'weapon2': '0.228', 'AMMO3': '0.233', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.198', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '60.000'} [2024-08-06 02:32:22,579][52669] DAMAGECOUNT value on done: 315011.0 [2024-08-06 02:32:22,580][52669] Sum rewards: 76.223, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.415', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.154', 'weapon5': '0.178', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.950', 'weapon3': '2.884', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:22,656][52794] DAMAGECOUNT value on done: 309338.0 [2024-08-06 02:32:22,657][52794] Sum rewards: 59.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.200', 'AMMO5': '0.021', 'AMMO2': '0.069', 'AMMO3': '0.184', 'weapon4': '0.280', 'weapon2': '0.314', 'weapon5': '0.338', 'AMMO4': '0.346', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '2.720', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '49.000'} [2024-08-06 02:32:22,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 318259200. Throughput: 0: 4403.1. Samples: 79569620. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:32:22,794][52567] Avg episode reward: [(0, '66.991')] [2024-08-06 02:32:22,888][52650] Updated weights for policy 0, policy_version 38851 (0.0034) [2024-08-06 02:32:23,356][52820] DAMAGECOUNT value on done: 292774.0 [2024-08-06 02:32:23,357][52820] Sum rewards: 63.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.498', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.169', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2024-08-06 02:32:24,117][52658] DAMAGECOUNT value on done: 312534.0 [2024-08-06 02:32:24,119][52658] Sum rewards: 70.997, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.634', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon2': '0.194', 'weapon5': '0.222', 'AMMO3': '0.291', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.900', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:25,142][52671] DAMAGECOUNT value on done: 309364.0 [2024-08-06 02:32:25,143][52671] Sum rewards: 77.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.240', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '63.000'} [2024-08-06 02:32:25,168][52660] DAMAGECOUNT value on done: 308287.0 [2024-08-06 02:32:25,169][52660] Sum rewards: 71.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.128', 'weapon5': '0.182', 'AMMO3': '0.193', 'AMMO4': '0.199', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:25,720][52794] DAMAGECOUNT value on done: 322945.0 [2024-08-06 02:32:25,723][52794] Sum rewards: 80.214, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.365', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.148', 'AMMO3': '0.173', 'AMMO4': '0.218', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.834', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '65.000'} [2024-08-06 02:32:25,783][52669] DAMAGECOUNT value on done: 318507.0 [2024-08-06 02:32:25,785][52669] Sum rewards: 68.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.291', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.256', 'weapon4': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:26,537][52820] DAMAGECOUNT value on done: 290244.0 [2024-08-06 02:32:26,537][52820] Sum rewards: 58.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.216', 'weapon4': '0.264', 'weapon5': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.796', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '49.000'} [2024-08-06 02:32:27,312][52658] DAMAGECOUNT value on done: 309594.0 [2024-08-06 02:32:27,314][52658] Sum rewards: 79.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.140', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.210', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '65.000'} [2024-08-06 02:32:27,536][52650] Updated weights for policy 0, policy_version 38861 (0.0019) [2024-08-06 02:32:27,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.1, 300 sec: 17550.3). Total num frames: 318349312. Throughput: 0: 4405.7. Samples: 79596000. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:32:27,795][52567] Avg episode reward: [(0, '67.241')] [2024-08-06 02:32:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038861_318349312.pth... [2024-08-06 02:32:27,926][52671] DAMAGECOUNT value on done: 316991.0 [2024-08-06 02:32:27,928][52671] Sum rewards: 66.274, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.287', 'AMMO5': '0.004', 'AMMO2': '0.038', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'AMMO4': '0.190', 'weapon2': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '53.000'} [2024-08-06 02:32:27,978][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038347_314138624.pth [2024-08-06 02:32:28,606][52794] DAMAGECOUNT value on done: 313867.0 [2024-08-06 02:32:28,606][52794] Sum rewards: 53.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.098', 'AMMO4': '0.139', 'weapon5': '0.154', 'weapon2': '0.196', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '3.308', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '47.000'} [2024-08-06 02:32:29,689][52820] DAMAGECOUNT value on done: 285719.0 [2024-08-06 02:32:29,690][52820] Sum rewards: 79.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.535', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.145', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.700', 'weapon3': '3.252', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '69.000'} [2024-08-06 02:32:30,024][52658] DAMAGECOUNT value on done: 306375.0 [2024-08-06 02:32:30,025][52658] Sum rewards: 65.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '53.000'} [2024-08-06 02:32:31,186][52671] DAMAGECOUNT value on done: 319469.0 [2024-08-06 02:32:31,187][52671] Sum rewards: 72.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.949', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon5': '0.152', 'AMMO3': '0.160', 'AMMO4': '0.256', 'weapon4': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.586', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:31,817][52794] DAMAGECOUNT value on done: 315387.0 [2024-08-06 02:32:31,817][52794] Sum rewards: 70.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.379', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.224', 'weapon2': '0.228', 'AMMO3': '0.231', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '60.000'} [2024-08-06 02:32:32,486][52650] Updated weights for policy 0, policy_version 38871 (0.0029) [2024-08-06 02:32:32,783][52820] DAMAGECOUNT value on done: 296907.0 [2024-08-06 02:32:32,785][52820] Sum rewards: 75.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '64.000'} [2024-08-06 02:32:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 318439424. Throughput: 0: 4395.6. Samples: 79608740. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:32:32,794][52567] Avg episode reward: [(0, '67.376')] [2024-08-06 02:32:33,154][52658] DAMAGECOUNT value on done: 318927.0 [2024-08-06 02:32:33,154][52658] Sum rewards: 73.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.288', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '60.000'} [2024-08-06 02:32:34,089][52671] DAMAGECOUNT value on done: 313838.0 [2024-08-06 02:32:34,089][52671] Sum rewards: 82.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.400', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '69.000'} [2024-08-06 02:32:34,870][52794] DAMAGECOUNT value on done: 323982.0 [2024-08-06 02:32:34,872][52794] Sum rewards: 69.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.521', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.500'} [2024-08-06 02:32:35,672][52658] DAMAGECOUNT value on done: 310342.0 [2024-08-06 02:32:35,673][52658] Sum rewards: 75.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.169', 'AMMO3': '0.175', 'weapon4': '0.304', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:35,841][52820] DAMAGECOUNT value on done: 299255.0 [2024-08-06 02:32:35,843][52820] Sum rewards: 64.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.120', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '55.000'} [2024-08-06 02:32:35,884][52666] DAMAGECOUNT value on done: 315604.0 [2024-08-06 02:32:35,885][52666] Sum rewards: 57.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO4': '0.207', 'weapon2': '0.218', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '2.908', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '50.000'} [2024-08-06 02:32:36,402][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:32:36,798][52650] Updated weights for policy 0, policy_version 38881 (0.0011) [2024-08-06 02:32:37,126][52671] DAMAGECOUNT value on done: 323830.0 [2024-08-06 02:32:37,128][52671] Sum rewards: 73.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.167', 'weapon4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:37,784][52794] DAMAGECOUNT value on done: 314138.0 [2024-08-06 02:32:37,785][52794] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.459', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon4': '0.170', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '3.146', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:37,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 318521344. Throughput: 0: 4399.8. Samples: 79635310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:32:37,794][52567] Avg episode reward: [(0, '67.714')] [2024-08-06 02:32:38,489][52658] DAMAGECOUNT value on done: 314670.0 [2024-08-06 02:32:38,489][52658] Sum rewards: 73.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.070', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.224', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:39,063][52666] DAMAGECOUNT value on done: 317259.0 [2024-08-06 02:32:39,065][52666] Sum rewards: 63.812, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.176', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.101', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.314', 'weapon2': '0.332', 'WEAPON3': '1.950', 'weapon3': '3.156', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:39,208][52820] DAMAGECOUNT value on done: 287743.0 [2024-08-06 02:32:39,211][52820] Sum rewards: 63.404, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.450', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.070', 'weapon4': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'WEAPON4': '0.300', 'AMMO3': '0.326', 'weapon2': '0.452', 'WEAPON3': '1.850', 'weapon3': '3.060', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '59.000'} [2024-08-06 02:32:39,790][52671] DAMAGECOUNT value on done: 311657.0 [2024-08-06 02:32:39,790][52671] Sum rewards: 54.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.942', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.072', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.278', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '45.500'} [2024-08-06 02:32:40,975][52658] DAMAGECOUNT value on done: 318018.0 [2024-08-06 02:32:40,976][52658] Sum rewards: 73.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.106', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.140', 'weapon4': '0.152', 'AMMO4': '0.171', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:41,586][52650] Updated weights for policy 0, policy_version 38891 (0.0023) [2024-08-06 02:32:42,092][52666] DAMAGECOUNT value on done: 317690.0 [2024-08-06 02:32:42,093][52666] Sum rewards: 68.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.209', 'weapon2': '0.700', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:42,700][52671] DAMAGECOUNT value on done: 305387.0 [2024-08-06 02:32:42,700][52671] Sum rewards: 74.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.562', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.224', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '3.510', 'weapon3': '3.514', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 318611456. Throughput: 0: 4400.0. Samples: 79661690. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:32:42,794][52567] Avg episode reward: [(0, '68.024')] [2024-08-06 02:32:43,400][52670] DAMAGECOUNT value on done: 310059.0 [2024-08-06 02:32:43,404][52670] Sum rewards: 73.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.698', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.080', 'AMMO3': '0.242', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '62.000'} [2024-08-06 02:32:43,976][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:32:45,135][52666] DAMAGECOUNT value on done: 312774.0 [2024-08-06 02:32:45,137][52666] Sum rewards: 61.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.113', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.000'} [2024-08-06 02:32:45,637][52671] DAMAGECOUNT value on done: 318582.0 [2024-08-06 02:32:45,639][52671] Sum rewards: 76.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.248', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.264', 'weapon2': '0.362', 'WEAPON3': '1.650', 'weapon3': '3.292', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '67.000'} [2024-08-06 02:32:46,194][52650] Updated weights for policy 0, policy_version 38901 (0.0034) [2024-08-06 02:32:46,377][52670] DAMAGECOUNT value on done: 313546.0 [2024-08-06 02:32:46,379][52670] Sum rewards: 72.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.082', 'AMMO4': '0.175', 'AMMO3': '0.198', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '60.000'} [2024-08-06 02:32:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 318701568. Throughput: 0: 4398.9. Samples: 79674780. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:32:47,795][52567] Avg episode reward: [(0, '68.127')] [2024-08-06 02:32:48,206][52666] DAMAGECOUNT value on done: 309388.0 [2024-08-06 02:32:48,206][52666] Sum rewards: 75.582, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.244', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.474', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '66.000'} [2024-08-06 02:32:48,617][52671] DAMAGECOUNT value on done: 319501.0 [2024-08-06 02:32:48,619][52671] Sum rewards: 72.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.856', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon5': '0.036', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:49,400][52670] DAMAGECOUNT value on done: 307960.0 [2024-08-06 02:32:49,408][52670] Sum rewards: 73.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.424', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.185', 'weapon4': '0.186', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.276', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '62.000'} [2024-08-06 02:32:50,890][52650] Updated weights for policy 0, policy_version 38911 (0.0027) [2024-08-06 02:32:51,008][52659] DAMAGECOUNT value on done: 315943.0 [2024-08-06 02:32:51,009][52659] Sum rewards: 67.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.705', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.182', 'AMMO4': '0.190', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '54.500'} [2024-08-06 02:32:51,142][52666] DAMAGECOUNT value on done: 304690.0 [2024-08-06 02:32:51,144][52666] Sum rewards: 50.757, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.815', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.178', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.276', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '45.000'} [2024-08-06 02:32:51,282][52671] DAMAGECOUNT value on done: 321290.0 [2024-08-06 02:32:51,283][52671] Sum rewards: 72.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO2': '0.014', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.270', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '60.000'} [2024-08-06 02:32:51,332][52664] DAMAGECOUNT value on done: 325268.0 [2024-08-06 02:32:51,332][52664] Sum rewards: 60.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.460', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.148', 'AMMO3': '0.196', 'AMMO4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.572', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '51.000'} [2024-08-06 02:32:52,288][52670] DAMAGECOUNT value on done: 305951.0 [2024-08-06 02:32:52,288][52670] Sum rewards: 68.274, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.242', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.197', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 02:32:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 318791680. Throughput: 0: 4391.4. Samples: 79701370. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:32:52,794][52567] Avg episode reward: [(0, '67.825')] [2024-08-06 02:32:53,942][52664] DAMAGECOUNT value on done: 325493.0 [2024-08-06 02:32:53,942][52664] Sum rewards: 64.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.839', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.112', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.282', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.294', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '56.000'} [2024-08-06 02:32:53,965][52666] DAMAGECOUNT value on done: 313682.0 [2024-08-06 02:32:53,965][52666] Sum rewards: 86.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.353', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'weapon2': '0.216', 'AMMO3': '0.224', 'WEAPON3': '1.300', 'weapon3': '3.380', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '71.000'} [2024-08-06 02:32:53,987][52659] DAMAGECOUNT value on done: 313617.0 [2024-08-06 02:32:53,988][52659] Sum rewards: 74.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.846', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.051', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.207', 'WEAPON3': '1.350', 'weapon3': '3.516', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '61.000'} [2024-08-06 02:32:54,214][52671] DAMAGECOUNT value on done: 313288.0 [2024-08-06 02:32:54,214][52671] Sum rewards: 70.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.029', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '59.000'} [2024-08-06 02:32:55,165][52670] DAMAGECOUNT value on done: 317016.0 [2024-08-06 02:32:55,166][52670] Sum rewards: 73.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.182', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '62.000'} [2024-08-06 02:32:55,580][52650] Updated weights for policy 0, policy_version 38921 (0.0024) [2024-08-06 02:32:56,649][52664] DAMAGECOUNT value on done: 327717.0 [2024-08-06 02:32:56,649][52664] Sum rewards: 72.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon5': '0.116', 'AMMO4': '0.117', 'AMMO3': '0.194', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '57.500'} [2024-08-06 02:32:56,727][52666] DAMAGECOUNT value on done: 310736.0 [2024-08-06 02:32:56,730][52666] Sum rewards: 78.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.076', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.440', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '64.000'} [2024-08-06 02:32:56,892][52659] DAMAGECOUNT value on done: 314501.0 [2024-08-06 02:32:56,893][52659] Sum rewards: 81.368, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.123', 'weapon5': '0.130', 'weapon2': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.334', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '71.000'} [2024-08-06 02:32:57,009][52671] DAMAGECOUNT value on done: 312084.0 [2024-08-06 02:32:57,010][52671] Sum rewards: 66.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.147', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.726', 'WEAPON3': '1.000', 'weapon3': '2.760', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '54.000'} [2024-08-06 02:32:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 318873600. Throughput: 0: 4388.4. Samples: 79727400. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:32:57,795][52567] Avg episode reward: [(0, '68.275')] [2024-08-06 02:32:58,014][52670] DAMAGECOUNT value on done: 311483.0 [2024-08-06 02:32:58,015][52670] Sum rewards: 66.327, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.942', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.234', 'weapon5': '0.286', 'weapon4': '0.306', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.760', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '58.000'} [2024-08-06 02:32:59,260][52664] DAMAGECOUNT value on done: 323814.0 [2024-08-06 02:32:59,261][52664] Sum rewards: 61.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.624', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.198', 'weapon5': '0.298', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.444', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '51.000'} [2024-08-06 02:32:59,483][52659] DAMAGECOUNT value on done: 314150.0 [2024-08-06 02:32:59,485][52659] Sum rewards: 68.670, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.215', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon4': '0.248', 'weapon2': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '54.000'} [2024-08-06 02:32:59,788][52666] DAMAGECOUNT value on done: 308040.0 [2024-08-06 02:32:59,788][52666] Sum rewards: 46.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.263', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.180', 'AMMO4': '0.194', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.200', 'HITCOUNT': '2.340', 'weapon3': '2.888', 'DAMAGECOUNT': '11.511', 'FRAGCOUNT': '41.000'} [2024-08-06 02:33:00,011][52650] Updated weights for policy 0, policy_version 38931 (0.0011) [2024-08-06 02:33:01,219][52670] DAMAGECOUNT value on done: 306684.0 [2024-08-06 02:33:01,220][52670] Sum rewards: 72.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.696', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.061', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.275', 'weapon2': '0.396', 'WEAPON3': '1.750', 'weapon3': '3.214', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '65.000'} [2024-08-06 02:33:01,883][52659] DAMAGECOUNT value on done: 308833.0 [2024-08-06 02:33:01,884][52659] Sum rewards: 74.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.183', 'weapon5': '0.196', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.930', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '60.000'} [2024-08-06 02:33:02,387][52664] DAMAGECOUNT value on done: 324334.0 [2024-08-06 02:33:02,388][52664] Sum rewards: 65.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.128', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon5': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '58.000'} [2024-08-06 02:33:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 318971904. Throughput: 0: 4384.7. Samples: 79740520. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:33:02,794][52567] Avg episode reward: [(0, '68.281')] [2024-08-06 02:33:02,961][52666] DAMAGECOUNT value on done: 309012.0 [2024-08-06 02:33:02,962][52666] Sum rewards: 83.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.529', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '67.000'} [2024-08-06 02:33:03,800][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:33:04,233][52670] DAMAGECOUNT value on done: 308901.0 [2024-08-06 02:33:04,234][52670] Sum rewards: 63.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.044', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.522', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.148', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '56.000'} [2024-08-06 02:33:04,751][52659] DAMAGECOUNT value on done: 312199.0 [2024-08-06 02:33:04,752][52659] Sum rewards: 65.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.156', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.158', 'AMMO4': '0.190', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 02:33:04,970][52664] DAMAGECOUNT value on done: 325580.0 [2024-08-06 02:33:04,970][52664] Sum rewards: 62.335, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon2': '0.202', 'AMMO4': '0.211', 'AMMO3': '0.232', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '55.000'} [2024-08-06 02:33:05,084][52650] Updated weights for policy 0, policy_version 38941 (0.0025) [2024-08-06 02:33:06,239][52666] DAMAGECOUNT value on done: 307273.0 [2024-08-06 02:33:06,239][52666] Sum rewards: 69.546, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.620', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.199', 'weapon5': '0.200', 'AMMO4': '0.228', 'weapon4': '0.228', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '60.000'} [2024-08-06 02:33:07,270][52670] DAMAGECOUNT value on done: 309008.0 [2024-08-06 02:33:07,271][52670] Sum rewards: 64.586, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.630', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.170', 'weapon5': '0.242', 'AMMO4': '0.246', 'AMMO3': '0.289', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.998', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '57.000'} [2024-08-06 02:33:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 319045632. Throughput: 0: 4378.2. Samples: 79766640. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:33:07,795][52659] DAMAGECOUNT value on done: 315321.0 [2024-08-06 02:33:07,795][52567] Avg episode reward: [(0, '68.364')] [2024-08-06 02:33:07,797][52659] Sum rewards: 67.211, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.377', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.016', 'weapon4': '0.038', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.220', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'HITCOUNT': '3.440', 'weapon3': '3.522', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.500'} [2024-08-06 02:33:08,057][52664] DAMAGECOUNT value on done: 327700.0 [2024-08-06 02:33:08,058][52664] Sum rewards: 59.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon4': '0.254', 'weapon2': '0.882', 'WEAPON3': '1.050', 'weapon3': '2.552', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '50.000'} [2024-08-06 02:33:09,091][52666] DAMAGECOUNT value on done: 305113.0 [2024-08-06 02:33:09,091][52666] Sum rewards: 61.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.054', 'weapon4': '0.068', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.430', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.226', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '51.000'} [2024-08-06 02:33:09,634][52650] Updated weights for policy 0, policy_version 38951 (0.0023) [2024-08-06 02:33:10,322][52670] DAMAGECOUNT value on done: 302860.0 [2024-08-06 02:33:10,330][52670] Sum rewards: 71.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.228', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.476', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '59.000'} [2024-08-06 02:33:10,462][52659] DAMAGECOUNT value on done: 310828.0 [2024-08-06 02:33:10,462][52659] Sum rewards: 72.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.424', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.134', 'weapon5': '0.162', 'AMMO4': '0.184', 'weapon2': '0.186', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.286', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '62.000'} [2024-08-06 02:33:10,984][52664] DAMAGECOUNT value on done: 318984.0 [2024-08-06 02:33:10,985][52664] Sum rewards: 74.436, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.228', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '64.000'} [2024-08-06 02:33:11,060][52662] Large shaping reward 2.570 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.519, 173.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:33:12,006][52666] DAMAGECOUNT value on done: 315543.0 [2024-08-06 02:33:12,006][52666] Sum rewards: 58.990, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.730', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.168', 'weapon4': '0.188', 'AMMO4': '0.251', 'AMMO3': '0.303', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.892', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '56.000'} [2024-08-06 02:33:12,152][52663] DAMAGECOUNT value on done: 319102.0 [2024-08-06 02:33:12,153][52663] Sum rewards: 68.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.844', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.132', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 02:33:12,535][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:33:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 319135744. Throughput: 0: 4378.5. Samples: 79793030. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:33:12,794][52567] Avg episode reward: [(0, '68.448')] [2024-08-06 02:33:13,095][52670] DAMAGECOUNT value on done: 317296.0 [2024-08-06 02:33:13,098][52670] Sum rewards: 59.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.165', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.176', 'AMMO3': '0.180', 'AMMO4': '0.188', 'weapon5': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.970', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '49.000'} [2024-08-06 02:33:13,307][52659] DAMAGECOUNT value on done: 321247.0 [2024-08-06 02:33:13,307][52659] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.444', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.117', 'weapon5': '0.140', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.178', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '57.000'} [2024-08-06 02:33:13,937][52664] DAMAGECOUNT value on done: 332055.0 [2024-08-06 02:33:13,937][52664] Sum rewards: 72.768, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO3': '0.151', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '58.000'} [2024-08-06 02:33:14,071][52650] Updated weights for policy 0, policy_version 38961 (0.0020) [2024-08-06 02:33:14,786][52666] DAMAGECOUNT value on done: 315405.0 [2024-08-06 02:33:14,788][52666] Sum rewards: 68.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.457', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.130', 'AMMO4': '0.170', 'weapon5': '0.180', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.550', 'weapon3': '3.050', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 02:33:14,954][52663] DAMAGECOUNT value on done: 311082.0 [2024-08-06 02:33:14,956][52663] Sum rewards: 56.537, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.045', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.249', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.416', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '50.000'} [2024-08-06 02:33:15,784][52670] DAMAGECOUNT value on done: 311146.0 [2024-08-06 02:33:15,787][52670] Sum rewards: 67.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.233', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.082', 'weapon4': '0.090', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.178', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '57.000'} [2024-08-06 02:33:16,008][52659] DAMAGECOUNT value on done: 319896.0 [2024-08-06 02:33:16,009][52659] Sum rewards: 67.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.080', 'weapon4': '0.148', 'AMMO4': '0.163', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '58.000'} [2024-08-06 02:33:16,533][52664] DAMAGECOUNT value on done: 323725.0 [2024-08-06 02:33:16,537][52664] Sum rewards: 69.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.127', 'weapon5': '0.138', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '55.500'} [2024-08-06 02:33:17,395][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:33:17,694][52666] DAMAGECOUNT value on done: 310480.0 [2024-08-06 02:33:17,695][52666] Sum rewards: 68.419, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.546', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.088', 'weapon4': '0.122', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.238', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 02:33:17,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 319225856. Throughput: 0: 4391.6. Samples: 79806360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:33:17,794][52567] Avg episode reward: [(0, '68.735')] [2024-08-06 02:33:17,863][52614] Saving new best policy, reward=68.735! [2024-08-06 02:33:18,299][52663] DAMAGECOUNT value on done: 312073.0 [2024-08-06 02:33:18,300][52663] Sum rewards: 73.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.485', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon5': '0.104', 'AMMO3': '0.226', 'weapon2': '0.266', 'AMMO4': '0.332', 'WEAPON5': '0.400', 'weapon4': '0.506', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '63.000'} [2024-08-06 02:33:18,510][52659] DAMAGECOUNT value on done: 313340.0 [2024-08-06 02:33:18,510][52659] Sum rewards: 63.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.078', 'AMMO4': '0.178', 'AMMO3': '0.229', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '54.500'} [2024-08-06 02:33:18,918][52670] DAMAGECOUNT value on done: 311723.0 [2024-08-06 02:33:18,919][52670] Sum rewards: 63.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.630', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon2': '0.328', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.422', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '50.000'} [2024-08-06 02:33:18,939][52650] Updated weights for policy 0, policy_version 38971 (0.0026) [2024-08-06 02:33:19,117][52664] DAMAGECOUNT value on done: 328184.0 [2024-08-06 02:33:19,118][52664] Sum rewards: 85.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.230', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '71.000'} [2024-08-06 02:33:20,709][52666] DAMAGECOUNT value on done: 312444.0 [2024-08-06 02:33:20,712][52666] Sum rewards: 71.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.256', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.142', 'AMMO3': '0.182', 'AMMO4': '0.271', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '58.000'} [2024-08-06 02:33:21,126][52659] DAMAGECOUNT value on done: 317240.0 [2024-08-06 02:33:21,127][52659] Sum rewards: 65.798, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.555', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.176', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.306', 'weapon2': '0.334', 'WEAPON3': '1.800', 'weapon3': '2.896', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '57.500'} [2024-08-06 02:33:21,632][52664] DAMAGECOUNT value on done: 325716.0 [2024-08-06 02:33:21,634][52664] Sum rewards: 69.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.287', 'weapon2': '0.312', 'WEAPON3': '1.700', 'weapon3': '3.440', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '62.000'} [2024-08-06 02:33:21,665][52663] DAMAGECOUNT value on done: 314253.0 [2024-08-06 02:33:21,665][52663] Sum rewards: 63.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.972', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.088', 'AMMO3': '0.180', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.418', 'weapon2': '0.706', 'WEAPON3': '1.000', 'weapon3': '2.414', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '52.000'} [2024-08-06 02:33:21,742][52670] DAMAGECOUNT value on done: 315394.0 [2024-08-06 02:33:21,742][52670] Sum rewards: 69.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.096', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '59.000'} [2024-08-06 02:33:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 319315968. Throughput: 0: 4380.2. Samples: 79832420. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:33:22,794][52567] Avg episode reward: [(0, '69.060')] [2024-08-06 02:33:22,795][52614] Saving new best policy, reward=69.060! [2024-08-06 02:33:23,464][52666] DAMAGECOUNT value on done: 309911.0 [2024-08-06 02:33:23,466][52666] Sum rewards: 73.807, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.569', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon2': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.206', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.324', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '63.000'} [2024-08-06 02:33:23,688][52650] Updated weights for policy 0, policy_version 38981 (0.0022) [2024-08-06 02:33:23,919][52659] DAMAGECOUNT value on done: 305987.0 [2024-08-06 02:33:23,919][52659] Sum rewards: 62.538, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'HITCOUNT': '2.980', 'weapon3': '3.528', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '57.000'} [2024-08-06 02:33:24,448][52670] DAMAGECOUNT value on done: 314248.0 [2024-08-06 02:33:24,448][52670] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.166', 'AMMO3': '0.187', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '57.000'} [2024-08-06 02:33:24,727][52664] DAMAGECOUNT value on done: 332516.0 [2024-08-06 02:33:24,727][52664] Sum rewards: 67.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.132', 'AMMO3': '0.188', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '55.000'} [2024-08-06 02:33:24,742][52663] DAMAGECOUNT value on done: 314066.0 [2024-08-06 02:33:24,744][52663] Sum rewards: 69.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.483', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.370', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '55.000'} [2024-08-06 02:33:26,448][52666] DAMAGECOUNT value on done: 312341.0 [2024-08-06 02:33:26,450][52666] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.717', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.068', 'AMMO4': '0.135', 'weapon5': '0.142', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '55.000'} [2024-08-06 02:33:26,548][52659] DAMAGECOUNT value on done: 315846.0 [2024-08-06 02:33:26,549][52659] Sum rewards: 72.928, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.616', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.160', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON3': '1.450', 'weapon3': '3.394', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '63.000'} [2024-08-06 02:33:27,263][52664] DAMAGECOUNT value on done: 325127.0 [2024-08-06 02:33:27,263][52664] Sum rewards: 63.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.423', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.136', 'weapon5': '0.166', 'AMMO3': '0.205', 'AMMO4': '0.221', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.210', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '53.000'} [2024-08-06 02:33:27,604][52670] DAMAGECOUNT value on done: 299205.0 [2024-08-06 02:33:27,606][52670] Sum rewards: 70.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.972', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO4': '0.166', 'weapon2': '0.200', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.296', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '60.000'} [2024-08-06 02:33:27,719][52663] DAMAGECOUNT value on done: 318337.0 [2024-08-06 02:33:27,721][52663] Sum rewards: 53.900, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.566', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.326', 'weapon2': '0.374', 'WEAPON3': '1.900', 'weapon3': '3.362', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '48.000'} [2024-08-06 02:33:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 319397888. Throughput: 0: 4373.8. Samples: 79858510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:33:27,794][52567] Avg episode reward: [(0, '68.782')] [2024-08-06 02:33:28,368][52650] Updated weights for policy 0, policy_version 38991 (0.0019) [2024-08-06 02:33:29,317][52659] DAMAGECOUNT value on done: 321483.0 [2024-08-06 02:33:29,318][52659] Sum rewards: 67.072, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.356', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.234', 'AMMO3': '0.266', 'AMMO4': '0.270', 'weapon2': '0.334', 'WEAPON5': '0.450', 'weapon4': '0.518', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.552', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 02:33:29,456][52666] DAMAGECOUNT value on done: 304279.0 [2024-08-06 02:33:29,457][52666] Sum rewards: 62.702, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.560', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon2': '0.220', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'HITCOUNT': '2.930', 'weapon3': '3.532', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '57.000'} [2024-08-06 02:33:29,900][52664] DAMAGECOUNT value on done: 331931.0 [2024-08-06 02:33:29,901][52664] Sum rewards: 69.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.018', 'AMMO2': '0.067', 'weapon2': '0.210', 'weapon4': '0.210', 'AMMO3': '0.216', 'weapon5': '0.302', 'AMMO4': '0.335', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '60.000'} [2024-08-06 02:33:30,575][52670] DAMAGECOUNT value on done: 312875.0 [2024-08-06 02:33:30,583][52670] Sum rewards: 58.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.024', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.656', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.940', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '48.000'} [2024-08-06 02:33:30,717][52663] DAMAGECOUNT value on done: 313956.0 [2024-08-06 02:33:30,717][52663] Sum rewards: 76.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.771', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.118', 'weapon4': '0.136', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.050', 'weapon3': '3.240', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '61.000'} [2024-08-06 02:33:32,323][52659] DAMAGECOUNT value on done: 323286.0 [2024-08-06 02:33:32,325][52659] Sum rewards: 62.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.915', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2024-08-06 02:33:32,531][52666] DAMAGECOUNT value on done: 313372.0 [2024-08-06 02:33:32,532][52666] Sum rewards: 69.300, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.324', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '61.000'} [2024-08-06 02:33:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 319488000. Throughput: 0: 4375.1. Samples: 79871660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:33:32,794][52567] Avg episode reward: [(0, '68.540')] [2024-08-06 02:33:32,908][52650] Updated weights for policy 0, policy_version 39001 (0.0014) [2024-08-06 02:33:32,980][52664] DAMAGECOUNT value on done: 321506.0 [2024-08-06 02:33:32,981][52664] Sum rewards: 72.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.064', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.086', 'weapon4': '0.092', 'AMMO4': '0.249', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.650', 'weapon3': '3.052', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 02:33:33,131][52663] DAMAGECOUNT value on done: 311604.0 [2024-08-06 02:33:33,132][52663] Sum rewards: 61.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.062', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.190', 'AMMO3': '0.229', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '2.802', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '51.000'} [2024-08-06 02:33:33,784][52670] DAMAGECOUNT value on done: 320458.0 [2024-08-06 02:33:33,785][52670] Sum rewards: 79.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.237', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '67.000'} [2024-08-06 02:33:34,927][52659] DAMAGECOUNT value on done: 317865.0 [2024-08-06 02:33:34,929][52659] Sum rewards: 64.603, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.533', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.097', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '56.000'} [2024-08-06 02:33:35,626][52664] DAMAGECOUNT value on done: 327438.0 [2024-08-06 02:33:35,628][52664] Sum rewards: 70.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.382', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.098', 'AMMO3': '0.176', 'weapon4': '0.186', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '58.000'} [2024-08-06 02:33:35,742][52663] DAMAGECOUNT value on done: 312345.0 [2024-08-06 02:33:35,744][52663] Sum rewards: 72.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.122', 'AMMO3': '0.209', 'AMMO4': '0.226', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '61.000'} [2024-08-06 02:33:36,879][52670] DAMAGECOUNT value on done: 311721.0 [2024-08-06 02:33:36,883][52670] Sum rewards: 67.627, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.167', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '0.900', 'HITCOUNT': '2.950', 'weapon3': '3.040', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '53.000'} [2024-08-06 02:33:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 319569920. Throughput: 0: 4374.4. Samples: 79898220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:33:37,794][52567] Avg episode reward: [(0, '68.542')] [2024-08-06 02:33:37,989][52650] Updated weights for policy 0, policy_version 39011 (0.0024) [2024-08-06 02:33:38,027][52664] DAMAGECOUNT value on done: 327092.0 [2024-08-06 02:33:38,027][52664] Sum rewards: 72.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '60.000'} [2024-08-06 02:33:38,079][52659] DAMAGECOUNT value on done: 313667.0 [2024-08-06 02:33:38,080][52659] Sum rewards: 64.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon5': '0.116', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.356', 'weapon4': '0.398', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '54.000'} [2024-08-06 02:33:38,364][52663] DAMAGECOUNT value on done: 315176.0 [2024-08-06 02:33:38,365][52663] Sum rewards: 56.651, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.436', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.110', 'AMMO4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '2.820', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '52.000'} [2024-08-06 02:33:39,902][52670] DAMAGECOUNT value on done: 312699.0 [2024-08-06 02:33:39,903][52670] Sum rewards: 67.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.341', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.214', 'weapon2': '0.242', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '55.000'} [2024-08-06 02:33:40,685][52664] DAMAGECOUNT value on done: 327725.0 [2024-08-06 02:33:40,685][52664] Sum rewards: 62.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.175', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.082', 'weapon5': '0.158', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '53.000'} [2024-08-06 02:33:40,899][52663] DAMAGECOUNT value on done: 316620.0 [2024-08-06 02:33:40,899][52663] Sum rewards: 71.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.502', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.124', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.000'} [2024-08-06 02:33:40,915][52659] DAMAGECOUNT value on done: 317527.0 [2024-08-06 02:33:40,917][52659] Sum rewards: 70.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.127', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '59.500'} [2024-08-06 02:33:42,019][52650] Updated weights for policy 0, policy_version 39021 (0.0016) [2024-08-06 02:33:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 319668224. Throughput: 0: 4379.4. Samples: 79924470. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:33:42,794][52567] Avg episode reward: [(0, '68.199')] [2024-08-06 02:33:43,585][52663] DAMAGECOUNT value on done: 312937.0 [2024-08-06 02:33:43,587][52663] Sum rewards: 66.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.130', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.122', 'AMMO4': '0.149', 'weapon2': '0.172', 'weapon4': '0.178', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.330', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.500'} [2024-08-06 02:33:43,776][52664] DAMAGECOUNT value on done: 327442.0 [2024-08-06 02:33:43,778][52664] Sum rewards: 87.155, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.095', 'AMMO2': '0.013', 'AMMO5': '0.014', 'weapon4': '0.034', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.171', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.338', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '70.000'} [2024-08-06 02:33:43,935][52659] DAMAGECOUNT value on done: 319896.0 [2024-08-06 02:33:43,936][52659] Sum rewards: 75.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.022', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '63.000'} [2024-08-06 02:33:46,628][52663] DAMAGECOUNT value on done: 307231.0 [2024-08-06 02:33:46,629][52663] Sum rewards: 63.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.655', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.074', 'weapon4': '0.122', 'AMMO4': '0.167', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.258', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '54.500'} [2024-08-06 02:33:46,928][52650] Updated weights for policy 0, policy_version 39031 (0.0024) [2024-08-06 02:33:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17578.1). Total num frames: 319758336. Throughput: 0: 4380.0. Samples: 79937620. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:33:47,794][52567] Avg episode reward: [(0, '68.312')] [2024-08-06 02:33:49,685][52663] DAMAGECOUNT value on done: 309375.0 [2024-08-06 02:33:49,686][52663] Sum rewards: 64.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.296', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.484', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '55.000'} [2024-08-06 02:33:50,611][52794] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon5', 0.002)] [2024-08-06 02:33:51,662][52650] Updated weights for policy 0, policy_version 39041 (0.0022) [2024-08-06 02:33:52,548][52663] DAMAGECOUNT value on done: 311142.0 [2024-08-06 02:33:52,550][52663] Sum rewards: 70.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO4': '0.156', 'weapon2': '0.218', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '60.000'} [2024-08-06 02:33:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 319840256. Throughput: 0: 4387.1. Samples: 79964060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:33:52,794][52567] Avg episode reward: [(0, '68.479')] [2024-08-06 02:33:55,351][52663] DAMAGECOUNT value on done: 319113.0 [2024-08-06 02:33:55,352][52663] Sum rewards: 67.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.294', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '57.000'} [2024-08-06 02:33:56,259][52650] Updated weights for policy 0, policy_version 39051 (0.0031) [2024-08-06 02:33:57,796][52567] Fps is (10 sec: 16380.8, 60 sec: 17475.8, 300 sec: 17522.4). Total num frames: 319922176. Throughput: 0: 4376.0. Samples: 79989960. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 02:33:57,796][52567] Avg episode reward: [(0, '68.425')] [2024-08-06 02:33:58,398][52663] DAMAGECOUNT value on done: 313239.0 [2024-08-06 02:33:58,399][52663] Sum rewards: 67.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.142', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.102', 'weapon4': '0.160', 'AMMO4': '0.168', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.254', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:00,943][52650] Updated weights for policy 0, policy_version 39061 (0.0014) [2024-08-06 02:34:01,401][52663] DAMAGECOUNT value on done: 320411.0 [2024-08-06 02:34:01,402][52663] Sum rewards: 80.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.242', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.249', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '68.000'} [2024-08-06 02:34:02,070][52662] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:34:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17550.3). Total num frames: 320012288. Throughput: 0: 4373.3. Samples: 80003160. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 02:34:02,795][52567] Avg episode reward: [(0, '68.474')] [2024-08-06 02:34:04,396][52663] DAMAGECOUNT value on done: 317202.0 [2024-08-06 02:34:04,399][52663] Sum rewards: 73.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.942', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.090', 'AMMO3': '0.156', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.374', 'weapon2': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.862', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:04,796][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:34:05,483][52667] DAMAGECOUNT value on done: 315247.0 [2024-08-06 02:34:05,486][52667] Sum rewards: 66.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.856', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'weapon4': '0.290', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.012', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:06,101][52650] Updated weights for policy 0, policy_version 39071 (0.0012) [2024-08-06 02:34:07,115][52663] DAMAGECOUNT value on done: 309066.0 [2024-08-06 02:34:07,116][52663] Sum rewards: 70.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.486', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.032', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.244', 'weapon2': '0.298', 'WEAPON3': '1.550', 'HITCOUNT': '3.230', 'weapon3': '3.262', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:07,794][52567] Fps is (10 sec: 18025.8, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 320102400. Throughput: 0: 4368.2. Samples: 80028990. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 02:34:07,795][52567] Avg episode reward: [(0, '68.473')] [2024-08-06 02:34:07,868][52795] DAMAGECOUNT value on done: 293663.0 [2024-08-06 02:34:07,868][52795] Sum rewards: 50.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon5': '0.162', 'AMMO3': '0.205', 'weapon4': '0.244', 'AMMO4': '0.318', 'weapon2': '0.474', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.788', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '45.500'} [2024-08-06 02:34:08,592][52667] DAMAGECOUNT value on done: 319680.0 [2024-08-06 02:34:08,594][52667] Sum rewards: 72.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:09,558][52665] DAMAGECOUNT value on done: 309079.0 [2024-08-06 02:34:09,558][52665] Sum rewards: 67.781, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.756', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.124', 'AMMO4': '0.208', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:09,686][52647] DAMAGECOUNT value on done: 331943.0 [2024-08-06 02:34:09,686][52647] Sum rewards: 63.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.189', 'weapon5': '0.218', 'weapon4': '0.350', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.618', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:10,189][52650] Updated weights for policy 0, policy_version 39081 (0.0019) [2024-08-06 02:34:11,006][52795] DAMAGECOUNT value on done: 286964.0 [2024-08-06 02:34:11,010][52795] Sum rewards: 79.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.478', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.140', 'weapon5': '0.164', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '65.000'} [2024-08-06 02:34:11,727][52667] DAMAGECOUNT value on done: 317030.0 [2024-08-06 02:34:11,730][52667] Sum rewards: 67.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.168', 'AMMO4': '0.172', 'weapon4': '0.188', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:11,981][52647] DAMAGECOUNT value on done: 332309.0 [2024-08-06 02:34:11,982][52647] Sum rewards: 68.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.020', 'WEAPON5': '0.050', 'weapon7': '0.062', 'AMMO4': '0.069', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.396', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:12,372][52803] DAMAGECOUNT value on done: 295820.0 [2024-08-06 02:34:12,373][52803] Sum rewards: 74.692, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.000', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.248', 'AMMO3': '0.260', 'weapon2': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.048', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '64.000'} [2024-08-06 02:34:12,778][52665] DAMAGECOUNT value on done: 315123.0 [2024-08-06 02:34:12,780][52665] Sum rewards: 71.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.262', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.144', 'weapon2': '0.186', 'WEAPON4': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.205', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.446', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '60.500'} [2024-08-06 02:34:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 320184320. Throughput: 0: 4369.1. Samples: 80055120. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 02:34:12,794][52567] Avg episode reward: [(0, '68.459')] [2024-08-06 02:34:12,876][52811] DAMAGECOUNT value on done: 305340.0 [2024-08-06 02:34:12,877][52811] Sum rewards: 81.406, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.925', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.175', 'weapon2': '0.266', 'WEAPON3': '1.100', 'weapon3': '3.556', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '66.000'} [2024-08-06 02:34:14,198][52795] DAMAGECOUNT value on done: 288718.0 [2024-08-06 02:34:14,201][52795] Sum rewards: 72.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.238', 'AMMO4': '0.240', 'weapon5': '0.254', 'weapon2': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.478', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:14,454][52667] DAMAGECOUNT value on done: 317024.0 [2024-08-06 02:34:14,454][52667] Sum rewards: 61.303, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.464', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.148', 'AMMO4': '0.219', 'weapon5': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.600', 'weapon4': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.460', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '47.500'} [2024-08-06 02:34:14,989][52647] DAMAGECOUNT value on done: 332234.0 [2024-08-06 02:34:14,990][52647] Sum rewards: 63.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.077', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO3': '0.150', 'AMMO4': '0.227', 'weapon5': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:15,474][52650] Updated weights for policy 0, policy_version 39091 (0.0019) [2024-08-06 02:34:15,475][52803] DAMAGECOUNT value on done: 293103.0 [2024-08-06 02:34:15,477][52803] Sum rewards: 62.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.725', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.114', 'weapon5': '0.214', 'AMMO3': '0.263', 'AMMO4': '0.293', 'weapon2': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.890', 'weapon3': '3.084', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:15,838][52665] DAMAGECOUNT value on done: 313662.0 [2024-08-06 02:34:15,841][52665] Sum rewards: 80.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO2': '0.014', 'AMMO4': '0.073', 'weapon2': '0.138', 'AMMO3': '0.216', 'WEAPON3': '1.400', 'weapon3': '3.686', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '67.000'} [2024-08-06 02:34:15,960][52811] DAMAGECOUNT value on done: 291824.0 [2024-08-06 02:34:15,963][52811] Sum rewards: 60.898, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.956', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.104', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.285', 'weapon2': '0.374', 'WEAPON3': '1.650', 'weapon3': '3.170', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:17,229][52795] DAMAGECOUNT value on done: 291530.0 [2024-08-06 02:34:17,239][52795] Sum rewards: 76.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.995', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:17,377][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:34:17,522][52667] DAMAGECOUNT value on done: 320594.0 [2024-08-06 02:34:17,522][52667] Sum rewards: 75.543, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.455', 'AMMO5': '0.021', 'AMMO2': '0.063', 'weapon5': '0.088', 'AMMO3': '0.202', 'weapon4': '0.242', 'AMMO4': '0.314', 'WEAPON5': '0.500', 'weapon2': '0.578', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '64.000'} [2024-08-06 02:34:17,615][52647] DAMAGECOUNT value on done: 335579.0 [2024-08-06 02:34:17,617][52647] Sum rewards: 72.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.176', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.130', 'AMMO3': '0.191', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '59.500'} [2024-08-06 02:34:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 320266240. Throughput: 0: 4364.7. Samples: 80068070. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 02:34:17,795][52567] Avg episode reward: [(0, '68.221')] [2024-08-06 02:34:18,063][52662] DAMAGECOUNT value on done: 324511.0 [2024-08-06 02:34:18,063][52662] Sum rewards: 71.178, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.253', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon2': '0.200', 'weapon5': '0.228', 'weapon4': '0.258', 'AMMO4': '0.282', 'AMMO3': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.992', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:18,182][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:34:18,502][52803] DAMAGECOUNT value on done: 296006.0 [2024-08-06 02:34:18,503][52803] Sum rewards: 68.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.736', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.096', 'weapon4': '0.132', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.188', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:18,854][52665] DAMAGECOUNT value on done: 309144.0 [2024-08-06 02:34:18,855][52665] Sum rewards: 65.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon2': '0.134', 'AMMO3': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.790', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:19,221][52811] DAMAGECOUNT value on done: 296203.0 [2024-08-06 02:34:19,222][52811] Sum rewards: 70.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon7': '0.054', 'AMMO4': '0.079', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON7': '0.200', 'weapon2': '0.360', 'weapon4': '0.392', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:19,570][52650] Updated weights for policy 0, policy_version 39101 (0.0021) [2024-08-06 02:34:19,616][52649] DAMAGECOUNT value on done: 306230.0 [2024-08-06 02:34:19,616][52649] Sum rewards: 57.713, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'AMMO5': '0.016', 'AMMO2': '0.063', 'AMMO3': '0.138', 'weapon5': '0.184', 'weapon2': '0.314', 'AMMO4': '0.317', 'weapon4': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '0.950', 'HITCOUNT': '2.640', 'weapon3': '2.864', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '49.000'} [2024-08-06 02:34:20,276][52647] DAMAGECOUNT value on done: 332407.0 [2024-08-06 02:34:20,277][52647] Sum rewards: 70.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.800', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.124', 'weapon5': '0.142', 'AMMO4': '0.178', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:20,315][52795] DAMAGECOUNT value on done: 294198.0 [2024-08-06 02:34:20,315][52795] Sum rewards: 64.840, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.416', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.116', 'AMMO3': '0.151', 'weapon2': '0.362', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.274', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '51.000'} [2024-08-06 02:34:20,403][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:34:20,504][52667] DAMAGECOUNT value on done: 320328.0 [2024-08-06 02:34:20,505][52667] Sum rewards: 65.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.484', 'weapon4': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:21,092][52662] DAMAGECOUNT value on done: 319893.0 [2024-08-06 02:34:21,096][52662] Sum rewards: 58.909, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon5': '0.178', 'weapon4': '0.218', 'AMMO3': '0.243', 'AMMO4': '0.317', 'weapon2': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '2.930', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:21,285][52665] DAMAGECOUNT value on done: 305499.0 [2024-08-06 02:34:21,287][52665] Sum rewards: 56.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.110', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.150', 'weapon5': '0.190', 'AMMO4': '0.205', 'weapon4': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.586', 'WEAPON3': '0.950', 'HITCOUNT': '2.580', 'weapon3': '2.744', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '45.000'} [2024-08-06 02:34:21,677][52803] DAMAGECOUNT value on done: 298526.0 [2024-08-06 02:34:21,677][52803] Sum rewards: 69.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.723', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.180', 'weapon5': '0.234', 'weapon2': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.682', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '56.500'} [2024-08-06 02:34:22,114][52668] DAMAGECOUNT value on done: 312875.0 [2024-08-06 02:34:22,116][52668] Sum rewards: 61.925, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.456', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.145', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'AMMO3': '0.341', 'WEAPON3': '2.000', 'HITCOUNT': '3.020', 'weapon3': '3.094', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:22,367][52811] DAMAGECOUNT value on done: 294684.0 [2024-08-06 02:34:22,368][52811] Sum rewards: 70.986, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.573', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.496', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:22,395][52649] DAMAGECOUNT value on done: 301560.0 [2024-08-06 02:34:22,396][52649] Sum rewards: 73.598, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.477', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon2': '0.204', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'weapon3': '3.512', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 320364544. Throughput: 0: 4364.7. Samples: 80094630. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:34:22,794][52567] Avg episode reward: [(0, '68.230')] [2024-08-06 02:34:23,277][52647] DAMAGECOUNT value on done: 337333.0 [2024-08-06 02:34:23,278][52647] Sum rewards: 69.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.104', 'weapon5': '0.138', 'AMMO3': '0.185', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:23,458][52795] DAMAGECOUNT value on done: 291295.0 [2024-08-06 02:34:23,459][52795] Sum rewards: 55.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.162', 'weapon5': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.688', 'WEAPON3': '0.900', 'weapon3': '2.404', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '46.000'} [2024-08-06 02:34:23,547][52667] DAMAGECOUNT value on done: 321361.0 [2024-08-06 02:34:23,548][52667] Sum rewards: 68.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.376', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.192', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:23,550][52668] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:34:23,624][52662] DAMAGECOUNT value on done: 320448.0 [2024-08-06 02:34:23,624][52662] Sum rewards: 73.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.768', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.204', 'AMMO4': '0.234', 'weapon5': '0.290', 'weapon4': '0.334', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:23,831][52665] DAMAGECOUNT value on done: 306344.0 [2024-08-06 02:34:23,835][52665] Sum rewards: 70.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.188', 'AMMO3': '0.197', 'weapon5': '0.228', 'weapon2': '0.230', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:24,635][52650] Updated weights for policy 0, policy_version 39111 (0.0013) [2024-08-06 02:34:24,742][52649] DAMAGECOUNT value on done: 308311.0 [2024-08-06 02:34:24,743][52649] Sum rewards: 72.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.158', 'AMMO3': '0.198', 'weapon4': '0.206', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:25,004][52803] DAMAGECOUNT value on done: 297996.0 [2024-08-06 02:34:25,007][52803] Sum rewards: 70.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.332', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.211', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:25,259][52668] DAMAGECOUNT value on done: 318603.0 [2024-08-06 02:34:25,260][52668] Sum rewards: 65.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.136', 'AMMO3': '0.189', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:25,488][52811] DAMAGECOUNT value on done: 297929.0 [2024-08-06 02:34:25,492][52811] Sum rewards: 72.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.122', 'weapon5': '0.142', 'AMMO4': '0.184', 'AMMO3': '0.199', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.696', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:26,205][52647] DAMAGECOUNT value on done: 333244.0 [2024-08-06 02:34:26,205][52647] Sum rewards: 69.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.931', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:26,454][52667] DAMAGECOUNT value on done: 316382.0 [2024-08-06 02:34:26,455][52667] Sum rewards: 72.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.369', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.120', 'AMMO3': '0.251', 'AMMO4': '0.261', 'weapon5': '0.278', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:26,596][52795] DAMAGECOUNT value on done: 298874.0 [2024-08-06 02:34:26,596][52795] Sum rewards: 84.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.125', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.118', 'weapon4': '0.170', 'AMMO4': '0.184', 'AMMO3': '0.190', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '69.000'} [2024-08-06 02:34:26,837][52665] DAMAGECOUNT value on done: 313683.0 [2024-08-06 02:34:26,837][52665] Sum rewards: 69.620, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.825', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.172', 'AMMO4': '0.198', 'weapon5': '0.200', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.562', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.312', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:26,849][52662] DAMAGECOUNT value on done: 311283.0 [2024-08-06 02:34:26,849][52662] Sum rewards: 67.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.916', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:27,747][52668] DAMAGECOUNT value on done: 320607.0 [2024-08-06 02:34:27,755][52668] Sum rewards: 62.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.588', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.182', 'AMMO3': '0.226', 'weapon2': '0.614', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:27,795][52567] Fps is (10 sec: 18021.5, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 320446464. Throughput: 0: 4361.3. Samples: 80120730. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:34:27,795][52567] Avg episode reward: [(0, '68.627')] [2024-08-06 02:34:27,809][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039118_320454656.pth... [2024-08-06 02:34:27,952][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038605_316252160.pth [2024-08-06 02:34:28,004][52649] DAMAGECOUNT value on done: 307575.0 [2024-08-06 02:34:28,004][52649] Sum rewards: 68.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.285', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.183', 'weapon2': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.260', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:28,216][52803] DAMAGECOUNT value on done: 293278.0 [2024-08-06 02:34:28,219][52803] Sum rewards: 65.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.069', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.187', 'weapon2': '0.240', 'weapon5': '0.280', 'AMMO4': '0.291', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.464', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:28,644][52811] DAMAGECOUNT value on done: 300726.0 [2024-08-06 02:34:28,644][52811] Sum rewards: 71.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.025', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'AMMO3': '0.206', 'weapon2': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:28,674][52671] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:34:29,055][52667] DAMAGECOUNT value on done: 316545.0 [2024-08-06 02:34:29,055][52667] Sum rewards: 66.111, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.156', 'weapon5': '0.186', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.950', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '52.000'} [2024-08-06 02:34:29,481][52647] DAMAGECOUNT value on done: 329742.0 [2024-08-06 02:34:29,482][52647] Sum rewards: 65.190, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon5': '0.116', 'weapon4': '0.224', 'AMMO4': '0.230', 'AMMO3': '0.256', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:29,702][52650] Updated weights for policy 0, policy_version 39121 (0.0036) [2024-08-06 02:34:29,703][52665] DAMAGECOUNT value on done: 314301.0 [2024-08-06 02:34:29,709][52665] Sum rewards: 49.370, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.496', 'weapon2': '0.634', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '44.000'} [2024-08-06 02:34:30,041][52662] DAMAGECOUNT value on done: 321264.0 [2024-08-06 02:34:30,041][52662] Sum rewards: 63.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.230', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.312', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:30,044][52795] DAMAGECOUNT value on done: 295318.0 [2024-08-06 02:34:30,045][52795] Sum rewards: 81.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.153', 'AMMO4': '0.208', 'weapon5': '0.220', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.658', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '66.000'} [2024-08-06 02:34:30,626][52649] DAMAGECOUNT value on done: 298626.0 [2024-08-06 02:34:30,626][52649] Sum rewards: 63.022, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.672', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '52.000'} [2024-08-06 02:34:30,905][52668] DAMAGECOUNT value on done: 321956.0 [2024-08-06 02:34:30,907][52668] Sum rewards: 74.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.625', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.069', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.328', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '61.000'} [2024-08-06 02:34:31,308][52803] DAMAGECOUNT value on done: 293079.0 [2024-08-06 02:34:31,308][52803] Sum rewards: 77.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.138', 'AMMO4': '0.190', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:31,693][52811] DAMAGECOUNT value on done: 295515.0 [2024-08-06 02:34:31,693][52811] Sum rewards: 75.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'weapon4': '0.020', 'AMMO2': '0.028', 'weapon5': '0.114', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.308', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:31,804][52667] DAMAGECOUNT value on done: 323149.0 [2024-08-06 02:34:31,804][52667] Sum rewards: 72.469, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.882', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:32,252][52647] DAMAGECOUNT value on done: 337767.0 [2024-08-06 02:34:32,252][52647] Sum rewards: 69.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.069', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:32,436][52665] DAMAGECOUNT value on done: 314911.0 [2024-08-06 02:34:32,436][52665] Sum rewards: 72.695, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.370', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO4': '0.215', 'weapon4': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '62.000'} [2024-08-06 02:34:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 320536576. Throughput: 0: 4358.2. Samples: 80133740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:34:32,794][52567] Avg episode reward: [(0, '68.632')] [2024-08-06 02:34:33,026][52662] DAMAGECOUNT value on done: 313793.0 [2024-08-06 02:34:33,028][52662] Sum rewards: 75.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.680', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.190', 'weapon4': '0.218', 'AMMO3': '0.223', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '62.000'} [2024-08-06 02:34:33,155][52795] DAMAGECOUNT value on done: 284427.0 [2024-08-06 02:34:33,156][52795] Sum rewards: 57.542, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.125', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.154', 'AMMO3': '0.192', 'weapon4': '0.210', 'AMMO4': '0.247', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.106', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '50.000'} [2024-08-06 02:34:33,506][52647] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:34:33,687][52649] DAMAGECOUNT value on done: 310300.0 [2024-08-06 02:34:33,688][52649] Sum rewards: 69.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.201', 'weapon2': '0.380', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.372', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:33,843][52668] DAMAGECOUNT value on done: 311214.0 [2024-08-06 02:34:33,843][52668] Sum rewards: 68.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.215', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'weapon4': '0.084', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:34,014][52650] Updated weights for policy 0, policy_version 39131 (0.0013) [2024-08-06 02:34:34,470][52803] DAMAGECOUNT value on done: 291692.0 [2024-08-06 02:34:34,470][52803] Sum rewards: 62.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.090', 'AMMO4': '0.145', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.306', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:34,611][52667] DAMAGECOUNT value on done: 315454.0 [2024-08-06 02:34:34,611][52667] Sum rewards: 64.632, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.602', 'AMMO5': '0.010', 'AMMO2': '0.060', 'AMMO3': '0.223', 'weapon5': '0.244', 'weapon2': '0.260', 'WEAPON5': '0.300', 'AMMO4': '0.301', 'weapon4': '0.548', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.606', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:34,778][52647] DAMAGECOUNT value on done: 330324.0 [2024-08-06 02:34:34,778][52647] Sum rewards: 66.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.248', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.182', 'weapon2': '0.296', 'AMMO4': '0.302', 'weapon5': '0.346', 'weapon4': '0.392', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.652', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:34,885][52811] DAMAGECOUNT value on done: 295221.0 [2024-08-06 02:34:34,888][52811] Sum rewards: 49.968, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.410', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.068', 'weapon5': '0.112', 'AMMO4': '0.245', 'AMMO3': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.612', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '2.894', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '46.000'} [2024-08-06 02:34:35,573][52662] DAMAGECOUNT value on done: 323451.0 [2024-08-06 02:34:35,575][52662] Sum rewards: 73.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.372', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.170', 'AMMO4': '0.209', 'weapon2': '0.244', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.500', 'weapon3': '2.774', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '61.000'} [2024-08-06 02:34:35,675][52665] DAMAGECOUNT value on done: 313278.0 [2024-08-06 02:34:35,683][52665] Sum rewards: 76.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon4': '0.194', 'weapon5': '0.198', 'AMMO3': '0.212', 'AMMO4': '0.292', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:36,327][52668] DAMAGECOUNT value on done: 320863.0 [2024-08-06 02:34:36,328][52668] Sum rewards: 66.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.274', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon2': '0.168', 'AMMO3': '0.224', 'AMMO4': '0.224', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:36,439][52795] DAMAGECOUNT value on done: 298317.0 [2024-08-06 02:34:36,440][52795] Sum rewards: 70.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.232', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.042', 'AMMO4': '0.095', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:36,884][52649] DAMAGECOUNT value on done: 306712.0 [2024-08-06 02:34:36,885][52649] Sum rewards: 64.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.174', 'weapon2': '0.216', 'AMMO3': '0.228', 'weapon4': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.120', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:37,327][52647] DAMAGECOUNT value on done: 336745.0 [2024-08-06 02:34:37,332][52647] Sum rewards: 63.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.122', 'weapon4': '0.124', 'AMMO4': '0.146', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.184', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '52.000'} [2024-08-06 02:34:37,492][52667] DAMAGECOUNT value on done: 319141.0 [2024-08-06 02:34:37,492][52667] Sum rewards: 65.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.256', 'weapon2': '0.320', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.942', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:37,607][52803] DAMAGECOUNT value on done: 296290.0 [2024-08-06 02:34:37,608][52803] Sum rewards: 62.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.464', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.097', 'AMMO3': '0.181', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.122', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:37,794][52567] Fps is (10 sec: 18023.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 320626688. Throughput: 0: 4356.2. Samples: 80160090. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:34:37,796][52567] Avg episode reward: [(0, '68.471')] [2024-08-06 02:34:37,948][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:34:38,155][52811] DAMAGECOUNT value on done: 305708.0 [2024-08-06 02:34:38,156][52811] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.882', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.048', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.282', 'weapon2': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.254', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '62.000'} [2024-08-06 02:34:38,381][52665] DAMAGECOUNT value on done: 319684.0 [2024-08-06 02:34:38,382][52665] Sum rewards: 59.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.608', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.215', 'AMMO4': '0.259', 'weapon5': '0.282', 'weapon2': '0.352', 'weapon4': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '50.500'} [2024-08-06 02:34:38,670][52650] Updated weights for policy 0, policy_version 39141 (0.0038) [2024-08-06 02:34:38,682][52669] DAMAGECOUNT value on done: 322100.0 [2024-08-06 02:34:38,683][52669] Sum rewards: 68.317, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.777', 'ARMOR': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon4': '0.122', 'weapon2': '0.202', 'AMMO3': '0.298', 'WEAPON3': '1.750', 'weapon3': '3.458', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:38,763][52662] DAMAGECOUNT value on done: 327538.0 [2024-08-06 02:34:38,763][52662] Sum rewards: 72.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.128', 'AMMO3': '0.160', 'AMMO4': '0.220', 'weapon5': '0.242', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.050', 'weapon3': '2.920', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:38,968][52668] DAMAGECOUNT value on done: 317705.0 [2024-08-06 02:34:38,968][52668] Sum rewards: 60.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.995', 'weapon4': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.424', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '52.500'} [2024-08-06 02:34:39,632][52795] DAMAGECOUNT value on done: 291138.0 [2024-08-06 02:34:39,633][52795] Sum rewards: 76.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.126', 'weapon4': '0.146', 'AMMO3': '0.189', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:39,684][52649] DAMAGECOUNT value on done: 312152.0 [2024-08-06 02:34:39,686][52649] Sum rewards: 60.485, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.032', 'AMMO4': '0.121', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.414', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '47.000'} [2024-08-06 02:34:40,209][52647] DAMAGECOUNT value on done: 327847.0 [2024-08-06 02:34:40,211][52647] Sum rewards: 71.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.174', 'AMMO4': '0.174', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:40,265][52667] DAMAGECOUNT value on done: 316633.0 [2024-08-06 02:34:40,266][52667] Sum rewards: 70.012, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.256', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.090', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon2': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'weapon3': '3.322', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.000'} [2024-08-06 02:34:40,302][52660] DAMAGECOUNT value on done: 312246.0 [2024-08-06 02:34:40,302][52660] Sum rewards: 56.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.132', 'weapon4': '0.144', 'AMMO4': '0.209', 'AMMO3': '0.216', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.218', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '48.000'} [2024-08-06 02:34:40,465][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:34:40,733][52803] DAMAGECOUNT value on done: 291998.0 [2024-08-06 02:34:40,741][52803] Sum rewards: 70.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.961', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon2': '0.190', 'AMMO3': '0.203', 'weapon5': '0.234', 'AMMO4': '0.246', 'weapon4': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:41,254][52811] DAMAGECOUNT value on done: 296169.0 [2024-08-06 02:34:41,255][52811] Sum rewards: 74.662, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.270', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'weapon2': '0.320', 'WEAPON3': '1.700', 'weapon3': '3.222', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '66.000'} [2024-08-06 02:34:41,418][52665] DAMAGECOUNT value on done: 314232.0 [2024-08-06 02:34:41,418][52665] Sum rewards: 67.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.198', 'weapon5': '0.198', 'weapon4': '0.222', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:41,482][52669] DAMAGECOUNT value on done: 312638.0 [2024-08-06 02:34:41,483][52669] Sum rewards: 64.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.142', 'AMMO4': '0.171', 'weapon5': '0.196', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:41,670][52662] DAMAGECOUNT value on done: 318092.0 [2024-08-06 02:34:41,672][52662] Sum rewards: 69.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.305', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.154', 'AMMO3': '0.224', 'weapon5': '0.240', 'AMMO4': '0.258', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:42,117][52668] DAMAGECOUNT value on done: 312803.0 [2024-08-06 02:34:42,120][52668] Sum rewards: 56.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.066', 'AMMO4': '0.203', 'AMMO3': '0.208', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.872', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '49.000'} [2024-08-06 02:34:42,637][52795] DAMAGECOUNT value on done: 290147.0 [2024-08-06 02:34:42,639][52795] Sum rewards: 64.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.102', 'AMMO4': '0.151', 'weapon4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '56.500'} [2024-08-06 02:34:42,730][52649] DAMAGECOUNT value on done: 308410.0 [2024-08-06 02:34:42,733][52649] Sum rewards: 55.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.116', 'AMMO5': '0.015', 'AMMO2': '0.070', 'weapon5': '0.138', 'AMMO3': '0.176', 'weapon4': '0.256', 'AMMO4': '0.349', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.720', 'weapon3': '2.832', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '47.000'} [2024-08-06 02:34:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 320716800. Throughput: 0: 4365.3. Samples: 80186390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 02:34:42,794][52567] Avg episode reward: [(0, '68.144')] [2024-08-06 02:34:42,919][52647] DAMAGECOUNT value on done: 330838.0 [2024-08-06 02:34:42,920][52647] Sum rewards: 75.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon5': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.181', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:43,054][52667] DAMAGECOUNT value on done: 313749.0 [2024-08-06 02:34:43,055][52667] Sum rewards: 55.594, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.712', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon5': '0.068', 'weapon4': '0.134', 'AMMO4': '0.163', 'weapon2': '0.196', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.360', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '51.000'} [2024-08-06 02:34:43,350][52660] DAMAGECOUNT value on done: 311037.0 [2024-08-06 02:34:43,362][52660] Sum rewards: 68.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.148', 'weapon4': '0.166', 'AMMO3': '0.176', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.174', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:43,533][52650] Updated weights for policy 0, policy_version 39151 (0.0012) [2024-08-06 02:34:43,775][52803] DAMAGECOUNT value on done: 300167.0 [2024-08-06 02:34:43,777][52803] Sum rewards: 57.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.721', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.078', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '2.990', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '50.000'} [2024-08-06 02:34:44,368][52811] DAMAGECOUNT value on done: 297594.0 [2024-08-06 02:34:44,368][52811] Sum rewards: 66.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.842', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.222', 'weapon2': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.194', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:44,395][52669] DAMAGECOUNT value on done: 320154.0 [2024-08-06 02:34:44,395][52669] Sum rewards: 66.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.174', 'AMMO4': '0.191', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:44,592][52665] DAMAGECOUNT value on done: 313564.0 [2024-08-06 02:34:44,592][52665] Sum rewards: 64.160, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.866', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon5': '0.202', 'weapon2': '0.222', 'AMMO3': '0.260', 'AMMO4': '0.297', 'WEAPON5': '0.400', 'weapon4': '0.506', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.700', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:44,739][52662] DAMAGECOUNT value on done: 328542.0 [2024-08-06 02:34:44,739][52662] Sum rewards: 59.645, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.111', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '53.500'} [2024-08-06 02:34:44,743][52668] DAMAGECOUNT value on done: 317625.0 [2024-08-06 02:34:44,745][52668] Sum rewards: 63.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.198', 'weapon5': '0.198', 'AMMO4': '0.227', 'weapon4': '0.282', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.726', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:45,526][52647] DAMAGECOUNT value on done: 331752.0 [2024-08-06 02:34:45,528][52647] Sum rewards: 66.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.384', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon4': '0.072', 'weapon5': '0.080', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '0.850', 'HITCOUNT': '3.180', 'weapon3': '3.236', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:45,778][52667] DAMAGECOUNT value on done: 321077.0 [2024-08-06 02:34:45,786][52667] Sum rewards: 66.807, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.024', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.092', 'AMMO3': '0.134', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '0.900', 'HITCOUNT': '3.040', 'weapon3': '3.186', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '52.000'} [2024-08-06 02:34:45,817][52795] DAMAGECOUNT value on done: 286823.0 [2024-08-06 02:34:45,818][52795] Sum rewards: 69.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.006', 'ARMOR': '0.036', 'AMMO2': '0.049', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'AMMO4': '0.243', 'weapon4': '0.340', 'WEAPON4': '0.350', 'weapon2': '0.724', 'WEAPON3': '1.450', 'weapon3': '2.648', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:45,945][52649] DAMAGECOUNT value on done: 307704.0 [2024-08-06 02:34:45,946][52649] Sum rewards: 59.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.166', 'AMMO3': '0.225', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '2.908', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '49.000'} [2024-08-06 02:34:46,040][52660] DAMAGECOUNT value on done: 320342.0 [2024-08-06 02:34:46,040][52660] Sum rewards: 61.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon2': '0.220', 'AMMO3': '0.231', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.612', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '52.000'} [2024-08-06 02:34:46,992][52803] DAMAGECOUNT value on done: 297095.0 [2024-08-06 02:34:46,992][52803] Sum rewards: 65.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.232', 'weapon4': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.232', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:47,263][52614] Signal inference workers to stop experience collection... (7050 times) [2024-08-06 02:34:47,279][52614] Signal inference workers to resume experience collection... (7050 times) [2024-08-06 02:34:47,331][52650] InferenceWorker_p0-w0: stopping experience collection (7050 times) [2024-08-06 02:34:47,347][52650] InferenceWorker_p0-w0: resuming experience collection (7050 times) [2024-08-06 02:34:47,396][52662] DAMAGECOUNT value on done: 314967.0 [2024-08-06 02:34:47,397][52662] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.444', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.256', 'weapon2': '0.330', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.500', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:47,447][52811] DAMAGECOUNT value on done: 302092.0 [2024-08-06 02:34:47,448][52811] Sum rewards: 69.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.042', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.108', 'AMMO4': '0.129', 'weapon5': '0.140', 'AMMO3': '0.200', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.318', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:47,513][52669] DAMAGECOUNT value on done: 316009.0 [2024-08-06 02:34:47,514][52669] Sum rewards: 74.781, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon4': '0.134', 'weapon5': '0.148', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'AMMO3': '0.303', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '65.000'} [2024-08-06 02:34:47,601][52665] DAMAGECOUNT value on done: 313170.0 [2024-08-06 02:34:47,601][52665] Sum rewards: 63.342, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.314', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.192', 'AMMO4': '0.226', 'AMMO3': '0.231', 'weapon4': '0.254', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '55.500'} [2024-08-06 02:34:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 320798720. Throughput: 0: 4360.2. Samples: 80199370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:34:47,794][52567] Avg episode reward: [(0, '67.228')] [2024-08-06 02:34:47,801][52647] DAMAGECOUNT value on done: 339838.0 [2024-08-06 02:34:47,801][52647] Sum rewards: 70.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.258', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.470', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:47,817][52668] DAMAGECOUNT value on done: 316244.0 [2024-08-06 02:34:47,817][52668] Sum rewards: 68.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.631', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.148', 'AMMO3': '0.162', 'AMMO4': '0.226', 'weapon2': '0.232', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.142', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:47,941][52650] Updated weights for policy 0, policy_version 39161 (0.0013) [2024-08-06 02:34:48,695][52649] DAMAGECOUNT value on done: 310235.0 [2024-08-06 02:34:48,695][52649] Sum rewards: 65.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.195', 'AMMO4': '0.210', 'weapon4': '0.216', 'weapon5': '0.258', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '52.000'} [2024-08-06 02:34:48,744][52667] DAMAGECOUNT value on done: 325070.0 [2024-08-06 02:34:48,744][52667] Sum rewards: 71.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.190', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '3.302', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:49,024][52795] DAMAGECOUNT value on done: 295582.0 [2024-08-06 02:34:49,025][52795] Sum rewards: 76.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.002', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.278', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.032', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '61.000'} [2024-08-06 02:34:49,169][52660] DAMAGECOUNT value on done: 319936.0 [2024-08-06 02:34:49,170][52660] Sum rewards: 66.297, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.506', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.110', 'AMMO4': '0.178', 'weapon4': '0.192', 'WEAPON5': '0.250', 'AMMO3': '0.299', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.044', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '60.500'} [2024-08-06 02:34:49,941][52669] DAMAGECOUNT value on done: 314112.0 [2024-08-06 02:34:49,942][52669] Sum rewards: 67.578, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.766', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'AMMO4': '0.187', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.102', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:49,956][52665] DAMAGECOUNT value on done: 314402.0 [2024-08-06 02:34:49,956][52665] Sum rewards: 74.678, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.294', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.047', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.287', 'weapon2': '0.324', 'WEAPON3': '1.750', 'weapon3': '3.352', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '66.000'} [2024-08-06 02:34:50,143][52803] DAMAGECOUNT value on done: 292919.0 [2024-08-06 02:34:50,145][52803] Sum rewards: 65.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.115', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon2': '0.218', 'AMMO3': '0.222', 'ARMOR': '0.400', 'weapon4': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:50,177][52662] DAMAGECOUNT value on done: 317077.0 [2024-08-06 02:34:50,179][52662] Sum rewards: 67.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.523', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.174', 'AMMO3': '0.199', 'weapon5': '0.222', 'AMMO4': '0.254', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:50,681][52811] DAMAGECOUNT value on done: 294948.0 [2024-08-06 02:34:50,683][52811] Sum rewards: 60.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.599', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.066', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.199', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.534', 'WEAPON3': '1.300', 'weapon3': '2.620', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '54.000'} [2024-08-06 02:34:50,941][52647] DAMAGECOUNT value on done: 333882.0 [2024-08-06 02:34:50,951][52647] Sum rewards: 73.721, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.074', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.216', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:51,053][52668] DAMAGECOUNT value on done: 321350.0 [2024-08-06 02:34:51,053][52668] Sum rewards: 65.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.688', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.114', 'weapon5': '0.156', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.164', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:51,123][52649] DAMAGECOUNT value on done: 310884.0 [2024-08-06 02:34:51,124][52649] Sum rewards: 63.104, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.070', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'weapon4': '0.196', 'weapon2': '0.220', 'AMMO3': '0.291', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.230', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:51,899][52667] DAMAGECOUNT value on done: 322422.0 [2024-08-06 02:34:51,899][52667] Sum rewards: 66.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.070', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:52,048][52795] DAMAGECOUNT value on done: 284586.0 [2024-08-06 02:34:52,048][52795] Sum rewards: 69.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.026', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon4': '0.234', 'weapon2': '0.264', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.188', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:52,449][52660] DAMAGECOUNT value on done: 316467.0 [2024-08-06 02:34:52,450][52660] Sum rewards: 59.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.918', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.072', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '49.000'} [2024-08-06 02:34:52,564][52669] DAMAGECOUNT value on done: 317139.0 [2024-08-06 02:34:52,564][52669] Sum rewards: 66.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.705', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.132', 'weapon4': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:52,569][52665] DAMAGECOUNT value on done: 311821.0 [2024-08-06 02:34:52,571][52665] Sum rewards: 78.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.056', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.052', 'AMMO4': '0.139', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.236', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '67.000'} [2024-08-06 02:34:52,695][52662] DAMAGECOUNT value on done: 320634.0 [2024-08-06 02:34:52,695][52662] Sum rewards: 73.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.034', 'AMMO2': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.220', 'AMMO4': '0.237', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '62.000'} [2024-08-06 02:34:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 320880640. Throughput: 0: 4366.0. Samples: 80225460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:34:52,794][52567] Avg episode reward: [(0, '67.452')] [2024-08-06 02:34:52,947][52650] Updated weights for policy 0, policy_version 39171 (0.0022) [2024-08-06 02:34:53,318][52803] DAMAGECOUNT value on done: 300413.0 [2024-08-06 02:34:53,322][52803] Sum rewards: 63.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.226', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.094', 'AMMO3': '0.216', 'weapon5': '0.220', 'weapon2': '0.240', 'AMMO4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.234', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '52.000'} [2024-08-06 02:34:53,822][52811] DAMAGECOUNT value on done: 299457.0 [2024-08-06 02:34:53,822][52811] Sum rewards: 74.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.777', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '62.000'} [2024-08-06 02:34:53,947][52647] DAMAGECOUNT value on done: 331901.0 [2024-08-06 02:34:53,948][52647] Sum rewards: 74.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.126', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:54,018][52794] DAMAGECOUNT value on done: 318592.0 [2024-08-06 02:34:54,018][52794] Sum rewards: 82.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.110', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.234', 'WEAPON3': '1.100', 'weapon3': '3.314', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '66.000'} [2024-08-06 02:34:54,094][52649] DAMAGECOUNT value on done: 311945.0 [2024-08-06 02:34:54,094][52649] Sum rewards: 64.204, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.127', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.219', 'weapon5': '0.230', 'weapon4': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.710', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:54,328][52668] DAMAGECOUNT value on done: 314607.0 [2024-08-06 02:34:54,328][52668] Sum rewards: 65.342, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.056', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.140', 'weapon5': '0.244', 'AMMO4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '56.000'} [2024-08-06 02:34:54,644][52667] DAMAGECOUNT value on done: 324916.0 [2024-08-06 02:34:54,644][52667] Sum rewards: 73.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.644', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO4': '0.172', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '61.000'} [2024-08-06 02:34:55,063][52662] DAMAGECOUNT value on done: 324443.0 [2024-08-06 02:34:55,065][52662] Sum rewards: 66.858, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.095', 'AMMO3': '0.116', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.850', 'WEAPON3': '0.900', 'weapon3': '2.786', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:55,154][52795] DAMAGECOUNT value on done: 301434.0 [2024-08-06 02:34:55,158][52795] Sum rewards: 57.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.832', 'WEAPON3': '1.100', 'weapon3': '2.542', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '47.000'} [2024-08-06 02:34:55,287][52665] DAMAGECOUNT value on done: 309006.0 [2024-08-06 02:34:55,288][52665] Sum rewards: 52.328, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.530', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.116', 'AMMO4': '0.150', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.700', 'HITCOUNT': '3.060', 'weapon3': '3.156', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '47.000'} [2024-08-06 02:34:55,446][52660] DAMAGECOUNT value on done: 312833.0 [2024-08-06 02:34:55,448][52660] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.096', 'AMMO4': '0.198', 'AMMO3': '0.225', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '63.000'} [2024-08-06 02:34:55,867][52669] DAMAGECOUNT value on done: 318914.0 [2024-08-06 02:34:55,870][52669] Sum rewards: 71.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.855', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.158', 'weapon2': '0.216', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '61.000'} [2024-08-06 02:34:56,541][52794] DAMAGECOUNT value on done: 323494.0 [2024-08-06 02:34:56,542][52794] Sum rewards: 59.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.313', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.183', 'weapon4': '0.228', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '50.000'} [2024-08-06 02:34:56,686][52803] DAMAGECOUNT value on done: 293280.0 [2024-08-06 02:34:56,686][52803] Sum rewards: 71.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.138', 'weapon5': '0.138', 'AMMO4': '0.219', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.204', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '60.000'} [2024-08-06 02:34:56,792][52647] DAMAGECOUNT value on done: 329568.0 [2024-08-06 02:34:56,792][52647] Sum rewards: 73.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.003', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.174', 'AMMO4': '0.208', 'weapon4': '0.208', 'weapon5': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '2.778', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:56,846][52649] DAMAGECOUNT value on done: 313245.0 [2024-08-06 02:34:56,846][52649] Sum rewards: 53.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.138', 'weapon5': '0.170', 'weapon4': '0.214', 'AMMO4': '0.281', 'weapon2': '0.534', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '2.824', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '45.000'} [2024-08-06 02:34:56,931][52811] DAMAGECOUNT value on done: 298004.0 [2024-08-06 02:34:56,933][52811] Sum rewards: 60.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'weapon4': '0.020', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.136', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.746', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '48.000'} [2024-08-06 02:34:56,951][52668] DAMAGECOUNT value on done: 307980.0 [2024-08-06 02:34:56,952][52668] Sum rewards: 72.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.655', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.182', 'weapon5': '0.182', 'AMMO4': '0.228', 'weapon4': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '59.000'} [2024-08-06 02:34:57,268][52650] Updated weights for policy 0, policy_version 39181 (0.0028) [2024-08-06 02:34:57,314][52658] DAMAGECOUNT value on done: 316981.0 [2024-08-06 02:34:57,316][52658] Sum rewards: 59.786, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.102', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.165', 'weapon5': '0.212', 'weapon2': '0.254', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.064', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.8, 300 sec: 17494.8). Total num frames: 320970752. Throughput: 0: 4372.2. Samples: 80251870. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:34:57,794][52567] Avg episode reward: [(0, '67.201')] [2024-08-06 02:34:57,880][52667] DAMAGECOUNT value on done: 315433.0 [2024-08-06 02:34:57,881][52667] Sum rewards: 83.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.146', 'AMMO3': '0.190', 'weapon2': '0.200', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '68.000'} [2024-08-06 02:34:58,124][52662] DAMAGECOUNT value on done: 317072.0 [2024-08-06 02:34:58,126][52662] Sum rewards: 60.715, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.236', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon5': '0.072', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.332', 'weapon2': '0.538', 'WEAPON3': '1.700', 'weapon3': '3.026', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:58,224][52660] DAMAGECOUNT value on done: 317517.0 [2024-08-06 02:34:58,225][52660] Sum rewards: 58.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon5': '0.046', 'weapon4': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.340', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.370', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '51.000'} [2024-08-06 02:34:58,389][52665] DAMAGECOUNT value on done: 309714.0 [2024-08-06 02:34:58,390][52665] Sum rewards: 66.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.885', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.182', 'weapon2': '0.498', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.410', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '55.000'} [2024-08-06 02:34:58,448][52795] DAMAGECOUNT value on done: 295089.0 [2024-08-06 02:34:58,449][52795] Sum rewards: 77.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.966', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.180', 'AMMO4': '0.191', 'weapon5': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '62.000'} [2024-08-06 02:34:58,984][52669] DAMAGECOUNT value on done: 317104.0 [2024-08-06 02:34:58,984][52669] Sum rewards: 64.851, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.846', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.188', 'AMMO3': '0.231', 'weapon4': '0.292', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:59,036][52671] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 02:34:59,595][52647] DAMAGECOUNT value on done: 324489.0 [2024-08-06 02:34:59,596][52647] Sum rewards: 73.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.317', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.032', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO4': '0.128', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.410', 'weapon3': '3.432', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '61.000'} [2024-08-06 02:34:59,611][52794] DAMAGECOUNT value on done: 317214.0 [2024-08-06 02:34:59,614][52794] Sum rewards: 69.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.614', 'AMMO5': '0.008', 'AMMO2': '0.065', 'weapon5': '0.136', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'AMMO4': '0.324', 'weapon4': '0.356', 'weapon2': '0.486', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '57.000'} [2024-08-06 02:34:59,755][52803] DAMAGECOUNT value on done: 292941.0 [2024-08-06 02:34:59,755][52803] Sum rewards: 52.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.852', 'AMMO5': '0.023', 'AMMO2': '0.076', 'AMMO3': '0.220', 'weapon2': '0.286', 'weapon5': '0.352', 'AMMO4': '0.378', 'weapon4': '0.552', 'WEAPON5': '0.700', 'WEAPON4': '0.900', 'WEAPON3': '1.250', 'weapon3': '2.412', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '46.000'} [2024-08-06 02:34:59,909][52811] DAMAGECOUNT value on done: 294280.0 [2024-08-06 02:34:59,912][52811] Sum rewards: 66.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.185', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.066', 'weapon4': '0.138', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '58.000'} [2024-08-06 02:34:59,916][52649] DAMAGECOUNT value on done: 303902.0 [2024-08-06 02:34:59,920][52649] Sum rewards: 58.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.865', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'weapon4': '0.308', 'weapon2': '0.364', 'WEAPON3': '1.750', 'weapon3': '3.050', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '53.000'} [2024-08-06 02:34:59,926][52668] DAMAGECOUNT value on done: 309204.0 [2024-08-06 02:34:59,930][52668] Sum rewards: 68.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO4': '0.155', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.412', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:00,246][52658] DAMAGECOUNT value on done: 317302.0 [2024-08-06 02:35:00,248][52658] Sum rewards: 71.042, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.146', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'HITCOUNT': '3.430', 'weapon3': '3.586', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:00,736][52662] DAMAGECOUNT value on done: 329897.0 [2024-08-06 02:35:00,738][52662] Sum rewards: 64.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.777', 'AMMO5': '0.011', 'weapon4': '0.012', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.228', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.510', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:00,751][52667] DAMAGECOUNT value on done: 322079.0 [2024-08-06 02:35:00,751][52667] Sum rewards: 82.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon5': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '71.000'} [2024-08-06 02:35:01,345][52660] DAMAGECOUNT value on done: 322638.0 [2024-08-06 02:35:01,348][52660] Sum rewards: 68.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.067', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon2': '0.150', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.574', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:01,492][52665] DAMAGECOUNT value on done: 312080.0 [2024-08-06 02:35:01,493][52665] Sum rewards: 52.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.169', 'weapon5': '0.208', 'weapon2': '0.254', 'AMMO4': '0.290', 'WEAPON5': '0.550', 'weapon4': '0.556', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.490', 'weapon3': '2.612', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '45.000'} [2024-08-06 02:35:01,569][52795] DAMAGECOUNT value on done: 285048.0 [2024-08-06 02:35:01,569][52795] Sum rewards: 59.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO3': '0.186', 'AMMO4': '0.214', 'weapon2': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.074', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '49.000'} [2024-08-06 02:35:01,929][52647] DAMAGECOUNT value on done: 332111.0 [2024-08-06 02:35:01,929][52647] Sum rewards: 61.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.425', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO4': '0.142', 'weapon5': '0.188', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '50.000'} [2024-08-06 02:35:02,025][52650] Updated weights for policy 0, policy_version 39191 (0.0023) [2024-08-06 02:35:02,050][52669] DAMAGECOUNT value on done: 317710.0 [2024-08-06 02:35:02,051][52669] Sum rewards: 73.788, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.612', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.080', 'AMMO4': '0.120', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.650', 'weapon3': '3.280', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:02,093][52794] DAMAGECOUNT value on done: 317264.0 [2024-08-06 02:35:02,093][52794] Sum rewards: 69.075, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.350', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.035', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.148', 'AMMO4': '0.175', 'AMMO3': '0.345', 'WEAPON3': '2.100', 'weapon3': '3.570', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 321060864. Throughput: 0: 4373.6. Samples: 80264880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:35:02,794][52567] Avg episode reward: [(0, '66.714')] [2024-08-06 02:35:02,888][52803] DAMAGECOUNT value on done: 301628.0 [2024-08-06 02:35:02,888][52803] Sum rewards: 64.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.388', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.244', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:02,982][52811] DAMAGECOUNT value on done: 297239.0 [2024-08-06 02:35:02,982][52811] Sum rewards: 57.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.390', 'AMMO5': '0.020', 'AMMO2': '0.068', 'weapon5': '0.176', 'AMMO3': '0.217', 'weapon4': '0.228', 'AMMO4': '0.338', 'weapon2': '0.360', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.918', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '50.000'} [2024-08-06 02:35:03,001][52649] DAMAGECOUNT value on done: 310915.0 [2024-08-06 02:35:03,003][52649] Sum rewards: 72.203, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.530', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.118', 'weapon5': '0.140', 'AMMO4': '0.189', 'weapon2': '0.252', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.184', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:03,103][52668] DAMAGECOUNT value on done: 309377.0 [2024-08-06 02:35:03,103][52668] Sum rewards: 74.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.018', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.158', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.232', 'WEAPON3': '1.100', 'HITCOUNT': '3.170', 'weapon3': '3.330', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:03,253][52658] DAMAGECOUNT value on done: 321237.0 [2024-08-06 02:35:03,254][52658] Sum rewards: 64.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.054', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO4': '0.109', 'AMMO3': '0.216', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.484', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '53.000'} [2024-08-06 02:35:03,332][52662] DAMAGECOUNT value on done: 321912.0 [2024-08-06 02:35:03,332][52662] Sum rewards: 66.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.669', 'AMMO5': '0.014', 'AMMO2': '0.053', 'AMMO3': '0.201', 'weapon5': '0.218', 'AMMO4': '0.267', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2024-08-06 02:35:04,235][52820] DAMAGECOUNT value on done: 290095.0 [2024-08-06 02:35:04,237][52820] Sum rewards: 77.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.144', 'weapon4': '0.172', 'AMMO4': '0.183', 'AMMO3': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '65.000'} [2024-08-06 02:35:04,458][52660] DAMAGECOUNT value on done: 320114.0 [2024-08-06 02:35:04,458][52660] Sum rewards: 63.562, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.710', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.204', 'AMMO3': '0.315', 'WEAPON3': '1.900', 'weapon3': '3.396', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '57.000'} [2024-08-06 02:35:04,656][52665] DAMAGECOUNT value on done: 313977.0 [2024-08-06 02:35:04,657][52665] Sum rewards: 77.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.685', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:04,707][52795] DAMAGECOUNT value on done: 296039.0 [2024-08-06 02:35:04,708][52795] Sum rewards: 71.081, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon5': '0.144', 'weapon4': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.222', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '61.000'} [2024-08-06 02:35:04,734][52669] DAMAGECOUNT value on done: 314816.0 [2024-08-06 02:35:04,734][52669] Sum rewards: 65.126, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.534', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.092', 'AMMO3': '0.150', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.000'} [2024-08-06 02:35:04,739][52794] DAMAGECOUNT value on done: 314578.0 [2024-08-06 02:35:04,739][52794] Sum rewards: 56.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon4': '0.282', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '48.000'} [2024-08-06 02:35:05,826][52658] DAMAGECOUNT value on done: 318421.0 [2024-08-06 02:35:05,826][52658] Sum rewards: 68.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.902', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.224', 'AMMO3': '0.225', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:05,958][52803] DAMAGECOUNT value on done: 295888.0 [2024-08-06 02:35:05,961][52803] Sum rewards: 81.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.456', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '68.000'} [2024-08-06 02:35:06,088][52662] DAMAGECOUNT value on done: 320568.0 [2024-08-06 02:35:06,088][52662] Sum rewards: 58.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.164', 'AMMO3': '0.183', 'AMMO4': '0.214', 'weapon4': '0.290', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.948', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '49.000'} [2024-08-06 02:35:06,106][52811] DAMAGECOUNT value on done: 298788.0 [2024-08-06 02:35:06,107][52811] Sum rewards: 64.084, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.100', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.188', 'weapon4': '0.214', 'weapon2': '0.240', 'AMMO3': '0.242', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.032', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:06,256][52668] DAMAGECOUNT value on done: 313373.0 [2024-08-06 02:35:06,257][52668] Sum rewards: 58.465, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.811', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.183', 'weapon4': '0.284', 'AMMO4': '0.298', 'weapon5': '0.312', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.532', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 02:35:06,324][52649] DAMAGECOUNT value on done: 307722.0 [2024-08-06 02:35:06,325][52649] Sum rewards: 64.812, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.154', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.788', 'WEAPON3': '1.000', 'weapon3': '2.504', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '51.000'} [2024-08-06 02:35:06,574][52650] Updated weights for policy 0, policy_version 39201 (0.0025) [2024-08-06 02:35:07,272][52660] DAMAGECOUNT value on done: 313765.0 [2024-08-06 02:35:07,272][52660] Sum rewards: 70.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.594', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.146', 'AMMO3': '0.221', 'weapon4': '0.234', 'weapon2': '0.252', 'AMMO4': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:07,315][52820] DAMAGECOUNT value on done: 294610.0 [2024-08-06 02:35:07,317][52820] Sum rewards: 75.356, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.547', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.144', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '0.900', 'weapon3': '3.106', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:07,459][52794] DAMAGECOUNT value on done: 320141.0 [2024-08-06 02:35:07,462][52794] Sum rewards: 62.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.380', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.728', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '52.500'} [2024-08-06 02:35:07,477][52669] DAMAGECOUNT value on done: 321031.0 [2024-08-06 02:35:07,478][52669] Sum rewards: 60.288, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.398', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon4': '0.316', 'weapon2': '0.380', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 321150976. Throughput: 0: 4373.3. Samples: 80291430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:35:07,794][52567] Avg episode reward: [(0, '66.885')] [2024-08-06 02:35:08,106][52795] DAMAGECOUNT value on done: 299495.0 [2024-08-06 02:35:08,106][52795] Sum rewards: 76.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.866', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:08,661][52658] DAMAGECOUNT value on done: 317659.0 [2024-08-06 02:35:08,663][52658] Sum rewards: 68.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.822', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.092', 'weapon5': '0.164', 'AMMO4': '0.168', 'AMMO3': '0.222', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:08,900][52668] DAMAGECOUNT value on done: 314593.0 [2024-08-06 02:35:08,900][52668] Sum rewards: 42.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon7': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.190', 'WEAPON7': '0.200', 'weapon5': '0.204', 'AMMO4': '0.208', 'AMMO3': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.310', 'weapon3': '2.534', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '39.000'} [2024-08-06 02:35:08,976][52803] DAMAGECOUNT value on done: 300702.0 [2024-08-06 02:35:08,977][52803] Sum rewards: 73.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.127', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:09,056][52671] DAMAGECOUNT value on done: 323534.0 [2024-08-06 02:35:09,056][52671] Sum rewards: 70.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '59.500'} [2024-08-06 02:35:09,079][52662] DAMAGECOUNT value on done: 318144.0 [2024-08-06 02:35:09,080][52662] Sum rewards: 60.052, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.056', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.131', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '49.000'} [2024-08-06 02:35:09,148][52811] DAMAGECOUNT value on done: 295032.0 [2024-08-06 02:35:09,152][52811] Sum rewards: 69.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.246', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.032', 'weapon5': '0.036', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.272', 'WEAPON3': '1.500', 'HITCOUNT': '3.200', 'weapon3': '3.392', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:09,177][52649] DAMAGECOUNT value on done: 313039.0 [2024-08-06 02:35:09,178][52649] Sum rewards: 71.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.488', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.284', 'weapon4': '0.394', 'WEAPON3': '1.000', 'weapon3': '2.996', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:10,199][52660] DAMAGECOUNT value on done: 323506.0 [2024-08-06 02:35:10,199][52660] Sum rewards: 66.376, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.141', 'HEALTH': '0.270', 'weapon2': '0.710', 'WEAPON3': '0.750', 'weapon3': '3.212', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '51.000'} [2024-08-06 02:35:10,543][52820] DAMAGECOUNT value on done: 292061.0 [2024-08-06 02:35:10,545][52820] Sum rewards: 67.482, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.933', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.086', 'WEAPON4': '0.100', 'weapon2': '0.194', 'AMMO3': '0.199', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.568', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:10,584][52669] DAMAGECOUNT value on done: 317737.0 [2024-08-06 02:35:10,587][52669] Sum rewards: 61.475, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.436', 'AMMO5': '0.016', 'AMMO2': '0.067', 'weapon5': '0.120', 'weapon4': '0.232', 'AMMO3': '0.236', 'weapon2': '0.236', 'AMMO4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.146', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:10,669][52794] DAMAGECOUNT value on done: 325023.0 [2024-08-06 02:35:10,671][52794] Sum rewards: 74.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.322', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:11,069][52658] DAMAGECOUNT value on done: 316064.0 [2024-08-06 02:35:11,072][52658] Sum rewards: 73.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.232', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.000', 'HITCOUNT': '3.230', 'weapon3': '3.250', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:11,555][52650] Updated weights for policy 0, policy_version 39211 (0.0013) [2024-08-06 02:35:11,828][52649] DAMAGECOUNT value on done: 315511.0 [2024-08-06 02:35:11,829][52649] Sum rewards: 82.584, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'AMMO2': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.168', 'weapon4': '0.206', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.000', 'weapon3': '3.258', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '66.000'} [2024-08-06 02:35:11,941][52671] DAMAGECOUNT value on done: 319641.0 [2024-08-06 02:35:11,943][52671] Sum rewards: 69.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.735', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:12,023][52803] DAMAGECOUNT value on done: 291128.0 [2024-08-06 02:35:12,024][52803] Sum rewards: 75.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.390', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.224', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:12,028][52668] DAMAGECOUNT value on done: 318446.0 [2024-08-06 02:35:12,030][52668] Sum rewards: 69.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.828', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'AMMO3': '0.312', 'WEAPON3': '1.900', 'weapon3': '3.230', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:12,149][52662] DAMAGECOUNT value on done: 313771.0 [2024-08-06 02:35:12,150][52662] Sum rewards: 61.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.482', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '52.000'} [2024-08-06 02:35:12,230][52811] DAMAGECOUNT value on done: 301324.0 [2024-08-06 02:35:12,232][52811] Sum rewards: 80.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.626', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.334', 'weapon2': '0.352', 'WEAPON3': '1.100', 'weapon3': '2.968', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 321241088. Throughput: 0: 4380.3. Samples: 80317840. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:12,794][52567] Avg episode reward: [(0, '67.660')] [2024-08-06 02:35:13,204][52660] DAMAGECOUNT value on done: 309922.0 [2024-08-06 02:35:13,205][52660] Sum rewards: 76.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.382', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:13,551][52669] DAMAGECOUNT value on done: 316416.0 [2024-08-06 02:35:13,552][52669] Sum rewards: 66.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.578', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.068', 'weapon2': '0.222', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'HITCOUNT': '3.320', 'weapon3': '3.564', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:13,770][52820] DAMAGECOUNT value on done: 288788.0 [2024-08-06 02:35:13,771][52820] Sum rewards: 66.070, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.984', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon2': '0.740', 'WEAPON3': '0.900', 'weapon3': '2.988', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '51.000'} [2024-08-06 02:35:13,800][52794] DAMAGECOUNT value on done: 318446.0 [2024-08-06 02:35:13,800][52794] Sum rewards: 64.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.994', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.086', 'weapon4': '0.102', 'AMMO4': '0.187', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:13,942][52658] DAMAGECOUNT value on done: 322173.0 [2024-08-06 02:35:13,942][52658] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.934', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.185', 'weapon5': '0.214', 'AMMO4': '0.235', 'weapon4': '0.236', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '57.500'} [2024-08-06 02:35:14,309][52671] DAMAGECOUNT value on done: 321051.0 [2024-08-06 02:35:14,310][52671] Sum rewards: 76.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.134', 'weapon4': '0.188', 'AMMO3': '0.200', 'AMMO4': '0.289', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:14,741][52649] DAMAGECOUNT value on done: 314450.0 [2024-08-06 02:35:14,743][52649] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.849', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.264', 'ARMOR': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:14,755][52668] DAMAGECOUNT value on done: 320137.0 [2024-08-06 02:35:14,755][52668] Sum rewards: 77.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.698', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.176', 'weapon4': '0.196', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:15,753][52650] Updated weights for policy 0, policy_version 39221 (0.0013) [2024-08-06 02:35:15,970][52660] DAMAGECOUNT value on done: 312663.0 [2024-08-06 02:35:15,971][52660] Sum rewards: 64.692, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.800', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '57.000'} [2024-08-06 02:35:16,495][52669] DAMAGECOUNT value on done: 319780.0 [2024-08-06 02:35:16,496][52669] Sum rewards: 70.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '3.320', 'weapon3': '3.400', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:16,948][52820] DAMAGECOUNT value on done: 294179.0 [2024-08-06 02:35:16,948][52820] Sum rewards: 65.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.583', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '55.500'} [2024-08-06 02:35:17,076][52794] DAMAGECOUNT value on done: 324187.0 [2024-08-06 02:35:17,077][52794] Sum rewards: 54.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.136', 'AMMO3': '0.183', 'AMMO4': '0.296', 'WEAPON5': '0.400', 'weapon2': '0.512', 'weapon4': '0.582', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.524', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '48.000'} [2024-08-06 02:35:17,166][52658] DAMAGECOUNT value on done: 312059.0 [2024-08-06 02:35:17,166][52658] Sum rewards: 74.775, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.404', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.094', 'weapon5': '0.144', 'AMMO3': '0.232', 'AMMO4': '0.242', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:17,384][52671] DAMAGECOUNT value on done: 319573.0 [2024-08-06 02:35:17,384][52671] Sum rewards: 65.140, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.835', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.104', 'weapon5': '0.202', 'AMMO4': '0.243', 'AMMO3': '0.287', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.008', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '58.500'} [2024-08-06 02:35:17,717][52668] DAMAGECOUNT value on done: 314196.0 [2024-08-06 02:35:17,717][52668] Sum rewards: 60.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.186', 'AMMO3': '0.223', 'weapon2': '0.382', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '52.000'} [2024-08-06 02:35:17,752][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:35:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 321323008. Throughput: 0: 4381.8. Samples: 80330920. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:17,795][52567] Avg episode reward: [(0, '67.669')] [2024-08-06 02:35:19,237][52660] DAMAGECOUNT value on done: 322818.0 [2024-08-06 02:35:19,240][52660] Sum rewards: 79.445, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.200', 'weapon5': '0.234', 'AMMO4': '0.241', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.546', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:19,377][52669] DAMAGECOUNT value on done: 323195.0 [2024-08-06 02:35:19,377][52669] Sum rewards: 77.541, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'HEALTH': '0.104', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '62.500'} [2024-08-06 02:35:19,815][52794] DAMAGECOUNT value on done: 321151.0 [2024-08-06 02:35:19,816][52794] Sum rewards: 58.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.246', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.340', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '51.000'} [2024-08-06 02:35:19,836][52658] DAMAGECOUNT value on done: 326585.0 [2024-08-06 02:35:19,836][52658] Sum rewards: 68.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.894', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.026', 'AMMO4': '0.107', 'weapon5': '0.180', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.224', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:20,010][52671] DAMAGECOUNT value on done: 326875.0 [2024-08-06 02:35:20,011][52671] Sum rewards: 67.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.841', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.108', 'weapon4': '0.130', 'AMMO4': '0.148', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:20,159][52820] DAMAGECOUNT value on done: 287835.0 [2024-08-06 02:35:20,160][52820] Sum rewards: 74.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.640', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.043', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon2': '0.190', 'WEAPON3': '0.950', 'HITCOUNT': '3.420', 'weapon3': '3.614', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:20,693][52650] Updated weights for policy 0, policy_version 39231 (0.0018) [2024-08-06 02:35:21,224][52662] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:35:22,018][52669] DAMAGECOUNT value on done: 333572.0 [2024-08-06 02:35:22,019][52669] Sum rewards: 73.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.672', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO3': '0.188', 'AMMO4': '0.201', 'weapon4': '0.280', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:22,456][52660] DAMAGECOUNT value on done: 325666.0 [2024-08-06 02:35:22,457][52660] Sum rewards: 69.020, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.158', 'HEALTH': '0.161', 'weapon2': '0.546', 'WEAPON3': '0.950', 'weapon3': '3.204', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:22,504][52658] DAMAGECOUNT value on done: 320091.0 [2024-08-06 02:35:22,504][52658] Sum rewards: 67.555, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.040', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.170', 'weapon2': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.328', 'WEAPON3': '1.950', 'weapon3': '3.306', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '61.000'} [2024-08-06 02:35:22,696][52794] DAMAGECOUNT value on done: 317324.0 [2024-08-06 02:35:22,696][52794] Sum rewards: 72.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.414', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.132', 'weapon4': '0.142', 'AMMO4': '0.158', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.302', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 321413120. Throughput: 0: 4384.7. Samples: 80357400. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:22,794][52567] Avg episode reward: [(0, '67.750')] [2024-08-06 02:35:22,961][52671] DAMAGECOUNT value on done: 317392.0 [2024-08-06 02:35:22,963][52671] Sum rewards: 58.097, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.500', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.148', 'AMMO4': '0.169', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.850', 'HITCOUNT': '3.110', 'weapon3': '3.122', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.500'} [2024-08-06 02:35:23,449][52820] DAMAGECOUNT value on done: 291250.0 [2024-08-06 02:35:23,450][52820] Sum rewards: 73.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.270', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:24,631][52669] DAMAGECOUNT value on done: 320358.0 [2024-08-06 02:35:24,634][52669] Sum rewards: 74.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.560', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.904', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:25,265][52650] Updated weights for policy 0, policy_version 39241 (0.0016) [2024-08-06 02:35:25,416][52794] DAMAGECOUNT value on done: 321461.0 [2024-08-06 02:35:25,416][52794] Sum rewards: 62.430, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.088', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.260', 'weapon5': '0.264', 'weapon2': '0.302', 'weapon4': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.714', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '55.000'} [2024-08-06 02:35:25,454][52660] DAMAGECOUNT value on done: 314034.0 [2024-08-06 02:35:25,454][52660] Sum rewards: 76.694, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.392', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.256', 'WEAPON3': '1.200', 'weapon3': '3.360', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '61.000'} [2024-08-06 02:35:25,521][52658] DAMAGECOUNT value on done: 327399.0 [2024-08-06 02:35:25,522][52658] Sum rewards: 63.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.102', 'weapon4': '0.122', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.910', 'weapon3': '3.276', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:25,739][52671] DAMAGECOUNT value on done: 322676.0 [2024-08-06 02:35:25,741][52671] Sum rewards: 76.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.596', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.080', 'weapon4': '0.084', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.360', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:26,533][52820] DAMAGECOUNT value on done: 296690.0 [2024-08-06 02:35:26,533][52820] Sum rewards: 66.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.500', 'weapon3': '2.840', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:27,541][52669] DAMAGECOUNT value on done: 322790.0 [2024-08-06 02:35:27,542][52669] Sum rewards: 68.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.161', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.187', 'AMMO4': '0.193', 'weapon4': '0.236', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.012', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:27,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 321495040. Throughput: 0: 4393.3. Samples: 80384090. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:27,795][52567] Avg episode reward: [(0, '67.947')] [2024-08-06 02:35:28,324][52660] DAMAGECOUNT value on done: 316443.0 [2024-08-06 02:35:28,326][52660] Sum rewards: 75.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.064', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 02:35:28,391][52794] DAMAGECOUNT value on done: 310957.0 [2024-08-06 02:35:28,391][52794] Sum rewards: 53.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.278', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.166', 'AMMO3': '0.216', 'AMMO4': '0.229', 'weapon4': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '2.866', 'DAMAGECOUNT': '13.779', 'FRAGCOUNT': '46.000'} [2024-08-06 02:35:28,478][52658] DAMAGECOUNT value on done: 311867.0 [2024-08-06 02:35:28,479][52658] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.128', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.052', 'weapon5': '0.164', 'AMMO3': '0.188', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '55.000'} [2024-08-06 02:35:28,567][52671] DAMAGECOUNT value on done: 322528.0 [2024-08-06 02:35:28,568][52671] Sum rewards: 75.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.126', 'weapon5': '0.128', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '61.500'} [2024-08-06 02:35:29,695][52820] DAMAGECOUNT value on done: 293453.0 [2024-08-06 02:35:29,696][52820] Sum rewards: 80.976, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.126', 'AMMO3': '0.148', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.484', 'weapon2': '0.576', 'WEAPON3': '0.850', 'weapon3': '2.962', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:30,020][52650] Updated weights for policy 0, policy_version 39251 (0.0032) [2024-08-06 02:35:30,314][52669] DAMAGECOUNT value on done: 321459.0 [2024-08-06 02:35:30,315][52669] Sum rewards: 81.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.506', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.133', 'AMMO3': '0.167', 'weapon4': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.050', 'weapon3': '3.198', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '65.500'} [2024-08-06 02:35:31,237][52794] DAMAGECOUNT value on done: 325942.0 [2024-08-06 02:35:31,238][52794] Sum rewards: 58.016, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.674', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.217', 'AMMO4': '0.263', 'weapon2': '0.300', 'weapon5': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.452', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '49.000'} [2024-08-06 02:35:31,298][52671] DAMAGECOUNT value on done: 314654.0 [2024-08-06 02:35:31,298][52671] Sum rewards: 63.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.908', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.192', 'weapon5': '0.212', 'AMMO4': '0.274', 'weapon2': '0.308', 'weapon4': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 02:35:31,447][52658] DAMAGECOUNT value on done: 320505.0 [2024-08-06 02:35:31,449][52658] Sum rewards: 72.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'weapon4': '0.174', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:31,463][52660] DAMAGECOUNT value on done: 310713.0 [2024-08-06 02:35:31,467][52660] Sum rewards: 79.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.235', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.120', 'weapon5': '0.144', 'AMMO4': '0.212', 'AMMO3': '0.234', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '67.000'} [2024-08-06 02:35:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 321585152. Throughput: 0: 4397.1. Samples: 80397240. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:32,794][52567] Avg episode reward: [(0, '68.444')] [2024-08-06 02:35:32,830][52820] DAMAGECOUNT value on done: 295605.0 [2024-08-06 02:35:32,839][52820] Sum rewards: 66.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.456', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.152', 'weapon4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '55.000'} [2024-08-06 02:35:33,001][52669] DAMAGECOUNT value on done: 324059.0 [2024-08-06 02:35:33,001][52669] Sum rewards: 67.094, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO2': '0.009', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon4': '0.194', 'AMMO3': '0.239', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '57.000'} [2024-08-06 02:35:34,004][52658] DAMAGECOUNT value on done: 318614.0 [2024-08-06 02:35:34,005][52658] Sum rewards: 76.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.515', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.242', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.438', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '65.000'} [2024-08-06 02:35:34,007][52794] DAMAGECOUNT value on done: 315105.0 [2024-08-06 02:35:34,008][52794] Sum rewards: 67.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.175', 'AMMO4': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '55.000'} [2024-08-06 02:35:34,425][52671] DAMAGECOUNT value on done: 322582.0 [2024-08-06 02:35:34,425][52671] Sum rewards: 63.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO4': '0.168', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '52.000'} [2024-08-06 02:35:34,543][52650] Updated weights for policy 0, policy_version 39261 (0.0013) [2024-08-06 02:35:34,584][52660] DAMAGECOUNT value on done: 320177.0 [2024-08-06 02:35:34,588][52660] Sum rewards: 64.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.224', 'weapon4': '0.224', 'weapon5': '0.242', 'AMMO4': '0.273', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '55.500'} [2024-08-06 02:35:36,030][52820] DAMAGECOUNT value on done: 294553.0 [2024-08-06 02:35:36,031][52820] Sum rewards: 57.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.522', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon5': '0.162', 'weapon4': '0.192', 'AMMO3': '0.219', 'AMMO4': '0.262', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.984', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '50.500'} [2024-08-06 02:35:36,733][52658] DAMAGECOUNT value on done: 314802.0 [2024-08-06 02:35:36,733][52658] Sum rewards: 60.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.062', 'weapon4': '0.134', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.310', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '50.000'} [2024-08-06 02:35:37,110][52794] DAMAGECOUNT value on done: 328950.0 [2024-08-06 02:35:37,110][52794] Sum rewards: 71.606, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.137', 'weapon5': '0.206', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:37,356][52671] DAMAGECOUNT value on done: 325050.0 [2024-08-06 02:35:37,357][52671] Sum rewards: 67.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.222', 'weapon5': '0.232', 'AMMO3': '0.237', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '58.000'} [2024-08-06 02:35:37,495][52660] DAMAGECOUNT value on done: 314248.0 [2024-08-06 02:35:37,495][52660] Sum rewards: 70.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.025', 'AMMO2': '0.038', 'weapon4': '0.104', 'weapon5': '0.178', 'AMMO4': '0.192', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 321675264. Throughput: 0: 4401.1. Samples: 80423510. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:37,795][52567] Avg episode reward: [(0, '68.486')] [2024-08-06 02:35:39,114][52658] DAMAGECOUNT value on done: 312552.0 [2024-08-06 02:35:39,114][52658] Sum rewards: 72.873, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.956', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.143', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '62.500'} [2024-08-06 02:35:39,204][52650] Updated weights for policy 0, policy_version 39271 (0.0013) [2024-08-06 02:35:39,344][52820] DAMAGECOUNT value on done: 295143.0 [2024-08-06 02:35:39,345][52820] Sum rewards: 50.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.725', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.064', 'AMMO3': '0.180', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.722', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.918', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '44.000'} [2024-08-06 02:35:40,194][52794] DAMAGECOUNT value on done: 320665.0 [2024-08-06 02:35:40,195][52794] Sum rewards: 81.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.435', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.090', 'weapon5': '0.150', 'AMMO4': '0.197', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.394', 'FRAGCOUNT': '67.500'} [2024-08-06 02:35:40,564][52803] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2024-08-06 02:35:40,724][52671] DAMAGECOUNT value on done: 319197.0 [2024-08-06 02:35:40,726][52671] Sum rewards: 65.599, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.793', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO3': '0.154', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.390', 'weapon2': '0.426', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '52.000'} [2024-08-06 02:35:41,873][52658] DAMAGECOUNT value on done: 324083.0 [2024-08-06 02:35:41,873][52658] Sum rewards: 64.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.525', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.078', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.288', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.402', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:42,572][52820] DAMAGECOUNT value on done: 296098.0 [2024-08-06 02:35:42,572][52820] Sum rewards: 63.803, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.180', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.112', 'AMMO4': '0.128', 'AMMO3': '0.176', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '51.000'} [2024-08-06 02:35:42,741][52794] DAMAGECOUNT value on done: 321328.0 [2024-08-06 02:35:42,741][52794] Sum rewards: 75.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.263', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.124', 'AMMO3': '0.198', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 321765376. Throughput: 0: 4398.2. Samples: 80449790. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:42,795][52567] Avg episode reward: [(0, '68.662')] [2024-08-06 02:35:43,702][52671] DAMAGECOUNT value on done: 329060.0 [2024-08-06 02:35:43,702][52671] Sum rewards: 63.173, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.432', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO4': '0.174', 'weapon4': '0.214', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:43,886][52650] Updated weights for policy 0, policy_version 39281 (0.0026) [2024-08-06 02:35:44,265][52658] DAMAGECOUNT value on done: 315924.0 [2024-08-06 02:35:44,275][52658] Sum rewards: 62.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.948', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.228', 'weapon2': '0.230', 'weapon5': '0.288', 'AMMO4': '0.293', 'weapon4': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '52.000'} [2024-08-06 02:35:45,519][52794] DAMAGECOUNT value on done: 330211.0 [2024-08-06 02:35:45,519][52794] Sum rewards: 77.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.599', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.122', 'AMMO4': '0.135', 'weapon5': '0.168', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:45,840][52820] DAMAGECOUNT value on done: 297007.0 [2024-08-06 02:35:45,841][52820] Sum rewards: 72.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.118', 'AMMO4': '0.146', 'weapon5': '0.162', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '59.500'} [2024-08-06 02:35:46,840][52671] DAMAGECOUNT value on done: 317083.0 [2024-08-06 02:35:46,841][52671] Sum rewards: 68.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.090', 'weapon5': '0.090', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.358', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:47,444][52658] DAMAGECOUNT value on done: 319683.0 [2024-08-06 02:35:47,444][52658] Sum rewards: 58.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.434', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.182', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.650', 'HITCOUNT': '3.110', 'weapon3': '3.208', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '51.500'} [2024-08-06 02:35:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 321847296. Throughput: 0: 4400.4. Samples: 80462900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:47,794][52567] Avg episode reward: [(0, '68.445')] [2024-08-06 02:35:48,472][52650] Updated weights for policy 0, policy_version 39291 (0.0021) [2024-08-06 02:35:48,524][52794] DAMAGECOUNT value on done: 319804.0 [2024-08-06 02:35:48,525][52794] Sum rewards: 68.028, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.672', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.102', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.284', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.204', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '59.000'} [2024-08-06 02:35:48,699][52666] DAMAGECOUNT value on done: 320339.0 [2024-08-06 02:35:48,700][52666] Sum rewards: 55.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO2': '0.002', 'AMMO5': '0.008', 'AMMO4': '0.010', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.586', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.066', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '46.000'} [2024-08-06 02:35:49,018][52820] DAMAGECOUNT value on done: 298782.0 [2024-08-06 02:35:49,018][52820] Sum rewards: 75.584, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.096', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.368', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '66.000'} [2024-08-06 02:35:49,581][52671] DAMAGECOUNT value on done: 312027.0 [2024-08-06 02:35:49,581][52671] Sum rewards: 80.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.174', 'weapon2': '0.188', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '65.000'} [2024-08-06 02:35:50,385][52658] DAMAGECOUNT value on done: 323299.0 [2024-08-06 02:35:50,385][52658] Sum rewards: 66.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.130', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.200', 'weapon5': '0.204', 'AMMO3': '0.235', 'AMMO4': '0.265', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '56.000'} [2024-08-06 02:35:51,630][52666] DAMAGECOUNT value on done: 322558.0 [2024-08-06 02:35:51,630][52666] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.435', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.094', 'AMMO4': '0.168', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.302', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '52.000'} [2024-08-06 02:35:51,800][52667] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.10200000000000001, -34.0), ('weapon5', 0.002)] [2024-08-06 02:35:52,264][52820] DAMAGECOUNT value on done: 295716.0 [2024-08-06 02:35:52,268][52820] Sum rewards: 66.078, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.872', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.046', 'AMMO4': '0.140', 'AMMO3': '0.152', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '3.060', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '53.000'} [2024-08-06 02:35:52,274][52671] DAMAGECOUNT value on done: 324922.0 [2024-08-06 02:35:52,277][52671] Sum rewards: 80.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.915', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.122', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 02:35:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 321937408. Throughput: 0: 4399.8. Samples: 80489420. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:52,794][52567] Avg episode reward: [(0, '68.782')] [2024-08-06 02:35:53,529][52650] Updated weights for policy 0, policy_version 39301 (0.0025) [2024-08-06 02:35:54,707][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:35:54,713][52671] DAMAGECOUNT value on done: 324969.0 [2024-08-06 02:35:54,718][52671] Sum rewards: 71.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:54,763][52666] DAMAGECOUNT value on done: 323850.0 [2024-08-06 02:35:54,763][52666] Sum rewards: 75.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.130', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '60.000'} [2024-08-06 02:35:54,962][52664] DAMAGECOUNT value on done: 331144.0 [2024-08-06 02:35:54,962][52664] Sum rewards: 78.147, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.457', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon4': '0.310', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '69.000'} [2024-08-06 02:35:55,349][52820] DAMAGECOUNT value on done: 291815.0 [2024-08-06 02:35:55,351][52820] Sum rewards: 75.803, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.058', 'weapon4': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '61.000'} [2024-08-06 02:35:56,031][52670] DAMAGECOUNT value on done: 316085.0 [2024-08-06 02:35:56,033][52670] Sum rewards: 73.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.186', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.048', 'weapon4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.211', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '62.000'} [2024-08-06 02:35:57,578][52671] DAMAGECOUNT value on done: 326488.0 [2024-08-06 02:35:57,578][52671] Sum rewards: 64.640, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.160', 'weapon2': '0.184', 'weapon5': '0.184', 'AMMO3': '0.206', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.214', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '54.000'} [2024-08-06 02:35:57,783][52659] DAMAGECOUNT value on done: 322271.0 [2024-08-06 02:35:57,783][52659] Sum rewards: 77.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.745', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.144', 'weapon2': '0.150', 'AMMO4': '0.225', 'weapon4': '0.236', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '64.000'} [2024-08-06 02:35:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 322027520. Throughput: 0: 4399.6. Samples: 80515820. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 02:35:57,794][52567] Avg episode reward: [(0, '69.076')] [2024-08-06 02:35:57,798][52614] Saving new best policy, reward=69.076! [2024-08-06 02:35:57,832][52666] DAMAGECOUNT value on done: 318404.0 [2024-08-06 02:35:57,834][52666] Sum rewards: 61.850, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.839', 'AMMO5': '0.022', 'AMMO2': '0.065', 'weapon4': '0.192', 'AMMO3': '0.238', 'weapon5': '0.276', 'AMMO4': '0.327', 'weapon2': '0.426', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.692', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '53.000'} [2024-08-06 02:35:58,039][52650] Updated weights for policy 0, policy_version 39311 (0.0028) [2024-08-06 02:35:58,130][52664] DAMAGECOUNT value on done: 331734.0 [2024-08-06 02:35:58,132][52664] Sum rewards: 78.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.481', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.101', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '65.000'} [2024-08-06 02:35:58,471][52820] DAMAGECOUNT value on done: 302807.0 [2024-08-06 02:35:58,473][52820] Sum rewards: 70.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.178', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.704', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '57.000'} [2024-08-06 02:35:59,259][52670] DAMAGECOUNT value on done: 319432.0 [2024-08-06 02:35:59,260][52670] Sum rewards: 74.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.179', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '61.000'} [2024-08-06 02:36:00,636][52666] DAMAGECOUNT value on done: 315086.0 [2024-08-06 02:36:00,636][52666] Sum rewards: 70.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.042', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.406', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:00,749][52671] DAMAGECOUNT value on done: 319575.0 [2024-08-06 02:36:00,751][52671] Sum rewards: 77.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.207', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '63.000'} [2024-08-06 02:36:00,837][52664] DAMAGECOUNT value on done: 333430.0 [2024-08-06 02:36:00,838][52664] Sum rewards: 64.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.810', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.216', 'AMMO3': '0.252', 'weapon2': '0.252', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'weapon4': '0.574', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.646', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:00,988][52659] DAMAGECOUNT value on done: 319300.0 [2024-08-06 02:36:00,990][52659] Sum rewards: 68.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.044', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:01,611][52670] DAMAGECOUNT value on done: 313384.0 [2024-08-06 02:36:01,611][52670] Sum rewards: 73.200, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.319', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.085', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '59.000'} [2024-08-06 02:36:01,612][52820] DAMAGECOUNT value on done: 305273.0 [2024-08-06 02:36:01,613][52820] Sum rewards: 77.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.797', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.208', 'weapon5': '0.228', 'AMMO4': '0.242', 'AMMO3': '0.247', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '66.000'} [2024-08-06 02:36:02,608][52650] Updated weights for policy 0, policy_version 39321 (0.0012) [2024-08-06 02:36:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 322117632. Throughput: 0: 4392.9. Samples: 80528600. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:36:02,794][52567] Avg episode reward: [(0, '69.748')] [2024-08-06 02:36:02,795][52614] Saving new best policy, reward=69.748! [2024-08-06 02:36:03,520][52666] DAMAGECOUNT value on done: 309964.0 [2024-08-06 02:36:03,521][52666] Sum rewards: 62.643, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.566', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.154', 'weapon5': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.018', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:03,587][52671] DAMAGECOUNT value on done: 317679.0 [2024-08-06 02:36:03,588][52671] Sum rewards: 66.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.573', 'AMMO5': '0.012', 'AMMO2': '0.064', 'weapon5': '0.092', 'AMMO3': '0.185', 'weapon4': '0.278', 'WEAPON5': '0.300', 'AMMO4': '0.321', 'weapon2': '0.364', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 02:36:03,639][52664] DAMAGECOUNT value on done: 329289.0 [2024-08-06 02:36:03,640][52664] Sum rewards: 66.893, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.032', 'HEALTH': '0.080', 'AMMO4': '0.162', 'AMMO3': '0.180', 'weapon2': '0.210', 'weapon5': '0.216', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.048', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '53.000'} [2024-08-06 02:36:03,751][52659] DAMAGECOUNT value on done: 319674.0 [2024-08-06 02:36:03,751][52659] Sum rewards: 59.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.192', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.442', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.480', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '51.000'} [2024-08-06 02:36:04,816][52820] DAMAGECOUNT value on done: 293919.0 [2024-08-06 02:36:04,816][52820] Sum rewards: 68.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.776', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.136', 'weapon5': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:04,885][52670] DAMAGECOUNT value on done: 311209.0 [2024-08-06 02:36:04,886][52670] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.066', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.158', 'AMMO4': '0.191', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.592', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.274', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '57.000'} [2024-08-06 02:36:06,551][52664] DAMAGECOUNT value on done: 329730.0 [2024-08-06 02:36:06,551][52664] Sum rewards: 62.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.658', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon2': '0.250', 'AMMO3': '0.274', 'WEAPON3': '1.750', 'HITCOUNT': '3.330', 'weapon3': '3.420', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:06,695][52666] DAMAGECOUNT value on done: 319778.0 [2024-08-06 02:36:06,697][52666] Sum rewards: 77.891, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'weapon4': '0.118', 'AMMO4': '0.118', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '64.000'} [2024-08-06 02:36:06,708][52659] DAMAGECOUNT value on done: 320420.0 [2024-08-06 02:36:06,708][52659] Sum rewards: 80.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.657', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.332', 'weapon4': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 02:36:07,368][52650] Updated weights for policy 0, policy_version 39331 (0.0023) [2024-08-06 02:36:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 322199552. Throughput: 0: 4382.9. Samples: 80554630. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:36:07,794][52567] Avg episode reward: [(0, '69.343')] [2024-08-06 02:36:07,829][52670] DAMAGECOUNT value on done: 324191.0 [2024-08-06 02:36:07,829][52670] Sum rewards: 81.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.475', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.232', 'weapon2': '0.248', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.525', 'FRAGCOUNT': '66.000'} [2024-08-06 02:36:08,906][52664] DAMAGECOUNT value on done: 330778.0 [2024-08-06 02:36:08,907][52664] Sum rewards: 59.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.333', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.130', 'AMMO4': '0.161', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.226', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '51.000'} [2024-08-06 02:36:09,626][52666] DAMAGECOUNT value on done: 316853.0 [2024-08-06 02:36:09,627][52666] Sum rewards: 67.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.976', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.360', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:09,794][52659] DAMAGECOUNT value on done: 313691.0 [2024-08-06 02:36:09,795][52659] Sum rewards: 53.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.304', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.119', 'weapon4': '0.196', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '3.234', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '47.000'} [2024-08-06 02:36:10,662][52670] DAMAGECOUNT value on done: 316747.0 [2024-08-06 02:36:10,663][52670] Sum rewards: 63.558, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.586', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.276', 'weapon2': '0.598', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:11,524][52664] DAMAGECOUNT value on done: 332505.0 [2024-08-06 02:36:11,524][52664] Sum rewards: 57.369, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.332', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.148', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '47.000'} [2024-08-06 02:36:11,929][52650] Updated weights for policy 0, policy_version 39341 (0.0025) [2024-08-06 02:36:12,173][52666] DAMAGECOUNT value on done: 314230.0 [2024-08-06 02:36:12,175][52666] Sum rewards: 72.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.038', 'weapon4': '0.058', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'HITCOUNT': '3.420', 'weapon3': '3.560', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '60.000'} [2024-08-06 02:36:12,724][52659] DAMAGECOUNT value on done: 319012.0 [2024-08-06 02:36:12,724][52659] Sum rewards: 78.677, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.942', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.068', 'AMMO4': '0.119', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '67.500'} [2024-08-06 02:36:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 322297856. Throughput: 0: 4380.7. Samples: 80581220. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:36:12,794][52567] Avg episode reward: [(0, '69.095')] [2024-08-06 02:36:13,123][52670] DAMAGECOUNT value on done: 311034.0 [2024-08-06 02:36:13,125][52670] Sum rewards: 54.103, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.174', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.122', 'weapon5': '0.210', 'AMMO4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.928', 'weapon3': '2.130', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.050', 'FRAGCOUNT': '42.000'} [2024-08-06 02:36:14,657][52664] DAMAGECOUNT value on done: 323325.0 [2024-08-06 02:36:14,658][52664] Sum rewards: 52.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon4': '0.138', 'weapon5': '0.220', 'AMMO3': '0.233', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '2.834', 'DAMAGECOUNT': '12.969', 'FRAGCOUNT': '47.000'} [2024-08-06 02:36:14,757][52666] DAMAGECOUNT value on done: 313774.0 [2024-08-06 02:36:14,757][52666] Sum rewards: 58.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '3.418', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '52.000'} [2024-08-06 02:36:14,827][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:36:15,687][52659] DAMAGECOUNT value on done: 320659.0 [2024-08-06 02:36:15,688][52659] Sum rewards: 66.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.060', 'weapon4': '0.146', 'weapon5': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.260', 'AMMO4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '58.000'} [2024-08-06 02:36:16,007][52670] DAMAGECOUNT value on done: 313956.0 [2024-08-06 02:36:16,008][52670] Sum rewards: 64.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.639', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '2.900', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:16,496][52650] Updated weights for policy 0, policy_version 39351 (0.0018) [2024-08-06 02:36:17,162][52664] DAMAGECOUNT value on done: 337194.0 [2024-08-06 02:36:17,163][52664] Sum rewards: 64.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.308', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO4': '0.199', 'AMMO3': '0.201', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.734', 'WEAPON3': '1.150', 'weapon3': '2.628', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '54.000'} [2024-08-06 02:36:17,750][52666] DAMAGECOUNT value on done: 312972.0 [2024-08-06 02:36:17,751][52666] Sum rewards: 67.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.160', 'AMMO3': '0.203', 'AMMO4': '0.256', 'weapon2': '0.308', 'WEAPON5': '0.400', 'weapon4': '0.456', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 322379776. Throughput: 0: 4384.9. Samples: 80594560. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:36:17,794][52567] Avg episode reward: [(0, '68.608')] [2024-08-06 02:36:17,803][52660] Large shaping reward 2.503 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('weapon5', 0.002)] [2024-08-06 02:36:18,270][52659] DAMAGECOUNT value on done: 315571.0 [2024-08-06 02:36:18,271][52659] Sum rewards: 52.649, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.770', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.082', 'AMMO4': '0.141', 'weapon5': '0.148', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '2.988', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '47.000'} [2024-08-06 02:36:19,093][52670] DAMAGECOUNT value on done: 314561.0 [2024-08-06 02:36:19,094][52670] Sum rewards: 63.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.195', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.132', 'AMMO4': '0.169', 'weapon4': '0.206', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '53.500'} [2024-08-06 02:36:20,052][52664] DAMAGECOUNT value on done: 329843.0 [2024-08-06 02:36:20,061][52664] Sum rewards: 76.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.153', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.230', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '63.000'} [2024-08-06 02:36:20,251][52663] DAMAGECOUNT value on done: 324573.0 [2024-08-06 02:36:20,251][52663] Sum rewards: 68.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '58.000'} [2024-08-06 02:36:20,414][52660] Large shaping reward 2.525 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47400000000000003, 158.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:36:20,915][52666] DAMAGECOUNT value on done: 310923.0 [2024-08-06 02:36:20,916][52666] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.781', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.174', 'AMMO3': '0.216', 'weapon4': '0.216', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:21,362][52650] Updated weights for policy 0, policy_version 39361 (0.0028) [2024-08-06 02:36:21,475][52659] DAMAGECOUNT value on done: 327502.0 [2024-08-06 02:36:21,477][52659] Sum rewards: 74.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.034', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.192', 'weapon4': '0.234', 'AMMO3': '0.247', 'AMMO4': '0.252', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.500'} [2024-08-06 02:36:21,909][52670] DAMAGECOUNT value on done: 308455.0 [2024-08-06 02:36:21,911][52670] Sum rewards: 67.182, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.610', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.096', 'weapon2': '0.256', 'AMMO3': '0.320', 'WEAPON3': '1.750', 'HITCOUNT': '3.390', 'weapon3': '3.466', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '60.000'} [2024-08-06 02:36:22,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 322469888. Throughput: 0: 4386.0. Samples: 80620880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:36:22,795][52567] Avg episode reward: [(0, '68.498')] [2024-08-06 02:36:22,974][52663] DAMAGECOUNT value on done: 316617.0 [2024-08-06 02:36:22,976][52663] Sum rewards: 69.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.611', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.226', 'weapon2': '0.312', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '59.000'} [2024-08-06 02:36:23,159][52664] DAMAGECOUNT value on done: 334015.0 [2024-08-06 02:36:23,161][52664] Sum rewards: 70.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.187', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.186', 'AMMO4': '0.201', 'AMMO3': '0.243', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 02:36:23,691][52666] DAMAGECOUNT value on done: 321806.0 [2024-08-06 02:36:23,698][52666] Sum rewards: 73.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.115', 'AMMO5': '0.019', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.152', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.408', 'weapon4': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.734', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '58.000'} [2024-08-06 02:36:24,518][52659] DAMAGECOUNT value on done: 325551.0 [2024-08-06 02:36:24,518][52659] Sum rewards: 72.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '63.000'} [2024-08-06 02:36:24,794][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:36:24,830][52670] DAMAGECOUNT value on done: 323391.0 [2024-08-06 02:36:24,832][52670] Sum rewards: 73.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.078', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.322', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '62.500'} [2024-08-06 02:36:25,679][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:36:25,885][52650] Updated weights for policy 0, policy_version 39371 (0.0024) [2024-08-06 02:36:26,158][52663] DAMAGECOUNT value on done: 317767.0 [2024-08-06 02:36:26,160][52663] Sum rewards: 71.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.601', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.432', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '61.000'} [2024-08-06 02:36:26,179][52664] DAMAGECOUNT value on done: 330822.0 [2024-08-06 02:36:26,179][52664] Sum rewards: 57.968, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.580', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.264', 'weapon4': '0.272', 'AMMO3': '0.279', 'WEAPON3': '1.650', 'weapon3': '3.156', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '53.000'} [2024-08-06 02:36:26,731][52666] DAMAGECOUNT value on done: 319954.0 [2024-08-06 02:36:26,734][52666] Sum rewards: 47.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.165', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.142', 'AMMO3': '0.203', 'AMMO4': '0.290', 'weapon4': '0.304', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.360', 'weapon3': '2.904', 'DAMAGECOUNT': '13.647', 'FRAGCOUNT': '41.000'} [2024-08-06 02:36:27,083][52659] DAMAGECOUNT value on done: 319254.0 [2024-08-06 02:36:27,084][52659] Sum rewards: 69.074, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.880', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.045', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO4': '0.223', 'AMMO3': '0.296', 'WEAPON3': '1.850', 'HITCOUNT': '3.280', 'weapon3': '3.414', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '62.000'} [2024-08-06 02:36:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 322551808. Throughput: 0: 4387.8. Samples: 80647240. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:36:27,794][52567] Avg episode reward: [(0, '68.318')] [2024-08-06 02:36:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039374_322551808.pth... [2024-08-06 02:36:27,943][52670] DAMAGECOUNT value on done: 316654.0 [2024-08-06 02:36:27,943][52670] Sum rewards: 72.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.170', 'AMMO4': '0.238', 'weapon5': '0.286', 'weapon2': '0.298', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '60.000'} [2024-08-06 02:36:27,948][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000038861_318349312.pth [2024-08-06 02:36:28,942][52664] DAMAGECOUNT value on done: 338881.0 [2024-08-06 02:36:28,943][52664] Sum rewards: 72.515, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.462', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon2': '0.278', 'AMMO3': '0.313', 'WEAPON3': '1.750', 'weapon3': '3.232', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '63.000'} [2024-08-06 02:36:29,643][52663] DAMAGECOUNT value on done: 319971.0 [2024-08-06 02:36:29,643][52663] Sum rewards: 66.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.139', 'weapon2': '0.204', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.436', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '58.000'} [2024-08-06 02:36:29,778][52659] DAMAGECOUNT value on done: 322676.0 [2024-08-06 02:36:29,780][52659] Sum rewards: 71.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.968', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '3.216', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '57.000'} [2024-08-06 02:36:29,810][52666] DAMAGECOUNT value on done: 316524.0 [2024-08-06 02:36:29,812][52666] Sum rewards: 68.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.037', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.225', 'weapon2': '0.236', 'weapon5': '0.236', 'AMMO4': '0.260', 'weapon4': '0.282', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '58.000'} [2024-08-06 02:36:31,045][52670] DAMAGECOUNT value on done: 317611.0 [2024-08-06 02:36:31,045][52670] Sum rewards: 68.340, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.636', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO4': '0.167', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.600', 'weapon3': '3.042', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '60.000'} [2024-08-06 02:36:31,053][52650] Updated weights for policy 0, policy_version 39381 (0.0012) [2024-08-06 02:36:31,699][52664] DAMAGECOUNT value on done: 330428.0 [2024-08-06 02:36:31,699][52664] Sum rewards: 56.496, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.815', 'AMMO5': '0.026', 'AMMO2': '0.074', 'AMMO3': '0.240', 'weapon5': '0.306', 'weapon4': '0.320', 'AMMO4': '0.370', 'weapon2': '0.418', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.504', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '49.000'} [2024-08-06 02:36:32,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 322641920. Throughput: 0: 4387.1. Samples: 80660320. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:36:32,794][52567] Avg episode reward: [(0, '68.051')] [2024-08-06 02:36:32,815][52666] DAMAGECOUNT value on done: 318466.0 [2024-08-06 02:36:32,819][52666] Sum rewards: 72.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.044', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.120', 'AMMO3': '0.210', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.370', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.000'} [2024-08-06 02:36:32,843][52663] DAMAGECOUNT value on done: 319336.0 [2024-08-06 02:36:32,845][52663] Sum rewards: 64.676, reward structure: {'DEATHCOUNT': '-17.250', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon4': '0.118', 'weapon5': '0.124', 'AMMO4': '0.153', 'HEALTH': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '57.000'} [2024-08-06 02:36:32,956][52659] DAMAGECOUNT value on done: 311483.0 [2024-08-06 02:36:32,956][52659] Sum rewards: 71.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.701', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '62.000'} [2024-08-06 02:36:34,057][52670] DAMAGECOUNT value on done: 321676.0 [2024-08-06 02:36:34,059][52670] Sum rewards: 73.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.215', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.239', 'weapon2': '0.288', 'WEAPON3': '1.500', 'weapon3': '3.544', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '61.000'} [2024-08-06 02:36:34,724][52664] DAMAGECOUNT value on done: 337851.0 [2024-08-06 02:36:34,725][52664] Sum rewards: 71.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.741', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.194', 'AMMO3': '0.201', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '57.500'} [2024-08-06 02:36:35,036][52650] Updated weights for policy 0, policy_version 39391 (0.0020) [2024-08-06 02:36:35,676][52663] DAMAGECOUNT value on done: 323613.0 [2024-08-06 02:36:35,677][52663] Sum rewards: 64.574, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO3': '0.168', 'AMMO4': '0.179', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.762', 'WEAPON3': '1.150', 'weapon3': '2.616', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '51.000'} [2024-08-06 02:36:35,903][52666] DAMAGECOUNT value on done: 316033.0 [2024-08-06 02:36:35,905][52666] Sum rewards: 71.910, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'HEALTH': '0.262', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '57.000'} [2024-08-06 02:36:36,238][52659] DAMAGECOUNT value on done: 321788.0 [2024-08-06 02:36:36,242][52659] Sum rewards: 73.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.205', 'weapon4': '0.308', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '61.000'} [2024-08-06 02:36:37,057][52670] DAMAGECOUNT value on done: 319411.0 [2024-08-06 02:36:37,059][52670] Sum rewards: 66.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.984', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon4': '0.084', 'WEAPON4': '0.150', 'weapon2': '0.220', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.456', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '59.000'} [2024-08-06 02:36:37,114][52664] DAMAGECOUNT value on done: 326823.0 [2024-08-06 02:36:37,114][52664] Sum rewards: 65.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.525', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.132', 'weapon4': '0.150', 'AMMO3': '0.244', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.212', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '57.000'} [2024-08-06 02:36:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 322732032. Throughput: 0: 4382.7. Samples: 80686640. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:36:37,794][52567] Avg episode reward: [(0, '68.213')] [2024-08-06 02:36:38,759][52666] DAMAGECOUNT value on done: 318942.0 [2024-08-06 02:36:38,761][52666] Sum rewards: 83.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.009', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.044', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '68.000'} [2024-08-06 02:36:39,088][52663] DAMAGECOUNT value on done: 319228.0 [2024-08-06 02:36:39,088][52663] Sum rewards: 63.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.238', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '2.960', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:39,307][52659] DAMAGECOUNT value on done: 327244.0 [2024-08-06 02:36:39,309][52659] Sum rewards: 66.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.353', 'AMMO5': '0.010', 'weapon4': '0.038', 'AMMO2': '0.045', 'weapon2': '0.178', 'weapon5': '0.206', 'AMMO4': '0.223', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.348', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:39,955][52670] DAMAGECOUNT value on done: 305197.0 [2024-08-06 02:36:39,955][52670] Sum rewards: 71.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.102', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.410', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:40,206][52650] Updated weights for policy 0, policy_version 39401 (0.0017) [2024-08-06 02:36:40,347][52664] DAMAGECOUNT value on done: 332236.0 [2024-08-06 02:36:40,347][52664] Sum rewards: 57.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.620', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.200', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '50.000'} [2024-08-06 02:36:41,592][52666] DAMAGECOUNT value on done: 309909.0 [2024-08-06 02:36:41,596][52666] Sum rewards: 67.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.006', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.162', 'weapon2': '0.198', 'AMMO3': '0.241', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.144', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '58.000'} [2024-08-06 02:36:41,734][52663] DAMAGECOUNT value on done: 316789.0 [2024-08-06 02:36:41,734][52663] Sum rewards: 63.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO3': '0.184', 'AMMO4': '0.194', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '2.980', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '51.000'} [2024-08-06 02:36:42,023][52671] Large shaping reward 2.682 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', 0.05, 10.0), ('weapon5', 0.002)] [2024-08-06 02:36:42,153][52659] DAMAGECOUNT value on done: 328693.0 [2024-08-06 02:36:42,157][52659] Sum rewards: 65.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.166', 'AMMO4': '0.189', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.340', 'WEAPON4': '0.450', 'weapon2': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.640', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '54.500'} [2024-08-06 02:36:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 322813952. Throughput: 0: 4378.9. Samples: 80712870. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:36:42,794][52567] Avg episode reward: [(0, '68.254')] [2024-08-06 02:36:42,807][52670] DAMAGECOUNT value on done: 319213.0 [2024-08-06 02:36:42,808][52670] Sum rewards: 78.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.376', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '66.000'} [2024-08-06 02:36:43,161][52664] DAMAGECOUNT value on done: 332060.0 [2024-08-06 02:36:43,161][52664] Sum rewards: 60.394, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.130', 'AMMO4': '0.176', 'weapon5': '0.214', 'weapon2': '0.234', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '3.082', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '54.000'} [2024-08-06 02:36:44,529][52666] DAMAGECOUNT value on done: 318977.0 [2024-08-06 02:36:44,529][52666] Sum rewards: 60.433, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.184', 'AMMO4': '0.198', 'weapon2': '0.254', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.202', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '53.000'} [2024-08-06 02:36:44,742][52663] DAMAGECOUNT value on done: 317535.0 [2024-08-06 02:36:44,743][52663] Sum rewards: 64.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.223', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.112', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon2': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.586', 'WEAPON3': '0.800', 'weapon3': '2.888', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 02:36:45,023][52650] Updated weights for policy 0, policy_version 39411 (0.0025) [2024-08-06 02:36:45,274][52659] DAMAGECOUNT value on done: 323233.0 [2024-08-06 02:36:45,275][52659] Sum rewards: 66.826, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.626', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.093', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.338', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '54.000'} [2024-08-06 02:36:45,805][52670] DAMAGECOUNT value on done: 326261.0 [2024-08-06 02:36:45,808][52670] Sum rewards: 70.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.627', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon2': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon4': '0.494', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '58.000'} [2024-08-06 02:36:45,828][52664] DAMAGECOUNT value on done: 332951.0 [2024-08-06 02:36:45,828][52664] Sum rewards: 67.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.779', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon2': '0.278', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.142', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:46,060][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:36:46,854][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:36:47,702][52663] DAMAGECOUNT value on done: 320314.0 [2024-08-06 02:36:47,705][52663] Sum rewards: 61.689, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.092', 'weapon5': '0.196', 'AMMO3': '0.234', 'AMMO4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '2.878', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:47,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 322904064. Throughput: 0: 4389.1. Samples: 80726110. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:36:47,795][52567] Avg episode reward: [(0, '68.094')] [2024-08-06 02:36:48,139][52659] DAMAGECOUNT value on done: 319116.0 [2024-08-06 02:36:48,140][52659] Sum rewards: 61.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.928', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon4': '0.296', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '49.000'} [2024-08-06 02:36:48,382][52664] DAMAGECOUNT value on done: 332656.0 [2024-08-06 02:36:48,385][52664] Sum rewards: 63.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.307', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '54.000'} [2024-08-06 02:36:48,724][52670] DAMAGECOUNT value on done: 316993.0 [2024-08-06 02:36:48,724][52670] Sum rewards: 62.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.600', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon2': '0.178', 'weapon4': '0.232', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.282', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:49,408][52650] Updated weights for policy 0, policy_version 39421 (0.0017) [2024-08-06 02:36:50,284][52663] DAMAGECOUNT value on done: 321934.0 [2024-08-06 02:36:50,292][52663] Sum rewards: 63.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.776', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '2.898', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:50,770][52659] DAMAGECOUNT value on done: 322544.0 [2024-08-06 02:36:50,770][52659] Sum rewards: 65.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.397', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.148', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:51,514][52670] DAMAGECOUNT value on done: 318254.0 [2024-08-06 02:36:51,514][52670] Sum rewards: 62.025, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.365', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.174', 'weapon5': '0.210', 'AMMO3': '0.248', 'AMMO4': '0.269', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.550', 'weapon3': '2.832', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '53.000'} [2024-08-06 02:36:51,947][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:36:52,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 322994176. Throughput: 0: 4396.8. Samples: 80752490. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:36:52,795][52567] Avg episode reward: [(0, '67.811')] [2024-08-06 02:36:52,890][52663] DAMAGECOUNT value on done: 318828.0 [2024-08-06 02:36:52,890][52663] Sum rewards: 74.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.374', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.178', 'AMMO3': '0.219', 'weapon5': '0.226', 'AMMO4': '0.254', 'weapon2': '0.328', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 02:36:53,452][52659] DAMAGECOUNT value on done: 325271.0 [2024-08-06 02:36:53,454][52659] Sum rewards: 64.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.628', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.180', 'weapon2': '0.236', 'AMMO3': '0.237', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '55.000'} [2024-08-06 02:36:53,970][52650] Updated weights for policy 0, policy_version 39431 (0.0042) [2024-08-06 02:36:55,164][52668] Large shaping reward 3.503 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('weapon5', 0.002)] [2024-08-06 02:36:55,617][52663] DAMAGECOUNT value on done: 312584.0 [2024-08-06 02:36:55,618][52663] Sum rewards: 70.163, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.586', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.154', 'AMMO3': '0.166', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.410', 'WEAPON3': '0.950', 'weapon3': '2.862', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '57.000'} [2024-08-06 02:36:57,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 323084288. Throughput: 0: 4390.4. Samples: 80778790. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:36:57,795][52567] Avg episode reward: [(0, '67.786')] [2024-08-06 02:36:58,322][52663] DAMAGECOUNT value on done: 314479.0 [2024-08-06 02:36:58,322][52663] Sum rewards: 67.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '3.158', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '56.000'} [2024-08-06 02:36:58,820][52650] Updated weights for policy 0, policy_version 39441 (0.0030) [2024-08-06 02:36:59,293][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:37:00,959][52663] DAMAGECOUNT value on done: 316261.0 [2024-08-06 02:37:00,967][52663] Sum rewards: 65.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.096', 'weapon4': '0.128', 'AMMO4': '0.167', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.268', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:02,211][52614] Signal inference workers to stop experience collection... (7100 times) [2024-08-06 02:37:02,223][52614] Signal inference workers to resume experience collection... (7100 times) [2024-08-06 02:37:02,271][52650] InferenceWorker_p0-w0: stopping experience collection (7100 times) [2024-08-06 02:37:02,272][52650] InferenceWorker_p0-w0: resuming experience collection (7100 times) [2024-08-06 02:37:02,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 323174400. Throughput: 0: 4385.8. Samples: 80791920. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:37:02,794][52567] Avg episode reward: [(0, '67.741')] [2024-08-06 02:37:03,455][52650] Updated weights for policy 0, policy_version 39451 (0.0015) [2024-08-06 02:37:04,058][52663] DAMAGECOUNT value on done: 324106.0 [2024-08-06 02:37:04,059][52663] Sum rewards: 61.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.064', 'weapon4': '0.118', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '2.984', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '52.500'} [2024-08-06 02:37:07,076][52663] DAMAGECOUNT value on done: 319214.0 [2024-08-06 02:37:07,076][52663] Sum rewards: 67.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.180', 'AMMO4': '0.191', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 323256320. Throughput: 0: 4385.1. Samples: 80818210. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:37:07,802][52567] Avg episode reward: [(0, '67.492')] [2024-08-06 02:37:08,292][52650] Updated weights for policy 0, policy_version 39461 (0.0013) [2024-08-06 02:37:09,445][52647] DAMAGECOUNT value on done: 338084.0 [2024-08-06 02:37:09,445][52647] Sum rewards: 79.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '66.000'} [2024-08-06 02:37:10,401][52663] DAMAGECOUNT value on done: 325655.0 [2024-08-06 02:37:10,401][52663] Sum rewards: 69.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.148', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON4': '0.400', 'weapon4': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:12,303][52667] DAMAGECOUNT value on done: 320295.0 [2024-08-06 02:37:12,311][52667] Sum rewards: 55.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.092', 'AMMO4': '0.104', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.272', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '45.500'} [2024-08-06 02:37:12,597][52647] DAMAGECOUNT value on done: 336628.0 [2024-08-06 02:37:12,597][52647] Sum rewards: 51.838, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.128', 'AMMO3': '0.155', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '0.900', 'weapon4': '1.058', 'weapon3': '2.238', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '41.000'} [2024-08-06 02:37:12,688][52650] Updated weights for policy 0, policy_version 39471 (0.0024) [2024-08-06 02:37:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 323346432. Throughput: 0: 4368.7. Samples: 80843830. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:37:12,794][52567] Avg episode reward: [(0, '67.145')] [2024-08-06 02:37:13,452][52663] DAMAGECOUNT value on done: 322133.0 [2024-08-06 02:37:13,453][52663] Sum rewards: 58.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.804', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.084', 'AMMO3': '0.166', 'AMMO4': '0.167', 'weapon5': '0.214', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '3.144', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '47.000'} [2024-08-06 02:37:15,033][52667] DAMAGECOUNT value on done: 324950.0 [2024-08-06 02:37:15,034][52667] Sum rewards: 67.068, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.372', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.156', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:15,472][52647] DAMAGECOUNT value on done: 337602.0 [2024-08-06 02:37:15,474][52647] Sum rewards: 63.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.214', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.086', 'weapon5': '0.184', 'AMMO4': '0.208', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.926', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '52.000'} [2024-08-06 02:37:16,325][52663] DAMAGECOUNT value on done: 314689.0 [2024-08-06 02:37:16,325][52663] Sum rewards: 71.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.615', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.201', 'weapon4': '0.260', 'WEAPON4': '0.400', 'weapon2': '0.716', 'WEAPON3': '1.200', 'weapon3': '2.766', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '58.000'} [2024-08-06 02:37:17,509][52650] Updated weights for policy 0, policy_version 39481 (0.0012) [2024-08-06 02:37:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 323436544. Throughput: 0: 4374.2. Samples: 80857160. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 02:37:17,795][52567] Avg episode reward: [(0, '66.903')] [2024-08-06 02:37:18,081][52667] DAMAGECOUNT value on done: 321692.0 [2024-08-06 02:37:18,082][52667] Sum rewards: 49.719, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.305', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.048', 'weapon4': '0.072', 'AMMO4': '0.217', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.232', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '45.500'} [2024-08-06 02:37:18,328][52647] DAMAGECOUNT value on done: 341016.0 [2024-08-06 02:37:18,329][52647] Sum rewards: 62.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.178', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon4': '0.158', 'AMMO3': '0.188', 'weapon5': '0.192', 'AMMO4': '0.303', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '52.000'} [2024-08-06 02:37:20,019][52665] DAMAGECOUNT value on done: 315401.0 [2024-08-06 02:37:20,021][52665] Sum rewards: 77.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.101', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '65.000'} [2024-08-06 02:37:20,846][52667] DAMAGECOUNT value on done: 322232.0 [2024-08-06 02:37:20,848][52667] Sum rewards: 63.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.322', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.144', 'weapon5': '0.182', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '2.874', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '54.500'} [2024-08-06 02:37:21,024][52647] DAMAGECOUNT value on done: 337688.0 [2024-08-06 02:37:21,024][52647] Sum rewards: 60.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.645', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.122', 'AMMO4': '0.217', 'AMMO3': '0.251', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.836', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '53.000'} [2024-08-06 02:37:21,978][52795] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:37:22,273][52650] Updated weights for policy 0, policy_version 39491 (0.0012) [2024-08-06 02:37:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 323518464. Throughput: 0: 4371.1. Samples: 80883340. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 02:37:22,802][52567] Avg episode reward: [(0, '66.496')] [2024-08-06 02:37:23,259][52665] DAMAGECOUNT value on done: 321204.0 [2024-08-06 02:37:23,265][52665] Sum rewards: 71.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.518', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.186', 'AMMO3': '0.188', 'AMMO4': '0.204', 'weapon4': '0.230', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:23,532][52667] DAMAGECOUNT value on done: 325628.0 [2024-08-06 02:37:23,535][52667] Sum rewards: 59.072, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.591', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.390', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '53.000'} [2024-08-06 02:37:23,975][52647] DAMAGECOUNT value on done: 343021.0 [2024-08-06 02:37:23,975][52647] Sum rewards: 70.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.090', 'AMMO4': '0.202', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '61.000'} [2024-08-06 02:37:24,656][52662] DAMAGECOUNT value on done: 330441.0 [2024-08-06 02:37:24,656][52662] Sum rewards: 71.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '61.000'} [2024-08-06 02:37:26,235][52665] DAMAGECOUNT value on done: 319965.0 [2024-08-06 02:37:26,235][52665] Sum rewards: 86.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon2': '0.332', 'WEAPON3': '0.950', 'weapon3': '3.396', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '68.000'} [2024-08-06 02:37:26,461][52667] DAMAGECOUNT value on done: 326623.0 [2024-08-06 02:37:26,462][52667] Sum rewards: 73.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.914', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '62.000'} [2024-08-06 02:37:26,902][52650] Updated weights for policy 0, policy_version 39501 (0.0021) [2024-08-06 02:37:27,189][52647] DAMAGECOUNT value on done: 339241.0 [2024-08-06 02:37:27,189][52647] Sum rewards: 79.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.256', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.052', 'weapon4': '0.070', 'AMMO4': '0.127', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '65.000'} [2024-08-06 02:37:27,326][52662] DAMAGECOUNT value on done: 325623.0 [2024-08-06 02:37:27,326][52662] Sum rewards: 66.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.155', 'weapon4': '0.184', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 323608576. Throughput: 0: 4371.8. Samples: 80909600. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 02:37:27,802][52567] Avg episode reward: [(0, '66.934')] [2024-08-06 02:37:28,534][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:37:28,928][52665] DAMAGECOUNT value on done: 315442.0 [2024-08-06 02:37:28,929][52665] Sum rewards: 80.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO4': '0.172', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.306', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '66.000'} [2024-08-06 02:37:29,056][52667] DAMAGECOUNT value on done: 327108.0 [2024-08-06 02:37:29,058][52667] Sum rewards: 75.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.456', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.166', 'weapon4': '0.196', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '60.000'} [2024-08-06 02:37:29,640][52662] DAMAGECOUNT value on done: 325414.0 [2024-08-06 02:37:29,640][52662] Sum rewards: 53.694, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.880', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.216', 'WEAPON4': '0.300', 'AMMO3': '0.337', 'weapon2': '0.394', 'WEAPON3': '2.000', 'weapon3': '3.016', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '51.000'} [2024-08-06 02:37:29,705][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:37:30,215][52647] DAMAGECOUNT value on done: 334585.0 [2024-08-06 02:37:30,216][52647] Sum rewards: 63.245, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.504', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.134', 'weapon4': '0.272', 'weapon2': '0.556', 'WEAPON3': '0.850', 'weapon3': '2.936', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '50.000'} [2024-08-06 02:37:31,462][52650] Updated weights for policy 0, policy_version 39511 (0.0012) [2024-08-06 02:37:31,557][52649] DAMAGECOUNT value on done: 312454.0 [2024-08-06 02:37:31,558][52649] Sum rewards: 75.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.435', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.116', 'weapon5': '0.140', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '63.000'} [2024-08-06 02:37:31,813][52667] DAMAGECOUNT value on done: 322223.0 [2024-08-06 02:37:31,824][52667] Sum rewards: 71.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.709', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.130', 'weapon5': '0.136', 'AMMO3': '0.207', 'AMMO4': '0.235', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '61.000'} [2024-08-06 02:37:32,009][52665] DAMAGECOUNT value on done: 311194.0 [2024-08-06 02:37:32,011][52665] Sum rewards: 58.392, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.268', 'AMMO5': '0.024', 'AMMO2': '0.081', 'AMMO3': '0.282', 'weapon4': '0.300', 'weapon5': '0.322', 'AMMO4': '0.405', 'weapon2': '0.448', 'WEAPON5': '0.700', 'WEAPON4': '0.850', 'WEAPON3': '1.750', 'weapon3': '2.552', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '53.500'} [2024-08-06 02:37:32,294][52662] DAMAGECOUNT value on done: 317690.0 [2024-08-06 02:37:32,295][52662] Sum rewards: 79.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.455', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.050', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '66.000'} [2024-08-06 02:37:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 323698688. Throughput: 0: 4376.3. Samples: 80923040. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 02:37:32,794][52567] Avg episode reward: [(0, '67.098')] [2024-08-06 02:37:33,375][52647] DAMAGECOUNT value on done: 343155.0 [2024-08-06 02:37:33,373][52668] DAMAGECOUNT value on done: 319064.0 [2024-08-06 02:37:33,375][52647] Sum rewards: 66.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.978', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.157', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:33,375][52668] Sum rewards: 75.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon4': '0.128', 'AMMO3': '0.185', 'weapon5': '0.226', 'AMMO4': '0.282', 'weapon2': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:34,034][52795] DAMAGECOUNT value on done: 300329.0 [2024-08-06 02:37:34,035][52795] Sum rewards: 80.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.214', 'weapon2': '0.244', 'weapon4': '0.246', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '66.000'} [2024-08-06 02:37:34,345][52649] DAMAGECOUNT value on done: 307499.0 [2024-08-06 02:37:34,345][52649] Sum rewards: 70.370, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.134', 'AMMO3': '0.196', 'AMMO4': '0.261', 'weapon4': '0.330', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:34,555][52667] DAMAGECOUNT value on done: 321736.0 [2024-08-06 02:37:34,556][52667] Sum rewards: 64.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.560', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:34,707][52665] DAMAGECOUNT value on done: 311500.0 [2024-08-06 02:37:34,709][52665] Sum rewards: 57.694, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.125', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.353', 'weapon2': '0.366', 'WEAPON3': '1.950', 'weapon3': '3.120', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:34,784][52811] DAMAGECOUNT value on done: 311035.0 [2024-08-06 02:37:34,784][52811] Sum rewards: 71.513, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.826', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.178', 'AMMO4': '0.221', 'weapon4': '0.224', 'AMMO3': '0.259', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '61.500'} [2024-08-06 02:37:35,440][52662] DAMAGECOUNT value on done: 327499.0 [2024-08-06 02:37:35,440][52662] Sum rewards: 78.981, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.042', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.414', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '67.000'} [2024-08-06 02:37:35,468][52803] DAMAGECOUNT value on done: 301197.0 [2024-08-06 02:37:35,469][52803] Sum rewards: 59.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO3': '0.186', 'AMMO4': '0.198', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '48.000'} [2024-08-06 02:37:36,107][52650] Updated weights for policy 0, policy_version 39521 (0.0025) [2024-08-06 02:37:36,225][52668] DAMAGECOUNT value on done: 323156.0 [2024-08-06 02:37:36,225][52668] Sum rewards: 57.895, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon4': '0.312', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.659', 'FRAGCOUNT': '48.000'} [2024-08-06 02:37:36,401][52647] DAMAGECOUNT value on done: 335940.0 [2024-08-06 02:37:36,402][52647] Sum rewards: 66.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.217', 'AMMO4': '0.237', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.222', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:36,511][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:37:36,711][52649] DAMAGECOUNT value on done: 313897.0 [2024-08-06 02:37:36,711][52649] Sum rewards: 69.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.635', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:37,086][52795] DAMAGECOUNT value on done: 293213.0 [2024-08-06 02:37:37,086][52795] Sum rewards: 67.154, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.906', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.124', 'weapon5': '0.134', 'AMMO4': '0.174', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '56.000'} [2024-08-06 02:37:37,182][52665] DAMAGECOUNT value on done: 318932.0 [2024-08-06 02:37:37,183][52665] Sum rewards: 64.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.342', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.262', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '53.000'} [2024-08-06 02:37:37,430][52667] DAMAGECOUNT value on done: 328721.0 [2024-08-06 02:37:37,432][52667] Sum rewards: 69.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.714', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'weapon2': '0.214', 'AMMO3': '0.233', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.366', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 323788800. Throughput: 0: 4373.1. Samples: 80949280. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 02:37:37,794][52567] Avg episode reward: [(0, '67.463')] [2024-08-06 02:37:37,804][52811] DAMAGECOUNT value on done: 297056.0 [2024-08-06 02:37:37,804][52811] Sum rewards: 67.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.456', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.090', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:38,533][52803] DAMAGECOUNT value on done: 298171.0 [2024-08-06 02:37:38,535][52803] Sum rewards: 56.714, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.496', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.174', 'AMMO3': '0.247', 'weapon4': '0.272', 'AMMO4': '0.277', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '50.000'} [2024-08-06 02:37:38,567][52662] DAMAGECOUNT value on done: 319235.0 [2024-08-06 02:37:38,571][52662] Sum rewards: 63.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.650', 'HITCOUNT': '3.240', 'weapon3': '3.322', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:39,432][52647] DAMAGECOUNT value on done: 342190.0 [2024-08-06 02:37:39,437][52647] Sum rewards: 66.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.338', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.204', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 02:37:39,437][52668] DAMAGECOUNT value on done: 325380.0 [2024-08-06 02:37:39,440][52668] Sum rewards: 53.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '48.000'} [2024-08-06 02:37:39,477][52649] DAMAGECOUNT value on done: 312571.0 [2024-08-06 02:37:39,478][52649] Sum rewards: 63.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.585', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.193', 'weapon4': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:39,747][52665] DAMAGECOUNT value on done: 320038.0 [2024-08-06 02:37:39,747][52665] Sum rewards: 68.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.485', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.228', 'weapon4': '0.244', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '56.000'} [2024-08-06 02:37:39,850][52667] DAMAGECOUNT value on done: 321437.0 [2024-08-06 02:37:39,851][52667] Sum rewards: 70.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.582', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.154', 'weapon5': '0.162', 'AMMO4': '0.185', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.002', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '60.000'} [2024-08-06 02:37:40,286][52795] DAMAGECOUNT value on done: 294530.0 [2024-08-06 02:37:40,286][52795] Sum rewards: 70.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.225', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.138', 'AMMO4': '0.216', 'weapon2': '0.234', 'AMMO3': '0.278', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.920', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '61.000'} [2024-08-06 02:37:40,802][52650] Updated weights for policy 0, policy_version 39531 (0.0013) [2024-08-06 02:37:41,034][52811] DAMAGECOUNT value on done: 302224.0 [2024-08-06 02:37:41,035][52811] Sum rewards: 68.727, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.810', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon5': '0.104', 'weapon4': '0.266', 'AMMO3': '0.268', 'AMMO4': '0.295', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '59.500'} [2024-08-06 02:37:41,737][52803] DAMAGECOUNT value on done: 301295.0 [2024-08-06 02:37:41,738][52803] Sum rewards: 62.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.348', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.184', 'weapon4': '0.198', 'AMMO4': '0.227', 'weapon2': '0.260', 'AMMO3': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.998', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:41,794][52662] DAMAGECOUNT value on done: 328589.0 [2024-08-06 02:37:41,794][52662] Sum rewards: 57.995, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.127', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.293', 'weapon2': '0.374', 'WEAPON3': '1.700', 'HITCOUNT': '2.850', 'weapon3': '3.052', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '52.000'} [2024-08-06 02:37:42,229][52647] DAMAGECOUNT value on done: 333618.0 [2024-08-06 02:37:42,230][52647] Sum rewards: 68.246, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.223', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.270', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '58.000'} [2024-08-06 02:37:42,369][52649] DAMAGECOUNT value on done: 303397.0 [2024-08-06 02:37:42,369][52649] Sum rewards: 57.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.552', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.173', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '46.000'} [2024-08-06 02:37:42,497][52667] DAMAGECOUNT value on done: 324563.0 [2024-08-06 02:37:42,499][52667] Sum rewards: 65.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'AMMO2': '0.033', 'weapon4': '0.166', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:42,513][52668] DAMAGECOUNT value on done: 326721.0 [2024-08-06 02:37:42,515][52668] Sum rewards: 54.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.270', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon5': '0.192', 'AMMO3': '0.248', 'AMMO4': '0.261', 'weapon4': '0.264', 'WEAPON5': '0.500', 'weapon2': '0.514', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.706', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '47.000'} [2024-08-06 02:37:42,742][52665] DAMAGECOUNT value on done: 320970.0 [2024-08-06 02:37:42,743][52665] Sum rewards: 70.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.128', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:42,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 323870720. Throughput: 0: 4373.3. Samples: 80975590. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:37:42,802][52567] Avg episode reward: [(0, '66.845')] [2024-08-06 02:37:43,521][52795] DAMAGECOUNT value on done: 297655.0 [2024-08-06 02:37:43,523][52795] Sum rewards: 70.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.582', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.060', 'weapon4': '0.078', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.500'} [2024-08-06 02:37:44,079][52811] DAMAGECOUNT value on done: 300147.0 [2024-08-06 02:37:44,081][52811] Sum rewards: 64.857, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.656', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.112', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '56.500'} [2024-08-06 02:37:44,680][52662] DAMAGECOUNT value on done: 333346.0 [2024-08-06 02:37:44,680][52662] Sum rewards: 67.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.274', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.200', 'AMMO4': '0.217', 'weapon5': '0.218', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:44,811][52649] DAMAGECOUNT value on done: 315370.0 [2024-08-06 02:37:44,811][52649] Sum rewards: 64.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.106', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.056', 'AMMO4': '0.113', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:44,984][52803] DAMAGECOUNT value on done: 304442.0 [2024-08-06 02:37:44,987][52803] Sum rewards: 68.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.203', 'AMMO4': '0.203', 'weapon5': '0.282', 'weapon2': '0.404', 'weapon4': '0.542', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.444', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:45,084][52665] DAMAGECOUNT value on done: 318925.0 [2024-08-06 02:37:45,084][52665] Sum rewards: 71.833, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.000', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.138', 'weapon5': '0.194', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.488', 'WEAPON3': '1.000', 'weapon3': '2.702', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '56.000'} [2024-08-06 02:37:45,281][52647] DAMAGECOUNT value on done: 336182.0 [2024-08-06 02:37:45,281][52647] Sum rewards: 63.001, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.028', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'HEALTH': '0.293', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '3.268', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '52.000'} [2024-08-06 02:37:45,348][52668] DAMAGECOUNT value on done: 316604.0 [2024-08-06 02:37:45,349][52668] Sum rewards: 68.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.336', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:45,511][52650] Updated weights for policy 0, policy_version 39541 (0.0012) [2024-08-06 02:37:45,601][52667] DAMAGECOUNT value on done: 322599.0 [2024-08-06 02:37:45,602][52667] Sum rewards: 69.410, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.809', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.122', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.464', 'WEAPON3': '1.550', 'weapon3': '3.038', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '60.000'} [2024-08-06 02:37:46,150][52669] DAMAGECOUNT value on done: 327212.0 [2024-08-06 02:37:46,150][52669] Sum rewards: 67.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.829', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.116', 'weapon5': '0.174', 'AMMO4': '0.203', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:46,600][52795] DAMAGECOUNT value on done: 299587.0 [2024-08-06 02:37:46,601][52795] Sum rewards: 71.438, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.756', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO3': '0.146', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.000', 'HITCOUNT': '3.140', 'weapon3': '3.256', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '58.000'} [2024-08-06 02:37:47,048][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:37:47,179][52811] DAMAGECOUNT value on done: 303491.0 [2024-08-06 02:37:47,179][52811] Sum rewards: 69.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.548', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:47,634][52662] DAMAGECOUNT value on done: 323719.0 [2024-08-06 02:37:47,636][52662] Sum rewards: 68.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.986', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.211', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:47,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 323952640. Throughput: 0: 4373.8. Samples: 80988740. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:37:47,794][52567] Avg episode reward: [(0, '66.608')] [2024-08-06 02:37:47,886][52647] DAMAGECOUNT value on done: 337011.0 [2024-08-06 02:37:47,887][52647] Sum rewards: 69.653, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.156', 'weapon2': '0.468', 'WEAPON3': '0.900', 'HITCOUNT': '3.200', 'weapon3': '3.358', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:47,966][52668] DAMAGECOUNT value on done: 326504.0 [2024-08-06 02:37:47,968][52668] Sum rewards: 71.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.000', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.138', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.690', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '58.000'} [2024-08-06 02:37:48,030][52649] DAMAGECOUNT value on done: 312341.0 [2024-08-06 02:37:48,030][52649] Sum rewards: 66.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.784', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:48,207][52665] DAMAGECOUNT value on done: 326149.0 [2024-08-06 02:37:48,207][52665] Sum rewards: 77.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.975', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.402', 'WEAPON3': '1.650', 'weapon3': '3.302', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '66.000'} [2024-08-06 02:37:48,224][52803] DAMAGECOUNT value on done: 303814.0 [2024-08-06 02:37:48,225][52803] Sum rewards: 71.577, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.410', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.144', 'AMMO4': '0.194', 'weapon2': '0.248', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.850', 'weapon3': '3.228', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '65.000'} [2024-08-06 02:37:48,335][52667] DAMAGECOUNT value on done: 319422.0 [2024-08-06 02:37:48,337][52667] Sum rewards: 70.641, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.986', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '62.000'} [2024-08-06 02:37:49,109][52669] DAMAGECOUNT value on done: 318759.0 [2024-08-06 02:37:49,111][52669] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.748', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon2': '0.260', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.800', 'weapon3': '2.910', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '61.000'} [2024-08-06 02:37:49,657][52795] DAMAGECOUNT value on done: 296869.0 [2024-08-06 02:37:49,657][52795] Sum rewards: 69.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.444', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:50,186][52650] Updated weights for policy 0, policy_version 39551 (0.0018) [2024-08-06 02:37:50,237][52811] DAMAGECOUNT value on done: 306120.0 [2024-08-06 02:37:50,237][52811] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.270', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.454', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '53.000'} [2024-08-06 02:37:50,347][52647] DAMAGECOUNT value on done: 345650.0 [2024-08-06 02:37:50,349][52647] Sum rewards: 60.932, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.768', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon5': '0.202', 'AMMO3': '0.224', 'weapon4': '0.242', 'AMMO4': '0.300', 'weapon2': '0.510', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:50,499][52662] DAMAGECOUNT value on done: 334848.0 [2024-08-06 02:37:50,500][52662] Sum rewards: 78.769, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.197', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.090', 'weapon5': '0.096', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '66.000'} [2024-08-06 02:37:50,757][52667] DAMAGECOUNT value on done: 326498.0 [2024-08-06 02:37:50,757][52667] Sum rewards: 69.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.372', 'WEAPON3': '1.000', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:51,138][52649] DAMAGECOUNT value on done: 317923.0 [2024-08-06 02:37:51,139][52649] Sum rewards: 63.120, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.108', 'weapon4': '0.172', 'AMMO4': '0.191', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '52.000'} [2024-08-06 02:37:51,157][52668] DAMAGECOUNT value on done: 323860.0 [2024-08-06 02:37:51,157][52668] Sum rewards: 74.926, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'AMMO2': '0.057', 'weapon5': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.254', 'AMMO4': '0.283', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '65.000'} [2024-08-06 02:37:51,350][52665] DAMAGECOUNT value on done: 319092.0 [2024-08-06 02:37:51,350][52665] Sum rewards: 62.959, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.474', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.124', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '52.000'} [2024-08-06 02:37:51,657][52803] DAMAGECOUNT value on done: 298335.0 [2024-08-06 02:37:51,658][52803] Sum rewards: 62.412, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.113', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON4': '0.400', 'weapon4': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.726', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '51.000'} [2024-08-06 02:37:51,911][52669] DAMAGECOUNT value on done: 326157.0 [2024-08-06 02:37:51,912][52669] Sum rewards: 78.413, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.160', 'AMMO4': '0.199', 'AMMO3': '0.202', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '66.000'} [2024-08-06 02:37:52,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 324050944. Throughput: 0: 4371.8. Samples: 81014940. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:37:52,794][52567] Avg episode reward: [(0, '67.384')] [2024-08-06 02:37:52,806][52795] DAMAGECOUNT value on done: 303813.0 [2024-08-06 02:37:52,806][52795] Sum rewards: 58.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.106', 'AMMO4': '0.157', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.066', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '53.000'} [2024-08-06 02:37:52,964][52647] DAMAGECOUNT value on done: 338643.0 [2024-08-06 02:37:52,966][52647] Sum rewards: 57.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.207', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '49.000'} [2024-08-06 02:37:53,130][52660] DAMAGECOUNT value on done: 317967.0 [2024-08-06 02:37:53,130][52660] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '56.000'} [2024-08-06 02:37:53,264][52811] DAMAGECOUNT value on done: 301151.0 [2024-08-06 02:37:53,265][52811] Sum rewards: 68.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.685', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.166', 'AMMO3': '0.172', 'AMMO4': '0.240', 'weapon4': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:53,402][52662] DAMAGECOUNT value on done: 320027.0 [2024-08-06 02:37:53,402][52662] Sum rewards: 64.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.192', 'AMMO3': '0.216', 'weapon5': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.710', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '55.000'} [2024-08-06 02:37:53,816][52667] DAMAGECOUNT value on done: 331331.0 [2024-08-06 02:37:53,816][52667] Sum rewards: 76.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.532', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.246', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '65.000'} [2024-08-06 02:37:54,164][52649] DAMAGECOUNT value on done: 313149.0 [2024-08-06 02:37:54,164][52649] Sum rewards: 61.826, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.308', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.125', 'AMMO3': '0.161', 'weapon4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '0.950', 'HITCOUNT': '3.050', 'weapon3': '3.084', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '49.000'} [2024-08-06 02:37:54,292][52665] DAMAGECOUNT value on done: 319304.0 [2024-08-06 02:37:54,293][52665] Sum rewards: 65.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.928', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.215', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.250', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:54,477][52668] DAMAGECOUNT value on done: 317823.0 [2024-08-06 02:37:54,478][52668] Sum rewards: 56.441, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.818', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.107', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.290', 'weapon2': '0.318', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '53.000'} [2024-08-06 02:37:54,646][52650] Updated weights for policy 0, policy_version 39561 (0.0029) [2024-08-06 02:37:54,702][52803] DAMAGECOUNT value on done: 298163.0 [2024-08-06 02:37:54,705][52803] Sum rewards: 70.192, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.855', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.147', 'weapon2': '0.178', 'AMMO4': '0.247', 'weapon5': '0.272', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '2.830', 'weapon3': '2.940', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '56.000'} [2024-08-06 02:37:54,923][52669] DAMAGECOUNT value on done: 321249.0 [2024-08-06 02:37:54,923][52669] Sum rewards: 59.615, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.827', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.172', 'AMMO4': '0.182', 'AMMO3': '0.200', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.988', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '48.000'} [2024-08-06 02:37:55,676][52647] DAMAGECOUNT value on done: 337521.0 [2024-08-06 02:37:55,676][52647] Sum rewards: 71.377, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.851', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.160', 'AMMO4': '0.216', 'weapon4': '0.244', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:55,863][52795] DAMAGECOUNT value on done: 300981.0 [2024-08-06 02:37:55,864][52795] Sum rewards: 67.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.005', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.062', 'weapon4': '0.098', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:55,973][52660] DAMAGECOUNT value on done: 317188.0 [2024-08-06 02:37:55,975][52660] Sum rewards: 71.730, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.885', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.224', 'AMMO4': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '61.000'} [2024-08-06 02:37:56,288][52811] DAMAGECOUNT value on done: 301449.0 [2024-08-06 02:37:56,289][52811] Sum rewards: 75.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.101', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '62.000'} [2024-08-06 02:37:56,407][52662] DAMAGECOUNT value on done: 322602.0 [2024-08-06 02:37:56,408][52662] Sum rewards: 70.423, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.839', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 02:37:56,681][52649] DAMAGECOUNT value on done: 312883.0 [2024-08-06 02:37:56,681][52649] Sum rewards: 63.224, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.107', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.340', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.342', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '51.000'} [2024-08-06 02:37:56,790][52665] DAMAGECOUNT value on done: 318661.0 [2024-08-06 02:37:56,791][52665] Sum rewards: 70.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.100', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '58.000'} [2024-08-06 02:37:56,926][52667] DAMAGECOUNT value on done: 329017.0 [2024-08-06 02:37:56,928][52667] Sum rewards: 76.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.272', 'weapon2': '0.492', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '64.000'} [2024-08-06 02:37:56,986][52668] DAMAGECOUNT value on done: 322837.0 [2024-08-06 02:37:56,986][52668] Sum rewards: 64.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.270', 'weapon4': '0.276', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.220', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:57,764][52803] DAMAGECOUNT value on done: 297251.0 [2024-08-06 02:37:57,764][52803] Sum rewards: 66.438, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.351', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.052', 'weapon4': '0.072', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.292', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '59.000'} [2024-08-06 02:37:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 324132864. Throughput: 0: 4384.7. Samples: 81041140. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:37:57,794][52567] Avg episode reward: [(0, '67.691')] [2024-08-06 02:37:58,017][52669] DAMAGECOUNT value on done: 319219.0 [2024-08-06 02:37:58,019][52669] Sum rewards: 54.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.185', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.130', 'weapon4': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.230', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '45.000'} [2024-08-06 02:37:58,426][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:37:58,529][52647] DAMAGECOUNT value on done: 336010.0 [2024-08-06 02:37:58,530][52647] Sum rewards: 80.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.890', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.131', 'weapon4': '0.178', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '67.000'} [2024-08-06 02:37:58,548][52660] DAMAGECOUNT value on done: 326404.0 [2024-08-06 02:37:58,548][52660] Sum rewards: 69.001, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.310', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.208', 'weapon5': '0.216', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '59.500'} [2024-08-06 02:37:58,994][52795] DAMAGECOUNT value on done: 289950.0 [2024-08-06 02:37:58,998][52795] Sum rewards: 69.560, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.285', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.058', 'weapon4': '0.142', 'AMMO3': '0.184', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:59,422][52650] Updated weights for policy 0, policy_version 39571 (0.0010) [2024-08-06 02:37:59,429][52811] DAMAGECOUNT value on done: 311359.0 [2024-08-06 02:37:59,433][52811] Sum rewards: 65.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.372', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '54.000'} [2024-08-06 02:37:59,540][52662] DAMAGECOUNT value on done: 325844.0 [2024-08-06 02:37:59,540][52662] Sum rewards: 67.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.639', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.204', 'AMMO3': '0.206', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.566', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '57.000'} [2024-08-06 02:37:59,643][52668] DAMAGECOUNT value on done: 321554.0 [2024-08-06 02:37:59,643][52668] Sum rewards: 66.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.072', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.136', 'weapon5': '0.172', 'AMMO4': '0.238', 'AMMO3': '0.255', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '58.000'} [2024-08-06 02:37:59,763][52649] DAMAGECOUNT value on done: 315987.0 [2024-08-06 02:37:59,763][52649] Sum rewards: 73.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.029', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.080', 'weapon5': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '61.000'} [2024-08-06 02:37:59,857][52665] DAMAGECOUNT value on done: 320860.0 [2024-08-06 02:37:59,857][52665] Sum rewards: 73.666, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.116', 'AMMO4': '0.151', 'weapon2': '0.236', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.320', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '63.000'} [2024-08-06 02:37:59,865][52667] DAMAGECOUNT value on done: 330155.0 [2024-08-06 02:37:59,866][52667] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.503', 'AMMO5': '0.008', 'weapon4': '0.020', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.564', 'WEAPON3': '1.000', 'HITCOUNT': '3.120', 'weapon3': '3.172', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:00,717][52669] DAMAGECOUNT value on done: 322850.0 [2024-08-06 02:38:00,720][52669] Sum rewards: 70.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.959', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.096', 'AMMO4': '0.146', 'weapon5': '0.174', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.500'} [2024-08-06 02:38:00,835][52803] DAMAGECOUNT value on done: 303552.0 [2024-08-06 02:38:00,838][52803] Sum rewards: 88.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.284', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.786', 'FRAGCOUNT': '71.000'} [2024-08-06 02:38:01,067][52660] DAMAGECOUNT value on done: 325335.0 [2024-08-06 02:38:01,068][52660] Sum rewards: 65.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.532', 'AMMO5': '0.028', 'AMMO2': '0.064', 'AMMO3': '0.256', 'weapon2': '0.260', 'AMMO4': '0.321', 'weapon5': '0.326', 'weapon4': '0.526', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.510', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:01,137][52647] DAMAGECOUNT value on done: 330681.0 [2024-08-06 02:38:01,138][52647] Sum rewards: 72.920, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.567', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.206', 'AMMO4': '0.242', 'weapon2': '0.284', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:02,155][52795] DAMAGECOUNT value on done: 303535.0 [2024-08-06 02:38:02,158][52795] Sum rewards: 60.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.252', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.082', 'AMMO4': '0.170', 'AMMO3': '0.189', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.388', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '51.000'} [2024-08-06 02:38:02,204][52794] DAMAGECOUNT value on done: 325217.0 [2024-08-06 02:38:02,204][52794] Sum rewards: 79.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.288', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.256', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '65.500'} [2024-08-06 02:38:02,258][52668] DAMAGECOUNT value on done: 326948.0 [2024-08-06 02:38:02,258][52668] Sum rewards: 70.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.478', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.092', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '62.000'} [2024-08-06 02:38:02,424][52811] DAMAGECOUNT value on done: 301867.0 [2024-08-06 02:38:02,425][52811] Sum rewards: 68.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.141', 'AMMO3': '0.173', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:02,595][52658] DAMAGECOUNT value on done: 322205.0 [2024-08-06 02:38:02,597][52658] Sum rewards: 67.974, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.541', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO3': '0.140', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.176', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 324214784. Throughput: 0: 4386.9. Samples: 81054570. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:38:02,802][52567] Avg episode reward: [(0, '67.715')] [2024-08-06 02:38:02,796][52662] DAMAGECOUNT value on done: 330092.0 [2024-08-06 02:38:02,802][52662] Sum rewards: 67.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.207', 'AMMO3': '0.235', 'weapon2': '0.246', 'weapon4': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:02,904][52649] DAMAGECOUNT value on done: 316255.0 [2024-08-06 02:38:02,905][52649] Sum rewards: 64.961, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.601', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.292', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '59.000'} [2024-08-06 02:38:02,971][52665] DAMAGECOUNT value on done: 316873.0 [2024-08-06 02:38:02,971][52665] Sum rewards: 60.874, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.505', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO4': '0.193', 'AMMO3': '0.215', 'weapon4': '0.216', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '52.000'} [2024-08-06 02:38:03,006][52667] DAMAGECOUNT value on done: 321374.0 [2024-08-06 02:38:03,007][52667] Sum rewards: 74.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.543', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.186', 'weapon5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '62.000'} [2024-08-06 02:38:03,686][52669] DAMAGECOUNT value on done: 324321.0 [2024-08-06 02:38:03,687][52669] Sum rewards: 67.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.776', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.140', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon4': '0.548', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:03,960][52803] DAMAGECOUNT value on done: 296885.0 [2024-08-06 02:38:03,960][52803] Sum rewards: 62.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.092', 'weapon4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.338', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.206', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:04,024][52650] Updated weights for policy 0, policy_version 39581 (0.0040) [2024-08-06 02:38:04,060][52660] DAMAGECOUNT value on done: 321801.0 [2024-08-06 02:38:04,060][52660] Sum rewards: 62.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.543', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.048', 'weapon5': '0.156', 'AMMO4': '0.182', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '51.000'} [2024-08-06 02:38:04,112][52647] DAMAGECOUNT value on done: 337455.0 [2024-08-06 02:38:04,113][52647] Sum rewards: 68.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.154', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:04,796][52794] DAMAGECOUNT value on done: 328564.0 [2024-08-06 02:38:04,797][52794] Sum rewards: 59.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.190', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '52.000'} [2024-08-06 02:38:05,237][52668] DAMAGECOUNT value on done: 319731.0 [2024-08-06 02:38:05,239][52668] Sum rewards: 64.837, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.305', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.112', 'weapon2': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.458', 'WEAPON3': '1.050', 'weapon3': '2.844', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:05,270][52795] DAMAGECOUNT value on done: 296351.0 [2024-08-06 02:38:05,271][52795] Sum rewards: 64.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.720', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:05,333][52662] DAMAGECOUNT value on done: 323222.0 [2024-08-06 02:38:05,334][52662] Sum rewards: 73.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.649', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO4': '0.198', 'AMMO3': '0.223', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:05,494][52811] DAMAGECOUNT value on done: 302804.0 [2024-08-06 02:38:05,496][52811] Sum rewards: 58.800, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.345', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.092', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.600', 'weapon3': '3.044', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '52.000'} [2024-08-06 02:38:05,566][52649] DAMAGECOUNT value on done: 317456.0 [2024-08-06 02:38:05,568][52649] Sum rewards: 69.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.058', 'AMMO4': '0.171', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:05,588][52665] DAMAGECOUNT value on done: 314439.0 [2024-08-06 02:38:05,588][52665] Sum rewards: 67.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.213', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:05,767][52658] DAMAGECOUNT value on done: 322543.0 [2024-08-06 02:38:05,767][52658] Sum rewards: 63.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.938', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.238', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '53.500'} [2024-08-06 02:38:06,176][52667] DAMAGECOUNT value on done: 328977.0 [2024-08-06 02:38:06,179][52667] Sum rewards: 77.560, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.930', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.152', 'weapon5': '0.156', 'weapon2': '0.268', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.850', 'weapon3': '3.194', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '67.000'} [2024-08-06 02:38:06,332][52669] DAMAGECOUNT value on done: 323245.0 [2024-08-06 02:38:06,333][52669] Sum rewards: 73.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.475', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.148', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:07,020][52660] DAMAGECOUNT value on done: 318116.0 [2024-08-06 02:38:07,022][52660] Sum rewards: 64.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.140', 'AMMO4': '0.178', 'weapon4': '0.192', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:07,222][52803] DAMAGECOUNT value on done: 306578.0 [2024-08-06 02:38:07,222][52803] Sum rewards: 74.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.286', 'WEAPON3': '1.650', 'weapon3': '3.192', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:07,666][52794] DAMAGECOUNT value on done: 323820.0 [2024-08-06 02:38:07,669][52794] Sum rewards: 82.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.325', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon5': '0.238', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '68.000'} [2024-08-06 02:38:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 324296704. Throughput: 0: 4381.8. Samples: 81080520. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:38:07,802][52567] Avg episode reward: [(0, '68.080')] [2024-08-06 02:38:07,993][52668] DAMAGECOUNT value on done: 314146.0 [2024-08-06 02:38:07,994][52668] Sum rewards: 74.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.992', 'AMMO5': '0.013', 'weapon4': '0.014', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.272', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:08,107][52665] DAMAGECOUNT value on done: 315506.0 [2024-08-06 02:38:08,107][52665] Sum rewards: 75.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.688', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.152', 'AMMO3': '0.173', 'weapon2': '0.226', 'AMMO4': '0.255', 'weapon4': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '62.000'} [2024-08-06 02:38:08,120][52649] DAMAGECOUNT value on done: 320031.0 [2024-08-06 02:38:08,120][52649] Sum rewards: 77.465, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.194', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.130', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.267', 'WEAPON3': '1.700', 'weapon3': '3.328', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '66.000'} [2024-08-06 02:38:08,372][52795] DAMAGECOUNT value on done: 295433.0 [2024-08-06 02:38:08,372][52795] Sum rewards: 62.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon5': '0.102', 'AMMO3': '0.221', 'weapon4': '0.238', 'AMMO4': '0.256', 'weapon2': '0.438', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:08,406][52662] DAMAGECOUNT value on done: 334967.0 [2024-08-06 02:38:08,406][52662] Sum rewards: 60.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.058', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'weapon2': '0.278', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.116', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '49.500'} [2024-08-06 02:38:08,796][52650] Updated weights for policy 0, policy_version 39591 (0.0019) [2024-08-06 02:38:08,828][52811] DAMAGECOUNT value on done: 307380.0 [2024-08-06 02:38:08,831][52811] Sum rewards: 65.283, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.074', 'weapon4': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.314', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.274', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:08,847][52658] DAMAGECOUNT value on done: 327826.0 [2024-08-06 02:38:08,849][52658] Sum rewards: 76.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.475', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.114', 'weapon5': '0.156', 'AMMO4': '0.175', 'AMMO3': '0.202', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '62.000'} [2024-08-06 02:38:09,248][52669] DAMAGECOUNT value on done: 323269.0 [2024-08-06 02:38:09,249][52669] Sum rewards: 61.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.209', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.144', 'AMMO3': '0.225', 'AMMO4': '0.262', 'weapon2': '0.300', 'weapon4': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '50.000'} [2024-08-06 02:38:09,830][52660] DAMAGECOUNT value on done: 322827.0 [2024-08-06 02:38:09,830][52660] Sum rewards: 59.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.082', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.097', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '49.000'} [2024-08-06 02:38:10,369][52803] DAMAGECOUNT value on done: 302812.0 [2024-08-06 02:38:10,369][52803] Sum rewards: 65.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.225', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.038', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.238', 'weapon2': '0.288', 'WEAPON3': '1.600', 'HITCOUNT': '3.360', 'weapon3': '3.376', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:10,685][52794] DAMAGECOUNT value on done: 323832.0 [2024-08-06 02:38:10,689][52794] Sum rewards: 84.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.558', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.191', 'weapon2': '0.226', 'WEAPON3': '1.200', 'weapon3': '3.632', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '68.000'} [2024-08-06 02:38:10,705][52668] DAMAGECOUNT value on done: 314462.0 [2024-08-06 02:38:10,707][52668] Sum rewards: 60.928, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.784', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon5': '0.166', 'AMMO3': '0.204', 'AMMO4': '0.278', 'weapon4': '0.366', 'weapon2': '0.470', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:11,012][52649] DAMAGECOUNT value on done: 309135.0 [2024-08-06 02:38:11,013][52649] Sum rewards: 65.578, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'weapon2': '0.272', 'AMMO3': '0.276', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.362', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '59.000'} [2024-08-06 02:38:11,025][52665] DAMAGECOUNT value on done: 318225.0 [2024-08-06 02:38:11,026][52665] Sum rewards: 80.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.180', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '65.000'} [2024-08-06 02:38:11,312][52658] DAMAGECOUNT value on done: 324631.0 [2024-08-06 02:38:11,315][52658] Sum rewards: 72.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.209', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:11,525][52795] DAMAGECOUNT value on done: 293076.0 [2024-08-06 02:38:11,526][52795] Sum rewards: 76.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.211', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:11,527][52662] DAMAGECOUNT value on done: 327339.0 [2024-08-06 02:38:11,528][52662] Sum rewards: 67.701, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:12,009][52811] DAMAGECOUNT value on done: 300596.0 [2024-08-06 02:38:12,010][52811] Sum rewards: 71.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.656', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.203', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '59.000'} [2024-08-06 02:38:12,361][52669] DAMAGECOUNT value on done: 320852.0 [2024-08-06 02:38:12,361][52669] Sum rewards: 70.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.595', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO4': '0.207', 'AMMO3': '0.224', 'weapon2': '0.242', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '59.000'} [2024-08-06 02:38:12,783][52660] DAMAGECOUNT value on done: 328791.0 [2024-08-06 02:38:12,783][52660] Sum rewards: 79.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.901', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.096', 'weapon4': '0.198', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 02:38:12,795][52567] Fps is (10 sec: 18020.2, 60 sec: 17475.9, 300 sec: 17522.5). Total num frames: 324395008. Throughput: 0: 4374.1. Samples: 81106440. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:38:12,803][52567] Avg episode reward: [(0, '68.832')] [2024-08-06 02:38:13,403][52803] DAMAGECOUNT value on done: 298307.0 [2024-08-06 02:38:13,405][52803] Sum rewards: 69.011, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO4': '0.167', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.240', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:13,557][52794] DAMAGECOUNT value on done: 320487.0 [2024-08-06 02:38:13,557][52794] Sum rewards: 72.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.477', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.142', 'AMMO3': '0.168', 'weapon2': '0.246', 'WEAPON3': '1.150', 'weapon3': '3.438', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:13,557][52665] DAMAGECOUNT value on done: 320350.0 [2024-08-06 02:38:13,559][52665] Sum rewards: 75.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.076', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '64.000'} [2024-08-06 02:38:13,573][52649] DAMAGECOUNT value on done: 315739.0 [2024-08-06 02:38:13,574][52649] Sum rewards: 57.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.055', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.144', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.554', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '3.092', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '46.000'} [2024-08-06 02:38:13,730][52668] DAMAGECOUNT value on done: 315259.0 [2024-08-06 02:38:13,731][52668] Sum rewards: 63.618, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.747', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'weapon4': '0.178', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:13,862][52650] Updated weights for policy 0, policy_version 39601 (0.0012) [2024-08-06 02:38:14,085][52658] DAMAGECOUNT value on done: 321908.0 [2024-08-06 02:38:14,088][52658] Sum rewards: 47.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.464', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.209', 'AMMO4': '0.215', 'weapon5': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.550', 'weapon2': '0.716', 'WEAPON3': '1.300', 'weapon3': '2.400', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '12.747', 'FRAGCOUNT': '41.000'} [2024-08-06 02:38:14,328][52662] DAMAGECOUNT value on done: 327074.0 [2024-08-06 02:38:14,328][52662] Sum rewards: 79.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.252', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '64.000'} [2024-08-06 02:38:14,706][52795] DAMAGECOUNT value on done: 301033.0 [2024-08-06 02:38:14,707][52795] Sum rewards: 69.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.217', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.154', 'AMMO3': '0.162', 'AMMO4': '0.234', 'weapon2': '0.316', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.500'} [2024-08-06 02:38:15,111][52811] DAMAGECOUNT value on done: 305250.0 [2024-08-06 02:38:15,112][52811] Sum rewards: 77.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.166', 'AMMO4': '0.202', 'AMMO3': '0.231', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '66.000'} [2024-08-06 02:38:15,187][52669] DAMAGECOUNT value on done: 326951.0 [2024-08-06 02:38:15,188][52669] Sum rewards: 71.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.191', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.376', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:15,541][52660] DAMAGECOUNT value on done: 326130.0 [2024-08-06 02:38:15,541][52660] Sum rewards: 74.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.084', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:16,140][52649] DAMAGECOUNT value on done: 313261.0 [2024-08-06 02:38:16,140][52649] Sum rewards: 73.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.115', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.758', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:16,535][52803] DAMAGECOUNT value on done: 305773.0 [2024-08-06 02:38:16,536][52803] Sum rewards: 63.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.066', 'AMMO3': '0.221', 'AMMO4': '0.235', 'WEAPON4': '0.300', 'weapon5': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:16,684][52668] DAMAGECOUNT value on done: 319009.0 [2024-08-06 02:38:16,685][52668] Sum rewards: 64.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.819', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.160', 'AMMO4': '0.191', 'WEAPON7': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.456', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.502', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:16,729][52794] DAMAGECOUNT value on done: 326136.0 [2024-08-06 02:38:16,729][52794] Sum rewards: 74.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.324', 'weapon4': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:16,732][52664] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:38:17,081][52658] DAMAGECOUNT value on done: 321558.0 [2024-08-06 02:38:17,083][52658] Sum rewards: 64.612, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.074', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.066', 'AMMO4': '0.143', 'weapon4': '0.152', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.750', 'HITCOUNT': '3.200', 'weapon3': '3.216', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:17,508][52669] DAMAGECOUNT value on done: 322592.0 [2024-08-06 02:38:17,509][52669] Sum rewards: 63.550, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.134', 'AMMO3': '0.162', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'HEALTH': '0.728', 'WEAPON3': '0.950', 'HITCOUNT': '3.050', 'weapon3': '3.144', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '51.000'} [2024-08-06 02:38:17,530][52662] DAMAGECOUNT value on done: 323743.0 [2024-08-06 02:38:17,532][52662] Sum rewards: 68.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.128', 'weapon4': '0.180', 'AMMO3': '0.216', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.550', 'weapon2': '0.640', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:17,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 324485120. Throughput: 0: 4372.0. Samples: 81119780. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:38:17,794][52567] Avg episode reward: [(0, '68.798')] [2024-08-06 02:38:17,797][52795] DAMAGECOUNT value on done: 290791.0 [2024-08-06 02:38:17,806][52795] Sum rewards: 70.508, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.329', 'weapon2': '0.358', 'WEAPON3': '1.800', 'weapon3': '3.224', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '62.000'} [2024-08-06 02:38:18,188][52650] Updated weights for policy 0, policy_version 39611 (0.0011) [2024-08-06 02:38:18,221][52811] DAMAGECOUNT value on done: 303420.0 [2024-08-06 02:38:18,222][52811] Sum rewards: 70.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.202', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.094', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:18,650][52671] DAMAGECOUNT value on done: 328933.0 [2024-08-06 02:38:18,651][52671] Sum rewards: 67.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.052', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.248', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:18,662][52660] DAMAGECOUNT value on done: 319126.0 [2024-08-06 02:38:18,663][52660] Sum rewards: 72.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.170', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.106', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon5': '0.218', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:18,826][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:38:18,884][52649] DAMAGECOUNT value on done: 318871.0 [2024-08-06 02:38:18,885][52649] Sum rewards: 69.999, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.180', 'weapon2': '0.230', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.254', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:19,618][52803] DAMAGECOUNT value on done: 298672.0 [2024-08-06 02:38:19,618][52803] Sum rewards: 63.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.637', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.160', 'weapon2': '0.220', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'AMMO4': '0.254', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:19,768][52668] DAMAGECOUNT value on done: 321156.0 [2024-08-06 02:38:19,768][52668] Sum rewards: 84.090, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.292', 'AMMO3': '0.299', 'WEAPON3': '1.800', 'weapon3': '3.340', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '73.000'} [2024-08-06 02:38:19,825][52658] DAMAGECOUNT value on done: 327378.0 [2024-08-06 02:38:19,825][52658] Sum rewards: 63.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.759', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.096', 'AMMO4': '0.225', 'AMMO3': '0.231', 'weapon5': '0.274', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:19,892][52794] DAMAGECOUNT value on done: 331499.0 [2024-08-06 02:38:19,892][52794] Sum rewards: 76.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.154', 'AMMO4': '0.157', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:19,950][52669] DAMAGECOUNT value on done: 321519.0 [2024-08-06 02:38:19,954][52669] Sum rewards: 67.745, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.865', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon5': '0.168', 'weapon2': '0.458', 'WEAPON3': '0.950', 'HITCOUNT': '3.050', 'weapon3': '3.184', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:20,660][52662] DAMAGECOUNT value on done: 319281.0 [2024-08-06 02:38:20,662][52662] Sum rewards: 68.930, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.426', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.128', 'weapon5': '0.138', 'AMMO4': '0.148', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:21,018][52795] DAMAGECOUNT value on done: 307356.0 [2024-08-06 02:38:21,021][52795] Sum rewards: 73.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.120', 'weapon4': '0.196', 'AMMO3': '0.252', 'AMMO4': '0.258', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.036', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:21,207][52811] DAMAGECOUNT value on done: 300710.0 [2024-08-06 02:38:21,207][52811] Sum rewards: 77.176, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.848', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.267', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '65.000'} [2024-08-06 02:38:21,463][52660] DAMAGECOUNT value on done: 329925.0 [2024-08-06 02:38:21,466][52660] Sum rewards: 76.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.084', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.038', 'AMMO4': '0.119', 'weapon5': '0.136', 'weapon2': '0.224', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.650', 'weapon3': '3.372', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 02:38:21,611][52649] DAMAGECOUNT value on done: 320636.0 [2024-08-06 02:38:21,611][52649] Sum rewards: 58.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.224', 'weapon2': '0.278', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.574', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '50.000'} [2024-08-06 02:38:21,769][52671] DAMAGECOUNT value on done: 324597.0 [2024-08-06 02:38:21,771][52671] Sum rewards: 59.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.032', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.221', 'weapon4': '0.412', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.810', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:22,565][52669] DAMAGECOUNT value on done: 325388.0 [2024-08-06 02:38:22,566][52669] Sum rewards: 69.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.120', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon2': '0.156', 'AMMO4': '0.177', 'weapon5': '0.196', 'AMMO3': '0.214', 'weapon4': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '59.000'} [2024-08-06 02:38:22,636][52803] DAMAGECOUNT value on done: 298619.0 [2024-08-06 02:38:22,637][52803] Sum rewards: 70.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.078', 'weapon4': '0.106', 'AMMO4': '0.186', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.816', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '58.500'} [2024-08-06 02:38:22,661][52668] DAMAGECOUNT value on done: 323881.0 [2024-08-06 02:38:22,662][52668] Sum rewards: 62.044, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.358', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.194', 'weapon4': '0.200', 'AMMO3': '0.239', 'AMMO4': '0.260', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:22,716][52658] DAMAGECOUNT value on done: 316688.0 [2024-08-06 02:38:22,716][52658] Sum rewards: 49.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.510', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.168', 'weapon5': '0.242', 'AMMO4': '0.257', 'AMMO3': '0.277', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.610', 'weapon3': '3.064', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '45.000'} [2024-08-06 02:38:22,794][52567] Fps is (10 sec: 17205.2, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 324567040. Throughput: 0: 4374.0. Samples: 81146110. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:38:22,794][52567] Avg episode reward: [(0, '69.031')] [2024-08-06 02:38:22,921][52650] Updated weights for policy 0, policy_version 39621 (0.0013) [2024-08-06 02:38:23,264][52794] DAMAGECOUNT value on done: 324191.0 [2024-08-06 02:38:23,265][52794] Sum rewards: 72.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.248', 'weapon4': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:24,086][52795] DAMAGECOUNT value on done: 300014.0 [2024-08-06 02:38:24,089][52795] Sum rewards: 61.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.325', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon2': '0.148', 'AMMO3': '0.193', 'weapon5': '0.200', 'AMMO4': '0.222', 'weapon4': '0.444', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '51.000'} [2024-08-06 02:38:24,209][52649] DAMAGECOUNT value on done: 320441.0 [2024-08-06 02:38:24,217][52649] Sum rewards: 78.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.338', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:24,213][52811] DAMAGECOUNT value on done: 301602.0 [2024-08-06 02:38:24,221][52811] Sum rewards: 57.389, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.028', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon4': '0.058', 'AMMO3': '0.145', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.241', 'weapon2': '0.758', 'WEAPON3': '0.900', 'weapon3': '2.806', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.089', 'FRAGCOUNT': '46.000'} [2024-08-06 02:38:24,379][52671] DAMAGECOUNT value on done: 325941.0 [2024-08-06 02:38:24,380][52671] Sum rewards: 58.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.108', 'AMMO4': '0.174', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.238', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '48.000'} [2024-08-06 02:38:24,534][52660] DAMAGECOUNT value on done: 315666.0 [2024-08-06 02:38:24,534][52660] Sum rewards: 66.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.345', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.096', 'weapon5': '0.240', 'AMMO3': '0.245', 'AMMO4': '0.327', 'weapon2': '0.466', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:25,567][52669] DAMAGECOUNT value on done: 329734.0 [2024-08-06 02:38:25,568][52669] Sum rewards: 82.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.145', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.102', 'AMMO4': '0.166', 'AMMO3': '0.224', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '68.000'} [2024-08-06 02:38:25,703][52803] DAMAGECOUNT value on done: 307669.0 [2024-08-06 02:38:25,705][52803] Sum rewards: 72.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.572', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.272', 'weapon2': '0.564', 'WEAPON3': '1.650', 'weapon3': '3.124', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:25,729][52668] DAMAGECOUNT value on done: 325949.0 [2024-08-06 02:38:25,729][52668] Sum rewards: 72.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.204', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:25,816][52658] DAMAGECOUNT value on done: 331930.0 [2024-08-06 02:38:25,816][52658] Sum rewards: 64.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.444', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.182', 'weapon2': '0.218', 'AMMO3': '0.232', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:26,015][52794] DAMAGECOUNT value on done: 329202.0 [2024-08-06 02:38:26,015][52794] Sum rewards: 59.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.130', 'AMMO4': '0.175', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.304', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '48.500'} [2024-08-06 02:38:27,243][52795] DAMAGECOUNT value on done: 290987.0 [2024-08-06 02:38:27,243][52795] Sum rewards: 72.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon4': '0.224', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:27,355][52671] DAMAGECOUNT value on done: 324742.0 [2024-08-06 02:38:27,358][52671] Sum rewards: 62.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.302', 'weapon4': '0.318', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.122', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:27,419][52811] DAMAGECOUNT value on done: 304042.0 [2024-08-06 02:38:27,421][52811] Sum rewards: 60.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.394', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.084', 'AMMO4': '0.193', 'AMMO3': '0.202', 'weapon5': '0.204', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.310', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '51.500'} [2024-08-06 02:38:27,526][52660] DAMAGECOUNT value on done: 318290.0 [2024-08-06 02:38:27,527][52660] Sum rewards: 68.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.752', 'AMMO5': '0.012', 'AMMO2': '0.036', 'ARMOR': '0.040', 'weapon5': '0.130', 'AMMO4': '0.178', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 324648960. Throughput: 0: 4379.6. Samples: 81172670. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:38:27,794][52567] Avg episode reward: [(0, '68.645')] [2024-08-06 02:38:27,839][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039631_324657152.pth... [2024-08-06 02:38:27,867][52650] Updated weights for policy 0, policy_version 39631 (0.0012) [2024-08-06 02:38:28,009][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039118_320454656.pth [2024-08-06 02:38:28,345][52669] DAMAGECOUNT value on done: 339876.0 [2024-08-06 02:38:28,345][52669] Sum rewards: 78.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.135', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.125', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.000', 'weapon3': '3.294', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '62.500'} [2024-08-06 02:38:28,662][52668] DAMAGECOUNT value on done: 320145.0 [2024-08-06 02:38:28,663][52668] Sum rewards: 67.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.596', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:28,754][52794] DAMAGECOUNT value on done: 326952.0 [2024-08-06 02:38:28,756][52794] Sum rewards: 69.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.428', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon2': '0.266', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.454', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:28,836][52658] DAMAGECOUNT value on done: 326055.0 [2024-08-06 02:38:28,838][52658] Sum rewards: 69.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.244', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.054', 'weapon4': '0.096', 'AMMO4': '0.124', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:28,939][52803] DAMAGECOUNT value on done: 302143.0 [2024-08-06 02:38:28,940][52803] Sum rewards: 75.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.662', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:29,646][52820] DAMAGECOUNT value on done: 295423.0 [2024-08-06 02:38:29,646][52820] Sum rewards: 69.474, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.133', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '0.900', 'weapon3': '3.144', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:30,573][52795] DAMAGECOUNT value on done: 302083.0 [2024-08-06 02:38:30,576][52795] Sum rewards: 68.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.630', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.128', 'weapon4': '0.146', 'AMMO4': '0.174', 'AMMO3': '0.249', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:30,618][52660] DAMAGECOUNT value on done: 329196.0 [2024-08-06 02:38:30,619][52660] Sum rewards: 76.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.112', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.213', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.398', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:30,641][52811] DAMAGECOUNT value on done: 300336.0 [2024-08-06 02:38:30,642][52811] Sum rewards: 60.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.062', 'AMMO3': '0.155', 'AMMO4': '0.159', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.060', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '50.000'} [2024-08-06 02:38:30,750][52671] DAMAGECOUNT value on done: 331539.0 [2024-08-06 02:38:30,751][52671] Sum rewards: 58.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.030', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon5': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.686', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '49.500'} [2024-08-06 02:38:30,952][52669] DAMAGECOUNT value on done: 325815.0 [2024-08-06 02:38:30,952][52669] Sum rewards: 63.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.098', 'AMMO4': '0.131', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.218', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '54.500'} [2024-08-06 02:38:31,713][52658] DAMAGECOUNT value on done: 332692.0 [2024-08-06 02:38:31,715][52658] Sum rewards: 60.639, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:31,993][52794] DAMAGECOUNT value on done: 322950.0 [2024-08-06 02:38:31,994][52794] Sum rewards: 71.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.914', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:32,003][52803] DAMAGECOUNT value on done: 306718.0 [2024-08-06 02:38:32,004][52803] Sum rewards: 74.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.465', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.102', 'AMMO4': '0.164', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:32,693][52650] Updated weights for policy 0, policy_version 39641 (0.0012) [2024-08-06 02:38:32,748][52820] DAMAGECOUNT value on done: 300169.0 [2024-08-06 02:38:32,752][52820] Sum rewards: 71.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.270', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 324739072. Throughput: 0: 4370.4. Samples: 81185410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:38:32,794][52567] Avg episode reward: [(0, '68.913')] [2024-08-06 02:38:33,060][52660] DAMAGECOUNT value on done: 331326.0 [2024-08-06 02:38:33,061][52660] Sum rewards: 67.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.346', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.103', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:33,493][52671] DAMAGECOUNT value on done: 322760.0 [2024-08-06 02:38:33,501][52671] Sum rewards: 64.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.835', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon2': '0.232', 'AMMO3': '0.238', 'weapon5': '0.246', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'weapon4': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.798', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:33,683][52811] DAMAGECOUNT value on done: 306209.0 [2024-08-06 02:38:33,683][52811] Sum rewards: 56.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.106', 'AMMO3': '0.185', 'weapon4': '0.190', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.988', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '47.000'} [2024-08-06 02:38:33,970][52669] DAMAGECOUNT value on done: 328216.0 [2024-08-06 02:38:33,970][52669] Sum rewards: 63.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.906', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.126', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.218', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:33,983][52795] DAMAGECOUNT value on done: 305278.0 [2024-08-06 02:38:33,983][52795] Sum rewards: 68.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.172', 'AMMO3': '0.175', 'weapon4': '0.262', 'AMMO4': '0.282', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:34,567][52658] DAMAGECOUNT value on done: 317472.0 [2024-08-06 02:38:34,567][52658] Sum rewards: 63.658, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.395', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.180', 'weapon5': '0.228', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '2.992', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '56.500'} [2024-08-06 02:38:35,047][52803] DAMAGECOUNT value on done: 297205.0 [2024-08-06 02:38:35,047][52803] Sum rewards: 72.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.827', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon4': '0.184', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon5': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '59.500'} [2024-08-06 02:38:35,079][52794] DAMAGECOUNT value on done: 326775.0 [2024-08-06 02:38:35,079][52794] Sum rewards: 68.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.197', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.064', 'AMMO4': '0.089', 'weapon5': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:35,403][52660] DAMAGECOUNT value on done: 319088.0 [2024-08-06 02:38:35,405][52660] Sum rewards: 62.338, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.715', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.157', 'weapon5': '0.226', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '50.500'} [2024-08-06 02:38:35,793][52820] DAMAGECOUNT value on done: 297362.0 [2024-08-06 02:38:35,793][52820] Sum rewards: 60.169, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.795', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.128', 'weapon5': '0.176', 'weapon2': '0.286', 'AMMO3': '0.291', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.078', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:36,475][52671] DAMAGECOUNT value on done: 328309.0 [2024-08-06 02:38:36,477][52671] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.520', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.149', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:36,579][52670] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:38:36,887][52650] Updated weights for policy 0, policy_version 39651 (0.0011) [2024-08-06 02:38:36,989][52669] DAMAGECOUNT value on done: 326760.0 [2024-08-06 02:38:36,989][52669] Sum rewards: 63.371, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.170', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon5': '0.136', 'weapon4': '0.190', 'AMMO3': '0.253', 'AMMO4': '0.292', 'weapon2': '0.406', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.950', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:37,204][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:38:37,284][52658] DAMAGECOUNT value on done: 325529.0 [2024-08-06 02:38:37,284][52658] Sum rewards: 63.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.214', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon2': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.210', 'weapon5': '0.210', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.032', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:37,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 324837376. Throughput: 0: 4372.2. Samples: 81211690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:38:37,794][52567] Avg episode reward: [(0, '68.219')] [2024-08-06 02:38:37,947][52794] DAMAGECOUNT value on done: 316918.0 [2024-08-06 02:38:37,947][52794] Sum rewards: 67.153, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.295', 'AMMO5': '0.017', 'AMMO2': '0.071', 'weapon5': '0.174', 'AMMO3': '0.236', 'weapon4': '0.340', 'AMMO4': '0.357', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.716', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:38,054][52660] DAMAGECOUNT value on done: 322004.0 [2024-08-06 02:38:38,055][52660] Sum rewards: 66.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO4': '0.153', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '56.500'} [2024-08-06 02:38:38,931][52820] DAMAGECOUNT value on done: 294380.0 [2024-08-06 02:38:38,940][52820] Sum rewards: 67.483, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.132', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.494', 'HEALTH': '0.521', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '54.000'} [2024-08-06 02:38:39,436][52671] DAMAGECOUNT value on done: 327502.0 [2024-08-06 02:38:39,437][52671] Sum rewards: 58.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.700', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.080', 'weapon5': '0.118', 'AMMO4': '0.119', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '48.000'} [2024-08-06 02:38:39,836][52658] DAMAGECOUNT value on done: 323513.0 [2024-08-06 02:38:39,838][52658] Sum rewards: 57.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.575', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.120', 'AMMO4': '0.193', 'weapon4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.184', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '49.000'} [2024-08-06 02:38:40,194][52669] DAMAGECOUNT value on done: 329238.0 [2024-08-06 02:38:40,194][52669] Sum rewards: 61.563, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.056', 'HEALTH': '0.154', 'weapon5': '0.184', 'AMMO4': '0.196', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.714', 'WEAPON3': '1.100', 'weapon3': '2.708', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '50.000'} [2024-08-06 02:38:40,819][52660] DAMAGECOUNT value on done: 316958.0 [2024-08-06 02:38:40,819][52660] Sum rewards: 75.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.645', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.158', 'weapon4': '0.182', 'weapon2': '0.212', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.000'} [2024-08-06 02:38:40,896][52794] DAMAGECOUNT value on done: 332330.0 [2024-08-06 02:38:40,898][52794] Sum rewards: 79.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.137', 'weapon4': '0.214', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 02:38:41,150][52670] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:38:41,763][52650] Updated weights for policy 0, policy_version 39661 (0.0021) [2024-08-06 02:38:42,061][52820] DAMAGECOUNT value on done: 299750.0 [2024-08-06 02:38:42,062][52820] Sum rewards: 63.585, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.116', 'weapon5': '0.116', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '54.500'} [2024-08-06 02:38:42,271][52671] DAMAGECOUNT value on done: 320532.0 [2024-08-06 02:38:42,272][52671] Sum rewards: 70.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.972', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.191', 'weapon5': '0.228', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:42,430][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 02:38:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 324919296. Throughput: 0: 4382.0. Samples: 81238330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:38:42,794][52567] Avg episode reward: [(0, '68.016')] [2024-08-06 02:38:42,995][52658] DAMAGECOUNT value on done: 320379.0 [2024-08-06 02:38:42,996][52658] Sum rewards: 68.595, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.500', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.188', 'AMMO4': '0.226', 'weapon4': '0.240', 'AMMO3': '0.287', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.846', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:43,359][52794] DAMAGECOUNT value on done: 321295.0 [2024-08-06 02:38:43,361][52794] Sum rewards: 81.798, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '65.000'} [2024-08-06 02:38:43,766][52660] DAMAGECOUNT value on done: 326153.0 [2024-08-06 02:38:43,767][52660] Sum rewards: 71.064, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.197', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:45,169][52820] DAMAGECOUNT value on done: 293014.0 [2024-08-06 02:38:45,170][52820] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.954', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.142', 'AMMO4': '0.234', 'AMMO3': '0.258', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '2.756', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '51.000'} [2024-08-06 02:38:45,511][52671] DAMAGECOUNT value on done: 328227.0 [2024-08-06 02:38:45,511][52671] Sum rewards: 69.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.752', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.052', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO4': '0.172', 'AMMO3': '0.183', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:45,682][52794] DAMAGECOUNT value on done: 335170.0 [2024-08-06 02:38:45,682][52794] Sum rewards: 74.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.894', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.245', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '63.000'} [2024-08-06 02:38:46,149][52658] DAMAGECOUNT value on done: 317312.0 [2024-08-06 02:38:46,150][52658] Sum rewards: 56.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.218', 'weapon7': '0.002', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.196', 'AMMO3': '0.221', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.454', 'weapon2': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '47.000'} [2024-08-06 02:38:46,185][52650] Updated weights for policy 0, policy_version 39671 (0.0027) [2024-08-06 02:38:46,325][52660] DAMAGECOUNT value on done: 319282.0 [2024-08-06 02:38:46,326][52660] Sum rewards: 58.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.420', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.161', 'AMMO4': '0.169', 'weapon5': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '0.950', 'weapon3': '2.734', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '46.000'} [2024-08-06 02:38:47,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 325001216. Throughput: 0: 4377.8. Samples: 81251570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:38:47,795][52567] Avg episode reward: [(0, '67.753')] [2024-08-06 02:38:48,340][52671] DAMAGECOUNT value on done: 330856.0 [2024-08-06 02:38:48,342][52671] Sum rewards: 68.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.216', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon4': '0.082', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.290', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:48,411][52820] DAMAGECOUNT value on done: 297160.0 [2024-08-06 02:38:48,413][52820] Sum rewards: 68.077, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.730', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.076', 'AMMO4': '0.148', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '58.000'} [2024-08-06 02:38:48,538][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:38:48,725][52794] DAMAGECOUNT value on done: 325923.0 [2024-08-06 02:38:48,725][52794] Sum rewards: 67.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.510', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:48,866][52658] DAMAGECOUNT value on done: 330516.0 [2024-08-06 02:38:48,866][52658] Sum rewards: 74.637, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.904', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.092', 'weapon4': '0.202', 'AMMO4': '0.209', 'weapon2': '0.248', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '66.000'} [2024-08-06 02:38:51,047][52650] Updated weights for policy 0, policy_version 39681 (0.0024) [2024-08-06 02:38:51,218][52671] DAMAGECOUNT value on done: 325052.0 [2024-08-06 02:38:51,219][52671] Sum rewards: 74.652, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.922', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.082', 'AMMO4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '61.000'} [2024-08-06 02:38:51,494][52820] DAMAGECOUNT value on done: 302794.0 [2024-08-06 02:38:51,497][52820] Sum rewards: 68.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.188', 'AMMO3': '0.246', 'weapon2': '0.258', 'AMMO4': '0.273', 'weapon5': '0.292', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.914', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '57.000'} [2024-08-06 02:38:51,525][52794] DAMAGECOUNT value on done: 326863.0 [2024-08-06 02:38:51,526][52794] Sum rewards: 64.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.305', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.146', 'AMMO4': '0.155', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.190', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:51,879][52658] DAMAGECOUNT value on done: 321695.0 [2024-08-06 02:38:51,879][52658] Sum rewards: 74.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.237', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '62.000'} [2024-08-06 02:38:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.4). Total num frames: 325099520. Throughput: 0: 4388.0. Samples: 81277980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:38:52,794][52567] Avg episode reward: [(0, '67.910')] [2024-08-06 02:38:54,035][52671] DAMAGECOUNT value on done: 334819.0 [2024-08-06 02:38:54,035][52671] Sum rewards: 66.020, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.932', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.294', 'AMMO3': '0.308', 'WEAPON3': '1.900', 'weapon3': '3.250', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '60.000'} [2024-08-06 02:38:54,364][52794] DAMAGECOUNT value on done: 335484.0 [2024-08-06 02:38:54,365][52794] Sum rewards: 65.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.175', 'weapon5': '0.220', 'AMMO4': '0.302', 'weapon4': '0.352', 'weapon2': '0.372', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.738', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:54,585][52658] DAMAGECOUNT value on done: 324910.0 [2024-08-06 02:38:54,586][52658] Sum rewards: 62.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.133', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.264', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '53.000'} [2024-08-06 02:38:54,685][52820] DAMAGECOUNT value on done: 298770.0 [2024-08-06 02:38:54,686][52820] Sum rewards: 67.092, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.428', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.204', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '55.000'} [2024-08-06 02:38:55,442][52650] Updated weights for policy 0, policy_version 39691 (0.0014) [2024-08-06 02:38:57,200][52671] DAMAGECOUNT value on done: 322866.0 [2024-08-06 02:38:57,202][52671] Sum rewards: 73.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.255', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.110', 'weapon5': '0.138', 'AMMO4': '0.155', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '59.000'} [2024-08-06 02:38:57,549][52794] DAMAGECOUNT value on done: 325987.0 [2024-08-06 02:38:57,550][52794] Sum rewards: 71.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.812', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.066', 'AMMO4': '0.126', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '58.500'} [2024-08-06 02:38:57,757][52658] DAMAGECOUNT value on done: 328898.0 [2024-08-06 02:38:57,758][52658] Sum rewards: 67.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.090', 'weapon5': '0.134', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.796', 'WEAPON3': '1.250', 'weapon3': '2.726', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '56.000'} [2024-08-06 02:38:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 325181440. Throughput: 0: 4393.0. Samples: 81304120. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:38:57,794][52567] Avg episode reward: [(0, '67.675')] [2024-08-06 02:38:57,800][52820] DAMAGECOUNT value on done: 301182.0 [2024-08-06 02:38:57,800][52820] Sum rewards: 63.761, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.055', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.120', 'weapon5': '0.148', 'AMMO4': '0.193', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.720', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '53.000'} [2024-08-06 02:39:00,154][52650] Updated weights for policy 0, policy_version 39701 (0.0012) [2024-08-06 02:39:00,343][52664] DAMAGECOUNT value on done: 336826.0 [2024-08-06 02:39:00,344][52664] Sum rewards: 68.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.150', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.189', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:00,400][52671] DAMAGECOUNT value on done: 318163.0 [2024-08-06 02:39:00,400][52671] Sum rewards: 68.078, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.323', 'AMMO5': '0.017', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.800', 'weapon3': '3.228', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '61.000'} [2024-08-06 02:39:00,892][52820] DAMAGECOUNT value on done: 299837.0 [2024-08-06 02:39:00,895][52820] Sum rewards: 66.165, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.774', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.136', 'weapon4': '0.156', 'AMMO4': '0.251', 'AMMO3': '0.251', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:02,683][52666] DAMAGECOUNT value on done: 325928.0 [2024-08-06 02:39:02,685][52666] Sum rewards: 64.876, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.232', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.176', 'weapon4': '0.202', 'weapon2': '0.224', 'AMMO4': '0.238', 'AMMO3': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.124', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '57.000'} [2024-08-06 02:39:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 325263360. Throughput: 0: 4383.3. Samples: 81317030. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:39:02,794][52567] Avg episode reward: [(0, '67.603')] [2024-08-06 02:39:03,019][52614] Signal inference workers to stop experience collection... (7150 times) [2024-08-06 02:39:03,020][52614] Signal inference workers to resume experience collection... (7150 times) [2024-08-06 02:39:03,120][52650] InferenceWorker_p0-w0: stopping experience collection (7150 times) [2024-08-06 02:39:03,120][52650] InferenceWorker_p0-w0: resuming experience collection (7150 times) [2024-08-06 02:39:03,509][52671] DAMAGECOUNT value on done: 330765.0 [2024-08-06 02:39:03,510][52671] Sum rewards: 70.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.072', 'weapon5': '0.158', 'AMMO3': '0.201', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:03,525][52664] DAMAGECOUNT value on done: 338256.0 [2024-08-06 02:39:03,525][52664] Sum rewards: 82.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.564', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.154', 'AMMO3': '0.189', 'weapon2': '0.198', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '67.000'} [2024-08-06 02:39:04,023][52820] DAMAGECOUNT value on done: 300797.0 [2024-08-06 02:39:04,024][52820] Sum rewards: 69.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.105', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon2': '0.152', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.644', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:05,275][52666] DAMAGECOUNT value on done: 326865.0 [2024-08-06 02:39:05,275][52666] Sum rewards: 51.279, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.040', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.104', 'AMMO3': '0.154', 'weapon2': '0.214', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '3.600', 'DAMAGECOUNT': '12.906', 'FRAGCOUNT': '41.000'} [2024-08-06 02:39:05,279][52650] Updated weights for policy 0, policy_version 39711 (0.0020) [2024-08-06 02:39:05,566][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:39:06,164][52671] DAMAGECOUNT value on done: 329617.0 [2024-08-06 02:39:06,165][52671] Sum rewards: 56.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon7': '0.070', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.190', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.315', 'weapon4': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '49.000'} [2024-08-06 02:39:06,664][52664] DAMAGECOUNT value on done: 339590.0 [2024-08-06 02:39:06,665][52664] Sum rewards: 67.923, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.876', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.114', 'AMMO4': '0.173', 'weapon4': '0.212', 'AMMO3': '0.257', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '57.500'} [2024-08-06 02:39:07,300][52820] DAMAGECOUNT value on done: 302139.0 [2024-08-06 02:39:07,301][52820] Sum rewards: 76.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '62.000'} [2024-08-06 02:39:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 325353472. Throughput: 0: 4377.6. Samples: 81343100. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:39:07,794][52567] Avg episode reward: [(0, '67.418')] [2024-08-06 02:39:08,027][52666] DAMAGECOUNT value on done: 329328.0 [2024-08-06 02:39:08,029][52666] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'weapon4': '0.138', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:08,628][52671] DAMAGECOUNT value on done: 331544.0 [2024-08-06 02:39:08,628][52671] Sum rewards: 60.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.622', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.002', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '49.000'} [2024-08-06 02:39:08,824][52670] DAMAGECOUNT value on done: 321254.0 [2024-08-06 02:39:08,840][52670] Sum rewards: 65.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.988', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.045', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.390', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '56.000'} [2024-08-06 02:39:09,461][52650] Updated weights for policy 0, policy_version 39721 (0.0013) [2024-08-06 02:39:09,530][52664] DAMAGECOUNT value on done: 335432.0 [2024-08-06 02:39:09,532][52664] Sum rewards: 75.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.104', 'weapon2': '0.144', 'AMMO4': '0.145', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '60.000'} [2024-08-06 02:39:09,738][52659] DAMAGECOUNT value on done: 327208.0 [2024-08-06 02:39:09,738][52659] Sum rewards: 59.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.045', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.164', 'weapon4': '0.178', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '2.920', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '50.000'} [2024-08-06 02:39:10,501][52820] DAMAGECOUNT value on done: 302926.0 [2024-08-06 02:39:10,501][52820] Sum rewards: 77.400, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.152', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.328', 'WEAPON3': '1.000', 'weapon3': '2.932', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '62.000'} [2024-08-06 02:39:10,854][52666] DAMAGECOUNT value on done: 324113.0 [2024-08-06 02:39:10,854][52666] Sum rewards: 70.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.042', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.802', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:11,500][52671] DAMAGECOUNT value on done: 325183.0 [2024-08-06 02:39:11,501][52671] Sum rewards: 72.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.130', 'AMMO3': '0.172', 'weapon2': '0.188', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.540', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '60.000'} [2024-08-06 02:39:11,574][52670] DAMAGECOUNT value on done: 324524.0 [2024-08-06 02:39:11,575][52670] Sum rewards: 58.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.158', 'weapon4': '0.164', 'AMMO4': '0.185', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '50.000'} [2024-08-06 02:39:12,658][52664] DAMAGECOUNT value on done: 335713.0 [2024-08-06 02:39:12,658][52664] Sum rewards: 74.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon2': '0.218', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.440', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '64.000'} [2024-08-06 02:39:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.6, 300 sec: 17550.3). Total num frames: 325443584. Throughput: 0: 4374.7. Samples: 81369530. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:39:12,794][52567] Avg episode reward: [(0, '67.256')] [2024-08-06 02:39:12,804][52659] DAMAGECOUNT value on done: 325981.0 [2024-08-06 02:39:12,806][52659] Sum rewards: 79.180, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.451', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.274', 'weapon4': '0.368', 'weapon2': '0.394', 'WEAPON3': '1.650', 'weapon3': '2.770', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '68.000'} [2024-08-06 02:39:13,587][52666] DAMAGECOUNT value on done: 321213.0 [2024-08-06 02:39:13,588][52666] Sum rewards: 70.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.214', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.132', 'weapon5': '0.152', 'AMMO4': '0.161', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:13,776][52820] DAMAGECOUNT value on done: 304068.0 [2024-08-06 02:39:13,778][52820] Sum rewards: 64.622, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.830', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.072', 'AMMO4': '0.167', 'weapon4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.228', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:14,185][52670] DAMAGECOUNT value on done: 318939.0 [2024-08-06 02:39:14,186][52670] Sum rewards: 67.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon2': '0.152', 'AMMO3': '0.184', 'weapon5': '0.198', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.576', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '54.000'} [2024-08-06 02:39:14,298][52650] Updated weights for policy 0, policy_version 39731 (0.0033) [2024-08-06 02:39:14,676][52671] DAMAGECOUNT value on done: 323870.0 [2024-08-06 02:39:14,676][52671] Sum rewards: 78.912, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.143', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.113', 'weapon5': '0.118', 'AMMO3': '0.135', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '0.900', 'weapon3': '3.172', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '60.500'} [2024-08-06 02:39:15,799][52659] DAMAGECOUNT value on done: 325890.0 [2024-08-06 02:39:15,801][52659] Sum rewards: 72.954, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.668', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.152', 'AMMO4': '0.176', 'weapon5': '0.188', 'weapon2': '0.240', 'WEAPON5': '0.300', 'AMMO3': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.110', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '64.000'} [2024-08-06 02:39:15,840][52664] DAMAGECOUNT value on done: 336260.0 [2024-08-06 02:39:15,843][52664] Sum rewards: 66.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.167', 'weapon4': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.120', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '54.000'} [2024-08-06 02:39:16,330][52666] DAMAGECOUNT value on done: 315632.0 [2024-08-06 02:39:16,332][52666] Sum rewards: 69.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.114', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:16,904][52670] DAMAGECOUNT value on done: 316698.0 [2024-08-06 02:39:16,906][52670] Sum rewards: 67.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.246', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:16,921][52820] DAMAGECOUNT value on done: 300884.0 [2024-08-06 02:39:16,921][52820] Sum rewards: 63.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon5': '0.168', 'AMMO4': '0.194', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.164', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2024-08-06 02:39:17,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 325541888. Throughput: 0: 4390.0. Samples: 81382960. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:39:17,794][52567] Avg episode reward: [(0, '67.644')] [2024-08-06 02:39:18,128][52811] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2024-08-06 02:39:18,757][52659] DAMAGECOUNT value on done: 325227.0 [2024-08-06 02:39:18,759][52659] Sum rewards: 47.294, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.196', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon7': '0.082', 'weapon5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.232', 'AMMO4': '0.312', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.700', 'weapon4': '0.766', 'WEAPON3': '1.400', 'weapon3': '2.332', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '43.500'} [2024-08-06 02:39:18,808][52664] DAMAGECOUNT value on done: 338153.0 [2024-08-06 02:39:18,808][52664] Sum rewards: 65.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.990', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.254', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.146', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '57.000'} [2024-08-06 02:39:19,155][52666] DAMAGECOUNT value on done: 325895.0 [2024-08-06 02:39:19,156][52666] Sum rewards: 75.255, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.632', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.158', 'AMMO3': '0.177', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:19,357][52650] Updated weights for policy 0, policy_version 39741 (0.0010) [2024-08-06 02:39:19,965][52670] DAMAGECOUNT value on done: 330272.0 [2024-08-06 02:39:19,966][52670] Sum rewards: 71.296, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.088', 'weapon4': '0.154', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.004', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '63.000'} [2024-08-06 02:39:20,041][52820] DAMAGECOUNT value on done: 298058.0 [2024-08-06 02:39:20,041][52820] Sum rewards: 74.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.203', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.470', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '61.000'} [2024-08-06 02:39:21,600][52659] DAMAGECOUNT value on done: 319502.0 [2024-08-06 02:39:21,601][52659] Sum rewards: 68.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.136', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.082', 'weapon5': '0.176', 'AMMO3': '0.244', 'AMMO4': '0.265', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.188', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:21,799][52666] DAMAGECOUNT value on done: 323254.0 [2024-08-06 02:39:21,801][52666] Sum rewards: 83.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.284', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.112', 'weapon2': '0.162', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.518', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '71.000'} [2024-08-06 02:39:21,889][52664] DAMAGECOUNT value on done: 329012.0 [2024-08-06 02:39:21,889][52664] Sum rewards: 63.072, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.410', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.162', 'weapon4': '0.212', 'AMMO4': '0.271', 'AMMO3': '0.277', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.910', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '57.000'} [2024-08-06 02:39:22,340][52670] DAMAGECOUNT value on done: 321474.0 [2024-08-06 02:39:22,341][52670] Sum rewards: 65.343, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.370', 'weapon4': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.768', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '54.000'} [2024-08-06 02:39:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 325615616. Throughput: 0: 4389.1. Samples: 81409200. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:39:22,794][52567] Avg episode reward: [(0, '67.730')] [2024-08-06 02:39:23,334][52820] DAMAGECOUNT value on done: 308280.0 [2024-08-06 02:39:23,335][52820] Sum rewards: 63.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.380', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.616', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '54.000'} [2024-08-06 02:39:23,534][52650] Updated weights for policy 0, policy_version 39751 (0.0014) [2024-08-06 02:39:24,694][52666] DAMAGECOUNT value on done: 320022.0 [2024-08-06 02:39:24,694][52666] Sum rewards: 68.153, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.262', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon5': '0.122', 'AMMO4': '0.160', 'weapon4': '0.186', 'AMMO3': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.800', 'weapon3': '2.998', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '61.000'} [2024-08-06 02:39:24,857][52659] DAMAGECOUNT value on done: 323641.0 [2024-08-06 02:39:24,858][52659] Sum rewards: 56.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.717', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.172', 'weapon5': '0.212', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '3.048', 'DAMAGECOUNT': '13.887', 'FRAGCOUNT': '50.000'} [2024-08-06 02:39:25,286][52664] DAMAGECOUNT value on done: 342290.0 [2024-08-06 02:39:25,286][52664] Sum rewards: 58.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.912', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.224', 'weapon2': '0.244', 'AMMO3': '0.256', 'WEAPON4': '0.450', 'weapon4': '0.656', 'WEAPON3': '1.600', 'weapon3': '2.744', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '52.000'} [2024-08-06 02:39:25,413][52670] DAMAGECOUNT value on done: 316552.0 [2024-08-06 02:39:25,416][52670] Sum rewards: 73.081, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.179', 'weapon4': '0.182', 'AMMO4': '0.272', 'weapon5': '0.312', 'weapon2': '0.320', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'HEALTH': '0.601', 'WEAPON3': '0.950', 'weapon3': '2.856', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '61.000'} [2024-08-06 02:39:26,462][52820] DAMAGECOUNT value on done: 310565.0 [2024-08-06 02:39:26,466][52820] Sum rewards: 65.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.100', 'AMMO3': '0.189', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '55.000'} [2024-08-06 02:39:27,755][52664] DAMAGECOUNT value on done: 334628.0 [2024-08-06 02:39:27,755][52664] Sum rewards: 57.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.878', 'AMMO2': '0.030', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.188', 'weapon2': '0.770', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '48.000'} [2024-08-06 02:39:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 325705728. Throughput: 0: 4375.3. Samples: 81435220. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:39:27,795][52567] Avg episode reward: [(0, '67.289')] [2024-08-06 02:39:27,842][52666] DAMAGECOUNT value on done: 319067.0 [2024-08-06 02:39:27,844][52666] Sum rewards: 63.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.162', 'weapon5': '0.176', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.106', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '53.500'} [2024-08-06 02:39:28,087][52659] DAMAGECOUNT value on done: 326458.0 [2024-08-06 02:39:28,088][52659] Sum rewards: 71.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.891', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO4': '0.178', 'weapon4': '0.192', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:28,263][52650] Updated weights for policy 0, policy_version 39761 (0.0012) [2024-08-06 02:39:28,652][52670] DAMAGECOUNT value on done: 319219.0 [2024-08-06 02:39:28,654][52670] Sum rewards: 63.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.239', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.082', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '53.000'} [2024-08-06 02:39:29,598][52663] DAMAGECOUNT value on done: 330126.0 [2024-08-06 02:39:29,599][52663] Sum rewards: 68.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.127', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.714', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '55.500'} [2024-08-06 02:39:29,641][52820] DAMAGECOUNT value on done: 299115.0 [2024-08-06 02:39:29,641][52820] Sum rewards: 68.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.111', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.092', 'AMMO4': '0.097', 'weapon5': '0.110', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '56.000'} [2024-08-06 02:39:30,631][52664] DAMAGECOUNT value on done: 339776.0 [2024-08-06 02:39:30,631][52664] Sum rewards: 69.283, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.861', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.128', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.358', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '61.000'} [2024-08-06 02:39:31,075][52666] DAMAGECOUNT value on done: 319929.0 [2024-08-06 02:39:31,077][52666] Sum rewards: 77.677, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.460', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.194', 'AMMO4': '0.235', 'weapon2': '0.266', 'AMMO3': '0.267', 'weapon4': '0.326', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.888', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.871', 'FRAGCOUNT': '66.000'} [2024-08-06 02:39:31,116][52659] DAMAGECOUNT value on done: 321556.0 [2024-08-06 02:39:31,117][52659] Sum rewards: 75.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.558', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.186', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '63.000'} [2024-08-06 02:39:31,849][52670] DAMAGECOUNT value on done: 320382.0 [2024-08-06 02:39:31,851][52670] Sum rewards: 70.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.524', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.094', 'AMMO3': '0.239', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:32,716][52663] DAMAGECOUNT value on done: 321352.0 [2024-08-06 02:39:32,720][52663] Sum rewards: 57.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.228', 'weapon5': '0.270', 'AMMO4': '0.280', 'weapon4': '0.318', 'weapon2': '0.356', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '49.000'} [2024-08-06 02:39:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 325795840. Throughput: 0: 4378.2. Samples: 81448590. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:39:32,794][52567] Avg episode reward: [(0, '67.606')] [2024-08-06 02:39:33,214][52650] Updated weights for policy 0, policy_version 39771 (0.0013) [2024-08-06 02:39:33,278][52664] DAMAGECOUNT value on done: 336615.0 [2024-08-06 02:39:33,279][52664] Sum rewards: 74.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.450', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.161', 'weapon2': '0.590', 'WEAPON3': '1.000', 'weapon3': '3.208', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:34,043][52665] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:39:34,157][52659] DAMAGECOUNT value on done: 332870.0 [2024-08-06 02:39:34,159][52659] Sum rewards: 63.290, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.088', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.092', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '56.000'} [2024-08-06 02:39:34,271][52666] DAMAGECOUNT value on done: 317795.0 [2024-08-06 02:39:34,272][52666] Sum rewards: 84.865, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.522', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.156', 'weapon2': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.592', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '67.000'} [2024-08-06 02:39:35,030][52670] DAMAGECOUNT value on done: 313673.0 [2024-08-06 02:39:35,031][52670] Sum rewards: 58.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.839', 'AMMO5': '0.030', 'AMMO2': '0.083', 'weapon4': '0.206', 'AMMO3': '0.217', 'weapon5': '0.222', 'weapon2': '0.246', 'AMMO4': '0.413', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '2.984', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '51.000'} [2024-08-06 02:39:35,811][52663] DAMAGECOUNT value on done: 322891.0 [2024-08-06 02:39:35,821][52663] Sum rewards: 54.946, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.216', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.174', 'weapon4': '0.268', 'AMMO4': '0.283', 'AMMO3': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'HITCOUNT': '2.800', 'weapon3': '2.890', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '51.000'} [2024-08-06 02:39:36,126][52664] DAMAGECOUNT value on done: 344730.0 [2024-08-06 02:39:36,126][52664] Sum rewards: 70.569, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.674', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.140', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '57.500'} [2024-08-06 02:39:36,464][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:39:37,065][52666] DAMAGECOUNT value on done: 328096.0 [2024-08-06 02:39:37,066][52666] Sum rewards: 79.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.174', 'AMMO3': '0.196', 'AMMO4': '0.206', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 02:39:37,345][52659] DAMAGECOUNT value on done: 330654.0 [2024-08-06 02:39:37,347][52659] Sum rewards: 64.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.878', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.102', 'weapon5': '0.138', 'AMMO4': '0.158', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.862', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '53.000'} [2024-08-06 02:39:37,513][52650] Updated weights for policy 0, policy_version 39781 (0.0012) [2024-08-06 02:39:37,718][52670] DAMAGECOUNT value on done: 329185.0 [2024-08-06 02:39:37,726][52670] Sum rewards: 72.135, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.574', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.144', 'AMMO3': '0.158', 'weapon4': '0.176', 'AMMO4': '0.254', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 325885952. Throughput: 0: 4370.6. Samples: 81474660. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:39:37,795][52567] Avg episode reward: [(0, '67.947')] [2024-08-06 02:39:38,614][52663] DAMAGECOUNT value on done: 325537.0 [2024-08-06 02:39:38,616][52663] Sum rewards: 64.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.444', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.168', 'weapon5': '0.178', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '53.000'} [2024-08-06 02:39:38,878][52664] DAMAGECOUNT value on done: 336813.0 [2024-08-06 02:39:38,878][52664] Sum rewards: 73.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.012', 'weapon4': '0.020', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.484', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '61.000'} [2024-08-06 02:39:39,657][52666] DAMAGECOUNT value on done: 324188.0 [2024-08-06 02:39:39,658][52666] Sum rewards: 51.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.133', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.158', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.150', 'HITCOUNT': '2.610', 'weapon3': '3.162', 'DAMAGECOUNT': '12.702', 'FRAGCOUNT': '43.000'} [2024-08-06 02:39:40,484][52670] DAMAGECOUNT value on done: 321561.0 [2024-08-06 02:39:40,486][52670] Sum rewards: 61.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.484', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.258', 'weapon2': '0.546', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.286', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '55.000'} [2024-08-06 02:39:40,533][52659] DAMAGECOUNT value on done: 324133.0 [2024-08-06 02:39:40,534][52659] Sum rewards: 55.336, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.795', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.122', 'AMMO4': '0.225', 'weapon2': '0.228', 'AMMO3': '0.258', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.036', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '50.000'} [2024-08-06 02:39:41,274][52664] DAMAGECOUNT value on done: 343090.0 [2024-08-06 02:39:41,283][52664] Sum rewards: 63.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.210', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.094', 'weapon5': '0.136', 'AMMO4': '0.163', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '53.000'} [2024-08-06 02:39:41,473][52663] DAMAGECOUNT value on done: 324083.0 [2024-08-06 02:39:41,475][52663] Sum rewards: 59.460, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.274', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.111', 'weapon5': '0.118', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.468', 'weapon4': '0.560', 'WEAPON3': '0.650', 'weapon3': '2.662', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '46.000'} [2024-08-06 02:39:42,307][52650] Updated weights for policy 0, policy_version 39791 (0.0031) [2024-08-06 02:39:42,652][52666] DAMAGECOUNT value on done: 322007.0 [2024-08-06 02:39:42,654][52666] Sum rewards: 69.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.320', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.302', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '60.000'} [2024-08-06 02:39:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 325967872. Throughput: 0: 4376.2. Samples: 81501050. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:39:42,794][52567] Avg episode reward: [(0, '67.594')] [2024-08-06 02:39:43,365][52670] DAMAGECOUNT value on done: 323728.0 [2024-08-06 02:39:43,365][52670] Sum rewards: 77.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.183', 'weapon5': '0.210', 'weapon4': '0.220', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '63.000'} [2024-08-06 02:39:43,681][52659] DAMAGECOUNT value on done: 327795.0 [2024-08-06 02:39:43,683][52659] Sum rewards: 62.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.142', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '54.000'} [2024-08-06 02:39:44,056][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:39:44,087][52664] DAMAGECOUNT value on done: 333264.0 [2024-08-06 02:39:44,088][52664] Sum rewards: 81.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.185', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.140', 'weapon4': '0.164', 'AMMO3': '0.198', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '67.000'} [2024-08-06 02:39:44,572][52663] DAMAGECOUNT value on done: 329058.0 [2024-08-06 02:39:44,575][52663] Sum rewards: 65.905, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.081', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.130', 'AMMO3': '0.133', 'AMMO4': '0.166', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '0.900', 'weapon3': '2.836', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '51.000'} [2024-08-06 02:39:45,198][52660] Large shaping reward 2.510 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.459, 153.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:39:45,859][52666] DAMAGECOUNT value on done: 323738.0 [2024-08-06 02:39:45,860][52666] Sum rewards: 61.028, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.922', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.086', 'weapon5': '0.144', 'AMMO4': '0.156', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '54.000'} [2024-08-06 02:39:46,066][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:39:46,412][52659] DAMAGECOUNT value on done: 317099.0 [2024-08-06 02:39:46,422][52659] Sum rewards: 64.969, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO3': '0.268', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.096', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '56.000'} [2024-08-06 02:39:46,467][52664] DAMAGECOUNT value on done: 337989.0 [2024-08-06 02:39:46,470][52664] Sum rewards: 70.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.180', 'weapon2': '0.188', 'AMMO3': '0.211', 'AMMO4': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '58.000'} [2024-08-06 02:39:46,662][52670] DAMAGECOUNT value on done: 327716.0 [2024-08-06 02:39:46,664][52670] Sum rewards: 72.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.210', 'weapon4': '0.214', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:47,051][52650] Updated weights for policy 0, policy_version 39801 (0.0020) [2024-08-06 02:39:47,711][52663] DAMAGECOUNT value on done: 324770.0 [2024-08-06 02:39:47,711][52663] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.886', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO4': '0.179', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '60.000'} [2024-08-06 02:39:47,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 326049792. Throughput: 0: 4378.2. Samples: 81514050. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:39:47,795][52567] Avg episode reward: [(0, '67.727')] [2024-08-06 02:39:48,949][52666] DAMAGECOUNT value on done: 321920.0 [2024-08-06 02:39:48,951][52666] Sum rewards: 67.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.262', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.188', 'weapon5': '0.196', 'weapon4': '0.204', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '56.000'} [2024-08-06 02:39:49,082][52664] DAMAGECOUNT value on done: 337287.0 [2024-08-06 02:39:49,083][52664] Sum rewards: 60.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.652', 'AMMO5': '0.022', 'AMMO2': '0.073', 'AMMO3': '0.130', 'weapon5': '0.302', 'AMMO4': '0.366', 'weapon2': '0.394', 'weapon4': '0.406', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '0.800', 'weapon3': '2.612', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '48.500'} [2024-08-06 02:39:49,268][52659] DAMAGECOUNT value on done: 326781.0 [2024-08-06 02:39:49,268][52659] Sum rewards: 65.756, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.949', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.118', 'weapon5': '0.146', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.184', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '53.000'} [2024-08-06 02:39:49,775][52670] DAMAGECOUNT value on done: 324699.0 [2024-08-06 02:39:49,775][52670] Sum rewards: 62.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.432', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.178', 'AMMO3': '0.189', 'weapon4': '0.338', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '52.000'} [2024-08-06 02:39:50,886][52663] DAMAGECOUNT value on done: 322798.0 [2024-08-06 02:39:50,887][52663] Sum rewards: 70.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.726', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '56.000'} [2024-08-06 02:39:51,731][52650] Updated weights for policy 0, policy_version 39811 (0.0018) [2024-08-06 02:39:51,740][52666] DAMAGECOUNT value on done: 323838.0 [2024-08-06 02:39:51,741][52666] Sum rewards: 63.381, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.355', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.120', 'weapon7': '0.140', 'weapon5': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'weapon4': '0.608', 'WEAPON3': '0.800', 'weapon3': '2.480', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '50.000'} [2024-08-06 02:39:52,045][52664] DAMAGECOUNT value on done: 338447.0 [2024-08-06 02:39:52,046][52664] Sum rewards: 64.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.236', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '56.000'} [2024-08-06 02:39:52,148][52659] DAMAGECOUNT value on done: 332097.0 [2024-08-06 02:39:52,148][52659] Sum rewards: 56.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.065', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.112', 'AMMO3': '0.165', 'AMMO4': '0.178', 'weapon5': '0.206', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.028', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '46.000'} [2024-08-06 02:39:52,406][52670] DAMAGECOUNT value on done: 309650.0 [2024-08-06 02:39:52,408][52670] Sum rewards: 54.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.255', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.144', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '2.964', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '44.000'} [2024-08-06 02:39:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 326148096. Throughput: 0: 4389.1. Samples: 81540610. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:39:52,795][52567] Avg episode reward: [(0, '67.202')] [2024-08-06 02:39:53,767][52663] DAMAGECOUNT value on done: 322855.0 [2024-08-06 02:39:53,771][52663] Sum rewards: 64.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.448', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.218', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '55.000'} [2024-08-06 02:39:54,399][52664] DAMAGECOUNT value on done: 337449.0 [2024-08-06 02:39:54,401][52664] Sum rewards: 56.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.469', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.173', 'weapon5': '0.184', 'weapon4': '0.238', 'AMMO4': '0.275', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.768', 'WEAPON3': '1.050', 'weapon3': '2.532', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '47.000'} [2024-08-06 02:39:54,694][52659] DAMAGECOUNT value on done: 333572.0 [2024-08-06 02:39:54,695][52659] Sum rewards: 55.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.106', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.162', 'weapon5': '0.192', 'AMMO3': '0.248', 'AMMO4': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '2.880', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '49.000'} [2024-08-06 02:39:54,846][52666] DAMAGECOUNT value on done: 316388.0 [2024-08-06 02:39:54,847][52666] Sum rewards: 75.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.243', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.166', 'weapon5': '0.194', 'AMMO4': '0.212', 'AMMO3': '0.216', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '63.000'} [2024-08-06 02:39:55,524][52670] DAMAGECOUNT value on done: 324961.0 [2024-08-06 02:39:55,524][52670] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.546', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.404', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.000'} [2024-08-06 02:39:56,662][52663] DAMAGECOUNT value on done: 326066.0 [2024-08-06 02:39:56,664][52663] Sum rewards: 75.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.404', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon4': '0.278', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '64.000'} [2024-08-06 02:39:56,757][52650] Updated weights for policy 0, policy_version 39821 (0.0014) [2024-08-06 02:39:57,504][52659] DAMAGECOUNT value on done: 329043.0 [2024-08-06 02:39:57,504][52659] Sum rewards: 73.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.636', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon2': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon4': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.458', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '62.000'} [2024-08-06 02:39:57,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 326238208. Throughput: 0: 4386.0. Samples: 81566900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:39:57,794][52567] Avg episode reward: [(0, '67.158')] [2024-08-06 02:39:57,985][52666] DAMAGECOUNT value on done: 324915.0 [2024-08-06 02:39:57,986][52666] Sum rewards: 69.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.608', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.232', 'WEAPON3': '1.500', 'weapon3': '3.448', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '59.000'} [2024-08-06 02:39:58,549][52670] DAMAGECOUNT value on done: 331875.0 [2024-08-06 02:39:58,550][52670] Sum rewards: 73.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'weapon4': '0.194', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '64.000'} [2024-08-06 02:39:59,596][52663] DAMAGECOUNT value on done: 327892.0 [2024-08-06 02:39:59,599][52663] Sum rewards: 69.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.664', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.102', 'weapon4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '59.000'} [2024-08-06 02:40:00,262][52659] DAMAGECOUNT value on done: 325195.0 [2024-08-06 02:40:00,262][52659] Sum rewards: 74.669, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.042', 'weapon5': '0.170', 'AMMO3': '0.189', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.338', 'weapon2': '0.354', 'WEAPON4': '0.450', 'HEALTH': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '60.000'} [2024-08-06 02:40:00,958][52650] Updated weights for policy 0, policy_version 39831 (0.0023) [2024-08-06 02:40:01,610][52670] DAMAGECOUNT value on done: 322877.0 [2024-08-06 02:40:01,610][52670] Sum rewards: 73.748, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.112', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon4': '0.226', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '59.000'} [2024-08-06 02:40:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 326320128. Throughput: 0: 4375.6. Samples: 81579860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:40:02,802][52567] Avg episode reward: [(0, '67.448')] [2024-08-06 02:40:02,818][52663] DAMAGECOUNT value on done: 324748.0 [2024-08-06 02:40:02,820][52663] Sum rewards: 69.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.632', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.600', 'weapon3': '3.064', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '59.000'} [2024-08-06 02:40:03,072][52659] DAMAGECOUNT value on done: 328519.0 [2024-08-06 02:40:03,073][52659] Sum rewards: 69.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.351', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.104', 'AMMO4': '0.220', 'weapon5': '0.230', 'AMMO3': '0.243', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '58.000'} [2024-08-06 02:40:04,665][52670] DAMAGECOUNT value on done: 323877.0 [2024-08-06 02:40:04,665][52670] Sum rewards: 70.769, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.110', 'weapon4': '0.174', 'AMMO3': '0.193', 'AMMO4': '0.224', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '60.000'} [2024-08-06 02:40:05,646][52650] Updated weights for policy 0, policy_version 39841 (0.0039) [2024-08-06 02:40:05,708][52663] DAMAGECOUNT value on done: 319059.0 [2024-08-06 02:40:05,710][52663] Sum rewards: 79.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.593', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.262', 'weapon4': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '64.000'} [2024-08-06 02:40:06,072][52659] DAMAGECOUNT value on done: 329598.0 [2024-08-06 02:40:06,075][52659] Sum rewards: 48.750, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.710', 'AMMO5': '0.022', 'AMMO2': '0.073', 'weapon4': '0.196', 'AMMO3': '0.224', 'weapon5': '0.258', 'AMMO4': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.560', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.630', 'DAMAGECOUNT': '12.981', 'FRAGCOUNT': '45.000'} [2024-08-06 02:40:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 326410240. Throughput: 0: 4385.6. Samples: 81606550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:40:07,794][52567] Avg episode reward: [(0, '67.530')] [2024-08-06 02:40:08,075][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:40:08,673][52662] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:40:08,915][52663] DAMAGECOUNT value on done: 319945.0 [2024-08-06 02:40:08,918][52663] Sum rewards: 66.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.079', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.320', 'WEAPON3': '0.950', 'HITCOUNT': '3.050', 'weapon3': '3.132', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 02:40:10,396][52650] Updated weights for policy 0, policy_version 39851 (0.0020) [2024-08-06 02:40:11,656][52647] DAMAGECOUNT value on done: 343602.0 [2024-08-06 02:40:11,656][52647] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.345', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.200', 'weapon4': '0.226', 'weapon2': '0.234', 'weapon5': '0.240', 'AMMO4': '0.297', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '57.000'} [2024-08-06 02:40:11,674][52663] DAMAGECOUNT value on done: 321870.0 [2024-08-06 02:40:11,676][52663] Sum rewards: 66.475, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.238', 'AMMO3': '0.257', 'weapon4': '0.266', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '58.000'} [2024-08-06 02:40:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 326492160. Throughput: 0: 4397.3. Samples: 81633100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 02:40:12,794][52567] Avg episode reward: [(0, '67.397')] [2024-08-06 02:40:13,999][52647] DAMAGECOUNT value on done: 342187.0 [2024-08-06 02:40:14,001][52647] Sum rewards: 66.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.566', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.314', 'weapon4': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:14,527][52663] DAMAGECOUNT value on done: 329472.0 [2024-08-06 02:40:14,528][52663] Sum rewards: 67.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.314', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 02:40:14,929][52650] Updated weights for policy 0, policy_version 39861 (0.0016) [2024-08-06 02:40:16,218][52647] DAMAGECOUNT value on done: 342465.0 [2024-08-06 02:40:16,218][52647] Sum rewards: 55.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.975', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon2': '0.234', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.516', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '48.000'} [2024-08-06 02:40:17,534][52663] DAMAGECOUNT value on done: 324705.0 [2024-08-06 02:40:17,535][52663] Sum rewards: 63.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.136', 'weapon4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '54.000'} [2024-08-06 02:40:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 326590464. Throughput: 0: 4388.7. Samples: 81646080. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 02:40:17,794][52567] Avg episode reward: [(0, '67.309')] [2024-08-06 02:40:18,805][52667] DAMAGECOUNT value on done: 326231.0 [2024-08-06 02:40:18,805][52667] Sum rewards: 72.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.636', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.136', 'weapon4': '0.180', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:19,159][52647] DAMAGECOUNT value on done: 346964.0 [2024-08-06 02:40:19,160][52647] Sum rewards: 72.262, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.180', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.170', 'weapon2': '0.202', 'weapon4': '0.262', 'WEAPON5': '0.300', 'AMMO3': '0.313', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.066', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '66.000'} [2024-08-06 02:40:19,634][52650] Updated weights for policy 0, policy_version 39871 (0.0011) [2024-08-06 02:40:20,541][52663] DAMAGECOUNT value on done: 331464.0 [2024-08-06 02:40:20,541][52663] Sum rewards: 67.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.960', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.226', 'AMMO3': '0.238', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '58.000'} [2024-08-06 02:40:21,595][52667] DAMAGECOUNT value on done: 331646.0 [2024-08-06 02:40:21,596][52667] Sum rewards: 80.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.244', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '67.000'} [2024-08-06 02:40:22,552][52647] DAMAGECOUNT value on done: 343977.0 [2024-08-06 02:40:22,552][52647] Sum rewards: 70.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.132', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.106', 'weapon4': '0.122', 'AMMO4': '0.234', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.196', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17578.1). Total num frames: 326680576. Throughput: 0: 4394.5. Samples: 81672410. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 02:40:22,802][52567] Avg episode reward: [(0, '67.411')] [2024-08-06 02:40:23,151][52663] DAMAGECOUNT value on done: 327941.0 [2024-08-06 02:40:23,154][52663] Sum rewards: 68.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.096', 'AMMO4': '0.151', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:24,238][52667] DAMAGECOUNT value on done: 326644.0 [2024-08-06 02:40:24,240][52667] Sum rewards: 66.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.906', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO3': '0.166', 'AMMO4': '0.177', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.456', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '55.000'} [2024-08-06 02:40:24,522][52650] Updated weights for policy 0, policy_version 39881 (0.0013) [2024-08-06 02:40:24,871][52647] DAMAGECOUNT value on done: 348372.0 [2024-08-06 02:40:24,873][52647] Sum rewards: 67.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.557', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.574', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '58.000'} [2024-08-06 02:40:26,205][52663] DAMAGECOUNT value on done: 321014.0 [2024-08-06 02:40:26,205][52663] Sum rewards: 80.786, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.046', 'HEALTH': '0.062', 'AMMO3': '0.197', 'weapon5': '0.210', 'AMMO4': '0.229', 'weapon2': '0.296', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '67.000'} [2024-08-06 02:40:27,177][52647] DAMAGECOUNT value on done: 343431.0 [2024-08-06 02:40:27,179][52647] Sum rewards: 48.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.752', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.168', 'AMMO4': '0.249', 'weapon5': '0.286', 'weapon4': '0.382', 'weapon2': '0.440', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.526', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '40.500'} [2024-08-06 02:40:27,454][52667] DAMAGECOUNT value on done: 327791.0 [2024-08-06 02:40:27,456][52667] Sum rewards: 70.950, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.164', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.322', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 02:40:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 326754304. Throughput: 0: 4397.3. Samples: 81698930. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 02:40:27,802][52567] Avg episode reward: [(0, '67.108')] [2024-08-06 02:40:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039887_326754304.pth... [2024-08-06 02:40:27,958][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039374_322551808.pth [2024-08-06 02:40:28,179][52665] DAMAGECOUNT value on done: 321231.0 [2024-08-06 02:40:28,180][52665] Sum rewards: 77.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '65.000'} [2024-08-06 02:40:28,954][52650] Updated weights for policy 0, policy_version 39891 (0.0015) [2024-08-06 02:40:30,149][52647] DAMAGECOUNT value on done: 340860.0 [2024-08-06 02:40:30,150][52647] Sum rewards: 76.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.294', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.114', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '62.000'} [2024-08-06 02:40:30,773][52667] DAMAGECOUNT value on done: 331817.0 [2024-08-06 02:40:30,776][52667] Sum rewards: 78.890, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.054', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.296', 'HEALTH': '0.760', 'WEAPON3': '1.100', 'weapon3': '3.430', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '64.000'} [2024-08-06 02:40:30,947][52665] DAMAGECOUNT value on done: 325977.0 [2024-08-06 02:40:30,949][52665] Sum rewards: 59.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.692', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO3': '0.210', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.250', 'HITCOUNT': '2.630', 'weapon3': '3.268', 'DAMAGECOUNT': '13.917', 'FRAGCOUNT': '51.000'} [2024-08-06 02:40:32,760][52647] DAMAGECOUNT value on done: 349074.0 [2024-08-06 02:40:32,761][52647] Sum rewards: 74.510, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.943', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'ARMOR': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 02:40:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 326852608. Throughput: 0: 4388.7. Samples: 81711540. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 02:40:32,794][52567] Avg episode reward: [(0, '67.370')] [2024-08-06 02:40:33,714][52667] DAMAGECOUNT value on done: 331943.0 [2024-08-06 02:40:33,715][52667] Sum rewards: 62.475, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.036', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.294', 'weapon2': '0.322', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '55.000'} [2024-08-06 02:40:33,850][52665] DAMAGECOUNT value on done: 325608.0 [2024-08-06 02:40:33,850][52665] Sum rewards: 70.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.108', 'AMMO4': '0.151', 'weapon5': '0.154', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.000', 'weapon3': '3.082', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '57.000'} [2024-08-06 02:40:33,872][52650] Updated weights for policy 0, policy_version 39901 (0.0011) [2024-08-06 02:40:34,344][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:40:35,508][52662] DAMAGECOUNT value on done: 336636.0 [2024-08-06 02:40:35,509][52662] Sum rewards: 72.154, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.644', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.098', 'AMMO4': '0.187', 'AMMO3': '0.230', 'weapon4': '0.256', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:35,570][52647] DAMAGECOUNT value on done: 341345.0 [2024-08-06 02:40:35,570][52647] Sum rewards: 63.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.092', 'weapon5': '0.136', 'AMMO3': '0.198', 'AMMO4': '0.262', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.232', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '54.000'} [2024-08-06 02:40:36,356][52665] DAMAGECOUNT value on done: 321775.0 [2024-08-06 02:40:36,356][52665] Sum rewards: 72.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.338', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.078', 'AMMO3': '0.205', 'AMMO4': '0.236', 'weapon5': '0.242', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '59.000'} [2024-08-06 02:40:36,796][52667] DAMAGECOUNT value on done: 332890.0 [2024-08-06 02:40:36,796][52667] Sum rewards: 71.565, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.072', 'AMMO5': '0.022', 'AMMO2': '0.065', 'AMMO3': '0.185', 'weapon4': '0.210', 'AMMO4': '0.323', 'weapon5': '0.330', 'weapon2': '0.332', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '59.000'} [2024-08-06 02:40:36,813][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:40:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 326934528. Throughput: 0: 4382.5. Samples: 81737820. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 02:40:37,794][52567] Avg episode reward: [(0, '67.396')] [2024-08-06 02:40:38,188][52650] Updated weights for policy 0, policy_version 39911 (0.0010) [2024-08-06 02:40:38,505][52662] DAMAGECOUNT value on done: 331226.0 [2024-08-06 02:40:38,506][52662] Sum rewards: 69.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.288', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.152', 'AMMO3': '0.191', 'AMMO4': '0.260', 'weapon2': '0.292', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 02:40:38,610][52647] DAMAGECOUNT value on done: 347716.0 [2024-08-06 02:40:38,610][52647] Sum rewards: 65.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.845', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.148', 'weapon5': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.210', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.760', 'WEAPON3': '1.050', 'weapon3': '2.632', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '54.000'} [2024-08-06 02:40:39,329][52665] DAMAGECOUNT value on done: 317236.0 [2024-08-06 02:40:39,333][52665] Sum rewards: 72.040, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO3': '0.170', 'weapon2': '0.214', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.090', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '58.000'} [2024-08-06 02:40:39,625][52668] DAMAGECOUNT value on done: 324513.0 [2024-08-06 02:40:39,625][52668] Sum rewards: 66.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.875', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.186', 'weapon4': '0.236', 'AMMO4': '0.254', 'AMMO3': '0.262', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '57.000'} [2024-08-06 02:40:39,749][52667] DAMAGECOUNT value on done: 327895.0 [2024-08-06 02:40:39,750][52667] Sum rewards: 71.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.344', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.066', 'weapon5': '0.182', 'AMMO3': '0.203', 'AMMO4': '0.230', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '59.000'} [2024-08-06 02:40:40,863][52662] DAMAGECOUNT value on done: 331290.0 [2024-08-06 02:40:40,863][52662] Sum rewards: 72.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.054', 'weapon4': '0.078', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon2': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.536', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:40,889][52649] DAMAGECOUNT value on done: 318440.0 [2024-08-06 02:40:40,890][52649] Sum rewards: 76.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.128', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '63.000'} [2024-08-06 02:40:41,705][52647] DAMAGECOUNT value on done: 339110.0 [2024-08-06 02:40:41,706][52647] Sum rewards: 59.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.710', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.532', 'WEAPON3': '1.650', 'weapon3': '3.226', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '51.000'} [2024-08-06 02:40:41,913][52665] DAMAGECOUNT value on done: 318153.0 [2024-08-06 02:40:41,914][52665] Sum rewards: 81.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.976', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon4': '0.136', 'AMMO3': '0.265', 'weapon5': '0.294', 'AMMO4': '0.325', 'weapon2': '0.332', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '68.000'} [2024-08-06 02:40:42,498][52667] DAMAGECOUNT value on done: 327901.0 [2024-08-06 02:40:42,498][52667] Sum rewards: 78.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.555', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '65.000'} [2024-08-06 02:40:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 327024640. Throughput: 0: 4376.9. Samples: 81763860. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:40:42,794][52567] Avg episode reward: [(0, '68.181')] [2024-08-06 02:40:42,898][52668] DAMAGECOUNT value on done: 329060.0 [2024-08-06 02:40:42,901][52668] Sum rewards: 73.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'ARMOR': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.432', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '62.000'} [2024-08-06 02:40:43,246][52650] Updated weights for policy 0, policy_version 39921 (0.0013) [2024-08-06 02:40:43,323][52649] DAMAGECOUNT value on done: 312838.0 [2024-08-06 02:40:43,324][52649] Sum rewards: 65.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.552', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.233', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:44,009][52662] DAMAGECOUNT value on done: 322648.0 [2024-08-06 02:40:44,009][52662] Sum rewards: 58.810, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.923', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.648', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '48.000'} [2024-08-06 02:40:44,718][52665] DAMAGECOUNT value on done: 324892.0 [2024-08-06 02:40:44,718][52665] Sum rewards: 74.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.155', 'AMMO3': '0.196', 'weapon4': '0.214', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:44,720][52647] DAMAGECOUNT value on done: 341619.0 [2024-08-06 02:40:44,721][52647] Sum rewards: 60.294, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.233', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'AMMO3': '0.327', 'weapon2': '0.364', 'weapon4': '0.370', 'WEAPON3': '1.900', 'weapon3': '2.840', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:45,271][52667] DAMAGECOUNT value on done: 334906.0 [2024-08-06 02:40:45,272][52667] Sum rewards: 77.980, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.996', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO3': '0.169', 'AMMO4': '0.215', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 02:40:45,524][52668] DAMAGECOUNT value on done: 331293.0 [2024-08-06 02:40:45,524][52668] Sum rewards: 70.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO4': '0.168', 'weapon5': '0.172', 'AMMO3': '0.219', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '59.500'} [2024-08-06 02:40:46,530][52649] DAMAGECOUNT value on done: 318973.0 [2024-08-06 02:40:46,531][52649] Sum rewards: 58.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.130', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '50.000'} [2024-08-06 02:40:46,685][52662] DAMAGECOUNT value on done: 332968.0 [2024-08-06 02:40:46,686][52662] Sum rewards: 62.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.142', 'AMMO4': '0.211', 'weapon5': '0.228', 'AMMO3': '0.267', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.770', 'weapon3': '3.030', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:47,710][52665] DAMAGECOUNT value on done: 325959.0 [2024-08-06 02:40:47,711][52665] Sum rewards: 77.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.208', 'WEAPON3': '1.300', 'weapon3': '3.470', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '64.000'} [2024-08-06 02:40:47,791][52650] Updated weights for policy 0, policy_version 39931 (0.0032) [2024-08-06 02:40:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 327114752. Throughput: 0: 4380.2. Samples: 81776970. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:40:47,795][52567] Avg episode reward: [(0, '67.969')] [2024-08-06 02:40:47,960][52647] DAMAGECOUNT value on done: 342442.0 [2024-08-06 02:40:47,960][52647] Sum rewards: 68.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.630', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.094', 'AMMO3': '0.173', 'weapon5': '0.204', 'AMMO4': '0.260', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.138', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:48,158][52668] DAMAGECOUNT value on done: 332291.0 [2024-08-06 02:40:48,159][52668] Sum rewards: 66.324, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.438', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.132', 'weapon4': '0.136', 'weapon2': '0.178', 'AMMO4': '0.218', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.306', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:48,212][52667] DAMAGECOUNT value on done: 326917.0 [2024-08-06 02:40:48,214][52667] Sum rewards: 73.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.283', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '62.000'} [2024-08-06 02:40:49,485][52649] DAMAGECOUNT value on done: 317848.0 [2024-08-06 02:40:49,488][52649] Sum rewards: 63.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.848', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '54.000'} [2024-08-06 02:40:49,872][52662] DAMAGECOUNT value on done: 325548.0 [2024-08-06 02:40:49,880][52662] Sum rewards: 73.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.635', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.063', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.608', 'WEAPON3': '1.650', 'weapon3': '3.006', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 02:40:50,109][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:40:50,480][52647] DAMAGECOUNT value on done: 350643.0 [2024-08-06 02:40:50,480][52647] Sum rewards: 58.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.182', 'AMMO4': '0.182', 'AMMO3': '0.205', 'weapon5': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '49.000'} [2024-08-06 02:40:51,038][52668] DAMAGECOUNT value on done: 322148.0 [2024-08-06 02:40:51,040][52668] Sum rewards: 66.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.402', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.100', 'weapon5': '0.138', 'weapon2': '0.178', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.402', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2024-08-06 02:40:51,073][52665] DAMAGECOUNT value on done: 326292.0 [2024-08-06 02:40:51,074][52665] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.206', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO4': '0.181', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '62.000'} [2024-08-06 02:40:51,360][52667] DAMAGECOUNT value on done: 329879.0 [2024-08-06 02:40:51,363][52667] Sum rewards: 61.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.830', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.081', 'WEAPON5': '0.150', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.538', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '53.000'} [2024-08-06 02:40:51,859][52614] Signal inference workers to stop experience collection... (7200 times) [2024-08-06 02:40:51,861][52614] Signal inference workers to resume experience collection... (7200 times) [2024-08-06 02:40:51,902][52650] InferenceWorker_p0-w0: stopping experience collection (7200 times) [2024-08-06 02:40:51,903][52650] InferenceWorker_p0-w0: resuming experience collection (7200 times) [2024-08-06 02:40:52,373][52650] Updated weights for policy 0, policy_version 39941 (0.0017) [2024-08-06 02:40:52,553][52649] DAMAGECOUNT value on done: 309595.0 [2024-08-06 02:40:52,554][52649] Sum rewards: 73.632, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.350', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon5': '0.136', 'AMMO4': '0.174', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '64.000'} [2024-08-06 02:40:52,611][52662] DAMAGECOUNT value on done: 334723.0 [2024-08-06 02:40:52,612][52662] Sum rewards: 71.055, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.092', 'weapon5': '0.170', 'AMMO4': '0.202', 'AMMO3': '0.249', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.096', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 327196672. Throughput: 0: 4371.1. Samples: 81803250. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:40:52,794][52567] Avg episode reward: [(0, '68.107')] [2024-08-06 02:40:53,142][52647] DAMAGECOUNT value on done: 344291.0 [2024-08-06 02:40:53,143][52647] Sum rewards: 67.259, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.299', 'weapon2': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.270', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '60.000'} [2024-08-06 02:40:53,462][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:40:53,922][52665] DAMAGECOUNT value on done: 325359.0 [2024-08-06 02:40:53,923][52665] Sum rewards: 82.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.345', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.284', 'weapon2': '0.376', 'WEAPON3': '1.750', 'weapon3': '3.202', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '72.000'} [2024-08-06 02:40:54,158][52667] DAMAGECOUNT value on done: 329567.0 [2024-08-06 02:40:54,158][52667] Sum rewards: 90.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.215', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '73.000'} [2024-08-06 02:40:54,186][52668] DAMAGECOUNT value on done: 332108.0 [2024-08-06 02:40:54,187][52668] Sum rewards: 72.153, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.468', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.124', 'AMMO3': '0.178', 'AMMO4': '0.181', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.768', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '57.000'} [2024-08-06 02:40:55,482][52662] DAMAGECOUNT value on done: 338854.0 [2024-08-06 02:40:55,483][52662] Sum rewards: 66.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.880', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.140', 'weapon2': '0.186', 'weapon5': '0.250', 'AMMO4': '0.270', 'WEAPON5': '0.550', 'weapon4': '0.606', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '52.500'} [2024-08-06 02:40:55,515][52649] DAMAGECOUNT value on done: 320742.0 [2024-08-06 02:40:55,517][52649] Sum rewards: 65.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.137', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon2': '0.206', 'AMMO3': '0.211', 'weapon5': '0.266', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '55.000'} [2024-08-06 02:40:55,755][52647] DAMAGECOUNT value on done: 343160.0 [2024-08-06 02:40:55,757][52647] Sum rewards: 71.363, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.208', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO4': '0.108', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.332', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:56,724][52667] DAMAGECOUNT value on done: 324588.0 [2024-08-06 02:40:56,726][52667] Sum rewards: 58.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.634', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon4': '0.206', 'AMMO3': '0.211', 'weapon5': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '50.000'} [2024-08-06 02:40:57,024][52665] DAMAGECOUNT value on done: 331126.0 [2024-08-06 02:40:57,024][52665] Sum rewards: 63.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.106', 'weapon5': '0.132', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.118', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '54.000'} [2024-08-06 02:40:57,097][52668] DAMAGECOUNT value on done: 330145.0 [2024-08-06 02:40:57,097][52668] Sum rewards: 72.691, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.327', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '60.000'} [2024-08-06 02:40:57,308][52650] Updated weights for policy 0, policy_version 39951 (0.0040) [2024-08-06 02:40:57,671][52669] DAMAGECOUNT value on done: 332550.0 [2024-08-06 02:40:57,673][52669] Sum rewards: 65.860, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.826', 'AMMO5': '0.013', 'AMMO2': '0.062', 'AMMO3': '0.193', 'weapon5': '0.222', 'weapon4': '0.268', 'AMMO4': '0.308', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2024-08-06 02:40:57,773][52811] DAMAGECOUNT value on done: 317179.0 [2024-08-06 02:40:57,773][52811] Sum rewards: 72.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.058', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.128', 'weapon4': '0.158', 'AMMO4': '0.219', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 327286784. Throughput: 0: 4358.0. Samples: 81829210. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:40:57,794][52567] Avg episode reward: [(0, '68.644')] [2024-08-06 02:40:58,155][52662] DAMAGECOUNT value on done: 328026.0 [2024-08-06 02:40:58,156][52662] Sum rewards: 49.455, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.340', 'AMMO5': '0.024', 'AMMO2': '0.068', 'AMMO3': '0.266', 'weapon4': '0.308', 'weapon5': '0.332', 'AMMO4': '0.338', 'weapon2': '0.376', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'HITCOUNT': '2.530', 'weapon3': '2.532', 'DAMAGECOUNT': '12.921', 'FRAGCOUNT': '46.500'} [2024-08-06 02:40:58,472][52660] DAMAGECOUNT value on done: 323685.0 [2024-08-06 02:40:58,474][52660] Sum rewards: 67.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.100', 'AMMO3': '0.226', 'AMMO4': '0.251', 'weapon5': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'weapon2': '0.682', 'WEAPON3': '1.450', 'weapon3': '2.494', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.000'} [2024-08-06 02:40:58,623][52649] DAMAGECOUNT value on done: 317326.0 [2024-08-06 02:40:58,623][52649] Sum rewards: 55.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon4': '0.174', 'weapon5': '0.226', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.550', 'weapon3': '2.758', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '50.000'} [2024-08-06 02:40:58,710][52647] DAMAGECOUNT value on done: 340555.0 [2024-08-06 02:40:58,710][52647] Sum rewards: 52.728, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.088', 'AMMO4': '0.150', 'weapon5': '0.216', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '3.108', 'DAMAGECOUNT': '13.635', 'FRAGCOUNT': '46.000'} [2024-08-06 02:40:59,187][52803] DAMAGECOUNT value on done: 306922.0 [2024-08-06 02:40:59,187][52803] Sum rewards: 67.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.207', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.120', 'weapon2': '0.164', 'AMMO4': '0.187', 'AMMO3': '0.190', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.330', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '54.000'} [2024-08-06 02:40:59,438][52667] DAMAGECOUNT value on done: 332647.0 [2024-08-06 02:40:59,440][52667] Sum rewards: 68.941, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.132', 'weapon4': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.300', 'AMMO3': '0.304', 'WEAPON3': '1.700', 'weapon3': '3.088', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '61.000'} [2024-08-06 02:40:59,512][52665] DAMAGECOUNT value on done: 324794.0 [2024-08-06 02:40:59,514][52665] Sum rewards: 67.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.603', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.213', 'weapon5': '0.288', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2024-08-06 02:40:59,790][52795] DAMAGECOUNT value on done: 305831.0 [2024-08-06 02:40:59,791][52795] Sum rewards: 64.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.198', 'weapon2': '0.262', 'weapon5': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '53.500'} [2024-08-06 02:41:00,238][52668] DAMAGECOUNT value on done: 324087.0 [2024-08-06 02:41:00,241][52668] Sum rewards: 72.142, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.626', 'AMMO2': '0.024', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'weapon2': '0.240', 'weapon4': '0.264', 'AMMO3': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:00,314][52669] DAMAGECOUNT value on done: 324460.0 [2024-08-06 02:41:00,315][52669] Sum rewards: 76.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO2': '0.016', 'AMMO5': '0.018', 'AMMO4': '0.081', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:00,933][52811] DAMAGECOUNT value on done: 302098.0 [2024-08-06 02:41:00,933][52811] Sum rewards: 61.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.610', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.132', 'weapon4': '0.190', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '51.000'} [2024-08-06 02:41:01,022][52666] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:41:01,209][52649] DAMAGECOUNT value on done: 323614.0 [2024-08-06 02:41:01,210][52649] Sum rewards: 72.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.094', 'AMMO4': '0.138', 'weapon5': '0.144', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:01,436][52662] DAMAGECOUNT value on done: 340023.0 [2024-08-06 02:41:01,437][52662] Sum rewards: 62.342, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.450', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.134', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'AMMO3': '0.261', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:01,465][52660] DAMAGECOUNT value on done: 323383.0 [2024-08-06 02:41:01,468][52660] Sum rewards: 71.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.178', 'weapon4': '0.200', 'weapon2': '0.210', 'AMMO4': '0.223', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.102', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:01,624][52647] DAMAGECOUNT value on done: 336711.0 [2024-08-06 02:41:01,624][52647] Sum rewards: 67.702, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.940', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.162', 'weapon5': '0.200', 'weapon2': '0.242', 'AMMO4': '0.274', 'AMMO3': '0.291', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.084', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:02,099][52665] DAMAGECOUNT value on done: 324058.0 [2024-08-06 02:41:02,101][52665] Sum rewards: 56.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.166', 'AMMO3': '0.199', 'weapon2': '0.208', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.038', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '48.000'} [2024-08-06 02:41:02,147][52667] DAMAGECOUNT value on done: 337328.0 [2024-08-06 02:41:02,147][52667] Sum rewards: 76.645, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.835', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO3': '0.138', 'weapon4': '0.148', 'AMMO4': '0.159', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.708', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:02,161][52650] Updated weights for policy 0, policy_version 39961 (0.0026) [2024-08-06 02:41:02,275][52803] DAMAGECOUNT value on done: 304539.0 [2024-08-06 02:41:02,277][52803] Sum rewards: 73.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.068', 'weapon5': '0.084', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.326', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 327368704. Throughput: 0: 4367.3. Samples: 81842610. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:41:02,794][52567] Avg episode reward: [(0, '68.740')] [2024-08-06 02:41:02,923][52795] DAMAGECOUNT value on done: 298793.0 [2024-08-06 02:41:02,923][52795] Sum rewards: 71.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.829', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.099', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:03,070][52668] DAMAGECOUNT value on done: 327631.0 [2024-08-06 02:41:03,072][52668] Sum rewards: 53.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.076', 'AMMO4': '0.137', 'weapon5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.012', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '45.000'} [2024-08-06 02:41:03,206][52669] DAMAGECOUNT value on done: 331176.0 [2024-08-06 02:41:03,206][52669] Sum rewards: 53.549, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.920', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'weapon4': '0.194', 'weapon2': '0.258', 'WEAPON4': '0.300', 'AMMO3': '0.375', 'WEAPON3': '2.150', 'HITCOUNT': '3.070', 'weapon3': '3.122', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '52.000'} [2024-08-06 02:41:03,947][52649] DAMAGECOUNT value on done: 319251.0 [2024-08-06 02:41:03,950][52649] Sum rewards: 75.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.044', 'weapon4': '0.056', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '63.000'} [2024-08-06 02:41:04,015][52811] DAMAGECOUNT value on done: 307685.0 [2024-08-06 02:41:04,015][52811] Sum rewards: 57.159, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.660', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.060', 'weapon5': '0.164', 'AMMO3': '0.251', 'AMMO4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.596', 'WEAPON3': '1.550', 'weapon3': '2.870', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '49.500'} [2024-08-06 02:41:04,181][52660] DAMAGECOUNT value on done: 331673.0 [2024-08-06 02:41:04,183][52660] Sum rewards: 63.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.544', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.134', 'weapon5': '0.148', 'AMMO3': '0.176', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.044', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '50.500'} [2024-08-06 02:41:04,691][52662] DAMAGECOUNT value on done: 326198.0 [2024-08-06 02:41:04,693][52662] Sum rewards: 67.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.070', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.228', 'weapon4': '0.228', 'weapon2': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:05,057][52647] DAMAGECOUNT value on done: 343270.0 [2024-08-06 02:41:05,058][52647] Sum rewards: 61.125, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.992', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.214', 'weapon4': '0.220', 'AMMO3': '0.234', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.744', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:05,237][52667] DAMAGECOUNT value on done: 335124.0 [2024-08-06 02:41:05,237][52667] Sum rewards: 81.561, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.398', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.091', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '66.000'} [2024-08-06 02:41:05,393][52665] DAMAGECOUNT value on done: 323903.0 [2024-08-06 02:41:05,394][52665] Sum rewards: 62.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.715', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon5': '0.204', 'AMMO3': '0.228', 'weapon4': '0.244', 'AMMO4': '0.339', 'weapon2': '0.464', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:05,472][52803] DAMAGECOUNT value on done: 307450.0 [2024-08-06 02:41:05,473][52803] Sum rewards: 69.239, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.440', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon5': '0.102', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO4': '0.224', 'AMMO3': '0.245', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:05,957][52669] DAMAGECOUNT value on done: 326527.0 [2024-08-06 02:41:05,957][52669] Sum rewards: 70.205, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.134', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.360', 'WEAPON3': '1.000', 'weapon3': '2.996', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:05,962][52668] DAMAGECOUNT value on done: 327879.0 [2024-08-06 02:41:05,965][52668] Sum rewards: 73.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.378', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:06,169][52795] DAMAGECOUNT value on done: 300252.0 [2024-08-06 02:41:06,170][52795] Sum rewards: 69.309, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.352', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:06,815][52650] Updated weights for policy 0, policy_version 39971 (0.0014) [2024-08-06 02:41:07,084][52649] DAMAGECOUNT value on done: 318921.0 [2024-08-06 02:41:07,085][52649] Sum rewards: 80.121, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.103', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '66.000'} [2024-08-06 02:41:07,099][52811] DAMAGECOUNT value on done: 304929.0 [2024-08-06 02:41:07,101][52811] Sum rewards: 58.192, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.064', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon7': '0.046', 'AMMO4': '0.079', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.172', 'weapon2': '0.218', 'weapon4': '0.558', 'WEAPON3': '1.200', 'HITCOUNT': '2.570', 'weapon3': '2.792', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '48.000'} [2024-08-06 02:41:07,193][52660] DAMAGECOUNT value on done: 332380.0 [2024-08-06 02:41:07,194][52660] Sum rewards: 87.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.046', 'AMMO3': '0.180', 'AMMO4': '0.190', 'weapon4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '72.000'} [2024-08-06 02:41:07,631][52662] DAMAGECOUNT value on done: 328348.0 [2024-08-06 02:41:07,632][52662] Sum rewards: 73.448, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.078', 'weapon5': '0.088', 'HEALTH': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.398', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 327458816. Throughput: 0: 4366.7. Samples: 81868910. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:41:07,794][52567] Avg episode reward: [(0, '68.806')] [2024-08-06 02:41:07,982][52667] DAMAGECOUNT value on done: 336246.0 [2024-08-06 02:41:07,982][52667] Sum rewards: 73.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.056', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.334', 'weapon4': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:08,308][52665] DAMAGECOUNT value on done: 326256.0 [2024-08-06 02:41:08,310][52665] Sum rewards: 69.502, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.172', 'weapon2': '0.458', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.418', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:08,603][52803] DAMAGECOUNT value on done: 309688.0 [2024-08-06 02:41:08,603][52803] Sum rewards: 62.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.311', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.117', 'weapon4': '0.136', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.188', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '53.000'} [2024-08-06 02:41:08,733][52669] DAMAGECOUNT value on done: 325032.0 [2024-08-06 02:41:08,733][52669] Sum rewards: 68.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.691', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.095', 'weapon5': '0.132', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.308', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:08,893][52668] DAMAGECOUNT value on done: 332765.0 [2024-08-06 02:41:08,894][52668] Sum rewards: 75.387, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '63.000'} [2024-08-06 02:41:09,286][52795] DAMAGECOUNT value on done: 303343.0 [2024-08-06 02:41:09,287][52795] Sum rewards: 68.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.163', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:09,894][52649] DAMAGECOUNT value on done: 322031.0 [2024-08-06 02:41:09,894][52649] Sum rewards: 72.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.901', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.220', 'AMMO3': '0.223', 'weapon2': '0.296', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:10,189][52660] DAMAGECOUNT value on done: 327333.0 [2024-08-06 02:41:10,189][52660] Sum rewards: 65.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.088', 'AMMO3': '0.192', 'weapon4': '0.204', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:10,205][52811] DAMAGECOUNT value on done: 309169.0 [2024-08-06 02:41:10,205][52811] Sum rewards: 72.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.134', 'AMMO3': '0.159', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:10,318][52662] DAMAGECOUNT value on done: 332005.0 [2024-08-06 02:41:10,319][52662] Sum rewards: 70.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.104', 'weapon4': '0.110', 'AMMO4': '0.151', 'weapon2': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.650', 'weapon3': '3.342', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:10,371][52670] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:41:10,912][52665] DAMAGECOUNT value on done: 322067.0 [2024-08-06 02:41:10,913][52665] Sum rewards: 67.927, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.163', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:10,937][52667] DAMAGECOUNT value on done: 326872.0 [2024-08-06 02:41:10,939][52667] Sum rewards: 58.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon4': '0.152', 'weapon5': '0.182', 'AMMO3': '0.254', 'AMMO4': '0.289', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '49.000'} [2024-08-06 02:41:10,962][52658] DAMAGECOUNT value on done: 327847.0 [2024-08-06 02:41:10,964][52658] Sum rewards: 63.061, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.350', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.068', 'weapon5': '0.134', 'AMMO3': '0.246', 'AMMO4': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '53.500'} [2024-08-06 02:41:11,379][52668] DAMAGECOUNT value on done: 325806.0 [2024-08-06 02:41:11,380][52668] Sum rewards: 70.586, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.980', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.297', 'weapon4': '0.342', 'WEAPON3': '1.750', 'weapon3': '3.094', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:11,597][52650] Updated weights for policy 0, policy_version 39981 (0.0032) [2024-08-06 02:41:11,756][52803] DAMAGECOUNT value on done: 309177.0 [2024-08-06 02:41:11,757][52803] Sum rewards: 66.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'weapon4': '0.182', 'weapon5': '0.188', 'AMMO4': '0.216', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:11,864][52669] DAMAGECOUNT value on done: 328411.0 [2024-08-06 02:41:11,867][52669] Sum rewards: 64.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.606', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '53.000'} [2024-08-06 02:41:12,512][52795] DAMAGECOUNT value on done: 305633.0 [2024-08-06 02:41:12,512][52795] Sum rewards: 75.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.140', 'weapon4': '0.144', 'AMMO4': '0.147', 'weapon2': '0.186', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.288', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '63.000'} [2024-08-06 02:41:12,665][52649] DAMAGECOUNT value on done: 322338.0 [2024-08-06 02:41:12,666][52649] Sum rewards: 72.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.280', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO4': '0.194', 'AMMO3': '0.245', 'weapon2': '0.250', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.896', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '63.000'} [2024-08-06 02:41:12,676][52794] DAMAGECOUNT value on done: 330766.0 [2024-08-06 02:41:12,676][52794] Sum rewards: 61.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.603', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.178', 'AMMO4': '0.215', 'AMMO3': '0.254', 'weapon4': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.858', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:12,732][52662] DAMAGECOUNT value on done: 335801.0 [2024-08-06 02:41:12,733][52662] Sum rewards: 66.266, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.092', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.307', 'WEAPON3': '1.800', 'weapon3': '3.350', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 327548928. Throughput: 0: 4353.1. Samples: 81894820. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:41:12,794][52567] Avg episode reward: [(0, '68.432')] [2024-08-06 02:41:12,831][52660] DAMAGECOUNT value on done: 322936.0 [2024-08-06 02:41:12,831][52660] Sum rewards: 62.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.092', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.832', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '53.000'} [2024-08-06 02:41:13,313][52811] DAMAGECOUNT value on done: 312007.0 [2024-08-06 02:41:13,314][52811] Sum rewards: 66.461, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.998', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.112', 'weapon4': '0.136', 'AMMO4': '0.215', 'AMMO3': '0.262', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:13,634][52665] DAMAGECOUNT value on done: 320489.0 [2024-08-06 02:41:13,635][52665] Sum rewards: 68.219, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.073', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.276', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:13,978][52667] DAMAGECOUNT value on done: 334058.0 [2024-08-06 02:41:13,981][52667] Sum rewards: 67.636, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.025', 'HEALTH': '0.086', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.174', 'weapon4': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.568', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:14,066][52658] DAMAGECOUNT value on done: 328320.0 [2024-08-06 02:41:14,068][52658] Sum rewards: 69.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.085', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.382', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:14,613][52668] DAMAGECOUNT value on done: 319930.0 [2024-08-06 02:41:14,613][52668] Sum rewards: 75.476, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.296', 'HEALTH': '0.406', 'weapon2': '0.486', 'WEAPON3': '0.700', 'weapon3': '2.862', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:14,889][52803] DAMAGECOUNT value on done: 303234.0 [2024-08-06 02:41:14,890][52803] Sum rewards: 59.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon2': '0.152', 'AMMO3': '0.188', 'AMMO4': '0.210', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '2.846', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '49.500'} [2024-08-06 02:41:14,920][52669] DAMAGECOUNT value on done: 329481.0 [2024-08-06 02:41:14,922][52669] Sum rewards: 60.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.670', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon4': '0.110', 'AMMO3': '0.206', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.300', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '50.000'} [2024-08-06 02:41:15,501][52794] DAMAGECOUNT value on done: 334684.0 [2024-08-06 02:41:15,501][52794] Sum rewards: 80.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '66.000'} [2024-08-06 02:41:15,560][52662] DAMAGECOUNT value on done: 328796.0 [2024-08-06 02:41:15,561][52662] Sum rewards: 65.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.948', 'AMMO5': '0.025', 'AMMO2': '0.070', 'AMMO3': '0.202', 'weapon2': '0.262', 'weapon4': '0.288', 'AMMO4': '0.348', 'weapon5': '0.438', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.576', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:15,614][52649] DAMAGECOUNT value on done: 323502.0 [2024-08-06 02:41:15,614][52649] Sum rewards: 74.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon4': '0.212', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '63.000'} [2024-08-06 02:41:15,704][52795] DAMAGECOUNT value on done: 303034.0 [2024-08-06 02:41:15,705][52795] Sum rewards: 78.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.701', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.103', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.232', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.388', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '64.000'} [2024-08-06 02:41:15,910][52650] Updated weights for policy 0, policy_version 39991 (0.0014) [2024-08-06 02:41:16,016][52660] DAMAGECOUNT value on done: 329368.0 [2024-08-06 02:41:16,025][52660] Sum rewards: 78.379, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.455', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.506', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '68.000'} [2024-08-06 02:41:16,450][52811] DAMAGECOUNT value on done: 307334.0 [2024-08-06 02:41:16,451][52811] Sum rewards: 77.445, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.056', 'weapon5': '0.078', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '65.000'} [2024-08-06 02:41:16,560][52665] DAMAGECOUNT value on done: 320764.0 [2024-08-06 02:41:16,562][52665] Sum rewards: 60.357, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.782', 'AMMO5': '0.005', 'AMMO2': '0.054', 'weapon5': '0.070', 'WEAPON5': '0.150', 'weapon4': '0.218', 'AMMO3': '0.264', 'AMMO4': '0.270', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '52.500'} [2024-08-06 02:41:17,180][52658] DAMAGECOUNT value on done: 333823.0 [2024-08-06 02:41:17,183][52658] Sum rewards: 69.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.108', 'weapon5': '0.182', 'AMMO4': '0.207', 'AMMO3': '0.226', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:17,505][52668] DAMAGECOUNT value on done: 319591.0 [2024-08-06 02:41:17,506][52668] Sum rewards: 62.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.925', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.170', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.058', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:17,689][52669] DAMAGECOUNT value on done: 328496.0 [2024-08-06 02:41:17,690][52669] Sum rewards: 68.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.505', 'AMMO5': '0.006', 'AMMO2': '0.047', 'weapon5': '0.076', 'AMMO3': '0.176', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'WEAPON4': '0.400', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 327630848. Throughput: 0: 4364.2. Samples: 81907930. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:41:17,794][52567] Avg episode reward: [(0, '68.221')] [2024-08-06 02:41:18,131][52803] DAMAGECOUNT value on done: 303288.0 [2024-08-06 02:41:18,132][52803] Sum rewards: 56.742, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.139', 'weapon5': '0.148', 'AMMO4': '0.198', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.482', 'weapon2': '0.500', 'WEAPON3': '0.700', 'weapon3': '2.616', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '44.000'} [2024-08-06 02:41:18,188][52649] DAMAGECOUNT value on done: 325366.0 [2024-08-06 02:41:18,188][52649] Sum rewards: 66.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon5': '0.156', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.848', 'WEAPON3': '1.100', 'weapon3': '2.526', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.500'} [2024-08-06 02:41:18,209][52794] Large shaping reward 2.599 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.033, -11.0), ('weapon5', 0.002)] [2024-08-06 02:41:18,486][52794] DAMAGECOUNT value on done: 329094.0 [2024-08-06 02:41:18,488][52794] Sum rewards: 61.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.517', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.116', 'weapon2': '0.222', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '51.000'} [2024-08-06 02:41:18,560][52662] DAMAGECOUNT value on done: 340619.0 [2024-08-06 02:41:18,562][52662] Sum rewards: 69.905, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.332', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.104', 'weapon5': '0.142', 'AMMO3': '0.184', 'AMMO4': '0.203', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:18,873][52795] DAMAGECOUNT value on done: 309842.0 [2024-08-06 02:41:18,876][52795] Sum rewards: 73.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.985', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.247', 'weapon2': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.534', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:18,990][52660] DAMAGECOUNT value on done: 335309.0 [2024-08-06 02:41:18,994][52660] Sum rewards: 77.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.902', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.114', 'weapon4': '0.134', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '66.000'} [2024-08-06 02:41:19,378][52665] DAMAGECOUNT value on done: 324127.0 [2024-08-06 02:41:19,379][52665] Sum rewards: 66.431, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.162', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.080', 'weapon5': '0.122', 'AMMO4': '0.241', 'AMMO3': '0.294', 'weapon2': '0.354', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.168', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:19,503][52811] DAMAGECOUNT value on done: 307320.0 [2024-08-06 02:41:19,505][52811] Sum rewards: 70.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.869', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.081', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:19,967][52658] DAMAGECOUNT value on done: 330741.0 [2024-08-06 02:41:19,968][52658] Sum rewards: 76.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.216', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.454', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:20,769][52668] DAMAGECOUNT value on done: 319496.0 [2024-08-06 02:41:20,772][52668] Sum rewards: 53.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.764', 'AMMO5': '0.010', 'ARMOR': '0.028', 'weapon5': '0.040', 'AMMO2': '0.046', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.229', 'weapon4': '0.450', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '12.711', 'FRAGCOUNT': '46.000'} [2024-08-06 02:41:20,843][52650] Updated weights for policy 0, policy_version 40001 (0.0013) [2024-08-06 02:41:21,011][52669] DAMAGECOUNT value on done: 329384.0 [2024-08-06 02:41:21,011][52669] Sum rewards: 77.075, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:21,223][52803] DAMAGECOUNT value on done: 302655.0 [2024-08-06 02:41:21,223][52803] Sum rewards: 63.235, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.099', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.148', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.299', 'WEAPON3': '1.800', 'HITCOUNT': '3.020', 'weapon3': '3.316', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:21,411][52649] DAMAGECOUNT value on done: 314088.0 [2024-08-06 02:41:21,413][52649] Sum rewards: 61.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '51.000'} [2024-08-06 02:41:21,598][52794] DAMAGECOUNT value on done: 328902.0 [2024-08-06 02:41:21,602][52794] Sum rewards: 64.434, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.096', 'weapon5': '0.096', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'HEALTH': '0.340', 'weapon2': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.194', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:21,631][52662] DAMAGECOUNT value on done: 332796.0 [2024-08-06 02:41:21,631][52662] Sum rewards: 65.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.191', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.886', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:22,133][52795] DAMAGECOUNT value on done: 306877.0 [2024-08-06 02:41:22,135][52795] Sum rewards: 63.569, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.870', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.102', 'weapon5': '0.208', 'AMMO3': '0.260', 'AMMO4': '0.270', 'weapon2': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.042', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:22,157][52660] DAMAGECOUNT value on done: 331170.0 [2024-08-06 02:41:22,157][52660] Sum rewards: 64.150, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.681', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.287', 'weapon2': '0.330', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.184', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:22,623][52665] DAMAGECOUNT value on done: 325716.0 [2024-08-06 02:41:22,624][52665] Sum rewards: 65.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.088', 'weapon5': '0.136', 'AMMO4': '0.140', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.808', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:22,687][52811] DAMAGECOUNT value on done: 316530.0 [2024-08-06 02:41:22,687][52811] Sum rewards: 56.969, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.382', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.668', 'WEAPON3': '1.700', 'weapon3': '2.776', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '51.000'} [2024-08-06 02:41:22,701][52658] DAMAGECOUNT value on done: 327528.0 [2024-08-06 02:41:22,702][52658] Sum rewards: 61.874, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.458', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.178', 'weapon5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.259', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.890', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '53.500'} [2024-08-06 02:41:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17203.2, 300 sec: 17494.8). Total num frames: 327712768. Throughput: 0: 4358.2. Samples: 81933940. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:41:22,794][52567] Avg episode reward: [(0, '67.469')] [2024-08-06 02:41:23,876][52668] DAMAGECOUNT value on done: 324706.0 [2024-08-06 02:41:23,877][52668] Sum rewards: 74.017, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.655', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.156', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.236', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:23,909][52669] DAMAGECOUNT value on done: 326932.0 [2024-08-06 02:41:23,910][52669] Sum rewards: 74.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.476', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.245', 'AMMO4': '0.252', 'weapon5': '0.274', 'weapon4': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.482', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:24,292][52803] DAMAGECOUNT value on done: 309021.0 [2024-08-06 02:41:24,293][52803] Sum rewards: 62.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.094', 'weapon5': '0.156', 'AMMO4': '0.197', 'AMMO3': '0.218', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.210', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '52.000'} [2024-08-06 02:41:24,715][52649] DAMAGECOUNT value on done: 320965.0 [2024-08-06 02:41:24,716][52649] Sum rewards: 66.029, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.832', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.306', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:24,963][52794] DAMAGECOUNT value on done: 326676.0 [2024-08-06 02:41:24,963][52794] Sum rewards: 75.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.124', 'AMMO4': '0.191', 'AMMO3': '0.214', 'weapon5': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:24,990][52662] DAMAGECOUNT value on done: 332478.0 [2024-08-06 02:41:24,992][52662] Sum rewards: 60.389, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.980', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.154', 'weapon5': '0.176', 'AMMO4': '0.215', 'weapon2': '0.216', 'AMMO3': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.152', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:25,124][52660] DAMAGECOUNT value on done: 324504.0 [2024-08-06 02:41:25,126][52660] Sum rewards: 61.603, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.980', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.066', 'weapon4': '0.106', 'AMMO4': '0.228', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '3.060', 'weapon3': '3.206', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:25,274][52795] DAMAGECOUNT value on done: 294311.0 [2024-08-06 02:41:25,276][52795] Sum rewards: 52.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.162', 'AMMO3': '0.167', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.554', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.768', 'FRAGCOUNT': '44.000'} [2024-08-06 02:41:25,609][52811] DAMAGECOUNT value on done: 306642.0 [2024-08-06 02:41:25,611][52811] Sum rewards: 54.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.851', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.237', 'AMMO3': '0.244', 'weapon2': '0.306', 'weapon4': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '47.500'} [2024-08-06 02:41:25,700][52658] DAMAGECOUNT value on done: 326942.0 [2024-08-06 02:41:25,700][52658] Sum rewards: 62.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.923', 'AMMO5': '0.012', 'AMMO2': '0.051', 'AMMO3': '0.199', 'weapon5': '0.218', 'AMMO4': '0.254', 'weapon4': '0.374', 'WEAPON5': '0.450', 'weapon2': '0.558', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.528', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '52.000'} [2024-08-06 02:41:25,721][52650] Updated weights for policy 0, policy_version 40011 (0.0012) [2024-08-06 02:41:26,709][52668] DAMAGECOUNT value on done: 327873.0 [2024-08-06 02:41:26,712][52668] Sum rewards: 80.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.104', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '67.000'} [2024-08-06 02:41:26,759][52669] DAMAGECOUNT value on done: 332275.0 [2024-08-06 02:41:26,762][52669] Sum rewards: 59.575, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.960', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.104', 'weapon2': '0.232', 'AMMO4': '0.248', 'weapon5': '0.266', 'AMMO3': '0.296', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.850', 'HITCOUNT': '3.000', 'weapon3': '3.096', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:26,964][52671] DAMAGECOUNT value on done: 333831.0 [2024-08-06 02:41:26,964][52671] Sum rewards: 61.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.406', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.408', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '50.000'} [2024-08-06 02:41:27,415][52803] DAMAGECOUNT value on done: 302982.0 [2024-08-06 02:41:27,417][52803] Sum rewards: 69.922, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.792', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.124', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.305', 'WEAPON3': '1.900', 'weapon3': '3.278', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:27,744][52649] DAMAGECOUNT value on done: 318895.0 [2024-08-06 02:41:27,745][52649] Sum rewards: 66.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.098', 'AMMO4': '0.137', 'weapon5': '0.144', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 327811072. Throughput: 0: 4362.0. Samples: 81960150. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:41:27,795][52567] Avg episode reward: [(0, '67.569')] [2024-08-06 02:41:28,086][52660] DAMAGECOUNT value on done: 336195.0 [2024-08-06 02:41:28,087][52660] Sum rewards: 75.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.022', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.259', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.452', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 02:41:28,133][52794] DAMAGECOUNT value on done: 331923.0 [2024-08-06 02:41:28,134][52794] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.770', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.098', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.327', 'WEAPON3': '1.900', 'HITCOUNT': '3.210', 'weapon3': '3.232', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:28,187][52662] DAMAGECOUNT value on done: 329373.0 [2024-08-06 02:41:28,187][52662] Sum rewards: 67.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon4': '0.314', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:28,413][52795] DAMAGECOUNT value on done: 309597.0 [2024-08-06 02:41:28,413][52795] Sum rewards: 78.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.104', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.240', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.278', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '67.000'} [2024-08-06 02:41:28,639][52811] DAMAGECOUNT value on done: 308038.0 [2024-08-06 02:41:28,639][52811] Sum rewards: 66.953, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.879', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.170', 'weapon4': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.172', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:28,716][52658] DAMAGECOUNT value on done: 333478.0 [2024-08-06 02:41:28,716][52658] Sum rewards: 76.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.300', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'weapon3': '3.460', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '67.000'} [2024-08-06 02:41:29,453][52671] DAMAGECOUNT value on done: 330568.0 [2024-08-06 02:41:29,454][52671] Sum rewards: 74.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.030', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '58.500'} [2024-08-06 02:41:29,885][52669] DAMAGECOUNT value on done: 328332.0 [2024-08-06 02:41:29,887][52669] Sum rewards: 72.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.113', 'weapon5': '0.132', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:29,897][52668] DAMAGECOUNT value on done: 329548.0 [2024-08-06 02:41:29,898][52668] Sum rewards: 70.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.191', 'weapon2': '0.754', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:30,039][52650] Updated weights for policy 0, policy_version 40021 (0.0020) [2024-08-06 02:41:30,168][52671] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:41:30,271][52803] DAMAGECOUNT value on done: 311288.0 [2024-08-06 02:41:30,275][52803] Sum rewards: 54.925, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.876', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.108', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '1.002', 'WEAPON3': '1.250', 'weapon3': '2.536', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '47.000'} [2024-08-06 02:41:30,326][52649] DAMAGECOUNT value on done: 323594.0 [2024-08-06 02:41:30,326][52649] Sum rewards: 57.871, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.653', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.354', 'WEAPON3': '0.850', 'HITCOUNT': '2.900', 'weapon3': '3.100', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '46.000'} [2024-08-06 02:41:30,842][52794] DAMAGECOUNT value on done: 335873.0 [2024-08-06 02:41:30,842][52794] Sum rewards: 55.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.762', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.088', 'AMMO3': '0.163', 'AMMO4': '0.228', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '2.856', 'DAMAGECOUNT': '13.122', 'FRAGCOUNT': '47.000'} [2024-08-06 02:41:30,892][52662] DAMAGECOUNT value on done: 325130.0 [2024-08-06 02:41:30,893][52662] Sum rewards: 75.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'weapon4': '0.028', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO4': '0.190', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '64.000'} [2024-08-06 02:41:31,261][52660] DAMAGECOUNT value on done: 321396.0 [2024-08-06 02:41:31,265][52660] Sum rewards: 71.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.206', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.194', 'AMMO3': '0.211', 'AMMO4': '0.225', 'weapon2': '0.246', 'WEAPON5': '0.350', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:31,435][52658] DAMAGECOUNT value on done: 322113.0 [2024-08-06 02:41:31,436][52658] Sum rewards: 60.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.224', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.276', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.450', 'weapon3': '2.642', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '52.000'} [2024-08-06 02:41:31,523][52795] DAMAGECOUNT value on done: 301706.0 [2024-08-06 02:41:31,524][52795] Sum rewards: 60.581, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.260', 'AMMO3': '0.338', 'WEAPON3': '1.850', 'HITCOUNT': '3.080', 'weapon3': '3.296', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:31,836][52811] DAMAGECOUNT value on done: 313507.0 [2024-08-06 02:41:31,838][52811] Sum rewards: 73.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.006', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.058', 'weapon5': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.274', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.376', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:32,687][52671] DAMAGECOUNT value on done: 332095.0 [2024-08-06 02:41:32,689][52671] Sum rewards: 73.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon5': '0.212', 'AMMO3': '0.240', 'weapon2': '0.268', 'weapon4': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '61.500'} [2024-08-06 02:41:32,783][52669] DAMAGECOUNT value on done: 327538.0 [2024-08-06 02:41:32,783][52669] Sum rewards: 74.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.094', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.217', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.570', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:32,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 327901184. Throughput: 0: 4364.0. Samples: 81973350. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 02:41:32,794][52567] Avg episode reward: [(0, '67.821')] [2024-08-06 02:41:32,815][52668] DAMAGECOUNT value on done: 331305.0 [2024-08-06 02:41:32,818][52668] Sum rewards: 62.834, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.185', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.206', 'AMMO4': '0.243', 'weapon2': '0.294', 'AMMO3': '0.303', 'weapon4': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.812', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:33,225][52649] DAMAGECOUNT value on done: 327094.0 [2024-08-06 02:41:33,225][52649] Sum rewards: 78.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.599', 'weapon5': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.207', 'WEAPON3': '1.250', 'weapon3': '3.596', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '63.000'} [2024-08-06 02:41:33,410][52803] DAMAGECOUNT value on done: 309019.0 [2024-08-06 02:41:33,410][52803] Sum rewards: 81.982, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.635', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.056', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.378', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '70.000'} [2024-08-06 02:41:33,611][52794] DAMAGECOUNT value on done: 329511.0 [2024-08-06 02:41:33,612][52794] Sum rewards: 65.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.562', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:34,055][52660] DAMAGECOUNT value on done: 323781.0 [2024-08-06 02:41:34,055][52660] Sum rewards: 65.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.194', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.197', 'weapon5': '0.310', 'weapon2': '0.370', 'WEAPON4': '0.450', 'weapon4': '0.596', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.326', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:34,262][52658] DAMAGECOUNT value on done: 338348.0 [2024-08-06 02:41:34,262][52658] Sum rewards: 80.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.992', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.136', 'weapon5': '0.158', 'AMMO3': '0.171', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.924', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '65.000'} [2024-08-06 02:41:34,623][52795] DAMAGECOUNT value on done: 302209.0 [2024-08-06 02:41:34,624][52795] Sum rewards: 86.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.164', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.236', 'weapon4': '0.296', 'WEAPON3': '1.000', 'weapon3': '3.060', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '68.000'} [2024-08-06 02:41:34,825][52811] DAMAGECOUNT value on done: 305740.0 [2024-08-06 02:41:34,826][52811] Sum rewards: 64.639, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.110', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon2': '0.508', 'WEAPON3': '0.950', 'weapon3': '3.292', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '52.000'} [2024-08-06 02:41:34,874][52650] Updated weights for policy 0, policy_version 40031 (0.0013) [2024-08-06 02:41:35,434][52669] DAMAGECOUNT value on done: 330951.0 [2024-08-06 02:41:35,434][52669] Sum rewards: 71.644, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.946', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.049', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:35,822][52668] DAMAGECOUNT value on done: 326949.0 [2024-08-06 02:41:35,824][52668] Sum rewards: 84.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'weapon2': '0.162', 'AMMO3': '0.218', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '70.000'} [2024-08-06 02:41:35,831][52671] DAMAGECOUNT value on done: 330633.0 [2024-08-06 02:41:35,833][52671] Sum rewards: 73.532, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.504', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon2': '0.168', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon4': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:36,062][52649] DAMAGECOUNT value on done: 325880.0 [2024-08-06 02:41:36,062][52649] Sum rewards: 66.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.046', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.726', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:36,335][52794] DAMAGECOUNT value on done: 334936.0 [2024-08-06 02:41:36,336][52794] Sum rewards: 68.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.164', 'AMMO4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.219', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.662', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:36,438][52803] DAMAGECOUNT value on done: 304904.0 [2024-08-06 02:41:36,438][52803] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.848', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.424', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '70.000'} [2024-08-06 02:41:37,028][52660] DAMAGECOUNT value on done: 334541.0 [2024-08-06 02:41:37,029][52660] Sum rewards: 65.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.377', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.174', 'AMMO4': '0.190', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.088', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:37,367][52658] DAMAGECOUNT value on done: 331340.0 [2024-08-06 02:41:37,369][52658] Sum rewards: 67.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'weapon2': '0.234', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.532', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:37,454][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:41:37,731][52795] DAMAGECOUNT value on done: 298664.0 [2024-08-06 02:41:37,732][52795] Sum rewards: 66.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.205', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.185', 'weapon5': '0.222', 'weapon4': '0.298', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '53.000'} [2024-08-06 02:41:37,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 327974912. Throughput: 0: 4363.1. Samples: 81999590. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 02:41:37,795][52567] Avg episode reward: [(0, '68.165')] [2024-08-06 02:41:37,896][52811] DAMAGECOUNT value on done: 309916.0 [2024-08-06 02:41:37,896][52811] Sum rewards: 57.139, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.422', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.155', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '0.950', 'HITCOUNT': '2.850', 'weapon3': '2.924', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '45.000'} [2024-08-06 02:41:38,205][52669] DAMAGECOUNT value on done: 335004.0 [2024-08-06 02:41:38,206][52669] Sum rewards: 58.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.411', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.136', 'weapon4': '0.160', 'AMMO4': '0.164', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.204', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '47.500'} [2024-08-06 02:41:38,605][52671] DAMAGECOUNT value on done: 337558.0 [2024-08-06 02:41:38,607][52671] Sum rewards: 75.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.198', 'AMMO4': '0.205', 'AMMO3': '0.208', 'weapon4': '0.230', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:39,274][52650] Updated weights for policy 0, policy_version 40041 (0.0024) [2024-08-06 02:41:39,471][52794] DAMAGECOUNT value on done: 332538.0 [2024-08-06 02:41:39,473][52794] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.184', 'AMMO4': '0.196', 'AMMO3': '0.249', 'weapon2': '0.316', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.880', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:39,555][52803] DAMAGECOUNT value on done: 310869.0 [2024-08-06 02:41:39,557][52803] Sum rewards: 65.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.036', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon5': '0.090', 'weapon2': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.224', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.320', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:39,730][52660] DAMAGECOUNT value on done: 336879.0 [2024-08-06 02:41:39,732][52660] Sum rewards: 71.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.232', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:40,226][52658] DAMAGECOUNT value on done: 338565.0 [2024-08-06 02:41:40,227][52658] Sum rewards: 75.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.175', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.123', 'weapon5': '0.148', 'weapon2': '0.154', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.446', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:40,892][52795] DAMAGECOUNT value on done: 306912.0 [2024-08-06 02:41:40,892][52795] Sum rewards: 74.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:41,023][52811] DAMAGECOUNT value on done: 309247.0 [2024-08-06 02:41:41,024][52811] Sum rewards: 70.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO3': '0.173', 'AMMO4': '0.179', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:41,133][52669] DAMAGECOUNT value on done: 345237.0 [2024-08-06 02:41:41,134][52669] Sum rewards: 68.105, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.776', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'weapon4': '0.160', 'AMMO3': '0.163', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.430', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:41,684][52671] DAMAGECOUNT value on done: 327314.0 [2024-08-06 02:41:41,686][52671] Sum rewards: 55.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.994', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.128', 'AMMO3': '0.176', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '3.206', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '45.000'} [2024-08-06 02:41:42,379][52660] DAMAGECOUNT value on done: 324578.0 [2024-08-06 02:41:42,387][52660] Sum rewards: 62.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.108', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.166', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.328', 'weapon4': '0.332', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '51.000'} [2024-08-06 02:41:42,619][52658] DAMAGECOUNT value on done: 323658.0 [2024-08-06 02:41:42,620][52658] Sum rewards: 80.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.045', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.192', 'AMMO3': '0.196', 'weapon4': '0.256', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '66.000'} [2024-08-06 02:41:42,646][52794] DAMAGECOUNT value on done: 328220.0 [2024-08-06 02:41:42,650][52794] Sum rewards: 66.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.585', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:42,685][52803] DAMAGECOUNT value on done: 304318.0 [2024-08-06 02:41:42,686][52803] Sum rewards: 75.396, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.147', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.312', 'weapon2': '0.364', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:42,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 328065024. Throughput: 0: 4374.8. Samples: 82026080. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 02:41:42,795][52567] Avg episode reward: [(0, '68.413')] [2024-08-06 02:41:44,006][52795] DAMAGECOUNT value on done: 296849.0 [2024-08-06 02:41:44,007][52795] Sum rewards: 65.493, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.234', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon5': '0.196', 'AMMO3': '0.225', 'weapon2': '0.278', 'AMMO4': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:44,038][52811] DAMAGECOUNT value on done: 305162.0 [2024-08-06 02:41:44,038][52811] Sum rewards: 55.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.182', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '2.740', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.296', 'FRAGCOUNT': '45.000'} [2024-08-06 02:41:44,429][52650] Updated weights for policy 0, policy_version 40051 (0.0022) [2024-08-06 02:41:44,464][52669] DAMAGECOUNT value on done: 331490.0 [2024-08-06 02:41:44,464][52669] Sum rewards: 73.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.928', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.190', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.500', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:44,835][52671] DAMAGECOUNT value on done: 334075.0 [2024-08-06 02:41:44,835][52671] Sum rewards: 70.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.871', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.316', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:45,291][52660] DAMAGECOUNT value on done: 327593.0 [2024-08-06 02:41:45,292][52660] Sum rewards: 68.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.335', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.232', 'weapon4': '0.308', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:45,479][52794] DAMAGECOUNT value on done: 332448.0 [2024-08-06 02:41:45,479][52794] Sum rewards: 66.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.962', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.156', 'AMMO4': '0.222', 'AMMO3': '0.260', 'weapon2': '0.274', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.906', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:45,546][52658] DAMAGECOUNT value on done: 331289.0 [2024-08-06 02:41:45,547][52658] Sum rewards: 71.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.426', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.096', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:45,740][52803] DAMAGECOUNT value on done: 303597.0 [2024-08-06 02:41:45,740][52803] Sum rewards: 65.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.218', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon2': '0.184', 'AMMO3': '0.195', 'weapon5': '0.250', 'AMMO4': '0.293', 'weapon4': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '2.946', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:46,963][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:41:47,151][52795] DAMAGECOUNT value on done: 312705.0 [2024-08-06 02:41:47,153][52795] Sum rewards: 65.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.153', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '53.000'} [2024-08-06 02:41:47,290][52811] DAMAGECOUNT value on done: 307278.0 [2024-08-06 02:41:47,294][52811] Sum rewards: 64.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.527', 'AMMO5': '0.009', 'AMMO2': '0.055', 'weapon5': '0.100', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'AMMO4': '0.277', 'weapon2': '0.304', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:47,488][52671] DAMAGECOUNT value on done: 332855.0 [2024-08-06 02:41:47,489][52671] Sum rewards: 62.573, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.873', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.207', 'AMMO3': '0.215', 'weapon2': '0.260', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:47,716][52669] DAMAGECOUNT value on done: 333352.0 [2024-08-06 02:41:47,717][52669] Sum rewards: 69.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon4': '0.262', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:47,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 328163328. Throughput: 0: 4371.3. Samples: 82039320. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 02:41:47,794][52567] Avg episode reward: [(0, '67.899')] [2024-08-06 02:41:48,016][52794] DAMAGECOUNT value on done: 322697.0 [2024-08-06 02:41:48,016][52794] Sum rewards: 74.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.971', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:48,325][52660] DAMAGECOUNT value on done: 322821.0 [2024-08-06 02:41:48,326][52660] Sum rewards: 72.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.768', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.142', 'weapon5': '0.178', 'AMMO4': '0.223', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:48,730][52658] DAMAGECOUNT value on done: 329127.0 [2024-08-06 02:41:48,731][52658] Sum rewards: 66.554, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.126', 'weapon5': '0.202', 'AMMO4': '0.217', 'AMMO3': '0.231', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:48,861][52803] DAMAGECOUNT value on done: 314410.0 [2024-08-06 02:41:48,863][52803] Sum rewards: 87.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '73.000'} [2024-08-06 02:41:49,066][52650] Updated weights for policy 0, policy_version 40061 (0.0013) [2024-08-06 02:41:50,277][52795] DAMAGECOUNT value on done: 305902.0 [2024-08-06 02:41:50,279][52795] Sum rewards: 63.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.830', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.286', 'weapon2': '0.410', 'WEAPON3': '1.800', 'weapon3': '3.200', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:50,293][52671] DAMAGECOUNT value on done: 325797.0 [2024-08-06 02:41:50,295][52671] Sum rewards: 64.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.416', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.205', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '52.000'} [2024-08-06 02:41:50,409][52811] DAMAGECOUNT value on done: 310293.0 [2024-08-06 02:41:50,409][52811] Sum rewards: 71.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.182', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.092', 'weapon4': '0.114', 'AMMO3': '0.208', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:50,501][52669] DAMAGECOUNT value on done: 331895.0 [2024-08-06 02:41:50,503][52669] Sum rewards: 69.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.068', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon5': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.222', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '57.000'} [2024-08-06 02:41:50,999][52794] DAMAGECOUNT value on done: 337725.0 [2024-08-06 02:41:51,001][52794] Sum rewards: 65.785, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.981', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.794', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2024-08-06 02:41:51,046][52660] DAMAGECOUNT value on done: 331336.0 [2024-08-06 02:41:51,047][52660] Sum rewards: 63.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.545', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.114', 'weapon5': '0.120', 'weapon2': '0.174', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '54.000'} [2024-08-06 02:41:51,761][52658] DAMAGECOUNT value on done: 326113.0 [2024-08-06 02:41:51,762][52658] Sum rewards: 71.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.183', 'AMMO2': '0.002', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.011', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 02:41:52,061][52803] DAMAGECOUNT value on done: 307620.0 [2024-08-06 02:41:52,064][52803] Sum rewards: 66.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.828', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.084', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '56.000'} [2024-08-06 02:41:52,794][52567] Fps is (10 sec: 18842.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 328253440. Throughput: 0: 4378.4. Samples: 82065940. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 02:41:52,794][52567] Avg episode reward: [(0, '68.250')] [2024-08-06 02:41:52,925][52671] DAMAGECOUNT value on done: 333069.0 [2024-08-06 02:41:52,928][52671] Sum rewards: 59.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.206', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.219', 'weapon4': '0.286', 'weapon5': '0.288', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.660', 'weapon3': '2.708', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '51.000'} [2024-08-06 02:41:53,267][52669] DAMAGECOUNT value on done: 335197.0 [2024-08-06 02:41:53,268][52669] Sum rewards: 72.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.070', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '61.000'} [2024-08-06 02:41:53,452][52650] Updated weights for policy 0, policy_version 40071 (0.0013) [2024-08-06 02:41:53,492][52811] DAMAGECOUNT value on done: 306358.0 [2024-08-06 02:41:53,493][52811] Sum rewards: 76.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.784', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.116', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '3.700', 'weapon3': '3.704', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '65.000'} [2024-08-06 02:41:53,548][52794] DAMAGECOUNT value on done: 325698.0 [2024-08-06 02:41:53,550][52794] Sum rewards: 54.972, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.822', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.148', 'AMMO4': '0.149', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '3.146', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '45.000'} [2024-08-06 02:41:53,575][52795] DAMAGECOUNT value on done: 296923.0 [2024-08-06 02:41:53,577][52795] Sum rewards: 68.568, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.715', 'AMMO5': '0.017', 'AMMO2': '0.076', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.174', 'WEAPON7': '0.200', 'weapon2': '0.252', 'AMMO3': '0.268', 'weapon4': '0.322', 'AMMO4': '0.382', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.858', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:54,233][52660] DAMAGECOUNT value on done: 325129.0 [2024-08-06 02:41:54,233][52660] Sum rewards: 67.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.170', 'weapon5': '0.224', 'AMMO4': '0.253', 'AMMO3': '0.265', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:54,613][52658] DAMAGECOUNT value on done: 323304.0 [2024-08-06 02:41:54,613][52658] Sum rewards: 72.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.606', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:55,050][52820] DAMAGECOUNT value on done: 301400.0 [2024-08-06 02:41:55,050][52820] Sum rewards: 76.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon4': '0.214', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '64.000'} [2024-08-06 02:41:55,427][52803] DAMAGECOUNT value on done: 312349.0 [2024-08-06 02:41:55,427][52803] Sum rewards: 63.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.042', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.282', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.424', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '55.000'} [2024-08-06 02:41:56,053][52671] DAMAGECOUNT value on done: 336696.0 [2024-08-06 02:41:56,053][52671] Sum rewards: 72.029, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.162', 'AMMO3': '0.226', 'weapon4': '0.232', 'AMMO4': '0.245', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:56,317][52794] DAMAGECOUNT value on done: 340381.0 [2024-08-06 02:41:56,319][52794] Sum rewards: 61.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.778', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.211', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '50.500'} [2024-08-06 02:41:56,571][52811] DAMAGECOUNT value on done: 311366.0 [2024-08-06 02:41:56,573][52811] Sum rewards: 58.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.267', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.100', 'AMMO3': '0.169', 'weapon5': '0.190', 'AMMO4': '0.315', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.588', 'WEAPON3': '1.050', 'HITCOUNT': '2.770', 'weapon3': '2.850', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '46.000'} [2024-08-06 02:41:56,817][52795] DAMAGECOUNT value on done: 306562.0 [2024-08-06 02:41:56,818][52795] Sum rewards: 56.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.108', 'AMMO3': '0.184', 'weapon5': '0.202', 'AMMO4': '0.205', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '1.010', 'WEAPON3': '1.100', 'weapon3': '2.144', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '46.000'} [2024-08-06 02:41:57,171][52658] DAMAGECOUNT value on done: 336422.0 [2024-08-06 02:41:57,173][52658] Sum rewards: 72.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.270', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.186', 'weapon2': '0.190', 'weapon4': '0.194', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.156', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.000'} [2024-08-06 02:41:57,784][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:41:57,795][52567] Fps is (10 sec: 17201.9, 60 sec: 17476.0, 300 sec: 17494.7). Total num frames: 328335360. Throughput: 0: 4386.1. Samples: 82092200. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 02:41:57,795][52567] Avg episode reward: [(0, '68.345')] [2024-08-06 02:41:58,160][52820] DAMAGECOUNT value on done: 305637.0 [2024-08-06 02:41:58,160][52820] Sum rewards: 70.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.464', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.170', 'AMMO4': '0.180', 'AMMO3': '0.185', 'weapon4': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '58.000'} [2024-08-06 02:41:58,182][52650] Updated weights for policy 0, policy_version 40081 (0.0012) [2024-08-06 02:41:58,558][52803] DAMAGECOUNT value on done: 302848.0 [2024-08-06 02:41:58,558][52803] Sum rewards: 72.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO3': '0.151', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.940', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:59,083][52671] DAMAGECOUNT value on done: 330422.0 [2024-08-06 02:41:59,084][52671] Sum rewards: 72.719, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.632', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.179', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.370', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '60.000'} [2024-08-06 02:41:59,400][52794] DAMAGECOUNT value on done: 332184.0 [2024-08-06 02:41:59,403][52794] Sum rewards: 77.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '64.000'} [2024-08-06 02:41:59,982][52795] DAMAGECOUNT value on done: 311803.0 [2024-08-06 02:41:59,982][52795] Sum rewards: 81.696, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.871', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '66.000'} [2024-08-06 02:42:00,071][52658] DAMAGECOUNT value on done: 327659.0 [2024-08-06 02:42:00,073][52658] Sum rewards: 74.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.626', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.169', 'weapon5': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '60.000'} [2024-08-06 02:42:01,108][52820] DAMAGECOUNT value on done: 302657.0 [2024-08-06 02:42:01,109][52820] Sum rewards: 61.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.078', 'weapon5': '0.198', 'AMMO3': '0.230', 'AMMO4': '0.259', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.716', 'WEAPON3': '1.450', 'weapon3': '2.750', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '51.000'} [2024-08-06 02:42:01,507][52671] DAMAGECOUNT value on done: 340907.0 [2024-08-06 02:42:01,510][52671] Sum rewards: 74.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.674', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon5': '0.188', 'AMMO3': '0.242', 'AMMO4': '0.246', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 02:42:02,190][52794] DAMAGECOUNT value on done: 332446.0 [2024-08-06 02:42:02,191][52794] Sum rewards: 68.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '58.000'} [2024-08-06 02:42:02,714][52650] Updated weights for policy 0, policy_version 40091 (0.0011) [2024-08-06 02:42:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 328425472. Throughput: 0: 4386.0. Samples: 82105300. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 02:42:02,794][52567] Avg episode reward: [(0, '69.216')] [2024-08-06 02:42:02,804][52658] DAMAGECOUNT value on done: 331616.0 [2024-08-06 02:42:02,807][52658] Sum rewards: 79.629, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.618', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.150', 'weapon5': '0.186', 'AMMO4': '0.198', 'weapon2': '0.198', 'AMMO3': '0.329', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.950', 'weapon3': '3.188', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '69.000'} [2024-08-06 02:42:03,611][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:42:04,341][52820] DAMAGECOUNT value on done: 300413.0 [2024-08-06 02:42:04,342][52820] Sum rewards: 71.780, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.025', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.198', 'AMMO3': '0.247', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.308', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '62.000'} [2024-08-06 02:42:04,440][52671] DAMAGECOUNT value on done: 328862.0 [2024-08-06 02:42:04,443][52671] Sum rewards: 72.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:05,024][52794] DAMAGECOUNT value on done: 341252.0 [2024-08-06 02:42:05,026][52794] Sum rewards: 66.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.266', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.230', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.000'} [2024-08-06 02:42:05,672][52658] DAMAGECOUNT value on done: 335073.0 [2024-08-06 02:42:05,672][52658] Sum rewards: 76.246, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.208', 'AMMO3': '0.211', 'weapon2': '0.254', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '62.000'} [2024-08-06 02:42:05,945][52664] DAMAGECOUNT value on done: 342277.0 [2024-08-06 02:42:05,945][52664] Sum rewards: 68.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.058', 'AMMO3': '0.175', 'AMMO4': '0.181', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '55.000'} [2024-08-06 02:42:07,259][52650] Updated weights for policy 0, policy_version 40101 (0.0022) [2024-08-06 02:42:07,385][52820] DAMAGECOUNT value on done: 306080.0 [2024-08-06 02:42:07,390][52671] DAMAGECOUNT value on done: 323730.0 [2024-08-06 02:42:07,388][52820] Sum rewards: 79.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO4': '0.042', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '64.000'} [2024-08-06 02:42:07,391][52671] Sum rewards: 70.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:07,794][52567] Fps is (10 sec: 17204.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 328507392. Throughput: 0: 4392.2. Samples: 82131590. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 02:42:07,794][52567] Avg episode reward: [(0, '69.396')] [2024-08-06 02:42:07,913][52794] DAMAGECOUNT value on done: 331459.0 [2024-08-06 02:42:07,914][52794] Sum rewards: 67.382, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.118', 'weapon4': '0.186', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO4': '0.267', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.180', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:08,932][52664] DAMAGECOUNT value on done: 344710.0 [2024-08-06 02:42:08,933][52664] Sum rewards: 86.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.463', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.058', 'AMMO3': '0.149', 'weapon5': '0.160', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '69.000'} [2024-08-06 02:42:10,280][52671] DAMAGECOUNT value on done: 336139.0 [2024-08-06 02:42:10,281][52671] Sum rewards: 71.500, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO3': '0.153', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:10,596][52820] DAMAGECOUNT value on done: 299369.0 [2024-08-06 02:42:10,598][52820] Sum rewards: 71.217, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '61.000'} [2024-08-06 02:42:11,974][52664] DAMAGECOUNT value on done: 345785.0 [2024-08-06 02:42:11,975][52664] Sum rewards: 75.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.493', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.408', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '63.000'} [2024-08-06 02:42:12,058][52650] Updated weights for policy 0, policy_version 40111 (0.0020) [2024-08-06 02:42:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 328597504. Throughput: 0: 4392.5. Samples: 82157810. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 02:42:12,794][52567] Avg episode reward: [(0, '69.828')] [2024-08-06 02:42:12,802][52614] Saving new best policy, reward=69.828! [2024-08-06 02:42:13,276][52671] DAMAGECOUNT value on done: 335430.0 [2024-08-06 02:42:13,277][52671] Sum rewards: 71.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.140', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '58.000'} [2024-08-06 02:42:13,845][52820] DAMAGECOUNT value on done: 302825.0 [2024-08-06 02:42:13,846][52820] Sum rewards: 67.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.848', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.114', 'weapon4': '0.156', 'AMMO4': '0.165', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:14,781][52664] DAMAGECOUNT value on done: 341227.0 [2024-08-06 02:42:14,782][52664] Sum rewards: 56.726, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.504', 'AMMO5': '0.012', 'AMMO2': '0.061', 'weapon5': '0.224', 'weapon4': '0.266', 'AMMO3': '0.270', 'AMMO4': '0.307', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.684', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '50.000'} [2024-08-06 02:42:15,047][52666] DAMAGECOUNT value on done: 330686.0 [2024-08-06 02:42:15,048][52666] Sum rewards: 50.499, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO5': '0.017', 'AMMO2': '0.072', 'AMMO3': '0.255', 'weapon5': '0.262', 'weapon2': '0.286', 'AMMO4': '0.359', 'WEAPON5': '0.450', 'weapon4': '0.568', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.466', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '45.500'} [2024-08-06 02:42:15,928][52671] DAMAGECOUNT value on done: 338336.0 [2024-08-06 02:42:15,928][52671] Sum rewards: 86.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '72.000'} [2024-08-06 02:42:17,016][52820] DAMAGECOUNT value on done: 308489.0 [2024-08-06 02:42:17,016][52820] Sum rewards: 74.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.790', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.201', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '62.000'} [2024-08-06 02:42:17,023][52650] Updated weights for policy 0, policy_version 40121 (0.0012) [2024-08-06 02:42:17,767][52659] DAMAGECOUNT value on done: 332661.0 [2024-08-06 02:42:17,768][52659] Sum rewards: 68.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.178', 'AMMO3': '0.222', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.898', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 328687616. Throughput: 0: 4382.9. Samples: 82170580. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 02:42:17,794][52567] Avg episode reward: [(0, '69.939')] [2024-08-06 02:42:17,798][52614] Saving new best policy, reward=69.939! [2024-08-06 02:42:17,870][52666] DAMAGECOUNT value on done: 332634.0 [2024-08-06 02:42:17,872][52666] Sum rewards: 72.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.324', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.144', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.264', 'weapon2': '0.326', 'weapon4': '0.330', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '61.000'} [2024-08-06 02:42:17,892][52664] DAMAGECOUNT value on done: 341117.0 [2024-08-06 02:42:17,893][52664] Sum rewards: 67.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.498', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.178', 'AMMO4': '0.233', 'AMMO3': '0.242', 'weapon2': '0.262', 'weapon4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '58.000'} [2024-08-06 02:42:18,951][52671] DAMAGECOUNT value on done: 331077.0 [2024-08-06 02:42:18,956][52671] Sum rewards: 69.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.534', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.114', 'weapon5': '0.134', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.134', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '60.000'} [2024-08-06 02:42:20,239][52820] DAMAGECOUNT value on done: 304655.0 [2024-08-06 02:42:20,240][52820] Sum rewards: 70.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.079', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.108', 'weapon5': '0.138', 'AMMO3': '0.177', 'AMMO4': '0.227', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:20,640][52666] DAMAGECOUNT value on done: 334052.0 [2024-08-06 02:42:20,641][52666] Sum rewards: 59.524, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.955', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.096', 'AMMO4': '0.186', 'weapon5': '0.188', 'AMMO3': '0.193', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '3.220', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '49.000'} [2024-08-06 02:42:20,790][52659] DAMAGECOUNT value on done: 331553.0 [2024-08-06 02:42:20,790][52659] Sum rewards: 69.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.915', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.220', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:21,076][52664] DAMAGECOUNT value on done: 342094.0 [2024-08-06 02:42:21,078][52664] Sum rewards: 71.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.814', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.170', 'AMMO3': '0.228', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '60.000'} [2024-08-06 02:42:21,424][52670] DAMAGECOUNT value on done: 326656.0 [2024-08-06 02:42:21,425][52670] Sum rewards: 65.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.354', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'weapon4': '0.056', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.265', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.458', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:21,649][52650] Updated weights for policy 0, policy_version 40131 (0.0023) [2024-08-06 02:42:21,984][52671] DAMAGECOUNT value on done: 328766.0 [2024-08-06 02:42:21,984][52671] Sum rewards: 59.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.130', 'weapon4': '0.166', 'AMMO3': '0.225', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2024-08-06 02:42:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 328769536. Throughput: 0: 4378.0. Samples: 82196600. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 02:42:22,795][52567] Avg episode reward: [(0, '69.337')] [2024-08-06 02:42:23,359][52666] DAMAGECOUNT value on done: 330186.0 [2024-08-06 02:42:23,361][52666] Sum rewards: 73.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.766', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.191', 'AMMO4': '0.270', 'weapon2': '0.280', 'weapon5': '0.314', 'weapon4': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 02:42:23,368][52820] DAMAGECOUNT value on done: 307264.0 [2024-08-06 02:42:23,369][52820] Sum rewards: 74.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.385', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.448', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '65.000'} [2024-08-06 02:42:23,884][52659] DAMAGECOUNT value on done: 331193.0 [2024-08-06 02:42:23,886][52659] Sum rewards: 66.514, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'HEALTH': '0.110', 'weapon7': '0.126', 'AMMO3': '0.180', 'weapon2': '0.262', 'weapon4': '0.388', 'WEAPON3': '1.050', 'weapon3': '2.952', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '53.000'} [2024-08-06 02:42:24,040][52670] DAMAGECOUNT value on done: 330380.0 [2024-08-06 02:42:24,040][52670] Sum rewards: 61.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.070', 'weapon4': '0.156', 'AMMO4': '0.167', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '51.500'} [2024-08-06 02:42:24,237][52664] DAMAGECOUNT value on done: 344147.0 [2024-08-06 02:42:24,239][52664] Sum rewards: 66.757, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.200', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.166', 'AMMO4': '0.207', 'weapon4': '0.270', 'WEAPON5': '0.300', 'AMMO3': '0.307', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.908', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:25,919][52650] Updated weights for policy 0, policy_version 40141 (0.0020) [2024-08-06 02:42:26,209][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:42:26,216][52666] DAMAGECOUNT value on done: 327101.0 [2024-08-06 02:42:26,217][52666] Sum rewards: 69.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.160', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.040', 'AMMO4': '0.122', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '60.000'} [2024-08-06 02:42:26,572][52820] DAMAGECOUNT value on done: 305664.0 [2024-08-06 02:42:26,573][52820] Sum rewards: 64.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.059', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.058', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.854', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '53.000'} [2024-08-06 02:42:26,764][52670] DAMAGECOUNT value on done: 323779.0 [2024-08-06 02:42:26,766][52670] Sum rewards: 62.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.695', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.106', 'AMMO3': '0.196', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.428', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.700', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '52.000'} [2024-08-06 02:42:26,985][52664] DAMAGECOUNT value on done: 334445.0 [2024-08-06 02:42:26,987][52664] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.214', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '61.000'} [2024-08-06 02:42:27,002][52659] DAMAGECOUNT value on done: 330784.0 [2024-08-06 02:42:27,002][52659] Sum rewards: 66.517, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.485', 'AMMO5': '0.006', 'weapon4': '0.024', 'AMMO2': '0.029', 'weapon5': '0.076', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.406', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.280', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 328859648. Throughput: 0: 4376.7. Samples: 82223030. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 02:42:27,794][52567] Avg episode reward: [(0, '69.082')] [2024-08-06 02:42:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040144_328859648.pth... [2024-08-06 02:42:27,921][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039631_324657152.pth [2024-08-06 02:42:29,046][52666] DAMAGECOUNT value on done: 320682.0 [2024-08-06 02:42:29,048][52666] Sum rewards: 66.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.022', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.340', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.436', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '56.000'} [2024-08-06 02:42:29,564][52664] DAMAGECOUNT value on done: 347481.0 [2024-08-06 02:42:29,564][52664] Sum rewards: 55.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.654', 'WEAPON3': '1.550', 'weapon3': '2.882', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '48.500'} [2024-08-06 02:42:29,892][52670] DAMAGECOUNT value on done: 322544.0 [2024-08-06 02:42:29,893][52670] Sum rewards: 68.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.379', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '55.000'} [2024-08-06 02:42:29,966][52820] DAMAGECOUNT value on done: 305802.0 [2024-08-06 02:42:29,966][52820] Sum rewards: 61.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.146', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.186', 'weapon5': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.022', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '51.500'} [2024-08-06 02:42:30,087][52659] DAMAGECOUNT value on done: 325552.0 [2024-08-06 02:42:30,087][52659] Sum rewards: 72.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.150', 'HITCOUNT': '3.350', 'weapon3': '3.492', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '60.000'} [2024-08-06 02:42:30,829][52650] Updated weights for policy 0, policy_version 40151 (0.0016) [2024-08-06 02:42:31,829][52666] DAMAGECOUNT value on done: 331262.0 [2024-08-06 02:42:31,831][52666] Sum rewards: 61.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.794', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.140', 'weapon4': '0.152', 'AMMO3': '0.223', 'AMMO4': '0.280', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.678', 'WEAPON3': '1.400', 'weapon3': '2.768', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '52.000'} [2024-08-06 02:42:32,664][52659] DAMAGECOUNT value on done: 329772.0 [2024-08-06 02:42:32,666][52659] Sum rewards: 77.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.210', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.266', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '63.000'} [2024-08-06 02:42:32,758][52670] DAMAGECOUNT value on done: 335192.0 [2024-08-06 02:42:32,758][52670] Sum rewards: 62.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.080', 'AMMO3': '0.158', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '52.000'} [2024-08-06 02:42:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 328941568. Throughput: 0: 4366.2. Samples: 82235800. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 02:42:32,794][52567] Avg episode reward: [(0, '68.819')] [2024-08-06 02:42:32,962][52664] DAMAGECOUNT value on done: 340211.0 [2024-08-06 02:42:32,962][52664] Sum rewards: 63.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.086', 'weapon5': '0.114', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.284', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '54.000'} [2024-08-06 02:42:33,148][52820] DAMAGECOUNT value on done: 308707.0 [2024-08-06 02:42:33,159][52820] Sum rewards: 83.243, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.392', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.084', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.356', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '68.000'} [2024-08-06 02:42:34,952][52666] DAMAGECOUNT value on done: 328603.0 [2024-08-06 02:42:34,952][52666] Sum rewards: 63.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.098', 'AMMO4': '0.146', 'weapon5': '0.194', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '52.000'} [2024-08-06 02:42:35,245][52664] DAMAGECOUNT value on done: 345409.0 [2024-08-06 02:42:35,245][52664] Sum rewards: 71.936, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.252', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.261', 'weapon2': '0.290', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.418', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '64.000'} [2024-08-06 02:42:35,724][52650] Updated weights for policy 0, policy_version 40161 (0.0033) [2024-08-06 02:42:35,750][52659] DAMAGECOUNT value on done: 332436.0 [2024-08-06 02:42:35,750][52659] Sum rewards: 74.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.058', 'weapon5': '0.092', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.288', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.610', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:35,800][52670] DAMAGECOUNT value on done: 327211.0 [2024-08-06 02:42:35,801][52670] Sum rewards: 68.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.325', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.088', 'weapon2': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'WEAPON3': '1.550', 'weapon3': '3.496', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.000'} [2024-08-06 02:42:36,217][52820] DAMAGECOUNT value on done: 308541.0 [2024-08-06 02:42:36,217][52820] Sum rewards: 69.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.166', 'AMMO4': '0.168', 'AMMO3': '0.190', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.800', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 02:42:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 329031680. Throughput: 0: 4359.3. Samples: 82262110. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 02:42:37,794][52567] Avg episode reward: [(0, '68.939')] [2024-08-06 02:42:38,063][52666] DAMAGECOUNT value on done: 325624.0 [2024-08-06 02:42:38,064][52666] Sum rewards: 70.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.964', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.132', 'weapon4': '0.162', 'AMMO4': '0.219', 'AMMO3': '0.234', 'weapon2': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.226', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:38,272][52664] DAMAGECOUNT value on done: 342750.0 [2024-08-06 02:42:38,272][52664] Sum rewards: 80.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.247', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.134', 'AMMO4': '0.188', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '68.500'} [2024-08-06 02:42:38,314][52659] DAMAGECOUNT value on done: 327968.0 [2024-08-06 02:42:38,314][52659] Sum rewards: 73.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.098', 'AMMO4': '0.216', 'weapon5': '0.234', 'AMMO3': '0.265', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 02:42:38,844][52670] DAMAGECOUNT value on done: 321813.0 [2024-08-06 02:42:38,844][52670] Sum rewards: 65.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.426', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.116', 'weapon5': '0.152', 'AMMO4': '0.183', 'AMMO3': '0.221', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '56.000'} [2024-08-06 02:42:39,430][52820] DAMAGECOUNT value on done: 310376.0 [2024-08-06 02:42:39,432][52820] Sum rewards: 81.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.340', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.187', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.442', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '66.000'} [2024-08-06 02:42:39,711][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 02:42:40,364][52650] Updated weights for policy 0, policy_version 40171 (0.0020) [2024-08-06 02:42:40,976][52666] DAMAGECOUNT value on done: 324870.0 [2024-08-06 02:42:40,978][52666] Sum rewards: 66.713, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.031', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.078', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'HITCOUNT': '3.380', 'weapon3': '3.388', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:41,499][52664] DAMAGECOUNT value on done: 350381.0 [2024-08-06 02:42:41,499][52664] Sum rewards: 75.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.275', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'weapon2': '0.358', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.332', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '63.000'} [2024-08-06 02:42:41,597][52659] DAMAGECOUNT value on done: 338364.0 [2024-08-06 02:42:41,599][52659] Sum rewards: 70.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.224', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:41,907][52670] DAMAGECOUNT value on done: 324555.0 [2024-08-06 02:42:41,910][52670] Sum rewards: 61.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.320', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO4': '0.027', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.614', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '51.000'} [2024-08-06 02:42:42,565][52820] DAMAGECOUNT value on done: 306368.0 [2024-08-06 02:42:42,567][52820] Sum rewards: 64.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.064', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.035', 'weapon5': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'weapon2': '0.228', 'AMMO3': '0.246', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.486', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '56.000'} [2024-08-06 02:42:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 329121792. Throughput: 0: 4365.0. Samples: 82288620. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 02:42:42,794][52567] Avg episode reward: [(0, '69.394')] [2024-08-06 02:42:42,995][52660] Large shaping reward 2.500 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:42:43,829][52666] DAMAGECOUNT value on done: 325053.0 [2024-08-06 02:42:43,831][52666] Sum rewards: 62.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.116', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '50.000'} [2024-08-06 02:42:44,473][52664] DAMAGECOUNT value on done: 342668.0 [2024-08-06 02:42:44,474][52664] Sum rewards: 77.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.862', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon7': '0.052', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.132', 'WEAPON7': '0.200', 'weapon4': '0.286', 'weapon2': '0.464', 'WEAPON3': '0.850', 'weapon3': '3.140', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '61.000'} [2024-08-06 02:42:44,492][52663] DAMAGECOUNT value on done: 335866.0 [2024-08-06 02:42:44,493][52663] Sum rewards: 69.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.136', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:44,647][52659] DAMAGECOUNT value on done: 335738.0 [2024-08-06 02:42:44,647][52670] DAMAGECOUNT value on done: 325916.0 [2024-08-06 02:42:44,649][52670] Sum rewards: 74.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '63.000'} [2024-08-06 02:42:44,647][52659] Sum rewards: 62.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.173', 'weapon4': '0.204', 'weapon5': '0.234', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.728', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '52.500'} [2024-08-06 02:42:45,067][52650] Updated weights for policy 0, policy_version 40181 (0.0012) [2024-08-06 02:42:45,480][52820] DAMAGECOUNT value on done: 304380.0 [2024-08-06 02:42:45,483][52820] Sum rewards: 83.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.229', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.082', 'AMMO4': '0.102', 'weapon5': '0.102', 'WEAPON4': '0.150', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.300', 'weapon3': '3.434', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '69.000'} [2024-08-06 02:42:46,881][52666] DAMAGECOUNT value on done: 323625.0 [2024-08-06 02:42:46,881][52666] Sum rewards: 70.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.544', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.094', 'weapon4': '0.126', 'AMMO4': '0.160', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:47,073][52663] DAMAGECOUNT value on done: 327567.0 [2024-08-06 02:42:47,074][52663] Sum rewards: 75.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'weapon5': '0.068', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '62.000'} [2024-08-06 02:42:47,213][52664] DAMAGECOUNT value on done: 348400.0 [2024-08-06 02:42:47,213][52664] Sum rewards: 60.934, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.160', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.062', 'weapon4': '0.080', 'AMMO4': '0.145', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.438', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2024-08-06 02:42:47,429][52659] DAMAGECOUNT value on done: 329154.0 [2024-08-06 02:42:47,430][52659] Sum rewards: 56.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.136', 'weapon4': '0.180', 'AMMO3': '0.236', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '48.000'} [2024-08-06 02:42:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 329203712. Throughput: 0: 4366.4. Samples: 82301790. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 02:42:47,794][52567] Avg episode reward: [(0, '69.285')] [2024-08-06 02:42:47,795][52670] DAMAGECOUNT value on done: 319606.0 [2024-08-06 02:42:47,795][52670] Sum rewards: 75.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 02:42:48,571][52820] DAMAGECOUNT value on done: 314834.0 [2024-08-06 02:42:48,574][52820] Sum rewards: 84.655, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '3.244', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '67.000'} [2024-08-06 02:42:49,423][52650] Updated weights for policy 0, policy_version 40191 (0.0022) [2024-08-06 02:42:49,934][52666] DAMAGECOUNT value on done: 334039.0 [2024-08-06 02:42:49,935][52666] Sum rewards: 80.439, reward structure: {'DEATHCOUNT': '-9.000', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.126', 'AMMO3': '0.143', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.256', 'weapon2': '0.316', 'WEAPON3': '0.850', 'weapon3': '3.186', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '63.000'} [2024-08-06 02:42:50,034][52663] DAMAGECOUNT value on done: 328438.0 [2024-08-06 02:42:50,038][52663] Sum rewards: 70.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.987', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.368', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.362', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '59.000'} [2024-08-06 02:42:50,154][52664] DAMAGECOUNT value on done: 339153.0 [2024-08-06 02:42:50,154][52664] Sum rewards: 67.314, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.775', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.102', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '60.000'} [2024-08-06 02:42:50,397][52659] DAMAGECOUNT value on done: 334339.0 [2024-08-06 02:42:50,397][52659] Sum rewards: 84.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO3': '0.193', 'AMMO4': '0.196', 'weapon2': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '69.000'} [2024-08-06 02:42:50,796][52670] DAMAGECOUNT value on done: 334733.0 [2024-08-06 02:42:50,797][52670] Sum rewards: 68.257, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.456', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.174', 'weapon5': '0.246', 'weapon2': '0.262', 'AMMO4': '0.308', 'AMMO3': '0.313', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'weapon3': '2.936', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '62.000'} [2024-08-06 02:42:51,370][52614] Signal inference workers to stop experience collection... (7250 times) [2024-08-06 02:42:51,370][52614] Signal inference workers to resume experience collection... (7250 times) [2024-08-06 02:42:51,456][52650] InferenceWorker_p0-w0: stopping experience collection (7250 times) [2024-08-06 02:42:51,456][52650] InferenceWorker_p0-w0: resuming experience collection (7250 times) [2024-08-06 02:42:51,759][52820] DAMAGECOUNT value on done: 316348.0 [2024-08-06 02:42:51,761][52820] Sum rewards: 63.744, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.768', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.118', 'AMMO4': '0.199', 'weapon2': '0.238', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '56.000'} [2024-08-06 02:42:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 329302016. Throughput: 0: 4363.1. Samples: 82327930. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 02:42:52,794][52567] Avg episode reward: [(0, '69.894')] [2024-08-06 02:42:52,925][52663] DAMAGECOUNT value on done: 330825.0 [2024-08-06 02:42:52,927][52663] Sum rewards: 62.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.098', 'AMMO3': '0.188', 'AMMO4': '0.197', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.954', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '51.000'} [2024-08-06 02:42:53,067][52666] DAMAGECOUNT value on done: 330163.0 [2024-08-06 02:42:53,068][52666] Sum rewards: 75.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.285', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.070', 'AMMO3': '0.212', 'AMMO4': '0.214', 'weapon5': '0.222', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 02:42:53,365][52664] DAMAGECOUNT value on done: 343532.0 [2024-08-06 02:42:53,367][52664] Sum rewards: 64.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.158', 'AMMO3': '0.220', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '2.916', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '53.000'} [2024-08-06 02:42:53,626][52659] DAMAGECOUNT value on done: 321814.0 [2024-08-06 02:42:53,626][52659] Sum rewards: 55.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.110', 'weapon5': '0.154', 'AMMO4': '0.169', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '3.204', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '45.500'} [2024-08-06 02:42:53,912][52670] DAMAGECOUNT value on done: 326751.0 [2024-08-06 02:42:53,912][52670] Sum rewards: 60.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.189', 'weapon5': '0.208', 'AMMO4': '0.319', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON4': '0.600', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '2.386', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '51.000'} [2024-08-06 02:42:54,408][52650] Updated weights for policy 0, policy_version 40201 (0.0034) [2024-08-06 02:42:54,888][52820] DAMAGECOUNT value on done: 304790.0 [2024-08-06 02:42:54,890][52820] Sum rewards: 72.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.436', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.142', 'AMMO3': '0.156', 'AMMO4': '0.173', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.274', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '58.000'} [2024-08-06 02:42:55,882][52663] DAMAGECOUNT value on done: 328878.0 [2024-08-06 02:42:55,885][52663] Sum rewards: 58.357, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.166', 'AMMO3': '0.167', 'HEALTH': '0.170', 'AMMO4': '0.185', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.620', 'weapon3': '2.862', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '47.000'} [2024-08-06 02:42:56,132][52666] DAMAGECOUNT value on done: 328176.0 [2024-08-06 02:42:56,132][52666] Sum rewards: 73.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.097', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.154', 'AMMO3': '0.179', 'weapon5': '0.228', 'AMMO4': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '59.500'} [2024-08-06 02:42:56,182][52664] DAMAGECOUNT value on done: 342404.0 [2024-08-06 02:42:56,184][52664] Sum rewards: 68.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.079', 'AMMO3': '0.189', 'weapon2': '0.372', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.396', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:57,003][52670] DAMAGECOUNT value on done: 328697.0 [2024-08-06 02:42:57,004][52670] Sum rewards: 62.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '53.000'} [2024-08-06 02:42:57,094][52659] DAMAGECOUNT value on done: 331882.0 [2024-08-06 02:42:57,095][52659] Sum rewards: 66.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.058', 'weapon4': '0.104', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:57,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 329383936. Throughput: 0: 4354.6. Samples: 82353770. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 02:42:57,795][52567] Avg episode reward: [(0, '69.648')] [2024-08-06 02:42:58,704][52666] DAMAGECOUNT value on done: 329291.0 [2024-08-06 02:42:58,704][52666] Sum rewards: 71.083, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.725', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.143', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.272', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:58,820][52664] DAMAGECOUNT value on done: 343202.0 [2024-08-06 02:42:58,823][52664] Sum rewards: 58.133, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.590', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.120', 'AMMO3': '0.179', 'AMMO4': '0.183', 'weapon4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '2.952', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '48.000'} [2024-08-06 02:42:58,856][52663] DAMAGECOUNT value on done: 334848.0 [2024-08-06 02:42:58,856][52663] Sum rewards: 70.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.225', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon4': '0.192', 'AMMO3': '0.197', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.390', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '57.000'} [2024-08-06 02:42:59,260][52670] DAMAGECOUNT value on done: 332441.0 [2024-08-06 02:42:59,260][52670] Sum rewards: 53.939, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.161', 'weapon5': '0.164', 'AMMO4': '0.172', 'weapon4': '0.174', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.730', 'weapon3': '3.224', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '42.000'} [2024-08-06 02:42:59,534][52650] Updated weights for policy 0, policy_version 40211 (0.0022) [2024-08-06 02:42:59,895][52659] DAMAGECOUNT value on done: 337630.0 [2024-08-06 02:42:59,895][52659] Sum rewards: 67.988, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.446', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.350', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:01,506][52663] DAMAGECOUNT value on done: 329810.0 [2024-08-06 02:43:01,515][52663] Sum rewards: 62.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.506', 'AMMO2': '0.024', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.240', 'weapon2': '0.260', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.364', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '53.000'} [2024-08-06 02:43:01,563][52666] DAMAGECOUNT value on done: 327285.0 [2024-08-06 02:43:01,563][52666] Sum rewards: 64.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.019', 'AMMO2': '0.070', 'AMMO3': '0.179', 'weapon4': '0.212', 'weapon5': '0.310', 'weapon2': '0.342', 'AMMO4': '0.348', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:01,678][52664] DAMAGECOUNT value on done: 342367.0 [2024-08-06 02:43:01,678][52664] Sum rewards: 61.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.708', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.148', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.534', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '49.000'} [2024-08-06 02:43:02,419][52670] DAMAGECOUNT value on done: 330682.0 [2024-08-06 02:43:02,420][52670] Sum rewards: 76.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.732', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.201', 'weapon2': '0.290', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '63.000'} [2024-08-06 02:43:02,795][52567] Fps is (10 sec: 16383.1, 60 sec: 17339.6, 300 sec: 17522.5). Total num frames: 329465856. Throughput: 0: 4362.6. Samples: 82366900. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 02:43:02,795][52567] Avg episode reward: [(0, '68.882')] [2024-08-06 02:43:02,864][52659] DAMAGECOUNT value on done: 338722.0 [2024-08-06 02:43:02,865][52659] Sum rewards: 60.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.584', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.132', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '2.884', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '51.000'} [2024-08-06 02:43:03,511][52650] Updated weights for policy 0, policy_version 40221 (0.0013) [2024-08-06 02:43:04,672][52663] DAMAGECOUNT value on done: 329118.0 [2024-08-06 02:43:04,675][52666] DAMAGECOUNT value on done: 328638.0 [2024-08-06 02:43:04,675][52663] Sum rewards: 69.754, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.060', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.331', 'weapon2': '0.536', 'WEAPON3': '1.950', 'weapon3': '3.070', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '64.000'} [2024-08-06 02:43:04,677][52666] Sum rewards: 61.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.605', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.157', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.792', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:05,536][52670] DAMAGECOUNT value on done: 315435.0 [2024-08-06 02:43:05,540][52670] Sum rewards: 73.954, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.016', 'HEALTH': '0.020', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.198', 'weapon4': '0.286', 'WEAPON3': '1.050', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '59.000'} [2024-08-06 02:43:05,845][52659] DAMAGECOUNT value on done: 334244.0 [2024-08-06 02:43:05,846][52659] Sum rewards: 60.465, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.612', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.090', 'weapon5': '0.092', 'AMMO4': '0.119', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.290', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '52.500'} [2024-08-06 02:43:06,442][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:43:06,600][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:43:07,639][52666] DAMAGECOUNT value on done: 321898.0 [2024-08-06 02:43:07,641][52666] Sum rewards: 64.781, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.243', 'weapon2': '0.374', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.320', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 02:43:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 329555968. Throughput: 0: 4370.5. Samples: 82393270. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 02:43:07,794][52567] Avg episode reward: [(0, '68.441')] [2024-08-06 02:43:07,871][52663] DAMAGECOUNT value on done: 327640.0 [2024-08-06 02:43:07,873][52663] Sum rewards: 58.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.038', 'AMMO5': '0.005', 'AMMO2': '0.037', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.116', 'weapon7': '0.128', 'AMMO3': '0.168', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.334', 'weapon4': '0.392', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.810', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '49.000'} [2024-08-06 02:43:08,520][52650] Updated weights for policy 0, policy_version 40231 (0.0021) [2024-08-06 02:43:08,635][52670] DAMAGECOUNT value on done: 330636.0 [2024-08-06 02:43:08,636][52670] Sum rewards: 60.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.117', 'weapon4': '0.172', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '48.500'} [2024-08-06 02:43:08,668][52659] DAMAGECOUNT value on done: 330113.0 [2024-08-06 02:43:08,668][52659] Sum rewards: 57.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.171', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.196', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '47.000'} [2024-08-06 02:43:10,687][52663] DAMAGECOUNT value on done: 331837.0 [2024-08-06 02:43:10,688][52663] Sum rewards: 65.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon4': '0.200', 'AMMO3': '0.239', 'weapon5': '0.314', 'AMMO4': '0.320', 'weapon2': '0.550', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.532', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '55.000'} [2024-08-06 02:43:11,013][52666] DAMAGECOUNT value on done: 329806.0 [2024-08-06 02:43:11,013][52666] Sum rewards: 58.763, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.252', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.184', 'weapon5': '0.198', 'AMMO3': '0.215', 'AMMO4': '0.217', 'weapon2': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '2.940', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '52.000'} [2024-08-06 02:43:11,743][52659] DAMAGECOUNT value on done: 334455.0 [2024-08-06 02:43:11,751][52659] Sum rewards: 69.806, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.284', 'weapon2': '0.326', 'WEAPON3': '1.700', 'HITCOUNT': '3.260', 'weapon3': '3.280', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '61.000'} [2024-08-06 02:43:11,915][52670] DAMAGECOUNT value on done: 336409.0 [2024-08-06 02:43:11,920][52670] Sum rewards: 57.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.538', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.174', 'AMMO3': '0.218', 'AMMO4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'weapon4': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.498', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '49.000'} [2024-08-06 02:43:12,795][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 329646080. Throughput: 0: 4371.7. Samples: 82419760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:43:12,795][52567] Avg episode reward: [(0, '67.623')] [2024-08-06 02:43:12,866][52650] Updated weights for policy 0, policy_version 40241 (0.0011) [2024-08-06 02:43:13,369][52663] DAMAGECOUNT value on done: 333907.0 [2024-08-06 02:43:13,369][52663] Sum rewards: 69.495, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon2': '0.248', 'AMMO3': '0.291', 'WEAPON3': '1.800', 'weapon3': '3.410', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '62.000'} [2024-08-06 02:43:14,583][52659] DAMAGECOUNT value on done: 335026.0 [2024-08-06 02:43:14,586][52659] Sum rewards: 62.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.116', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon5': '0.182', 'AMMO4': '0.243', 'weapon2': '0.260', 'AMMO3': '0.265', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.136', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:15,127][52670] DAMAGECOUNT value on done: 328708.0 [2024-08-06 02:43:15,130][52670] Sum rewards: 75.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.117', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.036', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.189', 'weapon5': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '62.000'} [2024-08-06 02:43:15,145][52647] DAMAGECOUNT value on done: 349956.0 [2024-08-06 02:43:15,146][52647] Sum rewards: 85.507, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.022', 'HEALTH': '0.076', 'AMMO4': '0.111', 'AMMO3': '0.166', 'weapon4': '0.182', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '0.950', 'weapon3': '2.928', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '70.000'} [2024-08-06 02:43:16,119][52663] DAMAGECOUNT value on done: 330497.0 [2024-08-06 02:43:16,119][52663] Sum rewards: 61.568, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.690', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.163', 'weapon2': '0.292', 'AMMO3': '0.295', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.800', 'weapon3': '2.976', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '55.000'} [2024-08-06 02:43:17,668][52650] Updated weights for policy 0, policy_version 40251 (0.0016) [2024-08-06 02:43:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 329736192. Throughput: 0: 4383.6. Samples: 82433060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:43:17,794][52567] Avg episode reward: [(0, '67.802')] [2024-08-06 02:43:18,249][52647] DAMAGECOUNT value on done: 348151.0 [2024-08-06 02:43:18,250][52647] Sum rewards: 69.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.895', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.176', 'AMMO4': '0.188', 'AMMO3': '0.213', 'weapon2': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '57.000'} [2024-08-06 02:43:18,322][52670] DAMAGECOUNT value on done: 329548.0 [2024-08-06 02:43:18,323][52670] Sum rewards: 71.304, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.766', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.160', 'weapon4': '0.164', 'AMMO4': '0.187', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.068', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '58.000'} [2024-08-06 02:43:18,731][52663] DAMAGECOUNT value on done: 324716.0 [2024-08-06 02:43:18,733][52663] Sum rewards: 72.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.680', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.174', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.348', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '2.824', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '61.000'} [2024-08-06 02:43:19,415][52647] Large shaping reward 2.548 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 02:43:21,302][52647] DAMAGECOUNT value on done: 347742.0 [2024-08-06 02:43:21,303][52647] Sum rewards: 60.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.053', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.142', 'AMMO4': '0.201', 'AMMO3': '0.230', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.234', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '51.000'} [2024-08-06 02:43:21,546][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:43:21,644][52663] DAMAGECOUNT value on done: 326545.0 [2024-08-06 02:43:21,646][52663] Sum rewards: 77.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.063', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.106', 'weapon5': '0.132', 'weapon2': '0.154', 'AMMO4': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.386', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '62.000'} [2024-08-06 02:43:22,420][52650] Updated weights for policy 0, policy_version 40261 (0.0014) [2024-08-06 02:43:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 329818112. Throughput: 0: 4381.5. Samples: 82459280. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:43:22,795][52567] Avg episode reward: [(0, '67.934')] [2024-08-06 02:43:23,397][52794] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:43:24,402][52647] DAMAGECOUNT value on done: 352102.0 [2024-08-06 02:43:24,405][52647] Sum rewards: 66.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.979', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.160', 'AMMO3': '0.194', 'weapon2': '0.220', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.074', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '57.000'} [2024-08-06 02:43:24,978][52663] DAMAGECOUNT value on done: 328003.0 [2024-08-06 02:43:24,978][52663] Sum rewards: 75.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.104', 'weapon4': '0.178', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '60.000'} [2024-08-06 02:43:26,289][52667] DAMAGECOUNT value on done: 330665.0 [2024-08-06 02:43:26,291][52667] Sum rewards: 50.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.525', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.207', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.952', 'WEAPON3': '1.100', 'weapon3': '2.358', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '13.302', 'FRAGCOUNT': '41.000'} [2024-08-06 02:43:26,751][52647] DAMAGECOUNT value on done: 349425.0 [2024-08-06 02:43:26,751][52647] Sum rewards: 67.035, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.449', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.155', 'AMMO4': '0.158', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.168', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '53.000'} [2024-08-06 02:43:26,983][52650] Updated weights for policy 0, policy_version 40271 (0.0028) [2024-08-06 02:43:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 329908224. Throughput: 0: 4377.5. Samples: 82485610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:43:27,794][52567] Avg episode reward: [(0, '67.873')] [2024-08-06 02:43:27,833][52663] DAMAGECOUNT value on done: 335924.0 [2024-08-06 02:43:27,835][52663] Sum rewards: 75.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.859', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.228', 'weapon2': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '62.000'} [2024-08-06 02:43:29,499][52647] DAMAGECOUNT value on done: 353355.0 [2024-08-06 02:43:29,500][52647] Sum rewards: 67.569, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.310', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.478', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '56.000'} [2024-08-06 02:43:29,675][52667] DAMAGECOUNT value on done: 336628.0 [2024-08-06 02:43:29,675][52667] Sum rewards: 58.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.311', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.127', 'AMMO3': '0.192', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '50.000'} [2024-08-06 02:43:30,465][52663] DAMAGECOUNT value on done: 331035.0 [2024-08-06 02:43:30,465][52663] Sum rewards: 73.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.041', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.132', 'weapon4': '0.194', 'AMMO4': '0.229', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '60.000'} [2024-08-06 02:43:31,592][52650] Updated weights for policy 0, policy_version 40281 (0.0022) [2024-08-06 02:43:32,290][52647] DAMAGECOUNT value on done: 348801.0 [2024-08-06 02:43:32,291][52647] Sum rewards: 69.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.338', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '59.000'} [2024-08-06 02:43:32,497][52667] DAMAGECOUNT value on done: 332089.0 [2024-08-06 02:43:32,497][52667] Sum rewards: 71.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.124', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.112', 'weapon5': '0.142', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '59.000'} [2024-08-06 02:43:32,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 329998336. Throughput: 0: 4379.8. Samples: 82498880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:43:32,794][52567] Avg episode reward: [(0, '67.911')] [2024-08-06 02:43:33,454][52663] DAMAGECOUNT value on done: 336586.0 [2024-08-06 02:43:33,455][52663] Sum rewards: 67.177, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.264', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.168', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.182', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '57.000'} [2024-08-06 02:43:33,915][52649] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 02:43:34,535][52665] DAMAGECOUNT value on done: 326081.0 [2024-08-06 02:43:34,536][52665] Sum rewards: 57.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.216', 'weapon2': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.158', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '48.000'} [2024-08-06 02:43:34,781][52647] DAMAGECOUNT value on done: 347157.0 [2024-08-06 02:43:34,782][52647] Sum rewards: 72.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '61.000'} [2024-08-06 02:43:35,391][52667] DAMAGECOUNT value on done: 333217.0 [2024-08-06 02:43:35,393][52667] Sum rewards: 65.546, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.948', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.176', 'AMMO4': '0.193', 'weapon2': '0.264', 'AMMO3': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.112', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '59.000'} [2024-08-06 02:43:35,398][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:43:36,533][52663] DAMAGECOUNT value on done: 333028.0 [2024-08-06 02:43:36,534][52663] Sum rewards: 63.857, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.734', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.158', 'weapon4': '0.196', 'AMMO3': '0.242', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '56.000'} [2024-08-06 02:43:36,754][52650] Updated weights for policy 0, policy_version 40291 (0.0014) [2024-08-06 02:43:37,024][52647] DAMAGECOUNT value on done: 355331.0 [2024-08-06 02:43:37,025][52647] Sum rewards: 75.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.086', 'weapon2': '0.166', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '63.000'} [2024-08-06 02:43:37,700][52665] DAMAGECOUNT value on done: 331646.0 [2024-08-06 02:43:37,701][52665] Sum rewards: 72.915, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.945', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.073', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.150', 'weapon3': '3.202', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '60.000'} [2024-08-06 02:43:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 330088448. Throughput: 0: 4380.0. Samples: 82525030. Policy #0 lag: (min: 2.0, avg: 4.1, max: 9.0) [2024-08-06 02:43:37,794][52567] Avg episode reward: [(0, '68.101')] [2024-08-06 02:43:38,154][52667] DAMAGECOUNT value on done: 337590.0 [2024-08-06 02:43:38,156][52667] Sum rewards: 66.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.972', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.095', 'AMMO3': '0.189', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.262', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:39,546][52663] DAMAGECOUNT value on done: 326438.0 [2024-08-06 02:43:39,547][52663] Sum rewards: 65.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.240', 'AMMO2': '0.014', 'AMMO5': '0.017', 'weapon4': '0.028', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.000'} [2024-08-06 02:43:40,118][52647] DAMAGECOUNT value on done: 346451.0 [2024-08-06 02:43:40,122][52647] Sum rewards: 64.144, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.444', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.072', 'AMMO3': '0.197', 'weapon2': '0.802', 'WEAPON3': '1.100', 'weapon3': '2.990', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '52.000'} [2024-08-06 02:43:40,150][52665] DAMAGECOUNT value on done: 331816.0 [2024-08-06 02:43:40,150][52665] Sum rewards: 81.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.099', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.232', 'WEAPON3': '1.250', 'weapon3': '3.348', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '67.000'} [2024-08-06 02:43:40,802][52650] Updated weights for policy 0, policy_version 40301 (0.0011) [2024-08-06 02:43:40,864][52667] DAMAGECOUNT value on done: 337177.0 [2024-08-06 02:43:40,867][52667] Sum rewards: 63.722, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.995', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.202', 'weapon2': '0.256', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '58.000'} [2024-08-06 02:43:42,438][52647] DAMAGECOUNT value on done: 354456.0 [2024-08-06 02:43:42,446][52647] Sum rewards: 80.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.854', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.166', 'weapon5': '0.178', 'weapon2': '0.198', 'AMMO4': '0.236', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '67.000'} [2024-08-06 02:43:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 330170368. Throughput: 0: 4390.3. Samples: 82551330. Policy #0 lag: (min: 2.0, avg: 4.1, max: 9.0) [2024-08-06 02:43:42,794][52567] Avg episode reward: [(0, '68.311')] [2024-08-06 02:43:43,176][52662] DAMAGECOUNT value on done: 343252.0 [2024-08-06 02:43:43,178][52662] Sum rewards: 66.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.984', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'weapon5': '0.164', 'WEAPON7': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '2.584', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '55.000'} [2024-08-06 02:43:43,349][52665] DAMAGECOUNT value on done: 327337.0 [2024-08-06 02:43:43,350][52665] Sum rewards: 74.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.226', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '63.000'} [2024-08-06 02:43:44,076][52667] DAMAGECOUNT value on done: 338300.0 [2024-08-06 02:43:44,076][52667] Sum rewards: 67.292, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.196', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.144', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'weapon3': '3.238', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '60.000'} [2024-08-06 02:43:45,154][52647] DAMAGECOUNT value on done: 345211.0 [2024-08-06 02:43:45,155][52647] Sum rewards: 76.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.542', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '62.000'} [2024-08-06 02:43:45,955][52650] Updated weights for policy 0, policy_version 40311 (0.0013) [2024-08-06 02:43:45,967][52665] DAMAGECOUNT value on done: 323677.0 [2024-08-06 02:43:45,968][52665] Sum rewards: 72.391, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.805', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.080', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon2': '0.212', 'AMMO3': '0.257', 'weapon4': '0.266', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '63.000'} [2024-08-06 02:43:46,051][52662] DAMAGECOUNT value on done: 337328.0 [2024-08-06 02:43:46,053][52662] Sum rewards: 73.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.226', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'weapon3': '3.506', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '61.000'} [2024-08-06 02:43:47,027][52667] DAMAGECOUNT value on done: 332973.0 [2024-08-06 02:43:47,028][52667] Sum rewards: 56.076, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.934', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon5': '0.212', 'AMMO3': '0.228', 'weapon4': '0.264', 'weapon2': '0.270', 'AMMO4': '0.331', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '50.500'} [2024-08-06 02:43:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 330252288. Throughput: 0: 4388.7. Samples: 82564390. Policy #0 lag: (min: 2.0, avg: 4.1, max: 9.0) [2024-08-06 02:43:47,794][52567] Avg episode reward: [(0, '68.158')] [2024-08-06 02:43:48,275][52647] DAMAGECOUNT value on done: 347086.0 [2024-08-06 02:43:48,275][52647] Sum rewards: 72.584, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.334', 'AMMO5': '0.005', 'weapon5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '63.000'} [2024-08-06 02:43:48,298][52662] DAMAGECOUNT value on done: 337046.0 [2024-08-06 02:43:48,298][52662] Sum rewards: 70.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.156', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO4': '0.134', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2024-08-06 02:43:48,312][52665] DAMAGECOUNT value on done: 323678.0 [2024-08-06 02:43:48,314][52665] Sum rewards: 65.737, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.166', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.064', 'weapon5': '0.152', 'AMMO4': '0.162', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '58.000'} [2024-08-06 02:43:48,786][52649] DAMAGECOUNT value on done: 324234.0 [2024-08-06 02:43:48,788][52649] Sum rewards: 69.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.072', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.247', 'WEAPON3': '1.400', 'HITCOUNT': '3.400', 'weapon3': '3.500', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 02:43:50,011][52667] DAMAGECOUNT value on done: 332963.0 [2024-08-06 02:43:50,011][52667] Sum rewards: 58.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.192', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.205', 'weapon2': '0.272', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '48.000'} [2024-08-06 02:43:50,870][52650] Updated weights for policy 0, policy_version 40321 (0.0011) [2024-08-06 02:43:51,011][52662] DAMAGECOUNT value on done: 328231.0 [2024-08-06 02:43:51,011][52662] Sum rewards: 74.743, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.189', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.147', 'weapon5': '0.160', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '59.000'} [2024-08-06 02:43:51,094][52647] DAMAGECOUNT value on done: 347988.0 [2024-08-06 02:43:51,094][52647] Sum rewards: 67.532, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '56.000'} [2024-08-06 02:43:51,258][52665] DAMAGECOUNT value on done: 329834.0 [2024-08-06 02:43:51,258][52665] Sum rewards: 53.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO4': '0.216', 'weapon5': '0.218', 'AMMO3': '0.256', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.062', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '46.000'} [2024-08-06 02:43:51,850][52649] DAMAGECOUNT value on done: 318206.0 [2024-08-06 02:43:51,852][52649] Sum rewards: 64.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.201', 'AMMO3': '0.202', 'weapon2': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.342', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 330350592. Throughput: 0: 4384.0. Samples: 82590550. Policy #0 lag: (min: 2.0, avg: 4.1, max: 9.0) [2024-08-06 02:43:52,794][52567] Avg episode reward: [(0, '67.740')] [2024-08-06 02:43:52,887][52668] DAMAGECOUNT value on done: 329836.0 [2024-08-06 02:43:52,889][52668] Sum rewards: 68.704, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.270', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.084', 'AMMO3': '0.146', 'weapon5': '0.170', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '0.900', 'HITCOUNT': '2.990', 'weapon3': '3.058', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:53,255][52667] DAMAGECOUNT value on done: 340553.0 [2024-08-06 02:43:53,258][52667] Sum rewards: 67.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.092', 'AMMO4': '0.157', 'weapon5': '0.176', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '56.000'} [2024-08-06 02:43:53,794][52647] DAMAGECOUNT value on done: 356854.0 [2024-08-06 02:43:53,796][52647] Sum rewards: 79.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.957', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.412', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '64.000'} [2024-08-06 02:43:53,820][52662] DAMAGECOUNT value on done: 338844.0 [2024-08-06 02:43:53,820][52662] Sum rewards: 67.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.214', 'AMMO5': '0.019', 'AMMO2': '0.084', 'AMMO3': '0.219', 'weapon2': '0.280', 'weapon5': '0.332', 'AMMO4': '0.421', 'weapon4': '0.504', 'WEAPON5': '0.600', 'WEAPON4': '0.950', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '57.500'} [2024-08-06 02:43:54,073][52665] DAMAGECOUNT value on done: 332909.0 [2024-08-06 02:43:54,074][52665] Sum rewards: 87.881, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.550', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.112', 'weapon2': '0.218', 'weapon5': '0.236', 'AMMO4': '0.274', 'AMMO3': '0.277', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.068', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.463', 'FRAGCOUNT': '76.000'} [2024-08-06 02:43:54,524][52649] DAMAGECOUNT value on done: 325087.0 [2024-08-06 02:43:54,525][52649] Sum rewards: 72.210, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.506', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.218', 'AMMO4': '0.249', 'AMMO3': '0.295', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON4': '0.550', 'weapon4': '0.598', 'WEAPON3': '1.650', 'weapon3': '2.354', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '62.000'} [2024-08-06 02:43:54,978][52650] Updated weights for policy 0, policy_version 40331 (0.0019) [2024-08-06 02:43:56,032][52668] DAMAGECOUNT value on done: 334496.0 [2024-08-06 02:43:56,035][52668] Sum rewards: 62.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon2': '0.196', 'AMMO4': '0.212', 'weapon4': '0.226', 'AMMO3': '0.230', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.026', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '52.500'} [2024-08-06 02:43:56,099][52667] DAMAGECOUNT value on done: 333706.0 [2024-08-06 02:43:56,100][52667] Sum rewards: 79.890, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.044', 'AMMO4': '0.058', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '66.000'} [2024-08-06 02:43:56,702][52662] DAMAGECOUNT value on done: 331226.0 [2024-08-06 02:43:56,703][52662] Sum rewards: 68.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.050', 'AMMO4': '0.166', 'weapon5': '0.166', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.142', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '57.000'} [2024-08-06 02:43:56,722][52647] DAMAGECOUNT value on done: 349556.0 [2024-08-06 02:43:56,723][52647] Sum rewards: 62.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.214', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO4': '0.181', 'weapon2': '0.196', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.268', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '54.000'} [2024-08-06 02:43:57,132][52665] DAMAGECOUNT value on done: 331313.0 [2024-08-06 02:43:57,134][52665] Sum rewards: 60.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.928', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.145', 'weapon4': '0.152', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '51.000'} [2024-08-06 02:43:57,720][52649] DAMAGECOUNT value on done: 323445.0 [2024-08-06 02:43:57,720][52649] Sum rewards: 68.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.176', 'AMMO4': '0.222', 'weapon5': '0.222', 'weapon2': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '55.000'} [2024-08-06 02:43:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 330432512. Throughput: 0: 4378.3. Samples: 82616780. Policy #0 lag: (min: 2.0, avg: 4.1, max: 9.0) [2024-08-06 02:43:57,795][52567] Avg episode reward: [(0, '67.683')] [2024-08-06 02:43:58,644][52658] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0)] [2024-08-06 02:43:58,995][52668] DAMAGECOUNT value on done: 337123.0 [2024-08-06 02:43:58,995][52668] Sum rewards: 74.341, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.215', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.142', 'AMMO4': '0.204', 'AMMO3': '0.220', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.244', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '64.000'} [2024-08-06 02:43:59,037][52667] DAMAGECOUNT value on done: 335028.0 [2024-08-06 02:43:59,039][52667] Sum rewards: 66.025, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.260', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.135', 'AMMO3': '0.141', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.000', 'HITCOUNT': '3.010', 'weapon3': '3.080', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '53.000'} [2024-08-06 02:43:59,486][52662] DAMAGECOUNT value on done: 339548.0 [2024-08-06 02:43:59,487][52662] Sum rewards: 58.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.956', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.062', 'AMMO3': '0.174', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.390', 'weapon4': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '48.000'} [2024-08-06 02:43:59,700][52665] DAMAGECOUNT value on done: 330068.0 [2024-08-06 02:43:59,702][52665] Sum rewards: 55.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.180', 'weapon2': '0.226', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.296', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '50.500'} [2024-08-06 02:43:59,805][52647] DAMAGECOUNT value on done: 348343.0 [2024-08-06 02:43:59,805][52647] Sum rewards: 67.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.918', 'AMMO5': '0.007', 'weapon4': '0.048', 'AMMO2': '0.051', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.257', 'weapon2': '0.486', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.148', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:00,094][52650] Updated weights for policy 0, policy_version 40341 (0.0013) [2024-08-06 02:44:00,118][52649] DAMAGECOUNT value on done: 315687.0 [2024-08-06 02:44:00,120][52649] Sum rewards: 72.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.110', 'weapon5': '0.122', 'AMMO4': '0.171', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:02,113][52667] DAMAGECOUNT value on done: 335371.0 [2024-08-06 02:44:02,115][52667] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.136', 'weapon2': '0.180', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon4': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.156', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:02,137][52668] DAMAGECOUNT value on done: 338604.0 [2024-08-06 02:44:02,139][52668] Sum rewards: 75.668, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.800', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.074', 'AMMO4': '0.166', 'weapon5': '0.172', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.600', 'weapon3': '2.938', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 02:44:02,344][52647] DAMAGECOUNT value on done: 345243.0 [2024-08-06 02:44:02,347][52647] Sum rewards: 57.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.074', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.084', 'weapon5': '0.136', 'AMMO4': '0.151', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.160', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '50.000'} [2024-08-06 02:44:02,472][52662] DAMAGECOUNT value on done: 344175.0 [2024-08-06 02:44:02,472][52662] Sum rewards: 68.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.166', 'weapon5': '0.172', 'AMMO3': '0.206', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.762', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:02,761][52665] DAMAGECOUNT value on done: 337266.0 [2024-08-06 02:44:02,764][52665] Sum rewards: 75.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.526', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '63.000'} [2024-08-06 02:44:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17613.0, 300 sec: 17522.6). Total num frames: 330522624. Throughput: 0: 4374.4. Samples: 82629910. Policy #0 lag: (min: 2.0, avg: 4.1, max: 9.0) [2024-08-06 02:44:02,794][52567] Avg episode reward: [(0, '67.436')] [2024-08-06 02:44:03,126][52649] DAMAGECOUNT value on done: 326437.0 [2024-08-06 02:44:03,133][52649] Sum rewards: 67.718, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.030', 'AMMO5': '0.029', 'AMMO2': '0.072', 'weapon4': '0.206', 'weapon5': '0.236', 'AMMO3': '0.282', 'weapon2': '0.350', 'AMMO4': '0.359', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.700', 'weapon3': '2.828', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:04,411][52650] Updated weights for policy 0, policy_version 40351 (0.0010) [2024-08-06 02:44:05,017][52668] DAMAGECOUNT value on done: 326999.0 [2024-08-06 02:44:05,019][52668] Sum rewards: 56.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.934', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.112', 'AMMO3': '0.221', 'AMMO4': '0.224', 'weapon2': '0.240', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '3.052', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '49.000'} [2024-08-06 02:44:05,155][52662] DAMAGECOUNT value on done: 333321.0 [2024-08-06 02:44:05,157][52662] Sum rewards: 61.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.805', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.197', 'weapon5': '0.212', 'AMMO4': '0.222', 'weapon2': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:05,306][52647] DAMAGECOUNT value on done: 342544.0 [2024-08-06 02:44:05,306][52647] Sum rewards: 74.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.126', 'AMMO4': '0.166', 'AMMO3': '0.186', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:05,475][52667] DAMAGECOUNT value on done: 329874.0 [2024-08-06 02:44:05,476][52667] Sum rewards: 68.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.942', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.040', 'weapon5': '0.054', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.340', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.374', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:05,578][52665] DAMAGECOUNT value on done: 329902.0 [2024-08-06 02:44:05,579][52665] Sum rewards: 62.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.060', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.386', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:05,966][52649] DAMAGECOUNT value on done: 322485.0 [2024-08-06 02:44:05,968][52649] Sum rewards: 64.720, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.116', 'weapon4': '0.142', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.808', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:06,815][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:44:07,102][52669] DAMAGECOUNT value on done: 337992.0 [2024-08-06 02:44:07,103][52669] Sum rewards: 69.268, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.066', 'weapon5': '0.176', 'AMMO3': '0.183', 'AMMO4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:07,632][52662] DAMAGECOUNT value on done: 345946.0 [2024-08-06 02:44:07,632][52662] Sum rewards: 73.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.715', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.224', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:07,725][52668] DAMAGECOUNT value on done: 337851.0 [2024-08-06 02:44:07,727][52668] Sum rewards: 69.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.124', 'AMMO3': '0.171', 'weapon4': '0.234', 'AMMO4': '0.249', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 330604544. Throughput: 0: 4382.0. Samples: 82656470. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:44:07,794][52567] Avg episode reward: [(0, '67.707')] [2024-08-06 02:44:07,840][52647] DAMAGECOUNT value on done: 349130.0 [2024-08-06 02:44:07,840][52647] Sum rewards: 77.657, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.809', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '63.000'} [2024-08-06 02:44:08,285][52667] DAMAGECOUNT value on done: 338652.0 [2024-08-06 02:44:08,294][52667] Sum rewards: 78.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.932', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.132', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '66.000'} [2024-08-06 02:44:08,450][52665] DAMAGECOUNT value on done: 328498.0 [2024-08-06 02:44:08,451][52665] Sum rewards: 49.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.606', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.229', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.976', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '43.000'} [2024-08-06 02:44:08,922][52649] DAMAGECOUNT value on done: 329257.0 [2024-08-06 02:44:08,922][52649] Sum rewards: 56.198, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.988', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.326', 'weapon2': '0.568', 'WEAPON3': '1.900', 'weapon3': '2.978', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '50.000'} [2024-08-06 02:44:09,021][52650] Updated weights for policy 0, policy_version 40361 (0.0026) [2024-08-06 02:44:10,141][52668] DAMAGECOUNT value on done: 336493.0 [2024-08-06 02:44:10,143][52668] Sum rewards: 74.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.156', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.096', 'weapon4': '0.140', 'AMMO4': '0.190', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:10,497][52669] DAMAGECOUNT value on done: 329617.0 [2024-08-06 02:44:10,498][52669] Sum rewards: 65.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.723', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.266', 'WEAPON3': '0.950', 'HITCOUNT': '3.070', 'weapon3': '3.490', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:10,614][52662] DAMAGECOUNT value on done: 331111.0 [2024-08-06 02:44:10,617][52662] Sum rewards: 63.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.475', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.114', 'AMMO4': '0.127', 'AMMO3': '0.137', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '0.900', 'HITCOUNT': '2.740', 'weapon3': '2.916', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:11,171][52667] DAMAGECOUNT value on done: 342018.0 [2024-08-06 02:44:11,171][52667] Sum rewards: 51.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.926', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.154', 'weapon5': '0.262', 'AMMO4': '0.283', 'AMMO3': '0.293', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.774', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '46.000'} [2024-08-06 02:44:11,483][52660] DAMAGECOUNT value on done: 329334.0 [2024-08-06 02:44:11,484][52660] Sum rewards: 78.442, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.129', 'weapon5': '0.140', 'weapon2': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.570', 'WEAPON3': '0.850', 'weapon3': '2.856', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:11,620][52665] DAMAGECOUNT value on done: 330043.0 [2024-08-06 02:44:11,620][52665] Sum rewards: 75.403, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.518', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.228', 'weapon2': '0.422', 'WEAPON3': '1.500', 'weapon3': '3.416', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '63.000'} [2024-08-06 02:44:12,130][52649] DAMAGECOUNT value on done: 325453.0 [2024-08-06 02:44:12,131][52649] Sum rewards: 80.932, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.278', 'WEAPON3': '1.050', 'weapon3': '3.490', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '65.000'} [2024-08-06 02:44:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 330702848. Throughput: 0: 4380.7. Samples: 82682740. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:44:12,794][52567] Avg episode reward: [(0, '67.992')] [2024-08-06 02:44:12,918][52668] DAMAGECOUNT value on done: 329322.0 [2024-08-06 02:44:12,920][52668] Sum rewards: 65.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.195', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.080', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:13,382][52669] DAMAGECOUNT value on done: 335903.0 [2024-08-06 02:44:13,392][52669] Sum rewards: 45.998, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.056', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.202', 'weapon2': '0.222', 'AMMO4': '0.224', 'AMMO3': '0.306', 'weapon5': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.510', 'weapon3': '2.882', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '41.000'} [2024-08-06 02:44:13,741][52650] Updated weights for policy 0, policy_version 40371 (0.0041) [2024-08-06 02:44:13,757][52662] DAMAGECOUNT value on done: 334653.0 [2024-08-06 02:44:13,758][52662] Sum rewards: 81.719, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.282', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '67.000'} [2024-08-06 02:44:13,963][52667] DAMAGECOUNT value on done: 341393.0 [2024-08-06 02:44:13,964][52667] Sum rewards: 76.261, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.100', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.098', 'weapon4': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.800', 'weapon3': '3.142', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '67.000'} [2024-08-06 02:44:14,151][52660] DAMAGECOUNT value on done: 329347.0 [2024-08-06 02:44:14,152][52660] Sum rewards: 77.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.585', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.254', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.406', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '67.000'} [2024-08-06 02:44:14,556][52665] DAMAGECOUNT value on done: 331444.0 [2024-08-06 02:44:14,557][52665] Sum rewards: 64.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.110', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '54.000'} [2024-08-06 02:44:15,018][52658] Large shaping reward 2.556 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:44:15,161][52649] DAMAGECOUNT value on done: 323826.0 [2024-08-06 02:44:15,161][52649] Sum rewards: 63.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.779', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.199', 'weapon5': '0.202', 'weapon2': '0.236', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:15,545][52668] DAMAGECOUNT value on done: 333362.0 [2024-08-06 02:44:15,545][52668] Sum rewards: 67.491, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.643', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.144', 'AMMO3': '0.152', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.392', 'WEAPON3': '1.000', 'weapon3': '3.106', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:16,326][52669] DAMAGECOUNT value on done: 332035.0 [2024-08-06 02:44:16,328][52669] Sum rewards: 74.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.157', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.134', 'AMMO3': '0.191', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:16,799][52662] DAMAGECOUNT value on done: 337464.0 [2024-08-06 02:44:16,801][52662] Sum rewards: 64.328, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.305', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.066', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.280', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:16,841][52660] DAMAGECOUNT value on done: 338145.0 [2024-08-06 02:44:16,842][52660] Sum rewards: 80.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.729', 'AMMO5': '0.012', 'AMMO2': '0.062', 'weapon5': '0.236', 'AMMO3': '0.242', 'weapon4': '0.244', 'AMMO4': '0.311', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '67.000'} [2024-08-06 02:44:17,058][52667] DAMAGECOUNT value on done: 342308.0 [2024-08-06 02:44:17,058][52667] Sum rewards: 72.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.212', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:17,412][52665] DAMAGECOUNT value on done: 327952.0 [2024-08-06 02:44:17,412][52665] Sum rewards: 72.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.227', 'weapon5': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 330784768. Throughput: 0: 4379.6. Samples: 82695960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:44:17,794][52567] Avg episode reward: [(0, '68.517')] [2024-08-06 02:44:17,854][52649] DAMAGECOUNT value on done: 328012.0 [2024-08-06 02:44:17,856][52649] Sum rewards: 73.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:18,023][52668] DAMAGECOUNT value on done: 334336.0 [2024-08-06 02:44:18,024][52668] Sum rewards: 76.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.066', 'AMMO3': '0.211', 'weapon2': '0.266', 'WEAPON3': '1.350', 'weapon3': '3.532', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:18,568][52650] Updated weights for policy 0, policy_version 40381 (0.0016) [2024-08-06 02:44:19,354][52669] DAMAGECOUNT value on done: 331441.0 [2024-08-06 02:44:19,357][52669] Sum rewards: 74.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'weapon4': '0.202', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.352', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:19,414][52658] DAMAGECOUNT value on done: 333361.0 [2024-08-06 02:44:19,418][52658] Sum rewards: 65.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.108', 'weapon4': '0.120', 'AMMO4': '0.210', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.134', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:19,432][52794] DAMAGECOUNT value on done: 336494.0 [2024-08-06 02:44:19,434][52794] Sum rewards: 64.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.485', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.227', 'weapon5': '0.274', 'AMMO4': '0.307', 'weapon2': '0.358', 'weapon4': '0.402', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.606', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:19,503][52660] DAMAGECOUNT value on done: 337960.0 [2024-08-06 02:44:19,503][52660] Sum rewards: 70.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.136', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.263', 'weapon2': '0.382', 'weapon4': '0.444', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:19,731][52662] DAMAGECOUNT value on done: 342076.0 [2024-08-06 02:44:19,731][52662] Sum rewards: 80.310, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.515', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon2': '0.142', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'weapon3': '3.654', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '71.000'} [2024-08-06 02:44:19,784][52667] DAMAGECOUNT value on done: 332401.0 [2024-08-06 02:44:19,786][52667] Sum rewards: 69.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.120', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:20,362][52665] DAMAGECOUNT value on done: 326250.0 [2024-08-06 02:44:20,362][52665] Sum rewards: 69.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon2': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon4': '0.280', 'WEAPON3': '1.650', 'weapon3': '3.230', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:20,476][52811] DAMAGECOUNT value on done: 323183.0 [2024-08-06 02:44:20,477][52811] Sum rewards: 73.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.505', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.197', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '3.196', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:20,710][52668] DAMAGECOUNT value on done: 337734.0 [2024-08-06 02:44:20,710][52668] Sum rewards: 58.072, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.217', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.090', 'weapon2': '0.176', 'AMMO3': '0.227', 'weapon5': '0.238', 'AMMO4': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.540', 'weapon3': '3.210', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '49.000'} [2024-08-06 02:44:20,917][52649] DAMAGECOUNT value on done: 328657.0 [2024-08-06 02:44:20,918][52649] Sum rewards: 76.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.364', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.172', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'weapon4': '0.364', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:22,124][52660] DAMAGECOUNT value on done: 332369.0 [2024-08-06 02:44:22,126][52660] Sum rewards: 51.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.175', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.406', 'ARMOR': '0.442', 'WEAPON4': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '41.500'} [2024-08-06 02:44:22,336][52794] DAMAGECOUNT value on done: 340384.0 [2024-08-06 02:44:22,336][52794] Sum rewards: 70.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.885', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'weapon5': '0.024', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.228', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:22,352][52803] DAMAGECOUNT value on done: 312616.0 [2024-08-06 02:44:22,352][52803] Sum rewards: 64.743, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'AMMO3': '0.284', 'weapon2': '0.582', 'WEAPON3': '1.650', 'weapon3': '3.006', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:22,353][52658] DAMAGECOUNT value on done: 334166.0 [2024-08-06 02:44:22,353][52658] Sum rewards: 70.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.205', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.094', 'AMMO3': '0.193', 'weapon5': '0.260', 'AMMO4': '0.277', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:22,411][52669] DAMAGECOUNT value on done: 333150.0 [2024-08-06 02:44:22,412][52669] Sum rewards: 51.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.926', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.153', 'AMMO3': '0.210', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.068', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '44.000'} [2024-08-06 02:44:22,602][52662] DAMAGECOUNT value on done: 334254.0 [2024-08-06 02:44:22,603][52662] Sum rewards: 71.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.336', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:22,736][52667] DAMAGECOUNT value on done: 339271.0 [2024-08-06 02:44:22,736][52667] Sum rewards: 65.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.235', 'weapon2': '0.298', 'WEAPON3': '1.400', 'HITCOUNT': '3.420', 'weapon3': '3.468', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:22,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 330874880. Throughput: 0: 4380.9. Samples: 82722170. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:44:22,795][52567] Avg episode reward: [(0, '68.653')] [2024-08-06 02:44:23,352][52668] DAMAGECOUNT value on done: 331626.0 [2024-08-06 02:44:23,356][52668] Sum rewards: 64.905, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.090', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.150', 'AMMO4': '0.199', 'weapon2': '0.250', 'weapon4': '0.298', 'AMMO3': '0.333', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.950', 'weapon3': '2.962', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:23,380][52650] Updated weights for policy 0, policy_version 40391 (0.0018) [2024-08-06 02:44:23,517][52811] DAMAGECOUNT value on done: 308038.0 [2024-08-06 02:44:23,518][52811] Sum rewards: 73.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.580', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.258', 'weapon2': '0.408', 'WEAPON3': '1.650', 'HITCOUNT': '3.420', 'weapon3': '3.422', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '64.000'} [2024-08-06 02:44:23,523][52665] DAMAGECOUNT value on done: 327087.0 [2024-08-06 02:44:23,524][52665] Sum rewards: 80.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.754', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.184', 'weapon4': '0.226', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '65.000'} [2024-08-06 02:44:24,232][52649] DAMAGECOUNT value on done: 330016.0 [2024-08-06 02:44:24,234][52649] Sum rewards: 72.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO4': '0.171', 'weapon5': '0.178', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '3.066', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '58.500'} [2024-08-06 02:44:24,824][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:44:24,947][52660] DAMAGECOUNT value on done: 329551.0 [2024-08-06 02:44:24,949][52660] Sum rewards: 80.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.017', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.154', 'AMMO3': '0.200', 'AMMO4': '0.205', 'weapon2': '0.282', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '66.000'} [2024-08-06 02:44:25,182][52658] DAMAGECOUNT value on done: 339647.0 [2024-08-06 02:44:25,183][52658] Sum rewards: 70.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.094', 'weapon4': '0.184', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:25,226][52669] DAMAGECOUNT value on done: 335293.0 [2024-08-06 02:44:25,226][52669] Sum rewards: 72.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.142', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO3': '0.189', 'weapon2': '0.246', 'WEAPON3': '1.150', 'HITCOUNT': '3.410', 'weapon3': '3.440', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:25,465][52794] DAMAGECOUNT value on done: 334389.0 [2024-08-06 02:44:25,467][52794] Sum rewards: 66.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.697', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.136', 'weapon2': '0.230', 'AMMO3': '0.235', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.454', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:25,499][52803] DAMAGECOUNT value on done: 310478.0 [2024-08-06 02:44:25,501][52803] Sum rewards: 72.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.040', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:25,609][52665] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:44:25,623][52795] DAMAGECOUNT value on done: 310997.0 [2024-08-06 02:44:25,625][52795] Sum rewards: 67.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO3': '0.179', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.444', 'weapon4': '0.534', 'WEAPON3': '1.050', 'weapon3': '2.660', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '54.000'} [2024-08-06 02:44:25,791][52662] DAMAGECOUNT value on done: 346322.0 [2024-08-06 02:44:25,793][52662] Sum rewards: 70.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.882', 'AMMO5': '0.015', 'weapon4': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO4': '0.197', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.144', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '55.000'} [2024-08-06 02:44:26,381][52665] DAMAGECOUNT value on done: 330286.0 [2024-08-06 02:44:26,382][52665] Sum rewards: 74.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.170', 'weapon2': '0.380', 'WEAPON3': '1.050', 'weapon3': '3.236', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:26,529][52668] DAMAGECOUNT value on done: 325493.0 [2024-08-06 02:44:26,529][52668] Sum rewards: 68.264, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.782', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon2': '0.242', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.538', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:26,617][52811] DAMAGECOUNT value on done: 313327.0 [2024-08-06 02:44:26,620][52811] Sum rewards: 64.843, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.160', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO4': '0.186', 'weapon2': '0.232', 'AMMO3': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.204', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:27,026][52649] DAMAGECOUNT value on done: 330486.0 [2024-08-06 02:44:27,026][52649] Sum rewards: 58.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.104', 'weapon2': '0.164', 'AMMO4': '0.196', 'AMMO3': '0.226', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.242', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '49.000'} [2024-08-06 02:44:27,418][52650] Updated weights for policy 0, policy_version 40401 (0.0033) [2024-08-06 02:44:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 330964992. Throughput: 0: 4379.8. Samples: 82748420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 02:44:27,794][52567] Avg episode reward: [(0, '68.669')] [2024-08-06 02:44:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040401_330964992.pth... [2024-08-06 02:44:27,854][52658] DAMAGECOUNT value on done: 336834.0 [2024-08-06 02:44:27,854][52794] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:44:27,857][52658] Sum rewards: 77.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.549', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon4': '0.080', 'WEAPON5': '0.100', 'weapon2': '0.222', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.426', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '66.000'} [2024-08-06 02:44:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000039887_326754304.pth [2024-08-06 02:44:28,115][52660] DAMAGECOUNT value on done: 335147.0 [2024-08-06 02:44:28,117][52660] Sum rewards: 71.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.095', 'weapon5': '0.138', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:28,305][52669] DAMAGECOUNT value on done: 334551.0 [2024-08-06 02:44:28,305][52669] Sum rewards: 69.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.632', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.142', 'AMMO4': '0.210', 'AMMO3': '0.219', 'weapon4': '0.282', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:28,371][52794] DAMAGECOUNT value on done: 333648.0 [2024-08-06 02:44:28,374][52794] Sum rewards: 53.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.209', 'AMMO4': '0.253', 'weapon5': '0.278', 'weapon2': '0.286', 'weapon4': '0.326', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '2.710', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '47.000'} [2024-08-06 02:44:28,620][52803] DAMAGECOUNT value on done: 312694.0 [2024-08-06 02:44:28,621][52803] Sum rewards: 63.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO4': '0.165', 'weapon4': '0.234', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.320', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:28,744][52662] DAMAGECOUNT value on done: 338495.0 [2024-08-06 02:44:28,744][52662] Sum rewards: 60.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.354', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.212', 'weapon4': '0.240', 'AMMO4': '0.316', 'weapon5': '0.358', 'weapon2': '0.430', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.600', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:28,747][52795] DAMAGECOUNT value on done: 304127.0 [2024-08-06 02:44:28,750][52795] Sum rewards: 68.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.505', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.154', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '2.952', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.500'} [2024-08-06 02:44:29,052][52665] DAMAGECOUNT value on done: 331444.0 [2024-08-06 02:44:29,054][52665] Sum rewards: 72.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.094', 'weapon5': '0.124', 'AMMO4': '0.133', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:29,704][52668] DAMAGECOUNT value on done: 325222.0 [2024-08-06 02:44:29,706][52668] Sum rewards: 67.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.378', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:29,736][52811] DAMAGECOUNT value on done: 310880.0 [2024-08-06 02:44:29,737][52811] Sum rewards: 72.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.104', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.132', 'AMMO4': '0.195', 'weapon5': '0.202', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:29,790][52649] DAMAGECOUNT value on done: 320513.0 [2024-08-06 02:44:29,791][52649] Sum rewards: 83.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.665', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.184', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.440', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '67.000'} [2024-08-06 02:44:31,081][52658] DAMAGECOUNT value on done: 332144.0 [2024-08-06 02:44:31,081][52658] Sum rewards: 55.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.221', 'weapon5': '0.260', 'AMMO4': '0.300', 'weapon2': '0.426', 'WEAPON5': '0.500', 'weapon4': '0.546', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.472', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '47.000'} [2024-08-06 02:44:31,088][52660] DAMAGECOUNT value on done: 341748.0 [2024-08-06 02:44:31,090][52660] Sum rewards: 77.740, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.808', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'AMMO4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:31,341][52794] DAMAGECOUNT value on done: 332620.0 [2024-08-06 02:44:31,343][52794] Sum rewards: 67.133, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.205', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.072', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.246', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:31,362][52669] DAMAGECOUNT value on done: 335680.0 [2024-08-06 02:44:31,362][52669] Sum rewards: 73.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.848', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.138', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:31,692][52662] DAMAGECOUNT value on done: 338132.0 [2024-08-06 02:44:31,696][52662] Sum rewards: 67.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.798', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.068', 'weapon5': '0.140', 'AMMO3': '0.244', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:31,850][52803] DAMAGECOUNT value on done: 315644.0 [2024-08-06 02:44:31,850][52803] Sum rewards: 76.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.318', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '64.000'} [2024-08-06 02:44:31,904][52795] DAMAGECOUNT value on done: 305169.0 [2024-08-06 02:44:31,905][52795] Sum rewards: 58.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.278', 'weapon4': '0.324', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.062', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:32,304][52668] DAMAGECOUNT value on done: 325429.0 [2024-08-06 02:44:32,304][52668] Sum rewards: 76.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.621', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:32,567][52670] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:44:32,725][52650] Updated weights for policy 0, policy_version 40411 (0.0040) [2024-08-06 02:44:32,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 331046912. Throughput: 0: 4369.6. Samples: 82761020. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:44:32,795][52567] Avg episode reward: [(0, '68.655')] [2024-08-06 02:44:32,991][52649] DAMAGECOUNT value on done: 326736.0 [2024-08-06 02:44:32,991][52649] Sum rewards: 69.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.187', 'weapon4': '0.354', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:33,046][52811] DAMAGECOUNT value on done: 314500.0 [2024-08-06 02:44:33,049][52811] Sum rewards: 60.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.144', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '51.500'} [2024-08-06 02:44:33,969][52794] DAMAGECOUNT value on done: 336845.0 [2024-08-06 02:44:33,971][52794] Sum rewards: 62.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.508', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.112', 'weapon5': '0.150', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.168', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:34,015][52660] DAMAGECOUNT value on done: 337092.0 [2024-08-06 02:44:34,015][52660] Sum rewards: 67.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.772', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.134', 'weapon2': '0.184', 'AMMO3': '0.198', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '55.000'} [2024-08-06 02:44:34,107][52658] DAMAGECOUNT value on done: 332880.0 [2024-08-06 02:44:34,108][52658] Sum rewards: 69.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.128', 'weapon4': '0.244', 'AMMO3': '0.247', 'AMMO4': '0.253', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:34,162][52662] DAMAGECOUNT value on done: 334764.0 [2024-08-06 02:44:34,162][52662] Sum rewards: 59.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.827', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.202', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '50.000'} [2024-08-06 02:44:34,164][52669] DAMAGECOUNT value on done: 332794.0 [2024-08-06 02:44:34,164][52669] Sum rewards: 72.351, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.847', 'AMMO5': '0.004', 'weapon5': '0.034', 'AMMO2': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'AMMO4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:34,949][52803] DAMAGECOUNT value on done: 315418.0 [2024-08-06 02:44:34,951][52803] Sum rewards: 75.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.381', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'weapon5': '0.138', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '63.000'} [2024-08-06 02:44:34,985][52795] DAMAGECOUNT value on done: 308469.0 [2024-08-06 02:44:34,986][52795] Sum rewards: 64.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.222', 'AMMO3': '0.253', 'weapon2': '0.290', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:35,639][52668] DAMAGECOUNT value on done: 329805.0 [2024-08-06 02:44:35,641][52668] Sum rewards: 62.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.288', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:35,775][52649] DAMAGECOUNT value on done: 324390.0 [2024-08-06 02:44:35,783][52649] Sum rewards: 67.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:35,821][52614] Signal inference workers to stop experience collection... (7300 times) [2024-08-06 02:44:35,821][52614] Signal inference workers to resume experience collection... (7300 times) [2024-08-06 02:44:35,871][52650] InferenceWorker_p0-w0: stopping experience collection (7300 times) [2024-08-06 02:44:35,871][52650] InferenceWorker_p0-w0: resuming experience collection (7300 times) [2024-08-06 02:44:36,107][52811] DAMAGECOUNT value on done: 317757.0 [2024-08-06 02:44:36,107][52811] Sum rewards: 73.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.653', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:36,665][52669] DAMAGECOUNT value on done: 338989.0 [2024-08-06 02:44:36,666][52669] Sum rewards: 88.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.045', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon4': '0.478', 'WEAPON3': '1.600', 'weapon3': '2.984', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '76.000'} [2024-08-06 02:44:36,921][52794] DAMAGECOUNT value on done: 342156.0 [2024-08-06 02:44:36,921][52794] Sum rewards: 77.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.334', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '64.000'} [2024-08-06 02:44:37,009][52658] DAMAGECOUNT value on done: 339564.0 [2024-08-06 02:44:37,011][52658] Sum rewards: 65.663, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.120', 'AMMO5': '0.027', 'AMMO2': '0.044', 'weapon4': '0.134', 'AMMO4': '0.218', 'weapon5': '0.282', 'AMMO3': '0.292', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.800', 'weapon3': '2.898', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '57.500'} [2024-08-06 02:44:37,069][52660] DAMAGECOUNT value on done: 330110.0 [2024-08-06 02:44:37,070][52660] Sum rewards: 77.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.503', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.092', 'AMMO4': '0.141', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.000', 'weapon3': '3.326', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '63.000'} [2024-08-06 02:44:37,164][52662] DAMAGECOUNT value on done: 330135.0 [2024-08-06 02:44:37,166][52662] Sum rewards: 64.884, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.424', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.350', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '55.000'} [2024-08-06 02:44:37,471][52650] Updated weights for policy 0, policy_version 40421 (0.0012) [2024-08-06 02:44:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 331128832. Throughput: 0: 4371.6. Samples: 82787270. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:44:37,794][52567] Avg episode reward: [(0, '69.133')] [2024-08-06 02:44:38,027][52795] DAMAGECOUNT value on done: 310355.0 [2024-08-06 02:44:38,027][52795] Sum rewards: 65.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.845', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.050', 'weapon4': '0.184', 'AMMO4': '0.190', 'AMMO3': '0.206', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.344', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:38,043][52671] DAMAGECOUNT value on done: 339844.0 [2024-08-06 02:44:38,046][52671] Sum rewards: 72.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.172', 'weapon5': '0.180', 'weapon4': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:38,066][52803] DAMAGECOUNT value on done: 309603.0 [2024-08-06 02:44:38,067][52803] Sum rewards: 79.466, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.066', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.146', 'AMMO4': '0.233', 'weapon5': '0.240', 'weapon4': '0.336', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.746', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:38,670][52649] DAMAGECOUNT value on done: 328457.0 [2024-08-06 02:44:38,671][52649] Sum rewards: 57.005, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.106', 'weapon4': '0.154', 'AMMO3': '0.159', 'AMMO4': '0.199', 'weapon2': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'HEALTH': '0.364', 'WEAPON3': '0.900', 'HITCOUNT': '2.800', 'weapon3': '3.328', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '47.000'} [2024-08-06 02:44:39,029][52668] DAMAGECOUNT value on done: 333596.0 [2024-08-06 02:44:39,031][52668] Sum rewards: 74.823, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.720', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.136', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.396', 'weapon2': '0.664', 'WEAPON3': '1.000', 'weapon3': '2.658', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:39,255][52811] DAMAGECOUNT value on done: 312548.0 [2024-08-06 02:44:39,256][52811] Sum rewards: 60.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.208', 'weapon4': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.032', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:39,549][52669] DAMAGECOUNT value on done: 333938.0 [2024-08-06 02:44:39,551][52669] Sum rewards: 73.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.354', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'WEAPON4': '0.450', 'weapon4': '0.452', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.460', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:39,591][52794] DAMAGECOUNT value on done: 335394.0 [2024-08-06 02:44:39,595][52794] Sum rewards: 68.307, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.650', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.111', 'weapon4': '0.114', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '54.000'} [2024-08-06 02:44:39,927][52658] DAMAGECOUNT value on done: 327914.0 [2024-08-06 02:44:39,928][52658] Sum rewards: 70.064, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:40,591][52660] DAMAGECOUNT value on done: 340945.0 [2024-08-06 02:44:40,591][52660] Sum rewards: 55.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO3': '0.185', 'AMMO4': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON4': '0.450', 'weapon2': '0.672', 'WEAPON3': '1.200', 'weapon3': '2.482', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '47.000'} [2024-08-06 02:44:41,109][52795] DAMAGECOUNT value on done: 309334.0 [2024-08-06 02:44:41,111][52795] Sum rewards: 74.867, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.922', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.318', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.500'} [2024-08-06 02:44:41,142][52671] DAMAGECOUNT value on done: 336506.0 [2024-08-06 02:44:41,144][52671] Sum rewards: 72.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.245', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '59.500'} [2024-08-06 02:44:41,239][52803] DAMAGECOUNT value on done: 308469.0 [2024-08-06 02:44:41,239][52803] Sum rewards: 66.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO4': '0.224', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:41,471][52649] DAMAGECOUNT value on done: 332475.0 [2024-08-06 02:44:41,472][52649] Sum rewards: 70.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.140', 'weapon2': '0.170', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:41,873][52650] Updated weights for policy 0, policy_version 40431 (0.0023) [2024-08-06 02:44:42,198][52669] DAMAGECOUNT value on done: 333271.0 [2024-08-06 02:44:42,199][52669] Sum rewards: 71.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.283', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon5': '0.132', 'AMMO4': '0.176', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:42,203][52668] DAMAGECOUNT value on done: 335405.0 [2024-08-06 02:44:42,203][52668] Sum rewards: 67.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.754', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.140', 'AMMO3': '0.168', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.724', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:42,268][52658] DAMAGECOUNT value on done: 343934.0 [2024-08-06 02:44:42,268][52658] Sum rewards: 65.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.546', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon4': '0.180', 'weapon5': '0.218', 'AMMO3': '0.232', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '54.000'} [2024-08-06 02:44:42,404][52811] DAMAGECOUNT value on done: 312926.0 [2024-08-06 02:44:42,404][52811] Sum rewards: 66.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon4': '0.344', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 331218944. Throughput: 0: 4373.3. Samples: 82813580. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:44:42,794][52567] Avg episode reward: [(0, '69.191')] [2024-08-06 02:44:42,904][52794] DAMAGECOUNT value on done: 340657.0 [2024-08-06 02:44:42,906][52794] Sum rewards: 64.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.142', 'AMMO3': '0.196', 'AMMO4': '0.261', 'weapon4': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:43,568][52660] DAMAGECOUNT value on done: 327444.0 [2024-08-06 02:44:43,569][52660] Sum rewards: 68.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.148', 'AMMO3': '0.220', 'weapon5': '0.260', 'AMMO4': '0.281', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:44,160][52671] DAMAGECOUNT value on done: 337227.0 [2024-08-06 02:44:44,162][52671] Sum rewards: 61.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.382', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.175', 'AMMO3': '0.207', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '50.000'} [2024-08-06 02:44:44,206][52649] DAMAGECOUNT value on done: 331392.0 [2024-08-06 02:44:44,207][52649] Sum rewards: 69.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.329', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon4': '0.294', 'weapon2': '0.430', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:44,318][52795] DAMAGECOUNT value on done: 315009.0 [2024-08-06 02:44:44,318][52795] Sum rewards: 60.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.761', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.248', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '50.000'} [2024-08-06 02:44:44,353][52803] DAMAGECOUNT value on done: 308110.0 [2024-08-06 02:44:44,354][52803] Sum rewards: 70.730, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.490', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'weapon4': '0.350', 'weapon2': '0.450', 'WEAPON3': '0.850', 'weapon3': '3.020', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:45,006][52658] DAMAGECOUNT value on done: 337338.0 [2024-08-06 02:44:45,006][52658] Sum rewards: 70.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.853', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon7': '0.110', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.178', 'WEAPON7': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.312', 'weapon2': '0.364', 'ARMOR': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:45,042][52668] DAMAGECOUNT value on done: 336976.0 [2024-08-06 02:44:45,044][52668] Sum rewards: 72.907, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.368', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.118', 'AMMO4': '0.199', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:45,109][52669] DAMAGECOUNT value on done: 336642.0 [2024-08-06 02:44:45,109][52669] Sum rewards: 70.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.708', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.076', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:45,494][52811] DAMAGECOUNT value on done: 321271.0 [2024-08-06 02:44:45,494][52811] Sum rewards: 54.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.208', 'AMMO3': '0.253', 'weapon2': '0.254', 'AMMO4': '0.278', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.776', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '48.000'} [2024-08-06 02:44:45,713][52794] DAMAGECOUNT value on done: 337659.0 [2024-08-06 02:44:45,714][52794] Sum rewards: 56.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.426', 'AMMO5': '0.005', 'weapon5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.223', 'WEAPON4': '0.400', 'weapon4': '0.402', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '48.000'} [2024-08-06 02:44:46,177][52660] DAMAGECOUNT value on done: 329619.0 [2024-08-06 02:44:46,178][52660] Sum rewards: 76.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.962', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.054', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '61.000'} [2024-08-06 02:44:46,739][52650] Updated weights for policy 0, policy_version 40441 (0.0023) [2024-08-06 02:44:47,301][52671] DAMAGECOUNT value on done: 335985.0 [2024-08-06 02:44:47,301][52671] Sum rewards: 66.224, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.020', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.130', 'AMMO3': '0.155', 'AMMO4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.364', 'weapon2': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.664', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:47,410][52803] DAMAGECOUNT value on done: 314016.0 [2024-08-06 02:44:47,414][52803] Sum rewards: 59.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.264', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '50.000'} [2024-08-06 02:44:47,688][52795] DAMAGECOUNT value on done: 311938.0 [2024-08-06 02:44:47,688][52795] Sum rewards: 63.234, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.680', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.366', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:47,741][52668] DAMAGECOUNT value on done: 333341.0 [2024-08-06 02:44:47,742][52668] Sum rewards: 77.346, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.186', 'weapon2': '0.194', 'AMMO4': '0.202', 'weapon5': '0.224', 'HEALTH': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 331309056. Throughput: 0: 4375.1. Samples: 82826790. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:44:47,794][52567] Avg episode reward: [(0, '68.399')] [2024-08-06 02:44:47,899][52658] DAMAGECOUNT value on done: 343251.0 [2024-08-06 02:44:47,899][52658] Sum rewards: 45.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.355', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.128', 'AMMO4': '0.218', 'AMMO3': '0.273', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.550', 'weapon3': '2.994', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '42.500'} [2024-08-06 02:44:48,287][52669] DAMAGECOUNT value on done: 341165.0 [2024-08-06 02:44:48,288][52669] Sum rewards: 78.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.444', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.229', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '66.000'} [2024-08-06 02:44:48,569][52811] DAMAGECOUNT value on done: 312427.0 [2024-08-06 02:44:48,572][52811] Sum rewards: 73.394, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.086', 'weapon4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.272', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.286', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '66.000'} [2024-08-06 02:44:48,632][52794] DAMAGECOUNT value on done: 333482.0 [2024-08-06 02:44:48,634][52794] Sum rewards: 68.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.666', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.140', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:49,303][52660] DAMAGECOUNT value on done: 340514.0 [2024-08-06 02:44:49,304][52660] Sum rewards: 73.145, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '63.000'} [2024-08-06 02:44:50,211][52671] DAMAGECOUNT value on done: 343504.0 [2024-08-06 02:44:50,212][52671] Sum rewards: 73.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.336', 'AMMO5': '0.020', 'AMMO2': '0.069', 'AMMO3': '0.252', 'weapon5': '0.262', 'weapon2': '0.298', 'AMMO4': '0.345', 'weapon4': '0.436', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.646', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:50,607][52803] DAMAGECOUNT value on done: 308638.0 [2024-08-06 02:44:50,607][52803] Sum rewards: 70.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.587', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'weapon4': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.344', 'WEAPON3': '1.700', 'weapon3': '3.238', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:50,907][52795] DAMAGECOUNT value on done: 299995.0 [2024-08-06 02:44:50,907][52795] Sum rewards: 58.151, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.037', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.144', 'weapon5': '0.176', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.322', 'AMMO3': '0.354', 'WEAPON3': '2.000', 'weapon3': '3.002', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:51,078][52658] DAMAGECOUNT value on done: 329011.0 [2024-08-06 02:44:51,081][52658] Sum rewards: 60.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.628', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon5': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '2.906', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:51,230][52669] DAMAGECOUNT value on done: 351250.0 [2024-08-06 02:44:51,238][52669] Sum rewards: 70.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.018', 'AMMO2': '0.058', 'AMMO3': '0.224', 'weapon2': '0.228', 'weapon5': '0.274', 'AMMO4': '0.291', 'weapon4': '0.466', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:51,479][52650] Updated weights for policy 0, policy_version 40451 (0.0013) [2024-08-06 02:44:51,611][52811] DAMAGECOUNT value on done: 313794.0 [2024-08-06 02:44:51,612][52811] Sum rewards: 63.454, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.560', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.170', 'weapon2': '0.180', 'AMMO3': '0.303', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.326', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '57.000'} [2024-08-06 02:44:51,716][52794] DAMAGECOUNT value on done: 338054.0 [2024-08-06 02:44:51,717][52794] Sum rewards: 68.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.535', 'AMMO5': '0.017', 'AMMO2': '0.074', 'weapon5': '0.232', 'AMMO3': '0.237', 'weapon4': '0.264', 'weapon2': '0.354', 'AMMO4': '0.369', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:52,360][52660] DAMAGECOUNT value on done: 341859.0 [2024-08-06 02:44:52,360][52660] Sum rewards: 61.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.024', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon5': '0.148', 'AMMO3': '0.198', 'weapon2': '0.672', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.038', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 331399168. Throughput: 0: 4366.0. Samples: 82852940. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:44:52,794][52567] Avg episode reward: [(0, '68.476')] [2024-08-06 02:44:53,021][52671] DAMAGECOUNT value on done: 333151.0 [2024-08-06 02:44:53,022][52671] Sum rewards: 61.478, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.166', 'AMMO4': '0.212', 'AMMO3': '0.244', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '54.500'} [2024-08-06 02:44:53,668][52803] DAMAGECOUNT value on done: 316229.0 [2024-08-06 02:44:53,672][52803] Sum rewards: 58.535, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.022', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO4': '0.237', 'weapon4': '0.240', 'AMMO3': '0.258', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.036', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '52.000'} [2024-08-06 02:44:53,736][52669] DAMAGECOUNT value on done: 335927.0 [2024-08-06 02:44:53,738][52669] Sum rewards: 59.630, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.148', 'weapon2': '0.496', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '3.372', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '49.000'} [2024-08-06 02:44:54,020][52795] DAMAGECOUNT value on done: 316195.0 [2024-08-06 02:44:54,021][52795] Sum rewards: 71.819, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.512', 'AMMO5': '0.025', 'AMMO2': '0.070', 'weapon4': '0.150', 'AMMO3': '0.245', 'AMMO4': '0.350', 'weapon5': '0.358', 'weapon2': '0.418', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.710', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '60.000'} [2024-08-06 02:44:54,077][52658] DAMAGECOUNT value on done: 337519.0 [2024-08-06 02:44:54,080][52658] Sum rewards: 67.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.225', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.148', 'AMMO4': '0.155', 'weapon5': '0.204', 'AMMO3': '0.234', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:54,751][52811] DAMAGECOUNT value on done: 319479.0 [2024-08-06 02:44:54,753][52811] Sum rewards: 74.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.725', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.242', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.526', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '62.000'} [2024-08-06 02:44:55,108][52794] DAMAGECOUNT value on done: 327983.0 [2024-08-06 02:44:55,109][52794] Sum rewards: 56.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.232', 'weapon4': '0.394', 'weapon2': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.666', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '48.500'} [2024-08-06 02:44:55,481][52660] DAMAGECOUNT value on done: 329818.0 [2024-08-06 02:44:55,482][52660] Sum rewards: 65.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.776', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.046', 'weapon2': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.248', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '56.000'} [2024-08-06 02:44:55,700][52671] DAMAGECOUNT value on done: 339324.0 [2024-08-06 02:44:55,701][52671] Sum rewards: 68.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.070', 'weapon4': '0.146', 'weapon2': '0.192', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.386', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:56,003][52650] Updated weights for policy 0, policy_version 40461 (0.0031) [2024-08-06 02:44:56,461][52669] DAMAGECOUNT value on done: 338788.0 [2024-08-06 02:44:56,471][52669] Sum rewards: 71.958, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.148', 'AMMO4': '0.164', 'weapon5': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.430', 'HEALTH': '0.835', 'WEAPON3': '0.850', 'weapon3': '2.914', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.500'} [2024-08-06 02:44:56,797][52803] DAMAGECOUNT value on done: 314529.0 [2024-08-06 02:44:56,800][52803] Sum rewards: 62.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.926', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.234', 'weapon4': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '53.000'} [2024-08-06 02:44:57,131][52795] DAMAGECOUNT value on done: 307213.0 [2024-08-06 02:44:57,132][52795] Sum rewards: 71.888, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.528', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.162', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.432', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:57,191][52658] DAMAGECOUNT value on done: 334131.0 [2024-08-06 02:44:57,192][52658] Sum rewards: 62.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.682', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.144', 'AMMO3': '0.158', 'AMMO4': '0.265', 'weapon2': '0.272', 'weapon4': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '51.000'} [2024-08-06 02:44:57,705][52794] DAMAGECOUNT value on done: 343579.0 [2024-08-06 02:44:57,706][52794] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.124', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.146', 'weapon4': '0.186', 'AMMO4': '0.195', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '59.000'} [2024-08-06 02:44:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 331481088. Throughput: 0: 4364.7. Samples: 82879150. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:44:57,794][52567] Avg episode reward: [(0, '67.667')] [2024-08-06 02:44:58,026][52811] DAMAGECOUNT value on done: 309871.0 [2024-08-06 02:44:58,026][52811] Sum rewards: 47.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.280', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.214', 'AMMO3': '0.216', 'AMMO4': '0.251', 'weapon4': '0.272', 'WEAPON5': '0.500', 'weapon2': '0.592', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.370', 'weapon3': '2.536', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '42.000'} [2024-08-06 02:44:58,650][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:44:58,716][52660] DAMAGECOUNT value on done: 334046.0 [2024-08-06 02:44:58,716][52660] Sum rewards: 79.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.052', 'weapon4': '0.084', 'AMMO4': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '65.000'} [2024-08-06 02:44:58,851][52671] DAMAGECOUNT value on done: 338406.0 [2024-08-06 02:44:58,852][52671] Sum rewards: 69.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.180', 'AMMO3': '0.196', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '58.000'} [2024-08-06 02:44:59,529][52669] DAMAGECOUNT value on done: 337959.0 [2024-08-06 02:44:59,532][52669] Sum rewards: 76.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.602', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.255', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '65.000'} [2024-08-06 02:44:59,749][52803] DAMAGECOUNT value on done: 310168.0 [2024-08-06 02:44:59,749][52803] Sum rewards: 63.008, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.238', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.102', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '54.000'} [2024-08-06 02:44:59,999][52658] DAMAGECOUNT value on done: 331159.0 [2024-08-06 02:45:00,001][52658] Sum rewards: 63.686, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.084', 'HEALTH': '0.094', 'AMMO3': '0.158', 'weapon5': '0.190', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.790', 'WEAPON3': '0.900', 'weapon3': '2.676', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '50.000'} [2024-08-06 02:45:00,304][52795] DAMAGECOUNT value on done: 307322.0 [2024-08-06 02:45:00,309][52795] Sum rewards: 64.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.322', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.180', 'AMMO4': '0.201', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.550', 'weapon4': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.552', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '55.000'} [2024-08-06 02:45:00,409][52794] DAMAGECOUNT value on done: 330515.0 [2024-08-06 02:45:00,411][52794] Sum rewards: 53.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '44.000'} [2024-08-06 02:45:00,735][52650] Updated weights for policy 0, policy_version 40471 (0.0011) [2024-08-06 02:45:01,103][52811] DAMAGECOUNT value on done: 315792.0 [2024-08-06 02:45:01,103][52811] Sum rewards: 73.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.210', 'AMMO3': '0.224', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '64.000'} [2024-08-06 02:45:01,662][52671] DAMAGECOUNT value on done: 332307.0 [2024-08-06 02:45:01,663][52671] Sum rewards: 79.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.312', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO4': '0.196', 'AMMO3': '0.206', 'weapon2': '0.286', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '67.000'} [2024-08-06 02:45:01,673][52660] DAMAGECOUNT value on done: 328172.0 [2024-08-06 02:45:01,674][52660] Sum rewards: 65.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.530', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.275', 'weapon2': '0.298', 'WEAPON3': '1.700', 'HITCOUNT': '3.440', 'weapon3': '3.480', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:02,639][52669] DAMAGECOUNT value on done: 340686.0 [2024-08-06 02:45:02,642][52669] Sum rewards: 71.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.332', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 331571200. Throughput: 0: 4363.3. Samples: 82892310. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:45:02,794][52567] Avg episode reward: [(0, '67.790')] [2024-08-06 02:45:02,879][52803] DAMAGECOUNT value on done: 315721.0 [2024-08-06 02:45:02,879][52803] Sum rewards: 57.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'AMMO5': '0.008', 'weapon5': '0.036', 'AMMO2': '0.048', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'weapon2': '0.374', 'weapon4': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '50.000'} [2024-08-06 02:45:02,982][52658] DAMAGECOUNT value on done: 329337.0 [2024-08-06 02:45:02,984][52658] Sum rewards: 75.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.176', 'AMMO4': '0.184', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '63.000'} [2024-08-06 02:45:03,093][52794] DAMAGECOUNT value on done: 344883.0 [2024-08-06 02:45:03,095][52794] Sum rewards: 49.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.955', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.140', 'AMMO3': '0.191', 'AMMO4': '0.264', 'weapon2': '0.338', 'WEAPON5': '0.400', 'weapon4': '0.520', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.506', 'FRAGCOUNT': '44.000'} [2024-08-06 02:45:03,431][52795] DAMAGECOUNT value on done: 304783.0 [2024-08-06 02:45:03,435][52795] Sum rewards: 78.846, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.293', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '63.000'} [2024-08-06 02:45:04,141][52660] DAMAGECOUNT value on done: 336405.0 [2024-08-06 02:45:04,143][52660] Sum rewards: 59.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.136', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '49.000'} [2024-08-06 02:45:04,234][52811] DAMAGECOUNT value on done: 314209.0 [2024-08-06 02:45:04,234][52811] Sum rewards: 60.088, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.124', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.276', 'weapon2': '0.308', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.316', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '54.000'} [2024-08-06 02:45:04,445][52671] DAMAGECOUNT value on done: 338037.0 [2024-08-06 02:45:04,446][52671] Sum rewards: 65.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.422', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.232', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.456', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:05,305][52650] Updated weights for policy 0, policy_version 40481 (0.0032) [2024-08-06 02:45:05,727][52658] DAMAGECOUNT value on done: 342351.0 [2024-08-06 02:45:05,727][52658] Sum rewards: 67.724, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.196', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.070', 'weapon4': '0.074', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.358', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:05,866][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:45:05,959][52803] DAMAGECOUNT value on done: 309909.0 [2024-08-06 02:45:05,960][52803] Sum rewards: 71.006, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.934', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.156', 'weapon5': '0.238', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.000', 'weapon3': '2.658', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:05,965][52794] DAMAGECOUNT value on done: 338095.0 [2024-08-06 02:45:05,966][52794] Sum rewards: 75.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.330', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.149', 'weapon5': '0.182', 'weapon2': '0.186', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.190', 'weapon3': '3.242', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '65.000'} [2024-08-06 02:45:06,520][52795] DAMAGECOUNT value on done: 312303.0 [2024-08-06 02:45:06,521][52795] Sum rewards: 64.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.475', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.310', 'WEAPON3': '1.550', 'HITCOUNT': '3.290', 'weapon3': '3.300', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:06,579][52660] DAMAGECOUNT value on done: 330744.0 [2024-08-06 02:45:06,579][52660] Sum rewards: 70.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.088', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.216', 'AMMO3': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.328', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '60.000'} [2024-08-06 02:45:07,175][52811] DAMAGECOUNT value on done: 311046.0 [2024-08-06 02:45:07,177][52811] Sum rewards: 70.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.884', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon4': '0.200', 'AMMO3': '0.243', 'weapon5': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.648', 'WEAPON3': '1.400', 'weapon3': '2.608', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 02:45:07,262][52671] DAMAGECOUNT value on done: 342187.0 [2024-08-06 02:45:07,263][52671] Sum rewards: 66.276, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.444', 'AMMO5': '0.008', 'AMMO2': '0.037', 'AMMO3': '0.128', 'weapon5': '0.138', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '3.022', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '51.000'} [2024-08-06 02:45:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 331661312. Throughput: 0: 4368.3. Samples: 82918740. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:45:07,794][52567] Avg episode reward: [(0, '67.430')] [2024-08-06 02:45:08,576][52658] DAMAGECOUNT value on done: 332556.0 [2024-08-06 02:45:08,577][52658] Sum rewards: 50.536, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.455', 'AMMO5': '0.010', 'AMMO2': '0.061', 'weapon5': '0.134', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'AMMO4': '0.303', 'weapon4': '0.320', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.786', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '46.000'} [2024-08-06 02:45:08,726][52794] DAMAGECOUNT value on done: 338454.0 [2024-08-06 02:45:08,727][52794] Sum rewards: 74.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.086', 'weapon4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.237', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 02:45:08,970][52803] DAMAGECOUNT value on done: 309478.0 [2024-08-06 02:45:08,973][52803] Sum rewards: 73.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '62.000'} [2024-08-06 02:45:09,640][52795] DAMAGECOUNT value on done: 303413.0 [2024-08-06 02:45:09,642][52795] Sum rewards: 74.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.445', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO3': '0.212', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '60.500'} [2024-08-06 02:45:09,821][52650] Updated weights for policy 0, policy_version 40491 (0.0012) [2024-08-06 02:45:10,144][52811] DAMAGECOUNT value on done: 313152.0 [2024-08-06 02:45:10,146][52811] Sum rewards: 72.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.780', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.255', 'weapon2': '0.390', 'WEAPON3': '1.600', 'weapon3': '3.382', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '62.000'} [2024-08-06 02:45:10,157][52671] DAMAGECOUNT value on done: 335678.0 [2024-08-06 02:45:10,159][52671] Sum rewards: 58.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.176', 'AMMO3': '0.255', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.500', 'weapon3': '2.604', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '51.000'} [2024-08-06 02:45:10,479][52664] DAMAGECOUNT value on done: 347908.0 [2024-08-06 02:45:10,479][52664] Sum rewards: 72.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.852', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.094', 'weapon4': '0.096', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '61.000'} [2024-08-06 02:45:11,256][52658] DAMAGECOUNT value on done: 337205.0 [2024-08-06 02:45:11,258][52658] Sum rewards: 70.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.735', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '60.000'} [2024-08-06 02:45:11,786][52794] DAMAGECOUNT value on done: 346957.0 [2024-08-06 02:45:11,794][52794] Sum rewards: 71.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.248', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.202', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:12,055][52803] DAMAGECOUNT value on done: 320088.0 [2024-08-06 02:45:12,056][52803] Sum rewards: 63.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.136', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.281', 'WEAPON3': '1.650', 'HITCOUNT': '3.060', 'weapon3': '3.242', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '54.500'} [2024-08-06 02:45:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 331751424. Throughput: 0: 4374.0. Samples: 82945250. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:45:12,794][52567] Avg episode reward: [(0, '67.139')] [2024-08-06 02:45:12,795][52795] DAMAGECOUNT value on done: 318505.0 [2024-08-06 02:45:12,795][52795] Sum rewards: 72.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.358', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.096', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '60.000'} [2024-08-06 02:45:13,236][52811] DAMAGECOUNT value on done: 316036.0 [2024-08-06 02:45:13,237][52811] Sum rewards: 71.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.136', 'AMMO3': '0.199', 'AMMO4': '0.233', 'weapon5': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '58.500'} [2024-08-06 02:45:13,536][52664] DAMAGECOUNT value on done: 350169.0 [2024-08-06 02:45:13,537][52664] Sum rewards: 74.733, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.086', 'AMMO4': '0.137', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '62.000'} [2024-08-06 02:45:13,552][52671] DAMAGECOUNT value on done: 346999.0 [2024-08-06 02:45:13,553][52671] Sum rewards: 69.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:14,416][52658] DAMAGECOUNT value on done: 340605.0 [2024-08-06 02:45:14,416][52658] Sum rewards: 69.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.100', 'weapon4': '0.156', 'AMMO3': '0.193', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:14,718][52650] Updated weights for policy 0, policy_version 40501 (0.0017) [2024-08-06 02:45:14,915][52794] DAMAGECOUNT value on done: 337733.0 [2024-08-06 02:45:14,915][52794] Sum rewards: 74.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.886', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.146', 'weapon4': '0.154', 'AMMO4': '0.180', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '63.000'} [2024-08-06 02:45:15,174][52803] DAMAGECOUNT value on done: 312050.0 [2024-08-06 02:45:15,175][52803] Sum rewards: 53.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.046', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.168', 'weapon2': '0.174', 'AMMO3': '0.193', 'weapon5': '0.228', 'AMMO4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.160', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '44.500'} [2024-08-06 02:45:15,982][52795] DAMAGECOUNT value on done: 311809.0 [2024-08-06 02:45:15,983][52795] Sum rewards: 76.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.231', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.241', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.456', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '65.000'} [2024-08-06 02:45:16,196][52811] DAMAGECOUNT value on done: 311891.0 [2024-08-06 02:45:16,196][52811] Sum rewards: 66.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.212', 'AMMO4': '0.277', 'weapon2': '0.288', 'weapon4': '0.310', 'weapon5': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.724', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:16,375][52664] DAMAGECOUNT value on done: 352303.0 [2024-08-06 02:45:16,376][52664] Sum rewards: 75.528, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.970', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.378', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '65.000'} [2024-08-06 02:45:16,463][52671] DAMAGECOUNT value on done: 334469.0 [2024-08-06 02:45:16,464][52671] Sum rewards: 71.283, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.272', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.164', 'AMMO4': '0.199', 'weapon2': '0.272', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.774', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 331833344. Throughput: 0: 4384.9. Samples: 82958340. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 02:45:17,794][52567] Avg episode reward: [(0, '67.318')] [2024-08-06 02:45:18,323][52803] DAMAGECOUNT value on done: 317233.0 [2024-08-06 02:45:18,325][52803] Sum rewards: 65.463, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.095', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.322', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.296', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '53.000'} [2024-08-06 02:45:18,942][52795] DAMAGECOUNT value on done: 303642.0 [2024-08-06 02:45:18,946][52795] Sum rewards: 76.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '64.000'} [2024-08-06 02:45:19,133][52664] DAMAGECOUNT value on done: 346201.0 [2024-08-06 02:45:19,133][52664] Sum rewards: 62.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.485', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.176', 'AMMO4': '0.197', 'weapon4': '0.206', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.150', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '53.000'} [2024-08-06 02:45:19,223][52650] Updated weights for policy 0, policy_version 40511 (0.0013) [2024-08-06 02:45:19,337][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:45:19,361][52811] DAMAGECOUNT value on done: 316173.0 [2024-08-06 02:45:19,361][52811] Sum rewards: 60.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.146', 'weapon5': '0.156', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.030', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:19,479][52671] DAMAGECOUNT value on done: 329571.0 [2024-08-06 02:45:19,480][52671] Sum rewards: 78.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.125', 'AMMO3': '0.165', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.930', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '64.000'} [2024-08-06 02:45:20,355][52820] DAMAGECOUNT value on done: 306869.0 [2024-08-06 02:45:20,356][52820] Sum rewards: 60.996, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.600', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.099', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.468', 'WEAPON3': '1.600', 'weapon3': '3.066', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '55.000'} [2024-08-06 02:45:21,441][52803] DAMAGECOUNT value on done: 307562.0 [2024-08-06 02:45:21,443][52803] Sum rewards: 54.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO4': '0.133', 'weapon5': '0.136', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '46.000'} [2024-08-06 02:45:21,841][52663] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:45:22,129][52671] DAMAGECOUNT value on done: 341938.0 [2024-08-06 02:45:22,130][52671] Sum rewards: 72.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.323', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:22,169][52795] DAMAGECOUNT value on done: 312155.0 [2024-08-06 02:45:22,170][52795] Sum rewards: 67.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.200', 'AMMO3': '0.238', 'AMMO4': '0.275', 'weapon2': '0.366', 'weapon4': '0.374', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.762', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:22,174][52664] DAMAGECOUNT value on done: 346822.0 [2024-08-06 02:45:22,174][52664] Sum rewards: 70.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.326', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.175', 'weapon5': '0.194', 'weapon4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 331923456. Throughput: 0: 4387.1. Samples: 82984690. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:45:22,794][52567] Avg episode reward: [(0, '67.215')] [2024-08-06 02:45:23,360][52820] DAMAGECOUNT value on done: 312367.0 [2024-08-06 02:45:23,362][52820] Sum rewards: 82.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.116', 'weapon5': '0.198', 'AMMO4': '0.234', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '2.948', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '69.000'} [2024-08-06 02:45:24,093][52650] Updated weights for policy 0, policy_version 40521 (0.0013) [2024-08-06 02:45:25,090][52664] DAMAGECOUNT value on done: 347969.0 [2024-08-06 02:45:25,091][52664] Sum rewards: 68.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.406', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.146', 'weapon4': '0.222', 'AMMO3': '0.237', 'AMMO4': '0.275', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:25,228][52795] DAMAGECOUNT value on done: 317555.0 [2024-08-06 02:45:25,228][52795] Sum rewards: 69.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.057', 'AMMO3': '0.178', 'weapon2': '0.192', 'weapon5': '0.230', 'AMMO4': '0.284', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:25,295][52671] DAMAGECOUNT value on done: 342060.0 [2024-08-06 02:45:25,296][52671] Sum rewards: 84.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.312', 'AMMO5': '0.004', 'weapon5': '0.026', 'AMMO2': '0.030', 'weapon4': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '69.000'} [2024-08-06 02:45:26,455][52820] DAMAGECOUNT value on done: 308587.0 [2024-08-06 02:45:26,455][52820] Sum rewards: 69.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.034', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.050', 'AMMO4': '0.140', 'AMMO3': '0.177', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:27,390][52664] DAMAGECOUNT value on done: 349784.0 [2024-08-06 02:45:27,392][52664] Sum rewards: 69.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.068', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.288', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.376', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 332013568. Throughput: 0: 4381.1. Samples: 83010730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:45:27,794][52567] Avg episode reward: [(0, '67.684')] [2024-08-06 02:45:28,256][52666] DAMAGECOUNT value on done: 336262.0 [2024-08-06 02:45:28,257][52666] Sum rewards: 64.520, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.785', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.140', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:28,324][52671] DAMAGECOUNT value on done: 344148.0 [2024-08-06 02:45:28,325][52671] Sum rewards: 61.987, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.381', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO4': '0.213', 'weapon2': '0.250', 'AMMO3': '0.290', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.910', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:28,658][52650] Updated weights for policy 0, policy_version 40531 (0.0012) [2024-08-06 02:45:29,548][52820] DAMAGECOUNT value on done: 305637.0 [2024-08-06 02:45:29,549][52820] Sum rewards: 62.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.758', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.229', 'weapon5': '0.234', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '2.958', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '51.000'} [2024-08-06 02:45:30,115][52664] DAMAGECOUNT value on done: 339848.0 [2024-08-06 02:45:30,116][52664] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.225', 'AMMO4': '0.251', 'weapon4': '0.266', 'weapon2': '0.274', 'weapon5': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:30,299][52659] DAMAGECOUNT value on done: 337923.0 [2024-08-06 02:45:30,301][52659] Sum rewards: 59.850, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.002', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.278', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:31,035][52666] DAMAGECOUNT value on done: 339889.0 [2024-08-06 02:45:31,037][52666] Sum rewards: 87.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.402', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.104', 'AMMO4': '0.113', 'weapon5': '0.134', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.765', 'FRAGCOUNT': '70.000'} [2024-08-06 02:45:31,490][52671] DAMAGECOUNT value on done: 336509.0 [2024-08-06 02:45:31,491][52671] Sum rewards: 67.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.526', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'AMMO4': '0.197', 'WEAPON4': '0.350', 'weapon2': '0.494', 'weapon4': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.690', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2024-08-06 02:45:32,529][52820] DAMAGECOUNT value on done: 311249.0 [2024-08-06 02:45:32,533][52820] Sum rewards: 59.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.526', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.140', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.420', 'weapon4': '0.454', 'WEAPON3': '1.450', 'weapon3': '2.654', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 332095488. Throughput: 0: 4381.1. Samples: 83023940. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:45:32,794][52567] Avg episode reward: [(0, '67.664')] [2024-08-06 02:45:33,219][52650] Updated weights for policy 0, policy_version 40541 (0.0014) [2024-08-06 02:45:33,279][52664] DAMAGECOUNT value on done: 352803.0 [2024-08-06 02:45:33,279][52664] Sum rewards: 67.447, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.385', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.136', 'weapon2': '0.372', 'WEAPON3': '0.850', 'HITCOUNT': '3.220', 'weapon3': '3.540', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:33,612][52659] DAMAGECOUNT value on done: 336403.0 [2024-08-06 02:45:33,612][52659] Sum rewards: 67.758, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:33,649][52666] DAMAGECOUNT value on done: 339209.0 [2024-08-06 02:45:33,650][52666] Sum rewards: 61.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.007', 'AMMO2': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.134', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'weapon2': '0.348', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '51.000'} [2024-08-06 02:45:34,110][52670] DAMAGECOUNT value on done: 332165.0 [2024-08-06 02:45:34,111][52670] Sum rewards: 71.325, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.724', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.157', 'AMMO4': '0.211', 'weapon5': '0.212', 'weapon4': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.706', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:34,663][52671] DAMAGECOUNT value on done: 334973.0 [2024-08-06 02:45:34,665][52671] Sum rewards: 74.634, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.546', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.066', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.264', 'weapon4': '0.298', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.990', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '65.000'} [2024-08-06 02:45:35,586][52664] DAMAGECOUNT value on done: 346023.0 [2024-08-06 02:45:35,586][52664] Sum rewards: 72.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.419', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.330', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:35,634][52820] DAMAGECOUNT value on done: 304173.0 [2024-08-06 02:45:35,635][52820] Sum rewards: 55.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.206', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '45.000'} [2024-08-06 02:45:36,550][52666] DAMAGECOUNT value on done: 336137.0 [2024-08-06 02:45:36,550][52666] Sum rewards: 74.256, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.145', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '60.500'} [2024-08-06 02:45:36,554][52659] DAMAGECOUNT value on done: 337127.0 [2024-08-06 02:45:36,554][52659] Sum rewards: 78.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.025', 'weapon5': '0.074', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.476', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '66.000'} [2024-08-06 02:45:37,062][52670] DAMAGECOUNT value on done: 335673.0 [2024-08-06 02:45:37,062][52670] Sum rewards: 57.489, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.426', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.068', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.304', 'weapon2': '0.410', 'WEAPON3': '1.800', 'HITCOUNT': '3.110', 'weapon3': '3.240', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 332185600. Throughput: 0: 4386.4. Samples: 83050330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:45:37,795][52567] Avg episode reward: [(0, '67.650')] [2024-08-06 02:45:38,318][52650] Updated weights for policy 0, policy_version 40551 (0.0029) [2024-08-06 02:45:38,606][52664] DAMAGECOUNT value on done: 352235.0 [2024-08-06 02:45:38,607][52664] Sum rewards: 80.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.078', 'AMMO3': '0.217', 'AMMO4': '0.226', 'weapon5': '0.252', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '67.000'} [2024-08-06 02:45:38,708][52820] DAMAGECOUNT value on done: 308475.0 [2024-08-06 02:45:38,709][52820] Sum rewards: 66.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.125', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.644', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:39,288][52666] DAMAGECOUNT value on done: 332755.0 [2024-08-06 02:45:39,288][52666] Sum rewards: 68.671, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.824', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.166', 'weapon5': '0.166', 'AMMO3': '0.202', 'AMMO4': '0.239', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:39,490][52659] DAMAGECOUNT value on done: 336155.0 [2024-08-06 02:45:39,491][52659] Sum rewards: 67.725, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.150', 'weapon2': '0.394', 'WEAPON3': '1.000', 'HITCOUNT': '3.230', 'weapon3': '3.360', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '53.000'} [2024-08-06 02:45:39,824][52670] DAMAGECOUNT value on done: 328828.0 [2024-08-06 02:45:39,825][52670] Sum rewards: 64.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.508', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.118', 'AMMO4': '0.139', 'AMMO3': '0.160', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.108', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '53.000'} [2024-08-06 02:45:41,253][52664] DAMAGECOUNT value on done: 348032.0 [2024-08-06 02:45:41,254][52664] Sum rewards: 59.839, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.145', 'AMMO5': '0.009', 'weapon5': '0.036', 'AMMO2': '0.039', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.380', 'WEAPON4': '0.550', 'weapon4': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.742', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '51.000'} [2024-08-06 02:45:41,769][52820] DAMAGECOUNT value on done: 313817.0 [2024-08-06 02:45:41,769][52820] Sum rewards: 69.716, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.114', 'weapon5': '0.120', 'weapon2': '0.156', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.442', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:42,487][52666] DAMAGECOUNT value on done: 326602.0 [2024-08-06 02:45:42,487][52666] Sum rewards: 72.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.620', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO3': '0.176', 'AMMO4': '0.177', 'weapon5': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '60.000'} [2024-08-06 02:45:42,600][52650] Updated weights for policy 0, policy_version 40561 (0.0015) [2024-08-06 02:45:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 332275712. Throughput: 0: 4389.3. Samples: 83076670. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:45:42,794][52567] Avg episode reward: [(0, '68.109')] [2024-08-06 02:45:42,815][52659] DAMAGECOUNT value on done: 331183.0 [2024-08-06 02:45:42,815][52659] Sum rewards: 67.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.414', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.278', 'weapon4': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '56.000'} [2024-08-06 02:45:43,081][52670] DAMAGECOUNT value on done: 328317.0 [2024-08-06 02:45:43,081][52670] Sum rewards: 68.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.095', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:43,859][52664] DAMAGECOUNT value on done: 355705.0 [2024-08-06 02:45:43,860][52664] Sum rewards: 71.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.242', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO3': '0.194', 'weapon4': '0.280', 'weapon2': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.664', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:44,950][52820] DAMAGECOUNT value on done: 308941.0 [2024-08-06 02:45:44,952][52820] Sum rewards: 55.697, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.356', 'weapon2': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.670', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '12.858', 'FRAGCOUNT': '45.000'} [2024-08-06 02:45:45,322][52659] DAMAGECOUNT value on done: 335508.0 [2024-08-06 02:45:45,324][52659] Sum rewards: 69.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.043', 'weapon5': '0.044', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.215', 'AMMO3': '0.219', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:45,879][52666] DAMAGECOUNT value on done: 337257.0 [2024-08-06 02:45:45,880][52666] Sum rewards: 72.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.599', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.216', 'weapon5': '0.248', 'AMMO4': '0.251', 'weapon2': '0.270', 'weapon4': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.794', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '62.000'} [2024-08-06 02:45:46,482][52664] DAMAGECOUNT value on done: 348769.0 [2024-08-06 02:45:46,482][52664] Sum rewards: 71.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.177', 'weapon5': '0.192', 'weapon2': '0.238', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '57.500'} [2024-08-06 02:45:46,529][52670] DAMAGECOUNT value on done: 341109.0 [2024-08-06 02:45:46,530][52670] Sum rewards: 71.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.142', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.046', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:47,208][52803] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon5', 0.002)] [2024-08-06 02:45:47,333][52650] Updated weights for policy 0, policy_version 40571 (0.0011) [2024-08-06 02:45:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 332357632. Throughput: 0: 4392.2. Samples: 83089960. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:45:47,803][52567] Avg episode reward: [(0, '68.215')] [2024-08-06 02:45:48,101][52820] DAMAGECOUNT value on done: 313668.0 [2024-08-06 02:45:48,103][52820] Sum rewards: 76.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.054', 'weapon4': '0.092', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '66.000'} [2024-08-06 02:45:48,474][52659] DAMAGECOUNT value on done: 336796.0 [2024-08-06 02:45:48,475][52659] Sum rewards: 52.016, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.317', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.198', 'AMMO4': '0.244', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON4': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.550', 'weapon3': '2.550', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.080', 'FRAGCOUNT': '47.000'} [2024-08-06 02:45:48,925][52666] DAMAGECOUNT value on done: 334538.0 [2024-08-06 02:45:48,925][52666] Sum rewards: 68.428, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.565', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.416', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:49,130][52664] DAMAGECOUNT value on done: 354321.0 [2024-08-06 02:45:49,131][52664] Sum rewards: 74.229, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.630', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'weapon4': '0.104', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.876', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:49,772][52670] DAMAGECOUNT value on done: 331978.0 [2024-08-06 02:45:49,772][52670] Sum rewards: 64.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.161', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.143', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'weapon2': '0.260', 'WEAPON4': '0.500', 'weapon4': '0.564', 'WEAPON3': '0.800', 'weapon3': '2.758', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:51,144][52820] DAMAGECOUNT value on done: 310954.0 [2024-08-06 02:45:51,146][52820] Sum rewards: 63.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.958', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.104', 'weapon5': '0.210', 'AMMO4': '0.219', 'AMMO3': '0.251', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.948', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:51,482][52659] DAMAGECOUNT value on done: 333943.0 [2024-08-06 02:45:51,482][52659] Sum rewards: 81.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.094', 'weapon4': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.968', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '68.000'} [2024-08-06 02:45:51,636][52664] DAMAGECOUNT value on done: 345638.0 [2024-08-06 02:45:51,636][52664] Sum rewards: 80.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.040', 'weapon5': '0.138', 'AMMO4': '0.179', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '65.000'} [2024-08-06 02:45:51,734][52666] DAMAGECOUNT value on done: 330521.0 [2024-08-06 02:45:51,734][52666] Sum rewards: 60.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.973', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.102', 'AMMO4': '0.169', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:52,023][52650] Updated weights for policy 0, policy_version 40581 (0.0032) [2024-08-06 02:45:52,331][52670] DAMAGECOUNT value on done: 327299.0 [2024-08-06 02:45:52,332][52670] Sum rewards: 59.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.405', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.052', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.144', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.618', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.000'} [2024-08-06 02:45:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 332447744. Throughput: 0: 4383.3. Samples: 83115990. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:45:52,795][52567] Avg episode reward: [(0, '68.348')] [2024-08-06 02:45:54,202][52820] DAMAGECOUNT value on done: 311797.0 [2024-08-06 02:45:54,203][52820] Sum rewards: 68.039, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.456', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.088', 'weapon4': '0.140', 'AMMO4': '0.194', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:54,338][52666] DAMAGECOUNT value on done: 330146.0 [2024-08-06 02:45:54,343][52666] Sum rewards: 73.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.005', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.100', 'HITCOUNT': '3.370', 'weapon3': '3.478', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '61.000'} [2024-08-06 02:45:54,423][52663] DAMAGECOUNT value on done: 341424.0 [2024-08-06 02:45:54,423][52663] Sum rewards: 66.272, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.126', 'weapon2': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.424', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:54,645][52664] DAMAGECOUNT value on done: 348890.0 [2024-08-06 02:45:54,645][52664] Sum rewards: 61.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.016', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.072', 'weapon5': '0.184', 'AMMO4': '0.217', 'weapon2': '0.254', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.238', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '52.000'} [2024-08-06 02:45:54,723][52659] DAMAGECOUNT value on done: 343646.0 [2024-08-06 02:45:54,724][52659] Sum rewards: 65.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.048', 'weapon5': '0.048', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '53.000'} [2024-08-06 02:45:54,842][52670] DAMAGECOUNT value on done: 330098.0 [2024-08-06 02:45:54,842][52670] Sum rewards: 71.751, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.138', 'AMMO3': '0.151', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.284', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '59.000'} [2024-08-06 02:45:56,634][52650] Updated weights for policy 0, policy_version 40591 (0.0022) [2024-08-06 02:45:56,996][52663] DAMAGECOUNT value on done: 333232.0 [2024-08-06 02:45:56,997][52663] Sum rewards: 70.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.876', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.161', 'weapon5': '0.174', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '58.000'} [2024-08-06 02:45:57,149][52820] DAMAGECOUNT value on done: 314516.0 [2024-08-06 02:45:57,149][52820] Sum rewards: 71.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.128', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.169', 'weapon2': '0.216', 'weapon4': '0.228', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '61.000'} [2024-08-06 02:45:57,195][52666] DAMAGECOUNT value on done: 330434.0 [2024-08-06 02:45:57,195][52666] Sum rewards: 58.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.743', 'ARMOR': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.178', 'weapon4': '0.198', 'weapon5': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '46.000'} [2024-08-06 02:45:57,484][52659] DAMAGECOUNT value on done: 341953.0 [2024-08-06 02:45:57,486][52659] Sum rewards: 79.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.565', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.188', 'weapon2': '0.256', 'AMMO3': '0.259', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '68.000'} [2024-08-06 02:45:57,524][52664] DAMAGECOUNT value on done: 348404.0 [2024-08-06 02:45:57,524][52664] Sum rewards: 67.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.935', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.150', 'weapon5': '0.168', 'weapon2': '0.178', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.288', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '57.000'} [2024-08-06 02:45:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 332529664. Throughput: 0: 4384.7. Samples: 83142560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:45:57,794][52567] Avg episode reward: [(0, '68.640')] [2024-08-06 02:45:57,877][52670] DAMAGECOUNT value on done: 332089.0 [2024-08-06 02:45:57,878][52670] Sum rewards: 75.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.125', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.138', 'weapon4': '0.202', 'weapon2': '0.410', 'WEAPON3': '0.850', 'weapon3': '3.130', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '58.500'} [2024-08-06 02:45:59,462][52669] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:45:59,550][52663] DAMAGECOUNT value on done: 333524.0 [2024-08-06 02:45:59,551][52663] Sum rewards: 62.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.924', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.186', 'AMMO3': '0.194', 'AMMO4': '0.212', 'weapon5': '0.294', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '50.500'} [2024-08-06 02:46:00,260][52666] DAMAGECOUNT value on done: 329228.0 [2024-08-06 02:46:00,260][52666] Sum rewards: 68.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.747', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.126', 'AMMO3': '0.219', 'AMMO4': '0.252', 'weapon5': '0.280', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:00,282][52820] DAMAGECOUNT value on done: 314170.0 [2024-08-06 02:46:00,282][52820] Sum rewards: 65.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.605', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.196', 'AMMO3': '0.206', 'AMMO4': '0.255', 'weapon2': '0.338', 'weapon4': '0.392', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.762', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:00,480][52659] DAMAGECOUNT value on done: 335071.0 [2024-08-06 02:46:00,480][52659] Sum rewards: 77.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.216', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '64.000'} [2024-08-06 02:46:00,671][52664] DAMAGECOUNT value on done: 348183.0 [2024-08-06 02:46:00,673][52664] Sum rewards: 56.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.258', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.247', 'weapon2': '0.278', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.448', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '49.000'} [2024-08-06 02:46:01,108][52670] DAMAGECOUNT value on done: 325329.0 [2024-08-06 02:46:01,110][52670] Sum rewards: 69.185, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.622', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.225', 'weapon4': '0.270', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:01,359][52650] Updated weights for policy 0, policy_version 40601 (0.0035) [2024-08-06 02:46:02,334][52663] DAMAGECOUNT value on done: 337348.0 [2024-08-06 02:46:02,334][52663] Sum rewards: 90.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.138', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.185', 'weapon4': '0.188', 'weapon5': '0.190', 'AMMO4': '0.242', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '75.000'} [2024-08-06 02:46:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 332627968. Throughput: 0: 4384.0. Samples: 83155620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:46:02,802][52567] Avg episode reward: [(0, '68.773')] [2024-08-06 02:46:03,402][52820] DAMAGECOUNT value on done: 315419.0 [2024-08-06 02:46:03,402][52820] Sum rewards: 62.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.103', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.308', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 02:46:03,474][52666] DAMAGECOUNT value on done: 339887.0 [2024-08-06 02:46:03,474][52666] Sum rewards: 68.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.819', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.226', 'AMMO3': '0.233', 'AMMO4': '0.288', 'weapon2': '0.336', 'weapon4': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.768', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:03,636][52659] DAMAGECOUNT value on done: 340123.0 [2024-08-06 02:46:03,638][52659] Sum rewards: 68.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.192', 'weapon4': '0.216', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:03,692][52664] DAMAGECOUNT value on done: 347485.0 [2024-08-06 02:46:03,692][52664] Sum rewards: 59.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.655', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.094', 'weapon4': '0.166', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.062', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '49.500'} [2024-08-06 02:46:04,234][52670] DAMAGECOUNT value on done: 339713.0 [2024-08-06 02:46:04,236][52670] Sum rewards: 64.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'AMMO5': '0.017', 'AMMO2': '0.062', 'AMMO3': '0.160', 'weapon5': '0.270', 'AMMO4': '0.311', 'weapon2': '0.330', 'weapon4': '0.434', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.620', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '54.000'} [2024-08-06 02:46:05,126][52663] DAMAGECOUNT value on done: 335307.0 [2024-08-06 02:46:05,129][52663] Sum rewards: 75.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon7': '0.048', 'weapon5': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.126', 'AMMO4': '0.183', 'WEAPON7': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.498', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '62.000'} [2024-08-06 02:46:05,970][52647] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon5', 0.002)] [2024-08-06 02:46:06,204][52650] Updated weights for policy 0, policy_version 40611 (0.0011) [2024-08-06 02:46:06,395][52820] DAMAGECOUNT value on done: 311571.0 [2024-08-06 02:46:06,397][52820] Sum rewards: 63.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.260', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.406', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.262', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:06,579][52666] DAMAGECOUNT value on done: 336814.0 [2024-08-06 02:46:06,580][52666] Sum rewards: 84.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'weapon5': '0.006', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.440', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '71.000'} [2024-08-06 02:46:06,943][52659] DAMAGECOUNT value on done: 328141.0 [2024-08-06 02:46:06,943][52659] Sum rewards: 73.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.747', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '61.000'} [2024-08-06 02:46:07,271][52670] DAMAGECOUNT value on done: 332415.0 [2024-08-06 02:46:07,272][52670] Sum rewards: 73.009, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.234', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '60.000'} [2024-08-06 02:46:07,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 332709888. Throughput: 0: 4381.5. Samples: 83181860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:46:07,802][52567] Avg episode reward: [(0, '68.881')] [2024-08-06 02:46:08,234][52663] DAMAGECOUNT value on done: 341159.0 [2024-08-06 02:46:08,234][52663] Sum rewards: 78.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.060', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '63.000'} [2024-08-06 02:46:09,377][52659] DAMAGECOUNT value on done: 337134.0 [2024-08-06 02:46:09,378][52659] Sum rewards: 65.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.985', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.060', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon2': '0.148', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.234', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.340', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '53.000'} [2024-08-06 02:46:09,407][52666] DAMAGECOUNT value on done: 333099.0 [2024-08-06 02:46:09,409][52666] Sum rewards: 66.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.572', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO4': '0.163', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:09,552][52820] DAMAGECOUNT value on done: 310233.0 [2024-08-06 02:46:09,552][52820] Sum rewards: 65.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.355', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.074', 'AMMO4': '0.179', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.500', 'weapon2': '0.794', 'WEAPON3': '1.350', 'weapon3': '2.534', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:10,103][52670] DAMAGECOUNT value on done: 333836.0 [2024-08-06 02:46:10,103][52670] Sum rewards: 64.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.775', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '55.000'} [2024-08-06 02:46:10,812][52650] Updated weights for policy 0, policy_version 40621 (0.0029) [2024-08-06 02:46:10,945][52663] DAMAGECOUNT value on done: 335902.0 [2024-08-06 02:46:10,945][52663] Sum rewards: 67.334, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.136', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.122', 'weapon5': '0.140', 'AMMO4': '0.195', 'AMMO3': '0.202', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:11,003][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:46:11,813][52659] DAMAGECOUNT value on done: 342688.0 [2024-08-06 02:46:11,815][52659] Sum rewards: 64.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.544', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.054', 'weapon5': '0.104', 'AMMO4': '0.104', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.358', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '52.500'} [2024-08-06 02:46:12,619][52666] DAMAGECOUNT value on done: 335181.0 [2024-08-06 02:46:12,620][52666] Sum rewards: 66.357, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.385', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.222', 'weapon4': '0.242', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.600', 'weapon3': '2.776', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 332800000. Throughput: 0: 4385.5. Samples: 83208080. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:46:12,795][52567] Avg episode reward: [(0, '68.638')] [2024-08-06 02:46:12,809][52820] DAMAGECOUNT value on done: 320176.0 [2024-08-06 02:46:12,810][52820] Sum rewards: 62.480, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.116', 'AMMO4': '0.147', 'weapon5': '0.194', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '52.000'} [2024-08-06 02:46:13,271][52670] DAMAGECOUNT value on done: 338005.0 [2024-08-06 02:46:13,273][52670] Sum rewards: 68.930, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.372', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.132', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:13,739][52663] DAMAGECOUNT value on done: 334395.0 [2024-08-06 02:46:13,741][52663] Sum rewards: 58.146, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.702', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.214', 'AMMO4': '0.235', 'AMMO3': '0.244', 'weapon5': '0.260', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '51.000'} [2024-08-06 02:46:14,705][52659] DAMAGECOUNT value on done: 344538.0 [2024-08-06 02:46:14,705][52659] Sum rewards: 73.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.959', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.320', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '60.000'} [2024-08-06 02:46:15,359][52650] Updated weights for policy 0, policy_version 40631 (0.0013) [2024-08-06 02:46:15,665][52666] DAMAGECOUNT value on done: 333275.0 [2024-08-06 02:46:15,666][52666] Sum rewards: 69.751, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.209', 'weapon4': '0.226', 'weapon5': '0.230', 'AMMO4': '0.231', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:15,855][52820] DAMAGECOUNT value on done: 320783.0 [2024-08-06 02:46:15,857][52820] Sum rewards: 53.258, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.056', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.130', 'AMMO3': '0.223', 'AMMO4': '0.291', 'weapon5': '0.316', 'weapon2': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.470', 'weapon3': '2.924', 'DAMAGECOUNT': '13.305', 'FRAGCOUNT': '48.000'} [2024-08-06 02:46:16,207][52663] DAMAGECOUNT value on done: 331700.0 [2024-08-06 02:46:16,209][52663] Sum rewards: 49.401, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.740', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.158', 'weapon7': '0.172', 'AMMO4': '0.177', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.548', 'WEAPON3': '0.600', 'weapon4': '1.254', 'weapon3': '1.636', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '12.081', 'FRAGCOUNT': '39.000'} [2024-08-06 02:46:16,395][52670] DAMAGECOUNT value on done: 335413.0 [2024-08-06 02:46:16,396][52670] Sum rewards: 54.581, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.082', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.112', 'weapon5': '0.134', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.268', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.780', 'weapon3': '3.220', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '50.000'} [2024-08-06 02:46:17,185][52647] DAMAGECOUNT value on done: 354708.0 [2024-08-06 02:46:17,185][52647] Sum rewards: 60.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.112', 'AMMO3': '0.172', 'weapon5': '0.244', 'AMMO4': '0.280', 'WEAPON4': '0.550', 'weapon2': '0.624', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '2.742', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '53.000'} [2024-08-06 02:46:17,602][52659] DAMAGECOUNT value on done: 339967.0 [2024-08-06 02:46:17,603][52659] Sum rewards: 70.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.176', 'AMMO5': '0.015', 'AMMO2': '0.084', 'weapon4': '0.176', 'AMMO3': '0.213', 'weapon5': '0.286', 'weapon2': '0.378', 'AMMO4': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 332881920. Throughput: 0: 4381.3. Samples: 83221100. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:46:17,802][52567] Avg episode reward: [(0, '68.124')] [2024-08-06 02:46:18,589][52666] DAMAGECOUNT value on done: 334168.0 [2024-08-06 02:46:18,591][52666] Sum rewards: 66.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:18,836][52820] DAMAGECOUNT value on done: 311024.0 [2024-08-06 02:46:18,836][52820] Sum rewards: 76.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO5': '0.004', 'AMMO2': '0.033', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.217', 'weapon4': '0.238', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '63.000'} [2024-08-06 02:46:19,232][52670] DAMAGECOUNT value on done: 321970.0 [2024-08-06 02:46:19,232][52670] Sum rewards: 82.436, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.782', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.076', 'weapon2': '0.218', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.406', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '70.000'} [2024-08-06 02:46:19,253][52663] DAMAGECOUNT value on done: 338073.0 [2024-08-06 02:46:19,253][52663] Sum rewards: 73.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.327', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.060', 'weapon4': '0.072', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.312', 'WEAPON3': '1.650', 'weapon3': '3.310', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '64.000'} [2024-08-06 02:46:20,102][52647] DAMAGECOUNT value on done: 353843.0 [2024-08-06 02:46:20,103][52647] Sum rewards: 70.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.575', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.352', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.236', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:20,162][52650] Updated weights for policy 0, policy_version 40641 (0.0013) [2024-08-06 02:46:20,237][52659] DAMAGECOUNT value on done: 335622.0 [2024-08-06 02:46:20,237][52659] Sum rewards: 64.615, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.553', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.392', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:21,038][52666] DAMAGECOUNT value on done: 327634.0 [2024-08-06 02:46:21,038][52666] Sum rewards: 65.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.198', 'AMMO3': '0.218', 'AMMO4': '0.258', 'weapon4': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '2.488', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '55.000'} [2024-08-06 02:46:21,529][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:46:21,826][52670] DAMAGECOUNT value on done: 335630.0 [2024-08-06 02:46:21,826][52670] Sum rewards: 63.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.502', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.106', 'AMMO3': '0.171', 'AMMO4': '0.201', 'weapon2': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.158', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '53.500'} [2024-08-06 02:46:22,423][52663] DAMAGECOUNT value on done: 340579.0 [2024-08-06 02:46:22,425][52663] Sum rewards: 81.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.042', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.124', 'weapon4': '0.126', 'AMMO4': '0.189', 'AMMO3': '0.193', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '66.000'} [2024-08-06 02:46:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 332972032. Throughput: 0: 4381.6. Samples: 83247500. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:46:22,794][52567] Avg episode reward: [(0, '68.045')] [2024-08-06 02:46:23,037][52647] DAMAGECOUNT value on done: 353057.0 [2024-08-06 02:46:23,037][52647] Sum rewards: 63.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.114', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.724', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '52.000'} [2024-08-06 02:46:23,107][52659] DAMAGECOUNT value on done: 341181.0 [2024-08-06 02:46:23,109][52659] Sum rewards: 79.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.736', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.130', 'AMMO3': '0.199', 'weapon5': '0.214', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '65.000'} [2024-08-06 02:46:23,995][52666] DAMAGECOUNT value on done: 334552.0 [2024-08-06 02:46:23,995][52666] Sum rewards: 62.466, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.663', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.000', 'HITCOUNT': '2.840', 'weapon3': '3.420', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '51.000'} [2024-08-06 02:46:24,499][52650] Updated weights for policy 0, policy_version 40651 (0.0011) [2024-08-06 02:46:24,623][52670] DAMAGECOUNT value on done: 341426.0 [2024-08-06 02:46:24,623][52670] Sum rewards: 61.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.434', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.222', 'AMMO4': '0.246', 'AMMO3': '0.268', 'weapon2': '0.334', 'weapon4': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.772', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '54.000'} [2024-08-06 02:46:24,842][52663] DAMAGECOUNT value on done: 336286.0 [2024-08-06 02:46:24,843][52663] Sum rewards: 71.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.175', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '59.000'} [2024-08-06 02:46:26,025][52659] DAMAGECOUNT value on done: 341189.0 [2024-08-06 02:46:26,025][52659] Sum rewards: 69.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.206', 'AMMO3': '0.223', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:26,226][52647] DAMAGECOUNT value on done: 358348.0 [2024-08-06 02:46:26,226][52647] Sum rewards: 80.500, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.034', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.272', 'HEALTH': '0.324', 'WEAPON3': '1.000', 'weapon3': '3.462', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 02:46:27,551][52663] DAMAGECOUNT value on done: 330458.0 [2024-08-06 02:46:27,551][52663] Sum rewards: 70.367, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.011', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.147', 'weapon5': '0.164', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '55.000'} [2024-08-06 02:46:27,567][52670] DAMAGECOUNT value on done: 333941.0 [2024-08-06 02:46:27,567][52670] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.370', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon4': '0.236', 'weapon2': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 333062144. Throughput: 0: 4380.0. Samples: 83273770. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:46:27,795][52567] Avg episode reward: [(0, '68.401')] [2024-08-06 02:46:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040657_333062144.pth... [2024-08-06 02:46:27,928][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040144_328859648.pth [2024-08-06 02:46:28,936][52647] DAMAGECOUNT value on done: 355395.0 [2024-08-06 02:46:28,936][52647] Sum rewards: 65.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.292', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon4': '0.256', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '51.500'} [2024-08-06 02:46:29,664][52650] Updated weights for policy 0, policy_version 40661 (0.0045) [2024-08-06 02:46:30,376][52663] DAMAGECOUNT value on done: 332718.0 [2024-08-06 02:46:30,376][52663] Sum rewards: 76.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '63.000'} [2024-08-06 02:46:30,944][52670] DAMAGECOUNT value on done: 334463.0 [2024-08-06 02:46:30,945][52670] Sum rewards: 60.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '49.000'} [2024-08-06 02:46:31,779][52647] DAMAGECOUNT value on done: 358855.0 [2024-08-06 02:46:31,779][52647] Sum rewards: 62.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.187', 'weapon2': '0.206', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '50.000'} [2024-08-06 02:46:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 333152256. Throughput: 0: 4363.3. Samples: 83286310. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:46:32,794][52567] Avg episode reward: [(0, '68.290')] [2024-08-06 02:46:33,163][52663] DAMAGECOUNT value on done: 333481.0 [2024-08-06 02:46:33,173][52663] Sum rewards: 64.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.072', 'AMMO4': '0.154', 'weapon4': '0.168', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '53.000'} [2024-08-06 02:46:34,343][52650] Updated weights for policy 0, policy_version 40671 (0.0019) [2024-08-06 02:46:34,514][52647] DAMAGECOUNT value on done: 354831.0 [2024-08-06 02:46:34,516][52647] Sum rewards: 70.683, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO4': '0.214', 'AMMO3': '0.235', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '61.000'} [2024-08-06 02:46:35,051][52667] DAMAGECOUNT value on done: 336886.0 [2024-08-06 02:46:35,052][52667] Sum rewards: 78.907, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.169', 'weapon4': '0.204', 'AMMO4': '0.207', 'weapon2': '0.228', 'weapon5': '0.232', 'HEALTH': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.996', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '62.000'} [2024-08-06 02:46:36,265][52663] DAMAGECOUNT value on done: 341101.0 [2024-08-06 02:46:36,265][52663] Sum rewards: 64.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.995', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.098', 'AMMO3': '0.200', 'AMMO4': '0.220', 'weapon5': '0.228', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.094', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '53.000'} [2024-08-06 02:46:36,841][52647] DAMAGECOUNT value on done: 352926.0 [2024-08-06 02:46:36,841][52647] Sum rewards: 71.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.182', 'AMMO3': '0.184', 'weapon4': '0.192', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 02:46:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 333234176. Throughput: 0: 4369.4. Samples: 83312610. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 02:46:37,794][52567] Avg episode reward: [(0, '68.413')] [2024-08-06 02:46:38,074][52667] DAMAGECOUNT value on done: 341664.0 [2024-08-06 02:46:38,075][52667] Sum rewards: 59.878, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.336', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.158', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.322', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '49.000'} [2024-08-06 02:46:38,883][52663] DAMAGECOUNT value on done: 336028.0 [2024-08-06 02:46:38,883][52663] Sum rewards: 63.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.112', 'AMMO4': '0.183', 'weapon5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.062', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '53.000'} [2024-08-06 02:46:38,921][52650] Updated weights for policy 0, policy_version 40681 (0.0024) [2024-08-06 02:46:39,381][52647] DAMAGECOUNT value on done: 362025.0 [2024-08-06 02:46:39,382][52647] Sum rewards: 82.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.178', 'AMMO3': '0.194', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '66.000'} [2024-08-06 02:46:40,682][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:46:40,921][52667] DAMAGECOUNT value on done: 337683.0 [2024-08-06 02:46:40,921][52667] Sum rewards: 68.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.586', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.252', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:41,816][52663] DAMAGECOUNT value on done: 342459.0 [2024-08-06 02:46:41,816][52663] Sum rewards: 67.777, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.290', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.200', 'weapon5': '0.226', 'weapon2': '0.246', 'AMMO3': '0.255', 'AMMO4': '0.255', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '60.000'} [2024-08-06 02:46:41,949][52647] DAMAGECOUNT value on done: 351578.0 [2024-08-06 02:46:41,949][52647] Sum rewards: 67.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.282', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.504', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '55.000'} [2024-08-06 02:46:41,982][52614] Signal inference workers to stop experience collection... (7350 times) [2024-08-06 02:46:41,984][52614] Signal inference workers to resume experience collection... (7350 times) [2024-08-06 02:46:42,067][52650] InferenceWorker_p0-w0: stopping experience collection (7350 times) [2024-08-06 02:46:42,067][52650] InferenceWorker_p0-w0: resuming experience collection (7350 times) [2024-08-06 02:46:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 333324288. Throughput: 0: 4365.1. Samples: 83338990. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 02:46:42,794][52567] Avg episode reward: [(0, '68.418')] [2024-08-06 02:46:43,100][52665] DAMAGECOUNT value on done: 331799.0 [2024-08-06 02:46:43,101][52665] Sum rewards: 71.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.094', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.120', 'AMMO4': '0.131', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.302', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '59.000'} [2024-08-06 02:46:43,319][52667] DAMAGECOUNT value on done: 339425.0 [2024-08-06 02:46:43,324][52667] Sum rewards: 72.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.178', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '60.000'} [2024-08-06 02:46:43,403][52650] Updated weights for policy 0, policy_version 40691 (0.0012) [2024-08-06 02:46:44,681][52647] DAMAGECOUNT value on done: 359925.0 [2024-08-06 02:46:44,681][52647] Sum rewards: 63.518, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.112', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.122', 'weapon5': '0.212', 'AMMO4': '0.214', 'AMMO3': '0.255', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:45,029][52663] DAMAGECOUNT value on done: 338412.0 [2024-08-06 02:46:45,030][52663] Sum rewards: 68.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.128', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.158', 'AMMO4': '0.174', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.000', 'weapon3': '3.196', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '55.000'} [2024-08-06 02:46:45,839][52669] Large shaping reward 2.586 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon5', 0.002)] [2024-08-06 02:46:46,115][52665] DAMAGECOUNT value on done: 338410.0 [2024-08-06 02:46:46,117][52665] Sum rewards: 77.713, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.032', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.144', 'weapon2': '0.186', 'weapon4': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.248', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '66.000'} [2024-08-06 02:46:46,149][52667] DAMAGECOUNT value on done: 343277.0 [2024-08-06 02:46:46,150][52667] Sum rewards: 75.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.514', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.175', 'weapon5': '0.206', 'weapon2': '0.232', 'AMMO4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.856', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '63.000'} [2024-08-06 02:46:47,498][52663] DAMAGECOUNT value on done: 331919.0 [2024-08-06 02:46:47,500][52663] Sum rewards: 66.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.212', 'weapon5': '0.230', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.050', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:47,679][52647] DAMAGECOUNT value on done: 350708.0 [2024-08-06 02:46:47,680][52647] Sum rewards: 67.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.304', 'WEAPON3': '1.050', 'weapon3': '3.358', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '54.000'} [2024-08-06 02:46:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 333414400. Throughput: 0: 4371.6. Samples: 83352340. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 02:46:47,794][52567] Avg episode reward: [(0, '68.565')] [2024-08-06 02:46:47,925][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:46:48,485][52650] Updated weights for policy 0, policy_version 40701 (0.0011) [2024-08-06 02:46:48,603][52665] DAMAGECOUNT value on done: 337068.0 [2024-08-06 02:46:48,604][52665] Sum rewards: 67.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.423', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO3': '0.183', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:49,200][52667] DAMAGECOUNT value on done: 342258.0 [2024-08-06 02:46:49,203][52667] Sum rewards: 60.234, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.171', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.080', 'AMMO3': '0.145', 'weapon4': '0.178', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.660', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '2.904', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '48.000'} [2024-08-06 02:46:49,903][52647] DAMAGECOUNT value on done: 352589.0 [2024-08-06 02:46:49,911][52647] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.518', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '59.000'} [2024-08-06 02:46:51,748][52665] DAMAGECOUNT value on done: 332944.0 [2024-08-06 02:46:51,748][52665] Sum rewards: 71.010, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.445', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.104', 'weapon4': '0.130', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'HITCOUNT': '3.180', 'weapon3': '3.290', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '63.000'} [2024-08-06 02:46:51,777][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:46:52,105][52662] DAMAGECOUNT value on done: 348646.0 [2024-08-06 02:46:52,106][52662] Sum rewards: 57.188, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.676', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.182', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.314', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.650', 'weapon3': '2.948', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '50.500'} [2024-08-06 02:46:52,128][52667] DAMAGECOUNT value on done: 343688.0 [2024-08-06 02:46:52,128][52667] Sum rewards: 64.125, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.247', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.474', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.200', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '51.000'} [2024-08-06 02:46:52,718][52647] DAMAGECOUNT value on done: 353596.0 [2024-08-06 02:46:52,718][52647] Sum rewards: 63.856, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.755', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.157', 'weapon4': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.500'} [2024-08-06 02:46:52,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 333496320. Throughput: 0: 4375.3. Samples: 83378750. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 02:46:52,795][52567] Avg episode reward: [(0, '68.333')] [2024-08-06 02:46:53,050][52650] Updated weights for policy 0, policy_version 40711 (0.0011) [2024-08-06 02:46:54,531][52665] DAMAGECOUNT value on done: 329919.0 [2024-08-06 02:46:54,531][52665] Sum rewards: 81.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.549', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '68.000'} [2024-08-06 02:46:54,640][52667] DAMAGECOUNT value on done: 339073.0 [2024-08-06 02:46:54,642][52667] Sum rewards: 75.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.230', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.048', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.293', 'weapon2': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.210', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '67.000'} [2024-08-06 02:46:55,118][52662] DAMAGECOUNT value on done: 342845.0 [2024-08-06 02:46:55,119][52662] Sum rewards: 71.627, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.046', 'weapon4': '0.084', 'AMMO3': '0.123', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.432', 'WEAPON3': '0.800', 'weapon3': '3.264', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '57.000'} [2024-08-06 02:46:55,790][52647] DAMAGECOUNT value on done: 362186.0 [2024-08-06 02:46:55,791][52647] Sum rewards: 64.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.151', 'weapon2': '0.194', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '56.000'} [2024-08-06 02:46:57,371][52665] DAMAGECOUNT value on done: 328643.0 [2024-08-06 02:46:57,376][52665] Sum rewards: 60.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.448', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.192', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '51.000'} [2024-08-06 02:46:57,402][52667] DAMAGECOUNT value on done: 337878.0 [2024-08-06 02:46:57,403][52667] Sum rewards: 62.110, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.444', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon5': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.748', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '50.000'} [2024-08-06 02:46:57,410][52650] Updated weights for policy 0, policy_version 40721 (0.0013) [2024-08-06 02:46:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17522.5). Total num frames: 333594624. Throughput: 0: 4376.2. Samples: 83405010. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 02:46:57,794][52567] Avg episode reward: [(0, '68.361')] [2024-08-06 02:46:57,893][52662] DAMAGECOUNT value on done: 342667.0 [2024-08-06 02:46:57,894][52662] Sum rewards: 68.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.217', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.195', 'weapon5': '0.236', 'weapon4': '0.260', 'AMMO4': '0.279', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '58.000'} [2024-08-06 02:46:58,239][52647] DAMAGECOUNT value on done: 354769.0 [2024-08-06 02:46:58,239][52647] Sum rewards: 65.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.214', 'AMMO3': '0.216', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.226', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '55.000'} [2024-08-06 02:46:58,998][52649] DAMAGECOUNT value on done: 331294.0 [2024-08-06 02:46:58,999][52649] Sum rewards: 81.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.106', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.560', 'WEAPON3': '1.600', 'weapon3': '2.748', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.105', 'FRAGCOUNT': '67.000'} [2024-08-06 02:47:00,137][52667] DAMAGECOUNT value on done: 346668.0 [2024-08-06 02:47:00,145][52667] Sum rewards: 74.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.737', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.216', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:00,258][52665] DAMAGECOUNT value on done: 335479.0 [2024-08-06 02:47:00,258][52665] Sum rewards: 69.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.200', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.244', 'weapon2': '0.334', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.110', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:00,523][52662] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.405, 135.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 02:47:00,811][52647] DAMAGECOUNT value on done: 352999.0 [2024-08-06 02:47:00,812][52647] Sum rewards: 60.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.502', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.169', 'weapon4': '0.222', 'weapon5': '0.228', 'AMMO4': '0.272', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '2.818', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:00,862][52662] DAMAGECOUNT value on done: 333069.0 [2024-08-06 02:47:00,862][52662] Sum rewards: 62.342, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.426', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '2.988', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:02,202][52650] Updated weights for policy 0, policy_version 40731 (0.0021) [2024-08-06 02:47:02,254][52649] DAMAGECOUNT value on done: 324469.0 [2024-08-06 02:47:02,255][52649] Sum rewards: 74.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.108', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.251', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:02,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 333676544. Throughput: 0: 4382.9. Samples: 83418330. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 02:47:02,794][52567] Avg episode reward: [(0, '68.545')] [2024-08-06 02:47:03,024][52667] DAMAGECOUNT value on done: 338159.0 [2024-08-06 02:47:03,024][52667] Sum rewards: 55.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.035', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.390', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.160', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '46.000'} [2024-08-06 02:47:03,487][52665] DAMAGECOUNT value on done: 338304.0 [2024-08-06 02:47:03,487][52665] Sum rewards: 62.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.554', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.158', 'weapon4': '0.172', 'AMMO4': '0.174', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.198', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:03,510][52647] DAMAGECOUNT value on done: 350365.0 [2024-08-06 02:47:03,511][52647] Sum rewards: 55.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.672', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.292', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.384', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '48.000'} [2024-08-06 02:47:03,729][52662] DAMAGECOUNT value on done: 344544.0 [2024-08-06 02:47:03,730][52662] Sum rewards: 74.473, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.126', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.214', 'weapon2': '0.466', 'WEAPON3': '0.950', 'weapon3': '3.052', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:05,102][52668] DAMAGECOUNT value on done: 335825.0 [2024-08-06 02:47:05,102][52668] Sum rewards: 74.313, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.155', 'AMMO4': '-0.030', 'AMMO2': '-0.006', 'AMMO3': '0.190', 'weapon2': '0.624', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:05,249][52649] DAMAGECOUNT value on done: 330255.0 [2024-08-06 02:47:05,257][52649] Sum rewards: 57.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.554', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:05,784][52667] DAMAGECOUNT value on done: 340800.0 [2024-08-06 02:47:05,787][52667] Sum rewards: 68.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.070', 'weapon5': '0.128', 'weapon2': '0.216', 'AMMO3': '0.231', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 02:47:06,265][52647] DAMAGECOUNT value on done: 348880.0 [2024-08-06 02:47:06,267][52647] Sum rewards: 80.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.027', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.684', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '68.000'} [2024-08-06 02:47:06,417][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:47:06,469][52665] DAMAGECOUNT value on done: 336989.0 [2024-08-06 02:47:06,469][52665] Sum rewards: 70.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.189', 'weapon4': '0.228', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.290', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:06,943][52662] DAMAGECOUNT value on done: 336701.0 [2024-08-06 02:47:06,944][52662] Sum rewards: 72.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.978', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:07,079][52650] Updated weights for policy 0, policy_version 40741 (0.0012) [2024-08-06 02:47:07,738][52668] DAMAGECOUNT value on done: 339752.0 [2024-08-06 02:47:07,739][52668] Sum rewards: 65.405, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.300', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2024-08-06 02:47:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 333758464. Throughput: 0: 4380.2. Samples: 83444610. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:47:07,794][52567] Avg episode reward: [(0, '68.177')] [2024-08-06 02:47:08,390][52649] DAMAGECOUNT value on done: 328672.0 [2024-08-06 02:47:08,392][52649] Sum rewards: 65.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.259', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.176', 'weapon5': '0.182', 'weapon2': '0.188', 'AMMO4': '0.197', 'weapon4': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.182', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '54.000'} [2024-08-06 02:47:08,535][52667] DAMAGECOUNT value on done: 340693.0 [2024-08-06 02:47:08,536][52667] Sum rewards: 69.300, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.190', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON5': '0.400', 'weapon2': '0.798', 'WEAPON3': '1.200', 'weapon3': '2.494', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '57.500'} [2024-08-06 02:47:08,783][52647] DAMAGECOUNT value on done: 354224.0 [2024-08-06 02:47:08,783][52647] Sum rewards: 55.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.592', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.118', 'weapon4': '0.150', 'AMMO4': '0.185', 'weapon2': '0.210', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.290', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '48.000'} [2024-08-06 02:47:09,423][52665] DAMAGECOUNT value on done: 334708.0 [2024-08-06 02:47:09,423][52665] Sum rewards: 58.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.436', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.120', 'weapon4': '0.176', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:09,930][52662] DAMAGECOUNT value on done: 345842.0 [2024-08-06 02:47:09,932][52662] Sum rewards: 78.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.414', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.230', 'WEAPON3': '1.450', 'weapon3': '3.484', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '66.000'} [2024-08-06 02:47:10,820][52668] DAMAGECOUNT value on done: 342035.0 [2024-08-06 02:47:10,820][52668] Sum rewards: 62.315, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.248', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.524', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '53.000'} [2024-08-06 02:47:11,098][52649] DAMAGECOUNT value on done: 320948.0 [2024-08-06 02:47:11,098][52649] Sum rewards: 64.876, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.152', 'AMMO5': '0.022', 'AMMO2': '0.050', 'weapon4': '0.126', 'weapon2': '0.216', 'weapon5': '0.236', 'AMMO4': '0.248', 'AMMO3': '0.287', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '3.010', 'weapon3': '3.026', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:11,330][52650] Updated weights for policy 0, policy_version 40751 (0.0027) [2024-08-06 02:47:11,341][52667] DAMAGECOUNT value on done: 334942.0 [2024-08-06 02:47:11,345][52667] Sum rewards: 61.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.150', 'weapon2': '0.244', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.452', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '55.000'} [2024-08-06 02:47:12,033][52803] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0)] [2024-08-06 02:47:12,344][52665] DAMAGECOUNT value on done: 343185.0 [2024-08-06 02:47:12,346][52665] Sum rewards: 68.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.232', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.170', 'AMMO3': '0.221', 'AMMO4': '0.277', 'weapon4': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 333848576. Throughput: 0: 4381.1. Samples: 83470920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:47:12,794][52567] Avg episode reward: [(0, '67.715')] [2024-08-06 02:47:13,007][52662] DAMAGECOUNT value on done: 349020.0 [2024-08-06 02:47:13,007][52662] Sum rewards: 58.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.148', 'AMMO4': '0.179', 'AMMO3': '0.195', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.260', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:13,571][52669] DAMAGECOUNT value on done: 342955.0 [2024-08-06 02:47:13,571][52669] Sum rewards: 60.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.667', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.132', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.256', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.230', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:13,862][52668] DAMAGECOUNT value on done: 343898.0 [2024-08-06 02:47:13,863][52668] Sum rewards: 63.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.090', 'AMMO4': '0.189', 'weapon4': '0.226', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.142', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:13,949][52649] DAMAGECOUNT value on done: 331901.0 [2024-08-06 02:47:13,960][52649] Sum rewards: 68.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO4': '0.118', 'weapon2': '0.152', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.634', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:14,396][52667] DAMAGECOUNT value on done: 343964.0 [2024-08-06 02:47:14,397][52667] Sum rewards: 70.170, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.147', 'AMMO4': '0.164', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.510', 'weapon2': '0.534', 'WEAPON3': '0.900', 'weapon3': '2.344', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '54.500'} [2024-08-06 02:47:15,137][52665] DAMAGECOUNT value on done: 335992.0 [2024-08-06 02:47:15,137][52665] Sum rewards: 78.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.317', 'AMMO5': '0.026', 'AMMO2': '0.077', 'weapon5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.256', 'weapon4': '0.298', 'AMMO4': '0.384', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '68.000'} [2024-08-06 02:47:15,783][52662] DAMAGECOUNT value on done: 339712.0 [2024-08-06 02:47:15,784][52662] Sum rewards: 77.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.064', 'AMMO4': '0.175', 'AMMO3': '0.230', 'weapon5': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:16,296][52650] Updated weights for policy 0, policy_version 40761 (0.0022) [2024-08-06 02:47:16,420][52669] DAMAGECOUNT value on done: 334741.0 [2024-08-06 02:47:16,422][52669] Sum rewards: 61.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.359', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO4': '0.206', 'AMMO3': '0.261', 'weapon2': '0.274', 'WEAPON5': '0.300', 'weapon4': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:16,516][52668] DAMAGECOUNT value on done: 333356.0 [2024-08-06 02:47:16,517][52668] Sum rewards: 75.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.912', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.116', 'weapon4': '0.152', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:17,026][52667] DAMAGECOUNT value on done: 347300.0 [2024-08-06 02:47:17,028][52667] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.303', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.242', 'weapon2': '0.394', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.382', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:17,104][52649] DAMAGECOUNT value on done: 327636.0 [2024-08-06 02:47:17,106][52649] Sum rewards: 66.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.086', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.184', 'AMMO3': '0.219', 'AMMO4': '0.230', 'weapon5': '0.236', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '55.000'} [2024-08-06 02:47:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 333938688. Throughput: 0: 4394.2. Samples: 83484050. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:47:17,794][52567] Avg episode reward: [(0, '67.888')] [2024-08-06 02:47:18,193][52665] DAMAGECOUNT value on done: 335066.0 [2024-08-06 02:47:18,193][52665] Sum rewards: 80.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.156', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '68.000'} [2024-08-06 02:47:18,775][52662] DAMAGECOUNT value on done: 352147.0 [2024-08-06 02:47:18,776][52662] Sum rewards: 71.267, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.138', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.122', 'AMMO4': '0.218', 'weapon5': '0.270', 'AMMO3': '0.280', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.980', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:19,363][52668] DAMAGECOUNT value on done: 342889.0 [2024-08-06 02:47:19,364][52668] Sum rewards: 64.642, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.159', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.126', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '53.000'} [2024-08-06 02:47:19,606][52669] DAMAGECOUNT value on done: 341124.0 [2024-08-06 02:47:19,606][52669] Sum rewards: 64.661, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.606', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.138', 'weapon4': '0.162', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.802', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:20,010][52667] DAMAGECOUNT value on done: 347104.0 [2024-08-06 02:47:20,011][52667] Sum rewards: 68.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.805', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.161', 'AMMO3': '0.181', 'weapon4': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '55.000'} [2024-08-06 02:47:20,117][52649] DAMAGECOUNT value on done: 334562.0 [2024-08-06 02:47:20,118][52649] Sum rewards: 64.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.230', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '53.000'} [2024-08-06 02:47:20,853][52650] Updated weights for policy 0, policy_version 40771 (0.0011) [2024-08-06 02:47:21,228][52665] DAMAGECOUNT value on done: 335503.0 [2024-08-06 02:47:21,230][52665] Sum rewards: 69.578, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.404', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.097', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.658', 'WEAPON3': '0.950', 'weapon3': '3.058', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '54.000'} [2024-08-06 02:47:21,828][52662] DAMAGECOUNT value on done: 337424.0 [2024-08-06 02:47:21,830][52662] Sum rewards: 77.104, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.976', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.312', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '65.000'} [2024-08-06 02:47:22,439][52668] DAMAGECOUNT value on done: 340212.0 [2024-08-06 02:47:22,440][52668] Sum rewards: 47.605, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.138', 'AMMO5': '0.025', 'AMMO2': '0.085', 'AMMO3': '0.208', 'weapon5': '0.290', 'weapon2': '0.368', 'AMMO4': '0.427', 'weapon4': '0.466', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'HITCOUNT': '2.360', 'weapon3': '2.556', 'DAMAGECOUNT': '11.157', 'FRAGCOUNT': '44.000'} [2024-08-06 02:47:22,445][52667] DAMAGECOUNT value on done: 347428.0 [2024-08-06 02:47:22,446][52667] Sum rewards: 64.197, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.427', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.149', 'weapon2': '0.220', 'weapon4': '0.306', 'WEAPON3': '0.900', 'HITCOUNT': '3.220', 'weapon3': '3.354', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:22,683][52669] DAMAGECOUNT value on done: 337613.0 [2024-08-06 02:47:22,683][52669] Sum rewards: 70.710, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.922', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.141', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.404', 'WEAPON3': '0.900', 'weapon3': '2.994', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '55.000'} [2024-08-06 02:47:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 334028800. Throughput: 0: 4398.9. Samples: 83510560. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:47:22,795][52567] Avg episode reward: [(0, '68.006')] [2024-08-06 02:47:23,273][52649] DAMAGECOUNT value on done: 331842.0 [2024-08-06 02:47:23,276][52649] Sum rewards: 83.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.024', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.388', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '68.000'} [2024-08-06 02:47:23,313][52660] DAMAGECOUNT value on done: 334987.0 [2024-08-06 02:47:23,313][52660] Sum rewards: 62.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.198', 'AMMO3': '0.207', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '51.500'} [2024-08-06 02:47:24,436][52665] DAMAGECOUNT value on done: 336874.0 [2024-08-06 02:47:24,437][52665] Sum rewards: 62.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon2': '0.184', 'AMMO3': '0.238', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:24,991][52662] DAMAGECOUNT value on done: 340787.0 [2024-08-06 02:47:24,993][52662] Sum rewards: 75.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.110', 'AMMO3': '0.211', 'AMMO4': '0.229', 'weapon5': '0.270', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:25,050][52658] DAMAGECOUNT value on done: 338526.0 [2024-08-06 02:47:25,052][52658] Sum rewards: 55.965, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.392', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.140', 'weapon5': '0.150', 'AMMO4': '0.236', 'AMMO3': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.880', 'weapon3': '3.080', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:25,276][52667] DAMAGECOUNT value on done: 338636.0 [2024-08-06 02:47:25,276][52667] Sum rewards: 74.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.819', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO4': '0.087', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '61.500'} [2024-08-06 02:47:25,311][52668] DAMAGECOUNT value on done: 334947.0 [2024-08-06 02:47:25,312][52668] Sum rewards: 67.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.124', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.193', 'weapon2': '0.286', 'weapon5': '0.334', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '55.500'} [2024-08-06 02:47:25,357][52650] Updated weights for policy 0, policy_version 40781 (0.0029) [2024-08-06 02:47:25,424][52669] DAMAGECOUNT value on done: 337537.0 [2024-08-06 02:47:25,425][52669] Sum rewards: 75.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.254', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon4': '0.188', 'AMMO3': '0.201', 'weapon5': '0.234', 'weapon2': '0.308', 'AMMO4': '0.315', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '62.500'} [2024-08-06 02:47:26,392][52649] DAMAGECOUNT value on done: 329029.0 [2024-08-06 02:47:26,393][52649] Sum rewards: 67.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.417', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.136', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:26,435][52660] DAMAGECOUNT value on done: 333473.0 [2024-08-06 02:47:26,435][52660] Sum rewards: 54.326, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.137', 'weapon4': '0.142', 'AMMO4': '0.210', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.848', 'WEAPON3': '0.850', 'HITCOUNT': '2.480', 'weapon3': '2.584', 'DAMAGECOUNT': '12.378', 'FRAGCOUNT': '45.000'} [2024-08-06 02:47:27,583][52665] DAMAGECOUNT value on done: 333711.0 [2024-08-06 02:47:27,585][52665] Sum rewards: 71.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.142', 'AMMO4': '0.188', 'AMMO3': '0.190', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:27,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 334110720. Throughput: 0: 4396.4. Samples: 83536830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:47:27,795][52567] Avg episode reward: [(0, '67.966')] [2024-08-06 02:47:27,898][52669] DAMAGECOUNT value on done: 338200.0 [2024-08-06 02:47:27,899][52669] Sum rewards: 61.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.545', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon7': '0.070', 'weapon5': '0.072', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '52.500'} [2024-08-06 02:47:27,956][52662] DAMAGECOUNT value on done: 343393.0 [2024-08-06 02:47:27,956][52662] Sum rewards: 70.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.864', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.126', 'AMMO3': '0.175', 'weapon2': '0.234', 'AMMO4': '0.246', 'weapon5': '0.348', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '2.988', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:27,986][52658] DAMAGECOUNT value on done: 340655.0 [2024-08-06 02:47:27,986][52658] Sum rewards: 73.392, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.465', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.128', 'AMMO4': '0.194', 'weapon2': '0.206', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.252', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:28,241][52667] DAMAGECOUNT value on done: 345352.0 [2024-08-06 02:47:28,243][52667] Sum rewards: 74.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.522', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.093', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:28,469][52668] DAMAGECOUNT value on done: 338657.0 [2024-08-06 02:47:28,471][52668] Sum rewards: 60.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.228', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.186', 'weapon5': '0.188', 'AMMO4': '0.197', 'weapon2': '0.260', 'weapon4': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '51.000'} [2024-08-06 02:47:29,567][52660] DAMAGECOUNT value on done: 344112.0 [2024-08-06 02:47:29,568][52660] Sum rewards: 71.196, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.188', 'AMMO5': '0.004', 'AMMO2': '0.030', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'AMMO3': '0.294', 'weapon4': '0.296', 'weapon2': '0.474', 'WEAPON3': '1.700', 'weapon3': '2.982', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:29,595][52649] DAMAGECOUNT value on done: 333371.0 [2024-08-06 02:47:29,597][52649] Sum rewards: 66.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon4': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:30,439][52650] Updated weights for policy 0, policy_version 40791 (0.0010) [2024-08-06 02:47:30,709][52658] DAMAGECOUNT value on done: 345655.0 [2024-08-06 02:47:30,709][52658] Sum rewards: 69.035, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.090', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon4': '0.156', 'AMMO4': '0.157', 'WEAPON5': '0.250', 'AMMO3': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.800', 'weapon3': '2.890', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:30,906][52669] DAMAGECOUNT value on done: 340821.0 [2024-08-06 02:47:30,906][52669] Sum rewards: 57.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.716', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.176', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:30,932][52665] DAMAGECOUNT value on done: 331786.0 [2024-08-06 02:47:30,933][52665] Sum rewards: 62.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO5': '0.018', 'AMMO2': '0.058', 'AMMO3': '0.164', 'weapon4': '0.210', 'AMMO4': '0.290', 'weapon5': '0.314', 'weapon2': '0.484', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:31,090][52662] DAMAGECOUNT value on done: 346980.0 [2024-08-06 02:47:31,091][52662] Sum rewards: 60.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.254', 'ARMOR': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:31,487][52668] DAMAGECOUNT value on done: 340201.0 [2024-08-06 02:47:31,496][52668] Sum rewards: 77.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.086', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:31,650][52794] DAMAGECOUNT value on done: 342603.0 [2024-08-06 02:47:31,651][52794] Sum rewards: 74.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.100', 'AMMO4': '0.141', 'weapon5': '0.182', 'AMMO3': '0.207', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.280', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:32,204][52660] DAMAGECOUNT value on done: 343907.0 [2024-08-06 02:47:32,205][52660] Sum rewards: 65.900, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.330', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.126', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.700', 'weapon3': '3.142', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:32,691][52649] DAMAGECOUNT value on done: 334427.0 [2024-08-06 02:47:32,691][52649] Sum rewards: 69.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.394', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.438', 'WEAPON3': '1.650', 'weapon3': '3.354', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 334200832. Throughput: 0: 4386.0. Samples: 83549710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:47:32,794][52567] Avg episode reward: [(0, '67.718')] [2024-08-06 02:47:33,322][52658] DAMAGECOUNT value on done: 343464.0 [2024-08-06 02:47:33,322][52658] Sum rewards: 82.082, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.684', 'AMMO5': '0.009', 'ARMOR': '0.012', 'AMMO2': '0.048', 'weapon5': '0.116', 'weapon4': '0.138', 'AMMO3': '0.178', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '67.000'} [2024-08-06 02:47:33,837][52668] DAMAGECOUNT value on done: 342963.0 [2024-08-06 02:47:33,838][52668] Sum rewards: 67.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.224', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:33,886][52669] DAMAGECOUNT value on done: 340114.0 [2024-08-06 02:47:33,886][52669] Sum rewards: 65.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.159', 'weapon5': '0.166', 'AMMO4': '0.205', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.840', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:33,899][52665] DAMAGECOUNT value on done: 332747.0 [2024-08-06 02:47:33,899][52665] Sum rewards: 73.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.644', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:34,027][52662] DAMAGECOUNT value on done: 339172.0 [2024-08-06 02:47:34,028][52662] Sum rewards: 57.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.058', 'weapon5': '0.064', 'AMMO4': '0.132', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:34,595][52794] DAMAGECOUNT value on done: 346025.0 [2024-08-06 02:47:34,596][52794] Sum rewards: 72.838, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.151', 'weapon4': '0.220', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '59.000'} [2024-08-06 02:47:34,804][52660] DAMAGECOUNT value on done: 339059.0 [2024-08-06 02:47:34,807][52660] Sum rewards: 82.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.516', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.146', 'AMMO3': '0.166', 'weapon2': '0.184', 'weapon5': '0.200', 'AMMO4': '0.257', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.262', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '65.000'} [2024-08-06 02:47:35,401][52650] Updated weights for policy 0, policy_version 40801 (0.0011) [2024-08-06 02:47:35,629][52658] DAMAGECOUNT value on done: 336715.0 [2024-08-06 02:47:35,630][52658] Sum rewards: 60.050, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.405', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.054', 'AMMO4': '0.137', 'AMMO3': '0.152', 'weapon4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '0.950', 'HITCOUNT': '2.680', 'weapon3': '3.042', 'DAMAGECOUNT': '13.713', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:35,909][52649] DAMAGECOUNT value on done: 335411.0 [2024-08-06 02:47:35,909][52649] Sum rewards: 68.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.133', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.474', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.046', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:36,731][52668] DAMAGECOUNT value on done: 337510.0 [2024-08-06 02:47:36,743][52668] Sum rewards: 73.896, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.634', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.088', 'AMMO3': '0.130', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.480', 'weapon4': '0.642', 'WEAPON3': '0.800', 'weapon3': '2.424', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:36,805][52669] DAMAGECOUNT value on done: 342005.0 [2024-08-06 02:47:36,806][52669] Sum rewards: 79.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.124', 'weapon5': '0.170', 'AMMO3': '0.208', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '66.000'} [2024-08-06 02:47:37,147][52665] DAMAGECOUNT value on done: 335491.0 [2024-08-06 02:47:37,147][52665] Sum rewards: 60.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.525', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'weapon4': '0.148', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.198', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '53.000'} [2024-08-06 02:47:37,263][52662] DAMAGECOUNT value on done: 351972.0 [2024-08-06 02:47:37,263][52662] Sum rewards: 65.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:37,778][52794] DAMAGECOUNT value on done: 340897.0 [2024-08-06 02:47:37,780][52794] Sum rewards: 79.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.227', 'AMMO4': '0.232', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '66.000'} [2024-08-06 02:47:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 334282752. Throughput: 0: 4382.9. Samples: 83575980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:47:37,794][52567] Avg episode reward: [(0, '67.856')] [2024-08-06 02:47:37,828][52660] DAMAGECOUNT value on done: 335439.0 [2024-08-06 02:47:37,830][52660] Sum rewards: 72.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.194', 'WEAPON3': '1.250', 'HITCOUNT': '3.540', 'weapon3': '3.624', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '59.000'} [2024-08-06 02:47:38,366][52658] DAMAGECOUNT value on done: 339027.0 [2024-08-06 02:47:38,368][52658] Sum rewards: 71.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.844', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.166', 'AMMO4': '0.175', 'weapon5': '0.198', 'AMMO3': '0.232', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '60.500'} [2024-08-06 02:47:38,915][52671] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:47:39,031][52649] DAMAGECOUNT value on done: 336322.0 [2024-08-06 02:47:39,032][52649] Sum rewards: 74.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.726', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.014', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.342', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:39,316][52650] Updated weights for policy 0, policy_version 40811 (0.0018) [2024-08-06 02:47:39,485][52669] DAMAGECOUNT value on done: 338857.0 [2024-08-06 02:47:39,486][52669] Sum rewards: 74.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.964', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.102', 'weapon5': '0.124', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.200', 'HITCOUNT': '3.400', 'weapon3': '3.402', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:39,801][52668] DAMAGECOUNT value on done: 331142.0 [2024-08-06 02:47:39,802][52668] Sum rewards: 71.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.678', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:40,085][52662] DAMAGECOUNT value on done: 344573.0 [2024-08-06 02:47:40,086][52662] Sum rewards: 69.200, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.130', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'weapon4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.418', 'WEAPON3': '1.750', 'weapon3': '3.128', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:40,283][52665] DAMAGECOUNT value on done: 337412.0 [2024-08-06 02:47:40,283][52665] Sum rewards: 74.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.940', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.196', 'weapon4': '0.206', 'AMMO4': '0.213', 'weapon5': '0.228', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:40,414][52794] DAMAGECOUNT value on done: 339758.0 [2024-08-06 02:47:40,416][52794] Sum rewards: 75.307, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:40,808][52660] DAMAGECOUNT value on done: 340232.0 [2024-08-06 02:47:40,810][52660] Sum rewards: 58.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.056', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.258', 'weapon4': '0.374', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '50.000'} [2024-08-06 02:47:41,329][52658] DAMAGECOUNT value on done: 344684.0 [2024-08-06 02:47:41,330][52658] Sum rewards: 68.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.202', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.134', 'AMMO3': '0.223', 'AMMO4': '0.239', 'weapon4': '0.256', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '59.000'} [2024-08-06 02:47:42,076][52649] DAMAGECOUNT value on done: 326915.0 [2024-08-06 02:47:42,084][52649] Sum rewards: 81.306, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.106', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.302', 'HEALTH': '0.540', 'WEAPON3': '1.050', 'weapon3': '3.390', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '65.000'} [2024-08-06 02:47:42,357][52811] DAMAGECOUNT value on done: 327879.0 [2024-08-06 02:47:42,358][52811] Sum rewards: 61.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.022', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.058', 'weapon4': '0.070', 'AMMO3': '0.144', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.764', 'WEAPON3': '0.950', 'HITCOUNT': '2.940', 'weapon3': '2.942', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 334372864. Throughput: 0: 4389.8. Samples: 83602550. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:47:42,795][52567] Avg episode reward: [(0, '68.409')] [2024-08-06 02:47:42,904][52668] DAMAGECOUNT value on done: 331521.0 [2024-08-06 02:47:42,904][52668] Sum rewards: 78.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.535', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.136', 'AMMO3': '0.177', 'AMMO4': '0.183', 'weapon2': '0.186', 'weapon5': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:43,000][52669] DAMAGECOUNT value on done: 344935.0 [2024-08-06 02:47:43,000][52669] Sum rewards: 75.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.076', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:43,051][52662] DAMAGECOUNT value on done: 343265.0 [2024-08-06 02:47:43,051][52662] Sum rewards: 62.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.135', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:43,557][52794] DAMAGECOUNT value on done: 338278.0 [2024-08-06 02:47:43,558][52794] Sum rewards: 70.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.638', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO4': '0.214', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.484', 'WEAPON3': '1.500', 'weapon3': '2.680', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:43,848][52660] DAMAGECOUNT value on done: 346871.0 [2024-08-06 02:47:43,850][52660] Sum rewards: 65.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.465', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.267', 'weapon2': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '3.290', 'weapon3': '3.370', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:44,172][52650] Updated weights for policy 0, policy_version 40821 (0.0044) [2024-08-06 02:47:44,442][52658] DAMAGECOUNT value on done: 333481.0 [2024-08-06 02:47:44,443][52658] Sum rewards: 73.643, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.172', 'weapon2': '0.182', 'AMMO3': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.504', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:44,481][52649] DAMAGECOUNT value on done: 332346.0 [2024-08-06 02:47:44,481][52649] Sum rewards: 64.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'ARMOR': '0.004', 'AMMO5': '0.013', 'weapon7': '0.050', 'AMMO2': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.168', 'AMMO3': '0.224', 'AMMO4': '0.261', 'weapon2': '0.282', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:44,939][52803] DAMAGECOUNT value on done: 318139.0 [2024-08-06 02:47:44,940][52803] Sum rewards: 63.157, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.074', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.118', 'AMMO4': '0.173', 'weapon2': '0.176', 'weapon5': '0.178', 'WEAPON4': '0.300', 'AMMO3': '0.311', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'HITCOUNT': '2.900', 'weapon3': '3.206', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:45,543][52811] DAMAGECOUNT value on done: 314137.0 [2024-08-06 02:47:45,544][52811] Sum rewards: 75.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.156', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '62.000'} [2024-08-06 02:47:45,553][52668] DAMAGECOUNT value on done: 331319.0 [2024-08-06 02:47:45,555][52668] Sum rewards: 75.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.400', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.106', 'AMMO4': '0.169', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '66.000'} [2024-08-06 02:47:45,905][52669] DAMAGECOUNT value on done: 339513.0 [2024-08-06 02:47:45,905][52669] Sum rewards: 72.926, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.875', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.137', 'weapon2': '0.744', 'WEAPON3': '0.900', 'weapon3': '3.188', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:46,455][52662] DAMAGECOUNT value on done: 339977.0 [2024-08-06 02:47:46,456][52662] Sum rewards: 67.682, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'HEALTH': '0.140', 'weapon5': '0.142', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'weapon4': '0.312', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:46,735][52660] DAMAGECOUNT value on done: 342651.0 [2024-08-06 02:47:46,735][52660] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.725', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.215', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:46,906][52794] DAMAGECOUNT value on done: 342005.0 [2024-08-06 02:47:46,907][52794] Sum rewards: 66.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.204', 'AMMO4': '0.210', 'AMMO3': '0.216', 'weapon4': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:47,116][52658] DAMAGECOUNT value on done: 350500.0 [2024-08-06 02:47:47,116][52658] Sum rewards: 75.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.272', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.072', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:47,442][52649] DAMAGECOUNT value on done: 329878.0 [2024-08-06 02:47:47,442][52649] Sum rewards: 66.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.460', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.408', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:47,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 334471168. Throughput: 0: 4382.2. Samples: 83615530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:47:47,795][52567] Avg episode reward: [(0, '68.670')] [2024-08-06 02:47:48,023][52803] DAMAGECOUNT value on done: 314344.0 [2024-08-06 02:47:48,023][52803] Sum rewards: 41.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.784', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.090', 'AMMO3': '0.183', 'AMMO4': '0.241', 'weapon5': '0.292', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.310', 'weapon3': '3.002', 'DAMAGECOUNT': '11.598', 'FRAGCOUNT': '35.000'} [2024-08-06 02:47:48,570][52668] DAMAGECOUNT value on done: 335749.0 [2024-08-06 02:47:48,572][52668] Sum rewards: 63.704, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.394', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'weapon2': '0.326', 'WEAPON3': '1.750', 'weapon3': '3.098', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '55.000'} [2024-08-06 02:47:48,684][52811] DAMAGECOUNT value on done: 318260.0 [2024-08-06 02:47:48,686][52811] Sum rewards: 54.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.777', 'ARMOR': '0.016', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.182', 'AMMO3': '0.244', 'weapon4': '0.256', 'AMMO4': '0.266', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '2.984', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '48.000'} [2024-08-06 02:47:48,771][52669] DAMAGECOUNT value on done: 338096.0 [2024-08-06 02:47:48,772][52669] Sum rewards: 58.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.812', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.198', 'weapon5': '0.198', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.040', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:48,978][52650] Updated weights for policy 0, policy_version 40831 (0.0012) [2024-08-06 02:47:49,210][52662] DAMAGECOUNT value on done: 335875.0 [2024-08-06 02:47:49,212][52662] Sum rewards: 73.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.104', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:49,520][52794] DAMAGECOUNT value on done: 347046.0 [2024-08-06 02:47:49,523][52794] Sum rewards: 60.044, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.379', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.037', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.348', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.384', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:49,692][52660] DAMAGECOUNT value on done: 336636.0 [2024-08-06 02:47:49,694][52660] Sum rewards: 76.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.197', 'weapon5': '0.216', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '61.000'} [2024-08-06 02:47:49,831][52658] DAMAGECOUNT value on done: 342883.0 [2024-08-06 02:47:49,833][52658] Sum rewards: 68.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'AMMO4': '0.242', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '2.832', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '58.000'} [2024-08-06 02:47:49,913][52659] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:47:50,140][52671] DAMAGECOUNT value on done: 345338.0 [2024-08-06 02:47:50,141][52671] Sum rewards: 68.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon5': '0.038', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.180', 'AMMO3': '0.199', 'weapon4': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.412', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:50,609][52795] DAMAGECOUNT value on done: 315944.0 [2024-08-06 02:47:50,610][52795] Sum rewards: 60.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.260', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.096', 'weapon4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.342', 'WEAPON3': '1.550', 'HITCOUNT': '2.890', 'weapon3': '3.174', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '53.000'} [2024-08-06 02:47:50,685][52649] DAMAGECOUNT value on done: 333134.0 [2024-08-06 02:47:50,685][52649] Sum rewards: 56.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.556', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.155', 'weapon2': '0.198', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.044', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '47.000'} [2024-08-06 02:47:51,190][52803] DAMAGECOUNT value on done: 318759.0 [2024-08-06 02:47:51,192][52803] Sum rewards: 73.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.943', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.106', 'AMMO4': '0.178', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.500'} [2024-08-06 02:47:51,297][52668] DAMAGECOUNT value on done: 339463.0 [2024-08-06 02:47:51,297][52668] Sum rewards: 66.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.258', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.118', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.592', 'WEAPON3': '1.600', 'weapon3': '2.992', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:51,298][52811] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:47:51,694][52811] DAMAGECOUNT value on done: 316484.0 [2024-08-06 02:47:51,696][52811] Sum rewards: 66.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.295', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.146', 'AMMO3': '0.190', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '55.000'} [2024-08-06 02:47:51,730][52669] DAMAGECOUNT value on done: 342838.0 [2024-08-06 02:47:51,735][52669] Sum rewards: 73.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.611', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.191', 'weapon5': '0.210', 'AMMO4': '0.262', 'weapon4': '0.312', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '58.500'} [2024-08-06 02:47:52,167][52660] DAMAGECOUNT value on done: 347454.0 [2024-08-06 02:47:52,175][52660] Sum rewards: 75.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.622', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.132', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO4': '0.238', 'AMMO3': '0.257', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.184', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:52,591][52794] DAMAGECOUNT value on done: 340532.0 [2024-08-06 02:47:52,592][52794] Sum rewards: 67.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.731', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.086', 'AMMO4': '0.180', 'weapon5': '0.182', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 334544896. Throughput: 0: 4380.0. Samples: 83641710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:47:52,794][52567] Avg episode reward: [(0, '68.464')] [2024-08-06 02:47:53,066][52658] DAMAGECOUNT value on done: 349534.0 [2024-08-06 02:47:53,068][52658] Sum rewards: 79.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.074', 'weapon4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO4': '0.236', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.380', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '68.000'} [2024-08-06 02:47:53,191][52671] DAMAGECOUNT value on done: 341161.0 [2024-08-06 02:47:53,193][52671] Sum rewards: 53.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.466', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.272', 'AMMO3': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '2.680', 'weapon3': '3.100', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '49.000'} [2024-08-06 02:47:53,417][52649] DAMAGECOUNT value on done: 337255.0 [2024-08-06 02:47:53,418][52649] Sum rewards: 59.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.044', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.340', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.086', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:53,772][52650] Updated weights for policy 0, policy_version 40841 (0.0013) [2024-08-06 02:47:53,855][52668] DAMAGECOUNT value on done: 342190.0 [2024-08-06 02:47:53,857][52668] Sum rewards: 81.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.068', 'AMMO3': '0.200', 'AMMO4': '0.204', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '66.000'} [2024-08-06 02:47:53,872][52795] DAMAGECOUNT value on done: 309756.0 [2024-08-06 02:47:53,883][52795] Sum rewards: 71.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.022', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:54,483][52803] DAMAGECOUNT value on done: 320837.0 [2024-08-06 02:47:54,486][52803] Sum rewards: 67.300, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.158', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'HEALTH': '0.270', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '54.000'} [2024-08-06 02:47:54,774][52660] DAMAGECOUNT value on done: 333334.0 [2024-08-06 02:47:54,774][52660] Sum rewards: 63.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.468', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.122', 'AMMO4': '0.141', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '54.000'} [2024-08-06 02:47:54,849][52811] DAMAGECOUNT value on done: 320626.0 [2024-08-06 02:47:54,850][52811] Sum rewards: 75.197, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '65.000'} [2024-08-06 02:47:54,949][52669] DAMAGECOUNT value on done: 347660.0 [2024-08-06 02:47:54,950][52669] Sum rewards: 74.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.142', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.096', 'weapon4': '0.098', 'AMMO3': '0.260', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:55,386][52794] DAMAGECOUNT value on done: 346593.0 [2024-08-06 02:47:55,387][52794] Sum rewards: 74.960, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.558', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO3': '0.171', 'AMMO4': '0.171', 'weapon4': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:55,855][52671] DAMAGECOUNT value on done: 341206.0 [2024-08-06 02:47:55,855][52671] Sum rewards: 47.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.342', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '2.260', 'weapon3': '2.840', 'DAMAGECOUNT': '11.937', 'FRAGCOUNT': '42.000'} [2024-08-06 02:47:55,907][52658] DAMAGECOUNT value on done: 335314.0 [2024-08-06 02:47:55,908][52658] Sum rewards: 76.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.283', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon2': '0.178', 'weapon5': '0.196', 'AMMO3': '0.215', 'weapon4': '0.232', 'AMMO4': '0.242', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '63.000'} [2024-08-06 02:47:56,395][52668] DAMAGECOUNT value on done: 342181.0 [2024-08-06 02:47:56,397][52668] Sum rewards: 66.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.106', 'weapon4': '0.162', 'AMMO3': '0.165', 'AMMO4': '0.264', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.070', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:56,525][52649] DAMAGECOUNT value on done: 337577.0 [2024-08-06 02:47:56,525][52649] Sum rewards: 78.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.219', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.226', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.386', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '65.000'} [2024-08-06 02:47:57,022][52795] DAMAGECOUNT value on done: 310458.0 [2024-08-06 02:47:57,024][52795] Sum rewards: 68.368, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.355', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.542', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.106', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '56.000'} [2024-08-06 02:47:57,391][52660] DAMAGECOUNT value on done: 334842.0 [2024-08-06 02:47:57,399][52660] Sum rewards: 60.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.236', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.052', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.270', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.402', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:57,687][52803] DAMAGECOUNT value on done: 321213.0 [2024-08-06 02:47:57,691][52803] Sum rewards: 68.603, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.024', 'AMMO2': '0.053', 'weapon4': '0.126', 'AMMO3': '0.209', 'AMMO4': '0.266', 'weapon5': '0.294', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:57,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 334635008. Throughput: 0: 4377.1. Samples: 83667890. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 02:47:57,794][52567] Avg episode reward: [(0, '68.535')] [2024-08-06 02:47:57,941][52811] DAMAGECOUNT value on done: 322912.0 [2024-08-06 02:47:57,943][52811] Sum rewards: 67.712, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.172', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.228', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '55.000'} [2024-08-06 02:47:58,136][52669] DAMAGECOUNT value on done: 357769.0 [2024-08-06 02:47:58,137][52669] Sum rewards: 79.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.164', 'weapon5': '0.202', 'AMMO3': '0.210', 'weapon2': '0.226', 'AMMO4': '0.325', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '64.500'} [2024-08-06 02:47:58,296][52794] DAMAGECOUNT value on done: 343859.0 [2024-08-06 02:47:58,300][52794] Sum rewards: 72.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.582', 'AMMO5': '0.018', 'AMMO2': '0.066', 'weapon5': '0.182', 'AMMO3': '0.237', 'weapon4': '0.244', 'AMMO4': '0.330', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '60.000'} [2024-08-06 02:47:58,724][52650] Updated weights for policy 0, policy_version 40851 (0.0013) [2024-08-06 02:47:58,863][52658] DAMAGECOUNT value on done: 343945.0 [2024-08-06 02:47:58,863][52658] Sum rewards: 70.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon4': '0.186', 'weapon5': '0.260', 'AMMO3': '0.261', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.870', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '57.000'} [2024-08-06 02:47:59,122][52668] DAMAGECOUNT value on done: 338017.0 [2024-08-06 02:47:59,123][52668] Sum rewards: 60.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO4': '0.154', 'AMMO3': '0.225', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.244', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '52.000'} [2024-08-06 02:47:59,234][52671] DAMAGECOUNT value on done: 341343.0 [2024-08-06 02:47:59,235][52671] Sum rewards: 63.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.516', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.352', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.336', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:00,138][52795] DAMAGECOUNT value on done: 314513.0 [2024-08-06 02:48:00,140][52795] Sum rewards: 66.888, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.102', 'AMMO5': '0.025', 'AMMO2': '0.080', 'weapon4': '0.150', 'AMMO3': '0.249', 'weapon5': '0.274', 'weapon2': '0.352', 'AMMO4': '0.398', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:00,365][52660] DAMAGECOUNT value on done: 346726.0 [2024-08-06 02:48:00,365][52660] Sum rewards: 76.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO3': '0.221', 'AMMO4': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.000'} [2024-08-06 02:48:00,792][52803] DAMAGECOUNT value on done: 314604.0 [2024-08-06 02:48:00,792][52803] Sum rewards: 67.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.766', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.092', 'AMMO3': '0.164', 'weapon5': '0.188', 'AMMO4': '0.195', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.190', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:01,081][52811] DAMAGECOUNT value on done: 318303.0 [2024-08-06 02:48:01,081][52811] Sum rewards: 67.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.534', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.124', 'weapon5': '0.194', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:01,276][52669] DAMAGECOUNT value on done: 342009.0 [2024-08-06 02:48:01,276][52669] Sum rewards: 74.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.177', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.530', 'WEAPON3': '0.900', 'weapon3': '2.770', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '57.500'} [2024-08-06 02:48:01,327][52794] DAMAGECOUNT value on done: 338877.0 [2024-08-06 02:48:01,328][52794] Sum rewards: 68.413, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.036', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.034', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO3': '0.144', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.544', 'WEAPON3': '0.900', 'weapon3': '3.164', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:01,848][52671] DAMAGECOUNT value on done: 348404.0 [2024-08-06 02:48:01,848][52671] Sum rewards: 59.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.019', 'AMMO2': '0.062', 'AMMO3': '0.174', 'weapon2': '0.216', 'weapon5': '0.226', 'AMMO4': '0.311', 'weapon4': '0.488', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '51.000'} [2024-08-06 02:48:02,005][52658] DAMAGECOUNT value on done: 339224.0 [2024-08-06 02:48:02,005][52658] Sum rewards: 63.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.722', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.372', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 334725120. Throughput: 0: 4378.2. Samples: 83681070. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 02:48:02,794][52567] Avg episode reward: [(0, '68.684')] [2024-08-06 02:48:02,871][52660] DAMAGECOUNT value on done: 348403.0 [2024-08-06 02:48:02,872][52660] Sum rewards: 78.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.305', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.148', 'weapon2': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'weapon3': '3.478', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '67.000'} [2024-08-06 02:48:03,076][52650] Updated weights for policy 0, policy_version 40861 (0.0019) [2024-08-06 02:48:03,207][52795] DAMAGECOUNT value on done: 315766.0 [2024-08-06 02:48:03,208][52795] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.645', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.112', 'AMMO4': '0.163', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.244', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:03,895][52803] DAMAGECOUNT value on done: 313956.0 [2024-08-06 02:48:03,897][52803] Sum rewards: 68.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.014', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.175', 'weapon5': '0.204', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.562', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:04,225][52811] DAMAGECOUNT value on done: 319289.0 [2024-08-06 02:48:04,225][52811] Sum rewards: 75.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.377', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.111', 'weapon4': '0.122', 'WEAPON5': '0.150', 'weapon2': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.700', 'weapon3': '3.404', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '66.000'} [2024-08-06 02:48:04,274][52658] DAMAGECOUNT value on done: 337097.0 [2024-08-06 02:48:04,274][52658] Sum rewards: 79.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.580', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.044', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon5': '0.170', 'AMMO4': '0.173', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.000', 'weapon3': '3.158', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '63.000'} [2024-08-06 02:48:04,383][52669] DAMAGECOUNT value on done: 344010.0 [2024-08-06 02:48:04,385][52669] Sum rewards: 62.454, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.746', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.250', 'AMMO3': '0.253', 'AMMO4': '0.263', 'weapon4': '0.324', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.682', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '54.000'} [2024-08-06 02:48:04,507][52794] DAMAGECOUNT value on done: 342851.0 [2024-08-06 02:48:04,508][52794] Sum rewards: 64.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon7': '0.058', 'AMMO4': '0.069', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon2': '0.264', 'weapon4': '0.794', 'WEAPON3': '1.050', 'weapon3': '2.524', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:05,039][52671] DAMAGECOUNT value on done: 339294.0 [2024-08-06 02:48:05,043][52671] Sum rewards: 76.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.463', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.189', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:05,661][52660] DAMAGECOUNT value on done: 335527.0 [2024-08-06 02:48:05,663][52660] Sum rewards: 66.378, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.628', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.224', 'weapon4': '0.226', 'AMMO4': '0.275', 'weapon2': '0.278', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.898', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.000'} [2024-08-06 02:48:06,311][52795] DAMAGECOUNT value on done: 314805.0 [2024-08-06 02:48:06,311][52795] Sum rewards: 64.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.142', 'weapon7': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO4': '0.193', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.215', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:07,076][52803] DAMAGECOUNT value on done: 314345.0 [2024-08-06 02:48:07,078][52803] Sum rewards: 80.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon5': '0.122', 'AMMO3': '0.158', 'AMMO4': '0.262', 'weapon4': '0.278', 'weapon2': '0.360', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '67.000'} [2024-08-06 02:48:07,241][52669] DAMAGECOUNT value on done: 343101.0 [2024-08-06 02:48:07,242][52669] Sum rewards: 64.494, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.170', 'weapon4': '0.252', 'AMMO4': '0.269', 'weapon5': '0.280', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '51.000'} [2024-08-06 02:48:07,337][52811] DAMAGECOUNT value on done: 326295.0 [2024-08-06 02:48:07,337][52811] Sum rewards: 53.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.146', 'AMMO3': '0.235', 'AMMO4': '0.262', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '46.000'} [2024-08-06 02:48:07,563][52658] DAMAGECOUNT value on done: 335170.0 [2024-08-06 02:48:07,563][52658] Sum rewards: 66.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.908', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.142', 'AMMO4': '0.182', 'AMMO3': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:07,647][52650] Updated weights for policy 0, policy_version 40871 (0.0012) [2024-08-06 02:48:07,703][52794] DAMAGECOUNT value on done: 334679.0 [2024-08-06 02:48:07,705][52794] Sum rewards: 87.988, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'HEALTH': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.018', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.358', 'WEAPON3': '0.900', 'weapon3': '3.364', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '70.000'} [2024-08-06 02:48:07,703][52671] DAMAGECOUNT value on done: 344194.0 [2024-08-06 02:48:07,705][52671] Sum rewards: 60.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.555', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.164', 'weapon2': '0.508', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.298', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '48.000'} [2024-08-06 02:48:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 334815232. Throughput: 0: 4372.2. Samples: 83707310. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 02:48:07,794][52567] Avg episode reward: [(0, '68.910')] [2024-08-06 02:48:08,465][52660] DAMAGECOUNT value on done: 339843.0 [2024-08-06 02:48:08,468][52660] Sum rewards: 69.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.932', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.164', 'weapon2': '0.184', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.346', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:08,697][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:48:09,460][52669] DAMAGECOUNT value on done: 346183.0 [2024-08-06 02:48:09,461][52669] Sum rewards: 68.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.171', 'weapon4': '0.178', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:09,477][52795] DAMAGECOUNT value on done: 321651.0 [2024-08-06 02:48:09,478][52795] Sum rewards: 82.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.300', 'weapon3': '3.550', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '67.000'} [2024-08-06 02:48:10,349][52803] DAMAGECOUNT value on done: 318415.0 [2024-08-06 02:48:10,350][52803] Sum rewards: 55.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.114', 'AMMO4': '0.149', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.324', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.008', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '46.000'} [2024-08-06 02:48:10,416][52658] DAMAGECOUNT value on done: 347123.0 [2024-08-06 02:48:10,416][52658] Sum rewards: 57.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.365', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.162', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '48.000'} [2024-08-06 02:48:10,439][52811] DAMAGECOUNT value on done: 317270.0 [2024-08-06 02:48:10,440][52811] Sum rewards: 59.102, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.913', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.064', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'weapon2': '0.294', 'AMMO3': '0.297', 'WEAPON3': '1.850', 'HITCOUNT': '2.910', 'weapon3': '3.320', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:10,595][52671] DAMAGECOUNT value on done: 343869.0 [2024-08-06 02:48:10,595][52671] Sum rewards: 70.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.213', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:10,995][52794] DAMAGECOUNT value on done: 350208.0 [2024-08-06 02:48:10,996][52794] Sum rewards: 84.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.839', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.178', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '71.000'} [2024-08-06 02:48:11,157][52660] DAMAGECOUNT value on done: 333901.0 [2024-08-06 02:48:11,157][52660] Sum rewards: 67.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.722', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.176', 'AMMO3': '0.247', 'weapon4': '0.252', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:12,487][52650] Updated weights for policy 0, policy_version 40881 (0.0019) [2024-08-06 02:48:12,663][52795] DAMAGECOUNT value on done: 317946.0 [2024-08-06 02:48:12,666][52795] Sum rewards: 74.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.012', 'ARMOR': '0.024', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.168', 'weapon5': '0.172', 'AMMO3': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.218', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 02:48:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 334905344. Throughput: 0: 4372.9. Samples: 83733610. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 02:48:12,794][52567] Avg episode reward: [(0, '68.679')] [2024-08-06 02:48:12,917][52658] DAMAGECOUNT value on done: 337698.0 [2024-08-06 02:48:12,919][52658] Sum rewards: 65.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.106', 'weapon2': '0.172', 'AMMO4': '0.192', 'weapon4': '0.210', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.300', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:13,467][52803] DAMAGECOUNT value on done: 313560.0 [2024-08-06 02:48:13,469][52803] Sum rewards: 59.212, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.065', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.424', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '52.000'} [2024-08-06 02:48:13,495][52811] DAMAGECOUNT value on done: 319428.0 [2024-08-06 02:48:13,499][52811] Sum rewards: 66.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.168', 'weapon4': '0.200', 'weapon2': '0.222', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:13,757][52671] DAMAGECOUNT value on done: 337305.0 [2024-08-06 02:48:13,760][52671] Sum rewards: 61.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.182', 'weapon2': '0.192', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.582', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.000'} [2024-08-06 02:48:13,897][52660] DAMAGECOUNT value on done: 341670.0 [2024-08-06 02:48:13,899][52660] Sum rewards: 70.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.689', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.230', 'weapon2': '0.304', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.278', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:13,948][52794] DAMAGECOUNT value on done: 337638.0 [2024-08-06 02:48:13,948][52794] Sum rewards: 82.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.106', 'AMMO4': '0.187', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.369', 'FRAGCOUNT': '67.000'} [2024-08-06 02:48:14,253][52664] DAMAGECOUNT value on done: 353394.0 [2024-08-06 02:48:14,254][52664] Sum rewards: 66.363, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.084', 'weapon5': '0.138', 'AMMO4': '0.141', 'weapon2': '0.238', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.090', 'weapon3': '3.198', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:15,677][52658] DAMAGECOUNT value on done: 342577.0 [2024-08-06 02:48:15,678][52658] Sum rewards: 65.139, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.880', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.096', 'weapon4': '0.196', 'weapon2': '0.260', 'AMMO4': '0.270', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '3.100', 'weapon3': '3.182', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '59.500'} [2024-08-06 02:48:15,755][52795] DAMAGECOUNT value on done: 306098.0 [2024-08-06 02:48:15,756][52795] Sum rewards: 73.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.122', 'weapon5': '0.128', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.200', 'weapon3': '3.362', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:16,447][52811] DAMAGECOUNT value on done: 324568.0 [2024-08-06 02:48:16,449][52811] Sum rewards: 62.353, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.067', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon4': '0.142', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.186', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:16,551][52803] DAMAGECOUNT value on done: 322340.0 [2024-08-06 02:48:16,554][52803] Sum rewards: 74.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:16,641][52660] DAMAGECOUNT value on done: 336229.0 [2024-08-06 02:48:16,641][52660] Sum rewards: 70.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.714', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.172', 'AMMO3': '0.184', 'weapon4': '0.222', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:16,685][52794] DAMAGECOUNT value on done: 351365.0 [2024-08-06 02:48:16,687][52794] Sum rewards: 82.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.740', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '68.000'} [2024-08-06 02:48:16,906][52671] DAMAGECOUNT value on done: 343499.0 [2024-08-06 02:48:16,907][52671] Sum rewards: 65.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.244', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon2': '0.184', 'AMMO3': '0.214', 'weapon4': '0.264', 'WEAPON3': '1.300', 'HITCOUNT': '3.350', 'weapon3': '3.410', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '54.000'} [2024-08-06 02:48:17,026][52650] Updated weights for policy 0, policy_version 40891 (0.0011) [2024-08-06 02:48:17,587][52664] DAMAGECOUNT value on done: 356169.0 [2024-08-06 02:48:17,587][52664] Sum rewards: 66.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.312', 'weapon4': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '54.000'} [2024-08-06 02:48:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 334987264. Throughput: 0: 4375.3. Samples: 83746600. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 02:48:17,794][52567] Avg episode reward: [(0, '68.396')] [2024-08-06 02:48:18,683][52658] DAMAGECOUNT value on done: 345835.0 [2024-08-06 02:48:18,684][52658] Sum rewards: 59.284, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.047', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon2': '0.182', 'weapon4': '0.216', 'AMMO4': '0.242', 'AMMO3': '0.290', 'WEAPON4': '0.450', 'ARMOR': '0.494', 'WEAPON3': '1.800', 'HITCOUNT': '2.950', 'weapon3': '3.240', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '54.000'} [2024-08-06 02:48:18,813][52795] DAMAGECOUNT value on done: 322123.0 [2024-08-06 02:48:18,814][52795] Sum rewards: 73.209, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.870', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.120', 'AMMO4': '0.184', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '3.124', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '65.000'} [2024-08-06 02:48:19,418][52671] DAMAGECOUNT value on done: 348375.0 [2024-08-06 02:48:19,418][52671] Sum rewards: 71.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.282', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.236', 'WEAPON3': '1.500', 'weapon3': '3.484', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '61.000'} [2024-08-06 02:48:19,586][52803] DAMAGECOUNT value on done: 320077.0 [2024-08-06 02:48:19,586][52803] Sum rewards: 72.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.887', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.074', 'weapon5': '0.206', 'AMMO3': '0.213', 'weapon2': '0.214', 'AMMO4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '61.000'} [2024-08-06 02:48:19,641][52811] DAMAGECOUNT value on done: 314875.0 [2024-08-06 02:48:19,642][52811] Sum rewards: 61.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.098', 'weapon4': '0.140', 'AMMO3': '0.206', 'weapon2': '0.242', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.302', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '52.000'} [2024-08-06 02:48:19,717][52794] DAMAGECOUNT value on done: 344065.0 [2024-08-06 02:48:19,717][52794] Sum rewards: 75.445, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.280', 'WEAPON3': '1.350', 'HITCOUNT': '3.540', 'weapon3': '3.564', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:20,122][52664] DAMAGECOUNT value on done: 356643.0 [2024-08-06 02:48:20,124][52664] Sum rewards: 57.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.305', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.094', 'AMMO3': '0.196', 'weapon5': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.142', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '49.000'} [2024-08-06 02:48:21,649][52650] Updated weights for policy 0, policy_version 40901 (0.0014) [2024-08-06 02:48:21,934][52795] DAMAGECOUNT value on done: 312779.0 [2024-08-06 02:48:21,935][52795] Sum rewards: 63.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.112', 'weapon4': '0.116', 'AMMO4': '0.231', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.082', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:22,077][52671] DAMAGECOUNT value on done: 340718.0 [2024-08-06 02:48:22,079][52671] Sum rewards: 66.425, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.372', 'WEAPON3': '0.900', 'weapon3': '3.102', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:22,756][52811] DAMAGECOUNT value on done: 321719.0 [2024-08-06 02:48:22,757][52811] Sum rewards: 72.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon4': '0.098', 'weapon5': '0.238', 'AMMO3': '0.247', 'AMMO4': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '1.500', 'weapon3': '2.566', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 335077376. Throughput: 0: 4380.0. Samples: 83773080. Policy #0 lag: (min: 2.0, avg: 4.9, max: 9.0) [2024-08-06 02:48:22,794][52803] DAMAGECOUNT value on done: 316193.0 [2024-08-06 02:48:22,795][52567] Avg episode reward: [(0, '68.120')] [2024-08-06 02:48:22,797][52803] Sum rewards: 73.185, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.125', 'weapon5': '0.148', 'AMMO3': '0.204', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.396', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.292', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:22,817][52794] DAMAGECOUNT value on done: 343921.0 [2024-08-06 02:48:22,819][52794] Sum rewards: 70.314, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.088', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.098', 'weapon5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.236', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:23,186][52664] DAMAGECOUNT value on done: 351797.0 [2024-08-06 02:48:23,187][52664] Sum rewards: 72.051, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.130', 'weapon4': '0.148', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:24,461][52671] DAMAGECOUNT value on done: 353256.0 [2024-08-06 02:48:24,465][52671] Sum rewards: 76.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.656', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:25,029][52795] DAMAGECOUNT value on done: 312575.0 [2024-08-06 02:48:25,029][52795] Sum rewards: 62.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.106', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.220', 'AMMO4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:25,731][52794] DAMAGECOUNT value on done: 352348.0 [2024-08-06 02:48:25,733][52794] Sum rewards: 68.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.068', 'AMMO3': '0.176', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:25,757][52803] DAMAGECOUNT value on done: 322043.0 [2024-08-06 02:48:25,758][52803] Sum rewards: 74.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO4': '0.181', 'weapon4': '0.210', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.000'} [2024-08-06 02:48:25,878][52811] DAMAGECOUNT value on done: 319348.0 [2024-08-06 02:48:25,878][52811] Sum rewards: 61.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.352', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO4': '0.186', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.000'} [2024-08-06 02:48:25,914][52664] DAMAGECOUNT value on done: 352054.0 [2024-08-06 02:48:25,914][52664] Sum rewards: 69.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.216', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon4': '0.260', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:26,642][52650] Updated weights for policy 0, policy_version 40911 (0.0011) [2024-08-06 02:48:26,876][52671] DAMAGECOUNT value on done: 340758.0 [2024-08-06 02:48:26,877][52671] Sum rewards: 76.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.354', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '65.000'} [2024-08-06 02:48:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 335167488. Throughput: 0: 4377.5. Samples: 83799540. Policy #0 lag: (min: 2.0, avg: 4.9, max: 9.0) [2024-08-06 02:48:27,795][52567] Avg episode reward: [(0, '68.829')] [2024-08-06 02:48:27,808][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040915_335175680.pth... [2024-08-06 02:48:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040401_330964992.pth [2024-08-06 02:48:28,218][52795] DAMAGECOUNT value on done: 309557.0 [2024-08-06 02:48:28,218][52795] Sum rewards: 57.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.160', 'AMMO3': '0.161', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '47.000'} [2024-08-06 02:48:28,432][52794] DAMAGECOUNT value on done: 342757.0 [2024-08-06 02:48:28,434][52794] Sum rewards: 61.642, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.870', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.136', 'weapon4': '0.152', 'AMMO4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.216', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '54.000'} [2024-08-06 02:48:28,899][52803] DAMAGECOUNT value on done: 316404.0 [2024-08-06 02:48:28,899][52803] Sum rewards: 80.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.083', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '66.000'} [2024-08-06 02:48:28,919][52664] DAMAGECOUNT value on done: 353785.0 [2024-08-06 02:48:28,920][52664] Sum rewards: 71.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.356', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.149', 'weapon4': '0.152', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:29,010][52811] DAMAGECOUNT value on done: 317365.0 [2024-08-06 02:48:29,011][52811] Sum rewards: 79.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.256', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.082', 'AMMO4': '0.133', 'weapon5': '0.174', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '65.000'} [2024-08-06 02:48:30,106][52614] Signal inference workers to stop experience collection... (7400 times) [2024-08-06 02:48:30,107][52614] Signal inference workers to resume experience collection... (7400 times) [2024-08-06 02:48:30,190][52671] DAMAGECOUNT value on done: 334143.0 [2024-08-06 02:48:30,191][52671] Sum rewards: 55.226, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.331', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon5': '0.176', 'weapon4': '0.294', 'weapon2': '0.320', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '3.064', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '44.500'} [2024-08-06 02:48:30,199][52650] InferenceWorker_p0-w0: stopping experience collection (7400 times) [2024-08-06 02:48:30,217][52650] InferenceWorker_p0-w0: resuming experience collection (7400 times) [2024-08-06 02:48:30,976][52650] Updated weights for policy 0, policy_version 40921 (0.0013) [2024-08-06 02:48:31,434][52795] DAMAGECOUNT value on done: 317875.0 [2024-08-06 02:48:31,434][52795] Sum rewards: 72.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.936', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.138', 'AMMO3': '0.178', 'AMMO4': '0.233', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '59.000'} [2024-08-06 02:48:31,533][52664] DAMAGECOUNT value on done: 355411.0 [2024-08-06 02:48:31,534][52664] Sum rewards: 72.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '61.000'} [2024-08-06 02:48:32,172][52811] DAMAGECOUNT value on done: 319011.0 [2024-08-06 02:48:32,173][52811] Sum rewards: 71.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.805', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.362', 'weapon4': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.834', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '61.000'} [2024-08-06 02:48:32,239][52803] DAMAGECOUNT value on done: 315473.0 [2024-08-06 02:48:32,239][52803] Sum rewards: 73.357, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.166', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.256', 'WEAPON3': '1.400', 'HITCOUNT': '3.460', 'weapon3': '3.504', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '61.000'} [2024-08-06 02:48:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 335249408. Throughput: 0: 4373.1. Samples: 83812320. Policy #0 lag: (min: 2.0, avg: 4.9, max: 9.0) [2024-08-06 02:48:32,794][52567] Avg episode reward: [(0, '69.043')] [2024-08-06 02:48:33,000][52671] DAMAGECOUNT value on done: 347770.0 [2024-08-06 02:48:33,001][52671] Sum rewards: 71.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.331', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.152', 'weapon5': '0.208', 'AMMO3': '0.242', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:33,284][52660] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:48:34,458][52664] DAMAGECOUNT value on done: 345287.0 [2024-08-06 02:48:34,462][52664] Sum rewards: 67.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.905', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.162', 'weapon4': '0.212', 'AMMO4': '0.214', 'AMMO3': '0.245', 'weapon2': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:34,648][52795] DAMAGECOUNT value on done: 310102.0 [2024-08-06 02:48:34,650][52795] Sum rewards: 81.437, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.725', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.128', 'AMMO3': '0.158', 'weapon2': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '64.000'} [2024-08-06 02:48:35,211][52803] DAMAGECOUNT value on done: 325821.0 [2024-08-06 02:48:35,214][52803] Sum rewards: 67.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.204', 'AMMO4': '0.209', 'weapon4': '0.230', 'weapon5': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:35,341][52811] DAMAGECOUNT value on done: 320316.0 [2024-08-06 02:48:35,342][52811] Sum rewards: 56.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.028', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.174', 'weapon5': '0.176', 'AMMO4': '0.180', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.810', 'WEAPON3': '1.100', 'weapon3': '2.572', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '12.840', 'FRAGCOUNT': '49.000'} [2024-08-06 02:48:35,758][52650] Updated weights for policy 0, policy_version 40931 (0.0035) [2024-08-06 02:48:36,067][52671] DAMAGECOUNT value on done: 348134.0 [2024-08-06 02:48:36,067][52671] Sum rewards: 71.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.118', 'AMMO4': '0.198', 'AMMO3': '0.205', 'weapon5': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '59.000'} [2024-08-06 02:48:37,309][52664] DAMAGECOUNT value on done: 357547.0 [2024-08-06 02:48:37,310][52664] Sum rewards: 58.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.945', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.064', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.448', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.082', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '52.000'} [2024-08-06 02:48:37,476][52664] Large shaping reward -2.520 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0)] [2024-08-06 02:48:37,699][52666] DAMAGECOUNT value on done: 342766.0 [2024-08-06 02:48:37,700][52666] Sum rewards: 74.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.648', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:37,777][52795] DAMAGECOUNT value on done: 324071.0 [2024-08-06 02:48:37,777][52795] Sum rewards: 74.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.118', 'AMMO3': '0.164', 'weapon5': '0.178', 'AMMO4': '0.245', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.018', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 335339520. Throughput: 0: 4372.7. Samples: 83838480. Policy #0 lag: (min: 2.0, avg: 4.9, max: 9.0) [2024-08-06 02:48:37,794][52567] Avg episode reward: [(0, '68.865')] [2024-08-06 02:48:38,375][52803] DAMAGECOUNT value on done: 317501.0 [2024-08-06 02:48:38,384][52803] Sum rewards: 66.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.110', 'weapon5': '0.170', 'AMMO3': '0.216', 'AMMO4': '0.220', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:38,433][52811] DAMAGECOUNT value on done: 316744.0 [2024-08-06 02:48:38,433][52811] Sum rewards: 64.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.111', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.156', 'weapon2': '0.418', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '3.256', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:39,317][52671] DAMAGECOUNT value on done: 350186.0 [2024-08-06 02:48:39,319][52671] Sum rewards: 72.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO3': '0.179', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.396', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:39,589][52664] DAMAGECOUNT value on done: 351697.0 [2024-08-06 02:48:39,591][52664] Sum rewards: 59.944, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.722', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.750', 'HITCOUNT': '3.180', 'weapon3': '3.230', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:40,125][52666] DAMAGECOUNT value on done: 345864.0 [2024-08-06 02:48:40,127][52666] Sum rewards: 69.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.428', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.348', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '59.000'} [2024-08-06 02:48:40,344][52650] Updated weights for policy 0, policy_version 40941 (0.0014) [2024-08-06 02:48:40,894][52795] DAMAGECOUNT value on done: 317077.0 [2024-08-06 02:48:40,894][52795] Sum rewards: 59.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO3': '0.190', 'weapon5': '0.192', 'AMMO4': '0.220', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '48.000'} [2024-08-06 02:48:41,419][52803] DAMAGECOUNT value on done: 322958.0 [2024-08-06 02:48:41,423][52803] Sum rewards: 72.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.174', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.436', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:41,472][52811] DAMAGECOUNT value on done: 322211.0 [2024-08-06 02:48:41,473][52811] Sum rewards: 76.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon5': '0.148', 'AMMO3': '0.215', 'weapon4': '0.278', 'weapon2': '0.280', 'AMMO4': '0.331', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '64.000'} [2024-08-06 02:48:41,650][52659] DAMAGECOUNT value on done: 343347.0 [2024-08-06 02:48:41,653][52659] Sum rewards: 65.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.615', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO3': '0.176', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:41,976][52671] DAMAGECOUNT value on done: 342411.0 [2024-08-06 02:48:41,978][52671] Sum rewards: 75.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.325', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.036', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:42,276][52664] DAMAGECOUNT value on done: 358348.0 [2024-08-06 02:48:42,277][52664] Sum rewards: 72.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '60.500'} [2024-08-06 02:48:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 335429632. Throughput: 0: 4376.2. Samples: 83864820. Policy #0 lag: (min: 2.0, avg: 4.9, max: 9.0) [2024-08-06 02:48:42,794][52567] Avg episode reward: [(0, '69.016')] [2024-08-06 02:48:43,233][52666] DAMAGECOUNT value on done: 345186.0 [2024-08-06 02:48:43,234][52666] Sum rewards: 73.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.274', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.060', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '63.000'} [2024-08-06 02:48:43,534][52820] DAMAGECOUNT value on done: 312208.0 [2024-08-06 02:48:43,542][52820] Sum rewards: 66.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.575', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:43,932][52670] DAMAGECOUNT value on done: 337600.0 [2024-08-06 02:48:43,936][52670] Sum rewards: 69.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.538', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'weapon4': '0.188', 'AMMO3': '0.197', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:44,028][52795] DAMAGECOUNT value on done: 308873.0 [2024-08-06 02:48:44,029][52795] Sum rewards: 62.679, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.606', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.064', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '55.000'} [2024-08-06 02:48:44,214][52659] DAMAGECOUNT value on done: 341444.0 [2024-08-06 02:48:44,216][52659] Sum rewards: 56.504, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.158', 'weapon5': '0.224', 'weapon2': '0.242', 'AMMO3': '0.250', 'AMMO4': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.070', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '50.000'} [2024-08-06 02:48:44,505][52671] DAMAGECOUNT value on done: 340823.0 [2024-08-06 02:48:44,510][52671] Sum rewards: 71.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.489', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.236', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '61.000'} [2024-08-06 02:48:44,679][52803] DAMAGECOUNT value on done: 314084.0 [2024-08-06 02:48:44,679][52803] Sum rewards: 80.935, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.887', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '64.000'} [2024-08-06 02:48:45,138][52664] DAMAGECOUNT value on done: 353506.0 [2024-08-06 02:48:45,138][52664] Sum rewards: 65.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.128', 'weapon4': '0.134', 'AMMO4': '0.158', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.082', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:45,288][52650] Updated weights for policy 0, policy_version 40951 (0.0018) [2024-08-06 02:48:46,171][52666] DAMAGECOUNT value on done: 341597.0 [2024-08-06 02:48:46,172][52666] Sum rewards: 67.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.106', 'weapon4': '0.112', 'AMMO4': '0.218', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:46,677][52820] DAMAGECOUNT value on done: 318247.0 [2024-08-06 02:48:46,678][52820] Sum rewards: 66.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.356', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.056', 'AMMO4': '0.227', 'weapon5': '0.242', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '55.500'} [2024-08-06 02:48:46,868][52670] DAMAGECOUNT value on done: 340979.0 [2024-08-06 02:48:46,868][52670] Sum rewards: 61.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.412', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.176', 'AMMO3': '0.247', 'AMMO4': '0.248', 'weapon4': '0.268', 'weapon2': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '2.974', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '54.000'} [2024-08-06 02:48:46,882][52659] DAMAGECOUNT value on done: 342809.0 [2024-08-06 02:48:46,886][52659] Sum rewards: 67.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.373', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.436', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:47,187][52795] DAMAGECOUNT value on done: 318276.0 [2024-08-06 02:48:47,187][52795] Sum rewards: 77.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.606', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.111', 'weapon4': '0.162', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '66.000'} [2024-08-06 02:48:47,522][52664] DAMAGECOUNT value on done: 361768.0 [2024-08-06 02:48:47,522][52664] Sum rewards: 76.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon2': '0.150', 'AMMO3': '0.180', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.408', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '62.000'} [2024-08-06 02:48:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 335511552. Throughput: 0: 4372.4. Samples: 83877830. Policy #0 lag: (min: 2.0, avg: 4.9, max: 9.0) [2024-08-06 02:48:47,794][52567] Avg episode reward: [(0, '68.879')] [2024-08-06 02:48:49,036][52666] DAMAGECOUNT value on done: 337904.0 [2024-08-06 02:48:49,036][52666] Sum rewards: 65.063, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.022', 'AMMO4': '0.079', 'weapon5': '0.106', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '52.000'} [2024-08-06 02:48:49,716][52659] DAMAGECOUNT value on done: 341250.0 [2024-08-06 02:48:49,722][52659] Sum rewards: 63.201, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.144', 'AMMO4': '0.171', 'AMMO3': '0.261', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.970', 'weapon3': '3.156', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:49,755][52670] DAMAGECOUNT value on done: 333773.0 [2024-08-06 02:48:49,756][52670] Sum rewards: 56.094, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.786', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.269', 'weapon2': '0.276', 'WEAPON3': '1.650', 'HITCOUNT': '2.830', 'weapon3': '3.272', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '51.000'} [2024-08-06 02:48:49,797][52650] Updated weights for policy 0, policy_version 40961 (0.0012) [2024-08-06 02:48:49,803][52820] DAMAGECOUNT value on done: 315677.0 [2024-08-06 02:48:49,806][52820] Sum rewards: 86.384, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.220', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.270', 'FRAGCOUNT': '71.000'} [2024-08-06 02:48:50,332][52664] DAMAGECOUNT value on done: 355074.0 [2024-08-06 02:48:50,332][52664] Sum rewards: 73.787, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.493', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.150', 'weapon5': '0.170', 'weapon2': '0.186', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.302', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '63.000'} [2024-08-06 02:48:50,433][52795] DAMAGECOUNT value on done: 323184.0 [2024-08-06 02:48:50,435][52795] Sum rewards: 72.723, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.474', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.146', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '59.000'} [2024-08-06 02:48:52,022][52666] DAMAGECOUNT value on done: 333322.0 [2024-08-06 02:48:52,022][52666] Sum rewards: 80.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.831', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.202', 'AMMO3': '0.210', 'AMMO4': '0.227', 'weapon4': '0.290', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '65.000'} [2024-08-06 02:48:52,705][52670] DAMAGECOUNT value on done: 332985.0 [2024-08-06 02:48:52,706][52670] Sum rewards: 58.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.424', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.576', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.074', 'DAMAGECOUNT': '14.004', 'FRAGCOUNT': '51.000'} [2024-08-06 02:48:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 335601664. Throughput: 0: 4369.1. Samples: 83903920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:48:52,794][52567] Avg episode reward: [(0, '69.096')] [2024-08-06 02:48:52,916][52820] DAMAGECOUNT value on done: 311320.0 [2024-08-06 02:48:52,916][52820] Sum rewards: 70.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.656', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.144', 'weapon4': '0.154', 'AMMO3': '0.158', 'AMMO4': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '0.950', 'weapon3': '3.106', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:52,981][52659] DAMAGECOUNT value on done: 336547.0 [2024-08-06 02:48:52,981][52659] Sum rewards: 68.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.344', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '58.000'} [2024-08-06 02:48:53,283][52664] DAMAGECOUNT value on done: 360092.0 [2024-08-06 02:48:53,283][52664] Sum rewards: 75.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.689', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.094', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '63.000'} [2024-08-06 02:48:54,533][52650] Updated weights for policy 0, policy_version 40971 (0.0026) [2024-08-06 02:48:55,253][52666] DAMAGECOUNT value on done: 342168.0 [2024-08-06 02:48:55,253][52666] Sum rewards: 56.322, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.330', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.064', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.800', 'HITCOUNT': '3.140', 'weapon3': '3.162', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '52.000'} [2024-08-06 02:48:55,759][52664] DAMAGECOUNT value on done: 351003.0 [2024-08-06 02:48:55,759][52664] Sum rewards: 64.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.092', 'weapon5': '0.138', 'AMMO3': '0.170', 'AMMO4': '0.279', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '53.500'} [2024-08-06 02:48:55,816][52659] DAMAGECOUNT value on done: 342336.0 [2024-08-06 02:48:55,816][52659] Sum rewards: 80.143, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.009', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.229', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '65.500'} [2024-08-06 02:48:55,983][52670] DAMAGECOUNT value on done: 346185.0 [2024-08-06 02:48:55,984][52670] Sum rewards: 62.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.706', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.118', 'AMMO4': '0.177', 'AMMO3': '0.194', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.438', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '51.000'} [2024-08-06 02:48:56,180][52820] DAMAGECOUNT value on done: 316550.0 [2024-08-06 02:48:56,180][52820] Sum rewards: 66.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.213', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.190', 'weapon2': '0.282', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.486', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '54.000'} [2024-08-06 02:48:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 335683584. Throughput: 0: 4371.3. Samples: 83930320. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:48:57,794][52567] Avg episode reward: [(0, '69.053')] [2024-08-06 02:48:58,050][52664] DAMAGECOUNT value on done: 354620.0 [2024-08-06 02:48:58,050][52664] Sum rewards: 67.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.144', 'weapon4': '0.166', 'AMMO4': '0.194', 'AMMO3': '0.226', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '56.000'} [2024-08-06 02:48:58,694][52666] DAMAGECOUNT value on done: 340357.0 [2024-08-06 02:48:58,695][52666] Sum rewards: 74.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.393', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.180', 'AMMO3': '0.182', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '60.000'} [2024-08-06 02:48:58,816][52659] DAMAGECOUNT value on done: 342095.0 [2024-08-06 02:48:58,817][52659] Sum rewards: 63.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.082', 'weapon4': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '53.000'} [2024-08-06 02:48:59,064][52650] Updated weights for policy 0, policy_version 40981 (0.0025) [2024-08-06 02:48:59,194][52820] DAMAGECOUNT value on done: 309530.0 [2024-08-06 02:48:59,195][52820] Sum rewards: 68.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.797', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.120', 'AMMO3': '0.191', 'AMMO4': '0.234', 'weapon5': '0.260', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '57.000'} [2024-08-06 02:48:59,271][52670] DAMAGECOUNT value on done: 338056.0 [2024-08-06 02:48:59,271][52670] Sum rewards: 74.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.005', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.074', 'AMMO4': '0.181', 'weapon5': '0.198', 'AMMO3': '0.255', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.110', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '63.000'} [2024-08-06 02:49:01,060][52664] DAMAGECOUNT value on done: 354606.0 [2024-08-06 02:49:01,061][52664] Sum rewards: 79.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.178', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '64.000'} [2024-08-06 02:49:01,294][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:49:01,741][52659] DAMAGECOUNT value on done: 339278.0 [2024-08-06 02:49:01,746][52659] Sum rewards: 64.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.055', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.546', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.258', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '53.000'} [2024-08-06 02:49:01,830][52666] DAMAGECOUNT value on done: 337337.0 [2024-08-06 02:49:01,832][52666] Sum rewards: 88.913, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'HEALTH': '0.206', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.358', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '71.000'} [2024-08-06 02:49:02,076][52663] DAMAGECOUNT value on done: 346687.0 [2024-08-06 02:49:02,077][52663] Sum rewards: 60.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.130', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.270', 'weapon2': '0.642', 'WEAPON3': '1.750', 'weapon3': '3.076', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '53.000'} [2024-08-06 02:49:02,314][52670] DAMAGECOUNT value on done: 333081.0 [2024-08-06 02:49:02,314][52670] Sum rewards: 67.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.452', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.090', 'weapon5': '0.200', 'AMMO4': '0.221', 'AMMO3': '0.233', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.798', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '55.500'} [2024-08-06 02:49:02,333][52820] DAMAGECOUNT value on done: 313256.0 [2024-08-06 02:49:02,333][52820] Sum rewards: 58.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.048', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.552', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '50.500'} [2024-08-06 02:49:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 335773696. Throughput: 0: 4372.2. Samples: 83943350. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:49:02,795][52567] Avg episode reward: [(0, '69.110')] [2024-08-06 02:49:04,261][52664] DAMAGECOUNT value on done: 354137.0 [2024-08-06 02:49:04,261][52664] Sum rewards: 73.108, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.381', 'AMMO5': '0.007', 'AMMO2': '0.041', 'AMMO3': '0.151', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'weapon2': '0.290', 'weapon4': '0.302', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:04,346][52650] Updated weights for policy 0, policy_version 40991 (0.0011) [2024-08-06 02:49:04,527][52659] DAMAGECOUNT value on done: 349199.0 [2024-08-06 02:49:04,529][52659] Sum rewards: 69.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon4': '0.240', 'weapon2': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.100', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.000'} [2024-08-06 02:49:04,595][52666] DAMAGECOUNT value on done: 336298.0 [2024-08-06 02:49:04,597][52666] Sum rewards: 71.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.080', 'weapon5': '0.182', 'AMMO4': '0.187', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '60.500'} [2024-08-06 02:49:05,087][52663] DAMAGECOUNT value on done: 339474.0 [2024-08-06 02:49:05,090][52663] Sum rewards: 78.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.501', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.124', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.342', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '64.000'} [2024-08-06 02:49:05,176][52670] DAMAGECOUNT value on done: 335113.0 [2024-08-06 02:49:05,176][52670] Sum rewards: 61.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.321', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.066', 'weapon5': '0.180', 'AMMO3': '0.189', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '49.000'} [2024-08-06 02:49:05,279][52820] DAMAGECOUNT value on done: 319796.0 [2024-08-06 02:49:05,279][52820] Sum rewards: 70.895, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.295', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.046', 'weapon4': '0.078', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.346', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.500'} [2024-08-06 02:49:06,961][52666] DAMAGECOUNT value on done: 336369.0 [2024-08-06 02:49:06,963][52666] Sum rewards: 69.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.159', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon4': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:07,502][52670] DAMAGECOUNT value on done: 338511.0 [2024-08-06 02:49:07,503][52670] Sum rewards: 79.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.552', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.198', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.442', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '64.000'} [2024-08-06 02:49:07,507][52664] DAMAGECOUNT value on done: 353880.0 [2024-08-06 02:49:07,509][52664] Sum rewards: 73.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.630', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.124', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON3': '0.950', 'HITCOUNT': '3.280', 'weapon3': '3.454', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:07,716][52659] DAMAGECOUNT value on done: 348034.0 [2024-08-06 02:49:07,717][52659] Sum rewards: 72.141, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.422', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.096', 'weapon5': '0.198', 'AMMO4': '0.225', 'weapon2': '0.248', 'AMMO3': '0.249', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 02:49:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 335863808. Throughput: 0: 4369.8. Samples: 83969720. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:49:07,794][52567] Avg episode reward: [(0, '69.309')] [2024-08-06 02:49:08,130][52663] DAMAGECOUNT value on done: 338398.0 [2024-08-06 02:49:08,131][52663] Sum rewards: 61.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.564', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.251', 'weapon2': '0.358', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.460', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '55.000'} [2024-08-06 02:49:08,291][52650] Updated weights for policy 0, policy_version 41001 (0.0029) [2024-08-06 02:49:08,409][52820] DAMAGECOUNT value on done: 314062.0 [2024-08-06 02:49:08,411][52820] Sum rewards: 66.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.970', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.118', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.074', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '57.500'} [2024-08-06 02:49:09,435][52666] DAMAGECOUNT value on done: 335088.0 [2024-08-06 02:49:09,437][52666] Sum rewards: 65.285, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.390', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.301', 'weapon2': '0.436', 'WEAPON3': '1.700', 'weapon3': '3.108', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '56.000'} [2024-08-06 02:49:10,025][52670] DAMAGECOUNT value on done: 330794.0 [2024-08-06 02:49:10,025][52670] Sum rewards: 68.054, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.976', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.155', 'AMMO3': '0.161', 'weapon2': '0.212', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.176', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 02:49:10,635][52659] DAMAGECOUNT value on done: 341059.0 [2024-08-06 02:49:10,636][52659] Sum rewards: 75.354, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.889', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.117', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.276', 'weapon2': '0.520', 'WEAPON3': '0.800', 'weapon3': '2.904', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:11,056][52663] DAMAGECOUNT value on done: 342810.0 [2024-08-06 02:49:11,059][52663] Sum rewards: 72.365, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.636', 'WEAPON3': '0.900', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:11,567][52820] DAMAGECOUNT value on done: 318445.0 [2024-08-06 02:49:11,569][52820] Sum rewards: 51.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.590', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon7': '0.064', 'AMMO3': '0.206', 'weapon5': '0.234', 'AMMO6': '0.260', 'AMMO7': '0.260', 'AMMO4': '0.292', 'WEAPON7': '0.300', 'weapon4': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.618', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '43.000'} [2024-08-06 02:49:12,542][52666] DAMAGECOUNT value on done: 345871.0 [2024-08-06 02:49:12,544][52666] Sum rewards: 75.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.241', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon2': '0.126', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '64.000'} [2024-08-06 02:49:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 335945728. Throughput: 0: 4365.6. Samples: 83995990. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:49:12,794][52567] Avg episode reward: [(0, '69.391')] [2024-08-06 02:49:12,796][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:49:13,230][52650] Updated weights for policy 0, policy_version 41011 (0.0013) [2024-08-06 02:49:13,299][52670] DAMAGECOUNT value on done: 345911.0 [2024-08-06 02:49:13,300][52670] Sum rewards: 73.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon7': '0.086', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.222', 'weapon2': '0.266', 'weapon4': '0.274', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '62.000'} [2024-08-06 02:49:13,340][52659] DAMAGECOUNT value on done: 345894.0 [2024-08-06 02:49:13,341][52659] Sum rewards: 68.367, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.128', 'AMMO3': '0.204', 'weapon5': '0.210', 'AMMO4': '0.211', 'weapon2': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.102', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:13,982][52663] DAMAGECOUNT value on done: 341209.0 [2024-08-06 02:49:13,983][52663] Sum rewards: 71.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.351', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.176', 'AMMO4': '0.178', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '59.000'} [2024-08-06 02:49:14,803][52820] DAMAGECOUNT value on done: 316669.0 [2024-08-06 02:49:14,803][52820] Sum rewards: 70.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.055', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.116', 'weapon4': '0.172', 'AMMO4': '0.180', 'weapon2': '0.206', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:15,488][52666] DAMAGECOUNT value on done: 342463.0 [2024-08-06 02:49:15,488][52666] Sum rewards: 72.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.483', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon5': '0.168', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:15,875][52659] DAMAGECOUNT value on done: 334146.0 [2024-08-06 02:49:15,876][52659] Sum rewards: 74.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '61.000'} [2024-08-06 02:49:16,231][52670] DAMAGECOUNT value on done: 337231.0 [2024-08-06 02:49:16,231][52670] Sum rewards: 54.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.105', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.680', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.832', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '48.000'} [2024-08-06 02:49:16,928][52663] DAMAGECOUNT value on done: 345481.0 [2024-08-06 02:49:16,931][52663] Sum rewards: 47.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.481', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.138', 'AMMO3': '0.167', 'AMMO4': '0.266', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'weapon2': '0.680', 'WEAPON3': '1.000', 'weapon3': '2.670', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '12.966', 'FRAGCOUNT': '41.000'} [2024-08-06 02:49:17,488][52647] DAMAGECOUNT value on done: 361458.0 [2024-08-06 02:49:17,488][52647] Sum rewards: 88.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.194', 'AMMO3': '0.236', 'AMMO4': '0.249', 'weapon2': '0.262', 'weapon5': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '74.000'} [2024-08-06 02:49:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 336035840. Throughput: 0: 4373.1. Samples: 84009110. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:49:17,795][52567] Avg episode reward: [(0, '69.286')] [2024-08-06 02:49:18,066][52820] DAMAGECOUNT value on done: 317676.0 [2024-08-06 02:49:18,068][52820] Sum rewards: 72.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.782', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.151', 'weapon2': '0.196', 'weapon5': '0.238', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '61.000'} [2024-08-06 02:49:18,215][52650] Updated weights for policy 0, policy_version 41021 (0.0011) [2024-08-06 02:49:18,705][52666] DAMAGECOUNT value on done: 338853.0 [2024-08-06 02:49:18,706][52666] Sum rewards: 71.989, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.352', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:18,707][52659] DAMAGECOUNT value on done: 342265.0 [2024-08-06 02:49:18,710][52659] Sum rewards: 61.373, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.950', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.104', 'AMMO4': '0.182', 'weapon2': '0.220', 'AMMO3': '0.255', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.132', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '55.000'} [2024-08-06 02:49:19,457][52670] DAMAGECOUNT value on done: 339865.0 [2024-08-06 02:49:19,458][52670] Sum rewards: 72.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'ARMOR': '0.015', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.125', 'AMMO3': '0.179', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:19,560][52663] DAMAGECOUNT value on done: 342014.0 [2024-08-06 02:49:19,560][52663] Sum rewards: 68.716, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.184', 'AMMO3': '0.211', 'weapon2': '0.298', 'HEALTH': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '55.000'} [2024-08-06 02:49:19,950][52647] DAMAGECOUNT value on done: 359853.0 [2024-08-06 02:49:19,950][52647] Sum rewards: 75.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.074', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.454', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '62.000'} [2024-08-06 02:49:20,224][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:49:20,319][52667] Large shaping reward 3.276 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.225, 75.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:49:21,272][52820] DAMAGECOUNT value on done: 320587.0 [2024-08-06 02:49:21,273][52820] Sum rewards: 81.906, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.198', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.168', 'weapon5': '0.168', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.736', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '65.000'} [2024-08-06 02:49:21,803][52659] DAMAGECOUNT value on done: 349035.0 [2024-08-06 02:49:21,803][52659] Sum rewards: 77.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '65.000'} [2024-08-06 02:49:21,853][52666] DAMAGECOUNT value on done: 341314.0 [2024-08-06 02:49:21,855][52666] Sum rewards: 81.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.245', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.136', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.392', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '68.000'} [2024-08-06 02:49:22,330][52663] DAMAGECOUNT value on done: 339591.0 [2024-08-06 02:49:22,331][52663] Sum rewards: 65.474, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.272', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.148', 'weapon2': '0.224', 'AMMO4': '0.234', 'weapon5': '0.272', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.862', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '52.000'} [2024-08-06 02:49:22,342][52670] DAMAGECOUNT value on done: 343509.0 [2024-08-06 02:49:22,343][52670] Sum rewards: 66.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.675', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.154', 'weapon5': '0.192', 'AMMO3': '0.221', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.130', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:22,721][52650] Updated weights for policy 0, policy_version 41031 (0.0024) [2024-08-06 02:49:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 336125952. Throughput: 0: 4374.4. Samples: 84035330. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:49:22,795][52567] Avg episode reward: [(0, '69.560')] [2024-08-06 02:49:23,112][52647] DAMAGECOUNT value on done: 358564.0 [2024-08-06 02:49:23,113][52647] Sum rewards: 68.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.574', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.202', 'weapon5': '0.248', 'weapon2': '0.360', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:24,440][52820] DAMAGECOUNT value on done: 319228.0 [2024-08-06 02:49:24,442][52820] Sum rewards: 59.193, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.282', 'weapon2': '0.332', 'WEAPON3': '1.650', 'weapon3': '3.190', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '53.000'} [2024-08-06 02:49:24,503][52666] DAMAGECOUNT value on done: 339191.0 [2024-08-06 02:49:24,505][52666] Sum rewards: 74.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.399', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.430', 'weapon4': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '61.000'} [2024-08-06 02:49:24,667][52659] DAMAGECOUNT value on done: 349834.0 [2024-08-06 02:49:24,669][52659] Sum rewards: 64.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.020', 'weapon4': '0.034', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '54.000'} [2024-08-06 02:49:24,932][52670] DAMAGECOUNT value on done: 340456.0 [2024-08-06 02:49:24,933][52670] Sum rewards: 63.402, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '53.000'} [2024-08-06 02:49:25,375][52663] DAMAGECOUNT value on done: 337270.0 [2024-08-06 02:49:25,377][52663] Sum rewards: 66.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.136', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.400', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '56.000'} [2024-08-06 02:49:25,465][52647] DAMAGECOUNT value on done: 364528.0 [2024-08-06 02:49:25,465][52647] Sum rewards: 78.167, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.126', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.097', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '68.000'} [2024-08-06 02:49:27,369][52666] DAMAGECOUNT value on done: 341292.0 [2024-08-06 02:49:27,371][52666] Sum rewards: 88.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.105', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.398', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '71.000'} [2024-08-06 02:49:27,370][52650] Updated weights for policy 0, policy_version 41041 (0.0033) [2024-08-06 02:49:27,465][52820] DAMAGECOUNT value on done: 321509.0 [2024-08-06 02:49:27,466][52820] Sum rewards: 73.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.765', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.162', 'AMMO3': '0.171', 'weapon5': '0.220', 'AMMO4': '0.235', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:27,470][52659] DAMAGECOUNT value on done: 346819.0 [2024-08-06 02:49:27,470][52659] Sum rewards: 83.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.244', 'weapon4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '67.000'} [2024-08-06 02:49:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 336216064. Throughput: 0: 4370.4. Samples: 84061490. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:49:27,794][52567] Avg episode reward: [(0, '69.797')] [2024-08-06 02:49:27,800][52647] DAMAGECOUNT value on done: 362402.0 [2024-08-06 02:49:27,802][52647] Sum rewards: 78.604, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.146', 'weapon2': '0.174', 'weapon5': '0.194', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.228', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '21.003', 'FRAGCOUNT': '65.000'} [2024-08-06 02:49:28,108][52663] DAMAGECOUNT value on done: 343755.0 [2024-08-06 02:49:28,111][52663] Sum rewards: 58.291, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.170', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.168', 'weapon4': '0.252', 'AMMO3': '0.270', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.020', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '52.500'} [2024-08-06 02:49:28,145][52670] DAMAGECOUNT value on done: 326788.0 [2024-08-06 02:49:28,146][52670] Sum rewards: 53.230, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.042', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.102', 'weapon4': '0.156', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.500', 'weapon3': '2.940', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '48.000'} [2024-08-06 02:49:28,428][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:49:30,409][52666] DAMAGECOUNT value on done: 333694.0 [2024-08-06 02:49:30,410][52666] Sum rewards: 77.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.148', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.500', 'weapon3': '3.056', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '65.000'} [2024-08-06 02:49:30,720][52820] DAMAGECOUNT value on done: 317375.0 [2024-08-06 02:49:30,720][52820] Sum rewards: 76.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.193', 'weapon5': '0.240', 'AMMO4': '0.245', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '63.000'} [2024-08-06 02:49:30,725][52659] DAMAGECOUNT value on done: 340279.0 [2024-08-06 02:49:30,726][52659] Sum rewards: 54.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.473', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.144', 'AMMO3': '0.182', 'weapon4': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.020', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '46.000'} [2024-08-06 02:49:30,958][52795] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:49:31,003][52647] DAMAGECOUNT value on done: 364930.0 [2024-08-06 02:49:31,004][52647] Sum rewards: 74.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.211', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.060', 'weapon4': '0.130', 'weapon2': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.412', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '66.000'} [2024-08-06 02:49:31,079][52670] DAMAGECOUNT value on done: 341728.0 [2024-08-06 02:49:31,080][52670] Sum rewards: 78.025, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.402', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon4': '0.174', 'weapon5': '0.178', 'AMMO3': '0.222', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '65.000'} [2024-08-06 02:49:31,348][52663] DAMAGECOUNT value on done: 346182.0 [2024-08-06 02:49:31,348][52663] Sum rewards: 69.482, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.121', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.322', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.368', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '55.000'} [2024-08-06 02:49:31,443][52649] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 02:49:31,850][52650] Updated weights for policy 0, policy_version 41051 (0.0013) [2024-08-06 02:49:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 336297984. Throughput: 0: 4372.7. Samples: 84074600. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:49:32,794][52567] Avg episode reward: [(0, '69.924')] [2024-08-06 02:49:33,568][52666] DAMAGECOUNT value on done: 339751.0 [2024-08-06 02:49:33,569][52666] Sum rewards: 62.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.070', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.142', 'AMMO4': '0.202', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.700', 'HITCOUNT': '3.060', 'weapon3': '3.190', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '56.000'} [2024-08-06 02:49:33,569][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:49:33,826][52820] DAMAGECOUNT value on done: 316037.0 [2024-08-06 02:49:33,826][52820] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.826', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.206', 'AMMO3': '0.225', 'weapon4': '0.226', 'AMMO4': '0.279', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '60.000'} [2024-08-06 02:49:33,910][52659] DAMAGECOUNT value on done: 346709.0 [2024-08-06 02:49:33,911][52659] Sum rewards: 70.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.003', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon2': '0.170', 'weapon4': '0.170', 'weapon5': '0.174', 'AMMO3': '0.201', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:33,962][52647] DAMAGECOUNT value on done: 360695.0 [2024-08-06 02:49:33,962][52647] Sum rewards: 73.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.391', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO3': '0.119', 'AMMO4': '0.120', 'weapon5': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.450', 'weapon4': '0.606', 'WEAPON3': '0.800', 'weapon3': '2.552', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:34,273][52670] DAMAGECOUNT value on done: 347687.0 [2024-08-06 02:49:34,275][52670] Sum rewards: 75.700, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.114', 'weapon2': '0.206', 'AMMO3': '0.267', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '65.000'} [2024-08-06 02:49:34,286][52663] DAMAGECOUNT value on done: 341981.0 [2024-08-06 02:49:34,287][52663] Sum rewards: 63.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.110', 'AMMO5': '0.028', 'AMMO2': '0.049', 'weapon5': '0.234', 'AMMO3': '0.236', 'AMMO4': '0.246', 'weapon2': '0.494', 'weapon4': '0.546', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.402', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '54.000'} [2024-08-06 02:49:36,338][52647] DAMAGECOUNT value on done: 358588.0 [2024-08-06 02:49:36,346][52647] Sum rewards: 65.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.472', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.124', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'AMMO4': '0.288', 'weapon4': '0.328', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '54.500'} [2024-08-06 02:49:36,797][52650] Updated weights for policy 0, policy_version 41061 (0.0037) [2024-08-06 02:49:36,870][52659] DAMAGECOUNT value on done: 346681.0 [2024-08-06 02:49:36,872][52659] Sum rewards: 68.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.136', 'AMMO4': '0.137', 'weapon5': '0.142', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:37,050][52820] DAMAGECOUNT value on done: 325397.0 [2024-08-06 02:49:37,050][52820] Sum rewards: 64.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.820', 'AMMO5': '0.011', 'AMMO2': '0.013', 'weapon4': '0.058', 'AMMO4': '0.065', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.782', 'WEAPON3': '1.300', 'weapon3': '2.654', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '56.000'} [2024-08-06 02:49:37,211][52670] DAMAGECOUNT value on done: 339451.0 [2024-08-06 02:49:37,212][52670] Sum rewards: 56.211, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.920', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.062', 'weapon4': '0.116', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'AMMO3': '0.337', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.950', 'weapon3': '3.030', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '53.000'} [2024-08-06 02:49:37,656][52663] DAMAGECOUNT value on done: 335950.0 [2024-08-06 02:49:37,656][52663] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon4': '0.268', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 336388096. Throughput: 0: 4389.1. Samples: 84101430. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 02:49:37,794][52567] Avg episode reward: [(0, '69.717')] [2024-08-06 02:49:39,246][52647] DAMAGECOUNT value on done: 367594.0 [2024-08-06 02:49:39,247][52647] Sum rewards: 68.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.329', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'weapon4': '0.180', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:39,909][52662] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2024-08-06 02:49:40,134][52820] DAMAGECOUNT value on done: 326459.0 [2024-08-06 02:49:40,136][52820] Sum rewards: 67.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.765', 'AMMO5': '0.007', 'AMMO2': '0.039', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.236', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.396', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '56.000'} [2024-08-06 02:49:40,384][52663] DAMAGECOUNT value on done: 338314.0 [2024-08-06 02:49:40,386][52663] Sum rewards: 73.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.831', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.054', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '61.000'} [2024-08-06 02:49:40,429][52670] DAMAGECOUNT value on done: 339206.0 [2024-08-06 02:49:40,430][52670] Sum rewards: 55.657, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.133', 'AMMO4': '0.182', 'weapon5': '0.192', 'weapon2': '0.268', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.914', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '43.500'} [2024-08-06 02:49:41,242][52650] Updated weights for policy 0, policy_version 41071 (0.0020) [2024-08-06 02:49:41,627][52647] DAMAGECOUNT value on done: 357724.0 [2024-08-06 02:49:41,627][52647] Sum rewards: 79.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.812', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.228', 'weapon4': '0.464', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '65.000'} [2024-08-06 02:49:42,330][52667] DAMAGECOUNT value on done: 341469.0 [2024-08-06 02:49:42,331][52667] Sum rewards: 53.354, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.345', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO3': '0.180', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.200', 'HITCOUNT': '2.650', 'weapon3': '2.942', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '44.000'} [2024-08-06 02:49:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 336470016. Throughput: 0: 4386.4. Samples: 84127710. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 02:49:42,794][52567] Avg episode reward: [(0, '69.544')] [2024-08-06 02:49:43,285][52820] DAMAGECOUNT value on done: 317303.0 [2024-08-06 02:49:43,286][52820] Sum rewards: 71.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.859', 'AMMO5': '0.013', 'AMMO2': '0.066', 'weapon5': '0.210', 'AMMO3': '0.212', 'weapon4': '0.292', 'AMMO4': '0.332', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '60.000'} [2024-08-06 02:49:43,289][52663] DAMAGECOUNT value on done: 339483.0 [2024-08-06 02:49:43,290][52663] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '60.000'} [2024-08-06 02:49:44,316][52647] DAMAGECOUNT value on done: 366221.0 [2024-08-06 02:49:44,317][52647] Sum rewards: 68.332, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.620', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.162', 'AMMO4': '0.181', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '61.000'} [2024-08-06 02:49:44,975][52667] DAMAGECOUNT value on done: 346627.0 [2024-08-06 02:49:44,976][52667] Sum rewards: 63.235, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.150', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '51.000'} [2024-08-06 02:49:45,689][52663] DAMAGECOUNT value on done: 347319.0 [2024-08-06 02:49:45,689][52663] Sum rewards: 77.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.337', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.095', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '66.000'} [2024-08-06 02:49:46,007][52650] Updated weights for policy 0, policy_version 41081 (0.0025) [2024-08-06 02:49:46,802][52649] Large shaping reward 2.512 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2024-08-06 02:49:47,254][52647] DAMAGECOUNT value on done: 355709.0 [2024-08-06 02:49:47,256][52647] Sum rewards: 61.670, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.782', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.422', 'weapon4': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '50.000'} [2024-08-06 02:49:47,764][52667] DAMAGECOUNT value on done: 343535.0 [2024-08-06 02:49:47,764][52667] Sum rewards: 73.402, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.964', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.124', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.244', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '59.000'} [2024-08-06 02:49:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 336568320. Throughput: 0: 4384.9. Samples: 84140670. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 02:49:47,794][52567] Avg episode reward: [(0, '69.382')] [2024-08-06 02:49:48,502][52663] DAMAGECOUNT value on done: 340793.0 [2024-08-06 02:49:48,506][52663] Sum rewards: 57.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.108', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '48.000'} [2024-08-06 02:49:50,251][52647] DAMAGECOUNT value on done: 357965.0 [2024-08-06 02:49:50,251][52647] Sum rewards: 65.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.700', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.264', 'weapon2': '0.290', 'WEAPON3': '1.550', 'HITCOUNT': '3.410', 'weapon3': '3.496', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '57.000'} [2024-08-06 02:49:50,479][52650] Updated weights for policy 0, policy_version 41091 (0.0013) [2024-08-06 02:49:50,486][52667] DAMAGECOUNT value on done: 344710.0 [2024-08-06 02:49:50,487][52667] Sum rewards: 64.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.148', 'AMMO3': '0.177', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.248', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '53.000'} [2024-08-06 02:49:51,642][52663] DAMAGECOUNT value on done: 348918.0 [2024-08-06 02:49:51,643][52663] Sum rewards: 79.803, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.304', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.232', 'weapon5': '0.312', 'weapon2': '0.324', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.616', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '68.000'} [2024-08-06 02:49:52,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 336658432. Throughput: 0: 4380.2. Samples: 84166830. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 02:49:52,795][52567] Avg episode reward: [(0, '69.492')] [2024-08-06 02:49:52,954][52647] DAMAGECOUNT value on done: 359091.0 [2024-08-06 02:49:52,954][52647] Sum rewards: 66.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.114', 'weapon4': '0.116', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.994', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '54.000'} [2024-08-06 02:49:53,605][52820] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:49:53,613][52667] DAMAGECOUNT value on done: 348622.0 [2024-08-06 02:49:53,613][52667] Sum rewards: 66.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.130', 'weapon4': '0.160', 'AMMO3': '0.190', 'AMMO4': '0.234', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.202', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2024-08-06 02:49:53,800][52665] DAMAGECOUNT value on done: 337869.0 [2024-08-06 02:49:53,801][52665] Sum rewards: 71.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.990', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO3': '0.213', 'AMMO4': '0.213', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.648', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '60.000'} [2024-08-06 02:49:54,475][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:49:54,498][52663] DAMAGECOUNT value on done: 343857.0 [2024-08-06 02:49:54,498][52663] Sum rewards: 70.875, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.022', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.124', 'HEALTH': '0.184', 'AMMO3': '0.198', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.506', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '59.000'} [2024-08-06 02:49:55,061][52663] Large shaping reward 2.519 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.042, -14.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:49:55,359][52650] Updated weights for policy 0, policy_version 41101 (0.0019) [2024-08-06 02:49:55,840][52647] DAMAGECOUNT value on done: 367800.0 [2024-08-06 02:49:55,840][52647] Sum rewards: 63.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.100', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.193', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.376', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '52.000'} [2024-08-06 02:49:56,344][52667] DAMAGECOUNT value on done: 348418.0 [2024-08-06 02:49:56,346][52667] Sum rewards: 75.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.282', 'weapon4': '0.408', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '61.000'} [2024-08-06 02:49:56,775][52665] DAMAGECOUNT value on done: 344905.0 [2024-08-06 02:49:56,776][52665] Sum rewards: 83.435, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.514', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '68.000'} [2024-08-06 02:49:56,797][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:49:57,100][52663] DAMAGECOUNT value on done: 337287.0 [2024-08-06 02:49:57,101][52663] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.935', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.116', 'AMMO3': '0.151', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '0.950', 'weapon3': '3.074', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 02:49:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 336740352. Throughput: 0: 4376.7. Samples: 84192940. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 02:49:57,794][52567] Avg episode reward: [(0, '69.701')] [2024-08-06 02:49:58,829][52647] DAMAGECOUNT value on done: 360232.0 [2024-08-06 02:49:58,831][52647] Sum rewards: 69.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.565', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon2': '0.242', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'HITCOUNT': '3.460', 'weapon3': '3.608', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '62.000'} [2024-08-06 02:49:59,331][52667] DAMAGECOUNT value on done: 348883.0 [2024-08-06 02:49:59,333][52667] Sum rewards: 67.240, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.041', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.476', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.202', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '58.000'} [2024-08-06 02:49:59,891][52665] DAMAGECOUNT value on done: 342643.0 [2024-08-06 02:49:59,893][52665] Sum rewards: 59.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.250', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO4': '0.203', 'weapon4': '0.244', 'AMMO3': '0.256', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.850', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '51.000'} [2024-08-06 02:49:59,967][52650] Updated weights for policy 0, policy_version 41111 (0.0023) [2024-08-06 02:50:01,161][52647] DAMAGECOUNT value on done: 358723.0 [2024-08-06 02:50:01,162][52647] Sum rewards: 66.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.075', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.140', 'weapon5': '0.168', 'weapon2': '0.190', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.216', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '55.500'} [2024-08-06 02:50:02,417][52667] DAMAGECOUNT value on done: 344480.0 [2024-08-06 02:50:02,418][52667] Sum rewards: 63.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.875', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.172', 'AMMO4': '0.188', 'weapon5': '0.244', 'weapon4': '0.268', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 336822272. Throughput: 0: 4376.2. Samples: 84206040. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 02:50:02,794][52567] Avg episode reward: [(0, '69.286')] [2024-08-06 02:50:03,111][52665] DAMAGECOUNT value on done: 338914.0 [2024-08-06 02:50:03,113][52665] Sum rewards: 80.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.476', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '67.000'} [2024-08-06 02:50:04,016][52647] DAMAGECOUNT value on done: 355737.0 [2024-08-06 02:50:04,016][52647] Sum rewards: 61.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.338', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.128', 'AMMO3': '0.194', 'AMMO4': '0.204', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '51.500'} [2024-08-06 02:50:04,564][52662] DAMAGECOUNT value on done: 354323.0 [2024-08-06 02:50:04,564][52662] Sum rewards: 74.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.264', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '60.000'} [2024-08-06 02:50:04,810][52650] Updated weights for policy 0, policy_version 41121 (0.0020) [2024-08-06 02:50:05,144][52667] DAMAGECOUNT value on done: 343769.0 [2024-08-06 02:50:05,146][52667] Sum rewards: 67.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.271', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '58.500'} [2024-08-06 02:50:06,101][52665] DAMAGECOUNT value on done: 334940.0 [2024-08-06 02:50:06,101][52665] Sum rewards: 56.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.070', 'AMMO4': '0.184', 'AMMO3': '0.202', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '47.000'} [2024-08-06 02:50:06,589][52647] DAMAGECOUNT value on done: 354373.0 [2024-08-06 02:50:06,590][52647] Sum rewards: 66.501, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.205', 'weapon2': '0.664', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:07,531][52662] DAMAGECOUNT value on done: 349720.0 [2024-08-06 02:50:07,531][52662] Sum rewards: 81.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.108', 'weapon5': '0.128', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '67.000'} [2024-08-06 02:50:07,663][52667] DAMAGECOUNT value on done: 351583.0 [2024-08-06 02:50:07,664][52667] Sum rewards: 63.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.308', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.092', 'weapon4': '0.164', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.232', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '55.000'} [2024-08-06 02:50:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 336912384. Throughput: 0: 4377.8. Samples: 84232330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:50:07,794][52567] Avg episode reward: [(0, '69.289')] [2024-08-06 02:50:09,163][52665] DAMAGECOUNT value on done: 333452.0 [2024-08-06 02:50:09,164][52665] Sum rewards: 56.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.134', 'AMMO4': '0.210', 'weapon4': '0.210', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.052', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '48.000'} [2024-08-06 02:50:09,254][52650] Updated weights for policy 0, policy_version 41131 (0.0013) [2024-08-06 02:50:09,372][52647] DAMAGECOUNT value on done: 359643.0 [2024-08-06 02:50:09,374][52647] Sum rewards: 65.119, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.366', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.200', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.228', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:10,312][52667] DAMAGECOUNT value on done: 343195.0 [2024-08-06 02:50:10,313][52667] Sum rewards: 60.895, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.074', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.166', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.330', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.070', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:10,758][52662] DAMAGECOUNT value on done: 348123.0 [2024-08-06 02:50:10,759][52662] Sum rewards: 69.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.226', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.504', 'weapon2': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.570', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:11,855][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:50:12,292][52665] DAMAGECOUNT value on done: 341114.0 [2024-08-06 02:50:12,292][52665] Sum rewards: 63.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.612', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.146', 'AMMO3': '0.202', 'AMMO4': '0.223', 'weapon5': '0.224', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:12,391][52649] DAMAGECOUNT value on done: 337333.0 [2024-08-06 02:50:12,391][52649] Sum rewards: 71.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.102', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 337002496. Throughput: 0: 4381.6. Samples: 84258660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:50:12,794][52567] Avg episode reward: [(0, '68.937')] [2024-08-06 02:50:12,820][52667] DAMAGECOUNT value on done: 346438.0 [2024-08-06 02:50:12,821][52667] Sum rewards: 64.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.952', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.370', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '56.500'} [2024-08-06 02:50:13,593][52662] DAMAGECOUNT value on done: 338045.0 [2024-08-06 02:50:13,593][52662] Sum rewards: 66.835, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.637', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.154', 'weapon4': '0.154', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '0.900', 'HITCOUNT': '2.970', 'weapon3': '3.092', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:14,155][52650] Updated weights for policy 0, policy_version 41141 (0.0011) [2024-08-06 02:50:15,025][52668] DAMAGECOUNT value on done: 341475.0 [2024-08-06 02:50:15,025][52668] Sum rewards: 68.910, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.855', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.132', 'weapon4': '0.176', 'AMMO3': '0.188', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:15,070][52665] DAMAGECOUNT value on done: 344735.0 [2024-08-06 02:50:15,072][52665] Sum rewards: 67.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.846', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.150', 'weapon5': '0.216', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:15,274][52649] DAMAGECOUNT value on done: 329964.0 [2024-08-06 02:50:15,285][52649] Sum rewards: 68.153, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.352', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.438', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '59.000'} [2024-08-06 02:50:15,700][52667] DAMAGECOUNT value on done: 346850.0 [2024-08-06 02:50:15,700][52667] Sum rewards: 77.884, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.037', 'weapon4': '0.048', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 02:50:16,891][52662] DAMAGECOUNT value on done: 350866.0 [2024-08-06 02:50:16,892][52662] Sum rewards: 77.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.799', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '64.000'} [2024-08-06 02:50:17,677][52668] DAMAGECOUNT value on done: 345995.0 [2024-08-06 02:50:17,677][52668] Sum rewards: 79.940, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.914', 'AMMO5': '0.005', 'AMMO2': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.177', 'weapon4': '0.198', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '68.000'} [2024-08-06 02:50:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 337092608. Throughput: 0: 4377.1. Samples: 84271570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:50:17,794][52567] Avg episode reward: [(0, '69.143')] [2024-08-06 02:50:18,024][52665] DAMAGECOUNT value on done: 342278.0 [2024-08-06 02:50:18,025][52665] Sum rewards: 65.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.087', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.686', 'WEAPON3': '0.950', 'weapon3': '3.018', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '52.000'} [2024-08-06 02:50:18,230][52649] DAMAGECOUNT value on done: 335714.0 [2024-08-06 02:50:18,231][52649] Sum rewards: 71.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.595', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.147', 'AMMO3': '0.176', 'weapon2': '0.684', 'WEAPON3': '1.050', 'weapon3': '3.076', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:18,796][52667] DAMAGECOUNT value on done: 340571.0 [2024-08-06 02:50:18,798][52667] Sum rewards: 62.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.786', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '0.456', 'WEAPON3': '1.600', 'weapon3': '2.704', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:18,901][52650] Updated weights for policy 0, policy_version 41151 (0.0026) [2024-08-06 02:50:19,911][52668] DAMAGECOUNT value on done: 347700.0 [2024-08-06 02:50:19,911][52668] Sum rewards: 67.652, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.869', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.169', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.422', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:20,080][52662] DAMAGECOUNT value on done: 342438.0 [2024-08-06 02:50:20,080][52662] Sum rewards: 71.833, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon2': '0.264', 'weapon4': '0.464', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:20,543][52665] DAMAGECOUNT value on done: 340214.0 [2024-08-06 02:50:20,544][52665] Sum rewards: 69.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.181', 'weapon2': '0.216', 'weapon5': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.694', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:20,863][52649] DAMAGECOUNT value on done: 334274.0 [2024-08-06 02:50:20,865][52649] Sum rewards: 70.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.544', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.494', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '60.000'} [2024-08-06 02:50:22,208][52667] DAMAGECOUNT value on done: 348478.0 [2024-08-06 02:50:22,209][52667] Sum rewards: 51.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.238', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.132', 'weapon5': '0.132', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.908', 'WEAPON3': '1.250', 'weapon3': '2.490', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '43.000'} [2024-08-06 02:50:22,560][52668] DAMAGECOUNT value on done: 349729.0 [2024-08-06 02:50:22,560][52668] Sum rewards: 67.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.142', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:22,759][52662] DAMAGECOUNT value on done: 351361.0 [2024-08-06 02:50:22,759][52662] Sum rewards: 70.562, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'HEALTH': '0.014', 'AMMO2': '0.032', 'weapon4': '0.134', 'weapon5': '0.148', 'AMMO4': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 337174528. Throughput: 0: 4371.3. Samples: 84298140. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:50:22,802][52567] Avg episode reward: [(0, '68.897')] [2024-08-06 02:50:23,334][52650] Updated weights for policy 0, policy_version 41161 (0.0032) [2024-08-06 02:50:23,416][52665] DAMAGECOUNT value on done: 348678.0 [2024-08-06 02:50:23,416][52665] Sum rewards: 64.317, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.239', 'AMMO5': '0.005', 'AMMO2': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO3': '0.256', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '56.500'} [2024-08-06 02:50:23,763][52649] DAMAGECOUNT value on done: 326989.0 [2024-08-06 02:50:23,766][52649] Sum rewards: 74.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.034', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '63.000'} [2024-08-06 02:50:24,228][52669] DAMAGECOUNT value on done: 348376.0 [2024-08-06 02:50:24,228][52669] Sum rewards: 66.319, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.910', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'weapon7': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.180', 'WEAPON7': '0.200', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.634', 'WEAPON3': '1.250', 'weapon3': '2.640', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:24,974][52667] DAMAGECOUNT value on done: 353438.0 [2024-08-06 02:50:24,978][52667] Sum rewards: 75.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.191', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:25,510][52668] DAMAGECOUNT value on done: 339142.0 [2024-08-06 02:50:25,510][52668] Sum rewards: 73.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '62.000'} [2024-08-06 02:50:25,534][52662] DAMAGECOUNT value on done: 354614.0 [2024-08-06 02:50:25,534][52662] Sum rewards: 65.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO4': '0.169', 'AMMO3': '0.225', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.104', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:26,222][52665] DAMAGECOUNT value on done: 341588.0 [2024-08-06 02:50:26,223][52665] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.702', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.206', 'AMMO3': '0.226', 'weapon2': '0.366', 'weapon4': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '59.000'} [2024-08-06 02:50:26,500][52649] DAMAGECOUNT value on done: 337647.0 [2024-08-06 02:50:26,502][52649] Sum rewards: 64.979, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.492', 'AMMO5': '0.005', 'ARMOR': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:27,374][52669] DAMAGECOUNT value on done: 340640.0 [2024-08-06 02:50:27,377][52669] Sum rewards: 78.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon5': '0.060', 'weapon2': '0.200', 'AMMO3': '0.208', 'WEAPON3': '1.350', 'HITCOUNT': '3.460', 'weapon3': '3.558', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '66.000'} [2024-08-06 02:50:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 337256448. Throughput: 0: 4367.1. Samples: 84324230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:50:27,794][52567] Avg episode reward: [(0, '68.751')] [2024-08-06 02:50:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041169_337256448.pth... [2024-08-06 02:50:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040657_333062144.pth [2024-08-06 02:50:28,061][52667] DAMAGECOUNT value on done: 352950.0 [2024-08-06 02:50:28,061][52667] Sum rewards: 70.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.408', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.173', 'weapon4': '0.186', 'AMMO3': '0.199', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:28,189][52668] DAMAGECOUNT value on done: 349279.0 [2024-08-06 02:50:28,190][52668] Sum rewards: 74.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon4': '0.176', 'AMMO3': '0.216', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:28,262][52650] Updated weights for policy 0, policy_version 41171 (0.0011) [2024-08-06 02:50:28,741][52665] DAMAGECOUNT value on done: 339997.0 [2024-08-06 02:50:28,743][52665] Sum rewards: 56.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.086', 'AMMO4': '0.153', 'weapon4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.114', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '47.000'} [2024-08-06 02:50:29,003][52662] DAMAGECOUNT value on done: 345094.0 [2024-08-06 02:50:29,005][52662] Sum rewards: 63.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.138', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:29,034][52649] DAMAGECOUNT value on done: 333155.0 [2024-08-06 02:50:29,034][52649] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.210', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:30,439][52669] DAMAGECOUNT value on done: 347279.0 [2024-08-06 02:50:30,439][52669] Sum rewards: 71.524, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.772', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon2': '0.180', 'weapon4': '0.192', 'weapon5': '0.196', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.098', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 02:50:31,018][52667] DAMAGECOUNT value on done: 353034.0 [2024-08-06 02:50:31,018][52667] Sum rewards: 66.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO2': '0.010', 'AMMO5': '0.011', 'weapon4': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.186', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:31,111][52668] DAMAGECOUNT value on done: 346554.0 [2024-08-06 02:50:31,112][52668] Sum rewards: 80.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.094', 'AMMO3': '0.235', 'weapon2': '0.236', 'AMMO4': '0.262', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '67.000'} [2024-08-06 02:50:31,353][52662] DAMAGECOUNT value on done: 358194.0 [2024-08-06 02:50:31,353][52662] Sum rewards: 66.544, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.134', 'weapon4': '0.150', 'AMMO4': '0.204', 'AMMO3': '0.280', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.128', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:31,991][52665] DAMAGECOUNT value on done: 341056.0 [2024-08-06 02:50:31,991][52665] Sum rewards: 68.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.136', 'weapon4': '0.170', 'weapon2': '0.208', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '59.000'} [2024-08-06 02:50:32,036][52660] DAMAGECOUNT value on done: 341566.0 [2024-08-06 02:50:32,036][52660] Sum rewards: 76.357, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.862', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO4': '0.178', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '64.500'} [2024-08-06 02:50:32,358][52649] DAMAGECOUNT value on done: 340454.0 [2024-08-06 02:50:32,360][52649] Sum rewards: 73.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.423', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.166', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.444', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '60.000'} [2024-08-06 02:50:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 337346560. Throughput: 0: 4359.6. Samples: 84336850. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:50:32,794][52567] Avg episode reward: [(0, '68.658')] [2024-08-06 02:50:33,282][52650] Updated weights for policy 0, policy_version 41181 (0.0031) [2024-08-06 02:50:33,591][52658] DAMAGECOUNT value on done: 344202.0 [2024-08-06 02:50:33,591][52658] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.380', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.112', 'AMMO3': '0.139', 'weapon5': '0.154', 'AMMO4': '0.184', 'weapon2': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.360', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:33,756][52668] DAMAGECOUNT value on done: 340570.0 [2024-08-06 02:50:33,757][52668] Sum rewards: 70.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.164', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.158', 'AMMO3': '0.164', 'AMMO4': '0.169', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.244', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:33,852][52662] DAMAGECOUNT value on done: 342697.0 [2024-08-06 02:50:33,854][52662] Sum rewards: 65.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.294', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.200', 'weapon5': '0.234', 'AMMO4': '0.239', 'weapon2': '0.302', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:33,856][52667] DAMAGECOUNT value on done: 345140.0 [2024-08-06 02:50:33,857][52667] Sum rewards: 78.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.044', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '65.000'} [2024-08-06 02:50:33,866][52669] DAMAGECOUNT value on done: 343192.0 [2024-08-06 02:50:33,867][52669] Sum rewards: 62.495, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon4': '0.126', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '52.000'} [2024-08-06 02:50:34,404][52660] DAMAGECOUNT value on done: 338698.0 [2024-08-06 02:50:34,406][52660] Sum rewards: 62.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.264', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:35,273][52665] DAMAGECOUNT value on done: 342409.0 [2024-08-06 02:50:35,281][52665] Sum rewards: 62.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.135', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.154', 'weapon5': '0.214', 'weapon2': '0.220', 'AMMO3': '0.254', 'AMMO4': '0.261', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '55.000'} [2024-08-06 02:50:35,580][52649] DAMAGECOUNT value on done: 338214.0 [2024-08-06 02:50:35,582][52649] Sum rewards: 74.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.917', 'AMMO5': '0.027', 'AMMO2': '0.062', 'weapon4': '0.110', 'AMMO3': '0.170', 'weapon5': '0.210', 'AMMO4': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.776', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '60.000'} [2024-08-06 02:50:36,412][52662] DAMAGECOUNT value on done: 346348.0 [2024-08-06 02:50:36,412][52662] Sum rewards: 69.161, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.332', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.064', 'weapon5': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:36,539][52668] DAMAGECOUNT value on done: 344305.0 [2024-08-06 02:50:36,541][52668] Sum rewards: 68.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.056', 'weapon5': '0.058', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.238', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.418', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:36,754][52658] DAMAGECOUNT value on done: 345862.0 [2024-08-06 02:50:36,755][52658] Sum rewards: 57.324, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.124', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '46.000'} [2024-08-06 02:50:37,042][52667] DAMAGECOUNT value on done: 350829.0 [2024-08-06 02:50:37,044][52667] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.094', 'weapon4': '0.132', 'AMMO3': '0.210', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.204', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:37,184][52669] DAMAGECOUNT value on done: 343724.0 [2024-08-06 02:50:37,186][52669] Sum rewards: 75.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.070', 'AMMO3': '0.176', 'weapon5': '0.180', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:37,416][52660] DAMAGECOUNT value on done: 349991.0 [2024-08-06 02:50:37,417][52660] Sum rewards: 72.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:37,660][52650] Updated weights for policy 0, policy_version 41191 (0.0024) [2024-08-06 02:50:37,683][52665] DAMAGECOUNT value on done: 339124.0 [2024-08-06 02:50:37,684][52665] Sum rewards: 62.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.270', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'weapon2': '0.188', 'AMMO3': '0.235', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '52.000'} [2024-08-06 02:50:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 337436672. Throughput: 0: 4358.0. Samples: 84362940. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:50:37,794][52567] Avg episode reward: [(0, '68.386')] [2024-08-06 02:50:38,154][52649] DAMAGECOUNT value on done: 335286.0 [2024-08-06 02:50:38,156][52649] Sum rewards: 68.906, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.935', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.180', 'AMMO4': '0.189', 'weapon5': '0.204', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '57.500'} [2024-08-06 02:50:38,260][52614] Signal inference workers to stop experience collection... (7450 times) [2024-08-06 02:50:38,261][52614] Signal inference workers to resume experience collection... (7450 times) [2024-08-06 02:50:38,295][52650] InferenceWorker_p0-w0: stopping experience collection (7450 times) [2024-08-06 02:50:38,296][52650] InferenceWorker_p0-w0: resuming experience collection (7450 times) [2024-08-06 02:50:39,096][52662] DAMAGECOUNT value on done: 348237.0 [2024-08-06 02:50:39,097][52662] Sum rewards: 56.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.072', 'weapon5': '0.110', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.106', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '48.000'} [2024-08-06 02:50:39,525][52668] DAMAGECOUNT value on done: 345440.0 [2024-08-06 02:50:39,527][52668] Sum rewards: 63.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.146', 'weapon5': '0.146', 'AMMO4': '0.157', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '55.000'} [2024-08-06 02:50:39,861][52658] DAMAGECOUNT value on done: 351602.0 [2024-08-06 02:50:39,863][52658] Sum rewards: 65.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.495', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.140', 'weapon5': '0.144', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.256', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '56.500'} [2024-08-06 02:50:40,092][52669] DAMAGECOUNT value on done: 343934.0 [2024-08-06 02:50:40,093][52669] Sum rewards: 69.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 02:50:40,394][52660] DAMAGECOUNT value on done: 350186.0 [2024-08-06 02:50:40,394][52660] Sum rewards: 69.300, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.700', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.120', 'weapon5': '0.190', 'AMMO4': '0.209', 'AMMO3': '0.309', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.716', 'WEAPON3': '1.850', 'weapon3': '2.664', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:40,660][52665] DAMAGECOUNT value on done: 338281.0 [2024-08-06 02:50:40,660][52665] Sum rewards: 82.638, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.224', 'AMMO4': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '67.000'} [2024-08-06 02:50:41,061][52649] DAMAGECOUNT value on done: 339334.0 [2024-08-06 02:50:41,063][52649] Sum rewards: 70.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.875', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.026', 'weapon4': '0.032', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '60.000'} [2024-08-06 02:50:42,239][52668] DAMAGECOUNT value on done: 347018.0 [2024-08-06 02:50:42,239][52668] Sum rewards: 52.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.268', 'weapon4': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '2.400', 'weapon3': '3.056', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '47.000'} [2024-08-06 02:50:42,284][52650] Updated weights for policy 0, policy_version 41201 (0.0014) [2024-08-06 02:50:42,335][52662] DAMAGECOUNT value on done: 353393.0 [2024-08-06 02:50:42,336][52662] Sum rewards: 80.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '65.000'} [2024-08-06 02:50:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 337526784. Throughput: 0: 4364.7. Samples: 84389350. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:50:42,794][52567] Avg episode reward: [(0, '68.498')] [2024-08-06 02:50:42,811][52658] DAMAGECOUNT value on done: 349238.0 [2024-08-06 02:50:42,812][52658] Sum rewards: 69.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.502', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.148', 'weapon5': '0.238', 'AMMO3': '0.272', 'weapon2': '0.274', 'AMMO4': '0.290', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '3.044', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '60.000'} [2024-08-06 02:50:42,862][52669] DAMAGECOUNT value on done: 347076.0 [2024-08-06 02:50:42,862][52669] Sum rewards: 75.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.681', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.112', 'weapon5': '0.174', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:43,157][52660] DAMAGECOUNT value on done: 345448.0 [2024-08-06 02:50:43,159][52660] Sum rewards: 82.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.342', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '69.000'} [2024-08-06 02:50:43,212][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:50:43,286][52794] DAMAGECOUNT value on done: 347990.0 [2024-08-06 02:50:43,286][52794] Sum rewards: 54.875, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.790', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.262', 'AMMO3': '0.298', 'WEAPON3': '1.800', 'weapon3': '3.170', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '50.000'} [2024-08-06 02:50:43,935][52665] DAMAGECOUNT value on done: 337712.0 [2024-08-06 02:50:43,938][52665] Sum rewards: 55.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.580', 'AMMO2': '0.032', 'weapon4': '0.104', 'AMMO4': '0.162', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '50.000'} [2024-08-06 02:50:44,354][52649] DAMAGECOUNT value on done: 340544.0 [2024-08-06 02:50:44,354][52649] Sum rewards: 78.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.179', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '64.000'} [2024-08-06 02:50:44,994][52662] DAMAGECOUNT value on done: 345088.0 [2024-08-06 02:50:44,995][52662] Sum rewards: 74.185, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.018', 'HEALTH': '0.081', 'AMMO4': '0.091', 'AMMO3': '0.131', 'weapon5': '0.168', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.450', 'WEAPON3': '0.800', 'weapon3': '2.826', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '56.500'} [2024-08-06 02:50:45,125][52668] DAMAGECOUNT value on done: 342798.0 [2024-08-06 02:50:45,125][52668] Sum rewards: 64.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.376', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.340', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:45,698][52658] DAMAGECOUNT value on done: 342392.0 [2024-08-06 02:50:45,705][52658] Sum rewards: 68.567, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.444', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.184', 'AMMO3': '0.233', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.402', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '2.644', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '59.000'} [2024-08-06 02:50:45,743][52669] DAMAGECOUNT value on done: 346214.0 [2024-08-06 02:50:45,744][52669] Sum rewards: 72.582, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon4': '0.244', 'weapon2': '0.284', 'HEALTH': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:46,042][52794] DAMAGECOUNT value on done: 351466.0 [2024-08-06 02:50:46,043][52794] Sum rewards: 66.512, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.951', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.160', 'AMMO3': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.560', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '57.000'} [2024-08-06 02:50:46,100][52660] DAMAGECOUNT value on done: 342086.0 [2024-08-06 02:50:46,103][52660] Sum rewards: 83.218, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.106', 'AMMO4': '0.133', 'weapon5': '0.204', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '70.000'} [2024-08-06 02:50:46,677][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:50:47,139][52650] Updated weights for policy 0, policy_version 41211 (0.0034) [2024-08-06 02:50:47,273][52665] DAMAGECOUNT value on done: 341073.0 [2024-08-06 02:50:47,278][52665] Sum rewards: 64.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.586', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.146', 'weapon5': '0.152', 'weapon4': '0.182', 'AMMO4': '0.225', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.726', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:47,615][52662] DAMAGECOUNT value on done: 357277.0 [2024-08-06 02:50:47,616][52662] Sum rewards: 63.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'weapon4': '0.104', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.310', 'WEAPON3': '1.650', 'weapon3': '3.200', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:47,730][52649] DAMAGECOUNT value on done: 340912.0 [2024-08-06 02:50:47,731][52649] Sum rewards: 69.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.094', 'AMMO4': '0.154', 'AMMO3': '0.177', 'weapon5': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 337608704. Throughput: 0: 4361.6. Samples: 84402310. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:50:47,794][52567] Avg episode reward: [(0, '68.680')] [2024-08-06 02:50:48,012][52668] DAMAGECOUNT value on done: 337259.0 [2024-08-06 02:50:48,015][52668] Sum rewards: 69.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.480', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.103', 'AMMO3': '0.284', 'weapon2': '0.606', 'WEAPON3': '1.800', 'weapon3': '3.078', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:48,437][52794] DAMAGECOUNT value on done: 346702.0 [2024-08-06 02:50:48,438][52794] Sum rewards: 66.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.598', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.142', 'AMMO3': '0.193', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '54.000'} [2024-08-06 02:50:48,463][52669] DAMAGECOUNT value on done: 347223.0 [2024-08-06 02:50:48,464][52669] Sum rewards: 62.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.103', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.221', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.350', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '53.500'} [2024-08-06 02:50:48,546][52658] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:50:48,795][52658] DAMAGECOUNT value on done: 345284.0 [2024-08-06 02:50:48,797][52658] Sum rewards: 73.802, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.185', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.174', 'AMMO4': '0.175', 'weapon2': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON3': '1.850', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '64.000'} [2024-08-06 02:50:49,021][52660] DAMAGECOUNT value on done: 346036.0 [2024-08-06 02:50:49,022][52660] Sum rewards: 67.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.270', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon4': '0.136', 'AMMO3': '0.269', 'ARMOR': '0.400', 'weapon2': '0.654', 'WEAPON3': '1.700', 'weapon3': '2.898', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:50,238][52665] DAMAGECOUNT value on done: 342672.0 [2024-08-06 02:50:50,239][52665] Sum rewards: 60.316, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.418', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'weapon2': '0.258', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.342', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:50,411][52662] DAMAGECOUNT value on done: 350336.0 [2024-08-06 02:50:50,411][52662] Sum rewards: 65.776, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO4': '0.162', 'weapon5': '0.194', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:50,685][52649] DAMAGECOUNT value on done: 341686.0 [2024-08-06 02:50:50,686][52649] Sum rewards: 67.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.828', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.108', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:51,010][52668] DAMAGECOUNT value on done: 338392.0 [2024-08-06 02:50:51,011][52668] Sum rewards: 80.772, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.108', 'AMMO4': '0.114', 'weapon2': '0.174', 'weapon5': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '68.000'} [2024-08-06 02:50:51,421][52669] DAMAGECOUNT value on done: 344965.0 [2024-08-06 02:50:51,422][52669] Sum rewards: 78.312, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.080', 'weapon4': '0.096', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '67.000'} [2024-08-06 02:50:51,503][52794] DAMAGECOUNT value on done: 345302.0 [2024-08-06 02:50:51,503][52794] Sum rewards: 69.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.154', 'AMMO3': '0.222', 'weapon2': '0.256', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.310', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:51,801][52650] Updated weights for policy 0, policy_version 41221 (0.0013) [2024-08-06 02:50:51,900][52658] DAMAGECOUNT value on done: 349201.0 [2024-08-06 02:50:51,901][52658] Sum rewards: 54.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.160', 'weapon5': '0.212', 'AMMO4': '0.219', 'AMMO3': '0.220', 'weapon2': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.610', 'weapon3': '3.096', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '48.000'} [2024-08-06 02:50:51,978][52660] DAMAGECOUNT value on done: 353260.0 [2024-08-06 02:50:51,980][52660] Sum rewards: 74.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.503', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.098', 'weapon5': '0.140', 'AMMO3': '0.198', 'weapon2': '0.250', 'AMMO4': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '61.000'} [2024-08-06 02:50:52,424][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:50:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17522.5). Total num frames: 337698816. Throughput: 0: 4353.6. Samples: 84428240. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:50:52,794][52567] Avg episode reward: [(0, '68.717')] [2024-08-06 02:50:53,501][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:50:53,578][52662] DAMAGECOUNT value on done: 348594.0 [2024-08-06 02:50:53,581][52662] Sum rewards: 67.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.016', 'AMMO5': '0.009', 'weapon4': '0.034', 'AMMO2': '0.039', 'weapon5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.254', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:53,694][52649] DAMAGECOUNT value on done: 332476.0 [2024-08-06 02:50:53,695][52649] Sum rewards: 70.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'weapon2': '0.194', 'AMMO3': '0.199', 'weapon4': '0.218', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:53,816][52668] DAMAGECOUNT value on done: 337663.0 [2024-08-06 02:50:53,817][52668] Sum rewards: 74.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.751', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.124', 'AMMO4': '0.183', 'AMMO3': '0.211', 'weapon5': '0.230', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '59.000'} [2024-08-06 02:50:54,095][52669] DAMAGECOUNT value on done: 351655.0 [2024-08-06 02:50:54,097][52669] Sum rewards: 79.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.265', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.176', 'AMMO3': '0.190', 'AMMO4': '0.196', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '63.500'} [2024-08-06 02:50:54,714][52794] DAMAGECOUNT value on done: 343522.0 [2024-08-06 02:50:54,714][52794] Sum rewards: 56.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.938', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.128', 'weapon5': '0.148', 'AMMO4': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.760', 'WEAPON3': '1.500', 'weapon3': '2.690', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '49.000'} [2024-08-06 02:50:54,810][52660] DAMAGECOUNT value on done: 349399.0 [2024-08-06 02:50:54,811][52660] Sum rewards: 81.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '68.000'} [2024-08-06 02:50:55,028][52658] DAMAGECOUNT value on done: 340143.0 [2024-08-06 02:50:55,028][52658] Sum rewards: 81.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.073', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.116', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '66.000'} [2024-08-06 02:50:56,301][52650] Updated weights for policy 0, policy_version 41231 (0.0012) [2024-08-06 02:50:56,644][52669] DAMAGECOUNT value on done: 344963.0 [2024-08-06 02:50:56,645][52669] Sum rewards: 66.324, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.445', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.182', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.308', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '53.000'} [2024-08-06 02:50:56,833][52668] DAMAGECOUNT value on done: 342293.0 [2024-08-06 02:50:56,834][52668] Sum rewards: 75.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.244', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.044', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '62.000'} [2024-08-06 02:50:56,854][52662] DAMAGECOUNT value on done: 345204.0 [2024-08-06 02:50:56,854][52662] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.070', 'weapon5': '0.078', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '55.000'} [2024-08-06 02:50:56,864][52649] DAMAGECOUNT value on done: 337660.0 [2024-08-06 02:50:56,865][52649] Sum rewards: 60.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.418', 'weapon4': '0.008', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.330', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '50.000'} [2024-08-06 02:50:57,531][52660] DAMAGECOUNT value on done: 343614.0 [2024-08-06 02:50:57,531][52660] Sum rewards: 88.922, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.204', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.934', 'FRAGCOUNT': '74.000'} [2024-08-06 02:50:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 337788928. Throughput: 0: 4351.1. Samples: 84454460. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 02:50:57,794][52567] Avg episode reward: [(0, '69.434')] [2024-08-06 02:50:58,008][52658] DAMAGECOUNT value on done: 356159.0 [2024-08-06 02:50:58,010][52658] Sum rewards: 69.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.908', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.192', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 02:50:58,058][52794] DAMAGECOUNT value on done: 347662.0 [2024-08-06 02:50:58,059][52794] Sum rewards: 65.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.255', 'AMMO5': '0.013', 'weapon7': '0.046', 'AMMO2': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'weapon2': '0.234', 'AMMO3': '0.238', 'weapon4': '0.302', 'AMMO4': '0.315', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.926', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 02:50:58,507][52671] DAMAGECOUNT value on done: 350426.0 [2024-08-06 02:50:58,507][52671] Sum rewards: 58.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.876', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.106', 'AMMO4': '0.191', 'AMMO3': '0.241', 'weapon5': '0.298', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.858', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '51.000'} [2024-08-06 02:50:59,469][52669] DAMAGECOUNT value on done: 343064.0 [2024-08-06 02:50:59,469][52669] Sum rewards: 60.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.326', 'weapon4': '0.414', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '51.000'} [2024-08-06 02:50:59,661][52668] DAMAGECOUNT value on done: 344867.0 [2024-08-06 02:50:59,662][52668] Sum rewards: 69.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.994', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.130', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '60.000'} [2024-08-06 02:50:59,848][52662] DAMAGECOUNT value on done: 341315.0 [2024-08-06 02:50:59,850][52662] Sum rewards: 62.738, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.218', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO4': '0.182', 'AMMO3': '0.231', 'weapon2': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.960', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '55.000'} [2024-08-06 02:50:59,997][52649] DAMAGECOUNT value on done: 335681.0 [2024-08-06 02:50:59,997][52649] Sum rewards: 71.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '59.000'} [2024-08-06 02:51:00,406][52660] DAMAGECOUNT value on done: 352703.0 [2024-08-06 02:51:00,407][52660] Sum rewards: 63.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'weapon7': '0.012', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.374', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:00,748][52794] DAMAGECOUNT value on done: 351760.0 [2024-08-06 02:51:00,749][52794] Sum rewards: 58.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.390', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon5': '0.182', 'AMMO3': '0.190', 'AMMO4': '0.319', 'weapon4': '0.440', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.560', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '51.000'} [2024-08-06 02:51:00,836][52658] DAMAGECOUNT value on done: 348182.0 [2024-08-06 02:51:00,837][52658] Sum rewards: 66.461, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.425', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.171', 'weapon2': '0.366', 'WEAPON3': '1.100', 'HITCOUNT': '3.210', 'weapon3': '3.422', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:01,362][52671] DAMAGECOUNT value on done: 347214.0 [2024-08-06 02:51:01,364][52671] Sum rewards: 76.110, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.521', 'AMMO5': '0.010', 'ARMOR': '0.036', 'AMMO2': '0.036', 'AMMO3': '0.157', 'weapon5': '0.180', 'AMMO4': '0.181', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.450', 'weapon4': '0.544', 'WEAPON3': '1.050', 'weapon3': '2.602', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '59.000'} [2024-08-06 02:51:01,521][52650] Updated weights for policy 0, policy_version 41241 (0.0011) [2024-08-06 02:51:02,268][52668] DAMAGECOUNT value on done: 348466.0 [2024-08-06 02:51:02,276][52668] Sum rewards: 70.014, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.754', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.098', 'weapon5': '0.190', 'weapon2': '0.196', 'AMMO4': '0.296', 'AMMO3': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.252', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '61.000'} [2024-08-06 02:51:02,639][52669] DAMAGECOUNT value on done: 348386.0 [2024-08-06 02:51:02,639][52669] Sum rewards: 65.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.126', 'weapon5': '0.174', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 337870848. Throughput: 0: 4351.1. Samples: 84467370. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:51:02,794][52567] Avg episode reward: [(0, '68.992')] [2024-08-06 02:51:02,816][52649] DAMAGECOUNT value on done: 338585.0 [2024-08-06 02:51:02,817][52649] Sum rewards: 59.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.282', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.224', 'weapon4': '0.288', 'AMMO4': '0.322', 'weapon5': '0.338', 'weapon2': '0.344', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.662', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '50.000'} [2024-08-06 02:51:03,114][52660] DAMAGECOUNT value on done: 339880.0 [2024-08-06 02:51:03,115][52660] Sum rewards: 73.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.094', 'weapon4': '0.196', 'AMMO4': '0.204', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:03,410][52794] DAMAGECOUNT value on done: 345539.0 [2024-08-06 02:51:03,410][52794] Sum rewards: 59.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.178', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.118', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '50.500'} [2024-08-06 02:51:03,654][52658] DAMAGECOUNT value on done: 355833.0 [2024-08-06 02:51:03,654][52658] Sum rewards: 78.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon2': '0.142', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.240', 'weapon4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '65.000'} [2024-08-06 02:51:04,173][52671] DAMAGECOUNT value on done: 346829.0 [2024-08-06 02:51:04,173][52671] Sum rewards: 65.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.992', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '55.500'} [2024-08-06 02:51:04,724][52668] DAMAGECOUNT value on done: 347920.0 [2024-08-06 02:51:04,726][52668] Sum rewards: 66.970, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.580', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.130', 'weapon5': '0.238', 'AMMO3': '0.255', 'AMMO4': '0.274', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.968', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '59.000'} [2024-08-06 02:51:05,550][52650] Updated weights for policy 0, policy_version 41251 (0.0025) [2024-08-06 02:51:05,714][52660] DAMAGECOUNT value on done: 339539.0 [2024-08-06 02:51:05,715][52660] Sum rewards: 56.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon5': '0.188', 'AMMO3': '0.206', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON4': '0.550', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.564', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '48.000'} [2024-08-06 02:51:05,721][52649] DAMAGECOUNT value on done: 342703.0 [2024-08-06 02:51:05,724][52649] Sum rewards: 66.481, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.603', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.094', 'AMMO4': '0.173', 'weapon5': '0.180', 'weapon2': '0.204', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:05,974][52669] DAMAGECOUNT value on done: 353291.0 [2024-08-06 02:51:05,976][52669] Sum rewards: 65.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.676', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.163', 'weapon5': '0.180', 'AMMO4': '0.203', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.732', 'WEAPON3': '1.100', 'weapon3': '2.564', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:06,040][52794] DAMAGECOUNT value on done: 351922.0 [2024-08-06 02:51:06,042][52794] Sum rewards: 62.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.725', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.141', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon4': '0.266', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.000', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:06,679][52658] DAMAGECOUNT value on done: 341369.0 [2024-08-06 02:51:06,681][52658] Sum rewards: 70.159, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.173', 'ARMOR': '0.004', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.862', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:06,932][52671] DAMAGECOUNT value on done: 347174.0 [2024-08-06 02:51:06,933][52671] Sum rewards: 77.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.132', 'AMMO3': '0.208', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '64.000'} [2024-08-06 02:51:07,212][52811] DAMAGECOUNT value on done: 333910.0 [2024-08-06 02:51:07,214][52811] Sum rewards: 73.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.009', 'AMMO2': '0.061', 'weapon5': '0.102', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.288', 'AMMO4': '0.305', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '62.000'} [2024-08-06 02:51:07,392][52668] DAMAGECOUNT value on done: 344209.0 [2024-08-06 02:51:07,400][52668] Sum rewards: 77.582, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.102', 'AMMO5': '0.005', 'weapon5': '0.036', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO4': '0.193', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '67.000'} [2024-08-06 02:51:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 337960960. Throughput: 0: 4350.9. Samples: 84493930. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:51:07,795][52567] Avg episode reward: [(0, '68.808')] [2024-08-06 02:51:08,508][52660] DAMAGECOUNT value on done: 353024.0 [2024-08-06 02:51:08,508][52660] Sum rewards: 76.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.226', 'weapon2': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:08,718][52669] DAMAGECOUNT value on done: 362833.0 [2024-08-06 02:51:08,718][52669] Sum rewards: 62.985, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.705', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.102', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '51.000'} [2024-08-06 02:51:08,986][52649] DAMAGECOUNT value on done: 342827.0 [2024-08-06 02:51:08,988][52649] Sum rewards: 61.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.164', 'AMMO3': '0.213', 'weapon5': '0.256', 'AMMO4': '0.288', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.720', 'WEAPON3': '1.250', 'weapon3': '2.564', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '51.500'} [2024-08-06 02:51:09,157][52794] DAMAGECOUNT value on done: 348857.0 [2024-08-06 02:51:09,160][52794] Sum rewards: 56.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.134', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.134', 'weapon4': '0.152', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'weapon2': '0.386', 'WEAPON3': '1.900', 'weapon3': '3.046', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.000'} [2024-08-06 02:51:09,271][52803] DAMAGECOUNT value on done: 324097.0 [2024-08-06 02:51:09,272][52803] Sum rewards: 70.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.185', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'weapon4': '0.144', 'AMMO4': '0.147', 'AMMO3': '0.189', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.224', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:09,433][52658] DAMAGECOUNT value on done: 348848.0 [2024-08-06 02:51:09,435][52658] Sum rewards: 59.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.746', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.166', 'AMMO4': '0.182', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.400', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.550', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '49.000'} [2024-08-06 02:51:10,124][52671] DAMAGECOUNT value on done: 353560.0 [2024-08-06 02:51:10,124][52671] Sum rewards: 59.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.342', 'AMMO5': '0.033', 'AMMO2': '0.067', 'AMMO3': '0.171', 'weapon2': '0.298', 'AMMO4': '0.333', 'weapon5': '0.454', 'weapon4': '0.568', 'WEAPON4': '0.750', 'WEAPON5': '0.900', 'WEAPON3': '1.050', 'weapon3': '2.212', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '49.000'} [2024-08-06 02:51:10,414][52811] DAMAGECOUNT value on done: 319946.0 [2024-08-06 02:51:10,414][52811] Sum rewards: 73.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.278', 'ARMOR': '0.455', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:10,590][52650] Updated weights for policy 0, policy_version 41261 (0.0025) [2024-08-06 02:51:11,474][52669] DAMAGECOUNT value on done: 347405.0 [2024-08-06 02:51:11,476][52669] Sum rewards: 66.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.262', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon7': '0.050', 'weapon4': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.163', 'WEAPON7': '0.200', 'weapon5': '0.208', 'AMMO3': '0.228', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.084', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:11,561][52660] DAMAGECOUNT value on done: 353651.0 [2024-08-06 02:51:11,563][52660] Sum rewards: 62.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.212', 'AMMO3': '0.227', 'weapon2': '0.282', 'weapon5': '0.298', 'AMMO4': '0.317', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.864', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:12,222][52794] DAMAGECOUNT value on done: 344853.0 [2024-08-06 02:51:12,223][52794] Sum rewards: 73.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.429', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.090', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 02:51:12,288][52658] DAMAGECOUNT value on done: 344074.0 [2024-08-06 02:51:12,289][52658] Sum rewards: 59.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.265', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.148', 'weapon5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.212', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.154', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '49.000'} [2024-08-06 02:51:12,360][52803] DAMAGECOUNT value on done: 320600.0 [2024-08-06 02:51:12,361][52803] Sum rewards: 71.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.174', 'AMMO3': '0.201', 'weapon4': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 338042880. Throughput: 0: 4350.2. Samples: 84519990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:51:12,794][52567] Avg episode reward: [(0, '68.172')] [2024-08-06 02:51:13,217][52671] DAMAGECOUNT value on done: 343954.0 [2024-08-06 02:51:13,217][52671] Sum rewards: 53.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.251', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.169', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.620', 'weapon3': '3.206', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '43.000'} [2024-08-06 02:51:13,408][52811] DAMAGECOUNT value on done: 323247.0 [2024-08-06 02:51:13,409][52811] Sum rewards: 59.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.036', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.126', 'AMMO4': '0.178', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.030', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '49.000'} [2024-08-06 02:51:14,433][52660] DAMAGECOUNT value on done: 341270.0 [2024-08-06 02:51:14,433][52660] Sum rewards: 69.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.013', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.265', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.330', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:14,737][52669] DAMAGECOUNT value on done: 349405.0 [2024-08-06 02:51:14,737][52669] Sum rewards: 64.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.378', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.092', 'weapon5': '0.122', 'AMMO3': '0.193', 'AMMO4': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '53.000'} [2024-08-06 02:51:14,771][52658] DAMAGECOUNT value on done: 342358.0 [2024-08-06 02:51:14,772][52658] Sum rewards: 68.004, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.842', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.108', 'weapon4': '0.144', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'weapon5': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '0.750', 'weapon3': '2.772', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '52.000'} [2024-08-06 02:51:14,931][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:51:15,228][52794] DAMAGECOUNT value on done: 348575.0 [2024-08-06 02:51:15,231][52794] Sum rewards: 69.327, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.184', 'weapon5': '0.234', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:15,484][52803] DAMAGECOUNT value on done: 325074.0 [2024-08-06 02:51:15,485][52803] Sum rewards: 74.972, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.130', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.138', 'weapon5': '0.160', 'AMMO4': '0.205', 'weapon2': '0.258', 'AMMO3': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.164', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '66.000'} [2024-08-06 02:51:15,513][52650] Updated weights for policy 0, policy_version 41271 (0.0012) [2024-08-06 02:51:15,768][52671] DAMAGECOUNT value on done: 350266.0 [2024-08-06 02:51:15,769][52671] Sum rewards: 70.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.028', 'weapon4': '0.114', 'weapon5': '0.132', 'AMMO4': '0.138', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:16,180][52795] DAMAGECOUNT value on done: 321394.0 [2024-08-06 02:51:16,181][52795] Sum rewards: 67.359, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.156', 'AMMO4': '0.206', 'HEALTH': '0.220', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.096', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:16,493][52811] DAMAGECOUNT value on done: 321835.0 [2024-08-06 02:51:16,496][52811] Sum rewards: 64.606, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.498', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.024', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'weapon4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:16,984][52660] DAMAGECOUNT value on done: 345975.0 [2024-08-06 02:51:16,986][52660] Sum rewards: 71.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:17,375][52664] DAMAGECOUNT value on done: 358764.0 [2024-08-06 02:51:17,376][52664] Sum rewards: 64.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.194', 'AMMO3': '0.205', 'AMMO4': '0.268', 'weapon2': '0.302', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.836', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:17,771][52658] DAMAGECOUNT value on done: 340207.0 [2024-08-06 02:51:17,773][52658] Sum rewards: 61.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.138', 'AMMO4': '0.183', 'AMMO3': '0.198', 'weapon2': '0.198', 'weapon5': '0.198', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '51.000'} [2024-08-06 02:51:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 338141184. Throughput: 0: 4362.7. Samples: 84533170. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:51:17,794][52567] Avg episode reward: [(0, '68.202')] [2024-08-06 02:51:17,864][52669] DAMAGECOUNT value on done: 349160.0 [2024-08-06 02:51:17,864][52669] Sum rewards: 72.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.875', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.218', 'weapon5': '0.218', 'AMMO4': '0.256', 'weapon2': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 02:51:18,187][52794] DAMAGECOUNT value on done: 340882.0 [2024-08-06 02:51:18,188][52794] Sum rewards: 75.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.592', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.092', 'weapon4': '0.106', 'AMMO3': '0.203', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:18,641][52803] DAMAGECOUNT value on done: 326486.0 [2024-08-06 02:51:18,643][52803] Sum rewards: 75.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.325', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.104', 'weapon7': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.342', 'WEAPON3': '1.000', 'weapon3': '3.002', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '61.000'} [2024-08-06 02:51:18,855][52671] DAMAGECOUNT value on done: 350164.0 [2024-08-06 02:51:18,857][52671] Sum rewards: 74.898, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.731', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.096', 'weapon4': '0.104', 'AMMO4': '0.156', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '65.000'} [2024-08-06 02:51:19,130][52795] DAMAGECOUNT value on done: 315181.0 [2024-08-06 02:51:19,132][52795] Sum rewards: 64.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO4': '0.209', 'AMMO3': '0.217', 'weapon4': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:19,493][52660] DAMAGECOUNT value on done: 339420.0 [2024-08-06 02:51:19,493][52660] Sum rewards: 66.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.492', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.566', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:19,516][52811] DAMAGECOUNT value on done: 325880.0 [2024-08-06 02:51:19,516][52811] Sum rewards: 67.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.128', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:19,769][52650] Updated weights for policy 0, policy_version 41281 (0.0016) [2024-08-06 02:51:20,162][52664] DAMAGECOUNT value on done: 361405.0 [2024-08-06 02:51:20,162][52664] Sum rewards: 64.964, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.741', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.053', 'AMMO3': '0.135', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.318', 'weapon2': '0.322', 'WEAPON3': '0.850', 'weapon3': '2.840', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '50.000'} [2024-08-06 02:51:20,166][52658] DAMAGECOUNT value on done: 353012.0 [2024-08-06 02:51:20,166][52658] Sum rewards: 75.308, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.165', 'weapon4': '0.186', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:20,925][52669] DAMAGECOUNT value on done: 351521.0 [2024-08-06 02:51:20,927][52669] Sum rewards: 67.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.746', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:21,057][52794] DAMAGECOUNT value on done: 356278.0 [2024-08-06 02:51:21,058][52794] Sum rewards: 74.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.213', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.034', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.223', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:21,532][52671] DAMAGECOUNT value on done: 342756.0 [2024-08-06 02:51:21,534][52671] Sum rewards: 66.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.792', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.542', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:21,821][52803] DAMAGECOUNT value on done: 327549.0 [2024-08-06 02:51:21,821][52803] Sum rewards: 77.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon5': '0.204', 'weapon4': '0.210', 'AMMO3': '0.212', 'AMMO4': '0.239', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '64.000'} [2024-08-06 02:51:22,063][52660] DAMAGECOUNT value on done: 347088.0 [2024-08-06 02:51:22,064][52660] Sum rewards: 63.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.378', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.112', 'weapon4': '0.118', 'AMMO4': '0.172', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.384', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '53.000'} [2024-08-06 02:51:22,340][52795] DAMAGECOUNT value on done: 315149.0 [2024-08-06 02:51:22,343][52795] Sum rewards: 61.558, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.072', 'weapon5': '0.080', 'HEALTH': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.512', 'WEAPON3': '0.950', 'HITCOUNT': '2.700', 'weapon3': '3.166', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '50.000'} [2024-08-06 02:51:22,551][52811] DAMAGECOUNT value on done: 329150.0 [2024-08-06 02:51:22,552][52811] Sum rewards: 79.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.005', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.154', 'AMMO3': '0.166', 'weapon4': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.868', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '64.000'} [2024-08-06 02:51:22,740][52664] DAMAGECOUNT value on done: 362087.0 [2024-08-06 02:51:22,740][52664] Sum rewards: 65.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.021', 'AMMO2': '0.041', 'AMMO3': '0.147', 'weapon5': '0.200', 'AMMO4': '0.206', 'weapon4': '0.306', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.944', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '53.500'} [2024-08-06 02:51:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 338223104. Throughput: 0: 4369.6. Samples: 84559570. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:51:22,802][52567] Avg episode reward: [(0, '68.250')] [2024-08-06 02:51:23,008][52658] DAMAGECOUNT value on done: 343576.0 [2024-08-06 02:51:23,009][52658] Sum rewards: 75.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.150', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.173', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '65.000'} [2024-08-06 02:51:23,176][52664] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:51:24,201][52794] DAMAGECOUNT value on done: 343259.0 [2024-08-06 02:51:24,202][52794] Sum rewards: 74.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.101', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon4': '0.274', 'weapon2': '0.634', 'WEAPON3': '0.850', 'weapon3': '2.882', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:24,500][52650] Updated weights for policy 0, policy_version 41291 (0.0021) [2024-08-06 02:51:24,638][52671] DAMAGECOUNT value on done: 349702.0 [2024-08-06 02:51:24,639][52671] Sum rewards: 69.881, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.036', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.330', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '59.000'} [2024-08-06 02:51:24,985][52803] DAMAGECOUNT value on done: 319705.0 [2024-08-06 02:51:24,989][52803] Sum rewards: 64.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.387', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.171', 'AMMO4': '0.203', 'weapon5': '0.212', 'weapon4': '0.234', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '2.966', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:25,258][52660] DAMAGECOUNT value on done: 342126.0 [2024-08-06 02:51:25,258][52660] Sum rewards: 69.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:25,385][52664] DAMAGECOUNT value on done: 357504.0 [2024-08-06 02:51:25,385][52664] Sum rewards: 72.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.688', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.072', 'AMMO4': '0.128', 'weapon5': '0.160', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.270', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:25,434][52795] DAMAGECOUNT value on done: 320229.0 [2024-08-06 02:51:25,435][52795] Sum rewards: 70.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.626', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.128', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:25,600][52811] DAMAGECOUNT value on done: 324045.0 [2024-08-06 02:51:25,602][52811] Sum rewards: 68.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.126', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:25,749][52658] DAMAGECOUNT value on done: 347997.0 [2024-08-06 02:51:25,750][52658] Sum rewards: 59.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.334', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.158', 'AMMO4': '0.159', 'weapon5': '0.168', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '51.000'} [2024-08-06 02:51:27,413][52671] DAMAGECOUNT value on done: 354105.0 [2024-08-06 02:51:27,414][52671] Sum rewards: 63.977, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.187', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.120', 'weapon4': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.600', 'weapon3': '2.974', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:27,444][52794] DAMAGECOUNT value on done: 356887.0 [2024-08-06 02:51:27,445][52794] Sum rewards: 67.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.957', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.146', 'weapon4': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '0.950', 'weapon3': '2.954', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '53.000'} [2024-08-06 02:51:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 338305024. Throughput: 0: 4365.1. Samples: 84585780. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:51:27,795][52567] Avg episode reward: [(0, '68.355')] [2024-08-06 02:51:27,830][52664] DAMAGECOUNT value on done: 358241.0 [2024-08-06 02:51:27,832][52664] Sum rewards: 69.366, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.114', 'weapon5': '0.130', 'AMMO4': '0.160', 'weapon2': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '59.000'} [2024-08-06 02:51:28,116][52803] DAMAGECOUNT value on done: 319321.0 [2024-08-06 02:51:28,116][52803] Sum rewards: 62.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.102', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.086', 'weapon5': '0.132', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'weapon2': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.126', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:28,534][52795] DAMAGECOUNT value on done: 320995.0 [2024-08-06 02:51:28,536][52795] Sum rewards: 62.693, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.198', 'AMMO3': '0.226', 'AMMO4': '0.247', 'weapon2': '0.270', 'weapon5': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'HEALTH': '1.092', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2024-08-06 02:51:28,804][52811] DAMAGECOUNT value on done: 324522.0 [2024-08-06 02:51:28,805][52811] Sum rewards: 67.369, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HEALTH': '0.018', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.266', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:28,874][52658] DAMAGECOUNT value on done: 350846.0 [2024-08-06 02:51:28,875][52658] Sum rewards: 62.135, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.877', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.083', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.732', 'WEAPON3': '1.050', 'weapon3': '2.924', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '50.000'} [2024-08-06 02:51:29,107][52650] Updated weights for policy 0, policy_version 41301 (0.0014) [2024-08-06 02:51:30,174][52671] DAMAGECOUNT value on done: 345780.0 [2024-08-06 02:51:30,174][52671] Sum rewards: 65.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.571', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.088', 'AMMO4': '0.180', 'AMMO3': '0.196', 'weapon5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '2.966', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '53.000'} [2024-08-06 02:51:30,635][52794] DAMAGECOUNT value on done: 349317.0 [2024-08-06 02:51:30,637][52794] Sum rewards: 63.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.924', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.132', 'weapon4': '0.174', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.218', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.276', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '52.000'} [2024-08-06 02:51:30,726][52664] DAMAGECOUNT value on done: 359213.0 [2024-08-06 02:51:30,727][52664] Sum rewards: 62.748, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.325', 'AMMO5': '0.010', 'AMMO2': '0.065', 'weapon5': '0.100', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.268', 'AMMO3': '0.275', 'AMMO4': '0.323', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.066', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:31,205][52803] DAMAGECOUNT value on done: 319112.0 [2024-08-06 02:51:31,207][52803] Sum rewards: 59.692, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.628', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.134', 'AMMO3': '0.156', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '0.950', 'HITCOUNT': '2.700', 'weapon3': '3.008', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '49.000'} [2024-08-06 02:51:31,757][52795] DAMAGECOUNT value on done: 321196.0 [2024-08-06 02:51:31,759][52811] DAMAGECOUNT value on done: 332141.0 [2024-08-06 02:51:31,759][52795] Sum rewards: 70.364, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.425', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.142', 'weapon5': '0.220', 'AMMO4': '0.265', 'AMMO3': '0.274', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '59.500'} [2024-08-06 02:51:31,763][52811] Sum rewards: 72.639, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.085', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.166', 'AMMO4': '0.221', 'weapon5': '0.244', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.000', 'weapon3': '2.706', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 338395136. Throughput: 0: 4363.8. Samples: 84598680. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:51:32,802][52567] Avg episode reward: [(0, '67.717')] [2024-08-06 02:51:32,940][52671] DAMAGECOUNT value on done: 359124.0 [2024-08-06 02:51:32,941][52671] Sum rewards: 73.399, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.168', 'weapon4': '0.170', 'AMMO4': '0.204', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:33,108][52664] DAMAGECOUNT value on done: 360263.0 [2024-08-06 02:51:33,108][52664] Sum rewards: 51.925, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.498', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.118', 'AMMO3': '0.303', 'weapon5': '0.310', 'AMMO4': '0.346', 'weapon2': '0.416', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'HITCOUNT': '2.540', 'weapon3': '2.792', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '49.000'} [2024-08-06 02:51:33,843][52650] Updated weights for policy 0, policy_version 41311 (0.0015) [2024-08-06 02:51:34,011][52794] DAMAGECOUNT value on done: 349069.0 [2024-08-06 02:51:34,013][52794] Sum rewards: 64.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.186', 'AMMO4': '0.189', 'weapon5': '0.190', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:34,102][52803] DAMAGECOUNT value on done: 324338.0 [2024-08-06 02:51:34,104][52803] Sum rewards: 73.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.024', 'weapon5': '0.090', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:34,644][52811] DAMAGECOUNT value on done: 323399.0 [2024-08-06 02:51:34,645][52811] Sum rewards: 75.765, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.158', 'AMMO3': '0.165', 'AMMO4': '0.258', 'weapon5': '0.264', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '59.000'} [2024-08-06 02:51:35,007][52795] DAMAGECOUNT value on done: 327961.0 [2024-08-06 02:51:35,007][52795] Sum rewards: 76.433, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.002', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.132', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '64.000'} [2024-08-06 02:51:35,754][52664] DAMAGECOUNT value on done: 351551.0 [2024-08-06 02:51:35,755][52664] Sum rewards: 78.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.004', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.060', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.205', 'WEAPON3': '1.350', 'weapon3': '3.578', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '65.000'} [2024-08-06 02:51:36,122][52671] DAMAGECOUNT value on done: 346082.0 [2024-08-06 02:51:36,122][52671] Sum rewards: 60.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.935', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.152', 'weapon5': '0.160', 'AMMO4': '0.214', 'AMMO3': '0.243', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '52.000'} [2024-08-06 02:51:36,945][52794] DAMAGECOUNT value on done: 358504.0 [2024-08-06 02:51:36,947][52794] Sum rewards: 74.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.256', 'WEAPON3': '1.600', 'weapon3': '3.442', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:37,278][52803] DAMAGECOUNT value on done: 319424.0 [2024-08-06 02:51:37,280][52803] Sum rewards: 72.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.556', 'AMMO5': '0.018', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.168', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:37,754][52811] DAMAGECOUNT value on done: 325538.0 [2024-08-06 02:51:37,756][52811] Sum rewards: 66.436, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.040', 'AMMO5': '0.023', 'AMMO2': '0.072', 'weapon4': '0.180', 'weapon5': '0.226', 'AMMO3': '0.263', 'AMMO4': '0.360', 'weapon2': '0.516', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.636', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '58.500'} [2024-08-06 02:51:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 338485248. Throughput: 0: 4371.3. Samples: 84624950. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:51:37,794][52567] Avg episode reward: [(0, '67.591')] [2024-08-06 02:51:38,251][52795] DAMAGECOUNT value on done: 324445.0 [2024-08-06 02:51:38,252][52795] Sum rewards: 76.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.692', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.102', 'weapon5': '0.152', 'AMMO3': '0.206', 'AMMO4': '0.243', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:38,495][52650] Updated weights for policy 0, policy_version 41321 (0.0036) [2024-08-06 02:51:38,803][52664] DAMAGECOUNT value on done: 362810.0 [2024-08-06 02:51:38,803][52664] Sum rewards: 58.632, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.175', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO4': '0.238', 'AMMO3': '0.246', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '52.000'} [2024-08-06 02:51:39,014][52671] DAMAGECOUNT value on done: 340129.0 [2024-08-06 02:51:39,016][52671] Sum rewards: 79.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.216', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '66.000'} [2024-08-06 02:51:39,462][52670] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:51:39,700][52794] DAMAGECOUNT value on done: 348554.0 [2024-08-06 02:51:39,700][52794] Sum rewards: 66.942, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.270', 'weapon2': '0.338', 'WEAPON3': '1.600', 'HITCOUNT': '3.320', 'weapon3': '3.358', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:40,336][52803] DAMAGECOUNT value on done: 327395.0 [2024-08-06 02:51:40,336][52803] Sum rewards: 57.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.800', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.212', 'weapon4': '0.244', 'weapon2': '0.270', 'AMMO4': '0.287', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.998', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '51.000'} [2024-08-06 02:51:40,825][52811] DAMAGECOUNT value on done: 330187.0 [2024-08-06 02:51:40,827][52811] Sum rewards: 62.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.728', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.492', 'WEAPON3': '1.700', 'weapon3': '3.100', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:41,439][52795] DAMAGECOUNT value on done: 310874.0 [2024-08-06 02:51:41,439][52795] Sum rewards: 54.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.851', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.053', 'weapon5': '0.158', 'weapon4': '0.192', 'AMMO3': '0.197', 'AMMO4': '0.262', 'WEAPON5': '0.450', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.928', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '45.000'} [2024-08-06 02:51:41,713][52671] DAMAGECOUNT value on done: 353859.0 [2024-08-06 02:51:41,713][52671] Sum rewards: 73.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.044', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.000'} [2024-08-06 02:51:42,049][52664] DAMAGECOUNT value on done: 357384.0 [2024-08-06 02:51:42,052][52664] Sum rewards: 68.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.312', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.046', 'weapon5': '0.064', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '59.000'} [2024-08-06 02:51:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 338567168. Throughput: 0: 4378.9. Samples: 84651510. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:51:42,795][52567] Avg episode reward: [(0, '67.677')] [2024-08-06 02:51:43,089][52650] Updated weights for policy 0, policy_version 41331 (0.0019) [2024-08-06 02:51:43,483][52803] DAMAGECOUNT value on done: 325275.0 [2024-08-06 02:51:43,483][52803] Sum rewards: 68.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.556', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.185', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.300', 'weapon5': '0.320', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '56.500'} [2024-08-06 02:51:43,740][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:51:43,975][52811] DAMAGECOUNT value on done: 321308.0 [2024-08-06 02:51:43,978][52811] Sum rewards: 78.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.164', 'weapon5': '0.196', 'AMMO3': '0.202', 'AMMO4': '0.227', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '64.000'} [2024-08-06 02:51:44,581][52795] DAMAGECOUNT value on done: 327918.0 [2024-08-06 02:51:44,582][52795] Sum rewards: 72.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.484', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.078', 'weapon5': '0.148', 'AMMO4': '0.156', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 02:51:44,919][52671] DAMAGECOUNT value on done: 353850.0 [2024-08-06 02:51:44,921][52671] Sum rewards: 67.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon2': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '3.370', 'weapon3': '3.526', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:45,300][52664] DAMAGECOUNT value on done: 363381.0 [2024-08-06 02:51:45,300][52664] Sum rewards: 62.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.629', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.215', 'weapon2': '0.286', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.212', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '53.000'} [2024-08-06 02:51:46,606][52803] DAMAGECOUNT value on done: 321945.0 [2024-08-06 02:51:46,609][52803] Sum rewards: 69.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.789', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.240', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:47,110][52811] DAMAGECOUNT value on done: 327219.0 [2024-08-06 02:51:47,111][52811] Sum rewards: 65.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.859', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.124', 'weapon4': '0.126', 'AMMO3': '0.217', 'AMMO4': '0.246', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:47,738][52795] DAMAGECOUNT value on done: 318005.0 [2024-08-06 02:51:47,740][52795] Sum rewards: 59.367, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.825', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.074', 'weapon5': '0.196', 'AMMO4': '0.219', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.910', 'weapon3': '2.984', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 338657280. Throughput: 0: 4380.0. Samples: 84664470. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 02:51:47,802][52567] Avg episode reward: [(0, '67.867')] [2024-08-06 02:51:48,085][52671] DAMAGECOUNT value on done: 355731.0 [2024-08-06 02:51:48,087][52671] Sum rewards: 68.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.180', 'AMMO3': '0.226', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.300', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:48,109][52664] DAMAGECOUNT value on done: 359718.0 [2024-08-06 02:51:48,110][52664] Sum rewards: 74.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.060', 'weapon4': '0.090', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:48,125][52650] Updated weights for policy 0, policy_version 41341 (0.0014) [2024-08-06 02:51:49,749][52803] DAMAGECOUNT value on done: 327386.0 [2024-08-06 02:51:49,750][52803] Sum rewards: 58.593, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.914', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.094', 'weapon4': '0.208', 'AMMO4': '0.248', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '53.000'} [2024-08-06 02:51:50,294][52811] DAMAGECOUNT value on done: 325133.0 [2024-08-06 02:51:50,294][52811] Sum rewards: 64.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.564', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:50,727][52671] DAMAGECOUNT value on done: 347918.0 [2024-08-06 02:51:50,729][52671] Sum rewards: 72.986, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.699', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.136', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.274', 'weapon2': '0.360', 'WEAPON3': '0.900', 'weapon3': '3.044', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '57.000'} [2024-08-06 02:51:50,817][52795] DAMAGECOUNT value on done: 318611.0 [2024-08-06 02:51:50,817][52795] Sum rewards: 78.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.235', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.106', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '64.000'} [2024-08-06 02:51:50,919][52664] DAMAGECOUNT value on done: 368089.0 [2024-08-06 02:51:50,920][52664] Sum rewards: 78.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.854', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.176', 'AMMO3': '0.178', 'weapon2': '0.212', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '65.500'} [2024-08-06 02:51:51,322][52659] DAMAGECOUNT value on done: 348090.0 [2024-08-06 02:51:51,323][52659] Sum rewards: 62.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.880', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.190', 'weapon2': '0.196', 'AMMO3': '0.277', 'weapon4': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:52,292][52666] DAMAGECOUNT value on done: 348038.0 [2024-08-06 02:51:52,293][52666] Sum rewards: 58.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.486', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.195', 'weapon5': '0.196', 'weapon4': '0.296', 'AMMO4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.722', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '49.000'} [2024-08-06 02:51:52,320][52650] Updated weights for policy 0, policy_version 41351 (0.0012) [2024-08-06 02:51:52,683][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:51:52,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 338755584. Throughput: 0: 4376.4. Samples: 84690870. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:51:52,794][52567] Avg episode reward: [(0, '67.709')] [2024-08-06 02:51:52,881][52803] DAMAGECOUNT value on done: 321661.0 [2024-08-06 02:51:52,884][52803] Sum rewards: 66.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.118', 'weapon5': '0.186', 'AMMO4': '0.197', 'weapon2': '0.232', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.232', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:53,434][52664] DAMAGECOUNT value on done: 360438.0 [2024-08-06 02:51:53,434][52664] Sum rewards: 64.177, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.700', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.080', 'weapon4': '0.142', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.276', 'AMMO3': '0.287', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.212', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '58.000'} [2024-08-06 02:51:53,499][52811] DAMAGECOUNT value on done: 321937.0 [2024-08-06 02:51:53,501][52811] Sum rewards: 51.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.804', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.120', 'weapon4': '0.126', 'AMMO3': '0.228', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.726', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.810', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '46.000'} [2024-08-06 02:51:53,698][52671] DAMAGECOUNT value on done: 345988.0 [2024-08-06 02:51:53,698][52671] Sum rewards: 67.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.656', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.145', 'weapon4': '0.338', 'weapon2': '0.438', 'WEAPON3': '0.900', 'weapon3': '3.038', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:53,909][52795] DAMAGECOUNT value on done: 315832.0 [2024-08-06 02:51:53,909][52795] Sum rewards: 77.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.186', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'weapon4': '0.202', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.000'} [2024-08-06 02:51:54,318][52659] DAMAGECOUNT value on done: 348162.0 [2024-08-06 02:51:54,318][52659] Sum rewards: 84.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.088', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '69.000'} [2024-08-06 02:51:55,250][52666] DAMAGECOUNT value on done: 351435.0 [2024-08-06 02:51:55,251][52666] Sum rewards: 68.794, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.261', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.140', 'AMMO4': '0.172', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.280', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:56,131][52803] DAMAGECOUNT value on done: 321483.0 [2024-08-06 02:51:56,132][52803] Sum rewards: 76.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.915', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.115', 'weapon5': '0.140', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.210', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '65.000'} [2024-08-06 02:51:56,192][52664] DAMAGECOUNT value on done: 366125.0 [2024-08-06 02:51:56,192][52664] Sum rewards: 66.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.426', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '56.000'} [2024-08-06 02:51:56,505][52811] DAMAGECOUNT value on done: 323868.0 [2024-08-06 02:51:56,507][52811] Sum rewards: 53.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.142', 'AMMO4': '0.168', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.024', 'DAMAGECOUNT': '14.571', 'FRAGCOUNT': '47.000'} [2024-08-06 02:51:57,000][52795] DAMAGECOUNT value on done: 324374.0 [2024-08-06 02:51:57,000][52795] Sum rewards: 73.876, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.960', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.214', 'AMMO4': '0.220', 'weapon2': '0.230', 'AMMO3': '0.255', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:57,395][52659] DAMAGECOUNT value on done: 347186.0 [2024-08-06 02:51:57,396][52659] Sum rewards: 51.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.155', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.120', 'weapon4': '0.174', 'weapon2': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '2.630', 'weapon3': '3.352', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '46.000'} [2024-08-06 02:51:57,566][52650] Updated weights for policy 0, policy_version 41361 (0.0026) [2024-08-06 02:51:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 338829312. Throughput: 0: 4381.8. Samples: 84717170. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:51:57,802][52567] Avg episode reward: [(0, '68.064')] [2024-08-06 02:51:58,315][52666] DAMAGECOUNT value on done: 350609.0 [2024-08-06 02:51:58,315][52666] Sum rewards: 65.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.120', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.148', 'AMMO4': '0.181', 'weapon5': '0.190', 'AMMO3': '0.225', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '54.000'} [2024-08-06 02:51:58,900][52670] DAMAGECOUNT value on done: 343521.0 [2024-08-06 02:51:58,900][52670] Sum rewards: 74.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.221', 'weapon2': '0.254', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '63.000'} [2024-08-06 02:51:59,035][52664] DAMAGECOUNT value on done: 356520.0 [2024-08-06 02:51:59,036][52664] Sum rewards: 70.481, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'weapon2': '0.484', 'WEAPON3': '0.900', 'HITCOUNT': '3.270', 'weapon3': '3.288', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '55.000'} [2024-08-06 02:51:59,256][52803] DAMAGECOUNT value on done: 331210.0 [2024-08-06 02:51:59,257][52803] Sum rewards: 74.951, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.870', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.051', 'AMMO3': '0.134', 'weapon5': '0.148', 'WEAPON4': '0.200', 'weapon2': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.702', 'WEAPON3': '0.900', 'weapon3': '2.652', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '60.000'} [2024-08-06 02:51:59,615][52811] DAMAGECOUNT value on done: 325621.0 [2024-08-06 02:51:59,617][52811] Sum rewards: 64.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.052', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:00,058][52795] DAMAGECOUNT value on done: 314948.0 [2024-08-06 02:52:00,062][52795] Sum rewards: 61.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.018', 'AMMO2': '0.065', 'AMMO3': '0.192', 'weapon5': '0.214', 'weapon2': '0.254', 'AMMO4': '0.326', 'weapon4': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:00,754][52659] DAMAGECOUNT value on done: 347495.0 [2024-08-06 02:52:00,754][52659] Sum rewards: 77.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.132', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.334', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:00,970][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:52:01,178][52666] DAMAGECOUNT value on done: 347688.0 [2024-08-06 02:52:01,179][52666] Sum rewards: 74.647, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.342', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.170', 'AMMO4': '0.223', 'weapon5': '0.238', 'weapon4': '0.312', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:01,701][52664] DAMAGECOUNT value on done: 359813.0 [2024-08-06 02:52:01,702][52664] Sum rewards: 54.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.438', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.248', 'weapon5': '0.258', 'AMMO3': '0.282', 'AMMO4': '0.301', 'weapon2': '0.514', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.640', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '49.000'} [2024-08-06 02:52:01,755][52650] Updated weights for policy 0, policy_version 41371 (0.0023) [2024-08-06 02:52:01,889][52670] DAMAGECOUNT value on done: 346870.0 [2024-08-06 02:52:01,889][52670] Sum rewards: 64.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.612', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.142', 'AMMO3': '0.222', 'AMMO4': '0.268', 'weapon2': '0.274', 'weapon4': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:02,415][52803] DAMAGECOUNT value on done: 324480.0 [2024-08-06 02:52:02,418][52803] Sum rewards: 79.787, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.735', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.106', 'weapon4': '0.124', 'AMMO4': '0.174', 'AMMO3': '0.226', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.937', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 338919424. Throughput: 0: 4376.4. Samples: 84730110. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:52:02,794][52567] Avg episode reward: [(0, '68.247')] [2024-08-06 02:52:02,888][52811] DAMAGECOUNT value on done: 322123.0 [2024-08-06 02:52:02,888][52811] Sum rewards: 67.548, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.645', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO3': '0.158', 'weapon5': '0.160', 'AMMO4': '0.171', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:03,234][52795] DAMAGECOUNT value on done: 330424.0 [2024-08-06 02:52:03,237][52795] Sum rewards: 77.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.231', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.348', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:03,377][52659] DAMAGECOUNT value on done: 342590.0 [2024-08-06 02:52:03,378][52659] Sum rewards: 75.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.160', 'weapon5': '0.160', 'weapon2': '0.166', 'AMMO3': '0.224', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.262', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '62.500'} [2024-08-06 02:52:03,811][52666] DAMAGECOUNT value on done: 344385.0 [2024-08-06 02:52:03,812][52666] Sum rewards: 77.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '62.000'} [2024-08-06 02:52:03,943][52664] DAMAGECOUNT value on done: 360870.0 [2024-08-06 02:52:03,944][52664] Sum rewards: 79.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.178', 'AMMO4': '0.200', 'weapon5': '0.232', 'weapon4': '0.332', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.652', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '65.000'} [2024-08-06 02:52:04,496][52670] DAMAGECOUNT value on done: 339398.0 [2024-08-06 02:52:04,497][52670] Sum rewards: 69.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.951', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.144', 'AMMO3': '0.236', 'weapon5': '0.266', 'AMMO4': '0.275', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 02:52:05,070][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:52:05,518][52803] DAMAGECOUNT value on done: 328518.0 [2024-08-06 02:52:05,518][52803] Sum rewards: 67.859, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'AMMO3': '0.280', 'weapon4': '0.302', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '2.924', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:05,932][52811] DAMAGECOUNT value on done: 327578.0 [2024-08-06 02:52:05,934][52811] Sum rewards: 65.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO4': '0.144', 'weapon4': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.268', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '55.000'} [2024-08-06 02:52:05,936][52671] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 02:52:06,196][52659] DAMAGECOUNT value on done: 348716.0 [2024-08-06 02:52:06,197][52659] Sum rewards: 83.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.170', 'weapon4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '68.000'} [2024-08-06 02:52:06,318][52795] DAMAGECOUNT value on done: 323150.0 [2024-08-06 02:52:06,319][52795] Sum rewards: 82.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '67.000'} [2024-08-06 02:52:06,395][52664] DAMAGECOUNT value on done: 359700.0 [2024-08-06 02:52:06,397][52664] Sum rewards: 70.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.938', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.142', 'AMMO3': '0.203', 'weapon2': '0.232', 'WEAPON3': '1.200', 'weapon3': '3.338', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:06,607][52650] Updated weights for policy 0, policy_version 41381 (0.0013) [2024-08-06 02:52:06,864][52666] DAMAGECOUNT value on done: 339423.0 [2024-08-06 02:52:06,864][52666] Sum rewards: 70.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.904', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.256', 'weapon2': '0.274', 'AMMO3': '0.275', 'weapon4': '0.396', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.660', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '60.500'} [2024-08-06 02:52:07,491][52670] DAMAGECOUNT value on done: 338526.0 [2024-08-06 02:52:07,491][52670] Sum rewards: 62.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.160', 'weapon2': '0.196', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.392', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '51.500'} [2024-08-06 02:52:07,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 339017728. Throughput: 0: 4381.8. Samples: 84756750. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:52:07,794][52567] Avg episode reward: [(0, '68.682')] [2024-08-06 02:52:08,776][52803] DAMAGECOUNT value on done: 319759.0 [2024-08-06 02:52:08,776][52803] Sum rewards: 64.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.038', 'AMMO4': '0.171', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon5': '0.302', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.028', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '51.500'} [2024-08-06 02:52:08,793][52820] DAMAGECOUNT value on done: 318430.0 [2024-08-06 02:52:08,796][52820] Sum rewards: 80.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.862', 'AMMO5': '0.009', 'AMMO2': '0.058', 'weapon5': '0.070', 'weapon4': '0.142', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.289', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:09,202][52659] DAMAGECOUNT value on done: 347772.0 [2024-08-06 02:52:09,202][52659] Sum rewards: 71.509, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.098', 'weapon2': '0.156', 'weapon5': '0.168', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.384', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '57.000'} [2024-08-06 02:52:09,319][52666] DAMAGECOUNT value on done: 348353.0 [2024-08-06 02:52:09,323][52666] Sum rewards: 69.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.346', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.106', 'AMMO4': '0.125', 'weapon2': '0.246', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.386', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '57.000'} [2024-08-06 02:52:09,334][52664] DAMAGECOUNT value on done: 359009.0 [2024-08-06 02:52:09,334][52664] Sum rewards: 65.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.146', 'AMMO4': '0.192', 'weapon4': '0.216', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.000', 'weapon3': '3.014', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:09,466][52795] DAMAGECOUNT value on done: 314559.0 [2024-08-06 02:52:09,467][52795] Sum rewards: 68.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '57.000'} [2024-08-06 02:52:10,120][52670] DAMAGECOUNT value on done: 351525.0 [2024-08-06 02:52:10,123][52670] Sum rewards: 65.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.452', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.106', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.512', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:11,215][52650] Updated weights for policy 0, policy_version 41391 (0.0018) [2024-08-06 02:52:11,816][52820] DAMAGECOUNT value on done: 323300.0 [2024-08-06 02:52:11,818][52820] Sum rewards: 67.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.724', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.085', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:12,158][52659] DAMAGECOUNT value on done: 345429.0 [2024-08-06 02:52:12,158][52659] Sum rewards: 70.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.656', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.094', 'weapon5': '0.138', 'AMMO4': '0.225', 'weapon2': '0.260', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.234', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:12,362][52666] DAMAGECOUNT value on done: 345951.0 [2024-08-06 02:52:12,368][52666] Sum rewards: 71.042, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.935', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '57.000'} [2024-08-06 02:52:12,788][52795] DAMAGECOUNT value on done: 324254.0 [2024-08-06 02:52:12,788][52795] Sum rewards: 76.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.412', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.202', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 339099648. Throughput: 0: 4387.6. Samples: 84783220. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:52:12,794][52567] Avg episode reward: [(0, '68.603')] [2024-08-06 02:52:13,074][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:52:13,129][52670] DAMAGECOUNT value on done: 343654.0 [2024-08-06 02:52:13,129][52670] Sum rewards: 69.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.874', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.085', 'weapon5': '0.142', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.770', 'WEAPON3': '0.950', 'weapon3': '2.870', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '55.000'} [2024-08-06 02:52:14,857][52663] DAMAGECOUNT value on done: 352752.0 [2024-08-06 02:52:14,859][52663] Sum rewards: 74.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.038', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '62.000'} [2024-08-06 02:52:14,858][52820] DAMAGECOUNT value on done: 322031.0 [2024-08-06 02:52:14,866][52820] Sum rewards: 85.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.232', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '72.000'} [2024-08-06 02:52:15,065][52659] DAMAGECOUNT value on done: 354395.0 [2024-08-06 02:52:15,065][52659] Sum rewards: 55.909, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.375', 'AMMO5': '0.025', 'AMMO2': '0.040', 'weapon4': '0.132', 'AMMO4': '0.202', 'weapon5': '0.212', 'AMMO3': '0.271', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.838', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '51.000'} [2024-08-06 02:52:15,350][52666] DAMAGECOUNT value on done: 343163.0 [2024-08-06 02:52:15,350][52666] Sum rewards: 74.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.996', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.084', 'AMMO4': '0.132', 'AMMO3': '0.163', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '2.992', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.000'} [2024-08-06 02:52:15,768][52647] DAMAGECOUNT value on done: 366935.0 [2024-08-06 02:52:15,768][52647] Sum rewards: 60.156, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.445', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.158', 'AMMO4': '0.204', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.300', 'AMMO3': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.950', 'weapon3': '2.888', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:15,809][52670] DAMAGECOUNT value on done: 336804.0 [2024-08-06 02:52:15,809][52670] Sum rewards: 47.710, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.635', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon7': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.164', 'AMMO3': '0.165', 'AMMO4': '0.169', 'weapon5': '0.188', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon4': '1.228', 'weapon3': '2.054', 'HITCOUNT': '2.220', 'DAMAGECOUNT': '11.169', 'FRAGCOUNT': '39.000'} [2024-08-06 02:52:15,892][52650] Updated weights for policy 0, policy_version 41401 (0.0019) [2024-08-06 02:52:16,004][52795] DAMAGECOUNT value on done: 327675.0 [2024-08-06 02:52:16,004][52795] Sum rewards: 54.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.584', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.192', 'weapon4': '0.206', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '2.856', 'DAMAGECOUNT': '13.473', 'FRAGCOUNT': '47.500'} [2024-08-06 02:52:17,742][52659] DAMAGECOUNT value on done: 355408.0 [2024-08-06 02:52:17,743][52659] Sum rewards: 81.121, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.594', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.174', 'weapon4': '0.210', 'weapon2': '0.212', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.927', 'FRAGCOUNT': '68.000'} [2024-08-06 02:52:17,757][52663] DAMAGECOUNT value on done: 345537.0 [2024-08-06 02:52:17,758][52663] Sum rewards: 67.606, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.490', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.296', 'weapon2': '0.342', 'WEAPON3': '1.800', 'weapon3': '3.374', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '59.000'} [2024-08-06 02:52:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 339189760. Throughput: 0: 4394.9. Samples: 84796450. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 02:52:17,794][52567] Avg episode reward: [(0, '68.809')] [2024-08-06 02:52:17,807][52666] DAMAGECOUNT value on done: 341689.0 [2024-08-06 02:52:17,807][52666] Sum rewards: 70.070, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'weapon4': '0.102', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '3.050', 'weapon3': '3.178', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '57.000'} [2024-08-06 02:52:17,960][52820] DAMAGECOUNT value on done: 317440.0 [2024-08-06 02:52:17,961][52820] Sum rewards: 80.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'weapon5': '0.060', 'AMMO3': '0.188', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:18,521][52670] DAMAGECOUNT value on done: 341763.0 [2024-08-06 02:52:18,522][52670] Sum rewards: 82.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.180', 'weapon2': '0.194', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '67.000'} [2024-08-06 02:52:18,903][52647] DAMAGECOUNT value on done: 365624.0 [2024-08-06 02:52:18,905][52647] Sum rewards: 69.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.232', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:20,259][52659] DAMAGECOUNT value on done: 347736.0 [2024-08-06 02:52:20,260][52659] Sum rewards: 73.111, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.197', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO2': '0.052', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.166', 'WEAPON7': '0.200', 'AMMO4': '0.262', 'AMMO3': '0.263', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '64.000'} [2024-08-06 02:52:20,432][52650] Updated weights for policy 0, policy_version 41411 (0.0017) [2024-08-06 02:52:20,466][52666] DAMAGECOUNT value on done: 341968.0 [2024-08-06 02:52:20,468][52666] Sum rewards: 68.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'weapon5': '0.210', 'weapon2': '0.238', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon4': '0.284', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '59.500'} [2024-08-06 02:52:20,632][52663] DAMAGECOUNT value on done: 344504.0 [2024-08-06 02:52:20,634][52663] Sum rewards: 76.368, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.725', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.185', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '63.000'} [2024-08-06 02:52:21,074][52820] DAMAGECOUNT value on done: 321840.0 [2024-08-06 02:52:21,075][52820] Sum rewards: 59.380, reward structure: {'DEATHCOUNT': '-18.750', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.154', 'weapon5': '0.200', 'HEALTH': '0.274', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '3.036', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:21,291][52670] DAMAGECOUNT value on done: 344015.0 [2024-08-06 02:52:21,292][52670] Sum rewards: 72.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.016', 'AMMO5': '0.010', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.164', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:21,800][52647] DAMAGECOUNT value on done: 364517.0 [2024-08-06 02:52:21,800][52647] Sum rewards: 71.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.173', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.172', 'AMMO3': '0.195', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 339271680. Throughput: 0: 4400.0. Samples: 84822950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:52:22,802][52567] Avg episode reward: [(0, '69.473')] [2024-08-06 02:52:23,276][52666] DAMAGECOUNT value on done: 340887.0 [2024-08-06 02:52:23,280][52666] Sum rewards: 69.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.090', 'weapon5': '0.162', 'AMMO3': '0.214', 'AMMO4': '0.273', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.146', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:23,328][52659] DAMAGECOUNT value on done: 351016.0 [2024-08-06 02:52:23,330][52659] Sum rewards: 60.415, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.884', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.064', 'weapon5': '0.166', 'weapon2': '0.242', 'AMMO4': '0.250', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.010', 'weapon3': '3.264', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '54.500'} [2024-08-06 02:52:23,780][52663] DAMAGECOUNT value on done: 349674.0 [2024-08-06 02:52:23,780][52663] Sum rewards: 83.549, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.549', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.106', 'weapon5': '0.120', 'AMMO4': '0.122', 'weapon2': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '69.500'} [2024-08-06 02:52:24,086][52670] DAMAGECOUNT value on done: 336290.0 [2024-08-06 02:52:24,088][52670] Sum rewards: 63.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO2': '0.031', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.215', 'weapon2': '0.518', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:24,233][52820] DAMAGECOUNT value on done: 315972.0 [2024-08-06 02:52:24,235][52820] Sum rewards: 81.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.214', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.055', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.284', 'WEAPON3': '1.100', 'weapon3': '3.364', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '65.000'} [2024-08-06 02:52:24,648][52647] DAMAGECOUNT value on done: 370462.0 [2024-08-06 02:52:24,648][52647] Sum rewards: 74.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.352', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.174', 'AMMO4': '0.175', 'AMMO3': '0.222', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:25,192][52650] Updated weights for policy 0, policy_version 41421 (0.0012) [2024-08-06 02:52:25,295][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:52:26,332][52666] DAMAGECOUNT value on done: 350964.0 [2024-08-06 02:52:26,335][52666] Sum rewards: 66.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.336', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:26,402][52659] DAMAGECOUNT value on done: 341295.0 [2024-08-06 02:52:26,406][52659] Sum rewards: 81.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.705', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.110', 'AMMO3': '0.242', 'weapon5': '0.254', 'weapon2': '0.260', 'AMMO4': '0.270', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.435', 'FRAGCOUNT': '67.000'} [2024-08-06 02:52:26,700][52663] DAMAGECOUNT value on done: 347284.0 [2024-08-06 02:52:26,700][52663] Sum rewards: 74.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.034', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.190', 'weapon4': '0.206', 'weapon5': '0.222', 'AMMO4': '0.267', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '61.500'} [2024-08-06 02:52:27,102][52647] DAMAGECOUNT value on done: 367676.0 [2024-08-06 02:52:27,104][52647] Sum rewards: 63.190, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.077', 'weapon5': '0.114', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.300', 'weapon2': '0.384', 'WEAPON3': '0.850', 'HITCOUNT': '3.090', 'weapon3': '3.290', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '48.500'} [2024-08-06 02:52:27,342][52820] DAMAGECOUNT value on done: 319449.0 [2024-08-06 02:52:27,342][52820] Sum rewards: 68.749, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.976', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.134', 'WEAPON4': '0.200', 'weapon4': '0.212', 'AMMO3': '0.291', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.850', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:27,355][52670] DAMAGECOUNT value on done: 351034.0 [2024-08-06 02:52:27,355][52670] Sum rewards: 60.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.025', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.267', 'weapon4': '0.364', 'weapon2': '0.390', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.766', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 339361792. Throughput: 0: 4392.0. Samples: 84849150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:52:27,794][52567] Avg episode reward: [(0, '69.491')] [2024-08-06 02:52:27,815][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041427_339369984.pth... [2024-08-06 02:52:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000040915_335175680.pth [2024-08-06 02:52:28,931][52671] Large shaping reward 3.381 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.36, 120.0), ('HEALTH', -0.03, -10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:52:29,279][52663] DAMAGECOUNT value on done: 351147.0 [2024-08-06 02:52:29,280][52663] Sum rewards: 66.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.197', 'weapon2': '0.210', 'weapon5': '0.274', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '55.000'} [2024-08-06 02:52:29,351][52666] DAMAGECOUNT value on done: 348059.0 [2024-08-06 02:52:29,351][52666] Sum rewards: 66.858, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.185', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.324', 'weapon2': '0.612', 'WEAPON3': '1.850', 'weapon3': '3.100', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:29,580][52647] DAMAGECOUNT value on done: 370660.0 [2024-08-06 02:52:29,581][52647] Sum rewards: 79.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.125', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '67.000'} [2024-08-06 02:52:29,669][52659] DAMAGECOUNT value on done: 347259.0 [2024-08-06 02:52:29,670][52659] Sum rewards: 61.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.085', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.130', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.214', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '52.000'} [2024-08-06 02:52:30,056][52650] Updated weights for policy 0, policy_version 41431 (0.0023) [2024-08-06 02:52:30,256][52670] DAMAGECOUNT value on done: 342641.0 [2024-08-06 02:52:30,256][52670] Sum rewards: 63.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.221', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:30,617][52820] DAMAGECOUNT value on done: 325323.0 [2024-08-06 02:52:30,618][52820] Sum rewards: 69.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.642', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.084', 'AMMO3': '0.143', 'AMMO4': '0.196', 'weapon2': '0.204', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'HITCOUNT': '3.080', 'weapon3': '3.150', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:31,836][52647] DAMAGECOUNT value on done: 366658.0 [2024-08-06 02:52:31,836][52647] Sum rewards: 75.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.605', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.030', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.258', 'WEAPON3': '1.200', 'weapon3': '3.496', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:32,188][52663] DAMAGECOUNT value on done: 348684.0 [2024-08-06 02:52:32,190][52663] Sum rewards: 79.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.144', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:32,389][52666] DAMAGECOUNT value on done: 344954.0 [2024-08-06 02:52:32,390][52666] Sum rewards: 71.130, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.033', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.242', 'AMMO3': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.522', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 339451904. Throughput: 0: 4384.9. Samples: 84861790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:52:32,794][52567] Avg episode reward: [(0, '69.726')] [2024-08-06 02:52:32,843][52659] DAMAGECOUNT value on done: 354442.0 [2024-08-06 02:52:32,845][52659] Sum rewards: 62.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.068', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.418', 'WEAPON3': '1.600', 'HITCOUNT': '3.220', 'weapon3': '3.230', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:33,380][52670] DAMAGECOUNT value on done: 345324.0 [2024-08-06 02:52:33,388][52670] Sum rewards: 68.107, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.285', 'WEAPON3': '1.700', 'HITCOUNT': '3.150', 'weapon3': '3.276', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:33,717][52820] DAMAGECOUNT value on done: 319801.0 [2024-08-06 02:52:33,719][52820] Sum rewards: 72.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.165', 'weapon4': '0.226', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.038', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '63.000'} [2024-08-06 02:52:34,731][52650] Updated weights for policy 0, policy_version 41441 (0.0015) [2024-08-06 02:52:34,838][52647] DAMAGECOUNT value on done: 363756.0 [2024-08-06 02:52:34,838][52647] Sum rewards: 68.801, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.275', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.075', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.730', 'WEAPON3': '0.850', 'weapon3': '2.842', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:35,194][52663] DAMAGECOUNT value on done: 345740.0 [2024-08-06 02:52:35,194][52663] Sum rewards: 72.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.110', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '59.000'} [2024-08-06 02:52:35,842][52659] DAMAGECOUNT value on done: 354768.0 [2024-08-06 02:52:35,844][52659] Sum rewards: 57.029, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.601', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.123', 'weapon5': '0.144', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '3.052', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '50.000'} [2024-08-06 02:52:35,898][52666] DAMAGECOUNT value on done: 347044.0 [2024-08-06 02:52:35,898][52666] Sum rewards: 68.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.184', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:36,549][52670] DAMAGECOUNT value on done: 350013.0 [2024-08-06 02:52:36,550][52670] Sum rewards: 83.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.827', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.196', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 02:52:36,983][52820] DAMAGECOUNT value on done: 323649.0 [2024-08-06 02:52:36,984][52820] Sum rewards: 64.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.095', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.576', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:37,694][52647] DAMAGECOUNT value on done: 373121.0 [2024-08-06 02:52:37,694][52647] Sum rewards: 69.741, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.045', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.155', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 339533824. Throughput: 0: 4383.3. Samples: 84888120. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:52:37,794][52567] Avg episode reward: [(0, '69.696')] [2024-08-06 02:52:38,268][52663] DAMAGECOUNT value on done: 342586.0 [2024-08-06 02:52:38,269][52663] Sum rewards: 66.771, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.166', 'AMMO4': '0.167', 'weapon5': '0.232', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HEALTH': '0.404', 'weapon2': '0.678', 'WEAPON3': '0.900', 'weapon3': '2.430', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:38,577][52666] DAMAGECOUNT value on done: 345158.0 [2024-08-06 02:52:38,585][52666] Sum rewards: 70.073, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.232', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'HITCOUNT': '3.430', 'weapon3': '3.480', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:38,904][52659] DAMAGECOUNT value on done: 351084.0 [2024-08-06 02:52:38,905][52659] Sum rewards: 56.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.798', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.386', 'DAMAGECOUNT': '12.795', 'FRAGCOUNT': '49.000'} [2024-08-06 02:52:39,024][52650] Updated weights for policy 0, policy_version 41451 (0.0028) [2024-08-06 02:52:39,751][52670] DAMAGECOUNT value on done: 345892.0 [2024-08-06 02:52:39,751][52670] Sum rewards: 63.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.066', 'weapon5': '0.136', 'AMMO3': '0.157', 'AMMO4': '0.255', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.230', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '52.000'} [2024-08-06 02:52:40,034][52659] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.027, -9.0), ('weapon5', 0.002)] [2024-08-06 02:52:40,070][52647] DAMAGECOUNT value on done: 363770.0 [2024-08-06 02:52:40,070][52647] Sum rewards: 70.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.611', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.179', 'AMMO4': '0.284', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:40,333][52820] DAMAGECOUNT value on done: 321574.0 [2024-08-06 02:52:40,333][52820] Sum rewards: 54.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.854', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.196', 'weapon5': '0.332', 'weapon2': '0.352', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.544', 'HITCOUNT': '2.560', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '46.000'} [2024-08-06 02:52:41,171][52663] DAMAGECOUNT value on done: 349226.0 [2024-08-06 02:52:41,173][52663] Sum rewards: 64.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.356', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon2': '0.198', 'AMMO4': '0.222', 'AMMO3': '0.241', 'weapon5': '0.258', 'weapon4': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '2.954', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:41,958][52659] DAMAGECOUNT value on done: 346532.0 [2024-08-06 02:52:41,958][52659] Sum rewards: 81.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.150', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.138', 'weapon2': '0.144', 'AMMO3': '0.151', 'AMMO4': '0.181', 'weapon4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon3': '3.300', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '64.000'} [2024-08-06 02:52:41,990][52666] DAMAGECOUNT value on done: 346716.0 [2024-08-06 02:52:41,991][52666] Sum rewards: 67.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.953', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.197', 'weapon4': '0.260', 'weapon5': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.662', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:42,549][52647] DAMAGECOUNT value on done: 371172.0 [2024-08-06 02:52:42,549][52647] Sum rewards: 63.005, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.365', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.154', 'AMMO3': '0.166', 'weapon5': '0.186', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '2.942', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '52.000'} [2024-08-06 02:52:42,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 339623936. Throughput: 0: 4383.8. Samples: 84914440. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:52:42,795][52567] Avg episode reward: [(0, '69.492')] [2024-08-06 02:52:42,878][52670] DAMAGECOUNT value on done: 332895.0 [2024-08-06 02:52:42,880][52670] Sum rewards: 74.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.863', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.096', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.200', 'weapon3': '3.384', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:43,551][52820] DAMAGECOUNT value on done: 323438.0 [2024-08-06 02:52:43,555][52820] Sum rewards: 68.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.090', 'weapon4': '0.142', 'AMMO4': '0.168', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:43,874][52663] DAMAGECOUNT value on done: 352156.0 [2024-08-06 02:52:43,883][52663] Sum rewards: 72.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.974', 'AMMO5': '0.023', 'AMMO2': '0.047', 'AMMO3': '0.220', 'AMMO4': '0.236', 'weapon5': '0.276', 'weapon4': '0.294', 'weapon2': '0.530', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.570', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:44,091][52650] Updated weights for policy 0, policy_version 41461 (0.0012) [2024-08-06 02:52:44,866][52647] DAMAGECOUNT value on done: 361665.0 [2024-08-06 02:52:44,866][52647] Sum rewards: 65.656, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.873', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.311', 'weapon2': '0.422', 'WEAPON3': '1.850', 'weapon3': '3.118', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '59.000'} [2024-08-06 02:52:44,944][52659] DAMAGECOUNT value on done: 352479.0 [2024-08-06 02:52:44,945][52659] Sum rewards: 74.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.202', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:45,113][52666] DAMAGECOUNT value on done: 339314.0 [2024-08-06 02:52:45,114][52666] Sum rewards: 65.963, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.261', 'weapon2': '0.334', 'WEAPON4': '0.450', 'weapon4': '0.458', 'WEAPON3': '1.550', 'weapon3': '2.876', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:46,013][52670] DAMAGECOUNT value on done: 347063.0 [2024-08-06 02:52:46,013][52670] Sum rewards: 66.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.801', 'AMMO5': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.193', 'weapon2': '0.204', 'weapon5': '0.290', 'AMMO4': '0.307', 'weapon4': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.500'} [2024-08-06 02:52:46,835][52820] DAMAGECOUNT value on done: 327981.0 [2024-08-06 02:52:46,839][52820] Sum rewards: 85.789, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.147', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.102', 'weapon4': '0.124', 'AMMO4': '0.172', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '22.182', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:46,961][52663] DAMAGECOUNT value on done: 347725.0 [2024-08-06 02:52:46,963][52663] Sum rewards: 70.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.002', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.102', 'AMMO3': '0.223', 'weapon5': '0.246', 'AMMO4': '0.271', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:47,522][52647] DAMAGECOUNT value on done: 364268.0 [2024-08-06 02:52:47,522][52647] Sum rewards: 73.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.142', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.179', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.636', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '58.000'} [2024-08-06 02:52:47,686][52659] DAMAGECOUNT value on done: 351482.0 [2024-08-06 02:52:47,686][52659] Sum rewards: 58.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'AMMO4': '0.254', 'weapon2': '0.366', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.500', 'weapon3': '2.782', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '50.000'} [2024-08-06 02:52:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 339714048. Throughput: 0: 4384.9. Samples: 84927430. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:52:47,794][52567] Avg episode reward: [(0, '69.900')] [2024-08-06 02:52:47,893][52666] DAMAGECOUNT value on done: 345590.0 [2024-08-06 02:52:47,893][52666] Sum rewards: 71.025, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.182', 'weapon4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '60.000'} [2024-08-06 02:52:48,407][52660] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:52:48,513][52650] Updated weights for policy 0, policy_version 41471 (0.0019) [2024-08-06 02:52:48,783][52670] DAMAGECOUNT value on done: 352833.0 [2024-08-06 02:52:48,785][52670] Sum rewards: 66.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.920', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.266', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '2.952', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '55.000'} [2024-08-06 02:52:49,969][52663] DAMAGECOUNT value on done: 341120.0 [2024-08-06 02:52:49,970][52663] Sum rewards: 61.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.898', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.048', 'weapon4': '0.098', 'AMMO4': '0.175', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.354', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:50,004][52820] DAMAGECOUNT value on done: 324389.0 [2024-08-06 02:52:50,004][52820] Sum rewards: 66.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.537', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.354', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:50,043][52667] DAMAGECOUNT value on done: 347290.0 [2024-08-06 02:52:50,044][52667] Sum rewards: 68.895, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.253', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO4': '0.193', 'weapon2': '0.238', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '59.000'} [2024-08-06 02:52:50,473][52647] DAMAGECOUNT value on done: 365073.0 [2024-08-06 02:52:50,473][52647] Sum rewards: 73.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.152', 'AMMO4': '0.160', 'AMMO3': '0.190', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '59.000'} [2024-08-06 02:52:51,618][52670] DAMAGECOUNT value on done: 345674.0 [2024-08-06 02:52:51,620][52670] Sum rewards: 77.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.022', 'AMMO4': '0.074', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'weapon3': '3.440', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:52,656][52663] DAMAGECOUNT value on done: 343470.0 [2024-08-06 02:52:52,657][52663] Sum rewards: 65.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.098', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:52,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 339804160. Throughput: 0: 4380.4. Samples: 84953870. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:52:52,794][52567] Avg episode reward: [(0, '69.695')] [2024-08-06 02:52:52,856][52667] DAMAGECOUNT value on done: 352719.0 [2024-08-06 02:52:52,858][52667] Sum rewards: 76.445, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.630', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.134', 'AMMO3': '0.214', 'WEAPON3': '1.250', 'HITCOUNT': '3.590', 'weapon3': '3.700', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '64.000'} [2024-08-06 02:52:53,158][52820] DAMAGECOUNT value on done: 327300.0 [2024-08-06 02:52:53,158][52820] Sum rewards: 72.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.101', 'weapon5': '0.104', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:53,355][52650] Updated weights for policy 0, policy_version 41481 (0.0012) [2024-08-06 02:52:53,424][52647] DAMAGECOUNT value on done: 373335.0 [2024-08-06 02:52:53,425][52647] Sum rewards: 58.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.626', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.450', 'weapon3': '2.842', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '50.000'} [2024-08-06 02:52:54,763][52670] DAMAGECOUNT value on done: 344424.0 [2024-08-06 02:52:54,766][52670] Sum rewards: 69.007, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.478', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.158', 'weapon5': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.038', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '55.000'} [2024-08-06 02:52:55,276][52663] DAMAGECOUNT value on done: 344641.0 [2024-08-06 02:52:55,284][52663] Sum rewards: 62.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.691', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO4': '0.169', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '53.000'} [2024-08-06 02:52:55,791][52614] Signal inference workers to stop experience collection... (7500 times) [2024-08-06 02:52:55,797][52614] Signal inference workers to resume experience collection... (7500 times) [2024-08-06 02:52:55,834][52650] InferenceWorker_p0-w0: stopping experience collection (7500 times) [2024-08-06 02:52:55,834][52650] InferenceWorker_p0-w0: resuming experience collection (7500 times) [2024-08-06 02:52:55,939][52667] DAMAGECOUNT value on done: 348631.0 [2024-08-06 02:52:55,940][52667] Sum rewards: 67.547, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.111', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon4': '0.158', 'weapon2': '0.524', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.198', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '54.000'} [2024-08-06 02:52:56,242][52820] DAMAGECOUNT value on done: 322837.0 [2024-08-06 02:52:56,242][52820] Sum rewards: 67.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.122', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.076', 'AMMO4': '0.088', 'weapon5': '0.134', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.378', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 02:52:56,539][52647] DAMAGECOUNT value on done: 365362.0 [2024-08-06 02:52:56,539][52647] Sum rewards: 69.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.055', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.042', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '61.000'} [2024-08-06 02:52:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 339886080. Throughput: 0: 4379.6. Samples: 84980300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:52:57,794][52567] Avg episode reward: [(0, '69.240')] [2024-08-06 02:52:57,847][52650] Updated weights for policy 0, policy_version 41491 (0.0032) [2024-08-06 02:52:58,150][52663] DAMAGECOUNT value on done: 354192.0 [2024-08-06 02:52:58,151][52663] Sum rewards: 79.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.395', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.092', 'weapon5': '0.126', 'AMMO4': '0.141', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.150', 'weapon3': '3.338', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '63.000'} [2024-08-06 02:52:59,002][52667] DAMAGECOUNT value on done: 350204.0 [2024-08-06 02:52:59,006][52667] Sum rewards: 63.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.876', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon2': '0.228', 'AMMO3': '0.296', 'WEAPON3': '1.700', 'HITCOUNT': '3.260', 'weapon3': '3.530', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '56.000'} [2024-08-06 02:52:59,345][52820] DAMAGECOUNT value on done: 322759.0 [2024-08-06 02:52:59,349][52820] Sum rewards: 78.505, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.416', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.183', 'weapon4': '0.208', 'weapon5': '0.236', 'AMMO4': '0.249', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.566', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '66.000'} [2024-08-06 02:52:59,422][52647] DAMAGECOUNT value on done: 363864.0 [2024-08-06 02:52:59,423][52647] Sum rewards: 53.188, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.212', 'AMMO4': '0.222', 'weapon2': '0.274', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.880', 'weapon3': '3.118', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '47.000'} [2024-08-06 02:53:00,801][52663] DAMAGECOUNT value on done: 346828.0 [2024-08-06 02:53:00,802][52663] Sum rewards: 68.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.836', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.193', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '55.500'} [2024-08-06 02:53:02,104][52647] DAMAGECOUNT value on done: 361693.0 [2024-08-06 02:53:02,104][52647] Sum rewards: 73.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '61.000'} [2024-08-06 02:53:02,173][52667] DAMAGECOUNT value on done: 354796.0 [2024-08-06 02:53:02,175][52667] Sum rewards: 78.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.995', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.184', 'weapon4': '0.184', 'weapon2': '0.248', 'weapon5': '0.284', 'AMMO4': '0.298', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '64.000'} [2024-08-06 02:53:02,433][52820] DAMAGECOUNT value on done: 330707.0 [2024-08-06 02:53:02,436][52820] Sum rewards: 57.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.262', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'weapon4': '0.140', 'AMMO3': '0.249', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '50.000'} [2024-08-06 02:53:02,758][52650] Updated weights for policy 0, policy_version 41501 (0.0014) [2024-08-06 02:53:02,766][52669] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon5', 0.002)] [2024-08-06 02:53:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 339976192. Throughput: 0: 4376.0. Samples: 84993370. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:53:02,794][52567] Avg episode reward: [(0, '69.295')] [2024-08-06 02:53:03,081][52663] Large shaping reward 3.351 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.3, 100.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:53:03,731][52663] DAMAGECOUNT value on done: 353779.0 [2024-08-06 02:53:03,731][52663] Sum rewards: 63.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.084', 'weapon5': '0.220', 'AMMO4': '0.230', 'AMMO3': '0.237', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '55.000'} [2024-08-06 02:53:04,735][52647] DAMAGECOUNT value on done: 361124.0 [2024-08-06 02:53:04,735][52647] Sum rewards: 78.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.274', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.170', 'AMMO4': '0.218', 'AMMO3': '0.230', 'weapon2': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '66.000'} [2024-08-06 02:53:04,824][52667] DAMAGECOUNT value on done: 353437.0 [2024-08-06 02:53:04,824][52667] Sum rewards: 63.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.604', 'AMMO5': '0.019', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon4': '0.192', 'weapon5': '0.196', 'AMMO3': '0.225', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.050', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:05,485][52665] DAMAGECOUNT value on done: 342915.0 [2024-08-06 02:53:05,486][52665] Sum rewards: 61.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.062', 'AMMO4': '0.113', 'weapon5': '0.136', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '2.982', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '52.000'} [2024-08-06 02:53:05,836][52820] DAMAGECOUNT value on done: 332041.0 [2024-08-06 02:53:05,845][52820] Sum rewards: 67.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.124', 'weapon4': '0.156', 'AMMO4': '0.168', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:06,675][52663] DAMAGECOUNT value on done: 349249.0 [2024-08-06 02:53:06,677][52663] Sum rewards: 63.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.428', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.167', 'weapon2': '0.276', 'AMMO4': '0.277', 'weapon5': '0.284', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:07,273][52650] Updated weights for policy 0, policy_version 41511 (0.0047) [2024-08-06 02:53:07,449][52647] DAMAGECOUNT value on done: 364671.0 [2024-08-06 02:53:07,449][52647] Sum rewards: 61.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.886', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.196', 'AMMO4': '0.205', 'AMMO3': '0.267', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.788', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '55.000'} [2024-08-06 02:53:07,618][52667] DAMAGECOUNT value on done: 354155.0 [2024-08-06 02:53:07,620][52667] Sum rewards: 67.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon4': '0.262', 'weapon2': '0.676', 'WEAPON3': '0.950', 'weapon3': '2.756', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '55.000'} [2024-08-06 02:53:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 340058112. Throughput: 0: 4368.9. Samples: 85019550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:53:07,794][52567] Avg episode reward: [(0, '68.860')] [2024-08-06 02:53:08,642][52665] DAMAGECOUNT value on done: 351413.0 [2024-08-06 02:53:08,643][52665] Sum rewards: 81.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.118', 'AMMO5': '0.015', 'AMMO2': '0.061', 'AMMO3': '0.217', 'weapon5': '0.222', 'weapon2': '0.284', 'AMMO4': '0.307', 'WEAPON5': '0.350', 'weapon4': '0.534', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '67.000'} [2024-08-06 02:53:08,962][52820] DAMAGECOUNT value on done: 322778.0 [2024-08-06 02:53:08,963][52820] Sum rewards: 70.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.104', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.038', 'AMMO4': '0.136', 'weapon5': '0.142', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.314', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '60.000'} [2024-08-06 02:53:09,695][52663] DAMAGECOUNT value on done: 343853.0 [2024-08-06 02:53:09,698][52663] Sum rewards: 82.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.246', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.078', 'AMMO4': '0.126', 'AMMO3': '0.172', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.952', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '66.000'} [2024-08-06 02:53:09,931][52795] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:53:10,552][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:53:11,075][52667] DAMAGECOUNT value on done: 350729.0 [2024-08-06 02:53:11,083][52667] Sum rewards: 80.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.768', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.154', 'AMMO3': '0.161', 'AMMO4': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '64.000'} [2024-08-06 02:53:11,572][52665] DAMAGECOUNT value on done: 349258.0 [2024-08-06 02:53:11,573][52665] Sum rewards: 79.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon5': '0.126', 'weapon4': '0.188', 'AMMO4': '0.221', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '67.000'} [2024-08-06 02:53:12,271][52650] Updated weights for policy 0, policy_version 41521 (0.0019) [2024-08-06 02:53:12,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 340140032. Throughput: 0: 4375.5. Samples: 85046050. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 02:53:12,795][52567] Avg episode reward: [(0, '69.760')] [2024-08-06 02:53:13,402][52811] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:53:13,967][52667] DAMAGECOUNT value on done: 350315.0 [2024-08-06 02:53:13,970][52667] Sum rewards: 81.891, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 02:53:14,677][52665] DAMAGECOUNT value on done: 344005.0 [2024-08-06 02:53:14,678][52665] Sum rewards: 61.272, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO4': '0.217', 'AMMO3': '0.260', 'weapon4': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:15,834][52662] DAMAGECOUNT value on done: 359281.0 [2024-08-06 02:53:15,835][52662] Sum rewards: 55.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.921', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.231', 'AMMO4': '0.258', 'weapon5': '0.272', 'weapon4': '0.320', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '48.500'} [2024-08-06 02:53:16,472][52650] Updated weights for policy 0, policy_version 41531 (0.0029) [2024-08-06 02:53:16,922][52667] DAMAGECOUNT value on done: 357105.0 [2024-08-06 02:53:16,923][52667] Sum rewards: 67.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.951', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.278', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '56.500'} [2024-08-06 02:53:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 340238336. Throughput: 0: 4382.9. Samples: 85059020. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 02:53:17,794][52567] Avg episode reward: [(0, '69.292')] [2024-08-06 02:53:17,867][52665] DAMAGECOUNT value on done: 339880.0 [2024-08-06 02:53:17,867][52665] Sum rewards: 62.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.922', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.108', 'AMMO4': '0.118', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '51.000'} [2024-08-06 02:53:18,409][52662] DAMAGECOUNT value on done: 355449.0 [2024-08-06 02:53:18,411][52662] Sum rewards: 69.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.622', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.424', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '56.000'} [2024-08-06 02:53:20,083][52667] DAMAGECOUNT value on done: 348892.0 [2024-08-06 02:53:20,084][52667] Sum rewards: 69.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.955', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.140', 'weapon4': '0.156', 'AMMO3': '0.205', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.292', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:20,731][52668] DAMAGECOUNT value on done: 347110.0 [2024-08-06 02:53:20,732][52668] Sum rewards: 69.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.318', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO3': '0.219', 'AMMO4': '0.229', 'weapon4': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '56.000'} [2024-08-06 02:53:20,753][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:53:20,973][52665] DAMAGECOUNT value on done: 339383.0 [2024-08-06 02:53:20,975][52665] Sum rewards: 75.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.652', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.046', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'HITCOUNT': '3.340', 'weapon3': '3.406', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '65.000'} [2024-08-06 02:53:21,355][52650] Updated weights for policy 0, policy_version 41541 (0.0012) [2024-08-06 02:53:21,440][52662] DAMAGECOUNT value on done: 354350.0 [2024-08-06 02:53:21,442][52662] Sum rewards: 71.989, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.530', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'weapon4': '0.228', 'weapon2': '0.282', 'AMMO3': '0.288', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.044', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '63.000'} [2024-08-06 02:53:22,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 340328448. Throughput: 0: 4382.2. Samples: 85085320. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 02:53:22,795][52567] Avg episode reward: [(0, '69.266')] [2024-08-06 02:53:23,372][52667] DAMAGECOUNT value on done: 352771.0 [2024-08-06 02:53:23,372][52667] Sum rewards: 84.268, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.182', 'weapon2': '0.226', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '69.000'} [2024-08-06 02:53:23,829][52668] DAMAGECOUNT value on done: 352121.0 [2024-08-06 02:53:23,831][52668] Sum rewards: 71.820, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.505', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon2': '0.208', 'AMMO4': '0.218', 'weapon5': '0.226', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '63.000'} [2024-08-06 02:53:24,127][52662] DAMAGECOUNT value on done: 343990.0 [2024-08-06 02:53:24,127][52662] Sum rewards: 72.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.642', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.192', 'AMMO3': '0.207', 'weapon5': '0.278', 'WEAPON5': '0.450', 'weapon2': '0.462', 'weapon4': '0.598', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.296', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '60.000'} [2024-08-06 02:53:24,131][52665] DAMAGECOUNT value on done: 347262.0 [2024-08-06 02:53:24,131][52665] Sum rewards: 71.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.616', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.145', 'weapon5': '0.184', 'weapon2': '0.212', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '59.000'} [2024-08-06 02:53:24,278][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:53:25,833][52650] Updated weights for policy 0, policy_version 41551 (0.0031) [2024-08-06 02:53:25,918][52649] DAMAGECOUNT value on done: 343215.0 [2024-08-06 02:53:25,919][52649] Sum rewards: 68.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.711', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.123', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:25,948][52667] DAMAGECOUNT value on done: 352342.0 [2024-08-06 02:53:25,948][52667] Sum rewards: 66.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.225', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.094', 'AMMO4': '0.187', 'weapon4': '0.212', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:26,388][52665] DAMAGECOUNT value on done: 350457.0 [2024-08-06 02:53:26,389][52665] Sum rewards: 71.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.898', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.164', 'AMMO4': '0.173', 'weapon5': '0.218', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:26,568][52668] DAMAGECOUNT value on done: 353351.0 [2024-08-06 02:53:26,568][52668] Sum rewards: 65.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.136', 'weapon4': '0.140', 'AMMO4': '0.201', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:27,093][52662] DAMAGECOUNT value on done: 355358.0 [2024-08-06 02:53:27,095][52662] Sum rewards: 58.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.199', 'weapon2': '0.628', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.166', 'DAMAGECOUNT': '13.476', 'FRAGCOUNT': '49.000'} [2024-08-06 02:53:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 340410368. Throughput: 0: 4377.6. Samples: 85111430. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 02:53:27,794][52567] Avg episode reward: [(0, '69.071')] [2024-08-06 02:53:28,315][52667] DAMAGECOUNT value on done: 347055.0 [2024-08-06 02:53:28,315][52667] Sum rewards: 77.485, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.410', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '68.000'} [2024-08-06 02:53:28,976][52649] DAMAGECOUNT value on done: 335567.0 [2024-08-06 02:53:28,977][52649] Sum rewards: 65.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.970', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.128', 'weapon5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.242', 'AMMO4': '0.261', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.254', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:29,463][52665] DAMAGECOUNT value on done: 348705.0 [2024-08-06 02:53:29,465][52665] Sum rewards: 79.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.841', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.184', 'weapon5': '0.186', 'AMMO3': '0.201', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '64.000'} [2024-08-06 02:53:29,618][52662] DAMAGECOUNT value on done: 348057.0 [2024-08-06 02:53:29,620][52662] Sum rewards: 70.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.706', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.146', 'AMMO4': '0.181', 'AMMO3': '0.202', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '59.000'} [2024-08-06 02:53:29,636][52668] DAMAGECOUNT value on done: 354936.0 [2024-08-06 02:53:29,638][52668] Sum rewards: 69.781, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.249', 'AMMO5': '0.007', 'AMMO2': '0.022', 'ARMOR': '0.040', 'weapon5': '0.104', 'AMMO4': '0.107', 'weapon4': '0.132', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.712', 'WEAPON3': '0.850', 'weapon3': '2.840', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '55.000'} [2024-08-06 02:53:30,562][52650] Updated weights for policy 0, policy_version 41561 (0.0015) [2024-08-06 02:53:30,987][52667] DAMAGECOUNT value on done: 353813.0 [2024-08-06 02:53:30,988][52667] Sum rewards: 66.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.897', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.104', 'AMMO3': '0.133', 'AMMO4': '0.191', 'weapon5': '0.238', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.644', 'WEAPON3': '0.900', 'weapon3': '2.440', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:31,342][52649] DAMAGECOUNT value on done: 342371.0 [2024-08-06 02:53:31,343][52649] Sum rewards: 84.878, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.411', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.167', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '68.000'} [2024-08-06 02:53:31,739][52665] DAMAGECOUNT value on done: 346504.0 [2024-08-06 02:53:31,739][52665] Sum rewards: 76.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.258', 'weapon4': '0.272', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 02:53:32,327][52662] DAMAGECOUNT value on done: 357061.0 [2024-08-06 02:53:32,327][52662] Sum rewards: 68.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'AMMO5': '0.025', 'AMMO2': '0.073', 'AMMO3': '0.239', 'weapon5': '0.250', 'weapon4': '0.310', 'weapon2': '0.362', 'AMMO4': '0.363', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.706', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 02:53:32,426][52668] DAMAGECOUNT value on done: 345765.0 [2024-08-06 02:53:32,427][52668] Sum rewards: 85.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.324', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon2': '0.196', 'AMMO4': '0.200', 'AMMO3': '0.206', 'weapon5': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '70.000'} [2024-08-06 02:53:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 340500480. Throughput: 0: 4381.3. Samples: 85124590. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 02:53:32,794][52567] Avg episode reward: [(0, '69.778')] [2024-08-06 02:53:33,823][52667] DAMAGECOUNT value on done: 359013.0 [2024-08-06 02:53:33,824][52667] Sum rewards: 66.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.202', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon4': '0.372', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.826', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2024-08-06 02:53:34,350][52649] DAMAGECOUNT value on done: 340009.0 [2024-08-06 02:53:34,353][52649] Sum rewards: 68.346, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.602', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '59.000'} [2024-08-06 02:53:34,817][52668] DAMAGECOUNT value on done: 354549.0 [2024-08-06 02:53:34,818][52668] Sum rewards: 62.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO4': '0.150', 'weapon2': '0.230', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.396', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '55.000'} [2024-08-06 02:53:34,917][52665] DAMAGECOUNT value on done: 353273.0 [2024-08-06 02:53:34,918][52665] Sum rewards: 55.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.360', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '46.000'} [2024-08-06 02:53:35,031][52662] DAMAGECOUNT value on done: 360253.0 [2024-08-06 02:53:35,033][52662] Sum rewards: 74.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.665', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.138', 'weapon4': '0.148', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '61.000'} [2024-08-06 02:53:35,319][52650] Updated weights for policy 0, policy_version 41571 (0.0012) [2024-08-06 02:53:35,392][52669] DAMAGECOUNT value on done: 353999.0 [2024-08-06 02:53:35,394][52669] Sum rewards: 65.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.030', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '53.500'} [2024-08-06 02:53:36,637][52667] DAMAGECOUNT value on done: 358566.0 [2024-08-06 02:53:36,639][52667] Sum rewards: 73.465, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '59.000'} [2024-08-06 02:53:37,178][52649] DAMAGECOUNT value on done: 333169.0 [2024-08-06 02:53:37,187][52649] Sum rewards: 78.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.066', 'weapon4': '0.140', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '67.000'} [2024-08-06 02:53:37,588][52668] DAMAGECOUNT value on done: 352836.0 [2024-08-06 02:53:37,590][52668] Sum rewards: 84.768, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.083', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.191', 'weapon2': '0.246', 'WEAPON3': '1.200', 'weapon3': '3.406', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '69.000'} [2024-08-06 02:53:37,724][52665] DAMAGECOUNT value on done: 348293.0 [2024-08-06 02:53:37,725][52665] Sum rewards: 75.944, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.170', 'weapon4': '0.244', 'weapon5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.962', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 340590592. Throughput: 0: 4379.1. Samples: 85150930. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:53:37,795][52567] Avg episode reward: [(0, '69.879')] [2024-08-06 02:53:38,034][52662] DAMAGECOUNT value on done: 351021.0 [2024-08-06 02:53:38,036][52662] Sum rewards: 67.666, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.150', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO4': '0.165', 'AMMO3': '0.240', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '59.000'} [2024-08-06 02:53:38,220][52669] DAMAGECOUNT value on done: 346156.0 [2024-08-06 02:53:38,224][52669] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.057', 'AMMO3': '0.166', 'weapon5': '0.176', 'weapon4': '0.242', 'AMMO4': '0.287', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:39,099][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:53:39,405][52660] DAMAGECOUNT value on done: 347588.0 [2024-08-06 02:53:39,407][52660] Sum rewards: 74.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.883', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.230', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.416', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '63.000'} [2024-08-06 02:53:39,460][52667] DAMAGECOUNT value on done: 357639.0 [2024-08-06 02:53:39,460][52667] Sum rewards: 57.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.876', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.118', 'weapon4': '0.144', 'AMMO3': '0.180', 'weapon2': '0.570', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.180', 'DAMAGECOUNT': '13.815', 'FRAGCOUNT': '48.000'} [2024-08-06 02:53:39,751][52666] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.552, 184.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:53:40,145][52649] DAMAGECOUNT value on done: 344527.0 [2024-08-06 02:53:40,147][52649] Sum rewards: 76.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.570', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon4': '0.160', 'AMMO4': '0.210', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '63.000'} [2024-08-06 02:53:40,155][52650] Updated weights for policy 0, policy_version 41581 (0.0034) [2024-08-06 02:53:40,625][52662] DAMAGECOUNT value on done: 363446.0 [2024-08-06 02:53:40,627][52662] Sum rewards: 60.879, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.800', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon5': '0.208', 'weapon4': '0.210', 'weapon2': '0.290', 'AMMO4': '0.295', 'AMMO3': '0.327', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.850', 'weapon3': '2.914', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:40,684][52668] DAMAGECOUNT value on done: 346449.0 [2024-08-06 02:53:40,684][52668] Sum rewards: 73.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.840', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.154', 'weapon5': '0.202', 'weapon2': '0.236', 'AMMO4': '0.278', 'weapon4': '0.368', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.946', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '60.000'} [2024-08-06 02:53:40,713][52665] DAMAGECOUNT value on done: 345426.0 [2024-08-06 02:53:40,715][52665] Sum rewards: 67.943, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.885', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.151', 'weapon5': '0.210', 'AMMO4': '0.231', 'weapon4': '0.256', 'weapon2': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:40,835][52669] DAMAGECOUNT value on done: 353058.0 [2024-08-06 02:53:40,836][52669] Sum rewards: 67.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.522', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.177', 'weapon5': '0.184', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.750', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '53.000'} [2024-08-06 02:53:41,973][52667] DAMAGECOUNT value on done: 350719.0 [2024-08-06 02:53:41,974][52667] Sum rewards: 72.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.114', 'AMMO3': '0.192', 'weapon5': '0.216', 'weapon2': '0.230', 'AMMO4': '0.237', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '60.000'} [2024-08-06 02:53:42,086][52658] DAMAGECOUNT value on done: 349698.0 [2024-08-06 02:53:42,087][52658] Sum rewards: 66.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.733', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.176', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '56.000'} [2024-08-06 02:53:42,388][52660] DAMAGECOUNT value on done: 344146.0 [2024-08-06 02:53:42,396][52660] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO3': '0.154', 'weapon4': '0.180', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.218', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '53.000'} [2024-08-06 02:53:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 340672512. Throughput: 0: 4376.0. Samples: 85177220. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:53:42,794][52567] Avg episode reward: [(0, '69.914')] [2024-08-06 02:53:43,359][52649] DAMAGECOUNT value on done: 338469.0 [2024-08-06 02:53:43,360][52649] Sum rewards: 60.685, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.146', 'AMMO3': '0.156', 'AMMO4': '0.275', 'weapon5': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.646', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '47.000'} [2024-08-06 02:53:43,471][52662] DAMAGECOUNT value on done: 348619.0 [2024-08-06 02:53:43,472][52662] Sum rewards: 69.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '58.500'} [2024-08-06 02:53:43,692][52668] DAMAGECOUNT value on done: 349296.0 [2024-08-06 02:53:43,694][52668] Sum rewards: 59.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon7': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.170', 'weapon5': '0.174', 'AMMO3': '0.195', 'WEAPON7': '0.200', 'AMMO4': '0.221', 'WEAPON5': '0.350', 'weapon4': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '50.000'} [2024-08-06 02:53:43,767][52665] DAMAGECOUNT value on done: 345870.0 [2024-08-06 02:53:43,767][52665] Sum rewards: 63.259, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'HEALTH': '0.266', 'weapon2': '0.418', 'WEAPON3': '0.800', 'HITCOUNT': '3.090', 'weapon3': '3.310', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '50.000'} [2024-08-06 02:53:43,956][52669] DAMAGECOUNT value on done: 348730.0 [2024-08-06 02:53:43,958][52669] Sum rewards: 69.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.785', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.854', 'WEAPON3': '0.950', 'weapon3': '2.856', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '56.000'} [2024-08-06 02:53:44,630][52650] Updated weights for policy 0, policy_version 41591 (0.0012) [2024-08-06 02:53:44,907][52667] DAMAGECOUNT value on done: 355786.0 [2024-08-06 02:53:44,907][52667] Sum rewards: 62.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.385', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon5': '0.068', 'AMMO3': '0.225', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.871', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:44,973][52658] DAMAGECOUNT value on done: 350646.0 [2024-08-06 02:53:44,975][52658] Sum rewards: 61.083, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.126', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '2.934', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '50.000'} [2024-08-06 02:53:45,295][52660] DAMAGECOUNT value on done: 355057.0 [2024-08-06 02:53:45,295][52660] Sum rewards: 62.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.259', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO3': '0.234', 'weapon4': '0.238', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '53.000'} [2024-08-06 02:53:46,492][52668] DAMAGECOUNT value on done: 352067.0 [2024-08-06 02:53:46,494][52668] Sum rewards: 79.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'weapon4': '0.096', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '66.000'} [2024-08-06 02:53:46,524][52649] DAMAGECOUNT value on done: 345945.0 [2024-08-06 02:53:46,525][52649] Sum rewards: 69.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.064', 'weapon4': '0.122', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:46,533][52662] DAMAGECOUNT value on done: 351455.0 [2024-08-06 02:53:46,534][52662] Sum rewards: 59.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.206', 'weapon4': '0.248', 'weapon5': '0.268', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '2.842', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '51.000'} [2024-08-06 02:53:46,918][52665] DAMAGECOUNT value on done: 348112.0 [2024-08-06 02:53:46,919][52665] Sum rewards: 74.711, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.063', 'AMMO3': '0.149', 'weapon4': '0.150', 'weapon2': '0.426', 'WEAPON3': '0.800', 'HEALTH': '1.000', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:47,132][52669] DAMAGECOUNT value on done: 349113.0 [2024-08-06 02:53:47,134][52669] Sum rewards: 63.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.285', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.213', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.150', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '55.000'} [2024-08-06 02:53:47,740][52658] DAMAGECOUNT value on done: 356780.0 [2024-08-06 02:53:47,740][52658] Sum rewards: 57.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.432', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.114', 'weapon5': '0.122', 'AMMO4': '0.142', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '48.000'} [2024-08-06 02:53:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 340762624. Throughput: 0: 4379.3. Samples: 85190440. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:53:47,795][52567] Avg episode reward: [(0, '69.381')] [2024-08-06 02:53:48,009][52660] DAMAGECOUNT value on done: 355716.0 [2024-08-06 02:53:48,010][52660] Sum rewards: 61.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.603', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.100', 'AMMO4': '0.194', 'AMMO3': '0.225', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '52.500'} [2024-08-06 02:53:49,142][52668] DAMAGECOUNT value on done: 352754.0 [2024-08-06 02:53:49,144][52668] Sum rewards: 71.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'weapon5': '0.006', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.454', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '60.000'} [2024-08-06 02:53:49,284][52662] DAMAGECOUNT value on done: 354730.0 [2024-08-06 02:53:49,285][52662] Sum rewards: 77.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.171', 'weapon5': '0.186', 'AMMO3': '0.255', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '65.000'} [2024-08-06 02:53:49,426][52650] Updated weights for policy 0, policy_version 41601 (0.0012) [2024-08-06 02:53:49,561][52649] DAMAGECOUNT value on done: 344091.0 [2024-08-06 02:53:49,561][52649] Sum rewards: 68.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.845', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.110', 'AMMO3': '0.201', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:49,615][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:53:49,865][52665] DAMAGECOUNT value on done: 344715.0 [2024-08-06 02:53:49,867][52665] Sum rewards: 70.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.112', 'weapon4': '0.122', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:50,063][52669] DAMAGECOUNT value on done: 349390.0 [2024-08-06 02:53:50,064][52669] Sum rewards: 64.701, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.986', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon5': '0.122', 'AMMO3': '0.178', 'weapon4': '0.238', 'AMMO4': '0.288', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:50,837][52658] DAMAGECOUNT value on done: 353268.0 [2024-08-06 02:53:50,837][52658] Sum rewards: 46.860, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.866', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.098', 'AMMO4': '0.177', 'weapon5': '0.192', 'AMMO3': '0.203', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.440', 'weapon3': '3.138', 'DAMAGECOUNT': '12.090', 'FRAGCOUNT': '43.000'} [2024-08-06 02:53:51,020][52660] DAMAGECOUNT value on done: 351275.0 [2024-08-06 02:53:51,021][52660] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.062', 'AMMO5': '0.003', 'weapon4': '0.026', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.233', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:52,145][52649] DAMAGECOUNT value on done: 341459.0 [2024-08-06 02:53:52,146][52649] Sum rewards: 77.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'weapon4': '0.036', 'AMMO2': '0.039', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.197', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.222', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2024-08-06 02:53:52,273][52668] DAMAGECOUNT value on done: 347864.0 [2024-08-06 02:53:52,274][52668] Sum rewards: 64.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.118', 'AMMO4': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.424', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '53.000'} [2024-08-06 02:53:52,328][52662] DAMAGECOUNT value on done: 359868.0 [2024-08-06 02:53:52,330][52662] Sum rewards: 76.619, reward structure: {'DEATHCOUNT': '-14.250', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.180', 'HEALTH': '0.188', 'AMMO4': '0.202', 'AMMO3': '0.207', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '61.500'} [2024-08-06 02:53:52,351][52665] DAMAGECOUNT value on done: 342760.0 [2024-08-06 02:53:52,352][52665] Sum rewards: 54.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.548', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO3': '0.161', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.860', 'weapon3': '3.066', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '44.500'} [2024-08-06 02:53:52,775][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:53:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 340844544. Throughput: 0: 4380.9. Samples: 85216690. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:53:52,795][52567] Avg episode reward: [(0, '69.124')] [2024-08-06 02:53:52,880][52669] DAMAGECOUNT value on done: 352705.0 [2024-08-06 02:53:52,881][52669] Sum rewards: 63.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.196', 'weapon4': '0.228', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:53,818][52794] DAMAGECOUNT value on done: 353772.0 [2024-08-06 02:53:53,818][52794] Sum rewards: 69.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'weapon4': '0.202', 'AMMO3': '0.217', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:53,919][52650] Updated weights for policy 0, policy_version 41611 (0.0012) [2024-08-06 02:53:54,050][52660] DAMAGECOUNT value on done: 346993.0 [2024-08-06 02:53:54,051][52660] Sum rewards: 59.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.038', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.562', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '52.000'} [2024-08-06 02:53:54,119][52658] DAMAGECOUNT value on done: 348569.0 [2024-08-06 02:53:54,121][52658] Sum rewards: 74.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.999', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.128', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '62.000'} [2024-08-06 02:53:55,103][52662] DAMAGECOUNT value on done: 350575.0 [2024-08-06 02:53:55,103][52662] Sum rewards: 65.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon5': '0.062', 'weapon4': '0.088', 'AMMO4': '0.113', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '57.000'} [2024-08-06 02:53:55,184][52668] DAMAGECOUNT value on done: 343418.0 [2024-08-06 02:53:55,186][52668] Sum rewards: 75.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.196', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.173', 'AMMO4': '0.201', 'weapon5': '0.202', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.684', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '62.000'} [2024-08-06 02:53:55,244][52649] DAMAGECOUNT value on done: 345808.0 [2024-08-06 02:53:55,244][52649] Sum rewards: 78.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.849', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.180', 'AMMO3': '0.185', 'AMMO4': '0.226', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '64.000'} [2024-08-06 02:53:55,560][52665] DAMAGECOUNT value on done: 342858.0 [2024-08-06 02:53:55,560][52665] Sum rewards: 61.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'weapon5': '0.136', 'AMMO3': '0.163', 'weapon4': '0.252', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.968', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '51.000'} [2024-08-06 02:53:55,881][52669] DAMAGECOUNT value on done: 351702.0 [2024-08-06 02:53:55,881][52669] Sum rewards: 71.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.182', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:56,824][52794] DAMAGECOUNT value on done: 356721.0 [2024-08-06 02:53:56,827][52794] Sum rewards: 63.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.665', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '52.000'} [2024-08-06 02:53:57,074][52660] DAMAGECOUNT value on done: 351267.0 [2024-08-06 02:53:57,076][52660] Sum rewards: 66.699, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.480', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.112', 'AMMO3': '0.166', 'weapon2': '0.220', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 02:53:57,259][52658] DAMAGECOUNT value on done: 350884.0 [2024-08-06 02:53:57,261][52658] Sum rewards: 70.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.094', 'AMMO4': '0.195', 'weapon5': '0.204', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '58.000'} [2024-08-06 02:53:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 340934656. Throughput: 0: 4375.1. Samples: 85242930. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:53:57,802][52567] Avg episode reward: [(0, '69.002')] [2024-08-06 02:53:57,943][52662] DAMAGECOUNT value on done: 362527.0 [2024-08-06 02:53:57,943][52662] Sum rewards: 62.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.170', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.256', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.108', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '51.500'} [2024-08-06 02:53:58,104][52668] DAMAGECOUNT value on done: 343113.0 [2024-08-06 02:53:58,105][52668] Sum rewards: 64.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.225', 'weapon4': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.152', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '56.000'} [2024-08-06 02:53:58,386][52649] DAMAGECOUNT value on done: 346834.0 [2024-08-06 02:53:58,387][52649] Sum rewards: 76.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.245', 'weapon2': '0.314', 'WEAPON3': '1.550', 'weapon3': '3.452', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 02:53:58,658][52665] DAMAGECOUNT value on done: 346960.0 [2024-08-06 02:53:58,658][52665] Sum rewards: 73.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '62.000'} [2024-08-06 02:53:58,722][52650] Updated weights for policy 0, policy_version 41621 (0.0031) [2024-08-06 02:53:58,839][52669] DAMAGECOUNT value on done: 353176.0 [2024-08-06 02:53:58,839][52669] Sum rewards: 69.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.122', 'AMMO4': '0.204', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '57.500'} [2024-08-06 02:53:59,344][52794] DAMAGECOUNT value on done: 353393.0 [2024-08-06 02:53:59,345][52794] Sum rewards: 80.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.849', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.136', 'weapon5': '0.176', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '67.000'} [2024-08-06 02:53:59,907][52660] DAMAGECOUNT value on done: 359033.0 [2024-08-06 02:53:59,907][52660] Sum rewards: 66.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.088', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '55.000'} [2024-08-06 02:54:00,029][52671] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:54:00,450][52658] DAMAGECOUNT value on done: 354910.0 [2024-08-06 02:54:00,451][52658] Sum rewards: 68.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.367', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.192', 'AMMO4': '0.193', 'weapon2': '0.250', 'AMMO3': '0.260', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.998', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.500'} [2024-08-06 02:54:00,675][52662] DAMAGECOUNT value on done: 355772.0 [2024-08-06 02:54:00,677][52662] Sum rewards: 69.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.624', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.116', 'weapon2': '0.152', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.542', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:00,965][52668] DAMAGECOUNT value on done: 343425.0 [2024-08-06 02:54:00,965][52668] Sum rewards: 71.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.270', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:01,529][52649] DAMAGECOUNT value on done: 347834.0 [2024-08-06 02:54:01,530][52649] Sum rewards: 84.511, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.088', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'weapon4': '0.284', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.766', 'FRAGCOUNT': '67.000'} [2024-08-06 02:54:01,664][52669] DAMAGECOUNT value on done: 350979.0 [2024-08-06 02:54:01,664][52669] Sum rewards: 68.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.200', 'AMMO4': '0.223', 'AMMO3': '0.236', 'weapon4': '0.296', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.692', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:01,770][52665] DAMAGECOUNT value on done: 348802.0 [2024-08-06 02:54:01,771][52665] Sum rewards: 74.572, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:02,497][52794] DAMAGECOUNT value on done: 351172.0 [2024-08-06 02:54:02,499][52794] Sum rewards: 69.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.228', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.132', 'AMMO3': '0.188', 'AMMO4': '0.276', 'weapon5': '0.292', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '55.500'} [2024-08-06 02:54:02,717][52660] DAMAGECOUNT value on done: 354408.0 [2024-08-06 02:54:02,717][52660] Sum rewards: 59.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.995', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.212', 'weapon2': '0.448', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.342', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '50.000'} [2024-08-06 02:54:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 341024768. Throughput: 0: 4376.9. Samples: 85255980. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 02:54:02,802][52567] Avg episode reward: [(0, '69.135')] [2024-08-06 02:54:03,233][52650] Updated weights for policy 0, policy_version 41631 (0.0011) [2024-08-06 02:54:03,500][52658] DAMAGECOUNT value on done: 345372.0 [2024-08-06 02:54:03,502][52658] Sum rewards: 63.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.766', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:03,855][52662] DAMAGECOUNT value on done: 353767.0 [2024-08-06 02:54:03,856][52662] Sum rewards: 64.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.170', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.186', 'weapon5': '0.202', 'weapon4': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.736', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '53.000'} [2024-08-06 02:54:03,931][52668] DAMAGECOUNT value on done: 348138.0 [2024-08-06 02:54:03,933][52668] Sum rewards: 68.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.188', 'weapon4': '0.188', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '2.888', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '58.500'} [2024-08-06 02:54:04,281][52669] DAMAGECOUNT value on done: 357007.0 [2024-08-06 02:54:04,281][52669] Sum rewards: 63.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon2': '0.180', 'weapon5': '0.184', 'AMMO3': '0.201', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.640', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '53.000'} [2024-08-06 02:54:04,802][52649] DAMAGECOUNT value on done: 348072.0 [2024-08-06 02:54:04,803][52649] Sum rewards: 80.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.502', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '66.000'} [2024-08-06 02:54:05,391][52794] DAMAGECOUNT value on done: 348763.0 [2024-08-06 02:54:05,393][52794] Sum rewards: 67.599, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.210', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.162', 'weapon5': '0.200', 'AMMO4': '0.220', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '2.860', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:05,468][52660] DAMAGECOUNT value on done: 350139.0 [2024-08-06 02:54:05,470][52660] Sum rewards: 77.415, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.382', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon2': '0.190', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'weapon3': '3.452', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '65.000'} [2024-08-06 02:54:06,575][52671] DAMAGECOUNT value on done: 356100.0 [2024-08-06 02:54:06,575][52671] Sum rewards: 66.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.114', 'AMMO4': '0.158', 'AMMO3': '0.195', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:06,675][52662] DAMAGECOUNT value on done: 350093.0 [2024-08-06 02:54:06,676][52662] Sum rewards: 59.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.774', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.638', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.198', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '52.000'} [2024-08-06 02:54:06,685][52668] DAMAGECOUNT value on done: 351159.0 [2024-08-06 02:54:06,686][52668] Sum rewards: 77.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.072', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.212', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.532', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:06,718][52658] DAMAGECOUNT value on done: 360700.0 [2024-08-06 02:54:06,718][52658] Sum rewards: 59.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.792', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.160', 'AMMO4': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.784', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '52.000'} [2024-08-06 02:54:07,254][52669] DAMAGECOUNT value on done: 351039.0 [2024-08-06 02:54:07,255][52669] Sum rewards: 78.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.910', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.154', 'AMMO3': '0.259', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon5': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '66.000'} [2024-08-06 02:54:07,667][52649] DAMAGECOUNT value on done: 338221.0 [2024-08-06 02:54:07,672][52649] Sum rewards: 68.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.375', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.162', 'AMMO3': '0.193', 'weapon5': '0.202', 'AMMO4': '0.223', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.000'} [2024-08-06 02:54:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 341114880. Throughput: 0: 4371.8. Samples: 85282050. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:54:07,802][52567] Avg episode reward: [(0, '68.849')] [2024-08-06 02:54:08,098][52660] DAMAGECOUNT value on done: 359003.0 [2024-08-06 02:54:08,100][52660] Sum rewards: 72.117, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.492', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'AMMO3': '0.274', 'weapon2': '0.308', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.550', 'weapon3': '2.874', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.000'} [2024-08-06 02:54:08,351][52650] Updated weights for policy 0, policy_version 41641 (0.0031) [2024-08-06 02:54:08,371][52794] DAMAGECOUNT value on done: 353722.0 [2024-08-06 02:54:08,371][52794] Sum rewards: 75.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.551', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.117', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.352', 'weapon4': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:08,375][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:54:09,328][52668] DAMAGECOUNT value on done: 352866.0 [2024-08-06 02:54:09,330][52668] Sum rewards: 56.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.703', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.195', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.952', 'DAMAGECOUNT': '13.200', 'FRAGCOUNT': '48.000'} [2024-08-06 02:54:09,608][52671] DAMAGECOUNT value on done: 352577.0 [2024-08-06 02:54:09,609][52671] Sum rewards: 58.727, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.592', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.100', 'weapon5': '0.198', 'AMMO4': '0.204', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '50.000'} [2024-08-06 02:54:09,618][52662] DAMAGECOUNT value on done: 346751.0 [2024-08-06 02:54:09,620][52662] Sum rewards: 68.275, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.140', 'weapon5': '0.156', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.020', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:09,669][52658] DAMAGECOUNT value on done: 352644.0 [2024-08-06 02:54:09,671][52658] Sum rewards: 48.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.865', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.198', 'AMMO3': '0.201', 'AMMO4': '0.254', 'weapon4': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.712', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '42.000'} [2024-08-06 02:54:10,427][52669] DAMAGECOUNT value on done: 348150.0 [2024-08-06 02:54:10,429][52669] Sum rewards: 59.376, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.084', 'AMMO5': '0.009', 'AMMO2': '0.057', 'weapon5': '0.122', 'AMMO3': '0.156', 'weapon4': '0.208', 'WEAPON5': '0.250', 'AMMO4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon2': '0.984', 'weapon3': '2.552', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '46.000'} [2024-08-06 02:54:11,069][52649] DAMAGECOUNT value on done: 344031.0 [2024-08-06 02:54:11,072][52649] Sum rewards: 77.280, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.135', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'HEALTH': '0.294', 'weapon2': '0.342', 'WEAPON3': '0.850', 'weapon3': '3.044', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:11,085][52660] DAMAGECOUNT value on done: 345640.0 [2024-08-06 02:54:11,086][52660] Sum rewards: 68.464, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.144', 'AMMO3': '0.270', 'AMMO4': '0.289', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.352', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:11,424][52794] DAMAGECOUNT value on done: 357381.0 [2024-08-06 02:54:11,426][52794] Sum rewards: 66.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.452', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.178', 'AMMO3': '0.220', 'AMMO4': '0.242', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '55.000'} [2024-08-06 02:54:12,408][52668] DAMAGECOUNT value on done: 352875.0 [2024-08-06 02:54:12,409][52668] Sum rewards: 63.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.024', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.135', 'weapon4': '0.206', 'AMMO4': '0.236', 'weapon5': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.752', 'WEAPON3': '0.850', 'weapon3': '2.378', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '52.000'} [2024-08-06 02:54:12,465][52658] DAMAGECOUNT value on done: 361248.0 [2024-08-06 02:54:12,465][52658] Sum rewards: 66.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon4': '0.384', 'weapon2': '0.460', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '52.000'} [2024-08-06 02:54:12,701][52671] DAMAGECOUNT value on done: 352660.0 [2024-08-06 02:54:12,701][52671] Sum rewards: 74.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.890', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO4': '0.207', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '64.000'} [2024-08-06 02:54:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 341196800. Throughput: 0: 4376.9. Samples: 85308390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:54:12,802][52567] Avg episode reward: [(0, '68.057')] [2024-08-06 02:54:12,824][52650] Updated weights for policy 0, policy_version 41651 (0.0011) [2024-08-06 02:54:12,848][52669] DAMAGECOUNT value on done: 353609.0 [2024-08-06 02:54:12,848][52669] Sum rewards: 63.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.478', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.170', 'AMMO3': '0.215', 'AMMO4': '0.236', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '53.000'} [2024-08-06 02:54:13,070][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:54:14,209][52660] DAMAGECOUNT value on done: 345349.0 [2024-08-06 02:54:14,209][52660] Sum rewards: 72.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.634', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.246', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.416', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:14,219][52649] DAMAGECOUNT value on done: 340860.0 [2024-08-06 02:54:14,221][52649] Sum rewards: 64.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.144', 'AMMO3': '0.182', 'weapon5': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.050', 'weapon3': '3.104', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:14,430][52794] DAMAGECOUNT value on done: 350617.0 [2024-08-06 02:54:14,431][52794] Sum rewards: 65.046, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.349', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.012', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.372', 'weapon2': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '53.000'} [2024-08-06 02:54:15,309][52658] DAMAGECOUNT value on done: 346791.0 [2024-08-06 02:54:15,311][52658] Sum rewards: 64.043, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.252', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon5': '0.168', 'weapon4': '0.192', 'AMMO3': '0.264', 'AMMO4': '0.279', 'weapon2': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '2.942', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '56.000'} [2024-08-06 02:54:15,482][52668] DAMAGECOUNT value on done: 349388.0 [2024-08-06 02:54:15,483][52668] Sum rewards: 59.185, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.930', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'weapon4': '0.244', 'weapon2': '0.254', 'AMMO3': '0.276', 'WEAPON3': '1.600', 'HITCOUNT': '3.070', 'weapon3': '3.236', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:15,608][52671] DAMAGECOUNT value on done: 353004.0 [2024-08-06 02:54:15,609][52671] Sum rewards: 69.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.209', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:15,677][52669] DAMAGECOUNT value on done: 358441.0 [2024-08-06 02:54:15,678][52669] Sum rewards: 62.001, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.180', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.200', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.000'} [2024-08-06 02:54:16,885][52664] DAMAGECOUNT value on done: 363720.0 [2024-08-06 02:54:16,885][52664] Sum rewards: 55.778, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.773', 'AMMO5': '0.009', 'weapon5': '0.032', 'AMMO2': '0.039', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.274', 'WEAPON4': '0.400', 'weapon4': '0.686', 'WEAPON3': '1.600', 'weapon3': '2.734', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '51.000'} [2024-08-06 02:54:17,172][52660] DAMAGECOUNT value on done: 358806.0 [2024-08-06 02:54:17,174][52660] Sum rewards: 70.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.146', 'weapon5': '0.196', 'AMMO3': '0.219', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.244', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 02:54:17,299][52649] DAMAGECOUNT value on done: 345486.0 [2024-08-06 02:54:17,300][52649] Sum rewards: 87.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.501', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.098', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.289', 'weapon2': '0.292', 'WEAPON3': '1.700', 'weapon3': '3.256', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.703', 'FRAGCOUNT': '75.000'} [2024-08-06 02:54:17,458][52794] DAMAGECOUNT value on done: 357810.0 [2024-08-06 02:54:17,460][52794] Sum rewards: 70.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.265', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.169', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.316', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:17,551][52650] Updated weights for policy 0, policy_version 41661 (0.0027) [2024-08-06 02:54:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 341286912. Throughput: 0: 4376.0. Samples: 85321510. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:54:17,802][52567] Avg episode reward: [(0, '67.625')] [2024-08-06 02:54:18,077][52658] DAMAGECOUNT value on done: 354540.0 [2024-08-06 02:54:18,078][52658] Sum rewards: 69.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.096', 'AMMO4': '0.106', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.304', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 02:54:18,502][52669] DAMAGECOUNT value on done: 367842.0 [2024-08-06 02:54:18,502][52669] Sum rewards: 56.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.088', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.232', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.980', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '47.000'} [2024-08-06 02:54:18,646][52671] DAMAGECOUNT value on done: 359006.0 [2024-08-06 02:54:18,647][52671] Sum rewards: 67.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.774', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon2': '0.158', 'AMMO3': '0.176', 'WEAPON3': '1.200', 'HITCOUNT': '3.430', 'weapon3': '3.668', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:19,148][52664] DAMAGECOUNT value on done: 367566.0 [2024-08-06 02:54:19,148][52664] Sum rewards: 78.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.657', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.110', 'AMMO3': '0.227', 'weapon5': '0.250', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '65.000'} [2024-08-06 02:54:20,246][52794] DAMAGECOUNT value on done: 353763.0 [2024-08-06 02:54:20,246][52794] Sum rewards: 63.440, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'ARMOR': '0.024', 'HEALTH': '0.074', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon4': '0.428', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '3.172', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '51.000'} [2024-08-06 02:54:20,340][52660] DAMAGECOUNT value on done: 359674.0 [2024-08-06 02:54:20,340][52660] Sum rewards: 75.697, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO3': '0.161', 'AMMO4': '0.161', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:20,412][52649] DAMAGECOUNT value on done: 348018.0 [2024-08-06 02:54:20,414][52649] Sum rewards: 63.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.144', 'AMMO3': '0.176', 'weapon4': '0.192', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.260', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '51.000'} [2024-08-06 02:54:21,039][52669] DAMAGECOUNT value on done: 353538.0 [2024-08-06 02:54:21,043][52669] Sum rewards: 74.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.158', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.143', 'weapon5': '0.198', 'weapon4': '0.212', 'AMMO4': '0.259', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.774', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:21,066][52658] DAMAGECOUNT value on done: 348962.0 [2024-08-06 02:54:21,066][52658] Sum rewards: 58.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.590', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.110', 'AMMO4': '0.202', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'weapon4': '0.382', 'WEAPON3': '1.500', 'weapon3': '2.924', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '51.000'} [2024-08-06 02:54:21,511][52671] DAMAGECOUNT value on done: 349782.0 [2024-08-06 02:54:21,512][52671] Sum rewards: 70.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.482', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.241', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.404', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:21,599][52664] DAMAGECOUNT value on done: 368890.0 [2024-08-06 02:54:21,599][52664] Sum rewards: 83.331, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.005', 'AMMO5': '0.013', 'HEALTH': '0.020', 'AMMO2': '0.030', 'weapon4': '0.146', 'AMMO4': '0.148', 'AMMO3': '0.208', 'weapon5': '0.222', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '66.000'} [2024-08-06 02:54:22,192][52650] Updated weights for policy 0, policy_version 41671 (0.0026) [2024-08-06 02:54:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 341377024. Throughput: 0: 4375.8. Samples: 85347840. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:54:22,795][52567] Avg episode reward: [(0, '67.860')] [2024-08-06 02:54:23,265][52794] DAMAGECOUNT value on done: 350440.0 [2024-08-06 02:54:23,266][52794] Sum rewards: 72.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.399', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.060', 'AMMO4': '0.177', 'weapon5': '0.184', 'weapon2': '0.214', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:23,329][52649] DAMAGECOUNT value on done: 347281.0 [2024-08-06 02:54:23,330][52649] Sum rewards: 54.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'weapon5': '0.044', 'AMMO2': '0.048', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.000', 'HITCOUNT': '2.840', 'weapon3': '3.028', 'DAMAGECOUNT': '13.362', 'FRAGCOUNT': '46.000'} [2024-08-06 02:54:23,527][52660] DAMAGECOUNT value on done: 347264.0 [2024-08-06 02:54:23,529][52660] Sum rewards: 69.730, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.380', 'AMMO2': '0.025', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.278', 'weapon2': '0.448', 'WEAPON3': '1.650', 'weapon3': '3.276', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:23,938][52671] DAMAGECOUNT value on done: 356374.0 [2024-08-06 02:54:23,939][52671] Sum rewards: 75.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.085', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'weapon4': '0.038', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.198', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:24,202][52658] DAMAGECOUNT value on done: 348221.0 [2024-08-06 02:54:24,204][52658] Sum rewards: 67.921, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.980', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.123', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.360', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:24,298][52669] DAMAGECOUNT value on done: 354943.0 [2024-08-06 02:54:24,300][52669] Sum rewards: 65.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.680', 'AMMO5': '0.024', 'AMMO2': '0.057', 'AMMO3': '0.205', 'AMMO4': '0.285', 'weapon5': '0.290', 'weapon4': '0.476', 'weapon2': '0.498', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.406', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:24,510][52664] DAMAGECOUNT value on done: 363473.0 [2024-08-06 02:54:24,510][52664] Sum rewards: 69.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.502', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.164', 'weapon5': '0.180', 'AMMO3': '0.215', 'AMMO4': '0.244', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:25,923][52660] DAMAGECOUNT value on done: 350636.0 [2024-08-06 02:54:25,924][52660] Sum rewards: 50.781, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.821', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.176', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.096', 'DAMAGECOUNT': '13.983', 'FRAGCOUNT': '44.000'} [2024-08-06 02:54:26,326][52794] DAMAGECOUNT value on done: 354747.0 [2024-08-06 02:54:26,327][52794] Sum rewards: 72.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.626', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.144', 'weapon5': '0.174', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.144', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:26,847][52650] Updated weights for policy 0, policy_version 41681 (0.0012) [2024-08-06 02:54:26,900][52671] DAMAGECOUNT value on done: 355789.0 [2024-08-06 02:54:26,902][52671] Sum rewards: 70.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.544', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.128', 'weapon4': '0.152', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:27,323][52658] DAMAGECOUNT value on done: 346227.0 [2024-08-06 02:54:27,323][52658] Sum rewards: 75.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.118', 'weapon4': '0.144', 'AMMO4': '0.173', 'weapon2': '0.178', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '65.000'} [2024-08-06 02:54:27,541][52664] DAMAGECOUNT value on done: 365021.0 [2024-08-06 02:54:27,542][52664] Sum rewards: 81.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.008', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.120', 'weapon2': '0.178', 'AMMO4': '0.214', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.386', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '68.000'} [2024-08-06 02:54:27,727][52669] DAMAGECOUNT value on done: 354464.0 [2024-08-06 02:54:27,727][52669] Sum rewards: 63.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.675', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.201', 'AMMO3': '0.231', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.154', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '55.000'} [2024-08-06 02:54:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 341458944. Throughput: 0: 4378.2. Samples: 85374240. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:54:27,802][52567] Avg episode reward: [(0, '68.291')] [2024-08-06 02:54:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041682_341458944.pth... [2024-08-06 02:54:27,943][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041169_337256448.pth [2024-08-06 02:54:28,735][52660] DAMAGECOUNT value on done: 345252.0 [2024-08-06 02:54:28,737][52660] Sum rewards: 66.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.422', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.048', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.352', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.308', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '58.000'} [2024-08-06 02:54:29,371][52794] DAMAGECOUNT value on done: 347340.0 [2024-08-06 02:54:29,372][52794] Sum rewards: 78.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.592', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '65.500'} [2024-08-06 02:54:29,383][52671] DAMAGECOUNT value on done: 348635.0 [2024-08-06 02:54:29,383][52671] Sum rewards: 73.003, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.845', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.162', 'AMMO4': '0.180', 'weapon5': '0.180', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.990', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '65.000'} [2024-08-06 02:54:30,067][52811] DAMAGECOUNT value on done: 339699.0 [2024-08-06 02:54:30,068][52811] Sum rewards: 74.793, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.201', 'weapon4': '0.220', 'weapon5': '0.246', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:30,436][52664] DAMAGECOUNT value on done: 364860.0 [2024-08-06 02:54:30,436][52664] Sum rewards: 66.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.018', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.182', 'weapon4': '0.192', 'AMMO4': '0.213', 'AMMO3': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:30,567][52658] DAMAGECOUNT value on done: 357961.0 [2024-08-06 02:54:30,568][52658] Sum rewards: 61.340, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.278', 'weapon2': '0.602', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '51.000'} [2024-08-06 02:54:30,917][52669] DAMAGECOUNT value on done: 357663.0 [2024-08-06 02:54:30,918][52669] Sum rewards: 77.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.072', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.239', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '65.500'} [2024-08-06 02:54:31,339][52660] DAMAGECOUNT value on done: 353148.0 [2024-08-06 02:54:31,340][52660] Sum rewards: 71.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.369', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.200', 'AMMO4': '0.219', 'AMMO3': '0.222', 'weapon2': '0.250', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:31,628][52650] Updated weights for policy 0, policy_version 41691 (0.0023) [2024-08-06 02:54:31,738][52671] DAMAGECOUNT value on done: 356018.0 [2024-08-06 02:54:31,739][52671] Sum rewards: 71.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.532', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.220', 'AMMO3': '0.237', 'weapon2': '0.298', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '57.500'} [2024-08-06 02:54:31,933][52803] DAMAGECOUNT value on done: 329815.0 [2024-08-06 02:54:31,935][52803] Sum rewards: 73.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.308', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.114', 'weapon4': '0.134', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.354', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:32,492][52794] DAMAGECOUNT value on done: 362896.0 [2024-08-06 02:54:32,493][52794] Sum rewards: 77.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.246', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.116', 'weapon5': '0.142', 'AMMO4': '0.208', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '65.000'} [2024-08-06 02:54:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 341549056. Throughput: 0: 4370.2. Samples: 85387100. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:54:32,795][52567] Avg episode reward: [(0, '68.796')] [2024-08-06 02:54:32,990][52811] DAMAGECOUNT value on done: 326423.0 [2024-08-06 02:54:32,990][52811] Sum rewards: 76.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.170', 'weapon2': '0.210', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '64.000'} [2024-08-06 02:54:33,313][52664] DAMAGECOUNT value on done: 365601.0 [2024-08-06 02:54:33,315][52664] Sum rewards: 64.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.116', 'weapon5': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.262', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.500'} [2024-08-06 02:54:33,618][52658] DAMAGECOUNT value on done: 348297.0 [2024-08-06 02:54:33,618][52658] Sum rewards: 56.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.310', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.106', 'weapon5': '0.136', 'AMMO4': '0.146', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.102', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '48.000'} [2024-08-06 02:54:34,404][52660] DAMAGECOUNT value on done: 347703.0 [2024-08-06 02:54:34,406][52660] Sum rewards: 67.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.136', 'AMMO4': '0.198', 'weapon2': '0.216', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.328', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:34,476][52660] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:54:34,519][52671] DAMAGECOUNT value on done: 359876.0 [2024-08-06 02:54:34,520][52671] Sum rewards: 70.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.086', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.120', 'AMMO3': '0.165', 'weapon4': '0.194', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:35,118][52803] DAMAGECOUNT value on done: 325656.0 [2024-08-06 02:54:35,118][52803] Sum rewards: 61.601, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.636', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.146', 'weapon5': '0.146', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.038', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '50.000'} [2024-08-06 02:54:35,742][52794] DAMAGECOUNT value on done: 348330.0 [2024-08-06 02:54:35,750][52794] Sum rewards: 54.560, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.670', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon4': '0.228', 'weapon2': '0.238', 'AMMO3': '0.261', 'weapon5': '0.282', 'AMMO4': '0.343', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.630', 'weapon3': '2.842', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '48.000'} [2024-08-06 02:54:35,978][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:54:36,010][52664] DAMAGECOUNT value on done: 357598.0 [2024-08-06 02:54:36,011][52664] Sum rewards: 77.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'AMMO3': '0.192', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '62.000'} [2024-08-06 02:54:36,104][52811] DAMAGECOUNT value on done: 329345.0 [2024-08-06 02:54:36,108][52811] Sum rewards: 75.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.134', 'AMMO4': '0.136', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:36,342][52650] Updated weights for policy 0, policy_version 41701 (0.0020) [2024-08-06 02:54:36,501][52658] DAMAGECOUNT value on done: 353268.0 [2024-08-06 02:54:36,501][52658] Sum rewards: 63.579, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.062', 'weapon4': '0.086', 'AMMO4': '0.211', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '56.500'} [2024-08-06 02:54:37,271][52671] DAMAGECOUNT value on done: 351709.0 [2024-08-06 02:54:37,271][52671] Sum rewards: 76.037, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.158', 'AMMO3': '0.177', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '2.750', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 341639168. Throughput: 0: 4370.2. Samples: 85413350. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:54:37,794][52567] Avg episode reward: [(0, '68.754')] [2024-08-06 02:54:38,215][52803] DAMAGECOUNT value on done: 330258.0 [2024-08-06 02:54:38,218][52803] Sum rewards: 64.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.785', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.088', 'weapon4': '0.160', 'AMMO4': '0.185', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.194', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '55.000'} [2024-08-06 02:54:38,458][52794] DAMAGECOUNT value on done: 362097.0 [2024-08-06 02:54:38,459][52794] Sum rewards: 66.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.080', 'weapon5': '0.142', 'AMMO3': '0.217', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.156', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '58.000'} [2024-08-06 02:54:39,266][52811] DAMAGECOUNT value on done: 327737.0 [2024-08-06 02:54:39,267][52811] Sum rewards: 74.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.423', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.008', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.237', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:39,522][52664] DAMAGECOUNT value on done: 368018.0 [2024-08-06 02:54:39,522][52664] Sum rewards: 57.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.763', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.240', 'AMMO3': '0.246', 'weapon5': '0.258', 'weapon2': '0.278', 'AMMO4': '0.317', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '51.000'} [2024-08-06 02:54:39,601][52658] DAMAGECOUNT value on done: 356417.0 [2024-08-06 02:54:39,603][52658] Sum rewards: 68.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.389', 'AMMO5': '0.017', 'AMMO2': '0.062', 'AMMO3': '0.153', 'weapon5': '0.260', 'AMMO4': '0.311', 'weapon2': '0.414', 'weapon4': '0.464', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.590', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:39,809][52671] DAMAGECOUNT value on done: 364751.0 [2024-08-06 02:54:39,811][52671] Sum rewards: 66.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.148', 'AMMO3': '0.163', 'weapon5': '0.202', 'AMMO4': '0.218', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:40,763][52650] Updated weights for policy 0, policy_version 41711 (0.0012) [2024-08-06 02:54:41,104][52794] DAMAGECOUNT value on done: 354214.0 [2024-08-06 02:54:41,106][52794] Sum rewards: 59.295, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.088', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.174', 'AMMO4': '0.175', 'weapon2': '0.238', 'weapon4': '0.306', 'weapon5': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '48.000'} [2024-08-06 02:54:41,293][52803] DAMAGECOUNT value on done: 332064.0 [2024-08-06 02:54:41,297][52803] Sum rewards: 69.154, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.830', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.258', 'weapon2': '0.342', 'WEAPON3': '1.500', 'HITCOUNT': '3.420', 'weapon3': '3.472', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:41,521][52795] DAMAGECOUNT value on done: 327095.0 [2024-08-06 02:54:41,521][52795] Sum rewards: 72.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.647', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.235', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:42,305][52811] DAMAGECOUNT value on done: 331444.0 [2024-08-06 02:54:42,306][52811] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.126', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.494', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:42,784][52671] DAMAGECOUNT value on done: 352175.0 [2024-08-06 02:54:42,784][52671] Sum rewards: 79.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.404', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.090', 'AMMO3': '0.197', 'weapon4': '0.200', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '65.000'} [2024-08-06 02:54:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 341729280. Throughput: 0: 4376.0. Samples: 85439850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:54:42,794][52567] Avg episode reward: [(0, '68.433')] [2024-08-06 02:54:42,799][52664] DAMAGECOUNT value on done: 363539.0 [2024-08-06 02:54:42,799][52664] Sum rewards: 77.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.093', 'weapon5': '0.094', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.200', 'weapon3': '3.462', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 02:54:44,233][52794] DAMAGECOUNT value on done: 354701.0 [2024-08-06 02:54:44,234][52794] Sum rewards: 70.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.052', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.638', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '56.000'} [2024-08-06 02:54:44,360][52803] DAMAGECOUNT value on done: 333437.0 [2024-08-06 02:54:44,361][52803] Sum rewards: 71.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO4': '0.163', 'weapon4': '0.204', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '62.000'} [2024-08-06 02:54:44,621][52795] DAMAGECOUNT value on done: 320016.0 [2024-08-06 02:54:44,621][52795] Sum rewards: 56.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.334', 'weapon2': '0.652', 'WEAPON3': '1.300', 'weapon3': '2.714', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '49.000'} [2024-08-06 02:54:45,358][52671] DAMAGECOUNT value on done: 346342.0 [2024-08-06 02:54:45,358][52671] Sum rewards: 70.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.834', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:45,361][52811] DAMAGECOUNT value on done: 335639.0 [2024-08-06 02:54:45,361][52811] Sum rewards: 78.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.891', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.186', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '65.000'} [2024-08-06 02:54:45,730][52650] Updated weights for policy 0, policy_version 41721 (0.0013) [2024-08-06 02:54:45,836][52664] DAMAGECOUNT value on done: 369714.0 [2024-08-06 02:54:45,837][52664] Sum rewards: 75.758, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.052', 'WEAPON5': '0.200', 'AMMO4': '0.243', 'AMMO3': '0.251', 'weapon2': '0.326', 'weapon4': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.978', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '66.000'} [2024-08-06 02:54:47,282][52794] DAMAGECOUNT value on done: 363782.0 [2024-08-06 02:54:47,282][52794] Sum rewards: 72.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.154', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.178', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '63.000'} [2024-08-06 02:54:47,394][52803] DAMAGECOUNT value on done: 325041.0 [2024-08-06 02:54:47,394][52803] Sum rewards: 65.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.736', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.124', 'AMMO4': '0.125', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.674', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 341811200. Throughput: 0: 4379.8. Samples: 85453070. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:54:47,794][52567] Avg episode reward: [(0, '68.738')] [2024-08-06 02:54:47,830][52795] DAMAGECOUNT value on done: 319950.0 [2024-08-06 02:54:47,831][52795] Sum rewards: 60.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.354', 'AMMO5': '0.023', 'AMMO2': '0.046', 'AMMO3': '0.190', 'weapon5': '0.216', 'AMMO4': '0.228', 'weapon4': '0.480', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.316', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '50.000'} [2024-08-06 02:54:48,278][52671] DAMAGECOUNT value on done: 359134.0 [2024-08-06 02:54:48,279][52671] Sum rewards: 63.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.857', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.044', 'AMMO4': '0.131', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.322', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.146', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:48,614][52811] DAMAGECOUNT value on done: 329606.0 [2024-08-06 02:54:48,614][52811] Sum rewards: 66.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.818', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.098', 'AMMO3': '0.194', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '54.000'} [2024-08-06 02:54:49,112][52664] DAMAGECOUNT value on done: 366072.0 [2024-08-06 02:54:49,113][52664] Sum rewards: 71.156, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.738', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:49,966][52794] DAMAGECOUNT value on done: 354314.0 [2024-08-06 02:54:49,966][52794] Sum rewards: 67.265, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.850', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.089', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.296', 'weapon2': '0.392', 'WEAPON3': '1.800', 'weapon3': '3.214', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '61.500'} [2024-08-06 02:54:50,403][52650] Updated weights for policy 0, policy_version 41731 (0.0031) [2024-08-06 02:54:50,530][52803] DAMAGECOUNT value on done: 324663.0 [2024-08-06 02:54:50,532][52803] Sum rewards: 67.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.928', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.194', 'weapon2': '0.210', 'weapon4': '0.286', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '55.000'} [2024-08-06 02:54:50,975][52795] DAMAGECOUNT value on done: 325783.0 [2024-08-06 02:54:50,976][52795] Sum rewards: 65.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.722', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon4': '0.156', 'weapon5': '0.172', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.060', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '55.500'} [2024-08-06 02:54:51,347][52671] DAMAGECOUNT value on done: 359583.0 [2024-08-06 02:54:51,347][52671] Sum rewards: 70.668, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.219', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.132', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'weapon4': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:51,748][52811] DAMAGECOUNT value on done: 330657.0 [2024-08-06 02:54:51,748][52811] Sum rewards: 72.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.088', 'weapon4': '0.132', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '60.000'} [2024-08-06 02:54:52,109][52664] DAMAGECOUNT value on done: 373368.0 [2024-08-06 02:54:52,109][52664] Sum rewards: 65.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.511', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2024-08-06 02:54:52,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 341901312. Throughput: 0: 4380.4. Samples: 85479170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 02:54:52,795][52567] Avg episode reward: [(0, '68.374')] [2024-08-06 02:54:53,692][52803] DAMAGECOUNT value on done: 324668.0 [2024-08-06 02:54:53,692][52803] Sum rewards: 72.443, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.505', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO3': '0.152', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '0.950', 'weapon3': '3.192', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:54,207][52795] DAMAGECOUNT value on done: 326348.0 [2024-08-06 02:54:54,207][52795] Sum rewards: 66.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.079', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.220', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.414', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '56.000'} [2024-08-06 02:54:54,482][52671] DAMAGECOUNT value on done: 361106.0 [2024-08-06 02:54:54,484][52671] Sum rewards: 68.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.366', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.336', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '58.000'} [2024-08-06 02:54:54,604][52664] DAMAGECOUNT value on done: 367758.0 [2024-08-06 02:54:54,606][52664] Sum rewards: 87.549, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.819', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.086', 'weapon5': '0.096', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'weapon3': '3.348', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.960', 'FRAGCOUNT': '73.000'} [2024-08-06 02:54:54,848][52650] Updated weights for policy 0, policy_version 41741 (0.0030) [2024-08-06 02:54:54,866][52811] DAMAGECOUNT value on done: 337700.0 [2024-08-06 02:54:54,866][52811] Sum rewards: 68.394, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.026', 'HEALTH': '0.040', 'AMMO2': '0.058', 'AMMO3': '0.192', 'weapon4': '0.222', 'weapon5': '0.262', 'AMMO4': '0.291', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 02:54:56,877][52803] DAMAGECOUNT value on done: 331090.0 [2024-08-06 02:54:56,881][52803] Sum rewards: 79.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.250', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.158', 'AMMO3': '0.239', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '66.000'} [2024-08-06 02:54:57,259][52664] DAMAGECOUNT value on done: 372273.0 [2024-08-06 02:54:57,259][52664] Sum rewards: 72.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'weapon4': '0.196', 'AMMO3': '0.232', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 02:54:57,456][52795] DAMAGECOUNT value on done: 327070.0 [2024-08-06 02:54:57,457][52795] Sum rewards: 70.783, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO3': '0.208', 'weapon4': '0.208', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '58.000'} [2024-08-06 02:54:57,610][52671] DAMAGECOUNT value on done: 353759.0 [2024-08-06 02:54:57,611][52671] Sum rewards: 70.508, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.662', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.160', 'AMMO4': '0.215', 'weapon4': '0.250', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.750', 'weapon3': '2.964', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '61.000'} [2024-08-06 02:54:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 341991424. Throughput: 0: 4380.4. Samples: 85505510. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:54:57,794][52567] Avg episode reward: [(0, '69.147')] [2024-08-06 02:54:58,019][52811] DAMAGECOUNT value on done: 329757.0 [2024-08-06 02:54:58,019][52811] Sum rewards: 72.994, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.569', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.078', 'AMMO4': '0.149', 'weapon4': '0.168', 'weapon2': '0.202', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '61.500'} [2024-08-06 02:54:58,396][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:54:58,812][52659] DAMAGECOUNT value on done: 354446.0 [2024-08-06 02:54:58,812][52659] Sum rewards: 71.837, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.778', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.092', 'AMMO3': '0.197', 'AMMO4': '0.204', 'weapon5': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '59.000'} [2024-08-06 02:54:59,276][52665] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.138, -46.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 02:54:59,584][52650] Updated weights for policy 0, policy_version 41751 (0.0012) [2024-08-06 02:54:59,856][52803] DAMAGECOUNT value on done: 324705.0 [2024-08-06 02:54:59,856][52803] Sum rewards: 60.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.323', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.080', 'weapon4': '0.114', 'AMMO3': '0.187', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.278', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '51.000'} [2024-08-06 02:54:59,896][52664] DAMAGECOUNT value on done: 363166.0 [2024-08-06 02:54:59,897][52664] Sum rewards: 77.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.607', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.080', 'AMMO4': '0.135', 'weapon5': '0.140', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '62.000'} [2024-08-06 02:55:00,226][52671] DAMAGECOUNT value on done: 351921.0 [2024-08-06 02:55:00,227][52671] Sum rewards: 71.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.182', 'weapon4': '0.182', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.276', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '58.000'} [2024-08-06 02:55:00,455][52795] DAMAGECOUNT value on done: 333679.0 [2024-08-06 02:55:00,455][52795] Sum rewards: 65.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.034', 'weapon4': '0.056', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '56.500'} [2024-08-06 02:55:01,129][52811] DAMAGECOUNT value on done: 330813.0 [2024-08-06 02:55:01,129][52811] Sum rewards: 66.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.768', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.142', 'AMMO3': '0.169', 'weapon2': '0.180', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.000'} [2024-08-06 02:55:01,716][52659] DAMAGECOUNT value on done: 354145.0 [2024-08-06 02:55:01,716][52659] Sum rewards: 72.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.104', 'weapon5': '0.168', 'AMMO4': '0.215', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.706', 'WEAPON3': '1.400', 'weapon3': '2.748', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '61.000'} [2024-08-06 02:55:02,735][52664] DAMAGECOUNT value on done: 365479.0 [2024-08-06 02:55:02,735][52664] Sum rewards: 70.935, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.118', 'HEALTH': '0.128', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 342073344. Throughput: 0: 4385.6. Samples: 85518860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:55:02,794][52567] Avg episode reward: [(0, '69.516')] [2024-08-06 02:55:02,991][52803] DAMAGECOUNT value on done: 333813.0 [2024-08-06 02:55:02,991][52803] Sum rewards: 76.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '63.000'} [2024-08-06 02:55:03,730][52795] DAMAGECOUNT value on done: 330875.0 [2024-08-06 02:55:03,730][52795] Sum rewards: 75.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.182', 'AMMO3': '0.212', 'AMMO4': '0.231', 'weapon2': '0.258', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '62.000'} [2024-08-06 02:55:04,264][52811] DAMAGECOUNT value on done: 338042.0 [2024-08-06 02:55:04,265][52811] Sum rewards: 98.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.092', 'weapon4': '0.100', 'AMMO4': '0.184', 'AMMO3': '0.192', 'weapon2': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.428', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '23.565', 'FRAGCOUNT': '80.000'} [2024-08-06 02:55:04,398][52650] Updated weights for policy 0, policy_version 41761 (0.0046) [2024-08-06 02:55:04,736][52659] DAMAGECOUNT value on done: 352607.0 [2024-08-06 02:55:04,737][52659] Sum rewards: 66.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.128', 'weapon4': '0.144', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.226', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:05,600][52664] DAMAGECOUNT value on done: 366682.0 [2024-08-06 02:55:05,602][52664] Sum rewards: 72.486, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.118', 'AMMO4': '0.206', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'HEALTH': '0.590', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 02:55:06,158][52803] DAMAGECOUNT value on done: 330254.0 [2024-08-06 02:55:06,158][52803] Sum rewards: 59.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.815', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.186', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.136', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '50.000'} [2024-08-06 02:55:06,370][52666] DAMAGECOUNT value on done: 353455.0 [2024-08-06 02:55:06,370][52666] Sum rewards: 64.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.425', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.048', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:06,757][52795] DAMAGECOUNT value on done: 315761.0 [2024-08-06 02:55:06,757][52795] Sum rewards: 57.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.464', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO4': '0.148', 'weapon5': '0.166', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.838', 'WEAPON3': '1.100', 'weapon3': '2.694', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '48.000'} [2024-08-06 02:55:07,381][52659] DAMAGECOUNT value on done: 353678.0 [2024-08-06 02:55:07,381][52659] Sum rewards: 70.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:07,403][52811] DAMAGECOUNT value on done: 326523.0 [2024-08-06 02:55:07,403][52811] Sum rewards: 64.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.054', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.132', 'AMMO4': '0.152', 'AMMO3': '0.201', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.294', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '54.000'} [2024-08-06 02:55:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 342163456. Throughput: 0: 4381.3. Samples: 85545000. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:55:07,794][52567] Avg episode reward: [(0, '69.715')] [2024-08-06 02:55:08,487][52664] DAMAGECOUNT value on done: 365518.0 [2024-08-06 02:55:08,488][52664] Sum rewards: 76.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.362', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.115', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.128', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '64.000'} [2024-08-06 02:55:09,090][52650] Updated weights for policy 0, policy_version 41771 (0.0015) [2024-08-06 02:55:09,292][52666] DAMAGECOUNT value on done: 357546.0 [2024-08-06 02:55:09,295][52666] Sum rewards: 63.524, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.900', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.190', 'weapon5': '0.208', 'AMMO3': '0.222', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:09,449][52803] DAMAGECOUNT value on done: 327812.0 [2024-08-06 02:55:09,450][52803] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.106', 'AMMO3': '0.212', 'weapon4': '0.220', 'weapon2': '0.226', 'AMMO4': '0.289', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '64.500'} [2024-08-06 02:55:09,884][52795] DAMAGECOUNT value on done: 332916.0 [2024-08-06 02:55:09,886][52795] Sum rewards: 64.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.072', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.684', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '54.000'} [2024-08-06 02:55:10,008][52659] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:55:10,255][52659] DAMAGECOUNT value on done: 348683.0 [2024-08-06 02:55:10,261][52659] Sum rewards: 71.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.177', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.154', 'AMMO4': '0.175', 'AMMO3': '0.227', 'weapon5': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '58.000'} [2024-08-06 02:55:10,528][52811] DAMAGECOUNT value on done: 331782.0 [2024-08-06 02:55:10,528][52811] Sum rewards: 55.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.030', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.084', 'AMMO4': '0.197', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '2.920', 'weapon3': '2.964', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '51.000'} [2024-08-06 02:55:11,086][52664] DAMAGECOUNT value on done: 365078.0 [2024-08-06 02:55:11,086][52664] Sum rewards: 73.758, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '62.000'} [2024-08-06 02:55:12,458][52666] DAMAGECOUNT value on done: 356780.0 [2024-08-06 02:55:12,460][52666] Sum rewards: 75.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.430', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.146', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.012', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '64.000'} [2024-08-06 02:55:12,617][52803] DAMAGECOUNT value on done: 333274.0 [2024-08-06 02:55:12,620][52803] Sum rewards: 63.751, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.550', 'AMMO5': '0.028', 'AMMO2': '0.073', 'AMMO3': '0.250', 'weapon5': '0.346', 'AMMO4': '0.364', 'weapon2': '0.370', 'weapon4': '0.384', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.492', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '56.500'} [2024-08-06 02:55:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 342253568. Throughput: 0: 4377.3. Samples: 85571220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:55:12,794][52567] Avg episode reward: [(0, '69.727')] [2024-08-06 02:55:13,068][52795] DAMAGECOUNT value on done: 323875.0 [2024-08-06 02:55:13,068][52795] Sum rewards: 75.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.605', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.014', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '3.470', 'weapon3': '3.492', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '62.000'} [2024-08-06 02:55:13,314][52670] DAMAGECOUNT value on done: 349815.0 [2024-08-06 02:55:13,315][52670] Sum rewards: 79.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.814', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.162', 'weapon5': '0.174', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.820', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '64.000'} [2024-08-06 02:55:13,411][52659] DAMAGECOUNT value on done: 353886.0 [2024-08-06 02:55:13,412][52659] Sum rewards: 64.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.135', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.304', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:13,544][52811] DAMAGECOUNT value on done: 331114.0 [2024-08-06 02:55:13,545][52811] Sum rewards: 62.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.802', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.150', 'weapon2': '0.206', 'weapon4': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.162', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:13,833][52650] Updated weights for policy 0, policy_version 41781 (0.0012) [2024-08-06 02:55:13,951][52614] Signal inference workers to stop experience collection... (7550 times) [2024-08-06 02:55:13,965][52614] Signal inference workers to resume experience collection... (7550 times) [2024-08-06 02:55:14,041][52650] InferenceWorker_p0-w0: stopping experience collection (7550 times) [2024-08-06 02:55:14,041][52650] InferenceWorker_p0-w0: resuming experience collection (7550 times) [2024-08-06 02:55:14,274][52647] DAMAGECOUNT value on done: 372420.0 [2024-08-06 02:55:14,275][52647] Sum rewards: 68.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'weapon4': '0.210', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.324', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:15,265][52666] DAMAGECOUNT value on done: 353903.0 [2024-08-06 02:55:15,265][52666] Sum rewards: 76.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.130', 'AMMO4': '0.132', 'weapon5': '0.162', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '61.000'} [2024-08-06 02:55:15,515][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:55:15,726][52803] DAMAGECOUNT value on done: 327541.0 [2024-08-06 02:55:15,729][52803] Sum rewards: 72.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.128', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '60.000'} [2024-08-06 02:55:16,201][52795] DAMAGECOUNT value on done: 325280.0 [2024-08-06 02:55:16,203][52795] Sum rewards: 83.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.477', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.093', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.364', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '68.000'} [2024-08-06 02:55:16,240][52670] DAMAGECOUNT value on done: 353402.0 [2024-08-06 02:55:16,240][52670] Sum rewards: 67.683, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.970', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO4': '0.218', 'AMMO3': '0.267', 'weapon4': '0.278', 'weapon5': '0.292', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.624', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '56.500'} [2024-08-06 02:55:16,516][52659] DAMAGECOUNT value on done: 353323.0 [2024-08-06 02:55:16,518][52659] Sum rewards: 72.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.041', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'weapon2': '0.206', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.468', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '62.000'} [2024-08-06 02:55:16,656][52811] DAMAGECOUNT value on done: 327201.0 [2024-08-06 02:55:16,658][52811] Sum rewards: 62.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.116', 'AMMO4': '0.137', 'weapon5': '0.144', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '54.000'} [2024-08-06 02:55:16,765][52647] DAMAGECOUNT value on done: 371222.0 [2024-08-06 02:55:16,767][52647] Sum rewards: 68.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.032', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.144', 'weapon4': '0.148', 'weapon5': '0.160', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '0.950', 'weapon3': '2.870', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 342335488. Throughput: 0: 4384.2. Samples: 85584390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:55:17,794][52567] Avg episode reward: [(0, '69.974')] [2024-08-06 02:55:17,807][52614] Saving new best policy, reward=69.974! [2024-08-06 02:55:17,987][52666] DAMAGECOUNT value on done: 350559.0 [2024-08-06 02:55:17,989][52666] Sum rewards: 73.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.445', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.220', 'AMMO4': '0.231', 'AMMO3': '0.262', 'weapon4': '0.264', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.858', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '63.000'} [2024-08-06 02:55:18,225][52650] Updated weights for policy 0, policy_version 41791 (0.0011) [2024-08-06 02:55:18,911][52803] DAMAGECOUNT value on done: 327019.0 [2024-08-06 02:55:18,911][52803] Sum rewards: 64.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:19,028][52670] DAMAGECOUNT value on done: 344075.0 [2024-08-06 02:55:19,033][52670] Sum rewards: 58.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.072', 'weapon4': '0.134', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.344', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.198', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '51.000'} [2024-08-06 02:55:19,200][52647] DAMAGECOUNT value on done: 370444.0 [2024-08-06 02:55:19,202][52647] Sum rewards: 67.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.461', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.228', 'AMMO4': '0.264', 'weapon5': '0.314', 'weapon2': '0.324', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:19,250][52659] DAMAGECOUNT value on done: 351397.0 [2024-08-06 02:55:19,250][52659] Sum rewards: 73.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.204', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:19,286][52795] DAMAGECOUNT value on done: 321236.0 [2024-08-06 02:55:19,286][52795] Sum rewards: 63.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.142', 'AMMO4': '0.202', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:19,870][52811] DAMAGECOUNT value on done: 329825.0 [2024-08-06 02:55:19,872][52811] Sum rewards: 73.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.072', 'AMMO4': '0.148', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '58.000'} [2024-08-06 02:55:21,290][52666] DAMAGECOUNT value on done: 345218.0 [2024-08-06 02:55:21,291][52666] Sum rewards: 72.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.579', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon4': '0.210', 'AMMO3': '0.213', 'weapon5': '0.260', 'weapon2': '0.266', 'AMMO4': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.964', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:21,692][52647] DAMAGECOUNT value on done: 377291.0 [2024-08-06 02:55:21,692][52647] Sum rewards: 82.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '69.000'} [2024-08-06 02:55:22,109][52670] DAMAGECOUNT value on done: 343628.0 [2024-08-06 02:55:22,109][52670] Sum rewards: 60.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.017', 'AMMO2': '0.080', 'AMMO3': '0.205', 'weapon5': '0.252', 'weapon4': '0.274', 'weapon2': '0.340', 'AMMO4': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '50.500'} [2024-08-06 02:55:22,270][52659] DAMAGECOUNT value on done: 360257.0 [2024-08-06 02:55:22,271][52659] Sum rewards: 68.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.017', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.310', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '56.000'} [2024-08-06 02:55:22,285][52803] DAMAGECOUNT value on done: 337408.0 [2024-08-06 02:55:22,290][52803] Sum rewards: 73.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.180', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '61.000'} [2024-08-06 02:55:22,338][52795] DAMAGECOUNT value on done: 329576.0 [2024-08-06 02:55:22,339][52795] Sum rewards: 61.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.124', 'AMMO4': '0.172', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '2.886', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '54.000'} [2024-08-06 02:55:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 342425600. Throughput: 0: 4376.4. Samples: 85610290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:55:22,794][52567] Avg episode reward: [(0, '69.687')] [2024-08-06 02:55:23,007][52811] DAMAGECOUNT value on done: 332230.0 [2024-08-06 02:55:23,010][52811] Sum rewards: 78.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.082', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.051', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.494', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '66.000'} [2024-08-06 02:55:23,180][52650] Updated weights for policy 0, policy_version 41801 (0.0018) [2024-08-06 02:55:23,981][52666] DAMAGECOUNT value on done: 353185.0 [2024-08-06 02:55:23,983][52666] Sum rewards: 53.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.333', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.218', 'weapon5': '0.242', 'AMMO4': '0.290', 'weapon4': '0.450', 'weapon2': '0.544', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.320', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '45.000'} [2024-08-06 02:55:24,396][52647] DAMAGECOUNT value on done: 373202.0 [2024-08-06 02:55:24,396][52647] Sum rewards: 65.914, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.826', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.094', 'AMMO4': '0.114', 'AMMO3': '0.131', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '0.900', 'HITCOUNT': '2.940', 'weapon3': '3.042', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '50.000'} [2024-08-06 02:55:24,691][52663] DAMAGECOUNT value on done: 358311.0 [2024-08-06 02:55:24,691][52663] Sum rewards: 67.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon4': '0.382', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:25,084][52670] DAMAGECOUNT value on done: 356955.0 [2024-08-06 02:55:25,085][52670] Sum rewards: 68.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.525', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon2': '0.166', 'AMMO3': '0.203', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '56.000'} [2024-08-06 02:55:25,342][52659] DAMAGECOUNT value on done: 361573.0 [2024-08-06 02:55:25,342][52659] Sum rewards: 74.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.750', 'AMMO5': '0.019', 'AMMO2': '0.062', 'AMMO3': '0.192', 'weapon5': '0.200', 'weapon4': '0.288', 'AMMO4': '0.309', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '64.000'} [2024-08-06 02:55:25,429][52803] DAMAGECOUNT value on done: 329890.0 [2024-08-06 02:55:25,431][52803] Sum rewards: 65.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.118', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.614', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '56.000'} [2024-08-06 02:55:25,472][52795] DAMAGECOUNT value on done: 321124.0 [2024-08-06 02:55:25,473][52795] Sum rewards: 74.658, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.763', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.118', 'weapon2': '0.174', 'weapon4': '0.188', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '64.000'} [2024-08-06 02:55:26,210][52811] DAMAGECOUNT value on done: 327517.0 [2024-08-06 02:55:26,211][52811] Sum rewards: 62.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.010', 'AMMO4': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.526', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '54.000'} [2024-08-06 02:55:26,788][52666] DAMAGECOUNT value on done: 351943.0 [2024-08-06 02:55:26,790][52666] Sum rewards: 77.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.802', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'weapon4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '66.000'} [2024-08-06 02:55:27,163][52647] DAMAGECOUNT value on done: 375515.0 [2024-08-06 02:55:27,164][52647] Sum rewards: 60.150, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.895', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.140', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.736', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.000'} [2024-08-06 02:55:27,255][52663] DAMAGECOUNT value on done: 351157.0 [2024-08-06 02:55:27,255][52663] Sum rewards: 66.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.179', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.137', 'weapon4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:27,644][52650] Updated weights for policy 0, policy_version 41811 (0.0021) [2024-08-06 02:55:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 342515712. Throughput: 0: 4368.0. Samples: 85636410. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:55:27,794][52567] Avg episode reward: [(0, '69.740')] [2024-08-06 02:55:27,807][52670] DAMAGECOUNT value on done: 348125.0 [2024-08-06 02:55:27,807][52670] Sum rewards: 47.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.947', 'AMMO5': '0.022', 'AMMO2': '0.053', 'weapon4': '0.212', 'weapon2': '0.234', 'AMMO3': '0.241', 'weapon5': '0.262', 'AMMO4': '0.263', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.320', 'weapon3': '2.924', 'DAMAGECOUNT': '13.413', 'FRAGCOUNT': '42.000'} [2024-08-06 02:55:28,183][52659] DAMAGECOUNT value on done: 353094.0 [2024-08-06 02:55:28,184][52659] Sum rewards: 59.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.146', 'AMMO4': '0.173', 'weapon5': '0.176', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '51.000'} [2024-08-06 02:55:28,563][52803] DAMAGECOUNT value on done: 333786.0 [2024-08-06 02:55:28,563][52803] Sum rewards: 63.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.812', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.244', 'AMMO3': '0.271', 'weapon2': '0.290', 'AMMO4': '0.307', 'WEAPON5': '0.400', 'weapon4': '0.444', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.638', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:28,612][52795] DAMAGECOUNT value on done: 336368.0 [2024-08-06 02:55:28,613][52795] Sum rewards: 78.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.684', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.050', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '63.000'} [2024-08-06 02:55:29,300][52811] DAMAGECOUNT value on done: 332228.0 [2024-08-06 02:55:29,300][52811] Sum rewards: 54.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.114', 'AMMO4': '0.166', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '3.308', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '47.000'} [2024-08-06 02:55:29,630][52811] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.552, 184.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:55:29,887][52647] DAMAGECOUNT value on done: 372986.0 [2024-08-06 02:55:29,888][52647] Sum rewards: 71.871, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.479', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.281', 'weapon4': '0.284', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.036', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '61.000'} [2024-08-06 02:55:29,915][52666] DAMAGECOUNT value on done: 348567.0 [2024-08-06 02:55:29,915][52666] Sum rewards: 65.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.484', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.344', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:30,110][52663] DAMAGECOUNT value on done: 350676.0 [2024-08-06 02:55:30,112][52663] Sum rewards: 78.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.642', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.181', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 02:55:30,733][52670] DAMAGECOUNT value on done: 343225.0 [2024-08-06 02:55:30,734][52670] Sum rewards: 74.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.454', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.226', 'AMMO4': '0.250', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '61.000'} [2024-08-06 02:55:31,216][52659] DAMAGECOUNT value on done: 356821.0 [2024-08-06 02:55:31,217][52659] Sum rewards: 74.476, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.159', 'weapon5': '0.160', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '61.000'} [2024-08-06 02:55:31,587][52795] DAMAGECOUNT value on done: 329258.0 [2024-08-06 02:55:31,589][52795] Sum rewards: 71.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.172', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon4': '0.164', 'weapon5': '0.192', 'AMMO4': '0.207', 'weapon2': '0.244', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '61.500'} [2024-08-06 02:55:31,888][52803] DAMAGECOUNT value on done: 326075.0 [2024-08-06 02:55:31,889][52803] Sum rewards: 76.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.010', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.197', 'AMMO4': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '63.000'} [2024-08-06 02:55:32,403][52650] Updated weights for policy 0, policy_version 41821 (0.0039) [2024-08-06 02:55:32,594][52647] DAMAGECOUNT value on done: 368413.0 [2024-08-06 02:55:32,595][52647] Sum rewards: 58.026, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.786', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.165', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.304', 'weapon2': '0.340', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '2.966', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '47.000'} [2024-08-06 02:55:32,769][52663] DAMAGECOUNT value on done: 353880.0 [2024-08-06 02:55:32,770][52663] Sum rewards: 46.051, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.224', 'AMMO5': '0.030', 'AMMO2': '0.070', 'AMMO3': '0.204', 'weapon4': '0.208', 'AMMO4': '0.352', 'weapon2': '0.406', 'weapon5': '0.436', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'HITCOUNT': '2.480', 'weapon3': '2.570', 'DAMAGECOUNT': '12.618', 'FRAGCOUNT': '41.000'} [2024-08-06 02:55:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 342605824. Throughput: 0: 4370.2. Samples: 85649730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:55:32,794][52567] Avg episode reward: [(0, '69.346')] [2024-08-06 02:55:32,970][52666] DAMAGECOUNT value on done: 346376.0 [2024-08-06 02:55:32,972][52666] Sum rewards: 62.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.140', 'weapon4': '0.166', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '3.178', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:33,960][52670] DAMAGECOUNT value on done: 347747.0 [2024-08-06 02:55:33,968][52670] Sum rewards: 69.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.040', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.310', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '58.000'} [2024-08-06 02:55:34,383][52659] DAMAGECOUNT value on done: 347853.0 [2024-08-06 02:55:34,383][52659] Sum rewards: 80.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.054', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '66.000'} [2024-08-06 02:55:34,445][52820] DAMAGECOUNT value on done: 323170.0 [2024-08-06 02:55:34,446][52820] Sum rewards: 61.841, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.272', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'weapon2': '0.246', 'weapon4': '0.344', 'WEAPON3': '0.950', 'HITCOUNT': '3.090', 'weapon3': '3.114', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '49.000'} [2024-08-06 02:55:34,690][52795] DAMAGECOUNT value on done: 320174.0 [2024-08-06 02:55:34,692][52795] Sum rewards: 73.585, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.078', 'AMMO4': '0.181', 'AMMO3': '0.218', 'HEALTH': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '60.000'} [2024-08-06 02:55:35,562][52647] DAMAGECOUNT value on done: 380251.0 [2024-08-06 02:55:35,562][52647] Sum rewards: 80.673, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.266', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.188', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '68.000'} [2024-08-06 02:55:35,721][52663] DAMAGECOUNT value on done: 352582.0 [2024-08-06 02:55:35,721][52663] Sum rewards: 61.246, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.320', 'AMMO5': '0.020', 'AMMO2': '0.081', 'weapon5': '0.184', 'AMMO3': '0.276', 'weapon2': '0.282', 'weapon4': '0.366', 'AMMO4': '0.405', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'WEAPON3': '1.650', 'weapon3': '2.788', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:36,105][52666] DAMAGECOUNT value on done: 348124.0 [2024-08-06 02:55:36,105][52666] Sum rewards: 75.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.692', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.088', 'weapon5': '0.136', 'AMMO4': '0.151', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '61.000'} [2024-08-06 02:55:36,904][52666] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:55:37,034][52650] Updated weights for policy 0, policy_version 41831 (0.0023) [2024-08-06 02:55:37,075][52670] DAMAGECOUNT value on done: 350785.0 [2024-08-06 02:55:37,076][52670] Sum rewards: 80.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.453', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.154', 'AMMO3': '0.168', 'weapon4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '63.000'} [2024-08-06 02:55:37,193][52659] DAMAGECOUNT value on done: 352410.0 [2024-08-06 02:55:37,193][52659] Sum rewards: 58.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.182', 'weapon5': '0.182', 'AMMO3': '0.206', 'AMMO4': '0.305', 'weapon2': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.086', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '51.500'} [2024-08-06 02:55:37,657][52820] DAMAGECOUNT value on done: 328456.0 [2024-08-06 02:55:37,658][52820] Sum rewards: 62.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.154', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.212', 'weapon4': '0.218', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.218', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '54.000'} [2024-08-06 02:55:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 342687744. Throughput: 0: 4372.7. Samples: 85675940. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:55:37,794][52567] Avg episode reward: [(0, '69.284')] [2024-08-06 02:55:37,991][52795] DAMAGECOUNT value on done: 329719.0 [2024-08-06 02:55:37,991][52795] Sum rewards: 66.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.562', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon4': '0.192', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '58.000'} [2024-08-06 02:55:38,441][52663] DAMAGECOUNT value on done: 355934.0 [2024-08-06 02:55:38,441][52663] Sum rewards: 56.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.624', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.160', 'weapon5': '0.178', 'AMMO3': '0.208', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.198', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '46.000'} [2024-08-06 02:55:38,534][52647] DAMAGECOUNT value on done: 369710.0 [2024-08-06 02:55:38,535][52647] Sum rewards: 73.402, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.165', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.246', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '63.000'} [2024-08-06 02:55:38,935][52666] DAMAGECOUNT value on done: 346726.0 [2024-08-06 02:55:38,936][52666] Sum rewards: 68.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.025', 'AMMO2': '0.071', 'AMMO3': '0.199', 'weapon5': '0.236', 'weapon4': '0.242', 'weapon2': '0.274', 'AMMO4': '0.353', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:39,815][52659] DAMAGECOUNT value on done: 360038.0 [2024-08-06 02:55:39,815][52659] Sum rewards: 69.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.462', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.318', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:39,868][52670] DAMAGECOUNT value on done: 342567.0 [2024-08-06 02:55:39,868][52670] Sum rewards: 73.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.133', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.114', 'weapon4': '0.128', 'AMMO4': '0.219', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '60.000'} [2024-08-06 02:55:40,715][52820] DAMAGECOUNT value on done: 327781.0 [2024-08-06 02:55:40,715][52820] Sum rewards: 66.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.136', 'AMMO4': '0.147', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '55.500'} [2024-08-06 02:55:41,020][52647] DAMAGECOUNT value on done: 376853.0 [2024-08-06 02:55:41,020][52647] Sum rewards: 67.203, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.930', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.188', 'AMMO4': '0.195', 'AMMO3': '0.283', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.100', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:41,076][52795] DAMAGECOUNT value on done: 333647.0 [2024-08-06 02:55:41,076][52795] Sum rewards: 70.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.258', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.077', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '58.000'} [2024-08-06 02:55:41,407][52663] DAMAGECOUNT value on done: 354095.0 [2024-08-06 02:55:41,410][52663] Sum rewards: 54.345, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.806', 'AMMO5': '0.028', 'AMMO2': '0.049', 'weapon4': '0.120', 'weapon5': '0.122', 'AMMO4': '0.246', 'AMMO3': '0.273', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.102', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '51.500'} [2024-08-06 02:55:41,678][52650] Updated weights for policy 0, policy_version 41841 (0.0033) [2024-08-06 02:55:41,770][52666] DAMAGECOUNT value on done: 356523.0 [2024-08-06 02:55:41,770][52666] Sum rewards: 68.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.496', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 342777856. Throughput: 0: 4374.2. Samples: 85702350. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:55:42,795][52567] Avg episode reward: [(0, '68.699')] [2024-08-06 02:55:42,814][52670] DAMAGECOUNT value on done: 357130.0 [2024-08-06 02:55:42,814][52670] Sum rewards: 71.726, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.574', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.114', 'AMMO3': '0.179', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '56.000'} [2024-08-06 02:55:43,167][52659] DAMAGECOUNT value on done: 360332.0 [2024-08-06 02:55:43,167][52659] Sum rewards: 63.076, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.116', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.170', 'AMMO4': '0.219', 'AMMO3': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.956', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.500'} [2024-08-06 02:55:43,374][52647] DAMAGECOUNT value on done: 367352.0 [2024-08-06 02:55:43,374][52647] Sum rewards: 62.384, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.776', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.198', 'AMMO3': '0.233', 'weapon5': '0.280', 'AMMO4': '0.299', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '53.000'} [2024-08-06 02:55:43,806][52820] DAMAGECOUNT value on done: 323085.0 [2024-08-06 02:55:43,807][52820] Sum rewards: 68.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.580', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon2': '0.200', 'weapon4': '0.220', 'AMMO3': '0.255', 'AMMO4': '0.272', 'weapon5': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.986', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:43,922][52663] DAMAGECOUNT value on done: 350899.0 [2024-08-06 02:55:43,923][52663] Sum rewards: 61.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.220', 'weapon4': '0.240', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '51.000'} [2024-08-06 02:55:43,986][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:55:44,922][52666] DAMAGECOUNT value on done: 352529.0 [2024-08-06 02:55:44,930][52666] Sum rewards: 51.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.140', 'weapon4': '0.176', 'AMMO4': '0.181', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '3.090', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '44.000'} [2024-08-06 02:55:45,720][52659] DAMAGECOUNT value on done: 357184.0 [2024-08-06 02:55:45,721][52659] Sum rewards: 78.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.656', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.030', 'weapon5': '0.042', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.318', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '66.000'} [2024-08-06 02:55:46,009][52670] DAMAGECOUNT value on done: 348532.0 [2024-08-06 02:55:46,009][52670] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.786', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.129', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:46,196][52650] Updated weights for policy 0, policy_version 41851 (0.0031) [2024-08-06 02:55:46,459][52647] DAMAGECOUNT value on done: 371063.0 [2024-08-06 02:55:46,459][52647] Sum rewards: 86.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.156', 'weapon4': '0.160', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '69.000'} [2024-08-06 02:55:46,588][52663] DAMAGECOUNT value on done: 348603.0 [2024-08-06 02:55:46,589][52663] Sum rewards: 76.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.283', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.328', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '65.000'} [2024-08-06 02:55:46,909][52820] DAMAGECOUNT value on done: 328029.0 [2024-08-06 02:55:46,910][52820] Sum rewards: 78.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.545', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'AMMO4': '0.230', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.378', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '64.000'} [2024-08-06 02:55:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 342859776. Throughput: 0: 4362.0. Samples: 85715150. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 02:55:47,794][52567] Avg episode reward: [(0, '68.294')] [2024-08-06 02:55:47,956][52666] DAMAGECOUNT value on done: 350459.0 [2024-08-06 02:55:47,960][52666] Sum rewards: 72.165, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.814', 'AMMO2': '0.021', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.168', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.370', 'weapon3': '3.422', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:48,786][52659] DAMAGECOUNT value on done: 352430.0 [2024-08-06 02:55:48,787][52659] Sum rewards: 72.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.242', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.197', 'weapon5': '0.220', 'weapon2': '0.230', 'WEAPON5': '0.450', 'weapon4': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '59.000'} [2024-08-06 02:55:48,973][52647] DAMAGECOUNT value on done: 370534.0 [2024-08-06 02:55:48,974][52647] Sum rewards: 60.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.142', 'weapon5': '0.142', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.804', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '50.000'} [2024-08-06 02:55:49,088][52670] DAMAGECOUNT value on done: 349781.0 [2024-08-06 02:55:49,089][52670] Sum rewards: 54.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.265', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.150', 'weapon2': '0.160', 'AMMO3': '0.173', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.550', 'weapon3': '3.364', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '46.000'} [2024-08-06 02:55:49,370][52663] DAMAGECOUNT value on done: 354582.0 [2024-08-06 02:55:49,371][52663] Sum rewards: 57.025, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.380', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.174', 'weapon4': '0.198', 'AMMO3': '0.228', 'AMMO4': '0.237', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.664', 'WEAPON3': '1.350', 'weapon3': '2.680', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '51.000'} [2024-08-06 02:55:50,088][52820] DAMAGECOUNT value on done: 321797.0 [2024-08-06 02:55:50,090][52820] Sum rewards: 70.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.394', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '58.000'} [2024-08-06 02:55:50,937][52666] DAMAGECOUNT value on done: 352922.0 [2024-08-06 02:55:50,937][52666] Sum rewards: 74.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.226', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.404', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '62.000'} [2024-08-06 02:55:50,942][52650] Updated weights for policy 0, policy_version 41861 (0.0011) [2024-08-06 02:55:51,311][52647] DAMAGECOUNT value on done: 379088.0 [2024-08-06 02:55:51,313][52647] Sum rewards: 75.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.068', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.217', 'WEAPON3': '1.400', 'HITCOUNT': '3.500', 'weapon3': '3.528', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '64.000'} [2024-08-06 02:55:51,712][52659] DAMAGECOUNT value on done: 358906.0 [2024-08-06 02:55:51,712][52659] Sum rewards: 75.481, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.981', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.140', 'AMMO4': '0.189', 'weapon4': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.062', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '65.000'} [2024-08-06 02:55:52,000][52670] DAMAGECOUNT value on done: 355580.0 [2024-08-06 02:55:52,002][52670] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.268', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.002', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '60.000'} [2024-08-06 02:55:52,123][52663] DAMAGECOUNT value on done: 357644.0 [2024-08-06 02:55:52,126][52663] Sum rewards: 68.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.158', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '57.000'} [2024-08-06 02:55:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 342949888. Throughput: 0: 4368.7. Samples: 85741590. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:55:52,794][52567] Avg episode reward: [(0, '68.430')] [2024-08-06 02:55:53,229][52820] DAMAGECOUNT value on done: 324501.0 [2024-08-06 02:55:53,229][52820] Sum rewards: 60.674, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.906', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.118', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.566', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '52.000'} [2024-08-06 02:55:53,653][52647] DAMAGECOUNT value on done: 371690.0 [2024-08-06 02:55:53,654][52647] Sum rewards: 78.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.906', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.176', 'AMMO3': '0.210', 'weapon5': '0.222', 'AMMO4': '0.302', 'weapon2': '0.398', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '65.000'} [2024-08-06 02:55:53,733][52666] DAMAGECOUNT value on done: 350817.0 [2024-08-06 02:55:53,736][52666] Sum rewards: 70.340, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.648', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.161', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.446', 'WEAPON3': '0.950', 'weapon3': '2.842', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:54,788][52659] DAMAGECOUNT value on done: 356848.0 [2024-08-06 02:55:54,791][52659] Sum rewards: 65.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.152', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon5': '0.302', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '55.000'} [2024-08-06 02:55:54,840][52663] DAMAGECOUNT value on done: 354233.0 [2024-08-06 02:55:54,845][52663] Sum rewards: 77.446, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.945', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.118', 'AMMO4': '0.229', 'weapon2': '0.252', 'AMMO3': '0.262', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '66.000'} [2024-08-06 02:55:55,041][52670] DAMAGECOUNT value on done: 351997.0 [2024-08-06 02:55:55,041][52670] Sum rewards: 75.911, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.784', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.110', 'weapon5': '0.174', 'AMMO4': '0.208', 'AMMO3': '0.228', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '67.000'} [2024-08-06 02:55:55,686][52650] Updated weights for policy 0, policy_version 41871 (0.0013) [2024-08-06 02:55:56,283][52647] DAMAGECOUNT value on done: 369924.0 [2024-08-06 02:55:56,283][52647] Sum rewards: 75.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.112', 'AMMO4': '0.144', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '62.000'} [2024-08-06 02:55:56,286][52820] DAMAGECOUNT value on done: 331756.0 [2024-08-06 02:55:56,287][52820] Sum rewards: 82.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '67.500'} [2024-08-06 02:55:56,946][52666] DAMAGECOUNT value on done: 351536.0 [2024-08-06 02:55:56,947][52666] Sum rewards: 61.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.608', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.064', 'weapon5': '0.096', 'AMMO4': '0.124', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.220', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '53.500'} [2024-08-06 02:55:57,797][52567] Fps is (10 sec: 18017.3, 60 sec: 17475.5, 300 sec: 17522.4). Total num frames: 343040000. Throughput: 0: 4368.2. Samples: 85767800. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:55:57,804][52567] Avg episode reward: [(0, '68.702')] [2024-08-06 02:55:57,860][52670] DAMAGECOUNT value on done: 338567.0 [2024-08-06 02:55:57,861][52670] Sum rewards: 59.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.964', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.142', 'weapon4': '0.180', 'AMMO4': '0.183', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '49.500'} [2024-08-06 02:55:57,965][52663] DAMAGECOUNT value on done: 347329.0 [2024-08-06 02:55:57,966][52663] Sum rewards: 74.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.537', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '60.000'} [2024-08-06 02:55:59,117][52647] DAMAGECOUNT value on done: 366779.0 [2024-08-06 02:55:59,119][52647] Sum rewards: 65.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.890', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.180', 'AMMO4': '0.193', 'weapon4': '0.214', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '56.000'} [2024-08-06 02:55:59,340][52820] DAMAGECOUNT value on done: 326135.0 [2024-08-06 02:55:59,342][52820] Sum rewards: 77.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '65.000'} [2024-08-06 02:55:59,590][52666] DAMAGECOUNT value on done: 343875.0 [2024-08-06 02:55:59,592][52666] Sum rewards: 55.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.588', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.079', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.262', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'HITCOUNT': '2.740', 'weapon3': '3.368', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '49.000'} [2024-08-06 02:56:00,418][52650] Updated weights for policy 0, policy_version 41881 (0.0024) [2024-08-06 02:56:00,813][52670] DAMAGECOUNT value on done: 352938.0 [2024-08-06 02:56:00,822][52670] Sum rewards: 70.776, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.549', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.172', 'weapon5': '0.190', 'weapon4': '0.238', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.930', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:00,928][52663] DAMAGECOUNT value on done: 348421.0 [2024-08-06 02:56:00,929][52663] Sum rewards: 53.536, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.075', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.172', 'weapon4': '0.206', 'AMMO4': '0.231', 'AMMO3': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.700', 'HITCOUNT': '2.830', 'weapon3': '2.862', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '49.500'} [2024-08-06 02:56:01,123][52667] DAMAGECOUNT value on done: 352887.0 [2024-08-06 02:56:01,123][52667] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon2': '0.640', 'WEAPON3': '1.000', 'weapon3': '3.152', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:01,600][52647] DAMAGECOUNT value on done: 366718.0 [2024-08-06 02:56:01,600][52647] Sum rewards: 63.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon2': '0.184', 'AMMO3': '0.210', 'weapon4': '0.226', 'AMMO4': '0.296', 'weapon5': '0.300', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '2.968', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '52.000'} [2024-08-06 02:56:02,386][52820] DAMAGECOUNT value on done: 328910.0 [2024-08-06 02:56:02,390][52820] Sum rewards: 57.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.764', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.130', 'weapon5': '0.140', 'AMMO4': '0.230', 'AMMO3': '0.259', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.172', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2024-08-06 02:56:02,651][52666] DAMAGECOUNT value on done: 351538.0 [2024-08-06 02:56:02,652][52666] Sum rewards: 77.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.181', 'AMMO4': '0.283', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '65.000'} [2024-08-06 02:56:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 343130112. Throughput: 0: 4364.4. Samples: 85780790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:56:02,794][52567] Avg episode reward: [(0, '68.290')] [2024-08-06 02:56:03,560][52670] DAMAGECOUNT value on done: 358715.0 [2024-08-06 02:56:03,561][52670] Sum rewards: 72.740, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.485', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon2': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.321', 'WEAPON3': '1.800', 'weapon3': '3.302', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '65.000'} [2024-08-06 02:56:03,651][52663] DAMAGECOUNT value on done: 350282.0 [2024-08-06 02:56:03,652][52663] Sum rewards: 66.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon2': '0.188', 'weapon5': '0.202', 'AMMO3': '0.233', 'AMMO4': '0.285', 'weapon4': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:04,248][52667] DAMAGECOUNT value on done: 359395.0 [2024-08-06 02:56:04,249][52667] Sum rewards: 80.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '68.000'} [2024-08-06 02:56:04,537][52647] DAMAGECOUNT value on done: 370082.0 [2024-08-06 02:56:04,538][52647] Sum rewards: 66.043, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.974', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.058', 'weapon5': '0.148', 'AMMO4': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:05,141][52650] Updated weights for policy 0, policy_version 41891 (0.0017) [2024-08-06 02:56:05,499][52820] DAMAGECOUNT value on done: 326305.0 [2024-08-06 02:56:05,499][52820] Sum rewards: 57.925, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.270', 'AMMO2': '0.014', 'AMMO5': '0.017', 'AMMO4': '0.071', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '0.900', 'weapon3': '2.804', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '45.500'} [2024-08-06 02:56:06,450][52670] DAMAGECOUNT value on done: 351345.0 [2024-08-06 02:56:06,458][52670] Sum rewards: 69.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.116', 'AMMO4': '0.174', 'weapon2': '0.242', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.296', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '61.000'} [2024-08-06 02:56:06,524][52663] DAMAGECOUNT value on done: 359802.0 [2024-08-06 02:56:06,525][52663] Sum rewards: 74.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.031', 'weapon5': '0.044', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.372', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '65.000'} [2024-08-06 02:56:06,942][52667] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:56:07,144][52667] DAMAGECOUNT value on done: 354377.0 [2024-08-06 02:56:07,146][52667] Sum rewards: 68.798, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.786', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.066', 'weapon5': '0.088', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:07,318][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:56:07,794][52567] Fps is (10 sec: 17208.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 343212032. Throughput: 0: 4374.4. Samples: 85807140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:56:07,794][52567] Avg episode reward: [(0, '68.233')] [2024-08-06 02:56:08,731][52820] DAMAGECOUNT value on done: 329399.0 [2024-08-06 02:56:08,731][52820] Sum rewards: 69.798, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.929', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.190', 'AMMO3': '0.199', 'AMMO4': '0.245', 'weapon4': '0.300', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:09,291][52663] DAMAGECOUNT value on done: 352620.0 [2024-08-06 02:56:09,291][52663] Sum rewards: 73.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.148', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '62.000'} [2024-08-06 02:56:09,434][52670] DAMAGECOUNT value on done: 350401.0 [2024-08-06 02:56:09,434][52670] Sum rewards: 70.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.090', 'AMMO5': '0.014', 'AMMO2': '0.063', 'AMMO3': '0.191', 'weapon2': '0.206', 'weapon5': '0.240', 'AMMO4': '0.316', 'weapon4': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '57.000'} [2024-08-06 02:56:09,752][52650] Updated weights for policy 0, policy_version 41901 (0.0015) [2024-08-06 02:56:10,036][52667] DAMAGECOUNT value on done: 355782.0 [2024-08-06 02:56:10,036][52667] Sum rewards: 65.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.368', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:11,874][52820] DAMAGECOUNT value on done: 333594.0 [2024-08-06 02:56:11,881][52820] Sum rewards: 64.108, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.945', 'AMMO5': '0.022', 'AMMO2': '0.061', 'weapon4': '0.214', 'AMMO3': '0.257', 'weapon2': '0.296', 'AMMO4': '0.306', 'weapon5': '0.308', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:12,237][52663] DAMAGECOUNT value on done: 358741.0 [2024-08-06 02:56:12,238][52663] Sum rewards: 57.352, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.701', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.106', 'AMMO3': '0.197', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.162', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '48.500'} [2024-08-06 02:56:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 343302144. Throughput: 0: 4385.8. Samples: 85833770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 02:56:12,794][52567] Avg episode reward: [(0, '68.224')] [2024-08-06 02:56:12,892][52667] DAMAGECOUNT value on done: 359891.0 [2024-08-06 02:56:12,892][52667] Sum rewards: 57.851, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.430', 'AMMO5': '0.021', 'AMMO2': '0.071', 'weapon4': '0.104', 'weapon5': '0.150', 'AMMO3': '0.270', 'AMMO4': '0.357', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.940', 'weapon3': '2.958', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:14,611][52650] Updated weights for policy 0, policy_version 41911 (0.0012) [2024-08-06 02:56:14,928][52820] DAMAGECOUNT value on done: 329696.0 [2024-08-06 02:56:14,930][52820] Sum rewards: 67.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.194', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.080', 'AMMO4': '0.080', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:15,594][52663] DAMAGECOUNT value on done: 355017.0 [2024-08-06 02:56:15,597][52663] Sum rewards: 72.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.244', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.442', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '63.000'} [2024-08-06 02:56:16,082][52667] DAMAGECOUNT value on done: 359577.0 [2024-08-06 02:56:16,082][52667] Sum rewards: 74.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.034', 'AMMO4': '0.127', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '61.000'} [2024-08-06 02:56:17,242][52665] DAMAGECOUNT value on done: 348810.0 [2024-08-06 02:56:17,252][52665] Sum rewards: 80.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.188', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.454', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '67.000'} [2024-08-06 02:56:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 343392256. Throughput: 0: 4382.2. Samples: 85846930. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:56:17,794][52567] Avg episode reward: [(0, '68.292')] [2024-08-06 02:56:18,010][52820] DAMAGECOUNT value on done: 333272.0 [2024-08-06 02:56:18,010][52820] Sum rewards: 70.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.060', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO4': '0.206', 'AMMO3': '0.266', 'weapon4': '0.282', 'weapon2': '0.284', 'WEAPON5': '0.400', 'ARMOR': '0.461', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.988', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '60.000'} [2024-08-06 02:56:18,520][52663] DAMAGECOUNT value on done: 349676.0 [2024-08-06 02:56:18,522][52663] Sum rewards: 74.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.169', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.108', 'AMMO4': '0.145', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.296', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '61.000'} [2024-08-06 02:56:19,031][52667] DAMAGECOUNT value on done: 360378.0 [2024-08-06 02:56:19,031][52667] Sum rewards: 78.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.998', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.064', 'weapon4': '0.068', 'AMMO4': '0.142', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '66.000'} [2024-08-06 02:56:19,304][52650] Updated weights for policy 0, policy_version 41921 (0.0019) [2024-08-06 02:56:20,450][52665] DAMAGECOUNT value on done: 356846.0 [2024-08-06 02:56:20,450][52665] Sum rewards: 64.358, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.170', 'AMMO3': '0.176', 'weapon5': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.450', 'HEALTH': '0.678', 'WEAPON3': '0.950', 'weapon3': '2.924', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '50.000'} [2024-08-06 02:56:21,088][52820] DAMAGECOUNT value on done: 328458.0 [2024-08-06 02:56:21,091][52820] Sum rewards: 68.452, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.074', 'weapon5': '0.096', 'AMMO4': '0.133', 'weapon2': '0.242', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.260', 'weapon3': '3.310', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '60.000'} [2024-08-06 02:56:21,682][52662] DAMAGECOUNT value on done: 365093.0 [2024-08-06 02:56:21,683][52662] Sum rewards: 69.948, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.057', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'weapon4': '0.100', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.800', 'weapon3': '3.170', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '63.000'} [2024-08-06 02:56:22,182][52667] DAMAGECOUNT value on done: 355938.0 [2024-08-06 02:56:22,184][52667] Sum rewards: 61.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.428', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.142', 'AMMO4': '0.146', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '53.500'} [2024-08-06 02:56:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 343474176. Throughput: 0: 4389.6. Samples: 85873470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:56:22,794][52567] Avg episode reward: [(0, '68.641')] [2024-08-06 02:56:23,472][52650] Updated weights for policy 0, policy_version 41931 (0.0012) [2024-08-06 02:56:23,538][52665] DAMAGECOUNT value on done: 354588.0 [2024-08-06 02:56:23,539][52665] Sum rewards: 70.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.974', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.274', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:24,168][52820] DAMAGECOUNT value on done: 328737.0 [2024-08-06 02:56:24,170][52820] Sum rewards: 74.043, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.106', 'weapon4': '0.122', 'AMMO4': '0.168', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '62.000'} [2024-08-06 02:56:24,728][52662] DAMAGECOUNT value on done: 360366.0 [2024-08-06 02:56:24,730][52662] Sum rewards: 60.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.303', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon4': '0.328', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '52.000'} [2024-08-06 02:56:25,206][52667] DAMAGECOUNT value on done: 355565.0 [2024-08-06 02:56:25,206][52667] Sum rewards: 64.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '54.000'} [2024-08-06 02:56:26,514][52665] DAMAGECOUNT value on done: 348821.0 [2024-08-06 02:56:26,516][52665] Sum rewards: 61.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.728', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.159', 'AMMO3': '0.204', 'weapon4': '0.254', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.060', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '53.000'} [2024-08-06 02:56:26,750][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:56:27,176][52820] DAMAGECOUNT value on done: 335971.0 [2024-08-06 02:56:27,177][52820] Sum rewards: 66.232, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.083', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '57.000'} [2024-08-06 02:56:27,631][52662] DAMAGECOUNT value on done: 360516.0 [2024-08-06 02:56:27,632][52662] Sum rewards: 71.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.102', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO4': '0.225', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '61.000'} [2024-08-06 02:56:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 343564288. Throughput: 0: 4389.3. Samples: 85899870. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:56:27,795][52567] Avg episode reward: [(0, '68.414')] [2024-08-06 02:56:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041939_343564288.pth... [2024-08-06 02:56:27,909][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041427_339369984.pth [2024-08-06 02:56:28,133][52667] DAMAGECOUNT value on done: 363136.0 [2024-08-06 02:56:28,133][52667] Sum rewards: 71.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.671', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.158', 'AMMO4': '0.159', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '61.000'} [2024-08-06 02:56:28,543][52650] Updated weights for policy 0, policy_version 41941 (0.0014) [2024-08-06 02:56:29,537][52665] DAMAGECOUNT value on done: 344464.0 [2024-08-06 02:56:29,538][52665] Sum rewards: 60.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.115', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.177', 'weapon2': '0.374', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.266', 'DAMAGECOUNT': '13.752', 'FRAGCOUNT': '51.000'} [2024-08-06 02:56:30,330][52820] DAMAGECOUNT value on done: 338058.0 [2024-08-06 02:56:30,331][52820] Sum rewards: 77.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.463', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.215', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '64.000'} [2024-08-06 02:56:30,547][52662] DAMAGECOUNT value on done: 349212.0 [2024-08-06 02:56:30,549][52662] Sum rewards: 56.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.120', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO4': '0.221', 'AMMO3': '0.239', 'weapon5': '0.260', 'weapon4': '0.296', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.720', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '49.000'} [2024-08-06 02:56:31,214][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:56:31,216][52667] DAMAGECOUNT value on done: 353594.0 [2024-08-06 02:56:31,217][52667] Sum rewards: 52.511, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon7': '0.094', 'weapon5': '0.106', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'AMMO4': '0.161', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON4': '0.450', 'weapon4': '0.754', 'WEAPON3': '0.900', 'weapon3': '2.468', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '43.000'} [2024-08-06 02:56:32,352][52665] DAMAGECOUNT value on done: 345960.0 [2024-08-06 02:56:32,352][52665] Sum rewards: 74.334, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.433', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.214', 'weapon4': '0.234', 'AMMO3': '0.251', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.600', 'weapon3': '2.662', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '63.000'} [2024-08-06 02:56:32,449][52668] DAMAGECOUNT value on done: 352614.0 [2024-08-06 02:56:32,450][52668] Sum rewards: 67.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.118', 'AMMO4': '0.119', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 343654400. Throughput: 0: 4390.7. Samples: 85912730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:56:32,794][52567] Avg episode reward: [(0, '68.468')] [2024-08-06 02:56:33,288][52650] Updated weights for policy 0, policy_version 41951 (0.0013) [2024-08-06 02:56:33,333][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:56:33,509][52820] DAMAGECOUNT value on done: 328280.0 [2024-08-06 02:56:33,509][52820] Sum rewards: 63.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:33,691][52662] DAMAGECOUNT value on done: 360581.0 [2024-08-06 02:56:33,691][52662] Sum rewards: 61.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.007', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.101', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.229', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.370', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '52.000'} [2024-08-06 02:56:34,018][52667] DAMAGECOUNT value on done: 358149.0 [2024-08-06 02:56:34,018][52667] Sum rewards: 63.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.736', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.065', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.248', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '53.500'} [2024-08-06 02:56:34,754][52668] DAMAGECOUNT value on done: 357891.0 [2024-08-06 02:56:34,755][52668] Sum rewards: 68.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.460', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.166', 'AMMO3': '0.213', 'AMMO4': '0.241', 'weapon4': '0.298', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:35,314][52665] DAMAGECOUNT value on done: 352998.0 [2024-08-06 02:56:35,314][52665] Sum rewards: 66.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.234', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.082', 'weapon4': '0.086', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.256', 'WEAPON3': '1.600', 'weapon3': '3.368', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '57.000'} [2024-08-06 02:56:36,950][52662] DAMAGECOUNT value on done: 353550.0 [2024-08-06 02:56:36,952][52662] Sum rewards: 62.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.046', 'weapon4': '0.204', 'AMMO3': '0.209', 'weapon5': '0.210', 'weapon2': '0.214', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '52.000'} [2024-08-06 02:56:36,951][52667] DAMAGECOUNT value on done: 357488.0 [2024-08-06 02:56:36,956][52667] Sum rewards: 65.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.519', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:37,664][52668] DAMAGECOUNT value on done: 359180.0 [2024-08-06 02:56:37,665][52668] Sum rewards: 75.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'AMMO5': '0.021', 'AMMO2': '0.044', 'AMMO3': '0.197', 'weapon5': '0.198', 'AMMO4': '0.219', 'weapon4': '0.284', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.000'} [2024-08-06 02:56:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 343744512. Throughput: 0: 4382.0. Samples: 85938780. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:56:37,794][52567] Avg episode reward: [(0, '68.128')] [2024-08-06 02:56:37,798][52650] Updated weights for policy 0, policy_version 41961 (0.0025) [2024-08-06 02:56:38,253][52665] DAMAGECOUNT value on done: 356210.0 [2024-08-06 02:56:38,254][52665] Sum rewards: 75.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.598', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.117', 'weapon4': '0.154', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '63.000'} [2024-08-06 02:56:39,884][52667] DAMAGECOUNT value on done: 352823.0 [2024-08-06 02:56:39,885][52667] Sum rewards: 66.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.661', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.177', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.014', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:40,095][52649] DAMAGECOUNT value on done: 348531.0 [2024-08-06 02:56:40,095][52649] Sum rewards: 62.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.907', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.164', 'AMMO4': '0.174', 'weapon2': '0.230', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.310', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '53.000'} [2024-08-06 02:56:40,237][52662] DAMAGECOUNT value on done: 362677.0 [2024-08-06 02:56:40,239][52662] Sum rewards: 65.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.879', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.193', 'weapon2': '0.198', 'AMMO3': '0.199', 'weapon5': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '54.000'} [2024-08-06 02:56:40,796][52668] DAMAGECOUNT value on done: 360788.0 [2024-08-06 02:56:40,796][52668] Sum rewards: 69.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO3': '0.202', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.358', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '2.802', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '57.000'} [2024-08-06 02:56:40,839][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:56:41,184][52665] DAMAGECOUNT value on done: 354925.0 [2024-08-06 02:56:41,186][52665] Sum rewards: 78.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '63.000'} [2024-08-06 02:56:42,126][52669] DAMAGECOUNT value on done: 359775.0 [2024-08-06 02:56:42,126][52669] Sum rewards: 69.058, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.154', 'AMMO4': '0.177', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:42,653][52650] Updated weights for policy 0, policy_version 41971 (0.0011) [2024-08-06 02:56:42,700][52667] DAMAGECOUNT value on done: 359588.0 [2024-08-06 02:56:42,702][52667] Sum rewards: 70.139, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.495', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '3.174', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 343826432. Throughput: 0: 4388.3. Samples: 85965260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 02:56:42,794][52567] Avg episode reward: [(0, '68.242')] [2024-08-06 02:56:42,810][52662] DAMAGECOUNT value on done: 365906.0 [2024-08-06 02:56:42,811][52662] Sum rewards: 66.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO3': '0.208', 'AMMO4': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '2.964', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:43,271][52649] DAMAGECOUNT value on done: 341148.0 [2024-08-06 02:56:43,271][52649] Sum rewards: 68.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.659', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.060', 'weapon5': '0.088', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.358', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:43,699][52668] DAMAGECOUNT value on done: 352479.0 [2024-08-06 02:56:43,707][52668] Sum rewards: 82.149, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.761', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.356', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '71.000'} [2024-08-06 02:56:44,447][52665] DAMAGECOUNT value on done: 352111.0 [2024-08-06 02:56:44,447][52665] Sum rewards: 69.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.227', 'weapon5': '0.228', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:45,023][52669] DAMAGECOUNT value on done: 351175.0 [2024-08-06 02:56:45,025][52669] Sum rewards: 59.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.900', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.173', 'weapon2': '0.712', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.214', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '48.000'} [2024-08-06 02:56:45,153][52667] DAMAGECOUNT value on done: 365484.0 [2024-08-06 02:56:45,155][52667] Sum rewards: 81.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.152', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '69.000'} [2024-08-06 02:56:45,571][52662] DAMAGECOUNT value on done: 357295.0 [2024-08-06 02:56:45,571][52662] Sum rewards: 79.543, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.494', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.120', 'weapon5': '0.168', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '64.000'} [2024-08-06 02:56:46,084][52668] DAMAGECOUNT value on done: 359727.0 [2024-08-06 02:56:46,085][52668] Sum rewards: 65.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.127', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.308', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '54.000'} [2024-08-06 02:56:46,432][52649] DAMAGECOUNT value on done: 347578.0 [2024-08-06 02:56:46,433][52649] Sum rewards: 66.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.548', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.183', 'weapon4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.116', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:46,918][52650] Updated weights for policy 0, policy_version 41981 (0.0029) [2024-08-06 02:56:47,570][52665] DAMAGECOUNT value on done: 358785.0 [2024-08-06 02:56:47,571][52665] Sum rewards: 68.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.128', 'weapon5': '0.136', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.246', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '59.000'} [2024-08-06 02:56:47,657][52669] DAMAGECOUNT value on done: 359795.0 [2024-08-06 02:56:47,660][52669] Sum rewards: 85.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.088', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'weapon2': '0.174', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.396', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '71.000'} [2024-08-06 02:56:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 343916544. Throughput: 0: 4392.0. Samples: 85978430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:56:47,794][52567] Avg episode reward: [(0, '68.820')] [2024-08-06 02:56:48,114][52667] DAMAGECOUNT value on done: 364574.0 [2024-08-06 02:56:48,114][52667] Sum rewards: 79.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'weapon2': '0.198', 'AMMO3': '0.210', 'WEAPON3': '1.300', 'weapon3': '3.676', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '66.000'} [2024-08-06 02:56:48,596][52662] DAMAGECOUNT value on done: 369461.0 [2024-08-06 02:56:48,596][52662] Sum rewards: 68.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.223', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:49,070][52668] DAMAGECOUNT value on done: 358275.0 [2024-08-06 02:56:49,070][52668] Sum rewards: 66.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.251', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.110', 'weapon5': '0.164', 'AMMO4': '0.217', 'weapon2': '0.222', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.190', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:49,674][52649] DAMAGECOUNT value on done: 345220.0 [2024-08-06 02:56:49,675][52649] Sum rewards: 67.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.276', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:50,290][52669] DAMAGECOUNT value on done: 354777.0 [2024-08-06 02:56:50,291][52669] Sum rewards: 75.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.873', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.173', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.446', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 02:56:50,700][52665] DAMAGECOUNT value on done: 353241.0 [2024-08-06 02:56:50,703][52665] Sum rewards: 62.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.142', 'AMMO3': '0.168', 'weapon2': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '3.120', 'weapon3': '3.182', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '52.000'} [2024-08-06 02:56:50,949][52667] DAMAGECOUNT value on done: 363712.0 [2024-08-06 02:56:50,949][52667] Sum rewards: 77.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.557', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.136', 'weapon5': '0.144', 'AMMO3': '0.182', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '63.000'} [2024-08-06 02:56:50,969][52660] DAMAGECOUNT value on done: 353105.0 [2024-08-06 02:56:50,970][52660] Sum rewards: 70.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.262', 'WEAPON3': '1.350', 'HITCOUNT': '3.440', 'weapon3': '3.482', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '60.000'} [2024-08-06 02:56:51,396][52662] DAMAGECOUNT value on done: 354561.0 [2024-08-06 02:56:51,399][52662] Sum rewards: 67.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.100', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.300', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '57.000'} [2024-08-06 02:56:51,858][52650] Updated weights for policy 0, policy_version 41991 (0.0021) [2024-08-06 02:56:52,168][52668] DAMAGECOUNT value on done: 352009.0 [2024-08-06 02:56:52,168][52668] Sum rewards: 67.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.052', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '56.000'} [2024-08-06 02:56:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 343998464. Throughput: 0: 4393.5. Samples: 86004850. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:56:52,795][52567] Avg episode reward: [(0, '68.933')] [2024-08-06 02:56:52,804][52649] DAMAGECOUNT value on done: 338921.0 [2024-08-06 02:56:52,809][52649] Sum rewards: 69.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.179', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.164', 'weapon4': '0.194', 'AMMO3': '0.214', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2024-08-06 02:56:53,367][52669] DAMAGECOUNT value on done: 355713.0 [2024-08-06 02:56:53,369][52669] Sum rewards: 80.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.954', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.136', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '64.000'} [2024-08-06 02:56:53,760][52665] DAMAGECOUNT value on done: 350677.0 [2024-08-06 02:56:53,760][52665] Sum rewards: 58.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.043', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.174', 'weapon2': '0.206', 'AMMO3': '0.230', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.074', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '51.000'} [2024-08-06 02:56:53,984][52662] DAMAGECOUNT value on done: 357600.0 [2024-08-06 02:56:53,985][52662] Sum rewards: 82.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.853', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.162', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.348', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '67.000'} [2024-08-06 02:56:54,013][52660] DAMAGECOUNT value on done: 350312.0 [2024-08-06 02:56:54,016][52660] Sum rewards: 76.700, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.131', 'weapon5': '0.134', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.340', 'HEALTH': '0.390', 'WEAPON3': '1.000', 'weapon3': '3.066', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '61.000'} [2024-08-06 02:56:54,138][52667] DAMAGECOUNT value on done: 355502.0 [2024-08-06 02:56:54,139][52667] Sum rewards: 56.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.198', 'AMMO5': '0.010', 'ARMOR': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.090', 'AMMO3': '0.162', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.024', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '46.000'} [2024-08-06 02:56:54,390][52658] DAMAGECOUNT value on done: 355416.0 [2024-08-06 02:56:54,390][52658] Sum rewards: 70.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.408', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO4': '0.169', 'AMMO3': '0.210', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '59.000'} [2024-08-06 02:56:55,238][52668] DAMAGECOUNT value on done: 355093.0 [2024-08-06 02:56:55,238][52668] Sum rewards: 67.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.188', 'weapon5': '0.266', 'AMMO4': '0.301', 'weapon2': '0.328', 'WEAPON5': '0.400', 'weapon4': '0.534', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.384', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '54.500'} [2024-08-06 02:56:55,976][52649] DAMAGECOUNT value on done: 349844.0 [2024-08-06 02:56:55,976][52649] Sum rewards: 70.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:56,056][52669] DAMAGECOUNT value on done: 355906.0 [2024-08-06 02:56:56,058][52669] Sum rewards: 78.369, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '67.000'} [2024-08-06 02:56:56,409][52650] Updated weights for policy 0, policy_version 42001 (0.0025) [2024-08-06 02:56:56,685][52662] DAMAGECOUNT value on done: 360411.0 [2024-08-06 02:56:56,687][52662] Sum rewards: 68.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.138', 'weapon5': '0.184', 'AMMO3': '0.194', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 02:56:56,835][52665] DAMAGECOUNT value on done: 351000.0 [2024-08-06 02:56:56,835][52665] Sum rewards: 57.132, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'ARMOR': '0.012', 'AMMO5': '0.013', 'weapon4': '0.030', 'AMMO2': '0.035', 'weapon5': '0.078', 'AMMO4': '0.176', 'AMMO3': '0.247', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.284', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '51.000'} [2024-08-06 02:56:56,973][52667] DAMAGECOUNT value on done: 362932.0 [2024-08-06 02:56:56,975][52667] Sum rewards: 86.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.144', 'weapon5': '0.192', 'weapon2': '0.196', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.438', 'FRAGCOUNT': '71.000'} [2024-08-06 02:56:57,088][52660] DAMAGECOUNT value on done: 361367.0 [2024-08-06 02:56:57,088][52660] Sum rewards: 78.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.242', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO4': '0.197', 'weapon5': '0.208', 'AMMO3': '0.231', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '64.000'} [2024-08-06 02:56:57,093][52658] DAMAGECOUNT value on done: 355645.0 [2024-08-06 02:56:57,094][52658] Sum rewards: 57.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.792', 'AMMO5': '0.025', 'AMMO2': '0.059', 'weapon2': '0.230', 'AMMO3': '0.236', 'AMMO4': '0.293', 'weapon4': '0.308', 'weapon5': '0.420', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.554', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '48.000'} [2024-08-06 02:56:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.6, 300 sec: 17550.3). Total num frames: 344096768. Throughput: 0: 4379.1. Samples: 86030830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:56:57,794][52567] Avg episode reward: [(0, '68.936')] [2024-08-06 02:56:58,164][52668] DAMAGECOUNT value on done: 357748.0 [2024-08-06 02:56:58,164][52668] Sum rewards: 63.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.988', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO4': '0.224', 'weapon5': '0.236', 'AMMO3': '0.255', 'weapon4': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.798', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:58,811][52669] DAMAGECOUNT value on done: 358074.0 [2024-08-06 02:56:58,812][52669] Sum rewards: 68.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.758', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.189', 'weapon5': '0.192', 'AMMO4': '0.264', 'weapon2': '0.322', 'WEAPON5': '0.450', 'weapon4': '0.572', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '58.000'} [2024-08-06 02:56:59,102][52649] DAMAGECOUNT value on done: 344700.0 [2024-08-06 02:56:59,102][52649] Sum rewards: 68.121, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.570', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.110', 'weapon5': '0.162', 'AMMO4': '0.172', 'weapon2': '0.216', 'AMMO3': '0.289', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.200', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '60.000'} [2024-08-06 02:56:59,596][52662] DAMAGECOUNT value on done: 365264.0 [2024-08-06 02:56:59,597][52662] Sum rewards: 69.791, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.154', 'AMMO3': '0.160', 'weapon4': '0.196', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.200', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '55.000'} [2024-08-06 02:56:59,937][52665] DAMAGECOUNT value on done: 353882.0 [2024-08-06 02:56:59,939][52665] Sum rewards: 73.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.682', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:00,076][52658] DAMAGECOUNT value on done: 361941.0 [2024-08-06 02:57:00,078][52658] Sum rewards: 63.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.318', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.148', 'AMMO4': '0.156', 'weapon5': '0.196', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.140', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '54.000'} [2024-08-06 02:57:00,106][52660] DAMAGECOUNT value on done: 361260.0 [2024-08-06 02:57:00,106][52660] Sum rewards: 68.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.927', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.346', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:01,249][52668] DAMAGECOUNT value on done: 357676.0 [2024-08-06 02:57:01,250][52668] Sum rewards: 57.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.156', 'AMMO3': '0.211', 'AMMO4': '0.221', 'weapon2': '0.292', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '50.000'} [2024-08-06 02:57:01,252][52650] Updated weights for policy 0, policy_version 42011 (0.0032) [2024-08-06 02:57:01,536][52794] DAMAGECOUNT value on done: 359554.0 [2024-08-06 02:57:01,540][52794] Sum rewards: 67.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.500', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.184', 'weapon5': '0.186', 'AMMO4': '0.244', 'AMMO3': '0.264', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.050', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:01,617][52669] DAMAGECOUNT value on done: 357675.0 [2024-08-06 02:57:01,617][52669] Sum rewards: 66.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.062', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:02,212][52649] DAMAGECOUNT value on done: 351634.0 [2024-08-06 02:57:02,215][52649] Sum rewards: 66.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.561', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.184', 'AMMO4': '0.211', 'weapon5': '0.222', 'AMMO3': '0.227', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 02:57:02,573][52662] DAMAGECOUNT value on done: 356679.0 [2024-08-06 02:57:02,577][52662] Sum rewards: 71.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.672', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon2': '0.172', 'AMMO3': '0.173', 'AMMO4': '0.276', 'weapon4': '0.294', 'weapon5': '0.322', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.802', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 344178688. Throughput: 0: 4380.9. Samples: 86044070. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:57:02,794][52567] Avg episode reward: [(0, '68.849')] [2024-08-06 02:57:02,987][52658] DAMAGECOUNT value on done: 359833.0 [2024-08-06 02:57:02,988][52658] Sum rewards: 76.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.092', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '62.000'} [2024-08-06 02:57:02,993][52665] DAMAGECOUNT value on done: 349961.0 [2024-08-06 02:57:02,993][52665] Sum rewards: 63.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.130', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.250', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '55.000'} [2024-08-06 02:57:03,098][52660] DAMAGECOUNT value on done: 355243.0 [2024-08-06 02:57:03,100][52660] Sum rewards: 47.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.197', 'AMMO4': '0.220', 'weapon4': '0.340', 'weapon2': '0.360', 'weapon5': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.460', 'weapon3': '2.606', 'DAMAGECOUNT': '11.904', 'FRAGCOUNT': '40.000'} [2024-08-06 02:57:03,949][52668] DAMAGECOUNT value on done: 353132.0 [2024-08-06 02:57:03,951][52668] Sum rewards: 57.614, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.072', 'AMMO5': '0.014', 'AMMO2': '0.065', 'weapon5': '0.170', 'AMMO3': '0.242', 'weapon4': '0.256', 'AMMO4': '0.326', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.804', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '50.500'} [2024-08-06 02:57:04,764][52669] DAMAGECOUNT value on done: 359710.0 [2024-08-06 02:57:04,765][52669] Sum rewards: 79.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.791', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '65.000'} [2024-08-06 02:57:04,840][52794] DAMAGECOUNT value on done: 362799.0 [2024-08-06 02:57:04,841][52794] Sum rewards: 75.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.145', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.062', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.346', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:05,361][52649] DAMAGECOUNT value on done: 349658.0 [2024-08-06 02:57:05,361][52649] Sum rewards: 63.836, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.675', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.152', 'weapon5': '0.214', 'AMMO4': '0.227', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.650', 'weapon3': '2.838', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:05,842][52662] DAMAGECOUNT value on done: 367849.0 [2024-08-06 02:57:05,844][52662] Sum rewards: 58.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.175', 'AMMO5': '0.028', 'AMMO2': '0.084', 'AMMO3': '0.303', 'weapon2': '0.356', 'weapon5': '0.372', 'weapon4': '0.404', 'AMMO4': '0.418', 'WEAPON5': '0.750', 'WEAPON4': '0.950', 'WEAPON3': '1.700', 'weapon3': '2.402', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '51.000'} [2024-08-06 02:57:05,883][52660] DAMAGECOUNT value on done: 351918.0 [2024-08-06 02:57:05,884][52660] Sum rewards: 64.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.177', 'weapon5': '0.228', 'AMMO4': '0.250', 'weapon4': '0.386', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.664', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:05,900][52658] DAMAGECOUNT value on done: 354272.0 [2024-08-06 02:57:05,901][52658] Sum rewards: 65.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.874', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.060', 'weapon5': '0.088', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.272', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '55.000'} [2024-08-06 02:57:05,998][52650] Updated weights for policy 0, policy_version 42021 (0.0012) [2024-08-06 02:57:06,174][52665] DAMAGECOUNT value on done: 347801.0 [2024-08-06 02:57:06,175][52665] Sum rewards: 60.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO5': '0.021', 'AMMO2': '0.067', 'weapon4': '0.154', 'weapon5': '0.180', 'weapon2': '0.210', 'AMMO3': '0.230', 'AMMO4': '0.336', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '3.164', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:07,137][52668] DAMAGECOUNT value on done: 348842.0 [2024-08-06 02:57:07,140][52668] Sum rewards: 65.039, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.064', 'AMMO4': '0.137', 'weapon4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:07,311][52669] DAMAGECOUNT value on done: 356763.0 [2024-08-06 02:57:07,313][52669] Sum rewards: 67.436, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon4': '0.338', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:07,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 344260608. Throughput: 0: 4374.0. Samples: 86070300. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:57:07,795][52567] Avg episode reward: [(0, '68.611')] [2024-08-06 02:57:08,070][52794] DAMAGECOUNT value on done: 359446.0 [2024-08-06 02:57:08,072][52794] Sum rewards: 77.890, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.129', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.174', 'AMMO3': '0.222', 'weapon4': '0.260', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '66.000'} [2024-08-06 02:57:08,474][52649] DAMAGECOUNT value on done: 347307.0 [2024-08-06 02:57:08,476][52649] Sum rewards: 75.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.179', 'weapon4': '0.238', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:08,804][52658] DAMAGECOUNT value on done: 356418.0 [2024-08-06 02:57:08,806][52658] Sum rewards: 68.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.748', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.088', 'AMMO3': '0.170', 'AMMO4': '0.270', 'weapon5': '0.312', 'WEAPON4': '0.500', 'weapon2': '0.592', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.734', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '55.000'} [2024-08-06 02:57:08,857][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:57:08,983][52660] DAMAGECOUNT value on done: 357285.0 [2024-08-06 02:57:08,983][52660] Sum rewards: 77.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.718', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon5': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.201', 'weapon2': '0.216', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '63.000'} [2024-08-06 02:57:09,021][52662] DAMAGECOUNT value on done: 361593.0 [2024-08-06 02:57:09,021][52662] Sum rewards: 71.639, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.866', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.096', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.256', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.234', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '63.000'} [2024-08-06 02:57:09,346][52665] DAMAGECOUNT value on done: 348012.0 [2024-08-06 02:57:09,348][52665] Sum rewards: 63.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.722', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.258', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.522', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '54.000'} [2024-08-06 02:57:09,653][52667] Large shaping reward 2.586 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon5', 0.002)] [2024-08-06 02:57:09,761][52668] DAMAGECOUNT value on done: 349148.0 [2024-08-06 02:57:09,762][52668] Sum rewards: 71.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.055', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.177', 'weapon5': '0.182', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:10,384][52669] DAMAGECOUNT value on done: 362390.0 [2024-08-06 02:57:10,392][52669] Sum rewards: 67.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.555', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.196', 'AMMO3': '0.217', 'AMMO4': '0.280', 'weapon2': '0.296', 'weapon4': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:10,557][52794] DAMAGECOUNT value on done: 356963.0 [2024-08-06 02:57:10,557][52794] Sum rewards: 62.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.965', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.216', 'weapon4': '0.250', 'AMMO3': '0.278', 'weapon2': '0.288', 'AMMO4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.924', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '55.000'} [2024-08-06 02:57:10,691][52650] Updated weights for policy 0, policy_version 42031 (0.0012) [2024-08-06 02:57:11,281][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:57:11,423][52662] DAMAGECOUNT value on done: 359901.0 [2024-08-06 02:57:11,425][52662] Sum rewards: 77.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.265', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.048', 'AMMO4': '0.140', 'weapon5': '0.160', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '65.000'} [2024-08-06 02:57:11,470][52660] DAMAGECOUNT value on done: 364975.0 [2024-08-06 02:57:11,473][52660] Sum rewards: 71.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.920', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.084', 'AMMO4': '0.143', 'weapon5': '0.156', 'AMMO3': '0.241', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:11,686][52649] DAMAGECOUNT value on done: 351013.0 [2024-08-06 02:57:11,686][52649] Sum rewards: 63.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO3': '0.144', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.448', 'weapon2': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.746', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2024-08-06 02:57:11,972][52658] DAMAGECOUNT value on done: 359350.0 [2024-08-06 02:57:11,972][52658] Sum rewards: 51.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.172', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.216', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.148', 'DAMAGECOUNT': '13.320', 'FRAGCOUNT': '46.000'} [2024-08-06 02:57:12,300][52665] DAMAGECOUNT value on done: 352740.0 [2024-08-06 02:57:12,300][52665] Sum rewards: 68.869, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'AMMO4': '0.026', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.208', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'HITCOUNT': '3.370', 'weapon3': '3.502', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:12,692][52668] DAMAGECOUNT value on done: 349417.0 [2024-08-06 02:57:12,694][52668] Sum rewards: 69.251, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.325', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.092', 'weapon4': '0.210', 'weapon2': '0.234', 'AMMO4': '0.245', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '60.000'} [2024-08-06 02:57:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 344350720. Throughput: 0: 4375.8. Samples: 86096780. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:57:12,795][52567] Avg episode reward: [(0, '68.610')] [2024-08-06 02:57:13,088][52669] DAMAGECOUNT value on done: 356487.0 [2024-08-06 02:57:13,088][52669] Sum rewards: 64.669, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.672', 'weapon4': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.602', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.156', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '51.000'} [2024-08-06 02:57:13,461][52794] DAMAGECOUNT value on done: 354284.0 [2024-08-06 02:57:13,461][52794] Sum rewards: 65.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.149', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '54.000'} [2024-08-06 02:57:14,215][52671] DAMAGECOUNT value on done: 362190.0 [2024-08-06 02:57:14,216][52671] Sum rewards: 70.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.182', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.042', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.221', 'weapon2': '0.646', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:14,505][52662] DAMAGECOUNT value on done: 355533.0 [2024-08-06 02:57:14,506][52662] Sum rewards: 72.068, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.036', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.092', 'AMMO3': '0.158', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon5': '0.214', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.168', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:14,651][52660] DAMAGECOUNT value on done: 360363.0 [2024-08-06 02:57:14,652][52660] Sum rewards: 69.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.568', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:14,694][52649] DAMAGECOUNT value on done: 352873.0 [2024-08-06 02:57:14,694][52649] Sum rewards: 75.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.595', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon5': '0.020', 'weapon4': '0.040', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '3.286', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '60.500'} [2024-08-06 02:57:15,168][52650] Updated weights for policy 0, policy_version 42041 (0.0015) [2024-08-06 02:57:15,184][52658] DAMAGECOUNT value on done: 351213.0 [2024-08-06 02:57:15,185][52658] Sum rewards: 71.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.912', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.078', 'weapon5': '0.132', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.276', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.274', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '60.000'} [2024-08-06 02:57:15,252][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:57:15,383][52665] DAMAGECOUNT value on done: 353707.0 [2024-08-06 02:57:15,383][52665] Sum rewards: 54.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.724', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.252', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2024-08-06 02:57:15,542][52669] DAMAGECOUNT value on done: 353984.0 [2024-08-06 02:57:15,550][52669] Sum rewards: 67.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.637', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon5': '0.202', 'AMMO3': '0.220', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.636', 'WEAPON3': '1.350', 'weapon3': '2.664', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:16,000][52668] DAMAGECOUNT value on done: 353861.0 [2024-08-06 02:57:16,001][52668] Sum rewards: 61.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.318', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.233', 'weapon5': '0.244', 'AMMO4': '0.281', 'WEAPON5': '0.400', 'weapon2': '0.468', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.306', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '52.000'} [2024-08-06 02:57:16,533][52794] DAMAGECOUNT value on done: 359697.0 [2024-08-06 02:57:16,534][52794] Sum rewards: 71.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.492', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '60.000'} [2024-08-06 02:57:16,749][52671] DAMAGECOUNT value on done: 358949.0 [2024-08-06 02:57:16,751][52671] Sum rewards: 83.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.897', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.142', 'weapon5': '0.156', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '69.000'} [2024-08-06 02:57:17,507][52662] DAMAGECOUNT value on done: 354038.0 [2024-08-06 02:57:17,507][52662] Sum rewards: 80.383, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.693', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.079', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'weapon3': '3.408', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.861', 'FRAGCOUNT': '66.000'} [2024-08-06 02:57:17,609][52664] DAMAGECOUNT value on done: 369398.0 [2024-08-06 02:57:17,610][52664] Sum rewards: 76.429, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.068', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon4': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '63.000'} [2024-08-06 02:57:17,623][52660] DAMAGECOUNT value on done: 356101.0 [2024-08-06 02:57:17,623][52660] Sum rewards: 70.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.064', 'weapon5': '0.082', 'AMMO4': '0.112', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '59.500'} [2024-08-06 02:57:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 344440832. Throughput: 0: 4386.2. Samples: 86110110. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:57:17,794][52567] Avg episode reward: [(0, '69.330')] [2024-08-06 02:57:17,880][52658] DAMAGECOUNT value on done: 365737.0 [2024-08-06 02:57:17,881][52658] Sum rewards: 57.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.136', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.130', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '50.000'} [2024-08-06 02:57:17,895][52649] DAMAGECOUNT value on done: 353443.0 [2024-08-06 02:57:17,895][52649] Sum rewards: 68.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:18,574][52669] DAMAGECOUNT value on done: 359713.0 [2024-08-06 02:57:18,575][52669] Sum rewards: 80.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.616', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '68.000'} [2024-08-06 02:57:18,730][52668] DAMAGECOUNT value on done: 357800.0 [2024-08-06 02:57:18,732][52668] Sum rewards: 76.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.152', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.206', 'AMMO3': '0.238', 'weapon5': '0.286', 'AMMO4': '0.298', 'weapon2': '0.324', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.848', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '64.000'} [2024-08-06 02:57:19,543][52671] DAMAGECOUNT value on done: 357949.0 [2024-08-06 02:57:19,543][52671] Sum rewards: 63.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.693', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.098', 'AMMO3': '0.184', 'AMMO4': '0.276', 'weapon5': '0.288', 'weapon2': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.560', 'weapon3': '3.030', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:19,635][52794] DAMAGECOUNT value on done: 363781.0 [2024-08-06 02:57:19,637][52794] Sum rewards: 81.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.455', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.207', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '67.000'} [2024-08-06 02:57:19,755][52650] Updated weights for policy 0, policy_version 42051 (0.0012) [2024-08-06 02:57:19,885][52664] DAMAGECOUNT value on done: 372479.0 [2024-08-06 02:57:19,885][52664] Sum rewards: 64.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.120', 'weapon5': '0.120', 'AMMO3': '0.131', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '52.000'} [2024-08-06 02:57:20,343][52660] DAMAGECOUNT value on done: 364340.0 [2024-08-06 02:57:20,343][52660] Sum rewards: 63.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.142', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.116', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '54.000'} [2024-08-06 02:57:20,759][52658] DAMAGECOUNT value on done: 358042.0 [2024-08-06 02:57:20,768][52658] Sum rewards: 67.314, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO3': '0.226', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:21,080][52649] DAMAGECOUNT value on done: 352611.0 [2024-08-06 02:57:21,081][52649] Sum rewards: 56.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon7': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.156', 'AMMO3': '0.187', 'WEAPON7': '0.200', 'AMMO4': '0.251', 'weapon2': '0.274', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '2.722', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '49.000'} [2024-08-06 02:57:21,316][52668] DAMAGECOUNT value on done: 358621.0 [2024-08-06 02:57:21,318][52668] Sum rewards: 71.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.260', 'weapon2': '0.294', 'WEAPON3': '1.600', 'HITCOUNT': '3.370', 'weapon3': '3.456', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:21,912][52669] DAMAGECOUNT value on done: 364463.0 [2024-08-06 02:57:21,913][52669] Sum rewards: 72.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.156', 'weapon5': '0.174', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:22,414][52664] DAMAGECOUNT value on done: 374568.0 [2024-08-06 02:57:22,414][52664] Sum rewards: 68.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.189', 'weapon5': '0.218', 'AMMO4': '0.264', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.908', 'WEAPON3': '1.050', 'weapon3': '2.340', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '55.000'} [2024-08-06 02:57:22,579][52671] DAMAGECOUNT value on done: 357931.0 [2024-08-06 02:57:22,580][52671] Sum rewards: 61.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.142', 'AMMO3': '0.209', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '51.000'} [2024-08-06 02:57:22,758][52794] DAMAGECOUNT value on done: 355134.0 [2024-08-06 02:57:22,758][52794] Sum rewards: 57.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.258', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '3.436', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '48.000'} [2024-08-06 02:57:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 344530944. Throughput: 0: 4392.4. Samples: 86136440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:57:22,794][52567] Avg episode reward: [(0, '69.072')] [2024-08-06 02:57:22,985][52660] DAMAGECOUNT value on done: 351646.0 [2024-08-06 02:57:22,985][52660] Sum rewards: 74.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.420', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.160', 'weapon5': '0.178', 'AMMO4': '0.239', 'weapon2': '0.342', 'weapon4': '0.416', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '60.000'} [2024-08-06 02:57:23,528][52658] DAMAGECOUNT value on done: 366960.0 [2024-08-06 02:57:23,528][52658] Sum rewards: 75.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.050', 'weapon3': '3.326', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:23,941][52668] DAMAGECOUNT value on done: 359296.0 [2024-08-06 02:57:23,943][52668] Sum rewards: 81.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.270', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.151', 'weapon2': '0.184', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '67.000'} [2024-08-06 02:57:24,027][52649] DAMAGECOUNT value on done: 342339.0 [2024-08-06 02:57:24,027][52649] Sum rewards: 51.780, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.725', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.127', 'weapon5': '0.230', 'AMMO4': '0.256', 'weapon2': '0.296', 'weapon4': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'HITCOUNT': '2.690', 'weapon3': '2.804', 'DAMAGECOUNT': '12.354', 'FRAGCOUNT': '40.500'} [2024-08-06 02:57:24,359][52795] Large shaping reward 3.630 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 02:57:24,602][52650] Updated weights for policy 0, policy_version 42061 (0.0026) [2024-08-06 02:57:24,817][52669] DAMAGECOUNT value on done: 373346.0 [2024-08-06 02:57:24,819][52669] Sum rewards: 66.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon2': '0.206', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.520', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '56.000'} [2024-08-06 02:57:25,342][52664] DAMAGECOUNT value on done: 369735.0 [2024-08-06 02:57:25,344][52664] Sum rewards: 77.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.185', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.095', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '64.000'} [2024-08-06 02:57:25,512][52794] DAMAGECOUNT value on done: 363640.0 [2024-08-06 02:57:25,513][52794] Sum rewards: 71.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.478', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.146', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.296', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '62.000'} [2024-08-06 02:57:25,528][52660] DAMAGECOUNT value on done: 351685.0 [2024-08-06 02:57:25,528][52660] Sum rewards: 68.893, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.340', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.243', 'AMMO4': '0.269', 'weapon5': '0.280', 'weapon4': '0.308', 'weapon2': '0.320', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.732', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '56.500'} [2024-08-06 02:57:25,625][52671] DAMAGECOUNT value on done: 364479.0 [2024-08-06 02:57:25,626][52671] Sum rewards: 67.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'AMMO5': '0.011', 'weapon4': '0.028', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.190', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '56.000'} [2024-08-06 02:57:26,286][52658] DAMAGECOUNT value on done: 351248.0 [2024-08-06 02:57:26,288][52658] Sum rewards: 50.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon7': '0.046', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.148', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '2.820', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '43.000'} [2024-08-06 02:57:27,029][52649] DAMAGECOUNT value on done: 349857.0 [2024-08-06 02:57:27,030][52649] Sum rewards: 63.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.394', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.114', 'weapon4': '0.140', 'AMMO4': '0.157', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '51.500'} [2024-08-06 02:57:27,047][52668] DAMAGECOUNT value on done: 354898.0 [2024-08-06 02:57:27,047][52668] Sum rewards: 65.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.228', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '51.500'} [2024-08-06 02:57:27,337][52669] DAMAGECOUNT value on done: 359393.0 [2024-08-06 02:57:27,339][52669] Sum rewards: 73.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.542', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.360', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.350', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '60.000'} [2024-08-06 02:57:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 344612864. Throughput: 0: 4391.8. Samples: 86162890. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:57:27,795][52567] Avg episode reward: [(0, '68.379')] [2024-08-06 02:57:28,079][52664] DAMAGECOUNT value on done: 371001.0 [2024-08-06 02:57:28,083][52664] Sum rewards: 77.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.432', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon2': '0.206', 'weapon5': '0.206', 'AMMO3': '0.214', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '64.000'} [2024-08-06 02:57:28,512][52671] DAMAGECOUNT value on done: 355242.0 [2024-08-06 02:57:28,513][52671] Sum rewards: 58.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.600', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.194', 'AMMO3': '0.221', 'weapon5': '0.232', 'AMMO4': '0.235', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.714', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '50.000'} [2024-08-06 02:57:28,612][52660] DAMAGECOUNT value on done: 363809.0 [2024-08-06 02:57:28,612][52660] Sum rewards: 64.923, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.114', 'AMMO4': '0.147', 'AMMO3': '0.148', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.656', 'WEAPON3': '0.850', 'HEALTH': '0.911', 'weapon3': '2.784', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '51.000'} [2024-08-06 02:57:28,850][52794] DAMAGECOUNT value on done: 358954.0 [2024-08-06 02:57:28,852][52794] Sum rewards: 64.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon2': '0.176', 'weapon5': '0.178', 'weapon4': '0.228', 'AMMO4': '0.260', 'AMMO3': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.162', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '56.000'} [2024-08-06 02:57:29,058][52650] Updated weights for policy 0, policy_version 42071 (0.0021) [2024-08-06 02:57:29,177][52658] DAMAGECOUNT value on done: 360266.0 [2024-08-06 02:57:29,177][52658] Sum rewards: 67.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.094', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.608', 'WEAPON3': '1.600', 'weapon3': '2.926', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:29,514][52649] DAMAGECOUNT value on done: 346375.0 [2024-08-06 02:57:29,516][52649] Sum rewards: 67.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.126', 'weapon5': '0.154', 'AMMO3': '0.188', 'AMMO4': '0.227', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.168', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:30,456][52669] DAMAGECOUNT value on done: 361167.0 [2024-08-06 02:57:30,457][52669] Sum rewards: 79.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.848', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.072', 'weapon4': '0.084', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '67.000'} [2024-08-06 02:57:31,256][52660] DAMAGECOUNT value on done: 365694.0 [2024-08-06 02:57:31,258][52660] Sum rewards: 78.977, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.156', 'HEALTH': '0.180', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '65.000'} [2024-08-06 02:57:31,292][52664] DAMAGECOUNT value on done: 370174.0 [2024-08-06 02:57:31,300][52664] Sum rewards: 67.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.565', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.098', 'AMMO4': '0.189', 'weapon5': '0.226', 'AMMO3': '0.234', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.098', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:31,634][52671] DAMAGECOUNT value on done: 362399.0 [2024-08-06 02:57:31,636][52671] Sum rewards: 78.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.588', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '64.000'} [2024-08-06 02:57:31,811][52794] DAMAGECOUNT value on done: 357109.0 [2024-08-06 02:57:31,812][52794] Sum rewards: 84.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.717', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.147', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '68.000'} [2024-08-06 02:57:31,965][52649] DAMAGECOUNT value on done: 351343.0 [2024-08-06 02:57:31,966][52649] Sum rewards: 70.668, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.299', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'weapon4': '0.152', 'weapon5': '0.158', 'AMMO3': '0.192', 'AMMO4': '0.209', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:32,002][52658] DAMAGECOUNT value on done: 355124.0 [2024-08-06 02:57:32,003][52658] Sum rewards: 66.553, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.570', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon5': '0.110', 'AMMO3': '0.278', 'weapon2': '0.306', 'weapon4': '0.330', 'AMMO4': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.936', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '58.500'} [2024-08-06 02:57:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 344711168. Throughput: 0: 4386.4. Samples: 86175820. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 02:57:32,794][52567] Avg episode reward: [(0, '68.480')] [2024-08-06 02:57:33,777][52669] DAMAGECOUNT value on done: 360187.0 [2024-08-06 02:57:33,777][52669] Sum rewards: 70.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.096', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:33,904][52660] DAMAGECOUNT value on done: 354174.0 [2024-08-06 02:57:33,906][52660] Sum rewards: 87.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.132', 'weapon5': '0.162', 'AMMO4': '0.180', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '71.000'} [2024-08-06 02:57:34,085][52650] Updated weights for policy 0, policy_version 42081 (0.0027) [2024-08-06 02:57:34,159][52671] DAMAGECOUNT value on done: 361365.0 [2024-08-06 02:57:34,161][52671] Sum rewards: 65.716, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.154', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.142', 'weapon4': '0.212', 'AMMO4': '0.247', 'AMMO3': '0.257', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.500', 'weapon3': '2.786', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:34,216][52664] DAMAGECOUNT value on done: 371041.0 [2024-08-06 02:57:34,216][52664] Sum rewards: 63.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.020', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon4': '0.166', 'AMMO4': '0.175', 'weapon5': '0.178', 'AMMO3': '0.222', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 02:57:34,687][52794] DAMAGECOUNT value on done: 359710.0 [2024-08-06 02:57:34,688][52794] Sum rewards: 60.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.716', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.104', 'weapon5': '0.170', 'AMMO3': '0.218', 'AMMO4': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.074', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '52.000'} [2024-08-06 02:57:35,141][52658] DAMAGECOUNT value on done: 354216.0 [2024-08-06 02:57:35,142][52658] Sum rewards: 79.350, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon4': '0.294', 'HEALTH': '0.496', 'weapon2': '0.584', 'WEAPON3': '0.850', 'weapon3': '2.988', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '62.000'} [2024-08-06 02:57:35,343][52649] DAMAGECOUNT value on done: 354386.0 [2024-08-06 02:57:35,344][52649] Sum rewards: 73.254, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.026', 'HEALTH': '0.056', 'weapon4': '0.082', 'AMMO4': '0.131', 'weapon5': '0.160', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '3.034', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:35,750][52663] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:57:36,248][52669] DAMAGECOUNT value on done: 364017.0 [2024-08-06 02:57:36,248][52669] Sum rewards: 74.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.021', 'AMMO2': '0.070', 'AMMO3': '0.254', 'weapon4': '0.282', 'weapon2': '0.294', 'weapon5': '0.344', 'AMMO4': '0.349', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.718', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '62.000'} [2024-08-06 02:57:36,758][52660] DAMAGECOUNT value on done: 355639.0 [2024-08-06 02:57:36,759][52660] Sum rewards: 54.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.785', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.088', 'weapon5': '0.130', 'AMMO4': '0.140', 'weapon2': '0.200', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.850', 'HITCOUNT': '2.870', 'weapon3': '3.298', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '51.000'} [2024-08-06 02:57:36,940][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:57:37,227][52671] DAMAGECOUNT value on done: 354515.0 [2024-08-06 02:57:37,230][52671] Sum rewards: 73.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.756', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.076', 'weapon5': '0.098', 'AMMO4': '0.109', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 02:57:37,438][52664] DAMAGECOUNT value on done: 364091.0 [2024-08-06 02:57:37,438][52664] Sum rewards: 80.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.052', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.190', 'weapon2': '0.302', 'WEAPON5': '0.350', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '65.500'} [2024-08-06 02:57:37,695][52794] DAMAGECOUNT value on done: 352476.0 [2024-08-06 02:57:37,696][52794] Sum rewards: 62.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.129', 'AMMO3': '0.199', 'weapon5': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 344793088. Throughput: 0: 4381.8. Samples: 86202030. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:57:37,794][52567] Avg episode reward: [(0, '68.821')] [2024-08-06 02:57:38,223][52658] DAMAGECOUNT value on done: 351585.0 [2024-08-06 02:57:38,223][52658] Sum rewards: 71.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.157', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.137', 'weapon5': '0.162', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.408', 'WEAPON3': '0.900', 'weapon3': '2.804', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:38,352][52649] DAMAGECOUNT value on done: 352311.0 [2024-08-06 02:57:38,353][52649] Sum rewards: 61.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'weapon4': '0.104', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.270', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.320', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:38,571][52650] Updated weights for policy 0, policy_version 42091 (0.0012) [2024-08-06 02:57:39,292][52660] DAMAGECOUNT value on done: 351620.0 [2024-08-06 02:57:39,293][52660] Sum rewards: 83.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.736', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.198', 'weapon5': '0.206', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.644', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '68.000'} [2024-08-06 02:57:39,790][52671] DAMAGECOUNT value on done: 362098.0 [2024-08-06 02:57:39,792][52671] Sum rewards: 73.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.526', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 02:57:39,962][52664] DAMAGECOUNT value on done: 373685.0 [2024-08-06 02:57:39,963][52664] Sum rewards: 70.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.278', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon2': '0.314', 'weapon4': '0.322', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:40,104][52614] Signal inference workers to stop experience collection... (7600 times) [2024-08-06 02:57:40,104][52614] Signal inference workers to resume experience collection... (7600 times) [2024-08-06 02:57:40,145][52650] InferenceWorker_p0-w0: stopping experience collection (7600 times) [2024-08-06 02:57:40,150][52650] InferenceWorker_p0-w0: resuming experience collection (7600 times) [2024-08-06 02:57:40,443][52794] DAMAGECOUNT value on done: 368690.0 [2024-08-06 02:57:40,443][52794] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.272', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:41,345][52658] DAMAGECOUNT value on done: 364210.0 [2024-08-06 02:57:41,347][52658] Sum rewards: 70.741, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO5': '0.025', 'AMMO2': '0.049', 'weapon4': '0.094', 'weapon5': '0.158', 'AMMO3': '0.216', 'AMMO4': '0.246', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:41,641][52660] DAMAGECOUNT value on done: 358245.0 [2024-08-06 02:57:41,641][52660] Sum rewards: 59.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.731', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.202', 'AMMO4': '0.285', 'weapon5': '0.286', 'weapon4': '0.292', 'weapon2': '0.340', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '2.744', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '49.000'} [2024-08-06 02:57:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 344883200. Throughput: 0: 4393.8. Samples: 86228550. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:57:42,794][52567] Avg episode reward: [(0, '69.260')] [2024-08-06 02:57:42,911][52671] DAMAGECOUNT value on done: 365326.0 [2024-08-06 02:57:42,912][52671] Sum rewards: 61.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.306', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.064', 'AMMO4': '0.122', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.344', 'weapon4': '0.356', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '49.000'} [2024-08-06 02:57:43,053][52664] DAMAGECOUNT value on done: 369714.0 [2024-08-06 02:57:43,056][52664] Sum rewards: 79.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'weapon4': '0.128', 'weapon2': '0.204', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.492', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '68.000'} [2024-08-06 02:57:43,081][52650] Updated weights for policy 0, policy_version 42101 (0.0020) [2024-08-06 02:57:43,391][52794] DAMAGECOUNT value on done: 353450.0 [2024-08-06 02:57:43,392][52794] Sum rewards: 61.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.952', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.048', 'weapon4': '0.106', 'AMMO4': '0.128', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:44,091][52658] DAMAGECOUNT value on done: 354113.0 [2024-08-06 02:57:44,091][52658] Sum rewards: 71.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.044', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.130', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '61.000'} [2024-08-06 02:57:44,288][52660] DAMAGECOUNT value on done: 353507.0 [2024-08-06 02:57:44,288][52660] Sum rewards: 66.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.445', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.096', 'AMMO4': '0.177', 'AMMO3': '0.233', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:45,605][52664] DAMAGECOUNT value on done: 376104.0 [2024-08-06 02:57:45,605][52664] Sum rewards: 75.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.118', 'weapon5': '0.160', 'AMMO4': '0.166', 'AMMO3': '0.223', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 02:57:46,090][52671] DAMAGECOUNT value on done: 357313.0 [2024-08-06 02:57:46,090][52671] Sum rewards: 68.087, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.666', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.114', 'weapon2': '0.214', 'AMMO4': '0.217', 'weapon5': '0.222', 'AMMO3': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.144', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '59.000'} [2024-08-06 02:57:46,410][52794] DAMAGECOUNT value on done: 368132.0 [2024-08-06 02:57:46,410][52794] Sum rewards: 77.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.090', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '64.000'} [2024-08-06 02:57:46,640][52658] DAMAGECOUNT value on done: 358687.0 [2024-08-06 02:57:46,641][52658] Sum rewards: 67.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.847', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.200', 'AMMO4': '0.222', 'weapon5': '0.222', 'weapon4': '0.292', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '55.000'} [2024-08-06 02:57:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 344965120. Throughput: 0: 4394.4. Samples: 86241820. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:57:47,795][52567] Avg episode reward: [(0, '69.537')] [2024-08-06 02:57:48,094][52650] Updated weights for policy 0, policy_version 42111 (0.0012) [2024-08-06 02:57:48,236][52664] DAMAGECOUNT value on done: 370849.0 [2024-08-06 02:57:48,237][52664] Sum rewards: 60.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.464', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.110', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.331', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:49,089][52671] DAMAGECOUNT value on done: 370051.0 [2024-08-06 02:57:49,090][52671] Sum rewards: 62.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.140', 'weapon4': '0.204', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:49,195][52794] DAMAGECOUNT value on done: 360769.0 [2024-08-06 02:57:49,197][52794] Sum rewards: 78.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.792', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.094', 'WEAPON4': '0.100', 'weapon2': '0.228', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.500', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '65.000'} [2024-08-06 02:57:49,559][52658] DAMAGECOUNT value on done: 361558.0 [2024-08-06 02:57:49,559][52658] Sum rewards: 60.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.966', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.128', 'weapon4': '0.130', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.082', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '50.000'} [2024-08-06 02:57:50,623][52664] DAMAGECOUNT value on done: 379279.0 [2024-08-06 02:57:50,624][52664] Sum rewards: 76.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.011', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.122', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '65.000'} [2024-08-06 02:57:51,770][52794] DAMAGECOUNT value on done: 359736.0 [2024-08-06 02:57:51,770][52794] Sum rewards: 60.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.862', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.278', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '50.000'} [2024-08-06 02:57:52,226][52671] DAMAGECOUNT value on done: 358299.0 [2024-08-06 02:57:52,226][52671] Sum rewards: 73.900, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.508', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon4': '0.092', 'weapon5': '0.124', 'AMMO4': '0.137', 'AMMO3': '0.150', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.238', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:52,544][52650] Updated weights for policy 0, policy_version 42121 (0.0045) [2024-08-06 02:57:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 345055232. Throughput: 0: 4385.8. Samples: 86267660. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:57:52,794][52567] Avg episode reward: [(0, '69.219')] [2024-08-06 02:57:52,936][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:57:53,708][52664] DAMAGECOUNT value on done: 373727.0 [2024-08-06 02:57:53,708][52664] Sum rewards: 75.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.213', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '63.000'} [2024-08-06 02:57:53,851][52811] DAMAGECOUNT value on done: 344681.0 [2024-08-06 02:57:53,852][52811] Sum rewards: 62.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.182', 'AMMO3': '0.189', 'AMMO4': '0.200', 'weapon2': '0.220', 'weapon5': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.038', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '54.000'} [2024-08-06 02:57:54,691][52794] DAMAGECOUNT value on done: 369794.0 [2024-08-06 02:57:54,693][52794] Sum rewards: 74.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.047', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.102', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '63.000'} [2024-08-06 02:57:54,780][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 02:57:54,936][52671] DAMAGECOUNT value on done: 352482.0 [2024-08-06 02:57:54,938][52671] Sum rewards: 68.650, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.444', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.078', 'weapon4': '0.106', 'AMMO4': '0.151', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'weapon3': '3.402', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '58.000'} [2024-08-06 02:57:55,614][52803] DAMAGECOUNT value on done: 335594.0 [2024-08-06 02:57:55,617][52803] Sum rewards: 70.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.042', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.900', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 02:57:56,826][52664] DAMAGECOUNT value on done: 377824.0 [2024-08-06 02:57:56,827][52664] Sum rewards: 70.974, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.616', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.128', 'weapon5': '0.168', 'AMMO4': '0.213', 'weapon2': '0.232', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.188', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '64.000'} [2024-08-06 02:57:56,939][52811] DAMAGECOUNT value on done: 332475.0 [2024-08-06 02:57:56,940][52811] Sum rewards: 63.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.152', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.062', 'weapon5': '0.196', 'AMMO3': '0.226', 'weapon4': '0.294', 'AMMO4': '0.308', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.552', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '52.500'} [2024-08-06 02:57:57,275][52650] Updated weights for policy 0, policy_version 42131 (0.0036) [2024-08-06 02:57:57,311][52794] DAMAGECOUNT value on done: 359465.0 [2024-08-06 02:57:57,312][52794] Sum rewards: 61.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.290', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.078', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '54.000'} [2024-08-06 02:57:57,673][52671] DAMAGECOUNT value on done: 364367.0 [2024-08-06 02:57:57,676][52671] Sum rewards: 64.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO4': '0.158', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.000'} [2024-08-06 02:57:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 345145344. Throughput: 0: 4381.1. Samples: 86293930. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:57:57,795][52567] Avg episode reward: [(0, '69.374')] [2024-08-06 02:57:58,810][52803] DAMAGECOUNT value on done: 331774.0 [2024-08-06 02:57:58,811][52803] Sum rewards: 75.540, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.602', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.211', 'weapon5': '0.212', 'weapon4': '0.216', 'AMMO4': '0.271', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '64.000'} [2024-08-06 02:57:59,478][52664] DAMAGECOUNT value on done: 368623.0 [2024-08-06 02:57:59,478][52664] Sum rewards: 67.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.167', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:00,140][52811] DAMAGECOUNT value on done: 334574.0 [2024-08-06 02:58:00,140][52811] Sum rewards: 61.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.070', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.216', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.508', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '53.000'} [2024-08-06 02:58:00,420][52671] DAMAGECOUNT value on done: 365504.0 [2024-08-06 02:58:00,421][52671] Sum rewards: 71.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.138', 'weapon4': '0.166', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '57.500'} [2024-08-06 02:58:01,865][52650] Updated weights for policy 0, policy_version 42141 (0.0011) [2024-08-06 02:58:01,993][52664] DAMAGECOUNT value on done: 371045.0 [2024-08-06 02:58:01,993][52664] Sum rewards: 64.163, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.486', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.218', 'weapon4': '0.232', 'AMMO3': '0.240', 'AMMO4': '0.242', 'weapon2': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:02,065][52803] DAMAGECOUNT value on done: 335625.0 [2024-08-06 02:58:02,067][52803] Sum rewards: 63.475, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.786', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.160', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '0.900', 'weapon3': '2.910', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '50.000'} [2024-08-06 02:58:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 345235456. Throughput: 0: 4377.3. Samples: 86307090. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 02:58:02,794][52567] Avg episode reward: [(0, '69.153')] [2024-08-06 02:58:03,050][52671] DAMAGECOUNT value on done: 367148.0 [2024-08-06 02:58:03,051][52671] Sum rewards: 74.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.141', 'AMMO3': '0.203', 'weapon2': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '63.000'} [2024-08-06 02:58:03,257][52811] DAMAGECOUNT value on done: 333917.0 [2024-08-06 02:58:03,260][52811] Sum rewards: 77.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.561', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.066', 'AMMO4': '0.097', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '3.244', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:05,034][52664] DAMAGECOUNT value on done: 372190.0 [2024-08-06 02:58:05,034][52664] Sum rewards: 63.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.034', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.106', 'weapon2': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.273', 'weapon5': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:05,117][52803] DAMAGECOUNT value on done: 337395.0 [2024-08-06 02:58:05,118][52803] Sum rewards: 62.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.124', 'AMMO4': '0.164', 'weapon5': '0.184', 'AMMO3': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.990', 'weapon3': '3.092', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '53.000'} [2024-08-06 02:58:05,780][52671] DAMAGECOUNT value on done: 360111.0 [2024-08-06 02:58:05,780][52671] Sum rewards: 67.936, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon2': '0.206', 'AMMO4': '0.214', 'weapon5': '0.224', 'AMMO3': '0.258', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.924', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:06,528][52811] DAMAGECOUNT value on done: 337082.0 [2024-08-06 02:58:06,529][52811] Sum rewards: 74.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'HITCOUNT': '3.360', 'weapon3': '3.554', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:06,615][52650] Updated weights for policy 0, policy_version 42151 (0.0011) [2024-08-06 02:58:06,927][52795] DAMAGECOUNT value on done: 332993.0 [2024-08-06 02:58:06,927][52795] Sum rewards: 71.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.522', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.161', 'AMMO3': '0.165', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.688', 'WEAPON3': '0.950', 'weapon3': '2.704', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:07,434][52659] DAMAGECOUNT value on done: 361454.0 [2024-08-06 02:58:07,436][52659] Sum rewards: 91.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.266', 'weapon4': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.024', 'FRAGCOUNT': '73.000'} [2024-08-06 02:58:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17578.1). Total num frames: 345325568. Throughput: 0: 4377.8. Samples: 86333440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:07,802][52567] Avg episode reward: [(0, '69.332')] [2024-08-06 02:58:08,197][52803] DAMAGECOUNT value on done: 339197.0 [2024-08-06 02:58:08,200][52803] Sum rewards: 65.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.856', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.108', 'weapon5': '0.202', 'AMMO4': '0.237', 'AMMO3': '0.244', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:08,289][52664] DAMAGECOUNT value on done: 371108.0 [2024-08-06 02:58:08,293][52664] Sum rewards: 70.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon4': '0.222', 'weapon5': '0.224', 'AMMO3': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:08,571][52671] DAMAGECOUNT value on done: 357580.0 [2024-08-06 02:58:08,573][52671] Sum rewards: 74.688, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.108', 'weapon4': '0.110', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.150', 'weapon3': '3.326', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:09,666][52811] DAMAGECOUNT value on done: 339924.0 [2024-08-06 02:58:09,669][52811] Sum rewards: 49.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.128', 'AMMO3': '0.162', 'weapon4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.050', 'HITCOUNT': '2.650', 'weapon3': '2.912', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '42.000'} [2024-08-06 02:58:10,004][52795] DAMAGECOUNT value on done: 325568.0 [2024-08-06 02:58:10,004][52795] Sum rewards: 66.197, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.670', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon2': '0.224', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'HITCOUNT': '3.160', 'weapon3': '3.592', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2024-08-06 02:58:10,487][52659] DAMAGECOUNT value on done: 359795.0 [2024-08-06 02:58:10,487][52659] Sum rewards: 62.762, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.854', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:11,374][52803] DAMAGECOUNT value on done: 330786.0 [2024-08-06 02:58:11,375][52803] Sum rewards: 73.936, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.904', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '64.000'} [2024-08-06 02:58:11,397][52650] Updated weights for policy 0, policy_version 42161 (0.0033) [2024-08-06 02:58:11,440][52664] DAMAGECOUNT value on done: 370223.0 [2024-08-06 02:58:11,440][52664] Sum rewards: 58.780, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon5': '0.228', 'AMMO4': '0.230', 'weapon2': '0.310', 'weapon4': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.580', 'weapon3': '2.890', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '46.500'} [2024-08-06 02:58:11,735][52647] DAMAGECOUNT value on done: 378333.0 [2024-08-06 02:58:11,739][52647] Sum rewards: 74.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO4': '0.183', 'AMMO3': '0.187', 'weapon2': '0.198', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:12,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 345399296. Throughput: 0: 4378.2. Samples: 86359910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:12,795][52567] Avg episode reward: [(0, '69.054')] [2024-08-06 02:58:12,824][52811] DAMAGECOUNT value on done: 335083.0 [2024-08-06 02:58:12,825][52811] Sum rewards: 69.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.624', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.108', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:13,103][52795] DAMAGECOUNT value on done: 325431.0 [2024-08-06 02:58:13,103][52795] Sum rewards: 67.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.104', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.132', 'AMMO3': '0.177', 'AMMO4': '0.246', 'weapon5': '0.342', 'weapon2': '0.460', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:13,571][52659] DAMAGECOUNT value on done: 358521.0 [2024-08-06 02:58:13,572][52659] Sum rewards: 70.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.928', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.136', 'AMMO3': '0.232', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:14,198][52647] DAMAGECOUNT value on done: 376964.0 [2024-08-06 02:58:14,198][52647] Sum rewards: 70.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.625', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.040', 'AMMO4': '0.075', 'weapon4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.266', 'WEAPON3': '1.700', 'weapon3': '3.466', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:14,538][52803] DAMAGECOUNT value on done: 330362.0 [2024-08-06 02:58:14,539][52803] Sum rewards: 69.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.099', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.263', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.480', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:15,839][52811] DAMAGECOUNT value on done: 335795.0 [2024-08-06 02:58:15,839][52811] Sum rewards: 60.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.665', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.140', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '52.000'} [2024-08-06 02:58:15,975][52650] Updated weights for policy 0, policy_version 42171 (0.0023) [2024-08-06 02:58:16,296][52795] DAMAGECOUNT value on done: 331472.0 [2024-08-06 02:58:16,298][52795] Sum rewards: 73.171, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.148', 'AMMO4': '0.161', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'HEALTH': '0.476', 'weapon2': '0.542', 'WEAPON3': '0.850', 'weapon3': '2.634', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '58.000'} [2024-08-06 02:58:16,459][52659] DAMAGECOUNT value on done: 359547.0 [2024-08-06 02:58:16,459][52659] Sum rewards: 68.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.905', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.102', 'AMMO4': '0.186', 'AMMO3': '0.190', 'weapon5': '0.196', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:17,001][52647] DAMAGECOUNT value on done: 376423.0 [2024-08-06 02:58:17,003][52647] Sum rewards: 64.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.055', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.208', 'AMMO4': '0.213', 'AMMO3': '0.224', 'weapon4': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:17,657][52803] DAMAGECOUNT value on done: 330500.0 [2024-08-06 02:58:17,657][52803] Sum rewards: 74.517, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.057', 'HEALTH': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.110', 'weapon4': '0.146', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.000', 'weapon3': '3.098', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 345497600. Throughput: 0: 4380.2. Samples: 86372930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:17,825][52567] Avg episode reward: [(0, '69.252')] [2024-08-06 02:58:19,027][52811] DAMAGECOUNT value on done: 341715.0 [2024-08-06 02:58:19,029][52811] Sum rewards: 51.679, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.459', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.102', 'AMMO4': '0.141', 'AMMO3': '0.142', 'weapon7': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.308', 'weapon2': '0.700', 'WEAPON3': '0.900', 'HITCOUNT': '2.380', 'weapon3': '2.470', 'DAMAGECOUNT': '12.045', 'FRAGCOUNT': '41.000'} [2024-08-06 02:58:19,142][52659] DAMAGECOUNT value on done: 355689.0 [2024-08-06 02:58:19,143][52659] Sum rewards: 84.150, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.022', 'weapon4': '0.072', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.468', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '73.000'} [2024-08-06 02:58:19,569][52795] DAMAGECOUNT value on done: 332131.0 [2024-08-06 02:58:19,571][52795] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.196', 'weapon4': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '59.000'} [2024-08-06 02:58:20,275][52647] DAMAGECOUNT value on done: 382936.0 [2024-08-06 02:58:20,277][52647] Sum rewards: 65.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.880', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.142', 'AMMO4': '0.179', 'weapon5': '0.180', 'AMMO3': '0.253', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:20,453][52650] Updated weights for policy 0, policy_version 42181 (0.0013) [2024-08-06 02:58:20,745][52666] DAMAGECOUNT value on done: 358794.0 [2024-08-06 02:58:20,746][52666] Sum rewards: 63.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.060', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.266', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.424', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:20,747][52803] DAMAGECOUNT value on done: 336448.0 [2024-08-06 02:58:20,750][52803] Sum rewards: 68.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.100', 'HITCOUNT': '3.300', 'weapon3': '3.400', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:21,648][52659] DAMAGECOUNT value on done: 360406.0 [2024-08-06 02:58:21,650][52659] Sum rewards: 77.468, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.309', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.090', 'AMMO4': '0.123', 'weapon2': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'weapon3': '3.400', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '66.000'} [2024-08-06 02:58:22,064][52811] DAMAGECOUNT value on done: 335339.0 [2024-08-06 02:58:22,064][52811] Sum rewards: 68.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.126', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon5': '0.166', 'AMMO3': '0.186', 'weapon2': '0.186', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.064', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:22,784][52647] DAMAGECOUNT value on done: 378909.0 [2024-08-06 02:58:22,788][52647] Sum rewards: 69.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.600', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.122', 'weapon5': '0.152', 'AMMO4': '0.220', 'AMMO3': '0.228', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.000'} [2024-08-06 02:58:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 345579520. Throughput: 0: 4382.4. Samples: 86399240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:22,794][52567] Avg episode reward: [(0, '69.456')] [2024-08-06 02:58:22,807][52795] DAMAGECOUNT value on done: 333045.0 [2024-08-06 02:58:22,807][52795] Sum rewards: 77.390, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.100', 'weapon3': '3.318', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:23,624][52666] DAMAGECOUNT value on done: 363041.0 [2024-08-06 02:58:23,625][52666] Sum rewards: 69.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.059', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.314', 'WEAPON3': '1.350', 'HITCOUNT': '3.410', 'weapon3': '3.558', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '58.000'} [2024-08-06 02:58:23,876][52803] DAMAGECOUNT value on done: 330367.0 [2024-08-06 02:58:23,877][52803] Sum rewards: 67.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.210', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.060', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.518', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:24,223][52659] DAMAGECOUNT value on done: 359152.0 [2024-08-06 02:58:24,225][52659] Sum rewards: 75.312, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.324', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon2': '0.126', 'weapon5': '0.172', 'AMMO3': '0.188', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.610', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:25,184][52811] DAMAGECOUNT value on done: 335774.0 [2024-08-06 02:58:25,186][52811] Sum rewards: 62.446, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.597', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'weapon5': '0.124', 'AMMO3': '0.142', 'weapon2': '0.554', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.076', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '50.000'} [2024-08-06 02:58:25,243][52650] Updated weights for policy 0, policy_version 42191 (0.0042) [2024-08-06 02:58:25,533][52647] DAMAGECOUNT value on done: 380982.0 [2024-08-06 02:58:25,535][52647] Sum rewards: 72.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.492', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.151', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:25,948][52795] DAMAGECOUNT value on done: 339988.0 [2024-08-06 02:58:25,952][52795] Sum rewards: 75.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.594', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.068', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:26,419][52666] DAMAGECOUNT value on done: 362832.0 [2024-08-06 02:58:26,422][52666] Sum rewards: 73.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.756', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.010', 'AMMO4': '0.034', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.390', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:26,789][52803] DAMAGECOUNT value on done: 339701.0 [2024-08-06 02:58:26,791][52803] Sum rewards: 70.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.186', 'AMMO3': '0.195', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:27,024][52670] DAMAGECOUNT value on done: 355724.0 [2024-08-06 02:58:27,024][52670] Sum rewards: 70.897, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:27,124][52659] DAMAGECOUNT value on done: 356311.0 [2024-08-06 02:58:27,124][52659] Sum rewards: 61.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.191', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.390', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '53.000'} [2024-08-06 02:58:27,486][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:58:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 345661440. Throughput: 0: 4381.8. Samples: 86425730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:27,794][52567] Avg episode reward: [(0, '69.306')] [2024-08-06 02:58:27,875][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042196_345669632.pth... [2024-08-06 02:58:28,021][52647] DAMAGECOUNT value on done: 379207.0 [2024-08-06 02:58:28,022][52647] Sum rewards: 75.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.100', 'weapon5': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.386', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:28,034][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041682_341458944.pth [2024-08-06 02:58:28,247][52811] DAMAGECOUNT value on done: 343528.0 [2024-08-06 02:58:28,247][52811] Sum rewards: 65.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.432', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.188', 'AMMO4': '0.192', 'AMMO3': '0.260', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.054', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:29,075][52795] DAMAGECOUNT value on done: 336801.0 [2024-08-06 02:58:29,077][52795] Sum rewards: 77.337, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.176', 'AMMO3': '0.191', 'AMMO4': '0.210', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.698', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '63.000'} [2024-08-06 02:58:29,123][52666] DAMAGECOUNT value on done: 359617.0 [2024-08-06 02:58:29,124][52666] Sum rewards: 71.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.190', 'WEAPON4': '0.400', 'weapon4': '0.416', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:29,579][52670] DAMAGECOUNT value on done: 358890.0 [2024-08-06 02:58:29,580][52670] Sum rewards: 64.914, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.324', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO4': '0.217', 'weapon5': '0.222', 'weapon2': '0.250', 'AMMO3': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.650', 'weapon3': '2.718', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:29,924][52803] DAMAGECOUNT value on done: 335230.0 [2024-08-06 02:58:29,924][52803] Sum rewards: 61.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO4': '0.170', 'AMMO3': '0.194', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.868', 'WEAPON3': '1.200', 'weapon3': '2.592', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '51.000'} [2024-08-06 02:58:29,943][52650] Updated weights for policy 0, policy_version 42201 (0.0022) [2024-08-06 02:58:30,129][52659] DAMAGECOUNT value on done: 366052.0 [2024-08-06 02:58:30,131][52659] Sum rewards: 72.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.442', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:31,223][52647] DAMAGECOUNT value on done: 374411.0 [2024-08-06 02:58:31,228][52647] Sum rewards: 76.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.495', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.150', 'weapon4': '0.186', 'AMMO4': '0.204', 'AMMO3': '0.226', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '64.000'} [2024-08-06 02:58:31,377][52811] DAMAGECOUNT value on done: 332717.0 [2024-08-06 02:58:31,377][52811] Sum rewards: 73.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.687', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.366', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:31,852][52666] DAMAGECOUNT value on done: 355897.0 [2024-08-06 02:58:31,853][52666] Sum rewards: 59.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon4': '0.186', 'AMMO3': '0.237', 'weapon5': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '51.000'} [2024-08-06 02:58:31,913][52663] DAMAGECOUNT value on done: 364089.0 [2024-08-06 02:58:31,914][52663] Sum rewards: 67.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.223', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:32,297][52795] DAMAGECOUNT value on done: 321283.0 [2024-08-06 02:58:32,297][52795] Sum rewards: 69.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.330', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.162', 'AMMO4': '0.201', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:32,338][52670] DAMAGECOUNT value on done: 350435.0 [2024-08-06 02:58:32,339][52670] Sum rewards: 76.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.215', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.082', 'AMMO3': '0.173', 'weapon5': '0.190', 'AMMO4': '0.203', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 345759744. Throughput: 0: 4368.5. Samples: 86438400. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:32,794][52567] Avg episode reward: [(0, '69.220')] [2024-08-06 02:58:32,980][52803] DAMAGECOUNT value on done: 333630.0 [2024-08-06 02:58:32,983][52803] Sum rewards: 72.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.824', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon4': '0.116', 'AMMO4': '0.153', 'AMMO3': '0.208', 'weapon5': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '61.000'} [2024-08-06 02:58:33,224][52659] DAMAGECOUNT value on done: 367124.0 [2024-08-06 02:58:33,224][52659] Sum rewards: 62.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'AMMO4': '0.227', 'weapon2': '0.234', 'weapon4': '0.384', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '52.000'} [2024-08-06 02:58:34,218][52666] DAMAGECOUNT value on done: 351569.0 [2024-08-06 02:58:34,219][52666] Sum rewards: 75.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.320', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon5': '0.218', 'weapon4': '0.256', 'AMMO3': '0.263', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.000'} [2024-08-06 02:58:34,341][52647] DAMAGECOUNT value on done: 385756.0 [2024-08-06 02:58:34,342][52647] Sum rewards: 62.886, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.023', 'AMMO2': '0.073', 'weapon4': '0.200', 'AMMO3': '0.238', 'weapon5': '0.334', 'AMMO4': '0.363', 'weapon2': '0.364', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.756', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:34,507][52811] DAMAGECOUNT value on done: 336860.0 [2024-08-06 02:58:34,509][52811] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.152', 'AMMO3': '0.230', 'AMMO4': '0.258', 'weapon4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:34,636][52650] Updated weights for policy 0, policy_version 42211 (0.0031) [2024-08-06 02:58:34,721][52670] DAMAGECOUNT value on done: 349214.0 [2024-08-06 02:58:34,721][52670] Sum rewards: 71.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.098', 'AMMO4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.194', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.236', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:35,017][52663] DAMAGECOUNT value on done: 357407.0 [2024-08-06 02:58:35,018][52663] Sum rewards: 75.029, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.206', 'AMMO3': '0.231', 'AMMO4': '0.243', 'weapon2': '0.274', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '63.000'} [2024-08-06 02:58:35,436][52795] DAMAGECOUNT value on done: 339372.0 [2024-08-06 02:58:35,437][52795] Sum rewards: 82.421, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.476', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.144', 'weapon5': '0.146', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '72.000'} [2024-08-06 02:58:36,151][52803] DAMAGECOUNT value on done: 337695.0 [2024-08-06 02:58:36,153][52803] Sum rewards: 53.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.667', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.080', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.196', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '45.000'} [2024-08-06 02:58:36,315][52659] DAMAGECOUNT value on done: 358582.0 [2024-08-06 02:58:36,316][52659] Sum rewards: 66.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.691', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.184', 'weapon5': '0.212', 'weapon2': '0.236', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:36,696][52666] DAMAGECOUNT value on done: 358486.0 [2024-08-06 02:58:36,698][52666] Sum rewards: 69.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.098', 'weapon5': '0.156', 'AMMO4': '0.160', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:37,097][52647] DAMAGECOUNT value on done: 374420.0 [2024-08-06 02:58:37,099][52647] Sum rewards: 59.422, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.207', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.150', 'AMMO3': '0.197', 'weapon4': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '50.000'} [2024-08-06 02:58:37,226][52647] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon5', 0.002)] [2024-08-06 02:58:37,368][52670] DAMAGECOUNT value on done: 362073.0 [2024-08-06 02:58:37,370][52670] Sum rewards: 63.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.093', 'weapon5': '0.136', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.382', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '52.000'} [2024-08-06 02:58:37,454][52811] DAMAGECOUNT value on done: 336515.0 [2024-08-06 02:58:37,455][52811] Sum rewards: 61.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.852', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.126', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.264', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.282', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:37,692][52663] DAMAGECOUNT value on done: 355855.0 [2024-08-06 02:58:37,692][52663] Sum rewards: 54.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.052', 'AMMO4': '0.157', 'weapon5': '0.212', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.114', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '46.500'} [2024-08-06 02:58:37,795][52567] Fps is (10 sec: 18021.5, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 345841664. Throughput: 0: 4382.8. Samples: 86464890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:37,795][52567] Avg episode reward: [(0, '68.753')] [2024-08-06 02:58:38,594][52795] DAMAGECOUNT value on done: 329627.0 [2024-08-06 02:58:38,594][52795] Sum rewards: 75.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.050', 'weapon4': '0.074', 'AMMO3': '0.134', 'AMMO4': '0.154', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '0.900', 'weapon3': '3.298', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:39,070][52659] DAMAGECOUNT value on done: 362359.0 [2024-08-06 02:58:39,073][52659] Sum rewards: 70.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.152', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:39,155][52803] DAMAGECOUNT value on done: 332941.0 [2024-08-06 02:58:39,156][52803] Sum rewards: 61.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '53.000'} [2024-08-06 02:58:39,664][52666] DAMAGECOUNT value on done: 357665.0 [2024-08-06 02:58:39,666][52666] Sum rewards: 69.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.696', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.101', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.456', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:39,824][52650] Updated weights for policy 0, policy_version 42221 (0.0014) [2024-08-06 02:58:40,275][52670] DAMAGECOUNT value on done: 353807.0 [2024-08-06 02:58:40,275][52670] Sum rewards: 67.661, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.884', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.166', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '58.000'} [2024-08-06 02:58:40,297][52647] DAMAGECOUNT value on done: 382042.0 [2024-08-06 02:58:40,297][52647] Sum rewards: 63.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.648', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.122', 'AMMO3': '0.160', 'weapon5': '0.180', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.698', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '50.000'} [2024-08-06 02:58:40,584][52811] DAMAGECOUNT value on done: 333160.0 [2024-08-06 02:58:40,588][52811] Sum rewards: 72.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon5': '0.174', 'weapon4': '0.208', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:40,620][52663] DAMAGECOUNT value on done: 359453.0 [2024-08-06 02:58:40,620][52663] Sum rewards: 61.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.109', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.070', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.216', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '53.000'} [2024-08-06 02:58:40,977][52664] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:58:41,712][52659] DAMAGECOUNT value on done: 352137.0 [2024-08-06 02:58:41,715][52659] Sum rewards: 56.541, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.830', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'AMMO3': '0.139', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon5': '0.176', 'weapon2': '0.360', 'weapon4': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '2.770', 'weapon3': '2.844', 'DAMAGECOUNT': '12.852', 'FRAGCOUNT': '44.000'} [2024-08-06 02:58:41,853][52795] DAMAGECOUNT value on done: 331075.0 [2024-08-06 02:58:41,854][52795] Sum rewards: 71.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.181', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.080', 'AMMO4': '0.128', 'weapon5': '0.130', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.618', 'WEAPON3': '1.000', 'weapon3': '2.952', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:42,225][52803] DAMAGECOUNT value on done: 332424.0 [2024-08-06 02:58:42,225][52803] Sum rewards: 66.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.132', 'weapon2': '0.232', 'AMMO3': '0.259', 'weapon5': '0.264', 'AMMO4': '0.321', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.020', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:42,517][52666] DAMAGECOUNT value on done: 353878.0 [2024-08-06 02:58:42,517][52666] Sum rewards: 61.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.799', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.104', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.298', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '51.000'} [2024-08-06 02:58:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 345923584. Throughput: 0: 4379.6. Samples: 86491010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:42,794][52567] Avg episode reward: [(0, '68.479')] [2024-08-06 02:58:42,981][52647] DAMAGECOUNT value on done: 372845.0 [2024-08-06 02:58:42,982][52647] Sum rewards: 61.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.182', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '49.000'} [2024-08-06 02:58:43,099][52670] DAMAGECOUNT value on done: 348102.0 [2024-08-06 02:58:43,103][52670] Sum rewards: 63.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.322', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.170', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:43,547][52663] DAMAGECOUNT value on done: 358063.0 [2024-08-06 02:58:43,547][52663] Sum rewards: 66.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.098', 'AMMO3': '0.187', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:43,756][52650] Updated weights for policy 0, policy_version 42231 (0.0026) [2024-08-06 02:58:43,769][52811] DAMAGECOUNT value on done: 335140.0 [2024-08-06 02:58:43,775][52811] Sum rewards: 64.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.534', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.082', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.264', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.332', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:44,731][52659] DAMAGECOUNT value on done: 357797.0 [2024-08-06 02:58:44,731][52659] Sum rewards: 61.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.058', 'weapon5': '0.116', 'AMMO3': '0.183', 'AMMO4': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '50.000'} [2024-08-06 02:58:44,961][52795] DAMAGECOUNT value on done: 327202.0 [2024-08-06 02:58:44,961][52795] Sum rewards: 70.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.704', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.590', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '59.000'} [2024-08-06 02:58:45,345][52803] DAMAGECOUNT value on done: 342869.0 [2024-08-06 02:58:45,345][52803] Sum rewards: 66.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.560', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.212', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:45,534][52666] DAMAGECOUNT value on done: 352154.0 [2024-08-06 02:58:45,534][52666] Sum rewards: 73.447, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.860', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.170', 'weapon5': '0.216', 'weapon2': '0.258', 'AMMO3': '0.269', 'AMMO4': '0.321', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.058', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '65.000'} [2024-08-06 02:58:45,945][52663] DAMAGECOUNT value on done: 361792.0 [2024-08-06 02:58:45,946][52663] Sum rewards: 74.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.168', 'AMMO3': '0.207', 'AMMO4': '0.295', 'weapon2': '0.300', 'weapon4': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '63.000'} [2024-08-06 02:58:46,037][52647] DAMAGECOUNT value on done: 375876.0 [2024-08-06 02:58:46,038][52647] Sum rewards: 54.928, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.090', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.134', 'AMMO4': '0.248', 'AMMO3': '0.273', 'weapon2': '0.336', 'WEAPON5': '0.400', 'weapon4': '0.562', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.628', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '49.000'} [2024-08-06 02:58:46,237][52670] DAMAGECOUNT value on done: 353536.0 [2024-08-06 02:58:46,238][52670] Sum rewards: 73.862, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.621', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO4': '0.124', 'AMMO3': '0.155', 'weapon2': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '0.950', 'weapon3': '3.254', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:46,814][52811] DAMAGECOUNT value on done: 338524.0 [2024-08-06 02:58:46,815][52811] Sum rewards: 77.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.304', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.169', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.938', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '62.000'} [2024-08-06 02:58:47,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 346013696. Throughput: 0: 4375.6. Samples: 86503990. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:47,794][52567] Avg episode reward: [(0, '68.440')] [2024-08-06 02:58:47,813][52659] DAMAGECOUNT value on done: 366361.0 [2024-08-06 02:58:47,815][52659] Sum rewards: 81.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.150', 'weapon2': '0.218', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '69.000'} [2024-08-06 02:58:47,986][52795] DAMAGECOUNT value on done: 335244.0 [2024-08-06 02:58:47,987][52795] Sum rewards: 64.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.679', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.134', 'weapon4': '0.156', 'AMMO4': '0.212', 'AMMO3': '0.245', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '54.500'} [2024-08-06 02:58:48,202][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:58:48,405][52647] DAMAGECOUNT value on done: 376240.0 [2024-08-06 02:58:48,405][52647] Sum rewards: 69.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.427', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.178', 'AMMO3': '0.195', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:48,533][52803] DAMAGECOUNT value on done: 336326.0 [2024-08-06 02:58:48,534][52803] Sum rewards: 81.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.258', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.161', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.358', 'weapon4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.658', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '63.000'} [2024-08-06 02:58:48,649][52650] Updated weights for policy 0, policy_version 42241 (0.0027) [2024-08-06 02:58:48,756][52666] DAMAGECOUNT value on done: 353732.0 [2024-08-06 02:58:48,758][52666] Sum rewards: 67.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.576', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO4': '0.203', 'AMMO3': '0.216', 'weapon5': '0.246', 'weapon2': '0.344', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:48,934][52663] DAMAGECOUNT value on done: 358886.0 [2024-08-06 02:58:48,935][52663] Sum rewards: 56.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.102', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.117', 'weapon5': '0.130', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.000', 'HITCOUNT': '2.950', 'weapon3': '2.980', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '45.000'} [2024-08-06 02:58:49,457][52670] DAMAGECOUNT value on done: 356767.0 [2024-08-06 02:58:49,459][52670] Sum rewards: 62.759, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.840', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.176', 'weapon4': '0.240', 'AMMO3': '0.258', 'AMMO4': '0.293', 'weapon2': '0.344', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.852', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:49,964][52811] DAMAGECOUNT value on done: 334486.0 [2024-08-06 02:58:49,964][52811] Sum rewards: 85.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.444', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.907', 'FRAGCOUNT': '69.000'} [2024-08-06 02:58:50,726][52647] DAMAGECOUNT value on done: 384491.0 [2024-08-06 02:58:50,727][52647] Sum rewards: 65.352, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.954', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.206', 'AMMO3': '0.296', 'weapon2': '0.396', 'WEAPON3': '1.750', 'HITCOUNT': '3.070', 'weapon3': '3.150', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '59.000'} [2024-08-06 02:58:50,788][52659] DAMAGECOUNT value on done: 365232.0 [2024-08-06 02:58:50,789][52659] Sum rewards: 58.904, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.416', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '46.000'} [2024-08-06 02:58:51,094][52795] DAMAGECOUNT value on done: 324535.0 [2024-08-06 02:58:51,094][52795] Sum rewards: 42.742, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.934', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.159', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.528', 'weapon4': '0.626', 'WEAPON3': '0.900', 'HITCOUNT': '2.150', 'weapon3': '2.500', 'DAMAGECOUNT': '10.233', 'FRAGCOUNT': '35.000'} [2024-08-06 02:58:51,582][52666] DAMAGECOUNT value on done: 352094.0 [2024-08-06 02:58:51,583][52666] Sum rewards: 64.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.064', 'AMMO3': '0.153', 'weapon5': '0.186', 'AMMO4': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.926', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '52.500'} [2024-08-06 02:58:51,634][52803] DAMAGECOUNT value on done: 339725.0 [2024-08-06 02:58:51,635][52803] Sum rewards: 72.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.102', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.402', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '60.000'} [2024-08-06 02:58:51,776][52663] DAMAGECOUNT value on done: 356357.0 [2024-08-06 02:58:51,778][52663] Sum rewards: 65.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.597', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.096', 'weapon5': '0.096', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '54.000'} [2024-08-06 02:58:52,312][52670] DAMAGECOUNT value on done: 348006.0 [2024-08-06 02:58:52,313][52670] Sum rewards: 68.716, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.445', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.159', 'weapon5': '0.172', 'AMMO4': '0.181', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.752', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 346103808. Throughput: 0: 4372.9. Samples: 86530220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 02:58:52,794][52567] Avg episode reward: [(0, '68.167')] [2024-08-06 02:58:52,993][52647] DAMAGECOUNT value on done: 377175.0 [2024-08-06 02:58:52,995][52647] Sum rewards: 68.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.183', 'weapon5': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '56.000'} [2024-08-06 02:58:53,191][52811] DAMAGECOUNT value on done: 336226.0 [2024-08-06 02:58:53,193][52811] Sum rewards: 48.682, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.984', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '0.850', 'HITCOUNT': '2.460', 'weapon3': '2.880', 'DAMAGECOUNT': '11.994', 'FRAGCOUNT': '38.000'} [2024-08-06 02:58:53,390][52650] Updated weights for policy 0, policy_version 42251 (0.0018) [2024-08-06 02:58:53,913][52659] DAMAGECOUNT value on done: 363599.0 [2024-08-06 02:58:53,917][52659] Sum rewards: 79.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.082', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.199', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '66.000'} [2024-08-06 02:58:54,275][52795] DAMAGECOUNT value on done: 342350.0 [2024-08-06 02:58:54,276][52795] Sum rewards: 63.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.156', 'AMMO3': '0.203', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.358', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '53.000'} [2024-08-06 02:58:54,667][52803] DAMAGECOUNT value on done: 331845.0 [2024-08-06 02:58:54,668][52803] Sum rewards: 70.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.192', 'weapon5': '0.242', 'AMMO4': '0.261', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '2.666', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '57.000'} [2024-08-06 02:58:54,697][52666] DAMAGECOUNT value on done: 361780.0 [2024-08-06 02:58:54,698][52666] Sum rewards: 66.817, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.155', 'weapon5': '0.162', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '2.876', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:55,115][52663] DAMAGECOUNT value on done: 353935.0 [2024-08-06 02:58:55,119][52663] Sum rewards: 66.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.542', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.204', 'weapon4': '0.240', 'weapon5': '0.240', 'AMMO4': '0.252', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:55,178][52670] DAMAGECOUNT value on done: 362725.0 [2024-08-06 02:58:55,179][52670] Sum rewards: 67.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.934', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon7': '0.074', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO4': '0.184', 'AMMO3': '0.197', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '55.000'} [2024-08-06 02:58:55,719][52647] DAMAGECOUNT value on done: 374604.0 [2024-08-06 02:58:55,720][52647] Sum rewards: 63.237, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.818', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.292', 'weapon4': '0.506', 'WEAPON3': '0.900', 'weapon3': '2.758', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '51.000'} [2024-08-06 02:58:56,939][52659] DAMAGECOUNT value on done: 358464.0 [2024-08-06 02:58:56,940][52659] Sum rewards: 74.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon4': '0.094', 'weapon2': '0.128', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.542', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '64.000'} [2024-08-06 02:58:56,979][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:58:57,160][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:58:57,247][52666] DAMAGECOUNT value on done: 357482.0 [2024-08-06 02:58:57,250][52666] Sum rewards: 60.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.102', 'AMMO4': '0.107', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.386', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.092', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '53.000'} [2024-08-06 02:58:57,279][52795] DAMAGECOUNT value on done: 333900.0 [2024-08-06 02:58:57,279][52795] Sum rewards: 54.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.636', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.172', 'weapon5': '0.218', 'AMMO4': '0.225', 'WEAPON5': '0.400', 'weapon2': '0.426', 'weapon4': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.602', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '13.926', 'FRAGCOUNT': '45.000'} [2024-08-06 02:58:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 346193920. Throughput: 0: 4366.4. Samples: 86556400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:58:57,794][52567] Avg episode reward: [(0, '67.794')] [2024-08-06 02:58:57,854][52670] DAMAGECOUNT value on done: 353667.0 [2024-08-06 02:58:57,856][52670] Sum rewards: 64.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.342', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.135', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.254', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '53.500'} [2024-08-06 02:58:58,215][52650] Updated weights for policy 0, policy_version 42261 (0.0030) [2024-08-06 02:58:58,286][52663] DAMAGECOUNT value on done: 359860.0 [2024-08-06 02:58:58,286][52663] Sum rewards: 57.809, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.035', 'WEAPON5': '0.050', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.304', 'weapon2': '0.358', 'WEAPON3': '1.700', 'weapon3': '3.140', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '51.500'} [2024-08-06 02:58:58,374][52820] DAMAGECOUNT value on done: 329272.0 [2024-08-06 02:58:58,374][52820] Sum rewards: 78.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.935', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '64.000'} [2024-08-06 02:58:58,525][52647] DAMAGECOUNT value on done: 372360.0 [2024-08-06 02:58:58,529][52647] Sum rewards: 71.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.241', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon2': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '3.240', 'weapon3': '3.300', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '58.000'} [2024-08-06 02:58:59,499][52659] DAMAGECOUNT value on done: 364721.0 [2024-08-06 02:58:59,509][52659] Sum rewards: 71.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.320', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.814', 'WEAPON3': '1.200', 'weapon3': '2.678', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '58.000'} [2024-08-06 02:59:00,088][52666] DAMAGECOUNT value on done: 355696.0 [2024-08-06 02:59:00,090][52666] Sum rewards: 66.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.961', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.092', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.238', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.030', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '56.000'} [2024-08-06 02:59:00,400][52795] DAMAGECOUNT value on done: 325345.0 [2024-08-06 02:59:00,403][52795] Sum rewards: 61.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.958', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.174', 'AMMO4': '0.199', 'weapon2': '0.212', 'AMMO3': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.278', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '52.000'} [2024-08-06 02:59:00,632][52670] DAMAGECOUNT value on done: 354730.0 [2024-08-06 02:59:00,634][52670] Sum rewards: 62.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.416', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.268', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '51.000'} [2024-08-06 02:59:01,463][52663] DAMAGECOUNT value on done: 363790.0 [2024-08-06 02:59:01,466][52663] Sum rewards: 78.474, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.488', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.146', 'weapon4': '0.206', 'AMMO4': '0.223', 'AMMO3': '0.261', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.988', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '69.000'} [2024-08-06 02:59:01,535][52820] DAMAGECOUNT value on done: 334291.0 [2024-08-06 02:59:01,535][52647] DAMAGECOUNT value on done: 371933.0 [2024-08-06 02:59:01,537][52647] Sum rewards: 62.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO4': '0.180', 'AMMO3': '0.183', 'weapon5': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.064', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '52.500'} [2024-08-06 02:59:01,535][52820] Sum rewards: 71.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.208', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '59.000'} [2024-08-06 02:59:01,939][52659] DAMAGECOUNT value on done: 362462.0 [2024-08-06 02:59:01,939][52659] Sum rewards: 71.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.593', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.164', 'weapon4': '0.186', 'AMMO3': '0.227', 'AMMO4': '0.250', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '62.000'} [2024-08-06 02:59:02,528][52650] Updated weights for policy 0, policy_version 42271 (0.0029) [2024-08-06 02:59:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 346284032. Throughput: 0: 4374.0. Samples: 86569760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:59:02,794][52567] Avg episode reward: [(0, '67.544')] [2024-08-06 02:59:02,963][52666] DAMAGECOUNT value on done: 358098.0 [2024-08-06 02:59:02,963][52666] Sum rewards: 68.553, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.703', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.174', 'AMMO4': '0.200', 'weapon5': '0.216', 'weapon2': '0.246', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:03,527][52795] DAMAGECOUNT value on done: 335422.0 [2024-08-06 02:59:03,527][52795] Sum rewards: 67.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.855', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.004', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.178', 'AMMO3': '0.191', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:03,569][52670] DAMAGECOUNT value on done: 361872.0 [2024-08-06 02:59:03,569][52670] Sum rewards: 75.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.575', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.102', 'AMMO3': '0.216', 'weapon4': '0.228', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '63.000'} [2024-08-06 02:59:04,027][52647] DAMAGECOUNT value on done: 376146.0 [2024-08-06 02:59:04,029][52647] Sum rewards: 67.467, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.280', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.170', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.700', 'weapon3': '3.066', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:04,310][52663] DAMAGECOUNT value on done: 360713.0 [2024-08-06 02:59:04,311][52663] Sum rewards: 82.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.046', 'weapon5': '0.158', 'AMMO3': '0.176', 'weapon2': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '67.000'} [2024-08-06 02:59:04,669][52647] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 02:59:04,706][52820] DAMAGECOUNT value on done: 333209.0 [2024-08-06 02:59:04,710][52820] Sum rewards: 66.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.190', 'AMMO3': '0.194', 'AMMO4': '0.213', 'weapon4': '0.238', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '54.000'} [2024-08-06 02:59:05,590][52666] DAMAGECOUNT value on done: 356437.0 [2024-08-06 02:59:05,592][52666] Sum rewards: 64.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'weapon7': '0.002', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.194', 'weapon4': '0.198', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '54.000'} [2024-08-06 02:59:06,065][52670] DAMAGECOUNT value on done: 357398.0 [2024-08-06 02:59:06,067][52670] Sum rewards: 59.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.198', 'weapon5': '0.252', 'AMMO4': '0.258', 'weapon4': '0.410', 'WEAPON5': '0.450', 'weapon2': '0.546', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.508', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '49.000'} [2024-08-06 02:59:06,642][52795] DAMAGECOUNT value on done: 340220.0 [2024-08-06 02:59:06,642][52795] Sum rewards: 75.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.462', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '61.500'} [2024-08-06 02:59:07,163][52663] DAMAGECOUNT value on done: 353172.0 [2024-08-06 02:59:07,167][52663] Sum rewards: 66.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.130', 'weapon2': '0.210', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.462', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '56.000'} [2024-08-06 02:59:07,379][52650] Updated weights for policy 0, policy_version 42281 (0.0012) [2024-08-06 02:59:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 346374144. Throughput: 0: 4374.2. Samples: 86596080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:59:07,794][52567] Avg episode reward: [(0, '67.425')] [2024-08-06 02:59:07,892][52820] DAMAGECOUNT value on done: 329268.0 [2024-08-06 02:59:07,895][52820] Sum rewards: 74.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.647', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.048', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.288', 'WEAPON3': '1.150', 'weapon3': '3.406', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:08,621][52666] DAMAGECOUNT value on done: 357494.0 [2024-08-06 02:59:08,622][52666] Sum rewards: 69.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.166', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '57.000'} [2024-08-06 02:59:09,314][52670] DAMAGECOUNT value on done: 343107.0 [2024-08-06 02:59:09,314][52670] Sum rewards: 54.187, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.931', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.166', 'AMMO3': '0.181', 'weapon5': '0.282', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.570', 'weapon3': '2.962', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '43.500'} [2024-08-06 02:59:10,017][52663] DAMAGECOUNT value on done: 354377.0 [2024-08-06 02:59:10,025][52663] Sum rewards: 71.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.070', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.500'} [2024-08-06 02:59:10,680][52667] DAMAGECOUNT value on done: 358786.0 [2024-08-06 02:59:10,680][52667] Sum rewards: 70.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.038', 'weapon4': '0.042', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:10,951][52820] DAMAGECOUNT value on done: 333364.0 [2024-08-06 02:59:10,953][52820] Sum rewards: 68.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.765', 'AMMO2': '0.021', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.220', 'weapon2': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '57.000'} [2024-08-06 02:59:11,412][52666] DAMAGECOUNT value on done: 349360.0 [2024-08-06 02:59:11,414][52666] Sum rewards: 68.345, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.370', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.124', 'AMMO3': '0.149', 'weapon5': '0.156', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '0.900', 'weapon3': '3.132', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '54.000'} [2024-08-06 02:59:12,008][52670] DAMAGECOUNT value on done: 358920.0 [2024-08-06 02:59:12,008][52670] Sum rewards: 72.560, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.246', 'weapon5': '0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.268', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '63.000'} [2024-08-06 02:59:12,418][52650] Updated weights for policy 0, policy_version 42291 (0.0013) [2024-08-06 02:59:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 346456064. Throughput: 0: 4365.8. Samples: 86622190. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:59:12,794][52567] Avg episode reward: [(0, '67.287')] [2024-08-06 02:59:12,886][52663] DAMAGECOUNT value on done: 356074.0 [2024-08-06 02:59:12,887][52663] Sum rewards: 73.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.483', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.192', 'weapon2': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '3.470', 'weapon3': '3.512', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:13,859][52667] DAMAGECOUNT value on done: 365193.0 [2024-08-06 02:59:13,860][52667] Sum rewards: 68.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.754', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.042', 'AMMO4': '0.086', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:14,137][52820] DAMAGECOUNT value on done: 327904.0 [2024-08-06 02:59:14,139][52820] Sum rewards: 80.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.243', 'weapon2': '0.288', 'WEAPON3': '1.500', 'weapon3': '3.466', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '69.000'} [2024-08-06 02:59:14,170][52666] DAMAGECOUNT value on done: 356921.0 [2024-08-06 02:59:14,170][52666] Sum rewards: 67.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.692', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.167', 'weapon4': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.820', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '53.000'} [2024-08-06 02:59:14,685][52670] DAMAGECOUNT value on done: 363683.0 [2024-08-06 02:59:14,685][52670] Sum rewards: 55.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.742', 'AMMO5': '0.019', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon2': '0.202', 'AMMO3': '0.237', 'weapon5': '0.268', 'weapon4': '0.426', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.746', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '48.000'} [2024-08-06 02:59:15,970][52663] DAMAGECOUNT value on done: 365739.0 [2024-08-06 02:59:15,970][52663] Sum rewards: 75.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.128', 'AMMO3': '0.227', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '63.000'} [2024-08-06 02:59:16,613][52667] DAMAGECOUNT value on done: 359496.0 [2024-08-06 02:59:16,615][52667] Sum rewards: 65.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.785', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.170', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:16,746][52650] Updated weights for policy 0, policy_version 42301 (0.0023) [2024-08-06 02:59:17,183][52670] DAMAGECOUNT value on done: 357044.0 [2024-08-06 02:59:17,184][52670] Sum rewards: 72.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.630', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.044', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.272', 'AMMO3': '0.284', 'WEAPON3': '1.750', 'HITCOUNT': '3.350', 'weapon3': '3.372', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '65.000'} [2024-08-06 02:59:17,219][52820] DAMAGECOUNT value on done: 329732.0 [2024-08-06 02:59:17,219][52820] Sum rewards: 56.978, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.348', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.119', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.297', 'WEAPON3': '1.800', 'HITCOUNT': '2.960', 'weapon3': '3.228', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '51.000'} [2024-08-06 02:59:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 346537984. Throughput: 0: 4373.8. Samples: 86635220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:59:17,794][52567] Avg episode reward: [(0, '67.343')] [2024-08-06 02:59:18,551][52649] Large shaping reward 2.564 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.513, 171.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 02:59:18,557][52663] DAMAGECOUNT value on done: 357801.0 [2024-08-06 02:59:18,557][52663] Sum rewards: 63.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.074', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.140', 'weapon5': '0.180', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '3.068', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:19,952][52670] DAMAGECOUNT value on done: 356742.0 [2024-08-06 02:59:19,954][52670] Sum rewards: 72.396, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.612', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.116', 'weapon4': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.286', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.174', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '64.000'} [2024-08-06 02:59:19,965][52667] DAMAGECOUNT value on done: 361171.0 [2024-08-06 02:59:19,965][52667] Sum rewards: 63.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'AMMO4': '0.228', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '53.000'} [2024-08-06 02:59:20,246][52820] DAMAGECOUNT value on done: 336800.0 [2024-08-06 02:59:20,246][52820] Sum rewards: 54.002, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.690', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon4': '0.436', 'WEAPON3': '1.650', 'weapon3': '2.734', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '49.000'} [2024-08-06 02:59:21,607][52650] Updated weights for policy 0, policy_version 42311 (0.0023) [2024-08-06 02:59:21,669][52663] DAMAGECOUNT value on done: 364386.0 [2024-08-06 02:59:21,670][52663] Sum rewards: 67.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.958', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.110', 'AMMO4': '0.205', 'weapon4': '0.214', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.768', 'WEAPON3': '1.400', 'weapon3': '2.656', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '58.000'} [2024-08-06 02:59:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 346636288. Throughput: 0: 4366.9. Samples: 86661400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 02:59:22,794][52567] Avg episode reward: [(0, '67.062')] [2024-08-06 02:59:22,836][52667] DAMAGECOUNT value on done: 365316.0 [2024-08-06 02:59:22,836][52667] Sum rewards: 60.164, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.112', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.080', 'weapon4': '0.086', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '52.000'} [2024-08-06 02:59:23,382][52820] DAMAGECOUNT value on done: 332733.0 [2024-08-06 02:59:23,382][52820] Sum rewards: 76.454, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.280', 'AMMO3': '0.324', 'WEAPON3': '1.850', 'weapon3': '3.318', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '68.000'} [2024-08-06 02:59:24,495][52663] DAMAGECOUNT value on done: 360594.0 [2024-08-06 02:59:24,496][52663] Sum rewards: 69.606, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.440', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.035', 'weapon5': '0.096', 'AMMO3': '0.115', 'AMMO4': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.862', 'weapon3': '2.850', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '53.000'} [2024-08-06 02:59:25,665][52667] DAMAGECOUNT value on done: 365133.0 [2024-08-06 02:59:25,665][52667] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.019', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO4': '0.198', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'WEAPON3': '1.800', 'HITCOUNT': '3.240', 'weapon3': '3.318', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '58.000'} [2024-08-06 02:59:26,319][52650] Updated weights for policy 0, policy_version 42321 (0.0011) [2024-08-06 02:59:26,627][52820] DAMAGECOUNT value on done: 335263.0 [2024-08-06 02:59:26,631][52820] Sum rewards: 78.213, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.834', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.074', 'AMMO4': '0.179', 'weapon5': '0.214', 'AMMO3': '0.246', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '66.000'} [2024-08-06 02:59:26,770][52663] DAMAGECOUNT value on done: 355426.0 [2024-08-06 02:59:26,771][52663] Sum rewards: 64.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.853', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.134', 'weapon4': '0.154', 'AMMO4': '0.185', 'AMMO3': '0.255', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.212', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '54.000'} [2024-08-06 02:59:27,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 346726400. Throughput: 0: 4366.4. Samples: 86687500. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 02:59:27,794][52567] Avg episode reward: [(0, '67.345')] [2024-08-06 02:59:28,154][52667] DAMAGECOUNT value on done: 366172.0 [2024-08-06 02:59:28,154][52667] Sum rewards: 69.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.054', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.410', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 02:59:29,377][52665] DAMAGECOUNT value on done: 353818.0 [2024-08-06 02:59:29,377][52665] Sum rewards: 62.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.124', 'AMMO4': '0.205', 'AMMO3': '0.243', 'weapon4': '0.314', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '2.912', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:29,710][52820] DAMAGECOUNT value on done: 332453.0 [2024-08-06 02:59:29,710][52820] Sum rewards: 74.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.190', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '61.000'} [2024-08-06 02:59:30,681][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 02:59:30,695][52650] Updated weights for policy 0, policy_version 42331 (0.0018) [2024-08-06 02:59:30,909][52667] DAMAGECOUNT value on done: 361143.0 [2024-08-06 02:59:30,911][52667] Sum rewards: 60.739, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.031', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.103', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2024-08-06 02:59:32,005][52665] DAMAGECOUNT value on done: 363516.0 [2024-08-06 02:59:32,005][52665] Sum rewards: 83.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.070', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '70.000'} [2024-08-06 02:59:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 346808320. Throughput: 0: 4373.1. Samples: 86700780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 02:59:32,794][52567] Avg episode reward: [(0, '67.530')] [2024-08-06 02:59:32,868][52662] DAMAGECOUNT value on done: 371044.0 [2024-08-06 02:59:32,868][52662] Sum rewards: 70.899, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.712', 'AMMO5': '0.017', 'weapon5': '0.052', 'AMMO2': '0.062', 'weapon2': '0.270', 'AMMO3': '0.278', 'AMMO4': '0.311', 'WEAPON5': '0.350', 'weapon4': '0.648', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.710', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '64.000'} [2024-08-06 02:59:32,976][52820] DAMAGECOUNT value on done: 335066.0 [2024-08-06 02:59:32,976][52820] Sum rewards: 72.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.469', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.232', 'weapon2': '0.244', 'weapon4': '0.244', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '62.000'} [2024-08-06 02:59:33,970][52667] DAMAGECOUNT value on done: 360727.0 [2024-08-06 02:59:33,970][52667] Sum rewards: 69.027, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'HEALTH': '0.023', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.120', 'AMMO3': '0.149', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '0.900', 'HITCOUNT': '2.810', 'weapon3': '3.260', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:35,237][52665] DAMAGECOUNT value on done: 361275.0 [2024-08-06 02:59:35,238][52665] Sum rewards: 81.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.350', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.167', 'AMMO3': '0.229', 'weapon2': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.438', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '68.000'} [2024-08-06 02:59:35,767][52650] Updated weights for policy 0, policy_version 42341 (0.0020) [2024-08-06 02:59:35,917][52662] DAMAGECOUNT value on done: 365881.0 [2024-08-06 02:59:35,917][52662] Sum rewards: 57.957, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.945', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.100', 'AMMO4': '0.163', 'weapon2': '0.178', 'weapon4': '0.198', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.318', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '50.000'} [2024-08-06 02:59:36,233][52820] DAMAGECOUNT value on done: 339448.0 [2024-08-06 02:59:36,235][52820] Sum rewards: 71.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.370', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.224', 'AMMO3': '0.293', 'WEAPON3': '1.900', 'HITCOUNT': '3.390', 'weapon3': '3.512', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '64.000'} [2024-08-06 02:59:36,682][52667] DAMAGECOUNT value on done: 368831.0 [2024-08-06 02:59:36,682][52667] Sum rewards: 69.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.082', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.276', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.386', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '59.000'} [2024-08-06 02:59:37,794][52567] Fps is (10 sec: 15564.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 346882048. Throughput: 0: 4365.3. Samples: 86726660. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 02:59:37,795][52567] Avg episode reward: [(0, '67.952')] [2024-08-06 02:59:37,993][52665] DAMAGECOUNT value on done: 354954.0 [2024-08-06 02:59:37,996][52665] Sum rewards: 73.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.842', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.126', 'AMMO4': '0.179', 'weapon5': '0.186', 'AMMO3': '0.193', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:39,014][52662] DAMAGECOUNT value on done: 366324.0 [2024-08-06 02:59:39,016][52662] Sum rewards: 65.316, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.749', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.112', 'AMMO4': '0.173', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.278', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '57.000'} [2024-08-06 02:59:39,211][52820] DAMAGECOUNT value on done: 335278.0 [2024-08-06 02:59:39,213][52820] Sum rewards: 70.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.964', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.118', 'weapon2': '0.196', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.400', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '59.000'} [2024-08-06 02:59:39,774][52667] DAMAGECOUNT value on done: 359533.0 [2024-08-06 02:59:39,777][52667] Sum rewards: 72.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.054', 'weapon4': '0.086', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.232', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:40,798][52650] Updated weights for policy 0, policy_version 42351 (0.0023) [2024-08-06 02:59:41,054][52665] DAMAGECOUNT value on done: 350337.0 [2024-08-06 02:59:41,057][52665] Sum rewards: 72.099, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.585', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.156', 'weapon4': '0.184', 'AMMO4': '0.216', 'AMMO3': '0.239', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '63.000'} [2024-08-06 02:59:42,183][52662] DAMAGECOUNT value on done: 355137.0 [2024-08-06 02:59:42,184][52662] Sum rewards: 69.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.096', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.126', 'weapon4': '0.214', 'AMMO4': '0.220', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.026', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:42,378][52820] DAMAGECOUNT value on done: 338822.0 [2024-08-06 02:59:42,379][52820] Sum rewards: 74.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.592', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.167', 'weapon2': '0.358', 'WEAPON3': '1.000', 'weapon3': '3.374', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '61.000'} [2024-08-06 02:59:42,442][52667] DAMAGECOUNT value on done: 363132.0 [2024-08-06 02:59:42,444][52667] Sum rewards: 57.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.764', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.104', 'weapon4': '0.112', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.402', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '47.000'} [2024-08-06 02:59:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 346980352. Throughput: 0: 4371.8. Samples: 86753130. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 02:59:42,794][52567] Avg episode reward: [(0, '68.084')] [2024-08-06 02:59:43,531][52665] DAMAGECOUNT value on done: 351230.0 [2024-08-06 02:59:43,531][52665] Sum rewards: 61.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.074', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.112', 'AMMO3': '0.191', 'AMMO4': '0.212', 'weapon2': '0.224', 'weapon5': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.114', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '49.000'} [2024-08-06 02:59:43,810][52668] DAMAGECOUNT value on done: 357729.0 [2024-08-06 02:59:43,810][52668] Sum rewards: 61.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.706', 'AMMO5': '0.015', 'AMMO2': '0.068', 'AMMO3': '0.175', 'weapon5': '0.274', 'weapon4': '0.280', 'AMMO4': '0.341', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.564', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '51.000'} [2024-08-06 02:59:45,026][52650] Updated weights for policy 0, policy_version 42361 (0.0012) [2024-08-06 02:59:45,304][52662] DAMAGECOUNT value on done: 366409.0 [2024-08-06 02:59:45,305][52662] Sum rewards: 73.232, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.939', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.079', 'weapon4': '0.152', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON3': '1.100', 'weapon3': '3.378', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '59.000'} [2024-08-06 02:59:45,433][52820] DAMAGECOUNT value on done: 334317.0 [2024-08-06 02:59:45,434][52820] Sum rewards: 70.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.173', 'AMMO3': '0.206', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '57.000'} [2024-08-06 02:59:45,603][52667] DAMAGECOUNT value on done: 363740.0 [2024-08-06 02:59:45,603][52667] Sum rewards: 78.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.551', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.174', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '62.000'} [2024-08-06 02:59:46,482][52665] DAMAGECOUNT value on done: 358169.0 [2024-08-06 02:59:46,490][52665] Sum rewards: 61.763, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.406', 'AMMO5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.356', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.332', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '51.000'} [2024-08-06 02:59:46,552][52668] DAMAGECOUNT value on done: 363403.0 [2024-08-06 02:59:46,553][52668] Sum rewards: 65.789, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.890', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.082', 'weapon5': '0.114', 'weapon2': '0.214', 'AMMO4': '0.272', 'AMMO3': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'HITCOUNT': '3.110', 'weapon3': '3.324', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '61.000'} [2024-08-06 02:59:47,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 347062272. Throughput: 0: 4367.3. Samples: 86766290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 02:59:47,794][52567] Avg episode reward: [(0, '67.772')] [2024-08-06 02:59:48,012][52614] Signal inference workers to stop experience collection... (7650 times) [2024-08-06 02:59:48,017][52614] Signal inference workers to resume experience collection... (7650 times) [2024-08-06 02:59:48,056][52650] InferenceWorker_p0-w0: stopping experience collection (7650 times) [2024-08-06 02:59:48,059][52650] InferenceWorker_p0-w0: resuming experience collection (7650 times) [2024-08-06 02:59:48,508][52662] DAMAGECOUNT value on done: 359742.0 [2024-08-06 02:59:48,508][52662] Sum rewards: 75.462, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.854', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO4': '0.196', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.348', 'weapon4': '0.402', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.820', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '66.000'} [2024-08-06 02:59:48,668][52667] DAMAGECOUNT value on done: 357789.0 [2024-08-06 02:59:48,668][52667] Sum rewards: 57.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.140', 'weapon4': '0.152', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON3': '1.650', 'HITCOUNT': '2.820', 'weapon3': '3.232', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '51.000'} [2024-08-06 02:59:48,698][52820] DAMAGECOUNT value on done: 334144.0 [2024-08-06 02:59:48,700][52820] Sum rewards: 61.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.084', 'AMMO4': '0.151', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.288', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '53.000'} [2024-08-06 02:59:49,446][52665] DAMAGECOUNT value on done: 361628.0 [2024-08-06 02:59:49,447][52665] Sum rewards: 65.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.118', 'weapon2': '0.180', 'AMMO3': '0.222', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.364', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:49,505][52668] DAMAGECOUNT value on done: 365682.0 [2024-08-06 02:59:49,506][52668] Sum rewards: 75.849, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.140', 'AMMO4': '0.186', 'weapon2': '0.240', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.230', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '65.000'} [2024-08-06 02:59:49,746][52650] Updated weights for policy 0, policy_version 42371 (0.0015) [2024-08-06 02:59:51,120][52667] DAMAGECOUNT value on done: 365516.0 [2024-08-06 02:59:51,121][52667] Sum rewards: 68.869, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.420', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.120', 'weapon5': '0.134', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '58.000'} [2024-08-06 02:59:51,372][52669] DAMAGECOUNT value on done: 364742.0 [2024-08-06 02:59:51,372][52669] Sum rewards: 59.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.112', 'weapon5': '0.128', 'AMMO4': '0.203', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '50.000'} [2024-08-06 02:59:51,760][52662] DAMAGECOUNT value on done: 368670.0 [2024-08-06 02:59:51,760][52662] Sum rewards: 65.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.765', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.114', 'AMMO4': '0.177', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '57.000'} [2024-08-06 02:59:51,983][52820] DAMAGECOUNT value on done: 341373.0 [2024-08-06 02:59:51,983][52820] Sum rewards: 56.135, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.439', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.301', 'WEAPON3': '1.750', 'HITCOUNT': '3.080', 'weapon3': '3.304', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '52.000'} [2024-08-06 02:59:52,114][52668] DAMAGECOUNT value on done: 366187.0 [2024-08-06 02:59:52,116][52668] Sum rewards: 67.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.049', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.328', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '56.500'} [2024-08-06 02:59:52,387][52665] DAMAGECOUNT value on done: 360839.0 [2024-08-06 02:59:52,387][52665] Sum rewards: 61.371, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.784', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.132', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '52.000'} [2024-08-06 02:59:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 347152384. Throughput: 0: 4364.2. Samples: 86792470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:59:52,794][52567] Avg episode reward: [(0, '67.813')] [2024-08-06 02:59:53,557][52649] DAMAGECOUNT value on done: 354251.0 [2024-08-06 02:59:53,557][52649] Sum rewards: 66.844, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.368', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.046', 'AMMO3': '0.171', 'weapon4': '0.176', 'AMMO4': '0.232', 'weapon5': '0.250', 'WEAPON4': '0.500', 'weapon2': '0.506', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '52.500'} [2024-08-06 02:59:54,144][52667] DAMAGECOUNT value on done: 371307.0 [2024-08-06 02:59:54,145][52667] Sum rewards: 72.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.797', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.142', 'AMMO3': '0.200', 'AMMO4': '0.230', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '60.000'} [2024-08-06 02:59:54,379][52650] Updated weights for policy 0, policy_version 42381 (0.0021) [2024-08-06 02:59:54,539][52669] DAMAGECOUNT value on done: 357071.0 [2024-08-06 02:59:54,541][52669] Sum rewards: 70.113, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.354', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.069', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.276', 'AMMO3': '0.287', 'WEAPON3': '1.800', 'weapon3': '3.274', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '62.000'} [2024-08-06 02:59:54,565][52662] DAMAGECOUNT value on done: 371605.0 [2024-08-06 02:59:54,569][52662] Sum rewards: 72.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO3': '0.178', 'AMMO4': '0.207', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '59.000'} [2024-08-06 02:59:54,874][52668] DAMAGECOUNT value on done: 357529.0 [2024-08-06 02:59:54,876][52668] Sum rewards: 62.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.625', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.134', 'weapon4': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.000', 'weapon3': '3.032', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '51.000'} [2024-08-06 02:59:55,075][52665] DAMAGECOUNT value on done: 358092.0 [2024-08-06 02:59:55,076][52665] Sum rewards: 77.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.243', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '67.000'} [2024-08-06 02:59:55,266][52820] DAMAGECOUNT value on done: 343648.0 [2024-08-06 02:59:55,266][52820] Sum rewards: 65.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.384', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '53.000'} [2024-08-06 02:59:56,154][52649] DAMAGECOUNT value on done: 346731.0 [2024-08-06 02:59:56,154][52649] Sum rewards: 69.148, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.912', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.006', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.176', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:57,005][52667] DAMAGECOUNT value on done: 370925.0 [2024-08-06 02:59:57,005][52667] Sum rewards: 80.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.486', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon2': '0.134', 'AMMO3': '0.213', 'WEAPON3': '1.400', 'weapon3': '3.652', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '67.000'} [2024-08-06 02:59:57,249][52668] DAMAGECOUNT value on done: 365545.0 [2024-08-06 02:59:57,249][52668] Sum rewards: 69.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.806', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.226', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '58.000'} [2024-08-06 02:59:57,334][52662] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.027, -9.0), ('weapon5', 0.002)] [2024-08-06 02:59:57,475][52669] DAMAGECOUNT value on done: 365838.0 [2024-08-06 02:59:57,477][52669] Sum rewards: 64.757, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.030', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.257', 'weapon4': '0.278', 'AMMO4': '0.300', 'weapon5': '0.328', 'weapon2': '0.360', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.686', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '56.000'} [2024-08-06 02:59:57,646][52665] DAMAGECOUNT value on done: 364682.0 [2024-08-06 02:59:57,646][52665] Sum rewards: 70.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.386', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.204', 'AMMO3': '0.234', 'weapon5': '0.270', 'AMMO4': '0.275', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '57.000'} [2024-08-06 02:59:57,780][52662] DAMAGECOUNT value on done: 362620.0 [2024-08-06 02:59:57,782][52662] Sum rewards: 68.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.858', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.177', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '3.112', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '58.000'} [2024-08-06 02:59:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 347242496. Throughput: 0: 4364.9. Samples: 86818610. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 02:59:57,794][52567] Avg episode reward: [(0, '68.383')] [2024-08-06 02:59:58,639][52820] DAMAGECOUNT value on done: 334312.0 [2024-08-06 02:59:58,639][52820] Sum rewards: 75.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.564', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.178', 'weapon5': '0.184', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.356', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '63.000'} [2024-08-06 02:59:58,667][52649] DAMAGECOUNT value on done: 353038.0 [2024-08-06 02:59:58,668][52649] Sum rewards: 64.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.585', 'AMMO5': '0.021', 'AMMO2': '0.063', 'weapon5': '0.106', 'AMMO3': '0.194', 'AMMO4': '0.314', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '55.000'} [2024-08-06 02:59:59,235][52650] Updated weights for policy 0, policy_version 42391 (0.0011) [2024-08-06 02:59:59,837][52665] DAMAGECOUNT value on done: 358910.0 [2024-08-06 02:59:59,839][52665] Sum rewards: 69.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.118', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.070', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.346', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.350', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '57.000'} [2024-08-06 02:59:59,918][52667] DAMAGECOUNT value on done: 368725.0 [2024-08-06 02:59:59,920][52667] Sum rewards: 63.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.935', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon4': '0.190', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:00,159][52662] DAMAGECOUNT value on done: 374460.0 [2024-08-06 03:00:00,160][52662] Sum rewards: 68.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.172', 'weapon2': '0.778', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:00,355][52669] DAMAGECOUNT value on done: 359829.0 [2024-08-06 03:00:00,355][52669] Sum rewards: 59.394, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.831', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.180', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.274', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '2.942', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '48.000'} [2024-08-06 03:00:00,541][52668] DAMAGECOUNT value on done: 364254.0 [2024-08-06 03:00:00,542][52668] Sum rewards: 72.134, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.895', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.070', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.262', 'AMMO4': '0.312', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '62.000'} [2024-08-06 03:00:00,974][52649] DAMAGECOUNT value on done: 350366.0 [2024-08-06 03:00:00,974][52649] Sum rewards: 61.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.860', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.172', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:01,869][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:00:02,108][52665] DAMAGECOUNT value on done: 355735.0 [2024-08-06 03:00:02,109][52665] Sum rewards: 57.148, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.402', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon5': '0.202', 'weapon4': '0.220', 'AMMO4': '0.240', 'AMMO3': '0.261', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.930', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '52.000'} [2024-08-06 03:00:02,715][52660] DAMAGECOUNT value on done: 358941.0 [2024-08-06 03:00:02,715][52660] Sum rewards: 70.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon4': '0.152', 'weapon5': '0.154', 'AMMO3': '0.204', 'AMMO4': '0.254', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 347332608. Throughput: 0: 4373.6. Samples: 86832030. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:00:02,794][52567] Avg episode reward: [(0, '68.224')] [2024-08-06 03:00:03,019][52662] DAMAGECOUNT value on done: 360424.0 [2024-08-06 03:00:03,020][52662] Sum rewards: 69.516, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.070', 'AMMO4': '0.105', 'weapon4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '60.000'} [2024-08-06 03:00:03,067][52667] DAMAGECOUNT value on done: 360421.0 [2024-08-06 03:00:03,068][52667] Sum rewards: 56.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'AMMO2': '0.036', 'weapon5': '0.074', 'weapon4': '0.134', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '48.000'} [2024-08-06 03:00:03,223][52669] DAMAGECOUNT value on done: 360510.0 [2024-08-06 03:00:03,225][52669] Sum rewards: 56.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.407', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.116', 'AMMO4': '0.120', 'weapon5': '0.182', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.162', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '49.000'} [2024-08-06 03:00:03,686][52649] DAMAGECOUNT value on done: 344513.0 [2024-08-06 03:00:03,687][52649] Sum rewards: 70.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.195', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.098', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:03,702][52668] DAMAGECOUNT value on done: 358562.0 [2024-08-06 03:00:03,702][52668] Sum rewards: 81.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.252', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO3': '0.205', 'weapon2': '0.210', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '69.000'} [2024-08-06 03:00:03,766][52650] Updated weights for policy 0, policy_version 42401 (0.0013) [2024-08-06 03:00:03,947][52658] DAMAGECOUNT value on done: 360954.0 [2024-08-06 03:00:03,950][52658] Sum rewards: 64.490, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.671', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.080', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.264', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'HITCOUNT': '3.260', 'weapon3': '3.282', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:05,015][52665] DAMAGECOUNT value on done: 355948.0 [2024-08-06 03:00:05,016][52665] Sum rewards: 58.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.152', 'AMMO4': '0.158', 'AMMO3': '0.175', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '47.500'} [2024-08-06 03:00:05,837][52660] DAMAGECOUNT value on done: 356149.0 [2024-08-06 03:00:05,838][52660] Sum rewards: 76.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.882', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon5': '0.080', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.215', 'weapon2': '0.234', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '64.000'} [2024-08-06 03:00:05,890][52662] DAMAGECOUNT value on done: 363325.0 [2024-08-06 03:00:05,891][52662] Sum rewards: 65.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.159', 'weapon4': '0.218', 'weapon2': '0.476', 'WEAPON3': '0.950', 'weapon3': '3.112', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '52.000'} [2024-08-06 03:00:05,906][52669] DAMAGECOUNT value on done: 362142.0 [2024-08-06 03:00:05,906][52669] Sum rewards: 73.282, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.369', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.082', 'weapon4': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 03:00:06,337][52667] DAMAGECOUNT value on done: 367936.0 [2024-08-06 03:00:06,338][52667] Sum rewards: 61.336, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.938', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.110', 'AMMO4': '0.203', 'AMMO3': '0.247', 'weapon5': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '2.972', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:06,390][52649] DAMAGECOUNT value on done: 355155.0 [2024-08-06 03:00:06,390][52649] Sum rewards: 67.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.998', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon2': '0.158', 'weapon5': '0.182', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:06,572][52668] DAMAGECOUNT value on done: 360690.0 [2024-08-06 03:00:06,572][52668] Sum rewards: 73.213, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.868', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.108', 'AMMO3': '0.144', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.388', 'weapon2': '0.468', 'WEAPON3': '0.950', 'weapon3': '2.830', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:06,943][52658] DAMAGECOUNT value on done: 361740.0 [2024-08-06 03:00:06,944][52658] Sum rewards: 65.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.445', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.054', 'AMMO4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.364', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 347414528. Throughput: 0: 4375.1. Samples: 86858280. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:00:07,794][52567] Avg episode reward: [(0, '67.981')] [2024-08-06 03:00:08,035][52665] DAMAGECOUNT value on done: 360127.0 [2024-08-06 03:00:08,037][52665] Sum rewards: 74.989, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.672', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.124', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'weapon3': '3.260', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '65.000'} [2024-08-06 03:00:08,291][52650] Updated weights for policy 0, policy_version 42411 (0.0022) [2024-08-06 03:00:08,522][52662] DAMAGECOUNT value on done: 366636.0 [2024-08-06 03:00:08,524][52662] Sum rewards: 79.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.084', 'AMMO5': '0.018', 'weapon5': '0.042', 'AMMO2': '0.046', 'weapon4': '0.114', 'AMMO3': '0.198', 'AMMO4': '0.229', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '66.000'} [2024-08-06 03:00:08,598][52660] DAMAGECOUNT value on done: 367162.0 [2024-08-06 03:00:08,599][52660] Sum rewards: 69.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.019', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.127', 'weapon4': '0.158', 'AMMO3': '0.191', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:08,652][52669] DAMAGECOUNT value on done: 363073.0 [2024-08-06 03:00:08,657][52669] Sum rewards: 57.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.660', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'AMMO4': '0.266', 'weapon4': '0.318', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '47.000'} [2024-08-06 03:00:09,693][52668] DAMAGECOUNT value on done: 363707.0 [2024-08-06 03:00:09,694][52668] Sum rewards: 70.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.140', 'weapon4': '0.180', 'AMMO4': '0.201', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:09,793][52649] DAMAGECOUNT value on done: 350076.0 [2024-08-06 03:00:09,796][52649] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.492', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.106', 'AMMO4': '0.153', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '50.000'} [2024-08-06 03:00:09,871][52658] DAMAGECOUNT value on done: 367530.0 [2024-08-06 03:00:09,875][52658] Sum rewards: 73.469, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.722', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.175', 'weapon5': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:10,930][52665] DAMAGECOUNT value on done: 355939.0 [2024-08-06 03:00:10,930][52665] Sum rewards: 68.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.064', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.143', 'AMMO3': '0.184', 'weapon5': '0.198', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.254', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:11,320][52662] DAMAGECOUNT value on done: 370481.0 [2024-08-06 03:00:11,321][52662] Sum rewards: 65.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.554', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.050', 'weapon5': '0.082', 'AMMO4': '0.102', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.798', 'WEAPON3': '1.000', 'weapon3': '2.932', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:11,337][52669] DAMAGECOUNT value on done: 363786.0 [2024-08-06 03:00:11,337][52669] Sum rewards: 69.130, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.184', 'AMMO3': '0.213', 'weapon4': '0.220', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:11,505][52660] DAMAGECOUNT value on done: 367660.0 [2024-08-06 03:00:11,506][52660] Sum rewards: 78.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.265', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '64.000'} [2024-08-06 03:00:12,238][52668] DAMAGECOUNT value on done: 363314.0 [2024-08-06 03:00:12,238][52668] Sum rewards: 67.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.834', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.044', 'AMMO4': '0.134', 'weapon5': '0.174', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:12,686][52649] DAMAGECOUNT value on done: 357549.0 [2024-08-06 03:00:12,687][52649] Sum rewards: 72.917, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.297', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.158', 'weapon5': '0.186', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:12,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 347504640. Throughput: 0: 4380.6. Samples: 86884630. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:00:12,802][52567] Avg episode reward: [(0, '67.967')] [2024-08-06 03:00:13,185][52650] Updated weights for policy 0, policy_version 42421 (0.0060) [2024-08-06 03:00:13,192][52658] DAMAGECOUNT value on done: 364823.0 [2024-08-06 03:00:13,192][52658] Sum rewards: 56.627, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.074', 'weapon4': '0.122', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.264', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.278', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '51.000'} [2024-08-06 03:00:13,396][52794] DAMAGECOUNT value on done: 365959.0 [2024-08-06 03:00:13,397][52794] Sum rewards: 81.465, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.132', 'weapon4': '0.166', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '70.000'} [2024-08-06 03:00:13,805][52662] DAMAGECOUNT value on done: 362556.0 [2024-08-06 03:00:13,805][52662] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.020', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.132', 'AMMO3': '0.200', 'weapon5': '0.210', 'AMMO4': '0.259', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:14,043][52665] DAMAGECOUNT value on done: 353275.0 [2024-08-06 03:00:14,043][52665] Sum rewards: 61.717, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.550', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.134', 'AMMO4': '0.198', 'AMMO3': '0.230', 'weapon5': '0.236', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.056', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:14,130][52660] DAMAGECOUNT value on done: 360204.0 [2024-08-06 03:00:14,130][52660] Sum rewards: 64.604, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.200', 'weapon4': '0.212', 'weapon5': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'HEALTH': '0.907', 'WEAPON3': '1.000', 'weapon3': '2.800', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:14,160][52669] DAMAGECOUNT value on done: 364350.0 [2024-08-06 03:00:14,160][52669] Sum rewards: 57.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.073', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.230', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '49.000'} [2024-08-06 03:00:14,183][52803] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:00:15,017][52668] DAMAGECOUNT value on done: 359149.0 [2024-08-06 03:00:15,019][52668] Sum rewards: 73.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.086', 'weapon4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:15,925][52649] DAMAGECOUNT value on done: 355657.0 [2024-08-06 03:00:15,925][52649] Sum rewards: 71.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.325', 'AMMO5': '0.008', 'weapon5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.239', 'WEAPON3': '1.500', 'weapon3': '3.554', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '62.000'} [2024-08-06 03:00:16,154][52794] DAMAGECOUNT value on done: 368489.0 [2024-08-06 03:00:16,159][52794] Sum rewards: 71.963, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.960', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.692', 'WEAPON3': '0.900', 'weapon3': '2.936', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '56.000'} [2024-08-06 03:00:16,277][52658] DAMAGECOUNT value on done: 359207.0 [2024-08-06 03:00:16,278][52658] Sum rewards: 59.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.190', 'AMMO3': '0.236', 'weapon5': '0.262', 'AMMO4': '0.292', 'weapon2': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.838', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '52.000'} [2024-08-06 03:00:16,644][52662] DAMAGECOUNT value on done: 374491.0 [2024-08-06 03:00:16,646][52662] Sum rewards: 78.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.214', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '63.000'} [2024-08-06 03:00:16,887][52660] DAMAGECOUNT value on done: 358171.0 [2024-08-06 03:00:16,889][52660] Sum rewards: 72.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.805', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.021', 'weapon4': '0.082', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.440', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '60.500'} [2024-08-06 03:00:17,157][52665] DAMAGECOUNT value on done: 353703.0 [2024-08-06 03:00:17,157][52665] Sum rewards: 71.347, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.170', 'AMMO3': '0.178', 'weapon4': '0.206', 'HEALTH': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.000', 'weapon3': '2.960', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '56.000'} [2024-08-06 03:00:17,222][52669] DAMAGECOUNT value on done: 362582.0 [2024-08-06 03:00:17,223][52669] Sum rewards: 70.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.398', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.111', 'AMMO3': '0.135', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.050', 'weapon3': '3.196', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:17,678][52650] Updated weights for policy 0, policy_version 42431 (0.0012) [2024-08-06 03:00:17,739][52668] DAMAGECOUNT value on done: 354533.0 [2024-08-06 03:00:17,739][52668] Sum rewards: 66.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.078', 'weapon5': '0.194', 'AMMO4': '0.198', 'weapon2': '0.210', 'AMMO3': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.224', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '56.000'} [2024-08-06 03:00:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 347594752. Throughput: 0: 4380.7. Samples: 86897910. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:00:17,794][52567] Avg episode reward: [(0, '68.225')] [2024-08-06 03:00:18,901][52649] DAMAGECOUNT value on done: 352780.0 [2024-08-06 03:00:18,902][52649] Sum rewards: 67.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.063', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.078', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.224', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.396', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:19,096][52794] DAMAGECOUNT value on done: 365038.0 [2024-08-06 03:00:19,097][52794] Sum rewards: 73.945, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.170', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO3': '0.151', 'weapon4': '0.160', 'AMMO4': '0.188', 'weapon5': '0.218', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:19,302][52658] DAMAGECOUNT value on done: 362177.0 [2024-08-06 03:00:19,302][52658] Sum rewards: 71.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.174', 'AMMO3': '0.218', 'weapon4': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.744', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 03:00:19,524][52662] DAMAGECOUNT value on done: 366278.0 [2024-08-06 03:00:19,525][52662] Sum rewards: 58.394, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.509', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.060', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'weapon2': '0.812', 'WEAPON3': '0.900', 'HITCOUNT': '2.710', 'weapon3': '2.894', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '46.000'} [2024-08-06 03:00:19,848][52660] DAMAGECOUNT value on done: 362814.0 [2024-08-06 03:00:19,848][52660] Sum rewards: 64.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.565', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.097', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.352', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '56.000'} [2024-08-06 03:00:19,903][52669] DAMAGECOUNT value on done: 368270.0 [2024-08-06 03:00:19,906][52669] Sum rewards: 68.151, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.800', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.108', 'WEAPON4': '0.150', 'weapon2': '0.188', 'AMMO3': '0.278', 'WEAPON3': '1.750', 'weapon3': '3.436', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:20,200][52665] DAMAGECOUNT value on done: 358507.0 [2024-08-06 03:00:20,200][52665] Sum rewards: 76.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.075', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.038', 'weapon4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.390', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '63.000'} [2024-08-06 03:00:20,727][52671] DAMAGECOUNT value on done: 367692.0 [2024-08-06 03:00:20,728][52671] Sum rewards: 64.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.122', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:20,994][52668] DAMAGECOUNT value on done: 354741.0 [2024-08-06 03:00:20,995][52668] Sum rewards: 60.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.072', 'weapon5': '0.090', 'AMMO4': '0.103', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.281', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.192', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '52.000'} [2024-08-06 03:00:22,078][52794] DAMAGECOUNT value on done: 361696.0 [2024-08-06 03:00:22,079][52794] Sum rewards: 60.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.092', 'AMMO3': '0.156', 'weapon4': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.348', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '49.000'} [2024-08-06 03:00:22,120][52649] DAMAGECOUNT value on done: 356569.0 [2024-08-06 03:00:22,120][52649] Sum rewards: 69.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.461', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.118', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.320', 'weapon3': '3.386', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:22,229][52650] Updated weights for policy 0, policy_version 42441 (0.0028) [2024-08-06 03:00:22,285][52658] DAMAGECOUNT value on done: 365279.0 [2024-08-06 03:00:22,286][52658] Sum rewards: 69.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.234', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.141', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon4': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:22,364][52662] DAMAGECOUNT value on done: 366043.0 [2024-08-06 03:00:22,365][52662] Sum rewards: 67.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.132', 'AMMO4': '0.151', 'weapon5': '0.172', 'AMMO3': '0.236', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.118', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 347684864. Throughput: 0: 4385.4. Samples: 86924000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:00:22,794][52567] Avg episode reward: [(0, '67.762')] [2024-08-06 03:00:22,849][52669] DAMAGECOUNT value on done: 362694.0 [2024-08-06 03:00:22,852][52669] Sum rewards: 76.731, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.504', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO3': '0.116', 'AMMO4': '0.134', 'weapon5': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.374', 'weapon4': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon3': '2.610', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:23,061][52660] DAMAGECOUNT value on done: 370152.0 [2024-08-06 03:00:23,062][52660] Sum rewards: 65.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.134', 'weapon5': '0.184', 'AMMO3': '0.224', 'AMMO4': '0.225', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.142', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:23,402][52665] DAMAGECOUNT value on done: 359844.0 [2024-08-06 03:00:23,402][52665] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.914', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.164', 'AMMO4': '0.203', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '60.000'} [2024-08-06 03:00:23,550][52664] DAMAGECOUNT value on done: 375740.0 [2024-08-06 03:00:23,550][52664] Sum rewards: 75.242, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.142', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '60.000'} [2024-08-06 03:00:23,800][52671] DAMAGECOUNT value on done: 364846.0 [2024-08-06 03:00:23,804][52671] Sum rewards: 69.945, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.056', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.108', 'weapon4': '0.130', 'AMMO4': '0.233', 'AMMO3': '0.281', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.500'} [2024-08-06 03:00:24,240][52668] DAMAGECOUNT value on done: 355751.0 [2024-08-06 03:00:24,241][52668] Sum rewards: 77.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.894', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.118', 'weapon5': '0.154', 'AMMO4': '0.222', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '65.000'} [2024-08-06 03:00:24,267][52794] DAMAGECOUNT value on done: 359949.0 [2024-08-06 03:00:24,267][52794] Sum rewards: 68.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.221', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:24,697][52662] DAMAGECOUNT value on done: 361000.0 [2024-08-06 03:00:24,701][52662] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.406', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:24,959][52658] DAMAGECOUNT value on done: 356585.0 [2024-08-06 03:00:24,960][52658] Sum rewards: 61.289, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.264', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.304', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '52.000'} [2024-08-06 03:00:25,126][52649] DAMAGECOUNT value on done: 358279.0 [2024-08-06 03:00:25,126][52649] Sum rewards: 63.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.460', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.118', 'weapon5': '0.118', 'AMMO4': '0.163', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:25,708][52669] DAMAGECOUNT value on done: 359671.0 [2024-08-06 03:00:25,709][52669] Sum rewards: 63.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'weapon5': '0.154', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.290', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:26,107][52660] DAMAGECOUNT value on done: 366545.0 [2024-08-06 03:00:26,107][52660] Sum rewards: 73.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.146', 'AMMO3': '0.189', 'weapon5': '0.232', 'AMMO4': '0.288', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:26,167][52664] DAMAGECOUNT value on done: 378525.0 [2024-08-06 03:00:26,170][52664] Sum rewards: 74.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.074', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.220', 'weapon5': '0.234', 'weapon2': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '2.990', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '64.000'} [2024-08-06 03:00:26,826][52671] DAMAGECOUNT value on done: 364194.0 [2024-08-06 03:00:26,828][52671] Sum rewards: 72.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.070', 'AMMO4': '0.104', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '60.000'} [2024-08-06 03:00:26,855][52668] DAMAGECOUNT value on done: 359117.0 [2024-08-06 03:00:26,857][52668] Sum rewards: 68.113, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.129', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:27,207][52650] Updated weights for policy 0, policy_version 42451 (0.0012) [2024-08-06 03:00:27,331][52794] DAMAGECOUNT value on done: 365927.0 [2024-08-06 03:00:27,334][52794] Sum rewards: 80.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '67.000'} [2024-08-06 03:00:27,679][52662] DAMAGECOUNT value on done: 359955.0 [2024-08-06 03:00:27,680][52662] Sum rewards: 72.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.685', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.195', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 347774976. Throughput: 0: 4377.8. Samples: 86950130. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:00:27,794][52567] Avg episode reward: [(0, '68.241')] [2024-08-06 03:00:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042453_347774976.pth... [2024-08-06 03:00:27,883][52658] DAMAGECOUNT value on done: 371751.0 [2024-08-06 03:00:27,883][52658] Sum rewards: 71.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.998', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.124', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:27,919][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000041939_343564288.pth [2024-08-06 03:00:28,197][52649] DAMAGECOUNT value on done: 359081.0 [2024-08-06 03:00:28,198][52649] Sum rewards: 79.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.687', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.184', 'AMMO4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.264', 'weapon4': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.910', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '69.000'} [2024-08-06 03:00:28,889][52660] DAMAGECOUNT value on done: 361088.0 [2024-08-06 03:00:28,891][52660] Sum rewards: 58.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.076', 'AMMO5': '0.013', 'AMMO2': '0.073', 'AMMO3': '0.207', 'weapon4': '0.210', 'weapon2': '0.222', 'weapon5': '0.258', 'AMMO4': '0.364', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '50.000'} [2024-08-06 03:00:28,897][52669] DAMAGECOUNT value on done: 365407.0 [2024-08-06 03:00:28,897][52669] Sum rewards: 72.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.494', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.145', 'weapon2': '0.162', 'AMMO3': '0.192', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:28,903][52664] DAMAGECOUNT value on done: 380181.0 [2024-08-06 03:00:28,904][52664] Sum rewards: 66.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.389', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.178', 'AMMO3': '0.233', 'weapon2': '0.234', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:29,654][52668] DAMAGECOUNT value on done: 363475.0 [2024-08-06 03:00:29,656][52668] Sum rewards: 72.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO4': '0.196', 'AMMO3': '0.210', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '62.000'} [2024-08-06 03:00:29,938][52671] DAMAGECOUNT value on done: 364397.0 [2024-08-06 03:00:29,939][52671] Sum rewards: 71.487, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.942', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon4': '0.276', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.798', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:30,448][52794] DAMAGECOUNT value on done: 369141.0 [2024-08-06 03:00:30,448][52794] Sum rewards: 60.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.571', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '51.000'} [2024-08-06 03:00:30,605][52658] DAMAGECOUNT value on done: 364097.0 [2024-08-06 03:00:30,606][52658] Sum rewards: 70.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.132', 'weapon5': '0.172', 'AMMO3': '0.262', 'AMMO4': '0.262', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '60.000'} [2024-08-06 03:00:31,139][52649] DAMAGECOUNT value on done: 358225.0 [2024-08-06 03:00:31,143][52649] Sum rewards: 68.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.152', 'weapon5': '0.174', 'AMMO4': '0.199', 'AMMO3': '0.220', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '56.000'} [2024-08-06 03:00:31,322][52660] DAMAGECOUNT value on done: 369528.0 [2024-08-06 03:00:31,323][52660] Sum rewards: 61.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.121', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:31,577][52650] Updated weights for policy 0, policy_version 42461 (0.0023) [2024-08-06 03:00:31,741][52664] DAMAGECOUNT value on done: 375994.0 [2024-08-06 03:00:31,741][52664] Sum rewards: 73.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.828', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.099', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '61.500'} [2024-08-06 03:00:31,955][52669] DAMAGECOUNT value on done: 370620.0 [2024-08-06 03:00:31,956][52669] Sum rewards: 75.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.800', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.102', 'weapon4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 03:00:32,398][52668] DAMAGECOUNT value on done: 363856.0 [2024-08-06 03:00:32,398][52668] Sum rewards: 64.304, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.356', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.092', 'AMMO3': '0.228', 'AMMO4': '0.253', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.692', 'WEAPON3': '1.350', 'weapon3': '2.708', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:32,729][52671] DAMAGECOUNT value on done: 370156.0 [2024-08-06 03:00:32,731][52671] Sum rewards: 62.087, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.072', 'weapon4': '0.098', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.372', 'WEAPON3': '1.650', 'HITCOUNT': '3.100', 'weapon3': '3.212', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 347848704. Throughput: 0: 4372.7. Samples: 86963060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:00:32,794][52567] Avg episode reward: [(0, '68.412')] [2024-08-06 03:00:33,173][52794] DAMAGECOUNT value on done: 359779.0 [2024-08-06 03:00:33,175][52794] Sum rewards: 51.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.285', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.052', 'weapon4': '0.122', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.424', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.144', 'DAMAGECOUNT': '13.935', 'FRAGCOUNT': '46.000'} [2024-08-06 03:00:33,301][52658] DAMAGECOUNT value on done: 372536.0 [2024-08-06 03:00:33,301][52658] Sum rewards: 66.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.229', 'weapon2': '0.310', 'WEAPON3': '1.350', 'HITCOUNT': '3.430', 'weapon3': '3.468', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 03:00:33,931][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:00:34,144][52660] DAMAGECOUNT value on done: 356336.0 [2024-08-06 03:00:34,148][52660] Sum rewards: 51.411, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.006', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '47.000'} [2024-08-06 03:00:34,223][52649] DAMAGECOUNT value on done: 347958.0 [2024-08-06 03:00:34,226][52649] Sum rewards: 67.745, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.180', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon5': '0.224', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '58.500'} [2024-08-06 03:00:34,284][52664] DAMAGECOUNT value on done: 377198.0 [2024-08-06 03:00:34,285][52664] Sum rewards: 72.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.456', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.172', 'AMMO4': '0.183', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon4': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.038', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.000'} [2024-08-06 03:00:34,779][52669] DAMAGECOUNT value on done: 379080.0 [2024-08-06 03:00:34,781][52669] Sum rewards: 63.659, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.116', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.154', 'weapon5': '0.182', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:35,166][52668] DAMAGECOUNT value on done: 364657.0 [2024-08-06 03:00:35,167][52668] Sum rewards: 67.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.905', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.042', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:35,920][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:00:36,111][52671] DAMAGECOUNT value on done: 361463.0 [2024-08-06 03:00:36,112][52671] Sum rewards: 76.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.914', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.158', 'weapon2': '0.160', 'AMMO4': '0.163', 'AMMO3': '0.201', 'weapon4': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '63.000'} [2024-08-06 03:00:36,379][52658] DAMAGECOUNT value on done: 356913.0 [2024-08-06 03:00:36,379][52658] Sum rewards: 72.372, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.562', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.282', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:36,414][52794] DAMAGECOUNT value on done: 369674.0 [2024-08-06 03:00:36,414][52794] Sum rewards: 72.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.950', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.113', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '59.500'} [2024-08-06 03:00:36,591][52650] Updated weights for policy 0, policy_version 42471 (0.0021) [2024-08-06 03:00:36,613][52664] DAMAGECOUNT value on done: 375527.0 [2024-08-06 03:00:36,613][52664] Sum rewards: 69.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.435', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.040', 'AMMO4': '0.059', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:37,114][52660] DAMAGECOUNT value on done: 356493.0 [2024-08-06 03:00:37,114][52660] Sum rewards: 52.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.193', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.180', 'weapon4': '0.188', 'AMMO3': '0.227', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '45.000'} [2024-08-06 03:00:37,218][52649] DAMAGECOUNT value on done: 355839.0 [2024-08-06 03:00:37,221][52649] Sum rewards: 80.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.169', 'weapon2': '0.264', 'WEAPON3': '1.000', 'weapon3': '3.614', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '65.000'} [2024-08-06 03:00:37,360][52669] DAMAGECOUNT value on done: 365706.0 [2024-08-06 03:00:37,362][52669] Sum rewards: 79.750, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.507', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.151', 'weapon5': '0.182', 'weapon4': '0.210', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.186', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '63.000'} [2024-08-06 03:00:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17749.4, 300 sec: 17522.6). Total num frames: 347947008. Throughput: 0: 4378.9. Samples: 86989520. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:00:37,794][52567] Avg episode reward: [(0, '68.515')] [2024-08-06 03:00:38,202][52668] DAMAGECOUNT value on done: 359602.0 [2024-08-06 03:00:38,210][52668] Sum rewards: 58.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.055', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.194', 'weapon4': '0.246', 'AMMO4': '0.273', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.590', 'weapon3': '3.282', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '50.000'} [2024-08-06 03:00:38,701][52671] DAMAGECOUNT value on done: 368708.0 [2024-08-06 03:00:38,703][52671] Sum rewards: 74.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.776', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.167', 'weapon5': '0.194', 'weapon2': '0.214', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 03:00:39,135][52794] DAMAGECOUNT value on done: 364922.0 [2024-08-06 03:00:39,135][52794] Sum rewards: 75.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.463', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.138', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:39,483][52658] DAMAGECOUNT value on done: 365904.0 [2024-08-06 03:00:39,483][52658] Sum rewards: 63.550, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.146', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon5': '0.142', 'AMMO4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.200', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:39,852][52664] DAMAGECOUNT value on done: 376556.0 [2024-08-06 03:00:39,852][52664] Sum rewards: 71.773, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.545', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.207', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:39,942][52649] DAMAGECOUNT value on done: 351361.0 [2024-08-06 03:00:39,943][52649] Sum rewards: 59.374, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.655', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.168', 'weapon2': '0.320', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '48.000'} [2024-08-06 03:00:40,162][52660] DAMAGECOUNT value on done: 369520.0 [2024-08-06 03:00:40,164][52660] Sum rewards: 72.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:40,528][52669] DAMAGECOUNT value on done: 367581.0 [2024-08-06 03:00:40,529][52669] Sum rewards: 80.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.130', 'weapon5': '0.222', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '67.000'} [2024-08-06 03:00:41,113][52650] Updated weights for policy 0, policy_version 42481 (0.0028) [2024-08-06 03:00:41,633][52671] DAMAGECOUNT value on done: 366858.0 [2024-08-06 03:00:41,635][52671] Sum rewards: 62.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.898', 'AMMO2': '0.019', 'AMMO5': '0.019', 'weapon4': '0.048', 'AMMO4': '0.092', 'weapon5': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.342', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:41,831][52658] DAMAGECOUNT value on done: 360184.0 [2024-08-06 03:00:41,831][52658] Sum rewards: 61.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.412', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.130', 'weapon5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.024', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:42,127][52794] DAMAGECOUNT value on done: 362406.0 [2024-08-06 03:00:42,128][52794] Sum rewards: 56.406, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.914', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'weapon4': '0.228', 'AMMO3': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.116', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '50.500'} [2024-08-06 03:00:42,551][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:00:42,746][52649] DAMAGECOUNT value on done: 357385.0 [2024-08-06 03:00:42,747][52649] Sum rewards: 73.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.186', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '62.000'} [2024-08-06 03:00:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 348028928. Throughput: 0: 4381.3. Samples: 87015770. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:00:42,794][52567] Avg episode reward: [(0, '68.564')] [2024-08-06 03:00:42,962][52660] DAMAGECOUNT value on done: 370889.0 [2024-08-06 03:00:42,964][52660] Sum rewards: 62.876, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.160', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.154', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '50.000'} [2024-08-06 03:00:43,085][52664] DAMAGECOUNT value on done: 369908.0 [2024-08-06 03:00:43,085][52664] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.926', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:43,738][52669] DAMAGECOUNT value on done: 366765.0 [2024-08-06 03:00:43,739][52669] Sum rewards: 80.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.122', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.219', 'weapon5': '0.226', 'AMMO4': '0.247', 'weapon4': '0.278', 'weapon2': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '66.000'} [2024-08-06 03:00:43,960][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:00:44,169][52671] DAMAGECOUNT value on done: 359816.0 [2024-08-06 03:00:44,169][52671] Sum rewards: 66.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.812', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.118', 'weapon4': '0.142', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:44,721][52658] DAMAGECOUNT value on done: 359742.0 [2024-08-06 03:00:44,722][52658] Sum rewards: 67.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.281', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.296', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:45,377][52794] DAMAGECOUNT value on done: 365553.0 [2024-08-06 03:00:45,378][52794] Sum rewards: 72.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.484', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.136', 'weapon5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:45,530][52664] DAMAGECOUNT value on done: 379697.0 [2024-08-06 03:00:45,530][52664] Sum rewards: 72.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:45,617][52650] Updated weights for policy 0, policy_version 42491 (0.0019) [2024-08-06 03:00:45,904][52649] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:00:45,910][52649] DAMAGECOUNT value on done: 360276.0 [2024-08-06 03:00:45,910][52649] Sum rewards: 66.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.235', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.198', 'AMMO3': '0.211', 'AMMO4': '0.249', 'weapon2': '0.272', 'weapon4': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:46,237][52660] DAMAGECOUNT value on done: 359847.0 [2024-08-06 03:00:46,241][52660] Sum rewards: 70.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.139', 'AMMO3': '0.206', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:46,630][52669] DAMAGECOUNT value on done: 369584.0 [2024-08-06 03:00:46,631][52669] Sum rewards: 56.117, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.596', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.204', 'AMMO4': '0.258', 'AMMO3': '0.295', 'weapon4': '0.346', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.800', 'weapon3': '2.710', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '50.000'} [2024-08-06 03:00:46,725][52671] DAMAGECOUNT value on done: 368877.0 [2024-08-06 03:00:46,725][52671] Sum rewards: 80.399, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.344', 'AMMO5': '0.012', 'AMMO2': '0.063', 'weapon5': '0.194', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.310', 'AMMO4': '0.315', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '68.000'} [2024-08-06 03:00:47,660][52658] DAMAGECOUNT value on done: 357756.0 [2024-08-06 03:00:47,663][52658] Sum rewards: 77.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.182', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO4': '0.219', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.246', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '65.000'} [2024-08-06 03:00:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 348119040. Throughput: 0: 4374.2. Samples: 87028870. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 03:00:47,795][52567] Avg episode reward: [(0, '68.709')] [2024-08-06 03:00:48,391][52649] DAMAGECOUNT value on done: 358576.0 [2024-08-06 03:00:48,391][52649] Sum rewards: 74.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.954', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.162', 'weapon5': '0.216', 'AMMO4': '0.226', 'AMMO3': '0.228', 'weapon2': '0.236', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '61.000'} [2024-08-06 03:00:48,542][52794] DAMAGECOUNT value on done: 358119.0 [2024-08-06 03:00:48,542][52794] Sum rewards: 66.137, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.301', 'weapon2': '0.562', 'WEAPON3': '1.750', 'weapon3': '2.974', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '59.000'} [2024-08-06 03:00:48,745][52664] DAMAGECOUNT value on done: 373884.0 [2024-08-06 03:00:48,745][52664] Sum rewards: 49.268, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.415', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.098', 'AMMO3': '0.162', 'AMMO4': '0.167', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.716', 'WEAPON3': '1.100', 'HITCOUNT': '2.700', 'weapon3': '2.744', 'DAMAGECOUNT': '12.510', 'FRAGCOUNT': '41.000'} [2024-08-06 03:00:49,335][52660] DAMAGECOUNT value on done: 361375.0 [2024-08-06 03:00:49,339][52660] Sum rewards: 69.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.960', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.171', 'weapon5': '0.176', 'AMMO3': '0.201', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:49,874][52671] DAMAGECOUNT value on done: 371626.0 [2024-08-06 03:00:49,874][52671] Sum rewards: 71.485, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.706', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '60.000'} [2024-08-06 03:00:50,390][52658] DAMAGECOUNT value on done: 370134.0 [2024-08-06 03:00:50,392][52658] Sum rewards: 75.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.175', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '62.500'} [2024-08-06 03:00:50,613][52650] Updated weights for policy 0, policy_version 42501 (0.0011) [2024-08-06 03:00:51,446][52794] DAMAGECOUNT value on done: 374399.0 [2024-08-06 03:00:51,447][52794] Sum rewards: 65.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.155', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO3': '0.207', 'AMMO4': '0.225', 'weapon2': '0.278', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '55.000'} [2024-08-06 03:00:51,574][52664] DAMAGECOUNT value on done: 381401.0 [2024-08-06 03:00:51,574][52664] Sum rewards: 62.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.023', 'AMMO2': '0.050', 'weapon5': '0.156', 'AMMO4': '0.249', 'AMMO3': '0.257', 'weapon2': '0.354', 'weapon4': '0.434', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.756', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:52,153][52660] DAMAGECOUNT value on done: 356968.0 [2024-08-06 03:00:52,155][52660] Sum rewards: 58.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.118', 'weapon5': '0.126', 'AMMO4': '0.177', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '50.000'} [2024-08-06 03:00:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.9). Total num frames: 348200960. Throughput: 0: 4369.6. Samples: 87054910. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 03:00:52,794][52567] Avg episode reward: [(0, '68.645')] [2024-08-06 03:00:52,825][52671] DAMAGECOUNT value on done: 362667.0 [2024-08-06 03:00:52,825][52671] Sum rewards: 62.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.581', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.112', 'weapon4': '0.176', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:53,418][52658] DAMAGECOUNT value on done: 361097.0 [2024-08-06 03:00:53,420][52658] Sum rewards: 80.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.389', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.168', 'AMMO4': '0.194', 'AMMO3': '0.195', 'weapon5': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '65.000'} [2024-08-06 03:00:53,605][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:00:54,328][52664] DAMAGECOUNT value on done: 376473.0 [2024-08-06 03:00:54,328][52664] Sum rewards: 72.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.845', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.085', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.284', 'weapon4': '0.374', 'WEAPON3': '0.900', 'weapon3': '3.120', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 03:00:54,691][52660] DAMAGECOUNT value on done: 364783.0 [2024-08-06 03:00:54,692][52660] Sum rewards: 80.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.122', 'AMMO4': '0.144', 'AMMO3': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '64.000'} [2024-08-06 03:00:54,793][52794] DAMAGECOUNT value on done: 358810.0 [2024-08-06 03:00:54,795][52794] Sum rewards: 64.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.299', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.056', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:55,006][52650] Updated weights for policy 0, policy_version 42511 (0.0022) [2024-08-06 03:00:55,786][52671] DAMAGECOUNT value on done: 375368.0 [2024-08-06 03:00:55,786][52671] Sum rewards: 63.609, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.625', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.068', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2024-08-06 03:00:55,861][52658] DAMAGECOUNT value on done: 364894.0 [2024-08-06 03:00:55,862][52658] Sum rewards: 76.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.092', 'weapon4': '0.134', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 03:00:56,675][52664] DAMAGECOUNT value on done: 384669.0 [2024-08-06 03:00:56,677][52664] Sum rewards: 69.140, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon4': '0.020', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.170', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.274', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '55.500'} [2024-08-06 03:00:57,422][52660] DAMAGECOUNT value on done: 359314.0 [2024-08-06 03:00:57,422][52660] Sum rewards: 65.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.280', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.180', 'AMMO3': '0.277', 'weapon2': '0.294', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.826', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '57.000'} [2024-08-06 03:00:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 348299264. Throughput: 0: 4375.6. Samples: 87081530. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 03:00:57,794][52567] Avg episode reward: [(0, '68.694')] [2024-08-06 03:00:57,852][52794] DAMAGECOUNT value on done: 373404.0 [2024-08-06 03:00:57,855][52794] Sum rewards: 64.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.198', 'AMMO3': '0.207', 'weapon4': '0.356', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2024-08-06 03:00:58,769][52658] DAMAGECOUNT value on done: 367336.0 [2024-08-06 03:00:58,770][52658] Sum rewards: 77.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.580', 'WEAPON3': '1.050', 'weapon3': '3.112', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '62.000'} [2024-08-06 03:00:58,807][52671] DAMAGECOUNT value on done: 363441.0 [2024-08-06 03:00:58,807][52671] Sum rewards: 65.060, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2024-08-06 03:00:59,246][52664] DAMAGECOUNT value on done: 378747.0 [2024-08-06 03:00:59,247][52664] Sum rewards: 60.780, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.414', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.596', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.198', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '50.000'} [2024-08-06 03:01:00,055][52650] Updated weights for policy 0, policy_version 42521 (0.0023) [2024-08-06 03:01:00,484][52794] DAMAGECOUNT value on done: 366571.0 [2024-08-06 03:01:00,484][52794] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.006', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.099', 'weapon2': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON3': '1.450', 'HITCOUNT': '3.440', 'weapon3': '3.476', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:01,678][52671] DAMAGECOUNT value on done: 357145.0 [2024-08-06 03:01:01,679][52671] Sum rewards: 60.465, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.763', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.030', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.224', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '50.000'} [2024-08-06 03:01:01,830][52664] DAMAGECOUNT value on done: 383475.0 [2024-08-06 03:01:01,830][52664] Sum rewards: 67.940, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.554', 'AMMO5': '0.031', 'AMMO2': '0.069', 'weapon4': '0.116', 'AMMO3': '0.229', 'weapon5': '0.242', 'weapon2': '0.308', 'AMMO4': '0.343', 'WEAPON4': '0.450', 'WEAPON5': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 348381184. Throughput: 0: 4370.0. Samples: 87094560. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 03:01:02,794][52567] Avg episode reward: [(0, '68.600')] [2024-08-06 03:01:03,703][52794] DAMAGECOUNT value on done: 365438.0 [2024-08-06 03:01:03,706][52794] Sum rewards: 73.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.502', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.168', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:04,067][52671] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:01:04,477][52664] DAMAGECOUNT value on done: 374008.0 [2024-08-06 03:01:04,478][52664] Sum rewards: 69.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.102', 'weapon4': '0.146', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:04,503][52650] Updated weights for policy 0, policy_version 42531 (0.0011) [2024-08-06 03:01:04,748][52671] DAMAGECOUNT value on done: 370658.0 [2024-08-06 03:01:04,750][52671] Sum rewards: 80.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.588', 'AMMO5': '0.003', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.220', 'weapon2': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.482', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '68.000'} [2024-08-06 03:01:06,319][52794] DAMAGECOUNT value on done: 375733.0 [2024-08-06 03:01:06,321][52794] Sum rewards: 64.924, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.982', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.170', 'weapon4': '0.176', 'AMMO4': '0.193', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '54.500'} [2024-08-06 03:01:07,022][52664] DAMAGECOUNT value on done: 376027.0 [2024-08-06 03:01:07,023][52664] Sum rewards: 55.178, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.696', 'AMMO5': '0.021', 'AMMO2': '0.073', 'weapon5': '0.172', 'AMMO3': '0.226', 'AMMO4': '0.364', 'weapon4': '0.404', 'weapon2': '0.424', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '47.000'} [2024-08-06 03:01:07,767][52671] DAMAGECOUNT value on done: 371349.0 [2024-08-06 03:01:07,767][52671] Sum rewards: 73.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.381', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.175', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:07,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 348463104. Throughput: 0: 4376.4. Samples: 87120940. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 03:01:07,795][52567] Avg episode reward: [(0, '68.739')] [2024-08-06 03:01:09,124][52650] Updated weights for policy 0, policy_version 42541 (0.0011) [2024-08-06 03:01:09,338][52794] DAMAGECOUNT value on done: 364953.0 [2024-08-06 03:01:09,340][52794] Sum rewards: 72.017, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.340', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.185', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'weapon4': '0.360', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:09,618][52664] DAMAGECOUNT value on done: 377166.0 [2024-08-06 03:01:09,619][52664] Sum rewards: 64.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.343', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '54.000'} [2024-08-06 03:01:10,968][52671] DAMAGECOUNT value on done: 372349.0 [2024-08-06 03:01:10,971][52671] Sum rewards: 61.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.084', 'weapon5': '0.128', 'AMMO4': '0.215', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.062', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:12,539][52664] DAMAGECOUNT value on done: 376757.0 [2024-08-06 03:01:12,540][52664] Sum rewards: 65.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.021', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.198', 'weapon2': '0.218', 'weapon5': '0.272', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:12,622][52647] DAMAGECOUNT value on done: 383788.0 [2024-08-06 03:01:12,623][52647] Sum rewards: 59.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '47.500'} [2024-08-06 03:01:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 348561408. Throughput: 0: 4381.8. Samples: 87147310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:01:12,794][52567] Avg episode reward: [(0, '68.349')] [2024-08-06 03:01:13,793][52650] Updated weights for policy 0, policy_version 42551 (0.0024) [2024-08-06 03:01:13,933][52671] DAMAGECOUNT value on done: 366380.0 [2024-08-06 03:01:13,933][52671] Sum rewards: 71.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.641', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.134', 'weapon4': '0.140', 'AMMO4': '0.176', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:15,408][52664] DAMAGECOUNT value on done: 375439.0 [2024-08-06 03:01:15,416][52664] Sum rewards: 60.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.994', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '51.000'} [2024-08-06 03:01:15,422][52647] DAMAGECOUNT value on done: 382850.0 [2024-08-06 03:01:15,422][52647] Sum rewards: 72.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.350', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:16,568][52659] DAMAGECOUNT value on done: 367053.0 [2024-08-06 03:01:16,569][52671] DAMAGECOUNT value on done: 363145.0 [2024-08-06 03:01:16,569][52659] Sum rewards: 65.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.455', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.181', 'weapon4': '0.210', 'AMMO4': '0.281', 'weapon5': '0.288', 'weapon2': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '51.000'} [2024-08-06 03:01:16,570][52671] Sum rewards: 68.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon7': '0.048', 'AMMO4': '0.075', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.160', 'WEAPON7': '0.200', 'AMMO3': '0.201', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.920', 'WEAPON3': '1.200', 'weapon3': '2.454', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '56.000'} [2024-08-06 03:01:16,716][52811] DAMAGECOUNT value on done: 349894.0 [2024-08-06 03:01:16,717][52811] Sum rewards: 60.657, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.064', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon5': '0.160', 'AMMO3': '0.249', 'AMMO4': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON4': '0.600', 'weapon2': '0.640', 'WEAPON3': '1.400', 'weapon3': '2.346', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:17,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 348643328. Throughput: 0: 4388.2. Samples: 87160530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:01:17,794][52567] Avg episode reward: [(0, '68.353')] [2024-08-06 03:01:18,126][52647] DAMAGECOUNT value on done: 381853.0 [2024-08-06 03:01:18,128][52647] Sum rewards: 67.551, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.060', 'AMMO3': '0.164', 'AMMO4': '0.174', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.520', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '55.000'} [2024-08-06 03:01:18,188][52803] DAMAGECOUNT value on done: 341680.0 [2024-08-06 03:01:18,188][52803] Sum rewards: 72.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.318', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.114', 'weapon5': '0.214', 'AMMO3': '0.220', 'AMMO4': '0.298', 'weapon2': '0.478', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:18,367][52650] Updated weights for policy 0, policy_version 42561 (0.0011) [2024-08-06 03:01:19,472][52659] DAMAGECOUNT value on done: 365337.0 [2024-08-06 03:01:19,474][52659] Sum rewards: 73.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.938', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.062', 'AMMO4': '0.122', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.232', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:19,884][52811] DAMAGECOUNT value on done: 337565.0 [2024-08-06 03:01:19,884][52811] Sum rewards: 63.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.596', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.155', 'AMMO3': '0.220', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2024-08-06 03:01:20,603][52647] DAMAGECOUNT value on done: 389048.0 [2024-08-06 03:01:20,604][52647] Sum rewards: 78.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.078', 'AMMO4': '0.148', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '67.000'} [2024-08-06 03:01:21,282][52803] DAMAGECOUNT value on done: 337883.0 [2024-08-06 03:01:21,282][52803] Sum rewards: 76.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.254', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.142', 'AMMO4': '0.205', 'AMMO3': '0.214', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '63.000'} [2024-08-06 03:01:22,504][52659] DAMAGECOUNT value on done: 363825.0 [2024-08-06 03:01:22,507][52659] Sum rewards: 67.478, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.013', 'weapon5': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.166', 'weapon4': '0.248', 'weapon2': '0.392', 'HEALTH': '0.698', 'WEAPON3': '0.850', 'weapon3': '3.094', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 348733440. Throughput: 0: 4389.3. Samples: 87187040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:01:22,794][52567] Avg episode reward: [(0, '68.166')] [2024-08-06 03:01:22,963][52811] DAMAGECOUNT value on done: 339294.0 [2024-08-06 03:01:22,963][52811] Sum rewards: 57.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.578', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.062', 'weapon5': '0.080', 'AMMO4': '0.089', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon2': '0.954', 'weapon3': '2.724', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '48.000'} [2024-08-06 03:01:23,281][52650] Updated weights for policy 0, policy_version 42571 (0.0013) [2024-08-06 03:01:23,813][52647] DAMAGECOUNT value on done: 384924.0 [2024-08-06 03:01:23,813][52647] Sum rewards: 68.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.728', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.136', 'weapon5': '0.140', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.330', 'WEAPON3': '1.950', 'weapon3': '3.222', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '61.000'} [2024-08-06 03:01:24,374][52803] DAMAGECOUNT value on done: 341121.0 [2024-08-06 03:01:24,375][52803] Sum rewards: 64.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.488', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.120', 'AMMO4': '0.186', 'AMMO3': '0.198', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:25,489][52659] DAMAGECOUNT value on done: 365109.0 [2024-08-06 03:01:25,489][52659] Sum rewards: 70.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.596', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.130', 'AMMO4': '0.165', 'weapon5': '0.174', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:26,138][52811] DAMAGECOUNT value on done: 339931.0 [2024-08-06 03:01:26,140][52811] Sum rewards: 74.915, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.730', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.114', 'AMMO3': '0.172', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:26,544][52647] DAMAGECOUNT value on done: 386198.0 [2024-08-06 03:01:26,544][52647] Sum rewards: 61.783, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.862', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.142', 'AMMO4': '0.155', 'AMMO3': '0.179', 'weapon5': '0.196', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '50.000'} [2024-08-06 03:01:27,405][52803] DAMAGECOUNT value on done: 343489.0 [2024-08-06 03:01:27,406][52803] Sum rewards: 75.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.492', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.198', 'weapon4': '0.236', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.282', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '63.000'} [2024-08-06 03:01:27,665][52650] Updated weights for policy 0, policy_version 42581 (0.0019) [2024-08-06 03:01:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 348823552. Throughput: 0: 4384.2. Samples: 87213060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:01:27,794][52567] Avg episode reward: [(0, '68.158')] [2024-08-06 03:01:28,596][52659] DAMAGECOUNT value on done: 361925.0 [2024-08-06 03:01:28,596][52659] Sum rewards: 71.862, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.308', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.193', 'AMMO3': '0.206', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '62.000'} [2024-08-06 03:01:28,746][52666] DAMAGECOUNT value on done: 364022.0 [2024-08-06 03:01:28,747][52666] Sum rewards: 61.545, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.726', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.190', 'AMMO3': '0.275', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.466', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '55.000'} [2024-08-06 03:01:29,086][52811] DAMAGECOUNT value on done: 341717.0 [2024-08-06 03:01:29,088][52811] Sum rewards: 55.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.110', 'weapon5': '0.182', 'AMMO3': '0.200', 'AMMO4': '0.221', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.540', 'weapon3': '2.974', 'DAMAGECOUNT': '13.905', 'FRAGCOUNT': '46.000'} [2024-08-06 03:01:29,204][52647] DAMAGECOUNT value on done: 385581.0 [2024-08-06 03:01:29,204][52647] Sum rewards: 74.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.032', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.064', 'weapon4': '0.112', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '62.000'} [2024-08-06 03:01:29,435][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:01:30,464][52803] DAMAGECOUNT value on done: 345001.0 [2024-08-06 03:01:30,464][52803] Sum rewards: 70.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.952', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.193', 'weapon5': '0.306', 'weapon4': '0.356', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:31,487][52659] DAMAGECOUNT value on done: 366426.0 [2024-08-06 03:01:31,487][52659] Sum rewards: 69.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.898', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO4': '0.227', 'AMMO3': '0.242', 'weapon5': '0.254', 'weapon4': '0.308', 'weapon2': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.734', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:31,592][52666] DAMAGECOUNT value on done: 368516.0 [2024-08-06 03:01:31,596][52666] Sum rewards: 66.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.222', 'weapon4': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '54.000'} [2024-08-06 03:01:31,690][52647] DAMAGECOUNT value on done: 379745.0 [2024-08-06 03:01:31,692][52647] Sum rewards: 64.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.199', 'weapon4': '0.210', 'AMMO4': '0.223', 'weapon5': '0.342', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '54.000'} [2024-08-06 03:01:32,218][52811] DAMAGECOUNT value on done: 345414.0 [2024-08-06 03:01:32,218][52811] Sum rewards: 68.173, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.318', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:32,365][52795] DAMAGECOUNT value on done: 337489.0 [2024-08-06 03:01:32,365][52795] Sum rewards: 56.825, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.135', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon5': '0.224', 'weapon2': '0.604', 'WEAPON3': '1.300', 'HITCOUNT': '2.580', 'weapon3': '2.902', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '48.000'} [2024-08-06 03:01:32,705][52650] Updated weights for policy 0, policy_version 42591 (0.0027) [2024-08-06 03:01:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 348905472. Throughput: 0: 4388.2. Samples: 87226340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:01:32,794][52567] Avg episode reward: [(0, '68.316')] [2024-08-06 03:01:33,417][52803] DAMAGECOUNT value on done: 335594.0 [2024-08-06 03:01:33,419][52803] Sum rewards: 60.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.312', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.458', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '3.008', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '49.000'} [2024-08-06 03:01:34,299][52647] DAMAGECOUNT value on done: 391052.0 [2024-08-06 03:01:34,300][52647] Sum rewards: 58.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.058', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.234', 'AMMO3': '0.263', 'AMMO4': '0.283', 'weapon2': '0.304', 'weapon5': '0.304', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.752', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '51.000'} [2024-08-06 03:01:34,442][52666] DAMAGECOUNT value on done: 368390.0 [2024-08-06 03:01:34,444][52666] Sum rewards: 65.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.177', 'weapon4': '0.184', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:34,566][52659] DAMAGECOUNT value on done: 364001.0 [2024-08-06 03:01:34,566][52659] Sum rewards: 60.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.536', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.258', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '51.000'} [2024-08-06 03:01:34,692][52670] DAMAGECOUNT value on done: 361134.0 [2024-08-06 03:01:34,693][52670] Sum rewards: 69.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:35,250][52811] DAMAGECOUNT value on done: 341406.0 [2024-08-06 03:01:35,251][52811] Sum rewards: 73.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO4': '0.185', 'AMMO3': '0.241', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '62.000'} [2024-08-06 03:01:35,427][52795] DAMAGECOUNT value on done: 330153.0 [2024-08-06 03:01:35,429][52795] Sum rewards: 56.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.816', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO4': '0.206', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.720', 'weapon3': '3.164', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '48.000'} [2024-08-06 03:01:36,543][52803] DAMAGECOUNT value on done: 335881.0 [2024-08-06 03:01:36,544][52803] Sum rewards: 69.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.170', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.136', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:36,806][52650] Updated weights for policy 0, policy_version 42601 (0.0013) [2024-08-06 03:01:36,921][52647] DAMAGECOUNT value on done: 380582.0 [2024-08-06 03:01:36,922][52647] Sum rewards: 77.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'AMMO4': '0.213', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.354', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '63.000'} [2024-08-06 03:01:37,213][52666] DAMAGECOUNT value on done: 366058.0 [2024-08-06 03:01:37,215][52666] Sum rewards: 76.746, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.236', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.120', 'AMMO4': '0.122', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '66.000'} [2024-08-06 03:01:37,420][52670] DAMAGECOUNT value on done: 364759.0 [2024-08-06 03:01:37,427][52670] Sum rewards: 74.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.225', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '63.000'} [2024-08-06 03:01:37,483][52659] DAMAGECOUNT value on done: 361719.0 [2024-08-06 03:01:37,485][52659] Sum rewards: 67.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.519', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon5': '0.048', 'weapon4': '0.102', 'AMMO4': '0.147', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.290', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '56.000'} [2024-08-06 03:01:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 348995584. Throughput: 0: 4397.1. Samples: 87252780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:01:37,794][52567] Avg episode reward: [(0, '67.985')] [2024-08-06 03:01:38,305][52811] DAMAGECOUNT value on done: 341622.0 [2024-08-06 03:01:38,306][52811] Sum rewards: 69.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.850', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.158', 'AMMO3': '0.199', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.760', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:38,422][52795] DAMAGECOUNT value on done: 331068.0 [2024-08-06 03:01:38,422][52795] Sum rewards: 66.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.854', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.136', 'AMMO4': '0.151', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '55.000'} [2024-08-06 03:01:39,369][52647] DAMAGECOUNT value on done: 387689.0 [2024-08-06 03:01:39,370][52647] Sum rewards: 73.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.257', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.162', 'AMMO3': '0.190', 'weapon5': '0.218', 'weapon2': '0.254', 'AMMO4': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:39,786][52803] DAMAGECOUNT value on done: 335846.0 [2024-08-06 03:01:39,786][52803] Sum rewards: 64.671, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.100', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.696', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.500'} [2024-08-06 03:01:40,046][52659] DAMAGECOUNT value on done: 371770.0 [2024-08-06 03:01:40,046][52659] Sum rewards: 67.895, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:40,270][52666] DAMAGECOUNT value on done: 361546.0 [2024-08-06 03:01:40,272][52666] Sum rewards: 65.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.115', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.171', 'weapon2': '0.386', 'WEAPON3': '1.100', 'HITCOUNT': '3.310', 'weapon3': '3.334', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '51.000'} [2024-08-06 03:01:40,454][52663] DAMAGECOUNT value on done: 369630.0 [2024-08-06 03:01:40,454][52663] Sum rewards: 61.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.845', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.088', 'weapon5': '0.088', 'AMMO4': '0.115', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.448', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:40,459][52670] DAMAGECOUNT value on done: 355737.0 [2024-08-06 03:01:40,461][52670] Sum rewards: 66.861, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.179', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.166', 'weapon4': '0.198', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '53.000'} [2024-08-06 03:01:41,312][52811] DAMAGECOUNT value on done: 347581.0 [2024-08-06 03:01:41,316][52811] Sum rewards: 64.018, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.104', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.272', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.054', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '56.000'} [2024-08-06 03:01:41,574][52647] DAMAGECOUNT value on done: 377489.0 [2024-08-06 03:01:41,582][52647] Sum rewards: 58.836, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO3': '0.157', 'weapon5': '0.174', 'AMMO4': '0.193', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '46.000'} [2024-08-06 03:01:41,601][52795] DAMAGECOUNT value on done: 336937.0 [2024-08-06 03:01:41,604][52795] Sum rewards: 64.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.386', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.126', 'weapon5': '0.204', 'AMMO3': '0.205', 'AMMO4': '0.286', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.024', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '53.500'} [2024-08-06 03:01:41,897][52650] Updated weights for policy 0, policy_version 42611 (0.0026) [2024-08-06 03:01:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 349085696. Throughput: 0: 4390.7. Samples: 87279110. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 03:01:42,794][52567] Avg episode reward: [(0, '67.833')] [2024-08-06 03:01:42,797][52659] DAMAGECOUNT value on done: 372366.0 [2024-08-06 03:01:42,797][52659] Sum rewards: 65.974, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.850', 'AMMO5': '0.014', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon4': '0.060', 'weapon5': '0.092', 'AMMO4': '0.118', 'AMMO3': '0.155', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '52.000'} [2024-08-06 03:01:42,870][52803] DAMAGECOUNT value on done: 341956.0 [2024-08-06 03:01:42,873][52803] Sum rewards: 71.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.145', 'weapon4': '0.148', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '0.900', 'weapon3': '3.078', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:42,980][52666] DAMAGECOUNT value on done: 356525.0 [2024-08-06 03:01:42,981][52666] Sum rewards: 60.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.452', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO3': '0.200', 'AMMO4': '0.239', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '2.954', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '49.500'} [2024-08-06 03:01:43,319][52670] DAMAGECOUNT value on done: 354974.0 [2024-08-06 03:01:43,321][52670] Sum rewards: 67.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.646', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.184', 'AMMO3': '0.223', 'AMMO4': '0.270', 'weapon2': '0.350', 'weapon4': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:43,531][52663] DAMAGECOUNT value on done: 363229.0 [2024-08-06 03:01:43,534][52663] Sum rewards: 71.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.396', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.066', 'weapon4': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:44,392][52647] DAMAGECOUNT value on done: 380845.0 [2024-08-06 03:01:44,393][52647] Sum rewards: 64.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.186', 'AMMO3': '0.208', 'AMMO4': '0.283', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.566', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '54.500'} [2024-08-06 03:01:44,468][52811] DAMAGECOUNT value on done: 340870.0 [2024-08-06 03:01:44,468][52811] Sum rewards: 66.737, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.142', 'weapon5': '0.184', 'AMMO3': '0.198', 'AMMO4': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '55.000'} [2024-08-06 03:01:44,788][52795] DAMAGECOUNT value on done: 337166.0 [2024-08-06 03:01:44,789][52795] Sum rewards: 62.010, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.258', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.066', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'weapon4': '0.510', 'weapon2': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.566', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 03:01:45,987][52659] DAMAGECOUNT value on done: 364323.0 [2024-08-06 03:01:45,987][52659] Sum rewards: 68.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.172', 'weapon4': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.224', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:45,994][52803] DAMAGECOUNT value on done: 334800.0 [2024-08-06 03:01:45,995][52803] Sum rewards: 47.815, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.974', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.128', 'AMMO4': '0.206', 'weapon2': '0.248', 'AMMO3': '0.309', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.578', 'WEAPON3': '1.850', 'weapon3': '2.744', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.299', 'FRAGCOUNT': '46.000'} [2024-08-06 03:01:46,048][52666] DAMAGECOUNT value on done: 364407.0 [2024-08-06 03:01:46,048][52666] Sum rewards: 70.225, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.296', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.070', 'weapon7': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.252', 'weapon4': '0.256', 'AMMO3': '0.293', 'WEAPON3': '1.800', 'weapon3': '3.076', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '64.000'} [2024-08-06 03:01:46,303][52650] Updated weights for policy 0, policy_version 42621 (0.0013) [2024-08-06 03:01:46,389][52670] DAMAGECOUNT value on done: 367269.0 [2024-08-06 03:01:46,389][52670] Sum rewards: 59.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.204', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.156', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '50.000'} [2024-08-06 03:01:46,800][52663] DAMAGECOUNT value on done: 360900.0 [2024-08-06 03:01:46,802][52663] Sum rewards: 58.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.649', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.112', 'AMMO3': '0.204', 'AMMO4': '0.297', 'weapon2': '0.310', 'weapon5': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.940', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '48.000'} [2024-08-06 03:01:47,091][52647] DAMAGECOUNT value on done: 382324.0 [2024-08-06 03:01:47,093][52647] Sum rewards: 73.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.142', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.137', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '3.230', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:47,518][52811] DAMAGECOUNT value on done: 341231.0 [2024-08-06 03:01:47,520][52811] Sum rewards: 65.779, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 349167616. Throughput: 0: 4390.5. Samples: 87292130. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 03:01:47,794][52567] Avg episode reward: [(0, '67.151')] [2024-08-06 03:01:47,905][52795] DAMAGECOUNT value on done: 339052.0 [2024-08-06 03:01:47,905][52795] Sum rewards: 71.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.965', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.071', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.278', 'weapon2': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.384', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '62.000'} [2024-08-06 03:01:48,477][52659] DAMAGECOUNT value on done: 368362.0 [2024-08-06 03:01:48,478][52659] Sum rewards: 72.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.165', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '61.000'} [2024-08-06 03:01:48,859][52666] DAMAGECOUNT value on done: 363901.0 [2024-08-06 03:01:48,861][52666] Sum rewards: 74.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.167', 'weapon5': '0.170', 'weapon4': '0.196', 'AMMO3': '0.219', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '61.000'} [2024-08-06 03:01:49,052][52803] DAMAGECOUNT value on done: 345482.0 [2024-08-06 03:01:49,052][52803] Sum rewards: 70.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.892', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.134', 'weapon5': '0.166', 'AMMO4': '0.195', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.396', 'WEAPON3': '0.850', 'weapon3': '2.740', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '55.000'} [2024-08-06 03:01:49,110][52670] DAMAGECOUNT value on done: 359908.0 [2024-08-06 03:01:49,110][52670] Sum rewards: 64.987, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.153', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon2': '0.220', 'AMMO3': '0.230', 'weapon5': '0.254', 'AMMO4': '0.283', 'weapon4': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '54.000'} [2024-08-06 03:01:49,627][52663] DAMAGECOUNT value on done: 364817.0 [2024-08-06 03:01:49,628][52663] Sum rewards: 66.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.609', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.072', 'AMMO3': '0.179', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 03:01:49,866][52647] DAMAGECOUNT value on done: 390534.0 [2024-08-06 03:01:49,866][52647] Sum rewards: 70.923, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.404', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.128', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 03:01:50,593][52811] DAMAGECOUNT value on done: 350355.0 [2024-08-06 03:01:50,595][52811] Sum rewards: 86.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '68.000'} [2024-08-06 03:01:50,980][52795] DAMAGECOUNT value on done: 345693.0 [2024-08-06 03:01:50,980][52795] Sum rewards: 67.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.495', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.110', 'weapon5': '0.174', 'AMMO4': '0.220', 'AMMO3': '0.227', 'weapon2': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:51,038][52650] Updated weights for policy 0, policy_version 42631 (0.0012) [2024-08-06 03:01:51,510][52659] DAMAGECOUNT value on done: 357720.0 [2024-08-06 03:01:51,510][52659] Sum rewards: 70.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.560', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.144', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:51,631][52666] Large shaping reward 2.533 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2024-08-06 03:01:51,838][52666] DAMAGECOUNT value on done: 360183.0 [2024-08-06 03:01:51,846][52666] Sum rewards: 75.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.663', 'AMMO5': '0.020', 'AMMO2': '0.066', 'AMMO3': '0.220', 'weapon4': '0.236', 'weapon5': '0.316', 'weapon2': '0.318', 'AMMO4': '0.327', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.784', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.000'} [2024-08-06 03:01:52,127][52670] DAMAGECOUNT value on done: 353870.0 [2024-08-06 03:01:52,129][52670] Sum rewards: 70.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.552', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.104', 'AMMO4': '0.224', 'AMMO3': '0.259', 'weapon2': '0.262', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.062', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:52,189][52803] DAMAGECOUNT value on done: 340784.0 [2024-08-06 03:01:52,189][52803] Sum rewards: 74.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.915', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.100', 'weapon2': '0.188', 'WEAPON4': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.248', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '66.000'} [2024-08-06 03:01:52,780][52647] DAMAGECOUNT value on done: 381325.0 [2024-08-06 03:01:52,780][52647] Sum rewards: 48.255, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.919', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.140', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon2': '0.526', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '2.828', 'DAMAGECOUNT': '12.450', 'FRAGCOUNT': '39.000'} [2024-08-06 03:01:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 349257728. Throughput: 0: 4392.9. Samples: 87318620. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 03:01:52,794][52567] Avg episode reward: [(0, '67.484')] [2024-08-06 03:01:52,823][52663] DAMAGECOUNT value on done: 362947.0 [2024-08-06 03:01:52,823][52663] Sum rewards: 65.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.566', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.126', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '54.000'} [2024-08-06 03:01:53,776][52811] DAMAGECOUNT value on done: 338487.0 [2024-08-06 03:01:53,778][52811] Sum rewards: 67.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.021', 'AMMO2': '0.067', 'weapon5': '0.128', 'AMMO3': '0.218', 'weapon4': '0.290', 'AMMO4': '0.337', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.780', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:54,069][52795] DAMAGECOUNT value on done: 341991.0 [2024-08-06 03:01:54,070][52795] Sum rewards: 62.111, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon2': '0.178', 'AMMO4': '0.197', 'weapon4': '0.204', 'AMMO3': '0.207', 'weapon5': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.098', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 03:01:54,665][52659] DAMAGECOUNT value on done: 363672.0 [2024-08-06 03:01:54,667][52659] Sum rewards: 68.580, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.220', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.054', 'weapon4': '0.064', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'weapon2': '0.360', 'WEAPON3': '1.800', 'weapon3': '3.244', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '63.000'} [2024-08-06 03:01:54,998][52666] DAMAGECOUNT value on done: 357416.0 [2024-08-06 03:01:54,998][52666] Sum rewards: 57.521, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.630', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.094', 'weapon2': '0.228', 'weapon5': '0.246', 'AMMO3': '0.294', 'AMMO4': '0.315', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'HITCOUNT': '2.950', 'weapon3': '3.058', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '51.000'} [2024-08-06 03:01:55,345][52803] DAMAGECOUNT value on done: 339597.0 [2024-08-06 03:01:55,345][52803] Sum rewards: 67.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon4': '0.166', 'AMMO3': '0.217', 'weapon2': '0.258', 'weapon5': '0.280', 'AMMO4': '0.311', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.046', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '56.500'} [2024-08-06 03:01:55,365][52670] DAMAGECOUNT value on done: 358581.0 [2024-08-06 03:01:55,367][52670] Sum rewards: 62.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.428', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon7': '0.086', 'weapon4': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'AMMO4': '0.151', 'WEAPON7': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '2.974', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '54.000'} [2024-08-06 03:01:55,581][52647] DAMAGECOUNT value on done: 379782.0 [2024-08-06 03:01:55,582][52647] Sum rewards: 60.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.040', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.158', 'AMMO4': '0.175', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.700', 'weapon3': '2.884', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '54.000'} [2024-08-06 03:01:55,882][52650] Updated weights for policy 0, policy_version 42641 (0.0025) [2024-08-06 03:01:56,032][52663] DAMAGECOUNT value on done: 366911.0 [2024-08-06 03:01:56,048][52663] Sum rewards: 58.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.223', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon7': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.143', 'AMMO3': '0.184', 'WEAPON7': '0.200', 'weapon5': '0.222', 'weapon2': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.292', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '48.500'} [2024-08-06 03:01:56,851][52811] DAMAGECOUNT value on done: 342335.0 [2024-08-06 03:01:56,860][52811] Sum rewards: 64.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.827', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.238', 'weapon2': '0.874', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '55.000'} [2024-08-06 03:01:57,207][52795] DAMAGECOUNT value on done: 327288.0 [2024-08-06 03:01:57,207][52795] Sum rewards: 68.152, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.080', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:57,483][52659] DAMAGECOUNT value on done: 372151.0 [2024-08-06 03:01:57,483][52659] Sum rewards: 70.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '59.000'} [2024-08-06 03:01:57,690][52666] DAMAGECOUNT value on done: 359646.0 [2024-08-06 03:01:57,691][52666] Sum rewards: 72.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.145', 'weapon4': '0.186', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '57.000'} [2024-08-06 03:01:57,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 349347840. Throughput: 0: 4390.2. Samples: 87344870. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 03:01:57,795][52567] Avg episode reward: [(0, '66.918')] [2024-08-06 03:01:58,083][52670] DAMAGECOUNT value on done: 361956.0 [2024-08-06 03:01:58,084][52670] Sum rewards: 60.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.560', 'AMMO5': '0.017', 'AMMO2': '0.070', 'AMMO3': '0.204', 'weapon2': '0.260', 'weapon5': '0.290', 'AMMO4': '0.349', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.350', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '51.000'} [2024-08-06 03:01:58,196][52647] DAMAGECOUNT value on done: 377924.0 [2024-08-06 03:01:58,197][52647] Sum rewards: 69.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.132', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.342', 'weapon2': '0.430', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '58.000'} [2024-08-06 03:01:58,439][52803] DAMAGECOUNT value on done: 343723.0 [2024-08-06 03:01:58,441][52803] Sum rewards: 73.372, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.720', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.179', 'AMMO4': '0.194', 'weapon2': '0.230', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '60.000'} [2024-08-06 03:01:58,886][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:01:59,118][52663] DAMAGECOUNT value on done: 364625.0 [2024-08-06 03:01:59,118][52663] Sum rewards: 68.926, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.890', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.160', 'AMMO4': '0.224', 'weapon5': '0.256', 'AMMO3': '0.280', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '61.000'} [2024-08-06 03:01:59,859][52811] DAMAGECOUNT value on done: 342569.0 [2024-08-06 03:01:59,859][52811] Sum rewards: 74.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.346', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '61.000'} [2024-08-06 03:02:00,308][52795] DAMAGECOUNT value on done: 344383.0 [2024-08-06 03:02:00,308][52795] Sum rewards: 67.692, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.119', 'weapon5': '0.176', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.774', 'weapon3': '2.580', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '53.000'} [2024-08-06 03:02:00,324][52659] DAMAGECOUNT value on done: 370852.0 [2024-08-06 03:02:00,328][52659] Sum rewards: 66.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.196', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.233', 'weapon5': '0.236', 'AMMO4': '0.293', 'weapon4': '0.326', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:00,345][52650] Updated weights for policy 0, policy_version 42651 (0.0011) [2024-08-06 03:02:00,693][52666] DAMAGECOUNT value on done: 358028.0 [2024-08-06 03:02:00,694][52666] Sum rewards: 73.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.053', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.152', 'AMMO4': '0.157', 'weapon5': '0.186', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:01,052][52670] DAMAGECOUNT value on done: 354105.0 [2024-08-06 03:02:01,054][52670] Sum rewards: 75.519, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.185', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.141', 'weapon5': '0.146', 'weapon4': '0.152', 'AMMO4': '0.169', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '3.092', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:01,124][52647] DAMAGECOUNT value on done: 377984.0 [2024-08-06 03:02:01,125][52647] Sum rewards: 70.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.106', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.036', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '61.000'} [2024-08-06 03:02:01,431][52803] DAMAGECOUNT value on done: 339359.0 [2024-08-06 03:02:01,432][52803] Sum rewards: 80.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.102', 'AMMO4': '0.170', 'AMMO3': '0.195', 'weapon5': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '64.000'} [2024-08-06 03:02:02,143][52663] DAMAGECOUNT value on done: 362960.0 [2024-08-06 03:02:02,143][52663] Sum rewards: 80.488, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.814', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.231', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '67.000'} [2024-08-06 03:02:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 349437952. Throughput: 0: 4391.1. Samples: 87358130. Policy #0 lag: (min: 1.0, avg: 3.3, max: 8.0) [2024-08-06 03:02:02,794][52567] Avg episode reward: [(0, '67.636')] [2024-08-06 03:02:02,917][52811] DAMAGECOUNT value on done: 338585.0 [2024-08-06 03:02:02,919][52811] Sum rewards: 62.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.954', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.078', 'weapon5': '0.122', 'AMMO4': '0.178', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.660', 'WEAPON3': '1.450', 'weapon3': '2.882', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '54.000'} [2024-08-06 03:02:02,964][52659] DAMAGECOUNT value on done: 369264.0 [2024-08-06 03:02:02,967][52659] Sum rewards: 68.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.019', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.154', 'AMMO4': '0.155', 'AMMO3': '0.176', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.000', 'weapon3': '3.010', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '54.000'} [2024-08-06 03:02:03,432][52795] DAMAGECOUNT value on done: 333882.0 [2024-08-06 03:02:03,433][52795] Sum rewards: 54.861, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO2': '0.032', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '3.206', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '44.000'} [2024-08-06 03:02:03,701][52666] DAMAGECOUNT value on done: 367521.0 [2024-08-06 03:02:03,703][52666] Sum rewards: 61.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.170', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.460', 'weapon4': '0.484', 'WEAPON3': '1.050', 'weapon3': '2.566', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '48.000'} [2024-08-06 03:02:04,063][52670] DAMAGECOUNT value on done: 368183.0 [2024-08-06 03:02:04,064][52670] Sum rewards: 70.326, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.937', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.118', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.748', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:04,164][52647] DAMAGECOUNT value on done: 382576.0 [2024-08-06 03:02:04,164][52647] Sum rewards: 77.562, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.572', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon2': '0.186', 'AMMO3': '0.216', 'AMMO4': '0.220', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '65.000'} [2024-08-06 03:02:04,579][52803] DAMAGECOUNT value on done: 338738.0 [2024-08-06 03:02:04,580][52803] Sum rewards: 75.370, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.330', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '65.000'} [2024-08-06 03:02:05,061][52650] Updated weights for policy 0, policy_version 42661 (0.0013) [2024-08-06 03:02:05,182][52663] DAMAGECOUNT value on done: 359738.0 [2024-08-06 03:02:05,184][52663] Sum rewards: 69.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.110', 'weapon4': '0.120', 'AMMO4': '0.173', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:06,077][52811] DAMAGECOUNT value on done: 341400.0 [2024-08-06 03:02:06,079][52811] Sum rewards: 76.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.287', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.076', 'weapon5': '0.106', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '62.000'} [2024-08-06 03:02:06,092][52659] DAMAGECOUNT value on done: 363841.0 [2024-08-06 03:02:06,093][52659] Sum rewards: 66.757, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.074', 'weapon4': '0.160', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:06,581][52795] DAMAGECOUNT value on done: 336366.0 [2024-08-06 03:02:06,583][52795] Sum rewards: 68.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.160', 'AMMO4': '0.164', 'weapon4': '0.170', 'AMMO3': '0.187', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:06,606][52666] DAMAGECOUNT value on done: 363066.0 [2024-08-06 03:02:06,606][52666] Sum rewards: 72.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.056', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO4': '0.220', 'AMMO3': '0.240', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '62.000'} [2024-08-06 03:02:07,037][52670] DAMAGECOUNT value on done: 359379.0 [2024-08-06 03:02:07,038][52670] Sum rewards: 67.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.084', 'AMMO3': '0.177', 'weapon5': '0.198', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '55.000'} [2024-08-06 03:02:07,638][52803] DAMAGECOUNT value on done: 348136.0 [2024-08-06 03:02:07,639][52803] Sum rewards: 63.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.132', 'AMMO4': '0.188', 'AMMO3': '0.201', 'weapon5': '0.226', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '53.500'} [2024-08-06 03:02:07,723][52663] DAMAGECOUNT value on done: 366207.0 [2024-08-06 03:02:07,724][52663] Sum rewards: 75.719, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.044', 'weapon5': '0.046', 'AMMO4': '0.089', 'HEALTH': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 03:02:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 349519872. Throughput: 0: 4384.6. Samples: 87384350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:02:07,795][52567] Avg episode reward: [(0, '67.565')] [2024-08-06 03:02:08,765][52614] Signal inference workers to stop experience collection... (7700 times) [2024-08-06 03:02:08,765][52614] Signal inference workers to resume experience collection... (7700 times) [2024-08-06 03:02:08,808][52650] InferenceWorker_p0-w0: stopping experience collection (7700 times) [2024-08-06 03:02:08,816][52650] InferenceWorker_p0-w0: resuming experience collection (7700 times) [2024-08-06 03:02:09,154][52659] DAMAGECOUNT value on done: 370685.0 [2024-08-06 03:02:09,156][52659] Sum rewards: 70.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.592', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon4': '0.066', 'weapon5': '0.086', 'weapon2': '0.236', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'HITCOUNT': '3.360', 'weapon3': '3.446', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.500'} [2024-08-06 03:02:09,165][52811] DAMAGECOUNT value on done: 343736.0 [2024-08-06 03:02:09,166][52811] Sum rewards: 65.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.184', 'weapon2': '0.202', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '57.000'} [2024-08-06 03:02:09,443][52666] DAMAGECOUNT value on done: 361276.0 [2024-08-06 03:02:09,446][52666] Sum rewards: 65.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.155', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.066', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.356', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '55.000'} [2024-08-06 03:02:09,735][52795] DAMAGECOUNT value on done: 332784.0 [2024-08-06 03:02:09,737][52795] Sum rewards: 71.331, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.145', 'weapon5': '0.170', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '58.000'} [2024-08-06 03:02:09,868][52670] DAMAGECOUNT value on done: 360735.0 [2024-08-06 03:02:09,868][52670] Sum rewards: 75.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.056', 'AMMO4': '0.076', 'weapon4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.232', 'WEAPON3': '1.400', 'HITCOUNT': '3.370', 'weapon3': '3.426', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '64.000'} [2024-08-06 03:02:10,138][52650] Updated weights for policy 0, policy_version 42671 (0.0029) [2024-08-06 03:02:10,668][52803] DAMAGECOUNT value on done: 342516.0 [2024-08-06 03:02:10,668][52803] Sum rewards: 75.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.195', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.087', 'weapon5': '0.132', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '61.000'} [2024-08-06 03:02:10,760][52663] DAMAGECOUNT value on done: 368498.0 [2024-08-06 03:02:10,761][52663] Sum rewards: 53.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.186', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon4': '0.062', 'weapon5': '0.142', 'AMMO4': '0.212', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.110', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '45.000'} [2024-08-06 03:02:11,703][52659] DAMAGECOUNT value on done: 368634.0 [2024-08-06 03:02:11,703][52659] Sum rewards: 78.470, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.126', 'weapon5': '0.134', 'AMMO3': '0.172', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.772', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 03:02:12,238][52811] DAMAGECOUNT value on done: 340181.0 [2024-08-06 03:02:12,238][52811] Sum rewards: 72.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.654', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.080', 'weapon4': '0.136', 'AMMO3': '0.187', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.332', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:12,468][52666] DAMAGECOUNT value on done: 363221.0 [2024-08-06 03:02:12,469][52666] Sum rewards: 64.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.380', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.186', 'AMMO3': '0.233', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.450', 'weapon3': '2.606', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:12,722][52670] DAMAGECOUNT value on done: 367975.0 [2024-08-06 03:02:12,730][52670] Sum rewards: 75.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.380', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.478', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '64.000'} [2024-08-06 03:02:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 349601792. Throughput: 0: 4392.4. Samples: 87410720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:02:12,794][52567] Avg episode reward: [(0, '68.150')] [2024-08-06 03:02:12,837][52795] DAMAGECOUNT value on done: 340979.0 [2024-08-06 03:02:12,838][52795] Sum rewards: 69.761, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO4': '0.113', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:13,660][52663] DAMAGECOUNT value on done: 366640.0 [2024-08-06 03:02:13,663][52663] Sum rewards: 71.720, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.600', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.132', 'AMMO3': '0.155', 'AMMO4': '0.227', 'weapon4': '0.292', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:13,718][52803] DAMAGECOUNT value on done: 344513.0 [2024-08-06 03:02:13,718][52803] Sum rewards: 55.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.086', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.058', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon2': '0.218', 'AMMO3': '0.224', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.362', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '47.000'} [2024-08-06 03:02:14,493][52650] Updated weights for policy 0, policy_version 42681 (0.0011) [2024-08-06 03:02:15,216][52811] DAMAGECOUNT value on done: 342234.0 [2024-08-06 03:02:15,219][52811] Sum rewards: 68.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.183', 'weapon5': '0.196', 'weapon4': '0.240', 'AMMO4': '0.244', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '55.000'} [2024-08-06 03:02:15,334][52666] DAMAGECOUNT value on done: 362479.0 [2024-08-06 03:02:15,336][52666] Sum rewards: 74.778, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.594', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.019', 'weapon4': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.772', 'WEAPON3': '1.100', 'weapon3': '2.892', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:15,632][52670] DAMAGECOUNT value on done: 364157.0 [2024-08-06 03:02:15,634][52670] Sum rewards: 75.288, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.280', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.134', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'weapon2': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.297', 'WEAPON3': '1.800', 'weapon3': '3.278', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '64.000'} [2024-08-06 03:02:15,943][52795] DAMAGECOUNT value on done: 330478.0 [2024-08-06 03:02:15,944][52795] Sum rewards: 68.729, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.086', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.266', 'weapon2': '0.368', 'WEAPON3': '1.650', 'weapon3': '3.234', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:16,876][52663] DAMAGECOUNT value on done: 359045.0 [2024-08-06 03:02:16,877][52663] Sum rewards: 72.802, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO3': '0.170', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:16,927][52803] DAMAGECOUNT value on done: 337731.0 [2024-08-06 03:02:16,930][52803] Sum rewards: 73.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.091', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.100', 'weapon4': '0.156', 'weapon2': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '63.000'} [2024-08-06 03:02:17,572][52667] DAMAGECOUNT value on done: 364967.0 [2024-08-06 03:02:17,573][52667] Sum rewards: 71.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.726', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon4': '0.282', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '61.000'} [2024-08-06 03:02:17,678][52666] DAMAGECOUNT value on done: 362762.0 [2024-08-06 03:02:17,679][52666] Sum rewards: 70.060, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.028', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.105', 'AMMO3': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '0.900', 'HITCOUNT': '3.110', 'weapon3': '3.252', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '55.000'} [2024-08-06 03:02:17,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 349700096. Throughput: 0: 4385.8. Samples: 87423700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:02:17,794][52567] Avg episode reward: [(0, '68.261')] [2024-08-06 03:02:18,027][52670] DAMAGECOUNT value on done: 348422.0 [2024-08-06 03:02:18,029][52670] Sum rewards: 61.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.180', 'AMMO3': '0.188', 'AMMO4': '0.219', 'weapon5': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.668', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '51.000'} [2024-08-06 03:02:19,095][52795] DAMAGECOUNT value on done: 349424.0 [2024-08-06 03:02:19,095][52795] Sum rewards: 84.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.080', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.222', 'FRAGCOUNT': '68.000'} [2024-08-06 03:02:19,440][52650] Updated weights for policy 0, policy_version 42691 (0.0069) [2024-08-06 03:02:20,080][52667] DAMAGECOUNT value on done: 370931.0 [2024-08-06 03:02:20,082][52667] Sum rewards: 71.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.086', 'AMMO4': '0.101', 'weapon5': '0.118', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:20,185][52663] DAMAGECOUNT value on done: 360204.0 [2024-08-06 03:02:20,187][52663] Sum rewards: 69.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.164', 'AMMO3': '0.188', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 03:02:20,586][52666] DAMAGECOUNT value on done: 354771.0 [2024-08-06 03:02:20,586][52666] Sum rewards: 67.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.588', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.263', 'weapon2': '0.354', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.428', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:21,159][52670] DAMAGECOUNT value on done: 364450.0 [2024-08-06 03:02:21,159][52670] Sum rewards: 66.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.148', 'AMMO4': '0.188', 'AMMO3': '0.207', 'weapon2': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '54.000'} [2024-08-06 03:02:22,274][52795] DAMAGECOUNT value on done: 340197.0 [2024-08-06 03:02:22,275][52795] Sum rewards: 77.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.226', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '61.000'} [2024-08-06 03:02:22,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 349790208. Throughput: 0: 4384.4. Samples: 87450080. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:02:22,794][52567] Avg episode reward: [(0, '68.606')] [2024-08-06 03:02:22,955][52663] DAMAGECOUNT value on done: 361455.0 [2024-08-06 03:02:22,956][52663] Sum rewards: 64.490, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.950', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.082', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.242', 'WEAPON3': '1.100', 'HITCOUNT': '3.320', 'weapon3': '3.384', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '51.000'} [2024-08-06 03:02:23,215][52667] DAMAGECOUNT value on done: 364301.0 [2024-08-06 03:02:23,215][52667] Sum rewards: 51.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.467', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.140', 'weapon5': '0.198', 'AMMO3': '0.251', 'AMMO4': '0.292', 'weapon2': '0.436', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.780', 'weapon3': '2.944', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '46.000'} [2024-08-06 03:02:23,404][52666] DAMAGECOUNT value on done: 362745.0 [2024-08-06 03:02:23,404][52666] Sum rewards: 71.059, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.092', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.262', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '58.000'} [2024-08-06 03:02:23,931][52650] Updated weights for policy 0, policy_version 42701 (0.0017) [2024-08-06 03:02:23,993][52670] DAMAGECOUNT value on done: 369491.0 [2024-08-06 03:02:23,995][52670] Sum rewards: 66.476, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'weapon2': '0.252', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.700', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:24,780][52820] DAMAGECOUNT value on done: 334377.0 [2024-08-06 03:02:24,782][52820] Sum rewards: 64.818, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.427', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon2': '0.352', 'WEAPON3': '0.950', 'HITCOUNT': '2.990', 'weapon3': '3.424', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2024-08-06 03:02:25,484][52795] DAMAGECOUNT value on done: 331000.0 [2024-08-06 03:02:25,484][52795] Sum rewards: 66.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.775', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.087', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '54.000'} [2024-08-06 03:02:25,632][52663] DAMAGECOUNT value on done: 371569.0 [2024-08-06 03:02:25,636][52663] Sum rewards: 75.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.054', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon4': '0.194', 'AMMO3': '0.217', 'weapon5': '0.270', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '64.000'} [2024-08-06 03:02:26,078][52667] DAMAGECOUNT value on done: 366904.0 [2024-08-06 03:02:26,078][52667] Sum rewards: 64.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.868', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon4': '0.120', 'AMMO3': '0.181', 'weapon5': '0.278', 'AMMO4': '0.330', 'weapon2': '0.504', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '53.000'} [2024-08-06 03:02:26,474][52670] DAMAGECOUNT value on done: 362780.0 [2024-08-06 03:02:26,474][52670] Sum rewards: 71.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.005', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.398', 'WEAPON3': '1.000', 'weapon3': '3.044', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '57.000'} [2024-08-06 03:02:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 349872128. Throughput: 0: 4377.6. Samples: 87476100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:02:27,802][52567] Avg episode reward: [(0, '68.654')] [2024-08-06 03:02:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042709_349872128.pth... [2024-08-06 03:02:27,951][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042196_345669632.pth [2024-08-06 03:02:28,197][52820] DAMAGECOUNT value on done: 338950.0 [2024-08-06 03:02:28,199][52820] Sum rewards: 54.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.162', 'AMMO4': '0.202', 'weapon2': '0.214', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.358', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '48.000'} [2024-08-06 03:02:28,261][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:02:28,437][52650] Updated weights for policy 0, policy_version 42711 (0.0035) [2024-08-06 03:02:28,645][52795] DAMAGECOUNT value on done: 341112.0 [2024-08-06 03:02:28,645][52795] Sum rewards: 68.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.957', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.245', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:28,694][52663] DAMAGECOUNT value on done: 363615.0 [2024-08-06 03:02:28,696][52663] Sum rewards: 70.562, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.080', 'AMMO5': '0.023', 'AMMO2': '0.043', 'AMMO4': '0.217', 'weapon5': '0.218', 'AMMO3': '0.264', 'weapon2': '0.272', 'WEAPON5': '0.450', 'weapon4': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.682', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '62.000'} [2024-08-06 03:02:29,011][52667] DAMAGECOUNT value on done: 370653.0 [2024-08-06 03:02:29,012][52667] Sum rewards: 69.787, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.795', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.086', 'weapon4': '0.122', 'AMMO4': '0.125', 'weapon2': '0.156', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.454', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '58.000'} [2024-08-06 03:02:29,440][52670] DAMAGECOUNT value on done: 361704.0 [2024-08-06 03:02:29,442][52670] Sum rewards: 63.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.411', 'AMMO5': '0.023', 'AMMO2': '0.063', 'weapon4': '0.224', 'AMMO3': '0.242', 'AMMO4': '0.314', 'weapon5': '0.328', 'weapon2': '0.428', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.698', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '54.500'} [2024-08-06 03:02:31,252][52820] DAMAGECOUNT value on done: 338849.0 [2024-08-06 03:02:31,252][52820] Sum rewards: 66.988, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.582', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.128', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.300', 'HITCOUNT': '3.470', 'weapon3': '3.478', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '58.000'} [2024-08-06 03:02:31,736][52663] DAMAGECOUNT value on done: 370068.0 [2024-08-06 03:02:31,738][52663] Sum rewards: 69.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.186', 'weapon5': '0.188', 'AMMO4': '0.226', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '57.000'} [2024-08-06 03:02:31,803][52795] DAMAGECOUNT value on done: 345802.0 [2024-08-06 03:02:31,804][52795] Sum rewards: 71.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.134', 'weapon2': '0.192', 'AMMO4': '0.202', 'weapon4': '0.204', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:32,181][52667] DAMAGECOUNT value on done: 371075.0 [2024-08-06 03:02:32,181][52667] Sum rewards: 68.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.152', 'weapon4': '0.168', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '57.000'} [2024-08-06 03:02:32,371][52666] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0)] [2024-08-06 03:02:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 349954048. Throughput: 0: 4375.1. Samples: 87489010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:02:32,794][52567] Avg episode reward: [(0, '68.903')] [2024-08-06 03:02:33,296][52650] Updated weights for policy 0, policy_version 42721 (0.0012) [2024-08-06 03:02:34,490][52820] DAMAGECOUNT value on done: 335060.0 [2024-08-06 03:02:34,490][52820] Sum rewards: 64.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.416', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.204', 'AMMO3': '0.217', 'weapon5': '0.296', 'AMMO4': '0.323', 'weapon2': '0.446', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '55.000'} [2024-08-06 03:02:34,687][52663] DAMAGECOUNT value on done: 366053.0 [2024-08-06 03:02:34,689][52663] Sum rewards: 67.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.459', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.156', 'AMMO3': '0.199', 'AMMO4': '0.216', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '54.500'} [2024-08-06 03:02:34,852][52667] DAMAGECOUNT value on done: 371569.0 [2024-08-06 03:02:34,854][52667] Sum rewards: 64.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.306', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.136', 'weapon5': '0.160', 'AMMO4': '0.166', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:37,062][52663] DAMAGECOUNT value on done: 360730.0 [2024-08-06 03:02:37,063][52663] Sum rewards: 63.065, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.056', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'HEALTH': '0.189', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.252', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '51.000'} [2024-08-06 03:02:37,516][52667] DAMAGECOUNT value on done: 367201.0 [2024-08-06 03:02:37,518][52667] Sum rewards: 75.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.072', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '62.000'} [2024-08-06 03:02:37,731][52820] DAMAGECOUNT value on done: 339823.0 [2024-08-06 03:02:37,733][52820] Sum rewards: 82.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.110', 'weapon4': '0.144', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '68.000'} [2024-08-06 03:02:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 350044160. Throughput: 0: 4370.4. Samples: 87515290. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:02:37,795][52567] Avg episode reward: [(0, '68.870')] [2024-08-06 03:02:37,922][52650] Updated weights for policy 0, policy_version 42731 (0.0036) [2024-08-06 03:02:40,475][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:02:40,679][52667] DAMAGECOUNT value on done: 366539.0 [2024-08-06 03:02:40,681][52667] Sum rewards: 63.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.120', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '54.000'} [2024-08-06 03:02:40,884][52820] DAMAGECOUNT value on done: 333233.0 [2024-08-06 03:02:40,884][52820] Sum rewards: 68.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '57.000'} [2024-08-06 03:02:42,575][52665] DAMAGECOUNT value on done: 359329.0 [2024-08-06 03:02:42,576][52665] Sum rewards: 71.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.051', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.094', 'weapon5': '0.116', 'AMMO3': '0.204', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:42,694][52650] Updated weights for policy 0, policy_version 42741 (0.0024) [2024-08-06 03:02:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 350134272. Throughput: 0: 4372.3. Samples: 87541620. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:02:42,794][52567] Avg episode reward: [(0, '68.652')] [2024-08-06 03:02:43,177][52667] DAMAGECOUNT value on done: 374356.0 [2024-08-06 03:02:43,177][52667] Sum rewards: 65.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.068', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.272', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.360', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:44,006][52820] DAMAGECOUNT value on done: 334944.0 [2024-08-06 03:02:44,006][52820] Sum rewards: 69.032, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'AMMO4': '0.203', 'HEALTH': '0.290', 'weapon4': '0.364', 'weapon2': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.510', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '55.000'} [2024-08-06 03:02:45,105][52665] DAMAGECOUNT value on done: 369401.0 [2024-08-06 03:02:45,105][52665] Sum rewards: 66.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.904', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'weapon2': '0.240', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.392', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '58.000'} [2024-08-06 03:02:45,199][52662] DAMAGECOUNT value on done: 375920.0 [2024-08-06 03:02:45,202][52662] Sum rewards: 61.617, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.495', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.173', 'weapon5': '0.174', 'weapon2': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '51.000'} [2024-08-06 03:02:46,323][52667] DAMAGECOUNT value on done: 365426.0 [2024-08-06 03:02:46,332][52667] Sum rewards: 77.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.070', 'weapon4': '0.074', 'AMMO4': '0.097', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '65.000'} [2024-08-06 03:02:47,163][52650] Updated weights for policy 0, policy_version 42751 (0.0011) [2024-08-06 03:02:47,219][52820] DAMAGECOUNT value on done: 342785.0 [2024-08-06 03:02:47,221][52820] Sum rewards: 72.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.094', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:47,616][52665] DAMAGECOUNT value on done: 367640.0 [2024-08-06 03:02:47,617][52665] Sum rewards: 82.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.324', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.203', 'weapon2': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '68.000'} [2024-08-06 03:02:47,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 350224384. Throughput: 0: 4370.9. Samples: 87554820. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:02:47,794][52567] Avg episode reward: [(0, '68.966')] [2024-08-06 03:02:48,392][52662] DAMAGECOUNT value on done: 371582.0 [2024-08-06 03:02:48,394][52662] Sum rewards: 66.059, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.233', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.133', 'weapon4': '0.182', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '56.000'} [2024-08-06 03:02:49,361][52667] DAMAGECOUNT value on done: 369360.0 [2024-08-06 03:02:49,362][52667] Sum rewards: 75.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.160', 'weapon4': '0.260', 'weapon5': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.582', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:50,355][52820] DAMAGECOUNT value on done: 338168.0 [2024-08-06 03:02:50,356][52820] Sum rewards: 63.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.022', 'AMMO2': '0.044', 'weapon4': '0.198', 'AMMO4': '0.220', 'AMMO3': '0.236', 'weapon5': '0.248', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.886', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '54.000'} [2024-08-06 03:02:50,592][52665] DAMAGECOUNT value on done: 361385.0 [2024-08-06 03:02:50,592][52665] Sum rewards: 73.839, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.114', 'AMMO4': '0.169', 'weapon5': '0.194', 'AMMO3': '0.222', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '61.000'} [2024-08-06 03:02:51,612][52662] DAMAGECOUNT value on done: 372586.0 [2024-08-06 03:02:51,613][52662] Sum rewards: 77.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.090', 'weapon4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.218', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.386', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '66.000'} [2024-08-06 03:02:51,843][52650] Updated weights for policy 0, policy_version 42761 (0.0026) [2024-08-06 03:02:52,046][52667] DAMAGECOUNT value on done: 368811.0 [2024-08-06 03:02:52,047][52667] Sum rewards: 61.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.162', 'AMMO4': '0.255', 'weapon5': '0.262', 'weapon4': '0.284', 'weapon2': '0.356', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.828', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '50.500'} [2024-08-06 03:02:52,592][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:02:52,796][52567] Fps is (10 sec: 17200.5, 60 sec: 17475.8, 300 sec: 17494.7). Total num frames: 350306304. Throughput: 0: 4373.0. Samples: 87581140. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:02:52,796][52567] Avg episode reward: [(0, '69.391')] [2024-08-06 03:02:53,294][52668] DAMAGECOUNT value on done: 363235.0 [2024-08-06 03:02:53,294][52668] Sum rewards: 67.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO4': '0.214', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.246', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '57.000'} [2024-08-06 03:02:53,443][52820] DAMAGECOUNT value on done: 341523.0 [2024-08-06 03:02:53,443][52820] Sum rewards: 74.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.449', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.124', 'AMMO4': '0.199', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '62.000'} [2024-08-06 03:02:53,728][52665] DAMAGECOUNT value on done: 356050.0 [2024-08-06 03:02:53,728][52665] Sum rewards: 71.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.325', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.154', 'weapon2': '0.190', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.316', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:54,153][52662] DAMAGECOUNT value on done: 361738.0 [2024-08-06 03:02:54,154][52662] Sum rewards: 73.193, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.826', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.112', 'weapon5': '0.166', 'AMMO4': '0.200', 'weapon2': '0.266', 'AMMO3': '0.287', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.088', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '64.500'} [2024-08-06 03:02:54,520][52667] DAMAGECOUNT value on done: 363972.0 [2024-08-06 03:02:54,521][52667] Sum rewards: 77.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.805', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '65.000'} [2024-08-06 03:02:56,169][52668] DAMAGECOUNT value on done: 369345.0 [2024-08-06 03:02:56,170][52668] Sum rewards: 73.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.414', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.112', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON3': '1.000', 'weapon3': '3.334', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:56,492][52650] Updated weights for policy 0, policy_version 42771 (0.0011) [2024-08-06 03:02:56,547][52665] DAMAGECOUNT value on done: 357329.0 [2024-08-06 03:02:56,549][52665] Sum rewards: 70.373, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon4': '0.082', 'weapon5': '0.216', 'weapon2': '0.218', 'AMMO3': '0.254', 'AMMO4': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:56,598][52820] DAMAGECOUNT value on done: 336952.0 [2024-08-06 03:02:56,599][52820] Sum rewards: 56.381, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.744', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.157', 'weapon2': '0.238', 'AMMO4': '0.252', 'weapon5': '0.288', 'weapon4': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.354', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '47.000'} [2024-08-06 03:02:57,045][52662] DAMAGECOUNT value on done: 372255.0 [2024-08-06 03:02:57,055][52662] Sum rewards: 70.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.245', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:57,621][52667] DAMAGECOUNT value on done: 371261.0 [2024-08-06 03:02:57,622][52667] Sum rewards: 70.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.411', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.106', 'weapon5': '0.112', 'AMMO4': '0.178', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '58.000'} [2024-08-06 03:02:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 350396416. Throughput: 0: 4375.1. Samples: 87607600. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:02:57,794][52567] Avg episode reward: [(0, '69.571')] [2024-08-06 03:02:58,856][52668] DAMAGECOUNT value on done: 371796.0 [2024-08-06 03:02:58,857][52668] Sum rewards: 72.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.285', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon5': '0.200', 'AMMO4': '0.244', 'AMMO3': '0.253', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '61.000'} [2024-08-06 03:02:59,284][52665] DAMAGECOUNT value on done: 363572.0 [2024-08-06 03:02:59,284][52665] Sum rewards: 71.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.481', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.174', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.326', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '59.000'} [2024-08-06 03:02:59,632][52820] DAMAGECOUNT value on done: 341249.0 [2024-08-06 03:02:59,637][52820] Sum rewards: 70.280, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.382', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.201', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.500', 'weapon3': '2.846', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '60.000'} [2024-08-06 03:02:59,915][52662] DAMAGECOUNT value on done: 365728.0 [2024-08-06 03:02:59,916][52662] Sum rewards: 70.656, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.072', 'weapon4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:00,175][52669] DAMAGECOUNT value on done: 370283.0 [2024-08-06 03:03:00,177][52669] Sum rewards: 68.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.142', 'AMMO3': '0.203', 'weapon4': '0.254', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:00,343][52667] DAMAGECOUNT value on done: 376981.0 [2024-08-06 03:03:00,345][52667] Sum rewards: 73.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.834', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon4': '0.282', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:01,178][52650] Updated weights for policy 0, policy_version 42781 (0.0038) [2024-08-06 03:03:01,822][52668] DAMAGECOUNT value on done: 372145.0 [2024-08-06 03:03:01,826][52668] Sum rewards: 68.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.165', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.206', 'AMMO3': '0.215', 'AMMO4': '0.261', 'weapon2': '0.272', 'weapon5': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:02,409][52665] DAMAGECOUNT value on done: 367724.0 [2024-08-06 03:03:02,410][52665] Sum rewards: 77.070, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.289', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.292', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '67.000'} [2024-08-06 03:03:02,691][52669] DAMAGECOUNT value on done: 362318.0 [2024-08-06 03:03:02,691][52669] Sum rewards: 66.972, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.641', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:02,794][52567] Fps is (10 sec: 18025.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 350486528. Throughput: 0: 4381.3. Samples: 87620860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:03:02,794][52567] Avg episode reward: [(0, '69.637')] [2024-08-06 03:03:02,801][52820] DAMAGECOUNT value on done: 344950.0 [2024-08-06 03:03:02,802][52820] Sum rewards: 68.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.187', 'weapon5': '0.210', 'AMMO4': '0.220', 'weapon2': '0.274', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:02,899][52662] DAMAGECOUNT value on done: 375242.0 [2024-08-06 03:03:02,900][52662] Sum rewards: 78.004, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.473', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.218', 'weapon5': '0.242', 'AMMO4': '0.257', 'AMMO3': '0.304', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.722', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '69.000'} [2024-08-06 03:03:02,967][52667] DAMAGECOUNT value on done: 376383.0 [2024-08-06 03:03:02,967][52667] Sum rewards: 63.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.029', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.057', 'weapon5': '0.128', 'weapon2': '0.210', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'AMMO4': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:05,080][52668] DAMAGECOUNT value on done: 362998.0 [2024-08-06 03:03:05,080][52668] Sum rewards: 68.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.226', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.152', 'weapon2': '0.178', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:05,348][52669] DAMAGECOUNT value on done: 372195.0 [2024-08-06 03:03:05,349][52669] Sum rewards: 77.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.365', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.163', 'weapon4': '0.166', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '67.000'} [2024-08-06 03:03:05,542][52665] DAMAGECOUNT value on done: 366894.0 [2024-08-06 03:03:05,542][52665] Sum rewards: 73.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.086', 'weapon4': '0.098', 'weapon2': '0.144', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.472', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:05,731][52650] Updated weights for policy 0, policy_version 42791 (0.0011) [2024-08-06 03:03:05,860][52667] DAMAGECOUNT value on done: 374141.0 [2024-08-06 03:03:05,860][52667] Sum rewards: 68.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.211', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.105', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '59.000'} [2024-08-06 03:03:05,870][52820] DAMAGECOUNT value on done: 340431.0 [2024-08-06 03:03:05,871][52820] Sum rewards: 64.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.234', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.206', 'AMMO3': '0.256', 'weapon2': '0.338', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.244', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:05,945][52662] DAMAGECOUNT value on done: 376190.0 [2024-08-06 03:03:05,946][52662] Sum rewards: 54.714, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.149', 'weapon2': '0.162', 'weapon4': '0.180', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.322', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '45.000'} [2024-08-06 03:03:07,760][52669] DAMAGECOUNT value on done: 365969.0 [2024-08-06 03:03:07,769][52669] Sum rewards: 74.829, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'weapon4': '0.090', 'AMMO4': '0.121', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'HEALTH': '0.392', 'WEAPON3': '1.000', 'weapon3': '3.368', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '59.000'} [2024-08-06 03:03:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 350576640. Throughput: 0: 4386.5. Samples: 87647470. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:03:07,794][52567] Avg episode reward: [(0, '69.432')] [2024-08-06 03:03:08,118][52668] DAMAGECOUNT value on done: 371567.0 [2024-08-06 03:03:08,118][52668] Sum rewards: 76.015, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.242', 'WEAPON3': '1.250', 'weapon3': '3.448', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:08,472][52649] DAMAGECOUNT value on done: 360324.0 [2024-08-06 03:03:08,475][52649] Sum rewards: 71.922, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.108', 'weapon5': '0.118', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon2': '0.330', 'WEAPON3': '1.650', 'weapon3': '3.190', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:08,598][52667] DAMAGECOUNT value on done: 365549.0 [2024-08-06 03:03:08,599][52667] Sum rewards: 65.476, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.053', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.145', 'weapon2': '0.168', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.340', 'WEAPON3': '0.850', 'HITCOUNT': '2.820', 'weapon3': '3.122', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '51.000'} [2024-08-06 03:03:08,678][52665] DAMAGECOUNT value on done: 363162.0 [2024-08-06 03:03:08,678][52665] Sum rewards: 53.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.752', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.174', 'weapon4': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.970', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '45.000'} [2024-08-06 03:03:09,049][52820] DAMAGECOUNT value on done: 343938.0 [2024-08-06 03:03:09,050][52820] Sum rewards: 63.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.423', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.132', 'AMMO3': '0.168', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '53.000'} [2024-08-06 03:03:09,058][52662] DAMAGECOUNT value on done: 368548.0 [2024-08-06 03:03:09,058][52662] Sum rewards: 73.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.126', 'AMMO4': '0.131', 'weapon5': '0.194', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '63.000'} [2024-08-06 03:03:09,797][52658] DAMAGECOUNT value on done: 367535.0 [2024-08-06 03:03:09,799][52658] Sum rewards: 71.204, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.372', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.312', 'WEAPON3': '1.850', 'weapon3': '3.226', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '62.500'} [2024-08-06 03:03:10,453][52650] Updated weights for policy 0, policy_version 42801 (0.0020) [2024-08-06 03:03:10,558][52669] DAMAGECOUNT value on done: 366341.0 [2024-08-06 03:03:10,558][52669] Sum rewards: 70.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.376', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '59.000'} [2024-08-06 03:03:11,134][52649] DAMAGECOUNT value on done: 353646.0 [2024-08-06 03:03:11,134][52649] Sum rewards: 88.320, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.412', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '70.000'} [2024-08-06 03:03:11,265][52668] DAMAGECOUNT value on done: 370115.0 [2024-08-06 03:03:11,266][52668] Sum rewards: 72.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.055', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.110', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.272', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.256', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:11,366][52665] DAMAGECOUNT value on done: 370765.0 [2024-08-06 03:03:11,367][52665] Sum rewards: 81.082, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.094', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.100', 'weapon3': '3.294', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '66.000'} [2024-08-06 03:03:11,731][52667] DAMAGECOUNT value on done: 373101.0 [2024-08-06 03:03:11,731][52667] Sum rewards: 64.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.094', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.164', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:12,175][52662] DAMAGECOUNT value on done: 380166.0 [2024-08-06 03:03:12,176][52662] Sum rewards: 75.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.494', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.184', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:12,194][52820] DAMAGECOUNT value on done: 339684.0 [2024-08-06 03:03:12,194][52820] Sum rewards: 65.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.508', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.080', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.436', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.3, 300 sec: 17522.5). Total num frames: 350666752. Throughput: 0: 4390.9. Samples: 87673690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:03:12,802][52567] Avg episode reward: [(0, '69.651')] [2024-08-06 03:03:12,839][52658] DAMAGECOUNT value on done: 368403.0 [2024-08-06 03:03:12,839][52658] Sum rewards: 83.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.276', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '3.224', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '68.000'} [2024-08-06 03:03:13,017][52669] DAMAGECOUNT value on done: 368419.0 [2024-08-06 03:03:13,019][52669] Sum rewards: 71.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.435', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.117', 'AMMO3': '0.206', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:13,387][52660] DAMAGECOUNT value on done: 364962.0 [2024-08-06 03:03:13,392][52660] Sum rewards: 75.606, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.173', 'weapon5': '0.174', 'AMMO4': '0.190', 'weapon4': '0.216', 'WEAPON5': '0.250', 'HEALTH': '0.289', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '2.862', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:13,861][52649] DAMAGECOUNT value on done: 359765.0 [2024-08-06 03:03:13,861][52649] Sum rewards: 80.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.075', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.092', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '68.000'} [2024-08-06 03:03:13,880][52665] DAMAGECOUNT value on done: 364805.0 [2024-08-06 03:03:13,880][52665] Sum rewards: 74.481, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.754', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.257', 'WEAPON3': '1.550', 'HITCOUNT': '3.400', 'weapon3': '3.442', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:14,425][52668] DAMAGECOUNT value on done: 363660.0 [2024-08-06 03:03:14,426][52668] Sum rewards: 61.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.126', 'AMMO3': '0.200', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.280', 'weapon4': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '51.000'} [2024-08-06 03:03:14,882][52662] DAMAGECOUNT value on done: 365448.0 [2024-08-06 03:03:14,882][52662] Sum rewards: 57.418, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.096', 'AMMO3': '0.194', 'weapon5': '0.204', 'weapon2': '0.288', 'AMMO4': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.450', 'weapon3': '3.152', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '48.500'} [2024-08-06 03:03:15,192][52650] Updated weights for policy 0, policy_version 42811 (0.0015) [2024-08-06 03:03:15,374][52820] DAMAGECOUNT value on done: 338819.0 [2024-08-06 03:03:15,377][52820] Sum rewards: 56.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.236', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO4': '0.042', 'weapon4': '0.044', 'WEAPON4': '0.100', 'weapon5': '0.160', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.650', 'HITCOUNT': '2.930', 'weapon3': '3.036', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:15,729][52658] DAMAGECOUNT value on done: 372570.0 [2024-08-06 03:03:15,729][52658] Sum rewards: 58.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.316', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.408', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '51.000'} [2024-08-06 03:03:15,878][52669] DAMAGECOUNT value on done: 368856.0 [2024-08-06 03:03:15,878][52669] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.987', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.090', 'AMMO3': '0.203', 'AMMO4': '0.211', 'weapon5': '0.246', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:15,912][52660] DAMAGECOUNT value on done: 361737.0 [2024-08-06 03:03:15,914][52660] Sum rewards: 67.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.420', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon5': '0.280', 'weapon2': '0.594', 'WEAPON3': '0.950', 'weapon3': '2.902', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:16,063][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:03:16,695][52668] DAMAGECOUNT value on done: 366508.0 [2024-08-06 03:03:16,697][52668] Sum rewards: 67.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.058', 'AMMO4': '0.162', 'AMMO3': '0.206', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:17,208][52649] DAMAGECOUNT value on done: 356202.0 [2024-08-06 03:03:17,209][52649] Sum rewards: 66.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.158', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.242', 'weapon4': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.460', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:17,304][52665] DAMAGECOUNT value on done: 361658.0 [2024-08-06 03:03:17,304][52665] Sum rewards: 61.620, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.703', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.114', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'AMMO3': '0.296', 'weapon2': '0.312', 'WEAPON3': '1.800', 'weapon3': '3.188', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 350748672. Throughput: 0: 4401.6. Samples: 87687080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:03:17,794][52567] Avg episode reward: [(0, '69.298')] [2024-08-06 03:03:18,084][52662] DAMAGECOUNT value on done: 369235.0 [2024-08-06 03:03:18,084][52662] Sum rewards: 72.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.256', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:18,238][52660] DAMAGECOUNT value on done: 372817.0 [2024-08-06 03:03:18,240][52660] Sum rewards: 68.649, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.023', 'HEALTH': '0.062', 'AMMO4': '0.116', 'weapon5': '0.158', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:18,578][52820] DAMAGECOUNT value on done: 347399.0 [2024-08-06 03:03:18,580][52820] Sum rewards: 76.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.965', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.134', 'weapon4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:18,817][52658] DAMAGECOUNT value on done: 371051.0 [2024-08-06 03:03:18,818][52658] Sum rewards: 81.171, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.081', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '65.000'} [2024-08-06 03:03:18,899][52669] DAMAGECOUNT value on done: 369992.0 [2024-08-06 03:03:18,901][52669] Sum rewards: 75.114, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.152', 'AMMO3': '0.153', 'weapon4': '0.246', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.350', 'HEALTH': '0.489', 'WEAPON3': '0.900', 'weapon3': '3.052', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:19,280][52668] DAMAGECOUNT value on done: 368277.0 [2024-08-06 03:03:19,282][52668] Sum rewards: 57.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.908', 'WEAPON3': '1.100', 'weapon3': '2.836', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '13.710', 'FRAGCOUNT': '48.500'} [2024-08-06 03:03:20,057][52650] Updated weights for policy 0, policy_version 42821 (0.0012) [2024-08-06 03:03:20,443][52649] DAMAGECOUNT value on done: 350061.0 [2024-08-06 03:03:20,446][52649] Sum rewards: 70.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.148', 'AMMO4': '0.155', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '59.000'} [2024-08-06 03:03:20,515][52665] DAMAGECOUNT value on done: 361932.0 [2024-08-06 03:03:20,517][52665] Sum rewards: 73.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.520', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.160', 'weapon5': '0.178', 'AMMO4': '0.240', 'weapon4': '0.320', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.942', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:21,237][52660] DAMAGECOUNT value on done: 373315.0 [2024-08-06 03:03:21,239][52660] Sum rewards: 67.309, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.122', 'weapon5': '0.162', 'weapon2': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'weapon3': '3.252', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '59.500'} [2024-08-06 03:03:21,246][52662] DAMAGECOUNT value on done: 372856.0 [2024-08-06 03:03:21,248][52662] Sum rewards: 76.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.038', 'weapon5': '0.048', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:21,453][52669] DAMAGECOUNT value on done: 370414.0 [2024-08-06 03:03:21,453][52669] Sum rewards: 74.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.160', 'weapon5': '0.164', 'AMMO3': '0.194', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:21,721][52820] DAMAGECOUNT value on done: 348904.0 [2024-08-06 03:03:21,722][52820] Sum rewards: 62.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.838', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.146', 'AMMO3': '0.192', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:22,219][52658] DAMAGECOUNT value on done: 364480.0 [2024-08-06 03:03:22,221][52658] Sum rewards: 63.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.430', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:22,306][52668] DAMAGECOUNT value on done: 369600.0 [2024-08-06 03:03:22,308][52668] Sum rewards: 79.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.012', 'AMMO4': '0.053', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '67.000'} [2024-08-06 03:03:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 350838784. Throughput: 0: 4400.5. Samples: 87713310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:03:22,795][52567] Avg episode reward: [(0, '69.991')] [2024-08-06 03:03:22,802][52614] Saving new best policy, reward=69.991! [2024-08-06 03:03:23,291][52649] DAMAGECOUNT value on done: 359559.0 [2024-08-06 03:03:23,291][52649] Sum rewards: 56.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.104', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.242', 'WEAPON3': '1.050', 'HITCOUNT': '2.800', 'weapon3': '3.256', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '47.000'} [2024-08-06 03:03:23,339][52665] DAMAGECOUNT value on done: 366086.0 [2024-08-06 03:03:23,339][52665] Sum rewards: 71.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.890', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.284', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '63.000'} [2024-08-06 03:03:23,857][52662] DAMAGECOUNT value on done: 376046.0 [2024-08-06 03:03:23,858][52662] Sum rewards: 63.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.112', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '53.000'} [2024-08-06 03:03:23,985][52669] DAMAGECOUNT value on done: 367917.0 [2024-08-06 03:03:23,986][52669] Sum rewards: 61.375, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.872', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.110', 'weapon5': '0.186', 'AMMO4': '0.245', 'weapon2': '0.278', 'AMMO3': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.850', 'weapon3': '2.996', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:24,235][52664] DAMAGECOUNT value on done: 381837.0 [2024-08-06 03:03:24,236][52664] Sum rewards: 74.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.021', 'AMMO2': '0.047', 'weapon4': '0.092', 'AMMO3': '0.182', 'AMMO4': '0.233', 'weapon5': '0.294', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.856', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:24,485][52660] DAMAGECOUNT value on done: 366536.0 [2024-08-06 03:03:24,485][52660] Sum rewards: 76.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.082', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.342', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '63.000'} [2024-08-06 03:03:24,578][52650] Updated weights for policy 0, policy_version 42831 (0.0019) [2024-08-06 03:03:24,838][52820] DAMAGECOUNT value on done: 339090.0 [2024-08-06 03:03:24,839][52820] Sum rewards: 57.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.022', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.144', 'AMMO4': '0.162', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.056', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '46.000'} [2024-08-06 03:03:25,048][52658] DAMAGECOUNT value on done: 368253.0 [2024-08-06 03:03:25,051][52658] Sum rewards: 80.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.086', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '69.000'} [2024-08-06 03:03:25,584][52668] DAMAGECOUNT value on done: 363536.0 [2024-08-06 03:03:25,585][52668] Sum rewards: 50.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.087', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.162', 'AMMO3': '0.192', 'weapon2': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.002', 'DAMAGECOUNT': '13.161', 'FRAGCOUNT': '43.000'} [2024-08-06 03:03:26,227][52649] DAMAGECOUNT value on done: 354753.0 [2024-08-06 03:03:26,227][52649] Sum rewards: 57.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.695', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon4': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '48.000'} [2024-08-06 03:03:26,286][52665] DAMAGECOUNT value on done: 362846.0 [2024-08-06 03:03:26,289][52665] Sum rewards: 81.307, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.040', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.202', 'weapon2': '0.264', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.274', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '70.000'} [2024-08-06 03:03:26,741][52669] DAMAGECOUNT value on done: 374217.0 [2024-08-06 03:03:26,742][52669] Sum rewards: 72.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.733', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.220', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:26,965][52662] DAMAGECOUNT value on done: 368128.0 [2024-08-06 03:03:26,965][52662] Sum rewards: 65.150, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.832', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.120', 'AMMO4': '0.151', 'AMMO3': '0.276', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.272', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:27,044][52664] DAMAGECOUNT value on done: 384409.0 [2024-08-06 03:03:27,044][52664] Sum rewards: 71.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.285', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.182', 'AMMO4': '0.193', 'AMMO3': '0.251', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:27,227][52660] DAMAGECOUNT value on done: 364063.0 [2024-08-06 03:03:27,229][52660] Sum rewards: 68.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.457', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.040', 'AMMO4': '0.058', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.746', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:27,537][52794] DAMAGECOUNT value on done: 371239.0 [2024-08-06 03:03:27,541][52794] Sum rewards: 65.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.190', 'AMMO4': '0.213', 'weapon5': '0.232', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.448', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 350928896. Throughput: 0: 4391.8. Samples: 87739250. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:03:27,794][52567] Avg episode reward: [(0, '69.759')] [2024-08-06 03:03:28,007][52668] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 03:03:28,068][52658] DAMAGECOUNT value on done: 371092.0 [2024-08-06 03:03:28,068][52658] Sum rewards: 74.443, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.176', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.730', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:28,219][52668] DAMAGECOUNT value on done: 360410.0 [2024-08-06 03:03:28,220][52668] Sum rewards: 74.935, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.630', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.158', 'weapon2': '0.202', 'AMMO4': '0.205', 'weapon5': '0.264', 'weapon4': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '59.000'} [2024-08-06 03:03:28,712][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:03:29,314][52650] Updated weights for policy 0, policy_version 42841 (0.0019) [2024-08-06 03:03:29,353][52649] DAMAGECOUNT value on done: 363335.0 [2024-08-06 03:03:29,353][52649] Sum rewards: 71.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.491', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '59.500'} [2024-08-06 03:03:29,355][52665] DAMAGECOUNT value on done: 360155.0 [2024-08-06 03:03:29,355][52665] Sum rewards: 80.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.678', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.090', 'AMMO4': '0.115', 'weapon5': '0.180', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:29,765][52664] DAMAGECOUNT value on done: 386131.0 [2024-08-06 03:03:29,766][52664] Sum rewards: 76.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.104', 'AMMO4': '0.157', 'weapon5': '0.176', 'AMMO3': '0.210', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:29,814][52671] DAMAGECOUNT value on done: 372809.0 [2024-08-06 03:03:29,815][52671] Sum rewards: 62.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.782', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.152', 'weapon5': '0.238', 'AMMO4': '0.245', 'AMMO3': '0.252', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:29,910][52669] DAMAGECOUNT value on done: 368601.0 [2024-08-06 03:03:29,911][52669] Sum rewards: 72.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.004', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.082', 'weapon5': '0.152', 'AMMO4': '0.191', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '59.000'} [2024-08-06 03:03:30,092][52660] DAMAGECOUNT value on done: 368672.0 [2024-08-06 03:03:30,094][52660] Sum rewards: 70.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.056', 'weapon5': '0.066', 'AMMO4': '0.091', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '0.950', 'weapon3': '3.258', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:30,119][52662] DAMAGECOUNT value on done: 380779.0 [2024-08-06 03:03:30,119][52662] Sum rewards: 79.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.325', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.172', 'AMMO3': '0.178', 'weapon4': '0.202', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:30,815][52794] DAMAGECOUNT value on done: 373117.0 [2024-08-06 03:03:30,818][52794] Sum rewards: 61.604, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.136', 'weapon4': '0.154', 'AMMO4': '0.162', 'weapon5': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '0.850', 'HITCOUNT': '2.710', 'weapon3': '3.002', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '49.000'} [2024-08-06 03:03:31,026][52658] DAMAGECOUNT value on done: 362540.0 [2024-08-06 03:03:31,028][52658] Sum rewards: 68.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.018', 'AMMO4': '0.045', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:31,207][52668] DAMAGECOUNT value on done: 360608.0 [2024-08-06 03:03:31,211][52668] Sum rewards: 69.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.148', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon4': '0.080', 'AMMO3': '0.161', 'AMMO4': '0.278', 'weapon5': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.000', 'weapon3': '2.874', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:32,184][52664] DAMAGECOUNT value on done: 381018.0 [2024-08-06 03:03:32,194][52664] Sum rewards: 61.143, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.182', 'weapon2': '0.570', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.242', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '51.000'} [2024-08-06 03:03:32,208][52665] DAMAGECOUNT value on done: 359589.0 [2024-08-06 03:03:32,208][52665] Sum rewards: 72.931, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.938', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.137', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.550', 'weapon3': '2.874', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:32,254][52649] DAMAGECOUNT value on done: 361998.0 [2024-08-06 03:03:32,255][52649] Sum rewards: 76.787, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon2': '0.168', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'HEALTH': '0.405', 'WEAPON3': '1.150', 'weapon3': '3.396', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:32,524][52669] DAMAGECOUNT value on done: 365481.0 [2024-08-06 03:03:32,525][52669] Sum rewards: 68.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.050', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.205', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:32,576][52671] DAMAGECOUNT value on done: 370119.0 [2024-08-06 03:03:32,577][52671] Sum rewards: 69.460, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.985', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.074', 'AMMO3': '0.149', 'weapon2': '0.424', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.346', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 351019008. Throughput: 0: 4390.2. Samples: 87752380. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:03:32,795][52567] Avg episode reward: [(0, '69.877')] [2024-08-06 03:03:33,096][52662] DAMAGECOUNT value on done: 372776.0 [2024-08-06 03:03:33,097][52662] Sum rewards: 78.712, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.265', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.153', 'weapon5': '0.184', 'weapon4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:33,357][52660] DAMAGECOUNT value on done: 375074.0 [2024-08-06 03:03:33,357][52660] Sum rewards: 61.635, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.922', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.174', 'weapon5': '0.200', 'weapon4': '0.240', 'AMMO4': '0.250', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '50.000'} [2024-08-06 03:03:33,775][52794] DAMAGECOUNT value on done: 370328.0 [2024-08-06 03:03:33,779][52794] Sum rewards: 61.857, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.371', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.122', 'weapon4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 03:03:33,851][52658] DAMAGECOUNT value on done: 377290.0 [2024-08-06 03:03:33,851][52658] Sum rewards: 68.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.224', 'weapon2': '0.244', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.304', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:34,121][52650] Updated weights for policy 0, policy_version 42851 (0.0021) [2024-08-06 03:03:34,195][52668] DAMAGECOUNT value on done: 361160.0 [2024-08-06 03:03:34,196][52668] Sum rewards: 67.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.144', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.122', 'weapon5': '0.188', 'AMMO3': '0.222', 'AMMO4': '0.230', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:35,056][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:03:35,145][52664] DAMAGECOUNT value on done: 383024.0 [2024-08-06 03:03:35,147][52664] Sum rewards: 64.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.431', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:35,175][52669] DAMAGECOUNT value on done: 371201.0 [2024-08-06 03:03:35,177][52669] Sum rewards: 71.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.144', 'weapon5': '0.166', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:35,239][52671] DAMAGECOUNT value on done: 369803.0 [2024-08-06 03:03:35,240][52671] Sum rewards: 66.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.198', 'AMMO3': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:35,275][52665] DAMAGECOUNT value on done: 364362.0 [2024-08-06 03:03:35,275][52665] Sum rewards: 71.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO3': '0.213', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.328', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.034', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:35,447][52649] DAMAGECOUNT value on done: 357126.0 [2024-08-06 03:03:35,449][52649] Sum rewards: 56.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.057', 'weapon4': '0.146', 'weapon5': '0.206', 'AMMO3': '0.233', 'AMMO4': '0.285', 'weapon2': '0.330', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.650', 'weapon3': '3.050', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '48.000'} [2024-08-06 03:03:36,127][52660] DAMAGECOUNT value on done: 372672.0 [2024-08-06 03:03:36,129][52660] Sum rewards: 72.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.972', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon4': '0.238', 'AMMO3': '0.242', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:36,440][52662] DAMAGECOUNT value on done: 371941.0 [2024-08-06 03:03:36,440][52662] Sum rewards: 71.214, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.445', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.222', 'AMMO4': '0.242', 'AMMO3': '0.250', 'weapon4': '0.266', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.824', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:36,959][52794] DAMAGECOUNT value on done: 366839.0 [2024-08-06 03:03:36,961][52794] Sum rewards: 54.109, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.064', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.322', 'weapon4': '0.384', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '48.000'} [2024-08-06 03:03:37,002][52658] DAMAGECOUNT value on done: 369373.0 [2024-08-06 03:03:37,003][52658] Sum rewards: 63.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.871', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.144', 'AMMO4': '0.210', 'AMMO3': '0.221', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:37,059][52668] DAMAGECOUNT value on done: 364225.0 [2024-08-06 03:03:37,059][52668] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.524', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon7': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.193', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.262', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.164', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:37,688][52664] DAMAGECOUNT value on done: 381715.0 [2024-08-06 03:03:37,688][52664] Sum rewards: 76.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.120', 'weapon5': '0.136', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:37,718][52669] DAMAGECOUNT value on done: 376920.0 [2024-08-06 03:03:37,719][52669] Sum rewards: 79.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.383', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.144', 'weapon5': '0.220', 'AMMO4': '0.223', 'weapon2': '0.232', 'AMMO3': '0.259', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '67.000'} [2024-08-06 03:03:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 351100928. Throughput: 0: 4383.5. Samples: 87778390. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:03:37,795][52567] Avg episode reward: [(0, '69.324')] [2024-08-06 03:03:38,199][52671] DAMAGECOUNT value on done: 370601.0 [2024-08-06 03:03:38,200][52671] Sum rewards: 79.647, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.082', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.124', 'weapon4': '0.126', 'AMMO4': '0.155', 'AMMO3': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '63.000'} [2024-08-06 03:03:38,347][52665] DAMAGECOUNT value on done: 365348.0 [2024-08-06 03:03:38,349][52665] Sum rewards: 64.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.594', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.092', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.250', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '54.500'} [2024-08-06 03:03:38,428][52649] DAMAGECOUNT value on done: 361662.0 [2024-08-06 03:03:38,428][52649] Sum rewards: 65.764, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.504', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.260', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:38,691][52650] Updated weights for policy 0, policy_version 42861 (0.0027) [2024-08-06 03:03:38,954][52660] DAMAGECOUNT value on done: 367543.0 [2024-08-06 03:03:38,957][52660] Sum rewards: 79.068, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.080', 'weapon4': '0.108', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '65.000'} [2024-08-06 03:03:39,175][52662] DAMAGECOUNT value on done: 366567.0 [2024-08-06 03:03:39,178][52662] Sum rewards: 64.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.315', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.856', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:39,846][52668] DAMAGECOUNT value on done: 369456.0 [2024-08-06 03:03:39,847][52668] Sum rewards: 77.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.444', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.304', 'WEAPON3': '1.000', 'weapon3': '3.368', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:39,904][52794] DAMAGECOUNT value on done: 365592.0 [2024-08-06 03:03:39,905][52794] Sum rewards: 64.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.342', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.072', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.266', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '53.500'} [2024-08-06 03:03:39,936][52658] DAMAGECOUNT value on done: 378612.0 [2024-08-06 03:03:39,938][52658] Sum rewards: 79.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.252', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.054', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.268', 'AMMO4': '0.270', 'WEAPON4': '0.450', 'weapon4': '0.664', 'WEAPON3': '1.350', 'weapon3': '2.558', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '67.000'} [2024-08-06 03:03:40,355][52664] DAMAGECOUNT value on done: 382751.0 [2024-08-06 03:03:40,356][52664] Sum rewards: 78.242, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.146', 'AMMO3': '0.176', 'weapon4': '0.208', 'AMMO4': '0.235', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:40,956][52669] DAMAGECOUNT value on done: 384462.0 [2024-08-06 03:03:40,959][52669] Sum rewards: 66.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.976', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.110', 'weapon5': '0.124', 'AMMO4': '0.173', 'weapon2': '0.196', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.320', 'weapon3': '3.338', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:41,114][52671] DAMAGECOUNT value on done: 375999.0 [2024-08-06 03:03:41,114][52671] Sum rewards: 72.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.907', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.091', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:41,523][52660] DAMAGECOUNT value on done: 375683.0 [2024-08-06 03:03:41,523][52660] Sum rewards: 75.872, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.092', 'weapon5': '0.152', 'AMMO4': '0.202', 'AMMO3': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:41,666][52649] DAMAGECOUNT value on done: 363574.0 [2024-08-06 03:03:41,666][52649] Sum rewards: 65.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.050', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.140', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'weapon4': '0.390', 'WEAPON3': '0.950', 'weapon3': '2.906', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '53.000'} [2024-08-06 03:03:42,139][52662] DAMAGECOUNT value on done: 364821.0 [2024-08-06 03:03:42,141][52662] Sum rewards: 63.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.618', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.114', 'weapon4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.148', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:42,437][52668] DAMAGECOUNT value on done: 369080.0 [2024-08-06 03:03:42,437][52668] Sum rewards: 63.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.086', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:42,776][52658] DAMAGECOUNT value on done: 362961.0 [2024-08-06 03:03:42,788][52658] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.552', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.198', 'AMMO4': '0.203', 'weapon2': '0.208', 'weapon4': '0.232', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:42,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 351182848. Throughput: 0: 4380.2. Samples: 87804710. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:03:42,794][52567] Avg episode reward: [(0, '69.761')] [2024-08-06 03:03:42,814][52794] DAMAGECOUNT value on done: 371506.0 [2024-08-06 03:03:42,814][52794] Sum rewards: 62.657, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.254', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.148', 'weapon5': '0.160', 'weapon2': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'WEAPON3': '1.750', 'HITCOUNT': '2.960', 'weapon3': '3.190', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:43,234][52664] DAMAGECOUNT value on done: 376240.0 [2024-08-06 03:03:43,234][52664] Sum rewards: 73.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.460', 'WEAPON3': '1.550', 'weapon3': '3.138', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:43,341][52650] Updated weights for policy 0, policy_version 42871 (0.0011) [2024-08-06 03:03:43,593][52669] DAMAGECOUNT value on done: 370818.0 [2024-08-06 03:03:43,595][52669] Sum rewards: 66.469, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.136', 'AMMO3': '0.141', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.146', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '53.000'} [2024-08-06 03:03:43,875][52671] DAMAGECOUNT value on done: 367520.0 [2024-08-06 03:03:43,876][52671] Sum rewards: 75.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.872', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.262', 'weapon4': '0.262', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:44,563][52660] DAMAGECOUNT value on done: 361689.0 [2024-08-06 03:03:44,565][52660] Sum rewards: 62.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.576', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.090', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.298', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:44,955][52649] DAMAGECOUNT value on done: 364382.0 [2024-08-06 03:03:44,955][52649] Sum rewards: 68.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.393', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.184', 'weapon5': '0.218', 'AMMO4': '0.234', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:45,478][52658] DAMAGECOUNT value on done: 371865.0 [2024-08-06 03:03:45,480][52658] Sum rewards: 70.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'weapon3': '3.308', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:45,495][52668] DAMAGECOUNT value on done: 370326.0 [2024-08-06 03:03:45,495][52668] Sum rewards: 70.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.041', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.142', 'weapon5': '0.154', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:45,713][52664] DAMAGECOUNT value on done: 385575.0 [2024-08-06 03:03:45,713][52664] Sum rewards: 71.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.790', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.112', 'AMMO3': '0.185', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:45,830][52794] DAMAGECOUNT value on done: 374915.0 [2024-08-06 03:03:45,830][52794] Sum rewards: 77.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.950', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '66.000'} [2024-08-06 03:03:46,858][52669] DAMAGECOUNT value on done: 373251.0 [2024-08-06 03:03:46,860][52669] Sum rewards: 72.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.717', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.187', 'weapon2': '0.658', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:46,914][52671] DAMAGECOUNT value on done: 374611.0 [2024-08-06 03:03:46,915][52671] Sum rewards: 69.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.491', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.110', 'AMMO3': '0.214', 'weapon2': '0.226', 'AMMO4': '0.274', 'weapon5': '0.278', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:47,391][52660] DAMAGECOUNT value on done: 361959.0 [2024-08-06 03:03:47,392][52660] Sum rewards: 70.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.665', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon2': '0.164', 'AMMO3': '0.170', 'AMMO4': '0.182', 'weapon5': '0.190', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:47,796][52567] Fps is (10 sec: 17200.3, 60 sec: 17475.7, 300 sec: 17522.4). Total num frames: 351272960. Throughput: 0: 4377.4. Samples: 87817850. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:03:47,796][52567] Avg episode reward: [(0, '69.358')] [2024-08-06 03:03:47,892][52658] DAMAGECOUNT value on done: 365489.0 [2024-08-06 03:03:47,893][52658] Sum rewards: 69.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.716', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.230', 'AMMO3': '0.236', 'AMMO4': '0.246', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.062', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:48,082][52668] DAMAGECOUNT value on done: 364892.0 [2024-08-06 03:03:48,082][52668] Sum rewards: 65.307, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.041', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.592', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.196', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:48,197][52649] DAMAGECOUNT value on done: 364015.0 [2024-08-06 03:03:48,198][52649] Sum rewards: 69.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.942', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.050', 'weapon3': '3.188', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:48,215][52650] Updated weights for policy 0, policy_version 42881 (0.0027) [2024-08-06 03:03:48,276][52664] DAMAGECOUNT value on done: 380740.0 [2024-08-06 03:03:48,276][52664] Sum rewards: 77.433, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.758', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.050', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'AMMO3': '0.262', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '65.000'} [2024-08-06 03:03:48,881][52794] DAMAGECOUNT value on done: 365618.0 [2024-08-06 03:03:48,881][52794] Sum rewards: 72.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.408', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon2': '0.204', 'AMMO3': '0.226', 'weapon5': '0.230', 'weapon4': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:49,009][52659] Large shaping reward 3.221 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.41100000000000003, 137.0), ('HEALTH', -0.222, -74.0), ('weapon5', 0.002)] [2024-08-06 03:03:49,802][52669] DAMAGECOUNT value on done: 372762.0 [2024-08-06 03:03:49,802][52669] Sum rewards: 67.135, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.182', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.078', 'weapon5': '0.156', 'AMMO4': '0.215', 'AMMO3': '0.297', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.014', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.500'} [2024-08-06 03:03:49,867][52671] DAMAGECOUNT value on done: 371612.0 [2024-08-06 03:03:49,869][52671] Sum rewards: 56.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.362', 'weapon4': '0.384', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.776', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '48.000'} [2024-08-06 03:03:49,964][52811] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:03:50,066][52660] DAMAGECOUNT value on done: 374745.0 [2024-08-06 03:03:50,068][52660] Sum rewards: 67.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.906', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.138', 'AMMO3': '0.208', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '57.000'} [2024-08-06 03:03:50,149][52669] Large shaping reward 2.602 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2024-08-06 03:03:50,812][52658] DAMAGECOUNT value on done: 365636.0 [2024-08-06 03:03:50,812][52658] Sum rewards: 75.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.168', 'weapon4': '0.192', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '63.000'} [2024-08-06 03:03:51,097][52664] DAMAGECOUNT value on done: 386788.0 [2024-08-06 03:03:51,099][52664] Sum rewards: 73.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.420', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.052', 'AMMO3': '0.172', 'AMMO4': '0.175', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:51,245][52649] DAMAGECOUNT value on done: 353638.0 [2024-08-06 03:03:51,246][52649] Sum rewards: 65.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.140', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.212', 'weapon2': '0.218', 'AMMO3': '0.229', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '56.000'} [2024-08-06 03:03:51,974][52794] DAMAGECOUNT value on done: 375227.0 [2024-08-06 03:03:51,976][52794] Sum rewards: 66.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.748', 'AMMO5': '0.011', 'AMMO2': '0.064', 'weapon5': '0.120', 'AMMO3': '0.227', 'weapon2': '0.260', 'weapon4': '0.298', 'WEAPON5': '0.300', 'AMMO4': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.500'} [2024-08-06 03:03:52,623][52650] Updated weights for policy 0, policy_version 42891 (0.0012) [2024-08-06 03:03:52,659][52660] DAMAGECOUNT value on done: 376898.0 [2024-08-06 03:03:52,659][52660] Sum rewards: 72.031, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.692', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '2.804', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '63.000'} [2024-08-06 03:03:52,795][52567] Fps is (10 sec: 18021.4, 60 sec: 17613.1, 300 sec: 17522.5). Total num frames: 351363072. Throughput: 0: 4369.7. Samples: 87844110. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:03:52,795][52567] Avg episode reward: [(0, '69.522')] [2024-08-06 03:03:52,803][52671] DAMAGECOUNT value on done: 366085.0 [2024-08-06 03:03:52,812][52671] Sum rewards: 76.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.532', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.122', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '64.000'} [2024-08-06 03:03:53,151][52669] DAMAGECOUNT value on done: 375274.0 [2024-08-06 03:03:53,152][52669] Sum rewards: 64.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.117', 'weapon5': '0.172', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.252', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:53,541][52658] DAMAGECOUNT value on done: 362861.0 [2024-08-06 03:03:53,543][52658] Sum rewards: 60.446, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.800', 'AMMO5': '0.022', 'AMMO2': '0.077', 'weapon5': '0.226', 'AMMO3': '0.270', 'weapon4': '0.270', 'weapon2': '0.376', 'AMMO4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.796', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:53,851][52664] DAMAGECOUNT value on done: 382695.0 [2024-08-06 03:03:53,851][52664] Sum rewards: 73.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.546', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO3': '0.178', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.366', 'weapon4': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '61.000'} [2024-08-06 03:03:54,466][52649] DAMAGECOUNT value on done: 361151.0 [2024-08-06 03:03:54,466][52649] Sum rewards: 62.483, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon4': '0.178', 'AMMO3': '0.196', 'weapon5': '0.286', 'AMMO4': '0.327', 'weapon2': '0.414', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.794', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:55,221][52794] DAMAGECOUNT value on done: 370855.0 [2024-08-06 03:03:55,222][52794] Sum rewards: 70.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.210', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.136', 'weapon4': '0.170', 'AMMO3': '0.188', 'AMMO4': '0.240', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '59.000'} [2024-08-06 03:03:55,232][52671] DAMAGECOUNT value on done: 374677.0 [2024-08-06 03:03:55,233][52671] Sum rewards: 70.622, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.146', 'weapon5': '0.160', 'AMMO4': '0.213', 'weapon2': '0.226', 'AMMO3': '0.247', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '60.000'} [2024-08-06 03:03:55,449][52660] DAMAGECOUNT value on done: 365256.0 [2024-08-06 03:03:55,449][52660] Sum rewards: 67.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.633', 'AMMO5': '0.014', 'ARMOR': '0.036', 'AMMO2': '0.056', 'weapon5': '0.140', 'AMMO3': '0.177', 'AMMO4': '0.278', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '55.000'} [2024-08-06 03:03:56,696][52658] DAMAGECOUNT value on done: 375455.0 [2024-08-06 03:03:56,698][52658] Sum rewards: 64.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.126', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 03:03:57,041][52664] DAMAGECOUNT value on done: 390923.0 [2024-08-06 03:03:57,041][52664] Sum rewards: 67.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.880', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.238', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '58.000'} [2024-08-06 03:03:57,131][52649] DAMAGECOUNT value on done: 356628.0 [2024-08-06 03:03:57,131][52649] Sum rewards: 57.158, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.230', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.136', 'AMMO4': '0.234', 'weapon5': '0.234', 'weapon2': '0.254', 'AMMO3': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.850', 'HITCOUNT': '3.000', 'weapon3': '3.050', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:57,519][52650] Updated weights for policy 0, policy_version 42901 (0.0013) [2024-08-06 03:03:57,794][52567] Fps is (10 sec: 18025.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 351453184. Throughput: 0: 4375.1. Samples: 87870570. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:03:57,794][52567] Avg episode reward: [(0, '69.270')] [2024-08-06 03:03:57,800][52794] DAMAGECOUNT value on done: 367474.0 [2024-08-06 03:03:57,800][52794] Sum rewards: 56.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.069', 'AMMO3': '0.239', 'weapon4': '0.258', 'weapon5': '0.270', 'AMMO4': '0.344', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '48.000'} [2024-08-06 03:03:57,918][52671] DAMAGECOUNT value on done: 376785.0 [2024-08-06 03:03:57,926][52671] Sum rewards: 63.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.315', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.138', 'AMMO3': '0.176', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '2.942', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '52.000'} [2024-08-06 03:03:58,105][52660] DAMAGECOUNT value on done: 368128.0 [2024-08-06 03:03:58,106][52660] Sum rewards: 82.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon4': '0.164', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '68.000'} [2024-08-06 03:03:59,657][52664] DAMAGECOUNT value on done: 384449.0 [2024-08-06 03:03:59,657][52664] Sum rewards: 74.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '62.000'} [2024-08-06 03:03:59,978][52658] DAMAGECOUNT value on done: 366923.0 [2024-08-06 03:03:59,979][52658] Sum rewards: 76.601, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.808', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.060', 'AMMO4': '0.095', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '63.000'} [2024-08-06 03:04:00,260][52649] DAMAGECOUNT value on done: 363767.0 [2024-08-06 03:04:00,262][52649] Sum rewards: 74.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.090', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO4': '0.232', 'AMMO3': '0.234', 'weapon4': '0.262', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.862', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '63.000'} [2024-08-06 03:04:00,372][52794] DAMAGECOUNT value on done: 371207.0 [2024-08-06 03:04:00,374][52794] Sum rewards: 71.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.105', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.284', 'weapon2': '0.376', 'WEAPON3': '1.750', 'weapon3': '3.346', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '63.000'} [2024-08-06 03:04:00,728][52671] DAMAGECOUNT value on done: 368477.0 [2024-08-06 03:04:00,729][52671] Sum rewards: 75.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon2': '0.170', 'AMMO4': '0.177', 'AMMO3': '0.204', 'weapon5': '0.238', 'weapon4': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '62.000'} [2024-08-06 03:04:00,960][52660] DAMAGECOUNT value on done: 362446.0 [2024-08-06 03:04:00,962][52660] Sum rewards: 67.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.205', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:01,780][52650] Updated weights for policy 0, policy_version 42911 (0.0037) [2024-08-06 03:04:02,209][52664] DAMAGECOUNT value on done: 388002.0 [2024-08-06 03:04:02,209][52664] Sum rewards: 53.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.055', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.122', 'AMMO4': '0.169', 'weapon5': '0.178', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.310', 'weapon3': '3.216', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '45.000'} [2024-08-06 03:04:02,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 351535104. Throughput: 0: 4369.8. Samples: 87883720. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:04:02,794][52567] Avg episode reward: [(0, '69.430')] [2024-08-06 03:04:03,030][52658] DAMAGECOUNT value on done: 370259.0 [2024-08-06 03:04:03,030][52658] Sum rewards: 62.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.482', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.206', 'weapon5': '0.270', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.656', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '50.000'} [2024-08-06 03:04:03,119][52794] DAMAGECOUNT value on done: 363122.0 [2024-08-06 03:04:03,119][52794] Sum rewards: 63.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.978', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.164', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.062', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '53.000'} [2024-08-06 03:04:03,427][52660] DAMAGECOUNT value on done: 370246.0 [2024-08-06 03:04:03,429][52660] Sum rewards: 68.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.150', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.170', 'AMMO4': '0.174', 'weapon2': '0.212', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '59.000'} [2024-08-06 03:04:03,523][52649] DAMAGECOUNT value on done: 366278.0 [2024-08-06 03:04:03,523][52649] Sum rewards: 73.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.116', 'weapon4': '0.144', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '61.000'} [2024-08-06 03:04:03,808][52671] DAMAGECOUNT value on done: 381264.0 [2024-08-06 03:04:03,812][52671] Sum rewards: 74.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.119', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.078', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.234', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.500'} [2024-08-06 03:04:04,846][52664] DAMAGECOUNT value on done: 379655.0 [2024-08-06 03:04:04,846][52664] Sum rewards: 66.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.418', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.166', 'weapon5': '0.228', 'AMMO4': '0.237', 'weapon4': '0.286', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:05,494][52794] DAMAGECOUNT value on done: 379742.0 [2024-08-06 03:04:05,495][52794] Sum rewards: 63.216, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.162', 'AMMO3': '0.227', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:06,305][52658] DAMAGECOUNT value on done: 372145.0 [2024-08-06 03:04:06,309][52658] Sum rewards: 55.423, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.320', 'AMMO5': '0.027', 'AMMO2': '0.082', 'weapon4': '0.196', 'AMMO3': '0.254', 'weapon2': '0.304', 'weapon5': '0.304', 'AMMO4': '0.409', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.790', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:06,346][52660] DAMAGECOUNT value on done: 364646.0 [2024-08-06 03:04:06,347][52660] Sum rewards: 64.599, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.188', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.050', 'AMMO3': '0.115', 'AMMO4': '0.138', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.632', 'WEAPON3': '0.900', 'HITCOUNT': '2.860', 'weapon3': '2.984', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '50.500'} [2024-08-06 03:04:06,524][52649] DAMAGECOUNT value on done: 364413.0 [2024-08-06 03:04:06,526][52649] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.468', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.164', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '60.000'} [2024-08-06 03:04:06,648][52671] DAMAGECOUNT value on done: 369373.0 [2024-08-06 03:04:06,649][52671] Sum rewards: 70.164, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.218', 'AMMO4': '0.223', 'AMMO3': '0.233', 'weapon2': '0.378', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.644', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '60.000'} [2024-08-06 03:04:06,855][52650] Updated weights for policy 0, policy_version 42921 (0.0036) [2024-08-06 03:04:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 351633408. Throughput: 0: 4377.6. Samples: 87910300. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:04:07,795][52567] Avg episode reward: [(0, '68.923')] [2024-08-06 03:04:08,063][52664] DAMAGECOUNT value on done: 381284.0 [2024-08-06 03:04:08,074][52664] Sum rewards: 64.888, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.965', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.064', 'weapon5': '0.166', 'AMMO3': '0.204', 'weapon2': '0.214', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.340', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '53.000'} [2024-08-06 03:04:08,361][52664] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2024-08-06 03:04:08,428][52794] DAMAGECOUNT value on done: 363690.0 [2024-08-06 03:04:08,429][52794] Sum rewards: 56.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.596', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.382', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '48.000'} [2024-08-06 03:04:09,946][52671] DAMAGECOUNT value on done: 362610.0 [2024-08-06 03:04:09,946][52671] Sum rewards: 66.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.090', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO4': '0.195', 'AMMO3': '0.204', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.726', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:11,220][52664] DAMAGECOUNT value on done: 382467.0 [2024-08-06 03:04:11,221][52664] Sum rewards: 69.052, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.452', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.152', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'weapon4': '0.548', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:11,385][52650] Updated weights for policy 0, policy_version 42931 (0.0025) [2024-08-06 03:04:11,470][52794] DAMAGECOUNT value on done: 378599.0 [2024-08-06 03:04:11,470][52794] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.096', 'AMMO3': '0.211', 'weapon5': '0.216', 'AMMO4': '0.271', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.016', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:11,530][52647] DAMAGECOUNT value on done: 389525.0 [2024-08-06 03:04:11,530][52647] Sum rewards: 62.114, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.902', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.132', 'AMMO4': '0.214', 'weapon4': '0.228', 'AMMO3': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '2.914', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 351715328. Throughput: 0: 4382.5. Samples: 87936460. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:04:12,794][52567] Avg episode reward: [(0, '68.645')] [2024-08-06 03:04:13,473][52671] DAMAGECOUNT value on done: 376906.0 [2024-08-06 03:04:13,473][52671] Sum rewards: 75.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.942', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.046', 'AMMO4': '0.105', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '64.000'} [2024-08-06 03:04:14,431][52664] DAMAGECOUNT value on done: 382276.0 [2024-08-06 03:04:14,431][52664] Sum rewards: 65.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.815', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.136', 'weapon4': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '53.000'} [2024-08-06 03:04:14,688][52647] DAMAGECOUNT value on done: 388769.0 [2024-08-06 03:04:14,688][52647] Sum rewards: 69.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.054', 'weapon4': '0.098', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '57.000'} [2024-08-06 03:04:14,705][52794] DAMAGECOUNT value on done: 372548.0 [2024-08-06 03:04:14,707][52794] Sum rewards: 79.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.288', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon5': '0.188', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '3.056', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '64.000'} [2024-08-06 03:04:15,917][52650] Updated weights for policy 0, policy_version 42941 (0.0025) [2024-08-06 03:04:16,095][52671] DAMAGECOUNT value on done: 376510.0 [2024-08-06 03:04:16,095][52671] Sum rewards: 61.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.102', 'AMMO3': '0.187', 'AMMO4': '0.248', 'weapon4': '0.262', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:17,306][52664] DAMAGECOUNT value on done: 381117.0 [2024-08-06 03:04:17,308][52664] Sum rewards: 69.615, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.119', 'weapon5': '0.120', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:17,469][52647] DAMAGECOUNT value on done: 387887.0 [2024-08-06 03:04:17,469][52647] Sum rewards: 83.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.328', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '69.000'} [2024-08-06 03:04:17,783][52794] DAMAGECOUNT value on done: 372212.0 [2024-08-06 03:04:17,783][52794] Sum rewards: 80.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.085', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon4': '0.144', 'weapon5': '0.270', 'AMMO3': '0.294', 'weapon2': '0.296', 'AMMO4': '0.308', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.850', 'weapon3': '2.950', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '68.000'} [2024-08-06 03:04:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 351805440. Throughput: 0: 4386.2. Samples: 87949760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:04:17,794][52567] Avg episode reward: [(0, '68.831')] [2024-08-06 03:04:18,879][52671] DAMAGECOUNT value on done: 377588.0 [2024-08-06 03:04:18,887][52671] Sum rewards: 68.169, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.976', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.162', 'AMMO3': '0.200', 'AMMO4': '0.232', 'weapon5': '0.234', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:20,220][52664] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:04:20,553][52650] Updated weights for policy 0, policy_version 42951 (0.0021) [2024-08-06 03:04:20,645][52647] DAMAGECOUNT value on done: 394783.0 [2024-08-06 03:04:20,645][52647] Sum rewards: 67.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.732', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.128', 'weapon2': '0.192', 'AMMO3': '0.213', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.740', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '57.000'} [2024-08-06 03:04:20,757][52794] DAMAGECOUNT value on done: 381259.0 [2024-08-06 03:04:20,758][52794] Sum rewards: 65.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.854', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.170', 'AMMO3': '0.196', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '53.000'} [2024-08-06 03:04:21,974][52671] DAMAGECOUNT value on done: 371493.0 [2024-08-06 03:04:21,974][52671] Sum rewards: 57.991, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.839', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.038', 'weapon5': '0.062', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.416', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.282', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '51.000'} [2024-08-06 03:04:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 351887360. Throughput: 0: 4390.7. Samples: 87975970. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:04:22,794][52567] Avg episode reward: [(0, '68.811')] [2024-08-06 03:04:23,000][52647] DAMAGECOUNT value on done: 390434.0 [2024-08-06 03:04:23,000][52647] Sum rewards: 67.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.971', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.080', 'weapon4': '0.106', 'AMMO4': '0.111', 'weapon2': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.510', 'weapon3': '3.522', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:23,472][52794] DAMAGECOUNT value on done: 370342.0 [2024-08-06 03:04:23,473][52794] Sum rewards: 70.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.086', 'weapon5': '0.126', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.664', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '59.000'} [2024-08-06 03:04:24,908][52671] DAMAGECOUNT value on done: 369424.0 [2024-08-06 03:04:24,910][52671] Sum rewards: 78.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.209', 'weapon4': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '64.500'} [2024-08-06 03:04:25,307][52659] DAMAGECOUNT value on done: 373000.0 [2024-08-06 03:04:25,307][52659] Sum rewards: 76.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.965', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.102', 'weapon4': '0.108', 'AMMO4': '0.163', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.000'} [2024-08-06 03:04:25,367][52650] Updated weights for policy 0, policy_version 42961 (0.0026) [2024-08-06 03:04:25,504][52647] DAMAGECOUNT value on done: 391538.0 [2024-08-06 03:04:25,504][52647] Sum rewards: 68.868, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.066', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 351977472. Throughput: 0: 4398.7. Samples: 88002650. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:04:27,794][52567] Avg episode reward: [(0, '69.250')] [2024-08-06 03:04:27,801][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042966_351977472.pth... [2024-08-06 03:04:27,942][52647] DAMAGECOUNT value on done: 390555.0 [2024-08-06 03:04:27,944][52647] Sum rewards: 60.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.972', 'AMMO5': '0.024', 'AMMO2': '0.071', 'AMMO3': '0.139', 'weapon5': '0.270', 'weapon4': '0.302', 'AMMO4': '0.354', 'weapon2': '0.440', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '48.000'} [2024-08-06 03:04:27,979][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042453_347774976.pth [2024-08-06 03:04:28,647][52659] DAMAGECOUNT value on done: 371210.0 [2024-08-06 03:04:28,651][52659] Sum rewards: 71.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.555', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.124', 'AMMO3': '0.168', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '57.000'} [2024-08-06 03:04:29,923][52650] Updated weights for policy 0, policy_version 42971 (0.0021) [2024-08-06 03:04:30,996][52647] DAMAGECOUNT value on done: 385620.0 [2024-08-06 03:04:30,997][52647] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon2': '0.208', 'weapon5': '0.240', 'AMMO3': '0.249', 'AMMO4': '0.306', 'weapon4': '0.374', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '59.000'} [2024-08-06 03:04:31,583][52659] DAMAGECOUNT value on done: 369788.0 [2024-08-06 03:04:31,585][52659] Sum rewards: 71.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.384', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.072', 'weapon5': '0.082', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '3.182', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 03:04:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17578.1). Total num frames: 352067584. Throughput: 0: 4379.1. Samples: 88014900. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:04:32,794][52567] Avg episode reward: [(0, '68.969')] [2024-08-06 03:04:33,729][52647] DAMAGECOUNT value on done: 396286.0 [2024-08-06 03:04:33,730][52647] Sum rewards: 62.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.093', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO3': '0.184', 'weapon5': '0.190', 'AMMO4': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:34,381][52659] DAMAGECOUNT value on done: 370901.0 [2024-08-06 03:04:34,381][52659] Sum rewards: 63.711, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.570', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon4': '0.150', 'weapon5': '0.226', 'AMMO4': '0.259', 'weapon2': '0.276', 'AMMO3': '0.285', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.024', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:34,932][52650] Updated weights for policy 0, policy_version 42981 (0.0024) [2024-08-06 03:04:36,791][52647] DAMAGECOUNT value on done: 386040.0 [2024-08-06 03:04:36,791][52647] Sum rewards: 66.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.465', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.152', 'AMMO4': '0.174', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.164', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '57.000'} [2024-08-06 03:04:37,251][52659] DAMAGECOUNT value on done: 367264.0 [2024-08-06 03:04:37,253][52659] Sum rewards: 59.987, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.549', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.170', 'weapon5': '0.180', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '2.954', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 352141312. Throughput: 0: 4381.8. Samples: 88041290. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:04:37,794][52567] Avg episode reward: [(0, '68.759')] [2024-08-06 03:04:38,504][52666] DAMAGECOUNT value on done: 369716.0 [2024-08-06 03:04:38,505][52666] Sum rewards: 66.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO4': '0.174', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '56.500'} [2024-08-06 03:04:39,373][52650] Updated weights for policy 0, policy_version 42991 (0.0028) [2024-08-06 03:04:39,552][52647] DAMAGECOUNT value on done: 393027.0 [2024-08-06 03:04:39,553][52647] Sum rewards: 63.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.069', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.554', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.048', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '53.000'} [2024-08-06 03:04:40,304][52659] DAMAGECOUNT value on done: 371098.0 [2024-08-06 03:04:40,308][52659] Sum rewards: 52.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.678', 'AMMO5': '0.016', 'AMMO2': '0.069', 'AMMO3': '0.230', 'weapon4': '0.262', 'weapon5': '0.264', 'AMMO4': '0.345', 'WEAPON5': '0.500', 'weapon2': '0.506', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'HITCOUNT': '2.420', 'weapon3': '2.680', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '45.000'} [2024-08-06 03:04:40,365][52811] DAMAGECOUNT value on done: 355507.0 [2024-08-06 03:04:40,366][52811] Sum rewards: 66.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.954', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.124', 'weapon4': '0.166', 'AMMO4': '0.169', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.202', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:40,613][52803] DAMAGECOUNT value on done: 347586.0 [2024-08-06 03:04:40,614][52803] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.070', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.200', 'weapon3': '3.410', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '63.000'} [2024-08-06 03:04:41,398][52666] DAMAGECOUNT value on done: 373910.0 [2024-08-06 03:04:41,399][52666] Sum rewards: 60.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:42,192][52647] DAMAGECOUNT value on done: 382879.0 [2024-08-06 03:04:42,193][52647] Sum rewards: 68.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '58.000'} [2024-08-06 03:04:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 352239616. Throughput: 0: 4378.0. Samples: 88067580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:04:42,794][52567] Avg episode reward: [(0, '68.133')] [2024-08-06 03:04:42,920][52659] DAMAGECOUNT value on done: 369545.0 [2024-08-06 03:04:42,922][52659] Sum rewards: 69.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.180', 'weapon2': '0.206', 'AMMO3': '0.213', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.258', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '58.000'} [2024-08-06 03:04:43,470][52811] DAMAGECOUNT value on done: 343439.0 [2024-08-06 03:04:43,471][52811] Sum rewards: 70.390, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.045', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon2': '0.210', 'AMMO3': '0.297', 'WEAPON3': '1.750', 'HITCOUNT': '3.560', 'weapon3': '3.586', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '62.000'} [2024-08-06 03:04:43,714][52803] DAMAGECOUNT value on done: 342725.0 [2024-08-06 03:04:43,716][52803] Sum rewards: 60.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.168', 'weapon4': '0.186', 'weapon2': '0.216', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.154', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '53.000'} [2024-08-06 03:04:44,106][52666] DAMAGECOUNT value on done: 374126.0 [2024-08-06 03:04:44,107][52666] Sum rewards: 73.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.507', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.197', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '61.000'} [2024-08-06 03:04:44,227][52650] Updated weights for policy 0, policy_version 43001 (0.0024) [2024-08-06 03:04:44,362][52670] DAMAGECOUNT value on done: 366180.0 [2024-08-06 03:04:44,365][52670] Sum rewards: 59.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.944', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.128', 'weapon5': '0.178', 'AMMO4': '0.206', 'AMMO3': '0.229', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '51.000'} [2024-08-06 03:04:44,798][52647] DAMAGECOUNT value on done: 386414.0 [2024-08-06 03:04:44,799][52647] Sum rewards: 67.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.027', 'weapon5': '0.084', 'weapon4': '0.096', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '57.000'} [2024-08-06 03:04:45,744][52659] DAMAGECOUNT value on done: 367661.0 [2024-08-06 03:04:45,745][52659] Sum rewards: 67.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.106', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:46,551][52811] DAMAGECOUNT value on done: 344181.0 [2024-08-06 03:04:46,552][52811] Sum rewards: 69.396, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.166', 'weapon5': '0.176', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.796', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:46,639][52666] DAMAGECOUNT value on done: 370985.0 [2024-08-06 03:04:46,640][52666] Sum rewards: 61.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.216', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.220', 'weapon4': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:46,761][52803] DAMAGECOUNT value on done: 346476.0 [2024-08-06 03:04:46,764][52803] Sum rewards: 66.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.935', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO4': '0.196', 'AMMO3': '0.214', 'weapon4': '0.226', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:46,914][52670] DAMAGECOUNT value on done: 370221.0 [2024-08-06 03:04:46,914][52670] Sum rewards: 67.214, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.952', 'AMMO5': '0.024', 'AMMO2': '0.073', 'weapon4': '0.188', 'AMMO3': '0.275', 'AMMO4': '0.364', 'weapon5': '0.370', 'weapon2': '0.472', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.564', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '59.000'} [2024-08-06 03:04:47,365][52647] DAMAGECOUNT value on done: 387339.0 [2024-08-06 03:04:47,366][52647] Sum rewards: 59.606, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.120', 'AMMO4': '0.202', 'AMMO3': '0.210', 'weapon4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '51.000'} [2024-08-06 03:04:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17613.3, 300 sec: 17550.3). Total num frames: 352329728. Throughput: 0: 4377.1. Samples: 88080690. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:04:47,794][52567] Avg episode reward: [(0, '67.926')] [2024-08-06 03:04:48,490][52659] DAMAGECOUNT value on done: 377990.0 [2024-08-06 03:04:48,492][52659] Sum rewards: 76.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon2': '0.160', 'AMMO4': '0.200', 'AMMO3': '0.207', 'weapon5': '0.242', 'weapon4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '62.000'} [2024-08-06 03:04:48,906][52650] Updated weights for policy 0, policy_version 43011 (0.0011) [2024-08-06 03:04:49,477][52666] DAMAGECOUNT value on done: 367586.0 [2024-08-06 03:04:49,478][52666] Sum rewards: 77.165, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.034', 'HEALTH': '0.095', 'weapon5': '0.134', 'AMMO4': '0.168', 'weapon4': '0.168', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 03:04:49,696][52811] DAMAGECOUNT value on done: 345745.0 [2024-08-06 03:04:49,699][52811] Sum rewards: 65.040, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.910', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.070', 'weapon5': '0.084', 'AMMO3': '0.260', 'AMMO4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '57.000'} [2024-08-06 03:04:49,819][52670] DAMAGECOUNT value on done: 360958.0 [2024-08-06 03:04:49,819][52670] Sum rewards: 69.829, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.104', 'AMMO3': '0.108', 'weapon4': '0.114', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.734', 'WEAPON3': '0.750', 'weapon3': '2.892', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:49,879][52803] DAMAGECOUNT value on done: 349621.0 [2024-08-06 03:04:49,880][52803] Sum rewards: 76.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.046', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.124', 'weapon5': '0.126', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '65.000'} [2024-08-06 03:04:50,228][52614] Signal inference workers to stop experience collection... (7750 times) [2024-08-06 03:04:50,228][52614] Signal inference workers to resume experience collection... (7750 times) [2024-08-06 03:04:50,279][52650] InferenceWorker_p0-w0: stopping experience collection (7750 times) [2024-08-06 03:04:50,280][52650] InferenceWorker_p0-w0: resuming experience collection (7750 times) [2024-08-06 03:04:50,519][52647] DAMAGECOUNT value on done: 396756.0 [2024-08-06 03:04:50,519][52647] Sum rewards: 72.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.272', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.159', 'weapon5': '0.178', 'AMMO4': '0.180', 'weapon4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '0.950', 'weapon3': '2.880', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:50,982][52663] DAMAGECOUNT value on done: 375534.0 [2024-08-06 03:04:50,983][52663] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.140', 'AMMO4': '0.178', 'weapon5': '0.182', 'AMMO3': '0.190', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:51,395][52659] DAMAGECOUNT value on done: 377736.0 [2024-08-06 03:04:51,397][52659] Sum rewards: 66.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.976', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.213', 'weapon2': '0.428', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.416', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:52,322][52666] DAMAGECOUNT value on done: 362776.0 [2024-08-06 03:04:52,323][52666] Sum rewards: 78.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.298', 'AMMO5': '0.008', 'weapon4': '0.050', 'AMMO2': '0.051', 'weapon5': '0.134', 'AMMO4': '0.254', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '66.000'} [2024-08-06 03:04:52,712][52670] DAMAGECOUNT value on done: 360596.0 [2024-08-06 03:04:52,713][52670] Sum rewards: 67.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.9, 300 sec: 17494.8). Total num frames: 352403456. Throughput: 0: 4364.2. Samples: 88106690. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-06 03:04:52,794][52567] Avg episode reward: [(0, '67.971')] [2024-08-06 03:04:53,047][52811] DAMAGECOUNT value on done: 348144.0 [2024-08-06 03:04:53,047][52811] Sum rewards: 79.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.094', 'AMMO3': '0.164', 'weapon5': '0.186', 'AMMO4': '0.217', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '63.500'} [2024-08-06 03:04:53,179][52803] DAMAGECOUNT value on done: 350635.0 [2024-08-06 03:04:53,180][52803] Sum rewards: 69.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.410', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.468', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:53,403][52650] Updated weights for policy 0, policy_version 43021 (0.0013) [2024-08-06 03:04:53,573][52647] DAMAGECOUNT value on done: 386905.0 [2024-08-06 03:04:53,575][52647] Sum rewards: 65.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.026', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon4': '0.174', 'AMMO3': '0.194', 'weapon5': '0.194', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '55.000'} [2024-08-06 03:04:53,660][52663] DAMAGECOUNT value on done: 369381.0 [2024-08-06 03:04:53,661][52663] Sum rewards: 75.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.582', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.192', 'AMMO4': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 03:04:54,030][52659] DAMAGECOUNT value on done: 370978.0 [2024-08-06 03:04:54,031][52659] Sum rewards: 86.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.822', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.314', 'WEAPON3': '1.150', 'weapon3': '3.422', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '70.000'} [2024-08-06 03:04:55,161][52666] DAMAGECOUNT value on done: 370468.0 [2024-08-06 03:04:55,161][52666] Sum rewards: 73.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.009', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO3': '0.203', 'AMMO4': '0.212', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 03:04:55,417][52670] DAMAGECOUNT value on done: 372703.0 [2024-08-06 03:04:55,417][52670] Sum rewards: 62.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.254', 'AMMO5': '0.018', 'AMMO2': '0.063', 'AMMO3': '0.182', 'weapon5': '0.264', 'weapon4': '0.282', 'AMMO4': '0.313', 'weapon2': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '51.000'} [2024-08-06 03:04:55,852][52647] DAMAGECOUNT value on done: 385558.0 [2024-08-06 03:04:55,852][52647] Sum rewards: 68.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.264', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.176', 'weapon4': '0.202', 'AMMO3': '0.217', 'AMMO4': '0.228', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.500'} [2024-08-06 03:04:56,253][52811] DAMAGECOUNT value on done: 351099.0 [2024-08-06 03:04:56,255][52811] Sum rewards: 68.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.667', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.104', 'AMMO4': '0.164', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '58.000'} [2024-08-06 03:04:56,392][52803] DAMAGECOUNT value on done: 340053.0 [2024-08-06 03:04:56,393][52803] Sum rewards: 60.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.419', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.130', 'AMMO4': '0.190', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '3.136', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '53.000'} [2024-08-06 03:04:56,672][52664] Large shaping reward 2.545 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 03:04:56,721][52663] DAMAGECOUNT value on done: 366284.0 [2024-08-06 03:04:56,722][52663] Sum rewards: 66.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.796', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.082', 'AMMO4': '0.181', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:56,791][52659] DAMAGECOUNT value on done: 373261.0 [2024-08-06 03:04:56,795][52659] Sum rewards: 56.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.158', 'AMMO3': '0.207', 'AMMO4': '0.282', 'weapon2': '0.298', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '2.884', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '50.000'} [2024-08-06 03:04:57,550][52795] DAMAGECOUNT value on done: 343588.0 [2024-08-06 03:04:57,552][52795] Sum rewards: 72.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.900', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.098', 'AMMO3': '0.171', 'AMMO4': '0.177', 'weapon5': '0.184', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '59.000'} [2024-08-06 03:04:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 352501760. Throughput: 0: 4369.8. Samples: 88133100. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-06 03:04:57,795][52567] Avg episode reward: [(0, '68.229')] [2024-08-06 03:04:58,076][52666] DAMAGECOUNT value on done: 369825.0 [2024-08-06 03:04:58,076][52666] Sum rewards: 69.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.783', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.188', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '58.000'} [2024-08-06 03:04:58,144][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:04:58,191][52647] DAMAGECOUNT value on done: 383849.0 [2024-08-06 03:04:58,192][52647] Sum rewards: 68.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.868', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.148', 'AMMO4': '0.212', 'weapon5': '0.214', 'AMMO3': '0.225', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '56.000'} [2024-08-06 03:04:58,405][52670] DAMAGECOUNT value on done: 364956.0 [2024-08-06 03:04:58,407][52670] Sum rewards: 64.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.076', 'AMMO3': '0.161', 'weapon2': '0.166', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.150', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '54.000'} [2024-08-06 03:04:58,537][52650] Updated weights for policy 0, policy_version 43031 (0.0020) [2024-08-06 03:04:59,302][52663] DAMAGECOUNT value on done: 370900.0 [2024-08-06 03:04:59,302][52663] Sum rewards: 74.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.095', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.185', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '59.000'} [2024-08-06 03:04:59,412][52811] DAMAGECOUNT value on done: 346707.0 [2024-08-06 03:04:59,412][52811] Sum rewards: 60.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.025', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.178', 'AMMO3': '0.214', 'weapon2': '0.268', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '52.000'} [2024-08-06 03:04:59,487][52803] DAMAGECOUNT value on done: 342031.0 [2024-08-06 03:04:59,487][52803] Sum rewards: 72.389, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.055', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.204', 'weapon2': '0.240', 'weapon4': '0.262', 'AMMO3': '0.273', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.940', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '63.500'} [2024-08-06 03:04:59,757][52659] DAMAGECOUNT value on done: 362436.0 [2024-08-06 03:04:59,757][52659] Sum rewards: 58.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.012', 'AMMO5': '0.007', 'ARMOR': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.226', 'AMMO3': '0.229', 'weapon2': '0.250', 'weapon4': '0.292', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '2.972', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '49.000'} [2024-08-06 03:05:00,758][52795] DAMAGECOUNT value on done: 335678.0 [2024-08-06 03:05:00,760][52795] Sum rewards: 65.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.235', 'weapon2': '0.262', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.414', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 03:05:00,943][52647] DAMAGECOUNT value on done: 382847.0 [2024-08-06 03:05:00,944][52647] Sum rewards: 61.651, reward structure: {'DEATHCOUNT': '-11.250', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.102', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'HEALTH': '0.183', 'weapon2': '0.258', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '3.232', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '50.000'} [2024-08-06 03:05:01,359][52666] DAMAGECOUNT value on done: 365623.0 [2024-08-06 03:05:01,361][52666] Sum rewards: 66.197, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.136', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.484', 'weapon4': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.426', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '53.000'} [2024-08-06 03:05:01,668][52670] DAMAGECOUNT value on done: 360116.0 [2024-08-06 03:05:01,668][52670] Sum rewards: 75.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.130', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '62.000'} [2024-08-06 03:05:01,795][52663] DAMAGECOUNT value on done: 368068.0 [2024-08-06 03:05:01,795][52663] Sum rewards: 66.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.304', 'weapon4': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '56.000'} [2024-08-06 03:05:02,404][52811] DAMAGECOUNT value on done: 347724.0 [2024-08-06 03:05:02,404][52811] Sum rewards: 73.435, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.920', 'AMMO5': '0.011', 'AMMO2': '0.064', 'AMMO3': '0.174', 'weapon5': '0.184', 'weapon4': '0.258', 'AMMO4': '0.320', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '60.000'} [2024-08-06 03:05:02,533][52803] DAMAGECOUNT value on done: 342121.0 [2024-08-06 03:05:02,536][52803] Sum rewards: 74.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.986', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.072', 'WEAPON4': '0.150', 'weapon2': '0.278', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.414', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '64.000'} [2024-08-06 03:05:02,561][52659] DAMAGECOUNT value on done: 368850.0 [2024-08-06 03:05:02,563][52659] Sum rewards: 62.563, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.568', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.182', 'weapon5': '0.194', 'AMMO4': '0.204', 'weapon4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.816', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '51.000'} [2024-08-06 03:05:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 352583680. Throughput: 0: 4367.3. Samples: 88146290. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-06 03:05:02,794][52567] Avg episode reward: [(0, '67.963')] [2024-08-06 03:05:02,876][52650] Updated weights for policy 0, policy_version 43041 (0.0011) [2024-08-06 03:05:03,674][52647] DAMAGECOUNT value on done: 388013.0 [2024-08-06 03:05:03,675][52647] Sum rewards: 72.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.335', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.086', 'AMMO4': '0.169', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:03,912][52795] DAMAGECOUNT value on done: 336169.0 [2024-08-06 03:05:03,914][52795] Sum rewards: 61.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.545', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.126', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.188', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '52.000'} [2024-08-06 03:05:04,005][52666] DAMAGECOUNT value on done: 362046.0 [2024-08-06 03:05:04,006][52666] Sum rewards: 56.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.146', 'weapon2': '0.182', 'AMMO4': '0.224', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.330', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '50.000'} [2024-08-06 03:05:04,293][52670] DAMAGECOUNT value on done: 364247.0 [2024-08-06 03:05:04,293][52670] Sum rewards: 66.213, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.100', 'weapon5': '0.160', 'weapon2': '0.206', 'AMMO3': '0.269', 'AMMO4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.226', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:04,786][52663] DAMAGECOUNT value on done: 372517.0 [2024-08-06 03:05:04,786][52663] Sum rewards: 72.131, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.150', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.107', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:05,238][52659] DAMAGECOUNT value on done: 378458.0 [2024-08-06 03:05:05,240][52659] Sum rewards: 76.419, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.392', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.154', 'weapon5': '0.228', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '0.900', 'weapon3': '2.798', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:05,521][52811] DAMAGECOUNT value on done: 352596.0 [2024-08-06 03:05:05,521][52811] Sum rewards: 59.758, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.136', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.334', 'weapon4': '0.340', 'WEAPON3': '0.950', 'weapon3': '3.000', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '47.000'} [2024-08-06 03:05:05,663][52803] DAMAGECOUNT value on done: 347797.0 [2024-08-06 03:05:05,663][52803] Sum rewards: 73.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.366', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '63.000'} [2024-08-06 03:05:06,867][52666] DAMAGECOUNT value on done: 365862.0 [2024-08-06 03:05:06,868][52666] Sum rewards: 81.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.810', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.104', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '68.000'} [2024-08-06 03:05:07,056][52795] DAMAGECOUNT value on done: 342696.0 [2024-08-06 03:05:07,056][52795] Sum rewards: 67.993, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.587', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.058', 'weapon4': '0.082', 'AMMO4': '0.179', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:07,091][52670] DAMAGECOUNT value on done: 367993.0 [2024-08-06 03:05:07,095][52670] Sum rewards: 75.857, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.082', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:07,375][52650] Updated weights for policy 0, policy_version 43051 (0.0013) [2024-08-06 03:05:07,769][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:05:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 352673792. Throughput: 0: 4369.3. Samples: 88172590. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-06 03:05:07,794][52567] Avg episode reward: [(0, '68.401')] [2024-08-06 03:05:07,879][52659] DAMAGECOUNT value on done: 376380.0 [2024-08-06 03:05:07,879][52659] Sum rewards: 62.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.082', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.136', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon4': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '2.994', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '53.000'} [2024-08-06 03:05:07,891][52663] DAMAGECOUNT value on done: 370507.0 [2024-08-06 03:05:07,891][52663] Sum rewards: 67.434, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.811', 'AMMO5': '0.026', 'AMMO2': '0.077', 'AMMO3': '0.271', 'weapon2': '0.282', 'weapon5': '0.290', 'weapon4': '0.318', 'AMMO4': '0.383', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.742', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:08,702][52803] DAMAGECOUNT value on done: 340102.0 [2024-08-06 03:05:08,703][52803] Sum rewards: 57.840, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.191', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.213', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'weapon4': '0.422', 'weapon2': '0.556', 'WEAPON3': '1.650', 'weapon3': '2.682', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '52.000'} [2024-08-06 03:05:08,756][52811] DAMAGECOUNT value on done: 347590.0 [2024-08-06 03:05:08,758][52811] Sum rewards: 83.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.038', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.211', 'WEAPON3': '1.300', 'weapon3': '3.582', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '67.000'} [2024-08-06 03:05:09,687][52666] DAMAGECOUNT value on done: 363850.0 [2024-08-06 03:05:09,694][52666] Sum rewards: 73.558, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.736', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:09,932][52670] DAMAGECOUNT value on done: 360097.0 [2024-08-06 03:05:09,932][52670] Sum rewards: 70.755, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.131', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:10,144][52795] DAMAGECOUNT value on done: 342232.0 [2024-08-06 03:05:10,145][52795] Sum rewards: 64.077, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.668', 'AMMO5': '0.007', 'AMMO2': '0.034', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon5': '0.282', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '52.000'} [2024-08-06 03:05:10,589][52663] DAMAGECOUNT value on done: 368114.0 [2024-08-06 03:05:10,589][52663] Sum rewards: 61.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.182', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.206', 'AMMO3': '0.230', 'weapon4': '0.288', 'weapon2': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.800', 'weapon3': '2.906', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '54.000'} [2024-08-06 03:05:10,658][52659] DAMAGECOUNT value on done: 374787.0 [2024-08-06 03:05:10,658][52659] Sum rewards: 62.496, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.250', 'AMMO3': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.256', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:11,889][52803] DAMAGECOUNT value on done: 349833.0 [2024-08-06 03:05:11,889][52803] Sum rewards: 46.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.345', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.122', 'weapon5': '0.142', 'AMMO4': '0.181', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.728', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '41.500'} [2024-08-06 03:05:12,106][52811] DAMAGECOUNT value on done: 346430.0 [2024-08-06 03:05:12,106][52811] Sum rewards: 66.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.454', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.144', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.068', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 03:05:12,404][52650] Updated weights for policy 0, policy_version 43061 (0.0022) [2024-08-06 03:05:12,555][52666] DAMAGECOUNT value on done: 373625.0 [2024-08-06 03:05:12,556][52666] Sum rewards: 72.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.116', 'AMMO4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:12,744][52670] DAMAGECOUNT value on done: 373590.0 [2024-08-06 03:05:12,744][52670] Sum rewards: 65.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO3': '0.150', 'AMMO4': '0.180', 'weapon5': '0.182', 'weapon2': '0.346', 'weapon4': '0.532', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.668', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '53.000'} [2024-08-06 03:05:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 352763904. Throughput: 0: 4362.0. Samples: 88198940. Policy #0 lag: (min: 0.0, avg: 4.4, max: 10.0) [2024-08-06 03:05:12,795][52567] Avg episode reward: [(0, '68.171')] [2024-08-06 03:05:12,823][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:05:13,230][52795] DAMAGECOUNT value on done: 344130.0 [2024-08-06 03:05:13,230][52795] Sum rewards: 63.353, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.179', 'weapon2': '1.070', 'WEAPON3': '1.100', 'weapon3': '2.784', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '51.000'} [2024-08-06 03:05:13,721][52659] DAMAGECOUNT value on done: 369566.0 [2024-08-06 03:05:13,721][52659] Sum rewards: 69.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.023', 'AMMO2': '0.068', 'AMMO3': '0.229', 'weapon4': '0.238', 'weapon5': '0.268', 'weapon2': '0.310', 'AMMO4': '0.341', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.896', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.000'} [2024-08-06 03:05:13,869][52663] DAMAGECOUNT value on done: 366103.0 [2024-08-06 03:05:13,869][52663] Sum rewards: 85.853, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.595', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.170', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '3.220', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '68.000'} [2024-08-06 03:05:14,895][52803] DAMAGECOUNT value on done: 346889.0 [2024-08-06 03:05:14,896][52803] Sum rewards: 73.073, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.564', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.126', 'weapon5': '0.144', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:15,187][52811] DAMAGECOUNT value on done: 356210.0 [2024-08-06 03:05:15,189][52811] Sum rewards: 73.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.994', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:15,322][52666] DAMAGECOUNT value on done: 369167.0 [2024-08-06 03:05:15,324][52666] Sum rewards: 78.697, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.100', 'AMMO3': '0.157', 'weapon5': '0.208', 'AMMO4': '0.249', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 03:05:15,537][52670] DAMAGECOUNT value on done: 365415.0 [2024-08-06 03:05:15,541][52670] Sum rewards: 68.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.158', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.072', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:16,390][52795] DAMAGECOUNT value on done: 352292.0 [2024-08-06 03:05:16,390][52795] Sum rewards: 78.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.717', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.178', 'AMMO4': '0.197', 'AMMO3': '0.214', 'weapon5': '0.214', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '65.000'} [2024-08-06 03:05:16,595][52659] DAMAGECOUNT value on done: 377012.0 [2024-08-06 03:05:16,596][52659] Sum rewards: 77.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.660', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.116', 'weapon5': '0.142', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 03:05:16,978][52663] DAMAGECOUNT value on done: 371865.0 [2024-08-06 03:05:16,974][52650] Updated weights for policy 0, policy_version 43071 (0.0012) [2024-08-06 03:05:16,979][52663] Sum rewards: 71.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.099', 'weapon4': '0.146', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.636', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:17,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 352845824. Throughput: 0: 4384.9. Samples: 88212220. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 03:05:17,795][52567] Avg episode reward: [(0, '68.399')] [2024-08-06 03:05:18,024][52803] DAMAGECOUNT value on done: 346368.0 [2024-08-06 03:05:18,029][52803] Sum rewards: 85.173, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '71.000'} [2024-08-06 03:05:18,216][52666] DAMAGECOUNT value on done: 366886.0 [2024-08-06 03:05:18,220][52666] Sum rewards: 69.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.268', 'weapon4': '0.276', 'WEAPON3': '1.050', 'weapon3': '3.168', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:18,233][52811] DAMAGECOUNT value on done: 344069.0 [2024-08-06 03:05:18,233][52811] Sum rewards: 66.905, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.464', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:18,411][52670] DAMAGECOUNT value on done: 366464.0 [2024-08-06 03:05:18,415][52670] Sum rewards: 72.724, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.170', 'weapon5': '0.174', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:19,492][52795] DAMAGECOUNT value on done: 346871.0 [2024-08-06 03:05:19,494][52795] Sum rewards: 61.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.222', 'AMMO3': '0.225', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '1.350', 'weapon3': '2.628', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '52.000'} [2024-08-06 03:05:19,545][52665] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:05:19,791][52659] DAMAGECOUNT value on done: 374958.0 [2024-08-06 03:05:19,792][52659] Sum rewards: 77.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO3': '0.234', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.294', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '64.000'} [2024-08-06 03:05:19,903][52663] DAMAGECOUNT value on done: 373788.0 [2024-08-06 03:05:19,904][52663] Sum rewards: 72.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.296', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '60.000'} [2024-08-06 03:05:21,164][52803] DAMAGECOUNT value on done: 349472.0 [2024-08-06 03:05:21,164][52803] Sum rewards: 66.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.176', 'AMMO3': '0.192', 'AMMO4': '0.238', 'weapon2': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '54.000'} [2024-08-06 03:05:21,267][52811] DAMAGECOUNT value on done: 347375.0 [2024-08-06 03:05:21,271][52811] Sum rewards: 55.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.649', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.120', 'weapon5': '0.130', 'AMMO4': '0.153', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.550', 'HITCOUNT': '2.920', 'weapon3': '3.188', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '48.000'} [2024-08-06 03:05:21,501][52666] DAMAGECOUNT value on done: 369243.0 [2024-08-06 03:05:21,503][52666] Sum rewards: 72.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.280', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO3': '0.168', 'weapon5': '0.170', 'AMMO4': '0.173', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '57.500'} [2024-08-06 03:05:21,695][52670] DAMAGECOUNT value on done: 372811.0 [2024-08-06 03:05:21,697][52670] Sum rewards: 60.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.116', 'AMMO4': '0.164', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.184', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '51.000'} [2024-08-06 03:05:21,851][52650] Updated weights for policy 0, policy_version 43081 (0.0032) [2024-08-06 03:05:22,529][52795] DAMAGECOUNT value on done: 332980.0 [2024-08-06 03:05:22,530][52795] Sum rewards: 71.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.325', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO4': '0.222', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.650', 'weapon3': '3.114', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:22,601][52663] DAMAGECOUNT value on done: 372579.0 [2024-08-06 03:05:22,602][52663] Sum rewards: 67.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.184', 'AMMO4': '0.185', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon2': '0.338', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 352944128. Throughput: 0: 4381.3. Samples: 88238450. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 03:05:22,794][52567] Avg episode reward: [(0, '68.942')] [2024-08-06 03:05:24,177][52666] DAMAGECOUNT value on done: 367995.0 [2024-08-06 03:05:24,177][52666] Sum rewards: 68.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.105', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'weapon4': '0.356', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '56.000'} [2024-08-06 03:05:24,225][52803] DAMAGECOUNT value on done: 344781.0 [2024-08-06 03:05:24,226][52803] Sum rewards: 66.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.638', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.138', 'weapon5': '0.138', 'AMMO4': '0.167', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '56.000'} [2024-08-06 03:05:24,369][52811] DAMAGECOUNT value on done: 348591.0 [2024-08-06 03:05:24,369][52811] Sum rewards: 73.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.101', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.000'} [2024-08-06 03:05:24,404][52670] DAMAGECOUNT value on done: 369811.0 [2024-08-06 03:05:24,409][52670] Sum rewards: 64.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.265', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.404', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:25,581][52795] DAMAGECOUNT value on done: 350345.0 [2024-08-06 03:05:25,582][52795] Sum rewards: 69.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.218', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.492', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '58.000'} [2024-08-06 03:05:25,695][52663] DAMAGECOUNT value on done: 365256.0 [2024-08-06 03:05:25,697][52663] Sum rewards: 69.368, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.506', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.066', 'weapon5': '0.096', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '58.500'} [2024-08-06 03:05:26,284][52650] Updated weights for policy 0, policy_version 43091 (0.0019) [2024-08-06 03:05:26,733][52666] DAMAGECOUNT value on done: 369350.0 [2024-08-06 03:05:26,734][52666] Sum rewards: 86.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon2': '0.128', 'weapon5': '0.132', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '71.000'} [2024-08-06 03:05:26,890][52670] DAMAGECOUNT value on done: 354215.0 [2024-08-06 03:05:26,890][52670] Sum rewards: 67.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.034', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.216', 'weapon2': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.750', 'weapon3': '3.336', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '58.500'} [2024-08-06 03:05:27,386][52667] DAMAGECOUNT value on done: 370263.0 [2024-08-06 03:05:27,386][52667] Sum rewards: 60.515, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.154', 'AMMO4': '0.262', 'AMMO3': '0.280', 'weapon2': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.600', 'weapon3': '2.708', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '53.000'} [2024-08-06 03:05:27,421][52803] DAMAGECOUNT value on done: 344137.0 [2024-08-06 03:05:27,422][52803] Sum rewards: 59.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.058', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.156', 'weapon5': '0.214', 'AMMO4': '0.218', 'AMMO3': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.874', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '49.000'} [2024-08-06 03:05:27,523][52811] DAMAGECOUNT value on done: 343853.0 [2024-08-06 03:05:27,523][52811] Sum rewards: 63.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO2': '0.007', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon4': '0.274', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '54.000'} [2024-08-06 03:05:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 353017856. Throughput: 0: 4379.1. Samples: 88264640. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 03:05:27,795][52567] Avg episode reward: [(0, '69.008')] [2024-08-06 03:05:28,266][52663] DAMAGECOUNT value on done: 365885.0 [2024-08-06 03:05:28,266][52663] Sum rewards: 70.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.886', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.068', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:28,723][52795] DAMAGECOUNT value on done: 338979.0 [2024-08-06 03:05:28,724][52795] Sum rewards: 70.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.813', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.258', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '58.000'} [2024-08-06 03:05:29,640][52666] DAMAGECOUNT value on done: 360223.0 [2024-08-06 03:05:29,644][52666] Sum rewards: 63.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon5': '0.188', 'AMMO3': '0.236', 'AMMO4': '0.269', 'weapon4': '0.274', 'weapon2': '0.330', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.828', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '53.000'} [2024-08-06 03:05:29,810][52670] DAMAGECOUNT value on done: 369572.0 [2024-08-06 03:05:29,812][52670] Sum rewards: 59.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.229', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.162', 'weapon5': '0.220', 'AMMO3': '0.229', 'AMMO4': '0.232', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.072', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2024-08-06 03:05:30,028][52667] DAMAGECOUNT value on done: 375884.0 [2024-08-06 03:05:30,028][52667] Sum rewards: 61.006, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.159', 'WEAPON4': '0.450', 'weapon4': '0.472', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '51.000'} [2024-08-06 03:05:30,538][52803] DAMAGECOUNT value on done: 353468.0 [2024-08-06 03:05:30,540][52803] Sum rewards: 60.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.050', 'AMMO4': '0.153', 'weapon5': '0.168', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.698', 'WEAPON3': '1.500', 'weapon3': '2.806', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '52.000'} [2024-08-06 03:05:30,604][52811] DAMAGECOUNT value on done: 346557.0 [2024-08-06 03:05:30,607][52811] Sum rewards: 58.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.488', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.178', 'weapon4': '0.200', 'AMMO4': '0.224', 'weapon5': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '47.000'} [2024-08-06 03:05:30,860][52663] DAMAGECOUNT value on done: 366210.0 [2024-08-06 03:05:30,860][52663] Sum rewards: 61.483, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon4': '0.124', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '3.146', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '53.000'} [2024-08-06 03:05:30,998][52650] Updated weights for policy 0, policy_version 43101 (0.0027) [2024-08-06 03:05:31,267][52658] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:05:31,834][52795] DAMAGECOUNT value on done: 342013.0 [2024-08-06 03:05:31,835][52795] Sum rewards: 70.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.182', 'weapon2': '0.194', 'weapon5': '0.220', 'AMMO4': '0.244', 'AMMO3': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:32,762][52666] DAMAGECOUNT value on done: 368642.0 [2024-08-06 03:05:32,762][52666] Sum rewards: 73.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.178', 'AMMO4': '0.194', 'AMMO3': '0.242', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.216', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '62.000'} [2024-08-06 03:05:32,780][52667] DAMAGECOUNT value on done: 370164.0 [2024-08-06 03:05:32,780][52667] Sum rewards: 63.174, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.030', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon2': '0.176', 'weapon5': '0.190', 'AMMO4': '0.222', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.262', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:32,807][52567] Fps is (10 sec: 17180.3, 60 sec: 17472.4, 300 sec: 17521.8). Total num frames: 353116160. Throughput: 0: 4378.9. Samples: 88277800. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 03:05:32,809][52567] Avg episode reward: [(0, '68.511')] [2024-08-06 03:05:33,036][52670] DAMAGECOUNT value on done: 374306.0 [2024-08-06 03:05:33,037][52670] Sum rewards: 55.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.106', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '46.000'} [2024-08-06 03:05:33,676][52803] DAMAGECOUNT value on done: 348350.0 [2024-08-06 03:05:33,676][52803] Sum rewards: 68.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.865', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.014', 'weapon4': '0.032', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:33,723][52803] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 03:05:33,737][52811] DAMAGECOUNT value on done: 348280.0 [2024-08-06 03:05:33,741][52811] Sum rewards: 57.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.916', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon2': '0.364', 'WEAPON3': '1.050', 'HITCOUNT': '2.800', 'weapon3': '3.328', 'DAMAGECOUNT': '13.632', 'FRAGCOUNT': '48.000'} [2024-08-06 03:05:34,014][52663] DAMAGECOUNT value on done: 376994.0 [2024-08-06 03:05:34,014][52663] Sum rewards: 65.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'weapon7': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.228', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '56.000'} [2024-08-06 03:05:35,063][52795] DAMAGECOUNT value on done: 339007.0 [2024-08-06 03:05:35,065][52795] Sum rewards: 77.417, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.642', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.512', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '63.000'} [2024-08-06 03:05:35,366][52667] DAMAGECOUNT value on done: 372575.0 [2024-08-06 03:05:35,367][52667] Sum rewards: 66.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '55.500'} [2024-08-06 03:05:35,625][52650] Updated weights for policy 0, policy_version 43111 (0.0015) [2024-08-06 03:05:36,178][52670] DAMAGECOUNT value on done: 367892.0 [2024-08-06 03:05:36,179][52670] Sum rewards: 64.607, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.140', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'weapon4': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.936', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '52.000'} [2024-08-06 03:05:36,841][52803] DAMAGECOUNT value on done: 350001.0 [2024-08-06 03:05:36,844][52803] Sum rewards: 65.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.352', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.222', 'weapon4': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '54.000'} [2024-08-06 03:05:36,888][52663] DAMAGECOUNT value on done: 369468.0 [2024-08-06 03:05:36,888][52663] Sum rewards: 77.177, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.270', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.092', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.586', 'WEAPON3': '0.950', 'weapon3': '3.134', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '60.000'} [2024-08-06 03:05:36,896][52811] DAMAGECOUNT value on done: 345173.0 [2024-08-06 03:05:36,898][52811] Sum rewards: 60.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.210', 'weapon4': '0.268', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.318', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '49.000'} [2024-08-06 03:05:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 353198080. Throughput: 0: 4386.4. Samples: 88304080. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 03:05:37,796][52567] Avg episode reward: [(0, '67.835')] [2024-08-06 03:05:38,121][52795] DAMAGECOUNT value on done: 346732.0 [2024-08-06 03:05:38,131][52795] Sum rewards: 74.358, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.939', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.794', 'WEAPON3': '0.950', 'weapon3': '2.904', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:38,473][52667] DAMAGECOUNT value on done: 376166.0 [2024-08-06 03:05:38,474][52667] Sum rewards: 65.163, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.503', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'weapon2': '0.290', 'AMMO3': '0.298', 'WEAPON3': '1.800', 'HITCOUNT': '3.150', 'weapon3': '3.380', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '59.000'} [2024-08-06 03:05:39,165][52670] DAMAGECOUNT value on done: 368294.0 [2024-08-06 03:05:39,166][52670] Sum rewards: 80.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.076', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '65.000'} [2024-08-06 03:05:39,985][52803] DAMAGECOUNT value on done: 342887.0 [2024-08-06 03:05:39,985][52803] Sum rewards: 67.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.776', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'AMMO4': '0.259', 'weapon4': '0.284', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '56.000'} [2024-08-06 03:05:40,035][52811] DAMAGECOUNT value on done: 348165.0 [2024-08-06 03:05:40,036][52811] Sum rewards: 74.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.738', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.147', 'weapon4': '0.196', 'weapon2': '0.232', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '62.000'} [2024-08-06 03:05:40,155][52663] DAMAGECOUNT value on done: 375345.0 [2024-08-06 03:05:40,156][52663] Sum rewards: 63.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.217', 'weapon5': '0.250', 'AMMO4': '0.285', 'weapon2': '0.334', 'weapon4': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '53.000'} [2024-08-06 03:05:40,309][52650] Updated weights for policy 0, policy_version 43121 (0.0016) [2024-08-06 03:05:41,252][52667] DAMAGECOUNT value on done: 375597.0 [2024-08-06 03:05:41,252][52667] Sum rewards: 51.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.828', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.194', 'AMMO3': '0.260', 'AMMO4': '0.307', 'weapon4': '0.360', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'HITCOUNT': '2.620', 'weapon3': '2.752', 'DAMAGECOUNT': '13.566', 'FRAGCOUNT': '46.000'} [2024-08-06 03:05:41,294][52795] DAMAGECOUNT value on done: 335679.0 [2024-08-06 03:05:41,295][52795] Sum rewards: 66.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.064', 'AMMO4': '0.073', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.344', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.258', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:42,379][52663] DAMAGECOUNT value on done: 371048.0 [2024-08-06 03:05:42,381][52663] Sum rewards: 64.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.440', 'AMMO5': '0.021', 'AMMO2': '0.048', 'AMMO3': '0.160', 'weapon4': '0.164', 'weapon5': '0.190', 'AMMO4': '0.239', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.818', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '54.000'} [2024-08-06 03:05:42,794][52567] Fps is (10 sec: 17226.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 353288192. Throughput: 0: 4382.9. Samples: 88330330. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 03:05:42,794][52567] Avg episode reward: [(0, '67.957')] [2024-08-06 03:05:44,296][52667] DAMAGECOUNT value on done: 377588.0 [2024-08-06 03:05:44,299][52667] Sum rewards: 69.666, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO4': '0.137', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:44,437][52795] DAMAGECOUNT value on done: 355571.0 [2024-08-06 03:05:44,437][52795] Sum rewards: 71.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.148', 'AMMO3': '0.193', 'weapon5': '0.208', 'AMMO4': '0.273', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '58.000'} [2024-08-06 03:05:44,961][52650] Updated weights for policy 0, policy_version 43131 (0.0012) [2024-08-06 03:05:45,502][52663] DAMAGECOUNT value on done: 366383.0 [2024-08-06 03:05:45,502][52663] Sum rewards: 71.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.102', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.232', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '58.000'} [2024-08-06 03:05:47,276][52667] DAMAGECOUNT value on done: 372649.0 [2024-08-06 03:05:47,277][52667] Sum rewards: 67.371, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.018', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.328', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:47,528][52795] DAMAGECOUNT value on done: 345748.0 [2024-08-06 03:05:47,529][52795] Sum rewards: 72.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.858', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.112', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '60.000'} [2024-08-06 03:05:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17550.3). Total num frames: 353378304. Throughput: 0: 4380.7. Samples: 88343420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:05:47,795][52567] Avg episode reward: [(0, '68.179')] [2024-08-06 03:05:49,641][52667] DAMAGECOUNT value on done: 372127.0 [2024-08-06 03:05:49,642][52667] Sum rewards: 61.659, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.452', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.072', 'weapon5': '0.154', 'weapon2': '0.262', 'AMMO3': '0.268', 'AMMO4': '0.358', 'WEAPON5': '0.400', 'weapon4': '0.598', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.670', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:49,764][52650] Updated weights for policy 0, policy_version 43141 (0.0013) [2024-08-06 03:05:50,564][52820] DAMAGECOUNT value on done: 339039.0 [2024-08-06 03:05:50,566][52820] Sum rewards: 47.372, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.175', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon5': '0.148', 'AMMO3': '0.202', 'AMMO4': '0.333', 'weapon2': '0.344', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '2.830', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '42.000'} [2024-08-06 03:05:50,745][52795] DAMAGECOUNT value on done: 336842.0 [2024-08-06 03:05:50,749][52795] Sum rewards: 69.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'weapon4': '0.088', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:52,102][52667] DAMAGECOUNT value on done: 379899.0 [2024-08-06 03:05:52,102][52667] Sum rewards: 67.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.632', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.570', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '56.000'} [2024-08-06 03:05:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 353460224. Throughput: 0: 4375.8. Samples: 88369500. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:05:52,794][52567] Avg episode reward: [(0, '67.935')] [2024-08-06 03:05:53,780][52820] DAMAGECOUNT value on done: 344497.0 [2024-08-06 03:05:53,780][52820] Sum rewards: 65.217, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.555', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.117', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.314', 'weapon2': '0.434', 'WEAPON3': '1.700', 'weapon3': '3.084', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '58.000'} [2024-08-06 03:05:53,939][52795] DAMAGECOUNT value on done: 346625.0 [2024-08-06 03:05:53,939][52795] Sum rewards: 71.323, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.146', 'AMMO4': '0.182', 'AMMO3': '0.183', 'weapon4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.302', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '58.000'} [2024-08-06 03:05:54,305][52650] Updated weights for policy 0, policy_version 43151 (0.0015) [2024-08-06 03:05:54,992][52667] DAMAGECOUNT value on done: 370622.0 [2024-08-06 03:05:54,992][52667] Sum rewards: 63.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.251', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.052', 'AMMO4': '0.151', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.402', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '52.000'} [2024-08-06 03:05:55,079][52665] DAMAGECOUNT value on done: 365026.0 [2024-08-06 03:05:55,081][52665] Sum rewards: 70.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.912', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.074', 'weapon5': '0.140', 'AMMO3': '0.238', 'AMMO4': '0.299', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.232', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '61.000'} [2024-08-06 03:05:55,253][52662] DAMAGECOUNT value on done: 380864.0 [2024-08-06 03:05:55,254][52662] Sum rewards: 61.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.223', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.320', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:56,984][52820] DAMAGECOUNT value on done: 344640.0 [2024-08-06 03:05:56,985][52820] Sum rewards: 62.762, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.240', 'AMMO5': '0.023', 'AMMO2': '0.061', 'weapon4': '0.198', 'AMMO3': '0.265', 'weapon5': '0.270', 'AMMO4': '0.307', 'weapon2': '0.342', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.852', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '55.000'} [2024-08-06 03:05:57,047][52795] DAMAGECOUNT value on done: 351313.0 [2024-08-06 03:05:57,048][52795] Sum rewards: 71.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.370', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.123', 'weapon4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '62.000'} [2024-08-06 03:05:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 353550336. Throughput: 0: 4375.1. Samples: 88395820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:05:57,794][52567] Avg episode reward: [(0, '67.924')] [2024-08-06 03:05:57,956][52667] DAMAGECOUNT value on done: 375140.0 [2024-08-06 03:05:57,958][52667] Sum rewards: 72.956, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.460', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.169', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.556', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.414', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 03:05:58,220][52665] DAMAGECOUNT value on done: 374653.0 [2024-08-06 03:05:58,221][52665] Sum rewards: 63.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.864', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.132', 'weapon4': '0.134', 'AMMO4': '0.201', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 03:05:58,323][52662] DAMAGECOUNT value on done: 377894.0 [2024-08-06 03:05:58,324][52662] Sum rewards: 72.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.836', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.114', 'AMMO4': '0.152', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '60.000'} [2024-08-06 03:05:59,206][52650] Updated weights for policy 0, policy_version 43161 (0.0016) [2024-08-06 03:06:00,210][52820] DAMAGECOUNT value on done: 340762.0 [2024-08-06 03:06:00,212][52820] Sum rewards: 66.034, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.802', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.150', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.196', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '58.000'} [2024-08-06 03:06:00,968][52667] DAMAGECOUNT value on done: 374909.0 [2024-08-06 03:06:00,970][52667] Sum rewards: 69.364, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.433', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.120', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:01,377][52665] DAMAGECOUNT value on done: 372770.0 [2024-08-06 03:06:01,380][52665] Sum rewards: 63.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.061', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.136', 'AMMO4': '0.176', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.312', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:01,473][52662] DAMAGECOUNT value on done: 378753.0 [2024-08-06 03:06:01,474][52662] Sum rewards: 70.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.115', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon2': '0.244', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.542', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:02,044][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:06:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 353640448. Throughput: 0: 4367.8. Samples: 88408770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:06:02,794][52567] Avg episode reward: [(0, '67.633')] [2024-08-06 03:06:03,280][52820] DAMAGECOUNT value on done: 345098.0 [2024-08-06 03:06:03,282][52820] Sum rewards: 59.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.721', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.168', 'weapon5': '0.172', 'AMMO4': '0.180', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.450', 'weapon3': '2.806', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:03,542][52667] DAMAGECOUNT value on done: 369106.0 [2024-08-06 03:06:03,542][52667] Sum rewards: 63.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.482', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:03,592][52650] Updated weights for policy 0, policy_version 43171 (0.0012) [2024-08-06 03:06:03,671][52665] DAMAGECOUNT value on done: 367645.0 [2024-08-06 03:06:03,672][52665] Sum rewards: 75.540, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.816', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.161', 'weapon4': '0.214', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '65.000'} [2024-08-06 03:06:04,272][52662] DAMAGECOUNT value on done: 367275.0 [2024-08-06 03:06:04,274][52662] Sum rewards: 61.505, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.518', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.292', 'weapon2': '0.318', 'WEAPON3': '1.750', 'weapon3': '3.402', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:04,942][52669] DAMAGECOUNT value on done: 375840.0 [2024-08-06 03:06:04,944][52669] Sum rewards: 71.364, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.410', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.169', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:06,394][52665] DAMAGECOUNT value on done: 361840.0 [2024-08-06 03:06:06,395][52665] Sum rewards: 68.586, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.191', 'AMMO3': '0.206', 'weapon4': '0.320', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:06,485][52820] DAMAGECOUNT value on done: 338556.0 [2024-08-06 03:06:06,485][52820] Sum rewards: 66.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.084', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:06,587][52668] DAMAGECOUNT value on done: 368773.0 [2024-08-06 03:06:06,588][52668] Sum rewards: 71.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO3': '0.184', 'AMMO4': '0.215', 'weapon4': '0.246', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.130', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2024-08-06 03:06:06,797][52667] DAMAGECOUNT value on done: 376428.0 [2024-08-06 03:06:06,801][52667] Sum rewards: 58.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.067', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.150', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '48.000'} [2024-08-06 03:06:06,986][52662] DAMAGECOUNT value on done: 377836.0 [2024-08-06 03:06:06,987][52662] Sum rewards: 64.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.127', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:07,532][52669] DAMAGECOUNT value on done: 367228.0 [2024-08-06 03:06:07,534][52669] Sum rewards: 59.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.360', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.176', 'weapon5': '0.238', 'AMMO4': '0.259', 'AMMO3': '0.312', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'HITCOUNT': '2.700', 'weapon3': '2.880', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:07,804][52567] Fps is (10 sec: 17186.3, 60 sec: 17473.4, 300 sec: 17494.2). Total num frames: 353722368. Throughput: 0: 4375.0. Samples: 88435370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:06:07,804][52567] Avg episode reward: [(0, '67.684')] [2024-08-06 03:06:08,532][52650] Updated weights for policy 0, policy_version 43181 (0.0022) [2024-08-06 03:06:09,136][52665] DAMAGECOUNT value on done: 362364.0 [2024-08-06 03:06:09,137][52665] Sum rewards: 56.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.785', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.178', 'weapon4': '0.230', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '45.500'} [2024-08-06 03:06:09,531][52667] DAMAGECOUNT value on done: 382121.0 [2024-08-06 03:06:09,532][52667] Sum rewards: 66.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.160', 'AMMO4': '0.173', 'AMMO3': '0.179', 'weapon2': '0.232', 'WEAPON5': '0.300', 'weapon5': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.098', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:09,728][52820] DAMAGECOUNT value on done: 341362.0 [2024-08-06 03:06:09,728][52820] Sum rewards: 70.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.096', 'weapon5': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '3.108', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:09,735][52668] DAMAGECOUNT value on done: 374862.0 [2024-08-06 03:06:09,736][52668] Sum rewards: 66.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.438', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.120', 'weapon5': '0.156', 'AMMO4': '0.174', 'AMMO3': '0.212', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.128', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:09,835][52662] DAMAGECOUNT value on done: 370820.0 [2024-08-06 03:06:09,837][52662] Sum rewards: 59.145, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO4': '0.183', 'weapon4': '0.226', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.092', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:10,312][52669] DAMAGECOUNT value on done: 377810.0 [2024-08-06 03:06:10,312][52669] Sum rewards: 68.861, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.096', 'weapon5': '0.126', 'AMMO3': '0.201', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.798', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:11,972][52665] DAMAGECOUNT value on done: 369533.0 [2024-08-06 03:06:11,974][52665] Sum rewards: 74.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.884', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.148', 'weapon4': '0.170', 'AMMO3': '0.174', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:12,415][52662] DAMAGECOUNT value on done: 380579.0 [2024-08-06 03:06:12,415][52662] Sum rewards: 66.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.849', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.076', 'AMMO4': '0.172', 'AMMO3': '0.199', 'weapon2': '0.200', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.194', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:12,481][52667] DAMAGECOUNT value on done: 381990.0 [2024-08-06 03:06:12,481][52667] Sum rewards: 67.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.386', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:12,629][52668] DAMAGECOUNT value on done: 376914.0 [2024-08-06 03:06:12,630][52668] Sum rewards: 61.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.152', 'weapon5': '0.202', 'AMMO4': '0.225', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon4': '0.786', 'WEAPON3': '1.050', 'weapon3': '2.422', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '49.000'} [2024-08-06 03:06:12,766][52820] DAMAGECOUNT value on done: 348086.0 [2024-08-06 03:06:12,768][52820] Sum rewards: 58.327, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.960', 'AMMO5': '0.013', 'AMMO2': '0.064', 'weapon5': '0.130', 'weapon4': '0.248', 'weapon2': '0.254', 'AMMO4': '0.318', 'AMMO3': '0.339', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '2.050', 'weapon3': '3.038', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 353812480. Throughput: 0: 4380.0. Samples: 88461740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:06:12,794][52567] Avg episode reward: [(0, '66.977')] [2024-08-06 03:06:12,924][52669] DAMAGECOUNT value on done: 371505.0 [2024-08-06 03:06:12,925][52669] Sum rewards: 61.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.022', 'AMMO2': '0.042', 'AMMO3': '0.195', 'AMMO4': '0.209', 'weapon4': '0.214', 'weapon5': '0.290', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:13,035][52650] Updated weights for policy 0, policy_version 43191 (0.0045) [2024-08-06 03:06:14,760][52665] DAMAGECOUNT value on done: 373050.0 [2024-08-06 03:06:14,761][52665] Sum rewards: 68.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.922', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '3.060', 'weapon3': '3.384', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:15,006][52662] DAMAGECOUNT value on done: 382119.0 [2024-08-06 03:06:15,007][52662] Sum rewards: 75.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.349', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:15,168][52667] DAMAGECOUNT value on done: 379372.0 [2024-08-06 03:06:15,169][52667] Sum rewards: 59.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.009', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO4': '0.168', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.126', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '50.000'} [2024-08-06 03:06:15,686][52668] DAMAGECOUNT value on done: 377739.0 [2024-08-06 03:06:15,687][52668] Sum rewards: 68.523, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.555', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.052', 'AMMO4': '0.172', 'AMMO3': '0.180', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.002', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:15,947][52820] DAMAGECOUNT value on done: 343465.0 [2024-08-06 03:06:15,947][52820] Sum rewards: 63.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.154', 'AMMO4': '0.192', 'AMMO3': '0.195', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.082', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '54.500'} [2024-08-06 03:06:16,054][52669] DAMAGECOUNT value on done: 372621.0 [2024-08-06 03:06:16,055][52669] Sum rewards: 83.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.420', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.135', 'weapon4': '0.170', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '67.000'} [2024-08-06 03:06:17,517][52650] Updated weights for policy 0, policy_version 43201 (0.0025) [2024-08-06 03:06:17,607][52665] DAMAGECOUNT value on done: 372693.0 [2024-08-06 03:06:17,609][52665] Sum rewards: 68.243, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.970', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.190', 'AMMO4': '0.210', 'weapon2': '0.228', 'weapon5': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.760', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:17,635][52667] DAMAGECOUNT value on done: 371671.0 [2024-08-06 03:06:17,635][52667] Sum rewards: 70.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.436', 'AMMO5': '0.025', 'AMMO2': '0.056', 'weapon4': '0.152', 'weapon5': '0.196', 'AMMO3': '0.199', 'AMMO4': '0.279', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.800', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:17,794][52567] Fps is (10 sec: 18040.1, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 353902592. Throughput: 0: 4381.3. Samples: 88474900. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:06:17,794][52567] Avg episode reward: [(0, '66.554')] [2024-08-06 03:06:17,823][52662] DAMAGECOUNT value on done: 374227.0 [2024-08-06 03:06:17,825][52662] Sum rewards: 72.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.691', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.152', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:18,822][52668] DAMAGECOUNT value on done: 369596.0 [2024-08-06 03:06:18,822][52668] Sum rewards: 86.653, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.110', 'AMMO3': '0.130', 'weapon5': '0.138', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.643', 'WEAPON3': '0.700', 'weapon2': '0.784', 'weapon3': '2.744', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '66.000'} [2024-08-06 03:06:19,096][52820] DAMAGECOUNT value on done: 348166.0 [2024-08-06 03:06:19,096][52820] Sum rewards: 80.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '65.000'} [2024-08-06 03:06:19,305][52669] DAMAGECOUNT value on done: 374604.0 [2024-08-06 03:06:19,306][52669] Sum rewards: 76.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.105', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.262', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:19,474][52658] DAMAGECOUNT value on done: 372984.0 [2024-08-06 03:06:19,474][52658] Sum rewards: 65.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.115', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:20,522][52662] DAMAGECOUNT value on done: 385594.0 [2024-08-06 03:06:20,524][52662] Sum rewards: 66.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.204', 'weapon5': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.462', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.474', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:20,600][52667] DAMAGECOUNT value on done: 378680.0 [2024-08-06 03:06:20,601][52667] Sum rewards: 72.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.435', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.080', 'weapon4': '0.148', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '60.500'} [2024-08-06 03:06:20,702][52665] DAMAGECOUNT value on done: 368687.0 [2024-08-06 03:06:20,704][52665] Sum rewards: 68.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.420', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.304', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:21,168][52668] DAMAGECOUNT value on done: 376067.0 [2024-08-06 03:06:21,168][52668] Sum rewards: 58.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.221', 'weapon5': '0.240', 'AMMO4': '0.270', 'weapon2': '0.294', 'weapon4': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:21,323][52670] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:06:21,391][52665] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:06:22,165][52658] DAMAGECOUNT value on done: 374225.0 [2024-08-06 03:06:22,166][52658] Sum rewards: 70.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.507', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.304', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '58.000'} [2024-08-06 03:06:22,202][52820] DAMAGECOUNT value on done: 341458.0 [2024-08-06 03:06:22,202][52820] Sum rewards: 59.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.126', 'weapon4': '0.170', 'weapon2': '0.178', 'AMMO4': '0.212', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.334', 'DAMAGECOUNT': '13.518', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:22,238][52669] DAMAGECOUNT value on done: 374171.0 [2024-08-06 03:06:22,242][52669] Sum rewards: 67.198, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'weapon4': '0.080', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:22,394][52649] DAMAGECOUNT value on done: 365698.0 [2024-08-06 03:06:22,395][52649] Sum rewards: 72.381, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.242', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.392', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:22,483][52650] Updated weights for policy 0, policy_version 43211 (0.0015) [2024-08-06 03:06:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 353984512. Throughput: 0: 4378.2. Samples: 88501100. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:06:22,802][52567] Avg episode reward: [(0, '66.780')] [2024-08-06 03:06:23,491][52662] DAMAGECOUNT value on done: 371027.0 [2024-08-06 03:06:23,491][52662] Sum rewards: 62.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.826', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.096', 'weapon4': '0.116', 'AMMO4': '0.149', 'weapon2': '0.216', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.356', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:23,904][52665] DAMAGECOUNT value on done: 376470.0 [2024-08-06 03:06:23,905][52665] Sum rewards: 65.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.896', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.136', 'weapon2': '0.200', 'AMMO4': '0.229', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:24,032][52668] DAMAGECOUNT value on done: 375949.0 [2024-08-06 03:06:24,034][52668] Sum rewards: 70.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.051', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.164', 'AMMO3': '0.216', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.560', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 03:06:24,905][52658] DAMAGECOUNT value on done: 378919.0 [2024-08-06 03:06:24,906][52658] Sum rewards: 73.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.437', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.170', 'weapon4': '0.186', 'AMMO4': '0.198', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:24,951][52669] DAMAGECOUNT value on done: 375074.0 [2024-08-06 03:06:24,951][52669] Sum rewards: 62.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.352', 'weapon4': '0.384', 'WEAPON3': '1.100', 'weapon3': '2.758', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:25,364][52820] DAMAGECOUNT value on done: 346144.0 [2024-08-06 03:06:25,364][52820] Sum rewards: 55.961, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.020', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.144', 'AMMO4': '0.211', 'weapon5': '0.238', 'AMMO3': '0.306', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'HITCOUNT': '2.920', 'weapon3': '2.944', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:25,431][52649] DAMAGECOUNT value on done: 358995.0 [2024-08-06 03:06:25,431][52649] Sum rewards: 59.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.300', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO4': '0.191', 'weapon2': '0.210', 'AMMO3': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.030', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:25,927][52660] DAMAGECOUNT value on done: 370837.0 [2024-08-06 03:06:25,927][52660] Sum rewards: 66.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.377', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon5': '0.180', 'AMMO4': '0.199', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:26,042][52664] DAMAGECOUNT value on done: 387524.0 [2024-08-06 03:06:26,043][52664] Sum rewards: 72.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.202', 'AMMO3': '0.219', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:26,572][52662] DAMAGECOUNT value on done: 374264.0 [2024-08-06 03:06:26,574][52662] Sum rewards: 59.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.805', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.158', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '2.978', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '49.000'} [2024-08-06 03:06:26,845][52650] Updated weights for policy 0, policy_version 43221 (0.0014) [2024-08-06 03:06:26,877][52668] DAMAGECOUNT value on done: 369929.0 [2024-08-06 03:06:26,880][52668] Sum rewards: 70.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.195', 'weapon2': '0.216', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.490', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:26,891][52665] DAMAGECOUNT value on done: 371109.0 [2024-08-06 03:06:26,892][52665] Sum rewards: 75.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.334', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.180', 'weapon4': '0.280', 'AMMO4': '0.311', 'weapon5': '0.344', 'weapon2': '0.468', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.530', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:27,574][52669] DAMAGECOUNT value on done: 375785.0 [2024-08-06 03:06:27,575][52669] Sum rewards: 67.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.124', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'weapon4': '0.334', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 354074624. Throughput: 0: 4379.3. Samples: 88527400. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:06:27,794][52567] Avg episode reward: [(0, '67.085')] [2024-08-06 03:06:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043222_354074624.pth... [2024-08-06 03:06:27,867][52658] DAMAGECOUNT value on done: 376854.0 [2024-08-06 03:06:27,868][52658] Sum rewards: 70.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.255', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.265', 'weapon2': '0.530', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:27,952][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042709_349872128.pth [2024-08-06 03:06:28,110][52649] DAMAGECOUNT value on done: 364866.0 [2024-08-06 03:06:28,111][52649] Sum rewards: 57.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.562', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.068', 'weapon7': '0.074', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.152', 'AMMO3': '0.178', 'weapon2': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.996', 'WEAPON3': '1.100', 'weapon3': '2.396', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '47.000'} [2024-08-06 03:06:28,539][52820] DAMAGECOUNT value on done: 350361.0 [2024-08-06 03:06:28,539][52820] Sum rewards: 64.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.187', 'weapon4': '0.196', 'weapon5': '0.198', 'AMMO4': '0.214', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:29,021][52664] DAMAGECOUNT value on done: 390156.0 [2024-08-06 03:06:29,023][52664] Sum rewards: 63.153, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.107', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.134', 'AMMO4': '0.152', 'weapon5': '0.194', 'WEAPON7': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '52.500'} [2024-08-06 03:06:29,027][52660] DAMAGECOUNT value on done: 367581.0 [2024-08-06 03:06:29,027][52660] Sum rewards: 79.468, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.102', 'weapon4': '0.148', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.296', 'weapon2': '0.588', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:29,577][52664] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:06:29,677][52665] DAMAGECOUNT value on done: 367202.0 [2024-08-06 03:06:29,680][52665] Sum rewards: 67.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.775', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.192', 'AMMO4': '0.211', 'AMMO3': '0.223', 'weapon2': '0.374', 'weapon4': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:29,781][52662] DAMAGECOUNT value on done: 377806.0 [2024-08-06 03:06:29,782][52662] Sum rewards: 55.451, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.079', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.146', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.700', 'weapon3': '2.834', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '50.000'} [2024-08-06 03:06:30,067][52668] DAMAGECOUNT value on done: 373307.0 [2024-08-06 03:06:30,067][52668] Sum rewards: 83.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.545', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.248', 'WEAPON3': '1.650', 'weapon3': '3.466', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '70.000'} [2024-08-06 03:06:30,364][52658] DAMAGECOUNT value on done: 369942.0 [2024-08-06 03:06:30,366][52658] Sum rewards: 64.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon4': '0.104', 'weapon5': '0.134', 'AMMO4': '0.255', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.650', 'weapon3': '3.064', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:30,677][52669] DAMAGECOUNT value on done: 373193.0 [2024-08-06 03:06:30,678][52669] Sum rewards: 56.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.216', 'weapon5': '0.218', 'AMMO3': '0.229', 'AMMO4': '0.276', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '48.000'} [2024-08-06 03:06:31,353][52649] DAMAGECOUNT value on done: 362584.0 [2024-08-06 03:06:31,353][52649] Sum rewards: 76.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '64.000'} [2024-08-06 03:06:31,488][52664] DAMAGECOUNT value on done: 392102.0 [2024-08-06 03:06:31,489][52664] Sum rewards: 72.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.052', 'AMMO4': '0.177', 'AMMO3': '0.186', 'weapon2': '0.202', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.332', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:31,582][52820] DAMAGECOUNT value on done: 345980.0 [2024-08-06 03:06:31,583][52820] Sum rewards: 65.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.969', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.168', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '3.048', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:32,148][52650] Updated weights for policy 0, policy_version 43231 (0.0012) [2024-08-06 03:06:32,367][52660] DAMAGECOUNT value on done: 379579.0 [2024-08-06 03:06:32,369][52660] Sum rewards: 81.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.608', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.102', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '67.000'} [2024-08-06 03:06:32,434][52794] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:06:32,448][52662] DAMAGECOUNT value on done: 381481.0 [2024-08-06 03:06:32,449][52662] Sum rewards: 63.900, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.183', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.376', 'weapon2': '0.722', 'WEAPON3': '1.150', 'weapon3': '2.516', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:32,804][52567] Fps is (10 sec: 18004.8, 60 sec: 17477.3, 300 sec: 17522.0). Total num frames: 354164736. Throughput: 0: 4374.4. Samples: 88540310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:06:32,804][52567] Avg episode reward: [(0, '67.240')] [2024-08-06 03:06:32,910][52665] DAMAGECOUNT value on done: 367275.0 [2024-08-06 03:06:32,913][52665] Sum rewards: 61.904, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.126', 'weapon5': '0.180', 'weapon2': '0.186', 'AMMO4': '0.247', 'AMMO3': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.200', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:33,108][52668] DAMAGECOUNT value on done: 373921.0 [2024-08-06 03:06:33,116][52668] Sum rewards: 65.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.416', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.210', 'AMMO3': '0.212', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.628', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:33,503][52658] DAMAGECOUNT value on done: 373172.0 [2024-08-06 03:06:33,504][52658] Sum rewards: 59.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.214', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.176', 'AMMO3': '0.217', 'AMMO4': '0.257', 'weapon4': '0.258', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.732', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:33,984][52669] DAMAGECOUNT value on done: 379805.0 [2024-08-06 03:06:33,985][52669] Sum rewards: 76.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.164', 'AMMO3': '0.200', 'weapon4': '0.238', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:34,339][52664] DAMAGECOUNT value on done: 386589.0 [2024-08-06 03:06:34,341][52664] Sum rewards: 61.514, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.062', 'weapon5': '0.102', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:34,546][52649] DAMAGECOUNT value on done: 354546.0 [2024-08-06 03:06:34,548][52649] Sum rewards: 57.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '0.000', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.088', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.536', 'WEAPON3': '0.850', 'weapon3': '2.728', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.455', 'FRAGCOUNT': '47.000'} [2024-08-06 03:06:34,687][52820] DAMAGECOUNT value on done: 350424.0 [2024-08-06 03:06:34,687][52820] Sum rewards: 79.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.026', 'weapon4': '0.094', 'AMMO4': '0.130', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '66.000'} [2024-08-06 03:06:34,891][52660] DAMAGECOUNT value on done: 379210.0 [2024-08-06 03:06:34,894][52660] Sum rewards: 64.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.020', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.309', 'weapon2': '0.470', 'WEAPON3': '1.900', 'weapon3': '3.132', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:35,119][52662] DAMAGECOUNT value on done: 373731.0 [2024-08-06 03:06:35,119][52662] Sum rewards: 64.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.096', 'weapon4': '0.100', 'AMMO3': '0.178', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:35,894][52668] DAMAGECOUNT value on done: 375754.0 [2024-08-06 03:06:35,894][52668] Sum rewards: 78.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.177', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.182', 'AMMO3': '0.199', 'weapon4': '0.242', 'AMMO4': '0.278', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '66.000'} [2024-08-06 03:06:36,052][52665] DAMAGECOUNT value on done: 370833.0 [2024-08-06 03:06:36,053][52665] Sum rewards: 51.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.072', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.288', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.392', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '46.000'} [2024-08-06 03:06:36,126][52650] Updated weights for policy 0, policy_version 43241 (0.0024) [2024-08-06 03:06:36,226][52794] DAMAGECOUNT value on done: 376394.0 [2024-08-06 03:06:36,229][52794] Sum rewards: 61.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.816', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'weapon4': '0.160', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.206', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:36,415][52658] DAMAGECOUNT value on done: 376597.0 [2024-08-06 03:06:36,415][52658] Sum rewards: 63.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.814', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:36,923][52669] DAMAGECOUNT value on done: 374675.0 [2024-08-06 03:06:36,925][52669] Sum rewards: 76.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.118', 'AMMO4': '0.146', 'weapon2': '0.228', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.356', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '66.000'} [2024-08-06 03:06:37,178][52664] DAMAGECOUNT value on done: 388789.0 [2024-08-06 03:06:37,178][52664] Sum rewards: 70.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.274', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.112', 'weapon5': '0.132', 'AMMO4': '0.158', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:37,400][52649] DAMAGECOUNT value on done: 364756.0 [2024-08-06 03:06:37,401][52649] Sum rewards: 64.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.090', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.066', 'weapon5': '0.108', 'AMMO3': '0.183', 'AMMO4': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.174', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:37,785][52820] DAMAGECOUNT value on done: 345337.0 [2024-08-06 03:06:37,786][52820] Sum rewards: 66.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.690', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.096', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 354246656. Throughput: 0: 4384.2. Samples: 88566790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:06:37,794][52567] Avg episode reward: [(0, '67.256')] [2024-08-06 03:06:37,806][52662] DAMAGECOUNT value on done: 386558.0 [2024-08-06 03:06:37,807][52662] Sum rewards: 69.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.324', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.236', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.482', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:37,980][52660] DAMAGECOUNT value on done: 372610.0 [2024-08-06 03:06:37,980][52660] Sum rewards: 71.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO2': '0.010', 'AMMO5': '0.013', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.190', 'weapon4': '0.262', 'WEAPON3': '1.100', 'weapon3': '3.304', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:38,447][52614] Signal inference workers to stop experience collection... (7800 times) [2024-08-06 03:06:38,448][52614] Signal inference workers to resume experience collection... (7800 times) [2024-08-06 03:06:38,489][52650] InferenceWorker_p0-w0: stopping experience collection (7800 times) [2024-08-06 03:06:38,489][52650] InferenceWorker_p0-w0: resuming experience collection (7800 times) [2024-08-06 03:06:38,701][52665] DAMAGECOUNT value on done: 368829.0 [2024-08-06 03:06:38,701][52665] Sum rewards: 70.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:38,899][52794] DAMAGECOUNT value on done: 379601.0 [2024-08-06 03:06:38,901][52794] Sum rewards: 78.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.009', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.148', 'weapon2': '0.156', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:38,921][52668] DAMAGECOUNT value on done: 368501.0 [2024-08-06 03:06:38,922][52668] Sum rewards: 59.359, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.284', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.096', 'AMMO4': '0.229', 'weapon4': '0.230', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.550', 'weapon3': '2.866', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:39,474][52658] DAMAGECOUNT value on done: 368103.0 [2024-08-06 03:06:39,474][52658] Sum rewards: 65.472, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.068', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.149', 'weapon5': '0.186', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:39,765][52671] DAMAGECOUNT value on done: 378724.0 [2024-08-06 03:06:39,767][52671] Sum rewards: 61.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.204', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.100', 'AMMO4': '0.180', 'AMMO3': '0.202', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '48.500'} [2024-08-06 03:06:39,821][52669] DAMAGECOUNT value on done: 370499.0 [2024-08-06 03:06:39,824][52669] Sum rewards: 62.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.115', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.062', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.398', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:39,901][52664] DAMAGECOUNT value on done: 386497.0 [2024-08-06 03:06:39,902][52664] Sum rewards: 53.728, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.679', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.190', 'weapon2': '0.214', 'AMMO4': '0.237', 'weapon4': '0.242', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '3.048', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '47.000'} [2024-08-06 03:06:40,585][52649] DAMAGECOUNT value on done: 359655.0 [2024-08-06 03:06:40,587][52649] Sum rewards: 54.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.323', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.086', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '3.208', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '48.000'} [2024-08-06 03:06:40,723][52662] DAMAGECOUNT value on done: 378010.0 [2024-08-06 03:06:40,723][52662] Sum rewards: 55.861, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.136', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.676', 'WEAPON3': '1.550', 'weapon3': '2.766', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '50.000'} [2024-08-06 03:06:40,896][52820] DAMAGECOUNT value on done: 344767.0 [2024-08-06 03:06:40,897][52820] Sum rewards: 73.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.385', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:40,956][52660] DAMAGECOUNT value on done: 370383.0 [2024-08-06 03:06:40,957][52660] Sum rewards: 73.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.170', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.394', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '62.000'} [2024-08-06 03:06:41,093][52650] Updated weights for policy 0, policy_version 43251 (0.0011) [2024-08-06 03:06:41,537][52665] DAMAGECOUNT value on done: 366469.0 [2024-08-06 03:06:41,539][52665] Sum rewards: 78.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.222', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.130', 'AMMO4': '0.176', 'weapon5': '0.186', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '65.000'} [2024-08-06 03:06:41,739][52668] DAMAGECOUNT value on done: 366120.0 [2024-08-06 03:06:41,740][52668] Sum rewards: 72.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.908', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.164', 'weapon5': '0.172', 'AMMO4': '0.181', 'AMMO3': '0.232', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '62.000'} [2024-08-06 03:06:41,767][52794] DAMAGECOUNT value on done: 375908.0 [2024-08-06 03:06:41,767][52794] Sum rewards: 69.783, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.790', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.146', 'AMMO3': '0.176', 'weapon5': '0.176', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:42,552][52658] DAMAGECOUNT value on done: 382192.0 [2024-08-06 03:06:42,553][52658] Sum rewards: 57.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.517', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO4': '0.192', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON4': '0.450', 'weapon4': '0.452', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '47.000'} [2024-08-06 03:06:42,609][52671] DAMAGECOUNT value on done: 375665.0 [2024-08-06 03:06:42,612][52671] Sum rewards: 67.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.002', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.061', 'AMMO3': '0.195', 'weapon5': '0.248', 'weapon4': '0.266', 'AMMO4': '0.305', 'weapon2': '0.396', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.776', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:42,756][52669] DAMAGECOUNT value on done: 377608.0 [2024-08-06 03:06:42,757][52669] Sum rewards: 71.277, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.155', 'weapon4': '0.188', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:42,795][52567] Fps is (10 sec: 17218.3, 60 sec: 17476.0, 300 sec: 17522.5). Total num frames: 354336768. Throughput: 0: 4385.5. Samples: 88593170. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 03:06:42,795][52567] Avg episode reward: [(0, '67.130')] [2024-08-06 03:06:43,028][52664] DAMAGECOUNT value on done: 387976.0 [2024-08-06 03:06:43,029][52664] Sum rewards: 64.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.008', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.142', 'weapon5': '0.146', 'AMMO4': '0.147', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.506', 'WEAPON3': '0.900', 'weapon3': '2.584', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:43,230][52660] DAMAGECOUNT value on done: 374624.0 [2024-08-06 03:06:43,230][52660] Sum rewards: 82.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.110', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.163', 'weapon5': '0.198', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '67.000'} [2024-08-06 03:06:43,281][52649] DAMAGECOUNT value on done: 368897.0 [2024-08-06 03:06:43,281][52649] Sum rewards: 67.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.126', 'AMMO3': '0.194', 'AMMO4': '0.291', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:43,378][52662] DAMAGECOUNT value on done: 377935.0 [2024-08-06 03:06:43,378][52662] Sum rewards: 71.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.731', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '58.500'} [2024-08-06 03:06:44,006][52668] DAMAGECOUNT value on done: 366768.0 [2024-08-06 03:06:44,014][52668] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:44,043][52820] DAMAGECOUNT value on done: 352914.0 [2024-08-06 03:06:44,043][52820] Sum rewards: 68.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.098', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.150', 'AMMO4': '0.182', 'weapon5': '0.226', 'weapon2': '0.302', 'weapon4': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.810', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:44,267][52794] DAMAGECOUNT value on done: 372614.0 [2024-08-06 03:06:44,268][52794] Sum rewards: 71.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.086', 'weapon4': '0.094', 'AMMO4': '0.188', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.000'} [2024-08-06 03:06:44,778][52665] DAMAGECOUNT value on done: 365325.0 [2024-08-06 03:06:44,779][52665] Sum rewards: 67.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.434', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.084', 'weapon4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 03:06:45,438][52671] DAMAGECOUNT value on done: 376242.0 [2024-08-06 03:06:45,439][52671] Sum rewards: 78.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.034', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.244', 'weapon4': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:45,588][52658] DAMAGECOUNT value on done: 374820.0 [2024-08-06 03:06:45,588][52658] Sum rewards: 64.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.094', 'AMMO4': '0.121', 'weapon5': '0.144', 'AMMO3': '0.207', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.342', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:45,811][52664] DAMAGECOUNT value on done: 382390.0 [2024-08-06 03:06:45,811][52664] Sum rewards: 66.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.062', 'AMMO5': '0.028', 'AMMO2': '0.084', 'AMMO3': '0.225', 'weapon4': '0.238', 'weapon2': '0.282', 'weapon5': '0.338', 'AMMO4': '0.422', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.400', 'weapon3': '2.740', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '53.500'} [2024-08-06 03:06:45,859][52669] DAMAGECOUNT value on done: 382444.0 [2024-08-06 03:06:45,860][52669] Sum rewards: 60.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.336', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.134', 'weapon4': '0.202', 'weapon2': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.160', 'weapon3': '3.198', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:45,930][52650] Updated weights for policy 0, policy_version 43261 (0.0025) [2024-08-06 03:06:45,933][52660] DAMAGECOUNT value on done: 380807.0 [2024-08-06 03:06:45,933][52660] Sum rewards: 66.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.748', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.054', 'weapon4': '0.080', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.220', 'WEAPON3': '1.250', 'weapon3': '3.396', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:46,229][52662] DAMAGECOUNT value on done: 372553.0 [2024-08-06 03:06:46,229][52662] Sum rewards: 71.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.042', 'weapon4': '0.078', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.254', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.366', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:46,550][52649] DAMAGECOUNT value on done: 367611.0 [2024-08-06 03:06:46,550][52649] Sum rewards: 65.414, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.262', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.074', 'weapon5': '0.188', 'AMMO4': '0.193', 'AMMO3': '0.238', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:46,754][52668] DAMAGECOUNT value on done: 366194.0 [2024-08-06 03:06:46,756][52668] Sum rewards: 53.468, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.269', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.254', 'weapon5': '0.266', 'weapon4': '0.292', 'AMMO4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.582', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '47.500'} [2024-08-06 03:06:47,136][52794] DAMAGECOUNT value on done: 371983.0 [2024-08-06 03:06:47,138][52794] Sum rewards: 77.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.775', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon2': '0.172', 'weapon5': '0.174', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '62.000'} [2024-08-06 03:06:47,284][52820] DAMAGECOUNT value on done: 354211.0 [2024-08-06 03:06:47,287][52820] Sum rewards: 69.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.516', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO4': '0.161', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.518', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.086', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:47,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 354426880. Throughput: 0: 4389.9. Samples: 88606320. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 03:06:47,795][52567] Avg episode reward: [(0, '67.904')] [2024-08-06 03:06:47,889][52665] DAMAGECOUNT value on done: 369148.0 [2024-08-06 03:06:47,890][52665] Sum rewards: 61.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.176', 'weapon4': '0.198', 'AMMO4': '0.226', 'AMMO3': '0.234', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.750', 'weapon3': '3.122', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:48,371][52664] DAMAGECOUNT value on done: 391517.0 [2024-08-06 03:06:48,371][52664] Sum rewards: 72.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon4': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:48,550][52669] DAMAGECOUNT value on done: 389410.0 [2024-08-06 03:06:48,551][52669] Sum rewards: 57.661, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.124', 'weapon5': '0.162', 'AMMO3': '0.167', 'AMMO4': '0.215', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.664', 'WEAPON3': '0.950', 'HITCOUNT': '2.610', 'weapon3': '2.784', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '46.000'} [2024-08-06 03:06:48,577][52671] DAMAGECOUNT value on done: 375966.0 [2024-08-06 03:06:48,577][52671] Sum rewards: 68.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.989', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.102', 'weapon4': '0.104', 'AMMO4': '0.117', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:48,732][52658] DAMAGECOUNT value on done: 384154.0 [2024-08-06 03:06:48,732][52658] Sum rewards: 63.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.521', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.177', 'weapon5': '0.218', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '2.566', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '52.000'} [2024-08-06 03:06:48,804][52662] DAMAGECOUNT value on done: 370031.0 [2024-08-06 03:06:48,804][52662] Sum rewards: 65.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.701', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.231', 'weapon2': '0.512', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.334', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:48,823][52660] DAMAGECOUNT value on done: 378424.0 [2024-08-06 03:06:48,826][52660] Sum rewards: 70.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.064', 'weapon4': '0.128', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:49,657][52658] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:06:49,715][52649] DAMAGECOUNT value on done: 361876.0 [2024-08-06 03:06:49,715][52649] Sum rewards: 54.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.126', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '0.950', 'HITCOUNT': '2.810', 'weapon3': '3.268', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '43.000'} [2024-08-06 03:06:49,720][52668] DAMAGECOUNT value on done: 369779.0 [2024-08-06 03:06:49,721][52668] Sum rewards: 67.356, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.165', 'weapon2': '0.476', 'HEALTH': '0.755', 'WEAPON3': '0.900', 'weapon3': '3.290', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '53.000'} [2024-08-06 03:06:49,911][52794] DAMAGECOUNT value on done: 376411.0 [2024-08-06 03:06:49,912][52794] Sum rewards: 65.816, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO5': '0.023', 'AMMO2': '0.050', 'AMMO3': '0.137', 'weapon2': '0.176', 'weapon5': '0.192', 'AMMO4': '0.252', 'weapon4': '0.304', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '2.940', 'weapon3': '3.146', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:50,259][52650] Updated weights for policy 0, policy_version 43271 (0.0013) [2024-08-06 03:06:50,456][52820] DAMAGECOUNT value on done: 344252.0 [2024-08-06 03:06:50,457][52820] Sum rewards: 61.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.142', 'weapon4': '0.162', 'weapon2': '0.190', 'AMMO3': '0.195', 'AMMO4': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.270', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:50,689][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:06:50,884][52665] DAMAGECOUNT value on done: 371437.0 [2024-08-06 03:06:50,884][52665] Sum rewards: 74.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.098', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:51,406][52658] DAMAGECOUNT value on done: 368610.0 [2024-08-06 03:06:51,406][52658] Sum rewards: 64.804, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.127', 'weapon5': '0.136', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.188', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:51,470][52671] DAMAGECOUNT value on done: 381748.0 [2024-08-06 03:06:51,470][52671] Sum rewards: 75.244, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.640', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'AMMO3': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'weapon4': '0.504', 'WEAPON3': '0.900', 'weapon3': '2.810', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:51,490][52664] DAMAGECOUNT value on done: 386324.0 [2024-08-06 03:06:51,491][52664] Sum rewards: 66.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.985', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.086', 'weapon4': '0.120', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.426', 'WEAPON3': '1.650', 'weapon3': '3.028', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '57.000'} [2024-08-06 03:06:51,657][52669] DAMAGECOUNT value on done: 376056.0 [2024-08-06 03:06:51,658][52669] Sum rewards: 71.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.556', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.162', 'AMMO3': '0.200', 'weapon2': '0.282', 'weapon5': '0.288', 'AMMO4': '0.314', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:51,824][52660] DAMAGECOUNT value on done: 373365.0 [2024-08-06 03:06:51,825][52660] Sum rewards: 69.697, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.058', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.298', 'WEAPON3': '1.800', 'weapon3': '3.370', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '62.000'} [2024-08-06 03:06:52,735][52794] DAMAGECOUNT value on done: 380571.0 [2024-08-06 03:06:52,736][52794] Sum rewards: 67.913, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.070', 'weapon4': '0.146', 'AMMO4': '0.255', 'weapon2': '0.268', 'AMMO3': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:52,748][52649] DAMAGECOUNT value on done: 367814.0 [2024-08-06 03:06:52,749][52649] Sum rewards: 70.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.914', 'AMMO5': '0.025', 'AMMO2': '0.059', 'weapon4': '0.186', 'AMMO3': '0.217', 'weapon5': '0.264', 'AMMO4': '0.295', 'weapon2': '0.372', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:52,794][52567] Fps is (10 sec: 18024.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 354516992. Throughput: 0: 4384.3. Samples: 88632620. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 03:06:52,794][52567] Avg episode reward: [(0, '67.272')] [2024-08-06 03:06:52,880][52668] DAMAGECOUNT value on done: 375643.0 [2024-08-06 03:06:52,881][52668] Sum rewards: 78.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.083', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '64.000'} [2024-08-06 03:06:53,875][52664] DAMAGECOUNT value on done: 391646.0 [2024-08-06 03:06:53,875][52664] Sum rewards: 62.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.630', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.163', 'weapon5': '0.178', 'AMMO4': '0.226', 'weapon2': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.920', 'weapon3': '3.042', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '50.000'} [2024-08-06 03:06:54,142][52658] DAMAGECOUNT value on done: 376997.0 [2024-08-06 03:06:54,143][52658] Sum rewards: 58.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.850', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO3': '0.230', 'AMMO4': '0.262', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '3.168', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:54,542][52669] DAMAGECOUNT value on done: 378495.0 [2024-08-06 03:06:54,542][52669] Sum rewards: 62.992, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.434', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.181', 'weapon5': '0.294', 'AMMO4': '0.299', 'weapon2': '0.356', 'WEAPON5': '0.450', 'weapon4': '0.508', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.514', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:54,795][52660] DAMAGECOUNT value on done: 381291.0 [2024-08-06 03:06:54,797][52660] Sum rewards: 69.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.519', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.205', 'weapon5': '0.290', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON4': '0.500', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '2.482', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '56.000'} [2024-08-06 03:06:54,819][52671] DAMAGECOUNT value on done: 373775.0 [2024-08-06 03:06:54,822][52671] Sum rewards: 78.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.137', 'weapon4': '0.182', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:54,965][52794] DAMAGECOUNT value on done: 371358.0 [2024-08-06 03:06:54,965][52794] Sum rewards: 69.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.680', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon4': '0.078', 'AMMO3': '0.213', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.000'} [2024-08-06 03:06:55,272][52650] Updated weights for policy 0, policy_version 43281 (0.0013) [2024-08-06 03:06:55,682][52668] DAMAGECOUNT value on done: 375457.0 [2024-08-06 03:06:55,684][52668] Sum rewards: 69.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.264', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.230', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '58.000'} [2024-08-06 03:06:55,795][52649] DAMAGECOUNT value on done: 369535.0 [2024-08-06 03:06:55,795][52649] Sum rewards: 70.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.325', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.201', 'AMMO4': '0.261', 'weapon5': '0.278', 'weapon4': '0.332', 'weapon2': '0.492', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.566', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:56,869][52664] DAMAGECOUNT value on done: 388598.0 [2024-08-06 03:06:56,870][52664] Sum rewards: 72.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.597', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.072', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:57,314][52658] DAMAGECOUNT value on done: 371711.0 [2024-08-06 03:06:57,315][52658] Sum rewards: 72.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.166', 'weapon4': '0.212', 'AMMO4': '0.225', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '60.000'} [2024-08-06 03:06:57,357][52671] DAMAGECOUNT value on done: 381233.0 [2024-08-06 03:06:57,359][52671] Sum rewards: 81.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.062', 'weapon5': '0.106', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '69.500'} [2024-08-06 03:06:57,447][52669] DAMAGECOUNT value on done: 378670.0 [2024-08-06 03:06:57,448][52669] Sum rewards: 71.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.118', 'weapon5': '0.150', 'AMMO4': '0.219', 'AMMO3': '0.227', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '61.000'} [2024-08-06 03:06:57,578][52660] DAMAGECOUNT value on done: 366990.0 [2024-08-06 03:06:57,581][52660] Sum rewards: 63.948, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon2': '0.158', 'AMMO3': '0.173', 'weapon5': '0.298', 'weapon4': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '51.000'} [2024-08-06 03:06:57,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 354598912. Throughput: 0: 4381.3. Samples: 88658900. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 03:06:57,794][52567] Avg episode reward: [(0, '67.791')] [2024-08-06 03:06:58,287][52794] DAMAGECOUNT value on done: 380406.0 [2024-08-06 03:06:58,287][52794] Sum rewards: 69.039, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.697', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.169', 'AMMO4': '0.180', 'weapon5': '0.192', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:58,384][52649] DAMAGECOUNT value on done: 369614.0 [2024-08-06 03:06:58,384][52649] Sum rewards: 64.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.067', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.120', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.206', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '55.000'} [2024-08-06 03:06:58,775][52668] DAMAGECOUNT value on done: 375780.0 [2024-08-06 03:06:58,776][52668] Sum rewards: 67.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.175', 'AMMO4': '0.201', 'weapon5': '0.202', 'weapon4': '0.264', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.000'} [2024-08-06 03:06:59,610][52664] DAMAGECOUNT value on done: 396795.0 [2024-08-06 03:06:59,610][52664] Sum rewards: 71.678, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.284', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.174', 'weapon5': '0.224', 'AMMO4': '0.246', 'AMMO3': '0.261', 'weapon2': '0.352', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.932', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '63.000'} [2024-08-06 03:06:59,800][52650] Updated weights for policy 0, policy_version 43291 (0.0012) [2024-08-06 03:07:00,148][52671] DAMAGECOUNT value on done: 376405.0 [2024-08-06 03:07:00,150][52671] Sum rewards: 61.756, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.284', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.144', 'AMMO3': '0.147', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.706', 'WEAPON3': '1.000', 'weapon3': '2.784', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '50.000'} [2024-08-06 03:07:00,312][52660] DAMAGECOUNT value on done: 368246.0 [2024-08-06 03:07:00,313][52660] Sum rewards: 80.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon5': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '66.000'} [2024-08-06 03:07:00,355][52658] DAMAGECOUNT value on done: 371700.0 [2024-08-06 03:07:00,355][52658] Sum rewards: 67.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.012', 'weapon5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.190', 'weapon2': '0.190', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.456', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:00,407][52669] DAMAGECOUNT value on done: 380615.0 [2024-08-06 03:07:00,408][52669] Sum rewards: 72.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.994', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '62.000'} [2024-08-06 03:07:01,463][52668] DAMAGECOUNT value on done: 370679.0 [2024-08-06 03:07:01,463][52668] Sum rewards: 68.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.947', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.118', 'weapon5': '0.144', 'AMMO4': '0.154', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:01,527][52794] DAMAGECOUNT value on done: 376354.0 [2024-08-06 03:07:01,527][52794] Sum rewards: 63.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.076', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'HITCOUNT': '3.180', 'weapon3': '3.372', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:01,619][52649] DAMAGECOUNT value on done: 369266.0 [2024-08-06 03:07:01,621][52649] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.194', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.250', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:02,430][52664] DAMAGECOUNT value on done: 391032.0 [2024-08-06 03:07:02,432][52664] Sum rewards: 76.194, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.715', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.098', 'AMMO4': '0.178', 'AMMO3': '0.208', 'weapon5': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '63.000'} [2024-08-06 03:07:02,614][52671] DAMAGECOUNT value on done: 371844.0 [2024-08-06 03:07:02,615][52671] Sum rewards: 72.021, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.136', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.440', 'weapon2': '0.482', 'WEAPON3': '0.900', 'weapon3': '2.650', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '56.000'} [2024-08-06 03:07:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 354689024. Throughput: 0: 4374.9. Samples: 88671770. Policy #0 lag: (min: 1.0, avg: 3.4, max: 8.0) [2024-08-06 03:07:02,795][52567] Avg episode reward: [(0, '67.824')] [2024-08-06 03:07:03,332][52660] DAMAGECOUNT value on done: 381698.0 [2024-08-06 03:07:03,332][52660] Sum rewards: 79.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.775', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.277', 'weapon2': '0.282', 'WEAPON3': '1.800', 'weapon3': '3.374', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.859', 'FRAGCOUNT': '68.000'} [2024-08-06 03:07:03,429][52658] DAMAGECOUNT value on done: 368869.0 [2024-08-06 03:07:03,429][52658] Sum rewards: 69.634, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.388', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '60.000'} [2024-08-06 03:07:04,212][52650] Updated weights for policy 0, policy_version 43301 (0.0046) [2024-08-06 03:07:04,581][52794] DAMAGECOUNT value on done: 372823.0 [2024-08-06 03:07:04,589][52794] Sum rewards: 69.159, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.076', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO4': '0.196', 'weapon2': '0.236', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.190', 'weapon3': '3.216', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '62.000'} [2024-08-06 03:07:04,593][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:07:04,603][52649] DAMAGECOUNT value on done: 359253.0 [2024-08-06 03:07:04,607][52649] Sum rewards: 69.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.110', 'weapon2': '0.140', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.000'} [2024-08-06 03:07:05,109][52671] DAMAGECOUNT value on done: 380482.0 [2024-08-06 03:07:05,109][52671] Sum rewards: 66.984, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.324', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.750', 'weapon3': '3.318', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '59.000'} [2024-08-06 03:07:05,301][52664] DAMAGECOUNT value on done: 394252.0 [2024-08-06 03:07:05,301][52664] Sum rewards: 78.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.161', 'weapon5': '0.194', 'AMMO4': '0.247', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.662', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '62.000'} [2024-08-06 03:07:06,387][52658] DAMAGECOUNT value on done: 381585.0 [2024-08-06 03:07:06,388][52658] Sum rewards: 77.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.380', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'weapon2': '0.272', 'WEAPON3': '1.250', 'HITCOUNT': '3.510', 'weapon3': '3.518', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '63.000'} [2024-08-06 03:07:06,538][52660] DAMAGECOUNT value on done: 383508.0 [2024-08-06 03:07:06,539][52660] Sum rewards: 78.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.568', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '63.000'} [2024-08-06 03:07:07,664][52794] DAMAGECOUNT value on done: 377956.0 [2024-08-06 03:07:07,667][52794] Sum rewards: 81.857, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.821', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.080', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'AMMO3': '0.319', 'weapon2': '0.340', 'WEAPON3': '1.850', 'weapon3': '3.190', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '72.000'} [2024-08-06 03:07:07,743][52671] DAMAGECOUNT value on done: 382806.0 [2024-08-06 03:07:07,743][52671] Sum rewards: 69.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.222', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.532', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '57.000'} [2024-08-06 03:07:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17615.7, 300 sec: 17550.3). Total num frames: 354779136. Throughput: 0: 4377.1. Samples: 88698070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:07:07,794][52567] Avg episode reward: [(0, '68.536')] [2024-08-06 03:07:07,964][52649] DAMAGECOUNT value on done: 367019.0 [2024-08-06 03:07:07,964][52649] Sum rewards: 64.085, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.218', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.126', 'weapon5': '0.160', 'AMMO4': '0.188', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:08,382][52664] DAMAGECOUNT value on done: 384576.0 [2024-08-06 03:07:08,383][52664] Sum rewards: 58.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon4': '0.182', 'AMMO3': '0.192', 'weapon5': '0.214', 'AMMO4': '0.282', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '50.000'} [2024-08-06 03:07:08,867][52658] DAMAGECOUNT value on done: 372465.0 [2024-08-06 03:07:08,867][52658] Sum rewards: 64.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.781', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.100', 'weapon5': '0.116', 'AMMO4': '0.119', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.344', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:09,120][52660] DAMAGECOUNT value on done: 370171.0 [2024-08-06 03:07:09,122][52660] Sum rewards: 58.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.385', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.074', 'weapon5': '0.132', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '47.000'} [2024-08-06 03:07:09,386][52650] Updated weights for policy 0, policy_version 43311 (0.0012) [2024-08-06 03:07:10,501][52794] DAMAGECOUNT value on done: 368286.0 [2024-08-06 03:07:10,509][52794] Sum rewards: 66.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.126', 'AMMO3': '0.200', 'AMMO4': '0.200', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:10,761][52671] DAMAGECOUNT value on done: 374181.0 [2024-08-06 03:07:10,761][52671] Sum rewards: 68.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO3': '0.229', 'AMMO4': '0.307', 'weapon2': '0.498', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 03:07:11,094][52664] DAMAGECOUNT value on done: 386987.0 [2024-08-06 03:07:11,094][52664] Sum rewards: 75.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.177', 'weapon5': '0.186', 'AMMO4': '0.194', 'weapon4': '0.230', 'weapon2': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '63.000'} [2024-08-06 03:07:11,238][52649] DAMAGECOUNT value on done: 362375.0 [2024-08-06 03:07:11,240][52649] Sum rewards: 68.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.192', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.072', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.316', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '59.000'} [2024-08-06 03:07:11,395][52647] DAMAGECOUNT value on done: 395330.0 [2024-08-06 03:07:11,395][52647] Sum rewards: 78.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.803', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.096', 'AMMO4': '0.190', 'AMMO3': '0.195', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '66.000'} [2024-08-06 03:07:11,462][52658] DAMAGECOUNT value on done: 376236.0 [2024-08-06 03:07:11,463][52658] Sum rewards: 71.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.124', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.247', 'WEAPON3': '1.650', 'weapon3': '3.236', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '61.000'} [2024-08-06 03:07:12,287][52660] DAMAGECOUNT value on done: 374271.0 [2024-08-06 03:07:12,290][52660] Sum rewards: 74.516, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.052', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.114', 'AMMO4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 03:07:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 354869248. Throughput: 0: 4377.8. Samples: 88724400. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:07:12,794][52567] Avg episode reward: [(0, '68.585')] [2024-08-06 03:07:13,501][52664] DAMAGECOUNT value on done: 388127.0 [2024-08-06 03:07:13,502][52664] Sum rewards: 71.549, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.146', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.106', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'weapon2': '0.386', 'WEAPON3': '1.650', 'weapon3': '3.086', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '63.000'} [2024-08-06 03:07:13,518][52794] DAMAGECOUNT value on done: 385733.0 [2024-08-06 03:07:13,519][52794] Sum rewards: 74.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.888', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'weapon2': '0.158', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'weapon3': '3.606', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '64.000'} [2024-08-06 03:07:13,673][52671] DAMAGECOUNT value on done: 386404.0 [2024-08-06 03:07:13,674][52671] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.270', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.322', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '54.500'} [2024-08-06 03:07:13,725][52647] DAMAGECOUNT value on done: 393839.0 [2024-08-06 03:07:13,725][52647] Sum rewards: 67.017, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.016', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.080', 'weapon4': '0.118', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.336', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:13,988][52650] Updated weights for policy 0, policy_version 43321 (0.0017) [2024-08-06 03:07:14,417][52649] DAMAGECOUNT value on done: 369276.0 [2024-08-06 03:07:14,420][52649] Sum rewards: 68.920, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'weapon4': '0.102', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'HEALTH': '0.287', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '56.000'} [2024-08-06 03:07:14,427][52658] DAMAGECOUNT value on done: 378037.0 [2024-08-06 03:07:14,429][52658] Sum rewards: 74.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.110', 'AMMO5': '0.009', 'AMMO2': '0.030', 'AMMO3': '0.143', 'weapon5': '0.144', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'weapon4': '0.382', 'WEAPON3': '0.850', 'weapon3': '2.964', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '58.000'} [2024-08-06 03:07:15,469][52660] DAMAGECOUNT value on done: 368645.0 [2024-08-06 03:07:15,470][52660] Sum rewards: 77.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.428', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '65.000'} [2024-08-06 03:07:15,862][52664] DAMAGECOUNT value on done: 386450.0 [2024-08-06 03:07:15,870][52664] Sum rewards: 50.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon2': '0.182', 'AMMO3': '0.247', 'weapon5': '0.254', 'AMMO4': '0.288', 'weapon4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.560', 'weapon3': '2.860', 'DAMAGECOUNT': '12.522', 'FRAGCOUNT': '44.000'} [2024-08-06 03:07:16,105][52647] DAMAGECOUNT value on done: 395195.0 [2024-08-06 03:07:16,107][52647] Sum rewards: 88.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.193', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.422', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.924', 'FRAGCOUNT': '70.000'} [2024-08-06 03:07:16,487][52794] DAMAGECOUNT value on done: 368418.0 [2024-08-06 03:07:16,487][52794] Sum rewards: 52.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.216', 'weapon5': '0.226', 'AMMO3': '0.234', 'AMMO4': '0.239', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '2.856', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '46.000'} [2024-08-06 03:07:16,563][52671] DAMAGECOUNT value on done: 375211.0 [2024-08-06 03:07:16,565][52671] Sum rewards: 72.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.048', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.104', 'AMMO3': '0.186', 'weapon5': '0.226', 'AMMO4': '0.235', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '60.000'} [2024-08-06 03:07:17,613][52649] DAMAGECOUNT value on done: 372127.0 [2024-08-06 03:07:17,613][52649] Sum rewards: 74.780, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.174', 'weapon5': '0.234', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '60.000'} [2024-08-06 03:07:17,795][52567] Fps is (10 sec: 16381.8, 60 sec: 17339.4, 300 sec: 17466.9). Total num frames: 354942976. Throughput: 0: 4383.7. Samples: 88737540. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:07:17,796][52567] Avg episode reward: [(0, '69.172')] [2024-08-06 03:07:18,262][52660] DAMAGECOUNT value on done: 376362.0 [2024-08-06 03:07:18,266][52660] Sum rewards: 75.205, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.128', 'weapon4': '0.154', 'AMMO3': '0.184', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '60.000'} [2024-08-06 03:07:18,275][52664] DAMAGECOUNT value on done: 387562.0 [2024-08-06 03:07:18,276][52664] Sum rewards: 76.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.214', 'AMMO3': '0.230', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '63.000'} [2024-08-06 03:07:18,368][52650] Updated weights for policy 0, policy_version 43331 (0.0021) [2024-08-06 03:07:18,401][52647] DAMAGECOUNT value on done: 400007.0 [2024-08-06 03:07:18,402][52647] Sum rewards: 64.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.184', 'weapon4': '0.198', 'AMMO3': '0.207', 'AMMO4': '0.210', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:19,468][52794] DAMAGECOUNT value on done: 384410.0 [2024-08-06 03:07:19,469][52794] Sum rewards: 72.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.124', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.036', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '60.000'} [2024-08-06 03:07:19,570][52671] DAMAGECOUNT value on done: 367457.0 [2024-08-06 03:07:19,571][52671] Sum rewards: 57.268, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.014', 'ARMOR': '0.016', 'AMMO4': '0.070', 'weapon5': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon7': '0.176', 'AMMO3': '0.199', 'WEAPON7': '0.200', 'weapon2': '0.206', 'weapon4': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.630', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '47.000'} [2024-08-06 03:07:20,739][52647] DAMAGECOUNT value on done: 396284.0 [2024-08-06 03:07:20,741][52647] Sum rewards: 74.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.054', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.101', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 03:07:20,742][52649] DAMAGECOUNT value on done: 369965.0 [2024-08-06 03:07:20,743][52649] Sum rewards: 72.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.492', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.180', 'AMMO3': '0.183', 'weapon5': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '61.000'} [2024-08-06 03:07:20,824][52660] DAMAGECOUNT value on done: 370152.0 [2024-08-06 03:07:20,825][52660] Sum rewards: 65.284, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.030', 'AMMO4': '0.113', 'weapon5': '0.130', 'HEALTH': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:22,499][52671] DAMAGECOUNT value on done: 382518.0 [2024-08-06 03:07:22,500][52671] Sum rewards: 72.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.104', 'weapon4': '0.110', 'AMMO4': '0.161', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.274', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '61.000'} [2024-08-06 03:07:22,681][52794] DAMAGECOUNT value on done: 377275.0 [2024-08-06 03:07:22,683][52794] Sum rewards: 56.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.154', 'weapon4': '0.170', 'AMMO3': '0.210', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.168', 'DAMAGECOUNT': '14.181', 'FRAGCOUNT': '47.000'} [2024-08-06 03:07:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 355041280. Throughput: 0: 4385.8. Samples: 88764150. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:07:22,794][52567] Avg episode reward: [(0, '69.069')] [2024-08-06 03:07:23,220][52650] Updated weights for policy 0, policy_version 43341 (0.0015) [2024-08-06 03:07:23,473][52647] DAMAGECOUNT value on done: 396428.0 [2024-08-06 03:07:23,473][52647] Sum rewards: 64.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.289', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.162', 'AMMO4': '0.186', 'AMMO3': '0.205', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:24,980][52671] DAMAGECOUNT value on done: 381902.0 [2024-08-06 03:07:24,980][52671] Sum rewards: 62.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.656', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.148', 'weapon4': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:25,137][52794] DAMAGECOUNT value on done: 377807.0 [2024-08-06 03:07:25,138][52794] Sum rewards: 69.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO4': '0.177', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.276', 'ARMOR': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '58.000'} [2024-08-06 03:07:26,417][52647] DAMAGECOUNT value on done: 396635.0 [2024-08-06 03:07:26,418][52647] Sum rewards: 70.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.058', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon5': '0.070', 'weapon4': '0.072', 'AMMO4': '0.097', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.638', 'WEAPON3': '0.850', 'weapon3': '3.054', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:27,496][52794] DAMAGECOUNT value on done: 386984.0 [2024-08-06 03:07:27,506][52794] Sum rewards: 69.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.370', 'WEAPON3': '1.600', 'weapon3': '3.230', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '61.000'} [2024-08-06 03:07:27,775][52650] Updated weights for policy 0, policy_version 43351 (0.0020) [2024-08-06 03:07:27,794][52567] Fps is (10 sec: 18844.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 355131392. Throughput: 0: 4388.8. Samples: 88790660. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:07:27,794][52567] Avg episode reward: [(0, '69.078')] [2024-08-06 03:07:27,852][52671] DAMAGECOUNT value on done: 383064.0 [2024-08-06 03:07:27,854][52671] Sum rewards: 65.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.432', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.064', 'AMMO4': '0.195', 'AMMO3': '0.207', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:29,549][52647] DAMAGECOUNT value on done: 390940.0 [2024-08-06 03:07:29,549][52647] Sum rewards: 61.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.412', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.240', 'weapon2': '0.548', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '52.000'} [2024-08-06 03:07:30,079][52794] DAMAGECOUNT value on done: 376236.0 [2024-08-06 03:07:30,079][52794] Sum rewards: 67.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.780', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.070', 'AMMO3': '0.217', 'AMMO4': '0.222', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '58.500'} [2024-08-06 03:07:30,871][52671] DAMAGECOUNT value on done: 377875.0 [2024-08-06 03:07:30,872][52671] Sum rewards: 76.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.119', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.296', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '64.000'} [2024-08-06 03:07:32,071][52647] DAMAGECOUNT value on done: 401711.0 [2024-08-06 03:07:32,071][52647] Sum rewards: 67.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.266', 'weapon4': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '57.000'} [2024-08-06 03:07:32,332][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:07:32,376][52650] Updated weights for policy 0, policy_version 43361 (0.0027) [2024-08-06 03:07:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17479.1, 300 sec: 17522.6). Total num frames: 355213312. Throughput: 0: 4382.5. Samples: 88803530. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:07:32,802][52567] Avg episode reward: [(0, '69.119')] [2024-08-06 03:07:33,504][52671] DAMAGECOUNT value on done: 375370.0 [2024-08-06 03:07:33,504][52671] Sum rewards: 70.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.632', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.152', 'weapon5': '0.164', 'AMMO4': '0.210', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '58.500'} [2024-08-06 03:07:34,203][52659] DAMAGECOUNT value on done: 378998.0 [2024-08-06 03:07:34,203][52659] Sum rewards: 70.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '58.000'} [2024-08-06 03:07:34,945][52647] DAMAGECOUNT value on done: 392425.0 [2024-08-06 03:07:34,947][52647] Sum rewards: 76.764, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.268', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.050', 'AMMO4': '0.137', 'weapon5': '0.148', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '60.000'} [2024-08-06 03:07:37,021][52650] Updated weights for policy 0, policy_version 43371 (0.0013) [2024-08-06 03:07:37,153][52659] DAMAGECOUNT value on done: 376765.0 [2024-08-06 03:07:37,154][52659] Sum rewards: 70.631, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.698', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon4': '0.234', 'WEAPON3': '0.950', 'HITCOUNT': '3.130', 'weapon3': '3.282', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:37,366][52647] DAMAGECOUNT value on done: 399142.0 [2024-08-06 03:07:37,366][52647] Sum rewards: 78.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.312', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.054', 'weapon5': '0.060', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.304', 'WEAPON3': '1.100', 'weapon3': '3.380', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '65.000'} [2024-08-06 03:07:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 355303424. Throughput: 0: 4384.9. Samples: 88829940. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:07:37,794][52567] Avg episode reward: [(0, '69.489')] [2024-08-06 03:07:40,167][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:07:40,275][52647] DAMAGECOUNT value on done: 388832.0 [2024-08-06 03:07:40,276][52647] Sum rewards: 72.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.154', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '61.000'} [2024-08-06 03:07:40,297][52659] DAMAGECOUNT value on done: 376113.0 [2024-08-06 03:07:40,299][52659] Sum rewards: 76.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.441', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.220', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '63.000'} [2024-08-06 03:07:41,560][52650] Updated weights for policy 0, policy_version 43381 (0.0010) [2024-08-06 03:07:42,550][52647] DAMAGECOUNT value on done: 392345.0 [2024-08-06 03:07:42,552][52647] Sum rewards: 72.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.254', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '61.000'} [2024-08-06 03:07:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.1, 300 sec: 17522.6). Total num frames: 355393536. Throughput: 0: 4390.2. Samples: 88856460. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:07:42,802][52567] Avg episode reward: [(0, '69.698')] [2024-08-06 03:07:43,131][52670] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:07:43,332][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:07:43,542][52659] DAMAGECOUNT value on done: 375986.0 [2024-08-06 03:07:43,543][52659] Sum rewards: 62.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.324', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.014', 'AMMO4': '0.032', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.193', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '53.000'} [2024-08-06 03:07:45,561][52647] DAMAGECOUNT value on done: 392953.0 [2024-08-06 03:07:45,562][52647] Sum rewards: 71.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.185', 'AMMO4': '0.247', 'weapon5': '0.264', 'weapon4': '0.362', 'weapon2': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.626', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '59.000'} [2024-08-06 03:07:46,535][52650] Updated weights for policy 0, policy_version 43391 (0.0028) [2024-08-06 03:07:46,972][52659] DAMAGECOUNT value on done: 373013.0 [2024-08-06 03:07:46,974][52659] Sum rewards: 76.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.255', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.154', 'AMMO4': '0.170', 'weapon5': '0.204', 'weapon2': '0.386', 'WEAPON4': '0.450', 'weapon4': '0.472', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.566', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '62.000'} [2024-08-06 03:07:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17550.4). Total num frames: 355483648. Throughput: 0: 4402.0. Samples: 88869860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:07:47,794][52567] Avg episode reward: [(0, '69.936')] [2024-08-06 03:07:48,376][52647] DAMAGECOUNT value on done: 401590.0 [2024-08-06 03:07:48,376][52647] Sum rewards: 56.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.355', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.170', 'AMMO3': '0.196', 'weapon4': '0.234', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '48.000'} [2024-08-06 03:07:49,031][52666] DAMAGECOUNT value on done: 375729.0 [2024-08-06 03:07:49,034][52666] Sum rewards: 66.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.950', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.094', 'AMMO4': '0.118', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.534', 'WEAPON3': '1.800', 'weapon3': '2.964', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '58.000'} [2024-08-06 03:07:49,942][52659] DAMAGECOUNT value on done: 376038.0 [2024-08-06 03:07:49,943][52659] Sum rewards: 56.084, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.112', 'AMMO4': '0.191', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.094', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '52.000'} [2024-08-06 03:07:50,433][52795] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:07:50,827][52650] Updated weights for policy 0, policy_version 43401 (0.0032) [2024-08-06 03:07:51,084][52647] DAMAGECOUNT value on done: 392063.0 [2024-08-06 03:07:51,084][52647] Sum rewards: 64.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.346', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon2': '0.194', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '53.000'} [2024-08-06 03:07:52,016][52666] DAMAGECOUNT value on done: 379212.0 [2024-08-06 03:07:52,018][52666] Sum rewards: 61.149, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.811', 'AMMO5': '0.023', 'AMMO2': '0.077', 'AMMO3': '0.192', 'weapon5': '0.330', 'weapon2': '0.364', 'AMMO4': '0.387', 'WEAPON5': '0.550', 'weapon4': '0.580', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.410', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '51.500'} [2024-08-06 03:07:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 355565568. Throughput: 0: 4396.4. Samples: 88895910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:07:52,794][52567] Avg episode reward: [(0, '69.559')] [2024-08-06 03:07:53,184][52659] DAMAGECOUNT value on done: 375594.0 [2024-08-06 03:07:53,189][52659] Sum rewards: 70.320, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.162', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'weapon4': '0.112', 'weapon5': '0.172', 'AMMO3': '0.254', 'AMMO4': '0.270', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '61.000'} [2024-08-06 03:07:53,490][52647] DAMAGECOUNT value on done: 391387.0 [2024-08-06 03:07:53,491][52647] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.331', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.085', 'weapon5': '0.174', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '53.500'} [2024-08-06 03:07:55,145][52666] DAMAGECOUNT value on done: 379717.0 [2024-08-06 03:07:55,148][52666] Sum rewards: 67.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.172', 'AMMO3': '0.183', 'weapon4': '0.204', 'AMMO4': '0.277', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '54.000'} [2024-08-06 03:07:55,787][52670] DAMAGECOUNT value on done: 371733.0 [2024-08-06 03:07:55,788][52670] Sum rewards: 68.827, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.104', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.129', 'weapon5': '0.130', 'weapon4': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '0.800', 'weapon3': '3.072', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '52.000'} [2024-08-06 03:07:55,842][52650] Updated weights for policy 0, policy_version 43411 (0.0026) [2024-08-06 03:07:55,930][52659] DAMAGECOUNT value on done: 373408.0 [2024-08-06 03:07:55,931][52659] Sum rewards: 64.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon4': '0.190', 'weapon5': '0.196', 'AMMO3': '0.254', 'AMMO4': '0.282', 'weapon2': '0.414', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '55.000'} [2024-08-06 03:07:56,024][52647] DAMAGECOUNT value on done: 389733.0 [2024-08-06 03:07:56,024][52647] Sum rewards: 61.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.725', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.178', 'weapon5': '0.224', 'AMMO4': '0.259', 'weapon2': '0.336', 'weapon4': '0.370', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '49.000'} [2024-08-06 03:07:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 355655680. Throughput: 0: 4397.6. Samples: 88922290. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:07:57,794][52567] Avg episode reward: [(0, '69.365')] [2024-08-06 03:07:58,055][52666] DAMAGECOUNT value on done: 377150.0 [2024-08-06 03:07:58,055][52666] Sum rewards: 68.243, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon4': '0.146', 'AMMO3': '0.237', 'AMMO4': '0.292', 'weapon5': '0.308', 'weapon2': '0.418', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '58.000'} [2024-08-06 03:07:58,739][52670] DAMAGECOUNT value on done: 375719.0 [2024-08-06 03:07:58,742][52670] Sum rewards: 68.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.188', 'AMMO4': '0.223', 'weapon4': '0.244', 'weapon5': '0.264', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '58.000'} [2024-08-06 03:07:58,751][52647] DAMAGECOUNT value on done: 388628.0 [2024-08-06 03:07:58,751][52647] Sum rewards: 65.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.570', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.216', 'AMMO3': '0.226', 'weapon4': '0.298', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.766', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '54.500'} [2024-08-06 03:07:58,771][52659] DAMAGECOUNT value on done: 383325.0 [2024-08-06 03:07:58,772][52659] Sum rewards: 66.070, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.250', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'weapon5': '0.348', 'weapon2': '0.806', 'WEAPON3': '0.850', 'weapon3': '2.736', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '51.000'} [2024-08-06 03:07:58,973][52663] DAMAGECOUNT value on done: 380151.0 [2024-08-06 03:07:58,974][52663] Sum rewards: 52.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.755', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.183', 'weapon5': '0.216', 'AMMO4': '0.247', 'weapon4': '0.256', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '2.818', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '44.000'} [2024-08-06 03:08:00,509][52650] Updated weights for policy 0, policy_version 43421 (0.0012) [2024-08-06 03:08:00,991][52666] DAMAGECOUNT value on done: 373571.0 [2024-08-06 03:08:00,991][52666] Sum rewards: 72.735, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.038', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.216', 'HEALTH': '0.368', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:01,272][52659] DAMAGECOUNT value on done: 384488.0 [2024-08-06 03:08:01,273][52659] Sum rewards: 74.432, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.378', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.124', 'AMMO4': '0.165', 'weapon5': '0.204', 'AMMO3': '0.258', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '62.500'} [2024-08-06 03:08:01,485][52647] DAMAGECOUNT value on done: 393908.0 [2024-08-06 03:08:01,486][52647] Sum rewards: 76.350, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.044', 'AMMO4': '0.118', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.388', 'weapon4': '0.452', 'WEAPON3': '0.950', 'weapon3': '2.936', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '60.000'} [2024-08-06 03:08:01,651][52670] DAMAGECOUNT value on done: 367413.0 [2024-08-06 03:08:01,651][52670] Sum rewards: 78.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.576', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.086', 'weapon5': '0.184', 'AMMO3': '0.203', 'AMMO4': '0.299', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '63.000'} [2024-08-06 03:08:02,084][52663] DAMAGECOUNT value on done: 375067.0 [2024-08-06 03:08:02,085][52663] Sum rewards: 71.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.034', 'AMMO4': '0.170', 'weapon5': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '59.500'} [2024-08-06 03:08:02,697][52811] DAMAGECOUNT value on done: 361427.0 [2024-08-06 03:08:02,698][52811] Sum rewards: 72.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.803', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.090', 'weapon5': '0.188', 'AMMO3': '0.196', 'AMMO4': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '60.000'} [2024-08-06 03:08:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 355745792. Throughput: 0: 4394.6. Samples: 88935290. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 03:08:02,794][52567] Avg episode reward: [(0, '69.265')] [2024-08-06 03:08:03,386][52803] DAMAGECOUNT value on done: 352035.0 [2024-08-06 03:08:03,387][52803] Sum rewards: 54.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.776', 'AMMO5': '0.011', 'AMMO2': '0.074', 'weapon5': '0.210', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'AMMO4': '0.371', 'weapon2': '0.498', 'weapon4': '0.628', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.348', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.347', 'FRAGCOUNT': '47.000'} [2024-08-06 03:08:03,714][52666] DAMAGECOUNT value on done: 368830.0 [2024-08-06 03:08:03,716][52666] Sum rewards: 74.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.117', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:04,423][52659] DAMAGECOUNT value on done: 377555.0 [2024-08-06 03:08:04,423][52659] Sum rewards: 74.866, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.390', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.148', 'weapon2': '0.200', 'AMMO4': '0.222', 'weapon4': '0.286', 'AMMO3': '0.287', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.966', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '63.000'} [2024-08-06 03:08:04,608][52670] DAMAGECOUNT value on done: 366772.0 [2024-08-06 03:08:04,610][52670] Sum rewards: 73.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon4': '0.136', 'weapon5': '0.180', 'weapon2': '0.186', 'AMMO3': '0.226', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.238', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '60.000'} [2024-08-06 03:08:04,760][52663] DAMAGECOUNT value on done: 371917.0 [2024-08-06 03:08:04,760][52663] Sum rewards: 72.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:04,894][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:08:05,163][52650] Updated weights for policy 0, policy_version 43431 (0.0030) [2024-08-06 03:08:05,716][52811] DAMAGECOUNT value on done: 349058.0 [2024-08-06 03:08:05,716][52811] Sum rewards: 76.240, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.076', 'AMMO3': '0.149', 'weapon2': '0.650', 'WEAPON3': '1.000', 'weapon3': '3.102', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:06,520][52803] DAMAGECOUNT value on done: 348860.0 [2024-08-06 03:08:06,521][52803] Sum rewards: 75.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.970', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.136', 'weapon5': '0.192', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '63.000'} [2024-08-06 03:08:06,545][52666] DAMAGECOUNT value on done: 376724.0 [2024-08-06 03:08:06,546][52666] Sum rewards: 78.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.546', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.118', 'AMMO4': '0.174', 'AMMO3': '0.230', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '64.000'} [2024-08-06 03:08:07,107][52670] DAMAGECOUNT value on done: 377874.0 [2024-08-06 03:08:07,109][52670] Sum rewards: 59.785, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.100', 'weapon5': '0.218', 'AMMO3': '0.281', 'AMMO4': '0.298', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.820', 'weapon3': '2.954', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '53.000'} [2024-08-06 03:08:07,625][52659] DAMAGECOUNT value on done: 379483.0 [2024-08-06 03:08:07,625][52659] Sum rewards: 77.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.126', 'AMMO4': '0.193', 'AMMO3': '0.236', 'weapon2': '0.240', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '65.000'} [2024-08-06 03:08:07,751][52663] DAMAGECOUNT value on done: 376976.0 [2024-08-06 03:08:07,754][52663] Sum rewards: 75.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.520', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.283', 'weapon2': '0.356', 'WEAPON3': '1.750', 'weapon3': '3.276', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '65.000'} [2024-08-06 03:08:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 355835904. Throughput: 0: 4388.7. Samples: 88961640. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 03:08:07,802][52567] Avg episode reward: [(0, '69.659')] [2024-08-06 03:08:08,931][52811] DAMAGECOUNT value on done: 348912.0 [2024-08-06 03:08:08,934][52811] Sum rewards: 56.672, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.372', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.186', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '2.898', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '51.000'} [2024-08-06 03:08:09,421][52666] DAMAGECOUNT value on done: 374978.0 [2024-08-06 03:08:09,423][52666] Sum rewards: 66.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.390', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:09,759][52803] DAMAGECOUNT value on done: 352261.0 [2024-08-06 03:08:09,759][52803] Sum rewards: 70.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.070', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.266', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.400', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '60.500'} [2024-08-06 03:08:09,866][52670] DAMAGECOUNT value on done: 370668.0 [2024-08-06 03:08:09,866][52670] Sum rewards: 70.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.105', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:10,054][52650] Updated weights for policy 0, policy_version 43441 (0.0026) [2024-08-06 03:08:10,258][52663] DAMAGECOUNT value on done: 373114.0 [2024-08-06 03:08:10,259][52663] Sum rewards: 64.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.106', 'weapon5': '0.168', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.122', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '54.000'} [2024-08-06 03:08:10,780][52659] DAMAGECOUNT value on done: 368170.0 [2024-08-06 03:08:10,782][52659] Sum rewards: 66.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.679', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.192', 'weapon4': '0.204', 'AMMO4': '0.246', 'weapon5': '0.260', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:11,927][52666] DAMAGECOUNT value on done: 371225.0 [2024-08-06 03:08:11,928][52666] Sum rewards: 73.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.164', 'AMMO3': '0.170', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:12,061][52811] DAMAGECOUNT value on done: 350694.0 [2024-08-06 03:08:12,061][52811] Sum rewards: 59.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.179', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.218', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.150', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '50.000'} [2024-08-06 03:08:12,274][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:08:12,511][52670] DAMAGECOUNT value on done: 366399.0 [2024-08-06 03:08:12,511][52670] Sum rewards: 72.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.177', 'weapon5': '0.182', 'weapon2': '0.262', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '57.000'} [2024-08-06 03:08:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 355909632. Throughput: 0: 4379.1. Samples: 88987720. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 03:08:12,802][52567] Avg episode reward: [(0, '69.236')] [2024-08-06 03:08:12,806][52803] DAMAGECOUNT value on done: 355418.0 [2024-08-06 03:08:12,807][52803] Sum rewards: 66.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.132', 'weapon4': '0.204', 'AMMO3': '0.239', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:13,102][52663] DAMAGECOUNT value on done: 377887.0 [2024-08-06 03:08:13,102][52663] Sum rewards: 63.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.135', 'AMMO5': '0.022', 'weapon7': '0.040', 'AMMO2': '0.054', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.208', 'weapon5': '0.208', 'weapon4': '0.232', 'AMMO4': '0.269', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:13,674][52659] DAMAGECOUNT value on done: 374512.0 [2024-08-06 03:08:13,674][52659] Sum rewards: 67.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.036', 'AMMO4': '0.115', 'weapon5': '0.186', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '54.000'} [2024-08-06 03:08:14,387][52650] Updated weights for policy 0, policy_version 43451 (0.0013) [2024-08-06 03:08:14,622][52666] DAMAGECOUNT value on done: 368213.0 [2024-08-06 03:08:14,624][52666] Sum rewards: 78.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.100', 'weapon2': '0.170', 'AMMO3': '0.191', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '66.000'} [2024-08-06 03:08:15,168][52811] DAMAGECOUNT value on done: 353592.0 [2024-08-06 03:08:15,169][52811] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.011', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.188', 'AMMO4': '0.189', 'weapon4': '0.198', 'AMMO3': '0.214', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.058', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:15,207][52670] DAMAGECOUNT value on done: 369790.0 [2024-08-06 03:08:15,208][52670] Sum rewards: 70.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.236', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO3': '0.207', 'weapon2': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.366', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '57.000'} [2024-08-06 03:08:16,016][52803] DAMAGECOUNT value on done: 356740.0 [2024-08-06 03:08:16,017][52803] Sum rewards: 68.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.783', 'AMMO5': '0.012', 'weapon7': '0.048', 'AMMO2': '0.052', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.180', 'weapon5': '0.182', 'WEAPON7': '0.200', 'AMMO4': '0.263', 'weapon2': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:16,037][52663] DAMAGECOUNT value on done: 376029.0 [2024-08-06 03:08:16,039][52663] Sum rewards: 65.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.132', 'weapon5': '0.132', 'AMMO4': '0.146', 'AMMO3': '0.209', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.168', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:16,796][52659] DAMAGECOUNT value on done: 384914.0 [2024-08-06 03:08:16,799][52659] Sum rewards: 75.307, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.900', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.304', 'WEAPON3': '1.800', 'weapon3': '3.394', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '66.000'} [2024-08-06 03:08:17,148][52666] DAMAGECOUNT value on done: 371338.0 [2024-08-06 03:08:17,149][52666] Sum rewards: 63.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.774', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.160', 'AMMO4': '0.193', 'weapon4': '0.232', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.750', 'weapon3': '2.810', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:17,633][52670] DAMAGECOUNT value on done: 373323.0 [2024-08-06 03:08:17,634][52670] Sum rewards: 64.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.582', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.158', 'AMMO3': '0.222', 'AMMO4': '0.224', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:17,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17613.2, 300 sec: 17494.8). Total num frames: 355999744. Throughput: 0: 4382.2. Samples: 89000730. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 03:08:17,802][52567] Avg episode reward: [(0, '69.112')] [2024-08-06 03:08:18,386][52811] DAMAGECOUNT value on done: 356377.0 [2024-08-06 03:08:18,387][52811] Sum rewards: 57.880, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.706', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.087', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'weapon2': '0.364', 'WEAPON3': '1.700', 'HITCOUNT': '3.020', 'weapon3': '3.222', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '52.000'} [2024-08-06 03:08:19,007][52663] DAMAGECOUNT value on done: 374007.0 [2024-08-06 03:08:19,008][52663] Sum rewards: 71.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.046', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '60.000'} [2024-08-06 03:08:19,068][52650] Updated weights for policy 0, policy_version 43461 (0.0018) [2024-08-06 03:08:19,277][52803] DAMAGECOUNT value on done: 345598.0 [2024-08-06 03:08:19,277][52803] Sum rewards: 64.546, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.238', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.178', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:19,521][52666] DAMAGECOUNT value on done: 369461.0 [2024-08-06 03:08:19,522][52666] Sum rewards: 66.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.092', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.164', 'AMMO3': '0.193', 'AMMO4': '0.227', 'weapon2': '0.278', 'weapon4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:19,863][52659] DAMAGECOUNT value on done: 382053.0 [2024-08-06 03:08:19,863][52659] Sum rewards: 66.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.173', 'weapon4': '0.174', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.106', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '54.000'} [2024-08-06 03:08:20,085][52670] DAMAGECOUNT value on done: 365448.0 [2024-08-06 03:08:20,085][52670] Sum rewards: 63.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.177', 'AMMO3': '0.189', 'weapon4': '0.220', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '53.500'} [2024-08-06 03:08:21,690][52811] DAMAGECOUNT value on done: 352279.0 [2024-08-06 03:08:21,690][52811] Sum rewards: 72.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO3': '0.187', 'AMMO4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:22,086][52666] DAMAGECOUNT value on done: 379571.0 [2024-08-06 03:08:22,087][52666] Sum rewards: 68.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.072', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.203', 'weapon5': '0.204', 'weapon4': '0.226', 'AMMO3': '0.232', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.552', 'WEAPON3': '1.450', 'weapon3': '2.694', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:22,234][52803] DAMAGECOUNT value on done: 347465.0 [2024-08-06 03:08:22,234][52803] Sum rewards: 73.728, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.157', 'weapon4': '0.180', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.892', 'WEAPON3': '1.200', 'weapon3': '2.626', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '60.000'} [2024-08-06 03:08:22,351][52663] DAMAGECOUNT value on done: 371122.0 [2024-08-06 03:08:22,351][52663] Sum rewards: 61.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.161', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '52.000'} [2024-08-06 03:08:22,474][52670] DAMAGECOUNT value on done: 379114.0 [2024-08-06 03:08:22,474][52670] Sum rewards: 63.348, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.600', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon4': '0.196', 'AMMO3': '0.260', 'weapon5': '0.274', 'AMMO4': '0.319', 'weapon2': '0.332', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.798', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:22,716][52659] DAMAGECOUNT value on done: 380816.0 [2024-08-06 03:08:22,716][52659] Sum rewards: 67.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.615', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.178', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 356089856. Throughput: 0: 4379.8. Samples: 89027030. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 03:08:22,794][52567] Avg episode reward: [(0, '68.659')] [2024-08-06 03:08:23,689][52795] DAMAGECOUNT value on done: 350247.0 [2024-08-06 03:08:23,689][52795] Sum rewards: 81.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.432', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO3': '0.192', 'weapon2': '0.228', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '67.000'} [2024-08-06 03:08:23,759][52650] Updated weights for policy 0, policy_version 43471 (0.0024) [2024-08-06 03:08:24,674][52811] DAMAGECOUNT value on done: 353238.0 [2024-08-06 03:08:24,676][52811] Sum rewards: 65.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.104', 'weapon5': '0.110', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:24,768][52666] DAMAGECOUNT value on done: 374739.0 [2024-08-06 03:08:24,771][52666] Sum rewards: 72.649, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.169', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.374', 'HEALTH': '0.572', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2024-08-06 03:08:25,265][52803] DAMAGECOUNT value on done: 347190.0 [2024-08-06 03:08:25,266][52803] Sum rewards: 67.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.105', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.070', 'weapon5': '0.158', 'AMMO3': '0.168', 'AMMO4': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:25,303][52663] DAMAGECOUNT value on done: 377448.0 [2024-08-06 03:08:25,306][52663] Sum rewards: 66.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.116', 'AMMO4': '0.173', 'weapon5': '0.182', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '54.000'} [2024-08-06 03:08:25,423][52670] DAMAGECOUNT value on done: 371020.0 [2024-08-06 03:08:25,426][52670] Sum rewards: 66.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.126', 'weapon5': '0.184', 'AMMO4': '0.253', 'AMMO3': '0.256', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:25,476][52659] DAMAGECOUNT value on done: 374221.0 [2024-08-06 03:08:25,478][52659] Sum rewards: 54.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.109', 'weapon5': '0.134', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.400', 'HITCOUNT': '2.650', 'weapon3': '3.130', 'DAMAGECOUNT': '13.605', 'FRAGCOUNT': '47.000'} [2024-08-06 03:08:26,898][52795] DAMAGECOUNT value on done: 341885.0 [2024-08-06 03:08:26,898][52795] Sum rewards: 77.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.204', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.036', 'weapon5': '0.148', 'AMMO3': '0.175', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '62.000'} [2024-08-06 03:08:27,792][52811] DAMAGECOUNT value on done: 358278.0 [2024-08-06 03:08:27,792][52811] Sum rewards: 67.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.116', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.740', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '54.000'} [2024-08-06 03:08:27,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 356188160. Throughput: 0: 4371.1. Samples: 89053160. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 03:08:27,794][52567] Avg episode reward: [(0, '68.403')] [2024-08-06 03:08:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043480_356188160.pth... [2024-08-06 03:08:27,828][52666] DAMAGECOUNT value on done: 372422.0 [2024-08-06 03:08:27,829][52666] Sum rewards: 64.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.116', 'weapon2': '0.160', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.252', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:27,916][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000042966_351977472.pth [2024-08-06 03:08:28,283][52659] DAMAGECOUNT value on done: 382707.0 [2024-08-06 03:08:28,284][52659] Sum rewards: 74.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.218', 'WEAPON3': '1.200', 'weapon3': '3.412', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '62.000'} [2024-08-06 03:08:28,290][52803] DAMAGECOUNT value on done: 353410.0 [2024-08-06 03:08:28,290][52803] Sum rewards: 69.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon2': '0.184', 'weapon5': '0.220', 'AMMO4': '0.236', 'AMMO3': '0.241', 'weapon4': '0.252', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:28,385][52663] DAMAGECOUNT value on done: 380383.0 [2024-08-06 03:08:28,385][52663] Sum rewards: 81.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.546', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.134', 'weapon5': '0.170', 'AMMO3': '0.180', 'AMMO4': '0.188', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '66.000'} [2024-08-06 03:08:28,499][52670] DAMAGECOUNT value on done: 372145.0 [2024-08-06 03:08:28,500][52670] Sum rewards: 66.984, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.412', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.100', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 03:08:28,850][52650] Updated weights for policy 0, policy_version 43481 (0.0046) [2024-08-06 03:08:30,233][52795] DAMAGECOUNT value on done: 341833.0 [2024-08-06 03:08:30,234][52795] Sum rewards: 69.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.172', 'AMMO4': '0.190', 'AMMO3': '0.231', 'weapon4': '0.244', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:30,695][52666] DAMAGECOUNT value on done: 374436.0 [2024-08-06 03:08:30,695][52666] Sum rewards: 71.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.076', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.390', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:30,896][52659] DAMAGECOUNT value on done: 380809.0 [2024-08-06 03:08:30,897][52659] Sum rewards: 67.992, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon2': '0.228', 'AMMO3': '0.235', 'weapon5': '0.236', 'AMMO4': '0.302', 'WEAPON5': '0.400', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '56.500'} [2024-08-06 03:08:31,031][52811] DAMAGECOUNT value on done: 352836.0 [2024-08-06 03:08:31,032][52811] Sum rewards: 62.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.800', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.400', 'weapon4': '0.516', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '53.000'} [2024-08-06 03:08:31,207][52803] DAMAGECOUNT value on done: 345188.0 [2024-08-06 03:08:31,208][52803] Sum rewards: 55.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.893', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.170', 'AMMO4': '0.178', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.106', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '46.000'} [2024-08-06 03:08:31,226][52670] DAMAGECOUNT value on done: 378463.0 [2024-08-06 03:08:31,227][52670] Sum rewards: 72.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.234', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:31,699][52663] DAMAGECOUNT value on done: 378019.0 [2024-08-06 03:08:31,701][52663] Sum rewards: 67.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.862', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '53.000'} [2024-08-06 03:08:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 356261888. Throughput: 0: 4367.1. Samples: 89066380. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:08:32,794][52567] Avg episode reward: [(0, '68.695')] [2024-08-06 03:08:33,049][52650] Updated weights for policy 0, policy_version 43491 (0.0027) [2024-08-06 03:08:33,286][52795] DAMAGECOUNT value on done: 348240.0 [2024-08-06 03:08:33,286][52795] Sum rewards: 68.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.839', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.082', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:33,526][52666] DAMAGECOUNT value on done: 373395.0 [2024-08-06 03:08:33,529][52666] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.234', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon2': '0.240', 'AMMO3': '0.242', 'AMMO4': '0.252', 'weapon5': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.654', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:34,066][52811] DAMAGECOUNT value on done: 352872.0 [2024-08-06 03:08:34,067][52811] Sum rewards: 76.474, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.500', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.132', 'AMMO4': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.311', 'weapon2': '0.452', 'WEAPON3': '1.900', 'weapon3': '3.034', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '67.000'} [2024-08-06 03:08:34,296][52670] DAMAGECOUNT value on done: 375639.0 [2024-08-06 03:08:34,296][52670] Sum rewards: 71.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'weapon4': '0.222', 'AMMO3': '0.260', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:34,355][52803] DAMAGECOUNT value on done: 355587.0 [2024-08-06 03:08:34,357][52803] Sum rewards: 65.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.314', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.120', 'weapon4': '0.126', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '53.000'} [2024-08-06 03:08:34,426][52667] DAMAGECOUNT value on done: 375915.0 [2024-08-06 03:08:34,426][52667] Sum rewards: 65.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.160', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.180', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '54.000'} [2024-08-06 03:08:34,690][52663] DAMAGECOUNT value on done: 371007.0 [2024-08-06 03:08:34,690][52663] Sum rewards: 64.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.540', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.090', 'weapon5': '0.190', 'AMMO3': '0.211', 'AMMO4': '0.236', 'WEAPON4': '0.500', 'weapon2': '0.502', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '54.500'} [2024-08-06 03:08:35,691][52794] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:08:36,393][52795] DAMAGECOUNT value on done: 348149.0 [2024-08-06 03:08:36,393][52795] Sum rewards: 71.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.110', 'weapon4': '0.136', 'AMMO3': '0.205', 'AMMO4': '0.252', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:36,934][52666] DAMAGECOUNT value on done: 375684.0 [2024-08-06 03:08:36,934][52666] Sum rewards: 75.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.308', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon5': '0.234', 'AMMO3': '0.260', 'weapon2': '0.276', 'AMMO4': '0.293', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.854', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '63.000'} [2024-08-06 03:08:37,061][52811] DAMAGECOUNT value on done: 361868.0 [2024-08-06 03:08:37,061][52811] Sum rewards: 69.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'AMMO5': '0.026', 'AMMO2': '0.066', 'AMMO3': '0.179', 'weapon5': '0.248', 'weapon2': '0.300', 'AMMO4': '0.329', 'weapon4': '0.354', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:37,374][52667] DAMAGECOUNT value on done: 382228.0 [2024-08-06 03:08:37,377][52667] Sum rewards: 77.483, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.076', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '64.000'} [2024-08-06 03:08:37,390][52663] DAMAGECOUNT value on done: 371304.0 [2024-08-06 03:08:37,390][52663] Sum rewards: 70.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:37,429][52803] DAMAGECOUNT value on done: 352792.0 [2024-08-06 03:08:37,431][52803] Sum rewards: 73.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO3': '0.176', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:37,517][52670] DAMAGECOUNT value on done: 359862.0 [2024-08-06 03:08:37,519][52670] Sum rewards: 69.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.146', 'weapon4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '60.000'} [2024-08-06 03:08:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 356352000. Throughput: 0: 4367.8. Samples: 89092460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:08:37,794][52567] Avg episode reward: [(0, '68.444')] [2024-08-06 03:08:38,183][52650] Updated weights for policy 0, policy_version 43501 (0.0013) [2024-08-06 03:08:39,068][52614] Signal inference workers to stop experience collection... (7850 times) [2024-08-06 03:08:39,069][52614] Signal inference workers to resume experience collection... (7850 times) [2024-08-06 03:08:39,106][52650] InferenceWorker_p0-w0: stopping experience collection (7850 times) [2024-08-06 03:08:39,107][52650] InferenceWorker_p0-w0: resuming experience collection (7850 times) [2024-08-06 03:08:39,566][52795] DAMAGECOUNT value on done: 350645.0 [2024-08-06 03:08:39,568][52795] Sum rewards: 76.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.015', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.482', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '65.000'} [2024-08-06 03:08:39,915][52666] DAMAGECOUNT value on done: 366216.0 [2024-08-06 03:08:39,917][52666] Sum rewards: 68.916, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.370', 'AMMO5': '0.018', 'AMMO2': '0.087', 'weapon5': '0.206', 'weapon4': '0.218', 'AMMO3': '0.279', 'weapon2': '0.372', 'AMMO4': '0.437', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.836', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:40,200][52811] DAMAGECOUNT value on done: 350498.0 [2024-08-06 03:08:40,203][52811] Sum rewards: 81.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon2': '0.172', 'AMMO4': '0.184', 'weapon5': '0.186', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '69.000'} [2024-08-06 03:08:40,474][52663] DAMAGECOUNT value on done: 372581.0 [2024-08-06 03:08:40,476][52663] Sum rewards: 83.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.668', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon4': '0.120', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '68.000'} [2024-08-06 03:08:40,577][52667] DAMAGECOUNT value on done: 375396.0 [2024-08-06 03:08:40,577][52667] Sum rewards: 67.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.252', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.112', 'weapon4': '0.136', 'AMMO4': '0.169', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:40,580][52670] DAMAGECOUNT value on done: 375121.0 [2024-08-06 03:08:40,581][52670] Sum rewards: 66.045, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.013', 'AMMO2': '0.061', 'AMMO3': '0.204', 'weapon5': '0.270', 'AMMO4': '0.306', 'WEAPON5': '0.400', 'weapon4': '0.508', 'weapon2': '0.556', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.448', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '52.000'} [2024-08-06 03:08:40,604][52803] DAMAGECOUNT value on done: 352197.0 [2024-08-06 03:08:40,604][52803] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.085', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.114', 'AMMO4': '0.117', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.500'} [2024-08-06 03:08:40,684][52660] Large shaping reward 2.504 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.453, 151.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:08:42,454][52650] Updated weights for policy 0, policy_version 43511 (0.0035) [2024-08-06 03:08:42,678][52795] DAMAGECOUNT value on done: 357182.0 [2024-08-06 03:08:42,679][52795] Sum rewards: 58.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.351', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.125', 'weapon5': '0.128', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.132', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '50.000'} [2024-08-06 03:08:42,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.4). Total num frames: 356450304. Throughput: 0: 4364.9. Samples: 89118710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:08:42,794][52567] Avg episode reward: [(0, '69.088')] [2024-08-06 03:08:42,920][52663] DAMAGECOUNT value on done: 382699.0 [2024-08-06 03:08:42,922][52663] Sum rewards: 69.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.092', 'weapon5': '0.120', 'AMMO3': '0.216', 'weapon2': '0.258', 'AMMO4': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:43,012][52666] DAMAGECOUNT value on done: 375276.0 [2024-08-06 03:08:43,014][52666] Sum rewards: 80.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.938', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.203', 'weapon2': '0.242', 'weapon4': '0.270', 'weapon5': '0.280', 'AMMO4': '0.281', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '66.000'} [2024-08-06 03:08:43,393][52811] DAMAGECOUNT value on done: 352361.0 [2024-08-06 03:08:43,393][52811] Sum rewards: 57.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.622', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.134', 'weapon5': '0.146', 'AMMO4': '0.184', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '2.916', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '49.000'} [2024-08-06 03:08:43,532][52667] DAMAGECOUNT value on done: 378204.0 [2024-08-06 03:08:43,532][52667] Sum rewards: 68.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.867', 'AMMO2': '0.004', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO4': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.404', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.296', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '58.000'} [2024-08-06 03:08:43,576][52670] DAMAGECOUNT value on done: 379122.0 [2024-08-06 03:08:43,578][52670] Sum rewards: 51.529, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.230', 'AMMO5': '0.022', 'AMMO2': '0.064', 'AMMO3': '0.301', 'weapon4': '0.302', 'weapon5': '0.316', 'AMMO4': '0.322', 'weapon2': '0.400', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.580', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '49.500'} [2024-08-06 03:08:43,614][52803] DAMAGECOUNT value on done: 355161.0 [2024-08-06 03:08:43,614][52803] Sum rewards: 69.176, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.652', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.184', 'weapon4': '0.246', 'AMMO3': '0.252', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:45,855][52795] DAMAGECOUNT value on done: 352100.0 [2024-08-06 03:08:45,857][52795] Sum rewards: 58.851, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon5': '0.268', 'AMMO3': '0.278', 'weapon2': '0.294', 'AMMO4': '0.312', 'weapon4': '0.320', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'HITCOUNT': '2.750', 'weapon3': '2.762', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '52.000'} [2024-08-06 03:08:46,010][52663] DAMAGECOUNT value on done: 373966.0 [2024-08-06 03:08:46,011][52663] Sum rewards: 54.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.079', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.094', 'DAMAGECOUNT': '13.494', 'FRAGCOUNT': '47.000'} [2024-08-06 03:08:46,294][52667] DAMAGECOUNT value on done: 382222.0 [2024-08-06 03:08:46,295][52667] Sum rewards: 75.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.132', 'weapon2': '0.232', 'AMMO3': '0.237', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '64.000'} [2024-08-06 03:08:46,390][52670] DAMAGECOUNT value on done: 373606.0 [2024-08-06 03:08:46,391][52670] Sum rewards: 57.725, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.554', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.176', 'weapon5': '0.192', 'weapon2': '0.260', 'AMMO3': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.080', 'weapon3': '3.168', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '51.500'} [2024-08-06 03:08:46,489][52803] DAMAGECOUNT value on done: 350544.0 [2024-08-06 03:08:46,489][52803] Sum rewards: 66.599, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.598', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.088', 'weapon5': '0.212', 'AMMO3': '0.238', 'weapon2': '0.242', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '56.500'} [2024-08-06 03:08:46,543][52811] DAMAGECOUNT value on done: 354719.0 [2024-08-06 03:08:46,547][52811] Sum rewards: 75.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.719', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon4': '0.220', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '61.000'} [2024-08-06 03:08:46,746][52664] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2024-08-06 03:08:47,419][52650] Updated weights for policy 0, policy_version 43521 (0.0022) [2024-08-06 03:08:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 356524032. Throughput: 0: 4368.4. Samples: 89131870. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:08:47,794][52567] Avg episode reward: [(0, '68.773')] [2024-08-06 03:08:48,920][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:08:48,942][52795] DAMAGECOUNT value on done: 339399.0 [2024-08-06 03:08:48,943][52795] Sum rewards: 71.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.411', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.066', 'weapon7': '0.072', 'AMMO4': '0.093', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.212', 'AMMO3': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2024-08-06 03:08:48,977][52667] DAMAGECOUNT value on done: 380981.0 [2024-08-06 03:08:48,979][52667] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.054', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.164', 'AMMO3': '0.167', 'weapon5': '0.174', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '55.000'} [2024-08-06 03:08:49,103][52670] DAMAGECOUNT value on done: 374193.0 [2024-08-06 03:08:49,104][52670] Sum rewards: 67.766, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.380', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.100', 'weapon4': '0.168', 'weapon2': '0.196', 'AMMO3': '0.252', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 03:08:49,145][52663] DAMAGECOUNT value on done: 380595.0 [2024-08-06 03:08:49,145][52663] Sum rewards: 64.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.784', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon5': '0.174', 'weapon4': '0.224', 'AMMO3': '0.262', 'weapon2': '0.286', 'AMMO4': '0.297', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '56.000'} [2024-08-06 03:08:49,510][52803] DAMAGECOUNT value on done: 350278.0 [2024-08-06 03:08:49,510][52803] Sum rewards: 75.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.696', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.246', 'weapon4': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 03:08:49,663][52811] DAMAGECOUNT value on done: 348956.0 [2024-08-06 03:08:49,663][52811] Sum rewards: 66.224, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.419', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.157', 'weapon5': '0.216', 'AMMO4': '0.232', 'weapon4': '0.268', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.880', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '53.000'} [2024-08-06 03:08:51,570][52667] DAMAGECOUNT value on done: 382620.0 [2024-08-06 03:08:51,574][52667] Sum rewards: 57.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.314', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.132', 'AMMO3': '0.172', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '48.000'} [2024-08-06 03:08:51,576][52650] Updated weights for policy 0, policy_version 43531 (0.0019) [2024-08-06 03:08:51,981][52663] DAMAGECOUNT value on done: 376840.0 [2024-08-06 03:08:51,982][52663] Sum rewards: 64.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.326', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '53.000'} [2024-08-06 03:08:52,012][52795] DAMAGECOUNT value on done: 355260.0 [2024-08-06 03:08:52,015][52795] Sum rewards: 62.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.790', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '51.000'} [2024-08-06 03:08:52,234][52660] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:08:52,607][52803] DAMAGECOUNT value on done: 358716.0 [2024-08-06 03:08:52,611][52803] Sum rewards: 62.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.611', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.154', 'weapon4': '0.202', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.146', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '52.000'} [2024-08-06 03:08:52,677][52811] DAMAGECOUNT value on done: 352754.0 [2024-08-06 03:08:52,681][52811] Sum rewards: 71.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.532', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.082', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '57.500'} [2024-08-06 03:08:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 356622336. Throughput: 0: 4371.8. Samples: 89158370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:08:52,794][52567] Avg episode reward: [(0, '68.264')] [2024-08-06 03:08:54,619][52667] DAMAGECOUNT value on done: 377055.0 [2024-08-06 03:08:54,620][52667] Sum rewards: 49.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.074', 'weapon5': '0.144', 'AMMO4': '0.244', 'AMMO3': '0.252', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '3.264', 'DAMAGECOUNT': '13.218', 'FRAGCOUNT': '45.000'} [2024-08-06 03:08:55,097][52795] DAMAGECOUNT value on done: 345060.0 [2024-08-06 03:08:55,101][52795] Sum rewards: 73.236, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.172', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.038', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.212', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '62.000'} [2024-08-06 03:08:55,148][52663] DAMAGECOUNT value on done: 371295.0 [2024-08-06 03:08:55,150][52663] Sum rewards: 56.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.182', 'AMMO4': '0.207', 'weapon4': '0.220', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '2.980', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '49.000'} [2024-08-06 03:08:55,870][52811] DAMAGECOUNT value on done: 354044.0 [2024-08-06 03:08:55,871][52811] Sum rewards: 72.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.548', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.086', 'AMMO4': '0.136', 'AMMO3': '0.190', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '57.500'} [2024-08-06 03:08:55,877][52803] DAMAGECOUNT value on done: 354350.0 [2024-08-06 03:08:55,877][52803] Sum rewards: 72.744, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.092', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'HEALTH': '0.156', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.290', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '57.000'} [2024-08-06 03:08:56,675][52650] Updated weights for policy 0, policy_version 43541 (0.0020) [2024-08-06 03:08:57,375][52667] DAMAGECOUNT value on done: 377562.0 [2024-08-06 03:08:57,376][52667] Sum rewards: 59.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.696', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.174', 'AMMO3': '0.237', 'weapon4': '0.262', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '50.000'} [2024-08-06 03:08:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 356704256. Throughput: 0: 4376.7. Samples: 89184670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:08:57,794][52567] Avg episode reward: [(0, '67.939')] [2024-08-06 03:08:58,156][52795] DAMAGECOUNT value on done: 346650.0 [2024-08-06 03:08:58,161][52795] Sum rewards: 59.136, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.326', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.080', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.390', 'WEAPON3': '0.800', 'HITCOUNT': '2.790', 'weapon3': '3.276', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '48.000'} [2024-08-06 03:08:58,991][52803] DAMAGECOUNT value on done: 355365.0 [2024-08-06 03:08:58,992][52803] Sum rewards: 69.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.825', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.124', 'AMMO4': '0.153', 'weapon5': '0.172', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '57.000'} [2024-08-06 03:08:59,091][52811] DAMAGECOUNT value on done: 351411.0 [2024-08-06 03:08:59,091][52811] Sum rewards: 77.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.148', 'weapon4': '0.160', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '64.000'} [2024-08-06 03:09:00,037][52667] DAMAGECOUNT value on done: 385631.0 [2024-08-06 03:09:00,039][52667] Sum rewards: 64.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.170', 'weapon4': '0.236', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.870', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:00,335][52668] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:09:01,215][52650] Updated weights for policy 0, policy_version 43551 (0.0018) [2024-08-06 03:09:01,344][52795] DAMAGECOUNT value on done: 344261.0 [2024-08-06 03:09:01,345][52795] Sum rewards: 58.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.935', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.104', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.650', 'HITCOUNT': '2.960', 'weapon3': '3.402', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '52.000'} [2024-08-06 03:09:01,961][52803] DAMAGECOUNT value on done: 348716.0 [2024-08-06 03:09:01,964][52803] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.207', 'AMMO4': '0.259', 'weapon2': '0.260', 'weapon5': '0.270', 'weapon4': '0.338', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:02,148][52811] DAMAGECOUNT value on done: 353225.0 [2024-08-06 03:09:02,148][52811] Sum rewards: 64.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.130', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.004', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon4': '0.532', 'weapon2': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.574', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '52.000'} [2024-08-06 03:09:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 356794368. Throughput: 0: 4382.9. Samples: 89197960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:09:02,795][52567] Avg episode reward: [(0, '67.926')] [2024-08-06 03:09:02,992][52667] DAMAGECOUNT value on done: 376096.0 [2024-08-06 03:09:02,993][52667] Sum rewards: 70.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.534', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.172', 'weapon2': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon5': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '57.500'} [2024-08-06 03:09:03,657][52662] DAMAGECOUNT value on done: 385758.0 [2024-08-06 03:09:03,658][52662] Sum rewards: 60.750, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.068', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.210', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.508', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '50.000'} [2024-08-06 03:09:04,493][52795] DAMAGECOUNT value on done: 353101.0 [2024-08-06 03:09:04,494][52795] Sum rewards: 74.424, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.395', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.088', 'AMMO4': '0.123', 'weapon2': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.750', 'weapon3': '3.376', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '65.000'} [2024-08-06 03:09:05,808][52650] Updated weights for policy 0, policy_version 43561 (0.0015) [2024-08-06 03:09:05,909][52667] DAMAGECOUNT value on done: 380588.0 [2024-08-06 03:09:05,910][52667] Sum rewards: 60.140, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.750', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.230', 'weapon2': '0.246', 'weapon4': '0.256', 'AMMO4': '0.285', 'AMMO3': '0.297', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'weapon3': '2.950', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:06,884][52662] DAMAGECOUNT value on done: 384193.0 [2024-08-06 03:09:06,885][52662] Sum rewards: 78.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.695', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.114', 'AMMO3': '0.180', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '63.000'} [2024-08-06 03:09:07,741][52795] DAMAGECOUNT value on done: 341058.0 [2024-08-06 03:09:07,750][52795] Sum rewards: 69.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon5': '0.048', 'AMMO4': '0.048', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 356884480. Throughput: 0: 4385.3. Samples: 89224370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:09:07,794][52567] Avg episode reward: [(0, '67.860')] [2024-08-06 03:09:08,871][52667] DAMAGECOUNT value on done: 380719.0 [2024-08-06 03:09:08,874][52667] Sum rewards: 70.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.137', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:09,573][52665] DAMAGECOUNT value on done: 370788.0 [2024-08-06 03:09:09,573][52665] Sum rewards: 71.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.824', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.078', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.404', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:10,131][52662] DAMAGECOUNT value on done: 384599.0 [2024-08-06 03:09:10,131][52662] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.432', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.270', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:10,533][52650] Updated weights for policy 0, policy_version 43571 (0.0013) [2024-08-06 03:09:10,946][52795] DAMAGECOUNT value on done: 360728.0 [2024-08-06 03:09:10,948][52795] Sum rewards: 66.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.194', 'weapon5': '0.196', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:11,632][52667] DAMAGECOUNT value on done: 374638.0 [2024-08-06 03:09:11,633][52667] Sum rewards: 62.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.888', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.424', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.222', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '51.000'} [2024-08-06 03:09:12,008][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:09:12,497][52665] DAMAGECOUNT value on done: 380444.0 [2024-08-06 03:09:12,498][52665] Sum rewards: 71.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.315', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon4': '0.348', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '61.500'} [2024-08-06 03:09:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 356966400. Throughput: 0: 4382.9. Samples: 89250390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:09:12,794][52567] Avg episode reward: [(0, '68.036')] [2024-08-06 03:09:13,512][52662] DAMAGECOUNT value on done: 372505.0 [2024-08-06 03:09:13,513][52662] Sum rewards: 63.161, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.745', 'AMMO5': '0.005', 'weapon4': '0.014', 'weapon5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.262', 'AMMO3': '0.304', 'WEAPON3': '1.850', 'HITCOUNT': '3.220', 'weapon3': '3.484', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:14,055][52795] DAMAGECOUNT value on done: 351456.0 [2024-08-06 03:09:14,055][52795] Sum rewards: 73.371, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO3': '0.121', 'AMMO4': '0.162', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.410', 'weapon2': '0.626', 'WEAPON3': '0.700', 'weapon3': '2.890', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '56.500'} [2024-08-06 03:09:14,180][52667] DAMAGECOUNT value on done: 382742.0 [2024-08-06 03:09:14,182][52667] Sum rewards: 76.514, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.850', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon4': '0.136', 'weapon5': '0.198', 'weapon2': '0.234', 'AMMO4': '0.287', 'AMMO3': '0.327', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.950', 'weapon3': '3.088', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '68.000'} [2024-08-06 03:09:15,344][52665] DAMAGECOUNT value on done: 377998.0 [2024-08-06 03:09:15,344][52665] Sum rewards: 59.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.144', 'AMMO4': '0.266', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.120', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '47.000'} [2024-08-06 03:09:15,357][52650] Updated weights for policy 0, policy_version 43581 (0.0013) [2024-08-06 03:09:15,815][52668] DAMAGECOUNT value on done: 374463.0 [2024-08-06 03:09:15,817][52668] Sum rewards: 69.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.884', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:16,036][52669] DAMAGECOUNT value on done: 381323.0 [2024-08-06 03:09:16,038][52669] Sum rewards: 61.945, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.092', 'weapon4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:16,334][52820] DAMAGECOUNT value on done: 344631.0 [2024-08-06 03:09:16,334][52820] Sum rewards: 70.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.685', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.078', 'weapon4': '0.162', 'AMMO4': '0.198', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:16,750][52662] DAMAGECOUNT value on done: 383886.0 [2024-08-06 03:09:16,753][52662] Sum rewards: 75.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.011', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.219', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:16,963][52669] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:09:17,126][52795] DAMAGECOUNT value on done: 342190.0 [2024-08-06 03:09:17,130][52795] Sum rewards: 64.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.090', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.232', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:17,505][52667] DAMAGECOUNT value on done: 387995.0 [2024-08-06 03:09:17,506][52667] Sum rewards: 67.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.418', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.124', 'AMMO4': '0.189', 'AMMO3': '0.197', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 357048320. Throughput: 0: 4379.8. Samples: 89263470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:09:17,795][52567] Avg episode reward: [(0, '68.001')] [2024-08-06 03:09:18,283][52665] DAMAGECOUNT value on done: 373583.0 [2024-08-06 03:09:18,284][52665] Sum rewards: 72.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.094', 'weapon2': '0.172', 'AMMO4': '0.197', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:18,391][52668] DAMAGECOUNT value on done: 380476.0 [2024-08-06 03:09:18,393][52668] Sum rewards: 65.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.176', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.186', 'AMMO4': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:19,129][52669] DAMAGECOUNT value on done: 372910.0 [2024-08-06 03:09:19,131][52669] Sum rewards: 72.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.218', 'weapon4': '0.220', 'WEAPON3': '1.100', 'weapon3': '3.288', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:19,258][52794] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.534, 178.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:09:19,563][52820] DAMAGECOUNT value on done: 349988.0 [2024-08-06 03:09:19,567][52820] Sum rewards: 67.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.145', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.096', 'AMMO3': '0.203', 'weapon5': '0.224', 'AMMO4': '0.248', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.136', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:19,819][52662] DAMAGECOUNT value on done: 377733.0 [2024-08-06 03:09:19,821][52662] Sum rewards: 84.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO4': '0.109', 'weapon4': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.739', 'FRAGCOUNT': '70.000'} [2024-08-06 03:09:20,009][52650] Updated weights for policy 0, policy_version 43591 (0.0015) [2024-08-06 03:09:20,204][52667] DAMAGECOUNT value on done: 386996.0 [2024-08-06 03:09:20,204][52667] Sum rewards: 65.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.075', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.304', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '57.000'} [2024-08-06 03:09:20,255][52795] DAMAGECOUNT value on done: 352315.0 [2024-08-06 03:09:20,255][52795] Sum rewards: 70.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.201', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:21,330][52665] DAMAGECOUNT value on done: 366647.0 [2024-08-06 03:09:21,334][52665] Sum rewards: 52.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.135', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '45.000'} [2024-08-06 03:09:21,347][52668] DAMAGECOUNT value on done: 381853.0 [2024-08-06 03:09:21,347][52668] Sum rewards: 60.868, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon2': '0.162', 'AMMO3': '0.167', 'AMMO4': '0.174', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.720', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '48.000'} [2024-08-06 03:09:22,268][52669] DAMAGECOUNT value on done: 383745.0 [2024-08-06 03:09:22,270][52669] Sum rewards: 67.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.091', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:22,563][52662] DAMAGECOUNT value on done: 386170.0 [2024-08-06 03:09:22,564][52662] Sum rewards: 69.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.154', 'weapon5': '0.168', 'AMMO4': '0.202', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:22,654][52667] DAMAGECOUNT value on done: 385180.0 [2024-08-06 03:09:22,656][52667] Sum rewards: 68.055, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.177', 'weapon4': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.020', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:22,771][52820] DAMAGECOUNT value on done: 350495.0 [2024-08-06 03:09:22,772][52820] Sum rewards: 65.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.525', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.206', 'AMMO3': '0.210', 'AMMO4': '0.249', 'weapon4': '0.274', 'weapon2': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '52.500'} [2024-08-06 03:09:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 357146624. Throughput: 0: 4384.9. Samples: 89289780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:09:22,795][52567] Avg episode reward: [(0, '67.897')] [2024-08-06 03:09:23,288][52795] DAMAGECOUNT value on done: 357809.0 [2024-08-06 03:09:23,288][52795] Sum rewards: 72.770, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.680', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.139', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:23,850][52665] DAMAGECOUNT value on done: 368448.0 [2024-08-06 03:09:23,850][52665] Sum rewards: 64.551, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.498', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.268', 'weapon5': '0.268', 'AMMO3': '0.284', 'weapon2': '0.306', 'AMMO4': '0.309', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.818', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:24,455][52650] Updated weights for policy 0, policy_version 43601 (0.0032) [2024-08-06 03:09:24,502][52668] DAMAGECOUNT value on done: 383257.0 [2024-08-06 03:09:24,503][52668] Sum rewards: 64.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO4': '0.172', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon4': '0.344', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:24,700][52669] DAMAGECOUNT value on done: 377556.0 [2024-08-06 03:09:24,700][52669] Sum rewards: 78.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.103', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.112', 'weapon5': '0.142', 'AMMO4': '0.166', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '66.000'} [2024-08-06 03:09:25,388][52664] DAMAGECOUNT value on done: 392498.0 [2024-08-06 03:09:25,389][52664] Sum rewards: 65.060, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.279', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.125', 'AMMO4': '0.182', 'weapon5': '0.218', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON3': '0.800', 'weapon3': '2.636', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '50.500'} [2024-08-06 03:09:25,627][52667] DAMAGECOUNT value on done: 378206.0 [2024-08-06 03:09:25,629][52667] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.110', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '61.000'} [2024-08-06 03:09:25,824][52662] DAMAGECOUNT value on done: 388975.0 [2024-08-06 03:09:25,824][52662] Sum rewards: 82.206, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.610', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.248', 'AMMO3': '0.285', 'WEAPON3': '1.850', 'weapon3': '3.478', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '71.000'} [2024-08-06 03:09:26,030][52820] DAMAGECOUNT value on done: 347160.0 [2024-08-06 03:09:26,030][52820] Sum rewards: 82.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.083', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.174', 'weapon4': '0.174', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '66.000'} [2024-08-06 03:09:26,901][52665] DAMAGECOUNT value on done: 374278.0 [2024-08-06 03:09:26,902][52665] Sum rewards: 56.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.152', 'weapon5': '0.178', 'AMMO4': '0.202', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.010', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '49.000'} [2024-08-06 03:09:27,344][52668] DAMAGECOUNT value on done: 374556.0 [2024-08-06 03:09:27,345][52668] Sum rewards: 58.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.822', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.055', 'weapon5': '0.176', 'weapon4': '0.216', 'AMMO3': '0.265', 'AMMO4': '0.275', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.894', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '51.000'} [2024-08-06 03:09:27,778][52669] DAMAGECOUNT value on done: 379055.0 [2024-08-06 03:09:27,779][52669] Sum rewards: 75.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.258', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.120', 'AMMO4': '0.158', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.650', 'weapon3': '3.256', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '64.000'} [2024-08-06 03:09:27,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 357236736. Throughput: 0: 4380.2. Samples: 89315820. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:09:27,794][52567] Avg episode reward: [(0, '68.062')] [2024-08-06 03:09:27,963][52664] DAMAGECOUNT value on done: 395698.0 [2024-08-06 03:09:27,963][52664] Sum rewards: 62.453, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.156', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.132', 'weapon2': '0.192', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.306', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:28,140][52658] DAMAGECOUNT value on done: 377949.0 [2024-08-06 03:09:28,140][52658] Sum rewards: 64.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.225', 'weapon2': '0.492', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.230', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:28,441][52667] DAMAGECOUNT value on done: 384673.0 [2024-08-06 03:09:28,443][52667] Sum rewards: 67.250, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.255', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon5': '0.092', 'weapon4': '0.116', 'AMMO4': '0.166', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '58.500'} [2024-08-06 03:09:28,855][52662] DAMAGECOUNT value on done: 379552.0 [2024-08-06 03:09:28,859][52662] Sum rewards: 61.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.678', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.276', 'weapon2': '0.370', 'WEAPON3': '1.750', 'weapon3': '3.242', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:28,888][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:09:29,364][52820] DAMAGECOUNT value on done: 350194.0 [2024-08-06 03:09:29,366][52820] Sum rewards: 58.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.092', 'weapon5': '0.116', 'AMMO3': '0.179', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.064', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '50.000'} [2024-08-06 03:09:29,532][52650] Updated weights for policy 0, policy_version 43611 (0.0019) [2024-08-06 03:09:30,082][52669] DAMAGECOUNT value on done: 380680.0 [2024-08-06 03:09:30,082][52669] Sum rewards: 79.806, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.019', 'HEALTH': '0.090', 'weapon5': '0.090', 'AMMO4': '0.096', 'AMMO3': '0.192', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '65.000'} [2024-08-06 03:09:30,297][52665] DAMAGECOUNT value on done: 378694.0 [2024-08-06 03:09:30,299][52665] Sum rewards: 67.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.809', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.170', 'AMMO3': '0.188', 'weapon5': '0.214', 'AMMO4': '0.225', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:30,314][52668] DAMAGECOUNT value on done: 381714.0 [2024-08-06 03:09:30,316][52668] Sum rewards: 75.441, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.050', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.141', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '0.950', 'weapon3': '3.154', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:30,720][52658] DAMAGECOUNT value on done: 380054.0 [2024-08-06 03:09:30,721][52658] Sum rewards: 74.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon2': '0.218', 'AMMO3': '0.229', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.456', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:31,081][52664] DAMAGECOUNT value on done: 398205.0 [2024-08-06 03:09:31,083][52664] Sum rewards: 72.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.142', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '61.000'} [2024-08-06 03:09:32,004][52662] DAMAGECOUNT value on done: 390670.0 [2024-08-06 03:09:32,005][52662] Sum rewards: 62.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.915', 'AMMO5': '0.027', 'AMMO2': '0.063', 'AMMO3': '0.211', 'AMMO4': '0.316', 'weapon5': '0.322', 'weapon2': '0.372', 'weapon4': '0.412', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.530', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '52.000'} [2024-08-06 03:09:32,611][52820] DAMAGECOUNT value on done: 344221.0 [2024-08-06 03:09:32,614][52820] Sum rewards: 63.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.765', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.080', 'weapon2': '0.168', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.326', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:32,768][52663] Large shaping reward 3.651 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:09:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 357318656. Throughput: 0: 4383.1. Samples: 89329110. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:09:32,794][52567] Avg episode reward: [(0, '67.714')] [2024-08-06 03:09:32,908][52665] DAMAGECOUNT value on done: 378790.0 [2024-08-06 03:09:32,909][52665] Sum rewards: 73.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.108', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'weapon2': '0.238', 'AMMO3': '0.245', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '63.000'} [2024-08-06 03:09:32,957][52669] DAMAGECOUNT value on done: 379982.0 [2024-08-06 03:09:32,958][52669] Sum rewards: 69.772, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.938', 'AMMO5': '0.017', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.160', 'AMMO3': '0.161', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.786', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:33,156][52668] DAMAGECOUNT value on done: 381749.0 [2024-08-06 03:09:33,156][52668] Sum rewards: 72.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.140', 'weapon4': '0.186', 'AMMO3': '0.193', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.182', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:33,729][52650] Updated weights for policy 0, policy_version 43621 (0.0021) [2024-08-06 03:09:33,754][52658] DAMAGECOUNT value on done: 385416.0 [2024-08-06 03:09:33,755][52658] Sum rewards: 78.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.216', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.098', 'weapon5': '0.218', 'AMMO4': '0.222', 'AMMO3': '0.257', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '66.000'} [2024-08-06 03:09:34,222][52664] DAMAGECOUNT value on done: 391639.0 [2024-08-06 03:09:34,222][52664] Sum rewards: 59.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.212', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.062', 'AMMO4': '0.167', 'weapon5': '0.170', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.200', 'HITCOUNT': '2.610', 'weapon3': '2.958', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '49.000'} [2024-08-06 03:09:34,860][52662] DAMAGECOUNT value on done: 376775.0 [2024-08-06 03:09:34,861][52662] Sum rewards: 68.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.897', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'weapon4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.434', 'WEAPON3': '1.700', 'weapon3': '3.094', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '61.000'} [2024-08-06 03:09:35,014][52660] DAMAGECOUNT value on done: 376402.0 [2024-08-06 03:09:35,015][52660] Sum rewards: 71.355, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.375', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.215', 'weapon2': '0.384', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.288', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:35,644][52665] DAMAGECOUNT value on done: 375510.0 [2024-08-06 03:09:35,644][52665] Sum rewards: 86.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.158', 'AMMO4': '0.166', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '70.000'} [2024-08-06 03:09:35,717][52668] DAMAGECOUNT value on done: 375992.0 [2024-08-06 03:09:35,719][52668] Sum rewards: 70.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.029', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.156', 'AMMO3': '0.183', 'AMMO4': '0.195', 'weapon5': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '58.500'} [2024-08-06 03:09:35,740][52820] DAMAGECOUNT value on done: 347085.0 [2024-08-06 03:09:35,741][52820] Sum rewards: 69.286, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.275', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.033', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:35,985][52669] DAMAGECOUNT value on done: 380539.0 [2024-08-06 03:09:35,985][52669] Sum rewards: 62.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.168', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.216', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '50.000'} [2024-08-06 03:09:36,809][52658] DAMAGECOUNT value on done: 382564.0 [2024-08-06 03:09:36,809][52658] Sum rewards: 75.413, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:36,813][52664] DAMAGECOUNT value on done: 393851.0 [2024-08-06 03:09:36,813][52664] Sum rewards: 59.731, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.090', 'weapon5': '0.226', 'AMMO4': '0.229', 'AMMO3': '0.232', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.770', 'weapon3': '3.032', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '51.000'} [2024-08-06 03:09:37,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 357400576. Throughput: 0: 4375.8. Samples: 89355280. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:09:37,794][52567] Avg episode reward: [(0, '68.059')] [2024-08-06 03:09:37,873][52662] DAMAGECOUNT value on done: 380792.0 [2024-08-06 03:09:37,873][52662] Sum rewards: 75.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.102', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:37,974][52660] DAMAGECOUNT value on done: 374120.0 [2024-08-06 03:09:37,974][52660] Sum rewards: 80.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.185', 'weapon2': '0.208', 'AMMO4': '0.216', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '65.000'} [2024-08-06 03:09:38,468][52669] DAMAGECOUNT value on done: 382131.0 [2024-08-06 03:09:38,468][52669] Sum rewards: 73.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.756', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.129', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:38,703][52650] Updated weights for policy 0, policy_version 43631 (0.0014) [2024-08-06 03:09:38,735][52665] DAMAGECOUNT value on done: 382264.0 [2024-08-06 03:09:38,737][52665] Sum rewards: 71.176, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.395', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.176', 'weapon4': '0.208', 'AMMO3': '0.242', 'AMMO4': '0.259', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '63.500'} [2024-08-06 03:09:38,791][52668] DAMAGECOUNT value on done: 378633.0 [2024-08-06 03:09:38,794][52668] Sum rewards: 66.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.739', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.136', 'weapon2': '0.170', 'weapon4': '0.206', 'AMMO3': '0.214', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.222', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:38,987][52820] DAMAGECOUNT value on done: 353265.0 [2024-08-06 03:09:38,989][52820] Sum rewards: 58.423, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.888', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.184', 'weapon5': '0.216', 'weapon2': '0.246', 'AMMO3': '0.257', 'AMMO4': '0.257', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.056', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '50.000'} [2024-08-06 03:09:39,060][52649] DAMAGECOUNT value on done: 370806.0 [2024-08-06 03:09:39,061][52649] Sum rewards: 64.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.270', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '57.000'} [2024-08-06 03:09:39,338][52664] DAMAGECOUNT value on done: 392033.0 [2024-08-06 03:09:39,340][52664] Sum rewards: 61.437, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.750', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.099', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.331', 'WEAPON3': '1.950', 'weapon3': '3.214', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '56.500'} [2024-08-06 03:09:39,348][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:09:39,994][52658] DAMAGECOUNT value on done: 375275.0 [2024-08-06 03:09:39,995][52658] Sum rewards: 66.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.216', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon4': '0.170', 'weapon5': '0.174', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '57.000'} [2024-08-06 03:09:40,274][52662] DAMAGECOUNT value on done: 383330.0 [2024-08-06 03:09:40,276][52662] Sum rewards: 65.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.664', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon5': '0.210', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:41,034][52669] DAMAGECOUNT value on done: 378567.0 [2024-08-06 03:09:41,042][52669] Sum rewards: 62.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '52.000'} [2024-08-06 03:09:41,113][52660] DAMAGECOUNT value on done: 385818.0 [2024-08-06 03:09:41,114][52660] Sum rewards: 74.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.862', 'AMMO5': '0.025', 'AMMO2': '0.083', 'AMMO3': '0.196', 'weapon2': '0.340', 'weapon5': '0.358', 'weapon4': '0.408', 'AMMO4': '0.415', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.518', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:41,778][52665] DAMAGECOUNT value on done: 376741.0 [2024-08-06 03:09:41,778][52665] Sum rewards: 65.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:41,926][52668] DAMAGECOUNT value on done: 380949.0 [2024-08-06 03:09:41,927][52668] Sum rewards: 83.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON1': '0.030', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.200', 'WEAPON3': '1.350', 'weapon3': '3.470', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.084', 'FRAGCOUNT': '67.000'} [2024-08-06 03:09:42,054][52664] DAMAGECOUNT value on done: 393373.0 [2024-08-06 03:09:42,055][52664] Sum rewards: 61.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.485', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.162', 'AMMO3': '0.223', 'AMMO4': '0.233', 'weapon4': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:42,086][52820] DAMAGECOUNT value on done: 349287.0 [2024-08-06 03:09:42,086][52820] Sum rewards: 72.968, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.979', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.270', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '63.000'} [2024-08-06 03:09:42,189][52649] DAMAGECOUNT value on done: 364807.0 [2024-08-06 03:09:42,190][52649] Sum rewards: 69.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.090', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '57.000'} [2024-08-06 03:09:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 357498880. Throughput: 0: 4371.3. Samples: 89381380. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:09:42,794][52567] Avg episode reward: [(0, '68.662')] [2024-08-06 03:09:42,928][52662] DAMAGECOUNT value on done: 387100.0 [2024-08-06 03:09:42,929][52662] Sum rewards: 66.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.116', 'AMMO4': '0.198', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:43,049][52658] DAMAGECOUNT value on done: 378444.0 [2024-08-06 03:09:43,049][52658] Sum rewards: 61.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO4': '0.228', 'weapon5': '0.230', 'AMMO3': '0.239', 'weapon4': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:43,195][52650] Updated weights for policy 0, policy_version 43641 (0.0030) [2024-08-06 03:09:43,847][52669] DAMAGECOUNT value on done: 384721.0 [2024-08-06 03:09:43,847][52669] Sum rewards: 58.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.144', 'weapon4': '0.160', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.110', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '51.000'} [2024-08-06 03:09:44,267][52660] DAMAGECOUNT value on done: 386009.0 [2024-08-06 03:09:44,267][52660] Sum rewards: 83.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.945', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.175', 'weapon2': '0.236', 'AMMO4': '0.244', 'weapon5': '0.248', 'weapon4': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '69.000'} [2024-08-06 03:09:44,548][52664] DAMAGECOUNT value on done: 387854.0 [2024-08-06 03:09:44,548][52664] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.487', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon2': '0.184', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:44,738][52665] DAMAGECOUNT value on done: 372666.0 [2024-08-06 03:09:44,739][52665] Sum rewards: 63.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.959', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.206', 'weapon2': '0.248', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:45,083][52668] DAMAGECOUNT value on done: 380741.0 [2024-08-06 03:09:45,083][52668] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.070', 'weapon5': '0.198', 'AMMO4': '0.208', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '2.910', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '51.000'} [2024-08-06 03:09:45,220][52649] DAMAGECOUNT value on done: 370739.0 [2024-08-06 03:09:45,221][52649] Sum rewards: 68.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.478', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.116', 'AMMO4': '0.173', 'weapon5': '0.178', 'AMMO3': '0.236', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '57.000'} [2024-08-06 03:09:45,274][52820] DAMAGECOUNT value on done: 353830.0 [2024-08-06 03:09:45,275][52820] Sum rewards: 69.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.558', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.130', 'AMMO4': '0.144', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '2.918', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:45,726][52662] DAMAGECOUNT value on done: 378950.0 [2024-08-06 03:09:45,726][52662] Sum rewards: 59.480, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.190', 'weapon4': '0.204', 'AMMO4': '0.214', 'weapon5': '0.232', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '2.996', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '48.000'} [2024-08-06 03:09:45,892][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:09:45,998][52658] DAMAGECOUNT value on done: 381559.0 [2024-08-06 03:09:45,999][52658] Sum rewards: 58.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.711', 'AMMO5': '0.025', 'AMMO2': '0.051', 'AMMO3': '0.182', 'AMMO4': '0.255', 'weapon5': '0.270', 'weapon2': '0.426', 'weapon4': '0.498', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '49.000'} [2024-08-06 03:09:46,760][52669] DAMAGECOUNT value on done: 380343.0 [2024-08-06 03:09:46,763][52669] Sum rewards: 76.898, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.555', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.126', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON4': '0.400', 'weapon4': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:47,024][52660] DAMAGECOUNT value on done: 378610.0 [2024-08-06 03:09:47,025][52660] Sum rewards: 79.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.787', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.154', 'AMMO3': '0.156', 'AMMO4': '0.167', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '64.000'} [2024-08-06 03:09:47,213][52664] DAMAGECOUNT value on done: 396488.0 [2024-08-06 03:09:47,215][52664] Sum rewards: 65.868, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.962', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.132', 'weapon5': '0.148', 'AMMO3': '0.163', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.714', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:47,605][52668] DAMAGECOUNT value on done: 374249.0 [2024-08-06 03:09:47,606][52668] Sum rewards: 72.527, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.017', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.086', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.220', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:47,610][52794] DAMAGECOUNT value on done: 382685.0 [2024-08-06 03:09:47,611][52794] Sum rewards: 71.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.066', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 357580800. Throughput: 0: 4371.1. Samples: 89394660. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:09:47,794][52567] Avg episode reward: [(0, '68.830')] [2024-08-06 03:09:47,805][52665] DAMAGECOUNT value on done: 372229.0 [2024-08-06 03:09:47,807][52665] Sum rewards: 64.443, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.019', 'AMMO2': '0.061', 'HEALTH': '0.080', 'weapon4': '0.146', 'AMMO3': '0.151', 'weapon5': '0.196', 'AMMO4': '0.306', 'weapon2': '0.338', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.890', 'weapon3': '3.064', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '52.000'} [2024-08-06 03:09:47,961][52650] Updated weights for policy 0, policy_version 43651 (0.0012) [2024-08-06 03:09:48,339][52649] DAMAGECOUNT value on done: 368586.0 [2024-08-06 03:09:48,341][52649] Sum rewards: 75.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.376', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.090', 'weapon4': '0.106', 'AMMO4': '0.135', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.270', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:48,442][52820] DAMAGECOUNT value on done: 346821.0 [2024-08-06 03:09:48,443][52820] Sum rewards: 63.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.162', 'weapon4': '0.212', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.132', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:48,843][52662] DAMAGECOUNT value on done: 392368.0 [2024-08-06 03:09:48,846][52662] Sum rewards: 68.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.492', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.118', 'weapon4': '0.166', 'AMMO4': '0.173', 'weapon2': '0.240', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.192', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:49,057][52658] DAMAGECOUNT value on done: 374343.0 [2024-08-06 03:09:49,058][52658] Sum rewards: 72.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.412', 'WEAPON3': '1.600', 'weapon3': '3.208', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '61.000'} [2024-08-06 03:09:49,314][52671] DAMAGECOUNT value on done: 383810.0 [2024-08-06 03:09:49,315][52671] Sum rewards: 62.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.192', 'weapon2': '0.216', 'AMMO4': '0.220', 'AMMO3': '0.221', 'weapon5': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.042', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 03:09:49,850][52660] DAMAGECOUNT value on done: 376602.0 [2024-08-06 03:09:49,850][52660] Sum rewards: 72.599, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.100', 'weapon4': '0.162', 'AMMO4': '0.166', 'weapon2': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:49,871][52669] DAMAGECOUNT value on done: 374689.0 [2024-08-06 03:09:49,871][52669] Sum rewards: 46.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.030', 'weapon7': '0.046', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon2': '0.162', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.204', 'weapon4': '0.788', 'WEAPON3': '1.250', 'HITCOUNT': '2.550', 'weapon3': '2.856', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '39.000'} [2024-08-06 03:09:49,886][52664] DAMAGECOUNT value on done: 391586.0 [2024-08-06 03:09:49,886][52664] Sum rewards: 59.025, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.431', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.102', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.292', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.328', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:50,423][52665] DAMAGECOUNT value on done: 376466.0 [2024-08-06 03:09:50,423][52665] Sum rewards: 66.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.045', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.060', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:50,505][52668] DAMAGECOUNT value on done: 371786.0 [2024-08-06 03:09:50,507][52668] Sum rewards: 74.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.655', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.344', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.318', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '65.000'} [2024-08-06 03:09:50,653][52794] DAMAGECOUNT value on done: 385035.0 [2024-08-06 03:09:50,655][52794] Sum rewards: 61.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.154', 'weapon5': '0.200', 'AMMO3': '0.234', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.596', 'WEAPON3': '1.450', 'weapon3': '2.806', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '52.000'} [2024-08-06 03:09:50,845][52649] DAMAGECOUNT value on done: 359896.0 [2024-08-06 03:09:50,847][52649] Sum rewards: 61.581, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.214', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.120', 'weapon4': '0.204', 'AMMO3': '0.252', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:51,459][52820] DAMAGECOUNT value on done: 351346.0 [2024-08-06 03:09:51,459][52820] Sum rewards: 65.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.375', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.088', 'weapon4': '0.092', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '57.000'} [2024-08-06 03:09:51,777][52662] DAMAGECOUNT value on done: 384518.0 [2024-08-06 03:09:51,786][52662] Sum rewards: 73.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.182', 'AMMO3': '0.260', 'AMMO4': '0.298', 'weapon5': '0.390', 'weapon2': '0.490', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.554', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:51,949][52658] DAMAGECOUNT value on done: 387516.0 [2024-08-06 03:09:51,952][52658] Sum rewards: 63.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.260', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.308', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:52,165][52671] DAMAGECOUNT value on done: 381377.0 [2024-08-06 03:09:52,165][52671] Sum rewards: 76.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.488', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '65.000'} [2024-08-06 03:09:52,788][52650] Updated weights for policy 0, policy_version 43661 (0.0024) [2024-08-06 03:09:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 357670912. Throughput: 0: 4367.3. Samples: 89420900. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:09:52,795][52567] Avg episode reward: [(0, '68.375')] [2024-08-06 03:09:52,800][52665] DAMAGECOUNT value on done: 374899.0 [2024-08-06 03:09:52,800][52665] Sum rewards: 75.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.054', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.180', 'AMMO4': '0.197', 'AMMO3': '0.225', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '63.000'} [2024-08-06 03:09:52,905][52669] DAMAGECOUNT value on done: 382860.0 [2024-08-06 03:09:52,906][52669] Sum rewards: 64.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.154', 'AMMO3': '0.189', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.098', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:52,956][52660] DAMAGECOUNT value on done: 380452.0 [2024-08-06 03:09:52,957][52660] Sum rewards: 70.779, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.004', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:53,138][52664] DAMAGECOUNT value on done: 397886.0 [2024-08-06 03:09:53,139][52664] Sum rewards: 70.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.306', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '59.500'} [2024-08-06 03:09:53,246][52649] DAMAGECOUNT value on done: 371486.0 [2024-08-06 03:09:53,247][52649] Sum rewards: 80.380, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon2': '0.182', 'AMMO3': '0.283', 'WEAPON3': '1.650', 'weapon3': '3.538', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '69.000'} [2024-08-06 03:09:53,547][52668] DAMAGECOUNT value on done: 373331.0 [2024-08-06 03:09:53,549][52668] Sum rewards: 83.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.767', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.160', 'AMMO4': '0.164', 'weapon2': '0.224', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.924', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '70.000'} [2024-08-06 03:09:53,566][52794] DAMAGECOUNT value on done: 381595.0 [2024-08-06 03:09:53,567][52794] Sum rewards: 72.591, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.477', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.040', 'AMMO4': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.330', 'WEAPON3': '1.100', 'HITCOUNT': '3.350', 'weapon3': '3.370', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:54,549][52820] DAMAGECOUNT value on done: 355797.0 [2024-08-06 03:09:54,549][52820] Sum rewards: 70.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:54,710][52658] DAMAGECOUNT value on done: 380408.0 [2024-08-06 03:09:54,712][52658] Sum rewards: 64.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.356', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.114', 'AMMO4': '0.221', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.304', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '54.000'} [2024-08-06 03:09:54,803][52662] DAMAGECOUNT value on done: 383756.0 [2024-08-06 03:09:54,804][52662] Sum rewards: 74.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.223', 'weapon4': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '62.000'} [2024-08-06 03:09:54,905][52671] DAMAGECOUNT value on done: 382115.0 [2024-08-06 03:09:54,906][52671] Sum rewards: 70.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.770', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.144', 'AMMO4': '0.160', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.214', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '60.500'} [2024-08-06 03:09:55,665][52669] DAMAGECOUNT value on done: 387446.0 [2024-08-06 03:09:55,667][52669] Sum rewards: 59.216, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.765', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.286', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:55,829][52660] DAMAGECOUNT value on done: 386131.0 [2024-08-06 03:09:55,830][52660] Sum rewards: 68.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.543', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.048', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.218', 'weapon2': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.330', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '57.000'} [2024-08-06 03:09:55,909][52664] DAMAGECOUNT value on done: 394751.0 [2024-08-06 03:09:55,912][52664] Sum rewards: 73.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.213', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.174', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'weapon4': '0.346', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:55,938][52665] DAMAGECOUNT value on done: 371622.0 [2024-08-06 03:09:55,939][52665] Sum rewards: 67.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.048', 'weapon4': '0.076', 'AMMO4': '0.162', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'ARMOR': '0.452', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.450', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '56.000'} [2024-08-06 03:09:56,302][52794] DAMAGECOUNT value on done: 378308.0 [2024-08-06 03:09:56,304][52794] Sum rewards: 72.079, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.589', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.195', 'weapon5': '0.220', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.628', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:56,395][52668] DAMAGECOUNT value on done: 372272.0 [2024-08-06 03:09:56,395][52668] Sum rewards: 81.917, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.158', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.138', 'weapon2': '0.424', 'WEAPON3': '0.900', 'weapon3': '3.270', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '64.000'} [2024-08-06 03:09:56,732][52649] DAMAGECOUNT value on done: 365397.0 [2024-08-06 03:09:56,735][52649] Sum rewards: 65.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.082', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.638', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '55.000'} [2024-08-06 03:09:57,018][52650] Updated weights for policy 0, policy_version 43671 (0.0010) [2024-08-06 03:09:57,390][52658] DAMAGECOUNT value on done: 390128.0 [2024-08-06 03:09:57,390][52658] Sum rewards: 71.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon2': '0.176', 'weapon4': '0.196', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '60.000'} [2024-08-06 03:09:57,536][52662] DAMAGECOUNT value on done: 377940.0 [2024-08-06 03:09:57,537][52662] Sum rewards: 64.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.830', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.198', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '53.000'} [2024-08-06 03:09:57,651][52820] DAMAGECOUNT value on done: 352166.0 [2024-08-06 03:09:57,652][52820] Sum rewards: 76.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.074', 'AMMO4': '0.140', 'weapon5': '0.168', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '66.000'} [2024-08-06 03:09:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 357752832. Throughput: 0: 4382.2. Samples: 89447590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:09:57,794][52567] Avg episode reward: [(0, '68.842')] [2024-08-06 03:09:57,958][52671] DAMAGECOUNT value on done: 381341.0 [2024-08-06 03:09:57,959][52671] Sum rewards: 61.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.354', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.150', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '52.000'} [2024-08-06 03:09:58,428][52664] DAMAGECOUNT value on done: 402557.0 [2024-08-06 03:09:58,430][52664] Sum rewards: 68.411, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.784', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon2': '0.178', 'AMMO3': '0.241', 'AMMO4': '0.248', 'weapon5': '0.252', 'weapon4': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:58,715][52660] DAMAGECOUNT value on done: 384479.0 [2024-08-06 03:09:58,719][52669] DAMAGECOUNT value on done: 394929.0 [2024-08-06 03:09:58,718][52660] Sum rewards: 74.407, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.541', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.153', 'weapon5': '0.178', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '64.000'} [2024-08-06 03:09:58,721][52669] Sum rewards: 64.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.076', 'AMMO4': '0.138', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.696', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '55.500'} [2024-08-06 03:09:59,204][52665] DAMAGECOUNT value on done: 371067.0 [2024-08-06 03:09:59,205][52665] Sum rewards: 67.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.150', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '2.998', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:59,372][52668] DAMAGECOUNT value on done: 375786.0 [2024-08-06 03:09:59,372][52668] Sum rewards: 73.126, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.037', 'HEALTH': '0.128', 'weapon5': '0.152', 'AMMO3': '0.158', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.410', 'weapon4': '0.432', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '58.000'} [2024-08-06 03:09:59,390][52794] DAMAGECOUNT value on done: 377990.0 [2024-08-06 03:09:59,390][52794] Sum rewards: 70.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.080', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.192', 'AMMO4': '0.215', 'AMMO3': '0.229', 'weapon4': '0.346', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '59.000'} [2024-08-06 03:09:59,683][52649] DAMAGECOUNT value on done: 374499.0 [2024-08-06 03:09:59,683][52649] Sum rewards: 65.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.877', 'AMMO5': '0.030', 'AMMO2': '0.067', 'weapon4': '0.142', 'AMMO3': '0.188', 'weapon5': '0.292', 'AMMO4': '0.333', 'weapon2': '0.454', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:00,037][52658] DAMAGECOUNT value on done: 373340.0 [2024-08-06 03:10:00,038][52658] Sum rewards: 56.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.176', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.124', 'weapon4': '0.132', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon2': '0.952', 'weapon3': '2.586', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '44.500'} [2024-08-06 03:10:00,651][52662] DAMAGECOUNT value on done: 375598.0 [2024-08-06 03:10:00,651][52662] Sum rewards: 71.347, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.146', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '58.000'} [2024-08-06 03:10:00,804][52820] DAMAGECOUNT value on done: 356499.0 [2024-08-06 03:10:00,804][52820] Sum rewards: 78.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.885', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.106', 'AMMO4': '0.122', 'weapon2': '0.172', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.650', 'weapon3': '3.408', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '68.000'} [2024-08-06 03:10:01,127][52671] DAMAGECOUNT value on done: 387385.0 [2024-08-06 03:10:01,129][52671] Sum rewards: 60.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.018', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.098', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.188', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '49.000'} [2024-08-06 03:10:01,161][52664] DAMAGECOUNT value on done: 396367.0 [2024-08-06 03:10:01,162][52664] Sum rewards: 66.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.075', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.178', 'weapon2': '0.288', 'weapon5': '0.306', 'AMMO4': '0.319', 'weapon4': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.822', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:01,313][52660] DAMAGECOUNT value on done: 377883.0 [2024-08-06 03:10:01,314][52660] Sum rewards: 58.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.228', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.220', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.530', 'weapon3': '3.084', 'DAMAGECOUNT': '13.554', 'FRAGCOUNT': '52.000'} [2024-08-06 03:10:01,669][52669] DAMAGECOUNT value on done: 382613.0 [2024-08-06 03:10:01,670][52669] Sum rewards: 80.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.064', 'AMMO4': '0.090', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '64.000'} [2024-08-06 03:10:01,966][52650] Updated weights for policy 0, policy_version 43681 (0.0041) [2024-08-06 03:10:02,013][52668] DAMAGECOUNT value on done: 381316.0 [2024-08-06 03:10:02,015][52668] Sum rewards: 64.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.322', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.100', 'AMMO4': '0.227', 'weapon2': '0.266', 'AMMO3': '0.268', 'weapon5': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.640', 'weapon3': '2.898', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:02,136][52665] DAMAGECOUNT value on done: 375219.0 [2024-08-06 03:10:02,136][52665] Sum rewards: 72.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.116', 'AMMO3': '0.208', 'AMMO4': '0.246', 'weapon5': '0.250', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '60.000'} [2024-08-06 03:10:02,359][52794] DAMAGECOUNT value on done: 381962.0 [2024-08-06 03:10:02,359][52794] Sum rewards: 68.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.186', 'AMMO3': '0.192', 'weapon2': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:02,705][52649] DAMAGECOUNT value on done: 373223.0 [2024-08-06 03:10:02,706][52649] Sum rewards: 74.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.178', 'AMMO3': '0.195', 'weapon2': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '61.000'} [2024-08-06 03:10:02,753][52658] DAMAGECOUNT value on done: 382020.0 [2024-08-06 03:10:02,753][52658] Sum rewards: 67.837, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.085', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.440', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:02,797][52567] Fps is (10 sec: 17197.6, 60 sec: 17475.3, 300 sec: 17522.3). Total num frames: 357842944. Throughput: 0: 4379.7. Samples: 89460570. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:10:02,798][52567] Avg episode reward: [(0, '68.835')] [2024-08-06 03:10:04,047][52820] DAMAGECOUNT value on done: 351350.0 [2024-08-06 03:10:04,051][52820] Sum rewards: 69.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.019', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.064', 'weapon5': '0.152', 'AMMO3': '0.240', 'AMMO4': '0.244', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '58.000'} [2024-08-06 03:10:04,080][52671] DAMAGECOUNT value on done: 378608.0 [2024-08-06 03:10:04,080][52671] Sum rewards: 58.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.082', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.548', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.078', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '50.000'} [2024-08-06 03:10:04,241][52660] DAMAGECOUNT value on done: 387461.0 [2024-08-06 03:10:04,242][52660] Sum rewards: 72.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.765', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.130', 'AMMO3': '0.203', 'AMMO4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '61.000'} [2024-08-06 03:10:04,251][52664] DAMAGECOUNT value on done: 400676.0 [2024-08-06 03:10:04,252][52664] Sum rewards: 81.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.644', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '68.000'} [2024-08-06 03:10:04,724][52669] DAMAGECOUNT value on done: 384598.0 [2024-08-06 03:10:04,724][52669] Sum rewards: 72.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.986', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.174', 'AMMO3': '0.192', 'weapon2': '0.312', 'AMMO4': '0.313', 'weapon4': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.834', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '58.000'} [2024-08-06 03:10:04,777][52668] DAMAGECOUNT value on done: 380312.0 [2024-08-06 03:10:04,782][52668] Sum rewards: 53.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.426', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon4': '0.076', 'AMMO3': '0.249', 'weapon2': '0.424', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.326', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.000'} [2024-08-06 03:10:05,053][52665] DAMAGECOUNT value on done: 377214.0 [2024-08-06 03:10:05,054][52665] Sum rewards: 72.724, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.106', 'HEALTH': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon2': '0.458', 'WEAPON3': '0.900', 'weapon3': '3.228', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:05,327][52658] DAMAGECOUNT value on done: 377843.0 [2024-08-06 03:10:05,327][52658] Sum rewards: 80.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.684', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.104', 'weapon5': '0.110', 'AMMO4': '0.134', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.354', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '68.000'} [2024-08-06 03:10:05,543][52794] DAMAGECOUNT value on done: 386325.0 [2024-08-06 03:10:05,544][52794] Sum rewards: 76.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.070', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '65.000'} [2024-08-06 03:10:05,631][52649] DAMAGECOUNT value on done: 367122.0 [2024-08-06 03:10:05,632][52649] Sum rewards: 65.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.689', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.350', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:06,768][52650] Updated weights for policy 0, policy_version 43691 (0.0031) [2024-08-06 03:10:06,935][52671] DAMAGECOUNT value on done: 387914.0 [2024-08-06 03:10:06,937][52671] Sum rewards: 84.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.245', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.251', 'weapon2': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.444', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '72.000'} [2024-08-06 03:10:07,241][52820] DAMAGECOUNT value on done: 349558.0 [2024-08-06 03:10:07,242][52820] Sum rewards: 56.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.922', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.058', 'weapon7': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.142', 'AMMO3': '0.179', 'weapon2': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'ARMOR': '0.476', 'weapon4': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '45.500'} [2024-08-06 03:10:07,321][52660] DAMAGECOUNT value on done: 373777.0 [2024-08-06 03:10:07,321][52660] Sum rewards: 83.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.491', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '67.000'} [2024-08-06 03:10:07,366][52664] DAMAGECOUNT value on done: 391494.0 [2024-08-06 03:10:07,367][52664] Sum rewards: 84.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.600', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'weapon4': '0.176', 'AMMO3': '0.222', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '4.330', 'DAMAGECOUNT': '20.754', 'FRAGCOUNT': '68.000'} [2024-08-06 03:10:07,665][52669] DAMAGECOUNT value on done: 384177.0 [2024-08-06 03:10:07,665][52669] Sum rewards: 67.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.158', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.121', 'AMMO3': '0.176', 'weapon2': '0.238', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.256', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 357924864. Throughput: 0: 4378.9. Samples: 89486830. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:10:07,794][52567] Avg episode reward: [(0, '69.022')] [2024-08-06 03:10:07,813][52647] DAMAGECOUNT value on done: 401715.0 [2024-08-06 03:10:07,813][52647] Sum rewards: 79.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.276', 'weapon2': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.504', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '68.000'} [2024-08-06 03:10:07,953][52668] DAMAGECOUNT value on done: 381801.0 [2024-08-06 03:10:07,955][52668] Sum rewards: 70.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon4': '0.018', 'WEAPON4': '0.100', 'weapon5': '0.136', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.874', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 03:10:08,066][52658] DAMAGECOUNT value on done: 377791.0 [2024-08-06 03:10:08,066][52658] Sum rewards: 69.400, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.400', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.102', 'weapon5': '0.152', 'AMMO4': '0.169', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '61.000'} [2024-08-06 03:10:08,718][52649] DAMAGECOUNT value on done: 373294.0 [2024-08-06 03:10:08,718][52649] Sum rewards: 67.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.558', 'AMMO5': '0.019', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.189', 'weapon5': '0.214', 'weapon2': '0.286', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '55.500'} [2024-08-06 03:10:08,732][52794] DAMAGECOUNT value on done: 377307.0 [2024-08-06 03:10:08,732][52794] Sum rewards: 70.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.200', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.130', 'AMMO4': '0.183', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 03:10:09,364][52671] DAMAGECOUNT value on done: 383349.0 [2024-08-06 03:10:09,365][52671] Sum rewards: 84.042, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.904', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.100', 'AMMO4': '0.211', 'weapon4': '0.212', 'AMMO3': '0.257', 'weapon2': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.160', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '72.000'} [2024-08-06 03:10:10,258][52664] DAMAGECOUNT value on done: 392677.0 [2024-08-06 03:10:10,259][52664] Sum rewards: 70.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.435', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.086', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '59.000'} [2024-08-06 03:10:10,378][52660] DAMAGECOUNT value on done: 373801.0 [2024-08-06 03:10:10,381][52660] Sum rewards: 65.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.108', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon2': '0.224', 'weapon5': '0.228', 'AMMO4': '0.256', 'AMMO3': '0.264', 'WEAPON5': '0.400', 'weapon4': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.616', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:10,392][52669] DAMAGECOUNT value on done: 387191.0 [2024-08-06 03:10:10,393][52669] Sum rewards: 73.345, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.080', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon5': '0.170', 'weapon4': '0.204', 'AMMO3': '0.238', 'AMMO4': '0.340', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.022', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '63.000'} [2024-08-06 03:10:10,438][52820] DAMAGECOUNT value on done: 359505.0 [2024-08-06 03:10:10,438][52820] Sum rewards: 88.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.428', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon2': '0.174', 'AMMO3': '0.188', 'weapon4': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '71.000'} [2024-08-06 03:10:10,715][52658] DAMAGECOUNT value on done: 374062.0 [2024-08-06 03:10:10,716][52658] Sum rewards: 64.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.410', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '56.000'} [2024-08-06 03:10:10,855][52647] DAMAGECOUNT value on done: 399375.0 [2024-08-06 03:10:10,856][52647] Sum rewards: 67.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.604', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.159', 'AMMO3': '0.194', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.054', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:10,988][52668] DAMAGECOUNT value on done: 375815.0 [2024-08-06 03:10:10,989][52668] Sum rewards: 63.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.882', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.204', 'weapon4': '0.218', 'AMMO4': '0.226', 'weapon5': '0.238', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:11,224][52650] Updated weights for policy 0, policy_version 43701 (0.0019) [2024-08-06 03:10:11,703][52649] DAMAGECOUNT value on done: 374576.0 [2024-08-06 03:10:11,704][52649] Sum rewards: 64.316, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'weapon4': '0.140', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.314', 'weapon2': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.594', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '50.500'} [2024-08-06 03:10:11,757][52794] DAMAGECOUNT value on done: 386241.0 [2024-08-06 03:10:11,758][52794] Sum rewards: 70.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.106', 'AMMO4': '0.139', 'weapon5': '0.160', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:11,880][52671] DAMAGECOUNT value on done: 378711.0 [2024-08-06 03:10:11,881][52671] Sum rewards: 85.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.919', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.142', 'weapon4': '0.166', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '70.000'} [2024-08-06 03:10:12,794][52567] Fps is (10 sec: 18028.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 358023168. Throughput: 0: 4380.7. Samples: 89512950. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:10:12,794][52567] Avg episode reward: [(0, '69.723')] [2024-08-06 03:10:13,051][52664] DAMAGECOUNT value on done: 394189.0 [2024-08-06 03:10:13,051][52664] Sum rewards: 76.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.422', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.205', 'weapon2': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.428', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '65.000'} [2024-08-06 03:10:13,534][52647] DAMAGECOUNT value on done: 401043.0 [2024-08-06 03:10:13,534][52647] Sum rewards: 70.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.700', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.118', 'AMMO4': '0.224', 'AMMO3': '0.236', 'weapon2': '0.270', 'weapon5': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2024-08-06 03:10:13,536][52660] DAMAGECOUNT value on done: 387735.0 [2024-08-06 03:10:13,536][52660] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.552', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.153', 'AMMO3': '0.192', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 03:10:13,551][52820] DAMAGECOUNT value on done: 361243.0 [2024-08-06 03:10:13,552][52820] Sum rewards: 88.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.086', 'AMMO5': '0.004', 'weapon4': '0.024', 'AMMO2': '0.037', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.187', 'AMMO3': '0.242', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.096', 'FRAGCOUNT': '73.000'} [2024-08-06 03:10:13,680][52658] DAMAGECOUNT value on done: 386306.0 [2024-08-06 03:10:13,681][52658] Sum rewards: 56.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.015', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.126', 'weapon2': '0.188', 'AMMO4': '0.232', 'weapon4': '0.244', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.184', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '49.000'} [2024-08-06 03:10:14,333][52649] DAMAGECOUNT value on done: 375238.0 [2024-08-06 03:10:14,333][52649] Sum rewards: 73.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.510', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.155', 'AMMO4': '0.178', 'weapon5': '0.180', 'weapon4': '0.228', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.162', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '59.000'} [2024-08-06 03:10:14,873][52671] DAMAGECOUNT value on done: 386468.0 [2024-08-06 03:10:14,874][52671] Sum rewards: 73.852, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.912', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.076', 'weapon5': '0.136', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '64.000'} [2024-08-06 03:10:14,881][52794] DAMAGECOUNT value on done: 382116.0 [2024-08-06 03:10:14,884][52794] Sum rewards: 66.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.866', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.186', 'AMMO4': '0.209', 'AMMO3': '0.220', 'weapon4': '0.228', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:16,078][52650] Updated weights for policy 0, policy_version 43711 (0.0033) [2024-08-06 03:10:16,178][52664] DAMAGECOUNT value on done: 392286.0 [2024-08-06 03:10:16,179][52664] Sum rewards: 65.151, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.088', 'weapon5': '0.118', 'AMMO4': '0.169', 'weapon2': '0.210', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:16,441][52660] DAMAGECOUNT value on done: 389407.0 [2024-08-06 03:10:16,441][52660] Sum rewards: 71.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.104', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '60.000'} [2024-08-06 03:10:16,602][52647] DAMAGECOUNT value on done: 406246.0 [2024-08-06 03:10:16,604][52647] Sum rewards: 77.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.263', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.104', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.050', 'weapon3': '3.204', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '61.000'} [2024-08-06 03:10:16,634][52820] DAMAGECOUNT value on done: 350068.0 [2024-08-06 03:10:16,637][52820] Sum rewards: 66.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.677', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.174', 'AMMO3': '0.192', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.408', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.636', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:16,799][52649] DAMAGECOUNT value on done: 374468.0 [2024-08-06 03:10:16,799][52649] Sum rewards: 63.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.182', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.172', 'AMMO3': '0.215', 'AMMO4': '0.242', 'weapon4': '0.320', 'weapon2': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:16,918][52658] DAMAGECOUNT value on done: 378313.0 [2024-08-06 03:10:16,920][52658] Sum rewards: 72.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.139', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.132', 'weapon2': '0.384', 'WEAPON3': '0.950', 'weapon3': '3.410', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:17,669][52671] DAMAGECOUNT value on done: 389289.0 [2024-08-06 03:10:17,670][52671] Sum rewards: 81.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.772', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '67.000'} [2024-08-06 03:10:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 358105088. Throughput: 0: 4382.7. Samples: 89526330. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:10:17,794][52567] Avg episode reward: [(0, '70.340')] [2024-08-06 03:10:17,884][52614] Saving new best policy, reward=70.340! [2024-08-06 03:10:18,010][52794] DAMAGECOUNT value on done: 377829.0 [2024-08-06 03:10:18,015][52794] Sum rewards: 58.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.110', 'AMMO4': '0.115', 'weapon2': '0.190', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '3.430', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '49.000'} [2024-08-06 03:10:18,965][52664] DAMAGECOUNT value on done: 392912.0 [2024-08-06 03:10:18,966][52664] Sum rewards: 69.444, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.110', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.072', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '58.000'} [2024-08-06 03:10:19,107][52660] DAMAGECOUNT value on done: 375592.0 [2024-08-06 03:10:19,109][52660] Sum rewards: 60.292, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.035', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO4': '0.194', 'weapon4': '0.208', 'weapon2': '0.288', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.000', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '56.000'} [2024-08-06 03:10:19,284][52647] DAMAGECOUNT value on done: 402375.0 [2024-08-06 03:10:19,284][52647] Sum rewards: 77.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.057', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '66.000'} [2024-08-06 03:10:20,031][52658] DAMAGECOUNT value on done: 382165.0 [2024-08-06 03:10:20,033][52658] Sum rewards: 73.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.116', 'weapon5': '0.180', 'AMMO4': '0.190', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 03:10:20,044][52649] DAMAGECOUNT value on done: 365995.0 [2024-08-06 03:10:20,046][52649] Sum rewards: 83.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.121', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.142', 'AMMO3': '0.185', 'weapon4': '0.222', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '66.000'} [2024-08-06 03:10:20,717][52650] Updated weights for policy 0, policy_version 43721 (0.0012) [2024-08-06 03:10:20,748][52671] DAMAGECOUNT value on done: 379113.0 [2024-08-06 03:10:20,749][52671] Sum rewards: 66.923, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.870', 'AMMO2': '0.013', 'AMMO5': '0.016', 'AMMO4': '0.064', 'weapon4': '0.082', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON3': '0.850', 'weapon3': '2.888', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '53.000'} [2024-08-06 03:10:20,916][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:10:21,369][52794] DAMAGECOUNT value on done: 384149.0 [2024-08-06 03:10:21,372][52794] Sum rewards: 70.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.228', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.100', 'weapon4': '0.136', 'AMMO4': '0.197', 'weapon2': '0.232', 'AMMO3': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '61.000'} [2024-08-06 03:10:21,817][52647] DAMAGECOUNT value on done: 402142.0 [2024-08-06 03:10:21,818][52647] Sum rewards: 72.234, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.016', 'HEALTH': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.173', 'weapon2': '0.270', 'WEAPON3': '1.000', 'HITCOUNT': '3.260', 'weapon3': '3.416', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:22,035][52660] DAMAGECOUNT value on done: 379478.0 [2024-08-06 03:10:22,036][52660] Sum rewards: 62.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.592', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.744', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '52.000'} [2024-08-06 03:10:22,724][52658] DAMAGECOUNT value on done: 384523.0 [2024-08-06 03:10:22,724][52658] Sum rewards: 79.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.160', 'AMMO3': '0.197', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '64.000'} [2024-08-06 03:10:22,795][52567] Fps is (10 sec: 17201.0, 60 sec: 17475.9, 300 sec: 17550.2). Total num frames: 358195200. Throughput: 0: 4383.4. Samples: 89552540. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:10:22,796][52567] Avg episode reward: [(0, '70.920')] [2024-08-06 03:10:22,796][52614] Saving new best policy, reward=70.920! [2024-08-06 03:10:23,086][52649] DAMAGECOUNT value on done: 372665.0 [2024-08-06 03:10:23,087][52649] Sum rewards: 63.458, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.042', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.136', 'weapon4': '0.150', 'AMMO3': '0.245', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '56.000'} [2024-08-06 03:10:23,513][52671] DAMAGECOUNT value on done: 392191.0 [2024-08-06 03:10:23,513][52671] Sum rewards: 72.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.428', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '62.000'} [2024-08-06 03:10:24,362][52647] DAMAGECOUNT value on done: 402332.0 [2024-08-06 03:10:24,363][52647] Sum rewards: 71.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.732', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.126', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '60.000'} [2024-08-06 03:10:24,500][52794] DAMAGECOUNT value on done: 373894.0 [2024-08-06 03:10:24,500][52794] Sum rewards: 69.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.180', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '57.500'} [2024-08-06 03:10:25,009][52660] DAMAGECOUNT value on done: 373504.0 [2024-08-06 03:10:25,011][52660] Sum rewards: 48.188, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.060', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.285', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.580', 'weapon3': '3.198', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '44.000'} [2024-08-06 03:10:25,483][52650] Updated weights for policy 0, policy_version 43731 (0.0012) [2024-08-06 03:10:25,950][52649] DAMAGECOUNT value on done: 368737.0 [2024-08-06 03:10:25,952][52649] Sum rewards: 82.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.248', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.142', 'weapon4': '0.156', 'AMMO4': '0.199', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '68.000'} [2024-08-06 03:10:26,368][52671] DAMAGECOUNT value on done: 380226.0 [2024-08-06 03:10:26,368][52671] Sum rewards: 57.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.138', 'AMMO3': '0.216', 'weapon5': '0.238', 'AMMO4': '0.241', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '48.500'} [2024-08-06 03:10:26,861][52794] DAMAGECOUNT value on done: 391359.0 [2024-08-06 03:10:26,864][52794] Sum rewards: 74.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.052', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '64.000'} [2024-08-06 03:10:27,421][52647] DAMAGECOUNT value on done: 396827.0 [2024-08-06 03:10:27,421][52647] Sum rewards: 72.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.328', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.136', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '61.000'} [2024-08-06 03:10:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17523.3). Total num frames: 358285312. Throughput: 0: 4384.2. Samples: 89578670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:10:27,794][52567] Avg episode reward: [(0, '70.463')] [2024-08-06 03:10:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043736_358285312.pth... [2024-08-06 03:10:27,903][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043222_354074624.pth [2024-08-06 03:10:28,232][52660] DAMAGECOUNT value on done: 382460.0 [2024-08-06 03:10:28,233][52660] Sum rewards: 66.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.242', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon4': '0.420', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.742', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:28,978][52649] DAMAGECOUNT value on done: 375785.0 [2024-08-06 03:10:28,979][52649] Sum rewards: 80.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.110', 'AMMO3': '0.197', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '66.000'} [2024-08-06 03:10:29,435][52671] DAMAGECOUNT value on done: 372911.0 [2024-08-06 03:10:29,436][52671] Sum rewards: 64.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.468', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.092', 'AMMO4': '0.178', 'weapon5': '0.182', 'weapon2': '0.218', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.190', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '56.000'} [2024-08-06 03:10:29,598][52794] DAMAGECOUNT value on done: 374156.0 [2024-08-06 03:10:29,600][52794] Sum rewards: 69.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon5': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '59.000'} [2024-08-06 03:10:30,149][52650] Updated weights for policy 0, policy_version 43741 (0.0011) [2024-08-06 03:10:30,268][52647] DAMAGECOUNT value on done: 407057.0 [2024-08-06 03:10:30,271][52647] Sum rewards: 63.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'AMMO3': '0.137', 'AMMO4': '0.148', 'weapon4': '0.194', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.826', 'WEAPON3': '0.950', 'weapon3': '2.548', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.000'} [2024-08-06 03:10:30,687][52660] DAMAGECOUNT value on done: 375954.0 [2024-08-06 03:10:30,687][52660] Sum rewards: 75.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '62.000'} [2024-08-06 03:10:30,911][52794] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:10:30,936][52660] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:10:32,025][52649] DAMAGECOUNT value on done: 377410.0 [2024-08-06 03:10:32,027][52649] Sum rewards: 60.376, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.300', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon2': '0.420', 'WEAPON3': '1.700', 'weapon3': '3.152', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:32,118][52794] DAMAGECOUNT value on done: 390503.0 [2024-08-06 03:10:32,118][52794] Sum rewards: 76.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.324', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '66.000'} [2024-08-06 03:10:32,506][52671] DAMAGECOUNT value on done: 388040.0 [2024-08-06 03:10:32,507][52671] Sum rewards: 65.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.051', 'AMMO3': '0.175', 'weapon5': '0.202', 'AMMO4': '0.256', 'weapon2': '0.338', 'weapon4': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '54.500'} [2024-08-06 03:10:32,707][52647] DAMAGECOUNT value on done: 398363.0 [2024-08-06 03:10:32,707][52647] Sum rewards: 71.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.455', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO3': '0.184', 'AMMO4': '0.188', 'weapon5': '0.264', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.624', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '57.500'} [2024-08-06 03:10:32,794][52567] Fps is (10 sec: 17205.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 358367232. Throughput: 0: 4381.3. Samples: 89591820. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:10:32,795][52567] Avg episode reward: [(0, '70.381')] [2024-08-06 03:10:34,718][52650] Updated weights for policy 0, policy_version 43751 (0.0047) [2024-08-06 03:10:34,921][52794] DAMAGECOUNT value on done: 383068.0 [2024-08-06 03:10:34,923][52794] Sum rewards: 68.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.158', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.134', 'AMMO3': '0.181', 'weapon5': '0.226', 'AMMO4': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.856', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:35,300][52649] DAMAGECOUNT value on done: 375018.0 [2024-08-06 03:10:35,303][52649] Sum rewards: 61.793, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon4': '0.226', 'AMMO3': '0.257', 'weapon2': '0.516', 'WEAPON3': '1.600', 'weapon3': '2.836', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '56.000'} [2024-08-06 03:10:35,419][52647] DAMAGECOUNT value on done: 404006.0 [2024-08-06 03:10:35,421][52647] Sum rewards: 55.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.014', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.534', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.058', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '45.000'} [2024-08-06 03:10:35,534][52671] DAMAGECOUNT value on done: 387423.0 [2024-08-06 03:10:35,534][52671] Sum rewards: 68.320, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.874', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.128', 'weapon5': '0.206', 'AMMO4': '0.239', 'AMMO3': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '59.000'} [2024-08-06 03:10:36,469][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:10:37,613][52647] DAMAGECOUNT value on done: 395031.0 [2024-08-06 03:10:37,614][52647] Sum rewards: 72.211, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.837', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.147', 'weapon5': '0.172', 'AMMO4': '0.240', 'weapon4': '0.272', 'weapon2': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:37,744][52794] DAMAGECOUNT value on done: 383696.0 [2024-08-06 03:10:37,745][52794] Sum rewards: 76.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.616', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'weapon4': '0.164', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '64.000'} [2024-08-06 03:10:37,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 358457344. Throughput: 0: 4385.7. Samples: 89618260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:10:37,795][52567] Avg episode reward: [(0, '70.252')] [2024-08-06 03:10:38,579][52671] DAMAGECOUNT value on done: 388611.0 [2024-08-06 03:10:38,580][52671] Sum rewards: 66.930, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.955', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.112', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '58.000'} [2024-08-06 03:10:39,562][52650] Updated weights for policy 0, policy_version 43761 (0.0013) [2024-08-06 03:10:40,320][52647] DAMAGECOUNT value on done: 398246.0 [2024-08-06 03:10:40,328][52647] Sum rewards: 77.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.550', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.134', 'AMMO4': '0.184', 'AMMO3': '0.201', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '66.000'} [2024-08-06 03:10:40,759][52794] DAMAGECOUNT value on done: 392507.0 [2024-08-06 03:10:40,761][52794] Sum rewards: 63.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.078', 'weapon4': '0.192', 'AMMO3': '0.200', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '54.000'} [2024-08-06 03:10:41,521][52671] DAMAGECOUNT value on done: 383287.0 [2024-08-06 03:10:41,523][52671] Sum rewards: 66.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.154', 'AMMO4': '0.177', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.260', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 358539264. Throughput: 0: 4377.3. Samples: 89644570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:10:42,794][52567] Avg episode reward: [(0, '70.288')] [2024-08-06 03:10:43,364][52647] DAMAGECOUNT value on done: 398376.0 [2024-08-06 03:10:43,365][52647] Sum rewards: 65.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.906', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.201', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:43,890][52794] DAMAGECOUNT value on done: 381692.0 [2024-08-06 03:10:43,891][52794] Sum rewards: 65.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.318', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.288', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:44,279][52650] Updated weights for policy 0, policy_version 43771 (0.0013) [2024-08-06 03:10:44,315][52671] DAMAGECOUNT value on done: 381238.0 [2024-08-06 03:10:44,315][52671] Sum rewards: 68.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.244', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '58.500'} [2024-08-06 03:10:46,037][52659] DAMAGECOUNT value on done: 384064.0 [2024-08-06 03:10:46,037][52659] Sum rewards: 63.931, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.164', 'AMMO4': '0.172', 'AMMO3': '0.222', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.254', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '56.000'} [2024-08-06 03:10:46,511][52647] DAMAGECOUNT value on done: 406756.0 [2024-08-06 03:10:46,513][52647] Sum rewards: 63.874, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.138', 'weapon4': '0.168', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 358629376. Throughput: 0: 4381.6. Samples: 89657730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:10:47,795][52567] Avg episode reward: [(0, '70.137')] [2024-08-06 03:10:48,794][52650] Updated weights for policy 0, policy_version 43781 (0.0013) [2024-08-06 03:10:48,920][52614] Signal inference workers to stop experience collection... (7900 times) [2024-08-06 03:10:48,920][52614] Signal inference workers to resume experience collection... (7900 times) [2024-08-06 03:10:48,963][52650] InferenceWorker_p0-w0: stopping experience collection (7900 times) [2024-08-06 03:10:48,963][52650] InferenceWorker_p0-w0: resuming experience collection (7900 times) [2024-08-06 03:10:49,221][52659] DAMAGECOUNT value on done: 382041.0 [2024-08-06 03:10:49,222][52659] Sum rewards: 68.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.477', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon2': '0.122', 'weapon5': '0.170', 'AMMO3': '0.185', 'weapon4': '0.232', 'AMMO4': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.236', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '56.000'} [2024-08-06 03:10:49,458][52647] DAMAGECOUNT value on done: 397233.0 [2024-08-06 03:10:49,459][52647] Sum rewards: 64.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.765', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.175', 'AMMO3': '0.220', 'weapon4': '0.282', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:51,856][52647] DAMAGECOUNT value on done: 396264.0 [2024-08-06 03:10:51,860][52647] Sum rewards: 56.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.021', 'AMMO2': '0.072', 'weapon5': '0.186', 'AMMO3': '0.209', 'weapon4': '0.244', 'AMMO4': '0.362', 'weapon2': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '50.000'} [2024-08-06 03:10:51,899][52659] DAMAGECOUNT value on done: 382202.0 [2024-08-06 03:10:51,900][52659] Sum rewards: 78.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.452', 'AMMO2': '0.001', 'AMMO4': '0.003', 'weapon2': '0.200', 'AMMO3': '0.207', 'WEAPON3': '1.250', 'weapon3': '3.606', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '65.000'} [2024-08-06 03:10:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 358719488. Throughput: 0: 4383.6. Samples: 89684090. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:10:52,794][52567] Avg episode reward: [(0, '70.150')] [2024-08-06 03:10:53,173][52666] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:10:53,580][52650] Updated weights for policy 0, policy_version 43791 (0.0012) [2024-08-06 03:10:54,547][52647] DAMAGECOUNT value on done: 395678.0 [2024-08-06 03:10:54,547][52647] Sum rewards: 74.777, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.764', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.070', 'AMMO4': '0.120', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '62.000'} [2024-08-06 03:10:54,707][52659] DAMAGECOUNT value on done: 381656.0 [2024-08-06 03:10:54,707][52659] Sum rewards: 69.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'AMMO4': '0.136', 'AMMO3': '0.173', 'weapon2': '0.410', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.452', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '57.000'} [2024-08-06 03:10:55,044][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:10:55,499][52668] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:10:57,492][52647] DAMAGECOUNT value on done: 393990.0 [2024-08-06 03:10:57,492][52647] Sum rewards: 63.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.060', 'AMMO4': '0.085', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '55.000'} [2024-08-06 03:10:57,732][52659] DAMAGECOUNT value on done: 378978.0 [2024-08-06 03:10:57,732][52659] Sum rewards: 75.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.895', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.186', 'AMMO3': '0.189', 'weapon4': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '64.000'} [2024-08-06 03:10:57,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.1, 300 sec: 17494.7). Total num frames: 358801408. Throughput: 0: 4372.8. Samples: 89709730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:10:57,795][52567] Avg episode reward: [(0, '70.195')] [2024-08-06 03:10:58,345][52666] DAMAGECOUNT value on done: 380596.0 [2024-08-06 03:10:58,347][52666] Sum rewards: 57.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.130', 'AMMO4': '0.136', 'weapon4': '0.184', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '48.000'} [2024-08-06 03:10:58,465][52650] Updated weights for policy 0, policy_version 43801 (0.0057) [2024-08-06 03:11:00,270][52647] DAMAGECOUNT value on done: 399182.0 [2024-08-06 03:11:00,270][52647] Sum rewards: 66.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.149', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.700', 'HITCOUNT': '3.190', 'weapon3': '3.414', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:00,741][52659] DAMAGECOUNT value on done: 381951.0 [2024-08-06 03:11:00,741][52659] Sum rewards: 74.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.814', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.200', 'AMMO3': '0.214', 'weapon5': '0.220', 'weapon2': '0.240', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '64.000'} [2024-08-06 03:11:01,034][52662] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:11:01,195][52666] DAMAGECOUNT value on done: 385739.0 [2024-08-06 03:11:01,195][52666] Sum rewards: 78.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.318', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.092', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '62.500'} [2024-08-06 03:11:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17477.3, 300 sec: 17523.1). Total num frames: 358891520. Throughput: 0: 4366.4. Samples: 89722820. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:11:02,794][52567] Avg episode reward: [(0, '70.283')] [2024-08-06 03:11:02,965][52650] Updated weights for policy 0, policy_version 43811 (0.0050) [2024-08-06 03:11:03,213][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:11:03,769][52659] DAMAGECOUNT value on done: 382019.0 [2024-08-06 03:11:03,769][52659] Sum rewards: 75.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.647', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.082', 'weapon4': '0.144', 'AMMO3': '0.189', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '60.000'} [2024-08-06 03:11:04,056][52666] DAMAGECOUNT value on done: 385983.0 [2024-08-06 03:11:04,058][52666] Sum rewards: 82.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.086', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.026', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '66.000'} [2024-08-06 03:11:04,930][52670] DAMAGECOUNT value on done: 376674.0 [2024-08-06 03:11:04,932][52670] Sum rewards: 57.316, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.145', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'weapon2': '0.246', 'AMMO3': '0.265', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.932', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '52.000'} [2024-08-06 03:11:05,030][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:11:06,842][52659] DAMAGECOUNT value on done: 379944.0 [2024-08-06 03:11:06,845][52659] Sum rewards: 80.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.193', 'weapon4': '0.234', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '63.000'} [2024-08-06 03:11:07,334][52666] DAMAGECOUNT value on done: 382088.0 [2024-08-06 03:11:07,336][52666] Sum rewards: 59.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.126', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.440', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.054', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '52.000'} [2024-08-06 03:11:07,682][52650] Updated weights for policy 0, policy_version 43821 (0.0015) [2024-08-06 03:11:07,794][52567] Fps is (10 sec: 18023.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 358981632. Throughput: 0: 4370.1. Samples: 89749190. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:11:07,794][52567] Avg episode reward: [(0, '70.236')] [2024-08-06 03:11:08,308][52670] DAMAGECOUNT value on done: 381076.0 [2024-08-06 03:11:08,311][52670] Sum rewards: 61.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.396', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.082', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.312', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '51.000'} [2024-08-06 03:11:08,773][52663] DAMAGECOUNT value on done: 386514.0 [2024-08-06 03:11:08,774][52663] Sum rewards: 80.190, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'HEALTH': '0.222', 'weapon4': '0.236', 'weapon2': '0.292', 'WEAPON3': '0.950', 'weapon3': '3.198', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '63.000'} [2024-08-06 03:11:10,068][52659] DAMAGECOUNT value on done: 388599.0 [2024-08-06 03:11:10,069][52659] Sum rewards: 62.717, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.418', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:10,075][52666] DAMAGECOUNT value on done: 379612.0 [2024-08-06 03:11:10,075][52666] Sum rewards: 72.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.176', 'weapon2': '0.180', 'weapon4': '0.196', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '60.000'} [2024-08-06 03:11:10,922][52670] DAMAGECOUNT value on done: 373368.0 [2024-08-06 03:11:10,924][52670] Sum rewards: 71.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.726', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.084', 'AMMO4': '0.163', 'weapon5': '0.184', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '60.500'} [2024-08-06 03:11:11,263][52663] DAMAGECOUNT value on done: 380568.0 [2024-08-06 03:11:11,263][52663] Sum rewards: 66.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.112', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.067', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.622', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.064', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:12,238][52670] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 03:11:12,353][52650] Updated weights for policy 0, policy_version 43831 (0.0017) [2024-08-06 03:11:12,725][52659] DAMAGECOUNT value on done: 389979.0 [2024-08-06 03:11:12,726][52659] Sum rewards: 71.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.112', 'AMMO3': '0.179', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.116', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 359063552. Throughput: 0: 4377.1. Samples: 89775640. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:11:12,802][52567] Avg episode reward: [(0, '69.887')] [2024-08-06 03:11:12,926][52666] DAMAGECOUNT value on done: 374450.0 [2024-08-06 03:11:12,928][52666] Sum rewards: 66.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.740', 'AMMO2': '0.019', 'AMMO5': '0.021', 'weapon4': '0.058', 'AMMO4': '0.097', 'weapon5': '0.166', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.210', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.368', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:13,858][52670] DAMAGECOUNT value on done: 372894.0 [2024-08-06 03:11:13,859][52670] Sum rewards: 71.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.642', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.175', 'weapon2': '0.208', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.500', 'weapon3': '2.924', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '60.000'} [2024-08-06 03:11:13,950][52663] DAMAGECOUNT value on done: 377358.0 [2024-08-06 03:11:13,950][52663] Sum rewards: 61.908, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.208', 'AMMO4': '0.244', 'weapon2': '0.244', 'AMMO3': '0.259', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.102', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2024-08-06 03:11:15,881][52659] DAMAGECOUNT value on done: 383109.0 [2024-08-06 03:11:15,884][52659] Sum rewards: 70.643, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.244', 'AMMO5': '0.018', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.168', 'weapon5': '0.206', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '0.950', 'weapon3': '2.874', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:16,535][52666] DAMAGECOUNT value on done: 382057.0 [2024-08-06 03:11:16,536][52666] Sum rewards: 61.113, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.142', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.134', 'weapon4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.298', 'weapon2': '0.320', 'WEAPON3': '1.800', 'weapon3': '3.084', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:16,976][52650] Updated weights for policy 0, policy_version 43841 (0.0012) [2024-08-06 03:11:17,185][52663] DAMAGECOUNT value on done: 383514.0 [2024-08-06 03:11:17,185][52663] Sum rewards: 72.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.508', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.100', 'AMMO4': '0.225', 'weapon5': '0.242', 'AMMO3': '0.264', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '60.000'} [2024-08-06 03:11:17,413][52670] DAMAGECOUNT value on done: 383357.0 [2024-08-06 03:11:17,413][52670] Sum rewards: 67.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.370', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.221', 'weapon2': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '56.000'} [2024-08-06 03:11:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 359161856. Throughput: 0: 4377.1. Samples: 89788790. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:11:17,795][52567] Avg episode reward: [(0, '69.503')] [2024-08-06 03:11:18,812][52659] DAMAGECOUNT value on done: 384998.0 [2024-08-06 03:11:18,813][52659] Sum rewards: 70.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.258', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.138', 'weapon4': '0.168', 'AMMO3': '0.191', 'AMMO4': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '58.000'} [2024-08-06 03:11:19,351][52666] DAMAGECOUNT value on done: 381418.0 [2024-08-06 03:11:19,352][52666] Sum rewards: 79.854, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.062', 'weapon4': '0.078', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '64.500'} [2024-08-06 03:11:19,692][52663] DAMAGECOUNT value on done: 379206.0 [2024-08-06 03:11:19,692][52663] Sum rewards: 74.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.873', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon7': '0.088', 'AMMO3': '0.141', 'weapon5': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'AMMO4': '0.214', 'weapon4': '0.226', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.768', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:20,214][52670] DAMAGECOUNT value on done: 376414.0 [2024-08-06 03:11:20,217][52670] Sum rewards: 67.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.178', 'AMMO4': '0.207', 'weapon5': '0.260', 'weapon2': '0.336', 'weapon4': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.754', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '53.000'} [2024-08-06 03:11:21,850][52650] Updated weights for policy 0, policy_version 43851 (0.0012) [2024-08-06 03:11:21,913][52659] DAMAGECOUNT value on done: 373757.0 [2024-08-06 03:11:21,915][52659] Sum rewards: 65.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.096', 'weapon4': '0.104', 'AMMO4': '0.170', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '54.000'} [2024-08-06 03:11:22,365][52666] DAMAGECOUNT value on done: 377291.0 [2024-08-06 03:11:22,369][52666] Sum rewards: 71.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.504', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'AMMO3': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.386', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 03:11:22,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17613.2, 300 sec: 17550.3). Total num frames: 359251968. Throughput: 0: 4372.9. Samples: 89815040. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:11:22,794][52567] Avg episode reward: [(0, '69.563')] [2024-08-06 03:11:22,798][52663] DAMAGECOUNT value on done: 383516.0 [2024-08-06 03:11:22,802][52663] Sum rewards: 74.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.215', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.090', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon4': '0.362', 'WEAPON4': '0.500', 'weapon2': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '62.000'} [2024-08-06 03:11:23,121][52670] DAMAGECOUNT value on done: 372206.0 [2024-08-06 03:11:23,122][52670] Sum rewards: 74.341, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.197', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.132', 'AMMO3': '0.158', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON3': '0.950', 'weapon3': '3.172', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '58.000'} [2024-08-06 03:11:24,688][52803] DAMAGECOUNT value on done: 357556.0 [2024-08-06 03:11:24,689][52803] Sum rewards: 65.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.126', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '56.000'} [2024-08-06 03:11:24,847][52666] DAMAGECOUNT value on done: 374247.0 [2024-08-06 03:11:24,849][52666] Sum rewards: 74.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.042', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.212', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '61.000'} [2024-08-06 03:11:24,997][52659] DAMAGECOUNT value on done: 380238.0 [2024-08-06 03:11:24,997][52659] Sum rewards: 70.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.029', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.060', 'AMMO4': '0.127', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:25,632][52663] DAMAGECOUNT value on done: 381659.0 [2024-08-06 03:11:25,634][52663] Sum rewards: 66.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.142', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '56.000'} [2024-08-06 03:11:25,802][52670] DAMAGECOUNT value on done: 375308.0 [2024-08-06 03:11:25,804][52670] Sum rewards: 63.601, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.444', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.326', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '50.000'} [2024-08-06 03:11:26,134][52650] Updated weights for policy 0, policy_version 43861 (0.0013) [2024-08-06 03:11:26,288][52811] DAMAGECOUNT value on done: 367986.0 [2024-08-06 03:11:26,289][52811] Sum rewards: 75.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.084', 'weapon5': '0.170', 'AMMO3': '0.230', 'AMMO4': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '62.500'} [2024-08-06 03:11:27,523][52666] DAMAGECOUNT value on done: 377585.0 [2024-08-06 03:11:27,524][52666] Sum rewards: 72.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.675', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.048', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO3': '0.269', 'WEAPON3': '1.550', 'weapon3': '3.562', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '61.000'} [2024-08-06 03:11:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17495.4). Total num frames: 359325696. Throughput: 0: 4366.2. Samples: 89841050. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:11:27,795][52567] Avg episode reward: [(0, '69.334')] [2024-08-06 03:11:27,851][52659] DAMAGECOUNT value on done: 390946.0 [2024-08-06 03:11:27,851][52659] Sum rewards: 69.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.159', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:27,915][52803] DAMAGECOUNT value on done: 354671.0 [2024-08-06 03:11:27,915][52803] Sum rewards: 74.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.962', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.126', 'weapon5': '0.158', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:28,187][52670] DAMAGECOUNT value on done: 378081.0 [2024-08-06 03:11:28,188][52670] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.514', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.023', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.132', 'WEAPON5': '0.200', 'weapon2': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.956', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '46.000'} [2024-08-06 03:11:28,195][52663] DAMAGECOUNT value on done: 379107.0 [2024-08-06 03:11:28,196][52663] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.714', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '51.000'} [2024-08-06 03:11:29,527][52811] DAMAGECOUNT value on done: 355264.0 [2024-08-06 03:11:29,527][52811] Sum rewards: 73.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.271', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.205', 'AMMO4': '0.207', 'weapon5': '0.220', 'weapon2': '0.278', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:30,078][52666] DAMAGECOUNT value on done: 375595.0 [2024-08-06 03:11:30,078][52666] Sum rewards: 73.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.945', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.175', 'weapon5': '0.218', 'AMMO4': '0.235', 'weapon2': '0.242', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '58.000'} [2024-08-06 03:11:30,727][52670] DAMAGECOUNT value on done: 371522.0 [2024-08-06 03:11:30,727][52670] Sum rewards: 73.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.445', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '61.000'} [2024-08-06 03:11:30,969][52659] DAMAGECOUNT value on done: 387698.0 [2024-08-06 03:11:30,972][52659] Sum rewards: 71.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.150', 'AMMO4': '0.173', 'weapon2': '0.174', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.386', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:30,982][52803] DAMAGECOUNT value on done: 358402.0 [2024-08-06 03:11:30,984][52803] Sum rewards: 75.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.398', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.205', 'AMMO4': '0.261', 'weapon2': '0.384', 'weapon4': '0.388', 'weapon5': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.554', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '63.000'} [2024-08-06 03:11:31,128][52650] Updated weights for policy 0, policy_version 43871 (0.0011) [2024-08-06 03:11:31,326][52663] DAMAGECOUNT value on done: 377708.0 [2024-08-06 03:11:31,328][52663] Sum rewards: 79.839, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.915', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.044', 'weapon4': '0.112', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.320', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '68.000'} [2024-08-06 03:11:32,666][52811] DAMAGECOUNT value on done: 354948.0 [2024-08-06 03:11:32,670][52811] Sum rewards: 74.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.000', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.156', 'AMMO3': '0.158', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '61.500'} [2024-08-06 03:11:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 359424000. Throughput: 0: 4365.8. Samples: 89854190. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:11:32,802][52567] Avg episode reward: [(0, '69.530')] [2024-08-06 03:11:32,906][52666] DAMAGECOUNT value on done: 385742.0 [2024-08-06 03:11:32,910][52666] Sum rewards: 72.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.592', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '61.000'} [2024-08-06 03:11:33,745][52670] DAMAGECOUNT value on done: 384178.0 [2024-08-06 03:11:33,747][52670] Sum rewards: 61.202, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.925', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO4': '0.190', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '53.000'} [2024-08-06 03:11:34,035][52659] DAMAGECOUNT value on done: 387045.0 [2024-08-06 03:11:34,036][52659] Sum rewards: 78.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.542', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.352', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '63.000'} [2024-08-06 03:11:34,049][52803] DAMAGECOUNT value on done: 360862.0 [2024-08-06 03:11:34,049][52803] Sum rewards: 68.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.948', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.138', 'AMMO3': '0.168', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.000', 'weapon3': '2.960', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:34,519][52663] DAMAGECOUNT value on done: 382694.0 [2024-08-06 03:11:34,521][52663] Sum rewards: 65.327, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'HEALTH': '0.142', 'AMMO3': '0.177', 'weapon5': '0.182', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.050', 'weapon3': '3.094', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2024-08-06 03:11:35,569][52666] DAMAGECOUNT value on done: 381012.0 [2024-08-06 03:11:35,571][52666] Sum rewards: 73.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.068', 'AMMO5': '0.017', 'AMMO2': '0.079', 'weapon4': '0.124', 'weapon5': '0.260', 'AMMO3': '0.267', 'weapon2': '0.344', 'AMMO4': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '62.000'} [2024-08-06 03:11:35,670][52650] Updated weights for policy 0, policy_version 43881 (0.0020) [2024-08-06 03:11:35,866][52811] DAMAGECOUNT value on done: 355891.0 [2024-08-06 03:11:35,866][52811] Sum rewards: 58.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.364', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon4': '0.194', 'weapon5': '0.252', 'AMMO3': '0.271', 'weapon2': '0.346', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.884', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '50.000'} [2024-08-06 03:11:36,155][52670] DAMAGECOUNT value on done: 376118.0 [2024-08-06 03:11:36,157][52670] Sum rewards: 63.053, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.360', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.168', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.320', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '49.000'} [2024-08-06 03:11:37,055][52659] DAMAGECOUNT value on done: 380171.0 [2024-08-06 03:11:37,055][52659] Sum rewards: 72.243, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.835', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.110', 'weapon2': '0.174', 'weapon5': '0.188', 'AMMO3': '0.221', 'AMMO4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '61.000'} [2024-08-06 03:11:37,185][52803] DAMAGECOUNT value on done: 362566.0 [2024-08-06 03:11:37,186][52803] Sum rewards: 66.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.158', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.149', 'weapon4': '0.170', 'AMMO3': '0.225', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:37,357][52663] DAMAGECOUNT value on done: 386063.0 [2024-08-06 03:11:37,357][52663] Sum rewards: 63.684, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.241', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.155', 'weapon4': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.164', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '55.500'} [2024-08-06 03:11:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 359505920. Throughput: 0: 4359.5. Samples: 89880270. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 03:11:37,802][52567] Avg episode reward: [(0, '69.141')] [2024-08-06 03:11:38,475][52666] DAMAGECOUNT value on done: 377546.0 [2024-08-06 03:11:38,475][52666] Sum rewards: 57.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.276', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO4': '0.196', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '2.604', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '49.000'} [2024-08-06 03:11:38,789][52811] DAMAGECOUNT value on done: 358724.0 [2024-08-06 03:11:38,790][52811] Sum rewards: 62.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.092', 'AMMO4': '0.147', 'AMMO3': '0.269', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.600', 'weapon3': '2.746', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:39,345][52670] DAMAGECOUNT value on done: 377870.0 [2024-08-06 03:11:39,345][52670] Sum rewards: 67.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.208', 'weapon2': '0.224', 'weapon5': '0.256', 'weapon4': '0.270', 'AMMO4': '0.276', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.000'} [2024-08-06 03:11:39,734][52659] DAMAGECOUNT value on done: 388745.0 [2024-08-06 03:11:39,735][52659] Sum rewards: 77.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.175', 'weapon4': '0.184', 'weapon5': '0.242', 'AMMO4': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '62.000'} [2024-08-06 03:11:40,309][52663] DAMAGECOUNT value on done: 383492.0 [2024-08-06 03:11:40,309][52663] Sum rewards: 64.687, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.835', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.182', 'AMMO4': '0.202', 'weapon2': '0.278', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '3.010', 'weapon3': '3.148', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '58.000'} [2024-08-06 03:11:40,413][52650] Updated weights for policy 0, policy_version 43891 (0.0023) [2024-08-06 03:11:40,510][52803] DAMAGECOUNT value on done: 349617.0 [2024-08-06 03:11:40,512][52803] Sum rewards: 55.161, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.145', 'weapon5': '0.148', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '3.172', 'DAMAGECOUNT': '12.057', 'FRAGCOUNT': '46.000'} [2024-08-06 03:11:41,624][52666] DAMAGECOUNT value on done: 380043.0 [2024-08-06 03:11:41,624][52666] Sum rewards: 67.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.159', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.124', 'AMMO4': '0.149', 'AMMO3': '0.191', 'weapon5': '0.210', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.152', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:41,867][52811] DAMAGECOUNT value on done: 362709.0 [2024-08-06 03:11:41,869][52811] Sum rewards: 78.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.000', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.128', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.076', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 03:11:42,288][52659] DAMAGECOUNT value on done: 386384.0 [2024-08-06 03:11:42,290][52659] Sum rewards: 67.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.970', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:42,759][52670] DAMAGECOUNT value on done: 384145.0 [2024-08-06 03:11:42,760][52670] Sum rewards: 66.742, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.068', 'HEALTH': '0.108', 'AMMO3': '0.130', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '0.700', 'weapon3': '3.050', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '53.500'} [2024-08-06 03:11:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 359596032. Throughput: 0: 4374.7. Samples: 89906590. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:11:42,802][52567] Avg episode reward: [(0, '68.887')] [2024-08-06 03:11:42,829][52663] DAMAGECOUNT value on done: 376452.0 [2024-08-06 03:11:42,831][52663] Sum rewards: 67.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.060', 'weapon4': '0.088', 'AMMO4': '0.180', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '57.000'} [2024-08-06 03:11:43,186][52667] DAMAGECOUNT value on done: 380711.0 [2024-08-06 03:11:43,187][52667] Sum rewards: 64.100, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.425', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO3': '0.123', 'weapon5': '0.134', 'AMMO4': '0.169', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '0.800', 'weapon3': '2.842', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '50.000'} [2024-08-06 03:11:43,672][52803] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:11:43,794][52803] DAMAGECOUNT value on done: 352934.0 [2024-08-06 03:11:43,794][52803] Sum rewards: 67.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.286', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2024-08-06 03:11:44,841][52650] Updated weights for policy 0, policy_version 43901 (0.0023) [2024-08-06 03:11:44,972][52811] DAMAGECOUNT value on done: 357661.0 [2024-08-06 03:11:44,973][52811] Sum rewards: 65.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.153', 'weapon4': '0.162', 'weapon5': '0.220', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '55.000'} [2024-08-06 03:11:44,995][52666] DAMAGECOUNT value on done: 379505.0 [2024-08-06 03:11:44,996][52666] Sum rewards: 72.224, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.191', 'AMMO3': '0.194', 'weapon5': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '57.000'} [2024-08-06 03:11:45,605][52663] DAMAGECOUNT value on done: 377921.0 [2024-08-06 03:11:45,609][52663] Sum rewards: 76.612, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.512', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.116', 'AMMO4': '0.122', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.206', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '65.000'} [2024-08-06 03:11:45,860][52667] DAMAGECOUNT value on done: 387901.0 [2024-08-06 03:11:45,862][52667] Sum rewards: 66.689, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.620', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.068', 'weapon5': '0.138', 'AMMO3': '0.224', 'AMMO4': '0.242', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '57.000'} [2024-08-06 03:11:45,876][52670] DAMAGECOUNT value on done: 381594.0 [2024-08-06 03:11:45,876][52670] Sum rewards: 75.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '62.000'} [2024-08-06 03:11:46,876][52803] DAMAGECOUNT value on done: 353317.0 [2024-08-06 03:11:46,877][52803] Sum rewards: 70.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.390', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon5': '0.212', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '57.500'} [2024-08-06 03:11:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 359686144. Throughput: 0: 4374.2. Samples: 89919660. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:11:47,794][52567] Avg episode reward: [(0, '69.037')] [2024-08-06 03:11:47,839][52666] DAMAGECOUNT value on done: 381171.0 [2024-08-06 03:11:47,842][52666] Sum rewards: 65.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.070', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.290', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.352', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '56.000'} [2024-08-06 03:11:48,103][52811] DAMAGECOUNT value on done: 358948.0 [2024-08-06 03:11:48,104][52811] Sum rewards: 72.067, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.963', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.135', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.384', 'weapon4': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.706', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '57.000'} [2024-08-06 03:11:48,684][52663] DAMAGECOUNT value on done: 377793.0 [2024-08-06 03:11:48,686][52663] Sum rewards: 66.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.628', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.064', 'AMMO4': '0.093', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.230', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.362', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '56.000'} [2024-08-06 03:11:48,707][52670] DAMAGECOUNT value on done: 365730.0 [2024-08-06 03:11:48,708][52670] Sum rewards: 71.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon4': '0.066', 'weapon5': '0.172', 'AMMO3': '0.216', 'weapon2': '0.272', 'AMMO4': '0.305', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.272', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '57.000'} [2024-08-06 03:11:48,788][52667] DAMAGECOUNT value on done: 381318.0 [2024-08-06 03:11:48,790][52667] Sum rewards: 73.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.390', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '59.000'} [2024-08-06 03:11:48,837][52795] DAMAGECOUNT value on done: 355774.0 [2024-08-06 03:11:48,837][52795] Sum rewards: 67.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.176', 'AMMO3': '0.193', 'AMMO4': '0.237', 'weapon2': '0.298', 'WEAPON5': '0.300', 'weapon4': '0.566', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '54.000'} [2024-08-06 03:11:49,884][52650] Updated weights for policy 0, policy_version 43911 (0.0031) [2024-08-06 03:11:49,971][52803] DAMAGECOUNT value on done: 359025.0 [2024-08-06 03:11:49,972][52803] Sum rewards: 62.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.152', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.194', 'AMMO4': '0.225', 'weapon2': '0.244', 'AMMO3': '0.247', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.990', 'weapon3': '2.992', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '52.500'} [2024-08-06 03:11:50,892][52666] DAMAGECOUNT value on done: 370772.0 [2024-08-06 03:11:50,892][52666] Sum rewards: 50.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.652', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.040', 'weapon4': '0.076', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.846', 'WEAPON3': '1.500', 'HITCOUNT': '2.670', 'weapon3': '2.864', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '45.000'} [2024-08-06 03:11:51,200][52811] DAMAGECOUNT value on done: 363311.0 [2024-08-06 03:11:51,201][52811] Sum rewards: 60.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.079', 'AMMO5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.115', 'weapon5': '0.122', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '2.958', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '51.000'} [2024-08-06 03:11:51,232][52667] DAMAGECOUNT value on done: 384340.0 [2024-08-06 03:11:51,233][52667] Sum rewards: 73.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.424', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon2': '0.158', 'AMMO4': '0.198', 'weapon5': '0.230', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '61.000'} [2024-08-06 03:11:51,684][52670] DAMAGECOUNT value on done: 380443.0 [2024-08-06 03:11:51,685][52670] Sum rewards: 63.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.756', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.168', 'weapon5': '0.180', 'weapon2': '0.194', 'AMMO4': '0.203', 'AMMO3': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '54.000'} [2024-08-06 03:11:52,049][52663] DAMAGECOUNT value on done: 389103.0 [2024-08-06 03:11:52,054][52663] Sum rewards: 73.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.769', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.170', 'AMMO4': '0.174', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '60.000'} [2024-08-06 03:11:52,088][52795] DAMAGECOUNT value on done: 347994.0 [2024-08-06 03:11:52,088][52795] Sum rewards: 71.364, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.618', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.100', 'weapon5': '0.150', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.700', 'weapon3': '2.894', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '62.000'} [2024-08-06 03:11:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 359768064. Throughput: 0: 4368.4. Samples: 89945770. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:11:52,794][52567] Avg episode reward: [(0, '68.996')] [2024-08-06 03:11:53,129][52803] DAMAGECOUNT value on done: 350619.0 [2024-08-06 03:11:53,130][52803] Sum rewards: 70.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.401', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.162', 'weapon4': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '0.950', 'weapon3': '3.158', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '58.000'} [2024-08-06 03:11:53,946][52666] DAMAGECOUNT value on done: 380621.0 [2024-08-06 03:11:53,947][52666] Sum rewards: 58.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.013', 'AMMO2': '0.060', 'weapon2': '0.194', 'weapon5': '0.200', 'weapon4': '0.222', 'AMMO3': '0.243', 'AMMO4': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '49.000'} [2024-08-06 03:11:54,315][52811] DAMAGECOUNT value on done: 358160.0 [2024-08-06 03:11:54,318][52811] Sum rewards: 63.820, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.152', 'AMMO4': '0.172', 'AMMO3': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.238', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '53.000'} [2024-08-06 03:11:54,364][52667] DAMAGECOUNT value on done: 387978.0 [2024-08-06 03:11:54,368][52667] Sum rewards: 70.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.420', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.050', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '59.500'} [2024-08-06 03:11:54,444][52650] Updated weights for policy 0, policy_version 43921 (0.0014) [2024-08-06 03:11:54,853][52670] DAMAGECOUNT value on done: 384792.0 [2024-08-06 03:11:54,855][52670] Sum rewards: 64.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.120', 'weapon4': '0.178', 'AMMO3': '0.196', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '53.500'} [2024-08-06 03:11:55,283][52663] DAMAGECOUNT value on done: 379573.0 [2024-08-06 03:11:55,284][52663] Sum rewards: 71.167, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.170', 'AMMO4': '0.181', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.750', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '57.000'} [2024-08-06 03:11:55,330][52795] DAMAGECOUNT value on done: 347235.0 [2024-08-06 03:11:55,330][52795] Sum rewards: 67.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.348', 'AMMO5': '0.013', 'weapon4': '0.026', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.166', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.224', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '55.500'} [2024-08-06 03:11:56,370][52803] DAMAGECOUNT value on done: 360743.0 [2024-08-06 03:11:56,372][52803] Sum rewards: 63.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.759', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon2': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.138', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '53.000'} [2024-08-06 03:11:57,230][52667] DAMAGECOUNT value on done: 387722.0 [2024-08-06 03:11:57,234][52667] Sum rewards: 83.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.032', 'weapon4': '0.080', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.484', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '69.500'} [2024-08-06 03:11:57,475][52811] DAMAGECOUNT value on done: 357907.0 [2024-08-06 03:11:57,478][52811] Sum rewards: 64.028, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.256', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.080', 'AMMO3': '0.149', 'AMMO4': '0.243', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.614', 'WEAPON3': '0.950', 'weapon3': '2.810', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '51.000'} [2024-08-06 03:11:57,714][52670] DAMAGECOUNT value on done: 380437.0 [2024-08-06 03:11:57,717][52670] Sum rewards: 81.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.081', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '65.000'} [2024-08-06 03:11:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17613.0, 300 sec: 17522.6). Total num frames: 359858176. Throughput: 0: 4361.1. Samples: 89971890. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:11:57,794][52567] Avg episode reward: [(0, '69.086')] [2024-08-06 03:11:58,432][52663] DAMAGECOUNT value on done: 385092.0 [2024-08-06 03:11:58,433][52663] Sum rewards: 54.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.126', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.134', 'AMMO3': '0.194', 'AMMO4': '0.249', 'weapon4': '0.412', 'weapon2': '0.440', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.720', 'weapon3': '2.732', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '46.000'} [2024-08-06 03:11:58,601][52795] DAMAGECOUNT value on done: 354012.0 [2024-08-06 03:11:58,601][52795] Sum rewards: 69.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.344', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO4': '0.194', 'weapon2': '0.266', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.206', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '60.000'} [2024-08-06 03:11:59,232][52650] Updated weights for policy 0, policy_version 43931 (0.0012) [2024-08-06 03:11:59,448][52803] DAMAGECOUNT value on done: 358431.0 [2024-08-06 03:11:59,448][52803] Sum rewards: 71.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.572', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.195', 'weapon5': '0.214', 'weapon2': '0.228', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'ARMOR': '0.455', 'WEAPON4': '0.500', 'weapon4': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:00,040][52667] DAMAGECOUNT value on done: 389093.0 [2024-08-06 03:12:00,041][52667] Sum rewards: 80.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.041', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.182', 'AMMO4': '0.211', 'weapon2': '0.214', 'AMMO3': '0.262', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '67.000'} [2024-08-06 03:12:00,377][52670] DAMAGECOUNT value on done: 380028.0 [2024-08-06 03:12:00,377][52670] Sum rewards: 62.401, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.274', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.102', 'AMMO4': '0.198', 'weapon5': '0.214', 'AMMO3': '0.281', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.986', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '55.500'} [2024-08-06 03:12:00,412][52811] DAMAGECOUNT value on done: 367474.0 [2024-08-06 03:12:00,412][52811] Sum rewards: 65.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.748', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.164', 'weapon4': '0.180', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 03:12:01,151][52663] DAMAGECOUNT value on done: 383000.0 [2024-08-06 03:12:01,153][52663] Sum rewards: 73.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.775', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:01,663][52795] DAMAGECOUNT value on done: 353072.0 [2024-08-06 03:12:01,665][52795] Sum rewards: 58.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.036', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.244', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '50.000'} [2024-08-06 03:12:02,408][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:12:02,572][52803] DAMAGECOUNT value on done: 358043.0 [2024-08-06 03:12:02,572][52803] Sum rewards: 75.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.110', 'weapon5': '0.122', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:02,800][52567] Fps is (10 sec: 17192.7, 60 sec: 17474.5, 300 sec: 17494.4). Total num frames: 359940096. Throughput: 0: 4358.8. Samples: 89984960. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:12:02,800][52567] Avg episode reward: [(0, '68.724')] [2024-08-06 03:12:03,130][52667] DAMAGECOUNT value on done: 382327.0 [2024-08-06 03:12:03,133][52667] Sum rewards: 57.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.112', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.218', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.376', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '47.500'} [2024-08-06 03:12:03,482][52811] DAMAGECOUNT value on done: 356683.0 [2024-08-06 03:12:03,487][52811] Sum rewards: 77.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.055', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '64.000'} [2024-08-06 03:12:03,774][52650] Updated weights for policy 0, policy_version 43941 (0.0027) [2024-08-06 03:12:04,298][52663] DAMAGECOUNT value on done: 376990.0 [2024-08-06 03:12:04,299][52663] Sum rewards: 71.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.218', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '62.000'} [2024-08-06 03:12:04,833][52795] DAMAGECOUNT value on done: 356468.0 [2024-08-06 03:12:04,833][52795] Sum rewards: 65.572, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.381', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.166', 'weapon2': '0.260', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.270', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:05,785][52803] DAMAGECOUNT value on done: 360999.0 [2024-08-06 03:12:05,785][52803] Sum rewards: 65.809, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.368', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.182', 'weapon4': '0.186', 'AMMO4': '0.238', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.910', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:06,400][52667] DAMAGECOUNT value on done: 383964.0 [2024-08-06 03:12:06,402][52667] Sum rewards: 82.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.251', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.462', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '71.000'} [2024-08-06 03:12:06,615][52811] DAMAGECOUNT value on done: 357917.0 [2024-08-06 03:12:06,619][52811] Sum rewards: 65.757, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.598', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.138', 'weapon4': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2024-08-06 03:12:07,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 360030208. Throughput: 0: 4365.3. Samples: 90011480. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:12:07,795][52567] Avg episode reward: [(0, '68.859')] [2024-08-06 03:12:07,884][52795] DAMAGECOUNT value on done: 362517.0 [2024-08-06 03:12:07,894][52795] Sum rewards: 69.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.170', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.152', 'AMMO3': '0.166', 'AMMO4': '0.222', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '56.000'} [2024-08-06 03:12:08,522][52650] Updated weights for policy 0, policy_version 43951 (0.0026) [2024-08-06 03:12:09,001][52803] DAMAGECOUNT value on done: 356228.0 [2024-08-06 03:12:09,001][52803] Sum rewards: 72.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.118', 'AMMO4': '0.173', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.318', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:09,394][52667] DAMAGECOUNT value on done: 391758.0 [2024-08-06 03:12:09,394][52667] Sum rewards: 74.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.340', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.192', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:09,805][52811] DAMAGECOUNT value on done: 360238.0 [2024-08-06 03:12:09,806][52811] Sum rewards: 66.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.158', 'AMMO3': '0.188', 'weapon4': '0.200', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '53.000'} [2024-08-06 03:12:10,983][52795] DAMAGECOUNT value on done: 357403.0 [2024-08-06 03:12:10,983][52795] Sum rewards: 58.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.554', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.172', 'AMMO4': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.182', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '51.000'} [2024-08-06 03:12:12,176][52803] DAMAGECOUNT value on done: 356171.0 [2024-08-06 03:12:12,178][52803] Sum rewards: 65.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.072', 'AMMO4': '0.095', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.486', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '56.500'} [2024-08-06 03:12:12,298][52667] DAMAGECOUNT value on done: 381254.0 [2024-08-06 03:12:12,298][52667] Sum rewards: 61.778, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.210', 'AMMO3': '0.230', 'weapon4': '0.256', 'AMMO4': '0.283', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '51.000'} [2024-08-06 03:12:12,794][52567] Fps is (10 sec: 18033.4, 60 sec: 17612.8, 300 sec: 17550.4). Total num frames: 360120320. Throughput: 0: 4370.4. Samples: 90037720. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:12:12,794][52567] Avg episode reward: [(0, '68.588')] [2024-08-06 03:12:12,882][52811] DAMAGECOUNT value on done: 355051.0 [2024-08-06 03:12:12,883][52811] Sum rewards: 67.125, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.244', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.179', 'weapon4': '0.212', 'AMMO3': '0.249', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '59.500'} [2024-08-06 03:12:13,352][52650] Updated weights for policy 0, policy_version 43961 (0.0011) [2024-08-06 03:12:14,094][52795] DAMAGECOUNT value on done: 345273.0 [2024-08-06 03:12:14,095][52795] Sum rewards: 73.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.374', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:15,244][52803] DAMAGECOUNT value on done: 364379.0 [2024-08-06 03:12:15,246][52803] Sum rewards: 69.284, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:15,352][52667] DAMAGECOUNT value on done: 385928.0 [2024-08-06 03:12:15,354][52667] Sum rewards: 68.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:16,170][52811] DAMAGECOUNT value on done: 357761.0 [2024-08-06 03:12:16,172][52811] Sum rewards: 56.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.042', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.832', 'WEAPON3': '1.200', 'weapon3': '2.632', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '47.000'} [2024-08-06 03:12:17,211][52795] DAMAGECOUNT value on done: 361378.0 [2024-08-06 03:12:17,214][52795] Sum rewards: 75.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.152', 'weapon5': '0.180', 'AMMO3': '0.207', 'weapon2': '0.228', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:17,752][52650] Updated weights for policy 0, policy_version 43971 (0.0028) [2024-08-06 03:12:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 360210432. Throughput: 0: 4369.1. Samples: 90050800. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:12:17,794][52567] Avg episode reward: [(0, '68.503')] [2024-08-06 03:12:18,289][52803] DAMAGECOUNT value on done: 360217.0 [2024-08-06 03:12:18,290][52803] Sum rewards: 70.639, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.062', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.231', 'HEALTH': '0.240', 'weapon2': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:18,462][52662] DAMAGECOUNT value on done: 390713.0 [2024-08-06 03:12:18,471][52662] Sum rewards: 63.177, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.081', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.962', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.000'} [2024-08-06 03:12:18,486][52667] DAMAGECOUNT value on done: 386433.0 [2024-08-06 03:12:18,486][52667] Sum rewards: 69.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.182', 'weapon4': '0.212', 'AMMO3': '0.224', 'AMMO4': '0.237', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 03:12:19,193][52811] DAMAGECOUNT value on done: 359245.0 [2024-08-06 03:12:19,193][52811] Sum rewards: 62.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.208', 'weapon2': '0.718', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '52.500'} [2024-08-06 03:12:20,370][52795] DAMAGECOUNT value on done: 351365.0 [2024-08-06 03:12:20,370][52795] Sum rewards: 78.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.058', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon4': '0.232', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 03:12:21,125][52662] DAMAGECOUNT value on done: 389067.0 [2024-08-06 03:12:21,128][52662] Sum rewards: 61.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.353', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon7': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.177', 'weapon5': '0.180', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '2.920', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '51.000'} [2024-08-06 03:12:21,470][52667] DAMAGECOUNT value on done: 380096.0 [2024-08-06 03:12:21,470][52667] Sum rewards: 67.754, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.556', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.152', 'AMMO3': '0.170', 'AMMO4': '0.188', 'weapon5': '0.204', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '55.000'} [2024-08-06 03:12:21,499][52803] DAMAGECOUNT value on done: 361602.0 [2024-08-06 03:12:21,500][52803] Sum rewards: 78.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.019', 'AMMO2': '0.072', 'weapon4': '0.206', 'weapon5': '0.240', 'AMMO3': '0.245', 'weapon2': '0.274', 'AMMO4': '0.361', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '65.000'} [2024-08-06 03:12:21,507][52668] DAMAGECOUNT value on done: 380191.0 [2024-08-06 03:12:21,508][52668] Sum rewards: 71.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.152', 'AMMO4': '0.167', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '62.000'} [2024-08-06 03:12:21,734][52665] DAMAGECOUNT value on done: 376588.0 [2024-08-06 03:12:21,736][52665] Sum rewards: 70.369, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.355', 'AMMO5': '0.012', 'AMMO2': '0.068', 'weapon5': '0.150', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.318', 'AMMO4': '0.342', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:22,252][52811] DAMAGECOUNT value on done: 357177.0 [2024-08-06 03:12:22,254][52811] Sum rewards: 69.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.215', 'AMMO5': '0.005', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.034', 'weapon5': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '57.500'} [2024-08-06 03:12:22,602][52650] Updated weights for policy 0, policy_version 43981 (0.0015) [2024-08-06 03:12:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 360292352. Throughput: 0: 4365.6. Samples: 90076720. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:12:22,794][52567] Avg episode reward: [(0, '68.541')] [2024-08-06 03:12:23,215][52669] DAMAGECOUNT value on done: 386999.0 [2024-08-06 03:12:23,217][52669] Sum rewards: 68.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.862', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.098', 'weapon4': '0.130', 'AMMO4': '0.174', 'AMMO3': '0.197', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:23,509][52795] DAMAGECOUNT value on done: 352828.0 [2024-08-06 03:12:23,517][52795] Sum rewards: 67.772, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.230', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon4': '0.160', 'weapon5': '0.206', 'AMMO3': '0.293', 'AMMO4': '0.317', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.974', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '58.500'} [2024-08-06 03:12:24,306][52662] DAMAGECOUNT value on done: 389850.0 [2024-08-06 03:12:24,308][52662] Sum rewards: 63.172, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.070', 'HEALTH': '0.110', 'AMMO4': '0.116', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.242', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.906', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '50.000'} [2024-08-06 03:12:24,368][52667] DAMAGECOUNT value on done: 388538.0 [2024-08-06 03:12:24,371][52667] Sum rewards: 69.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.058', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.212', 'AMMO4': '0.215', 'AMMO3': '0.227', 'weapon4': '0.254', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:24,582][52803] DAMAGECOUNT value on done: 354881.0 [2024-08-06 03:12:24,584][52803] Sum rewards: 71.179, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.278', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.750', 'weapon3': '3.282', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '63.000'} [2024-08-06 03:12:24,792][52665] DAMAGECOUNT value on done: 386178.0 [2024-08-06 03:12:24,792][52665] Sum rewards: 66.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '54.000'} [2024-08-06 03:12:24,861][52668] DAMAGECOUNT value on done: 386266.0 [2024-08-06 03:12:24,864][52668] Sum rewards: 73.393, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.975', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.102', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '2.940', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:25,333][52811] DAMAGECOUNT value on done: 359901.0 [2024-08-06 03:12:25,333][52811] Sum rewards: 79.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.837', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.066', 'AMMO4': '0.154', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '65.000'} [2024-08-06 03:12:26,161][52669] DAMAGECOUNT value on done: 378932.0 [2024-08-06 03:12:26,163][52669] Sum rewards: 72.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.255', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.211', 'weapon4': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:26,681][52795] DAMAGECOUNT value on done: 349966.0 [2024-08-06 03:12:26,682][52795] Sum rewards: 71.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.964', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.082', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.396', 'WEAPON3': '1.700', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '63.000'} [2024-08-06 03:12:26,938][52662] DAMAGECOUNT value on done: 379034.0 [2024-08-06 03:12:26,938][52662] Sum rewards: 76.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.885', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.104', 'AMMO4': '0.119', 'weapon5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '63.000'} [2024-08-06 03:12:27,421][52650] Updated weights for policy 0, policy_version 43991 (0.0014) [2024-08-06 03:12:27,536][52667] DAMAGECOUNT value on done: 393531.0 [2024-08-06 03:12:27,536][52667] Sum rewards: 75.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.195', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.051', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.332', 'WEAPON3': '1.050', 'HITCOUNT': '3.210', 'weapon3': '3.384', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '62.000'} [2024-08-06 03:12:27,633][52668] DAMAGECOUNT value on done: 387755.0 [2024-08-06 03:12:27,635][52668] Sum rewards: 70.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.637', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.088', 'AMMO4': '0.194', 'weapon5': '0.206', 'AMMO3': '0.273', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:27,795][52567] Fps is (10 sec: 16383.1, 60 sec: 17476.1, 300 sec: 17494.7). Total num frames: 360374272. Throughput: 0: 4367.3. Samples: 90103120. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:12:27,795][52567] Avg episode reward: [(0, '68.532')] [2024-08-06 03:12:27,808][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043992_360382464.pth... [2024-08-06 03:12:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043480_356188160.pth [2024-08-06 03:12:28,110][52664] DAMAGECOUNT value on done: 398063.0 [2024-08-06 03:12:28,111][52664] Sum rewards: 68.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.598', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.192', 'AMMO4': '0.207', 'weapon4': '0.208', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:28,284][52665] DAMAGECOUNT value on done: 384265.0 [2024-08-06 03:12:28,287][52665] Sum rewards: 82.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.905', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.092', 'weapon4': '0.138', 'AMMO4': '0.155', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '69.000'} [2024-08-06 03:12:28,673][52669] DAMAGECOUNT value on done: 389702.0 [2024-08-06 03:12:28,673][52669] Sum rewards: 74.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.174', 'AMMO4': '0.223', 'AMMO3': '0.266', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.744', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '64.000'} [2024-08-06 03:12:29,921][52795] DAMAGECOUNT value on done: 358910.0 [2024-08-06 03:12:29,921][52795] Sum rewards: 66.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.075', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.168', 'AMMO4': '0.179', 'weapon5': '0.188', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.884', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '54.000'} [2024-08-06 03:12:30,049][52668] DAMAGECOUNT value on done: 390116.0 [2024-08-06 03:12:30,051][52668] Sum rewards: 83.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.902', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.154', 'weapon2': '0.186', 'weapon4': '0.214', 'AMMO3': '0.223', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.508', 'FRAGCOUNT': '68.000'} [2024-08-06 03:12:30,050][52662] DAMAGECOUNT value on done: 389243.0 [2024-08-06 03:12:30,054][52662] Sum rewards: 70.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.721', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon2': '0.186', 'weapon5': '0.192', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:30,792][52667] DAMAGECOUNT value on done: 392461.0 [2024-08-06 03:12:30,793][52667] Sum rewards: 63.719, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.156', 'AMMO3': '0.221', 'weapon4': '0.222', 'AMMO4': '0.224', 'weapon2': '0.246', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.092', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 03:12:30,986][52664] DAMAGECOUNT value on done: 401453.0 [2024-08-06 03:12:30,986][52664] Sum rewards: 70.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.226', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.064', 'AMMO4': '0.065', 'weapon4': '0.074', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:31,444][52665] DAMAGECOUNT value on done: 379867.0 [2024-08-06 03:12:31,445][52665] Sum rewards: 80.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.454', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.013', 'AMMO3': '0.219', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.464', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '67.000'} [2024-08-06 03:12:31,815][52650] Updated weights for policy 0, policy_version 44001 (0.0019) [2024-08-06 03:12:31,974][52669] DAMAGECOUNT value on done: 382284.0 [2024-08-06 03:12:31,974][52669] Sum rewards: 57.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.949', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.198', 'AMMO4': '0.230', 'weapon4': '0.244', 'weapon2': '0.320', 'weapon5': '0.346', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.600', 'weapon3': '2.826', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '48.000'} [2024-08-06 03:12:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 360464384. Throughput: 0: 4362.0. Samples: 90115950. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:12:32,794][52567] Avg episode reward: [(0, '69.198')] [2024-08-06 03:12:32,818][52662] DAMAGECOUNT value on done: 383264.0 [2024-08-06 03:12:32,818][52662] Sum rewards: 70.127, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.237', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.175', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:32,982][52795] DAMAGECOUNT value on done: 346496.0 [2024-08-06 03:12:32,982][52795] Sum rewards: 58.111, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.088', 'weapon4': '0.156', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.650', 'HITCOUNT': '3.040', 'weapon3': '3.092', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '51.000'} [2024-08-06 03:12:33,177][52668] DAMAGECOUNT value on done: 379893.0 [2024-08-06 03:12:33,179][52668] Sum rewards: 60.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.137', 'AMMO4': '0.199', 'weapon5': '0.264', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.900', 'weapon3': '2.540', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '48.000'} [2024-08-06 03:12:33,597][52664] DAMAGECOUNT value on done: 403826.0 [2024-08-06 03:12:33,598][52664] Sum rewards: 69.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'weapon2': '0.188', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.418', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:33,767][52667] DAMAGECOUNT value on done: 390742.0 [2024-08-06 03:12:33,768][52667] Sum rewards: 65.816, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.242', 'AMMO3': '0.280', 'weapon2': '0.428', 'WEAPON3': '1.700', 'weapon3': '3.002', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:34,464][52669] DAMAGECOUNT value on done: 383812.0 [2024-08-06 03:12:34,465][52669] Sum rewards: 57.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.902', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.080', 'weapon4': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.312', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '47.000'} [2024-08-06 03:12:34,645][52665] DAMAGECOUNT value on done: 372127.0 [2024-08-06 03:12:34,645][52665] Sum rewards: 60.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.075', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.092', 'weapon2': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.256', 'AMMO3': '0.264', 'WEAPON3': '1.700', 'weapon3': '3.278', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '54.000'} [2024-08-06 03:12:35,648][52662] DAMAGECOUNT value on done: 392340.0 [2024-08-06 03:12:35,648][52662] Sum rewards: 75.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.552', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.118', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO4': '0.285', 'weapon4': '0.496', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '62.000'} [2024-08-06 03:12:36,192][52795] DAMAGECOUNT value on done: 365814.0 [2024-08-06 03:12:36,192][52795] Sum rewards: 68.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.114', 'weapon5': '0.184', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.170', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:36,237][52668] DAMAGECOUNT value on done: 386667.0 [2024-08-06 03:12:36,237][52668] Sum rewards: 66.673, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.110', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '0.950', 'HITCOUNT': '3.120', 'weapon3': '3.312', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '53.000'} [2024-08-06 03:12:36,377][52664] DAMAGECOUNT value on done: 397194.0 [2024-08-06 03:12:36,378][52664] Sum rewards: 68.571, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.190', 'weapon4': '0.214', 'AMMO4': '0.246', 'weapon5': '0.258', 'weapon2': '0.492', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.760', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.000'} [2024-08-06 03:12:36,894][52650] Updated weights for policy 0, policy_version 44011 (0.0027) [2024-08-06 03:12:36,971][52667] DAMAGECOUNT value on done: 383781.0 [2024-08-06 03:12:36,971][52667] Sum rewards: 75.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.318', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon4': '0.202', 'weapon2': '0.262', 'WEAPON3': '1.050', 'HITCOUNT': '3.350', 'weapon3': '3.390', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:37,696][52665] DAMAGECOUNT value on done: 373956.0 [2024-08-06 03:12:37,700][52665] Sum rewards: 69.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.160', 'AMMO5': '0.018', 'AMMO2': '0.066', 'weapon2': '0.214', 'AMMO3': '0.226', 'weapon5': '0.232', 'weapon4': '0.244', 'AMMO4': '0.329', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '2.992', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '59.500'} [2024-08-06 03:12:37,732][52669] DAMAGECOUNT value on done: 385789.0 [2024-08-06 03:12:37,732][52669] Sum rewards: 64.978, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.160', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '53.000'} [2024-08-06 03:12:37,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 360554496. Throughput: 0: 4364.7. Samples: 90142180. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:12:37,794][52567] Avg episode reward: [(0, '68.800')] [2024-08-06 03:12:38,795][52662] DAMAGECOUNT value on done: 395277.0 [2024-08-06 03:12:38,796][52662] Sum rewards: 79.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.899', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.468', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '63.000'} [2024-08-06 03:12:39,118][52664] DAMAGECOUNT value on done: 399776.0 [2024-08-06 03:12:39,118][52664] Sum rewards: 68.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.930', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.119', 'weapon4': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.310', 'weapon2': '0.570', 'WEAPON3': '1.850', 'weapon3': '2.908', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:39,250][52795] DAMAGECOUNT value on done: 358783.0 [2024-08-06 03:12:39,253][52795] Sum rewards: 88.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.134', 'AMMO4': '0.145', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.981', 'FRAGCOUNT': '73.000'} [2024-08-06 03:12:39,304][52658] DAMAGECOUNT value on done: 382892.0 [2024-08-06 03:12:39,305][52658] Sum rewards: 62.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.570', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.084', 'AMMO4': '0.084', 'weapon5': '0.164', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.138', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '51.000'} [2024-08-06 03:12:39,396][52668] DAMAGECOUNT value on done: 386856.0 [2024-08-06 03:12:39,399][52668] Sum rewards: 61.899, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.358', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.322', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '55.000'} [2024-08-06 03:12:39,627][52667] DAMAGECOUNT value on done: 390619.0 [2024-08-06 03:12:39,628][52667] Sum rewards: 71.333, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.261', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.046', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon4': '0.202', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:40,494][52669] DAMAGECOUNT value on done: 385724.0 [2024-08-06 03:12:40,494][52669] Sum rewards: 68.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.102', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.390', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:40,740][52665] DAMAGECOUNT value on done: 379959.0 [2024-08-06 03:12:40,740][52665] Sum rewards: 63.083, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.849', 'AMMO5': '0.007', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.200', 'AMMO3': '0.262', 'WEAPON3': '1.650', 'HITCOUNT': '3.560', 'weapon3': '3.578', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '55.000'} [2024-08-06 03:12:41,187][52650] Updated weights for policy 0, policy_version 44021 (0.0011) [2024-08-06 03:12:41,662][52664] DAMAGECOUNT value on done: 398184.0 [2024-08-06 03:12:41,662][52664] Sum rewards: 74.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.520', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.086', 'AMMO3': '0.200', 'weapon5': '0.260', 'AMMO4': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:41,701][52662] DAMAGECOUNT value on done: 384578.0 [2024-08-06 03:12:41,701][52662] Sum rewards: 62.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.965', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.114', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.492', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.016', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '54.000'} [2024-08-06 03:12:42,183][52658] DAMAGECOUNT value on done: 386132.0 [2024-08-06 03:12:42,183][52658] Sum rewards: 77.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.598', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON1': '0.020', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '64.000'} [2024-08-06 03:12:42,343][52795] DAMAGECOUNT value on done: 348180.0 [2024-08-06 03:12:42,344][52795] Sum rewards: 71.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.062', 'weapon4': '0.076', 'AMMO4': '0.161', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:42,376][52660] DAMAGECOUNT value on done: 381291.0 [2024-08-06 03:12:42,377][52660] Sum rewards: 56.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.524', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.203', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '2.990', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '49.000'} [2024-08-06 03:12:42,584][52668] DAMAGECOUNT value on done: 380709.0 [2024-08-06 03:12:42,584][52668] Sum rewards: 62.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.148', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.198', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '52.000'} [2024-08-06 03:12:42,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 360636416. Throughput: 0: 4368.2. Samples: 90168460. Policy #0 lag: (min: 0.0, avg: 2.3, max: 7.0) [2024-08-06 03:12:42,795][52567] Avg episode reward: [(0, '69.147')] [2024-08-06 03:12:43,374][52665] DAMAGECOUNT value on done: 383674.0 [2024-08-06 03:12:43,375][52665] Sum rewards: 62.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.258', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.203', 'weapon2': '0.280', 'weapon4': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '51.000'} [2024-08-06 03:12:43,460][52669] DAMAGECOUNT value on done: 385974.0 [2024-08-06 03:12:43,462][52669] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.671', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.131', 'weapon4': '0.196', 'AMMO3': '0.237', 'weapon2': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.392', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:43,656][52820] DAMAGECOUNT value on done: 349950.0 [2024-08-06 03:12:43,657][52820] Sum rewards: 65.733, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.186', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.106', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.966', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '53.000'} [2024-08-06 03:12:44,828][52664] DAMAGECOUNT value on done: 399633.0 [2024-08-06 03:12:44,828][52664] Sum rewards: 73.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.038', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.098', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:44,846][52662] DAMAGECOUNT value on done: 395480.0 [2024-08-06 03:12:44,846][52662] Sum rewards: 57.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.157', 'weapon4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '3.028', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2024-08-06 03:12:44,899][52658] DAMAGECOUNT value on done: 390959.0 [2024-08-06 03:12:44,899][52658] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.070', 'weapon5': '0.078', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '54.000'} [2024-08-06 03:12:45,117][52660] DAMAGECOUNT value on done: 379378.0 [2024-08-06 03:12:45,117][52660] Sum rewards: 62.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.492', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.079', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.324', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '54.000'} [2024-08-06 03:12:45,313][52668] DAMAGECOUNT value on done: 384296.0 [2024-08-06 03:12:45,314][52668] Sum rewards: 65.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.014', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.156', 'AMMO3': '0.227', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.676', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '55.000'} [2024-08-06 03:12:45,364][52795] DAMAGECOUNT value on done: 356971.0 [2024-08-06 03:12:45,364][52795] Sum rewards: 58.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.825', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon4': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '50.000'} [2024-08-06 03:12:46,059][52650] Updated weights for policy 0, policy_version 44031 (0.0036) [2024-08-06 03:12:46,187][52665] DAMAGECOUNT value on done: 384433.0 [2024-08-06 03:12:46,188][52665] Sum rewards: 72.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.957', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon5': '0.150', 'weapon2': '0.180', 'AMMO4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:46,330][52669] DAMAGECOUNT value on done: 387987.0 [2024-08-06 03:12:46,330][52669] Sum rewards: 63.897, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.880', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.240', 'AMMO4': '0.313', 'weapon5': '0.328', 'weapon2': '0.416', 'weapon4': '0.460', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.460', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '53.000'} [2024-08-06 03:12:46,711][52820] DAMAGECOUNT value on done: 355749.0 [2024-08-06 03:12:46,714][52820] Sum rewards: 68.756, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.420', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.182', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:47,102][52647] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:12:47,483][52664] DAMAGECOUNT value on done: 392774.0 [2024-08-06 03:12:47,485][52664] Sum rewards: 58.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.747', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.300', 'weapon2': '0.432', 'weapon4': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.428', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '46.000'} [2024-08-06 03:12:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 360726528. Throughput: 0: 4371.7. Samples: 90181660. Policy #0 lag: (min: 0.0, avg: 2.3, max: 7.0) [2024-08-06 03:12:47,794][52567] Avg episode reward: [(0, '68.546')] [2024-08-06 03:12:47,865][52658] DAMAGECOUNT value on done: 388300.0 [2024-08-06 03:12:47,865][52658] Sum rewards: 70.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.084', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:48,044][52662] DAMAGECOUNT value on done: 382822.0 [2024-08-06 03:12:48,044][52662] Sum rewards: 73.360, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.253', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '62.000'} [2024-08-06 03:12:48,092][52660] DAMAGECOUNT value on done: 391239.0 [2024-08-06 03:12:48,093][52660] Sum rewards: 67.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.686', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon4': '0.080', 'AMMO4': '0.125', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.268', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:48,371][52795] DAMAGECOUNT value on done: 362951.0 [2024-08-06 03:12:48,372][52795] Sum rewards: 69.925, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.254', 'weapon2': '0.374', 'HEALTH': '0.610', 'WEAPON3': '0.750', 'weapon3': '3.136', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '56.000'} [2024-08-06 03:12:48,417][52668] DAMAGECOUNT value on done: 387245.0 [2024-08-06 03:12:48,417][52668] Sum rewards: 82.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.324', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.072', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.432', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '68.000'} [2024-08-06 03:12:49,058][52669] DAMAGECOUNT value on done: 383994.0 [2024-08-06 03:12:49,061][52669] Sum rewards: 66.173, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.294', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.116', 'AMMO3': '0.164', 'weapon5': '0.170', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.878', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '52.000'} [2024-08-06 03:12:49,254][52665] DAMAGECOUNT value on done: 381781.0 [2024-08-06 03:12:49,254][52665] Sum rewards: 80.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.490', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.212', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.454', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '66.000'} [2024-08-06 03:12:49,876][52820] DAMAGECOUNT value on done: 356386.0 [2024-08-06 03:12:49,887][52820] Sum rewards: 70.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.770', 'AMMO5': '0.010', 'weapon5': '0.020', 'AMMO2': '0.021', 'weapon4': '0.072', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.255', 'WEAPON3': '1.650', 'weapon3': '3.450', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 03:12:50,079][52664] DAMAGECOUNT value on done: 402524.0 [2024-08-06 03:12:50,081][52664] Sum rewards: 68.448, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.490', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.302', 'weapon2': '0.382', 'WEAPON3': '1.750', 'weapon3': '3.178', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:50,906][52658] DAMAGECOUNT value on done: 381095.0 [2024-08-06 03:12:50,906][52658] Sum rewards: 74.725, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.782', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.176', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.220', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '59.000'} [2024-08-06 03:12:50,911][52650] Updated weights for policy 0, policy_version 44041 (0.0021) [2024-08-06 03:12:51,020][52662] DAMAGECOUNT value on done: 386618.0 [2024-08-06 03:12:51,022][52662] Sum rewards: 69.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.124', 'weapon4': '0.136', 'AMMO4': '0.147', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '57.000'} [2024-08-06 03:12:51,073][52660] DAMAGECOUNT value on done: 391486.0 [2024-08-06 03:12:51,074][52660] Sum rewards: 69.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.895', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon2': '0.192', 'AMMO3': '0.208', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.606', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:51,282][52668] DAMAGECOUNT value on done: 387191.0 [2024-08-06 03:12:51,285][52668] Sum rewards: 78.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.198', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.374', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '66.000'} [2024-08-06 03:12:51,760][52669] DAMAGECOUNT value on done: 390273.0 [2024-08-06 03:12:51,761][52669] Sum rewards: 70.019, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.052', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.366', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '55.000'} [2024-08-06 03:12:52,146][52665] DAMAGECOUNT value on done: 388111.0 [2024-08-06 03:12:52,146][52665] Sum rewards: 66.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.090', 'AMMO3': '0.221', 'weapon2': '0.250', 'AMMO4': '0.251', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '54.000'} [2024-08-06 03:12:52,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 360816640. Throughput: 0: 4365.8. Samples: 90207940. Policy #0 lag: (min: 0.0, avg: 2.3, max: 7.0) [2024-08-06 03:12:52,794][52567] Avg episode reward: [(0, '68.939')] [2024-08-06 03:12:52,937][52664] DAMAGECOUNT value on done: 397362.0 [2024-08-06 03:12:52,938][52664] Sum rewards: 76.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.190', 'weapon5': '0.276', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '62.000'} [2024-08-06 03:12:53,067][52820] DAMAGECOUNT value on done: 352511.0 [2024-08-06 03:12:53,070][52820] Sum rewards: 66.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 03:12:53,632][52658] DAMAGECOUNT value on done: 384869.0 [2024-08-06 03:12:53,634][52658] Sum rewards: 79.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '66.000'} [2024-08-06 03:12:53,825][52649] DAMAGECOUNT value on done: 375820.0 [2024-08-06 03:12:53,826][52649] Sum rewards: 62.823, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.112', 'AMMO5': '0.023', 'AMMO2': '0.064', 'AMMO3': '0.188', 'weapon2': '0.226', 'weapon4': '0.244', 'weapon5': '0.276', 'AMMO4': '0.318', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.780', 'weapon3': '2.974', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '52.000'} [2024-08-06 03:12:53,919][52660] DAMAGECOUNT value on done: 384080.0 [2024-08-06 03:12:53,919][52660] Sum rewards: 65.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.146', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'weapon4': '0.328', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '53.000'} [2024-08-06 03:12:53,985][52668] DAMAGECOUNT value on done: 380762.0 [2024-08-06 03:12:53,987][52668] Sum rewards: 75.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.578', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.307', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '63.000'} [2024-08-06 03:12:54,325][52662] DAMAGECOUNT value on done: 389791.0 [2024-08-06 03:12:54,328][52662] Sum rewards: 77.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO4': '0.194', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '63.000'} [2024-08-06 03:12:54,723][52669] DAMAGECOUNT value on done: 386464.0 [2024-08-06 03:12:54,725][52669] Sum rewards: 67.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.468', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon2': '0.214', 'AMMO4': '0.224', 'weapon4': '0.242', 'AMMO3': '0.254', 'weapon5': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '55.000'} [2024-08-06 03:12:54,864][52665] DAMAGECOUNT value on done: 382399.0 [2024-08-06 03:12:54,866][52665] Sum rewards: 68.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.698', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.156', 'AMMO4': '0.193', 'AMMO3': '0.228', 'weapon2': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:55,542][52650] Updated weights for policy 0, policy_version 44051 (0.0013) [2024-08-06 03:12:55,829][52664] DAMAGECOUNT value on done: 403902.0 [2024-08-06 03:12:55,829][52664] Sum rewards: 71.441, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.650', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.126', 'weapon5': '0.178', 'weapon2': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.154', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '63.000'} [2024-08-06 03:12:56,128][52820] DAMAGECOUNT value on done: 356393.0 [2024-08-06 03:12:56,129][52820] Sum rewards: 76.831, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.949', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.188', 'AMMO4': '0.189', 'weapon2': '0.252', 'weapon4': '0.276', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.966', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '66.000'} [2024-08-06 03:12:56,470][52649] DAMAGECOUNT value on done: 370302.0 [2024-08-06 03:12:56,470][52649] Sum rewards: 68.185, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.051', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.106', 'AMMO4': '0.216', 'AMMO3': '0.220', 'weapon5': '0.298', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '2.966', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '57.000'} [2024-08-06 03:12:56,638][52660] DAMAGECOUNT value on done: 381983.0 [2024-08-06 03:12:56,639][52660] Sum rewards: 62.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.946', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.138', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '52.000'} [2024-08-06 03:12:56,703][52668] DAMAGECOUNT value on done: 376789.0 [2024-08-06 03:12:56,705][52668] Sum rewards: 58.793, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.417', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.187', 'weapon5': '0.190', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '2.888', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '49.000'} [2024-08-06 03:12:56,958][52658] DAMAGECOUNT value on done: 387241.0 [2024-08-06 03:12:56,959][52658] Sum rewards: 63.520, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.808', 'AMMO5': '0.026', 'AMMO2': '0.061', 'AMMO3': '0.242', 'weapon4': '0.264', 'AMMO4': '0.306', 'weapon2': '0.344', 'weapon5': '0.408', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.620', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '55.500'} [2024-08-06 03:12:57,394][52662] DAMAGECOUNT value on done: 392315.0 [2024-08-06 03:12:57,394][52662] Sum rewards: 63.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.325', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.178', 'weapon2': '0.196', 'weapon4': '0.240', 'AMMO4': '0.290', 'weapon5': '0.336', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '2.922', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '51.000'} [2024-08-06 03:12:57,516][52665] DAMAGECOUNT value on done: 378793.0 [2024-08-06 03:12:57,516][52665] Sum rewards: 72.314, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.784', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.132', 'AMMO3': '0.224', 'AMMO4': '0.248', 'weapon2': '0.248', 'weapon4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '60.000'} [2024-08-06 03:12:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 360906752. Throughput: 0: 4368.2. Samples: 90234290. Policy #0 lag: (min: 0.0, avg: 2.3, max: 7.0) [2024-08-06 03:12:57,794][52567] Avg episode reward: [(0, '69.333')] [2024-08-06 03:12:57,868][52671] DAMAGECOUNT value on done: 389555.0 [2024-08-06 03:12:57,870][52671] Sum rewards: 66.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.956', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.154', 'weapon4': '0.186', 'AMMO3': '0.212', 'AMMO4': '0.218', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '56.000'} [2024-08-06 03:12:57,915][52669] DAMAGECOUNT value on done: 380942.0 [2024-08-06 03:12:57,915][52669] Sum rewards: 75.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'AMMO3': '0.226', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '62.000'} [2024-08-06 03:12:58,656][52664] DAMAGECOUNT value on done: 399892.0 [2024-08-06 03:12:58,656][52664] Sum rewards: 61.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.020', 'AMMO4': '0.053', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.394', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.352', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '52.000'} [2024-08-06 03:12:59,154][52660] DAMAGECOUNT value on done: 386099.0 [2024-08-06 03:12:59,156][52660] Sum rewards: 71.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.084', 'AMMO4': '0.187', 'AMMO3': '0.197', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.712', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 03:12:59,167][52649] DAMAGECOUNT value on done: 376259.0 [2024-08-06 03:12:59,169][52649] Sum rewards: 64.674, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.223', 'AMMO4': '0.239', 'weapon5': '0.246', 'weapon4': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '55.000'} [2024-08-06 03:12:59,267][52668] DAMAGECOUNT value on done: 377938.0 [2024-08-06 03:12:59,267][52668] Sum rewards: 57.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.114', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.010', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2024-08-06 03:12:59,367][52820] DAMAGECOUNT value on done: 350221.0 [2024-08-06 03:12:59,368][52820] Sum rewards: 78.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.468', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '65.000'} [2024-08-06 03:12:59,889][52658] DAMAGECOUNT value on done: 379940.0 [2024-08-06 03:12:59,890][52658] Sum rewards: 73.683, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.114', 'AMMO4': '0.178', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.360', 'WEAPON4': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:00,038][52650] Updated weights for policy 0, policy_version 44061 (0.0025) [2024-08-06 03:13:00,087][52662] DAMAGECOUNT value on done: 385215.0 [2024-08-06 03:13:00,088][52662] Sum rewards: 71.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.166', 'AMMO4': '0.200', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:00,171][52665] DAMAGECOUNT value on done: 378267.0 [2024-08-06 03:13:00,172][52665] Sum rewards: 76.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.887', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.092', 'AMMO4': '0.164', 'AMMO3': '0.183', 'weapon2': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '63.000'} [2024-08-06 03:13:01,022][52671] DAMAGECOUNT value on done: 386773.0 [2024-08-06 03:13:01,022][52671] Sum rewards: 68.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon2': '0.872', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:01,037][52669] DAMAGECOUNT value on done: 388352.0 [2024-08-06 03:13:01,039][52669] Sum rewards: 69.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.266', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.096', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:01,727][52664] DAMAGECOUNT value on done: 409104.0 [2024-08-06 03:13:01,729][52664] Sum rewards: 76.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.292', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.070', 'AMMO4': '0.132', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '3.262', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:01,843][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:13:02,016][52660] DAMAGECOUNT value on done: 391687.0 [2024-08-06 03:13:02,018][52660] Sum rewards: 70.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.456', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:02,068][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-06 03:13:02,123][52794] DAMAGECOUNT value on done: 388322.0 [2024-08-06 03:13:02,123][52794] Sum rewards: 70.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.465', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon4': '0.204', 'weapon2': '0.280', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:02,155][52668] DAMAGECOUNT value on done: 378150.0 [2024-08-06 03:13:02,161][52668] Sum rewards: 71.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.154', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.189', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:02,240][52649] DAMAGECOUNT value on done: 374572.0 [2024-08-06 03:13:02,240][52649] Sum rewards: 77.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.340', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon4': '0.046', 'AMMO3': '0.181', 'weapon5': '0.184', 'AMMO4': '0.200', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:02,306][52658] DAMAGECOUNT value on done: 393369.0 [2024-08-06 03:13:02,307][52658] Sum rewards: 73.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:02,574][52820] DAMAGECOUNT value on done: 353345.0 [2024-08-06 03:13:02,574][52820] Sum rewards: 72.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.150', 'AMMO3': '0.185', 'weapon5': '0.230', 'AMMO4': '0.268', 'weapon2': '0.308', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.062', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:02,666][52662] DAMAGECOUNT value on done: 398221.0 [2024-08-06 03:13:02,667][52662] Sum rewards: 63.837, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.720', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.154', 'weapon5': '0.182', 'AMMO4': '0.280', 'AMMO3': '0.283', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.846', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '57.500'} [2024-08-06 03:13:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17478.0, 300 sec: 17467.0). Total num frames: 360988672. Throughput: 0: 4364.7. Samples: 90247210. Policy #0 lag: (min: 0.0, avg: 2.3, max: 7.0) [2024-08-06 03:13:02,794][52567] Avg episode reward: [(0, '69.038')] [2024-08-06 03:13:03,298][52665] DAMAGECOUNT value on done: 382765.0 [2024-08-06 03:13:03,299][52665] Sum rewards: 79.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.480', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '67.000'} [2024-08-06 03:13:04,083][52671] DAMAGECOUNT value on done: 388130.0 [2024-08-06 03:13:04,084][52671] Sum rewards: 75.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.136', 'weapon4': '0.214', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '63.000'} [2024-08-06 03:13:04,241][52669] DAMAGECOUNT value on done: 393084.0 [2024-08-06 03:13:04,241][52669] Sum rewards: 69.600, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.170', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.223', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:04,539][52660] DAMAGECOUNT value on done: 389578.0 [2024-08-06 03:13:04,539][52660] Sum rewards: 63.095, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.171', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.404', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.528', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '51.000'} [2024-08-06 03:13:04,549][52664] DAMAGECOUNT value on done: 401319.0 [2024-08-06 03:13:04,550][52664] Sum rewards: 60.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.487', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.140', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'weapon2': '0.468', 'weapon4': '0.536', 'WEAPON3': '0.950', 'weapon3': '2.610', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '50.000'} [2024-08-06 03:13:04,575][52668] DAMAGECOUNT value on done: 381220.0 [2024-08-06 03:13:04,577][52668] Sum rewards: 64.876, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'weapon4': '0.098', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '51.000'} [2024-08-06 03:13:05,074][52650] Updated weights for policy 0, policy_version 44071 (0.0019) [2024-08-06 03:13:05,211][52794] DAMAGECOUNT value on done: 390971.0 [2024-08-06 03:13:05,214][52794] Sum rewards: 68.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.892', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.068', 'weapon5': '0.152', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:05,244][52649] DAMAGECOUNT value on done: 365809.0 [2024-08-06 03:13:05,247][52649] Sum rewards: 75.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.174', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.046', 'weapon4': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.550', 'WEAPON3': '0.950', 'weapon3': '3.090', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:05,441][52658] DAMAGECOUNT value on done: 385610.0 [2024-08-06 03:13:05,445][52658] Sum rewards: 63.914, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.142', 'AMMO4': '0.182', 'weapon2': '0.182', 'AMMO3': '0.189', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '53.000'} [2024-08-06 03:13:05,657][52662] DAMAGECOUNT value on done: 390188.0 [2024-08-06 03:13:05,659][52662] Sum rewards: 66.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.332', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.179', 'weapon5': '0.184', 'AMMO4': '0.227', 'weapon4': '0.232', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '53.000'} [2024-08-06 03:13:05,700][52820] DAMAGECOUNT value on done: 358491.0 [2024-08-06 03:13:05,703][52820] Sum rewards: 62.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.080', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.352', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '53.000'} [2024-08-06 03:13:06,362][52665] DAMAGECOUNT value on done: 380668.0 [2024-08-06 03:13:06,371][52665] Sum rewards: 67.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO3': '0.202', 'AMMO4': '0.205', 'weapon2': '0.276', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:06,930][52669] DAMAGECOUNT value on done: 401116.0 [2024-08-06 03:13:06,930][52669] Sum rewards: 75.827, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.564', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.132', 'weapon5': '0.244', 'AMMO3': '0.257', 'weapon2': '0.288', 'AMMO4': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '65.000'} [2024-08-06 03:13:07,038][52671] DAMAGECOUNT value on done: 387218.0 [2024-08-06 03:13:07,040][52671] Sum rewards: 74.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.496', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.080', 'AMMO4': '0.134', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:07,069][52647] DAMAGECOUNT value on done: 408090.0 [2024-08-06 03:13:07,069][52647] Sum rewards: 78.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.287', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO3': '0.156', 'AMMO4': '0.168', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:07,260][52664] DAMAGECOUNT value on done: 406123.0 [2024-08-06 03:13:07,261][52664] Sum rewards: 64.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.995', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.130', 'weapon4': '0.188', 'AMMO3': '0.206', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.182', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:07,582][52660] DAMAGECOUNT value on done: 384182.0 [2024-08-06 03:13:07,584][52660] Sum rewards: 71.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.048', 'AMMO5': '0.021', 'AMMO2': '0.074', 'AMMO3': '0.194', 'weapon2': '0.214', 'weapon5': '0.342', 'AMMO4': '0.368', 'weapon4': '0.536', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.572', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '57.500'} [2024-08-06 03:13:07,642][52668] DAMAGECOUNT value on done: 386835.0 [2024-08-06 03:13:07,645][52668] Sum rewards: 64.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.726', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO4': '0.171', 'weapon5': '0.172', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 361078784. Throughput: 0: 4367.5. Samples: 90273260. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:13:07,795][52567] Avg episode reward: [(0, '69.379')] [2024-08-06 03:13:08,175][52794] DAMAGECOUNT value on done: 387177.0 [2024-08-06 03:13:08,176][52794] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.220', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO3': '0.170', 'AMMO4': '0.179', 'weapon2': '0.222', 'weapon5': '0.246', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon4': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.690', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:08,247][52649] DAMAGECOUNT value on done: 377152.0 [2024-08-06 03:13:08,250][52649] Sum rewards: 72.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.294', 'WEAPON3': '1.100', 'HITCOUNT': '3.340', 'weapon3': '3.432', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:08,612][52658] DAMAGECOUNT value on done: 395638.0 [2024-08-06 03:13:08,612][52658] Sum rewards: 73.788, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.148', 'weapon4': '0.156', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.430', 'HEALTH': '0.799', 'WEAPON3': '0.800', 'HITCOUNT': '3.030', 'weapon3': '3.046', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:08,744][52820] DAMAGECOUNT value on done: 355239.0 [2024-08-06 03:13:08,745][52820] Sum rewards: 73.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.678', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.068', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:08,776][52662] DAMAGECOUNT value on done: 389860.0 [2024-08-06 03:13:08,776][52662] Sum rewards: 75.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.096', 'AMMO4': '0.189', 'AMMO3': '0.216', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:09,150][52669] DAMAGECOUNT value on done: 388119.0 [2024-08-06 03:13:09,150][52669] Sum rewards: 64.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.220', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.068', 'AMMO4': '0.128', 'weapon4': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.238', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:09,319][52650] Updated weights for policy 0, policy_version 44081 (0.0026) [2024-08-06 03:13:09,467][52665] DAMAGECOUNT value on done: 377240.0 [2024-08-06 03:13:09,467][52665] Sum rewards: 68.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.735', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.060', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:09,722][52671] DAMAGECOUNT value on done: 392722.0 [2024-08-06 03:13:09,722][52671] Sum rewards: 60.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.573', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.194', 'weapon5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '52.000'} [2024-08-06 03:13:09,815][52647] DAMAGECOUNT value on done: 405020.0 [2024-08-06 03:13:09,816][52647] Sum rewards: 67.717, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.293', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.122', 'weapon5': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.317', 'WEAPON3': '1.800', 'HITCOUNT': '3.090', 'weapon3': '3.220', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:10,042][52664] DAMAGECOUNT value on done: 396639.0 [2024-08-06 03:13:10,042][52664] Sum rewards: 72.448, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.137', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.091', 'weapon5': '0.138', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.226', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:10,714][52660] DAMAGECOUNT value on done: 393007.0 [2024-08-06 03:13:10,715][52660] Sum rewards: 69.064, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.052', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.102', 'weapon4': '0.126', 'AMMO4': '0.196', 'AMMO3': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:10,775][52668] DAMAGECOUNT value on done: 385255.0 [2024-08-06 03:13:10,776][52668] Sum rewards: 58.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.895', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.092', 'weapon5': '0.198', 'AMMO3': '0.209', 'AMMO4': '0.247', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.202', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '50.000'} [2024-08-06 03:13:11,080][52794] DAMAGECOUNT value on done: 384017.0 [2024-08-06 03:13:11,080][52794] Sum rewards: 68.213, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.200', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.183', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '56.500'} [2024-08-06 03:13:11,239][52649] DAMAGECOUNT value on done: 371339.0 [2024-08-06 03:13:11,241][52649] Sum rewards: 74.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.186', 'weapon2': '0.228', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:11,270][52658] DAMAGECOUNT value on done: 379209.0 [2024-08-06 03:13:11,270][52658] Sum rewards: 73.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO4': '0.142', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:11,412][52662] DAMAGECOUNT value on done: 384594.0 [2024-08-06 03:13:11,412][52662] Sum rewards: 76.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.128', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.074', 'weapon7': '0.074', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO4': '0.205', 'weapon4': '0.382', 'WEAPON4': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.000', 'weapon3': '2.700', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:11,704][52669] DAMAGECOUNT value on done: 389759.0 [2024-08-06 03:13:11,704][52669] Sum rewards: 62.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.146', 'weapon4': '0.172', 'weapon2': '0.198', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.266', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '51.000'} [2024-08-06 03:13:11,875][52820] DAMAGECOUNT value on done: 359957.0 [2024-08-06 03:13:11,875][52820] Sum rewards: 73.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.892', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.125', 'weapon2': '0.182', 'weapon5': '0.182', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.288', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:11,970][52803] Large shaping reward 2.625 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:13:12,288][52665] DAMAGECOUNT value on done: 376900.0 [2024-08-06 03:13:12,290][52665] Sum rewards: 76.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.108', 'AMMO3': '0.186', 'weapon5': '0.250', 'AMMO4': '0.283', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '63.000'} [2024-08-06 03:13:12,721][52647] DAMAGECOUNT value on done: 405959.0 [2024-08-06 03:13:12,721][52647] Sum rewards: 54.477, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.940', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.204', 'weapon5': '0.260', 'AMMO3': '0.279', 'AMMO4': '0.302', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.560', 'weapon3': '2.860', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '48.000'} [2024-08-06 03:13:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 361168896. Throughput: 0: 4368.1. Samples: 90299680. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:13:12,794][52567] Avg episode reward: [(0, '69.432')] [2024-08-06 03:13:12,796][52671] DAMAGECOUNT value on done: 384323.0 [2024-08-06 03:13:12,796][52671] Sum rewards: 65.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'weapon2': '0.208', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:13,056][52664] DAMAGECOUNT value on done: 397906.0 [2024-08-06 03:13:13,056][52664] Sum rewards: 71.199, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.010', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.153', 'AMMO4': '0.222', 'weapon5': '0.310', 'weapon2': '0.378', 'weapon4': '0.500', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.576', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:13,761][52668] DAMAGECOUNT value on done: 387207.0 [2024-08-06 03:13:13,762][52668] Sum rewards: 63.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.608', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.352', 'WEAPON3': '1.650', 'weapon3': '3.248', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:13,780][52660] DAMAGECOUNT value on done: 379470.0 [2024-08-06 03:13:13,781][52660] Sum rewards: 68.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.462', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.116', 'weapon4': '0.144', 'AMMO4': '0.183', 'AMMO3': '0.222', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:13,830][52658] DAMAGECOUNT value on done: 387425.0 [2024-08-06 03:13:13,831][52658] Sum rewards: 68.305, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.084', 'weapon5': '0.096', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'HEALTH': '0.445', 'weapon2': '0.546', 'WEAPON3': '1.000', 'HITCOUNT': '3.000', 'weapon3': '3.096', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 03:13:13,965][52794] DAMAGECOUNT value on done: 383056.0 [2024-08-06 03:13:13,968][52794] Sum rewards: 62.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.070', 'AMMO4': '0.180', 'AMMO3': '0.216', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.168', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '52.500'} [2024-08-06 03:13:14,149][52649] DAMAGECOUNT value on done: 380757.0 [2024-08-06 03:13:14,158][52649] Sum rewards: 76.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.126', 'AMMO4': '0.196', 'AMMO3': '0.197', 'weapon5': '0.256', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:14,229][52650] Updated weights for policy 0, policy_version 44091 (0.0025) [2024-08-06 03:13:14,388][52662] DAMAGECOUNT value on done: 380119.0 [2024-08-06 03:13:14,388][52662] Sum rewards: 58.894, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.106', 'AMMO3': '0.157', 'weapon5': '0.170', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '0.950', 'HITCOUNT': '2.850', 'weapon3': '3.060', 'DAMAGECOUNT': '13.563', 'FRAGCOUNT': '48.000'} [2024-08-06 03:13:14,390][52669] DAMAGECOUNT value on done: 390461.0 [2024-08-06 03:13:14,393][52669] Sum rewards: 78.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '64.000'} [2024-08-06 03:13:14,954][52820] DAMAGECOUNT value on done: 352997.0 [2024-08-06 03:13:14,955][52820] Sum rewards: 76.307, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.965', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '66.000'} [2024-08-06 03:13:15,241][52665] DAMAGECOUNT value on done: 380583.0 [2024-08-06 03:13:15,243][52665] Sum rewards: 57.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.180', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.170', 'AMMO3': '0.245', 'weapon5': '0.274', 'AMMO4': '0.310', 'weapon2': '0.458', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '50.500'} [2024-08-06 03:13:15,332][52647] DAMAGECOUNT value on done: 411735.0 [2024-08-06 03:13:15,332][52647] Sum rewards: 68.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.203', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:15,616][52664] DAMAGECOUNT value on done: 399220.0 [2024-08-06 03:13:15,618][52664] Sum rewards: 59.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.872', 'AMMO5': '0.028', 'AMMO2': '0.069', 'weapon5': '0.158', 'AMMO3': '0.180', 'weapon4': '0.334', 'AMMO4': '0.343', 'weapon2': '0.356', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '49.000'} [2024-08-06 03:13:16,102][52671] DAMAGECOUNT value on done: 393403.0 [2024-08-06 03:13:16,104][52671] Sum rewards: 65.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.569', 'AMMO5': '0.022', 'AMMO2': '0.065', 'weapon4': '0.192', 'AMMO3': '0.234', 'weapon5': '0.274', 'weapon2': '0.282', 'AMMO4': '0.323', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:16,862][52660] DAMAGECOUNT value on done: 379113.0 [2024-08-06 03:13:16,862][52660] Sum rewards: 67.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:16,863][52668] DAMAGECOUNT value on done: 382563.0 [2024-08-06 03:13:16,874][52668] Sum rewards: 90.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.276', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.380', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '74.000'} [2024-08-06 03:13:16,913][52669] DAMAGECOUNT value on done: 391774.0 [2024-08-06 03:13:16,917][52669] Sum rewards: 56.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.140', 'weapon5': '0.174', 'AMMO3': '0.201', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '2.848', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '46.000'} [2024-08-06 03:13:16,980][52658] DAMAGECOUNT value on done: 384016.0 [2024-08-06 03:13:16,982][52658] Sum rewards: 76.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.127', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:17,122][52794] DAMAGECOUNT value on done: 387611.0 [2024-08-06 03:13:17,124][52794] Sum rewards: 73.603, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.174', 'weapon2': '0.574', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:17,234][52649] DAMAGECOUNT value on done: 378720.0 [2024-08-06 03:13:17,235][52649] Sum rewards: 64.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.110', 'AMMO3': '0.159', 'AMMO4': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '53.000'} [2024-08-06 03:13:17,742][52647] DAMAGECOUNT value on done: 408639.0 [2024-08-06 03:13:17,743][52647] Sum rewards: 76.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:17,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 361250816. Throughput: 0: 4375.8. Samples: 90312860. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:13:17,794][52567] Avg episode reward: [(0, '69.465')] [2024-08-06 03:13:18,035][52664] DAMAGECOUNT value on done: 398018.0 [2024-08-06 03:13:18,036][52664] Sum rewards: 66.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.088', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.228', 'weapon5': '0.244', 'weapon4': '0.308', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.732', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:18,066][52820] DAMAGECOUNT value on done: 356584.0 [2024-08-06 03:13:18,068][52820] Sum rewards: 64.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.051', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.213', 'weapon5': '0.268', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.610', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '54.000'} [2024-08-06 03:13:18,295][52665] DAMAGECOUNT value on done: 383035.0 [2024-08-06 03:13:18,295][52665] Sum rewards: 71.549, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.109', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:18,604][52650] Updated weights for policy 0, policy_version 44101 (0.0010) [2024-08-06 03:13:18,815][52671] DAMAGECOUNT value on done: 389616.0 [2024-08-06 03:13:18,816][52671] Sum rewards: 76.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.006', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.180', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.606', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:19,590][52660] DAMAGECOUNT value on done: 392960.0 [2024-08-06 03:13:19,592][52660] Sum rewards: 62.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.219', 'weapon5': '0.248', 'weapon2': '0.310', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:19,947][52794] DAMAGECOUNT value on done: 392784.0 [2024-08-06 03:13:19,947][52794] Sum rewards: 81.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.242', 'weapon4': '0.252', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '65.000'} [2024-08-06 03:13:20,155][52649] DAMAGECOUNT value on done: 371600.0 [2024-08-06 03:13:20,155][52649] Sum rewards: 56.447, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.183', 'AMMO3': '0.187', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.966', 'DAMAGECOUNT': '13.434', 'FRAGCOUNT': '49.000'} [2024-08-06 03:13:20,157][52658] DAMAGECOUNT value on done: 383057.0 [2024-08-06 03:13:20,158][52658] Sum rewards: 67.757, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.514', 'AMMO2': '0.014', 'AMMO5': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:20,355][52647] DAMAGECOUNT value on done: 407352.0 [2024-08-06 03:13:20,355][52647] Sum rewards: 65.529, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.476', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.082', 'AMMO4': '0.086', 'AMMO3': '0.147', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '0.900', 'HITCOUNT': '2.990', 'weapon3': '3.270', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '51.000'} [2024-08-06 03:13:20,710][52664] DAMAGECOUNT value on done: 398420.0 [2024-08-06 03:13:20,710][52664] Sum rewards: 63.319, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.245', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.082', 'weapon4': '0.098', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '54.000'} [2024-08-06 03:13:21,137][52820] DAMAGECOUNT value on done: 361746.0 [2024-08-06 03:13:21,137][52820] Sum rewards: 72.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.268', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:21,464][52671] DAMAGECOUNT value on done: 384440.0 [2024-08-06 03:13:21,464][52671] Sum rewards: 69.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.475', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.148', 'weapon5': '0.164', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:22,451][52660] DAMAGECOUNT value on done: 395604.0 [2024-08-06 03:13:22,459][52660] Sum rewards: 75.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.514', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.174', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:22,475][52794] DAMAGECOUNT value on done: 382665.0 [2024-08-06 03:13:22,475][52794] Sum rewards: 73.704, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.210', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.146', 'weapon5': '0.158', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '65.000'} [2024-08-06 03:13:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 361332736. Throughput: 0: 4372.9. Samples: 90338960. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:13:22,794][52567] Avg episode reward: [(0, '69.192')] [2024-08-06 03:13:23,050][52649] DAMAGECOUNT value on done: 378985.0 [2024-08-06 03:13:23,052][52649] Sum rewards: 69.350, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.153', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:23,257][52647] DAMAGECOUNT value on done: 407550.0 [2024-08-06 03:13:23,258][52647] Sum rewards: 68.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.424', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.308', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.328', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:23,357][52658] DAMAGECOUNT value on done: 380168.0 [2024-08-06 03:13:23,357][52658] Sum rewards: 72.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.076', 'weapon5': '0.086', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:23,672][52650] Updated weights for policy 0, policy_version 44111 (0.0026) [2024-08-06 03:13:23,809][52647] Large shaping reward -2.513 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.264, -88.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:13:23,940][52671] DAMAGECOUNT value on done: 392481.0 [2024-08-06 03:13:23,940][52671] Sum rewards: 71.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.242', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:24,445][52820] DAMAGECOUNT value on done: 358573.0 [2024-08-06 03:13:24,448][52820] Sum rewards: 72.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.106', 'weapon2': '0.204', 'weapon5': '0.206', 'AMMO3': '0.226', 'AMMO4': '0.240', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.204', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '58.500'} [2024-08-06 03:13:25,066][52794] DAMAGECOUNT value on done: 392295.0 [2024-08-06 03:13:25,066][52794] Sum rewards: 75.448, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.112', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.168', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.402', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.696', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:25,466][52660] DAMAGECOUNT value on done: 380459.0 [2024-08-06 03:13:25,468][52660] Sum rewards: 59.298, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.222', 'weapon5': '0.246', 'weapon2': '0.324', 'WEAPON3': '0.850', 'HEALTH': '0.939', 'HITCOUNT': '2.960', 'weapon3': '3.072', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '46.000'} [2024-08-06 03:13:25,873][52649] DAMAGECOUNT value on done: 379769.0 [2024-08-06 03:13:25,875][52649] Sum rewards: 65.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.175', 'AMMO4': '0.176', 'weapon5': '0.192', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.000', 'weapon3': '2.732', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '54.000'} [2024-08-06 03:13:26,374][52658] DAMAGECOUNT value on done: 391731.0 [2024-08-06 03:13:26,377][52658] Sum rewards: 60.464, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.914', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.128', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'weapon2': '0.286', 'AMMO3': '0.315', 'weapon4': '0.374', 'WEAPON4': '0.600', 'WEAPON3': '1.800', 'weapon3': '2.884', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:26,518][52647] DAMAGECOUNT value on done: 401026.0 [2024-08-06 03:13:26,518][52647] Sum rewards: 50.149, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.142', 'AMMO4': '0.194', 'weapon5': '0.242', 'weapon4': '0.254', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.510', 'weapon3': '2.894', 'DAMAGECOUNT': '12.597', 'FRAGCOUNT': '40.000'} [2024-08-06 03:13:26,898][52671] DAMAGECOUNT value on done: 396080.0 [2024-08-06 03:13:26,898][52671] Sum rewards: 78.843, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.402', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.108', 'AMMO4': '0.204', 'weapon2': '0.266', 'AMMO3': '0.271', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '69.000'} [2024-08-06 03:13:27,182][52614] Signal inference workers to stop experience collection... (7950 times) [2024-08-06 03:13:27,183][52614] Signal inference workers to resume experience collection... (7950 times) [2024-08-06 03:13:27,264][52650] InferenceWorker_p0-w0: stopping experience collection (7950 times) [2024-08-06 03:13:27,264][52650] InferenceWorker_p0-w0: resuming experience collection (7950 times) [2024-08-06 03:13:27,546][52820] DAMAGECOUNT value on done: 362208.0 [2024-08-06 03:13:27,546][52820] Sum rewards: 71.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.475', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.087', 'weapon4': '0.088', 'WEAPON5': '0.100', 'weapon2': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'WEAPON3': '1.650', 'weapon3': '3.562', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17522.5). Total num frames: 361431040. Throughput: 0: 4376.7. Samples: 90365410. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:13:27,794][52567] Avg episode reward: [(0, '69.294')] [2024-08-06 03:13:28,124][52794] DAMAGECOUNT value on done: 387844.0 [2024-08-06 03:13:28,125][52794] Sum rewards: 68.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.358', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon4': '0.074', 'weapon5': '0.114', 'AMMO4': '0.129', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:28,336][52650] Updated weights for policy 0, policy_version 44121 (0.0021) [2024-08-06 03:13:28,591][52660] DAMAGECOUNT value on done: 385453.0 [2024-08-06 03:13:28,593][52660] Sum rewards: 73.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.882', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.172', 'weapon5': '0.182', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.700', 'weapon3': '3.076', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '63.000'} [2024-08-06 03:13:28,824][52647] DAMAGECOUNT value on done: 413248.0 [2024-08-06 03:13:28,825][52647] Sum rewards: 72.848, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.308', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.192', 'weapon2': '0.202', 'AMMO3': '0.255', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.012', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:28,882][52649] DAMAGECOUNT value on done: 380869.0 [2024-08-06 03:13:28,885][52649] Sum rewards: 65.464, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon4': '0.098', 'AMMO4': '0.188', 'weapon5': '0.192', 'AMMO3': '0.239', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:29,279][52658] DAMAGECOUNT value on done: 384796.0 [2024-08-06 03:13:29,279][52658] Sum rewards: 84.379, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.787', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.434', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '69.000'} [2024-08-06 03:13:29,867][52671] DAMAGECOUNT value on done: 384954.0 [2024-08-06 03:13:29,868][52671] Sum rewards: 72.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.630', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.192', 'AMMO4': '0.198', 'weapon5': '0.214', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:30,752][52820] DAMAGECOUNT value on done: 357051.0 [2024-08-06 03:13:30,755][52820] Sum rewards: 69.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.076', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.424', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:31,262][52647] DAMAGECOUNT value on done: 404497.0 [2024-08-06 03:13:31,263][52647] Sum rewards: 75.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.972', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.114', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.372', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '64.000'} [2024-08-06 03:13:31,341][52794] DAMAGECOUNT value on done: 383529.0 [2024-08-06 03:13:31,342][52794] Sum rewards: 74.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.102', 'AMMO3': '0.199', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '62.500'} [2024-08-06 03:13:31,444][52660] DAMAGECOUNT value on done: 380109.0 [2024-08-06 03:13:31,445][52660] Sum rewards: 77.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon2': '0.158', 'AMMO3': '0.201', 'weapon5': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '63.000'} [2024-08-06 03:13:32,036][52649] DAMAGECOUNT value on done: 379454.0 [2024-08-06 03:13:32,044][52649] Sum rewards: 62.322, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.765', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.036', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.204', 'WEAPON3': '0.950', 'HITCOUNT': '2.930', 'weapon3': '3.352', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '49.000'} [2024-08-06 03:13:32,206][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:13:32,441][52658] DAMAGECOUNT value on done: 387317.0 [2024-08-06 03:13:32,441][52658] Sum rewards: 58.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.674', 'AMMO5': '0.016', 'AMMO2': '0.023', 'weapon4': '0.028', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon5': '0.226', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '51.000'} [2024-08-06 03:13:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 361512960. Throughput: 0: 4367.8. Samples: 90378210. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:13:32,794][52567] Avg episode reward: [(0, '69.234')] [2024-08-06 03:13:32,804][52671] DAMAGECOUNT value on done: 396652.0 [2024-08-06 03:13:32,805][52671] Sum rewards: 54.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.146', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.175', 'weapon5': '0.228', 'AMMO4': '0.245', 'weapon4': '0.256', 'weapon2': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.470', 'weapon3': '2.942', 'DAMAGECOUNT': '13.383', 'FRAGCOUNT': '45.000'} [2024-08-06 03:13:32,897][52650] Updated weights for policy 0, policy_version 44131 (0.0022) [2024-08-06 03:13:33,822][52820] DAMAGECOUNT value on done: 354763.0 [2024-08-06 03:13:33,822][52820] Sum rewards: 62.998, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.082', 'AMMO3': '0.148', 'weapon4': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.052', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '51.000'} [2024-08-06 03:13:33,876][52647] DAMAGECOUNT value on done: 408677.0 [2024-08-06 03:13:33,877][52647] Sum rewards: 51.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.076', 'AMMO5': '0.016', 'AMMO2': '0.063', 'AMMO3': '0.135', 'weapon5': '0.240', 'AMMO4': '0.317', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '0.800', 'weapon3': '2.550', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '42.000'} [2024-08-06 03:13:34,285][52660] DAMAGECOUNT value on done: 387314.0 [2024-08-06 03:13:34,286][52660] Sum rewards: 57.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.520', 'AMMO5': '0.026', 'AMMO2': '0.076', 'weapon5': '0.166', 'weapon4': '0.196', 'AMMO3': '0.225', 'AMMO4': '0.381', 'weapon2': '0.414', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '2.914', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '51.000'} [2024-08-06 03:13:34,336][52794] DAMAGECOUNT value on done: 390374.0 [2024-08-06 03:13:34,338][52794] Sum rewards: 69.169, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.116', 'AMMO4': '0.174', 'weapon5': '0.176', 'weapon2': '0.236', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.174', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:34,943][52649] DAMAGECOUNT value on done: 372064.0 [2024-08-06 03:13:34,943][52649] Sum rewards: 70.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.755', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.216', 'weapon5': '0.230', 'weapon4': '0.364', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.610', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:35,565][52658] DAMAGECOUNT value on done: 390403.0 [2024-08-06 03:13:35,565][52658] Sum rewards: 74.373, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.380', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.066', 'weapon4': '0.130', 'AMMO3': '0.133', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.590', 'WEAPON3': '0.800', 'weapon3': '3.048', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:35,641][52671] DAMAGECOUNT value on done: 386772.0 [2024-08-06 03:13:35,641][52671] Sum rewards: 80.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.576', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.126', 'AMMO4': '0.127', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '66.000'} [2024-08-06 03:13:36,665][52647] DAMAGECOUNT value on done: 400734.0 [2024-08-06 03:13:36,666][52647] Sum rewards: 68.930, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.032', 'HEALTH': '0.057', 'weapon5': '0.132', 'weapon4': '0.134', 'AMMO4': '0.160', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.000', 'weapon3': '2.982', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '54.000'} [2024-08-06 03:13:37,008][52820] DAMAGECOUNT value on done: 365044.0 [2024-08-06 03:13:37,008][52820] Sum rewards: 73.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.108', 'AMMO4': '0.129', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:37,016][52660] DAMAGECOUNT value on done: 381824.0 [2024-08-06 03:13:37,016][52660] Sum rewards: 70.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.715', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.100', 'weapon5': '0.146', 'AMMO4': '0.212', 'AMMO3': '0.212', 'weapon2': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.298', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:37,174][52794] DAMAGECOUNT value on done: 379924.0 [2024-08-06 03:13:37,175][52794] Sum rewards: 75.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.092', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.468', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:37,713][52650] Updated weights for policy 0, policy_version 44141 (0.0027) [2024-08-06 03:13:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 361603072. Throughput: 0: 4373.8. Samples: 90404760. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 03:13:37,795][52567] Avg episode reward: [(0, '69.031')] [2024-08-06 03:13:38,025][52649] DAMAGECOUNT value on done: 378180.0 [2024-08-06 03:13:38,027][52649] Sum rewards: 63.937, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.198', 'AMMO3': '0.237', 'AMMO4': '0.260', 'weapon5': '0.316', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.696', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:38,319][52671] DAMAGECOUNT value on done: 379703.0 [2024-08-06 03:13:38,321][52671] Sum rewards: 85.119, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.102', 'AMMO4': '0.108', 'weapon5': '0.174', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '68.000'} [2024-08-06 03:13:38,674][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:13:39,203][52647] DAMAGECOUNT value on done: 403820.0 [2024-08-06 03:13:39,203][52647] Sum rewards: 68.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '55.000'} [2024-08-06 03:13:39,931][52794] DAMAGECOUNT value on done: 396784.0 [2024-08-06 03:13:39,932][52794] Sum rewards: 63.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.409', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.164', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '53.500'} [2024-08-06 03:13:40,167][52820] DAMAGECOUNT value on done: 367684.0 [2024-08-06 03:13:40,169][52820] Sum rewards: 76.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.043', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '64.000'} [2024-08-06 03:13:41,015][52649] DAMAGECOUNT value on done: 374402.0 [2024-08-06 03:13:41,016][52649] Sum rewards: 71.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.526', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.199', 'weapon2': '0.246', 'WEAPON3': '1.150', 'HITCOUNT': '3.340', 'weapon3': '3.384', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:41,522][52671] DAMAGECOUNT value on done: 393829.0 [2024-08-06 03:13:41,524][52671] Sum rewards: 65.203, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.432', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon4': '0.170', 'weapon5': '0.178', 'AMMO3': '0.270', 'AMMO4': '0.285', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.060', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:41,814][52647] DAMAGECOUNT value on done: 404373.0 [2024-08-06 03:13:41,816][52647] Sum rewards: 69.772, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.142', 'weapon5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.267', 'AMMO4': '0.321', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '60.000'} [2024-08-06 03:13:42,050][52650] Updated weights for policy 0, policy_version 44151 (0.0030) [2024-08-06 03:13:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 361693184. Throughput: 0: 4373.1. Samples: 90431080. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 03:13:42,794][52567] Avg episode reward: [(0, '69.049')] [2024-08-06 03:13:43,123][52794] DAMAGECOUNT value on done: 379638.0 [2024-08-06 03:13:43,125][52794] Sum rewards: 71.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:43,330][52820] DAMAGECOUNT value on done: 354775.0 [2024-08-06 03:13:43,330][52820] Sum rewards: 62.992, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.266', 'weapon2': '0.420', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '3.098', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '52.000'} [2024-08-06 03:13:43,843][52649] DAMAGECOUNT value on done: 381100.0 [2024-08-06 03:13:43,845][52649] Sum rewards: 60.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.399', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.128', 'AMMO4': '0.165', 'weapon5': '0.166', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '50.000'} [2024-08-06 03:13:44,478][52671] DAMAGECOUNT value on done: 392905.0 [2024-08-06 03:13:44,479][52671] Sum rewards: 63.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.128', 'AMMO3': '0.145', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon2': '0.546', 'WEAPON3': '0.900', 'weapon3': '2.772', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '50.000'} [2024-08-06 03:13:44,997][52647] DAMAGECOUNT value on done: 412790.0 [2024-08-06 03:13:44,998][52647] Sum rewards: 71.269, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.044', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.090', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.342', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:46,087][52794] DAMAGECOUNT value on done: 396449.0 [2024-08-06 03:13:46,088][52794] Sum rewards: 79.341, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.955', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.110', 'weapon4': '0.128', 'AMMO3': '0.145', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '0.950', 'weapon3': '3.222', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '63.000'} [2024-08-06 03:13:46,760][52649] DAMAGECOUNT value on done: 383364.0 [2024-08-06 03:13:46,761][52649] Sum rewards: 76.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.070', 'AMMO4': '0.141', 'AMMO3': '0.166', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:47,070][52671] DAMAGECOUNT value on done: 394392.0 [2024-08-06 03:13:47,072][52671] Sum rewards: 71.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.008', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.192', 'weapon4': '0.238', 'weapon5': '0.284', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '57.000'} [2024-08-06 03:13:47,167][52650] Updated weights for policy 0, policy_version 44161 (0.0012) [2024-08-06 03:13:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 361783296. Throughput: 0: 4374.7. Samples: 90444070. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 03:13:47,794][52567] Avg episode reward: [(0, '69.008')] [2024-08-06 03:13:47,849][52647] DAMAGECOUNT value on done: 402974.0 [2024-08-06 03:13:47,850][52647] Sum rewards: 64.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.162', 'weapon4': '0.168', 'weapon5': '0.170', 'AMMO4': '0.287', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '53.000'} [2024-08-06 03:13:48,903][52794] DAMAGECOUNT value on done: 388649.0 [2024-08-06 03:13:48,903][52794] Sum rewards: 65.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.184', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:49,951][52671] DAMAGECOUNT value on done: 389435.0 [2024-08-06 03:13:49,957][52671] Sum rewards: 69.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.691', 'AMMO5': '0.035', 'AMMO2': '0.064', 'AMMO3': '0.171', 'weapon4': '0.244', 'AMMO4': '0.321', 'weapon5': '0.416', 'weapon2': '0.566', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.430', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:49,978][52649] DAMAGECOUNT value on done: 380423.0 [2024-08-06 03:13:49,979][52649] Sum rewards: 69.269, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.150', 'HITCOUNT': '3.360', 'weapon3': '3.376', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:50,512][52647] DAMAGECOUNT value on done: 401926.0 [2024-08-06 03:13:50,514][52647] Sum rewards: 68.119, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.060', 'weapon7': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.312', 'weapon2': '0.480', 'WEAPON3': '1.800', 'weapon3': '3.130', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '61.000'} [2024-08-06 03:13:51,489][52650] Updated weights for policy 0, policy_version 44171 (0.0013) [2024-08-06 03:13:51,948][52794] DAMAGECOUNT value on done: 390284.0 [2024-08-06 03:13:51,949][52794] Sum rewards: 80.951, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.394', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '68.500'} [2024-08-06 03:13:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 361865216. Throughput: 0: 4379.8. Samples: 90470350. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 03:13:52,794][52567] Avg episode reward: [(0, '69.221')] [2024-08-06 03:13:52,939][52647] DAMAGECOUNT value on done: 401389.0 [2024-08-06 03:13:52,940][52647] Sum rewards: 69.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.154', 'weapon4': '0.162', 'AMMO4': '0.176', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.000'} [2024-08-06 03:13:53,196][52671] DAMAGECOUNT value on done: 386801.0 [2024-08-06 03:13:53,197][52671] Sum rewards: 63.060, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.892', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.159', 'AMMO4': '0.161', 'weapon5': '0.194', 'weapon4': '0.234', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '47.500'} [2024-08-06 03:13:53,203][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:13:54,825][52794] DAMAGECOUNT value on done: 399232.0 [2024-08-06 03:13:54,829][52794] Sum rewards: 78.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.297', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.072', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.422', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '64.000'} [2024-08-06 03:13:55,435][52647] DAMAGECOUNT value on done: 399907.0 [2024-08-06 03:13:55,436][52647] Sum rewards: 76.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.070', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.668', 'WEAPON3': '1.050', 'weapon3': '2.932', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '64.000'} [2024-08-06 03:13:55,527][52659] DAMAGECOUNT value on done: 389664.0 [2024-08-06 03:13:55,530][52659] Sum rewards: 67.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.614', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.350', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '56.000'} [2024-08-06 03:13:56,255][52650] Updated weights for policy 0, policy_version 44181 (0.0020) [2024-08-06 03:13:56,571][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:13:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 361955328. Throughput: 0: 4375.6. Samples: 90496580. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 03:13:57,794][52567] Avg episode reward: [(0, '69.175')] [2024-08-06 03:13:57,800][52647] DAMAGECOUNT value on done: 404939.0 [2024-08-06 03:13:57,803][52647] Sum rewards: 74.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '62.000'} [2024-08-06 03:13:58,030][52794] DAMAGECOUNT value on done: 387747.0 [2024-08-06 03:13:58,034][52794] Sum rewards: 72.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.312', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.181', 'AMMO4': '0.250', 'weapon5': '0.294', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon4': '0.570', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '59.000'} [2024-08-06 03:13:58,062][52659] DAMAGECOUNT value on done: 388712.0 [2024-08-06 03:13:58,062][52659] Sum rewards: 80.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.190', 'AMMO3': '0.208', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '66.000'} [2024-08-06 03:14:01,020][52650] Updated weights for policy 0, policy_version 44191 (0.0013) [2024-08-06 03:14:01,149][52659] DAMAGECOUNT value on done: 388085.0 [2024-08-06 03:14:01,152][52659] Sum rewards: 67.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.075', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.202', 'weapon2': '0.222', 'weapon5': '0.228', 'AMMO4': '0.244', 'AMMO3': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '57.000'} [2024-08-06 03:14:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 362037248. Throughput: 0: 4376.2. Samples: 90509790. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 03:14:02,802][52567] Avg episode reward: [(0, '69.452')] [2024-08-06 03:14:04,296][52659] DAMAGECOUNT value on done: 386576.0 [2024-08-06 03:14:04,298][52659] Sum rewards: 61.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.155', 'weapon2': '0.204', 'weapon5': '0.266', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'weapon4': '0.808', 'WEAPON3': '0.900', 'weapon3': '2.242', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '49.000'} [2024-08-06 03:14:05,644][52650] Updated weights for policy 0, policy_version 44201 (0.0032) [2024-08-06 03:14:05,953][52794] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:14:07,228][52659] DAMAGECOUNT value on done: 384878.0 [2024-08-06 03:14:07,229][52659] Sum rewards: 73.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.258', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 362127360. Throughput: 0: 4369.3. Samples: 90535580. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:14:07,794][52567] Avg episode reward: [(0, '69.477')] [2024-08-06 03:14:09,239][52666] DAMAGECOUNT value on done: 386346.0 [2024-08-06 03:14:09,241][52666] Sum rewards: 70.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.418', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '60.000'} [2024-08-06 03:14:10,030][52659] DAMAGECOUNT value on done: 387556.0 [2024-08-06 03:14:10,031][52659] Sum rewards: 70.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.594', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.042', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '57.000'} [2024-08-06 03:14:10,453][52650] Updated weights for policy 0, policy_version 44211 (0.0018) [2024-08-06 03:14:12,068][52666] DAMAGECOUNT value on done: 391874.0 [2024-08-06 03:14:12,069][52666] Sum rewards: 69.238, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.180', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.140', 'AMMO4': '0.174', 'weapon2': '0.232', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.310', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '59.000'} [2024-08-06 03:14:12,678][52659] DAMAGECOUNT value on done: 387680.0 [2024-08-06 03:14:12,678][52659] Sum rewards: 63.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.420', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '53.000'} [2024-08-06 03:14:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 362209280. Throughput: 0: 4359.1. Samples: 90561570. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:14:12,794][52567] Avg episode reward: [(0, '69.503')] [2024-08-06 03:14:14,651][52670] DAMAGECOUNT value on done: 382420.0 [2024-08-06 03:14:14,651][52670] Sum rewards: 67.840, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.168', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.044', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.241', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.370', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.000'} [2024-08-06 03:14:14,740][52666] DAMAGECOUNT value on done: 390825.0 [2024-08-06 03:14:14,742][52666] Sum rewards: 54.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.556', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.104', 'weapon2': '0.198', 'weapon5': '0.208', 'AMMO3': '0.222', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.530', 'weapon3': '3.244', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '46.000'} [2024-08-06 03:14:15,287][52650] Updated weights for policy 0, policy_version 44221 (0.0036) [2024-08-06 03:14:15,521][52659] DAMAGECOUNT value on done: 385869.0 [2024-08-06 03:14:15,521][52659] Sum rewards: 67.308, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.904', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.160', 'weapon4': '0.182', 'weapon2': '0.188', 'AMMO4': '0.244', 'AMMO3': '0.255', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '58.000'} [2024-08-06 03:14:16,980][52663] DAMAGECOUNT value on done: 392138.0 [2024-08-06 03:14:16,980][52663] Sum rewards: 71.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.624', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.222', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 03:14:17,357][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:14:17,574][52670] DAMAGECOUNT value on done: 387264.0 [2024-08-06 03:14:17,576][52670] Sum rewards: 76.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.961', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon2': '0.206', 'AMMO3': '0.212', 'weapon5': '0.228', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:17,663][52666] DAMAGECOUNT value on done: 388875.0 [2024-08-06 03:14:17,664][52666] Sum rewards: 77.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.600', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.158', 'AMMO4': '0.165', 'AMMO3': '0.182', 'weapon4': '0.276', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 362299392. Throughput: 0: 4366.9. Samples: 90574720. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:14:17,795][52567] Avg episode reward: [(0, '69.640')] [2024-08-06 03:14:18,273][52659] DAMAGECOUNT value on done: 394816.0 [2024-08-06 03:14:18,274][52659] Sum rewards: 76.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'weapon4': '0.108', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.380', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '62.000'} [2024-08-06 03:14:19,650][52663] DAMAGECOUNT value on done: 386718.0 [2024-08-06 03:14:19,650][52663] Sum rewards: 75.981, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.490', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '59.500'} [2024-08-06 03:14:19,910][52650] Updated weights for policy 0, policy_version 44231 (0.0016) [2024-08-06 03:14:20,504][52670] DAMAGECOUNT value on done: 379884.0 [2024-08-06 03:14:20,504][52670] Sum rewards: 80.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.236', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'weapon5': '0.138', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.650', 'weapon3': '3.328', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '69.000'} [2024-08-06 03:14:20,584][52666] DAMAGECOUNT value on done: 386053.0 [2024-08-06 03:14:20,586][52666] Sum rewards: 84.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.964', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon4': '0.086', 'weapon5': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '69.000'} [2024-08-06 03:14:20,919][52659] DAMAGECOUNT value on done: 396258.0 [2024-08-06 03:14:20,919][52659] Sum rewards: 76.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.096', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.144', 'AMMO4': '0.148', 'weapon2': '0.192', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.312', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '65.000'} [2024-08-06 03:14:21,565][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:14:22,795][52567] Fps is (10 sec: 18020.3, 60 sec: 17612.5, 300 sec: 17466.9). Total num frames: 362389504. Throughput: 0: 4356.3. Samples: 90600800. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:14:22,803][52567] Avg episode reward: [(0, '69.938')] [2024-08-06 03:14:22,819][52663] DAMAGECOUNT value on done: 383076.0 [2024-08-06 03:14:22,820][52663] Sum rewards: 72.325, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon2': '0.112', 'AMMO3': '0.210', 'HEALTH': '0.316', 'WEAPON3': '1.150', 'HITCOUNT': '3.340', 'weapon3': '3.762', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '59.000'} [2024-08-06 03:14:23,488][52670] DAMAGECOUNT value on done: 379031.0 [2024-08-06 03:14:23,488][52670] Sum rewards: 82.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.024', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '69.000'} [2024-08-06 03:14:23,575][52666] DAMAGECOUNT value on done: 379403.0 [2024-08-06 03:14:23,576][52666] Sum rewards: 56.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.124', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.221', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '48.000'} [2024-08-06 03:14:23,900][52659] DAMAGECOUNT value on done: 389078.0 [2024-08-06 03:14:23,900][52659] Sum rewards: 77.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.982', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.189', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:24,278][52650] Updated weights for policy 0, policy_version 44241 (0.0017) [2024-08-06 03:14:25,627][52647] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:14:26,118][52663] DAMAGECOUNT value on done: 389060.0 [2024-08-06 03:14:26,119][52663] Sum rewards: 65.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.479', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.134', 'weapon4': '0.140', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '56.000'} [2024-08-06 03:14:26,465][52659] DAMAGECOUNT value on done: 391040.0 [2024-08-06 03:14:26,465][52659] Sum rewards: 70.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.042', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.112', 'weapon4': '0.114', 'AMMO4': '0.176', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '59.000'} [2024-08-06 03:14:26,479][52670] DAMAGECOUNT value on done: 389125.0 [2024-08-06 03:14:26,479][52670] Sum rewards: 70.066, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.192', 'WEAPON5': '0.250', 'AMMO4': '0.254', 'weapon4': '0.254', 'AMMO3': '0.271', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.922', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '60.000'} [2024-08-06 03:14:26,693][52666] DAMAGECOUNT value on done: 387228.0 [2024-08-06 03:14:26,693][52666] Sum rewards: 60.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.694', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.199', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.368', 'weapon4': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.750', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '49.500'} [2024-08-06 03:14:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 362471424. Throughput: 0: 4357.1. Samples: 90627150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:14:27,794][52567] Avg episode reward: [(0, '69.861')] [2024-08-06 03:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000044247_362471424.pth... [2024-08-06 03:14:27,942][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043736_358285312.pth [2024-08-06 03:14:28,985][52659] DAMAGECOUNT value on done: 379586.0 [2024-08-06 03:14:28,985][52659] Sum rewards: 72.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.915', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.118', 'weapon5': '0.128', 'AMMO4': '0.175', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '61.000'} [2024-08-06 03:14:29,285][52650] Updated weights for policy 0, policy_version 44251 (0.0038) [2024-08-06 03:14:29,412][52663] DAMAGECOUNT value on done: 385336.0 [2024-08-06 03:14:29,413][52663] Sum rewards: 77.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.696', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.154', 'weapon5': '0.168', 'AMMO4': '0.198', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '64.000'} [2024-08-06 03:14:29,647][52670] DAMAGECOUNT value on done: 381706.0 [2024-08-06 03:14:29,650][52670] Sum rewards: 63.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.562', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon2': '0.206', 'AMMO3': '0.238', 'WEAPON4': '0.450', 'weapon4': '0.498', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '53.000'} [2024-08-06 03:14:29,812][52666] DAMAGECOUNT value on done: 386340.0 [2024-08-06 03:14:29,813][52666] Sum rewards: 57.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'AMMO5': '0.021', 'AMMO2': '0.059', 'AMMO3': '0.177', 'weapon2': '0.196', 'weapon4': '0.240', 'weapon5': '0.272', 'AMMO4': '0.295', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '3.014', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '46.000'} [2024-08-06 03:14:30,868][52666] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:14:31,339][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:14:31,639][52659] DAMAGECOUNT value on done: 386625.0 [2024-08-06 03:14:31,640][52659] Sum rewards: 77.546, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.004', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.544', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '64.000'} [2024-08-06 03:14:32,151][52663] DAMAGECOUNT value on done: 389721.0 [2024-08-06 03:14:32,151][52663] Sum rewards: 75.251, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.844', 'AMMO5': '0.015', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '64.000'} [2024-08-06 03:14:32,318][52670] DAMAGECOUNT value on done: 378553.0 [2024-08-06 03:14:32,318][52670] Sum rewards: 84.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.112', 'AMMO4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.460', 'weapon3': '3.478', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '69.000'} [2024-08-06 03:14:32,562][52666] DAMAGECOUNT value on done: 383059.0 [2024-08-06 03:14:32,563][52666] Sum rewards: 67.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.719', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.162', 'weapon5': '0.188', 'AMMO4': '0.301', 'weapon2': '0.342', 'weapon4': '0.412', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.806', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '54.500'} [2024-08-06 03:14:32,794][52567] Fps is (10 sec: 17205.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 362561536. Throughput: 0: 4350.9. Samples: 90639860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:14:32,794][52567] Avg episode reward: [(0, '70.181')] [2024-08-06 03:14:34,139][52650] Updated weights for policy 0, policy_version 44261 (0.0041) [2024-08-06 03:14:34,906][52659] DAMAGECOUNT value on done: 396484.0 [2024-08-06 03:14:34,908][52659] Sum rewards: 65.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.979', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.188', 'AMMO3': '0.204', 'weapon2': '0.226', 'weapon5': '0.300', 'AMMO4': '0.301', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.020', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '54.000'} [2024-08-06 03:14:35,117][52670] DAMAGECOUNT value on done: 380373.0 [2024-08-06 03:14:35,119][52670] Sum rewards: 65.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.226', 'weapon2': '0.244', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.562', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '56.000'} [2024-08-06 03:14:35,206][52663] DAMAGECOUNT value on done: 387279.0 [2024-08-06 03:14:35,208][52663] Sum rewards: 70.665, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.026', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon4': '0.330', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '55.000'} [2024-08-06 03:14:35,429][52666] DAMAGECOUNT value on done: 380148.0 [2024-08-06 03:14:35,430][52666] Sum rewards: 73.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.133', 'weapon4': '0.146', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '3.088', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 03:14:37,694][52659] DAMAGECOUNT value on done: 393677.0 [2024-08-06 03:14:37,694][52659] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.392', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.212', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '62.000'} [2024-08-06 03:14:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 362651648. Throughput: 0: 4346.9. Samples: 90665960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:14:37,794][52567] Avg episode reward: [(0, '70.144')] [2024-08-06 03:14:38,134][52670] DAMAGECOUNT value on done: 383739.0 [2024-08-06 03:14:38,140][52670] Sum rewards: 68.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.080', 'weapon4': '0.094', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.440', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 03:14:38,352][52666] DAMAGECOUNT value on done: 383595.0 [2024-08-06 03:14:38,362][52666] Sum rewards: 69.497, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.024', 'AMMO2': '0.080', 'weapon5': '0.230', 'AMMO3': '0.235', 'AMMO4': '0.400', 'weapon4': '0.420', 'weapon2': '0.440', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.518', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '60.000'} [2024-08-06 03:14:38,471][52650] Updated weights for policy 0, policy_version 44271 (0.0012) [2024-08-06 03:14:38,494][52663] DAMAGECOUNT value on done: 384361.0 [2024-08-06 03:14:38,495][52663] Sum rewards: 62.997, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.742', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.098', 'weapon5': '0.148', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.295', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'HITCOUNT': '3.160', 'weapon3': '3.304', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '57.000'} [2024-08-06 03:14:40,449][52659] DAMAGECOUNT value on done: 393982.0 [2024-08-06 03:14:40,451][52659] Sum rewards: 89.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.241', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.249', 'weapon2': '0.604', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.811', 'FRAGCOUNT': '74.000'} [2024-08-06 03:14:41,093][52670] DAMAGECOUNT value on done: 377617.0 [2024-08-06 03:14:41,093][52670] Sum rewards: 81.034, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.144', 'weapon5': '0.144', 'AMMO3': '0.168', 'AMMO4': '0.169', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.336', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '65.000'} [2024-08-06 03:14:41,227][52666] DAMAGECOUNT value on done: 382558.0 [2024-08-06 03:14:41,230][52666] Sum rewards: 82.909, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.308', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.110', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.262', 'WEAPON3': '1.650', 'weapon3': '3.366', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.889', 'FRAGCOUNT': '71.000'} [2024-08-06 03:14:41,403][52663] DAMAGECOUNT value on done: 383819.0 [2024-08-06 03:14:41,405][52663] Sum rewards: 72.705, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.307', 'weapon4': '0.364', 'WEAPON3': '1.750', 'weapon3': '3.128', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 362733568. Throughput: 0: 4352.4. Samples: 90692440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:14:42,794][52567] Avg episode reward: [(0, '70.793')] [2024-08-06 03:14:43,453][52650] Updated weights for policy 0, policy_version 44281 (0.0011) [2024-08-06 03:14:43,615][52659] DAMAGECOUNT value on done: 386366.0 [2024-08-06 03:14:43,615][52659] Sum rewards: 73.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.683', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.137', 'weapon5': '0.140', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '60.000'} [2024-08-06 03:14:43,831][52670] DAMAGECOUNT value on done: 389154.0 [2024-08-06 03:14:43,831][52670] Sum rewards: 66.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.094', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.254', 'weapon4': '0.336', 'weapon2': '0.376', 'WEAPON3': '0.950', 'weapon3': '2.802', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '54.000'} [2024-08-06 03:14:44,068][52666] DAMAGECOUNT value on done: 391355.0 [2024-08-06 03:14:44,068][52666] Sum rewards: 66.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.185', 'weapon5': '0.192', 'AMMO4': '0.218', 'weapon2': '0.232', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '55.000'} [2024-08-06 03:14:44,474][52663] DAMAGECOUNT value on done: 389208.0 [2024-08-06 03:14:44,477][52663] Sum rewards: 75.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.043', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.174', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.298', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '62.000'} [2024-08-06 03:14:46,413][52659] DAMAGECOUNT value on done: 393637.0 [2024-08-06 03:14:46,421][52659] Sum rewards: 60.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.866', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.256', 'weapon4': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '3.032', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '51.000'} [2024-08-06 03:14:47,205][52670] DAMAGECOUNT value on done: 381180.0 [2024-08-06 03:14:47,206][52670] Sum rewards: 66.550, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.517', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.134', 'AMMO3': '0.141', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.562', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '55.000'} [2024-08-06 03:14:47,322][52663] DAMAGECOUNT value on done: 391940.0 [2024-08-06 03:14:47,322][52663] Sum rewards: 71.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.128', 'AMMO4': '0.133', 'weapon5': '0.144', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '59.000'} [2024-08-06 03:14:47,408][52666] DAMAGECOUNT value on done: 386617.0 [2024-08-06 03:14:47,409][52666] Sum rewards: 72.102, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.266', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.198', 'weapon2': '0.226', 'AMMO4': '0.250', 'AMMO3': '0.279', 'weapon4': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.890', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '62.000'} [2024-08-06 03:14:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 362823680. Throughput: 0: 4349.5. Samples: 90705520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:14:47,795][52567] Avg episode reward: [(0, '70.506')] [2024-08-06 03:14:48,136][52650] Updated weights for policy 0, policy_version 44291 (0.0019) [2024-08-06 03:14:48,750][52803] DAMAGECOUNT value on done: 363800.0 [2024-08-06 03:14:48,752][52803] Sum rewards: 80.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.857', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.146', 'weapon4': '0.180', 'weapon2': '0.220', 'AMMO3': '0.230', 'AMMO4': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '67.000'} [2024-08-06 03:14:49,632][52659] DAMAGECOUNT value on done: 392154.0 [2024-08-06 03:14:49,636][52659] Sum rewards: 68.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.070', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.152', 'weapon2': '0.168', 'AMMO4': '0.172', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.390', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '56.000'} [2024-08-06 03:14:49,657][52811] DAMAGECOUNT value on done: 373809.0 [2024-08-06 03:14:49,658][52811] Sum rewards: 70.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.328', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.115', 'weapon2': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '60.000'} [2024-08-06 03:14:49,976][52663] DAMAGECOUNT value on done: 388659.0 [2024-08-06 03:14:49,977][52663] Sum rewards: 63.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '53.000'} [2024-08-06 03:14:50,355][52670] DAMAGECOUNT value on done: 383516.0 [2024-08-06 03:14:50,355][52670] Sum rewards: 69.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.412', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.066', 'AMMO3': '0.203', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '60.000'} [2024-08-06 03:14:50,573][52666] DAMAGECOUNT value on done: 382667.0 [2024-08-06 03:14:50,573][52666] Sum rewards: 59.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.118', 'AMMO4': '0.124', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '2.904', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '50.000'} [2024-08-06 03:14:51,793][52803] DAMAGECOUNT value on done: 359936.0 [2024-08-06 03:14:51,793][52803] Sum rewards: 68.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.467', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.098', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.818', 'WEAPON3': '1.100', 'weapon3': '2.836', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 03:14:52,683][52650] Updated weights for policy 0, policy_version 44301 (0.0013) [2024-08-06 03:14:52,782][52811] DAMAGECOUNT value on done: 360648.0 [2024-08-06 03:14:52,782][52811] Sum rewards: 67.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.096', 'AMMO2': '0.014', 'AMMO5': '0.016', 'weapon4': '0.016', 'AMMO4': '0.071', 'weapon5': '0.132', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '0.950', 'HITCOUNT': '3.170', 'weapon3': '3.224', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '53.000'} [2024-08-06 03:14:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 362913792. Throughput: 0: 4359.8. Samples: 90731770. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:14:52,794][52567] Avg episode reward: [(0, '70.896')] [2024-08-06 03:14:52,799][52663] DAMAGECOUNT value on done: 382814.0 [2024-08-06 03:14:52,800][52663] Sum rewards: 73.071, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.690', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.118', 'AMMO3': '0.231', 'weapon5': '0.236', 'AMMO4': '0.272', 'weapon2': '0.290', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:53,204][52670] DAMAGECOUNT value on done: 390220.0 [2024-08-06 03:14:53,204][52670] Sum rewards: 79.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.147', 'weapon5': '0.154', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '66.000'} [2024-08-06 03:14:53,327][52666] DAMAGECOUNT value on done: 385314.0 [2024-08-06 03:14:53,327][52666] Sum rewards: 65.717, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.300', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.152', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.382', 'weapon2': '0.632', 'WEAPON3': '0.900', 'weapon3': '2.586', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.500'} [2024-08-06 03:14:54,750][52803] DAMAGECOUNT value on done: 365345.0 [2024-08-06 03:14:54,754][52803] Sum rewards: 80.016, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.086', 'weapon4': '0.150', 'AMMO4': '0.202', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '67.000'} [2024-08-06 03:14:55,563][52663] DAMAGECOUNT value on done: 383794.0 [2024-08-06 03:14:55,565][52663] Sum rewards: 66.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.796', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '55.000'} [2024-08-06 03:14:55,928][52811] DAMAGECOUNT value on done: 360755.0 [2024-08-06 03:14:55,930][52811] Sum rewards: 72.676, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.712', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO4': '0.197', 'weapon4': '0.234', 'AMMO3': '0.241', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '62.000'} [2024-08-06 03:14:56,025][52670] DAMAGECOUNT value on done: 386690.0 [2024-08-06 03:14:56,025][52670] Sum rewards: 64.131, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.030', 'weapon4': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.151', 'weapon5': '0.170', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.138', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '51.000'} [2024-08-06 03:14:56,164][52666] DAMAGECOUNT value on done: 385295.0 [2024-08-06 03:14:56,165][52666] Sum rewards: 76.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.696', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon4': '0.034', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.666', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:56,293][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:14:56,619][52667] DAMAGECOUNT value on done: 386727.0 [2024-08-06 03:14:56,620][52667] Sum rewards: 68.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.157', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon5': '0.328', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.300', 'HITCOUNT': '2.760', 'weapon3': '2.834', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '55.000'} [2024-08-06 03:14:57,643][52650] Updated weights for policy 0, policy_version 44311 (0.0014) [2024-08-06 03:14:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.2). Total num frames: 362995712. Throughput: 0: 4360.2. Samples: 90757780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:14:57,794][52567] Avg episode reward: [(0, '71.006')] [2024-08-06 03:14:57,857][52803] DAMAGECOUNT value on done: 366775.0 [2024-08-06 03:14:57,857][52803] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.106', 'AMMO4': '0.146', 'weapon5': '0.166', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '59.000'} [2024-08-06 03:14:57,874][52614] Saving new best policy, reward=71.006! [2024-08-06 03:14:58,684][52670] DAMAGECOUNT value on done: 371362.0 [2024-08-06 03:14:58,687][52670] Sum rewards: 71.944, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.960', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.132', 'weapon4': '0.148', 'AMMO4': '0.223', 'AMMO3': '0.273', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '63.000'} [2024-08-06 03:14:58,856][52663] DAMAGECOUNT value on done: 383657.0 [2024-08-06 03:14:58,857][52663] Sum rewards: 74.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.110', 'AMMO5': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.038', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.342', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '61.000'} [2024-08-06 03:14:58,924][52666] DAMAGECOUNT value on done: 386450.0 [2024-08-06 03:14:58,924][52666] Sum rewards: 67.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.701', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.080', 'AMMO4': '0.107', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.412', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.170', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '56.000'} [2024-08-06 03:14:58,985][52811] DAMAGECOUNT value on done: 361131.0 [2024-08-06 03:14:58,986][52811] Sum rewards: 62.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '52.000'} [2024-08-06 03:14:59,418][52667] DAMAGECOUNT value on done: 394154.0 [2024-08-06 03:14:59,418][52667] Sum rewards: 79.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.368', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.102', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.218', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.296', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '67.000'} [2024-08-06 03:15:00,984][52803] DAMAGECOUNT value on done: 368261.0 [2024-08-06 03:15:00,985][52803] Sum rewards: 74.683, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.080', 'weapon4': '0.112', 'AMMO4': '0.147', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '61.000'} [2024-08-06 03:15:01,704][52670] DAMAGECOUNT value on done: 384923.0 [2024-08-06 03:15:01,705][52670] Sum rewards: 55.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.635', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.008', 'weapon4': '0.016', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.496', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '3.322', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '48.000'} [2024-08-06 03:15:01,852][52666] DAMAGECOUNT value on done: 376964.0 [2024-08-06 03:15:01,852][52666] Sum rewards: 74.329, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.679', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.245', 'weapon4': '0.270', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '65.000'} [2024-08-06 03:15:01,867][52663] DAMAGECOUNT value on done: 394288.0 [2024-08-06 03:15:01,869][52663] Sum rewards: 69.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.236', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:02,110][52650] Updated weights for policy 0, policy_version 44321 (0.0043) [2024-08-06 03:15:02,191][52811] DAMAGECOUNT value on done: 364385.0 [2024-08-06 03:15:02,193][52811] Sum rewards: 63.498, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.090', 'AMMO5': '0.028', 'AMMO2': '0.069', 'weapon4': '0.122', 'weapon5': '0.244', 'weapon2': '0.272', 'AMMO3': '0.277', 'AMMO4': '0.344', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.850', 'weapon3': '3.050', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:02,208][52667] DAMAGECOUNT value on done: 387232.0 [2024-08-06 03:15:02,208][52667] Sum rewards: 75.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.046', 'AMMO3': '0.152', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.346', 'weapon4': '0.436', 'WEAPON3': '0.950', 'weapon3': '2.958', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '61.000'} [2024-08-06 03:15:02,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 363085824. Throughput: 0: 4354.7. Samples: 90770680. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 03:15:02,795][52567] Avg episode reward: [(0, '71.133')] [2024-08-06 03:15:02,795][52614] Saving new best policy, reward=71.133! [2024-08-06 03:15:04,127][52803] DAMAGECOUNT value on done: 354881.0 [2024-08-06 03:15:04,127][52803] Sum rewards: 60.226, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.416', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.142', 'weapon4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.066', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '48.000'} [2024-08-06 03:15:04,613][52670] DAMAGECOUNT value on done: 391202.0 [2024-08-06 03:15:04,615][52670] Sum rewards: 77.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.779', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon2': '0.152', 'weapon5': '0.160', 'weapon4': '0.190', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '64.000'} [2024-08-06 03:15:04,740][52663] DAMAGECOUNT value on done: 384399.0 [2024-08-06 03:15:04,740][52663] Sum rewards: 60.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.015', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.143', 'weapon5': '0.174', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.104', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '50.000'} [2024-08-06 03:15:04,921][52666] DAMAGECOUNT value on done: 386117.0 [2024-08-06 03:15:04,923][52666] Sum rewards: 72.627, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.166', 'weapon2': '0.178', 'AMMO3': '0.182', 'AMMO4': '0.198', 'weapon4': '0.440', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '59.000'} [2024-08-06 03:15:05,285][52811] DAMAGECOUNT value on done: 368112.0 [2024-08-06 03:15:05,286][52811] Sum rewards: 69.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.188', 'AMMO5': '0.021', 'AMMO2': '0.032', 'weapon4': '0.066', 'AMMO4': '0.159', 'weapon5': '0.178', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '59.000'} [2024-08-06 03:15:05,403][52667] DAMAGECOUNT value on done: 390103.0 [2024-08-06 03:15:05,405][52667] Sum rewards: 68.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.464', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.136', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.720', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:06,651][52650] Updated weights for policy 0, policy_version 44331 (0.0012) [2024-08-06 03:15:07,160][52803] DAMAGECOUNT value on done: 359048.0 [2024-08-06 03:15:07,160][52803] Sum rewards: 69.861, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.254', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.156', 'weapon4': '0.164', 'AMMO3': '0.305', 'AMMO4': '0.314', 'weapon2': '0.386', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.916', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '62.000'} [2024-08-06 03:15:07,596][52670] DAMAGECOUNT value on done: 385400.0 [2024-08-06 03:15:07,599][52670] Sum rewards: 58.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.155', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.140', 'weapon4': '0.170', 'AMMO4': '0.173', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.214', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '52.000'} [2024-08-06 03:15:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 363167744. Throughput: 0: 4352.3. Samples: 90796650. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 03:15:07,794][52567] Avg episode reward: [(0, '70.867')] [2024-08-06 03:15:07,795][52663] DAMAGECOUNT value on done: 390814.0 [2024-08-06 03:15:07,798][52663] Sum rewards: 73.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '62.000'} [2024-08-06 03:15:08,496][52811] DAMAGECOUNT value on done: 363419.0 [2024-08-06 03:15:08,497][52811] Sum rewards: 66.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.153', 'weapon5': '0.204', 'weapon4': '0.242', 'AMMO3': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '2.818', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:08,510][52667] DAMAGECOUNT value on done: 394238.0 [2024-08-06 03:15:08,510][52667] Sum rewards: 82.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.854', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.149', 'weapon2': '0.172', 'weapon5': '0.186', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.354', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '67.000'} [2024-08-06 03:15:10,286][52803] DAMAGECOUNT value on done: 358290.0 [2024-08-06 03:15:10,287][52803] Sum rewards: 60.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.776', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.082', 'AMMO3': '0.148', 'weapon5': '0.178', 'AMMO4': '0.197', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '3.254', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '49.000'} [2024-08-06 03:15:10,539][52670] DAMAGECOUNT value on done: 385846.0 [2024-08-06 03:15:10,540][52670] Sum rewards: 71.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.826', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon5': '0.076', 'weapon4': '0.124', 'weapon2': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '61.000'} [2024-08-06 03:15:10,750][52663] DAMAGECOUNT value on done: 389006.0 [2024-08-06 03:15:10,752][52663] Sum rewards: 73.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.408', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon2': '0.202', 'AMMO3': '0.224', 'weapon4': '0.240', 'weapon5': '0.300', 'AMMO4': '0.329', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '61.000'} [2024-08-06 03:15:11,399][52667] DAMAGECOUNT value on done: 393238.0 [2024-08-06 03:15:11,399][52667] Sum rewards: 69.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.780', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.072', 'AMMO4': '0.097', 'AMMO3': '0.178', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '57.000'} [2024-08-06 03:15:11,620][52811] DAMAGECOUNT value on done: 363665.0 [2024-08-06 03:15:11,620][52811] Sum rewards: 58.202, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.721', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.024', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '48.000'} [2024-08-06 03:15:11,633][52650] Updated weights for policy 0, policy_version 44341 (0.0016) [2024-08-06 03:15:12,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 363266048. Throughput: 0: 4357.1. Samples: 90823220. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 03:15:12,794][52567] Avg episode reward: [(0, '70.509')] [2024-08-06 03:15:13,413][52803] DAMAGECOUNT value on done: 364838.0 [2024-08-06 03:15:13,413][52803] Sum rewards: 69.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.064', 'AMMO4': '0.129', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:13,771][52663] DAMAGECOUNT value on done: 382784.0 [2024-08-06 03:15:13,781][52663] Sum rewards: 72.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.684', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon4': '0.168', 'weapon5': '0.174', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:14,199][52667] DAMAGECOUNT value on done: 394514.0 [2024-08-06 03:15:14,199][52667] Sum rewards: 62.284, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.014', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.086', 'weapon4': '0.154', 'AMMO4': '0.156', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.204', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '57.000'} [2024-08-06 03:15:14,370][52614] Signal inference workers to stop experience collection... (8000 times) [2024-08-06 03:15:14,370][52614] Signal inference workers to resume experience collection... (8000 times) [2024-08-06 03:15:14,439][52650] InferenceWorker_p0-w0: stopping experience collection (8000 times) [2024-08-06 03:15:14,439][52650] InferenceWorker_p0-w0: resuming experience collection (8000 times) [2024-08-06 03:15:14,652][52811] DAMAGECOUNT value on done: 368897.0 [2024-08-06 03:15:14,653][52811] Sum rewards: 65.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.749', 'AMMO5': '0.016', 'AMMO2': '0.063', 'AMMO3': '0.210', 'weapon2': '0.244', 'weapon4': '0.258', 'weapon5': '0.258', 'AMMO4': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:14,966][52795] DAMAGECOUNT value on done: 362215.0 [2024-08-06 03:15:14,966][52795] Sum rewards: 81.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.122', 'weapon4': '0.146', 'AMMO4': '0.155', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '68.000'} [2024-08-06 03:15:16,175][52650] Updated weights for policy 0, policy_version 44351 (0.0013) [2024-08-06 03:15:16,495][52803] DAMAGECOUNT value on done: 357661.0 [2024-08-06 03:15:16,499][52803] Sum rewards: 88.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.084', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.222', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.490', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.126', 'FRAGCOUNT': '73.000'} [2024-08-06 03:15:16,821][52667] DAMAGECOUNT value on done: 388660.0 [2024-08-06 03:15:16,823][52667] Sum rewards: 85.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '70.000'} [2024-08-06 03:15:17,671][52811] DAMAGECOUNT value on done: 364817.0 [2024-08-06 03:15:17,672][52811] Sum rewards: 81.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.318', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.094', 'weapon5': '0.194', 'AMMO3': '0.198', 'AMMO4': '0.228', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '67.000'} [2024-08-06 03:15:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.1). Total num frames: 363347968. Throughput: 0: 4362.4. Samples: 90836170. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 03:15:17,794][52567] Avg episode reward: [(0, '71.086')] [2024-08-06 03:15:18,233][52795] DAMAGECOUNT value on done: 353566.0 [2024-08-06 03:15:18,259][52795] Sum rewards: 66.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.004', 'weapon4': '0.022', 'AMMO2': '0.028', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.222', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:19,417][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:15:19,635][52803] DAMAGECOUNT value on done: 367127.0 [2024-08-06 03:15:19,639][52803] Sum rewards: 75.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.930', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.154', 'weapon5': '0.162', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '61.500'} [2024-08-06 03:15:19,879][52667] DAMAGECOUNT value on done: 389653.0 [2024-08-06 03:15:19,880][52667] Sum rewards: 69.620, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.516', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.198', 'AMMO3': '0.218', 'AMMO4': '0.243', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:20,844][52811] DAMAGECOUNT value on done: 363300.0 [2024-08-06 03:15:20,844][52811] Sum rewards: 65.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.022', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.209', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.346', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.000'} [2024-08-06 03:15:20,892][52650] Updated weights for policy 0, policy_version 44361 (0.0014) [2024-08-06 03:15:21,469][52795] DAMAGECOUNT value on done: 352694.0 [2024-08-06 03:15:21,469][52795] Sum rewards: 65.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.133', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.140', 'weapon2': '0.148', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '54.500'} [2024-08-06 03:15:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17340.1, 300 sec: 17439.2). Total num frames: 363429888. Throughput: 0: 4365.8. Samples: 90862420. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 03:15:22,794][52567] Avg episode reward: [(0, '71.140')] [2024-08-06 03:15:22,795][52614] Saving new best policy, reward=71.140! [2024-08-06 03:15:22,860][52667] DAMAGECOUNT value on done: 397405.0 [2024-08-06 03:15:22,862][52667] Sum rewards: 66.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.764', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.128', 'AMMO4': '0.235', 'AMMO3': '0.243', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.992', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:22,867][52803] DAMAGECOUNT value on done: 363144.0 [2024-08-06 03:15:22,867][52803] Sum rewards: 61.405, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.424', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO4': '0.222', 'AMMO3': '0.223', 'weapon5': '0.226', 'weapon4': '0.322', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.636', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.139', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:24,202][52811] DAMAGECOUNT value on done: 373944.0 [2024-08-06 03:15:24,203][52811] Sum rewards: 80.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.213', 'weapon4': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '65.000'} [2024-08-06 03:15:24,424][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:15:24,694][52795] DAMAGECOUNT value on done: 360120.0 [2024-08-06 03:15:24,695][52795] Sum rewards: 70.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.215', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.116', 'weapon5': '0.200', 'AMMO3': '0.245', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.036', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '59.000'} [2024-08-06 03:15:25,636][52667] DAMAGECOUNT value on done: 386877.0 [2024-08-06 03:15:25,637][52667] Sum rewards: 67.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.240', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:25,929][52650] Updated weights for policy 0, policy_version 44371 (0.0031) [2024-08-06 03:15:26,010][52803] DAMAGECOUNT value on done: 363662.0 [2024-08-06 03:15:26,010][52803] Sum rewards: 66.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.053', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'AMMO4': '0.267', 'weapon2': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.394', 'WEAPON3': '1.400', 'weapon3': '2.828', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:27,293][52811] DAMAGECOUNT value on done: 363038.0 [2024-08-06 03:15:27,293][52811] Sum rewards: 78.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.138', 'AMMO3': '0.161', 'AMMO4': '0.193', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '64.000'} [2024-08-06 03:15:27,524][52662] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:15:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 363528192. Throughput: 0: 4347.1. Samples: 90888060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:15:27,794][52567] Avg episode reward: [(0, '70.619')] [2024-08-06 03:15:27,842][52795] DAMAGECOUNT value on done: 358887.0 [2024-08-06 03:15:27,842][52795] Sum rewards: 72.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.078', 'AMMO4': '0.208', 'weapon5': '0.222', 'AMMO3': '0.241', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.108', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:28,037][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:15:28,531][52667] DAMAGECOUNT value on done: 392341.0 [2024-08-06 03:15:28,531][52667] Sum rewards: 75.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.731', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon4': '0.100', 'weapon5': '0.178', 'AMMO3': '0.219', 'AMMO4': '0.291', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '62.000'} [2024-08-06 03:15:29,098][52803] DAMAGECOUNT value on done: 366897.0 [2024-08-06 03:15:29,099][52803] Sum rewards: 72.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.101', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '59.000'} [2024-08-06 03:15:30,273][52650] Updated weights for policy 0, policy_version 44381 (0.0025) [2024-08-06 03:15:30,504][52811] DAMAGECOUNT value on done: 363004.0 [2024-08-06 03:15:30,504][52811] Sum rewards: 55.055, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.283', 'AMMO5': '0.034', 'AMMO2': '0.079', 'weapon4': '0.178', 'AMMO3': '0.223', 'weapon2': '0.300', 'weapon5': '0.358', 'AMMO4': '0.393', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '2.822', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '48.000'} [2024-08-06 03:15:30,735][52662] DAMAGECOUNT value on done: 396135.0 [2024-08-06 03:15:30,735][52662] Sum rewards: 64.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.296', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.132', 'weapon4': '0.134', 'AMMO3': '0.190', 'AMMO4': '0.235', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '52.000'} [2024-08-06 03:15:30,925][52795] DAMAGECOUNT value on done: 362813.0 [2024-08-06 03:15:30,928][52795] Sum rewards: 82.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.236', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '70.000'} [2024-08-06 03:15:31,185][52667] DAMAGECOUNT value on done: 392233.0 [2024-08-06 03:15:31,185][52667] Sum rewards: 70.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.819', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.170', 'weapon5': '0.204', 'AMMO3': '0.252', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.188', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:31,574][52664] DAMAGECOUNT value on done: 403209.0 [2024-08-06 03:15:31,575][52664] Sum rewards: 61.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.179', 'AMMO4': '0.241', 'weapon5': '0.272', 'weapon2': '0.426', 'weapon4': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.484', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '50.000'} [2024-08-06 03:15:31,731][52669] DAMAGECOUNT value on done: 392442.0 [2024-08-06 03:15:31,731][52669] Sum rewards: 75.994, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon4': '0.272', 'HEALTH': '0.550', 'WEAPON3': '0.750', 'weapon2': '0.838', 'weapon3': '2.666', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '59.000'} [2024-08-06 03:15:32,223][52803] DAMAGECOUNT value on done: 361798.0 [2024-08-06 03:15:32,224][52803] Sum rewards: 68.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.698', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '57.000'} [2024-08-06 03:15:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 363610112. Throughput: 0: 4349.8. Samples: 90901260. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:15:32,794][52567] Avg episode reward: [(0, '70.621')] [2024-08-06 03:15:33,170][52668] DAMAGECOUNT value on done: 385358.0 [2024-08-06 03:15:33,179][52668] Sum rewards: 61.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.284', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.046', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '50.000'} [2024-08-06 03:15:33,598][52662] DAMAGECOUNT value on done: 395015.0 [2024-08-06 03:15:33,600][52662] Sum rewards: 65.337, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.033', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.368', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:33,701][52811] DAMAGECOUNT value on done: 365627.0 [2024-08-06 03:15:33,703][52811] Sum rewards: 70.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.184', 'weapon2': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:33,894][52667] DAMAGECOUNT value on done: 386432.0 [2024-08-06 03:15:33,894][52667] Sum rewards: 71.297, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.896', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.138', 'AMMO3': '0.243', 'weapon5': '0.260', 'AMMO4': '0.320', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:34,128][52795] DAMAGECOUNT value on done: 368159.0 [2024-08-06 03:15:34,129][52795] Sum rewards: 66.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.559', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.212', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:34,265][52664] DAMAGECOUNT value on done: 407786.0 [2024-08-06 03:15:34,265][52664] Sum rewards: 74.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.931', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.178', 'AMMO3': '0.211', 'weapon2': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:34,485][52665] DAMAGECOUNT value on done: 382274.0 [2024-08-06 03:15:34,485][52665] Sum rewards: 72.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'weapon4': '0.028', 'AMMO2': '0.040', 'weapon5': '0.088', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '61.000'} [2024-08-06 03:15:34,558][52669] DAMAGECOUNT value on done: 383999.0 [2024-08-06 03:15:34,559][52669] Sum rewards: 61.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.925', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.067', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.232', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.542', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '51.000'} [2024-08-06 03:15:35,293][52650] Updated weights for policy 0, policy_version 44391 (0.0025) [2024-08-06 03:15:35,329][52803] DAMAGECOUNT value on done: 360635.0 [2024-08-06 03:15:35,330][52803] Sum rewards: 56.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.209', 'weapon2': '0.842', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.986', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '47.000'} [2024-08-06 03:15:36,225][52668] DAMAGECOUNT value on done: 391604.0 [2024-08-06 03:15:36,225][52668] Sum rewards: 68.373, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.634', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.118', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.324', 'weapon4': '0.382', 'WEAPON3': '0.800', 'weapon3': '2.838', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '53.000'} [2024-08-06 03:15:36,766][52811] DAMAGECOUNT value on done: 360676.0 [2024-08-06 03:15:36,767][52811] Sum rewards: 67.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.236', 'weapon4': '0.322', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '53.000'} [2024-08-06 03:15:36,850][52662] DAMAGECOUNT value on done: 396307.0 [2024-08-06 03:15:36,853][52662] Sum rewards: 79.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO3': '0.209', 'weapon2': '0.244', 'WEAPON3': '1.300', 'weapon3': '3.488', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '66.000'} [2024-08-06 03:15:37,092][52667] DAMAGECOUNT value on done: 394131.0 [2024-08-06 03:15:37,095][52667] Sum rewards: 74.341, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.775', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'weapon2': '0.434', 'WEAPON3': '0.950', 'weapon3': '3.312', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:37,224][52795] DAMAGECOUNT value on done: 363584.0 [2024-08-06 03:15:37,225][52795] Sum rewards: 75.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.612', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '61.000'} [2024-08-06 03:15:37,300][52665] DAMAGECOUNT value on done: 391369.0 [2024-08-06 03:15:37,301][52665] Sum rewards: 57.967, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.698', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.108', 'weapon5': '0.170', 'AMMO4': '0.186', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.750', 'HITCOUNT': '2.990', 'weapon3': '3.164', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '52.000'} [2024-08-06 03:15:37,451][52664] DAMAGECOUNT value on done: 409197.0 [2024-08-06 03:15:37,453][52664] Sum rewards: 64.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.599', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO4': '0.203', 'AMMO3': '0.236', 'weapon2': '0.238', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '54.000'} [2024-08-06 03:15:37,460][52669] DAMAGECOUNT value on done: 396422.0 [2024-08-06 03:15:37,463][52669] Sum rewards: 82.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.775', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.152', 'weapon2': '0.226', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.103', 'FRAGCOUNT': '69.000'} [2024-08-06 03:15:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 363692032. Throughput: 0: 4349.1. Samples: 90927480. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:15:37,794][52567] Avg episode reward: [(0, '69.925')] [2024-08-06 03:15:38,443][52803] DAMAGECOUNT value on done: 369926.0 [2024-08-06 03:15:38,444][52803] Sum rewards: 67.823, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.564', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.108', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.315', 'weapon2': '0.532', 'WEAPON3': '1.700', 'weapon3': '2.976', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:38,623][52668] DAMAGECOUNT value on done: 393225.0 [2024-08-06 03:15:38,624][52668] Sum rewards: 63.695, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.150', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon4': '0.132', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '57.000'} [2024-08-06 03:15:39,416][52662] DAMAGECOUNT value on done: 384746.0 [2024-08-06 03:15:39,416][52662] Sum rewards: 72.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon4': '0.114', 'AMMO3': '0.194', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:39,701][52650] Updated weights for policy 0, policy_version 44401 (0.0014) [2024-08-06 03:15:39,842][52811] DAMAGECOUNT value on done: 363933.0 [2024-08-06 03:15:39,846][52811] Sum rewards: 78.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '66.000'} [2024-08-06 03:15:39,938][52667] DAMAGECOUNT value on done: 399118.0 [2024-08-06 03:15:39,941][52667] Sum rewards: 65.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.720', 'AMMO5': '0.011', 'weapon4': '0.024', 'AMMO2': '0.041', 'weapon5': '0.092', 'WEAPON4': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.650', 'weapon3': '3.082', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:39,955][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:15:40,246][52669] DAMAGECOUNT value on done: 389272.0 [2024-08-06 03:15:40,247][52669] Sum rewards: 83.485, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.042', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.048', 'weapon4': '0.096', 'AMMO4': '0.106', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.346', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.964', 'FRAGCOUNT': '71.000'} [2024-08-06 03:15:40,321][52795] DAMAGECOUNT value on done: 351017.0 [2024-08-06 03:15:40,322][52795] Sum rewards: 58.634, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.180', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.134', 'AMMO3': '0.197', 'weapon5': '0.276', 'AMMO4': '0.284', 'weapon2': '0.370', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '50.500'} [2024-08-06 03:15:40,361][52665] DAMAGECOUNT value on done: 389921.0 [2024-08-06 03:15:40,361][52665] Sum rewards: 66.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.112', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:40,373][52664] DAMAGECOUNT value on done: 402399.0 [2024-08-06 03:15:40,375][52664] Sum rewards: 64.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon2': '0.130', 'weapon5': '0.136', 'AMMO3': '0.186', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.106', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:41,666][52668] DAMAGECOUNT value on done: 395975.0 [2024-08-06 03:15:41,667][52668] Sum rewards: 75.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.008', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.128', 'AMMO3': '0.192', 'AMMO4': '0.218', 'weapon4': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '63.000'} [2024-08-06 03:15:41,782][52803] DAMAGECOUNT value on done: 365394.0 [2024-08-06 03:15:41,782][52803] Sum rewards: 62.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.444', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '51.000'} [2024-08-06 03:15:42,563][52664] DAMAGECOUNT value on done: 405666.0 [2024-08-06 03:15:42,563][52664] Sum rewards: 71.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:42,692][52662] DAMAGECOUNT value on done: 395314.0 [2024-08-06 03:15:42,696][52662] Sum rewards: 73.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '59.000'} [2024-08-06 03:15:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 363782144. Throughput: 0: 4353.5. Samples: 90953690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:15:42,795][52567] Avg episode reward: [(0, '69.892')] [2024-08-06 03:15:42,914][52811] DAMAGECOUNT value on done: 365349.0 [2024-08-06 03:15:42,916][52811] Sum rewards: 76.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.123', 'weapon2': '0.218', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '66.000'} [2024-08-06 03:15:43,152][52667] DAMAGECOUNT value on done: 397832.0 [2024-08-06 03:15:43,153][52667] Sum rewards: 70.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.042', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon2': '0.246', 'AMMO3': '0.257', 'WEAPON3': '1.550', 'HITCOUNT': '3.320', 'weapon3': '3.414', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '62.000'} [2024-08-06 03:15:43,157][52669] DAMAGECOUNT value on done: 389102.0 [2024-08-06 03:15:43,157][52669] Sum rewards: 56.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.336', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.174', 'weapon4': '0.248', 'AMMO3': '0.278', 'weapon2': '0.382', 'WEAPON3': '1.650', 'weapon3': '2.950', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '49.500'} [2024-08-06 03:15:43,422][52795] DAMAGECOUNT value on done: 366892.0 [2024-08-06 03:15:43,423][52795] Sum rewards: 67.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.116', 'AMMO4': '0.196', 'AMMO3': '0.232', 'weapon5': '0.252', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '57.000'} [2024-08-06 03:15:43,571][52665] DAMAGECOUNT value on done: 384445.0 [2024-08-06 03:15:43,571][52665] Sum rewards: 54.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'AMMO4': '0.203', 'weapon2': '0.286', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.010', 'weapon3': '3.160', 'DAMAGECOUNT': '13.734', 'FRAGCOUNT': '46.000'} [2024-08-06 03:15:44,236][52650] Updated weights for policy 0, policy_version 44411 (0.0039) [2024-08-06 03:15:44,299][52668] DAMAGECOUNT value on done: 385354.0 [2024-08-06 03:15:44,301][52668] Sum rewards: 77.182, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.167', 'AMMO4': '0.178', 'weapon2': '0.216', 'WEAPON4': '0.350', 'HEALTH': '0.790', 'WEAPON3': '0.900', 'HITCOUNT': '3.180', 'weapon3': '3.324', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '64.000'} [2024-08-06 03:15:45,032][52803] DAMAGECOUNT value on done: 367905.0 [2024-08-06 03:15:45,033][52803] Sum rewards: 80.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.809', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.154', 'AMMO4': '0.171', 'AMMO3': '0.203', 'weapon4': '0.234', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '67.000'} [2024-08-06 03:15:45,423][52664] DAMAGECOUNT value on done: 403184.0 [2024-08-06 03:15:45,423][52664] Sum rewards: 58.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon2': '0.238', 'weapon4': '0.240', 'AMMO3': '0.275', 'AMMO4': '0.275', 'weapon5': '0.338', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '2.760', 'weapon3': '2.796', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '52.000'} [2024-08-06 03:15:45,909][52662] DAMAGECOUNT value on done: 389663.0 [2024-08-06 03:15:45,911][52662] Sum rewards: 69.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.907', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.212', 'AMMO3': '0.238', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:46,030][52667] DAMAGECOUNT value on done: 396361.0 [2024-08-06 03:15:46,031][52667] Sum rewards: 62.735, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.938', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.170', 'AMMO4': '0.195', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.700', 'HITCOUNT': '3.010', 'weapon3': '3.072', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:46,043][52811] DAMAGECOUNT value on done: 362990.0 [2024-08-06 03:15:46,044][52811] Sum rewards: 73.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.470', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.057', 'weapon4': '0.084', 'weapon5': '0.158', 'AMMO4': '0.286', 'AMMO3': '0.292', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.080', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '65.000'} [2024-08-06 03:15:46,127][52665] DAMAGECOUNT value on done: 378212.0 [2024-08-06 03:15:46,128][52665] Sum rewards: 75.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.488', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.105', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '63.000'} [2024-08-06 03:15:46,157][52669] DAMAGECOUNT value on done: 392507.0 [2024-08-06 03:15:46,159][52669] Sum rewards: 83.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.986', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.118', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '69.000'} [2024-08-06 03:15:46,598][52795] DAMAGECOUNT value on done: 358054.0 [2024-08-06 03:15:46,600][52795] Sum rewards: 80.640, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'weapon4': '0.202', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.318', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '68.000'} [2024-08-06 03:15:47,542][52668] DAMAGECOUNT value on done: 392142.0 [2024-08-06 03:15:47,543][52668] Sum rewards: 64.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.312', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 363872256. Throughput: 0: 4358.7. Samples: 90966820. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:15:47,794][52567] Avg episode reward: [(0, '69.779')] [2024-08-06 03:15:48,322][52664] DAMAGECOUNT value on done: 405711.0 [2024-08-06 03:15:48,322][52664] Sum rewards: 69.445, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.334', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.108', 'weapon4': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.308', 'weapon2': '0.322', 'WEAPON3': '1.800', 'weapon3': '3.144', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:48,379][52803] DAMAGECOUNT value on done: 360341.0 [2024-08-06 03:15:48,380][52803] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.153', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'HEALTH': '0.304', 'weapon2': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:48,916][52662] DAMAGECOUNT value on done: 398230.0 [2024-08-06 03:15:48,924][52662] Sum rewards: 74.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.872', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.138', 'AMMO4': '0.179', 'AMMO3': '0.184', 'weapon2': '0.246', 'weapon5': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '60.000'} [2024-08-06 03:15:48,951][52665] DAMAGECOUNT value on done: 378980.0 [2024-08-06 03:15:48,952][52665] Sum rewards: 56.931, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.196', 'weapon4': '0.232', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '2.822', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '49.000'} [2024-08-06 03:15:49,020][52667] DAMAGECOUNT value on done: 389032.0 [2024-08-06 03:15:49,021][52667] Sum rewards: 55.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO4': '0.211', 'weapon5': '0.248', 'AMMO3': '0.250', 'weapon2': '0.362', 'weapon4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.694', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '48.000'} [2024-08-06 03:15:49,153][52811] DAMAGECOUNT value on done: 364712.0 [2024-08-06 03:15:49,153][52811] Sum rewards: 55.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.329', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.498', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '49.000'} [2024-08-06 03:15:49,156][52669] DAMAGECOUNT value on done: 391480.0 [2024-08-06 03:15:49,157][52669] Sum rewards: 64.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.830', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.268', 'WEAPON3': '1.650', 'weapon3': '3.304', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:49,472][52650] Updated weights for policy 0, policy_version 44421 (0.0025) [2024-08-06 03:15:49,627][52795] DAMAGECOUNT value on done: 359169.0 [2024-08-06 03:15:49,629][52795] Sum rewards: 75.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.684', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.235', 'weapon2': '0.338', 'WEAPON4': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '63.000'} [2024-08-06 03:15:50,382][52668] DAMAGECOUNT value on done: 392846.0 [2024-08-06 03:15:50,384][52668] Sum rewards: 74.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO3': '0.203', 'AMMO4': '0.206', 'weapon2': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '62.000'} [2024-08-06 03:15:51,421][52664] DAMAGECOUNT value on done: 398377.0 [2024-08-06 03:15:51,423][52664] Sum rewards: 69.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:51,528][52662] DAMAGECOUNT value on done: 400465.0 [2024-08-06 03:15:51,529][52662] Sum rewards: 56.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.094', 'AMMO4': '0.173', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.132', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '47.000'} [2024-08-06 03:15:51,845][52658] DAMAGECOUNT value on done: 388215.0 [2024-08-06 03:15:51,850][52658] Sum rewards: 60.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.146', 'weapon5': '0.146', 'AMMO4': '0.177', 'weapon2': '0.184', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.280', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '52.000'} [2024-08-06 03:15:51,945][52665] DAMAGECOUNT value on done: 384969.0 [2024-08-06 03:15:51,947][52665] Sum rewards: 59.486, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.610', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.144', 'AMMO3': '0.196', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '49.000'} [2024-08-06 03:15:52,244][52667] DAMAGECOUNT value on done: 396811.0 [2024-08-06 03:15:52,244][52667] Sum rewards: 75.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.008', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'weapon5': '0.148', 'weapon4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '61.000'} [2024-08-06 03:15:52,410][52669] DAMAGECOUNT value on done: 391679.0 [2024-08-06 03:15:52,411][52669] Sum rewards: 62.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.030', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.064', 'weapon5': '0.098', 'AMMO4': '0.100', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '52.000'} [2024-08-06 03:15:52,460][52660] DAMAGECOUNT value on done: 387410.0 [2024-08-06 03:15:52,460][52660] Sum rewards: 71.549, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.540', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.112', 'weapon4': '0.144', 'AMMO4': '0.227', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '64.000'} [2024-08-06 03:15:52,767][52795] DAMAGECOUNT value on done: 354930.0 [2024-08-06 03:15:52,767][52795] Sum rewards: 60.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.326', 'weapon2': '0.502', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.026', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '50.000'} [2024-08-06 03:15:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 363954176. Throughput: 0: 4366.4. Samples: 90993140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:15:52,794][52567] Avg episode reward: [(0, '69.297')] [2024-08-06 03:15:53,041][52668] DAMAGECOUNT value on done: 386089.0 [2024-08-06 03:15:53,042][52668] Sum rewards: 68.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.080', 'AMMO4': '0.102', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:53,601][52647] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:15:53,764][52650] Updated weights for policy 0, policy_version 44431 (0.0013) [2024-08-06 03:15:54,473][52664] DAMAGECOUNT value on done: 409009.0 [2024-08-06 03:15:54,474][52664] Sum rewards: 73.252, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.662', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.060', 'weapon4': '0.076', 'AMMO4': '0.125', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'weapon2': '0.302', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '63.500'} [2024-08-06 03:15:54,539][52665] DAMAGECOUNT value on done: 389930.0 [2024-08-06 03:15:54,539][52665] Sum rewards: 76.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.436', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.180', 'AMMO3': '0.226', 'AMMO4': '0.246', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.500'} [2024-08-06 03:15:54,657][52662] DAMAGECOUNT value on done: 390422.0 [2024-08-06 03:15:54,660][52662] Sum rewards: 70.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.338', 'WEAPON3': '1.350', 'HITCOUNT': '3.380', 'weapon3': '3.494', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:54,921][52669] DAMAGECOUNT value on done: 394522.0 [2024-08-06 03:15:54,922][52669] Sum rewards: 82.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.205', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.111', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '67.000'} [2024-08-06 03:15:54,943][52658] DAMAGECOUNT value on done: 392452.0 [2024-08-06 03:15:54,945][52658] Sum rewards: 80.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.945', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '64.000'} [2024-08-06 03:15:55,542][52660] DAMAGECOUNT value on done: 384702.0 [2024-08-06 03:15:55,545][52660] Sum rewards: 62.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.292', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.154', 'AMMO3': '0.177', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '53.000'} [2024-08-06 03:15:55,863][52820] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)] [2024-08-06 03:15:55,958][52795] DAMAGECOUNT value on done: 365088.0 [2024-08-06 03:15:55,959][52795] Sum rewards: 81.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.369', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.179', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '67.000'} [2024-08-06 03:15:56,056][52668] DAMAGECOUNT value on done: 389645.0 [2024-08-06 03:15:56,056][52668] Sum rewards: 66.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.796', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.211', 'AMMO4': '0.213', 'weapon5': '0.240', 'weapon2': '0.276', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '56.000'} [2024-08-06 03:15:57,152][52665] DAMAGECOUNT value on done: 390510.0 [2024-08-06 03:15:57,155][52665] Sum rewards: 64.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.698', 'AMMO5': '0.026', 'AMMO2': '0.065', 'AMMO3': '0.203', 'weapon4': '0.254', 'AMMO4': '0.327', 'weapon2': '0.342', 'weapon5': '0.416', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.626', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '52.000'} [2024-08-06 03:15:57,452][52664] DAMAGECOUNT value on done: 401999.0 [2024-08-06 03:15:57,452][52664] Sum rewards: 56.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.014', 'AMMO2': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.168', 'weapon5': '0.196', 'WEAPON7': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.280', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.314', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '13.911', 'FRAGCOUNT': '49.000'} [2024-08-06 03:15:57,666][52669] DAMAGECOUNT value on done: 390628.0 [2024-08-06 03:15:57,666][52669] Sum rewards: 84.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.074', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.136', 'AMMO4': '0.184', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '69.000'} [2024-08-06 03:15:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 364036096. Throughput: 0: 4354.2. Samples: 91019160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:15:57,794][52567] Avg episode reward: [(0, '69.743')] [2024-08-06 03:15:57,845][52662] DAMAGECOUNT value on done: 401199.0 [2024-08-06 03:15:57,846][52662] Sum rewards: 68.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.882', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.072', 'AMMO3': '0.218', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.358', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '58.000'} [2024-08-06 03:15:57,914][52658] DAMAGECOUNT value on done: 396331.0 [2024-08-06 03:15:57,915][52658] Sum rewards: 69.234, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.954', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.112', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.620', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '54.000'} [2024-08-06 03:15:58,781][52660] DAMAGECOUNT value on done: 396353.0 [2024-08-06 03:15:58,782][52660] Sum rewards: 62.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.300', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.166', 'weapon5': '0.220', 'weapon2': '0.262', 'AMMO4': '0.267', 'weapon4': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '2.828', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '55.000'} [2024-08-06 03:15:58,789][52650] Updated weights for policy 0, policy_version 44441 (0.0023) [2024-08-06 03:15:59,191][52668] DAMAGECOUNT value on done: 392528.0 [2024-08-06 03:15:59,193][52668] Sum rewards: 61.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.187', 'AMMO4': '0.224', 'weapon2': '0.312', 'weapon5': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.410', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '48.500'} [2024-08-06 03:15:59,258][52795] DAMAGECOUNT value on done: 352760.0 [2024-08-06 03:15:59,260][52795] Sum rewards: 81.295, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.550', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.156', 'weapon2': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.442', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '64.000'} [2024-08-06 03:16:00,221][52665] DAMAGECOUNT value on done: 386985.0 [2024-08-06 03:16:00,221][52665] Sum rewards: 65.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:00,551][52664] DAMAGECOUNT value on done: 409681.0 [2024-08-06 03:16:00,551][52664] Sum rewards: 68.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.098', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.064', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:00,643][52658] DAMAGECOUNT value on done: 394471.0 [2024-08-06 03:16:00,644][52658] Sum rewards: 79.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.138', 'AMMO4': '0.175', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 03:16:00,752][52669] DAMAGECOUNT value on done: 395921.0 [2024-08-06 03:16:00,752][52669] Sum rewards: 65.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.930', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.198', 'AMMO3': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.438', 'weapon4': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.624', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:00,885][52662] DAMAGECOUNT value on done: 388592.0 [2024-08-06 03:16:00,886][52662] Sum rewards: 70.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.126', 'AMMO4': '0.162', 'AMMO3': '0.191', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '58.500'} [2024-08-06 03:16:01,961][52660] DAMAGECOUNT value on done: 397822.0 [2024-08-06 03:16:01,961][52660] Sum rewards: 77.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.851', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.430', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:02,377][52668] DAMAGECOUNT value on done: 392913.0 [2024-08-06 03:16:02,378][52668] Sum rewards: 71.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.108', 'weapon2': '0.152', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:02,489][52795] DAMAGECOUNT value on done: 370439.0 [2024-08-06 03:16:02,490][52795] Sum rewards: 58.343, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.132', 'AMMO4': '0.164', 'AMMO3': '0.191', 'weapon5': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.534', 'HEALTH': '0.786', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '47.000'} [2024-08-06 03:16:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 364134400. Throughput: 0: 4354.4. Samples: 91032120. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:16:02,794][52567] Avg episode reward: [(0, '69.145')] [2024-08-06 03:16:02,814][52665] DAMAGECOUNT value on done: 393005.0 [2024-08-06 03:16:02,814][52665] Sum rewards: 67.892, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.648', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.169', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'weapon4': '0.318', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:03,187][52650] Updated weights for policy 0, policy_version 44451 (0.0019) [2024-08-06 03:16:03,640][52658] DAMAGECOUNT value on done: 386316.0 [2024-08-06 03:16:03,641][52658] Sum rewards: 60.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.246', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.060', 'weapon5': '0.096', 'weapon2': '0.210', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.442', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '51.000'} [2024-08-06 03:16:03,738][52669] DAMAGECOUNT value on done: 391410.0 [2024-08-06 03:16:03,738][52669] Sum rewards: 61.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.251', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon2': '0.186', 'AMMO3': '0.217', 'weapon4': '0.270', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.176', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '52.000'} [2024-08-06 03:16:03,776][52662] DAMAGECOUNT value on done: 392260.0 [2024-08-06 03:16:03,776][52662] Sum rewards: 70.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.158', 'AMMO3': '0.227', 'weapon4': '0.296', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:03,800][52664] DAMAGECOUNT value on done: 406421.0 [2024-08-06 03:16:03,801][52664] Sum rewards: 88.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.131', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '74.000'} [2024-08-06 03:16:04,865][52660] DAMAGECOUNT value on done: 389612.0 [2024-08-06 03:16:04,868][52660] Sum rewards: 58.689, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.456', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon4': '0.224', 'AMMO3': '0.268', 'weapon5': '0.286', 'AMMO4': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.610', 'WEAPON3': '1.600', 'weapon3': '2.572', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '51.000'} [2024-08-06 03:16:05,249][52668] DAMAGECOUNT value on done: 386025.0 [2024-08-06 03:16:05,249][52668] Sum rewards: 68.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.832', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.162', 'weapon2': '0.716', 'WEAPON3': '0.950', 'weapon3': '2.916', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:05,408][52671] DAMAGECOUNT value on done: 395005.0 [2024-08-06 03:16:05,409][52671] Sum rewards: 68.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.101', 'weapon5': '0.120', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.290', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:05,651][52665] DAMAGECOUNT value on done: 388019.0 [2024-08-06 03:16:05,651][52665] Sum rewards: 62.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon4': '0.248', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '2.762', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '53.000'} [2024-08-06 03:16:05,672][52795] DAMAGECOUNT value on done: 364399.0 [2024-08-06 03:16:05,672][52795] Sum rewards: 67.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.182', 'weapon5': '0.190', 'AMMO4': '0.224', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.558', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:05,917][52649] DAMAGECOUNT value on done: 381448.0 [2024-08-06 03:16:05,917][52649] Sum rewards: 68.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.194', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.148', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.350', 'weapon4': '0.580', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:05,962][52669] DAMAGECOUNT value on done: 386524.0 [2024-08-06 03:16:05,962][52669] Sum rewards: 68.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.136', 'AMMO3': '0.215', 'weapon5': '0.222', 'AMMO4': '0.289', 'weapon2': '0.418', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:06,361][52658] DAMAGECOUNT value on done: 390539.0 [2024-08-06 03:16:06,362][52658] Sum rewards: 73.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.016', 'AMMO4': '0.020', 'weapon4': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.209', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.410', 'weapon3': '3.486', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:06,823][52662] DAMAGECOUNT value on done: 394935.0 [2024-08-06 03:16:06,826][52662] Sum rewards: 62.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.685', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.174', 'AMMO4': '0.192', 'weapon2': '0.194', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.408', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '52.000'} [2024-08-06 03:16:06,874][52664] DAMAGECOUNT value on done: 414599.0 [2024-08-06 03:16:06,874][52664] Sum rewards: 63.454, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.206', 'AMMO5': '0.017', 'AMMO2': '0.075', 'weapon5': '0.218', 'AMMO3': '0.224', 'weapon2': '0.228', 'weapon4': '0.340', 'WEAPON5': '0.350', 'AMMO4': '0.374', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:07,605][52820] DAMAGECOUNT value on done: 356566.0 [2024-08-06 03:16:07,606][52820] Sum rewards: 79.552, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.028', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.520', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '69.000'} [2024-08-06 03:16:07,682][52795] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon5', 0.002)] [2024-08-06 03:16:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 364216320. Throughput: 0: 4355.1. Samples: 91058400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:16:07,794][52567] Avg episode reward: [(0, '68.957')] [2024-08-06 03:16:07,870][52650] Updated weights for policy 0, policy_version 44461 (0.0024) [2024-08-06 03:16:08,014][52660] DAMAGECOUNT value on done: 387814.0 [2024-08-06 03:16:08,014][52660] Sum rewards: 72.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.566', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'weapon4': '0.094', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.370', 'weapon3': '3.404', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:08,294][52668] DAMAGECOUNT value on done: 382627.0 [2024-08-06 03:16:08,296][52668] Sum rewards: 76.518, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.163', 'AMMO4': '0.168', 'weapon4': '0.184', 'weapon5': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:08,536][52671] DAMAGECOUNT value on done: 392752.0 [2024-08-06 03:16:08,537][52671] Sum rewards: 75.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.150', 'weapon4': '0.194', 'AMMO4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:08,653][52669] DAMAGECOUNT value on done: 393999.0 [2024-08-06 03:16:08,654][52669] Sum rewards: 70.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.064', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:08,735][52665] DAMAGECOUNT value on done: 384849.0 [2024-08-06 03:16:08,735][52665] Sum rewards: 70.498, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.533', 'AMMO5': '0.027', 'AMMO2': '0.050', 'weapon4': '0.118', 'weapon5': '0.164', 'AMMO3': '0.241', 'AMMO4': '0.248', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:08,870][52795] DAMAGECOUNT value on done: 353989.0 [2024-08-06 03:16:08,870][52795] Sum rewards: 66.673, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.486', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.088', 'weapon5': '0.206', 'AMMO4': '0.208', 'AMMO3': '0.257', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:08,972][52649] DAMAGECOUNT value on done: 375723.0 [2024-08-06 03:16:08,972][52649] Sum rewards: 66.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.218', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.450', 'weapon4': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.612', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:09,082][52658] DAMAGECOUNT value on done: 392558.0 [2024-08-06 03:16:09,082][52658] Sum rewards: 69.769, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.172', 'weapon2': '0.194', 'AMMO3': '0.201', 'AMMO4': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:09,766][52647] DAMAGECOUNT value on done: 413670.0 [2024-08-06 03:16:09,766][52647] Sum rewards: 69.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.554', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.058', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.352', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:09,861][52664] DAMAGECOUNT value on done: 407062.0 [2024-08-06 03:16:09,861][52664] Sum rewards: 75.563, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.902', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '3.196', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:09,913][52662] DAMAGECOUNT value on done: 398590.0 [2024-08-06 03:16:09,913][52662] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.540', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon2': '0.208', 'AMMO4': '0.237', 'AMMO3': '0.245', 'weapon4': '0.260', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.940', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '58.500'} [2024-08-06 03:16:10,741][52820] DAMAGECOUNT value on done: 361408.0 [2024-08-06 03:16:10,742][52820] Sum rewards: 71.685, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.927', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.121', 'weapon2': '0.516', 'WEAPON3': '0.850', 'HITCOUNT': '3.190', 'weapon3': '3.366', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:10,846][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:16:10,898][52660] DAMAGECOUNT value on done: 391849.0 [2024-08-06 03:16:10,900][52660] Sum rewards: 70.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.234', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:11,268][52668] DAMAGECOUNT value on done: 383922.0 [2024-08-06 03:16:11,269][52668] Sum rewards: 79.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.457', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.156', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.310', 'WEAPON3': '0.950', 'weapon3': '2.996', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:11,404][52669] DAMAGECOUNT value on done: 398486.0 [2024-08-06 03:16:11,404][52669] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.118', 'AMMO5': '0.009', 'weapon5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.316', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '53.000'} [2024-08-06 03:16:11,575][52671] DAMAGECOUNT value on done: 393145.0 [2024-08-06 03:16:11,575][52671] Sum rewards: 63.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.951', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.136', 'weapon4': '0.146', 'AMMO4': '0.172', 'weapon2': '0.198', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.272', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:11,752][52665] DAMAGECOUNT value on done: 384257.0 [2024-08-06 03:16:11,752][52665] Sum rewards: 71.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:11,867][52658] DAMAGECOUNT value on done: 385327.0 [2024-08-06 03:16:11,867][52658] Sum rewards: 63.494, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.962', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.272', 'AMMO3': '0.284', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:11,957][52649] DAMAGECOUNT value on done: 382020.0 [2024-08-06 03:16:11,958][52649] Sum rewards: 68.572, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.038', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:12,042][52795] DAMAGECOUNT value on done: 361430.0 [2024-08-06 03:16:12,043][52795] Sum rewards: 58.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.451', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.138', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.392', 'WEAPON3': '0.950', 'HITCOUNT': '2.860', 'weapon3': '3.040', 'DAMAGECOUNT': '13.377', 'FRAGCOUNT': '46.000'} [2024-08-06 03:16:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 364298240. Throughput: 0: 4373.6. Samples: 91084870. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:16:12,794][52567] Avg episode reward: [(0, '68.871')] [2024-08-06 03:16:12,886][52650] Updated weights for policy 0, policy_version 44471 (0.0012) [2024-08-06 03:16:12,964][52647] DAMAGECOUNT value on done: 410634.0 [2024-08-06 03:16:12,965][52647] Sum rewards: 71.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.185', 'weapon5': '0.228', 'weapon2': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:13,031][52662] DAMAGECOUNT value on done: 390851.0 [2024-08-06 03:16:13,032][52662] Sum rewards: 67.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:13,099][52664] DAMAGECOUNT value on done: 411540.0 [2024-08-06 03:16:13,099][52664] Sum rewards: 68.258, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.114', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:13,440][52660] DAMAGECOUNT value on done: 397556.0 [2024-08-06 03:16:13,441][52660] Sum rewards: 66.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.948', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.080', 'weapon5': '0.168', 'AMMO4': '0.235', 'AMMO3': '0.266', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.098', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:13,715][52668] DAMAGECOUNT value on done: 383790.0 [2024-08-06 03:16:13,718][52668] Sum rewards: 67.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon2': '0.234', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:13,989][52820] DAMAGECOUNT value on done: 362719.0 [2024-08-06 03:16:13,990][52820] Sum rewards: 72.541, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.920', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO4': '0.261', 'weapon2': '0.292', 'AMMO3': '0.301', 'weapon5': '0.308', 'weapon4': '0.358', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.582', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '64.000'} [2024-08-06 03:16:14,147][52671] DAMAGECOUNT value on done: 391819.0 [2024-08-06 03:16:14,147][52671] Sum rewards: 58.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.914', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.194', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '13.803', 'FRAGCOUNT': '48.000'} [2024-08-06 03:16:14,195][52669] DAMAGECOUNT value on done: 407310.0 [2024-08-06 03:16:14,200][52669] Sum rewards: 77.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.168', 'weapon4': '0.240', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '65.000'} [2024-08-06 03:16:14,458][52665] DAMAGECOUNT value on done: 389015.0 [2024-08-06 03:16:14,458][52665] Sum rewards: 74.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.136', 'AMMO3': '0.168', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:14,855][52658] DAMAGECOUNT value on done: 398996.0 [2024-08-06 03:16:14,855][52658] Sum rewards: 66.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.575', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:14,859][52649] DAMAGECOUNT value on done: 379800.0 [2024-08-06 03:16:14,859][52649] Sum rewards: 64.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.778', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.140', 'weapon5': '0.174', 'AMMO4': '0.191', 'AMMO3': '0.248', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.090', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:15,385][52795] DAMAGECOUNT value on done: 368695.0 [2024-08-06 03:16:15,385][52795] Sum rewards: 68.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.226', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:16,135][52662] DAMAGECOUNT value on done: 403523.0 [2024-08-06 03:16:16,143][52662] Sum rewards: 68.009, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'HEALTH': '0.026', 'AMMO2': '0.038', 'weapon5': '0.140', 'weapon2': '0.170', 'AMMO3': '0.175', 'AMMO4': '0.189', 'weapon4': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.950', 'weapon3': '3.246', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:16,161][52647] DAMAGECOUNT value on done: 411298.0 [2024-08-06 03:16:16,162][52647] Sum rewards: 67.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.186', 'AMMO4': '0.195', 'AMMO3': '0.228', 'weapon2': '0.286', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:16,239][52664] DAMAGECOUNT value on done: 402975.0 [2024-08-06 03:16:16,239][52664] Sum rewards: 82.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.752', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.072', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'weapon2': '0.186', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.460', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '68.000'} [2024-08-06 03:16:16,561][52794] DAMAGECOUNT value on done: 394004.0 [2024-08-06 03:16:16,562][52794] Sum rewards: 71.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.002', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.117', 'weapon4': '0.156', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.134', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:16,621][52660] DAMAGECOUNT value on done: 394968.0 [2024-08-06 03:16:16,624][52660] Sum rewards: 61.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.226', 'AMMO3': '0.235', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '51.000'} [2024-08-06 03:16:16,693][52671] DAMAGECOUNT value on done: 398693.0 [2024-08-06 03:16:16,695][52671] Sum rewards: 67.988, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.144', 'AMMO4': '0.194', 'weapon5': '0.214', 'AMMO3': '0.279', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.972', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:16,816][52669] DAMAGECOUNT value on done: 394386.0 [2024-08-06 03:16:16,817][52669] Sum rewards: 73.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon4': '0.120', 'AMMO3': '0.204', 'weapon5': '0.258', 'AMMO4': '0.330', 'weapon2': '0.442', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:16,892][52668] DAMAGECOUNT value on done: 387360.0 [2024-08-06 03:16:16,893][52668] Sum rewards: 75.673, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.248', 'HEALTH': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.494', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:17,136][52820] DAMAGECOUNT value on done: 357681.0 [2024-08-06 03:16:17,136][52820] Sum rewards: 64.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'AMMO5': '0.024', 'AMMO2': '0.056', 'weapon4': '0.098', 'AMMO3': '0.183', 'weapon5': '0.218', 'AMMO4': '0.282', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:17,458][52650] Updated weights for policy 0, policy_version 44481 (0.0027) [2024-08-06 03:16:17,474][52665] DAMAGECOUNT value on done: 386229.0 [2024-08-06 03:16:17,474][52665] Sum rewards: 65.775, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.342', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.104', 'weapon5': '0.142', 'AMMO3': '0.240', 'AMMO4': '0.249', 'weapon2': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.218', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:17,691][52649] DAMAGECOUNT value on done: 370944.0 [2024-08-06 03:16:17,692][52649] Sum rewards: 62.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.914', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'weapon5': '0.164', 'weapon4': '0.206', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.884', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '53.000'} [2024-08-06 03:16:17,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17411.4). Total num frames: 364388352. Throughput: 0: 4367.1. Samples: 91097780. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:16:17,795][52567] Avg episode reward: [(0, '68.764')] [2024-08-06 03:16:17,813][52658] DAMAGECOUNT value on done: 391859.0 [2024-08-06 03:16:17,815][52658] Sum rewards: 79.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.231', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.042', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '67.000'} [2024-08-06 03:16:19,151][52662] DAMAGECOUNT value on done: 395949.0 [2024-08-06 03:16:19,152][52662] Sum rewards: 71.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.142', 'weapon5': '0.172', 'AMMO4': '0.193', 'AMMO3': '0.252', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '61.000'} [2024-08-06 03:16:19,164][52647] DAMAGECOUNT value on done: 418425.0 [2024-08-06 03:16:19,164][52647] Sum rewards: 82.344, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.124', 'weapon4': '0.140', 'weapon2': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.456', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '70.000'} [2024-08-06 03:16:19,272][52664] DAMAGECOUNT value on done: 404484.0 [2024-08-06 03:16:19,275][52664] Sum rewards: 80.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.206', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.600', 'weapon3': '2.750', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '67.000'} [2024-08-06 03:16:19,553][52660] DAMAGECOUNT value on done: 389742.0 [2024-08-06 03:16:19,554][52660] Sum rewards: 68.044, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.124', 'weapon5': '0.152', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:19,590][52794] DAMAGECOUNT value on done: 396614.0 [2024-08-06 03:16:19,591][52794] Sum rewards: 64.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.392', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO4': '0.187', 'AMMO3': '0.228', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:19,777][52671] DAMAGECOUNT value on done: 390002.0 [2024-08-06 03:16:19,777][52671] Sum rewards: 68.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.523', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.233', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.016', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:19,836][52669] DAMAGECOUNT value on done: 395902.0 [2024-08-06 03:16:19,837][52669] Sum rewards: 72.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.972', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.196', 'AMMO3': '0.234', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.616', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '61.000'} [2024-08-06 03:16:19,937][52668] DAMAGECOUNT value on done: 392870.0 [2024-08-06 03:16:19,939][52668] Sum rewards: 76.347, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.176', 'weapon2': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.278', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.064', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '66.000'} [2024-08-06 03:16:20,108][52665] DAMAGECOUNT value on done: 382801.0 [2024-08-06 03:16:20,108][52665] Sum rewards: 68.090, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.196', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.166', 'AMMO4': '0.171', 'AMMO3': '0.210', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:20,309][52649] DAMAGECOUNT value on done: 382262.0 [2024-08-06 03:16:20,309][52649] Sum rewards: 64.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.208', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:20,318][52820] DAMAGECOUNT value on done: 362569.0 [2024-08-06 03:16:20,318][52820] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.080', 'weapon5': '0.186', 'AMMO3': '0.214', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:20,524][52658] DAMAGECOUNT value on done: 400748.0 [2024-08-06 03:16:20,525][52658] Sum rewards: 65.226, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.385', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.042', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:21,943][52650] Updated weights for policy 0, policy_version 44491 (0.0015) [2024-08-06 03:16:22,027][52662] DAMAGECOUNT value on done: 395911.0 [2024-08-06 03:16:22,028][52662] Sum rewards: 72.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.864', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.106', 'weapon5': '0.158', 'AMMO3': '0.234', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '61.000'} [2024-08-06 03:16:22,078][52647] DAMAGECOUNT value on done: 414613.0 [2024-08-06 03:16:22,078][52647] Sum rewards: 69.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.510', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.131', 'weapon4': '0.196', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:22,162][52664] DAMAGECOUNT value on done: 405451.0 [2024-08-06 03:16:22,162][52664] Sum rewards: 74.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.132', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.156', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.000'} [2024-08-06 03:16:22,344][52669] DAMAGECOUNT value on done: 396036.0 [2024-08-06 03:16:22,345][52669] Sum rewards: 67.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.398', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.078', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.410', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:22,535][52794] DAMAGECOUNT value on done: 393034.0 [2024-08-06 03:16:22,536][52794] Sum rewards: 82.700, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.018', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.444', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '69.000'} [2024-08-06 03:16:22,666][52671] DAMAGECOUNT value on done: 399708.0 [2024-08-06 03:16:22,667][52671] Sum rewards: 77.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.514', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 03:16:22,707][52660] DAMAGECOUNT value on done: 398329.0 [2024-08-06 03:16:22,707][52660] Sum rewards: 66.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.188', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon2': '0.180', 'weapon5': '0.194', 'weapon4': '0.210', 'AMMO3': '0.225', 'AMMO4': '0.289', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.208', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 364478464. Throughput: 0: 4365.5. Samples: 91123930. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:16:22,795][52567] Avg episode reward: [(0, '69.912')] [2024-08-06 03:16:23,117][52668] DAMAGECOUNT value on done: 391316.0 [2024-08-06 03:16:23,120][52668] Sum rewards: 74.923, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.246', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.392', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '66.000'} [2024-08-06 03:16:23,198][52665] DAMAGECOUNT value on done: 383584.0 [2024-08-06 03:16:23,200][52665] Sum rewards: 83.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.746', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.187', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '68.000'} [2024-08-06 03:16:23,444][52658] DAMAGECOUNT value on done: 384669.0 [2024-08-06 03:16:23,444][52658] Sum rewards: 67.111, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.410', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.152', 'weapon5': '0.168', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.650', 'weapon3': '3.102', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:23,523][52649] DAMAGECOUNT value on done: 376776.0 [2024-08-06 03:16:23,523][52649] Sum rewards: 63.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.353', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO3': '0.169', 'AMMO4': '0.169', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '52.000'} [2024-08-06 03:16:23,591][52820] DAMAGECOUNT value on done: 356040.0 [2024-08-06 03:16:23,591][52820] Sum rewards: 70.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.273', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.520', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:24,933][52647] DAMAGECOUNT value on done: 414334.0 [2024-08-06 03:16:24,934][52647] Sum rewards: 87.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.367', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO3': '0.197', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.338', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.946', 'FRAGCOUNT': '69.500'} [2024-08-06 03:16:25,107][52664] DAMAGECOUNT value on done: 403547.0 [2024-08-06 03:16:25,107][52664] Sum rewards: 62.738, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.225', 'AMMO4': '0.305', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:25,170][52669] DAMAGECOUNT value on done: 397747.0 [2024-08-06 03:16:25,174][52669] Sum rewards: 71.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.953', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:25,326][52662] DAMAGECOUNT value on done: 389106.0 [2024-08-06 03:16:25,326][52662] Sum rewards: 51.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.730', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.148', 'AMMO3': '0.169', 'AMMO4': '0.234', 'weapon4': '0.294', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '2.954', 'DAMAGECOUNT': '13.536', 'FRAGCOUNT': '43.000'} [2024-08-06 03:16:25,358][52660] DAMAGECOUNT value on done: 385315.0 [2024-08-06 03:16:25,359][52660] Sum rewards: 70.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.145', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:25,658][52671] DAMAGECOUNT value on done: 394961.0 [2024-08-06 03:16:25,659][52671] Sum rewards: 58.145, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.023', 'AMMO2': '0.070', 'AMMO3': '0.188', 'weapon4': '0.212', 'weapon5': '0.226', 'HEALTH': '0.340', 'AMMO4': '0.349', 'WEAPON5': '0.550', 'weapon2': '0.628', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.584', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '48.000'} [2024-08-06 03:16:25,694][52668] DAMAGECOUNT value on done: 393443.0 [2024-08-06 03:16:25,695][52668] Sum rewards: 74.586, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.287', 'weapon2': '0.302', 'WEAPON3': '1.750', 'weapon3': '3.514', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '65.000'} [2024-08-06 03:16:25,753][52665] DAMAGECOUNT value on done: 385763.0 [2024-08-06 03:16:25,753][52665] Sum rewards: 66.620, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.382', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.105', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.620', 'WEAPON3': '0.800', 'weapon3': '2.904', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '52.000'} [2024-08-06 03:16:25,809][52794] DAMAGECOUNT value on done: 390025.0 [2024-08-06 03:16:25,809][52794] Sum rewards: 74.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.615', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.070', 'weapon4': '0.118', 'AMMO4': '0.211', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:26,015][52649] DAMAGECOUNT value on done: 385441.0 [2024-08-06 03:16:26,016][52649] Sum rewards: 52.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.040', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO4': '0.189', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'weapon4': '0.364', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.910', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '48.000'} [2024-08-06 03:16:26,270][52658] DAMAGECOUNT value on done: 392411.0 [2024-08-06 03:16:26,270][52658] Sum rewards: 52.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.900', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.078', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '3.348', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '46.000'} [2024-08-06 03:16:26,648][52650] Updated weights for policy 0, policy_version 44501 (0.0019) [2024-08-06 03:16:26,712][52820] DAMAGECOUNT value on done: 359422.0 [2024-08-06 03:16:26,713][52820] Sum rewards: 72.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.045', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.156', 'weapon4': '0.180', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:27,612][52647] DAMAGECOUNT value on done: 413356.0 [2024-08-06 03:16:27,612][52647] Sum rewards: 72.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.126', 'weapon4': '0.176', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:27,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 364568576. Throughput: 0: 4367.1. Samples: 91150210. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:16:27,794][52567] Avg episode reward: [(0, '69.498')] [2024-08-06 03:16:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000044503_364568576.pth... [2024-08-06 03:16:27,817][52664] DAMAGECOUNT value on done: 404468.0 [2024-08-06 03:16:27,817][52664] Sum rewards: 71.249, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.222', 'weapon2': '0.236', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000043992_360382464.pth [2024-08-06 03:16:28,234][52660] DAMAGECOUNT value on done: 385624.0 [2024-08-06 03:16:28,234][52660] Sum rewards: 80.797, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.713', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '69.000'} [2024-08-06 03:16:28,310][52671] DAMAGECOUNT value on done: 390342.0 [2024-08-06 03:16:28,310][52671] Sum rewards: 67.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO4': '0.195', 'weapon4': '0.204', 'AMMO3': '0.225', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.884', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:28,430][52668] DAMAGECOUNT value on done: 388382.0 [2024-08-06 03:16:28,431][52668] Sum rewards: 72.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.739', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon7': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.266', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:28,453][52662] DAMAGECOUNT value on done: 386520.0 [2024-08-06 03:16:28,454][52662] Sum rewards: 78.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.988', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon4': '0.178', 'AMMO3': '0.241', 'AMMO4': '0.311', 'weapon5': '0.312', 'weapon2': '0.418', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.760', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '65.500'} [2024-08-06 03:16:29,031][52665] DAMAGECOUNT value on done: 388278.0 [2024-08-06 03:16:29,031][52665] Sum rewards: 58.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.075', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon2': '0.202', 'AMMO3': '0.212', 'weapon5': '0.248', 'AMMO4': '0.276', 'WEAPON5': '0.500', 'weapon4': '0.666', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.420', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '49.000'} [2024-08-06 03:16:29,135][52794] DAMAGECOUNT value on done: 389427.0 [2024-08-06 03:16:29,135][52794] Sum rewards: 74.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.222', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.110', 'AMMO4': '0.139', 'weapon5': '0.180', 'weapon2': '0.182', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:29,442][52649] DAMAGECOUNT value on done: 385106.0 [2024-08-06 03:16:29,442][52649] Sum rewards: 74.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.101', 'weapon5': '0.132', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:29,549][52658] DAMAGECOUNT value on done: 389642.0 [2024-08-06 03:16:29,550][52658] Sum rewards: 64.378, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.150', 'weapon2': '0.228', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.408', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '55.500'} [2024-08-06 03:16:29,786][52820] DAMAGECOUNT value on done: 365159.0 [2024-08-06 03:16:29,788][52820] Sum rewards: 82.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.582', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.048', 'weapon5': '0.058', 'AMMO4': '0.109', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.292', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '66.000'} [2024-08-06 03:16:30,192][52647] DAMAGECOUNT value on done: 406289.0 [2024-08-06 03:16:30,192][52647] Sum rewards: 62.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.231', 'weapon2': '0.394', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.318', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:30,750][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:16:30,786][52660] DAMAGECOUNT value on done: 398651.0 [2024-08-06 03:16:30,786][52660] Sum rewards: 67.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.255', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.384', 'WEAPON3': '1.700', 'weapon3': '3.394', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:31,184][52671] DAMAGECOUNT value on done: 398365.0 [2024-08-06 03:16:31,184][52671] Sum rewards: 72.300, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.038', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.298', 'weapon2': '0.436', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:31,329][52650] Updated weights for policy 0, policy_version 44511 (0.0013) [2024-08-06 03:16:31,697][52803] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:16:31,717][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:16:31,991][52794] DAMAGECOUNT value on done: 393132.0 [2024-08-06 03:16:31,991][52794] Sum rewards: 61.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.012', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.184', 'AMMO4': '0.211', 'weapon2': '0.238', 'weapon4': '0.246', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.066', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '52.000'} [2024-08-06 03:16:32,407][52649] DAMAGECOUNT value on done: 377340.0 [2024-08-06 03:16:32,407][52649] Sum rewards: 72.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO4': '0.173', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:32,619][52658] DAMAGECOUNT value on done: 389342.0 [2024-08-06 03:16:32,620][52658] Sum rewards: 69.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.948', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.180', 'weapon2': '0.222', 'AMMO4': '0.234', 'AMMO3': '0.249', 'weapon4': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '58.500'} [2024-08-06 03:16:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 364650496. Throughput: 0: 4354.2. Samples: 91162760. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:16:32,794][52567] Avg episode reward: [(0, '69.898')] [2024-08-06 03:16:33,079][52820] DAMAGECOUNT value on done: 360791.0 [2024-08-06 03:16:33,080][52820] Sum rewards: 73.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.434', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.139', 'weapon5': '0.206', 'AMMO4': '0.211', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '0.900', 'weapon3': '2.882', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:33,225][52647] DAMAGECOUNT value on done: 419211.0 [2024-08-06 03:16:33,226][52647] Sum rewards: 76.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.176', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon5': '0.214', 'AMMO3': '0.226', 'weapon2': '0.232', 'weapon4': '0.284', 'AMMO4': '0.289', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '65.000'} [2024-08-06 03:16:33,614][52660] DAMAGECOUNT value on done: 401781.0 [2024-08-06 03:16:33,616][52660] Sum rewards: 81.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.262', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '66.000'} [2024-08-06 03:16:33,701][52671] DAMAGECOUNT value on done: 401307.0 [2024-08-06 03:16:33,701][52671] Sum rewards: 72.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.135', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon5': '0.206', 'weapon2': '0.654', 'WEAPON3': '0.900', 'weapon3': '2.922', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:35,233][52794] DAMAGECOUNT value on done: 398526.0 [2024-08-06 03:16:35,242][52794] Sum rewards: 70.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.265', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.100', 'weapon5': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.050', 'HITCOUNT': '3.260', 'weapon3': '3.296', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:35,453][52649] DAMAGECOUNT value on done: 384652.0 [2024-08-06 03:16:35,454][52649] Sum rewards: 64.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO4': '0.077', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:35,550][52647] DAMAGECOUNT value on done: 409830.0 [2024-08-06 03:16:35,550][52647] Sum rewards: 65.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.442', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.096', 'AMMO3': '0.136', 'weapon5': '0.158', 'AMMO4': '0.173', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '3.060', 'weapon3': '3.212', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '52.000'} [2024-08-06 03:16:35,556][52658] DAMAGECOUNT value on done: 385518.0 [2024-08-06 03:16:35,556][52658] Sum rewards: 64.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.536', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '52.000'} [2024-08-06 03:16:36,099][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:16:36,177][52820] DAMAGECOUNT value on done: 365595.0 [2024-08-06 03:16:36,181][52820] Sum rewards: 61.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.193', 'weapon4': '0.196', 'AMMO4': '0.240', 'weapon5': '0.246', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '51.500'} [2024-08-06 03:16:36,352][52671] DAMAGECOUNT value on done: 390358.0 [2024-08-06 03:16:36,352][52671] Sum rewards: 68.837, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.532', 'AMMO5': '0.013', 'AMMO2': '0.059', 'AMMO3': '0.157', 'weapon5': '0.216', 'AMMO4': '0.294', 'weapon2': '0.330', 'WEAPON5': '0.400', 'weapon4': '0.542', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.526', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:36,508][52650] Updated weights for policy 0, policy_version 44521 (0.0015) [2024-08-06 03:16:36,736][52660] DAMAGECOUNT value on done: 385822.0 [2024-08-06 03:16:36,737][52660] Sum rewards: 70.852, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.051', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.100', 'HEALTH': '0.160', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '0.900', 'HITCOUNT': '3.110', 'weapon3': '3.252', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:37,725][52662] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:16:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 364740608. Throughput: 0: 4356.9. Samples: 91189200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:16:37,794][52567] Avg episode reward: [(0, '69.859')] [2024-08-06 03:16:37,993][52647] DAMAGECOUNT value on done: 413585.0 [2024-08-06 03:16:37,994][52647] Sum rewards: 63.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.076', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.162', 'weapon4': '0.164', 'AMMO4': '0.174', 'AMMO3': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '53.000'} [2024-08-06 03:16:38,249][52794] DAMAGECOUNT value on done: 388932.0 [2024-08-06 03:16:38,250][52794] Sum rewards: 77.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.587', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon4': '0.106', 'weapon2': '0.182', 'AMMO3': '0.218', 'WEAPON3': '1.350', 'weapon3': '3.522', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '64.000'} [2024-08-06 03:16:38,471][52658] DAMAGECOUNT value on done: 398291.0 [2024-08-06 03:16:38,471][52658] Sum rewards: 78.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.956', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.110', 'weapon4': '0.224', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '65.500'} [2024-08-06 03:16:38,937][52649] DAMAGECOUNT value on done: 385662.0 [2024-08-06 03:16:38,937][52649] Sum rewards: 69.163, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.515', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.376', 'WEAPON3': '2.150', 'weapon3': '3.358', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '65.000'} [2024-08-06 03:16:39,053][52671] DAMAGECOUNT value on done: 402382.0 [2024-08-06 03:16:39,053][52671] Sum rewards: 71.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.078', 'weapon5': '0.134', 'AMMO4': '0.161', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:39,344][52820] DAMAGECOUNT value on done: 358893.0 [2024-08-06 03:16:39,345][52820] Sum rewards: 68.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.238', 'AMMO3': '0.243', 'weapon2': '0.284', 'weapon4': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.754', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:39,360][52660] DAMAGECOUNT value on done: 391596.0 [2024-08-06 03:16:39,361][52660] Sum rewards: 73.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.578', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.088', 'weapon5': '0.134', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.392', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:40,596][52650] Updated weights for policy 0, policy_version 44531 (0.0013) [2024-08-06 03:16:40,650][52794] DAMAGECOUNT value on done: 397619.0 [2024-08-06 03:16:40,652][52794] Sum rewards: 64.338, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.632', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.052', 'AMMO4': '0.052', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.310', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:40,768][52647] DAMAGECOUNT value on done: 406205.0 [2024-08-06 03:16:40,768][52647] Sum rewards: 59.645, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.746', 'AMMO5': '0.022', 'AMMO2': '0.075', 'weapon4': '0.114', 'weapon2': '0.270', 'weapon5': '0.294', 'AMMO3': '0.299', 'AMMO4': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.910', 'weapon3': '2.970', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:41,364][52658] DAMAGECOUNT value on done: 390622.0 [2024-08-06 03:16:41,365][52658] Sum rewards: 72.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.756', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.160', 'AMMO4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:41,698][52671] DAMAGECOUNT value on done: 392071.0 [2024-08-06 03:16:41,699][52671] Sum rewards: 62.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.460', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.196', 'AMMO3': '0.199', 'weapon4': '0.278', 'AMMO4': '0.304', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:41,790][52649] DAMAGECOUNT value on done: 386413.0 [2024-08-06 03:16:41,791][52649] Sum rewards: 63.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.098', 'weapon2': '0.144', 'AMMO4': '0.155', 'weapon4': '0.180', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.342', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:42,388][52660] DAMAGECOUNT value on done: 385599.0 [2024-08-06 03:16:42,392][52660] Sum rewards: 66.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.314', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:42,484][52820] DAMAGECOUNT value on done: 362335.0 [2024-08-06 03:16:42,488][52820] Sum rewards: 66.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.058', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon2': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'HITCOUNT': '3.410', 'weapon3': '3.514', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:42,738][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:16:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 364830720. Throughput: 0: 4359.6. Samples: 91215340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:16:42,794][52567] Avg episode reward: [(0, '69.796')] [2024-08-06 03:16:43,204][52794] DAMAGECOUNT value on done: 392632.0 [2024-08-06 03:16:43,206][52794] Sum rewards: 61.332, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.504', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO3': '0.164', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '3.096', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '48.000'} [2024-08-06 03:16:43,366][52647] DAMAGECOUNT value on done: 409631.0 [2024-08-06 03:16:43,367][52647] Sum rewards: 66.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.498', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.127', 'weapon5': '0.144', 'weapon2': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.292', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:44,380][52658] DAMAGECOUNT value on done: 392663.0 [2024-08-06 03:16:44,380][52658] Sum rewards: 58.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.676', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.243', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.246', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '50.000'} [2024-08-06 03:16:44,600][52671] DAMAGECOUNT value on done: 384701.0 [2024-08-06 03:16:44,602][52671] Sum rewards: 60.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.228', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.100', 'AMMO4': '0.188', 'weapon2': '0.206', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon4': '0.542', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '53.000'} [2024-08-06 03:16:44,858][52649] DAMAGECOUNT value on done: 385751.0 [2024-08-06 03:16:44,858][52649] Sum rewards: 75.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.602', 'AMMO5': '0.019', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.125', 'AMMO3': '0.180', 'weapon4': '0.224', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:44,867][52660] DAMAGECOUNT value on done: 393125.0 [2024-08-06 03:16:44,867][52660] Sum rewards: 73.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.095', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '61.000'} [2024-08-06 03:16:44,966][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:16:45,361][52650] Updated weights for policy 0, policy_version 44541 (0.0031) [2024-08-06 03:16:45,401][52649] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:16:45,681][52820] DAMAGECOUNT value on done: 367117.0 [2024-08-06 03:16:45,689][52820] Sum rewards: 69.341, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.280', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'weapon5': '0.046', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:46,041][52794] DAMAGECOUNT value on done: 389432.0 [2024-08-06 03:16:46,042][52647] DAMAGECOUNT value on done: 410038.0 [2024-08-06 03:16:46,042][52794] Sum rewards: 70.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.124', 'AMMO4': '0.151', 'weapon2': '0.210', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.378', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:46,042][52647] Sum rewards: 70.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.090', 'weapon4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:47,062][52658] DAMAGECOUNT value on done: 396291.0 [2024-08-06 03:16:47,065][52658] Sum rewards: 75.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.076', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.085', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:47,571][52671] DAMAGECOUNT value on done: 399811.0 [2024-08-06 03:16:47,571][52671] Sum rewards: 68.553, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.199', 'weapon2': '0.246', 'AMMO3': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.286', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:47,717][52660] DAMAGECOUNT value on done: 387544.0 [2024-08-06 03:16:47,718][52660] Sum rewards: 69.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.544', 'AMMO5': '0.009', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.042', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 364920832. Throughput: 0: 4370.0. Samples: 91228770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:16:47,794][52567] Avg episode reward: [(0, '69.789')] [2024-08-06 03:16:48,018][52649] DAMAGECOUNT value on done: 378517.0 [2024-08-06 03:16:48,018][52649] Sum rewards: 83.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.696', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.236', 'weapon4': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '70.000'} [2024-08-06 03:16:48,728][52794] DAMAGECOUNT value on done: 396278.0 [2024-08-06 03:16:48,729][52794] Sum rewards: 74.737, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.134', 'weapon5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:48,781][52647] DAMAGECOUNT value on done: 418950.0 [2024-08-06 03:16:48,783][52647] Sum rewards: 72.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.455', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.034', 'AMMO4': '0.155', 'weapon5': '0.180', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '58.500'} [2024-08-06 03:16:48,887][52820] DAMAGECOUNT value on done: 363874.0 [2024-08-06 03:16:48,891][52820] Sum rewards: 68.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.616', 'AMMO5': '0.007', 'weapon5': '0.024', 'AMMO2': '0.032', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon4': '0.330', 'weapon2': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.126', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:49,314][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:16:50,292][52650] Updated weights for policy 0, policy_version 44551 (0.0012) [2024-08-06 03:16:50,367][52671] DAMAGECOUNT value on done: 398775.0 [2024-08-06 03:16:50,367][52671] Sum rewards: 74.880, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.037', 'weapon4': '0.166', 'AMMO3': '0.177', 'AMMO4': '0.187', 'weapon5': '0.216', 'weapon2': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2024-08-06 03:16:51,201][52649] DAMAGECOUNT value on done: 384417.0 [2024-08-06 03:16:51,210][52649] Sum rewards: 76.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.217', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.212', 'weapon4': '0.218', 'AMMO3': '0.232', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '64.000'} [2024-08-06 03:16:51,414][52647] DAMAGECOUNT value on done: 409287.0 [2024-08-06 03:16:51,414][52647] Sum rewards: 68.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO4': '0.062', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.210', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '57.000'} [2024-08-06 03:16:51,420][52794] DAMAGECOUNT value on done: 385408.0 [2024-08-06 03:16:51,420][52794] Sum rewards: 74.821, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.157', 'weapon5': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.336', 'HEALTH': '0.340', 'WEAPON3': '0.900', 'weapon3': '2.992', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:52,048][52820] DAMAGECOUNT value on done: 367591.0 [2024-08-06 03:16:52,048][52820] Sum rewards: 69.157, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon2': '0.168', 'AMMO3': '0.171', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.136', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '55.000'} [2024-08-06 03:16:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 365002752. Throughput: 0: 4367.6. Samples: 91254940. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:16:52,794][52567] Avg episode reward: [(0, '70.177')] [2024-08-06 03:16:52,903][52671] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:16:53,103][52671] DAMAGECOUNT value on done: 400529.0 [2024-08-06 03:16:53,105][52671] Sum rewards: 75.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.394', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.193', 'weapon5': '0.218', 'AMMO4': '0.221', 'weapon2': '0.246', 'WEAPON5': '0.450', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:53,262][52665] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.054, -18.0)] [2024-08-06 03:16:53,841][52649] DAMAGECOUNT value on done: 379918.0 [2024-08-06 03:16:53,843][52649] Sum rewards: 72.023, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.945', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.138', 'AMMO3': '0.183', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '59.000'} [2024-08-06 03:16:54,320][52794] DAMAGECOUNT value on done: 402872.0 [2024-08-06 03:16:54,320][52794] Sum rewards: 72.564, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.608', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO4': '0.209', 'AMMO3': '0.256', 'weapon4': '0.274', 'weapon5': '0.274', 'weapon2': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.810', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '62.000'} [2024-08-06 03:16:54,441][52647] DAMAGECOUNT value on done: 407522.0 [2024-08-06 03:16:54,441][52647] Sum rewards: 64.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.558', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.234', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.352', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '54.000'} [2024-08-06 03:16:54,800][52650] Updated weights for policy 0, policy_version 44561 (0.0042) [2024-08-06 03:16:55,147][52820] DAMAGECOUNT value on done: 362871.0 [2024-08-06 03:16:55,148][52820] Sum rewards: 68.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.605', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.050', 'weapon4': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:55,283][52658] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:16:55,986][52671] DAMAGECOUNT value on done: 395755.0 [2024-08-06 03:16:55,986][52671] Sum rewards: 76.033, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.110', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'weapon3': '3.394', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '66.000'} [2024-08-06 03:16:56,946][52794] DAMAGECOUNT value on done: 385514.0 [2024-08-06 03:16:56,947][52794] Sum rewards: 73.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.351', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '58.000'} [2024-08-06 03:16:56,952][52649] DAMAGECOUNT value on done: 387385.0 [2024-08-06 03:16:56,954][52649] Sum rewards: 77.209, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'weapon5': '0.120', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '61.500'} [2024-08-06 03:16:57,495][52647] DAMAGECOUNT value on done: 407499.0 [2024-08-06 03:16:57,496][52647] Sum rewards: 76.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17467.4). Total num frames: 365092864. Throughput: 0: 4367.8. Samples: 91281420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:16:57,795][52567] Avg episode reward: [(0, '70.094')] [2024-08-06 03:16:58,258][52820] DAMAGECOUNT value on done: 360623.0 [2024-08-06 03:16:58,258][52820] Sum rewards: 73.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.289', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO4': '0.154', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.284', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '63.000'} [2024-08-06 03:16:58,923][52671] DAMAGECOUNT value on done: 392259.0 [2024-08-06 03:16:58,924][52671] Sum rewards: 63.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.380', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.114', 'weapon5': '0.212', 'AMMO4': '0.235', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '56.000'} [2024-08-06 03:16:59,527][52650] Updated weights for policy 0, policy_version 44571 (0.0014) [2024-08-06 03:16:59,616][52649] DAMAGECOUNT value on done: 388687.0 [2024-08-06 03:16:59,618][52649] Sum rewards: 62.403, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.138', 'weapon4': '0.206', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'HITCOUNT': '3.330', 'weapon3': '3.368', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 03:17:00,037][52794] DAMAGECOUNT value on done: 402376.0 [2024-08-06 03:17:00,039][52794] Sum rewards: 69.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.251', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.249', 'weapon2': '0.258', 'weapon5': '0.262', 'AMMO4': '0.280', 'weapon4': '0.414', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.762', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 03:17:00,511][52647] DAMAGECOUNT value on done: 405859.0 [2024-08-06 03:17:00,512][52647] Sum rewards: 78.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.658', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.154', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'weapon4': '0.434', 'WEAPON3': '1.000', 'weapon3': '2.824', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '64.000'} [2024-08-06 03:17:00,969][52659] DAMAGECOUNT value on done: 394534.0 [2024-08-06 03:17:00,970][52659] Sum rewards: 56.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.019', 'AMMO5': '0.020', 'AMMO2': '0.066', 'AMMO3': '0.202', 'weapon5': '0.286', 'AMMO4': '0.329', 'weapon2': '0.374', 'weapon4': '0.520', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.490', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '46.000'} [2024-08-06 03:17:01,282][52820] DAMAGECOUNT value on done: 371438.0 [2024-08-06 03:17:01,282][52820] Sum rewards: 76.734, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.012', 'weapon4': '0.056', 'AMMO2': '0.058', 'weapon5': '0.160', 'AMMO3': '0.273', 'AMMO4': '0.291', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '66.000'} [2024-08-06 03:17:02,702][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:17:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 365182976. Throughput: 0: 4374.0. Samples: 91294610. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:17:02,795][52567] Avg episode reward: [(0, '70.022')] [2024-08-06 03:17:02,884][52649] DAMAGECOUNT value on done: 386101.0 [2024-08-06 03:17:02,884][52649] Sum rewards: 70.955, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.202', 'WEAPON4': '0.250', 'HEALTH': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.050', 'weapon3': '3.094', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 03:17:02,912][52794] DAMAGECOUNT value on done: 393873.0 [2024-08-06 03:17:02,913][52794] Sum rewards: 62.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon2': '0.144', 'weapon4': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.324', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '53.000'} [2024-08-06 03:17:03,472][52647] DAMAGECOUNT value on done: 410178.0 [2024-08-06 03:17:03,472][52647] Sum rewards: 66.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.156', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon2': '0.210', 'AMMO3': '0.267', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.336', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '59.000'} [2024-08-06 03:17:03,898][52659] DAMAGECOUNT value on done: 393896.0 [2024-08-06 03:17:03,900][52659] Sum rewards: 60.817, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.096', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.275', 'weapon2': '0.394', 'WEAPON3': '1.700', 'HITCOUNT': '3.240', 'weapon3': '3.346', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '55.000'} [2024-08-06 03:17:04,273][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:17:04,404][52650] Updated weights for policy 0, policy_version 44581 (0.0024) [2024-08-06 03:17:04,443][52820] DAMAGECOUNT value on done: 373619.0 [2024-08-06 03:17:04,446][52820] Sum rewards: 70.004, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.998', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.098', 'AMMO4': '0.194', 'weapon5': '0.222', 'AMMO3': '0.252', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.970', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '61.000'} [2024-08-06 03:17:05,883][52794] DAMAGECOUNT value on done: 395043.0 [2024-08-06 03:17:05,885][52794] Sum rewards: 61.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.084', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.710', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.994', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '51.000'} [2024-08-06 03:17:06,689][52659] DAMAGECOUNT value on done: 393970.0 [2024-08-06 03:17:06,691][52659] Sum rewards: 74.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.504', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2024-08-06 03:17:07,452][52614] Signal inference workers to stop experience collection... (8050 times) [2024-08-06 03:17:07,459][52614] Signal inference workers to resume experience collection... (8050 times) [2024-08-06 03:17:07,531][52650] InferenceWorker_p0-w0: stopping experience collection (8050 times) [2024-08-06 03:17:07,532][52650] InferenceWorker_p0-w0: resuming experience collection (8050 times) [2024-08-06 03:17:07,572][52820] DAMAGECOUNT value on done: 360417.0 [2024-08-06 03:17:07,574][52820] Sum rewards: 67.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.799', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '55.500'} [2024-08-06 03:17:07,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 365273088. Throughput: 0: 4375.3. Samples: 91320820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:17:07,794][52567] Avg episode reward: [(0, '69.525')] [2024-08-06 03:17:08,520][52650] Updated weights for policy 0, policy_version 44591 (0.0033) [2024-08-06 03:17:08,900][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:17:08,959][52794] DAMAGECOUNT value on done: 405076.0 [2024-08-06 03:17:08,960][52794] Sum rewards: 72.990, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.588', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon4': '0.192', 'weapon5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '63.000'} [2024-08-06 03:17:09,701][52659] DAMAGECOUNT value on done: 392655.0 [2024-08-06 03:17:09,702][52659] Sum rewards: 69.428, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.855', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO4': '0.193', 'weapon4': '0.224', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '59.000'} [2024-08-06 03:17:11,916][52794] DAMAGECOUNT value on done: 392933.0 [2024-08-06 03:17:11,917][52794] Sum rewards: 58.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.074', 'AMMO3': '0.153', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.640', 'WEAPON3': '0.950', 'weapon3': '2.982', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '47.000'} [2024-08-06 03:17:12,637][52659] DAMAGECOUNT value on done: 390093.0 [2024-08-06 03:17:12,637][52659] Sum rewards: 60.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.038', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.818', 'WEAPON3': '1.150', 'weapon3': '2.756', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '50.000'} [2024-08-06 03:17:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 365346816. Throughput: 0: 4374.0. Samples: 91347040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:17:12,794][52567] Avg episode reward: [(0, '69.223')] [2024-08-06 03:17:13,591][52650] Updated weights for policy 0, policy_version 44601 (0.0020) [2024-08-06 03:17:15,296][52659] DAMAGECOUNT value on done: 393080.0 [2024-08-06 03:17:15,298][52659] Sum rewards: 59.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.464', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.096', 'weapon5': '0.102', 'AMMO3': '0.236', 'weapon2': '0.252', 'AMMO4': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.272', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '50.000'} [2024-08-06 03:17:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 365445120. Throughput: 0: 4391.1. Samples: 91360360. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:17:17,802][52567] Avg episode reward: [(0, '69.300')] [2024-08-06 03:17:17,863][52659] DAMAGECOUNT value on done: 393631.0 [2024-08-06 03:17:17,863][52659] Sum rewards: 75.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.154', 'weapon2': '0.192', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.446', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '63.000'} [2024-08-06 03:17:18,463][52650] Updated weights for policy 0, policy_version 44611 (0.0019) [2024-08-06 03:17:20,817][52666] DAMAGECOUNT value on done: 392071.0 [2024-08-06 03:17:20,817][52666] Sum rewards: 67.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.614', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO4': '0.048', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.000'} [2024-08-06 03:17:21,059][52659] DAMAGECOUNT value on done: 390985.0 [2024-08-06 03:17:21,060][52659] Sum rewards: 56.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.665', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.270', 'weapon4': '0.280', 'WEAPON4': '0.350', 'ARMOR': '0.459', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '3.164', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '47.000'} [2024-08-06 03:17:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 365527040. Throughput: 0: 4378.0. Samples: 91386210. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 03:17:22,802][52567] Avg episode reward: [(0, '69.263')] [2024-08-06 03:17:22,820][52650] Updated weights for policy 0, policy_version 44621 (0.0013) [2024-08-06 03:17:23,067][52803] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:17:23,693][52666] DAMAGECOUNT value on done: 397704.0 [2024-08-06 03:17:23,693][52666] Sum rewards: 73.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.080', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.185', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '61.000'} [2024-08-06 03:17:24,043][52659] DAMAGECOUNT value on done: 401052.0 [2024-08-06 03:17:24,043][52659] Sum rewards: 76.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '63.000'} [2024-08-06 03:17:25,428][52670] DAMAGECOUNT value on done: 388865.0 [2024-08-06 03:17:25,430][52670] Sum rewards: 84.478, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'HEALTH': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.094', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '70.000'} [2024-08-06 03:17:26,216][52666] DAMAGECOUNT value on done: 397113.0 [2024-08-06 03:17:26,218][52666] Sum rewards: 80.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.053', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.193', 'AMMO4': '0.193', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '65.000'} [2024-08-06 03:17:27,033][52659] DAMAGECOUNT value on done: 401956.0 [2024-08-06 03:17:27,033][52659] Sum rewards: 69.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.586', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'weapon4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.538', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '61.000'} [2024-08-06 03:17:27,523][52663] DAMAGECOUNT value on done: 397909.0 [2024-08-06 03:17:27,523][52663] Sum rewards: 67.779, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.025', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.434', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '58.000'} [2024-08-06 03:17:27,724][52650] Updated weights for policy 0, policy_version 44631 (0.0013) [2024-08-06 03:17:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 365617152. Throughput: 0: 4379.3. Samples: 91412410. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 03:17:27,794][52567] Avg episode reward: [(0, '69.877')] [2024-08-06 03:17:27,826][52670] DAMAGECOUNT value on done: 393643.0 [2024-08-06 03:17:27,826][52670] Sum rewards: 73.801, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.710', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.094', 'AMMO4': '0.218', 'weapon2': '0.256', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.048', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '63.000'} [2024-08-06 03:17:28,656][52666] DAMAGECOUNT value on done: 394740.0 [2024-08-06 03:17:28,657][52666] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.418', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.204', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '59.000'} [2024-08-06 03:17:30,100][52659] DAMAGECOUNT value on done: 394342.0 [2024-08-06 03:17:30,100][52659] Sum rewards: 61.383, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.188', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.092', 'weapon4': '0.146', 'AMMO4': '0.183', 'AMMO3': '0.243', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '54.000'} [2024-08-06 03:17:30,379][52670] DAMAGECOUNT value on done: 386096.0 [2024-08-06 03:17:30,380][52670] Sum rewards: 79.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.036', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '65.000'} [2024-08-06 03:17:30,535][52663] DAMAGECOUNT value on done: 392769.0 [2024-08-06 03:17:30,540][52663] Sum rewards: 76.081, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.683', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.096', 'weapon5': '0.124', 'AMMO4': '0.201', 'weapon2': '0.220', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '64.000'} [2024-08-06 03:17:31,311][52666] DAMAGECOUNT value on done: 392267.0 [2024-08-06 03:17:31,313][52666] Sum rewards: 76.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO3': '0.180', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.000'} [2024-08-06 03:17:32,130][52650] Updated weights for policy 0, policy_version 44641 (0.0014) [2024-08-06 03:17:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 365707264. Throughput: 0: 4368.0. Samples: 91425330. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 03:17:32,802][52567] Avg episode reward: [(0, '69.969')] [2024-08-06 03:17:33,228][52659] DAMAGECOUNT value on done: 396690.0 [2024-08-06 03:17:33,229][52659] Sum rewards: 69.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.155', 'AMMO4': '0.211', 'weapon2': '0.276', 'weapon4': '0.340', 'weapon5': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.650', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '54.000'} [2024-08-06 03:17:33,284][52670] DAMAGECOUNT value on done: 384381.0 [2024-08-06 03:17:33,284][52670] Sum rewards: 68.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.964', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.187', 'weapon4': '0.188', 'weapon5': '0.216', 'AMMO4': '0.257', 'weapon2': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '57.000'} [2024-08-06 03:17:33,380][52663] DAMAGECOUNT value on done: 388051.0 [2024-08-06 03:17:33,380][52663] Sum rewards: 68.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.561', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.056', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.820', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '58.000'} [2024-08-06 03:17:34,403][52666] DAMAGECOUNT value on done: 384243.0 [2024-08-06 03:17:34,428][52666] Sum rewards: 54.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.035', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.213', 'weapon2': '0.448', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.238', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '47.000'} [2024-08-06 03:17:35,379][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:17:36,265][52663] DAMAGECOUNT value on done: 394817.0 [2024-08-06 03:17:36,265][52663] Sum rewards: 73.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.992', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon4': '0.024', 'AMMO2': '0.032', 'weapon5': '0.084', 'AMMO4': '0.160', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '60.000'} [2024-08-06 03:17:36,402][52659] DAMAGECOUNT value on done: 385389.0 [2024-08-06 03:17:36,402][52659] Sum rewards: 66.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO3': '0.145', 'weapon4': '0.172', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.670', 'WEAPON3': '0.950', 'weapon3': '2.890', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '52.500'} [2024-08-06 03:17:36,464][52670] DAMAGECOUNT value on done: 395054.0 [2024-08-06 03:17:36,465][52670] Sum rewards: 73.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.626', 'AMMO5': '0.009', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.258', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 03:17:37,262][52650] Updated weights for policy 0, policy_version 44651 (0.0012) [2024-08-06 03:17:37,564][52666] DAMAGECOUNT value on done: 393658.0 [2024-08-06 03:17:37,566][52666] Sum rewards: 78.680, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.613', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.162', 'AMMO4': '0.198', 'weapon4': '0.206', 'weapon5': '0.244', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '63.000'} [2024-08-06 03:17:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 365797376. Throughput: 0: 4367.3. Samples: 91451470. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 03:17:37,802][52567] Avg episode reward: [(0, '69.904')] [2024-08-06 03:17:39,191][52659] DAMAGECOUNT value on done: 392302.0 [2024-08-06 03:17:39,201][52659] Sum rewards: 68.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.178', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.484', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 03:17:39,286][52663] DAMAGECOUNT value on done: 390558.0 [2024-08-06 03:17:39,287][52663] Sum rewards: 65.921, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.740', 'AMMO5': '0.015', 'weapon4': '0.018', 'AMMO2': '0.032', 'weapon5': '0.056', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.306', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.340', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '59.000'} [2024-08-06 03:17:39,415][52670] DAMAGECOUNT value on done: 387991.0 [2024-08-06 03:17:39,417][52670] Sum rewards: 74.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.149', 'weapon2': '0.194', 'AMMO3': '0.204', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '59.000'} [2024-08-06 03:17:40,452][52666] DAMAGECOUNT value on done: 391708.0 [2024-08-06 03:17:40,453][52666] Sum rewards: 67.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.074', 'AMMO4': '0.111', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '58.000'} [2024-08-06 03:17:41,619][52650] Updated weights for policy 0, policy_version 44661 (0.0019) [2024-08-06 03:17:42,012][52670] DAMAGECOUNT value on done: 386084.0 [2024-08-06 03:17:42,014][52670] Sum rewards: 86.840, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon5': '0.208', 'AMMO3': '0.231', 'AMMO4': '0.244', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '22.593', 'FRAGCOUNT': '71.000'} [2024-08-06 03:17:42,047][52663] DAMAGECOUNT value on done: 395403.0 [2024-08-06 03:17:42,049][52663] Sum rewards: 64.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.204', 'AMMO3': '0.241', 'AMMO4': '0.255', 'weapon4': '0.324', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.688', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '54.000'} [2024-08-06 03:17:42,081][52659] DAMAGECOUNT value on done: 401372.0 [2024-08-06 03:17:42,084][52659] Sum rewards: 52.256, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.046', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.158', 'weapon5': '0.204', 'AMMO3': '0.225', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '45.000'} [2024-08-06 03:17:42,779][52666] DAMAGECOUNT value on done: 389060.0 [2024-08-06 03:17:42,781][52666] Sum rewards: 77.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.151', 'AMMO3': '0.180', 'weapon5': '0.186', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '62.000'} [2024-08-06 03:17:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 365871104. Throughput: 0: 4367.6. Samples: 91477960. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 03:17:42,802][52567] Avg episode reward: [(0, '69.532')] [2024-08-06 03:17:43,195][52667] Large shaping reward 2.742 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 03:17:44,424][52670] DAMAGECOUNT value on done: 385885.0 [2024-08-06 03:17:44,426][52670] Sum rewards: 72.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.968', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.172', 'AMMO3': '0.195', 'AMMO4': '0.218', 'weapon5': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '62.000'} [2024-08-06 03:17:44,440][52820] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:17:45,005][52659] DAMAGECOUNT value on done: 398589.0 [2024-08-06 03:17:45,005][52659] Sum rewards: 61.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.877', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.048', 'weapon5': '0.174', 'AMMO3': '0.220', 'weapon4': '0.232', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.668', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '51.000'} [2024-08-06 03:17:45,156][52666] DAMAGECOUNT value on done: 385131.0 [2024-08-06 03:17:45,157][52666] Sum rewards: 58.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.076', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.180', 'weapon5': '0.200', 'AMMO4': '0.221', 'weapon4': '0.266', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '48.000'} [2024-08-06 03:17:45,171][52663] DAMAGECOUNT value on done: 392951.0 [2024-08-06 03:17:45,171][52663] Sum rewards: 72.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.477', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.182', 'AMMO3': '0.188', 'weapon5': '0.242', 'AMMO4': '0.270', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '59.000'} [2024-08-06 03:17:46,416][52650] Updated weights for policy 0, policy_version 44671 (0.0012) [2024-08-06 03:17:46,809][52668] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:17:47,120][52670] DAMAGECOUNT value on done: 389265.0 [2024-08-06 03:17:47,122][52670] Sum rewards: 65.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.578', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.240', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '56.000'} [2024-08-06 03:17:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 365969408. Throughput: 0: 4366.0. Samples: 91491080. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 03:17:47,794][52567] Avg episode reward: [(0, '69.653')] [2024-08-06 03:17:48,002][52666] DAMAGECOUNT value on done: 389027.0 [2024-08-06 03:17:48,002][52666] Sum rewards: 72.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.554', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.119', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '61.000'} [2024-08-06 03:17:48,103][52659] DAMAGECOUNT value on done: 399787.0 [2024-08-06 03:17:48,103][52659] Sum rewards: 71.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.652', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.192', 'AMMO3': '0.203', 'AMMO4': '0.220', 'weapon5': '0.230', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 03:17:48,284][52663] DAMAGECOUNT value on done: 390500.0 [2024-08-06 03:17:48,286][52663] Sum rewards: 77.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.018', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.145', 'weapon5': '0.190', 'weapon4': '0.194', 'AMMO4': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.680', 'WEAPON3': '0.900', 'weapon3': '2.730', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.000'} [2024-08-06 03:17:49,944][52670] DAMAGECOUNT value on done: 383184.0 [2024-08-06 03:17:49,944][52670] Sum rewards: 65.703, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.559', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.128', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.242', 'AMMO3': '0.273', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.270', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '57.000'} [2024-08-06 03:17:50,735][52666] DAMAGECOUNT value on done: 388103.0 [2024-08-06 03:17:50,736][52666] Sum rewards: 65.605, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.425', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon5': '0.196', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '52.000'} [2024-08-06 03:17:51,020][52659] DAMAGECOUNT value on done: 392794.0 [2024-08-06 03:17:51,021][52659] Sum rewards: 81.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.406', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '66.000'} [2024-08-06 03:17:51,161][52650] Updated weights for policy 0, policy_version 44681 (0.0012) [2024-08-06 03:17:51,183][52663] DAMAGECOUNT value on done: 390357.0 [2024-08-06 03:17:51,183][52663] Sum rewards: 74.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.930', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.094', 'weapon5': '0.160', 'AMMO3': '0.206', 'AMMO4': '0.216', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '63.000'} [2024-08-06 03:17:51,996][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:17:52,704][52670] DAMAGECOUNT value on done: 394374.0 [2024-08-06 03:17:52,707][52670] Sum rewards: 63.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.192', 'AMMO3': '0.226', 'weapon4': '0.242', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.700', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '54.000'} [2024-08-06 03:17:52,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 366059520. Throughput: 0: 4367.1. Samples: 91517340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:17:52,794][52567] Avg episode reward: [(0, '69.703')] [2024-08-06 03:17:53,629][52659] DAMAGECOUNT value on done: 398862.0 [2024-08-06 03:17:53,629][52659] Sum rewards: 68.237, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.108', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.205', 'HEALTH': '0.490', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.250', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '57.000'} [2024-08-06 03:17:53,834][52666] DAMAGECOUNT value on done: 396580.0 [2024-08-06 03:17:53,835][52666] Sum rewards: 57.521, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.850', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO4': '0.185', 'weapon4': '0.282', 'AMMO3': '0.295', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.902', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2024-08-06 03:17:54,094][52663] DAMAGECOUNT value on done: 394843.0 [2024-08-06 03:17:54,096][52663] Sum rewards: 64.719, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.666', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.154', 'weapon2': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.270', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.146', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 03:17:55,774][52650] Updated weights for policy 0, policy_version 44691 (0.0030) [2024-08-06 03:17:55,880][52670] DAMAGECOUNT value on done: 387151.0 [2024-08-06 03:17:55,881][52670] Sum rewards: 78.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.438', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.026', 'weapon4': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.229', 'weapon2': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.500', 'weapon3': '3.546', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '66.000'} [2024-08-06 03:17:56,520][52659] DAMAGECOUNT value on done: 397782.0 [2024-08-06 03:17:56,520][52659] Sum rewards: 75.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.162', 'weapon4': '0.186', 'weapon2': '0.192', 'AMMO3': '0.267', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.264', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '66.000'} [2024-08-06 03:17:56,911][52666] DAMAGECOUNT value on done: 392191.0 [2024-08-06 03:17:56,912][52666] Sum rewards: 71.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.321', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.168', 'AMMO4': '0.184', 'weapon2': '0.192', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.232', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '61.500'} [2024-08-06 03:17:56,935][52663] DAMAGECOUNT value on done: 397936.0 [2024-08-06 03:17:56,936][52663] Sum rewards: 74.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.987', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.028', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 03:17:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 366141440. Throughput: 0: 4363.1. Samples: 91543380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:17:57,794][52567] Avg episode reward: [(0, '70.066')] [2024-08-06 03:17:59,012][52670] DAMAGECOUNT value on done: 388237.0 [2024-08-06 03:17:59,013][52670] Sum rewards: 58.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.825', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon4': '0.156', 'AMMO3': '0.228', 'weapon2': '0.272', 'AMMO4': '0.294', 'weapon5': '0.358', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.710', 'weapon3': '2.878', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '51.000'} [2024-08-06 03:17:59,688][52663] DAMAGECOUNT value on done: 394364.0 [2024-08-06 03:17:59,689][52663] Sum rewards: 64.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.688', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.604', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '54.000'} [2024-08-06 03:18:00,161][52666] DAMAGECOUNT value on done: 388705.0 [2024-08-06 03:18:00,162][52666] Sum rewards: 67.720, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.959', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.074', 'weapon2': '0.252', 'AMMO3': '0.306', 'WEAPON3': '1.750', 'weapon3': '3.408', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:00,558][52650] Updated weights for policy 0, policy_version 44701 (0.0022) [2024-08-06 03:18:02,190][52670] DAMAGECOUNT value on done: 395905.0 [2024-08-06 03:18:02,190][52670] Sum rewards: 73.373, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.070', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '0.800', 'weapon3': '2.998', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '56.000'} [2024-08-06 03:18:02,311][52663] DAMAGECOUNT value on done: 388191.0 [2024-08-06 03:18:02,311][52663] Sum rewards: 61.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.657', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.140', 'weapon4': '0.186', 'AMMO3': '0.190', 'AMMO4': '0.201', 'weapon2': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.194', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '50.000'} [2024-08-06 03:18:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 366223360. Throughput: 0: 4359.3. Samples: 91556530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:18:02,794][52567] Avg episode reward: [(0, '69.968')] [2024-08-06 03:18:03,330][52666] DAMAGECOUNT value on done: 390757.0 [2024-08-06 03:18:03,332][52666] Sum rewards: 65.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.945', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.128', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.416', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '54.000'} [2024-08-06 03:18:04,868][52663] DAMAGECOUNT value on done: 388704.0 [2024-08-06 03:18:04,868][52663] Sum rewards: 57.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.018', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO3': '0.173', 'AMMO4': '0.174', 'weapon4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '2.918', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '46.500'} [2024-08-06 03:18:05,342][52670] DAMAGECOUNT value on done: 392161.0 [2024-08-06 03:18:05,342][52670] Sum rewards: 67.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.635', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.680', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 03:18:05,355][52650] Updated weights for policy 0, policy_version 44711 (0.0012) [2024-08-06 03:18:06,360][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:18:06,366][52666] DAMAGECOUNT value on done: 390844.0 [2024-08-06 03:18:06,366][52666] Sum rewards: 70.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.425', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.144', 'AMMO4': '0.146', 'AMMO3': '0.186', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '58.000'} [2024-08-06 03:18:07,529][52663] DAMAGECOUNT value on done: 389737.0 [2024-08-06 03:18:07,529][52663] Sum rewards: 74.569, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.217', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.162', 'AMMO3': '0.171', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.500'} [2024-08-06 03:18:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 366313472. Throughput: 0: 4366.2. Samples: 91582690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:18:07,794][52567] Avg episode reward: [(0, '69.781')] [2024-08-06 03:18:08,150][52670] DAMAGECOUNT value on done: 377082.0 [2024-08-06 03:18:08,151][52670] Sum rewards: 67.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.175', 'weapon5': '0.222', 'weapon4': '0.224', 'AMMO4': '0.247', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '55.000'} [2024-08-06 03:18:08,985][52667] DAMAGECOUNT value on done: 392257.0 [2024-08-06 03:18:08,985][52667] Sum rewards: 72.046, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.280', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO3': '0.170', 'AMMO4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.000', 'HITCOUNT': '3.150', 'weapon3': '3.294', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '58.000'} [2024-08-06 03:18:09,317][52666] DAMAGECOUNT value on done: 392839.0 [2024-08-06 03:18:09,319][52666] Sum rewards: 75.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.555', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.120', 'weapon2': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON3': '1.400', 'weapon3': '3.380', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '63.000'} [2024-08-06 03:18:09,700][52650] Updated weights for policy 0, policy_version 44721 (0.0011) [2024-08-06 03:18:09,961][52658] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:18:10,202][52663] DAMAGECOUNT value on done: 399013.0 [2024-08-06 03:18:10,202][52663] Sum rewards: 57.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.624', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon5': '0.134', 'AMMO3': '0.166', 'weapon4': '0.294', 'AMMO4': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.368', 'ARMOR': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '2.880', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '47.000'} [2024-08-06 03:18:11,277][52670] DAMAGECOUNT value on done: 389970.0 [2024-08-06 03:18:11,278][52670] Sum rewards: 58.047, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.097', 'weapon5': '0.100', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.658', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '2.940', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '46.000'} [2024-08-06 03:18:11,952][52667] DAMAGECOUNT value on done: 399958.0 [2024-08-06 03:18:11,953][52667] Sum rewards: 63.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.026', 'weapon4': '0.054', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.144', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.588', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '53.000'} [2024-08-06 03:18:12,498][52666] DAMAGECOUNT value on done: 382383.0 [2024-08-06 03:18:12,499][52666] Sum rewards: 64.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.812', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.132', 'weapon4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.044', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '55.000'} [2024-08-06 03:18:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 366403584. Throughput: 0: 4367.3. Samples: 91608940. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:18:12,802][52567] Avg episode reward: [(0, '69.168')] [2024-08-06 03:18:12,822][52663] DAMAGECOUNT value on done: 389763.0 [2024-08-06 03:18:12,823][52663] Sum rewards: 64.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.556', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.190', 'weapon4': '0.226', 'AMMO3': '0.237', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2024-08-06 03:18:12,890][52811] DAMAGECOUNT value on done: 378624.0 [2024-08-06 03:18:12,891][52811] Sum rewards: 55.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.505', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.212', 'AMMO4': '0.242', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '48.000'} [2024-08-06 03:18:13,201][52803] DAMAGECOUNT value on done: 369924.0 [2024-08-06 03:18:13,204][52803] Sum rewards: 69.510, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.372', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.065', 'AMMO3': '0.216', 'weapon5': '0.260', 'weapon2': '0.304', 'AMMO4': '0.323', 'weapon4': '0.382', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '59.500'} [2024-08-06 03:18:14,352][52650] Updated weights for policy 0, policy_version 44731 (0.0043) [2024-08-06 03:18:14,491][52670] DAMAGECOUNT value on done: 396950.0 [2024-08-06 03:18:14,492][52670] Sum rewards: 72.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.022', 'AMMO2': '0.052', 'weapon4': '0.134', 'weapon2': '0.182', 'weapon5': '0.196', 'AMMO3': '0.223', 'AMMO4': '0.262', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.254', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '62.000'} [2024-08-06 03:18:14,679][52667] DAMAGECOUNT value on done: 392992.0 [2024-08-06 03:18:14,680][52667] Sum rewards: 73.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.070', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:15,716][52663] DAMAGECOUNT value on done: 395830.0 [2024-08-06 03:18:15,716][52663] Sum rewards: 61.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.064', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.136', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '52.500'} [2024-08-06 03:18:15,845][52811] DAMAGECOUNT value on done: 366113.0 [2024-08-06 03:18:15,846][52811] Sum rewards: 68.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.004', 'weapon5': '0.036', 'AMMO2': '0.037', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.212', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '57.000'} [2024-08-06 03:18:15,986][52666] DAMAGECOUNT value on done: 391255.0 [2024-08-06 03:18:15,986][52666] Sum rewards: 61.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.546', 'AMMO5': '0.020', 'AMMO2': '0.073', 'weapon4': '0.120', 'AMMO3': '0.230', 'weapon5': '0.280', 'weapon2': '0.286', 'AMMO4': '0.363', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.926', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '53.000'} [2024-08-06 03:18:16,244][52803] DAMAGECOUNT value on done: 365059.0 [2024-08-06 03:18:16,247][52803] Sum rewards: 61.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.102', 'weapon5': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.158', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '52.000'} [2024-08-06 03:18:17,230][52667] DAMAGECOUNT value on done: 396108.0 [2024-08-06 03:18:17,230][52667] Sum rewards: 79.950, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.545', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.158', 'weapon5': '0.194', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '65.000'} [2024-08-06 03:18:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 366485504. Throughput: 0: 4375.8. Samples: 91622240. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:18:17,794][52567] Avg episode reward: [(0, '68.666')] [2024-08-06 03:18:17,955][52670] DAMAGECOUNT value on done: 390210.0 [2024-08-06 03:18:17,955][52670] Sum rewards: 57.040, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon4': '0.060', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.010', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '47.000'} [2024-08-06 03:18:18,638][52663] DAMAGECOUNT value on done: 395047.0 [2024-08-06 03:18:18,640][52663] Sum rewards: 76.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.102', 'AMMO3': '0.155', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON3': '1.050', 'weapon3': '3.504', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '62.000'} [2024-08-06 03:18:18,933][52811] DAMAGECOUNT value on done: 365976.0 [2024-08-06 03:18:18,933][52811] Sum rewards: 66.084, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.365', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO3': '0.167', 'AMMO4': '0.171', 'weapon2': '0.292', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '55.000'} [2024-08-06 03:18:19,339][52803] DAMAGECOUNT value on done: 370813.0 [2024-08-06 03:18:19,340][52803] Sum rewards: 71.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.080', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.224', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.438', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:19,402][52650] Updated weights for policy 0, policy_version 44741 (0.0012) [2024-08-06 03:18:20,087][52667] DAMAGECOUNT value on done: 400009.0 [2024-08-06 03:18:20,087][52667] Sum rewards: 66.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon4': '0.106', 'AMMO4': '0.209', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '56.500'} [2024-08-06 03:18:20,621][52670] DAMAGECOUNT value on done: 391286.0 [2024-08-06 03:18:20,622][52670] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.159', 'weapon5': '0.170', 'weapon4': '0.192', 'AMMO4': '0.195', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.046', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '56.000'} [2024-08-06 03:18:21,846][52663] DAMAGECOUNT value on done: 387647.0 [2024-08-06 03:18:21,846][52663] Sum rewards: 56.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.028', 'AMMO2': '0.050', 'AMMO3': '0.211', 'weapon5': '0.246', 'AMMO4': '0.249', 'weapon4': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'weapon2': '0.752', 'WEAPON3': '1.200', 'weapon3': '2.364', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.589', 'FRAGCOUNT': '47.000'} [2024-08-06 03:18:22,040][52811] DAMAGECOUNT value on done: 367195.0 [2024-08-06 03:18:22,042][52811] Sum rewards: 78.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.310', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '65.000'} [2024-08-06 03:18:22,295][52803] DAMAGECOUNT value on done: 373835.0 [2024-08-06 03:18:22,296][52803] Sum rewards: 84.106, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.262', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '66.000'} [2024-08-06 03:18:22,502][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:18:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 366575616. Throughput: 0: 4378.7. Samples: 91648510. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:18:22,794][52567] Avg episode reward: [(0, '68.608')] [2024-08-06 03:18:22,835][52667] DAMAGECOUNT value on done: 399533.0 [2024-08-06 03:18:22,835][52667] Sum rewards: 81.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.041', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.146', 'weapon5': '0.146', 'AMMO3': '0.201', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '67.000'} [2024-08-06 03:18:23,730][52650] Updated weights for policy 0, policy_version 44751 (0.0020) [2024-08-06 03:18:25,181][52811] DAMAGECOUNT value on done: 369569.0 [2024-08-06 03:18:25,184][52811] Sum rewards: 62.440, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.600', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon5': '0.194', 'weapon2': '0.214', 'AMMO3': '0.261', 'AMMO4': '0.284', 'weapon4': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.896', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '56.000'} [2024-08-06 03:18:25,530][52667] DAMAGECOUNT value on done: 399969.0 [2024-08-06 03:18:25,530][52667] Sum rewards: 63.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.076', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.090', 'weapon4': '0.116', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '53.000'} [2024-08-06 03:18:25,537][52803] DAMAGECOUNT value on done: 373347.0 [2024-08-06 03:18:25,538][52803] Sum rewards: 66.116, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.347', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.102', 'weapon5': '0.136', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '3.070', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '55.000'} [2024-08-06 03:18:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 366665728. Throughput: 0: 4374.2. Samples: 91674800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:18:27,794][52567] Avg episode reward: [(0, '68.737')] [2024-08-06 03:18:27,864][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000044760_366673920.pth... [2024-08-06 03:18:28,002][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000044247_362471424.pth [2024-08-06 03:18:28,134][52811] DAMAGECOUNT value on done: 373503.0 [2024-08-06 03:18:28,135][52811] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.855', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.158', 'AMMO3': '0.184', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '55.000'} [2024-08-06 03:18:28,577][52650] Updated weights for policy 0, policy_version 44761 (0.0012) [2024-08-06 03:18:28,635][52667] DAMAGECOUNT value on done: 394082.0 [2024-08-06 03:18:28,636][52667] Sum rewards: 66.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.198', 'AMMO3': '0.211', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '55.000'} [2024-08-06 03:18:28,648][52803] DAMAGECOUNT value on done: 360433.0 [2024-08-06 03:18:28,648][52803] Sum rewards: 73.983, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.324', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.170', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:31,261][52811] DAMAGECOUNT value on done: 368819.0 [2024-08-06 03:18:31,262][52811] Sum rewards: 61.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.147', 'weapon2': '0.176', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '52.000'} [2024-08-06 03:18:31,499][52667] DAMAGECOUNT value on done: 395758.0 [2024-08-06 03:18:31,499][52667] Sum rewards: 72.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.635', 'AMMO5': '0.009', 'AMMO2': '0.009', 'weapon4': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:31,738][52803] DAMAGECOUNT value on done: 364502.0 [2024-08-06 03:18:31,738][52803] Sum rewards: 69.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.614', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.640', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 366755840. Throughput: 0: 4366.0. Samples: 91687550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:18:32,795][52567] Avg episode reward: [(0, '68.698')] [2024-08-06 03:18:33,403][52650] Updated weights for policy 0, policy_version 44771 (0.0022) [2024-08-06 03:18:34,414][52811] DAMAGECOUNT value on done: 369549.0 [2024-08-06 03:18:34,415][52811] Sum rewards: 75.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.394', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO4': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.100', 'weapon3': '3.354', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:34,462][52667] DAMAGECOUNT value on done: 403198.0 [2024-08-06 03:18:34,462][52667] Sum rewards: 71.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.012', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO3': '0.155', 'AMMO4': '0.197', 'weapon4': '0.342', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.776', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '57.000'} [2024-08-06 03:18:34,631][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:18:34,788][52803] DAMAGECOUNT value on done: 365081.0 [2024-08-06 03:18:34,788][52803] Sum rewards: 86.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.040', 'weapon5': '0.096', 'AMMO4': '0.190', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '72.000'} [2024-08-06 03:18:36,070][52664] DAMAGECOUNT value on done: 409008.0 [2024-08-06 03:18:36,071][52664] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.857', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.197', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:37,482][52667] DAMAGECOUNT value on done: 393212.0 [2024-08-06 03:18:37,482][52667] Sum rewards: 73.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.534', 'AMMO5': '0.023', 'AMMO2': '0.053', 'weapon4': '0.142', 'weapon5': '0.182', 'AMMO3': '0.207', 'AMMO4': '0.267', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '61.500'} [2024-08-06 03:18:37,714][52811] DAMAGECOUNT value on done: 373859.0 [2024-08-06 03:18:37,714][52811] Sum rewards: 54.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.914', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.358', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.138', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '48.000'} [2024-08-06 03:18:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 366837760. Throughput: 0: 4371.6. Samples: 91714060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:18:37,794][52567] Avg episode reward: [(0, '69.250')] [2024-08-06 03:18:37,848][52803] DAMAGECOUNT value on done: 370592.0 [2024-08-06 03:18:37,849][52803] Sum rewards: 66.340, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.062', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.214', 'weapon2': '0.228', 'AMMO4': '0.247', 'AMMO3': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.166', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 03:18:38,089][52650] Updated weights for policy 0, policy_version 44781 (0.0011) [2024-08-06 03:18:38,893][52664] DAMAGECOUNT value on done: 412911.0 [2024-08-06 03:18:38,894][52664] Sum rewards: 59.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.176', 'AMMO4': '0.207', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '2.958', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '52.000'} [2024-08-06 03:18:39,703][52669] DAMAGECOUNT value on done: 398601.0 [2024-08-06 03:18:39,703][52669] Sum rewards: 68.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.522', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.144', 'AMMO3': '0.177', 'AMMO4': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.698', 'WEAPON3': '1.000', 'weapon3': '2.790', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '56.000'} [2024-08-06 03:18:40,147][52667] DAMAGECOUNT value on done: 398601.0 [2024-08-06 03:18:40,155][52667] Sum rewards: 80.781, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.268', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '68.000'} [2024-08-06 03:18:40,369][52668] DAMAGECOUNT value on done: 392210.0 [2024-08-06 03:18:40,371][52668] Sum rewards: 87.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.094', 'AMMO4': '0.097', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.232', 'WEAPON3': '1.300', 'weapon3': '3.284', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '72.000'} [2024-08-06 03:18:40,890][52811] DAMAGECOUNT value on done: 369902.0 [2024-08-06 03:18:40,890][52811] Sum rewards: 63.031, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.602', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.136', 'AMMO4': '0.180', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.204', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '51.000'} [2024-08-06 03:18:40,960][52803] DAMAGECOUNT value on done: 363862.0 [2024-08-06 03:18:40,962][52803] Sum rewards: 70.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.437', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.217', 'weapon4': '0.220', 'weapon2': '0.240', 'AMMO4': '0.257', 'weapon5': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '57.000'} [2024-08-06 03:18:41,498][52795] DAMAGECOUNT value on done: 368150.0 [2024-08-06 03:18:41,499][52795] Sum rewards: 71.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.725', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.074', 'AMMO4': '0.129', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 03:18:41,568][52664] DAMAGECOUNT value on done: 414965.0 [2024-08-06 03:18:41,570][52664] Sum rewards: 73.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.108', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:41,948][52658] Large shaping reward 2.537 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.486, 162.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:18:42,460][52650] Updated weights for policy 0, policy_version 44791 (0.0012) [2024-08-06 03:18:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 366927872. Throughput: 0: 4375.8. Samples: 91740290. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:18:42,794][52567] Avg episode reward: [(0, '69.075')] [2024-08-06 03:18:42,821][52669] DAMAGECOUNT value on done: 390239.0 [2024-08-06 03:18:42,823][52669] Sum rewards: 74.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.733', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.076', 'AMMO4': '0.217', 'weapon5': '0.236', 'AMMO3': '0.262', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '63.000'} [2024-08-06 03:18:42,998][52668] DAMAGECOUNT value on done: 397327.0 [2024-08-06 03:18:42,998][52668] Sum rewards: 68.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.885', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.226', 'AMMO4': '0.235', 'weapon5': '0.240', 'weapon4': '0.312', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:43,235][52667] DAMAGECOUNT value on done: 398315.0 [2024-08-06 03:18:43,235][52667] Sum rewards: 74.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.736', 'AMMO2': '0.005', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '62.000'} [2024-08-06 03:18:44,032][52811] DAMAGECOUNT value on done: 367879.0 [2024-08-06 03:18:44,032][52811] Sum rewards: 51.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.356', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.212', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.604', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '42.000'} [2024-08-06 03:18:44,120][52803] DAMAGECOUNT value on done: 372985.0 [2024-08-06 03:18:44,120][52803] Sum rewards: 63.512, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.022', 'AMMO2': '0.066', 'weapon5': '0.222', 'AMMO3': '0.229', 'weapon4': '0.288', 'weapon2': '0.316', 'AMMO4': '0.329', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '55.500'} [2024-08-06 03:18:44,437][52664] DAMAGECOUNT value on done: 407743.0 [2024-08-06 03:18:44,438][52664] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.575', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.318', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '52.000'} [2024-08-06 03:18:44,444][52662] DAMAGECOUNT value on done: 401900.0 [2024-08-06 03:18:44,445][52662] Sum rewards: 66.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.465', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.142', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '57.000'} [2024-08-06 03:18:44,653][52795] DAMAGECOUNT value on done: 359110.0 [2024-08-06 03:18:44,653][52795] Sum rewards: 71.965, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.548', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.123', 'AMMO4': '0.123', 'weapon5': '0.172', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '0.800', 'weapon3': '2.670', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '55.000'} [2024-08-06 03:18:45,456][52669] DAMAGECOUNT value on done: 401202.0 [2024-08-06 03:18:45,465][52669] Sum rewards: 60.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '3.186', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '50.000'} [2024-08-06 03:18:45,763][52668] DAMAGECOUNT value on done: 399499.0 [2024-08-06 03:18:45,765][52668] Sum rewards: 73.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.138', 'weapon5': '0.158', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:45,831][52665] DAMAGECOUNT value on done: 387768.0 [2024-08-06 03:18:45,835][52665] Sum rewards: 63.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.492', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.156', 'weapon5': '0.206', 'AMMO3': '0.224', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.034', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '52.000'} [2024-08-06 03:18:45,891][52667] DAMAGECOUNT value on done: 391536.0 [2024-08-06 03:18:45,892][52667] Sum rewards: 62.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.092', 'AMMO4': '0.156', 'weapon5': '0.164', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '51.000'} [2024-08-06 03:18:47,109][52803] DAMAGECOUNT value on done: 369113.0 [2024-08-06 03:18:47,110][52803] Sum rewards: 74.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.140', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:47,158][52811] DAMAGECOUNT value on done: 379741.0 [2024-08-06 03:18:47,159][52811] Sum rewards: 75.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.258', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.278', 'WEAPON3': '1.200', 'HITCOUNT': '3.310', 'weapon3': '3.344', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '62.000'} [2024-08-06 03:18:47,206][52650] Updated weights for policy 0, policy_version 44801 (0.0017) [2024-08-06 03:18:47,295][52664] DAMAGECOUNT value on done: 411500.0 [2024-08-06 03:18:47,295][52664] Sum rewards: 70.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.035', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.358', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.398', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:47,662][52662] DAMAGECOUNT value on done: 400115.0 [2024-08-06 03:18:47,663][52662] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.194', 'AMMO4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.690', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '53.000'} [2024-08-06 03:18:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 367017984. Throughput: 0: 4373.3. Samples: 91753330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:18:47,794][52567] Avg episode reward: [(0, '68.406')] [2024-08-06 03:18:47,884][52795] DAMAGECOUNT value on done: 357578.0 [2024-08-06 03:18:47,885][52795] Sum rewards: 59.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.236', 'weapon2': '0.362', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.112', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '50.000'} [2024-08-06 03:18:48,340][52669] DAMAGECOUNT value on done: 394183.0 [2024-08-06 03:18:48,342][52669] Sum rewards: 55.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.755', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.080', 'weapon5': '0.208', 'AMMO3': '0.237', 'AMMO4': '0.258', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.878', 'WEAPON3': '1.500', 'weapon3': '2.556', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '48.000'} [2024-08-06 03:18:48,391][52667] DAMAGECOUNT value on done: 399879.0 [2024-08-06 03:18:48,391][52667] Sum rewards: 69.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.646', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.233', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:48,675][52665] DAMAGECOUNT value on done: 397740.0 [2024-08-06 03:18:48,675][52665] Sum rewards: 79.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.442', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.238', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '64.000'} [2024-08-06 03:18:48,768][52668] DAMAGECOUNT value on done: 401420.0 [2024-08-06 03:18:48,768][52668] Sum rewards: 62.630, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.506', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.096', 'weapon5': '0.190', 'weapon2': '0.194', 'AMMO4': '0.225', 'AMMO3': '0.283', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.210', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 03:18:50,269][52811] DAMAGECOUNT value on done: 368778.0 [2024-08-06 03:18:50,269][52811] Sum rewards: 69.002, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.860', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon5': '0.214', 'AMMO3': '0.217', 'AMMO4': '0.239', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.638', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:50,277][52803] DAMAGECOUNT value on done: 368951.0 [2024-08-06 03:18:50,278][52803] Sum rewards: 61.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.933', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.178', 'weapon2': '0.208', 'weapon4': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '51.000'} [2024-08-06 03:18:50,548][52662] DAMAGECOUNT value on done: 401886.0 [2024-08-06 03:18:50,550][52662] Sum rewards: 71.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.266', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.332', 'WEAPON3': '1.350', 'HITCOUNT': '3.400', 'weapon3': '3.424', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '62.000'} [2024-08-06 03:18:50,605][52664] DAMAGECOUNT value on done: 408929.0 [2024-08-06 03:18:50,605][52664] Sum rewards: 66.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.478', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.134', 'weapon5': '0.186', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '54.000'} [2024-08-06 03:18:51,142][52669] DAMAGECOUNT value on done: 395098.0 [2024-08-06 03:18:51,143][52669] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.132', 'weapon5': '0.148', 'AMMO3': '0.237', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:51,149][52795] DAMAGECOUNT value on done: 365855.0 [2024-08-06 03:18:51,149][52795] Sum rewards: 63.120, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.925', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.214', 'weapon2': '0.242', 'WEAPON4': '0.250', 'AMMO3': '0.289', 'WEAPON3': '1.750', 'weapon3': '3.190', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '56.000'} [2024-08-06 03:18:51,336][52667] DAMAGECOUNT value on done: 405760.0 [2024-08-06 03:18:51,337][52667] Sum rewards: 88.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.374', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon2': '0.228', 'AMMO3': '0.247', 'WEAPON3': '1.550', 'weapon3': '3.610', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '75.000'} [2024-08-06 03:18:51,613][52665] DAMAGECOUNT value on done: 395482.0 [2024-08-06 03:18:51,614][52665] Sum rewards: 71.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.172', 'weapon2': '0.210', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon5': '0.376', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.666', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '57.000'} [2024-08-06 03:18:51,835][52668] DAMAGECOUNT value on done: 391215.0 [2024-08-06 03:18:51,836][52668] Sum rewards: 66.455, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.682', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.120', 'AMMO4': '0.122', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.311', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.036', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.500'} [2024-08-06 03:18:52,181][52650] Updated weights for policy 0, policy_version 44811 (0.0021) [2024-08-06 03:18:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 367099904. Throughput: 0: 4367.3. Samples: 91779220. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:18:52,794][52567] Avg episode reward: [(0, '68.372')] [2024-08-06 03:18:53,265][52662] DAMAGECOUNT value on done: 390358.0 [2024-08-06 03:18:53,265][52662] Sum rewards: 73.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.752', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.104', 'weapon4': '0.132', 'AMMO3': '0.154', 'AMMO4': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.838', 'WEAPON3': '1.000', 'weapon3': '2.788', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:53,328][52811] DAMAGECOUNT value on done: 368620.0 [2024-08-06 03:18:53,331][52811] Sum rewards: 68.640, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.904', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.564', 'WEAPON3': '1.650', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:53,366][52803] DAMAGECOUNT value on done: 373073.0 [2024-08-06 03:18:53,368][52803] Sum rewards: 76.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.642', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon2': '0.176', 'weapon5': '0.182', 'AMMO4': '0.195', 'AMMO3': '0.207', 'weapon4': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '64.000'} [2024-08-06 03:18:53,774][52664] DAMAGECOUNT value on done: 411636.0 [2024-08-06 03:18:53,775][52664] Sum rewards: 62.844, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.268', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.126', 'weapon5': '0.222', 'AMMO4': '0.225', 'weapon2': '0.232', 'AMMO3': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.072', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '54.000'} [2024-08-06 03:18:53,933][52669] DAMAGECOUNT value on done: 398898.0 [2024-08-06 03:18:53,935][52669] Sum rewards: 80.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.339', 'AMMO5': '0.021', 'AMMO2': '0.066', 'AMMO3': '0.216', 'weapon4': '0.224', 'weapon2': '0.282', 'weapon5': '0.322', 'AMMO4': '0.332', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '67.000'} [2024-08-06 03:18:54,335][52795] DAMAGECOUNT value on done: 360217.0 [2024-08-06 03:18:54,337][52795] Sum rewards: 18.840, reward structure: {'DEATHCOUNT': '-5.250', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'AMMO3': '0.096', 'WEAPON5': '0.100', 'weapon2': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.158', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON3': '0.550', 'weapon3': '0.678', 'HITCOUNT': '0.710', 'weapon4': '3.012', 'DAMAGECOUNT': '3.990', 'FRAGCOUNT': '15.000'} [2024-08-06 03:18:54,473][52665] DAMAGECOUNT value on done: 390511.0 [2024-08-06 03:18:54,473][52665] Sum rewards: 71.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.126', 'AMMO3': '0.227', 'weapon5': '0.284', 'AMMO4': '0.285', 'weapon2': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:54,540][52667] DAMAGECOUNT value on done: 403870.0 [2024-08-06 03:18:54,542][52667] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.019', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.258', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '63.000'} [2024-08-06 03:18:55,023][52668] DAMAGECOUNT value on done: 398636.0 [2024-08-06 03:18:55,025][52668] Sum rewards: 75.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.023', 'AMMO2': '0.050', 'weapon4': '0.194', 'AMMO3': '0.221', 'AMMO4': '0.248', 'weapon5': '0.292', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:56,245][52662] DAMAGECOUNT value on done: 400664.0 [2024-08-06 03:18:56,253][52662] Sum rewards: 63.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.309', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.124', 'AMMO4': '0.186', 'AMMO3': '0.234', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '53.500'} [2024-08-06 03:18:56,364][52664] DAMAGECOUNT value on done: 404171.0 [2024-08-06 03:18:56,365][52664] Sum rewards: 72.044, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO3': '0.162', 'AMMO4': '0.162', 'WEAPON5': '0.300', 'weapon2': '0.332', 'weapon4': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:56,398][52803] DAMAGECOUNT value on done: 367847.0 [2024-08-06 03:18:56,399][52803] Sum rewards: 72.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.289', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon4': '0.190', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '59.000'} [2024-08-06 03:18:56,427][52811] DAMAGECOUNT value on done: 371909.0 [2024-08-06 03:18:56,428][52811] Sum rewards: 77.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.202', 'weapon4': '0.236', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '65.000'} [2024-08-06 03:18:56,600][52650] Updated weights for policy 0, policy_version 44821 (0.0011) [2024-08-06 03:18:56,995][52669] DAMAGECOUNT value on done: 396053.0 [2024-08-06 03:18:56,997][52669] Sum rewards: 57.947, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.650', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.156', 'weapon2': '0.446', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.226', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '48.000'} [2024-08-06 03:18:57,342][52795] DAMAGECOUNT value on done: 368357.0 [2024-08-06 03:18:57,342][52795] Sum rewards: 69.838, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.973', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon2': '0.158', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'HITCOUNT': '3.300', 'weapon3': '3.544', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '62.000'} [2024-08-06 03:18:57,358][52665] DAMAGECOUNT value on done: 384368.0 [2024-08-06 03:18:57,360][52665] Sum rewards: 75.211, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.201', 'weapon5': '0.224', 'HEALTH': '0.280', 'weapon2': '0.282', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '60.000'} [2024-08-06 03:18:57,454][52667] DAMAGECOUNT value on done: 401792.0 [2024-08-06 03:18:57,455][52667] Sum rewards: 67.808, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.155', 'weapon5': '0.162', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon4': '0.374', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.820', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '54.000'} [2024-08-06 03:18:57,486][52649] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:18:57,697][52668] DAMAGECOUNT value on done: 398094.0 [2024-08-06 03:18:57,700][52668] Sum rewards: 61.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.374', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.258', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.368', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '49.000'} [2024-08-06 03:18:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 367181824. Throughput: 0: 4369.1. Samples: 91805550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:18:57,794][52567] Avg episode reward: [(0, '68.442')] [2024-08-06 03:18:59,111][52662] DAMAGECOUNT value on done: 395404.0 [2024-08-06 03:18:59,112][52662] Sum rewards: 74.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.410', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.282', 'weapon4': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '61.000'} [2024-08-06 03:18:59,127][52664] DAMAGECOUNT value on done: 415688.0 [2024-08-06 03:18:59,127][52664] Sum rewards: 83.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.010', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.028', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.164', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.590', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '70.000'} [2024-08-06 03:18:59,469][52803] DAMAGECOUNT value on done: 367334.0 [2024-08-06 03:18:59,469][52803] Sum rewards: 84.465, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.531', 'AMMO5': '0.024', 'AMMO2': '0.037', 'weapon4': '0.166', 'AMMO4': '0.184', 'weapon2': '0.202', 'AMMO3': '0.234', 'weapon5': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '71.000'} [2024-08-06 03:18:59,527][52811] DAMAGECOUNT value on done: 365755.0 [2024-08-06 03:18:59,527][52811] Sum rewards: 58.058, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.176', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO4': '0.205', 'AMMO3': '0.221', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '51.000'} [2024-08-06 03:19:00,080][52669] DAMAGECOUNT value on done: 397605.0 [2024-08-06 03:19:00,082][52669] Sum rewards: 68.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.188', 'weapon5': '0.198', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:00,261][52665] DAMAGECOUNT value on done: 385326.0 [2024-08-06 03:19:00,263][52665] Sum rewards: 74.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.080', 'AMMO4': '0.088', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:00,381][52668] DAMAGECOUNT value on done: 390760.0 [2024-08-06 03:19:00,381][52668] Sum rewards: 65.197, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.410', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'weapon5': '0.094', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.392', 'weapon4': '0.448', 'WEAPON3': '0.800', 'weapon3': '2.780', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '52.000'} [2024-08-06 03:19:00,515][52667] DAMAGECOUNT value on done: 395127.0 [2024-08-06 03:19:00,515][52667] Sum rewards: 72.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.082', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.288', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.300', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '60.000'} [2024-08-06 03:19:00,597][52795] DAMAGECOUNT value on done: 373435.0 [2024-08-06 03:19:00,598][52795] Sum rewards: 65.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.532', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.191', 'weapon5': '0.230', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 03:19:00,802][52660] DAMAGECOUNT value on done: 394129.0 [2024-08-06 03:19:00,802][52660] Sum rewards: 84.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.706', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.217', 'weapon2': '0.242', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '69.000'} [2024-08-06 03:19:01,472][52662] DAMAGECOUNT value on done: 404668.0 [2024-08-06 03:19:01,473][52662] Sum rewards: 77.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.165', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.098', 'AMMO4': '0.103', 'weapon5': '0.108', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:01,626][52650] Updated weights for policy 0, policy_version 44831 (0.0013) [2024-08-06 03:19:02,050][52664] DAMAGECOUNT value on done: 407409.0 [2024-08-06 03:19:02,050][52664] Sum rewards: 61.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.769', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.188', 'AMMO4': '0.188', 'AMMO3': '0.196', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.446', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:02,612][52803] DAMAGECOUNT value on done: 376257.0 [2024-08-06 03:19:02,613][52803] Sum rewards: 81.778, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.234', 'WEAPON3': '1.150', 'weapon3': '3.368', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '67.000'} [2024-08-06 03:19:02,641][52811] DAMAGECOUNT value on done: 369817.0 [2024-08-06 03:19:02,642][52811] Sum rewards: 66.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.015', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.124', 'weapon4': '0.132', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.600', 'weapon3': '3.038', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 367280128. Throughput: 0: 4357.8. Samples: 91818340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:19:02,794][52567] Avg episode reward: [(0, '69.325')] [2024-08-06 03:19:02,940][52665] DAMAGECOUNT value on done: 389744.0 [2024-08-06 03:19:02,941][52665] Sum rewards: 54.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.236', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.198', 'weapon4': '0.228', 'weapon5': '0.252', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '45.500'} [2024-08-06 03:19:03,139][52658] DAMAGECOUNT value on done: 393371.0 [2024-08-06 03:19:03,140][52658] Sum rewards: 65.051, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.178', 'AMMO3': '0.193', 'weapon2': '0.212', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '53.000'} [2024-08-06 03:19:03,233][52667] DAMAGECOUNT value on done: 402478.0 [2024-08-06 03:19:03,233][52667] Sum rewards: 65.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.066', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:03,433][52669] DAMAGECOUNT value on done: 400553.0 [2024-08-06 03:19:03,433][52669] Sum rewards: 75.607, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.465', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.151', 'weapon2': '0.192', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON3': '0.900', 'weapon3': '2.876', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:03,562][52668] DAMAGECOUNT value on done: 396421.0 [2024-08-06 03:19:03,562][52668] Sum rewards: 90.645, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.511', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon4': '0.244', 'weapon2': '0.390', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '72.000'} [2024-08-06 03:19:03,799][52795] DAMAGECOUNT value on done: 368828.0 [2024-08-06 03:19:03,801][52795] Sum rewards: 63.567, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.586', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.040', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO4': '0.175', 'WEAPON5': '0.350', 'weapon2': '0.888', 'WEAPON3': '0.900', 'weapon3': '2.742', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '48.000'} [2024-08-06 03:19:04,004][52660] DAMAGECOUNT value on done: 389643.0 [2024-08-06 03:19:04,008][52660] Sum rewards: 65.606, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.386', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO3': '0.160', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '53.000'} [2024-08-06 03:19:04,416][52662] DAMAGECOUNT value on done: 406448.0 [2024-08-06 03:19:04,420][52662] Sum rewards: 63.696, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.644', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.134', 'AMMO4': '0.230', 'weapon5': '0.266', 'AMMO3': '0.283', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.896', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:04,674][52664] DAMAGECOUNT value on done: 415064.0 [2024-08-06 03:19:04,680][52664] Sum rewards: 61.336, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.825', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.100', 'weapon4': '0.182', 'weapon2': '0.246', 'AMMO3': '0.337', 'WEAPON3': '1.900', 'weapon3': '3.360', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:05,507][52658] DAMAGECOUNT value on done: 398307.0 [2024-08-06 03:19:05,507][52658] Sum rewards: 75.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.086', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:05,710][52803] DAMAGECOUNT value on done: 371326.0 [2024-08-06 03:19:05,712][52803] Sum rewards: 70.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.150', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon5': '0.210', 'AMMO3': '0.217', 'AMMO4': '0.284', 'weapon4': '0.350', 'weapon2': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.684', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:05,818][52811] DAMAGECOUNT value on done: 371297.0 [2024-08-06 03:19:05,818][52811] Sum rewards: 74.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.472', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:06,076][52650] Updated weights for policy 0, policy_version 44841 (0.0013) [2024-08-06 03:19:06,103][52669] DAMAGECOUNT value on done: 396037.0 [2024-08-06 03:19:06,104][52669] Sum rewards: 64.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.342', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.094', 'AMMO4': '0.115', 'weapon5': '0.136', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.188', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '54.000'} [2024-08-06 03:19:06,162][52665] DAMAGECOUNT value on done: 394654.0 [2024-08-06 03:19:06,163][52665] Sum rewards: 59.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.180', 'AMMO4': '0.205', 'weapon2': '0.256', 'weapon5': '0.262', 'WEAPON5': '0.400', 'weapon4': '0.492', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.530', 'weapon3': '2.732', 'DAMAGECOUNT': '14.172', 'FRAGCOUNT': '51.000'} [2024-08-06 03:19:06,825][52668] DAMAGECOUNT value on done: 398996.0 [2024-08-06 03:19:06,833][52668] Sum rewards: 86.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.102', 'weapon5': '0.144', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '70.000'} [2024-08-06 03:19:07,127][52795] DAMAGECOUNT value on done: 356894.0 [2024-08-06 03:19:07,131][52795] Sum rewards: 74.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.955', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.042', 'weapon5': '0.100', 'AMMO3': '0.193', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:07,166][52820] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:19:07,200][52660] DAMAGECOUNT value on done: 402913.0 [2024-08-06 03:19:07,202][52660] Sum rewards: 76.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.068', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.428', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:07,428][52664] DAMAGECOUNT value on done: 412485.0 [2024-08-06 03:19:07,429][52664] Sum rewards: 67.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.955', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.252', 'WEAPON3': '1.600', 'weapon3': '3.344', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:07,724][52662] DAMAGECOUNT value on done: 395047.0 [2024-08-06 03:19:07,724][52662] Sum rewards: 57.584, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.435', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.068', 'AMMO4': '0.095', 'weapon5': '0.130', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.844', 'WEAPON3': '0.950', 'HITCOUNT': '2.780', 'weapon3': '2.808', 'DAMAGECOUNT': '13.875', 'FRAGCOUNT': '46.000'} [2024-08-06 03:19:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 367362048. Throughput: 0: 4357.6. Samples: 91844600. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:19:07,794][52567] Avg episode reward: [(0, '69.331')] [2024-08-06 03:19:08,425][52658] DAMAGECOUNT value on done: 401716.0 [2024-08-06 03:19:08,426][52658] Sum rewards: 66.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.736', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.185', 'AMMO4': '0.192', 'weapon5': '0.220', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.434', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '53.000'} [2024-08-06 03:19:08,510][52669] DAMAGECOUNT value on done: 400894.0 [2024-08-06 03:19:08,512][52669] Sum rewards: 62.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.216', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2024-08-06 03:19:08,590][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:19:08,818][52803] DAMAGECOUNT value on done: 372872.0 [2024-08-06 03:19:08,819][52803] Sum rewards: 62.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.112', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '53.000'} [2024-08-06 03:19:08,953][52665] DAMAGECOUNT value on done: 395969.0 [2024-08-06 03:19:08,954][52665] Sum rewards: 68.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.180', 'AMMO3': '0.186', 'weapon2': '0.246', 'WEAPON3': '1.100', 'weapon3': '3.264', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:08,962][52811] DAMAGECOUNT value on done: 369045.0 [2024-08-06 03:19:08,964][52811] Sum rewards: 71.531, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.068', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '2.820', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '60.500'} [2024-08-06 03:19:09,617][52668] DAMAGECOUNT value on done: 397616.0 [2024-08-06 03:19:09,619][52668] Sum rewards: 56.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.806', 'AMMO5': '0.015', 'ARMOR': '0.035', 'AMMO2': '0.057', 'weapon5': '0.254', 'AMMO3': '0.258', 'weapon4': '0.282', 'AMMO4': '0.286', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:09,984][52660] DAMAGECOUNT value on done: 403809.0 [2024-08-06 03:19:09,985][52660] Sum rewards: 76.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.782', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.174', 'AMMO4': '0.183', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '64.000'} [2024-08-06 03:19:10,289][52795] DAMAGECOUNT value on done: 372985.0 [2024-08-06 03:19:10,289][52795] Sum rewards: 77.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.178', 'AMMO3': '0.199', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:10,405][52662] DAMAGECOUNT value on done: 407526.0 [2024-08-06 03:19:10,405][52662] Sum rewards: 75.265, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.232', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 03:19:10,537][52664] DAMAGECOUNT value on done: 420583.0 [2024-08-06 03:19:10,538][52664] Sum rewards: 73.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.252', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.108', 'AMMO4': '0.157', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:10,806][52614] Signal inference workers to stop experience collection... (8100 times) [2024-08-06 03:19:10,811][52614] Signal inference workers to resume experience collection... (8100 times) [2024-08-06 03:19:10,858][52650] InferenceWorker_p0-w0: stopping experience collection (8100 times) [2024-08-06 03:19:10,858][52650] InferenceWorker_p0-w0: resuming experience collection (8100 times) [2024-08-06 03:19:10,906][52650] Updated weights for policy 0, policy_version 44851 (0.0034) [2024-08-06 03:19:10,999][52647] DAMAGECOUNT value on done: 419650.0 [2024-08-06 03:19:11,003][52647] Sum rewards: 75.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.195', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.122', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON3': '1.000', 'weapon3': '3.426', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:11,436][52665] DAMAGECOUNT value on done: 392875.0 [2024-08-06 03:19:11,437][52665] Sum rewards: 69.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.813', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.168', 'AMMO3': '0.211', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:11,569][52658] DAMAGECOUNT value on done: 400308.0 [2024-08-06 03:19:11,570][52658] Sum rewards: 69.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.507', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.132', 'weapon4': '0.146', 'AMMO4': '0.180', 'AMMO3': '0.195', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.796', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:11,626][52669] DAMAGECOUNT value on done: 396575.0 [2024-08-06 03:19:11,628][52669] Sum rewards: 65.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.412', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.200', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:11,930][52803] DAMAGECOUNT value on done: 366060.0 [2024-08-06 03:19:11,938][52803] Sum rewards: 68.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.576', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.058', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.279', 'weapon2': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '60.000'} [2024-08-06 03:19:12,038][52811] DAMAGECOUNT value on done: 371129.0 [2024-08-06 03:19:12,038][52811] Sum rewards: 83.515, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.068', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'weapon2': '0.298', 'WEAPON3': '0.950', 'weapon3': '3.316', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:12,542][52668] DAMAGECOUNT value on done: 392009.0 [2024-08-06 03:19:12,542][52668] Sum rewards: 73.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon5': '0.124', 'AMMO3': '0.208', 'AMMO4': '0.224', 'weapon2': '0.396', 'weapon4': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:12,618][52671] DAMAGECOUNT value on done: 400527.0 [2024-08-06 03:19:12,621][52671] Sum rewards: 64.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.446', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.098', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.214', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 367452160. Throughput: 0: 4351.6. Samples: 91870620. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:19:12,794][52567] Avg episode reward: [(0, '69.217')] [2024-08-06 03:19:12,940][52660] DAMAGECOUNT value on done: 395071.0 [2024-08-06 03:19:12,940][52660] Sum rewards: 65.672, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.126', 'weapon5': '0.142', 'weapon2': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.296', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:13,312][52662] DAMAGECOUNT value on done: 394710.0 [2024-08-06 03:19:13,312][52662] Sum rewards: 73.368, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.130', 'weapon4': '0.178', 'weapon2': '0.226', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:13,470][52795] DAMAGECOUNT value on done: 364033.0 [2024-08-06 03:19:13,471][52795] Sum rewards: 73.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon5': '0.184', 'AMMO3': '0.188', 'weapon2': '0.226', 'AMMO4': '0.288', 'weapon4': '0.362', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:13,562][52664] DAMAGECOUNT value on done: 412430.0 [2024-08-06 03:19:13,564][52664] Sum rewards: 69.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.376', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.195', 'weapon2': '0.682', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:13,894][52647] DAMAGECOUNT value on done: 416383.0 [2024-08-06 03:19:13,895][52647] Sum rewards: 67.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.108', 'weapon5': '0.140', 'AMMO4': '0.154', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:14,095][52665] DAMAGECOUNT value on done: 398935.0 [2024-08-06 03:19:14,099][52665] Sum rewards: 71.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.134', 'AMMO4': '0.173', 'AMMO3': '0.190', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:14,318][52658] DAMAGECOUNT value on done: 391711.0 [2024-08-06 03:19:14,318][52658] Sum rewards: 68.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.864', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.174', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:14,633][52669] DAMAGECOUNT value on done: 391813.0 [2024-08-06 03:19:14,633][52669] Sum rewards: 65.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.508', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.088', 'AMMO3': '0.222', 'weapon2': '0.412', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.300', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:15,310][52668] DAMAGECOUNT value on done: 388978.0 [2024-08-06 03:19:15,312][52668] Sum rewards: 79.956, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.203', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '66.000'} [2024-08-06 03:19:15,442][52671] DAMAGECOUNT value on done: 399477.0 [2024-08-06 03:19:15,442][52671] Sum rewards: 77.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.084', 'AMMO4': '0.159', 'AMMO3': '0.197', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:15,524][52660] DAMAGECOUNT value on done: 393668.0 [2024-08-06 03:19:15,527][52660] Sum rewards: 69.070, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.260', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.268', 'AMMO3': '0.272', 'weapon2': '0.316', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:15,582][52650] Updated weights for policy 0, policy_version 44861 (0.0017) [2024-08-06 03:19:15,836][52662] DAMAGECOUNT value on done: 398602.0 [2024-08-06 03:19:15,836][52662] Sum rewards: 75.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.194', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.158', 'weapon5': '0.180', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:16,464][52664] DAMAGECOUNT value on done: 417195.0 [2024-08-06 03:19:16,465][52664] Sum rewards: 79.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.215', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.120', 'weapon5': '0.128', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:16,658][52795] DAMAGECOUNT value on done: 365112.0 [2024-08-06 03:19:16,658][52795] Sum rewards: 70.877, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.092', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO4': '0.192', 'weapon2': '0.202', 'weapon4': '0.218', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.204', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:16,741][52647] DAMAGECOUNT value on done: 417731.0 [2024-08-06 03:19:16,742][52647] Sum rewards: 80.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.166', 'AMMO3': '0.177', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '64.000'} [2024-08-06 03:19:17,014][52658] DAMAGECOUNT value on done: 396430.0 [2024-08-06 03:19:17,015][52658] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.738', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.140', 'weapon5': '0.162', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.762', 'WEAPON3': '0.900', 'weapon3': '2.750', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:17,065][52665] DAMAGECOUNT value on done: 393590.0 [2024-08-06 03:19:17,067][52665] Sum rewards: 69.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.424', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.422', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:17,709][52669] DAMAGECOUNT value on done: 400698.0 [2024-08-06 03:19:17,710][52669] Sum rewards: 86.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.536', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.193', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '70.000'} [2024-08-06 03:19:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 367534080. Throughput: 0: 4360.7. Samples: 91883780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:19:17,794][52567] Avg episode reward: [(0, '70.242')] [2024-08-06 03:19:17,802][52668] DAMAGECOUNT value on done: 389403.0 [2024-08-06 03:19:17,803][52668] Sum rewards: 67.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.348', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.217', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:18,053][52660] DAMAGECOUNT value on done: 397720.0 [2024-08-06 03:19:18,055][52660] Sum rewards: 74.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.734', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.169', 'weapon2': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:18,605][52662] DAMAGECOUNT value on done: 399897.0 [2024-08-06 03:19:18,605][52662] Sum rewards: 59.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.123', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.072', 'weapon4': '0.186', 'AMMO4': '0.193', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '52.500'} [2024-08-06 03:19:18,628][52671] DAMAGECOUNT value on done: 399227.0 [2024-08-06 03:19:18,628][52671] Sum rewards: 71.088, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.715', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.092', 'weapon5': '0.128', 'AMMO4': '0.248', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.100', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:19,089][52649] DAMAGECOUNT value on done: 385395.0 [2024-08-06 03:19:19,091][52649] Sum rewards: 48.530, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.678', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon2': '0.168', 'AMMO3': '0.228', 'weapon4': '0.366', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '3.108', 'DAMAGECOUNT': '11.841', 'FRAGCOUNT': '44.000'} [2024-08-06 03:19:19,242][52664] DAMAGECOUNT value on done: 408089.0 [2024-08-06 03:19:19,243][52664] Sum rewards: 66.774, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.429', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.254', 'WEAPON4': '0.500', 'weapon2': '0.568', 'weapon4': '0.598', 'WEAPON3': '1.400', 'weapon3': '2.476', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:19,517][52647] DAMAGECOUNT value on done: 424977.0 [2024-08-06 03:19:19,518][52647] Sum rewards: 82.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.845', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.190', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.418', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '67.000'} [2024-08-06 03:19:19,789][52795] DAMAGECOUNT value on done: 359767.0 [2024-08-06 03:19:19,790][52795] Sum rewards: 61.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO4': '0.198', 'weapon4': '0.208', 'AMMO3': '0.217', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.086', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '52.000'} [2024-08-06 03:19:19,950][52658] DAMAGECOUNT value on done: 399344.0 [2024-08-06 03:19:19,951][52658] Sum rewards: 80.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.612', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.066', 'AMMO4': '0.084', 'weapon4': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '66.000'} [2024-08-06 03:19:20,018][52665] DAMAGECOUNT value on done: 390198.0 [2024-08-06 03:19:20,018][52665] Sum rewards: 56.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.880', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.070', 'AMMO4': '0.183', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon5': '0.314', 'WEAPON5': '0.400', 'weapon2': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.798', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '47.000'} [2024-08-06 03:19:20,481][52650] Updated weights for policy 0, policy_version 44871 (0.0019) [2024-08-06 03:19:20,693][52668] DAMAGECOUNT value on done: 389557.0 [2024-08-06 03:19:20,693][52668] Sum rewards: 71.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.688', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.254', 'WEAPON3': '1.300', 'HITCOUNT': '3.460', 'weapon3': '3.488', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '60.000'} [2024-08-06 03:19:20,966][52669] DAMAGECOUNT value on done: 405242.0 [2024-08-06 03:19:20,967][52669] Sum rewards: 83.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon4': '0.216', 'AMMO3': '0.224', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '68.000'} [2024-08-06 03:19:20,983][52660] DAMAGECOUNT value on done: 402659.0 [2024-08-06 03:19:20,983][52660] Sum rewards: 60.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.152', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.146', 'AMMO3': '0.238', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.724', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '51.000'} [2024-08-06 03:19:21,412][52671] DAMAGECOUNT value on done: 398421.0 [2024-08-06 03:19:21,412][52671] Sum rewards: 88.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.881', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.187', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.524', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '72.000'} [2024-08-06 03:19:21,809][52662] DAMAGECOUNT value on done: 404190.0 [2024-08-06 03:19:21,811][52662] Sum rewards: 67.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.177', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.194', 'AMMO4': '0.217', 'AMMO3': '0.223', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:21,939][52664] DAMAGECOUNT value on done: 410125.0 [2024-08-06 03:19:21,939][52664] Sum rewards: 62.028, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.860', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.108', 'weapon4': '0.138', 'AMMO4': '0.145', 'WEAPON5': '0.250', 'weapon2': '0.274', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.240', 'weapon3': '3.262', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:22,147][52649] DAMAGECOUNT value on done: 381493.0 [2024-08-06 03:19:22,149][52649] Sum rewards: 70.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.178', 'AMMO3': '0.185', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:22,220][52647] DAMAGECOUNT value on done: 420100.0 [2024-08-06 03:19:22,220][52647] Sum rewards: 69.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.211', 'weapon5': '0.214', 'weapon2': '0.264', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 367624192. Throughput: 0: 4354.2. Samples: 91910000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:19:22,794][52567] Avg episode reward: [(0, '70.109')] [2024-08-06 03:19:22,873][52795] DAMAGECOUNT value on done: 370205.0 [2024-08-06 03:19:22,876][52795] Sum rewards: 58.034, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.646', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.178', 'weapon5': '0.192', 'weapon2': '0.210', 'AMMO3': '0.225', 'AMMO4': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.178', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:22,934][52658] DAMAGECOUNT value on done: 390903.0 [2024-08-06 03:19:22,936][52658] Sum rewards: 69.579, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.868', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.193', 'AMMO4': '0.199', 'weapon2': '0.268', 'weapon5': '0.284', 'weapon4': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:23,055][52665] DAMAGECOUNT value on done: 390052.0 [2024-08-06 03:19:23,057][52665] Sum rewards: 70.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO2': '0.007', 'AMMO5': '0.013', 'weapon4': '0.018', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.191', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:23,784][52669] DAMAGECOUNT value on done: 412799.0 [2024-08-06 03:19:23,785][52669] Sum rewards: 71.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon2': '0.164', 'AMMO4': '0.180', 'AMMO3': '0.186', 'weapon5': '0.234', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:23,917][52668] DAMAGECOUNT value on done: 393056.0 [2024-08-06 03:19:23,922][52668] Sum rewards: 73.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.072', 'AMMO3': '0.195', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.432', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:24,139][52660] DAMAGECOUNT value on done: 399606.0 [2024-08-06 03:19:24,141][52660] Sum rewards: 52.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.161', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'weapon2': '0.306', 'weapon7': '0.396', 'WEAPON4': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.490', 'weapon3': '2.600', 'DAMAGECOUNT': '13.914', 'FRAGCOUNT': '44.000'} [2024-08-06 03:19:24,428][52671] DAMAGECOUNT value on done: 405539.0 [2024-08-06 03:19:24,428][52671] Sum rewards: 86.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon4': '0.196', 'AMMO3': '0.199', 'weapon5': '0.206', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '70.000'} [2024-08-06 03:19:24,465][52664] DAMAGECOUNT value on done: 410944.0 [2024-08-06 03:19:24,465][52664] Sum rewards: 68.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.557', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '56.500'} [2024-08-06 03:19:24,695][52647] DAMAGECOUNT value on done: 420352.0 [2024-08-06 03:19:24,697][52647] Sum rewards: 70.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.124', 'weapon5': '0.196', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:24,894][52650] Updated weights for policy 0, policy_version 44881 (0.0024) [2024-08-06 03:19:24,924][52665] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:19:24,934][52662] DAMAGECOUNT value on done: 397040.0 [2024-08-06 03:19:24,934][52662] Sum rewards: 82.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.098', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO3': '0.157', 'AMMO4': '0.194', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '0.950', 'weapon3': '2.986', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '67.000'} [2024-08-06 03:19:24,979][52649] DAMAGECOUNT value on done: 388321.0 [2024-08-06 03:19:24,979][52649] Sum rewards: 76.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.033', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.130', 'AMMO3': '0.215', 'weapon4': '0.250', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.600', 'weapon2': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:25,866][52665] DAMAGECOUNT value on done: 395521.0 [2024-08-06 03:19:25,867][52665] Sum rewards: 75.329, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.020', 'AMMO5': '0.008', 'weapon4': '0.044', 'AMMO2': '0.044', 'weapon5': '0.160', 'AMMO4': '0.222', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.254', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:25,948][52658] DAMAGECOUNT value on done: 405021.0 [2024-08-06 03:19:25,949][52658] Sum rewards: 73.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.214', 'AMMO5': '0.016', 'AMMO2': '0.066', 'AMMO3': '0.218', 'weapon5': '0.242', 'weapon4': '0.268', 'weapon2': '0.290', 'AMMO4': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:26,014][52795] DAMAGECOUNT value on done: 357925.0 [2024-08-06 03:19:26,014][52795] Sum rewards: 66.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.158', 'AMMO3': '0.216', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.336', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:26,221][52669] DAMAGECOUNT value on done: 399418.0 [2024-08-06 03:19:26,223][52669] Sum rewards: 62.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.430', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.204', 'weapon5': '0.206', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '2.972', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '53.000'} [2024-08-06 03:19:26,973][52668] DAMAGECOUNT value on done: 398580.0 [2024-08-06 03:19:26,973][52668] Sum rewards: 69.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.072', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.346', 'WEAPON3': '1.150', 'weapon3': '3.398', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:27,139][52660] DAMAGECOUNT value on done: 396499.0 [2024-08-06 03:19:27,139][52660] Sum rewards: 85.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '71.000'} [2024-08-06 03:19:27,311][52671] DAMAGECOUNT value on done: 396419.0 [2024-08-06 03:19:27,319][52671] Sum rewards: 84.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.445', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '69.000'} [2024-08-06 03:19:27,369][52664] DAMAGECOUNT value on done: 409329.0 [2024-08-06 03:19:27,369][52664] Sum rewards: 74.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.338', 'AMMO5': '0.009', 'weapon5': '0.028', 'AMMO2': '0.030', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon4': '0.234', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.272', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:27,527][52647] DAMAGECOUNT value on done: 418702.0 [2024-08-06 03:19:27,527][52647] Sum rewards: 67.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.295', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO3': '0.134', 'AMMO4': '0.151', 'weapon5': '0.216', 'weapon2': '0.310', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.850', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '53.000'} [2024-08-06 03:19:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 367714304. Throughput: 0: 4357.8. Samples: 91936390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:19:27,794][52567] Avg episode reward: [(0, '70.820')] [2024-08-06 03:19:27,981][52662] DAMAGECOUNT value on done: 408554.0 [2024-08-06 03:19:27,984][52662] Sum rewards: 55.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.470', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.278', 'weapon2': '0.454', 'WEAPON3': '1.750', 'weapon3': '3.246', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:28,214][52649] DAMAGECOUNT value on done: 385829.0 [2024-08-06 03:19:28,214][52649] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon5': '0.192', 'AMMO4': '0.221', 'AMMO3': '0.241', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '64.000'} [2024-08-06 03:19:28,692][52658] DAMAGECOUNT value on done: 398068.0 [2024-08-06 03:19:28,694][52658] Sum rewards: 78.380, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.533', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.194', 'weapon4': '0.216', 'weapon5': '0.286', 'AMMO4': '0.297', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:28,910][52794] DAMAGECOUNT value on done: 399390.0 [2024-08-06 03:19:28,911][52794] Sum rewards: 66.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.975', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.460', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:28,990][52665] DAMAGECOUNT value on done: 392453.0 [2024-08-06 03:19:28,991][52665] Sum rewards: 78.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.138', 'AMMO3': '0.206', 'AMMO4': '0.213', 'weapon4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:29,150][52669] DAMAGECOUNT value on done: 402022.0 [2024-08-06 03:19:29,152][52669] Sum rewards: 72.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.883', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.064', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:29,161][52795] DAMAGECOUNT value on done: 375693.0 [2024-08-06 03:19:29,163][52795] Sum rewards: 69.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.274', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:29,671][52650] Updated weights for policy 0, policy_version 44891 (0.0011) [2024-08-06 03:19:29,720][52668] DAMAGECOUNT value on done: 396775.0 [2024-08-06 03:19:29,720][52668] Sum rewards: 70.593, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.804', 'AMMO5': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.155', 'weapon5': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:29,823][52660] DAMAGECOUNT value on done: 404804.0 [2024-08-06 03:19:29,824][52660] Sum rewards: 81.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.099', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'weapon3': '3.442', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:29,942][52664] DAMAGECOUNT value on done: 409432.0 [2024-08-06 03:19:29,942][52664] Sum rewards: 54.763, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.836', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '48.000'} [2024-08-06 03:19:30,060][52647] DAMAGECOUNT value on done: 412308.0 [2024-08-06 03:19:30,061][52647] Sum rewards: 79.130, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.055', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.184', 'AMMO3': '0.194', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:30,473][52671] DAMAGECOUNT value on done: 405254.0 [2024-08-06 03:19:30,478][52671] Sum rewards: 65.777, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.044', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.080', 'weapon5': '0.170', 'AMMO3': '0.232', 'AMMO4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:30,990][52662] DAMAGECOUNT value on done: 401577.0 [2024-08-06 03:19:30,991][52662] Sum rewards: 67.891, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.172', 'weapon5': '0.194', 'AMMO3': '0.264', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:31,414][52649] DAMAGECOUNT value on done: 376944.0 [2024-08-06 03:19:31,415][52649] Sum rewards: 74.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.157', 'AMMO3': '0.189', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:31,477][52658] DAMAGECOUNT value on done: 406712.0 [2024-08-06 03:19:31,477][52658] Sum rewards: 66.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.935', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.174', 'AMMO3': '0.199', 'weapon5': '0.232', 'weapon2': '0.284', 'AMMO4': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.958', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:31,929][52794] DAMAGECOUNT value on done: 402691.0 [2024-08-06 03:19:31,929][52794] Sum rewards: 81.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.435', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.130', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '3.084', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '66.000'} [2024-08-06 03:19:32,052][52669] DAMAGECOUNT value on done: 402155.0 [2024-08-06 03:19:32,054][52669] Sum rewards: 78.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.765', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.182', 'weapon2': '0.188', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:32,233][52668] DAMAGECOUNT value on done: 399347.0 [2024-08-06 03:19:32,234][52668] Sum rewards: 77.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.630', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.098', 'weapon4': '0.176', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:32,333][52665] DAMAGECOUNT value on done: 388588.0 [2024-08-06 03:19:32,334][52665] Sum rewards: 71.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.464', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.199', 'AMMO3': '0.214', 'weapon2': '0.332', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:32,352][52795] DAMAGECOUNT value on done: 369526.0 [2024-08-06 03:19:32,355][52795] Sum rewards: 61.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.178', 'AMMO3': '0.194', 'weapon5': '0.204', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '2.764', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '51.000'} [2024-08-06 03:19:32,423][52660] DAMAGECOUNT value on done: 390000.0 [2024-08-06 03:19:32,423][52660] Sum rewards: 55.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.050', 'AMMO4': '0.186', 'weapon4': '0.248', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '2.990', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '49.000'} [2024-08-06 03:19:32,701][52647] DAMAGECOUNT value on done: 424973.0 [2024-08-06 03:19:32,702][52647] Sum rewards: 74.932, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon5': '0.274', 'weapon2': '0.680', 'WEAPON3': '0.700', 'HEALTH': '0.984', 'weapon3': '2.812', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 367804416. Throughput: 0: 4357.1. Samples: 91949400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:19:32,794][52567] Avg episode reward: [(0, '70.931')] [2024-08-06 03:19:33,366][52671] DAMAGECOUNT value on done: 400078.0 [2024-08-06 03:19:33,366][52671] Sum rewards: 65.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.140', 'weapon5': '0.148', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.108', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:33,817][52820] DAMAGECOUNT value on done: 363337.0 [2024-08-06 03:19:33,817][52820] Sum rewards: 86.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.188', 'AMMO3': '0.226', 'weapon2': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '73.000'} [2024-08-06 03:19:33,849][52662] DAMAGECOUNT value on done: 399828.0 [2024-08-06 03:19:33,850][52662] Sum rewards: 46.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.971', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.169', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon4': '0.508', 'weapon7': '0.612', 'WEAPON3': '0.900', 'weapon3': '2.096', 'HITCOUNT': '2.110', 'DAMAGECOUNT': '11.751', 'FRAGCOUNT': '38.000'} [2024-08-06 03:19:34,200][52650] Updated weights for policy 0, policy_version 44901 (0.0020) [2024-08-06 03:19:34,332][52649] DAMAGECOUNT value on done: 388614.0 [2024-08-06 03:19:34,332][52649] Sum rewards: 78.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.569', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.128', 'AMMO4': '0.242', 'AMMO3': '0.249', 'weapon5': '0.280', 'weapon2': '0.288', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '68.000'} [2024-08-06 03:19:34,356][52658] DAMAGECOUNT value on done: 390612.0 [2024-08-06 03:19:34,356][52658] Sum rewards: 72.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.206', 'weapon2': '0.628', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '60.000'} [2024-08-06 03:19:34,670][52669] DAMAGECOUNT value on done: 403231.0 [2024-08-06 03:19:34,670][52669] Sum rewards: 65.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.036', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:34,686][52794] DAMAGECOUNT value on done: 399092.0 [2024-08-06 03:19:34,688][52794] Sum rewards: 73.094, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.692', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.208', 'AMMO4': '0.225', 'AMMO3': '0.233', 'weapon4': '0.268', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:34,973][52665] DAMAGECOUNT value on done: 389321.0 [2024-08-06 03:19:34,974][52665] Sum rewards: 69.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.286', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.072', 'AMMO4': '0.210', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon5': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:35,204][52668] DAMAGECOUNT value on done: 393831.0 [2024-08-06 03:19:35,205][52668] Sum rewards: 67.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.372', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.090', 'AMMO4': '0.110', 'weapon5': '0.128', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.088', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:35,366][52660] DAMAGECOUNT value on done: 391095.0 [2024-08-06 03:19:35,366][52660] Sum rewards: 65.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.178', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.136', 'AMMO4': '0.226', 'weapon5': '0.240', 'AMMO3': '0.241', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:35,448][52795] DAMAGECOUNT value on done: 360345.0 [2024-08-06 03:19:35,452][52795] Sum rewards: 72.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '2.916', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '56.500'} [2024-08-06 03:19:35,769][52647] DAMAGECOUNT value on done: 415601.0 [2024-08-06 03:19:35,769][52647] Sum rewards: 76.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.090', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:36,364][52671] DAMAGECOUNT value on done: 396194.0 [2024-08-06 03:19:36,372][52671] Sum rewards: 75.495, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.281', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.108', 'weapon5': '0.128', 'AMMO4': '0.154', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:36,745][52662] DAMAGECOUNT value on done: 394851.0 [2024-08-06 03:19:36,747][52662] Sum rewards: 74.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:36,919][52820] DAMAGECOUNT value on done: 367118.0 [2024-08-06 03:19:36,921][52820] Sum rewards: 63.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.140', 'AMMO3': '0.211', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:37,112][52649] DAMAGECOUNT value on done: 382056.0 [2024-08-06 03:19:37,112][52649] Sum rewards: 64.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.905', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.151', 'weapon2': '0.180', 'AMMO3': '0.197', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '54.000'} [2024-08-06 03:19:37,374][52658] DAMAGECOUNT value on done: 398746.0 [2024-08-06 03:19:37,375][52658] Sum rewards: 75.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.808', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.134', 'AMMO4': '0.144', 'weapon5': '0.166', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:37,703][52794] DAMAGECOUNT value on done: 396511.0 [2024-08-06 03:19:37,706][52794] Sum rewards: 82.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.154', 'weapon4': '0.166', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '71.000'} [2024-08-06 03:19:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 367886336. Throughput: 0: 4368.9. Samples: 91975820. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:19:37,794][52567] Avg episode reward: [(0, '71.234')] [2024-08-06 03:19:37,797][52614] Saving new best policy, reward=71.234! [2024-08-06 03:19:37,868][52665] DAMAGECOUNT value on done: 392216.0 [2024-08-06 03:19:37,869][52665] Sum rewards: 79.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.535', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.024', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '66.000'} [2024-08-06 03:19:38,206][52647] DAMAGECOUNT value on done: 419552.0 [2024-08-06 03:19:38,209][52647] Sum rewards: 70.385, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.195', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.098', 'weapon4': '0.158', 'AMMO3': '0.171', 'AMMO4': '0.181', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '55.500'} [2024-08-06 03:19:38,332][52660] DAMAGECOUNT value on done: 405437.0 [2024-08-06 03:19:38,333][52660] Sum rewards: 85.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon5': '0.028', 'AMMO4': '0.038', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '72.000'} [2024-08-06 03:19:38,591][52795] DAMAGECOUNT value on done: 366832.0 [2024-08-06 03:19:38,593][52795] Sum rewards: 67.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.557', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon4': '0.036', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.159', 'weapon5': '0.178', 'AMMO3': '0.181', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:38,982][52650] Updated weights for policy 0, policy_version 44911 (0.0023) [2024-08-06 03:19:39,374][52671] DAMAGECOUNT value on done: 404657.0 [2024-08-06 03:19:39,375][52671] Sum rewards: 79.891, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.080', 'weapon5': '0.118', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.576', 'WEAPON3': '0.950', 'weapon3': '3.050', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:39,906][52662] DAMAGECOUNT value on done: 392839.0 [2024-08-06 03:19:39,907][52662] Sum rewards: 69.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.540', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO4': '0.218', 'weapon5': '0.252', 'AMMO3': '0.263', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.034', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:40,121][52820] DAMAGECOUNT value on done: 368636.0 [2024-08-06 03:19:40,122][52820] Sum rewards: 72.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.080', 'weapon4': '0.108', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:40,179][52649] DAMAGECOUNT value on done: 390780.0 [2024-08-06 03:19:40,180][52649] Sum rewards: 59.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.302', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.086', 'weapon5': '0.092', 'AMMO4': '0.138', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.018', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '52.000'} [2024-08-06 03:19:40,657][52658] DAMAGECOUNT value on done: 394175.0 [2024-08-06 03:19:40,658][52658] Sum rewards: 58.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.160', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.082', 'AMMO3': '0.140', 'weapon5': '0.198', 'AMMO4': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon2': '0.892', 'weapon3': '2.602', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.599', 'FRAGCOUNT': '46.500'} [2024-08-06 03:19:40,801][52794] DAMAGECOUNT value on done: 393784.0 [2024-08-06 03:19:40,801][52794] Sum rewards: 55.395, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.392', 'AMMO2': '0.001', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.126', 'weapon2': '0.570', 'WEAPON3': '0.800', 'HITCOUNT': '2.760', 'weapon3': '3.190', 'DAMAGECOUNT': '13.071', 'FRAGCOUNT': '44.000'} [2024-08-06 03:19:40,837][52647] DAMAGECOUNT value on done: 411375.0 [2024-08-06 03:19:40,840][52647] Sum rewards: 61.436, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.485', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.101', 'weapon4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'weapon2': '0.358', 'WEAPON3': '1.800', 'weapon3': '3.150', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:41,034][52665] DAMAGECOUNT value on done: 393625.0 [2024-08-06 03:19:41,035][52665] Sum rewards: 68.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.391', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.190', 'weapon5': '0.194', 'AMMO3': '0.203', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:41,127][52660] DAMAGECOUNT value on done: 408325.0 [2024-08-06 03:19:41,128][52660] Sum rewards: 74.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.216', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:41,558][52795] DAMAGECOUNT value on done: 374416.0 [2024-08-06 03:19:41,559][52795] Sum rewards: 66.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.368', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon4': '0.064', 'weapon5': '0.122', 'AMMO4': '0.133', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:42,526][52671] DAMAGECOUNT value on done: 407307.0 [2024-08-06 03:19:42,526][52671] Sum rewards: 67.172, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.280', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.156', 'weapon5': '0.178', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.307', 'WEAPON3': '1.850', 'weapon3': '3.118', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:42,804][52567] Fps is (10 sec: 17185.7, 60 sec: 17473.3, 300 sec: 17466.4). Total num frames: 367976448. Throughput: 0: 4363.5. Samples: 92001950. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:19:42,804][52567] Avg episode reward: [(0, '70.890')] [2024-08-06 03:19:43,171][52649] DAMAGECOUNT value on done: 391073.0 [2024-08-06 03:19:43,175][52649] Sum rewards: 65.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.696', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.112', 'weapon5': '0.186', 'AMMO3': '0.241', 'AMMO4': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '2.884', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:43,286][52820] DAMAGECOUNT value on done: 363763.0 [2024-08-06 03:19:43,287][52820] Sum rewards: 69.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.016', 'AMMO5': '0.021', 'AMMO2': '0.065', 'AMMO3': '0.213', 'weapon4': '0.278', 'weapon5': '0.296', 'AMMO4': '0.328', 'weapon2': '0.504', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.600', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:43,308][52647] DAMAGECOUNT value on done: 416585.0 [2024-08-06 03:19:43,309][52647] Sum rewards: 87.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.158', 'weapon5': '0.182', 'weapon2': '0.244', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '74.000'} [2024-08-06 03:19:43,364][52658] DAMAGECOUNT value on done: 394986.0 [2024-08-06 03:19:43,366][52658] Sum rewards: 66.153, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.790', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon4': '0.192', 'AMMO3': '0.206', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.728', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:43,528][52650] Updated weights for policy 0, policy_version 44921 (0.0012) [2024-08-06 03:19:43,760][52794] DAMAGECOUNT value on done: 399026.0 [2024-08-06 03:19:43,761][52794] Sum rewards: 72.833, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'HEALTH': '0.017', 'AMMO2': '0.035', 'AMMO3': '0.155', 'AMMO4': '0.177', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.724', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:43,968][52660] DAMAGECOUNT value on done: 390962.0 [2024-08-06 03:19:43,969][52660] Sum rewards: 57.731, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.206', 'AMMO5': '0.020', 'AMMO2': '0.069', 'weapon5': '0.228', 'AMMO3': '0.234', 'weapon4': '0.280', 'weapon2': '0.328', 'AMMO4': '0.343', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:45,622][52671] DAMAGECOUNT value on done: 396146.0 [2024-08-06 03:19:45,623][52671] Sum rewards: 65.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.362', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.080', 'AMMO4': '0.189', 'weapon5': '0.224', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:45,979][52647] DAMAGECOUNT value on done: 415192.0 [2024-08-06 03:19:45,979][52647] Sum rewards: 60.371, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.162', 'weapon5': '0.188', 'weapon2': '0.204', 'AMMO4': '0.232', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.170', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '52.000'} [2024-08-06 03:19:46,292][52820] DAMAGECOUNT value on done: 368714.0 [2024-08-06 03:19:46,293][52820] Sum rewards: 79.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:46,326][52658] DAMAGECOUNT value on done: 391668.0 [2024-08-06 03:19:46,326][52658] Sum rewards: 70.417, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'weapon5': '0.044', 'AMMO2': '0.045', 'weapon4': '0.128', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:46,462][52649] DAMAGECOUNT value on done: 383406.0 [2024-08-06 03:19:46,464][52649] Sum rewards: 72.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.964', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.196', 'weapon2': '0.256', 'AMMO3': '0.319', 'WEAPON3': '1.850', 'weapon3': '3.266', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '64.000'} [2024-08-06 03:19:46,477][52660] DAMAGECOUNT value on done: 396475.0 [2024-08-06 03:19:46,477][52660] Sum rewards: 59.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.173', 'AMMO4': '0.259', 'weapon5': '0.294', 'weapon2': '0.350', 'weapon4': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.728', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '49.000'} [2024-08-06 03:19:46,719][52794] DAMAGECOUNT value on done: 403989.0 [2024-08-06 03:19:46,719][52794] Sum rewards: 71.241, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.066', 'weapon5': '0.084', 'AMMO4': '0.121', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.186', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 368058368. Throughput: 0: 4369.3. Samples: 92014960. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:19:47,794][52567] Avg episode reward: [(0, '70.647')] [2024-08-06 03:19:48,226][52650] Updated weights for policy 0, policy_version 44931 (0.0012) [2024-08-06 03:19:48,769][52647] DAMAGECOUNT value on done: 424696.0 [2024-08-06 03:19:48,770][52647] Sum rewards: 76.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.643', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:48,944][52671] DAMAGECOUNT value on done: 407532.0 [2024-08-06 03:19:48,946][52671] Sum rewards: 63.028, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.444', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon4': '0.168', 'AMMO3': '0.172', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:49,345][52820] DAMAGECOUNT value on done: 362384.0 [2024-08-06 03:19:49,346][52820] Sum rewards: 78.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.694', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.224', 'AMMO3': '0.244', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:49,364][52649] DAMAGECOUNT value on done: 390112.0 [2024-08-06 03:19:49,364][52649] Sum rewards: 68.129, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.014', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.156', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'weapon4': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.482', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '54.000'} [2024-08-06 03:19:49,467][52660] DAMAGECOUNT value on done: 391555.0 [2024-08-06 03:19:49,468][52660] Sum rewards: 78.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.070', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '64.000'} [2024-08-06 03:19:49,475][52794] DAMAGECOUNT value on done: 394369.0 [2024-08-06 03:19:49,476][52794] Sum rewards: 65.548, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.535', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.178', 'weapon2': '0.184', 'AMMO4': '0.200', 'AMMO3': '0.289', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.884', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:49,550][52658] DAMAGECOUNT value on done: 404503.0 [2024-08-06 03:19:49,551][52658] Sum rewards: 76.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.400', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '65.000'} [2024-08-06 03:19:49,688][52660] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:19:51,471][52671] DAMAGECOUNT value on done: 398294.0 [2024-08-06 03:19:51,472][52671] Sum rewards: 69.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.918', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.205', 'AMMO4': '0.233', 'weapon5': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.716', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '57.000'} [2024-08-06 03:19:51,498][52647] DAMAGECOUNT value on done: 415147.0 [2024-08-06 03:19:51,499][52647] Sum rewards: 74.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.041', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon4': '0.166', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'weapon3': '3.390', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '64.000'} [2024-08-06 03:19:52,087][52660] DAMAGECOUNT value on done: 397987.0 [2024-08-06 03:19:52,088][52660] Sum rewards: 64.520, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.635', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.102', 'AMMO3': '0.106', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '0.750', 'HITCOUNT': '2.840', 'weapon3': '3.278', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '50.000'} [2024-08-06 03:19:52,264][52794] DAMAGECOUNT value on done: 403103.0 [2024-08-06 03:19:52,264][52794] Sum rewards: 60.597, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.139', 'AMMO5': '0.014', 'AMMO2': '0.060', 'weapon5': '0.146', 'weapon4': '0.204', 'weapon2': '0.300', 'AMMO4': '0.301', 'AMMO3': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.932', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:52,451][52649] DAMAGECOUNT value on done: 392138.0 [2024-08-06 03:19:52,454][52649] Sum rewards: 74.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.040', 'AMMO4': '0.047', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '62.000'} [2024-08-06 03:19:52,535][52658] DAMAGECOUNT value on done: 396348.0 [2024-08-06 03:19:52,535][52658] Sum rewards: 72.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.354', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.185', 'weapon5': '0.186', 'weapon4': '0.192', 'AMMO4': '0.206', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '60.000'} [2024-08-06 03:19:52,763][52820] DAMAGECOUNT value on done: 364246.0 [2024-08-06 03:19:52,764][52820] Sum rewards: 54.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'AMMO5': '0.025', 'AMMO2': '0.043', 'weapon5': '0.140', 'weapon4': '0.212', 'AMMO4': '0.217', 'AMMO3': '0.227', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.610', 'weapon3': '2.892', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '49.000'} [2024-08-06 03:19:52,794][52567] Fps is (10 sec: 17220.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 368148480. Throughput: 0: 4371.1. Samples: 92041300. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:19:52,794][52567] Avg episode reward: [(0, '70.738')] [2024-08-06 03:19:52,974][52650] Updated weights for policy 0, policy_version 44941 (0.0040) [2024-08-06 03:19:54,208][52647] DAMAGECOUNT value on done: 413150.0 [2024-08-06 03:19:54,208][52647] Sum rewards: 68.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.077', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.166', 'AMMO4': '0.238', 'weapon4': '0.302', 'weapon5': '0.320', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:54,342][52671] DAMAGECOUNT value on done: 390116.0 [2024-08-06 03:19:54,343][52671] Sum rewards: 69.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.418', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.156', 'AMMO3': '0.185', 'AMMO4': '0.186', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.246', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.000'} [2024-08-06 03:19:54,907][52658] DAMAGECOUNT value on done: 399090.0 [2024-08-06 03:19:54,908][52658] Sum rewards: 75.315, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.043', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.187', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '60.000'} [2024-08-06 03:19:54,945][52660] DAMAGECOUNT value on done: 393149.0 [2024-08-06 03:19:54,949][52660] Sum rewards: 67.786, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.022', 'AMMO4': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.452', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.230', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '55.000'} [2024-08-06 03:19:55,044][52794] DAMAGECOUNT value on done: 398692.0 [2024-08-06 03:19:55,046][52794] Sum rewards: 74.612, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.878', 'AMMO5': '0.023', 'AMMO2': '0.049', 'AMMO3': '0.182', 'AMMO4': '0.247', 'weapon4': '0.280', 'weapon5': '0.292', 'weapon2': '0.482', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.654', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:55,597][52649] DAMAGECOUNT value on done: 392164.0 [2024-08-06 03:19:55,599][52649] Sum rewards: 74.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.044', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:55,980][52820] DAMAGECOUNT value on done: 369746.0 [2024-08-06 03:19:55,980][52820] Sum rewards: 53.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.472', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.190', 'AMMO4': '0.226', 'AMMO3': '0.255', 'weapon5': '0.278', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.530', 'weapon3': '2.924', 'DAMAGECOUNT': '13.341', 'FRAGCOUNT': '48.000'} [2024-08-06 03:19:56,931][52647] DAMAGECOUNT value on done: 413162.0 [2024-08-06 03:19:56,931][52647] Sum rewards: 73.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.060', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.238', 'WEAPON3': '1.200', 'weapon3': '3.404', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '60.000'} [2024-08-06 03:19:57,283][52658] DAMAGECOUNT value on done: 402322.0 [2024-08-06 03:19:57,284][52658] Sum rewards: 71.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.904', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.188', 'AMMO3': '0.219', 'weapon5': '0.220', 'AMMO4': '0.267', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2024-08-06 03:19:57,423][52671] DAMAGECOUNT value on done: 405855.0 [2024-08-06 03:19:57,424][52671] Sum rewards: 69.300, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.116', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.092', 'weapon5': '0.176', 'AMMO4': '0.217', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '58.000'} [2024-08-06 03:19:57,471][52650] Updated weights for policy 0, policy_version 44951 (0.0031) [2024-08-06 03:19:57,767][52794] DAMAGECOUNT value on done: 395475.0 [2024-08-06 03:19:57,767][52794] Sum rewards: 73.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.779', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '61.000'} [2024-08-06 03:19:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 368238592. Throughput: 0: 4377.3. Samples: 92067600. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:19:57,794][52567] Avg episode reward: [(0, '70.285')] [2024-08-06 03:19:58,441][52649] DAMAGECOUNT value on done: 392009.0 [2024-08-06 03:19:58,442][52649] Sum rewards: 79.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.120', 'weapon2': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.352', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '66.000'} [2024-08-06 03:19:59,121][52820] DAMAGECOUNT value on done: 366836.0 [2024-08-06 03:19:59,121][52820] Sum rewards: 76.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.112', 'weapon5': '0.134', 'AMMO4': '0.135', 'weapon2': '0.154', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 03:19:59,350][52647] DAMAGECOUNT value on done: 411755.0 [2024-08-06 03:19:59,351][52647] Sum rewards: 70.707, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.560', 'AMMO5': '0.025', 'AMMO2': '0.055', 'weapon5': '0.240', 'weapon4': '0.246', 'AMMO3': '0.250', 'weapon2': '0.256', 'AMMO4': '0.273', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:00,520][52671] DAMAGECOUNT value on done: 405627.0 [2024-08-06 03:20:00,522][52671] Sum rewards: 78.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.090', 'weapon5': '0.188', 'AMMO3': '0.253', 'weapon2': '0.262', 'AMMO4': '0.269', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '65.500'} [2024-08-06 03:20:00,965][52794] DAMAGECOUNT value on done: 401300.0 [2024-08-06 03:20:00,965][52794] Sum rewards: 57.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.212', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.098', 'AMMO3': '0.185', 'AMMO4': '0.206', 'weapon5': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '47.500'} [2024-08-06 03:20:01,716][52647] DAMAGECOUNT value on done: 416101.0 [2024-08-06 03:20:01,717][52647] Sum rewards: 69.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.186', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon2': '0.216', 'AMMO3': '0.220', 'weapon4': '0.380', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '57.000'} [2024-08-06 03:20:01,793][52649] DAMAGECOUNT value on done: 385031.0 [2024-08-06 03:20:01,796][52649] Sum rewards: 81.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.505', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.123', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '65.500'} [2024-08-06 03:20:02,312][52820] DAMAGECOUNT value on done: 371589.0 [2024-08-06 03:20:02,313][52820] Sum rewards: 72.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.186', 'weapon4': '0.194', 'AMMO4': '0.258', 'weapon5': '0.280', 'weapon2': '0.516', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.710', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '58.000'} [2024-08-06 03:20:02,353][52650] Updated weights for policy 0, policy_version 44961 (0.0012) [2024-08-06 03:20:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 368320512. Throughput: 0: 4374.9. Samples: 92080650. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:20:02,794][52567] Avg episode reward: [(0, '70.479')] [2024-08-06 03:20:03,511][52671] DAMAGECOUNT value on done: 405858.0 [2024-08-06 03:20:03,512][52671] Sum rewards: 69.497, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.280', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO3': '0.137', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.456', 'WEAPON3': '0.850', 'HITCOUNT': '3.230', 'weapon3': '3.276', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '55.000'} [2024-08-06 03:20:03,797][52794] DAMAGECOUNT value on done: 391103.0 [2024-08-06 03:20:03,800][52794] Sum rewards: 70.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '58.000'} [2024-08-06 03:20:04,607][52649] DAMAGECOUNT value on done: 390863.0 [2024-08-06 03:20:04,607][52649] Sum rewards: 74.738, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.545', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.098', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'WEAPON3': '1.750', 'weapon3': '3.502', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '64.000'} [2024-08-06 03:20:05,435][52820] DAMAGECOUNT value on done: 364949.0 [2024-08-06 03:20:05,436][52820] Sum rewards: 73.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.536', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.042', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:06,537][52671] DAMAGECOUNT value on done: 400788.0 [2024-08-06 03:20:06,538][52671] Sum rewards: 63.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.252', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.134', 'AMMO4': '0.185', 'AMMO3': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.024', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '52.000'} [2024-08-06 03:20:06,611][52794] DAMAGECOUNT value on done: 409136.0 [2024-08-06 03:20:06,611][52794] Sum rewards: 82.166, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.094', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'weapon2': '0.396', 'WEAPON3': '0.950', 'weapon3': '3.114', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '64.000'} [2024-08-06 03:20:07,061][52650] Updated weights for policy 0, policy_version 44971 (0.0026) [2024-08-06 03:20:07,773][52666] Large shaping reward -2.522 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.273, -91.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:20:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 368418816. Throughput: 0: 4378.2. Samples: 92107020. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:20:07,797][52567] Avg episode reward: [(0, '70.410')] [2024-08-06 03:20:07,804][52649] DAMAGECOUNT value on done: 385516.0 [2024-08-06 03:20:07,805][52649] Sum rewards: 65.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.104', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon4': '0.042', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'AMMO4': '0.201', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.444', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '53.000'} [2024-08-06 03:20:08,581][52820] DAMAGECOUNT value on done: 367372.0 [2024-08-06 03:20:08,582][52820] Sum rewards: 62.664, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.380', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.322', 'weapon3': '2.442', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '48.500'} [2024-08-06 03:20:09,347][52671] DAMAGECOUNT value on done: 398441.0 [2024-08-06 03:20:09,347][52671] Sum rewards: 73.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '62.000'} [2024-08-06 03:20:09,436][52794] DAMAGECOUNT value on done: 391935.0 [2024-08-06 03:20:09,437][52794] Sum rewards: 84.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.105', 'weapon5': '0.114', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.000', 'weapon3': '3.308', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '68.000'} [2024-08-06 03:20:10,088][52649] DAMAGECOUNT value on done: 392517.0 [2024-08-06 03:20:10,098][52649] Sum rewards: 64.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon4': '0.108', 'weapon5': '0.218', 'AMMO3': '0.247', 'AMMO4': '0.295', 'weapon2': '0.366', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '2.980', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '58.000'} [2024-08-06 03:20:11,755][52650] Updated weights for policy 0, policy_version 44981 (0.0031) [2024-08-06 03:20:11,963][52820] DAMAGECOUNT value on done: 373574.0 [2024-08-06 03:20:11,963][52820] Sum rewards: 69.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.930', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.172', 'weapon5': '0.190', 'AMMO3': '0.235', 'AMMO4': '0.240', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '58.500'} [2024-08-06 03:20:12,326][52794] DAMAGECOUNT value on done: 408393.0 [2024-08-06 03:20:12,326][52794] Sum rewards: 71.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.201', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '59.000'} [2024-08-06 03:20:12,766][52649] DAMAGECOUNT value on done: 394587.0 [2024-08-06 03:20:12,767][52649] Sum rewards: 72.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.055', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.166', 'weapon4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 368500736. Throughput: 0: 4375.8. Samples: 92133300. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:12,794][52567] Avg episode reward: [(0, '70.394')] [2024-08-06 03:20:12,953][52659] DAMAGECOUNT value on done: 400509.0 [2024-08-06 03:20:12,954][52659] Sum rewards: 75.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.165', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon4': '0.232', 'weapon2': '0.274', 'WEAPON3': '0.950', 'weapon3': '3.020', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '60.000'} [2024-08-06 03:20:15,181][52820] DAMAGECOUNT value on done: 368804.0 [2024-08-06 03:20:15,184][52820] Sum rewards: 65.016, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.620', 'AMMO5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.108', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.834', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '52.000'} [2024-08-06 03:20:15,319][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:20:15,483][52794] DAMAGECOUNT value on done: 399631.0 [2024-08-06 03:20:15,484][52794] Sum rewards: 67.638, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.962', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.104', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO3': '0.298', 'WEAPON3': '1.800', 'HITCOUNT': '3.260', 'weapon3': '3.456', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:15,502][52649] DAMAGECOUNT value on done: 391003.0 [2024-08-06 03:20:15,502][52649] Sum rewards: 63.083, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.814', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.096', 'AMMO4': '0.097', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '51.000'} [2024-08-06 03:20:16,070][52659] DAMAGECOUNT value on done: 399541.0 [2024-08-06 03:20:16,075][52659] Sum rewards: 60.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.374', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.189', 'weapon5': '0.218', 'weapon4': '0.268', 'AMMO4': '0.280', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '50.500'} [2024-08-06 03:20:16,290][52650] Updated weights for policy 0, policy_version 44991 (0.0011) [2024-08-06 03:20:17,392][52662] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:20:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 368582656. Throughput: 0: 4379.1. Samples: 92146460. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:17,794][52567] Avg episode reward: [(0, '70.058')] [2024-08-06 03:20:18,326][52820] DAMAGECOUNT value on done: 372688.0 [2024-08-06 03:20:18,326][52820] Sum rewards: 62.601, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.788', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.101', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.214', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '50.000'} [2024-08-06 03:20:18,553][52794] DAMAGECOUNT value on done: 400927.0 [2024-08-06 03:20:18,556][52794] Sum rewards: 75.116, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.198', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.216', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:18,744][52659] DAMAGECOUNT value on done: 400481.0 [2024-08-06 03:20:18,745][52659] Sum rewards: 78.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.023', 'AMMO2': '0.048', 'weapon5': '0.222', 'weapon4': '0.232', 'AMMO4': '0.241', 'AMMO3': '0.243', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.884', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '66.000'} [2024-08-06 03:20:21,056][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:20:21,069][52650] Updated weights for policy 0, policy_version 45001 (0.0017) [2024-08-06 03:20:21,396][52820] DAMAGECOUNT value on done: 368183.0 [2024-08-06 03:20:21,400][52820] Sum rewards: 65.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.702', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon2': '0.172', 'weapon5': '0.174', 'AMMO3': '0.195', 'weapon4': '0.212', 'AMMO4': '0.217', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '53.000'} [2024-08-06 03:20:21,521][52794] DAMAGECOUNT value on done: 410474.0 [2024-08-06 03:20:21,523][52794] Sum rewards: 64.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.604', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.162', 'weapon4': '0.232', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.500', 'weapon3': '2.774', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '57.000'} [2024-08-06 03:20:21,642][52659] DAMAGECOUNT value on done: 398757.0 [2024-08-06 03:20:21,644][52659] Sum rewards: 69.131, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.134', 'AMMO3': '0.211', 'AMMO4': '0.231', 'weapon5': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '2.698', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '57.000'} [2024-08-06 03:20:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 368680960. Throughput: 0: 4372.0. Samples: 92172560. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:22,794][52567] Avg episode reward: [(0, '70.131')] [2024-08-06 03:20:24,304][52659] DAMAGECOUNT value on done: 395796.0 [2024-08-06 03:20:24,305][52659] Sum rewards: 65.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.145', 'weapon5': '0.182', 'AMMO3': '0.216', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.246', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '53.000'} [2024-08-06 03:20:24,494][52820] DAMAGECOUNT value on done: 366632.0 [2024-08-06 03:20:24,494][52820] Sum rewards: 73.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.088', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.362', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '59.000'} [2024-08-06 03:20:24,876][52794] DAMAGECOUNT value on done: 398056.0 [2024-08-06 03:20:24,877][52794] Sum rewards: 60.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.466', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.800', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '50.000'} [2024-08-06 03:20:25,639][52650] Updated weights for policy 0, policy_version 45011 (0.0012) [2024-08-06 03:20:26,839][52659] DAMAGECOUNT value on done: 398612.0 [2024-08-06 03:20:26,840][52659] Sum rewards: 66.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.478', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.122', 'weapon5': '0.162', 'weapon2': '0.228', 'AMMO3': '0.233', 'AMMO4': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.138', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '57.000'} [2024-08-06 03:20:27,601][52820] DAMAGECOUNT value on done: 376840.0 [2024-08-06 03:20:27,602][52820] Sum rewards: 62.362, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.221', 'weapon2': '0.236', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '52.000'} [2024-08-06 03:20:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 368762880. Throughput: 0: 4373.6. Samples: 92198720. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:27,794][52567] Avg episode reward: [(0, '69.920')] [2024-08-06 03:20:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045015_368762880.pth... [2024-08-06 03:20:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000044503_364568576.pth [2024-08-06 03:20:30,040][52659] DAMAGECOUNT value on done: 399378.0 [2024-08-06 03:20:30,042][52659] Sum rewards: 70.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.230', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.090', 'AMMO3': '0.197', 'AMMO4': '0.198', 'weapon2': '0.208', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.210', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '56.000'} [2024-08-06 03:20:30,541][52650] Updated weights for policy 0, policy_version 45021 (0.0019) [2024-08-06 03:20:30,657][52820] DAMAGECOUNT value on done: 379314.0 [2024-08-06 03:20:30,661][52820] Sum rewards: 71.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.179', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.126', 'AMMO3': '0.193', 'AMMO4': '0.244', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '59.000'} [2024-08-06 03:20:32,702][52659] DAMAGECOUNT value on done: 395881.0 [2024-08-06 03:20:32,704][52659] Sum rewards: 60.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.039', 'AMMO5': '0.018', 'AMMO2': '0.069', 'weapon2': '0.206', 'AMMO3': '0.208', 'weapon5': '0.234', 'weapon4': '0.298', 'AMMO4': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '2.902', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2024-08-06 03:20:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 368844800. Throughput: 0: 4369.3. Samples: 92211580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:32,794][52567] Avg episode reward: [(0, '69.802')] [2024-08-06 03:20:33,727][52820] DAMAGECOUNT value on done: 366974.0 [2024-08-06 03:20:33,727][52820] Sum rewards: 77.257, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.973', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.232', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '64.000'} [2024-08-06 03:20:33,910][52666] DAMAGECOUNT value on done: 397502.0 [2024-08-06 03:20:33,910][52666] Sum rewards: 70.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.357', 'AMMO5': '0.007', 'AMMO2': '0.040', 'AMMO3': '0.177', 'weapon5': '0.178', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.402', 'weapon4': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '57.000'} [2024-08-06 03:20:35,060][52650] Updated weights for policy 0, policy_version 45031 (0.0012) [2024-08-06 03:20:35,471][52659] DAMAGECOUNT value on done: 406676.0 [2024-08-06 03:20:35,471][52659] Sum rewards: 65.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.197', 'AMMO3': '0.202', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.282', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '54.000'} [2024-08-06 03:20:36,024][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:20:36,885][52666] DAMAGECOUNT value on done: 402909.0 [2024-08-06 03:20:36,885][52666] Sum rewards: 64.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.204', 'weapon5': '0.222', 'AMMO4': '0.288', 'weapon2': '0.444', 'weapon4': '0.512', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '54.000'} [2024-08-06 03:20:37,500][52663] DAMAGECOUNT value on done: 403340.0 [2024-08-06 03:20:37,501][52663] Sum rewards: 65.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.106', 'AMMO4': '0.146', 'AMMO3': '0.165', 'weapon5': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '52.000'} [2024-08-06 03:20:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 368934912. Throughput: 0: 4370.4. Samples: 92237970. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:37,794][52567] Avg episode reward: [(0, '69.689')] [2024-08-06 03:20:38,527][52659] DAMAGECOUNT value on done: 407952.0 [2024-08-06 03:20:38,528][52659] Sum rewards: 71.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.032', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon2': '0.168', 'weapon5': '0.186', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.408', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.000'} [2024-08-06 03:20:38,531][52670] DAMAGECOUNT value on done: 393836.0 [2024-08-06 03:20:38,533][52670] Sum rewards: 61.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.165', 'AMMO4': '0.189', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '51.000'} [2024-08-06 03:20:39,805][52650] Updated weights for policy 0, policy_version 45041 (0.0024) [2024-08-06 03:20:39,848][52666] DAMAGECOUNT value on done: 401917.0 [2024-08-06 03:20:39,852][52666] Sum rewards: 58.961, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.764', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.151', 'weapon5': '0.184', 'weapon2': '0.256', 'AMMO4': '0.279', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.918', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.412', 'FRAGCOUNT': '47.500'} [2024-08-06 03:20:40,349][52663] DAMAGECOUNT value on done: 399337.0 [2024-08-06 03:20:40,350][52663] Sum rewards: 78.072, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'weapon3': '3.456', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '65.000'} [2024-08-06 03:20:41,433][52670] DAMAGECOUNT value on done: 399465.0 [2024-08-06 03:20:41,433][52670] Sum rewards: 73.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.213', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.560', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:41,705][52659] DAMAGECOUNT value on done: 400672.0 [2024-08-06 03:20:41,705][52659] Sum rewards: 81.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.828', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.368', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '69.000'} [2024-08-06 03:20:41,930][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:20:42,585][52666] DAMAGECOUNT value on done: 399010.0 [2024-08-06 03:20:42,585][52666] Sum rewards: 49.068, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.774', 'AMMO5': '0.030', 'AMMO2': '0.074', 'AMMO3': '0.237', 'weapon2': '0.300', 'weapon5': '0.308', 'AMMO4': '0.370', 'weapon4': '0.382', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'HITCOUNT': '2.320', 'weapon3': '2.624', 'DAMAGECOUNT': '12.696', 'FRAGCOUNT': '46.000'} [2024-08-06 03:20:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17479.2, 300 sec: 17467.0). Total num frames: 369025024. Throughput: 0: 4367.8. Samples: 92264150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:42,794][52567] Avg episode reward: [(0, '69.082')] [2024-08-06 03:20:43,503][52663] DAMAGECOUNT value on done: 393451.0 [2024-08-06 03:20:43,503][52663] Sum rewards: 62.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.915', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.280', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.224', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '53.000'} [2024-08-06 03:20:44,066][52659] DAMAGECOUNT value on done: 401899.0 [2024-08-06 03:20:44,067][52659] Sum rewards: 60.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.227', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.202', 'weapon2': '0.712', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '49.000'} [2024-08-06 03:20:44,450][52650] Updated weights for policy 0, policy_version 45051 (0.0013) [2024-08-06 03:20:44,488][52670] DAMAGECOUNT value on done: 391691.0 [2024-08-06 03:20:44,488][52670] Sum rewards: 72.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.092', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:45,842][52666] DAMAGECOUNT value on done: 397632.0 [2024-08-06 03:20:45,844][52666] Sum rewards: 60.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon4': '0.126', 'AMMO4': '0.197', 'weapon5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '51.000'} [2024-08-06 03:20:46,577][52663] DAMAGECOUNT value on done: 398872.0 [2024-08-06 03:20:46,577][52663] Sum rewards: 44.930, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.070', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.110', 'AMMO4': '0.206', 'weapon4': '0.218', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.470', 'weapon3': '2.908', 'DAMAGECOUNT': '12.165', 'FRAGCOUNT': '44.000'} [2024-08-06 03:20:47,084][52659] DAMAGECOUNT value on done: 391327.0 [2024-08-06 03:20:47,085][52659] Sum rewards: 80.727, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.635', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.143', 'weapon5': '0.174', 'weapon2': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.470', 'WEAPON3': '1.000', 'weapon3': '2.940', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '64.000'} [2024-08-06 03:20:47,652][52670] DAMAGECOUNT value on done: 389934.0 [2024-08-06 03:20:47,652][52670] Sum rewards: 66.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '54.000'} [2024-08-06 03:20:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 369115136. Throughput: 0: 4375.3. Samples: 92277540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:47,794][52567] Avg episode reward: [(0, '69.048')] [2024-08-06 03:20:48,866][52666] DAMAGECOUNT value on done: 391066.0 [2024-08-06 03:20:48,868][52666] Sum rewards: 84.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '68.000'} [2024-08-06 03:20:49,227][52650] Updated weights for policy 0, policy_version 45061 (0.0026) [2024-08-06 03:20:49,377][52663] DAMAGECOUNT value on done: 395766.0 [2024-08-06 03:20:49,377][52663] Sum rewards: 61.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.082', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.314', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '51.000'} [2024-08-06 03:20:49,771][52811] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:20:50,118][52659] DAMAGECOUNT value on done: 397808.0 [2024-08-06 03:20:50,119][52659] Sum rewards: 61.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.315', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.176', 'weapon5': '0.226', 'AMMO3': '0.227', 'AMMO4': '0.227', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '55.000'} [2024-08-06 03:20:50,693][52670] DAMAGECOUNT value on done: 400691.0 [2024-08-06 03:20:50,693][52670] Sum rewards: 64.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.620', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.090', 'weapon3': '3.452', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '55.000'} [2024-08-06 03:20:51,628][52666] DAMAGECOUNT value on done: 399446.0 [2024-08-06 03:20:51,629][52666] Sum rewards: 70.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.210', 'weapon5': '0.210', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '58.000'} [2024-08-06 03:20:52,289][52663] DAMAGECOUNT value on done: 401422.0 [2024-08-06 03:20:52,292][52663] Sum rewards: 73.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.770', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.094', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '62.000'} [2024-08-06 03:20:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 369197056. Throughput: 0: 4372.4. Samples: 92303780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:52,794][52567] Avg episode reward: [(0, '68.991')] [2024-08-06 03:20:53,050][52659] DAMAGECOUNT value on done: 407999.0 [2024-08-06 03:20:53,051][52659] Sum rewards: 79.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.076', 'AMMO4': '0.199', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '68.000'} [2024-08-06 03:20:53,342][52670] DAMAGECOUNT value on done: 394032.0 [2024-08-06 03:20:53,342][52670] Sum rewards: 73.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.568', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:54,084][52650] Updated weights for policy 0, policy_version 45071 (0.0015) [2024-08-06 03:20:54,310][52666] DAMAGECOUNT value on done: 398618.0 [2024-08-06 03:20:54,312][52666] Sum rewards: 80.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.110', 'AMMO3': '0.220', 'AMMO4': '0.223', 'weapon5': '0.266', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '66.000'} [2024-08-06 03:20:54,390][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:20:54,833][52663] DAMAGECOUNT value on done: 399298.0 [2024-08-06 03:20:54,834][52663] Sum rewards: 74.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.203', 'weapon4': '0.214', 'weapon2': '0.262', 'weapon5': '0.274', 'AMMO4': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '61.000'} [2024-08-06 03:20:56,153][52659] DAMAGECOUNT value on done: 404695.0 [2024-08-06 03:20:56,153][52659] Sum rewards: 75.037, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.497', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.168', 'AMMO4': '0.243', 'weapon2': '0.274', 'AMMO3': '0.309', 'weapon4': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.908', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '67.000'} [2024-08-06 03:20:56,217][52670] DAMAGECOUNT value on done: 391710.0 [2024-08-06 03:20:56,217][52670] Sum rewards: 69.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.076', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.112', 'weapon4': '0.116', 'AMMO3': '0.157', 'AMMO4': '0.238', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.050', 'weapon3': '3.326', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '57.000'} [2024-08-06 03:20:57,304][52666] DAMAGECOUNT value on done: 394227.0 [2024-08-06 03:20:57,312][52666] Sum rewards: 65.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '54.000'} [2024-08-06 03:20:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 369287168. Throughput: 0: 4366.0. Samples: 92329770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:20:57,794][52567] Avg episode reward: [(0, '69.382')] [2024-08-06 03:20:58,036][52663] DAMAGECOUNT value on done: 396182.0 [2024-08-06 03:20:58,036][52663] Sum rewards: 70.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.088', 'AMMO3': '0.217', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '59.000'} [2024-08-06 03:20:58,559][52650] Updated weights for policy 0, policy_version 45081 (0.0019) [2024-08-06 03:20:58,793][52670] DAMAGECOUNT value on done: 391863.0 [2024-08-06 03:20:58,794][52670] Sum rewards: 72.879, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.094', 'weapon5': '0.122', 'AMMO4': '0.125', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'HEALTH': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.254', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '59.000'} [2024-08-06 03:20:59,399][52659] DAMAGECOUNT value on done: 405319.0 [2024-08-06 03:20:59,401][52659] Sum rewards: 70.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.035', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.120', 'weapon4': '0.128', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '60.000'} [2024-08-06 03:20:59,701][52666] DAMAGECOUNT value on done: 391077.0 [2024-08-06 03:20:59,702][52666] Sum rewards: 71.284, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.852', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.142', 'weapon4': '0.184', 'AMMO4': '0.282', 'AMMO3': '0.291', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.650', 'weapon3': '2.964', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '61.000'} [2024-08-06 03:21:00,842][52663] DAMAGECOUNT value on done: 396703.0 [2024-08-06 03:21:00,843][52663] Sum rewards: 71.768, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.773', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon2': '0.256', 'AMMO3': '0.261', 'WEAPON3': '1.600', 'weapon3': '3.560', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '61.000'} [2024-08-06 03:21:01,375][52670] DAMAGECOUNT value on done: 395140.0 [2024-08-06 03:21:01,377][52670] Sum rewards: 74.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.079', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.098', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '60.000'} [2024-08-06 03:21:01,878][52659] DAMAGECOUNT value on done: 398228.0 [2024-08-06 03:21:01,879][52659] Sum rewards: 55.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.389', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.136', 'AMMO4': '0.191', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '45.500'} [2024-08-06 03:21:02,436][52666] DAMAGECOUNT value on done: 395211.0 [2024-08-06 03:21:02,445][52666] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.132', 'weapon4': '0.218', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '63.000'} [2024-08-06 03:21:02,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 369377280. Throughput: 0: 4370.9. Samples: 92343150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:21:02,795][52567] Avg episode reward: [(0, '69.397')] [2024-08-06 03:21:03,284][52650] Updated weights for policy 0, policy_version 45091 (0.0017) [2024-08-06 03:21:04,080][52663] DAMAGECOUNT value on done: 400723.0 [2024-08-06 03:21:04,080][52663] Sum rewards: 68.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.876', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.156', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '55.000'} [2024-08-06 03:21:04,434][52670] DAMAGECOUNT value on done: 389081.0 [2024-08-06 03:21:04,435][52670] Sum rewards: 74.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.128', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.196', 'AMMO3': '0.218', 'weapon4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:04,703][52659] DAMAGECOUNT value on done: 404553.0 [2024-08-06 03:21:04,706][52659] Sum rewards: 73.807, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.090', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:05,559][52666] DAMAGECOUNT value on done: 394175.0 [2024-08-06 03:21:05,560][52666] Sum rewards: 76.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.246', 'weapon4': '0.338', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '63.000'} [2024-08-06 03:21:06,684][52663] DAMAGECOUNT value on done: 404800.0 [2024-08-06 03:21:06,684][52663] Sum rewards: 86.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.201', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.130', 'weapon5': '0.144', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '73.000'} [2024-08-06 03:21:07,052][52670] DAMAGECOUNT value on done: 399800.0 [2024-08-06 03:21:07,052][52670] Sum rewards: 67.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.173', 'weapon7': '0.184', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.244', 'weapon4': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '54.000'} [2024-08-06 03:21:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 369459200. Throughput: 0: 4373.8. Samples: 92369380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:21:07,802][52567] Avg episode reward: [(0, '69.674')] [2024-08-06 03:21:07,878][52650] Updated weights for policy 0, policy_version 45101 (0.0012) [2024-08-06 03:21:08,031][52659] DAMAGECOUNT value on done: 403655.0 [2024-08-06 03:21:08,033][52659] Sum rewards: 67.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.275', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.096', 'weapon4': '0.208', 'AMMO4': '0.217', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '58.000'} [2024-08-06 03:21:08,196][52666] DAMAGECOUNT value on done: 402430.0 [2024-08-06 03:21:08,197][52666] Sum rewards: 69.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon2': '0.184', 'AMMO3': '0.186', 'weapon5': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '56.000'} [2024-08-06 03:21:09,195][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:21:09,388][52663] DAMAGECOUNT value on done: 400410.0 [2024-08-06 03:21:09,395][52663] Sum rewards: 72.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.795', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.224', 'weapon2': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.498', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '61.000'} [2024-08-06 03:21:09,769][52670] DAMAGECOUNT value on done: 392702.0 [2024-08-06 03:21:09,770][52670] Sum rewards: 67.464, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.664', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.102', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.344', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '59.000'} [2024-08-06 03:21:10,905][52666] DAMAGECOUNT value on done: 398904.0 [2024-08-06 03:21:10,905][52666] Sum rewards: 82.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.221', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '69.000'} [2024-08-06 03:21:12,469][52670] DAMAGECOUNT value on done: 393647.0 [2024-08-06 03:21:12,469][52670] Sum rewards: 66.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.314', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.068', 'AMMO4': '0.072', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.114', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '53.000'} [2024-08-06 03:21:12,616][52663] DAMAGECOUNT value on done: 394105.0 [2024-08-06 03:21:12,618][52663] Sum rewards: 72.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.801', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.072', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '59.000'} [2024-08-06 03:21:12,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 369541120. Throughput: 0: 4374.7. Samples: 92395580. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:21:12,794][52567] Avg episode reward: [(0, '69.850')] [2024-08-06 03:21:12,815][52650] Updated weights for policy 0, policy_version 45111 (0.0027) [2024-08-06 03:21:13,596][52666] DAMAGECOUNT value on done: 395195.0 [2024-08-06 03:21:13,597][52666] Sum rewards: 71.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.854', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.105', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '61.000'} [2024-08-06 03:21:15,175][52663] DAMAGECOUNT value on done: 393648.0 [2024-08-06 03:21:15,177][52663] Sum rewards: 56.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon5': '0.136', 'weapon4': '0.176', 'AMMO3': '0.202', 'AMMO4': '0.299', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '46.500'} [2024-08-06 03:21:15,711][52670] DAMAGECOUNT value on done: 401570.0 [2024-08-06 03:21:15,712][52670] Sum rewards: 68.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.466', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.102', 'weapon4': '0.126', 'AMMO4': '0.133', 'weapon2': '0.176', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.200', 'weapon3': '3.348', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '58.000'} [2024-08-06 03:21:16,649][52667] DAMAGECOUNT value on done: 397897.0 [2024-08-06 03:21:16,651][52667] Sum rewards: 69.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.366', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.214', 'AMMO3': '0.239', 'AMMO4': '0.261', 'weapon2': '0.270', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '58.000'} [2024-08-06 03:21:16,827][52666] DAMAGECOUNT value on done: 395969.0 [2024-08-06 03:21:16,828][52666] Sum rewards: 56.834, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.330', 'AMMO5': '0.024', 'AMMO2': '0.079', 'weapon4': '0.270', 'weapon5': '0.272', 'AMMO3': '0.284', 'weapon2': '0.338', 'AMMO4': '0.397', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.700', 'weapon3': '2.704', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 03:21:17,177][52650] Updated weights for policy 0, policy_version 45121 (0.0016) [2024-08-06 03:21:17,776][52663] DAMAGECOUNT value on done: 395270.0 [2024-08-06 03:21:17,778][52663] Sum rewards: 70.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.418', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.090', 'weapon4': '0.092', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '59.000'} [2024-08-06 03:21:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 369639424. Throughput: 0: 4378.9. Samples: 92408630. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:21:17,802][52567] Avg episode reward: [(0, '69.654')] [2024-08-06 03:21:18,544][52670] DAMAGECOUNT value on done: 398253.0 [2024-08-06 03:21:18,545][52670] Sum rewards: 78.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.037', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'weapon5': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '66.000'} [2024-08-06 03:21:19,708][52666] DAMAGECOUNT value on done: 397137.0 [2024-08-06 03:21:19,708][52666] Sum rewards: 80.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.641', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'AMMO3': '0.183', 'weapon4': '0.230', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '64.000'} [2024-08-06 03:21:19,868][52667] DAMAGECOUNT value on done: 405849.0 [2024-08-06 03:21:19,868][52667] Sum rewards: 67.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.551', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '56.000'} [2024-08-06 03:21:21,027][52663] DAMAGECOUNT value on done: 404947.0 [2024-08-06 03:21:21,031][52663] Sum rewards: 74.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO4': '0.174', 'weapon4': '0.184', 'weapon2': '0.216', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '65.000'} [2024-08-06 03:21:21,498][52670] DAMAGECOUNT value on done: 382658.0 [2024-08-06 03:21:21,498][52670] Sum rewards: 68.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.495', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 03:21:21,957][52650] Updated weights for policy 0, policy_version 45131 (0.0013) [2024-08-06 03:21:22,541][52667] DAMAGECOUNT value on done: 398536.0 [2024-08-06 03:21:22,544][52667] Sum rewards: 66.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.702', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.270', 'AMMO3': '0.277', 'weapon2': '0.362', 'WEAPON3': '1.600', 'weapon3': '2.882', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '57.000'} [2024-08-06 03:21:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 369721344. Throughput: 0: 4379.5. Samples: 92435050. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:21:22,802][52567] Avg episode reward: [(0, '69.666')] [2024-08-06 03:21:22,832][52666] DAMAGECOUNT value on done: 397890.0 [2024-08-06 03:21:22,832][52666] Sum rewards: 61.017, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.098', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.206', 'AMMO3': '0.267', 'weapon2': '0.270', 'AMMO4': '0.297', 'weapon4': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.650', 'weapon3': '2.840', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '55.000'} [2024-08-06 03:21:24,029][52663] DAMAGECOUNT value on done: 395580.0 [2024-08-06 03:21:24,030][52663] Sum rewards: 73.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.845', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.258', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:24,457][52670] DAMAGECOUNT value on done: 395302.0 [2024-08-06 03:21:24,459][52670] Sum rewards: 65.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.160', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '57.000'} [2024-08-06 03:21:25,404][52666] DAMAGECOUNT value on done: 387911.0 [2024-08-06 03:21:25,407][52666] Sum rewards: 64.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.122', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon5': '0.196', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.762', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '55.000'} [2024-08-06 03:21:25,830][52667] DAMAGECOUNT value on done: 401872.0 [2024-08-06 03:21:25,830][52667] Sum rewards: 67.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.187', 'weapon5': '0.192', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '54.000'} [2024-08-06 03:21:25,851][52671] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 03:21:26,773][52650] Updated weights for policy 0, policy_version 45141 (0.0025) [2024-08-06 03:21:26,880][52663] DAMAGECOUNT value on done: 401181.0 [2024-08-06 03:21:26,882][52663] Sum rewards: 69.499, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.170', 'weapon2': '0.210', 'AMMO4': '0.217', 'AMMO3': '0.227', 'weapon5': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '59.000'} [2024-08-06 03:21:27,073][52670] DAMAGECOUNT value on done: 402986.0 [2024-08-06 03:21:27,075][52670] Sum rewards: 73.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.150', 'weapon2': '0.208', 'weapon4': '0.210', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '60.000'} [2024-08-06 03:21:27,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 369811456. Throughput: 0: 4386.2. Samples: 92461530. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:21:27,795][52567] Avg episode reward: [(0, '69.364')] [2024-08-06 03:21:28,447][52666] DAMAGECOUNT value on done: 397829.0 [2024-08-06 03:21:28,448][52666] Sum rewards: 85.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.715', 'AMMO2': '0.001', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO4': '0.007', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.542', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '71.000'} [2024-08-06 03:21:28,735][52667] DAMAGECOUNT value on done: 406507.0 [2024-08-06 03:21:28,736][52667] Sum rewards: 79.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.410', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO4': '0.232', 'weapon4': '0.250', 'weapon2': '0.264', 'weapon5': '0.268', 'AMMO3': '0.277', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.888', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '67.000'} [2024-08-06 03:21:29,988][52663] DAMAGECOUNT value on done: 400316.0 [2024-08-06 03:21:29,988][52663] Sum rewards: 65.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.342', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.215', 'weapon2': '0.336', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '55.000'} [2024-08-06 03:21:30,238][52670] DAMAGECOUNT value on done: 394213.0 [2024-08-06 03:21:30,241][52670] Sum rewards: 51.515, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.088', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.000', 'HITCOUNT': '2.510', 'weapon3': '2.872', 'DAMAGECOUNT': '12.009', 'FRAGCOUNT': '42.000'} [2024-08-06 03:21:31,081][52650] Updated weights for policy 0, policy_version 45151 (0.0019) [2024-08-06 03:21:31,879][52667] DAMAGECOUNT value on done: 405365.0 [2024-08-06 03:21:31,880][52667] Sum rewards: 71.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.144', 'weapon5': '0.178', 'AMMO3': '0.227', 'AMMO4': '0.236', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 03:21:32,347][52663] DAMAGECOUNT value on done: 394431.0 [2024-08-06 03:21:32,347][52663] Sum rewards: 87.246, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.970', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.292', 'WEAPON3': '1.000', 'weapon3': '3.330', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '69.000'} [2024-08-06 03:21:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 369901568. Throughput: 0: 4380.0. Samples: 92474640. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:21:32,795][52567] Avg episode reward: [(0, '69.438')] [2024-08-06 03:21:33,253][52670] DAMAGECOUNT value on done: 397543.0 [2024-08-06 03:21:33,254][52670] Sum rewards: 75.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.471', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.206', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.366', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:33,637][52667] Large shaping reward -2.542 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.291, -97.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:21:34,610][52667] DAMAGECOUNT value on done: 406824.0 [2024-08-06 03:21:34,612][52667] Sum rewards: 84.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.272', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO3': '0.198', 'weapon2': '0.220', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '67.000'} [2024-08-06 03:21:35,476][52811] DAMAGECOUNT value on done: 384430.0 [2024-08-06 03:21:35,476][52811] Sum rewards: 72.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.138', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.302', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.000'} [2024-08-06 03:21:35,575][52803] DAMAGECOUNT value on done: 375034.0 [2024-08-06 03:21:35,575][52803] Sum rewards: 61.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.060', 'weapon5': '0.118', 'AMMO3': '0.185', 'weapon2': '0.210', 'weapon4': '0.262', 'AMMO4': '0.299', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.178', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '53.000'} [2024-08-06 03:21:35,937][52650] Updated weights for policy 0, policy_version 45161 (0.0012) [2024-08-06 03:21:36,460][52614] Signal inference workers to stop experience collection... (8150 times) [2024-08-06 03:21:36,474][52614] Signal inference workers to resume experience collection... (8150 times) [2024-08-06 03:21:36,551][52650] InferenceWorker_p0-w0: stopping experience collection (8150 times) [2024-08-06 03:21:36,551][52650] InferenceWorker_p0-w0: resuming experience collection (8150 times) [2024-08-06 03:21:37,222][52667] DAMAGECOUNT value on done: 398894.0 [2024-08-06 03:21:37,224][52667] Sum rewards: 56.246, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.072', 'AMMO4': '0.169', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '49.000'} [2024-08-06 03:21:37,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 369991680. Throughput: 0: 4378.2. Samples: 92500800. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:21:37,794][52567] Avg episode reward: [(0, '69.391')] [2024-08-06 03:21:38,283][52664] DAMAGECOUNT value on done: 414764.0 [2024-08-06 03:21:38,285][52664] Sum rewards: 73.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.264', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.394', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:38,482][52811] DAMAGECOUNT value on done: 371438.0 [2024-08-06 03:21:38,484][52811] Sum rewards: 59.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.025', 'AMMO2': '0.055', 'AMMO3': '0.188', 'weapon2': '0.274', 'AMMO4': '0.275', 'weapon5': '0.304', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.324', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '49.000'} [2024-08-06 03:21:38,600][52803] DAMAGECOUNT value on done: 371614.0 [2024-08-06 03:21:38,600][52803] Sum rewards: 80.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.375', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.106', 'AMMO4': '0.217', 'weapon5': '0.226', 'AMMO3': '0.251', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '66.000'} [2024-08-06 03:21:40,120][52667] DAMAGECOUNT value on done: 401661.0 [2024-08-06 03:21:40,122][52667] Sum rewards: 74.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.155', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.240', 'AMMO4': '0.258', 'weapon4': '0.270', 'weapon5': '0.280', 'weapon2': '0.386', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.668', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:40,364][52650] Updated weights for policy 0, policy_version 45171 (0.0011) [2024-08-06 03:21:40,816][52664] DAMAGECOUNT value on done: 418441.0 [2024-08-06 03:21:40,817][52664] Sum rewards: 59.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.440', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.231', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '50.000'} [2024-08-06 03:21:41,455][52811] DAMAGECOUNT value on done: 371561.0 [2024-08-06 03:21:41,457][52811] Sum rewards: 70.869, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.054', 'AMMO3': '0.164', 'AMMO4': '0.174', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.202', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 03:21:41,837][52803] DAMAGECOUNT value on done: 376840.0 [2024-08-06 03:21:41,839][52803] Sum rewards: 74.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.126', 'weapon4': '0.136', 'AMMO3': '0.159', 'AMMO4': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 03:21:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 370073600. Throughput: 0: 4392.6. Samples: 92527440. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:21:42,802][52567] Avg episode reward: [(0, '69.607')] [2024-08-06 03:21:42,928][52667] DAMAGECOUNT value on done: 408823.0 [2024-08-06 03:21:42,929][52667] Sum rewards: 68.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.090', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '58.000'} [2024-08-06 03:21:43,280][52664] DAMAGECOUNT value on done: 421355.0 [2024-08-06 03:21:43,282][52664] Sum rewards: 75.334, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.214', 'AMMO3': '0.233', 'weapon2': '0.250', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '65.000'} [2024-08-06 03:21:44,533][52811] DAMAGECOUNT value on done: 371964.0 [2024-08-06 03:21:44,535][52811] Sum rewards: 54.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.060', 'weapon4': '0.110', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.600', 'HITCOUNT': '2.920', 'weapon3': '3.078', 'DAMAGECOUNT': '14.307', 'FRAGCOUNT': '48.500'} [2024-08-06 03:21:44,948][52803] DAMAGECOUNT value on done: 379074.0 [2024-08-06 03:21:44,951][52803] Sum rewards: 67.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.530', 'AMMO5': '0.017', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.149', 'weapon5': '0.190', 'weapon2': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.480', 'WEAPON3': '0.950', 'weapon3': '2.872', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '54.000'} [2024-08-06 03:21:45,455][52650] Updated weights for policy 0, policy_version 45181 (0.0014) [2024-08-06 03:21:45,567][52664] DAMAGECOUNT value on done: 414139.0 [2024-08-06 03:21:45,571][52664] Sum rewards: 79.115, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.215', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.132', 'AMMO3': '0.164', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '63.000'} [2024-08-06 03:21:45,802][52667] DAMAGECOUNT value on done: 398360.0 [2024-08-06 03:21:45,802][52667] Sum rewards: 60.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.675', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.046', 'AMMO4': '0.132', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.758', 'WEAPON3': '1.250', 'weapon3': '2.698', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '51.000'} [2024-08-06 03:21:47,722][52811] DAMAGECOUNT value on done: 374084.0 [2024-08-06 03:21:47,724][52811] Sum rewards: 58.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.557', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.208', 'weapon2': '0.762', 'WEAPON3': '1.250', 'weapon3': '2.748', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '50.000'} [2024-08-06 03:21:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 370155520. Throughput: 0: 4391.4. Samples: 92540760. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:21:47,802][52567] Avg episode reward: [(0, '69.647')] [2024-08-06 03:21:47,999][52803] DAMAGECOUNT value on done: 379274.0 [2024-08-06 03:21:47,999][52803] Sum rewards: 74.899, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.200', 'AMMO5': '0.026', 'AMMO2': '0.062', 'weapon4': '0.172', 'weapon2': '0.232', 'AMMO3': '0.241', 'weapon5': '0.244', 'AMMO4': '0.308', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '64.000'} [2024-08-06 03:21:48,195][52664] DAMAGECOUNT value on done: 416402.0 [2024-08-06 03:21:48,196][52664] Sum rewards: 65.150, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.031', 'HEALTH': '0.054', 'weapon5': '0.134', 'AMMO4': '0.153', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.620', 'WEAPON3': '0.950', 'weapon3': '2.776', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '53.000'} [2024-08-06 03:21:48,506][52667] DAMAGECOUNT value on done: 404021.0 [2024-08-06 03:21:48,508][52667] Sum rewards: 57.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.215', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon2': '0.216', 'AMMO3': '0.229', 'weapon5': '0.234', 'WEAPON5': '0.450', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.638', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '47.000'} [2024-08-06 03:21:48,983][52669] DAMAGECOUNT value on done: 404435.0 [2024-08-06 03:21:48,983][52669] Sum rewards: 74.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.150', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.208', 'AMMO4': '0.233', 'weapon2': '0.260', 'weapon4': '0.288', 'weapon5': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '63.000'} [2024-08-06 03:21:49,397][52650] Updated weights for policy 0, policy_version 45191 (0.0044) [2024-08-06 03:21:49,430][52668] DAMAGECOUNT value on done: 398217.0 [2024-08-06 03:21:49,430][52668] Sum rewards: 75.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.086', 'weapon5': '0.206', 'AMMO3': '0.215', 'AMMO4': '0.265', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '63.000'} [2024-08-06 03:21:50,888][52811] DAMAGECOUNT value on done: 379626.0 [2024-08-06 03:21:50,888][52811] Sum rewards: 76.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.114', 'weapon4': '0.132', 'AMMO3': '0.203', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 03:21:50,937][52667] DAMAGECOUNT value on done: 403495.0 [2024-08-06 03:21:50,937][52667] Sum rewards: 64.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.092', 'AMMO4': '0.146', 'AMMO3': '0.170', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '2.974', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '53.000'} [2024-08-06 03:21:51,038][52803] DAMAGECOUNT value on done: 365944.0 [2024-08-06 03:21:51,038][52803] Sum rewards: 67.677, reward structure: {'DEATHCOUNT': '-11.250', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.182', 'weapon5': '0.194', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'HEALTH': '0.416', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '53.000'} [2024-08-06 03:21:51,312][52664] DAMAGECOUNT value on done: 414132.0 [2024-08-06 03:21:51,312][52664] Sum rewards: 65.511, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.124', 'AMMO4': '0.146', 'AMMO3': '0.195', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.928', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '53.000'} [2024-08-06 03:21:51,829][52669] DAMAGECOUNT value on done: 396213.0 [2024-08-06 03:21:51,829][52669] Sum rewards: 67.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.950', 'AMMO5': '0.016', 'AMMO2': '0.078', 'weapon5': '0.266', 'AMMO3': '0.281', 'weapon4': '0.290', 'weapon2': '0.370', 'AMMO4': '0.392', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.702', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '58.500'} [2024-08-06 03:21:52,043][52668] DAMAGECOUNT value on done: 403972.0 [2024-08-06 03:21:52,043][52668] Sum rewards: 80.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.444', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.204', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '64.000'} [2024-08-06 03:21:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 370253824. Throughput: 0: 4386.9. Samples: 92566790. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:21:52,794][52567] Avg episode reward: [(0, '69.973')] [2024-08-06 03:21:53,826][52662] DAMAGECOUNT value on done: 407484.0 [2024-08-06 03:21:53,827][52662] Sum rewards: 60.559, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.440', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.214', 'AMMO4': '0.220', 'AMMO3': '0.301', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.932', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.000'} [2024-08-06 03:21:53,885][52667] DAMAGECOUNT value on done: 396758.0 [2024-08-06 03:21:53,885][52667] Sum rewards: 62.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.168', 'AMMO4': '0.182', 'AMMO3': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.766', 'WEAPON3': '1.200', 'weapon3': '2.550', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '52.000'} [2024-08-06 03:21:53,898][52664] DAMAGECOUNT value on done: 416692.0 [2024-08-06 03:21:53,898][52664] Sum rewards: 61.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.932', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.195', 'weapon2': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.324', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '51.000'} [2024-08-06 03:21:54,036][52811] DAMAGECOUNT value on done: 374463.0 [2024-08-06 03:21:54,037][52811] Sum rewards: 71.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.352', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.236', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '60.000'} [2024-08-06 03:21:54,216][52803] DAMAGECOUNT value on done: 369894.0 [2024-08-06 03:21:54,218][52803] Sum rewards: 64.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.402', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.142', 'AMMO4': '0.178', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.240', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2024-08-06 03:21:54,531][52669] DAMAGECOUNT value on done: 406366.0 [2024-08-06 03:21:54,532][52669] Sum rewards: 64.082, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'weapon4': '0.106', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'HEALTH': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.280', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '51.000'} [2024-08-06 03:21:54,746][52650] Updated weights for policy 0, policy_version 45201 (0.0011) [2024-08-06 03:21:55,139][52668] DAMAGECOUNT value on done: 404713.0 [2024-08-06 03:21:55,139][52668] Sum rewards: 63.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.400', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.078', 'AMMO4': '0.108', 'AMMO3': '0.181', 'weapon4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '52.000'} [2024-08-06 03:21:55,307][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:21:56,456][52664] DAMAGECOUNT value on done: 409810.0 [2024-08-06 03:21:56,459][52664] Sum rewards: 72.583, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon2': '0.180', 'AMMO3': '0.202', 'HEALTH': '0.515', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.458', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 03:21:56,859][52667] DAMAGECOUNT value on done: 405858.0 [2024-08-06 03:21:56,862][52667] Sum rewards: 69.664, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.060', 'weapon4': '0.078', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.446', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:57,004][52662] DAMAGECOUNT value on done: 405823.0 [2024-08-06 03:21:57,004][52662] Sum rewards: 68.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.350', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.164', 'AMMO4': '0.224', 'weapon5': '0.308', 'weapon2': '0.344', 'weapon4': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.524', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '54.500'} [2024-08-06 03:21:57,070][52811] DAMAGECOUNT value on done: 375124.0 [2024-08-06 03:21:57,071][52811] Sum rewards: 67.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.490', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.130', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.100', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '59.000'} [2024-08-06 03:21:57,292][52803] DAMAGECOUNT value on done: 370466.0 [2024-08-06 03:21:57,294][52803] Sum rewards: 65.475, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.468', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon4': '0.310', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '53.000'} [2024-08-06 03:21:57,542][52669] DAMAGECOUNT value on done: 399286.0 [2024-08-06 03:21:57,545][52669] Sum rewards: 65.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.786', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.340', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.360', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '58.000'} [2024-08-06 03:21:57,691][52668] DAMAGECOUNT value on done: 405981.0 [2024-08-06 03:21:57,691][52668] Sum rewards: 56.390, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.170', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '2.896', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '46.000'} [2024-08-06 03:21:57,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 370343936. Throughput: 0: 4388.9. Samples: 92593080. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:21:57,802][52567] Avg episode reward: [(0, '69.742')] [2024-08-06 03:21:59,055][52664] DAMAGECOUNT value on done: 421423.0 [2024-08-06 03:21:59,055][52664] Sum rewards: 73.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.216', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '62.000'} [2024-08-06 03:21:59,208][52665] DAMAGECOUNT value on done: 393392.0 [2024-08-06 03:21:59,209][52665] Sum rewards: 70.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.933', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.143', 'AMMO3': '0.182', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '57.000'} [2024-08-06 03:21:59,366][52667] DAMAGECOUNT value on done: 412589.0 [2024-08-06 03:21:59,367][52667] Sum rewards: 76.918, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.760', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.048', 'weapon4': '0.060', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.311', 'WEAPON3': '1.900', 'weapon3': '3.436', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '67.000'} [2024-08-06 03:21:59,386][52650] Updated weights for policy 0, policy_version 45211 (0.0011) [2024-08-06 03:22:00,207][52668] DAMAGECOUNT value on done: 394874.0 [2024-08-06 03:22:00,208][52668] Sum rewards: 42.948, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.595', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.094', 'weapon5': '0.094', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '0.850', 'HITCOUNT': '2.420', 'weapon3': '3.340', 'DAMAGECOUNT': '10.977', 'FRAGCOUNT': '34.000'} [2024-08-06 03:22:00,213][52811] DAMAGECOUNT value on done: 379246.0 [2024-08-06 03:22:00,214][52811] Sum rewards: 66.759, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.854', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:00,271][52662] DAMAGECOUNT value on done: 407298.0 [2024-08-06 03:22:00,272][52662] Sum rewards: 62.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.008', 'AMMO2': '0.057', 'weapon4': '0.180', 'AMMO3': '0.197', 'weapon5': '0.206', 'WEAPON5': '0.250', 'AMMO4': '0.285', 'WEAPON4': '0.400', 'weapon2': '0.656', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:00,493][52803] DAMAGECOUNT value on done: 376386.0 [2024-08-06 03:22:00,494][52803] Sum rewards: 73.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.390', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.180', 'weapon4': '0.214', 'AMMO4': '0.230', 'weapon2': '0.244', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.024', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '63.000'} [2024-08-06 03:22:00,727][52669] DAMAGECOUNT value on done: 400534.0 [2024-08-06 03:22:00,728][52669] Sum rewards: 61.332, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.700', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.214', 'AMMO4': '0.218', 'weapon5': '0.264', 'weapon2': '0.282', 'AMMO3': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.914', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:01,879][52664] DAMAGECOUNT value on done: 413121.0 [2024-08-06 03:22:01,881][52664] Sum rewards: 73.553, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.384', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:02,034][52667] DAMAGECOUNT value on done: 410455.0 [2024-08-06 03:22:02,034][52667] Sum rewards: 76.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.402', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.116', 'weapon5': '0.194', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:02,244][52665] DAMAGECOUNT value on done: 402693.0 [2024-08-06 03:22:02,245][52665] Sum rewards: 52.954, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.883', 'AMMO5': '0.026', 'AMMO2': '0.096', 'AMMO3': '0.176', 'weapon5': '0.250', 'weapon2': '0.284', 'AMMO4': '0.481', 'weapon4': '0.568', 'WEAPON5': '0.750', 'WEAPON4': '1.050', 'WEAPON3': '1.100', 'weapon3': '2.496', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '48.000'} [2024-08-06 03:22:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 370425856. Throughput: 0: 4387.3. Samples: 92606060. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:22:02,802][52567] Avg episode reward: [(0, '69.084')] [2024-08-06 03:22:02,939][52668] DAMAGECOUNT value on done: 404542.0 [2024-08-06 03:22:02,940][52668] Sum rewards: 76.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.475', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:03,274][52811] DAMAGECOUNT value on done: 375657.0 [2024-08-06 03:22:03,274][52811] Sum rewards: 68.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.180', 'AMMO3': '0.219', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '2.780', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '57.500'} [2024-08-06 03:22:03,355][52662] DAMAGECOUNT value on done: 396641.0 [2024-08-06 03:22:03,356][52662] Sum rewards: 79.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.418', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.170', 'AMMO3': '0.180', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '64.000'} [2024-08-06 03:22:03,594][52803] DAMAGECOUNT value on done: 369226.0 [2024-08-06 03:22:03,594][52803] Sum rewards: 69.552, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.624', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.076', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.173', 'weapon2': '0.854', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:03,646][52669] DAMAGECOUNT value on done: 404581.0 [2024-08-06 03:22:03,650][52669] Sum rewards: 66.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.042', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:03,854][52650] Updated weights for policy 0, policy_version 45221 (0.0010) [2024-08-06 03:22:04,732][52665] DAMAGECOUNT value on done: 400827.0 [2024-08-06 03:22:04,733][52665] Sum rewards: 64.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.150', 'AMMO2': '0.004', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.282', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.400', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:04,781][52664] DAMAGECOUNT value on done: 420977.0 [2024-08-06 03:22:04,781][52664] Sum rewards: 69.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.815', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.128', 'weapon4': '0.188', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:05,067][52667] DAMAGECOUNT value on done: 406504.0 [2024-08-06 03:22:05,067][52667] Sum rewards: 59.317, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.892', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '48.000'} [2024-08-06 03:22:05,948][52668] DAMAGECOUNT value on done: 403723.0 [2024-08-06 03:22:05,948][52668] Sum rewards: 64.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.171', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:06,232][52811] DAMAGECOUNT value on done: 373553.0 [2024-08-06 03:22:06,232][52811] Sum rewards: 66.104, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.016', 'AMMO2': '0.043', 'HEALTH': '0.067', 'weapon4': '0.102', 'weapon5': '0.216', 'AMMO3': '0.217', 'AMMO4': '0.217', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.772', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:06,530][52662] DAMAGECOUNT value on done: 406596.0 [2024-08-06 03:22:06,531][52662] Sum rewards: 70.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.564', 'AMMO5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.099', 'weapon5': '0.154', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.362', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:06,644][52803] DAMAGECOUNT value on done: 379565.0 [2024-08-06 03:22:06,644][52803] Sum rewards: 82.387, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.246', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.068', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'weapon2': '0.240', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.320', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '71.000'} [2024-08-06 03:22:06,751][52669] DAMAGECOUNT value on done: 402044.0 [2024-08-06 03:22:06,751][52669] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.565', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.088', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:07,272][52664] DAMAGECOUNT value on done: 417990.0 [2024-08-06 03:22:07,273][52664] Sum rewards: 73.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.995', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.734', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:07,781][52795] DAMAGECOUNT value on done: 374479.0 [2024-08-06 03:22:07,781][52795] Sum rewards: 73.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.598', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.147', 'weapon4': '0.162', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 370515968. Throughput: 0: 4390.2. Samples: 92632610. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 03:22:07,795][52567] Avg episode reward: [(0, '68.820')] [2024-08-06 03:22:07,890][52665] DAMAGECOUNT value on done: 395766.0 [2024-08-06 03:22:07,890][52665] Sum rewards: 60.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.567', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.058', 'AMMO4': '0.063', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.398', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '51.000'} [2024-08-06 03:22:07,919][52647] DAMAGECOUNT value on done: 425281.0 [2024-08-06 03:22:07,920][52647] Sum rewards: 66.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.652', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.110', 'AMMO4': '0.122', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '53.500'} [2024-08-06 03:22:08,143][52667] DAMAGECOUNT value on done: 400236.0 [2024-08-06 03:22:08,144][52667] Sum rewards: 59.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.739', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.109', 'AMMO3': '0.216', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '51.000'} [2024-08-06 03:22:08,595][52650] Updated weights for policy 0, policy_version 45231 (0.0036) [2024-08-06 03:22:08,831][52668] DAMAGECOUNT value on done: 396376.0 [2024-08-06 03:22:08,835][52668] Sum rewards: 71.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:09,218][52811] DAMAGECOUNT value on done: 385378.0 [2024-08-06 03:22:09,218][52811] Sum rewards: 75.355, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.402', 'WEAPON3': '1.300', 'HITCOUNT': '3.350', 'weapon3': '3.390', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '64.000'} [2024-08-06 03:22:09,438][52669] DAMAGECOUNT value on done: 403433.0 [2024-08-06 03:22:09,440][52669] Sum rewards: 72.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.130', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.062', 'AMMO4': '0.083', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:09,538][52662] DAMAGECOUNT value on done: 400248.0 [2024-08-06 03:22:09,538][52662] Sum rewards: 63.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.252', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:09,640][52660] DAMAGECOUNT value on done: 399575.0 [2024-08-06 03:22:09,640][52660] Sum rewards: 62.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.748', 'AMMO5': '0.027', 'AMMO2': '0.079', 'AMMO3': '0.248', 'weapon5': '0.320', 'weapon2': '0.326', 'AMMO4': '0.397', 'weapon4': '0.406', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.450', 'weapon3': '2.506', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:09,690][52803] DAMAGECOUNT value on done: 374689.0 [2024-08-06 03:22:09,691][52803] Sum rewards: 67.097, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.257', 'weapon2': '0.574', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:10,129][52664] DAMAGECOUNT value on done: 425313.0 [2024-08-06 03:22:10,130][52664] Sum rewards: 53.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.012', 'weapon5': '0.038', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.368', 'WEAPON3': '1.450', 'HITCOUNT': '2.810', 'weapon3': '3.406', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '47.000'} [2024-08-06 03:22:10,730][52647] DAMAGECOUNT value on done: 421878.0 [2024-08-06 03:22:10,731][52647] Sum rewards: 65.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.810', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.072', 'weapon5': '0.114', 'AMMO4': '0.190', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:10,966][52665] DAMAGECOUNT value on done: 389644.0 [2024-08-06 03:22:10,967][52665] Sum rewards: 65.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.408', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.181', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.358', 'weapon4': '0.458', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:11,007][52795] DAMAGECOUNT value on done: 364440.0 [2024-08-06 03:22:11,007][52795] Sum rewards: 61.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.158', 'AMMO4': '0.190', 'AMMO3': '0.199', 'weapon2': '0.214', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.046', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '52.500'} [2024-08-06 03:22:11,018][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:22:11,029][52667] DAMAGECOUNT value on done: 407835.0 [2024-08-06 03:22:11,031][52667] Sum rewards: 62.610, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.734', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.174', 'weapon5': '0.206', 'AMMO3': '0.231', 'weapon2': '0.288', 'AMMO4': '0.309', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.010', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:11,242][52658] DAMAGECOUNT value on done: 399345.0 [2024-08-06 03:22:11,245][52658] Sum rewards: 71.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.162', 'weapon5': '0.180', 'AMMO3': '0.226', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:12,045][52668] DAMAGECOUNT value on done: 402088.0 [2024-08-06 03:22:12,047][52668] Sum rewards: 63.553, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.400', 'AMMO5': '0.022', 'AMMO2': '0.052', 'weapon5': '0.256', 'AMMO3': '0.261', 'AMMO4': '0.261', 'weapon2': '0.384', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.592', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:12,062][52662] DAMAGECOUNT value on done: 410730.0 [2024-08-06 03:22:12,064][52662] Sum rewards: 73.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.205', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.422', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:12,285][52669] DAMAGECOUNT value on done: 406894.0 [2024-08-06 03:22:12,287][52669] Sum rewards: 78.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.402', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon5': '0.312', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '66.000'} [2024-08-06 03:22:12,359][52811] DAMAGECOUNT value on done: 374221.0 [2024-08-06 03:22:12,359][52811] Sum rewards: 65.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.028', 'AMMO2': '0.038', 'weapon4': '0.102', 'AMMO4': '0.191', 'AMMO3': '0.213', 'weapon2': '0.326', 'weapon5': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:12,704][52660] DAMAGECOUNT value on done: 394320.0 [2024-08-06 03:22:12,704][52660] Sum rewards: 57.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.492', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.242', 'DAMAGECOUNT': '14.031', 'FRAGCOUNT': '50.000'} [2024-08-06 03:22:12,740][52803] DAMAGECOUNT value on done: 375220.0 [2024-08-06 03:22:12,741][52803] Sum rewards: 76.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.110', 'AMMO4': '0.170', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '65.000'} [2024-08-06 03:22:12,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 370597888. Throughput: 0: 4381.6. Samples: 92658700. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 03:22:12,802][52567] Avg episode reward: [(0, '68.263')] [2024-08-06 03:22:12,815][52664] DAMAGECOUNT value on done: 419263.0 [2024-08-06 03:22:12,816][52664] Sum rewards: 87.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.912', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.204', 'weapon2': '0.210', 'AMMO4': '0.218', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.394', 'WEAPON3': '1.150', 'weapon3': '2.914', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '72.000'} [2024-08-06 03:22:13,273][52650] Updated weights for policy 0, policy_version 45241 (0.0023) [2024-08-06 03:22:13,399][52647] DAMAGECOUNT value on done: 423260.0 [2024-08-06 03:22:13,399][52647] Sum rewards: 66.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.156', 'AMMO3': '0.171', 'weapon4': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:13,561][52665] DAMAGECOUNT value on done: 391147.0 [2024-08-06 03:22:13,563][52665] Sum rewards: 70.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.632', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'weapon4': '0.174', 'weapon2': '0.226', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:14,138][52795] DAMAGECOUNT value on done: 363569.0 [2024-08-06 03:22:14,142][52795] Sum rewards: 67.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.084', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.128', 'AMMO4': '0.142', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '58.500'} [2024-08-06 03:22:14,302][52658] DAMAGECOUNT value on done: 403324.0 [2024-08-06 03:22:14,302][52658] Sum rewards: 62.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.970', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.201', 'weapon5': '0.266', 'WEAPON5': '0.400', 'weapon2': '0.442', 'weapon4': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.362', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:15,078][52668] DAMAGECOUNT value on done: 405620.0 [2024-08-06 03:22:15,079][52668] Sum rewards: 81.251, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.738', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.162', 'weapon5': '0.178', 'weapon2': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.295', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.114', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '70.000'} [2024-08-06 03:22:15,147][52669] DAMAGECOUNT value on done: 401964.0 [2024-08-06 03:22:15,149][52669] Sum rewards: 69.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.170', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:15,163][52662] DAMAGECOUNT value on done: 412197.0 [2024-08-06 03:22:15,163][52662] Sum rewards: 73.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.230', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.384', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:15,411][52811] DAMAGECOUNT value on done: 373889.0 [2024-08-06 03:22:15,414][52811] Sum rewards: 65.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.349', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.226', 'weapon2': '0.314', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.426', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:15,583][52664] DAMAGECOUNT value on done: 422321.0 [2024-08-06 03:22:15,584][52664] Sum rewards: 60.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.213', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:15,776][52660] DAMAGECOUNT value on done: 408775.0 [2024-08-06 03:22:15,779][52660] Sum rewards: 77.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.485', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.080', 'weapon5': '0.116', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '66.000'} [2024-08-06 03:22:15,834][52803] DAMAGECOUNT value on done: 378437.0 [2024-08-06 03:22:15,835][52803] Sum rewards: 68.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.232', 'weapon4': '0.286', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:16,044][52647] DAMAGECOUNT value on done: 430242.0 [2024-08-06 03:22:16,044][52647] Sum rewards: 64.914, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.944', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.050', 'AMMO3': '0.142', 'weapon5': '0.168', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '3.110', 'weapon3': '3.294', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '51.000'} [2024-08-06 03:22:16,405][52665] DAMAGECOUNT value on done: 395781.0 [2024-08-06 03:22:16,405][52665] Sum rewards: 76.559, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.705', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO3': '0.169', 'AMMO4': '0.174', 'weapon5': '0.198', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:16,451][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:22:17,142][52658] DAMAGECOUNT value on done: 408345.0 [2024-08-06 03:22:17,143][52658] Sum rewards: 84.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.486', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.142', 'AMMO4': '0.166', 'AMMO3': '0.206', 'weapon4': '0.280', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '68.000'} [2024-08-06 03:22:17,206][52795] DAMAGECOUNT value on done: 370933.0 [2024-08-06 03:22:17,209][52795] Sum rewards: 57.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.371', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.172', 'AMMO3': '0.195', 'weapon4': '0.250', 'AMMO4': '0.257', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '48.000'} [2024-08-06 03:22:17,695][52662] DAMAGECOUNT value on done: 401182.0 [2024-08-06 03:22:17,696][52662] Sum rewards: 78.301, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.182', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '63.000'} [2024-08-06 03:22:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 370688000. Throughput: 0: 4377.3. Samples: 92671620. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 03:22:17,795][52567] Avg episode reward: [(0, '68.235')] [2024-08-06 03:22:17,807][52669] DAMAGECOUNT value on done: 407139.0 [2024-08-06 03:22:17,808][52669] Sum rewards: 79.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.558', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.234', 'weapon4': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '66.000'} [2024-08-06 03:22:18,091][52650] Updated weights for policy 0, policy_version 45251 (0.0014) [2024-08-06 03:22:18,108][52664] DAMAGECOUNT value on done: 414945.0 [2024-08-06 03:22:18,108][52664] Sum rewards: 82.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.414', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.136', 'AMMO4': '0.194', 'AMMO3': '0.239', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '68.000'} [2024-08-06 03:22:18,205][52668] DAMAGECOUNT value on done: 402766.0 [2024-08-06 03:22:18,207][52668] Sum rewards: 63.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.707', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.142', 'AMMO3': '0.216', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.230', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:18,520][52811] DAMAGECOUNT value on done: 377705.0 [2024-08-06 03:22:18,521][52811] Sum rewards: 69.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.005', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon5': '0.036', 'AMMO4': '0.055', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:18,600][52647] DAMAGECOUNT value on done: 426658.0 [2024-08-06 03:22:18,602][52647] Sum rewards: 80.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.688', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'weapon2': '0.232', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.292', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '67.000'} [2024-08-06 03:22:18,862][52660] DAMAGECOUNT value on done: 409592.0 [2024-08-06 03:22:18,862][52660] Sum rewards: 68.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.224', 'AMMO3': '0.296', 'WEAPON3': '1.750', 'weapon3': '3.158', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:18,969][52803] DAMAGECOUNT value on done: 373369.0 [2024-08-06 03:22:18,971][52803] Sum rewards: 67.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.180', 'weapon5': '0.186', 'AMMO4': '0.247', 'weapon4': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.548', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:19,843][52665] DAMAGECOUNT value on done: 400729.0 [2024-08-06 03:22:19,843][52665] Sum rewards: 76.395, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.935', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.136', 'AMMO3': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '0.950', 'weapon3': '3.002', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:19,962][52658] DAMAGECOUNT value on done: 405826.0 [2024-08-06 03:22:19,963][52658] Sum rewards: 68.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.206', 'weapon4': '0.212', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.302', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:20,303][52795] DAMAGECOUNT value on done: 366111.0 [2024-08-06 03:22:20,304][52795] Sum rewards: 67.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.072', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.368', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:20,541][52669] DAMAGECOUNT value on done: 402865.0 [2024-08-06 03:22:20,542][52669] Sum rewards: 79.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.180', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '3.382', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '64.000'} [2024-08-06 03:22:20,671][52662] DAMAGECOUNT value on done: 413463.0 [2024-08-06 03:22:20,671][52662] Sum rewards: 73.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.142', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.068', 'AMMO4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.149', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.822', 'WEAPON3': '1.050', 'weapon3': '2.752', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.500'} [2024-08-06 03:22:21,066][52664] DAMAGECOUNT value on done: 416440.0 [2024-08-06 03:22:21,066][52664] Sum rewards: 76.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.260', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.269', 'weapon2': '0.340', 'WEAPON3': '1.700', 'weapon3': '3.388', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '65.000'} [2024-08-06 03:22:21,192][52668] DAMAGECOUNT value on done: 397764.0 [2024-08-06 03:22:21,192][52668] Sum rewards: 66.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.116', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.142', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:21,451][52647] DAMAGECOUNT value on done: 425866.0 [2024-08-06 03:22:21,451][52647] Sum rewards: 62.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.932', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.238', 'AMMO3': '0.242', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:21,590][52811] DAMAGECOUNT value on done: 371479.0 [2024-08-06 03:22:21,590][52811] Sum rewards: 68.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.700', 'AMMO5': '0.013', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.165', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '57.500'} [2024-08-06 03:22:21,842][52660] DAMAGECOUNT value on done: 401057.0 [2024-08-06 03:22:21,842][52660] Sum rewards: 75.277, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.131', 'AMMO4': '0.131', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.494', 'weapon2': '0.746', 'WEAPON3': '0.950', 'weapon3': '2.304', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:22,120][52803] DAMAGECOUNT value on done: 373505.0 [2024-08-06 03:22:22,121][52803] Sum rewards: 77.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.328', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon4': '0.122', 'AMMO4': '0.152', 'AMMO3': '0.159', 'weapon5': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:22,595][52650] Updated weights for policy 0, policy_version 45261 (0.0019) [2024-08-06 03:22:22,598][52665] DAMAGECOUNT value on done: 401807.0 [2024-08-06 03:22:22,598][52665] Sum rewards: 65.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.464', 'AMMO5': '0.023', 'AMMO2': '0.057', 'AMMO3': '0.163', 'weapon5': '0.208', 'weapon4': '0.214', 'AMMO4': '0.285', 'weapon2': '0.296', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.018', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 370778112. Throughput: 0: 4384.2. Samples: 92698090. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 03:22:22,795][52567] Avg episode reward: [(0, '68.903')] [2024-08-06 03:22:22,990][52658] DAMAGECOUNT value on done: 397420.0 [2024-08-06 03:22:22,992][52658] Sum rewards: 70.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.709', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO3': '0.168', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.278', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:23,038][52669] DAMAGECOUNT value on done: 396551.0 [2024-08-06 03:22:23,038][52669] Sum rewards: 54.373, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.840', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.206', 'AMMO4': '0.232', 'weapon4': '0.250', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.650', 'weapon3': '2.794', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '50.000'} [2024-08-06 03:22:23,203][52662] DAMAGECOUNT value on done: 400730.0 [2024-08-06 03:22:23,206][52662] Sum rewards: 66.591, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.915', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.450', 'weapon3': '2.842', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:23,295][52795] DAMAGECOUNT value on done: 374512.0 [2024-08-06 03:22:23,298][52795] Sum rewards: 74.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.106', 'weapon5': '0.182', 'weapon2': '0.204', 'AMMO4': '0.241', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '63.000'} [2024-08-06 03:22:24,048][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:22:24,189][52664] DAMAGECOUNT value on done: 416270.0 [2024-08-06 03:22:24,190][52664] Sum rewards: 66.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.148', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.141', 'AMMO4': '0.234', 'weapon5': '0.242', 'weapon4': '0.252', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.846', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:24,235][52671] DAMAGECOUNT value on done: 406958.0 [2024-08-06 03:22:24,235][52671] Sum rewards: 75.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.544', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.088', 'AMMO3': '0.162', 'AMMO4': '0.171', 'weapon5': '0.190', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.224', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '59.500'} [2024-08-06 03:22:24,356][52668] DAMAGECOUNT value on done: 393795.0 [2024-08-06 03:22:24,357][52668] Sum rewards: 56.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.540', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.108', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '49.000'} [2024-08-06 03:22:24,561][52647] DAMAGECOUNT value on done: 423946.0 [2024-08-06 03:22:24,563][52647] Sum rewards: 62.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.140', 'AMMO3': '0.201', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:24,584][52811] DAMAGECOUNT value on done: 375267.0 [2024-08-06 03:22:24,587][52811] Sum rewards: 72.300, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.174', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.248', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.458', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '59.500'} [2024-08-06 03:22:25,006][52660] DAMAGECOUNT value on done: 399480.0 [2024-08-06 03:22:25,007][52660] Sum rewards: 67.713, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO4': '0.169', 'weapon5': '0.178', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:25,043][52665] DAMAGECOUNT value on done: 398105.0 [2024-08-06 03:22:25,044][52665] Sum rewards: 65.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.036', 'AMMO2': '0.081', 'AMMO3': '0.150', 'weapon5': '0.206', 'AMMO4': '0.406', 'weapon4': '0.466', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'weapon2': '0.786', 'WEAPON3': '0.900', 'weapon3': '2.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:25,162][52803] DAMAGECOUNT value on done: 381338.0 [2024-08-06 03:22:25,162][52803] Sum rewards: 57.016, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.292', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.092', 'weapon4': '0.106', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.538', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.014', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '49.000'} [2024-08-06 03:22:25,745][52662] DAMAGECOUNT value on done: 404317.0 [2024-08-06 03:22:25,745][52662] Sum rewards: 67.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.810', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon2': '0.190', 'AMMO3': '0.215', 'weapon5': '0.216', 'AMMO4': '0.244', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:25,750][52658] DAMAGECOUNT value on done: 401794.0 [2024-08-06 03:22:25,751][52658] Sum rewards: 68.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.561', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.104', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:26,009][52669] DAMAGECOUNT value on done: 406549.0 [2024-08-06 03:22:26,010][52669] Sum rewards: 72.198, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.164', 'AMMO4': '0.171', 'weapon5': '0.216', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'HEALTH': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:26,446][52795] DAMAGECOUNT value on done: 379906.0 [2024-08-06 03:22:26,447][52795] Sum rewards: 86.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.186', 'AMMO3': '0.203', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '70.000'} [2024-08-06 03:22:27,193][52668] DAMAGECOUNT value on done: 394358.0 [2024-08-06 03:22:27,196][52668] Sum rewards: 59.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.978', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.123', 'weapon4': '0.142', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.738', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '50.500'} [2024-08-06 03:22:27,279][52671] DAMAGECOUNT value on done: 405632.0 [2024-08-06 03:22:27,279][52671] Sum rewards: 70.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon2': '0.188', 'weapon4': '0.188', 'AMMO3': '0.231', 'weapon5': '0.262', 'AMMO4': '0.273', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:27,320][52665] DAMAGECOUNT value on done: 403920.0 [2024-08-06 03:22:27,321][52665] Sum rewards: 61.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.024', 'AMMO2': '0.069', 'AMMO3': '0.213', 'weapon4': '0.236', 'weapon5': '0.268', 'AMMO4': '0.343', 'weapon2': '0.512', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:27,348][52664] DAMAGECOUNT value on done: 414714.0 [2024-08-06 03:22:27,348][52664] Sum rewards: 63.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.204', 'weapon2': '0.492', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.322', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:27,492][52650] Updated weights for policy 0, policy_version 45271 (0.0013) [2024-08-06 03:22:27,552][52811] DAMAGECOUNT value on done: 376489.0 [2024-08-06 03:22:27,554][52811] Sum rewards: 61.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.056', 'weapon4': '0.060', 'AMMO4': '0.139', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.338', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '51.000'} [2024-08-06 03:22:27,735][52647] DAMAGECOUNT value on done: 418542.0 [2024-08-06 03:22:27,736][52647] Sum rewards: 73.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.218', 'weapon2': '0.242', 'AMMO4': '0.246', 'weapon4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:27,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 370868224. Throughput: 0: 4379.8. Samples: 92724530. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 03:22:27,794][52567] Avg episode reward: [(0, '69.049')] [2024-08-06 03:22:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045272_370868224.pth... [2024-08-06 03:22:27,917][52660] DAMAGECOUNT value on done: 402547.0 [2024-08-06 03:22:27,918][52660] Sum rewards: 58.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.108', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.126', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '49.000'} [2024-08-06 03:22:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000044760_366673920.pth [2024-08-06 03:22:28,317][52803] DAMAGECOUNT value on done: 378066.0 [2024-08-06 03:22:28,317][52803] Sum rewards: 85.820, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.884', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '69.000'} [2024-08-06 03:22:28,445][52662] DAMAGECOUNT value on done: 405252.0 [2024-08-06 03:22:28,445][52662] Sum rewards: 70.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.245', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.258', 'weapon4': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:28,548][52658] DAMAGECOUNT value on done: 405456.0 [2024-08-06 03:22:28,548][52658] Sum rewards: 74.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.777', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.195', 'weapon4': '0.204', 'AMMO4': '0.316', 'weapon5': '0.370', 'weapon2': '0.402', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.626', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '61.000'} [2024-08-06 03:22:28,769][52669] DAMAGECOUNT value on done: 410346.0 [2024-08-06 03:22:28,770][52669] Sum rewards: 63.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.180', 'weapon5': '0.180', 'AMMO3': '0.181', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:29,616][52795] DAMAGECOUNT value on done: 374714.0 [2024-08-06 03:22:29,617][52795] Sum rewards: 64.892, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.416', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.170', 'AMMO3': '0.243', 'AMMO4': '0.257', 'weapon5': '0.352', 'WEAPON4': '0.550', 'weapon2': '0.554', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.582', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:29,981][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:22:30,260][52665] DAMAGECOUNT value on done: 399423.0 [2024-08-06 03:22:30,262][52665] Sum rewards: 74.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.801', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.210', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.468', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:30,323][52668] DAMAGECOUNT value on done: 394144.0 [2024-08-06 03:22:30,324][52668] Sum rewards: 50.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.770', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.166', 'AMMO4': '0.204', 'weapon2': '0.256', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '2.800', 'weapon3': '3.280', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '45.000'} [2024-08-06 03:22:30,364][52664] DAMAGECOUNT value on done: 415272.0 [2024-08-06 03:22:30,364][52664] Sum rewards: 69.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.663', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.410', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:30,455][52671] DAMAGECOUNT value on done: 405034.0 [2024-08-06 03:22:30,456][52671] Sum rewards: 70.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.090', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:30,551][52647] DAMAGECOUNT value on done: 431650.0 [2024-08-06 03:22:30,551][52647] Sum rewards: 83.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'AMMO3': '0.231', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '69.000'} [2024-08-06 03:22:30,769][52811] DAMAGECOUNT value on done: 374578.0 [2024-08-06 03:22:30,770][52811] Sum rewards: 64.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.808', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:30,903][52660] DAMAGECOUNT value on done: 407449.0 [2024-08-06 03:22:30,910][52660] Sum rewards: 67.518, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.138', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'HEALTH': '0.265', 'weapon2': '0.300', 'weapon4': '0.522', 'WEAPON3': '0.800', 'weapon3': '2.876', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:31,445][52662] DAMAGECOUNT value on done: 409809.0 [2024-08-06 03:22:31,447][52662] Sum rewards: 66.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.838', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.198', 'AMMO3': '0.215', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.616', 'WEAPON3': '1.400', 'weapon3': '2.616', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:31,461][52803] DAMAGECOUNT value on done: 377863.0 [2024-08-06 03:22:31,462][52803] Sum rewards: 57.685, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.116', 'AMMO3': '0.194', 'AMMO4': '0.203', 'weapon5': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.560', 'HEALTH': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '46.000'} [2024-08-06 03:22:31,703][52658] DAMAGECOUNT value on done: 397209.0 [2024-08-06 03:22:31,704][52658] Sum rewards: 73.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.876', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.148', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:31,956][52669] DAMAGECOUNT value on done: 417589.0 [2024-08-06 03:22:31,958][52669] Sum rewards: 60.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.145', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.146', 'weapon4': '0.162', 'AMMO3': '0.215', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '2.908', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '51.000'} [2024-08-06 03:22:32,065][52650] Updated weights for policy 0, policy_version 45281 (0.0014) [2024-08-06 03:22:32,641][52795] DAMAGECOUNT value on done: 363194.0 [2024-08-06 03:22:32,642][52795] Sum rewards: 80.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.109', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'weapon4': '0.098', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '65.000'} [2024-08-06 03:22:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 370950144. Throughput: 0: 4368.9. Samples: 92737360. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 03:22:32,794][52567] Avg episode reward: [(0, '69.045')] [2024-08-06 03:22:33,140][52668] DAMAGECOUNT value on done: 399206.0 [2024-08-06 03:22:33,148][52668] Sum rewards: 75.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.988', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.146', 'AMMO4': '0.192', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:33,339][52671] DAMAGECOUNT value on done: 404235.0 [2024-08-06 03:22:33,341][52671] Sum rewards: 67.884, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.142', 'AMMO3': '0.206', 'weapon5': '0.256', 'AMMO4': '0.275', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.772', 'WEAPON3': '1.200', 'weapon3': '2.556', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:33,355][52665] DAMAGECOUNT value on done: 395437.0 [2024-08-06 03:22:33,355][52665] Sum rewards: 62.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.145', 'weapon4': '0.152', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.130', 'weapon3': '3.218', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:33,573][52647] DAMAGECOUNT value on done: 421913.0 [2024-08-06 03:22:33,575][52647] Sum rewards: 73.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.073', 'weapon4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.228', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:33,691][52660] DAMAGECOUNT value on done: 404674.0 [2024-08-06 03:22:33,693][52660] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.522', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.128', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.678', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:34,045][52811] DAMAGECOUNT value on done: 376421.0 [2024-08-06 03:22:34,045][52811] Sum rewards: 67.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.156', 'AMMO4': '0.190', 'weapon5': '0.210', 'weapon4': '0.312', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:34,458][52649] DAMAGECOUNT value on done: 390174.0 [2024-08-06 03:22:34,459][52649] Sum rewards: 53.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.334', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.217', 'weapon5': '0.218', 'AMMO4': '0.243', 'weapon2': '0.402', 'weapon4': '0.484', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.548', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '45.500'} [2024-08-06 03:22:34,468][52662] DAMAGECOUNT value on done: 403220.0 [2024-08-06 03:22:34,470][52662] Sum rewards: 77.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.128', 'weapon5': '0.172', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 03:22:34,481][52803] DAMAGECOUNT value on done: 372384.0 [2024-08-06 03:22:34,484][52803] Sum rewards: 69.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.602', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.113', 'weapon5': '0.126', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:34,544][52658] DAMAGECOUNT value on done: 410716.0 [2024-08-06 03:22:34,552][52658] Sum rewards: 66.890, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.669', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.144', 'weapon4': '0.170', 'weapon2': '0.188', 'AMMO3': '0.216', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:35,214][52669] DAMAGECOUNT value on done: 404977.0 [2024-08-06 03:22:35,215][52669] Sum rewards: 69.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.199', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.176', 'AMMO3': '0.180', 'weapon5': '0.180', 'weapon4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.162', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:35,753][52795] DAMAGECOUNT value on done: 378893.0 [2024-08-06 03:22:35,753][52795] Sum rewards: 75.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.122', 'AMMO4': '0.170', 'weapon5': '0.180', 'weapon2': '0.222', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '64.000'} [2024-08-06 03:22:35,943][52665] DAMAGECOUNT value on done: 396254.0 [2024-08-06 03:22:35,944][52665] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.178', 'AMMO3': '0.181', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:35,946][52668] DAMAGECOUNT value on done: 404026.0 [2024-08-06 03:22:35,947][52668] Sum rewards: 60.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.022', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.180', 'weapon4': '0.186', 'AMMO4': '0.204', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:36,358][52671] DAMAGECOUNT value on done: 411615.0 [2024-08-06 03:22:36,358][52671] Sum rewards: 70.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.812', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.152', 'AMMO3': '0.167', 'AMMO4': '0.257', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.000', 'weapon3': '2.902', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:36,588][52647] DAMAGECOUNT value on done: 425006.0 [2024-08-06 03:22:36,588][52647] Sum rewards: 69.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.814', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.050', 'HITCOUNT': '3.380', 'weapon3': '3.390', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:36,610][52660] DAMAGECOUNT value on done: 402229.0 [2024-08-06 03:22:36,612][52660] Sum rewards: 69.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.284', 'weapon4': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:36,830][52650] Updated weights for policy 0, policy_version 45291 (0.0012) [2024-08-06 03:22:37,096][52658] DAMAGECOUNT value on done: 403843.0 [2024-08-06 03:22:37,097][52658] Sum rewards: 74.539, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.166', 'HEALTH': '0.435', 'weapon2': '0.728', 'WEAPON3': '0.900', 'weapon3': '3.094', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:37,131][52649] DAMAGECOUNT value on done: 387294.0 [2024-08-06 03:22:37,132][52649] Sum rewards: 75.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.204', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'HITCOUNT': '3.460', 'weapon3': '3.510', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '64.000'} [2024-08-06 03:22:37,446][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:22:37,520][52662] DAMAGECOUNT value on done: 414631.0 [2024-08-06 03:22:37,521][52662] Sum rewards: 69.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.566', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.154', 'AMMO4': '0.165', 'weapon5': '0.188', 'weapon2': '0.246', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '59.500'} [2024-08-06 03:22:37,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 371032064. Throughput: 0: 4375.8. Samples: 92763700. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 03:22:37,795][52567] Avg episode reward: [(0, '69.578')] [2024-08-06 03:22:38,135][52669] DAMAGECOUNT value on done: 406882.0 [2024-08-06 03:22:38,135][52669] Sum rewards: 59.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.642', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.070', 'AMMO4': '0.082', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.386', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.164', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '51.000'} [2024-08-06 03:22:38,876][52795] DAMAGECOUNT value on done: 369918.0 [2024-08-06 03:22:38,879][52795] Sum rewards: 76.958, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.405', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.162', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'weapon4': '0.360', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '61.000'} [2024-08-06 03:22:38,887][52794] DAMAGECOUNT value on done: 404824.0 [2024-08-06 03:22:38,888][52794] Sum rewards: 69.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.289', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.034', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:38,904][52668] DAMAGECOUNT value on done: 401888.0 [2024-08-06 03:22:38,905][52668] Sum rewards: 64.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.227', 'weapon2': '0.248', 'weapon5': '0.286', 'AMMO4': '0.299', 'weapon4': '0.304', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.814', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:38,977][52671] DAMAGECOUNT value on done: 402123.0 [2024-08-06 03:22:38,979][52671] Sum rewards: 70.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon2': '0.190', 'weapon5': '0.218', 'AMMO3': '0.227', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:39,049][52665] DAMAGECOUNT value on done: 400863.0 [2024-08-06 03:22:39,050][52665] Sum rewards: 64.153, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.816', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon4': '0.132', 'weapon5': '0.290', 'AMMO3': '0.305', 'AMMO4': '0.320', 'weapon2': '0.364', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.746', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:39,525][52660] DAMAGECOUNT value on done: 410793.0 [2024-08-06 03:22:39,525][52660] Sum rewards: 74.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.823', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.158', 'AMMO3': '0.170', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:39,746][52647] DAMAGECOUNT value on done: 416991.0 [2024-08-06 03:22:39,746][52647] Sum rewards: 64.499, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon5': '0.206', 'AMMO3': '0.228', 'AMMO4': '0.329', 'weapon4': '0.356', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon2': '0.690', 'WEAPON3': '1.350', 'weapon3': '2.466', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:40,241][52658] DAMAGECOUNT value on done: 412675.0 [2024-08-06 03:22:40,241][52658] Sum rewards: 72.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.494', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.170', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'weapon4': '0.374', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '58.500'} [2024-08-06 03:22:40,295][52662] DAMAGECOUNT value on done: 408306.0 [2024-08-06 03:22:40,296][52662] Sum rewards: 74.246, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.450', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO4': '0.220', 'weapon2': '0.260', 'AMMO3': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.154', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '63.000'} [2024-08-06 03:22:40,368][52649] DAMAGECOUNT value on done: 394093.0 [2024-08-06 03:22:40,369][52649] Sum rewards: 70.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.973', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.126', 'weapon2': '0.190', 'AMMO3': '0.211', 'AMMO4': '0.223', 'weapon5': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.114', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '58.500'} [2024-08-06 03:22:40,794][52669] DAMAGECOUNT value on done: 407965.0 [2024-08-06 03:22:40,794][52669] Sum rewards: 63.557, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.110', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.014', 'weapon4': '0.018', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.302', 'weapon2': '0.484', 'WEAPON3': '1.750', 'weapon3': '3.248', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:41,207][52650] Updated weights for policy 0, policy_version 45301 (0.0023) [2024-08-06 03:22:41,634][52671] DAMAGECOUNT value on done: 411130.0 [2024-08-06 03:22:41,634][52671] Sum rewards: 65.180, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.088', 'weapon4': '0.194', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:41,762][52668] DAMAGECOUNT value on done: 405685.0 [2024-08-06 03:22:41,763][52668] Sum rewards: 78.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.186', 'AMMO3': '0.226', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '66.000'} [2024-08-06 03:22:41,773][52794] DAMAGECOUNT value on done: 408600.0 [2024-08-06 03:22:41,774][52794] Sum rewards: 75.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.150', 'AMMO3': '0.226', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '63.000'} [2024-08-06 03:22:41,968][52795] DAMAGECOUNT value on done: 370464.0 [2024-08-06 03:22:41,970][52795] Sum rewards: 69.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:42,101][52665] DAMAGECOUNT value on done: 398128.0 [2024-08-06 03:22:42,101][52665] Sum rewards: 64.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon2': '0.192', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.334', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:42,329][52647] DAMAGECOUNT value on done: 422135.0 [2024-08-06 03:22:42,329][52647] Sum rewards: 70.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.306', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.099', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.416', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:42,426][52660] DAMAGECOUNT value on done: 395412.0 [2024-08-06 03:22:42,428][52660] Sum rewards: 60.809, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.047', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.176', 'weapon4': '0.208', 'AMMO4': '0.209', 'weapon2': '0.218', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.102', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 371130368. Throughput: 0: 4376.4. Samples: 92790020. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 03:22:42,794][52567] Avg episode reward: [(0, '69.128')] [2024-08-06 03:22:43,022][52658] DAMAGECOUNT value on done: 395037.0 [2024-08-06 03:22:43,024][52658] Sum rewards: 52.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.127', 'weapon5': '0.152', 'AMMO3': '0.210', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.374', 'DAMAGECOUNT': '13.275', 'FRAGCOUNT': '44.000'} [2024-08-06 03:22:43,309][52662] DAMAGECOUNT value on done: 405587.0 [2024-08-06 03:22:43,310][52662] Sum rewards: 75.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.232', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.392', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '64.000'} [2024-08-06 03:22:43,543][52649] DAMAGECOUNT value on done: 390732.0 [2024-08-06 03:22:43,543][52649] Sum rewards: 62.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.424', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.169', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:43,734][52669] DAMAGECOUNT value on done: 408972.0 [2024-08-06 03:22:43,736][52669] Sum rewards: 70.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.528', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.231', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:44,548][52671] DAMAGECOUNT value on done: 406067.0 [2024-08-06 03:22:44,557][52671] Sum rewards: 67.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.212', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.175', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:44,597][52668] DAMAGECOUNT value on done: 399339.0 [2024-08-06 03:22:44,597][52668] Sum rewards: 60.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.115', 'weapon5': '0.134', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.550', 'HITCOUNT': '2.970', 'weapon3': '3.128', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:44,639][52647] DAMAGECOUNT value on done: 419974.0 [2024-08-06 03:22:44,640][52647] Sum rewards: 57.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.898', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.088', 'AMMO3': '0.201', 'weapon5': '0.264', 'AMMO4': '0.276', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.590', 'weapon3': '2.952', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '49.500'} [2024-08-06 03:22:44,872][52794] DAMAGECOUNT value on done: 405382.0 [2024-08-06 03:22:44,872][52794] Sum rewards: 80.865, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.260', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.118', 'AMMO3': '0.193', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 03:22:45,065][52795] DAMAGECOUNT value on done: 365765.0 [2024-08-06 03:22:45,067][52795] Sum rewards: 76.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.737', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.156', 'AMMO3': '0.158', 'weapon5': '0.188', 'AMMO4': '0.213', 'weapon2': '0.214', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.152', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:45,070][52660] DAMAGECOUNT value on done: 397803.0 [2024-08-06 03:22:45,070][52660] Sum rewards: 79.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.901', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.098', 'AMMO3': '0.237', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '67.000'} [2024-08-06 03:22:45,243][52665] DAMAGECOUNT value on done: 393627.0 [2024-08-06 03:22:45,245][52665] Sum rewards: 59.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.716', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.162', 'AMMO4': '0.175', 'AMMO3': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.296', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '50.000'} [2024-08-06 03:22:45,781][52658] DAMAGECOUNT value on done: 404724.0 [2024-08-06 03:22:45,782][52658] Sum rewards: 72.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.122', 'weapon2': '0.142', 'AMMO3': '0.229', 'weapon4': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:45,861][52662] DAMAGECOUNT value on done: 400740.0 [2024-08-06 03:22:45,863][52662] Sum rewards: 77.703, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'weapon5': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.366', 'weapon2': '0.620', 'WEAPON3': '0.850', 'weapon3': '2.634', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '61.000'} [2024-08-06 03:22:46,234][52650] Updated weights for policy 0, policy_version 45311 (0.0028) [2024-08-06 03:22:46,778][52649] DAMAGECOUNT value on done: 382789.0 [2024-08-06 03:22:46,779][52649] Sum rewards: 73.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.332', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:47,158][52647] DAMAGECOUNT value on done: 430144.0 [2024-08-06 03:22:47,158][52647] Sum rewards: 70.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.178', 'weapon4': '0.180', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:47,343][52794] DAMAGECOUNT value on done: 401991.0 [2024-08-06 03:22:47,344][52794] Sum rewards: 68.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.345', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.116', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:47,446][52671] DAMAGECOUNT value on done: 401639.0 [2024-08-06 03:22:47,446][52671] Sum rewards: 65.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.622', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.124', 'AMMO4': '0.177', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:47,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 371220480. Throughput: 0: 4382.9. Samples: 92803290. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 03:22:47,794][52567] Avg episode reward: [(0, '68.655')] [2024-08-06 03:22:47,810][52660] DAMAGECOUNT value on done: 411482.0 [2024-08-06 03:22:47,812][52660] Sum rewards: 71.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.134', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '59.000'} [2024-08-06 03:22:48,162][52795] DAMAGECOUNT value on done: 376008.0 [2024-08-06 03:22:48,162][52795] Sum rewards: 69.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.108', 'AMMO4': '0.186', 'AMMO3': '0.238', 'weapon5': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:48,255][52665] DAMAGECOUNT value on done: 395503.0 [2024-08-06 03:22:48,255][52665] Sum rewards: 82.192, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.057', 'AMMO3': '0.145', 'weapon5': '0.156', 'weapon2': '0.176', 'AMMO4': '0.284', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.048', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '66.000'} [2024-08-06 03:22:48,576][52662] DAMAGECOUNT value on done: 398936.0 [2024-08-06 03:22:48,577][52662] Sum rewards: 72.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.104', 'AMMO4': '0.152', 'weapon5': '0.154', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '61.000'} [2024-08-06 03:22:48,833][52658] DAMAGECOUNT value on done: 399534.0 [2024-08-06 03:22:48,834][52658] Sum rewards: 66.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.803', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.094', 'AMMO4': '0.182', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:49,413][52647] DAMAGECOUNT value on done: 421722.0 [2024-08-06 03:22:49,413][52647] Sum rewards: 79.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.504', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.198', 'AMMO3': '0.245', 'weapon2': '0.270', 'AMMO4': '0.275', 'weapon5': '0.324', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.874', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '66.000'} [2024-08-06 03:22:49,861][52649] DAMAGECOUNT value on done: 394470.0 [2024-08-06 03:22:49,863][52649] Sum rewards: 66.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.132', 'AMMO3': '0.204', 'AMMO4': '0.263', 'weapon5': '0.292', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:50,317][52794] DAMAGECOUNT value on done: 399244.0 [2024-08-06 03:22:50,321][52794] Sum rewards: 66.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.206', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:50,370][52671] DAMAGECOUNT value on done: 410262.0 [2024-08-06 03:22:50,370][52671] Sum rewards: 62.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.174', 'weapon4': '0.188', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.688', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '50.000'} [2024-08-06 03:22:50,534][52650] Updated weights for policy 0, policy_version 45321 (0.0016) [2024-08-06 03:22:50,954][52660] DAMAGECOUNT value on done: 415772.0 [2024-08-06 03:22:50,955][52660] Sum rewards: 92.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.118', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO4': '0.176', 'AMMO3': '0.211', 'weapon5': '0.212', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '22.341', 'FRAGCOUNT': '74.500'} [2024-08-06 03:22:51,092][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:22:51,257][52795] DAMAGECOUNT value on done: 363723.0 [2024-08-06 03:22:51,257][52795] Sum rewards: 71.308, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.544', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.228', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:51,305][52665] DAMAGECOUNT value on done: 397076.0 [2024-08-06 03:22:51,305][52665] Sum rewards: 58.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.076', 'weapon5': '0.142', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'HITCOUNT': '2.750', 'weapon3': '3.266', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '53.000'} [2024-08-06 03:22:51,707][52658] DAMAGECOUNT value on done: 400511.0 [2024-08-06 03:22:51,707][52658] Sum rewards: 73.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.676', 'AMMO5': '0.011', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:52,008][52647] DAMAGECOUNT value on done: 418586.0 [2024-08-06 03:22:52,008][52647] Sum rewards: 65.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.535', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.122', 'weapon5': '0.186', 'AMMO3': '0.191', 'AMMO4': '0.253', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 371302400. Throughput: 0: 4382.9. Samples: 92829840. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 03:22:52,794][52567] Avg episode reward: [(0, '69.092')] [2024-08-06 03:22:52,906][52649] DAMAGECOUNT value on done: 387540.0 [2024-08-06 03:22:52,908][52649] Sum rewards: 66.372, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.725', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.203', 'weapon5': '0.214', 'WEAPON5': '0.350', 'weapon2': '0.366', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:53,139][52794] DAMAGECOUNT value on done: 405120.0 [2024-08-06 03:22:53,139][52794] Sum rewards: 72.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.753', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.152', 'AMMO3': '0.179', 'weapon5': '0.186', 'AMMO4': '0.193', 'weapon4': '0.322', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:53,468][52671] DAMAGECOUNT value on done: 413007.0 [2024-08-06 03:22:53,468][52671] Sum rewards: 70.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.154', 'AMMO3': '0.178', 'weapon5': '0.180', 'AMMO4': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:53,763][52660] DAMAGECOUNT value on done: 397300.0 [2024-08-06 03:22:53,764][52660] Sum rewards: 71.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.186', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:54,352][52795] DAMAGECOUNT value on done: 381596.0 [2024-08-06 03:22:54,354][52795] Sum rewards: 69.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.315', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.086', 'weapon4': '0.116', 'AMMO4': '0.126', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '56.000'} [2024-08-06 03:22:54,374][52665] DAMAGECOUNT value on done: 399869.0 [2024-08-06 03:22:54,374][52665] Sum rewards: 70.142, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.804', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.093', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.144', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '60.000'} [2024-08-06 03:22:54,496][52658] DAMAGECOUNT value on done: 397271.0 [2024-08-06 03:22:54,497][52658] Sum rewards: 63.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.689', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.174', 'AMMO3': '0.209', 'weapon4': '0.216', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:54,676][52647] DAMAGECOUNT value on done: 418779.0 [2024-08-06 03:22:54,676][52647] Sum rewards: 69.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.664', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.118', 'weapon5': '0.144', 'AMMO3': '0.156', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '2.884', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '56.500'} [2024-08-06 03:22:55,235][52650] Updated weights for policy 0, policy_version 45331 (0.0035) [2024-08-06 03:22:55,855][52794] DAMAGECOUNT value on done: 409233.0 [2024-08-06 03:22:55,857][52794] Sum rewards: 63.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.096', 'AMMO4': '0.119', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon5': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '54.000'} [2024-08-06 03:22:56,129][52649] DAMAGECOUNT value on done: 397005.0 [2024-08-06 03:22:56,131][52649] Sum rewards: 79.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.104', 'AMMO4': '0.177', 'weapon5': '0.178', 'AMMO3': '0.239', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '67.000'} [2024-08-06 03:22:56,253][52671] DAMAGECOUNT value on done: 402405.0 [2024-08-06 03:22:56,255][52671] Sum rewards: 76.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.022', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon2': '0.216', 'AMMO3': '0.229', 'AMMO4': '0.311', 'weapon5': '0.316', 'weapon4': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.782', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '63.000'} [2024-08-06 03:22:56,868][52660] DAMAGECOUNT value on done: 401772.0 [2024-08-06 03:22:56,870][52660] Sum rewards: 64.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.812', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.080', 'AMMO4': '0.126', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.160', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '55.000'} [2024-08-06 03:22:57,324][52658] DAMAGECOUNT value on done: 410195.0 [2024-08-06 03:22:57,326][52658] Sum rewards: 66.663, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.434', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.080', 'weapon5': '0.118', 'AMMO4': '0.215', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 03:22:57,423][52795] DAMAGECOUNT value on done: 375621.0 [2024-08-06 03:22:57,423][52795] Sum rewards: 74.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.218', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.287', 'weapon4': '0.390', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.736', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '65.000'} [2024-08-06 03:22:57,629][52647] DAMAGECOUNT value on done: 417214.0 [2024-08-06 03:22:57,636][52647] Sum rewards: 56.750, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.104', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.270', 'weapon2': '0.278', 'AMMO3': '0.301', 'AMMO4': '0.304', 'weapon5': '0.372', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.640', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '49.000'} [2024-08-06 03:22:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 371392512. Throughput: 0: 4379.8. Samples: 92855790. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 03:22:57,794][52567] Avg episode reward: [(0, '69.223')] [2024-08-06 03:22:58,492][52794] DAMAGECOUNT value on done: 400027.0 [2024-08-06 03:22:58,492][52794] Sum rewards: 71.134, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.234', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.020', 'AMMO4': '0.053', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.260', 'weapon3': '3.302', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '62.000'} [2024-08-06 03:22:58,641][52820] DAMAGECOUNT value on done: 369056.0 [2024-08-06 03:22:58,641][52820] Sum rewards: 70.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.044', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.252', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '57.000'} [2024-08-06 03:22:59,096][52649] DAMAGECOUNT value on done: 396250.0 [2024-08-06 03:22:59,096][52649] Sum rewards: 58.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.895', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon7': '0.052', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'weapon2': '0.182', 'weapon4': '0.270', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.142', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '52.000'} [2024-08-06 03:22:59,274][52671] DAMAGECOUNT value on done: 412578.0 [2024-08-06 03:22:59,274][52671] Sum rewards: 56.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.326', 'WEAPON3': '1.600', 'HITCOUNT': '2.970', 'weapon3': '3.140', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '49.000'} [2024-08-06 03:22:59,841][52660] DAMAGECOUNT value on done: 398031.0 [2024-08-06 03:22:59,841][52660] Sum rewards: 77.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.262', 'weapon2': '0.306', 'WEAPON3': '1.650', 'weapon3': '3.258', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '67.000'} [2024-08-06 03:23:00,055][52650] Updated weights for policy 0, policy_version 45341 (0.0012) [2024-08-06 03:23:00,174][52658] DAMAGECOUNT value on done: 401933.0 [2024-08-06 03:23:00,175][52658] Sum rewards: 67.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.162', 'AMMO3': '0.165', 'weapon4': '0.182', 'AMMO4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '53.000'} [2024-08-06 03:23:00,404][52647] DAMAGECOUNT value on done: 420867.0 [2024-08-06 03:23:00,405][52647] Sum rewards: 61.265, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.599', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.198', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.192', 'DAMAGECOUNT': '14.298', 'FRAGCOUNT': '52.000'} [2024-08-06 03:23:00,519][52795] DAMAGECOUNT value on done: 366500.0 [2024-08-06 03:23:00,519][52795] Sum rewards: 74.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.250', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.116', 'weapon4': '0.174', 'AMMO4': '0.207', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:01,654][52820] DAMAGECOUNT value on done: 372918.0 [2024-08-06 03:23:01,655][52820] Sum rewards: 71.668, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon2': '0.200', 'weapon4': '0.212', 'weapon5': '0.228', 'AMMO3': '0.230', 'AMMO4': '0.241', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:01,719][52794] DAMAGECOUNT value on done: 408658.0 [2024-08-06 03:23:01,720][52794] Sum rewards: 68.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.338', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.161', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.382', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.000'} [2024-08-06 03:23:02,045][52649] DAMAGECOUNT value on done: 389425.0 [2024-08-06 03:23:02,046][52649] Sum rewards: 78.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.165', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.152', 'weapon2': '0.390', 'WEAPON3': '0.950', 'weapon3': '3.480', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '62.000'} [2024-08-06 03:23:02,205][52660] DAMAGECOUNT value on done: 403932.0 [2024-08-06 03:23:02,207][52660] Sum rewards: 74.978, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.585', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon4': '0.150', 'AMMO3': '0.262', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '65.000'} [2024-08-06 03:23:02,401][52671] DAMAGECOUNT value on done: 404473.0 [2024-08-06 03:23:02,404][52671] Sum rewards: 71.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.162', 'weapon5': '0.194', 'AMMO4': '0.202', 'AMMO3': '0.236', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '61.000'} [2024-08-06 03:23:02,522][52658] DAMAGECOUNT value on done: 405395.0 [2024-08-06 03:23:02,524][52658] Sum rewards: 78.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.306', 'weapon4': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '62.000'} [2024-08-06 03:23:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 371474432. Throughput: 0: 4387.3. Samples: 92869050. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 03:23:02,795][52567] Avg episode reward: [(0, '69.606')] [2024-08-06 03:23:03,648][52795] DAMAGECOUNT value on done: 373165.0 [2024-08-06 03:23:03,648][52795] Sum rewards: 78.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.776', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.174', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '63.000'} [2024-08-06 03:23:04,774][52649] DAMAGECOUNT value on done: 395450.0 [2024-08-06 03:23:04,776][52649] Sum rewards: 70.562, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.084', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.150', 'weapon5': '0.180', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.632', 'WEAPON3': '0.950', 'weapon3': '2.810', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2024-08-06 03:23:04,838][52820] DAMAGECOUNT value on done: 374691.0 [2024-08-06 03:23:04,839][52820] Sum rewards: 74.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.110', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '62.000'} [2024-08-06 03:23:04,902][52650] Updated weights for policy 0, policy_version 45351 (0.0027) [2024-08-06 03:23:04,907][52794] DAMAGECOUNT value on done: 404334.0 [2024-08-06 03:23:04,907][52794] Sum rewards: 73.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'weapon4': '0.088', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '62.000'} [2024-08-06 03:23:05,070][52660] DAMAGECOUNT value on done: 398820.0 [2024-08-06 03:23:05,073][52660] Sum rewards: 62.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.282', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.204', 'weapon2': '0.224', 'AMMO3': '0.261', 'AMMO4': '0.274', 'weapon5': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '53.500'} [2024-08-06 03:23:05,112][52658] DAMAGECOUNT value on done: 408246.0 [2024-08-06 03:23:05,113][52658] Sum rewards: 72.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.494', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.280', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '59.000'} [2024-08-06 03:23:05,604][52671] DAMAGECOUNT value on done: 396719.0 [2024-08-06 03:23:05,604][52671] Sum rewards: 82.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.745', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.434', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '66.000'} [2024-08-06 03:23:06,948][52795] DAMAGECOUNT value on done: 380057.0 [2024-08-06 03:23:06,956][52795] Sum rewards: 71.927, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.405', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.182', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '59.000'} [2024-08-06 03:23:07,624][52794] DAMAGECOUNT value on done: 401085.0 [2024-08-06 03:23:07,629][52794] Sum rewards: 67.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.188', 'AMMO5': '0.021', 'AMMO2': '0.048', 'AMMO3': '0.207', 'AMMO4': '0.240', 'weapon5': '0.248', 'weapon4': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.584', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '55.000'} [2024-08-06 03:23:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 371564544. Throughput: 0: 4381.3. Samples: 92895250. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 03:23:07,795][52567] Avg episode reward: [(0, '69.899')] [2024-08-06 03:23:07,934][52649] DAMAGECOUNT value on done: 399018.0 [2024-08-06 03:23:07,934][52649] Sum rewards: 83.383, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.015', 'AMMO2': '0.030', 'HEALTH': '0.105', 'AMMO4': '0.148', 'weapon4': '0.152', 'AMMO3': '0.153', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '0.950', 'weapon3': '2.806', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '67.000'} [2024-08-06 03:23:08,004][52820] DAMAGECOUNT value on done: 369569.0 [2024-08-06 03:23:08,005][52820] Sum rewards: 71.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.009', 'AMMO2': '0.055', 'weapon4': '0.128', 'weapon5': '0.132', 'weapon2': '0.192', 'AMMO3': '0.252', 'AMMO4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.290', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:08,429][52671] DAMAGECOUNT value on done: 412128.0 [2024-08-06 03:23:08,429][52671] Sum rewards: 76.032, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.137', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.056', 'weapon4': '0.064', 'AMMO4': '0.126', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '66.000'} [2024-08-06 03:23:08,625][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:23:09,317][52650] Updated weights for policy 0, policy_version 45361 (0.0013) [2024-08-06 03:23:10,907][52794] DAMAGECOUNT value on done: 407906.0 [2024-08-06 03:23:10,907][52794] Sum rewards: 84.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.195', 'weapon2': '0.604', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '69.000'} [2024-08-06 03:23:11,168][52820] DAMAGECOUNT value on done: 375383.0 [2024-08-06 03:23:11,170][52820] Sum rewards: 81.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.139', 'weapon2': '0.194', 'weapon4': '0.200', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.254', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '69.000'} [2024-08-06 03:23:11,359][52649] DAMAGECOUNT value on done: 397862.0 [2024-08-06 03:23:11,360][52649] Sum rewards: 71.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.046', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.306', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.402', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '62.000'} [2024-08-06 03:23:11,434][52671] DAMAGECOUNT value on done: 411334.0 [2024-08-06 03:23:11,434][52671] Sum rewards: 70.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.204', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.370', 'weapon3': '3.456', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '59.000'} [2024-08-06 03:23:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 371654656. Throughput: 0: 4379.1. Samples: 92921590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 03:23:12,795][52567] Avg episode reward: [(0, '70.426')] [2024-08-06 03:23:13,959][52794] DAMAGECOUNT value on done: 396613.0 [2024-08-06 03:23:13,959][52794] Sum rewards: 68.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.224', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.176', 'AMMO3': '0.191', 'weapon4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 03:23:14,015][52650] Updated weights for policy 0, policy_version 45371 (0.0012) [2024-08-06 03:23:14,279][52820] DAMAGECOUNT value on done: 367448.0 [2024-08-06 03:23:14,279][52820] Sum rewards: 66.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.375', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.036', 'weapon4': '0.078', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '57.000'} [2024-08-06 03:23:14,425][52671] DAMAGECOUNT value on done: 411735.0 [2024-08-06 03:23:14,426][52671] Sum rewards: 79.673, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.076', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '66.000'} [2024-08-06 03:23:14,556][52649] DAMAGECOUNT value on done: 397802.0 [2024-08-06 03:23:14,559][52649] Sum rewards: 70.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.881', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.132', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '57.000'} [2024-08-06 03:23:16,901][52794] DAMAGECOUNT value on done: 415947.0 [2024-08-06 03:23:16,903][52794] Sum rewards: 79.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.531', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'weapon2': '0.232', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.534', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '67.000'} [2024-08-06 03:23:17,260][52820] DAMAGECOUNT value on done: 370389.0 [2024-08-06 03:23:17,264][52820] Sum rewards: 77.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.111', 'weapon5': '0.136', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '63.000'} [2024-08-06 03:23:17,402][52671] DAMAGECOUNT value on done: 406631.0 [2024-08-06 03:23:17,403][52671] Sum rewards: 71.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon2': '0.182', 'weapon4': '0.188', 'AMMO3': '0.194', 'weapon5': '0.198', 'AMMO4': '0.299', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '58.000'} [2024-08-06 03:23:17,813][52567] Fps is (10 sec: 17170.8, 60 sec: 17470.8, 300 sec: 17493.7). Total num frames: 371736576. Throughput: 0: 4385.7. Samples: 92934800. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 03:23:17,825][52567] Avg episode reward: [(0, '70.698')] [2024-08-06 03:23:18,101][52649] DAMAGECOUNT value on done: 390365.0 [2024-08-06 03:23:18,109][52649] Sum rewards: 64.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.148', 'AMMO3': '0.178', 'AMMO4': '0.188', 'weapon2': '0.306', 'weapon4': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.500'} [2024-08-06 03:23:18,575][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:23:18,969][52650] Updated weights for policy 0, policy_version 45381 (0.0022) [2024-08-06 03:23:20,233][52671] DAMAGECOUNT value on done: 404568.0 [2024-08-06 03:23:20,236][52671] Sum rewards: 72.855, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.151', 'weapon5': '0.152', 'AMMO4': '0.187', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.794', 'WEAPON3': '0.950', 'weapon3': '2.566', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '57.000'} [2024-08-06 03:23:20,436][52820] DAMAGECOUNT value on done: 376210.0 [2024-08-06 03:23:20,438][52820] Sum rewards: 75.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.140', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO4': '0.172', 'weapon2': '0.236', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.274', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '63.000'} [2024-08-06 03:23:20,499][52794] DAMAGECOUNT value on done: 397077.0 [2024-08-06 03:23:20,501][52794] Sum rewards: 62.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'AMMO5': '0.016', 'weapon4': '0.026', 'AMMO2': '0.030', 'weapon5': '0.078', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.304', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2024-08-06 03:23:20,980][52811] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:23:21,166][52649] DAMAGECOUNT value on done: 395997.0 [2024-08-06 03:23:21,166][52649] Sum rewards: 59.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.022', 'AMMO2': '0.077', 'weapon4': '0.200', 'AMMO3': '0.211', 'weapon5': '0.324', 'AMMO4': '0.387', 'weapon2': '0.424', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '50.000'} [2024-08-06 03:23:22,429][52665] Large shaping reward 2.545 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.08700000000000001, -29.0), ('weapon5', 0.002)] [2024-08-06 03:23:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 371826688. Throughput: 0: 4374.9. Samples: 92960570. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 03:23:22,794][52567] Avg episode reward: [(0, '70.549')] [2024-08-06 03:23:23,406][52794] DAMAGECOUNT value on done: 413087.0 [2024-08-06 03:23:23,409][52794] Sum rewards: 59.348, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.570', 'AMMO5': '0.009', 'weapon4': '0.010', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'weapon5': '0.132', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.582', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.088', 'DAMAGECOUNT': '14.082', 'FRAGCOUNT': '49.000'} [2024-08-06 03:23:23,470][52820] DAMAGECOUNT value on done: 372147.0 [2024-08-06 03:23:23,472][52820] Sum rewards: 66.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.180', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon5': '0.202', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.026', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '53.000'} [2024-08-06 03:23:23,750][52650] Updated weights for policy 0, policy_version 45391 (0.0021) [2024-08-06 03:23:24,092][52649] DAMAGECOUNT value on done: 390974.0 [2024-08-06 03:23:24,092][52649] Sum rewards: 66.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.227', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.235', 'weapon5': '0.284', 'weapon4': '0.304', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.796', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '57.000'} [2024-08-06 03:23:25,015][52659] DAMAGECOUNT value on done: 405050.0 [2024-08-06 03:23:25,017][52659] Sum rewards: 55.797, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.524', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.166', 'weapon5': '0.184', 'weapon2': '0.210', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.008', 'DAMAGECOUNT': '13.623', 'FRAGCOUNT': '45.000'} [2024-08-06 03:23:26,484][52794] DAMAGECOUNT value on done: 405185.0 [2024-08-06 03:23:26,485][52794] Sum rewards: 69.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.330', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.078', 'weapon5': '0.128', 'AMMO4': '0.142', 'AMMO3': '0.235', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.246', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:26,564][52820] DAMAGECOUNT value on done: 377931.0 [2024-08-06 03:23:26,566][52820] Sum rewards: 73.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.138', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.086', 'AMMO3': '0.202', 'AMMO4': '0.242', 'weapon2': '0.318', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:27,251][52649] DAMAGECOUNT value on done: 398618.0 [2024-08-06 03:23:27,252][52649] Sum rewards: 73.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.167', 'AMMO3': '0.227', 'weapon5': '0.248', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.682', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '61.000'} [2024-08-06 03:23:27,734][52659] DAMAGECOUNT value on done: 405047.0 [2024-08-06 03:23:27,736][52659] Sum rewards: 66.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.060', 'AMMO4': '0.087', 'weapon5': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '53.000'} [2024-08-06 03:23:27,794][52567] Fps is (10 sec: 18056.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 371916800. Throughput: 0: 4374.2. Samples: 92986860. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 03:23:27,794][52567] Avg episode reward: [(0, '70.345')] [2024-08-06 03:23:28,179][52650] Updated weights for policy 0, policy_version 45401 (0.0020) [2024-08-06 03:23:29,506][52794] DAMAGECOUNT value on done: 406885.0 [2024-08-06 03:23:29,506][52794] Sum rewards: 74.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.015', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.056', 'weapon5': '0.134', 'AMMO3': '0.180', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:29,636][52820] DAMAGECOUNT value on done: 370770.0 [2024-08-06 03:23:29,636][52820] Sum rewards: 65.082, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.622', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.289', 'weapon2': '0.442', 'WEAPON3': '1.750', 'weapon3': '3.308', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '57.000'} [2024-08-06 03:23:30,306][52649] DAMAGECOUNT value on done: 399885.0 [2024-08-06 03:23:30,309][52649] Sum rewards: 62.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.175', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.112', 'weapon4': '0.136', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.902', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '48.500'} [2024-08-06 03:23:30,704][52659] DAMAGECOUNT value on done: 405397.0 [2024-08-06 03:23:30,704][52659] Sum rewards: 60.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.054', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.962', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '50.000'} [2024-08-06 03:23:32,570][52794] DAMAGECOUNT value on done: 415210.0 [2024-08-06 03:23:32,572][52794] Sum rewards: 53.645, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.532', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.267', 'weapon2': '0.302', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.906', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '48.000'} [2024-08-06 03:23:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 371998720. Throughput: 0: 4371.3. Samples: 93000000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:23:32,795][52567] Avg episode reward: [(0, '70.200')] [2024-08-06 03:23:32,822][52650] Updated weights for policy 0, policy_version 45411 (0.0013) [2024-08-06 03:23:32,939][52820] DAMAGECOUNT value on done: 373598.0 [2024-08-06 03:23:32,940][52820] Sum rewards: 69.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.125', 'weapon5': '0.140', 'weapon2': '0.242', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.280', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '59.000'} [2024-08-06 03:23:33,087][52649] DAMAGECOUNT value on done: 395734.0 [2024-08-06 03:23:33,088][52649] Sum rewards: 53.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.798', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.024', 'AMMO4': '0.044', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.652', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '47.000'} [2024-08-06 03:23:33,626][52659] DAMAGECOUNT value on done: 403747.0 [2024-08-06 03:23:33,626][52659] Sum rewards: 60.817, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.814', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.146', 'weapon5': '0.192', 'AMMO3': '0.227', 'AMMO4': '0.256', 'weapon2': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '53.000'} [2024-08-06 03:23:35,016][52794] DAMAGECOUNT value on done: 404590.0 [2024-08-06 03:23:35,017][52794] Sum rewards: 85.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.709', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.235', 'WEAPON3': '1.300', 'weapon3': '3.478', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '71.000'} [2024-08-06 03:23:36,151][52820] DAMAGECOUNT value on done: 379509.0 [2024-08-06 03:23:36,152][52820] Sum rewards: 68.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.845', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.152', 'weapon4': '0.176', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '57.000'} [2024-08-06 03:23:36,633][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:23:36,832][52659] DAMAGECOUNT value on done: 401800.0 [2024-08-06 03:23:36,833][52659] Sum rewards: 70.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.485', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.104', 'weapon4': '0.122', 'AMMO4': '0.173', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '61.000'} [2024-08-06 03:23:37,482][52650] Updated weights for policy 0, policy_version 45421 (0.0013) [2024-08-06 03:23:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 372088832. Throughput: 0: 4363.8. Samples: 93026210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:23:37,794][52567] Avg episode reward: [(0, '70.360')] [2024-08-06 03:23:38,685][52659] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 03:23:39,354][52820] DAMAGECOUNT value on done: 375134.0 [2024-08-06 03:23:39,356][52820] Sum rewards: 68.767, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.645', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.182', 'AMMO4': '0.219', 'weapon2': '0.230', 'AMMO3': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.158', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:39,823][52659] DAMAGECOUNT value on done: 404049.0 [2024-08-06 03:23:39,824][52659] Sum rewards: 66.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.614', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.131', 'weapon4': '0.158', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.284', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '55.000'} [2024-08-06 03:23:42,234][52650] Updated weights for policy 0, policy_version 45431 (0.0011) [2024-08-06 03:23:42,604][52820] DAMAGECOUNT value on done: 378750.0 [2024-08-06 03:23:42,605][52820] Sum rewards: 69.054, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.144', 'weapon4': '0.146', 'AMMO3': '0.209', 'weapon2': '0.248', 'AMMO4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '59.000'} [2024-08-06 03:23:42,790][52665] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:23:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 372170752. Throughput: 0: 4374.4. Samples: 93052640. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:23:42,794][52567] Avg episode reward: [(0, '70.035')] [2024-08-06 03:23:43,032][52659] DAMAGECOUNT value on done: 405222.0 [2024-08-06 03:23:43,033][52659] Sum rewards: 73.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.912', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.052', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '60.500'} [2024-08-06 03:23:45,656][52659] DAMAGECOUNT value on done: 401781.0 [2024-08-06 03:23:45,657][52659] Sum rewards: 75.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.646', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.166', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:45,899][52663] DAMAGECOUNT value on done: 409391.0 [2024-08-06 03:23:45,899][52663] Sum rewards: 72.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.689', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.259', 'weapon2': '0.372', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.798', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '62.000'} [2024-08-06 03:23:45,927][52820] DAMAGECOUNT value on done: 374057.0 [2024-08-06 03:23:45,928][52820] Sum rewards: 71.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'ARMOR': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:46,362][52666] DAMAGECOUNT value on done: 403641.0 [2024-08-06 03:23:46,365][52666] Sum rewards: 73.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.100', 'weapon4': '0.182', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.000'} [2024-08-06 03:23:46,530][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:23:46,683][52650] Updated weights for policy 0, policy_version 45441 (0.0012) [2024-08-06 03:23:47,010][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:23:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 372269056. Throughput: 0: 4378.0. Samples: 93066060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:23:47,794][52567] Avg episode reward: [(0, '70.166')] [2024-08-06 03:23:48,521][52659] DAMAGECOUNT value on done: 412366.0 [2024-08-06 03:23:48,521][52659] Sum rewards: 70.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:48,936][52820] DAMAGECOUNT value on done: 373051.0 [2024-08-06 03:23:48,939][52820] Sum rewards: 75.774, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.130', 'weapon2': '0.230', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.378', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 03:23:49,052][52663] DAMAGECOUNT value on done: 404687.0 [2024-08-06 03:23:49,053][52663] Sum rewards: 64.412, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.652', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.106', 'AMMO4': '0.113', 'weapon4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.178', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '58.000'} [2024-08-06 03:23:49,285][52666] DAMAGECOUNT value on done: 409538.0 [2024-08-06 03:23:49,286][52666] Sum rewards: 83.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.092', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '68.000'} [2024-08-06 03:23:51,093][52670] DAMAGECOUNT value on done: 397419.0 [2024-08-06 03:23:51,096][52670] Sum rewards: 42.697, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.455', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.160', 'AMMO4': '0.164', 'weapon7': '0.166', 'WEAPON7': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon4': '1.298', 'weapon3': '1.970', 'HITCOUNT': '2.050', 'DAMAGECOUNT': '10.749', 'FRAGCOUNT': '35.000'} [2024-08-06 03:23:51,476][52659] DAMAGECOUNT value on done: 413574.0 [2024-08-06 03:23:51,477][52659] Sum rewards: 70.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon5': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:51,710][52650] Updated weights for policy 0, policy_version 45451 (0.0021) [2024-08-06 03:23:51,958][52663] DAMAGECOUNT value on done: 398457.0 [2024-08-06 03:23:51,959][52663] Sum rewards: 55.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.142', 'AMMO4': '0.199', 'AMMO3': '0.210', 'weapon4': '0.210', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '48.000'} [2024-08-06 03:23:52,133][52820] DAMAGECOUNT value on done: 383407.0 [2024-08-06 03:23:52,135][52820] Sum rewards: 76.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.410', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO4': '0.174', 'AMMO3': '0.278', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.208', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '67.000'} [2024-08-06 03:23:52,614][52666] DAMAGECOUNT value on done: 407478.0 [2024-08-06 03:23:52,615][52666] Sum rewards: 67.097, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.046', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 03:23:52,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 372359168. Throughput: 0: 4378.0. Samples: 93092260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:23:52,794][52567] Avg episode reward: [(0, '69.810')] [2024-08-06 03:23:54,230][52670] DAMAGECOUNT value on done: 404445.0 [2024-08-06 03:23:54,231][52670] Sum rewards: 60.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.154', 'weapon4': '0.172', 'AMMO3': '0.197', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '50.500'} [2024-08-06 03:23:54,334][52614] Signal inference workers to stop experience collection... (8200 times) [2024-08-06 03:23:54,334][52614] Signal inference workers to resume experience collection... (8200 times) [2024-08-06 03:23:54,422][52650] InferenceWorker_p0-w0: stopping experience collection (8200 times) [2024-08-06 03:23:54,422][52650] InferenceWorker_p0-w0: resuming experience collection (8200 times) [2024-08-06 03:23:54,489][52659] DAMAGECOUNT value on done: 405825.0 [2024-08-06 03:23:54,489][52659] Sum rewards: 63.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.120', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.522', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.104', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '53.000'} [2024-08-06 03:23:54,634][52663] DAMAGECOUNT value on done: 404984.0 [2024-08-06 03:23:54,636][52663] Sum rewards: 78.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.510', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.049', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.252', 'WEAPON3': '1.600', 'weapon3': '3.378', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '67.000'} [2024-08-06 03:23:55,269][52820] DAMAGECOUNT value on done: 384562.0 [2024-08-06 03:23:55,270][52820] Sum rewards: 63.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.161', 'weapon5': '0.216', 'AMMO4': '0.267', 'WEAPON5': '0.400', 'weapon2': '0.414', 'weapon4': '0.432', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.650', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '52.000'} [2024-08-06 03:23:55,429][52666] DAMAGECOUNT value on done: 404697.0 [2024-08-06 03:23:55,430][52666] Sum rewards: 76.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.139', 'weapon2': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '65.000'} [2024-08-06 03:23:56,112][52650] Updated weights for policy 0, policy_version 45461 (0.0015) [2024-08-06 03:23:56,870][52670] DAMAGECOUNT value on done: 397544.0 [2024-08-06 03:23:56,870][52670] Sum rewards: 71.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.075', 'weapon5': '0.080', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.590', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '60.000'} [2024-08-06 03:23:57,174][52659] DAMAGECOUNT value on done: 407993.0 [2024-08-06 03:23:57,175][52659] Sum rewards: 72.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.148', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.482', 'WEAPON3': '1.550', 'weapon3': '2.848', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '61.000'} [2024-08-06 03:23:57,505][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 03:23:57,589][52663] DAMAGECOUNT value on done: 400908.0 [2024-08-06 03:23:57,589][52663] Sum rewards: 60.821, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.054', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.520', 'WEAPON3': '1.000', 'weapon3': '3.056', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '48.000'} [2024-08-06 03:23:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 372441088. Throughput: 0: 4373.6. Samples: 93118400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:23:57,794][52567] Avg episode reward: [(0, '69.728')] [2024-08-06 03:23:58,028][52666] DAMAGECOUNT value on done: 404396.0 [2024-08-06 03:23:58,029][52666] Sum rewards: 80.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.128', 'weapon5': '0.144', 'AMMO4': '0.151', 'AMMO3': '0.240', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '66.000'} [2024-08-06 03:23:58,323][52820] DAMAGECOUNT value on done: 371531.0 [2024-08-06 03:23:58,324][52820] Sum rewards: 56.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.096', 'weapon5': '0.168', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.710', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.824', 'DAMAGECOUNT': '13.671', 'FRAGCOUNT': '47.000'} [2024-08-06 03:23:59,498][52670] DAMAGECOUNT value on done: 395700.0 [2024-08-06 03:23:59,499][52670] Sum rewards: 73.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.211', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '61.000'} [2024-08-06 03:24:00,035][52659] DAMAGECOUNT value on done: 396291.0 [2024-08-06 03:24:00,035][52659] Sum rewards: 59.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon2': '0.170', 'AMMO3': '0.184', 'weapon5': '0.214', 'AMMO4': '0.253', 'WEAPON5': '0.450', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '2.858', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '49.000'} [2024-08-06 03:24:00,292][52663] DAMAGECOUNT value on done: 407095.0 [2024-08-06 03:24:00,293][52663] Sum rewards: 69.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'weapon4': '0.124', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '60.000'} [2024-08-06 03:24:00,859][52650] Updated weights for policy 0, policy_version 45471 (0.0021) [2024-08-06 03:24:01,036][52666] DAMAGECOUNT value on done: 397844.0 [2024-08-06 03:24:01,037][52666] Sum rewards: 80.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.962', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.214', 'weapon5': '0.224', 'weapon2': '0.226', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '65.000'} [2024-08-06 03:24:01,816][52665] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:02,537][52670] DAMAGECOUNT value on done: 406661.0 [2024-08-06 03:24:02,539][52670] Sum rewards: 73.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.846', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.296', 'weapon2': '0.328', 'WEAPON3': '1.700', 'weapon3': '3.338', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '64.000'} [2024-08-06 03:24:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 372523008. Throughput: 0: 4370.5. Samples: 93131390. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 03:24:02,794][52567] Avg episode reward: [(0, '69.806')] [2024-08-06 03:24:03,023][52659] DAMAGECOUNT value on done: 404063.0 [2024-08-06 03:24:03,024][52659] Sum rewards: 69.005, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.392', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.088', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.315', 'weapon2': '0.424', 'WEAPON3': '1.900', 'weapon3': '2.994', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '60.000'} [2024-08-06 03:24:03,336][52663] DAMAGECOUNT value on done: 406072.0 [2024-08-06 03:24:03,337][52663] Sum rewards: 84.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.854', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '70.000'} [2024-08-06 03:24:03,597][52666] DAMAGECOUNT value on done: 405047.0 [2024-08-06 03:24:03,598][52666] Sum rewards: 72.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '62.000'} [2024-08-06 03:24:05,408][52670] DAMAGECOUNT value on done: 400452.0 [2024-08-06 03:24:05,408][52670] Sum rewards: 78.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.052', 'weapon4': '0.066', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.226', 'WEAPON3': '1.450', 'HITCOUNT': '3.540', 'weapon3': '3.542', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '65.000'} [2024-08-06 03:24:05,643][52659] DAMAGECOUNT value on done: 413962.0 [2024-08-06 03:24:05,644][52659] Sum rewards: 69.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.217', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.162', 'weapon4': '0.202', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '58.000'} [2024-08-06 03:24:05,818][52663] DAMAGECOUNT value on done: 401481.0 [2024-08-06 03:24:05,819][52663] Sum rewards: 61.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.712', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.093', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.368', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '53.000'} [2024-08-06 03:24:05,898][52650] Updated weights for policy 0, policy_version 45481 (0.0010) [2024-08-06 03:24:06,375][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:06,788][52666] DAMAGECOUNT value on done: 404186.0 [2024-08-06 03:24:06,788][52666] Sum rewards: 60.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.690', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '49.000'} [2024-08-06 03:24:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 372621312. Throughput: 0: 4382.4. Samples: 93157780. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 03:24:07,794][52567] Avg episode reward: [(0, '69.949')] [2024-08-06 03:24:08,428][52670] DAMAGECOUNT value on done: 396477.0 [2024-08-06 03:24:08,428][52670] Sum rewards: 54.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.235', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.122', 'AMMO3': '0.135', 'weapon2': '0.180', 'weapon5': '0.246', 'AMMO4': '0.247', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon4': '0.864', 'weapon3': '2.288', 'HITCOUNT': '2.460', 'DAMAGECOUNT': '13.782', 'FRAGCOUNT': '44.000'} [2024-08-06 03:24:08,671][52659] DAMAGECOUNT value on done: 409475.0 [2024-08-06 03:24:08,671][52659] Sum rewards: 55.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.985', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.168', 'AMMO3': '0.181', 'weapon4': '0.228', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.096', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '45.000'} [2024-08-06 03:24:09,030][52663] DAMAGECOUNT value on done: 401616.0 [2024-08-06 03:24:09,030][52663] Sum rewards: 59.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.066', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.114', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.304', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.254', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '52.000'} [2024-08-06 03:24:09,925][52666] DAMAGECOUNT value on done: 398957.0 [2024-08-06 03:24:09,925][52666] Sum rewards: 59.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.172', 'AMMO4': '0.192', 'AMMO3': '0.196', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.820', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '49.000'} [2024-08-06 03:24:10,092][52650] Updated weights for policy 0, policy_version 45491 (0.0017) [2024-08-06 03:24:11,349][52670] DAMAGECOUNT value on done: 398115.0 [2024-08-06 03:24:11,350][52670] Sum rewards: 76.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.125', 'weapon5': '0.164', 'weapon2': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 03:24:11,654][52659] DAMAGECOUNT value on done: 410896.0 [2024-08-06 03:24:11,655][52659] Sum rewards: 65.443, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.430', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '57.000'} [2024-08-06 03:24:12,043][52663] DAMAGECOUNT value on done: 406727.0 [2024-08-06 03:24:12,045][52663] Sum rewards: 70.261, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.182', 'weapon5': '0.194', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'HEALTH': '0.440', 'WEAPON3': '1.000', 'weapon3': '2.812', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '57.000'} [2024-08-06 03:24:12,405][52666] DAMAGECOUNT value on done: 396089.0 [2024-08-06 03:24:12,405][52666] Sum rewards: 61.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.130', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.128', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '52.000'} [2024-08-06 03:24:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 372703232. Throughput: 0: 4378.0. Samples: 93183870. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 03:24:12,795][52567] Avg episode reward: [(0, '69.614')] [2024-08-06 03:24:14,144][52670] DAMAGECOUNT value on done: 399780.0 [2024-08-06 03:24:14,149][52670] Sum rewards: 54.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.154', 'AMMO3': '0.179', 'AMMO4': '0.191', 'weapon5': '0.270', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.500', 'weapon3': '3.024', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '45.000'} [2024-08-06 03:24:14,647][52663] DAMAGECOUNT value on done: 411441.0 [2024-08-06 03:24:14,647][52663] Sum rewards: 74.753, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.902', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.384', 'WEAPON3': '1.700', 'weapon3': '3.062', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '64.000'} [2024-08-06 03:24:14,787][52659] DAMAGECOUNT value on done: 403710.0 [2024-08-06 03:24:14,792][52659] Sum rewards: 68.657, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.877', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.120', 'AMMO4': '0.142', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.362', 'weapon2': '0.554', 'WEAPON3': '0.850', 'weapon3': '2.714', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '52.000'} [2024-08-06 03:24:15,122][52650] Updated weights for policy 0, policy_version 45501 (0.0034) [2024-08-06 03:24:15,458][52666] DAMAGECOUNT value on done: 401417.0 [2024-08-06 03:24:15,460][52666] Sum rewards: 73.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.104', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon4': '0.248', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '58.000'} [2024-08-06 03:24:17,132][52670] DAMAGECOUNT value on done: 395119.0 [2024-08-06 03:24:17,132][52670] Sum rewards: 74.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.168', 'AMMO4': '0.169', 'AMMO3': '0.199', 'weapon2': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '61.000'} [2024-08-06 03:24:17,387][52663] DAMAGECOUNT value on done: 404771.0 [2024-08-06 03:24:17,388][52663] Sum rewards: 48.914, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.955', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon5': '0.154', 'AMMO3': '0.201', 'weapon2': '0.324', 'AMMO4': '0.327', 'WEAPON5': '0.550', 'WEAPON4': '0.800', 'weapon4': '0.844', 'WEAPON3': '1.300', 'weapon3': '2.390', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.083', 'FRAGCOUNT': '42.000'} [2024-08-06 03:24:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17481.7, 300 sec: 17494.8). Total num frames: 372785152. Throughput: 0: 4376.7. Samples: 93196950. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 03:24:17,802][52567] Avg episode reward: [(0, '69.121')] [2024-08-06 03:24:17,846][52659] DAMAGECOUNT value on done: 411091.0 [2024-08-06 03:24:17,847][52659] Sum rewards: 79.656, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.156', 'AMMO3': '0.157', 'weapon2': '0.168', 'AMMO4': '0.213', 'weapon5': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '62.000'} [2024-08-06 03:24:18,346][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:18,575][52666] DAMAGECOUNT value on done: 398761.0 [2024-08-06 03:24:18,575][52666] Sum rewards: 57.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.131', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.164', 'weapon5': '0.262', 'weapon4': '0.286', 'AMMO4': '0.314', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.484', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '46.000'} [2024-08-06 03:24:19,410][52650] Updated weights for policy 0, policy_version 45511 (0.0035) [2024-08-06 03:24:20,345][52663] DAMAGECOUNT value on done: 399774.0 [2024-08-06 03:24:20,346][52663] Sum rewards: 73.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.556', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.196', 'weapon5': '0.212', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '60.000'} [2024-08-06 03:24:20,567][52670] DAMAGECOUNT value on done: 405408.0 [2024-08-06 03:24:20,568][52670] Sum rewards: 67.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.151', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.380', 'weapon2': '0.676', 'WEAPON3': '0.950', 'weapon3': '2.484', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '54.000'} [2024-08-06 03:24:20,767][52659] DAMAGECOUNT value on done: 409308.0 [2024-08-06 03:24:20,767][52659] Sum rewards: 64.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.092', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.126', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.221', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '52.000'} [2024-08-06 03:24:21,914][52666] DAMAGECOUNT value on done: 408835.0 [2024-08-06 03:24:21,915][52666] Sum rewards: 76.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.995', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.188', 'AMMO4': '0.213', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'weapon4': '0.448', 'WEAPON3': '1.500', 'weapon3': '2.610', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '64.000'} [2024-08-06 03:24:22,067][52662] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:22,136][52667] DAMAGECOUNT value on done: 403909.0 [2024-08-06 03:24:22,139][52667] Sum rewards: 70.400, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.335', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.264', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.490', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '61.000'} [2024-08-06 03:24:22,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 372875264. Throughput: 0: 4373.1. Samples: 93223000. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 03:24:22,794][52567] Avg episode reward: [(0, '68.870')] [2024-08-06 03:24:23,083][52670] DAMAGECOUNT value on done: 396902.0 [2024-08-06 03:24:23,084][52670] Sum rewards: 55.906, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.334', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.180', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.622', 'weapon2': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.194', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '12.600', 'FRAGCOUNT': '46.000'} [2024-08-06 03:24:23,185][52663] DAMAGECOUNT value on done: 398864.0 [2024-08-06 03:24:23,188][52663] Sum rewards: 58.600, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.962', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.136', 'AMMO4': '0.196', 'weapon5': '0.244', 'AMMO3': '0.277', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.880', 'weapon3': '2.992', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '52.000'} [2024-08-06 03:24:24,206][52666] DAMAGECOUNT value on done: 405522.0 [2024-08-06 03:24:24,207][52666] Sum rewards: 81.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO2': '0.012', 'AMMO5': '0.016', 'weapon4': '0.032', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'weapon5': '0.188', 'AMMO3': '0.218', 'WEAPON5': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '66.500'} [2024-08-06 03:24:24,428][52650] Updated weights for policy 0, policy_version 45521 (0.0014) [2024-08-06 03:24:25,125][52667] DAMAGECOUNT value on done: 412206.0 [2024-08-06 03:24:25,126][52667] Sum rewards: 76.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.118', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.346', 'WEAPON3': '1.650', 'weapon3': '3.178', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '65.000'} [2024-08-06 03:24:25,869][52670] DAMAGECOUNT value on done: 398555.0 [2024-08-06 03:24:25,870][52670] Sum rewards: 62.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.550', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.098', 'weapon2': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon4': '0.314', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.264', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '55.000'} [2024-08-06 03:24:26,029][52663] DAMAGECOUNT value on done: 401416.0 [2024-08-06 03:24:26,031][52663] Sum rewards: 73.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.578', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.242', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '62.000'} [2024-08-06 03:24:27,040][52666] DAMAGECOUNT value on done: 400899.0 [2024-08-06 03:24:27,040][52666] Sum rewards: 70.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.922', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.114', 'weapon2': '0.194', 'AMMO3': '0.204', 'AMMO4': '0.223', 'weapon5': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 03:24:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 372965376. Throughput: 0: 4367.8. Samples: 93249190. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:24:27,803][52567] Avg episode reward: [(0, '68.288')] [2024-08-06 03:24:27,849][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045529_372973568.pth... [2024-08-06 03:24:27,990][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045015_368762880.pth [2024-08-06 03:24:28,221][52667] DAMAGECOUNT value on done: 404768.0 [2024-08-06 03:24:28,224][52667] Sum rewards: 79.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.282', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.038', 'weapon5': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.190', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '64.000'} [2024-08-06 03:24:28,616][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:28,778][52670] DAMAGECOUNT value on done: 407332.0 [2024-08-06 03:24:28,780][52670] Sum rewards: 68.203, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.259', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.186', 'AMMO3': '0.195', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 03:24:29,411][52663] DAMAGECOUNT value on done: 410653.0 [2024-08-06 03:24:29,413][52663] Sum rewards: 69.675, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.993', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon4': '0.078', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.494', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '59.000'} [2024-08-06 03:24:29,540][52650] Updated weights for policy 0, policy_version 45531 (0.0048) [2024-08-06 03:24:30,283][52666] DAMAGECOUNT value on done: 401613.0 [2024-08-06 03:24:30,285][52666] Sum rewards: 68.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.934', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon4': '0.182', 'weapon5': '0.220', 'AMMO3': '0.230', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '58.000'} [2024-08-06 03:24:30,334][52659] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:31,368][52667] DAMAGECOUNT value on done: 406733.0 [2024-08-06 03:24:31,368][52667] Sum rewards: 61.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.674', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.144', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.583', 'FRAGCOUNT': '51.000'} [2024-08-06 03:24:31,716][52670] DAMAGECOUNT value on done: 403190.0 [2024-08-06 03:24:31,719][52670] Sum rewards: 63.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.495', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.136', 'AMMO3': '0.175', 'AMMO4': '0.236', 'weapon5': '0.240', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '54.000'} [2024-08-06 03:24:32,535][52663] DAMAGECOUNT value on done: 401278.0 [2024-08-06 03:24:32,535][52663] Sum rewards: 67.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.178', 'AMMO3': '0.199', 'weapon5': '0.202', 'AMMO4': '0.232', 'weapon2': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.000'} [2024-08-06 03:24:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 373047296. Throughput: 0: 4360.0. Samples: 93262260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:24:32,794][52567] Avg episode reward: [(0, '67.996')] [2024-08-06 03:24:33,179][52666] DAMAGECOUNT value on done: 402952.0 [2024-08-06 03:24:33,179][52666] Sum rewards: 68.168, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.175', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.082', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.266', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 03:24:33,577][52650] Updated weights for policy 0, policy_version 45541 (0.0028) [2024-08-06 03:24:34,185][52667] DAMAGECOUNT value on done: 412503.0 [2024-08-06 03:24:34,186][52667] Sum rewards: 71.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.074', 'weapon2': '0.200', 'weapon5': '0.220', 'AMMO3': '0.222', 'AMMO4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.500'} [2024-08-06 03:24:34,512][52670] DAMAGECOUNT value on done: 387950.0 [2024-08-06 03:24:34,513][52670] Sum rewards: 57.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.386', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.166', 'AMMO3': '0.201', 'AMMO4': '0.230', 'weapon5': '0.230', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.054', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '47.000'} [2024-08-06 03:24:35,862][52666] DAMAGECOUNT value on done: 403402.0 [2024-08-06 03:24:35,870][52666] Sum rewards: 65.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.104', 'AMMO3': '0.206', 'AMMO4': '0.222', 'weapon5': '0.224', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.042', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '55.000'} [2024-08-06 03:24:35,904][52663] DAMAGECOUNT value on done: 407344.0 [2024-08-06 03:24:35,905][52663] Sum rewards: 66.769, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.924', 'AMMO5': '0.011', 'AMMO2': '0.080', 'weapon5': '0.200', 'AMMO3': '0.269', 'AMMO4': '0.398', 'WEAPON5': '0.400', 'weapon2': '0.412', 'weapon4': '0.542', 'WEAPON4': '0.800', 'WEAPON3': '1.650', 'weapon3': '2.512', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '57.000'} [2024-08-06 03:24:37,084][52670] DAMAGECOUNT value on done: 401648.0 [2024-08-06 03:24:37,085][52670] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon4': '0.210', 'AMMO3': '0.222', 'weapon2': '0.266', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '61.000'} [2024-08-06 03:24:37,353][52664] DAMAGECOUNT value on done: 420561.0 [2024-08-06 03:24:37,355][52664] Sum rewards: 64.834, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.587', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.052', 'AMMO4': '0.139', 'weapon5': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.700', 'weapon3': '3.040', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '57.000'} [2024-08-06 03:24:37,357][52667] DAMAGECOUNT value on done: 411629.0 [2024-08-06 03:24:37,361][52667] Sum rewards: 78.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.578', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.191', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '3.428', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '64.000'} [2024-08-06 03:24:37,795][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.1, 300 sec: 17495.4). Total num frames: 373137408. Throughput: 0: 4359.1. Samples: 93288420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:24:37,795][52567] Avg episode reward: [(0, '68.031')] [2024-08-06 03:24:38,413][52666] DAMAGECOUNT value on done: 393457.0 [2024-08-06 03:24:38,415][52666] Sum rewards: 65.307, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.414', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.064', 'weapon5': '0.136', 'weapon4': '0.272', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'AMMO4': '0.320', 'weapon2': '0.324', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '58.000'} [2024-08-06 03:24:38,649][52650] Updated weights for policy 0, policy_version 45551 (0.0015) [2024-08-06 03:24:38,725][52663] DAMAGECOUNT value on done: 406022.0 [2024-08-06 03:24:38,725][52663] Sum rewards: 68.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '59.000'} [2024-08-06 03:24:38,890][52668] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:39,261][52820] Large shaping reward 2.509 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0)] [2024-08-06 03:24:40,087][52670] DAMAGECOUNT value on done: 409259.0 [2024-08-06 03:24:40,090][52670] Sum rewards: 78.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.998', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.169', 'AMMO3': '0.209', 'weapon2': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '64.000'} [2024-08-06 03:24:40,316][52667] DAMAGECOUNT value on done: 411664.0 [2024-08-06 03:24:40,316][52667] Sum rewards: 64.251, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.136', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.308', 'weapon4': '0.370', 'WEAPON3': '0.950', 'weapon3': '3.014', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '51.000'} [2024-08-06 03:24:40,568][52664] DAMAGECOUNT value on done: 424687.0 [2024-08-06 03:24:40,568][52664] Sum rewards: 75.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.110', 'weapon5': '0.178', 'AMMO4': '0.195', 'AMMO3': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.550', 'weapon3': '2.846', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '63.000'} [2024-08-06 03:24:41,403][52663] DAMAGECOUNT value on done: 399842.0 [2024-08-06 03:24:41,411][52663] Sum rewards: 69.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.084', 'weapon4': '0.164', 'AMMO4': '0.178', 'weapon2': '0.208', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.308', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '59.000'} [2024-08-06 03:24:41,460][52666] DAMAGECOUNT value on done: 403474.0 [2024-08-06 03:24:41,462][52666] Sum rewards: 71.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.136', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '60.000'} [2024-08-06 03:24:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 373227520. Throughput: 0: 4356.9. Samples: 93314460. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:24:42,794][52567] Avg episode reward: [(0, '68.250')] [2024-08-06 03:24:42,799][52670] DAMAGECOUNT value on done: 400431.0 [2024-08-06 03:24:42,800][52670] Sum rewards: 77.659, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.491', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.320', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 03:24:43,259][52650] Updated weights for policy 0, policy_version 45561 (0.0022) [2024-08-06 03:24:43,323][52664] DAMAGECOUNT value on done: 426720.0 [2024-08-06 03:24:43,324][52664] Sum rewards: 65.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.240', 'weapon4': '0.246', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.280', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '55.000'} [2024-08-06 03:24:43,347][52667] DAMAGECOUNT value on done: 405327.0 [2024-08-06 03:24:43,347][52667] Sum rewards: 83.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.923', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.183', 'weapon2': '0.248', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '67.000'} [2024-08-06 03:24:45,490][52670] DAMAGECOUNT value on done: 403676.0 [2024-08-06 03:24:45,492][52670] Sum rewards: 70.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.878', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.107', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '59.000'} [2024-08-06 03:24:45,892][52664] DAMAGECOUNT value on done: 420185.0 [2024-08-06 03:24:45,893][52664] Sum rewards: 75.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.872', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.068', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '64.500'} [2024-08-06 03:24:46,529][52667] DAMAGECOUNT value on done: 407045.0 [2024-08-06 03:24:46,535][52667] Sum rewards: 62.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.755', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.092', 'weapon5': '0.198', 'AMMO3': '0.215', 'AMMO4': '0.250', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '54.000'} [2024-08-06 03:24:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 373309440. Throughput: 0: 4357.3. Samples: 93327470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:24:47,795][52567] Avg episode reward: [(0, '68.742')] [2024-08-06 03:24:47,818][52650] Updated weights for policy 0, policy_version 45571 (0.0026) [2024-08-06 03:24:48,692][52664] DAMAGECOUNT value on done: 422486.0 [2024-08-06 03:24:48,694][52664] Sum rewards: 73.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '62.000'} [2024-08-06 03:24:49,207][52667] DAMAGECOUNT value on done: 414887.0 [2024-08-06 03:24:49,210][52667] Sum rewards: 72.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.100', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon4': '0.160', 'AMMO3': '0.195', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '57.000'} [2024-08-06 03:24:51,392][52664] DAMAGECOUNT value on done: 419914.0 [2024-08-06 03:24:51,392][52664] Sum rewards: 67.803, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.735', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.146', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 03:24:51,555][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:52,274][52667] DAMAGECOUNT value on done: 403966.0 [2024-08-06 03:24:52,276][52667] Sum rewards: 67.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.888', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.126', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '57.000'} [2024-08-06 03:24:52,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 373391360. Throughput: 0: 4354.9. Samples: 93353750. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:24:52,794][52567] Avg episode reward: [(0, '68.872')] [2024-08-06 03:24:52,883][52650] Updated weights for policy 0, policy_version 45581 (0.0011) [2024-08-06 03:24:54,050][52664] DAMAGECOUNT value on done: 423069.0 [2024-08-06 03:24:54,054][52664] Sum rewards: 80.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.119', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.095', 'weapon5': '0.132', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '66.000'} [2024-08-06 03:24:54,328][52670] Large shaping reward 2.597 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.054, -18.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:24:55,309][52667] DAMAGECOUNT value on done: 409551.0 [2024-08-06 03:24:55,310][52667] Sum rewards: 62.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.101', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.140', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '53.000'} [2024-08-06 03:24:56,387][52664] DAMAGECOUNT value on done: 416044.0 [2024-08-06 03:24:56,387][52664] Sum rewards: 73.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.894', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.076', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '60.000'} [2024-08-06 03:24:57,139][52650] Updated weights for policy 0, policy_version 45591 (0.0013) [2024-08-06 03:24:57,213][52669] DAMAGECOUNT value on done: 411145.0 [2024-08-06 03:24:57,216][52669] Sum rewards: 84.866, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'HEALTH': '0.285', 'weapon2': '0.328', 'WEAPON3': '0.950', 'weapon3': '3.366', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '66.000'} [2024-08-06 03:24:57,250][52811] DAMAGECOUNT value on done: 390061.0 [2024-08-06 03:24:57,250][52811] Sum rewards: 66.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.120', 'AMMO4': '0.172', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '56.000'} [2024-08-06 03:24:57,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 373489664. Throughput: 0: 4358.5. Samples: 93380000. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 03:24:57,794][52567] Avg episode reward: [(0, '69.066')] [2024-08-06 03:24:58,279][52667] DAMAGECOUNT value on done: 409726.0 [2024-08-06 03:24:58,279][52667] Sum rewards: 75.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.182', 'AMMO3': '0.185', 'weapon2': '0.268', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '62.000'} [2024-08-06 03:24:58,530][52668] DAMAGECOUNT value on done: 404772.0 [2024-08-06 03:24:58,531][52668] Sum rewards: 82.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.322', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO3': '0.177', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.360', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '66.000'} [2024-08-06 03:24:58,844][52803] DAMAGECOUNT value on done: 379992.0 [2024-08-06 03:24:58,844][52803] Sum rewards: 62.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.846', 'AMMO5': '0.017', 'AMMO2': '0.061', 'AMMO3': '0.184', 'weapon5': '0.206', 'AMMO4': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.382', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.698', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '53.000'} [2024-08-06 03:24:59,122][52664] DAMAGECOUNT value on done: 426456.0 [2024-08-06 03:24:59,123][52664] Sum rewards: 62.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '52.000'} [2024-08-06 03:25:00,111][52669] DAMAGECOUNT value on done: 401482.0 [2024-08-06 03:25:00,111][52669] Sum rewards: 60.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.555', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.072', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.246', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.458', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:00,367][52811] DAMAGECOUNT value on done: 376661.0 [2024-08-06 03:25:00,368][52811] Sum rewards: 58.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.794', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO4': '0.160', 'weapon5': '0.176', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.920', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '49.000'} [2024-08-06 03:25:01,178][52667] DAMAGECOUNT value on done: 403661.0 [2024-08-06 03:25:01,178][52667] Sum rewards: 77.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.696', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.142', 'AMMO4': '0.171', 'weapon5': '0.202', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.709', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:01,310][52668] DAMAGECOUNT value on done: 410116.0 [2024-08-06 03:25:01,311][52668] Sum rewards: 70.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.267', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.132', 'weapon2': '0.202', 'AMMO4': '0.223', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:01,417][52820] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:25:01,705][52664] DAMAGECOUNT value on done: 418419.0 [2024-08-06 03:25:01,705][52664] Sum rewards: 68.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'weapon2': '0.492', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.256', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:01,951][52803] DAMAGECOUNT value on done: 376668.0 [2024-08-06 03:25:01,952][52803] Sum rewards: 61.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'weapon2': '0.182', 'AMMO3': '0.196', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.426', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:01,982][52650] Updated weights for policy 0, policy_version 45601 (0.0013) [2024-08-06 03:25:02,792][52669] DAMAGECOUNT value on done: 411801.0 [2024-08-06 03:25:02,793][52669] Sum rewards: 67.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.804', 'AMMO5': '0.019', 'ARMOR': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.150', 'weapon5': '0.222', 'AMMO4': '0.292', 'weapon4': '0.408', 'weapon2': '0.506', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.552', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 373579776. Throughput: 0: 4357.3. Samples: 93393030. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 03:25:02,794][52567] Avg episode reward: [(0, '68.876')] [2024-08-06 03:25:03,504][52811] DAMAGECOUNT value on done: 377188.0 [2024-08-06 03:25:03,506][52811] Sum rewards: 72.249, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.900', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.155', 'weapon4': '0.178', 'weapon5': '0.186', 'AMMO4': '0.189', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:03,637][52811] Large shaping reward 2.624 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.018000000000000002, -6.0), ('weapon5', 0.002)] [2024-08-06 03:25:03,892][52667] DAMAGECOUNT value on done: 411034.0 [2024-08-06 03:25:03,894][52667] Sum rewards: 63.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.376', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.200', 'weapon2': '0.218', 'AMMO4': '0.253', 'AMMO3': '0.254', 'weapon4': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '2.946', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:04,184][52668] DAMAGECOUNT value on done: 411114.0 [2024-08-06 03:25:04,184][52668] Sum rewards: 80.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:04,437][52664] DAMAGECOUNT value on done: 427538.0 [2024-08-06 03:25:04,437][52664] Sum rewards: 81.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.066', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.210', 'WEAPON3': '1.200', 'weapon3': '3.440', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:04,943][52803] DAMAGECOUNT value on done: 382811.0 [2024-08-06 03:25:04,943][52803] Sum rewards: 75.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.488', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.243', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:05,301][52647] DAMAGECOUNT value on done: 431217.0 [2024-08-06 03:25:05,301][52647] Sum rewards: 71.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.217', 'AMMO4': '0.218', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:05,924][52669] DAMAGECOUNT value on done: 405752.0 [2024-08-06 03:25:05,924][52669] Sum rewards: 79.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.414', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.254', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:06,437][52650] Updated weights for policy 0, policy_version 45611 (0.0036) [2024-08-06 03:25:06,632][52662] DAMAGECOUNT value on done: 412562.0 [2024-08-06 03:25:06,634][52662] Sum rewards: 56.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.268', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.176', 'AMMO3': '0.184', 'AMMO4': '0.234', 'weapon4': '0.314', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '47.000'} [2024-08-06 03:25:06,644][52811] DAMAGECOUNT value on done: 377951.0 [2024-08-06 03:25:06,645][52811] Sum rewards: 74.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.078', 'AMMO4': '0.107', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:06,725][52668] DAMAGECOUNT value on done: 411960.0 [2024-08-06 03:25:06,725][52667] DAMAGECOUNT value on done: 419007.0 [2024-08-06 03:25:06,725][52668] Sum rewards: 70.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.173', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO4': '0.204', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:06,726][52667] Sum rewards: 71.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.735', 'ARMOR': '0.012', 'AMMO5': '0.024', 'AMMO2': '0.060', 'AMMO3': '0.220', 'weapon4': '0.258', 'AMMO4': '0.300', 'weapon5': '0.308', 'weapon2': '0.328', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:06,875][52664] DAMAGECOUNT value on done: 423997.0 [2024-08-06 03:25:06,875][52664] Sum rewards: 70.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.096', 'weapon4': '0.108', 'AMMO3': '0.167', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.118', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:07,537][52647] DAMAGECOUNT value on done: 427628.0 [2024-08-06 03:25:07,537][52647] Sum rewards: 71.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.188', 'AMMO3': '0.210', 'weapon4': '0.236', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '61.000'} [2024-08-06 03:25:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 373653504. Throughput: 0: 4360.9. Samples: 93419240. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 03:25:07,794][52567] Avg episode reward: [(0, '69.370')] [2024-08-06 03:25:08,066][52803] DAMAGECOUNT value on done: 384801.0 [2024-08-06 03:25:08,066][52803] Sum rewards: 68.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.254', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:08,751][52669] DAMAGECOUNT value on done: 405990.0 [2024-08-06 03:25:08,751][52669] Sum rewards: 68.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.182', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.110', 'AMMO3': '0.204', 'weapon5': '0.234', 'AMMO4': '0.295', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:08,772][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:25:09,451][52667] DAMAGECOUNT value on done: 415415.0 [2024-08-06 03:25:09,451][52667] Sum rewards: 59.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.162', 'AMMO3': '0.181', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '48.000'} [2024-08-06 03:25:09,666][52668] DAMAGECOUNT value on done: 400496.0 [2024-08-06 03:25:09,666][52668] Sum rewards: 64.624, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.433', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.082', 'AMMO4': '0.166', 'weapon5': '0.204', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.700', 'weapon3': '3.034', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:09,735][52664] DAMAGECOUNT value on done: 431842.0 [2024-08-06 03:25:09,735][52664] Sum rewards: 80.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.154', 'AMMO3': '0.209', 'weapon4': '0.250', 'AMMO4': '0.269', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:09,757][52811] DAMAGECOUNT value on done: 379522.0 [2024-08-06 03:25:09,757][52811] Sum rewards: 59.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.040', 'AMMO5': '0.014', 'AMMO2': '0.069', 'weapon4': '0.092', 'weapon5': '0.196', 'AMMO3': '0.222', 'weapon2': '0.314', 'AMMO4': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.730', 'weapon3': '3.164', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:10,197][52662] DAMAGECOUNT value on done: 411860.0 [2024-08-06 03:25:10,197][52662] Sum rewards: 69.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.072', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.160', 'AMMO4': '0.206', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:10,680][52647] DAMAGECOUNT value on done: 428469.0 [2024-08-06 03:25:10,680][52647] Sum rewards: 59.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.922', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.142', 'weapon5': '0.158', 'AMMO4': '0.301', 'WEAPON5': '0.400', 'weapon4': '0.420', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.768', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '48.000'} [2024-08-06 03:25:11,071][52803] DAMAGECOUNT value on done: 385203.0 [2024-08-06 03:25:11,073][52803] Sum rewards: 72.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.268', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.130', 'AMMO4': '0.179', 'weapon5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:11,261][52650] Updated weights for policy 0, policy_version 45621 (0.0023) [2024-08-06 03:25:11,683][52669] DAMAGECOUNT value on done: 411186.0 [2024-08-06 03:25:11,685][52669] Sum rewards: 87.379, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.141', 'HEALTH': '0.243', 'weapon2': '0.480', 'WEAPON3': '0.900', 'weapon3': '3.226', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '68.000'} [2024-08-06 03:25:12,409][52668] DAMAGECOUNT value on done: 410835.0 [2024-08-06 03:25:12,412][52668] Sum rewards: 75.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.714', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.096', 'weapon5': '0.182', 'AMMO3': '0.194', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:12,568][52667] DAMAGECOUNT value on done: 411994.0 [2024-08-06 03:25:12,569][52667] Sum rewards: 65.728, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.162', 'weapon5': '0.174', 'AMMO3': '0.250', 'weapon2': '0.256', 'AMMO4': '0.257', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.100', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:12,796][52567] Fps is (10 sec: 17199.9, 60 sec: 17475.8, 300 sec: 17522.4). Total num frames: 373751808. Throughput: 0: 4359.4. Samples: 93445370. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 03:25:12,796][52567] Avg episode reward: [(0, '69.350')] [2024-08-06 03:25:12,859][52811] DAMAGECOUNT value on done: 385361.0 [2024-08-06 03:25:12,861][52811] Sum rewards: 69.356, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.106', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:12,928][52664] DAMAGECOUNT value on done: 424836.0 [2024-08-06 03:25:12,928][52664] Sum rewards: 71.167, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon4': '0.154', 'AMMO4': '0.186', 'weapon5': '0.186', 'AMMO3': '0.228', 'weapon2': '0.234', 'HEALTH': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.114', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:13,142][52662] DAMAGECOUNT value on done: 412096.0 [2024-08-06 03:25:13,144][52662] Sum rewards: 61.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.640', 'AMMO5': '0.024', 'AMMO2': '0.049', 'weapon5': '0.138', 'weapon4': '0.164', 'AMMO3': '0.226', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.400', 'weapon3': '2.716', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:13,835][52647] DAMAGECOUNT value on done: 436107.0 [2024-08-06 03:25:13,837][52647] Sum rewards: 75.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.686', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:14,188][52803] DAMAGECOUNT value on done: 372429.0 [2024-08-06 03:25:14,192][52803] Sum rewards: 82.600, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.400', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.132', 'weapon5': '0.174', 'AMMO4': '0.189', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon3': '2.900', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:14,521][52665] DAMAGECOUNT value on done: 399360.0 [2024-08-06 03:25:14,523][52665] Sum rewards: 64.775, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.990', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.192', 'AMMO3': '0.276', 'AMMO4': '0.295', 'weapon5': '0.312', 'weapon2': '0.360', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.756', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:14,729][52669] DAMAGECOUNT value on done: 408234.0 [2024-08-06 03:25:14,729][52669] Sum rewards: 76.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.130', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.126', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.234', 'WEAPON3': '1.250', 'weapon3': '3.350', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:14,876][52667] DAMAGECOUNT value on done: 405906.0 [2024-08-06 03:25:14,877][52667] Sum rewards: 76.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.592', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.188', 'weapon5': '0.198', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:15,333][52668] DAMAGECOUNT value on done: 410899.0 [2024-08-06 03:25:15,335][52668] Sum rewards: 86.135, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.136', 'weapon4': '0.140', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.528', 'FRAGCOUNT': '72.000'} [2024-08-06 03:25:15,559][52664] DAMAGECOUNT value on done: 428692.0 [2024-08-06 03:25:15,560][52664] Sum rewards: 83.617, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.970', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO4': '0.057', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '3.278', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:16,073][52650] Updated weights for policy 0, policy_version 45631 (0.0013) [2024-08-06 03:25:16,095][52811] DAMAGECOUNT value on done: 380138.0 [2024-08-06 03:25:16,096][52811] Sum rewards: 67.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.176', 'AMMO5': '0.003', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:16,326][52647] DAMAGECOUNT value on done: 433014.0 [2024-08-06 03:25:16,328][52647] Sum rewards: 78.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.060', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:16,352][52662] DAMAGECOUNT value on done: 402970.0 [2024-08-06 03:25:16,354][52662] Sum rewards: 74.483, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.024', 'weapon5': '0.046', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.148', 'AMMO3': '0.295', 'WEAPON3': '1.700', 'weapon3': '3.554', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:17,384][52803] DAMAGECOUNT value on done: 375820.0 [2024-08-06 03:25:17,386][52803] Sum rewards: 73.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.444', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.116', 'weapon4': '0.142', 'AMMO4': '0.198', 'AMMO3': '0.211', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:17,643][52667] DAMAGECOUNT value on done: 413831.0 [2024-08-06 03:25:17,645][52667] Sum rewards: 70.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.112', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.378', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:17,780][52665] DAMAGECOUNT value on done: 408820.0 [2024-08-06 03:25:17,780][52665] Sum rewards: 72.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.922', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.221', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:17,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 373833728. Throughput: 0: 4363.3. Samples: 93458610. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 03:25:17,795][52567] Avg episode reward: [(0, '70.668')] [2024-08-06 03:25:17,816][52658] DAMAGECOUNT value on done: 405851.0 [2024-08-06 03:25:17,816][52658] Sum rewards: 79.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.025', 'AMMO5': '0.019', 'AMMO2': '0.067', 'weapon4': '0.140', 'AMMO3': '0.216', 'weapon2': '0.260', 'weapon5': '0.292', 'AMMO4': '0.333', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:17,868][52664] DAMAGECOUNT value on done: 420821.0 [2024-08-06 03:25:17,868][52664] Sum rewards: 69.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.092', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:17,891][52669] DAMAGECOUNT value on done: 409049.0 [2024-08-06 03:25:17,892][52669] Sum rewards: 67.876, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.021', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon2': '0.208', 'weapon5': '0.218', 'weapon4': '0.260', 'AMMO3': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.962', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:18,179][52668] DAMAGECOUNT value on done: 403128.0 [2024-08-06 03:25:18,180][52668] Sum rewards: 83.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.648', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.040', 'AMMO4': '0.168', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '68.000'} [2024-08-06 03:25:18,791][52647] DAMAGECOUNT value on done: 431580.0 [2024-08-06 03:25:18,794][52647] Sum rewards: 71.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.556', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.438', 'ARMOR': '0.492', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:19,157][52660] DAMAGECOUNT value on done: 404774.0 [2024-08-06 03:25:19,157][52660] Sum rewards: 62.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.314', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.185', 'AMMO4': '0.197', 'weapon2': '0.228', 'weapon5': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.522', 'WEAPON3': '1.050', 'weapon3': '2.672', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '51.000'} [2024-08-06 03:25:19,251][52811] DAMAGECOUNT value on done: 380727.0 [2024-08-06 03:25:19,251][52811] Sum rewards: 73.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.292', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.150', 'weapon4': '0.168', 'weapon5': '0.230', 'AMMO4': '0.249', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.744', 'WEAPON3': '0.900', 'weapon3': '2.584', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:19,287][52662] DAMAGECOUNT value on done: 413097.0 [2024-08-06 03:25:19,287][52662] Sum rewards: 81.244, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.716', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.026', 'AMMO4': '0.033', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.396', 'WEAPON3': '1.100', 'weapon3': '3.338', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:20,331][52803] DAMAGECOUNT value on done: 375610.0 [2024-08-06 03:25:20,332][52803] Sum rewards: 64.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.060', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.122', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.224', 'weapon2': '0.530', 'WEAPON3': '0.800', 'weapon3': '2.888', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '50.000'} [2024-08-06 03:25:20,519][52658] DAMAGECOUNT value on done: 409116.0 [2024-08-06 03:25:20,519][52658] Sum rewards: 73.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.025', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.205', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:20,738][52664] DAMAGECOUNT value on done: 422311.0 [2024-08-06 03:25:20,740][52664] Sum rewards: 70.357, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.851', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.120', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.218', 'AMMO3': '0.285', 'WEAPON3': '1.750', 'weapon3': '3.256', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:20,775][52668] DAMAGECOUNT value on done: 406279.0 [2024-08-06 03:25:20,778][52668] Sum rewards: 57.885, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.167', 'weapon5': '0.206', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.728', 'WEAPON3': '1.050', 'weapon3': '2.534', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.573', 'FRAGCOUNT': '47.000'} [2024-08-06 03:25:20,823][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:25:20,861][52669] DAMAGECOUNT value on done: 412629.0 [2024-08-06 03:25:20,862][52669] Sum rewards: 65.311, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.670', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.118', 'AMMO4': '0.127', 'weapon5': '0.136', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.700', 'weapon3': '3.118', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:21,093][52650] Updated weights for policy 0, policy_version 45641 (0.0030) [2024-08-06 03:25:21,097][52665] DAMAGECOUNT value on done: 406520.0 [2024-08-06 03:25:21,101][52665] Sum rewards: 69.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.040', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.404', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:21,625][52647] DAMAGECOUNT value on done: 430208.0 [2024-08-06 03:25:21,625][52647] Sum rewards: 77.163, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.200', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.192', 'weapon5': '0.236', 'AMMO4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'weapon4': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:21,673][52660] DAMAGECOUNT value on done: 399896.0 [2024-08-06 03:25:21,674][52660] Sum rewards: 69.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:22,408][52662] DAMAGECOUNT value on done: 406174.0 [2024-08-06 03:25:22,408][52662] Sum rewards: 66.974, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.437', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon5': '0.094', 'weapon4': '0.108', 'AMMO4': '0.199', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:22,456][52811] DAMAGECOUNT value on done: 384488.0 [2024-08-06 03:25:22,457][52811] Sum rewards: 62.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.146', 'AMMO3': '0.182', 'weapon4': '0.184', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '51.000'} [2024-08-06 03:25:22,794][52567] Fps is (10 sec: 18025.9, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 373932032. Throughput: 0: 4365.6. Samples: 93484870. Policy #0 lag: (min: 0.0, avg: 2.9, max: 8.0) [2024-08-06 03:25:22,794][52567] Avg episode reward: [(0, '70.968')] [2024-08-06 03:25:23,398][52803] DAMAGECOUNT value on done: 382212.0 [2024-08-06 03:25:23,402][52803] Sum rewards: 74.113, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.780', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.170', 'weapon2': '0.188', 'weapon5': '0.206', 'AMMO4': '0.224', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.178', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:23,546][52669] DAMAGECOUNT value on done: 407547.0 [2024-08-06 03:25:23,549][52669] Sum rewards: 62.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.178', 'AMMO4': '0.196', 'AMMO3': '0.209', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '51.000'} [2024-08-06 03:25:23,653][52658] DAMAGECOUNT value on done: 414254.0 [2024-08-06 03:25:23,653][52658] Sum rewards: 75.847, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.140', 'weapon4': '0.146', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'HEALTH': '0.404', 'weapon2': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.814', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:23,733][52668] DAMAGECOUNT value on done: 410955.0 [2024-08-06 03:25:23,733][52668] Sum rewards: 73.119, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.883', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO4': '0.187', 'AMMO3': '0.195', 'weapon4': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:23,967][52664] DAMAGECOUNT value on done: 422343.0 [2024-08-06 03:25:23,969][52664] Sum rewards: 76.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon4': '0.188', 'weapon5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:24,059][52665] DAMAGECOUNT value on done: 401841.0 [2024-08-06 03:25:24,059][52665] Sum rewards: 76.617, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.060', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:24,831][52647] DAMAGECOUNT value on done: 424730.0 [2024-08-06 03:25:24,831][52647] Sum rewards: 71.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.076', 'weapon5': '0.168', 'AMMO4': '0.189', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.500', 'weapon3': '2.836', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:24,836][52660] DAMAGECOUNT value on done: 414508.0 [2024-08-06 03:25:24,838][52660] Sum rewards: 68.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.728', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:25,023][52662] DAMAGECOUNT value on done: 416436.0 [2024-08-06 03:25:25,025][52662] Sum rewards: 71.071, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.475', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.175', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.050', 'weapon3': '3.230', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:25,126][52650] Updated weights for policy 0, policy_version 45651 (0.0023) [2024-08-06 03:25:25,507][52811] DAMAGECOUNT value on done: 381552.0 [2024-08-06 03:25:25,509][52811] Sum rewards: 69.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.502', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:26,204][52669] DAMAGECOUNT value on done: 413807.0 [2024-08-06 03:25:26,205][52669] Sum rewards: 77.984, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.879', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.164', 'AMMO4': '0.186', 'weapon5': '0.206', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.842', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:26,576][52803] DAMAGECOUNT value on done: 374561.0 [2024-08-06 03:25:26,577][52803] Sum rewards: 62.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:26,777][52658] DAMAGECOUNT value on done: 411797.0 [2024-08-06 03:25:26,778][52658] Sum rewards: 74.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.182', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:26,909][52668] DAMAGECOUNT value on done: 409062.0 [2024-08-06 03:25:26,911][52668] Sum rewards: 76.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon4': '0.190', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:27,020][52665] DAMAGECOUNT value on done: 395584.0 [2024-08-06 03:25:27,021][52665] Sum rewards: 72.857, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.176', 'AMMO4': '0.260', 'weapon2': '0.350', 'weapon5': '0.356', 'weapon4': '0.512', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.492', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:27,269][52664] DAMAGECOUNT value on done: 419826.0 [2024-08-06 03:25:27,270][52664] Sum rewards: 61.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.950', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon4': '0.032', 'AMMO4': '0.063', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.228', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '52.000'} [2024-08-06 03:25:27,657][52660] DAMAGECOUNT value on done: 415754.0 [2024-08-06 03:25:27,658][52660] Sum rewards: 79.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.007', 'AMMO5': '0.027', 'AMMO2': '0.067', 'weapon4': '0.142', 'AMMO3': '0.202', 'AMMO4': '0.335', 'weapon5': '0.352', 'weapon2': '0.414', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 374005760. Throughput: 0: 4365.1. Samples: 93510890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:25:27,795][52567] Avg episode reward: [(0, '71.365')] [2024-08-06 03:25:27,797][52614] Saving new best policy, reward=71.365! [2024-08-06 03:25:27,911][52647] DAMAGECOUNT value on done: 436843.0 [2024-08-06 03:25:27,911][52647] Sum rewards: 69.039, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.278', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:28,110][52662] DAMAGECOUNT value on done: 417906.0 [2024-08-06 03:25:28,112][52662] Sum rewards: 70.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.102', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:28,765][52811] DAMAGECOUNT value on done: 379088.0 [2024-08-06 03:25:28,766][52811] Sum rewards: 71.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.525', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.110', 'AMMO3': '0.182', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:29,471][52669] DAMAGECOUNT value on done: 408035.0 [2024-08-06 03:25:29,473][52669] Sum rewards: 61.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.596', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.146', 'AMMO3': '0.188', 'AMMO4': '0.189', 'weapon2': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '51.000'} [2024-08-06 03:25:29,681][52668] DAMAGECOUNT value on done: 403367.0 [2024-08-06 03:25:29,684][52668] Sum rewards: 67.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.192', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.118', 'AMMO4': '0.149', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.168', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:29,810][52803] DAMAGECOUNT value on done: 385004.0 [2024-08-06 03:25:29,812][52803] Sum rewards: 66.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.016', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon2': '0.192', 'AMMO4': '0.196', 'weapon5': '0.216', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:29,821][52665] DAMAGECOUNT value on done: 397348.0 [2024-08-06 03:25:29,823][52665] Sum rewards: 79.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.400', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon4': '0.166', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:29,997][52658] DAMAGECOUNT value on done: 402916.0 [2024-08-06 03:25:29,998][52658] Sum rewards: 64.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.016', 'AMMO2': '0.071', 'AMMO3': '0.157', 'weapon5': '0.230', 'weapon4': '0.352', 'AMMO4': '0.353', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.644', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '51.000'} [2024-08-06 03:25:30,389][52664] DAMAGECOUNT value on done: 421304.0 [2024-08-06 03:25:30,390][52664] Sum rewards: 72.597, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.110', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.258', 'AMMO3': '0.279', 'WEAPON3': '1.750', 'HITCOUNT': '3.330', 'weapon3': '3.358', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:30,514][52650] Updated weights for policy 0, policy_version 45661 (0.0017) [2024-08-06 03:25:30,708][52660] DAMAGECOUNT value on done: 406623.0 [2024-08-06 03:25:30,708][52660] Sum rewards: 69.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.160', 'AMMO5': '0.016', 'AMMO2': '0.019', 'weapon4': '0.022', 'AMMO4': '0.092', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.156', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:30,994][52647] DAMAGECOUNT value on done: 427348.0 [2024-08-06 03:25:30,996][52647] Sum rewards: 61.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.053', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.240', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.448', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '51.000'} [2024-08-06 03:25:31,468][52662] DAMAGECOUNT value on done: 407536.0 [2024-08-06 03:25:31,469][52662] Sum rewards: 73.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.796', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.112', 'AMMO4': '0.198', 'weapon5': '0.234', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.750', 'weapon3': '2.948', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:31,856][52811] DAMAGECOUNT value on done: 390936.0 [2024-08-06 03:25:31,857][52811] Sum rewards: 67.799, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon5': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.147', 'HEALTH': '0.438', 'weapon2': '0.820', 'WEAPON3': '0.850', 'weapon3': '2.800', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '52.500'} [2024-08-06 03:25:32,285][52669] DAMAGECOUNT value on done: 401544.0 [2024-08-06 03:25:32,286][52669] Sum rewards: 63.813, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.054', 'AMMO3': '0.104', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon2': '0.638', 'WEAPON3': '0.800', 'HITCOUNT': '2.900', 'weapon3': '3.076', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '49.000'} [2024-08-06 03:25:32,406][52668] DAMAGECOUNT value on done: 399047.0 [2024-08-06 03:25:32,406][52668] Sum rewards: 58.437, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.275', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon4': '0.144', 'AMMO4': '0.194', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '52.000'} [2024-08-06 03:25:32,444][52665] DAMAGECOUNT value on done: 401666.0 [2024-08-06 03:25:32,445][52665] Sum rewards: 72.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.149', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.126', 'weapon4': '0.164', 'AMMO4': '0.194', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:32,748][52658] DAMAGECOUNT value on done: 407282.0 [2024-08-06 03:25:32,748][52658] Sum rewards: 64.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.124', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.188', 'AMMO4': '0.260', 'AMMO3': '0.274', 'weapon2': '0.304', 'WEAPON5': '0.350', 'weapon4': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.714', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 374095872. Throughput: 0: 4356.5. Samples: 93523510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:25:32,794][52567] Avg episode reward: [(0, '70.661')] [2024-08-06 03:25:32,975][52803] DAMAGECOUNT value on done: 381028.0 [2024-08-06 03:25:32,978][52803] Sum rewards: 80.757, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon5': '0.134', 'AMMO3': '0.163', 'weapon4': '0.196', 'weapon2': '0.222', 'AMMO4': '0.289', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:33,112][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:25:33,304][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 03:25:33,477][52660] DAMAGECOUNT value on done: 404808.0 [2024-08-06 03:25:33,479][52660] Sum rewards: 68.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.113', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:33,521][52647] DAMAGECOUNT value on done: 430958.0 [2024-08-06 03:25:33,523][52647] Sum rewards: 79.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.100', 'weapon5': '0.174', 'AMMO3': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:33,580][52795] DAMAGECOUNT value on done: 379344.0 [2024-08-06 03:25:33,581][52795] Sum rewards: 59.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.792', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.104', 'weapon5': '0.150', 'AMMO4': '0.218', 'AMMO3': '0.224', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.272', 'DAMAGECOUNT': '14.595', 'FRAGCOUNT': '52.000'} [2024-08-06 03:25:34,277][52671] DAMAGECOUNT value on done: 411953.0 [2024-08-06 03:25:34,281][52671] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.060', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.138', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.582', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '52.000'} [2024-08-06 03:25:34,560][52662] DAMAGECOUNT value on done: 419773.0 [2024-08-06 03:25:34,561][52662] Sum rewards: 79.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.498', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.122', 'weapon4': '0.124', 'AMMO4': '0.149', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:34,599][52650] Updated weights for policy 0, policy_version 45671 (0.0013) [2024-08-06 03:25:34,966][52811] DAMAGECOUNT value on done: 380061.0 [2024-08-06 03:25:34,966][52811] Sum rewards: 79.148, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.025', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'HEALTH': '0.184', 'weapon2': '0.436', 'WEAPON3': '1.000', 'weapon3': '3.304', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:35,206][52669] DAMAGECOUNT value on done: 412847.0 [2024-08-06 03:25:35,208][52669] Sum rewards: 77.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.115', 'weapon5': '0.134', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.184', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:35,360][52668] DAMAGECOUNT value on done: 400621.0 [2024-08-06 03:25:35,361][52668] Sum rewards: 81.580, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.016', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.182', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.474', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:35,505][52665] DAMAGECOUNT value on done: 406039.0 [2024-08-06 03:25:35,506][52665] Sum rewards: 60.896, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.023', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.142', 'weapon5': '0.226', 'AMMO4': '0.259', 'AMMO3': '0.273', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.986', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:35,745][52658] DAMAGECOUNT value on done: 410820.0 [2024-08-06 03:25:35,747][52658] Sum rewards: 69.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.676', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.168', 'weapon2': '0.200', 'AMMO4': '0.236', 'AMMO3': '0.254', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.056', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:35,787][52647] DAMAGECOUNT value on done: 422794.0 [2024-08-06 03:25:35,788][52647] Sum rewards: 75.722, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.824', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.123', 'AMMO3': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'weapon4': '0.438', 'WEAPON3': '0.850', 'weapon3': '2.914', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:36,178][52803] DAMAGECOUNT value on done: 381334.0 [2024-08-06 03:25:36,178][52803] Sum rewards: 78.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.158', 'AMMO5': '0.010', 'AMMO2': '0.035', 'WEAPON4': '0.150', 'weapon4': '0.164', 'weapon5': '0.172', 'AMMO4': '0.174', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:36,494][52660] DAMAGECOUNT value on done: 408584.0 [2024-08-06 03:25:36,495][52660] Sum rewards: 73.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.083', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:36,733][52795] DAMAGECOUNT value on done: 369552.0 [2024-08-06 03:25:36,734][52795] Sum rewards: 64.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.515', 'AMMO5': '0.024', 'AMMO2': '0.055', 'weapon4': '0.096', 'AMMO3': '0.176', 'weapon2': '0.274', 'AMMO4': '0.277', 'weapon5': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.010', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '52.500'} [2024-08-06 03:25:37,058][52662] DAMAGECOUNT value on done: 406154.0 [2024-08-06 03:25:37,060][52662] Sum rewards: 63.470, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.624', 'AMMO5': '0.020', 'AMMO2': '0.071', 'AMMO3': '0.204', 'weapon5': '0.224', 'weapon4': '0.246', 'AMMO4': '0.353', 'WEAPON5': '0.450', 'weapon2': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '55.000'} [2024-08-06 03:25:37,573][52671] DAMAGECOUNT value on done: 411796.0 [2024-08-06 03:25:37,574][52671] Sum rewards: 77.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.458', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 374185984. Throughput: 0: 4352.7. Samples: 93549620. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:25:37,794][52567] Avg episode reward: [(0, '71.089')] [2024-08-06 03:25:38,136][52669] DAMAGECOUNT value on done: 416062.0 [2024-08-06 03:25:38,144][52669] Sum rewards: 74.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.112', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.308', 'weapon4': '0.376', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '61.000'} [2024-08-06 03:25:38,148][52811] DAMAGECOUNT value on done: 379962.0 [2024-08-06 03:25:38,150][52811] Sum rewards: 77.903, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.128', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'HEALTH': '0.310', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:38,356][52658] DAMAGECOUNT value on done: 403123.0 [2024-08-06 03:25:38,357][52658] Sum rewards: 73.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.778', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.082', 'AMMO4': '0.163', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '61.000'} [2024-08-06 03:25:38,363][52668] DAMAGECOUNT value on done: 399238.0 [2024-08-06 03:25:38,366][52668] Sum rewards: 66.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.135', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.231', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:38,565][52665] DAMAGECOUNT value on done: 407657.0 [2024-08-06 03:25:38,565][52665] Sum rewards: 70.644, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.635', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.042', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.274', 'AMMO3': '0.286', 'weapon2': '0.344', 'WEAPON3': '1.700', 'weapon3': '3.082', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:38,665][52647] DAMAGECOUNT value on done: 428285.0 [2024-08-06 03:25:38,667][52647] Sum rewards: 77.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.891', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.100', 'weapon5': '0.124', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:39,202][52803] DAMAGECOUNT value on done: 384439.0 [2024-08-06 03:25:39,203][52803] Sum rewards: 76.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.068', 'weapon5': '0.164', 'AMMO3': '0.244', 'AMMO4': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:39,444][52660] DAMAGECOUNT value on done: 413715.0 [2024-08-06 03:25:39,445][52660] Sum rewards: 73.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.420', 'WEAPON3': '1.550', 'weapon3': '3.022', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:39,720][52650] Updated weights for policy 0, policy_version 45681 (0.0011) [2024-08-06 03:25:39,750][52662] DAMAGECOUNT value on done: 410284.0 [2024-08-06 03:25:39,750][52662] Sum rewards: 70.000, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.990', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.114', 'weapon5': '0.152', 'weapon2': '0.252', 'AMMO4': '0.274', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.170', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:39,825][52795] DAMAGECOUNT value on done: 369972.0 [2024-08-06 03:25:39,827][52795] Sum rewards: 79.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.116', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:40,130][52614] Signal inference workers to stop experience collection... (8250 times) [2024-08-06 03:25:40,131][52614] Signal inference workers to resume experience collection... (8250 times) [2024-08-06 03:25:40,185][52650] InferenceWorker_p0-w0: stopping experience collection (8250 times) [2024-08-06 03:25:40,185][52650] InferenceWorker_p0-w0: resuming experience collection (8250 times) [2024-08-06 03:25:40,572][52671] DAMAGECOUNT value on done: 410785.0 [2024-08-06 03:25:40,573][52671] Sum rewards: 67.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.995', 'AMMO5': '0.023', 'AMMO2': '0.060', 'AMMO3': '0.232', 'weapon4': '0.262', 'AMMO4': '0.300', 'weapon2': '0.300', 'weapon5': '0.342', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.674', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:40,983][52665] DAMAGECOUNT value on done: 403786.0 [2024-08-06 03:25:40,983][52665] Sum rewards: 70.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.098', 'weapon5': '0.170', 'AMMO4': '0.224', 'AMMO3': '0.235', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:41,233][52811] DAMAGECOUNT value on done: 382766.0 [2024-08-06 03:25:41,235][52811] Sum rewards: 63.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.239', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.068', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:41,280][52658] DAMAGECOUNT value on done: 416313.0 [2024-08-06 03:25:41,281][52658] Sum rewards: 67.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'weapon2': '0.224', 'AMMO3': '0.236', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:41,353][52669] DAMAGECOUNT value on done: 423108.0 [2024-08-06 03:25:41,353][52669] Sum rewards: 64.564, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.724', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.108', 'weapon2': '0.172', 'AMMO4': '0.198', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.424', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:41,386][52668] DAMAGECOUNT value on done: 405272.0 [2024-08-06 03:25:41,387][52668] Sum rewards: 74.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.315', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.094', 'WEAPON4': '0.100', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.268', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '61.000'} [2024-08-06 03:25:41,683][52647] DAMAGECOUNT value on done: 426402.0 [2024-08-06 03:25:41,684][52647] Sum rewards: 77.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.028', 'AMMO5': '0.013', 'AMMO2': '0.063', 'AMMO3': '0.190', 'weapon4': '0.192', 'weapon5': '0.202', 'weapon2': '0.226', 'AMMO4': '0.315', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:41,989][52794] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('ARMOR', -0.001, -1.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:25:42,241][52803] DAMAGECOUNT value on done: 378714.0 [2024-08-06 03:25:42,243][52803] Sum rewards: 64.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.000', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.148', 'weapon5': '0.158', 'weapon2': '0.222', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.262', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '55.000'} [2024-08-06 03:25:42,350][52660] DAMAGECOUNT value on done: 411205.0 [2024-08-06 03:25:42,351][52660] Sum rewards: 79.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon5': '0.220', 'AMMO3': '0.232', 'weapon4': '0.300', 'weapon2': '0.302', 'AMMO4': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:42,480][52662] DAMAGECOUNT value on done: 411779.0 [2024-08-06 03:25:42,481][52662] Sum rewards: 74.176, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.424', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 374267904. Throughput: 0: 4351.8. Samples: 93575830. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:25:42,794][52567] Avg episode reward: [(0, '71.478')] [2024-08-06 03:25:42,865][52614] Saving new best policy, reward=71.478! [2024-08-06 03:25:42,898][52795] DAMAGECOUNT value on done: 376885.0 [2024-08-06 03:25:42,899][52795] Sum rewards: 68.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.014', 'AMMO2': '0.063', 'weapon5': '0.202', 'AMMO3': '0.215', 'weapon2': '0.306', 'AMMO4': '0.315', 'weapon4': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '55.000'} [2024-08-06 03:25:43,470][52671] DAMAGECOUNT value on done: 410889.0 [2024-08-06 03:25:43,472][52671] Sum rewards: 80.859, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.112', 'weapon2': '0.134', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.492', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '67.000'} [2024-08-06 03:25:43,940][52665] DAMAGECOUNT value on done: 410123.0 [2024-08-06 03:25:43,941][52665] Sum rewards: 74.108, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.709', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.102', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.390', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:43,977][52658] DAMAGECOUNT value on done: 409250.0 [2024-08-06 03:25:43,977][52658] Sum rewards: 67.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.238', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.528', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:44,214][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:25:44,377][52669] DAMAGECOUNT value on done: 411297.0 [2024-08-06 03:25:44,377][52669] Sum rewards: 77.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.144', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:44,427][52668] DAMAGECOUNT value on done: 410054.0 [2024-08-06 03:25:44,427][52668] Sum rewards: 75.175, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.116', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.160', 'weapon5': '0.180', 'AMMO4': '0.202', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '64.000'} [2024-08-06 03:25:44,660][52811] DAMAGECOUNT value on done: 377167.0 [2024-08-06 03:25:44,661][52811] Sum rewards: 81.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.282', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon2': '0.152', 'AMMO3': '0.155', 'weapon5': '0.196', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.402', 'WEAPON3': '0.900', 'weapon3': '2.976', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:44,714][52650] Updated weights for policy 0, policy_version 45691 (0.0015) [2024-08-06 03:25:44,817][52647] DAMAGECOUNT value on done: 435453.0 [2024-08-06 03:25:44,817][52647] Sum rewards: 70.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.260', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:45,195][52660] DAMAGECOUNT value on done: 406367.0 [2024-08-06 03:25:45,197][52660] Sum rewards: 56.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.122', 'weapon5': '0.174', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.810', 'WEAPON3': '1.150', 'HITCOUNT': '2.570', 'weapon3': '2.702', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '48.000'} [2024-08-06 03:25:45,329][52803] DAMAGECOUNT value on done: 378593.0 [2024-08-06 03:25:45,331][52803] Sum rewards: 62.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.846', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.086', 'AMMO4': '0.196', 'weapon5': '0.218', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.550', 'weapon3': '2.898', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:45,668][52662] DAMAGECOUNT value on done: 416254.0 [2024-08-06 03:25:45,668][52662] Sum rewards: 82.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.131', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '67.000'} [2024-08-06 03:25:46,269][52795] DAMAGECOUNT value on done: 372925.0 [2024-08-06 03:25:46,271][52795] Sum rewards: 81.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.121', 'weapon5': '0.136', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '66.000'} [2024-08-06 03:25:46,329][52671] DAMAGECOUNT value on done: 417832.0 [2024-08-06 03:25:46,332][52671] Sum rewards: 76.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.434', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon4': '0.070', 'AMMO4': '0.156', 'weapon5': '0.176', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '61.000'} [2024-08-06 03:25:46,470][52665] DAMAGECOUNT value on done: 405250.0 [2024-08-06 03:25:46,470][52665] Sum rewards: 68.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.962', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO4': '0.214', 'AMMO3': '0.219', 'weapon5': '0.282', 'weapon4': '0.328', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.734', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:46,834][52668] DAMAGECOUNT value on done: 407214.0 [2024-08-06 03:25:46,836][52668] Sum rewards: 64.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.683', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.100', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.152', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:46,893][52658] DAMAGECOUNT value on done: 418852.0 [2024-08-06 03:25:46,895][52658] Sum rewards: 72.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.155', 'weapon4': '0.172', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:47,613][52647] DAMAGECOUNT value on done: 427241.0 [2024-08-06 03:25:47,613][52647] Sum rewards: 68.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.766', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.164', 'AMMO3': '0.227', 'AMMO4': '0.307', 'weapon2': '0.332', 'weapon4': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:47,626][52669] DAMAGECOUNT value on done: 412525.0 [2024-08-06 03:25:47,628][52669] Sum rewards: 70.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.227', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 374358016. Throughput: 0: 4344.9. Samples: 93588550. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:25:47,794][52567] Avg episode reward: [(0, '71.149')] [2024-08-06 03:25:47,817][52811] DAMAGECOUNT value on done: 381150.0 [2024-08-06 03:25:47,819][52811] Sum rewards: 61.133, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.591', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.108', 'weapon5': '0.162', 'AMMO4': '0.218', 'AMMO3': '0.286', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.034', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:47,862][52660] DAMAGECOUNT value on done: 417014.0 [2024-08-06 03:25:47,864][52660] Sum rewards: 74.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.012', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:48,301][52803] DAMAGECOUNT value on done: 386843.0 [2024-08-06 03:25:48,303][52803] Sum rewards: 65.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.049', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:48,906][52665] DAMAGECOUNT value on done: 401440.0 [2024-08-06 03:25:48,908][52665] Sum rewards: 75.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.046', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.264', 'weapon2': '0.590', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:48,996][52671] DAMAGECOUNT value on done: 408117.0 [2024-08-06 03:25:48,996][52671] Sum rewards: 70.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.145', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.139', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '57.500'} [2024-08-06 03:25:49,051][52662] DAMAGECOUNT value on done: 409067.0 [2024-08-06 03:25:49,051][52662] Sum rewards: 71.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.739', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.658', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:49,172][52650] Updated weights for policy 0, policy_version 45701 (0.0013) [2024-08-06 03:25:49,481][52795] DAMAGECOUNT value on done: 379573.0 [2024-08-06 03:25:49,482][52795] Sum rewards: 58.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.066', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.496', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '50.000'} [2024-08-06 03:25:49,628][52668] DAMAGECOUNT value on done: 412410.0 [2024-08-06 03:25:49,631][52668] Sum rewards: 82.164, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.852', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.169', 'AMMO4': '0.222', 'weapon5': '0.272', 'weapon2': '0.400', 'weapon4': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:50,013][52658] DAMAGECOUNT value on done: 400141.0 [2024-08-06 03:25:50,013][52658] Sum rewards: 61.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.060', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.192', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '50.000'} [2024-08-06 03:25:50,566][52660] DAMAGECOUNT value on done: 400577.0 [2024-08-06 03:25:50,569][52660] Sum rewards: 61.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.265', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.153', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:50,650][52669] DAMAGECOUNT value on done: 413746.0 [2024-08-06 03:25:50,651][52669] Sum rewards: 70.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.386', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:50,782][52647] DAMAGECOUNT value on done: 423682.0 [2024-08-06 03:25:50,783][52647] Sum rewards: 62.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.828', 'weapon7': '0.004', 'AMMO5': '0.009', 'ARMOR': '0.016', 'AMMO2': '0.050', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.116', 'AMMO4': '0.248', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.450', 'weapon4': '0.458', 'WEAPON3': '1.750', 'weapon3': '2.782', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:50,924][52811] DAMAGECOUNT value on done: 381800.0 [2024-08-06 03:25:50,924][52811] Sum rewards: 67.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.050', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.336', 'weapon4': '0.366', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '57.000'} [2024-08-06 03:25:51,453][52803] DAMAGECOUNT value on done: 384327.0 [2024-08-06 03:25:51,453][52803] Sum rewards: 77.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.060', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.230', 'WEAPON3': '1.250', 'weapon3': '3.474', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:51,539][52671] DAMAGECOUNT value on done: 416635.0 [2024-08-06 03:25:51,540][52671] Sum rewards: 63.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.220', 'weapon2': '0.294', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:51,548][52662] DAMAGECOUNT value on done: 419632.0 [2024-08-06 03:25:51,549][52662] Sum rewards: 60.382, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.949', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.062', 'weapon5': '0.174', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.056', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:51,578][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:25:51,971][52665] DAMAGECOUNT value on done: 401688.0 [2024-08-06 03:25:51,971][52665] Sum rewards: 68.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.645', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:52,164][52649] DAMAGECOUNT value on done: 395894.0 [2024-08-06 03:25:52,164][52649] Sum rewards: 70.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.098', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.154', 'weapon5': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'weapon2': '0.360', 'ARMOR': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.998', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '61.000'} [2024-08-06 03:25:52,545][52668] DAMAGECOUNT value on done: 405678.0 [2024-08-06 03:25:52,546][52668] Sum rewards: 83.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.274', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO3': '0.196', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '68.000'} [2024-08-06 03:25:52,700][52795] DAMAGECOUNT value on done: 385424.0 [2024-08-06 03:25:52,702][52795] Sum rewards: 68.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.906', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.110', 'weapon5': '0.170', 'AMMO3': '0.207', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 374439936. Throughput: 0: 4344.4. Samples: 93614740. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:25:52,794][52567] Avg episode reward: [(0, '70.833')] [2024-08-06 03:25:53,153][52658] DAMAGECOUNT value on done: 410572.0 [2024-08-06 03:25:53,154][52658] Sum rewards: 69.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.104', 'AMMO3': '0.180', 'AMMO4': '0.192', 'weapon5': '0.198', 'weapon2': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.134', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '55.000'} [2024-08-06 03:25:53,484][52669] DAMAGECOUNT value on done: 415385.0 [2024-08-06 03:25:53,493][52669] Sum rewards: 81.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.413', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.137', 'weapon2': '0.170', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '69.000'} [2024-08-06 03:25:53,638][52660] DAMAGECOUNT value on done: 403725.0 [2024-08-06 03:25:53,640][52660] Sum rewards: 73.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.121', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '59.500'} [2024-08-06 03:25:53,646][52794] DAMAGECOUNT value on done: 410767.0 [2024-08-06 03:25:53,647][52794] Sum rewards: 67.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.108', 'AMMO3': '0.199', 'weapon5': '0.286', 'AMMO4': '0.295', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '55.500'} [2024-08-06 03:25:53,701][52647] DAMAGECOUNT value on done: 424795.0 [2024-08-06 03:25:53,701][52647] Sum rewards: 77.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:53,925][52650] Updated weights for policy 0, policy_version 45711 (0.0023) [2024-08-06 03:25:53,960][52811] DAMAGECOUNT value on done: 380526.0 [2024-08-06 03:25:53,963][52811] Sum rewards: 75.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.238', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:54,175][52671] DAMAGECOUNT value on done: 412461.0 [2024-08-06 03:25:54,175][52671] Sum rewards: 74.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.034', 'weapon4': '0.038', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.540', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:54,534][52662] DAMAGECOUNT value on done: 413149.0 [2024-08-06 03:25:54,535][52662] Sum rewards: 56.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.303', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.156', 'weapon4': '0.186', 'AMMO4': '0.206', 'WEAPON4': '0.400', 'weapon5': '0.418', 'WEAPON5': '0.550', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.508', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '44.500'} [2024-08-06 03:25:54,599][52803] DAMAGECOUNT value on done: 383053.0 [2024-08-06 03:25:54,600][52803] Sum rewards: 67.433, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.026', 'AMMO2': '0.062', 'AMMO3': '0.140', 'weapon4': '0.152', 'AMMO4': '0.309', 'weapon5': '0.318', 'weapon2': '0.426', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.830', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '53.500'} [2024-08-06 03:25:55,193][52665] DAMAGECOUNT value on done: 406488.0 [2024-08-06 03:25:55,193][52665] Sum rewards: 67.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.874', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.120', 'AMMO3': '0.174', 'AMMO4': '0.198', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:55,363][52649] DAMAGECOUNT value on done: 392641.0 [2024-08-06 03:25:55,365][52649] Sum rewards: 63.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'AMMO5': '0.004', 'AMMO2': '0.035', 'weapon5': '0.048', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.176', 'weapon2': '0.242', 'AMMO3': '0.273', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.400', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 03:25:55,958][52795] DAMAGECOUNT value on done: 380886.0 [2024-08-06 03:25:55,958][52795] Sum rewards: 75.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.046', 'weapon5': '0.102', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '62.000'} [2024-08-06 03:25:56,116][52658] DAMAGECOUNT value on done: 404747.0 [2024-08-06 03:25:56,116][52658] Sum rewards: 60.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.038', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.108', 'weapon5': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.208', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '53.000'} [2024-08-06 03:25:56,269][52647] DAMAGECOUNT value on done: 424945.0 [2024-08-06 03:25:56,272][52647] Sum rewards: 91.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.090', 'weapon5': '0.148', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '23.163', 'FRAGCOUNT': '75.000'} [2024-08-06 03:25:56,307][52660] DAMAGECOUNT value on done: 417765.0 [2024-08-06 03:25:56,308][52660] Sum rewards: 76.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.114', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.116', 'weapon5': '0.180', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:56,730][52671] DAMAGECOUNT value on done: 407138.0 [2024-08-06 03:25:56,731][52671] Sum rewards: 70.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.315', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.147', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.282', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '58.000'} [2024-08-06 03:25:56,863][52794] DAMAGECOUNT value on done: 414893.0 [2024-08-06 03:25:56,863][52794] Sum rewards: 79.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.465', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.116', 'AMMO4': '0.194', 'AMMO3': '0.205', 'weapon2': '0.226', 'weapon5': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '65.000'} [2024-08-06 03:25:56,986][52811] DAMAGECOUNT value on done: 380984.0 [2024-08-06 03:25:56,987][52811] Sum rewards: 60.639, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.805', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon2': '0.154', 'weapon4': '0.186', 'AMMO3': '0.202', 'AMMO4': '0.232', 'weapon5': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.600', 'weapon3': '3.090', 'DAMAGECOUNT': '13.689', 'FRAGCOUNT': '52.000'} [2024-08-06 03:25:57,628][52662] DAMAGECOUNT value on done: 410042.0 [2024-08-06 03:25:57,628][52662] Sum rewards: 58.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.186', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.286', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '49.000'} [2024-08-06 03:25:57,691][52803] DAMAGECOUNT value on done: 378544.0 [2024-08-06 03:25:57,692][52803] Sum rewards: 67.391, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.136', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.140', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.318', 'weapon2': '0.552', 'WEAPON3': '1.850', 'weapon3': '2.908', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '60.000'} [2024-08-06 03:25:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 374530048. Throughput: 0: 4344.6. Samples: 93640870. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 03:25:57,795][52567] Avg episode reward: [(0, '70.966')] [2024-08-06 03:25:58,047][52665] DAMAGECOUNT value on done: 403672.0 [2024-08-06 03:25:58,049][52665] Sum rewards: 68.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.440', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.184', 'AMMO4': '0.205', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.650', 'weapon3': '2.872', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '59.000'} [2024-08-06 03:25:58,203][52649] DAMAGECOUNT value on done: 399606.0 [2024-08-06 03:25:58,203][52649] Sum rewards: 62.159, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.568', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon4': '0.200', 'weapon5': '0.218', 'weapon2': '0.258', 'AMMO3': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.850', 'weapon3': '2.990', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '56.000'} [2024-08-06 03:25:58,357][52650] Updated weights for policy 0, policy_version 45721 (0.0024) [2024-08-06 03:25:59,043][52658] DAMAGECOUNT value on done: 405497.0 [2024-08-06 03:25:59,043][52658] Sum rewards: 63.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.366', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.176', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '54.000'} [2024-08-06 03:25:59,070][52795] DAMAGECOUNT value on done: 368693.0 [2024-08-06 03:25:59,071][52795] Sum rewards: 70.022, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon5': '0.114', 'AMMO3': '0.167', 'weapon2': '0.172', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '56.500'} [2024-08-06 03:25:59,209][52647] DAMAGECOUNT value on done: 425902.0 [2024-08-06 03:25:59,210][52647] Sum rewards: 60.757, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.056', 'AMMO3': '0.179', 'weapon5': '0.266', 'AMMO4': '0.279', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '49.000'} [2024-08-06 03:25:59,304][52671] DAMAGECOUNT value on done: 415059.0 [2024-08-06 03:25:59,305][52671] Sum rewards: 63.050, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.485', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.160', 'AMMO3': '0.169', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '2.832', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '52.000'} [2024-08-06 03:25:59,342][52660] DAMAGECOUNT value on done: 421669.0 [2024-08-06 03:25:59,342][52660] Sum rewards: 75.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.407', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.049', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.396', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '63.000'} [2024-08-06 03:25:59,821][52794] DAMAGECOUNT value on done: 411186.0 [2024-08-06 03:25:59,821][52794] Sum rewards: 78.273, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.137', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'weapon2': '0.342', 'WEAPON3': '1.000', 'weapon3': '2.904', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '62.000'} [2024-08-06 03:26:00,420][52662] DAMAGECOUNT value on done: 406329.0 [2024-08-06 03:26:00,421][52662] Sum rewards: 67.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.487', 'AMMO5': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.188', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.562', 'WEAPON3': '1.450', 'weapon3': '2.638', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:00,830][52665] DAMAGECOUNT value on done: 399207.0 [2024-08-06 03:26:00,835][52665] Sum rewards: 67.510, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.886', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.159', 'AMMO4': '0.176', 'weapon5': '0.194', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON5': '0.400', 'weapon2': '0.512', 'WEAPON3': '0.950', 'weapon3': '2.630', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '54.000'} [2024-08-06 03:26:00,868][52649] DAMAGECOUNT value on done: 396440.0 [2024-08-06 03:26:00,869][52649] Sum rewards: 68.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.317', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.190', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '56.000'} [2024-08-06 03:26:01,883][52658] DAMAGECOUNT value on done: 402513.0 [2024-08-06 03:26:01,883][52658] Sum rewards: 67.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '58.000'} [2024-08-06 03:26:02,136][52671] DAMAGECOUNT value on done: 418541.0 [2024-08-06 03:26:02,138][52671] Sum rewards: 67.912, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.156', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon5': '0.148', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.228', 'weapon2': '0.418', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '53.500'} [2024-08-06 03:26:02,290][52795] DAMAGECOUNT value on done: 384183.0 [2024-08-06 03:26:02,290][52795] Sum rewards: 66.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO3': '0.172', 'AMMO4': '0.172', 'weapon4': '0.228', 'weapon2': '0.232', 'weapon5': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '2.892', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '54.000'} [2024-08-06 03:26:02,429][52660] DAMAGECOUNT value on done: 403150.0 [2024-08-06 03:26:02,429][52660] Sum rewards: 71.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.874', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '58.000'} [2024-08-06 03:26:02,465][52794] DAMAGECOUNT value on done: 407391.0 [2024-08-06 03:26:02,466][52794] Sum rewards: 66.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.044', 'AMMO4': '0.141', 'weapon2': '0.150', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.420', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:02,540][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:26:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 374611968. Throughput: 0: 4338.2. Samples: 93653830. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 03:26:02,795][52567] Avg episode reward: [(0, '70.551')] [2024-08-06 03:26:03,143][52650] Updated weights for policy 0, policy_version 45731 (0.0026) [2024-08-06 03:26:03,241][52662] DAMAGECOUNT value on done: 403938.0 [2024-08-06 03:26:03,242][52662] Sum rewards: 60.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.078', 'weapon4': '0.108', 'AMMO4': '0.180', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.260', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '50.000'} [2024-08-06 03:26:04,077][52665] DAMAGECOUNT value on done: 401209.0 [2024-08-06 03:26:04,078][52665] Sum rewards: 76.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.102', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.132', 'AMMO4': '0.200', 'AMMO3': '0.227', 'weapon4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '64.000'} [2024-08-06 03:26:04,096][52649] DAMAGECOUNT value on done: 388141.0 [2024-08-06 03:26:04,096][52649] Sum rewards: 65.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.093', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.266', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.328', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '55.000'} [2024-08-06 03:26:04,623][52658] DAMAGECOUNT value on done: 416522.0 [2024-08-06 03:26:04,624][52658] Sum rewards: 76.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.042', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.256', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 03:26:04,954][52671] DAMAGECOUNT value on done: 408824.0 [2024-08-06 03:26:04,956][52671] Sum rewards: 73.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.825', 'AMMO5': '0.024', 'AMMO2': '0.072', 'weapon4': '0.238', 'AMMO3': '0.254', 'weapon2': '0.286', 'weapon5': '0.324', 'AMMO4': '0.361', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.764', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '61.000'} [2024-08-06 03:26:05,312][52660] DAMAGECOUNT value on done: 407501.0 [2024-08-06 03:26:05,312][52660] Sum rewards: 64.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.410', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.071', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.674', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '53.000'} [2024-08-06 03:26:05,461][52795] DAMAGECOUNT value on done: 375740.0 [2024-08-06 03:26:05,461][52795] Sum rewards: 63.939, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.286', 'WEAPON3': '1.650', 'weapon3': '3.350', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '55.000'} [2024-08-06 03:26:05,780][52794] DAMAGECOUNT value on done: 405094.0 [2024-08-06 03:26:05,781][52794] Sum rewards: 77.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.203', 'weapon2': '0.224', 'WEAPON3': '1.200', 'HITCOUNT': '3.400', 'weapon3': '3.614', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '64.000'} [2024-08-06 03:26:06,943][52665] DAMAGECOUNT value on done: 402657.0 [2024-08-06 03:26:06,943][52665] Sum rewards: 62.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon2': '0.234', 'AMMO3': '0.237', 'weapon5': '0.240', 'weapon4': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '52.000'} [2024-08-06 03:26:07,001][52649] DAMAGECOUNT value on done: 400227.0 [2024-08-06 03:26:07,002][52649] Sum rewards: 68.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.906', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.186', 'AMMO3': '0.204', 'weapon2': '0.212', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:07,778][52671] DAMAGECOUNT value on done: 418434.0 [2024-08-06 03:26:07,779][52671] Sum rewards: 70.219, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.784', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.106', 'AMMO4': '0.124', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.278', 'WEAPON3': '1.650', 'weapon3': '3.232', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '62.000'} [2024-08-06 03:26:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 374702080. Throughput: 0: 4330.7. Samples: 93679750. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 03:26:07,794][52567] Avg episode reward: [(0, '70.191')] [2024-08-06 03:26:07,881][52658] DAMAGECOUNT value on done: 407395.0 [2024-08-06 03:26:07,881][52658] Sum rewards: 62.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.988', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.262', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.536', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '53.000'} [2024-08-06 03:26:08,173][52650] Updated weights for policy 0, policy_version 45741 (0.0022) [2024-08-06 03:26:08,713][52795] DAMAGECOUNT value on done: 377160.0 [2024-08-06 03:26:08,713][52795] Sum rewards: 79.098, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO4': '0.177', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.320', 'WEAPON3': '1.800', 'weapon3': '3.208', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '69.000'} [2024-08-06 03:26:08,875][52660] DAMAGECOUNT value on done: 403598.0 [2024-08-06 03:26:08,878][52660] Sum rewards: 62.606, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.768', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.076', 'AMMO4': '0.191', 'weapon5': '0.192', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '54.500'} [2024-08-06 03:26:09,062][52794] DAMAGECOUNT value on done: 411240.0 [2024-08-06 03:26:09,063][52794] Sum rewards: 78.009, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO3': '0.183', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.526', 'HEALTH': '0.875', 'WEAPON3': '1.000', 'weapon3': '2.776', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.000'} [2024-08-06 03:26:10,111][52665] DAMAGECOUNT value on done: 405626.0 [2024-08-06 03:26:10,114][52665] Sum rewards: 72.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.222', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.172', 'AMMO3': '0.211', 'AMMO4': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '60.000'} [2024-08-06 03:26:10,250][52649] DAMAGECOUNT value on done: 393989.0 [2024-08-06 03:26:10,251][52649] Sum rewards: 77.057, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.104', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.306', 'weapon2': '0.426', 'WEAPON3': '1.800', 'weapon3': '3.012', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '66.000'} [2024-08-06 03:26:10,356][52671] DAMAGECOUNT value on done: 409604.0 [2024-08-06 03:26:10,359][52671] Sum rewards: 57.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.840', 'AMMO2': '0.003', 'AMMO4': '0.015', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon4': '0.376', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '50.000'} [2024-08-06 03:26:11,050][52658] DAMAGECOUNT value on done: 410507.0 [2024-08-06 03:26:11,051][52658] Sum rewards: 65.196, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.381', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.149', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.678', 'WEAPON3': '0.900', 'weapon3': '2.762', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '51.000'} [2024-08-06 03:26:11,710][52660] DAMAGECOUNT value on done: 408610.0 [2024-08-06 03:26:11,712][52660] Sum rewards: 63.034, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'AMMO4': '0.150', 'weapon2': '0.514', 'WEAPON3': '0.900', 'HITCOUNT': '2.700', 'weapon3': '3.204', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '51.000'} [2024-08-06 03:26:11,844][52795] DAMAGECOUNT value on done: 372463.0 [2024-08-06 03:26:11,844][52795] Sum rewards: 82.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.058', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.358', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '68.000'} [2024-08-06 03:26:12,117][52794] DAMAGECOUNT value on done: 415062.0 [2024-08-06 03:26:12,119][52794] Sum rewards: 73.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.090', 'AMMO4': '0.144', 'weapon5': '0.184', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '63.000'} [2024-08-06 03:26:12,550][52650] Updated weights for policy 0, policy_version 45751 (0.0019) [2024-08-06 03:26:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17340.3, 300 sec: 17467.0). Total num frames: 374792192. Throughput: 0: 4334.7. Samples: 93705950. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 03:26:12,794][52567] Avg episode reward: [(0, '70.067')] [2024-08-06 03:26:13,075][52649] DAMAGECOUNT value on done: 402031.0 [2024-08-06 03:26:13,077][52649] Sum rewards: 59.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.850', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.162', 'AMMO3': '0.229', 'AMMO4': '0.238', 'weapon4': '0.242', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.004', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '51.000'} [2024-08-06 03:26:13,591][52671] DAMAGECOUNT value on done: 402186.0 [2024-08-06 03:26:13,591][52671] Sum rewards: 63.819, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.314', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon4': '0.116', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'weapon2': '0.408', 'WEAPON3': '1.600', 'weapon3': '3.076', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '56.000'} [2024-08-06 03:26:14,369][52660] DAMAGECOUNT value on done: 404229.0 [2024-08-06 03:26:14,369][52660] Sum rewards: 66.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.194', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.158', 'AMMO3': '0.189', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '54.000'} [2024-08-06 03:26:14,433][52658] DAMAGECOUNT value on done: 413621.0 [2024-08-06 03:26:14,434][52658] Sum rewards: 60.026, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.450', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon5': '0.216', 'weapon2': '0.248', 'AMMO3': '0.252', 'AMMO4': '0.303', 'weapon4': '0.432', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '54.000'} [2024-08-06 03:26:14,970][52795] DAMAGECOUNT value on done: 380846.0 [2024-08-06 03:26:14,970][52795] Sum rewards: 58.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.272', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '49.000'} [2024-08-06 03:26:15,034][52794] DAMAGECOUNT value on done: 405705.0 [2024-08-06 03:26:15,034][52794] Sum rewards: 63.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.992', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.205', 'weapon4': '0.208', 'AMMO4': '0.228', 'weapon5': '0.244', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '52.000'} [2024-08-06 03:26:16,267][52649] DAMAGECOUNT value on done: 402203.0 [2024-08-06 03:26:16,267][52649] Sum rewards: 74.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.702', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.164', 'weapon2': '0.178', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '60.000'} [2024-08-06 03:26:16,323][52671] DAMAGECOUNT value on done: 417543.0 [2024-08-06 03:26:16,323][52671] Sum rewards: 70.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.515', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.192', 'weapon4': '0.206', 'AMMO3': '0.245', 'AMMO4': '0.289', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.002', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '61.000'} [2024-08-06 03:26:17,743][52650] Updated weights for policy 0, policy_version 45761 (0.0014) [2024-08-06 03:26:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 374874112. Throughput: 0: 4342.9. Samples: 93718940. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 03:26:17,794][52567] Avg episode reward: [(0, '69.357')] [2024-08-06 03:26:17,997][52794] DAMAGECOUNT value on done: 414761.0 [2024-08-06 03:26:17,998][52794] Sum rewards: 66.141, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.524', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.108', 'AMMO4': '0.244', 'AMMO3': '0.259', 'weapon2': '0.278', 'weapon5': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.964', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:18,138][52795] DAMAGECOUNT value on done: 369613.0 [2024-08-06 03:26:18,139][52795] Sum rewards: 68.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.088', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.334', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '56.000'} [2024-08-06 03:26:19,182][52671] DAMAGECOUNT value on done: 416206.0 [2024-08-06 03:26:19,185][52671] Sum rewards: 59.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.465', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon4': '0.192', 'AMMO3': '0.210', 'weapon5': '0.244', 'AMMO4': '0.342', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon2': '1.090', 'WEAPON3': '1.300', 'weapon3': '2.256', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '48.000'} [2024-08-06 03:26:19,240][52649] DAMAGECOUNT value on done: 395544.0 [2024-08-06 03:26:19,242][52649] Sum rewards: 78.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.082', 'weapon5': '0.088', 'AMMO4': '0.169', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '63.000'} [2024-08-06 03:26:20,613][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:26:21,200][52795] DAMAGECOUNT value on done: 387624.0 [2024-08-06 03:26:21,200][52795] Sum rewards: 78.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.385', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.090', 'AMMO4': '0.214', 'AMMO3': '0.216', 'weapon5': '0.222', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '65.000'} [2024-08-06 03:26:21,205][52794] DAMAGECOUNT value on done: 410510.0 [2024-08-06 03:26:21,206][52794] Sum rewards: 71.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.692', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.112', 'AMMO4': '0.168', 'weapon5': '0.184', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '59.000'} [2024-08-06 03:26:21,775][52650] Updated weights for policy 0, policy_version 45771 (0.0011) [2024-08-06 03:26:22,331][52671] DAMAGECOUNT value on done: 418173.0 [2024-08-06 03:26:22,331][52671] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.022', 'AMMO2': '0.065', 'AMMO3': '0.174', 'weapon5': '0.220', 'weapon4': '0.262', 'AMMO4': '0.323', 'weapon2': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '57.500'} [2024-08-06 03:26:22,538][52649] DAMAGECOUNT value on done: 401335.0 [2024-08-06 03:26:22,539][52649] Sum rewards: 71.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.011', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.061', 'weapon4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '58.000'} [2024-08-06 03:26:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 374964224. Throughput: 0: 4348.0. Samples: 93745280. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 03:26:22,794][52567] Avg episode reward: [(0, '69.131')] [2024-08-06 03:26:23,768][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:26:23,802][52794] DAMAGECOUNT value on done: 406465.0 [2024-08-06 03:26:23,804][52794] Sum rewards: 66.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.327', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.201', 'weapon2': '0.252', 'AMMO4': '0.309', 'weapon5': '0.394', 'weapon4': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.658', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '53.000'} [2024-08-06 03:26:24,312][52820] DAMAGECOUNT value on done: 374468.0 [2024-08-06 03:26:24,312][52820] Sum rewards: 69.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.454', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.225', 'weapon2': '0.306', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.528', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '59.000'} [2024-08-06 03:26:24,334][52795] DAMAGECOUNT value on done: 381115.0 [2024-08-06 03:26:24,335][52795] Sum rewards: 65.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.215', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.106', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.312', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '55.000'} [2024-08-06 03:26:25,083][52671] DAMAGECOUNT value on done: 412137.0 [2024-08-06 03:26:25,083][52671] Sum rewards: 61.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.448', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '52.000'} [2024-08-06 03:26:25,437][52649] DAMAGECOUNT value on done: 402868.0 [2024-08-06 03:26:25,437][52649] Sum rewards: 45.757, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.568', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.220', 'weapon7': '0.222', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.652', 'WEAPON3': '1.300', 'HITCOUNT': '2.290', 'weapon3': '2.522', 'DAMAGECOUNT': '11.550', 'FRAGCOUNT': '41.000'} [2024-08-06 03:26:26,518][52794] DAMAGECOUNT value on done: 413016.0 [2024-08-06 03:26:26,520][52794] Sum rewards: 60.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.165', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.054', 'AMMO4': '0.152', 'weapon5': '0.152', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.820', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '50.000'} [2024-08-06 03:26:26,828][52650] Updated weights for policy 0, policy_version 45781 (0.0036) [2024-08-06 03:26:27,303][52820] DAMAGECOUNT value on done: 379184.0 [2024-08-06 03:26:27,305][52820] Sum rewards: 69.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.862', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.130', 'AMMO4': '0.167', 'weapon5': '0.210', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '2.846', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '57.500'} [2024-08-06 03:26:27,471][52795] DAMAGECOUNT value on done: 372391.0 [2024-08-06 03:26:27,472][52795] Sum rewards: 66.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.178', 'AMMO4': '0.219', 'AMMO3': '0.257', 'weapon2': '0.266', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '56.000'} [2024-08-06 03:26:27,719][52671] DAMAGECOUNT value on done: 410040.0 [2024-08-06 03:26:27,720][52671] Sum rewards: 63.695, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.962', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.150', 'weapon5': '0.176', 'AMMO4': '0.228', 'AMMO3': '0.253', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 375054336. Throughput: 0: 4349.3. Samples: 93771550. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 03:26:27,794][52567] Avg episode reward: [(0, '68.597')] [2024-08-06 03:26:27,808][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045784_375062528.pth... [2024-08-06 03:26:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045272_370868224.pth [2024-08-06 03:26:28,336][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:26:28,353][52649] DAMAGECOUNT value on done: 403337.0 [2024-08-06 03:26:28,353][52649] Sum rewards: 66.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.136', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.249', 'weapon4': '0.326', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '58.000'} [2024-08-06 03:26:29,571][52794] DAMAGECOUNT value on done: 402157.0 [2024-08-06 03:26:29,573][52794] Sum rewards: 66.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.302', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.110', 'AMMO4': '0.112', 'weapon4': '0.120', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '55.000'} [2024-08-06 03:26:30,484][52820] DAMAGECOUNT value on done: 379676.0 [2024-08-06 03:26:30,484][52820] Sum rewards: 59.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.278', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.225', 'weapon5': '0.274', 'AMMO4': '0.322', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.440', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '49.000'} [2024-08-06 03:26:30,601][52795] DAMAGECOUNT value on done: 379585.0 [2024-08-06 03:26:30,603][52795] Sum rewards: 73.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.608', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO4': '0.202', 'weapon4': '0.208', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'weapon5': '0.410', 'WEAPON5': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.550', 'weapon3': '2.584', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '62.000'} [2024-08-06 03:26:31,293][52650] Updated weights for policy 0, policy_version 45791 (0.0024) [2024-08-06 03:26:31,511][52649] DAMAGECOUNT value on done: 403755.0 [2024-08-06 03:26:31,513][52649] Sum rewards: 75.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.696', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO4': '0.178', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.600', 'weapon3': '3.124', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '64.000'} [2024-08-06 03:26:32,667][52794] DAMAGECOUNT value on done: 421037.0 [2024-08-06 03:26:32,669][52794] Sum rewards: 57.043, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.990', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.164', 'AMMO4': '0.208', 'weapon4': '0.260', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.800', 'HITCOUNT': '2.780', 'weapon3': '2.826', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '52.000'} [2024-08-06 03:26:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 375144448. Throughput: 0: 4355.8. Samples: 93784560. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 03:26:32,795][52567] Avg episode reward: [(0, '68.380')] [2024-08-06 03:26:32,879][52659] DAMAGECOUNT value on done: 410456.0 [2024-08-06 03:26:32,880][52659] Sum rewards: 63.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO4': '0.192', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon4': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '54.000'} [2024-08-06 03:26:33,601][52820] DAMAGECOUNT value on done: 374283.0 [2024-08-06 03:26:33,601][52820] Sum rewards: 60.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.945', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.188', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '52.000'} [2024-08-06 03:26:33,704][52795] DAMAGECOUNT value on done: 385678.0 [2024-08-06 03:26:33,708][52795] Sum rewards: 61.548, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.140', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.166', 'weapon4': '0.214', 'AMMO4': '0.244', 'AMMO3': '0.275', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.934', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '55.000'} [2024-08-06 03:26:34,839][52649] DAMAGECOUNT value on done: 395103.0 [2024-08-06 03:26:34,839][52649] Sum rewards: 53.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.292', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.148', 'weapon2': '0.190', 'AMMO4': '0.199', 'AMMO3': '0.208', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '3.096', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '44.000'} [2024-08-06 03:26:35,834][52794] DAMAGECOUNT value on done: 403118.0 [2024-08-06 03:26:35,835][52794] Sum rewards: 71.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.240', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.102', 'AMMO4': '0.128', 'weapon5': '0.142', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '59.000'} [2024-08-06 03:26:35,864][52650] Updated weights for policy 0, policy_version 45801 (0.0013) [2024-08-06 03:26:35,987][52659] DAMAGECOUNT value on done: 410759.0 [2024-08-06 03:26:35,987][52659] Sum rewards: 73.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.372', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.422', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '62.000'} [2024-08-06 03:26:36,696][52820] DAMAGECOUNT value on done: 381791.0 [2024-08-06 03:26:36,697][52820] Sum rewards: 75.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.643', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.260', 'weapon2': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '64.000'} [2024-08-06 03:26:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 375226368. Throughput: 0: 4362.7. Samples: 93811060. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 03:26:37,795][52567] Avg episode reward: [(0, '68.349')] [2024-08-06 03:26:38,023][52649] DAMAGECOUNT value on done: 401957.0 [2024-08-06 03:26:38,025][52649] Sum rewards: 73.775, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.128', 'weapon4': '0.132', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '63.000'} [2024-08-06 03:26:38,518][52794] DAMAGECOUNT value on done: 419212.0 [2024-08-06 03:26:38,518][52794] Sum rewards: 71.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.106', 'AMMO3': '0.217', 'AMMO4': '0.240', 'weapon5': '0.250', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.000'} [2024-08-06 03:26:39,121][52659] DAMAGECOUNT value on done: 411645.0 [2024-08-06 03:26:39,131][52659] Sum rewards: 76.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.021', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.120', 'weapon5': '0.148', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 03:26:39,871][52820] DAMAGECOUNT value on done: 372878.0 [2024-08-06 03:26:39,872][52820] Sum rewards: 69.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.165', 'AMMO3': '0.188', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:39,923][52663] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:26:40,655][52649] DAMAGECOUNT value on done: 397968.0 [2024-08-06 03:26:40,657][52649] Sum rewards: 87.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.196', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.496', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.982', 'FRAGCOUNT': '71.000'} [2024-08-06 03:26:40,826][52650] Updated weights for policy 0, policy_version 45811 (0.0012) [2024-08-06 03:26:41,209][52794] DAMAGECOUNT value on done: 410870.0 [2024-08-06 03:26:41,209][52794] Sum rewards: 73.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.050', 'weapon4': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.200', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '59.000'} [2024-08-06 03:26:42,183][52659] DAMAGECOUNT value on done: 409110.0 [2024-08-06 03:26:42,183][52659] Sum rewards: 66.968, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.857', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO3': '0.155', 'AMMO4': '0.171', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.084', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 03:26:42,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 375308288. Throughput: 0: 4366.2. Samples: 93837350. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 03:26:42,794][52567] Avg episode reward: [(0, '68.434')] [2024-08-06 03:26:43,005][52820] DAMAGECOUNT value on done: 377367.0 [2024-08-06 03:26:43,006][52820] Sum rewards: 81.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.415', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.225', 'weapon2': '0.278', 'AMMO4': '0.309', 'weapon5': '0.360', 'weapon4': '0.368', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.672', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.934', 'FRAGCOUNT': '65.000'} [2024-08-06 03:26:43,679][52649] DAMAGECOUNT value on done: 404346.0 [2024-08-06 03:26:43,679][52649] Sum rewards: 65.854, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.310', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.116', 'AMMO4': '0.219', 'weapon2': '0.252', 'WEAPON5': '0.300', 'AMMO3': '0.324', 'weapon4': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.766', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '58.000'} [2024-08-06 03:26:44,138][52794] DAMAGECOUNT value on done: 413318.0 [2024-08-06 03:26:44,146][52794] Sum rewards: 77.980, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.208', 'weapon5': '0.210', 'weapon4': '0.268', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '65.000'} [2024-08-06 03:26:44,739][52659] DAMAGECOUNT value on done: 408417.0 [2024-08-06 03:26:44,742][52659] Sum rewards: 79.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '65.000'} [2024-08-06 03:26:45,699][52650] Updated weights for policy 0, policy_version 45821 (0.0016) [2024-08-06 03:26:46,030][52820] DAMAGECOUNT value on done: 381724.0 [2024-08-06 03:26:46,033][52820] Sum rewards: 71.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.672', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.097', 'weapon4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '61.000'} [2024-08-06 03:26:47,016][52649] DAMAGECOUNT value on done: 406325.0 [2024-08-06 03:26:47,017][52649] Sum rewards: 82.970, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.983', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.050', 'weapon3': '3.116', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '65.000'} [2024-08-06 03:26:47,340][52794] DAMAGECOUNT value on done: 420560.0 [2024-08-06 03:26:47,340][52794] Sum rewards: 66.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.100', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.272', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.364', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:47,346][52659] DAMAGECOUNT value on done: 409609.0 [2024-08-06 03:26:47,346][52659] Sum rewards: 74.261, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.926', 'AMMO5': '0.014', 'AMMO2': '0.054', 'AMMO3': '0.160', 'weapon5': '0.220', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.514', 'weapon4': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.400', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '59.000'} [2024-08-06 03:26:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 375406592. Throughput: 0: 4369.1. Samples: 93850440. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 03:26:47,794][52567] Avg episode reward: [(0, '68.878')] [2024-08-06 03:26:48,709][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:26:49,152][52820] DAMAGECOUNT value on done: 377657.0 [2024-08-06 03:26:49,162][52820] Sum rewards: 71.596, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO5': '0.009', 'AMMO2': '0.044', 'AMMO3': '0.165', 'weapon5': '0.220', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.488', 'weapon2': '0.596', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '57.000'} [2024-08-06 03:26:50,082][52649] DAMAGECOUNT value on done: 400709.0 [2024-08-06 03:26:50,084][52649] Sum rewards: 64.153, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.064', 'HEALTH': '0.071', 'AMMO4': '0.093', 'AMMO3': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.414', 'weapon2': '0.524', 'WEAPON3': '0.850', 'weapon3': '2.800', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '50.000'} [2024-08-06 03:26:50,268][52650] Updated weights for policy 0, policy_version 45831 (0.0014) [2024-08-06 03:26:50,497][52794] DAMAGECOUNT value on done: 410209.0 [2024-08-06 03:26:50,498][52794] Sum rewards: 68.751, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.073', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.190', 'AMMO3': '0.197', 'weapon2': '0.198', 'weapon4': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.184', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 03:26:50,596][52659] DAMAGECOUNT value on done: 411081.0 [2024-08-06 03:26:50,597][52659] Sum rewards: 75.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.778', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.110', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '63.000'} [2024-08-06 03:26:52,065][52662] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.534, 178.0), ('weapon5', 0.002)] [2024-08-06 03:26:52,374][52820] DAMAGECOUNT value on done: 383486.0 [2024-08-06 03:26:52,376][52820] Sum rewards: 63.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.992', 'AMMO2': '0.018', 'weapon4': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.265', 'weapon2': '0.306', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.400', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '54.000'} [2024-08-06 03:26:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 375488512. Throughput: 0: 4374.2. Samples: 93876590. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 03:26:52,794][52567] Avg episode reward: [(0, '68.570')] [2024-08-06 03:26:53,415][52659] DAMAGECOUNT value on done: 408308.0 [2024-08-06 03:26:53,417][52659] Sum rewards: 86.893, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'ARMOR': '0.004', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '74.000'} [2024-08-06 03:26:54,954][52650] Updated weights for policy 0, policy_version 45841 (0.0016) [2024-08-06 03:26:55,570][52820] DAMAGECOUNT value on done: 376596.0 [2024-08-06 03:26:55,571][52820] Sum rewards: 64.081, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.084', 'weapon5': '0.140', 'AMMO4': '0.154', 'weapon2': '0.226', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.268', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '54.000'} [2024-08-06 03:26:56,094][52666] DAMAGECOUNT value on done: 408908.0 [2024-08-06 03:26:56,094][52666] Sum rewards: 65.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.398', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.126', 'AMMO3': '0.180', 'AMMO4': '0.200', 'weapon5': '0.202', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.078', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '56.000'} [2024-08-06 03:26:56,531][52659] DAMAGECOUNT value on done: 418725.0 [2024-08-06 03:26:56,531][52659] Sum rewards: 79.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.078', 'weapon5': '0.178', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '65.000'} [2024-08-06 03:26:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 375578624. Throughput: 0: 4368.4. Samples: 93902530. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 03:26:57,795][52567] Avg episode reward: [(0, '68.864')] [2024-08-06 03:26:58,390][52663] DAMAGECOUNT value on done: 415455.0 [2024-08-06 03:26:58,392][52663] Sum rewards: 68.268, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.320', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.074', 'weapon5': '0.218', 'weapon2': '0.238', 'AMMO4': '0.272', 'AMMO3': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.148', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '60.000'} [2024-08-06 03:26:58,815][52659] DAMAGECOUNT value on done: 419597.0 [2024-08-06 03:26:58,817][52659] Sum rewards: 73.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.096', 'weapon5': '0.132', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.324', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '59.000'} [2024-08-06 03:26:58,826][52820] DAMAGECOUNT value on done: 380313.0 [2024-08-06 03:26:58,827][52820] Sum rewards: 79.302, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.200', 'AMMO2': '0.028', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.260', 'weapon2': '0.356', 'WEAPON3': '1.650', 'weapon3': '3.342', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '69.000'} [2024-08-06 03:26:58,887][52666] DAMAGECOUNT value on done: 415626.0 [2024-08-06 03:26:58,888][52666] Sum rewards: 83.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.236', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.126', 'weapon4': '0.142', 'AMMO3': '0.180', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '67.000'} [2024-08-06 03:26:59,599][52650] Updated weights for policy 0, policy_version 45851 (0.0013) [2024-08-06 03:27:00,329][52670] DAMAGECOUNT value on done: 403127.0 [2024-08-06 03:27:00,330][52670] Sum rewards: 68.618, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.226', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.216', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:01,451][52663] DAMAGECOUNT value on done: 410364.0 [2024-08-06 03:27:01,453][52663] Sum rewards: 68.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.188', 'AMMO4': '0.210', 'weapon2': '0.216', 'AMMO3': '0.217', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 03:27:01,653][52659] DAMAGECOUNT value on done: 411558.0 [2024-08-06 03:27:01,657][52659] Sum rewards: 70.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.577', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.074', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.304', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '62.000'} [2024-08-06 03:27:01,765][52666] DAMAGECOUNT value on done: 413851.0 [2024-08-06 03:27:01,767][52666] Sum rewards: 76.854, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.142', 'AMMO4': '0.165', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.450', 'weapon3': '2.760', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '64.000'} [2024-08-06 03:27:01,953][52820] DAMAGECOUNT value on done: 385020.0 [2024-08-06 03:27:01,957][52820] Sum rewards: 67.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.108', 'weapon2': '0.218', 'AMMO3': '0.255', 'AMMO4': '0.272', 'weapon5': '0.312', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '3.006', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '58.000'} [2024-08-06 03:27:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 375668736. Throughput: 0: 4373.6. Samples: 93915750. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 03:27:02,794][52567] Avg episode reward: [(0, '69.326')] [2024-08-06 03:27:03,466][52670] DAMAGECOUNT value on done: 411434.0 [2024-08-06 03:27:03,466][52670] Sum rewards: 90.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.598', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '20.967', 'FRAGCOUNT': '70.000'} [2024-08-06 03:27:04,216][52650] Updated weights for policy 0, policy_version 45861 (0.0028) [2024-08-06 03:27:04,447][52663] DAMAGECOUNT value on done: 404504.0 [2024-08-06 03:27:04,449][52663] Sum rewards: 70.261, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.103', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '60.000'} [2024-08-06 03:27:04,793][52659] DAMAGECOUNT value on done: 414116.0 [2024-08-06 03:27:04,794][52659] Sum rewards: 69.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon4': '0.150', 'weapon5': '0.182', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '56.000'} [2024-08-06 03:27:04,980][52666] DAMAGECOUNT value on done: 409822.0 [2024-08-06 03:27:04,982][52666] Sum rewards: 63.070, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.086', 'weapon4': '0.088', 'AMMO3': '0.180', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.258', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '52.000'} [2024-08-06 03:27:05,197][52820] DAMAGECOUNT value on done: 380506.0 [2024-08-06 03:27:05,198][52820] Sum rewards: 65.832, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.222', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO4': '0.180', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.232', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '58.000'} [2024-08-06 03:27:06,561][52670] DAMAGECOUNT value on done: 403100.0 [2024-08-06 03:27:06,563][52670] Sum rewards: 62.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.480', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.214', 'AMMO4': '0.228', 'AMMO3': '0.242', 'weapon2': '0.316', 'weapon5': '0.380', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.758', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '53.500'} [2024-08-06 03:27:07,289][52663] DAMAGECOUNT value on done: 411299.0 [2024-08-06 03:27:07,289][52663] Sum rewards: 74.729, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.130', 'weapon4': '0.160', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '64.000'} [2024-08-06 03:27:07,686][52659] DAMAGECOUNT value on done: 402718.0 [2024-08-06 03:27:07,686][52659] Sum rewards: 81.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.497', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.066', 'AMMO4': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.274', 'WEAPON3': '1.450', 'weapon3': '3.366', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '67.000'} [2024-08-06 03:27:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 375750656. Throughput: 0: 4371.3. Samples: 93941990. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 03:27:07,794][52567] Avg episode reward: [(0, '69.723')] [2024-08-06 03:27:07,812][52666] DAMAGECOUNT value on done: 411010.0 [2024-08-06 03:27:07,815][52666] Sum rewards: 84.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.220', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.482', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '69.000'} [2024-08-06 03:27:08,287][52820] DAMAGECOUNT value on done: 385342.0 [2024-08-06 03:27:08,290][52820] Sum rewards: 82.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.989', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.125', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'weapon4': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '67.000'} [2024-08-06 03:27:08,810][52650] Updated weights for policy 0, policy_version 45871 (0.0011) [2024-08-06 03:27:09,525][52670] DAMAGECOUNT value on done: 401291.0 [2024-08-06 03:27:09,526][52670] Sum rewards: 60.265, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.650', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon4': '0.116', 'AMMO3': '0.219', 'weapon5': '0.228', 'AMMO4': '0.318', 'weapon2': '0.354', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.032', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '51.500'} [2024-08-06 03:27:10,590][52663] DAMAGECOUNT value on done: 406975.0 [2024-08-06 03:27:10,592][52663] Sum rewards: 67.992, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.042', 'weapon5': '0.050', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.352', 'HEALTH': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '56.000'} [2024-08-06 03:27:10,807][52659] DAMAGECOUNT value on done: 409691.0 [2024-08-06 03:27:10,808][52659] Sum rewards: 72.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.024', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:10,939][52666] DAMAGECOUNT value on done: 404063.0 [2024-08-06 03:27:10,941][52666] Sum rewards: 74.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.220', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.172', 'AMMO3': '0.201', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.662', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '61.000'} [2024-08-06 03:27:11,438][52820] DAMAGECOUNT value on done: 379162.0 [2024-08-06 03:27:11,438][52820] Sum rewards: 64.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.581', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.312', 'weapon4': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '55.000'} [2024-08-06 03:27:12,588][52670] DAMAGECOUNT value on done: 411628.0 [2024-08-06 03:27:12,588][52670] Sum rewards: 56.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.375', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon2': '0.210', 'weapon4': '0.224', 'weapon5': '0.266', 'AMMO3': '0.272', 'AMMO4': '0.297', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'HITCOUNT': '2.670', 'weapon3': '2.966', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '50.000'} [2024-08-06 03:27:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 375840768. Throughput: 0: 4369.3. Samples: 93968170. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 03:27:12,794][52567] Avg episode reward: [(0, '69.749')] [2024-08-06 03:27:13,491][52650] Updated weights for policy 0, policy_version 45881 (0.0027) [2024-08-06 03:27:13,613][52663] DAMAGECOUNT value on done: 413115.0 [2024-08-06 03:27:13,613][52663] Sum rewards: 71.227, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.972', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.292', 'weapon2': '0.360', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '62.000'} [2024-08-06 03:27:13,723][52659] DAMAGECOUNT value on done: 420034.0 [2024-08-06 03:27:13,725][52659] Sum rewards: 77.769, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.233', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO4': '0.149', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 03:27:14,111][52666] DAMAGECOUNT value on done: 410612.0 [2024-08-06 03:27:14,111][52666] Sum rewards: 66.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.224', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 03:27:14,440][52820] DAMAGECOUNT value on done: 379091.0 [2024-08-06 03:27:14,441][52820] Sum rewards: 70.509, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.500', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.072', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.273', 'WEAPON3': '1.750', 'weapon3': '3.420', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '61.000'} [2024-08-06 03:27:15,308][52670] DAMAGECOUNT value on done: 405413.0 [2024-08-06 03:27:15,309][52670] Sum rewards: 63.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.393', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.040', 'AMMO4': '0.071', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.206', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.458', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '53.000'} [2024-08-06 03:27:16,506][52663] DAMAGECOUNT value on done: 412355.0 [2024-08-06 03:27:16,508][52663] Sum rewards: 83.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.368', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '70.000'} [2024-08-06 03:27:16,628][52666] DAMAGECOUNT value on done: 409721.0 [2024-08-06 03:27:16,629][52666] Sum rewards: 68.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.638', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO3': '0.191', 'AMMO4': '0.193', 'weapon4': '0.250', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '57.000'} [2024-08-06 03:27:16,821][52659] DAMAGECOUNT value on done: 415891.0 [2024-08-06 03:27:16,823][52659] Sum rewards: 78.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.066', 'AMMO4': '0.105', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '64.000'} [2024-08-06 03:27:17,611][52820] DAMAGECOUNT value on done: 390068.0 [2024-08-06 03:27:17,611][52820] Sum rewards: 82.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.477', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon5': '0.194', 'AMMO4': '0.199', 'AMMO3': '0.214', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '69.000'} [2024-08-06 03:27:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 375922688. Throughput: 0: 4376.2. Samples: 93981490. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 03:27:17,795][52567] Avg episode reward: [(0, '70.093')] [2024-08-06 03:27:18,027][52650] Updated weights for policy 0, policy_version 45891 (0.0011) [2024-08-06 03:27:18,585][52670] DAMAGECOUNT value on done: 401516.0 [2024-08-06 03:27:18,585][52670] Sum rewards: 71.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.330', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:19,276][52663] DAMAGECOUNT value on done: 407658.0 [2024-08-06 03:27:19,278][52663] Sum rewards: 72.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.166', 'AMMO3': '0.211', 'AMMO4': '0.273', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '60.000'} [2024-08-06 03:27:19,455][52659] DAMAGECOUNT value on done: 417236.0 [2024-08-06 03:27:19,457][52659] Sum rewards: 77.478, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.286', 'weapon2': '0.426', 'WEAPON3': '1.650', 'weapon3': '3.354', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 03:27:19,945][52666] DAMAGECOUNT value on done: 404999.0 [2024-08-06 03:27:19,945][52666] Sum rewards: 72.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.149', 'weapon5': '0.172', 'AMMO3': '0.244', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.286', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '60.000'} [2024-08-06 03:27:20,750][52820] DAMAGECOUNT value on done: 390436.0 [2024-08-06 03:27:20,752][52820] Sum rewards: 71.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.064', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:21,542][52670] DAMAGECOUNT value on done: 405401.0 [2024-08-06 03:27:21,544][52670] Sum rewards: 96.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.086', 'AMMO4': '0.122', 'weapon5': '0.130', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.858', 'FRAGCOUNT': '79.000'} [2024-08-06 03:27:22,014][52663] DAMAGECOUNT value on done: 406645.0 [2024-08-06 03:27:22,015][52663] Sum rewards: 60.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.502', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.228', 'AMMO3': '0.259', 'weapon5': '0.288', 'AMMO4': '0.308', 'weapon2': '0.486', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.632', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '53.000'} [2024-08-06 03:27:22,657][52659] DAMAGECOUNT value on done: 408225.0 [2024-08-06 03:27:22,666][52659] Sum rewards: 54.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.162', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon7': '0.320', 'weapon4': '0.332', 'weapon2': '0.494', 'WEAPON3': '0.950', 'weapon3': '2.526', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '46.000'} [2024-08-06 03:27:22,712][52650] Updated weights for policy 0, policy_version 45901 (0.0012) [2024-08-06 03:27:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 376020992. Throughput: 0: 4374.0. Samples: 94007890. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:27:22,794][52567] Avg episode reward: [(0, '70.507')] [2024-08-06 03:27:23,023][52666] DAMAGECOUNT value on done: 401543.0 [2024-08-06 03:27:23,023][52666] Sum rewards: 63.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.358', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.096', 'weapon5': '0.214', 'AMMO4': '0.239', 'AMMO3': '0.248', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.102', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '53.000'} [2024-08-06 03:27:23,851][52820] DAMAGECOUNT value on done: 378579.0 [2024-08-06 03:27:23,853][52820] Sum rewards: 79.237, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.594', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon2': '0.196', 'weapon5': '0.224', 'weapon4': '0.246', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '21.144', 'FRAGCOUNT': '67.000'} [2024-08-06 03:27:24,639][52670] DAMAGECOUNT value on done: 404492.0 [2024-08-06 03:27:24,641][52670] Sum rewards: 57.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.210', 'weapon4': '0.214', 'weapon5': '0.226', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.940', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '47.000'} [2024-08-06 03:27:24,892][52663] DAMAGECOUNT value on done: 412597.0 [2024-08-06 03:27:24,894][52663] Sum rewards: 72.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.180', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.146', 'weapon5': '0.218', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.962', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 03:27:25,500][52659] DAMAGECOUNT value on done: 415732.0 [2024-08-06 03:27:25,501][52659] Sum rewards: 61.114, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.806', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.123', 'AMMO3': '0.162', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.928', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.923', 'FRAGCOUNT': '51.000'} [2024-08-06 03:27:25,864][52666] DAMAGECOUNT value on done: 407258.0 [2024-08-06 03:27:25,865][52666] Sum rewards: 75.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.296', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '63.000'} [2024-08-06 03:27:27,170][52670] DAMAGECOUNT value on done: 401374.0 [2024-08-06 03:27:27,173][52670] Sum rewards: 76.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.500'} [2024-08-06 03:27:27,645][52650] Updated weights for policy 0, policy_version 45911 (0.0012) [2024-08-06 03:27:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 376102912. Throughput: 0: 4372.2. Samples: 94034100. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:27:27,794][52567] Avg episode reward: [(0, '70.764')] [2024-08-06 03:27:28,099][52659] DAMAGECOUNT value on done: 414667.0 [2024-08-06 03:27:28,100][52659] Sum rewards: 66.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.148', 'AMMO3': '0.160', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'weapon4': '0.450', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.628', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '55.000'} [2024-08-06 03:27:28,112][52663] DAMAGECOUNT value on done: 417471.0 [2024-08-06 03:27:28,112][52663] Sum rewards: 63.801, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.410', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.084', 'AMMO4': '0.163', 'weapon5': '0.190', 'AMMO3': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.900', 'weapon3': '2.930', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '58.000'} [2024-08-06 03:27:28,519][52666] DAMAGECOUNT value on done: 405259.0 [2024-08-06 03:27:28,520][52666] Sum rewards: 86.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '71.000'} [2024-08-06 03:27:28,790][52614] Signal inference workers to stop experience collection... (8300 times) [2024-08-06 03:27:28,799][52614] Signal inference workers to resume experience collection... (8300 times) [2024-08-06 03:27:28,873][52650] InferenceWorker_p0-w0: stopping experience collection (8300 times) [2024-08-06 03:27:28,873][52650] InferenceWorker_p0-w0: resuming experience collection (8300 times) [2024-08-06 03:27:30,100][52670] DAMAGECOUNT value on done: 410626.0 [2024-08-06 03:27:30,102][52670] Sum rewards: 59.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.027', 'AMMO2': '0.051', 'AMMO3': '0.146', 'weapon5': '0.212', 'AMMO4': '0.254', 'weapon4': '0.296', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.862', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '47.000'} [2024-08-06 03:27:30,397][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:27:31,068][52663] DAMAGECOUNT value on done: 410381.0 [2024-08-06 03:27:31,068][52663] Sum rewards: 70.280, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.254', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '56.000'} [2024-08-06 03:27:31,620][52666] DAMAGECOUNT value on done: 414194.0 [2024-08-06 03:27:31,622][52666] Sum rewards: 63.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.090', 'weapon5': '0.090', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.128', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '54.000'} [2024-08-06 03:27:31,995][52650] Updated weights for policy 0, policy_version 45921 (0.0015) [2024-08-06 03:27:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 376193024. Throughput: 0: 4377.8. Samples: 94047440. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:27:32,794][52567] Avg episode reward: [(0, '70.489')] [2024-08-06 03:27:33,220][52670] DAMAGECOUNT value on done: 402837.0 [2024-08-06 03:27:33,220][52670] Sum rewards: 71.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.514', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.190', 'AMMO3': '0.240', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '60.000'} [2024-08-06 03:27:34,172][52663] DAMAGECOUNT value on done: 405261.0 [2024-08-06 03:27:34,172][52663] Sum rewards: 69.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.189', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.178', 'weapon2': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '3.340', 'weapon3': '3.354', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '57.500'} [2024-08-06 03:27:34,361][52667] DAMAGECOUNT value on done: 409586.0 [2024-08-06 03:27:34,361][52667] Sum rewards: 71.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.868', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.224', 'weapon2': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '58.000'} [2024-08-06 03:27:34,625][52666] DAMAGECOUNT value on done: 411463.0 [2024-08-06 03:27:34,629][52666] Sum rewards: 75.059, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.430', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon4': '0.036', 'AMMO4': '0.044', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.398', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '64.000'} [2024-08-06 03:27:36,245][52670] DAMAGECOUNT value on done: 404281.0 [2024-08-06 03:27:36,247][52670] Sum rewards: 65.277, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.282', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon5': '0.240', 'AMMO4': '0.250', 'weapon4': '0.258', 'weapon2': '0.260', 'AMMO3': '0.263', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.918', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.000'} [2024-08-06 03:27:36,865][52650] Updated weights for policy 0, policy_version 45931 (0.0034) [2024-08-06 03:27:37,142][52667] DAMAGECOUNT value on done: 417672.0 [2024-08-06 03:27:37,147][52667] Sum rewards: 69.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.064', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.346', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '57.000'} [2024-08-06 03:27:37,187][52663] DAMAGECOUNT value on done: 404032.0 [2024-08-06 03:27:37,188][52663] Sum rewards: 64.176, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.755', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.142', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '52.000'} [2024-08-06 03:27:37,582][52666] DAMAGECOUNT value on done: 406863.0 [2024-08-06 03:27:37,584][52666] Sum rewards: 72.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.725', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.120', 'AMMO4': '0.130', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '60.000'} [2024-08-06 03:27:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 376283136. Throughput: 0: 4381.8. Samples: 94073770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:27:37,794][52567] Avg episode reward: [(0, '71.057')] [2024-08-06 03:27:38,727][52664] DAMAGECOUNT value on done: 426232.0 [2024-08-06 03:27:38,728][52664] Sum rewards: 68.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.276', 'weapon4': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '58.000'} [2024-08-06 03:27:39,099][52670] DAMAGECOUNT value on done: 414174.0 [2024-08-06 03:27:39,100][52670] Sum rewards: 82.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.325', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.100', 'weapon5': '0.192', 'AMMO4': '0.198', 'AMMO3': '0.239', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '68.000'} [2024-08-06 03:27:40,027][52663] DAMAGECOUNT value on done: 406913.0 [2024-08-06 03:27:40,028][52663] Sum rewards: 64.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.358', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.250', 'weapon3': '3.332', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '55.000'} [2024-08-06 03:27:40,222][52667] DAMAGECOUNT value on done: 409687.0 [2024-08-06 03:27:40,222][52667] Sum rewards: 56.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.026', 'AMMO2': '0.060', 'weapon4': '0.134', 'AMMO3': '0.258', 'AMMO4': '0.300', 'weapon5': '0.330', 'weapon2': '0.390', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.732', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '50.000'} [2024-08-06 03:27:40,489][52666] DAMAGECOUNT value on done: 407557.0 [2024-08-06 03:27:40,489][52666] Sum rewards: 73.988, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.605', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.188', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '65.000'} [2024-08-06 03:27:41,556][52650] Updated weights for policy 0, policy_version 45941 (0.0011) [2024-08-06 03:27:41,599][52664] DAMAGECOUNT value on done: 431230.0 [2024-08-06 03:27:41,599][52664] Sum rewards: 80.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon4': '0.042', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.221', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '67.000'} [2024-08-06 03:27:41,955][52670] DAMAGECOUNT value on done: 409323.0 [2024-08-06 03:27:41,957][52670] Sum rewards: 63.420, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.676', 'AMMO5': '0.027', 'AMMO2': '0.089', 'weapon4': '0.230', 'AMMO3': '0.271', 'weapon2': '0.282', 'weapon5': '0.418', 'AMMO4': '0.444', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.646', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '56.000'} [2024-08-06 03:27:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 376365056. Throughput: 0: 4387.8. Samples: 94099980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:27:42,794][52567] Avg episode reward: [(0, '71.348')] [2024-08-06 03:27:42,881][52667] DAMAGECOUNT value on done: 412471.0 [2024-08-06 03:27:42,881][52667] Sum rewards: 71.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.073', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.260', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.402', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:43,076][52666] DAMAGECOUNT value on done: 409057.0 [2024-08-06 03:27:43,077][52666] Sum rewards: 73.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.204', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.104', 'AMMO4': '0.149', 'weapon2': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.388', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 03:27:43,417][52663] DAMAGECOUNT value on done: 415942.0 [2024-08-06 03:27:43,417][52663] Sum rewards: 64.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.350', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.134', 'weapon4': '0.144', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '55.000'} [2024-08-06 03:27:44,481][52664] DAMAGECOUNT value on done: 432099.0 [2024-08-06 03:27:44,481][52664] Sum rewards: 62.517, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.088', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.116', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '54.000'} [2024-08-06 03:27:44,497][52670] DAMAGECOUNT value on done: 393783.0 [2024-08-06 03:27:44,498][52670] Sum rewards: 73.187, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.126', 'weapon5': '0.126', 'AMMO4': '0.155', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '63.000'} [2024-08-06 03:27:45,862][52666] DAMAGECOUNT value on done: 408671.0 [2024-08-06 03:27:45,864][52666] Sum rewards: 66.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.182', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.314', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.194', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '55.000'} [2024-08-06 03:27:45,922][52667] DAMAGECOUNT value on done: 417879.0 [2024-08-06 03:27:45,923][52667] Sum rewards: 69.339, reward structure: {'DEATHCOUNT': '-12.750', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'HEALTH': '0.090', 'weapon4': '0.146', 'AMMO3': '0.178', 'weapon5': '0.198', 'weapon2': '0.206', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.206', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '57.000'} [2024-08-06 03:27:46,098][52663] DAMAGECOUNT value on done: 406360.0 [2024-08-06 03:27:46,102][52663] Sum rewards: 64.195, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.425', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.066', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.350', 'weapon4': '0.380', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '53.000'} [2024-08-06 03:27:46,289][52650] Updated weights for policy 0, policy_version 45951 (0.0013) [2024-08-06 03:27:47,288][52670] DAMAGECOUNT value on done: 407828.0 [2024-08-06 03:27:47,288][52670] Sum rewards: 79.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '66.000'} [2024-08-06 03:27:47,545][52664] DAMAGECOUNT value on done: 426244.0 [2024-08-06 03:27:47,548][52664] Sum rewards: 72.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.080', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 376455168. Throughput: 0: 4380.9. Samples: 94112890. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:27:47,795][52567] Avg episode reward: [(0, '71.452')] [2024-08-06 03:27:48,353][52666] DAMAGECOUNT value on done: 399227.0 [2024-08-06 03:27:48,354][52666] Sum rewards: 70.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.552', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.034', 'AMMO4': '0.117', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:48,533][52663] DAMAGECOUNT value on done: 411789.0 [2024-08-06 03:27:48,533][52663] Sum rewards: 51.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.829', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.096', 'AMMO4': '0.185', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.650', 'weapon3': '3.208', 'DAMAGECOUNT': '13.335', 'FRAGCOUNT': '44.000'} [2024-08-06 03:27:48,741][52667] DAMAGECOUNT value on done: 418581.0 [2024-08-06 03:27:48,742][52667] Sum rewards: 81.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.060', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO4': '0.167', 'weapon2': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.272', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.856', 'FRAGCOUNT': '69.000'} [2024-08-06 03:27:49,738][52664] DAMAGECOUNT value on done: 429207.0 [2024-08-06 03:27:49,739][52664] Sum rewards: 86.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.486', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.132', 'weapon4': '0.176', 'AMMO3': '0.198', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '69.000'} [2024-08-06 03:27:50,231][52670] DAMAGECOUNT value on done: 415631.0 [2024-08-06 03:27:50,231][52670] Sum rewards: 77.737, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.613', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.066', 'weapon5': '0.118', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.261', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.276', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '67.000'} [2024-08-06 03:27:51,057][52650] Updated weights for policy 0, policy_version 45961 (0.0011) [2024-08-06 03:27:51,572][52666] DAMAGECOUNT value on done: 409338.0 [2024-08-06 03:27:51,573][52666] Sum rewards: 68.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.420', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.348', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '58.000'} [2024-08-06 03:27:51,677][52667] DAMAGECOUNT value on done: 416908.0 [2024-08-06 03:27:51,678][52667] Sum rewards: 65.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.380', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.260', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '56.000'} [2024-08-06 03:27:51,732][52663] DAMAGECOUNT value on done: 412035.0 [2024-08-06 03:27:51,732][52663] Sum rewards: 75.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.234', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '63.000'} [2024-08-06 03:27:52,088][52664] DAMAGECOUNT value on done: 426611.0 [2024-08-06 03:27:52,089][52664] Sum rewards: 82.734, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.112', 'weapon5': '0.132', 'HEALTH': '0.136', 'weapon2': '0.170', 'AMMO4': '0.198', 'AMMO3': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.360', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '67.000'} [2024-08-06 03:27:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 376545280. Throughput: 0: 4387.3. Samples: 94139420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:27:52,802][52567] Avg episode reward: [(0, '71.175')] [2024-08-06 03:27:53,206][52670] DAMAGECOUNT value on done: 405967.0 [2024-08-06 03:27:53,207][52670] Sum rewards: 68.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.886', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon5': '0.134', 'weapon4': '0.158', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'AMMO4': '0.305', 'WEAPON4': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '57.000'} [2024-08-06 03:27:54,786][52663] DAMAGECOUNT value on done: 405425.0 [2024-08-06 03:27:54,791][52663] Sum rewards: 67.834, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.838', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.044', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.214', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '59.000'} [2024-08-06 03:27:55,013][52667] DAMAGECOUNT value on done: 410674.0 [2024-08-06 03:27:55,016][52667] Sum rewards: 72.268, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.857', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'weapon5': '0.032', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'weapon2': '0.416', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.396', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '60.000'} [2024-08-06 03:27:55,122][52664] DAMAGECOUNT value on done: 427751.0 [2024-08-06 03:27:55,122][52664] Sum rewards: 62.568, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.740', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '3.028', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '52.000'} [2024-08-06 03:27:55,534][52650] Updated weights for policy 0, policy_version 45971 (0.0025) [2024-08-06 03:27:55,581][52670] DAMAGECOUNT value on done: 409043.0 [2024-08-06 03:27:55,581][52670] Sum rewards: 58.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.300', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.096', 'AMMO3': '0.200', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'weapon4': '0.416', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '50.000'} [2024-08-06 03:27:57,771][52664] DAMAGECOUNT value on done: 421143.0 [2024-08-06 03:27:57,773][52664] Sum rewards: 66.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.340', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '57.000'} [2024-08-06 03:27:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 376627200. Throughput: 0: 4387.3. Samples: 94165600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:27:57,794][52567] Avg episode reward: [(0, '71.018')] [2024-08-06 03:27:57,970][52667] DAMAGECOUNT value on done: 413571.0 [2024-08-06 03:27:57,970][52667] Sum rewards: 83.613, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.086', 'AMMO3': '0.139', 'weapon4': '0.236', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon3': '2.812', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:00,419][52667] DAMAGECOUNT value on done: 421177.0 [2024-08-06 03:28:00,419][52667] Sum rewards: 75.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.098', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:00,434][52650] Updated weights for policy 0, policy_version 45981 (0.0015) [2024-08-06 03:28:00,800][52664] DAMAGECOUNT value on done: 432280.0 [2024-08-06 03:28:00,802][52664] Sum rewards: 75.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.350', 'weapon3': '3.354', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:02,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 376717312. Throughput: 0: 4382.2. Samples: 94178690. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:28:02,795][52567] Avg episode reward: [(0, '71.128')] [2024-08-06 03:28:03,258][52667] DAMAGECOUNT value on done: 409010.0 [2024-08-06 03:28:03,260][52667] Sum rewards: 62.205, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.707', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.141', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '49.000'} [2024-08-06 03:28:03,271][52664] DAMAGECOUNT value on done: 423905.0 [2024-08-06 03:28:03,272][52664] Sum rewards: 67.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.149', 'weapon5': '0.162', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.144', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '56.000'} [2024-08-06 03:28:04,237][52647] DAMAGECOUNT value on done: 436469.0 [2024-08-06 03:28:04,237][52647] Sum rewards: 65.077, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.024', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.222', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:05,314][52650] Updated weights for policy 0, policy_version 45991 (0.0010) [2024-08-06 03:28:05,707][52664] DAMAGECOUNT value on done: 433063.0 [2024-08-06 03:28:05,707][52664] Sum rewards: 64.353, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.581', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.169', 'weapon4': '0.216', 'AMMO3': '0.233', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.092', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 03:28:05,859][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:28:06,446][52667] DAMAGECOUNT value on done: 414504.0 [2024-08-06 03:28:06,448][52667] Sum rewards: 58.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.982', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.098', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.580', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.032', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '49.000'} [2024-08-06 03:28:06,864][52647] DAMAGECOUNT value on done: 434465.0 [2024-08-06 03:28:06,865][52647] Sum rewards: 83.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.038', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.174', 'AMMO3': '0.215', 'weapon4': '0.342', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '68.000'} [2024-08-06 03:28:07,210][52668] DAMAGECOUNT value on done: 410640.0 [2024-08-06 03:28:07,210][52668] Sum rewards: 66.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.080', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.099', 'AMMO3': '0.217', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.744', 'WEAPON3': '1.350', 'weapon3': '2.654', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '55.000'} [2024-08-06 03:28:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 376799232. Throughput: 0: 4378.2. Samples: 94204910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:28:07,794][52567] Avg episode reward: [(0, '70.631')] [2024-08-06 03:28:08,307][52664] DAMAGECOUNT value on done: 430209.0 [2024-08-06 03:28:08,309][52664] Sum rewards: 78.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO3': '0.160', 'AMMO4': '0.161', 'weapon4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:09,113][52667] DAMAGECOUNT value on done: 415943.0 [2024-08-06 03:28:09,113][52667] Sum rewards: 80.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.070', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.282', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '66.000'} [2024-08-06 03:28:09,215][52650] Updated weights for policy 0, policy_version 46001 (0.0012) [2024-08-06 03:28:09,487][52647] DAMAGECOUNT value on done: 434097.0 [2024-08-06 03:28:09,488][52647] Sum rewards: 72.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.134', 'weapon5': '0.140', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:09,742][52668] DAMAGECOUNT value on done: 415373.0 [2024-08-06 03:28:09,742][52668] Sum rewards: 63.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.408', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.222', 'AMMO3': '0.237', 'AMMO4': '0.263', 'weapon4': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.798', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:11,044][52669] DAMAGECOUNT value on done: 417226.0 [2024-08-06 03:28:11,046][52669] Sum rewards: 78.190, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.965', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.161', 'weapon2': '0.276', 'WEAPON3': '1.050', 'HITCOUNT': '3.540', 'weapon3': '3.642', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:11,322][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:28:11,482][52664] DAMAGECOUNT value on done: 436472.0 [2024-08-06 03:28:11,483][52664] Sum rewards: 56.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.988', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'weapon5': '0.094', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.248', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.330', 'DAMAGECOUNT': '13.890', 'FRAGCOUNT': '46.000'} [2024-08-06 03:28:12,026][52667] DAMAGECOUNT value on done: 408917.0 [2024-08-06 03:28:12,029][52667] Sum rewards: 63.302, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.094', 'AMMO4': '0.140', 'AMMO3': '0.207', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:12,595][52647] DAMAGECOUNT value on done: 442378.0 [2024-08-06 03:28:12,596][52647] Sum rewards: 76.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.192', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.142', 'weapon5': '0.178', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:12,692][52668] DAMAGECOUNT value on done: 416998.0 [2024-08-06 03:28:12,693][52668] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'weapon4': '0.092', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.448', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:12,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17612.8, 300 sec: 17495.9). Total num frames: 376897536. Throughput: 0: 4377.6. Samples: 94231090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:28:12,794][52567] Avg episode reward: [(0, '70.613')] [2024-08-06 03:28:14,392][52669] DAMAGECOUNT value on done: 407032.0 [2024-08-06 03:28:14,393][52669] Sum rewards: 62.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.715', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon2': '0.198', 'weapon4': '0.198', 'weapon5': '0.208', 'AMMO3': '0.283', 'AMMO4': '0.295', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'HITCOUNT': '2.980', 'weapon3': '3.106', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '56.000'} [2024-08-06 03:28:14,546][52650] Updated weights for policy 0, policy_version 46011 (0.0017) [2024-08-06 03:28:14,658][52664] DAMAGECOUNT value on done: 430220.0 [2024-08-06 03:28:14,658][52664] Sum rewards: 67.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.326', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:14,861][52667] DAMAGECOUNT value on done: 416693.0 [2024-08-06 03:28:14,861][52667] Sum rewards: 60.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.154', 'AMMO3': '0.217', 'weapon5': '0.220', 'AMMO4': '0.284', 'weapon2': '0.374', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.820', 'weapon3': '2.910', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:15,449][52668] DAMAGECOUNT value on done: 417057.0 [2024-08-06 03:28:15,449][52668] Sum rewards: 57.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.486', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO4': '0.204', 'AMMO3': '0.267', 'WEAPON3': '1.700', 'HITCOUNT': '3.060', 'weapon3': '3.556', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '51.000'} [2024-08-06 03:28:15,737][52647] DAMAGECOUNT value on done: 439330.0 [2024-08-06 03:28:15,737][52647] Sum rewards: 79.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.104', 'weapon4': '0.116', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '66.000'} [2024-08-06 03:28:17,355][52664] DAMAGECOUNT value on done: 434907.0 [2024-08-06 03:28:17,355][52664] Sum rewards: 71.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.378', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.178', 'AMMO3': '0.213', 'AMMO4': '0.223', 'weapon4': '0.278', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '59.500'} [2024-08-06 03:28:17,609][52669] DAMAGECOUNT value on done: 417309.0 [2024-08-06 03:28:17,610][52669] Sum rewards: 70.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.505', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.138', 'AMMO3': '0.190', 'AMMO4': '0.225', 'weapon5': '0.246', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:17,633][52667] DAMAGECOUNT value on done: 424388.0 [2024-08-06 03:28:17,634][52667] Sum rewards: 68.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.769', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.084', 'AMMO4': '0.151', 'weapon5': '0.168', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 376979456. Throughput: 0: 4364.9. Samples: 94243860. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:28:17,802][52567] Avg episode reward: [(0, '70.140')] [2024-08-06 03:28:18,287][52647] DAMAGECOUNT value on done: 437691.0 [2024-08-06 03:28:18,287][52647] Sum rewards: 66.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.480', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.146', 'weapon2': '0.224', 'AMMO3': '0.246', 'weapon5': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:18,544][52668] DAMAGECOUNT value on done: 406015.0 [2024-08-06 03:28:18,545][52668] Sum rewards: 68.868, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.062', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.122', 'weapon5': '0.160', 'AMMO4': '0.163', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.844', 'weapon3': '2.590', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:19,254][52662] DAMAGECOUNT value on done: 418011.0 [2024-08-06 03:28:19,255][52662] Sum rewards: 64.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.230', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.254', 'AMMO4': '0.264', 'weapon5': '0.264', 'weapon4': '0.302', 'weapon2': '0.314', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.772', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '55.000'} [2024-08-06 03:28:19,557][52650] Updated weights for policy 0, policy_version 46021 (0.0029) [2024-08-06 03:28:20,117][52667] DAMAGECOUNT value on done: 421037.0 [2024-08-06 03:28:20,118][52667] Sum rewards: 73.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.130', 'weapon4': '0.192', 'AMMO3': '0.208', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:20,263][52664] DAMAGECOUNT value on done: 427448.0 [2024-08-06 03:28:20,264][52664] Sum rewards: 77.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:20,459][52669] DAMAGECOUNT value on done: 411903.0 [2024-08-06 03:28:20,461][52669] Sum rewards: 77.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.155', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.141', 'AMMO3': '0.187', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.374', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:21,216][52647] DAMAGECOUNT value on done: 436716.0 [2024-08-06 03:28:21,218][52647] Sum rewards: 80.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.250', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.056', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.440', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '65.000'} [2024-08-06 03:28:21,417][52803] DAMAGECOUNT value on done: 386328.0 [2024-08-06 03:28:21,418][52803] Sum rewards: 73.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.096', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.532', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:21,434][52811] DAMAGECOUNT value on done: 396103.0 [2024-08-06 03:28:21,434][52811] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.743', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO4': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '55.000'} [2024-08-06 03:28:21,506][52668] DAMAGECOUNT value on done: 416773.0 [2024-08-06 03:28:21,508][52668] Sum rewards: 71.875, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.728', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.104', 'weapon5': '0.122', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:21,748][52662] DAMAGECOUNT value on done: 418326.0 [2024-08-06 03:28:21,748][52662] Sum rewards: 78.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.780', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO4': '0.199', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.000'} [2024-08-06 03:28:22,743][52667] DAMAGECOUNT value on done: 416880.0 [2024-08-06 03:28:22,743][52667] Sum rewards: 57.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.154', 'weapon5': '0.206', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.092', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '49.000'} [2024-08-06 03:28:22,794][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 377061376. Throughput: 0: 4370.0. Samples: 94270420. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:28:22,802][52567] Avg episode reward: [(0, '70.160')] [2024-08-06 03:28:23,388][52664] DAMAGECOUNT value on done: 427819.0 [2024-08-06 03:28:23,389][52664] Sum rewards: 67.151, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.209', 'weapon2': '0.218', 'AMMO4': '0.224', 'weapon5': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.500'} [2024-08-06 03:28:23,452][52669] DAMAGECOUNT value on done: 411578.0 [2024-08-06 03:28:23,453][52669] Sum rewards: 70.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.431', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '3.440', 'weapon3': '3.528', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:23,551][52650] Updated weights for policy 0, policy_version 46031 (0.0040) [2024-08-06 03:28:24,076][52668] DAMAGECOUNT value on done: 416096.0 [2024-08-06 03:28:24,076][52668] Sum rewards: 64.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.261', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.094', 'weapon5': '0.094', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.402', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.186', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '55.000'} [2024-08-06 03:28:24,363][52811] DAMAGECOUNT value on done: 382568.0 [2024-08-06 03:28:24,363][52811] Sum rewards: 76.673, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.342', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.148', 'weapon5': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.266', 'WEAPON3': '0.900', 'weapon3': '3.132', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:24,451][52647] DAMAGECOUNT value on done: 430422.0 [2024-08-06 03:28:24,451][52647] Sum rewards: 69.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.476', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.186', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '56.000'} [2024-08-06 03:28:24,526][52803] DAMAGECOUNT value on done: 382028.0 [2024-08-06 03:28:24,529][52803] Sum rewards: 71.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.868', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.048', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon2': '0.428', 'WEAPON3': '0.900', 'HITCOUNT': '3.300', 'weapon3': '3.352', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:24,654][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:28:24,858][52662] DAMAGECOUNT value on done: 417791.0 [2024-08-06 03:28:24,862][52662] Sum rewards: 58.813, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.330', 'AMMO5': '0.027', 'AMMO2': '0.067', 'weapon4': '0.134', 'weapon5': '0.254', 'AMMO3': '0.272', 'AMMO4': '0.337', 'weapon2': '0.352', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.914', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:25,787][52667] DAMAGECOUNT value on done: 411095.0 [2024-08-06 03:28:25,789][52667] Sum rewards: 65.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.772', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.144', 'weapon4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.964', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '55.000'} [2024-08-06 03:28:26,446][52664] DAMAGECOUNT value on done: 428242.0 [2024-08-06 03:28:26,446][52664] Sum rewards: 74.646, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.378', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.212', 'AMMO3': '0.225', 'AMMO4': '0.230', 'weapon5': '0.262', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:26,504][52669] DAMAGECOUNT value on done: 417667.0 [2024-08-06 03:28:26,505][52669] Sum rewards: 72.213, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.405', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.122', 'AMMO4': '0.142', 'weapon5': '0.146', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.124', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:26,617][52665] DAMAGECOUNT value on done: 405436.0 [2024-08-06 03:28:26,619][52665] Sum rewards: 70.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.674', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.130', 'weapon4': '0.142', 'AMMO4': '0.206', 'AMMO3': '0.258', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:27,263][52668] DAMAGECOUNT value on done: 408908.0 [2024-08-06 03:28:27,263][52668] Sum rewards: 77.495, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.006', 'HEALTH': '0.012', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon4': '0.326', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:27,439][52647] DAMAGECOUNT value on done: 443341.0 [2024-08-06 03:28:27,439][52647] Sum rewards: 76.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon4': '0.212', 'AMMO3': '0.230', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:27,515][52811] DAMAGECOUNT value on done: 383212.0 [2024-08-06 03:28:27,515][52811] Sum rewards: 69.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.195', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.168', 'weapon5': '0.220', 'weapon2': '0.254', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.022', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:27,656][52803] DAMAGECOUNT value on done: 388671.0 [2024-08-06 03:28:27,659][52803] Sum rewards: 70.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.975', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.144', 'weapon2': '0.168', 'AMMO4': '0.224', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.344', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:27,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 377151488. Throughput: 0: 4362.4. Samples: 94296290. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:28:27,795][52567] Avg episode reward: [(0, '70.122')] [2024-08-06 03:28:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046039_377151488.pth... [2024-08-06 03:28:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045529_372973568.pth [2024-08-06 03:28:27,964][52662] DAMAGECOUNT value on done: 408453.0 [2024-08-06 03:28:27,964][52662] Sum rewards: 68.824, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon5': '0.168', 'weapon4': '0.276', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:28,654][52650] Updated weights for policy 0, policy_version 46041 (0.0026) [2024-08-06 03:28:28,734][52667] DAMAGECOUNT value on done: 419733.0 [2024-08-06 03:28:28,748][52667] Sum rewards: 67.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.157', 'weapon2': '0.200', 'AMMO3': '0.275', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.500'} [2024-08-06 03:28:28,820][52660] DAMAGECOUNT value on done: 410931.0 [2024-08-06 03:28:28,824][52660] Sum rewards: 75.649, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.117', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:28,944][52658] DAMAGECOUNT value on done: 411982.0 [2024-08-06 03:28:28,944][52658] Sum rewards: 75.445, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.845', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.142', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon5': '0.322', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:29,256][52665] DAMAGECOUNT value on done: 414451.0 [2024-08-06 03:28:29,257][52665] Sum rewards: 68.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.736', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.174', 'AMMO4': '0.210', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:29,380][52669] DAMAGECOUNT value on done: 414230.0 [2024-08-06 03:28:29,381][52669] Sum rewards: 69.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.195', 'weapon5': '0.240', 'weapon4': '0.266', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:29,410][52664] DAMAGECOUNT value on done: 426586.0 [2024-08-06 03:28:29,411][52664] Sum rewards: 80.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.018', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.118', 'weapon4': '0.148', 'AMMO4': '0.186', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '65.000'} [2024-08-06 03:28:30,191][52647] DAMAGECOUNT value on done: 432538.0 [2024-08-06 03:28:30,192][52647] Sum rewards: 67.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.200', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.198', 'AMMO3': '0.231', 'AMMO4': '0.265', 'weapon4': '0.318', 'weapon2': '0.422', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.750', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:30,520][52668] DAMAGECOUNT value on done: 412150.0 [2024-08-06 03:28:30,521][52668] Sum rewards: 73.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.201', 'AMMO3': '0.239', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:30,677][52811] DAMAGECOUNT value on done: 383680.0 [2024-08-06 03:28:30,677][52811] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.116', 'AMMO4': '0.159', 'AMMO3': '0.211', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:30,711][52803] DAMAGECOUNT value on done: 391215.0 [2024-08-06 03:28:30,711][52803] Sum rewards: 73.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.334', 'AMMO5': '0.008', 'weapon4': '0.046', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'AMMO3': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.306', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:30,764][52662] DAMAGECOUNT value on done: 419305.0 [2024-08-06 03:28:30,764][52662] Sum rewards: 73.659, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.386', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.288', 'weapon2': '0.338', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:31,577][52660] DAMAGECOUNT value on done: 405823.0 [2024-08-06 03:28:31,578][52660] Sum rewards: 75.088, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.397', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon2': '0.164', 'AMMO3': '0.165', 'weapon5': '0.198', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:31,969][52658] DAMAGECOUNT value on done: 415129.0 [2024-08-06 03:28:31,970][52658] Sum rewards: 71.145, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.144', 'AMMO5': '0.007', 'AMMO2': '0.057', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'AMMO4': '0.285', 'weapon2': '0.296', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '2.992', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:32,079][52664] DAMAGECOUNT value on done: 428011.0 [2024-08-06 03:28:32,079][52664] Sum rewards: 82.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.088', 'AMMO3': '0.217', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.322', 'weapon4': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '66.000'} [2024-08-06 03:28:32,241][52665] DAMAGECOUNT value on done: 412732.0 [2024-08-06 03:28:32,242][52665] Sum rewards: 77.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.122', 'weapon5': '0.164', 'AMMO4': '0.170', 'AMMO3': '0.193', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.500'} [2024-08-06 03:28:32,291][52669] DAMAGECOUNT value on done: 414727.0 [2024-08-06 03:28:32,292][52669] Sum rewards: 71.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.212', 'weapon2': '0.620', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:32,779][52647] DAMAGECOUNT value on done: 436309.0 [2024-08-06 03:28:32,780][52647] Sum rewards: 65.488, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.100', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.084', 'weapon4': '0.192', 'AMMO4': '0.195', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.202', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:32,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 377241600. Throughput: 0: 4362.0. Samples: 94309180. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:28:32,794][52567] Avg episode reward: [(0, '70.682')] [2024-08-06 03:28:32,919][52668] DAMAGECOUNT value on done: 417525.0 [2024-08-06 03:28:32,919][52668] Sum rewards: 79.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon2': '0.224', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'weapon3': '3.478', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '65.000'} [2024-08-06 03:28:33,206][52650] Updated weights for policy 0, policy_version 46051 (0.0022) [2024-08-06 03:28:33,762][52811] DAMAGECOUNT value on done: 385710.0 [2024-08-06 03:28:33,762][52811] Sum rewards: 77.977, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.012', 'HEALTH': '0.025', 'AMMO4': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.156', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:33,787][52662] DAMAGECOUNT value on done: 411365.0 [2024-08-06 03:28:33,789][52662] Sum rewards: 61.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.490', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.104', 'AMMO4': '0.176', 'weapon5': '0.212', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.720', 'WEAPON3': '1.400', 'weapon3': '2.674', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:33,898][52803] DAMAGECOUNT value on done: 390868.0 [2024-08-06 03:28:33,899][52803] Sum rewards: 71.183, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.345', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.135', 'AMMO4': '0.175', 'weapon5': '0.182', 'WEAPON5': '0.350', 'weapon4': '0.398', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.750', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:34,248][52660] DAMAGECOUNT value on done: 419223.0 [2024-08-06 03:28:34,250][52660] Sum rewards: 59.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.898', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.080', 'AMMO3': '0.138', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.220', 'weapon2': '0.872', 'WEAPON3': '0.950', 'weapon3': '2.626', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '48.000'} [2024-08-06 03:28:35,088][52669] DAMAGECOUNT value on done: 418840.0 [2024-08-06 03:28:35,089][52669] Sum rewards: 72.914, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.825', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.022', 'weapon5': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.410', 'weapon3': '3.428', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:35,133][52647] DAMAGECOUNT value on done: 428557.0 [2024-08-06 03:28:35,134][52647] Sum rewards: 68.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.578', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.084', 'AMMO4': '0.160', 'weapon5': '0.174', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:35,207][52658] DAMAGECOUNT value on done: 420159.0 [2024-08-06 03:28:35,208][52658] Sum rewards: 69.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.916', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.448', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:35,290][52665] DAMAGECOUNT value on done: 407721.0 [2024-08-06 03:28:35,291][52665] Sum rewards: 66.610, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.130', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.292', 'weapon4': '0.448', 'WEAPON3': '1.700', 'weapon3': '2.890', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:35,943][52668] DAMAGECOUNT value on done: 414460.0 [2024-08-06 03:28:35,944][52668] Sum rewards: 67.741, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'AMMO3': '0.120', 'weapon4': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '0.950', 'weapon3': '2.996', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:36,780][52811] DAMAGECOUNT value on done: 391828.0 [2024-08-06 03:28:36,781][52811] Sum rewards: 78.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.172', 'AMMO3': '0.236', 'weapon4': '0.270', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 03:28:36,969][52662] DAMAGECOUNT value on done: 422463.0 [2024-08-06 03:28:36,972][52662] Sum rewards: 74.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.121', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:37,022][52803] DAMAGECOUNT value on done: 378241.0 [2024-08-06 03:28:37,023][52803] Sum rewards: 67.849, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.042', 'weapon5': '0.054', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.300', 'weapon3': '3.380', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:37,249][52660] DAMAGECOUNT value on done: 420897.0 [2024-08-06 03:28:37,249][52660] Sum rewards: 65.566, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.811', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.142', 'AMMO4': '0.162', 'weapon5': '0.228', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.740', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:37,622][52647] DAMAGECOUNT value on done: 434765.0 [2024-08-06 03:28:37,623][52647] Sum rewards: 74.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.433', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.148', 'weapon4': '0.186', 'AMMO3': '0.197', 'AMMO4': '0.244', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '61.500'} [2024-08-06 03:28:37,638][52669] DAMAGECOUNT value on done: 413273.0 [2024-08-06 03:28:37,638][52669] Sum rewards: 79.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.108', 'weapon5': '0.128', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '67.000'} [2024-08-06 03:28:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 377323520. Throughput: 0: 4359.5. Samples: 94335600. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:28:37,795][52567] Avg episode reward: [(0, '70.942')] [2024-08-06 03:28:37,878][52650] Updated weights for policy 0, policy_version 46061 (0.0012) [2024-08-06 03:28:38,348][52658] DAMAGECOUNT value on done: 416445.0 [2024-08-06 03:28:38,349][52658] Sum rewards: 57.142, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.273', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon7': '0.058', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.150', 'weapon5': '0.186', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon4': '0.864', 'weapon3': '2.406', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '46.000'} [2024-08-06 03:28:38,413][52665] DAMAGECOUNT value on done: 400939.0 [2024-08-06 03:28:38,414][52665] Sum rewards: 64.437, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.667', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.151', 'AMMO4': '0.212', 'weapon5': '0.214', 'weapon4': '0.252', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.854', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:38,962][52668] DAMAGECOUNT value on done: 408997.0 [2024-08-06 03:28:38,962][52668] Sum rewards: 71.106, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.160', 'weapon5': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.202', 'AMMO4': '0.245', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:39,563][52662] DAMAGECOUNT value on done: 423972.0 [2024-08-06 03:28:39,564][52662] Sum rewards: 79.965, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.166', 'weapon2': '0.286', 'HEALTH': '0.940', 'WEAPON3': '0.950', 'weapon3': '3.344', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:39,825][52811] DAMAGECOUNT value on done: 386987.0 [2024-08-06 03:28:39,825][52811] Sum rewards: 84.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.136', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '71.000'} [2024-08-06 03:28:40,139][52647] DAMAGECOUNT value on done: 431081.0 [2024-08-06 03:28:40,140][52647] Sum rewards: 57.163, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.402', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon5': '0.202', 'weapon4': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.600', 'weapon3': '2.766', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:40,179][52671] DAMAGECOUNT value on done: 417715.0 [2024-08-06 03:28:40,180][52671] Sum rewards: 73.136, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.665', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.506', 'WEAPON3': '1.050', 'HITCOUNT': '3.320', 'weapon3': '3.340', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:40,190][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:28:40,251][52660] DAMAGECOUNT value on done: 411576.0 [2024-08-06 03:28:40,252][52660] Sum rewards: 58.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'weapon4': '0.152', 'AMMO4': '0.153', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.248', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '48.000'} [2024-08-06 03:28:40,252][52803] DAMAGECOUNT value on done: 382255.0 [2024-08-06 03:28:40,252][52803] Sum rewards: 76.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon4': '0.070', 'AMMO4': '0.195', 'weapon5': '0.208', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:40,898][52669] DAMAGECOUNT value on done: 419223.0 [2024-08-06 03:28:40,898][52669] Sum rewards: 72.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.062', 'AMMO3': '0.163', 'AMMO4': '0.165', 'weapon5': '0.170', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.260', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:41,079][52658] DAMAGECOUNT value on done: 407768.0 [2024-08-06 03:28:41,079][52658] Sum rewards: 52.815, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.275', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon5': '0.252', 'AMMO3': '0.261', 'weapon2': '0.324', 'AMMO4': '0.332', 'weapon4': '0.402', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.636', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '47.000'} [2024-08-06 03:28:41,549][52665] DAMAGECOUNT value on done: 402984.0 [2024-08-06 03:28:41,549][52665] Sum rewards: 68.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.454', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon2': '0.214', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'HITCOUNT': '3.430', 'weapon3': '3.610', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:41,901][52668] DAMAGECOUNT value on done: 404476.0 [2024-08-06 03:28:41,901][52668] Sum rewards: 65.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.045', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.150', 'HITCOUNT': '3.380', 'weapon3': '3.472', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:42,438][52662] DAMAGECOUNT value on done: 412834.0 [2024-08-06 03:28:42,439][52662] Sum rewards: 62.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.473', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.199', 'weapon2': '0.202', 'weapon5': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '51.500'} [2024-08-06 03:28:42,480][52671] DAMAGECOUNT value on done: 417579.0 [2024-08-06 03:28:42,480][52671] Sum rewards: 72.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.758', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.144', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:42,744][52650] Updated weights for policy 0, policy_version 46071 (0.0011) [2024-08-06 03:28:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 377413632. Throughput: 0: 4360.2. Samples: 94361810. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:28:42,794][52567] Avg episode reward: [(0, '70.223')] [2024-08-06 03:28:42,794][52647] DAMAGECOUNT value on done: 441782.0 [2024-08-06 03:28:42,795][52647] Sum rewards: 74.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.776', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.102', 'weapon5': '0.134', 'AMMO4': '0.169', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:42,864][52811] DAMAGECOUNT value on done: 386152.0 [2024-08-06 03:28:42,865][52811] Sum rewards: 64.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'weapon5': '0.108', 'AMMO3': '0.207', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:42,996][52660] DAMAGECOUNT value on done: 409824.0 [2024-08-06 03:28:42,997][52660] Sum rewards: 66.679, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.480', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.144', 'weapon4': '0.184', 'weapon5': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.478', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:43,392][52803] DAMAGECOUNT value on done: 381714.0 [2024-08-06 03:28:43,392][52803] Sum rewards: 73.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.503', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.166', 'AMMO3': '0.200', 'weapon4': '0.222', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:43,999][52669] DAMAGECOUNT value on done: 413981.0 [2024-08-06 03:28:44,008][52669] Sum rewards: 73.087, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.324', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.116', 'weapon5': '0.122', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:44,084][52658] DAMAGECOUNT value on done: 413169.0 [2024-08-06 03:28:44,084][52658] Sum rewards: 66.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.382', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.179', 'AMMO4': '0.214', 'weapon4': '0.222', 'weapon5': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '52.500'} [2024-08-06 03:28:44,528][52668] DAMAGECOUNT value on done: 406129.0 [2024-08-06 03:28:44,529][52668] Sum rewards: 66.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.275', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.173', 'AMMO3': '0.204', 'weapon2': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:44,654][52665] DAMAGECOUNT value on done: 407233.0 [2024-08-06 03:28:44,656][52665] Sum rewards: 63.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.835', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'weapon4': '0.112', 'AMMO3': '0.267', 'weapon2': '0.436', 'WEAPON3': '1.700', 'weapon3': '3.210', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2024-08-06 03:28:45,101][52671] DAMAGECOUNT value on done: 416546.0 [2024-08-06 03:28:45,102][52671] Sum rewards: 72.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.216', 'AMMO3': '0.234', 'AMMO4': '0.292', 'weapon2': '0.374', 'weapon4': '0.382', 'WEAPON5': '0.400', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.750', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:45,513][52647] DAMAGECOUNT value on done: 432213.0 [2024-08-06 03:28:45,515][52647] Sum rewards: 55.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.984', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.102', 'AMMO4': '0.230', 'AMMO3': '0.251', 'weapon5': '0.270', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.830', 'weapon3': '3.028', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '48.500'} [2024-08-06 03:28:45,518][52662] DAMAGECOUNT value on done: 425803.0 [2024-08-06 03:28:45,520][52662] Sum rewards: 67.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.082', 'AMMO4': '0.168', 'weapon5': '0.182', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.072', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:45,628][52660] DAMAGECOUNT value on done: 413679.0 [2024-08-06 03:28:45,628][52660] Sum rewards: 66.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.127', 'weapon5': '0.222', 'AMMO4': '0.246', 'weapon2': '0.304', 'WEAPON5': '0.350', 'weapon4': '0.536', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon3': '2.674', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '51.000'} [2024-08-06 03:28:45,859][52811] DAMAGECOUNT value on done: 388911.0 [2024-08-06 03:28:45,861][52811] Sum rewards: 48.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.068', 'weapon5': '0.168', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'AMMO4': '0.339', 'weapon2': '0.354', 'WEAPON4': '0.450', 'weapon4': '0.452', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '41.500'} [2024-08-06 03:28:46,452][52803] DAMAGECOUNT value on done: 388858.0 [2024-08-06 03:28:46,455][52803] Sum rewards: 84.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.077', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.144', 'AMMO4': '0.199', 'weapon5': '0.204', 'AMMO3': '0.208', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '68.000'} [2024-08-06 03:28:46,493][52658] DAMAGECOUNT value on done: 416691.0 [2024-08-06 03:28:46,493][52658] Sum rewards: 69.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.960', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.124', 'weapon5': '0.144', 'AMMO4': '0.179', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '56.000'} [2024-08-06 03:28:46,931][52669] DAMAGECOUNT value on done: 406541.0 [2024-08-06 03:28:46,933][52669] Sum rewards: 58.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.124', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.128', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '50.000'} [2024-08-06 03:28:47,235][52668] DAMAGECOUNT value on done: 405059.0 [2024-08-06 03:28:47,238][52668] Sum rewards: 74.588, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.512', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.041', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.372', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:47,423][52650] Updated weights for policy 0, policy_version 46081 (0.0012) [2024-08-06 03:28:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 377503744. Throughput: 0: 4361.8. Samples: 94374970. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:28:47,794][52567] Avg episode reward: [(0, '69.969')] [2024-08-06 03:28:47,799][52665] DAMAGECOUNT value on done: 412137.0 [2024-08-06 03:28:47,801][52665] Sum rewards: 72.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.927', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.040', 'weapon5': '0.060', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:48,228][52671] DAMAGECOUNT value on done: 416610.0 [2024-08-06 03:28:48,229][52671] Sum rewards: 72.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.207', 'weapon5': '0.254', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:48,342][52647] DAMAGECOUNT value on done: 428610.0 [2024-08-06 03:28:48,343][52647] Sum rewards: 60.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.284', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.112', 'AMMO3': '0.228', 'weapon2': '0.962', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '51.000'} [2024-08-06 03:28:48,527][52662] DAMAGECOUNT value on done: 411750.0 [2024-08-06 03:28:48,530][52662] Sum rewards: 68.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.962', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.110', 'AMMO4': '0.134', 'weapon5': '0.170', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.208', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '55.000'} [2024-08-06 03:28:49,010][52660] DAMAGECOUNT value on done: 419360.0 [2024-08-06 03:28:49,012][52660] Sum rewards: 71.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.254', 'weapon4': '0.288', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:49,168][52811] DAMAGECOUNT value on done: 387539.0 [2024-08-06 03:28:49,169][52811] Sum rewards: 77.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.475', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.028', 'AMMO4': '0.103', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.514', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '66.000'} [2024-08-06 03:28:49,263][52658] DAMAGECOUNT value on done: 408523.0 [2024-08-06 03:28:49,266][52658] Sum rewards: 64.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'AMMO5': '0.021', 'AMMO2': '0.039', 'weapon4': '0.112', 'AMMO3': '0.191', 'AMMO4': '0.194', 'weapon5': '0.278', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:49,493][52803] DAMAGECOUNT value on done: 380784.0 [2024-08-06 03:28:49,493][52803] Sum rewards: 75.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.550', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:49,915][52669] DAMAGECOUNT value on done: 418287.0 [2024-08-06 03:28:49,918][52669] Sum rewards: 75.459, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.130', 'weapon4': '0.130', 'weapon2': '0.600', 'WEAPON3': '0.900', 'weapon3': '3.040', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:50,461][52668] DAMAGECOUNT value on done: 411031.0 [2024-08-06 03:28:50,462][52668] Sum rewards: 68.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.838', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.132', 'weapon5': '0.134', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:50,825][52671] DAMAGECOUNT value on done: 423615.0 [2024-08-06 03:28:50,825][52671] Sum rewards: 72.314, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.968', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.171', 'weapon5': '0.186', 'AMMO3': '0.283', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.134', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:51,003][52665] DAMAGECOUNT value on done: 413002.0 [2024-08-06 03:28:51,005][52665] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon5': '0.242', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.084', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:51,239][52662] DAMAGECOUNT value on done: 416027.0 [2024-08-06 03:28:51,240][52662] Sum rewards: 62.580, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.305', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.096', 'weapon5': '0.208', 'AMMO3': '0.226', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:51,246][52647] DAMAGECOUNT value on done: 431278.0 [2024-08-06 03:28:51,247][52647] Sum rewards: 80.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.385', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.098', 'AMMO4': '0.153', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '67.000'} [2024-08-06 03:28:51,968][52650] Updated weights for policy 0, policy_version 46091 (0.0034) [2024-08-06 03:28:52,144][52660] DAMAGECOUNT value on done: 416860.0 [2024-08-06 03:28:52,146][52660] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.502', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon7': '0.040', 'AMMO4': '0.061', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:52,210][52811] DAMAGECOUNT value on done: 385640.0 [2024-08-06 03:28:52,212][52811] Sum rewards: 69.992, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.328', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.210', 'AMMO4': '0.221', 'weapon2': '0.234', 'weapon4': '0.260', 'AMMO3': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.000', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '59.000'} [2024-08-06 03:28:52,301][52658] DAMAGECOUNT value on done: 422693.0 [2024-08-06 03:28:52,303][52658] Sum rewards: 79.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.539', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.084', 'AMMO4': '0.115', 'weapon2': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.552', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:52,625][52803] DAMAGECOUNT value on done: 390709.0 [2024-08-06 03:28:52,626][52803] Sum rewards: 64.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.104', 'AMMO3': '0.174', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:52,677][52669] DAMAGECOUNT value on done: 421572.0 [2024-08-06 03:28:52,677][52669] Sum rewards: 67.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.130', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.032', 'AMMO4': '0.149', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.236', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 377585664. Throughput: 0: 4359.6. Samples: 94401090. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:28:52,795][52567] Avg episode reward: [(0, '70.022')] [2024-08-06 03:28:53,635][52668] DAMAGECOUNT value on done: 415975.0 [2024-08-06 03:28:53,637][52668] Sum rewards: 71.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.760', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.295', 'weapon2': '0.388', 'WEAPON3': '1.750', 'weapon3': '3.380', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '63.000'} [2024-08-06 03:28:53,774][52662] DAMAGECOUNT value on done: 416348.0 [2024-08-06 03:28:53,775][52662] Sum rewards: 49.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.357', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.066', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.644', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.004', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '42.000'} [2024-08-06 03:28:53,857][52671] DAMAGECOUNT value on done: 414529.0 [2024-08-06 03:28:53,858][52671] Sum rewards: 80.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.774', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '68.000'} [2024-08-06 03:28:53,966][52647] DAMAGECOUNT value on done: 430840.0 [2024-08-06 03:28:53,966][52647] Sum rewards: 78.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.300', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.140', 'AMMO4': '0.164', 'weapon5': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.598', 'weapon4': '0.696', 'WEAPON3': '0.950', 'weapon3': '2.300', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:54,036][52665] DAMAGECOUNT value on done: 409699.0 [2024-08-06 03:28:54,037][52665] Sum rewards: 70.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.469', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.164', 'AMMO3': '0.175', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:54,629][52658] DAMAGECOUNT value on done: 415069.0 [2024-08-06 03:28:54,629][52658] Sum rewards: 71.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.956', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.104', 'AMMO3': '0.166', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '57.000'} [2024-08-06 03:28:55,379][52660] DAMAGECOUNT value on done: 411161.0 [2024-08-06 03:28:55,379][52660] Sum rewards: 61.927, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.902', 'AMMO5': '0.025', 'AMMO2': '0.050', 'AMMO3': '0.160', 'weapon4': '0.160', 'AMMO4': '0.252', 'weapon5': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '2.438', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.376', 'FRAGCOUNT': '50.000'} [2024-08-06 03:28:55,411][52811] DAMAGECOUNT value on done: 396877.0 [2024-08-06 03:28:55,411][52811] Sum rewards: 69.649, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.395', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.163', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.434', 'weapon4': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.538', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:55,570][52669] DAMAGECOUNT value on done: 429078.0 [2024-08-06 03:28:55,572][52669] Sum rewards: 79.569, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.094', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.320', 'weapon2': '0.340', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '64.000'} [2024-08-06 03:28:55,658][52803] DAMAGECOUNT value on done: 386494.0 [2024-08-06 03:28:55,658][52803] Sum rewards: 67.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.212', 'AMMO3': '0.216', 'weapon2': '0.264', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '56.000'} [2024-08-06 03:28:56,578][52650] Updated weights for policy 0, policy_version 46101 (0.0018) [2024-08-06 03:28:56,824][52662] DAMAGECOUNT value on done: 421952.0 [2024-08-06 03:28:56,826][52662] Sum rewards: 63.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.078', 'AMMO3': '0.165', 'AMMO4': '0.187', 'weapon5': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.902', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '51.000'} [2024-08-06 03:28:56,864][52665] DAMAGECOUNT value on done: 415633.0 [2024-08-06 03:28:56,865][52665] Sum rewards: 63.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.196', 'AMMO3': '0.206', 'weapon4': '0.232', 'WEAPON5': '0.250', 'AMMO4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.000'} [2024-08-06 03:28:56,921][52671] DAMAGECOUNT value on done: 422628.0 [2024-08-06 03:28:56,921][52671] Sum rewards: 71.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:56,935][52668] DAMAGECOUNT value on done: 412674.0 [2024-08-06 03:28:56,936][52668] Sum rewards: 66.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.000'} [2024-08-06 03:28:57,182][52658] DAMAGECOUNT value on done: 425652.0 [2024-08-06 03:28:57,182][52658] Sum rewards: 80.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.622', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.132', 'weapon4': '0.182', 'AMMO4': '0.187', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.212', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '66.000'} [2024-08-06 03:28:57,201][52647] DAMAGECOUNT value on done: 431208.0 [2024-08-06 03:28:57,201][52647] Sum rewards: 64.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.164', 'weapon5': '0.180', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 377675776. Throughput: 0: 4367.1. Samples: 94427610. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:28:57,795][52567] Avg episode reward: [(0, '69.878')] [2024-08-06 03:28:58,209][52660] DAMAGECOUNT value on done: 422537.0 [2024-08-06 03:28:58,212][52660] Sum rewards: 66.704, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.434', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.165', 'AMMO4': '0.189', 'weapon5': '0.198', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.592', 'WEAPON3': '1.000', 'weapon3': '2.618', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '52.000'} [2024-08-06 03:28:58,213][52669] DAMAGECOUNT value on done: 416274.0 [2024-08-06 03:28:58,213][52669] Sum rewards: 62.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.116', 'weapon5': '0.134', 'AMMO4': '0.174', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '51.000'} [2024-08-06 03:28:58,519][52811] DAMAGECOUNT value on done: 385969.0 [2024-08-06 03:28:58,520][52811] Sum rewards: 72.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.014', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.211', 'weapon5': '0.214', 'weapon4': '0.216', 'AMMO4': '0.219', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '60.000'} [2024-08-06 03:28:58,720][52803] DAMAGECOUNT value on done: 387185.0 [2024-08-06 03:28:58,721][52803] Sum rewards: 74.599, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.009', 'AMMO2': '0.014', 'HEALTH': '0.042', 'AMMO4': '0.071', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '0.900', 'weapon3': '3.076', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '58.000'} [2024-08-06 03:28:59,309][52668] DAMAGECOUNT value on done: 418147.0 [2024-08-06 03:28:59,310][52668] Sum rewards: 75.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.470', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.120', 'AMMO3': '0.169', 'weapon5': '0.200', 'AMMO4': '0.237', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.664', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '61.000'} [2024-08-06 03:28:59,655][52662] DAMAGECOUNT value on done: 414486.0 [2024-08-06 03:28:59,656][52662] Sum rewards: 65.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.190', 'weapon2': '0.220', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.602', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '53.000'} [2024-08-06 03:28:59,868][52658] DAMAGECOUNT value on done: 406223.0 [2024-08-06 03:28:59,868][52658] Sum rewards: 71.781, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.058', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.223', 'AMMO3': '0.251', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '62.000'} [2024-08-06 03:28:59,995][52671] DAMAGECOUNT value on done: 418965.0 [2024-08-06 03:28:59,997][52671] Sum rewards: 77.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.844', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.302', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:00,114][52665] DAMAGECOUNT value on done: 410780.0 [2024-08-06 03:29:00,116][52665] Sum rewards: 70.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.844', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.104', 'AMMO3': '0.159', 'weapon5': '0.188', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.016', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:00,526][52660] DAMAGECOUNT value on done: 406229.0 [2024-08-06 03:29:00,526][52660] Sum rewards: 71.154, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.171', 'AMMO4': '0.235', 'weapon5': '0.250', 'weapon2': '0.286', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.562', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:00,559][52795] DAMAGECOUNT value on done: 385546.0 [2024-08-06 03:29:00,559][52795] Sum rewards: 79.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.695', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.191', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:01,227][52669] DAMAGECOUNT value on done: 418401.0 [2024-08-06 03:29:01,229][52669] Sum rewards: 73.969, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:01,315][52650] Updated weights for policy 0, policy_version 46111 (0.0029) [2024-08-06 03:29:01,528][52811] DAMAGECOUNT value on done: 384299.0 [2024-08-06 03:29:01,532][52811] Sum rewards: 58.401, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.180', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.124', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.516', 'WEAPON3': '0.850', 'HITCOUNT': '2.790', 'weapon3': '2.902', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '47.000'} [2024-08-06 03:29:01,623][52668] DAMAGECOUNT value on done: 411244.0 [2024-08-06 03:29:01,624][52668] Sum rewards: 64.836, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.036', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.130', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '53.000'} [2024-08-06 03:29:01,808][52803] DAMAGECOUNT value on done: 390943.0 [2024-08-06 03:29:01,810][52803] Sum rewards: 81.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.472', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '66.000'} [2024-08-06 03:29:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 377765888. Throughput: 0: 4372.4. Samples: 94440620. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:29:02,802][52567] Avg episode reward: [(0, '69.515')] [2024-08-06 03:29:02,823][52662] DAMAGECOUNT value on done: 425228.0 [2024-08-06 03:29:02,825][52662] Sum rewards: 63.411, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.774', 'AMMO5': '0.025', 'AMMO2': '0.068', 'weapon4': '0.208', 'weapon5': '0.244', 'AMMO3': '0.287', 'AMMO4': '0.342', 'weapon2': '0.344', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.812', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '57.000'} [2024-08-06 03:29:02,829][52658] DAMAGECOUNT value on done: 416598.0 [2024-08-06 03:29:02,829][52658] Sum rewards: 70.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.300', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.424', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '59.000'} [2024-08-06 03:29:03,077][52665] DAMAGECOUNT value on done: 407801.0 [2024-08-06 03:29:03,077][52665] Sum rewards: 74.464, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.086', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.068', 'weapon4': '0.104', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '63.500'} [2024-08-06 03:29:03,107][52660] DAMAGECOUNT value on done: 409905.0 [2024-08-06 03:29:03,109][52660] Sum rewards: 78.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.375', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.092', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:03,114][52671] DAMAGECOUNT value on done: 413350.0 [2024-08-06 03:29:03,115][52671] Sum rewards: 77.115, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.454', 'HEALTH': '0.777', 'WEAPON3': '0.950', 'weapon3': '3.090', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:03,717][52795] DAMAGECOUNT value on done: 375684.0 [2024-08-06 03:29:03,718][52795] Sum rewards: 73.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.187', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.122', 'AMMO4': '0.143', 'weapon5': '0.156', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '59.500'} [2024-08-06 03:29:04,324][52669] DAMAGECOUNT value on done: 419577.0 [2024-08-06 03:29:04,325][52669] Sum rewards: 67.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.498', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.224', 'weapon5': '0.228', 'weapon4': '0.258', 'AMMO4': '0.270', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:04,594][52811] DAMAGECOUNT value on done: 389145.0 [2024-08-06 03:29:04,596][52811] Sum rewards: 78.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.168', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.458', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:04,860][52803] DAMAGECOUNT value on done: 385106.0 [2024-08-06 03:29:04,861][52803] Sum rewards: 80.431, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.569', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon2': '0.116', 'AMMO4': '0.138', 'AMMO3': '0.164', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.556', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '63.000'} [2024-08-06 03:29:05,186][52658] DAMAGECOUNT value on done: 410622.0 [2024-08-06 03:29:05,188][52658] Sum rewards: 74.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.096', 'weapon4': '0.128', 'AMMO4': '0.141', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '61.000'} [2024-08-06 03:29:05,744][52650] Updated weights for policy 0, policy_version 46121 (0.0013) [2024-08-06 03:29:05,792][52665] DAMAGECOUNT value on done: 407553.0 [2024-08-06 03:29:05,794][52665] Sum rewards: 72.842, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.569', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'weapon3': '3.206', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '65.000'} [2024-08-06 03:29:05,976][52794] DAMAGECOUNT value on done: 416387.0 [2024-08-06 03:29:05,979][52794] Sum rewards: 72.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.616', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.106', 'weapon4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '61.000'} [2024-08-06 03:29:05,996][52662] DAMAGECOUNT value on done: 419382.0 [2024-08-06 03:29:05,999][52662] Sum rewards: 72.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.237', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '60.500'} [2024-08-06 03:29:06,016][52660] DAMAGECOUNT value on done: 423518.0 [2024-08-06 03:29:06,017][52660] Sum rewards: 70.900, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.758', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.212', 'weapon2': '0.326', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '59.000'} [2024-08-06 03:29:06,154][52671] DAMAGECOUNT value on done: 421427.0 [2024-08-06 03:29:06,154][52671] Sum rewards: 79.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.778', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '65.000'} [2024-08-06 03:29:06,795][52795] DAMAGECOUNT value on done: 376495.0 [2024-08-06 03:29:06,796][52795] Sum rewards: 75.001, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.525', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.042', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.273', 'WEAPON3': '1.600', 'weapon3': '3.474', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:07,474][52658] DAMAGECOUNT value on done: 411385.0 [2024-08-06 03:29:07,475][52658] Sum rewards: 71.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.112', 'AMMO5': '0.009', 'AMMO2': '0.056', 'weapon5': '0.118', 'weapon2': '0.170', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'WEAPON4': '0.400', 'weapon4': '0.604', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:07,623][52649] DAMAGECOUNT value on done: 400740.0 [2024-08-06 03:29:07,624][52649] Sum rewards: 60.361, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.032', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.127', 'weapon5': '0.146', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '0.850', 'HITCOUNT': '2.950', 'weapon3': '3.020', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '46.000'} [2024-08-06 03:29:07,644][52669] DAMAGECOUNT value on done: 421450.0 [2024-08-06 03:29:07,646][52669] Sum rewards: 77.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.575', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.132', 'AMMO3': '0.160', 'AMMO4': '0.164', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '63.000'} [2024-08-06 03:29:07,711][52811] DAMAGECOUNT value on done: 383407.0 [2024-08-06 03:29:07,711][52811] Sum rewards: 75.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.147', 'weapon4': '0.186', 'weapon2': '0.218', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 377856000. Throughput: 0: 4372.3. Samples: 94467170. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:29:07,802][52567] Avg episode reward: [(0, '70.236')] [2024-08-06 03:29:07,971][52803] DAMAGECOUNT value on done: 383845.0 [2024-08-06 03:29:07,972][52803] Sum rewards: 68.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.161', 'weapon4': '0.178', 'weapon5': '0.196', 'AMMO4': '0.224', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.162', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:08,323][52665] DAMAGECOUNT value on done: 411687.0 [2024-08-06 03:29:08,326][52665] Sum rewards: 64.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.106', 'weapon5': '0.108', 'AMMO4': '0.195', 'AMMO3': '0.205', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 03:29:08,887][52662] DAMAGECOUNT value on done: 415275.0 [2024-08-06 03:29:08,887][52662] Sum rewards: 65.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.218', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.240', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '55.000'} [2024-08-06 03:29:08,896][52794] DAMAGECOUNT value on done: 421071.0 [2024-08-06 03:29:08,896][52794] Sum rewards: 74.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.726', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.198', 'AMMO3': '0.211', 'weapon5': '0.242', 'AMMO4': '0.245', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '60.500'} [2024-08-06 03:29:09,053][52660] DAMAGECOUNT value on done: 427952.0 [2024-08-06 03:29:09,053][52660] Sum rewards: 79.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.016', 'weapon4': '0.048', 'AMMO2': '0.048', 'weapon5': '0.152', 'AMMO3': '0.215', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '66.000'} [2024-08-06 03:29:09,324][52671] DAMAGECOUNT value on done: 424942.0 [2024-08-06 03:29:09,326][52671] Sum rewards: 79.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.301', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.148', 'AMMO4': '0.165', 'weapon5': '0.198', 'AMMO3': '0.200', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:09,949][52795] DAMAGECOUNT value on done: 382811.0 [2024-08-06 03:29:09,950][52795] Sum rewards: 76.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.148', 'weapon5': '0.192', 'AMMO4': '0.194', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:10,185][52658] DAMAGECOUNT value on done: 408204.0 [2024-08-06 03:29:10,185][52658] Sum rewards: 72.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.007', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '61.000'} [2024-08-06 03:29:10,577][52650] Updated weights for policy 0, policy_version 46131 (0.0017) [2024-08-06 03:29:10,629][52649] DAMAGECOUNT value on done: 397746.0 [2024-08-06 03:29:10,629][52649] Sum rewards: 58.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.570', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.160', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '50.000'} [2024-08-06 03:29:10,711][52811] DAMAGECOUNT value on done: 386590.0 [2024-08-06 03:29:10,714][52811] Sum rewards: 67.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.084', 'AMMO4': '0.092', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.530', 'WEAPON3': '1.500', 'weapon3': '2.686', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '59.000'} [2024-08-06 03:29:10,938][52795] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:29:11,155][52665] DAMAGECOUNT value on done: 409331.0 [2024-08-06 03:29:11,156][52665] Sum rewards: 60.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.090', 'AMMO4': '0.147', 'weapon2': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.478', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '52.000'} [2024-08-06 03:29:11,163][52803] DAMAGECOUNT value on done: 392868.0 [2024-08-06 03:29:11,163][52803] Sum rewards: 67.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.671', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.104', 'weapon5': '0.160', 'AMMO3': '0.234', 'AMMO4': '0.255', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '57.000'} [2024-08-06 03:29:11,797][52662] DAMAGECOUNT value on done: 411395.0 [2024-08-06 03:29:11,799][52662] Sum rewards: 56.969, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.084', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.178', 'AMMO4': '0.190', 'weapon5': '0.264', 'AMMO3': '0.293', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'HITCOUNT': '2.820', 'weapon3': '2.840', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '52.000'} [2024-08-06 03:29:11,819][52794] DAMAGECOUNT value on done: 417881.0 [2024-08-06 03:29:11,819][52794] Sum rewards: 80.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.404', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.118', 'weapon5': '0.134', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:12,094][52660] DAMAGECOUNT value on done: 408989.0 [2024-08-06 03:29:12,094][52660] Sum rewards: 72.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.194', 'weapon5': '0.196', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:12,611][52671] DAMAGECOUNT value on done: 415357.0 [2024-08-06 03:29:12,611][52671] Sum rewards: 79.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.716', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.148', 'AMMO4': '0.187', 'weapon2': '0.214', 'weapon5': '0.230', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '66.000'} [2024-08-06 03:29:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 377937920. Throughput: 0: 4379.1. Samples: 94493350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:29:12,794][52567] Avg episode reward: [(0, '70.483')] [2024-08-06 03:29:13,061][52658] DAMAGECOUNT value on done: 421230.0 [2024-08-06 03:29:13,061][52658] Sum rewards: 58.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.696', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.171', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '51.000'} [2024-08-06 03:29:13,114][52795] DAMAGECOUNT value on done: 378090.0 [2024-08-06 03:29:13,114][52795] Sum rewards: 66.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.180', 'AMMO3': '0.205', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.112', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '55.000'} [2024-08-06 03:29:13,181][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:29:13,404][52649] DAMAGECOUNT value on done: 405528.0 [2024-08-06 03:29:13,406][52649] Sum rewards: 67.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.046', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.124', 'AMMO4': '0.166', 'weapon2': '0.204', 'weapon4': '0.206', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.282', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '55.000'} [2024-08-06 03:29:13,785][52811] DAMAGECOUNT value on done: 387822.0 [2024-08-06 03:29:13,785][52811] Sum rewards: 72.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.253', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.080', 'AMMO3': '0.248', 'weapon2': '0.428', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:13,977][52665] DAMAGECOUNT value on done: 404701.0 [2024-08-06 03:29:13,977][52665] Sum rewards: 57.619, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.515', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon5': '0.134', 'weapon4': '0.138', 'AMMO3': '0.276', 'AMMO4': '0.323', 'weapon2': '0.422', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.990', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '54.000'} [2024-08-06 03:29:14,244][52803] DAMAGECOUNT value on done: 389036.0 [2024-08-06 03:29:14,245][52803] Sum rewards: 52.389, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.230', 'AMMO5': '0.027', 'AMMO2': '0.077', 'AMMO3': '0.271', 'weapon2': '0.288', 'weapon4': '0.304', 'weapon5': '0.378', 'AMMO4': '0.384', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.650', 'weapon3': '2.632', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '47.000'} [2024-08-06 03:29:14,911][52662] DAMAGECOUNT value on done: 410186.0 [2024-08-06 03:29:14,915][52662] Sum rewards: 77.316, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '65.000'} [2024-08-06 03:29:14,983][52794] DAMAGECOUNT value on done: 412805.0 [2024-08-06 03:29:14,983][52794] Sum rewards: 67.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.182', 'AMMO3': '0.189', 'AMMO4': '0.243', 'weapon2': '0.264', 'weapon4': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:15,301][52650] Updated weights for policy 0, policy_version 46141 (0.0023) [2024-08-06 03:29:15,354][52660] DAMAGECOUNT value on done: 414108.0 [2024-08-06 03:29:15,356][52660] Sum rewards: 81.865, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.025', 'HEALTH': '0.096', 'AMMO4': '0.127', 'AMMO3': '0.182', 'weapon4': '0.218', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:15,454][52671] DAMAGECOUNT value on done: 423274.0 [2024-08-06 03:29:15,454][52671] Sum rewards: 63.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.498', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.181', 'weapon4': '0.248', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.752', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '51.000'} [2024-08-06 03:29:15,650][52658] DAMAGECOUNT value on done: 413290.0 [2024-08-06 03:29:15,650][52658] Sum rewards: 70.967, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.909', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.100', 'weapon5': '0.168', 'AMMO4': '0.199', 'AMMO3': '0.258', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '61.000'} [2024-08-06 03:29:16,065][52794] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:29:16,228][52795] DAMAGECOUNT value on done: 385429.0 [2024-08-06 03:29:16,229][52795] Sum rewards: 66.901, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.597', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.094', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'weapon2': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '3.200', 'weapon3': '3.248', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:16,232][52649] DAMAGECOUNT value on done: 402259.0 [2024-08-06 03:29:16,232][52649] Sum rewards: 71.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.040', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon2': '0.200', 'weapon5': '0.210', 'AMMO3': '0.220', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '61.000'} [2024-08-06 03:29:16,861][52665] DAMAGECOUNT value on done: 406693.0 [2024-08-06 03:29:16,861][52665] Sum rewards: 65.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.252', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.122', 'weapon4': '0.170', 'weapon2': '0.176', 'AMMO4': '0.235', 'weapon5': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.900', 'HITCOUNT': '2.700', 'weapon3': '2.894', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '51.000'} [2024-08-06 03:29:17,033][52811] DAMAGECOUNT value on done: 386750.0 [2024-08-06 03:29:17,033][52811] Sum rewards: 76.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.740', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:17,241][52803] DAMAGECOUNT value on done: 388933.0 [2024-08-06 03:29:17,242][52803] Sum rewards: 68.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.584', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.142', 'weapon2': '0.186', 'AMMO4': '0.218', 'AMMO3': '0.239', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 378028032. Throughput: 0: 4382.2. Samples: 94506380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:29:17,795][52567] Avg episode reward: [(0, '70.477')] [2024-08-06 03:29:17,907][52794] DAMAGECOUNT value on done: 411174.0 [2024-08-06 03:29:17,909][52794] Sum rewards: 74.823, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.238', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO4': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:18,125][52660] DAMAGECOUNT value on done: 409889.0 [2024-08-06 03:29:18,125][52660] Sum rewards: 78.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.019', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon4': '0.246', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:18,280][52671] DAMAGECOUNT value on done: 414807.0 [2024-08-06 03:29:18,280][52671] Sum rewards: 62.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.181', 'weapon5': '0.226', 'AMMO4': '0.235', 'weapon2': '0.396', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '51.000'} [2024-08-06 03:29:18,800][52658] DAMAGECOUNT value on done: 416357.0 [2024-08-06 03:29:18,801][52658] Sum rewards: 71.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.226', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.112', 'AMMO3': '0.141', 'AMMO4': '0.230', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.568', 'WEAPON3': '0.950', 'weapon3': '2.772', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '57.000'} [2024-08-06 03:29:18,960][52649] DAMAGECOUNT value on done: 393561.0 [2024-08-06 03:29:18,962][52649] Sum rewards: 70.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.634', 'AMMO2': '0.009', 'AMMO5': '0.017', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.528', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.302', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:19,339][52795] DAMAGECOUNT value on done: 390791.0 [2024-08-06 03:29:19,340][52795] Sum rewards: 61.071, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.220', 'AMMO3': '0.294', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.310', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '54.000'} [2024-08-06 03:29:19,673][52665] DAMAGECOUNT value on done: 407413.0 [2024-08-06 03:29:19,675][52665] Sum rewards: 57.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.058', 'weapon5': '0.118', 'AMMO4': '0.213', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '2.998', 'DAMAGECOUNT': '13.995', 'FRAGCOUNT': '51.000'} [2024-08-06 03:29:19,715][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:29:19,926][52650] Updated weights for policy 0, policy_version 46151 (0.0019) [2024-08-06 03:29:19,993][52811] DAMAGECOUNT value on done: 386686.0 [2024-08-06 03:29:19,994][52811] Sum rewards: 69.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.156', 'weapon4': '0.206', 'AMMO3': '0.216', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:20,447][52803] DAMAGECOUNT value on done: 385136.0 [2024-08-06 03:29:20,449][52803] Sum rewards: 78.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.320', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.158', 'AMMO3': '0.201', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.396', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '63.000'} [2024-08-06 03:29:20,884][52794] DAMAGECOUNT value on done: 417218.0 [2024-08-06 03:29:20,884][52794] Sum rewards: 80.112, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.125', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.118', 'weapon5': '0.120', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.712', 'WEAPON3': '0.850', 'weapon3': '2.846', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:20,942][52671] DAMAGECOUNT value on done: 408045.0 [2024-08-06 03:29:20,942][52671] Sum rewards: 72.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.715', 'AMMO5': '0.018', 'AMMO2': '0.068', 'weapon4': '0.164', 'AMMO3': '0.218', 'weapon5': '0.232', 'AMMO4': '0.340', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2024-08-06 03:29:21,015][52660] DAMAGECOUNT value on done: 414506.0 [2024-08-06 03:29:21,015][52660] Sum rewards: 73.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.594', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.208', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '63.000'} [2024-08-06 03:29:21,755][52658] DAMAGECOUNT value on done: 419167.0 [2024-08-06 03:29:21,755][52658] Sum rewards: 65.328, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.880', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.098', 'AMMO4': '0.156', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.232', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '57.000'} [2024-08-06 03:29:22,137][52649] DAMAGECOUNT value on done: 405270.0 [2024-08-06 03:29:22,138][52649] Sum rewards: 62.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.066', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.286', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.340', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 03:29:22,623][52795] DAMAGECOUNT value on done: 386551.0 [2024-08-06 03:29:22,624][52795] Sum rewards: 68.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.247', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.076', 'AMMO4': '0.113', 'weapon5': '0.130', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 378118144. Throughput: 0: 4382.9. Samples: 94532830. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:29:22,794][52567] Avg episode reward: [(0, '70.313')] [2024-08-06 03:29:22,836][52665] DAMAGECOUNT value on done: 411115.0 [2024-08-06 03:29:22,838][52665] Sum rewards: 68.879, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.030', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'WEAPON5': '0.200', 'weapon2': '0.228', 'weapon5': '0.258', 'weapon4': '0.348', 'WEAPON3': '0.850', 'weapon3': '2.942', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '52.500'} [2024-08-06 03:29:23,449][52794] DAMAGECOUNT value on done: 421020.0 [2024-08-06 03:29:23,452][52794] Sum rewards: 70.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.963', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO4': '0.238', 'AMMO3': '0.245', 'weapon4': '0.252', 'weapon5': '0.276', 'weapon2': '0.314', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.806', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '59.000'} [2024-08-06 03:29:23,700][52660] DAMAGECOUNT value on done: 410250.0 [2024-08-06 03:29:23,700][52660] Sum rewards: 71.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.674', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'weapon2': '0.140', 'AMMO3': '0.214', 'WEAPON3': '1.250', 'weapon3': '3.446', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:23,760][52671] DAMAGECOUNT value on done: 423210.0 [2024-08-06 03:29:23,762][52671] Sum rewards: 69.488, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.304', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.076', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '3.176', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '54.000'} [2024-08-06 03:29:24,446][52650] Updated weights for policy 0, policy_version 46161 (0.0011) [2024-08-06 03:29:24,660][52649] DAMAGECOUNT value on done: 399836.0 [2024-08-06 03:29:24,661][52649] Sum rewards: 77.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.642', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.105', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.262', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.316', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '64.000'} [2024-08-06 03:29:25,781][52795] DAMAGECOUNT value on done: 374985.0 [2024-08-06 03:29:25,784][52795] Sum rewards: 81.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.224', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.158', 'AMMO3': '0.206', 'AMMO4': '0.243', 'weapon2': '0.322', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '67.000'} [2024-08-06 03:29:25,868][52647] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:29:26,357][52794] DAMAGECOUNT value on done: 411657.0 [2024-08-06 03:29:26,357][52794] Sum rewards: 73.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.459', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:26,580][52671] DAMAGECOUNT value on done: 421410.0 [2024-08-06 03:29:26,580][52671] Sum rewards: 65.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.096', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.176', 'AMMO3': '0.194', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.062', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '53.000'} [2024-08-06 03:29:27,621][52649] DAMAGECOUNT value on done: 408097.0 [2024-08-06 03:29:27,621][52649] Sum rewards: 76.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.878', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.162', 'AMMO3': '0.187', 'weapon2': '0.266', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 378208256. Throughput: 0: 4389.1. Samples: 94559320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:29:27,802][52567] Avg episode reward: [(0, '70.671')] [2024-08-06 03:29:28,101][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:29:28,914][52662] Large shaping reward 2.616 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon5', 0.002)] [2024-08-06 03:29:28,958][52795] DAMAGECOUNT value on done: 389116.0 [2024-08-06 03:29:28,959][52795] Sum rewards: 60.949, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.367', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.132', 'weapon5': '0.206', 'AMMO4': '0.230', 'AMMO3': '0.239', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '2.944', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '55.000'} [2024-08-06 03:29:29,236][52650] Updated weights for policy 0, policy_version 46171 (0.0056) [2024-08-06 03:29:29,262][52794] DAMAGECOUNT value on done: 419902.0 [2024-08-06 03:29:29,264][52794] Sum rewards: 62.522, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.140', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.270', 'WEAPON3': '0.900', 'HITCOUNT': '3.020', 'weapon3': '3.500', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '49.500'} [2024-08-06 03:29:29,372][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:29:29,562][52671] DAMAGECOUNT value on done: 423238.0 [2024-08-06 03:29:29,563][52671] Sum rewards: 67.082, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.127', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '3.244', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '54.000'} [2024-08-06 03:29:30,185][52649] DAMAGECOUNT value on done: 406970.0 [2024-08-06 03:29:30,187][52649] Sum rewards: 55.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.564', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon7': '0.058', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO3': '0.138', 'AMMO4': '0.181', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '0.850', 'weapon4': '0.986', 'weapon3': '2.114', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '45.000'} [2024-08-06 03:29:32,134][52795] DAMAGECOUNT value on done: 381235.0 [2024-08-06 03:29:32,135][52795] Sum rewards: 60.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.162', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '49.000'} [2024-08-06 03:29:32,135][52794] DAMAGECOUNT value on done: 416342.0 [2024-08-06 03:29:32,136][52794] Sum rewards: 74.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.535', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.119', 'AMMO3': '0.184', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:32,213][52614] Signal inference workers to stop experience collection... (8350 times) [2024-08-06 03:29:32,222][52614] Signal inference workers to resume experience collection... (8350 times) [2024-08-06 03:29:32,297][52650] InferenceWorker_p0-w0: stopping experience collection (8350 times) [2024-08-06 03:29:32,297][52650] InferenceWorker_p0-w0: resuming experience collection (8350 times) [2024-08-06 03:29:32,581][52671] DAMAGECOUNT value on done: 417786.0 [2024-08-06 03:29:32,583][52671] Sum rewards: 67.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.026', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.100', 'AMMO4': '0.162', 'weapon4': '0.176', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.500'} [2024-08-06 03:29:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 378298368. Throughput: 0: 4390.2. Samples: 94572530. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:29:32,794][52567] Avg episode reward: [(0, '70.343')] [2024-08-06 03:29:33,598][52649] DAMAGECOUNT value on done: 400953.0 [2024-08-06 03:29:33,599][52649] Sum rewards: 69.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.469', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '58.000'} [2024-08-06 03:29:33,931][52650] Updated weights for policy 0, policy_version 46181 (0.0025) [2024-08-06 03:29:35,268][52795] DAMAGECOUNT value on done: 382832.0 [2024-08-06 03:29:35,271][52795] Sum rewards: 71.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.155', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.288', 'weapon4': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '59.000'} [2024-08-06 03:29:35,308][52794] DAMAGECOUNT value on done: 412002.0 [2024-08-06 03:29:35,309][52794] Sum rewards: 67.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.084', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:35,636][52671] DAMAGECOUNT value on done: 416591.0 [2024-08-06 03:29:35,637][52671] Sum rewards: 75.892, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.108', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.084', 'weapon5': '0.132', 'AMMO4': '0.135', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:36,536][52649] DAMAGECOUNT value on done: 408000.0 [2024-08-06 03:29:36,545][52649] Sum rewards: 78.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.415', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.454', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '65.000'} [2024-08-06 03:29:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 378380288. Throughput: 0: 4392.2. Samples: 94598740. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:29:37,794][52567] Avg episode reward: [(0, '70.517')] [2024-08-06 03:29:38,313][52650] Updated weights for policy 0, policy_version 46191 (0.0011) [2024-08-06 03:29:38,379][52794] DAMAGECOUNT value on done: 419617.0 [2024-08-06 03:29:38,379][52794] Sum rewards: 83.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.268', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.140', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '68.000'} [2024-08-06 03:29:38,395][52795] DAMAGECOUNT value on done: 377756.0 [2024-08-06 03:29:38,396][52795] Sum rewards: 62.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.584', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon4': '0.078', 'AMMO3': '0.176', 'AMMO4': '0.183', 'WEAPON4': '0.300', 'weapon5': '0.308', 'weapon2': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '2.850', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '50.000'} [2024-08-06 03:29:39,321][52649] DAMAGECOUNT value on done: 409808.0 [2024-08-06 03:29:39,322][52649] Sum rewards: 78.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.989', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.110', 'weapon5': '0.140', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.535', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:40,576][52664] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:29:40,901][52794] DAMAGECOUNT value on done: 408325.0 [2024-08-06 03:29:40,904][52794] Sum rewards: 72.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.087', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.258', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '63.000'} [2024-08-06 03:29:41,530][52795] DAMAGECOUNT value on done: 386910.0 [2024-08-06 03:29:41,532][52795] Sum rewards: 77.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.338', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.306', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:41,993][52659] DAMAGECOUNT value on done: 416334.0 [2024-08-06 03:29:41,993][52659] Sum rewards: 71.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.845', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO4': '0.203', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:42,459][52649] DAMAGECOUNT value on done: 409819.0 [2024-08-06 03:29:42,460][52649] Sum rewards: 77.680, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.108', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.320', 'weapon2': '0.452', 'WEAPON3': '1.850', 'weapon3': '3.094', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '68.000'} [2024-08-06 03:29:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 378462208. Throughput: 0: 4391.1. Samples: 94625210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:29:42,794][52567] Avg episode reward: [(0, '70.702')] [2024-08-06 03:29:43,488][52650] Updated weights for policy 0, policy_version 46201 (0.0021) [2024-08-06 03:29:43,520][52794] DAMAGECOUNT value on done: 426153.0 [2024-08-06 03:29:43,524][52794] Sum rewards: 62.376, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.136', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.056', 'weapon5': '0.106', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.418', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.178', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '54.000'} [2024-08-06 03:29:44,460][52659] DAMAGECOUNT value on done: 416306.0 [2024-08-06 03:29:44,461][52659] Sum rewards: 70.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.673', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.175', 'AMMO4': '0.214', 'weapon4': '0.236', 'weapon5': '0.268', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 03:29:44,639][52795] DAMAGECOUNT value on done: 375637.0 [2024-08-06 03:29:44,641][52795] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.592', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'AMMO4': '0.155', 'AMMO3': '0.196', 'WEAPON7': '0.200', 'weapon7': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.414', 'weapon4': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.330', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '55.000'} [2024-08-06 03:29:45,483][52649] DAMAGECOUNT value on done: 410555.0 [2024-08-06 03:29:45,483][52649] Sum rewards: 85.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.640', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.094', 'AMMO4': '0.122', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '68.000'} [2024-08-06 03:29:46,581][52794] DAMAGECOUNT value on done: 408651.0 [2024-08-06 03:29:46,583][52794] Sum rewards: 68.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.115', 'weapon2': '0.166', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.354', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:46,866][52659] DAMAGECOUNT value on done: 418564.0 [2024-08-06 03:29:46,868][52659] Sum rewards: 81.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.198', 'AMMO3': '0.222', 'weapon4': '0.246', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '66.000'} [2024-08-06 03:29:47,665][52650] Updated weights for policy 0, policy_version 46211 (0.0013) [2024-08-06 03:29:47,772][52795] DAMAGECOUNT value on done: 394103.0 [2024-08-06 03:29:47,774][52795] Sum rewards: 79.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.138', 'weapon4': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '66.000'} [2024-08-06 03:29:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 378560512. Throughput: 0: 4394.0. Samples: 94638350. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 03:29:47,794][52567] Avg episode reward: [(0, '70.791')] [2024-08-06 03:29:48,601][52649] DAMAGECOUNT value on done: 401124.0 [2024-08-06 03:29:48,602][52649] Sum rewards: 65.686, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.708', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.126', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '55.000'} [2024-08-06 03:29:48,777][52820] DAMAGECOUNT value on done: 380154.0 [2024-08-06 03:29:48,779][52820] Sum rewards: 70.988, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.166', 'AMMO3': '0.183', 'weapon2': '0.220', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '57.000'} [2024-08-06 03:29:49,149][52794] DAMAGECOUNT value on done: 425831.0 [2024-08-06 03:29:49,149][52794] Sum rewards: 74.773, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.238', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.118', 'weapon5': '0.230', 'AMMO3': '0.251', 'AMMO4': '0.253', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:49,372][52659] DAMAGECOUNT value on done: 414357.0 [2024-08-06 03:29:49,373][52659] Sum rewards: 57.068, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO4': '0.228', 'AMMO3': '0.242', 'weapon4': '0.244', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '50.000'} [2024-08-06 03:29:50,950][52795] DAMAGECOUNT value on done: 386737.0 [2024-08-06 03:29:50,953][52795] Sum rewards: 72.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.790', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.256', 'weapon2': '0.362', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.372', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '62.000'} [2024-08-06 03:29:51,534][52649] DAMAGECOUNT value on done: 407959.0 [2024-08-06 03:29:51,534][52649] Sum rewards: 73.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.287', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon4': '0.146', 'weapon5': '0.192', 'AMMO3': '0.205', 'weapon2': '0.242', 'AMMO4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:51,855][52659] DAMAGECOUNT value on done: 414595.0 [2024-08-06 03:29:51,856][52659] Sum rewards: 71.302, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.237', 'AMMO5': '0.013', 'weapon4': '0.050', 'AMMO2': '0.052', 'weapon5': '0.156', 'AMMO3': '0.253', 'AMMO4': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '60.000'} [2024-08-06 03:29:51,871][52820] DAMAGECOUNT value on done: 385749.0 [2024-08-06 03:29:51,872][52820] Sum rewards: 86.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.074', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.198', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '72.000'} [2024-08-06 03:29:51,939][52794] DAMAGECOUNT value on done: 416562.0 [2024-08-06 03:29:51,941][52794] Sum rewards: 62.794, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.491', 'AMMO5': '0.026', 'AMMO2': '0.050', 'weapon4': '0.152', 'weapon2': '0.196', 'AMMO4': '0.248', 'weapon5': '0.260', 'AMMO3': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.070', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '54.000'} [2024-08-06 03:29:52,765][52650] Updated weights for policy 0, policy_version 46221 (0.0019) [2024-08-06 03:29:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 378642432. Throughput: 0: 4390.7. Samples: 94664750. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 03:29:52,795][52567] Avg episode reward: [(0, '70.519')] [2024-08-06 03:29:54,084][52795] DAMAGECOUNT value on done: 377329.0 [2024-08-06 03:29:54,085][52795] Sum rewards: 61.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.260', 'AMMO3': '0.272', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.342', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:54,320][52649] DAMAGECOUNT value on done: 403406.0 [2024-08-06 03:29:54,321][52649] Sum rewards: 66.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.851', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.101', 'weapon5': '0.102', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.450', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 03:29:54,635][52659] DAMAGECOUNT value on done: 415951.0 [2024-08-06 03:29:54,635][52659] Sum rewards: 82.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.556', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.090', 'weapon5': '0.180', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '67.000'} [2024-08-06 03:29:54,809][52794] DAMAGECOUNT value on done: 418944.0 [2024-08-06 03:29:54,810][52794] Sum rewards: 70.301, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.089', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'weapon2': '0.890', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '57.000'} [2024-08-06 03:29:54,951][52820] DAMAGECOUNT value on done: 385378.0 [2024-08-06 03:29:54,953][52820] Sum rewards: 74.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.126', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '63.000'} [2024-08-06 03:29:57,044][52650] Updated weights for policy 0, policy_version 46231 (0.0028) [2024-08-06 03:29:57,142][52795] DAMAGECOUNT value on done: 384578.0 [2024-08-06 03:29:57,142][52795] Sum rewards: 61.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.428', 'AMMO5': '0.026', 'AMMO2': '0.043', 'weapon4': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.214', 'weapon5': '0.264', 'weapon2': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.072', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '53.000'} [2024-08-06 03:29:57,290][52649] DAMAGECOUNT value on done: 411024.0 [2024-08-06 03:29:57,291][52649] Sum rewards: 85.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.218', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.230', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '73.000'} [2024-08-06 03:29:57,541][52659] DAMAGECOUNT value on done: 417453.0 [2024-08-06 03:29:57,542][52659] Sum rewards: 80.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.757', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '67.000'} [2024-08-06 03:29:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 378724352. Throughput: 0: 4390.4. Samples: 94690920. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 03:29:57,794][52567] Avg episode reward: [(0, '70.547')] [2024-08-06 03:29:57,971][52794] DAMAGECOUNT value on done: 425094.0 [2024-08-06 03:29:57,972][52794] Sum rewards: 56.054, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.651', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.156', 'AMMO3': '0.212', 'weapon4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.064', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '48.000'} [2024-08-06 03:29:58,186][52820] DAMAGECOUNT value on done: 380178.0 [2024-08-06 03:29:58,186][52820] Sum rewards: 66.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.199', 'weapon5': '0.238', 'AMMO4': '0.276', 'weapon2': '0.322', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.000'} [2024-08-06 03:30:00,223][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:30:00,336][52795] DAMAGECOUNT value on done: 391368.0 [2024-08-06 03:30:00,336][52795] Sum rewards: 74.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.715', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.166', 'AMMO4': '0.206', 'AMMO3': '0.207', 'weapon5': '0.274', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '61.000'} [2024-08-06 03:30:00,390][52794] DAMAGECOUNT value on done: 415953.0 [2024-08-06 03:30:00,392][52794] Sum rewards: 67.109, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.146', 'weapon2': '0.234', 'AMMO3': '0.263', 'weapon5': '0.288', 'AMMO4': '0.320', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '3.036', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:00,459][52803] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:30:00,521][52649] DAMAGECOUNT value on done: 412569.0 [2024-08-06 03:30:00,523][52649] Sum rewards: 86.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon4': '0.204', 'AMMO3': '0.211', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '72.000'} [2024-08-06 03:30:00,554][52659] DAMAGECOUNT value on done: 414632.0 [2024-08-06 03:30:00,554][52659] Sum rewards: 72.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.545', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.216', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:01,336][52820] DAMAGECOUNT value on done: 387784.0 [2024-08-06 03:30:01,337][52820] Sum rewards: 72.759, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.667', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.115', 'weapon2': '0.128', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.610', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '57.000'} [2024-08-06 03:30:01,878][52650] Updated weights for policy 0, policy_version 46241 (0.0012) [2024-08-06 03:30:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 378814464. Throughput: 0: 4388.0. Samples: 94703840. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 03:30:02,802][52567] Avg episode reward: [(0, '70.438')] [2024-08-06 03:30:03,291][52649] DAMAGECOUNT value on done: 405512.0 [2024-08-06 03:30:03,291][52649] Sum rewards: 61.081, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.154', 'AMMO3': '0.175', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'HEALTH': '0.416', 'WEAPON3': '1.000', 'HITCOUNT': '2.870', 'weapon3': '3.136', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '49.000'} [2024-08-06 03:30:03,539][52659] DAMAGECOUNT value on done: 425132.0 [2024-08-06 03:30:03,541][52659] Sum rewards: 81.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.268', 'weapon2': '0.466', 'WEAPON3': '1.650', 'weapon3': '3.332', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '70.000'} [2024-08-06 03:30:04,035][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:30:04,582][52820] DAMAGECOUNT value on done: 378157.0 [2024-08-06 03:30:04,584][52820] Sum rewards: 59.827, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.168', 'weapon5': '0.228', 'AMMO3': '0.273', 'AMMO4': '0.274', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.930', 'weapon3': '3.002', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '53.000'} [2024-08-06 03:30:06,277][52659] DAMAGECOUNT value on done: 425427.0 [2024-08-06 03:30:06,279][52659] Sum rewards: 77.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.363', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '3.348', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:06,624][52650] Updated weights for policy 0, policy_version 46251 (0.0021) [2024-08-06 03:30:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.1). Total num frames: 378904576. Throughput: 0: 4381.8. Samples: 94730010. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 03:30:07,794][52567] Avg episode reward: [(0, '70.487')] [2024-08-06 03:30:07,858][52820] DAMAGECOUNT value on done: 382634.0 [2024-08-06 03:30:07,858][52820] Sum rewards: 63.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.552', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.126', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.112', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '53.000'} [2024-08-06 03:30:08,166][52666] DAMAGECOUNT value on done: 414654.0 [2024-08-06 03:30:08,168][52666] Sum rewards: 67.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.146', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:08,914][52659] DAMAGECOUNT value on done: 417170.0 [2024-08-06 03:30:08,915][52659] Sum rewards: 65.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.017', 'ARMOR': '0.028', 'AMMO2': '0.033', 'AMMO4': '0.168', 'weapon5': '0.172', 'weapon4': '0.184', 'AMMO3': '0.194', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '54.000'} [2024-08-06 03:30:11,010][52820] DAMAGECOUNT value on done: 387822.0 [2024-08-06 03:30:11,012][52820] Sum rewards: 78.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.613', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.170', 'weapon2': '0.798', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:11,042][52666] DAMAGECOUNT value on done: 421363.0 [2024-08-06 03:30:11,042][52666] Sum rewards: 70.276, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.237', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '60.000'} [2024-08-06 03:30:11,411][52650] Updated weights for policy 0, policy_version 46261 (0.0033) [2024-08-06 03:30:11,665][52663] DAMAGECOUNT value on done: 420859.0 [2024-08-06 03:30:11,666][52663] Sum rewards: 68.287, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.056', 'HEALTH': '0.090', 'AMMO3': '0.165', 'weapon2': '0.230', 'weapon5': '0.236', 'AMMO4': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '55.000'} [2024-08-06 03:30:11,868][52659] DAMAGECOUNT value on done: 419926.0 [2024-08-06 03:30:11,869][52659] Sum rewards: 68.398, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.730', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.110', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.343', 'weapon2': '0.350', 'WEAPON3': '1.950', 'weapon3': '3.102', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:12,109][52670] DAMAGECOUNT value on done: 408934.0 [2024-08-06 03:30:12,109][52670] Sum rewards: 73.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.221', 'weapon5': '0.222', 'weapon4': '0.234', 'weapon2': '0.236', 'AMMO4': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '60.000'} [2024-08-06 03:30:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 378994688. Throughput: 0: 4377.1. Samples: 94756290. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 03:30:12,794][52567] Avg episode reward: [(0, '70.607')] [2024-08-06 03:30:14,092][52820] DAMAGECOUNT value on done: 383560.0 [2024-08-06 03:30:14,094][52820] Sum rewards: 73.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'weapon5': '0.220', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.642', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '61.000'} [2024-08-06 03:30:14,137][52666] DAMAGECOUNT value on done: 418845.0 [2024-08-06 03:30:14,139][52666] Sum rewards: 64.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.090', 'AMMO3': '0.178', 'weapon5': '0.178', 'AMMO4': '0.253', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '53.000'} [2024-08-06 03:30:14,818][52663] DAMAGECOUNT value on done: 416827.0 [2024-08-06 03:30:14,822][52663] Sum rewards: 81.715, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.645', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.160', 'AMMO3': '0.167', 'weapon2': '0.180', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '64.000'} [2024-08-06 03:30:14,947][52659] DAMAGECOUNT value on done: 407634.0 [2024-08-06 03:30:14,947][52659] Sum rewards: 56.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.051', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.158', 'weapon5': '0.190', 'weapon4': '0.242', 'AMMO4': '0.325', 'weapon2': '0.498', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'HITCOUNT': '2.770', 'weapon3': '2.802', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '46.000'} [2024-08-06 03:30:15,490][52670] DAMAGECOUNT value on done: 417218.0 [2024-08-06 03:30:15,491][52670] Sum rewards: 67.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.098', 'AMMO4': '0.191', 'AMMO3': '0.232', 'weapon4': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:15,797][52650] Updated weights for policy 0, policy_version 46271 (0.0021) [2024-08-06 03:30:17,281][52820] DAMAGECOUNT value on done: 389493.0 [2024-08-06 03:30:17,281][52820] Sum rewards: 76.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.767', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'weapon2': '0.202', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '64.000'} [2024-08-06 03:30:17,364][52666] DAMAGECOUNT value on done: 416747.0 [2024-08-06 03:30:17,366][52666] Sum rewards: 78.132, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.824', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.050', 'AMMO4': '0.149', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.236', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '65.500'} [2024-08-06 03:30:17,795][52567] Fps is (10 sec: 18020.7, 60 sec: 17612.5, 300 sec: 17467.0). Total num frames: 379084800. Throughput: 0: 4379.7. Samples: 94769620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:30:17,795][52567] Avg episode reward: [(0, '70.823')] [2024-08-06 03:30:17,947][52659] DAMAGECOUNT value on done: 417099.0 [2024-08-06 03:30:17,949][52659] Sum rewards: 81.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.978', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.189', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '22.029', 'FRAGCOUNT': '65.000'} [2024-08-06 03:30:17,955][52663] DAMAGECOUNT value on done: 409847.0 [2024-08-06 03:30:17,980][52663] Sum rewards: 63.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.085', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.120', 'AMMO3': '0.201', 'AMMO4': '0.225', 'weapon4': '0.242', 'weapon2': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.130', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '54.000'} [2024-08-06 03:30:18,384][52670] DAMAGECOUNT value on done: 409419.0 [2024-08-06 03:30:18,386][52670] Sum rewards: 79.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.094', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.068', 'AMMO4': '0.096', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.286', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '69.000'} [2024-08-06 03:30:19,945][52666] DAMAGECOUNT value on done: 417478.0 [2024-08-06 03:30:19,947][52666] Sum rewards: 68.949, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.130', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.148', 'AMMO4': '0.166', 'weapon2': '0.248', 'weapon5': '0.256', 'AMMO3': '0.325', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.950', 'weapon3': '2.936', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:20,406][52820] DAMAGECOUNT value on done: 382470.0 [2024-08-06 03:30:20,408][52820] Sum rewards: 76.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.616', 'AMMO5': '0.015', 'weapon4': '0.032', 'AMMO2': '0.047', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'AMMO4': '0.237', 'weapon5': '0.292', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:20,726][52650] Updated weights for policy 0, policy_version 46281 (0.0025) [2024-08-06 03:30:20,970][52659] DAMAGECOUNT value on done: 426185.0 [2024-08-06 03:30:20,970][52659] Sum rewards: 71.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.138', 'weapon4': '0.238', 'AMMO4': '0.245', 'AMMO3': '0.254', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.100', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '60.000'} [2024-08-06 03:30:21,038][52663] DAMAGECOUNT value on done: 416848.0 [2024-08-06 03:30:21,039][52663] Sum rewards: 67.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.050', 'AMMO4': '0.148', 'AMMO3': '0.174', 'weapon5': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '54.000'} [2024-08-06 03:30:21,072][52670] DAMAGECOUNT value on done: 407831.0 [2024-08-06 03:30:21,072][52670] Sum rewards: 75.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.285', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '64.000'} [2024-08-06 03:30:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 379166720. Throughput: 0: 4382.9. Samples: 94795970. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:30:22,795][52567] Avg episode reward: [(0, '71.095')] [2024-08-06 03:30:22,812][52666] DAMAGECOUNT value on done: 409427.0 [2024-08-06 03:30:22,816][52666] Sum rewards: 67.608, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.634', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.174', 'AMMO3': '0.187', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 03:30:23,572][52820] DAMAGECOUNT value on done: 386365.0 [2024-08-06 03:30:23,573][52820] Sum rewards: 75.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.336', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.142', 'AMMO4': '0.179', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:23,971][52659] DAMAGECOUNT value on done: 421360.0 [2024-08-06 03:30:23,972][52659] Sum rewards: 63.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.312', 'weapon4': '0.312', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '50.000'} [2024-08-06 03:30:23,995][52670] DAMAGECOUNT value on done: 417558.0 [2024-08-06 03:30:23,999][52670] Sum rewards: 77.870, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.962', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:24,144][52663] DAMAGECOUNT value on done: 413283.0 [2024-08-06 03:30:24,145][52663] Sum rewards: 79.803, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.828', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon2': '0.170', 'weapon5': '0.194', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '65.000'} [2024-08-06 03:30:25,047][52650] Updated weights for policy 0, policy_version 46291 (0.0033) [2024-08-06 03:30:25,559][52666] DAMAGECOUNT value on done: 416885.0 [2024-08-06 03:30:25,559][52666] Sum rewards: 81.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.224', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.090', 'AMMO3': '0.209', 'AMMO4': '0.252', 'weapon5': '0.320', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '66.000'} [2024-08-06 03:30:26,411][52670] DAMAGECOUNT value on done: 411385.0 [2024-08-06 03:30:26,415][52670] Sum rewards: 72.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.102', 'weapon5': '0.130', 'AMMO4': '0.166', 'AMMO3': '0.196', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:26,651][52820] DAMAGECOUNT value on done: 390482.0 [2024-08-06 03:30:26,652][52820] Sum rewards: 66.751, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.126', 'AMMO3': '0.176', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '53.000'} [2024-08-06 03:30:26,837][52659] DAMAGECOUNT value on done: 423072.0 [2024-08-06 03:30:26,837][52659] Sum rewards: 66.574, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon5': '0.240', 'AMMO3': '0.260', 'weapon4': '0.268', 'AMMO4': '0.289', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.730', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '56.000'} [2024-08-06 03:30:27,000][52663] DAMAGECOUNT value on done: 419313.0 [2024-08-06 03:30:27,000][52663] Sum rewards: 68.816, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.907', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.106', 'AMMO4': '0.163', 'weapon4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:27,794][52567] Fps is (10 sec: 17204.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 379256832. Throughput: 0: 4381.1. Samples: 94822360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:30:27,795][52567] Avg episode reward: [(0, '71.262')] [2024-08-06 03:30:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046296_379256832.pth... [2024-08-06 03:30:27,957][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000045784_375062528.pth [2024-08-06 03:30:28,144][52666] DAMAGECOUNT value on done: 415504.0 [2024-08-06 03:30:28,145][52666] Sum rewards: 65.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.290', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.234', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '54.000'} [2024-08-06 03:30:29,221][52670] DAMAGECOUNT value on done: 407144.0 [2024-08-06 03:30:29,221][52670] Sum rewards: 72.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.120', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'weapon4': '0.230', 'AMMO4': '0.230', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.034', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:29,756][52663] DAMAGECOUNT value on done: 418633.0 [2024-08-06 03:30:29,757][52663] Sum rewards: 70.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.607', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon4': '0.082', 'AMMO3': '0.219', 'AMMO4': '0.244', 'weapon5': '0.256', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:29,825][52659] DAMAGECOUNT value on done: 414427.0 [2024-08-06 03:30:29,825][52659] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.556', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.118', 'AMMO3': '0.204', 'AMMO4': '0.294', 'weapon5': '0.302', 'weapon2': '0.456', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '61.000'} [2024-08-06 03:30:29,901][52820] DAMAGECOUNT value on done: 386091.0 [2024-08-06 03:30:29,904][52820] Sum rewards: 69.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.193', 'weapon2': '0.198', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.668', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '57.000'} [2024-08-06 03:30:30,069][52650] Updated weights for policy 0, policy_version 46301 (0.0018) [2024-08-06 03:30:31,232][52666] DAMAGECOUNT value on done: 411217.0 [2024-08-06 03:30:31,232][52666] Sum rewards: 80.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.786', 'AMMO5': '0.023', 'AMMO2': '0.055', 'AMMO3': '0.152', 'weapon5': '0.216', 'AMMO4': '0.273', 'weapon2': '0.310', 'weapon4': '0.452', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.740', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '66.000'} [2024-08-06 03:30:32,170][52670] DAMAGECOUNT value on done: 410422.0 [2024-08-06 03:30:32,170][52670] Sum rewards: 63.037, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.662', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.122', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.350', 'WEAPON3': '0.950', 'weapon3': '2.964', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '50.000'} [2024-08-06 03:30:32,492][52663] DAMAGECOUNT value on done: 413042.0 [2024-08-06 03:30:32,494][52663] Sum rewards: 61.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.064', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.134', 'AMMO4': '0.226', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.760', 'WEAPON3': '1.400', 'weapon3': '2.788', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '52.500'} [2024-08-06 03:30:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 379338752. Throughput: 0: 4374.2. Samples: 94835190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:30:32,795][52567] Avg episode reward: [(0, '71.334')] [2024-08-06 03:30:33,001][52659] DAMAGECOUNT value on done: 421079.0 [2024-08-06 03:30:33,001][52659] Sum rewards: 70.635, reward structure: {'DEATHCOUNT': '-14.250', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.116', 'AMMO3': '0.210', 'weapon2': '0.230', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.590', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '60.000'} [2024-08-06 03:30:33,037][52820] DAMAGECOUNT value on done: 391457.0 [2024-08-06 03:30:33,037][52820] Sum rewards: 78.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.216', 'AMMO3': '0.227', 'weapon2': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '65.000'} [2024-08-06 03:30:33,289][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:30:34,102][52666] DAMAGECOUNT value on done: 407615.0 [2024-08-06 03:30:34,102][52666] Sum rewards: 73.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:34,631][52650] Updated weights for policy 0, policy_version 46311 (0.0011) [2024-08-06 03:30:34,798][52670] DAMAGECOUNT value on done: 410615.0 [2024-08-06 03:30:34,800][52670] Sum rewards: 74.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.678', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.076', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '60.000'} [2024-08-06 03:30:35,372][52663] DAMAGECOUNT value on done: 412523.0 [2024-08-06 03:30:35,372][52663] Sum rewards: 66.769, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.084', 'AMMO3': '0.188', 'weapon4': '0.244', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '55.000'} [2024-08-06 03:30:36,115][52820] DAMAGECOUNT value on done: 384401.0 [2024-08-06 03:30:36,115][52820] Sum rewards: 62.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.266', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '52.000'} [2024-08-06 03:30:36,163][52659] DAMAGECOUNT value on done: 419686.0 [2024-08-06 03:30:36,165][52659] Sum rewards: 59.302, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.058', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.192', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.264', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '51.000'} [2024-08-06 03:30:36,527][52666] DAMAGECOUNT value on done: 412919.0 [2024-08-06 03:30:36,530][52666] Sum rewards: 73.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.126', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.174', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:37,168][52659] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:30:37,511][52670] DAMAGECOUNT value on done: 407886.0 [2024-08-06 03:30:37,511][52670] Sum rewards: 78.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.094', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.207', 'weapon4': '0.240', 'weapon5': '0.322', 'AMMO4': '0.331', 'weapon2': '0.366', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '64.000'} [2024-08-06 03:30:37,795][52567] Fps is (10 sec: 17202.1, 60 sec: 17476.0, 300 sec: 17494.7). Total num frames: 379428864. Throughput: 0: 4375.5. Samples: 94861650. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:30:37,796][52567] Avg episode reward: [(0, '71.512')] [2024-08-06 03:30:37,856][52614] Saving new best policy, reward=71.512! [2024-08-06 03:30:37,933][52663] DAMAGECOUNT value on done: 419108.0 [2024-08-06 03:30:37,937][52663] Sum rewards: 77.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.845', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.118', 'weapon4': '0.118', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:39,192][52650] Updated weights for policy 0, policy_version 46321 (0.0012) [2024-08-06 03:30:39,273][52820] DAMAGECOUNT value on done: 385199.0 [2024-08-06 03:30:39,273][52820] Sum rewards: 75.893, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.616', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.269', 'weapon2': '0.462', 'WEAPON3': '1.600', 'weapon3': '3.208', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '65.000'} [2024-08-06 03:30:39,636][52666] DAMAGECOUNT value on done: 410744.0 [2024-08-06 03:30:39,638][52666] Sum rewards: 69.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.935', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.159', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:40,138][52667] DAMAGECOUNT value on done: 414294.0 [2024-08-06 03:30:40,138][52667] Sum rewards: 57.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.021', 'AMMO2': '0.064', 'AMMO3': '0.217', 'weapon5': '0.224', 'AMMO4': '0.322', 'weapon4': '0.328', 'weapon2': '0.414', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '50.000'} [2024-08-06 03:30:40,612][52670] DAMAGECOUNT value on done: 415802.0 [2024-08-06 03:30:40,612][52670] Sum rewards: 69.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.174', 'AMMO3': '0.185', 'weapon5': '0.186', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.268', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '56.000'} [2024-08-06 03:30:40,642][52663] DAMAGECOUNT value on done: 423525.0 [2024-08-06 03:30:40,642][52663] Sum rewards: 71.720, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.152', 'weapon5': '0.172', 'AMMO4': '0.178', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '59.500'} [2024-08-06 03:30:42,091][52668] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:30:42,239][52820] DAMAGECOUNT value on done: 396066.0 [2024-08-06 03:30:42,240][52820] Sum rewards: 77.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.132', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.114', 'weapon4': '0.146', 'weapon2': '0.156', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.424', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '64.000'} [2024-08-06 03:30:42,351][52666] DAMAGECOUNT value on done: 420103.0 [2024-08-06 03:30:42,352][52666] Sum rewards: 66.819, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.400', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.100', 'AMMO4': '0.176', 'weapon5': '0.180', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.072', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:42,391][52664] DAMAGECOUNT value on done: 432542.0 [2024-08-06 03:30:42,391][52664] Sum rewards: 82.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.162', 'AMMO4': '0.164', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.216', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.182', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '65.000'} [2024-08-06 03:30:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 379518976. Throughput: 0: 4376.2. Samples: 94887850. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:30:42,794][52567] Avg episode reward: [(0, '71.495')] [2024-08-06 03:30:42,980][52667] DAMAGECOUNT value on done: 423580.0 [2024-08-06 03:30:42,981][52667] Sum rewards: 70.934, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.623', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.070', 'weapon4': '0.072', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:43,187][52670] DAMAGECOUNT value on done: 408566.0 [2024-08-06 03:30:43,188][52670] Sum rewards: 67.079, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.911', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.120', 'weapon5': '0.204', 'AMMO4': '0.268', 'AMMO3': '0.287', 'weapon2': '0.340', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.800', 'weapon3': '3.050', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:43,484][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:30:43,896][52663] DAMAGECOUNT value on done: 415194.0 [2024-08-06 03:30:43,898][52663] Sum rewards: 58.376, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.182', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.376', 'WEAPON3': '1.200', 'weapon3': '2.528', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '48.000'} [2024-08-06 03:30:44,181][52650] Updated weights for policy 0, policy_version 46331 (0.0012) [2024-08-06 03:30:45,215][52666] DAMAGECOUNT value on done: 417751.0 [2024-08-06 03:30:45,216][52666] Sum rewards: 70.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.552', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.118', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:45,280][52664] DAMAGECOUNT value on done: 437405.0 [2024-08-06 03:30:45,280][52664] Sum rewards: 68.637, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.160', 'weapon4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:45,346][52820] DAMAGECOUNT value on done: 396526.0 [2024-08-06 03:30:45,346][52820] Sum rewards: 77.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.986', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.054', 'AMMO4': '0.136', 'AMMO3': '0.225', 'weapon5': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.400', 'weapon3': '2.744', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '65.000'} [2024-08-06 03:30:46,129][52670] DAMAGECOUNT value on done: 409551.0 [2024-08-06 03:30:46,129][52670] Sum rewards: 67.884, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.860', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.178', 'AMMO3': '0.190', 'AMMO4': '0.199', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '55.000'} [2024-08-06 03:30:46,138][52667] DAMAGECOUNT value on done: 415582.0 [2024-08-06 03:30:46,138][52667] Sum rewards: 69.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.555', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.213', 'AMMO4': '0.226', 'weapon5': '0.236', 'weapon4': '0.270', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.642', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:46,821][52663] DAMAGECOUNT value on done: 411333.0 [2024-08-06 03:30:46,821][52663] Sum rewards: 71.956, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.103', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon4': '0.102', 'weapon5': '0.134', 'AMMO3': '0.224', 'AMMO4': '0.226', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '59.000'} [2024-08-06 03:30:47,794][52567] Fps is (10 sec: 18023.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 379609088. Throughput: 0: 4382.5. Samples: 94901050. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 03:30:47,794][52567] Avg episode reward: [(0, '71.294')] [2024-08-06 03:30:47,905][52666] DAMAGECOUNT value on done: 413053.0 [2024-08-06 03:30:47,907][52666] Sum rewards: 76.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO5': '0.016', 'AMMO2': '0.026', 'weapon4': '0.040', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.229', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:48,050][52664] DAMAGECOUNT value on done: 437837.0 [2024-08-06 03:30:48,050][52664] Sum rewards: 74.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.160', 'weapon4': '0.188', 'AMMO3': '0.219', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:48,382][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:30:48,599][52820] DAMAGECOUNT value on done: 384546.0 [2024-08-06 03:30:48,599][52820] Sum rewards: 69.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '57.000'} [2024-08-06 03:30:48,731][52650] Updated weights for policy 0, policy_version 46341 (0.0015) [2024-08-06 03:30:48,872][52670] DAMAGECOUNT value on done: 421045.0 [2024-08-06 03:30:48,875][52670] Sum rewards: 76.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.264', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.090', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.130', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '64.000'} [2024-08-06 03:30:49,345][52667] DAMAGECOUNT value on done: 418242.0 [2024-08-06 03:30:49,346][52667] Sum rewards: 66.243, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.865', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.138', 'AMMO3': '0.217', 'AMMO4': '0.268', 'weapon5': '0.274', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '54.000'} [2024-08-06 03:30:49,392][52660] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:30:49,935][52663] DAMAGECOUNT value on done: 410198.0 [2024-08-06 03:30:49,938][52663] Sum rewards: 72.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.442', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.170', 'weapon5': '0.190', 'weapon2': '0.228', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '57.000'} [2024-08-06 03:30:50,903][52666] DAMAGECOUNT value on done: 413386.0 [2024-08-06 03:30:50,903][52666] Sum rewards: 74.562, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.763', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.120', 'weapon5': '0.178', 'AMMO4': '0.185', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 03:30:51,181][52664] DAMAGECOUNT value on done: 431477.0 [2024-08-06 03:30:51,181][52664] Sum rewards: 59.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.180', 'AMMO3': '0.207', 'AMMO4': '0.278', 'weapon5': '0.292', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.716', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '51.500'} [2024-08-06 03:30:51,879][52670] DAMAGECOUNT value on done: 415674.0 [2024-08-06 03:30:51,880][52670] Sum rewards: 74.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.818', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO4': '0.229', 'AMMO3': '0.235', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:51,909][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:30:52,436][52667] DAMAGECOUNT value on done: 423829.0 [2024-08-06 03:30:52,437][52667] Sum rewards: 71.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.050', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.284', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '62.000'} [2024-08-06 03:30:52,679][52663] DAMAGECOUNT value on done: 413055.0 [2024-08-06 03:30:52,681][52663] Sum rewards: 82.337, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.480', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.088', 'AMMO4': '0.103', 'weapon5': '0.134', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.000', 'weapon3': '3.202', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '66.000'} [2024-08-06 03:30:52,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 379691008. Throughput: 0: 4384.8. Samples: 94927330. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 03:30:52,795][52567] Avg episode reward: [(0, '71.286')] [2024-08-06 03:30:53,205][52650] Updated weights for policy 0, policy_version 46351 (0.0027) [2024-08-06 03:30:53,944][52666] DAMAGECOUNT value on done: 414559.0 [2024-08-06 03:30:53,956][52666] Sum rewards: 61.962, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '2.828', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '53.000'} [2024-08-06 03:30:54,414][52664] DAMAGECOUNT value on done: 434926.0 [2024-08-06 03:30:54,420][52664] Sum rewards: 68.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.554', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.212', 'AMMO4': '0.223', 'weapon2': '0.244', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.196', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '58.000'} [2024-08-06 03:30:54,922][52670] DAMAGECOUNT value on done: 399503.0 [2024-08-06 03:30:54,924][52670] Sum rewards: 64.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.268', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon4': '0.030', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '50.500'} [2024-08-06 03:30:55,154][52663] DAMAGECOUNT value on done: 422289.0 [2024-08-06 03:30:55,156][52663] Sum rewards: 75.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.232', 'weapon2': '0.256', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 03:30:55,511][52667] DAMAGECOUNT value on done: 424816.0 [2024-08-06 03:30:55,512][52667] Sum rewards: 78.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.095', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.073', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.418', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '65.000'} [2024-08-06 03:30:56,832][52666] DAMAGECOUNT value on done: 414092.0 [2024-08-06 03:30:56,835][52666] Sum rewards: 62.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.175', 'AMMO5': '0.016', 'AMMO2': '0.068', 'weapon5': '0.136', 'AMMO3': '0.202', 'weapon4': '0.304', 'AMMO4': '0.342', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '53.500'} [2024-08-06 03:30:57,684][52664] DAMAGECOUNT value on done: 431751.0 [2024-08-06 03:30:57,687][52664] Sum rewards: 63.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.850', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.128', 'weapon5': '0.128', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.128', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '54.000'} [2024-08-06 03:30:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 379781120. Throughput: 0: 4378.4. Samples: 94953320. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 03:30:57,795][52567] Avg episode reward: [(0, '70.982')] [2024-08-06 03:30:57,889][52670] DAMAGECOUNT value on done: 412351.0 [2024-08-06 03:30:57,890][52670] Sum rewards: 56.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.547', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.126', 'weapon2': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.220', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '47.000'} [2024-08-06 03:30:58,266][52650] Updated weights for policy 0, policy_version 46361 (0.0023) [2024-08-06 03:30:58,487][52663] DAMAGECOUNT value on done: 413222.0 [2024-08-06 03:30:58,487][52663] Sum rewards: 82.650, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.285', 'weapon2': '0.302', 'WEAPON3': '1.750', 'weapon3': '3.352', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.586', 'FRAGCOUNT': '72.000'} [2024-08-06 03:30:58,722][52667] DAMAGECOUNT value on done: 422045.0 [2024-08-06 03:30:58,724][52667] Sum rewards: 57.768, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.460', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.234', 'weapon4': '0.238', 'AMMO4': '0.251', 'weapon2': '0.282', 'AMMO3': '0.303', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.932', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '53.000'} [2024-08-06 03:30:59,815][52666] DAMAGECOUNT value on done: 404350.0 [2024-08-06 03:30:59,817][52666] Sum rewards: 60.276, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.082', 'AMMO4': '0.189', 'weapon5': '0.232', 'AMMO3': '0.255', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.128', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '53.000'} [2024-08-06 03:31:00,662][52670] DAMAGECOUNT value on done: 421888.0 [2024-08-06 03:31:00,662][52670] Sum rewards: 77.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.137', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.074', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:00,710][52664] DAMAGECOUNT value on done: 433439.0 [2024-08-06 03:31:00,711][52664] Sum rewards: 60.730, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.512', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.238', 'weapon5': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '2.794', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '50.000'} [2024-08-06 03:31:01,527][52663] DAMAGECOUNT value on done: 417870.0 [2024-08-06 03:31:01,529][52663] Sum rewards: 73.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.022', 'weapon5': '0.096', 'AMMO4': '0.101', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.350', 'HITCOUNT': '3.460', 'weapon3': '3.540', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:01,995][52667] DAMAGECOUNT value on done: 417704.0 [2024-08-06 03:31:01,995][52667] Sum rewards: 90.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.133', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.114', 'AMMO4': '0.137', 'AMMO3': '0.154', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.060', 'FRAGCOUNT': '73.000'} [2024-08-06 03:31:02,155][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:02,545][52666] DAMAGECOUNT value on done: 414815.0 [2024-08-06 03:31:02,545][52666] Sum rewards: 68.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.101', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 379863040. Throughput: 0: 4374.7. Samples: 94966480. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 03:31:02,795][52567] Avg episode reward: [(0, '70.741')] [2024-08-06 03:31:02,851][52650] Updated weights for policy 0, policy_version 46371 (0.0024) [2024-08-06 03:31:03,567][52670] DAMAGECOUNT value on done: 412130.0 [2024-08-06 03:31:03,569][52670] Sum rewards: 75.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.343', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.182', 'weapon4': '0.186', 'weapon2': '0.216', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.000'} [2024-08-06 03:31:03,644][52664] DAMAGECOUNT value on done: 426780.0 [2024-08-06 03:31:03,645][52664] Sum rewards: 68.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.204', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.066', 'AMMO4': '0.106', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.160', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:04,467][52663] DAMAGECOUNT value on done: 417210.0 [2024-08-06 03:31:04,475][52663] Sum rewards: 60.358, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.128', 'weapon4': '0.148', 'AMMO4': '0.195', 'AMMO3': '0.278', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.910', 'weapon3': '3.102', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '54.000'} [2024-08-06 03:31:05,326][52667] DAMAGECOUNT value on done: 419405.0 [2024-08-06 03:31:05,327][52667] Sum rewards: 79.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.227', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.400', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '69.000'} [2024-08-06 03:31:06,014][52664] DAMAGECOUNT value on done: 438830.0 [2024-08-06 03:31:06,015][52664] Sum rewards: 78.821, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.380', 'WEAPON3': '1.050', 'weapon3': '3.414', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:06,563][52670] DAMAGECOUNT value on done: 415347.0 [2024-08-06 03:31:06,563][52670] Sum rewards: 77.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.605', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.126', 'weapon4': '0.128', 'AMMO4': '0.146', 'AMMO3': '0.234', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '65.000'} [2024-08-06 03:31:06,671][52660] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:07,316][52647] DAMAGECOUNT value on done: 442241.0 [2024-08-06 03:31:07,317][52647] Sum rewards: 66.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.345', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.148', 'weapon5': '0.148', 'AMMO3': '0.213', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.298', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:07,528][52650] Updated weights for policy 0, policy_version 46381 (0.0013) [2024-08-06 03:31:07,566][52663] DAMAGECOUNT value on done: 411433.0 [2024-08-06 03:31:07,569][52663] Sum rewards: 74.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.108', 'weapon4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 03:31:07,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 379953152. Throughput: 0: 4372.7. Samples: 94992740. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 03:31:07,794][52567] Avg episode reward: [(0, '71.060')] [2024-08-06 03:31:08,389][52667] DAMAGECOUNT value on done: 427346.0 [2024-08-06 03:31:08,391][52667] Sum rewards: 81.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.758', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.150', 'weapon3': '3.304', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:09,158][52664] DAMAGECOUNT value on done: 429981.0 [2024-08-06 03:31:09,158][52664] Sum rewards: 82.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.778', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.156', 'AMMO3': '0.157', 'AMMO4': '0.191', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '68.000'} [2024-08-06 03:31:10,467][52647] DAMAGECOUNT value on done: 440464.0 [2024-08-06 03:31:10,467][52647] Sum rewards: 73.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.856', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.088', 'weapon4': '0.090', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:10,472][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:31:11,029][52667] DAMAGECOUNT value on done: 414356.0 [2024-08-06 03:31:11,030][52667] Sum rewards: 70.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.496', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.025', 'weapon4': '0.056', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon2': '0.546', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.266', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:11,890][52650] Updated weights for policy 0, policy_version 46391 (0.0010) [2024-08-06 03:31:12,300][52664] DAMAGECOUNT value on done: 438841.0 [2024-08-06 03:31:12,300][52664] Sum rewards: 74.297, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.685', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.217', 'AMMO4': '0.225', 'weapon5': '0.236', 'weapon4': '0.336', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:12,447][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:12,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 380043264. Throughput: 0: 4373.6. Samples: 95019170. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:31:12,794][52567] Avg episode reward: [(0, '71.304')] [2024-08-06 03:31:13,524][52647] DAMAGECOUNT value on done: 439542.0 [2024-08-06 03:31:13,527][52647] Sum rewards: 72.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.916', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.096', 'AMMO3': '0.152', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.012', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '58.000'} [2024-08-06 03:31:13,935][52667] DAMAGECOUNT value on done: 419955.0 [2024-08-06 03:31:13,938][52667] Sum rewards: 70.526, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.558', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.288', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 03:31:15,346][52664] DAMAGECOUNT value on done: 436004.0 [2024-08-06 03:31:15,347][52664] Sum rewards: 72.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.256', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '58.500'} [2024-08-06 03:31:16,359][52647] DAMAGECOUNT value on done: 448630.0 [2024-08-06 03:31:16,360][52647] Sum rewards: 76.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.366', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.079', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.398', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '64.000'} [2024-08-06 03:31:16,840][52667] DAMAGECOUNT value on done: 420849.0 [2024-08-06 03:31:16,840][52667] Sum rewards: 64.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.190', 'weapon5': '0.194', 'AMMO4': '0.236', 'weapon2': '0.240', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '2.982', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:17,003][52650] Updated weights for policy 0, policy_version 46401 (0.0022) [2024-08-06 03:31:17,694][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:17,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 380133376. Throughput: 0: 4377.5. Samples: 95032180. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:31:17,795][52567] Avg episode reward: [(0, '71.423')] [2024-08-06 03:31:17,992][52664] DAMAGECOUNT value on done: 443114.0 [2024-08-06 03:31:17,993][52664] Sum rewards: 79.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.925', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '63.000'} [2024-08-06 03:31:18,332][52665] Large shaping reward 3.501 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:18,689][52668] DAMAGECOUNT value on done: 416958.0 [2024-08-06 03:31:18,694][52668] Sum rewards: 80.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.046', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.180', 'weapon5': '0.182', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:18,975][52647] DAMAGECOUNT value on done: 445545.0 [2024-08-06 03:31:18,976][52647] Sum rewards: 75.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.230', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.086', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '64.000'} [2024-08-06 03:31:19,914][52667] DAMAGECOUNT value on done: 414852.0 [2024-08-06 03:31:19,915][52667] Sum rewards: 72.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.659', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.172', 'weapon5': '0.172', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:20,499][52669] DAMAGECOUNT value on done: 423806.0 [2024-08-06 03:31:20,500][52669] Sum rewards: 76.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.096', 'AMMO4': '0.167', 'AMMO3': '0.184', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:20,703][52664] DAMAGECOUNT value on done: 436544.0 [2024-08-06 03:31:20,706][52664] Sum rewards: 80.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.442', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon4': '0.210', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:21,226][52650] Updated weights for policy 0, policy_version 46411 (0.0015) [2024-08-06 03:31:21,658][52647] DAMAGECOUNT value on done: 443202.0 [2024-08-06 03:31:21,659][52647] Sum rewards: 66.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.087', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon7': '0.118', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.163', 'weapon4': '0.174', 'WEAPON7': '0.200', 'AMMO3': '0.218', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.096', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:21,794][52668] DAMAGECOUNT value on done: 420208.0 [2024-08-06 03:31:21,794][52668] Sum rewards: 60.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.296', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.120', 'AMMO4': '0.199', 'weapon4': '0.226', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.712', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '50.500'} [2024-08-06 03:31:22,720][52659] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 380215296. Throughput: 0: 4371.9. Samples: 95058380. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:31:22,794][52567] Avg episode reward: [(0, '71.377')] [2024-08-06 03:31:22,924][52667] DAMAGECOUNT value on done: 422517.0 [2024-08-06 03:31:22,925][52667] Sum rewards: 72.538, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.028', 'HEALTH': '0.094', 'AMMO4': '0.138', 'weapon5': '0.168', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.260', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:23,231][52669] DAMAGECOUNT value on done: 411885.0 [2024-08-06 03:31:23,232][52669] Sum rewards: 63.975, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.156', 'weapon2': '0.384', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.324', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '51.000'} [2024-08-06 03:31:23,921][52664] DAMAGECOUNT value on done: 440358.0 [2024-08-06 03:31:23,921][52664] Sum rewards: 63.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.250', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.190', 'AMMO3': '0.263', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '2.742', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '54.000'} [2024-08-06 03:31:24,566][52668] DAMAGECOUNT value on done: 421892.0 [2024-08-06 03:31:24,569][52668] Sum rewards: 56.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.901', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon5': '0.126', 'weapon4': '0.194', 'weapon2': '0.196', 'AMMO3': '0.212', 'AMMO4': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.196', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '49.000'} [2024-08-06 03:31:24,755][52647] DAMAGECOUNT value on done: 442693.0 [2024-08-06 03:31:24,755][52647] Sum rewards: 68.576, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.462', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.186', 'AMMO4': '0.189', 'AMMO3': '0.248', 'weapon2': '0.264', 'weapon4': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:25,680][52669] DAMAGECOUNT value on done: 423394.0 [2024-08-06 03:31:25,682][52669] Sum rewards: 82.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.196', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.171', 'weapon4': '0.190', 'weapon2': '0.282', 'WEAPON3': '1.050', 'weapon3': '3.338', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:26,254][52667] DAMAGECOUNT value on done: 429219.0 [2024-08-06 03:31:26,255][52667] Sum rewards: 51.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.244', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.454', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '44.000'} [2024-08-06 03:31:26,467][52650] Updated weights for policy 0, policy_version 46421 (0.0012) [2024-08-06 03:31:26,657][52664] DAMAGECOUNT value on done: 433198.0 [2024-08-06 03:31:26,665][52664] Sum rewards: 72.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.272', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.466', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '58.000'} [2024-08-06 03:31:27,374][52647] DAMAGECOUNT value on done: 435126.0 [2024-08-06 03:31:27,374][52647] Sum rewards: 60.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.147', 'weapon5': '0.162', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.672', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '2.886', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '50.000'} [2024-08-06 03:31:27,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 380313600. Throughput: 0: 4370.9. Samples: 95084540. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:31:27,794][52567] Avg episode reward: [(0, '70.702')] [2024-08-06 03:31:27,824][52668] DAMAGECOUNT value on done: 423728.0 [2024-08-06 03:31:27,824][52668] Sum rewards: 85.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.098', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.490', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '70.000'} [2024-08-06 03:31:28,467][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:28,835][52669] DAMAGECOUNT value on done: 417483.0 [2024-08-06 03:31:28,835][52669] Sum rewards: 72.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.286', 'weapon5': '0.004', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.290', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:29,108][52664] DAMAGECOUNT value on done: 433266.0 [2024-08-06 03:31:29,109][52664] Sum rewards: 67.518, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.572', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.140', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.538', 'WEAPON3': '1.500', 'weapon3': '2.990', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:29,503][52667] DAMAGECOUNT value on done: 426378.0 [2024-08-06 03:31:29,503][52667] Sum rewards: 60.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.140', 'weapon4': '0.176', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '50.000'} [2024-08-06 03:31:29,777][52647] DAMAGECOUNT value on done: 448334.0 [2024-08-06 03:31:29,780][52647] Sum rewards: 64.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.255', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:30,143][52662] DAMAGECOUNT value on done: 423764.0 [2024-08-06 03:31:30,143][52662] Sum rewards: 71.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.102', 'weapon2': '0.138', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.524', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:30,451][52650] Updated weights for policy 0, policy_version 46431 (0.0014) [2024-08-06 03:31:30,737][52668] DAMAGECOUNT value on done: 411766.0 [2024-08-06 03:31:30,739][52668] Sum rewards: 72.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.146', 'AMMO3': '0.174', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '58.000'} [2024-08-06 03:31:31,857][52669] DAMAGECOUNT value on done: 418294.0 [2024-08-06 03:31:31,861][52669] Sum rewards: 79.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.045', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.104', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.122', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '67.000'} [2024-08-06 03:31:31,983][52664] DAMAGECOUNT value on done: 434198.0 [2024-08-06 03:31:31,984][52664] Sum rewards: 75.893, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.434', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:32,368][52667] DAMAGECOUNT value on done: 423430.0 [2024-08-06 03:31:32,371][52667] Sum rewards: 80.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.100', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'AMMO3': '0.265', 'weapon2': '0.270', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.014', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '69.000'} [2024-08-06 03:31:32,685][52662] DAMAGECOUNT value on done: 424671.0 [2024-08-06 03:31:32,685][52662] Sum rewards: 67.275, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.764', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.126', 'AMMO4': '0.193', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.204', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '56.500'} [2024-08-06 03:31:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 380395520. Throughput: 0: 4369.3. Samples: 95097670. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:31:32,794][52567] Avg episode reward: [(0, '71.092')] [2024-08-06 03:31:32,844][52647] DAMAGECOUNT value on done: 437671.0 [2024-08-06 03:31:32,845][52647] Sum rewards: 63.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.906', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.178', 'AMMO4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.262', 'weapon4': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '53.000'} [2024-08-06 03:31:33,722][52668] DAMAGECOUNT value on done: 423211.0 [2024-08-06 03:31:33,722][52668] Sum rewards: 79.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.349', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.124', 'weapon5': '0.128', 'AMMO4': '0.201', 'weapon2': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.258', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '67.000'} [2024-08-06 03:31:34,937][52669] DAMAGECOUNT value on done: 423317.0 [2024-08-06 03:31:34,939][52669] Sum rewards: 69.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.120', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.142', 'AMMO4': '0.156', 'weapon5': '0.182', 'AMMO3': '0.237', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.156', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:35,036][52664] DAMAGECOUNT value on done: 432361.0 [2024-08-06 03:31:35,038][52664] Sum rewards: 68.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon5': '0.188', 'AMMO3': '0.223', 'AMMO4': '0.299', 'weapon2': '0.420', 'WEAPON5': '0.500', 'weapon4': '0.506', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:35,478][52665] DAMAGECOUNT value on done: 411410.0 [2024-08-06 03:31:35,478][52665] Sum rewards: 66.849, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.118', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:35,582][52662] DAMAGECOUNT value on done: 423738.0 [2024-08-06 03:31:35,583][52662] Sum rewards: 71.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.186', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:35,661][52650] Updated weights for policy 0, policy_version 46441 (0.0028) [2024-08-06 03:31:35,759][52667] DAMAGECOUNT value on done: 417180.0 [2024-08-06 03:31:35,760][52667] Sum rewards: 72.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.675', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.078', 'AMMO4': '0.192', 'AMMO3': '0.198', 'weapon5': '0.210', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.214', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:35,794][52647] DAMAGECOUNT value on done: 442298.0 [2024-08-06 03:31:35,795][52647] Sum rewards: 71.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.046', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:36,312][52668] DAMAGECOUNT value on done: 422096.0 [2024-08-06 03:31:36,314][52668] Sum rewards: 67.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.258', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.139', 'weapon5': '0.142', 'AMMO4': '0.165', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '52.000'} [2024-08-06 03:31:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.5, 300 sec: 17522.5). Total num frames: 380477440. Throughput: 0: 4366.9. Samples: 95123840. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:31:37,794][52567] Avg episode reward: [(0, '71.030')] [2024-08-06 03:31:38,243][52664] DAMAGECOUNT value on done: 433332.0 [2024-08-06 03:31:38,243][52664] Sum rewards: 66.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.176', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 03:31:38,258][52669] DAMAGECOUNT value on done: 419890.0 [2024-08-06 03:31:38,259][52669] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.146', 'AMMO3': '0.215', 'weapon2': '0.290', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:38,299][52665] DAMAGECOUNT value on done: 419929.0 [2024-08-06 03:31:38,299][52665] Sum rewards: 64.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.052', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.326', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.400', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '56.000'} [2024-08-06 03:31:38,501][52662] DAMAGECOUNT value on done: 414581.0 [2024-08-06 03:31:38,501][52662] Sum rewards: 76.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.854', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.204', 'weapon4': '0.206', 'weapon5': '0.228', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 03:31:38,738][52667] DAMAGECOUNT value on done: 425483.0 [2024-08-06 03:31:38,739][52667] Sum rewards: 73.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:38,759][52658] DAMAGECOUNT value on done: 417973.0 [2024-08-06 03:31:38,760][52658] Sum rewards: 71.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.852', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.340', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:38,761][52647] DAMAGECOUNT value on done: 434446.0 [2024-08-06 03:31:38,761][52647] Sum rewards: 75.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.619', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.127', 'AMMO3': '0.167', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.902', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:39,166][52668] DAMAGECOUNT value on done: 414572.0 [2024-08-06 03:31:39,166][52668] Sum rewards: 76.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.891', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.070', 'AMMO4': '0.125', 'weapon5': '0.142', 'weapon2': '0.168', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.342', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '64.000'} [2024-08-06 03:31:40,213][52668] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:31:40,302][52650] Updated weights for policy 0, policy_version 46451 (0.0012) [2024-08-06 03:31:41,006][52660] DAMAGECOUNT value on done: 417005.0 [2024-08-06 03:31:41,007][52660] Sum rewards: 77.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.066', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.102', 'weapon5': '0.136', 'AMMO4': '0.183', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '62.000'} [2024-08-06 03:31:41,322][52665] DAMAGECOUNT value on done: 418674.0 [2024-08-06 03:31:41,324][52665] Sum rewards: 72.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.180', 'AMMO3': '0.220', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '62.000'} [2024-08-06 03:31:41,333][52658] DAMAGECOUNT value on done: 421465.0 [2024-08-06 03:31:41,334][52658] Sum rewards: 81.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.114', 'AMMO4': '0.169', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '69.000'} [2024-08-06 03:31:41,334][52662] DAMAGECOUNT value on done: 426075.0 [2024-08-06 03:31:41,336][52662] Sum rewards: 90.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.110', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '75.000'} [2024-08-06 03:31:41,396][52647] DAMAGECOUNT value on done: 440822.0 [2024-08-06 03:31:41,398][52647] Sum rewards: 72.445, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.545', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.145', 'AMMO3': '0.163', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:41,528][52669] DAMAGECOUNT value on done: 420672.0 [2024-08-06 03:31:41,530][52669] Sum rewards: 66.920, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.830', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.320', 'WEAPON3': '2.000', 'weapon3': '3.430', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:41,826][52668] DAMAGECOUNT value on done: 417436.0 [2024-08-06 03:31:41,828][52668] Sum rewards: 64.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.168', 'AMMO3': '0.172', 'AMMO4': '0.256', 'weapon4': '0.288', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '51.000'} [2024-08-06 03:31:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 380567552. Throughput: 0: 4376.9. Samples: 95150280. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:31:42,794][52567] Avg episode reward: [(0, '71.436')] [2024-08-06 03:31:43,243][52811] DAMAGECOUNT value on done: 402838.0 [2024-08-06 03:31:43,248][52811] Sum rewards: 77.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.666', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.144', 'weapon5': '0.206', 'AMMO4': '0.241', 'weapon2': '0.256', 'AMMO3': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '65.000'} [2024-08-06 03:31:43,923][52658] DAMAGECOUNT value on done: 425575.0 [2024-08-06 03:31:43,927][52658] Sum rewards: 64.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.094', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.178', 'AMMO3': '0.184', 'weapon2': '0.232', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '53.000'} [2024-08-06 03:31:43,980][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:31:44,159][52671] DAMAGECOUNT value on done: 423946.0 [2024-08-06 03:31:44,159][52671] Sum rewards: 81.496, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.148', 'weapon4': '0.194', 'weapon5': '0.220', 'AMMO4': '0.294', 'weapon2': '0.312', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '3.008', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '64.000'} [2024-08-06 03:31:44,176][52647] DAMAGECOUNT value on done: 436489.0 [2024-08-06 03:31:44,177][52647] Sum rewards: 65.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.014', 'AMMO2': '0.060', 'weapon4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.230', 'AMMO4': '0.302', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '54.500'} [2024-08-06 03:31:44,191][52662] DAMAGECOUNT value on done: 418078.0 [2024-08-06 03:31:44,192][52662] Sum rewards: 80.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.157', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.131', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:44,236][52660] DAMAGECOUNT value on done: 411230.0 [2024-08-06 03:31:44,237][52660] Sum rewards: 66.546, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.731', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.058', 'weapon4': '0.072', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.476', 'WEAPON3': '1.000', 'HITCOUNT': '3.160', 'weapon3': '3.250', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2024-08-06 03:31:44,299][52669] DAMAGECOUNT value on done: 424023.0 [2024-08-06 03:31:44,300][52669] Sum rewards: 60.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.262', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '51.000'} [2024-08-06 03:31:44,575][52665] DAMAGECOUNT value on done: 413985.0 [2024-08-06 03:31:44,575][52665] Sum rewards: 79.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.044', 'AMMO4': '0.147', 'weapon5': '0.154', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '67.000'} [2024-08-06 03:31:44,756][52650] Updated weights for policy 0, policy_version 46461 (0.0010) [2024-08-06 03:31:44,801][52803] DAMAGECOUNT value on done: 392294.0 [2024-08-06 03:31:44,803][52803] Sum rewards: 70.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.378', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.099', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.263', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.364', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:45,131][52668] DAMAGECOUNT value on done: 423295.0 [2024-08-06 03:31:45,131][52668] Sum rewards: 69.906, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.010', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.074', 'weapon5': '0.140', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.294', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:46,475][52811] DAMAGECOUNT value on done: 387687.0 [2024-08-06 03:31:46,476][52811] Sum rewards: 58.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon2': '0.158', 'AMMO4': '0.167', 'AMMO3': '0.222', 'weapon5': '0.234', 'weapon4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.126', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '49.000'} [2024-08-06 03:31:46,536][52671] DAMAGECOUNT value on done: 423087.0 [2024-08-06 03:31:46,538][52671] Sum rewards: 67.979, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.215', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.248', 'AMMO3': '0.294', 'WEAPON3': '1.800', 'HITCOUNT': '3.370', 'weapon3': '3.508', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:46,699][52647] DAMAGECOUNT value on done: 446870.0 [2024-08-06 03:31:46,700][52647] Sum rewards: 55.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.160', 'weapon4': '0.190', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.094', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '47.000'} [2024-08-06 03:31:46,947][52662] DAMAGECOUNT value on done: 428105.0 [2024-08-06 03:31:46,948][52662] Sum rewards: 69.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:47,071][52658] DAMAGECOUNT value on done: 422346.0 [2024-08-06 03:31:47,072][52658] Sum rewards: 66.530, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.396', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.238', 'AMMO4': '0.246', 'AMMO3': '0.256', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.016', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:47,137][52669] DAMAGECOUNT value on done: 419508.0 [2024-08-06 03:31:47,138][52669] Sum rewards: 76.586, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.147', 'AMMO3': '0.162', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:47,542][52660] DAMAGECOUNT value on done: 423812.0 [2024-08-06 03:31:47,544][52660] Sum rewards: 55.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.097', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.070', 'AMMO3': '0.171', 'AMMO4': '0.201', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '45.000'} [2024-08-06 03:31:47,752][52665] DAMAGECOUNT value on done: 406278.0 [2024-08-06 03:31:47,754][52665] Sum rewards: 65.617, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.168', 'AMMO3': '0.178', 'weapon5': '0.200', 'AMMO4': '0.221', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '53.500'} [2024-08-06 03:31:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 380657664. Throughput: 0: 4379.4. Samples: 95163550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:31:47,794][52567] Avg episode reward: [(0, '71.088')] [2024-08-06 03:31:47,900][52803] DAMAGECOUNT value on done: 388011.0 [2024-08-06 03:31:47,900][52803] Sum rewards: 71.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.050', 'weapon4': '0.114', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:48,350][52668] DAMAGECOUNT value on done: 419733.0 [2024-08-06 03:31:48,353][52668] Sum rewards: 68.733, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.098', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.266', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.352', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '56.000'} [2024-08-06 03:31:49,282][52647] DAMAGECOUNT value on done: 437730.0 [2024-08-06 03:31:49,283][52647] Sum rewards: 67.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.155', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO3': '0.194', 'AMMO4': '0.194', 'weapon4': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '58.000'} [2024-08-06 03:31:49,383][52669] DAMAGECOUNT value on done: 424171.0 [2024-08-06 03:31:49,385][52669] Sum rewards: 61.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.928', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon4': '0.108', 'AMMO3': '0.190', 'AMMO4': '0.196', 'weapon2': '0.200', 'weapon5': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.158', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '52.000'} [2024-08-06 03:31:49,425][52671] DAMAGECOUNT value on done: 422939.0 [2024-08-06 03:31:49,425][52671] Sum rewards: 77.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.690', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.036', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.314', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '67.000'} [2024-08-06 03:31:49,631][52811] DAMAGECOUNT value on done: 389411.0 [2024-08-06 03:31:49,635][52811] Sum rewards: 73.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.235', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.068', 'weapon5': '0.088', 'AMMO4': '0.122', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '62.000'} [2024-08-06 03:31:49,708][52650] Updated weights for policy 0, policy_version 46471 (0.0032) [2024-08-06 03:31:49,761][52658] DAMAGECOUNT value on done: 413249.0 [2024-08-06 03:31:49,762][52658] Sum rewards: 59.087, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.072', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.170', 'weapon4': '0.178', 'AMMO4': '0.195', 'AMMO3': '0.236', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.046', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '51.000'} [2024-08-06 03:31:49,864][52662] DAMAGECOUNT value on done: 430001.0 [2024-08-06 03:31:49,864][52662] Sum rewards: 73.222, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.924', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.166', 'weapon5': '0.218', 'AMMO4': '0.258', 'weapon4': '0.318', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '58.000'} [2024-08-06 03:31:50,714][52660] DAMAGECOUNT value on done: 426085.0 [2024-08-06 03:31:50,715][52660] Sum rewards: 62.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.594', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.112', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.200', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '52.000'} [2024-08-06 03:31:50,983][52803] DAMAGECOUNT value on done: 395004.0 [2024-08-06 03:31:50,985][52803] Sum rewards: 78.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.062', 'AMMO4': '0.067', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.248', 'WEAPON3': '1.400', 'weapon3': '3.414', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:51,017][52665] DAMAGECOUNT value on done: 409174.0 [2024-08-06 03:31:51,018][52665] Sum rewards: 81.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.332', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '67.000'} [2024-08-06 03:31:51,461][52668] DAMAGECOUNT value on done: 414990.0 [2024-08-06 03:31:51,462][52668] Sum rewards: 76.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.206', 'weapon2': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.420', 'weapon3': '3.426', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 03:31:51,912][52669] DAMAGECOUNT value on done: 420472.0 [2024-08-06 03:31:51,912][52669] Sum rewards: 84.253, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.132', 'AMMO3': '0.177', 'AMMO4': '0.244', 'weapon2': '0.322', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '67.000'} [2024-08-06 03:31:52,056][52647] DAMAGECOUNT value on done: 434237.0 [2024-08-06 03:31:52,057][52647] Sum rewards: 76.739, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.890', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.118', 'weapon5': '0.142', 'AMMO3': '0.179', 'AMMO4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '63.000'} [2024-08-06 03:31:52,169][52671] DAMAGECOUNT value on done: 422060.0 [2024-08-06 03:31:52,170][52671] Sum rewards: 61.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.422', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.151', 'weapon5': '0.194', 'weapon2': '0.204', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.290', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '51.500'} [2024-08-06 03:31:52,724][52811] DAMAGECOUNT value on done: 390024.0 [2024-08-06 03:31:52,725][52811] Sum rewards: 77.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.135', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '64.000'} [2024-08-06 03:31:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 380747776. Throughput: 0: 4377.8. Samples: 95189740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:31:52,794][52567] Avg episode reward: [(0, '71.355')] [2024-08-06 03:31:52,900][52662] DAMAGECOUNT value on done: 419054.0 [2024-08-06 03:31:52,901][52662] Sum rewards: 84.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.854', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.520', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '70.000'} [2024-08-06 03:31:52,953][52658] DAMAGECOUNT value on done: 418728.0 [2024-08-06 03:31:52,954][52658] Sum rewards: 66.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.739', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:53,872][52660] DAMAGECOUNT value on done: 417298.0 [2024-08-06 03:31:53,872][52660] Sum rewards: 64.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.395', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.060', 'WEAPON4': '0.100', 'weapon2': '0.158', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'HITCOUNT': '3.500', 'weapon3': '3.598', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '56.000'} [2024-08-06 03:31:54,132][52665] DAMAGECOUNT value on done: 413321.0 [2024-08-06 03:31:54,136][52665] Sum rewards: 71.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.111', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:54,144][52803] DAMAGECOUNT value on done: 397233.0 [2024-08-06 03:31:54,145][52803] Sum rewards: 75.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.395', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.174', 'weapon2': '0.428', 'WEAPON3': '1.050', 'weapon3': '3.330', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:54,252][52650] Updated weights for policy 0, policy_version 46481 (0.0023) [2024-08-06 03:31:54,338][52647] DAMAGECOUNT value on done: 436759.0 [2024-08-06 03:31:54,340][52647] Sum rewards: 67.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.798', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.086', 'weapon5': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 03:31:54,379][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:31:54,509][52668] DAMAGECOUNT value on done: 409996.0 [2024-08-06 03:31:54,509][52668] Sum rewards: 68.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.200', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.174', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'weapon2': '0.334', 'WEAPON4': '0.600', 'weapon4': '0.640', 'WEAPON3': '1.050', 'weapon3': '2.496', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:54,914][52669] DAMAGECOUNT value on done: 412269.0 [2024-08-06 03:31:54,914][52669] Sum rewards: 70.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.340', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '58.000'} [2024-08-06 03:31:54,942][52671] DAMAGECOUNT value on done: 429705.0 [2024-08-06 03:31:54,942][52671] Sum rewards: 72.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.986', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.200', 'HITCOUNT': '3.490', 'weapon3': '3.548', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:55,599][52662] DAMAGECOUNT value on done: 431738.0 [2024-08-06 03:31:55,600][52662] Sum rewards: 70.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.765', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.118', 'weapon4': '0.130', 'AMMO4': '0.153', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.000'} [2024-08-06 03:31:55,790][52811] DAMAGECOUNT value on done: 392244.0 [2024-08-06 03:31:55,802][52811] Sum rewards: 80.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.024', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.114', 'weapon2': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'WEAPON3': '1.350', 'weapon3': '3.560', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '66.000'} [2024-08-06 03:31:56,059][52658] DAMAGECOUNT value on done: 422726.0 [2024-08-06 03:31:56,060][52658] Sum rewards: 69.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.952', 'AMMO5': '0.022', 'AMMO2': '0.072', 'weapon4': '0.140', 'AMMO3': '0.234', 'weapon2': '0.312', 'weapon5': '0.350', 'AMMO4': '0.361', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '60.000'} [2024-08-06 03:31:56,460][52660] DAMAGECOUNT value on done: 415611.0 [2024-08-06 03:31:56,461][52660] Sum rewards: 74.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.932', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'weapon4': '0.078', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '61.000'} [2024-08-06 03:31:56,959][52647] DAMAGECOUNT value on done: 436425.0 [2024-08-06 03:31:56,959][52647] Sum rewards: 61.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.004', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.202', 'AMMO3': '0.216', 'AMMO4': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '52.000'} [2024-08-06 03:31:56,990][52668] DAMAGECOUNT value on done: 412080.0 [2024-08-06 03:31:56,991][52668] Sum rewards: 72.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.022', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.430', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.000'} [2024-08-06 03:31:57,171][52665] DAMAGECOUNT value on done: 417380.0 [2024-08-06 03:31:57,172][52665] Sum rewards: 60.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.140', 'weapon5': '0.216', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.064', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '52.000'} [2024-08-06 03:31:57,294][52803] DAMAGECOUNT value on done: 396353.0 [2024-08-06 03:31:57,294][52803] Sum rewards: 65.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.194', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.000'} [2024-08-06 03:31:57,755][52663] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2024-08-06 03:31:57,773][52671] DAMAGECOUNT value on done: 420603.0 [2024-08-06 03:31:57,773][52671] Sum rewards: 73.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.003', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.958', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 380829696. Throughput: 0: 4373.5. Samples: 95215980. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:31:57,794][52567] Avg episode reward: [(0, '70.578')] [2024-08-06 03:31:58,071][52669] DAMAGECOUNT value on done: 423183.0 [2024-08-06 03:31:58,072][52669] Sum rewards: 59.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.464', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.155', 'weapon7': '0.160', 'weapon5': '0.160', 'AMMO4': '0.164', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon4': '1.102', 'weapon3': '2.130', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '46.000'} [2024-08-06 03:31:58,417][52662] DAMAGECOUNT value on done: 417748.0 [2024-08-06 03:31:58,417][52662] Sum rewards: 74.268, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.478', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.133', 'weapon2': '0.152', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.528', 'WEAPON3': '0.950', 'weapon3': '2.882', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:58,816][52650] Updated weights for policy 0, policy_version 46491 (0.0031) [2024-08-06 03:31:58,920][52811] DAMAGECOUNT value on done: 397575.0 [2024-08-06 03:31:58,921][52811] Sum rewards: 72.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.828', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.132', 'weapon4': '0.158', 'AMMO4': '0.178', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '58.500'} [2024-08-06 03:31:59,113][52660] DAMAGECOUNT value on done: 418719.0 [2024-08-06 03:31:59,115][52660] Sum rewards: 64.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.985', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.072', 'weapon5': '0.116', 'AMMO4': '0.156', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.236', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '53.000'} [2024-08-06 03:31:59,256][52658] DAMAGECOUNT value on done: 414268.0 [2024-08-06 03:31:59,259][52658] Sum rewards: 68.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.047', 'AMMO5': '0.007', 'AMMO2': '0.057', 'weapon5': '0.152', 'weapon4': '0.164', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO4': '0.285', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:59,731][52647] DAMAGECOUNT value on done: 436970.0 [2024-08-06 03:31:59,732][52647] Sum rewards: 68.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2024-08-06 03:31:59,758][52668] DAMAGECOUNT value on done: 410941.0 [2024-08-06 03:31:59,758][52668] Sum rewards: 74.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '61.000'} [2024-08-06 03:32:00,397][52665] DAMAGECOUNT value on done: 419021.0 [2024-08-06 03:32:00,397][52665] Sum rewards: 74.142, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.141', 'weapon5': '0.174', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.158', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '63.000'} [2024-08-06 03:32:00,489][52671] DAMAGECOUNT value on done: 428135.0 [2024-08-06 03:32:00,489][52671] Sum rewards: 69.939, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.498', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon5': '0.252', 'weapon2': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.094', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:00,529][52803] DAMAGECOUNT value on done: 383915.0 [2024-08-06 03:32:00,530][52803] Sum rewards: 67.407, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.595', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon4': '0.166', 'weapon2': '0.172', 'weapon5': '0.200', 'AMMO3': '0.277', 'AMMO4': '0.283', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.150', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:01,055][52669] DAMAGECOUNT value on done: 427125.0 [2024-08-06 03:32:01,057][52669] Sum rewards: 69.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.114', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '55.000'} [2024-08-06 03:32:01,502][52662] DAMAGECOUNT value on done: 421995.0 [2024-08-06 03:32:01,502][52662] Sum rewards: 68.779, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.142', 'weapon4': '0.166', 'AMMO4': '0.251', 'AMMO3': '0.261', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:01,814][52660] DAMAGECOUNT value on done: 425235.0 [2024-08-06 03:32:01,815][52660] Sum rewards: 71.406, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.248', 'AMMO5': '0.017', 'AMMO2': '0.070', 'AMMO3': '0.180', 'weapon4': '0.222', 'weapon5': '0.274', 'AMMO4': '0.351', 'weapon2': '0.468', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:01,964][52811] DAMAGECOUNT value on done: 392819.0 [2024-08-06 03:32:01,964][52811] Sum rewards: 69.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.316', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon2': '0.174', 'weapon4': '0.182', 'AMMO4': '0.209', 'weapon5': '0.226', 'AMMO3': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.078', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 03:32:02,338][52668] DAMAGECOUNT value on done: 417835.0 [2024-08-06 03:32:02,338][52668] Sum rewards: 84.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.293', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.214', 'AMMO3': '0.221', 'WEAPON3': '1.250', 'weapon3': '3.448', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '69.000'} [2024-08-06 03:32:02,420][52658] DAMAGECOUNT value on done: 428733.0 [2024-08-06 03:32:02,420][52658] Sum rewards: 70.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.505', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.110', 'weapon5': '0.152', 'AMMO3': '0.156', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 380919808. Throughput: 0: 4371.6. Samples: 95228900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:32:02,794][52567] Avg episode reward: [(0, '70.839')] [2024-08-06 03:32:03,301][52665] DAMAGECOUNT value on done: 415312.0 [2024-08-06 03:32:03,302][52665] Sum rewards: 70.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.162', 'weapon2': '0.170', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:03,411][52671] DAMAGECOUNT value on done: 425017.0 [2024-08-06 03:32:03,412][52671] Sum rewards: 79.764, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HEALTH': '0.029', 'weapon4': '0.036', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:03,657][52803] DAMAGECOUNT value on done: 387540.0 [2024-08-06 03:32:03,659][52803] Sum rewards: 69.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.546', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.103', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.326', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.272', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '59.000'} [2024-08-06 03:32:03,779][52650] Updated weights for policy 0, policy_version 46501 (0.0011) [2024-08-06 03:32:04,197][52669] DAMAGECOUNT value on done: 433804.0 [2024-08-06 03:32:04,199][52669] Sum rewards: 55.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.505', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.190', 'AMMO3': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.300', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '46.000'} [2024-08-06 03:32:04,386][52660] DAMAGECOUNT value on done: 422184.0 [2024-08-06 03:32:04,387][52660] Sum rewards: 64.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.785', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.118', 'weapon4': '0.156', 'AMMO4': '0.180', 'AMMO3': '0.236', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.206', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '55.000'} [2024-08-06 03:32:04,633][52662] DAMAGECOUNT value on done: 421056.0 [2024-08-06 03:32:04,634][52662] Sum rewards: 56.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.156', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.378', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.124', 'FRAGCOUNT': '50.000'} [2024-08-06 03:32:04,968][52668] DAMAGECOUNT value on done: 422550.0 [2024-08-06 03:32:04,969][52668] Sum rewards: 80.359, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.179', 'weapon5': '0.182', 'HEALTH': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.440', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '63.000'} [2024-08-06 03:32:05,133][52664] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:32:05,205][52811] DAMAGECOUNT value on done: 391993.0 [2024-08-06 03:32:05,206][52811] Sum rewards: 79.473, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.140', 'weapon4': '0.192', 'AMMO3': '0.219', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '66.000'} [2024-08-06 03:32:05,401][52658] DAMAGECOUNT value on done: 419726.0 [2024-08-06 03:32:05,401][52658] Sum rewards: 50.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.860', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.166', 'AMMO4': '0.172', 'AMMO3': '0.220', 'weapon2': '0.238', 'weapon4': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.104', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '44.000'} [2024-08-06 03:32:05,810][52614] Signal inference workers to stop experience collection... (8400 times) [2024-08-06 03:32:05,821][52614] Signal inference workers to resume experience collection... (8400 times) [2024-08-06 03:32:05,909][52650] InferenceWorker_p0-w0: stopping experience collection (8400 times) [2024-08-06 03:32:05,909][52650] InferenceWorker_p0-w0: resuming experience collection (8400 times) [2024-08-06 03:32:06,263][52665] DAMAGECOUNT value on done: 420848.0 [2024-08-06 03:32:06,266][52665] Sum rewards: 61.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.187', 'weapon5': '0.198', 'weapon4': '0.204', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '49.000'} [2024-08-06 03:32:06,282][52671] DAMAGECOUNT value on done: 419353.0 [2024-08-06 03:32:06,283][52671] Sum rewards: 69.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.134', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:06,795][52803] DAMAGECOUNT value on done: 386890.0 [2024-08-06 03:32:06,795][52803] Sum rewards: 68.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.370', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:07,146][52660] DAMAGECOUNT value on done: 416308.0 [2024-08-06 03:32:07,148][52660] Sum rewards: 56.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon5': '0.206', 'AMMO3': '0.208', 'AMMO4': '0.284', 'weapon2': '0.302', 'weapon4': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.912', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '48.000'} [2024-08-06 03:32:07,349][52669] DAMAGECOUNT value on done: 422062.0 [2024-08-06 03:32:07,349][52669] Sum rewards: 70.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.412', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.180', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:07,759][52668] DAMAGECOUNT value on done: 419129.0 [2024-08-06 03:32:07,760][52668] Sum rewards: 77.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.098', 'AMMO4': '0.121', 'weapon5': '0.124', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '62.000'} [2024-08-06 03:32:07,772][52662] DAMAGECOUNT value on done: 427993.0 [2024-08-06 03:32:07,772][52662] Sum rewards: 76.017, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.730', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.058', 'AMMO4': '0.161', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.120', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 381001728. Throughput: 0: 4380.7. Samples: 95255510. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:32:07,802][52567] Avg episode reward: [(0, '70.262')] [2024-08-06 03:32:08,289][52650] Updated weights for policy 0, policy_version 46511 (0.0010) [2024-08-06 03:32:08,300][52658] DAMAGECOUNT value on done: 431925.0 [2024-08-06 03:32:08,300][52658] Sum rewards: 78.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.024', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.060', 'weapon5': '0.086', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '65.000'} [2024-08-06 03:32:08,336][52811] DAMAGECOUNT value on done: 395927.0 [2024-08-06 03:32:08,336][52811] Sum rewards: 84.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.088', 'weapon5': '0.096', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.048', 'FRAGCOUNT': '68.000'} [2024-08-06 03:32:08,793][52660] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:32:08,819][52665] DAMAGECOUNT value on done: 416207.0 [2024-08-06 03:32:08,819][52665] Sum rewards: 60.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.132', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.196', 'weapon2': '0.260', 'AMMO3': '0.274', 'weapon5': '0.280', 'AMMO4': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.820', 'weapon3': '2.904', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:09,475][52671] DAMAGECOUNT value on done: 425961.0 [2024-08-06 03:32:09,476][52671] Sum rewards: 49.015, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.602', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO4': '0.175', 'weapon2': '0.188', 'weapon5': '0.244', 'AMMO3': '0.319', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '2.550', 'weapon3': '3.156', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '46.000'} [2024-08-06 03:32:09,819][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:32:09,950][52803] DAMAGECOUNT value on done: 394460.0 [2024-08-06 03:32:09,950][52803] Sum rewards: 71.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.796', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'weapon4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '61.000'} [2024-08-06 03:32:10,044][52660] DAMAGECOUNT value on done: 428160.0 [2024-08-06 03:32:10,045][52660] Sum rewards: 73.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.063', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.168', 'weapon4': '0.180', 'AMMO4': '0.193', 'weapon5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.012', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '59.000'} [2024-08-06 03:32:10,399][52669] DAMAGECOUNT value on done: 423737.0 [2024-08-06 03:32:10,401][52669] Sum rewards: 70.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.100', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.194', 'weapon2': '0.202', 'weapon5': '0.242', 'AMMO4': '0.266', 'weapon4': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:10,757][52668] DAMAGECOUNT value on done: 424809.0 [2024-08-06 03:32:10,759][52668] Sum rewards: 79.855, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-5.000', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.054', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.320', 'AMMO3': '0.330', 'WEAPON3': '2.050', 'weapon3': '3.226', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '73.000'} [2024-08-06 03:32:10,768][52662] DAMAGECOUNT value on done: 421227.0 [2024-08-06 03:32:10,768][52662] Sum rewards: 81.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.394', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.219', 'WEAPON3': '1.350', 'weapon3': '3.396', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '66.000'} [2024-08-06 03:32:11,353][52811] DAMAGECOUNT value on done: 392845.0 [2024-08-06 03:32:11,353][52811] Sum rewards: 66.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.529', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.142', 'AMMO3': '0.165', 'AMMO4': '0.201', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:11,577][52658] DAMAGECOUNT value on done: 411885.0 [2024-08-06 03:32:11,577][52658] Sum rewards: 70.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.080', 'weapon5': '0.138', 'AMMO3': '0.193', 'weapon2': '0.262', 'AMMO4': '0.271', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.328', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:11,638][52820] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:32:11,912][52665] DAMAGECOUNT value on done: 413996.0 [2024-08-06 03:32:11,912][52665] Sum rewards: 74.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.442', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.140', 'AMMO4': '0.225', 'weapon5': '0.234', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '2.846', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:12,145][52671] DAMAGECOUNT value on done: 430792.0 [2024-08-06 03:32:12,146][52671] Sum rewards: 72.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.212', 'weapon5': '0.216', 'weapon2': '0.222', 'AMMO4': '0.275', 'weapon4': '0.306', 'WEAPON5': '0.450', 'ARMOR': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '61.000'} [2024-08-06 03:32:12,609][52660] DAMAGECOUNT value on done: 411205.0 [2024-08-06 03:32:12,611][52660] Sum rewards: 64.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'weapon4': '0.034', 'AMMO2': '0.035', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.246', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 381091840. Throughput: 0: 4385.8. Samples: 95281900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 03:32:12,802][52567] Avg episode reward: [(0, '69.959')] [2024-08-06 03:32:12,958][52650] Updated weights for policy 0, policy_version 46521 (0.0016) [2024-08-06 03:32:13,146][52803] DAMAGECOUNT value on done: 386205.0 [2024-08-06 03:32:13,146][52803] Sum rewards: 61.438, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.556', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.198', 'weapon5': '0.208', 'AMMO3': '0.217', 'AMMO4': '0.287', 'weapon2': '0.482', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:13,172][52668] DAMAGECOUNT value on done: 417237.0 [2024-08-06 03:32:13,174][52668] Sum rewards: 81.083, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.540', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.050', 'AMMO4': '0.153', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '3.088', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:13,352][52669] DAMAGECOUNT value on done: 425004.0 [2024-08-06 03:32:13,353][52669] Sum rewards: 63.566, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.610', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.192', 'AMMO3': '0.209', 'AMMO4': '0.215', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '53.000'} [2024-08-06 03:32:13,828][52662] DAMAGECOUNT value on done: 430254.0 [2024-08-06 03:32:13,829][52662] Sum rewards: 58.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.454', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.090', 'AMMO4': '0.169', 'weapon5': '0.224', 'AMMO3': '0.260', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.810', 'weapon3': '3.144', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:14,369][52811] DAMAGECOUNT value on done: 391253.0 [2024-08-06 03:32:14,373][52811] Sum rewards: 66.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.094', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.204', 'weapon2': '0.508', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.250', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:14,604][52658] DAMAGECOUNT value on done: 422591.0 [2024-08-06 03:32:14,606][52658] Sum rewards: 74.161, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.135', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.210', 'weapon2': '0.232', 'HEALTH': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '0.850', 'weapon3': '3.262', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:14,744][52671] DAMAGECOUNT value on done: 421564.0 [2024-08-06 03:32:14,745][52671] Sum rewards: 72.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.092', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:14,972][52665] DAMAGECOUNT value on done: 413616.0 [2024-08-06 03:32:14,973][52665] Sum rewards: 74.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.022', 'AMMO2': '0.041', 'weapon4': '0.188', 'AMMO3': '0.191', 'AMMO4': '0.205', 'weapon5': '0.228', 'weapon2': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:15,234][52660] DAMAGECOUNT value on done: 415402.0 [2024-08-06 03:32:15,235][52660] Sum rewards: 63.873, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.223', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.096', 'weapon5': '0.148', 'AMMO4': '0.191', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.500', 'weapon3': '2.990', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '56.500'} [2024-08-06 03:32:16,129][52803] DAMAGECOUNT value on done: 397396.0 [2024-08-06 03:32:16,130][52803] Sum rewards: 79.651, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.994', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.152', 'AMMO3': '0.296', 'WEAPON3': '1.850', 'weapon3': '3.520', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '69.000'} [2024-08-06 03:32:16,459][52669] DAMAGECOUNT value on done: 428120.0 [2024-08-06 03:32:16,459][52669] Sum rewards: 84.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'weapon4': '0.194', 'AMMO3': '0.204', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '69.000'} [2024-08-06 03:32:16,933][52662] DAMAGECOUNT value on done: 424872.0 [2024-08-06 03:32:16,934][52662] Sum rewards: 63.323, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.104', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.598', 'WEAPON3': '1.600', 'weapon3': '2.980', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '55.000'} [2024-08-06 03:32:17,340][52671] DAMAGECOUNT value on done: 428629.0 [2024-08-06 03:32:17,342][52671] Sum rewards: 67.486, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.045', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.180', 'weapon4': '0.240', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.214', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '55.000'} [2024-08-06 03:32:17,426][52811] DAMAGECOUNT value on done: 403110.0 [2024-08-06 03:32:17,426][52811] Sum rewards: 77.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.312', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.102', 'AMMO4': '0.144', 'weapon2': '0.174', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.412', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.500'} [2024-08-06 03:32:17,520][52650] Updated weights for policy 0, policy_version 46531 (0.0014) [2024-08-06 03:32:17,599][52658] DAMAGECOUNT value on done: 416407.0 [2024-08-06 03:32:17,599][52658] Sum rewards: 73.185, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.685', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.038', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.278', 'WEAPON3': '1.200', 'HITCOUNT': '3.400', 'weapon3': '3.446', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '59.000'} [2024-08-06 03:32:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 381181952. Throughput: 0: 4384.7. Samples: 95294980. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 03:32:17,794][52567] Avg episode reward: [(0, '70.269')] [2024-08-06 03:32:17,950][52794] DAMAGECOUNT value on done: 422288.0 [2024-08-06 03:32:17,951][52794] Sum rewards: 70.733, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.279', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.360', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '62.000'} [2024-08-06 03:32:17,986][52665] DAMAGECOUNT value on done: 417339.0 [2024-08-06 03:32:17,987][52665] Sum rewards: 72.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.410', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.104', 'AMMO4': '0.110', 'weapon5': '0.168', 'weapon2': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.700', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:18,367][52660] DAMAGECOUNT value on done: 429636.0 [2024-08-06 03:32:18,367][52660] Sum rewards: 76.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.355', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO4': '0.124', 'AMMO3': '0.206', 'weapon2': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.392', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '63.000'} [2024-08-06 03:32:19,251][52803] DAMAGECOUNT value on done: 392403.0 [2024-08-06 03:32:19,253][52803] Sum rewards: 75.394, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.406', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.000', 'HITCOUNT': '3.160', 'weapon3': '3.304', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:19,439][52649] DAMAGECOUNT value on done: 405422.0 [2024-08-06 03:32:19,440][52649] Sum rewards: 58.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.426', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.078', 'AMMO4': '0.164', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.438', 'weapon4': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.836', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.046', 'FRAGCOUNT': '48.000'} [2024-08-06 03:32:19,546][52662] DAMAGECOUNT value on done: 421215.0 [2024-08-06 03:32:19,548][52662] Sum rewards: 67.541, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'weapon4': '0.236', 'weapon2': '0.242', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.254', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:19,802][52671] DAMAGECOUNT value on done: 420963.0 [2024-08-06 03:32:19,804][52671] Sum rewards: 76.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon2': '0.202', 'AMMO3': '0.205', 'weapon4': '0.224', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:20,390][52811] DAMAGECOUNT value on done: 392097.0 [2024-08-06 03:32:20,393][52811] Sum rewards: 73.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.996', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.280', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 03:32:20,700][52658] DAMAGECOUNT value on done: 417534.0 [2024-08-06 03:32:20,701][52658] Sum rewards: 72.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.050', 'AMMO4': '0.169', 'weapon4': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.038', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '61.500'} [2024-08-06 03:32:20,742][52794] DAMAGECOUNT value on done: 426863.0 [2024-08-06 03:32:20,745][52794] Sum rewards: 73.695, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.210', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.136', 'AMMO3': '0.185', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '58.500'} [2024-08-06 03:32:21,001][52660] DAMAGECOUNT value on done: 434685.0 [2024-08-06 03:32:21,002][52660] Sum rewards: 84.074, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.247', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '70.000'} [2024-08-06 03:32:21,207][52665] DAMAGECOUNT value on done: 414206.0 [2024-08-06 03:32:21,207][52665] Sum rewards: 62.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.298', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '3.416', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '51.000'} [2024-08-06 03:32:22,160][52662] DAMAGECOUNT value on done: 417155.0 [2024-08-06 03:32:22,161][52662] Sum rewards: 68.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.614', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.082', 'weapon5': '0.170', 'AMMO4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:22,246][52649] DAMAGECOUNT value on done: 402612.0 [2024-08-06 03:32:22,246][52649] Sum rewards: 56.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.696', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'weapon5': '0.212', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.086', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '46.500'} [2024-08-06 03:32:22,360][52803] DAMAGECOUNT value on done: 392818.0 [2024-08-06 03:32:22,361][52803] Sum rewards: 73.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.106', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.114', 'weapon4': '0.120', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '59.500'} [2024-08-06 03:32:22,420][52650] Updated weights for policy 0, policy_version 46541 (0.0029) [2024-08-06 03:32:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 381272064. Throughput: 0: 4387.8. Samples: 95321290. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 03:32:22,802][52567] Avg episode reward: [(0, '70.629')] [2024-08-06 03:32:23,059][52671] DAMAGECOUNT value on done: 413885.0 [2024-08-06 03:32:23,059][52671] Sum rewards: 72.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.771', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'weapon4': '0.112', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.240', 'weapon3': '3.452', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '57.000'} [2024-08-06 03:32:23,534][52658] DAMAGECOUNT value on done: 414907.0 [2024-08-06 03:32:23,534][52658] Sum rewards: 86.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.748', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.142', 'AMMO4': '0.149', 'AMMO3': '0.244', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '73.000'} [2024-08-06 03:32:23,570][52665] DAMAGECOUNT value on done: 410745.0 [2024-08-06 03:32:23,570][52665] Sum rewards: 66.040, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.050', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.138', 'weapon5': '0.146', 'AMMO4': '0.234', 'AMMO3': '0.275', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:23,592][52811] DAMAGECOUNT value on done: 389359.0 [2024-08-06 03:32:23,592][52811] Sum rewards: 66.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.652', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon4': '0.190', 'AMMO3': '0.208', 'weapon5': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:23,655][52794] DAMAGECOUNT value on done: 423833.0 [2024-08-06 03:32:23,655][52794] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.392', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.186', 'weapon5': '0.188', 'weapon4': '0.198', 'AMMO4': '0.232', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:24,140][52660] DAMAGECOUNT value on done: 415573.0 [2024-08-06 03:32:24,141][52660] Sum rewards: 78.452, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.295', 'WEAPON3': '1.800', 'weapon3': '3.442', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '68.000'} [2024-08-06 03:32:25,134][52649] DAMAGECOUNT value on done: 412046.0 [2024-08-06 03:32:25,134][52649] Sum rewards: 87.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.271', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.199', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.520', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '72.000'} [2024-08-06 03:32:25,411][52662] DAMAGECOUNT value on done: 415627.0 [2024-08-06 03:32:25,412][52662] Sum rewards: 67.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.478', 'AMMO2': '0.012', 'AMMO5': '0.015', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '3.018', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:25,482][52803] DAMAGECOUNT value on done: 396735.0 [2024-08-06 03:32:25,482][52803] Sum rewards: 72.494, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.198', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.138', 'AMMO4': '0.172', 'weapon2': '0.196', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.290', 'weapon3': '3.306', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '62.000'} [2024-08-06 03:32:26,161][52658] DAMAGECOUNT value on done: 426845.0 [2024-08-06 03:32:26,162][52658] Sum rewards: 69.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.054', 'weapon4': '0.062', 'weapon5': '0.122', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'AMMO4': '0.268', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:26,163][52671] DAMAGECOUNT value on done: 428488.0 [2024-08-06 03:32:26,166][52671] Sum rewards: 63.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.128', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.088', 'AMMO4': '0.163', 'weapon4': '0.172', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:26,473][52794] DAMAGECOUNT value on done: 417879.0 [2024-08-06 03:32:26,473][52794] Sum rewards: 60.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.315', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.130', 'weapon5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.211', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.206', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '51.000'} [2024-08-06 03:32:26,678][52811] DAMAGECOUNT value on done: 395240.0 [2024-08-06 03:32:26,678][52811] Sum rewards: 79.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon2': '0.164', 'AMMO3': '0.230', 'WEAPON3': '1.500', 'weapon3': '3.624', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '67.000'} [2024-08-06 03:32:26,736][52665] DAMAGECOUNT value on done: 412015.0 [2024-08-06 03:32:26,737][52665] Sum rewards: 68.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.533', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon4': '0.128', 'AMMO3': '0.197', 'weapon5': '0.260', 'AMMO4': '0.282', 'weapon2': '0.332', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.040', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '57.000'} [2024-08-06 03:32:26,770][52650] Updated weights for policy 0, policy_version 46551 (0.0023) [2024-08-06 03:32:27,090][52660] DAMAGECOUNT value on done: 420193.0 [2024-08-06 03:32:27,090][52660] Sum rewards: 75.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.110', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.256', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '61.000'} [2024-08-06 03:32:27,298][52795] DAMAGECOUNT value on done: 391676.0 [2024-08-06 03:32:27,298][52795] Sum rewards: 73.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.274', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'HITCOUNT': '3.570', 'weapon3': '3.576', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 03:32:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 381362176. Throughput: 0: 4382.7. Samples: 95347500. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 03:32:27,794][52567] Avg episode reward: [(0, '70.535')] [2024-08-06 03:32:27,804][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046553_381362176.pth... [2024-08-06 03:32:27,938][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046039_377151488.pth [2024-08-06 03:32:28,129][52649] DAMAGECOUNT value on done: 408240.0 [2024-08-06 03:32:28,131][52649] Sum rewards: 77.228, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.341', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.020', 'AMMO4': '0.039', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.424', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '66.000'} [2024-08-06 03:32:28,537][52803] DAMAGECOUNT value on done: 390993.0 [2024-08-06 03:32:28,539][52803] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.655', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.162', 'AMMO3': '0.179', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.100', 'weapon3': '3.258', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '62.000'} [2024-08-06 03:32:28,855][52658] DAMAGECOUNT value on done: 418861.0 [2024-08-06 03:32:28,856][52658] Sum rewards: 67.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.172', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:29,160][52671] DAMAGECOUNT value on done: 427519.0 [2024-08-06 03:32:29,160][52671] Sum rewards: 67.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.855', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.068', 'weapon5': '0.092', 'AMMO4': '0.218', 'AMMO3': '0.240', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.328', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '57.000'} [2024-08-06 03:32:29,292][52794] DAMAGECOUNT value on done: 417238.0 [2024-08-06 03:32:29,294][52794] Sum rewards: 75.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.128', 'weapon4': '0.140', 'AMMO4': '0.172', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '61.000'} [2024-08-06 03:32:29,780][52811] DAMAGECOUNT value on done: 389256.0 [2024-08-06 03:32:29,780][52811] Sum rewards: 72.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.174', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.072', 'weapon5': '0.184', 'weapon2': '0.204', 'AMMO3': '0.206', 'AMMO4': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:29,785][52665] DAMAGECOUNT value on done: 413334.0 [2024-08-06 03:32:29,785][52665] Sum rewards: 70.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.948', 'AMMO5': '0.021', 'AMMO2': '0.045', 'AMMO3': '0.169', 'weapon4': '0.174', 'weapon5': '0.174', 'AMMO4': '0.223', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.080', 'weapon3': '3.082', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '57.500'} [2024-08-06 03:32:30,191][52660] DAMAGECOUNT value on done: 415928.0 [2024-08-06 03:32:30,192][52660] Sum rewards: 67.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.116', 'weapon5': '0.130', 'weapon2': '0.184', 'AMMO4': '0.207', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.318', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:30,497][52795] DAMAGECOUNT value on done: 381347.0 [2024-08-06 03:32:30,497][52795] Sum rewards: 65.691, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 03:32:31,342][52649] DAMAGECOUNT value on done: 398291.0 [2024-08-06 03:32:31,343][52649] Sum rewards: 58.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.176', 'AMMO3': '0.221', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.068', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '50.000'} [2024-08-06 03:32:31,560][52803] DAMAGECOUNT value on done: 390413.0 [2024-08-06 03:32:31,560][52803] Sum rewards: 79.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.128', 'AMMO4': '0.189', 'AMMO3': '0.204', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '63.000'} [2024-08-06 03:32:31,565][52658] DAMAGECOUNT value on done: 422302.0 [2024-08-06 03:32:31,566][52658] Sum rewards: 72.168, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.156', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '57.000'} [2024-08-06 03:32:31,728][52794] DAMAGECOUNT value on done: 423356.0 [2024-08-06 03:32:31,731][52794] Sum rewards: 71.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.436', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO4': '0.185', 'AMMO3': '0.212', 'weapon4': '0.244', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '58.500'} [2024-08-06 03:32:31,935][52650] Updated weights for policy 0, policy_version 46561 (0.0012) [2024-08-06 03:32:32,039][52671] DAMAGECOUNT value on done: 429397.0 [2024-08-06 03:32:32,040][52671] Sum rewards: 76.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.014', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.070', 'weapon5': '0.152', 'AMMO3': '0.175', 'AMMO4': '0.215', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '62.000'} [2024-08-06 03:32:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 381444096. Throughput: 0: 4371.6. Samples: 95360270. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 03:32:32,794][52567] Avg episode reward: [(0, '70.865')] [2024-08-06 03:32:32,817][52665] DAMAGECOUNT value on done: 416983.0 [2024-08-06 03:32:32,818][52665] Sum rewards: 82.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.390', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.114', 'AMMO4': '0.173', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.000', 'weapon3': '3.372', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '67.000'} [2024-08-06 03:32:32,976][52811] DAMAGECOUNT value on done: 392212.0 [2024-08-06 03:32:32,977][52811] Sum rewards: 65.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.548', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.230', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:33,280][52660] DAMAGECOUNT value on done: 419861.0 [2024-08-06 03:32:33,296][52660] Sum rewards: 66.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.462', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.136', 'weapon4': '0.156', 'AMMO3': '0.197', 'AMMO4': '0.205', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:33,590][52795] DAMAGECOUNT value on done: 382829.0 [2024-08-06 03:32:33,591][52795] Sum rewards: 81.492, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.722', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.094', 'WEAPON5': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.174', 'weapon2': '0.230', 'WEAPON3': '1.200', 'weapon3': '3.372', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '65.500'} [2024-08-06 03:32:34,352][52794] DAMAGECOUNT value on done: 427125.0 [2024-08-06 03:32:34,354][52794] Sum rewards: 72.938, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.225', 'AMMO5': '0.025', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.078', 'AMMO4': '0.193', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:34,424][52649] DAMAGECOUNT value on done: 410530.0 [2024-08-06 03:32:34,425][52649] Sum rewards: 67.361, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.130', 'AMMO3': '0.161', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:34,549][52803] DAMAGECOUNT value on done: 398346.0 [2024-08-06 03:32:34,549][52803] Sum rewards: 69.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.023', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.193', 'weapon4': '0.224', 'weapon5': '0.230', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:34,756][52671] DAMAGECOUNT value on done: 423063.0 [2024-08-06 03:32:34,756][52671] Sum rewards: 68.303, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO4': '0.113', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.288', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '57.000'} [2024-08-06 03:32:34,781][52658] DAMAGECOUNT value on done: 425158.0 [2024-08-06 03:32:34,783][52658] Sum rewards: 72.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.197', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.239', 'weapon4': '0.310', 'weapon5': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.516', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '61.000'} [2024-08-06 03:32:36,030][52660] DAMAGECOUNT value on done: 416838.0 [2024-08-06 03:32:36,031][52660] Sum rewards: 80.860, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.108', 'AMMO4': '0.166', 'AMMO3': '0.205', 'weapon4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '67.500'} [2024-08-06 03:32:36,099][52811] DAMAGECOUNT value on done: 392831.0 [2024-08-06 03:32:36,099][52811] Sum rewards: 63.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon2': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '3.014', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:36,213][52650] Updated weights for policy 0, policy_version 46571 (0.0012) [2024-08-06 03:32:36,696][52795] DAMAGECOUNT value on done: 388220.0 [2024-08-06 03:32:36,699][52795] Sum rewards: 67.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.372', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.304', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '57.000'} [2024-08-06 03:32:37,069][52794] DAMAGECOUNT value on done: 417281.0 [2024-08-06 03:32:37,071][52794] Sum rewards: 65.194, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.794', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.126', 'weapon4': '0.154', 'AMMO4': '0.216', 'AMMO3': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.650', 'weapon3': '2.806', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:37,519][52803] DAMAGECOUNT value on done: 394194.0 [2024-08-06 03:32:37,519][52803] Sum rewards: 62.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.311', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.118', 'AMMO3': '0.190', 'AMMO4': '0.284', 'weapon5': '0.320', 'weapon2': '0.424', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:37,548][52649] DAMAGECOUNT value on done: 406432.0 [2024-08-06 03:32:37,550][52649] Sum rewards: 76.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.134', 'AMMO4': '0.174', 'AMMO3': '0.247', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '63.000'} [2024-08-06 03:32:37,700][52671] DAMAGECOUNT value on done: 422602.0 [2024-08-06 03:32:37,700][52671] Sum rewards: 77.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.072', 'weapon5': '0.094', 'AMMO4': '0.097', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 381526016. Throughput: 0: 4374.2. Samples: 95386580. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 03:32:37,794][52567] Avg episode reward: [(0, '71.097')] [2024-08-06 03:32:38,987][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:32:39,212][52811] DAMAGECOUNT value on done: 393191.0 [2024-08-06 03:32:39,213][52811] Sum rewards: 78.701, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon4': '0.110', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.279', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '68.000'} [2024-08-06 03:32:39,576][52794] DAMAGECOUNT value on done: 425669.0 [2024-08-06 03:32:39,576][52794] Sum rewards: 68.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.686', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.104', 'AMMO4': '0.152', 'weapon5': '0.152', 'AMMO3': '0.214', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '58.500'} [2024-08-06 03:32:39,780][52795] DAMAGECOUNT value on done: 383766.0 [2024-08-06 03:32:39,781][52795] Sum rewards: 68.512, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.092', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.410', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:39,899][52669] Large shaping reward -2.537 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28800000000000003, -96.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:32:40,515][52803] DAMAGECOUNT value on done: 394485.0 [2024-08-06 03:32:40,517][52803] Sum rewards: 68.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.394', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:40,660][52649] DAMAGECOUNT value on done: 413290.0 [2024-08-06 03:32:40,662][52649] Sum rewards: 58.652, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.372', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon5': '0.232', 'AMMO4': '0.261', 'weapon4': '0.280', 'AMMO3': '0.286', 'weapon2': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.828', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.000'} [2024-08-06 03:32:41,284][52650] Updated weights for policy 0, policy_version 46581 (0.0029) [2024-08-06 03:32:42,230][52811] DAMAGECOUNT value on done: 392696.0 [2024-08-06 03:32:42,231][52811] Sum rewards: 75.242, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.364', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.172', 'weapon5': '0.174', 'AMMO4': '0.194', 'weapon2': '0.194', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:42,558][52794] DAMAGECOUNT value on done: 421971.0 [2024-08-06 03:32:42,560][52794] Sum rewards: 65.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.358', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.215', 'AMMO4': '0.221', 'weapon5': '0.226', 'weapon2': '0.294', 'weapon4': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 381624320. Throughput: 0: 4376.2. Samples: 95412910. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:32:42,794][52567] Avg episode reward: [(0, '71.281')] [2024-08-06 03:32:42,829][52795] DAMAGECOUNT value on done: 392185.0 [2024-08-06 03:32:42,830][52795] Sum rewards: 79.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.155', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.488', 'WEAPON3': '1.650', 'weapon3': '3.202', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '66.000'} [2024-08-06 03:32:43,579][52803] DAMAGECOUNT value on done: 390720.0 [2024-08-06 03:32:43,582][52803] Sum rewards: 70.864, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.464', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.174', 'weapon5': '0.180', 'weapon2': '0.316', 'WEAPON3': '1.000', 'weapon3': '3.146', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:43,676][52649] DAMAGECOUNT value on done: 412953.0 [2024-08-06 03:32:43,679][52649] Sum rewards: 71.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.199', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.186', 'AMMO3': '0.222', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '59.000'} [2024-08-06 03:32:45,265][52659] DAMAGECOUNT value on done: 421691.0 [2024-08-06 03:32:45,265][52659] Sum rewards: 67.490, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.720', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.179', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:45,433][52650] Updated weights for policy 0, policy_version 46591 (0.0018) [2024-08-06 03:32:45,830][52794] DAMAGECOUNT value on done: 417573.0 [2024-08-06 03:32:45,832][52794] Sum rewards: 66.698, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.136', 'weapon4': '0.154', 'AMMO4': '0.167', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '2.964', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:45,933][52795] DAMAGECOUNT value on done: 396333.0 [2024-08-06 03:32:45,933][52795] Sum rewards: 65.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.216', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.078', 'weapon4': '0.156', 'AMMO4': '0.174', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.388', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:46,461][52649] DAMAGECOUNT value on done: 407018.0 [2024-08-06 03:32:46,461][52649] Sum rewards: 72.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.233', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.092', 'AMMO4': '0.162', 'AMMO3': '0.201', 'weapon5': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.802', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 381714432. Throughput: 0: 4384.2. Samples: 95426190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:32:47,794][52567] Avg episode reward: [(0, '71.240')] [2024-08-06 03:32:48,720][52649] DAMAGECOUNT value on done: 413198.0 [2024-08-06 03:32:48,721][52649] Sum rewards: 62.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.580', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.148', 'AMMO3': '0.149', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.988', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '49.000'} [2024-08-06 03:32:48,752][52659] DAMAGECOUNT value on done: 421629.0 [2024-08-06 03:32:48,752][52659] Sum rewards: 66.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.048', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.189', 'weapon5': '0.202', 'weapon4': '0.226', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '55.000'} [2024-08-06 03:32:48,807][52666] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:32:48,908][52794] DAMAGECOUNT value on done: 424715.0 [2024-08-06 03:32:48,908][52794] Sum rewards: 63.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.404', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.152', 'AMMO3': '0.177', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '3.036', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '52.000'} [2024-08-06 03:32:49,097][52795] DAMAGECOUNT value on done: 392634.0 [2024-08-06 03:32:49,098][52795] Sum rewards: 76.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.962', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon4': '0.114', 'weapon2': '0.190', 'AMMO3': '0.245', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:50,291][52650] Updated weights for policy 0, policy_version 46601 (0.0020) [2024-08-06 03:32:51,263][52659] DAMAGECOUNT value on done: 424834.0 [2024-08-06 03:32:51,265][52659] Sum rewards: 71.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.610', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.188', 'weapon2': '0.254', 'AMMO3': '0.265', 'weapon5': '0.304', 'AMMO4': '0.314', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '58.500'} [2024-08-06 03:32:51,620][52794] DAMAGECOUNT value on done: 413766.0 [2024-08-06 03:32:51,621][52794] Sum rewards: 66.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.204', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2024-08-06 03:32:51,796][52649] DAMAGECOUNT value on done: 415233.0 [2024-08-06 03:32:51,799][52649] Sum rewards: 62.986, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.868', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.078', 'AMMO4': '0.182', 'weapon5': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '55.000'} [2024-08-06 03:32:52,224][52795] DAMAGECOUNT value on done: 380713.0 [2024-08-06 03:32:52,225][52795] Sum rewards: 65.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.125', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.108', 'AMMO3': '0.222', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '56.000'} [2024-08-06 03:32:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 381788160. Throughput: 0: 4384.4. Samples: 95452810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:32:52,794][52567] Avg episode reward: [(0, '70.708')] [2024-08-06 03:32:53,990][52659] DAMAGECOUNT value on done: 420580.0 [2024-08-06 03:32:53,992][52659] Sum rewards: 76.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.545', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.269', 'weapon2': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.442', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '66.000'} [2024-08-06 03:32:54,401][52794] DAMAGECOUNT value on done: 432618.0 [2024-08-06 03:32:54,402][52794] Sum rewards: 80.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.393', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.068', 'AMMO4': '0.073', 'weapon5': '0.102', 'WEAPON4': '0.150', 'weapon2': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON3': '1.300', 'weapon3': '3.468', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '65.500'} [2024-08-06 03:32:54,670][52649] DAMAGECOUNT value on done: 415363.0 [2024-08-06 03:32:54,671][52649] Sum rewards: 72.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.638', 'ARMOR': '0.008', 'AMMO2': '0.011', 'AMMO5': '0.011', 'weapon4': '0.032', 'weapon5': '0.042', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.310', 'weapon3': '3.328', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '60.000'} [2024-08-06 03:32:55,124][52650] Updated weights for policy 0, policy_version 46611 (0.0013) [2024-08-06 03:32:55,354][52795] DAMAGECOUNT value on done: 395502.0 [2024-08-06 03:32:55,356][52795] Sum rewards: 78.921, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.154', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.236', 'AMMO3': '0.276', 'weapon4': '0.286', 'weapon2': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.784', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '69.000'} [2024-08-06 03:32:56,893][52659] DAMAGECOUNT value on done: 420760.0 [2024-08-06 03:32:56,893][52659] Sum rewards: 81.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.377', 'AMMO2': '0.017', 'AMMO5': '0.019', 'AMMO4': '0.086', 'weapon5': '0.110', 'weapon4': '0.124', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '68.000'} [2024-08-06 03:32:57,642][52794] DAMAGECOUNT value on done: 415057.0 [2024-08-06 03:32:57,643][52794] Sum rewards: 76.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.288', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.126', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.268', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '64.000'} [2024-08-06 03:32:57,787][52649] DAMAGECOUNT value on done: 416356.0 [2024-08-06 03:32:57,788][52649] Sum rewards: 67.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.088', 'AMMO4': '0.195', 'weapon2': '0.212', 'weapon5': '0.218', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.218', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 381878272. Throughput: 0: 4376.4. Samples: 95478840. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:32:57,794][52567] Avg episode reward: [(0, '71.348')] [2024-08-06 03:32:58,582][52795] DAMAGECOUNT value on done: 386751.0 [2024-08-06 03:32:58,583][52795] Sum rewards: 71.595, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.145', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.147', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.540', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '58.000'} [2024-08-06 03:32:59,185][52665] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:32:59,387][52650] Updated weights for policy 0, policy_version 46621 (0.0013) [2024-08-06 03:32:59,551][52659] DAMAGECOUNT value on done: 422638.0 [2024-08-06 03:32:59,551][52659] Sum rewards: 78.116, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.030', 'AMMO5': '0.023', 'AMMO2': '0.054', 'weapon4': '0.166', 'weapon5': '0.188', 'AMMO3': '0.242', 'weapon2': '0.266', 'AMMO4': '0.270', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '66.000'} [2024-08-06 03:32:59,842][52667] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 03:33:00,678][52649] DAMAGECOUNT value on done: 406465.0 [2024-08-06 03:33:00,678][52649] Sum rewards: 62.872, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.356', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.212', 'weapon4': '0.226', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '54.000'} [2024-08-06 03:33:00,828][52794] DAMAGECOUNT value on done: 431907.0 [2024-08-06 03:33:00,828][52794] Sum rewards: 73.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.206', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.150', 'weapon4': '0.154', 'AMMO4': '0.202', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '63.500'} [2024-08-06 03:33:01,722][52795] DAMAGECOUNT value on done: 388481.0 [2024-08-06 03:33:01,725][52795] Sum rewards: 66.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.424', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.152', 'weapon5': '0.174', 'AMMO3': '0.215', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.312', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.000'} [2024-08-06 03:33:02,024][52659] DAMAGECOUNT value on done: 423210.0 [2024-08-06 03:33:02,036][52659] Sum rewards: 68.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.900', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.108', 'AMMO4': '0.154', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 381976576. Throughput: 0: 4382.4. Samples: 95492190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:33:02,794][52567] Avg episode reward: [(0, '71.081')] [2024-08-06 03:33:03,883][52794] DAMAGECOUNT value on done: 422591.0 [2024-08-06 03:33:03,886][52794] Sum rewards: 74.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.460', 'AMMO5': '0.020', 'AMMO2': '0.066', 'AMMO3': '0.239', 'weapon5': '0.272', 'AMMO4': '0.328', 'weapon4': '0.366', 'weapon2': '0.476', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.568', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '62.000'} [2024-08-06 03:33:03,931][52649] DAMAGECOUNT value on done: 414208.0 [2024-08-06 03:33:03,933][52649] Sum rewards: 69.756, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.520', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon5': '0.138', 'AMMO3': '0.244', 'AMMO4': '0.263', 'weapon4': '0.316', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '60.500'} [2024-08-06 03:33:04,455][52650] Updated weights for policy 0, policy_version 46631 (0.0018) [2024-08-06 03:33:05,004][52659] DAMAGECOUNT value on done: 419818.0 [2024-08-06 03:33:05,004][52659] Sum rewards: 60.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.956', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.144', 'weapon2': '0.190', 'AMMO4': '0.216', 'AMMO3': '0.244', 'weapon5': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.192', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '50.500'} [2024-08-06 03:33:05,014][52795] DAMAGECOUNT value on done: 383580.0 [2024-08-06 03:33:05,014][52795] Sum rewards: 67.444, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.668', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.096', 'weapon5': '0.114', 'AMMO4': '0.122', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:06,585][52794] DAMAGECOUNT value on done: 424735.0 [2024-08-06 03:33:06,586][52794] Sum rewards: 73.728, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.384', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.189', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.450', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '60.000'} [2024-08-06 03:33:06,936][52649] DAMAGECOUNT value on done: 408449.0 [2024-08-06 03:33:06,936][52649] Sum rewards: 60.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.985', 'AMMO5': '0.024', 'AMMO2': '0.076', 'weapon4': '0.184', 'AMMO3': '0.233', 'weapon5': '0.266', 'AMMO4': '0.381', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '51.000'} [2024-08-06 03:33:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 382058496. Throughput: 0: 4380.4. Samples: 95518410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:33:07,794][52567] Avg episode reward: [(0, '70.888')] [2024-08-06 03:33:07,938][52659] DAMAGECOUNT value on done: 430484.0 [2024-08-06 03:33:07,941][52659] Sum rewards: 66.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.743', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.208', 'weapon2': '0.262', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '54.000'} [2024-08-06 03:33:08,194][52795] DAMAGECOUNT value on done: 392246.0 [2024-08-06 03:33:08,195][52795] Sum rewards: 61.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO3': '0.168', 'AMMO4': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.250', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '51.000'} [2024-08-06 03:33:09,029][52650] Updated weights for policy 0, policy_version 46641 (0.0013) [2024-08-06 03:33:09,321][52794] DAMAGECOUNT value on done: 429703.0 [2024-08-06 03:33:09,325][52794] Sum rewards: 56.197, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.920', 'AMMO5': '0.019', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.098', 'weapon5': '0.146', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.050', 'HITCOUNT': '2.490', 'weapon3': '3.250', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '46.000'} [2024-08-06 03:33:09,527][52649] DAMAGECOUNT value on done: 417030.0 [2024-08-06 03:33:09,527][52649] Sum rewards: 74.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.291', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon5': '0.160', 'AMMO3': '0.202', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '62.000'} [2024-08-06 03:33:10,652][52659] DAMAGECOUNT value on done: 431273.0 [2024-08-06 03:33:10,653][52659] Sum rewards: 78.050, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.005', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '64.000'} [2024-08-06 03:33:11,332][52795] DAMAGECOUNT value on done: 382559.0 [2024-08-06 03:33:11,332][52795] Sum rewards: 81.395, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.701', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.128', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon2': '0.382', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '69.000'} [2024-08-06 03:33:12,172][52649] DAMAGECOUNT value on done: 418792.0 [2024-08-06 03:33:12,173][52649] Sum rewards: 78.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.034', 'weapon5': '0.078', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.444', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '65.500'} [2024-08-06 03:33:12,520][52794] DAMAGECOUNT value on done: 421881.0 [2024-08-06 03:33:12,520][52794] Sum rewards: 68.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.213', 'weapon5': '0.222', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.596', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '55.000'} [2024-08-06 03:33:12,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 382140416. Throughput: 0: 4382.4. Samples: 95544710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:33:12,795][52567] Avg episode reward: [(0, '70.789')] [2024-08-06 03:33:13,078][52659] DAMAGECOUNT value on done: 421951.0 [2024-08-06 03:33:13,079][52659] Sum rewards: 56.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.553', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon2': '0.160', 'AMMO4': '0.173', 'weapon5': '0.174', 'AMMO3': '0.197', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.008', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '47.000'} [2024-08-06 03:33:13,711][52650] Updated weights for policy 0, policy_version 46651 (0.0021) [2024-08-06 03:33:14,071][52820] DAMAGECOUNT value on done: 386316.0 [2024-08-06 03:33:14,072][52820] Sum rewards: 70.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.096', 'AMMO3': '0.214', 'weapon5': '0.238', 'AMMO4': '0.242', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '57.000'} [2024-08-06 03:33:14,497][52795] DAMAGECOUNT value on done: 399790.0 [2024-08-06 03:33:14,498][52795] Sum rewards: 66.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.130', 'AMMO4': '0.229', 'AMMO3': '0.241', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '57.000'} [2024-08-06 03:33:15,084][52649] DAMAGECOUNT value on done: 411740.0 [2024-08-06 03:33:15,085][52649] Sum rewards: 75.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.689', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.072', 'AMMO4': '0.108', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '62.000'} [2024-08-06 03:33:15,881][52659] DAMAGECOUNT value on done: 425526.0 [2024-08-06 03:33:15,883][52659] Sum rewards: 68.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.174', 'AMMO3': '0.233', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '57.000'} [2024-08-06 03:33:16,697][52666] DAMAGECOUNT value on done: 419647.0 [2024-08-06 03:33:16,698][52666] Sum rewards: 59.931, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.905', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.072', 'weapon2': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.237', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.436', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '52.500'} [2024-08-06 03:33:17,098][52820] DAMAGECOUNT value on done: 390835.0 [2024-08-06 03:33:17,101][52820] Sum rewards: 69.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.178', 'weapon2': '0.220', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.390', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '59.000'} [2024-08-06 03:33:17,710][52795] DAMAGECOUNT value on done: 392413.0 [2024-08-06 03:33:17,712][52795] Sum rewards: 70.295, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.108', 'weapon5': '0.148', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '57.000'} [2024-08-06 03:33:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 382238720. Throughput: 0: 4391.6. Samples: 95557890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:33:17,794][52567] Avg episode reward: [(0, '70.471')] [2024-08-06 03:33:18,238][52650] Updated weights for policy 0, policy_version 46661 (0.0021) [2024-08-06 03:33:18,517][52659] DAMAGECOUNT value on done: 413626.0 [2024-08-06 03:33:18,518][52659] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '59.000'} [2024-08-06 03:33:19,842][52666] DAMAGECOUNT value on done: 427537.0 [2024-08-06 03:33:19,844][52666] Sum rewards: 76.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.072', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.404', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '64.000'} [2024-08-06 03:33:20,306][52670] DAMAGECOUNT value on done: 414152.0 [2024-08-06 03:33:20,307][52670] Sum rewards: 60.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.058', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.486', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.188', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '52.000'} [2024-08-06 03:33:20,319][52820] DAMAGECOUNT value on done: 391696.0 [2024-08-06 03:33:20,320][52820] Sum rewards: 76.286, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.950', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon5': '0.154', 'AMMO3': '0.200', 'weapon4': '0.226', 'weapon2': '0.312', 'AMMO4': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '65.000'} [2024-08-06 03:33:20,914][52795] DAMAGECOUNT value on done: 383964.0 [2024-08-06 03:33:20,915][52795] Sum rewards: 89.134, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'weapon2': '0.154', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON3': '1.000', 'weapon3': '3.264', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '71.000'} [2024-08-06 03:33:21,531][52659] DAMAGECOUNT value on done: 422541.0 [2024-08-06 03:33:21,533][52659] Sum rewards: 63.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.974', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.052', 'AMMO4': '0.200', 'weapon5': '0.204', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '52.000'} [2024-08-06 03:33:22,460][52666] DAMAGECOUNT value on done: 424815.0 [2024-08-06 03:33:22,461][52666] Sum rewards: 75.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.743', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO4': '0.205', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '62.000'} [2024-08-06 03:33:22,628][52663] DAMAGECOUNT value on done: 426515.0 [2024-08-06 03:33:22,628][52663] Sum rewards: 64.576, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.344', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO4': '0.202', 'weapon5': '0.208', 'AMMO3': '0.239', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.164', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '54.500'} [2024-08-06 03:33:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 382312448. Throughput: 0: 4388.0. Samples: 95584040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:33:22,795][52567] Avg episode reward: [(0, '70.475')] [2024-08-06 03:33:22,862][52670] DAMAGECOUNT value on done: 423817.0 [2024-08-06 03:33:22,863][52670] Sum rewards: 70.948, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.360', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.080', 'AMMO4': '0.144', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'AMMO3': '0.315', 'WEAPON3': '2.000', 'weapon3': '3.150', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '62.500'} [2024-08-06 03:33:23,103][52650] Updated weights for policy 0, policy_version 46671 (0.0016) [2024-08-06 03:33:23,449][52820] DAMAGECOUNT value on done: 386165.0 [2024-08-06 03:33:23,451][52820] Sum rewards: 76.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.237', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '64.000'} [2024-08-06 03:33:23,903][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 03:33:24,002][52795] DAMAGECOUNT value on done: 389591.0 [2024-08-06 03:33:24,003][52795] Sum rewards: 68.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.992', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.146', 'AMMO3': '0.157', 'AMMO4': '0.163', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.000', 'HITCOUNT': '2.810', 'weapon3': '2.988', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '55.000'} [2024-08-06 03:33:24,756][52659] DAMAGECOUNT value on done: 431979.0 [2024-08-06 03:33:24,758][52659] Sum rewards: 70.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.335', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.154', 'AMMO3': '0.187', 'weapon4': '0.240', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:25,123][52666] DAMAGECOUNT value on done: 422341.0 [2024-08-06 03:33:25,124][52666] Sum rewards: 65.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.262', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.098', 'AMMO3': '0.173', 'AMMO4': '0.182', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '3.028', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '53.000'} [2024-08-06 03:33:25,687][52670] DAMAGECOUNT value on done: 415153.0 [2024-08-06 03:33:25,689][52670] Sum rewards: 69.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.084', 'AMMO4': '0.102', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '55.000'} [2024-08-06 03:33:25,767][52663] DAMAGECOUNT value on done: 422065.0 [2024-08-06 03:33:25,768][52663] Sum rewards: 65.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.123', 'weapon5': '0.190', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.816', 'WEAPON3': '1.300', 'weapon3': '2.722', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '55.000'} [2024-08-06 03:33:26,390][52820] DAMAGECOUNT value on done: 393715.0 [2024-08-06 03:33:26,390][52820] Sum rewards: 65.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.877', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.068', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.310', 'WEAPON4': '0.350', 'weapon4': '0.394', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '56.500'} [2024-08-06 03:33:27,308][52795] DAMAGECOUNT value on done: 397331.0 [2024-08-06 03:33:27,309][52795] Sum rewards: 69.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.399', 'AMMO2': '0.010', 'AMMO5': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.052', 'weapon5': '0.104', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '57.000'} [2024-08-06 03:33:27,554][52650] Updated weights for policy 0, policy_version 46681 (0.0031) [2024-08-06 03:33:27,628][52659] DAMAGECOUNT value on done: 427867.0 [2024-08-06 03:33:27,632][52659] Sum rewards: 74.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.265', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.248', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '64.000'} [2024-08-06 03:33:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 382410752. Throughput: 0: 4385.6. Samples: 95610260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:33:27,794][52567] Avg episode reward: [(0, '70.250')] [2024-08-06 03:33:27,817][52666] DAMAGECOUNT value on done: 423900.0 [2024-08-06 03:33:27,819][52666] Sum rewards: 71.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.987', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.104', 'weapon5': '0.224', 'AMMO3': '0.227', 'AMMO4': '0.296', 'weapon2': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:28,293][52670] DAMAGECOUNT value on done: 413671.0 [2024-08-06 03:33:28,293][52670] Sum rewards: 71.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.082', 'weapon5': '0.084', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.308', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.316', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '59.000'} [2024-08-06 03:33:28,582][52663] DAMAGECOUNT value on done: 416093.0 [2024-08-06 03:33:28,583][52663] Sum rewards: 74.081, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.166', 'AMMO4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.264', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '62.000'} [2024-08-06 03:33:29,576][52820] DAMAGECOUNT value on done: 384683.0 [2024-08-06 03:33:29,576][52820] Sum rewards: 83.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.054', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '70.000'} [2024-08-06 03:33:30,638][52659] DAMAGECOUNT value on done: 429125.0 [2024-08-06 03:33:30,639][52659] Sum rewards: 68.942, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.310', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon2': '0.230', 'AMMO4': '0.237', 'AMMO3': '0.263', 'weapon5': '0.268', 'WEAPON5': '0.400', 'weapon4': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.674', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '59.000'} [2024-08-06 03:33:30,701][52666] DAMAGECOUNT value on done: 414571.0 [2024-08-06 03:33:30,701][52666] Sum rewards: 59.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.860', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.170', 'weapon5': '0.242', 'AMMO4': '0.279', 'weapon4': '0.316', 'weapon2': '0.344', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '48.000'} [2024-08-06 03:33:31,072][52670] DAMAGECOUNT value on done: 424964.0 [2024-08-06 03:33:31,073][52670] Sum rewards: 92.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.066', 'weapon4': '0.148', 'AMMO4': '0.163', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '22.218', 'FRAGCOUNT': '74.000'} [2024-08-06 03:33:31,822][52663] DAMAGECOUNT value on done: 422717.0 [2024-08-06 03:33:31,823][52663] Sum rewards: 66.711, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.688', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.272', 'weapon2': '0.520', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:32,249][52662] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:33:32,486][52650] Updated weights for policy 0, policy_version 46691 (0.0013) [2024-08-06 03:33:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 382492672. Throughput: 0: 4383.8. Samples: 95623460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:33:32,802][52567] Avg episode reward: [(0, '70.546')] [2024-08-06 03:33:32,825][52820] DAMAGECOUNT value on done: 388082.0 [2024-08-06 03:33:32,825][52820] Sum rewards: 65.389, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.270', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.134', 'weapon5': '0.182', 'AMMO4': '0.248', 'AMMO3': '0.289', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.750', 'weapon3': '2.948', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:33,599][52666] DAMAGECOUNT value on done: 422846.0 [2024-08-06 03:33:33,601][52666] Sum rewards: 72.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.162', 'AMMO4': '0.180', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 03:33:33,773][52659] DAMAGECOUNT value on done: 419749.0 [2024-08-06 03:33:33,773][52659] Sum rewards: 67.425, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.115', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.018', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'weapon4': '0.330', 'weapon2': '0.606', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '53.500'} [2024-08-06 03:33:34,168][52670] DAMAGECOUNT value on done: 418048.0 [2024-08-06 03:33:34,170][52670] Sum rewards: 79.233, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.237', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.163', 'AMMO4': '0.252', 'weapon5': '0.256', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '61.000'} [2024-08-06 03:33:34,446][52663] DAMAGECOUNT value on done: 419156.0 [2024-08-06 03:33:34,448][52663] Sum rewards: 73.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.162', 'AMMO3': '0.209', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '58.500'} [2024-08-06 03:33:35,883][52820] DAMAGECOUNT value on done: 393501.0 [2024-08-06 03:33:35,885][52820] Sum rewards: 72.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon2': '0.150', 'AMMO3': '0.242', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.680', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '63.000'} [2024-08-06 03:33:36,554][52666] DAMAGECOUNT value on done: 420851.0 [2024-08-06 03:33:36,556][52666] Sum rewards: 61.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.324', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.098', 'weapon5': '0.152', 'AMMO4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.178', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '53.000'} [2024-08-06 03:33:36,607][52659] DAMAGECOUNT value on done: 426387.0 [2024-08-06 03:33:36,609][52659] Sum rewards: 52.980, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.025', 'AMMO2': '0.078', 'AMMO3': '0.261', 'weapon2': '0.270', 'weapon4': '0.318', 'weapon5': '0.362', 'AMMO4': '0.390', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.642', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '45.000'} [2024-08-06 03:33:36,955][52670] DAMAGECOUNT value on done: 412013.0 [2024-08-06 03:33:36,956][52670] Sum rewards: 60.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.152', 'weapon4': '0.184', 'AMMO4': '0.190', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '53.500'} [2024-08-06 03:33:37,104][52663] DAMAGECOUNT value on done: 424619.0 [2024-08-06 03:33:37,105][52663] Sum rewards: 71.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.008', 'AMMO2': '0.056', 'weapon5': '0.076', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO4': '0.280', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '59.000'} [2024-08-06 03:33:37,284][52650] Updated weights for policy 0, policy_version 46701 (0.0019) [2024-08-06 03:33:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 382582784. Throughput: 0: 4374.0. Samples: 95649640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:33:37,795][52567] Avg episode reward: [(0, '70.071')] [2024-08-06 03:33:38,985][52820] DAMAGECOUNT value on done: 388580.0 [2024-08-06 03:33:38,985][52820] Sum rewards: 62.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.192', 'weapon2': '0.258', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '52.000'} [2024-08-06 03:33:39,336][52666] DAMAGECOUNT value on done: 417088.0 [2024-08-06 03:33:39,336][52666] Sum rewards: 71.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.665', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.068', 'weapon4': '0.120', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '60.000'} [2024-08-06 03:33:39,875][52659] DAMAGECOUNT value on done: 425671.0 [2024-08-06 03:33:39,876][52659] Sum rewards: 68.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.008', 'AMMO2': '0.055', 'weapon5': '0.142', 'AMMO3': '0.190', 'AMMO4': '0.276', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '57.000'} [2024-08-06 03:33:40,023][52670] DAMAGECOUNT value on done: 415764.0 [2024-08-06 03:33:40,027][52670] Sum rewards: 63.486, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.128', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.104', 'AMMO4': '0.201', 'AMMO3': '0.244', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.218', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '57.000'} [2024-08-06 03:33:40,208][52663] DAMAGECOUNT value on done: 423395.0 [2024-08-06 03:33:40,210][52663] Sum rewards: 58.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.050', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.179', 'weapon4': '0.184', 'AMMO4': '0.210', 'weapon5': '0.216', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '48.000'} [2024-08-06 03:33:41,615][52650] Updated weights for policy 0, policy_version 46711 (0.0012) [2024-08-06 03:33:42,044][52820] DAMAGECOUNT value on done: 396417.0 [2024-08-06 03:33:42,045][52820] Sum rewards: 84.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon2': '0.204', 'AMMO3': '0.229', 'WEAPON3': '1.450', 'weapon3': '3.638', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '69.000'} [2024-08-06 03:33:42,055][52666] DAMAGECOUNT value on done: 413455.0 [2024-08-06 03:33:42,055][52666] Sum rewards: 73.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.224', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '59.000'} [2024-08-06 03:33:42,709][52670] DAMAGECOUNT value on done: 417266.0 [2024-08-06 03:33:42,713][52670] Sum rewards: 77.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.618', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.090', 'AMMO4': '0.123', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.072', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '65.000'} [2024-08-06 03:33:42,783][52663] DAMAGECOUNT value on done: 417499.0 [2024-08-06 03:33:42,783][52663] Sum rewards: 53.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.625', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.087', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '3.020', 'DAMAGECOUNT': '13.371', 'FRAGCOUNT': '45.500'} [2024-08-06 03:33:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 382672896. Throughput: 0: 4383.3. Samples: 95676090. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:33:42,794][52567] Avg episode reward: [(0, '69.940')] [2024-08-06 03:33:44,888][52666] DAMAGECOUNT value on done: 418093.0 [2024-08-06 03:33:44,889][52666] Sum rewards: 68.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.124', 'weapon5': '0.140', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.080', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '59.000'} [2024-08-06 03:33:45,183][52820] DAMAGECOUNT value on done: 388489.0 [2024-08-06 03:33:45,186][52820] Sum rewards: 67.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'weapon2': '0.186', 'AMMO3': '0.205', 'weapon4': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '54.000'} [2024-08-06 03:33:45,517][52670] DAMAGECOUNT value on done: 413553.0 [2024-08-06 03:33:45,517][52670] Sum rewards: 72.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.044', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'weapon2': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.312', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '63.000'} [2024-08-06 03:33:45,620][52663] DAMAGECOUNT value on done: 418271.0 [2024-08-06 03:33:45,622][52663] Sum rewards: 65.683, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.610', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.080', 'weapon5': '0.164', 'AMMO4': '0.212', 'AMMO3': '0.274', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.124', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:46,359][52650] Updated weights for policy 0, policy_version 46721 (0.0013) [2024-08-06 03:33:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 382754816. Throughput: 0: 4380.0. Samples: 95689290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:33:47,794][52567] Avg episode reward: [(0, '69.809')] [2024-08-06 03:33:47,963][52666] DAMAGECOUNT value on done: 416299.0 [2024-08-06 03:33:47,964][52666] Sum rewards: 65.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.094', 'weapon2': '0.152', 'weapon5': '0.214', 'AMMO3': '0.220', 'AMMO4': '0.319', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.344', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '54.500'} [2024-08-06 03:33:48,287][52820] DAMAGECOUNT value on done: 392485.0 [2024-08-06 03:33:48,287][52820] Sum rewards: 75.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.500', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'weapon2': '0.274', 'weapon4': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.284', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '64.000'} [2024-08-06 03:33:48,461][52663] DAMAGECOUNT value on done: 424402.0 [2024-08-06 03:33:48,461][52663] Sum rewards: 60.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.638', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.150', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon5': '0.326', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.860', 'weapon3': '2.974', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '52.000'} [2024-08-06 03:33:48,676][52670] DAMAGECOUNT value on done: 421642.0 [2024-08-06 03:33:48,676][52670] Sum rewards: 69.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.135', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.144', 'AMMO4': '0.149', 'weapon2': '0.212', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.308', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:48,891][52664] DAMAGECOUNT value on done: 438067.0 [2024-08-06 03:33:48,892][52664] Sum rewards: 68.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.476', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.194', 'AMMO3': '0.196', 'weapon2': '0.204', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 03:33:50,818][52666] DAMAGECOUNT value on done: 426132.0 [2024-08-06 03:33:50,819][52666] Sum rewards: 75.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.140', 'AMMO3': '0.160', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '60.000'} [2024-08-06 03:33:51,243][52820] DAMAGECOUNT value on done: 394986.0 [2024-08-06 03:33:51,245][52820] Sum rewards: 57.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.154', 'AMMO3': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon7': '0.190', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.238', 'weapon4': '0.444', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '2.686', 'DAMAGECOUNT': '13.512', 'FRAGCOUNT': '47.000'} [2024-08-06 03:33:51,368][52650] Updated weights for policy 0, policy_version 46731 (0.0013) [2024-08-06 03:33:51,422][52670] DAMAGECOUNT value on done: 414864.0 [2024-08-06 03:33:51,422][52670] Sum rewards: 73.576, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.220', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.220', 'weapon2': '0.256', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '60.000'} [2024-08-06 03:33:52,065][52664] DAMAGECOUNT value on done: 443363.0 [2024-08-06 03:33:52,065][52664] Sum rewards: 69.610, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.520', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon2': '0.174', 'weapon5': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '2.974', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '61.000'} [2024-08-06 03:33:52,106][52663] DAMAGECOUNT value on done: 428595.0 [2024-08-06 03:33:52,107][52663] Sum rewards: 65.719, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.138', 'weapon4': '0.146', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.814', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '53.000'} [2024-08-06 03:33:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 382844928. Throughput: 0: 4375.5. Samples: 95715310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:33:52,795][52567] Avg episode reward: [(0, '69.746')] [2024-08-06 03:33:53,711][52666] DAMAGECOUNT value on done: 423408.0 [2024-08-06 03:33:53,712][52666] Sum rewards: 69.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.602', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.058', 'AMMO4': '0.084', 'weapon5': '0.090', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:54,439][52820] DAMAGECOUNT value on done: 391784.0 [2024-08-06 03:33:54,439][52820] Sum rewards: 70.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.420', 'WEAPON3': '1.550', 'weapon3': '3.354', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '61.000'} [2024-08-06 03:33:54,536][52670] DAMAGECOUNT value on done: 415147.0 [2024-08-06 03:33:54,538][52670] Sum rewards: 67.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.828', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.247', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.480', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:55,157][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:33:55,190][52663] DAMAGECOUNT value on done: 421099.0 [2024-08-06 03:33:55,190][52663] Sum rewards: 67.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.388', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '55.000'} [2024-08-06 03:33:55,267][52664] DAMAGECOUNT value on done: 443884.0 [2024-08-06 03:33:55,267][52664] Sum rewards: 75.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.275', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '62.000'} [2024-08-06 03:33:55,319][52667] DAMAGECOUNT value on done: 419640.0 [2024-08-06 03:33:55,320][52667] Sum rewards: 61.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.660', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.048', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'weapon2': '0.264', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.310', 'weapon3': '3.326', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '54.000'} [2024-08-06 03:33:55,844][52650] Updated weights for policy 0, policy_version 46741 (0.0054) [2024-08-06 03:33:56,797][52666] DAMAGECOUNT value on done: 418610.0 [2024-08-06 03:33:56,799][52666] Sum rewards: 59.253, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.954', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'weapon4': '0.264', 'AMMO3': '0.308', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.800', 'weapon3': '2.810', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '55.000'} [2024-08-06 03:33:57,410][52820] DAMAGECOUNT value on done: 397555.0 [2024-08-06 03:33:57,411][52820] Sum rewards: 72.639, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.138', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.432', 'weapon4': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '58.000'} [2024-08-06 03:33:57,432][52670] DAMAGECOUNT value on done: 427471.0 [2024-08-06 03:33:57,433][52670] Sum rewards: 76.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.120', 'AMMO3': '0.202', 'weapon2': '0.220', 'weapon5': '0.242', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '63.500'} [2024-08-06 03:33:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 382935040. Throughput: 0: 4374.2. Samples: 95741550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:33:57,802][52567] Avg episode reward: [(0, '69.606')] [2024-08-06 03:33:58,043][52664] DAMAGECOUNT value on done: 437239.0 [2024-08-06 03:33:58,043][52664] Sum rewards: 75.670, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.095', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.070', 'AMMO3': '0.173', 'weapon5': '0.176', 'AMMO4': '0.198', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '60.000'} [2024-08-06 03:33:58,204][52663] DAMAGECOUNT value on done: 416898.0 [2024-08-06 03:33:58,205][52663] Sum rewards: 68.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.179', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.164', 'AMMO4': '0.272', 'weapon5': '0.310', 'weapon4': '0.398', 'weapon2': '0.404', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.620', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '53.000'} [2024-08-06 03:33:58,304][52667] DAMAGECOUNT value on done: 429391.0 [2024-08-06 03:33:58,306][52667] Sum rewards: 73.453, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.545', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.022', 'weapon5': '0.038', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.190', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.548', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '63.000'} [2024-08-06 03:33:59,463][52666] DAMAGECOUNT value on done: 419373.0 [2024-08-06 03:33:59,465][52666] Sum rewards: 72.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon4': '0.270', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '61.000'} [2024-08-06 03:33:59,701][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:34:00,145][52670] DAMAGECOUNT value on done: 421196.0 [2024-08-06 03:34:00,145][52670] Sum rewards: 70.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.282', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.246', 'weapon2': '0.310', 'weapon4': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '61.000'} [2024-08-06 03:34:00,373][52650] Updated weights for policy 0, policy_version 46751 (0.0020) [2024-08-06 03:34:00,516][52820] DAMAGECOUNT value on done: 390342.0 [2024-08-06 03:34:00,516][52820] Sum rewards: 73.045, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.546', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.175', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '62.500'} [2024-08-06 03:34:00,696][52664] DAMAGECOUNT value on done: 440546.0 [2024-08-06 03:34:00,696][52664] Sum rewards: 70.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.080', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:00,829][52663] DAMAGECOUNT value on done: 415243.0 [2024-08-06 03:34:00,830][52663] Sum rewards: 60.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.018', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.199', 'weapon2': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.218', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '49.000'} [2024-08-06 03:34:01,591][52667] DAMAGECOUNT value on done: 421061.0 [2024-08-06 03:34:01,594][52667] Sum rewards: 67.450, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO3': '0.154', 'AMMO4': '0.186', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.898', 'WEAPON3': '1.050', 'weapon3': '2.536', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '53.000'} [2024-08-06 03:34:02,313][52666] DAMAGECOUNT value on done: 419984.0 [2024-08-06 03:34:02,314][52666] Sum rewards: 68.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.632', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.136', 'AMMO4': '0.170', 'weapon5': '0.172', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 383025152. Throughput: 0: 4377.3. Samples: 95754870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:34:02,802][52567] Avg episode reward: [(0, '69.364')] [2024-08-06 03:34:03,004][52670] DAMAGECOUNT value on done: 406332.0 [2024-08-06 03:34:03,004][52670] Sum rewards: 81.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.670', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.177', 'AMMO3': '0.246', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '69.000'} [2024-08-06 03:34:03,221][52664] DAMAGECOUNT value on done: 437411.0 [2024-08-06 03:34:03,221][52664] Sum rewards: 72.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 03:34:03,543][52663] DAMAGECOUNT value on done: 417475.0 [2024-08-06 03:34:03,545][52663] Sum rewards: 50.821, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.715', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO3': '0.175', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.362', 'weapon2': '0.404', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.858', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '41.000'} [2024-08-06 03:34:03,664][52820] DAMAGECOUNT value on done: 390920.0 [2024-08-06 03:34:03,664][52820] Sum rewards: 70.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.674', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.118', 'weapon5': '0.134', 'AMMO4': '0.168', 'weapon2': '0.216', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.296', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '62.000'} [2024-08-06 03:34:04,646][52667] DAMAGECOUNT value on done: 423224.0 [2024-08-06 03:34:04,648][52667] Sum rewards: 63.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.081', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.438', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:05,047][52666] DAMAGECOUNT value on done: 421289.0 [2024-08-06 03:34:05,047][52666] Sum rewards: 88.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.144', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.549', 'FRAGCOUNT': '72.000'} [2024-08-06 03:34:05,283][52650] Updated weights for policy 0, policy_version 46761 (0.0030) [2024-08-06 03:34:05,731][52664] DAMAGECOUNT value on done: 439301.0 [2024-08-06 03:34:05,732][52664] Sum rewards: 71.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.705', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'weapon4': '0.098', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.214', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:05,811][52670] DAMAGECOUNT value on done: 417758.0 [2024-08-06 03:34:05,815][52670] Sum rewards: 65.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.268', 'weapon2': '0.362', 'WEAPON3': '1.650', 'HITCOUNT': '3.250', 'weapon3': '3.456', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '58.000'} [2024-08-06 03:34:06,072][52663] DAMAGECOUNT value on done: 427819.0 [2024-08-06 03:34:06,073][52663] Sum rewards: 70.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.821', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.084', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.272', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.370', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:06,774][52820] DAMAGECOUNT value on done: 401731.0 [2024-08-06 03:34:06,775][52820] Sum rewards: 66.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.284', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.500'} [2024-08-06 03:34:07,755][52667] DAMAGECOUNT value on done: 429123.0 [2024-08-06 03:34:07,756][52667] Sum rewards: 63.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.326', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.110', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.880', 'weapon3': '3.294', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 383107072. Throughput: 0: 4374.0. Samples: 95780870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:34:07,794][52567] Avg episode reward: [(0, '69.747')] [2024-08-06 03:34:08,240][52666] DAMAGECOUNT value on done: 411184.0 [2024-08-06 03:34:08,242][52666] Sum rewards: 83.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.359', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.134', 'AMMO3': '0.203', 'AMMO4': '0.214', 'weapon5': '0.232', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '69.000'} [2024-08-06 03:34:08,833][52664] DAMAGECOUNT value on done: 431312.0 [2024-08-06 03:34:08,834][52664] Sum rewards: 53.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.878', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.140', 'weapon5': '0.140', 'AMMO3': '0.195', 'AMMO4': '0.285', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '3.138', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '46.000'} [2024-08-06 03:34:09,019][52670] DAMAGECOUNT value on done: 426815.0 [2024-08-06 03:34:09,022][52670] Sum rewards: 57.663, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.309', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.062', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.476', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.244', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '48.000'} [2024-08-06 03:34:09,308][52663] DAMAGECOUNT value on done: 419462.0 [2024-08-06 03:34:09,310][52663] Sum rewards: 72.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.640', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.118', 'weapon4': '0.124', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:09,699][52647] DAMAGECOUNT value on done: 446802.0 [2024-08-06 03:34:09,699][52647] Sum rewards: 54.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.086', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.358', 'weapon2': '0.428', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '2.920', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '44.000'} [2024-08-06 03:34:09,743][52650] Updated weights for policy 0, policy_version 46771 (0.0039) [2024-08-06 03:34:09,904][52820] DAMAGECOUNT value on done: 402129.0 [2024-08-06 03:34:09,904][52820] Sum rewards: 66.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.200', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.146', 'AMMO4': '0.196', 'AMMO3': '0.219', 'weapon5': '0.286', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:10,945][52667] DAMAGECOUNT value on done: 430241.0 [2024-08-06 03:34:10,946][52667] Sum rewards: 67.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.104', 'weapon4': '0.106', 'AMMO4': '0.121', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.402', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '57.000'} [2024-08-06 03:34:11,434][52666] DAMAGECOUNT value on done: 420367.0 [2024-08-06 03:34:11,434][52666] Sum rewards: 65.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.697', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.164', 'AMMO3': '0.223', 'weapon5': '0.274', 'AMMO4': '0.293', 'weapon2': '0.300', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:11,540][52664] DAMAGECOUNT value on done: 444287.0 [2024-08-06 03:34:11,543][52664] Sum rewards: 64.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.326', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.360', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '52.000'} [2024-08-06 03:34:11,885][52670] DAMAGECOUNT value on done: 418481.0 [2024-08-06 03:34:11,886][52670] Sum rewards: 80.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.460', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.154', 'weapon5': '0.174', 'AMMO4': '0.175', 'AMMO3': '0.178', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '66.000'} [2024-08-06 03:34:12,364][52663] DAMAGECOUNT value on done: 424282.0 [2024-08-06 03:34:12,364][52663] Sum rewards: 76.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.782', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.144', 'AMMO3': '0.233', 'weapon4': '0.236', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '64.000'} [2024-08-06 03:34:12,392][52647] DAMAGECOUNT value on done: 446814.0 [2024-08-06 03:34:12,392][52647] Sum rewards: 79.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.046', 'AMMO4': '0.180', 'weapon5': '0.214', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '66.000'} [2024-08-06 03:34:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 383197184. Throughput: 0: 4380.2. Samples: 95807370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:34:12,794][52567] Avg episode reward: [(0, '69.463')] [2024-08-06 03:34:13,111][52820] DAMAGECOUNT value on done: 389603.0 [2024-08-06 03:34:13,112][52820] Sum rewards: 68.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.495', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.320', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.494', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:14,122][52667] DAMAGECOUNT value on done: 427444.0 [2024-08-06 03:34:14,122][52667] Sum rewards: 61.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO4': '0.190', 'AMMO3': '0.238', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.356', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '53.000'} [2024-08-06 03:34:14,329][52650] Updated weights for policy 0, policy_version 46781 (0.0019) [2024-08-06 03:34:14,426][52664] DAMAGECOUNT value on done: 435261.0 [2024-08-06 03:34:14,427][52664] Sum rewards: 65.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.102', 'AMMO3': '0.189', 'weapon5': '0.220', 'AMMO4': '0.267', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.774', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:14,949][52670] DAMAGECOUNT value on done: 420809.0 [2024-08-06 03:34:14,950][52670] Sum rewards: 65.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.753', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.150', 'AMMO4': '0.189', 'weapon2': '0.194', 'AMMO3': '0.209', 'weapon5': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.164', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:15,315][52647] DAMAGECOUNT value on done: 444806.0 [2024-08-06 03:34:15,315][52647] Sum rewards: 63.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.158', 'AMMO4': '0.163', 'AMMO3': '0.212', 'weapon5': '0.224', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.018', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '52.000'} [2024-08-06 03:34:15,422][52663] DAMAGECOUNT value on done: 423518.0 [2024-08-06 03:34:15,422][52663] Sum rewards: 75.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.644', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.178', 'weapon2': '0.232', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 03:34:15,723][52614] Signal inference workers to stop experience collection... (8450 times) [2024-08-06 03:34:15,724][52614] Signal inference workers to resume experience collection... (8450 times) [2024-08-06 03:34:15,802][52650] InferenceWorker_p0-w0: stopping experience collection (8450 times) [2024-08-06 03:34:15,802][52650] InferenceWorker_p0-w0: resuming experience collection (8450 times) [2024-08-06 03:34:16,738][52667] DAMAGECOUNT value on done: 424187.0 [2024-08-06 03:34:16,739][52667] Sum rewards: 80.521, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.058', 'weapon4': '0.178', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '69.000'} [2024-08-06 03:34:17,445][52664] DAMAGECOUNT value on done: 445584.0 [2024-08-06 03:34:17,447][52664] Sum rewards: 84.682, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.112', 'AMMO4': '0.116', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '67.000'} [2024-08-06 03:34:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 383279104. Throughput: 0: 4371.1. Samples: 95820160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:34:17,794][52567] Avg episode reward: [(0, '69.326')] [2024-08-06 03:34:18,125][52647] DAMAGECOUNT value on done: 454949.0 [2024-08-06 03:34:18,125][52647] Sum rewards: 77.169, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.802', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.164', 'AMMO4': '0.196', 'weapon5': '0.222', 'AMMO3': '0.259', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.982', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '65.000'} [2024-08-06 03:34:18,427][52663] DAMAGECOUNT value on done: 417411.0 [2024-08-06 03:34:18,427][52663] Sum rewards: 72.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.099', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.096', 'weapon5': '0.174', 'AMMO4': '0.197', 'AMMO3': '0.211', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:19,415][52650] Updated weights for policy 0, policy_version 46791 (0.0015) [2024-08-06 03:34:19,592][52667] DAMAGECOUNT value on done: 425384.0 [2024-08-06 03:34:19,597][52667] Sum rewards: 74.126, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.175', 'AMMO4': '0.183', 'weapon5': '0.204', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:20,405][52664] DAMAGECOUNT value on done: 440715.0 [2024-08-06 03:34:20,405][52664] Sum rewards: 57.718, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.880', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon2': '0.162', 'AMMO3': '0.184', 'AMMO4': '0.187', 'weapon5': '0.260', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '2.964', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '47.000'} [2024-08-06 03:34:20,968][52647] DAMAGECOUNT value on done: 451280.0 [2024-08-06 03:34:20,969][52647] Sum rewards: 70.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.258', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.078', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 03:34:22,327][52667] DAMAGECOUNT value on done: 433052.0 [2024-08-06 03:34:22,327][52667] Sum rewards: 69.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.194', 'AMMO4': '0.227', 'weapon2': '0.258', 'weapon4': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.500'} [2024-08-06 03:34:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 383369216. Throughput: 0: 4373.6. Samples: 95846450. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:34:22,794][52567] Avg episode reward: [(0, '69.384')] [2024-08-06 03:34:23,400][52664] DAMAGECOUNT value on done: 448975.0 [2024-08-06 03:34:23,400][52664] Sum rewards: 76.399, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.172', 'AMMO3': '0.184', 'weapon2': '0.236', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '63.000'} [2024-08-06 03:34:23,962][52650] Updated weights for policy 0, policy_version 46801 (0.0025) [2024-08-06 03:34:24,010][52647] DAMAGECOUNT value on done: 448417.0 [2024-08-06 03:34:24,012][52647] Sum rewards: 65.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.102', 'weapon4': '0.126', 'AMMO3': '0.180', 'AMMO4': '0.184', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:25,023][52667] DAMAGECOUNT value on done: 419923.0 [2024-08-06 03:34:25,023][52667] Sum rewards: 67.194, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.822', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.116', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.342', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '58.000'} [2024-08-06 03:34:25,968][52664] DAMAGECOUNT value on done: 442279.0 [2024-08-06 03:34:25,970][52664] Sum rewards: 73.251, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.031', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.134', 'AMMO4': '0.149', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.402', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 03:34:26,440][52647] DAMAGECOUNT value on done: 449008.0 [2024-08-06 03:34:26,442][52647] Sum rewards: 72.789, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.424', 'AMMO2': '0.005', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.027', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.342', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '62.000'} [2024-08-06 03:34:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 383459328. Throughput: 0: 4371.1. Samples: 95872790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:34:27,794][52567] Avg episode reward: [(0, '69.409')] [2024-08-06 03:34:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046809_383459328.pth... [2024-08-06 03:34:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046296_379256832.pth [2024-08-06 03:34:28,028][52667] DAMAGECOUNT value on done: 424814.0 [2024-08-06 03:34:28,029][52667] Sum rewards: 63.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.149', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon4': '0.086', 'AMMO4': '0.157', 'weapon5': '0.182', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '2.990', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '53.000'} [2024-08-06 03:34:28,491][52668] DAMAGECOUNT value on done: 423437.0 [2024-08-06 03:34:28,493][52668] Sum rewards: 80.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.096', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '66.000'} [2024-08-06 03:34:28,612][52664] DAMAGECOUNT value on done: 445956.0 [2024-08-06 03:34:28,613][52664] Sum rewards: 67.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'weapon2': '0.200', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'HITCOUNT': '3.270', 'weapon3': '3.416', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:28,727][52650] Updated weights for policy 0, policy_version 46811 (0.0037) [2024-08-06 03:34:29,032][52647] DAMAGECOUNT value on done: 441318.0 [2024-08-06 03:34:29,032][52647] Sum rewards: 73.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.196', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.098', 'AMMO3': '0.206', 'AMMO4': '0.260', 'weapon5': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '2.704', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:31,165][52667] DAMAGECOUNT value on done: 426977.0 [2024-08-06 03:34:31,167][52667] Sum rewards: 73.481, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.627', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.010', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '57.500'} [2024-08-06 03:34:31,190][52664] DAMAGECOUNT value on done: 439028.0 [2024-08-06 03:34:31,190][52664] Sum rewards: 70.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.180', 'AMMO3': '0.188', 'weapon2': '0.198', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '57.000'} [2024-08-06 03:34:31,269][52669] DAMAGECOUNT value on done: 429529.0 [2024-08-06 03:34:31,271][52669] Sum rewards: 68.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.384', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.068', 'weapon5': '0.132', 'AMMO3': '0.199', 'AMMO4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.160', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:31,576][52668] DAMAGECOUNT value on done: 426198.0 [2024-08-06 03:34:31,579][52668] Sum rewards: 71.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.350', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.088', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:31,631][52647] DAMAGECOUNT value on done: 453982.0 [2024-08-06 03:34:31,631][52647] Sum rewards: 66.371, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.280', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.168', 'AMMO3': '0.257', 'AMMO4': '0.272', 'weapon2': '0.324', 'weapon4': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.854', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 383541248. Throughput: 0: 4360.7. Samples: 95885520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:34:32,794][52567] Avg episode reward: [(0, '69.257')] [2024-08-06 03:34:33,205][52650] Updated weights for policy 0, policy_version 46821 (0.0039) [2024-08-06 03:34:33,887][52664] DAMAGECOUNT value on done: 439244.0 [2024-08-06 03:34:33,887][52664] Sum rewards: 66.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.525', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.250', 'weapon4': '0.274', 'AMMO3': '0.282', 'weapon2': '0.330', 'WEAPON3': '1.850', 'weapon3': '3.112', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '58.000'} [2024-08-06 03:34:34,259][52669] DAMAGECOUNT value on done: 418550.0 [2024-08-06 03:34:34,259][52669] Sum rewards: 84.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.635', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.068', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '71.000'} [2024-08-06 03:34:34,259][52667] DAMAGECOUNT value on done: 420558.0 [2024-08-06 03:34:34,261][52667] Sum rewards: 74.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.632', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.098', 'weapon5': '0.128', 'AMMO3': '0.188', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '62.000'} [2024-08-06 03:34:34,305][52647] DAMAGECOUNT value on done: 442948.0 [2024-08-06 03:34:34,305][52647] Sum rewards: 65.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.167', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.268', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:34,673][52668] DAMAGECOUNT value on done: 427111.0 [2024-08-06 03:34:34,673][52668] Sum rewards: 61.316, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.644', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.202', 'weapon5': '0.226', 'AMMO3': '0.267', 'weapon2': '0.286', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.720', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:36,696][52669] DAMAGECOUNT value on done: 429427.0 [2024-08-06 03:34:36,698][52669] Sum rewards: 78.475, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '64.000'} [2024-08-06 03:34:36,980][52664] DAMAGECOUNT value on done: 440471.0 [2024-08-06 03:34:36,980][52664] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.096', 'weapon5': '0.166', 'AMMO4': '0.241', 'AMMO3': '0.270', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '63.000'} [2024-08-06 03:34:37,169][52667] DAMAGECOUNT value on done: 428035.0 [2024-08-06 03:34:37,170][52667] Sum rewards: 59.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.074', 'AMMO4': '0.168', 'weapon5': '0.176', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.600', 'HITCOUNT': '2.770', 'weapon3': '2.968', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '51.000'} [2024-08-06 03:34:37,434][52647] DAMAGECOUNT value on done: 447277.0 [2024-08-06 03:34:37,434][52647] Sum rewards: 58.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.924', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.104', 'weapon2': '0.208', 'AMMO4': '0.225', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.048', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '52.000'} [2024-08-06 03:34:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 383631360. Throughput: 0: 4366.0. Samples: 95911780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:34:37,794][52567] Avg episode reward: [(0, '69.451')] [2024-08-06 03:34:37,909][52668] DAMAGECOUNT value on done: 429161.0 [2024-08-06 03:34:37,910][52668] Sum rewards: 58.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.242', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.220', 'weapon4': '0.244', 'weapon5': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.820', 'WEAPON3': '1.300', 'weapon3': '2.404', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '48.000'} [2024-08-06 03:34:38,165][52650] Updated weights for policy 0, policy_version 46831 (0.0018) [2024-08-06 03:34:38,701][52662] DAMAGECOUNT value on done: 430043.0 [2024-08-06 03:34:38,701][52662] Sum rewards: 76.399, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.054', 'AMMO3': '0.179', 'AMMO4': '0.197', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:39,411][52667] DAMAGECOUNT value on done: 434425.0 [2024-08-06 03:34:39,411][52667] Sum rewards: 60.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO4': '0.152', 'weapon2': '0.210', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.396', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '53.000'} [2024-08-06 03:34:39,479][52669] DAMAGECOUNT value on done: 423144.0 [2024-08-06 03:34:39,479][52669] Sum rewards: 68.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.195', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.198', 'weapon2': '0.218', 'weapon5': '0.220', 'AMMO4': '0.301', 'weapon4': '0.330', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '57.000'} [2024-08-06 03:34:40,212][52664] DAMAGECOUNT value on done: 438492.0 [2024-08-06 03:34:40,213][52664] Sum rewards: 68.604, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.934', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon4': '0.108', 'AMMO4': '0.195', 'weapon2': '0.244', 'AMMO3': '0.290', 'weapon5': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.938', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '59.500'} [2024-08-06 03:34:40,622][52647] DAMAGECOUNT value on done: 440266.0 [2024-08-06 03:34:40,623][52647] Sum rewards: 72.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.036', 'weapon4': '0.056', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '61.000'} [2024-08-06 03:34:41,088][52668] DAMAGECOUNT value on done: 417598.0 [2024-08-06 03:34:41,090][52668] Sum rewards: 71.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.041', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.270', 'weapon2': '0.414', 'WEAPON3': '1.750', 'weapon3': '3.406', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '63.000'} [2024-08-06 03:34:41,188][52662] DAMAGECOUNT value on done: 430723.0 [2024-08-06 03:34:41,189][52662] Sum rewards: 75.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.156', 'AMMO4': '0.173', 'weapon4': '0.206', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '62.000'} [2024-08-06 03:34:41,974][52667] DAMAGECOUNT value on done: 431617.0 [2024-08-06 03:34:41,982][52667] Sum rewards: 65.917, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.872', 'AMMO5': '0.014', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.085', 'weapon5': '0.164', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '2.970', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '53.000'} [2024-08-06 03:34:42,014][52669] DAMAGECOUNT value on done: 423866.0 [2024-08-06 03:34:42,015][52669] Sum rewards: 66.875, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.130', 'AMMO4': '0.145', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.244', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:42,631][52650] Updated weights for policy 0, policy_version 46841 (0.0019) [2024-08-06 03:34:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 383721472. Throughput: 0: 4374.4. Samples: 95938400. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 03:34:42,794][52567] Avg episode reward: [(0, '69.444')] [2024-08-06 03:34:43,145][52664] DAMAGECOUNT value on done: 439858.0 [2024-08-06 03:34:43,146][52664] Sum rewards: 77.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.564', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.066', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon2': '0.324', 'WEAPON3': '1.700', 'weapon3': '3.316', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '66.000'} [2024-08-06 03:34:43,577][52647] DAMAGECOUNT value on done: 446700.0 [2024-08-06 03:34:43,577][52647] Sum rewards: 74.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.775', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.151', 'AMMO3': '0.176', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:44,118][52668] DAMAGECOUNT value on done: 428611.0 [2024-08-06 03:34:44,118][52668] Sum rewards: 67.082, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.848', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.130', 'weapon5': '0.174', 'AMMO3': '0.194', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '2.992', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:44,200][52662] DAMAGECOUNT value on done: 429515.0 [2024-08-06 03:34:44,222][52662] Sum rewards: 66.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.851', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.122', 'AMMO4': '0.161', 'weapon5': '0.176', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.074', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:44,365][52667] DAMAGECOUNT value on done: 429536.0 [2024-08-06 03:34:44,366][52667] Sum rewards: 76.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.158', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.070', 'AMMO4': '0.157', 'AMMO3': '0.186', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '63.000'} [2024-08-06 03:34:44,819][52669] DAMAGECOUNT value on done: 429954.0 [2024-08-06 03:34:44,822][52669] Sum rewards: 76.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.092', 'weapon5': '0.182', 'AMMO4': '0.217', 'AMMO3': '0.226', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '63.500'} [2024-08-06 03:34:46,363][52647] DAMAGECOUNT value on done: 442950.0 [2024-08-06 03:34:46,363][52647] Sum rewards: 76.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.179', 'weapon5': '0.192', 'weapon2': '0.238', 'AMMO4': '0.286', 'weapon4': '0.424', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '61.500'} [2024-08-06 03:34:46,585][52662] DAMAGECOUNT value on done: 420115.0 [2024-08-06 03:34:46,585][52662] Sum rewards: 57.433, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.470', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.156', 'weapon5': '0.194', 'AMMO4': '0.291', 'weapon2': '0.302', 'AMMO3': '0.321', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'HITCOUNT': '2.870', 'weapon3': '3.006', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '52.000'} [2024-08-06 03:34:46,662][52668] DAMAGECOUNT value on done: 427573.0 [2024-08-06 03:34:46,663][52668] Sum rewards: 64.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.210', 'AMMO3': '0.241', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.680', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '55.500'} [2024-08-06 03:34:47,156][52665] DAMAGECOUNT value on done: 417487.0 [2024-08-06 03:34:47,157][52665] Sum rewards: 80.135, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.136', 'weapon5': '0.136', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '66.000'} [2024-08-06 03:34:47,192][52650] Updated weights for policy 0, policy_version 46851 (0.0026) [2024-08-06 03:34:47,403][52667] DAMAGECOUNT value on done: 422758.0 [2024-08-06 03:34:47,405][52667] Sum rewards: 66.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.010', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.210', 'weapon5': '0.276', 'weapon4': '0.314', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.798', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 383811584. Throughput: 0: 4374.9. Samples: 95951740. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 03:34:47,794][52567] Avg episode reward: [(0, '69.811')] [2024-08-06 03:34:48,133][52669] DAMAGECOUNT value on done: 425236.0 [2024-08-06 03:34:48,135][52669] Sum rewards: 65.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.500', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon5': '0.130', 'weapon2': '0.186', 'AMMO3': '0.265', 'weapon4': '0.272', 'AMMO4': '0.309', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '57.000'} [2024-08-06 03:34:48,805][52647] DAMAGECOUNT value on done: 452234.0 [2024-08-06 03:34:48,805][52647] Sum rewards: 58.419, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.004', 'AMMO5': '0.022', 'AMMO2': '0.073', 'weapon4': '0.166', 'weapon2': '0.236', 'weapon5': '0.266', 'AMMO3': '0.267', 'AMMO4': '0.363', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.998', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '51.000'} [2024-08-06 03:34:49,492][52668] DAMAGECOUNT value on done: 420130.0 [2024-08-06 03:34:49,493][52668] Sum rewards: 69.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.078', 'weapon5': '0.098', 'AMMO3': '0.179', 'AMMO4': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '57.000'} [2024-08-06 03:34:49,555][52662] DAMAGECOUNT value on done: 431244.0 [2024-08-06 03:34:49,558][52662] Sum rewards: 67.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.165', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.129', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.146', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:50,107][52671] DAMAGECOUNT value on done: 430546.0 [2024-08-06 03:34:50,110][52671] Sum rewards: 79.760, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.440', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.100', 'AMMO4': '0.174', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.366', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '69.000'} [2024-08-06 03:34:50,289][52658] DAMAGECOUNT value on done: 423369.0 [2024-08-06 03:34:50,289][52658] Sum rewards: 65.401, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO3': '0.155', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.922', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '53.000'} [2024-08-06 03:34:50,368][52665] DAMAGECOUNT value on done: 424877.0 [2024-08-06 03:34:50,368][52665] Sum rewards: 57.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.642', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.094', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '3.204', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '50.500'} [2024-08-06 03:34:50,500][52667] DAMAGECOUNT value on done: 432246.0 [2024-08-06 03:34:50,501][52667] Sum rewards: 82.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.136', 'AMMO4': '0.164', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '69.000'} [2024-08-06 03:34:50,923][52669] DAMAGECOUNT value on done: 426651.0 [2024-08-06 03:34:50,923][52669] Sum rewards: 67.436, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.210', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.128', 'weapon5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '52.000'} [2024-08-06 03:34:51,534][52647] DAMAGECOUNT value on done: 443661.0 [2024-08-06 03:34:51,534][52647] Sum rewards: 70.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.322', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.168', 'AMMO3': '0.193', 'weapon5': '0.262', 'AMMO4': '0.268', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '2.984', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '57.000'} [2024-08-06 03:34:51,968][52650] Updated weights for policy 0, policy_version 46861 (0.0021) [2024-08-06 03:34:52,504][52660] DAMAGECOUNT value on done: 423509.0 [2024-08-06 03:34:52,504][52660] Sum rewards: 80.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.160', 'weapon5': '0.178', 'AMMO3': '0.199', 'AMMO4': '0.270', 'weapon2': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '67.000'} [2024-08-06 03:34:52,575][52662] DAMAGECOUNT value on done: 423838.0 [2024-08-06 03:34:52,576][52662] Sum rewards: 70.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.964', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.198', 'AMMO3': '0.235', 'weapon5': '0.260', 'AMMO4': '0.272', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 03:34:52,621][52658] DAMAGECOUNT value on done: 427046.0 [2024-08-06 03:34:52,621][52658] Sum rewards: 68.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.154', 'weapon5': '0.158', 'AMMO4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.230', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 383893504. Throughput: 0: 4376.7. Samples: 95977820. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 03:34:52,793][52665] DAMAGECOUNT value on done: 423431.0 [2024-08-06 03:34:52,794][52567] Avg episode reward: [(0, '69.730')] [2024-08-06 03:34:52,795][52665] Sum rewards: 63.582, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.708', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO3': '0.133', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.764', 'WEAPON3': '0.850', 'weapon3': '2.932', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '49.000'} [2024-08-06 03:34:52,937][52671] DAMAGECOUNT value on done: 428865.0 [2024-08-06 03:34:52,938][52671] Sum rewards: 69.827, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.013', 'AMMO2': '0.024', 'HEALTH': '0.071', 'AMMO4': '0.120', 'weapon4': '0.158', 'weapon5': '0.186', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '56.000'} [2024-08-06 03:34:52,959][52668] DAMAGECOUNT value on done: 422690.0 [2024-08-06 03:34:52,959][52668] Sum rewards: 63.533, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.134', 'weapon2': '0.206', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.374', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '55.000'} [2024-08-06 03:34:53,557][52669] DAMAGECOUNT value on done: 429897.0 [2024-08-06 03:34:53,558][52669] Sum rewards: 67.049, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.116', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.206', 'AMMO3': '0.238', 'weapon5': '0.282', 'AMMO4': '0.298', 'weapon2': '0.332', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '58.000'} [2024-08-06 03:34:54,663][52647] DAMAGECOUNT value on done: 440760.0 [2024-08-06 03:34:54,664][52647] Sum rewards: 79.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.090', 'weapon5': '0.176', 'AMMO3': '0.216', 'AMMO4': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '65.000'} [2024-08-06 03:34:55,424][52660] DAMAGECOUNT value on done: 417948.0 [2024-08-06 03:34:55,426][52660] Sum rewards: 76.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.818', 'AMMO5': '0.024', 'AMMO2': '0.056', 'weapon5': '0.194', 'weapon4': '0.200', 'AMMO3': '0.234', 'AMMO4': '0.282', 'weapon2': '0.384', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '64.000'} [2024-08-06 03:34:55,494][52665] DAMAGECOUNT value on done: 419969.0 [2024-08-06 03:34:55,494][52665] Sum rewards: 73.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.919', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.197', 'weapon4': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 03:34:55,641][52662] DAMAGECOUNT value on done: 433207.0 [2024-08-06 03:34:55,641][52662] Sum rewards: 57.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.842', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.122', 'weapon4': '0.158', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '47.000'} [2024-08-06 03:34:55,673][52658] DAMAGECOUNT value on done: 430261.0 [2024-08-06 03:34:55,675][52658] Sum rewards: 58.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.777', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.138', 'weapon4': '0.140', 'AMMO4': '0.148', 'AMMO3': '0.201', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.250', 'DAMAGECOUNT': '14.058', 'FRAGCOUNT': '50.000'} [2024-08-06 03:34:55,801][52668] DAMAGECOUNT value on done: 429610.0 [2024-08-06 03:34:55,801][52668] Sum rewards: 81.202, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.132', 'AMMO4': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '64.000'} [2024-08-06 03:34:56,042][52671] DAMAGECOUNT value on done: 429600.0 [2024-08-06 03:34:56,042][52671] Sum rewards: 77.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.992', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.174', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '61.000'} [2024-08-06 03:34:56,137][52669] DAMAGECOUNT value on done: 425678.0 [2024-08-06 03:34:56,138][52669] Sum rewards: 77.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.308', 'WEAPON3': '1.100', 'weapon3': '3.412', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '63.000'} [2024-08-06 03:34:56,452][52650] Updated weights for policy 0, policy_version 46871 (0.0023) [2024-08-06 03:34:57,269][52647] DAMAGECOUNT value on done: 443491.0 [2024-08-06 03:34:57,269][52647] Sum rewards: 82.560, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.337', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.166', 'weapon4': '0.170', 'weapon5': '0.236', 'AMMO4': '0.257', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '63.500'} [2024-08-06 03:34:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 383983616. Throughput: 0: 4368.9. Samples: 96003970. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 03:34:57,794][52567] Avg episode reward: [(0, '69.901')] [2024-08-06 03:34:58,170][52665] DAMAGECOUNT value on done: 412582.0 [2024-08-06 03:34:58,171][52665] Sum rewards: 81.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.198', 'AMMO3': '0.240', 'weapon2': '0.252', 'weapon5': '0.258', 'AMMO4': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '67.000'} [2024-08-06 03:34:58,378][52658] DAMAGECOUNT value on done: 428264.0 [2024-08-06 03:34:58,379][52658] Sum rewards: 69.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.102', 'AMMO3': '0.222', 'AMMO4': '0.272', 'weapon5': '0.276', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.000'} [2024-08-06 03:34:58,404][52660] DAMAGECOUNT value on done: 429435.0 [2024-08-06 03:34:58,404][52660] Sum rewards: 64.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.755', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.162', 'weapon4': '0.184', 'AMMO4': '0.199', 'AMMO3': '0.204', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '54.000'} [2024-08-06 03:34:58,683][52671] DAMAGECOUNT value on done: 426836.0 [2024-08-06 03:34:58,687][52671] Sum rewards: 60.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon4': '0.170', 'AMMO3': '0.174', 'weapon5': '0.208', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.148', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '50.000'} [2024-08-06 03:34:58,940][52668] DAMAGECOUNT value on done: 425446.0 [2024-08-06 03:34:58,940][52668] Sum rewards: 68.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.874', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.202', 'weapon2': '0.294', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.600', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '57.000'} [2024-08-06 03:34:58,969][52662] DAMAGECOUNT value on done: 436259.0 [2024-08-06 03:34:58,971][52662] Sum rewards: 75.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.220', 'AMMO4': '0.224', 'AMMO3': '0.237', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2024-08-06 03:34:59,312][52669] DAMAGECOUNT value on done: 431006.0 [2024-08-06 03:34:59,313][52669] Sum rewards: 85.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.558', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO4': '0.210', 'AMMO3': '0.221', 'weapon2': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.904', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '69.000'} [2024-08-06 03:35:00,036][52647] DAMAGECOUNT value on done: 442140.0 [2024-08-06 03:35:00,037][52647] Sum rewards: 69.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon4': '0.158', 'AMMO3': '0.227', 'weapon2': '0.248', 'weapon5': '0.266', 'AMMO4': '0.323', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.054', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:01,257][52665] DAMAGECOUNT value on done: 414098.0 [2024-08-06 03:35:01,259][52665] Sum rewards: 64.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.454', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.180', 'weapon5': '0.182', 'weapon4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.744', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '53.000'} [2024-08-06 03:35:01,369][52660] DAMAGECOUNT value on done: 431677.0 [2024-08-06 03:35:01,370][52660] Sum rewards: 68.511, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.709', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon2': '0.164', 'AMMO3': '0.186', 'AMMO4': '0.227', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.608', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:01,430][52650] Updated weights for policy 0, policy_version 46881 (0.0019) [2024-08-06 03:35:01,453][52658] DAMAGECOUNT value on done: 419127.0 [2024-08-06 03:35:01,454][52658] Sum rewards: 72.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.186', 'AMMO4': '0.228', 'weapon2': '0.236', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:01,647][52662] DAMAGECOUNT value on done: 424297.0 [2024-08-06 03:35:01,647][52662] Sum rewards: 68.267, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.898', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.155', 'weapon5': '0.214', 'weapon2': '0.218', 'AMMO4': '0.274', 'weapon4': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.926', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:01,724][52668] DAMAGECOUNT value on done: 421086.0 [2024-08-06 03:35:01,725][52668] Sum rewards: 71.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.134', 'AMMO3': '0.179', 'weapon5': '0.204', 'AMMO4': '0.236', 'weapon2': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:02,154][52671] DAMAGECOUNT value on done: 435849.0 [2024-08-06 03:35:02,154][52671] Sum rewards: 75.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.074', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.204', 'weapon5': '0.206', 'AMMO4': '0.261', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:02,312][52669] DAMAGECOUNT value on done: 426609.0 [2024-08-06 03:35:02,312][52669] Sum rewards: 71.025, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.880', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'weapon2': '0.358', 'WEAPON3': '1.800', 'weapon3': '3.326', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:02,518][52647] DAMAGECOUNT value on done: 443557.0 [2024-08-06 03:35:02,518][52647] Sum rewards: 84.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon5': '0.074', 'weapon4': '0.142', 'AMMO4': '0.143', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.198', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '68.500'} [2024-08-06 03:35:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 384073728. Throughput: 0: 4378.9. Samples: 96017210. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 03:35:02,795][52567] Avg episode reward: [(0, '70.523')] [2024-08-06 03:35:03,756][52660] DAMAGECOUNT value on done: 424631.0 [2024-08-06 03:35:03,758][52660] Sum rewards: 95.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.407', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.076', 'AMMO4': '0.144', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.999', 'FRAGCOUNT': '78.000'} [2024-08-06 03:35:04,101][52668] DAMAGECOUNT value on done: 415604.0 [2024-08-06 03:35:04,103][52668] Sum rewards: 67.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.605', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.132', 'weapon4': '0.190', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '57.500'} [2024-08-06 03:35:04,440][52665] DAMAGECOUNT value on done: 419018.0 [2024-08-06 03:35:04,443][52665] Sum rewards: 76.529, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.090', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.166', 'WEAPON3': '0.900', 'HEALTH': '1.132', 'HITCOUNT': '3.290', 'weapon3': '3.434', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:04,493][52662] DAMAGECOUNT value on done: 437372.0 [2024-08-06 03:35:04,493][52662] Sum rewards: 66.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.438', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.176', 'weapon4': '0.204', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '55.000'} [2024-08-06 03:35:04,611][52658] DAMAGECOUNT value on done: 424692.0 [2024-08-06 03:35:04,611][52658] Sum rewards: 75.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.142', 'weapon4': '0.170', 'AMMO3': '0.184', 'AMMO4': '0.225', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:04,853][52671] DAMAGECOUNT value on done: 425813.0 [2024-08-06 03:35:04,854][52671] Sum rewards: 68.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.055', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.108', 'weapon2': '0.156', 'AMMO4': '0.159', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:05,267][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:35:05,440][52669] DAMAGECOUNT value on done: 417972.0 [2024-08-06 03:35:05,441][52669] Sum rewards: 70.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon4': '0.020', 'weapon5': '0.032', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.346', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:06,171][52650] Updated weights for policy 0, policy_version 46891 (0.0011) [2024-08-06 03:35:06,409][52660] DAMAGECOUNT value on done: 421432.0 [2024-08-06 03:35:06,410][52660] Sum rewards: 71.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.193', 'weapon2': '0.614', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:06,752][52668] DAMAGECOUNT value on done: 417742.0 [2024-08-06 03:35:06,753][52668] Sum rewards: 65.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.156', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.274', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '55.000'} [2024-08-06 03:35:06,817][52803] DAMAGECOUNT value on done: 398317.0 [2024-08-06 03:35:06,817][52803] Sum rewards: 75.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon2': '0.168', 'AMMO4': '0.195', 'weapon5': '0.200', 'AMMO3': '0.218', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:06,840][52811] DAMAGECOUNT value on done: 408218.0 [2024-08-06 03:35:06,840][52811] Sum rewards: 61.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.669', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon5': '0.098', 'AMMO4': '0.224', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '54.500'} [2024-08-06 03:35:07,467][52662] DAMAGECOUNT value on done: 423278.0 [2024-08-06 03:35:07,468][52662] Sum rewards: 70.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.042', 'weapon5': '0.096', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.386', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:07,528][52665] DAMAGECOUNT value on done: 423318.0 [2024-08-06 03:35:07,528][52665] Sum rewards: 71.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.211', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.490', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:07,545][52671] DAMAGECOUNT value on done: 434411.0 [2024-08-06 03:35:07,546][52671] Sum rewards: 77.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.120', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO4': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:07,600][52658] DAMAGECOUNT value on done: 427985.0 [2024-08-06 03:35:07,602][52658] Sum rewards: 60.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.146', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.088', 'AMMO4': '0.111', 'weapon5': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.374', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.198', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '53.000'} [2024-08-06 03:35:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 384155648. Throughput: 0: 4378.4. Samples: 96043480. Policy #0 lag: (min: 0.0, avg: 2.6, max: 7.0) [2024-08-06 03:35:07,795][52567] Avg episode reward: [(0, '70.647')] [2024-08-06 03:35:08,596][52669] DAMAGECOUNT value on done: 429047.0 [2024-08-06 03:35:08,597][52669] Sum rewards: 66.457, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.242', 'AMMO5': '0.030', 'AMMO2': '0.060', 'weapon4': '0.170', 'AMMO3': '0.200', 'AMMO4': '0.301', 'weapon5': '0.326', 'weapon2': '0.462', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.618', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:08,899][52660] DAMAGECOUNT value on done: 423885.0 [2024-08-06 03:35:08,899][52660] Sum rewards: 61.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.556', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.140', 'AMMO4': '0.177', 'weapon2': '0.240', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.262', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '53.000'} [2024-08-06 03:35:09,333][52668] DAMAGECOUNT value on done: 416118.0 [2024-08-06 03:35:09,334][52668] Sum rewards: 59.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.142', 'AMMO3': '0.186', 'weapon4': '0.204', 'AMMO4': '0.209', 'weapon2': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.224', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '49.000'} [2024-08-06 03:35:09,460][52662] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:35:09,871][52811] DAMAGECOUNT value on done: 392784.0 [2024-08-06 03:35:09,874][52811] Sum rewards: 61.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.138', 'AMMO3': '0.204', 'weapon2': '0.234', 'weapon5': '0.254', 'AMMO4': '0.317', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.100', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '53.500'} [2024-08-06 03:35:09,927][52803] DAMAGECOUNT value on done: 393939.0 [2024-08-06 03:35:09,927][52803] Sum rewards: 72.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.135', 'weapon5': '0.140', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:10,392][52658] DAMAGECOUNT value on done: 419953.0 [2024-08-06 03:35:10,392][52658] Sum rewards: 69.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.000', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.144', 'weapon5': '0.146', 'AMMO4': '0.164', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '0.800', 'weapon3': '2.928', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:10,457][52665] DAMAGECOUNT value on done: 425429.0 [2024-08-06 03:35:10,458][52665] Sum rewards: 80.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.175', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.111', 'weapon5': '0.136', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '65.000'} [2024-08-06 03:35:10,669][52671] DAMAGECOUNT value on done: 430653.0 [2024-08-06 03:35:10,669][52671] Sum rewards: 73.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.288', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO3': '0.198', 'AMMO4': '0.201', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:10,732][52662] DAMAGECOUNT value on done: 427087.0 [2024-08-06 03:35:10,732][52662] Sum rewards: 55.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.390', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.196', 'weapon2': '0.216', 'AMMO3': '0.282', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.950', 'weapon3': '2.962', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '50.000'} [2024-08-06 03:35:11,089][52650] Updated weights for policy 0, policy_version 46901 (0.0021) [2024-08-06 03:35:11,548][52660] DAMAGECOUNT value on done: 431155.0 [2024-08-06 03:35:11,550][52660] Sum rewards: 67.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon4': '0.126', 'AMMO4': '0.146', 'AMMO3': '0.181', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '54.500'} [2024-08-06 03:35:11,603][52669] DAMAGECOUNT value on done: 432522.0 [2024-08-06 03:35:11,606][52669] Sum rewards: 61.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.144', 'AMMO4': '0.152', 'weapon5': '0.184', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '51.000'} [2024-08-06 03:35:11,913][52668] DAMAGECOUNT value on done: 422933.0 [2024-08-06 03:35:11,913][52668] Sum rewards: 60.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.172', 'weapon4': '0.192', 'weapon5': '0.206', 'AMMO4': '0.237', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '49.500'} [2024-08-06 03:35:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 384245760. Throughput: 0: 4377.1. Samples: 96069760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:35:12,794][52567] Avg episode reward: [(0, '70.072')] [2024-08-06 03:35:12,887][52811] DAMAGECOUNT value on done: 394513.0 [2024-08-06 03:35:12,888][52811] Sum rewards: 63.365, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.152', 'AMMO4': '0.161', 'AMMO3': '0.177', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '51.000'} [2024-08-06 03:35:13,049][52803] DAMAGECOUNT value on done: 400546.0 [2024-08-06 03:35:13,052][52803] Sum rewards: 70.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.081', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.212', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:13,403][52671] DAMAGECOUNT value on done: 426394.0 [2024-08-06 03:35:13,403][52671] Sum rewards: 86.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.123', 'FRAGCOUNT': '69.000'} [2024-08-06 03:35:13,466][52658] DAMAGECOUNT value on done: 435393.0 [2024-08-06 03:35:13,466][52658] Sum rewards: 78.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.160', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.090', 'weapon5': '0.118', 'AMMO4': '0.175', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '63.500'} [2024-08-06 03:35:13,472][52665] DAMAGECOUNT value on done: 420506.0 [2024-08-06 03:35:13,472][52665] Sum rewards: 62.927, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.524', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.098', 'AMMO4': '0.160', 'AMMO3': '0.215', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:13,792][52662] DAMAGECOUNT value on done: 426853.0 [2024-08-06 03:35:13,792][52662] Sum rewards: 69.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.200', 'weapon5': '0.236', 'AMMO3': '0.239', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:14,175][52669] DAMAGECOUNT value on done: 440544.0 [2024-08-06 03:35:14,175][52669] Sum rewards: 79.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.088', 'weapon5': '0.226', 'AMMO4': '0.248', 'AMMO3': '0.259', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '65.500'} [2024-08-06 03:35:14,507][52660] DAMAGECOUNT value on done: 427293.0 [2024-08-06 03:35:14,509][52660] Sum rewards: 64.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.368', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.294', 'weapon4': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:14,741][52668] DAMAGECOUNT value on done: 427830.0 [2024-08-06 03:35:14,742][52668] Sum rewards: 68.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.182', 'AMMO3': '0.210', 'weapon5': '0.216', 'AMMO4': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:15,202][52650] Updated weights for policy 0, policy_version 46911 (0.0038) [2024-08-06 03:35:15,893][52811] DAMAGECOUNT value on done: 395842.0 [2024-08-06 03:35:15,893][52811] Sum rewards: 66.828, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.367', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.092', 'AMMO4': '0.128', 'weapon5': '0.202', 'weapon2': '0.214', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:16,100][52803] DAMAGECOUNT value on done: 403258.0 [2024-08-06 03:35:16,101][52803] Sum rewards: 73.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.855', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.068', 'WEAPON4': '0.150', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.224', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:16,218][52658] DAMAGECOUNT value on done: 425755.0 [2024-08-06 03:35:16,218][52658] Sum rewards: 66.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.655', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.052', 'weapon5': '0.086', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.350', 'weapon3': '3.374', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:16,305][52665] DAMAGECOUNT value on done: 426746.0 [2024-08-06 03:35:16,305][52665] Sum rewards: 70.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.225', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.078', 'weapon4': '0.092', 'AMMO4': '0.105', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:16,407][52671] DAMAGECOUNT value on done: 432423.0 [2024-08-06 03:35:16,408][52671] Sum rewards: 82.399, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.915', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.076', 'weapon4': '0.108', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.000', 'weapon3': '3.266', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '65.000'} [2024-08-06 03:35:16,961][52669] DAMAGECOUNT value on done: 427702.0 [2024-08-06 03:35:16,961][52669] Sum rewards: 65.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.829', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.158', 'AMMO4': '0.175', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '55.000'} [2024-08-06 03:35:17,383][52660] DAMAGECOUNT value on done: 422149.0 [2024-08-06 03:35:17,383][52660] Sum rewards: 72.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.217', 'AMMO4': '0.221', 'weapon5': '0.228', 'weapon2': '0.402', 'weapon4': '0.492', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.502', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:17,399][52662] DAMAGECOUNT value on done: 434336.0 [2024-08-06 03:35:17,400][52662] Sum rewards: 72.851, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.703', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon5': '0.166', 'AMMO3': '0.243', 'weapon4': '0.306', 'AMMO4': '0.332', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:17,791][52668] DAMAGECOUNT value on done: 424834.0 [2024-08-06 03:35:17,791][52668] Sum rewards: 71.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.866', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 384335872. Throughput: 0: 4383.6. Samples: 96082780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:35:17,794][52567] Avg episode reward: [(0, '70.562')] [2024-08-06 03:35:18,284][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:35:18,954][52811] DAMAGECOUNT value on done: 397250.0 [2024-08-06 03:35:18,954][52811] Sum rewards: 67.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.064', 'AMMO4': '0.157', 'weapon5': '0.164', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '55.000'} [2024-08-06 03:35:19,030][52671] DAMAGECOUNT value on done: 436349.0 [2024-08-06 03:35:19,030][52671] Sum rewards: 74.043, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.215', 'weapon5': '0.216', 'weapon4': '0.242', 'weapon2': '0.288', 'AMMO4': '0.294', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:19,101][52665] DAMAGECOUNT value on done: 422537.0 [2024-08-06 03:35:19,102][52665] Sum rewards: 74.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.635', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:19,142][52803] DAMAGECOUNT value on done: 402011.0 [2024-08-06 03:35:19,144][52803] Sum rewards: 66.360, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.410', 'AMMO2': '0.004', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.150', 'weapon2': '0.248', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.380', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:19,196][52658] DAMAGECOUNT value on done: 436899.0 [2024-08-06 03:35:19,197][52658] Sum rewards: 52.389, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.049', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.266', 'AMMO4': '0.272', 'weapon5': '0.276', 'weapon2': '0.340', 'weapon4': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.634', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '48.000'} [2024-08-06 03:35:19,898][52650] Updated weights for policy 0, policy_version 46921 (0.0020) [2024-08-06 03:35:20,272][52669] DAMAGECOUNT value on done: 429355.0 [2024-08-06 03:35:20,274][52669] Sum rewards: 70.179, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO4': '0.171', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.528', 'HEALTH': '0.595', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:20,419][52662] DAMAGECOUNT value on done: 426937.0 [2024-08-06 03:35:20,420][52662] Sum rewards: 68.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.511', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.158', 'AMMO4': '0.191', 'AMMO3': '0.252', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.500', 'weapon3': '2.738', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:20,504][52660] DAMAGECOUNT value on done: 434994.0 [2024-08-06 03:35:20,505][52660] Sum rewards: 81.546, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.174', 'weapon2': '0.180', 'weapon5': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:21,001][52668] DAMAGECOUNT value on done: 430237.0 [2024-08-06 03:35:21,002][52668] Sum rewards: 70.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.328', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO4': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:21,953][52671] DAMAGECOUNT value on done: 426945.0 [2024-08-06 03:35:21,954][52671] Sum rewards: 64.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.370', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.066', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '53.000'} [2024-08-06 03:35:22,046][52658] DAMAGECOUNT value on done: 418238.0 [2024-08-06 03:35:22,046][52658] Sum rewards: 82.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.998', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.328', 'weapon4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '68.000'} [2024-08-06 03:35:22,069][52811] DAMAGECOUNT value on done: 403525.0 [2024-08-06 03:35:22,072][52811] Sum rewards: 67.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.878', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.130', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:22,091][52665] DAMAGECOUNT value on done: 420041.0 [2024-08-06 03:35:22,095][52665] Sum rewards: 72.222, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.986', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.146', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:22,257][52803] DAMAGECOUNT value on done: 389812.0 [2024-08-06 03:35:22,257][52803] Sum rewards: 76.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.106', 'AMMO4': '0.156', 'weapon5': '0.192', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 384425984. Throughput: 0: 4389.1. Samples: 96109290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:35:22,794][52567] Avg episode reward: [(0, '70.578')] [2024-08-06 03:35:23,174][52662] DAMAGECOUNT value on done: 436201.0 [2024-08-06 03:35:23,174][52662] Sum rewards: 74.774, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'HEALTH': '0.025', 'weapon5': '0.084', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:23,177][52669] DAMAGECOUNT value on done: 430337.0 [2024-08-06 03:35:23,177][52669] Sum rewards: 58.599, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.182', 'AMMO5': '0.008', 'weapon4': '0.038', 'AMMO2': '0.048', 'weapon5': '0.136', 'AMMO4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon2': '0.490', 'WEAPON3': '1.650', 'weapon3': '3.056', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '51.000'} [2024-08-06 03:35:23,569][52660] DAMAGECOUNT value on done: 417905.0 [2024-08-06 03:35:23,570][52660] Sum rewards: 76.399, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.789', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.078', 'AMMO4': '0.106', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'weapon2': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:23,791][52668] DAMAGECOUNT value on done: 423194.0 [2024-08-06 03:35:23,792][52668] Sum rewards: 76.921, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.522', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon3': '3.100', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:24,529][52650] Updated weights for policy 0, policy_version 46931 (0.0012) [2024-08-06 03:35:24,563][52671] DAMAGECOUNT value on done: 434736.0 [2024-08-06 03:35:24,563][52671] Sum rewards: 73.580, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.924', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.088', 'weapon5': '0.202', 'AMMO4': '0.216', 'AMMO3': '0.304', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.014', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:25,088][52658] DAMAGECOUNT value on done: 428020.0 [2024-08-06 03:35:25,089][52658] Sum rewards: 70.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.078', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.194', 'AMMO3': '0.195', 'weapon4': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:25,116][52665] DAMAGECOUNT value on done: 419515.0 [2024-08-06 03:35:25,118][52665] Sum rewards: 73.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.078', 'weapon4': '0.114', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:25,205][52811] DAMAGECOUNT value on done: 397674.0 [2024-08-06 03:35:25,208][52811] Sum rewards: 62.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.927', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.066', 'AMMO4': '0.141', 'weapon4': '0.154', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.210', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '55.000'} [2024-08-06 03:35:25,260][52803] DAMAGECOUNT value on done: 393461.0 [2024-08-06 03:35:25,262][52803] Sum rewards: 72.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.179', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.201', 'weapon5': '0.228', 'weapon2': '0.236', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:25,902][52662] DAMAGECOUNT value on done: 430931.0 [2024-08-06 03:35:25,903][52662] Sum rewards: 75.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.415', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.122', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon5': '0.270', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:26,295][52669] DAMAGECOUNT value on done: 432858.0 [2024-08-06 03:35:26,296][52669] Sum rewards: 55.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.679', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '48.000'} [2024-08-06 03:35:26,322][52660] DAMAGECOUNT value on done: 421604.0 [2024-08-06 03:35:26,325][52660] Sum rewards: 81.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.044', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.190', 'AMMO3': '0.206', 'weapon4': '0.216', 'weapon2': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:27,324][52671] DAMAGECOUNT value on done: 426970.0 [2024-08-06 03:35:27,324][52671] Sum rewards: 74.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.028', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.195', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:27,535][52794] DAMAGECOUNT value on done: 428385.0 [2024-08-06 03:35:27,536][52794] Sum rewards: 74.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.198', 'weapon2': '0.388', 'WEAPON3': '1.150', 'HITCOUNT': '3.360', 'weapon3': '3.420', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 384516096. Throughput: 0: 4386.0. Samples: 96135770. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:35:27,802][52567] Avg episode reward: [(0, '70.856')] [2024-08-06 03:35:28,129][52658] DAMAGECOUNT value on done: 422645.0 [2024-08-06 03:35:28,130][52658] Sum rewards: 74.557, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.739', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.112', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.190', 'weapon2': '0.198', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.352', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:28,170][52666] Large shaping reward 2.616 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon5', 0.002)] [2024-08-06 03:35:28,227][52665] DAMAGECOUNT value on done: 422712.0 [2024-08-06 03:35:28,227][52665] Sum rewards: 72.167, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO3': '0.112', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.720', 'WEAPON3': '0.850', 'weapon3': '3.018', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:28,287][52803] DAMAGECOUNT value on done: 392856.0 [2024-08-06 03:35:28,291][52803] Sum rewards: 76.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.958', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.047', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.512', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:28,315][52811] DAMAGECOUNT value on done: 398394.0 [2024-08-06 03:35:28,317][52811] Sum rewards: 77.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.478', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.034', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'weapon2': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.218', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:28,453][52662] DAMAGECOUNT value on done: 426912.0 [2024-08-06 03:35:28,455][52662] Sum rewards: 73.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.138', 'weapon2': '0.170', 'AMMO3': '0.174', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:29,389][52650] Updated weights for policy 0, policy_version 46941 (0.0010) [2024-08-06 03:35:29,597][52660] DAMAGECOUNT value on done: 434888.0 [2024-08-06 03:35:29,597][52660] Sum rewards: 65.066, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.178', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.080', 'weapon3': '3.238', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:29,908][52671] DAMAGECOUNT value on done: 420295.0 [2024-08-06 03:35:29,910][52671] Sum rewards: 81.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.528', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.074', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:29,928][52794] DAMAGECOUNT value on done: 432243.0 [2024-08-06 03:35:29,929][52794] Sum rewards: 65.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.226', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '55.000'} [2024-08-06 03:35:31,023][52662] DAMAGECOUNT value on done: 422383.0 [2024-08-06 03:35:31,025][52662] Sum rewards: 65.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.592', 'AMMO5': '0.008', 'weapon7': '0.038', 'AMMO2': '0.041', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.202', 'weapon4': '0.204', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:31,096][52658] DAMAGECOUNT value on done: 423488.0 [2024-08-06 03:35:31,098][52658] Sum rewards: 71.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.148', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:31,338][52803] DAMAGECOUNT value on done: 400263.0 [2024-08-06 03:35:31,339][52803] Sum rewards: 64.327, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.808', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.096', 'weapon5': '0.230', 'weapon2': '0.232', 'AMMO4': '0.276', 'AMMO3': '0.319', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'HITCOUNT': '3.020', 'weapon3': '3.132', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:31,426][52665] DAMAGECOUNT value on done: 418609.0 [2024-08-06 03:35:31,426][52665] Sum rewards: 51.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.182', 'weapon4': '0.186', 'weapon5': '0.244', 'weapon2': '0.306', 'AMMO4': '0.325', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.980', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '43.000'} [2024-08-06 03:35:31,502][52811] DAMAGECOUNT value on done: 400791.0 [2024-08-06 03:35:31,502][52811] Sum rewards: 59.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.028', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.104', 'AMMO3': '0.209', 'AMMO4': '0.219', 'weapon5': '0.224', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.540', 'weapon3': '3.068', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '51.000'} [2024-08-06 03:35:32,666][52649] DAMAGECOUNT value on done: 410980.0 [2024-08-06 03:35:32,668][52649] Sum rewards: 68.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.168', 'AMMO3': '0.211', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:32,747][52660] DAMAGECOUNT value on done: 441016.0 [2024-08-06 03:35:32,747][52660] Sum rewards: 76.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.101', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 384598016. Throughput: 0: 4381.3. Samples: 96148900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:35:32,794][52567] Avg episode reward: [(0, '70.590')] [2024-08-06 03:35:32,808][52794] DAMAGECOUNT value on done: 429581.0 [2024-08-06 03:35:32,808][52794] Sum rewards: 63.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.185', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.086', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.556', 'WEAPON3': '1.600', 'weapon3': '2.954', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:32,891][52671] DAMAGECOUNT value on done: 434553.0 [2024-08-06 03:35:32,891][52671] Sum rewards: 78.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.338', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '65.000'} [2024-08-06 03:35:33,725][52658] DAMAGECOUNT value on done: 420605.0 [2024-08-06 03:35:33,725][52658] Sum rewards: 69.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.029', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.400', 'weapon3': '3.422', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:33,882][52662] DAMAGECOUNT value on done: 421370.0 [2024-08-06 03:35:33,890][52662] Sum rewards: 69.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.728', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.168', 'weapon5': '0.180', 'weapon4': '0.310', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:33,946][52650] Updated weights for policy 0, policy_version 46951 (0.0036) [2024-08-06 03:35:34,357][52803] DAMAGECOUNT value on done: 392388.0 [2024-08-06 03:35:34,360][52803] Sum rewards: 76.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.886', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:34,376][52665] DAMAGECOUNT value on done: 415914.0 [2024-08-06 03:35:34,377][52665] Sum rewards: 67.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.587', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon2': '0.198', 'weapon5': '0.214', 'AMMO3': '0.230', 'AMMO4': '0.247', 'weapon4': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.008', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:34,577][52811] DAMAGECOUNT value on done: 398841.0 [2024-08-06 03:35:34,581][52811] Sum rewards: 74.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.365', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.214', 'weapon4': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:35,446][52660] DAMAGECOUNT value on done: 421472.0 [2024-08-06 03:35:35,447][52660] Sum rewards: 70.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.064', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:35,829][52649] DAMAGECOUNT value on done: 407653.0 [2024-08-06 03:35:35,831][52649] Sum rewards: 63.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.195', 'weapon2': '0.390', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.454', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '52.000'} [2024-08-06 03:35:35,891][52671] DAMAGECOUNT value on done: 433241.0 [2024-08-06 03:35:35,891][52671] Sum rewards: 70.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.670', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.126', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.650', 'weapon3': '3.042', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:35,957][52794] DAMAGECOUNT value on done: 423535.0 [2024-08-06 03:35:35,958][52794] Sum rewards: 62.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.501', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.072', 'AMMO4': '0.076', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.281', 'weapon2': '0.486', 'WEAPON3': '1.700', 'weapon3': '3.054', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:36,820][52658] DAMAGECOUNT value on done: 432355.0 [2024-08-06 03:35:36,820][52658] Sum rewards: 73.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.705', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO4': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.198', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.602', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:37,354][52803] DAMAGECOUNT value on done: 403545.0 [2024-08-06 03:35:37,356][52803] Sum rewards: 73.747, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.095', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.114', 'weapon2': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO4': '0.238', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.184', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:37,484][52665] DAMAGECOUNT value on done: 417269.0 [2024-08-06 03:35:37,484][52665] Sum rewards: 70.473, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.155', 'weapon2': '0.630', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:37,555][52811] DAMAGECOUNT value on done: 397459.0 [2024-08-06 03:35:37,556][52811] Sum rewards: 81.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.444', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.202', 'AMMO3': '0.208', 'weapon5': '0.382', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.632', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 384688128. Throughput: 0: 4389.3. Samples: 96175340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:35:37,794][52567] Avg episode reward: [(0, '70.091')] [2024-08-06 03:35:38,318][52660] DAMAGECOUNT value on done: 426419.0 [2024-08-06 03:35:38,318][52660] Sum rewards: 75.434, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.299', 'WEAPON3': '1.750', 'weapon3': '3.476', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '67.000'} [2024-08-06 03:35:38,491][52671] DAMAGECOUNT value on done: 434643.0 [2024-08-06 03:35:38,493][52671] Sum rewards: 63.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.402', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.126', 'weapon2': '0.156', 'weapon4': '0.184', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.308', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:38,716][52794] DAMAGECOUNT value on done: 423954.0 [2024-08-06 03:35:38,716][52794] Sum rewards: 80.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.298', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.132', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon4': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '68.000'} [2024-08-06 03:35:38,879][52650] Updated weights for policy 0, policy_version 46961 (0.0012) [2024-08-06 03:35:38,915][52649] DAMAGECOUNT value on done: 418599.0 [2024-08-06 03:35:38,915][52649] Sum rewards: 81.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.636', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '68.000'} [2024-08-06 03:35:39,967][52658] DAMAGECOUNT value on done: 424895.0 [2024-08-06 03:35:39,967][52658] Sum rewards: 72.509, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.665', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.130', 'weapon4': '0.154', 'AMMO4': '0.170', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:40,418][52665] DAMAGECOUNT value on done: 418870.0 [2024-08-06 03:35:40,418][52665] Sum rewards: 68.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.937', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.207', 'weapon5': '0.262', 'AMMO4': '0.272', 'weapon4': '0.296', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:40,481][52803] DAMAGECOUNT value on done: 398208.0 [2024-08-06 03:35:40,484][52803] Sum rewards: 73.756, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.087', 'weapon5': '0.094', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.378', 'weapon2': '0.626', 'WEAPON3': '0.900', 'weapon3': '3.092', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:40,700][52811] DAMAGECOUNT value on done: 408453.0 [2024-08-06 03:35:40,702][52811] Sum rewards: 70.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'weapon4': '0.100', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.274', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:41,060][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:35:41,134][52671] DAMAGECOUNT value on done: 429450.0 [2024-08-06 03:35:41,134][52671] Sum rewards: 75.066, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.570', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.154', 'weapon4': '0.174', 'AMMO4': '0.247', 'AMMO3': '0.322', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.020', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '67.000'} [2024-08-06 03:35:41,361][52649] DAMAGECOUNT value on done: 413052.0 [2024-08-06 03:35:41,361][52649] Sum rewards: 52.451, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.622', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.192', 'AMMO4': '0.252', 'AMMO3': '0.266', 'weapon5': '0.282', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '2.540', 'weapon3': '2.828', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '47.000'} [2024-08-06 03:35:41,441][52660] DAMAGECOUNT value on done: 422196.0 [2024-08-06 03:35:41,444][52660] Sum rewards: 77.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.740', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO3': '0.167', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.000', 'weapon3': '3.284', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '60.500'} [2024-08-06 03:35:41,705][52794] DAMAGECOUNT value on done: 429427.0 [2024-08-06 03:35:41,706][52794] Sum rewards: 78.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.098', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.038', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.223', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:42,121][52803] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:35:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 384778240. Throughput: 0: 4390.0. Samples: 96201520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:35:42,794][52567] Avg episode reward: [(0, '70.432')] [2024-08-06 03:35:42,824][52665] DAMAGECOUNT value on done: 422954.0 [2024-08-06 03:35:42,826][52665] Sum rewards: 71.041, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.134', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'weapon2': '0.302', 'WEAPON3': '1.600', 'weapon3': '3.228', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:43,014][52658] DAMAGECOUNT value on done: 428244.0 [2024-08-06 03:35:43,014][52658] Sum rewards: 73.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.974', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.180', 'weapon5': '0.188', 'AMMO4': '0.237', 'AMMO3': '0.246', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:43,158][52650] Updated weights for policy 0, policy_version 46971 (0.0024) [2024-08-06 03:35:43,523][52671] DAMAGECOUNT value on done: 428797.0 [2024-08-06 03:35:43,523][52671] Sum rewards: 72.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.542', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.096', 'AMMO4': '0.169', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.550', 'weapon3': '3.342', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:43,624][52803] DAMAGECOUNT value on done: 398934.0 [2024-08-06 03:35:43,625][52803] Sum rewards: 76.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.772', 'AMMO5': '0.022', 'AMMO2': '0.053', 'weapon4': '0.152', 'AMMO3': '0.184', 'weapon5': '0.258', 'AMMO4': '0.266', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:43,802][52811] DAMAGECOUNT value on done: 398951.0 [2024-08-06 03:35:43,803][52811] Sum rewards: 89.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.994', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon2': '0.196', 'weapon5': '0.218', 'weapon4': '0.222', 'AMMO3': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.562', 'FRAGCOUNT': '72.000'} [2024-08-06 03:35:44,150][52660] DAMAGECOUNT value on done: 425497.0 [2024-08-06 03:35:44,151][52660] Sum rewards: 69.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.203', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.460', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.464', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:44,267][52649] DAMAGECOUNT value on done: 404742.0 [2024-08-06 03:35:44,268][52649] Sum rewards: 77.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.051', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon2': '0.184', 'AMMO3': '0.211', 'WEAPON3': '1.250', 'weapon3': '3.526', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:44,901][52794] DAMAGECOUNT value on done: 433191.0 [2024-08-06 03:35:44,904][52794] Sum rewards: 71.071, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.662', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.166', 'weapon4': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:46,115][52658] DAMAGECOUNT value on done: 431952.0 [2024-08-06 03:35:46,115][52658] Sum rewards: 80.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.132', 'weapon4': '0.190', 'AMMO4': '0.199', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '67.000'} [2024-08-06 03:35:46,883][52803] DAMAGECOUNT value on done: 402452.0 [2024-08-06 03:35:46,886][52803] Sum rewards: 66.996, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'weapon2': '0.244', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.374', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:46,887][52811] DAMAGECOUNT value on done: 395515.0 [2024-08-06 03:35:46,888][52811] Sum rewards: 70.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.762', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.248', 'AMMO4': '0.271', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:46,954][52660] DAMAGECOUNT value on done: 421307.0 [2024-08-06 03:35:46,955][52660] Sum rewards: 48.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.096', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.082', 'AMMO4': '0.120', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '2.896', 'DAMAGECOUNT': '13.407', 'FRAGCOUNT': '41.000'} [2024-08-06 03:35:47,073][52803] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:35:47,563][52649] DAMAGECOUNT value on done: 416458.0 [2024-08-06 03:35:47,565][52649] Sum rewards: 69.569, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.576', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.118', 'AMMO3': '0.299', 'WEAPON3': '1.950', 'HITCOUNT': '3.520', 'weapon3': '3.648', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 384860160. Throughput: 0: 4393.1. Samples: 96214900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:35:47,794][52567] Avg episode reward: [(0, '71.262')] [2024-08-06 03:35:47,838][52794] DAMAGECOUNT value on done: 423556.0 [2024-08-06 03:35:47,838][52794] Sum rewards: 75.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.017', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.203', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '61.000'} [2024-08-06 03:35:47,924][52650] Updated weights for policy 0, policy_version 46981 (0.0020) [2024-08-06 03:35:49,889][52811] DAMAGECOUNT value on done: 400963.0 [2024-08-06 03:35:49,891][52811] Sum rewards: 71.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.191', 'weapon5': '0.264', 'AMMO4': '0.274', 'weapon2': '0.376', 'WEAPON5': '0.450', 'weapon4': '0.456', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.596', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:50,209][52803] DAMAGECOUNT value on done: 397230.0 [2024-08-06 03:35:50,211][52803] Sum rewards: 77.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.054', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.190', 'AMMO3': '0.194', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:50,655][52649] DAMAGECOUNT value on done: 412131.0 [2024-08-06 03:35:50,656][52649] Sum rewards: 71.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.794', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:51,000][52794] DAMAGECOUNT value on done: 431273.0 [2024-08-06 03:35:51,002][52794] Sum rewards: 67.764, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.048', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.040', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.280', 'weapon2': '0.494', 'WEAPON3': '1.650', 'weapon3': '3.198', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:51,508][52659] DAMAGECOUNT value on done: 428424.0 [2024-08-06 03:35:51,508][52659] Sum rewards: 81.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO4': '0.150', 'AMMO3': '0.211', 'weapon5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:51,859][52795] DAMAGECOUNT value on done: 396971.0 [2024-08-06 03:35:51,859][52795] Sum rewards: 63.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.815', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.228', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:52,577][52650] Updated weights for policy 0, policy_version 46991 (0.0012) [2024-08-06 03:35:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 384950272. Throughput: 0: 4398.2. Samples: 96241400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:35:52,802][52567] Avg episode reward: [(0, '71.214')] [2024-08-06 03:35:52,890][52811] DAMAGECOUNT value on done: 395000.0 [2024-08-06 03:35:52,890][52811] Sum rewards: 71.355, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.655', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.132', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.358', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:52,999][52671] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 03:35:53,369][52649] DAMAGECOUNT value on done: 418479.0 [2024-08-06 03:35:53,371][52649] Sum rewards: 61.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.118', 'AMMO3': '0.261', 'weapon2': '0.290', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.310', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '54.000'} [2024-08-06 03:35:53,449][52803] DAMAGECOUNT value on done: 396137.0 [2024-08-06 03:35:53,450][52803] Sum rewards: 68.360, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.349', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon5': '0.136', 'weapon4': '0.152', 'AMMO3': '0.264', 'AMMO4': '0.323', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.552', 'WEAPON3': '1.700', 'weapon3': '2.864', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '60.000'} [2024-08-06 03:35:53,735][52794] DAMAGECOUNT value on done: 427746.0 [2024-08-06 03:35:53,736][52794] Sum rewards: 73.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.118', 'weapon5': '0.148', 'AMMO3': '0.191', 'AMMO4': '0.231', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.500'} [2024-08-06 03:35:54,374][52659] DAMAGECOUNT value on done: 427810.0 [2024-08-06 03:35:54,376][52659] Sum rewards: 76.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '63.000'} [2024-08-06 03:35:55,089][52795] DAMAGECOUNT value on done: 387482.0 [2024-08-06 03:35:55,090][52795] Sum rewards: 80.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '67.000'} [2024-08-06 03:35:56,010][52649] DAMAGECOUNT value on done: 419468.0 [2024-08-06 03:35:56,010][52649] Sum rewards: 78.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.085', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.166', 'AMMO3': '0.291', 'WEAPON3': '1.850', 'weapon3': '3.498', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '69.000'} [2024-08-06 03:35:56,011][52811] DAMAGECOUNT value on done: 398297.0 [2024-08-06 03:35:56,015][52811] Sum rewards: 71.219, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.468', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.114', 'weapon4': '0.210', 'weapon2': '0.222', 'AMMO4': '0.231', 'AMMO3': '0.241', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:56,096][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:35:56,568][52803] DAMAGECOUNT value on done: 404125.0 [2024-08-06 03:35:56,571][52803] Sum rewards: 70.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.478', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.146', 'weapon4': '0.196', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 03:35:56,846][52794] DAMAGECOUNT value on done: 423312.0 [2024-08-06 03:35:56,846][52794] Sum rewards: 69.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.114', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '57.000'} [2024-08-06 03:35:57,200][52659] DAMAGECOUNT value on done: 430633.0 [2024-08-06 03:35:57,201][52659] Sum rewards: 63.226, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.386', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.218', 'weapon2': '0.234', 'weapon4': '0.256', 'AMMO4': '0.266', 'AMMO3': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '2.938', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '56.000'} [2024-08-06 03:35:57,216][52650] Updated weights for policy 0, policy_version 47001 (0.0013) [2024-08-06 03:35:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 385032192. Throughput: 0: 4396.0. Samples: 96267580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:35:57,794][52567] Avg episode reward: [(0, '71.292')] [2024-08-06 03:35:58,101][52795] DAMAGECOUNT value on done: 388574.0 [2024-08-06 03:35:58,104][52795] Sum rewards: 68.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.980', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.040', 'AMMO4': '0.149', 'weapon5': '0.154', 'weapon2': '0.216', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.310', 'weapon3': '3.360', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 03:35:59,140][52649] DAMAGECOUNT value on done: 413648.0 [2024-08-06 03:35:59,140][52649] Sum rewards: 75.341, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.250', 'AMMO3': '0.316', 'WEAPON3': '1.800', 'weapon3': '3.376', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '66.000'} [2024-08-06 03:35:59,152][52811] DAMAGECOUNT value on done: 398465.0 [2024-08-06 03:35:59,153][52811] Sum rewards: 75.532, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.118', 'weapon5': '0.122', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '64.000'} [2024-08-06 03:35:59,442][52794] DAMAGECOUNT value on done: 430852.0 [2024-08-06 03:35:59,443][52794] Sum rewards: 72.628, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.870', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.272', 'AMMO3': '0.275', 'WEAPON3': '1.550', 'weapon3': '3.340', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '62.000'} [2024-08-06 03:35:59,892][52803] DAMAGECOUNT value on done: 399666.0 [2024-08-06 03:35:59,892][52803] Sum rewards: 64.027, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.228', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.096', 'AMMO4': '0.193', 'weapon5': '0.214', 'AMMO3': '0.237', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.022', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:00,140][52659] DAMAGECOUNT value on done: 426176.0 [2024-08-06 03:36:00,142][52659] Sum rewards: 67.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.144', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.256', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:01,209][52795] DAMAGECOUNT value on done: 394162.0 [2024-08-06 03:36:01,210][52795] Sum rewards: 67.991, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.982', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.288', 'WEAPON3': '1.750', 'weapon3': '3.432', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:01,869][52650] Updated weights for policy 0, policy_version 47011 (0.0012) [2024-08-06 03:36:01,895][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:36:02,022][52670] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0), ('weapon5', 0.002)] [2024-08-06 03:36:02,147][52649] DAMAGECOUNT value on done: 419929.0 [2024-08-06 03:36:02,149][52649] Sum rewards: 87.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.495', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.090', 'AMMO4': '0.119', 'AMMO3': '0.164', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '70.000'} [2024-08-06 03:36:02,213][52811] DAMAGECOUNT value on done: 399126.0 [2024-08-06 03:36:02,216][52811] Sum rewards: 73.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.160', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:02,458][52794] DAMAGECOUNT value on done: 419155.0 [2024-08-06 03:36:02,460][52794] Sum rewards: 62.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.320', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.388', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.212', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '54.000'} [2024-08-06 03:36:02,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 385122304. Throughput: 0: 4399.3. Samples: 96280750. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:36:02,802][52567] Avg episode reward: [(0, '71.395')] [2024-08-06 03:36:02,856][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:36:03,008][52803] DAMAGECOUNT value on done: 400466.0 [2024-08-06 03:36:03,008][52803] Sum rewards: 74.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.165', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '3.278', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:03,051][52659] DAMAGECOUNT value on done: 425576.0 [2024-08-06 03:36:03,052][52659] Sum rewards: 58.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.254', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.524', 'DAMAGECOUNT': '14.448', 'FRAGCOUNT': '50.000'} [2024-08-06 03:36:04,341][52795] DAMAGECOUNT value on done: 389920.0 [2024-08-06 03:36:04,343][52795] Sum rewards: 73.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.325', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.082', 'AMMO4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.368', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.000'} [2024-08-06 03:36:05,167][52811] DAMAGECOUNT value on done: 398998.0 [2024-08-06 03:36:05,167][52811] Sum rewards: 78.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.198', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:05,402][52649] DAMAGECOUNT value on done: 421779.0 [2024-08-06 03:36:05,402][52649] Sum rewards: 76.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.130', 'weapon5': '0.140', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:05,411][52794] DAMAGECOUNT value on done: 438462.0 [2024-08-06 03:36:05,412][52794] Sum rewards: 66.580, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.405', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.122', 'AMMO4': '0.200', 'weapon2': '0.220', 'weapon5': '0.240', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '58.000'} [2024-08-06 03:36:05,706][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:36:05,716][52659] DAMAGECOUNT value on done: 427742.0 [2024-08-06 03:36:05,719][52659] Sum rewards: 60.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.308', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.243', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '52.000'} [2024-08-06 03:36:06,053][52803] DAMAGECOUNT value on done: 396620.0 [2024-08-06 03:36:06,055][52803] Sum rewards: 74.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.198', 'weapon5': '0.208', 'weapon2': '0.212', 'AMMO4': '0.224', 'weapon4': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '59.500'} [2024-08-06 03:36:06,674][52650] Updated weights for policy 0, policy_version 47021 (0.0022) [2024-08-06 03:36:07,489][52795] DAMAGECOUNT value on done: 397500.0 [2024-08-06 03:36:07,491][52795] Sum rewards: 67.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.118', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.156', 'AMMO3': '0.196', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.188', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 385204224. Throughput: 0: 4389.8. Samples: 96306830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:36:07,802][52567] Avg episode reward: [(0, '71.232')] [2024-08-06 03:36:08,527][52794] DAMAGECOUNT value on done: 421052.0 [2024-08-06 03:36:08,528][52794] Sum rewards: 71.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.244', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.076', 'weapon5': '0.154', 'AMMO4': '0.157', 'AMMO3': '0.235', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:08,529][52659] DAMAGECOUNT value on done: 427967.0 [2024-08-06 03:36:08,531][52659] Sum rewards: 56.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.072', 'weapon4': '0.160', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '3.208', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '50.000'} [2024-08-06 03:36:08,595][52649] DAMAGECOUNT value on done: 420810.0 [2024-08-06 03:36:08,595][52649] Sum rewards: 71.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.106', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.130', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '62.000'} [2024-08-06 03:36:10,698][52795] DAMAGECOUNT value on done: 403294.0 [2024-08-06 03:36:10,698][52795] Sum rewards: 84.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.837', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'weapon2': '0.256', 'AMMO3': '0.265', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.086', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.883', 'FRAGCOUNT': '70.000'} [2024-08-06 03:36:11,357][52650] Updated weights for policy 0, policy_version 47031 (0.0036) [2024-08-06 03:36:11,449][52794] DAMAGECOUNT value on done: 437742.0 [2024-08-06 03:36:11,451][52794] Sum rewards: 70.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.052', 'weapon5': '0.114', 'AMMO3': '0.210', 'AMMO4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '61.000'} [2024-08-06 03:36:11,698][52659] DAMAGECOUNT value on done: 425729.0 [2024-08-06 03:36:11,698][52659] Sum rewards: 71.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.285', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.128', 'AMMO4': '0.151', 'AMMO3': '0.187', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '58.000'} [2024-08-06 03:36:11,741][52649] DAMAGECOUNT value on done: 421921.0 [2024-08-06 03:36:11,741][52649] Sum rewards: 67.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.514', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.148', 'weapon4': '0.182', 'AMMO3': '0.226', 'AMMO4': '0.226', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '57.000'} [2024-08-06 03:36:11,776][52670] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:36:12,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 385294336. Throughput: 0: 4388.4. Samples: 96333250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:36:12,802][52567] Avg episode reward: [(0, '71.219')] [2024-08-06 03:36:13,793][52795] DAMAGECOUNT value on done: 398332.0 [2024-08-06 03:36:13,795][52795] Sum rewards: 68.101, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon5': '0.058', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.486', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.192', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:14,083][52794] DAMAGECOUNT value on done: 429076.0 [2024-08-06 03:36:14,084][52794] Sum rewards: 81.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.525', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.154', 'AMMO3': '0.209', 'AMMO4': '0.219', 'weapon2': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '67.000'} [2024-08-06 03:36:14,304][52659] DAMAGECOUNT value on done: 436678.0 [2024-08-06 03:36:14,305][52659] Sum rewards: 72.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.751', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.095', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '58.000'} [2024-08-06 03:36:14,924][52649] DAMAGECOUNT value on done: 411750.0 [2024-08-06 03:36:14,924][52649] Sum rewards: 66.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.301', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.134', 'weapon4': '0.162', 'weapon2': '0.210', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.276', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:16,089][52650] Updated weights for policy 0, policy_version 47041 (0.0012) [2024-08-06 03:36:16,745][52794] DAMAGECOUNT value on done: 431283.0 [2024-08-06 03:36:16,745][52794] Sum rewards: 78.539, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.704', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon5': '0.176', 'weapon4': '0.242', 'AMMO3': '0.286', 'weapon2': '0.304', 'AMMO4': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.896', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '68.000'} [2024-08-06 03:36:16,993][52795] DAMAGECOUNT value on done: 386421.0 [2024-08-06 03:36:16,993][52795] Sum rewards: 68.096, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.927', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.142', 'AMMO4': '0.189', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.656', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '54.000'} [2024-08-06 03:36:17,236][52659] DAMAGECOUNT value on done: 436550.0 [2024-08-06 03:36:17,236][52659] Sum rewards: 70.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.346', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.042', 'weapon5': '0.070', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.204', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '61.000'} [2024-08-06 03:36:17,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 385392640. Throughput: 0: 4384.7. Samples: 96346210. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:36:17,794][52567] Avg episode reward: [(0, '71.136')] [2024-08-06 03:36:18,113][52649] DAMAGECOUNT value on done: 420675.0 [2024-08-06 03:36:18,114][52649] Sum rewards: 80.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.415', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.082', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.226', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 03:36:19,244][52794] DAMAGECOUNT value on done: 435303.0 [2024-08-06 03:36:19,246][52794] Sum rewards: 73.155, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.694', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.148', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.290', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.700', 'weapon3': '2.912', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:20,079][52795] DAMAGECOUNT value on done: 401602.0 [2024-08-06 03:36:20,079][52795] Sum rewards: 78.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.114', 'weapon4': '0.160', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:20,433][52659] DAMAGECOUNT value on done: 428042.0 [2024-08-06 03:36:20,434][52659] Sum rewards: 72.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.906', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.046', 'AMMO4': '0.047', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:20,675][52650] Updated weights for policy 0, policy_version 47051 (0.0033) [2024-08-06 03:36:21,194][52649] DAMAGECOUNT value on done: 413922.0 [2024-08-06 03:36:21,196][52649] Sum rewards: 63.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.778', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.136', 'weapon5': '0.172', 'weapon2': '0.184', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.318', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '52.000'} [2024-08-06 03:36:21,767][52794] DAMAGECOUNT value on done: 427506.0 [2024-08-06 03:36:21,767][52794] Sum rewards: 76.548, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.707', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.104', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.402', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '62.000'} [2024-08-06 03:36:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 385474560. Throughput: 0: 4382.0. Samples: 96372530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:36:22,802][52567] Avg episode reward: [(0, '71.580')] [2024-08-06 03:36:22,803][52614] Saving new best policy, reward=71.580! [2024-08-06 03:36:23,159][52795] DAMAGECOUNT value on done: 393258.0 [2024-08-06 03:36:23,161][52795] Sum rewards: 80.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.748', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.078', 'weapon5': '0.190', 'AMMO3': '0.196', 'AMMO4': '0.217', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:23,467][52659] DAMAGECOUNT value on done: 430764.0 [2024-08-06 03:36:23,467][52659] Sum rewards: 60.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.974', 'AMMO5': '0.006', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.774', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '49.000'} [2024-08-06 03:36:23,775][52614] Signal inference workers to stop experience collection... (8500 times) [2024-08-06 03:36:23,776][52614] Signal inference workers to resume experience collection... (8500 times) [2024-08-06 03:36:23,839][52650] InferenceWorker_p0-w0: stopping experience collection (8500 times) [2024-08-06 03:36:23,849][52650] InferenceWorker_p0-w0: resuming experience collection (8500 times) [2024-08-06 03:36:23,905][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:36:24,212][52649] DAMAGECOUNT value on done: 422055.0 [2024-08-06 03:36:24,214][52649] Sum rewards: 62.212, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon2': '0.172', 'AMMO3': '0.175', 'weapon4': '0.210', 'AMMO4': '0.242', 'weapon5': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.018', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '50.000'} [2024-08-06 03:36:25,546][52650] Updated weights for policy 0, policy_version 47061 (0.0041) [2024-08-06 03:36:26,276][52662] Large shaping reward 2.551 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:36:26,360][52795] DAMAGECOUNT value on done: 394021.0 [2024-08-06 03:36:26,361][52795] Sum rewards: 67.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO4': '0.173', 'AMMO3': '0.186', 'weapon5': '0.224', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '54.500'} [2024-08-06 03:36:26,592][52659] DAMAGECOUNT value on done: 419749.0 [2024-08-06 03:36:26,593][52659] Sum rewards: 72.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:26,594][52649] DAMAGECOUNT value on done: 424254.0 [2024-08-06 03:36:26,596][52649] Sum rewards: 67.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.186', 'AMMO3': '0.218', 'AMMO4': '0.227', 'weapon2': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:26,761][52666] DAMAGECOUNT value on done: 424993.0 [2024-08-06 03:36:26,762][52666] Sum rewards: 61.567, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.144', 'weapon5': '0.156', 'weapon7': '0.166', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.340', 'HEALTH': '0.406', 'weapon4': '0.410', 'WEAPON3': '0.950', 'weapon3': '2.682', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '48.500'} [2024-08-06 03:36:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 385556480. Throughput: 0: 4375.3. Samples: 96398410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:36:27,794][52567] Avg episode reward: [(0, '71.436')] [2024-08-06 03:36:27,801][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047066_385564672.pth... [2024-08-06 03:36:27,911][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046553_381362176.pth [2024-08-06 03:36:29,491][52659] DAMAGECOUNT value on done: 428016.0 [2024-08-06 03:36:29,493][52659] Sum rewards: 69.853, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '58.000'} [2024-08-06 03:36:29,507][52649] DAMAGECOUNT value on done: 417789.0 [2024-08-06 03:36:29,509][52649] Sum rewards: 74.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.016', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.099', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '63.000'} [2024-08-06 03:36:29,649][52666] DAMAGECOUNT value on done: 432917.0 [2024-08-06 03:36:29,651][52666] Sum rewards: 69.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.306', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon2': '0.190', 'weapon5': '0.202', 'weapon4': '0.224', 'AMMO3': '0.236', 'AMMO4': '0.249', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:29,655][52795] DAMAGECOUNT value on done: 388979.0 [2024-08-06 03:36:29,656][52795] Sum rewards: 64.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.570', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.226', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '54.000'} [2024-08-06 03:36:29,987][52670] DAMAGECOUNT value on done: 419486.0 [2024-08-06 03:36:29,989][52670] Sum rewards: 63.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.292', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.042', 'weapon4': '0.102', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.246', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.392', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '55.500'} [2024-08-06 03:36:30,143][52650] Updated weights for policy 0, policy_version 47071 (0.0017) [2024-08-06 03:36:32,221][52666] DAMAGECOUNT value on done: 430358.0 [2024-08-06 03:36:32,222][52666] Sum rewards: 61.197, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.360', 'AMMO5': '0.029', 'AMMO2': '0.098', 'weapon4': '0.256', 'AMMO3': '0.292', 'weapon2': '0.334', 'weapon5': '0.346', 'AMMO4': '0.492', 'WEAPON5': '0.900', 'WEAPON4': '0.950', 'WEAPON3': '1.700', 'weapon3': '2.690', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '55.000'} [2024-08-06 03:36:32,332][52659] DAMAGECOUNT value on done: 438027.0 [2024-08-06 03:36:32,333][52659] Sum rewards: 73.056, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.035', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon7': '0.048', 'weapon5': '0.090', 'weapon4': '0.132', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '62.500'} [2024-08-06 03:36:32,693][52795] DAMAGECOUNT value on done: 397977.0 [2024-08-06 03:36:32,695][52795] Sum rewards: 72.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.092', 'weapon5': '0.132', 'AMMO4': '0.219', 'AMMO3': '0.236', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.206', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '62.500'} [2024-08-06 03:36:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 385646592. Throughput: 0: 4366.0. Samples: 96411370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:36:32,794][52567] Avg episode reward: [(0, '71.337')] [2024-08-06 03:36:32,812][52670] DAMAGECOUNT value on done: 429128.0 [2024-08-06 03:36:32,815][52670] Sum rewards: 69.697, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.138', 'AMMO3': '0.163', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '0.900', 'HEALTH': '0.992', 'weapon3': '3.186', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:34,041][52668] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:36:34,348][52663] DAMAGECOUNT value on done: 432745.0 [2024-08-06 03:36:34,349][52663] Sum rewards: 71.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.445', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.110', 'weapon4': '0.126', 'AMMO4': '0.154', 'AMMO3': '0.179', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.350', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '57.000'} [2024-08-06 03:36:34,727][52659] DAMAGECOUNT value on done: 434434.0 [2024-08-06 03:36:34,729][52659] Sum rewards: 84.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.030', 'AMMO4': '0.041', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '69.000'} [2024-08-06 03:36:34,905][52650] Updated weights for policy 0, policy_version 47081 (0.0012) [2024-08-06 03:36:35,299][52666] DAMAGECOUNT value on done: 428466.0 [2024-08-06 03:36:35,300][52666] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.035', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.205', 'AMMO4': '0.205', 'weapon5': '0.252', 'weapon4': '0.286', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:35,780][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:36:35,866][52670] DAMAGECOUNT value on done: 421214.0 [2024-08-06 03:36:35,869][52670] Sum rewards: 77.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:35,927][52795] DAMAGECOUNT value on done: 387330.0 [2024-08-06 03:36:35,927][52795] Sum rewards: 58.885, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.875', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.177', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.448', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '2.630', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '53.000'} [2024-08-06 03:36:37,038][52663] DAMAGECOUNT value on done: 428046.0 [2024-08-06 03:36:37,038][52663] Sum rewards: 72.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.176', 'weapon4': '0.212', 'AMMO3': '0.242', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.034', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '62.000'} [2024-08-06 03:36:37,596][52659] DAMAGECOUNT value on done: 434715.0 [2024-08-06 03:36:37,597][52659] Sum rewards: 71.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO3': '0.164', 'AMMO4': '0.213', 'weapon4': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '2.916', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '57.000'} [2024-08-06 03:36:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 385728512. Throughput: 0: 4362.0. Samples: 96437690. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:36:37,794][52567] Avg episode reward: [(0, '71.130')] [2024-08-06 03:36:38,009][52666] DAMAGECOUNT value on done: 429832.0 [2024-08-06 03:36:38,011][52666] Sum rewards: 68.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.754', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.136', 'AMMO4': '0.173', 'weapon2': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.342', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:38,438][52670] DAMAGECOUNT value on done: 419098.0 [2024-08-06 03:36:38,440][52670] Sum rewards: 67.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.346', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.138', 'weapon5': '0.176', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:38,888][52820] DAMAGECOUNT value on done: 392195.0 [2024-08-06 03:36:38,892][52820] Sum rewards: 76.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO5': '0.009', 'weapon4': '0.034', 'AMMO2': '0.040', 'weapon5': '0.094', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon2': '0.380', 'WEAPON3': '1.050', 'HITCOUNT': '3.320', 'weapon3': '3.334', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '61.000'} [2024-08-06 03:36:39,071][52795] DAMAGECOUNT value on done: 404601.0 [2024-08-06 03:36:39,079][52795] Sum rewards: 58.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.106', 'weapon5': '0.210', 'AMMO4': '0.232', 'AMMO3': '0.279', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.600', 'HITCOUNT': '2.730', 'weapon3': '2.966', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '52.000'} [2024-08-06 03:36:39,521][52650] Updated weights for policy 0, policy_version 47091 (0.0018) [2024-08-06 03:36:39,728][52663] DAMAGECOUNT value on done: 421876.0 [2024-08-06 03:36:39,730][52663] Sum rewards: 72.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.332', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '61.000'} [2024-08-06 03:36:40,597][52666] DAMAGECOUNT value on done: 420092.0 [2024-08-06 03:36:40,598][52666] Sum rewards: 64.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.113', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '53.000'} [2024-08-06 03:36:40,702][52659] DAMAGECOUNT value on done: 426401.0 [2024-08-06 03:36:40,703][52659] Sum rewards: 74.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.917', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.183', 'weapon4': '0.188', 'weapon5': '0.296', 'AMMO4': '0.327', 'weapon2': '0.608', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:41,188][52670] DAMAGECOUNT value on done: 431104.0 [2024-08-06 03:36:41,189][52670] Sum rewards: 75.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.090', 'weapon5': '0.182', 'AMMO4': '0.201', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '63.000'} [2024-08-06 03:36:41,992][52795] DAMAGECOUNT value on done: 398385.0 [2024-08-06 03:36:41,992][52795] Sum rewards: 70.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.044', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:42,044][52820] DAMAGECOUNT value on done: 395747.0 [2024-08-06 03:36:42,045][52820] Sum rewards: 56.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.086', 'weapon4': '0.198', 'AMMO3': '0.211', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.072', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '49.000'} [2024-08-06 03:36:42,211][52663] DAMAGECOUNT value on done: 428280.0 [2024-08-06 03:36:42,211][52663] Sum rewards: 69.425, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.475', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.346', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 385826816. Throughput: 0: 4371.3. Samples: 96464290. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:36:42,794][52567] Avg episode reward: [(0, '70.788')] [2024-08-06 03:36:43,668][52647] Large shaping reward 2.543 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.08700000000000001, -29.0)] [2024-08-06 03:36:43,788][52666] DAMAGECOUNT value on done: 428858.0 [2024-08-06 03:36:43,789][52666] Sum rewards: 69.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:43,825][52659] DAMAGECOUNT value on done: 431954.0 [2024-08-06 03:36:43,827][52659] Sum rewards: 68.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.049', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.356', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.308', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '56.000'} [2024-08-06 03:36:44,008][52650] Updated weights for policy 0, policy_version 47101 (0.0028) [2024-08-06 03:36:44,402][52670] DAMAGECOUNT value on done: 423665.0 [2024-08-06 03:36:44,414][52670] Sum rewards: 72.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.262', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.084', 'AMMO3': '0.184', 'weapon5': '0.204', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:45,005][52663] DAMAGECOUNT value on done: 426087.0 [2024-08-06 03:36:45,005][52663] Sum rewards: 81.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.634', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.118', 'AMMO4': '0.161', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '67.000'} [2024-08-06 03:36:45,085][52795] DAMAGECOUNT value on done: 388941.0 [2024-08-06 03:36:45,086][52795] Sum rewards: 58.457, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.874', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.204', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.718', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '47.000'} [2024-08-06 03:36:45,159][52820] DAMAGECOUNT value on done: 397158.0 [2024-08-06 03:36:45,159][52820] Sum rewards: 70.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.107', 'weapon5': '0.110', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '61.000'} [2024-08-06 03:36:46,621][52659] DAMAGECOUNT value on done: 430273.0 [2024-08-06 03:36:46,622][52659] Sum rewards: 59.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.191', 'weapon5': '0.224', 'weapon2': '0.306', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.710', 'weapon3': '2.800', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '49.000'} [2024-08-06 03:36:46,742][52666] DAMAGECOUNT value on done: 426507.0 [2024-08-06 03:36:46,742][52666] Sum rewards: 67.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.021', 'AMMO2': '0.055', 'AMMO3': '0.141', 'weapon4': '0.200', 'AMMO4': '0.273', 'weapon5': '0.296', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.756', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '55.000'} [2024-08-06 03:36:47,225][52670] DAMAGECOUNT value on done: 417471.0 [2024-08-06 03:36:47,227][52670] Sum rewards: 71.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.160', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '58.000'} [2024-08-06 03:36:47,541][52663] DAMAGECOUNT value on done: 430408.0 [2024-08-06 03:36:47,541][52663] Sum rewards: 73.621, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.166', 'AMMO3': '0.173', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '58.000'} [2024-08-06 03:36:47,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 385908736. Throughput: 0: 4366.9. Samples: 96477260. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:36:47,798][52567] Avg episode reward: [(0, '70.543')] [2024-08-06 03:36:48,040][52664] DAMAGECOUNT value on done: 444206.0 [2024-08-06 03:36:48,040][52664] Sum rewards: 70.542, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.640', 'AMMO5': '0.025', 'AMMO2': '0.066', 'weapon4': '0.214', 'AMMO3': '0.219', 'weapon5': '0.240', 'AMMO4': '0.329', 'weapon2': '0.382', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.000'} [2024-08-06 03:36:48,179][52820] DAMAGECOUNT value on done: 391336.0 [2024-08-06 03:36:48,179][52820] Sum rewards: 64.075, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.202', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.126', 'weapon5': '0.172', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON3': '1.600', 'HITCOUNT': '3.030', 'weapon3': '3.224', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '57.000'} [2024-08-06 03:36:48,208][52795] DAMAGECOUNT value on done: 396016.0 [2024-08-06 03:36:48,208][52795] Sum rewards: 77.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.091', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.386', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:48,895][52650] Updated weights for policy 0, policy_version 47111 (0.0024) [2024-08-06 03:36:49,373][52666] DAMAGECOUNT value on done: 423373.0 [2024-08-06 03:36:49,375][52666] Sum rewards: 85.903, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.717', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.052', 'AMMO3': '0.129', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.452', 'weapon5': '0.506', 'WEAPON3': '0.950', 'weapon3': '2.812', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '67.000'} [2024-08-06 03:36:49,960][52670] DAMAGECOUNT value on done: 422070.0 [2024-08-06 03:36:49,970][52670] Sum rewards: 76.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.086', 'AMMO4': '0.194', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '62.000'} [2024-08-06 03:36:50,339][52663] DAMAGECOUNT value on done: 429358.0 [2024-08-06 03:36:50,339][52663] Sum rewards: 66.676, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.668', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.216', 'AMMO3': '0.351', 'WEAPON3': '2.100', 'weapon3': '3.408', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 03:36:51,051][52664] DAMAGECOUNT value on done: 449105.0 [2024-08-06 03:36:51,052][52664] Sum rewards: 65.847, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.760', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.132', 'weapon5': '0.150', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'AMMO3': '0.313', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.900', 'weapon3': '2.986', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '61.000'} [2024-08-06 03:36:51,265][52820] DAMAGECOUNT value on done: 399101.0 [2024-08-06 03:36:51,268][52820] Sum rewards: 63.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.078', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.204', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '53.000'} [2024-08-06 03:36:51,382][52795] DAMAGECOUNT value on done: 402175.0 [2024-08-06 03:36:51,383][52795] Sum rewards: 53.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.575', 'AMMO5': '0.005', 'weapon7': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.068', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '45.000'} [2024-08-06 03:36:52,237][52666] DAMAGECOUNT value on done: 418844.0 [2024-08-06 03:36:52,238][52666] Sum rewards: 66.182, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.370', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.140', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'weapon2': '0.406', 'WEAPON3': '1.700', 'weapon3': '3.052', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '59.000'} [2024-08-06 03:36:52,743][52670] DAMAGECOUNT value on done: 423757.0 [2024-08-06 03:36:52,744][52670] Sum rewards: 78.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.182', 'weapon5': '0.196', 'AMMO4': '0.228', 'weapon4': '0.288', 'weapon2': '0.326', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '63.000'} [2024-08-06 03:36:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 385998848. Throughput: 0: 4378.7. Samples: 96503870. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:36:52,795][52567] Avg episode reward: [(0, '70.363')] [2024-08-06 03:36:53,343][52650] Updated weights for policy 0, policy_version 47121 (0.0021) [2024-08-06 03:36:53,452][52663] DAMAGECOUNT value on done: 423609.0 [2024-08-06 03:36:53,453][52663] Sum rewards: 78.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.223', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.526', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '65.000'} [2024-08-06 03:36:53,794][52664] DAMAGECOUNT value on done: 449872.0 [2024-08-06 03:36:53,795][52664] Sum rewards: 73.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.248', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.098', 'weapon5': '0.140', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '62.000'} [2024-08-06 03:36:54,444][52820] DAMAGECOUNT value on done: 390460.0 [2024-08-06 03:36:54,445][52820] Sum rewards: 71.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:54,523][52666] DAMAGECOUNT value on done: 423479.0 [2024-08-06 03:36:54,525][52666] Sum rewards: 57.812, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.678', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.082', 'weapon5': '0.186', 'AMMO3': '0.251', 'AMMO4': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.142', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '50.500'} [2024-08-06 03:36:55,295][52670] DAMAGECOUNT value on done: 419615.0 [2024-08-06 03:36:55,303][52670] Sum rewards: 78.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.108', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '64.000'} [2024-08-06 03:36:56,631][52663] DAMAGECOUNT value on done: 423098.0 [2024-08-06 03:36:56,631][52663] Sum rewards: 57.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.174', 'AMMO5': '0.014', 'AMMO2': '0.067', 'weapon5': '0.210', 'AMMO3': '0.253', 'AMMO4': '0.334', 'weapon2': '0.376', 'weapon4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.704', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '50.000'} [2024-08-06 03:36:56,966][52664] DAMAGECOUNT value on done: 443649.0 [2024-08-06 03:36:56,967][52664] Sum rewards: 71.574, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'weapon5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '58.500'} [2024-08-06 03:36:57,462][52820] DAMAGECOUNT value on done: 393605.0 [2024-08-06 03:36:57,463][52820] Sum rewards: 73.870, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.084', 'weapon4': '0.158', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '60.000'} [2024-08-06 03:36:57,623][52666] DAMAGECOUNT value on done: 422546.0 [2024-08-06 03:36:57,623][52666] Sum rewards: 78.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.854', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.040', 'AMMO4': '0.122', 'weapon5': '0.134', 'weapon2': '0.164', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '66.000'} [2024-08-06 03:36:57,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 386080768. Throughput: 0: 4380.7. Samples: 96530380. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:36:57,794][52567] Avg episode reward: [(0, '70.250')] [2024-08-06 03:36:58,174][52650] Updated weights for policy 0, policy_version 47131 (0.0020) [2024-08-06 03:36:58,253][52670] DAMAGECOUNT value on done: 428029.0 [2024-08-06 03:36:58,253][52670] Sum rewards: 81.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.247', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.156', 'weapon5': '0.170', 'weapon2': '0.214', 'AMMO3': '0.234', 'AMMO4': '0.259', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '67.000'} [2024-08-06 03:36:59,898][52663] DAMAGECOUNT value on done: 429727.0 [2024-08-06 03:36:59,898][52663] Sum rewards: 67.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.205', 'AMMO5': '0.021', 'AMMO2': '0.072', 'weapon2': '0.224', 'AMMO3': '0.244', 'weapon4': '0.258', 'weapon5': '0.288', 'AMMO4': '0.361', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '57.000'} [2024-08-06 03:37:00,023][52666] DAMAGECOUNT value on done: 431937.0 [2024-08-06 03:37:00,023][52666] Sum rewards: 70.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.882', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.154', 'weapon5': '0.172', 'weapon4': '0.242', 'AMMO4': '0.257', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '55.500'} [2024-08-06 03:37:00,143][52664] DAMAGECOUNT value on done: 446552.0 [2024-08-06 03:37:00,145][52664] Sum rewards: 73.214, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.848', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.084', 'AMMO4': '0.189', 'weapon2': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:00,529][52820] DAMAGECOUNT value on done: 398741.0 [2024-08-06 03:37:00,529][52820] Sum rewards: 59.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.062', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.215', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.176', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '52.000'} [2024-08-06 03:37:00,806][52670] DAMAGECOUNT value on done: 419952.0 [2024-08-06 03:37:00,806][52670] Sum rewards: 67.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.130', 'weapon5': '0.130', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.254', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '56.000'} [2024-08-06 03:37:02,744][52650] Updated weights for policy 0, policy_version 47141 (0.0012) [2024-08-06 03:37:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 386179072. Throughput: 0: 4378.0. Samples: 96543220. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 03:37:02,794][52567] Avg episode reward: [(0, '70.120')] [2024-08-06 03:37:02,823][52664] DAMAGECOUNT value on done: 444002.0 [2024-08-06 03:37:02,824][52664] Sum rewards: 79.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.096', 'weapon4': '0.106', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.420', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:02,911][52663] DAMAGECOUNT value on done: 435120.0 [2024-08-06 03:37:02,912][52663] Sum rewards: 78.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.106', 'AMMO4': '0.193', 'weapon5': '0.214', 'AMMO3': '0.267', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.048', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '67.000'} [2024-08-06 03:37:02,942][52666] DAMAGECOUNT value on done: 428485.0 [2024-08-06 03:37:02,943][52666] Sum rewards: 64.249, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.162', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.164', 'AMMO3': '0.270', 'weapon2': '0.320', 'weapon4': '0.370', 'WEAPON3': '1.550', 'weapon3': '2.812', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '57.000'} [2024-08-06 03:37:03,683][52820] DAMAGECOUNT value on done: 394986.0 [2024-08-06 03:37:03,685][52820] Sum rewards: 81.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.100', 'weapon4': '0.162', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '67.000'} [2024-08-06 03:37:03,902][52670] DAMAGECOUNT value on done: 421411.0 [2024-08-06 03:37:03,902][52670] Sum rewards: 68.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.828', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.239', 'weapon5': '0.250', 'weapon4': '0.290', 'AMMO4': '0.312', 'weapon2': '0.546', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.596', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '56.000'} [2024-08-06 03:37:05,110][52664] DAMAGECOUNT value on done: 445280.0 [2024-08-06 03:37:05,111][52664] Sum rewards: 73.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:05,354][52663] DAMAGECOUNT value on done: 427258.0 [2024-08-06 03:37:05,354][52663] Sum rewards: 76.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.419', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.143', 'weapon2': '0.234', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.388', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '66.000'} [2024-08-06 03:37:05,922][52666] DAMAGECOUNT value on done: 424783.0 [2024-08-06 03:37:05,930][52666] Sum rewards: 77.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.845', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.106', 'weapon4': '0.112', 'weapon2': '0.184', 'AMMO3': '0.211', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '66.000'} [2024-08-06 03:37:06,181][52647] DAMAGECOUNT value on done: 452387.0 [2024-08-06 03:37:06,181][52647] Sum rewards: 71.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.879', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.165', 'weapon4': '0.208', 'AMMO4': '0.226', 'weapon5': '0.252', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 03:37:06,464][52670] DAMAGECOUNT value on done: 432473.0 [2024-08-06 03:37:06,467][52670] Sum rewards: 63.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.210', 'AMMO4': '0.254', 'weapon5': '0.258', 'weapon4': '0.330', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '53.000'} [2024-08-06 03:37:06,813][52820] DAMAGECOUNT value on done: 402732.0 [2024-08-06 03:37:06,813][52820] Sum rewards: 79.350, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.136', 'weapon4': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 386260992. Throughput: 0: 4374.0. Samples: 96569360. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:37:07,794][52567] Avg episode reward: [(0, '70.774')] [2024-08-06 03:37:07,800][52650] Updated weights for policy 0, policy_version 47151 (0.0036) [2024-08-06 03:37:08,049][52663] DAMAGECOUNT value on done: 423088.0 [2024-08-06 03:37:08,049][52663] Sum rewards: 79.866, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.050', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO3': '0.146', 'AMMO4': '0.172', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '0.900', 'weapon3': '3.154', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:08,054][52664] DAMAGECOUNT value on done: 437780.0 [2024-08-06 03:37:08,054][52664] Sum rewards: 84.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.091', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '70.000'} [2024-08-06 03:37:08,262][52666] DAMAGECOUNT value on done: 425376.0 [2024-08-06 03:37:08,262][52666] Sum rewards: 65.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.196', 'AMMO4': '0.220', 'AMMO3': '0.280', 'weapon5': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '2.822', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '56.000'} [2024-08-06 03:37:08,313][52667] DAMAGECOUNT value on done: 424817.0 [2024-08-06 03:37:08,313][52667] Sum rewards: 61.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.126', 'AMMO3': '0.226', 'AMMO4': '0.235', 'weapon4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '52.000'} [2024-08-06 03:37:09,053][52670] DAMAGECOUNT value on done: 426028.0 [2024-08-06 03:37:09,053][52670] Sum rewards: 53.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.961', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon4': '0.214', 'weapon5': '0.242', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.500', 'weapon3': '2.676', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '47.000'} [2024-08-06 03:37:09,068][52647] DAMAGECOUNT value on done: 452605.0 [2024-08-06 03:37:09,070][52647] Sum rewards: 70.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.130', 'weapon5': '0.188', 'AMMO4': '0.211', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '59.000'} [2024-08-06 03:37:09,899][52820] DAMAGECOUNT value on done: 393780.0 [2024-08-06 03:37:09,901][52820] Sum rewards: 61.476, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.680', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.088', 'weapon5': '0.092', 'AMMO4': '0.139', 'weapon2': '0.220', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.300', 'weapon3': '3.322', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:10,078][52658] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('weapon5', 0.002)] [2024-08-06 03:37:10,458][52663] DAMAGECOUNT value on done: 421631.0 [2024-08-06 03:37:10,459][52663] Sum rewards: 81.298, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'weapon2': '0.686', 'WEAPON3': '1.000', 'weapon3': '3.098', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:10,509][52664] DAMAGECOUNT value on done: 449655.0 [2024-08-06 03:37:10,511][52664] Sum rewards: 71.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon4': '0.182', 'weapon2': '0.434', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.152', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '59.000'} [2024-08-06 03:37:11,227][52666] DAMAGECOUNT value on done: 425794.0 [2024-08-06 03:37:11,235][52666] Sum rewards: 74.896, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.152', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.114', 'weapon5': '0.176', 'AMMO4': '0.231', 'AMMO3': '0.238', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:11,431][52667] DAMAGECOUNT value on done: 435418.0 [2024-08-06 03:37:11,431][52667] Sum rewards: 73.483, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.201', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon4': '0.094', 'AMMO3': '0.232', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 03:37:11,626][52647] DAMAGECOUNT value on done: 451628.0 [2024-08-06 03:37:11,626][52647] Sum rewards: 84.551, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.052', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '67.000'} [2024-08-06 03:37:11,738][52670] DAMAGECOUNT value on done: 411767.0 [2024-08-06 03:37:11,740][52670] Sum rewards: 65.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.695', 'AMMO5': '0.024', 'AMMO2': '0.062', 'AMMO3': '0.194', 'weapon2': '0.194', 'weapon5': '0.296', 'AMMO4': '0.308', 'weapon4': '0.334', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:12,462][52650] Updated weights for policy 0, policy_version 47161 (0.0022) [2024-08-06 03:37:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 386351104. Throughput: 0: 4376.4. Samples: 96595350. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:37:12,794][52567] Avg episode reward: [(0, '70.646')] [2024-08-06 03:37:13,236][52820] DAMAGECOUNT value on done: 398116.0 [2024-08-06 03:37:13,236][52820] Sum rewards: 67.931, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.068', 'weapon5': '0.174', 'AMMO4': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.311', 'weapon2': '0.388', 'WEAPON3': '1.700', 'weapon3': '3.092', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '59.000'} [2024-08-06 03:37:13,404][52663] DAMAGECOUNT value on done: 422797.0 [2024-08-06 03:37:13,405][52663] Sum rewards: 67.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon4': '0.230', 'weapon2': '0.374', 'WEAPON3': '1.000', 'weapon3': '3.156', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '53.000'} [2024-08-06 03:37:13,611][52664] DAMAGECOUNT value on done: 440878.0 [2024-08-06 03:37:13,611][52664] Sum rewards: 73.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.546', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.042', 'AMMO4': '0.062', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.398', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:13,702][52666] DAMAGECOUNT value on done: 427309.0 [2024-08-06 03:37:13,702][52666] Sum rewards: 80.093, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.256', 'WEAPON3': '1.200', 'HITCOUNT': '3.470', 'weapon3': '3.538', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '66.000'} [2024-08-06 03:37:14,498][52670] DAMAGECOUNT value on done: 424159.0 [2024-08-06 03:37:14,499][52670] Sum rewards: 75.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.446', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.068', 'AMMO4': '0.148', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '62.000'} [2024-08-06 03:37:14,741][52667] DAMAGECOUNT value on done: 427618.0 [2024-08-06 03:37:14,742][52667] Sum rewards: 80.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.104', 'weapon4': '0.136', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:14,774][52647] DAMAGECOUNT value on done: 460222.0 [2024-08-06 03:37:14,775][52647] Sum rewards: 65.634, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.071', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.328', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.312', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '58.000'} [2024-08-06 03:37:15,460][52664] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:37:16,296][52664] DAMAGECOUNT value on done: 451843.0 [2024-08-06 03:37:16,297][52664] Sum rewards: 73.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.270', 'weapon4': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '61.000'} [2024-08-06 03:37:16,430][52663] DAMAGECOUNT value on done: 432552.0 [2024-08-06 03:37:16,431][52663] Sum rewards: 56.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.313', 'AMMO5': '0.014', 'AMMO2': '0.051', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'AMMO3': '0.150', 'WEAPON7': '0.200', 'AMMO4': '0.256', 'weapon7': '0.266', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.574', 'WEAPON3': '0.900', 'weapon3': '2.342', 'HITCOUNT': '2.480', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '47.000'} [2024-08-06 03:37:16,449][52820] DAMAGECOUNT value on done: 401682.0 [2024-08-06 03:37:16,451][52820] Sum rewards: 81.290, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.162', 'AMMO4': '0.163', 'AMMO3': '0.187', 'HEALTH': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.330', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.674', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:16,884][52666] DAMAGECOUNT value on done: 417018.0 [2024-08-06 03:37:16,884][52666] Sum rewards: 69.841, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.106', 'AMMO4': '0.228', 'weapon5': '0.246', 'AMMO3': '0.271', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.004', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.500'} [2024-08-06 03:37:16,940][52650] Updated weights for policy 0, policy_version 47171 (0.0025) [2024-08-06 03:37:17,513][52647] DAMAGECOUNT value on done: 457776.0 [2024-08-06 03:37:17,513][52647] Sum rewards: 74.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.125', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon4': '0.042', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.298', 'weapon2': '0.324', 'WEAPON3': '1.900', 'weapon3': '3.362', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '65.000'} [2024-08-06 03:37:17,647][52670] DAMAGECOUNT value on done: 432853.0 [2024-08-06 03:37:17,647][52670] Sum rewards: 73.910, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.840', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.169', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:17,763][52667] DAMAGECOUNT value on done: 429392.0 [2024-08-06 03:37:17,763][52667] Sum rewards: 72.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.564', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO4': '0.149', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 386441216. Throughput: 0: 4380.0. Samples: 96608470. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:37:17,794][52567] Avg episode reward: [(0, '70.908')] [2024-08-06 03:37:19,133][52664] DAMAGECOUNT value on done: 446705.0 [2024-08-06 03:37:19,134][52664] Sum rewards: 71.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.404', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.066', 'AMMO4': '0.200', 'weapon5': '0.222', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:19,510][52663] DAMAGECOUNT value on done: 424914.0 [2024-08-06 03:37:19,510][52663] Sum rewards: 73.639, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.095', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.374', 'weapon4': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.474', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '59.500'} [2024-08-06 03:37:19,532][52666] DAMAGECOUNT value on done: 425176.0 [2024-08-06 03:37:19,532][52666] Sum rewards: 58.318, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.720', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.136', 'AMMO4': '0.166', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.698', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.920', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '47.000'} [2024-08-06 03:37:19,547][52820] DAMAGECOUNT value on done: 397083.0 [2024-08-06 03:37:19,547][52820] Sum rewards: 63.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.174', 'AMMO4': '0.197', 'weapon4': '0.234', 'AMMO3': '0.242', 'weapon2': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '53.000'} [2024-08-06 03:37:19,984][52647] DAMAGECOUNT value on done: 454144.0 [2024-08-06 03:37:19,987][52647] Sum rewards: 66.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.992', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.154', 'AMMO3': '0.250', 'AMMO4': '0.254', 'weapon2': '0.304', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 03:37:20,178][52670] DAMAGECOUNT value on done: 423570.0 [2024-08-06 03:37:20,180][52670] Sum rewards: 64.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.946', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'weapon4': '0.088', 'AMMO4': '0.101', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.464', 'WEAPON3': '0.950', 'HITCOUNT': '2.980', 'weapon3': '3.274', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '51.000'} [2024-08-06 03:37:20,385][52667] DAMAGECOUNT value on done: 435383.0 [2024-08-06 03:37:20,388][52667] Sum rewards: 75.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.065', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.134', 'weapon5': '0.136', 'AMMO4': '0.222', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.600', 'weapon3': '2.920', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:21,517][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:37:21,529][52664] DAMAGECOUNT value on done: 454854.0 [2024-08-06 03:37:21,529][52664] Sum rewards: 79.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.375', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.097', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.366', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:21,857][52650] Updated weights for policy 0, policy_version 47181 (0.0019) [2024-08-06 03:37:22,370][52647] DAMAGECOUNT value on done: 454171.0 [2024-08-06 03:37:22,370][52647] Sum rewards: 64.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.402', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.238', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:22,621][52663] DAMAGECOUNT value on done: 430286.0 [2024-08-06 03:37:22,621][52663] Sum rewards: 72.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.544', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.178', 'AMMO3': '0.280', 'WEAPON3': '1.650', 'weapon3': '3.546', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 03:37:22,744][52820] DAMAGECOUNT value on done: 403322.0 [2024-08-06 03:37:22,746][52820] Sum rewards: 71.055, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.432', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.114', 'weapon4': '0.194', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.000', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:22,796][52567] Fps is (10 sec: 17200.4, 60 sec: 17475.8, 300 sec: 17494.7). Total num frames: 386523136. Throughput: 0: 4382.5. Samples: 96634910. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:37:22,796][52567] Avg episode reward: [(0, '70.743')] [2024-08-06 03:37:22,883][52667] DAMAGECOUNT value on done: 436083.0 [2024-08-06 03:37:22,884][52667] Sum rewards: 70.102, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.075', 'AMMO5': '0.012', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.030', 'weapon5': '0.056', 'AMMO4': '0.100', 'weapon2': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.480', 'weapon3': '3.548', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:23,249][52670] DAMAGECOUNT value on done: 426730.0 [2024-08-06 03:37:23,252][52670] Sum rewards: 68.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.302', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.072', 'weapon5': '0.154', 'AMMO4': '0.189', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.678', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:24,496][52664] DAMAGECOUNT value on done: 448418.0 [2024-08-06 03:37:24,497][52664] Sum rewards: 75.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.116', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.144', 'weapon5': '0.152', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:25,435][52647] DAMAGECOUNT value on done: 447545.0 [2024-08-06 03:37:25,435][52647] Sum rewards: 81.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.122', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '66.000'} [2024-08-06 03:37:25,486][52663] DAMAGECOUNT value on done: 429120.0 [2024-08-06 03:37:25,486][52663] Sum rewards: 63.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.094', 'weapon5': '0.132', 'AMMO4': '0.194', 'AMMO3': '0.234', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.318', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '54.000'} [2024-08-06 03:37:25,766][52820] DAMAGECOUNT value on done: 396648.0 [2024-08-06 03:37:25,768][52820] Sum rewards: 74.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.256', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'weapon4': '0.160', 'AMMO3': '0.256', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '62.000'} [2024-08-06 03:37:26,094][52667] DAMAGECOUNT value on done: 432166.0 [2024-08-06 03:37:26,094][52667] Sum rewards: 58.537, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon4': '0.330', 'weapon2': '0.516', 'WEAPON3': '1.500', 'weapon3': '2.690', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '53.000'} [2024-08-06 03:37:26,392][52650] Updated weights for policy 0, policy_version 47191 (0.0011) [2024-08-06 03:37:27,699][52664] DAMAGECOUNT value on done: 450984.0 [2024-08-06 03:37:27,700][52664] Sum rewards: 58.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.580', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO3': '0.182', 'AMMO4': '0.182', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.408', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '49.000'} [2024-08-06 03:37:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 386613248. Throughput: 0: 4369.1. Samples: 96660900. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:37:27,795][52567] Avg episode reward: [(0, '70.741')] [2024-08-06 03:37:28,597][52647] DAMAGECOUNT value on done: 460026.0 [2024-08-06 03:37:28,598][52647] Sum rewards: 74.717, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.950', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.161', 'weapon2': '0.238', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.196', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '59.000'} [2024-08-06 03:37:28,627][52663] DAMAGECOUNT value on done: 422541.0 [2024-08-06 03:37:28,627][52663] Sum rewards: 64.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.192', 'AMMO5': '0.017', 'weapon7': '0.032', 'AMMO2': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.161', 'weapon2': '0.196', 'AMMO4': '0.200', 'weapon4': '0.260', 'weapon5': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.650', 'weapon3': '2.904', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '51.500'} [2024-08-06 03:37:28,916][52820] DAMAGECOUNT value on done: 396974.0 [2024-08-06 03:37:28,918][52820] Sum rewards: 73.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon4': '0.080', 'weapon5': '0.128', 'AMMO3': '0.172', 'AMMO4': '0.309', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:28,971][52667] DAMAGECOUNT value on done: 429878.0 [2024-08-06 03:37:28,973][52667] Sum rewards: 62.924, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.772', 'AMMO5': '0.021', 'AMMO2': '0.072', 'weapon4': '0.178', 'weapon5': '0.182', 'AMMO3': '0.270', 'AMMO4': '0.360', 'weapon2': '0.366', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.978', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:30,546][52664] DAMAGECOUNT value on done: 444168.0 [2024-08-06 03:37:30,546][52664] Sum rewards: 62.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon4': '0.420', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '51.000'} [2024-08-06 03:37:30,918][52650] Updated weights for policy 0, policy_version 47201 (0.0058) [2024-08-06 03:37:31,334][52647] DAMAGECOUNT value on done: 448525.0 [2024-08-06 03:37:31,336][52647] Sum rewards: 73.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.417', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.225', 'AMMO4': '0.254', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:31,924][52667] DAMAGECOUNT value on done: 432043.0 [2024-08-06 03:37:31,924][52667] Sum rewards: 87.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.174', 'AMMO4': '0.175', 'AMMO3': '0.213', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '71.000'} [2024-08-06 03:37:32,039][52820] DAMAGECOUNT value on done: 407064.0 [2024-08-06 03:37:32,039][52820] Sum rewards: 60.932, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.190', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.122', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon2': '0.312', 'WEAPON3': '1.650', 'HITCOUNT': '3.040', 'weapon3': '3.244', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:32,085][52662] Large shaping reward -2.518 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('weapon5', 0.002)] [2024-08-06 03:37:32,794][52567] Fps is (10 sec: 17206.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 386695168. Throughput: 0: 4371.4. Samples: 96673970. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 03:37:32,802][52567] Avg episode reward: [(0, '70.803')] [2024-08-06 03:37:33,269][52664] DAMAGECOUNT value on done: 444852.0 [2024-08-06 03:37:33,269][52664] Sum rewards: 67.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.915', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.174', 'AMMO3': '0.190', 'AMMO4': '0.202', 'weapon5': '0.258', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '55.500'} [2024-08-06 03:37:33,356][52667] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:37:34,239][52647] DAMAGECOUNT value on done: 452643.0 [2024-08-06 03:37:34,239][52647] Sum rewards: 68.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.278', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.288', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.414', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '58.000'} [2024-08-06 03:37:34,768][52667] DAMAGECOUNT value on done: 438703.0 [2024-08-06 03:37:34,768][52667] Sum rewards: 66.121, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.176', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.116', 'weapon5': '0.178', 'AMMO3': '0.180', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '51.000'} [2024-08-06 03:37:35,138][52820] DAMAGECOUNT value on done: 408305.0 [2024-08-06 03:37:35,139][52820] Sum rewards: 78.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.218', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '65.000'} [2024-08-06 03:37:35,808][52664] DAMAGECOUNT value on done: 445627.0 [2024-08-06 03:37:35,808][52664] Sum rewards: 61.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.110', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon4': '0.040', 'weapon5': '0.084', 'AMMO3': '0.180', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.520', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '51.000'} [2024-08-06 03:37:35,962][52650] Updated weights for policy 0, policy_version 47211 (0.0021) [2024-08-06 03:37:36,552][52647] DAMAGECOUNT value on done: 446515.0 [2024-08-06 03:37:36,552][52647] Sum rewards: 78.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.423', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.186', 'AMMO4': '0.189', 'AMMO3': '0.212', 'weapon5': '0.224', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:37,590][52667] DAMAGECOUNT value on done: 426371.0 [2024-08-06 03:37:37,590][52667] Sum rewards: 76.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.093', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.094', 'weapon5': '0.172', 'AMMO4': '0.206', 'AMMO3': '0.253', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 386785280. Throughput: 0: 4367.1. Samples: 96700390. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 03:37:37,795][52567] Avg episode reward: [(0, '70.964')] [2024-08-06 03:37:38,025][52664] DAMAGECOUNT value on done: 444199.0 [2024-08-06 03:37:38,027][52664] Sum rewards: 63.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.157', 'AMMO4': '0.210', 'weapon5': '0.220', 'weapon4': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.716', 'WEAPON3': '1.000', 'weapon3': '2.510', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '50.500'} [2024-08-06 03:37:38,421][52820] DAMAGECOUNT value on done: 396227.0 [2024-08-06 03:37:38,421][52820] Sum rewards: 79.340, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.091', 'weapon4': '0.092', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.472', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '65.000'} [2024-08-06 03:37:38,998][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:37:39,094][52647] DAMAGECOUNT value on done: 451765.0 [2024-08-06 03:37:39,095][52647] Sum rewards: 63.516, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.287', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '3.258', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '52.000'} [2024-08-06 03:37:39,579][52669] DAMAGECOUNT value on done: 434901.0 [2024-08-06 03:37:39,580][52669] Sum rewards: 64.213, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.678', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:40,121][52650] Updated weights for policy 0, policy_version 47221 (0.0016) [2024-08-06 03:37:40,240][52668] DAMAGECOUNT value on done: 429653.0 [2024-08-06 03:37:40,240][52668] Sum rewards: 69.819, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.658', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.140', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.267', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.324', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:40,252][52667] DAMAGECOUNT value on done: 430269.0 [2024-08-06 03:37:40,252][52667] Sum rewards: 65.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.068', 'weapon5': '0.106', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.442', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:41,048][52664] DAMAGECOUNT value on done: 444645.0 [2024-08-06 03:37:41,048][52664] Sum rewards: 61.194, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.883', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.137', 'AMMO4': '0.211', 'weapon5': '0.228', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.466', 'WEAPON3': '0.850', 'weapon3': '2.718', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '48.000'} [2024-08-06 03:37:41,894][52647] DAMAGECOUNT value on done: 448989.0 [2024-08-06 03:37:41,894][52647] Sum rewards: 74.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:42,233][52669] DAMAGECOUNT value on done: 424772.0 [2024-08-06 03:37:42,233][52669] Sum rewards: 76.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.211', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 386875392. Throughput: 0: 4358.7. Samples: 96726520. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 03:37:42,802][52567] Avg episode reward: [(0, '70.625')] [2024-08-06 03:37:43,114][52667] DAMAGECOUNT value on done: 433233.0 [2024-08-06 03:37:43,117][52667] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.557', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '59.000'} [2024-08-06 03:37:43,175][52668] DAMAGECOUNT value on done: 432770.0 [2024-08-06 03:37:43,176][52668] Sum rewards: 74.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.282', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.116', 'AMMO4': '0.207', 'weapon4': '0.212', 'weapon2': '0.224', 'AMMO3': '0.235', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:44,476][52647] DAMAGECOUNT value on done: 458296.0 [2024-08-06 03:37:44,477][52647] Sum rewards: 76.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.124', 'weapon4': '0.128', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:44,973][52669] DAMAGECOUNT value on done: 434006.0 [2024-08-06 03:37:44,974][52669] Sum rewards: 60.668, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.162', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon4': '0.212', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '13.737', 'FRAGCOUNT': '51.000'} [2024-08-06 03:37:45,057][52650] Updated weights for policy 0, policy_version 47231 (0.0012) [2024-08-06 03:37:46,105][52668] DAMAGECOUNT value on done: 433232.0 [2024-08-06 03:37:46,105][52668] Sum rewards: 70.861, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.936', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.426', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:46,227][52667] DAMAGECOUNT value on done: 426774.0 [2024-08-06 03:37:46,227][52667] Sum rewards: 73.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.965', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.226', 'AMMO3': '0.240', 'weapon4': '0.326', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:47,286][52647] DAMAGECOUNT value on done: 450157.0 [2024-08-06 03:37:47,288][52647] Sum rewards: 78.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.795', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.138', 'weapon4': '0.168', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:47,717][52669] DAMAGECOUNT value on done: 428839.0 [2024-08-06 03:37:47,719][52669] Sum rewards: 65.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'AMMO5': '0.016', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.097', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.134', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '53.000'} [2024-08-06 03:37:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 386957312. Throughput: 0: 4366.2. Samples: 96739700. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 03:37:47,802][52567] Avg episode reward: [(0, '70.942')] [2024-08-06 03:37:49,341][52667] DAMAGECOUNT value on done: 433110.0 [2024-08-06 03:37:49,341][52667] Sum rewards: 72.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.621', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.176', 'AMMO4': '0.226', 'AMMO3': '0.245', 'weapon2': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.758', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '63.000'} [2024-08-06 03:37:49,449][52662] DAMAGECOUNT value on done: 435169.0 [2024-08-06 03:37:49,449][52662] Sum rewards: 61.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.132', 'weapon5': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '54.000'} [2024-08-06 03:37:49,541][52668] DAMAGECOUNT value on done: 435812.0 [2024-08-06 03:37:49,541][52668] Sum rewards: 82.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.055', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.154', 'weapon5': '0.160', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '65.000'} [2024-08-06 03:37:49,852][52650] Updated weights for policy 0, policy_version 47241 (0.0012) [2024-08-06 03:37:50,402][52647] DAMAGECOUNT value on done: 446628.0 [2024-08-06 03:37:50,402][52647] Sum rewards: 74.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.126', 'AMMO4': '0.174', 'weapon2': '0.184', 'weapon5': '0.184', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.260', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 03:37:50,434][52669] DAMAGECOUNT value on done: 430035.0 [2024-08-06 03:37:50,436][52669] Sum rewards: 75.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.406', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.267', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.384', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '64.000'} [2024-08-06 03:37:52,538][52662] DAMAGECOUNT value on done: 435355.0 [2024-08-06 03:37:52,540][52662] Sum rewards: 56.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.490', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.220', 'weapon5': '0.220', 'weapon4': '0.226', 'AMMO4': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.716', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '47.000'} [2024-08-06 03:37:52,546][52667] DAMAGECOUNT value on done: 440459.0 [2024-08-06 03:37:52,546][52667] Sum rewards: 62.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.384', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.156', 'weapon5': '0.218', 'AMMO3': '0.237', 'AMMO4': '0.252', 'weapon2': '0.286', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.014', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '54.000'} [2024-08-06 03:37:52,554][52668] DAMAGECOUNT value on done: 423322.0 [2024-08-06 03:37:52,556][52668] Sum rewards: 70.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.200', 'weapon5': '0.224', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '61.000'} [2024-08-06 03:37:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 387047424. Throughput: 0: 4371.6. Samples: 96766080. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 03:37:52,802][52567] Avg episode reward: [(0, '70.717')] [2024-08-06 03:37:53,484][52647] DAMAGECOUNT value on done: 448944.0 [2024-08-06 03:37:53,486][52647] Sum rewards: 66.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.447', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO4': '0.144', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '56.000'} [2024-08-06 03:37:53,504][52669] DAMAGECOUNT value on done: 436180.0 [2024-08-06 03:37:53,507][52669] Sum rewards: 72.128, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.520', 'AMMO5': '0.023', 'AMMO2': '0.084', 'weapon4': '0.138', 'weapon5': '0.244', 'AMMO3': '0.252', 'weapon2': '0.358', 'AMMO4': '0.420', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '62.000'} [2024-08-06 03:37:54,311][52650] Updated weights for policy 0, policy_version 47251 (0.0023) [2024-08-06 03:37:55,297][52668] DAMAGECOUNT value on done: 434494.0 [2024-08-06 03:37:55,298][52668] Sum rewards: 71.578, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.036', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon2': '0.598', 'WEAPON3': '0.900', 'weapon3': '3.176', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '55.000'} [2024-08-06 03:37:55,663][52662] DAMAGECOUNT value on done: 435711.0 [2024-08-06 03:37:55,663][52662] Sum rewards: 78.322, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.759', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.273', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '67.000'} [2024-08-06 03:37:55,746][52667] DAMAGECOUNT value on done: 437572.0 [2024-08-06 03:37:55,746][52667] Sum rewards: 71.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO4': '0.170', 'weapon5': '0.178', 'weapon2': '0.234', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.140', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.500'} [2024-08-06 03:37:56,507][52647] DAMAGECOUNT value on done: 447677.0 [2024-08-06 03:37:56,508][52647] Sum rewards: 68.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.193', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.324', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.416', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '55.500'} [2024-08-06 03:37:56,522][52669] DAMAGECOUNT value on done: 430660.0 [2024-08-06 03:37:56,524][52669] Sum rewards: 66.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.213', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.000'} [2024-08-06 03:37:57,282][52665] DAMAGECOUNT value on done: 423371.0 [2024-08-06 03:37:57,282][52665] Sum rewards: 70.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.402', 'AMMO5': '0.015', 'AMMO2': '0.069', 'weapon4': '0.086', 'weapon5': '0.200', 'AMMO3': '0.219', 'AMMO4': '0.347', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 03:37:57,431][52671] DAMAGECOUNT value on done: 435445.0 [2024-08-06 03:37:57,432][52671] Sum rewards: 64.352, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.860', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.137', 'AMMO4': '0.221', 'weapon4': '0.294', 'weapon5': '0.342', 'WEAPON5': '0.450', 'weapon2': '0.520', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.640', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '50.000'} [2024-08-06 03:37:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 387137536. Throughput: 0: 4381.8. Samples: 96792530. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 03:37:57,795][52567] Avg episode reward: [(0, '70.560')] [2024-08-06 03:37:57,917][52668] DAMAGECOUNT value on done: 434001.0 [2024-08-06 03:37:57,919][52668] Sum rewards: 75.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.224', 'weapon4': '0.238', 'AMMO4': '0.243', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '62.000'} [2024-08-06 03:37:58,884][52667] DAMAGECOUNT value on done: 434966.0 [2024-08-06 03:37:58,887][52667] Sum rewards: 68.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.078', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '58.000'} [2024-08-06 03:37:58,893][52662] DAMAGECOUNT value on done: 425386.0 [2024-08-06 03:37:58,893][52662] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.670', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon2': '1.036', 'WEAPON3': '1.100', 'weapon3': '2.660', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '54.000'} [2024-08-06 03:37:59,032][52650] Updated weights for policy 0, policy_version 47261 (0.0024) [2024-08-06 03:37:59,475][52669] DAMAGECOUNT value on done: 432139.0 [2024-08-06 03:37:59,477][52669] Sum rewards: 72.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.949', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.126', 'weapon4': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.578', 'WEAPON3': '0.850', 'weapon3': '2.752', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.000'} [2024-08-06 03:37:59,569][52647] DAMAGECOUNT value on done: 449363.0 [2024-08-06 03:37:59,570][52647] Sum rewards: 70.655, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.112', 'AMMO5': '0.022', 'AMMO2': '0.050', 'weapon4': '0.130', 'AMMO3': '0.217', 'weapon5': '0.236', 'AMMO4': '0.249', 'weapon2': '0.282', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.500'} [2024-08-06 03:38:00,060][52665] DAMAGECOUNT value on done: 431308.0 [2024-08-06 03:38:00,061][52665] Sum rewards: 77.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.841', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.188', 'AMMO3': '0.192', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.396', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:00,315][52671] DAMAGECOUNT value on done: 434216.0 [2024-08-06 03:38:00,316][52671] Sum rewards: 63.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.554', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.114', 'weapon5': '0.174', 'AMMO4': '0.220', 'AMMO3': '0.251', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.130', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:01,043][52668] DAMAGECOUNT value on done: 426513.0 [2024-08-06 03:38:01,044][52668] Sum rewards: 77.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.314', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.122', 'weapon4': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.280', 'WEAPON3': '1.650', 'weapon3': '3.190', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '67.000'} [2024-08-06 03:38:01,734][52669] DAMAGECOUNT value on done: 436410.0 [2024-08-06 03:38:01,734][52669] Sum rewards: 83.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.080', 'AMMO4': '0.128', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.336', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '68.000'} [2024-08-06 03:38:01,956][52662] DAMAGECOUNT value on done: 436996.0 [2024-08-06 03:38:01,956][52662] Sum rewards: 68.657, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.820', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.026', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:02,264][52667] DAMAGECOUNT value on done: 428768.0 [2024-08-06 03:38:02,266][52667] Sum rewards: 62.363, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.500', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.108', 'AMMO4': '0.198', 'weapon2': '0.214', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.344', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '56.000'} [2024-08-06 03:38:02,286][52660] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 03:38:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 387219456. Throughput: 0: 4379.5. Samples: 96805550. Policy #0 lag: (min: 1.0, avg: 3.1, max: 7.0) [2024-08-06 03:38:02,795][52567] Avg episode reward: [(0, '70.585')] [2024-08-06 03:38:03,050][52671] DAMAGECOUNT value on done: 434993.0 [2024-08-06 03:38:03,051][52671] Sum rewards: 65.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.592', 'AMMO2': '0.001', 'AMMO4': '0.007', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon2': '0.902', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.000'} [2024-08-06 03:38:03,162][52665] DAMAGECOUNT value on done: 428939.0 [2024-08-06 03:38:03,163][52665] Sum rewards: 62.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.192', 'AMMO3': '0.225', 'weapon4': '0.230', 'AMMO4': '0.261', 'weapon2': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '54.000'} [2024-08-06 03:38:03,723][52650] Updated weights for policy 0, policy_version 47271 (0.0027) [2024-08-06 03:38:04,035][52660] DAMAGECOUNT value on done: 428299.0 [2024-08-06 03:38:04,036][52660] Sum rewards: 59.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.086', 'weapon5': '0.170', 'AMMO3': '0.219', 'weapon2': '0.238', 'AMMO4': '0.246', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.278', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '50.000'} [2024-08-06 03:38:04,052][52668] DAMAGECOUNT value on done: 427557.0 [2024-08-06 03:38:04,053][52668] Sum rewards: 56.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.100', 'AMMO4': '0.190', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '48.000'} [2024-08-06 03:38:04,566][52669] DAMAGECOUNT value on done: 430720.0 [2024-08-06 03:38:04,567][52669] Sum rewards: 63.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.724', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '53.000'} [2024-08-06 03:38:04,674][52803] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2024-08-06 03:38:04,740][52662] DAMAGECOUNT value on done: 429112.0 [2024-08-06 03:38:04,744][52662] Sum rewards: 65.402, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon2': '0.134', 'weapon5': '0.142', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:05,432][52667] DAMAGECOUNT value on done: 438583.0 [2024-08-06 03:38:05,432][52667] Sum rewards: 77.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.064', 'weapon5': '0.142', 'AMMO4': '0.145', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2024-08-06 03:38:05,532][52671] DAMAGECOUNT value on done: 432448.0 [2024-08-06 03:38:05,533][52671] Sum rewards: 59.504, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.170', 'weapon5': '0.218', 'AMMO4': '0.236', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.950', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:05,558][52658] DAMAGECOUNT value on done: 429206.0 [2024-08-06 03:38:05,558][52658] Sum rewards: 69.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.627', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.216', 'AMMO3': '0.246', 'weapon4': '0.276', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.752', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:06,241][52665] DAMAGECOUNT value on done: 425707.0 [2024-08-06 03:38:06,241][52665] Sum rewards: 73.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.015', 'AMMO5': '0.004', 'weapon5': '0.030', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.197', 'weapon2': '0.254', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:06,753][52660] DAMAGECOUNT value on done: 423967.0 [2024-08-06 03:38:06,754][52660] Sum rewards: 80.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.108', 'AMMO4': '0.124', 'weapon5': '0.126', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.362', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '67.000'} [2024-08-06 03:38:06,805][52668] DAMAGECOUNT value on done: 435209.0 [2024-08-06 03:38:06,805][52668] Sum rewards: 66.017, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.662', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.292', 'weapon2': '0.436', 'WEAPON3': '1.750', 'weapon3': '3.208', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:07,235][52669] DAMAGECOUNT value on done: 437128.0 [2024-08-06 03:38:07,235][52669] Sum rewards: 79.720, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.106', 'AMMO3': '0.146', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.238', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '64.000'} [2024-08-06 03:38:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 387317760. Throughput: 0: 4377.0. Samples: 96831870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:38:07,795][52567] Avg episode reward: [(0, '69.795')] [2024-08-06 03:38:07,941][52662] DAMAGECOUNT value on done: 439739.0 [2024-08-06 03:38:07,943][52662] Sum rewards: 74.236, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.451', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.114', 'AMMO3': '0.227', 'weapon5': '0.270', 'AMMO4': '0.296', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:07,996][52671] DAMAGECOUNT value on done: 441255.0 [2024-08-06 03:38:07,998][52671] Sum rewards: 65.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.086', 'weapon4': '0.130', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.454', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.094', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:08,408][52650] Updated weights for policy 0, policy_version 47281 (0.0012) [2024-08-06 03:38:08,584][52658] DAMAGECOUNT value on done: 431895.0 [2024-08-06 03:38:08,588][52658] Sum rewards: 57.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.592', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.158', 'weapon5': '0.188', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.576', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '48.000'} [2024-08-06 03:38:09,147][52665] DAMAGECOUNT value on done: 418300.0 [2024-08-06 03:38:09,148][52665] Sum rewards: 70.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.094', 'AMMO4': '0.136', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.226', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:09,814][52660] DAMAGECOUNT value on done: 434647.0 [2024-08-06 03:38:09,815][52660] Sum rewards: 63.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.074', 'weapon4': '0.086', 'AMMO4': '0.107', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.124', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:09,824][52668] DAMAGECOUNT value on done: 431646.0 [2024-08-06 03:38:09,827][52668] Sum rewards: 78.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.324', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'weapon2': '0.154', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '65.000'} [2024-08-06 03:38:10,268][52669] DAMAGECOUNT value on done: 432608.0 [2024-08-06 03:38:10,268][52669] Sum rewards: 69.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.216', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.178', 'AMMO3': '0.198', 'weapon4': '0.220', 'AMMO4': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '58.500'} [2024-08-06 03:38:10,818][52662] DAMAGECOUNT value on done: 442285.0 [2024-08-06 03:38:10,818][52662] Sum rewards: 77.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.300', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:11,025][52671] DAMAGECOUNT value on done: 431626.0 [2024-08-06 03:38:11,026][52671] Sum rewards: 74.405, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.174', 'weapon5': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.356', 'weapon2': '0.390', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:11,451][52658] DAMAGECOUNT value on done: 436078.0 [2024-08-06 03:38:11,452][52658] Sum rewards: 68.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.835', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.228', 'AMMO3': '0.231', 'weapon5': '0.268', 'AMMO4': '0.277', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.730', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:12,365][52665] DAMAGECOUNT value on done: 420009.0 [2024-08-06 03:38:12,365][52665] Sum rewards: 73.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.090', 'weapon5': '0.184', 'AMMO3': '0.225', 'AMMO4': '0.239', 'WEAPON4': '0.450', 'weapon2': '0.516', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.946', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:12,748][52668] DAMAGECOUNT value on done: 426243.0 [2024-08-06 03:38:12,748][52668] Sum rewards: 56.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.749', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon4': '0.162', 'AMMO3': '0.221', 'AMMO4': '0.298', 'weapon5': '0.316', 'weapon2': '0.336', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.490', 'weapon3': '2.878', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '45.000'} [2024-08-06 03:38:12,755][52660] DAMAGECOUNT value on done: 438134.0 [2024-08-06 03:38:12,760][52660] Sum rewards: 81.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.150', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.154', 'weapon5': '0.154', 'AMMO4': '0.186', 'weapon2': '0.266', 'AMMO3': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.142', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '71.000'} [2024-08-06 03:38:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 387399680. Throughput: 0: 4384.7. Samples: 96858210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:38:12,794][52567] Avg episode reward: [(0, '69.726')] [2024-08-06 03:38:13,057][52650] Updated weights for policy 0, policy_version 47291 (0.0032) [2024-08-06 03:38:13,186][52669] DAMAGECOUNT value on done: 422755.0 [2024-08-06 03:38:13,186][52669] Sum rewards: 55.559, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.058', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.160', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '46.000'} [2024-08-06 03:38:13,454][52662] DAMAGECOUNT value on done: 429753.0 [2024-08-06 03:38:13,455][52662] Sum rewards: 65.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.741', 'AMMO5': '0.016', 'AMMO2': '0.080', 'weapon5': '0.128', 'AMMO3': '0.219', 'weapon2': '0.318', 'WEAPON5': '0.350', 'weapon4': '0.386', 'AMMO4': '0.401', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:14,135][52671] DAMAGECOUNT value on done: 439379.0 [2024-08-06 03:38:14,136][52671] Sum rewards: 65.522, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'weapon4': '0.022', 'AMMO2': '0.033', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.900', 'WEAPON3': '0.950', 'weapon3': '2.888', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '53.000'} [2024-08-06 03:38:14,218][52658] DAMAGECOUNT value on done: 434236.0 [2024-08-06 03:38:14,218][52658] Sum rewards: 72.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.716', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.146', 'AMMO3': '0.176', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.292', 'weapon4': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.948', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:15,249][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:38:15,557][52665] DAMAGECOUNT value on done: 424885.0 [2024-08-06 03:38:15,557][52665] Sum rewards: 73.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.217', 'weapon4': '0.246', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:15,681][52669] DAMAGECOUNT value on done: 434713.0 [2024-08-06 03:38:15,683][52669] Sum rewards: 71.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.288', 'WEAPON3': '1.500', 'weapon3': '3.468', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:15,700][52668] DAMAGECOUNT value on done: 421291.0 [2024-08-06 03:38:15,703][52668] Sum rewards: 68.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.307', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.186', 'AMMO4': '0.206', 'AMMO3': '0.228', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.238', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:15,762][52660] DAMAGECOUNT value on done: 431182.0 [2024-08-06 03:38:15,762][52660] Sum rewards: 79.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.602', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.226', 'weapon2': '0.240', 'WEAPON3': '1.600', 'weapon3': '3.538', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '67.000'} [2024-08-06 03:38:16,221][52662] DAMAGECOUNT value on done: 443107.0 [2024-08-06 03:38:16,222][52662] Sum rewards: 68.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.232', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.202', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:16,978][52658] DAMAGECOUNT value on done: 425493.0 [2024-08-06 03:38:16,979][52658] Sum rewards: 78.728, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.713', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.268', 'weapon4': '0.684', 'WEAPON3': '1.050', 'weapon3': '2.728', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:17,289][52671] DAMAGECOUNT value on done: 436167.0 [2024-08-06 03:38:17,289][52671] Sum rewards: 68.407, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.112', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.192', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:17,604][52650] Updated weights for policy 0, policy_version 47301 (0.0036) [2024-08-06 03:38:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 387489792. Throughput: 0: 4391.3. Samples: 96871580. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:38:17,802][52567] Avg episode reward: [(0, '69.711')] [2024-08-06 03:38:18,332][52668] DAMAGECOUNT value on done: 423387.0 [2024-08-06 03:38:18,332][52668] Sum rewards: 74.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.274', 'AMMO5': '0.019', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.198', 'AMMO3': '0.211', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '62.000'} [2024-08-06 03:38:18,390][52669] DAMAGECOUNT value on done: 437578.0 [2024-08-06 03:38:18,390][52669] Sum rewards: 66.758, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.554', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.280', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:18,403][52660] DAMAGECOUNT value on done: 428198.0 [2024-08-06 03:38:18,403][52660] Sum rewards: 83.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.861', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.104', 'weapon4': '0.128', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '68.000'} [2024-08-06 03:38:18,872][52665] DAMAGECOUNT value on done: 428827.0 [2024-08-06 03:38:18,872][52665] Sum rewards: 67.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO4': '0.186', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:18,904][52662] DAMAGECOUNT value on done: 428737.0 [2024-08-06 03:38:18,905][52662] Sum rewards: 61.548, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.570', 'AMMO5': '0.023', 'AMMO2': '0.092', 'weapon4': '0.212', 'weapon5': '0.292', 'AMMO3': '0.293', 'weapon2': '0.334', 'AMMO4': '0.462', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.650', 'weapon3': '2.782', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '53.500'} [2024-08-06 03:38:19,452][52658] DAMAGECOUNT value on done: 430222.0 [2024-08-06 03:38:19,452][52658] Sum rewards: 71.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.195', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.163', 'weapon4': '0.172', 'weapon2': '0.192', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.294', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '62.000'} [2024-08-06 03:38:20,311][52671] DAMAGECOUNT value on done: 430804.0 [2024-08-06 03:38:20,312][52671] Sum rewards: 47.054, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.490', 'weapon3': '3.214', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '42.000'} [2024-08-06 03:38:21,313][52669] DAMAGECOUNT value on done: 446106.0 [2024-08-06 03:38:21,315][52669] Sum rewards: 68.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.016', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.126', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:21,508][52668] DAMAGECOUNT value on done: 422118.0 [2024-08-06 03:38:21,508][52668] Sum rewards: 68.165, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.060', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.114', 'AMMO4': '0.206', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:21,526][52660] DAMAGECOUNT value on done: 429305.0 [2024-08-06 03:38:21,526][52660] Sum rewards: 70.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.220', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon4': '0.284', 'weapon2': '0.642', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:21,543][52665] DAMAGECOUNT value on done: 431251.0 [2024-08-06 03:38:21,545][52665] Sum rewards: 70.348, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon5': '0.220', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.874', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:22,100][52662] DAMAGECOUNT value on done: 433418.0 [2024-08-06 03:38:22,100][52662] Sum rewards: 74.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.610', 'AMMO5': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.204', 'weapon4': '0.216', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '60.500'} [2024-08-06 03:38:22,432][52650] Updated weights for policy 0, policy_version 47311 (0.0012) [2024-08-06 03:38:22,524][52658] DAMAGECOUNT value on done: 433882.0 [2024-08-06 03:38:22,525][52658] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.213', 'weapon5': '0.230', 'weapon4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.7, 300 sec: 17494.8). Total num frames: 387571712. Throughput: 0: 4388.9. Samples: 96897890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:38:22,795][52567] Avg episode reward: [(0, '69.768')] [2024-08-06 03:38:23,593][52671] DAMAGECOUNT value on done: 437318.0 [2024-08-06 03:38:23,594][52671] Sum rewards: 63.865, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.782', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.060', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.044', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:24,068][52668] DAMAGECOUNT value on done: 428848.0 [2024-08-06 03:38:24,068][52668] Sum rewards: 76.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.306', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.124', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 03:38:24,133][52660] DAMAGECOUNT value on done: 436210.0 [2024-08-06 03:38:24,133][52660] Sum rewards: 53.993, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.900', 'AMMO5': '0.023', 'AMMO2': '0.092', 'AMMO3': '0.248', 'weapon5': '0.250', 'weapon2': '0.320', 'weapon4': '0.428', 'AMMO4': '0.458', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.688', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '48.000'} [2024-08-06 03:38:24,226][52669] DAMAGECOUNT value on done: 433957.0 [2024-08-06 03:38:24,227][52669] Sum rewards: 81.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.394', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.190', 'AMMO3': '0.200', 'weapon4': '0.206', 'AMMO4': '0.239', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '67.000'} [2024-08-06 03:38:24,421][52665] DAMAGECOUNT value on done: 427727.0 [2024-08-06 03:38:24,424][52665] Sum rewards: 88.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.228', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '21.663', 'FRAGCOUNT': '72.000'} [2024-08-06 03:38:25,295][52658] DAMAGECOUNT value on done: 426015.0 [2024-08-06 03:38:25,297][52658] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.969', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.114', 'weapon4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.650', 'weapon3': '3.096', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 03:38:25,340][52662] DAMAGECOUNT value on done: 433293.0 [2024-08-06 03:38:25,342][52662] Sum rewards: 79.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.443', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.221', 'weapon4': '0.308', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '64.000'} [2024-08-06 03:38:26,496][52671] DAMAGECOUNT value on done: 441951.0 [2024-08-06 03:38:26,499][52671] Sum rewards: 66.880, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.474', 'AMMO5': '0.024', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.210', 'weapon2': '0.214', 'AMMO4': '0.224', 'AMMO3': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:26,916][52668] DAMAGECOUNT value on done: 433324.0 [2024-08-06 03:38:26,916][52668] Sum rewards: 70.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.716', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.200', 'weapon5': '0.204', 'AMMO4': '0.214', 'weapon4': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:26,956][52660] DAMAGECOUNT value on done: 432911.0 [2024-08-06 03:38:26,956][52660] Sum rewards: 62.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.136', 'AMMO4': '0.167', 'weapon5': '0.194', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:26,994][52650] Updated weights for policy 0, policy_version 47321 (0.0041) [2024-08-06 03:38:27,076][52665] DAMAGECOUNT value on done: 432757.0 [2024-08-06 03:38:27,077][52665] Sum rewards: 75.940, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon2': '0.142', 'weapon5': '0.154', 'AMMO4': '0.154', 'AMMO3': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '61.500'} [2024-08-06 03:38:27,259][52669] DAMAGECOUNT value on done: 434922.0 [2024-08-06 03:38:27,260][52669] Sum rewards: 73.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.079', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.108', 'AMMO4': '0.160', 'weapon5': '0.202', 'AMMO3': '0.220', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '62.000'} [2024-08-06 03:38:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 387661824. Throughput: 0: 4389.8. Samples: 96924060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:38:27,794][52567] Avg episode reward: [(0, '70.132')] [2024-08-06 03:38:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047322_387661824.pth... [2024-08-06 03:38:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000046809_383459328.pth [2024-08-06 03:38:28,200][52658] DAMAGECOUNT value on done: 440702.0 [2024-08-06 03:38:28,200][52658] Sum rewards: 67.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.104', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.070', 'weapon5': '0.120', 'AMMO3': '0.163', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.816', 'WEAPON3': '1.050', 'weapon3': '2.768', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:28,206][52662] DAMAGECOUNT value on done: 439218.0 [2024-08-06 03:38:28,206][52662] Sum rewards: 59.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.116', 'weapon5': '0.130', 'AMMO4': '0.140', 'AMMO3': '0.262', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.242', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '53.000'} [2024-08-06 03:38:28,799][52811] DAMAGECOUNT value on done: 414238.0 [2024-08-06 03:38:28,802][52811] Sum rewards: 73.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.217', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:29,604][52671] DAMAGECOUNT value on done: 433052.0 [2024-08-06 03:38:29,606][52671] Sum rewards: 70.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.757', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon4': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon2': '0.396', 'WEAPON3': '1.700', 'weapon3': '3.016', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:29,638][52614] Signal inference workers to stop experience collection... (8550 times) [2024-08-06 03:38:29,638][52614] Signal inference workers to resume experience collection... (8550 times) [2024-08-06 03:38:29,659][52668] DAMAGECOUNT value on done: 430344.0 [2024-08-06 03:38:29,659][52668] Sum rewards: 73.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:29,721][52650] InferenceWorker_p0-w0: stopping experience collection (8550 times) [2024-08-06 03:38:29,721][52650] InferenceWorker_p0-w0: resuming experience collection (8550 times) [2024-08-06 03:38:29,723][52660] DAMAGECOUNT value on done: 427412.0 [2024-08-06 03:38:29,726][52660] Sum rewards: 62.044, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.166', 'weapon4': '0.166', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '3.036', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '49.000'} [2024-08-06 03:38:29,995][52665] DAMAGECOUNT value on done: 428662.0 [2024-08-06 03:38:29,997][52665] Sum rewards: 66.763, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.216', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.186', 'weapon4': '0.230', 'AMMO4': '0.239', 'AMMO3': '0.255', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:30,605][52669] DAMAGECOUNT value on done: 436359.0 [2024-08-06 03:38:30,606][52669] Sum rewards: 75.305, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'HEALTH': '0.008', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.165', 'weapon2': '0.274', 'WEAPON3': '1.000', 'HITCOUNT': '3.340', 'weapon3': '3.352', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.500'} [2024-08-06 03:38:31,275][52658] DAMAGECOUNT value on done: 432203.0 [2024-08-06 03:38:31,276][52658] Sum rewards: 78.676, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.050', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:31,286][52803] DAMAGECOUNT value on done: 403600.0 [2024-08-06 03:38:31,289][52803] Sum rewards: 58.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.850', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.160', 'AMMO4': '0.205', 'AMMO3': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.782', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '49.000'} [2024-08-06 03:38:31,425][52662] DAMAGECOUNT value on done: 432981.0 [2024-08-06 03:38:31,426][52662] Sum rewards: 75.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.180', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.330', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:31,814][52650] Updated weights for policy 0, policy_version 47331 (0.0044) [2024-08-06 03:38:31,975][52811] DAMAGECOUNT value on done: 398308.0 [2024-08-06 03:38:31,978][52811] Sum rewards: 66.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.090', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.196', 'AMMO4': '0.205', 'AMMO3': '0.219', 'weapon2': '0.244', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:32,260][52671] DAMAGECOUNT value on done: 440895.0 [2024-08-06 03:38:32,260][52671] Sum rewards: 70.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.555', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.252', 'weapon2': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.470', 'weapon3': '3.514', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '60.500'} [2024-08-06 03:38:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 387751936. Throughput: 0: 4384.9. Samples: 96937020. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 03:38:32,794][52567] Avg episode reward: [(0, '69.710')] [2024-08-06 03:38:32,843][52668] DAMAGECOUNT value on done: 436043.0 [2024-08-06 03:38:32,843][52668] Sum rewards: 74.046, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.126', 'weapon2': '0.630', 'WEAPON3': '0.900', 'weapon3': '3.112', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:32,976][52660] DAMAGECOUNT value on done: 440357.0 [2024-08-06 03:38:32,979][52660] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.192', 'AMMO5': '0.021', 'AMMO2': '0.072', 'weapon4': '0.198', 'weapon5': '0.232', 'weapon2': '0.236', 'AMMO3': '0.253', 'AMMO4': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 03:38:33,141][52665] DAMAGECOUNT value on done: 425637.0 [2024-08-06 03:38:33,143][52665] Sum rewards: 66.857, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.125', 'AMMO3': '0.194', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.076', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '54.000'} [2024-08-06 03:38:33,263][52669] DAMAGECOUNT value on done: 438194.0 [2024-08-06 03:38:33,264][52669] Sum rewards: 67.945, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.396', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.177', 'weapon2': '0.192', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:34,214][52658] DAMAGECOUNT value on done: 441901.0 [2024-08-06 03:38:34,217][52658] Sum rewards: 62.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.101', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.164', 'AMMO3': '0.208', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:34,439][52803] DAMAGECOUNT value on done: 400718.0 [2024-08-06 03:38:34,440][52803] Sum rewards: 78.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.072', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon4': '0.206', 'AMMO3': '0.207', 'weapon2': '0.216', 'weapon5': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:34,535][52794] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('HEALTH', 0.05, 10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:38:34,561][52662] DAMAGECOUNT value on done: 442043.0 [2024-08-06 03:38:34,561][52662] Sum rewards: 69.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.735', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.109', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '57.500'} [2024-08-06 03:38:35,102][52811] DAMAGECOUNT value on done: 399669.0 [2024-08-06 03:38:35,103][52811] Sum rewards: 63.268, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.168', 'AMMO4': '0.170', 'AMMO3': '0.182', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:35,337][52671] DAMAGECOUNT value on done: 432317.0 [2024-08-06 03:38:35,339][52671] Sum rewards: 67.760, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.099', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.776', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '56.000'} [2024-08-06 03:38:35,601][52668] DAMAGECOUNT value on done: 428279.0 [2024-08-06 03:38:35,602][52668] Sum rewards: 64.224, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.594', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.100', 'AMMO3': '0.138', 'weapon2': '0.190', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '3.030', 'weapon3': '3.242', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '50.000'} [2024-08-06 03:38:35,772][52660] DAMAGECOUNT value on done: 424257.0 [2024-08-06 03:38:35,773][52660] Sum rewards: 83.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.092', 'weapon5': '0.132', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '68.000'} [2024-08-06 03:38:36,455][52665] DAMAGECOUNT value on done: 425531.0 [2024-08-06 03:38:36,455][52665] Sum rewards: 76.046, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.882', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.180', 'weapon5': '0.194', 'AMMO4': '0.198', 'AMMO3': '0.243', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '65.000'} [2024-08-06 03:38:36,895][52650] Updated weights for policy 0, policy_version 47341 (0.0031) [2024-08-06 03:38:37,266][52658] DAMAGECOUNT value on done: 424061.0 [2024-08-06 03:38:37,266][52658] Sum rewards: 67.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.181', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:37,414][52664] Large shaping reward 2.585 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.534, 178.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:38:37,503][52803] DAMAGECOUNT value on done: 407002.0 [2024-08-06 03:38:37,505][52803] Sum rewards: 76.357, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.120', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '62.000'} [2024-08-06 03:38:37,563][52662] DAMAGECOUNT value on done: 437132.0 [2024-08-06 03:38:37,565][52662] Sum rewards: 78.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.843', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.098', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '64.000'} [2024-08-06 03:38:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 387833856. Throughput: 0: 4384.2. Samples: 96963370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:38:37,795][52567] Avg episode reward: [(0, '69.838')] [2024-08-06 03:38:37,891][52671] DAMAGECOUNT value on done: 426013.0 [2024-08-06 03:38:37,891][52671] Sum rewards: 72.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon4': '0.250', 'WEAPON3': '1.000', 'weapon3': '3.212', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:38,131][52811] DAMAGECOUNT value on done: 401517.0 [2024-08-06 03:38:38,132][52811] Sum rewards: 69.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.072', 'AMMO4': '0.128', 'weapon5': '0.130', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:38,351][52660] DAMAGECOUNT value on done: 427945.0 [2024-08-06 03:38:38,360][52660] Sum rewards: 78.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.054', 'weapon5': '0.136', 'AMMO3': '0.187', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '65.000'} [2024-08-06 03:38:39,425][52665] DAMAGECOUNT value on done: 428838.0 [2024-08-06 03:38:39,426][52665] Sum rewards: 77.157, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.099', 'AMMO3': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.236', 'HEALTH': '0.340', 'WEAPON3': '0.800', 'HITCOUNT': '3.320', 'weapon3': '3.524', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:39,733][52658] DAMAGECOUNT value on done: 433879.0 [2024-08-06 03:38:39,733][52658] Sum rewards: 68.445, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.202', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:40,279][52794] DAMAGECOUNT value on done: 435085.0 [2024-08-06 03:38:40,280][52794] Sum rewards: 84.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.325', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.332', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '68.000'} [2024-08-06 03:38:40,558][52803] DAMAGECOUNT value on done: 408493.0 [2024-08-06 03:38:40,560][52803] Sum rewards: 62.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.578', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.131', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.246', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:40,584][52662] DAMAGECOUNT value on done: 431774.0 [2024-08-06 03:38:40,608][52662] Sum rewards: 54.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.875', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.126', 'weapon4': '0.146', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.132', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '47.000'} [2024-08-06 03:38:40,892][52660] DAMAGECOUNT value on done: 440776.0 [2024-08-06 03:38:40,892][52660] Sum rewards: 73.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.914', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.048', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:41,084][52650] Updated weights for policy 0, policy_version 47351 (0.0022) [2024-08-06 03:38:41,106][52671] DAMAGECOUNT value on done: 439984.0 [2024-08-06 03:38:41,106][52671] Sum rewards: 69.372, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.775', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.156', 'weapon5': '0.182', 'AMMO4': '0.228', 'weapon4': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.624', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '56.000'} [2024-08-06 03:38:41,231][52811] DAMAGECOUNT value on done: 403823.0 [2024-08-06 03:38:41,231][52811] Sum rewards: 85.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.114', 'AMMO4': '0.176', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '72.000'} [2024-08-06 03:38:42,490][52665] DAMAGECOUNT value on done: 423374.0 [2024-08-06 03:38:42,491][52665] Sum rewards: 53.971, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'AMMO5': '0.025', 'AMMO2': '0.072', 'weapon2': '0.210', 'weapon4': '0.232', 'AMMO3': '0.284', 'weapon5': '0.338', 'AMMO4': '0.362', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.650', 'HITCOUNT': '2.430', 'weapon3': '2.862', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '48.000'} [2024-08-06 03:38:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 387923968. Throughput: 0: 4374.2. Samples: 96989370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:38:42,795][52567] Avg episode reward: [(0, '69.938')] [2024-08-06 03:38:42,910][52658] DAMAGECOUNT value on done: 428926.0 [2024-08-06 03:38:42,911][52658] Sum rewards: 79.852, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO3': '0.161', 'AMMO4': '0.173', 'weapon5': '0.204', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.214', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '64.000'} [2024-08-06 03:38:43,086][52794] DAMAGECOUNT value on done: 438558.0 [2024-08-06 03:38:43,086][52794] Sum rewards: 72.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.862', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:43,637][52803] DAMAGECOUNT value on done: 408291.0 [2024-08-06 03:38:43,637][52803] Sum rewards: 72.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.025', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'weapon2': '0.244', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'weapon3': '3.494', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:43,660][52660] DAMAGECOUNT value on done: 446798.0 [2024-08-06 03:38:43,660][52660] Sum rewards: 68.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.065', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.120', 'weapon5': '0.186', 'AMMO4': '0.217', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:43,700][52662] DAMAGECOUNT value on done: 428675.0 [2024-08-06 03:38:43,701][52662] Sum rewards: 82.596, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.849', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.137', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '65.000'} [2024-08-06 03:38:43,792][52671] DAMAGECOUNT value on done: 439064.0 [2024-08-06 03:38:43,792][52671] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.945', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.120', 'AMMO3': '0.216', 'AMMO4': '0.225', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:44,296][52811] DAMAGECOUNT value on done: 408990.0 [2024-08-06 03:38:44,300][52811] Sum rewards: 64.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.094', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.290', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '56.500'} [2024-08-06 03:38:44,992][52662] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:38:45,330][52658] DAMAGECOUNT value on done: 429056.0 [2024-08-06 03:38:45,332][52658] Sum rewards: 69.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.566', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.098', 'AMMO4': '0.192', 'AMMO3': '0.208', 'weapon5': '0.244', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:45,459][52665] DAMAGECOUNT value on done: 421792.0 [2024-08-06 03:38:45,460][52665] Sum rewards: 74.333, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.088', 'weapon5': '0.088', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '60.500'} [2024-08-06 03:38:45,633][52650] Updated weights for policy 0, policy_version 47361 (0.0045) [2024-08-06 03:38:45,689][52649] DAMAGECOUNT value on done: 416567.0 [2024-08-06 03:38:45,690][52649] Sum rewards: 64.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.881', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.168', 'AMMO3': '0.190', 'AMMO4': '0.278', 'weapon2': '0.316', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '54.000'} [2024-08-06 03:38:46,080][52794] DAMAGECOUNT value on done: 435639.0 [2024-08-06 03:38:46,081][52794] Sum rewards: 72.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.504', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.102', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:46,500][52662] DAMAGECOUNT value on done: 426729.0 [2024-08-06 03:38:46,501][52662] Sum rewards: 57.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.200', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO4': '0.160', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'HITCOUNT': '3.220', 'weapon3': '3.378', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:46,595][52660] DAMAGECOUNT value on done: 427468.0 [2024-08-06 03:38:46,596][52660] Sum rewards: 68.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.124', 'AMMO4': '0.149', 'weapon2': '0.182', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.376', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:46,731][52803] DAMAGECOUNT value on done: 395358.0 [2024-08-06 03:38:46,735][52803] Sum rewards: 66.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.732', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.130', 'AMMO4': '0.135', 'weapon5': '0.188', 'AMMO3': '0.268', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.880', 'weapon3': '3.092', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '57.000'} [2024-08-06 03:38:46,851][52671] DAMAGECOUNT value on done: 439833.0 [2024-08-06 03:38:46,852][52671] Sum rewards: 56.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.216', 'weapon4': '0.230', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '2.984', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '49.000'} [2024-08-06 03:38:47,341][52811] DAMAGECOUNT value on done: 403378.0 [2024-08-06 03:38:47,343][52811] Sum rewards: 70.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.181', 'AMMO3': '0.217', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.500'} [2024-08-06 03:38:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 388014080. Throughput: 0: 4373.8. Samples: 97002370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:38:47,794][52567] Avg episode reward: [(0, '70.237')] [2024-08-06 03:38:48,095][52658] DAMAGECOUNT value on done: 426672.0 [2024-08-06 03:38:48,096][52658] Sum rewards: 71.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.767', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon4': '0.194', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:48,266][52665] DAMAGECOUNT value on done: 423156.0 [2024-08-06 03:38:48,266][52665] Sum rewards: 73.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'HITCOUNT': '3.420', 'weapon3': '3.518', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:48,526][52649] DAMAGECOUNT value on done: 413111.0 [2024-08-06 03:38:48,526][52649] Sum rewards: 68.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:48,855][52794] DAMAGECOUNT value on done: 428994.0 [2024-08-06 03:38:48,863][52794] Sum rewards: 69.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.888', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.213', 'weapon2': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.286', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:49,610][52660] DAMAGECOUNT value on done: 433169.0 [2024-08-06 03:38:49,610][52660] Sum rewards: 82.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.185', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.116', 'AMMO4': '0.143', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '67.000'} [2024-08-06 03:38:49,808][52803] DAMAGECOUNT value on done: 398812.0 [2024-08-06 03:38:49,810][52803] Sum rewards: 58.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.548', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.054', 'AMMO4': '0.087', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '50.500'} [2024-08-06 03:38:49,921][52671] DAMAGECOUNT value on done: 435603.0 [2024-08-06 03:38:49,921][52671] Sum rewards: 70.497, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.060', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.178', 'weapon5': '0.222', 'AMMO3': '0.285', 'AMMO4': '0.319', 'weapon2': '0.490', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.800', 'weapon3': '2.732', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:50,378][52811] DAMAGECOUNT value on done: 404132.0 [2024-08-06 03:38:50,379][52811] Sum rewards: 70.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.815', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.020', 'AMMO4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.270', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:50,425][52650] Updated weights for policy 0, policy_version 47371 (0.0011) [2024-08-06 03:38:50,708][52665] DAMAGECOUNT value on done: 424718.0 [2024-08-06 03:38:50,709][52665] Sum rewards: 72.948, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '59.000'} [2024-08-06 03:38:50,832][52658] DAMAGECOUNT value on done: 439389.0 [2024-08-06 03:38:50,834][52658] Sum rewards: 81.668, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.668', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.113', 'weapon5': '0.154', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.102', 'FRAGCOUNT': '66.500'} [2024-08-06 03:38:51,043][52649] DAMAGECOUNT value on done: 424752.0 [2024-08-06 03:38:51,044][52649] Sum rewards: 77.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.492', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:51,528][52794] DAMAGECOUNT value on done: 428917.0 [2024-08-06 03:38:51,531][52794] Sum rewards: 63.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO4': '0.138', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.210', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:52,359][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:38:52,576][52660] DAMAGECOUNT value on done: 428158.0 [2024-08-06 03:38:52,580][52660] Sum rewards: 77.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.938', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon4': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.188', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:52,597][52671] DAMAGECOUNT value on done: 434417.0 [2024-08-06 03:38:52,597][52671] Sum rewards: 70.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.123', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.180', 'AMMO4': '0.201', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '58.000'} [2024-08-06 03:38:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 388096000. Throughput: 0: 4374.7. Samples: 97028730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:38:52,794][52567] Avg episode reward: [(0, '70.499')] [2024-08-06 03:38:52,982][52803] DAMAGECOUNT value on done: 399238.0 [2024-08-06 03:38:52,982][52803] Sum rewards: 78.369, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.863', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.144', 'AMMO3': '0.164', 'weapon5': '0.272', 'weapon2': '0.314', 'AMMO4': '0.315', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '61.000'} [2024-08-06 03:38:53,466][52811] DAMAGECOUNT value on done: 407691.0 [2024-08-06 03:38:53,468][52811] Sum rewards: 81.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '68.000'} [2024-08-06 03:38:53,697][52658] DAMAGECOUNT value on done: 430072.0 [2024-08-06 03:38:53,698][52658] Sum rewards: 61.466, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO4': '0.174', 'weapon5': '0.174', 'AMMO3': '0.203', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HEALTH': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '52.000'} [2024-08-06 03:38:53,699][52665] DAMAGECOUNT value on done: 429406.0 [2024-08-06 03:38:53,701][52665] Sum rewards: 80.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.044', 'weapon4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.452', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '66.000'} [2024-08-06 03:38:53,940][52649] DAMAGECOUNT value on done: 418475.0 [2024-08-06 03:38:53,941][52649] Sum rewards: 64.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.134', 'weapon2': '0.188', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '53.000'} [2024-08-06 03:38:53,972][52794] DAMAGECOUNT value on done: 435564.0 [2024-08-06 03:38:53,973][52794] Sum rewards: 72.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.094', 'AMMO3': '0.218', 'AMMO4': '0.247', 'weapon5': '0.298', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '60.000'} [2024-08-06 03:38:55,595][52650] Updated weights for policy 0, policy_version 47381 (0.0021) [2024-08-06 03:38:55,667][52660] DAMAGECOUNT value on done: 430938.0 [2024-08-06 03:38:55,668][52660] Sum rewards: 68.550, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.236', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.133', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.000', 'HITCOUNT': '3.250', 'weapon3': '3.380', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '55.000'} [2024-08-06 03:38:56,025][52803] DAMAGECOUNT value on done: 406252.0 [2024-08-06 03:38:56,027][52803] Sum rewards: 74.713, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.112', 'weapon4': '0.122', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '62.000'} [2024-08-06 03:38:56,503][52658] DAMAGECOUNT value on done: 435056.0 [2024-08-06 03:38:56,505][52658] Sum rewards: 79.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.164', 'AMMO4': '0.194', 'weapon4': '0.196', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '66.000'} [2024-08-06 03:38:56,590][52811] DAMAGECOUNT value on done: 405198.0 [2024-08-06 03:38:56,593][52811] Sum rewards: 78.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.220', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.190', 'AMMO3': '0.220', 'weapon5': '0.262', 'AMMO4': '0.304', 'weapon2': '0.318', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:57,194][52794] DAMAGECOUNT value on done: 438741.0 [2024-08-06 03:38:57,194][52794] Sum rewards: 64.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.848', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.190', 'AMMO3': '0.216', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '54.000'} [2024-08-06 03:38:57,299][52649] DAMAGECOUNT value on done: 410344.0 [2024-08-06 03:38:57,303][52649] Sum rewards: 61.401, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.120', 'weapon5': '0.126', 'weapon2': '0.162', 'AMMO4': '0.233', 'AMMO3': '0.293', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '3.190', 'weapon3': '3.374', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '53.500'} [2024-08-06 03:38:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 388186112. Throughput: 0: 4376.4. Samples: 97055150. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:38:57,795][52567] Avg episode reward: [(0, '70.767')] [2024-08-06 03:38:58,706][52660] DAMAGECOUNT value on done: 426320.0 [2024-08-06 03:38:58,708][52660] Sum rewards: 65.235, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.269', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.052', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon2': '0.284', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.462', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '53.000'} [2024-08-06 03:38:59,068][52803] DAMAGECOUNT value on done: 397191.0 [2024-08-06 03:38:59,069][52803] Sum rewards: 56.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.578', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.198', 'weapon5': '0.204', 'AMMO3': '0.225', 'weapon2': '0.240', 'AMMO4': '0.293', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '3.052', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '49.000'} [2024-08-06 03:38:59,258][52658] DAMAGECOUNT value on done: 437943.0 [2024-08-06 03:38:59,258][52658] Sum rewards: 73.848, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon4': '0.208', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.236', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '63.000'} [2024-08-06 03:38:59,473][52650] Updated weights for policy 0, policy_version 47391 (0.0010) [2024-08-06 03:38:59,646][52811] DAMAGECOUNT value on done: 403741.0 [2024-08-06 03:38:59,646][52811] Sum rewards: 78.514, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.514', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.140', 'weapon5': '0.144', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.000', 'weapon3': '3.132', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '61.000'} [2024-08-06 03:39:00,341][52794] DAMAGECOUNT value on done: 429490.0 [2024-08-06 03:39:00,343][52794] Sum rewards: 77.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon2': '0.154', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.490', 'weapon3': '3.522', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '64.000'} [2024-08-06 03:39:00,476][52649] DAMAGECOUNT value on done: 423564.0 [2024-08-06 03:39:00,476][52649] Sum rewards: 87.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.004', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO2': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.203', 'AMMO3': '0.231', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.528', 'HITCOUNT': '4.270', 'DAMAGECOUNT': '21.318', 'FRAGCOUNT': '71.000'} [2024-08-06 03:39:02,410][52803] DAMAGECOUNT value on done: 409628.0 [2024-08-06 03:39:02,411][52803] Sum rewards: 72.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon5': '0.176', 'AMMO3': '0.231', 'AMMO4': '0.275', 'weapon4': '0.314', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.778', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '60.500'} [2024-08-06 03:39:02,558][52659] DAMAGECOUNT value on done: 433517.0 [2024-08-06 03:39:02,558][52659] Sum rewards: 61.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.724', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.092', 'AMMO4': '0.138', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '53.000'} [2024-08-06 03:39:02,669][52811] DAMAGECOUNT value on done: 414035.0 [2024-08-06 03:39:02,670][52811] Sum rewards: 71.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.330', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon4': '0.182', 'AMMO3': '0.191', 'weapon2': '0.220', 'weapon5': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.084', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:02,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 388284416. Throughput: 0: 4373.1. Samples: 97068370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:39:02,794][52567] Avg episode reward: [(0, '71.065')] [2024-08-06 03:39:03,372][52649] DAMAGECOUNT value on done: 417658.0 [2024-08-06 03:39:03,374][52649] Sum rewards: 66.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.070', 'weapon5': '0.070', 'AMMO4': '0.131', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.304', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '56.000'} [2024-08-06 03:39:03,718][52794] DAMAGECOUNT value on done: 436498.0 [2024-08-06 03:39:03,727][52794] Sum rewards: 65.866, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.948', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.098', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.264', 'WEAPON3': '1.100', 'HITCOUNT': '3.210', 'weapon3': '3.438', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2024-08-06 03:39:04,782][52650] Updated weights for policy 0, policy_version 47401 (0.0013) [2024-08-06 03:39:05,015][52659] DAMAGECOUNT value on done: 433704.0 [2024-08-06 03:39:05,015][52659] Sum rewards: 73.713, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.102', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.308', 'WEAPON3': '0.950', 'weapon3': '3.250', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '57.000'} [2024-08-06 03:39:05,628][52803] DAMAGECOUNT value on done: 403553.0 [2024-08-06 03:39:05,628][52803] Sum rewards: 68.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.124', 'weapon5': '0.170', 'AMMO3': '0.200', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '57.000'} [2024-08-06 03:39:05,892][52811] DAMAGECOUNT value on done: 403328.0 [2024-08-06 03:39:05,893][52811] Sum rewards: 53.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.094', 'AMMO4': '0.140', 'weapon2': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '2.630', 'weapon3': '3.480', 'DAMAGECOUNT': '13.131', 'FRAGCOUNT': '47.000'} [2024-08-06 03:39:06,474][52649] DAMAGECOUNT value on done: 424577.0 [2024-08-06 03:39:06,476][52649] Sum rewards: 76.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.045', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:06,767][52794] DAMAGECOUNT value on done: 434082.0 [2024-08-06 03:39:06,767][52794] Sum rewards: 81.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.119', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.109', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.256', 'weapon2': '0.446', 'WEAPON3': '0.950', 'weapon3': '2.996', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '65.000'} [2024-08-06 03:39:07,792][52659] DAMAGECOUNT value on done: 436501.0 [2024-08-06 03:39:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 388366336. Throughput: 0: 4370.9. Samples: 97094580. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:39:07,795][52567] Avg episode reward: [(0, '70.722')] [2024-08-06 03:39:07,792][52659] Sum rewards: 75.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.876', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.086', 'weapon5': '0.140', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.946', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:08,801][52803] DAMAGECOUNT value on done: 404126.0 [2024-08-06 03:39:08,801][52803] Sum rewards: 62.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.856', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.134', 'weapon2': '0.160', 'weapon5': '0.172', 'AMMO4': '0.234', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.334', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '54.000'} [2024-08-06 03:39:08,998][52811] DAMAGECOUNT value on done: 401882.0 [2024-08-06 03:39:09,000][52811] Sum rewards: 72.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'AMMO4': '0.224', 'weapon2': '0.318', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:09,048][52650] Updated weights for policy 0, policy_version 47411 (0.0014) [2024-08-06 03:39:09,560][52649] DAMAGECOUNT value on done: 424923.0 [2024-08-06 03:39:09,560][52649] Sum rewards: 68.761, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.226', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO3': '0.113', 'AMMO4': '0.138', 'weapon5': '0.196', 'weapon4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.700', 'WEAPON3': '0.800', 'weapon3': '2.686', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '52.500'} [2024-08-06 03:39:09,630][52794] DAMAGECOUNT value on done: 429060.0 [2024-08-06 03:39:09,633][52794] Sum rewards: 69.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.072', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.290', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.300', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '59.000'} [2024-08-06 03:39:10,460][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:39:10,858][52659] DAMAGECOUNT value on done: 431921.0 [2024-08-06 03:39:10,858][52659] Sum rewards: 65.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.053', 'weapon4': '0.110', 'AMMO3': '0.172', 'weapon5': '0.210', 'AMMO4': '0.263', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '52.000'} [2024-08-06 03:39:11,905][52803] DAMAGECOUNT value on done: 407850.0 [2024-08-06 03:39:11,905][52803] Sum rewards: 62.316, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.193', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO4': '0.185', 'AMMO3': '0.229', 'weapon2': '0.276', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '2.930', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '53.000'} [2024-08-06 03:39:12,094][52811] DAMAGECOUNT value on done: 406374.0 [2024-08-06 03:39:12,094][52811] Sum rewards: 70.010, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.202', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.153', 'AMMO4': '0.222', 'weapon5': '0.360', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.450', 'WEAPON3': '0.850', 'weapon3': '2.462', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:12,593][52794] DAMAGECOUNT value on done: 436574.0 [2024-08-06 03:39:12,594][52794] Sum rewards: 73.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.146', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.224', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:12,656][52649] DAMAGECOUNT value on done: 419306.0 [2024-08-06 03:39:12,659][52649] Sum rewards: 65.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.026', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO3': '0.201', 'AMMO4': '0.207', 'weapon5': '0.276', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.884', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '54.500'} [2024-08-06 03:39:12,676][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:39:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 388448256. Throughput: 0: 4370.9. Samples: 97120750. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:39:12,794][52567] Avg episode reward: [(0, '70.607')] [2024-08-06 03:39:13,866][52650] Updated weights for policy 0, policy_version 47421 (0.0019) [2024-08-06 03:39:13,886][52659] DAMAGECOUNT value on done: 430219.0 [2024-08-06 03:39:13,889][52659] Sum rewards: 52.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.096', 'weapon4': '0.172', 'AMMO4': '0.183', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.002', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '45.000'} [2024-08-06 03:39:15,188][52811] DAMAGECOUNT value on done: 401171.0 [2024-08-06 03:39:15,188][52811] Sum rewards: 79.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.754', 'AMMO5': '0.011', 'weapon4': '0.036', 'AMMO2': '0.043', 'weapon5': '0.102', 'AMMO3': '0.187', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 03:39:15,243][52803] DAMAGECOUNT value on done: 402017.0 [2024-08-06 03:39:15,244][52803] Sum rewards: 60.461, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.032', 'AMMO4': '0.119', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '3.192', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '47.500'} [2024-08-06 03:39:15,436][52794] DAMAGECOUNT value on done: 424960.0 [2024-08-06 03:39:15,437][52794] Sum rewards: 70.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.625', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.062', 'AMMO4': '0.106', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:15,668][52649] DAMAGECOUNT value on done: 425592.0 [2024-08-06 03:39:15,669][52649] Sum rewards: 65.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.096', 'AMMO4': '0.176', 'weapon5': '0.176', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.303', 'WEAPON3': '1.750', 'HITCOUNT': '3.070', 'weapon3': '3.214', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '58.000'} [2024-08-06 03:39:16,448][52659] DAMAGECOUNT value on done: 433992.0 [2024-08-06 03:39:16,449][52659] Sum rewards: 71.871, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.590', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.268', 'AMMO3': '0.339', 'WEAPON3': '1.950', 'weapon3': '3.424', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '64.000'} [2024-08-06 03:39:16,715][52795] DAMAGECOUNT value on done: 401855.0 [2024-08-06 03:39:16,718][52795] Sum rewards: 58.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.748', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.106', 'weapon5': '0.148', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.334', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '49.000'} [2024-08-06 03:39:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 388538368. Throughput: 0: 4374.9. Samples: 97133890. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:39:17,794][52567] Avg episode reward: [(0, '70.339')] [2024-08-06 03:39:17,879][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:39:18,231][52803] DAMAGECOUNT value on done: 401132.0 [2024-08-06 03:39:18,232][52803] Sum rewards: 54.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.270', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.137', 'AMMO4': '0.244', 'weapon5': '0.270', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.572', 'WEAPON3': '0.800', 'weapon3': '2.520', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '14.985', 'FRAGCOUNT': '41.500'} [2024-08-06 03:39:18,364][52811] DAMAGECOUNT value on done: 403952.0 [2024-08-06 03:39:18,366][52811] Sum rewards: 69.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.107', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.208', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.474', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '57.000'} [2024-08-06 03:39:18,492][52649] DAMAGECOUNT value on done: 427709.0 [2024-08-06 03:39:18,493][52649] Sum rewards: 72.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.906', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'weapon2': '0.218', 'AMMO3': '0.237', 'weapon4': '0.248', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '61.000'} [2024-08-06 03:39:18,736][52650] Updated weights for policy 0, policy_version 47431 (0.0029) [2024-08-06 03:39:18,801][52794] DAMAGECOUNT value on done: 444102.0 [2024-08-06 03:39:18,801][52794] Sum rewards: 58.006, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.654', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.178', 'weapon4': '0.184', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.104', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '50.000'} [2024-08-06 03:39:19,229][52659] DAMAGECOUNT value on done: 433688.0 [2024-08-06 03:39:19,230][52659] Sum rewards: 67.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.189', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.074', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '57.000'} [2024-08-06 03:39:19,946][52795] DAMAGECOUNT value on done: 393300.0 [2024-08-06 03:39:19,950][52795] Sum rewards: 73.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.605', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.200', 'weapon5': '0.256', 'weapon2': '0.258', 'weapon4': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '60.500'} [2024-08-06 03:39:21,358][52803] DAMAGECOUNT value on done: 408779.0 [2024-08-06 03:39:21,360][52803] Sum rewards: 52.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.670', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.102', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '47.000'} [2024-08-06 03:39:21,407][52811] DAMAGECOUNT value on done: 404305.0 [2024-08-06 03:39:21,408][52811] Sum rewards: 70.792, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.056', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon5': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '57.000'} [2024-08-06 03:39:21,606][52649] DAMAGECOUNT value on done: 426750.0 [2024-08-06 03:39:21,607][52649] Sum rewards: 75.216, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.194', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.332', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:21,719][52794] DAMAGECOUNT value on done: 427591.0 [2024-08-06 03:39:21,720][52794] Sum rewards: 72.931, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.244', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon4': '0.182', 'weapon5': '0.222', 'AMMO3': '0.237', 'weapon2': '0.282', 'WEAPON5': '0.300', 'AMMO4': '0.303', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '61.000'} [2024-08-06 03:39:21,916][52659] DAMAGECOUNT value on done: 431891.0 [2024-08-06 03:39:21,917][52659] Sum rewards: 78.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.756', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.140', 'weapon4': '0.144', 'WEAPON4': '0.150', 'weapon5': '0.228', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'weapon3': '3.168', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '61.000'} [2024-08-06 03:39:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 388628480. Throughput: 0: 4371.8. Samples: 97160100. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:39:22,794][52567] Avg episode reward: [(0, '70.110')] [2024-08-06 03:39:23,072][52650] Updated weights for policy 0, policy_version 47441 (0.0026) [2024-08-06 03:39:23,198][52795] DAMAGECOUNT value on done: 393848.0 [2024-08-06 03:39:23,199][52795] Sum rewards: 63.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.243', 'weapon2': '0.598', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:24,255][52794] DAMAGECOUNT value on done: 442977.0 [2024-08-06 03:39:24,263][52794] Sum rewards: 68.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.476', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.398', 'WEAPON3': '1.000', 'HITCOUNT': '3.150', 'weapon3': '3.440', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:24,453][52811] DAMAGECOUNT value on done: 404761.0 [2024-08-06 03:39:24,453][52811] Sum rewards: 67.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.090', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.376', 'weapon4': '0.378', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:24,477][52803] DAMAGECOUNT value on done: 406441.0 [2024-08-06 03:39:24,477][52803] Sum rewards: 81.755, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.142', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.096', 'AMMO4': '0.220', 'weapon5': '0.224', 'AMMO3': '0.252', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '70.000'} [2024-08-06 03:39:24,684][52649] DAMAGECOUNT value on done: 427516.0 [2024-08-06 03:39:24,685][52649] Sum rewards: 64.917, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.595', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.167', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2024-08-06 03:39:25,129][52659] DAMAGECOUNT value on done: 442286.0 [2024-08-06 03:39:25,129][52659] Sum rewards: 67.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.066', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.244', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.336', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '58.000'} [2024-08-06 03:39:26,330][52795] DAMAGECOUNT value on done: 398972.0 [2024-08-06 03:39:26,331][52795] Sum rewards: 57.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.173', 'AMMO3': '0.201', 'weapon2': '0.276', 'weapon5': '0.298', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.754', 'DAMAGECOUNT': '14.430', 'FRAGCOUNT': '48.000'} [2024-08-06 03:39:27,392][52811] DAMAGECOUNT value on done: 404925.0 [2024-08-06 03:39:27,394][52811] Sum rewards: 75.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.065', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.060', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.496', 'WEAPON3': '0.950', 'weapon3': '3.218', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:27,414][52794] DAMAGECOUNT value on done: 434693.0 [2024-08-06 03:39:27,414][52794] Sum rewards: 65.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.215', 'weapon2': '0.230', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.236', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '54.000'} [2024-08-06 03:39:27,460][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:39:27,595][52803] DAMAGECOUNT value on done: 406886.0 [2024-08-06 03:39:27,597][52803] Sum rewards: 80.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.382', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon2': '0.212', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.470', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '68.000'} [2024-08-06 03:39:27,713][52649] DAMAGECOUNT value on done: 417327.0 [2024-08-06 03:39:27,715][52649] Sum rewards: 68.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.161', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 388710400. Throughput: 0: 4373.3. Samples: 97186170. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:39:27,794][52567] Avg episode reward: [(0, '69.771')] [2024-08-06 03:39:27,967][52659] DAMAGECOUNT value on done: 442296.0 [2024-08-06 03:39:27,970][52659] Sum rewards: 70.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.438', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.136', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.500'} [2024-08-06 03:39:28,183][52650] Updated weights for policy 0, policy_version 47451 (0.0013) [2024-08-06 03:39:29,458][52795] DAMAGECOUNT value on done: 395055.0 [2024-08-06 03:39:29,460][52795] Sum rewards: 62.811, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.144', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon5': '0.188', 'weapon2': '0.196', 'AMMO4': '0.223', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.258', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:30,169][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:39:30,295][52794] DAMAGECOUNT value on done: 436317.0 [2024-08-06 03:39:30,295][52794] Sum rewards: 55.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.096', 'weapon4': '0.154', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '44.500'} [2024-08-06 03:39:30,719][52803] DAMAGECOUNT value on done: 402530.0 [2024-08-06 03:39:30,719][52803] Sum rewards: 67.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.537', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.164', 'weapon5': '0.186', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.650', 'weapon3': '2.794', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '59.000'} [2024-08-06 03:39:30,770][52649] DAMAGECOUNT value on done: 426143.0 [2024-08-06 03:39:30,772][52649] Sum rewards: 63.928, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.126', 'weapon5': '0.206', 'weapon2': '0.232', 'AMMO3': '0.281', 'AMMO4': '0.296', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '3.050', 'weapon3': '3.100', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '56.500'} [2024-08-06 03:39:31,086][52659] DAMAGECOUNT value on done: 434010.0 [2024-08-06 03:39:31,086][52659] Sum rewards: 79.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.265', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.052', 'weapon5': '0.122', 'AMMO4': '0.209', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '67.000'} [2024-08-06 03:39:32,390][52666] DAMAGECOUNT value on done: 431519.0 [2024-08-06 03:39:32,391][52666] Sum rewards: 77.398, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.084', 'weapon4': '0.130', 'AMMO3': '0.178', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:32,638][52795] DAMAGECOUNT value on done: 402881.0 [2024-08-06 03:39:32,638][52795] Sum rewards: 58.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.026', 'AMMO2': '0.044', 'AMMO3': '0.215', 'AMMO4': '0.221', 'weapon4': '0.240', 'weapon5': '0.294', 'weapon2': '0.370', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.752', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '49.000'} [2024-08-06 03:39:32,742][52794] DAMAGECOUNT value on done: 440651.0 [2024-08-06 03:39:32,742][52794] Sum rewards: 68.101, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.403', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.114', 'weapon4': '0.148', 'AMMO4': '0.149', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 388792320. Throughput: 0: 4381.6. Samples: 97199540. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 03:39:32,794][52567] Avg episode reward: [(0, '69.281')] [2024-08-06 03:39:32,888][52650] Updated weights for policy 0, policy_version 47461 (0.0023) [2024-08-06 03:39:33,374][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:39:33,935][52649] DAMAGECOUNT value on done: 418572.0 [2024-08-06 03:39:33,937][52649] Sum rewards: 53.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.416', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO4': '0.215', 'AMMO3': '0.220', 'weapon4': '0.232', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.950', 'FRAGCOUNT': '47.000'} [2024-08-06 03:39:34,193][52659] DAMAGECOUNT value on done: 436579.0 [2024-08-06 03:39:34,193][52659] Sum rewards: 70.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.908', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.178', 'weapon2': '0.220', 'AMMO3': '0.238', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'weapon4': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:35,041][52666] DAMAGECOUNT value on done: 438324.0 [2024-08-06 03:39:35,042][52666] Sum rewards: 67.882, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.796', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon2': '0.236', 'AMMO3': '0.263', 'WEAPON3': '1.550', 'HITCOUNT': '3.340', 'weapon3': '3.380', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '59.000'} [2024-08-06 03:39:35,712][52795] DAMAGECOUNT value on done: 408749.0 [2024-08-06 03:39:35,712][52795] Sum rewards: 60.003, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.275', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.126', 'weapon5': '0.136', 'AMMO4': '0.191', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '52.000'} [2024-08-06 03:39:35,879][52794] DAMAGECOUNT value on done: 432698.0 [2024-08-06 03:39:35,890][52794] Sum rewards: 68.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '58.000'} [2024-08-06 03:39:35,963][52670] DAMAGECOUNT value on done: 424640.0 [2024-08-06 03:39:35,963][52670] Sum rewards: 68.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.894', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.294', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '59.000'} [2024-08-06 03:39:36,879][52649] DAMAGECOUNT value on done: 427671.0 [2024-08-06 03:39:36,881][52649] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.223', 'weapon5': '0.224', 'weapon2': '0.262', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 03:39:37,046][52659] DAMAGECOUNT value on done: 427209.0 [2024-08-06 03:39:37,047][52659] Sum rewards: 94.442, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.285', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.120', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.272', 'weapon2': '0.420', 'WEAPON3': '1.000', 'weapon3': '3.010', 'HITCOUNT': '4.340', 'DAMAGECOUNT': '22.380', 'FRAGCOUNT': '74.000'} [2024-08-06 03:39:37,327][52650] Updated weights for policy 0, policy_version 47471 (0.0013) [2024-08-06 03:39:37,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 388890624. Throughput: 0: 4381.8. Samples: 97225910. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:39:37,795][52567] Avg episode reward: [(0, '69.412')] [2024-08-06 03:39:38,183][52666] DAMAGECOUNT value on done: 436222.0 [2024-08-06 03:39:38,185][52666] Sum rewards: 71.739, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'HEALTH': '0.090', 'weapon4': '0.182', 'AMMO3': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '58.000'} [2024-08-06 03:39:38,608][52803] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:39:38,774][52795] DAMAGECOUNT value on done: 403114.0 [2024-08-06 03:39:38,774][52795] Sum rewards: 59.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.108', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.084', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '3.236', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '53.000'} [2024-08-06 03:39:38,894][52670] DAMAGECOUNT value on done: 434829.0 [2024-08-06 03:39:38,896][52670] Sum rewards: 67.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.535', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.140', 'AMMO4': '0.166', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '56.000'} [2024-08-06 03:39:39,913][52649] DAMAGECOUNT value on done: 429749.0 [2024-08-06 03:39:39,914][52649] Sum rewards: 71.563, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.172', 'weapon2': '0.236', 'weapon4': '0.542', 'WEAPON3': '1.050', 'weapon3': '3.094', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '58.000'} [2024-08-06 03:39:40,029][52659] DAMAGECOUNT value on done: 434094.0 [2024-08-06 03:39:40,032][52659] Sum rewards: 70.958, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.882', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.125', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'weapon3': '3.384', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:41,090][52666] DAMAGECOUNT value on done: 434862.0 [2024-08-06 03:39:41,100][52666] Sum rewards: 81.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.105', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'weapon4': '0.080', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '67.000'} [2024-08-06 03:39:41,386][52663] DAMAGECOUNT value on done: 438705.0 [2024-08-06 03:39:41,388][52663] Sum rewards: 65.503, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.272', 'weapon2': '0.452', 'WEAPON3': '1.600', 'weapon3': '3.286', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '56.000'} [2024-08-06 03:39:41,777][52650] Updated weights for policy 0, policy_version 47481 (0.0022) [2024-08-06 03:39:41,899][52795] DAMAGECOUNT value on done: 392891.0 [2024-08-06 03:39:41,901][52795] Sum rewards: 79.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.079', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.186', 'weapon4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '64.000'} [2024-08-06 03:39:42,072][52670] DAMAGECOUNT value on done: 427639.0 [2024-08-06 03:39:42,073][52670] Sum rewards: 82.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.764', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.110', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '68.000'} [2024-08-06 03:39:42,720][52659] DAMAGECOUNT value on done: 443585.0 [2024-08-06 03:39:42,721][52659] Sum rewards: 65.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.611', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.068', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.430', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '56.000'} [2024-08-06 03:39:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 388972544. Throughput: 0: 4379.8. Samples: 97252240. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:39:42,794][52567] Avg episode reward: [(0, '69.659')] [2024-08-06 03:39:43,053][52649] DAMAGECOUNT value on done: 422868.0 [2024-08-06 03:39:43,054][52649] Sum rewards: 68.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.393', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.094', 'AMMO4': '0.132', 'AMMO3': '0.167', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.842', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '57.000'} [2024-08-06 03:39:44,329][52663] DAMAGECOUNT value on done: 434498.0 [2024-08-06 03:39:44,330][52663] Sum rewards: 78.415, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.848', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon5': '0.206', 'AMMO3': '0.244', 'AMMO4': '0.256', 'weapon4': '0.324', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '66.500'} [2024-08-06 03:39:44,386][52666] DAMAGECOUNT value on done: 434931.0 [2024-08-06 03:39:44,389][52666] Sum rewards: 59.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.325', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.120', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.154', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '48.000'} [2024-08-06 03:39:44,992][52795] DAMAGECOUNT value on done: 408339.0 [2024-08-06 03:39:44,994][52795] Sum rewards: 82.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.061', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.164', 'AMMO3': '0.252', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '69.000'} [2024-08-06 03:39:45,247][52670] DAMAGECOUNT value on done: 425924.0 [2024-08-06 03:39:45,250][52670] Sum rewards: 80.142, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.394', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon4': '0.090', 'AMMO3': '0.184', 'AMMO4': '0.197', 'weapon2': '0.264', 'weapon5': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '64.000'} [2024-08-06 03:39:45,848][52659] DAMAGECOUNT value on done: 439167.0 [2024-08-06 03:39:45,851][52659] Sum rewards: 59.219, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.813', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.160', 'AMMO4': '0.187', 'weapon2': '0.214', 'weapon5': '0.284', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.854', 'WEAPON3': '1.050', 'weapon3': '2.330', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.199', 'FRAGCOUNT': '48.000'} [2024-08-06 03:39:46,647][52650] Updated weights for policy 0, policy_version 47491 (0.0012) [2024-08-06 03:39:47,522][52663] DAMAGECOUNT value on done: 428154.0 [2024-08-06 03:39:47,522][52663] Sum rewards: 78.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.628', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.152', 'weapon4': '0.172', 'weapon2': '0.186', 'AMMO3': '0.196', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '64.000'} [2024-08-06 03:39:47,554][52666] DAMAGECOUNT value on done: 426401.0 [2024-08-06 03:39:47,554][52666] Sum rewards: 78.636, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.208', 'weapon2': '0.228', 'AMMO3': '0.238', 'weapon4': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '66.000'} [2024-08-06 03:39:47,683][52794] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 03:39:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 389062656. Throughput: 0: 4376.0. Samples: 97265290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:39:47,794][52567] Avg episode reward: [(0, '69.477')] [2024-08-06 03:39:48,070][52795] DAMAGECOUNT value on done: 399455.0 [2024-08-06 03:39:48,071][52795] Sum rewards: 73.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.669', 'AMMO2': '0.007', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:48,428][52670] DAMAGECOUNT value on done: 436814.0 [2024-08-06 03:39:48,437][52659] DAMAGECOUNT value on done: 440619.0 [2024-08-06 03:39:48,433][52670] Sum rewards: 74.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.406', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.155', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.316', 'weapon4': '0.320', 'WEAPON3': '1.000', 'weapon3': '3.024', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '59.000'} [2024-08-06 03:39:48,438][52659] Sum rewards: 68.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.510', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '56.000'} [2024-08-06 03:39:50,196][52663] DAMAGECOUNT value on done: 433343.0 [2024-08-06 03:39:50,197][52663] Sum rewards: 57.971, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.435', 'AMMO5': '0.025', 'AMMO2': '0.071', 'AMMO3': '0.260', 'weapon5': '0.280', 'weapon4': '0.308', 'weapon2': '0.346', 'AMMO4': '0.356', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.740', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '53.000'} [2024-08-06 03:39:50,444][52664] DAMAGECOUNT value on done: 450351.0 [2024-08-06 03:39:50,445][52664] Sum rewards: 68.888, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.160', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.104', 'weapon5': '0.200', 'weapon2': '0.268', 'AMMO4': '0.270', 'AMMO3': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:50,670][52666] DAMAGECOUNT value on done: 433328.0 [2024-08-06 03:39:50,671][52666] Sum rewards: 53.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.160', 'weapon4': '0.190', 'AMMO3': '0.208', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '2.760', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '45.500'} [2024-08-06 03:39:51,322][52795] DAMAGECOUNT value on done: 399304.0 [2024-08-06 03:39:51,323][52795] Sum rewards: 64.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.862', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.084', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '55.500'} [2024-08-06 03:39:51,485][52650] Updated weights for policy 0, policy_version 47501 (0.0020) [2024-08-06 03:39:51,609][52670] DAMAGECOUNT value on done: 429764.0 [2024-08-06 03:39:51,609][52670] Sum rewards: 71.457, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.574', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.212', 'weapon5': '0.248', 'AMMO3': '0.275', 'weapon2': '0.276', 'AMMO4': '0.294', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.930', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:51,781][52659] DAMAGECOUNT value on done: 432251.0 [2024-08-06 03:39:51,789][52659] Sum rewards: 72.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.052', 'AMMO4': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 389152768. Throughput: 0: 4366.9. Samples: 97291090. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:39:52,795][52567] Avg episode reward: [(0, '69.080')] [2024-08-06 03:39:52,929][52663] DAMAGECOUNT value on done: 432693.0 [2024-08-06 03:39:52,930][52663] Sum rewards: 85.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.835', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '71.000'} [2024-08-06 03:39:52,940][52664] DAMAGECOUNT value on done: 454692.0 [2024-08-06 03:39:52,940][52664] Sum rewards: 65.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.090', 'AMMO3': '0.170', 'weapon5': '0.174', 'AMMO4': '0.206', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.174', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '53.500'} [2024-08-06 03:39:53,558][52666] DAMAGECOUNT value on done: 432351.0 [2024-08-06 03:39:53,560][52666] Sum rewards: 77.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.991', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.162', 'AMMO3': '0.181', 'weapon2': '0.262', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.356', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '64.000'} [2024-08-06 03:39:54,490][52670] DAMAGECOUNT value on done: 423126.0 [2024-08-06 03:39:54,491][52670] Sum rewards: 70.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.390', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.136', 'AMMO3': '0.159', 'weapon5': '0.250', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.670', 'WEAPON3': '0.950', 'weapon3': '2.718', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:54,562][52795] DAMAGECOUNT value on done: 395015.0 [2024-08-06 03:39:54,569][52795] Sum rewards: 77.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.082', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.050', 'weapon3': '3.318', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '62.000'} [2024-08-06 03:39:54,955][52659] DAMAGECOUNT value on done: 437288.0 [2024-08-06 03:39:54,957][52659] Sum rewards: 61.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.292', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.156', 'weapon4': '0.206', 'AMMO4': '0.225', 'AMMO3': '0.249', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.972', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:55,710][52663] DAMAGECOUNT value on done: 436004.0 [2024-08-06 03:39:55,710][52663] Sum rewards: 70.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.708', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.124', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '60.000'} [2024-08-06 03:39:55,715][52650] Updated weights for policy 0, policy_version 47511 (0.0021) [2024-08-06 03:39:56,132][52664] DAMAGECOUNT value on done: 455355.0 [2024-08-06 03:39:56,135][52664] Sum rewards: 67.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.468', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.166', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2024-08-06 03:39:56,512][52666] DAMAGECOUNT value on done: 429065.0 [2024-08-06 03:39:56,512][52666] Sum rewards: 67.263, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.042', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '55.000'} [2024-08-06 03:39:57,209][52670] DAMAGECOUNT value on done: 427838.0 [2024-08-06 03:39:57,219][52670] Sum rewards: 72.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.558', 'AMMO5': '0.010', 'AMMO2': '0.049', 'AMMO3': '0.175', 'weapon5': '0.180', 'weapon4': '0.196', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '59.000'} [2024-08-06 03:39:57,743][52795] DAMAGECOUNT value on done: 403390.0 [2024-08-06 03:39:57,744][52795] Sum rewards: 67.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.114', 'weapon4': '0.120', 'AMMO4': '0.165', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '56.500'} [2024-08-06 03:39:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 389234688. Throughput: 0: 4372.2. Samples: 97317500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:39:57,795][52567] Avg episode reward: [(0, '69.184')] [2024-08-06 03:39:57,957][52659] DAMAGECOUNT value on done: 436399.0 [2024-08-06 03:39:57,961][52659] Sum rewards: 75.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.176', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.151', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '61.000'} [2024-08-06 03:39:58,443][52663] DAMAGECOUNT value on done: 434843.0 [2024-08-06 03:39:58,444][52663] Sum rewards: 64.245, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.286', 'weapon2': '0.438', 'WEAPON3': '1.600', 'weapon3': '3.292', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '56.000'} [2024-08-06 03:39:59,134][52666] DAMAGECOUNT value on done: 423554.0 [2024-08-06 03:39:59,135][52666] Sum rewards: 51.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.357', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.213', 'weapon4': '0.232', 'AMMO4': '0.240', 'weapon5': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.502', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.130', 'FRAGCOUNT': '43.000'} [2024-08-06 03:39:59,229][52664] DAMAGECOUNT value on done: 449548.0 [2024-08-06 03:39:59,229][52664] Sum rewards: 66.274, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.110', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.094', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.230', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '58.000'} [2024-08-06 03:39:59,713][52670] DAMAGECOUNT value on done: 429721.0 [2024-08-06 03:39:59,713][52670] Sum rewards: 78.506, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.620', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.132', 'AMMO3': '0.163', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '63.000'} [2024-08-06 03:40:00,681][52650] Updated weights for policy 0, policy_version 47521 (0.0013) [2024-08-06 03:40:00,893][52795] DAMAGECOUNT value on done: 393922.0 [2024-08-06 03:40:00,894][52795] Sum rewards: 85.921, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.999', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.414', 'weapon4': '0.476', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '68.000'} [2024-08-06 03:40:01,336][52663] DAMAGECOUNT value on done: 428976.0 [2024-08-06 03:40:01,336][52663] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.476', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.223', 'weapon4': '0.232', 'AMMO4': '0.249', 'weapon5': '0.266', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '52.000'} [2024-08-06 03:40:02,180][52664] DAMAGECOUNT value on done: 452940.0 [2024-08-06 03:40:02,181][52664] Sum rewards: 80.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon5': '0.060', 'weapon4': '0.062', 'AMMO4': '0.134', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:02,239][52666] DAMAGECOUNT value on done: 429801.0 [2024-08-06 03:40:02,247][52666] Sum rewards: 76.155, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.264', 'weapon2': '0.384', 'WEAPON3': '1.600', 'weapon3': '3.304', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '65.000'} [2024-08-06 03:40:02,725][52670] DAMAGECOUNT value on done: 425523.0 [2024-08-06 03:40:02,725][52670] Sum rewards: 74.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.349', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.079', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '60.500'} [2024-08-06 03:40:02,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17203.2, 300 sec: 17494.8). Total num frames: 389316608. Throughput: 0: 4371.3. Samples: 97330600. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:40:02,794][52567] Avg episode reward: [(0, '69.303')] [2024-08-06 03:40:03,635][52663] DAMAGECOUNT value on done: 428236.0 [2024-08-06 03:40:03,635][52663] Sum rewards: 63.892, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.014', 'AMMO2': '0.033', 'HEALTH': '0.112', 'AMMO4': '0.163', 'weapon5': '0.180', 'weapon4': '0.202', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.754', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '53.000'} [2024-08-06 03:40:03,976][52795] DAMAGECOUNT value on done: 411171.0 [2024-08-06 03:40:03,976][52795] Sum rewards: 78.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.145', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon4': '0.092', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'AMMO4': '0.238', 'weapon2': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.364', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:04,378][52820] DAMAGECOUNT value on done: 397906.0 [2024-08-06 03:40:04,379][52820] Sum rewards: 68.173, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.930', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.344', 'WEAPON3': '1.500', 'HITCOUNT': '3.370', 'weapon3': '3.418', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '57.000'} [2024-08-06 03:40:05,088][52664] DAMAGECOUNT value on done: 450109.0 [2024-08-06 03:40:05,089][52664] Sum rewards: 80.333, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.172', 'AMMO3': '0.199', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:05,114][52666] DAMAGECOUNT value on done: 428310.0 [2024-08-06 03:40:05,114][52666] Sum rewards: 74.959, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.222', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.116', 'weapon5': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.192', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:05,589][52670] DAMAGECOUNT value on done: 432556.0 [2024-08-06 03:40:05,591][52670] Sum rewards: 58.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.318', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.100', 'AMMO4': '0.191', 'AMMO3': '0.214', 'weapon5': '0.228', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.028', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '51.000'} [2024-08-06 03:40:05,766][52650] Updated weights for policy 0, policy_version 47531 (0.0011) [2024-08-06 03:40:05,895][52663] DAMAGECOUNT value on done: 436092.0 [2024-08-06 03:40:05,897][52663] Sum rewards: 77.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.484', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.066', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.232', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '64.000'} [2024-08-06 03:40:06,300][52614] Signal inference workers to stop experience collection... (8600 times) [2024-08-06 03:40:06,301][52614] Signal inference workers to resume experience collection... (8600 times) [2024-08-06 03:40:06,396][52650] InferenceWorker_p0-w0: stopping experience collection (8600 times) [2024-08-06 03:40:06,396][52650] InferenceWorker_p0-w0: resuming experience collection (8600 times) [2024-08-06 03:40:06,593][52647] DAMAGECOUNT value on done: 457569.0 [2024-08-06 03:40:06,595][52647] Sum rewards: 61.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.982', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.092', 'weapon4': '0.134', 'AMMO3': '0.215', 'AMMO4': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '52.000'} [2024-08-06 03:40:07,106][52795] DAMAGECOUNT value on done: 403917.0 [2024-08-06 03:40:07,108][52795] Sum rewards: 63.491, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.700', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.198', 'weapon4': '0.214', 'weapon2': '0.242', 'AMMO4': '0.266', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.972', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '57.000'} [2024-08-06 03:40:07,607][52820] DAMAGECOUNT value on done: 401675.0 [2024-08-06 03:40:07,609][52820] Sum rewards: 72.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.127', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.224', 'AMMO3': '0.226', 'WEAPON3': '1.450', 'weapon3': '3.408', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 389406720. Throughput: 0: 4373.1. Samples: 97356890. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 03:40:07,795][52567] Avg episode reward: [(0, '69.652')] [2024-08-06 03:40:07,798][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:40:08,020][52666] DAMAGECOUNT value on done: 438444.0 [2024-08-06 03:40:08,021][52666] Sum rewards: 76.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.187', 'weapon2': '0.206', 'AMMO3': '0.209', 'weapon5': '0.250', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '63.000'} [2024-08-06 03:40:08,257][52664] DAMAGECOUNT value on done: 450901.0 [2024-08-06 03:40:08,259][52664] Sum rewards: 65.571, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.516', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.076', 'AMMO4': '0.168', 'weapon5': '0.220', 'weapon2': '0.284', 'AMMO3': '0.287', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '3.080', 'weapon3': '3.110', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '59.000'} [2024-08-06 03:40:08,750][52670] DAMAGECOUNT value on done: 425729.0 [2024-08-06 03:40:08,751][52670] Sum rewards: 71.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.063', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.192', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:08,813][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:40:09,104][52663] DAMAGECOUNT value on done: 441137.0 [2024-08-06 03:40:09,104][52663] Sum rewards: 72.130, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.505', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.156', 'weapon2': '0.158', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.456', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:09,628][52647] DAMAGECOUNT value on done: 457810.0 [2024-08-06 03:40:09,631][52647] Sum rewards: 68.155, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.735', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.262', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.398', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:09,722][52650] Updated weights for policy 0, policy_version 47541 (0.0013) [2024-08-06 03:40:10,141][52795] DAMAGECOUNT value on done: 394941.0 [2024-08-06 03:40:10,144][52795] Sum rewards: 71.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.015', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.251', 'weapon2': '0.360', 'WEAPON3': '1.600', 'weapon3': '3.272', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:10,944][52820] DAMAGECOUNT value on done: 402244.0 [2024-08-06 03:40:10,946][52820] Sum rewards: 55.582, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.820', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.132', 'weapon4': '0.208', 'AMMO4': '0.226', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '2.930', 'weapon3': '2.970', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 03:40:11,207][52666] DAMAGECOUNT value on done: 434736.0 [2024-08-06 03:40:11,211][52666] Sum rewards: 70.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.036', 'weapon5': '0.136', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:11,235][52664] DAMAGECOUNT value on done: 443530.0 [2024-08-06 03:40:11,236][52664] Sum rewards: 71.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.627', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.224', 'AMMO3': '0.227', 'weapon2': '0.232', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:12,023][52663] DAMAGECOUNT value on done: 433249.0 [2024-08-06 03:40:12,024][52663] Sum rewards: 68.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.816', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.144', 'AMMO4': '0.191', 'weapon5': '0.236', 'AMMO3': '0.239', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.500', 'weapon3': '2.720', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:12,135][52670] DAMAGECOUNT value on done: 426727.0 [2024-08-06 03:40:12,136][52670] Sum rewards: 67.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.150', 'weapon2': '0.172', 'AMMO4': '0.189', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:12,644][52647] DAMAGECOUNT value on done: 458433.0 [2024-08-06 03:40:12,655][52647] Sum rewards: 82.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.620', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.415', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 389505024. Throughput: 0: 4370.4. Samples: 97382840. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 03:40:12,794][52567] Avg episode reward: [(0, '70.166')] [2024-08-06 03:40:13,373][52795] DAMAGECOUNT value on done: 402923.0 [2024-08-06 03:40:13,374][52795] Sum rewards: 83.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.023', 'AMMO2': '0.050', 'weapon5': '0.174', 'AMMO3': '0.207', 'AMMO4': '0.252', 'weapon2': '0.278', 'weapon4': '0.290', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '67.000'} [2024-08-06 03:40:13,905][52664] DAMAGECOUNT value on done: 455717.0 [2024-08-06 03:40:13,905][52664] Sum rewards: 73.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:14,035][52666] DAMAGECOUNT value on done: 430909.0 [2024-08-06 03:40:14,035][52666] Sum rewards: 78.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.236', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.078', 'weapon5': '0.186', 'AMMO4': '0.205', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:14,115][52820] DAMAGECOUNT value on done: 397546.0 [2024-08-06 03:40:14,116][52820] Sum rewards: 77.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.566', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:14,786][52670] DAMAGECOUNT value on done: 438758.0 [2024-08-06 03:40:14,787][52670] Sum rewards: 73.887, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.174', 'AMMO5': '0.023', 'AMMO2': '0.058', 'weapon4': '0.112', 'AMMO3': '0.237', 'weapon5': '0.272', 'AMMO4': '0.288', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:14,832][52663] DAMAGECOUNT value on done: 428505.0 [2024-08-06 03:40:14,832][52663] Sum rewards: 58.802, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.455', 'AMMO5': '0.023', 'AMMO2': '0.060', 'AMMO3': '0.227', 'weapon4': '0.248', 'weapon5': '0.288', 'AMMO4': '0.298', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '50.500'} [2024-08-06 03:40:14,900][52650] Updated weights for policy 0, policy_version 47551 (0.0024) [2024-08-06 03:40:15,034][52647] DAMAGECOUNT value on done: 466157.0 [2024-08-06 03:40:15,034][52647] Sum rewards: 75.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.345', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:16,356][52664] DAMAGECOUNT value on done: 447147.0 [2024-08-06 03:40:16,358][52664] Sum rewards: 76.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.923', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.082', 'AMMO3': '0.189', 'AMMO4': '0.223', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '64.000'} [2024-08-06 03:40:16,463][52795] DAMAGECOUNT value on done: 407392.0 [2024-08-06 03:40:16,466][52795] Sum rewards: 62.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.827', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.320', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.256', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '53.000'} [2024-08-06 03:40:16,729][52811] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:40:16,881][52666] DAMAGECOUNT value on done: 430398.0 [2024-08-06 03:40:16,883][52666] Sum rewards: 54.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.120', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.179', 'weapon4': '0.206', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '2.950', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '46.000'} [2024-08-06 03:40:17,239][52647] DAMAGECOUNT value on done: 463994.0 [2024-08-06 03:40:17,239][52647] Sum rewards: 76.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.704', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.136', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO4': '0.219', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '64.000'} [2024-08-06 03:40:17,406][52820] DAMAGECOUNT value on done: 405645.0 [2024-08-06 03:40:17,413][52820] Sum rewards: 79.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO4': '0.180', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '65.000'} [2024-08-06 03:40:17,539][52670] DAMAGECOUNT value on done: 432132.0 [2024-08-06 03:40:17,539][52670] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.344', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.104', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.328', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '64.000'} [2024-08-06 03:40:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 389586944. Throughput: 0: 4363.3. Samples: 97395890. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 03:40:17,802][52567] Avg episode reward: [(0, '70.487')] [2024-08-06 03:40:17,934][52663] DAMAGECOUNT value on done: 427337.0 [2024-08-06 03:40:17,939][52663] Sum rewards: 71.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.255', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.136', 'weapon5': '0.186', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:19,028][52664] DAMAGECOUNT value on done: 458165.0 [2024-08-06 03:40:19,031][52664] Sum rewards: 84.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.226', 'WEAPON3': '1.250', 'weapon3': '3.478', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '69.000'} [2024-08-06 03:40:19,462][52666] DAMAGECOUNT value on done: 431407.0 [2024-08-06 03:40:19,464][52666] Sum rewards: 71.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.286', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.130', 'AMMO3': '0.219', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:19,665][52650] Updated weights for policy 0, policy_version 47561 (0.0023) [2024-08-06 03:40:19,831][52667] DAMAGECOUNT value on done: 430704.0 [2024-08-06 03:40:19,832][52667] Sum rewards: 76.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.118', 'AMMO3': '0.176', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '63.000'} [2024-08-06 03:40:20,088][52670] DAMAGECOUNT value on done: 417586.0 [2024-08-06 03:40:20,090][52670] Sum rewards: 69.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.733', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.060', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon2': '0.884', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '57.000'} [2024-08-06 03:40:20,331][52647] DAMAGECOUNT value on done: 460815.0 [2024-08-06 03:40:20,333][52647] Sum rewards: 83.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.221', 'weapon4': '0.230', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '70.000'} [2024-08-06 03:40:20,527][52820] DAMAGECOUNT value on done: 395879.0 [2024-08-06 03:40:20,528][52820] Sum rewards: 62.344, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.208', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.166', 'AMMO4': '0.209', 'weapon2': '0.256', 'weapon5': '0.288', 'AMMO3': '0.289', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.962', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '54.000'} [2024-08-06 03:40:20,822][52663] DAMAGECOUNT value on done: 428598.0 [2024-08-06 03:40:20,824][52663] Sum rewards: 73.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.856', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.100', 'weapon5': '0.136', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.380', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:21,751][52664] DAMAGECOUNT value on done: 452471.0 [2024-08-06 03:40:21,752][52664] Sum rewards: 67.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.169', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'weapon4': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '55.000'} [2024-08-06 03:40:22,243][52666] DAMAGECOUNT value on done: 433584.0 [2024-08-06 03:40:22,244][52666] Sum rewards: 75.556, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon2': '0.228', 'AMMO3': '0.286', 'WEAPON3': '1.800', 'weapon3': '3.602', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:22,588][52667] DAMAGECOUNT value on done: 440847.0 [2024-08-06 03:40:22,589][52667] Sum rewards: 68.306, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.102', 'AMMO3': '0.182', 'weapon2': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.446', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2024-08-06 03:40:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 389668864. Throughput: 0: 4368.7. Samples: 97422500. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 03:40:22,794][52567] Avg episode reward: [(0, '71.248')] [2024-08-06 03:40:22,833][52647] DAMAGECOUNT value on done: 459784.0 [2024-08-06 03:40:22,833][52647] Sum rewards: 72.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.072', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:22,845][52670] DAMAGECOUNT value on done: 429896.0 [2024-08-06 03:40:22,847][52670] Sum rewards: 68.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.068', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '3.280', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:23,721][52820] DAMAGECOUNT value on done: 399889.0 [2024-08-06 03:40:23,721][52820] Sum rewards: 80.107, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.227', 'weapon2': '0.246', 'WEAPON3': '1.400', 'weapon3': '3.576', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '67.000'} [2024-08-06 03:40:23,878][52650] Updated weights for policy 0, policy_version 47571 (0.0034) [2024-08-06 03:40:23,946][52663] DAMAGECOUNT value on done: 438969.0 [2024-08-06 03:40:23,946][52663] Sum rewards: 77.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.602', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon2': '0.182', 'weapon5': '0.198', 'AMMO3': '0.240', 'weapon4': '0.258', 'AMMO4': '0.295', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '65.000'} [2024-08-06 03:40:24,570][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:40:24,725][52664] DAMAGECOUNT value on done: 461219.0 [2024-08-06 03:40:24,726][52664] Sum rewards: 79.666, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.260', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.036', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:24,995][52659] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:40:24,996][52666] DAMAGECOUNT value on done: 422484.0 [2024-08-06 03:40:24,996][52666] Sum rewards: 63.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.140', 'weapon2': '0.166', 'weapon5': '0.198', 'AMMO4': '0.211', 'AMMO3': '0.235', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.192', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 03:40:25,561][52667] DAMAGECOUNT value on done: 432871.0 [2024-08-06 03:40:25,562][52667] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.314', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.139', 'weapon5': '0.162', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.276', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '54.000'} [2024-08-06 03:40:25,599][52670] DAMAGECOUNT value on done: 438586.0 [2024-08-06 03:40:25,599][52670] Sum rewards: 74.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.202', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '3.390', 'weapon3': '3.396', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:25,905][52647] DAMAGECOUNT value on done: 453393.0 [2024-08-06 03:40:25,907][52647] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.842', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.120', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '64.000'} [2024-08-06 03:40:26,875][52663] DAMAGECOUNT value on done: 429915.0 [2024-08-06 03:40:26,875][52663] Sum rewards: 56.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.938', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.184', 'AMMO3': '0.230', 'AMMO4': '0.234', 'weapon5': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.350', 'HITCOUNT': '2.680', 'weapon3': '2.744', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '48.000'} [2024-08-06 03:40:26,928][52820] DAMAGECOUNT value on done: 404809.0 [2024-08-06 03:40:26,930][52820] Sum rewards: 75.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.518', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.173', 'weapon2': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.174', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '64.000'} [2024-08-06 03:40:27,728][52666] DAMAGECOUNT value on done: 429084.0 [2024-08-06 03:40:27,729][52666] Sum rewards: 45.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.580', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.054', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.316', 'weapon4': '0.362', 'WEAPON3': '0.950', 'HITCOUNT': '2.350', 'weapon3': '2.866', 'DAMAGECOUNT': '11.724', 'FRAGCOUNT': '36.500'} [2024-08-06 03:40:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 389758976. Throughput: 0: 4365.3. Samples: 97448680. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 03:40:27,802][52567] Avg episode reward: [(0, '71.055')] [2024-08-06 03:40:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047578_389758976.pth... [2024-08-06 03:40:27,801][52664] DAMAGECOUNT value on done: 454386.0 [2024-08-06 03:40:27,808][52664] Sum rewards: 74.526, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.728', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:27,951][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047066_385564672.pth [2024-08-06 03:40:28,412][52670] DAMAGECOUNT value on done: 428949.0 [2024-08-06 03:40:28,412][52670] Sum rewards: 73.006, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.535', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.186', 'weapon2': '0.236', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.544', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:28,868][52667] DAMAGECOUNT value on done: 435201.0 [2024-08-06 03:40:28,869][52667] Sum rewards: 69.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.130', 'AMMO4': '0.164', 'weapon5': '0.192', 'weapon2': '0.228', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '59.000'} [2024-08-06 03:40:28,872][52647] DAMAGECOUNT value on done: 465424.0 [2024-08-06 03:40:28,873][52647] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.674', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.096', 'AMMO4': '0.180', 'weapon5': '0.204', 'AMMO3': '0.235', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:28,917][52650] Updated weights for policy 0, policy_version 47581 (0.0016) [2024-08-06 03:40:29,627][52663] DAMAGECOUNT value on done: 436810.0 [2024-08-06 03:40:29,628][52663] Sum rewards: 81.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.058', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.173', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '67.000'} [2024-08-06 03:40:30,040][52820] DAMAGECOUNT value on done: 400645.0 [2024-08-06 03:40:30,040][52820] Sum rewards: 65.793, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.082', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.350', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '56.000'} [2024-08-06 03:40:30,338][52664] DAMAGECOUNT value on done: 456963.0 [2024-08-06 03:40:30,338][52664] Sum rewards: 82.635, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.078', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '68.000'} [2024-08-06 03:40:31,159][52647] DAMAGECOUNT value on done: 454876.0 [2024-08-06 03:40:31,161][52647] Sum rewards: 80.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.559', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '65.000'} [2024-08-06 03:40:31,361][52670] DAMAGECOUNT value on done: 432694.0 [2024-08-06 03:40:31,362][52670] Sum rewards: 78.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:32,231][52667] DAMAGECOUNT value on done: 441090.0 [2024-08-06 03:40:32,233][52667] Sum rewards: 69.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.856', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.118', 'AMMO3': '0.196', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 03:40:32,650][52663] DAMAGECOUNT value on done: 434690.0 [2024-08-06 03:40:32,650][52663] Sum rewards: 67.743, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.906', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.138', 'weapon4': '0.156', 'AMMO3': '0.213', 'AMMO4': '0.265', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '57.500'} [2024-08-06 03:40:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 389849088. Throughput: 0: 4359.6. Samples: 97461470. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 03:40:32,794][52567] Avg episode reward: [(0, '71.217')] [2024-08-06 03:40:32,936][52664] DAMAGECOUNT value on done: 450535.0 [2024-08-06 03:40:32,937][52664] Sum rewards: 77.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.454', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '64.000'} [2024-08-06 03:40:33,100][52820] DAMAGECOUNT value on done: 408320.0 [2024-08-06 03:40:33,104][52820] Sum rewards: 67.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.192', 'weapon2': '0.222', 'weapon5': '0.224', 'AMMO3': '0.256', 'AMMO4': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:33,711][52647] DAMAGECOUNT value on done: 458823.0 [2024-08-06 03:40:33,711][52647] Sum rewards: 75.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.365', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.092', 'weapon5': '0.116', 'AMMO4': '0.161', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '63.000'} [2024-08-06 03:40:33,926][52650] Updated weights for policy 0, policy_version 47591 (0.0034) [2024-08-06 03:40:35,124][52667] DAMAGECOUNT value on done: 442336.0 [2024-08-06 03:40:35,126][52667] Sum rewards: 77.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.112', 'weapon5': '0.176', 'AMMO3': '0.182', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:35,458][52663] DAMAGECOUNT value on done: 427903.0 [2024-08-06 03:40:35,460][52663] Sum rewards: 68.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.982', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.138', 'AMMO4': '0.168', 'weapon5': '0.194', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '2.808', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '59.000'} [2024-08-06 03:40:35,607][52664] DAMAGECOUNT value on done: 450130.0 [2024-08-06 03:40:35,608][52664] Sum rewards: 67.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.144', 'weapon5': '0.176', 'AMMO4': '0.246', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '59.000'} [2024-08-06 03:40:36,234][52647] DAMAGECOUNT value on done: 451465.0 [2024-08-06 03:40:36,234][52647] Sum rewards: 60.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.174', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.088', 'weapon5': '0.090', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.286', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '49.000'} [2024-08-06 03:40:36,258][52820] DAMAGECOUNT value on done: 399359.0 [2024-08-06 03:40:36,259][52820] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.175', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.086', 'weapon4': '0.108', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.336', 'AMMO3': '0.376', 'WEAPON3': '2.200', 'weapon3': '3.144', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 389939200. Throughput: 0: 4370.2. Samples: 97487750. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:40:37,794][52567] Avg episode reward: [(0, '71.397')] [2024-08-06 03:40:38,004][52667] DAMAGECOUNT value on done: 437911.0 [2024-08-06 03:40:38,005][52667] Sum rewards: 65.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.435', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.106', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.000'} [2024-08-06 03:40:38,035][52664] DAMAGECOUNT value on done: 451697.0 [2024-08-06 03:40:38,036][52664] Sum rewards: 71.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.546', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'AMMO3': '0.295', 'weapon4': '0.344', 'weapon2': '0.374', 'WEAPON3': '1.750', 'weapon3': '3.030', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:38,088][52650] Updated weights for policy 0, policy_version 47601 (0.0013) [2024-08-06 03:40:38,595][52647] DAMAGECOUNT value on done: 458158.0 [2024-08-06 03:40:38,611][52647] Sum rewards: 76.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.081', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.058', 'AMMO4': '0.072', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.227', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '63.000'} [2024-08-06 03:40:39,361][52820] DAMAGECOUNT value on done: 403627.0 [2024-08-06 03:40:39,362][52820] Sum rewards: 69.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.208', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.256', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '55.000'} [2024-08-06 03:40:40,369][52667] DAMAGECOUNT value on done: 436167.0 [2024-08-06 03:40:40,369][52667] Sum rewards: 77.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.122', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.550', 'weapon3': '2.900', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '65.500'} [2024-08-06 03:40:40,377][52664] DAMAGECOUNT value on done: 449274.0 [2024-08-06 03:40:40,377][52664] Sum rewards: 62.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.460', 'AMMO5': '0.009', 'AMMO2': '0.061', 'weapon5': '0.124', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.280', 'AMMO4': '0.303', 'weapon4': '0.380', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '53.000'} [2024-08-06 03:40:40,933][52671] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:40:40,944][52647] DAMAGECOUNT value on done: 455004.0 [2024-08-06 03:40:40,944][52647] Sum rewards: 72.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.181', 'AMMO4': '0.208', 'weapon4': '0.312', 'weapon2': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '60.000'} [2024-08-06 03:40:42,427][52820] DAMAGECOUNT value on done: 407342.0 [2024-08-06 03:40:42,428][52820] Sum rewards: 73.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.075', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.103', 'weapon5': '0.116', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:42,795][52567] Fps is (10 sec: 17201.5, 60 sec: 17476.0, 300 sec: 17494.7). Total num frames: 390021120. Throughput: 0: 4372.8. Samples: 97514280. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:40:42,795][52567] Avg episode reward: [(0, '71.286')] [2024-08-06 03:40:42,830][52667] DAMAGECOUNT value on done: 438146.0 [2024-08-06 03:40:42,830][52667] Sum rewards: 75.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon5': '0.188', 'AMMO3': '0.238', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '62.000'} [2024-08-06 03:40:43,043][52650] Updated weights for policy 0, policy_version 47611 (0.0030) [2024-08-06 03:40:43,265][52664] DAMAGECOUNT value on done: 449994.0 [2024-08-06 03:40:43,266][52664] Sum rewards: 69.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.358', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.362', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.438', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '57.000'} [2024-08-06 03:40:44,042][52647] DAMAGECOUNT value on done: 464364.0 [2024-08-06 03:40:44,043][52647] Sum rewards: 73.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.176', 'AMMO3': '0.185', 'weapon4': '0.198', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:45,137][52647] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.027, -9.0), ('weapon5', 0.002)] [2024-08-06 03:40:45,469][52820] DAMAGECOUNT value on done: 403105.0 [2024-08-06 03:40:45,471][52820] Sum rewards: 68.113, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.736', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.204', 'AMMO3': '0.208', 'weapon5': '0.214', 'weapon2': '0.270', 'AMMO4': '0.305', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:45,526][52669] DAMAGECOUNT value on done: 440830.0 [2024-08-06 03:40:45,528][52669] Sum rewards: 73.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:45,953][52667] DAMAGECOUNT value on done: 445370.0 [2024-08-06 03:40:45,953][52667] Sum rewards: 82.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.865', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.180', 'AMMO3': '0.199', 'weapon2': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '67.000'} [2024-08-06 03:40:46,395][52647] DAMAGECOUNT value on done: 455742.0 [2024-08-06 03:40:46,395][52647] Sum rewards: 69.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon2': '0.202', 'AMMO3': '0.249', 'WEAPON3': '1.450', 'HITCOUNT': '3.380', 'weapon3': '3.678', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '59.000'} [2024-08-06 03:40:47,335][52650] Updated weights for policy 0, policy_version 47621 (0.0013) [2024-08-06 03:40:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 390111232. Throughput: 0: 4376.2. Samples: 97527530. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:40:47,794][52567] Avg episode reward: [(0, '71.549')] [2024-08-06 03:40:48,155][52668] DAMAGECOUNT value on done: 435381.0 [2024-08-06 03:40:48,155][52668] Sum rewards: 68.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.094', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.114', 'weapon4': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '55.000'} [2024-08-06 03:40:48,326][52669] DAMAGECOUNT value on done: 430787.0 [2024-08-06 03:40:48,326][52669] Sum rewards: 74.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.744', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.134', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.650', 'weapon3': '3.182', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '65.000'} [2024-08-06 03:40:48,547][52820] DAMAGECOUNT value on done: 408515.0 [2024-08-06 03:40:48,548][52820] Sum rewards: 60.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.422', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon5': '0.172', 'weapon4': '0.176', 'AMMO3': '0.204', 'AMMO4': '0.324', 'WEAPON5': '0.600', 'weapon2': '0.632', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.500'} [2024-08-06 03:40:48,712][52667] DAMAGECOUNT value on done: 432146.0 [2024-08-06 03:40:48,712][52667] Sum rewards: 75.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.181', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.128', 'weapon4': '0.166', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.050', 'weapon3': '3.158', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:49,370][52647] DAMAGECOUNT value on done: 452376.0 [2024-08-06 03:40:49,370][52647] Sum rewards: 67.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.219', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.132', 'weapon7': '0.134', 'AMMO4': '0.142', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.362', 'WEAPON3': '1.500', 'weapon3': '2.692', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:50,697][52668] DAMAGECOUNT value on done: 438716.0 [2024-08-06 03:40:50,697][52668] Sum rewards: 71.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.366', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.154', 'weapon5': '0.184', 'AMMO3': '0.212', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '58.000'} [2024-08-06 03:40:51,522][52669] DAMAGECOUNT value on done: 439370.0 [2024-08-06 03:40:51,524][52669] Sum rewards: 64.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.134', 'AMMO3': '0.208', 'AMMO4': '0.269', 'weapon2': '0.306', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 03:40:51,712][52820] DAMAGECOUNT value on done: 402812.0 [2024-08-06 03:40:51,712][52820] Sum rewards: 78.912, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.190', 'HEALTH': '0.290', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '63.000'} [2024-08-06 03:40:51,744][52667] DAMAGECOUNT value on done: 435978.0 [2024-08-06 03:40:51,744][52667] Sum rewards: 63.853, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.448', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.142', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.626', 'weapon2': '0.672', 'WEAPON3': '0.950', 'weapon3': '2.264', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '47.000'} [2024-08-06 03:40:51,869][52647] DAMAGECOUNT value on done: 454579.0 [2024-08-06 03:40:51,869][52647] Sum rewards: 66.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.175', 'AMMO2': '0.020', 'AMMO5': '0.024', 'weapon4': '0.068', 'AMMO4': '0.101', 'weapon5': '0.112', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '55.000'} [2024-08-06 03:40:52,525][52650] Updated weights for policy 0, policy_version 47631 (0.0024) [2024-08-06 03:40:52,794][52567] Fps is (10 sec: 18024.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 390201344. Throughput: 0: 4378.7. Samples: 97553930. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:40:52,794][52567] Avg episode reward: [(0, '71.269')] [2024-08-06 03:40:53,705][52668] DAMAGECOUNT value on done: 438962.0 [2024-08-06 03:40:53,705][52668] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.186', 'weapon4': '0.188', 'AMMO4': '0.203', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.928', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '59.000'} [2024-08-06 03:40:54,168][52667] DAMAGECOUNT value on done: 439721.0 [2024-08-06 03:40:54,169][52667] Sum rewards: 76.541, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.087', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.274', 'weapon2': '0.392', 'WEAPON3': '1.650', 'weapon3': '3.234', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:54,255][52647] DAMAGECOUNT value on done: 452995.0 [2024-08-06 03:40:54,255][52647] Sum rewards: 64.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.285', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.140', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon2': '1.120', 'weapon3': '2.582', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '49.000'} [2024-08-06 03:40:54,539][52669] DAMAGECOUNT value on done: 434063.0 [2024-08-06 03:40:54,541][52669] Sum rewards: 68.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.100', 'weapon5': '0.166', 'AMMO3': '0.169', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.802', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '57.000'} [2024-08-06 03:40:55,019][52820] DAMAGECOUNT value on done: 403233.0 [2024-08-06 03:40:55,019][52820] Sum rewards: 75.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.102', 'AMMO4': '0.150', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON3': '1.350', 'weapon3': '3.512', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '61.000'} [2024-08-06 03:40:56,712][52667] DAMAGECOUNT value on done: 432674.0 [2024-08-06 03:40:56,716][52667] Sum rewards: 69.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.160', 'AMMO4': '0.198', 'weapon2': '0.210', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '57.000'} [2024-08-06 03:40:56,783][52668] DAMAGECOUNT value on done: 439826.0 [2024-08-06 03:40:56,783][52668] Sum rewards: 44.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.124', 'weapon5': '0.126', 'weapon7': '0.154', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.936', 'WEAPON3': '1.200', 'HITCOUNT': '2.150', 'weapon3': '2.280', 'DAMAGECOUNT': '12.042', 'FRAGCOUNT': '39.000'} [2024-08-06 03:40:56,972][52650] Updated weights for policy 0, policy_version 47641 (0.0015) [2024-08-06 03:40:57,151][52647] DAMAGECOUNT value on done: 455530.0 [2024-08-06 03:40:57,151][52647] Sum rewards: 82.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.695', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.186', 'weapon5': '0.214', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '66.000'} [2024-08-06 03:40:57,426][52669] DAMAGECOUNT value on done: 437071.0 [2024-08-06 03:40:57,426][52669] Sum rewards: 81.145, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.194', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon2': '0.284', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.108', 'FRAGCOUNT': '67.000'} [2024-08-06 03:40:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 390283264. Throughput: 0: 4374.7. Samples: 97579700. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:40:57,794][52567] Avg episode reward: [(0, '71.256')] [2024-08-06 03:40:58,249][52820] DAMAGECOUNT value on done: 413695.0 [2024-08-06 03:40:58,253][52820] Sum rewards: 80.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.420', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.144', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.254', 'weapon4': '0.302', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '63.000'} [2024-08-06 03:40:59,276][52668] DAMAGECOUNT value on done: 429057.0 [2024-08-06 03:40:59,277][52668] Sum rewards: 65.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.450', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '53.500'} [2024-08-06 03:40:59,690][52667] DAMAGECOUNT value on done: 439825.0 [2024-08-06 03:40:59,691][52667] Sum rewards: 80.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.040', 'weapon5': '0.068', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.229', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '66.000'} [2024-08-06 03:41:00,080][52669] DAMAGECOUNT value on done: 441881.0 [2024-08-06 03:41:00,081][52669] Sum rewards: 70.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.865', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:01,321][52820] DAMAGECOUNT value on done: 414296.0 [2024-08-06 03:41:01,321][52820] Sum rewards: 74.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.200', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:01,525][52650] Updated weights for policy 0, policy_version 47651 (0.0021) [2024-08-06 03:41:02,365][52668] DAMAGECOUNT value on done: 440335.0 [2024-08-06 03:41:02,367][52668] Sum rewards: 73.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.284', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.202', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '61.000'} [2024-08-06 03:41:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 390373376. Throughput: 0: 4379.6. Samples: 97592970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:41:02,794][52567] Avg episode reward: [(0, '71.653')] [2024-08-06 03:41:02,795][52614] Saving new best policy, reward=71.653! [2024-08-06 03:41:02,814][52667] DAMAGECOUNT value on done: 446733.0 [2024-08-06 03:41:02,816][52667] Sum rewards: 78.222, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.146', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.092', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '67.000'} [2024-08-06 03:41:02,860][52669] DAMAGECOUNT value on done: 435528.0 [2024-08-06 03:41:02,861][52669] Sum rewards: 62.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.442', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.230', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '52.000'} [2024-08-06 03:41:03,623][52662] DAMAGECOUNT value on done: 440668.0 [2024-08-06 03:41:03,623][52662] Sum rewards: 58.826, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.758', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.198', 'AMMO4': '0.209', 'weapon5': '0.236', 'weapon2': '0.242', 'AMMO3': '0.325', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.996', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:04,609][52820] DAMAGECOUNT value on done: 402241.0 [2024-08-06 03:41:04,610][52820] Sum rewards: 72.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.216', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.714', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:04,636][52667] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:41:05,477][52668] DAMAGECOUNT value on done: 440245.0 [2024-08-06 03:41:05,477][52668] Sum rewards: 79.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '65.000'} [2024-08-06 03:41:05,631][52667] DAMAGECOUNT value on done: 442696.0 [2024-08-06 03:41:05,633][52667] Sum rewards: 66.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.356', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '56.000'} [2024-08-06 03:41:06,019][52669] DAMAGECOUNT value on done: 437388.0 [2024-08-06 03:41:06,022][52669] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.207', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:06,571][52650] Updated weights for policy 0, policy_version 47661 (0.0026) [2024-08-06 03:41:06,860][52662] DAMAGECOUNT value on done: 441252.0 [2024-08-06 03:41:06,862][52662] Sum rewards: 76.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.023', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.344', 'weapon4': '0.352', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.000'} [2024-08-06 03:41:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 390463488. Throughput: 0: 4362.7. Samples: 97618820. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-06 03:41:07,794][52567] Avg episode reward: [(0, '71.324')] [2024-08-06 03:41:08,200][52668] DAMAGECOUNT value on done: 432403.0 [2024-08-06 03:41:08,208][52668] Sum rewards: 74.834, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.925', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.052', 'weapon4': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '3.218', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:08,555][52667] DAMAGECOUNT value on done: 441047.0 [2024-08-06 03:41:08,555][52667] Sum rewards: 72.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.746', 'AMMO5': '0.023', 'AMMO2': '0.045', 'AMMO3': '0.192', 'AMMO4': '0.227', 'weapon4': '0.252', 'weapon5': '0.258', 'weapon2': '0.502', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.686', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:08,592][52669] DAMAGECOUNT value on done: 441289.0 [2024-08-06 03:41:08,593][52669] Sum rewards: 61.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.017', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.083', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '51.000'} [2024-08-06 03:41:09,800][52671] DAMAGECOUNT value on done: 440289.0 [2024-08-06 03:41:09,801][52671] Sum rewards: 56.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO4': '0.190', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '49.000'} [2024-08-06 03:41:10,078][52662] DAMAGECOUNT value on done: 441357.0 [2024-08-06 03:41:10,080][52662] Sum rewards: 67.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:10,754][52660] DAMAGECOUNT value on done: 434327.0 [2024-08-06 03:41:10,754][52660] Sum rewards: 74.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.528', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.054', 'weapon5': '0.068', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '62.000'} [2024-08-06 03:41:11,030][52650] Updated weights for policy 0, policy_version 47671 (0.0011) [2024-08-06 03:41:11,077][52668] DAMAGECOUNT value on done: 433899.0 [2024-08-06 03:41:11,077][52668] Sum rewards: 81.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '65.000'} [2024-08-06 03:41:11,153][52665] DAMAGECOUNT value on done: 428561.0 [2024-08-06 03:41:11,155][52665] Sum rewards: 66.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.417', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.146', 'weapon2': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.080', 'weapon3': '3.350', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:11,401][52669] DAMAGECOUNT value on done: 436688.0 [2024-08-06 03:41:11,402][52669] Sum rewards: 68.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.508', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.186', 'AMMO4': '0.204', 'weapon2': '0.220', 'weapon5': '0.222', 'AMMO3': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.058', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '58.500'} [2024-08-06 03:41:11,626][52667] DAMAGECOUNT value on done: 435714.0 [2024-08-06 03:41:11,630][52667] Sum rewards: 81.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.512', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '67.000'} [2024-08-06 03:41:12,330][52671] DAMAGECOUNT value on done: 440217.0 [2024-08-06 03:41:12,330][52671] Sum rewards: 74.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.198', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.142', 'AMMO3': '0.162', 'weapon5': '0.176', 'AMMO4': '0.178', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 390553600. Throughput: 0: 4364.9. Samples: 97645100. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-06 03:41:12,794][52567] Avg episode reward: [(0, '71.295')] [2024-08-06 03:41:13,059][52660] DAMAGECOUNT value on done: 429127.0 [2024-08-06 03:41:13,061][52660] Sum rewards: 62.068, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.062', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.160', 'weapon2': '0.184', 'weapon5': '0.190', 'AMMO4': '0.212', 'AMMO3': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.144', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '54.000'} [2024-08-06 03:41:13,076][52662] DAMAGECOUNT value on done: 431419.0 [2024-08-06 03:41:13,077][52662] Sum rewards: 76.268, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.090', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.339', 'weapon2': '0.732', 'WEAPON3': '0.750', 'weapon3': '3.004', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:13,410][52668] DAMAGECOUNT value on done: 440504.0 [2024-08-06 03:41:13,415][52668] Sum rewards: 64.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.745', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.242', 'weapon4': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:14,184][52658] DAMAGECOUNT value on done: 434566.0 [2024-08-06 03:41:14,185][52658] Sum rewards: 63.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.134', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.500'} [2024-08-06 03:41:14,244][52665] DAMAGECOUNT value on done: 437227.0 [2024-08-06 03:41:14,245][52665] Sum rewards: 77.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.420', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '65.000'} [2024-08-06 03:41:14,252][52667] DAMAGECOUNT value on done: 443272.0 [2024-08-06 03:41:14,252][52667] Sum rewards: 58.546, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.840', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.163', 'AMMO4': '0.203', 'weapon2': '0.218', 'weapon5': '0.242', 'weapon4': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '2.920', 'DAMAGECOUNT': '14.067', 'FRAGCOUNT': '48.000'} [2024-08-06 03:41:14,527][52669] DAMAGECOUNT value on done: 442149.0 [2024-08-06 03:41:14,529][52669] Sum rewards: 62.103, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.332', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.189', 'weapon2': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.562', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '2.870', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '51.000'} [2024-08-06 03:41:15,496][52671] DAMAGECOUNT value on done: 440630.0 [2024-08-06 03:41:15,497][52671] Sum rewards: 68.463, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.190', 'weapon2': '0.328', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:15,538][52660] DAMAGECOUNT value on done: 440363.0 [2024-08-06 03:41:15,540][52660] Sum rewards: 69.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.723', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.123', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.308', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.000'} [2024-08-06 03:41:15,640][52650] Updated weights for policy 0, policy_version 47681 (0.0023) [2024-08-06 03:41:15,775][52662] DAMAGECOUNT value on done: 442349.0 [2024-08-06 03:41:15,776][52662] Sum rewards: 69.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.138', 'AMMO5': '0.023', 'AMMO2': '0.079', 'AMMO3': '0.170', 'weapon5': '0.250', 'weapon2': '0.276', 'weapon4': '0.356', 'AMMO4': '0.397', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.752', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:16,063][52668] DAMAGECOUNT value on done: 437107.0 [2024-08-06 03:41:16,079][52668] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.785', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.260', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '56.000'} [2024-08-06 03:41:16,747][52658] DAMAGECOUNT value on done: 438697.0 [2024-08-06 03:41:16,749][52658] Sum rewards: 80.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.051', 'weapon5': '0.054', 'WEAPON4': '0.100', 'weapon2': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.618', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '66.000'} [2024-08-06 03:41:17,370][52665] DAMAGECOUNT value on done: 433841.0 [2024-08-06 03:41:17,370][52665] Sum rewards: 57.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.260', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.448', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '47.000'} [2024-08-06 03:41:17,569][52669] DAMAGECOUNT value on done: 439517.0 [2024-08-06 03:41:17,570][52669] Sum rewards: 74.060, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.179', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.234', 'weapon5': '0.258', 'AMMO3': '0.270', 'AMMO4': '0.275', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.556', 'WEAPON3': '1.600', 'weapon3': '2.564', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.727', 'FRAGCOUNT': '63.000'} [2024-08-06 03:41:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 390635520. Throughput: 0: 4370.9. Samples: 97658160. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-06 03:41:17,795][52567] Avg episode reward: [(0, '70.506')] [2024-08-06 03:41:18,524][52671] DAMAGECOUNT value on done: 438094.0 [2024-08-06 03:41:18,534][52671] Sum rewards: 64.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.783', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.129', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:18,593][52660] DAMAGECOUNT value on done: 443238.0 [2024-08-06 03:41:18,595][52660] Sum rewards: 66.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.638', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.202', 'weapon2': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.168', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:18,735][52662] DAMAGECOUNT value on done: 434646.0 [2024-08-06 03:41:18,737][52662] Sum rewards: 67.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.318', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.205', 'weapon2': '0.692', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:19,214][52668] DAMAGECOUNT value on done: 431718.0 [2024-08-06 03:41:19,215][52668] Sum rewards: 64.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.092', 'AMMO4': '0.180', 'AMMO3': '0.227', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.088', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '53.500'} [2024-08-06 03:41:19,707][52658] DAMAGECOUNT value on done: 442063.0 [2024-08-06 03:41:19,707][52658] Sum rewards: 68.697, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.354', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon4': '0.190', 'weapon2': '0.212', 'weapon5': '0.212', 'AMMO3': '0.305', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.058', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '61.000'} [2024-08-06 03:41:19,987][52665] DAMAGECOUNT value on done: 432023.0 [2024-08-06 03:41:19,987][52665] Sum rewards: 70.159, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.830', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.194', 'weapon5': '0.206', 'AMMO4': '0.243', 'AMMO3': '0.294', 'weapon2': '0.298', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.958', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '63.000'} [2024-08-06 03:41:20,244][52669] DAMAGECOUNT value on done: 428077.0 [2024-08-06 03:41:20,245][52669] Sum rewards: 62.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon4': '0.382', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '52.000'} [2024-08-06 03:41:20,677][52650] Updated weights for policy 0, policy_version 47691 (0.0014) [2024-08-06 03:41:21,186][52662] DAMAGECOUNT value on done: 445454.0 [2024-08-06 03:41:21,190][52662] Sum rewards: 64.371, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.332', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.150', 'weapon2': '0.182', 'weapon4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'weapon3': '3.200', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:21,663][52671] DAMAGECOUNT value on done: 446775.0 [2024-08-06 03:41:21,663][52671] Sum rewards: 67.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.172', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.320', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '56.000'} [2024-08-06 03:41:21,744][52660] DAMAGECOUNT value on done: 437458.0 [2024-08-06 03:41:21,745][52660] Sum rewards: 77.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'AMMO2': '0.008', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.434', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '63.000'} [2024-08-06 03:41:22,166][52668] DAMAGECOUNT value on done: 426931.0 [2024-08-06 03:41:22,167][52668] Sum rewards: 78.910, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon4': '0.182', 'weapon2': '0.240', 'HEALTH': '0.655', 'WEAPON3': '0.900', 'weapon3': '3.306', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '63.000'} [2024-08-06 03:41:22,230][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:41:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 390725632. Throughput: 0: 4372.0. Samples: 97684490. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-06 03:41:22,794][52567] Avg episode reward: [(0, '70.505')] [2024-08-06 03:41:22,806][52658] DAMAGECOUNT value on done: 439208.0 [2024-08-06 03:41:22,807][52658] Sum rewards: 58.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.258', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.160', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '48.000'} [2024-08-06 03:41:22,950][52665] DAMAGECOUNT value on done: 423953.0 [2024-08-06 03:41:22,954][52665] Sum rewards: 73.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.216', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.304', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '62.000'} [2024-08-06 03:41:23,324][52669] DAMAGECOUNT value on done: 440273.0 [2024-08-06 03:41:23,325][52669] Sum rewards: 64.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.106', 'AMMO4': '0.214', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon5': '0.386', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.558', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:23,795][52662] DAMAGECOUNT value on done: 447421.0 [2024-08-06 03:41:23,803][52662] Sum rewards: 61.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.915', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.176', 'AMMO3': '0.188', 'weapon2': '0.208', 'AMMO4': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '50.000'} [2024-08-06 03:41:24,323][52671] DAMAGECOUNT value on done: 438041.0 [2024-08-06 03:41:24,328][52671] Sum rewards: 77.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.242', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '64.000'} [2024-08-06 03:41:24,384][52811] Large shaping reward 2.649 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:41:24,411][52660] DAMAGECOUNT value on done: 434003.0 [2024-08-06 03:41:24,411][52660] Sum rewards: 70.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.123', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.290', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:24,846][52650] Updated weights for policy 0, policy_version 47701 (0.0052) [2024-08-06 03:41:24,901][52668] DAMAGECOUNT value on done: 429162.0 [2024-08-06 03:41:24,901][52668] Sum rewards: 63.787, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.972', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.218', 'AMMO4': '0.219', 'weapon2': '0.282', 'AMMO3': '0.301', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'HITCOUNT': '3.010', 'weapon3': '3.044', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:25,847][52658] DAMAGECOUNT value on done: 430318.0 [2024-08-06 03:41:25,850][52658] Sum rewards: 60.586, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon4': '0.226', 'weapon2': '0.338', 'WEAPON3': '0.900', 'weapon3': '2.968', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '48.000'} [2024-08-06 03:41:26,158][52665] DAMAGECOUNT value on done: 425694.0 [2024-08-06 03:41:26,158][52665] Sum rewards: 71.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.618', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'AMMO4': '0.052', 'weapon4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '3.222', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:26,549][52662] DAMAGECOUNT value on done: 435069.0 [2024-08-06 03:41:26,550][52662] Sum rewards: 68.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.014', 'AMMO2': '0.066', 'weapon4': '0.198', 'weapon5': '0.206', 'AMMO3': '0.268', 'weapon2': '0.288', 'AMMO4': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.026', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:26,575][52669] DAMAGECOUNT value on done: 443542.0 [2024-08-06 03:41:26,582][52669] Sum rewards: 77.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.125', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.112', 'weapon4': '0.120', 'AMMO4': '0.178', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '65.000'} [2024-08-06 03:41:27,056][52660] DAMAGECOUNT value on done: 434731.0 [2024-08-06 03:41:27,057][52660] Sum rewards: 70.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.318', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.024', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon4': '0.296', 'weapon2': '0.810', 'WEAPON3': '1.000', 'weapon3': '2.688', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:27,200][52671] DAMAGECOUNT value on done: 445087.0 [2024-08-06 03:41:27,201][52671] Sum rewards: 70.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.842', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon2': '0.168', 'AMMO4': '0.172', 'weapon5': '0.220', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.316', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:27,577][52668] DAMAGECOUNT value on done: 427064.0 [2024-08-06 03:41:27,578][52668] Sum rewards: 64.692, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.304', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO4': '0.155', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.814', 'WEAPON3': '1.100', 'weapon3': '2.630', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 390815744. Throughput: 0: 4364.8. Samples: 97710690. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-06 03:41:27,794][52567] Avg episode reward: [(0, '69.740')] [2024-08-06 03:41:28,872][52665] DAMAGECOUNT value on done: 429961.0 [2024-08-06 03:41:28,875][52665] Sum rewards: 59.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.158', 'weapon4': '0.164', 'AMMO4': '0.165', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '49.000'} [2024-08-06 03:41:28,949][52658] DAMAGECOUNT value on done: 435832.0 [2024-08-06 03:41:28,952][52658] Sum rewards: 66.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.436', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon4': '0.216', 'weapon2': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '54.000'} [2024-08-06 03:41:29,498][52669] DAMAGECOUNT value on done: 452472.0 [2024-08-06 03:41:29,500][52669] Sum rewards: 82.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.972', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.134', 'weapon4': '0.172', 'AMMO4': '0.178', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '67.000'} [2024-08-06 03:41:29,583][52662] DAMAGECOUNT value on done: 449658.0 [2024-08-06 03:41:29,583][52662] Sum rewards: 83.635, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.204', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.186', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '67.000'} [2024-08-06 03:41:29,885][52660] DAMAGECOUNT value on done: 442377.0 [2024-08-06 03:41:29,885][52660] Sum rewards: 76.279, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.247', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'weapon4': '0.084', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '3.138', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:29,886][52650] Updated weights for policy 0, policy_version 47711 (0.0011) [2024-08-06 03:41:30,256][52671] DAMAGECOUNT value on done: 441361.0 [2024-08-06 03:41:30,257][52671] Sum rewards: 63.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.673', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.059', 'weapon5': '0.066', 'weapon2': '0.170', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'AMMO4': '0.297', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.164', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:30,355][52668] DAMAGECOUNT value on done: 434195.0 [2024-08-06 03:41:30,356][52668] Sum rewards: 64.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.955', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon2': '0.146', 'AMMO3': '0.179', 'weapon5': '0.226', 'AMMO4': '0.237', 'weapon4': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:31,688][52658] DAMAGECOUNT value on done: 438811.0 [2024-08-06 03:41:31,688][52658] Sum rewards: 53.678, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon5': '0.208', 'AMMO3': '0.240', 'AMMO4': '0.328', 'weapon2': '0.362', 'weapon4': '0.364', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.764', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '46.500'} [2024-08-06 03:41:31,887][52665] DAMAGECOUNT value on done: 434219.0 [2024-08-06 03:41:31,889][52665] Sum rewards: 66.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.176', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.322', 'weapon4': '0.506', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.604', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:32,314][52662] DAMAGECOUNT value on done: 435179.0 [2024-08-06 03:41:32,315][52662] Sum rewards: 81.222, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.164', 'weapon5': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.340', 'HEALTH': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '65.000'} [2024-08-06 03:41:32,387][52669] DAMAGECOUNT value on done: 440304.0 [2024-08-06 03:41:32,389][52669] Sum rewards: 76.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.106', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.244', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 03:41:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 390897664. Throughput: 0: 4363.1. Samples: 97723870. Policy #0 lag: (min: 0.0, avg: 4.2, max: 10.0) [2024-08-06 03:41:32,794][52567] Avg episode reward: [(0, '69.796')] [2024-08-06 03:41:32,931][52660] DAMAGECOUNT value on done: 438170.0 [2024-08-06 03:41:32,932][52660] Sum rewards: 64.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.112', 'AMMO4': '0.162', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.154', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '54.000'} [2024-08-06 03:41:33,216][52671] DAMAGECOUNT value on done: 436827.0 [2024-08-06 03:41:33,217][52671] Sum rewards: 67.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.060', 'weapon5': '0.074', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.618', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '56.000'} [2024-08-06 03:41:33,358][52668] DAMAGECOUNT value on done: 438353.0 [2024-08-06 03:41:33,359][52668] Sum rewards: 66.112, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.016', 'HEALTH': '0.026', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.207', 'weapon5': '0.248', 'weapon2': '0.272', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '54.000'} [2024-08-06 03:41:34,520][52650] Updated weights for policy 0, policy_version 47721 (0.0012) [2024-08-06 03:41:34,553][52665] DAMAGECOUNT value on done: 437081.0 [2024-08-06 03:41:34,554][52665] Sum rewards: 62.549, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.189', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.160', 'weapon4': '0.176', 'AMMO4': '0.256', 'weapon2': '0.262', 'AMMO3': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.086', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:34,932][52658] DAMAGECOUNT value on done: 431907.0 [2024-08-06 03:41:34,932][52658] Sum rewards: 74.069, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.779', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.080', 'weapon4': '0.098', 'AMMO4': '0.204', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '66.000'} [2024-08-06 03:41:35,253][52669] DAMAGECOUNT value on done: 440511.0 [2024-08-06 03:41:35,254][52669] Sum rewards: 67.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.936', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.104', 'AMMO4': '0.127', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '58.000'} [2024-08-06 03:41:35,467][52662] DAMAGECOUNT value on done: 439175.0 [2024-08-06 03:41:35,470][52662] Sum rewards: 73.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.188', 'weapon2': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.236', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:35,561][52660] DAMAGECOUNT value on done: 433142.0 [2024-08-06 03:41:35,562][52660] Sum rewards: 71.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.134', 'weapon5': '0.154', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '58.000'} [2024-08-06 03:41:36,227][52668] DAMAGECOUNT value on done: 435705.0 [2024-08-06 03:41:36,229][52668] Sum rewards: 60.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.578', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.244', 'weapon4': '0.248', 'AMMO3': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '51.000'} [2024-08-06 03:41:36,334][52671] DAMAGECOUNT value on done: 442844.0 [2024-08-06 03:41:36,334][52671] Sum rewards: 65.776, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.616', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.171', 'weapon2': '0.178', 'AMMO4': '0.219', 'weapon4': '0.226', 'weapon5': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.980', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '52.000'} [2024-08-06 03:41:37,322][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:41:37,437][52665] DAMAGECOUNT value on done: 433026.0 [2024-08-06 03:41:37,437][52665] Sum rewards: 69.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.124', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.234', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '58.000'} [2024-08-06 03:41:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 390987776. Throughput: 0: 4355.3. Samples: 97749920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:41:37,794][52567] Avg episode reward: [(0, '69.393')] [2024-08-06 03:41:37,929][52658] DAMAGECOUNT value on done: 446206.0 [2024-08-06 03:41:37,931][52658] Sum rewards: 71.725, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.705', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.016', 'AMMO4': '0.073', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '3.086', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:38,056][52660] DAMAGECOUNT value on done: 445016.0 [2024-08-06 03:41:38,059][52660] Sum rewards: 56.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.054', 'AMMO4': '0.122', 'weapon4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '13.977', 'FRAGCOUNT': '50.000'} [2024-08-06 03:41:38,174][52662] DAMAGECOUNT value on done: 438874.0 [2024-08-06 03:41:38,174][52662] Sum rewards: 61.953, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.138', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2024-08-06 03:41:38,273][52669] DAMAGECOUNT value on done: 442417.0 [2024-08-06 03:41:38,274][52669] Sum rewards: 72.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.744', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.180', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '59.500'} [2024-08-06 03:41:38,787][52668] DAMAGECOUNT value on done: 442058.0 [2024-08-06 03:41:38,789][52668] Sum rewards: 74.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.025', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.400', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '63.000'} [2024-08-06 03:41:39,003][52650] Updated weights for policy 0, policy_version 47731 (0.0013) [2024-08-06 03:41:39,308][52671] DAMAGECOUNT value on done: 447550.0 [2024-08-06 03:41:39,308][52671] Sum rewards: 67.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.391', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.108', 'AMMO4': '0.125', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'WEAPON3': '1.650', 'HITCOUNT': '3.170', 'weapon3': '3.380', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:40,400][52658] DAMAGECOUNT value on done: 438047.0 [2024-08-06 03:41:40,401][52658] Sum rewards: 67.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.216', 'weapon4': '0.224', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:40,567][52665] DAMAGECOUNT value on done: 439386.0 [2024-08-06 03:41:40,567][52665] Sum rewards: 79.872, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.210', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon2': '0.204', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.570', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '69.000'} [2024-08-06 03:41:40,973][52660] DAMAGECOUNT value on done: 430035.0 [2024-08-06 03:41:40,973][52660] Sum rewards: 74.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.515', 'AMMO5': '0.010', 'weapon4': '0.046', 'AMMO2': '0.049', 'weapon5': '0.106', 'AMMO4': '0.242', 'AMMO3': '0.259', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.300', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '65.000'} [2024-08-06 03:41:41,028][52669] DAMAGECOUNT value on done: 444657.0 [2024-08-06 03:41:41,029][52669] Sum rewards: 76.766, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.150', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.388', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '64.000'} [2024-08-06 03:41:41,361][52662] DAMAGECOUNT value on done: 443970.0 [2024-08-06 03:41:41,363][52662] Sum rewards: 53.788, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.009', 'weapon5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon4': '0.498', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '2.886', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '49.000'} [2024-08-06 03:41:41,658][52668] DAMAGECOUNT value on done: 434372.0 [2024-08-06 03:41:41,658][52668] Sum rewards: 73.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.163', 'AMMO5': '0.013', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:42,396][52671] DAMAGECOUNT value on done: 438939.0 [2024-08-06 03:41:42,400][52671] Sum rewards: 65.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.470', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.210', 'AMMO3': '0.228', 'weapon5': '0.228', 'AMMO4': '0.244', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '56.000'} [2024-08-06 03:41:42,795][52567] Fps is (10 sec: 17202.1, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 391069696. Throughput: 0: 4372.8. Samples: 97776480. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:41:42,795][52567] Avg episode reward: [(0, '69.386')] [2024-08-06 03:41:43,207][52658] DAMAGECOUNT value on done: 447770.0 [2024-08-06 03:41:43,207][52658] Sum rewards: 71.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.392', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.116', 'AMMO4': '0.130', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 03:41:43,677][52665] DAMAGECOUNT value on done: 435340.0 [2024-08-06 03:41:43,678][52665] Sum rewards: 82.571, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.587', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO4': '0.120', 'AMMO3': '0.197', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '66.000'} [2024-08-06 03:41:43,691][52660] DAMAGECOUNT value on done: 433748.0 [2024-08-06 03:41:43,693][52660] Sum rewards: 65.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.884', 'AMMO5': '0.020', 'AMMO2': '0.072', 'weapon2': '0.220', 'AMMO3': '0.224', 'weapon5': '0.312', 'AMMO4': '0.361', 'weapon4': '0.406', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:43,932][52650] Updated weights for policy 0, policy_version 47741 (0.0019) [2024-08-06 03:41:44,066][52662] DAMAGECOUNT value on done: 437996.0 [2024-08-06 03:41:44,068][52662] Sum rewards: 61.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.390', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.132', 'weapon5': '0.256', 'AMMO4': '0.262', 'AMMO3': '0.287', 'weapon2': '0.414', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.770', 'weapon3': '2.862', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '54.000'} [2024-08-06 03:41:45,454][52671] DAMAGECOUNT value on done: 446497.0 [2024-08-06 03:41:45,456][52671] Sum rewards: 72.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.972', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.191', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:45,581][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:41:45,931][52658] DAMAGECOUNT value on done: 429640.0 [2024-08-06 03:41:45,932][52658] Sum rewards: 70.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.378', 'weapon4': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:46,366][52660] DAMAGECOUNT value on done: 446077.0 [2024-08-06 03:41:46,368][52660] Sum rewards: 68.054, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.804', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.188', 'weapon2': '0.660', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '57.000'} [2024-08-06 03:41:46,818][52665] DAMAGECOUNT value on done: 431476.0 [2024-08-06 03:41:46,819][52665] Sum rewards: 77.194, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.892', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.204', 'weapon5': '0.208', 'weapon2': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '62.000'} [2024-08-06 03:41:46,896][52662] DAMAGECOUNT value on done: 447543.0 [2024-08-06 03:41:46,898][52662] Sum rewards: 68.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.633', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'AMMO4': '0.166', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.208', 'weapon4': '0.238', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.316', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 03:41:47,125][52660] Large shaping reward 3.264 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.213, 71.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:41:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 391159808. Throughput: 0: 4368.9. Samples: 97789570. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:41:47,794][52567] Avg episode reward: [(0, '69.087')] [2024-08-06 03:41:48,196][52650] Updated weights for policy 0, policy_version 47751 (0.0020) [2024-08-06 03:41:48,577][52671] DAMAGECOUNT value on done: 437629.0 [2024-08-06 03:41:48,577][52671] Sum rewards: 67.308, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.740', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon2': '0.160', 'weapon4': '0.252', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.260', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '60.000'} [2024-08-06 03:41:49,137][52660] DAMAGECOUNT value on done: 452805.0 [2024-08-06 03:41:49,138][52660] Sum rewards: 74.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon4': '0.074', 'weapon5': '0.134', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'AMMO4': '0.281', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2024-08-06 03:41:49,342][52658] DAMAGECOUNT value on done: 439571.0 [2024-08-06 03:41:49,343][52658] Sum rewards: 68.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.927', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.160', 'weapon5': '0.166', 'AMMO4': '0.183', 'AMMO3': '0.212', 'weapon2': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '56.000'} [2024-08-06 03:41:49,487][52662] DAMAGECOUNT value on done: 443417.0 [2024-08-06 03:41:49,488][52662] Sum rewards: 80.173, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.625', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.132', 'AMMO3': '0.139', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.352', 'WEAPON3': '0.900', 'weapon3': '3.220', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '62.000'} [2024-08-06 03:41:50,043][52665] DAMAGECOUNT value on done: 431061.0 [2024-08-06 03:41:50,043][52665] Sum rewards: 64.464, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.984', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.186', 'weapon2': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.327', 'WEAPON4': '0.400', 'WEAPON3': '1.950', 'weapon3': '3.146', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '58.000'} [2024-08-06 03:41:51,069][52811] DAMAGECOUNT value on done: 419946.0 [2024-08-06 03:41:51,070][52811] Sum rewards: 66.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.558', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon5': '0.168', 'weapon4': '0.186', 'AMMO3': '0.229', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '2.824', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '57.500'} [2024-08-06 03:41:51,278][52671] DAMAGECOUNT value on done: 431366.0 [2024-08-06 03:41:51,278][52671] Sum rewards: 64.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.483', 'AMMO5': '0.025', 'AMMO2': '0.035', 'weapon2': '0.162', 'AMMO3': '0.169', 'AMMO4': '0.173', 'weapon4': '0.194', 'weapon5': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.172', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:51,390][52662] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:41:51,499][52660] DAMAGECOUNT value on done: 433116.0 [2024-08-06 03:41:51,501][52660] Sum rewards: 75.077, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '61.000'} [2024-08-06 03:41:52,136][52614] Signal inference workers to stop experience collection... (8650 times) [2024-08-06 03:41:52,137][52614] Signal inference workers to resume experience collection... (8650 times) [2024-08-06 03:41:52,163][52650] InferenceWorker_p0-w0: stopping experience collection (8650 times) [2024-08-06 03:41:52,164][52650] InferenceWorker_p0-w0: resuming experience collection (8650 times) [2024-08-06 03:41:52,572][52658] DAMAGECOUNT value on done: 434512.0 [2024-08-06 03:41:52,574][52658] Sum rewards: 65.019, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.090', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.252', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:52,631][52662] DAMAGECOUNT value on done: 437787.0 [2024-08-06 03:41:52,632][52662] Sum rewards: 70.939, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO4': '0.177', 'AMMO3': '0.246', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '61.000'} [2024-08-06 03:41:52,794][52567] Fps is (10 sec: 18023.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 391249920. Throughput: 0: 4382.5. Samples: 97816030. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:41:52,794][52567] Avg episode reward: [(0, '69.190')] [2024-08-06 03:41:52,851][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:41:52,930][52794] DAMAGECOUNT value on done: 440436.0 [2024-08-06 03:41:52,931][52794] Sum rewards: 60.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.070', 'weapon4': '0.204', 'AMMO3': '0.209', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '52.000'} [2024-08-06 03:41:53,082][52665] DAMAGECOUNT value on done: 434751.0 [2024-08-06 03:41:53,085][52665] Sum rewards: 72.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.317', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.092', 'weapon5': '0.242', 'AMMO4': '0.252', 'AMMO3': '0.260', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.968', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '62.000'} [2024-08-06 03:41:53,200][52650] Updated weights for policy 0, policy_version 47761 (0.0011) [2024-08-06 03:41:53,625][52671] DAMAGECOUNT value on done: 446259.0 [2024-08-06 03:41:53,626][52671] Sum rewards: 75.470, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.225', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.094', 'AMMO3': '0.148', 'AMMO4': '0.153', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.000', 'weapon3': '3.068', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '58.000'} [2024-08-06 03:41:54,128][52811] DAMAGECOUNT value on done: 402998.0 [2024-08-06 03:41:54,133][52811] Sum rewards: 53.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.660', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.096', 'AMMO4': '0.127', 'AMMO3': '0.220', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.838', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '46.000'} [2024-08-06 03:41:54,485][52660] DAMAGECOUNT value on done: 438739.0 [2024-08-06 03:41:54,487][52660] Sum rewards: 70.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.125', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.086', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:55,514][52665] DAMAGECOUNT value on done: 428913.0 [2024-08-06 03:41:55,516][52665] Sum rewards: 64.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.099', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon5': '0.144', 'AMMO4': '0.146', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.440', 'weapon4': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.534', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '54.000'} [2024-08-06 03:41:55,620][52662] DAMAGECOUNT value on done: 435528.0 [2024-08-06 03:41:55,621][52662] Sum rewards: 87.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.499', 'AMMO5': '0.014', 'AMMO2': '0.066', 'weapon4': '0.166', 'weapon5': '0.202', 'AMMO3': '0.224', 'weapon2': '0.234', 'AMMO4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '73.000'} [2024-08-06 03:41:55,697][52658] DAMAGECOUNT value on done: 434548.0 [2024-08-06 03:41:55,699][52658] Sum rewards: 64.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.085', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.202', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.462', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '53.000'} [2024-08-06 03:41:55,719][52803] DAMAGECOUNT value on done: 410093.0 [2024-08-06 03:41:55,720][52803] Sum rewards: 81.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.494', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO4': '0.193', 'weapon4': '0.214', 'AMMO3': '0.223', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '68.500'} [2024-08-06 03:41:55,971][52794] DAMAGECOUNT value on done: 444697.0 [2024-08-06 03:41:55,974][52794] Sum rewards: 80.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO4': '0.136', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '66.000'} [2024-08-06 03:41:56,594][52671] DAMAGECOUNT value on done: 444304.0 [2024-08-06 03:41:56,595][52671] Sum rewards: 65.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.050', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon2': '0.198', 'AMMO3': '0.205', 'weapon4': '0.242', 'weapon5': '0.266', 'AMMO4': '0.268', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.030', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:56,982][52660] DAMAGECOUNT value on done: 434237.0 [2024-08-06 03:41:56,982][52660] Sum rewards: 75.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.354', 'AMMO2': '0.009', 'weapon7': '0.010', 'AMMO4': '0.045', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.148', 'weapon2': '0.214', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.292', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '66.000'} [2024-08-06 03:41:57,260][52811] DAMAGECOUNT value on done: 406451.0 [2024-08-06 03:41:57,261][52811] Sum rewards: 86.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.199', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '70.000'} [2024-08-06 03:41:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 391331840. Throughput: 0: 4380.9. Samples: 97842240. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:41:57,794][52567] Avg episode reward: [(0, '69.431')] [2024-08-06 03:41:58,013][52650] Updated weights for policy 0, policy_version 47771 (0.0031) [2024-08-06 03:41:58,164][52665] DAMAGECOUNT value on done: 427686.0 [2024-08-06 03:41:58,164][52665] Sum rewards: 72.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.143', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.240', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '59.000'} [2024-08-06 03:41:58,669][52662] DAMAGECOUNT value on done: 432517.0 [2024-08-06 03:41:58,669][52662] Sum rewards: 68.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.180', 'weapon5': '0.192', 'AMMO4': '0.217', 'weapon4': '0.294', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '55.000'} [2024-08-06 03:41:58,870][52658] DAMAGECOUNT value on done: 432005.0 [2024-08-06 03:41:58,870][52658] Sum rewards: 63.559, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.991', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.148', 'AMMO4': '0.173', 'weapon4': '0.180', 'AMMO3': '0.233', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '54.500'} [2024-08-06 03:41:58,873][52803] DAMAGECOUNT value on done: 405583.0 [2024-08-06 03:41:58,874][52803] Sum rewards: 56.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.914', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.098', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.112', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '47.000'} [2024-08-06 03:41:59,057][52794] DAMAGECOUNT value on done: 441674.0 [2024-08-06 03:41:59,057][52794] Sum rewards: 79.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.830', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.136', 'AMMO4': '0.173', 'weapon2': '0.176', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '67.000'} [2024-08-06 03:41:59,421][52671] DAMAGECOUNT value on done: 445955.0 [2024-08-06 03:41:59,422][52671] Sum rewards: 75.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:00,066][52649] DAMAGECOUNT value on done: 421227.0 [2024-08-06 03:42:00,066][52649] Sum rewards: 58.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.306', 'weapon4': '0.314', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.148', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '50.000'} [2024-08-06 03:42:00,235][52660] DAMAGECOUNT value on done: 435923.0 [2024-08-06 03:42:00,235][52660] Sum rewards: 61.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.837', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.106', 'AMMO4': '0.152', 'AMMO3': '0.196', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '51.000'} [2024-08-06 03:42:00,388][52811] DAMAGECOUNT value on done: 407129.0 [2024-08-06 03:42:00,388][52811] Sum rewards: 63.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.932', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.112', 'weapon4': '0.124', 'AMMO4': '0.149', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '53.500'} [2024-08-06 03:42:01,351][52665] DAMAGECOUNT value on done: 429407.0 [2024-08-06 03:42:01,351][52665] Sum rewards: 77.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.393', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.082', 'AMMO4': '0.088', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '61.000'} [2024-08-06 03:42:01,668][52671] DAMAGECOUNT value on done: 441321.0 [2024-08-06 03:42:01,670][52671] Sum rewards: 68.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.346', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.100', 'weapon4': '0.134', 'AMMO4': '0.180', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:01,947][52658] DAMAGECOUNT value on done: 444767.0 [2024-08-06 03:42:01,947][52658] Sum rewards: 64.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.412', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon4': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '3.020', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:01,969][52803] DAMAGECOUNT value on done: 412717.0 [2024-08-06 03:42:01,970][52803] Sum rewards: 68.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.381', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.153', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.278', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '58.000'} [2024-08-06 03:42:02,172][52794] DAMAGECOUNT value on done: 435073.0 [2024-08-06 03:42:02,174][52794] Sum rewards: 71.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.633', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.196', 'weapon4': '0.206', 'AMMO3': '0.253', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:02,629][52649] DAMAGECOUNT value on done: 418722.0 [2024-08-06 03:42:02,630][52649] Sum rewards: 69.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.114', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:02,726][52650] Updated weights for policy 0, policy_version 47781 (0.0022) [2024-08-06 03:42:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 391421952. Throughput: 0: 4376.0. Samples: 97855080. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:42:02,802][52567] Avg episode reward: [(0, '69.483')] [2024-08-06 03:42:02,913][52660] DAMAGECOUNT value on done: 432342.0 [2024-08-06 03:42:02,915][52660] Sum rewards: 72.385, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.365', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.108', 'AMMO4': '0.222', 'weapon2': '0.278', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.278', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '65.000'} [2024-08-06 03:42:03,551][52811] DAMAGECOUNT value on done: 409472.0 [2024-08-06 03:42:03,552][52811] Sum rewards: 71.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.117', 'weapon5': '0.130', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '57.000'} [2024-08-06 03:42:04,131][52665] DAMAGECOUNT value on done: 430569.0 [2024-08-06 03:42:04,133][52665] Sum rewards: 63.680, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.535', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO4': '0.209', 'weapon5': '0.232', 'weapon4': '0.246', 'AMMO3': '0.282', 'weapon2': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.840', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:04,550][52671] DAMAGECOUNT value on done: 440101.0 [2024-08-06 03:42:04,550][52671] Sum rewards: 73.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.416', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.128', 'AMMO4': '0.164', 'AMMO3': '0.198', 'weapon5': '0.214', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.188', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '61.000'} [2024-08-06 03:42:04,824][52658] DAMAGECOUNT value on done: 435511.0 [2024-08-06 03:42:04,824][52658] Sum rewards: 64.371, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.198', 'weapon2': '0.202', 'weapon4': '0.214', 'AMMO3': '0.245', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:04,992][52803] DAMAGECOUNT value on done: 414320.0 [2024-08-06 03:42:04,992][52803] Sum rewards: 73.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.258', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:05,141][52794] DAMAGECOUNT value on done: 435251.0 [2024-08-06 03:42:05,142][52794] Sum rewards: 77.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:05,834][52649] DAMAGECOUNT value on done: 431177.0 [2024-08-06 03:42:05,834][52649] Sum rewards: 82.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.236', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.450', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '71.000'} [2024-08-06 03:42:06,707][52811] DAMAGECOUNT value on done: 415772.0 [2024-08-06 03:42:06,708][52811] Sum rewards: 82.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '69.000'} [2024-08-06 03:42:07,113][52658] DAMAGECOUNT value on done: 440528.0 [2024-08-06 03:42:07,113][52658] Sum rewards: 66.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.610', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.076', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.150', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:07,187][52665] DAMAGECOUNT value on done: 436443.0 [2024-08-06 03:42:07,187][52665] Sum rewards: 86.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.175', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.040', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.514', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.111', 'FRAGCOUNT': '70.000'} [2024-08-06 03:42:07,615][52650] Updated weights for policy 0, policy_version 47791 (0.0012) [2024-08-06 03:42:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 391503872. Throughput: 0: 4373.8. Samples: 97881310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:42:07,802][52567] Avg episode reward: [(0, '70.057')] [2024-08-06 03:42:08,161][52803] DAMAGECOUNT value on done: 414565.0 [2024-08-06 03:42:08,162][52803] Sum rewards: 86.423, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'HEALTH': '0.030', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.174', 'weapon2': '0.246', 'WEAPON3': '0.850', 'weapon3': '3.312', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '68.000'} [2024-08-06 03:42:08,549][52794] DAMAGECOUNT value on done: 440662.0 [2024-08-06 03:42:08,550][52794] Sum rewards: 72.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.718', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.135', 'weapon4': '0.266', 'weapon5': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.836', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '59.000'} [2024-08-06 03:42:08,815][52649] DAMAGECOUNT value on done: 424282.0 [2024-08-06 03:42:08,817][52649] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.815', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'weapon5': '0.100', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:09,426][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:42:09,812][52811] DAMAGECOUNT value on done: 409422.0 [2024-08-06 03:42:09,814][52811] Sum rewards: 70.231, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.026', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.177', 'weapon5': '0.218', 'weapon2': '0.276', 'AMMO3': '0.328', 'weapon4': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.796', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '63.000'} [2024-08-06 03:42:09,821][52658] DAMAGECOUNT value on done: 444038.0 [2024-08-06 03:42:09,822][52658] Sum rewards: 70.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.072', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.098', 'AMMO3': '0.167', 'weapon5': '0.182', 'AMMO4': '0.310', 'weapon2': '0.488', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '59.000'} [2024-08-06 03:42:11,145][52803] DAMAGECOUNT value on done: 401864.0 [2024-08-06 03:42:11,148][52803] Sum rewards: 77.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.017', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.193', 'weapon5': '0.210', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:11,528][52649] DAMAGECOUNT value on done: 416698.0 [2024-08-06 03:42:11,529][52649] Sum rewards: 78.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.882', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.576', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:11,653][52650] Updated weights for policy 0, policy_version 47801 (0.0013) [2024-08-06 03:42:12,020][52794] DAMAGECOUNT value on done: 444402.0 [2024-08-06 03:42:12,021][52794] Sum rewards: 65.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.398', 'AMMO2': '0.001', 'AMMO5': '0.004', 'AMMO4': '0.005', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO3': '0.259', 'weapon4': '0.270', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 391602176. Throughput: 0: 4378.4. Samples: 97907720. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:42:12,802][52567] Avg episode reward: [(0, '70.527')] [2024-08-06 03:42:12,994][52811] DAMAGECOUNT value on done: 409588.0 [2024-08-06 03:42:12,994][52811] Sum rewards: 68.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.158', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:14,179][52649] DAMAGECOUNT value on done: 429429.0 [2024-08-06 03:42:14,180][52649] Sum rewards: 68.266, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.954', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon4': '0.070', 'weapon5': '0.120', 'weapon2': '0.248', 'AMMO4': '0.266', 'AMMO3': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '3.290', 'weapon3': '3.328', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:14,275][52803] DAMAGECOUNT value on done: 404689.0 [2024-08-06 03:42:14,277][52803] Sum rewards: 79.078, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.163', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '0.900', 'weapon3': '3.026', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '63.000'} [2024-08-06 03:42:14,403][52659] DAMAGECOUNT value on done: 439169.0 [2024-08-06 03:42:14,404][52659] Sum rewards: 70.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.679', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '58.000'} [2024-08-06 03:42:15,307][52794] DAMAGECOUNT value on done: 435987.0 [2024-08-06 03:42:15,311][52794] Sum rewards: 82.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.104', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon4': '0.090', 'weapon5': '0.204', 'AMMO3': '0.205', 'AMMO4': '0.224', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '68.000'} [2024-08-06 03:42:16,033][52811] DAMAGECOUNT value on done: 413796.0 [2024-08-06 03:42:16,034][52811] Sum rewards: 75.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.205', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.272', 'weapon2': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.368', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '65.000'} [2024-08-06 03:42:16,838][52650] Updated weights for policy 0, policy_version 47811 (0.0030) [2024-08-06 03:42:17,013][52659] DAMAGECOUNT value on done: 439397.0 [2024-08-06 03:42:17,014][52659] Sum rewards: 72.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.483', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.192', 'weapon2': '0.256', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.442', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 03:42:17,052][52649] DAMAGECOUNT value on done: 423353.0 [2024-08-06 03:42:17,053][52649] Sum rewards: 71.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.657', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.108', 'weapon4': '0.128', 'AMMO4': '0.168', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '61.000'} [2024-08-06 03:42:17,453][52803] DAMAGECOUNT value on done: 403189.0 [2024-08-06 03:42:17,455][52803] Sum rewards: 43.836, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.025', 'AMMO2': '0.074', 'weapon4': '0.192', 'AMMO3': '0.220', 'weapon5': '0.278', 'AMMO4': '0.368', 'weapon2': '0.418', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.300', 'HITCOUNT': '2.270', 'weapon3': '2.778', 'DAMAGECOUNT': '11.853', 'FRAGCOUNT': '40.000'} [2024-08-06 03:42:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.9). Total num frames: 391684096. Throughput: 0: 4375.6. Samples: 97920770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:42:17,794][52567] Avg episode reward: [(0, '70.464')] [2024-08-06 03:42:18,008][52794] DAMAGECOUNT value on done: 442542.0 [2024-08-06 03:42:18,009][52794] Sum rewards: 63.491, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.060', 'AMMO5': '0.021', 'AMMO2': '0.075', 'weapon4': '0.230', 'AMMO3': '0.318', 'weapon5': '0.336', 'weapon2': '0.352', 'AMMO4': '0.374', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.800', 'weapon3': '2.672', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:19,022][52811] DAMAGECOUNT value on done: 410629.0 [2024-08-06 03:42:19,022][52811] Sum rewards: 68.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.402', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.034', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.198', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.508', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '58.000'} [2024-08-06 03:42:19,908][52659] DAMAGECOUNT value on done: 442729.0 [2024-08-06 03:42:19,909][52659] Sum rewards: 72.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:20,218][52649] DAMAGECOUNT value on done: 430022.0 [2024-08-06 03:42:20,219][52649] Sum rewards: 65.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.550', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.140', 'AMMO3': '0.219', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.380', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.726', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:20,624][52803] DAMAGECOUNT value on done: 411484.0 [2024-08-06 03:42:20,627][52803] Sum rewards: 57.462, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.060', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.204', 'weapon2': '0.210', 'AMMO3': '0.284', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.660', 'WEAPON3': '1.650', 'weapon3': '2.662', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '51.000'} [2024-08-06 03:42:20,661][52794] DAMAGECOUNT value on done: 439397.0 [2024-08-06 03:42:20,661][52794] Sum rewards: 69.971, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.860', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.136', 'AMMO3': '0.148', 'AMMO4': '0.167', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '0.950', 'weapon3': '3.162', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:21,102][52650] Updated weights for policy 0, policy_version 47821 (0.0013) [2024-08-06 03:42:22,154][52811] DAMAGECOUNT value on done: 409415.0 [2024-08-06 03:42:22,154][52811] Sum rewards: 71.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.715', 'AMMO5': '0.019', 'AMMO2': '0.071', 'weapon5': '0.110', 'weapon4': '0.202', 'AMMO3': '0.217', 'AMMO4': '0.357', 'WEAPON5': '0.450', 'weapon2': '0.590', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '62.000'} [2024-08-06 03:42:22,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 391766016. Throughput: 0: 4386.0. Samples: 97947290. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:42:22,803][52567] Avg episode reward: [(0, '70.375')] [2024-08-06 03:42:23,006][52659] DAMAGECOUNT value on done: 438217.0 [2024-08-06 03:42:23,006][52659] Sum rewards: 73.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.944', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.148', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '63.000'} [2024-08-06 03:42:23,361][52649] DAMAGECOUNT value on done: 430354.0 [2024-08-06 03:42:23,363][52649] Sum rewards: 67.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.160', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.826', 'WEAPON3': '0.900', 'weapon3': '2.816', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:23,709][52794] DAMAGECOUNT value on done: 434423.0 [2024-08-06 03:42:23,711][52794] Sum rewards: 66.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.465', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO3': '0.170', 'AMMO4': '0.171', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 03:42:23,719][52803] DAMAGECOUNT value on done: 402455.0 [2024-08-06 03:42:23,721][52803] Sum rewards: 60.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.792', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.326', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.324', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:25,327][52811] DAMAGECOUNT value on done: 419866.0 [2024-08-06 03:42:25,327][52811] Sum rewards: 67.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.588', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'AMMO3': '0.269', 'WEAPON3': '1.550', 'weapon3': '3.180', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '58.000'} [2024-08-06 03:42:25,353][52659] DAMAGECOUNT value on done: 435540.0 [2024-08-06 03:42:25,355][52659] Sum rewards: 62.549, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.532', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO4': '0.192', 'AMMO3': '0.213', 'weapon4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.066', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:25,876][52650] Updated weights for policy 0, policy_version 47831 (0.0013) [2024-08-06 03:42:26,436][52649] DAMAGECOUNT value on done: 424697.0 [2024-08-06 03:42:26,437][52649] Sum rewards: 64.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon4': '0.258', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:26,742][52794] DAMAGECOUNT value on done: 442223.0 [2024-08-06 03:42:26,743][52794] Sum rewards: 74.257, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.123', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.090', 'AMMO3': '0.124', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '0.850', 'weapon3': '2.980', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '57.000'} [2024-08-06 03:42:26,837][52803] DAMAGECOUNT value on done: 415875.0 [2024-08-06 03:42:26,837][52803] Sum rewards: 81.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.287', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.154', 'weapon5': '0.176', 'AMMO4': '0.185', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '66.000'} [2024-08-06 03:42:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 391856128. Throughput: 0: 4384.1. Samples: 97973760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:42:27,795][52567] Avg episode reward: [(0, '70.522')] [2024-08-06 03:42:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047834_391856128.pth... [2024-08-06 03:42:27,960][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047322_387661824.pth [2024-08-06 03:42:28,345][52659] DAMAGECOUNT value on done: 440280.0 [2024-08-06 03:42:28,350][52659] Sum rewards: 78.960, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.060', 'weapon5': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '62.000'} [2024-08-06 03:42:28,464][52811] DAMAGECOUNT value on done: 409823.0 [2024-08-06 03:42:28,464][52811] Sum rewards: 77.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.226', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.100', 'weapon5': '0.154', 'AMMO3': '0.231', 'AMMO4': '0.259', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '64.500'} [2024-08-06 03:42:29,376][52794] DAMAGECOUNT value on done: 430019.0 [2024-08-06 03:42:29,377][52794] Sum rewards: 61.502, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.306', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.042', 'weapon4': '0.116', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.500', 'weapon3': '2.966', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:29,461][52649] DAMAGECOUNT value on done: 431974.0 [2024-08-06 03:42:29,461][52649] Sum rewards: 78.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.673', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.092', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.364', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:30,234][52803] DAMAGECOUNT value on done: 410199.0 [2024-08-06 03:42:30,237][52803] Sum rewards: 83.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '68.000'} [2024-08-06 03:42:31,178][52650] Updated weights for policy 0, policy_version 47841 (0.0014) [2024-08-06 03:42:31,554][52811] DAMAGECOUNT value on done: 406828.0 [2024-08-06 03:42:31,554][52811] Sum rewards: 67.964, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.635', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.354', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '57.000'} [2024-08-06 03:42:31,585][52659] DAMAGECOUNT value on done: 439661.0 [2024-08-06 03:42:31,585][52659] Sum rewards: 66.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.080', 'AMMO3': '0.201', 'weapon5': '0.210', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:32,372][52794] DAMAGECOUNT value on done: 451039.0 [2024-08-06 03:42:32,373][52794] Sum rewards: 87.979, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.153', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.076', 'AMMO4': '0.119', 'weapon5': '0.170', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.811', 'FRAGCOUNT': '72.000'} [2024-08-06 03:42:32,725][52649] DAMAGECOUNT value on done: 433762.0 [2024-08-06 03:42:32,726][52649] Sum rewards: 70.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.761', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.141', 'weapon5': '0.176', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '58.000'} [2024-08-06 03:42:32,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 391946240. Throughput: 0: 4382.0. Samples: 97986760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:42:32,794][52567] Avg episode reward: [(0, '70.937')] [2024-08-06 03:42:33,323][52803] DAMAGECOUNT value on done: 409168.0 [2024-08-06 03:42:33,324][52803] Sum rewards: 59.670, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.462', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.123', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.406', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.174', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '53.000'} [2024-08-06 03:42:34,408][52659] DAMAGECOUNT value on done: 439381.0 [2024-08-06 03:42:34,412][52659] Sum rewards: 94.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.306', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.234', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '22.470', 'FRAGCOUNT': '78.000'} [2024-08-06 03:42:34,714][52811] DAMAGECOUNT value on done: 412669.0 [2024-08-06 03:42:34,717][52811] Sum rewards: 83.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.178', 'AMMO4': '0.191', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '69.000'} [2024-08-06 03:42:35,120][52794] DAMAGECOUNT value on done: 432847.0 [2024-08-06 03:42:35,120][52794] Sum rewards: 59.973, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.842', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.164', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '53.000'} [2024-08-06 03:42:35,175][52650] Updated weights for policy 0, policy_version 47851 (0.0023) [2024-08-06 03:42:35,547][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:42:35,837][52649] DAMAGECOUNT value on done: 432812.0 [2024-08-06 03:42:35,839][52649] Sum rewards: 71.299, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.400', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon4': '0.118', 'weapon5': '0.120', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.272', 'AMMO3': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.224', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 03:42:36,516][52803] DAMAGECOUNT value on done: 413123.0 [2024-08-06 03:42:36,518][52803] Sum rewards: 68.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.865', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'WEAPON1': '0.020', 'weapon4': '0.022', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.624', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '57.000'} [2024-08-06 03:42:37,480][52659] DAMAGECOUNT value on done: 448087.0 [2024-08-06 03:42:37,481][52659] Sum rewards: 72.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.188', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.650', 'weapon3': '3.104', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '62.000'} [2024-08-06 03:42:37,510][52794] DAMAGECOUNT value on done: 449200.0 [2024-08-06 03:42:37,510][52794] Sum rewards: 80.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.090', 'AMMO3': '0.191', 'AMMO4': '0.205', 'weapon4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '65.000'} [2024-08-06 03:42:37,670][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:42:37,790][52811] DAMAGECOUNT value on done: 406376.0 [2024-08-06 03:42:37,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 392044544. Throughput: 0: 4370.7. Samples: 98012710. Policy #0 lag: (min: 0.0, avg: 4.7, max: 10.0) [2024-08-06 03:42:37,793][52811] Sum rewards: 65.016, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.496', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.222', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2024-08-06 03:42:37,796][52567] Avg episode reward: [(0, '71.161')] [2024-08-06 03:42:38,417][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:42:38,533][52649] DAMAGECOUNT value on done: 433846.0 [2024-08-06 03:42:38,533][52649] Sum rewards: 85.513, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.152', 'AMMO3': '0.202', 'AMMO4': '0.261', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.762', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '69.000'} [2024-08-06 03:42:39,552][52803] DAMAGECOUNT value on done: 408222.0 [2024-08-06 03:42:39,553][52803] Sum rewards: 80.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.331', 'AMMO5': '0.015', 'AMMO2': '0.061', 'AMMO3': '0.193', 'weapon4': '0.246', 'weapon5': '0.270', 'AMMO4': '0.304', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '65.000'} [2024-08-06 03:42:39,960][52650] Updated weights for policy 0, policy_version 47861 (0.0028) [2024-08-06 03:42:39,984][52659] DAMAGECOUNT value on done: 448806.0 [2024-08-06 03:42:39,985][52659] Sum rewards: 76.739, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.894', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.070', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:40,410][52794] DAMAGECOUNT value on done: 440647.0 [2024-08-06 03:42:40,417][52794] Sum rewards: 74.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.100', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.250', 'HITCOUNT': '3.360', 'weapon3': '3.386', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '62.000'} [2024-08-06 03:42:40,937][52811] DAMAGECOUNT value on done: 409648.0 [2024-08-06 03:42:40,938][52811] Sum rewards: 73.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.435', 'AMMO5': '0.022', 'AMMO2': '0.043', 'weapon4': '0.082', 'AMMO3': '0.198', 'AMMO4': '0.217', 'weapon5': '0.386', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '60.500'} [2024-08-06 03:42:41,375][52649] DAMAGECOUNT value on done: 423322.0 [2024-08-06 03:42:41,376][52649] Sum rewards: 71.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.106', 'weapon5': '0.118', 'AMMO4': '0.139', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.354', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '62.000'} [2024-08-06 03:42:42,457][52659] DAMAGECOUNT value on done: 439937.0 [2024-08-06 03:42:42,459][52659] Sum rewards: 71.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.495', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon2': '0.190', 'AMMO3': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.500', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:42,651][52803] DAMAGECOUNT value on done: 406018.0 [2024-08-06 03:42:42,651][52803] Sum rewards: 61.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.666', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.076', 'weapon4': '0.200', 'AMMO3': '0.222', 'weapon5': '0.320', 'weapon2': '0.354', 'AMMO4': '0.378', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.5, 300 sec: 17494.8). Total num frames: 392118272. Throughput: 0: 4370.0. Samples: 98038890. Policy #0 lag: (min: 0.0, avg: 4.7, max: 10.0) [2024-08-06 03:42:42,794][52567] Avg episode reward: [(0, '71.476')] [2024-08-06 03:42:42,987][52795] DAMAGECOUNT value on done: 407448.0 [2024-08-06 03:42:42,991][52795] Sum rewards: 65.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.806', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.130', 'AMMO3': '0.205', 'weapon5': '0.212', 'weapon2': '0.294', 'AMMO4': '0.307', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.052', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:43,639][52794] DAMAGECOUNT value on done: 442240.0 [2024-08-06 03:42:43,640][52794] Sum rewards: 78.835, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO4': '0.085', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon2': '0.578', 'WEAPON3': '0.950', 'weapon3': '3.136', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '62.000'} [2024-08-06 03:42:44,040][52811] DAMAGECOUNT value on done: 410746.0 [2024-08-06 03:42:44,040][52811] Sum rewards: 79.883, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.676', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.330', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '65.000'} [2024-08-06 03:42:44,213][52649] DAMAGECOUNT value on done: 431583.0 [2024-08-06 03:42:44,213][52649] Sum rewards: 68.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.555', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.158', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '0.950', 'weapon3': '2.900', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:44,397][52666] DAMAGECOUNT value on done: 436272.0 [2024-08-06 03:42:44,397][52666] Sum rewards: 54.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.555', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.186', 'weapon2': '0.188', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.346', 'DAMAGECOUNT': '14.259', 'FRAGCOUNT': '47.000'} [2024-08-06 03:42:44,835][52650] Updated weights for policy 0, policy_version 47871 (0.0014) [2024-08-06 03:42:45,260][52659] DAMAGECOUNT value on done: 442213.0 [2024-08-06 03:42:45,263][52659] Sum rewards: 63.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.125', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.058', 'AMMO3': '0.262', 'weapon2': '0.446', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:45,627][52803] DAMAGECOUNT value on done: 415491.0 [2024-08-06 03:42:45,627][52803] Sum rewards: 80.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.330', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.190', 'AMMO3': '0.212', 'weapon4': '0.214', 'AMMO4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '67.000'} [2024-08-06 03:42:46,169][52795] DAMAGECOUNT value on done: 398452.0 [2024-08-06 03:42:46,170][52795] Sum rewards: 59.130, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.790', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.158', 'weapon5': '0.188', 'AMMO4': '0.236', 'AMMO3': '0.313', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.850', 'weapon3': '2.884', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '54.000'} [2024-08-06 03:42:46,286][52794] DAMAGECOUNT value on done: 446616.0 [2024-08-06 03:42:46,288][52794] Sum rewards: 73.849, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.102', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.204', 'HEALTH': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.344', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:47,020][52811] DAMAGECOUNT value on done: 409844.0 [2024-08-06 03:42:47,022][52811] Sum rewards: 68.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.687', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.165', 'AMMO3': '0.170', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:47,070][52666] DAMAGECOUNT value on done: 443092.0 [2024-08-06 03:42:47,072][52666] Sum rewards: 59.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.098', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.148', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.726', 'WEAPON3': '1.150', 'weapon3': '2.758', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '50.000'} [2024-08-06 03:42:47,272][52649] DAMAGECOUNT value on done: 423196.0 [2024-08-06 03:42:47,272][52649] Sum rewards: 54.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'AMMO5': '0.021', 'AMMO2': '0.047', 'weapon5': '0.174', 'weapon4': '0.222', 'AMMO3': '0.226', 'AMMO4': '0.236', 'weapon2': '0.352', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.002', 'DAMAGECOUNT': '13.872', 'FRAGCOUNT': '49.000'} [2024-08-06 03:42:47,500][52670] DAMAGECOUNT value on done: 430085.0 [2024-08-06 03:42:47,506][52670] Sum rewards: 67.760, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.631', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.147', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.338', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:47,744][52659] DAMAGECOUNT value on done: 432572.0 [2024-08-06 03:42:47,745][52659] Sum rewards: 59.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.034', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.132', 'weapon5': '0.182', 'AMMO3': '0.233', 'AMMO4': '0.247', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.118', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '51.500'} [2024-08-06 03:42:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 392208384. Throughput: 0: 4376.7. Samples: 98052030. Policy #0 lag: (min: 0.0, avg: 4.7, max: 10.0) [2024-08-06 03:42:47,794][52567] Avg episode reward: [(0, '70.927')] [2024-08-06 03:42:48,730][52803] DAMAGECOUNT value on done: 412257.0 [2024-08-06 03:42:48,731][52803] Sum rewards: 74.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.058', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.456', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:49,215][52795] DAMAGECOUNT value on done: 398725.0 [2024-08-06 03:42:49,217][52795] Sum rewards: 64.166, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon2': '0.346', 'weapon4': '0.356', 'WEAPON3': '0.950', 'HITCOUNT': '3.040', 'weapon3': '3.110', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '52.000'} [2024-08-06 03:42:49,335][52650] Updated weights for policy 0, policy_version 47881 (0.0023) [2024-08-06 03:42:49,562][52794] DAMAGECOUNT value on done: 438803.0 [2024-08-06 03:42:49,562][52794] Sum rewards: 70.905, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.474', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.500'} [2024-08-06 03:42:50,199][52811] DAMAGECOUNT value on done: 410424.0 [2024-08-06 03:42:50,201][52811] Sum rewards: 62.214, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.680', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.054', 'WEAPON5': '0.200', 'AMMO4': '0.241', 'AMMO3': '0.263', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.996', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:50,271][52666] DAMAGECOUNT value on done: 442205.0 [2024-08-06 03:42:50,275][52666] Sum rewards: 72.740, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.546', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO3': '0.129', 'AMMO4': '0.160', 'weapon2': '0.262', 'weapon5': '0.316', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.768', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '57.000'} [2024-08-06 03:42:50,288][52649] DAMAGECOUNT value on done: 433023.0 [2024-08-06 03:42:50,288][52649] Sum rewards: 67.580, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.492', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.242', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.134', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:50,644][52659] DAMAGECOUNT value on done: 440138.0 [2024-08-06 03:42:50,644][52659] Sum rewards: 72.135, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.054', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.266', 'AMMO3': '0.315', 'WEAPON3': '1.750', 'weapon3': '3.340', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:50,773][52670] DAMAGECOUNT value on done: 439678.0 [2024-08-06 03:42:50,774][52670] Sum rewards: 61.227, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.982', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.752', 'WEAPON3': '1.000', 'weapon3': '2.956', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '49.000'} [2024-08-06 03:42:51,780][52803] DAMAGECOUNT value on done: 412999.0 [2024-08-06 03:42:51,785][52803] Sum rewards: 81.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.034', 'AMMO4': '0.138', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '66.000'} [2024-08-06 03:42:52,182][52663] DAMAGECOUNT value on done: 445077.0 [2024-08-06 03:42:52,182][52663] Sum rewards: 84.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon4': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.614', 'WEAPON3': '0.950', 'weapon3': '3.060', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '67.000'} [2024-08-06 03:42:52,296][52664] DAMAGECOUNT value on done: 455897.0 [2024-08-06 03:42:52,296][52664] Sum rewards: 65.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.735', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon4': '0.114', 'weapon5': '0.130', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '55.000'} [2024-08-06 03:42:52,350][52795] DAMAGECOUNT value on done: 404632.0 [2024-08-06 03:42:52,354][52795] Sum rewards: 63.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.236', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '53.000'} [2024-08-06 03:42:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 392298496. Throughput: 0: 4384.4. Samples: 98078610. Policy #0 lag: (min: 0.0, avg: 4.7, max: 10.0) [2024-08-06 03:42:52,794][52567] Avg episode reward: [(0, '71.031')] [2024-08-06 03:42:53,351][52649] DAMAGECOUNT value on done: 435439.0 [2024-08-06 03:42:53,351][52649] Sum rewards: 69.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.186', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.066', 'weapon4': '0.078', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '59.000'} [2024-08-06 03:42:53,404][52659] DAMAGECOUNT value on done: 449219.0 [2024-08-06 03:42:53,406][52659] Sum rewards: 68.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.041', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.094', 'AMMO4': '0.148', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.382', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:53,431][52666] DAMAGECOUNT value on done: 440742.0 [2024-08-06 03:42:53,433][52666] Sum rewards: 72.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.877', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.120', 'weapon4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '61.000'} [2024-08-06 03:42:53,774][52659] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:42:53,901][52650] Updated weights for policy 0, policy_version 47891 (0.0011) [2024-08-06 03:42:53,936][52670] DAMAGECOUNT value on done: 433191.0 [2024-08-06 03:42:53,938][52670] Sum rewards: 70.772, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.885', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.211', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2024-08-06 03:42:54,883][52803] DAMAGECOUNT value on done: 408573.0 [2024-08-06 03:42:54,883][52803] Sum rewards: 71.028, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.562', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.104', 'AMMO4': '0.107', 'AMMO3': '0.179', 'weapon2': '0.192', 'WEAPON4': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.240', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '56.000'} [2024-08-06 03:42:55,306][52663] DAMAGECOUNT value on done: 440293.0 [2024-08-06 03:42:55,306][52663] Sum rewards: 70.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.092', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2024-08-06 03:42:55,522][52664] DAMAGECOUNT value on done: 461102.0 [2024-08-06 03:42:55,523][52664] Sum rewards: 70.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.700', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.122', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.390', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '60.500'} [2024-08-06 03:42:55,633][52795] DAMAGECOUNT value on done: 400918.0 [2024-08-06 03:42:55,633][52795] Sum rewards: 70.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.670', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.186', 'AMMO3': '0.254', 'weapon5': '0.258', 'AMMO4': '0.271', 'weapon2': '0.470', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.812', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.000'} [2024-08-06 03:42:55,952][52659] DAMAGECOUNT value on done: 445636.0 [2024-08-06 03:42:55,952][52659] Sum rewards: 79.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.479', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.032', 'AMMO4': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.396', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '65.000'} [2024-08-06 03:42:56,335][52649] DAMAGECOUNT value on done: 428753.0 [2024-08-06 03:42:56,335][52649] Sum rewards: 75.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.236', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.374', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '64.000'} [2024-08-06 03:42:56,566][52666] DAMAGECOUNT value on done: 440413.0 [2024-08-06 03:42:56,566][52666] Sum rewards: 67.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.186', 'AMMO3': '0.217', 'AMMO4': '0.226', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.268', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '57.000'} [2024-08-06 03:42:57,091][52670] DAMAGECOUNT value on done: 432315.0 [2024-08-06 03:42:57,096][52670] Sum rewards: 76.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.030', 'AMMO4': '0.144', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '62.500'} [2024-08-06 03:42:57,698][52663] DAMAGECOUNT value on done: 433889.0 [2024-08-06 03:42:57,700][52663] Sum rewards: 65.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.587', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.256', 'WEAPON4': '0.450', 'weapon4': '0.574', 'weapon2': '0.632', 'WEAPON3': '1.500', 'weapon3': '2.482', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '57.000'} [2024-08-06 03:42:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 392380416. Throughput: 0: 4374.9. Samples: 98104590. Policy #0 lag: (min: 0.0, avg: 4.7, max: 10.0) [2024-08-06 03:42:57,794][52567] Avg episode reward: [(0, '70.964')] [2024-08-06 03:42:58,177][52664] DAMAGECOUNT value on done: 461830.0 [2024-08-06 03:42:58,178][52664] Sum rewards: 81.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.991', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.022', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.248', 'weapon2': '0.310', 'WEAPON3': '1.600', 'weapon3': '3.464', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '69.000'} [2024-08-06 03:42:58,702][52650] Updated weights for policy 0, policy_version 47901 (0.0017) [2024-08-06 03:42:58,849][52659] DAMAGECOUNT value on done: 445583.0 [2024-08-06 03:42:58,857][52659] Sum rewards: 64.553, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.434', 'WEAPON3': '1.000', 'weapon3': '2.982', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '51.500'} [2024-08-06 03:42:58,918][52795] DAMAGECOUNT value on done: 408207.0 [2024-08-06 03:42:58,924][52795] Sum rewards: 66.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.471', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.176', 'weapon2': '0.222', 'AMMO3': '0.263', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.072', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '58.000'} [2024-08-06 03:42:59,751][52666] DAMAGECOUNT value on done: 431454.0 [2024-08-06 03:42:59,751][52666] Sum rewards: 65.425, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.022', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.088', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.276', 'weapon2': '0.426', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '58.000'} [2024-08-06 03:43:00,016][52669] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2024-08-06 03:43:00,327][52670] DAMAGECOUNT value on done: 443112.0 [2024-08-06 03:43:00,327][52670] Sum rewards: 71.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.139', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.160', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.430', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:00,719][52795] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.03, -10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:43:00,807][52663] DAMAGECOUNT value on done: 438516.0 [2024-08-06 03:43:00,808][52663] Sum rewards: 58.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.270', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.148', 'weapon5': '0.176', 'AMMO4': '0.201', 'weapon2': '0.300', 'AMMO3': '0.301', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.930', 'weapon3': '3.080', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:00,877][52664] DAMAGECOUNT value on done: 454456.0 [2024-08-06 03:43:00,878][52664] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.060', 'AMMO3': '0.158', 'weapon2': '0.234', 'weapon5': '0.282', 'AMMO4': '0.301', 'HEALTH': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '2.630', 'weapon3': '2.770', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '51.000'} [2024-08-06 03:43:01,944][52659] DAMAGECOUNT value on done: 437981.0 [2024-08-06 03:43:01,946][52659] Sum rewards: 72.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.086', 'AMMO4': '0.099', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:02,149][52795] DAMAGECOUNT value on done: 415049.0 [2024-08-06 03:43:02,150][52795] Sum rewards: 74.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO4': '0.195', 'weapon4': '0.246', 'AMMO3': '0.256', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.000'} [2024-08-06 03:43:02,696][52666] DAMAGECOUNT value on done: 438630.0 [2024-08-06 03:43:02,696][52666] Sum rewards: 63.155, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.262', 'weapon2': '0.272', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.454', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 392470528. Throughput: 0: 4375.8. Samples: 98117680. Policy #0 lag: (min: 0.0, avg: 4.7, max: 10.0) [2024-08-06 03:43:02,794][52567] Avg episode reward: [(0, '70.351')] [2024-08-06 03:43:03,055][52670] DAMAGECOUNT value on done: 435878.0 [2024-08-06 03:43:03,055][52670] Sum rewards: 71.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.730', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.158', 'AMMO3': '0.195', 'weapon4': '0.210', 'AMMO4': '0.221', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '59.000'} [2024-08-06 03:43:03,334][52650] Updated weights for policy 0, policy_version 47911 (0.0010) [2024-08-06 03:43:03,409][52664] DAMAGECOUNT value on done: 458624.0 [2024-08-06 03:43:03,412][52664] Sum rewards: 68.534, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.744', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.173', 'weapon5': '0.174', 'weapon2': '0.222', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.178', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:04,065][52663] DAMAGECOUNT value on done: 438816.0 [2024-08-06 03:43:04,067][52663] Sum rewards: 75.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.728', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.156', 'AMMO3': '0.218', 'AMMO4': '0.229', 'weapon4': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '65.000'} [2024-08-06 03:43:04,304][52647] DAMAGECOUNT value on done: 464099.0 [2024-08-06 03:43:04,307][52647] Sum rewards: 73.735, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.200', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.168', 'AMMO4': '0.234', 'weapon2': '0.296', 'AMMO3': '0.302', 'weapon5': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.882', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '65.000'} [2024-08-06 03:43:04,864][52659] DAMAGECOUNT value on done: 442650.0 [2024-08-06 03:43:04,865][52659] Sum rewards: 63.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.605', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.218', 'weapon5': '0.244', 'weapon4': '0.266', 'AMMO4': '0.293', 'weapon2': '0.352', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:05,203][52666] DAMAGECOUNT value on done: 438253.0 [2024-08-06 03:43:05,204][52666] Sum rewards: 63.942, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.608', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon4': '0.338', 'weapon2': '0.390', 'WEAPON3': '1.600', 'weapon3': '2.854', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:05,284][52795] DAMAGECOUNT value on done: 408852.0 [2024-08-06 03:43:05,286][52795] Sum rewards: 72.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.360', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon2': '0.186', 'AMMO4': '0.186', 'AMMO3': '0.240', 'weapon4': '0.264', 'weapon5': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:05,805][52664] DAMAGECOUNT value on done: 456164.0 [2024-08-06 03:43:05,805][52664] Sum rewards: 76.049, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.262', 'WEAPON3': '1.100', 'weapon3': '3.402', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:05,902][52670] DAMAGECOUNT value on done: 428793.0 [2024-08-06 03:43:05,903][52670] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.710', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.079', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.374', 'weapon2': '0.560', 'WEAPON3': '0.850', 'weapon3': '2.872', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '58.000'} [2024-08-06 03:43:06,607][52647] DAMAGECOUNT value on done: 463509.0 [2024-08-06 03:43:06,607][52647] Sum rewards: 65.673, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.140', 'weapon4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.264', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:07,458][52663] DAMAGECOUNT value on done: 441962.0 [2024-08-06 03:43:07,459][52663] Sum rewards: 75.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.432', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon5': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.456', 'WEAPON3': '0.950', 'weapon3': '3.154', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '58.000'} [2024-08-06 03:43:07,635][52659] DAMAGECOUNT value on done: 442245.0 [2024-08-06 03:43:07,637][52659] Sum rewards: 65.435, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.116', 'weapon4': '0.124', 'AMMO3': '0.247', 'AMMO4': '0.248', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.500'} [2024-08-06 03:43:07,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 392560640. Throughput: 0: 4367.8. Samples: 98143840. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:43:07,795][52567] Avg episode reward: [(0, '70.436')] [2024-08-06 03:43:07,803][52647] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:43:07,832][52666] DAMAGECOUNT value on done: 435110.0 [2024-08-06 03:43:07,834][52666] Sum rewards: 76.534, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.100', 'weapon5': '0.162', 'AMMO3': '0.177', 'AMMO4': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '64.000'} [2024-08-06 03:43:08,232][52650] Updated weights for policy 0, policy_version 47921 (0.0012) [2024-08-06 03:43:08,266][52664] DAMAGECOUNT value on done: 456454.0 [2024-08-06 03:43:08,266][52664] Sum rewards: 64.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.190', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.092', 'AMMO4': '0.221', 'AMMO3': '0.239', 'weapon5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.926', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '53.000'} [2024-08-06 03:43:08,375][52670] DAMAGECOUNT value on done: 433702.0 [2024-08-06 03:43:08,377][52670] Sum rewards: 75.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.919', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.038', 'AMMO4': '0.085', 'weapon4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '63.000'} [2024-08-06 03:43:08,457][52795] DAMAGECOUNT value on done: 397743.0 [2024-08-06 03:43:08,459][52795] Sum rewards: 64.327, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.752', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon5': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.334', 'weapon2': '0.392', 'WEAPON3': '0.950', 'weapon3': '2.924', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '51.000'} [2024-08-06 03:43:09,071][52647] DAMAGECOUNT value on done: 463282.0 [2024-08-06 03:43:09,071][52647] Sum rewards: 62.596, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.099', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.324', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.376', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:10,416][52663] DAMAGECOUNT value on done: 440647.0 [2024-08-06 03:43:10,421][52663] Sum rewards: 69.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.591', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.128', 'AMMO3': '0.225', 'AMMO4': '0.242', 'weapon5': '0.246', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.926', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '58.500'} [2024-08-06 03:43:10,773][52666] DAMAGECOUNT value on done: 428907.0 [2024-08-06 03:43:10,774][52666] Sum rewards: 68.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.966', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.135', 'weapon4': '0.172', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '58.000'} [2024-08-06 03:43:10,915][52664] DAMAGECOUNT value on done: 450649.0 [2024-08-06 03:43:10,915][52664] Sum rewards: 86.396, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.160', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.233', 'weapon2': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.518', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.357', 'FRAGCOUNT': '70.000'} [2024-08-06 03:43:11,430][52670] DAMAGECOUNT value on done: 436173.0 [2024-08-06 03:43:11,432][52670] Sum rewards: 77.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.118', 'weapon5': '0.138', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '66.000'} [2024-08-06 03:43:11,627][52795] DAMAGECOUNT value on done: 413211.0 [2024-08-06 03:43:11,627][52795] Sum rewards: 56.198, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.665', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.294', 'weapon2': '0.480', 'WEAPON3': '1.700', 'HITCOUNT': '3.130', 'weapon3': '3.218', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '50.500'} [2024-08-06 03:43:11,746][52647] DAMAGECOUNT value on done: 471447.0 [2024-08-06 03:43:11,749][52647] Sum rewards: 65.466, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.424', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.216', 'AMMO4': '0.217', 'weapon2': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.890', 'weapon3': '3.136', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '59.000'} [2024-08-06 03:43:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 392642560. Throughput: 0: 4368.7. Samples: 98170350. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:43:12,794][52567] Avg episode reward: [(0, '70.823')] [2024-08-06 03:43:12,895][52650] Updated weights for policy 0, policy_version 47931 (0.0036) [2024-08-06 03:43:13,240][52663] DAMAGECOUNT value on done: 434339.0 [2024-08-06 03:43:13,242][52663] Sum rewards: 70.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.736', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.114', 'AMMO4': '0.140', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:13,740][52664] DAMAGECOUNT value on done: 461006.0 [2024-08-06 03:43:13,741][52664] Sum rewards: 56.583, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.690', 'AMMO5': '0.017', 'AMMO2': '0.077', 'weapon5': '0.108', 'AMMO3': '0.243', 'weapon2': '0.338', 'WEAPON5': '0.350', 'AMMO4': '0.386', 'weapon4': '0.506', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.690', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:13,950][52666] DAMAGECOUNT value on done: 435284.0 [2024-08-06 03:43:13,950][52666] Sum rewards: 65.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon2': '0.144', 'AMMO4': '0.162', 'weapon5': '0.178', 'AMMO3': '0.207', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:14,563][52670] DAMAGECOUNT value on done: 431288.0 [2024-08-06 03:43:14,563][52670] Sum rewards: 70.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO2': '0.010', 'AMMO5': '0.013', 'weapon4': '0.014', 'weapon5': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.814', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '59.000'} [2024-08-06 03:43:14,610][52647] DAMAGECOUNT value on done: 469925.0 [2024-08-06 03:43:14,610][52647] Sum rewards: 73.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.432', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon2': '0.184', 'AMMO4': '0.218', 'AMMO3': '0.223', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:14,765][52795] DAMAGECOUNT value on done: 405722.0 [2024-08-06 03:43:14,766][52795] Sum rewards: 74.901, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '64.000'} [2024-08-06 03:43:16,116][52663] DAMAGECOUNT value on done: 434779.0 [2024-08-06 03:43:16,119][52663] Sum rewards: 81.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.089', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.184', 'weapon2': '0.194', 'AMMO4': '0.197', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.278', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '70.000'} [2024-08-06 03:43:16,538][52664] DAMAGECOUNT value on done: 453413.0 [2024-08-06 03:43:16,539][52664] Sum rewards: 76.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.538', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.142', 'AMMO3': '0.175', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '0.950', 'weapon3': '3.060', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '63.000'} [2024-08-06 03:43:17,058][52666] DAMAGECOUNT value on done: 433344.0 [2024-08-06 03:43:17,059][52666] Sum rewards: 63.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.088', 'weapon4': '0.124', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:17,207][52647] DAMAGECOUNT value on done: 467093.0 [2024-08-06 03:43:17,207][52647] Sum rewards: 73.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.056', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.048', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '62.000'} [2024-08-06 03:43:17,290][52650] Updated weights for policy 0, policy_version 47941 (0.0014) [2024-08-06 03:43:17,497][52670] DAMAGECOUNT value on done: 438174.0 [2024-08-06 03:43:17,498][52670] Sum rewards: 70.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.098', 'weapon5': '0.154', 'AMMO4': '0.172', 'weapon2': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.266', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 392732672. Throughput: 0: 4372.2. Samples: 98183510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:43:17,794][52567] Avg episode reward: [(0, '70.303')] [2024-08-06 03:43:17,904][52795] DAMAGECOUNT value on done: 404812.0 [2024-08-06 03:43:17,905][52795] Sum rewards: 72.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.439', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.372', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.758', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:18,999][52663] DAMAGECOUNT value on done: 441630.0 [2024-08-06 03:43:19,001][52663] Sum rewards: 65.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.017', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.226', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:19,024][52664] DAMAGECOUNT value on done: 464236.0 [2024-08-06 03:43:19,024][52664] Sum rewards: 76.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.200', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.214', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '65.000'} [2024-08-06 03:43:19,568][52666] DAMAGECOUNT value on done: 444490.0 [2024-08-06 03:43:19,568][52666] Sum rewards: 71.288, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.540', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.216', 'AMMO4': '0.260', 'weapon2': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:19,702][52647] DAMAGECOUNT value on done: 464849.0 [2024-08-06 03:43:19,703][52647] Sum rewards: 67.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.182', 'weapon5': '0.246', 'weapon2': '0.274', 'AMMO4': '0.275', 'weapon4': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.572', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '56.500'} [2024-08-06 03:43:20,047][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:43:20,238][52670] DAMAGECOUNT value on done: 431196.0 [2024-08-06 03:43:20,238][52670] Sum rewards: 63.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.078', 'weapon5': '0.122', 'AMMO4': '0.147', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:20,988][52795] DAMAGECOUNT value on done: 400877.0 [2024-08-06 03:43:20,988][52795] Sum rewards: 66.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.184', 'weapon2': '0.194', 'AMMO4': '0.197', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.220', 'weapon3': '3.294', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:21,669][52663] DAMAGECOUNT value on done: 446766.0 [2024-08-06 03:43:21,670][52663] Sum rewards: 61.173, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.115', 'AMMO5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.123', 'weapon5': '0.130', 'weapon4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.712', 'WEAPON3': '0.850', 'weapon3': '2.760', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '47.500'} [2024-08-06 03:43:21,955][52664] DAMAGECOUNT value on done: 457824.0 [2024-08-06 03:43:21,956][52664] Sum rewards: 63.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.454', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.146', 'weapon4': '0.152', 'AMMO3': '0.203', 'AMMO4': '0.272', 'weapon2': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.044', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:22,111][52650] Updated weights for policy 0, policy_version 47951 (0.0019) [2024-08-06 03:43:22,505][52647] DAMAGECOUNT value on done: 459617.0 [2024-08-06 03:43:22,505][52647] Sum rewards: 77.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.588', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.247', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.488', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '64.000'} [2024-08-06 03:43:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 392822784. Throughput: 0: 4376.2. Samples: 98209640. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:43:22,794][52567] Avg episode reward: [(0, '69.721')] [2024-08-06 03:43:22,940][52666] DAMAGECOUNT value on done: 440436.0 [2024-08-06 03:43:22,942][52666] Sum rewards: 67.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.461', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO4': '0.168', 'weapon2': '0.188', 'AMMO3': '0.214', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.246', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '56.000'} [2024-08-06 03:43:23,454][52670] DAMAGECOUNT value on done: 432929.0 [2024-08-06 03:43:23,454][52670] Sum rewards: 80.218, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.616', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.042', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.380', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '65.000'} [2024-08-06 03:43:24,132][52795] DAMAGECOUNT value on done: 409667.0 [2024-08-06 03:43:24,132][52795] Sum rewards: 77.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.105', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO4': '0.153', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '63.500'} [2024-08-06 03:43:24,524][52664] DAMAGECOUNT value on done: 466716.0 [2024-08-06 03:43:24,524][52664] Sum rewards: 58.968, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.786', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO4': '0.205', 'weapon2': '0.256', 'AMMO3': '0.289', 'WEAPON5': '0.350', 'weapon4': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.802', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '53.000'} [2024-08-06 03:43:24,616][52663] DAMAGECOUNT value on done: 438056.0 [2024-08-06 03:43:24,624][52663] Sum rewards: 63.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO5': '0.004', 'AMMO2': '0.035', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '2.968', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:24,950][52647] DAMAGECOUNT value on done: 471013.0 [2024-08-06 03:43:24,951][52647] Sum rewards: 71.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.338', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.112', 'weapon5': '0.148', 'AMMO4': '0.194', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '62.000'} [2024-08-06 03:43:26,166][52666] DAMAGECOUNT value on done: 435882.0 [2024-08-06 03:43:26,168][52666] Sum rewards: 62.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.080', 'weapon4': '0.118', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.336', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '51.000'} [2024-08-06 03:43:26,720][52670] DAMAGECOUNT value on done: 443932.0 [2024-08-06 03:43:26,721][52670] Sum rewards: 60.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.875', 'AMMO5': '0.006', 'AMMO2': '0.063', 'weapon5': '0.078', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'AMMO4': '0.313', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '51.000'} [2024-08-06 03:43:26,777][52650] Updated weights for policy 0, policy_version 47961 (0.0012) [2024-08-06 03:43:27,134][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:43:27,273][52795] DAMAGECOUNT value on done: 399229.0 [2024-08-06 03:43:27,275][52795] Sum rewards: 65.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.204', 'AMMO3': '0.226', 'weapon2': '0.238', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '56.000'} [2024-08-06 03:43:27,276][52664] DAMAGECOUNT value on done: 460292.0 [2024-08-06 03:43:27,277][52664] Sum rewards: 70.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.844', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.220', 'AMMO3': '0.252', 'weapon2': '0.256', 'AMMO4': '0.279', 'weapon5': '0.364', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.842', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:27,382][52663] DAMAGECOUNT value on done: 433831.0 [2024-08-06 03:43:27,382][52663] Sum rewards: 65.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.060', 'AMMO4': '0.116', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:27,768][52647] DAMAGECOUNT value on done: 460344.0 [2024-08-06 03:43:27,769][52647] Sum rewards: 60.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.794', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon5': '0.200', 'weapon4': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.275', 'weapon2': '0.300', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'HITCOUNT': '2.950', 'weapon3': '2.998', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 392912896. Throughput: 0: 4375.6. Samples: 98235790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:43:27,794][52567] Avg episode reward: [(0, '69.125')] [2024-08-06 03:43:29,307][52666] DAMAGECOUNT value on done: 436187.0 [2024-08-06 03:43:29,308][52666] Sum rewards: 69.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.667', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon2': '0.200', 'AMMO3': '0.227', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.616', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '59.000'} [2024-08-06 03:43:29,315][52820] DAMAGECOUNT value on done: 403552.0 [2024-08-06 03:43:29,316][52820] Sum rewards: 66.139, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.998', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.158', 'AMMO4': '0.203', 'AMMO3': '0.256', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.500', 'weapon3': '2.862', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:29,633][52649] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:43:29,665][52670] DAMAGECOUNT value on done: 437449.0 [2024-08-06 03:43:29,668][52670] Sum rewards: 66.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.138', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.146', 'AMMO3': '0.197', 'AMMO4': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.072', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:29,752][52664] DAMAGECOUNT value on done: 462265.0 [2024-08-06 03:43:29,752][52664] Sum rewards: 64.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.516', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.102', 'AMMO4': '0.150', 'AMMO3': '0.172', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:30,039][52647] DAMAGECOUNT value on done: 464657.0 [2024-08-06 03:43:30,040][52647] Sum rewards: 70.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.322', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 03:43:30,351][52663] DAMAGECOUNT value on done: 433324.0 [2024-08-06 03:43:30,352][52663] Sum rewards: 75.144, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.898', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.166', 'AMMO3': '0.222', 'AMMO4': '0.277', 'weapon2': '0.296', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '65.000'} [2024-08-06 03:43:30,468][52795] DAMAGECOUNT value on done: 417357.0 [2024-08-06 03:43:30,469][52795] Sum rewards: 76.056, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.328', 'AMMO5': '0.004', 'weapon5': '0.030', 'AMMO2': '0.031', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'weapon4': '0.246', 'AMMO3': '0.286', 'weapon2': '0.298', 'WEAPON3': '1.750', 'weapon3': '3.178', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '68.000'} [2024-08-06 03:43:30,983][52667] DAMAGECOUNT value on done: 436934.0 [2024-08-06 03:43:30,985][52667] Sum rewards: 77.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.131', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.246', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.430', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '66.000'} [2024-08-06 03:43:31,576][52650] Updated weights for policy 0, policy_version 47971 (0.0011) [2024-08-06 03:43:32,186][52666] DAMAGECOUNT value on done: 438029.0 [2024-08-06 03:43:32,187][52666] Sum rewards: 80.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.068', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.320', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '68.000'} [2024-08-06 03:43:32,224][52664] DAMAGECOUNT value on done: 455977.0 [2024-08-06 03:43:32,224][52664] Sum rewards: 69.083, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.570', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.092', 'AMMO4': '0.103', 'weapon5': '0.138', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.284', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '56.000'} [2024-08-06 03:43:32,471][52820] DAMAGECOUNT value on done: 407690.0 [2024-08-06 03:43:32,472][52820] Sum rewards: 67.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.417', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.102', 'AMMO4': '0.212', 'AMMO3': '0.220', 'weapon5': '0.240', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:32,540][52647] DAMAGECOUNT value on done: 457295.0 [2024-08-06 03:43:32,540][52647] Sum rewards: 67.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'weapon4': '0.266', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:32,719][52670] DAMAGECOUNT value on done: 422886.0 [2024-08-06 03:43:32,721][52670] Sum rewards: 63.728, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.348', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.078', 'weapon5': '0.116', 'AMMO4': '0.206', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.252', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '55.500'} [2024-08-06 03:43:32,747][52820] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:43:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 392994816. Throughput: 0: 4376.0. Samples: 98248950. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 03:43:32,794][52567] Avg episode reward: [(0, '69.747')] [2024-08-06 03:43:33,473][52663] DAMAGECOUNT value on done: 434242.0 [2024-08-06 03:43:33,474][52663] Sum rewards: 68.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO4': '0.203', 'weapon5': '0.228', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'weapon4': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.668', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:33,575][52667] DAMAGECOUNT value on done: 447019.0 [2024-08-06 03:43:33,576][52667] Sum rewards: 75.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.108', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon4': '0.072', 'weapon5': '0.122', 'AMMO4': '0.156', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.000', 'weapon3': '3.024', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '60.500'} [2024-08-06 03:43:33,693][52795] DAMAGECOUNT value on done: 409215.0 [2024-08-06 03:43:33,693][52795] Sum rewards: 66.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.999', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.168', 'weapon5': '0.172', 'AMMO4': '0.204', 'AMMO3': '0.206', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.064', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:35,031][52664] DAMAGECOUNT value on done: 455538.0 [2024-08-06 03:43:35,041][52664] Sum rewards: 57.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.140', 'weapon4': '0.142', 'AMMO4': '0.233', 'AMMO3': '0.241', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '50.000'} [2024-08-06 03:43:35,075][52666] DAMAGECOUNT value on done: 439272.0 [2024-08-06 03:43:35,076][52666] Sum rewards: 73.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.665', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.054', 'weapon5': '0.120', 'AMMO4': '0.190', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '62.000'} [2024-08-06 03:43:35,108][52668] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:43:35,264][52647] DAMAGECOUNT value on done: 464475.0 [2024-08-06 03:43:35,265][52647] Sum rewards: 71.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.175', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon5': '0.234', 'weapon4': '0.248', 'AMMO3': '0.254', 'AMMO4': '0.279', 'weapon2': '0.372', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '62.000'} [2024-08-06 03:43:35,510][52670] DAMAGECOUNT value on done: 435088.0 [2024-08-06 03:43:35,512][52670] Sum rewards: 67.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.297', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.136', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.304', 'weapon2': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:35,783][52820] DAMAGECOUNT value on done: 407636.0 [2024-08-06 03:43:35,786][52820] Sum rewards: 60.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.202', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.030', 'weapon4': '0.114', 'AMMO4': '0.131', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:36,361][52650] Updated weights for policy 0, policy_version 47981 (0.0013) [2024-08-06 03:43:36,467][52663] DAMAGECOUNT value on done: 443969.0 [2024-08-06 03:43:36,467][52663] Sum rewards: 63.438, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.098', 'weapon2': '0.154', 'AMMO3': '0.190', 'weapon4': '0.192', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.396', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:36,492][52667] DAMAGECOUNT value on done: 439357.0 [2024-08-06 03:43:36,492][52667] Sum rewards: 79.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.235', 'weapon2': '0.420', 'WEAPON3': '1.550', 'weapon3': '3.382', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '67.000'} [2024-08-06 03:43:36,536][52614] Signal inference workers to stop experience collection... (8700 times) [2024-08-06 03:43:36,536][52614] Signal inference workers to resume experience collection... (8700 times) [2024-08-06 03:43:36,617][52650] InferenceWorker_p0-w0: stopping experience collection (8700 times) [2024-08-06 03:43:36,617][52650] InferenceWorker_p0-w0: resuming experience collection (8700 times) [2024-08-06 03:43:36,839][52795] DAMAGECOUNT value on done: 400682.0 [2024-08-06 03:43:36,839][52795] Sum rewards: 71.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.954', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.177', 'AMMO3': '0.180', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.468', 'weapon2': '0.498', 'WEAPON3': '1.050', 'weapon3': '2.608', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '58.500'} [2024-08-06 03:43:37,696][52664] DAMAGECOUNT value on done: 458109.0 [2024-08-06 03:43:37,698][52664] Sum rewards: 81.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.178', 'AMMO3': '0.184', 'AMMO4': '0.195', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '67.000'} [2024-08-06 03:43:37,794][52666] DAMAGECOUNT value on done: 427606.0 [2024-08-06 03:43:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 393093120. Throughput: 0: 4366.4. Samples: 98275100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:43:37,794][52666] Sum rewards: 66.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.664', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.138', 'weapon4': '0.156', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.184', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:37,796][52567] Avg episode reward: [(0, '69.591')] [2024-08-06 03:43:38,102][52647] DAMAGECOUNT value on done: 460572.0 [2024-08-06 03:43:38,102][52647] Sum rewards: 69.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.796', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.110', 'AMMO4': '0.246', 'weapon2': '0.254', 'weapon5': '0.260', 'AMMO3': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.066', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:38,227][52670] DAMAGECOUNT value on done: 444668.0 [2024-08-06 03:43:38,227][52670] Sum rewards: 83.605, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.108', 'AMMO4': '0.118', 'AMMO3': '0.141', 'weapon2': '0.462', 'WEAPON3': '0.900', 'weapon3': '3.204', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '67.000'} [2024-08-06 03:43:38,918][52820] DAMAGECOUNT value on done: 402664.0 [2024-08-06 03:43:38,921][52820] Sum rewards: 66.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.071', 'AMMO3': '0.196', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.336', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:39,017][52663] DAMAGECOUNT value on done: 435312.0 [2024-08-06 03:43:39,017][52663] Sum rewards: 68.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.116', 'AMMO4': '0.162', 'weapon5': '0.166', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:39,170][52667] DAMAGECOUNT value on done: 440898.0 [2024-08-06 03:43:39,172][52667] Sum rewards: 71.379, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.387', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.116', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.294', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:40,027][52795] DAMAGECOUNT value on done: 409229.0 [2024-08-06 03:43:40,029][52795] Sum rewards: 75.048, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.398', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:40,533][52666] DAMAGECOUNT value on done: 434722.0 [2024-08-06 03:43:40,541][52666] Sum rewards: 64.638, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.582', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.134', 'AMMO4': '0.196', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:40,735][52664] DAMAGECOUNT value on done: 455412.0 [2024-08-06 03:43:40,735][52664] Sum rewards: 77.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.902', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.172', 'AMMO3': '0.224', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '66.000'} [2024-08-06 03:43:40,849][52650] Updated weights for policy 0, policy_version 47991 (0.0011) [2024-08-06 03:43:40,970][52647] DAMAGECOUNT value on done: 470397.0 [2024-08-06 03:43:40,970][52647] Sum rewards: 68.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.565', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.222', 'weapon2': '0.254', 'AMMO3': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '58.000'} [2024-08-06 03:43:41,089][52670] DAMAGECOUNT value on done: 435016.0 [2024-08-06 03:43:41,091][52670] Sum rewards: 72.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.835', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.102', 'AMMO4': '0.140', 'weapon5': '0.140', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:41,851][52663] DAMAGECOUNT value on done: 443270.0 [2024-08-06 03:43:41,851][52663] Sum rewards: 85.713, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.186', 'weapon5': '0.198', 'weapon4': '0.210', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'HEALTH': '0.302', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '69.000'} [2024-08-06 03:43:42,000][52820] DAMAGECOUNT value on done: 411708.0 [2024-08-06 03:43:42,002][52820] Sum rewards: 65.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.855', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.128', 'weapon5': '0.140', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:42,192][52667] DAMAGECOUNT value on done: 447504.0 [2024-08-06 03:43:42,193][52667] Sum rewards: 79.831, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO4': '0.091', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '68.000'} [2024-08-06 03:43:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 393166848. Throughput: 0: 4382.7. Samples: 98301810. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:43:42,795][52567] Avg episode reward: [(0, '69.769')] [2024-08-06 03:43:43,183][52795] DAMAGECOUNT value on done: 412617.0 [2024-08-06 03:43:43,183][52795] Sum rewards: 58.302, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.972', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.090', 'AMMO4': '0.122', 'weapon2': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.408', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:43,953][52664] DAMAGECOUNT value on done: 456201.0 [2024-08-06 03:43:43,953][52664] Sum rewards: 78.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.082', 'weapon4': '0.108', 'AMMO4': '0.136', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '63.000'} [2024-08-06 03:43:44,126][52647] DAMAGECOUNT value on done: 462303.0 [2024-08-06 03:43:44,126][52647] Sum rewards: 83.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.118', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.086', 'weapon4': '0.088', 'AMMO3': '0.208', 'AMMO4': '0.247', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '70.000'} [2024-08-06 03:43:44,181][52670] DAMAGECOUNT value on done: 438485.0 [2024-08-06 03:43:44,182][52670] Sum rewards: 71.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.017', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.158', 'AMMO3': '0.168', 'weapon5': '0.176', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.202', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '57.500'} [2024-08-06 03:43:44,769][52667] DAMAGECOUNT value on done: 449742.0 [2024-08-06 03:43:44,770][52667] Sum rewards: 91.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.066', 'weapon5': '0.150', 'weapon2': '0.248', 'AMMO4': '0.252', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.218', 'FRAGCOUNT': '76.000'} [2024-08-06 03:43:45,014][52663] DAMAGECOUNT value on done: 439906.0 [2024-08-06 03:43:45,015][52663] Sum rewards: 62.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.103', 'weapon4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.000'} [2024-08-06 03:43:45,053][52820] DAMAGECOUNT value on done: 401751.0 [2024-08-06 03:43:45,054][52820] Sum rewards: 68.776, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.676', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.144', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.272', 'AMMO3': '0.281', 'weapon2': '0.342', 'WEAPON3': '1.600', 'weapon3': '2.966', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.500'} [2024-08-06 03:43:45,564][52650] Updated weights for policy 0, policy_version 48001 (0.0035) [2024-08-06 03:43:46,473][52647] DAMAGECOUNT value on done: 457573.0 [2024-08-06 03:43:46,475][52647] Sum rewards: 63.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.732', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.074', 'AMMO4': '0.157', 'weapon5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.060', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:47,439][52667] DAMAGECOUNT value on done: 443439.0 [2024-08-06 03:43:47,439][52667] Sum rewards: 72.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.667', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.198', 'weapon4': '0.238', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 393256960. Throughput: 0: 4378.9. Samples: 98314730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:43:47,795][52567] Avg episode reward: [(0, '70.042')] [2024-08-06 03:43:48,097][52663] DAMAGECOUNT value on done: 433554.0 [2024-08-06 03:43:48,097][52663] Sum rewards: 66.720, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.770', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon4': '0.090', 'AMMO4': '0.120', 'weapon5': '0.124', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:48,134][52820] DAMAGECOUNT value on done: 405228.0 [2024-08-06 03:43:48,136][52820] Sum rewards: 66.883, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.146', 'AMMO4': '0.180', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.274', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:48,773][52647] DAMAGECOUNT value on done: 460733.0 [2024-08-06 03:43:48,773][52647] Sum rewards: 70.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.942', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.068', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.252', 'AMMO3': '0.258', 'WEAPON3': '1.650', 'weapon3': '3.370', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:50,144][52650] Updated weights for policy 0, policy_version 48011 (0.0017) [2024-08-06 03:43:50,516][52667] DAMAGECOUNT value on done: 441756.0 [2024-08-06 03:43:50,516][52667] Sum rewards: 71.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.668', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon4': '0.296', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '57.500'} [2024-08-06 03:43:51,225][52820] DAMAGECOUNT value on done: 411260.0 [2024-08-06 03:43:51,233][52820] Sum rewards: 83.847, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.026', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.070', 'weapon4': '0.140', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '3.266', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '66.000'} [2024-08-06 03:43:51,864][52647] DAMAGECOUNT value on done: 459089.0 [2024-08-06 03:43:51,864][52647] Sum rewards: 70.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.464', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.174', 'AMMO4': '0.194', 'weapon2': '0.218', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.914', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '60.000'} [2024-08-06 03:43:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 393347072. Throughput: 0: 4385.4. Samples: 98341180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:43:52,794][52567] Avg episode reward: [(0, '70.185')] [2024-08-06 03:43:53,747][52667] DAMAGECOUNT value on done: 444829.0 [2024-08-06 03:43:53,749][52667] Sum rewards: 80.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.249', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.428', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '67.000'} [2024-08-06 03:43:54,196][52820] DAMAGECOUNT value on done: 406302.0 [2024-08-06 03:43:54,198][52820] Sum rewards: 68.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.882', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.096', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 03:43:54,764][52647] DAMAGECOUNT value on done: 460827.0 [2024-08-06 03:43:54,764][52647] Sum rewards: 63.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.011', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.124', 'AMMO4': '0.171', 'AMMO3': '0.187', 'weapon4': '0.258', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '52.000'} [2024-08-06 03:43:54,849][52650] Updated weights for policy 0, policy_version 48021 (0.0015) [2024-08-06 03:43:54,908][52668] DAMAGECOUNT value on done: 441057.0 [2024-08-06 03:43:54,908][52668] Sum rewards: 70.496, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.817', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '57.000'} [2024-08-06 03:43:56,015][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:43:56,619][52669] DAMAGECOUNT value on done: 446009.0 [2024-08-06 03:43:56,620][52669] Sum rewards: 59.618, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.034', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.458', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '54.000'} [2024-08-06 03:43:56,799][52667] DAMAGECOUNT value on done: 450918.0 [2024-08-06 03:43:56,799][52667] Sum rewards: 66.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.740', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.191', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '55.000'} [2024-08-06 03:43:57,389][52820] DAMAGECOUNT value on done: 414786.0 [2024-08-06 03:43:57,393][52820] Sum rewards: 74.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.275', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.232', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.576', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '61.000'} [2024-08-06 03:43:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 393428992. Throughput: 0: 4372.2. Samples: 98367100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:43:57,794][52567] Avg episode reward: [(0, '70.191')] [2024-08-06 03:43:57,917][52668] DAMAGECOUNT value on done: 445031.0 [2024-08-06 03:43:57,917][52668] Sum rewards: 79.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.188', 'AMMO3': '0.226', 'weapon4': '0.228', 'AMMO4': '0.264', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '66.000'} [2024-08-06 03:43:58,820][52669] DAMAGECOUNT value on done: 435774.0 [2024-08-06 03:43:58,820][52669] Sum rewards: 66.712, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.163', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.078', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.163', 'weapon2': '0.764', 'WEAPON3': '0.950', 'weapon3': '2.804', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '53.000'} [2024-08-06 03:43:59,299][52650] Updated weights for policy 0, policy_version 48031 (0.0033) [2024-08-06 03:43:59,399][52667] DAMAGECOUNT value on done: 437811.0 [2024-08-06 03:43:59,401][52667] Sum rewards: 72.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon5': '0.182', 'AMMO3': '0.192', 'weapon4': '0.218', 'weapon2': '0.252', 'AMMO4': '0.271', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:00,425][52820] DAMAGECOUNT value on done: 405771.0 [2024-08-06 03:44:00,433][52820] Sum rewards: 87.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.862', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO4': '0.169', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '73.000'} [2024-08-06 03:44:00,992][52668] DAMAGECOUNT value on done: 445167.0 [2024-08-06 03:44:00,994][52668] Sum rewards: 83.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.452', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.159', 'AMMO3': '0.197', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.426', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '71.000'} [2024-08-06 03:44:01,244][52669] DAMAGECOUNT value on done: 444630.0 [2024-08-06 03:44:01,246][52669] Sum rewards: 64.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.092', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '53.000'} [2024-08-06 03:44:02,167][52667] DAMAGECOUNT value on done: 441404.0 [2024-08-06 03:44:02,168][52667] Sum rewards: 59.421, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.285', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.098', 'AMMO4': '0.176', 'weapon5': '0.182', 'AMMO3': '0.227', 'weapon2': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.224', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '50.000'} [2024-08-06 03:44:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 393519104. Throughput: 0: 4367.5. Samples: 98380050. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:44:02,795][52567] Avg episode reward: [(0, '70.377')] [2024-08-06 03:44:02,852][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:03,436][52820] DAMAGECOUNT value on done: 410157.0 [2024-08-06 03:44:03,438][52820] Sum rewards: 82.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.258', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.134', 'weapon2': '0.208', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '69.000'} [2024-08-06 03:44:03,712][52669] DAMAGECOUNT value on done: 440631.0 [2024-08-06 03:44:03,713][52669] Sum rewards: 86.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.156', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.082', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'weapon4': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '69.000'} [2024-08-06 03:44:03,945][52794] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:44:03,981][52668] DAMAGECOUNT value on done: 446271.0 [2024-08-06 03:44:03,981][52668] Sum rewards: 78.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.148', 'weapon5': '0.156', 'AMMO3': '0.195', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '64.000'} [2024-08-06 03:44:04,295][52650] Updated weights for policy 0, policy_version 48041 (0.0045) [2024-08-06 03:44:04,851][52667] DAMAGECOUNT value on done: 445293.0 [2024-08-06 03:44:04,852][52667] Sum rewards: 72.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.198', 'weapon4': '0.228', 'AMMO4': '0.243', 'weapon2': '0.274', 'weapon5': '0.280', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:06,431][52669] DAMAGECOUNT value on done: 441915.0 [2024-08-06 03:44:06,431][52669] Sum rewards: 58.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.134', 'AMMO3': '0.178', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.404', 'weapon4': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '48.000'} [2024-08-06 03:44:06,456][52820] DAMAGECOUNT value on done: 413239.0 [2024-08-06 03:44:06,456][52820] Sum rewards: 70.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon4': '0.116', 'weapon5': '0.196', 'AMMO3': '0.220', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '58.000'} [2024-08-06 03:44:07,205][52668] DAMAGECOUNT value on done: 435069.0 [2024-08-06 03:44:07,206][52668] Sum rewards: 75.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.283', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.101', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.504', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:07,399][52667] DAMAGECOUNT value on done: 438893.0 [2024-08-06 03:44:07,399][52667] Sum rewards: 71.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.983', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.193', 'weapon5': '0.198', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.786', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 393609216. Throughput: 0: 4372.9. Samples: 98406420. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:44:07,794][52567] Avg episode reward: [(0, '70.708')] [2024-08-06 03:44:08,702][52650] Updated weights for policy 0, policy_version 48051 (0.0033) [2024-08-06 03:44:09,446][52669] DAMAGECOUNT value on done: 447083.0 [2024-08-06 03:44:09,447][52669] Sum rewards: 68.987, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.294', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.131', 'AMMO3': '0.145', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.348', 'weapon2': '0.532', 'WEAPON3': '0.950', 'weapon3': '2.834', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '55.500'} [2024-08-06 03:44:09,701][52820] DAMAGECOUNT value on done: 409050.0 [2024-08-06 03:44:09,701][52820] Sum rewards: 71.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.922', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.274', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 03:44:09,932][52668] DAMAGECOUNT value on done: 445333.0 [2024-08-06 03:44:09,935][52668] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.141', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.132', 'AMMO3': '0.187', 'AMMO4': '0.227', 'weapon2': '0.230', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.054', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '53.000'} [2024-08-06 03:44:09,991][52667] DAMAGECOUNT value on done: 445767.0 [2024-08-06 03:44:09,991][52667] Sum rewards: 70.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.467', 'AMMO5': '0.022', 'AMMO2': '0.062', 'AMMO3': '0.149', 'weapon5': '0.220', 'weapon4': '0.222', 'AMMO4': '0.312', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon2': '0.936', 'weapon3': '2.308', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.500'} [2024-08-06 03:44:12,424][52662] DAMAGECOUNT value on done: 446522.0 [2024-08-06 03:44:12,424][52662] Sum rewards: 66.828, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.362', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.118', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '60.000'} [2024-08-06 03:44:12,484][52669] DAMAGECOUNT value on done: 441520.0 [2024-08-06 03:44:12,485][52669] Sum rewards: 77.106, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.025', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon2': '0.134', 'weapon5': '0.148', 'AMMO3': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:12,568][52667] DAMAGECOUNT value on done: 452136.0 [2024-08-06 03:44:12,570][52667] Sum rewards: 63.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.092', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO4': '0.158', 'weapon4': '0.190', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:12,639][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 393691136. Throughput: 0: 4378.2. Samples: 98432810. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:44:12,794][52567] Avg episode reward: [(0, '70.583')] [2024-08-06 03:44:13,124][52668] DAMAGECOUNT value on done: 446682.0 [2024-08-06 03:44:13,125][52668] Sum rewards: 79.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.624', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.153', 'AMMO4': '0.220', 'weapon5': '0.236', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.000', 'weapon3': '2.762', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:13,184][52820] DAMAGECOUNT value on done: 414226.0 [2024-08-06 03:44:13,187][52820] Sum rewards: 70.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.706', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:13,725][52650] Updated weights for policy 0, policy_version 48061 (0.0013) [2024-08-06 03:44:15,039][52662] DAMAGECOUNT value on done: 448613.0 [2024-08-06 03:44:15,040][52662] Sum rewards: 86.123, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.855', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.092', 'weapon4': '0.184', 'AMMO4': '0.185', 'weapon2': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '22.083', 'FRAGCOUNT': '73.000'} [2024-08-06 03:44:15,139][52667] DAMAGECOUNT value on done: 449066.0 [2024-08-06 03:44:15,141][52667] Sum rewards: 80.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.240', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon5': '0.144', 'AMMO4': '0.175', 'weapon2': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '68.000'} [2024-08-06 03:44:15,457][52669] DAMAGECOUNT value on done: 443199.0 [2024-08-06 03:44:15,457][52669] Sum rewards: 64.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.132', 'weapon5': '0.174', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '54.000'} [2024-08-06 03:44:16,010][52668] DAMAGECOUNT value on done: 438012.0 [2024-08-06 03:44:16,010][52668] Sum rewards: 68.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.116', 'weapon5': '0.154', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.212', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '58.000'} [2024-08-06 03:44:16,416][52820] DAMAGECOUNT value on done: 408452.0 [2024-08-06 03:44:16,417][52820] Sum rewards: 70.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.130', 'weapon4': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '58.000'} [2024-08-06 03:44:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 393789440. Throughput: 0: 4371.1. Samples: 98445650. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:44:17,794][52567] Avg episode reward: [(0, '70.993')] [2024-08-06 03:44:17,883][52662] DAMAGECOUNT value on done: 447254.0 [2024-08-06 03:44:17,884][52662] Sum rewards: 66.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.092', 'weapon5': '0.226', 'AMMO3': '0.234', 'AMMO4': '0.267', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '55.000'} [2024-08-06 03:44:18,111][52667] DAMAGECOUNT value on done: 447925.0 [2024-08-06 03:44:18,112][52667] Sum rewards: 80.610, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.944', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.164', 'weapon4': '0.182', 'AMMO3': '0.243', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.008', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '68.500'} [2024-08-06 03:44:18,402][52669] DAMAGECOUNT value on done: 446828.0 [2024-08-06 03:44:18,403][52669] Sum rewards: 68.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.026', 'weapon4': '0.034', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '3.316', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:18,407][52650] Updated weights for policy 0, policy_version 48071 (0.0063) [2024-08-06 03:44:18,852][52660] DAMAGECOUNT value on done: 440212.0 [2024-08-06 03:44:18,853][52660] Sum rewards: 77.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.202', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.104', 'AMMO3': '0.197', 'weapon5': '0.198', 'AMMO4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:19,054][52668] DAMAGECOUNT value on done: 439487.0 [2024-08-06 03:44:19,056][52668] Sum rewards: 73.115, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.612', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:19,084][52671] DAMAGECOUNT value on done: 445838.0 [2024-08-06 03:44:19,084][52671] Sum rewards: 64.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.458', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.238', 'weapon5': '0.274', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.588', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '53.000'} [2024-08-06 03:44:19,592][52820] DAMAGECOUNT value on done: 409287.0 [2024-08-06 03:44:19,592][52820] Sum rewards: 80.202, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.331', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon5': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '3.124', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '64.000'} [2024-08-06 03:44:20,562][52662] DAMAGECOUNT value on done: 437943.0 [2024-08-06 03:44:20,562][52662] Sum rewards: 83.703, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO3': '0.164', 'weapon4': '0.178', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.000', 'weapon3': '3.070', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '65.000'} [2024-08-06 03:44:21,208][52669] DAMAGECOUNT value on done: 442189.0 [2024-08-06 03:44:21,209][52669] Sum rewards: 70.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.873', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.073', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.212', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.494', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:21,213][52667] DAMAGECOUNT value on done: 441732.0 [2024-08-06 03:44:21,214][52667] Sum rewards: 70.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.149', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '58.000'} [2024-08-06 03:44:21,462][52660] DAMAGECOUNT value on done: 434943.0 [2024-08-06 03:44:21,463][52660] Sum rewards: 68.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.310', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO3': '0.225', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '57.000'} [2024-08-06 03:44:21,619][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:44:21,638][52668] DAMAGECOUNT value on done: 446858.0 [2024-08-06 03:44:21,640][52668] Sum rewards: 78.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.566', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.149', 'weapon4': '0.168', 'AMMO3': '0.194', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '66.000'} [2024-08-06 03:44:22,178][52671] DAMAGECOUNT value on done: 446527.0 [2024-08-06 03:44:22,180][52671] Sum rewards: 74.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO3': '0.185', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.266', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '62.000'} [2024-08-06 03:44:22,706][52820] DAMAGECOUNT value on done: 419850.0 [2024-08-06 03:44:22,706][52820] Sum rewards: 74.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.294', 'weapon4': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 393871360. Throughput: 0: 4377.6. Samples: 98472090. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:44:22,794][52567] Avg episode reward: [(0, '72.074')] [2024-08-06 03:44:22,795][52614] Saving new best policy, reward=72.074! [2024-08-06 03:44:23,088][52650] Updated weights for policy 0, policy_version 48081 (0.0033) [2024-08-06 03:44:23,185][52662] DAMAGECOUNT value on done: 448020.0 [2024-08-06 03:44:23,185][52662] Sum rewards: 71.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.330', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.192', 'weapon5': '0.194', 'AMMO4': '0.203', 'AMMO3': '0.254', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:24,298][52660] DAMAGECOUNT value on done: 445665.0 [2024-08-06 03:44:24,300][52660] Sum rewards: 59.060, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.548', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon5': '0.140', 'weapon4': '0.150', 'AMMO3': '0.231', 'AMMO4': '0.323', 'WEAPON5': '0.450', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '51.000'} [2024-08-06 03:44:24,450][52669] DAMAGECOUNT value on done: 447730.0 [2024-08-06 03:44:24,451][52669] Sum rewards: 71.528, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.612', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.138', 'AMMO3': '0.167', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '57.000'} [2024-08-06 03:44:24,479][52668] DAMAGECOUNT value on done: 443581.0 [2024-08-06 03:44:24,480][52668] Sum rewards: 78.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.635', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.284', 'WEAPON3': '1.600', 'weapon3': '3.230', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '66.500'} [2024-08-06 03:44:24,532][52667] DAMAGECOUNT value on done: 449043.0 [2024-08-06 03:44:24,532][52667] Sum rewards: 66.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.163', 'weapon2': '0.202', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.380', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:24,609][52665] DAMAGECOUNT value on done: 434175.0 [2024-08-06 03:44:24,613][52665] Sum rewards: 64.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.764', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.114', 'weapon4': '0.120', 'AMMO4': '0.161', 'AMMO3': '0.216', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '54.000'} [2024-08-06 03:44:24,709][52658] DAMAGECOUNT value on done: 440112.0 [2024-08-06 03:44:24,712][52658] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.620', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.106', 'weapon5': '0.118', 'AMMO4': '0.184', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'WEAPON3': '1.900', 'HITCOUNT': '3.190', 'weapon3': '3.248', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '60.000'} [2024-08-06 03:44:24,769][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:24,887][52671] DAMAGECOUNT value on done: 446534.0 [2024-08-06 03:44:24,890][52671] Sum rewards: 73.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.008', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.179', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:25,629][52662] DAMAGECOUNT value on done: 440927.0 [2024-08-06 03:44:25,629][52662] Sum rewards: 76.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.088', 'weapon4': '0.092', 'AMMO4': '0.102', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'weapon3': '3.420', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:25,838][52820] DAMAGECOUNT value on done: 420247.0 [2024-08-06 03:44:25,839][52820] Sum rewards: 65.180, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.690', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.142', 'weapon4': '0.194', 'AMMO4': '0.202', 'weapon2': '0.282', 'AMMO3': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.102', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '57.000'} [2024-08-06 03:44:26,879][52665] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:27,130][52660] DAMAGECOUNT value on done: 449192.0 [2024-08-06 03:44:27,130][52660] Sum rewards: 79.229, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.294', 'weapon4': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '68.000'} [2024-08-06 03:44:27,225][52669] DAMAGECOUNT value on done: 444888.0 [2024-08-06 03:44:27,225][52669] Sum rewards: 64.720, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.054', 'weapon4': '0.134', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.200', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:27,395][52665] DAMAGECOUNT value on done: 443656.0 [2024-08-06 03:44:27,396][52665] Sum rewards: 81.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.474', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '67.000'} [2024-08-06 03:44:27,444][52668] DAMAGECOUNT value on done: 437490.0 [2024-08-06 03:44:27,445][52668] Sum rewards: 64.920, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.432', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon5': '0.098', 'weapon4': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.280', 'AMMO4': '0.293', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.124', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '58.500'} [2024-08-06 03:44:27,609][52658] DAMAGECOUNT value on done: 444013.0 [2024-08-06 03:44:27,609][52658] Sum rewards: 66.766, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.695', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.106', 'weapon5': '0.112', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.326', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 393953280. Throughput: 0: 4350.0. Samples: 98497560. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:44:27,794][52567] Avg episode reward: [(0, '71.972')] [2024-08-06 03:44:27,810][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048091_393961472.pth... [2024-08-06 03:44:27,814][52650] Updated weights for policy 0, policy_version 48091 (0.0024) [2024-08-06 03:44:27,930][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047578_389758976.pth [2024-08-06 03:44:28,167][52671] DAMAGECOUNT value on done: 444386.0 [2024-08-06 03:44:28,167][52671] Sum rewards: 79.681, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.121', 'weapon5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '64.000'} [2024-08-06 03:44:28,912][52820] DAMAGECOUNT value on done: 407764.0 [2024-08-06 03:44:28,914][52820] Sum rewards: 66.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.044', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO4': '0.191', 'weapon4': '0.204', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 03:44:29,010][52662] DAMAGECOUNT value on done: 450352.0 [2024-08-06 03:44:29,012][52662] Sum rewards: 54.482, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.395', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.138', 'weapon4': '0.170', 'AMMO4': '0.210', 'weapon2': '0.264', 'AMMO3': '0.285', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'HITCOUNT': '2.960', 'weapon3': '3.146', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '50.000'} [2024-08-06 03:44:29,754][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:29,958][52669] DAMAGECOUNT value on done: 434078.0 [2024-08-06 03:44:29,959][52669] Sum rewards: 77.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.038', 'weapon4': '0.054', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.412', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '65.000'} [2024-08-06 03:44:29,986][52665] DAMAGECOUNT value on done: 440665.0 [2024-08-06 03:44:29,990][52665] Sum rewards: 74.213, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.730', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.164', 'weapon4': '0.166', 'AMMO3': '0.234', 'AMMO4': '0.249', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:30,269][52660] DAMAGECOUNT value on done: 442359.0 [2024-08-06 03:44:30,271][52660] Sum rewards: 65.592, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.154', 'weapon2': '0.388', 'HEALTH': '0.630', 'WEAPON3': '0.850', 'HITCOUNT': '2.970', 'weapon3': '3.456', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '52.000'} [2024-08-06 03:44:30,389][52658] DAMAGECOUNT value on done: 448052.0 [2024-08-06 03:44:30,391][52658] Sum rewards: 79.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.124', 'weapon5': '0.140', 'weapon2': '0.162', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.484', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '67.000'} [2024-08-06 03:44:30,528][52668] DAMAGECOUNT value on done: 433125.0 [2024-08-06 03:44:30,531][52668] Sum rewards: 78.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.429', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '66.000'} [2024-08-06 03:44:31,454][52671] DAMAGECOUNT value on done: 452884.0 [2024-08-06 03:44:31,456][52671] Sum rewards: 75.067, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.054', 'weapon4': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '64.000'} [2024-08-06 03:44:32,053][52662] DAMAGECOUNT value on done: 453456.0 [2024-08-06 03:44:32,055][52662] Sum rewards: 74.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.311', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.070', 'weapon5': '0.088', 'AMMO4': '0.128', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:32,553][52650] Updated weights for policy 0, policy_version 48101 (0.0035) [2024-08-06 03:44:32,581][52669] DAMAGECOUNT value on done: 446132.0 [2024-08-06 03:44:32,581][52669] Sum rewards: 70.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon5': '0.184', 'AMMO3': '0.222', 'weapon4': '0.252', 'AMMO4': '0.288', 'weapon2': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 394043392. Throughput: 0: 4348.5. Samples: 98510410. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:44:32,794][52567] Avg episode reward: [(0, '72.160')] [2024-08-06 03:44:32,832][52614] Saving new best policy, reward=72.160! [2024-08-06 03:44:32,947][52665] DAMAGECOUNT value on done: 437330.0 [2024-08-06 03:44:32,949][52665] Sum rewards: 68.226, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.237', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.145', 'weapon5': '0.156', 'weapon2': '0.262', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.126', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '54.000'} [2024-08-06 03:44:33,221][52658] DAMAGECOUNT value on done: 444933.0 [2024-08-06 03:44:33,221][52658] Sum rewards: 69.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.874', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.102', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:33,642][52660] DAMAGECOUNT value on done: 440897.0 [2024-08-06 03:44:33,642][52660] Sum rewards: 87.895, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.493', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.100', 'weapon5': '0.136', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '73.000'} [2024-08-06 03:44:33,924][52668] DAMAGECOUNT value on done: 435203.0 [2024-08-06 03:44:33,925][52668] Sum rewards: 64.995, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.001', 'AMMO5': '0.022', 'AMMO2': '0.064', 'AMMO3': '0.224', 'weapon2': '0.234', 'AMMO4': '0.321', 'weapon5': '0.394', 'weapon4': '0.486', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.442', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '55.000'} [2024-08-06 03:44:34,449][52671] DAMAGECOUNT value on done: 443581.0 [2024-08-06 03:44:34,449][52671] Sum rewards: 64.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.170', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.042', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.295', 'weapon2': '0.496', 'WEAPON3': '1.800', 'weapon3': '3.006', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 03:44:35,121][52662] DAMAGECOUNT value on done: 440811.0 [2024-08-06 03:44:35,124][52662] Sum rewards: 74.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.134', 'AMMO3': '0.174', 'weapon4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '60.000'} [2024-08-06 03:44:35,417][52669] DAMAGECOUNT value on done: 448532.0 [2024-08-06 03:44:35,420][52669] Sum rewards: 59.752, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.960', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.175', 'weapon5': '0.178', 'weapon2': '0.238', 'AMMO4': '0.277', 'weapon4': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.770', 'weapon3': '2.950', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '48.000'} [2024-08-06 03:44:35,853][52658] DAMAGECOUNT value on done: 436170.0 [2024-08-06 03:44:35,855][52658] Sum rewards: 69.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.415', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon4': '0.240', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '58.000'} [2024-08-06 03:44:36,280][52665] DAMAGECOUNT value on done: 430357.0 [2024-08-06 03:44:36,280][52665] Sum rewards: 82.280, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon2': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.306', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '71.000'} [2024-08-06 03:44:36,363][52660] DAMAGECOUNT value on done: 441096.0 [2024-08-06 03:44:36,364][52660] Sum rewards: 81.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.472', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.096', 'weapon4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '69.000'} [2024-08-06 03:44:36,599][52668] DAMAGECOUNT value on done: 432865.0 [2024-08-06 03:44:36,601][52668] Sum rewards: 69.893, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.134', 'AMMO5': '0.007', 'weapon7': '0.008', 'AMMO2': '0.022', 'weapon5': '0.044', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.283', 'weapon2': '0.340', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:37,319][52650] Updated weights for policy 0, policy_version 48111 (0.0011) [2024-08-06 03:44:37,584][52671] DAMAGECOUNT value on done: 451060.0 [2024-08-06 03:44:37,586][52671] Sum rewards: 75.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.009', 'weapon4': '0.040', 'AMMO4': '0.044', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.692', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:37,709][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 394133504. Throughput: 0: 4345.6. Samples: 98536730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:44:37,794][52567] Avg episode reward: [(0, '72.031')] [2024-08-06 03:44:38,231][52662] DAMAGECOUNT value on done: 454718.0 [2024-08-06 03:44:38,239][52662] Sum rewards: 64.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.175', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.214', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:38,391][52669] DAMAGECOUNT value on done: 458030.0 [2024-08-06 03:44:38,392][52669] Sum rewards: 67.664, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.146', 'AMMO4': '0.169', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.600', 'weapon3': '2.942', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:38,655][52658] DAMAGECOUNT value on done: 441985.0 [2024-08-06 03:44:38,656][52658] Sum rewards: 72.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.283', 'weapon2': '0.328', 'WEAPON3': '1.800', 'weapon3': '3.308', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:39,145][52660] DAMAGECOUNT value on done: 447786.0 [2024-08-06 03:44:39,146][52660] Sum rewards: 67.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.936', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.234', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:39,320][52665] DAMAGECOUNT value on done: 432563.0 [2024-08-06 03:44:39,321][52665] Sum rewards: 82.014, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'AMMO5': '0.005', 'weapon6': '0.014', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'weapon4': '0.174', 'WEAPON6': '0.200', 'AMMO6': '0.200', 'AMMO7': '0.200', 'weapon2': '0.230', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '67.000'} [2024-08-06 03:44:39,468][52668] DAMAGECOUNT value on done: 439940.0 [2024-08-06 03:44:39,468][52668] Sum rewards: 66.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.130', 'AMMO4': '0.196', 'AMMO3': '0.219', 'weapon5': '0.246', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '55.500'} [2024-08-06 03:44:39,779][52671] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:39,943][52671] DAMAGECOUNT value on done: 447016.0 [2024-08-06 03:44:39,943][52671] Sum rewards: 74.643, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'HEALTH': '0.436', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '60.000'} [2024-08-06 03:44:40,925][52662] DAMAGECOUNT value on done: 441489.0 [2024-08-06 03:44:40,926][52662] Sum rewards: 75.269, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.195', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.214', 'AMMO3': '0.257', 'weapon4': '0.290', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.832', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '65.000'} [2024-08-06 03:44:41,030][52669] DAMAGECOUNT value on done: 446133.0 [2024-08-06 03:44:41,033][52669] Sum rewards: 70.980, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.070', 'AMMO3': '0.142', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.346', 'WEAPON3': '0.950', 'HITCOUNT': '3.280', 'weapon3': '3.308', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:41,567][52658] DAMAGECOUNT value on done: 443912.0 [2024-08-06 03:44:41,567][52658] Sum rewards: 60.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.054', 'AMMO4': '0.148', 'weapon5': '0.192', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.174', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '50.000'} [2024-08-06 03:44:41,873][52660] DAMAGECOUNT value on done: 444334.0 [2024-08-06 03:44:41,875][52660] Sum rewards: 76.845, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.596', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.112', 'weapon5': '0.160', 'AMMO4': '0.171', 'AMMO3': '0.214', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '65.000'} [2024-08-06 03:44:42,106][52650] Updated weights for policy 0, policy_version 48121 (0.0043) [2024-08-06 03:44:42,171][52668] DAMAGECOUNT value on done: 444120.0 [2024-08-06 03:44:42,171][52668] Sum rewards: 72.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.132', 'weapon2': '0.184', 'AMMO4': '0.244', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.354', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:42,549][52665] DAMAGECOUNT value on done: 435899.0 [2024-08-06 03:44:42,550][52665] Sum rewards: 72.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.104', 'weapon5': '0.124', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 394215424. Throughput: 0: 4351.8. Samples: 98562930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:44:42,794][52567] Avg episode reward: [(0, '71.867')] [2024-08-06 03:44:43,116][52671] DAMAGECOUNT value on done: 442382.0 [2024-08-06 03:44:43,117][52671] Sum rewards: 67.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.118', 'AMMO3': '0.191', 'weapon5': '0.220', 'AMMO4': '0.227', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2024-08-06 03:44:43,981][52662] DAMAGECOUNT value on done: 444974.0 [2024-08-06 03:44:43,983][52662] Sum rewards: 74.442, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.876', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.143', 'weapon5': '0.152', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.680', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:44,034][52669] DAMAGECOUNT value on done: 446486.0 [2024-08-06 03:44:44,034][52669] Sum rewards: 73.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.064', 'weapon5': '0.086', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:44,341][52658] DAMAGECOUNT value on done: 438057.0 [2024-08-06 03:44:44,343][52658] Sum rewards: 69.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.007', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.162', 'AMMO4': '0.178', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '58.500'} [2024-08-06 03:44:44,704][52660] DAMAGECOUNT value on done: 438897.0 [2024-08-06 03:44:44,705][52660] Sum rewards: 77.242, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.155', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.144', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.266', 'WEAPON3': '1.050', 'weapon3': '3.200', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '62.000'} [2024-08-06 03:44:45,121][52668] DAMAGECOUNT value on done: 441253.0 [2024-08-06 03:44:45,122][52668] Sum rewards: 67.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.352', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.428', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '57.000'} [2024-08-06 03:44:45,651][52671] DAMAGECOUNT value on done: 448817.0 [2024-08-06 03:44:45,652][52671] Sum rewards: 74.757, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.066', 'weapon4': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.428', 'HEALTH': '0.820', 'WEAPON3': '0.900', 'weapon3': '3.198', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:45,771][52811] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:45,783][52665] DAMAGECOUNT value on done: 439193.0 [2024-08-06 03:44:45,785][52665] Sum rewards: 64.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.126', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '54.000'} [2024-08-06 03:44:46,402][52669] DAMAGECOUNT value on done: 448663.0 [2024-08-06 03:44:46,402][52669] Sum rewards: 77.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.105', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.220', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 03:44:46,523][52650] Updated weights for policy 0, policy_version 48131 (0.0032) [2024-08-06 03:44:46,686][52662] DAMAGECOUNT value on done: 444255.0 [2024-08-06 03:44:46,686][52662] Sum rewards: 66.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.260', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.116', 'AMMO4': '0.150', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.550', 'weapon3': '2.982', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '58.000'} [2024-08-06 03:44:47,489][52658] DAMAGECOUNT value on done: 452483.0 [2024-08-06 03:44:47,489][52658] Sum rewards: 80.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.856', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.088', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.244', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '67.000'} [2024-08-06 03:44:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 394305536. Throughput: 0: 4356.9. Samples: 98576110. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:44:47,794][52567] Avg episode reward: [(0, '71.880')] [2024-08-06 03:44:47,933][52660] DAMAGECOUNT value on done: 450781.0 [2024-08-06 03:44:47,933][52660] Sum rewards: 73.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.856', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.150', 'weapon5': '0.188', 'AMMO3': '0.189', 'AMMO4': '0.202', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:48,373][52668] DAMAGECOUNT value on done: 448094.0 [2024-08-06 03:44:48,373][52668] Sum rewards: 74.009, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.861', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.054', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.257', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '63.000'} [2024-08-06 03:44:48,395][52671] DAMAGECOUNT value on done: 452461.0 [2024-08-06 03:44:48,396][52671] Sum rewards: 62.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.784', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.148', 'AMMO3': '0.187', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.324', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '51.000'} [2024-08-06 03:44:48,816][52665] DAMAGECOUNT value on done: 443822.0 [2024-08-06 03:44:48,816][52665] Sum rewards: 88.301, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.768', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '71.000'} [2024-08-06 03:44:49,370][52669] DAMAGECOUNT value on done: 449283.0 [2024-08-06 03:44:49,371][52669] Sum rewards: 54.116, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.150', 'weapon4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '3.346', 'DAMAGECOUNT': '13.356', 'FRAGCOUNT': '43.500'} [2024-08-06 03:44:49,549][52662] DAMAGECOUNT value on done: 449825.0 [2024-08-06 03:44:49,550][52662] Sum rewards: 63.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.357', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.152', 'weapon4': '0.168', 'AMMO3': '0.207', 'AMMO4': '0.277', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.088', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '53.000'} [2024-08-06 03:44:50,655][52658] DAMAGECOUNT value on done: 443345.0 [2024-08-06 03:44:50,657][52658] Sum rewards: 64.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.352', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.107', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.558', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '54.000'} [2024-08-06 03:44:50,935][52671] DAMAGECOUNT value on done: 445024.0 [2024-08-06 03:44:50,936][52671] Sum rewards: 77.686, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.849', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.052', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.354', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '62.000'} [2024-08-06 03:44:51,089][52660] DAMAGECOUNT value on done: 435877.0 [2024-08-06 03:44:51,089][52660] Sum rewards: 71.111, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.152', 'weapon5': '0.182', 'AMMO3': '0.225', 'AMMO4': '0.246', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:51,139][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:44:51,392][52650] Updated weights for policy 0, policy_version 48141 (0.0031) [2024-08-06 03:44:51,537][52668] DAMAGECOUNT value on done: 439916.0 [2024-08-06 03:44:51,538][52668] Sum rewards: 68.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.238', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.162', 'weapon5': '0.210', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:51,907][52665] DAMAGECOUNT value on done: 438922.0 [2024-08-06 03:44:51,908][52665] Sum rewards: 63.182, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.760', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon5': '0.148', 'AMMO3': '0.244', 'AMMO4': '0.289', 'weapon4': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '2.578', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '54.000'} [2024-08-06 03:44:52,161][52662] DAMAGECOUNT value on done: 443906.0 [2024-08-06 03:44:52,162][52662] Sum rewards: 81.943, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.312', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.073', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '66.000'} [2024-08-06 03:44:52,393][52647] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0), ('weapon5', 0.002)] [2024-08-06 03:44:52,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 394395648. Throughput: 0: 4353.8. Samples: 98602340. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:44:52,795][52567] Avg episode reward: [(0, '71.697')] [2024-08-06 03:44:53,449][52658] DAMAGECOUNT value on done: 453773.0 [2024-08-06 03:44:53,450][52658] Sum rewards: 72.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.778', 'AMMO5': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.222', 'weapon4': '0.264', 'AMMO4': '0.283', 'weapon5': '0.302', 'weapon2': '0.360', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '61.000'} [2024-08-06 03:44:53,824][52671] DAMAGECOUNT value on done: 452165.0 [2024-08-06 03:44:53,824][52671] Sum rewards: 69.059, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.797', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.050', 'AMMO3': '0.184', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '55.000'} [2024-08-06 03:44:54,451][52660] DAMAGECOUNT value on done: 440483.0 [2024-08-06 03:44:54,452][52660] Sum rewards: 89.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.012', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.065', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '3.072', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '70.000'} [2024-08-06 03:44:54,458][52665] DAMAGECOUNT value on done: 445876.0 [2024-08-06 03:44:54,461][52665] Sum rewards: 81.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.253', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.247', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '69.000'} [2024-08-06 03:44:54,858][52662] DAMAGECOUNT value on done: 454584.0 [2024-08-06 03:44:54,859][52662] Sum rewards: 86.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.154', 'AMMO4': '0.159', 'weapon5': '0.198', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.123', 'FRAGCOUNT': '69.500'} [2024-08-06 03:44:55,705][52650] Updated weights for policy 0, policy_version 48151 (0.0016) [2024-08-06 03:44:56,191][52671] DAMAGECOUNT value on done: 444131.0 [2024-08-06 03:44:56,191][52671] Sum rewards: 80.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.068', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '68.000'} [2024-08-06 03:44:56,424][52658] DAMAGECOUNT value on done: 435158.0 [2024-08-06 03:44:56,429][52658] Sum rewards: 70.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.069', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.342', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '59.000'} [2024-08-06 03:44:57,297][52665] DAMAGECOUNT value on done: 440355.0 [2024-08-06 03:44:57,297][52665] Sum rewards: 63.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.132', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '54.000'} [2024-08-06 03:44:57,607][52660] DAMAGECOUNT value on done: 451503.0 [2024-08-06 03:44:57,609][52660] Sum rewards: 63.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.565', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.095', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.312', 'WEAPON3': '1.650', 'weapon3': '3.132', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '56.000'} [2024-08-06 03:44:57,778][52662] DAMAGECOUNT value on done: 450038.0 [2024-08-06 03:44:57,778][52662] Sum rewards: 79.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.214', 'AMMO3': '0.215', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '64.000'} [2024-08-06 03:44:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 394477568. Throughput: 0: 4352.4. Samples: 98628670. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:44:57,794][52567] Avg episode reward: [(0, '71.870')] [2024-08-06 03:44:58,091][52647] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:44:59,172][52658] DAMAGECOUNT value on done: 444562.0 [2024-08-06 03:44:59,174][52658] Sum rewards: 58.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.212', 'AMMO4': '0.214', 'weapon5': '0.236', 'AMMO3': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.794', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '49.000'} [2024-08-06 03:44:59,423][52671] DAMAGECOUNT value on done: 435905.0 [2024-08-06 03:44:59,424][52671] Sum rewards: 57.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.988', 'DAMAGECOUNT': '13.617', 'FRAGCOUNT': '47.000'} [2024-08-06 03:45:00,285][52660] DAMAGECOUNT value on done: 457950.0 [2024-08-06 03:45:00,285][52660] Sum rewards: 69.624, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.474', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.176', 'weapon2': '0.646', 'WEAPON3': '1.100', 'HITCOUNT': '3.210', 'weapon3': '3.280', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '57.000'} [2024-08-06 03:45:00,459][52665] DAMAGECOUNT value on done: 436846.0 [2024-08-06 03:45:00,459][52665] Sum rewards: 68.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.138', 'AMMO3': '0.189', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '57.000'} [2024-08-06 03:45:00,872][52650] Updated weights for policy 0, policy_version 48161 (0.0012) [2024-08-06 03:45:00,913][52662] DAMAGECOUNT value on done: 443076.0 [2024-08-06 03:45:00,913][52662] Sum rewards: 70.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.160', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '58.000'} [2024-08-06 03:45:01,916][52794] DAMAGECOUNT value on done: 446938.0 [2024-08-06 03:45:01,918][52794] Sum rewards: 79.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.944', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.520', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '67.000'} [2024-08-06 03:45:02,510][52658] DAMAGECOUNT value on done: 440750.0 [2024-08-06 03:45:02,512][52658] Sum rewards: 78.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.014', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.233', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.386', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '66.000'} [2024-08-06 03:45:02,568][52671] DAMAGECOUNT value on done: 451972.0 [2024-08-06 03:45:02,571][52671] Sum rewards: 63.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.215', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.156', 'weapon5': '0.162', 'AMMO3': '0.196', 'AMMO4': '0.269', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '53.000'} [2024-08-06 03:45:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 394567680. Throughput: 0: 4358.7. Samples: 98641790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 03:45:02,794][52567] Avg episode reward: [(0, '71.784')] [2024-08-06 03:45:03,077][52665] DAMAGECOUNT value on done: 437052.0 [2024-08-06 03:45:03,078][52665] Sum rewards: 74.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.023', 'AMMO2': '0.059', 'AMMO3': '0.231', 'weapon5': '0.284', 'AMMO4': '0.297', 'weapon2': '0.318', 'weapon4': '0.412', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.674', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '63.000'} [2024-08-06 03:45:03,165][52660] DAMAGECOUNT value on done: 439514.0 [2024-08-06 03:45:03,166][52660] Sum rewards: 83.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.664', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.196', 'weapon4': '0.246', 'weapon2': '0.250', 'weapon5': '0.274', 'AMMO4': '0.290', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '67.000'} [2024-08-06 03:45:03,685][52662] DAMAGECOUNT value on done: 441466.0 [2024-08-06 03:45:03,686][52662] Sum rewards: 71.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.310', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.180', 'weapon4': '0.180', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '56.000'} [2024-08-06 03:45:04,790][52794] DAMAGECOUNT value on done: 449703.0 [2024-08-06 03:45:04,793][52794] Sum rewards: 57.885, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.792', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.084', 'weapon7': '0.102', 'AMMO4': '0.169', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '50.000'} [2024-08-06 03:45:05,280][52671] DAMAGECOUNT value on done: 449602.0 [2024-08-06 03:45:05,288][52671] Sum rewards: 61.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.260', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO4': '0.029', 'weapon5': '0.086', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.224', 'weapon2': '0.748', 'WEAPON3': '1.250', 'weapon3': '2.720', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '49.000'} [2024-08-06 03:45:05,393][52650] Updated weights for policy 0, policy_version 48171 (0.0017) [2024-08-06 03:45:05,462][52658] DAMAGECOUNT value on done: 439924.0 [2024-08-06 03:45:05,462][52658] Sum rewards: 67.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.642', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.120', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '57.000'} [2024-08-06 03:45:05,957][52665] DAMAGECOUNT value on done: 440916.0 [2024-08-06 03:45:05,958][52665] Sum rewards: 76.822, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.078', 'AMMO3': '0.207', 'HEALTH': '0.502', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '3.118', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '62.000'} [2024-08-06 03:45:06,366][52660] DAMAGECOUNT value on done: 444970.0 [2024-08-06 03:45:06,366][52660] Sum rewards: 73.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.769', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.120', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'weapon2': '0.240', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.298', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 03:45:06,513][52662] DAMAGECOUNT value on done: 438996.0 [2024-08-06 03:45:06,513][52662] Sum rewards: 77.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.679', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.145', 'weapon5': '0.176', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '62.000'} [2024-08-06 03:45:07,443][52794] DAMAGECOUNT value on done: 447363.0 [2024-08-06 03:45:07,444][52794] Sum rewards: 67.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.708', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '54.500'} [2024-08-06 03:45:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 394657792. Throughput: 0: 4353.8. Samples: 98668010. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:45:07,794][52567] Avg episode reward: [(0, '71.580')] [2024-08-06 03:45:07,955][52671] DAMAGECOUNT value on done: 451140.0 [2024-08-06 03:45:07,956][52671] Sum rewards: 62.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.124', 'weapon4': '0.152', 'AMMO4': '0.154', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:08,413][52658] DAMAGECOUNT value on done: 436662.0 [2024-08-06 03:45:08,413][52658] Sum rewards: 58.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.282', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '51.000'} [2024-08-06 03:45:08,744][52665] DAMAGECOUNT value on done: 434100.0 [2024-08-06 03:45:08,744][52665] Sum rewards: 60.306, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.627', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.640', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '48.000'} [2024-08-06 03:45:09,000][52660] DAMAGECOUNT value on done: 440243.0 [2024-08-06 03:45:09,003][52660] Sum rewards: 75.284, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.028', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '61.000'} [2024-08-06 03:45:10,128][52650] Updated weights for policy 0, policy_version 48181 (0.0036) [2024-08-06 03:45:10,364][52794] DAMAGECOUNT value on done: 440673.0 [2024-08-06 03:45:10,364][52794] Sum rewards: 61.490, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.845', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.156', 'AMMO4': '0.169', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.218', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '52.500'} [2024-08-06 03:45:10,898][52671] DAMAGECOUNT value on done: 446584.0 [2024-08-06 03:45:10,898][52671] Sum rewards: 53.409, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.536', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.210', 'WEAPON5': '0.250', 'AMMO4': '0.275', 'AMMO3': '0.292', 'weapon2': '0.302', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.774', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '47.000'} [2024-08-06 03:45:11,224][52658] DAMAGECOUNT value on done: 450411.0 [2024-08-06 03:45:11,225][52658] Sum rewards: 71.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.106', 'weapon4': '0.166', 'AMMO4': '0.196', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '61.000'} [2024-08-06 03:45:11,856][52660] DAMAGECOUNT value on done: 441887.0 [2024-08-06 03:45:11,857][52660] Sum rewards: 66.974, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.624', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.162', 'AMMO3': '0.227', 'AMMO4': '0.245', 'weapon5': '0.278', 'weapon2': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '55.000'} [2024-08-06 03:45:11,913][52665] DAMAGECOUNT value on done: 434065.0 [2024-08-06 03:45:11,914][52665] Sum rewards: 79.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.368', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.080', 'AMMO4': '0.181', 'AMMO3': '0.255', 'weapon5': '0.278', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '66.000'} [2024-08-06 03:45:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 394739712. Throughput: 0: 4374.2. Samples: 98694400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:45:12,794][52567] Avg episode reward: [(0, '71.068')] [2024-08-06 03:45:13,152][52794] DAMAGECOUNT value on done: 441275.0 [2024-08-06 03:45:13,154][52794] Sum rewards: 79.112, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.950', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.164', 'AMMO3': '0.168', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '63.000'} [2024-08-06 03:45:13,895][52658] DAMAGECOUNT value on done: 441177.0 [2024-08-06 03:45:13,895][52658] Sum rewards: 67.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.128', 'weapon4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 03:45:13,943][52671] DAMAGECOUNT value on done: 445498.0 [2024-08-06 03:45:13,946][52671] Sum rewards: 72.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.568', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.398', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.282', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '63.000'} [2024-08-06 03:45:14,257][52811] DAMAGECOUNT value on done: 425864.0 [2024-08-06 03:45:14,257][52811] Sum rewards: 69.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.364', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.500'} [2024-08-06 03:45:14,764][52660] DAMAGECOUNT value on done: 437991.0 [2024-08-06 03:45:14,764][52660] Sum rewards: 65.938, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.840', 'AMMO5': '0.018', 'AMMO2': '0.074', 'weapon4': '0.238', 'weapon2': '0.284', 'weapon5': '0.294', 'AMMO3': '0.302', 'AMMO4': '0.372', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.778', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '58.000'} [2024-08-06 03:45:15,039][52665] DAMAGECOUNT value on done: 434228.0 [2024-08-06 03:45:15,040][52665] Sum rewards: 63.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.604', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.128', 'AMMO3': '0.159', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.552', 'weapon2': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.442', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '52.000'} [2024-08-06 03:45:15,048][52650] Updated weights for policy 0, policy_version 48191 (0.0024) [2024-08-06 03:45:15,635][52649] DAMAGECOUNT value on done: 428218.0 [2024-08-06 03:45:15,639][52649] Sum rewards: 87.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.102', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.179', 'weapon2': '0.230', 'WEAPON3': '1.150', 'weapon3': '3.628', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '70.000'} [2024-08-06 03:45:15,779][52794] DAMAGECOUNT value on done: 446189.0 [2024-08-06 03:45:15,781][52794] Sum rewards: 70.685, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.044', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.217', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '58.000'} [2024-08-06 03:45:16,599][52658] DAMAGECOUNT value on done: 444988.0 [2024-08-06 03:45:16,599][52658] Sum rewards: 56.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon5': '0.166', 'AMMO3': '0.191', 'AMMO4': '0.241', 'weapon4': '0.296', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '3.004', 'DAMAGECOUNT': '13.380', 'FRAGCOUNT': '48.000'} [2024-08-06 03:45:17,309][52811] DAMAGECOUNT value on done: 408673.0 [2024-08-06 03:45:17,309][52811] Sum rewards: 76.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.060', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'weapon2': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON3': '1.250', 'HITCOUNT': '3.370', 'weapon3': '3.582', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '64.000'} [2024-08-06 03:45:17,588][52670] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:45:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 394829824. Throughput: 0: 4381.8. Samples: 98707590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:45:17,794][52567] Avg episode reward: [(0, '71.202')] [2024-08-06 03:45:18,186][52665] DAMAGECOUNT value on done: 435857.0 [2024-08-06 03:45:18,188][52665] Sum rewards: 63.975, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.535', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO3': '0.185', 'AMMO4': '0.216', 'weapon5': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '51.000'} [2024-08-06 03:45:18,194][52794] DAMAGECOUNT value on done: 450491.0 [2024-08-06 03:45:18,195][52794] Sum rewards: 78.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.586', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.097', 'weapon4': '0.122', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '65.000'} [2024-08-06 03:45:18,894][52649] DAMAGECOUNT value on done: 423335.0 [2024-08-06 03:45:18,896][52649] Sum rewards: 56.846, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.034', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.330', 'weapon2': '0.460', 'WEAPON3': '0.900', 'HITCOUNT': '2.860', 'weapon3': '3.064', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '45.000'} [2024-08-06 03:45:19,305][52650] Updated weights for policy 0, policy_version 48201 (0.0027) [2024-08-06 03:45:19,660][52658] DAMAGECOUNT value on done: 449377.0 [2024-08-06 03:45:19,660][52658] Sum rewards: 61.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.241', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.130', 'weapon2': '0.206', 'AMMO4': '0.236', 'weapon4': '0.252', 'AMMO3': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.180', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '53.500'} [2024-08-06 03:45:19,966][52803] DAMAGECOUNT value on done: 415193.0 [2024-08-06 03:45:19,970][52803] Sum rewards: 57.828, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.120', 'AMMO3': '0.170', 'AMMO4': '0.178', 'weapon5': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.842', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '46.000'} [2024-08-06 03:45:20,448][52811] DAMAGECOUNT value on done: 411790.0 [2024-08-06 03:45:20,449][52811] Sum rewards: 66.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.022', 'AMMO2': '0.067', 'AMMO3': '0.208', 'weapon5': '0.224', 'weapon2': '0.246', 'AMMO4': '0.334', 'weapon4': '0.356', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '58.000'} [2024-08-06 03:45:20,695][52794] DAMAGECOUNT value on done: 441839.0 [2024-08-06 03:45:20,703][52794] Sum rewards: 67.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.094', 'weapon5': '0.098', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.428', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '56.000'} [2024-08-06 03:45:21,310][52665] DAMAGECOUNT value on done: 441101.0 [2024-08-06 03:45:21,310][52665] Sum rewards: 54.835, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.685', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.146', 'AMMO4': '0.187', 'weapon4': '0.282', 'WEAPON5': '0.300', 'AMMO3': '0.310', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.850', 'weapon3': '2.834', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '52.000'} [2024-08-06 03:45:22,017][52649] DAMAGECOUNT value on done: 437516.0 [2024-08-06 03:45:22,019][52649] Sum rewards: 84.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.078', 'AMMO4': '0.103', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '68.000'} [2024-08-06 03:45:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 394928128. Throughput: 0: 4380.4. Samples: 98733850. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:45:22,794][52567] Avg episode reward: [(0, '70.413')] [2024-08-06 03:45:23,060][52803] DAMAGECOUNT value on done: 411239.0 [2024-08-06 03:45:23,063][52803] Sum rewards: 66.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon4': '0.182', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.600', 'weapon3': '3.040', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '56.000'} [2024-08-06 03:45:23,461][52811] DAMAGECOUNT value on done: 412313.0 [2024-08-06 03:45:23,461][52811] Sum rewards: 61.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.009', 'AMMO5': '0.024', 'AMMO2': '0.066', 'AMMO3': '0.199', 'weapon2': '0.236', 'weapon4': '0.248', 'weapon5': '0.260', 'AMMO4': '0.332', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.922', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '51.000'} [2024-08-06 03:45:23,643][52794] DAMAGECOUNT value on done: 449019.0 [2024-08-06 03:45:23,644][52794] Sum rewards: 79.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.914', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.072', 'AMMO4': '0.138', 'weapon4': '0.144', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '64.000'} [2024-08-06 03:45:24,345][52650] Updated weights for policy 0, policy_version 48211 (0.0010) [2024-08-06 03:45:24,857][52659] DAMAGECOUNT value on done: 444685.0 [2024-08-06 03:45:24,859][52659] Sum rewards: 68.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.456', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.384', 'weapon4': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '56.000'} [2024-08-06 03:45:25,115][52614] Signal inference workers to stop experience collection... (8750 times) [2024-08-06 03:45:25,116][52614] Signal inference workers to resume experience collection... (8750 times) [2024-08-06 03:45:25,156][52649] DAMAGECOUNT value on done: 430145.0 [2024-08-06 03:45:25,158][52649] Sum rewards: 73.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.468', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.124', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 03:45:25,203][52650] InferenceWorker_p0-w0: stopping experience collection (8750 times) [2024-08-06 03:45:25,211][52650] InferenceWorker_p0-w0: resuming experience collection (8750 times) [2024-08-06 03:45:26,165][52803] DAMAGECOUNT value on done: 418911.0 [2024-08-06 03:45:26,168][52803] Sum rewards: 73.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.933', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.104', 'AMMO4': '0.106', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '60.000'} [2024-08-06 03:45:26,379][52794] DAMAGECOUNT value on done: 445487.0 [2024-08-06 03:45:26,379][52794] Sum rewards: 72.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.134', 'weapon2': '0.170', 'weapon5': '0.176', 'AMMO4': '0.223', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 03:45:26,517][52811] DAMAGECOUNT value on done: 415727.0 [2024-08-06 03:45:26,519][52811] Sum rewards: 78.466, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.174', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.172', 'AMMO4': '0.174', 'weapon2': '0.240', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '67.000'} [2024-08-06 03:45:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 395001856. Throughput: 0: 4384.9. Samples: 98760250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:45:27,795][52567] Avg episode reward: [(0, '70.371')] [2024-08-06 03:45:27,963][52659] DAMAGECOUNT value on done: 444925.0 [2024-08-06 03:45:27,965][52659] Sum rewards: 73.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.535', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.284', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.440', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '60.000'} [2024-08-06 03:45:28,241][52649] DAMAGECOUNT value on done: 422046.0 [2024-08-06 03:45:28,242][52649] Sum rewards: 74.659, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.705', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.250', 'weapon5': '0.256', 'weapon2': '0.330', 'WEAPON3': '0.900', 'weapon3': '3.160', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '59.000'} [2024-08-06 03:45:28,470][52650] Updated weights for policy 0, policy_version 48221 (0.0013) [2024-08-06 03:45:29,055][52794] DAMAGECOUNT value on done: 440518.0 [2024-08-06 03:45:29,057][52794] Sum rewards: 69.245, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.240', 'AMMO4': '0.248', 'AMMO3': '0.265', 'weapon5': '0.296', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.684', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '59.500'} [2024-08-06 03:45:29,264][52803] DAMAGECOUNT value on done: 420886.0 [2024-08-06 03:45:29,265][52803] Sum rewards: 83.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.674', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.176', 'AMMO4': '0.179', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '66.000'} [2024-08-06 03:45:29,710][52811] DAMAGECOUNT value on done: 421601.0 [2024-08-06 03:45:29,710][52811] Sum rewards: 68.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.647', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.147', 'weapon5': '0.166', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.148', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '58.000'} [2024-08-06 03:45:30,528][52659] DAMAGECOUNT value on done: 447671.0 [2024-08-06 03:45:30,530][52659] Sum rewards: 59.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.230', 'weapon2': '0.490', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.164', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '51.000'} [2024-08-06 03:45:31,343][52649] DAMAGECOUNT value on done: 434700.0 [2024-08-06 03:45:31,352][52649] Sum rewards: 64.133, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.260', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.178', 'weapon4': '0.190', 'AMMO4': '0.213', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.950', 'weapon3': '3.050', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '57.000'} [2024-08-06 03:45:32,220][52794] DAMAGECOUNT value on done: 447907.0 [2024-08-06 03:45:32,220][52794] Sum rewards: 64.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.078', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.298', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '55.000'} [2024-08-06 03:45:32,304][52803] DAMAGECOUNT value on done: 420121.0 [2024-08-06 03:45:32,307][52803] Sum rewards: 66.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.548', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.096', 'AMMO3': '0.179', 'AMMO4': '0.224', 'weapon4': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 395100160. Throughput: 0: 4381.6. Samples: 98773280. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:45:32,794][52567] Avg episode reward: [(0, '70.183')] [2024-08-06 03:45:32,886][52811] DAMAGECOUNT value on done: 416041.0 [2024-08-06 03:45:32,886][52811] Sum rewards: 82.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.128', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '67.000'} [2024-08-06 03:45:33,170][52650] Updated weights for policy 0, policy_version 48231 (0.0012) [2024-08-06 03:45:33,639][52659] DAMAGECOUNT value on done: 443797.0 [2024-08-06 03:45:33,639][52659] Sum rewards: 66.407, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.838', 'AMMO5': '0.008', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'weapon5': '0.194', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.272', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:34,468][52649] DAMAGECOUNT value on done: 429630.0 [2024-08-06 03:45:34,468][52649] Sum rewards: 76.919, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO4': '0.225', 'weapon5': '0.232', 'weapon2': '0.252', 'AMMO3': '0.287', 'weapon4': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'ARMOR': '0.456', 'WEAPON3': '1.750', 'weapon3': '2.814', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '66.000'} [2024-08-06 03:45:35,117][52794] DAMAGECOUNT value on done: 437158.0 [2024-08-06 03:45:35,119][52794] Sum rewards: 88.222, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.622', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.211', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.310', 'weapon4': '0.396', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.366', 'FRAGCOUNT': '71.000'} [2024-08-06 03:45:35,579][52803] DAMAGECOUNT value on done: 407558.0 [2024-08-06 03:45:35,579][52803] Sum rewards: 67.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.395', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.156', 'weapon4': '0.224', 'weapon2': '0.240', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.140', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '60.000'} [2024-08-06 03:45:36,016][52811] DAMAGECOUNT value on done: 414911.0 [2024-08-06 03:45:36,020][52811] Sum rewards: 64.807, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.187', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO3': '0.173', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.272', 'weapon2': '0.698', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '52.000'} [2024-08-06 03:45:36,211][52659] DAMAGECOUNT value on done: 440898.0 [2024-08-06 03:45:36,213][52659] Sum rewards: 64.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.070', 'weapon5': '0.120', 'AMMO3': '0.247', 'AMMO4': '0.253', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.334', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '55.000'} [2024-08-06 03:45:37,437][52794] DAMAGECOUNT value on done: 457238.0 [2024-08-06 03:45:37,437][52794] Sum rewards: 77.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '65.000'} [2024-08-06 03:45:37,678][52649] DAMAGECOUNT value on done: 435385.0 [2024-08-06 03:45:37,680][52649] Sum rewards: 61.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.454', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.212', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '53.000'} [2024-08-06 03:45:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.1). Total num frames: 395173888. Throughput: 0: 4382.9. Samples: 98799570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:45:37,794][52567] Avg episode reward: [(0, '70.244')] [2024-08-06 03:45:38,135][52650] Updated weights for policy 0, policy_version 48241 (0.0038) [2024-08-06 03:45:38,758][52803] DAMAGECOUNT value on done: 410141.0 [2024-08-06 03:45:38,759][52803] Sum rewards: 62.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.638', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.038', 'AMMO4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.358', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.312', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '53.000'} [2024-08-06 03:45:39,158][52811] DAMAGECOUNT value on done: 418764.0 [2024-08-06 03:45:39,162][52811] Sum rewards: 60.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.482', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.120', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:39,197][52659] DAMAGECOUNT value on done: 445932.0 [2024-08-06 03:45:39,199][52659] Sum rewards: 66.308, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.311', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.250', 'weapon4': '0.256', 'AMMO3': '0.259', 'AMMO4': '0.317', 'weapon2': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.738', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '59.000'} [2024-08-06 03:45:40,267][52794] DAMAGECOUNT value on done: 438915.0 [2024-08-06 03:45:40,267][52794] Sum rewards: 74.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.766', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.130', 'weapon5': '0.136', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '61.000'} [2024-08-06 03:45:40,767][52649] DAMAGECOUNT value on done: 436492.0 [2024-08-06 03:45:40,767][52649] Sum rewards: 66.083, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.780', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.134', 'weapon5': '0.218', 'AMMO3': '0.229', 'AMMO4': '0.307', 'weapon2': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '56.000'} [2024-08-06 03:45:41,869][52659] DAMAGECOUNT value on done: 444963.0 [2024-08-06 03:45:41,870][52659] Sum rewards: 66.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.356', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.118', 'weapon2': '0.146', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '55.000'} [2024-08-06 03:45:41,924][52803] DAMAGECOUNT value on done: 409408.0 [2024-08-06 03:45:41,924][52803] Sum rewards: 77.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.858', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.144', 'AMMO4': '0.198', 'AMMO3': '0.212', 'weapon5': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 03:45:42,214][52811] DAMAGECOUNT value on done: 415893.0 [2024-08-06 03:45:42,215][52811] Sum rewards: 63.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.776', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.135', 'weapon4': '0.196', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.298', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '53.000'} [2024-08-06 03:45:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 395264000. Throughput: 0: 4383.3. Samples: 98825920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:45:42,794][52567] Avg episode reward: [(0, '69.955')] [2024-08-06 03:45:42,996][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:45:43,056][52650] Updated weights for policy 0, policy_version 48251 (0.0012) [2024-08-06 03:45:43,371][52794] DAMAGECOUNT value on done: 455689.0 [2024-08-06 03:45:43,371][52794] Sum rewards: 76.671, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.088', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.312', 'weapon2': '0.374', 'WEAPON3': '1.800', 'weapon3': '3.118', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '67.000'} [2024-08-06 03:45:43,788][52649] DAMAGECOUNT value on done: 430006.0 [2024-08-06 03:45:43,788][52649] Sum rewards: 62.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:44,836][52659] DAMAGECOUNT value on done: 445046.0 [2024-08-06 03:45:44,840][52659] Sum rewards: 73.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.990', 'AMMO5': '0.009', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.274', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.518', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '63.000'} [2024-08-06 03:45:45,013][52803] DAMAGECOUNT value on done: 416325.0 [2024-08-06 03:45:45,016][52803] Sum rewards: 63.110, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.025', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.138', 'AMMO3': '0.154', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '0.900', 'weapon3': '2.752', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.523', 'FRAGCOUNT': '50.000'} [2024-08-06 03:45:45,213][52811] DAMAGECOUNT value on done: 414783.0 [2024-08-06 03:45:45,215][52811] Sum rewards: 69.052, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.135', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.040', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '0.850', 'weapon3': '3.064', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:45,835][52794] DAMAGECOUNT value on done: 445835.0 [2024-08-06 03:45:45,838][52794] Sum rewards: 53.338, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.795', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.224', 'weapon2': '0.248', 'AMMO4': '0.252', 'AMMO3': '0.277', 'weapon4': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.804', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '48.000'} [2024-08-06 03:45:47,084][52649] DAMAGECOUNT value on done: 437692.0 [2024-08-06 03:45:47,084][52649] Sum rewards: 63.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.498', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.070', 'AMMO4': '0.178', 'weapon5': '0.214', 'AMMO3': '0.254', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.168', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:47,381][52650] Updated weights for policy 0, policy_version 48261 (0.0027) [2024-08-06 03:45:47,438][52659] DAMAGECOUNT value on done: 452277.0 [2024-08-06 03:45:47,441][52659] Sum rewards: 52.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.156', 'AMMO4': '0.265', 'weapon5': '0.280', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.544', 'weapon2': '0.562', 'WEAPON3': '0.950', 'weapon3': '2.328', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '44.500'} [2024-08-06 03:45:47,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 395362304. Throughput: 0: 4388.4. Samples: 98839270. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:45:47,795][52567] Avg episode reward: [(0, '69.480')] [2024-08-06 03:45:48,187][52803] DAMAGECOUNT value on done: 408235.0 [2024-08-06 03:45:48,188][52803] Sum rewards: 67.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.666', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon5': '0.238', 'AMMO3': '0.243', 'weapon4': '0.266', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.794', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 03:45:48,291][52811] DAMAGECOUNT value on done: 425394.0 [2024-08-06 03:45:48,294][52811] Sum rewards: 67.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.838', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'AMMO4': '0.098', 'weapon5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.268', 'weapon2': '0.552', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '58.000'} [2024-08-06 03:45:48,482][52794] DAMAGECOUNT value on done: 448209.0 [2024-08-06 03:45:48,484][52794] Sum rewards: 75.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.006', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.106', 'AMMO4': '0.196', 'weapon5': '0.202', 'AMMO3': '0.216', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '61.000'} [2024-08-06 03:45:48,767][52671] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:45:50,129][52649] DAMAGECOUNT value on done: 439860.0 [2024-08-06 03:45:50,133][52649] Sum rewards: 73.797, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.458', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '64.000'} [2024-08-06 03:45:50,782][52659] DAMAGECOUNT value on done: 454856.0 [2024-08-06 03:45:50,784][52659] Sum rewards: 72.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.355', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.390', 'WEAPON3': '1.650', 'weapon3': '3.338', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '63.000'} [2024-08-06 03:45:51,203][52803] DAMAGECOUNT value on done: 421497.0 [2024-08-06 03:45:51,203][52803] Sum rewards: 71.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.035', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.177', 'weapon2': '0.210', 'WEAPON3': '1.100', 'HITCOUNT': '3.290', 'weapon3': '3.488', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '58.000'} [2024-08-06 03:45:51,298][52811] DAMAGECOUNT value on done: 415847.0 [2024-08-06 03:45:51,298][52811] Sum rewards: 65.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.780', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.125', 'weapon4': '0.140', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '54.500'} [2024-08-06 03:45:51,341][52794] DAMAGECOUNT value on done: 452160.0 [2024-08-06 03:45:51,342][52794] Sum rewards: 62.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.190', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO4': '0.172', 'weapon2': '0.180', 'weapon5': '0.182', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.190', 'weapon3': '3.278', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:52,147][52650] Updated weights for policy 0, policy_version 48271 (0.0019) [2024-08-06 03:45:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 395444224. Throughput: 0: 4386.2. Samples: 98865390. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:45:52,802][52567] Avg episode reward: [(0, '68.791')] [2024-08-06 03:45:52,938][52659] DAMAGECOUNT value on done: 444115.0 [2024-08-06 03:45:52,940][52659] Sum rewards: 52.667, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.182', 'AMMO3': '0.188', 'weapon4': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '3.068', 'DAMAGECOUNT': '12.534', 'FRAGCOUNT': '43.000'} [2024-08-06 03:45:53,549][52649] DAMAGECOUNT value on done: 439470.0 [2024-08-06 03:45:53,549][52649] Sum rewards: 76.918, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.826', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.118', 'AMMO4': '0.200', 'weapon5': '0.214', 'AMMO3': '0.275', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.080', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '66.000'} [2024-08-06 03:45:54,080][52664] DAMAGECOUNT value on done: 461738.0 [2024-08-06 03:45:54,081][52664] Sum rewards: 71.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.951', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '59.000'} [2024-08-06 03:45:54,185][52647] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 03:45:54,245][52803] DAMAGECOUNT value on done: 415072.0 [2024-08-06 03:45:54,246][52803] Sum rewards: 57.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.488', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.096', 'weapon5': '0.172', 'AMMO4': '0.195', 'AMMO3': '0.205', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.740', 'weapon3': '3.238', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '48.000'} [2024-08-06 03:45:54,337][52811] DAMAGECOUNT value on done: 411972.0 [2024-08-06 03:45:54,337][52811] Sum rewards: 60.846, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.516', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.184', 'AMMO4': '0.189', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '51.500'} [2024-08-06 03:45:54,606][52794] DAMAGECOUNT value on done: 443997.0 [2024-08-06 03:45:54,609][52794] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.252', 'HEALTH': '0.260', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '2.998', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '54.000'} [2024-08-06 03:45:55,618][52659] DAMAGECOUNT value on done: 447718.0 [2024-08-06 03:45:55,621][52659] Sum rewards: 59.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.691', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.196', 'weapon5': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '49.000'} [2024-08-06 03:45:55,974][52649] DAMAGECOUNT value on done: 438753.0 [2024-08-06 03:45:55,975][52649] Sum rewards: 57.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.654', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.116', 'AMMO4': '0.150', 'weapon5': '0.198', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '2.640', 'weapon3': '3.098', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '48.000'} [2024-08-06 03:45:56,603][52650] Updated weights for policy 0, policy_version 48281 (0.0012) [2024-08-06 03:45:57,293][52664] DAMAGECOUNT value on done: 467083.0 [2024-08-06 03:45:57,293][52664] Sum rewards: 71.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.082', 'AMMO4': '0.151', 'weapon5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.262', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '60.000'} [2024-08-06 03:45:57,447][52811] DAMAGECOUNT value on done: 418319.0 [2024-08-06 03:45:57,448][52811] Sum rewards: 69.589, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon4': '0.090', 'weapon5': '0.106', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.396', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 03:45:57,497][52803] DAMAGECOUNT value on done: 414701.0 [2024-08-06 03:45:57,497][52803] Sum rewards: 66.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.676', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.172', 'AMMO4': '0.191', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '56.000'} [2024-08-06 03:45:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 395526144. Throughput: 0: 4381.3. Samples: 98891560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:45:57,794][52567] Avg episode reward: [(0, '68.316')] [2024-08-06 03:45:58,625][52649] DAMAGECOUNT value on done: 428606.0 [2024-08-06 03:45:58,627][52649] Sum rewards: 56.242, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.882', 'AMMO5': '0.016', 'AMMO2': '0.068', 'weapon4': '0.136', 'weapon5': '0.250', 'AMMO3': '0.269', 'AMMO4': '0.343', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.816', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '50.500'} [2024-08-06 03:45:58,631][52659] DAMAGECOUNT value on done: 439470.0 [2024-08-06 03:45:58,633][52659] Sum rewards: 79.572, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.980', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.084', 'weapon5': '0.182', 'AMMO4': '0.252', 'weapon2': '0.300', 'AMMO3': '0.309', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.950', 'weapon3': '3.128', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '69.000'} [2024-08-06 03:45:59,037][52663] DAMAGECOUNT value on done: 450669.0 [2024-08-06 03:45:59,039][52663] Sum rewards: 63.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.170', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.120', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.246', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '53.000'} [2024-08-06 03:46:00,502][52811] DAMAGECOUNT value on done: 411625.0 [2024-08-06 03:46:00,502][52811] Sum rewards: 60.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.148', 'AMMO3': '0.247', 'weapon2': '0.264', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '51.000'} [2024-08-06 03:46:00,643][52803] DAMAGECOUNT value on done: 419169.0 [2024-08-06 03:46:00,645][52803] Sum rewards: 77.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.382', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.104', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'weapon5': '0.226', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:00,671][52664] DAMAGECOUNT value on done: 467427.0 [2024-08-06 03:46:00,672][52664] Sum rewards: 65.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '53.000'} [2024-08-06 03:46:00,747][52666] DAMAGECOUNT value on done: 441496.0 [2024-08-06 03:46:00,747][52666] Sum rewards: 59.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.056', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.146', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'weapon4': '0.282', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.118', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '48.500'} [2024-08-06 03:46:01,282][52650] Updated weights for policy 0, policy_version 48291 (0.0019) [2024-08-06 03:46:01,373][52649] DAMAGECOUNT value on done: 437278.0 [2024-08-06 03:46:01,374][52649] Sum rewards: 75.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.062', 'weapon4': '0.108', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.396', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:01,537][52659] DAMAGECOUNT value on done: 445881.0 [2024-08-06 03:46:01,537][52659] Sum rewards: 66.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.925', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.147', 'AMMO3': '0.227', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.320', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:01,786][52663] DAMAGECOUNT value on done: 445655.0 [2024-08-06 03:46:01,786][52663] Sum rewards: 66.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.088', 'weapon2': '0.192', 'weapon5': '0.216', 'AMMO4': '0.223', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.820', 'weapon3': '3.256', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '57.000'} [2024-08-06 03:46:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 395616256. Throughput: 0: 4385.8. Samples: 98904950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:46:02,794][52567] Avg episode reward: [(0, '67.970')] [2024-08-06 03:46:03,502][52666] DAMAGECOUNT value on done: 448443.0 [2024-08-06 03:46:03,503][52666] Sum rewards: 65.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.556', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.180', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:03,719][52811] DAMAGECOUNT value on done: 414858.0 [2024-08-06 03:46:03,720][52811] Sum rewards: 64.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.078', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.376', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:03,729][52803] DAMAGECOUNT value on done: 413956.0 [2024-08-06 03:46:03,729][52803] Sum rewards: 71.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.305', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon4': '0.268', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:03,859][52664] DAMAGECOUNT value on done: 460319.0 [2024-08-06 03:46:03,859][52664] Sum rewards: 69.972, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.020', 'HEALTH': '0.038', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.195', 'weapon5': '0.220', 'weapon4': '0.362', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.684', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.500'} [2024-08-06 03:46:03,897][52670] DAMAGECOUNT value on done: 436050.0 [2024-08-06 03:46:03,898][52670] Sum rewards: 74.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO4': '0.192', 'AMMO3': '0.225', 'weapon2': '0.228', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '62.000'} [2024-08-06 03:46:03,958][52659] DAMAGECOUNT value on done: 454409.0 [2024-08-06 03:46:03,959][52659] Sum rewards: 61.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.714', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.146', 'weapon5': '0.146', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.424', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.642', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2024-08-06 03:46:04,198][52649] DAMAGECOUNT value on done: 428525.0 [2024-08-06 03:46:04,200][52649] Sum rewards: 69.220, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.174', 'weapon4': '0.224', 'AMMO4': '0.237', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.014', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:04,211][52663] DAMAGECOUNT value on done: 439818.0 [2024-08-06 03:46:04,212][52663] Sum rewards: 69.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.278', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.076', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:04,262][52647] DAMAGECOUNT value on done: 469523.0 [2024-08-06 03:46:04,263][52647] Sum rewards: 67.217, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.770', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.032', 'weapon4': '0.034', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.400', 'weapon3': '3.458', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:05,417][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:46:06,165][52650] Updated weights for policy 0, policy_version 48301 (0.0030) [2024-08-06 03:46:06,263][52666] DAMAGECOUNT value on done: 447958.0 [2024-08-06 03:46:06,264][52666] Sum rewards: 68.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.222', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.172', 'AMMO3': '0.307', 'WEAPON3': '1.800', 'HITCOUNT': '3.290', 'weapon3': '3.616', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '62.000'} [2024-08-06 03:46:06,511][52670] DAMAGECOUNT value on done: 445057.0 [2024-08-06 03:46:06,513][52670] Sum rewards: 65.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.842', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.096', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:06,525][52664] DAMAGECOUNT value on done: 464599.0 [2024-08-06 03:46:06,525][52664] Sum rewards: 68.630, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.050', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.148', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.284', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.214', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:06,645][52811] DAMAGECOUNT value on done: 415931.0 [2024-08-06 03:46:06,645][52811] Sum rewards: 59.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.086', 'weapon5': '0.128', 'AMMO3': '0.192', 'AMMO4': '0.279', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '2.982', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '51.000'} [2024-08-06 03:46:06,821][52659] DAMAGECOUNT value on done: 451571.0 [2024-08-06 03:46:06,822][52659] Sum rewards: 74.279, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.741', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO3': '0.134', 'AMMO4': '0.139', 'weapon4': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.000', 'weapon3': '3.056', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:06,932][52803] DAMAGECOUNT value on done: 411050.0 [2024-08-06 03:46:06,933][52803] Sum rewards: 54.559, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.475', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.218', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '47.500'} [2024-08-06 03:46:06,979][52663] DAMAGECOUNT value on done: 444177.0 [2024-08-06 03:46:06,979][52663] Sum rewards: 69.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.816', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:07,010][52647] DAMAGECOUNT value on done: 468814.0 [2024-08-06 03:46:07,010][52647] Sum rewards: 62.673, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.925', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.146', 'AMMO3': '0.297', 'WEAPON3': '1.750', 'HITCOUNT': '3.090', 'weapon3': '3.578', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '57.000'} [2024-08-06 03:46:07,598][52649] DAMAGECOUNT value on done: 438552.0 [2024-08-06 03:46:07,598][52649] Sum rewards: 65.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.795', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.209', 'weapon2': '0.738', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 395706368. Throughput: 0: 4380.2. Samples: 98930960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:46:07,802][52567] Avg episode reward: [(0, '67.642')] [2024-08-06 03:46:08,474][52795] DAMAGECOUNT value on done: 413978.0 [2024-08-06 03:46:08,475][52795] Sum rewards: 78.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.704', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.084', 'weapon4': '0.106', 'AMMO4': '0.134', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '64.000'} [2024-08-06 03:46:08,728][52666] DAMAGECOUNT value on done: 446744.0 [2024-08-06 03:46:08,729][52666] Sum rewards: 70.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.745', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.168', 'AMMO3': '0.221', 'weapon5': '0.230', 'AMMO4': '0.267', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '59.500'} [2024-08-06 03:46:09,184][52670] DAMAGECOUNT value on done: 439816.0 [2024-08-06 03:46:09,184][52670] Sum rewards: 80.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.042', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.174', 'AMMO3': '0.206', 'WEAPON3': '1.350', 'weapon3': '3.552', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '67.000'} [2024-08-06 03:46:09,280][52664] DAMAGECOUNT value on done: 462553.0 [2024-08-06 03:46:09,281][52664] Sum rewards: 82.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.472', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.126', 'weapon4': '0.130', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '68.000'} [2024-08-06 03:46:09,576][52647] DAMAGECOUNT value on done: 468444.0 [2024-08-06 03:46:09,577][52647] Sum rewards: 65.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.628', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.146', 'weapon5': '0.148', 'AMMO3': '0.220', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.144', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '55.000'} [2024-08-06 03:46:09,783][52663] DAMAGECOUNT value on done: 444150.0 [2024-08-06 03:46:09,784][52663] Sum rewards: 60.728, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.327', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.092', 'weapon5': '0.182', 'AMMO4': '0.194', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.018', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:09,788][52811] DAMAGECOUNT value on done: 415681.0 [2024-08-06 03:46:09,789][52811] Sum rewards: 68.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.830', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.158', 'weapon4': '0.212', 'AMMO3': '0.222', 'weapon2': '0.224', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.146', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:09,842][52649] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.543, 181.0), ('weapon5', 0.002)] [2024-08-06 03:46:09,979][52659] DAMAGECOUNT value on done: 451309.0 [2024-08-06 03:46:09,979][52659] Sum rewards: 72.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.146', 'weapon5': '0.148', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:10,048][52803] DAMAGECOUNT value on done: 421471.0 [2024-08-06 03:46:10,050][52803] Sum rewards: 74.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.998', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON4': '0.100', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:10,735][52649] DAMAGECOUNT value on done: 441533.0 [2024-08-06 03:46:10,736][52649] Sum rewards: 72.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.893', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.140', 'AMMO3': '0.202', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:10,844][52650] Updated weights for policy 0, policy_version 48311 (0.0012) [2024-08-06 03:46:11,693][52795] DAMAGECOUNT value on done: 403827.0 [2024-08-06 03:46:11,696][52795] Sum rewards: 65.919, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.072', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.302', 'weapon2': '0.326', 'WEAPON3': '1.650', 'HITCOUNT': '3.110', 'weapon3': '3.280', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:11,718][52666] DAMAGECOUNT value on done: 446433.0 [2024-08-06 03:46:11,720][52666] Sum rewards: 67.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.288', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.102', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:11,928][52664] DAMAGECOUNT value on done: 461768.0 [2024-08-06 03:46:11,928][52664] Sum rewards: 60.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.043', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.118', 'AMMO4': '0.210', 'AMMO3': '0.211', 'weapon5': '0.244', 'weapon2': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.060', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '51.000'} [2024-08-06 03:46:11,982][52670] DAMAGECOUNT value on done: 437656.0 [2024-08-06 03:46:11,986][52670] Sum rewards: 65.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.098', 'AMMO4': '0.130', 'weapon5': '0.164', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:12,273][52647] DAMAGECOUNT value on done: 476906.0 [2024-08-06 03:46:12,273][52647] Sum rewards: 68.941, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.088', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.106', 'weapon2': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON3': '0.950', 'HITCOUNT': '3.130', 'weapon3': '3.516', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:12,494][52663] DAMAGECOUNT value on done: 447419.0 [2024-08-06 03:46:12,497][52663] Sum rewards: 66.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.312', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.100', 'AMMO4': '0.185', 'AMMO3': '0.203', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:12,747][52811] DAMAGECOUNT value on done: 416609.0 [2024-08-06 03:46:12,750][52811] Sum rewards: 75.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.106', 'AMMO4': '0.153', 'AMMO3': '0.242', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '64.000'} [2024-08-06 03:46:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 395796480. Throughput: 0: 4368.9. Samples: 98956850. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:46:12,795][52567] Avg episode reward: [(0, '68.157')] [2024-08-06 03:46:12,954][52659] DAMAGECOUNT value on done: 443364.0 [2024-08-06 03:46:12,958][52659] Sum rewards: 66.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.482', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon5': '0.094', 'AMMO3': '0.211', 'weapon2': '0.282', 'AMMO4': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '57.000'} [2024-08-06 03:46:13,187][52803] DAMAGECOUNT value on done: 417504.0 [2024-08-06 03:46:13,189][52803] Sum rewards: 61.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.945', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.056', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO4': '0.221', 'AMMO3': '0.266', 'weapon4': '0.392', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '53.000'} [2024-08-06 03:46:13,866][52649] DAMAGECOUNT value on done: 434599.0 [2024-08-06 03:46:13,867][52649] Sum rewards: 66.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO2': '0.035', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.110', 'WEAPON4': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.231', 'weapon4': '0.332', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '55.000'} [2024-08-06 03:46:14,364][52664] DAMAGECOUNT value on done: 456269.0 [2024-08-06 03:46:14,366][52664] Sum rewards: 67.281, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.134', 'AMMO4': '0.144', 'weapon5': '0.184', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:14,601][52647] DAMAGECOUNT value on done: 475476.0 [2024-08-06 03:46:14,602][52647] Sum rewards: 70.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.173', 'weapon5': '0.174', 'weapon2': '0.204', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.302', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:14,798][52666] DAMAGECOUNT value on done: 437733.0 [2024-08-06 03:46:14,800][52666] Sum rewards: 76.371, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.485', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.151', 'weapon5': '0.248', 'weapon4': '0.250', 'AMMO4': '0.251', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.712', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:14,827][52795] DAMAGECOUNT value on done: 403788.0 [2024-08-06 03:46:14,829][52795] Sum rewards: 63.427, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.174', 'weapon5': '0.174', 'AMMO4': '0.231', 'weapon4': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:15,006][52670] DAMAGECOUNT value on done: 449104.0 [2024-08-06 03:46:15,009][52670] Sum rewards: 73.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.116', 'AMMO3': '0.216', 'weapon5': '0.220', 'AMMO4': '0.323', 'weapon2': '0.406', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '62.000'} [2024-08-06 03:46:15,467][52650] Updated weights for policy 0, policy_version 48321 (0.0012) [2024-08-06 03:46:15,739][52663] DAMAGECOUNT value on done: 446193.0 [2024-08-06 03:46:15,739][52663] Sum rewards: 65.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.910', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.108', 'weapon4': '0.152', 'AMMO4': '0.184', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '55.000'} [2024-08-06 03:46:15,748][52667] Large shaping reward 3.306 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.255, 85.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:46:15,949][52659] DAMAGECOUNT value on done: 447755.0 [2024-08-06 03:46:15,951][52659] Sum rewards: 68.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.181', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.037', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.296', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:16,272][52803] DAMAGECOUNT value on done: 418788.0 [2024-08-06 03:46:16,274][52803] Sum rewards: 73.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.600', 'AMMO5': '0.021', 'AMMO2': '0.043', 'AMMO3': '0.143', 'AMMO4': '0.216', 'weapon5': '0.232', 'weapon4': '0.292', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.716', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:16,868][52664] DAMAGECOUNT value on done: 466945.0 [2024-08-06 03:46:16,868][52664] Sum rewards: 66.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.144', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '55.000'} [2024-08-06 03:46:17,166][52647] DAMAGECOUNT value on done: 472715.0 [2024-08-06 03:46:17,166][52647] Sum rewards: 73.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.294', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.380', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:17,442][52666] DAMAGECOUNT value on done: 444336.0 [2024-08-06 03:46:17,443][52666] Sum rewards: 70.364, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.616', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.112', 'weapon4': '0.118', 'AMMO3': '0.232', 'AMMO4': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:17,595][52670] DAMAGECOUNT value on done: 441534.0 [2024-08-06 03:46:17,598][52670] Sum rewards: 70.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'weapon4': '0.096', 'AMMO3': '0.208', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 395886592. Throughput: 0: 4371.3. Samples: 98969990. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:46:17,802][52567] Avg episode reward: [(0, '67.609')] [2024-08-06 03:46:18,038][52795] DAMAGECOUNT value on done: 410979.0 [2024-08-06 03:46:18,038][52795] Sum rewards: 84.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.224', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '69.000'} [2024-08-06 03:46:18,039][52663] DAMAGECOUNT value on done: 440324.0 [2024-08-06 03:46:18,041][52663] Sum rewards: 78.226, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon2': '0.624', 'WEAPON3': '0.850', 'weapon3': '3.222', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:19,111][52659] DAMAGECOUNT value on done: 448488.0 [2024-08-06 03:46:19,111][52659] Sum rewards: 78.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.080', 'AMMO4': '0.109', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:19,587][52803] DAMAGECOUNT value on done: 413927.0 [2024-08-06 03:46:19,588][52803] Sum rewards: 58.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.342', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO4': '0.188', 'AMMO3': '0.206', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '49.000'} [2024-08-06 03:46:19,791][52664] DAMAGECOUNT value on done: 459642.0 [2024-08-06 03:46:19,791][52664] Sum rewards: 80.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.150', 'AMMO4': '0.169', 'weapon5': '0.202', 'AMMO3': '0.237', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '67.000'} [2024-08-06 03:46:19,970][52647] DAMAGECOUNT value on done: 470781.0 [2024-08-06 03:46:19,970][52647] Sum rewards: 70.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.783', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.148', 'AMMO4': '0.205', 'AMMO3': '0.236', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:20,307][52650] Updated weights for policy 0, policy_version 48331 (0.0011) [2024-08-06 03:46:20,570][52666] DAMAGECOUNT value on done: 443941.0 [2024-08-06 03:46:20,573][52666] Sum rewards: 70.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.220', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:20,654][52663] DAMAGECOUNT value on done: 440980.0 [2024-08-06 03:46:20,655][52663] Sum rewards: 79.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.795', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.040', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.216', 'WEAPON3': '1.450', 'weapon3': '3.456', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '66.000'} [2024-08-06 03:46:20,705][52670] DAMAGECOUNT value on done: 435562.0 [2024-08-06 03:46:20,707][52670] Sum rewards: 89.052, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.020', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.099', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '72.000'} [2024-08-06 03:46:21,145][52795] DAMAGECOUNT value on done: 407248.0 [2024-08-06 03:46:21,146][52795] Sum rewards: 77.856, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'weapon4': '0.154', 'AMMO3': '0.155', 'weapon2': '0.798', 'WEAPON3': '0.950', 'weapon3': '2.770', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '60.500'} [2024-08-06 03:46:22,487][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:46:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 395968512. Throughput: 0: 4374.7. Samples: 98996430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:46:22,794][52567] Avg episode reward: [(0, '68.613')] [2024-08-06 03:46:22,928][52664] DAMAGECOUNT value on done: 469463.0 [2024-08-06 03:46:22,932][52664] Sum rewards: 54.549, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.972', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.152', 'weapon5': '0.176', 'AMMO3': '0.209', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.246', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '44.000'} [2024-08-06 03:46:23,044][52647] DAMAGECOUNT value on done: 464359.0 [2024-08-06 03:46:23,046][52647] Sum rewards: 64.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:23,349][52666] DAMAGECOUNT value on done: 440997.0 [2024-08-06 03:46:23,351][52666] Sum rewards: 68.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.214', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.112', 'AMMO4': '0.117', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:23,460][52663] DAMAGECOUNT value on done: 446986.0 [2024-08-06 03:46:23,460][52663] Sum rewards: 67.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.823', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon2': '0.136', 'AMMO4': '0.172', 'weapon5': '0.188', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.402', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '55.000'} [2024-08-06 03:46:23,497][52670] DAMAGECOUNT value on done: 439619.0 [2024-08-06 03:46:23,498][52670] Sum rewards: 70.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.440', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO4': '0.136', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '57.000'} [2024-08-06 03:46:24,338][52795] DAMAGECOUNT value on done: 413987.0 [2024-08-06 03:46:24,339][52795] Sum rewards: 69.173, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.932', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.151', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.328', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:24,880][52650] Updated weights for policy 0, policy_version 48341 (0.0013) [2024-08-06 03:46:25,867][52664] DAMAGECOUNT value on done: 463939.0 [2024-08-06 03:46:25,868][52664] Sum rewards: 76.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.714', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.266', 'weapon5': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '63.500'} [2024-08-06 03:46:26,031][52647] DAMAGECOUNT value on done: 476639.0 [2024-08-06 03:46:26,031][52647] Sum rewards: 60.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.322', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.158', 'weapon4': '0.184', 'AMMO4': '0.223', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.960', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '52.000'} [2024-08-06 03:46:26,144][52666] DAMAGECOUNT value on done: 435418.0 [2024-08-06 03:46:26,145][52666] Sum rewards: 82.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.880', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO4': '0.034', 'weapon5': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.370', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '68.000'} [2024-08-06 03:46:26,218][52670] DAMAGECOUNT value on done: 441473.0 [2024-08-06 03:46:26,218][52670] Sum rewards: 63.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.941', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.216', 'weapon4': '0.226', 'AMMO4': '0.247', 'weapon5': '0.336', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2024-08-06 03:46:26,531][52663] DAMAGECOUNT value on done: 452180.0 [2024-08-06 03:46:26,532][52663] Sum rewards: 65.206, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.283', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.178', 'weapon4': '0.220', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:27,513][52795] DAMAGECOUNT value on done: 420744.0 [2024-08-06 03:46:27,514][52795] Sum rewards: 68.044, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.000', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.126', 'weapon5': '0.156', 'weapon2': '0.192', 'AMMO3': '0.226', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.266', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 396058624. Throughput: 0: 4373.1. Samples: 99022710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:46:27,802][52567] Avg episode reward: [(0, '68.810')] [2024-08-06 03:46:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048347_396058624.pth... [2024-08-06 03:46:27,948][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000047834_391856128.pth [2024-08-06 03:46:29,031][52664] DAMAGECOUNT value on done: 473099.0 [2024-08-06 03:46:29,031][52664] Sum rewards: 76.918, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.730', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.170', 'AMMO4': '0.171', 'weapon2': '0.226', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:29,229][52647] DAMAGECOUNT value on done: 466795.0 [2024-08-06 03:46:29,229][52647] Sum rewards: 76.063, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.343', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.102', 'weapon4': '0.148', 'AMMO4': '0.155', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '65.500'} [2024-08-06 03:46:29,413][52663] DAMAGECOUNT value on done: 443642.0 [2024-08-06 03:46:29,413][52663] Sum rewards: 68.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.744', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.212', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:29,528][52650] Updated weights for policy 0, policy_version 48351 (0.0037) [2024-08-06 03:46:29,658][52666] DAMAGECOUNT value on done: 440760.0 [2024-08-06 03:46:29,659][52666] Sum rewards: 65.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.322', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.168', 'weapon5': '0.204', 'AMMO4': '0.272', 'weapon4': '0.328', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.670', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '54.000'} [2024-08-06 03:46:29,809][52670] DAMAGECOUNT value on done: 437478.0 [2024-08-06 03:46:29,810][52670] Sum rewards: 73.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon5': '0.180', 'AMMO4': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:29,812][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:46:30,670][52795] DAMAGECOUNT value on done: 414290.0 [2024-08-06 03:46:30,672][52795] Sum rewards: 69.220, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.710', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:32,245][52666] DAMAGECOUNT value on done: 438541.0 [2024-08-06 03:46:32,246][52666] Sum rewards: 63.197, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.172', 'weapon5': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '51.000'} [2024-08-06 03:46:32,283][52664] DAMAGECOUNT value on done: 466278.0 [2024-08-06 03:46:32,285][52664] Sum rewards: 74.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.006', 'AMMO4': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.219', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:32,320][52670] DAMAGECOUNT value on done: 444419.0 [2024-08-06 03:46:32,320][52670] Sum rewards: 72.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.479', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO4': '0.167', 'AMMO3': '0.228', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:32,348][52647] DAMAGECOUNT value on done: 469906.0 [2024-08-06 03:46:32,348][52647] Sum rewards: 60.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.160', 'weapon4': '0.172', 'AMMO4': '0.220', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '53.000'} [2024-08-06 03:46:32,696][52663] DAMAGECOUNT value on done: 439941.0 [2024-08-06 03:46:32,697][52663] Sum rewards: 77.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '64.000'} [2024-08-06 03:46:32,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 396148736. Throughput: 0: 4362.9. Samples: 99035600. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:46:32,795][52567] Avg episode reward: [(0, '68.916')] [2024-08-06 03:46:33,824][52795] DAMAGECOUNT value on done: 403917.0 [2024-08-06 03:46:33,824][52795] Sum rewards: 76.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.052', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'weapon3': '3.530', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:34,504][52650] Updated weights for policy 0, policy_version 48361 (0.0020) [2024-08-06 03:46:34,894][52666] DAMAGECOUNT value on done: 450401.0 [2024-08-06 03:46:34,894][52666] Sum rewards: 73.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.174', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:34,921][52670] DAMAGECOUNT value on done: 436405.0 [2024-08-06 03:46:34,921][52670] Sum rewards: 61.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.102', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.132', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.278', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '49.000'} [2024-08-06 03:46:35,106][52664] DAMAGECOUNT value on done: 468300.0 [2024-08-06 03:46:35,107][52664] Sum rewards: 76.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:35,305][52647] DAMAGECOUNT value on done: 463055.0 [2024-08-06 03:46:35,305][52647] Sum rewards: 70.742, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.626', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.145', 'WEAPON5': '0.200', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '3.090', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:35,366][52663] DAMAGECOUNT value on done: 439084.0 [2024-08-06 03:46:35,366][52663] Sum rewards: 61.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.286', 'AMMO5': '0.034', 'AMMO2': '0.075', 'AMMO3': '0.226', 'weapon2': '0.248', 'weapon5': '0.262', 'AMMO4': '0.375', 'weapon4': '0.448', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.400', 'weapon3': '2.670', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '52.500'} [2024-08-06 03:46:37,002][52795] DAMAGECOUNT value on done: 419678.0 [2024-08-06 03:46:37,006][52795] Sum rewards: 76.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.235', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.186', 'AMMO3': '0.265', 'weapon5': '0.286', 'AMMO4': '0.322', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.758', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '65.500'} [2024-08-06 03:46:37,481][52665] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 03:46:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 396230656. Throughput: 0: 4364.2. Samples: 99061780. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:46:37,794][52567] Avg episode reward: [(0, '69.535')] [2024-08-06 03:46:37,823][52663] DAMAGECOUNT value on done: 440254.0 [2024-08-06 03:46:37,825][52663] Sum rewards: 69.697, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.059', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.114', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '57.000'} [2024-08-06 03:46:38,058][52666] DAMAGECOUNT value on done: 445855.0 [2024-08-06 03:46:38,059][52666] Sum rewards: 63.743, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.254', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon5': '0.150', 'AMMO4': '0.202', 'AMMO3': '0.320', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.042', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:38,063][52670] DAMAGECOUNT value on done: 439169.0 [2024-08-06 03:46:38,066][52670] Sum rewards: 77.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.104', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon4': '0.176', 'AMMO3': '0.253', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:38,102][52664] DAMAGECOUNT value on done: 461514.0 [2024-08-06 03:46:38,103][52664] Sum rewards: 63.395, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.300', 'AMMO3': '0.313', 'WEAPON3': '1.800', 'HITCOUNT': '3.250', 'weapon3': '3.408', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:38,154][52647] DAMAGECOUNT value on done: 470209.0 [2024-08-06 03:46:38,154][52647] Sum rewards: 70.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.920', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:38,534][52667] DAMAGECOUNT value on done: 443289.0 [2024-08-06 03:46:38,534][52667] Sum rewards: 72.763, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.729', 'AMMO5': '0.023', 'AMMO2': '0.050', 'weapon4': '0.214', 'weapon5': '0.222', 'AMMO3': '0.224', 'AMMO4': '0.250', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.774', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:38,806][52650] Updated weights for policy 0, policy_version 48371 (0.0013) [2024-08-06 03:46:40,116][52795] DAMAGECOUNT value on done: 411688.0 [2024-08-06 03:46:40,116][52795] Sum rewards: 76.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.414', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:40,736][52664] DAMAGECOUNT value on done: 460939.0 [2024-08-06 03:46:40,736][52664] Sum rewards: 70.899, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.420', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.157', 'weapon4': '0.180', 'weapon5': '0.226', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.000', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 03:46:40,810][52670] DAMAGECOUNT value on done: 449347.0 [2024-08-06 03:46:40,813][52647] DAMAGECOUNT value on done: 466982.0 [2024-08-06 03:46:40,814][52670] Sum rewards: 72.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.666', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.096', 'AMMO3': '0.157', 'weapon5': '0.170', 'AMMO4': '0.245', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.088', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:40,814][52647] Sum rewards: 74.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.251', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.104', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:40,859][52666] DAMAGECOUNT value on done: 440861.0 [2024-08-06 03:46:40,861][52666] Sum rewards: 62.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.094', 'AMMO3': '0.172', 'AMMO4': '0.196', 'weapon4': '0.260', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '51.000'} [2024-08-06 03:46:40,998][52663] DAMAGECOUNT value on done: 450239.0 [2024-08-06 03:46:40,998][52663] Sum rewards: 76.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 03:46:41,834][52667] DAMAGECOUNT value on done: 452571.0 [2024-08-06 03:46:41,835][52667] Sum rewards: 66.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.084', 'weapon5': '0.102', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.308', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:42,794][52567] Fps is (10 sec: 16384.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 396312576. Throughput: 0: 4374.0. Samples: 99088390. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:46:42,794][52567] Avg episode reward: [(0, '69.987')] [2024-08-06 03:46:43,089][52664] DAMAGECOUNT value on done: 463979.0 [2024-08-06 03:46:43,090][52664] Sum rewards: 70.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.207', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon4': '0.280', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:43,094][52647] DAMAGECOUNT value on done: 476659.0 [2024-08-06 03:46:43,095][52647] Sum rewards: 78.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.154', 'AMMO3': '0.192', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.736', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '62.000'} [2024-08-06 03:46:43,308][52795] DAMAGECOUNT value on done: 409722.0 [2024-08-06 03:46:43,310][52795] Sum rewards: 61.826, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.409', 'AMMO5': '0.011', 'AMMO2': '0.041', 'AMMO3': '0.132', 'weapon5': '0.142', 'AMMO4': '0.203', 'weapon4': '0.258', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '2.860', 'weapon3': '3.064', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '48.000'} [2024-08-06 03:46:43,657][52650] Updated weights for policy 0, policy_version 48381 (0.0013) [2024-08-06 03:46:43,702][52663] DAMAGECOUNT value on done: 441456.0 [2024-08-06 03:46:43,704][52663] Sum rewards: 75.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.561', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.199', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:43,815][52670] DAMAGECOUNT value on done: 443124.0 [2024-08-06 03:46:43,818][52670] Sum rewards: 75.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.715', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.086', 'AMMO3': '0.147', 'weapon5': '0.202', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '0.950', 'weapon3': '3.102', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:43,846][52666] DAMAGECOUNT value on done: 441317.0 [2024-08-06 03:46:43,846][52666] Sum rewards: 63.866, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.094', 'WEAPON4': '0.150', 'weapon2': '0.162', 'weapon4': '0.164', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.428', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '53.000'} [2024-08-06 03:46:44,828][52667] DAMAGECOUNT value on done: 445543.0 [2024-08-06 03:46:44,828][52667] Sum rewards: 77.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.745', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.082', 'weapon5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:45,922][52647] DAMAGECOUNT value on done: 467896.0 [2024-08-06 03:46:45,923][52647] Sum rewards: 65.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.245', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.090', 'weapon5': '0.102', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.476', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '57.000'} [2024-08-06 03:46:45,950][52664] DAMAGECOUNT value on done: 461195.0 [2024-08-06 03:46:45,952][52664] Sum rewards: 72.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.098', 'AMMO3': '0.206', 'AMMO4': '0.220', 'weapon5': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.770', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '59.000'} [2024-08-06 03:46:46,287][52666] DAMAGECOUNT value on done: 443637.0 [2024-08-06 03:46:46,287][52666] Sum rewards: 63.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.170', 'AMMO4': '0.207', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '52.000'} [2024-08-06 03:46:46,312][52670] DAMAGECOUNT value on done: 428791.0 [2024-08-06 03:46:46,312][52670] Sum rewards: 74.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.228', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '64.000'} [2024-08-06 03:46:46,484][52795] DAMAGECOUNT value on done: 407218.0 [2024-08-06 03:46:46,485][52795] Sum rewards: 81.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.155', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.105', 'weapon4': '0.146', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '69.000'} [2024-08-06 03:46:46,765][52663] DAMAGECOUNT value on done: 448691.0 [2024-08-06 03:46:46,765][52663] Sum rewards: 64.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.874', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.142', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO4': '0.233', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.156', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 03:46:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 396410880. Throughput: 0: 4369.3. Samples: 99101570. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:46:47,794][52567] Avg episode reward: [(0, '70.515')] [2024-08-06 03:46:47,964][52667] DAMAGECOUNT value on done: 445925.0 [2024-08-06 03:46:47,966][52667] Sum rewards: 56.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.323', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.116', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.254', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '49.500'} [2024-08-06 03:46:48,435][52650] Updated weights for policy 0, policy_version 48391 (0.0012) [2024-08-06 03:46:48,691][52647] DAMAGECOUNT value on done: 463039.0 [2024-08-06 03:46:48,691][52647] Sum rewards: 69.123, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.919', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO3': '0.097', 'AMMO4': '0.143', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.556', 'WEAPON3': '0.650', 'weapon3': '2.710', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '52.000'} [2024-08-06 03:46:48,723][52664] DAMAGECOUNT value on done: 461804.0 [2024-08-06 03:46:48,723][52664] Sum rewards: 70.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.367', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.141', 'weapon5': '0.196', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:49,002][52666] DAMAGECOUNT value on done: 445187.0 [2024-08-06 03:46:49,005][52666] Sum rewards: 68.801, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.310', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:49,046][52670] DAMAGECOUNT value on done: 439826.0 [2024-08-06 03:46:49,046][52670] Sum rewards: 55.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.668', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.199', 'weapon5': '0.246', 'AMMO4': '0.314', 'weapon2': '0.340', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '46.000'} [2024-08-06 03:46:49,610][52795] DAMAGECOUNT value on done: 415511.0 [2024-08-06 03:46:49,611][52795] Sum rewards: 68.946, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.450', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.162', 'weapon2': '0.278', 'WEAPON5': '0.300', 'AMMO3': '0.344', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '2.000', 'weapon3': '2.892', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:49,809][52663] DAMAGECOUNT value on done: 446279.0 [2024-08-06 03:46:49,811][52663] Sum rewards: 77.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.500', 'AMMO5': '0.006', 'weapon4': '0.010', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'weapon2': '0.284', 'AMMO3': '0.298', 'WEAPON3': '1.900', 'weapon3': '3.350', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '68.000'} [2024-08-06 03:46:50,051][52670] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.045, -15.0), ('weapon5', 0.002)] [2024-08-06 03:46:50,748][52667] DAMAGECOUNT value on done: 453278.0 [2024-08-06 03:46:50,749][52667] Sum rewards: 69.192, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.866', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.088', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.281', 'WEAPON3': '1.750', 'HITCOUNT': '3.300', 'weapon3': '3.370', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '62.000'} [2024-08-06 03:46:51,499][52647] DAMAGECOUNT value on done: 466821.0 [2024-08-06 03:46:51,500][52647] Sum rewards: 71.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.116', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.106', 'weapon5': '0.108', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'weapon3': '3.314', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:51,736][52666] DAMAGECOUNT value on done: 433258.0 [2024-08-06 03:46:51,737][52666] Sum rewards: 70.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.168', 'weapon5': '0.180', 'AMMO4': '0.193', 'AMMO3': '0.256', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:51,917][52670] DAMAGECOUNT value on done: 450354.0 [2024-08-06 03:46:51,918][52670] Sum rewards: 67.396, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.096', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '0.900', 'HITCOUNT': '3.020', 'weapon3': '3.222', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '51.000'} [2024-08-06 03:46:52,388][52663] DAMAGECOUNT value on done: 439678.0 [2024-08-06 03:46:52,390][52663] Sum rewards: 75.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.279', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.168', 'AMMO4': '0.187', 'weapon5': '0.294', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.740', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '58.500'} [2024-08-06 03:46:52,470][52811] Large shaping reward 2.579 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.528, 176.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:46:52,541][52650] Updated weights for policy 0, policy_version 48401 (0.0016) [2024-08-06 03:46:52,610][52795] DAMAGECOUNT value on done: 405246.0 [2024-08-06 03:46:52,612][52795] Sum rewards: 74.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.262', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.022', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:52,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 396500992. Throughput: 0: 4376.2. Samples: 99127890. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:46:52,794][52567] Avg episode reward: [(0, '70.240')] [2024-08-06 03:46:53,387][52820] DAMAGECOUNT value on done: 410545.0 [2024-08-06 03:46:53,389][52820] Sum rewards: 82.101, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.784', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.150', 'AMMO4': '0.173', 'weapon5': '0.200', 'weapon2': '0.246', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.076', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.979', 'FRAGCOUNT': '70.000'} [2024-08-06 03:46:54,093][52647] DAMAGECOUNT value on done: 464971.0 [2024-08-06 03:46:54,094][52647] Sum rewards: 71.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.539', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.122', 'weapon4': '0.138', 'weapon2': '0.236', 'AMMO4': '0.252', 'AMMO3': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.256', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '61.000'} [2024-08-06 03:46:54,136][52667] DAMAGECOUNT value on done: 454897.0 [2024-08-06 03:46:54,138][52667] Sum rewards: 61.900, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.066', 'AMMO4': '0.117', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.456', 'WEAPON3': '0.900', 'weapon3': '3.114', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '49.000'} [2024-08-06 03:46:54,209][52666] DAMAGECOUNT value on done: 440852.0 [2024-08-06 03:46:54,211][52666] Sum rewards: 72.246, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.734', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.120', 'weapon5': '0.150', 'AMMO4': '0.187', 'weapon2': '0.252', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.194', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '63.000'} [2024-08-06 03:46:54,281][52670] DAMAGECOUNT value on done: 441637.0 [2024-08-06 03:46:54,283][52670] Sum rewards: 78.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.132', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '65.000'} [2024-08-06 03:46:55,806][52795] DAMAGECOUNT value on done: 423664.0 [2024-08-06 03:46:55,807][52795] Sum rewards: 77.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.391', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.155', 'weapon5': '0.168', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '64.000'} [2024-08-06 03:46:56,510][52820] DAMAGECOUNT value on done: 413703.0 [2024-08-06 03:46:56,512][52820] Sum rewards: 72.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.214', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.082', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '62.000'} [2024-08-06 03:46:56,990][52670] DAMAGECOUNT value on done: 444426.0 [2024-08-06 03:46:56,992][52670] Sum rewards: 78.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.671', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.052', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.366', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '67.000'} [2024-08-06 03:46:57,113][52647] DAMAGECOUNT value on done: 467661.0 [2024-08-06 03:46:57,114][52647] Sum rewards: 74.344, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.564', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.134', 'weapon4': '0.158', 'AMMO4': '0.197', 'weapon2': '0.300', 'AMMO3': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.106', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '65.500'} [2024-08-06 03:46:57,170][52667] DAMAGECOUNT value on done: 448607.0 [2024-08-06 03:46:57,171][52667] Sum rewards: 68.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.108', 'weapon5': '0.112', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.284', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '60.000'} [2024-08-06 03:46:57,235][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:46:57,516][52650] Updated weights for policy 0, policy_version 48411 (0.0021) [2024-08-06 03:46:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 396582912. Throughput: 0: 4379.8. Samples: 99153940. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:46:57,795][52567] Avg episode reward: [(0, '70.956')] [2024-08-06 03:46:58,915][52795] DAMAGECOUNT value on done: 415266.0 [2024-08-06 03:46:58,915][52795] Sum rewards: 68.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.154', 'weapon2': '0.192', 'AMMO3': '0.249', 'AMMO4': '0.285', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.956', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '58.000'} [2024-08-06 03:46:59,683][52820] DAMAGECOUNT value on done: 414019.0 [2024-08-06 03:46:59,683][52820] Sum rewards: 79.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.563', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.079', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '66.000'} [2024-08-06 03:46:59,892][52667] DAMAGECOUNT value on done: 447785.0 [2024-08-06 03:46:59,893][52667] Sum rewards: 78.805, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.588', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.108', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.618', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '64.000'} [2024-08-06 03:46:59,999][52669] DAMAGECOUNT value on done: 451684.0 [2024-08-06 03:47:00,003][52669] Sum rewards: 69.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.996', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO3': '0.199', 'AMMO4': '0.204', 'weapon4': '0.260', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '58.000'} [2024-08-06 03:47:01,995][52795] DAMAGECOUNT value on done: 406393.0 [2024-08-06 03:47:02,003][52795] Sum rewards: 69.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.214', 'weapon5': '0.228', 'weapon2': '0.232', 'AMMO4': '0.273', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:02,580][52650] Updated weights for policy 0, policy_version 48421 (0.0039) [2024-08-06 03:47:02,705][52667] DAMAGECOUNT value on done: 451230.0 [2024-08-06 03:47:02,706][52667] Sum rewards: 81.737, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.631', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.098', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '66.000'} [2024-08-06 03:47:02,733][52669] DAMAGECOUNT value on done: 441121.0 [2024-08-06 03:47:02,734][52669] Sum rewards: 65.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.140', 'weapon5': '0.154', 'AMMO3': '0.222', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.054', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 396664832. Throughput: 0: 4380.4. Samples: 99167110. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:47:02,795][52567] Avg episode reward: [(0, '71.263')] [2024-08-06 03:47:02,966][52820] DAMAGECOUNT value on done: 408467.0 [2024-08-06 03:47:02,967][52820] Sum rewards: 74.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.250', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.212', 'weapon2': '0.264', 'weapon4': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '64.000'} [2024-08-06 03:47:05,049][52795] DAMAGECOUNT value on done: 415615.0 [2024-08-06 03:47:05,050][52795] Sum rewards: 73.261, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.108', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.191', 'weapon2': '0.280', 'AMMO3': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.188', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '64.000'} [2024-08-06 03:47:05,311][52667] DAMAGECOUNT value on done: 456880.0 [2024-08-06 03:47:05,313][52667] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.064', 'weapon5': '0.194', 'AMMO3': '0.249', 'AMMO4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:06,077][52820] DAMAGECOUNT value on done: 417418.0 [2024-08-06 03:47:06,080][52820] Sum rewards: 68.845, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.110', 'weapon5': '0.140', 'AMMO4': '0.169', 'AMMO3': '0.235', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:06,202][52669] DAMAGECOUNT value on done: 450018.0 [2024-08-06 03:47:06,202][52669] Sum rewards: 66.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.462', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.176', 'AMMO3': '0.190', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.052', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '53.000'} [2024-08-06 03:47:06,730][52650] Updated weights for policy 0, policy_version 48431 (0.0025) [2024-08-06 03:47:07,052][52668] DAMAGECOUNT value on done: 446784.0 [2024-08-06 03:47:07,060][52668] Sum rewards: 70.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.958', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO4': '0.137', 'weapon5': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 396754944. Throughput: 0: 4375.1. Samples: 99193310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 03:47:07,794][52567] Avg episode reward: [(0, '71.015')] [2024-08-06 03:47:08,042][52795] DAMAGECOUNT value on done: 417925.0 [2024-08-06 03:47:08,042][52795] Sum rewards: 65.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.116', 'AMMO3': '0.229', 'AMMO4': '0.229', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:08,171][52667] DAMAGECOUNT value on done: 443584.0 [2024-08-06 03:47:08,171][52667] Sum rewards: 69.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.144', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.948', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:08,754][52669] DAMAGECOUNT value on done: 445874.0 [2024-08-06 03:47:08,755][52669] Sum rewards: 63.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.866', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '52.000'} [2024-08-06 03:47:09,233][52820] DAMAGECOUNT value on done: 407660.0 [2024-08-06 03:47:09,233][52820] Sum rewards: 73.219, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.630', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.172', 'AMMO3': '0.174', 'weapon4': '0.216', 'AMMO4': '0.223', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:09,379][52614] Signal inference workers to stop experience collection... (8800 times) [2024-08-06 03:47:09,381][52614] Signal inference workers to resume experience collection... (8800 times) [2024-08-06 03:47:09,431][52650] InferenceWorker_p0-w0: stopping experience collection (8800 times) [2024-08-06 03:47:09,445][52650] InferenceWorker_p0-w0: resuming experience collection (8800 times) [2024-08-06 03:47:09,956][52668] DAMAGECOUNT value on done: 450215.0 [2024-08-06 03:47:09,958][52668] Sum rewards: 64.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.058', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.256', 'AMMO3': '0.268', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:11,145][52667] DAMAGECOUNT value on done: 446524.0 [2024-08-06 03:47:11,146][52667] Sum rewards: 65.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.571', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.120', 'weapon4': '0.142', 'AMMO4': '0.174', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.308', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:11,779][52650] Updated weights for policy 0, policy_version 48441 (0.0013) [2024-08-06 03:47:11,938][52669] DAMAGECOUNT value on done: 446591.0 [2024-08-06 03:47:11,944][52669] Sum rewards: 56.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.916', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.024', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.176', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.016', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '47.000'} [2024-08-06 03:47:12,347][52820] DAMAGECOUNT value on done: 411919.0 [2024-08-06 03:47:12,357][52820] Sum rewards: 79.923, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.398', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.128', 'weapon5': '0.162', 'AMMO4': '0.234', 'AMMO3': '0.251', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '66.000'} [2024-08-06 03:47:12,602][52668] DAMAGECOUNT value on done: 450988.0 [2024-08-06 03:47:12,602][52668] Sum rewards: 73.427, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.339', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.242', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '58.000'} [2024-08-06 03:47:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 396845056. Throughput: 0: 4378.0. Samples: 99219720. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:12,794][52567] Avg episode reward: [(0, '70.545')] [2024-08-06 03:47:13,721][52667] DAMAGECOUNT value on done: 451465.0 [2024-08-06 03:47:13,721][52667] Sum rewards: 68.654, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.675', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.112', 'weapon2': '0.216', 'weapon5': '0.252', 'AMMO3': '0.269', 'AMMO4': '0.319', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '3.060', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:15,160][52669] DAMAGECOUNT value on done: 452469.0 [2024-08-06 03:47:15,160][52669] Sum rewards: 65.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.044', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.098', 'AMMO4': '0.118', 'weapon5': '0.128', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.218', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '54.500'} [2024-08-06 03:47:15,439][52820] DAMAGECOUNT value on done: 416855.0 [2024-08-06 03:47:15,443][52820] Sum rewards: 68.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.075', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:15,581][52668] DAMAGECOUNT value on done: 452965.0 [2024-08-06 03:47:15,581][52668] Sum rewards: 83.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.609', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.164', 'AMMO4': '0.199', 'weapon2': '0.202', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '68.500'} [2024-08-06 03:47:15,801][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:47:16,284][52650] Updated weights for policy 0, policy_version 48451 (0.0022) [2024-08-06 03:47:16,411][52667] DAMAGECOUNT value on done: 445101.0 [2024-08-06 03:47:16,412][52667] Sum rewards: 77.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.094', 'AMMO4': '0.141', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.334', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '63.000'} [2024-08-06 03:47:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 396935168. Throughput: 0: 4386.7. Samples: 99233000. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:17,802][52567] Avg episode reward: [(0, '70.780')] [2024-08-06 03:47:17,990][52669] DAMAGECOUNT value on done: 447663.0 [2024-08-06 03:47:17,990][52669] Sum rewards: 76.418, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.496', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.210', 'AMMO3': '0.227', 'AMMO4': '0.247', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 03:47:18,533][52668] DAMAGECOUNT value on done: 440514.0 [2024-08-06 03:47:18,535][52668] Sum rewards: 67.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.556', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.074', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '58.000'} [2024-08-06 03:47:18,613][52662] DAMAGECOUNT value on done: 451985.0 [2024-08-06 03:47:18,614][52662] Sum rewards: 65.976, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.115', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.070', 'weapon5': '0.094', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'weapon2': '1.140', 'weapon3': '2.512', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '51.000'} [2024-08-06 03:47:18,697][52820] DAMAGECOUNT value on done: 411674.0 [2024-08-06 03:47:18,697][52820] Sum rewards: 63.353, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.638', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon5': '0.272', 'weapon2': '0.308', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.136', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '54.000'} [2024-08-06 03:47:19,584][52667] DAMAGECOUNT value on done: 451686.0 [2024-08-06 03:47:19,585][52667] Sum rewards: 76.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.944', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.184', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'weapon4': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '62.000'} [2024-08-06 03:47:20,711][52650] Updated weights for policy 0, policy_version 48461 (0.0017) [2024-08-06 03:47:20,762][52669] DAMAGECOUNT value on done: 449457.0 [2024-08-06 03:47:20,762][52669] Sum rewards: 72.035, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.996', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon5': '0.224', 'weapon4': '0.232', 'AMMO3': '0.262', 'AMMO4': '0.284', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.680', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:21,364][52668] DAMAGECOUNT value on done: 450769.0 [2024-08-06 03:47:21,365][52668] Sum rewards: 72.739, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.410', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.410', 'WEAPON3': '0.850', 'weapon3': '2.962', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:21,595][52662] DAMAGECOUNT value on done: 454834.0 [2024-08-06 03:47:21,595][52662] Sum rewards: 72.120, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.929', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO4': '0.153', 'weapon2': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '60.500'} [2024-08-06 03:47:21,651][52820] DAMAGECOUNT value on done: 420794.0 [2024-08-06 03:47:21,651][52820] Sum rewards: 69.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.270', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.290', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:22,652][52667] DAMAGECOUNT value on done: 457746.0 [2024-08-06 03:47:22,653][52667] Sum rewards: 68.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.477', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.197', 'weapon2': '0.402', 'WEAPON3': '1.250', 'HITCOUNT': '3.370', 'weapon3': '3.462', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 397025280. Throughput: 0: 4395.6. Samples: 99259580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:22,794][52567] Avg episode reward: [(0, '70.796')] [2024-08-06 03:47:23,855][52669] DAMAGECOUNT value on done: 452833.0 [2024-08-06 03:47:23,856][52669] Sum rewards: 71.692, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.159', 'weapon2': '0.164', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'HEALTH': '0.630', 'WEAPON3': '1.050', 'weapon3': '3.242', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:24,043][52668] DAMAGECOUNT value on done: 451995.0 [2024-08-06 03:47:24,045][52668] Sum rewards: 61.886, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.939', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.144', 'AMMO3': '0.218', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '54.000'} [2024-08-06 03:47:24,759][52662] DAMAGECOUNT value on done: 453656.0 [2024-08-06 03:47:24,759][52662] Sum rewards: 82.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.555', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.318', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '70.000'} [2024-08-06 03:47:24,791][52820] DAMAGECOUNT value on done: 411301.0 [2024-08-06 03:47:24,792][52820] Sum rewards: 62.829, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.785', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.197', 'weapon4': '0.226', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '53.000'} [2024-08-06 03:47:25,743][52667] DAMAGECOUNT value on done: 455274.0 [2024-08-06 03:47:25,744][52667] Sum rewards: 69.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.078', 'AMMO4': '0.123', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:25,793][52650] Updated weights for policy 0, policy_version 48471 (0.0013) [2024-08-06 03:47:26,734][52669] DAMAGECOUNT value on done: 446971.0 [2024-08-06 03:47:26,735][52669] Sum rewards: 53.240, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.184', 'weapon4': '0.186', 'AMMO4': '0.195', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.746', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '46.000'} [2024-08-06 03:47:27,080][52668] DAMAGECOUNT value on done: 443875.0 [2024-08-06 03:47:27,081][52668] Sum rewards: 70.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon2': '0.244', 'AMMO3': '0.286', 'WEAPON3': '1.800', 'HITCOUNT': '3.330', 'weapon3': '3.458', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '62.000'} [2024-08-06 03:47:27,196][52671] DAMAGECOUNT value on done: 452169.0 [2024-08-06 03:47:27,224][52671] Sum rewards: 72.578, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.376', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.324', 'weapon2': '0.516', 'WEAPON3': '1.950', 'weapon3': '2.952', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '67.000'} [2024-08-06 03:47:27,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 397107200. Throughput: 0: 4385.8. Samples: 99285750. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:27,802][52567] Avg episode reward: [(0, '70.579')] [2024-08-06 03:47:27,965][52662] DAMAGECOUNT value on done: 443057.0 [2024-08-06 03:47:27,971][52662] Sum rewards: 61.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.023', 'AMMO2': '0.058', 'AMMO3': '0.205', 'weapon5': '0.242', 'weapon4': '0.290', 'AMMO4': '0.291', 'weapon2': '0.314', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2024-08-06 03:47:28,032][52820] DAMAGECOUNT value on done: 415605.0 [2024-08-06 03:47:28,034][52820] Sum rewards: 60.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.864', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.172', 'weapon5': '0.212', 'AMMO3': '0.248', 'AMMO4': '0.249', 'weapon2': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.026', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '52.000'} [2024-08-06 03:47:28,860][52667] DAMAGECOUNT value on done: 454091.0 [2024-08-06 03:47:28,861][52667] Sum rewards: 72.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.102', 'weapon4': '0.128', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.240', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:29,251][52669] DAMAGECOUNT value on done: 453880.0 [2024-08-06 03:47:29,252][52669] Sum rewards: 73.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.480', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.108', 'weapon4': '0.132', 'AMMO4': '0.170', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:29,687][52660] DAMAGECOUNT value on done: 446797.0 [2024-08-06 03:47:29,687][52660] Sum rewards: 83.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.213', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '69.000'} [2024-08-06 03:47:29,992][52671] DAMAGECOUNT value on done: 453233.0 [2024-08-06 03:47:29,995][52671] Sum rewards: 78.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.118', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.092', 'AMMO4': '0.189', 'AMMO3': '0.210', 'weapon5': '0.216', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '63.000'} [2024-08-06 03:47:30,043][52650] Updated weights for policy 0, policy_version 48481 (0.0012) [2024-08-06 03:47:30,165][52668] DAMAGECOUNT value on done: 445284.0 [2024-08-06 03:47:30,165][52668] Sum rewards: 71.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.746', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.092', 'weapon4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:30,922][52662] DAMAGECOUNT value on done: 454018.0 [2024-08-06 03:47:30,925][52662] Sum rewards: 77.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.295', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.166', 'AMMO4': '0.199', 'AMMO3': '0.200', 'weapon2': '0.262', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '65.000'} [2024-08-06 03:47:31,015][52820] DAMAGECOUNT value on done: 419226.0 [2024-08-06 03:47:31,016][52820] Sum rewards: 76.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.188', 'AMMO2': '0.014', 'AMMO4': '0.071', 'AMMO3': '0.230', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.342', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '64.000'} [2024-08-06 03:47:31,889][52669] DAMAGECOUNT value on done: 450627.0 [2024-08-06 03:47:31,889][52669] Sum rewards: 66.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.580', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.098', 'AMMO4': '0.152', 'AMMO3': '0.273', 'weapon5': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.700', 'weapon3': '2.922', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '58.000'} [2024-08-06 03:47:32,177][52667] DAMAGECOUNT value on done: 447272.0 [2024-08-06 03:47:32,178][52667] Sum rewards: 67.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.875', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.048', 'weapon4': '0.118', 'AMMO4': '0.133', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 397197312. Throughput: 0: 4386.9. Samples: 99298980. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:32,794][52567] Avg episode reward: [(0, '70.844')] [2024-08-06 03:47:32,841][52660] DAMAGECOUNT value on done: 441602.0 [2024-08-06 03:47:32,842][52660] Sum rewards: 85.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.457', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.448', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '72.000'} [2024-08-06 03:47:32,992][52671] DAMAGECOUNT value on done: 451953.0 [2024-08-06 03:47:32,992][52671] Sum rewards: 57.212, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.560', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.142', 'weapon4': '0.170', 'AMMO4': '0.203', 'AMMO3': '0.288', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.086', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '50.500'} [2024-08-06 03:47:33,292][52668] DAMAGECOUNT value on done: 451986.0 [2024-08-06 03:47:33,294][52668] Sum rewards: 56.136, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.820', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.300', 'AMMO3': '0.305', 'weapon2': '0.432', 'WEAPON3': '1.700', 'weapon3': '2.910', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '51.000'} [2024-08-06 03:47:33,712][52662] DAMAGECOUNT value on done: 447316.0 [2024-08-06 03:47:33,712][52662] Sum rewards: 75.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.097', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '62.000'} [2024-08-06 03:47:33,824][52662] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:47:34,177][52820] DAMAGECOUNT value on done: 415224.0 [2024-08-06 03:47:34,178][52820] Sum rewards: 71.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.832', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.149', 'weapon5': '0.180', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:34,769][52669] DAMAGECOUNT value on done: 439793.0 [2024-08-06 03:47:34,772][52669] Sum rewards: 66.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.050', 'weapon5': '0.144', 'AMMO4': '0.209', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '55.000'} [2024-08-06 03:47:35,108][52650] Updated weights for policy 0, policy_version 48491 (0.0024) [2024-08-06 03:47:35,216][52667] DAMAGECOUNT value on done: 454698.0 [2024-08-06 03:47:35,217][52667] Sum rewards: 67.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.735', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.073', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.224', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.470', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:35,665][52671] DAMAGECOUNT value on done: 450012.0 [2024-08-06 03:47:35,665][52671] Sum rewards: 66.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.718', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.188', 'AMMO4': '0.213', 'weapon2': '0.224', 'weapon5': '0.282', 'weapon4': '0.298', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '55.000'} [2024-08-06 03:47:36,157][52662] DAMAGECOUNT value on done: 456936.0 [2024-08-06 03:47:36,159][52662] Sum rewards: 74.178, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.306', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.116', 'AMMO4': '0.159', 'weapon5': '0.198', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '62.000'} [2024-08-06 03:47:36,166][52660] DAMAGECOUNT value on done: 451481.0 [2024-08-06 03:47:36,166][52660] Sum rewards: 74.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.226', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.072', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.192', 'WEAPON3': '1.100', 'HITCOUNT': '3.330', 'weapon3': '3.482', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 03:47:36,363][52658] DAMAGECOUNT value on done: 446395.0 [2024-08-06 03:47:36,366][52658] Sum rewards: 71.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:36,561][52668] DAMAGECOUNT value on done: 448713.0 [2024-08-06 03:47:36,561][52668] Sum rewards: 65.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.968', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.120', 'AMMO4': '0.219', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.224', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:37,325][52820] DAMAGECOUNT value on done: 420039.0 [2024-08-06 03:47:37,326][52820] Sum rewards: 66.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.194', 'AMMO3': '0.241', 'AMMO4': '0.307', 'weapon4': '0.392', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.674', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:37,527][52669] DAMAGECOUNT value on done: 452505.0 [2024-08-06 03:47:37,529][52669] Sum rewards: 77.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.156', 'AMMO4': '0.171', 'weapon5': '0.194', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '64.000'} [2024-08-06 03:47:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 397279232. Throughput: 0: 4386.6. Samples: 99325290. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:37,795][52567] Avg episode reward: [(0, '70.643')] [2024-08-06 03:47:38,416][52671] DAMAGECOUNT value on done: 458537.0 [2024-08-06 03:47:38,419][52671] Sum rewards: 68.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.418', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.214', 'AMMO3': '0.227', 'weapon2': '0.238', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '59.500'} [2024-08-06 03:47:38,932][52665] DAMAGECOUNT value on done: 439451.0 [2024-08-06 03:47:38,932][52665] Sum rewards: 60.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.065', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.082', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.416', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.220', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '50.000'} [2024-08-06 03:47:38,984][52660] DAMAGECOUNT value on done: 454804.0 [2024-08-06 03:47:38,984][52660] Sum rewards: 67.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.604', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.122', 'AMMO4': '0.196', 'AMMO3': '0.210', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.320', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:39,032][52662] DAMAGECOUNT value on done: 459867.0 [2024-08-06 03:47:39,032][52662] Sum rewards: 81.374, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.034', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.124', 'weapon5': '0.158', 'AMMO3': '0.169', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '3.018', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '65.000'} [2024-08-06 03:47:39,033][52658] DAMAGECOUNT value on done: 449424.0 [2024-08-06 03:47:39,036][52658] Sum rewards: 64.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.721', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.170', 'AMMO3': '0.176', 'weapon5': '0.210', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '2.920', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '52.500'} [2024-08-06 03:47:39,417][52668] DAMAGECOUNT value on done: 443400.0 [2024-08-06 03:47:39,418][52668] Sum rewards: 71.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.496', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.168', 'weapon4': '0.212', 'AMMO3': '0.246', 'weapon2': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:39,684][52650] Updated weights for policy 0, policy_version 48501 (0.0011) [2024-08-06 03:47:40,553][52820] DAMAGECOUNT value on done: 413858.0 [2024-08-06 03:47:40,554][52820] Sum rewards: 61.319, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'weapon2': '0.498', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '53.000'} [2024-08-06 03:47:40,682][52669] DAMAGECOUNT value on done: 453700.0 [2024-08-06 03:47:40,682][52669] Sum rewards: 62.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.536', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.162', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2024-08-06 03:47:41,536][52658] DAMAGECOUNT value on done: 453760.0 [2024-08-06 03:47:41,537][52658] Sum rewards: 66.933, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.224', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:41,545][52671] DAMAGECOUNT value on done: 449276.0 [2024-08-06 03:47:41,546][52671] Sum rewards: 67.480, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.437', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.134', 'WEAPON5': '0.200', 'weapon2': '0.772', 'WEAPON3': '0.900', 'weapon3': '3.026', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '52.000'} [2024-08-06 03:47:41,579][52660] DAMAGECOUNT value on done: 447561.0 [2024-08-06 03:47:41,582][52660] Sum rewards: 61.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.916', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO4': '0.194', 'AMMO3': '0.195', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '51.500'} [2024-08-06 03:47:42,024][52665] DAMAGECOUNT value on done: 448909.0 [2024-08-06 03:47:42,026][52665] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-15.750', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.230', 'AMMO4': '0.256', 'weapon5': '0.280', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.438', 'HEALTH': '0.922', 'WEAPON3': '1.200', 'weapon3': '2.444', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.500'} [2024-08-06 03:47:42,164][52662] DAMAGECOUNT value on done: 446716.0 [2024-08-06 03:47:42,166][52662] Sum rewards: 66.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.444', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:42,222][52668] DAMAGECOUNT value on done: 439090.0 [2024-08-06 03:47:42,225][52668] Sum rewards: 70.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.455', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:42,447][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:47:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 397369344. Throughput: 0: 4392.2. Samples: 99351590. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:42,794][52567] Avg episode reward: [(0, '70.313')] [2024-08-06 03:47:43,648][52820] DAMAGECOUNT value on done: 415145.0 [2024-08-06 03:47:43,651][52820] Sum rewards: 71.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO4': '0.219', 'AMMO3': '0.252', 'weapon5': '0.264', 'weapon2': '0.436', 'WEAPON5': '0.450', 'weapon4': '0.470', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.524', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '60.000'} [2024-08-06 03:47:44,193][52658] DAMAGECOUNT value on done: 451742.0 [2024-08-06 03:47:44,195][52658] Sum rewards: 84.449, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.864', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.174', 'AMMO3': '0.183', 'weapon5': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '68.000'} [2024-08-06 03:47:44,238][52669] DAMAGECOUNT value on done: 464097.0 [2024-08-06 03:47:44,238][52669] Sum rewards: 76.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon4': '0.148', 'AMMO3': '0.204', 'weapon5': '0.244', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '64.000'} [2024-08-06 03:47:44,320][52650] Updated weights for policy 0, policy_version 48511 (0.0024) [2024-08-06 03:47:44,662][52671] DAMAGECOUNT value on done: 455776.0 [2024-08-06 03:47:44,663][52671] Sum rewards: 57.770, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.185', 'weapon2': '0.696', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '49.000'} [2024-08-06 03:47:44,682][52660] DAMAGECOUNT value on done: 445856.0 [2024-08-06 03:47:44,682][52660] Sum rewards: 56.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.205', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.412', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.470', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '46.000'} [2024-08-06 03:47:45,180][52794] Large shaping reward 2.551 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.069, -23.0)] [2024-08-06 03:47:45,193][52662] DAMAGECOUNT value on done: 460035.0 [2024-08-06 03:47:45,196][52662] Sum rewards: 61.908, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.840', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.134', 'AMMO4': '0.196', 'weapon2': '0.228', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.060', 'weapon3': '3.292', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:45,225][52665] DAMAGECOUNT value on done: 445941.0 [2024-08-06 03:47:45,225][52665] Sum rewards: 66.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.111', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.086', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.316', 'ARMOR': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.202', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '58.000'} [2024-08-06 03:47:45,275][52668] DAMAGECOUNT value on done: 439013.0 [2024-08-06 03:47:45,275][52668] Sum rewards: 46.144, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO3': '0.149', 'AMMO4': '0.154', 'weapon5': '0.184', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '2.070', 'weapon3': '3.314', 'DAMAGECOUNT': '11.430', 'FRAGCOUNT': '36.000'} [2024-08-06 03:47:46,682][52820] DAMAGECOUNT value on done: 426162.0 [2024-08-06 03:47:46,683][52820] Sum rewards: 76.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.306', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.169', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.232', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:47,086][52669] DAMAGECOUNT value on done: 452359.0 [2024-08-06 03:47:47,086][52669] Sum rewards: 78.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.694', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.072', 'AMMO4': '0.141', 'weapon5': '0.142', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '65.000'} [2024-08-06 03:47:47,213][52658] DAMAGECOUNT value on done: 441206.0 [2024-08-06 03:47:47,215][52658] Sum rewards: 55.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.874', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.054', 'AMMO4': '0.119', 'weapon4': '0.172', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.322', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '48.000'} [2024-08-06 03:47:47,336][52671] DAMAGECOUNT value on done: 452523.0 [2024-08-06 03:47:47,337][52671] Sum rewards: 67.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.894', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.214', 'weapon2': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.446', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:47,794][52567] Fps is (10 sec: 18842.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 397467648. Throughput: 0: 4388.2. Samples: 99364580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:47,794][52567] Avg episode reward: [(0, '69.597')] [2024-08-06 03:47:47,854][52662] DAMAGECOUNT value on done: 446900.0 [2024-08-06 03:47:47,856][52662] Sum rewards: 65.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.888', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon4': '0.156', 'weapon5': '0.206', 'AMMO4': '0.241', 'AMMO3': '0.258', 'weapon2': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.910', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:47,908][52660] DAMAGECOUNT value on done: 446142.0 [2024-08-06 03:47:47,908][52660] Sum rewards: 54.601, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.013', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.098', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.259', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.070', 'weapon3': '3.246', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '48.000'} [2024-08-06 03:47:48,530][52668] DAMAGECOUNT value on done: 438506.0 [2024-08-06 03:47:48,530][52668] Sum rewards: 72.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.518', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.068', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.368', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.292', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '60.000'} [2024-08-06 03:47:48,711][52665] DAMAGECOUNT value on done: 442327.0 [2024-08-06 03:47:48,712][52665] Sum rewards: 58.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.712', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.118', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '50.000'} [2024-08-06 03:47:48,936][52650] Updated weights for policy 0, policy_version 48521 (0.0031) [2024-08-06 03:47:49,364][52669] DAMAGECOUNT value on done: 452940.0 [2024-08-06 03:47:49,364][52669] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.670', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.254', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.402', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '64.000'} [2024-08-06 03:47:49,677][52820] DAMAGECOUNT value on done: 426136.0 [2024-08-06 03:47:49,677][52820] Sum rewards: 67.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.058', 'weapon5': '0.106', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '56.000'} [2024-08-06 03:47:49,949][52658] DAMAGECOUNT value on done: 447764.0 [2024-08-06 03:47:49,951][52658] Sum rewards: 75.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.899', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.142', 'weapon4': '0.180', 'AMMO3': '0.190', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '63.000'} [2024-08-06 03:47:50,169][52671] DAMAGECOUNT value on done: 447438.0 [2024-08-06 03:47:50,171][52671] Sum rewards: 62.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.187', 'weapon4': '0.220', 'weapon5': '0.238', 'weapon2': '0.240', 'AMMO4': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.052', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '51.500'} [2024-08-06 03:47:50,688][52662] DAMAGECOUNT value on done: 451047.0 [2024-08-06 03:47:50,690][52662] Sum rewards: 72.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.599', 'AMMO5': '0.005', 'ARMOR': '0.028', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.474', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 03:47:50,991][52660] DAMAGECOUNT value on done: 452842.0 [2024-08-06 03:47:50,991][52660] Sum rewards: 64.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.648', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.690', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '53.500'} [2024-08-06 03:47:51,710][52665] DAMAGECOUNT value on done: 435054.0 [2024-08-06 03:47:51,713][52665] Sum rewards: 52.029, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.180', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.198', 'AMMO3': '0.237', 'weapon4': '0.332', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.091', 'FRAGCOUNT': '46.000'} [2024-08-06 03:47:51,854][52668] DAMAGECOUNT value on done: 446174.0 [2024-08-06 03:47:51,855][52668] Sum rewards: 72.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.296', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO4': '0.232', 'AMMO3': '0.235', 'weapon4': '0.258', 'weapon5': '0.266', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '62.000'} [2024-08-06 03:47:52,132][52669] DAMAGECOUNT value on done: 454293.0 [2024-08-06 03:47:52,132][52669] Sum rewards: 65.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '54.000'} [2024-08-06 03:47:52,496][52671] DAMAGECOUNT value on done: 455004.0 [2024-08-06 03:47:52,497][52671] Sum rewards: 72.613, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.020', 'AMMO2': '0.068', 'AMMO3': '0.236', 'weapon5': '0.292', 'weapon4': '0.336', 'AMMO4': '0.341', 'weapon2': '0.470', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.554', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 397549568. Throughput: 0: 4387.6. Samples: 99390750. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:52,794][52567] Avg episode reward: [(0, '68.598')] [2024-08-06 03:47:52,886][52820] DAMAGECOUNT value on done: 413184.0 [2024-08-06 03:47:52,889][52820] Sum rewards: 66.741, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.068', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.172', 'AMMO3': '0.183', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '53.000'} [2024-08-06 03:47:53,161][52658] DAMAGECOUNT value on done: 450655.0 [2024-08-06 03:47:53,162][52658] Sum rewards: 82.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.021', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.141', 'weapon4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '67.500'} [2024-08-06 03:47:53,765][52650] Updated weights for policy 0, policy_version 48531 (0.0015) [2024-08-06 03:47:53,786][52662] DAMAGECOUNT value on done: 449786.0 [2024-08-06 03:47:53,788][52662] Sum rewards: 69.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.176', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon5': '0.152', 'AMMO3': '0.157', 'weapon4': '0.180', 'weapon2': '0.212', 'AMMO4': '0.281', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '3.206', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:53,836][52660] DAMAGECOUNT value on done: 450602.0 [2024-08-06 03:47:53,836][52660] Sum rewards: 71.498, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.820', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.165', 'AMMO3': '0.252', 'weapon2': '0.266', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '60.000'} [2024-08-06 03:47:54,469][52668] DAMAGECOUNT value on done: 449196.0 [2024-08-06 03:47:54,481][52668] Sum rewards: 58.390, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.320', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.120', 'AMMO4': '0.160', 'weapon5': '0.204', 'AMMO3': '0.255', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.114', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '52.000'} [2024-08-06 03:47:54,743][52665] DAMAGECOUNT value on done: 437884.0 [2024-08-06 03:47:54,744][52665] Sum rewards: 66.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.339', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.203', 'weapon2': '0.448', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.308', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 03:47:55,242][52671] DAMAGECOUNT value on done: 458331.0 [2024-08-06 03:47:55,242][52671] Sum rewards: 74.566, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon2': '0.140', 'weapon5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.394', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2024-08-06 03:47:55,298][52669] DAMAGECOUNT value on done: 454564.0 [2024-08-06 03:47:55,299][52669] Sum rewards: 62.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.010', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.448', 'WEAPON3': '1.600', 'weapon3': '3.332', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '54.000'} [2024-08-06 03:47:55,977][52658] DAMAGECOUNT value on done: 443720.0 [2024-08-06 03:47:55,978][52658] Sum rewards: 63.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.106', 'weapon4': '0.144', 'AMMO3': '0.169', 'AMMO4': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.666', 'WEAPON3': '1.100', 'weapon3': '2.660', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '52.000'} [2024-08-06 03:47:56,565][52660] DAMAGECOUNT value on done: 444808.0 [2024-08-06 03:47:56,566][52660] Sum rewards: 71.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.380', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.092', 'weapon5': '0.094', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.386', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '58.000'} [2024-08-06 03:47:56,761][52662] DAMAGECOUNT value on done: 456142.0 [2024-08-06 03:47:56,763][52662] Sum rewards: 81.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.404', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '68.000'} [2024-08-06 03:47:57,037][52668] DAMAGECOUNT value on done: 447343.0 [2024-08-06 03:47:57,039][52668] Sum rewards: 69.484, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.690', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.094', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '59.000'} [2024-08-06 03:47:57,719][52665] DAMAGECOUNT value on done: 441677.0 [2024-08-06 03:47:57,737][52665] Sum rewards: 72.950, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.229', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.208', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.358', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 03:47:57,795][52567] Fps is (10 sec: 16383.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 397631488. Throughput: 0: 4384.6. Samples: 99417030. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:47:57,803][52567] Avg episode reward: [(0, '68.809')] [2024-08-06 03:47:58,330][52671] DAMAGECOUNT value on done: 450532.0 [2024-08-06 03:47:58,332][52671] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.026', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.708', 'WEAPON3': '0.900', 'weapon3': '2.976', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '54.000'} [2024-08-06 03:47:58,335][52650] Updated weights for policy 0, policy_version 48541 (0.0011) [2024-08-06 03:47:58,703][52658] DAMAGECOUNT value on done: 458222.0 [2024-08-06 03:47:58,703][52658] Sum rewards: 68.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.126', 'AMMO4': '0.191', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '57.000'} [2024-08-06 03:47:59,541][52660] DAMAGECOUNT value on done: 455643.0 [2024-08-06 03:47:59,541][52660] Sum rewards: 58.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.202', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.102', 'AMMO3': '0.212', 'AMMO4': '0.241', 'weapon5': '0.268', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '50.000'} [2024-08-06 03:47:59,605][52662] DAMAGECOUNT value on done: 449031.0 [2024-08-06 03:47:59,607][52662] Sum rewards: 64.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon5': '0.132', 'weapon4': '0.158', 'AMMO4': '0.159', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '53.000'} [2024-08-06 03:48:00,165][52668] DAMAGECOUNT value on done: 454241.0 [2024-08-06 03:48:00,167][52668] Sum rewards: 73.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.404', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:00,808][52665] DAMAGECOUNT value on done: 444236.0 [2024-08-06 03:48:00,808][52665] Sum rewards: 61.367, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon4': '0.214', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.450', 'weapon3': '2.724', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 03:48:01,159][52671] DAMAGECOUNT value on done: 457528.0 [2024-08-06 03:48:01,159][52671] Sum rewards: 68.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.444', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.084', 'weapon5': '0.140', 'AMMO4': '0.210', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '59.000'} [2024-08-06 03:48:01,671][52658] DAMAGECOUNT value on done: 448367.0 [2024-08-06 03:48:01,673][52658] Sum rewards: 63.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.098', 'weapon5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.198', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '53.000'} [2024-08-06 03:48:02,466][52662] DAMAGECOUNT value on done: 460155.0 [2024-08-06 03:48:02,468][52662] Sum rewards: 69.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.343', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.149', 'AMMO4': '0.193', 'weapon5': '0.280', 'weapon4': '0.306', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '56.000'} [2024-08-06 03:48:02,489][52660] DAMAGECOUNT value on done: 440655.0 [2024-08-06 03:48:02,489][52660] Sum rewards: 54.478, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.900', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon5': '0.200', 'AMMO3': '0.232', 'weapon4': '0.234', 'AMMO4': '0.247', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '49.000'} [2024-08-06 03:48:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 397721600. Throughput: 0: 4386.7. Samples: 99430400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:48:02,794][52567] Avg episode reward: [(0, '68.233')] [2024-08-06 03:48:02,898][52668] DAMAGECOUNT value on done: 445880.0 [2024-08-06 03:48:02,898][52668] Sum rewards: 71.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.122', 'weapon4': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.000'} [2024-08-06 03:48:03,026][52650] Updated weights for policy 0, policy_version 48551 (0.0019) [2024-08-06 03:48:03,714][52671] DAMAGECOUNT value on done: 449930.0 [2024-08-06 03:48:03,716][52671] Sum rewards: 73.052, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.667', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.130', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.282', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:03,968][52665] DAMAGECOUNT value on done: 449635.0 [2024-08-06 03:48:03,970][52665] Sum rewards: 76.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.360', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '65.000'} [2024-08-06 03:48:04,738][52658] DAMAGECOUNT value on done: 459393.0 [2024-08-06 03:48:04,738][52658] Sum rewards: 68.394, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.110', 'weapon4': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:05,296][52662] DAMAGECOUNT value on done: 455788.0 [2024-08-06 03:48:05,300][52662] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO3': '0.203', 'weapon2': '0.216', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.390', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:05,355][52660] DAMAGECOUNT value on done: 446200.0 [2024-08-06 03:48:05,356][52660] Sum rewards: 70.309, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.426', 'AMMO5': '0.025', 'AMMO2': '0.031', 'weapon4': '0.074', 'AMMO4': '0.156', 'weapon5': '0.184', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:06,150][52671] DAMAGECOUNT value on done: 441650.0 [2024-08-06 03:48:06,152][52671] Sum rewards: 71.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.102', 'weapon4': '0.122', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 03:48:06,950][52647] Large shaping reward 2.639 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:48:07,099][52665] DAMAGECOUNT value on done: 444271.0 [2024-08-06 03:48:07,099][52665] Sum rewards: 63.815, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.055', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.114', 'AMMO4': '0.168', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '51.000'} [2024-08-06 03:48:07,583][52650] Updated weights for policy 0, policy_version 48561 (0.0027) [2024-08-06 03:48:07,674][52658] DAMAGECOUNT value on done: 440670.0 [2024-08-06 03:48:07,675][52658] Sum rewards: 69.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.164', 'weapon5': '0.168', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.366', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '56.000'} [2024-08-06 03:48:07,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 397811712. Throughput: 0: 4377.1. Samples: 99456550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:48:07,794][52567] Avg episode reward: [(0, '68.282')] [2024-08-06 03:48:08,354][52660] DAMAGECOUNT value on done: 456762.0 [2024-08-06 03:48:08,355][52660] Sum rewards: 58.333, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.934', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.234', 'weapon2': '0.246', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.012', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '51.000'} [2024-08-06 03:48:08,453][52662] DAMAGECOUNT value on done: 448882.0 [2024-08-06 03:48:08,457][52662] Sum rewards: 69.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.798', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.100', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.678', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:08,991][52671] DAMAGECOUNT value on done: 458370.0 [2024-08-06 03:48:08,991][52671] Sum rewards: 78.608, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.165', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '63.000'} [2024-08-06 03:48:09,998][52665] DAMAGECOUNT value on done: 451911.0 [2024-08-06 03:48:10,000][52665] Sum rewards: 74.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.465', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.038', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '62.000'} [2024-08-06 03:48:10,224][52794] DAMAGECOUNT value on done: 451659.0 [2024-08-06 03:48:10,226][52794] Sum rewards: 51.133, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.090', 'AMMO5': '0.031', 'AMMO2': '0.061', 'AMMO3': '0.256', 'weapon4': '0.268', 'weapon5': '0.284', 'AMMO4': '0.306', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.640', 'weapon3': '2.730', 'DAMAGECOUNT': '14.163', 'FRAGCOUNT': '47.000'} [2024-08-06 03:48:10,410][52658] DAMAGECOUNT value on done: 450237.0 [2024-08-06 03:48:10,411][52658] Sum rewards: 66.740, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.736', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.154', 'weapon4': '0.252', 'AMMO3': '0.258', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.904', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '59.000'} [2024-08-06 03:48:11,398][52660] DAMAGECOUNT value on done: 463529.0 [2024-08-06 03:48:11,399][52660] Sum rewards: 70.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.232', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:11,408][52662] DAMAGECOUNT value on done: 447428.0 [2024-08-06 03:48:11,408][52662] Sum rewards: 68.939, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.527', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.168', 'AMMO4': '0.175', 'weapon2': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.310', 'weapon3': '3.316', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 03:48:12,103][52671] DAMAGECOUNT value on done: 455348.0 [2024-08-06 03:48:12,103][52671] Sum rewards: 64.862, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.054', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.152', 'weapon4': '0.170', 'AMMO4': '0.208', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.062', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '57.500'} [2024-08-06 03:48:12,444][52650] Updated weights for policy 0, policy_version 48571 (0.0015) [2024-08-06 03:48:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 397893632. Throughput: 0: 4386.7. Samples: 99483150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:48:12,794][52567] Avg episode reward: [(0, '68.043')] [2024-08-06 03:48:12,892][52665] DAMAGECOUNT value on done: 445899.0 [2024-08-06 03:48:12,893][52665] Sum rewards: 59.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.533', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.207', 'weapon2': '0.232', 'AMMO4': '0.243', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.598', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '49.000'} [2024-08-06 03:48:13,227][52658] DAMAGECOUNT value on done: 446051.0 [2024-08-06 03:48:13,228][52658] Sum rewards: 66.738, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.068', 'AMMO3': '0.184', 'AMMO4': '0.185', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '54.000'} [2024-08-06 03:48:13,298][52794] DAMAGECOUNT value on done: 454670.0 [2024-08-06 03:48:13,300][52794] Sum rewards: 58.330, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.280', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.108', 'AMMO4': '0.245', 'weapon2': '0.262', 'weapon5': '0.270', 'AMMO3': '0.359', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '2.000', 'weapon3': '2.950', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '55.000'} [2024-08-06 03:48:14,304][52660] DAMAGECOUNT value on done: 445026.0 [2024-08-06 03:48:14,305][52660] Sum rewards: 63.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.751', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.211', 'weapon2': '0.228', 'weapon5': '0.262', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '52.000'} [2024-08-06 03:48:14,456][52662] DAMAGECOUNT value on done: 444698.0 [2024-08-06 03:48:14,457][52662] Sum rewards: 65.500, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.231', 'AMMO5': '0.024', 'AMMO2': '0.069', 'AMMO3': '0.239', 'weapon4': '0.246', 'weapon5': '0.274', 'weapon2': '0.334', 'AMMO4': '0.344', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '56.000'} [2024-08-06 03:48:15,198][52671] DAMAGECOUNT value on done: 456736.0 [2024-08-06 03:48:15,200][52671] Sum rewards: 66.747, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.866', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.205', 'weapon5': '0.228', 'weapon4': '0.262', 'AMMO4': '0.294', 'weapon2': '0.370', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:16,111][52665] DAMAGECOUNT value on done: 443204.0 [2024-08-06 03:48:16,111][52665] Sum rewards: 74.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.020', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.130', 'weapon4': '0.164', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.700', 'weapon3': '3.110', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '65.000'} [2024-08-06 03:48:16,283][52658] DAMAGECOUNT value on done: 446033.0 [2024-08-06 03:48:16,283][52658] Sum rewards: 80.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.214', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.114', 'AMMO4': '0.174', 'AMMO3': '0.200', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '68.000'} [2024-08-06 03:48:16,293][52794] DAMAGECOUNT value on done: 453176.0 [2024-08-06 03:48:16,294][52794] Sum rewards: 73.951, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.942', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO3': '0.151', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.342', 'WEAPON3': '1.050', 'weapon3': '3.140', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '59.000'} [2024-08-06 03:48:16,647][52650] Updated weights for policy 0, policy_version 48581 (0.0024) [2024-08-06 03:48:17,295][52660] DAMAGECOUNT value on done: 451187.0 [2024-08-06 03:48:17,296][52660] Sum rewards: 73.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.182', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.114', 'weapon5': '0.136', 'weapon2': '0.174', 'AMMO3': '0.183', 'AMMO4': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.342', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 397983744. Throughput: 0: 4379.6. Samples: 99496060. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:48:17,794][52567] Avg episode reward: [(0, '67.809')] [2024-08-06 03:48:18,304][52671] DAMAGECOUNT value on done: 452593.0 [2024-08-06 03:48:18,306][52671] Sum rewards: 73.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.161', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.015', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.197', 'weapon2': '0.672', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:19,113][52658] DAMAGECOUNT value on done: 442731.0 [2024-08-06 03:48:19,113][52658] Sum rewards: 75.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.090', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'WEAPON3': '1.550', 'HITCOUNT': '3.400', 'weapon3': '3.424', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '64.000'} [2024-08-06 03:48:19,260][52665] DAMAGECOUNT value on done: 443145.0 [2024-08-06 03:48:19,261][52665] Sum rewards: 74.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.624', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.132', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'AMMO4': '0.219', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '62.000'} [2024-08-06 03:48:19,577][52794] DAMAGECOUNT value on done: 446132.0 [2024-08-06 03:48:19,579][52794] Sum rewards: 64.682, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.118', 'AMMO4': '0.206', 'AMMO3': '0.207', 'weapon5': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON5': '0.500', 'HEALTH': '0.729', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '53.500'} [2024-08-06 03:48:20,291][52660] DAMAGECOUNT value on done: 446331.0 [2024-08-06 03:48:20,292][52660] Sum rewards: 76.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.846', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.148', 'weapon5': '0.148', 'AMMO3': '0.199', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.306', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 03:48:21,022][52671] DAMAGECOUNT value on done: 451351.0 [2024-08-06 03:48:21,023][52671] Sum rewards: 69.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon4': '0.096', 'AMMO3': '0.211', 'weapon5': '0.228', 'AMMO4': '0.281', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:21,757][52650] Updated weights for policy 0, policy_version 48591 (0.0015) [2024-08-06 03:48:21,962][52794] DAMAGECOUNT value on done: 446907.0 [2024-08-06 03:48:21,963][52794] Sum rewards: 61.795, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.858', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '53.500'} [2024-08-06 03:48:21,970][52658] DAMAGECOUNT value on done: 456679.0 [2024-08-06 03:48:21,970][52658] Sum rewards: 72.116, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.602', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.177', 'weapon5': '0.210', 'weapon4': '0.216', 'AMMO4': '0.228', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '55.000'} [2024-08-06 03:48:22,320][52665] DAMAGECOUNT value on done: 446791.0 [2024-08-06 03:48:22,321][52665] Sum rewards: 68.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.199', 'weapon2': '0.238', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 398073856. Throughput: 0: 4380.3. Samples: 99522400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:48:22,794][52567] Avg episode reward: [(0, '67.865')] [2024-08-06 03:48:23,539][52660] DAMAGECOUNT value on done: 447584.0 [2024-08-06 03:48:23,540][52660] Sum rewards: 73.446, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.487', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.160', 'weapon5': '0.186', 'AMMO4': '0.229', 'AMMO3': '0.251', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '64.000'} [2024-08-06 03:48:24,744][52794] DAMAGECOUNT value on done: 452221.0 [2024-08-06 03:48:24,745][52794] Sum rewards: 76.487, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.172', 'weapon2': '0.172', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:25,136][52658] DAMAGECOUNT value on done: 447403.0 [2024-08-06 03:48:25,136][52658] Sum rewards: 72.638, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.143', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon5': '0.204', 'weapon2': '0.236', 'AMMO4': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '62.000'} [2024-08-06 03:48:25,484][52665] DAMAGECOUNT value on done: 440290.0 [2024-08-06 03:48:25,487][52665] Sum rewards: 69.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.904', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.196', 'AMMO4': '0.204', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.294', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:26,212][52650] Updated weights for policy 0, policy_version 48601 (0.0025) [2024-08-06 03:48:26,426][52660] DAMAGECOUNT value on done: 442614.0 [2024-08-06 03:48:26,430][52660] Sum rewards: 59.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.536', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.094', 'AMMO3': '0.171', 'AMMO4': '0.177', 'weapon5': '0.178', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '3.216', 'DAMAGECOUNT': '13.869', 'FRAGCOUNT': '49.000'} [2024-08-06 03:48:26,507][52658] Large shaping reward 2.579 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0)] [2024-08-06 03:48:27,245][52794] DAMAGECOUNT value on done: 456884.0 [2024-08-06 03:48:27,246][52794] Sum rewards: 80.859, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.720', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.176', 'weapon4': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.550', 'weapon3': '3.278', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '69.000'} [2024-08-06 03:48:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 398163968. Throughput: 0: 4375.8. Samples: 99548500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:48:27,795][52567] Avg episode reward: [(0, '68.045')] [2024-08-06 03:48:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048604_398163968.pth... [2024-08-06 03:48:27,948][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048091_393961472.pth [2024-08-06 03:48:28,150][52658] DAMAGECOUNT value on done: 451535.0 [2024-08-06 03:48:28,151][52658] Sum rewards: 80.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.223', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.472', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '67.000'} [2024-08-06 03:48:28,433][52665] DAMAGECOUNT value on done: 440431.0 [2024-08-06 03:48:28,434][52665] Sum rewards: 77.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.466', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.102', 'weapon5': '0.166', 'AMMO4': '0.184', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '64.000'} [2024-08-06 03:48:29,811][52794] DAMAGECOUNT value on done: 448002.0 [2024-08-06 03:48:29,811][52794] Sum rewards: 76.504, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.597', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.138', 'weapon2': '0.196', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.052', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '67.000'} [2024-08-06 03:48:31,090][52650] Updated weights for policy 0, policy_version 48611 (0.0025) [2024-08-06 03:48:31,147][52658] DAMAGECOUNT value on done: 454883.0 [2024-08-06 03:48:31,148][52658] Sum rewards: 67.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.117', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '53.000'} [2024-08-06 03:48:31,521][52665] DAMAGECOUNT value on done: 440663.0 [2024-08-06 03:48:31,522][52665] Sum rewards: 77.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.136', 'weapon4': '0.234', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.600', 'weapon3': '2.948', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '66.000'} [2024-08-06 03:48:32,288][52659] DAMAGECOUNT value on done: 450798.0 [2024-08-06 03:48:32,288][52659] Sum rewards: 73.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.624', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.278', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:32,460][52794] DAMAGECOUNT value on done: 454539.0 [2024-08-06 03:48:32,463][52794] Sum rewards: 67.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.596', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.146', 'AMMO3': '0.212', 'weapon5': '0.232', 'AMMO4': '0.238', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '56.000'} [2024-08-06 03:48:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 398245888. Throughput: 0: 4372.7. Samples: 99561350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:48:32,794][52567] Avg episode reward: [(0, '68.760')] [2024-08-06 03:48:33,051][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:48:34,074][52649] DAMAGECOUNT value on done: 433277.0 [2024-08-06 03:48:34,075][52649] Sum rewards: 64.221, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.647', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.034', 'AMMO4': '0.037', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon2': '0.762', 'WEAPON3': '0.800', 'weapon3': '2.992', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '49.000'} [2024-08-06 03:48:34,535][52665] DAMAGECOUNT value on done: 441418.0 [2024-08-06 03:48:34,537][52665] Sum rewards: 64.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.074', 'AMMO4': '0.082', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '56.000'} [2024-08-06 03:48:35,000][52659] DAMAGECOUNT value on done: 450538.0 [2024-08-06 03:48:35,002][52659] Sum rewards: 66.469, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.680', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.112', 'weapon5': '0.118', 'AMMO4': '0.197', 'AMMO3': '0.297', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '3.060', 'weapon3': '3.162', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:35,367][52794] DAMAGECOUNT value on done: 450908.0 [2024-08-06 03:48:35,367][52794] Sum rewards: 67.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.034', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.132', 'AMMO4': '0.164', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.312', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 03:48:35,824][52811] DAMAGECOUNT value on done: 431986.0 [2024-08-06 03:48:35,824][52811] Sum rewards: 76.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.151', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.124', 'weapon5': '0.160', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '61.500'} [2024-08-06 03:48:36,010][52650] Updated weights for policy 0, policy_version 48621 (0.0019) [2024-08-06 03:48:37,136][52649] DAMAGECOUNT value on done: 428937.0 [2024-08-06 03:48:37,136][52649] Sum rewards: 58.095, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.340', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.170', 'weapon4': '0.202', 'AMMO4': '0.260', 'AMMO3': '0.267', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.080', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '51.000'} [2024-08-06 03:48:37,580][52665] DAMAGECOUNT value on done: 446116.0 [2024-08-06 03:48:37,582][52665] Sum rewards: 59.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.170', 'AMMO3': '0.188', 'AMMO4': '0.229', 'weapon5': '0.248', 'weapon2': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.046', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '51.000'} [2024-08-06 03:48:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 398336000. Throughput: 0: 4373.1. Samples: 99587540. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 03:48:37,795][52567] Avg episode reward: [(0, '68.538')] [2024-08-06 03:48:37,879][52659] DAMAGECOUNT value on done: 453716.0 [2024-08-06 03:48:37,879][52659] Sum rewards: 68.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.022', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.414', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:38,058][52794] DAMAGECOUNT value on done: 445827.0 [2024-08-06 03:48:38,059][52794] Sum rewards: 66.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.182', 'weapon5': '0.214', 'AMMO4': '0.224', 'weapon4': '0.368', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '54.000'} [2024-08-06 03:48:38,282][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:48:38,925][52811] DAMAGECOUNT value on done: 414592.0 [2024-08-06 03:48:38,932][52811] Sum rewards: 70.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.680', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.123', 'weapon5': '0.168', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:40,345][52649] DAMAGECOUNT value on done: 442741.0 [2024-08-06 03:48:40,347][52649] Sum rewards: 64.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.256', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.048', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon5': '0.334', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.182', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '54.000'} [2024-08-06 03:48:40,391][52659] DAMAGECOUNT value on done: 450065.0 [2024-08-06 03:48:40,391][52659] Sum rewards: 72.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.428', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.132', 'weapon5': '0.172', 'AMMO3': '0.218', 'AMMO4': '0.249', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '61.000'} [2024-08-06 03:48:40,519][52650] Updated weights for policy 0, policy_version 48631 (0.0027) [2024-08-06 03:48:41,104][52794] DAMAGECOUNT value on done: 453730.0 [2024-08-06 03:48:41,105][52794] Sum rewards: 74.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.218', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '62.000'} [2024-08-06 03:48:42,027][52811] DAMAGECOUNT value on done: 416740.0 [2024-08-06 03:48:42,028][52811] Sum rewards: 63.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.019', 'AMMO2': '0.066', 'AMMO3': '0.157', 'weapon5': '0.218', 'weapon4': '0.234', 'AMMO4': '0.330', 'weapon2': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.960', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '53.000'} [2024-08-06 03:48:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 398426112. Throughput: 0: 4378.7. Samples: 99614070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:48:42,794][52567] Avg episode reward: [(0, '68.781')] [2024-08-06 03:48:42,933][52649] DAMAGECOUNT value on done: 435864.0 [2024-08-06 03:48:42,935][52649] Sum rewards: 65.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.322', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.088', 'AMMO4': '0.097', 'AMMO3': '0.175', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.694', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '53.500'} [2024-08-06 03:48:43,355][52659] DAMAGECOUNT value on done: 447165.0 [2024-08-06 03:48:43,358][52659] Sum rewards: 68.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.890', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.092', 'AMMO4': '0.216', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:43,786][52794] DAMAGECOUNT value on done: 442625.0 [2024-08-06 03:48:43,788][52794] Sum rewards: 66.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.191', 'weapon5': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.438', 'weapon4': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.264', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '56.000'} [2024-08-06 03:48:44,250][52803] DAMAGECOUNT value on done: 420537.0 [2024-08-06 03:48:44,258][52803] Sum rewards: 63.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.692', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO4': '0.189', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon4': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '54.000'} [2024-08-06 03:48:45,021][52650] Updated weights for policy 0, policy_version 48641 (0.0011) [2024-08-06 03:48:45,201][52811] DAMAGECOUNT value on done: 418208.0 [2024-08-06 03:48:45,202][52811] Sum rewards: 75.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.163', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.178', 'AMMO4': '0.202', 'weapon5': '0.218', 'weapon4': '0.368', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.652', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '62.000'} [2024-08-06 03:48:45,882][52649] DAMAGECOUNT value on done: 428596.0 [2024-08-06 03:48:45,883][52649] Sum rewards: 86.129, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon2': '0.576', 'HEALTH': '0.651', 'WEAPON3': '0.800', 'weapon3': '3.112', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '66.000'} [2024-08-06 03:48:46,018][52659] DAMAGECOUNT value on done: 452701.0 [2024-08-06 03:48:46,022][52659] Sum rewards: 75.758, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.144', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.136', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.236', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '64.000'} [2024-08-06 03:48:46,390][52794] DAMAGECOUNT value on done: 462655.0 [2024-08-06 03:48:46,393][52794] Sum rewards: 63.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.574', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.088', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '55.000'} [2024-08-06 03:48:47,274][52803] DAMAGECOUNT value on done: 417065.0 [2024-08-06 03:48:47,278][52803] Sum rewards: 64.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO3': '0.204', 'AMMO4': '0.215', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.618', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '54.000'} [2024-08-06 03:48:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 398508032. Throughput: 0: 4372.7. Samples: 99627170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:48:47,795][52567] Avg episode reward: [(0, '69.063')] [2024-08-06 03:48:48,240][52811] DAMAGECOUNT value on done: 420486.0 [2024-08-06 03:48:48,243][52811] Sum rewards: 60.584, reward structure: {'DEATHCOUNT': '-6.750', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.099', 'AMMO4': '0.126', 'HEALTH': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon5': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '0.782', 'weapon3': '2.470', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '45.000'} [2024-08-06 03:48:48,513][52649] DAMAGECOUNT value on done: 440354.0 [2024-08-06 03:48:48,515][52649] Sum rewards: 64.032, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.025', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO4': '0.198', 'AMMO3': '0.239', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.182', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '55.000'} [2024-08-06 03:48:48,782][52659] DAMAGECOUNT value on done: 450418.0 [2024-08-06 03:48:48,783][52659] Sum rewards: 70.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.184', 'weapon2': '0.206', 'weapon5': '0.224', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:49,615][52650] Updated weights for policy 0, policy_version 48651 (0.0020) [2024-08-06 03:48:49,686][52794] DAMAGECOUNT value on done: 444388.0 [2024-08-06 03:48:49,690][52794] Sum rewards: 69.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.035', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.174', 'weapon2': '0.200', 'AMMO3': '0.210', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.234', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:50,301][52803] DAMAGECOUNT value on done: 424840.0 [2024-08-06 03:48:50,303][52803] Sum rewards: 73.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.082', 'weapon5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.674', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 03:48:51,435][52811] DAMAGECOUNT value on done: 426568.0 [2024-08-06 03:48:51,436][52811] Sum rewards: 53.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.027', 'AMMO2': '0.086', 'AMMO3': '0.214', 'weapon2': '0.248', 'weapon4': '0.298', 'weapon5': '0.358', 'AMMO4': '0.428', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.774', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '45.500'} [2024-08-06 03:48:51,485][52649] DAMAGECOUNT value on done: 435148.0 [2024-08-06 03:48:51,485][52649] Sum rewards: 72.515, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.255', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.147', 'weapon5': '0.174', 'weapon4': '0.194', 'AMMO4': '0.200', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.074', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:51,669][52659] DAMAGECOUNT value on done: 450509.0 [2024-08-06 03:48:51,673][52659] Sum rewards: 62.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.518', 'AMMO5': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.215', 'AMMO4': '0.268', 'weapon2': '0.298', 'weapon5': '0.374', 'weapon4': '0.438', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.516', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '52.000'} [2024-08-06 03:48:52,750][52794] DAMAGECOUNT value on done: 461566.0 [2024-08-06 03:48:52,755][52794] Sum rewards: 69.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.158', 'AMMO3': '0.210', 'AMMO4': '0.216', 'weapon5': '0.220', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 398598144. Throughput: 0: 4375.8. Samples: 99653460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:48:52,794][52567] Avg episode reward: [(0, '68.804')] [2024-08-06 03:48:53,370][52803] DAMAGECOUNT value on done: 426746.0 [2024-08-06 03:48:53,371][52803] Sum rewards: 70.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon4': '0.270', 'weapon2': '0.466', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:54,413][52650] Updated weights for policy 0, policy_version 48661 (0.0021) [2024-08-06 03:48:54,503][52649] DAMAGECOUNT value on done: 441286.0 [2024-08-06 03:48:54,504][52649] Sum rewards: 74.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.204', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.134', 'AMMO4': '0.178', 'AMMO3': '0.206', 'weapon5': '0.284', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '62.000'} [2024-08-06 03:48:54,703][52811] DAMAGECOUNT value on done: 422049.0 [2024-08-06 03:48:54,703][52811] Sum rewards: 75.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.238', 'AMMO5': '0.006', 'AMMO2': '0.025', 'ARMOR': '0.036', 'weapon5': '0.074', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 03:48:54,730][52659] DAMAGECOUNT value on done: 457819.0 [2024-08-06 03:48:54,730][52659] Sum rewards: 69.147, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'HEALTH': '0.232', 'AMMO3': '0.246', 'weapon4': '0.352', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '2.678', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '58.000'} [2024-08-06 03:48:55,408][52794] DAMAGECOUNT value on done: 451535.0 [2024-08-06 03:48:55,409][52794] Sum rewards: 61.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.225', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.126', 'AMMO3': '0.198', 'weapon4': '0.250', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '52.000'} [2024-08-06 03:48:56,601][52803] DAMAGECOUNT value on done: 425564.0 [2024-08-06 03:48:56,601][52803] Sum rewards: 61.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.139', 'weapon5': '0.164', 'weapon4': '0.190', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon7': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '2.712', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '51.000'} [2024-08-06 03:48:57,415][52659] DAMAGECOUNT value on done: 461234.0 [2024-08-06 03:48:57,418][52659] Sum rewards: 77.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '62.000'} [2024-08-06 03:48:57,508][52649] DAMAGECOUNT value on done: 441622.0 [2024-08-06 03:48:57,508][52649] Sum rewards: 65.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.469', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.126', 'weapon5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.000', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '54.000'} [2024-08-06 03:48:57,792][52811] DAMAGECOUNT value on done: 421204.0 [2024-08-06 03:48:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 398688256. Throughput: 0: 4369.6. Samples: 99679780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:48:57,797][52567] Avg episode reward: [(0, '68.840')] [2024-08-06 03:48:57,792][52811] Sum rewards: 75.068, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.904', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.190', 'weapon5': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.358', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '61.000'} [2024-08-06 03:48:57,895][52664] DAMAGECOUNT value on done: 467334.0 [2024-08-06 03:48:57,896][52664] Sum rewards: 65.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.092', 'weapon4': '0.164', 'AMMO3': '0.206', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.162', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '54.000'} [2024-08-06 03:48:58,234][52794] DAMAGECOUNT value on done: 453812.0 [2024-08-06 03:48:58,237][52794] Sum rewards: 69.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.308', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.194', 'AMMO4': '0.246', 'weapon5': '0.260', 'weapon4': '0.318', 'weapon2': '0.372', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.698', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '57.000'} [2024-08-06 03:48:59,355][52650] Updated weights for policy 0, policy_version 48671 (0.0011) [2024-08-06 03:48:59,720][52803] DAMAGECOUNT value on done: 413221.0 [2024-08-06 03:48:59,720][52803] Sum rewards: 61.154, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.654', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.090', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '53.000'} [2024-08-06 03:48:59,780][52659] DAMAGECOUNT value on done: 449947.0 [2024-08-06 03:48:59,780][52659] Sum rewards: 75.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.024', 'AMMO4': '0.051', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.266', 'WEAPON3': '1.150', 'weapon3': '3.472', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:00,611][52649] DAMAGECOUNT value on done: 436143.0 [2024-08-06 03:49:00,613][52649] Sum rewards: 83.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.396', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.213', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '69.000'} [2024-08-06 03:49:00,653][52664] DAMAGECOUNT value on done: 473473.0 [2024-08-06 03:49:00,655][52664] Sum rewards: 76.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.984', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.054', 'AMMO4': '0.181', 'weapon5': '0.218', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:00,827][52811] DAMAGECOUNT value on done: 425196.0 [2024-08-06 03:49:00,830][52811] Sum rewards: 78.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.206', 'AMMO3': '0.212', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '64.000'} [2024-08-06 03:49:01,526][52794] DAMAGECOUNT value on done: 458058.0 [2024-08-06 03:49:01,527][52794] Sum rewards: 71.519, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.304', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.166', 'AMMO3': '0.192', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 398770176. Throughput: 0: 4374.4. Samples: 99692910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:49:02,794][52567] Avg episode reward: [(0, '69.418')] [2024-08-06 03:49:02,870][52803] DAMAGECOUNT value on done: 415056.0 [2024-08-06 03:49:02,873][52803] Sum rewards: 53.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.202', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.118', 'weapon4': '0.160', 'AMMO4': '0.188', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '3.088', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '47.000'} [2024-08-06 03:49:02,930][52659] DAMAGECOUNT value on done: 453752.0 [2024-08-06 03:49:02,931][52659] Sum rewards: 69.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.736', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO4': '0.212', 'AMMO3': '0.229', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '59.000'} [2024-08-06 03:49:03,144][52664] DAMAGECOUNT value on done: 473042.0 [2024-08-06 03:49:03,145][52664] Sum rewards: 68.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.136', 'weapon4': '0.186', 'AMMO3': '0.196', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '56.000'} [2024-08-06 03:49:03,507][52650] Updated weights for policy 0, policy_version 48681 (0.0019) [2024-08-06 03:49:03,627][52649] DAMAGECOUNT value on done: 443810.0 [2024-08-06 03:49:03,631][52649] Sum rewards: 68.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.610', 'AMMO5': '0.024', 'AMMO2': '0.046', 'weapon5': '0.162', 'AMMO3': '0.218', 'AMMO4': '0.233', 'weapon2': '0.272', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '57.500'} [2024-08-06 03:49:03,843][52647] DAMAGECOUNT value on done: 474604.0 [2024-08-06 03:49:03,843][52647] Sum rewards: 62.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.465', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'AMMO4': '0.175', 'weapon4': '0.192', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.002', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '51.000'} [2024-08-06 03:49:03,974][52811] DAMAGECOUNT value on done: 422071.0 [2024-08-06 03:49:03,975][52811] Sum rewards: 76.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.397', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.090', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '65.000'} [2024-08-06 03:49:04,448][52794] DAMAGECOUNT value on done: 450183.0 [2024-08-06 03:49:04,451][52794] Sum rewards: 71.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.004', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.188', 'AMMO4': '0.229', 'AMMO3': '0.241', 'weapon5': '0.256', 'weapon2': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '61.000'} [2024-08-06 03:49:06,030][52803] DAMAGECOUNT value on done: 414486.0 [2024-08-06 03:49:06,032][52803] Sum rewards: 62.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.602', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:06,084][52659] DAMAGECOUNT value on done: 445399.0 [2024-08-06 03:49:06,084][52659] Sum rewards: 71.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.608', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.208', 'weapon2': '0.612', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '57.500'} [2024-08-06 03:49:06,147][52664] DAMAGECOUNT value on done: 465701.0 [2024-08-06 03:49:06,147][52664] Sum rewards: 64.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.024', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:06,295][52649] DAMAGECOUNT value on done: 446742.0 [2024-08-06 03:49:06,296][52649] Sum rewards: 83.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.857', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.119', 'weapon5': '0.134', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '69.000'} [2024-08-06 03:49:06,770][52647] DAMAGECOUNT value on done: 474941.0 [2024-08-06 03:49:06,770][52647] Sum rewards: 70.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.797', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.153', 'weapon5': '0.158', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '59.000'} [2024-08-06 03:49:07,056][52811] DAMAGECOUNT value on done: 420429.0 [2024-08-06 03:49:07,058][52811] Sum rewards: 73.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.008', 'weapon4': '0.024', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon2': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON3': '1.600', 'HITCOUNT': '3.380', 'weapon3': '3.634', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '64.000'} [2024-08-06 03:49:07,663][52666] DAMAGECOUNT value on done: 446484.0 [2024-08-06 03:49:07,664][52666] Sum rewards: 55.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.832', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.266', 'AMMO4': '0.267', 'AMMO3': '0.277', 'weapon4': '0.316', 'weapon2': '0.384', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.734', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '48.000'} [2024-08-06 03:49:07,671][52663] DAMAGECOUNT value on done: 456168.0 [2024-08-06 03:49:07,671][52663] Sum rewards: 65.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.418', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.102', 'weapon4': '0.124', 'AMMO4': '0.199', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:07,721][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:49:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 398860288. Throughput: 0: 4372.4. Samples: 99719160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 03:49:07,794][52567] Avg episode reward: [(0, '69.357')] [2024-08-06 03:49:08,215][52669] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.057, -19.0), ('weapon5', 0.002)] [2024-08-06 03:49:08,326][52650] Updated weights for policy 0, policy_version 48691 (0.0025) [2024-08-06 03:49:09,017][52649] DAMAGECOUNT value on done: 446201.0 [2024-08-06 03:49:09,026][52649] Sum rewards: 84.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.736', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.164', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon4': '0.344', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '68.000'} [2024-08-06 03:49:09,100][52803] DAMAGECOUNT value on done: 422291.0 [2024-08-06 03:49:09,102][52803] Sum rewards: 80.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.517', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.080', 'AMMO4': '0.128', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon5': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '67.000'} [2024-08-06 03:49:09,296][52664] DAMAGECOUNT value on done: 470949.0 [2024-08-06 03:49:09,296][52664] Sum rewards: 87.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.148', 'weapon5': '0.182', 'weapon2': '0.260', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '75.000'} [2024-08-06 03:49:09,325][52659] DAMAGECOUNT value on done: 451851.0 [2024-08-06 03:49:09,327][52659] Sum rewards: 65.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.976', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.269', 'weapon2': '0.530', 'WEAPON3': '1.650', 'weapon3': '3.098', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '56.000'} [2024-08-06 03:49:09,796][52647] DAMAGECOUNT value on done: 473426.0 [2024-08-06 03:49:09,797][52647] Sum rewards: 62.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.863', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.157', 'weapon5': '0.188', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.202', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:10,111][52670] DAMAGECOUNT value on done: 440965.0 [2024-08-06 03:49:10,111][52670] Sum rewards: 65.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.084', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:10,122][52811] DAMAGECOUNT value on done: 430632.0 [2024-08-06 03:49:10,126][52811] Sum rewards: 65.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.403', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.160', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.706', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '54.000'} [2024-08-06 03:49:10,178][52666] DAMAGECOUNT value on done: 453725.0 [2024-08-06 03:49:10,181][52666] Sum rewards: 65.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.080', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.096', 'weapon4': '0.126', 'AMMO4': '0.159', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '54.000'} [2024-08-06 03:49:10,573][52663] DAMAGECOUNT value on done: 451543.0 [2024-08-06 03:49:10,575][52663] Sum rewards: 70.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.450', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '59.000'} [2024-08-06 03:49:11,412][52662] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:49:12,103][52664] DAMAGECOUNT value on done: 468016.0 [2024-08-06 03:49:12,103][52664] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.333', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.126', 'weapon4': '0.166', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'WEAPON4': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:12,278][52803] DAMAGECOUNT value on done: 413340.0 [2024-08-06 03:49:12,279][52803] Sum rewards: 61.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '53.000'} [2024-08-06 03:49:12,338][52649] DAMAGECOUNT value on done: 444400.0 [2024-08-06 03:49:12,340][52649] Sum rewards: 64.627, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.475', 'AMMO5': '0.023', 'AMMO2': '0.068', 'weapon4': '0.194', 'AMMO3': '0.219', 'weapon5': '0.308', 'AMMO4': '0.341', 'weapon2': '0.428', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.640', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:12,458][52659] DAMAGECOUNT value on done: 460953.0 [2024-08-06 03:49:12,459][52659] Sum rewards: 78.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO3': '0.217', 'AMMO4': '0.229', 'weapon5': '0.254', 'weapon4': '0.360', 'weapon2': '0.462', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.598', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '64.000'} [2024-08-06 03:49:12,487][52647] DAMAGECOUNT value on done: 483021.0 [2024-08-06 03:49:12,487][52647] Sum rewards: 73.279, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.866', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.184', 'weapon4': '0.196', 'AMMO3': '0.204', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.618', 'WEAPON3': '1.250', 'weapon3': '2.748', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '58.000'} [2024-08-06 03:49:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 398950400. Throughput: 0: 4377.3. Samples: 99745480. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:49:12,794][52567] Avg episode reward: [(0, '69.778')] [2024-08-06 03:49:12,869][52670] DAMAGECOUNT value on done: 451753.0 [2024-08-06 03:49:12,870][52670] Sum rewards: 79.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.149', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.231', 'WEAPON3': '1.450', 'weapon3': '3.492', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '66.000'} [2024-08-06 03:49:12,934][52666] DAMAGECOUNT value on done: 453474.0 [2024-08-06 03:49:12,936][52666] Sum rewards: 66.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon5': '0.070', 'weapon4': '0.094', 'AMMO3': '0.194', 'AMMO4': '0.215', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:13,230][52811] DAMAGECOUNT value on done: 421284.0 [2024-08-06 03:49:13,231][52811] Sum rewards: 65.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.096', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.388', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '54.000'} [2024-08-06 03:49:13,263][52663] DAMAGECOUNT value on done: 445936.0 [2024-08-06 03:49:13,264][52663] Sum rewards: 75.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.965', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.234', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.522', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:13,490][52650] Updated weights for policy 0, policy_version 48701 (0.0036) [2024-08-06 03:49:14,958][52664] DAMAGECOUNT value on done: 467502.0 [2024-08-06 03:49:14,959][52664] Sum rewards: 67.090, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.200', 'AMMO3': '0.255', 'weapon4': '0.284', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.700', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 03:49:15,112][52659] DAMAGECOUNT value on done: 456250.0 [2024-08-06 03:49:15,112][52659] Sum rewards: 61.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.082', 'weapon5': '0.092', 'AMMO4': '0.100', 'weapon2': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '3.528', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '54.000'} [2024-08-06 03:49:15,281][52647] DAMAGECOUNT value on done: 480750.0 [2024-08-06 03:49:15,283][52647] Sum rewards: 60.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.802', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.220', 'weapon2': '0.246', 'AMMO3': '0.285', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:15,461][52803] DAMAGECOUNT value on done: 427745.0 [2024-08-06 03:49:15,464][52803] Sum rewards: 78.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.913', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.230', 'weapon2': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.462', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '66.000'} [2024-08-06 03:49:15,592][52670] DAMAGECOUNT value on done: 445299.0 [2024-08-06 03:49:15,592][52670] Sum rewards: 71.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.547', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.106', 'weapon4': '0.126', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.292', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '60.000'} [2024-08-06 03:49:15,626][52649] DAMAGECOUNT value on done: 434856.0 [2024-08-06 03:49:15,626][52649] Sum rewards: 72.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.719', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.164', 'weapon4': '0.190', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.052', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:15,795][52666] DAMAGECOUNT value on done: 452334.0 [2024-08-06 03:49:15,795][52666] Sum rewards: 69.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:16,274][52811] DAMAGECOUNT value on done: 417844.0 [2024-08-06 03:49:16,274][52811] Sum rewards: 72.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.036', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.220', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.600', 'weapon3': '2.900', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:16,315][52663] DAMAGECOUNT value on done: 449805.0 [2024-08-06 03:49:16,315][52663] Sum rewards: 62.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.176', 'weapon4': '0.192', 'AMMO4': '0.212', 'weapon2': '0.216', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:17,664][52664] DAMAGECOUNT value on done: 462283.0 [2024-08-06 03:49:17,665][52664] Sum rewards: 69.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.150', 'AMMO4': '0.177', 'weapon5': '0.214', 'AMMO3': '0.224', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:17,795][52567] Fps is (10 sec: 17202.1, 60 sec: 17476.1, 300 sec: 17494.7). Total num frames: 399032320. Throughput: 0: 4381.5. Samples: 99758520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:49:17,796][52567] Avg episode reward: [(0, '69.621')] [2024-08-06 03:49:17,828][52650] Updated weights for policy 0, policy_version 48711 (0.0013) [2024-08-06 03:49:17,867][52659] DAMAGECOUNT value on done: 457293.0 [2024-08-06 03:49:17,869][52659] Sum rewards: 75.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.814', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.095', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:17,986][52647] DAMAGECOUNT value on done: 478505.0 [2024-08-06 03:49:17,987][52647] Sum rewards: 76.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '65.000'} [2024-08-06 03:49:18,438][52670] DAMAGECOUNT value on done: 443708.0 [2024-08-06 03:49:18,440][52670] Sum rewards: 73.900, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.070', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon2': '0.216', 'AMMO3': '0.225', 'WEAPON3': '1.300', 'HITCOUNT': '3.420', 'weapon3': '3.498', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:18,521][52666] DAMAGECOUNT value on done: 453518.0 [2024-08-06 03:49:18,521][52666] Sum rewards: 89.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.256', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.255', 'FRAGCOUNT': '72.000'} [2024-08-06 03:49:18,539][52803] DAMAGECOUNT value on done: 420817.0 [2024-08-06 03:49:18,539][52803] Sum rewards: 68.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.317', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 03:49:18,625][52649] DAMAGECOUNT value on done: 443675.0 [2024-08-06 03:49:18,625][52649] Sum rewards: 82.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.472', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.352', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '68.000'} [2024-08-06 03:49:19,052][52663] DAMAGECOUNT value on done: 450542.0 [2024-08-06 03:49:19,053][52663] Sum rewards: 76.106, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.130', 'weapon4': '0.164', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'WEAPON3': '1.700', 'weapon3': '3.122', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '65.000'} [2024-08-06 03:49:19,416][52811] DAMAGECOUNT value on done: 423929.0 [2024-08-06 03:49:19,418][52811] Sum rewards: 63.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.629', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.152', 'AMMO4': '0.180', 'AMMO3': '0.188', 'weapon5': '0.302', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '51.500'} [2024-08-06 03:49:20,507][52664] DAMAGECOUNT value on done: 472378.0 [2024-08-06 03:49:20,507][52664] Sum rewards: 67.492, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.115', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.084', 'weapon5': '0.134', 'AMMO3': '0.136', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '0.900', 'weapon3': '2.998', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:20,735][52647] DAMAGECOUNT value on done: 476547.0 [2024-08-06 03:49:20,737][52647] Sum rewards: 69.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.145', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.084', 'AMMO4': '0.158', 'AMMO3': '0.198', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '58.000'} [2024-08-06 03:49:20,809][52659] DAMAGECOUNT value on done: 449630.0 [2024-08-06 03:49:20,811][52659] Sum rewards: 73.687, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.073', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.248', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:21,148][52670] DAMAGECOUNT value on done: 455633.0 [2024-08-06 03:49:21,148][52670] Sum rewards: 77.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.104', 'AMMO4': '0.172', 'AMMO3': '0.232', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '64.000'} [2024-08-06 03:49:21,199][52666] DAMAGECOUNT value on done: 444552.0 [2024-08-06 03:49:21,199][52666] Sum rewards: 78.056, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.774', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.222', 'AMMO4': '0.273', 'AMMO3': '0.280', 'weapon5': '0.310', 'weapon2': '0.314', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.738', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '20.457', 'FRAGCOUNT': '67.000'} [2024-08-06 03:49:21,509][52649] DAMAGECOUNT value on done: 433075.0 [2024-08-06 03:49:21,510][52649] Sum rewards: 54.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO4': '0.246', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.804', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '48.000'} [2024-08-06 03:49:21,613][52803] DAMAGECOUNT value on done: 420610.0 [2024-08-06 03:49:21,613][52803] Sum rewards: 72.911, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.676', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.278', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:22,126][52663] DAMAGECOUNT value on done: 453655.0 [2024-08-06 03:49:22,127][52663] Sum rewards: 76.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.235', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.080', 'weapon5': '0.090', 'AMMO4': '0.121', 'AMMO3': '0.217', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:22,367][52650] Updated weights for policy 0, policy_version 48721 (0.0024) [2024-08-06 03:49:22,476][52811] DAMAGECOUNT value on done: 416339.0 [2024-08-06 03:49:22,477][52811] Sum rewards: 60.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.374', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.074', 'weapon5': '0.080', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.238', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.444', 'DAMAGECOUNT': '14.142', 'FRAGCOUNT': '53.000'} [2024-08-06 03:49:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 399122432. Throughput: 0: 4386.7. Samples: 99784940. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:49:22,795][52567] Avg episode reward: [(0, '70.034')] [2024-08-06 03:49:23,184][52664] DAMAGECOUNT value on done: 466376.0 [2024-08-06 03:49:23,185][52664] Sum rewards: 79.126, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.129', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.070', 'weapon4': '0.106', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '66.000'} [2024-08-06 03:49:23,336][52647] DAMAGECOUNT value on done: 470127.0 [2024-08-06 03:49:23,336][52647] Sum rewards: 72.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.118', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.264', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '61.000'} [2024-08-06 03:49:23,615][52659] DAMAGECOUNT value on done: 453498.0 [2024-08-06 03:49:23,616][52659] Sum rewards: 73.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.189', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.078', 'AMMO4': '0.194', 'AMMO3': '0.206', 'weapon5': '0.222', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '61.000'} [2024-08-06 03:49:24,006][52670] DAMAGECOUNT value on done: 447437.0 [2024-08-06 03:49:24,007][52670] Sum rewards: 65.329, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.894', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.122', 'AMMO3': '0.253', 'weapon5': '0.256', 'weapon2': '0.286', 'AMMO4': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '56.000'} [2024-08-06 03:49:24,062][52666] DAMAGECOUNT value on done: 450138.0 [2024-08-06 03:49:24,063][52666] Sum rewards: 68.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.607', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.104', 'weapon4': '0.116', 'AMMO3': '0.179', 'AMMO4': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '56.000'} [2024-08-06 03:49:24,499][52649] DAMAGECOUNT value on done: 444354.0 [2024-08-06 03:49:24,501][52649] Sum rewards: 73.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.970', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.154', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:24,779][52803] DAMAGECOUNT value on done: 424243.0 [2024-08-06 03:49:24,779][52803] Sum rewards: 59.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.367', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.162', 'AMMO3': '0.170', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.006', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '48.000'} [2024-08-06 03:49:25,032][52663] DAMAGECOUNT value on done: 452503.0 [2024-08-06 03:49:25,033][52663] Sum rewards: 76.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.987', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.088', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.246', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '65.000'} [2024-08-06 03:49:25,453][52811] DAMAGECOUNT value on done: 421416.0 [2024-08-06 03:49:25,453][52811] Sum rewards: 78.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.422', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:25,994][52664] DAMAGECOUNT value on done: 475651.0 [2024-08-06 03:49:25,995][52664] Sum rewards: 76.733, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.260', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.044', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '64.000'} [2024-08-06 03:49:26,247][52647] DAMAGECOUNT value on done: 482093.0 [2024-08-06 03:49:26,248][52647] Sum rewards: 69.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon4': '0.184', 'weapon2': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '56.000'} [2024-08-06 03:49:26,287][52659] DAMAGECOUNT value on done: 454085.0 [2024-08-06 03:49:26,288][52659] Sum rewards: 64.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.524', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.190', 'weapon4': '0.204', 'weapon5': '0.294', 'AMMO4': '0.302', 'weapon2': '0.320', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '53.000'} [2024-08-06 03:49:26,507][52670] DAMAGECOUNT value on done: 440949.0 [2024-08-06 03:49:26,508][52670] Sum rewards: 62.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.179', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.154', 'AMMO3': '0.189', 'AMMO4': '0.247', 'weapon5': '0.278', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '51.000'} [2024-08-06 03:49:26,708][52666] DAMAGECOUNT value on done: 449686.0 [2024-08-06 03:49:26,708][52666] Sum rewards: 71.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.104', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.306', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 03:49:27,183][52649] DAMAGECOUNT value on done: 446518.0 [2024-08-06 03:49:27,184][52649] Sum rewards: 60.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.721', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.168', 'AMMO4': '0.220', 'AMMO3': '0.226', 'weapon4': '0.228', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '51.000'} [2024-08-06 03:49:27,367][52650] Updated weights for policy 0, policy_version 48731 (0.0037) [2024-08-06 03:49:27,710][52663] DAMAGECOUNT value on done: 445545.0 [2024-08-06 03:49:27,710][52663] Sum rewards: 58.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.136', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.138', 'AMMO4': '0.211', 'AMMO3': '0.263', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.824', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '50.000'} [2024-08-06 03:49:27,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 399212544. Throughput: 0: 4375.8. Samples: 99810980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:49:27,795][52567] Avg episode reward: [(0, '70.199')] [2024-08-06 03:49:27,943][52803] DAMAGECOUNT value on done: 420282.0 [2024-08-06 03:49:27,943][52803] Sum rewards: 73.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.589', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.086', 'AMMO4': '0.096', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.520', 'WEAPON3': '1.650', 'weapon3': '2.990', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:28,576][52811] DAMAGECOUNT value on done: 422032.0 [2024-08-06 03:49:28,576][52811] Sum rewards: 67.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.942', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.066', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:29,023][52670] DAMAGECOUNT value on done: 446197.0 [2024-08-06 03:49:29,025][52670] Sum rewards: 77.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO3': '0.193', 'AMMO4': '0.202', 'weapon5': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:29,147][52666] DAMAGECOUNT value on done: 447418.0 [2024-08-06 03:49:29,149][52666] Sum rewards: 77.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.508', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.184', 'weapon4': '0.194', 'AMMO4': '0.207', 'weapon5': '0.232', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:29,313][52664] DAMAGECOUNT value on done: 470593.0 [2024-08-06 03:49:29,315][52664] Sum rewards: 82.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.317', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.136', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '66.000'} [2024-08-06 03:49:29,564][52647] DAMAGECOUNT value on done: 472178.0 [2024-08-06 03:49:29,564][52647] Sum rewards: 61.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.183', 'weapon2': '0.206', 'AMMO4': '0.213', 'weapon5': '0.286', 'weapon4': '0.376', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '48.000'} [2024-08-06 03:49:30,285][52649] DAMAGECOUNT value on done: 439887.0 [2024-08-06 03:49:30,285][52649] Sum rewards: 65.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.433', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.056', 'AMMO4': '0.114', 'AMMO3': '0.183', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.980', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:30,519][52663] DAMAGECOUNT value on done: 446659.0 [2024-08-06 03:49:30,519][52663] Sum rewards: 71.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.364', 'AMMO5': '0.016', 'ARMOR': '0.036', 'AMMO2': '0.044', 'weapon4': '0.118', 'weapon5': '0.186', 'AMMO3': '0.213', 'AMMO4': '0.222', 'weapon2': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.114', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '60.000'} [2024-08-06 03:49:31,074][52803] DAMAGECOUNT value on done: 417073.0 [2024-08-06 03:49:31,078][52803] Sum rewards: 71.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.177', 'weapon4': '0.224', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:31,629][52811] DAMAGECOUNT value on done: 421158.0 [2024-08-06 03:49:31,631][52811] Sum rewards: 70.047, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.776', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '56.000'} [2024-08-06 03:49:31,672][52670] DAMAGECOUNT value on done: 446609.0 [2024-08-06 03:49:31,673][52670] Sum rewards: 60.518, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.675', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.069', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.390', 'WEAPON3': '0.950', 'HITCOUNT': '3.030', 'weapon3': '3.262', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '46.500'} [2024-08-06 03:49:31,802][52650] Updated weights for policy 0, policy_version 48741 (0.0012) [2024-08-06 03:49:31,869][52666] DAMAGECOUNT value on done: 441093.0 [2024-08-06 03:49:31,873][52666] Sum rewards: 71.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.246', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.149', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.244', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '58.000'} [2024-08-06 03:49:32,549][52664] DAMAGECOUNT value on done: 478052.0 [2024-08-06 03:49:32,551][52664] Sum rewards: 49.197, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.110', 'AMMO5': '0.025', 'AMMO2': '0.079', 'AMMO3': '0.234', 'weapon5': '0.246', 'weapon4': '0.370', 'AMMO4': '0.395', 'weapon2': '0.476', 'WEAPON5': '0.700', 'WEAPON4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.462', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '45.000'} [2024-08-06 03:49:32,693][52647] DAMAGECOUNT value on done: 475115.0 [2024-08-06 03:49:32,694][52647] Sum rewards: 62.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.681', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.144', 'weapon4': '0.204', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.672', 'WEAPON3': '0.850', 'weapon3': '2.662', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '49.000'} [2024-08-06 03:49:32,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 399294464. Throughput: 0: 4377.5. Samples: 99824160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:49:32,795][52567] Avg episode reward: [(0, '70.166')] [2024-08-06 03:49:33,544][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:49:33,552][52663] DAMAGECOUNT value on done: 452650.0 [2024-08-06 03:49:33,553][52663] Sum rewards: 68.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '58.000'} [2024-08-06 03:49:34,049][52795] DAMAGECOUNT value on done: 420522.0 [2024-08-06 03:49:34,049][52795] Sum rewards: 74.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.144', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO3': '0.187', 'AMMO4': '0.213', 'weapon5': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '60.000'} [2024-08-06 03:49:34,119][52803] DAMAGECOUNT value on done: 427249.0 [2024-08-06 03:49:34,120][52803] Sum rewards: 67.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.275', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.094', 'weapon5': '0.112', 'AMMO4': '0.196', 'weapon2': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '59.000'} [2024-08-06 03:49:34,572][52670] DAMAGECOUNT value on done: 443909.0 [2024-08-06 03:49:34,575][52670] Sum rewards: 76.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.499', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.229', 'weapon5': '0.278', 'weapon4': '0.336', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.648', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '64.000'} [2024-08-06 03:49:34,671][52811] DAMAGECOUNT value on done: 422027.0 [2024-08-06 03:49:34,673][52811] Sum rewards: 65.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.052', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.133', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon2': '0.348', 'WEAPON3': '0.850', 'weapon3': '3.086', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '51.000'} [2024-08-06 03:49:34,835][52666] DAMAGECOUNT value on done: 446887.0 [2024-08-06 03:49:34,835][52666] Sum rewards: 76.528, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.591', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.115', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.282', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:35,230][52664] DAMAGECOUNT value on done: 471776.0 [2024-08-06 03:49:35,230][52664] Sum rewards: 62.384, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.066', 'weapon5': '0.188', 'AMMO4': '0.249', 'AMMO3': '0.259', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '54.000'} [2024-08-06 03:49:35,344][52647] DAMAGECOUNT value on done: 469480.0 [2024-08-06 03:49:35,345][52647] Sum rewards: 81.814, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.177', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '65.000'} [2024-08-06 03:49:36,424][52650] Updated weights for policy 0, policy_version 48751 (0.0011) [2024-08-06 03:49:36,574][52663] DAMAGECOUNT value on done: 457123.0 [2024-08-06 03:49:36,577][52663] Sum rewards: 59.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.253', 'weapon2': '0.288', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.520', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:37,186][52795] DAMAGECOUNT value on done: 409379.0 [2024-08-06 03:49:37,194][52795] Sum rewards: 67.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.265', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.044', 'AMMO4': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.144', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '3.350', 'weapon3': '3.516', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '60.000'} [2024-08-06 03:49:37,292][52803] DAMAGECOUNT value on done: 422491.0 [2024-08-06 03:49:37,294][52803] Sum rewards: 57.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '48.000'} [2024-08-06 03:49:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 399384576. Throughput: 0: 4374.9. Samples: 99850330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 03:49:37,794][52567] Avg episode reward: [(0, '69.985')] [2024-08-06 03:49:37,880][52670] DAMAGECOUNT value on done: 450509.0 [2024-08-06 03:49:37,883][52670] Sum rewards: 75.085, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.568', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '65.000'} [2024-08-06 03:49:38,111][52666] DAMAGECOUNT value on done: 444207.0 [2024-08-06 03:49:38,113][52666] Sum rewards: 67.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.154', 'weapon4': '0.174', 'weapon5': '0.210', 'AMMO4': '0.302', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.928', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:38,374][52664] DAMAGECOUNT value on done: 473541.0 [2024-08-06 03:49:38,375][52664] Sum rewards: 65.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.356', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon5': '0.090', 'WEAPON4': '0.150', 'weapon2': '0.150', 'weapon4': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:38,435][52647] DAMAGECOUNT value on done: 477125.0 [2024-08-06 03:49:38,437][52647] Sum rewards: 83.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.178', 'AMMO4': '0.191', 'weapon4': '0.196', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '68.000'} [2024-08-06 03:49:39,689][52663] DAMAGECOUNT value on done: 449930.0 [2024-08-06 03:49:39,691][52663] Sum rewards: 80.527, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.252', 'AMMO3': '0.266', 'weapon2': '0.572', 'WEAPON3': '1.500', 'weapon3': '2.814', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '69.000'} [2024-08-06 03:49:40,276][52795] DAMAGECOUNT value on done: 409979.0 [2024-08-06 03:49:40,278][52795] Sum rewards: 70.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.628', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.102', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.270', 'WEAPON3': '1.100', 'HITCOUNT': '3.440', 'weapon3': '3.488', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '56.500'} [2024-08-06 03:49:40,398][52803] DAMAGECOUNT value on done: 424709.0 [2024-08-06 03:49:40,400][52803] Sum rewards: 63.169, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.646', 'AMMO5': '0.019', 'ARMOR': '0.020', 'AMMO2': '0.052', 'AMMO4': '0.259', 'weapon5': '0.282', 'AMMO3': '0.305', 'weapon2': '0.328', 'weapon4': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.574', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:40,805][52670] DAMAGECOUNT value on done: 442124.0 [2024-08-06 03:49:40,808][52670] Sum rewards: 67.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.472', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.196', 'AMMO4': '0.209', 'AMMO3': '0.234', 'weapon4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:40,896][52664] DAMAGECOUNT value on done: 467097.0 [2024-08-06 03:49:40,897][52664] Sum rewards: 67.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.286', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:40,912][52647] DAMAGECOUNT value on done: 473004.0 [2024-08-06 03:49:40,913][52647] Sum rewards: 75.825, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.518', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.153', 'AMMO3': '0.156', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.596', 'WEAPON3': '0.900', 'weapon3': '2.864', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '59.000'} [2024-08-06 03:49:40,979][52666] DAMAGECOUNT value on done: 456561.0 [2024-08-06 03:49:40,979][52666] Sum rewards: 76.894, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.536', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.120', 'AMMO4': '0.146', 'weapon2': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '66.000'} [2024-08-06 03:49:41,216][52650] Updated weights for policy 0, policy_version 48761 (0.0026) [2024-08-06 03:49:42,055][52614] Signal inference workers to stop experience collection... (8850 times) [2024-08-06 03:49:42,056][52614] Signal inference workers to resume experience collection... (8850 times) [2024-08-06 03:49:42,146][52650] InferenceWorker_p0-w0: stopping experience collection (8850 times) [2024-08-06 03:49:42,146][52650] InferenceWorker_p0-w0: resuming experience collection (8850 times) [2024-08-06 03:49:42,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 399474688. Throughput: 0: 4378.0. Samples: 99876790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:49:42,794][52567] Avg episode reward: [(0, '70.234')] [2024-08-06 03:49:42,807][52663] DAMAGECOUNT value on done: 445627.0 [2024-08-06 03:49:42,807][52663] Sum rewards: 73.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.376', 'ARMOR': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '61.000'} [2024-08-06 03:49:43,488][52647] DAMAGECOUNT value on done: 481766.0 [2024-08-06 03:49:43,490][52647] Sum rewards: 68.580, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.090', 'AMMO3': '0.121', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.568', 'WEAPON3': '0.800', 'HITCOUNT': '3.050', 'weapon3': '3.138', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '53.000'} [2024-08-06 03:49:43,505][52795] DAMAGECOUNT value on done: 416490.0 [2024-08-06 03:49:43,505][52795] Sum rewards: 62.057, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.240', 'AMMO5': '0.021', 'AMMO2': '0.075', 'weapon4': '0.172', 'weapon5': '0.270', 'AMMO3': '0.276', 'weapon2': '0.324', 'AMMO4': '0.374', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'HITCOUNT': '2.840', 'weapon3': '2.862', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '56.000'} [2024-08-06 03:49:43,531][52664] DAMAGECOUNT value on done: 465651.0 [2024-08-06 03:49:43,531][52664] Sum rewards: 59.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.218', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.070', 'AMMO4': '0.153', 'weapon5': '0.202', 'AMMO3': '0.249', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '3.076', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '53.000'} [2024-08-06 03:49:43,669][52803] DAMAGECOUNT value on done: 420206.0 [2024-08-06 03:49:43,671][52803] Sum rewards: 79.304, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.485', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '68.000'} [2024-08-06 03:49:43,869][52670] DAMAGECOUNT value on done: 444006.0 [2024-08-06 03:49:43,869][52670] Sum rewards: 57.628, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.092', 'weapon5': '0.178', 'AMMO4': '0.205', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.946', 'DAMAGECOUNT': '14.511', 'FRAGCOUNT': '49.000'} [2024-08-06 03:49:44,090][52666] DAMAGECOUNT value on done: 452325.0 [2024-08-06 03:49:44,090][52666] Sum rewards: 74.670, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:45,778][52650] Updated weights for policy 0, policy_version 48771 (0.0022) [2024-08-06 03:49:45,820][52647] DAMAGECOUNT value on done: 473707.0 [2024-08-06 03:49:45,820][52647] Sum rewards: 70.637, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.124', 'weapon5': '0.172', 'AMMO4': '0.181', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.050', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:45,874][52664] DAMAGECOUNT value on done: 470178.0 [2024-08-06 03:49:45,874][52664] Sum rewards: 76.319, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.133', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:45,930][52663] DAMAGECOUNT value on done: 444393.0 [2024-08-06 03:49:45,931][52663] Sum rewards: 61.613, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.626', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.152', 'AMMO3': '0.199', 'weapon5': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '50.500'} [2024-08-06 03:49:46,602][52795] DAMAGECOUNT value on done: 412811.0 [2024-08-06 03:49:46,603][52795] Sum rewards: 69.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.140', 'AMMO4': '0.160', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '58.000'} [2024-08-06 03:49:47,011][52670] DAMAGECOUNT value on done: 455047.0 [2024-08-06 03:49:47,013][52670] Sum rewards: 74.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.226', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.432', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '61.000'} [2024-08-06 03:49:47,266][52666] DAMAGECOUNT value on done: 446131.0 [2024-08-06 03:49:47,268][52666] Sum rewards: 67.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.021', 'AMMO2': '0.047', 'weapon4': '0.142', 'AMMO3': '0.202', 'weapon2': '0.216', 'AMMO4': '0.238', 'weapon5': '0.242', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 399564800. Throughput: 0: 4381.1. Samples: 99890060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:49:47,794][52567] Avg episode reward: [(0, '70.075')] [2024-08-06 03:49:48,243][52647] DAMAGECOUNT value on done: 468336.0 [2024-08-06 03:49:48,244][52647] Sum rewards: 62.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.762', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon5': '0.146', 'weapon4': '0.156', 'AMMO3': '0.240', 'AMMO4': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.670', 'WEAPON3': '1.350', 'weapon3': '2.782', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '53.500'} [2024-08-06 03:49:48,334][52664] DAMAGECOUNT value on done: 467557.0 [2024-08-06 03:49:48,335][52664] Sum rewards: 83.417, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '67.000'} [2024-08-06 03:49:49,233][52663] DAMAGECOUNT value on done: 445185.0 [2024-08-06 03:49:49,235][52663] Sum rewards: 54.508, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.098', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon5': '0.204', 'AMMO3': '0.263', 'AMMO4': '0.279', 'weapon2': '0.318', 'weapon4': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.752', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '49.500'} [2024-08-06 03:49:49,728][52795] DAMAGECOUNT value on done: 419814.0 [2024-08-06 03:49:49,730][52795] Sum rewards: 71.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '60.000'} [2024-08-06 03:49:49,832][52667] DAMAGECOUNT value on done: 450073.0 [2024-08-06 03:49:49,832][52667] Sum rewards: 87.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.704', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.106', 'weapon5': '0.118', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '70.000'} [2024-08-06 03:49:50,124][52670] DAMAGECOUNT value on done: 448484.0 [2024-08-06 03:49:50,124][52670] Sum rewards: 58.214, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.570', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.206', 'weapon4': '0.260', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'HITCOUNT': '3.250', 'weapon3': '3.266', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:50,284][52650] Updated weights for policy 0, policy_version 48781 (0.0014) [2024-08-06 03:49:50,382][52666] DAMAGECOUNT value on done: 446923.0 [2024-08-06 03:49:50,384][52666] Sum rewards: 64.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.435', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.123', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.346', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '55.000'} [2024-08-06 03:49:50,729][52647] DAMAGECOUNT value on done: 472264.0 [2024-08-06 03:49:50,730][52647] Sum rewards: 65.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.134', 'AMMO4': '0.153', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.414', 'weapon2': '0.650', 'WEAPON3': '0.800', 'weapon3': '2.428', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:50,847][52664] DAMAGECOUNT value on done: 468111.0 [2024-08-06 03:49:50,848][52664] Sum rewards: 75.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.322', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.130', 'weapon5': '0.132', 'AMMO4': '0.133', 'weapon2': '0.224', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:52,307][52663] DAMAGECOUNT value on done: 456017.0 [2024-08-06 03:49:52,311][52663] Sum rewards: 74.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.170', 'AMMO3': '0.206', 'AMMO4': '0.284', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.676', 'WEAPON3': '1.300', 'weapon3': '2.594', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '62.500'} [2024-08-06 03:49:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 399654912. Throughput: 0: 4384.7. Samples: 99916470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:49:52,794][52567] Avg episode reward: [(0, '70.107')] [2024-08-06 03:49:52,807][52795] DAMAGECOUNT value on done: 426008.0 [2024-08-06 03:49:52,807][52795] Sum rewards: 56.524, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.308', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.116', 'weapon5': '0.158', 'AMMO4': '0.243', 'AMMO3': '0.277', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.600', 'weapon3': '2.826', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '52.000'} [2024-08-06 03:49:52,826][52667] DAMAGECOUNT value on done: 458911.0 [2024-08-06 03:49:52,826][52667] Sum rewards: 72.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.851', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.202', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '61.000'} [2024-08-06 03:49:53,230][52670] DAMAGECOUNT value on done: 434534.0 [2024-08-06 03:49:53,232][52670] Sum rewards: 64.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.354', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon5': '0.100', 'weapon4': '0.200', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon2': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '54.000'} [2024-08-06 03:49:53,372][52666] DAMAGECOUNT value on done: 449992.0 [2024-08-06 03:49:53,373][52666] Sum rewards: 71.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.278', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '60.000'} [2024-08-06 03:49:53,461][52663] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:49:53,495][52647] DAMAGECOUNT value on done: 470968.0 [2024-08-06 03:49:53,496][52647] Sum rewards: 74.486, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.142', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.140', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.258', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:54,976][52650] Updated weights for policy 0, policy_version 48791 (0.0013) [2024-08-06 03:49:55,091][52663] DAMAGECOUNT value on done: 447503.0 [2024-08-06 03:49:55,092][52663] Sum rewards: 73.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.222', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.134', 'weapon4': '0.202', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:55,732][52667] DAMAGECOUNT value on done: 451460.0 [2024-08-06 03:49:55,735][52667] Sum rewards: 66.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.387', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.084', 'weapon5': '0.156', 'AMMO3': '0.219', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '54.000'} [2024-08-06 03:49:55,855][52795] DAMAGECOUNT value on done: 420872.0 [2024-08-06 03:49:55,857][52795] Sum rewards: 79.270, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.960', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.318', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '68.000'} [2024-08-06 03:49:56,101][52670] DAMAGECOUNT value on done: 444225.0 [2024-08-06 03:49:56,102][52670] Sum rewards: 45.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.876', 'AMMO5': '0.021', 'AMMO2': '0.073', 'weapon2': '0.228', 'AMMO3': '0.256', 'AMMO4': '0.364', 'weapon4': '0.384', 'weapon5': '0.394', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.530', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '13.197', 'FRAGCOUNT': '40.000'} [2024-08-06 03:49:56,106][52647] DAMAGECOUNT value on done: 473920.0 [2024-08-06 03:49:56,107][52647] Sum rewards: 78.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon4': '0.210', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:56,324][52666] DAMAGECOUNT value on done: 451221.0 [2024-08-06 03:49:56,326][52666] Sum rewards: 75.536, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.122', 'AMMO3': '0.163', 'weapon4': '0.180', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '63.000'} [2024-08-06 03:49:57,755][52663] DAMAGECOUNT value on done: 454944.0 [2024-08-06 03:49:57,756][52663] Sum rewards: 72.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.189', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.254', 'weapon2': '0.476', 'WEAPON3': '1.650', 'weapon3': '3.300', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 399736832. Throughput: 0: 4387.3. Samples: 99942910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:49:57,795][52567] Avg episode reward: [(0, '69.872')] [2024-08-06 03:49:58,539][52667] DAMAGECOUNT value on done: 452191.0 [2024-08-06 03:49:58,539][52667] Sum rewards: 72.896, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.559', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.281', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '62.000'} [2024-08-06 03:49:58,997][52795] DAMAGECOUNT value on done: 410718.0 [2024-08-06 03:49:58,997][52795] Sum rewards: 80.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.727', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.128', 'weapon4': '0.150', 'AMMO3': '0.188', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '66.000'} [2024-08-06 03:49:59,099][52670] DAMAGECOUNT value on done: 455742.0 [2024-08-06 03:49:59,110][52670] Sum rewards: 67.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.463', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.126', 'AMMO3': '0.201', 'WEAPON3': '1.250', 'HITCOUNT': '3.420', 'weapon3': '3.688', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '57.000'} [2024-08-06 03:49:59,425][52666] DAMAGECOUNT value on done: 439790.0 [2024-08-06 03:49:59,427][52666] Sum rewards: 83.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.628', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.141', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.340', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '66.000'} [2024-08-06 03:49:59,987][52650] Updated weights for policy 0, policy_version 48801 (0.0032) [2024-08-06 03:50:00,580][52663] DAMAGECOUNT value on done: 451699.0 [2024-08-06 03:50:00,582][52663] Sum rewards: 64.963, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.805', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.308', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.278', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '53.000'} [2024-08-06 03:50:01,620][52667] DAMAGECOUNT value on done: 458388.0 [2024-08-06 03:50:01,621][52667] Sum rewards: 62.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.326', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.134', 'AMMO3': '0.189', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '52.000'} [2024-08-06 03:50:01,779][52670] DAMAGECOUNT value on done: 447276.0 [2024-08-06 03:50:01,780][52670] Sum rewards: 69.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon5': '0.172', 'AMMO3': '0.227', 'AMMO4': '0.309', 'weapon2': '0.322', 'WEAPON5': '0.400', 'weapon4': '0.532', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.628', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '58.000'} [2024-08-06 03:50:02,036][52666] DAMAGECOUNT value on done: 446314.0 [2024-08-06 03:50:02,037][52666] Sum rewards: 76.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.195', 'weapon2': '0.444', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.254', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '64.000'} [2024-08-06 03:50:02,236][52795] DAMAGECOUNT value on done: 425519.0 [2024-08-06 03:50:02,236][52795] Sum rewards: 76.311, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.444', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.170', 'weapon4': '0.286', 'weapon2': '0.390', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '61.000'} [2024-08-06 03:50:02,679][52647] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2024-08-06 03:50:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 399818752. Throughput: 0: 4385.2. Samples: 99955850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:50:02,794][52567] Avg episode reward: [(0, '69.696')] [2024-08-06 03:50:03,850][52663] DAMAGECOUNT value on done: 445565.0 [2024-08-06 03:50:03,852][52663] Sum rewards: 68.242, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.314', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.182', 'AMMO4': '0.189', 'AMMO3': '0.287', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '58.000'} [2024-08-06 03:50:04,276][52670] DAMAGECOUNT value on done: 450178.0 [2024-08-06 03:50:04,278][52670] Sum rewards: 63.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.501', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.138', 'AMMO3': '0.221', 'weapon5': '0.244', 'AMMO4': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '2.708', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '53.000'} [2024-08-06 03:50:04,387][52667] DAMAGECOUNT value on done: 461607.0 [2024-08-06 03:50:04,389][52667] Sum rewards: 80.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO2': '0.002', 'AMMO4': '0.007', 'AMMO5': '0.008', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.676', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '65.000'} [2024-08-06 03:50:04,423][52650] Updated weights for policy 0, policy_version 48811 (0.0027) [2024-08-06 03:50:05,356][52795] DAMAGECOUNT value on done: 417939.0 [2024-08-06 03:50:05,356][52795] Sum rewards: 70.527, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.078', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.258', 'weapon4': '0.258', 'AMMO3': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:07,500][52667] DAMAGECOUNT value on done: 453312.0 [2024-08-06 03:50:07,502][52667] Sum rewards: 60.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.092', 'weapon5': '0.112', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.532', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.012', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '53.000'} [2024-08-06 03:50:07,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 399908864. Throughput: 0: 4387.6. Samples: 99982380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:50:07,794][52567] Avg episode reward: [(0, '69.697')] [2024-08-06 03:50:08,468][52795] DAMAGECOUNT value on done: 415665.0 [2024-08-06 03:50:08,469][52795] Sum rewards: 74.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.744', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.180', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:08,949][52650] Updated weights for policy 0, policy_version 48821 (0.0037) [2024-08-06 03:50:09,840][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:50:10,318][52669] DAMAGECOUNT value on done: 456862.0 [2024-08-06 03:50:10,319][52669] Sum rewards: 62.962, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.080', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon2': '0.218', 'weapon5': '0.228', 'AMMO3': '0.247', 'AMMO4': '0.251', 'weapon4': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '54.000'} [2024-08-06 03:50:10,600][52667] DAMAGECOUNT value on done: 453563.0 [2024-08-06 03:50:10,601][52667] Sum rewards: 68.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.127', 'weapon5': '0.164', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:11,643][52795] DAMAGECOUNT value on done: 413838.0 [2024-08-06 03:50:11,644][52795] Sum rewards: 80.657, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.085', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.098', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON3': '1.750', 'weapon3': '3.472', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '71.000'} [2024-08-06 03:50:12,736][52658] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:50:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 399998976. Throughput: 0: 4392.0. Samples: 100008620. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 03:50:12,794][52567] Avg episode reward: [(0, '69.760')] [2024-08-06 03:50:12,927][52669] DAMAGECOUNT value on done: 446587.0 [2024-08-06 03:50:12,930][52669] Sum rewards: 63.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.038', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.158', 'AMMO3': '0.217', 'weapon5': '0.224', 'AMMO4': '0.305', 'weapon2': '0.328', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '53.500'} [2024-08-06 03:50:13,610][52667] DAMAGECOUNT value on done: 456758.0 [2024-08-06 03:50:13,612][52667] Sum rewards: 59.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.900', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.111', 'weapon5': '0.112', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.206', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '50.500'} [2024-08-06 03:50:13,914][52650] Updated weights for policy 0, policy_version 48831 (0.0010) [2024-08-06 03:50:14,755][52795] DAMAGECOUNT value on done: 421048.0 [2024-08-06 03:50:14,756][52795] Sum rewards: 62.468, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.322', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.048', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.252', 'AMMO3': '0.273', 'WEAPON3': '1.750', 'HITCOUNT': '3.100', 'weapon3': '3.468', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:15,986][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:50:16,035][52669] DAMAGECOUNT value on done: 455172.0 [2024-08-06 03:50:16,037][52669] Sum rewards: 65.241, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.098', 'AMMO4': '0.145', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.830', 'weapon3': '3.456', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '53.000'} [2024-08-06 03:50:16,771][52667] DAMAGECOUNT value on done: 462477.0 [2024-08-06 03:50:16,771][52667] Sum rewards: 65.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.980', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.213', 'weapon4': '0.260', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:17,549][52820] DAMAGECOUNT value on done: 415698.0 [2024-08-06 03:50:17,551][52820] Sum rewards: 59.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.410', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.160', 'weapon4': '0.178', 'weapon2': '0.218', 'AMMO4': '0.221', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '2.910', 'weapon3': '3.172', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '52.000'} [2024-08-06 03:50:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17494.8). Total num frames: 400089088. Throughput: 0: 4392.0. Samples: 100021800. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 03:50:17,802][52567] Avg episode reward: [(0, '69.221')] [2024-08-06 03:50:17,973][52795] DAMAGECOUNT value on done: 411389.0 [2024-08-06 03:50:17,974][52795] Sum rewards: 73.051, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.182', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.372', 'WEAPON3': '1.700', 'weapon3': '3.104', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '63.000'} [2024-08-06 03:50:18,401][52650] Updated weights for policy 0, policy_version 48841 (0.0019) [2024-08-06 03:50:18,510][52668] DAMAGECOUNT value on done: 452638.0 [2024-08-06 03:50:18,512][52668] Sum rewards: 66.728, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.033', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '58.000'} [2024-08-06 03:50:19,033][52669] DAMAGECOUNT value on done: 452646.0 [2024-08-06 03:50:19,034][52669] Sum rewards: 71.631, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.535', 'AMMO5': '0.020', 'AMMO2': '0.068', 'weapon4': '0.098', 'weapon5': '0.228', 'AMMO3': '0.284', 'AMMO4': '0.339', 'weapon2': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.988', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '61.500'} [2024-08-06 03:50:19,879][52667] DAMAGECOUNT value on done: 450365.0 [2024-08-06 03:50:19,880][52667] Sum rewards: 80.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.046', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '64.000'} [2024-08-06 03:50:20,628][52820] DAMAGECOUNT value on done: 419554.0 [2024-08-06 03:50:20,630][52820] Sum rewards: 66.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.161', 'weapon5': '0.202', 'AMMO4': '0.244', 'weapon4': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.734', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '54.000'} [2024-08-06 03:50:21,174][52795] DAMAGECOUNT value on done: 429540.0 [2024-08-06 03:50:21,175][52795] Sum rewards: 72.492, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.132', 'AMMO3': '0.194', 'AMMO4': '0.246', 'weapon5': '0.256', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:21,232][52668] DAMAGECOUNT value on done: 456589.0 [2024-08-06 03:50:21,232][52668] Sum rewards: 75.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.676', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.114', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '63.000'} [2024-08-06 03:50:22,147][52669] DAMAGECOUNT value on done: 452322.0 [2024-08-06 03:50:22,150][52669] Sum rewards: 75.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '63.000'} [2024-08-06 03:50:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 400179200. Throughput: 0: 4387.6. Samples: 100047770. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 03:50:22,794][52567] Avg episode reward: [(0, '69.629')] [2024-08-06 03:50:23,102][52667] DAMAGECOUNT value on done: 452259.0 [2024-08-06 03:50:23,103][52667] Sum rewards: 68.461, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.008', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.121', 'weapon5': '0.146', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.366', 'weapon4': '0.378', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:23,602][52650] Updated weights for policy 0, policy_version 48851 (0.0023) [2024-08-06 03:50:23,779][52820] DAMAGECOUNT value on done: 420245.0 [2024-08-06 03:50:23,781][52820] Sum rewards: 72.411, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.188', 'weapon4': '0.218', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '61.000'} [2024-08-06 03:50:24,298][52668] DAMAGECOUNT value on done: 456246.0 [2024-08-06 03:50:24,298][52668] Sum rewards: 69.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.864', 'AMMO5': '0.027', 'AMMO2': '0.064', 'AMMO3': '0.202', 'weapon4': '0.206', 'weapon2': '0.272', 'AMMO4': '0.320', 'weapon5': '0.424', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '58.000'} [2024-08-06 03:50:24,355][52795] DAMAGECOUNT value on done: 421504.0 [2024-08-06 03:50:24,355][52795] Sum rewards: 72.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.528', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.078', 'AMMO4': '0.100', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.450', 'HITCOUNT': '3.450', 'weapon3': '3.522', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '61.500'} [2024-08-06 03:50:25,184][52669] DAMAGECOUNT value on done: 457720.0 [2024-08-06 03:50:25,184][52669] Sum rewards: 66.582, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.015', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO3': '0.201', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.188', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:26,420][52667] DAMAGECOUNT value on done: 457589.0 [2024-08-06 03:50:26,421][52667] Sum rewards: 73.991, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.046', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.142', 'weapon4': '0.214', 'AMMO4': '0.227', 'WEAPON4': '0.400', 'weapon5': '0.444', 'weapon2': '0.446', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.608', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:26,733][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:50:26,832][52820] DAMAGECOUNT value on done: 414662.0 [2024-08-06 03:50:26,832][52820] Sum rewards: 77.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.152', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '63.000'} [2024-08-06 03:50:26,874][52795] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2024-08-06 03:50:27,264][52668] DAMAGECOUNT value on done: 459082.0 [2024-08-06 03:50:27,265][52668] Sum rewards: 80.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon4': '0.252', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '68.000'} [2024-08-06 03:50:27,597][52795] DAMAGECOUNT value on done: 412901.0 [2024-08-06 03:50:27,597][52795] Sum rewards: 76.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.409', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.038', 'weapon5': '0.050', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.496', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '63.000'} [2024-08-06 03:50:27,654][52650] Updated weights for policy 0, policy_version 48861 (0.0025) [2024-08-06 03:50:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 400269312. Throughput: 0: 4381.5. Samples: 100073960. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 03:50:27,794][52567] Avg episode reward: [(0, '69.884')] [2024-08-06 03:50:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048861_400269312.pth... [2024-08-06 03:50:27,961][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048347_396058624.pth [2024-08-06 03:50:28,267][52669] DAMAGECOUNT value on done: 453589.0 [2024-08-06 03:50:28,267][52669] Sum rewards: 71.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.147', 'AMMO3': '0.197', 'weapon2': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '58.000'} [2024-08-06 03:50:29,363][52667] DAMAGECOUNT value on done: 451029.0 [2024-08-06 03:50:29,364][52667] Sum rewards: 73.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.237', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon5': '0.220', 'weapon2': '0.240', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:29,908][52668] DAMAGECOUNT value on done: 446901.0 [2024-08-06 03:50:29,910][52668] Sum rewards: 74.580, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.381', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.240', 'AMMO4': '0.242', 'weapon4': '0.248', 'weapon2': '0.254', 'AMMO3': '0.263', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '64.000'} [2024-08-06 03:50:29,942][52662] DAMAGECOUNT value on done: 458329.0 [2024-08-06 03:50:29,943][52662] Sum rewards: 81.169, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.505', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon2': '0.148', 'AMMO3': '0.264', 'WEAPON3': '1.750', 'weapon3': '3.664', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '71.000'} [2024-08-06 03:50:30,029][52820] DAMAGECOUNT value on done: 423768.0 [2024-08-06 03:50:30,032][52820] Sum rewards: 79.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.192', 'AMMO4': '0.194', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '65.000'} [2024-08-06 03:50:30,965][52795] DAMAGECOUNT value on done: 421530.0 [2024-08-06 03:50:30,966][52795] Sum rewards: 69.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.465', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon5': '0.114', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.498', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '59.000'} [2024-08-06 03:50:31,456][52669] DAMAGECOUNT value on done: 454970.0 [2024-08-06 03:50:31,457][52669] Sum rewards: 68.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.415', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.196', 'weapon4': '0.234', 'weapon2': '0.248', 'weapon5': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:31,945][52671] DAMAGECOUNT value on done: 457906.0 [2024-08-06 03:50:31,946][52671] Sum rewards: 67.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.248', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.022', 'weapon5': '0.038', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '3.260', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '54.000'} [2024-08-06 03:50:32,147][52667] DAMAGECOUNT value on done: 457659.0 [2024-08-06 03:50:32,148][52667] Sum rewards: 69.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.585', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.148', 'weapon4': '0.156', 'weapon2': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:32,411][52668] DAMAGECOUNT value on done: 456445.0 [2024-08-06 03:50:32,412][52668] Sum rewards: 69.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.378', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'weapon4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.294', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.380', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:32,619][52662] DAMAGECOUNT value on done: 460669.0 [2024-08-06 03:50:32,619][52662] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.723', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.136', 'weapon4': '0.148', 'AMMO4': '0.168', 'AMMO3': '0.199', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:32,766][52650] Updated weights for policy 0, policy_version 48871 (0.0015) [2024-08-06 03:50:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 400351232. Throughput: 0: 4370.9. Samples: 100086750. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 03:50:32,795][52567] Avg episode reward: [(0, '70.426')] [2024-08-06 03:50:33,227][52820] DAMAGECOUNT value on done: 413532.0 [2024-08-06 03:50:33,227][52820] Sum rewards: 65.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.304', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.080', 'weapon5': '0.184', 'AMMO4': '0.211', 'AMMO3': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.650', 'weapon3': '2.968', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:34,187][52795] DAMAGECOUNT value on done: 423630.0 [2024-08-06 03:50:34,189][52795] Sum rewards: 76.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '63.000'} [2024-08-06 03:50:34,633][52669] DAMAGECOUNT value on done: 459371.0 [2024-08-06 03:50:34,634][52669] Sum rewards: 81.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.108', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.120', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '65.000'} [2024-08-06 03:50:34,699][52671] DAMAGECOUNT value on done: 458640.0 [2024-08-06 03:50:34,701][52671] Sum rewards: 71.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.170', 'AMMO3': '0.173', 'weapon2': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:34,720][52667] DAMAGECOUNT value on done: 462816.0 [2024-08-06 03:50:34,721][52667] Sum rewards: 65.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.066', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.238', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.394', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:35,313][52662] DAMAGECOUNT value on done: 459140.0 [2024-08-06 03:50:35,321][52662] Sum rewards: 66.835, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.280', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.066', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'HITCOUNT': '3.280', 'weapon3': '3.426', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:35,608][52668] DAMAGECOUNT value on done: 458092.0 [2024-08-06 03:50:35,610][52668] Sum rewards: 72.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.356', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.252', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '59.000'} [2024-08-06 03:50:35,686][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:50:36,151][52820] DAMAGECOUNT value on done: 417728.0 [2024-08-06 03:50:36,154][52820] Sum rewards: 67.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.172', 'AMMO3': '0.212', 'weapon5': '0.250', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:37,072][52650] Updated weights for policy 0, policy_version 48881 (0.0023) [2024-08-06 03:50:37,520][52671] DAMAGECOUNT value on done: 457594.0 [2024-08-06 03:50:37,522][52671] Sum rewards: 75.202, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.655', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon4': '0.176', 'AMMO3': '0.184', 'weapon5': '0.202', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '61.000'} [2024-08-06 03:50:37,695][52667] DAMAGECOUNT value on done: 460964.0 [2024-08-06 03:50:37,698][52667] Sum rewards: 64.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.176', 'AMMO4': '0.190', 'weapon5': '0.240', 'AMMO3': '0.261', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.910', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:37,760][52669] DAMAGECOUNT value on done: 452472.0 [2024-08-06 03:50:37,762][52669] Sum rewards: 60.728, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.180', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO4': '0.192', 'weapon2': '0.278', 'weapon4': '0.286', 'AMMO3': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '2.946', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 400433152. Throughput: 0: 4373.3. Samples: 100113270. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 03:50:37,794][52567] Avg episode reward: [(0, '70.505')] [2024-08-06 03:50:38,191][52662] DAMAGECOUNT value on done: 448313.0 [2024-08-06 03:50:38,193][52662] Sum rewards: 68.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.561', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.166', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.472', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.508', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:38,412][52668] DAMAGECOUNT value on done: 448962.0 [2024-08-06 03:50:38,412][52668] Sum rewards: 56.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.226', 'weapon5': '0.244', 'AMMO4': '0.257', 'weapon4': '0.334', 'weapon2': '0.528', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.614', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '49.000'} [2024-08-06 03:50:39,318][52820] DAMAGECOUNT value on done: 421772.0 [2024-08-06 03:50:39,318][52820] Sum rewards: 55.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.753', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.174', 'weapon5': '0.232', 'AMMO4': '0.233', 'AMMO3': '0.260', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.790', 'weapon3': '2.898', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '50.000'} [2024-08-06 03:50:39,610][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:50:40,682][52660] DAMAGECOUNT value on done: 453331.0 [2024-08-06 03:50:40,682][52660] Sum rewards: 76.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO2': '0.015', 'AMMO5': '0.017', 'AMMO4': '0.076', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '62.000'} [2024-08-06 03:50:40,819][52668] DAMAGECOUNT value on done: 450794.0 [2024-08-06 03:50:40,819][52668] Sum rewards: 68.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.964', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.213', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.456', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2024-08-06 03:50:40,830][52669] DAMAGECOUNT value on done: 459612.0 [2024-08-06 03:50:40,831][52669] Sum rewards: 73.408, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.056', 'HEALTH': '0.146', 'AMMO3': '0.208', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.394', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:40,940][52667] DAMAGECOUNT value on done: 459669.0 [2024-08-06 03:50:40,941][52667] Sum rewards: 65.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.971', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon4': '0.080', 'AMMO4': '0.132', 'AMMO3': '0.183', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '54.000'} [2024-08-06 03:50:41,080][52662] DAMAGECOUNT value on done: 460180.0 [2024-08-06 03:50:41,080][52662] Sum rewards: 74.148, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.996', 'AMMO5': '0.011', 'weapon5': '0.024', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.164', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.356', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '65.000'} [2024-08-06 03:50:41,116][52671] DAMAGECOUNT value on done: 455280.0 [2024-08-06 03:50:41,116][52671] Sum rewards: 61.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.092', 'weapon4': '0.140', 'AMMO3': '0.195', 'weapon2': '0.202', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.308', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '51.000'} [2024-08-06 03:50:42,248][52650] Updated weights for policy 0, policy_version 48891 (0.0012) [2024-08-06 03:50:42,439][52820] DAMAGECOUNT value on done: 416789.0 [2024-08-06 03:50:42,441][52820] Sum rewards: 66.676, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.213', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.103', 'weapon5': '0.126', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.092', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 400531456. Throughput: 0: 4366.9. Samples: 100139420. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 03:50:42,795][52567] Avg episode reward: [(0, '70.117')] [2024-08-06 03:50:42,914][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:50:43,356][52660] DAMAGECOUNT value on done: 447029.0 [2024-08-06 03:50:43,356][52660] Sum rewards: 66.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.222', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.094', 'weapon4': '0.106', 'AMMO4': '0.169', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:43,411][52668] DAMAGECOUNT value on done: 458144.0 [2024-08-06 03:50:43,412][52668] Sum rewards: 72.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.224', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.094', 'weapon4': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '59.000'} [2024-08-06 03:50:43,845][52667] DAMAGECOUNT value on done: 453289.0 [2024-08-06 03:50:43,847][52667] Sum rewards: 74.810, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.950', 'AMMO5': '0.006', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.028', 'AMMO4': '0.060', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '61.000'} [2024-08-06 03:50:43,968][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:50:44,016][52669] DAMAGECOUNT value on done: 457499.0 [2024-08-06 03:50:44,017][52669] Sum rewards: 82.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.068', 'weapon5': '0.116', 'AMMO3': '0.195', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '66.000'} [2024-08-06 03:50:44,021][52671] DAMAGECOUNT value on done: 464975.0 [2024-08-06 03:50:44,022][52671] Sum rewards: 74.473, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.064', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.140', 'weapon4': '0.162', 'weapon2': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.230', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '65.000'} [2024-08-06 03:50:44,289][52662] DAMAGECOUNT value on done: 452088.0 [2024-08-06 03:50:44,289][52662] Sum rewards: 55.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.912', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.167', 'weapon2': '0.406', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.214', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '45.000'} [2024-08-06 03:50:45,559][52820] DAMAGECOUNT value on done: 426842.0 [2024-08-06 03:50:45,560][52820] Sum rewards: 75.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.944', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '62.000'} [2024-08-06 03:50:45,855][52660] DAMAGECOUNT value on done: 457391.0 [2024-08-06 03:50:45,863][52660] Sum rewards: 69.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.596', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.066', 'AMMO4': '0.128', 'weapon5': '0.238', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '59.000'} [2024-08-06 03:50:45,878][52668] DAMAGECOUNT value on done: 454118.0 [2024-08-06 03:50:45,878][52668] Sum rewards: 69.360, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.425', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.150', 'AMMO4': '0.225', 'weapon5': '0.320', 'weapon4': '0.364', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.546', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:46,391][52667] DAMAGECOUNT value on done: 460350.0 [2024-08-06 03:50:46,393][52667] Sum rewards: 67.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.121', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'weapon4': '0.198', 'weapon2': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.184', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:46,654][52650] Updated weights for policy 0, policy_version 48901 (0.0034) [2024-08-06 03:50:46,781][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:50:46,853][52671] DAMAGECOUNT value on done: 454881.0 [2024-08-06 03:50:46,853][52671] Sum rewards: 71.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.044', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon2': '0.486', 'WEAPON3': '0.900', 'weapon3': '3.220', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:47,097][52669] DAMAGECOUNT value on done: 445592.0 [2024-08-06 03:50:47,099][52669] Sum rewards: 74.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.562', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.056', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '62.000'} [2024-08-06 03:50:47,185][52658] DAMAGECOUNT value on done: 452086.0 [2024-08-06 03:50:47,185][52658] Sum rewards: 66.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.061', 'weapon4': '0.132', 'AMMO3': '0.214', 'weapon5': '0.298', 'AMMO4': '0.306', 'weapon2': '0.560', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.616', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '55.500'} [2024-08-06 03:50:47,453][52662] DAMAGECOUNT value on done: 462744.0 [2024-08-06 03:50:47,454][52662] Sum rewards: 71.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.219', 'weapon4': '0.220', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 400613376. Throughput: 0: 4372.0. Samples: 100152590. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 03:50:47,794][52567] Avg episode reward: [(0, '70.307')] [2024-08-06 03:50:48,656][52820] DAMAGECOUNT value on done: 416615.0 [2024-08-06 03:50:48,656][52820] Sum rewards: 66.271, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.130', 'weapon4': '0.142', 'AMMO4': '0.148', 'HEALTH': '0.150', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:48,912][52660] DAMAGECOUNT value on done: 460943.0 [2024-08-06 03:50:48,913][52660] Sum rewards: 73.463, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.904', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.143', 'weapon4': '0.184', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '62.000'} [2024-08-06 03:50:48,944][52668] DAMAGECOUNT value on done: 448688.0 [2024-08-06 03:50:48,944][52668] Sum rewards: 66.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon2': '0.182', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:49,862][52671] DAMAGECOUNT value on done: 461126.0 [2024-08-06 03:50:49,863][52671] Sum rewards: 69.612, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.670', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.165', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.894', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '56.000'} [2024-08-06 03:50:49,887][52658] DAMAGECOUNT value on done: 454849.0 [2024-08-06 03:50:49,887][52658] Sum rewards: 63.293, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.400', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.124', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.000', 'HITCOUNT': '3.150', 'weapon3': '3.200', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '50.000'} [2024-08-06 03:50:50,254][52669] DAMAGECOUNT value on done: 457112.0 [2024-08-06 03:50:50,254][52669] Sum rewards: 52.718, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.582', 'AMMO5': '0.026', 'AMMO2': '0.086', 'AMMO3': '0.218', 'weapon5': '0.230', 'weapon4': '0.362', 'weapon2': '0.370', 'AMMO4': '0.432', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'HITCOUNT': '2.620', 'weapon3': '2.634', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '47.500'} [2024-08-06 03:50:50,565][52662] DAMAGECOUNT value on done: 464823.0 [2024-08-06 03:50:50,565][52662] Sum rewards: 66.635, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.116', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '54.000'} [2024-08-06 03:50:51,427][52650] Updated weights for policy 0, policy_version 48911 (0.0011) [2024-08-06 03:50:51,471][52662] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:50:51,720][52820] DAMAGECOUNT value on done: 421541.0 [2024-08-06 03:50:51,721][52820] Sum rewards: 67.721, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.082', 'AMMO4': '0.168', 'weapon4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:51,896][52660] DAMAGECOUNT value on done: 453653.0 [2024-08-06 03:50:51,898][52660] Sum rewards: 75.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '62.000'} [2024-08-06 03:50:51,925][52668] DAMAGECOUNT value on done: 444253.0 [2024-08-06 03:50:51,928][52668] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.225', 'weapon2': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.332', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '58.000'} [2024-08-06 03:50:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 400703488. Throughput: 0: 4369.6. Samples: 100179010. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 03:50:52,794][52567] Avg episode reward: [(0, '69.878')] [2024-08-06 03:50:52,809][52671] DAMAGECOUNT value on done: 458163.0 [2024-08-06 03:50:52,810][52671] Sum rewards: 63.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.050', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon5': '0.216', 'AMMO3': '0.237', 'weapon4': '0.246', 'AMMO4': '0.295', 'weapon2': '0.382', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:52,907][52658] DAMAGECOUNT value on done: 459533.0 [2024-08-06 03:50:52,907][52658] Sum rewards: 70.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.074', 'AMMO4': '0.170', 'AMMO3': '0.188', 'weapon4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:53,076][52666] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:50:53,193][52669] DAMAGECOUNT value on done: 459419.0 [2024-08-06 03:50:53,195][52669] Sum rewards: 70.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.450', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.195', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '56.500'} [2024-08-06 03:50:53,413][52662] DAMAGECOUNT value on done: 452709.0 [2024-08-06 03:50:53,413][52662] Sum rewards: 77.357, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.175', 'HEALTH': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '63.000'} [2024-08-06 03:50:53,544][52665] DAMAGECOUNT value on done: 444391.0 [2024-08-06 03:50:53,545][52665] Sum rewards: 54.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.119', 'weapon2': '0.180', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'HITCOUNT': '2.960', 'weapon3': '3.180', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '49.000'} [2024-08-06 03:50:54,469][52660] DAMAGECOUNT value on done: 451470.0 [2024-08-06 03:50:54,470][52660] Sum rewards: 72.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.046', 'AMMO4': '0.150', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.228', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '60.000'} [2024-08-06 03:50:54,476][52668] DAMAGECOUNT value on done: 444529.0 [2024-08-06 03:50:54,476][52668] Sum rewards: 69.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.413', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.156', 'weapon5': '0.160', 'AMMO3': '0.183', 'AMMO4': '0.324', 'weapon2': '0.366', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:54,797][52820] DAMAGECOUNT value on done: 425652.0 [2024-08-06 03:50:54,797][52820] Sum rewards: 80.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.555', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.164', 'AMMO3': '0.208', 'AMMO4': '0.210', 'weapon5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '67.000'} [2024-08-06 03:50:55,726][52671] DAMAGECOUNT value on done: 452644.0 [2024-08-06 03:50:55,727][52671] Sum rewards: 63.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.204', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.240', 'AMMO3': '0.273', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:55,979][52650] Updated weights for policy 0, policy_version 48921 (0.0024) [2024-08-06 03:50:56,002][52658] DAMAGECOUNT value on done: 457524.0 [2024-08-06 03:50:56,003][52658] Sum rewards: 63.737, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.303', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.040', 'weapon4': '0.044', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.320', 'WEAPON3': '1.850', 'HITCOUNT': '3.380', 'weapon3': '3.470', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:56,058][52662] DAMAGECOUNT value on done: 465829.0 [2024-08-06 03:50:56,061][52662] Sum rewards: 76.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.134', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.268', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.214', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '66.000'} [2024-08-06 03:50:56,086][52665] DAMAGECOUNT value on done: 455137.0 [2024-08-06 03:50:56,086][52665] Sum rewards: 78.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.884', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.201', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.272', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '65.000'} [2024-08-06 03:50:56,244][52669] DAMAGECOUNT value on done: 469653.0 [2024-08-06 03:50:56,244][52669] Sum rewards: 66.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.233', 'weapon2': '0.254', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.498', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '55.000'} [2024-08-06 03:50:57,211][52668] DAMAGECOUNT value on done: 444145.0 [2024-08-06 03:50:57,228][52668] Sum rewards: 71.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '59.000'} [2024-08-06 03:50:57,252][52660] DAMAGECOUNT value on done: 451380.0 [2024-08-06 03:50:57,260][52660] Sum rewards: 61.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.228', 'weapon5': '0.278', 'weapon2': '0.280', 'weapon4': '0.286', 'AMMO4': '0.313', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.846', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '52.000'} [2024-08-06 03:50:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 400793600. Throughput: 0: 4372.9. Samples: 100205400. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 03:50:57,795][52567] Avg episode reward: [(0, '69.685')] [2024-08-06 03:50:57,876][52820] DAMAGECOUNT value on done: 420559.0 [2024-08-06 03:50:57,878][52820] Sum rewards: 66.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.829', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.150', 'AMMO3': '0.231', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.604', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '57.000'} [2024-08-06 03:50:58,586][52662] DAMAGECOUNT value on done: 452123.0 [2024-08-06 03:50:58,587][52662] Sum rewards: 60.562, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.467', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.092', 'weapon4': '0.118', 'AMMO4': '0.181', 'AMMO3': '0.229', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.154', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '53.000'} [2024-08-06 03:50:58,609][52658] DAMAGECOUNT value on done: 446715.0 [2024-08-06 03:50:58,611][52658] Sum rewards: 61.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.496', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.122', 'AMMO4': '0.204', 'AMMO3': '0.232', 'weapon4': '0.348', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '53.000'} [2024-08-06 03:50:58,721][52665] DAMAGECOUNT value on done: 452159.0 [2024-08-06 03:50:58,722][52665] Sum rewards: 77.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.132', 'AMMO4': '0.151', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '65.000'} [2024-08-06 03:50:58,725][52671] DAMAGECOUNT value on done: 460529.0 [2024-08-06 03:50:58,726][52671] Sum rewards: 69.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon5': '0.224', 'AMMO3': '0.240', 'weapon2': '0.296', 'AMMO4': '0.311', 'weapon4': '0.494', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.658', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '59.000'} [2024-08-06 03:50:59,475][52669] DAMAGECOUNT value on done: 458968.0 [2024-08-06 03:50:59,477][52669] Sum rewards: 86.546, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.074', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.032', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.290', 'weapon4': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '70.000'} [2024-08-06 03:50:59,793][52668] DAMAGECOUNT value on done: 452767.0 [2024-08-06 03:50:59,794][52668] Sum rewards: 84.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.909', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.196', 'weapon5': '0.210', 'AMMO4': '0.224', 'weapon2': '0.308', 'weapon4': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '69.000'} [2024-08-06 03:50:59,819][52660] DAMAGECOUNT value on done: 459149.0 [2024-08-06 03:50:59,821][52660] Sum rewards: 81.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.034', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO3': '0.184', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '66.000'} [2024-08-06 03:51:00,727][52650] Updated weights for policy 0, policy_version 48931 (0.0037) [2024-08-06 03:51:01,124][52820] DAMAGECOUNT value on done: 426030.0 [2024-08-06 03:51:01,125][52820] Sum rewards: 74.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.356', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.112', 'weapon5': '0.186', 'AMMO4': '0.190', 'AMMO3': '0.214', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '62.000'} [2024-08-06 03:51:01,185][52662] DAMAGECOUNT value on done: 456781.0 [2024-08-06 03:51:01,186][52662] Sum rewards: 67.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.172', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.144', 'weapon5': '0.196', 'AMMO4': '0.202', 'AMMO3': '0.219', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '56.000'} [2024-08-06 03:51:01,346][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:51:01,587][52658] DAMAGECOUNT value on done: 453836.0 [2024-08-06 03:51:01,589][52658] Sum rewards: 71.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.394', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.130', 'AMMO3': '0.182', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '60.000'} [2024-08-06 03:51:01,842][52665] DAMAGECOUNT value on done: 448806.0 [2024-08-06 03:51:01,843][52665] Sum rewards: 77.731, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.764', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.128', 'AMMO4': '0.137', 'weapon5': '0.176', 'weapon2': '0.222', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '65.000'} [2024-08-06 03:51:01,854][52671] DAMAGECOUNT value on done: 463398.0 [2024-08-06 03:51:01,855][52671] Sum rewards: 62.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO3': '0.146', 'AMMO4': '0.172', 'weapon4': '0.184', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.940', 'weapon3': '3.050', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '50.000'} [2024-08-06 03:51:02,414][52669] DAMAGECOUNT value on done: 458030.0 [2024-08-06 03:51:02,425][52669] Sum rewards: 63.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon2': '0.190', 'weapon5': '0.240', 'AMMO4': '0.240', 'AMMO3': '0.256', 'weapon4': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '2.898', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '55.000'} [2024-08-06 03:51:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 400875520. Throughput: 0: 4374.9. Samples: 100218670. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 03:51:02,794][52567] Avg episode reward: [(0, '70.395')] [2024-08-06 03:51:02,839][52668] DAMAGECOUNT value on done: 454729.0 [2024-08-06 03:51:02,841][52668] Sum rewards: 63.903, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.184', 'AMMO3': '0.246', 'AMMO4': '0.256', 'weapon5': '0.282', 'weapon2': '0.288', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.842', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '55.500'} [2024-08-06 03:51:02,895][52660] DAMAGECOUNT value on done: 456742.0 [2024-08-06 03:51:02,895][52660] Sum rewards: 66.992, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.876', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.168', 'AMMO4': '0.218', 'AMMO3': '0.231', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.052', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '55.500'} [2024-08-06 03:51:03,986][52662] DAMAGECOUNT value on done: 455041.0 [2024-08-06 03:51:03,988][52662] Sum rewards: 69.681, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.445', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'weapon4': '0.164', 'AMMO3': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '58.000'} [2024-08-06 03:51:04,307][52820] DAMAGECOUNT value on done: 419671.0 [2024-08-06 03:51:04,310][52820] Sum rewards: 69.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.368', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.182', 'weapon4': '0.248', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '60.000'} [2024-08-06 03:51:04,321][52658] DAMAGECOUNT value on done: 457270.0 [2024-08-06 03:51:04,322][52658] Sum rewards: 82.590, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.422', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.268', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '68.000'} [2024-08-06 03:51:04,896][52671] DAMAGECOUNT value on done: 456959.0 [2024-08-06 03:51:04,896][52671] Sum rewards: 78.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.973', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.114', 'weapon5': '0.188', 'AMMO3': '0.225', 'AMMO4': '0.233', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '66.000'} [2024-08-06 03:51:05,072][52665] DAMAGECOUNT value on done: 440285.0 [2024-08-06 03:51:05,072][52665] Sum rewards: 62.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.075', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.213', 'weapon4': '0.236', 'weapon5': '0.248', 'AMMO4': '0.329', 'weapon2': '0.602', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.612', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '52.000'} [2024-08-06 03:51:05,079][52669] DAMAGECOUNT value on done: 460095.0 [2024-08-06 03:51:05,079][52669] Sum rewards: 71.517, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'AMMO3': '0.185', 'weapon4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '58.000'} [2024-08-06 03:51:05,391][52650] Updated weights for policy 0, policy_version 48941 (0.0020) [2024-08-06 03:51:05,664][52668] DAMAGECOUNT value on done: 453085.0 [2024-08-06 03:51:05,665][52668] Sum rewards: 68.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.605', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.056', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.267', 'WEAPON3': '1.700', 'HITCOUNT': '3.260', 'weapon3': '3.436', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '61.000'} [2024-08-06 03:51:05,770][52660] DAMAGECOUNT value on done: 450220.0 [2024-08-06 03:51:05,772][52660] Sum rewards: 68.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.210', 'AMMO4': '0.212', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '57.000'} [2024-08-06 03:51:06,920][52662] DAMAGECOUNT value on done: 462201.0 [2024-08-06 03:51:06,920][52662] Sum rewards: 75.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.132', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.120', 'AMMO4': '0.129', 'weapon5': '0.182', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 03:51:07,283][52658] DAMAGECOUNT value on done: 449067.0 [2024-08-06 03:51:07,283][52658] Sum rewards: 68.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.084', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.224', 'AMMO3': '0.243', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.336', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '58.000'} [2024-08-06 03:51:07,387][52820] DAMAGECOUNT value on done: 421077.0 [2024-08-06 03:51:07,387][52820] Sum rewards: 69.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.145', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.184', 'AMMO4': '0.210', 'AMMO3': '0.213', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.796', 'WEAPON3': '1.300', 'weapon3': '2.310', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '59.000'} [2024-08-06 03:51:07,418][52665] DAMAGECOUNT value on done: 443027.0 [2024-08-06 03:51:07,427][52665] Sum rewards: 60.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.658', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.158', 'AMMO4': '0.204', 'weapon5': '0.210', 'AMMO3': '0.220', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '2.954', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '49.000'} [2024-08-06 03:51:07,752][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:51:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17749.3, 300 sec: 17550.3). Total num frames: 400973824. Throughput: 0: 4383.6. Samples: 100245030. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 03:51:07,794][52567] Avg episode reward: [(0, '69.902')] [2024-08-06 03:51:07,818][52669] DAMAGECOUNT value on done: 460574.0 [2024-08-06 03:51:07,818][52669] Sum rewards: 74.134, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.616', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '64.000'} [2024-08-06 03:51:07,843][52671] DAMAGECOUNT value on done: 464185.0 [2024-08-06 03:51:07,843][52671] Sum rewards: 75.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.194', 'weapon5': '0.198', 'AMMO3': '0.225', 'AMMO4': '0.230', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:08,767][52668] DAMAGECOUNT value on done: 459885.0 [2024-08-06 03:51:08,767][52668] Sum rewards: 64.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.168', 'AMMO4': '0.169', 'AMMO3': '0.270', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.192', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.000'} [2024-08-06 03:51:08,931][52660] DAMAGECOUNT value on done: 462493.0 [2024-08-06 03:51:08,931][52660] Sum rewards: 84.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.057', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.094', 'AMMO4': '0.099', 'weapon5': '0.132', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.100', 'weapon3': '3.268', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '68.000'} [2024-08-06 03:51:09,902][52650] Updated weights for policy 0, policy_version 48951 (0.0012) [2024-08-06 03:51:09,957][52662] DAMAGECOUNT value on done: 454883.0 [2024-08-06 03:51:09,960][52662] Sum rewards: 77.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.000', 'weapon3': '3.008', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:10,330][52658] DAMAGECOUNT value on done: 464510.0 [2024-08-06 03:51:10,332][52658] Sum rewards: 75.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.103', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.170', 'weapon4': '0.188', 'AMMO3': '0.202', 'AMMO4': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:10,461][52671] DAMAGECOUNT value on done: 455403.0 [2024-08-06 03:51:10,462][52671] Sum rewards: 64.458, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.132', 'AMMO3': '0.154', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '51.000'} [2024-08-06 03:51:10,473][52820] DAMAGECOUNT value on done: 432587.0 [2024-08-06 03:51:10,473][52820] Sum rewards: 79.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.683', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.074', 'weapon5': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '66.000'} [2024-08-06 03:51:10,474][52665] DAMAGECOUNT value on done: 447023.0 [2024-08-06 03:51:10,477][52665] Sum rewards: 69.852, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '58.000'} [2024-08-06 03:51:11,902][52668] DAMAGECOUNT value on done: 452156.0 [2024-08-06 03:51:11,907][52668] Sum rewards: 80.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.128', 'AMMO4': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '67.000'} [2024-08-06 03:51:12,050][52660] DAMAGECOUNT value on done: 446210.0 [2024-08-06 03:51:12,053][52660] Sum rewards: 63.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.178', 'weapon2': '0.186', 'AMMO3': '0.250', 'AMMO4': '0.260', 'weapon4': '0.268', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2024-08-06 03:51:12,460][52662] DAMAGECOUNT value on done: 465508.0 [2024-08-06 03:51:12,468][52662] Sum rewards: 66.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.453', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.100', 'weapon5': '0.144', 'AMMO4': '0.183', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '57.000'} [2024-08-06 03:51:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 401055744. Throughput: 0: 4392.7. Samples: 100271630. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 03:51:12,795][52567] Avg episode reward: [(0, '69.905')] [2024-08-06 03:51:13,268][52665] DAMAGECOUNT value on done: 449419.0 [2024-08-06 03:51:13,269][52665] Sum rewards: 62.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.922', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon4': '0.302', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '55.000'} [2024-08-06 03:51:13,424][52658] DAMAGECOUNT value on done: 454344.0 [2024-08-06 03:51:13,425][52658] Sum rewards: 80.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.955', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'weapon4': '0.116', 'AMMO4': '0.140', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.000', 'weapon3': '3.248', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:13,562][52671] DAMAGECOUNT value on done: 447422.0 [2024-08-06 03:51:13,563][52671] Sum rewards: 71.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.014', 'AMMO2': '0.021', 'weapon5': '0.036', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.596', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '61.000'} [2024-08-06 03:51:13,632][52820] DAMAGECOUNT value on done: 431716.0 [2024-08-06 03:51:13,635][52820] Sum rewards: 70.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.248', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.090', 'weapon5': '0.136', 'AMMO4': '0.144', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.816', 'WEAPON3': '1.150', 'weapon3': '2.710', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '58.000'} [2024-08-06 03:51:14,786][52650] Updated weights for policy 0, policy_version 48961 (0.0018) [2024-08-06 03:51:15,028][52660] DAMAGECOUNT value on done: 452708.0 [2024-08-06 03:51:15,030][52660] Sum rewards: 75.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.634', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.074', 'AMMO4': '0.153', 'weapon5': '0.156', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '61.000'} [2024-08-06 03:51:15,322][52662] DAMAGECOUNT value on done: 460535.0 [2024-08-06 03:51:15,323][52662] Sum rewards: 62.601, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.164', 'weapon2': '0.188', 'weapon5': '0.192', 'weapon4': '0.208', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.164', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '52.000'} [2024-08-06 03:51:16,097][52658] DAMAGECOUNT value on done: 465882.0 [2024-08-06 03:51:16,098][52658] Sum rewards: 76.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.214', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.090', 'AMMO4': '0.174', 'weapon5': '0.190', 'AMMO3': '0.230', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:16,173][52665] DAMAGECOUNT value on done: 456036.0 [2024-08-06 03:51:16,174][52665] Sum rewards: 80.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.280', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '67.000'} [2024-08-06 03:51:16,196][52671] DAMAGECOUNT value on done: 464637.0 [2024-08-06 03:51:16,197][52671] Sum rewards: 75.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.178', 'weapon4': '0.202', 'AMMO3': '0.255', 'weapon2': '0.282', 'AMMO4': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:16,766][52820] DAMAGECOUNT value on done: 418999.0 [2024-08-06 03:51:16,766][52820] Sum rewards: 65.909, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.980', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.168', 'weapon4': '0.304', 'AMMO3': '0.315', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '2.756', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '58.000'} [2024-08-06 03:51:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 401137664. Throughput: 0: 4398.7. Samples: 100284690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:51:17,802][52567] Avg episode reward: [(0, '70.057')] [2024-08-06 03:51:17,958][52660] DAMAGECOUNT value on done: 462811.0 [2024-08-06 03:51:17,959][52660] Sum rewards: 76.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '64.000'} [2024-08-06 03:51:18,029][52662] DAMAGECOUNT value on done: 453886.0 [2024-08-06 03:51:18,029][52662] Sum rewards: 64.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.250', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.100', 'AMMO3': '0.149', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.758', 'WEAPON3': '0.900', 'weapon3': '2.776', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '52.000'} [2024-08-06 03:51:18,664][52658] DAMAGECOUNT value on done: 446519.0 [2024-08-06 03:51:18,664][52658] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.947', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.185', 'weapon4': '0.238', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '60.000'} [2024-08-06 03:51:19,178][52650] Updated weights for policy 0, policy_version 48971 (0.0024) [2024-08-06 03:51:19,232][52671] DAMAGECOUNT value on done: 460480.0 [2024-08-06 03:51:19,232][52671] Sum rewards: 60.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'weapon5': '0.038', 'AMMO2': '0.047', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.235', 'AMMO4': '0.235', 'weapon4': '0.238', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.376', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '52.000'} [2024-08-06 03:51:19,427][52665] DAMAGECOUNT value on done: 449915.0 [2024-08-06 03:51:19,431][52665] Sum rewards: 66.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.558', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.038', 'AMMO4': '0.053', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.000'} [2024-08-06 03:51:20,725][52660] DAMAGECOUNT value on done: 469051.0 [2024-08-06 03:51:20,727][52660] Sum rewards: 64.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.792', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.122', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.414', 'WEAPON3': '1.600', 'weapon3': '3.062', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '55.000'} [2024-08-06 03:51:20,820][52794] DAMAGECOUNT value on done: 458015.0 [2024-08-06 03:51:20,821][52794] Sum rewards: 80.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.104', 'AMMO3': '0.175', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '65.000'} [2024-08-06 03:51:21,311][52662] DAMAGECOUNT value on done: 454224.0 [2024-08-06 03:51:21,312][52662] Sum rewards: 82.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.834', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.360', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '67.000'} [2024-08-06 03:51:21,603][52658] DAMAGECOUNT value on done: 456057.0 [2024-08-06 03:51:21,604][52658] Sum rewards: 72.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.525', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.000'} [2024-08-06 03:51:22,058][52671] DAMAGECOUNT value on done: 462935.0 [2024-08-06 03:51:22,061][52671] Sum rewards: 73.866, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.300', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.102', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.270', 'AMMO3': '0.305', 'WEAPON3': '1.850', 'weapon3': '3.244', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '65.000'} [2024-08-06 03:51:22,643][52665] DAMAGECOUNT value on done: 457453.0 [2024-08-06 03:51:22,645][52665] Sum rewards: 65.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.276', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 03:51:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 401227776. Throughput: 0: 4399.6. Samples: 100311250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:51:22,802][52567] Avg episode reward: [(0, '70.554')] [2024-08-06 03:51:23,656][52794] DAMAGECOUNT value on done: 460852.0 [2024-08-06 03:51:23,656][52794] Sum rewards: 79.095, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.887', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.150', 'AMMO4': '0.225', 'weapon5': '0.250', 'weapon2': '0.308', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.804', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '61.000'} [2024-08-06 03:51:23,745][52660] DAMAGECOUNT value on done: 450665.0 [2024-08-06 03:51:23,745][52660] Sum rewards: 70.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.080', 'weapon5': '0.082', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.430', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 03:51:23,835][52650] Updated weights for policy 0, policy_version 48981 (0.0013) [2024-08-06 03:51:24,028][52662] DAMAGECOUNT value on done: 450757.0 [2024-08-06 03:51:24,030][52662] Sum rewards: 76.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.853', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.044', 'weapon5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 03:51:24,543][52658] DAMAGECOUNT value on done: 451463.0 [2024-08-06 03:51:24,543][52658] Sum rewards: 63.871, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.762', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.222', 'AMMO4': '0.224', 'weapon2': '0.248', 'AMMO3': '0.289', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '3.056', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '57.000'} [2024-08-06 03:51:24,915][52671] DAMAGECOUNT value on done: 460064.0 [2024-08-06 03:51:24,915][52671] Sum rewards: 91.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.132', 'weapon4': '0.156', 'weapon2': '0.174', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.314', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '22.413', 'FRAGCOUNT': '75.000'} [2024-08-06 03:51:25,533][52665] DAMAGECOUNT value on done: 452240.0 [2024-08-06 03:51:25,535][52665] Sum rewards: 84.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.126', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '69.000'} [2024-08-06 03:51:26,405][52660] DAMAGECOUNT value on done: 456992.0 [2024-08-06 03:51:26,405][52660] Sum rewards: 66.860, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.736', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.122', 'weapon2': '0.182', 'AMMO3': '0.202', 'weapon4': '0.214', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.270', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '55.000'} [2024-08-06 03:51:26,569][52794] DAMAGECOUNT value on done: 459519.0 [2024-08-06 03:51:26,569][52794] Sum rewards: 72.830, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.526', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.094', 'weapon5': '0.134', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.313', 'weapon2': '0.336', 'WEAPON3': '1.850', 'weapon3': '3.164', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:27,098][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:51:27,481][52658] DAMAGECOUNT value on done: 452147.0 [2024-08-06 03:51:27,481][52658] Sum rewards: 78.189, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.169', 'weapon2': '0.682', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '62.000'} [2024-08-06 03:51:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 401317888. Throughput: 0: 4401.6. Samples: 100337490. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:51:27,794][52567] Avg episode reward: [(0, '70.996')] [2024-08-06 03:51:27,864][52671] DAMAGECOUNT value on done: 456437.0 [2024-08-06 03:51:27,865][52671] Sum rewards: 60.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.139', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.584', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '50.000'} [2024-08-06 03:51:28,601][52665] DAMAGECOUNT value on done: 449731.0 [2024-08-06 03:51:28,604][52665] Sum rewards: 83.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.758', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '67.000'} [2024-08-06 03:51:28,922][52650] Updated weights for policy 0, policy_version 48991 (0.0013) [2024-08-06 03:51:29,698][52660] DAMAGECOUNT value on done: 451749.0 [2024-08-06 03:51:29,700][52660] Sum rewards: 67.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.354', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.233', 'weapon4': '0.240', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.884', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2024-08-06 03:51:30,112][52794] DAMAGECOUNT value on done: 452115.0 [2024-08-06 03:51:30,113][52794] Sum rewards: 73.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.192', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.054', 'AMMO4': '0.170', 'weapon2': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.302', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '64.000'} [2024-08-06 03:51:30,293][52658] DAMAGECOUNT value on done: 448447.0 [2024-08-06 03:51:30,296][52658] Sum rewards: 71.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.144', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.049', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '60.000'} [2024-08-06 03:51:31,713][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:51:31,732][52665] DAMAGECOUNT value on done: 448613.0 [2024-08-06 03:51:31,735][52665] Sum rewards: 67.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.076', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.366', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.346', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '57.000'} [2024-08-06 03:51:32,039][52660] DAMAGECOUNT value on done: 453394.0 [2024-08-06 03:51:32,039][52660] Sum rewards: 66.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.158', 'AMMO3': '0.230', 'AMMO4': '0.263', 'weapon4': '0.362', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.754', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '56.000'} [2024-08-06 03:51:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 401408000. Throughput: 0: 4400.0. Samples: 100350590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:51:32,795][52567] Avg episode reward: [(0, '70.991')] [2024-08-06 03:51:33,124][52650] Updated weights for policy 0, policy_version 49001 (0.0015) [2024-08-06 03:51:33,328][52794] DAMAGECOUNT value on done: 452845.0 [2024-08-06 03:51:33,329][52794] Sum rewards: 73.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.432', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.116', 'weapon4': '0.188', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:33,636][52658] DAMAGECOUNT value on done: 462424.0 [2024-08-06 03:51:33,637][52658] Sum rewards: 69.377, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.100', 'AMMO5': '0.025', 'AMMO2': '0.055', 'weapon4': '0.120', 'weapon5': '0.208', 'weapon2': '0.216', 'AMMO4': '0.274', 'AMMO3': '0.292', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.072', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '63.000'} [2024-08-06 03:51:34,387][52660] DAMAGECOUNT value on done: 448764.0 [2024-08-06 03:51:34,387][52660] Sum rewards: 72.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.084', 'weapon5': '0.154', 'AMMO3': '0.217', 'AMMO4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 03:51:34,852][52665] DAMAGECOUNT value on done: 452545.0 [2024-08-06 03:51:34,852][52665] Sum rewards: 70.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.114', 'weapon5': '0.124', 'AMMO4': '0.152', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 03:51:36,082][52794] DAMAGECOUNT value on done: 457658.0 [2024-08-06 03:51:36,082][52794] Sum rewards: 62.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.124', 'weapon5': '0.188', 'weapon2': '0.204', 'AMMO4': '0.209', 'AMMO3': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.860', 'weapon3': '3.192', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '55.000'} [2024-08-06 03:51:36,334][52658] DAMAGECOUNT value on done: 454131.0 [2024-08-06 03:51:36,334][52658] Sum rewards: 81.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.226', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.194', 'AMMO3': '0.213', 'weapon5': '0.246', 'weapon2': '0.268', 'AMMO4': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '67.000'} [2024-08-06 03:51:37,547][52665] DAMAGECOUNT value on done: 446832.0 [2024-08-06 03:51:37,548][52665] Sum rewards: 84.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '68.000'} [2024-08-06 03:51:37,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 401481728. Throughput: 0: 4392.4. Samples: 100376670. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:51:37,794][52567] Avg episode reward: [(0, '71.529')] [2024-08-06 03:51:38,065][52650] Updated weights for policy 0, policy_version 49011 (0.0026) [2024-08-06 03:51:38,895][52658] DAMAGECOUNT value on done: 456532.0 [2024-08-06 03:51:38,895][52658] Sum rewards: 65.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.139', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.124', 'AMMO4': '0.168', 'weapon5': '0.226', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.024', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '56.000'} [2024-08-06 03:51:39,336][52794] DAMAGECOUNT value on done: 462319.0 [2024-08-06 03:51:39,337][52794] Sum rewards: 64.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.693', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.350', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '52.000'} [2024-08-06 03:51:39,787][52659] DAMAGECOUNT value on done: 456364.0 [2024-08-06 03:51:39,787][52659] Sum rewards: 64.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.611', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.134', 'AMMO4': '0.160', 'AMMO3': '0.209', 'weapon5': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '53.000'} [2024-08-06 03:51:40,484][52665] DAMAGECOUNT value on done: 445652.0 [2024-08-06 03:51:40,484][52665] Sum rewards: 60.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.647', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.130', 'AMMO4': '0.201', 'weapon2': '0.206', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.680', 'weapon3': '3.432', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '51.000'} [2024-08-06 03:51:41,346][52614] Signal inference workers to stop experience collection... (8900 times) [2024-08-06 03:51:41,350][52614] Signal inference workers to resume experience collection... (8900 times) [2024-08-06 03:51:41,395][52650] InferenceWorker_p0-w0: stopping experience collection (8900 times) [2024-08-06 03:51:41,402][52650] InferenceWorker_p0-w0: resuming experience collection (8900 times) [2024-08-06 03:51:41,495][52658] DAMAGECOUNT value on done: 459825.0 [2024-08-06 03:51:41,496][52658] Sum rewards: 54.558, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.096', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.674', 'WEAPON3': '1.450', 'weapon3': '2.928', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '47.500'} [2024-08-06 03:51:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 401571840. Throughput: 0: 4394.4. Samples: 100403150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 03:51:42,802][52567] Avg episode reward: [(0, '71.129')] [2024-08-06 03:51:42,812][52794] DAMAGECOUNT value on done: 452888.0 [2024-08-06 03:51:42,815][52794] Sum rewards: 61.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO3': '0.130', 'weapon5': '0.140', 'AMMO4': '0.159', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.660', 'WEAPON3': '0.900', 'weapon3': '2.750', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '49.000'} [2024-08-06 03:51:42,856][52650] Updated weights for policy 0, policy_version 49021 (0.0012) [2024-08-06 03:51:42,921][52659] DAMAGECOUNT value on done: 456591.0 [2024-08-06 03:51:42,921][52659] Sum rewards: 64.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.226', 'weapon5': '0.230', 'AMMO4': '0.239', 'weapon2': '0.304', 'weapon4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.804', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '54.000'} [2024-08-06 03:51:43,088][52665] DAMAGECOUNT value on done: 446534.0 [2024-08-06 03:51:43,089][52665] Sum rewards: 75.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.366', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.500'} [2024-08-06 03:51:45,601][52794] DAMAGECOUNT value on done: 460751.0 [2024-08-06 03:51:45,602][52794] Sum rewards: 80.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.130', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.282', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '66.000'} [2024-08-06 03:51:45,765][52665] DAMAGECOUNT value on done: 446806.0 [2024-08-06 03:51:45,765][52665] Sum rewards: 65.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.173', 'weapon2': '0.178', 'AMMO4': '0.230', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.132', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '54.000'} [2024-08-06 03:51:46,173][52659] DAMAGECOUNT value on done: 459327.0 [2024-08-06 03:51:46,174][52659] Sum rewards: 62.403, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.520', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.060', 'weapon5': '0.064', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.522', 'WEAPON3': '1.550', 'weapon3': '3.096', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '55.000'} [2024-08-06 03:51:47,153][52649] DAMAGECOUNT value on done: 438789.0 [2024-08-06 03:51:47,155][52649] Sum rewards: 65.390, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.820', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.114', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '53.000'} [2024-08-06 03:51:47,242][52650] Updated weights for policy 0, policy_version 49031 (0.0012) [2024-08-06 03:51:47,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 401670144. Throughput: 0: 4388.2. Samples: 100416140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:51:47,794][52567] Avg episode reward: [(0, '71.065')] [2024-08-06 03:51:48,624][52665] DAMAGECOUNT value on done: 451134.0 [2024-08-06 03:51:48,624][52665] Sum rewards: 60.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.836', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon4': '0.152', 'AMMO3': '0.156', 'weapon5': '0.250', 'AMMO4': '0.321', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.870', 'weapon3': '2.932', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '49.000'} [2024-08-06 03:51:48,889][52794] DAMAGECOUNT value on done: 456234.0 [2024-08-06 03:51:48,889][52794] Sum rewards: 63.669, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.498', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.260', 'AMMO3': '0.270', 'weapon2': '0.284', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.500'} [2024-08-06 03:51:49,260][52659] DAMAGECOUNT value on done: 455294.0 [2024-08-06 03:51:49,261][52659] Sum rewards: 57.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO4': '0.184', 'weapon4': '0.190', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.884', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '49.000'} [2024-08-06 03:51:49,908][52649] DAMAGECOUNT value on done: 434770.0 [2024-08-06 03:51:49,908][52649] Sum rewards: 71.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.132', 'weapon5': '0.162', 'AMMO4': '0.240', 'AMMO3': '0.241', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '61.000'} [2024-08-06 03:51:51,429][52794] DAMAGECOUNT value on done: 451588.0 [2024-08-06 03:51:51,429][52794] Sum rewards: 66.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.098', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.320', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '56.000'} [2024-08-06 03:51:52,054][52650] Updated weights for policy 0, policy_version 49041 (0.0022) [2024-08-06 03:51:52,282][52659] DAMAGECOUNT value on done: 452710.0 [2024-08-06 03:51:52,283][52659] Sum rewards: 66.060, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.194', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.392', 'HEALTH': '0.956', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '54.000'} [2024-08-06 03:51:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 401752064. Throughput: 0: 4388.0. Samples: 100442490. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:51:52,802][52567] Avg episode reward: [(0, '70.873')] [2024-08-06 03:51:53,062][52649] DAMAGECOUNT value on done: 448998.0 [2024-08-06 03:51:53,063][52649] Sum rewards: 70.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.760', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.114', 'AMMO4': '0.170', 'AMMO3': '0.261', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '61.500'} [2024-08-06 03:51:54,496][52794] DAMAGECOUNT value on done: 459467.0 [2024-08-06 03:51:54,497][52794] Sum rewards: 73.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.690', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.128', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '60.000'} [2024-08-06 03:51:55,192][52659] DAMAGECOUNT value on done: 458790.0 [2024-08-06 03:51:55,192][52659] Sum rewards: 76.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.410', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.132', 'weapon5': '0.132', 'AMMO4': '0.150', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '66.000'} [2024-08-06 03:51:55,591][52649] DAMAGECOUNT value on done: 440846.0 [2024-08-06 03:51:55,592][52649] Sum rewards: 64.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.242', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.296', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.422', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '52.000'} [2024-08-06 03:51:56,718][52650] Updated weights for policy 0, policy_version 49051 (0.0020) [2024-08-06 03:51:57,666][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:51:57,690][52794] DAMAGECOUNT value on done: 447704.0 [2024-08-06 03:51:57,690][52794] Sum rewards: 60.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.114', 'AMMO3': '0.184', 'AMMO4': '0.202', 'weapon5': '0.228', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.078', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '52.000'} [2024-08-06 03:51:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 401842176. Throughput: 0: 4372.9. Samples: 100468410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:51:57,802][52567] Avg episode reward: [(0, '70.533')] [2024-08-06 03:51:57,955][52811] DAMAGECOUNT value on done: 438138.0 [2024-08-06 03:51:57,955][52811] Sum rewards: 75.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.209', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.448', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '62.000'} [2024-08-06 03:51:58,178][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:51:58,274][52659] DAMAGECOUNT value on done: 455564.0 [2024-08-06 03:51:58,274][52659] Sum rewards: 62.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon2': '0.174', 'AMMO3': '0.183', 'weapon5': '0.196', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.092', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '50.000'} [2024-08-06 03:51:58,332][52649] DAMAGECOUNT value on done: 435022.0 [2024-08-06 03:51:58,334][52649] Sum rewards: 76.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.400', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.114', 'AMMO4': '0.148', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.328', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:00,800][52794] DAMAGECOUNT value on done: 468729.0 [2024-08-06 03:52:00,803][52794] Sum rewards: 76.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon2': '0.162', 'weapon5': '0.172', 'AMMO3': '0.219', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '65.000'} [2024-08-06 03:52:00,959][52811] DAMAGECOUNT value on done: 419761.0 [2024-08-06 03:52:00,959][52811] Sum rewards: 62.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.838', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.074', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '50.000'} [2024-08-06 03:52:01,149][52650] Updated weights for policy 0, policy_version 49061 (0.0027) [2024-08-06 03:52:01,444][52659] DAMAGECOUNT value on done: 456229.0 [2024-08-06 03:52:01,446][52659] Sum rewards: 65.520, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.478', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.142', 'AMMO3': '0.235', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.274', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:01,459][52649] DAMAGECOUNT value on done: 446425.0 [2024-08-06 03:52:01,461][52649] Sum rewards: 78.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.328', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.159', 'weapon5': '0.172', 'AMMO4': '0.197', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '2.978', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:02,628][52664] DAMAGECOUNT value on done: 473308.0 [2024-08-06 03:52:02,636][52664] Sum rewards: 66.367, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.350', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.146', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'weapon4': '0.322', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 401924096. Throughput: 0: 4381.1. Samples: 100481840. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:52:02,795][52567] Avg episode reward: [(0, '70.549')] [2024-08-06 03:52:03,965][52794] DAMAGECOUNT value on done: 450618.0 [2024-08-06 03:52:03,965][52794] Sum rewards: 72.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.063', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.164', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '60.000'} [2024-08-06 03:52:04,051][52649] DAMAGECOUNT value on done: 442066.0 [2024-08-06 03:52:04,052][52649] Sum rewards: 75.306, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.600', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.272', 'AMMO3': '0.292', 'WEAPON3': '1.800', 'weapon3': '3.438', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:04,179][52811] DAMAGECOUNT value on done: 421170.0 [2024-08-06 03:52:04,180][52811] Sum rewards: 54.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '2.560', 'weapon3': '3.438', 'DAMAGECOUNT': '13.290', 'FRAGCOUNT': '47.000'} [2024-08-06 03:52:04,598][52659] DAMAGECOUNT value on done: 463714.0 [2024-08-06 03:52:04,599][52659] Sum rewards: 73.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.110', 'weapon4': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:05,471][52664] DAMAGECOUNT value on done: 479002.0 [2024-08-06 03:52:05,471][52664] Sum rewards: 67.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '54.000'} [2024-08-06 03:52:05,900][52647] DAMAGECOUNT value on done: 480324.0 [2024-08-06 03:52:05,900][52647] Sum rewards: 70.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon4': '0.072', 'weapon5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.248', 'AMMO4': '0.323', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.500'} [2024-08-06 03:52:06,261][52650] Updated weights for policy 0, policy_version 49071 (0.0021) [2024-08-06 03:52:06,465][52803] DAMAGECOUNT value on done: 425312.0 [2024-08-06 03:52:06,469][52803] Sum rewards: 54.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.763', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.140', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '45.000'} [2024-08-06 03:52:06,772][52794] DAMAGECOUNT value on done: 466834.0 [2024-08-06 03:52:06,773][52794] Sum rewards: 58.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.141', 'weapon5': '0.152', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.080', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '51.000'} [2024-08-06 03:52:07,166][52649] DAMAGECOUNT value on done: 447345.0 [2024-08-06 03:52:07,168][52649] Sum rewards: 74.067, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.730', 'AMMO5': '0.032', 'AMMO2': '0.073', 'weapon4': '0.134', 'weapon5': '0.234', 'AMMO3': '0.249', 'AMMO4': '0.365', 'weapon2': '0.460', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:07,224][52811] DAMAGECOUNT value on done: 423744.0 [2024-08-06 03:52:07,225][52811] Sum rewards: 61.407, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.944', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.100', 'AMMO4': '0.198', 'weapon5': '0.200', 'weapon2': '0.268', 'AMMO3': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '3.080', 'weapon3': '3.116', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '54.500'} [2024-08-06 03:52:07,504][52659] DAMAGECOUNT value on done: 466945.0 [2024-08-06 03:52:07,506][52659] Sum rewards: 67.155, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.968', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.128', 'weapon4': '0.130', 'weapon2': '0.208', 'AMMO3': '0.238', 'AMMO4': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.276', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 402014208. Throughput: 0: 4359.8. Samples: 100507440. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:52:07,795][52567] Avg episode reward: [(0, '70.024')] [2024-08-06 03:52:07,991][52664] DAMAGECOUNT value on done: 479001.0 [2024-08-06 03:52:07,992][52664] Sum rewards: 72.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '60.000'} [2024-08-06 03:52:08,371][52647] DAMAGECOUNT value on done: 481429.0 [2024-08-06 03:52:08,371][52647] Sum rewards: 78.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.121', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.082', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:09,191][52795] Large shaping reward 2.569 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0)] [2024-08-06 03:52:09,488][52803] DAMAGECOUNT value on done: 423290.0 [2024-08-06 03:52:09,495][52803] Sum rewards: 72.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.146', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon2': '0.200', 'weapon5': '0.238', 'AMMO3': '0.241', 'AMMO4': '0.274', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:09,596][52794] DAMAGECOUNT value on done: 457739.0 [2024-08-06 03:52:09,597][52794] Sum rewards: 77.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.174', 'AMMO3': '0.236', 'weapon4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '65.000'} [2024-08-06 03:52:10,274][52811] DAMAGECOUNT value on done: 426368.0 [2024-08-06 03:52:10,275][52811] Sum rewards: 68.222, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.106', 'weapon5': '0.168', 'AMMO4': '0.190', 'AMMO3': '0.263', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:10,353][52649] DAMAGECOUNT value on done: 446956.0 [2024-08-06 03:52:10,353][52649] Sum rewards: 65.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.826', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.096', 'AMMO4': '0.120', 'weapon5': '0.138', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.204', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:10,375][52659] DAMAGECOUNT value on done: 455574.0 [2024-08-06 03:52:10,376][52659] Sum rewards: 66.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.418', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.069', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '54.000'} [2024-08-06 03:52:10,528][52650] Updated weights for policy 0, policy_version 49081 (0.0021) [2024-08-06 03:52:10,698][52664] DAMAGECOUNT value on done: 470968.0 [2024-08-06 03:52:10,698][52664] Sum rewards: 64.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.772', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.092', 'weapon4': '0.120', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.286', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.274', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:11,238][52647] DAMAGECOUNT value on done: 479253.0 [2024-08-06 03:52:11,246][52647] Sum rewards: 69.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.182', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.678', 'WEAPON3': '1.150', 'weapon3': '2.660', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:12,585][52794] DAMAGECOUNT value on done: 459943.0 [2024-08-06 03:52:12,587][52794] Sum rewards: 75.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.164', 'AMMO3': '0.234', 'weapon5': '0.260', 'weapon2': '0.262', 'AMMO4': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:12,607][52803] DAMAGECOUNT value on done: 430769.0 [2024-08-06 03:52:12,608][52803] Sum rewards: 73.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.759', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.092', 'weapon4': '0.108', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 402104320. Throughput: 0: 4359.3. Samples: 100533660. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 03:52:12,794][52567] Avg episode reward: [(0, '69.923')] [2024-08-06 03:52:13,369][52659] DAMAGECOUNT value on done: 459502.0 [2024-08-06 03:52:13,372][52659] Sum rewards: 68.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.971', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.038', 'weapon4': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.548', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:13,386][52811] DAMAGECOUNT value on done: 432657.0 [2024-08-06 03:52:13,386][52811] Sum rewards: 75.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.168', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.136', 'weapon5': '0.154', 'AMMO4': '0.234', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:13,617][52649] DAMAGECOUNT value on done: 441369.0 [2024-08-06 03:52:13,617][52649] Sum rewards: 69.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO2': '0.001', 'weapon5': '0.002', 'AMMO4': '0.006', 'AMMO5': '0.015', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.524', 'WEAPON3': '1.150', 'HITCOUNT': '3.220', 'weapon3': '3.302', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '57.000'} [2024-08-06 03:52:13,697][52664] DAMAGECOUNT value on done: 476655.0 [2024-08-06 03:52:13,698][52664] Sum rewards: 69.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.930', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.274', 'WEAPON3': '1.750', 'HITCOUNT': '3.460', 'weapon3': '3.488', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:13,813][52666] DAMAGECOUNT value on done: 453192.0 [2024-08-06 03:52:13,813][52666] Sum rewards: 80.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.096', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.586', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '67.000'} [2024-08-06 03:52:13,913][52647] DAMAGECOUNT value on done: 488071.0 [2024-08-06 03:52:13,914][52647] Sum rewards: 61.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.286', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.448', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '51.000'} [2024-08-06 03:52:15,262][52794] DAMAGECOUNT value on done: 463664.0 [2024-08-06 03:52:15,262][52794] Sum rewards: 66.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.678', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.130', 'AMMO3': '0.220', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.654', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:15,744][52650] Updated weights for policy 0, policy_version 49091 (0.0016) [2024-08-06 03:52:15,840][52803] DAMAGECOUNT value on done: 432696.0 [2024-08-06 03:52:15,841][52803] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.665', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.140', 'weapon5': '0.144', 'AMMO4': '0.147', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:16,145][52659] DAMAGECOUNT value on done: 450207.0 [2024-08-06 03:52:16,145][52659] Sum rewards: 55.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.837', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.176', 'weapon5': '0.262', 'weapon2': '0.294', 'weapon4': '0.326', 'AMMO4': '0.335', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '46.000'} [2024-08-06 03:52:16,271][52811] DAMAGECOUNT value on done: 427375.0 [2024-08-06 03:52:16,279][52811] Sum rewards: 64.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.304', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.182', 'AMMO4': '0.207', 'weapon5': '0.220', 'weapon4': '0.280', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '2.910', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '51.000'} [2024-08-06 03:52:16,348][52664] DAMAGECOUNT value on done: 473640.0 [2024-08-06 03:52:16,349][52664] Sum rewards: 70.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.182', 'AMMO3': '0.207', 'weapon4': '0.260', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:16,749][52670] DAMAGECOUNT value on done: 446188.0 [2024-08-06 03:52:16,750][52670] Sum rewards: 64.206, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.416', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.394', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '54.000'} [2024-08-06 03:52:16,778][52647] DAMAGECOUNT value on done: 485521.0 [2024-08-06 03:52:16,779][52647] Sum rewards: 57.753, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.590', 'AMMO5': '0.019', 'AMMO2': '0.026', 'weapon4': '0.114', 'AMMO4': '0.128', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon5': '0.364', 'WEAPON5': '0.400', 'weapon2': '0.790', 'WEAPON3': '1.200', 'weapon3': '2.416', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '47.000'} [2024-08-06 03:52:16,798][52649] DAMAGECOUNT value on done: 449435.0 [2024-08-06 03:52:16,798][52649] Sum rewards: 71.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.136', 'weapon5': '0.160', 'AMMO4': '0.162', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:17,013][52666] DAMAGECOUNT value on done: 459267.0 [2024-08-06 03:52:17,013][52666] Sum rewards: 65.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.185', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.134', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 402186240. Throughput: 0: 4361.6. Samples: 100546860. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:17,794][52567] Avg episode reward: [(0, '69.343')] [2024-08-06 03:52:18,002][52794] DAMAGECOUNT value on done: 455922.0 [2024-08-06 03:52:18,004][52794] Sum rewards: 64.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.320', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.016', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '53.500'} [2024-08-06 03:52:19,045][52803] DAMAGECOUNT value on done: 430372.0 [2024-08-06 03:52:19,046][52803] Sum rewards: 57.623, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.127', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'weapon4': '0.180', 'weapon2': '0.184', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.418', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '48.000'} [2024-08-06 03:52:19,353][52811] DAMAGECOUNT value on done: 427501.0 [2024-08-06 03:52:19,355][52811] Sum rewards: 69.850, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.120', 'AMMO5': '0.021', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.076', 'AMMO4': '0.114', 'WEAPON4': '0.250', 'AMMO3': '0.298', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.850', 'weapon3': '3.212', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:19,458][52659] DAMAGECOUNT value on done: 458474.0 [2024-08-06 03:52:19,459][52659] Sum rewards: 84.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.798', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '69.000'} [2024-08-06 03:52:19,639][52670] DAMAGECOUNT value on done: 457788.0 [2024-08-06 03:52:19,642][52670] Sum rewards: 67.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO4': '0.191', 'AMMO3': '0.214', 'weapon4': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '57.000'} [2024-08-06 03:52:19,707][52664] DAMAGECOUNT value on done: 472919.0 [2024-08-06 03:52:19,707][52664] Sum rewards: 67.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.110', 'AMMO3': '0.178', 'weapon5': '0.178', 'AMMO4': '0.192', 'weapon2': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.212', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:19,830][52647] DAMAGECOUNT value on done: 484460.0 [2024-08-06 03:52:19,832][52647] Sum rewards: 70.725, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.555', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO3': '0.152', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'weapon4': '0.278', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.124', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:19,843][52666] DAMAGECOUNT value on done: 459883.0 [2024-08-06 03:52:19,845][52666] Sum rewards: 79.383, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.162', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.183', 'weapon4': '0.286', 'weapon2': '0.346', 'weapon5': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:19,907][52649] DAMAGECOUNT value on done: 452681.0 [2024-08-06 03:52:19,907][52649] Sum rewards: 79.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.265', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.082', 'weapon4': '0.088', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.150', 'weapon3': '3.378', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '66.000'} [2024-08-06 03:52:19,927][52663] DAMAGECOUNT value on done: 461926.0 [2024-08-06 03:52:19,927][52663] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.476', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.100', 'AMMO4': '0.198', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:20,458][52650] Updated weights for policy 0, policy_version 49101 (0.0015) [2024-08-06 03:52:21,985][52659] DAMAGECOUNT value on done: 467243.0 [2024-08-06 03:52:21,987][52659] Sum rewards: 78.608, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.106', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:22,130][52803] DAMAGECOUNT value on done: 418616.0 [2024-08-06 03:52:22,130][52803] Sum rewards: 66.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.130', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.342', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.220', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '57.000'} [2024-08-06 03:52:22,251][52664] DAMAGECOUNT value on done: 468016.0 [2024-08-06 03:52:22,253][52664] Sum rewards: 60.874, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.080', 'AMMO4': '0.173', 'weapon2': '0.182', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.282', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '52.000'} [2024-08-06 03:52:22,375][52670] DAMAGECOUNT value on done: 451308.0 [2024-08-06 03:52:22,378][52670] Sum rewards: 74.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.016', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.408', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:22,419][52647] DAMAGECOUNT value on done: 482540.0 [2024-08-06 03:52:22,419][52647] Sum rewards: 71.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.865', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.172', 'AMMO3': '0.197', 'weapon4': '0.200', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.764', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:22,486][52811] DAMAGECOUNT value on done: 430928.0 [2024-08-06 03:52:22,490][52811] Sum rewards: 71.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.030', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.102', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '1.700', 'weapon3': '3.064', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:22,714][52666] DAMAGECOUNT value on done: 458828.0 [2024-08-06 03:52:22,714][52666] Sum rewards: 76.185, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.542', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.184', 'weapon5': '0.190', 'AMMO3': '0.208', 'AMMO4': '0.262', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 402276352. Throughput: 0: 4359.6. Samples: 100572850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:22,794][52567] Avg episode reward: [(0, '69.029')] [2024-08-06 03:52:23,012][52663] DAMAGECOUNT value on done: 456420.0 [2024-08-06 03:52:23,013][52663] Sum rewards: 64.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.375', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.098', 'AMMO3': '0.141', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'weapon5': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '0.850', 'HITCOUNT': '2.750', 'weapon3': '2.854', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '52.000'} [2024-08-06 03:52:23,029][52649] DAMAGECOUNT value on done: 452514.0 [2024-08-06 03:52:23,029][52649] Sum rewards: 75.946, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.900', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.030', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.276', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.424', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '65.000'} [2024-08-06 03:52:24,781][52659] DAMAGECOUNT value on done: 461624.0 [2024-08-06 03:52:24,782][52659] Sum rewards: 64.103, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.084', 'HEALTH': '0.130', 'AMMO3': '0.159', 'AMMO4': '0.186', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.752', 'WEAPON3': '0.900', 'weapon3': '2.724', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '50.500'} [2024-08-06 03:52:24,789][52650] Updated weights for policy 0, policy_version 49111 (0.0045) [2024-08-06 03:52:24,851][52664] Large shaping reward 2.588 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.537, 179.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:52:24,876][52664] DAMAGECOUNT value on done: 478455.0 [2024-08-06 03:52:24,877][52664] Sum rewards: 79.977, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.104', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.300', 'WEAPON3': '0.950', 'HEALTH': '1.042', 'weapon3': '3.288', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:24,935][52647] DAMAGECOUNT value on done: 475489.0 [2024-08-06 03:52:24,937][52647] Sum rewards: 61.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.730', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'weapon2': '0.182', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.700', 'HITCOUNT': '3.000', 'weapon3': '3.342', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '54.000'} [2024-08-06 03:52:25,394][52803] DAMAGECOUNT value on done: 420871.0 [2024-08-06 03:52:25,396][52803] Sum rewards: 70.310, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.152', 'weapon2': '0.228', 'AMMO3': '0.281', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '60.000'} [2024-08-06 03:52:25,453][52670] DAMAGECOUNT value on done: 449831.0 [2024-08-06 03:52:25,455][52670] Sum rewards: 77.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.224', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.270', 'weapon5': '0.274', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:25,480][52811] DAMAGECOUNT value on done: 427880.0 [2024-08-06 03:52:25,481][52811] Sum rewards: 74.765, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.435', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.137', 'weapon5': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.734', 'WEAPON3': '0.900', 'weapon3': '2.844', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:25,822][52666] DAMAGECOUNT value on done: 459031.0 [2024-08-06 03:52:25,823][52666] Sum rewards: 61.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.752', 'AMMO5': '0.017', 'AMMO2': '0.061', 'AMMO3': '0.223', 'weapon4': '0.254', 'weapon5': '0.262', 'AMMO4': '0.306', 'weapon2': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '2.804', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '52.000'} [2024-08-06 03:52:25,928][52663] DAMAGECOUNT value on done: 451879.0 [2024-08-06 03:52:25,931][52663] Sum rewards: 73.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.650', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.064', 'weapon4': '0.102', 'AMMO4': '0.202', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.286', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:26,251][52649] DAMAGECOUNT value on done: 450671.0 [2024-08-06 03:52:26,253][52649] Sum rewards: 79.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.108', 'weapon5': '0.120', 'AMMO4': '0.149', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '67.000'} [2024-08-06 03:52:27,563][52659] DAMAGECOUNT value on done: 463125.0 [2024-08-06 03:52:27,564][52659] Sum rewards: 77.804, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.650', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.142', 'AMMO4': '0.181', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.798', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:27,678][52664] DAMAGECOUNT value on done: 472086.0 [2024-08-06 03:52:27,678][52664] Sum rewards: 70.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.114', 'AMMO4': '0.135', 'weapon5': '0.136', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:27,736][52647] DAMAGECOUNT value on done: 487152.0 [2024-08-06 03:52:27,738][52647] Sum rewards: 56.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.090', 'weapon5': '0.112', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.168', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '48.000'} [2024-08-06 03:52:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 402366464. Throughput: 0: 4352.5. Samples: 100599010. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:27,794][52567] Avg episode reward: [(0, '68.915')] [2024-08-06 03:52:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049117_402366464.pth... [2024-08-06 03:52:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048604_398163968.pth [2024-08-06 03:52:28,279][52670] DAMAGECOUNT value on done: 461100.0 [2024-08-06 03:52:28,281][52670] Sum rewards: 65.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.743', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.056', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:28,572][52803] DAMAGECOUNT value on done: 420320.0 [2024-08-06 03:52:28,574][52803] Sum rewards: 75.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.072', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:28,682][52666] DAMAGECOUNT value on done: 450607.0 [2024-08-06 03:52:28,682][52666] Sum rewards: 69.470, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.640', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.093', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:28,694][52811] DAMAGECOUNT value on done: 426131.0 [2024-08-06 03:52:28,695][52811] Sum rewards: 75.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.473', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.112', 'AMMO4': '0.180', 'AMMO3': '0.210', 'weapon2': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '63.500'} [2024-08-06 03:52:28,906][52663] DAMAGECOUNT value on done: 456144.0 [2024-08-06 03:52:28,906][52663] Sum rewards: 79.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.132', 'AMMO3': '0.145', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.402', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.666', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:29,187][52649] DAMAGECOUNT value on done: 440613.0 [2024-08-06 03:52:29,191][52649] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon4': '0.222', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '57.000'} [2024-08-06 03:52:29,924][52650] Updated weights for policy 0, policy_version 49121 (0.0032) [2024-08-06 03:52:30,073][52664] DAMAGECOUNT value on done: 482323.0 [2024-08-06 03:52:30,073][52664] Sum rewards: 80.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.033', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.742', 'WEAPON3': '1.500', 'weapon3': '2.860', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '67.000'} [2024-08-06 03:52:30,159][52647] DAMAGECOUNT value on done: 478084.0 [2024-08-06 03:52:30,159][52647] Sum rewards: 68.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.201', 'weapon5': '0.218', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.616', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:30,426][52659] DAMAGECOUNT value on done: 455766.0 [2024-08-06 03:52:30,429][52659] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.114', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.096', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon2': '0.554', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '60.000'} [2024-08-06 03:52:31,398][52670] DAMAGECOUNT value on done: 453689.0 [2024-08-06 03:52:31,399][52670] Sum rewards: 77.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.017', 'AMMO2': '0.075', 'weapon2': '0.208', 'weapon4': '0.224', 'AMMO3': '0.246', 'weapon5': '0.336', 'AMMO4': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '65.000'} [2024-08-06 03:52:31,710][52803] DAMAGECOUNT value on done: 427926.0 [2024-08-06 03:52:31,711][52803] Sum rewards: 68.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.112', 'weapon4': '0.138', 'AMMO4': '0.189', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:31,781][52666] DAMAGECOUNT value on done: 455981.0 [2024-08-06 03:52:31,781][52666] Sum rewards: 73.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.050', 'AMMO4': '0.156', 'weapon5': '0.168', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:31,907][52811] DAMAGECOUNT value on done: 436100.0 [2024-08-06 03:52:31,908][52811] Sum rewards: 67.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.314', 'weapon4': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:32,185][52663] DAMAGECOUNT value on done: 455962.0 [2024-08-06 03:52:32,187][52663] Sum rewards: 62.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.128', 'weapon4': '0.146', 'AMMO4': '0.193', 'AMMO3': '0.219', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.060', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '53.000'} [2024-08-06 03:52:32,269][52649] DAMAGECOUNT value on done: 449110.0 [2024-08-06 03:52:32,269][52649] Sum rewards: 63.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.158', 'weapon4': '0.162', 'AMMO3': '0.177', 'AMMO4': '0.201', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.076', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '52.000'} [2024-08-06 03:52:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 402448384. Throughput: 0: 4349.6. Samples: 100611870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:32,794][52567] Avg episode reward: [(0, '69.673')] [2024-08-06 03:52:32,806][52664] DAMAGECOUNT value on done: 476700.0 [2024-08-06 03:52:32,808][52664] Sum rewards: 74.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.104', 'AMMO3': '0.189', 'weapon4': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 03:52:32,874][52647] DAMAGECOUNT value on done: 481056.0 [2024-08-06 03:52:32,874][52647] Sum rewards: 71.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.231', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:33,270][52794] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:52:33,727][52659] DAMAGECOUNT value on done: 459347.0 [2024-08-06 03:52:33,728][52659] Sum rewards: 72.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.352', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.166', 'AMMO3': '0.170', 'weapon4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:34,194][52650] Updated weights for policy 0, policy_version 49131 (0.0019) [2024-08-06 03:52:34,452][52670] DAMAGECOUNT value on done: 446642.0 [2024-08-06 03:52:34,452][52670] Sum rewards: 65.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.847', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.112', 'AMMO3': '0.245', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:34,840][52663] DAMAGECOUNT value on done: 459725.0 [2024-08-06 03:52:34,840][52663] Sum rewards: 71.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.134', 'weapon2': '0.202', 'AMMO4': '0.217', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '59.500'} [2024-08-06 03:52:34,902][52666] DAMAGECOUNT value on done: 454635.0 [2024-08-06 03:52:34,903][52666] Sum rewards: 61.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.118', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.190', 'AMMO4': '0.222', 'AMMO3': '0.222', 'weapon5': '0.230', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.004', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '51.000'} [2024-08-06 03:52:34,962][52649] DAMAGECOUNT value on done: 438501.0 [2024-08-06 03:52:34,962][52649] Sum rewards: 66.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.106', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.260', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.410', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:34,994][52803] DAMAGECOUNT value on done: 418547.0 [2024-08-06 03:52:34,994][52803] Sum rewards: 62.085, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.572', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.152', 'weapon4': '0.180', 'AMMO4': '0.197', 'weapon5': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.864', 'WEAPON3': '0.950', 'weapon3': '2.502', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '49.000'} [2024-08-06 03:52:34,996][52811] DAMAGECOUNT value on done: 426739.0 [2024-08-06 03:52:34,998][52811] Sum rewards: 68.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.889', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.140', 'AMMO4': '0.214', 'weapon5': '0.276', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.800', 'weapon4': '0.858', 'weapon3': '2.178', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '53.000'} [2024-08-06 03:52:35,350][52665] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:52:35,642][52664] DAMAGECOUNT value on done: 484173.0 [2024-08-06 03:52:35,643][52664] Sum rewards: 76.825, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.285', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.126', 'AMMO4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '67.000'} [2024-08-06 03:52:35,668][52647] DAMAGECOUNT value on done: 474768.0 [2024-08-06 03:52:35,668][52647] Sum rewards: 58.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'AMMO5': '0.024', 'AMMO2': '0.077', 'weapon2': '0.258', 'AMMO3': '0.269', 'weapon4': '0.346', 'weapon5': '0.368', 'AMMO4': '0.383', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.600', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '51.000'} [2024-08-06 03:52:35,852][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:52:36,218][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:52:36,759][52659] DAMAGECOUNT value on done: 459917.0 [2024-08-06 03:52:36,760][52659] Sum rewards: 73.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.548', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.108', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:37,235][52670] DAMAGECOUNT value on done: 453393.0 [2024-08-06 03:52:37,238][52670] Sum rewards: 80.635, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.567', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.120', 'weapon5': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.234', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.336', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.588', 'FRAGCOUNT': '68.000'} [2024-08-06 03:52:37,505][52663] DAMAGECOUNT value on done: 458595.0 [2024-08-06 03:52:37,508][52663] Sum rewards: 77.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.134', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.058', 'weapon4': '0.098', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '65.000'} [2024-08-06 03:52:37,575][52649] DAMAGECOUNT value on done: 450569.0 [2024-08-06 03:52:37,576][52649] Sum rewards: 74.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.866', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.043', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:37,744][52666] DAMAGECOUNT value on done: 452738.0 [2024-08-06 03:52:37,745][52666] Sum rewards: 66.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.564', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.066', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon2': '0.182', 'AMMO3': '0.185', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.526', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '54.000'} [2024-08-06 03:52:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 402538496. Throughput: 0: 4357.8. Samples: 100638590. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:37,794][52567] Avg episode reward: [(0, '69.984')] [2024-08-06 03:52:38,102][52811] DAMAGECOUNT value on done: 424557.0 [2024-08-06 03:52:38,102][52811] Sum rewards: 81.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.242', 'weapon4': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '66.000'} [2024-08-06 03:52:38,119][52803] DAMAGECOUNT value on done: 433135.0 [2024-08-06 03:52:38,119][52803] Sum rewards: 69.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'weapon4': '0.096', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:38,833][52664] DAMAGECOUNT value on done: 478210.0 [2024-08-06 03:52:38,833][52664] Sum rewards: 76.722, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '3.304', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '60.000'} [2024-08-06 03:52:38,834][52647] DAMAGECOUNT value on done: 483266.0 [2024-08-06 03:52:38,841][52647] Sum rewards: 75.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.050', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:39,254][52650] Updated weights for policy 0, policy_version 49141 (0.0013) [2024-08-06 03:52:39,870][52670] DAMAGECOUNT value on done: 451922.0 [2024-08-06 03:52:39,872][52670] Sum rewards: 75.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.072', 'weapon4': '0.152', 'AMMO4': '0.179', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '65.000'} [2024-08-06 03:52:40,159][52666] DAMAGECOUNT value on done: 447634.0 [2024-08-06 03:52:40,160][52666] Sum rewards: 87.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.390', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.106', 'AMMO3': '0.164', 'weapon5': '0.178', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.000', 'weapon3': '3.104', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '69.000'} [2024-08-06 03:52:40,379][52663] DAMAGECOUNT value on done: 451363.0 [2024-08-06 03:52:40,381][52663] Sum rewards: 72.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.735', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:40,436][52649] DAMAGECOUNT value on done: 452239.0 [2024-08-06 03:52:40,436][52649] Sum rewards: 71.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.249', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.118', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.732', 'WEAPON3': '1.600', 'weapon3': '2.806', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:40,655][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:52:41,128][52803] DAMAGECOUNT value on done: 427141.0 [2024-08-06 03:52:41,129][52803] Sum rewards: 76.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.874', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.134', 'weapon2': '0.202', 'AMMO3': '0.252', 'AMMO4': '0.279', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:41,184][52811] DAMAGECOUNT value on done: 429484.0 [2024-08-06 03:52:41,185][52811] Sum rewards: 67.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.515', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO3': '0.176', 'AMMO4': '0.176', 'weapon4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:41,636][52668] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:52:41,862][52647] DAMAGECOUNT value on done: 479336.0 [2024-08-06 03:52:41,863][52647] Sum rewards: 72.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.360', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.072', 'weapon5': '0.182', 'AMMO4': '0.217', 'AMMO3': '0.280', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.140', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:41,939][52664] DAMAGECOUNT value on done: 479728.0 [2024-08-06 03:52:41,939][52664] Sum rewards: 78.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.328', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.128', 'weapon5': '0.140', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '65.000'} [2024-08-06 03:52:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 402628608. Throughput: 0: 4359.8. Samples: 100664600. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:42,794][52567] Avg episode reward: [(0, '70.935')] [2024-08-06 03:52:42,836][52670] DAMAGECOUNT value on done: 449015.0 [2024-08-06 03:52:42,837][52670] Sum rewards: 60.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.171', 'weapon4': '0.178', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '2.952', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '49.000'} [2024-08-06 03:52:43,157][52663] DAMAGECOUNT value on done: 453012.0 [2024-08-06 03:52:43,157][52663] Sum rewards: 75.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:43,249][52666] DAMAGECOUNT value on done: 451915.0 [2024-08-06 03:52:43,250][52666] Sum rewards: 58.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.203', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.262', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.202', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '51.000'} [2024-08-06 03:52:43,566][52649] DAMAGECOUNT value on done: 445351.0 [2024-08-06 03:52:43,567][52649] Sum rewards: 67.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.465', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.102', 'AMMO4': '0.119', 'weapon5': '0.134', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:43,684][52650] Updated weights for policy 0, policy_version 49151 (0.0025) [2024-08-06 03:52:44,264][52803] DAMAGECOUNT value on done: 426248.0 [2024-08-06 03:52:44,273][52803] Sum rewards: 65.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.434', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.046', 'AMMO4': '0.158', 'weapon5': '0.196', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '54.000'} [2024-08-06 03:52:44,341][52811] DAMAGECOUNT value on done: 422452.0 [2024-08-06 03:52:44,341][52811] Sum rewards: 79.220, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.140', 'AMMO3': '0.149', 'AMMO4': '0.202', 'weapon5': '0.232', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.014', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '62.000'} [2024-08-06 03:52:44,353][52647] DAMAGECOUNT value on done: 488249.0 [2024-08-06 03:52:44,355][52647] Sum rewards: 80.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.002', 'AMMO5': '0.014', 'weapon4': '0.028', 'AMMO2': '0.034', 'AMMO4': '0.167', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:44,452][52664] DAMAGECOUNT value on done: 472771.0 [2024-08-06 03:52:44,453][52664] Sum rewards: 67.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.866', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO4': '0.215', 'AMMO3': '0.215', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:45,824][52670] DAMAGECOUNT value on done: 455699.0 [2024-08-06 03:52:45,828][52670] Sum rewards: 64.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.073', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.378', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.264', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:46,046][52663] DAMAGECOUNT value on done: 458564.0 [2024-08-06 03:52:46,048][52663] Sum rewards: 75.584, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.785', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.101', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:46,317][52666] DAMAGECOUNT value on done: 450450.0 [2024-08-06 03:52:46,318][52666] Sum rewards: 73.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.538', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.146', 'weapon4': '0.184', 'AMMO4': '0.204', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '61.500'} [2024-08-06 03:52:47,197][52647] DAMAGECOUNT value on done: 480492.0 [2024-08-06 03:52:47,198][52647] Sum rewards: 83.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.532', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon2': '0.188', 'AMMO3': '0.191', 'weapon5': '0.230', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '66.000'} [2024-08-06 03:52:47,239][52803] DAMAGECOUNT value on done: 429212.0 [2024-08-06 03:52:47,239][52803] Sum rewards: 62.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.237', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.140', 'AMMO3': '0.172', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'weapon4': '0.444', 'weapon2': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.670', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '53.000'} [2024-08-06 03:52:47,339][52811] DAMAGECOUNT value on done: 427482.0 [2024-08-06 03:52:47,339][52811] Sum rewards: 80.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.570', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'weapon4': '0.096', 'AMMO4': '0.120', 'AMMO3': '0.203', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '68.000'} [2024-08-06 03:52:47,395][52664] DAMAGECOUNT value on done: 471817.0 [2024-08-06 03:52:47,397][52664] Sum rewards: 79.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.490', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.181', 'weapon4': '0.194', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 402710528. Throughput: 0: 4352.7. Samples: 100677710. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:47,795][52567] Avg episode reward: [(0, '71.011')] [2024-08-06 03:52:48,583][52650] Updated weights for policy 0, policy_version 49161 (0.0030) [2024-08-06 03:52:48,852][52663] DAMAGECOUNT value on done: 462344.0 [2024-08-06 03:52:48,852][52663] Sum rewards: 59.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.571', 'AMMO5': '0.020', 'AMMO2': '0.063', 'AMMO3': '0.181', 'weapon5': '0.200', 'weapon2': '0.292', 'AMMO4': '0.317', 'weapon4': '0.366', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '49.500'} [2024-08-06 03:52:48,917][52670] DAMAGECOUNT value on done: 447476.0 [2024-08-06 03:52:48,917][52670] Sum rewards: 67.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.246', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.252', 'weapon2': '0.358', 'WEAPON3': '1.000', 'weapon3': '3.140', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '53.000'} [2024-08-06 03:52:49,386][52666] DAMAGECOUNT value on done: 462638.0 [2024-08-06 03:52:49,394][52666] Sum rewards: 73.135, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.172', 'AMMO3': '0.205', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.728', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:50,147][52647] DAMAGECOUNT value on done: 473879.0 [2024-08-06 03:52:50,148][52647] Sum rewards: 71.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.437', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.138', 'weapon5': '0.170', 'AMMO3': '0.189', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:50,392][52664] DAMAGECOUNT value on done: 476322.0 [2024-08-06 03:52:50,394][52664] Sum rewards: 77.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.202', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.090', 'AMMO4': '0.148', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:50,410][52803] DAMAGECOUNT value on done: 426805.0 [2024-08-06 03:52:50,411][52803] Sum rewards: 79.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.081', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.075', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '66.000'} [2024-08-06 03:52:50,437][52811] DAMAGECOUNT value on done: 427747.0 [2024-08-06 03:52:50,439][52811] Sum rewards: 68.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.375', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.276', 'weapon2': '0.522', 'WEAPON3': '1.700', 'weapon3': '3.238', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:51,749][52663] DAMAGECOUNT value on done: 456021.0 [2024-08-06 03:52:51,751][52663] Sum rewards: 74.153, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.565', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.150', 'weapon2': '0.188', 'AMMO4': '0.247', 'AMMO3': '0.253', 'weapon4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '64.000'} [2024-08-06 03:52:51,965][52669] Large shaping reward 2.512 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('HEALTH', -0.057, -19.0), ('weapon5', 0.002)] [2024-08-06 03:52:52,044][52670] DAMAGECOUNT value on done: 449592.0 [2024-08-06 03:52:52,047][52670] Sum rewards: 67.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.138', 'AMMO4': '0.182', 'AMMO3': '0.239', 'weapon5': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '57.000'} [2024-08-06 03:52:52,489][52666] DAMAGECOUNT value on done: 458491.0 [2024-08-06 03:52:52,491][52666] Sum rewards: 77.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.682', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.168', 'weapon5': '0.180', 'weapon2': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '63.000'} [2024-08-06 03:52:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 402800640. Throughput: 0: 4364.7. Samples: 100703850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:52,794][52567] Avg episode reward: [(0, '71.504')] [2024-08-06 03:52:52,875][52647] DAMAGECOUNT value on done: 479158.0 [2024-08-06 03:52:52,876][52647] Sum rewards: 84.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.453', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.190', 'AMMO3': '0.228', 'weapon2': '0.228', 'AMMO4': '0.246', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '71.000'} [2024-08-06 03:52:53,159][52650] Updated weights for policy 0, policy_version 49171 (0.0012) [2024-08-06 03:52:53,193][52664] DAMAGECOUNT value on done: 473268.0 [2024-08-06 03:52:53,195][52664] Sum rewards: 71.754, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.134', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.494', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '56.000'} [2024-08-06 03:52:53,382][52811] DAMAGECOUNT value on done: 426922.0 [2024-08-06 03:52:53,384][52811] Sum rewards: 66.199, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.796', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.152', 'weapon5': '0.250', 'AMMO3': '0.270', 'AMMO4': '0.270', 'weapon2': '0.350', 'WEAPON5': '0.400', 'ARMOR': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.896', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '58.500'} [2024-08-06 03:52:53,588][52803] DAMAGECOUNT value on done: 422937.0 [2024-08-06 03:52:53,590][52803] Sum rewards: 69.122, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.114', 'weapon5': '0.186', 'AMMO3': '0.234', 'AMMO4': '0.262', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '59.500'} [2024-08-06 03:52:54,687][52663] DAMAGECOUNT value on done: 450811.0 [2024-08-06 03:52:54,689][52663] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.202', 'weapon4': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '53.000'} [2024-08-06 03:52:55,236][52670] DAMAGECOUNT value on done: 460152.0 [2024-08-06 03:52:55,236][52670] Sum rewards: 68.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.099', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:55,645][52666] DAMAGECOUNT value on done: 451758.0 [2024-08-06 03:52:55,649][52666] Sum rewards: 70.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.110', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon4': '0.238', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:55,853][52647] DAMAGECOUNT value on done: 476797.0 [2024-08-06 03:52:55,853][52647] Sum rewards: 74.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.889', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.266', 'WEAPON3': '1.200', 'HITCOUNT': '3.340', 'weapon3': '3.518', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:56,344][52664] DAMAGECOUNT value on done: 473114.0 [2024-08-06 03:52:56,344][52664] Sum rewards: 64.985, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.272', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.178', 'weapon5': '0.258', 'weapon2': '0.272', 'weapon4': '0.284', 'AMMO4': '0.308', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '2.864', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '54.000'} [2024-08-06 03:52:56,472][52811] DAMAGECOUNT value on done: 427659.0 [2024-08-06 03:52:56,473][52811] Sum rewards: 68.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.978', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.180', 'weapon2': '0.230', 'weapon5': '0.272', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '57.000'} [2024-08-06 03:52:56,706][52803] DAMAGECOUNT value on done: 432945.0 [2024-08-06 03:52:56,706][52803] Sum rewards: 69.396, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.892', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.088', 'weapon5': '0.168', 'AMMO3': '0.202', 'AMMO4': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '59.000'} [2024-08-06 03:52:57,673][52663] DAMAGECOUNT value on done: 450880.0 [2024-08-06 03:52:57,673][52663] Sum rewards: 79.696, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.595', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.282', 'weapon2': '0.428', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '69.000'} [2024-08-06 03:52:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 402882560. Throughput: 0: 4364.8. Samples: 100730080. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:52:57,795][52567] Avg episode reward: [(0, '71.467')] [2024-08-06 03:52:57,808][52650] Updated weights for policy 0, policy_version 49181 (0.0021) [2024-08-06 03:52:58,198][52670] DAMAGECOUNT value on done: 453919.0 [2024-08-06 03:52:58,198][52670] Sum rewards: 68.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.167', 'weapon5': '0.184', 'weapon4': '0.192', 'AMMO4': '0.219', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.164', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 03:52:58,296][52667] DAMAGECOUNT value on done: 456807.0 [2024-08-06 03:52:58,297][52667] Sum rewards: 81.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.986', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.278', 'weapon2': '0.378', 'WEAPON3': '1.750', 'weapon3': '3.304', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '70.000'} [2024-08-06 03:52:58,642][52666] DAMAGECOUNT value on done: 453076.0 [2024-08-06 03:52:58,644][52666] Sum rewards: 75.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.162', 'AMMO3': '0.201', 'AMMO4': '0.225', 'weapon5': '0.252', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '61.000'} [2024-08-06 03:52:59,104][52647] DAMAGECOUNT value on done: 479593.0 [2024-08-06 03:52:59,105][52647] Sum rewards: 65.916, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.872', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.130', 'weapon5': '0.240', 'AMMO4': '0.257', 'weapon4': '0.276', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.600', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '52.000'} [2024-08-06 03:52:59,510][52795] DAMAGECOUNT value on done: 425900.0 [2024-08-06 03:52:59,510][52795] Sum rewards: 66.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.904', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.086', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.334', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '58.000'} [2024-08-06 03:52:59,668][52803] DAMAGECOUNT value on done: 428429.0 [2024-08-06 03:52:59,669][52803] Sum rewards: 71.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.039', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.026', 'AMMO4': '0.027', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.255', 'weapon2': '0.648', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 03:53:00,431][52663] DAMAGECOUNT value on done: 451088.0 [2024-08-06 03:53:00,431][52663] Sum rewards: 69.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.969', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.120', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.292', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '60.000'} [2024-08-06 03:53:01,278][52670] DAMAGECOUNT value on done: 441036.0 [2024-08-06 03:53:01,279][52670] Sum rewards: 79.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.845', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO4': '0.106', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.600', 'weapon3': '3.148', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '67.000'} [2024-08-06 03:53:01,612][52666] DAMAGECOUNT value on done: 455281.0 [2024-08-06 03:53:01,614][52666] Sum rewards: 71.466, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.445', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.143', 'weapon5': '0.180', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.646', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:01,694][52667] DAMAGECOUNT value on done: 464832.0 [2024-08-06 03:53:01,695][52667] Sum rewards: 76.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.178', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '65.000'} [2024-08-06 03:53:02,577][52650] Updated weights for policy 0, policy_version 49191 (0.0014) [2024-08-06 03:53:02,714][52795] DAMAGECOUNT value on done: 415404.0 [2024-08-06 03:53:02,715][52795] Sum rewards: 63.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.588', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.150', 'weapon5': '0.194', 'AMMO3': '0.244', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '53.000'} [2024-08-06 03:53:02,778][52663] DAMAGECOUNT value on done: 461483.0 [2024-08-06 03:53:02,779][52663] Sum rewards: 64.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.465', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.250', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 402972672. Throughput: 0: 4363.8. Samples: 100743230. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:53:02,794][52567] Avg episode reward: [(0, '71.680')] [2024-08-06 03:53:03,002][52803] DAMAGECOUNT value on done: 430246.0 [2024-08-06 03:53:03,004][52803] Sum rewards: 61.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.018', 'AMMO4': '0.071', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '54.000'} [2024-08-06 03:53:04,451][52670] DAMAGECOUNT value on done: 450387.0 [2024-08-06 03:53:04,452][52670] Sum rewards: 75.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.038', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.052', 'AMMO4': '0.056', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.230', 'WEAPON3': '1.250', 'weapon3': '3.378', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '62.000'} [2024-08-06 03:53:04,759][52666] DAMAGECOUNT value on done: 457927.0 [2024-08-06 03:53:04,761][52666] Sum rewards: 85.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.108', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '69.000'} [2024-08-06 03:53:04,949][52667] DAMAGECOUNT value on done: 456725.0 [2024-08-06 03:53:04,950][52667] Sum rewards: 66.069, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.136', 'AMMO3': '0.166', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '54.000'} [2024-08-06 03:53:05,650][52663] DAMAGECOUNT value on done: 452707.0 [2024-08-06 03:53:05,651][52663] Sum rewards: 59.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.942', 'AMMO5': '0.025', 'AMMO2': '0.075', 'AMMO3': '0.195', 'weapon4': '0.196', 'weapon5': '0.318', 'AMMO4': '0.375', 'weapon2': '0.552', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.552', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '49.000'} [2024-08-06 03:53:05,905][52795] DAMAGECOUNT value on done: 415959.0 [2024-08-06 03:53:05,907][52795] Sum rewards: 75.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.108', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '65.000'} [2024-08-06 03:53:06,054][52803] DAMAGECOUNT value on done: 426458.0 [2024-08-06 03:53:06,056][52803] Sum rewards: 80.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.154', 'weapon4': '0.156', 'AMMO3': '0.204', 'AMMO4': '0.238', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '66.000'} [2024-08-06 03:53:07,160][52670] DAMAGECOUNT value on done: 460793.0 [2024-08-06 03:53:07,161][52670] Sum rewards: 68.371, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.155', 'HEALTH': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.866', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '54.000'} [2024-08-06 03:53:07,271][52650] Updated weights for policy 0, policy_version 49201 (0.0027) [2024-08-06 03:53:07,487][52666] DAMAGECOUNT value on done: 445087.0 [2024-08-06 03:53:07,487][52666] Sum rewards: 66.619, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon5': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.318', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '54.000'} [2024-08-06 03:53:07,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 403062784. Throughput: 0: 4361.8. Samples: 100769130. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:53:07,795][52567] Avg episode reward: [(0, '71.652')] [2024-08-06 03:53:08,122][52667] DAMAGECOUNT value on done: 457773.0 [2024-08-06 03:53:08,122][52667] Sum rewards: 66.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.168', 'AMMO3': '0.216', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '56.000'} [2024-08-06 03:53:08,286][52663] DAMAGECOUNT value on done: 460722.0 [2024-08-06 03:53:08,288][52663] Sum rewards: 67.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.126', 'AMMO4': '0.164', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.342', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:09,187][52795] DAMAGECOUNT value on done: 422756.0 [2024-08-06 03:53:09,187][52795] Sum rewards: 74.631, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.542', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.064', 'AMMO4': '0.163', 'weapon5': '0.224', 'AMMO3': '0.255', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.500'} [2024-08-06 03:53:10,160][52670] DAMAGECOUNT value on done: 452978.0 [2024-08-06 03:53:10,162][52670] Sum rewards: 65.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.480', 'AMMO5': '0.026', 'AMMO2': '0.054', 'weapon4': '0.128', 'AMMO3': '0.217', 'weapon5': '0.254', 'AMMO4': '0.273', 'weapon2': '0.340', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:10,361][52666] DAMAGECOUNT value on done: 452272.0 [2024-08-06 03:53:10,361][52666] Sum rewards: 72.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.114', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:10,943][52667] DAMAGECOUNT value on done: 463475.0 [2024-08-06 03:53:10,952][52667] Sum rewards: 57.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.160', 'weapon5': '0.214', 'AMMO4': '0.231', 'AMMO3': '0.256', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.012', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '50.000'} [2024-08-06 03:53:11,612][52663] DAMAGECOUNT value on done: 457228.0 [2024-08-06 03:53:11,616][52663] Sum rewards: 66.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.314', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.164', 'AMMO3': '0.190', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '54.500'} [2024-08-06 03:53:11,753][52650] Updated weights for policy 0, policy_version 49211 (0.0016) [2024-08-06 03:53:12,316][52795] DAMAGECOUNT value on done: 418991.0 [2024-08-06 03:53:12,317][52795] Sum rewards: 73.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.061', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon4': '0.206', 'weapon5': '0.210', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '61.000'} [2024-08-06 03:53:12,614][52670] DAMAGECOUNT value on done: 455891.0 [2024-08-06 03:53:12,614][52670] Sum rewards: 69.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.849', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.084', 'weapon4': '0.098', 'AMMO3': '0.170', 'AMMO4': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 403144704. Throughput: 0: 4374.9. Samples: 100795880. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:53:12,795][52567] Avg episode reward: [(0, '71.105')] [2024-08-06 03:53:13,908][52667] DAMAGECOUNT value on done: 467069.0 [2024-08-06 03:53:13,909][52667] Sum rewards: 62.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.188', 'AMMO4': '0.198', 'AMMO3': '0.213', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '52.000'} [2024-08-06 03:53:14,403][52663] DAMAGECOUNT value on done: 451539.0 [2024-08-06 03:53:14,404][52663] Sum rewards: 76.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.226', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.120', 'AMMO3': '0.182', 'weapon4': '0.192', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '63.000'} [2024-08-06 03:53:15,386][52795] DAMAGECOUNT value on done: 425324.0 [2024-08-06 03:53:15,388][52795] Sum rewards: 73.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.351', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.114', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.216', 'WEAPON3': '1.350', 'HITCOUNT': '3.310', 'weapon3': '3.430', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '62.000'} [2024-08-06 03:53:15,839][52671] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:53:16,501][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:53:16,644][52650] Updated weights for policy 0, policy_version 49221 (0.0020) [2024-08-06 03:53:17,087][52667] DAMAGECOUNT value on done: 459097.0 [2024-08-06 03:53:17,088][52667] Sum rewards: 74.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.461', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.220', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.426', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '63.000'} [2024-08-06 03:53:17,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 403234816. Throughput: 0: 4380.2. Samples: 100808980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:17,795][52567] Avg episode reward: [(0, '71.261')] [2024-08-06 03:53:18,568][52795] DAMAGECOUNT value on done: 431608.0 [2024-08-06 03:53:18,569][52795] Sum rewards: 70.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.276', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.185', 'weapon5': '0.194', 'AMMO4': '0.257', 'weapon4': '0.314', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:20,131][52667] DAMAGECOUNT value on done: 459133.0 [2024-08-06 03:53:20,131][52667] Sum rewards: 67.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.554', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.179', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.496', 'WEAPON3': '1.050', 'weapon3': '2.892', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:20,169][52669] DAMAGECOUNT value on done: 462856.0 [2024-08-06 03:53:20,169][52669] Sum rewards: 71.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.174', 'AMMO4': '0.222', 'AMMO3': '0.231', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:21,029][52650] Updated weights for policy 0, policy_version 49231 (0.0020) [2024-08-06 03:53:21,684][52795] DAMAGECOUNT value on done: 427430.0 [2024-08-06 03:53:21,686][52795] Sum rewards: 77.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.333', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.036', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '64.000'} [2024-08-06 03:53:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 403324928. Throughput: 0: 4367.6. Samples: 100835130. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:22,794][52567] Avg episode reward: [(0, '71.312')] [2024-08-06 03:53:23,149][52667] DAMAGECOUNT value on done: 461815.0 [2024-08-06 03:53:23,151][52667] Sum rewards: 64.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon7': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.210', 'AMMO4': '0.230', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon4': '1.108', 'weapon3': '2.162', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '54.000'} [2024-08-06 03:53:23,153][52669] DAMAGECOUNT value on done: 452467.0 [2024-08-06 03:53:23,153][52669] Sum rewards: 66.752, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.040', 'weapon5': '0.060', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.674', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:24,755][52795] DAMAGECOUNT value on done: 417105.0 [2024-08-06 03:53:24,755][52795] Sum rewards: 75.248, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.570', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.122', 'weapon4': '0.136', 'AMMO4': '0.203', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '63.000'} [2024-08-06 03:53:25,736][52650] Updated weights for policy 0, policy_version 49241 (0.0013) [2024-08-06 03:53:25,995][52669] DAMAGECOUNT value on done: 461087.0 [2024-08-06 03:53:25,995][52669] Sum rewards: 66.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.054', 'weapon5': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.257', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.252', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:26,365][52667] DAMAGECOUNT value on done: 468070.0 [2024-08-06 03:53:26,365][52667] Sum rewards: 62.360, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.904', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.079', 'WEAPON4': '0.200', 'weapon5': '0.216', 'AMMO3': '0.282', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.750', 'weapon3': '3.016', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:26,430][52668] DAMAGECOUNT value on done: 458313.0 [2024-08-06 03:53:26,431][52668] Sum rewards: 70.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.748', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.118', 'weapon5': '0.174', 'AMMO3': '0.192', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:27,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 403415040. Throughput: 0: 4377.1. Samples: 100861570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:27,794][52567] Avg episode reward: [(0, '71.417')] [2024-08-06 03:53:27,966][52795] DAMAGECOUNT value on done: 430936.0 [2024-08-06 03:53:27,967][52795] Sum rewards: 65.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.354', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon2': '0.236', 'AMMO4': '0.245', 'weapon5': '0.258', 'AMMO3': '0.261', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.850', 'weapon3': '3.038', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:29,299][52669] DAMAGECOUNT value on done: 458474.0 [2024-08-06 03:53:29,299][52669] Sum rewards: 71.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.157', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.238', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:29,506][52668] DAMAGECOUNT value on done: 461952.0 [2024-08-06 03:53:29,508][52668] Sum rewards: 64.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.134', 'AMMO4': '0.199', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.426', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.678', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '56.000'} [2024-08-06 03:53:29,732][52667] DAMAGECOUNT value on done: 456532.0 [2024-08-06 03:53:29,732][52667] Sum rewards: 68.672, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.540', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.244', 'AMMO3': '0.247', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.198', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:30,142][52658] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:53:30,667][52650] Updated weights for policy 0, policy_version 49251 (0.0023) [2024-08-06 03:53:31,170][52795] DAMAGECOUNT value on done: 423966.0 [2024-08-06 03:53:31,174][52795] Sum rewards: 70.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.022', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.116', 'AMMO4': '0.152', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.358', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:32,025][52668] DAMAGECOUNT value on done: 462503.0 [2024-08-06 03:53:32,025][52668] Sum rewards: 74.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.735', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.096', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.344', 'WEAPON3': '1.700', 'weapon3': '3.178', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '64.000'} [2024-08-06 03:53:32,408][52669] DAMAGECOUNT value on done: 457921.0 [2024-08-06 03:53:32,411][52669] Sum rewards: 67.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:32,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 403505152. Throughput: 0: 4373.6. Samples: 100874520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:32,795][52567] Avg episode reward: [(0, '71.175')] [2024-08-06 03:53:32,860][52667] DAMAGECOUNT value on done: 458383.0 [2024-08-06 03:53:32,861][52667] Sum rewards: 77.589, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.059', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.146', 'AMMO4': '0.146', 'weapon5': '0.184', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '60.000'} [2024-08-06 03:53:34,402][52795] DAMAGECOUNT value on done: 421284.0 [2024-08-06 03:53:34,402][52795] Sum rewards: 60.988, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.164', 'AMMO4': '0.201', 'weapon5': '0.204', 'AMMO3': '0.221', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '52.000'} [2024-08-06 03:53:35,057][52650] Updated weights for policy 0, policy_version 49261 (0.0012) [2024-08-06 03:53:35,099][52668] DAMAGECOUNT value on done: 465561.0 [2024-08-06 03:53:35,101][52668] Sum rewards: 80.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.475', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '67.000'} [2024-08-06 03:53:35,488][52669] DAMAGECOUNT value on done: 463337.0 [2024-08-06 03:53:35,489][52669] Sum rewards: 71.722, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.611', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.256', 'weapon2': '0.284', 'WEAPON3': '1.550', 'weapon3': '3.468', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '63.000'} [2024-08-06 03:53:35,504][52667] DAMAGECOUNT value on done: 463208.0 [2024-08-06 03:53:35,505][52667] Sum rewards: 71.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.810', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:37,535][52795] DAMAGECOUNT value on done: 419547.0 [2024-08-06 03:53:37,536][52795] Sum rewards: 69.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.190', 'AMMO3': '0.204', 'weapon5': '0.218', 'AMMO4': '0.230', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:37,666][52667] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:53:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 403587072. Throughput: 0: 4380.7. Samples: 100900980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:37,802][52567] Avg episode reward: [(0, '70.839')] [2024-08-06 03:53:37,955][52668] DAMAGECOUNT value on done: 451955.0 [2024-08-06 03:53:37,957][52668] Sum rewards: 61.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon5': '0.224', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.152', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '54.000'} [2024-08-06 03:53:38,269][52667] DAMAGECOUNT value on done: 456439.0 [2024-08-06 03:53:38,270][52667] Sum rewards: 57.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.839', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.052', 'weapon5': '0.144', 'AMMO3': '0.221', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.010', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '49.000'} [2024-08-06 03:53:38,685][52669] DAMAGECOUNT value on done: 458633.0 [2024-08-06 03:53:38,685][52669] Sum rewards: 62.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.870', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.020', 'weapon5': '0.058', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.734', 'WEAPON3': '0.950', 'weapon3': '3.088', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '50.000'} [2024-08-06 03:53:39,961][52650] Updated weights for policy 0, policy_version 49271 (0.0017) [2024-08-06 03:53:40,319][52662] DAMAGECOUNT value on done: 464657.0 [2024-08-06 03:53:40,319][52662] Sum rewards: 83.284, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.525', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.178', 'AMMO3': '0.212', 'weapon4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '68.000'} [2024-08-06 03:53:40,625][52795] DAMAGECOUNT value on done: 427616.0 [2024-08-06 03:53:40,625][52795] Sum rewards: 77.330, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.573', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon4': '0.218', 'weapon5': '0.224', 'AMMO3': '0.266', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.922', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '65.000'} [2024-08-06 03:53:40,805][52667] DAMAGECOUNT value on done: 463144.0 [2024-08-06 03:53:40,805][52667] Sum rewards: 64.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.408', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.164', 'weapon5': '0.192', 'AMMO3': '0.220', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.072', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:40,852][52668] DAMAGECOUNT value on done: 462479.0 [2024-08-06 03:53:40,853][52668] Sum rewards: 77.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.989', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.194', 'weapon2': '0.226', 'AMMO3': '0.234', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.800', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '65.000'} [2024-08-06 03:53:41,728][52671] DAMAGECOUNT value on done: 463630.0 [2024-08-06 03:53:41,729][52671] Sum rewards: 70.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.302', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.130', 'weapon5': '0.154', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.650', 'weapon3': '3.016', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '60.000'} [2024-08-06 03:53:41,888][52669] DAMAGECOUNT value on done: 461157.0 [2024-08-06 03:53:41,889][52669] Sum rewards: 70.023, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.454', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.096', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.542', 'WEAPON3': '1.600', 'weapon3': '3.032', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:42,288][52820] DAMAGECOUNT value on done: 422318.0 [2024-08-06 03:53:42,288][52820] Sum rewards: 84.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.094', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'weapon3': '3.434', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '72.000'} [2024-08-06 03:53:42,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 403677184. Throughput: 0: 4380.5. Samples: 100927200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:42,794][52567] Avg episode reward: [(0, '70.929')] [2024-08-06 03:53:43,288][52662] DAMAGECOUNT value on done: 466823.0 [2024-08-06 03:53:43,289][52662] Sum rewards: 71.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.128', 'AMMO3': '0.171', 'AMMO4': '0.180', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.280', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:43,605][52667] DAMAGECOUNT value on done: 468874.0 [2024-08-06 03:53:43,607][52667] Sum rewards: 76.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.131', 'weapon5': '0.136', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '62.000'} [2024-08-06 03:53:43,770][52795] DAMAGECOUNT value on done: 417028.0 [2024-08-06 03:53:43,770][52795] Sum rewards: 70.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.589', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.036', 'weapon4': '0.068', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:43,783][52668] DAMAGECOUNT value on done: 464141.0 [2024-08-06 03:53:43,783][52668] Sum rewards: 70.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.050', 'AMMO4': '0.063', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:44,362][52650] Updated weights for policy 0, policy_version 49281 (0.0013) [2024-08-06 03:53:44,746][52669] DAMAGECOUNT value on done: 465576.0 [2024-08-06 03:53:44,746][52669] Sum rewards: 75.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'weapon5': '0.046', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.210', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.484', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '64.000'} [2024-08-06 03:53:44,933][52671] DAMAGECOUNT value on done: 464370.0 [2024-08-06 03:53:44,936][52671] Sum rewards: 70.121, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.186', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon4': '0.298', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:45,317][52820] DAMAGECOUNT value on done: 424473.0 [2024-08-06 03:53:45,318][52820] Sum rewards: 54.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'AMMO5': '0.017', 'AMMO2': '0.072', 'weapon5': '0.132', 'AMMO3': '0.245', 'weapon4': '0.336', 'AMMO4': '0.360', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.894', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '46.000'} [2024-08-06 03:53:45,839][52662] DAMAGECOUNT value on done: 464341.0 [2024-08-06 03:53:45,841][52662] Sum rewards: 67.369, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.168', 'AMMO4': '0.170', 'weapon5': '0.182', 'weapon4': '0.200', 'HEALTH': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '0.900', 'weapon3': '2.822', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '54.000'} [2024-08-06 03:53:46,571][52667] DAMAGECOUNT value on done: 467052.0 [2024-08-06 03:53:46,572][52667] Sum rewards: 75.618, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.112', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.358', 'WEAPON3': '1.000', 'weapon3': '3.230', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:46,717][52668] DAMAGECOUNT value on done: 454638.0 [2024-08-06 03:53:46,718][52668] Sum rewards: 71.005, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.143', 'AMMO3': '0.173', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.460', 'weapon2': '0.516', 'WEAPON3': '1.000', 'weapon3': '3.014', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:46,898][52795] DAMAGECOUNT value on done: 435629.0 [2024-08-06 03:53:46,898][52795] Sum rewards: 71.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.706', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '59.500'} [2024-08-06 03:53:47,631][52669] DAMAGECOUNT value on done: 458376.0 [2024-08-06 03:53:47,633][52669] Sum rewards: 72.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'weapon4': '0.170', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '62.000'} [2024-08-06 03:53:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 403767296. Throughput: 0: 4379.3. Samples: 100940300. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:47,795][52567] Avg episode reward: [(0, '70.688')] [2024-08-06 03:53:48,091][52671] DAMAGECOUNT value on done: 463295.0 [2024-08-06 03:53:48,091][52671] Sum rewards: 69.837, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO4': '0.140', 'weapon5': '0.160', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:48,448][52820] DAMAGECOUNT value on done: 426142.0 [2024-08-06 03:53:48,449][52820] Sum rewards: 69.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.036', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.269', 'weapon2': '0.358', 'WEAPON3': '1.750', 'weapon3': '3.346', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '60.000'} [2024-08-06 03:53:48,835][52662] DAMAGECOUNT value on done: 454532.0 [2024-08-06 03:53:48,835][52662] Sum rewards: 72.268, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.050', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon5': '0.172', 'weapon4': '0.190', 'AMMO4': '0.264', 'AMMO3': '0.273', 'weapon2': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.912', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '62.000'} [2024-08-06 03:53:48,931][52667] DAMAGECOUNT value on done: 465224.0 [2024-08-06 03:53:48,932][52667] Sum rewards: 64.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.186', 'AMMO3': '0.239', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.874', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '53.000'} [2024-08-06 03:53:49,270][52650] Updated weights for policy 0, policy_version 49291 (0.0028) [2024-08-06 03:53:50,004][52795] DAMAGECOUNT value on done: 426885.0 [2024-08-06 03:53:50,006][52795] Sum rewards: 71.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.190', 'weapon5': '0.202', 'AMMO3': '0.233', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '61.000'} [2024-08-06 03:53:50,011][52668] DAMAGECOUNT value on done: 456914.0 [2024-08-06 03:53:50,013][52668] Sum rewards: 66.127, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.112', 'AMMO5': '0.025', 'AMMO2': '0.062', 'weapon4': '0.190', 'AMMO3': '0.251', 'weapon5': '0.282', 'AMMO4': '0.309', 'weapon2': '0.316', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.784', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:50,154][52660] DAMAGECOUNT value on done: 460006.0 [2024-08-06 03:53:50,155][52660] Sum rewards: 80.778, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.189', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.126', 'weapon2': '0.158', 'AMMO3': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.584', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '68.000'} [2024-08-06 03:53:50,228][52669] DAMAGECOUNT value on done: 466471.0 [2024-08-06 03:53:50,229][52669] Sum rewards: 84.281, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'weapon3': '3.372', 'HITCOUNT': '4.360', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '72.000'} [2024-08-06 03:53:50,970][52671] DAMAGECOUNT value on done: 460919.0 [2024-08-06 03:53:50,970][52671] Sum rewards: 60.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.300', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.100', 'weapon2': '0.206', 'weapon5': '0.258', 'AMMO3': '0.287', 'AMMO4': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'HITCOUNT': '3.090', 'weapon3': '3.128', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '53.000'} [2024-08-06 03:53:51,553][52820] DAMAGECOUNT value on done: 420064.0 [2024-08-06 03:53:51,554][52820] Sum rewards: 65.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.648', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.136', 'AMMO4': '0.206', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '56.000'} [2024-08-06 03:53:51,974][52662] DAMAGECOUNT value on done: 466036.0 [2024-08-06 03:53:51,976][52662] Sum rewards: 75.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'weapon5': '0.012', 'weapon4': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '62.000'} [2024-08-06 03:53:52,147][52667] DAMAGECOUNT value on done: 459392.0 [2024-08-06 03:53:52,147][52667] Sum rewards: 68.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.737', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.222', 'weapon2': '0.258', 'AMMO3': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:52,590][52668] DAMAGECOUNT value on done: 464307.0 [2024-08-06 03:53:52,590][52668] Sum rewards: 79.956, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.646', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.076', 'AMMO4': '0.107', 'weapon5': '0.138', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '68.000'} [2024-08-06 03:53:52,698][52660] DAMAGECOUNT value on done: 451673.0 [2024-08-06 03:53:52,699][52660] Sum rewards: 57.305, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.275', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'AMMO4': '0.187', 'weapon4': '0.224', 'WEAPON4': '0.400', 'weapon2': '0.738', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '48.000'} [2024-08-06 03:53:52,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 403849216. Throughput: 0: 4390.7. Samples: 100966710. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:52,802][52567] Avg episode reward: [(0, '70.416')] [2024-08-06 03:53:53,230][52795] DAMAGECOUNT value on done: 418856.0 [2024-08-06 03:53:53,231][52795] Sum rewards: 74.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.464', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO4': '0.211', 'AMMO3': '0.223', 'weapon4': '0.262', 'weapon5': '0.262', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '60.000'} [2024-08-06 03:53:53,391][52669] DAMAGECOUNT value on done: 463998.0 [2024-08-06 03:53:53,392][52669] Sum rewards: 84.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.031', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '72.000'} [2024-08-06 03:53:53,761][52650] Updated weights for policy 0, policy_version 49301 (0.0042) [2024-08-06 03:53:53,889][52671] DAMAGECOUNT value on done: 471864.0 [2024-08-06 03:53:53,890][52671] Sum rewards: 79.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.125', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.216', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.667', 'FRAGCOUNT': '67.000'} [2024-08-06 03:53:54,422][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:53:54,703][52820] DAMAGECOUNT value on done: 429936.0 [2024-08-06 03:53:54,704][52820] Sum rewards: 68.739, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.348', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.254', 'weapon2': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.522', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:54,952][52667] DAMAGECOUNT value on done: 465210.0 [2024-08-06 03:53:54,953][52667] Sum rewards: 58.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.472', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '52.000'} [2024-08-06 03:53:55,046][52668] DAMAGECOUNT value on done: 459538.0 [2024-08-06 03:53:55,047][52668] Sum rewards: 66.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.151', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.142', 'weapon2': '0.192', 'AMMO4': '0.199', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.284', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '56.000'} [2024-08-06 03:53:55,069][52662] DAMAGECOUNT value on done: 457810.0 [2024-08-06 03:53:55,071][52662] Sum rewards: 69.030, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.033', 'HEALTH': '0.035', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon4': '0.212', 'AMMO3': '0.218', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '57.000'} [2024-08-06 03:53:55,288][52660] DAMAGECOUNT value on done: 462345.0 [2024-08-06 03:53:55,288][52660] Sum rewards: 59.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.284', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.104', 'AMMO3': '0.149', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '49.000'} [2024-08-06 03:53:55,757][52658] DAMAGECOUNT value on done: 457912.0 [2024-08-06 03:53:55,757][52658] Sum rewards: 68.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.254', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.136', 'weapon4': '0.146', 'AMMO4': '0.151', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '56.000'} [2024-08-06 03:53:56,510][52669] DAMAGECOUNT value on done: 451291.0 [2024-08-06 03:53:56,510][52669] Sum rewards: 69.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.584', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.090', 'weapon5': '0.106', 'AMMO4': '0.119', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.278', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '56.000'} [2024-08-06 03:53:56,686][52671] DAMAGECOUNT value on done: 460568.0 [2024-08-06 03:53:56,687][52671] Sum rewards: 69.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.442', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 03:53:56,733][52795] DAMAGECOUNT value on done: 427535.0 [2024-08-06 03:53:56,733][52795] Sum rewards: 72.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.432', 'AMMO5': '0.011', 'AMMO2': '0.058', 'weapon4': '0.116', 'weapon5': '0.178', 'AMMO3': '0.190', 'AMMO4': '0.291', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '59.000'} [2024-08-06 03:53:57,523][52662] DAMAGECOUNT value on done: 467691.0 [2024-08-06 03:53:57,525][52662] Sum rewards: 61.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.228', 'weapon2': '0.342', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.314', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '53.000'} [2024-08-06 03:53:57,780][52820] DAMAGECOUNT value on done: 419294.0 [2024-08-06 03:53:57,781][52820] Sum rewards: 66.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 03:53:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 403939328. Throughput: 0: 4372.9. Samples: 100992660. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:53:57,795][52567] Avg episode reward: [(0, '70.177')] [2024-08-06 03:53:58,096][52668] DAMAGECOUNT value on done: 454063.0 [2024-08-06 03:53:58,096][52668] Sum rewards: 63.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.284', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.502', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '53.000'} [2024-08-06 03:53:58,200][52660] DAMAGECOUNT value on done: 468099.0 [2024-08-06 03:53:58,202][52660] Sum rewards: 86.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.411', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.136', 'weapon4': '0.174', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.468', 'FRAGCOUNT': '71.000'} [2024-08-06 03:53:58,487][52650] Updated weights for policy 0, policy_version 49311 (0.0025) [2024-08-06 03:53:58,796][52658] DAMAGECOUNT value on done: 460781.0 [2024-08-06 03:53:58,800][52658] Sum rewards: 76.883, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.997', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO4': '0.178', 'AMMO3': '0.193', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '62.500'} [2024-08-06 03:53:59,525][52671] DAMAGECOUNT value on done: 466708.0 [2024-08-06 03:53:59,526][52671] Sum rewards: 69.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.572', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.316', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.398', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '60.000'} [2024-08-06 03:53:59,573][52669] DAMAGECOUNT value on done: 463383.0 [2024-08-06 03:53:59,573][52669] Sum rewards: 75.638, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.634', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.114', 'weapon5': '0.116', 'AMMO4': '0.197', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '65.000'} [2024-08-06 03:54:00,001][52795] DAMAGECOUNT value on done: 430359.0 [2024-08-06 03:54:00,002][52795] Sum rewards: 84.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.172', 'AMMO3': '0.229', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '70.000'} [2024-08-06 03:54:00,469][52662] DAMAGECOUNT value on done: 471184.0 [2024-08-06 03:54:00,469][52662] Sum rewards: 79.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.006', 'AMMO2': '0.026', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '65.000'} [2024-08-06 03:54:00,806][52668] DAMAGECOUNT value on done: 449496.0 [2024-08-06 03:54:00,808][52668] Sum rewards: 59.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.729', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.112', 'weapon4': '0.114', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.102', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '49.000'} [2024-08-06 03:54:01,125][52660] DAMAGECOUNT value on done: 458957.0 [2024-08-06 03:54:01,126][52660] Sum rewards: 64.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.116', 'AMMO4': '0.149', 'weapon5': '0.166', 'weapon2': '0.214', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.212', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:01,139][52820] DAMAGECOUNT value on done: 423044.0 [2024-08-06 03:54:01,140][52820] Sum rewards: 68.622, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.534', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.180', 'weapon4': '0.188', 'weapon5': '0.238', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.004', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:01,485][52658] DAMAGECOUNT value on done: 465202.0 [2024-08-06 03:54:01,487][52658] Sum rewards: 69.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.196', 'AMMO3': '0.205', 'AMMO4': '0.227', 'weapon4': '0.236', 'weapon2': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:02,071][52669] DAMAGECOUNT value on done: 464553.0 [2024-08-06 03:54:02,072][52669] Sum rewards: 67.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.130', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '56.000'} [2024-08-06 03:54:02,689][52671] DAMAGECOUNT value on done: 463729.0 [2024-08-06 03:54:02,690][52671] Sum rewards: 72.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.185', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.112', 'AMMO4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '59.000'} [2024-08-06 03:54:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 404029440. Throughput: 0: 4375.8. Samples: 101005890. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:54:02,794][52567] Avg episode reward: [(0, '70.254')] [2024-08-06 03:54:03,229][52650] Updated weights for policy 0, policy_version 49321 (0.0013) [2024-08-06 03:54:03,305][52662] DAMAGECOUNT value on done: 458502.0 [2024-08-06 03:54:03,306][52662] Sum rewards: 70.073, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.117', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.172', 'AMMO3': '0.174', 'weapon5': '0.176', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.130', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '56.000'} [2024-08-06 03:54:03,888][52668] DAMAGECOUNT value on done: 450098.0 [2024-08-06 03:54:03,888][52668] Sum rewards: 74.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.348', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.074', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.304', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '64.000'} [2024-08-06 03:54:04,192][52660] DAMAGECOUNT value on done: 456464.0 [2024-08-06 03:54:04,193][52660] Sum rewards: 63.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.045', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.088', 'AMMO4': '0.158', 'AMMO3': '0.191', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '2.886', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '52.000'} [2024-08-06 03:54:04,250][52658] DAMAGECOUNT value on done: 463634.0 [2024-08-06 03:54:04,254][52658] Sum rewards: 66.692, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.681', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon2': '0.200', 'weapon5': '0.212', 'AMMO4': '0.258', 'AMMO3': '0.265', 'weapon4': '0.340', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '56.500'} [2024-08-06 03:54:04,434][52820] DAMAGECOUNT value on done: 426420.0 [2024-08-06 03:54:04,434][52820] Sum rewards: 61.723, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.137', 'weapon5': '0.182', 'AMMO4': '0.187', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.430', 'WEAPON3': '0.850', 'HITCOUNT': '2.730', 'weapon3': '2.854', 'DAMAGECOUNT': '13.944', 'FRAGCOUNT': '50.000'} [2024-08-06 03:54:04,467][52669] DAMAGECOUNT value on done: 475142.0 [2024-08-06 03:54:04,467][52669] Sum rewards: 64.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:05,523][52671] DAMAGECOUNT value on done: 458537.0 [2024-08-06 03:54:05,524][52671] Sum rewards: 66.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.430', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.144', 'AMMO4': '0.157', 'weapon2': '0.238', 'weapon5': '0.246', 'AMMO3': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.092', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '57.000'} [2024-08-06 03:54:05,558][52665] DAMAGECOUNT value on done: 450095.0 [2024-08-06 03:54:05,560][52665] Sum rewards: 74.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.002', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.157', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '59.000'} [2024-08-06 03:54:06,181][52811] Large shaping reward 3.411 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.36, 120.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:54:06,602][52662] DAMAGECOUNT value on done: 472632.0 [2024-08-06 03:54:06,603][52662] Sum rewards: 83.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon4': '0.180', 'AMMO3': '0.186', 'weapon5': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '66.000'} [2024-08-06 03:54:07,082][52669] DAMAGECOUNT value on done: 464920.0 [2024-08-06 03:54:07,084][52669] Sum rewards: 73.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.276', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.186', 'AMMO3': '0.202', 'weapon4': '0.208', 'AMMO4': '0.250', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.000'} [2024-08-06 03:54:07,132][52668] DAMAGECOUNT value on done: 449909.0 [2024-08-06 03:54:07,132][52668] Sum rewards: 71.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.305', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.090', 'weapon5': '0.180', 'AMMO3': '0.194', 'AMMO4': '0.222', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.220', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:07,267][52658] DAMAGECOUNT value on done: 452373.0 [2024-08-06 03:54:07,269][52658] Sum rewards: 61.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.068', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon5': '0.208', 'AMMO3': '0.217', 'AMMO4': '0.247', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '51.000'} [2024-08-06 03:54:07,411][52660] DAMAGECOUNT value on done: 457250.0 [2024-08-06 03:54:07,411][52660] Sum rewards: 76.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.175', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.089', 'weapon5': '0.124', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:07,521][52820] DAMAGECOUNT value on done: 422571.0 [2024-08-06 03:54:07,522][52820] Sum rewards: 66.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.431', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.144', 'weapon4': '0.218', 'AMMO3': '0.232', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '56.500'} [2024-08-06 03:54:07,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17476.1, 300 sec: 17494.7). Total num frames: 404111360. Throughput: 0: 4379.1. Samples: 101032190. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:54:07,796][52567] Avg episode reward: [(0, '70.304')] [2024-08-06 03:54:07,864][52650] Updated weights for policy 0, policy_version 49331 (0.0025) [2024-08-06 03:54:07,946][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:54:08,347][52671] DAMAGECOUNT value on done: 465921.0 [2024-08-06 03:54:08,347][52671] Sum rewards: 67.174, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.243', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 03:54:08,769][52665] DAMAGECOUNT value on done: 461612.0 [2024-08-06 03:54:08,771][52665] Sum rewards: 73.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.001', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.126', 'AMMO4': '0.196', 'weapon5': '0.232', 'AMMO3': '0.242', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.988', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '62.000'} [2024-08-06 03:54:09,711][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:54:09,740][52662] DAMAGECOUNT value on done: 458320.0 [2024-08-06 03:54:09,740][52662] Sum rewards: 79.376, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.096', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.390', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:10,055][52668] DAMAGECOUNT value on done: 459155.0 [2024-08-06 03:54:10,055][52668] Sum rewards: 75.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.038', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.094', 'AMMO4': '0.105', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '60.500'} [2024-08-06 03:54:10,107][52658] DAMAGECOUNT value on done: 459289.0 [2024-08-06 03:54:10,108][52658] Sum rewards: 71.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'AMMO4': '0.213', 'weapon2': '0.962', 'WEAPON3': '1.200', 'weapon3': '2.758', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '60.000'} [2024-08-06 03:54:10,124][52669] DAMAGECOUNT value on done: 463180.0 [2024-08-06 03:54:10,125][52669] Sum rewards: 61.832, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.586', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.178', 'weapon2': '0.260', 'AMMO3': '0.263', 'AMMO4': '0.289', 'WEAPON5': '0.450', 'weapon4': '0.488', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.664', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '54.000'} [2024-08-06 03:54:10,206][52660] DAMAGECOUNT value on done: 464309.0 [2024-08-06 03:54:10,206][52660] Sum rewards: 61.233, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'weapon4': '0.060', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'weapon2': '0.380', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.262', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '53.000'} [2024-08-06 03:54:10,690][52820] DAMAGECOUNT value on done: 432600.0 [2024-08-06 03:54:10,692][52820] Sum rewards: 71.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.895', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.212', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '59.000'} [2024-08-06 03:54:11,541][52671] DAMAGECOUNT value on done: 468427.0 [2024-08-06 03:54:11,541][52671] Sum rewards: 63.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.304', 'AMMO5': '0.006', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon5': '0.188', 'weapon4': '0.234', 'weapon2': '0.296', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '50.500'} [2024-08-06 03:54:11,696][52665] DAMAGECOUNT value on done: 457840.0 [2024-08-06 03:54:11,696][52665] Sum rewards: 68.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.134', 'weapon4': '0.162', 'weapon2': '0.176', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.288', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 03:54:12,340][52662] DAMAGECOUNT value on done: 462502.0 [2024-08-06 03:54:12,340][52662] Sum rewards: 69.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.862', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon4': '0.034', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.155', 'weapon5': '0.166', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '56.000'} [2024-08-06 03:54:12,381][52658] DAMAGECOUNT value on done: 463293.0 [2024-08-06 03:54:12,381][52658] Sum rewards: 72.109, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.932', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.166', 'weapon2': '0.202', 'weapon5': '0.204', 'AMMO4': '0.249', 'AMMO3': '0.295', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.106', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:12,696][52650] Updated weights for policy 0, policy_version 49341 (0.0031) [2024-08-06 03:54:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 404201472. Throughput: 0: 4374.0. Samples: 101058400. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:54:12,794][52567] Avg episode reward: [(0, '70.368')] [2024-08-06 03:54:12,891][52668] DAMAGECOUNT value on done: 460617.0 [2024-08-06 03:54:12,893][52668] Sum rewards: 75.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.595', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'weapon2': '0.626', 'WEAPON3': '0.950', 'weapon3': '3.028', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '60.000'} [2024-08-06 03:54:13,020][52660] DAMAGECOUNT value on done: 461858.0 [2024-08-06 03:54:13,021][52660] Sum rewards: 64.053, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.247', 'weapon2': '0.292', 'weapon4': '0.414', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '53.000'} [2024-08-06 03:54:13,252][52669] DAMAGECOUNT value on done: 466126.0 [2024-08-06 03:54:13,253][52669] Sum rewards: 75.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.494', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.114', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '62.000'} [2024-08-06 03:54:13,862][52820] DAMAGECOUNT value on done: 422021.0 [2024-08-06 03:54:13,865][52820] Sum rewards: 64.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.240', 'weapon2': '0.254', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:14,579][52671] DAMAGECOUNT value on done: 462924.0 [2024-08-06 03:54:14,579][52671] Sum rewards: 75.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.117', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO3': '0.196', 'AMMO4': '0.258', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '61.000'} [2024-08-06 03:54:14,817][52665] DAMAGECOUNT value on done: 454534.0 [2024-08-06 03:54:14,818][52665] Sum rewards: 69.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.742', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.144', 'AMMO3': '0.193', 'AMMO4': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:15,126][52662] DAMAGECOUNT value on done: 460417.0 [2024-08-06 03:54:15,127][52662] Sum rewards: 66.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.296', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:15,157][52658] DAMAGECOUNT value on done: 455682.0 [2024-08-06 03:54:15,157][52658] Sum rewards: 86.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.599', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.076', 'AMMO4': '0.183', 'AMMO3': '0.193', 'weapon5': '0.196', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '69.000'} [2024-08-06 03:54:15,886][52668] DAMAGECOUNT value on done: 459108.0 [2024-08-06 03:54:15,888][52668] Sum rewards: 75.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.210', 'weapon2': '0.254', 'WEAPON3': '1.250', 'HITCOUNT': '3.480', 'weapon3': '3.512', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '62.000'} [2024-08-06 03:54:16,061][52669] DAMAGECOUNT value on done: 466610.0 [2024-08-06 03:54:16,062][52669] Sum rewards: 76.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.244', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:16,109][52660] DAMAGECOUNT value on done: 456013.0 [2024-08-06 03:54:16,110][52660] Sum rewards: 70.106, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.155', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '55.500'} [2024-08-06 03:54:17,045][52659] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:54:17,140][52820] DAMAGECOUNT value on done: 426920.0 [2024-08-06 03:54:17,140][52820] Sum rewards: 67.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO5': '0.019', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.167', 'weapon5': '0.220', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.686', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '56.000'} [2024-08-06 03:54:17,424][52650] Updated weights for policy 0, policy_version 49351 (0.0029) [2024-08-06 03:54:17,461][52671] DAMAGECOUNT value on done: 469038.0 [2024-08-06 03:54:17,463][52671] Sum rewards: 54.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.149', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.310', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.334', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '47.000'} [2024-08-06 03:54:17,747][52665] DAMAGECOUNT value on done: 445972.0 [2024-08-06 03:54:17,748][52665] Sum rewards: 71.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.069', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '3.202', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '57.000'} [2024-08-06 03:54:17,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 404291584. Throughput: 0: 4378.9. Samples: 101071570. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 03:54:17,794][52567] Avg episode reward: [(0, '70.606')] [2024-08-06 03:54:17,976][52658] DAMAGECOUNT value on done: 469767.0 [2024-08-06 03:54:17,977][52658] Sum rewards: 53.940, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.060', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.170', 'AMMO4': '0.181', 'AMMO3': '0.284', 'weapon2': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.914', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '49.500'} [2024-08-06 03:54:18,168][52662] DAMAGECOUNT value on done: 468239.0 [2024-08-06 03:54:18,169][52662] Sum rewards: 81.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.082', 'weapon4': '0.100', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '68.000'} [2024-08-06 03:54:18,422][52668] DAMAGECOUNT value on done: 465463.0 [2024-08-06 03:54:18,422][52668] Sum rewards: 64.157, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.894', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO4': '0.239', 'weapon5': '0.240', 'AMMO3': '0.272', 'weapon2': '0.312', 'weapon4': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.742', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:18,606][52660] DAMAGECOUNT value on done: 467258.0 [2024-08-06 03:54:18,607][52660] Sum rewards: 52.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.108', 'weapon5': '0.164', 'AMMO4': '0.225', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.132', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '47.000'} [2024-08-06 03:54:20,315][52666] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.297, -99.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 03:54:20,408][52820] DAMAGECOUNT value on done: 431625.0 [2024-08-06 03:54:20,408][52820] Sum rewards: 69.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.308', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.174', 'AMMO3': '0.225', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:20,546][52671] DAMAGECOUNT value on done: 462250.0 [2024-08-06 03:54:20,546][52671] Sum rewards: 91.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.781', 'AMMO5': '0.005', 'weapon4': '0.044', 'AMMO2': '0.045', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.227', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.416', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.541', 'FRAGCOUNT': '76.000'} [2024-08-06 03:54:20,758][52658] DAMAGECOUNT value on done: 460118.0 [2024-08-06 03:54:20,762][52658] Sum rewards: 75.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.106', 'weapon5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.206', 'weapon2': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:20,843][52665] DAMAGECOUNT value on done: 448819.0 [2024-08-06 03:54:20,843][52665] Sum rewards: 71.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.528', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.098', 'AMMO3': '0.203', 'weapon4': '0.248', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:21,080][52668] DAMAGECOUNT value on done: 458156.0 [2024-08-06 03:54:21,080][52668] Sum rewards: 78.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.252', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '64.000'} [2024-08-06 03:54:21,120][52662] DAMAGECOUNT value on done: 460501.0 [2024-08-06 03:54:21,120][52662] Sum rewards: 62.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.478', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon2': '0.174', 'weapon5': '0.212', 'AMMO4': '0.237', 'AMMO3': '0.255', 'WEAPON5': '0.400', 'weapon4': '0.438', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.894', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '53.000'} [2024-08-06 03:54:21,192][52660] DAMAGECOUNT value on done: 453005.0 [2024-08-06 03:54:21,192][52660] Sum rewards: 87.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.128', 'AMMO3': '0.157', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '70.500'} [2024-08-06 03:54:22,086][52650] Updated weights for policy 0, policy_version 49361 (0.0020) [2024-08-06 03:54:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 404373504. Throughput: 0: 4375.3. Samples: 101097870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:54:22,794][52567] Avg episode reward: [(0, '70.420')] [2024-08-06 03:54:23,391][52820] DAMAGECOUNT value on done: 426665.0 [2024-08-06 03:54:23,395][52820] Sum rewards: 78.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.047', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '65.000'} [2024-08-06 03:54:23,621][52658] DAMAGECOUNT value on done: 471274.0 [2024-08-06 03:54:23,621][52658] Sum rewards: 63.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.070', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:23,738][52665] DAMAGECOUNT value on done: 453338.0 [2024-08-06 03:54:23,742][52665] Sum rewards: 75.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.630', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.160', 'AMMO3': '0.174', 'AMMO4': '0.235', 'weapon2': '0.278', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '62.000'} [2024-08-06 03:54:23,770][52671] DAMAGECOUNT value on done: 452573.0 [2024-08-06 03:54:23,772][52671] Sum rewards: 61.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.919', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.132', 'weapon5': '0.148', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.128', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:23,887][52660] DAMAGECOUNT value on done: 458212.0 [2024-08-06 03:54:23,889][52660] Sum rewards: 64.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.060', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.214', 'AMMO4': '0.227', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:24,014][52662] DAMAGECOUNT value on done: 471476.0 [2024-08-06 03:54:24,018][52662] Sum rewards: 67.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.110', 'AMMO3': '0.201', 'AMMO4': '0.254', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.716', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:26,611][52820] DAMAGECOUNT value on done: 431868.0 [2024-08-06 03:54:26,611][52820] Sum rewards: 71.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.190', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.142', 'weapon4': '0.152', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.000', 'weapon3': '3.160', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '56.000'} [2024-08-06 03:54:26,764][52658] DAMAGECOUNT value on done: 452401.0 [2024-08-06 03:54:26,764][52658] Sum rewards: 70.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.576', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '59.500'} [2024-08-06 03:54:26,769][52671] DAMAGECOUNT value on done: 470260.0 [2024-08-06 03:54:26,771][52671] Sum rewards: 71.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.243', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.098', 'AMMO4': '0.105', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.236', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '57.000'} [2024-08-06 03:54:26,889][52650] Updated weights for policy 0, policy_version 49371 (0.0018) [2024-08-06 03:54:26,917][52665] DAMAGECOUNT value on done: 455615.0 [2024-08-06 03:54:26,918][52665] Sum rewards: 72.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.066', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO4': '0.177', 'AMMO3': '0.230', 'weapon2': '0.266', 'weapon5': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '60.000'} [2024-08-06 03:54:27,009][52660] DAMAGECOUNT value on done: 469005.0 [2024-08-06 03:54:27,010][52660] Sum rewards: 78.039, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.719', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.098', 'weapon5': '0.150', 'AMMO3': '0.226', 'AMMO4': '0.267', 'weapon2': '0.352', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '66.000'} [2024-08-06 03:54:27,484][52662] DAMAGECOUNT value on done: 466823.0 [2024-08-06 03:54:27,492][52662] Sum rewards: 71.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.974', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.202', 'AMMO4': '0.216', 'AMMO3': '0.232', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '60.000'} [2024-08-06 03:54:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 404455424. Throughput: 0: 4365.1. Samples: 101123630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:54:27,794][52567] Avg episode reward: [(0, '70.565')] [2024-08-06 03:54:27,808][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049373_404463616.pth... [2024-08-06 03:54:27,938][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000048861_400269312.pth [2024-08-06 03:54:28,875][52614] Signal inference workers to stop experience collection... (8950 times) [2024-08-06 03:54:28,876][52614] Signal inference workers to resume experience collection... (8950 times) [2024-08-06 03:54:28,968][52650] InferenceWorker_p0-w0: stopping experience collection (8950 times) [2024-08-06 03:54:28,975][52650] InferenceWorker_p0-w0: resuming experience collection (8950 times) [2024-08-06 03:54:29,254][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:54:29,361][52658] DAMAGECOUNT value on done: 461914.0 [2024-08-06 03:54:29,361][52658] Sum rewards: 71.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.960', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.094', 'weapon4': '0.122', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.550', 'weapon3': '3.180', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '61.000'} [2024-08-06 03:54:29,826][52820] DAMAGECOUNT value on done: 424928.0 [2024-08-06 03:54:29,828][52820] Sum rewards: 63.612, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon4': '0.234', 'weapon2': '0.516', 'WEAPON3': '0.950', 'weapon3': '3.016', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '49.000'} [2024-08-06 03:54:29,929][52665] DAMAGECOUNT value on done: 461886.0 [2024-08-06 03:54:29,930][52665] Sum rewards: 73.897, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:30,030][52671] DAMAGECOUNT value on done: 466882.0 [2024-08-06 03:54:30,030][52671] Sum rewards: 84.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.077', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.438', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '71.000'} [2024-08-06 03:54:30,061][52660] DAMAGECOUNT value on done: 474724.0 [2024-08-06 03:54:30,061][52660] Sum rewards: 64.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.876', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.234', 'AMMO4': '0.265', 'weapon2': '0.316', 'weapon5': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.376', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '54.000'} [2024-08-06 03:54:30,671][52662] DAMAGECOUNT value on done: 459119.0 [2024-08-06 03:54:30,673][52662] Sum rewards: 64.674, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.220', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.092', 'weapon4': '0.098', 'AMMO3': '0.151', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.188', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '52.000'} [2024-08-06 03:54:31,590][52650] Updated weights for policy 0, policy_version 49381 (0.0023) [2024-08-06 03:54:32,145][52658] DAMAGECOUNT value on done: 457897.0 [2024-08-06 03:54:32,146][52658] Sum rewards: 83.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '67.000'} [2024-08-06 03:54:32,251][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:54:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 404545536. Throughput: 0: 4358.2. Samples: 101136420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:54:32,794][52567] Avg episode reward: [(0, '70.584')] [2024-08-06 03:54:32,940][52820] DAMAGECOUNT value on done: 427345.0 [2024-08-06 03:54:32,941][52820] Sum rewards: 84.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.153', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '3.186', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '67.000'} [2024-08-06 03:54:32,944][52660] DAMAGECOUNT value on done: 456442.0 [2024-08-06 03:54:32,944][52660] Sum rewards: 68.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.868', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.214', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '57.000'} [2024-08-06 03:54:33,188][52671] DAMAGECOUNT value on done: 469202.0 [2024-08-06 03:54:33,188][52671] Sum rewards: 81.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.976', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.161', 'weapon4': '0.174', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.950', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '71.000'} [2024-08-06 03:54:33,196][52665] DAMAGECOUNT value on done: 455352.0 [2024-08-06 03:54:33,198][52665] Sum rewards: 67.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.798', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.104', 'weapon5': '0.128', 'AMMO4': '0.166', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.276', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '59.000'} [2024-08-06 03:54:33,633][52662] DAMAGECOUNT value on done: 460147.0 [2024-08-06 03:54:33,633][52662] Sum rewards: 75.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.195', 'weapon4': '0.196', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '62.000'} [2024-08-06 03:54:33,749][52794] DAMAGECOUNT value on done: 463513.0 [2024-08-06 03:54:33,749][52794] Sum rewards: 70.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.220', 'weapon2': '0.378', 'WEAPON3': '0.950', 'weapon3': '3.120', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '56.000'} [2024-08-06 03:54:34,884][52658] DAMAGECOUNT value on done: 458140.0 [2024-08-06 03:54:34,885][52658] Sum rewards: 74.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.062', 'AMMO4': '0.197', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '61.000'} [2024-08-06 03:54:35,688][52665] DAMAGECOUNT value on done: 463946.0 [2024-08-06 03:54:35,689][52665] Sum rewards: 80.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.240', 'weapon2': '0.646', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '66.000'} [2024-08-06 03:54:36,008][52660] DAMAGECOUNT value on done: 463921.0 [2024-08-06 03:54:36,012][52660] Sum rewards: 78.938, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.150', 'weapon2': '0.170', 'AMMO3': '0.296', 'WEAPON3': '1.800', 'weapon3': '3.408', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.787', 'FRAGCOUNT': '67.000'} [2024-08-06 03:54:36,210][52650] Updated weights for policy 0, policy_version 49391 (0.0039) [2024-08-06 03:54:36,263][52820] DAMAGECOUNT value on done: 438650.0 [2024-08-06 03:54:36,264][52820] Sum rewards: 71.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.764', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.318', 'weapon4': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '59.000'} [2024-08-06 03:54:36,290][52671] DAMAGECOUNT value on done: 465003.0 [2024-08-06 03:54:36,290][52671] Sum rewards: 58.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.324', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.116', 'AMMO4': '0.220', 'AMMO3': '0.255', 'weapon2': '0.304', 'weapon5': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.860', 'weapon3': '2.894', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '51.000'} [2024-08-06 03:54:36,913][52662] DAMAGECOUNT value on done: 456488.0 [2024-08-06 03:54:36,914][52662] Sum rewards: 68.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.905', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.145', 'weapon5': '0.168', 'weapon2': '0.222', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.220', 'weapon3': '3.288', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '60.000'} [2024-08-06 03:54:37,027][52794] DAMAGECOUNT value on done: 466440.0 [2024-08-06 03:54:37,028][52794] Sum rewards: 70.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.132', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.164', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '60.000'} [2024-08-06 03:54:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 404635648. Throughput: 0: 4358.0. Samples: 101162820. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:54:37,794][52567] Avg episode reward: [(0, '71.048')] [2024-08-06 03:54:37,862][52658] DAMAGECOUNT value on done: 454090.0 [2024-08-06 03:54:37,863][52658] Sum rewards: 65.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.257', 'AMMO5': '0.020', 'AMMO2': '0.063', 'AMMO3': '0.216', 'weapon2': '0.220', 'weapon5': '0.298', 'AMMO4': '0.314', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.718', 'WEAPON3': '1.300', 'weapon3': '2.384', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '54.000'} [2024-08-06 03:54:38,900][52671] DAMAGECOUNT value on done: 460645.0 [2024-08-06 03:54:38,904][52671] Sum rewards: 48.834, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.748', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.168', 'AMMO4': '0.172', 'weapon5': '0.204', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.540', 'weapon3': '3.020', 'DAMAGECOUNT': '12.624', 'FRAGCOUNT': '45.000'} [2024-08-06 03:54:38,938][52665] DAMAGECOUNT value on done: 458495.0 [2024-08-06 03:54:38,939][52665] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.281', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.122', 'weapon5': '0.204', 'AMMO4': '0.216', 'AMMO3': '0.219', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.032', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '64.000'} [2024-08-06 03:54:39,103][52660] DAMAGECOUNT value on done: 457194.0 [2024-08-06 03:54:39,104][52660] Sum rewards: 62.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.102', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.154', 'AMMO3': '0.237', 'weapon5': '0.240', 'AMMO4': '0.251', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '2.952', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '53.000'} [2024-08-06 03:54:39,369][52820] DAMAGECOUNT value on done: 437810.0 [2024-08-06 03:54:39,371][52820] Sum rewards: 74.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.722', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.102', 'AMMO4': '0.173', 'AMMO3': '0.178', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '61.000'} [2024-08-06 03:54:39,933][52794] DAMAGECOUNT value on done: 465272.0 [2024-08-06 03:54:39,933][52794] Sum rewards: 68.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.361', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.188', 'weapon4': '0.200', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '2.882', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '59.000'} [2024-08-06 03:54:40,947][52650] Updated weights for policy 0, policy_version 49401 (0.0014) [2024-08-06 03:54:40,956][52658] DAMAGECOUNT value on done: 468445.0 [2024-08-06 03:54:40,959][52658] Sum rewards: 70.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.078', 'AMMO4': '0.187', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.466', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.704', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:41,760][52665] DAMAGECOUNT value on done: 455655.0 [2024-08-06 03:54:41,760][52665] Sum rewards: 69.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.138', 'weapon2': '0.228', 'AMMO3': '0.245', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 03:54:41,997][52660] DAMAGECOUNT value on done: 458665.0 [2024-08-06 03:54:42,001][52660] Sum rewards: 67.627, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.625', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.148', 'weapon4': '0.380', 'weapon2': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.862', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '53.000'} [2024-08-06 03:54:42,375][52820] DAMAGECOUNT value on done: 424222.0 [2024-08-06 03:54:42,378][52820] Sum rewards: 64.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.216', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.314', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '54.000'} [2024-08-06 03:54:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 404717568. Throughput: 0: 4362.2. Samples: 101188960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:54:42,795][52567] Avg episode reward: [(0, '70.480')] [2024-08-06 03:54:43,095][52794] DAMAGECOUNT value on done: 458139.0 [2024-08-06 03:54:43,102][52794] Sum rewards: 73.925, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.264', 'weapon2': '0.490', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:43,729][52658] DAMAGECOUNT value on done: 460263.0 [2024-08-06 03:54:43,731][52658] Sum rewards: 79.914, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.014', 'HEALTH': '0.030', 'AMMO2': '0.040', 'weapon4': '0.152', 'AMMO3': '0.189', 'AMMO4': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '64.000'} [2024-08-06 03:54:44,420][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:54:44,683][52665] DAMAGECOUNT value on done: 454035.0 [2024-08-06 03:54:44,684][52665] Sum rewards: 64.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.065', 'AMMO5': '0.016', 'AMMO2': '0.069', 'AMMO3': '0.183', 'weapon5': '0.240', 'AMMO4': '0.342', 'weapon2': '0.352', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '54.500'} [2024-08-06 03:54:45,260][52660] DAMAGECOUNT value on done: 453996.0 [2024-08-06 03:54:45,262][52660] Sum rewards: 64.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.233', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon5': '0.186', 'AMMO3': '0.205', 'AMMO4': '0.207', 'weapon4': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '55.000'} [2024-08-06 03:54:45,870][52650] Updated weights for policy 0, policy_version 49411 (0.0020) [2024-08-06 03:54:46,016][52794] DAMAGECOUNT value on done: 459087.0 [2024-08-06 03:54:46,026][52794] Sum rewards: 72.561, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.110', 'weapon4': '0.114', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.292', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:46,475][52658] DAMAGECOUNT value on done: 462261.0 [2024-08-06 03:54:46,475][52658] Sum rewards: 69.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.148', 'weapon4': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.500'} [2024-08-06 03:54:47,637][52665] DAMAGECOUNT value on done: 457574.0 [2024-08-06 03:54:47,637][52665] Sum rewards: 61.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.086', 'AMMO4': '0.144', 'weapon5': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '50.000'} [2024-08-06 03:54:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 404815872. Throughput: 0: 4362.7. Samples: 101202210. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:54:47,794][52567] Avg episode reward: [(0, '70.548')] [2024-08-06 03:54:48,485][52794] DAMAGECOUNT value on done: 464113.0 [2024-08-06 03:54:48,485][52794] Sum rewards: 82.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.054', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '67.000'} [2024-08-06 03:54:49,679][52658] DAMAGECOUNT value on done: 465519.0 [2024-08-06 03:54:49,679][52658] Sum rewards: 69.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'weapon4': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:50,338][52650] Updated weights for policy 0, policy_version 49421 (0.0018) [2024-08-06 03:54:50,407][52665] DAMAGECOUNT value on done: 452482.0 [2024-08-06 03:54:50,407][52665] Sum rewards: 66.336, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.686', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon2': '0.226', 'weapon5': '0.242', 'AMMO3': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '58.000'} [2024-08-06 03:54:51,173][52659] DAMAGECOUNT value on done: 462651.0 [2024-08-06 03:54:51,183][52659] Sum rewards: 75.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.701', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.136', 'weapon4': '0.164', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '63.000'} [2024-08-06 03:54:51,485][52794] DAMAGECOUNT value on done: 467994.0 [2024-08-06 03:54:51,486][52794] Sum rewards: 67.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.975', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.088', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.500'} [2024-08-06 03:54:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 404897792. Throughput: 0: 4366.1. Samples: 101228660. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 03:54:52,795][52567] Avg episode reward: [(0, '70.775')] [2024-08-06 03:54:53,130][52665] DAMAGECOUNT value on done: 451943.0 [2024-08-06 03:54:53,130][52665] Sum rewards: 83.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.271', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.224', 'WEAPON3': '1.450', 'HITCOUNT': '3.600', 'weapon3': '3.602', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '70.000'} [2024-08-06 03:54:53,780][52659] DAMAGECOUNT value on done: 461575.0 [2024-08-06 03:54:53,780][52659] Sum rewards: 56.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.091', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.272', 'AMMO3': '0.293', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.050', 'weapon3': '3.238', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '51.000'} [2024-08-06 03:54:54,769][52794] DAMAGECOUNT value on done: 457377.0 [2024-08-06 03:54:54,769][52794] Sum rewards: 50.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.624', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.130', 'weapon4': '0.156', 'weapon2': '0.176', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.580', 'weapon3': '3.284', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '42.000'} [2024-08-06 03:54:55,255][52650] Updated weights for policy 0, policy_version 49431 (0.0011) [2024-08-06 03:54:56,213][52665] DAMAGECOUNT value on done: 452594.0 [2024-08-06 03:54:56,213][52665] Sum rewards: 70.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.155', 'weapon2': '0.162', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.234', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2024-08-06 03:54:56,678][52659] DAMAGECOUNT value on done: 465894.0 [2024-08-06 03:54:56,680][52659] Sum rewards: 71.904, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.981', 'AMMO5': '0.023', 'AMMO2': '0.046', 'weapon4': '0.100', 'weapon5': '0.212', 'AMMO4': '0.232', 'AMMO3': '0.236', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '60.500'} [2024-08-06 03:54:57,602][52794] DAMAGECOUNT value on done: 465928.0 [2024-08-06 03:54:57,604][52794] Sum rewards: 62.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.336', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.091', 'weapon5': '0.136', 'AMMO3': '0.188', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.364', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '51.000'} [2024-08-06 03:54:57,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 404979712. Throughput: 0: 4368.4. Samples: 101254980. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 03:54:57,794][52567] Avg episode reward: [(0, '70.428')] [2024-08-06 03:54:59,257][52659] DAMAGECOUNT value on done: 461607.0 [2024-08-06 03:54:59,257][52659] Sum rewards: 81.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.752', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.244', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '68.000'} [2024-08-06 03:54:59,319][52650] Updated weights for policy 0, policy_version 49441 (0.0012) [2024-08-06 03:54:59,380][52665] DAMAGECOUNT value on done: 452306.0 [2024-08-06 03:54:59,381][52665] Sum rewards: 66.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.209', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.118', 'weapon4': '0.138', 'AMMO4': '0.140', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '53.000'} [2024-08-06 03:55:00,740][52794] DAMAGECOUNT value on done: 462346.0 [2024-08-06 03:55:00,742][52794] Sum rewards: 75.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.943', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.144', 'weapon5': '0.240', 'weapon4': '0.270', 'AMMO4': '0.277', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.834', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:02,071][52659] DAMAGECOUNT value on done: 458606.0 [2024-08-06 03:55:02,074][52659] Sum rewards: 74.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.179', 'weapon5': '0.188', 'AMMO4': '0.249', 'weapon4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:02,182][52649] DAMAGECOUNT value on done: 445243.0 [2024-08-06 03:55:02,182][52649] Sum rewards: 77.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.106', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:02,408][52665] DAMAGECOUNT value on done: 457413.0 [2024-08-06 03:55:02,409][52665] Sum rewards: 79.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.402', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.120', 'weapon5': '0.126', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 405078016. Throughput: 0: 4371.1. Samples: 101268270. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 03:55:02,794][52567] Avg episode reward: [(0, '70.730')] [2024-08-06 03:55:03,595][52794] DAMAGECOUNT value on done: 457763.0 [2024-08-06 03:55:03,596][52794] Sum rewards: 75.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.866', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.084', 'AMMO3': '0.238', 'weapon2': '0.266', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:03,976][52664] DAMAGECOUNT value on done: 479779.0 [2024-08-06 03:55:03,977][52664] Sum rewards: 79.180, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.088', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.122', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:04,394][52650] Updated weights for policy 0, policy_version 49451 (0.0010) [2024-08-06 03:55:04,473][52647] DAMAGECOUNT value on done: 486154.0 [2024-08-06 03:55:04,473][52647] Sum rewards: 67.750, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.470', 'AMMO5': '0.020', 'AMMO2': '0.030', 'weapon4': '0.138', 'AMMO4': '0.149', 'weapon2': '0.176', 'weapon5': '0.184', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:05,275][52649] DAMAGECOUNT value on done: 439947.0 [2024-08-06 03:55:05,275][52649] Sum rewards: 66.174, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.245', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.158', 'weapon5': '0.160', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.000', 'HITCOUNT': '3.080', 'weapon3': '3.140', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '53.000'} [2024-08-06 03:55:05,325][52659] DAMAGECOUNT value on done: 464148.0 [2024-08-06 03:55:05,326][52659] Sum rewards: 68.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.018', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.274', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.444', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:06,506][52664] DAMAGECOUNT value on done: 485311.0 [2024-08-06 03:55:06,508][52664] Sum rewards: 78.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.044', 'weapon4': '0.102', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.650', 'weapon3': '3.416', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '66.000'} [2024-08-06 03:55:06,535][52794] DAMAGECOUNT value on done: 466808.0 [2024-08-06 03:55:06,537][52794] Sum rewards: 84.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.288', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.126', 'AMMO4': '0.245', 'AMMO3': '0.263', 'weapon2': '0.320', 'weapon5': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.804', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '22.023', 'FRAGCOUNT': '69.000'} [2024-08-06 03:55:06,798][52647] DAMAGECOUNT value on done: 487705.0 [2024-08-06 03:55:06,798][52647] Sum rewards: 76.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.152', 'weapon2': '0.158', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:07,534][52795] Large shaping reward 3.261 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.21, 70.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:55:07,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17613.0, 300 sec: 17522.5). Total num frames: 405168128. Throughput: 0: 4368.2. Samples: 101294440. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 03:55:07,794][52567] Avg episode reward: [(0, '71.260')] [2024-08-06 03:55:08,006][52795] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:55:08,089][52659] DAMAGECOUNT value on done: 461508.0 [2024-08-06 03:55:08,089][52659] Sum rewards: 75.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.532', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.184', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:08,377][52649] DAMAGECOUNT value on done: 454311.0 [2024-08-06 03:55:08,377][52649] Sum rewards: 62.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.589', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.066', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.774', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '53.000'} [2024-08-06 03:55:09,035][52650] Updated weights for policy 0, policy_version 49461 (0.0048) [2024-08-06 03:55:09,180][52794] DAMAGECOUNT value on done: 454351.0 [2024-08-06 03:55:09,180][52794] Sum rewards: 80.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.076', 'weapon5': '0.126', 'AMMO4': '0.147', 'weapon2': '0.190', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '66.000'} [2024-08-06 03:55:09,662][52664] DAMAGECOUNT value on done: 485025.0 [2024-08-06 03:55:09,663][52664] Sum rewards: 78.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.052', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:10,109][52647] DAMAGECOUNT value on done: 484655.0 [2024-08-06 03:55:10,110][52647] Sum rewards: 68.093, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.145', 'weapon4': '0.180', 'weapon5': '0.250', 'AMMO4': '0.259', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON3': '0.950', 'weapon3': '2.862', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '55.500'} [2024-08-06 03:55:10,680][52659] DAMAGECOUNT value on done: 461250.0 [2024-08-06 03:55:10,680][52659] Sum rewards: 61.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.115', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.304', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '51.000'} [2024-08-06 03:55:11,001][52649] DAMAGECOUNT value on done: 447236.0 [2024-08-06 03:55:11,004][52649] Sum rewards: 76.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.860', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.148', 'weapon5': '0.212', 'AMMO4': '0.241', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '2.930', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:12,161][52794] DAMAGECOUNT value on done: 475012.0 [2024-08-06 03:55:12,162][52794] Sum rewards: 78.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '66.000'} [2024-08-06 03:55:12,286][52795] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:55:12,315][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:55:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 405241856. Throughput: 0: 4377.6. Samples: 101320620. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 03:55:12,796][52567] Avg episode reward: [(0, '71.452')] [2024-08-06 03:55:12,793][52664] DAMAGECOUNT value on done: 476525.0 [2024-08-06 03:55:12,797][52664] Sum rewards: 67.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.110', 'weapon5': '0.162', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:13,167][52649] DAMAGECOUNT value on done: 440512.0 [2024-08-06 03:55:13,167][52649] Sum rewards: 60.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.842', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.142', 'AMMO3': '0.183', 'AMMO4': '0.189', 'weapon5': '0.194', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.100', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '50.000'} [2024-08-06 03:55:13,216][52647] DAMAGECOUNT value on done: 494345.0 [2024-08-06 03:55:13,217][52647] Sum rewards: 73.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.044', 'weapon4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.656', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:13,473][52650] Updated weights for policy 0, policy_version 49471 (0.0013) [2024-08-06 03:55:13,740][52659] DAMAGECOUNT value on done: 468479.0 [2024-08-06 03:55:13,740][52659] Sum rewards: 56.895, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.810', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.138', 'AMMO3': '0.205', 'AMMO4': '0.253', 'weapon2': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '2.978', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '50.000'} [2024-08-06 03:55:14,506][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:55:15,300][52664] DAMAGECOUNT value on done: 483052.0 [2024-08-06 03:55:15,302][52664] Sum rewards: 73.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:15,317][52794] DAMAGECOUNT value on done: 456884.0 [2024-08-06 03:55:15,318][52794] Sum rewards: 76.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.589', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.163', 'AMMO4': '0.188', 'weapon2': '0.196', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '62.500'} [2024-08-06 03:55:15,515][52647] DAMAGECOUNT value on done: 491099.0 [2024-08-06 03:55:15,515][52647] Sum rewards: 66.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.948', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.201', 'weapon5': '0.220', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '58.000'} [2024-08-06 03:55:16,192][52649] DAMAGECOUNT value on done: 452169.0 [2024-08-06 03:55:16,193][52649] Sum rewards: 64.781, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.140', 'AMMO3': '0.153', 'AMMO4': '0.181', 'weapon2': '0.326', 'weapon5': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.820', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '52.000'} [2024-08-06 03:55:16,556][52659] DAMAGECOUNT value on done: 472404.0 [2024-08-06 03:55:16,558][52659] Sum rewards: 65.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.094', 'AMMO4': '0.191', 'weapon5': '0.196', 'AMMO3': '0.254', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.990', 'weapon3': '3.116', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '58.000'} [2024-08-06 03:55:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 405340160. Throughput: 0: 4385.8. Samples: 101333780. Policy #0 lag: (min: 0.0, avg: 2.7, max: 7.0) [2024-08-06 03:55:17,794][52567] Avg episode reward: [(0, '71.130')] [2024-08-06 03:55:17,964][52664] DAMAGECOUNT value on done: 479451.0 [2024-08-06 03:55:17,965][52664] Sum rewards: 72.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.190', 'AMMO4': '0.191', 'weapon4': '0.214', 'AMMO3': '0.230', 'weapon5': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:18,111][52794] DAMAGECOUNT value on done: 472997.0 [2024-08-06 03:55:18,111][52794] Sum rewards: 79.668, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.072', 'weapon4': '0.126', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.272', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:18,252][52647] DAMAGECOUNT value on done: 489915.0 [2024-08-06 03:55:18,253][52647] Sum rewards: 68.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.048', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:18,429][52650] Updated weights for policy 0, policy_version 49481 (0.0015) [2024-08-06 03:55:19,157][52649] DAMAGECOUNT value on done: 448344.0 [2024-08-06 03:55:19,159][52649] Sum rewards: 74.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.096', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.104', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.261', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.138', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:19,459][52659] DAMAGECOUNT value on done: 461298.0 [2024-08-06 03:55:19,462][52659] Sum rewards: 76.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.926', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.126', 'weapon5': '0.142', 'AMMO3': '0.162', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:20,140][52811] DAMAGECOUNT value on done: 444524.0 [2024-08-06 03:55:20,142][52811] Sum rewards: 81.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.125', 'weapon5': '0.132', 'weapon2': '0.210', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '67.000'} [2024-08-06 03:55:20,788][52664] DAMAGECOUNT value on done: 478012.0 [2024-08-06 03:55:20,788][52664] Sum rewards: 64.557, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.108', 'weapon5': '0.176', 'AMMO3': '0.193', 'AMMO4': '0.253', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '53.000'} [2024-08-06 03:55:20,791][52794] DAMAGECOUNT value on done: 463478.0 [2024-08-06 03:55:20,793][52794] Sum rewards: 69.581, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.878', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.090', 'AMMO4': '0.195', 'weapon5': '0.204', 'weapon2': '0.240', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.168', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:21,068][52647] DAMAGECOUNT value on done: 488936.0 [2024-08-06 03:55:21,068][52647] Sum rewards: 81.023, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.092', 'weapon4': '0.094', 'AMMO4': '0.127', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.312', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '69.000'} [2024-08-06 03:55:22,161][52659] DAMAGECOUNT value on done: 465695.0 [2024-08-06 03:55:22,162][52659] Sum rewards: 81.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.104', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.204', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '67.000'} [2024-08-06 03:55:22,555][52649] DAMAGECOUNT value on done: 453390.0 [2024-08-06 03:55:22,556][52649] Sum rewards: 76.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.002', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO3': '0.175', 'weapon5': '0.184', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.852', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 405422080. Throughput: 0: 4384.4. Samples: 101360120. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:55:22,794][52567] Avg episode reward: [(0, '71.452')] [2024-08-06 03:55:22,868][52650] Updated weights for policy 0, policy_version 49491 (0.0022) [2024-08-06 03:55:23,095][52794] DAMAGECOUNT value on done: 466885.0 [2024-08-06 03:55:23,096][52794] Sum rewards: 92.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.182', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.161', 'AMMO3': '0.185', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '75.000'} [2024-08-06 03:55:23,451][52811] DAMAGECOUNT value on done: 425336.0 [2024-08-06 03:55:23,453][52811] Sum rewards: 64.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.848', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.052', 'weapon5': '0.178', 'AMMO4': '0.188', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:23,556][52664] DAMAGECOUNT value on done: 474058.0 [2024-08-06 03:55:23,558][52664] Sum rewards: 74.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.021', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.168', 'AMMO3': '0.226', 'AMMO4': '0.272', 'weapon2': '0.324', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:23,697][52647] DAMAGECOUNT value on done: 481882.0 [2024-08-06 03:55:23,697][52647] Sum rewards: 74.487, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.164', 'AMMO4': '0.179', 'AMMO3': '0.186', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HEALTH': '0.482', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.250', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '60.000'} [2024-08-06 03:55:25,234][52659] DAMAGECOUNT value on done: 455878.0 [2024-08-06 03:55:25,236][52659] Sum rewards: 72.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.672', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'weapon4': '0.020', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.378', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '60.000'} [2024-08-06 03:55:25,693][52649] DAMAGECOUNT value on done: 452585.0 [2024-08-06 03:55:25,694][52649] Sum rewards: 69.274, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.722', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.260', 'weapon2': '0.618', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:26,161][52664] DAMAGECOUNT value on done: 484647.0 [2024-08-06 03:55:26,162][52664] Sum rewards: 73.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.570', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO4': '0.196', 'weapon5': '0.226', 'AMMO3': '0.271', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:26,222][52794] DAMAGECOUNT value on done: 469366.0 [2024-08-06 03:55:26,222][52794] Sum rewards: 69.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.170', 'AMMO3': '0.207', 'AMMO4': '0.219', 'weapon5': '0.226', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '58.000'} [2024-08-06 03:55:26,352][52647] DAMAGECOUNT value on done: 492437.0 [2024-08-06 03:55:26,353][52647] Sum rewards: 56.412, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.244', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.106', 'weapon5': '0.210', 'AMMO4': '0.248', 'AMMO3': '0.257', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.930', 'weapon3': '3.058', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '50.500'} [2024-08-06 03:55:26,459][52811] DAMAGECOUNT value on done: 426614.0 [2024-08-06 03:55:26,461][52811] Sum rewards: 64.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.942', 'AMMO5': '0.029', 'AMMO2': '0.064', 'AMMO3': '0.214', 'AMMO4': '0.318', 'weapon4': '0.332', 'weapon2': '0.356', 'weapon5': '0.390', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.536', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:26,658][52663] DAMAGECOUNT value on done: 468569.0 [2024-08-06 03:55:26,658][52663] Sum rewards: 78.038, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.304', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.242', 'weapon2': '0.320', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:27,368][52650] Updated weights for policy 0, policy_version 49501 (0.0011) [2024-08-06 03:55:27,426][52666] DAMAGECOUNT value on done: 457544.0 [2024-08-06 03:55:27,427][52666] Sum rewards: 55.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.827', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.081', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.404', 'WEAPON3': '1.250', 'HITCOUNT': '2.480', 'weapon3': '3.162', 'DAMAGECOUNT': '13.056', 'FRAGCOUNT': '47.000'} [2024-08-06 03:55:27,524][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:55:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 405512192. Throughput: 0: 4383.6. Samples: 101386220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:55:27,794][52567] Avg episode reward: [(0, '71.486')] [2024-08-06 03:55:28,010][52659] DAMAGECOUNT value on done: 463871.0 [2024-08-06 03:55:28,010][52659] Sum rewards: 64.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.114', 'weapon4': '0.164', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.030', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2024-08-06 03:55:28,889][52649] DAMAGECOUNT value on done: 447299.0 [2024-08-06 03:55:28,889][52649] Sum rewards: 69.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.188', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.049', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 03:55:29,044][52663] DAMAGECOUNT value on done: 462171.0 [2024-08-06 03:55:29,044][52663] Sum rewards: 65.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.174', 'weapon4': '0.206', 'AMMO4': '0.225', 'AMMO3': '0.268', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.988', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:29,160][52664] DAMAGECOUNT value on done: 477738.0 [2024-08-06 03:55:29,160][52664] Sum rewards: 65.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.875', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.204', 'weapon2': '0.214', 'weapon5': '0.218', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.050', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:29,426][52647] DAMAGECOUNT value on done: 484298.0 [2024-08-06 03:55:29,426][52647] Sum rewards: 77.606, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.135', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.162', 'AMMO3': '0.302', 'WEAPON3': '1.800', 'weapon3': '3.626', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '69.000'} [2024-08-06 03:55:29,524][52794] DAMAGECOUNT value on done: 461970.0 [2024-08-06 03:55:29,525][52794] Sum rewards: 76.907, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'HEALTH': '0.040', 'weapon4': '0.058', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:29,543][52670] DAMAGECOUNT value on done: 451561.0 [2024-08-06 03:55:29,544][52670] Sum rewards: 63.006, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.140', 'weapon4': '0.180', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.216', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:29,592][52811] DAMAGECOUNT value on done: 428959.0 [2024-08-06 03:55:29,593][52811] Sum rewards: 64.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.132', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:29,694][52803] DAMAGECOUNT value on done: 431670.0 [2024-08-06 03:55:29,694][52803] Sum rewards: 78.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.807', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.197', 'weapon5': '0.218', 'AMMO4': '0.235', 'weapon2': '0.278', 'weapon4': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:29,901][52666] DAMAGECOUNT value on done: 464305.0 [2024-08-06 03:55:29,902][52666] Sum rewards: 60.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.102', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.318', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.288', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '52.000'} [2024-08-06 03:55:31,016][52659] DAMAGECOUNT value on done: 473766.0 [2024-08-06 03:55:31,016][52659] Sum rewards: 80.049, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.394', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon2': '0.198', 'AMMO3': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.598', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '68.000'} [2024-08-06 03:55:31,939][52664] DAMAGECOUNT value on done: 488260.0 [2024-08-06 03:55:31,939][52664] Sum rewards: 80.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.097', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.180', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '67.000'} [2024-08-06 03:55:32,058][52647] DAMAGECOUNT value on done: 487115.0 [2024-08-06 03:55:32,058][52647] Sum rewards: 80.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.139', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.164', 'AMMO3': '0.178', 'AMMO4': '0.231', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.744', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:32,074][52663] DAMAGECOUNT value on done: 457213.0 [2024-08-06 03:55:32,074][52663] Sum rewards: 64.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.847', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon5': '0.196', 'AMMO3': '0.201', 'weapon2': '0.202', 'weapon4': '0.246', 'AMMO4': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:32,187][52649] DAMAGECOUNT value on done: 455968.0 [2024-08-06 03:55:32,187][52649] Sum rewards: 80.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.255', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '67.000'} [2024-08-06 03:55:32,219][52670] DAMAGECOUNT value on done: 464031.0 [2024-08-06 03:55:32,219][52670] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.755', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.120', 'AMMO3': '0.225', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '58.000'} [2024-08-06 03:55:32,439][52650] Updated weights for policy 0, policy_version 49511 (0.0021) [2024-08-06 03:55:32,652][52811] DAMAGECOUNT value on done: 431595.0 [2024-08-06 03:55:32,654][52811] Sum rewards: 69.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.164', 'AMMO3': '0.189', 'AMMO4': '0.198', 'weapon2': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.706', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '58.000'} [2024-08-06 03:55:32,753][52666] DAMAGECOUNT value on done: 465888.0 [2024-08-06 03:55:32,753][52666] Sum rewards: 73.895, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.356', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.340', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 405602304. Throughput: 0: 4376.7. Samples: 101399160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:55:32,794][52567] Avg episode reward: [(0, '71.129')] [2024-08-06 03:55:32,922][52803] DAMAGECOUNT value on done: 428126.0 [2024-08-06 03:55:32,922][52803] Sum rewards: 63.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.284', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '52.000'} [2024-08-06 03:55:34,149][52659] DAMAGECOUNT value on done: 468196.0 [2024-08-06 03:55:34,150][52659] Sum rewards: 78.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.256', 'weapon4': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:34,516][52664] DAMAGECOUNT value on done: 482731.0 [2024-08-06 03:55:34,517][52664] Sum rewards: 70.296, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.695', 'AMMO5': '0.020', 'AMMO2': '0.068', 'weapon4': '0.192', 'AMMO3': '0.217', 'weapon5': '0.254', 'AMMO4': '0.340', 'WEAPON5': '0.500', 'weapon2': '0.572', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.654', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:34,639][52647] DAMAGECOUNT value on done: 479207.0 [2024-08-06 03:55:34,639][52647] Sum rewards: 51.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.005', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.062', 'AMMO4': '0.162', 'AMMO3': '0.166', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '2.928', 'DAMAGECOUNT': '13.170', 'FRAGCOUNT': '42.000'} [2024-08-06 03:55:35,079][52663] DAMAGECOUNT value on done: 461407.0 [2024-08-06 03:55:35,079][52663] Sum rewards: 58.008, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.670', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon5': '0.222', 'AMMO4': '0.246', 'weapon2': '0.252', 'AMMO3': '0.256', 'weapon4': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.944', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '51.000'} [2024-08-06 03:55:35,199][52649] DAMAGECOUNT value on done: 458225.0 [2024-08-06 03:55:35,199][52649] Sum rewards: 66.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.147', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.162', 'AMMO4': '0.188', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:35,296][52670] DAMAGECOUNT value on done: 457025.0 [2024-08-06 03:55:35,296][52670] Sum rewards: 69.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:35,667][52811] DAMAGECOUNT value on done: 438325.0 [2024-08-06 03:55:35,670][52811] Sum rewards: 72.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '0.002', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO3': '0.145', 'AMMO4': '0.168', 'weapon4': '0.174', 'weapon5': '0.242', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.090', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:35,820][52666] DAMAGECOUNT value on done: 464529.0 [2024-08-06 03:55:35,820][52666] Sum rewards: 70.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.095', 'AMMO2': '0.027', 'AMMO5': '0.027', 'weapon4': '0.082', 'AMMO4': '0.134', 'AMMO3': '0.203', 'weapon5': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '59.500'} [2024-08-06 03:55:36,040][52803] DAMAGECOUNT value on done: 436405.0 [2024-08-06 03:55:36,040][52803] Sum rewards: 76.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.144', 'AMMO4': '0.201', 'AMMO3': '0.209', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.280', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:36,883][52650] Updated weights for policy 0, policy_version 49521 (0.0012) [2024-08-06 03:55:37,322][52659] DAMAGECOUNT value on done: 469025.0 [2024-08-06 03:55:37,323][52659] Sum rewards: 63.741, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.740', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon5': '0.120', 'weapon2': '0.232', 'AMMO3': '0.251', 'AMMO4': '0.254', 'weapon4': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 405676032. Throughput: 0: 4368.9. Samples: 101425260. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:55:37,802][52567] Avg episode reward: [(0, '71.122')] [2024-08-06 03:55:37,895][52664] DAMAGECOUNT value on done: 489581.0 [2024-08-06 03:55:37,896][52664] Sum rewards: 67.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.053', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.209', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.394', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:37,920][52647] DAMAGECOUNT value on done: 489521.0 [2024-08-06 03:55:37,920][52647] Sum rewards: 77.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.685', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.188', 'weapon2': '0.202', 'AMMO3': '0.209', 'weapon5': '0.236', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:38,266][52663] DAMAGECOUNT value on done: 461917.0 [2024-08-06 03:55:38,267][52663] Sum rewards: 76.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.477', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'HITCOUNT': '3.430', 'weapon3': '3.602', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:38,338][52649] DAMAGECOUNT value on done: 459029.0 [2024-08-06 03:55:38,338][52649] Sum rewards: 72.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.866', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.119', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.282', 'weapon2': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.128', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:38,486][52670] DAMAGECOUNT value on done: 455840.0 [2024-08-06 03:55:38,486][52670] Sum rewards: 74.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.399', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:38,839][52811] DAMAGECOUNT value on done: 433058.0 [2024-08-06 03:55:38,843][52811] Sum rewards: 69.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.585', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.148', 'weapon5': '0.176', 'AMMO4': '0.192', 'AMMO3': '0.218', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:38,964][52666] DAMAGECOUNT value on done: 464040.0 [2024-08-06 03:55:38,965][52666] Sum rewards: 66.339, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.452', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:39,125][52803] DAMAGECOUNT value on done: 438462.0 [2024-08-06 03:55:39,125][52803] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.954', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.124', 'AMMO3': '0.218', 'AMMO4': '0.230', 'weapon5': '0.286', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:40,124][52659] DAMAGECOUNT value on done: 461669.0 [2024-08-06 03:55:40,125][52659] Sum rewards: 72.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.306', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.138', 'AMMO4': '0.148', 'weapon2': '0.216', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.380', 'weapon3': '3.382', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '61.000'} [2024-08-06 03:55:40,454][52664] DAMAGECOUNT value on done: 484599.0 [2024-08-06 03:55:40,456][52664] Sum rewards: 70.599, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.434', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.036', 'weapon4': '0.076', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.278', 'AMMO3': '0.364', 'WEAPON3': '2.200', 'weapon3': '3.328', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:40,459][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:55:40,508][52647] DAMAGECOUNT value on done: 484346.0 [2024-08-06 03:55:40,508][52647] Sum rewards: 60.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.765', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.058', 'AMMO4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.082', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '50.000'} [2024-08-06 03:55:41,189][52649] DAMAGECOUNT value on done: 456628.0 [2024-08-06 03:55:41,189][52649] Sum rewards: 68.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.578', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.686', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '56.500'} [2024-08-06 03:55:41,380][52663] DAMAGECOUNT value on done: 466241.0 [2024-08-06 03:55:41,383][52663] Sum rewards: 80.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.236', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.028', 'WEAPON4': '0.100', 'AMMO4': '0.138', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.308', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:41,431][52670] DAMAGECOUNT value on done: 466218.0 [2024-08-06 03:55:41,431][52670] Sum rewards: 58.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.031', 'AMMO2': '0.076', 'AMMO3': '0.172', 'weapon5': '0.296', 'weapon4': '0.322', 'AMMO4': '0.380', 'weapon2': '0.500', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.556', 'HITCOUNT': '2.570', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '47.000'} [2024-08-06 03:55:41,739][52650] Updated weights for policy 0, policy_version 49531 (0.0015) [2024-08-06 03:55:41,898][52811] DAMAGECOUNT value on done: 433490.0 [2024-08-06 03:55:41,900][52811] Sum rewards: 69.374, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.341', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.157', 'AMMO4': '0.209', 'weapon4': '0.216', 'weapon2': '0.316', 'weapon5': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.764', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:42,049][52666] DAMAGECOUNT value on done: 456314.0 [2024-08-06 03:55:42,051][52666] Sum rewards: 69.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.576', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.178', 'weapon2': '0.216', 'AMMO3': '0.225', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:42,265][52803] DAMAGECOUNT value on done: 435949.0 [2024-08-06 03:55:42,268][52803] Sum rewards: 65.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'AMMO5': '0.004', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.264', 'weapon2': '0.356', 'ARMOR': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '52.000'} [2024-08-06 03:55:42,737][52659] DAMAGECOUNT value on done: 464996.0 [2024-08-06 03:55:42,737][52659] Sum rewards: 69.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.128', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.062', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.218', 'weapon2': '0.252', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.244', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '60.000'} [2024-08-06 03:55:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 405774336. Throughput: 0: 4364.5. Samples: 101451380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:55:42,802][52567] Avg episode reward: [(0, '71.217')] [2024-08-06 03:55:43,624][52664] DAMAGECOUNT value on done: 485900.0 [2024-08-06 03:55:43,628][52664] Sum rewards: 81.291, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.893', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.107', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.280', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:43,629][52647] DAMAGECOUNT value on done: 493885.0 [2024-08-06 03:55:43,632][52647] Sum rewards: 65.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.188', 'AMMO5': '0.026', 'AMMO2': '0.082', 'AMMO3': '0.194', 'weapon2': '0.256', 'weapon4': '0.294', 'weapon5': '0.328', 'AMMO4': '0.409', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:43,721][52649] DAMAGECOUNT value on done: 446459.0 [2024-08-06 03:55:43,722][52649] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.783', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.210', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:44,059][52670] DAMAGECOUNT value on done: 460341.0 [2024-08-06 03:55:44,060][52670] Sum rewards: 82.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.078', 'AMMO4': '0.144', 'weapon5': '0.174', 'weapon2': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '68.000'} [2024-08-06 03:55:44,302][52663] DAMAGECOUNT value on done: 464455.0 [2024-08-06 03:55:44,305][52663] Sum rewards: 75.027, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'HEALTH': '0.104', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.186', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.958', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:44,668][52666] DAMAGECOUNT value on done: 461376.0 [2024-08-06 03:55:44,670][52666] Sum rewards: 65.315, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.659', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.148', 'weapon4': '0.160', 'weapon2': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.274', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:44,930][52811] DAMAGECOUNT value on done: 436892.0 [2024-08-06 03:55:44,931][52811] Sum rewards: 69.916, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.770', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.130', 'weapon5': '0.160', 'AMMO4': '0.171', 'weapon2': '0.210', 'WEAPON5': '0.300', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.252', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:45,321][52659] DAMAGECOUNT value on done: 465341.0 [2024-08-06 03:55:45,323][52659] Sum rewards: 65.574, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.108', 'weapon5': '0.138', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.398', 'HEALTH': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:45,340][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:55:45,515][52803] DAMAGECOUNT value on done: 424047.0 [2024-08-06 03:55:45,515][52803] Sum rewards: 65.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.039', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon4': '0.136', 'weapon5': '0.146', 'AMMO3': '0.245', 'weapon2': '0.286', 'WEAPON5': '0.300', 'AMMO4': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.116', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:46,503][52649] DAMAGECOUNT value on done: 456336.0 [2024-08-06 03:55:46,503][52649] Sum rewards: 85.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon2': '0.152', 'weapon5': '0.180', 'weapon4': '0.184', 'AMMO4': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.204', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.678', 'FRAGCOUNT': '70.000'} [2024-08-06 03:55:46,756][52650] Updated weights for policy 0, policy_version 49541 (0.0027) [2024-08-06 03:55:46,764][52647] DAMAGECOUNT value on done: 486499.0 [2024-08-06 03:55:46,764][52647] Sum rewards: 75.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.054', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:46,798][52664] DAMAGECOUNT value on done: 479067.0 [2024-08-06 03:55:46,798][52664] Sum rewards: 73.925, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.284', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.291', 'WEAPON3': '1.550', 'weapon3': '3.398', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:47,130][52663] DAMAGECOUNT value on done: 457639.0 [2024-08-06 03:55:47,130][52663] Sum rewards: 76.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.694', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.132', 'weapon2': '0.210', 'AMMO3': '0.240', 'weapon5': '0.302', 'AMMO4': '0.323', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:47,309][52670] DAMAGECOUNT value on done: 452423.0 [2024-08-06 03:55:47,311][52670] Sum rewards: 74.461, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.014', 'AMMO2': '0.027', 'HEALTH': '0.102', 'AMMO4': '0.135', 'AMMO3': '0.181', 'weapon2': '0.184', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 03:55:47,773][52666] DAMAGECOUNT value on done: 460226.0 [2024-08-06 03:55:47,774][52666] Sum rewards: 67.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.128', 'AMMO3': '0.184', 'weapon5': '0.284', 'AMMO4': '0.297', 'weapon2': '0.396', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '55.500'} [2024-08-06 03:55:47,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 405864448. Throughput: 0: 4359.8. Samples: 101464460. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 03:55:47,794][52567] Avg episode reward: [(0, '71.075')] [2024-08-06 03:55:47,996][52811] DAMAGECOUNT value on done: 433726.0 [2024-08-06 03:55:48,000][52811] Sum rewards: 71.108, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.267', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.150', 'weapon4': '0.172', 'weapon2': '0.236', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:48,555][52803] DAMAGECOUNT value on done: 426933.0 [2024-08-06 03:55:48,556][52803] Sum rewards: 71.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.151', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon5': '0.160', 'AMMO3': '0.214', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON4': '0.600', 'weapon2': '0.692', 'WEAPON3': '1.400', 'weapon3': '2.452', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:49,273][52647] DAMAGECOUNT value on done: 480113.0 [2024-08-06 03:55:49,276][52647] Sum rewards: 73.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.072', 'AMMO5': '0.023', 'AMMO2': '0.074', 'weapon4': '0.166', 'AMMO3': '0.187', 'weapon5': '0.226', 'AMMO4': '0.370', 'weapon2': '0.528', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '60.000'} [2024-08-06 03:55:49,402][52649] DAMAGECOUNT value on done: 443457.0 [2024-08-06 03:55:49,403][52649] Sum rewards: 58.759, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.104', 'weapon5': '0.104', 'AMMO4': '0.142', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.570', 'WEAPON3': '1.750', 'HITCOUNT': '2.940', 'weapon3': '2.952', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '54.000'} [2024-08-06 03:55:49,461][52664] DAMAGECOUNT value on done: 478835.0 [2024-08-06 03:55:49,462][52664] Sum rewards: 90.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.054', 'FRAGCOUNT': '73.000'} [2024-08-06 03:55:50,258][52663] DAMAGECOUNT value on done: 457829.0 [2024-08-06 03:55:50,258][52663] Sum rewards: 56.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.196', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.848', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '46.000'} [2024-08-06 03:55:50,285][52670] DAMAGECOUNT value on done: 458644.0 [2024-08-06 03:55:50,285][52670] Sum rewards: 69.194, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '3.300', 'weapon3': '3.378', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:50,740][52666] DAMAGECOUNT value on done: 458797.0 [2024-08-06 03:55:50,741][52666] Sum rewards: 73.318, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 03:55:51,000][52650] Updated weights for policy 0, policy_version 49551 (0.0018) [2024-08-06 03:55:51,083][52811] DAMAGECOUNT value on done: 432011.0 [2024-08-06 03:55:51,084][52811] Sum rewards: 69.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.800', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.108', 'AMMO3': '0.214', 'weapon5': '0.238', 'AMMO4': '0.274', 'weapon2': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:51,566][52803] DAMAGECOUNT value on done: 426659.0 [2024-08-06 03:55:51,568][52803] Sum rewards: 75.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.185', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.238', 'WEAPON3': '1.550', 'weapon3': '3.576', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:52,067][52647] DAMAGECOUNT value on done: 485146.0 [2024-08-06 03:55:52,068][52647] Sum rewards: 78.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.055', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.175', 'weapon2': '0.202', 'WEAPON3': '1.100', 'HITCOUNT': '3.470', 'weapon3': '3.486', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '63.000'} [2024-08-06 03:55:52,098][52649] DAMAGECOUNT value on done: 456801.0 [2024-08-06 03:55:52,100][52649] Sum rewards: 78.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.426', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.026', 'AMMO4': '0.127', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '64.000'} [2024-08-06 03:55:52,332][52664] DAMAGECOUNT value on done: 481809.0 [2024-08-06 03:55:52,335][52664] Sum rewards: 67.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.126', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.056', 'weapon4': '0.146', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.267', 'WEAPON4': '0.350', 'weapon2': '0.844', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 405946368. Throughput: 0: 4365.8. Samples: 101490900. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:55:52,795][52567] Avg episode reward: [(0, '71.278')] [2024-08-06 03:55:52,939][52663] DAMAGECOUNT value on done: 464236.0 [2024-08-06 03:55:52,940][52663] Sum rewards: 66.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.952', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon5': '0.054', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:53,311][52670] DAMAGECOUNT value on done: 457431.0 [2024-08-06 03:55:53,311][52670] Sum rewards: 69.070, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.035', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.112', 'weapon5': '0.124', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.252', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '57.000'} [2024-08-06 03:55:53,734][52666] DAMAGECOUNT value on done: 453856.0 [2024-08-06 03:55:53,734][52666] Sum rewards: 79.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.865', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '65.500'} [2024-08-06 03:55:54,090][52811] DAMAGECOUNT value on done: 442959.0 [2024-08-06 03:55:54,091][52811] Sum rewards: 85.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.372', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.140', 'AMMO4': '0.186', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '70.000'} [2024-08-06 03:55:54,593][52803] DAMAGECOUNT value on done: 433680.0 [2024-08-06 03:55:54,596][52803] Sum rewards: 64.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.095', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.152', 'AMMO4': '0.198', 'AMMO3': '0.230', 'weapon4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '53.000'} [2024-08-06 03:55:54,993][52647] DAMAGECOUNT value on done: 482611.0 [2024-08-06 03:55:54,994][52647] Sum rewards: 73.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.188', 'weapon5': '0.202', 'AMMO4': '0.211', 'weapon4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.690', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '60.000'} [2024-08-06 03:55:55,099][52649] DAMAGECOUNT value on done: 458264.0 [2024-08-06 03:55:55,099][52649] Sum rewards: 65.851, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.966', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.128', 'weapon5': '0.214', 'AMMO3': '0.253', 'AMMO4': '0.311', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:55,303][52664] DAMAGECOUNT value on done: 479904.0 [2024-08-06 03:55:55,305][52664] Sum rewards: 82.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.210', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '67.000'} [2024-08-06 03:55:55,626][52663] DAMAGECOUNT value on done: 469206.0 [2024-08-06 03:55:55,628][52663] Sum rewards: 85.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.205', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.123', 'weapon5': '0.130', 'AMMO3': '0.183', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.368', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '69.000'} [2024-08-06 03:55:55,744][52650] Updated weights for policy 0, policy_version 49561 (0.0011) [2024-08-06 03:55:55,880][52670] DAMAGECOUNT value on done: 455733.0 [2024-08-06 03:55:55,880][52670] Sum rewards: 79.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.080', 'AMMO4': '0.142', 'weapon5': '0.172', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '65.000'} [2024-08-06 03:55:56,133][52666] DAMAGECOUNT value on done: 457607.0 [2024-08-06 03:55:56,134][52666] Sum rewards: 68.050, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.208', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.154', 'weapon4': '0.158', 'AMMO3': '0.214', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.410', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:57,177][52811] DAMAGECOUNT value on done: 432140.0 [2024-08-06 03:55:57,178][52811] Sum rewards: 67.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.089', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.050', 'weapon4': '0.128', 'AMMO4': '0.176', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.276', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 03:55:57,654][52803] DAMAGECOUNT value on done: 423329.0 [2024-08-06 03:55:57,654][52803] Sum rewards: 60.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.248', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.224', 'weapon4': '0.248', 'ARMOR': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '51.000'} [2024-08-06 03:55:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 406036480. Throughput: 0: 4367.8. Samples: 101517170. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:55:57,794][52567] Avg episode reward: [(0, '71.180')] [2024-08-06 03:55:57,838][52649] DAMAGECOUNT value on done: 449753.0 [2024-08-06 03:55:57,840][52649] Sum rewards: 54.221, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'ARMOR': '0.005', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.120', 'weapon5': '0.130', 'AMMO4': '0.138', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.590', 'weapon3': '3.318', 'DAMAGECOUNT': '13.206', 'FRAGCOUNT': '46.000'} [2024-08-06 03:55:57,882][52647] DAMAGECOUNT value on done: 482865.0 [2024-08-06 03:55:57,882][52647] Sum rewards: 43.225, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.506', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'AMMO3': '0.092', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.332', 'WEAPON3': '0.550', 'weapon7': '0.686', 'weapon4': '0.836', 'weapon3': '1.610', 'HITCOUNT': '1.930', 'DAMAGECOUNT': '9.816', 'FRAGCOUNT': '33.000'} [2024-08-06 03:55:58,063][52663] DAMAGECOUNT value on done: 461624.0 [2024-08-06 03:55:58,063][52663] Sum rewards: 60.855, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.519', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.171', 'weapon5': '0.192', 'weapon2': '0.218', 'AMMO3': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'HITCOUNT': '2.970', 'weapon3': '3.204', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:58,260][52664] DAMAGECOUNT value on done: 478943.0 [2024-08-06 03:55:58,260][52664] Sum rewards: 65.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.122', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.184', 'weapon5': '0.190', 'AMMO3': '0.226', 'AMMO4': '0.236', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.590', 'WEAPON3': '1.450', 'weapon3': '2.744', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '55.000'} [2024-08-06 03:55:58,468][52670] DAMAGECOUNT value on done: 461646.0 [2024-08-06 03:55:58,470][52670] Sum rewards: 73.305, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.339', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '59.000'} [2024-08-06 03:55:58,744][52666] DAMAGECOUNT value on done: 455948.0 [2024-08-06 03:55:58,745][52666] Sum rewards: 69.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.198', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.482', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '57.000'} [2024-08-06 03:56:00,305][52811] DAMAGECOUNT value on done: 430852.0 [2024-08-06 03:56:00,306][52811] Sum rewards: 78.124, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.414', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.147', 'weapon2': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '61.000'} [2024-08-06 03:56:00,526][52650] Updated weights for policy 0, policy_version 49571 (0.0011) [2024-08-06 03:56:00,740][52803] DAMAGECOUNT value on done: 439416.0 [2024-08-06 03:56:00,742][52803] Sum rewards: 81.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '66.000'} [2024-08-06 03:56:00,930][52663] DAMAGECOUNT value on done: 456726.0 [2024-08-06 03:56:00,932][52663] Sum rewards: 75.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.888', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.168', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '64.000'} [2024-08-06 03:56:00,957][52670] DAMAGECOUNT value on done: 452465.0 [2024-08-06 03:56:00,957][52670] Sum rewards: 62.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.118', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.135', 'weapon4': '0.160', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.230', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '54.000'} [2024-08-06 03:56:01,333][52666] DAMAGECOUNT value on done: 468148.0 [2024-08-06 03:56:01,333][52666] Sum rewards: 68.170, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.734', 'AMMO5': '0.011', 'AMMO2': '0.053', 'AMMO3': '0.137', 'weapon4': '0.216', 'weapon5': '0.224', 'AMMO4': '0.263', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.000'} [2024-08-06 03:56:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 406118400. Throughput: 0: 4370.0. Samples: 101530430. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:56:02,802][52567] Avg episode reward: [(0, '70.599')] [2024-08-06 03:56:03,433][52811] DAMAGECOUNT value on done: 434846.0 [2024-08-06 03:56:03,435][52811] Sum rewards: 65.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon4': '0.048', 'AMMO4': '0.054', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.268', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.402', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '53.000'} [2024-08-06 03:56:03,666][52670] DAMAGECOUNT value on done: 456469.0 [2024-08-06 03:56:03,667][52670] Sum rewards: 82.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '69.000'} [2024-08-06 03:56:03,730][52663] DAMAGECOUNT value on done: 456118.0 [2024-08-06 03:56:03,730][52663] Sum rewards: 65.884, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.488', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.354', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '53.000'} [2024-08-06 03:56:03,845][52803] DAMAGECOUNT value on done: 433525.0 [2024-08-06 03:56:03,845][52803] Sum rewards: 80.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.126', 'weapon5': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '68.000'} [2024-08-06 03:56:04,237][52666] DAMAGECOUNT value on done: 464459.0 [2024-08-06 03:56:04,238][52666] Sum rewards: 75.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.253', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.154', 'AMMO4': '0.154', 'AMMO3': '0.165', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.500'} [2024-08-06 03:56:05,052][52650] Updated weights for policy 0, policy_version 49581 (0.0036) [2024-08-06 03:56:06,461][52663] DAMAGECOUNT value on done: 457474.0 [2024-08-06 03:56:06,463][52663] Sum rewards: 80.133, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.135', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.032', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.482', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '68.000'} [2024-08-06 03:56:06,492][52811] DAMAGECOUNT value on done: 427258.0 [2024-08-06 03:56:06,494][52811] Sum rewards: 58.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.222', 'weapon2': '0.246', 'WEAPON5': '0.450', 'weapon4': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '51.000'} [2024-08-06 03:56:06,976][52670] DAMAGECOUNT value on done: 466096.0 [2024-08-06 03:56:06,980][52670] Sum rewards: 72.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.607', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.205', 'weapon2': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.370', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:07,015][52803] DAMAGECOUNT value on done: 431771.0 [2024-08-06 03:56:07,015][52803] Sum rewards: 64.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.067', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.184', 'weapon5': '0.306', 'weapon2': '0.312', 'AMMO4': '0.327', 'WEAPON5': '0.550', 'weapon4': '0.594', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.422', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '51.000'} [2024-08-06 03:56:07,634][52666] DAMAGECOUNT value on done: 457608.0 [2024-08-06 03:56:07,634][52666] Sum rewards: 70.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.795', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon4': '0.244', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 406216704. Throughput: 0: 4369.3. Samples: 101556740. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:56:07,802][52567] Avg episode reward: [(0, '70.944')] [2024-08-06 03:56:08,604][52667] DAMAGECOUNT value on done: 461633.0 [2024-08-06 03:56:08,605][52667] Sum rewards: 56.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO4': '0.193', 'AMMO3': '0.203', 'weapon2': '0.248', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '49.000'} [2024-08-06 03:56:08,697][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:56:09,295][52663] DAMAGECOUNT value on done: 467109.0 [2024-08-06 03:56:09,296][52663] Sum rewards: 64.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.902', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon2': '0.176', 'AMMO3': '0.198', 'AMMO4': '0.202', 'weapon5': '0.216', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '52.000'} [2024-08-06 03:56:09,530][52811] DAMAGECOUNT value on done: 433549.0 [2024-08-06 03:56:09,533][52811] Sum rewards: 72.009, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.945', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.116', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '61.000'} [2024-08-06 03:56:09,558][52650] Updated weights for policy 0, policy_version 49591 (0.0020) [2024-08-06 03:56:09,980][52803] DAMAGECOUNT value on done: 434805.0 [2024-08-06 03:56:09,981][52803] Sum rewards: 69.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.651', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.120', 'AMMO4': '0.165', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.774', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:10,286][52670] DAMAGECOUNT value on done: 459595.0 [2024-08-06 03:56:10,287][52670] Sum rewards: 67.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.197', 'weapon4': '0.228', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '55.000'} [2024-08-06 03:56:10,915][52666] DAMAGECOUNT value on done: 459855.0 [2024-08-06 03:56:10,918][52666] Sum rewards: 84.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '69.000'} [2024-08-06 03:56:10,971][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:56:11,325][52664] Large shaping reward 2.600 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.549, 183.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:56:11,665][52663] DAMAGECOUNT value on done: 458746.0 [2024-08-06 03:56:11,665][52663] Sum rewards: 72.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.118', 'weapon5': '0.144', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:11,718][52667] DAMAGECOUNT value on done: 471175.0 [2024-08-06 03:56:11,720][52667] Sum rewards: 83.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.264', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.052', 'weapon4': '0.054', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '67.000'} [2024-08-06 03:56:12,525][52811] DAMAGECOUNT value on done: 433878.0 [2024-08-06 03:56:12,529][52811] Sum rewards: 79.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.406', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO4': '0.160', 'AMMO3': '0.164', 'weapon2': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '65.000'} [2024-08-06 03:56:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 406298624. Throughput: 0: 4371.5. Samples: 101582940. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:56:12,795][52567] Avg episode reward: [(0, '70.823')] [2024-08-06 03:56:12,934][52803] DAMAGECOUNT value on done: 432668.0 [2024-08-06 03:56:12,936][52803] Sum rewards: 71.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.118', 'AMMO4': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.222', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:13,671][52670] DAMAGECOUNT value on done: 446709.0 [2024-08-06 03:56:13,672][52670] Sum rewards: 70.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon2': '0.174', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:14,022][52666] DAMAGECOUNT value on done: 461077.0 [2024-08-06 03:56:14,023][52666] Sum rewards: 71.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:14,094][52663] DAMAGECOUNT value on done: 466516.0 [2024-08-06 03:56:14,094][52663] Sum rewards: 65.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.355', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO4': '0.203', 'weapon2': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.282', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '56.000'} [2024-08-06 03:56:14,334][52650] Updated weights for policy 0, policy_version 49601 (0.0021) [2024-08-06 03:56:14,624][52667] DAMAGECOUNT value on done: 462410.0 [2024-08-06 03:56:14,626][52667] Sum rewards: 71.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.186', 'AMMO4': '0.204', 'weapon5': '0.232', 'weapon4': '0.234', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:15,576][52811] DAMAGECOUNT value on done: 433135.0 [2024-08-06 03:56:15,578][52811] Sum rewards: 71.299, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.084', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.212', 'weapon4': '0.240', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:16,180][52803] DAMAGECOUNT value on done: 428197.0 [2024-08-06 03:56:16,181][52803] Sum rewards: 61.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.819', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.176', 'weapon2': '0.224', 'AMMO4': '0.248', 'weapon5': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '50.500'} [2024-08-06 03:56:16,637][52670] DAMAGECOUNT value on done: 456271.0 [2024-08-06 03:56:16,639][52670] Sum rewards: 65.263, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.209', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.029', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.328', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '56.000'} [2024-08-06 03:56:17,112][52666] DAMAGECOUNT value on done: 464347.0 [2024-08-06 03:56:17,112][52666] Sum rewards: 73.949, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.110', 'AMMO5': '0.004', 'weapon4': '0.008', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.308', 'weapon2': '0.374', 'WEAPON3': '1.800', 'weapon3': '3.368', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '64.000'} [2024-08-06 03:56:17,181][52663] DAMAGECOUNT value on done: 463634.0 [2024-08-06 03:56:17,182][52663] Sum rewards: 75.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.979', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.177', 'AMMO3': '0.234', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '63.000'} [2024-08-06 03:56:17,544][52667] DAMAGECOUNT value on done: 463193.0 [2024-08-06 03:56:17,545][52667] Sum rewards: 66.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.143', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '55.000'} [2024-08-06 03:56:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 406388736. Throughput: 0: 4371.3. Samples: 101595870. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 03:56:17,802][52567] Avg episode reward: [(0, '71.067')] [2024-08-06 03:56:18,575][52811] DAMAGECOUNT value on done: 433101.0 [2024-08-06 03:56:18,576][52811] Sum rewards: 68.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.954', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.166', 'weapon5': '0.220', 'weapon2': '0.240', 'AMMO4': '0.258', 'AMMO3': '0.275', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:18,866][52650] Updated weights for policy 0, policy_version 49611 (0.0031) [2024-08-06 03:56:19,367][52803] DAMAGECOUNT value on done: 437909.0 [2024-08-06 03:56:19,368][52803] Sum rewards: 66.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.192', 'weapon2': '0.862', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '55.000'} [2024-08-06 03:56:19,485][52670] DAMAGECOUNT value on done: 467442.0 [2024-08-06 03:56:19,485][52670] Sum rewards: 86.622, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.565', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.161', 'weapon4': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.284', 'weapon2': '0.424', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '68.000'} [2024-08-06 03:56:19,886][52666] DAMAGECOUNT value on done: 449951.0 [2024-08-06 03:56:19,888][52666] Sum rewards: 61.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.624', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.208', 'weapon2': '0.210', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.158', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '54.000'} [2024-08-06 03:56:19,948][52614] Signal inference workers to stop experience collection... (9000 times) [2024-08-06 03:56:19,949][52614] Signal inference workers to resume experience collection... (9000 times) [2024-08-06 03:56:19,989][52650] InferenceWorker_p0-w0: stopping experience collection (9000 times) [2024-08-06 03:56:19,989][52650] InferenceWorker_p0-w0: resuming experience collection (9000 times) [2024-08-06 03:56:20,156][52667] DAMAGECOUNT value on done: 470472.0 [2024-08-06 03:56:20,158][52667] Sum rewards: 90.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.238', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.116', 'AMMO3': '0.149', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.296', 'WEAPON3': '0.850', 'weapon3': '3.274', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.991', 'FRAGCOUNT': '71.000'} [2024-08-06 03:56:20,299][52663] DAMAGECOUNT value on done: 457456.0 [2024-08-06 03:56:20,299][52663] Sum rewards: 68.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.356', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.176', 'weapon5': '0.176', 'AMMO4': '0.202', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '57.000'} [2024-08-06 03:56:20,420][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:56:22,013][52670] DAMAGECOUNT value on done: 458189.0 [2024-08-06 03:56:22,015][52670] Sum rewards: 64.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.182', 'AMMO4': '0.191', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '2.978', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '57.000'} [2024-08-06 03:56:22,380][52666] DAMAGECOUNT value on done: 457710.0 [2024-08-06 03:56:22,383][52666] Sum rewards: 67.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.280', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.412', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:22,507][52803] DAMAGECOUNT value on done: 434083.0 [2024-08-06 03:56:22,507][52803] Sum rewards: 71.388, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.870', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.156', 'AMMO4': '0.208', 'weapon4': '0.236', 'weapon5': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.000', 'weapon3': '2.820', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '56.000'} [2024-08-06 03:56:22,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 406470656. Throughput: 0: 4383.8. Samples: 101622530. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:56:22,802][52567] Avg episode reward: [(0, '71.038')] [2024-08-06 03:56:22,963][52667] DAMAGECOUNT value on done: 472943.0 [2024-08-06 03:56:22,965][52667] Sum rewards: 72.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.204', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.164', 'AMMO4': '0.165', 'weapon5': '0.172', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:23,692][52650] Updated weights for policy 0, policy_version 49621 (0.0018) [2024-08-06 03:56:24,960][52670] DAMAGECOUNT value on done: 462210.0 [2024-08-06 03:56:24,960][52670] Sum rewards: 77.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.038', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '62.000'} [2024-08-06 03:56:25,312][52669] DAMAGECOUNT value on done: 468495.0 [2024-08-06 03:56:25,313][52669] Sum rewards: 73.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.416', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:25,690][52803] DAMAGECOUNT value on done: 436777.0 [2024-08-06 03:56:25,691][52803] Sum rewards: 82.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.298', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.084', 'AMMO4': '0.222', 'weapon5': '0.230', 'AMMO3': '0.238', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '68.000'} [2024-08-06 03:56:26,071][52667] DAMAGECOUNT value on done: 465910.0 [2024-08-06 03:56:26,072][52667] Sum rewards: 80.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.399', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '66.000'} [2024-08-06 03:56:26,577][52795] DAMAGECOUNT value on done: 431584.0 [2024-08-06 03:56:26,580][52795] Sum rewards: 68.208, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.140', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.080', 'AMMO4': '0.121', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.299', 'WEAPON3': '1.800', 'weapon3': '3.406', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '61.000'} [2024-08-06 03:56:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 406552576. Throughput: 0: 4390.4. Samples: 101648950. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:56:27,795][52567] Avg episode reward: [(0, '71.519')] [2024-08-06 03:56:27,800][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049629_406560768.pth... [2024-08-06 03:56:27,967][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049117_402366464.pth [2024-08-06 03:56:28,522][52669] DAMAGECOUNT value on done: 458207.0 [2024-08-06 03:56:28,522][52669] Sum rewards: 62.050, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.640', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.326', 'WEAPON3': '1.950', 'HITCOUNT': '3.180', 'weapon3': '3.388', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '57.000'} [2024-08-06 03:56:28,702][52650] Updated weights for policy 0, policy_version 49631 (0.0012) [2024-08-06 03:56:28,962][52803] DAMAGECOUNT value on done: 431873.0 [2024-08-06 03:56:28,964][52803] Sum rewards: 63.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.275', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.068', 'weapon4': '0.076', 'AMMO4': '0.117', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.360', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2024-08-06 03:56:29,297][52667] DAMAGECOUNT value on done: 464885.0 [2024-08-06 03:56:29,299][52667] Sum rewards: 70.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO4': '0.191', 'AMMO3': '0.206', 'WEAPON5': '0.350', 'weapon4': '0.410', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:29,709][52795] DAMAGECOUNT value on done: 421714.0 [2024-08-06 03:56:29,711][52795] Sum rewards: 81.222, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.082', 'weapon5': '0.126', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.354', 'HEALTH': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 03:56:31,699][52669] DAMAGECOUNT value on done: 467708.0 [2024-08-06 03:56:31,699][52669] Sum rewards: 80.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.305', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '65.500'} [2024-08-06 03:56:32,043][52667] DAMAGECOUNT value on done: 468254.0 [2024-08-06 03:56:32,046][52667] Sum rewards: 77.722, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.867', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.236', 'weapon5': '0.250', 'AMMO3': '0.267', 'AMMO4': '0.286', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.860', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '66.500'} [2024-08-06 03:56:32,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 406650880. Throughput: 0: 4382.6. Samples: 101661680. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:56:32,795][52567] Avg episode reward: [(0, '71.601')] [2024-08-06 03:56:32,968][52795] DAMAGECOUNT value on done: 422412.0 [2024-08-06 03:56:32,972][52795] Sum rewards: 78.207, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.678', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.208', 'AMMO3': '0.244', 'weapon4': '0.244', 'weapon2': '0.250', 'AMMO4': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '67.000'} [2024-08-06 03:56:33,324][52650] Updated weights for policy 0, policy_version 49641 (0.0012) [2024-08-06 03:56:34,848][52669] DAMAGECOUNT value on done: 464584.0 [2024-08-06 03:56:34,848][52669] Sum rewards: 73.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.317', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.126', 'AMMO3': '0.216', 'AMMO4': '0.240', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '61.000'} [2024-08-06 03:56:35,194][52667] DAMAGECOUNT value on done: 473478.0 [2024-08-06 03:56:35,194][52667] Sum rewards: 68.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.117', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.320', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:36,210][52795] DAMAGECOUNT value on done: 427849.0 [2024-08-06 03:56:36,211][52795] Sum rewards: 56.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.138', 'AMMO4': '0.182', 'weapon5': '0.188', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.598', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.812', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '48.000'} [2024-08-06 03:56:37,440][52669] DAMAGECOUNT value on done: 464107.0 [2024-08-06 03:56:37,442][52669] Sum rewards: 71.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.080', 'AMMO4': '0.159', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 03:56:37,645][52668] DAMAGECOUNT value on done: 464005.0 [2024-08-06 03:56:37,647][52668] Sum rewards: 70.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO4': '0.140', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 406732800. Throughput: 0: 4382.2. Samples: 101688100. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:56:37,794][52567] Avg episode reward: [(0, '71.550')] [2024-08-06 03:56:37,806][52650] Updated weights for policy 0, policy_version 49651 (0.0029) [2024-08-06 03:56:38,086][52667] DAMAGECOUNT value on done: 461665.0 [2024-08-06 03:56:38,086][52667] Sum rewards: 63.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.265', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.118', 'AMMO4': '0.214', 'weapon5': '0.220', 'weapon2': '0.222', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '3.070', 'weapon3': '3.146', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '55.000'} [2024-08-06 03:56:39,327][52795] DAMAGECOUNT value on done: 424602.0 [2024-08-06 03:56:39,329][52795] Sum rewards: 70.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.305', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.163', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '3.306', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '56.000'} [2024-08-06 03:56:40,121][52668] DAMAGECOUNT value on done: 467773.0 [2024-08-06 03:56:40,130][52668] Sum rewards: 68.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.238', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '57.000'} [2024-08-06 03:56:40,371][52669] DAMAGECOUNT value on done: 468083.0 [2024-08-06 03:56:40,372][52669] Sum rewards: 58.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.498', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.252', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '48.000'} [2024-08-06 03:56:41,247][52667] DAMAGECOUNT value on done: 464212.0 [2024-08-06 03:56:41,248][52667] Sum rewards: 69.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.493', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.204', 'weapon2': '0.210', 'AMMO4': '0.249', 'weapon5': '0.312', 'weapon4': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:42,481][52795] DAMAGECOUNT value on done: 432301.0 [2024-08-06 03:56:42,483][52795] Sum rewards: 89.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.362', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.086', 'AMMO4': '0.137', 'weapon5': '0.152', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.174', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.931', 'FRAGCOUNT': '70.000'} [2024-08-06 03:56:42,683][52669] DAMAGECOUNT value on done: 465288.0 [2024-08-06 03:56:42,684][52669] Sum rewards: 82.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.124', 'weapon4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.338', 'WEAPON3': '1.600', 'weapon3': '3.134', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '69.000'} [2024-08-06 03:56:42,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 406814720. Throughput: 0: 4375.1. Samples: 101714050. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:56:42,794][52567] Avg episode reward: [(0, '71.316')] [2024-08-06 03:56:43,028][52650] Updated weights for policy 0, policy_version 49661 (0.0013) [2024-08-06 03:56:43,272][52668] DAMAGECOUNT value on done: 469076.0 [2024-08-06 03:56:43,275][52668] Sum rewards: 82.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.014', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.066', 'weapon5': '0.150', 'AMMO3': '0.215', 'AMMO4': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '69.500'} [2024-08-06 03:56:44,338][52667] DAMAGECOUNT value on done: 469348.0 [2024-08-06 03:56:44,338][52667] Sum rewards: 72.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.030', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.136', 'weapon2': '0.218', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.376', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:45,264][52669] DAMAGECOUNT value on done: 466684.0 [2024-08-06 03:56:45,266][52669] Sum rewards: 73.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.685', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:45,666][52795] DAMAGECOUNT value on done: 437540.0 [2024-08-06 03:56:45,666][52795] Sum rewards: 68.849, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.019', 'HEALTH': '0.030', 'AMMO2': '0.045', 'weapon4': '0.178', 'AMMO3': '0.192', 'AMMO4': '0.224', 'weapon5': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '57.000'} [2024-08-06 03:56:46,382][52668] DAMAGECOUNT value on done: 471423.0 [2024-08-06 03:56:46,383][52668] Sum rewards: 69.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.129', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:47,059][52667] DAMAGECOUNT value on done: 462434.0 [2024-08-06 03:56:47,060][52667] Sum rewards: 79.877, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.149', 'HEALTH': '0.155', 'weapon2': '0.466', 'WEAPON3': '0.900', 'weapon3': '3.406', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '63.000'} [2024-08-06 03:56:47,259][52650] Updated weights for policy 0, policy_version 49671 (0.0029) [2024-08-06 03:56:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 406904832. Throughput: 0: 4367.6. Samples: 101726970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:56:47,794][52567] Avg episode reward: [(0, '71.583')] [2024-08-06 03:56:48,049][52669] DAMAGECOUNT value on done: 471380.0 [2024-08-06 03:56:48,049][52669] Sum rewards: 74.424, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.172', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.418', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '61.000'} [2024-08-06 03:56:48,844][52795] DAMAGECOUNT value on done: 433358.0 [2024-08-06 03:56:48,845][52795] Sum rewards: 66.771, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.800', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.138', 'AMMO4': '0.144', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.202', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '58.000'} [2024-08-06 03:56:49,102][52668] DAMAGECOUNT value on done: 458458.0 [2024-08-06 03:56:49,104][52668] Sum rewards: 76.523, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.472', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon5': '0.220', 'AMMO4': '0.220', 'AMMO3': '0.233', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '65.000'} [2024-08-06 03:56:50,126][52667] DAMAGECOUNT value on done: 468614.0 [2024-08-06 03:56:50,128][52667] Sum rewards: 67.177, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.161', 'AMMO3': '0.201', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.000'} [2024-08-06 03:56:50,365][52662] DAMAGECOUNT value on done: 470126.0 [2024-08-06 03:56:50,367][52662] Sum rewards: 71.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.346', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.092', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:51,043][52669] DAMAGECOUNT value on done: 464511.0 [2024-08-06 03:56:51,043][52669] Sum rewards: 79.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.444', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.132', 'AMMO4': '0.141', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '66.000'} [2024-08-06 03:56:51,122][52671] DAMAGECOUNT value on done: 468791.0 [2024-08-06 03:56:51,124][52671] Sum rewards: 62.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.221', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '52.000'} [2024-08-06 03:56:51,819][52650] Updated weights for policy 0, policy_version 49681 (0.0018) [2024-08-06 03:56:51,940][52795] DAMAGECOUNT value on done: 422645.0 [2024-08-06 03:56:51,942][52795] Sum rewards: 66.393, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.416', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.180', 'AMMO3': '0.205', 'AMMO4': '0.260', 'weapon4': '0.332', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.500'} [2024-08-06 03:56:52,025][52668] DAMAGECOUNT value on done: 469322.0 [2024-08-06 03:56:52,026][52668] Sum rewards: 82.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.004', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO4': '0.150', 'weapon2': '0.182', 'AMMO3': '0.216', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '68.000'} [2024-08-06 03:56:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 406994944. Throughput: 0: 4358.9. Samples: 101752890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 03:56:52,794][52567] Avg episode reward: [(0, '71.470')] [2024-08-06 03:56:52,907][52667] DAMAGECOUNT value on done: 475191.0 [2024-08-06 03:56:52,908][52667] Sum rewards: 71.381, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.728', 'AMMO5': '0.011', 'AMMO2': '0.057', 'weapon5': '0.154', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO4': '0.285', 'AMMO3': '0.293', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.106', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '63.000'} [2024-08-06 03:56:52,962][52662] DAMAGECOUNT value on done: 472156.0 [2024-08-06 03:56:52,963][52662] Sum rewards: 66.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.115', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '55.000'} [2024-08-06 03:56:54,172][52671] DAMAGECOUNT value on done: 470108.0 [2024-08-06 03:56:54,176][52671] Sum rewards: 72.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:54,222][52669] DAMAGECOUNT value on done: 471775.0 [2024-08-06 03:56:54,225][52669] Sum rewards: 64.525, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.906', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.090', 'AMMO4': '0.170', 'weapon5': '0.238', 'weapon2': '0.246', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.150', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '56.000'} [2024-08-06 03:56:54,305][52668] DAMAGECOUNT value on done: 470344.0 [2024-08-06 03:56:54,307][52668] Sum rewards: 72.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.627', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.200', 'weapon5': '0.212', 'weapon4': '0.248', 'AMMO4': '0.260', 'weapon2': '0.368', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:55,154][52795] DAMAGECOUNT value on done: 437000.0 [2024-08-06 03:56:55,155][52795] Sum rewards: 82.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.817', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.082', 'weapon5': '0.120', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '67.000'} [2024-08-06 03:56:55,663][52667] DAMAGECOUNT value on done: 472398.0 [2024-08-06 03:56:55,671][52667] Sum rewards: 66.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.112', 'weapon2': '0.150', 'weapon4': '0.164', 'AMMO3': '0.212', 'AMMO4': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.420', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '56.000'} [2024-08-06 03:56:56,032][52662] DAMAGECOUNT value on done: 470110.0 [2024-08-06 03:56:56,032][52662] Sum rewards: 71.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon5': '0.180', 'weapon4': '0.200', 'AMMO3': '0.237', 'AMMO4': '0.292', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 03:56:56,758][52650] Updated weights for policy 0, policy_version 49691 (0.0013) [2024-08-06 03:56:56,875][52668] DAMAGECOUNT value on done: 459627.0 [2024-08-06 03:56:56,875][52668] Sum rewards: 58.093, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon7': '0.086', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.171', 'WEAPON7': '0.200', 'AMMO4': '0.217', 'weapon2': '0.238', 'weapon5': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.846', 'WEAPON3': '1.050', 'weapon3': '2.158', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '48.000'} [2024-08-06 03:56:57,380][52669] DAMAGECOUNT value on done: 470596.0 [2024-08-06 03:56:57,382][52669] Sum rewards: 81.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.124', 'weapon5': '0.148', 'AMMO4': '0.234', 'AMMO3': '0.239', 'weapon2': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '68.000'} [2024-08-06 03:56:57,443][52671] DAMAGECOUNT value on done: 468540.0 [2024-08-06 03:56:57,443][52671] Sum rewards: 58.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.377', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.224', 'weapon4': '0.246', 'AMMO4': '0.246', 'weapon2': '0.250', 'AMMO3': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.870', 'weapon3': '2.966', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '51.000'} [2024-08-06 03:56:57,795][52567] Fps is (10 sec: 18020.0, 60 sec: 17475.9, 300 sec: 17494.7). Total num frames: 407085056. Throughput: 0: 4358.8. Samples: 101779090. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:56:57,796][52567] Avg episode reward: [(0, '71.272')] [2024-08-06 03:56:58,269][52795] DAMAGECOUNT value on done: 430037.0 [2024-08-06 03:56:58,271][52795] Sum rewards: 67.555, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.885', 'AMMO5': '0.021', 'AMMO2': '0.057', 'AMMO3': '0.278', 'AMMO4': '0.286', 'weapon5': '0.328', 'weapon2': '0.390', 'weapon4': '0.546', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.330', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '59.000'} [2024-08-06 03:56:58,843][52662] DAMAGECOUNT value on done: 460767.0 [2024-08-06 03:56:58,843][52662] Sum rewards: 73.779, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.093', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.245', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '62.000'} [2024-08-06 03:56:58,991][52667] DAMAGECOUNT value on done: 471563.0 [2024-08-06 03:56:58,992][52667] Sum rewards: 79.840, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.379', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.150', 'weapon4': '0.198', 'weapon2': '0.230', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '68.000'} [2024-08-06 03:56:59,845][52668] DAMAGECOUNT value on done: 461660.0 [2024-08-06 03:56:59,846][52668] Sum rewards: 63.214, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.130', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.148', 'AMMO3': '0.172', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '0.950', 'weapon3': '2.824', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '51.000'} [2024-08-06 03:56:59,996][52660] DAMAGECOUNT value on done: 466124.0 [2024-08-06 03:56:59,996][52660] Sum rewards: 75.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.388', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.100', 'AMMO4': '0.124', 'weapon2': '0.144', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.360', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:00,211][52669] DAMAGECOUNT value on done: 456736.0 [2024-08-06 03:57:00,211][52669] Sum rewards: 65.646, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.044', 'AMMO4': '0.149', 'weapon5': '0.154', 'HEALTH': '0.167', 'weapon2': '0.198', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.390', 'weapon3': '3.400', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '54.000'} [2024-08-06 03:57:00,448][52671] DAMAGECOUNT value on done: 467281.0 [2024-08-06 03:57:00,448][52671] Sum rewards: 81.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.012', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '68.000'} [2024-08-06 03:57:00,515][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:57:01,082][52650] Updated weights for policy 0, policy_version 49701 (0.0011) [2024-08-06 03:57:01,368][52795] DAMAGECOUNT value on done: 427335.0 [2024-08-06 03:57:01,368][52795] Sum rewards: 82.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.042', 'weapon4': '0.046', 'AMMO4': '0.084', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '0.950', 'weapon3': '3.226', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:01,628][52667] DAMAGECOUNT value on done: 465451.0 [2024-08-06 03:57:01,629][52667] Sum rewards: 74.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.058', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon2': '0.172', 'weapon5': '0.192', 'AMMO3': '0.195', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:01,795][52662] DAMAGECOUNT value on done: 471560.0 [2024-08-06 03:57:01,799][52662] Sum rewards: 68.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.175', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.135', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.246', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:02,508][52668] DAMAGECOUNT value on done: 470050.0 [2024-08-06 03:57:02,509][52668] Sum rewards: 61.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.100', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.130', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.256', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.100', 'weapon3': '3.128', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '53.000'} [2024-08-06 03:57:02,706][52660] DAMAGECOUNT value on done: 457188.0 [2024-08-06 03:57:02,709][52660] Sum rewards: 63.643, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.702', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon5': '0.242', 'AMMO3': '0.282', 'AMMO4': '0.285', 'weapon2': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.804', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 407175168. Throughput: 0: 4364.2. Samples: 101792260. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:57:02,795][52567] Avg episode reward: [(0, '71.609')] [2024-08-06 03:57:03,300][52669] DAMAGECOUNT value on done: 468550.0 [2024-08-06 03:57:03,302][52669] Sum rewards: 64.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.172', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.196', 'AMMO3': '0.216', 'AMMO4': '0.233', 'weapon2': '0.236', 'weapon4': '0.302', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:03,589][52671] DAMAGECOUNT value on done: 476913.0 [2024-08-06 03:57:03,590][52671] Sum rewards: 66.917, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.705', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.078', 'AMMO4': '0.109', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.106', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:04,166][52667] DAMAGECOUNT value on done: 470640.0 [2024-08-06 03:57:04,167][52667] Sum rewards: 72.110, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.189', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.190', 'weapon2': '0.420', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:04,688][52795] DAMAGECOUNT value on done: 425518.0 [2024-08-06 03:57:04,690][52795] Sum rewards: 74.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.760', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.124', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:04,886][52662] DAMAGECOUNT value on done: 463745.0 [2024-08-06 03:57:04,886][52662] Sum rewards: 72.793, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.052', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:05,245][52658] DAMAGECOUNT value on done: 463508.0 [2024-08-06 03:57:05,246][52658] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.947', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.140', 'AMMO4': '0.172', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:05,293][52668] Large shaping reward 2.612 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:57:05,329][52668] DAMAGECOUNT value on done: 465208.0 [2024-08-06 03:57:05,330][52668] Sum rewards: 66.372, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.705', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:05,616][52660] DAMAGECOUNT value on done: 468412.0 [2024-08-06 03:57:05,618][52660] Sum rewards: 73.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.118', 'AMMO3': '0.188', 'AMMO4': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon5': '0.314', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '59.500'} [2024-08-06 03:57:06,107][52669] DAMAGECOUNT value on done: 470044.0 [2024-08-06 03:57:06,115][52669] Sum rewards: 68.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.856', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO4': '0.171', 'weapon5': '0.178', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:06,209][52650] Updated weights for policy 0, policy_version 49711 (0.0011) [2024-08-06 03:57:06,800][52671] DAMAGECOUNT value on done: 466841.0 [2024-08-06 03:57:06,800][52671] Sum rewards: 74.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.136', 'weapon5': '0.144', 'AMMO4': '0.195', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:07,559][52662] DAMAGECOUNT value on done: 470691.0 [2024-08-06 03:57:07,560][52662] Sum rewards: 38.339, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.700', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.116', 'weapon2': '0.140', 'WEAPON4': '0.150', 'weapon7': '0.376', 'WEAPON3': '0.750', 'weapon4': '1.122', 'weapon3': '1.814', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '9.000', 'FRAGCOUNT': '31.000'} [2024-08-06 03:57:07,795][52567] Fps is (10 sec: 17203.7, 60 sec: 17339.5, 300 sec: 17466.9). Total num frames: 407257088. Throughput: 0: 4355.2. Samples: 101818520. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:57:07,796][52567] Avg episode reward: [(0, '71.403')] [2024-08-06 03:57:07,839][52658] DAMAGECOUNT value on done: 466553.0 [2024-08-06 03:57:07,840][52658] Sum rewards: 66.608, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.286', 'WEAPON3': '1.750', 'HITCOUNT': '3.340', 'weapon3': '3.542', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:07,886][52795] DAMAGECOUNT value on done: 432806.0 [2024-08-06 03:57:07,886][52795] Sum rewards: 60.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.344', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.138', 'weapon4': '0.182', 'weapon2': '0.228', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '51.000'} [2024-08-06 03:57:08,274][52668] DAMAGECOUNT value on done: 459845.0 [2024-08-06 03:57:08,275][52668] Sum rewards: 71.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.068', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.142', 'AMMO4': '0.147', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.220', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:08,294][52820] DAMAGECOUNT value on done: 428248.0 [2024-08-06 03:57:08,294][52820] Sum rewards: 75.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.866', 'AMMO5': '0.021', 'AMMO2': '0.069', 'weapon4': '0.128', 'AMMO3': '0.204', 'weapon5': '0.288', 'AMMO4': '0.344', 'weapon2': '0.418', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:08,448][52660] DAMAGECOUNT value on done: 473544.0 [2024-08-06 03:57:08,448][52660] Sum rewards: 65.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:09,207][52669] DAMAGECOUNT value on done: 480986.0 [2024-08-06 03:57:09,209][52669] Sum rewards: 70.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.764', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:09,853][52671] DAMAGECOUNT value on done: 472153.0 [2024-08-06 03:57:09,854][52671] Sum rewards: 65.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.345', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.167', 'weapon2': '0.434', 'WEAPON3': '1.100', 'HITCOUNT': '3.290', 'weapon3': '3.396', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '52.000'} [2024-08-06 03:57:10,051][52662] DAMAGECOUNT value on done: 475939.0 [2024-08-06 03:57:10,052][52662] Sum rewards: 57.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.018', 'AMMO4': '0.025', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.566', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.182', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '47.000'} [2024-08-06 03:57:10,209][52658] DAMAGECOUNT value on done: 471440.0 [2024-08-06 03:57:10,209][52658] Sum rewards: 79.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.093', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:10,876][52650] Updated weights for policy 0, policy_version 49721 (0.0035) [2024-08-06 03:57:11,059][52795] DAMAGECOUNT value on done: 422008.0 [2024-08-06 03:57:11,061][52795] Sum rewards: 61.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.128', 'weapon5': '0.156', 'AMMO4': '0.220', 'AMMO3': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.006', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '54.000'} [2024-08-06 03:57:11,365][52820] DAMAGECOUNT value on done: 429925.0 [2024-08-06 03:57:11,367][52820] Sum rewards: 70.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.555', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.126', 'AMMO4': '0.181', 'weapon5': '0.198', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:11,481][52668] DAMAGECOUNT value on done: 455890.0 [2024-08-06 03:57:11,484][52668] Sum rewards: 80.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.118', 'weapon2': '0.142', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.474', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '69.000'} [2024-08-06 03:57:11,799][52660] DAMAGECOUNT value on done: 465548.0 [2024-08-06 03:57:11,799][52660] Sum rewards: 84.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.217', 'WEAPON3': '1.250', 'weapon3': '3.436', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '70.000'} [2024-08-06 03:57:11,842][52669] DAMAGECOUNT value on done: 470979.0 [2024-08-06 03:57:11,843][52669] Sum rewards: 70.548, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.042', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.029', 'weapon5': '0.106', 'weapon4': '0.126', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:12,794][52658] DAMAGECOUNT value on done: 469574.0 [2024-08-06 03:57:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 407347200. Throughput: 0: 4348.2. Samples: 101844620. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:57:12,795][52567] Avg episode reward: [(0, '71.157')] [2024-08-06 03:57:12,795][52658] Sum rewards: 72.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.032', 'AMMO2': '0.075', 'AMMO3': '0.197', 'weapon2': '0.228', 'weapon5': '0.312', 'AMMO4': '0.375', 'weapon4': '0.398', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:12,932][52662] DAMAGECOUNT value on done: 464243.0 [2024-08-06 03:57:12,934][52662] Sum rewards: 70.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.844', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon2': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.190', 'weapon4': '0.204', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.150', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:13,185][52671] DAMAGECOUNT value on done: 469278.0 [2024-08-06 03:57:13,186][52671] Sum rewards: 69.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon4': '0.050', 'weapon5': '0.126', 'weapon2': '0.202', 'AMMO3': '0.243', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.424', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:14,218][52795] DAMAGECOUNT value on done: 441342.0 [2024-08-06 03:57:14,218][52795] Sum rewards: 70.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.207', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:14,247][52668] DAMAGECOUNT value on done: 455829.0 [2024-08-06 03:57:14,247][52668] Sum rewards: 66.111, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.076', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.201', 'weapon4': '0.224', 'AMMO4': '0.232', 'weapon5': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:14,501][52660] DAMAGECOUNT value on done: 462719.0 [2024-08-06 03:57:14,503][52660] Sum rewards: 77.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.540', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.132', 'AMMO3': '0.213', 'weapon2': '0.232', 'AMMO4': '0.242', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:14,515][52820] DAMAGECOUNT value on done: 432227.0 [2024-08-06 03:57:14,517][52820] Sum rewards: 79.303, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.031', 'HEALTH': '0.067', 'AMMO3': '0.137', 'AMMO4': '0.157', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.332', 'weapon4': '0.672', 'WEAPON3': '0.800', 'weapon3': '2.608', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:14,730][52669] DAMAGECOUNT value on done: 468394.0 [2024-08-06 03:57:14,730][52669] Sum rewards: 58.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.157', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.098', 'weapon4': '0.160', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '48.000'} [2024-08-06 03:57:15,447][52650] Updated weights for policy 0, policy_version 49731 (0.0012) [2024-08-06 03:57:15,561][52658] DAMAGECOUNT value on done: 458166.0 [2024-08-06 03:57:15,563][52658] Sum rewards: 74.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.861', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.034', 'weapon4': '0.072', 'AMMO4': '0.121', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '64.000'} [2024-08-06 03:57:15,671][52662] DAMAGECOUNT value on done: 478486.0 [2024-08-06 03:57:15,674][52662] Sum rewards: 71.337, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.184', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '3.326', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:15,912][52671] DAMAGECOUNT value on done: 464210.0 [2024-08-06 03:57:15,913][52671] Sum rewards: 64.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.414', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon2': '0.174', 'AMMO4': '0.177', 'weapon4': '0.206', 'AMMO3': '0.207', 'weapon5': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.076', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '51.000'} [2024-08-06 03:57:17,390][52668] DAMAGECOUNT value on done: 456539.0 [2024-08-06 03:57:17,391][52668] Sum rewards: 75.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.286', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.099', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.452', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '64.000'} [2024-08-06 03:57:17,400][52795] DAMAGECOUNT value on done: 432499.0 [2024-08-06 03:57:17,400][52795] Sum rewards: 70.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.646', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'weapon4': '0.088', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.344', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:17,584][52820] DAMAGECOUNT value on done: 425534.0 [2024-08-06 03:57:17,585][52820] Sum rewards: 66.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.124', 'weapon2': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:17,629][52669] DAMAGECOUNT value on done: 471901.0 [2024-08-06 03:57:17,630][52669] Sum rewards: 69.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.830', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.066', 'AMMO4': '0.197', 'weapon2': '0.224', 'AMMO3': '0.301', 'WEAPON4': '0.400', 'weapon5': '0.448', 'WEAPON5': '0.500', 'WEAPON3': '1.850', 'weapon3': '2.956', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:17,632][52665] DAMAGECOUNT value on done: 456013.0 [2024-08-06 03:57:17,633][52665] Sum rewards: 67.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.878', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.038', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.394', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:17,724][52660] DAMAGECOUNT value on done: 462325.0 [2024-08-06 03:57:17,727][52660] Sum rewards: 59.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.682', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.092', 'AMMO3': '0.187', 'weapon5': '0.192', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.080', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '49.000'} [2024-08-06 03:57:17,794][52567] Fps is (10 sec: 17204.9, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 407429120. Throughput: 0: 4363.4. Samples: 101858030. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:57:17,794][52567] Avg episode reward: [(0, '70.704')] [2024-08-06 03:57:18,489][52658] DAMAGECOUNT value on done: 464349.0 [2024-08-06 03:57:18,490][52658] Sum rewards: 63.679, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.902', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'weapon4': '0.074', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON3': '1.100', 'weapon2': '1.118', 'weapon3': '2.616', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '51.000'} [2024-08-06 03:57:18,579][52671] DAMAGECOUNT value on done: 472221.0 [2024-08-06 03:57:18,579][52671] Sum rewards: 82.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.822', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.172', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.506', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:18,912][52662] DAMAGECOUNT value on done: 464329.0 [2024-08-06 03:57:18,916][52662] Sum rewards: 71.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.342', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.227', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:20,113][52650] Updated weights for policy 0, policy_version 49741 (0.0012) [2024-08-06 03:57:20,383][52668] DAMAGECOUNT value on done: 465366.0 [2024-08-06 03:57:20,385][52668] Sum rewards: 71.381, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.904', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.098', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'AMMO3': '0.309', 'WEAPON3': '1.850', 'weapon3': '3.260', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:20,645][52660] DAMAGECOUNT value on done: 468104.0 [2024-08-06 03:57:20,645][52660] Sum rewards: 48.382, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.045', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon2': '0.444', 'weapon4': '0.462', 'weapon7': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.120', 'HITCOUNT': '2.490', 'DAMAGECOUNT': '11.385', 'FRAGCOUNT': '40.000'} [2024-08-06 03:57:20,666][52669] DAMAGECOUNT value on done: 473090.0 [2024-08-06 03:57:20,668][52669] Sum rewards: 77.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.456', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.166', 'weapon4': '0.206', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '65.000'} [2024-08-06 03:57:20,731][52665] DAMAGECOUNT value on done: 467782.0 [2024-08-06 03:57:20,731][52665] Sum rewards: 76.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.216', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.506', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:20,732][52795] DAMAGECOUNT value on done: 423883.0 [2024-08-06 03:57:20,733][52795] Sum rewards: 63.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.407', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.084', 'AMMO4': '0.133', 'AMMO3': '0.180', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '2.936', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '52.000'} [2024-08-06 03:57:20,861][52820] DAMAGECOUNT value on done: 435085.0 [2024-08-06 03:57:20,862][52820] Sum rewards: 64.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.845', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.247', 'weapon2': '0.382', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.446', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:21,349][52658] DAMAGECOUNT value on done: 469449.0 [2024-08-06 03:57:21,349][52658] Sum rewards: 73.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.882', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.106', 'weapon4': '0.154', 'AMMO3': '0.209', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:21,585][52671] DAMAGECOUNT value on done: 474269.0 [2024-08-06 03:57:21,585][52671] Sum rewards: 72.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:21,622][52662] DAMAGECOUNT value on done: 468492.0 [2024-08-06 03:57:21,623][52662] Sum rewards: 72.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.398', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 407519232. Throughput: 0: 4355.5. Samples: 101884100. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 03:57:22,802][52567] Avg episode reward: [(0, '70.357')] [2024-08-06 03:57:22,910][52668] DAMAGECOUNT value on done: 465851.0 [2024-08-06 03:57:22,911][52668] Sum rewards: 67.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.380', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.155', 'AMMO3': '0.184', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.324', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:23,132][52660] DAMAGECOUNT value on done: 468356.0 [2024-08-06 03:57:23,133][52660] Sum rewards: 76.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.484', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon2': '0.180', 'weapon4': '0.188', 'AMMO4': '0.253', 'AMMO3': '0.254', 'weapon5': '0.264', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.040', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:23,761][52665] DAMAGECOUNT value on done: 463829.0 [2024-08-06 03:57:23,761][52665] Sum rewards: 74.678, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.382', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.048', 'weapon4': '0.122', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.324', 'WEAPON3': '1.850', 'weapon3': '3.352', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:23,899][52795] DAMAGECOUNT value on done: 433984.0 [2024-08-06 03:57:23,900][52795] Sum rewards: 77.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.835', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon4': '0.098', 'weapon5': '0.114', 'weapon2': '0.208', 'AMMO3': '0.221', 'AMMO4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '65.000'} [2024-08-06 03:57:23,916][52820] DAMAGECOUNT value on done: 425435.0 [2024-08-06 03:57:23,916][52820] Sum rewards: 72.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.246', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:23,960][52658] DAMAGECOUNT value on done: 461721.0 [2024-08-06 03:57:23,962][52658] Sum rewards: 74.933, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.148', 'weapon5': '0.174', 'weapon4': '0.180', 'AMMO3': '0.209', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 03:57:24,390][52662] DAMAGECOUNT value on done: 466233.0 [2024-08-06 03:57:24,393][52662] Sum rewards: 75.936, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.216', 'weapon2': '0.422', 'WEAPON3': '0.950', 'weapon3': '3.028', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:24,700][52671] DAMAGECOUNT value on done: 468638.0 [2024-08-06 03:57:24,700][52671] Sum rewards: 72.543, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.386', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.155', 'weapon5': '0.168', 'AMMO4': '0.178', 'weapon4': '0.204', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.116', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:25,259][52650] Updated weights for policy 0, policy_version 49751 (0.0018) [2024-08-06 03:57:25,893][52668] DAMAGECOUNT value on done: 464016.0 [2024-08-06 03:57:25,894][52668] Sum rewards: 63.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.555', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.210', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.692', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '53.000'} [2024-08-06 03:57:26,188][52660] DAMAGECOUNT value on done: 461718.0 [2024-08-06 03:57:26,190][52660] Sum rewards: 66.100, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.792', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.238', 'weapon5': '0.252', 'AMMO4': '0.276', 'AMMO3': '0.278', 'weapon2': '0.288', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.858', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.500'} [2024-08-06 03:57:26,191][52665] DAMAGECOUNT value on done: 459886.0 [2024-08-06 03:57:26,192][52665] Sum rewards: 66.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.628', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.152', 'AMMO4': '0.173', 'weapon2': '0.194', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.306', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:26,854][52658] DAMAGECOUNT value on done: 475621.0 [2024-08-06 03:57:26,854][52658] Sum rewards: 70.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.938', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.149', 'weapon5': '0.158', 'weapon2': '0.180', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.330', 'weapon3': '3.352', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '62.000'} [2024-08-06 03:57:26,920][52820] DAMAGECOUNT value on done: 428178.0 [2024-08-06 03:57:26,921][52820] Sum rewards: 64.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.483', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.186', 'weapon2': '0.216', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.020', 'weapon3': '3.304', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '53.000'} [2024-08-06 03:57:26,959][52662] DAMAGECOUNT value on done: 473793.0 [2024-08-06 03:57:26,959][52662] Sum rewards: 66.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.062', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.418', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:27,047][52795] DAMAGECOUNT value on done: 434939.0 [2024-08-06 03:57:27,049][52795] Sum rewards: 58.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.038', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon7': '0.074', 'weapon5': '0.086', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.756', 'WEAPON3': '0.900', 'weapon3': '2.630', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '13.740', 'FRAGCOUNT': '48.000'} [2024-08-06 03:57:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 407601152. Throughput: 0: 4366.0. Samples: 101910520. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:57:27,794][52567] Avg episode reward: [(0, '69.912')] [2024-08-06 03:57:27,796][52671] DAMAGECOUNT value on done: 474775.0 [2024-08-06 03:57:27,802][52671] Sum rewards: 72.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.194', 'AMMO3': '0.202', 'weapon2': '0.270', 'weapon4': '0.290', 'AMMO4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:28,575][52665] DAMAGECOUNT value on done: 452203.0 [2024-08-06 03:57:28,575][52665] Sum rewards: 75.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.172', 'weapon2': '0.248', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.282', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:29,111][52668] DAMAGECOUNT value on done: 470317.0 [2024-08-06 03:57:29,111][52668] Sum rewards: 58.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.104', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon4': '0.196', 'AMMO3': '0.205', 'weapon5': '0.234', 'AMMO4': '0.260', 'weapon2': '0.334', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.906', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '51.000'} [2024-08-06 03:57:29,308][52660] DAMAGECOUNT value on done: 472741.0 [2024-08-06 03:57:29,308][52660] Sum rewards: 68.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.742', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.076', 'weapon5': '0.140', 'AMMO4': '0.143', 'AMMO3': '0.203', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.298', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:29,451][52650] Updated weights for policy 0, policy_version 49761 (0.0025) [2024-08-06 03:57:29,686][52658] DAMAGECOUNT value on done: 465369.0 [2024-08-06 03:57:29,690][52658] Sum rewards: 64.094, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.304', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.424', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:30,090][52820] DAMAGECOUNT value on done: 433166.0 [2024-08-06 03:57:30,091][52820] Sum rewards: 77.992, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.114', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.318', 'WEAPON3': '1.900', 'weapon3': '3.304', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '68.000'} [2024-08-06 03:57:30,360][52662] DAMAGECOUNT value on done: 467634.0 [2024-08-06 03:57:30,363][52662] Sum rewards: 90.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.135', 'weapon5': '0.136', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.399', 'FRAGCOUNT': '76.000'} [2024-08-06 03:57:30,620][52671] DAMAGECOUNT value on done: 468631.0 [2024-08-06 03:57:30,623][52671] Sum rewards: 75.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon4': '0.040', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:31,149][52665] DAMAGECOUNT value on done: 455855.0 [2024-08-06 03:57:31,150][52665] Sum rewards: 83.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.043', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.066', 'AMMO4': '0.174', 'weapon5': '0.194', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.108', 'FRAGCOUNT': '68.000'} [2024-08-06 03:57:32,092][52668] DAMAGECOUNT value on done: 464498.0 [2024-08-06 03:57:32,093][52668] Sum rewards: 82.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.190', 'weapon2': '0.214', 'WEAPON3': '1.200', 'HITCOUNT': '3.420', 'weapon3': '3.428', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:32,356][52658] DAMAGECOUNT value on done: 477150.0 [2024-08-06 03:57:32,357][52658] Sum rewards: 71.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.532', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.074', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '62.000'} [2024-08-06 03:57:32,477][52660] DAMAGECOUNT value on done: 458350.0 [2024-08-06 03:57:32,477][52660] Sum rewards: 62.438, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.895', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.188', 'AMMO4': '0.209', 'weapon5': '0.224', 'AMMO3': '0.267', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.846', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.000'} [2024-08-06 03:57:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 407699456. Throughput: 0: 4365.6. Samples: 101923420. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:57:32,802][52567] Avg episode reward: [(0, '70.265')] [2024-08-06 03:57:33,116][52820] DAMAGECOUNT value on done: 428964.0 [2024-08-06 03:57:33,116][52820] Sum rewards: 78.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.073', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.090', 'weapon4': '0.106', 'AMMO4': '0.110', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '66.000'} [2024-08-06 03:57:33,319][52662] DAMAGECOUNT value on done: 477202.0 [2024-08-06 03:57:33,322][52662] Sum rewards: 67.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.223', 'weapon4': '0.256', 'weapon5': '0.270', 'AMMO4': '0.292', 'weapon2': '0.420', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:33,739][52671] DAMAGECOUNT value on done: 457330.0 [2024-08-06 03:57:33,739][52671] Sum rewards: 56.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.191', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.094', 'weapon5': '0.126', 'AMMO3': '0.244', 'AMMO4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.450', 'HITCOUNT': '2.710', 'weapon3': '3.166', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '50.000'} [2024-08-06 03:57:33,920][52665] DAMAGECOUNT value on done: 458960.0 [2024-08-06 03:57:33,921][52665] Sum rewards: 67.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.453', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon4': '0.208', 'AMMO3': '0.223', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:34,374][52650] Updated weights for policy 0, policy_version 49771 (0.0012) [2024-08-06 03:57:35,157][52658] DAMAGECOUNT value on done: 457908.0 [2024-08-06 03:57:35,159][52658] Sum rewards: 69.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.405', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.108', 'weapon4': '0.136', 'weapon2': '0.174', 'AMMO3': '0.217', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.332', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:35,409][52660] DAMAGECOUNT value on done: 464003.0 [2024-08-06 03:57:35,413][52660] Sum rewards: 67.083, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.925', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.096', 'weapon5': '0.198', 'AMMO4': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:36,235][52820] DAMAGECOUNT value on done: 438750.0 [2024-08-06 03:57:36,236][52820] Sum rewards: 81.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '65.000'} [2024-08-06 03:57:36,359][52662] DAMAGECOUNT value on done: 471543.0 [2024-08-06 03:57:36,361][52662] Sum rewards: 60.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.485', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.318', 'weapon4': '0.406', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.022', 'DAMAGECOUNT': '14.160', 'FRAGCOUNT': '50.000'} [2024-08-06 03:57:36,751][52671] DAMAGECOUNT value on done: 476185.0 [2024-08-06 03:57:36,753][52671] Sum rewards: 79.598, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.060', 'weapon4': '0.066', 'HEALTH': '0.075', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.364', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:36,990][52665] DAMAGECOUNT value on done: 461342.0 [2024-08-06 03:57:36,990][52665] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.162', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.340', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:37,612][52658] DAMAGECOUNT value on done: 468249.0 [2024-08-06 03:57:37,616][52658] Sum rewards: 77.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon2': '0.114', 'weapon5': '0.142', 'AMMO4': '0.153', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 407781376. Throughput: 0: 4374.4. Samples: 101949740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:57:37,794][52567] Avg episode reward: [(0, '70.277')] [2024-08-06 03:57:38,563][52660] DAMAGECOUNT value on done: 474371.0 [2024-08-06 03:57:38,565][52660] Sum rewards: 55.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.778', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO4': '0.214', 'weapon5': '0.236', 'AMMO3': '0.251', 'weapon2': '0.262', 'weapon4': '0.336', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '48.000'} [2024-08-06 03:57:39,002][52650] Updated weights for policy 0, policy_version 49781 (0.0011) [2024-08-06 03:57:39,201][52671] DAMAGECOUNT value on done: 473197.0 [2024-08-06 03:57:39,203][52671] Sum rewards: 79.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.146', 'AMMO3': '0.219', 'WEAPON3': '1.350', 'HITCOUNT': '3.520', 'weapon3': '3.650', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '65.000'} [2024-08-06 03:57:39,349][52820] DAMAGECOUNT value on done: 427706.0 [2024-08-06 03:57:39,350][52820] Sum rewards: 69.180, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.975', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.182', 'AMMO4': '0.211', 'AMMO3': '0.221', 'weapon4': '0.378', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.744', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:39,514][52662] DAMAGECOUNT value on done: 465443.0 [2024-08-06 03:57:39,515][52662] Sum rewards: 78.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.838', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.200', 'weapon2': '0.280', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'weapon3': '3.276', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:40,164][52665] DAMAGECOUNT value on done: 467821.0 [2024-08-06 03:57:40,166][52665] Sum rewards: 69.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.016', 'AMMO2': '0.064', 'AMMO3': '0.206', 'weapon5': '0.216', 'weapon4': '0.250', 'AMMO4': '0.322', 'weapon2': '0.484', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:40,741][52658] DAMAGECOUNT value on done: 463804.0 [2024-08-06 03:57:40,742][52658] Sum rewards: 67.826, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.818', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.126', 'weapon5': '0.232', 'AMMO3': '0.267', 'AMMO4': '0.299', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.966', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:41,729][52660] DAMAGECOUNT value on done: 479708.0 [2024-08-06 03:57:41,730][52660] Sum rewards: 64.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.118', 'AMMO3': '0.216', 'weapon2': '0.222', 'weapon5': '0.228', 'AMMO4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.178', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:41,839][52820] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 03:57:41,884][52671] DAMAGECOUNT value on done: 475033.0 [2024-08-06 03:57:41,885][52671] Sum rewards: 75.666, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.579', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon4': '0.108', 'AMMO3': '0.186', 'AMMO4': '0.205', 'weapon5': '0.212', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:42,343][52662] DAMAGECOUNT value on done: 466142.0 [2024-08-06 03:57:42,344][52662] Sum rewards: 73.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.536', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.096', 'AMMO4': '0.151', 'AMMO3': '0.200', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:42,452][52820] DAMAGECOUNT value on done: 432534.0 [2024-08-06 03:57:42,452][52820] Sum rewards: 65.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO4': '0.230', 'AMMO3': '0.252', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.552', 'WEAPON3': '1.500', 'weapon3': '2.720', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:42,674][52794] DAMAGECOUNT value on done: 468808.0 [2024-08-06 03:57:42,676][52794] Sum rewards: 64.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.938', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.146', 'weapon5': '0.160', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.122', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '52.000'} [2024-08-06 03:57:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 407871488. Throughput: 0: 4376.4. Samples: 101976020. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:57:42,794][52567] Avg episode reward: [(0, '70.145')] [2024-08-06 03:57:43,219][52665] DAMAGECOUNT value on done: 460994.0 [2024-08-06 03:57:43,220][52665] Sum rewards: 70.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.154', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.080', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:43,616][52658] DAMAGECOUNT value on done: 464390.0 [2024-08-06 03:57:43,617][52658] Sum rewards: 77.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.214', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.124', 'weapon2': '0.190', 'weapon4': '0.218', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '64.000'} [2024-08-06 03:57:43,826][52650] Updated weights for policy 0, policy_version 49791 (0.0012) [2024-08-06 03:57:44,619][52660] DAMAGECOUNT value on done: 462907.0 [2024-08-06 03:57:44,619][52660] Sum rewards: 78.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.104', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '64.000'} [2024-08-06 03:57:44,904][52671] DAMAGECOUNT value on done: 471582.0 [2024-08-06 03:57:44,905][52671] Sum rewards: 81.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.115', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.072', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.216', 'WEAPON3': '1.350', 'weapon3': '3.480', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:44,918][52662] DAMAGECOUNT value on done: 463275.0 [2024-08-06 03:57:44,921][52662] Sum rewards: 83.996, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.445', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.044', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.302', 'weapon2': '0.308', 'WEAPON3': '1.850', 'weapon3': '3.350', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '74.000'} [2024-08-06 03:57:45,305][52794] DAMAGECOUNT value on done: 471976.0 [2024-08-06 03:57:45,305][52794] Sum rewards: 67.662, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.158', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '54.000'} [2024-08-06 03:57:45,634][52820] DAMAGECOUNT value on done: 437042.0 [2024-08-06 03:57:45,636][52820] Sum rewards: 68.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.354', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon5': '0.206', 'AMMO3': '0.223', 'AMMO4': '0.316', 'weapon2': '0.374', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.712', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:46,142][52665] DAMAGECOUNT value on done: 469592.0 [2024-08-06 03:57:46,142][52665] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.033', 'weapon4': '0.036', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '60.000'} [2024-08-06 03:57:46,615][52658] DAMAGECOUNT value on done: 459779.0 [2024-08-06 03:57:46,615][52658] Sum rewards: 69.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.262', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.148', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:47,357][52660] DAMAGECOUNT value on done: 469616.0 [2024-08-06 03:57:47,357][52660] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.140', 'AMMO4': '0.191', 'AMMO3': '0.198', 'weapon5': '0.268', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '52.000'} [2024-08-06 03:57:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 407953408. Throughput: 0: 4374.7. Samples: 101989120. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:57:47,795][52567] Avg episode reward: [(0, '70.805')] [2024-08-06 03:57:47,963][52671] DAMAGECOUNT value on done: 466126.0 [2024-08-06 03:57:47,965][52671] Sum rewards: 63.488, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.124', 'AMMO4': '0.160', 'weapon5': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.110', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:48,229][52650] Updated weights for policy 0, policy_version 49801 (0.0012) [2024-08-06 03:57:48,478][52794] DAMAGECOUNT value on done: 470771.0 [2024-08-06 03:57:48,480][52794] Sum rewards: 65.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.569', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.086', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.201', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.182', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '55.000'} [2024-08-06 03:57:48,788][52820] DAMAGECOUNT value on done: 432252.0 [2024-08-06 03:57:48,789][52820] Sum rewards: 70.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.102', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '58.000'} [2024-08-06 03:57:48,887][52665] DAMAGECOUNT value on done: 465145.0 [2024-08-06 03:57:48,888][52665] Sum rewards: 85.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.501', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.038', 'AMMO4': '0.096', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.390', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '70.000'} [2024-08-06 03:57:49,647][52658] DAMAGECOUNT value on done: 474021.0 [2024-08-06 03:57:49,647][52658] Sum rewards: 67.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.161', 'weapon5': '0.178', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.692', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '54.000'} [2024-08-06 03:57:50,601][52660] DAMAGECOUNT value on done: 462519.0 [2024-08-06 03:57:50,602][52660] Sum rewards: 62.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.139', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '52.000'} [2024-08-06 03:57:51,286][52794] DAMAGECOUNT value on done: 464144.0 [2024-08-06 03:57:51,287][52794] Sum rewards: 72.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon4': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:51,985][52820] DAMAGECOUNT value on done: 437639.0 [2024-08-06 03:57:51,986][52820] Sum rewards: 73.806, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.517', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.132', 'AMMO3': '0.182', 'weapon4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:52,000][52665] DAMAGECOUNT value on done: 462194.0 [2024-08-06 03:57:52,000][52665] Sum rewards: 78.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.926', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.142', 'AMMO4': '0.153', 'AMMO3': '0.212', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.284', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '65.000'} [2024-08-06 03:57:52,005][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:57:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 408043520. Throughput: 0: 4368.1. Samples: 102015080. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 03:57:52,802][52567] Avg episode reward: [(0, '71.029')] [2024-08-06 03:57:52,797][52658] DAMAGECOUNT value on done: 465601.0 [2024-08-06 03:57:52,804][52658] Sum rewards: 66.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.678', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.118', 'weapon4': '0.126', 'AMMO4': '0.168', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.114', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:53,242][52650] Updated weights for policy 0, policy_version 49811 (0.0035) [2024-08-06 03:57:53,736][52660] DAMAGECOUNT value on done: 465016.0 [2024-08-06 03:57:53,736][52660] Sum rewards: 73.265, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.155', 'AMMO4': '0.180', 'weapon4': '0.192', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.410', 'HEALTH': '0.469', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '57.000'} [2024-08-06 03:57:54,050][52794] DAMAGECOUNT value on done: 465282.0 [2024-08-06 03:57:54,051][52794] Sum rewards: 75.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.342', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.092', 'AMMO4': '0.149', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '65.000'} [2024-08-06 03:57:54,793][52665] DAMAGECOUNT value on done: 459500.0 [2024-08-06 03:57:54,794][52665] Sum rewards: 64.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.802', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.127', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '54.000'} [2024-08-06 03:57:55,198][52820] DAMAGECOUNT value on done: 431054.0 [2024-08-06 03:57:55,199][52820] Sum rewards: 76.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.226', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO3': '0.228', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '63.000'} [2024-08-06 03:57:55,758][52811] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:57:55,828][52658] DAMAGECOUNT value on done: 468242.0 [2024-08-06 03:57:55,828][52658] Sum rewards: 74.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.436', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.129', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:56,395][52660] DAMAGECOUNT value on done: 459951.0 [2024-08-06 03:57:56,396][52660] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.192', 'weapon4': '0.196', 'weapon2': '0.222', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.180', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '59.000'} [2024-08-06 03:57:56,573][52794] DAMAGECOUNT value on done: 469696.0 [2024-08-06 03:57:56,574][52794] Sum rewards: 71.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.364', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.245', 'weapon2': '0.270', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.356', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '61.000'} [2024-08-06 03:57:57,697][52650] Updated weights for policy 0, policy_version 49821 (0.0013) [2024-08-06 03:57:57,786][52665] DAMAGECOUNT value on done: 463643.0 [2024-08-06 03:57:57,786][52665] Sum rewards: 66.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.126', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.364', 'WEAPON3': '1.650', 'weapon3': '3.216', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '56.000'} [2024-08-06 03:57:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.7, 300 sec: 17494.8). Total num frames: 408133632. Throughput: 0: 4369.4. Samples: 102041240. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:57:57,794][52567] Avg episode reward: [(0, '70.913')] [2024-08-06 03:57:58,236][52820] DAMAGECOUNT value on done: 433089.0 [2024-08-06 03:57:58,237][52820] Sum rewards: 68.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.128', 'weapon5': '0.178', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '58.500'} [2024-08-06 03:57:58,594][52658] DAMAGECOUNT value on done: 471727.0 [2024-08-06 03:57:58,594][52658] Sum rewards: 74.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.096', 'AMMO4': '0.150', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '62.000'} [2024-08-06 03:57:59,388][52794] DAMAGECOUNT value on done: 474233.0 [2024-08-06 03:57:59,391][52794] Sum rewards: 80.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.188', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.074', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '67.000'} [2024-08-06 03:57:59,829][52614] Signal inference workers to stop experience collection... (9050 times) [2024-08-06 03:57:59,830][52614] Signal inference workers to resume experience collection... (9050 times) [2024-08-06 03:57:59,899][52650] InferenceWorker_p0-w0: stopping experience collection (9050 times) [2024-08-06 03:57:59,900][52650] InferenceWorker_p0-w0: resuming experience collection (9050 times) [2024-08-06 03:58:00,109][52670] Large shaping reward -2.514 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.024, 8.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 03:58:00,560][52665] DAMAGECOUNT value on done: 457759.0 [2024-08-06 03:58:00,562][52665] Sum rewards: 62.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.138', 'AMMO4': '0.202', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.198', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '53.000'} [2024-08-06 03:58:01,332][52659] DAMAGECOUNT value on done: 468234.0 [2024-08-06 03:58:01,333][52659] Sum rewards: 72.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.510', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.140', 'weapon2': '0.182', 'AMMO3': '0.205', 'AMMO4': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.370', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '61.000'} [2024-08-06 03:58:01,368][52820] DAMAGECOUNT value on done: 443994.0 [2024-08-06 03:58:01,369][52820] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.958', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.042', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon5': '0.238', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '50.500'} [2024-08-06 03:58:02,390][52794] DAMAGECOUNT value on done: 463172.0 [2024-08-06 03:58:02,392][52794] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 03:58:02,670][52650] Updated weights for policy 0, policy_version 49831 (0.0014) [2024-08-06 03:58:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 408215552. Throughput: 0: 4356.2. Samples: 102054060. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:58:02,794][52567] Avg episode reward: [(0, '70.754')] [2024-08-06 03:58:03,532][52665] DAMAGECOUNT value on done: 458119.0 [2024-08-06 03:58:03,532][52665] Sum rewards: 76.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.005', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.061', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '61.000'} [2024-08-06 03:58:03,692][52803] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:58:04,484][52820] DAMAGECOUNT value on done: 443519.0 [2024-08-06 03:58:04,485][52820] Sum rewards: 65.686, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.470', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.118', 'weapon5': '0.264', 'AMMO4': '0.275', 'AMMO3': '0.292', 'weapon2': '0.340', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.926', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:04,502][52659] DAMAGECOUNT value on done: 467540.0 [2024-08-06 03:58:04,502][52659] Sum rewards: 74.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.549', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.098', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.219', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:05,033][52794] DAMAGECOUNT value on done: 470992.0 [2024-08-06 03:58:05,033][52794] Sum rewards: 65.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.484', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.060', 'weapon5': '0.172', 'AMMO4': '0.229', 'AMMO3': '0.238', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.268', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:06,326][52665] DAMAGECOUNT value on done: 457991.0 [2024-08-06 03:58:06,328][52665] Sum rewards: 64.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.105', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.266', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.370', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:06,961][52650] Updated weights for policy 0, policy_version 49841 (0.0036) [2024-08-06 03:58:07,582][52820] DAMAGECOUNT value on done: 429299.0 [2024-08-06 03:58:07,582][52820] Sum rewards: 66.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.184', 'AMMO3': '0.194', 'weapon4': '0.206', 'AMMO4': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.231', 'FRAGCOUNT': '53.000'} [2024-08-06 03:58:07,595][52659] DAMAGECOUNT value on done: 471860.0 [2024-08-06 03:58:07,596][52659] Sum rewards: 71.576, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.126', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.076', 'AMMO4': '0.121', 'weapon5': '0.218', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:07,645][52794] DAMAGECOUNT value on done: 467151.0 [2024-08-06 03:58:07,646][52794] Sum rewards: 56.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.226', 'AMMO3': '0.233', 'weapon2': '0.306', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.268', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '49.000'} [2024-08-06 03:58:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.5, 300 sec: 17494.8). Total num frames: 408305664. Throughput: 0: 4364.7. Samples: 102080510. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:58:07,795][52567] Avg episode reward: [(0, '70.623')] [2024-08-06 03:58:09,206][52665] DAMAGECOUNT value on done: 458099.0 [2024-08-06 03:58:09,209][52665] Sum rewards: 71.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.070', 'AMMO5': '0.028', 'AMMO2': '0.069', 'weapon4': '0.146', 'weapon5': '0.238', 'AMMO3': '0.264', 'weapon2': '0.292', 'AMMO4': '0.343', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.700', 'weapon3': '2.974', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '61.000'} [2024-08-06 03:58:09,525][52647] DAMAGECOUNT value on done: 492439.0 [2024-08-06 03:58:09,525][52647] Sum rewards: 78.129, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.170', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.295', 'WEAPON3': '1.800', 'weapon3': '3.400', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '69.000'} [2024-08-06 03:58:10,517][52794] DAMAGECOUNT value on done: 463793.0 [2024-08-06 03:58:10,518][52794] Sum rewards: 71.103, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.378', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'weapon2': '0.190', 'weapon4': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.289', 'WEAPON3': '1.800', 'weapon3': '3.280', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:10,954][52659] DAMAGECOUNT value on done: 467541.0 [2024-08-06 03:58:10,955][52659] Sum rewards: 69.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.310', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.132', 'AMMO4': '0.204', 'AMMO3': '0.214', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:11,262][52664] DAMAGECOUNT value on done: 485699.0 [2024-08-06 03:58:11,262][52664] Sum rewards: 68.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.065', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.076', 'weapon5': '0.210', 'AMMO3': '0.225', 'AMMO4': '0.292', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '58.500'} [2024-08-06 03:58:11,822][52650] Updated weights for policy 0, policy_version 49851 (0.0027) [2024-08-06 03:58:12,114][52647] DAMAGECOUNT value on done: 493326.0 [2024-08-06 03:58:12,116][52647] Sum rewards: 67.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.688', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.112', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '56.000'} [2024-08-06 03:58:12,319][52665] DAMAGECOUNT value on done: 463078.0 [2024-08-06 03:58:12,319][52665] Sum rewards: 68.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'weapon4': '0.106', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 408395776. Throughput: 0: 4357.6. Samples: 102106610. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:58:12,794][52567] Avg episode reward: [(0, '70.808')] [2024-08-06 03:58:13,662][52794] DAMAGECOUNT value on done: 472788.0 [2024-08-06 03:58:13,662][52794] Sum rewards: 72.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.661', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.080', 'weapon5': '0.220', 'AMMO3': '0.230', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 03:58:13,990][52664] DAMAGECOUNT value on done: 491360.0 [2024-08-06 03:58:13,991][52664] Sum rewards: 73.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.100', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.064', 'weapon4': '0.082', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.384', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '61.500'} [2024-08-06 03:58:14,091][52659] DAMAGECOUNT value on done: 465416.0 [2024-08-06 03:58:14,092][52659] Sum rewards: 84.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.292', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.058', 'weapon4': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.188', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.500', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '68.000'} [2024-08-06 03:58:14,129][52649] DAMAGECOUNT value on done: 452071.0 [2024-08-06 03:58:14,130][52649] Sum rewards: 79.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.502', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.082', 'weapon5': '0.208', 'AMMO3': '0.233', 'AMMO4': '0.235', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '65.000'} [2024-08-06 03:58:14,517][52647] DAMAGECOUNT value on done: 489706.0 [2024-08-06 03:58:14,517][52647] Sum rewards: 63.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.392', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:16,252][52650] Updated weights for policy 0, policy_version 49861 (0.0011) [2024-08-06 03:58:16,515][52794] DAMAGECOUNT value on done: 460563.0 [2024-08-06 03:58:16,517][52794] Sum rewards: 75.018, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.818', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.080', 'AMMO4': '0.125', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'HITCOUNT': '3.400', 'weapon3': '3.428', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '66.000'} [2024-08-06 03:58:16,623][52664] DAMAGECOUNT value on done: 491808.0 [2024-08-06 03:58:16,624][52664] Sum rewards: 86.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.040', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.042', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.554', 'WEAPON3': '0.950', 'weapon3': '3.170', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '69.000'} [2024-08-06 03:58:17,150][52647] DAMAGECOUNT value on done: 500570.0 [2024-08-06 03:58:17,150][52647] Sum rewards: 83.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.126', 'weapon4': '0.142', 'AMMO3': '0.187', 'weapon2': '0.204', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '68.000'} [2024-08-06 03:58:17,210][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:58:17,213][52649] DAMAGECOUNT value on done: 446098.0 [2024-08-06 03:58:17,215][52649] Sum rewards: 76.917, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.140', 'weapon5': '0.140', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '67.000'} [2024-08-06 03:58:17,352][52659] DAMAGECOUNT value on done: 470046.0 [2024-08-06 03:58:17,352][52659] Sum rewards: 73.725, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.252', 'AMMO3': '0.284', 'WEAPON3': '1.600', 'weapon3': '3.418', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '65.000'} [2024-08-06 03:58:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 408477696. Throughput: 0: 4366.9. Samples: 102119930. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:58:17,802][52567] Avg episode reward: [(0, '71.219')] [2024-08-06 03:58:19,298][52794] DAMAGECOUNT value on done: 480828.0 [2024-08-06 03:58:19,299][52794] Sum rewards: 66.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.192', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.154', 'weapon4': '0.196', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:19,702][52664] DAMAGECOUNT value on done: 481589.0 [2024-08-06 03:58:19,702][52664] Sum rewards: 63.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.331', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.274', 'weapon2': '0.280', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '53.000'} [2024-08-06 03:58:19,873][52649] DAMAGECOUNT value on done: 460729.0 [2024-08-06 03:58:19,874][52649] Sum rewards: 79.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.528', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.126', 'weapon5': '0.126', 'weapon2': '0.228', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.328', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '66.000'} [2024-08-06 03:58:20,274][52647] DAMAGECOUNT value on done: 497418.0 [2024-08-06 03:58:20,277][52647] Sum rewards: 81.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '68.000'} [2024-08-06 03:58:20,539][52659] DAMAGECOUNT value on done: 467611.0 [2024-08-06 03:58:20,542][52659] Sum rewards: 79.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:21,286][52650] Updated weights for policy 0, policy_version 49871 (0.0014) [2024-08-06 03:58:21,733][52666] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:58:21,939][52794] DAMAGECOUNT value on done: 461659.0 [2024-08-06 03:58:21,941][52794] Sum rewards: 58.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.438', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon4': '0.120', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '52.000'} [2024-08-06 03:58:22,363][52649] DAMAGECOUNT value on done: 452368.0 [2024-08-06 03:58:22,364][52649] Sum rewards: 65.500, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.146', 'weapon2': '0.256', 'WEAPON3': '1.000', 'HITCOUNT': '2.950', 'weapon3': '3.514', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '53.000'} [2024-08-06 03:58:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 408567808. Throughput: 0: 4362.4. Samples: 102146050. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 03:58:22,802][52567] Avg episode reward: [(0, '71.505')] [2024-08-06 03:58:22,941][52664] DAMAGECOUNT value on done: 489298.0 [2024-08-06 03:58:22,941][52664] Sum rewards: 76.836, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.190', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'HEALTH': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:23,431][52647] DAMAGECOUNT value on done: 495601.0 [2024-08-06 03:58:23,432][52647] Sum rewards: 72.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.140', 'AMMO4': '0.153', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '60.000'} [2024-08-06 03:58:23,678][52659] DAMAGECOUNT value on done: 466954.0 [2024-08-06 03:58:23,679][52659] Sum rewards: 65.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.030', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.042', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.262', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.490', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:24,087][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:58:25,208][52649] DAMAGECOUNT value on done: 446082.0 [2024-08-06 03:58:25,211][52649] Sum rewards: 70.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.835', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.118', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '58.000'} [2024-08-06 03:58:25,262][52794] DAMAGECOUNT value on done: 478133.0 [2024-08-06 03:58:25,263][52794] Sum rewards: 57.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.044', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.158', 'AMMO4': '0.202', 'AMMO3': '0.221', 'weapon4': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '2.926', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '49.000'} [2024-08-06 03:58:25,635][52650] Updated weights for policy 0, policy_version 49881 (0.0024) [2024-08-06 03:58:25,651][52664] DAMAGECOUNT value on done: 485931.0 [2024-08-06 03:58:25,653][52664] Sum rewards: 80.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.920', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.032', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '66.000'} [2024-08-06 03:58:25,900][52647] DAMAGECOUNT value on done: 493815.0 [2024-08-06 03:58:25,901][52647] Sum rewards: 58.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.140', 'weapon5': '0.186', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.350', 'HITCOUNT': '2.740', 'weapon3': '3.104', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '51.000'} [2024-08-06 03:58:26,589][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:58:26,786][52659] DAMAGECOUNT value on done: 474300.0 [2024-08-06 03:58:26,788][52659] Sum rewards: 73.543, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.375', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.163', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 408657920. Throughput: 0: 4362.9. Samples: 102172350. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 03:58:27,802][52567] Avg episode reward: [(0, '71.111')] [2024-08-06 03:58:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049885_408657920.pth... [2024-08-06 03:58:27,894][52649] DAMAGECOUNT value on done: 458510.0 [2024-08-06 03:58:27,895][52649] Sum rewards: 80.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.825', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.136', 'AMMO4': '0.152', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '66.000'} [2024-08-06 03:58:27,950][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049373_404463616.pth [2024-08-06 03:58:28,480][52794] DAMAGECOUNT value on done: 469461.0 [2024-08-06 03:58:28,482][52794] Sum rewards: 78.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:28,582][52664] DAMAGECOUNT value on done: 484318.0 [2024-08-06 03:58:28,582][52664] Sum rewards: 79.193, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.610', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.148', 'weapon4': '0.186', 'AMMO4': '0.241', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.038', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '68.000'} [2024-08-06 03:58:28,857][52647] DAMAGECOUNT value on done: 487820.0 [2024-08-06 03:58:28,857][52647] Sum rewards: 71.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.102', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.216', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 03:58:29,745][52659] DAMAGECOUNT value on done: 478473.0 [2024-08-06 03:58:29,746][52659] Sum rewards: 74.962, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.008', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.098', 'AMMO4': '0.195', 'weapon2': '0.220', 'AMMO3': '0.234', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 03:58:30,523][52650] Updated weights for policy 0, policy_version 49891 (0.0023) [2024-08-06 03:58:30,694][52649] DAMAGECOUNT value on done: 453753.0 [2024-08-06 03:58:30,694][52649] Sum rewards: 70.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.055', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.182', 'AMMO3': '0.197', 'AMMO4': '0.255', 'weapon4': '0.392', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.700', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:31,336][52667] Large shaping reward 3.351 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.3, 100.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:58:31,543][52794] DAMAGECOUNT value on done: 473106.0 [2024-08-06 03:58:31,543][52794] Sum rewards: 71.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.627', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '60.000'} [2024-08-06 03:58:31,771][52664] DAMAGECOUNT value on done: 479307.0 [2024-08-06 03:58:31,771][52664] Sum rewards: 66.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.874', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.182', 'weapon4': '0.202', 'AMMO4': '0.257', 'weapon5': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '2.580', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '54.000'} [2024-08-06 03:58:31,861][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:58:31,929][52647] DAMAGECOUNT value on done: 498243.0 [2024-08-06 03:58:31,929][52647] Sum rewards: 72.540, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO2': '0.011', 'AMMO5': '0.011', 'AMMO4': '0.053', 'weapon5': '0.134', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.864', 'WEAPON3': '1.050', 'weapon3': '2.658', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '57.000'} [2024-08-06 03:58:32,316][52659] DAMAGECOUNT value on done: 467829.0 [2024-08-06 03:58:32,317][52659] Sum rewards: 81.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.210', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.150', 'AMMO4': '0.186', 'weapon2': '0.202', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '68.000'} [2024-08-06 03:58:32,347][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 03:58:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 408739840. Throughput: 0: 4356.9. Samples: 102185180. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 03:58:32,795][52567] Avg episode reward: [(0, '71.548')] [2024-08-06 03:58:33,481][52649] DAMAGECOUNT value on done: 458439.0 [2024-08-06 03:58:33,490][52649] Sum rewards: 57.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.172', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.146', 'weapon5': '0.166', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '3.126', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 03:58:34,277][52664] DAMAGECOUNT value on done: 490923.0 [2024-08-06 03:58:34,278][52664] Sum rewards: 74.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.521', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.189', 'weapon2': '0.246', 'weapon4': '0.282', 'weapon5': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '58.000'} [2024-08-06 03:58:34,350][52647] DAMAGECOUNT value on done: 490663.0 [2024-08-06 03:58:34,353][52647] Sum rewards: 80.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.965', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.204', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.482', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '67.000'} [2024-08-06 03:58:34,417][52794] DAMAGECOUNT value on done: 475205.0 [2024-08-06 03:58:34,417][52794] Sum rewards: 72.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.665', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.284', 'weapon4': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '63.000'} [2024-08-06 03:58:35,238][52659] DAMAGECOUNT value on done: 471389.0 [2024-08-06 03:58:35,239][52659] Sum rewards: 63.982, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.844', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon5': '0.198', 'weapon4': '0.272', 'AMMO3': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.740', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '57.000'} [2024-08-06 03:58:35,600][52650] Updated weights for policy 0, policy_version 49901 (0.0012) [2024-08-06 03:58:36,660][52649] DAMAGECOUNT value on done: 459160.0 [2024-08-06 03:58:36,660][52649] Sum rewards: 75.176, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.630', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.068', 'weapon5': '0.170', 'AMMO4': '0.224', 'weapon2': '0.228', 'AMMO3': '0.323', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.262', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '65.000'} [2024-08-06 03:58:36,988][52664] DAMAGECOUNT value on done: 482803.0 [2024-08-06 03:58:36,988][52664] Sum rewards: 60.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.223', 'AMMO3': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '53.000'} [2024-08-06 03:58:37,114][52647] DAMAGECOUNT value on done: 493365.0 [2024-08-06 03:58:37,115][52647] Sum rewards: 82.073, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.080', 'AMMO4': '0.144', 'weapon5': '0.176', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '68.000'} [2024-08-06 03:58:37,396][52794] DAMAGECOUNT value on done: 467663.0 [2024-08-06 03:58:37,397][52794] Sum rewards: 66.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.098', 'AMMO4': '0.161', 'weapon2': '0.200', 'weapon4': '0.212', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '57.000'} [2024-08-06 03:58:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 408829952. Throughput: 0: 4360.7. Samples: 102211310. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 03:58:37,794][52567] Avg episode reward: [(0, '71.478')] [2024-08-06 03:58:38,415][52659] DAMAGECOUNT value on done: 461891.0 [2024-08-06 03:58:38,417][52659] Sum rewards: 71.536, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.088', 'AMMO4': '0.101', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:38,433][52663] DAMAGECOUNT value on done: 474661.0 [2024-08-06 03:58:38,435][52663] Sum rewards: 77.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '63.000'} [2024-08-06 03:58:39,384][52666] DAMAGECOUNT value on done: 463814.0 [2024-08-06 03:58:39,386][52666] Sum rewards: 77.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.038', 'AMMO4': '0.067', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '66.000'} [2024-08-06 03:58:39,720][52647] DAMAGECOUNT value on done: 484803.0 [2024-08-06 03:58:39,721][52647] Sum rewards: 63.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.553', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.120', 'weapon5': '0.174', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'HITCOUNT': '3.290', 'weapon3': '3.302', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 03:58:39,724][52664] DAMAGECOUNT value on done: 493447.0 [2024-08-06 03:58:39,724][52664] Sum rewards: 62.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.382', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.098', 'AMMO3': '0.150', 'AMMO4': '0.202', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.442', 'WEAPON3': '0.900', 'weapon3': '3.052', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '50.000'} [2024-08-06 03:58:39,751][52650] Updated weights for policy 0, policy_version 49911 (0.0013) [2024-08-06 03:58:39,798][52649] DAMAGECOUNT value on done: 453371.0 [2024-08-06 03:58:39,798][52649] Sum rewards: 68.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.200', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.195', 'AMMO3': '0.272', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.204', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '59.500'} [2024-08-06 03:58:41,392][52663] DAMAGECOUNT value on done: 468210.0 [2024-08-06 03:58:41,393][52663] Sum rewards: 75.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.926', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.118', 'weapon4': '0.132', 'AMMO4': '0.188', 'AMMO3': '0.190', 'weapon2': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.344', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:41,656][52659] DAMAGECOUNT value on done: 469790.0 [2024-08-06 03:58:41,656][52659] Sum rewards: 76.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.395', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.121', 'AMMO3': '0.202', 'weapon2': '0.226', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:41,669][52670] DAMAGECOUNT value on done: 457626.0 [2024-08-06 03:58:41,670][52670] Sum rewards: 72.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.142', 'AMMO4': '0.222', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:42,123][52666] DAMAGECOUNT value on done: 471055.0 [2024-08-06 03:58:42,124][52666] Sum rewards: 83.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.202', 'weapon5': '0.212', 'AMMO4': '0.264', 'weapon4': '0.302', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.748', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '66.000'} [2024-08-06 03:58:42,145][52647] DAMAGECOUNT value on done: 496169.0 [2024-08-06 03:58:42,145][52647] Sum rewards: 82.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.124', 'weapon2': '0.172', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '67.500'} [2024-08-06 03:58:42,180][52664] DAMAGECOUNT value on done: 488369.0 [2024-08-06 03:58:42,181][52664] Sum rewards: 66.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.737', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.134', 'weapon4': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.264', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:42,266][52811] DAMAGECOUNT value on done: 449430.0 [2024-08-06 03:58:42,268][52811] Sum rewards: 58.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.024', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon2': '0.142', 'AMMO4': '0.148', 'weapon5': '0.186', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.328', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '50.000'} [2024-08-06 03:58:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 408920064. Throughput: 0: 4360.4. Samples: 102237460. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 03:58:42,794][52567] Avg episode reward: [(0, '71.439')] [2024-08-06 03:58:43,022][52649] DAMAGECOUNT value on done: 461977.0 [2024-08-06 03:58:43,022][52649] Sum rewards: 78.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.986', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.058', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon2': '0.544', 'WEAPON3': '1.000', 'weapon3': '3.150', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:44,264][52663] DAMAGECOUNT value on done: 462963.0 [2024-08-06 03:58:44,264][52663] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.070', 'weapon5': '0.148', 'AMMO4': '0.160', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.650', 'weapon3': '3.018', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '63.000'} [2024-08-06 03:58:44,465][52647] DAMAGECOUNT value on done: 489991.0 [2024-08-06 03:58:44,475][52647] Sum rewards: 62.858, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.552', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.122', 'weapon5': '0.254', 'AMMO4': '0.266', 'AMMO3': '0.316', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.844', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:44,522][52664] DAMAGECOUNT value on done: 495276.0 [2024-08-06 03:58:44,522][52664] Sum rewards: 69.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.514', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.190', 'weapon4': '0.202', 'weapon5': '0.228', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.710', 'WEAPON3': '1.100', 'weapon3': '2.582', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 03:58:44,623][52659] DAMAGECOUNT value on done: 480057.0 [2024-08-06 03:58:44,623][52659] Sum rewards: 79.119, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.158', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.178', 'weapon5': '0.194', 'AMMO4': '0.246', 'weapon2': '0.324', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.882', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:44,631][52670] DAMAGECOUNT value on done: 470561.0 [2024-08-06 03:58:44,633][52670] Sum rewards: 75.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.024', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.125', 'AMMO3': '0.227', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '64.500'} [2024-08-06 03:58:45,049][52666] DAMAGECOUNT value on done: 472158.0 [2024-08-06 03:58:45,050][52666] Sum rewards: 76.830, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.084', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.144', 'AMMO4': '0.211', 'weapon5': '0.218', 'AMMO3': '0.243', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '65.000'} [2024-08-06 03:58:45,065][52650] Updated weights for policy 0, policy_version 49921 (0.0024) [2024-08-06 03:58:45,444][52811] DAMAGECOUNT value on done: 431129.0 [2024-08-06 03:58:45,444][52811] Sum rewards: 67.408, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.666', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon5': '0.162', 'AMMO3': '0.197', 'AMMO4': '0.255', 'weapon4': '0.342', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '56.000'} [2024-08-06 03:58:46,027][52649] DAMAGECOUNT value on done: 464979.0 [2024-08-06 03:58:46,028][52649] Sum rewards: 87.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.682', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.088', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '73.000'} [2024-08-06 03:58:47,287][52663] DAMAGECOUNT value on done: 467612.0 [2024-08-06 03:58:47,289][52663] Sum rewards: 75.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.152', 'weapon2': '0.214', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.354', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:47,326][52647] DAMAGECOUNT value on done: 499650.0 [2024-08-06 03:58:47,328][52647] Sum rewards: 67.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.125', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.122', 'weapon5': '0.148', 'weapon2': '0.204', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.346', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '57.000'} [2024-08-06 03:58:47,379][52670] DAMAGECOUNT value on done: 463188.0 [2024-08-06 03:58:47,379][52670] Sum rewards: 76.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.055', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:47,482][52664] DAMAGECOUNT value on done: 490724.0 [2024-08-06 03:58:47,483][52664] Sum rewards: 68.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.407', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon5': '0.210', 'AMMO3': '0.263', 'weapon4': '0.280', 'AMMO4': '0.319', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.820', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:47,649][52659] DAMAGECOUNT value on done: 474431.0 [2024-08-06 03:58:47,649][52659] Sum rewards: 77.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.136', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.080', 'weapon5': '0.146', 'AMMO3': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 409001984. Throughput: 0: 4362.7. Samples: 102250380. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 03:58:47,794][52567] Avg episode reward: [(0, '71.952')] [2024-08-06 03:58:47,845][52666] DAMAGECOUNT value on done: 470192.0 [2024-08-06 03:58:47,848][52666] Sum rewards: 67.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.530', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.184', 'AMMO3': '0.232', 'AMMO4': '0.254', 'weapon5': '0.258', 'weapon2': '0.332', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '56.000'} [2024-08-06 03:58:48,556][52811] DAMAGECOUNT value on done: 431881.0 [2024-08-06 03:58:48,558][52811] Sum rewards: 65.615, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.167', 'AMMO3': '0.184', 'weapon5': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '53.000'} [2024-08-06 03:58:49,228][52649] DAMAGECOUNT value on done: 465487.0 [2024-08-06 03:58:49,229][52649] Sum rewards: 69.608, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.756', 'AMMO5': '0.027', 'AMMO2': '0.074', 'weapon4': '0.194', 'AMMO3': '0.252', 'weapon5': '0.292', 'AMMO4': '0.372', 'weapon2': '0.388', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.730', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:49,312][52650] Updated weights for policy 0, policy_version 49931 (0.0011) [2024-08-06 03:58:50,034][52647] DAMAGECOUNT value on done: 492359.0 [2024-08-06 03:58:50,042][52647] Sum rewards: 70.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.557', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.230', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.000'} [2024-08-06 03:58:50,150][52664] DAMAGECOUNT value on done: 491698.0 [2024-08-06 03:58:50,151][52664] Sum rewards: 69.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.142', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.253', 'weapon2': '0.462', 'WEAPON3': '1.600', 'weapon3': '3.368', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '60.000'} [2024-08-06 03:58:50,171][52670] DAMAGECOUNT value on done: 462005.0 [2024-08-06 03:58:50,174][52670] Sum rewards: 74.583, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.464', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.132', 'weapon2': '0.178', 'AMMO3': '0.220', 'WEAPON3': '1.450', 'weapon3': '3.440', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:50,422][52666] DAMAGECOUNT value on done: 469677.0 [2024-08-06 03:58:50,425][52666] Sum rewards: 72.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.072', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.126', 'weapon4': '0.158', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.050', 'HITCOUNT': '3.250', 'weapon3': '3.252', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:50,438][52659] DAMAGECOUNT value on done: 473741.0 [2024-08-06 03:58:50,438][52659] Sum rewards: 63.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.455', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.140', 'AMMO3': '0.157', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.646', 'WEAPON3': '0.950', 'weapon3': '2.714', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '52.000'} [2024-08-06 03:58:50,448][52663] DAMAGECOUNT value on done: 468248.0 [2024-08-06 03:58:50,453][52663] Sum rewards: 77.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.128', 'weapon4': '0.142', 'weapon2': '0.148', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '63.000'} [2024-08-06 03:58:51,719][52811] DAMAGECOUNT value on done: 434759.0 [2024-08-06 03:58:51,720][52811] Sum rewards: 72.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.220', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.066', 'AMMO4': '0.136', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:52,547][52670] DAMAGECOUNT value on done: 472059.0 [2024-08-06 03:58:52,549][52670] Sum rewards: 68.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon4': '0.264', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:52,557][52649] DAMAGECOUNT value on done: 461854.0 [2024-08-06 03:58:52,558][52649] Sum rewards: 63.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.635', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon2': '0.192', 'weapon4': '0.196', 'AMMO3': '0.231', 'weapon5': '0.274', 'AMMO4': '0.324', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.058', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '54.000'} [2024-08-06 03:58:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 409092096. Throughput: 0: 4352.9. Samples: 102276390. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 03:58:52,795][52567] Avg episode reward: [(0, '71.726')] [2024-08-06 03:58:52,893][52666] DAMAGECOUNT value on done: 462822.0 [2024-08-06 03:58:52,895][52647] DAMAGECOUNT value on done: 484376.0 [2024-08-06 03:58:52,895][52666] Sum rewards: 80.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon2': '0.234', 'AMMO3': '0.237', 'weapon5': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '68.000'} [2024-08-06 03:58:52,895][52647] Sum rewards: 49.686, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.700', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.177', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.420', 'weapon3': '3.414', 'DAMAGECOUNT': '12.789', 'FRAGCOUNT': '40.000'} [2024-08-06 03:58:53,127][52664] DAMAGECOUNT value on done: 484597.0 [2024-08-06 03:58:53,129][52664] Sum rewards: 62.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.245', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.082', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.966', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '53.000'} [2024-08-06 03:58:53,294][52663] DAMAGECOUNT value on done: 472115.0 [2024-08-06 03:58:53,294][52663] Sum rewards: 68.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'weapon5': '0.252', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.038', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '58.000'} [2024-08-06 03:58:53,652][52659] DAMAGECOUNT value on done: 467273.0 [2024-08-06 03:58:53,654][52659] Sum rewards: 66.254, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.680', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.164', 'AMMO3': '0.167', 'weapon4': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '52.000'} [2024-08-06 03:58:54,021][52650] Updated weights for policy 0, policy_version 49941 (0.0021) [2024-08-06 03:58:54,098][52803] DAMAGECOUNT value on done: 437246.0 [2024-08-06 03:58:54,099][52803] Sum rewards: 67.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.409', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.104', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.556', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:54,816][52811] DAMAGECOUNT value on done: 437588.0 [2024-08-06 03:58:54,817][52811] Sum rewards: 75.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.974', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon5': '0.146', 'AMMO3': '0.222', 'weapon4': '0.230', 'AMMO4': '0.332', 'weapon2': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:55,120][52670] DAMAGECOUNT value on done: 466182.0 [2024-08-06 03:58:55,121][52670] Sum rewards: 65.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.094', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.146', 'weapon5': '0.156', 'AMMO3': '0.215', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '54.000'} [2024-08-06 03:58:55,390][52649] DAMAGECOUNT value on done: 451385.0 [2024-08-06 03:58:55,392][52649] Sum rewards: 59.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.252', 'WEAPON5': '0.400', 'weapon4': '0.418', 'weapon2': '0.516', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.638', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '51.000'} [2024-08-06 03:58:55,470][52666] DAMAGECOUNT value on done: 466787.0 [2024-08-06 03:58:55,470][52666] Sum rewards: 68.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.134', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '59.000'} [2024-08-06 03:58:55,900][52647] DAMAGECOUNT value on done: 490592.0 [2024-08-06 03:58:55,903][52647] Sum rewards: 72.701, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.124', 'AMMO4': '0.158', 'weapon5': '0.160', 'weapon4': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'weapon3': '3.098', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '57.000'} [2024-08-06 03:58:56,128][52664] DAMAGECOUNT value on done: 483762.0 [2024-08-06 03:58:56,129][52664] Sum rewards: 63.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.845', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.092', 'weapon4': '0.094', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '3.284', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '56.000'} [2024-08-06 03:58:56,144][52659] DAMAGECOUNT value on done: 471075.0 [2024-08-06 03:58:56,145][52659] Sum rewards: 74.059, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.128', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.094', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.312', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '62.000'} [2024-08-06 03:58:56,265][52663] DAMAGECOUNT value on done: 469442.0 [2024-08-06 03:58:56,266][52663] Sum rewards: 62.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.124', 'AMMO4': '0.170', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.286', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '2.954', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '52.000'} [2024-08-06 03:58:57,240][52803] DAMAGECOUNT value on done: 433973.0 [2024-08-06 03:58:57,242][52803] Sum rewards: 70.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.635', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.062', 'AMMO4': '0.079', 'weapon5': '0.106', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '57.000'} [2024-08-06 03:58:57,660][52670] DAMAGECOUNT value on done: 457796.0 [2024-08-06 03:58:57,661][52670] Sum rewards: 65.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.148', 'AMMO4': '0.188', 'AMMO3': '0.209', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '56.000'} [2024-08-06 03:58:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 409182208. Throughput: 0: 4353.3. Samples: 102302510. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 03:58:57,794][52567] Avg episode reward: [(0, '71.485')] [2024-08-06 03:58:57,930][52811] DAMAGECOUNT value on done: 443808.0 [2024-08-06 03:58:57,932][52811] Sum rewards: 66.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.120', 'AMMO3': '0.185', 'weapon4': '0.212', 'AMMO4': '0.251', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.852', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '55.000'} [2024-08-06 03:58:58,233][52666] DAMAGECOUNT value on done: 466397.0 [2024-08-06 03:58:58,234][52666] Sum rewards: 75.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.891', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.130', 'weapon5': '0.212', 'AMMO4': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '64.000'} [2024-08-06 03:58:58,321][52649] DAMAGECOUNT value on done: 460913.0 [2024-08-06 03:58:58,322][52649] Sum rewards: 57.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.812', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.138', 'AMMO3': '0.194', 'AMMO4': '0.208', 'weapon2': '0.274', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.982', 'DAMAGECOUNT': '13.731', 'FRAGCOUNT': '49.000'} [2024-08-06 03:58:58,517][52647] DAMAGECOUNT value on done: 488012.0 [2024-08-06 03:58:58,520][52647] Sum rewards: 60.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.120', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.218', 'weapon4': '0.220', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.890', 'weapon3': '3.002', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '51.000'} [2024-08-06 03:58:58,680][52664] DAMAGECOUNT value on done: 487961.0 [2024-08-06 03:58:58,681][52664] Sum rewards: 71.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.944', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.052', 'weapon5': '0.190', 'AMMO3': '0.209', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '58.000'} [2024-08-06 03:58:59,026][52650] Updated weights for policy 0, policy_version 49951 (0.0012) [2024-08-06 03:58:59,029][52659] DAMAGECOUNT value on done: 471852.0 [2024-08-06 03:58:59,030][52659] Sum rewards: 70.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.162', 'AMMO3': '0.237', 'AMMO4': '0.282', 'weapon5': '0.312', 'weapon2': '0.400', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.762', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '58.000'} [2024-08-06 03:58:59,051][52663] DAMAGECOUNT value on done: 463366.0 [2024-08-06 03:58:59,052][52663] Sum rewards: 72.396, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.082', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.500'} [2024-08-06 03:59:00,474][52803] DAMAGECOUNT value on done: 442464.0 [2024-08-06 03:59:00,474][52803] Sum rewards: 71.675, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.952', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.026', 'AMMO4': '0.058', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:00,786][52670] DAMAGECOUNT value on done: 465030.0 [2024-08-06 03:59:00,787][52670] Sum rewards: 80.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.138', 'AMMO4': '0.196', 'weapon2': '0.210', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.366', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '67.000'} [2024-08-06 03:59:01,044][52811] DAMAGECOUNT value on done: 439056.0 [2024-08-06 03:59:01,045][52811] Sum rewards: 72.163, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.634', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.160', 'AMMO4': '0.170', 'weapon5': '0.222', 'AMMO3': '0.230', 'weapon2': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:01,282][52649] DAMAGECOUNT value on done: 449271.0 [2024-08-06 03:59:01,283][52649] Sum rewards: 70.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.094', 'weapon4': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:01,365][52666] DAMAGECOUNT value on done: 465059.0 [2024-08-06 03:59:01,366][52666] Sum rewards: 76.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.178', 'AMMO3': '0.198', 'AMMO4': '0.205', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:01,542][52647] DAMAGECOUNT value on done: 488038.0 [2024-08-06 03:59:01,543][52647] Sum rewards: 63.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '53.000'} [2024-08-06 03:59:01,814][52664] DAMAGECOUNT value on done: 486392.0 [2024-08-06 03:59:01,814][52664] Sum rewards: 82.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.230', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '68.000'} [2024-08-06 03:59:02,155][52663] DAMAGECOUNT value on done: 463226.0 [2024-08-06 03:59:02,156][52663] Sum rewards: 66.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.239', 'weapon2': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.502', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '57.000'} [2024-08-06 03:59:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 409272320. Throughput: 0: 4349.5. Samples: 102315660. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:59:02,795][52567] Avg episode reward: [(0, '70.794')] [2024-08-06 03:59:03,420][52650] Updated weights for policy 0, policy_version 49961 (0.0025) [2024-08-06 03:59:03,431][52803] DAMAGECOUNT value on done: 444592.0 [2024-08-06 03:59:03,431][52803] Sum rewards: 75.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.202', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.188', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:03,618][52670] DAMAGECOUNT value on done: 462865.0 [2024-08-06 03:59:03,618][52670] Sum rewards: 67.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon5': '0.234', 'weapon2': '0.314', 'weapon4': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.560', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '53.500'} [2024-08-06 03:59:04,055][52811] DAMAGECOUNT value on done: 438613.0 [2024-08-06 03:59:04,055][52811] Sum rewards: 65.979, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.921', 'AMMO5': '0.012', 'AMMO2': '0.046', 'AMMO3': '0.136', 'weapon5': '0.174', 'AMMO4': '0.230', 'weapon2': '0.240', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.980', 'weapon3': '2.982', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '51.000'} [2024-08-06 03:59:04,168][52668] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 03:59:04,188][52666] DAMAGECOUNT value on done: 459457.0 [2024-08-06 03:59:04,189][52666] Sum rewards: 68.347, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.162', 'weapon2': '0.286', 'WEAPON3': '1.050', 'HITCOUNT': '3.270', 'weapon3': '3.494', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '55.000'} [2024-08-06 03:59:04,490][52649] DAMAGECOUNT value on done: 462435.0 [2024-08-06 03:59:04,490][52649] Sum rewards: 66.281, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.275', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon4': '0.182', 'weapon2': '0.210', 'AMMO3': '0.216', 'weapon5': '0.216', 'AMMO4': '0.281', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '54.000'} [2024-08-06 03:59:05,105][52664] DAMAGECOUNT value on done: 484136.0 [2024-08-06 03:59:05,107][52664] Sum rewards: 62.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.424', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.166', 'AMMO4': '0.209', 'AMMO3': '0.228', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.000'} [2024-08-06 03:59:05,274][52663] DAMAGECOUNT value on done: 469968.0 [2024-08-06 03:59:05,275][52663] Sum rewards: 71.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.584', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.235', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:05,659][52669] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:59:06,394][52803] DAMAGECOUNT value on done: 441554.0 [2024-08-06 03:59:06,395][52803] Sum rewards: 71.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:06,671][52649] DAMAGECOUNT value on done: 464564.0 [2024-08-06 03:59:06,673][52649] Sum rewards: 75.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.736', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.175', 'weapon4': '0.194', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:06,813][52670] DAMAGECOUNT value on done: 460665.0 [2024-08-06 03:59:06,813][52670] Sum rewards: 59.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO3': '0.161', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '49.000'} [2024-08-06 03:59:07,251][52811] DAMAGECOUNT value on done: 443418.0 [2024-08-06 03:59:07,251][52811] Sum rewards: 83.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.142', 'AMMO2': '0.008', 'AMMO5': '0.012', 'AMMO4': '0.041', 'weapon4': '0.052', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon2': '0.142', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.504', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '69.000'} [2024-08-06 03:59:07,414][52666] DAMAGECOUNT value on done: 463233.0 [2024-08-06 03:59:07,414][52666] Sum rewards: 73.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.815', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.142', 'AMMO3': '0.193', 'weapon4': '0.224', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 409354240. Throughput: 0: 4348.9. Samples: 102341750. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:59:07,795][52567] Avg episode reward: [(0, '70.821')] [2024-08-06 03:59:08,087][52650] Updated weights for policy 0, policy_version 49971 (0.0027) [2024-08-06 03:59:08,357][52663] DAMAGECOUNT value on done: 475707.0 [2024-08-06 03:59:08,359][52663] Sum rewards: 80.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.661', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.181', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '64.000'} [2024-08-06 03:59:09,268][52649] DAMAGECOUNT value on done: 456399.0 [2024-08-06 03:59:09,276][52649] Sum rewards: 77.872, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.116', 'weapon5': '0.126', 'AMMO4': '0.209', 'AMMO3': '0.218', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '65.500'} [2024-08-06 03:59:09,419][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:59:09,437][52803] DAMAGECOUNT value on done: 430316.0 [2024-08-06 03:59:09,437][52803] Sum rewards: 75.664, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.966', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon4': '0.144', 'weapon2': '0.208', 'weapon5': '0.224', 'AMMO3': '0.261', 'AMMO4': '0.319', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '63.000'} [2024-08-06 03:59:09,899][52670] DAMAGECOUNT value on done: 466390.0 [2024-08-06 03:59:09,902][52670] Sum rewards: 58.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.873', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.152', 'weapon5': '0.166', 'AMMO3': '0.206', 'AMMO4': '0.223', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.104', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '50.000'} [2024-08-06 03:59:10,371][52666] DAMAGECOUNT value on done: 461196.0 [2024-08-06 03:59:10,371][52666] Sum rewards: 66.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon4': '0.074', 'weapon5': '0.182', 'AMMO3': '0.208', 'AMMO4': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '55.000'} [2024-08-06 03:59:10,389][52811] DAMAGECOUNT value on done: 439150.0 [2024-08-06 03:59:10,390][52811] Sum rewards: 68.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO5': '0.023', 'AMMO2': '0.052', 'AMMO3': '0.175', 'weapon4': '0.248', 'weapon5': '0.252', 'AMMO4': '0.261', 'weapon2': '0.492', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:11,045][52663] DAMAGECOUNT value on done: 466021.0 [2024-08-06 03:59:11,045][52663] Sum rewards: 53.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.144', 'AMMO5': '0.023', 'AMMO2': '0.060', 'AMMO3': '0.179', 'weapon5': '0.234', 'AMMO4': '0.302', 'weapon2': '0.370', 'weapon4': '0.406', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.580', 'weapon3': '2.712', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '47.000'} [2024-08-06 03:59:12,426][52803] DAMAGECOUNT value on done: 432824.0 [2024-08-06 03:59:12,430][52803] Sum rewards: 74.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.120', 'AMMO3': '0.225', 'AMMO4': '0.272', 'weapon4': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:12,693][52670] DAMAGECOUNT value on done: 458270.0 [2024-08-06 03:59:12,695][52670] Sum rewards: 70.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.765', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.176', 'AMMO3': '0.192', 'weapon2': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 03:59:12,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 409436160. Throughput: 0: 4352.4. Samples: 102368210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:59:12,794][52567] Avg episode reward: [(0, '70.417')] [2024-08-06 03:59:13,084][52650] Updated weights for policy 0, policy_version 49981 (0.0020) [2024-08-06 03:59:13,293][52666] DAMAGECOUNT value on done: 473719.0 [2024-08-06 03:59:13,293][52666] Sum rewards: 69.449, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.699', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.192', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:13,559][52811] DAMAGECOUNT value on done: 437689.0 [2024-08-06 03:59:13,560][52811] Sum rewards: 68.850, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.672', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'weapon5': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.268', 'weapon2': '0.456', 'WEAPON3': '1.750', 'weapon3': '3.070', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:14,172][52663] DAMAGECOUNT value on done: 462636.0 [2024-08-06 03:59:14,173][52663] Sum rewards: 74.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.485', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.130', 'AMMO3': '0.193', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:14,993][52667] DAMAGECOUNT value on done: 467325.0 [2024-08-06 03:59:14,994][52667] Sum rewards: 66.419, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.164', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon5': '0.148', 'AMMO3': '0.197', 'AMMO4': '0.274', 'weapon2': '0.358', 'weapon4': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:15,585][52803] DAMAGECOUNT value on done: 433114.0 [2024-08-06 03:59:15,585][52803] Sum rewards: 75.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.114', 'weapon4': '0.166', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:15,943][52670] DAMAGECOUNT value on done: 462900.0 [2024-08-06 03:59:15,943][52670] Sum rewards: 78.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.288', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.144', 'weapon4': '0.176', 'AMMO3': '0.195', 'AMMO4': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '64.500'} [2024-08-06 03:59:16,620][52666] DAMAGECOUNT value on done: 469962.0 [2024-08-06 03:59:16,621][52666] Sum rewards: 68.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.468', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.100', 'AMMO4': '0.178', 'weapon5': '0.204', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '57.000'} [2024-08-06 03:59:16,652][52811] DAMAGECOUNT value on done: 448609.0 [2024-08-06 03:59:16,653][52811] Sum rewards: 65.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.393', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.284', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '57.000'} [2024-08-06 03:59:17,279][52663] DAMAGECOUNT value on done: 462014.0 [2024-08-06 03:59:17,279][52663] Sum rewards: 72.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.432', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO4': '0.081', 'weapon4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:17,669][52667] DAMAGECOUNT value on done: 477428.0 [2024-08-06 03:59:17,674][52667] Sum rewards: 71.981, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.765', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.322', 'weapon2': '0.326', 'WEAPON3': '1.900', 'weapon3': '3.440', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '64.000'} [2024-08-06 03:59:17,699][52650] Updated weights for policy 0, policy_version 49991 (0.0043) [2024-08-06 03:59:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 409526272. Throughput: 0: 4356.0. Samples: 102381200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:59:17,794][52567] Avg episode reward: [(0, '70.482')] [2024-08-06 03:59:18,684][52803] DAMAGECOUNT value on done: 439422.0 [2024-08-06 03:59:18,686][52803] Sum rewards: 73.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.542', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.176', 'weapon5': '0.190', 'AMMO3': '0.209', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:18,869][52670] DAMAGECOUNT value on done: 472493.0 [2024-08-06 03:59:18,869][52670] Sum rewards: 82.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.207', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.203', 'weapon5': '0.252', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '66.000'} [2024-08-06 03:59:19,471][52666] DAMAGECOUNT value on done: 463945.0 [2024-08-06 03:59:19,472][52666] Sum rewards: 79.317, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.328', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'weapon2': '0.226', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '68.000'} [2024-08-06 03:59:19,826][52811] DAMAGECOUNT value on done: 437520.0 [2024-08-06 03:59:19,826][52811] Sum rewards: 64.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.049', 'weapon5': '0.168', 'AMMO3': '0.201', 'AMMO4': '0.245', 'weapon2': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '52.000'} [2024-08-06 03:59:20,367][52663] DAMAGECOUNT value on done: 463448.0 [2024-08-06 03:59:20,375][52663] Sum rewards: 70.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.069', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:20,588][52667] DAMAGECOUNT value on done: 468642.0 [2024-08-06 03:59:20,588][52667] Sum rewards: 72.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.301', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.116', 'weapon4': '0.122', 'AMMO4': '0.124', 'weapon2': '0.160', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:21,710][52803] DAMAGECOUNT value on done: 429283.0 [2024-08-06 03:59:21,713][52803] Sum rewards: 77.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '65.000'} [2024-08-06 03:59:21,761][52670] DAMAGECOUNT value on done: 465641.0 [2024-08-06 03:59:21,761][52670] Sum rewards: 75.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.924', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.016', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.163', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:22,134][52650] Updated weights for policy 0, policy_version 50001 (0.0025) [2024-08-06 03:59:22,303][52666] DAMAGECOUNT value on done: 465904.0 [2024-08-06 03:59:22,305][52666] Sum rewards: 80.962, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.056', 'AMMO3': '0.143', 'HEALTH': '0.210', 'weapon2': '0.522', 'WEAPON3': '0.850', 'weapon3': '3.164', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '63.000'} [2024-08-06 03:59:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 409608192. Throughput: 0: 4355.8. Samples: 102407320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:59:22,794][52567] Avg episode reward: [(0, '70.672')] [2024-08-06 03:59:22,890][52811] DAMAGECOUNT value on done: 436752.0 [2024-08-06 03:59:22,890][52811] Sum rewards: 74.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO4': '0.187', 'AMMO3': '0.210', 'weapon2': '0.254', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:23,328][52663] DAMAGECOUNT value on done: 473717.0 [2024-08-06 03:59:23,330][52663] Sum rewards: 86.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.835', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.083', 'AMMO3': '0.190', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.502', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '69.000'} [2024-08-06 03:59:23,533][52667] DAMAGECOUNT value on done: 468743.0 [2024-08-06 03:59:23,533][52667] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:24,599][52670] DAMAGECOUNT value on done: 452422.0 [2024-08-06 03:59:24,603][52670] Sum rewards: 75.997, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon5': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.338', 'WEAPON3': '1.000', 'weapon3': '3.098', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:24,734][52803] DAMAGECOUNT value on done: 445199.0 [2024-08-06 03:59:24,737][52803] Sum rewards: 69.124, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.014', 'AMMO2': '0.037', 'HEALTH': '0.062', 'weapon4': '0.066', 'AMMO4': '0.183', 'AMMO3': '0.220', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '56.000'} [2024-08-06 03:59:25,035][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 03:59:25,099][52666] DAMAGECOUNT value on done: 466309.0 [2024-08-06 03:59:25,099][52666] Sum rewards: 56.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.178', 'AMMO3': '0.181', 'weapon4': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '2.906', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '46.000'} [2024-08-06 03:59:26,011][52811] DAMAGECOUNT value on done: 440346.0 [2024-08-06 03:59:26,011][52811] Sum rewards: 65.683, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.395', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.172', 'weapon2': '0.186', 'weapon5': '0.212', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.252', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 03:59:26,367][52663] DAMAGECOUNT value on done: 463540.0 [2024-08-06 03:59:26,368][52663] Sum rewards: 61.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.132', 'AMMO4': '0.196', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.674', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '2.898', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '52.000'} [2024-08-06 03:59:26,577][52667] DAMAGECOUNT value on done: 476385.0 [2024-08-06 03:59:26,578][52667] Sum rewards: 71.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.788', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.138', 'AMMO4': '0.200', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '3.034', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:26,755][52650] Updated weights for policy 0, policy_version 50011 (0.0013) [2024-08-06 03:59:27,672][52670] DAMAGECOUNT value on done: 461748.0 [2024-08-06 03:59:27,674][52670] Sum rewards: 67.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.120', 'weapon4': '0.194', 'AMMO4': '0.196', 'AMMO3': '0.219', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '57.000'} [2024-08-06 03:59:27,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 409706496. Throughput: 0: 4358.7. Samples: 102433600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 03:59:27,795][52567] Avg episode reward: [(0, '70.467')] [2024-08-06 03:59:27,822][52803] DAMAGECOUNT value on done: 439982.0 [2024-08-06 03:59:27,823][52803] Sum rewards: 76.307, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.046', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.088', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.328', 'weapon2': '0.362', 'WEAPON3': '1.950', 'weapon3': '3.182', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '68.000'} [2024-08-06 03:59:28,307][52666] DAMAGECOUNT value on done: 469545.0 [2024-08-06 03:59:28,307][52666] Sum rewards: 61.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.132', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.090', 'AMMO4': '0.212', 'weapon5': '0.218', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '51.000'} [2024-08-06 03:59:28,889][52667] DAMAGECOUNT value on done: 478106.0 [2024-08-06 03:59:28,890][52667] Sum rewards: 64.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.275', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.118', 'weapon5': '0.138', 'AMMO4': '0.153', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.700', 'weapon3': '3.014', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '57.000'} [2024-08-06 03:59:29,083][52811] DAMAGECOUNT value on done: 434158.0 [2024-08-06 03:59:29,083][52811] Sum rewards: 80.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.186', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.090', 'weapon5': '0.180', 'AMMO3': '0.203', 'AMMO4': '0.254', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '65.000'} [2024-08-06 03:59:29,173][52663] DAMAGECOUNT value on done: 473123.0 [2024-08-06 03:59:29,174][52663] Sum rewards: 79.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.990', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO4': '0.181', 'AMMO3': '0.185', 'weapon2': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.680', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '64.000'} [2024-08-06 03:59:30,989][52803] DAMAGECOUNT value on done: 437224.0 [2024-08-06 03:59:30,989][52803] Sum rewards: 66.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.273', 'weapon2': '0.318', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.408', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:31,050][52670] DAMAGECOUNT value on done: 472801.0 [2024-08-06 03:59:31,051][52670] Sum rewards: 62.209, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.910', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.090', 'AMMO4': '0.197', 'weapon5': '0.212', 'weapon2': '0.214', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '55.000'} [2024-08-06 03:59:31,249][52667] DAMAGECOUNT value on done: 471057.0 [2024-08-06 03:59:31,251][52667] Sum rewards: 71.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.765', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.172', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:31,377][52666] DAMAGECOUNT value on done: 455702.0 [2024-08-06 03:59:31,378][52666] Sum rewards: 74.456, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.033', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.032', 'AMMO4': '0.154', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon5': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:31,659][52650] Updated weights for policy 0, policy_version 50021 (0.0023) [2024-08-06 03:59:32,162][52811] DAMAGECOUNT value on done: 439142.0 [2024-08-06 03:59:32,163][52811] Sum rewards: 68.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.024', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.227', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.340', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:32,186][52663] DAMAGECOUNT value on done: 469324.0 [2024-08-06 03:59:32,187][52663] Sum rewards: 69.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.104', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '56.000'} [2024-08-06 03:59:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 409788416. Throughput: 0: 4368.7. Samples: 102446970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 03:59:32,794][52567] Avg episode reward: [(0, '70.291')] [2024-08-06 03:59:33,586][52670] DAMAGECOUNT value on done: 464153.0 [2024-08-06 03:59:33,587][52670] Sum rewards: 72.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.825', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:33,919][52649] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:59:33,943][52666] DAMAGECOUNT value on done: 463674.0 [2024-08-06 03:59:33,945][52666] Sum rewards: 66.284, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.026', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.108', 'weapon4': '0.224', 'weapon2': '0.238', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.146', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:34,032][52667] DAMAGECOUNT value on done: 471067.0 [2024-08-06 03:59:34,034][52667] Sum rewards: 76.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.204', 'AMMO4': '0.204', 'weapon4': '0.216', 'weapon5': '0.242', 'weapon2': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:34,047][52803] DAMAGECOUNT value on done: 440556.0 [2024-08-06 03:59:34,053][52803] Sum rewards: 71.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.344', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.062', 'AMMO4': '0.074', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.239', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:35,259][52811] DAMAGECOUNT value on done: 439626.0 [2024-08-06 03:59:35,260][52811] Sum rewards: 72.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.214', 'weapon4': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '61.000'} [2024-08-06 03:59:35,278][52663] DAMAGECOUNT value on done: 463477.0 [2024-08-06 03:59:35,280][52663] Sum rewards: 73.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.241', 'WEAPON3': '1.550', 'weapon3': '3.524', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:35,477][52662] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:59:36,195][52650] Updated weights for policy 0, policy_version 50031 (0.0012) [2024-08-06 03:59:36,200][52670] DAMAGECOUNT value on done: 467665.0 [2024-08-06 03:59:36,203][52670] Sum rewards: 75.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.761', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.098', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:36,957][52667] DAMAGECOUNT value on done: 474975.0 [2024-08-06 03:59:36,958][52667] Sum rewards: 72.451, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.572', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.136', 'AMMO3': '0.248', 'weapon5': '0.270', 'AMMO4': '0.277', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '60.500'} [2024-08-06 03:59:37,188][52803] DAMAGECOUNT value on done: 438149.0 [2024-08-06 03:59:37,189][52803] Sum rewards: 70.397, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.015', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.036', 'AMMO4': '0.140', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '3.002', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2024-08-06 03:59:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 409878528. Throughput: 0: 4376.5. Samples: 102473330. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 03:59:37,795][52567] Avg episode reward: [(0, '70.382')] [2024-08-06 03:59:38,294][52811] DAMAGECOUNT value on done: 438306.0 [2024-08-06 03:59:38,294][52811] Sum rewards: 55.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.340', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon2': '0.204', 'weapon5': '0.208', 'AMMO3': '0.272', 'AMMO4': '0.323', 'weapon4': '0.370', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.650', 'HITCOUNT': '2.540', 'weapon3': '2.914', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '49.000'} [2024-08-06 03:59:39,055][52669] DAMAGECOUNT value on done: 473726.0 [2024-08-06 03:59:39,056][52669] Sum rewards: 67.984, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.162', 'weapon2': '0.220', 'HEALTH': '0.320', 'WEAPON3': '0.950', 'HITCOUNT': '3.300', 'weapon3': '3.496', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 03:59:39,296][52667] DAMAGECOUNT value on done: 478527.0 [2024-08-06 03:59:39,298][52667] Sum rewards: 60.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '2.996', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 03:59:39,677][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:59:40,286][52803] DAMAGECOUNT value on done: 433602.0 [2024-08-06 03:59:40,287][52803] Sum rewards: 66.428, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.905', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.179', 'weapon5': '0.230', 'AMMO4': '0.230', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.694', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '53.000'} [2024-08-06 03:59:40,866][52650] Updated weights for policy 0, policy_version 50041 (0.0033) [2024-08-06 03:59:41,383][52811] DAMAGECOUNT value on done: 439214.0 [2024-08-06 03:59:41,387][52811] Sum rewards: 79.760, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.564', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.050', 'weapon3': '3.278', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '64.000'} [2024-08-06 03:59:41,655][52669] DAMAGECOUNT value on done: 464632.0 [2024-08-06 03:59:41,655][52669] Sum rewards: 86.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.568', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.362', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '71.000'} [2024-08-06 03:59:41,891][52667] DAMAGECOUNT value on done: 467756.0 [2024-08-06 03:59:41,892][52667] Sum rewards: 79.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.398', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '66.000'} [2024-08-06 03:59:42,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 409960448. Throughput: 0: 4386.4. Samples: 102499900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 03:59:42,795][52567] Avg episode reward: [(0, '70.784')] [2024-08-06 03:59:43,411][52803] DAMAGECOUNT value on done: 443537.0 [2024-08-06 03:59:43,415][52803] Sum rewards: 69.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.107', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.068', 'weapon5': '0.138', 'AMMO4': '0.162', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:44,438][52669] DAMAGECOUNT value on done: 473857.0 [2024-08-06 03:59:44,441][52669] Sum rewards: 71.698, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.110', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.279', 'WEAPON3': '1.600', 'weapon3': '3.356', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:44,925][52667] DAMAGECOUNT value on done: 469814.0 [2024-08-06 03:59:44,925][52667] Sum rewards: 68.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.646', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '56.000'} [2024-08-06 03:59:45,537][52650] Updated weights for policy 0, policy_version 50051 (0.0038) [2024-08-06 03:59:46,536][52803] DAMAGECOUNT value on done: 440254.0 [2024-08-06 03:59:46,545][52803] Sum rewards: 77.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.187', 'weapon4': '0.204', 'weapon5': '0.254', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '62.000'} [2024-08-06 03:59:47,529][52667] DAMAGECOUNT value on done: 475369.0 [2024-08-06 03:59:47,531][52667] Sum rewards: 79.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '65.000'} [2024-08-06 03:59:47,781][52669] DAMAGECOUNT value on done: 470698.0 [2024-08-06 03:59:47,783][52669] Sum rewards: 69.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.048', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.204', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 410050560. Throughput: 0: 4384.7. Samples: 102512970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 03:59:47,794][52567] Avg episode reward: [(0, '71.070')] [2024-08-06 03:59:48,375][52668] DAMAGECOUNT value on done: 469640.0 [2024-08-06 03:59:48,378][52668] Sum rewards: 71.873, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.046', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.344', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:49,646][52803] DAMAGECOUNT value on done: 442278.0 [2024-08-06 03:59:49,646][52803] Sum rewards: 73.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.584', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.174', 'weapon2': '0.700', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:50,182][52667] DAMAGECOUNT value on done: 467969.0 [2024-08-06 03:59:50,183][52667] Sum rewards: 71.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.552', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.183', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:50,316][52650] Updated weights for policy 0, policy_version 50061 (0.0028) [2024-08-06 03:59:50,755][52669] DAMAGECOUNT value on done: 470287.0 [2024-08-06 03:59:50,758][52669] Sum rewards: 79.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.679', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.130', 'AMMO4': '0.173', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.276', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '63.000'} [2024-08-06 03:59:51,193][52668] DAMAGECOUNT value on done: 473393.0 [2024-08-06 03:59:51,197][52668] Sum rewards: 73.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.797', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.081', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.280', 'WEAPON3': '1.200', 'HITCOUNT': '3.390', 'weapon3': '3.414', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:52,663][52803] DAMAGECOUNT value on done: 435190.0 [2024-08-06 03:59:52,664][52803] Sum rewards: 40.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.306', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon4': '0.626', 'WEAPON3': '0.800', 'HITCOUNT': '1.990', 'weapon3': '2.496', 'DAMAGECOUNT': '9.636', 'FRAGCOUNT': '33.000'} [2024-08-06 03:59:52,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 410148864. Throughput: 0: 4391.8. Samples: 102539380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 03:59:52,794][52567] Avg episode reward: [(0, '71.264')] [2024-08-06 03:59:52,834][52795] DAMAGECOUNT value on done: 438012.0 [2024-08-06 03:59:52,835][52795] Sum rewards: 85.204, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.841', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.121', 'weapon5': '0.148', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.100', 'weapon3': '3.334', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '68.000'} [2024-08-06 03:59:53,170][52667] DAMAGECOUNT value on done: 474859.0 [2024-08-06 03:59:53,171][52667] Sum rewards: 69.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.985', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.102', 'AMMO4': '0.169', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.298', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.010', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:53,898][52669] DAMAGECOUNT value on done: 474381.0 [2024-08-06 03:59:53,899][52669] Sum rewards: 78.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.470', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.191', 'weapon5': '0.198', 'weapon4': '0.248', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '64.000'} [2024-08-06 03:59:54,084][52668] DAMAGECOUNT value on done: 474738.0 [2024-08-06 03:59:54,084][52668] Sum rewards: 70.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon2': '0.172', 'AMMO3': '0.183', 'weapon5': '0.204', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:54,415][52803] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 03:59:54,945][52650] Updated weights for policy 0, policy_version 50071 (0.0026) [2024-08-06 03:59:56,011][52795] DAMAGECOUNT value on done: 427224.0 [2024-08-06 03:59:56,011][52795] Sum rewards: 64.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.295', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.100', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.342', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.000'} [2024-08-06 03:59:56,208][52667] DAMAGECOUNT value on done: 480327.0 [2024-08-06 03:59:56,209][52667] Sum rewards: 69.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.195', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.118', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.438', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.180', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '58.000'} [2024-08-06 03:59:57,005][52669] DAMAGECOUNT value on done: 471041.0 [2024-08-06 03:59:57,006][52669] Sum rewards: 72.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.058', 'weapon4': '0.098', 'AMMO4': '0.122', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:57,419][52668] DAMAGECOUNT value on done: 475503.0 [2024-08-06 03:59:57,421][52668] Sum rewards: 59.155, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.084', 'AMMO3': '0.106', 'AMMO4': '0.186', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '0.800', 'HITCOUNT': '2.650', 'weapon3': '2.958', 'DAMAGECOUNT': '12.240', 'FRAGCOUNT': '47.000'} [2024-08-06 03:59:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 410230784. Throughput: 0: 4386.2. Samples: 102565590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 03:59:57,794][52567] Avg episode reward: [(0, '71.092')] [2024-08-06 03:59:58,930][52667] DAMAGECOUNT value on done: 478147.0 [2024-08-06 03:59:58,931][52667] Sum rewards: 74.486, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.136', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.892', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '60.000'} [2024-08-06 03:59:59,138][52795] DAMAGECOUNT value on done: 428280.0 [2024-08-06 03:59:59,139][52795] Sum rewards: 72.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.128', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '59.000'} [2024-08-06 03:59:59,495][52650] Updated weights for policy 0, policy_version 50081 (0.0015) [2024-08-06 03:59:59,914][52669] DAMAGECOUNT value on done: 472112.0 [2024-08-06 03:59:59,914][52669] Sum rewards: 64.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.085', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.404', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '57.000'} [2024-08-06 03:59:59,979][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:00:00,363][52668] DAMAGECOUNT value on done: 463987.0 [2024-08-06 04:00:00,365][52668] Sum rewards: 65.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.174', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO3': '0.195', 'AMMO4': '0.197', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.708', 'WEAPON3': '1.250', 'weapon3': '2.650', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '54.000'} [2024-08-06 04:00:01,419][52662] DAMAGECOUNT value on done: 475944.0 [2024-08-06 04:00:01,419][52662] Sum rewards: 66.605, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.060', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO4': '0.208', 'weapon4': '0.212', 'weapon5': '0.242', 'weapon2': '0.272', 'AMMO3': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.946', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:02,122][52667] DAMAGECOUNT value on done: 477325.0 [2024-08-06 04:00:02,122][52667] Sum rewards: 68.974, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.855', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.141', 'AMMO3': '0.143', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.000', 'weapon3': '3.176', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:02,307][52795] DAMAGECOUNT value on done: 433924.0 [2024-08-06 04:00:02,308][52795] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.060', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.140', 'AMMO3': '0.229', 'AMMO4': '0.234', 'weapon4': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.664', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '57.500'} [2024-08-06 04:00:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 410320896. Throughput: 0: 4391.1. Samples: 102578800. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:00:02,802][52567] Avg episode reward: [(0, '71.019')] [2024-08-06 04:00:02,845][52669] DAMAGECOUNT value on done: 477392.0 [2024-08-06 04:00:02,845][52669] Sum rewards: 70.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.504', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon2': '0.164', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'weapon3': '3.542', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:03,243][52671] DAMAGECOUNT value on done: 474940.0 [2024-08-06 04:00:03,246][52671] Sum rewards: 72.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.170', 'AMMO3': '0.262', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '61.500'} [2024-08-06 04:00:03,313][52668] DAMAGECOUNT value on done: 476125.0 [2024-08-06 04:00:03,313][52668] Sum rewards: 82.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.176', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.160', 'AMMO3': '0.194', 'weapon4': '0.240', 'AMMO4': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '68.000'} [2024-08-06 04:00:04,301][52650] Updated weights for policy 0, policy_version 50091 (0.0011) [2024-08-06 04:00:04,344][52662] DAMAGECOUNT value on done: 477970.0 [2024-08-06 04:00:04,344][52662] Sum rewards: 69.929, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.174', 'AMMO5': '0.010', 'AMMO2': '0.067', 'weapon5': '0.190', 'weapon4': '0.222', 'weapon2': '0.268', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'AMMO4': '0.335', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.984', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:05,123][52667] DAMAGECOUNT value on done: 470710.0 [2024-08-06 04:00:05,123][52667] Sum rewards: 66.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.784', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.068', 'weapon5': '0.126', 'AMMO4': '0.131', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.104', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:05,432][52795] DAMAGECOUNT value on done: 429843.0 [2024-08-06 04:00:05,432][52795] Sum rewards: 69.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.648', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:05,960][52669] DAMAGECOUNT value on done: 469810.0 [2024-08-06 04:00:05,961][52669] Sum rewards: 66.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.442', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.124', 'AMMO3': '0.210', 'AMMO4': '0.255', 'weapon2': '0.286', 'weapon5': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.018', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 04:00:06,122][52671] DAMAGECOUNT value on done: 475534.0 [2024-08-06 04:00:06,123][52671] Sum rewards: 67.683, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.176', 'weapon4': '0.178', 'weapon5': '0.196', 'weapon2': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.188', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:06,132][52668] DAMAGECOUNT value on done: 476246.0 [2024-08-06 04:00:06,132][52668] Sum rewards: 72.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.396', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.160', 'AMMO4': '0.169', 'weapon5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:07,517][52662] DAMAGECOUNT value on done: 474892.0 [2024-08-06 04:00:07,517][52662] Sum rewards: 56.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.999', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.109', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.746', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '2.898', 'DAMAGECOUNT': '14.316', 'FRAGCOUNT': '45.000'} [2024-08-06 04:00:07,611][52667] DAMAGECOUNT value on done: 475659.0 [2024-08-06 04:00:07,614][52667] Sum rewards: 61.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.804', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.132', 'AMMO4': '0.142', 'weapon5': '0.166', 'weapon2': '0.206', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.240', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '53.000'} [2024-08-06 04:00:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 410402816. Throughput: 0: 4391.8. Samples: 102604950. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:00:07,794][52567] Avg episode reward: [(0, '70.584')] [2024-08-06 04:00:08,146][52794] Large shaping reward 2.594 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.543, 181.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:00:08,660][52795] DAMAGECOUNT value on done: 438065.0 [2024-08-06 04:00:08,662][52795] Sum rewards: 70.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.096', 'weapon4': '0.112', 'AMMO4': '0.167', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:08,683][52650] Updated weights for policy 0, policy_version 50101 (0.0012) [2024-08-06 04:00:08,821][52669] DAMAGECOUNT value on done: 477860.0 [2024-08-06 04:00:08,824][52669] Sum rewards: 72.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.976', 'AMMO5': '0.023', 'AMMO2': '0.043', 'weapon4': '0.102', 'AMMO3': '0.206', 'weapon5': '0.216', 'AMMO4': '0.217', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.500'} [2024-08-06 04:00:08,990][52671] DAMAGECOUNT value on done: 474476.0 [2024-08-06 04:00:08,992][52671] Sum rewards: 76.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.146', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.038', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.446', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:09,366][52668] DAMAGECOUNT value on done: 465459.0 [2024-08-06 04:00:09,367][52668] Sum rewards: 70.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.247', 'weapon4': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '2.736', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:09,449][52658] DAMAGECOUNT value on done: 469395.0 [2024-08-06 04:00:09,449][52658] Sum rewards: 70.058, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.119', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.202', 'weapon2': '0.220', 'AMMO4': '0.225', 'weapon5': '0.240', 'AMMO3': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.026', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:10,689][52614] Signal inference workers to stop experience collection... (9100 times) [2024-08-06 04:00:10,691][52614] Signal inference workers to resume experience collection... (9100 times) [2024-08-06 04:00:10,723][52662] DAMAGECOUNT value on done: 466791.0 [2024-08-06 04:00:10,726][52662] Sum rewards: 75.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.464', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.066', 'weapon5': '0.090', 'AMMO4': '0.128', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:10,735][52650] InferenceWorker_p0-w0: stopping experience collection (9100 times) [2024-08-06 04:00:10,735][52650] InferenceWorker_p0-w0: resuming experience collection (9100 times) [2024-08-06 04:00:11,762][52795] DAMAGECOUNT value on done: 442902.0 [2024-08-06 04:00:11,764][52795] Sum rewards: 65.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.852', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon4': '0.394', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:11,895][52671] DAMAGECOUNT value on done: 473235.0 [2024-08-06 04:00:11,896][52671] Sum rewards: 78.904, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.149', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO4': '0.141', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.596', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '63.000'} [2024-08-06 04:00:11,904][52669] DAMAGECOUNT value on done: 476314.0 [2024-08-06 04:00:11,905][52669] Sum rewards: 67.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.116', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.109', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.472', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:12,072][52668] DAMAGECOUNT value on done: 468666.0 [2024-08-06 04:00:12,073][52668] Sum rewards: 86.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.660', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon4': '0.016', 'weapon5': '0.022', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.712', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '70.000'} [2024-08-06 04:00:12,215][52658] DAMAGECOUNT value on done: 472775.0 [2024-08-06 04:00:12,218][52658] Sum rewards: 73.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.121', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.073', 'weapon2': '0.180', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.586', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 04:00:12,256][52660] DAMAGECOUNT value on done: 471093.0 [2024-08-06 04:00:12,257][52660] Sum rewards: 57.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.074', 'weapon5': '0.166', 'AMMO4': '0.172', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.036', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '48.000'} [2024-08-06 04:00:12,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 410484736. Throughput: 0: 4393.8. Samples: 102631320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:00:12,802][52567] Avg episode reward: [(0, '70.991')] [2024-08-06 04:00:13,519][52650] Updated weights for policy 0, policy_version 50111 (0.0018) [2024-08-06 04:00:13,807][52662] DAMAGECOUNT value on done: 476942.0 [2024-08-06 04:00:13,810][52662] Sum rewards: 70.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.464', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.246', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '2.816', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:14,674][52671] DAMAGECOUNT value on done: 484410.0 [2024-08-06 04:00:14,676][52671] Sum rewards: 90.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.178', 'AMMO4': '0.178', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.903', 'FRAGCOUNT': '73.000'} [2024-08-06 04:00:14,904][52795] DAMAGECOUNT value on done: 439842.0 [2024-08-06 04:00:14,905][52795] Sum rewards: 79.450, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.204', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.242', 'weapon2': '0.304', 'WEAPON3': '0.950', 'weapon3': '3.054', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:14,962][52668] DAMAGECOUNT value on done: 476243.0 [2024-08-06 04:00:14,962][52668] Sum rewards: 79.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.238', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.496', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '68.000'} [2024-08-06 04:00:15,173][52669] DAMAGECOUNT value on done: 462965.0 [2024-08-06 04:00:15,173][52669] Sum rewards: 79.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.020', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.060', 'weapon4': '0.116', 'AMMO4': '0.181', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.450', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '67.000'} [2024-08-06 04:00:15,208][52660] DAMAGECOUNT value on done: 462129.0 [2024-08-06 04:00:15,208][52660] Sum rewards: 65.425, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.336', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.146', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.440', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '2.714', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '53.000'} [2024-08-06 04:00:15,330][52658] DAMAGECOUNT value on done: 477250.0 [2024-08-06 04:00:15,330][52658] Sum rewards: 70.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.140', 'AMMO3': '0.182', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.526', 'weapon4': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.524', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '57.000'} [2024-08-06 04:00:16,690][52662] DAMAGECOUNT value on done: 469732.0 [2024-08-06 04:00:16,691][52662] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.190', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.104', 'weapon4': '0.108', 'AMMO3': '0.220', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.714', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '62.000'} [2024-08-06 04:00:17,330][52671] DAMAGECOUNT value on done: 473415.0 [2024-08-06 04:00:17,334][52671] Sum rewards: 78.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.871', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.154', 'weapon2': '0.184', 'weapon4': '0.206', 'AMMO4': '0.229', 'AMMO3': '0.237', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:17,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 410583040. Throughput: 0: 4390.6. Samples: 102644550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:00:17,802][52567] Avg episode reward: [(0, '71.387')] [2024-08-06 04:00:17,875][52669] DAMAGECOUNT value on done: 474835.0 [2024-08-06 04:00:17,878][52669] Sum rewards: 82.107, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.143', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.100', 'weapon5': '0.152', 'AMMO4': '0.177', 'AMMO3': '0.192', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '67.000'} [2024-08-06 04:00:18,048][52795] DAMAGECOUNT value on done: 429217.0 [2024-08-06 04:00:18,050][52795] Sum rewards: 77.660, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.936', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.076', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.296', 'weapon4': '0.298', 'WEAPON3': '1.850', 'weapon3': '3.144', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '69.000'} [2024-08-06 04:00:18,052][52658] DAMAGECOUNT value on done: 475591.0 [2024-08-06 04:00:18,054][52658] Sum rewards: 74.039, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.524', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:18,140][52668] DAMAGECOUNT value on done: 471189.0 [2024-08-06 04:00:18,141][52668] Sum rewards: 69.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.464', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO4': '0.214', 'AMMO3': '0.260', 'weapon2': '0.284', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:18,350][52660] DAMAGECOUNT value on done: 474172.0 [2024-08-06 04:00:18,350][52660] Sum rewards: 71.597, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'weapon2': '0.206', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'HITCOUNT': '3.470', 'weapon3': '3.564', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '62.000'} [2024-08-06 04:00:18,683][52650] Updated weights for policy 0, policy_version 50121 (0.0025) [2024-08-06 04:00:19,147][52662] DAMAGECOUNT value on done: 476381.0 [2024-08-06 04:00:19,148][52662] Sum rewards: 72.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.944', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.184', 'AMMO3': '0.207', 'weapon5': '0.234', 'AMMO4': '0.275', 'weapon2': '0.338', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:20,126][52671] DAMAGECOUNT value on done: 478750.0 [2024-08-06 04:00:20,128][52671] Sum rewards: 82.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.124', 'weapon2': '0.146', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON3': '1.100', 'weapon3': '3.324', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '66.000'} [2024-08-06 04:00:20,781][52658] DAMAGECOUNT value on done: 464634.0 [2024-08-06 04:00:20,781][52658] Sum rewards: 79.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.178', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.126', 'AMMO4': '0.165', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:20,805][52669] DAMAGECOUNT value on done: 475268.0 [2024-08-06 04:00:20,807][52669] Sum rewards: 62.268, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.531', 'AMMO5': '0.022', 'AMMO2': '0.067', 'AMMO3': '0.152', 'weapon2': '0.274', 'weapon5': '0.282', 'AMMO4': '0.337', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.588', 'WEAPON3': '1.000', 'weapon3': '2.566', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '50.000'} [2024-08-06 04:00:21,155][52668] DAMAGECOUNT value on done: 465549.0 [2024-08-06 04:00:21,156][52668] Sum rewards: 69.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.004', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO4': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:21,364][52795] DAMAGECOUNT value on done: 442598.0 [2024-08-06 04:00:21,365][52795] Sum rewards: 70.311, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.065', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '3.280', 'weapon3': '3.282', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:21,388][52660] DAMAGECOUNT value on done: 479236.0 [2024-08-06 04:00:21,389][52660] Sum rewards: 66.895, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.576', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.110', 'weapon4': '0.124', 'AMMO4': '0.218', 'AMMO3': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:22,466][52662] DAMAGECOUNT value on done: 481993.0 [2024-08-06 04:00:22,468][52662] Sum rewards: 71.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.051', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.138', 'weapon5': '0.210', 'AMMO3': '0.259', 'AMMO4': '0.265', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:22,607][52650] Updated weights for policy 0, policy_version 50131 (0.0036) [2024-08-06 04:00:22,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 410673152. Throughput: 0: 4392.7. Samples: 102671000. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:00:22,802][52567] Avg episode reward: [(0, '71.478')] [2024-08-06 04:00:22,959][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:00:23,014][52671] DAMAGECOUNT value on done: 475652.0 [2024-08-06 04:00:23,014][52671] Sum rewards: 72.851, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.736', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon4': '0.038', 'AMMO4': '0.096', 'weapon5': '0.118', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'HITCOUNT': '3.410', 'weapon3': '3.450', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:23,292][52669] DAMAGECOUNT value on done: 487955.0 [2024-08-06 04:00:23,294][52669] Sum rewards: 90.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.525', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.130', 'weapon4': '0.174', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.144', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.907', 'FRAGCOUNT': '74.000'} [2024-08-06 04:00:23,302][52658] DAMAGECOUNT value on done: 470286.0 [2024-08-06 04:00:23,304][52658] Sum rewards: 70.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.382', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.128', 'weapon5': '0.142', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:23,864][52668] DAMAGECOUNT value on done: 460669.0 [2024-08-06 04:00:23,865][52668] Sum rewards: 62.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.538', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.098', 'weapon5': '0.116', 'AMMO4': '0.136', 'weapon2': '0.172', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.740', 'weapon3': '3.302', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:24,078][52660] DAMAGECOUNT value on done: 471149.0 [2024-08-06 04:00:24,080][52660] Sum rewards: 65.370, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.478', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.148', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.722', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '51.500'} [2024-08-06 04:00:24,296][52665] DAMAGECOUNT value on done: 461216.0 [2024-08-06 04:00:24,297][52665] Sum rewards: 62.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.971', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO3': '0.176', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'weapon4': '0.362', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '50.000'} [2024-08-06 04:00:24,472][52795] DAMAGECOUNT value on done: 435828.0 [2024-08-06 04:00:24,472][52795] Sum rewards: 71.926, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'AMMO2': '0.028', 'HEALTH': '0.050', 'weapon5': '0.068', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:25,640][52671] DAMAGECOUNT value on done: 470212.0 [2024-08-06 04:00:25,640][52671] Sum rewards: 76.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.098', 'weapon4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '63.000'} [2024-08-06 04:00:25,833][52662] DAMAGECOUNT value on done: 470005.0 [2024-08-06 04:00:25,835][52662] Sum rewards: 73.328, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon4': '0.214', 'ARMOR': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:26,215][52658] DAMAGECOUNT value on done: 475462.0 [2024-08-06 04:00:26,217][52658] Sum rewards: 72.436, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.349', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.094', 'weapon5': '0.204', 'weapon2': '0.216', 'AMMO4': '0.224', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '62.000'} [2024-08-06 04:00:26,337][52669] DAMAGECOUNT value on done: 476813.0 [2024-08-06 04:00:26,337][52669] Sum rewards: 69.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.104', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.272', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:26,828][52668] DAMAGECOUNT value on done: 462083.0 [2024-08-06 04:00:26,830][52668] Sum rewards: 74.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.978', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.277', 'weapon2': '0.406', 'WEAPON3': '1.800', 'weapon3': '3.302', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:27,060][52660] DAMAGECOUNT value on done: 467832.0 [2024-08-06 04:00:27,063][52660] Sum rewards: 61.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.844', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon2': '0.184', 'weapon4': '0.238', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.328', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '53.000'} [2024-08-06 04:00:27,563][52665] DAMAGECOUNT value on done: 473449.0 [2024-08-06 04:00:27,563][52665] Sum rewards: 69.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.404', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.089', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.294', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:27,739][52795] DAMAGECOUNT value on done: 433505.0 [2024-08-06 04:00:27,740][52795] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.136', 'AMMO3': '0.205', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.300', 'HEALTH': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:27,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 410746880. Throughput: 0: 4383.4. Samples: 102697150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:00:27,795][52567] Avg episode reward: [(0, '71.566')] [2024-08-06 04:00:27,810][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050141_410755072.pth... [2024-08-06 04:00:27,812][52650] Updated weights for policy 0, policy_version 50141 (0.0015) [2024-08-06 04:00:27,955][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049629_406560768.pth [2024-08-06 04:00:28,049][52671] DAMAGECOUNT value on done: 477391.0 [2024-08-06 04:00:28,052][52671] Sum rewards: 59.173, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.312', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.194', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2024-08-06 04:00:28,919][52662] DAMAGECOUNT value on done: 484441.0 [2024-08-06 04:00:28,919][52662] Sum rewards: 79.311, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.448', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.184', 'weapon5': '0.206', 'AMMO4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.328', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:29,237][52658] DAMAGECOUNT value on done: 466988.0 [2024-08-06 04:00:29,238][52658] Sum rewards: 62.468, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.940', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.098', 'weapon2': '0.214', 'AMMO3': '0.269', 'weapon4': '0.290', 'AMMO4': '0.317', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:29,440][52669] DAMAGECOUNT value on done: 474273.0 [2024-08-06 04:00:29,443][52669] Sum rewards: 66.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.617', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.132', 'weapon5': '0.142', 'AMMO3': '0.241', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:30,035][52668] DAMAGECOUNT value on done: 463172.0 [2024-08-06 04:00:30,035][52668] Sum rewards: 82.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.373', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.110', 'AMMO3': '0.219', 'AMMO4': '0.256', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:30,266][52660] DAMAGECOUNT value on done: 468318.0 [2024-08-06 04:00:30,267][52660] Sum rewards: 72.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.342', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.170', 'AMMO3': '0.173', 'weapon5': '0.228', 'AMMO4': '0.281', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '57.000'} [2024-08-06 04:00:30,865][52665] DAMAGECOUNT value on done: 469547.0 [2024-08-06 04:00:30,865][52665] Sum rewards: 68.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO4': '0.170', 'weapon5': '0.182', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.116', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:31,099][52795] DAMAGECOUNT value on done: 430707.0 [2024-08-06 04:00:31,099][52795] Sum rewards: 59.937, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.300', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.154', 'weapon5': '0.212', 'AMMO4': '0.244', 'AMMO3': '0.320', 'weapon2': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.900', 'weapon3': '2.918', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:31,318][52671] DAMAGECOUNT value on done: 480512.0 [2024-08-06 04:00:31,319][52671] Sum rewards: 78.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.134', 'weapon4': '0.144', 'weapon2': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:31,546][52662] DAMAGECOUNT value on done: 470287.0 [2024-08-06 04:00:31,548][52662] Sum rewards: 72.177, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.064', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.149', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon2': '0.594', 'WEAPON3': '0.800', 'weapon3': '2.836', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '54.000'} [2024-08-06 04:00:31,701][52658] DAMAGECOUNT value on done: 481389.0 [2024-08-06 04:00:31,701][52658] Sum rewards: 62.925, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon4': '0.102', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.364', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:32,254][52650] Updated weights for policy 0, policy_version 50151 (0.0036) [2024-08-06 04:00:32,318][52669] DAMAGECOUNT value on done: 478732.0 [2024-08-06 04:00:32,320][52669] Sum rewards: 79.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.725', 'AMMO5': '0.009', 'weapon4': '0.040', 'AMMO2': '0.049', 'weapon5': '0.128', 'AMMO3': '0.238', 'AMMO4': '0.243', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.330', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '66.000'} [2024-08-06 04:00:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 410836992. Throughput: 0: 4374.9. Samples: 102709840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:00:32,794][52567] Avg episode reward: [(0, '71.473')] [2024-08-06 04:00:32,824][52820] DAMAGECOUNT value on done: 434386.0 [2024-08-06 04:00:32,824][52820] Sum rewards: 76.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.140', 'weapon5': '0.218', 'AMMO3': '0.226', 'AMMO4': '0.228', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:33,158][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 04:00:33,183][52668] DAMAGECOUNT value on done: 470655.0 [2024-08-06 04:00:33,184][52668] Sum rewards: 66.926, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '54.000'} [2024-08-06 04:00:33,397][52660] DAMAGECOUNT value on done: 473547.0 [2024-08-06 04:00:33,397][52660] Sum rewards: 68.672, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.648', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon4': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.136', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '53.500'} [2024-08-06 04:00:33,704][52665] DAMAGECOUNT value on done: 465540.0 [2024-08-06 04:00:33,706][52665] Sum rewards: 68.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.162', 'AMMO4': '0.167', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '57.000'} [2024-08-06 04:00:33,985][52671] DAMAGECOUNT value on done: 474914.0 [2024-08-06 04:00:33,986][52671] Sum rewards: 81.736, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.545', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.087', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.186', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:34,307][52795] DAMAGECOUNT value on done: 438309.0 [2024-08-06 04:00:34,308][52795] Sum rewards: 71.884, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.097', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.121', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.306', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:34,506][52662] DAMAGECOUNT value on done: 474571.0 [2024-08-06 04:00:34,507][52662] Sum rewards: 70.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.076', 'weapon4': '0.126', 'AMMO4': '0.202', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:34,902][52658] DAMAGECOUNT value on done: 471546.0 [2024-08-06 04:00:34,903][52658] Sum rewards: 71.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.908', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.154', 'weapon4': '0.170', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:35,156][52669] DAMAGECOUNT value on done: 478543.0 [2024-08-06 04:00:35,156][52669] Sum rewards: 68.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.565', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:35,889][52668] DAMAGECOUNT value on done: 472587.0 [2024-08-06 04:00:35,889][52668] Sum rewards: 84.643, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.472', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.208', 'FRAGCOUNT': '71.000'} [2024-08-06 04:00:35,964][52820] DAMAGECOUNT value on done: 436180.0 [2024-08-06 04:00:35,965][52820] Sum rewards: 74.535, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.078', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 04:00:36,063][52660] DAMAGECOUNT value on done: 474021.0 [2024-08-06 04:00:36,063][52660] Sum rewards: 73.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.078', 'AMMO4': '0.140', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:36,349][52665] DAMAGECOUNT value on done: 457631.0 [2024-08-06 04:00:36,350][52665] Sum rewards: 65.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.942', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.038', 'weapon4': '0.122', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.456', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '55.000'} [2024-08-06 04:00:36,931][52650] Updated weights for policy 0, policy_version 50161 (0.0020) [2024-08-06 04:00:36,976][52671] DAMAGECOUNT value on done: 480636.0 [2024-08-06 04:00:36,976][52671] Sum rewards: 79.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.503', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon2': '0.204', 'AMMO3': '0.221', 'weapon5': '0.226', 'AMMO4': '0.286', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '68.000'} [2024-08-06 04:00:37,476][52795] DAMAGECOUNT value on done: 427960.0 [2024-08-06 04:00:37,476][52795] Sum rewards: 68.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO4': '0.202', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:37,506][52662] DAMAGECOUNT value on done: 471996.0 [2024-08-06 04:00:37,506][52662] Sum rewards: 77.113, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.280', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.148', 'weapon5': '0.154', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.000', 'weapon3': '3.178', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 410927104. Throughput: 0: 4368.0. Samples: 102735940. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 04:00:37,794][52567] Avg episode reward: [(0, '71.574')] [2024-08-06 04:00:37,805][52658] DAMAGECOUNT value on done: 483241.0 [2024-08-06 04:00:37,807][52658] Sum rewards: 72.652, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.142', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '62.000'} [2024-08-06 04:00:38,865][52668] DAMAGECOUNT value on done: 470737.0 [2024-08-06 04:00:38,866][52668] Sum rewards: 84.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.754', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.060', 'weapon2': '0.140', 'AMMO4': '0.149', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.590', 'weapon3': '3.594', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '68.000'} [2024-08-06 04:00:39,118][52820] DAMAGECOUNT value on done: 438305.0 [2024-08-06 04:00:39,119][52820] Sum rewards: 70.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.614', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon2': '0.124', 'AMMO3': '0.186', 'WEAPON3': '1.250', 'HITCOUNT': '3.650', 'weapon3': '3.788', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:39,133][52660] DAMAGECOUNT value on done: 467560.0 [2024-08-06 04:00:39,133][52660] Sum rewards: 71.777, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO3': '0.144', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.336', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.718', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:39,293][52665] DAMAGECOUNT value on done: 462769.0 [2024-08-06 04:00:39,294][52665] Sum rewards: 82.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.954', 'AMMO5': '0.023', 'AMMO2': '0.081', 'weapon4': '0.228', 'AMMO3': '0.234', 'weapon5': '0.248', 'weapon2': '0.280', 'AMMO4': '0.407', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '68.000'} [2024-08-06 04:00:40,003][52671] DAMAGECOUNT value on done: 474658.0 [2024-08-06 04:00:40,005][52671] Sum rewards: 76.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.356', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.178', 'AMMO4': '0.183', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:40,433][52662] DAMAGECOUNT value on done: 479088.0 [2024-08-06 04:00:40,433][52662] Sum rewards: 69.623, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon4': '0.074', 'weapon5': '0.148', 'AMMO3': '0.173', 'AMMO4': '0.253', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.330', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:40,626][52658] DAMAGECOUNT value on done: 464422.0 [2024-08-06 04:00:40,626][52658] Sum rewards: 88.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.030', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.234', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '74.000'} [2024-08-06 04:00:40,638][52795] DAMAGECOUNT value on done: 446758.0 [2024-08-06 04:00:40,638][52795] Sum rewards: 60.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.224', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.224', 'weapon5': '0.270', 'AMMO4': '0.272', 'weapon2': '0.318', 'weapon4': '0.394', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.676', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '51.000'} [2024-08-06 04:00:41,811][52668] DAMAGECOUNT value on done: 475976.0 [2024-08-06 04:00:41,811][52668] Sum rewards: 70.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.224', 'weapon2': '0.348', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.416', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:41,963][52650] Updated weights for policy 0, policy_version 50171 (0.0025) [2024-08-06 04:00:42,049][52660] DAMAGECOUNT value on done: 478951.0 [2024-08-06 04:00:42,052][52660] Sum rewards: 80.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.322', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.046', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '66.000'} [2024-08-06 04:00:42,077][52665] DAMAGECOUNT value on done: 466015.0 [2024-08-06 04:00:42,078][52665] Sum rewards: 85.473, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.112', 'weapon4': '0.116', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '71.000'} [2024-08-06 04:00:42,311][52820] DAMAGECOUNT value on done: 431300.0 [2024-08-06 04:00:42,311][52820] Sum rewards: 72.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.737', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.133', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'weapon4': '0.248', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:42,787][52662] DAMAGECOUNT value on done: 472635.0 [2024-08-06 04:00:42,787][52662] Sum rewards: 66.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.124', 'AMMO3': '0.225', 'AMMO4': '0.264', 'weapon5': '0.266', 'weapon2': '0.380', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '2.964', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 411017216. Throughput: 0: 4373.1. Samples: 102762380. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 04:00:42,794][52567] Avg episode reward: [(0, '72.551')] [2024-08-06 04:00:42,795][52614] Saving new best policy, reward=72.551! [2024-08-06 04:00:42,899][52671] DAMAGECOUNT value on done: 461927.0 [2024-08-06 04:00:42,899][52671] Sum rewards: 56.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.055', 'weapon4': '0.108', 'WEAPON4': '0.150', 'weapon2': '0.204', 'AMMO3': '0.208', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.440', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '48.000'} [2024-08-06 04:00:43,456][52658] DAMAGECOUNT value on done: 473770.0 [2024-08-06 04:00:43,461][52658] Sum rewards: 66.842, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.863', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.138', 'weapon5': '0.206', 'AMMO4': '0.216', 'AMMO3': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.980', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:44,117][52795] DAMAGECOUNT value on done: 438223.0 [2024-08-06 04:00:44,117][52795] Sum rewards: 70.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.578', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.147', 'AMMO3': '0.214', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.396', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:44,846][52668] DAMAGECOUNT value on done: 471091.0 [2024-08-06 04:00:44,846][52668] Sum rewards: 74.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.004', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon5': '0.196', 'AMMO3': '0.251', 'weapon2': '0.286', 'AMMO4': '0.309', 'weapon4': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.814', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '62.000'} [2024-08-06 04:00:44,891][52665] DAMAGECOUNT value on done: 466680.0 [2024-08-06 04:00:44,893][52665] Sum rewards: 65.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.998', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.013', 'weapon4': '0.016', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.726', 'WEAPON3': '1.050', 'weapon3': '3.116', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '52.000'} [2024-08-06 04:00:45,139][52660] DAMAGECOUNT value on done: 464199.0 [2024-08-06 04:00:45,143][52660] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.695', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.229', 'weapon4': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:45,175][52659] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:00:45,330][52671] DAMAGECOUNT value on done: 482225.0 [2024-08-06 04:00:45,332][52671] Sum rewards: 71.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.625', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.092', 'AMMO4': '0.222', 'AMMO3': '0.263', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.600', 'weapon3': '2.846', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:45,599][52820] DAMAGECOUNT value on done: 441208.0 [2024-08-06 04:00:45,601][52820] Sum rewards: 78.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.003', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.046', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon5': '0.188', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 04:00:45,772][52662] DAMAGECOUNT value on done: 483637.0 [2024-08-06 04:00:45,773][52662] Sum rewards: 79.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.816', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.420', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:46,302][52650] Updated weights for policy 0, policy_version 50181 (0.0012) [2024-08-06 04:00:46,505][52820] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:00:46,578][52658] DAMAGECOUNT value on done: 470177.0 [2024-08-06 04:00:46,578][52658] Sum rewards: 77.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.492', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.173', 'weapon4': '0.188', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:46,641][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:00:47,354][52795] DAMAGECOUNT value on done: 428656.0 [2024-08-06 04:00:47,355][52795] Sum rewards: 57.386, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.588', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.164', 'AMMO3': '0.185', 'weapon4': '0.324', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.319', 'FRAGCOUNT': '47.000'} [2024-08-06 04:00:47,587][52660] DAMAGECOUNT value on done: 470292.0 [2024-08-06 04:00:47,587][52660] Sum rewards: 74.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.066', 'weapon5': '0.140', 'AMMO3': '0.199', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 411099136. Throughput: 0: 4367.8. Samples: 102775350. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 04:00:47,794][52567] Avg episode reward: [(0, '72.630')] [2024-08-06 04:00:47,798][52614] Saving new best policy, reward=72.630! [2024-08-06 04:00:48,125][52665] DAMAGECOUNT value on done: 473779.0 [2024-08-06 04:00:48,127][52665] Sum rewards: 74.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO4': '0.157', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.202', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '63.000'} [2024-08-06 04:00:48,298][52671] DAMAGECOUNT value on done: 479211.0 [2024-08-06 04:00:48,298][52671] Sum rewards: 72.209, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.896', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.132', 'AMMO4': '0.151', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '62.000'} [2024-08-06 04:00:48,722][52820] DAMAGECOUNT value on done: 431662.0 [2024-08-06 04:00:48,724][52820] Sum rewards: 72.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.260', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.024', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.258', 'WEAPON3': '1.650', 'weapon3': '3.572', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '62.000'} [2024-08-06 04:00:48,875][52662] DAMAGECOUNT value on done: 477807.0 [2024-08-06 04:00:48,878][52662] Sum rewards: 76.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.405', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.176', 'weapon5': '0.176', 'AMMO4': '0.184', 'weapon4': '0.304', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:50,000][52658] DAMAGECOUNT value on done: 470648.0 [2024-08-06 04:00:50,003][52658] Sum rewards: 76.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.949', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.116', 'AMMO4': '0.237', 'AMMO3': '0.250', 'weapon2': '0.286', 'weapon5': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:50,625][52795] DAMAGECOUNT value on done: 439080.0 [2024-08-06 04:00:50,627][52795] Sum rewards: 60.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.184', 'AMMO3': '0.202', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.372', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '50.000'} [2024-08-06 04:00:50,650][52660] DAMAGECOUNT value on done: 480135.0 [2024-08-06 04:00:50,652][52660] Sum rewards: 68.413, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.184', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.186', 'AMMO3': '0.222', 'AMMO4': '0.293', 'weapon2': '0.314', 'weapon4': '0.434', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '56.500'} [2024-08-06 04:00:50,893][52671] DAMAGECOUNT value on done: 480995.0 [2024-08-06 04:00:50,893][52671] Sum rewards: 74.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.102', 'weapon5': '0.124', 'AMMO3': '0.210', 'AMMO4': '0.213', 'weapon2': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:51,319][52650] Updated weights for policy 0, policy_version 50191 (0.0030) [2024-08-06 04:00:51,436][52665] DAMAGECOUNT value on done: 466402.0 [2024-08-06 04:00:51,439][52665] Sum rewards: 69.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.710', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:51,977][52820] DAMAGECOUNT value on done: 434451.0 [2024-08-06 04:00:51,981][52820] Sum rewards: 75.440, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.388', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.166', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.288', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '60.000'} [2024-08-06 04:00:52,185][52662] DAMAGECOUNT value on done: 471210.0 [2024-08-06 04:00:52,186][52662] Sum rewards: 71.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.084', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 411197440. Throughput: 0: 4366.2. Samples: 102801430. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 04:00:52,794][52567] Avg episode reward: [(0, '72.476')] [2024-08-06 04:00:52,924][52658] DAMAGECOUNT value on done: 465168.0 [2024-08-06 04:00:52,926][52658] Sum rewards: 63.081, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.720', 'AMMO5': '0.020', 'AMMO2': '0.072', 'weapon5': '0.136', 'weapon4': '0.166', 'AMMO3': '0.268', 'AMMO4': '0.359', 'weapon2': '0.388', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '58.000'} [2024-08-06 04:00:53,418][52660] DAMAGECOUNT value on done: 485084.0 [2024-08-06 04:00:53,418][52660] Sum rewards: 65.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.725', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.046', 'weapon5': '0.080', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.464', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '56.000'} [2024-08-06 04:00:53,823][52671] DAMAGECOUNT value on done: 478025.0 [2024-08-06 04:00:53,824][52671] Sum rewards: 81.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '66.000'} [2024-08-06 04:00:53,852][52795] DAMAGECOUNT value on done: 440823.0 [2024-08-06 04:00:53,852][52795] Sum rewards: 65.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.018', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.210', 'AMMO3': '0.222', 'weapon2': '0.240', 'weapon5': '0.256', 'AMMO4': '0.264', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '54.000'} [2024-08-06 04:00:54,190][52665] DAMAGECOUNT value on done: 475279.0 [2024-08-06 04:00:54,201][52665] Sum rewards: 67.796, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.600', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.299', 'weapon2': '0.310', 'WEAPON3': '1.850', 'weapon3': '3.320', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:55,143][52820] DAMAGECOUNT value on done: 438754.0 [2024-08-06 04:00:55,145][52820] Sum rewards: 69.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.968', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.074', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.231', 'WEAPON3': '1.450', 'HITCOUNT': '3.340', 'weapon3': '3.508', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:55,305][52662] DAMAGECOUNT value on done: 471915.0 [2024-08-06 04:00:55,305][52662] Sum rewards: 70.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.114', 'AMMO3': '0.227', 'weapon2': '0.300', 'weapon5': '0.304', 'AMMO4': '0.322', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:55,618][52650] Updated weights for policy 0, policy_version 50201 (0.0025) [2024-08-06 04:00:55,829][52658] DAMAGECOUNT value on done: 480103.0 [2024-08-06 04:00:55,831][52658] Sum rewards: 75.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.323', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.080', 'weapon5': '0.084', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.270', 'weapon2': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.310', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:56,320][52660] DAMAGECOUNT value on done: 468584.0 [2024-08-06 04:00:56,322][52660] Sum rewards: 66.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.093', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.150', 'AMMO4': '0.216', 'AMMO3': '0.270', 'weapon2': '0.322', 'weapon5': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.720', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 04:00:56,671][52671] DAMAGECOUNT value on done: 472274.0 [2024-08-06 04:00:56,671][52671] Sum rewards: 69.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.014', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.235', 'weapon2': '0.576', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '59.000'} [2024-08-06 04:00:57,118][52794] DAMAGECOUNT value on done: 474054.0 [2024-08-06 04:00:57,120][52794] Sum rewards: 64.320, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.182', 'AMMO3': '0.197', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '52.000'} [2024-08-06 04:00:57,384][52665] DAMAGECOUNT value on done: 471982.0 [2024-08-06 04:00:57,388][52665] Sum rewards: 79.215, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.066', 'AMMO4': '0.069', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.349', 'WEAPON3': '1.950', 'weapon3': '3.306', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '70.000'} [2024-08-06 04:00:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 411271168. Throughput: 0: 4364.5. Samples: 102827720. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 04:00:57,795][52567] Avg episode reward: [(0, '71.838')] [2024-08-06 04:00:58,297][52658] DAMAGECOUNT value on done: 471472.0 [2024-08-06 04:00:58,299][52658] Sum rewards: 71.984, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.767', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.316', 'weapon2': '0.320', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '2.930', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '65.000'} [2024-08-06 04:00:58,345][52820] DAMAGECOUNT value on done: 434591.0 [2024-08-06 04:00:58,346][52820] Sum rewards: 68.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.110', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 04:00:58,508][52662] DAMAGECOUNT value on done: 468842.0 [2024-08-06 04:00:58,516][52662] Sum rewards: 73.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'weapon5': '0.052', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.766', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '61.000'} [2024-08-06 04:00:59,179][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:00:59,352][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:00:59,434][52660] DAMAGECOUNT value on done: 475588.0 [2024-08-06 04:00:59,435][52660] Sum rewards: 74.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.055', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.256', 'weapon2': '0.286', 'WEAPON3': '1.550', 'weapon3': '3.444', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '64.000'} [2024-08-06 04:00:59,980][52794] DAMAGECOUNT value on done: 478148.0 [2024-08-06 04:00:59,980][52794] Sum rewards: 70.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.135', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.078', 'AMMO3': '0.191', 'weapon5': '0.214', 'AMMO4': '0.215', 'weapon2': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '56.000'} [2024-08-06 04:01:00,442][52665] DAMAGECOUNT value on done: 467597.0 [2024-08-06 04:01:00,442][52665] Sum rewards: 69.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.090', 'AMMO4': '0.145', 'weapon5': '0.166', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:00,618][52650] Updated weights for policy 0, policy_version 50211 (0.0027) [2024-08-06 04:01:01,244][52658] DAMAGECOUNT value on done: 473719.0 [2024-08-06 04:01:01,247][52658] Sum rewards: 68.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.595', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.090', 'AMMO3': '0.187', 'AMMO4': '0.206', 'weapon5': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '56.000'} [2024-08-06 04:01:01,649][52820] DAMAGECOUNT value on done: 444645.0 [2024-08-06 04:01:01,649][52820] Sum rewards: 76.371, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.020', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '64.000'} [2024-08-06 04:01:02,505][52660] DAMAGECOUNT value on done: 469590.0 [2024-08-06 04:01:02,509][52660] Sum rewards: 88.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.142', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.174', 'AMMO4': '0.213', 'AMMO3': '0.233', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.213', 'FRAGCOUNT': '72.000'} [2024-08-06 04:01:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 411361280. Throughput: 0: 4358.3. Samples: 102840670. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 04:01:02,794][52567] Avg episode reward: [(0, '71.979')] [2024-08-06 04:01:02,862][52794] DAMAGECOUNT value on done: 477481.0 [2024-08-06 04:01:02,862][52794] Sum rewards: 85.394, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.880', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.180', 'weapon4': '0.252', 'WEAPON3': '1.200', 'weapon3': '3.338', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '68.000'} [2024-08-06 04:01:03,812][52665] DAMAGECOUNT value on done: 464762.0 [2024-08-06 04:01:03,813][52665] Sum rewards: 64.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.834', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.102', 'AMMO3': '0.216', 'AMMO4': '0.237', 'weapon5': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.200', 'HITCOUNT': '2.690', 'weapon3': '2.884', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '54.000'} [2024-08-06 04:01:04,266][52658] DAMAGECOUNT value on done: 478011.0 [2024-08-06 04:01:04,266][52658] Sum rewards: 74.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.772', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.112', 'weapon5': '0.210', 'AMMO3': '0.242', 'weapon2': '0.280', 'AMMO4': '0.319', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.124', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '63.000'} [2024-08-06 04:01:04,801][52820] DAMAGECOUNT value on done: 433791.0 [2024-08-06 04:01:04,802][52820] Sum rewards: 78.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.984', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.121', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '63.000'} [2024-08-06 04:01:05,302][52650] Updated weights for policy 0, policy_version 50221 (0.0012) [2024-08-06 04:01:05,327][52660] DAMAGECOUNT value on done: 470977.0 [2024-08-06 04:01:05,329][52660] Sum rewards: 72.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.184', 'AMMO3': '0.221', 'weapon4': '0.234', 'AMMO4': '0.271', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:06,076][52794] DAMAGECOUNT value on done: 469284.0 [2024-08-06 04:01:06,077][52794] Sum rewards: 60.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.004', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.264', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.380', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '53.000'} [2024-08-06 04:01:06,287][52667] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:01:06,617][52665] DAMAGECOUNT value on done: 469115.0 [2024-08-06 04:01:06,619][52665] Sum rewards: 68.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.545', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.194', 'weapon5': '0.200', 'weapon4': '0.298', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 411451392. Throughput: 0: 4352.9. Samples: 102866880. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 04:01:07,794][52567] Avg episode reward: [(0, '72.036')] [2024-08-06 04:01:07,845][52820] DAMAGECOUNT value on done: 438158.0 [2024-08-06 04:01:07,846][52820] Sum rewards: 68.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.615', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.252', 'weapon2': '0.414', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.358', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:08,246][52660] DAMAGECOUNT value on done: 465202.0 [2024-08-06 04:01:08,247][52660] Sum rewards: 63.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO2': '0.009', 'AMMO5': '0.011', 'weapon4': '0.016', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.322', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '54.000'} [2024-08-06 04:01:08,962][52794] DAMAGECOUNT value on done: 471362.0 [2024-08-06 04:01:08,962][52794] Sum rewards: 63.852, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.901', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.164', 'AMMO3': '0.245', 'AMMO4': '0.315', 'weapon5': '0.322', 'weapon2': '0.398', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.614', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '54.000'} [2024-08-06 04:01:09,591][52665] DAMAGECOUNT value on done: 463107.0 [2024-08-06 04:01:09,591][52665] Sum rewards: 62.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.158', 'AMMO4': '0.168', 'weapon5': '0.174', 'AMMO3': '0.177', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '50.000'} [2024-08-06 04:01:10,114][52650] Updated weights for policy 0, policy_version 50231 (0.0025) [2024-08-06 04:01:10,973][52820] DAMAGECOUNT value on done: 443403.0 [2024-08-06 04:01:10,976][52820] Sum rewards: 76.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.184', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.180', 'weapon4': '0.196', 'weapon5': '0.214', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '62.000'} [2024-08-06 04:01:11,209][52647] DAMAGECOUNT value on done: 498247.0 [2024-08-06 04:01:11,209][52647] Sum rewards: 73.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.180', 'AMMO5': '0.023', 'AMMO2': '0.080', 'AMMO3': '0.219', 'weapon4': '0.238', 'weapon2': '0.248', 'weapon5': '0.300', 'AMMO4': '0.402', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.864', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '62.000'} [2024-08-06 04:01:11,221][52659] DAMAGECOUNT value on done: 474864.0 [2024-08-06 04:01:11,221][52659] Sum rewards: 82.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.342', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.158', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '65.000'} [2024-08-06 04:01:11,555][52794] DAMAGECOUNT value on done: 475523.0 [2024-08-06 04:01:11,556][52794] Sum rewards: 77.120, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.125', 'weapon5': '0.136', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '62.000'} [2024-08-06 04:01:12,259][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:01:12,731][52665] DAMAGECOUNT value on done: 464476.0 [2024-08-06 04:01:12,731][52665] Sum rewards: 69.853, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.590', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.214', 'AMMO4': '0.224', 'AMMO3': '0.298', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.052', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '60.500'} [2024-08-06 04:01:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 411533312. Throughput: 0: 4361.6. Samples: 102893420. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 04:01:12,794][52567] Avg episode reward: [(0, '72.090')] [2024-08-06 04:01:13,741][52647] DAMAGECOUNT value on done: 498887.0 [2024-08-06 04:01:13,743][52647] Sum rewards: 72.480, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.138', 'weapon5': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.578', 'WEAPON3': '0.750', 'HEALTH': '0.830', 'weapon3': '2.626', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '56.000'} [2024-08-06 04:01:14,162][52820] DAMAGECOUNT value on done: 437264.0 [2024-08-06 04:01:14,163][52820] Sum rewards: 57.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.382', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.246', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.068', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '48.000'} [2024-08-06 04:01:14,176][52659] DAMAGECOUNT value on done: 472860.0 [2024-08-06 04:01:14,176][52659] Sum rewards: 74.483, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.098', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.316', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '61.000'} [2024-08-06 04:01:14,283][52794] DAMAGECOUNT value on done: 479743.0 [2024-08-06 04:01:14,285][52794] Sum rewards: 67.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.104', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO4': '0.169', 'AMMO3': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.000'} [2024-08-06 04:01:14,470][52650] Updated weights for policy 0, policy_version 50241 (0.0010) [2024-08-06 04:01:16,107][52664] DAMAGECOUNT value on done: 491596.0 [2024-08-06 04:01:16,107][52664] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.102', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '3.060', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.500'} [2024-08-06 04:01:16,163][52665] DAMAGECOUNT value on done: 463709.0 [2024-08-06 04:01:16,163][52665] Sum rewards: 55.177, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.814', 'AMMO5': '0.023', 'AMMO2': '0.077', 'weapon4': '0.230', 'weapon5': '0.326', 'AMMO3': '0.342', 'AMMO4': '0.384', 'weapon2': '0.426', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.950', 'weapon3': '2.588', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '50.000'} [2024-08-06 04:01:16,269][52647] DAMAGECOUNT value on done: 495882.0 [2024-08-06 04:01:16,270][52647] Sum rewards: 75.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.235', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.295', 'WEAPON3': '1.800', 'weapon3': '3.448', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '66.000'} [2024-08-06 04:01:17,144][52794] DAMAGECOUNT value on done: 467924.0 [2024-08-06 04:01:17,146][52794] Sum rewards: 61.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.112', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.179', 'weapon2': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.196', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '51.000'} [2024-08-06 04:01:17,185][52659] DAMAGECOUNT value on done: 477442.0 [2024-08-06 04:01:17,186][52659] Sum rewards: 62.517, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.711', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.147', 'weapon5': '0.218', 'AMMO3': '0.232', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.228', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '52.500'} [2024-08-06 04:01:17,257][52820] DAMAGECOUNT value on done: 443586.0 [2024-08-06 04:01:17,257][52820] Sum rewards: 72.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.424', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.156', 'weapon2': '0.178', 'weapon5': '0.188', 'AMMO3': '0.215', 'AMMO4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.272', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 411631616. Throughput: 0: 4373.1. Samples: 102906630. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 04:01:17,795][52567] Avg episode reward: [(0, '71.741')] [2024-08-06 04:01:18,777][52664] DAMAGECOUNT value on done: 497417.0 [2024-08-06 04:01:18,778][52664] Sum rewards: 72.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.143', 'weapon2': '0.192', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '61.000'} [2024-08-06 04:01:18,946][52647] DAMAGECOUNT value on done: 507252.0 [2024-08-06 04:01:18,947][52647] Sum rewards: 85.689, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.170', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.217', 'weapon2': '0.248', 'WEAPON3': '1.250', 'weapon3': '3.596', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '70.000'} [2024-08-06 04:01:19,111][52665] DAMAGECOUNT value on done: 464552.0 [2024-08-06 04:01:19,112][52665] Sum rewards: 77.185, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.544', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.128', 'weapon5': '0.168', 'AMMO4': '0.169', 'AMMO3': '0.235', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '66.000'} [2024-08-06 04:01:19,281][52650] Updated weights for policy 0, policy_version 50251 (0.0011) [2024-08-06 04:01:19,988][52794] DAMAGECOUNT value on done: 477494.0 [2024-08-06 04:01:19,988][52794] Sum rewards: 82.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.060', 'AMMO4': '0.090', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '70.000'} [2024-08-06 04:01:20,109][52659] DAMAGECOUNT value on done: 472704.0 [2024-08-06 04:01:20,112][52659] Sum rewards: 73.699, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.133', 'weapon2': '0.200', 'weapon4': '0.302', 'WEAPON3': '0.900', 'weapon3': '3.340', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '59.000'} [2024-08-06 04:01:20,407][52820] DAMAGECOUNT value on done: 437600.0 [2024-08-06 04:01:20,407][52820] Sum rewards: 82.005, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.138', 'weapon4': '0.142', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '65.000'} [2024-08-06 04:01:20,481][52663] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:01:20,657][52669] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:01:21,393][52664] DAMAGECOUNT value on done: 496382.0 [2024-08-06 04:01:21,396][52664] Sum rewards: 56.622, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.133', 'weapon4': '0.138', 'AMMO3': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.288', 'weapon2': '0.548', 'WEAPON3': '0.850', 'HITCOUNT': '2.680', 'weapon3': '3.078', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '45.000'} [2024-08-06 04:01:21,632][52647] DAMAGECOUNT value on done: 503421.0 [2024-08-06 04:01:21,632][52647] Sum rewards: 75.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '64.000'} [2024-08-06 04:01:22,273][52665] DAMAGECOUNT value on done: 468315.0 [2024-08-06 04:01:22,273][52665] Sum rewards: 65.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.475', 'AMMO5': '0.018', 'AMMO2': '0.063', 'AMMO3': '0.175', 'weapon5': '0.304', 'weapon4': '0.306', 'AMMO4': '0.317', 'weapon2': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.760', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 04:01:22,677][52659] DAMAGECOUNT value on done: 470888.0 [2024-08-06 04:01:22,679][52659] Sum rewards: 66.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.088', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.201', 'weapon2': '0.670', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '55.000'} [2024-08-06 04:01:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 411713536. Throughput: 0: 4380.2. Samples: 102933050. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 04:01:22,795][52567] Avg episode reward: [(0, '71.825')] [2024-08-06 04:01:23,302][52794] DAMAGECOUNT value on done: 472894.0 [2024-08-06 04:01:23,302][52794] Sum rewards: 71.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.006', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.204', 'weapon2': '0.206', 'AMMO4': '0.209', 'weapon5': '0.242', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:23,535][52650] Updated weights for policy 0, policy_version 50261 (0.0030) [2024-08-06 04:01:23,600][52820] DAMAGECOUNT value on done: 439040.0 [2024-08-06 04:01:23,601][52820] Sum rewards: 72.371, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.775', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.118', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.000', 'weapon3': '3.084', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:24,088][52664] DAMAGECOUNT value on done: 486401.0 [2024-08-06 04:01:24,096][52664] Sum rewards: 62.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.074', 'weapon5': '0.132', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.608', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.010', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '53.000'} [2024-08-06 04:01:24,393][52647] DAMAGECOUNT value on done: 501824.0 [2024-08-06 04:01:24,394][52647] Sum rewards: 77.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.878', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.156', 'weapon2': '0.186', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 04:01:25,747][52659] DAMAGECOUNT value on done: 475559.0 [2024-08-06 04:01:25,748][52659] Sum rewards: 69.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.192', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.210', 'weapon4': '0.258', 'AMMO4': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:25,832][52649] DAMAGECOUNT value on done: 458052.0 [2024-08-06 04:01:25,833][52649] Sum rewards: 69.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.128', 'weapon5': '0.186', 'AMMO3': '0.246', 'AMMO4': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:26,230][52794] DAMAGECOUNT value on done: 470090.0 [2024-08-06 04:01:26,232][52794] Sum rewards: 78.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.652', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.102', 'weapon5': '0.120', 'AMMO4': '0.138', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '65.000'} [2024-08-06 04:01:26,721][52820] DAMAGECOUNT value on done: 449888.0 [2024-08-06 04:01:26,722][52820] Sum rewards: 72.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.192', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.211', 'weapon4': '0.240', 'AMMO4': '0.278', 'weapon5': '0.282', 'weapon2': '0.496', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.642', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:27,356][52664] DAMAGECOUNT value on done: 495215.0 [2024-08-06 04:01:27,357][52664] Sum rewards: 71.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.228', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'weapon2': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.550', 'HITCOUNT': '3.470', 'weapon3': '3.600', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '61.000'} [2024-08-06 04:01:27,547][52647] DAMAGECOUNT value on done: 499069.0 [2024-08-06 04:01:27,547][52647] Sum rewards: 68.881, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.445', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.140', 'weapon2': '0.174', 'weapon5': '0.212', 'AMMO4': '0.221', 'WEAPON5': '0.450', 'weapon4': '0.578', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.798', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '56.000'} [2024-08-06 04:01:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 411803648. Throughput: 0: 4368.9. Samples: 102958980. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 04:01:27,794][52567] Avg episode reward: [(0, '71.586')] [2024-08-06 04:01:28,451][52650] Updated weights for policy 0, policy_version 50271 (0.0020) [2024-08-06 04:01:28,518][52649] DAMAGECOUNT value on done: 451726.0 [2024-08-06 04:01:28,518][52649] Sum rewards: 68.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.667', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.086', 'weapon5': '0.164', 'AMMO3': '0.262', 'AMMO4': '0.293', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.600', 'weapon3': '2.990', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:28,951][52659] DAMAGECOUNT value on done: 472378.0 [2024-08-06 04:01:28,951][52659] Sum rewards: 57.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.480', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.162', 'weapon5': '0.180', 'AMMO4': '0.189', 'AMMO3': '0.267', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.650', 'HITCOUNT': '2.860', 'weapon3': '2.862', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '51.000'} [2024-08-06 04:01:29,099][52794] DAMAGECOUNT value on done: 478894.0 [2024-08-06 04:01:29,107][52794] Sum rewards: 73.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.164', 'weapon4': '0.180', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:29,853][52820] DAMAGECOUNT value on done: 449167.0 [2024-08-06 04:01:29,854][52820] Sum rewards: 67.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.086', 'weapon5': '0.162', 'AMMO3': '0.232', 'AMMO4': '0.240', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '59.000'} [2024-08-06 04:01:30,591][52664] DAMAGECOUNT value on done: 491005.0 [2024-08-06 04:01:30,592][52664] Sum rewards: 60.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.540', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.015', 'weapon4': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.458', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.252', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '52.000'} [2024-08-06 04:01:30,705][52647] DAMAGECOUNT value on done: 494032.0 [2024-08-06 04:01:30,707][52647] Sum rewards: 72.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.296', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.218', 'AMMO4': '0.243', 'weapon2': '0.258', 'weapon5': '0.302', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:31,005][52649] DAMAGECOUNT value on done: 466228.0 [2024-08-06 04:01:31,005][52649] Sum rewards: 61.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.545', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon2': '0.182', 'weapon4': '0.192', 'AMMO4': '0.231', 'weapon5': '0.234', 'AMMO3': '0.265', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.880', 'weapon3': '3.056', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '54.000'} [2024-08-06 04:01:31,550][52794] DAMAGECOUNT value on done: 466250.0 [2024-08-06 04:01:31,552][52794] Sum rewards: 66.033, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.836', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.282', 'weapon2': '0.302', 'WEAPON3': '1.650', 'HITCOUNT': '3.320', 'weapon3': '3.348', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:32,289][52659] DAMAGECOUNT value on done: 473164.0 [2024-08-06 04:01:32,291][52659] Sum rewards: 71.068, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.750', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO4': '0.223', 'AMMO3': '0.234', 'weapon5': '0.236', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.820', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 411893760. Throughput: 0: 4373.8. Samples: 102972170. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 04:01:32,794][52567] Avg episode reward: [(0, '70.702')] [2024-08-06 04:01:33,010][52820] DAMAGECOUNT value on done: 435083.0 [2024-08-06 04:01:33,012][52820] Sum rewards: 71.354, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '59.000'} [2024-08-06 04:01:33,328][52650] Updated weights for policy 0, policy_version 50281 (0.0031) [2024-08-06 04:01:33,636][52649] DAMAGECOUNT value on done: 458704.0 [2024-08-06 04:01:33,636][52649] Sum rewards: 85.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.860', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.128', 'weapon5': '0.162', 'AMMO4': '0.183', 'AMMO3': '0.203', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '71.000'} [2024-08-06 04:01:33,781][52794] DAMAGECOUNT value on done: 486625.0 [2024-08-06 04:01:33,781][52794] Sum rewards: 71.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.054', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:33,825][52664] DAMAGECOUNT value on done: 489672.0 [2024-08-06 04:01:33,825][52664] Sum rewards: 60.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO3': '0.152', 'weapon4': '0.188', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.578', 'WEAPON3': '0.850', 'weapon3': '2.858', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '48.000'} [2024-08-06 04:01:33,930][52647] DAMAGECOUNT value on done: 503611.0 [2024-08-06 04:01:33,933][52647] Sum rewards: 68.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.471', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.106', 'AMMO3': '0.176', 'weapon5': '0.184', 'AMMO4': '0.217', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.880', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:35,212][52659] DAMAGECOUNT value on done: 479482.0 [2024-08-06 04:01:35,214][52659] Sum rewards: 63.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.715', 'AMMO5': '0.014', 'AMMO2': '0.063', 'AMMO3': '0.219', 'weapon5': '0.244', 'weapon4': '0.292', 'AMMO4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '54.000'} [2024-08-06 04:01:35,594][52668] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:01:36,609][52649] DAMAGECOUNT value on done: 451630.0 [2024-08-06 04:01:36,610][52649] Sum rewards: 73.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.700', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.214', 'weapon2': '0.242', 'WEAPON3': '1.250', 'weapon3': '3.438', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '61.000'} [2024-08-06 04:01:36,625][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:01:36,953][52664] DAMAGECOUNT value on done: 485421.0 [2024-08-06 04:01:36,955][52664] Sum rewards: 68.171, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.070', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.112', 'weapon4': '0.170', 'AMMO4': '0.231', 'weapon2': '0.278', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.164', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:37,014][52647] DAMAGECOUNT value on done: 496582.0 [2024-08-06 04:01:37,016][52647] Sum rewards: 76.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.794', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '65.000'} [2024-08-06 04:01:37,038][52794] DAMAGECOUNT value on done: 466796.0 [2024-08-06 04:01:37,041][52794] Sum rewards: 64.726, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.482', 'weapon2': '0.720', 'WEAPON3': '1.300', 'weapon3': '2.516', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '53.000'} [2024-08-06 04:01:37,672][52659] DAMAGECOUNT value on done: 484318.0 [2024-08-06 04:01:37,672][52659] Sum rewards: 66.398, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.491', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.058', 'AMMO3': '0.199', 'AMMO4': '0.211', 'weapon5': '0.242', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.070', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '53.000'} [2024-08-06 04:01:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 411975680. Throughput: 0: 4374.2. Samples: 102998270. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:01:37,795][52567] Avg episode reward: [(0, '70.595')] [2024-08-06 04:01:38,007][52650] Updated weights for policy 0, policy_version 50291 (0.0012) [2024-08-06 04:01:38,294][52669] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:01:39,251][52649] DAMAGECOUNT value on done: 464570.0 [2024-08-06 04:01:39,252][52649] Sum rewards: 72.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.390', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.119', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2024-08-06 04:01:39,832][52664] DAMAGECOUNT value on done: 497042.0 [2024-08-06 04:01:39,832][52664] Sum rewards: 71.855, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.634', 'AMMO5': '0.007', 'ARMOR': '0.020', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.430', 'weapon4': '0.502', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '56.000'} [2024-08-06 04:01:39,851][52647] DAMAGECOUNT value on done: 500459.0 [2024-08-06 04:01:39,851][52647] Sum rewards: 86.390, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.788', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.124', 'weapon5': '0.178', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.550', 'weapon3': '3.272', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.267', 'FRAGCOUNT': '72.000'} [2024-08-06 04:01:40,077][52794] DAMAGECOUNT value on done: 485121.0 [2024-08-06 04:01:40,080][52794] Sum rewards: 84.882, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.018', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.178', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.606', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.964', 'FRAGCOUNT': '71.000'} [2024-08-06 04:01:40,351][52659] DAMAGECOUNT value on done: 472960.0 [2024-08-06 04:01:40,359][52659] Sum rewards: 61.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.291', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.230', 'weapon2': '0.430', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '2.986', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '52.000'} [2024-08-06 04:01:41,823][52649] DAMAGECOUNT value on done: 459816.0 [2024-08-06 04:01:41,824][52649] Sum rewards: 70.185, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.307', 'AMMO5': '0.021', 'AMMO2': '0.066', 'AMMO3': '0.194', 'weapon5': '0.290', 'AMMO4': '0.331', 'weapon4': '0.396', 'weapon2': '0.444', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.590', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:42,495][52650] Updated weights for policy 0, policy_version 50301 (0.0012) [2024-08-06 04:01:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 412065792. Throughput: 0: 4374.9. Samples: 103024590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:01:42,794][52567] Avg episode reward: [(0, '70.807')] [2024-08-06 04:01:42,979][52647] DAMAGECOUNT value on done: 490951.0 [2024-08-06 04:01:42,981][52647] Sum rewards: 75.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.773', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.123', 'weapon5': '0.130', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'weapon3': '3.332', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '64.000'} [2024-08-06 04:01:42,996][52664] DAMAGECOUNT value on done: 488314.0 [2024-08-06 04:01:42,997][52664] Sum rewards: 70.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.254', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.022', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.214', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.642', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '59.000'} [2024-08-06 04:01:43,157][52659] DAMAGECOUNT value on done: 477430.0 [2024-08-06 04:01:43,157][52659] Sum rewards: 71.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.938', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.103', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 04:01:43,264][52794] DAMAGECOUNT value on done: 475230.0 [2024-08-06 04:01:43,266][52794] Sum rewards: 72.356, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.405', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.157', 'weapon4': '0.160', 'AMMO4': '0.207', 'weapon5': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:44,678][52649] DAMAGECOUNT value on done: 464233.0 [2024-08-06 04:01:44,678][52649] Sum rewards: 69.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.431', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.100', 'weapon4': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.582', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 04:01:45,841][52647] DAMAGECOUNT value on done: 501714.0 [2024-08-06 04:01:45,842][52647] Sum rewards: 64.107, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.899', 'AMMO5': '0.011', 'weapon5': '0.038', 'AMMO2': '0.045', 'weapon4': '0.178', 'AMMO4': '0.227', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.272', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:45,916][52659] DAMAGECOUNT value on done: 467969.0 [2024-08-06 04:01:45,916][52659] Sum rewards: 73.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.715', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.342', 'weapon4': '0.364', 'WEAPON3': '1.050', 'weapon3': '2.940', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '59.000'} [2024-08-06 04:01:45,927][52664] DAMAGECOUNT value on done: 499505.0 [2024-08-06 04:01:45,929][52664] Sum rewards: 77.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.084', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '64.000'} [2024-08-06 04:01:46,245][52794] DAMAGECOUNT value on done: 479011.0 [2024-08-06 04:01:46,247][52794] Sum rewards: 78.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.380', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.094', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.286', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '66.000'} [2024-08-06 04:01:47,370][52650] Updated weights for policy 0, policy_version 50311 (0.0012) [2024-08-06 04:01:47,427][52649] DAMAGECOUNT value on done: 465172.0 [2024-08-06 04:01:47,428][52649] Sum rewards: 72.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 412155904. Throughput: 0: 4371.8. Samples: 103037400. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:01:47,794][52567] Avg episode reward: [(0, '70.991')] [2024-08-06 04:01:48,562][52659] DAMAGECOUNT value on done: 475649.0 [2024-08-06 04:01:48,563][52659] Sum rewards: 69.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.814', 'AMMO5': '0.015', 'AMMO2': '0.056', 'AMMO3': '0.176', 'weapon5': '0.218', 'weapon4': '0.232', 'AMMO4': '0.281', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.836', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '55.000'} [2024-08-06 04:01:48,668][52666] DAMAGECOUNT value on done: 470414.0 [2024-08-06 04:01:48,668][52666] Sum rewards: 82.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.241', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '69.000'} [2024-08-06 04:01:48,704][52647] DAMAGECOUNT value on done: 496736.0 [2024-08-06 04:01:48,704][52647] Sum rewards: 90.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.554', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.170', 'weapon4': '0.186', 'AMMO4': '0.194', 'AMMO3': '0.194', 'weapon2': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '73.000'} [2024-08-06 04:01:48,809][52664] DAMAGECOUNT value on done: 494366.0 [2024-08-06 04:01:48,810][52664] Sum rewards: 75.465, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.058', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.299', 'WEAPON3': '1.750', 'weapon3': '3.240', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '67.000'} [2024-08-06 04:01:49,034][52794] DAMAGECOUNT value on done: 480930.0 [2024-08-06 04:01:49,034][52794] Sum rewards: 68.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.951', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.124', 'weapon5': '0.150', 'AMMO4': '0.160', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.524', 'weapon2': '0.562', 'WEAPON3': '0.900', 'weapon3': '2.506', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '55.000'} [2024-08-06 04:01:50,646][52649] DAMAGECOUNT value on done: 459375.0 [2024-08-06 04:01:50,648][52649] Sum rewards: 73.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.484', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.288', 'WEAPON3': '1.050', 'weapon3': '3.236', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '59.000'} [2024-08-06 04:01:51,266][52670] DAMAGECOUNT value on done: 463573.0 [2024-08-06 04:01:51,275][52670] Sum rewards: 79.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.194', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '66.000'} [2024-08-06 04:01:51,311][52666] DAMAGECOUNT value on done: 475571.0 [2024-08-06 04:01:51,312][52666] Sum rewards: 54.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.192', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.156', 'weapon5': '0.210', 'AMMO4': '0.245', 'weapon4': '0.262', 'weapon2': '0.338', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'HITCOUNT': '2.710', 'weapon3': '2.970', 'DAMAGECOUNT': '13.548', 'FRAGCOUNT': '47.000'} [2024-08-06 04:01:51,343][52659] DAMAGECOUNT value on done: 485901.0 [2024-08-06 04:01:51,345][52659] Sum rewards: 72.025, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon4': '0.218', 'weapon5': '0.228', 'AMMO3': '0.241', 'weapon2': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '61.000'} [2024-08-06 04:01:51,416][52647] DAMAGECOUNT value on done: 505774.0 [2024-08-06 04:01:51,416][52647] Sum rewards: 80.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.209', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.138', 'AMMO4': '0.155', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '66.000'} [2024-08-06 04:01:51,542][52664] DAMAGECOUNT value on done: 501588.0 [2024-08-06 04:01:51,543][52664] Sum rewards: 77.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.469', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '64.000'} [2024-08-06 04:01:51,765][52663] DAMAGECOUNT value on done: 481083.0 [2024-08-06 04:01:51,765][52663] Sum rewards: 81.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.165', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.059', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.474', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '71.000'} [2024-08-06 04:01:51,895][52650] Updated weights for policy 0, policy_version 50321 (0.0020) [2024-08-06 04:01:52,203][52794] DAMAGECOUNT value on done: 472744.0 [2024-08-06 04:01:52,203][52794] Sum rewards: 67.321, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'HEALTH': '0.240', 'weapon4': '0.330', 'weapon2': '0.724', 'WEAPON3': '0.900', 'weapon3': '2.680', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.243', 'FRAGCOUNT': '53.000'} [2024-08-06 04:01:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.1). Total num frames: 412237824. Throughput: 0: 4378.4. Samples: 103063910. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:01:52,794][52567] Avg episode reward: [(0, '71.534')] [2024-08-06 04:01:53,749][52670] DAMAGECOUNT value on done: 476777.0 [2024-08-06 04:01:53,749][52670] Sum rewards: 76.111, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.974', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.070', 'AMMO4': '0.268', 'AMMO3': '0.294', 'weapon5': '0.296', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.870', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '66.500'} [2024-08-06 04:01:53,805][52666] DAMAGECOUNT value on done: 478382.0 [2024-08-06 04:01:53,806][52666] Sum rewards: 75.228, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.796', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.100', 'AMMO4': '0.152', 'weapon5': '0.164', 'AMMO3': '0.253', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '65.000'} [2024-08-06 04:01:54,041][52649] DAMAGECOUNT value on done: 467109.0 [2024-08-06 04:01:54,044][52649] Sum rewards: 58.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.015', 'weapon4': '0.046', 'AMMO2': '0.050', 'weapon5': '0.136', 'weapon2': '0.222', 'AMMO4': '0.248', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.326', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '51.000'} [2024-08-06 04:01:54,265][52647] DAMAGECOUNT value on done: 498479.0 [2024-08-06 04:01:54,266][52647] Sum rewards: 75.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.145', 'weapon5': '0.170', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.000'} [2024-08-06 04:01:54,331][52664] DAMAGECOUNT value on done: 496737.0 [2024-08-06 04:01:54,332][52664] Sum rewards: 71.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.170', 'AMMO3': '0.203', 'AMMO4': '0.250', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.502', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:54,388][52659] DAMAGECOUNT value on done: 480839.0 [2024-08-06 04:01:54,390][52659] Sum rewards: 77.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.652', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.074', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '66.000'} [2024-08-06 04:01:54,573][52663] DAMAGECOUNT value on done: 475237.0 [2024-08-06 04:01:54,573][52663] Sum rewards: 90.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon2': '0.150', 'weapon5': '0.180', 'AMMO3': '0.189', 'AMMO4': '0.211', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.081', 'FRAGCOUNT': '73.000'} [2024-08-06 04:01:56,305][52670] DAMAGECOUNT value on done: 469173.0 [2024-08-06 04:01:56,307][52670] Sum rewards: 72.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'WEAPON3': '0.900', 'weapon2': '0.908', 'weapon3': '2.912', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '55.000'} [2024-08-06 04:01:56,372][52666] DAMAGECOUNT value on done: 475577.0 [2024-08-06 04:01:56,373][52666] Sum rewards: 68.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.561', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.212', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '57.000'} [2024-08-06 04:01:56,613][52650] Updated weights for policy 0, policy_version 50331 (0.0030) [2024-08-06 04:01:57,118][52649] DAMAGECOUNT value on done: 470898.0 [2024-08-06 04:01:57,119][52649] Sum rewards: 70.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.280', 'AMMO5': '0.014', 'AMMO2': '0.068', 'weapon5': '0.126', 'weapon4': '0.194', 'AMMO3': '0.240', 'AMMO4': '0.339', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '61.000'} [2024-08-06 04:01:57,138][52659] DAMAGECOUNT value on done: 479370.0 [2024-08-06 04:01:57,140][52659] Sum rewards: 71.712, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.594', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.106', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.706', 'WEAPON3': '0.900', 'weapon3': '3.000', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.000'} [2024-08-06 04:01:57,168][52647] DAMAGECOUNT value on done: 489622.0 [2024-08-06 04:01:57,169][52647] Sum rewards: 63.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.134', 'weapon2': '0.142', 'AMMO3': '0.216', 'AMMO4': '0.240', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.228', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '52.000'} [2024-08-06 04:01:57,305][52664] DAMAGECOUNT value on done: 497592.0 [2024-08-06 04:01:57,305][52664] Sum rewards: 72.439, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.131', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.242', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.302', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:57,497][52663] DAMAGECOUNT value on done: 469780.0 [2024-08-06 04:01:57,498][52663] Sum rewards: 87.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '73.000'} [2024-08-06 04:01:57,796][52567] Fps is (10 sec: 17200.1, 60 sec: 17612.3, 300 sec: 17466.9). Total num frames: 412327936. Throughput: 0: 4371.2. Samples: 103090130. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:01:57,796][52567] Avg episode reward: [(0, '71.739')] [2024-08-06 04:01:58,998][52670] DAMAGECOUNT value on done: 467659.0 [2024-08-06 04:01:58,998][52670] Sum rewards: 62.562, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.289', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.076', 'weapon4': '0.094', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon2': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'HITCOUNT': '3.180', 'weapon3': '3.410', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '55.000'} [2024-08-06 04:01:59,023][52666] DAMAGECOUNT value on done: 475556.0 [2024-08-06 04:01:59,024][52666] Sum rewards: 70.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.770', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.068', 'weapon5': '0.164', 'AMMO4': '0.211', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '58.000'} [2024-08-06 04:01:59,769][52649] DAMAGECOUNT value on done: 472315.0 [2024-08-06 04:01:59,769][52649] Sum rewards: 86.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.058', 'AMMO4': '0.081', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '71.000'} [2024-08-06 04:01:59,824][52659] DAMAGECOUNT value on done: 473654.0 [2024-08-06 04:01:59,824][52659] Sum rewards: 79.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.638', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.039', 'weapon5': '0.110', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '67.000'} [2024-08-06 04:02:00,175][52663] DAMAGECOUNT value on done: 473473.0 [2024-08-06 04:02:00,175][52663] Sum rewards: 72.348, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.135', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.013', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.346', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:00,241][52647] DAMAGECOUNT value on done: 496421.0 [2024-08-06 04:02:00,241][52647] Sum rewards: 67.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.538', 'AMMO5': '0.016', 'AMMO2': '0.068', 'weapon5': '0.232', 'AMMO3': '0.237', 'AMMO4': '0.341', 'weapon4': '0.392', 'weapon2': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.660', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:00,420][52664] DAMAGECOUNT value on done: 489837.0 [2024-08-06 04:02:00,424][52664] Sum rewards: 65.449, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.505', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.104', 'AMMO4': '0.136', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.722', 'WEAPON3': '1.000', 'weapon3': '2.962', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '51.000'} [2024-08-06 04:02:01,466][52650] Updated weights for policy 0, policy_version 50341 (0.0013) [2024-08-06 04:02:02,117][52666] DAMAGECOUNT value on done: 468576.0 [2024-08-06 04:02:02,117][52670] DAMAGECOUNT value on done: 477159.0 [2024-08-06 04:02:02,118][52666] Sum rewards: 64.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO4': '0.193', 'AMMO3': '0.226', 'weapon2': '0.284', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '53.000'} [2024-08-06 04:02:02,119][52670] Sum rewards: 60.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.920', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.078', 'AMMO4': '0.097', 'weapon4': '0.184', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.334', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '49.000'} [2024-08-06 04:02:02,587][52649] DAMAGECOUNT value on done: 467706.0 [2024-08-06 04:02:02,587][52649] Sum rewards: 64.498, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.662', 'AMMO5': '0.011', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.055', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'weapon2': '0.310', 'WEAPON3': '1.750', 'weapon3': '3.312', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:02,787][52659] DAMAGECOUNT value on done: 475609.0 [2024-08-06 04:02:02,788][52659] Sum rewards: 58.268, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.274', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.154', 'weapon5': '0.184', 'AMMO4': '0.212', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.602', 'FRAGCOUNT': '49.500'} [2024-08-06 04:02:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 412418048. Throughput: 0: 4374.5. Samples: 103103480. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:02:02,794][52567] Avg episode reward: [(0, '71.559')] [2024-08-06 04:02:02,858][52663] DAMAGECOUNT value on done: 473870.0 [2024-08-06 04:02:02,858][52663] Sum rewards: 71.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.868', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.132', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.334', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.834', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '57.000'} [2024-08-06 04:02:03,389][52647] DAMAGECOUNT value on done: 493997.0 [2024-08-06 04:02:03,390][52647] Sum rewards: 77.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.096', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '66.000'} [2024-08-06 04:02:03,578][52664] DAMAGECOUNT value on done: 489411.0 [2024-08-06 04:02:03,580][52664] Sum rewards: 65.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.938', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.180', 'AMMO4': '0.248', 'weapon2': '0.330', 'weapon4': '0.440', 'weapon5': '0.470', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.424', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '51.000'} [2024-08-06 04:02:04,274][52811] DAMAGECOUNT value on done: 454974.0 [2024-08-06 04:02:04,274][52811] Sum rewards: 67.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.510', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.086', 'weapon4': '0.164', 'AMMO4': '0.164', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.240', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:04,708][52666] DAMAGECOUNT value on done: 473126.0 [2024-08-06 04:02:04,709][52666] Sum rewards: 78.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.126', 'AMMO4': '0.127', 'AMMO3': '0.165', 'weapon5': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '63.000'} [2024-08-06 04:02:04,720][52670] DAMAGECOUNT value on done: 472555.0 [2024-08-06 04:02:04,721][52670] Sum rewards: 79.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.080', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '63.000'} [2024-08-06 04:02:05,692][52649] DAMAGECOUNT value on done: 457067.0 [2024-08-06 04:02:05,693][52649] Sum rewards: 69.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.351', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.202', 'weapon5': '0.220', 'weapon4': '0.284', 'AMMO4': '0.284', 'weapon2': '0.458', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.742', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:05,886][52663] DAMAGECOUNT value on done: 477223.0 [2024-08-06 04:02:05,886][52663] Sum rewards: 66.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.873', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.182', 'AMMO4': '0.206', 'weapon4': '0.246', 'weapon5': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '53.000'} [2024-08-06 04:02:05,907][52647] DAMAGECOUNT value on done: 494449.0 [2024-08-06 04:02:05,908][52647] Sum rewards: 76.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.768', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.206', 'weapon4': '0.240', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.700', 'weapon3': '3.108', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '66.000'} [2024-08-06 04:02:05,959][52659] DAMAGECOUNT value on done: 478189.0 [2024-08-06 04:02:05,959][52659] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.557', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.130', 'weapon5': '0.188', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '59.000'} [2024-08-06 04:02:05,981][52650] Updated weights for policy 0, policy_version 50351 (0.0013) [2024-08-06 04:02:06,087][52664] DAMAGECOUNT value on done: 493921.0 [2024-08-06 04:02:06,087][52664] Sum rewards: 76.834, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.128', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.122', 'weapon5': '0.154', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '66.000'} [2024-08-06 04:02:07,173][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:02:07,538][52811] DAMAGECOUNT value on done: 437266.0 [2024-08-06 04:02:07,539][52811] Sum rewards: 76.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.735', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.134', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '64.000'} [2024-08-06 04:02:07,672][52666] DAMAGECOUNT value on done: 472206.0 [2024-08-06 04:02:07,672][52666] Sum rewards: 71.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.020', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.136', 'weapon5': '0.176', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon2': '0.548', 'WEAPON3': '0.750', 'weapon3': '2.602', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '57.000'} [2024-08-06 04:02:07,675][52670] DAMAGECOUNT value on done: 463319.0 [2024-08-06 04:02:07,675][52670] Sum rewards: 62.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.072', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.148', 'AMMO4': '0.193', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.650', 'HITCOUNT': '3.120', 'weapon3': '3.214', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:07,794][52567] Fps is (10 sec: 18025.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 412508160. Throughput: 0: 4370.5. Samples: 103129720. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:02:07,794][52567] Avg episode reward: [(0, '71.555')] [2024-08-06 04:02:08,550][52649] DAMAGECOUNT value on done: 467217.0 [2024-08-06 04:02:08,550][52649] Sum rewards: 80.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.871', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.029', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.225', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '68.000'} [2024-08-06 04:02:08,902][52663] DAMAGECOUNT value on done: 474997.0 [2024-08-06 04:02:08,902][52663] Sum rewards: 70.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.163', 'AMMO4': '0.170', 'weapon4': '0.180', 'weapon5': '0.252', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:09,051][52664] DAMAGECOUNT value on done: 492001.0 [2024-08-06 04:02:09,053][52664] Sum rewards: 70.121, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.144', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.104', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '55.000'} [2024-08-06 04:02:09,597][52614] Signal inference workers to stop experience collection... (9150 times) [2024-08-06 04:02:09,597][52614] Signal inference workers to resume experience collection... (9150 times) [2024-08-06 04:02:09,646][52650] InferenceWorker_p0-w0: stopping experience collection (9150 times) [2024-08-06 04:02:09,694][52650] InferenceWorker_p0-w0: resuming experience collection (9150 times) [2024-08-06 04:02:10,138][52666] DAMAGECOUNT value on done: 470852.0 [2024-08-06 04:02:10,139][52666] Sum rewards: 70.978, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.036', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.096', 'weapon5': '0.118', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.298', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.220', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '62.000'} [2024-08-06 04:02:10,148][52670] DAMAGECOUNT value on done: 470440.0 [2024-08-06 04:02:10,150][52670] Sum rewards: 65.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.056', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '55.000'} [2024-08-06 04:02:10,695][52650] Updated weights for policy 0, policy_version 50361 (0.0061) [2024-08-06 04:02:10,832][52811] DAMAGECOUNT value on done: 436831.0 [2024-08-06 04:02:10,833][52811] Sum rewards: 62.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.536', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.182', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.216', 'DAMAGECOUNT': '14.535', 'FRAGCOUNT': '52.000'} [2024-08-06 04:02:11,815][52649] DAMAGECOUNT value on done: 455051.0 [2024-08-06 04:02:11,815][52649] Sum rewards: 71.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.085', 'weapon4': '0.098', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:11,956][52663] DAMAGECOUNT value on done: 468954.0 [2024-08-06 04:02:11,957][52663] Sum rewards: 68.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:12,099][52664] DAMAGECOUNT value on done: 489798.0 [2024-08-06 04:02:12,099][52664] Sum rewards: 66.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.149', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '53.000'} [2024-08-06 04:02:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 412590080. Throughput: 0: 4377.8. Samples: 103155980. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:02:12,794][52567] Avg episode reward: [(0, '71.481')] [2024-08-06 04:02:13,111][52670] DAMAGECOUNT value on done: 469920.0 [2024-08-06 04:02:13,111][52670] Sum rewards: 87.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.056', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.238', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '72.000'} [2024-08-06 04:02:13,112][52666] DAMAGECOUNT value on done: 465202.0 [2024-08-06 04:02:13,115][52666] Sum rewards: 71.204, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.238', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.442', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 04:02:14,048][52811] DAMAGECOUNT value on done: 440360.0 [2024-08-06 04:02:14,048][52811] Sum rewards: 67.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:14,876][52649] DAMAGECOUNT value on done: 468577.0 [2024-08-06 04:02:14,876][52649] Sum rewards: 71.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.031', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.186', 'weapon2': '0.232', 'AMMO4': '0.233', 'AMMO3': '0.275', 'weapon4': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.998', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:15,034][52663] DAMAGECOUNT value on done: 468239.0 [2024-08-06 04:02:15,035][52663] Sum rewards: 63.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO4': '0.142', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.082', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '52.000'} [2024-08-06 04:02:15,716][52650] Updated weights for policy 0, policy_version 50371 (0.0025) [2024-08-06 04:02:16,081][52659] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2024-08-06 04:02:16,082][52670] DAMAGECOUNT value on done: 466415.0 [2024-08-06 04:02:16,086][52670] Sum rewards: 72.019, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.437', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.204', 'AMMO3': '0.272', 'weapon2': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.542', 'WEAPON3': '1.550', 'weapon3': '2.620', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '63.000'} [2024-08-06 04:02:16,124][52666] DAMAGECOUNT value on done: 469677.0 [2024-08-06 04:02:16,126][52666] Sum rewards: 85.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.354', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.214', 'WEAPON3': '1.450', 'weapon3': '3.466', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '71.000'} [2024-08-06 04:02:16,170][52803] DAMAGECOUNT value on done: 442251.0 [2024-08-06 04:02:16,172][52803] Sum rewards: 55.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.060', 'weapon4': '0.070', 'AMMO4': '0.129', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.336', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '47.000'} [2024-08-06 04:02:17,083][52811] DAMAGECOUNT value on done: 443929.0 [2024-08-06 04:02:17,087][52811] Sum rewards: 74.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'weapon4': '0.032', 'AMMO2': '0.032', 'weapon5': '0.050', 'AMMO4': '0.160', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '59.000'} [2024-08-06 04:02:17,727][52649] DAMAGECOUNT value on done: 470082.0 [2024-08-06 04:02:17,729][52649] Sum rewards: 66.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.992', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.058', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.144', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 412672000. Throughput: 0: 4381.1. Samples: 103169320. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:02:17,795][52567] Avg episode reward: [(0, '71.899')] [2024-08-06 04:02:18,015][52663] DAMAGECOUNT value on done: 477050.0 [2024-08-06 04:02:18,018][52663] Sum rewards: 87.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.066', 'AMMO4': '0.172', 'weapon5': '0.180', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.183', 'FRAGCOUNT': '72.000'} [2024-08-06 04:02:19,202][52670] DAMAGECOUNT value on done: 472505.0 [2024-08-06 04:02:19,202][52670] Sum rewards: 71.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.590', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.398', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:19,209][52667] DAMAGECOUNT value on done: 473086.0 [2024-08-06 04:02:19,209][52667] Sum rewards: 70.219, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.328', 'HEALTH': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.210', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:19,236][52666] DAMAGECOUNT value on done: 467100.0 [2024-08-06 04:02:19,237][52666] Sum rewards: 72.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.785', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.096', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '62.000'} [2024-08-06 04:02:19,339][52803] DAMAGECOUNT value on done: 439785.0 [2024-08-06 04:02:19,339][52803] Sum rewards: 72.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.154', 'weapon5': '0.158', 'AMMO3': '0.190', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:19,833][52650] Updated weights for policy 0, policy_version 50381 (0.0013) [2024-08-06 04:02:20,284][52811] DAMAGECOUNT value on done: 448957.0 [2024-08-06 04:02:20,284][52811] Sum rewards: 64.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.051', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.142', 'AMMO3': '0.223', 'weapon5': '0.234', 'AMMO4': '0.282', 'weapon2': '0.444', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '2.930', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:20,436][52649] DAMAGECOUNT value on done: 461580.0 [2024-08-06 04:02:20,437][52649] Sum rewards: 67.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.146', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.060', 'weapon5': '0.132', 'AMMO4': '0.157', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:20,612][52663] DAMAGECOUNT value on done: 482196.0 [2024-08-06 04:02:20,612][52663] Sum rewards: 80.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.564', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.084', 'weapon2': '0.122', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON3': '1.250', 'weapon3': '3.500', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '65.000'} [2024-08-06 04:02:21,546][52667] DAMAGECOUNT value on done: 483703.0 [2024-08-06 04:02:21,548][52667] Sum rewards: 78.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.283', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.082', 'weapon5': '0.134', 'AMMO4': '0.169', 'AMMO3': '0.217', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.000'} [2024-08-06 04:02:22,450][52670] DAMAGECOUNT value on done: 463292.0 [2024-08-06 04:02:22,453][52670] Sum rewards: 60.866, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.183', 'weapon5': '0.236', 'AMMO4': '0.255', 'weapon4': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '49.000'} [2024-08-06 04:02:22,525][52666] DAMAGECOUNT value on done: 480407.0 [2024-08-06 04:02:22,527][52666] Sum rewards: 78.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.466', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.229', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.398', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '65.000'} [2024-08-06 04:02:22,557][52803] DAMAGECOUNT value on done: 447914.0 [2024-08-06 04:02:22,559][52803] Sum rewards: 73.588, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.142', 'weapon4': '0.156', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.349', 'weapon2': '0.384', 'WEAPON3': '0.900', 'HITCOUNT': '3.070', 'weapon3': '3.094', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 412770304. Throughput: 0: 4385.1. Samples: 103195600. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:02:22,795][52567] Avg episode reward: [(0, '72.277')] [2024-08-06 04:02:23,236][52663] DAMAGECOUNT value on done: 471672.0 [2024-08-06 04:02:23,236][52663] Sum rewards: 56.936, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.188', 'AMMO3': '0.249', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.500', 'weapon3': '2.670', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '49.000'} [2024-08-06 04:02:23,412][52811] DAMAGECOUNT value on done: 444495.0 [2024-08-06 04:02:23,413][52811] Sum rewards: 61.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.718', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.116', 'weapon5': '0.162', 'AMMO4': '0.187', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '51.000'} [2024-08-06 04:02:24,364][52667] DAMAGECOUNT value on done: 473410.0 [2024-08-06 04:02:24,365][52667] Sum rewards: 59.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.072', 'AMMO3': '0.164', 'weapon4': '0.192', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.206', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '50.000'} [2024-08-06 04:02:24,891][52650] Updated weights for policy 0, policy_version 50391 (0.0013) [2024-08-06 04:02:25,553][52803] DAMAGECOUNT value on done: 450281.0 [2024-08-06 04:02:25,554][52803] Sum rewards: 73.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.128', 'weapon4': '0.140', 'AMMO3': '0.179', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:25,614][52670] DAMAGECOUNT value on done: 469126.0 [2024-08-06 04:02:25,614][52670] Sum rewards: 72.400, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.952', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO3': '0.135', 'weapon5': '0.140', 'AMMO4': '0.148', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '0.900', 'weapon3': '3.078', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '54.500'} [2024-08-06 04:02:25,637][52666] DAMAGECOUNT value on done: 475281.0 [2024-08-06 04:02:25,642][52666] Sum rewards: 59.507, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.410', 'AMMO5': '0.027', 'AMMO2': '0.083', 'AMMO3': '0.268', 'weapon4': '0.314', 'weapon5': '0.336', 'AMMO4': '0.417', 'weapon2': '0.450', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.474', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:25,741][52663] DAMAGECOUNT value on done: 468245.0 [2024-08-06 04:02:25,742][52663] Sum rewards: 67.693, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.450', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon5': '0.092', 'AMMO4': '0.204', 'weapon4': '0.214', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:26,672][52811] DAMAGECOUNT value on done: 444065.0 [2024-08-06 04:02:26,672][52811] Sum rewards: 65.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.784', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.036', 'weapon5': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.254', 'weapon2': '0.432', 'WEAPON3': '1.650', 'weapon3': '3.254', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:27,483][52667] DAMAGECOUNT value on done: 474608.0 [2024-08-06 04:02:27,491][52667] Sum rewards: 71.736, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.770', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.190', 'weapon4': '0.228', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.650', 'weapon3': '2.842', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '62.000'} [2024-08-06 04:02:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 412852224. Throughput: 0: 4379.3. Samples: 103221660. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:02:27,794][52567] Avg episode reward: [(0, '71.557')] [2024-08-06 04:02:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050397_412852224.pth... [2024-08-06 04:02:27,916][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000049885_408657920.pth [2024-08-06 04:02:28,268][52663] DAMAGECOUNT value on done: 467919.0 [2024-08-06 04:02:28,268][52663] Sum rewards: 75.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.664', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.156', 'AMMO3': '0.169', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:28,719][52803] DAMAGECOUNT value on done: 446540.0 [2024-08-06 04:02:28,719][52803] Sum rewards: 64.397, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.245', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.134', 'AMMO3': '0.139', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.532', 'WEAPON3': '0.850', 'HITCOUNT': '2.840', 'weapon3': '3.038', 'DAMAGECOUNT': '14.508', 'FRAGCOUNT': '51.000'} [2024-08-06 04:02:28,935][52670] DAMAGECOUNT value on done: 477520.0 [2024-08-06 04:02:28,937][52670] Sum rewards: 55.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon5': '0.136', 'AMMO3': '0.236', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.020', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '47.500'} [2024-08-06 04:02:29,022][52666] DAMAGECOUNT value on done: 469964.0 [2024-08-06 04:02:29,025][52666] Sum rewards: 73.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.106', 'weapon5': '0.136', 'AMMO3': '0.182', 'AMMO4': '0.284', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:29,152][52650] Updated weights for policy 0, policy_version 50401 (0.0019) [2024-08-06 04:02:29,814][52811] DAMAGECOUNT value on done: 449805.0 [2024-08-06 04:02:29,815][52811] Sum rewards: 75.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.124', 'AMMO4': '0.126', 'weapon5': '0.134', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.678', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:30,578][52667] DAMAGECOUNT value on done: 482667.0 [2024-08-06 04:02:30,578][52667] Sum rewards: 74.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.106', 'weapon5': '0.132', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:31,113][52663] DAMAGECOUNT value on done: 469478.0 [2024-08-06 04:02:31,113][52663] Sum rewards: 76.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.092', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.500'} [2024-08-06 04:02:31,529][52670] DAMAGECOUNT value on done: 470900.0 [2024-08-06 04:02:31,531][52670] Sum rewards: 67.203, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.260', 'weapon4': '0.262', 'HEALTH': '0.540', 'WEAPON3': '1.100', 'weapon3': '3.164', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 04:02:31,552][52666] DAMAGECOUNT value on done: 470826.0 [2024-08-06 04:02:31,552][52666] Sum rewards: 64.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.191', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.164', 'AMMO4': '0.259', 'weapon5': '0.266', 'weapon2': '0.294', 'weapon4': '0.436', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.726', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '55.000'} [2024-08-06 04:02:31,808][52803] DAMAGECOUNT value on done: 436672.0 [2024-08-06 04:02:31,808][52803] Sum rewards: 77.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.395', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.179', 'weapon2': '0.182', 'weapon4': '0.198', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '64.000'} [2024-08-06 04:02:32,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 412934144. Throughput: 0: 4378.9. Samples: 103234450. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:02:32,794][52567] Avg episode reward: [(0, '71.292')] [2024-08-06 04:02:32,997][52811] DAMAGECOUNT value on done: 445094.0 [2024-08-06 04:02:32,998][52811] Sum rewards: 78.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.808', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.228', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '64.000'} [2024-08-06 04:02:33,694][52667] DAMAGECOUNT value on done: 483960.0 [2024-08-06 04:02:33,694][52667] Sum rewards: 72.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon5': '0.202', 'weapon2': '0.676', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:33,895][52666] DAMAGECOUNT value on done: 471896.0 [2024-08-06 04:02:33,895][52666] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.465', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.000', 'HITCOUNT': '3.340', 'weapon3': '3.342', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '57.000'} [2024-08-06 04:02:33,908][52670] DAMAGECOUNT value on done: 457587.0 [2024-08-06 04:02:33,908][52670] Sum rewards: 66.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.122', 'AMMO4': '0.126', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:34,081][52663] DAMAGECOUNT value on done: 479479.0 [2024-08-06 04:02:34,083][52663] Sum rewards: 72.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.042', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:34,217][52650] Updated weights for policy 0, policy_version 50411 (0.0035) [2024-08-06 04:02:34,872][52803] DAMAGECOUNT value on done: 438451.0 [2024-08-06 04:02:34,872][52803] Sum rewards: 67.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.256', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.096', 'weapon4': '0.128', 'AMMO3': '0.217', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.294', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:36,080][52811] DAMAGECOUNT value on done: 443037.0 [2024-08-06 04:02:36,080][52811] Sum rewards: 66.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.124', 'weapon4': '0.130', 'AMMO4': '0.186', 'AMMO3': '0.207', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.248', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '57.000'} [2024-08-06 04:02:36,674][52667] DAMAGECOUNT value on done: 476752.0 [2024-08-06 04:02:36,675][52667] Sum rewards: 67.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.096', 'AMMO4': '0.141', 'weapon5': '0.190', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '57.000'} [2024-08-06 04:02:36,785][52666] DAMAGECOUNT value on done: 476412.0 [2024-08-06 04:02:36,785][52666] Sum rewards: 79.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.674', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.116', 'AMMO4': '0.124', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '67.000'} [2024-08-06 04:02:36,790][52670] DAMAGECOUNT value on done: 467712.0 [2024-08-06 04:02:36,790][52670] Sum rewards: 67.314, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.122', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon5': '0.168', 'weapon4': '0.208', 'AMMO4': '0.299', 'AMMO3': '0.312', 'weapon2': '0.326', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.900', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '61.500'} [2024-08-06 04:02:36,946][52663] DAMAGECOUNT value on done: 469641.0 [2024-08-06 04:02:36,947][52663] Sum rewards: 70.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.200', 'weapon4': '0.206', 'AMMO4': '0.229', 'AMMO3': '0.232', 'weapon2': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 413032448. Throughput: 0: 4374.0. Samples: 103260740. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:02:37,794][52567] Avg episode reward: [(0, '70.886')] [2024-08-06 04:02:38,020][52803] DAMAGECOUNT value on done: 437993.0 [2024-08-06 04:02:38,021][52803] Sum rewards: 57.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.650', 'AMMO5': '0.021', 'AMMO2': '0.064', 'AMMO3': '0.204', 'weapon2': '0.216', 'weapon4': '0.252', 'weapon5': '0.304', 'AMMO4': '0.321', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.892', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '48.000'} [2024-08-06 04:02:38,194][52670] Large shaping reward 2.728 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 04:02:38,841][52650] Updated weights for policy 0, policy_version 50421 (0.0013) [2024-08-06 04:02:39,034][52811] DAMAGECOUNT value on done: 455051.0 [2024-08-06 04:02:39,034][52811] Sum rewards: 78.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.024', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.228', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '64.000'} [2024-08-06 04:02:39,499][52666] DAMAGECOUNT value on done: 461377.0 [2024-08-06 04:02:39,501][52666] Sum rewards: 78.160, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.026', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.088', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.352', 'WEAPON3': '0.950', 'weapon3': '3.122', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '63.000'} [2024-08-06 04:02:39,528][52670] DAMAGECOUNT value on done: 478330.0 [2024-08-06 04:02:39,530][52670] Sum rewards: 69.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.666', 'WEAPON3': '1.700', 'weapon3': '2.970', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:39,650][52663] DAMAGECOUNT value on done: 479014.0 [2024-08-06 04:02:39,650][52663] Sum rewards: 72.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.000', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.156', 'AMMO3': '0.209', 'weapon5': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:39,844][52667] DAMAGECOUNT value on done: 476346.0 [2024-08-06 04:02:39,844][52667] Sum rewards: 64.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.070', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:41,095][52803] DAMAGECOUNT value on done: 444376.0 [2024-08-06 04:02:41,095][52803] Sum rewards: 62.678, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.955', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.096', 'weapon5': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.218', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.442', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '53.000'} [2024-08-06 04:02:42,187][52811] DAMAGECOUNT value on done: 443023.0 [2024-08-06 04:02:42,191][52811] Sum rewards: 65.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.660', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.262', 'weapon2': '0.294', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.104', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:42,256][52667] DAMAGECOUNT value on done: 480875.0 [2024-08-06 04:02:42,257][52667] Sum rewards: 69.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.396', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.196', 'AMMO4': '0.202', 'AMMO3': '0.203', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '59.000'} [2024-08-06 04:02:42,323][52666] DAMAGECOUNT value on done: 468919.0 [2024-08-06 04:02:42,323][52666] Sum rewards: 65.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.239', 'AMMO5': '0.024', 'AMMO2': '0.067', 'weapon4': '0.166', 'AMMO3': '0.191', 'weapon5': '0.282', 'weapon2': '0.328', 'AMMO4': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:42,351][52670] DAMAGECOUNT value on done: 469988.0 [2024-08-06 04:02:42,353][52670] Sum rewards: 77.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '64.000'} [2024-08-06 04:02:42,607][52663] DAMAGECOUNT value on done: 474517.0 [2024-08-06 04:02:42,608][52663] Sum rewards: 64.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.496', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.090', 'AMMO3': '0.163', 'AMMO4': '0.194', 'weapon5': '0.200', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '2.590', 'weapon3': '3.088', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '52.500'} [2024-08-06 04:02:42,763][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:02:42,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 413114368. Throughput: 0: 4383.3. Samples: 103287370. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:02:42,795][52567] Avg episode reward: [(0, '70.424')] [2024-08-06 04:02:43,534][52650] Updated weights for policy 0, policy_version 50431 (0.0015) [2024-08-06 04:02:44,204][52803] DAMAGECOUNT value on done: 434651.0 [2024-08-06 04:02:44,212][52803] Sum rewards: 69.640, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.174', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.094', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '57.000'} [2024-08-06 04:02:44,936][52667] DAMAGECOUNT value on done: 483471.0 [2024-08-06 04:02:44,936][52667] Sum rewards: 65.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.536', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.494', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.234', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '54.000'} [2024-08-06 04:02:45,116][52670] DAMAGECOUNT value on done: 473428.0 [2024-08-06 04:02:45,118][52670] Sum rewards: 75.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.498', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '64.000'} [2024-08-06 04:02:45,223][52811] DAMAGECOUNT value on done: 442045.0 [2024-08-06 04:02:45,224][52811] Sum rewards: 67.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.054', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.766', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '57.000'} [2024-08-06 04:02:45,526][52663] DAMAGECOUNT value on done: 469230.0 [2024-08-06 04:02:45,528][52663] Sum rewards: 75.051, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.127', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '3.330', 'weapon3': '3.376', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:45,804][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:02:47,342][52803] DAMAGECOUNT value on done: 450461.0 [2024-08-06 04:02:47,342][52803] Sum rewards: 56.883, reward structure: {'DEATHCOUNT': '-22.500', 'HEALTH': '-3.288', 'AMMO5': '0.030', 'AMMO2': '0.096', 'AMMO3': '0.312', 'weapon5': '0.316', 'weapon2': '0.352', 'weapon4': '0.390', 'AMMO4': '0.482', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.750', 'weapon3': '2.436', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 413204480. Throughput: 0: 4378.2. Samples: 103300500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:02:47,795][52567] Avg episode reward: [(0, '69.938')] [2024-08-06 04:02:47,863][52650] Updated weights for policy 0, policy_version 50441 (0.0012) [2024-08-06 04:02:47,956][52667] DAMAGECOUNT value on done: 473619.0 [2024-08-06 04:02:47,956][52667] Sum rewards: 66.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.175', 'weapon5': '0.194', 'AMMO4': '0.231', 'weapon4': '0.304', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '52.000'} [2024-08-06 04:02:48,216][52811] DAMAGECOUNT value on done: 446076.0 [2024-08-06 04:02:48,216][52811] Sum rewards: 70.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.086', 'weapon2': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:48,439][52669] DAMAGECOUNT value on done: 478984.0 [2024-08-06 04:02:48,442][52669] Sum rewards: 65.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.144', 'AMMO4': '0.147', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.112', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:50,675][52803] DAMAGECOUNT value on done: 445490.0 [2024-08-06 04:02:50,676][52803] Sum rewards: 69.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.132', 'AMMO4': '0.173', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:50,811][52667] DAMAGECOUNT value on done: 475065.0 [2024-08-06 04:02:50,812][52667] Sum rewards: 67.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.146', 'AMMO4': '0.150', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:51,163][52669] DAMAGECOUNT value on done: 470142.0 [2024-08-06 04:02:51,167][52669] Sum rewards: 64.624, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.080', 'weapon4': '0.114', 'AMMO4': '0.212', 'weapon2': '0.240', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2024-08-06 04:02:51,388][52811] DAMAGECOUNT value on done: 440333.0 [2024-08-06 04:02:51,388][52811] Sum rewards: 72.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.375', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.038', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '61.000'} [2024-08-06 04:02:52,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 413286400. Throughput: 0: 4377.3. Samples: 103326700. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:02:52,794][52567] Avg episode reward: [(0, '70.165')] [2024-08-06 04:02:52,944][52650] Updated weights for policy 0, policy_version 50451 (0.0017) [2024-08-06 04:02:53,830][52803] DAMAGECOUNT value on done: 443113.0 [2024-08-06 04:02:53,831][52803] Sum rewards: 69.870, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.062', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.174', 'weapon2': '0.204', 'weapon5': '0.204', 'AMMO3': '0.261', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:53,995][52667] DAMAGECOUNT value on done: 481195.0 [2024-08-06 04:02:53,997][52667] Sum rewards: 76.463, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.565', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.076', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon2': '0.470', 'WEAPON3': '0.850', 'weapon3': '3.132', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '60.000'} [2024-08-06 04:02:54,239][52669] DAMAGECOUNT value on done: 479891.0 [2024-08-06 04:02:54,240][52669] Sum rewards: 80.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.104', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.169', 'weapon2': '0.328', 'WEAPON4': '0.350', 'weapon4': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.674', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '66.000'} [2024-08-06 04:02:54,491][52811] DAMAGECOUNT value on done: 445112.0 [2024-08-06 04:02:54,491][52811] Sum rewards: 74.317, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.130', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.144', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.307', 'weapon2': '0.316', 'WEAPON3': '1.850', 'weapon3': '3.148', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '66.000'} [2024-08-06 04:02:56,785][52667] DAMAGECOUNT value on done: 473594.0 [2024-08-06 04:02:56,787][52667] Sum rewards: 65.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.052', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.100', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'HITCOUNT': '3.260', 'weapon3': '3.406', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 04:02:56,892][52669] DAMAGECOUNT value on done: 476886.0 [2024-08-06 04:02:56,892][52669] Sum rewards: 72.250, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.247', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.024', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.236', 'AMMO3': '0.280', 'WEAPON3': '1.600', 'weapon3': '3.464', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '62.000'} [2024-08-06 04:02:57,097][52803] DAMAGECOUNT value on done: 446697.0 [2024-08-06 04:02:57,097][52803] Sum rewards: 74.800, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.360', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'weapon2': '0.358', 'WEAPON3': '1.750', 'weapon3': '3.208', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '65.000'} [2024-08-06 04:02:57,519][52650] Updated weights for policy 0, policy_version 50461 (0.0021) [2024-08-06 04:02:57,668][52811] DAMAGECOUNT value on done: 445981.0 [2024-08-06 04:02:57,670][52811] Sum rewards: 77.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.066', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.364', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '63.000'} [2024-08-06 04:02:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.8, 300 sec: 17494.8). Total num frames: 413376512. Throughput: 0: 4359.3. Samples: 103352150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:02:57,795][52567] Avg episode reward: [(0, '70.317')] [2024-08-06 04:02:59,717][52667] DAMAGECOUNT value on done: 480984.0 [2024-08-06 04:02:59,717][52667] Sum rewards: 77.130, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.807', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.450', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '62.000'} [2024-08-06 04:02:59,880][52669] DAMAGECOUNT value on done: 476137.0 [2024-08-06 04:02:59,883][52669] Sum rewards: 75.005, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.116', 'AMMO3': '0.161', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.262', 'weapon2': '0.460', 'WEAPON3': '0.900', 'weapon3': '2.800', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:00,081][52668] DAMAGECOUNT value on done: 474840.0 [2024-08-06 04:03:00,081][52668] Sum rewards: 64.130, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.402', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.124', 'AMMO3': '0.234', 'weapon4': '0.234', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.128', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '56.000'} [2024-08-06 04:03:00,414][52803] DAMAGECOUNT value on done: 443547.0 [2024-08-06 04:03:00,414][52803] Sum rewards: 63.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.480', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.135', 'AMMO3': '0.229', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '52.000'} [2024-08-06 04:03:00,797][52811] DAMAGECOUNT value on done: 444283.0 [2024-08-06 04:03:00,798][52811] Sum rewards: 74.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.196', 'weapon2': '0.254', 'WEAPON3': '1.100', 'weapon3': '3.300', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:02,386][52650] Updated weights for policy 0, policy_version 50471 (0.0043) [2024-08-06 04:03:02,662][52667] DAMAGECOUNT value on done: 485072.0 [2024-08-06 04:03:02,664][52667] Sum rewards: 52.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'weapon2': '0.220', 'weapon4': '0.220', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '2.920', 'weapon3': '3.230', 'DAMAGECOUNT': '14.235', 'FRAGCOUNT': '48.000'} [2024-08-06 04:03:02,719][52668] DAMAGECOUNT value on done: 480066.0 [2024-08-06 04:03:02,719][52668] Sum rewards: 80.885, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.339', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.108', 'AMMO4': '0.183', 'AMMO3': '0.239', 'weapon5': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '67.000'} [2024-08-06 04:03:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 413466624. Throughput: 0: 4347.3. Samples: 103364950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:02,794][52567] Avg episode reward: [(0, '70.012')] [2024-08-06 04:03:03,066][52669] DAMAGECOUNT value on done: 479531.0 [2024-08-06 04:03:03,070][52669] Sum rewards: 65.837, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.515', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO3': '0.152', 'AMMO4': '0.156', 'weapon4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '0.900', 'HITCOUNT': '2.960', 'weapon3': '3.100', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '52.000'} [2024-08-06 04:03:03,400][52803] DAMAGECOUNT value on done: 439997.0 [2024-08-06 04:03:03,400][52803] Sum rewards: 77.523, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon2': '0.204', 'AMMO3': '0.213', 'WEAPON3': '1.400', 'weapon3': '3.656', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '64.000'} [2024-08-06 04:03:03,933][52811] DAMAGECOUNT value on done: 444531.0 [2024-08-06 04:03:03,934][52811] Sum rewards: 67.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.318', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.116', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.500'} [2024-08-06 04:03:05,425][52668] DAMAGECOUNT value on done: 479598.0 [2024-08-06 04:03:05,425][52668] Sum rewards: 55.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.715', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.170', 'AMMO3': '0.236', 'weapon4': '0.240', 'AMMO4': '0.263', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.712', 'WEAPON3': '1.300', 'weapon3': '2.628', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '48.000'} [2024-08-06 04:03:05,438][52667] DAMAGECOUNT value on done: 484918.0 [2024-08-06 04:03:05,439][52667] Sum rewards: 76.796, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.245', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.090', 'AMMO4': '0.222', 'weapon5': '0.230', 'AMMO3': '0.254', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '64.000'} [2024-08-06 04:03:06,044][52669] DAMAGECOUNT value on done: 478392.0 [2024-08-06 04:03:06,044][52669] Sum rewards: 86.613, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.345', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.122', 'weapon5': '0.152', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.238', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '22.053', 'FRAGCOUNT': '74.000'} [2024-08-06 04:03:06,357][52803] DAMAGECOUNT value on done: 449511.0 [2024-08-06 04:03:06,357][52803] Sum rewards: 73.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '61.000'} [2024-08-06 04:03:06,780][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:03:07,305][52650] Updated weights for policy 0, policy_version 50481 (0.0012) [2024-08-06 04:03:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 413548544. Throughput: 0: 4353.4. Samples: 103391500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:07,794][52567] Avg episode reward: [(0, '70.248')] [2024-08-06 04:03:08,081][52668] DAMAGECOUNT value on done: 481308.0 [2024-08-06 04:03:08,083][52668] Sum rewards: 70.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.076', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.154', 'weapon5': '0.170', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.286', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:08,275][52667] DAMAGECOUNT value on done: 482040.0 [2024-08-06 04:03:08,276][52667] Sum rewards: 58.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.148', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.128', 'AMMO4': '0.176', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.100', 'HITCOUNT': '2.710', 'weapon3': '3.166', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '49.500'} [2024-08-06 04:03:08,882][52669] DAMAGECOUNT value on done: 477613.0 [2024-08-06 04:03:08,883][52669] Sum rewards: 65.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.244', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 04:03:09,621][52803] DAMAGECOUNT value on done: 445353.0 [2024-08-06 04:03:09,622][52803] Sum rewards: 63.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'weapon4': '0.184', 'AMMO3': '0.205', 'weapon5': '0.210', 'AMMO4': '0.252', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.634', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '53.000'} [2024-08-06 04:03:10,403][52671] DAMAGECOUNT value on done: 481332.0 [2024-08-06 04:03:10,404][52671] Sum rewards: 74.153, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.550', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.174', 'weapon4': '0.280', 'AMMO3': '0.285', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.880', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '65.000'} [2024-08-06 04:03:11,131][52668] DAMAGECOUNT value on done: 470530.0 [2024-08-06 04:03:11,132][52668] Sum rewards: 76.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.148', 'AMMO4': '0.151', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.500', 'weapon3': '3.280', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '64.000'} [2024-08-06 04:03:11,194][52667] DAMAGECOUNT value on done: 476772.0 [2024-08-06 04:03:11,196][52667] Sum rewards: 74.806, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.094', 'weapon4': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.290', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:11,542][52650] Updated weights for policy 0, policy_version 50491 (0.0034) [2024-08-06 04:03:11,579][52669] DAMAGECOUNT value on done: 483244.0 [2024-08-06 04:03:11,579][52669] Sum rewards: 71.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.178', 'weapon5': '0.190', 'weapon2': '0.194', 'AMMO4': '0.225', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:12,737][52803] DAMAGECOUNT value on done: 448659.0 [2024-08-06 04:03:12,737][52803] Sum rewards: 78.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.744', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.151', 'weapon5': '0.164', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.500'} [2024-08-06 04:03:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 413638656. Throughput: 0: 4360.7. Samples: 103417890. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:12,794][52567] Avg episode reward: [(0, '69.946')] [2024-08-06 04:03:13,214][52671] DAMAGECOUNT value on done: 480056.0 [2024-08-06 04:03:13,214][52671] Sum rewards: 57.618, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.444', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.144', 'weapon5': '0.164', 'weapon2': '0.176', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '3.158', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '46.000'} [2024-08-06 04:03:13,900][52669] DAMAGECOUNT value on done: 475491.0 [2024-08-06 04:03:13,900][52669] Sum rewards: 72.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.584', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.048', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.226', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.474', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:14,189][52667] DAMAGECOUNT value on done: 482390.0 [2024-08-06 04:03:14,191][52667] Sum rewards: 86.220, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.153', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.136', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '0.900', 'weapon3': '3.376', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '67.500'} [2024-08-06 04:03:14,345][52668] DAMAGECOUNT value on done: 482681.0 [2024-08-06 04:03:14,346][52668] Sum rewards: 80.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.288', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.210', 'AMMO4': '0.216', 'AMMO3': '0.235', 'weapon2': '0.322', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '67.000'} [2024-08-06 04:03:15,792][52803] DAMAGECOUNT value on done: 440620.0 [2024-08-06 04:03:15,795][52803] Sum rewards: 66.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.913', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.078', 'weapon5': '0.080', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.236', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2024-08-06 04:03:15,917][52671] DAMAGECOUNT value on done: 480790.0 [2024-08-06 04:03:15,918][52671] Sum rewards: 79.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.275', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.060', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.211', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.816', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '64.500'} [2024-08-06 04:03:16,023][52662] DAMAGECOUNT value on done: 481816.0 [2024-08-06 04:03:16,025][52662] Sum rewards: 74.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.112', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '63.000'} [2024-08-06 04:03:16,392][52658] DAMAGECOUNT value on done: 474937.0 [2024-08-06 04:03:16,393][52658] Sum rewards: 71.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.676', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.388', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:16,459][52650] Updated weights for policy 0, policy_version 50501 (0.0011) [2024-08-06 04:03:16,632][52669] DAMAGECOUNT value on done: 484024.0 [2024-08-06 04:03:16,635][52669] Sum rewards: 78.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.154', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.039', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'AMMO4': '0.195', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '62.500'} [2024-08-06 04:03:17,503][52668] DAMAGECOUNT value on done: 482113.0 [2024-08-06 04:03:17,503][52668] Sum rewards: 64.596, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.614', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.076', 'weapon5': '0.092', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.238', 'AMMO3': '0.340', 'WEAPON3': '1.950', 'weapon3': '3.278', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 413728768. Throughput: 0: 4371.5. Samples: 103431170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:17,794][52567] Avg episode reward: [(0, '70.194')] [2024-08-06 04:03:18,129][52671] Large shaping reward 2.645 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.594, 198.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:03:18,700][52671] DAMAGECOUNT value on done: 479667.0 [2024-08-06 04:03:18,701][52671] Sum rewards: 81.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.086', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'weapon2': '0.244', 'AMMO3': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '68.000'} [2024-08-06 04:03:19,002][52662] DAMAGECOUNT value on done: 484297.0 [2024-08-06 04:03:19,003][52662] Sum rewards: 78.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon2': '0.152', 'AMMO4': '0.152', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '65.000'} [2024-08-06 04:03:19,326][52658] DAMAGECOUNT value on done: 479283.0 [2024-08-06 04:03:19,326][52658] Sum rewards: 78.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO4': '0.114', 'AMMO3': '0.212', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '64.000'} [2024-08-06 04:03:19,459][52669] DAMAGECOUNT value on done: 482525.0 [2024-08-06 04:03:19,459][52669] Sum rewards: 76.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.201', 'weapon4': '0.292', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '62.000'} [2024-08-06 04:03:20,290][52795] DAMAGECOUNT value on done: 443574.0 [2024-08-06 04:03:20,293][52795] Sum rewards: 74.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.716', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.208', 'weapon4': '0.232', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.362', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '62.000'} [2024-08-06 04:03:20,766][52668] DAMAGECOUNT value on done: 471513.0 [2024-08-06 04:03:20,767][52668] Sum rewards: 70.950, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:20,919][52650] Updated weights for policy 0, policy_version 50511 (0.0019) [2024-08-06 04:03:21,544][52662] DAMAGECOUNT value on done: 481925.0 [2024-08-06 04:03:21,544][52662] Sum rewards: 87.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.462', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.126', 'AMMO4': '0.163', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.099', 'FRAGCOUNT': '71.000'} [2024-08-06 04:03:21,938][52671] DAMAGECOUNT value on done: 490085.0 [2024-08-06 04:03:21,939][52671] Sum rewards: 72.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.442', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.129', 'weapon5': '0.178', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:22,142][52658] DAMAGECOUNT value on done: 482989.0 [2024-08-06 04:03:22,142][52658] Sum rewards: 71.824, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.088', 'HEALTH': '0.110', 'weapon5': '0.192', 'AMMO4': '0.207', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:22,197][52669] DAMAGECOUNT value on done: 469168.0 [2024-08-06 04:03:22,198][52669] Sum rewards: 74.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.879', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon5': '0.214', 'weapon2': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 413818880. Throughput: 0: 4371.8. Samples: 103457470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:22,795][52567] Avg episode reward: [(0, '71.109')] [2024-08-06 04:03:23,414][52795] DAMAGECOUNT value on done: 432710.0 [2024-08-06 04:03:23,415][52795] Sum rewards: 65.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.660', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.488', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.198', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '53.500'} [2024-08-06 04:03:23,538][52668] DAMAGECOUNT value on done: 475102.0 [2024-08-06 04:03:23,539][52668] Sum rewards: 80.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.275', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '69.000'} [2024-08-06 04:03:23,666][52660] DAMAGECOUNT value on done: 477019.0 [2024-08-06 04:03:23,667][52660] Sum rewards: 72.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.210', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.104', 'AMMO4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:24,320][52662] DAMAGECOUNT value on done: 471401.0 [2024-08-06 04:03:24,323][52662] Sum rewards: 58.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.377', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.212', 'AMMO4': '0.258', 'weapon5': '0.268', 'weapon4': '0.466', 'weapon2': '0.488', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.490', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '13.830', 'FRAGCOUNT': '50.000'} [2024-08-06 04:03:24,915][52658] DAMAGECOUNT value on done: 480941.0 [2024-08-06 04:03:24,915][52658] Sum rewards: 63.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.062', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.102', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '53.500'} [2024-08-06 04:03:24,921][52669] DAMAGECOUNT value on done: 481112.0 [2024-08-06 04:03:24,921][52669] Sum rewards: 75.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.044', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.190', 'AMMO4': '0.191', 'AMMO3': '0.199', 'weapon5': '0.264', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:25,010][52671] DAMAGECOUNT value on done: 480344.0 [2024-08-06 04:03:25,011][52671] Sum rewards: 86.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon5': '0.228', 'weapon2': '0.724', 'WEAPON3': '0.950', 'weapon3': '2.800', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.787', 'FRAGCOUNT': '67.000'} [2024-08-06 04:03:25,439][52650] Updated weights for policy 0, policy_version 50521 (0.0027) [2024-08-06 04:03:26,341][52668] DAMAGECOUNT value on done: 482750.0 [2024-08-06 04:03:26,343][52668] Sum rewards: 80.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.738', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.104', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '68.000'} [2024-08-06 04:03:26,602][52660] DAMAGECOUNT value on done: 467232.0 [2024-08-06 04:03:26,603][52660] Sum rewards: 64.496, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.615', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.190', 'AMMO3': '0.192', 'AMMO4': '0.246', 'weapon4': '0.286', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '2.928', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '53.000'} [2024-08-06 04:03:26,848][52795] DAMAGECOUNT value on done: 433759.0 [2024-08-06 04:03:26,848][52795] Sum rewards: 74.089, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.515', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.068', 'AMMO4': '0.106', 'weapon5': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.306', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:27,323][52662] DAMAGECOUNT value on done: 482640.0 [2024-08-06 04:03:27,324][52662] Sum rewards: 63.224, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.928', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.076', 'weapon5': '0.138', 'AMMO4': '0.171', 'weapon2': '0.216', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '54.000'} [2024-08-06 04:03:27,503][52671] DAMAGECOUNT value on done: 485033.0 [2024-08-06 04:03:27,503][52671] Sum rewards: 78.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.186', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.080', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.236', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '65.000'} [2024-08-06 04:03:27,768][52658] DAMAGECOUNT value on done: 470606.0 [2024-08-06 04:03:27,769][52658] Sum rewards: 77.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.325', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '3.510', 'weapon3': '3.530', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '63.000'} [2024-08-06 04:03:27,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 413900800. Throughput: 0: 4358.4. Samples: 103483500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:27,795][52567] Avg episode reward: [(0, '71.434')] [2024-08-06 04:03:27,935][52669] DAMAGECOUNT value on done: 481451.0 [2024-08-06 04:03:27,936][52669] Sum rewards: 79.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.685', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.096', 'weapon5': '0.162', 'AMMO3': '0.179', 'AMMO4': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '66.000'} [2024-08-06 04:03:29,684][52668] DAMAGECOUNT value on done: 476845.0 [2024-08-06 04:03:29,684][52668] Sum rewards: 72.817, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.760', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.161', 'weapon4': '0.166', 'weapon5': '0.204', 'weapon2': '0.254', 'AMMO4': '0.255', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '57.000'} [2024-08-06 04:03:29,924][52660] DAMAGECOUNT value on done: 480238.0 [2024-08-06 04:03:29,924][52660] Sum rewards: 71.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.986', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.106', 'AMMO4': '0.192', 'weapon5': '0.196', 'AMMO3': '0.227', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:29,976][52795] DAMAGECOUNT value on done: 439798.0 [2024-08-06 04:03:29,976][52795] Sum rewards: 72.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.817', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.189', 'weapon4': '0.210', 'AMMO4': '0.242', 'weapon5': '0.284', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:30,280][52662] DAMAGECOUNT value on done: 475917.0 [2024-08-06 04:03:30,282][52662] Sum rewards: 72.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.384', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.066', 'weapon5': '0.160', 'AMMO4': '0.215', 'AMMO3': '0.235', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:30,369][52658] DAMAGECOUNT value on done: 475459.0 [2024-08-06 04:03:30,371][52658] Sum rewards: 67.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO4': '0.120', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.294', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:30,551][52650] Updated weights for policy 0, policy_version 50531 (0.0028) [2024-08-06 04:03:30,602][52671] DAMAGECOUNT value on done: 481662.0 [2024-08-06 04:03:30,604][52671] Sum rewards: 77.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.435', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.187', 'weapon5': '0.272', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '63.000'} [2024-08-06 04:03:30,640][52669] DAMAGECOUNT value on done: 493728.0 [2024-08-06 04:03:30,640][52669] Sum rewards: 72.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.230', 'weapon2': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:32,747][52668] DAMAGECOUNT value on done: 471449.0 [2024-08-06 04:03:32,748][52668] Sum rewards: 70.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.151', 'weapon5': '0.152', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 413982720. Throughput: 0: 4359.1. Samples: 103496660. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:32,802][52567] Avg episode reward: [(0, '71.701')] [2024-08-06 04:03:32,934][52660] DAMAGECOUNT value on done: 484451.0 [2024-08-06 04:03:32,935][52660] Sum rewards: 64.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.720', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.116', 'AMMO4': '0.179', 'weapon5': '0.190', 'AMMO3': '0.231', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.870', 'weapon3': '3.010', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '56.000'} [2024-08-06 04:03:33,080][52795] DAMAGECOUNT value on done: 436569.0 [2024-08-06 04:03:33,082][52795] Sum rewards: 82.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.499', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon2': '0.184', 'weapon4': '0.184', 'AMMO4': '0.189', 'weapon5': '0.212', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '67.000'} [2024-08-06 04:03:33,337][52671] DAMAGECOUNT value on done: 475561.0 [2024-08-06 04:03:33,338][52671] Sum rewards: 70.167, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.125', 'weapon5': '0.126', 'weapon4': '0.128', 'AMMO4': '0.143', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.850', 'weapon2': '0.892', 'weapon3': '2.620', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '54.000'} [2024-08-06 04:03:33,376][52658] DAMAGECOUNT value on done: 481734.0 [2024-08-06 04:03:33,378][52658] Sum rewards: 83.842, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'HEALTH': '0.018', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.172', 'weapon2': '0.554', 'WEAPON3': '0.900', 'weapon3': '3.038', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '65.000'} [2024-08-06 04:03:33,438][52669] DAMAGECOUNT value on done: 481984.0 [2024-08-06 04:03:33,438][52669] Sum rewards: 61.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.709', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.330', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.318', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '52.000'} [2024-08-06 04:03:33,452][52662] DAMAGECOUNT value on done: 482029.0 [2024-08-06 04:03:33,452][52662] Sum rewards: 68.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.483', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.154', 'AMMO3': '0.237', 'weapon5': '0.244', 'AMMO4': '0.253', 'weapon2': '0.290', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:34,855][52650] Updated weights for policy 0, policy_version 50541 (0.0027) [2024-08-06 04:03:35,244][52665] DAMAGECOUNT value on done: 467322.0 [2024-08-06 04:03:35,244][52665] Sum rewards: 81.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.278', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon2': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.282', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '67.000'} [2024-08-06 04:03:35,463][52668] DAMAGECOUNT value on done: 465824.0 [2024-08-06 04:03:35,464][52668] Sum rewards: 64.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.146', 'AMMO4': '0.155', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '54.000'} [2024-08-06 04:03:35,591][52660] DAMAGECOUNT value on done: 477869.0 [2024-08-06 04:03:35,594][52660] Sum rewards: 84.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.585', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.095', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '70.000'} [2024-08-06 04:03:36,207][52662] DAMAGECOUNT value on done: 487403.0 [2024-08-06 04:03:36,207][52662] Sum rewards: 67.130, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.068', 'weapon2': '0.204', 'AMMO3': '0.211', 'weapon4': '0.294', 'weapon5': '0.300', 'AMMO4': '0.339', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '54.000'} [2024-08-06 04:03:36,254][52795] DAMAGECOUNT value on done: 444160.0 [2024-08-06 04:03:36,255][52795] Sum rewards: 78.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '64.000'} [2024-08-06 04:03:36,257][52671] DAMAGECOUNT value on done: 483335.0 [2024-08-06 04:03:36,259][52671] Sum rewards: 74.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.151', 'weapon5': '0.170', 'AMMO4': '0.174', 'weapon4': '0.186', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.000', 'weapon3': '2.994', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:36,336][52658] DAMAGECOUNT value on done: 473629.0 [2024-08-06 04:03:36,336][52658] Sum rewards: 80.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.214', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '66.000'} [2024-08-06 04:03:36,467][52669] DAMAGECOUNT value on done: 479752.0 [2024-08-06 04:03:36,468][52669] Sum rewards: 60.199, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.470', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.086', 'weapon5': '0.098', 'AMMO3': '0.264', 'weapon2': '0.292', 'AMMO4': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.220', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '55.000'} [2024-08-06 04:03:37,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 414081024. Throughput: 0: 4362.4. Samples: 103523010. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:03:37,802][52567] Avg episode reward: [(0, '72.165')] [2024-08-06 04:03:37,996][52668] DAMAGECOUNT value on done: 467334.0 [2024-08-06 04:03:37,998][52668] Sum rewards: 71.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.224', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.394', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '62.000'} [2024-08-06 04:03:38,063][52665] DAMAGECOUNT value on done: 479498.0 [2024-08-06 04:03:38,063][52665] Sum rewards: 70.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.757', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.182', 'weapon5': '0.182', 'AMMO4': '0.242', 'weapon4': '0.378', 'weapon2': '0.440', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:38,073][52660] DAMAGECOUNT value on done: 474049.0 [2024-08-06 04:03:38,074][52660] Sum rewards: 75.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.577', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.056', 'AMMO3': '0.219', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.500', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '62.000'} [2024-08-06 04:03:38,939][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:03:39,007][52658] DAMAGECOUNT value on done: 487573.0 [2024-08-06 04:03:39,007][52658] Sum rewards: 77.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.505', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.076', 'AMMO4': '0.129', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.050', 'weapon3': '3.326', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '62.000'} [2024-08-06 04:03:39,218][52671] DAMAGECOUNT value on done: 485362.0 [2024-08-06 04:03:39,218][52671] Sum rewards: 56.842, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.181', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.112', 'weapon2': '0.224', 'weapon5': '0.224', 'AMMO4': '0.273', 'AMMO3': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.088', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '52.000'} [2024-08-06 04:03:39,336][52662] DAMAGECOUNT value on done: 476131.0 [2024-08-06 04:03:39,339][52662] Sum rewards: 80.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.102', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '65.000'} [2024-08-06 04:03:39,418][52795] DAMAGECOUNT value on done: 448442.0 [2024-08-06 04:03:39,419][52795] Sum rewards: 66.387, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.272', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.104', 'AMMO3': '0.206', 'AMMO4': '0.270', 'weapon5': '0.274', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.000'} [2024-08-06 04:03:39,441][52669] DAMAGECOUNT value on done: 484680.0 [2024-08-06 04:03:39,442][52669] Sum rewards: 79.314, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.930', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.130', 'AMMO3': '0.174', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '64.000'} [2024-08-06 04:03:39,659][52650] Updated weights for policy 0, policy_version 50551 (0.0016) [2024-08-06 04:03:40,717][52668] DAMAGECOUNT value on done: 469358.0 [2024-08-06 04:03:40,717][52668] Sum rewards: 70.844, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.692', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.354', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '61.000'} [2024-08-06 04:03:40,821][52660] DAMAGECOUNT value on done: 474891.0 [2024-08-06 04:03:40,822][52660] Sum rewards: 80.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.038', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.358', 'WEAPON3': '1.650', 'weapon3': '3.374', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '69.000'} [2024-08-06 04:03:41,046][52665] DAMAGECOUNT value on done: 475618.0 [2024-08-06 04:03:41,046][52665] Sum rewards: 74.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.805', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon4': '0.032', 'AMMO4': '0.041', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '62.000'} [2024-08-06 04:03:42,072][52658] DAMAGECOUNT value on done: 475446.0 [2024-08-06 04:03:42,072][52658] Sum rewards: 51.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.015', 'weapon7': '0.020', 'AMMO2': '0.053', 'weapon5': '0.158', 'AMMO3': '0.193', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.264', 'weapon2': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '2.604', 'DAMAGECOUNT': '11.700', 'FRAGCOUNT': '44.000'} [2024-08-06 04:03:42,280][52671] DAMAGECOUNT value on done: 480620.0 [2024-08-06 04:03:42,280][52671] Sum rewards: 76.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.722', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.156', 'weapon4': '0.156', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '63.000'} [2024-08-06 04:03:42,422][52662] DAMAGECOUNT value on done: 490224.0 [2024-08-06 04:03:42,423][52662] Sum rewards: 73.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.349', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.102', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.156', 'weapon4': '0.188', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:42,480][52669] DAMAGECOUNT value on done: 483910.0 [2024-08-06 04:03:42,482][52669] Sum rewards: 70.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.480', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.195', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:42,523][52795] DAMAGECOUNT value on done: 444754.0 [2024-08-06 04:03:42,526][52795] Sum rewards: 60.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.156', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon5': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.100', 'weapon3': '2.758', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '50.000'} [2024-08-06 04:03:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 414162944. Throughput: 0: 4384.0. Samples: 103549430. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:03:42,802][52567] Avg episode reward: [(0, '72.403')] [2024-08-06 04:03:43,062][52668] DAMAGECOUNT value on done: 476016.0 [2024-08-06 04:03:43,064][52668] Sum rewards: 62.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.968', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.199', 'AMMO4': '0.211', 'weapon5': '0.280', 'weapon2': '0.292', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.486', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '52.000'} [2024-08-06 04:03:43,272][52660] DAMAGECOUNT value on done: 479873.0 [2024-08-06 04:03:43,272][52660] Sum rewards: 76.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.016', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.016', 'weapon5': '0.020', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '66.000'} [2024-08-06 04:03:44,165][52665] DAMAGECOUNT value on done: 471164.0 [2024-08-06 04:03:44,167][52665] Sum rewards: 68.714, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.094', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:44,439][52650] Updated weights for policy 0, policy_version 50561 (0.0013) [2024-08-06 04:03:44,762][52671] DAMAGECOUNT value on done: 487432.0 [2024-08-06 04:03:44,764][52671] Sum rewards: 76.012, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.368', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.154', 'AMMO4': '0.191', 'AMMO3': '0.272', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '68.000'} [2024-08-06 04:03:45,176][52658] DAMAGECOUNT value on done: 488875.0 [2024-08-06 04:03:45,177][52658] Sum rewards: 65.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.942', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.172', 'AMMO4': '0.202', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '54.000'} [2024-08-06 04:03:45,390][52820] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:03:45,458][52662] DAMAGECOUNT value on done: 475790.0 [2024-08-06 04:03:45,459][52662] Sum rewards: 72.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.325', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.054', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon5': '0.256', 'weapon2': '0.622', 'WEAPON3': '0.950', 'weapon3': '2.864', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:45,663][52795] DAMAGECOUNT value on done: 434599.0 [2024-08-06 04:03:45,663][52795] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.163', 'AMMO3': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.528', 'weapon4': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.404', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '61.000'} [2024-08-06 04:03:46,023][52668] DAMAGECOUNT value on done: 478149.0 [2024-08-06 04:03:46,023][52668] Sum rewards: 72.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.150', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon2': '0.192', 'weapon5': '0.206', 'AMMO3': '0.221', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:46,309][52660] DAMAGECOUNT value on done: 479398.0 [2024-08-06 04:03:46,318][52660] Sum rewards: 66.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.964', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.023', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon5': '0.244', 'weapon2': '0.606', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.908', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '54.000'} [2024-08-06 04:03:46,831][52665] DAMAGECOUNT value on done: 462484.0 [2024-08-06 04:03:46,832][52665] Sum rewards: 59.094, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.028', 'HEALTH': '0.028', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.243', 'weapon2': '0.336', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.240', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '51.000'} [2024-08-06 04:03:47,218][52671] DAMAGECOUNT value on done: 480948.0 [2024-08-06 04:03:47,220][52671] Sum rewards: 79.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.070', 'weapon4': '0.128', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '67.000'} [2024-08-06 04:03:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 414253056. Throughput: 0: 4392.5. Samples: 103562610. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:03:47,794][52567] Avg episode reward: [(0, '72.398')] [2024-08-06 04:03:47,995][52658] DAMAGECOUNT value on done: 470232.0 [2024-08-06 04:03:47,996][52658] Sum rewards: 72.837, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.014', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.104', 'AMMO3': '0.145', 'weapon4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '0.950', 'weapon3': '3.150', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '57.000'} [2024-08-06 04:03:48,163][52662] DAMAGECOUNT value on done: 480234.0 [2024-08-06 04:03:48,165][52662] Sum rewards: 70.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.178', 'AMMO3': '0.185', 'weapon2': '0.198', 'AMMO4': '0.260', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 04:03:48,784][52668] DAMAGECOUNT value on done: 476445.0 [2024-08-06 04:03:48,784][52668] Sum rewards: 66.522, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon5': '0.032', 'weapon4': '0.048', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.274', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:48,839][52795] DAMAGECOUNT value on done: 447867.0 [2024-08-06 04:03:48,841][52795] Sum rewards: 62.338, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.130', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.220', 'weapon2': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.492', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '53.000'} [2024-08-06 04:03:48,952][52650] Updated weights for policy 0, policy_version 50571 (0.0011) [2024-08-06 04:03:49,013][52660] DAMAGECOUNT value on done: 473357.0 [2024-08-06 04:03:49,014][52660] Sum rewards: 65.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.162', 'weapon4': '0.164', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '56.000'} [2024-08-06 04:03:50,044][52671] DAMAGECOUNT value on done: 467857.0 [2024-08-06 04:03:50,045][52671] Sum rewards: 71.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.191', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.142', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:50,065][52665] DAMAGECOUNT value on done: 468655.0 [2024-08-06 04:03:50,067][52665] Sum rewards: 67.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.026', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.152', 'AMMO4': '0.172', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '56.000'} [2024-08-06 04:03:50,733][52658] DAMAGECOUNT value on done: 479759.0 [2024-08-06 04:03:50,734][52658] Sum rewards: 69.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.884', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.147', 'AMMO4': '0.165', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'weapon4': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.488', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '54.500'} [2024-08-06 04:03:50,751][52662] DAMAGECOUNT value on done: 477700.0 [2024-08-06 04:03:50,751][52662] Sum rewards: 67.562, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.016', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.426', 'WEAPON3': '1.500', 'weapon3': '2.952', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:50,772][52663] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('HEALTH', -0.003, -1.0), ('weapon5', 0.002)] [2024-08-06 04:03:51,257][52668] DAMAGECOUNT value on done: 481205.0 [2024-08-06 04:03:51,257][52668] Sum rewards: 56.815, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.119', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '49.000'} [2024-08-06 04:03:51,445][52660] DAMAGECOUNT value on done: 484200.0 [2024-08-06 04:03:51,447][52660] Sum rewards: 65.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.106', 'weapon4': '0.176', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.106', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '54.000'} [2024-08-06 04:03:52,025][52795] DAMAGECOUNT value on done: 441756.0 [2024-08-06 04:03:52,025][52795] Sum rewards: 72.852, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.155', 'weapon5': '0.160', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.390', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.774', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '57.000'} [2024-08-06 04:03:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 414334976. Throughput: 0: 4397.5. Samples: 103589390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:03:52,795][52567] Avg episode reward: [(0, '72.086')] [2024-08-06 04:03:52,830][52665] DAMAGECOUNT value on done: 472229.0 [2024-08-06 04:03:52,831][52665] Sum rewards: 78.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '65.000'} [2024-08-06 04:03:52,972][52671] DAMAGECOUNT value on done: 488113.0 [2024-08-06 04:03:52,972][52671] Sum rewards: 73.921, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.096', 'weapon4': '0.102', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:53,451][52662] DAMAGECOUNT value on done: 485625.0 [2024-08-06 04:03:53,452][52662] Sum rewards: 73.643, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.505', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.116', 'weapon5': '0.214', 'AMMO4': '0.215', 'AMMO3': '0.236', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '63.000'} [2024-08-06 04:03:53,572][52650] Updated weights for policy 0, policy_version 50581 (0.0012) [2024-08-06 04:03:53,907][52658] DAMAGECOUNT value on done: 476480.0 [2024-08-06 04:03:53,908][52658] Sum rewards: 81.094, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.655', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'weapon4': '0.142', 'weapon2': '0.512', 'WEAPON3': '0.950', 'weapon3': '3.172', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '63.000'} [2024-08-06 04:03:54,188][52668] DAMAGECOUNT value on done: 478179.0 [2024-08-06 04:03:54,191][52668] Sum rewards: 85.269, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.244', 'weapon2': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.224', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.922', 'FRAGCOUNT': '70.000'} [2024-08-06 04:03:54,389][52660] DAMAGECOUNT value on done: 470061.0 [2024-08-06 04:03:54,391][52660] Sum rewards: 73.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.212', 'weapon4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '61.000'} [2024-08-06 04:03:55,296][52795] DAMAGECOUNT value on done: 439626.0 [2024-08-06 04:03:55,298][52795] Sum rewards: 69.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.284', 'weapon4': '0.360', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '58.000'} [2024-08-06 04:03:55,981][52662] DAMAGECOUNT value on done: 478740.0 [2024-08-06 04:03:55,981][52662] Sum rewards: 73.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.108', 'AMMO4': '0.120', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 04:03:56,006][52671] DAMAGECOUNT value on done: 485240.0 [2024-08-06 04:03:56,008][52671] Sum rewards: 64.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.443', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.156', 'weapon2': '0.166', 'AMMO4': '0.214', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '53.000'} [2024-08-06 04:03:56,030][52665] DAMAGECOUNT value on done: 472911.0 [2024-08-06 04:03:56,031][52665] Sum rewards: 71.152, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.126', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.084', 'weapon5': '0.168', 'AMMO4': '0.214', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '2.940', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.000'} [2024-08-06 04:03:56,590][52658] DAMAGECOUNT value on done: 476079.0 [2024-08-06 04:03:56,592][52658] Sum rewards: 67.950, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.566', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.176', 'AMMO4': '0.225', 'AMMO3': '0.244', 'weapon5': '0.258', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '2.978', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:57,284][52803] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:03:57,452][52660] DAMAGECOUNT value on done: 476859.0 [2024-08-06 04:03:57,453][52660] Sum rewards: 82.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.666', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.146', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '69.000'} [2024-08-06 04:03:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 414425088. Throughput: 0: 4392.4. Samples: 103615550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:03:57,794][52567] Avg episode reward: [(0, '72.124')] [2024-08-06 04:03:58,187][52614] Signal inference workers to stop experience collection... (9200 times) [2024-08-06 04:03:58,202][52614] Signal inference workers to resume experience collection... (9200 times) [2024-08-06 04:03:58,261][52650] InferenceWorker_p0-w0: stopping experience collection (9200 times) [2024-08-06 04:03:58,262][52650] InferenceWorker_p0-w0: resuming experience collection (9200 times) [2024-08-06 04:03:58,283][52650] Updated weights for policy 0, policy_version 50591 (0.0051) [2024-08-06 04:03:58,363][52820] DAMAGECOUNT value on done: 440331.0 [2024-08-06 04:03:58,365][52820] Sum rewards: 71.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.078', 'weapon5': '0.154', 'AMMO4': '0.166', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.266', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2024-08-06 04:03:58,471][52795] DAMAGECOUNT value on done: 436817.0 [2024-08-06 04:03:58,471][52795] Sum rewards: 71.743, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.144', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.202', 'weapon2': '0.216', 'AMMO3': '0.226', 'weapon4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '60.000'} [2024-08-06 04:03:58,593][52671] DAMAGECOUNT value on done: 485763.0 [2024-08-06 04:03:58,593][52671] Sum rewards: 61.620, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.168', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '51.000'} [2024-08-06 04:03:58,943][52662] DAMAGECOUNT value on done: 490270.0 [2024-08-06 04:03:58,944][52662] Sum rewards: 80.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.082', 'weapon5': '0.160', 'weapon2': '0.186', 'AMMO4': '0.193', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.342', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '66.000'} [2024-08-06 04:03:59,190][52665] DAMAGECOUNT value on done: 479747.0 [2024-08-06 04:03:59,191][52665] Sum rewards: 74.008, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.122', 'weapon5': '0.128', 'AMMO4': '0.142', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:00,054][52658] DAMAGECOUNT value on done: 471470.0 [2024-08-06 04:04:00,057][52658] Sum rewards: 82.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.274', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '68.000'} [2024-08-06 04:04:00,356][52660] DAMAGECOUNT value on done: 485453.0 [2024-08-06 04:04:00,356][52660] Sum rewards: 62.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.066', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.324', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '51.000'} [2024-08-06 04:04:01,176][52671] DAMAGECOUNT value on done: 483494.0 [2024-08-06 04:04:01,177][52671] Sum rewards: 69.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.088', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.181', 'weapon5': '0.214', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.450', 'weapon4': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:01,489][52820] DAMAGECOUNT value on done: 441810.0 [2024-08-06 04:04:01,489][52820] Sum rewards: 67.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.158', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.090', 'weapon4': '0.106', 'weapon2': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'WEAPON3': '1.600', 'HITCOUNT': '3.260', 'weapon3': '3.410', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:01,566][52795] DAMAGECOUNT value on done: 444438.0 [2024-08-06 04:04:01,566][52795] Sum rewards: 78.866, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.843', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '64.000'} [2024-08-06 04:04:01,907][52665] DAMAGECOUNT value on done: 471340.0 [2024-08-06 04:04:01,908][52665] Sum rewards: 66.391, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.682', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.120', 'AMMO4': '0.171', 'weapon5': '0.258', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON3': '0.750', 'weapon3': '2.672', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:01,945][52662] DAMAGECOUNT value on done: 482823.0 [2024-08-06 04:04:01,946][52662] Sum rewards: 60.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.671', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.066', 'AMMO4': '0.129', 'AMMO3': '0.159', 'weapon4': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.776', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2024-08-06 04:04:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 414515200. Throughput: 0: 4388.9. Samples: 103628670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:04:02,795][52567] Avg episode reward: [(0, '71.543')] [2024-08-06 04:04:02,858][52650] Updated weights for policy 0, policy_version 50601 (0.0025) [2024-08-06 04:04:02,987][52658] DAMAGECOUNT value on done: 485668.0 [2024-08-06 04:04:02,987][52658] Sum rewards: 65.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.385', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO4': '0.233', 'weapon2': '0.284', 'AMMO3': '0.286', 'weapon5': '0.346', 'weapon4': '0.362', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.632', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '56.000'} [2024-08-06 04:04:03,470][52660] DAMAGECOUNT value on done: 489870.0 [2024-08-06 04:04:03,471][52660] Sum rewards: 55.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.162', 'AMMO5': '0.015', 'AMMO2': '0.061', 'AMMO3': '0.220', 'weapon5': '0.256', 'weapon4': '0.270', 'AMMO4': '0.307', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '2.742', 'DAMAGECOUNT': '14.358', 'FRAGCOUNT': '47.000'} [2024-08-06 04:04:04,232][52671] DAMAGECOUNT value on done: 477899.0 [2024-08-06 04:04:04,232][52671] Sum rewards: 70.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.904', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.118', 'weapon4': '0.146', 'AMMO4': '0.163', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.898', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:04,565][52820] DAMAGECOUNT value on done: 444421.0 [2024-08-06 04:04:04,565][52820] Sum rewards: 75.768, reward structure: {'DEATHCOUNT': '-17.250', 'AMMO5': '0.017', 'AMMO2': '0.040', 'HEALTH': '0.050', 'weapon5': '0.106', 'weapon4': '0.146', 'AMMO4': '0.203', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '65.000'} [2024-08-06 04:04:04,590][52662] DAMAGECOUNT value on done: 476245.0 [2024-08-06 04:04:04,590][52662] Sum rewards: 67.142, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.783', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.044', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.226', 'weapon2': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.234', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '55.000'} [2024-08-06 04:04:04,708][52665] DAMAGECOUNT value on done: 481918.0 [2024-08-06 04:04:04,709][52665] Sum rewards: 76.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.065', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.159', 'weapon5': '0.178', 'weapon4': '0.180', 'AMMO4': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.034', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:04,717][52795] DAMAGECOUNT value on done: 433521.0 [2024-08-06 04:04:04,717][52795] Sum rewards: 67.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.574', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO4': '0.177', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:05,746][52658] DAMAGECOUNT value on done: 476545.0 [2024-08-06 04:04:05,746][52658] Sum rewards: 65.142, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.160', 'weapon2': '0.184', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:06,424][52660] DAMAGECOUNT value on done: 474534.0 [2024-08-06 04:04:06,425][52660] Sum rewards: 73.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO2': '0.018', 'weapon4': '0.060', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON3': '1.300', 'HITCOUNT': '3.530', 'weapon3': '3.544', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '60.000'} [2024-08-06 04:04:07,790][52662] DAMAGECOUNT value on done: 477450.0 [2024-08-06 04:04:07,790][52662] Sum rewards: 71.373, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.684', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'AMMO4': '0.176', 'weapon2': '0.254', 'weapon4': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 414597120. Throughput: 0: 4385.1. Samples: 103654800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:04:07,795][52567] Avg episode reward: [(0, '71.140')] [2024-08-06 04:04:07,830][52665] DAMAGECOUNT value on done: 478766.0 [2024-08-06 04:04:07,830][52665] Sum rewards: 80.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.022', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.222', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.494', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '67.000'} [2024-08-06 04:04:07,833][52795] DAMAGECOUNT value on done: 451741.0 [2024-08-06 04:04:07,834][52795] Sum rewards: 52.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.058', 'AMMO4': '0.073', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.544', 'WEAPON3': '1.700', 'HITCOUNT': '2.800', 'weapon3': '2.834', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '46.000'} [2024-08-06 04:04:07,850][52820] DAMAGECOUNT value on done: 437178.0 [2024-08-06 04:04:07,851][52820] Sum rewards: 74.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.622', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.102', 'AMMO4': '0.114', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '60.000'} [2024-08-06 04:04:08,046][52650] Updated weights for policy 0, policy_version 50611 (0.0012) [2024-08-06 04:04:08,165][52658] DAMAGECOUNT value on done: 479591.0 [2024-08-06 04:04:08,166][52658] Sum rewards: 76.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.260', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.448', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '62.000'} [2024-08-06 04:04:08,853][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:04:09,397][52660] DAMAGECOUNT value on done: 481767.0 [2024-08-06 04:04:09,398][52660] Sum rewards: 70.370, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:10,349][52794] DAMAGECOUNT value on done: 479360.0 [2024-08-06 04:04:10,350][52794] Sum rewards: 64.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.233', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.136', 'AMMO3': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.354', 'weapon2': '0.430', 'WEAPON3': '0.900', 'weapon3': '2.896', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '51.000'} [2024-08-06 04:04:10,974][52665] DAMAGECOUNT value on done: 473418.0 [2024-08-06 04:04:10,982][52665] Sum rewards: 66.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.836', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.196', 'AMMO4': '0.234', 'weapon4': '0.248', 'weapon5': '0.292', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.646', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '53.500'} [2024-08-06 04:04:10,996][52795] DAMAGECOUNT value on done: 443793.0 [2024-08-06 04:04:10,999][52795] Sum rewards: 71.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.198', 'weapon2': '0.690', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:11,021][52662] DAMAGECOUNT value on done: 474269.0 [2024-08-06 04:04:11,021][52662] Sum rewards: 70.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.192', 'weapon2': '0.802', 'WEAPON3': '1.200', 'weapon3': '2.720', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:11,105][52820] DAMAGECOUNT value on done: 446370.0 [2024-08-06 04:04:11,107][52820] Sum rewards: 63.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '55.000'} [2024-08-06 04:04:11,483][52658] DAMAGECOUNT value on done: 483350.0 [2024-08-06 04:04:11,485][52658] Sum rewards: 69.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.102', 'weapon4': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.352', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:11,857][52660] DAMAGECOUNT value on done: 474583.0 [2024-08-06 04:04:11,858][52660] Sum rewards: 61.778, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.731', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.060', 'AMMO3': '0.128', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.468', 'weapon4': '0.472', 'WEAPON3': '0.800', 'weapon3': '2.862', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '47.000'} [2024-08-06 04:04:12,501][52650] Updated weights for policy 0, policy_version 50621 (0.0032) [2024-08-06 04:04:12,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 414687232. Throughput: 0: 4390.9. Samples: 103681090. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:04:12,794][52567] Avg episode reward: [(0, '70.648')] [2024-08-06 04:04:13,549][52794] DAMAGECOUNT value on done: 484900.0 [2024-08-06 04:04:13,549][52794] Sum rewards: 87.611, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.130', 'HEALTH': '0.132', 'AMMO4': '0.135', 'AMMO3': '0.166', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '69.000'} [2024-08-06 04:04:14,116][52665] DAMAGECOUNT value on done: 470665.0 [2024-08-06 04:04:14,118][52665] Sum rewards: 74.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO4': '0.167', 'AMMO3': '0.182', 'weapon4': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '62.000'} [2024-08-06 04:04:14,155][52795] DAMAGECOUNT value on done: 434552.0 [2024-08-06 04:04:14,155][52795] Sum rewards: 76.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.064', 'AMMO4': '0.123', 'weapon4': '0.160', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.840', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:14,291][52820] DAMAGECOUNT value on done: 437618.0 [2024-08-06 04:04:14,293][52820] Sum rewards: 76.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.018', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.201', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:14,582][52660] DAMAGECOUNT value on done: 476085.0 [2024-08-06 04:04:14,582][52660] Sum rewards: 57.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.025', 'AMMO2': '0.065', 'AMMO3': '0.205', 'weapon5': '0.256', 'weapon4': '0.302', 'AMMO4': '0.324', 'weapon2': '0.338', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.726', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '49.000'} [2024-08-06 04:04:16,003][52647] DAMAGECOUNT value on done: 503918.0 [2024-08-06 04:04:16,004][52647] Sum rewards: 71.707, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.022', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.114', 'weapon5': '0.142', 'AMMO3': '0.165', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.738', 'WEAPON3': '0.850', 'weapon3': '2.790', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:16,559][52794] DAMAGECOUNT value on done: 482836.0 [2024-08-06 04:04:16,561][52794] Sum rewards: 58.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.258', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.104', 'AMMO4': '0.191', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '51.000'} [2024-08-06 04:04:16,749][52665] DAMAGECOUNT value on done: 473985.0 [2024-08-06 04:04:16,751][52665] Sum rewards: 59.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.356', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '51.000'} [2024-08-06 04:04:16,958][52650] Updated weights for policy 0, policy_version 50631 (0.0024) [2024-08-06 04:04:17,181][52795] DAMAGECOUNT value on done: 444626.0 [2024-08-06 04:04:17,182][52795] Sum rewards: 63.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.995', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.144', 'weapon5': '0.186', 'AMMO4': '0.234', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '54.000'} [2024-08-06 04:04:17,420][52820] DAMAGECOUNT value on done: 441321.0 [2024-08-06 04:04:17,420][52820] Sum rewards: 82.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.456', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.112', 'AMMO4': '0.202', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '68.000'} [2024-08-06 04:04:17,481][52660] DAMAGECOUNT value on done: 470033.0 [2024-08-06 04:04:17,482][52660] Sum rewards: 64.763, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.408', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '2.976', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:17,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 414777344. Throughput: 0: 4388.4. Samples: 103694140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:04:17,795][52567] Avg episode reward: [(0, '70.390')] [2024-08-06 04:04:19,112][52665] DAMAGECOUNT value on done: 468835.0 [2024-08-06 04:04:19,114][52665] Sum rewards: 73.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.194', 'weapon5': '0.212', 'AMMO4': '0.261', 'weapon2': '0.272', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '60.000'} [2024-08-06 04:04:19,134][52647] DAMAGECOUNT value on done: 504336.0 [2024-08-06 04:04:19,134][52647] Sum rewards: 66.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.150', 'weapon5': '0.180', 'AMMO4': '0.186', 'AMMO3': '0.211', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.150', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '55.000'} [2024-08-06 04:04:19,178][52794] DAMAGECOUNT value on done: 475121.0 [2024-08-06 04:04:19,179][52794] Sum rewards: 69.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:19,491][52659] DAMAGECOUNT value on done: 481740.0 [2024-08-06 04:04:19,492][52659] Sum rewards: 81.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.878', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.064', 'AMMO4': '0.173', 'weapon5': '0.176', 'AMMO3': '0.245', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '66.000'} [2024-08-06 04:04:20,372][52795] DAMAGECOUNT value on done: 447261.0 [2024-08-06 04:04:20,381][52795] Sum rewards: 71.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.900', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.123', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON3': '1.750', 'weapon3': '3.406', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:20,551][52820] DAMAGECOUNT value on done: 444072.0 [2024-08-06 04:04:20,553][52820] Sum rewards: 63.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.124', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.166', 'weapon5': '0.186', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.064', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '52.000'} [2024-08-06 04:04:21,681][52665] DAMAGECOUNT value on done: 471086.0 [2024-08-06 04:04:21,695][52665] Sum rewards: 79.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.388', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.222', 'weapon2': '0.224', 'weapon5': '0.230', 'AMMO4': '0.258', 'weapon4': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.948', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '64.000'} [2024-08-06 04:04:21,758][52650] Updated weights for policy 0, policy_version 50641 (0.0018) [2024-08-06 04:04:21,862][52647] DAMAGECOUNT value on done: 501018.0 [2024-08-06 04:04:21,863][52647] Sum rewards: 59.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.229', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.177', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.302', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '51.000'} [2024-08-06 04:04:22,326][52794] DAMAGECOUNT value on done: 476912.0 [2024-08-06 04:04:22,329][52794] Sum rewards: 65.680, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.573', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.110', 'weapon4': '0.118', 'AMMO4': '0.126', 'AMMO3': '0.283', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.030', 'weapon3': '3.210', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:22,574][52659] DAMAGECOUNT value on done: 479439.0 [2024-08-06 04:04:22,575][52659] Sum rewards: 81.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.215', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.052', 'weapon4': '0.096', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '68.000'} [2024-08-06 04:04:22,752][52664] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.033, 11.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:04:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 414867456. Throughput: 0: 4387.3. Samples: 103720440. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:04:22,794][52567] Avg episode reward: [(0, '70.251')] [2024-08-06 04:04:23,623][52820] DAMAGECOUNT value on done: 440701.0 [2024-08-06 04:04:23,625][52820] Sum rewards: 73.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.984', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon2': '0.162', 'weapon4': '0.182', 'weapon5': '0.190', 'AMMO3': '0.196', 'AMMO4': '0.203', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '60.500'} [2024-08-06 04:04:24,278][52664] DAMAGECOUNT value on done: 497671.0 [2024-08-06 04:04:24,279][52664] Sum rewards: 74.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.596', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.141', 'weapon5': '0.198', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:24,501][52647] DAMAGECOUNT value on done: 512703.0 [2024-08-06 04:04:24,503][52647] Sum rewards: 66.856, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.562', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon4': '0.158', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:24,871][52665] DAMAGECOUNT value on done: 469086.0 [2024-08-06 04:04:24,873][52665] Sum rewards: 64.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.278', 'weapon4': '0.356', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '54.000'} [2024-08-06 04:04:24,990][52794] DAMAGECOUNT value on done: 480084.0 [2024-08-06 04:04:24,990][52794] Sum rewards: 52.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.164', 'AMMO3': '0.193', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '2.842', 'DAMAGECOUNT': '13.683', 'FRAGCOUNT': '45.000'} [2024-08-06 04:04:25,753][52659] DAMAGECOUNT value on done: 483932.0 [2024-08-06 04:04:25,753][52659] Sum rewards: 77.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.522', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.102', 'AMMO4': '0.161', 'weapon5': '0.166', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '64.000'} [2024-08-06 04:04:26,297][52650] Updated weights for policy 0, policy_version 50651 (0.0019) [2024-08-06 04:04:26,762][52820] DAMAGECOUNT value on done: 450258.0 [2024-08-06 04:04:26,762][52820] Sum rewards: 64.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.067', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:27,105][52664] DAMAGECOUNT value on done: 503736.0 [2024-08-06 04:04:27,106][52664] Sum rewards: 82.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.745', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '68.000'} [2024-08-06 04:04:27,261][52647] DAMAGECOUNT value on done: 510176.0 [2024-08-06 04:04:27,262][52647] Sum rewards: 81.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.126', 'weapon4': '0.132', 'AMMO4': '0.148', 'weapon2': '0.204', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '68.000'} [2024-08-06 04:04:27,642][52794] DAMAGECOUNT value on done: 485657.0 [2024-08-06 04:04:27,643][52794] Sum rewards: 72.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.688', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.190', 'weapon5': '0.212', 'weapon4': '0.214', 'AMMO4': '0.270', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '60.000'} [2024-08-06 04:04:27,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 414957568. Throughput: 0: 4385.3. Samples: 103746770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:04:27,794][52567] Avg episode reward: [(0, '70.297')] [2024-08-06 04:04:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050654_414957568.pth... [2024-08-06 04:04:27,857][52665] DAMAGECOUNT value on done: 470041.0 [2024-08-06 04:04:27,857][52665] Sum rewards: 66.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.202', 'weapon2': '0.210', 'AMMO3': '0.223', 'AMMO4': '0.270', 'weapon4': '0.304', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '55.000'} [2024-08-06 04:04:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050141_410755072.pth [2024-08-06 04:04:28,827][52659] DAMAGECOUNT value on done: 478789.0 [2024-08-06 04:04:28,827][52659] Sum rewards: 79.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.132', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.084', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.254', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '65.000'} [2024-08-06 04:04:29,880][52820] DAMAGECOUNT value on done: 440298.0 [2024-08-06 04:04:29,884][52820] Sum rewards: 76.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.912', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.092', 'weapon5': '0.256', 'AMMO3': '0.264', 'AMMO4': '0.287', 'weapon2': '0.330', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:30,008][52664] DAMAGECOUNT value on done: 501311.0 [2024-08-06 04:04:30,010][52664] Sum rewards: 55.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.144', 'weapon5': '0.256', 'AMMO3': '0.283', 'AMMO4': '0.295', 'weapon2': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'HITCOUNT': '2.810', 'weapon3': '2.836', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '49.000'} [2024-08-06 04:04:30,078][52794] DAMAGECOUNT value on done: 473317.0 [2024-08-06 04:04:30,079][52794] Sum rewards: 67.364, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.030', 'AMMO4': '0.124', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.238', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '54.000'} [2024-08-06 04:04:30,103][52647] DAMAGECOUNT value on done: 507484.0 [2024-08-06 04:04:30,103][52647] Sum rewards: 70.576, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.247', 'weapon2': '0.554', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:30,840][52665] DAMAGECOUNT value on done: 474997.0 [2024-08-06 04:04:30,840][52665] Sum rewards: 76.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.460', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.279', 'weapon4': '0.296', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '2.978', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '64.000'} [2024-08-06 04:04:31,276][52650] Updated weights for policy 0, policy_version 50661 (0.0018) [2024-08-06 04:04:31,994][52659] DAMAGECOUNT value on done: 477661.0 [2024-08-06 04:04:31,994][52659] Sum rewards: 83.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'weapon4': '0.218', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '69.000'} [2024-08-06 04:04:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 415039488. Throughput: 0: 4381.3. Samples: 103759770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:04:32,795][52567] Avg episode reward: [(0, '70.404')] [2024-08-06 04:04:32,836][52794] DAMAGECOUNT value on done: 484054.0 [2024-08-06 04:04:32,837][52794] Sum rewards: 75.429, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.794', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.118', 'weapon5': '0.154', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '64.000'} [2024-08-06 04:04:32,840][52664] DAMAGECOUNT value on done: 492189.0 [2024-08-06 04:04:32,840][52664] Sum rewards: 74.700, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.350', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.173', 'weapon5': '0.224', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.666', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '60.000'} [2024-08-06 04:04:32,916][52647] DAMAGECOUNT value on done: 504990.0 [2024-08-06 04:04:32,917][52647] Sum rewards: 73.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.844', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.196', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:33,037][52820] DAMAGECOUNT value on done: 444680.0 [2024-08-06 04:04:33,037][52820] Sum rewards: 78.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.202', 'AMMO3': '0.215', 'weapon4': '0.296', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '63.500'} [2024-08-06 04:04:34,164][52659] DAMAGECOUNT value on done: 481196.0 [2024-08-06 04:04:34,166][52659] Sum rewards: 74.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.727', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.050', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.458', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:35,414][52794] DAMAGECOUNT value on done: 480138.0 [2024-08-06 04:04:35,415][52794] Sum rewards: 87.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.227', 'weapon5': '0.244', 'weapon2': '0.250', 'weapon4': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.732', 'FRAGCOUNT': '72.000'} [2024-08-06 04:04:35,516][52664] DAMAGECOUNT value on done: 500271.0 [2024-08-06 04:04:35,517][52664] Sum rewards: 63.635, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.508', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.188', 'AMMO4': '0.190', 'weapon5': '0.222', 'weapon2': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.574', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:35,543][52647] DAMAGECOUNT value on done: 500340.0 [2024-08-06 04:04:35,544][52647] Sum rewards: 76.862, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.762', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.040', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.000', 'weapon3': '3.344', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '60.000'} [2024-08-06 04:04:35,854][52650] Updated weights for policy 0, policy_version 50671 (0.0013) [2024-08-06 04:04:36,116][52820] DAMAGECOUNT value on done: 449032.0 [2024-08-06 04:04:36,118][52820] Sum rewards: 70.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.898', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.162', 'weapon2': '0.172', 'AMMO3': '0.222', 'AMMO4': '0.222', 'weapon4': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:36,331][52649] DAMAGECOUNT value on done: 462921.0 [2024-08-06 04:04:36,332][52649] Sum rewards: 59.751, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.034', 'AMMO2': '0.013', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon5': '0.166', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.202', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '47.500'} [2024-08-06 04:04:36,907][52659] DAMAGECOUNT value on done: 479574.0 [2024-08-06 04:04:36,909][52659] Sum rewards: 90.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.504', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon2': '0.152', 'weapon5': '0.166', 'AMMO4': '0.201', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.350', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.588', 'FRAGCOUNT': '73.500'} [2024-08-06 04:04:37,708][52671] Large shaping reward -2.525 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.276, -92.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:04:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 415129600. Throughput: 0: 4372.9. Samples: 103786170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:04:37,794][52567] Avg episode reward: [(0, '71.150')] [2024-08-06 04:04:38,367][52664] DAMAGECOUNT value on done: 496718.0 [2024-08-06 04:04:38,367][52664] Sum rewards: 72.141, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.694', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.380', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:38,398][52647] DAMAGECOUNT value on done: 509459.0 [2024-08-06 04:04:38,400][52647] Sum rewards: 69.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.179', 'weapon4': '0.180', 'weapon2': '0.232', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:38,411][52794] DAMAGECOUNT value on done: 475573.0 [2024-08-06 04:04:38,411][52794] Sum rewards: 62.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.270', 'weapon2': '0.646', 'WEAPON3': '1.600', 'weapon3': '3.110', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '54.000'} [2024-08-06 04:04:39,333][52820] DAMAGECOUNT value on done: 444048.0 [2024-08-06 04:04:39,334][52820] Sum rewards: 77.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.116', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.237', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:39,484][52649] DAMAGECOUNT value on done: 457112.0 [2024-08-06 04:04:39,484][52649] Sum rewards: 61.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.223', 'weapon5': '0.236', 'weapon4': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.760', 'WEAPON3': '1.350', 'weapon3': '2.464', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '52.000'} [2024-08-06 04:04:39,725][52659] DAMAGECOUNT value on done: 478166.0 [2024-08-06 04:04:39,727][52659] Sum rewards: 58.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.069', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.106', 'AMMO4': '0.159', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.150', 'HITCOUNT': '2.650', 'weapon3': '3.094', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '49.000'} [2024-08-06 04:04:40,247][52650] Updated weights for policy 0, policy_version 50681 (0.0052) [2024-08-06 04:04:40,918][52664] DAMAGECOUNT value on done: 495598.0 [2024-08-06 04:04:40,919][52664] Sum rewards: 71.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.315', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.080', 'AMMO4': '0.154', 'weapon4': '0.190', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:40,936][52647] DAMAGECOUNT value on done: 502264.0 [2024-08-06 04:04:40,937][52647] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.266', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.146', 'AMMO3': '0.228', 'weapon5': '0.228', 'AMMO4': '0.236', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:41,801][52794] DAMAGECOUNT value on done: 485652.0 [2024-08-06 04:04:41,801][52794] Sum rewards: 81.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.640', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.138', 'AMMO3': '0.223', 'AMMO4': '0.233', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '66.000'} [2024-08-06 04:04:42,408][52659] DAMAGECOUNT value on done: 484423.0 [2024-08-06 04:04:42,410][52659] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.495', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.104', 'AMMO3': '0.173', 'weapon2': '0.200', 'AMMO4': '0.223', 'weapon5': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '3.266', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '50.000'} [2024-08-06 04:04:42,645][52649] DAMAGECOUNT value on done: 472601.0 [2024-08-06 04:04:42,647][52649] Sum rewards: 91.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.098', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '76.000'} [2024-08-06 04:04:42,675][52820] DAMAGECOUNT value on done: 449871.0 [2024-08-06 04:04:42,678][52820] Sum rewards: 76.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.272', 'weapon2': '0.276', 'WEAPON3': '1.700', 'weapon3': '3.538', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '66.000'} [2024-08-06 04:04:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 415211520. Throughput: 0: 4377.1. Samples: 103812520. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:04:42,794][52567] Avg episode reward: [(0, '70.982')] [2024-08-06 04:04:43,902][52647] DAMAGECOUNT value on done: 506245.0 [2024-08-06 04:04:43,903][52647] Sum rewards: 75.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.682', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.090', 'weapon5': '0.098', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:43,914][52664] DAMAGECOUNT value on done: 491112.0 [2024-08-06 04:04:43,915][52664] Sum rewards: 71.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.128', 'AMMO3': '0.147', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.394', 'WEAPON4': '0.450', 'weapon2': '0.618', 'WEAPON3': '0.850', 'weapon3': '2.572', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:44,378][52794] DAMAGECOUNT value on done: 473041.0 [2024-08-06 04:04:44,379][52794] Sum rewards: 78.945, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.630', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.100', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '66.000'} [2024-08-06 04:04:45,143][52650] Updated weights for policy 0, policy_version 50691 (0.0015) [2024-08-06 04:04:45,153][52659] DAMAGECOUNT value on done: 490454.0 [2024-08-06 04:04:45,154][52659] Sum rewards: 70.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.279', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.059', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.289', 'weapon2': '0.538', 'WEAPON3': '1.800', 'weapon3': '3.018', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:45,795][52649] DAMAGECOUNT value on done: 464307.0 [2024-08-06 04:04:45,796][52649] Sum rewards: 71.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.330', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.154', 'AMMO3': '0.182', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:45,849][52820] DAMAGECOUNT value on done: 444114.0 [2024-08-06 04:04:45,850][52820] Sum rewards: 79.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.099', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.038', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '66.000'} [2024-08-06 04:04:46,368][52647] DAMAGECOUNT value on done: 497170.0 [2024-08-06 04:04:46,370][52647] Sum rewards: 78.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '65.000'} [2024-08-06 04:04:46,493][52664] DAMAGECOUNT value on done: 503137.0 [2024-08-06 04:04:46,493][52664] Sum rewards: 75.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.088', 'weapon5': '0.148', 'AMMO3': '0.163', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '62.500'} [2024-08-06 04:04:47,440][52794] DAMAGECOUNT value on done: 492349.0 [2024-08-06 04:04:47,450][52794] Sum rewards: 64.799, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.871', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.186', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.526', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 415301632. Throughput: 0: 4373.8. Samples: 103825490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:04:47,794][52567] Avg episode reward: [(0, '71.211')] [2024-08-06 04:04:47,949][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:04:48,164][52659] DAMAGECOUNT value on done: 478830.0 [2024-08-06 04:04:48,164][52659] Sum rewards: 65.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.428', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.192', 'weapon4': '0.220', 'AMMO3': '0.248', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '55.000'} [2024-08-06 04:04:48,597][52647] DAMAGECOUNT value on done: 507640.0 [2024-08-06 04:04:48,597][52647] Sum rewards: 73.811, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.082', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.141', 'weapon2': '0.386', 'WEAPON3': '1.000', 'weapon3': '3.238', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:48,761][52664] DAMAGECOUNT value on done: 494540.0 [2024-08-06 04:04:48,762][52664] Sum rewards: 68.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.171', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.216', 'AMMO4': '0.236', 'weapon2': '0.238', 'AMMO3': '0.251', 'weapon5': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '56.000'} [2024-08-06 04:04:48,826][52649] DAMAGECOUNT value on done: 457569.0 [2024-08-06 04:04:48,826][52649] Sum rewards: 71.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.100', 'AMMO4': '0.198', 'AMMO3': '0.201', 'weapon5': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:49,095][52820] DAMAGECOUNT value on done: 444110.0 [2024-08-06 04:04:49,096][52820] Sum rewards: 63.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.134', 'AMMO3': '0.197', 'weapon5': '0.234', 'AMMO4': '0.282', 'weapon2': '0.422', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '2.962', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '52.000'} [2024-08-06 04:04:49,520][52650] Updated weights for policy 0, policy_version 50701 (0.0029) [2024-08-06 04:04:50,862][52794] DAMAGECOUNT value on done: 473070.0 [2024-08-06 04:04:50,862][52794] Sum rewards: 79.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.918', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.173', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.390', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '65.000'} [2024-08-06 04:04:51,029][52659] DAMAGECOUNT value on done: 483919.0 [2024-08-06 04:04:51,030][52659] Sum rewards: 74.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.365', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.234', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '60.000'} [2024-08-06 04:04:51,264][52647] DAMAGECOUNT value on done: 502880.0 [2024-08-06 04:04:51,266][52647] Sum rewards: 72.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.010', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.024', 'AMMO4': '0.039', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.320', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:51,537][52664] DAMAGECOUNT value on done: 504601.0 [2024-08-06 04:04:51,539][52664] Sum rewards: 63.396, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.395', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.118', 'AMMO4': '0.181', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '56.000'} [2024-08-06 04:04:51,773][52649] DAMAGECOUNT value on done: 469856.0 [2024-08-06 04:04:51,777][52649] Sum rewards: 62.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.180', 'weapon2': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.258', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:52,087][52820] DAMAGECOUNT value on done: 455703.0 [2024-08-06 04:04:52,087][52820] Sum rewards: 73.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.212', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.155', 'weapon5': '0.180', 'weapon4': '0.196', 'AMMO4': '0.211', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 415391744. Throughput: 0: 4379.3. Samples: 103851870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:04:52,802][52567] Avg episode reward: [(0, '71.335')] [2024-08-06 04:04:53,806][52794] DAMAGECOUNT value on done: 490454.0 [2024-08-06 04:04:53,807][52794] Sum rewards: 65.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.136', 'weapon5': '0.136', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.716', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '54.000'} [2024-08-06 04:04:53,832][52659] DAMAGECOUNT value on done: 474397.0 [2024-08-06 04:04:53,832][52659] Sum rewards: 81.512, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.390', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.138', 'weapon5': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '3.060', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '63.000'} [2024-08-06 04:04:54,217][52647] DAMAGECOUNT value on done: 511323.0 [2024-08-06 04:04:54,217][52647] Sum rewards: 63.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.118', 'weapon4': '0.130', 'AMMO3': '0.157', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '0.900', 'HITCOUNT': '3.130', 'weapon3': '3.144', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '50.000'} [2024-08-06 04:04:54,521][52664] DAMAGECOUNT value on done: 500171.0 [2024-08-06 04:04:54,522][52664] Sum rewards: 76.494, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.154', 'AMMO3': '0.160', 'WEAPON3': '1.000', 'HITCOUNT': '3.490', 'weapon3': '3.694', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:54,732][52650] Updated weights for policy 0, policy_version 50711 (0.0015) [2024-08-06 04:04:55,169][52820] DAMAGECOUNT value on done: 454808.0 [2024-08-06 04:04:55,170][52820] Sum rewards: 67.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.463', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.072', 'AMMO4': '0.135', 'weapon5': '0.180', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:55,392][52649] DAMAGECOUNT value on done: 465326.0 [2024-08-06 04:04:55,392][52649] Sum rewards: 64.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'AMMO4': '0.209', 'weapon2': '0.228', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '52.000'} [2024-08-06 04:04:55,960][52794] Large shaping reward 3.411 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.36, 120.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:04:56,357][52659] DAMAGECOUNT value on done: 480922.0 [2024-08-06 04:04:56,360][52659] Sum rewards: 62.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'AMMO5': '0.018', 'AMMO2': '0.074', 'AMMO3': '0.147', 'weapon5': '0.216', 'AMMO4': '0.371', 'WEAPON5': '0.500', 'weapon4': '0.542', 'weapon2': '0.572', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.388', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '50.000'} [2024-08-06 04:04:56,578][52794] DAMAGECOUNT value on done: 480816.0 [2024-08-06 04:04:56,579][52794] Sum rewards: 67.193, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.546', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.140', 'weapon5': '0.140', 'weapon2': '0.182', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.222', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:56,674][52666] DAMAGECOUNT value on done: 476691.0 [2024-08-06 04:04:56,674][52666] Sum rewards: 75.843, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.591', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.208', 'weapon5': '0.210', 'weapon2': '0.246', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:57,175][52647] DAMAGECOUNT value on done: 503865.0 [2024-08-06 04:04:57,175][52647] Sum rewards: 67.454, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.056', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.158', 'weapon2': '0.164', 'weapon5': '0.240', 'AMMO4': '0.288', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '53.000'} [2024-08-06 04:04:57,363][52664] DAMAGECOUNT value on done: 507983.0 [2024-08-06 04:04:57,363][52664] Sum rewards: 78.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.806', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '64.000'} [2024-08-06 04:04:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 415473664. Throughput: 0: 4377.6. Samples: 103878080. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:04:57,802][52567] Avg episode reward: [(0, '71.296')] [2024-08-06 04:04:58,247][52663] DAMAGECOUNT value on done: 487065.0 [2024-08-06 04:04:58,249][52663] Sum rewards: 74.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.216', 'weapon4': '0.226', 'weapon5': '0.238', 'AMMO4': '0.296', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '62.000'} [2024-08-06 04:04:58,339][52820] DAMAGECOUNT value on done: 441145.0 [2024-08-06 04:04:58,340][52820] Sum rewards: 70.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.983', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '58.000'} [2024-08-06 04:04:58,600][52649] DAMAGECOUNT value on done: 469836.0 [2024-08-06 04:04:58,600][52649] Sum rewards: 66.675, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.749', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.772', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '52.000'} [2024-08-06 04:04:59,078][52650] Updated weights for policy 0, policy_version 50721 (0.0019) [2024-08-06 04:04:59,120][52659] DAMAGECOUNT value on done: 491825.0 [2024-08-06 04:04:59,121][52659] Sum rewards: 76.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.038', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.274', 'weapon4': '0.342', 'WEAPON3': '0.900', 'weapon3': '3.088', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '61.000'} [2024-08-06 04:04:59,474][52794] DAMAGECOUNT value on done: 484823.0 [2024-08-06 04:04:59,475][52794] Sum rewards: 69.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.259', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.152', 'AMMO4': '0.170', 'weapon5': '0.172', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.884', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 04:04:59,692][52666] DAMAGECOUNT value on done: 481087.0 [2024-08-06 04:04:59,692][52666] Sum rewards: 67.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.582', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.194', 'AMMO3': '0.241', 'AMMO4': '0.292', 'weapon4': '0.376', 'WEAPON5': '0.500', 'weapon2': '0.516', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.606', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '57.000'} [2024-08-06 04:04:59,835][52647] DAMAGECOUNT value on done: 495401.0 [2024-08-06 04:04:59,836][52647] Sum rewards: 71.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.885', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.118', 'weapon2': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon4': '0.314', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.216', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:00,065][52664] DAMAGECOUNT value on done: 503324.0 [2024-08-06 04:05:00,066][52664] Sum rewards: 74.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon2': '0.210', 'AMMO4': '0.219', 'weapon5': '0.220', 'AMMO3': '0.224', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.582', 'WEAPON3': '1.400', 'weapon3': '2.688', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:00,277][52670] DAMAGECOUNT value on done: 469558.0 [2024-08-06 04:05:00,288][52670] Sum rewards: 74.255, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO4': '0.192', 'weapon4': '0.222', 'AMMO3': '0.265', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '63.000'} [2024-08-06 04:05:01,153][52663] DAMAGECOUNT value on done: 481621.0 [2024-08-06 04:05:01,155][52663] Sum rewards: 75.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.834', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.094', 'AMMO4': '0.096', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:01,796][52649] DAMAGECOUNT value on done: 470989.0 [2024-08-06 04:05:01,796][52649] Sum rewards: 73.431, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.152', 'weapon4': '0.180', 'AMMO4': '0.210', 'AMMO3': '0.218', 'weapon2': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:01,817][52659] DAMAGECOUNT value on done: 487086.0 [2024-08-06 04:05:01,817][52659] Sum rewards: 76.996, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.301', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.230', 'weapon2': '0.264', 'AMMO3': '0.271', 'AMMO4': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.762', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '67.000'} [2024-08-06 04:05:02,106][52647] DAMAGECOUNT value on done: 501674.0 [2024-08-06 04:05:02,107][52647] Sum rewards: 66.570, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.150', 'AMMO3': '0.168', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.068', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:02,331][52664] DAMAGECOUNT value on done: 503278.0 [2024-08-06 04:05:02,331][52664] Sum rewards: 67.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.238', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.102', 'weapon4': '0.144', 'weapon2': '0.232', 'AMMO3': '0.237', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.270', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:02,535][52794] DAMAGECOUNT value on done: 486759.0 [2024-08-06 04:05:02,538][52794] Sum rewards: 73.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.138', 'AMMO4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:02,609][52666] DAMAGECOUNT value on done: 484214.0 [2024-08-06 04:05:02,611][52666] Sum rewards: 68.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.865', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.026', 'AMMO4': '0.046', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.222', 'weapon4': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 415563776. Throughput: 0: 4376.9. Samples: 103891100. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:05:02,794][52567] Avg episode reward: [(0, '71.828')] [2024-08-06 04:05:02,939][52670] DAMAGECOUNT value on done: 483431.0 [2024-08-06 04:05:02,941][52670] Sum rewards: 76.766, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.484', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.186', 'weapon4': '0.202', 'AMMO3': '0.220', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '64.500'} [2024-08-06 04:05:03,823][52650] Updated weights for policy 0, policy_version 50731 (0.0011) [2024-08-06 04:05:04,132][52663] DAMAGECOUNT value on done: 475134.0 [2024-08-06 04:05:04,133][52663] Sum rewards: 65.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.093', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.428', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:04,723][52659] DAMAGECOUNT value on done: 484043.0 [2024-08-06 04:05:04,723][52659] Sum rewards: 55.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.311', 'AMMO5': '0.020', 'AMMO2': '0.035', 'weapon5': '0.176', 'AMMO4': '0.178', 'weapon4': '0.204', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '2.860', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '48.500'} [2024-08-06 04:05:04,836][52647] DAMAGECOUNT value on done: 499456.0 [2024-08-06 04:05:04,837][52647] Sum rewards: 71.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.074', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '59.000'} [2024-08-06 04:05:05,016][52649] DAMAGECOUNT value on done: 464767.0 [2024-08-06 04:05:05,019][52649] Sum rewards: 61.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.586', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.244', 'AMMO3': '0.248', 'weapon2': '0.264', 'AMMO4': '0.272', 'WEAPON5': '0.450', 'weapon4': '0.548', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.628', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:05,065][52664] DAMAGECOUNT value on done: 496044.0 [2024-08-06 04:05:05,066][52664] Sum rewards: 74.937, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.096', 'AMMO4': '0.144', 'weapon5': '0.184', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '60.000'} [2024-08-06 04:05:05,382][52794] DAMAGECOUNT value on done: 478332.0 [2024-08-06 04:05:05,383][52794] Sum rewards: 63.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.325', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon4': '0.202', 'AMMO3': '0.237', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.206', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '54.000'} [2024-08-06 04:05:05,514][52666] DAMAGECOUNT value on done: 481321.0 [2024-08-06 04:05:05,514][52666] Sum rewards: 67.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.175', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.112', 'weapon5': '0.180', 'AMMO4': '0.183', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 04:05:05,932][52670] DAMAGECOUNT value on done: 475081.0 [2024-08-06 04:05:05,932][52670] Sum rewards: 69.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.485', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO4': '0.157', 'AMMO3': '0.214', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '60.000'} [2024-08-06 04:05:06,680][52663] DAMAGECOUNT value on done: 478299.0 [2024-08-06 04:05:06,682][52663] Sum rewards: 62.260, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.180', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.141', 'AMMO3': '0.221', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '3.324', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '54.000'} [2024-08-06 04:05:07,499][52647] DAMAGECOUNT value on done: 500498.0 [2024-08-06 04:05:07,500][52647] Sum rewards: 72.008, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.118', 'AMMO4': '0.151', 'weapon5': '0.166', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:07,587][52659] DAMAGECOUNT value on done: 480385.0 [2024-08-06 04:05:07,589][52659] Sum rewards: 82.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.982', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.134', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '69.000'} [2024-08-06 04:05:07,743][52664] DAMAGECOUNT value on done: 495641.0 [2024-08-06 04:05:07,743][52664] Sum rewards: 77.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.103', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '64.000'} [2024-08-06 04:05:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 415653888. Throughput: 0: 4376.2. Samples: 103917370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:05:07,794][52567] Avg episode reward: [(0, '71.522')] [2024-08-06 04:05:08,180][52649] DAMAGECOUNT value on done: 472985.0 [2024-08-06 04:05:08,180][52649] Sum rewards: 68.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.436', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:08,405][52666] DAMAGECOUNT value on done: 480213.0 [2024-08-06 04:05:08,408][52666] Sum rewards: 54.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.632', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.154', 'weapon4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.650', 'weapon3': '2.940', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.971', 'FRAGCOUNT': '50.000'} [2024-08-06 04:05:08,597][52650] Updated weights for policy 0, policy_version 50741 (0.0013) [2024-08-06 04:05:08,854][52670] DAMAGECOUNT value on done: 473758.0 [2024-08-06 04:05:08,856][52670] Sum rewards: 75.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.178', 'AMMO4': '0.183', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '63.000'} [2024-08-06 04:05:09,686][52663] DAMAGECOUNT value on done: 480123.0 [2024-08-06 04:05:09,687][52663] Sum rewards: 77.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.806', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.080', 'AMMO4': '0.102', 'weapon4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '63.000'} [2024-08-06 04:05:10,404][52659] DAMAGECOUNT value on done: 481559.0 [2024-08-06 04:05:10,406][52659] Sum rewards: 70.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.905', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.115', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.338', 'ARMOR': '0.454', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '59.000'} [2024-08-06 04:05:10,481][52664] DAMAGECOUNT value on done: 499799.0 [2024-08-06 04:05:10,483][52664] Sum rewards: 74.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.020', 'AMMO4': '0.083', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:10,952][52666] DAMAGECOUNT value on done: 474469.0 [2024-08-06 04:05:10,953][52666] Sum rewards: 71.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.948', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.129', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.342', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '59.000'} [2024-08-06 04:05:11,293][52649] DAMAGECOUNT value on done: 477059.0 [2024-08-06 04:05:11,295][52649] Sum rewards: 76.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.926', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.201', 'AMMO4': '0.239', 'weapon2': '0.242', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:11,320][52670] DAMAGECOUNT value on done: 484606.0 [2024-08-06 04:05:11,322][52670] Sum rewards: 85.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.096', 'weapon5': '0.096', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.346', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '22.341', 'FRAGCOUNT': '70.000'} [2024-08-06 04:05:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 415744000. Throughput: 0: 4375.1. Samples: 103943650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:05:12,794][52567] Avg episode reward: [(0, '71.706')] [2024-08-06 04:05:12,799][52663] DAMAGECOUNT value on done: 483421.0 [2024-08-06 04:05:12,801][52663] Sum rewards: 73.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.064', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:13,134][52664] DAMAGECOUNT value on done: 496951.0 [2024-08-06 04:05:13,134][52664] Sum rewards: 63.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.385', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.098', 'AMMO3': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.826', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '50.000'} [2024-08-06 04:05:13,172][52650] Updated weights for policy 0, policy_version 50751 (0.0014) [2024-08-06 04:05:13,301][52659] DAMAGECOUNT value on done: 483578.0 [2024-08-06 04:05:13,303][52659] Sum rewards: 63.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.268', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.192', 'weapon4': '0.210', 'AMMO4': '0.224', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '54.000'} [2024-08-06 04:05:13,939][52666] DAMAGECOUNT value on done: 477578.0 [2024-08-06 04:05:13,942][52666] Sum rewards: 52.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.834', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.094', 'weapon4': '0.126', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.220', 'DAMAGECOUNT': '13.323', 'FRAGCOUNT': '45.000'} [2024-08-06 04:05:14,497][52670] DAMAGECOUNT value on done: 479277.0 [2024-08-06 04:05:14,500][52670] Sum rewards: 84.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.600', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.138', 'weapon5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '69.000'} [2024-08-06 04:05:14,576][52649] DAMAGECOUNT value on done: 478904.0 [2024-08-06 04:05:14,576][52649] Sum rewards: 81.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.143', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.177', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '66.000'} [2024-08-06 04:05:15,493][52663] DAMAGECOUNT value on done: 480871.0 [2024-08-06 04:05:15,493][52663] Sum rewards: 69.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.844', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.102', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.342', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:15,676][52664] DAMAGECOUNT value on done: 495403.0 [2024-08-06 04:05:15,676][52664] Sum rewards: 62.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.862', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.114', 'weapon4': '0.152', 'AMMO3': '0.238', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:17,046][52666] DAMAGECOUNT value on done: 478589.0 [2024-08-06 04:05:17,047][52666] Sum rewards: 67.483, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.319', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.084', 'AMMO4': '0.220', 'weapon4': '0.230', 'AMMO3': '0.259', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.124', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '57.500'} [2024-08-06 04:05:17,411][52670] DAMAGECOUNT value on done: 469795.0 [2024-08-06 04:05:17,411][52670] Sum rewards: 80.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.206', 'AMMO3': '0.223', 'AMMO4': '0.223', 'weapon2': '0.378', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '65.000'} [2024-08-06 04:05:17,719][52649] DAMAGECOUNT value on done: 473363.0 [2024-08-06 04:05:17,719][52649] Sum rewards: 61.462, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.790', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO4': '0.181', 'weapon4': '0.216', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.976', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '55.500'} [2024-08-06 04:05:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 415825920. Throughput: 0: 4374.9. Samples: 103956640. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:05:17,794][52567] Avg episode reward: [(0, '71.341')] [2024-08-06 04:05:17,983][52650] Updated weights for policy 0, policy_version 50761 (0.0016) [2024-08-06 04:05:18,486][52663] DAMAGECOUNT value on done: 475191.0 [2024-08-06 04:05:18,488][52663] Sum rewards: 79.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.450', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.176', 'weapon4': '0.198', 'weapon5': '0.208', 'AMMO4': '0.216', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '63.000'} [2024-08-06 04:05:19,439][52666] DAMAGECOUNT value on done: 476988.0 [2024-08-06 04:05:19,440][52666] Sum rewards: 71.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.134', 'weapon5': '0.208', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '59.000'} [2024-08-06 04:05:20,061][52670] DAMAGECOUNT value on done: 477168.0 [2024-08-06 04:05:20,076][52670] Sum rewards: 78.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.389', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.112', 'weapon2': '0.164', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.750', 'weapon3': '3.236', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '67.000'} [2024-08-06 04:05:20,309][52649] DAMAGECOUNT value on done: 462786.0 [2024-08-06 04:05:20,309][52649] Sum rewards: 70.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.140', 'AMMO3': '0.205', 'weapon4': '0.222', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:21,361][52663] DAMAGECOUNT value on done: 474334.0 [2024-08-06 04:05:21,362][52663] Sum rewards: 72.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.218', 'weapon2': '0.258', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:22,425][52650] Updated weights for policy 0, policy_version 50771 (0.0034) [2024-08-06 04:05:22,570][52666] DAMAGECOUNT value on done: 470994.0 [2024-08-06 04:05:22,571][52666] Sum rewards: 71.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.054', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '57.000'} [2024-08-06 04:05:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 415916032. Throughput: 0: 4373.5. Samples: 103982980. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:05:22,802][52567] Avg episode reward: [(0, '71.271')] [2024-08-06 04:05:23,231][52670] DAMAGECOUNT value on done: 476238.0 [2024-08-06 04:05:23,231][52670] Sum rewards: 75.952, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.116', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.262', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.310', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '64.000'} [2024-08-06 04:05:23,464][52649] DAMAGECOUNT value on done: 473136.0 [2024-08-06 04:05:23,466][52649] Sum rewards: 73.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.086', 'weapon5': '0.176', 'AMMO3': '0.240', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:23,971][52663] DAMAGECOUNT value on done: 482313.0 [2024-08-06 04:05:23,973][52663] Sum rewards: 65.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.080', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.368', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '55.000'} [2024-08-06 04:05:25,736][52666] DAMAGECOUNT value on done: 475289.0 [2024-08-06 04:05:25,737][52666] Sum rewards: 67.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.014', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.432', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '57.000'} [2024-08-06 04:05:26,393][52670] DAMAGECOUNT value on done: 472116.0 [2024-08-06 04:05:26,393][52670] Sum rewards: 74.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.717', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.284', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:26,581][52649] DAMAGECOUNT value on done: 460679.0 [2024-08-06 04:05:26,582][52649] Sum rewards: 65.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.682', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.090', 'AMMO4': '0.202', 'weapon4': '0.204', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '57.000'} [2024-08-06 04:05:26,969][52663] DAMAGECOUNT value on done: 488410.0 [2024-08-06 04:05:26,970][52663] Sum rewards: 70.767, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.310', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.114', 'AMMO4': '0.225', 'AMMO3': '0.253', 'weapon5': '0.260', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:27,362][52650] Updated weights for policy 0, policy_version 50781 (0.0039) [2024-08-06 04:05:27,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 416014336. Throughput: 0: 4369.1. Samples: 104009130. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:05:27,794][52567] Avg episode reward: [(0, '71.259')] [2024-08-06 04:05:27,891][52811] DAMAGECOUNT value on done: 460724.0 [2024-08-06 04:05:27,892][52811] Sum rewards: 66.859, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.545', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.174', 'AMMO3': '0.184', 'AMMO4': '0.221', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.750', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '55.000'} [2024-08-06 04:05:28,294][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:05:29,044][52666] DAMAGECOUNT value on done: 472835.0 [2024-08-06 04:05:29,045][52666] Sum rewards: 70.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.080', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.256', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:29,564][52663] DAMAGECOUNT value on done: 477517.0 [2024-08-06 04:05:29,564][52663] Sum rewards: 64.544, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.906', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.102', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.438', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '56.000'} [2024-08-06 04:05:29,675][52670] DAMAGECOUNT value on done: 478333.0 [2024-08-06 04:05:29,676][52670] Sum rewards: 65.983, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.624', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.130', 'AMMO4': '0.231', 'weapon2': '0.256', 'AMMO3': '0.313', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.994', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 04:05:29,723][52667] DAMAGECOUNT value on done: 479061.0 [2024-08-06 04:05:29,723][52667] Sum rewards: 80.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.174', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.216', 'weapon2': '0.262', 'WEAPON3': '1.250', 'weapon3': '3.554', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '67.000'} [2024-08-06 04:05:29,811][52649] DAMAGECOUNT value on done: 473815.0 [2024-08-06 04:05:29,814][52649] Sum rewards: 63.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.067', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '55.000'} [2024-08-06 04:05:30,464][52795] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:05:30,824][52811] DAMAGECOUNT value on done: 442789.0 [2024-08-06 04:05:30,824][52811] Sum rewards: 72.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:31,861][52666] DAMAGECOUNT value on done: 487286.0 [2024-08-06 04:05:31,863][52666] Sum rewards: 88.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.113', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.232', 'WEAPON3': '1.500', 'weapon3': '3.278', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '74.000'} [2024-08-06 04:05:32,116][52650] Updated weights for policy 0, policy_version 50791 (0.0012) [2024-08-06 04:05:32,345][52670] DAMAGECOUNT value on done: 469459.0 [2024-08-06 04:05:32,346][52670] Sum rewards: 73.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.745', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.108', 'weapon4': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.260', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.308', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '63.000'} [2024-08-06 04:05:32,497][52667] DAMAGECOUNT value on done: 489952.0 [2024-08-06 04:05:32,498][52667] Sum rewards: 74.061, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.792', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.080', 'AMMO4': '0.200', 'weapon5': '0.258', 'weapon2': '0.266', 'AMMO3': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '63.000'} [2024-08-06 04:05:32,767][52649] DAMAGECOUNT value on done: 476122.0 [2024-08-06 04:05:32,769][52649] Sum rewards: 70.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.040', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:32,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 416088064. Throughput: 0: 4372.0. Samples: 104022230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:05:32,802][52567] Avg episode reward: [(0, '71.053')] [2024-08-06 04:05:32,839][52663] DAMAGECOUNT value on done: 474462.0 [2024-08-06 04:05:32,839][52663] Sum rewards: 74.137, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.170', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.090', 'weapon5': '0.096', 'AMMO4': '0.237', 'AMMO3': '0.251', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '66.000'} [2024-08-06 04:05:33,917][52811] DAMAGECOUNT value on done: 442421.0 [2024-08-06 04:05:33,917][52811] Sum rewards: 64.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.126', 'weapon4': '0.186', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '52.000'} [2024-08-06 04:05:34,829][52666] DAMAGECOUNT value on done: 480388.0 [2024-08-06 04:05:34,829][52666] Sum rewards: 63.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.567', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:35,407][52670] DAMAGECOUNT value on done: 474923.0 [2024-08-06 04:05:35,409][52670] Sum rewards: 80.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.189', 'AMMO2': '0.004', 'AMMO4': '0.021', 'AMMO3': '0.177', 'weapon2': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '3.500', 'weapon3': '3.508', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '67.000'} [2024-08-06 04:05:35,491][52667] DAMAGECOUNT value on done: 478460.0 [2024-08-06 04:05:35,494][52667] Sum rewards: 60.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.708', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.076', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.294', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:35,637][52663] DAMAGECOUNT value on done: 473216.0 [2024-08-06 04:05:35,640][52663] Sum rewards: 61.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.320', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon5': '0.178', 'AMMO4': '0.245', 'AMMO3': '0.274', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.870', 'weapon3': '3.088', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:35,961][52649] DAMAGECOUNT value on done: 467968.0 [2024-08-06 04:05:35,961][52649] Sum rewards: 79.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.404', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 04:05:36,403][52650] Updated weights for policy 0, policy_version 50801 (0.0014) [2024-08-06 04:05:37,092][52811] DAMAGECOUNT value on done: 446314.0 [2024-08-06 04:05:37,095][52811] Sum rewards: 67.749, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.960', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.186', 'AMMO4': '0.196', 'weapon5': '0.206', 'weapon2': '0.252', 'AMMO3': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.038', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '61.500'} [2024-08-06 04:05:37,651][52666] DAMAGECOUNT value on done: 476029.0 [2024-08-06 04:05:37,652][52666] Sum rewards: 70.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.185', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.178', 'weapon4': '0.188', 'AMMO4': '0.207', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '57.000'} [2024-08-06 04:05:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 416178176. Throughput: 0: 4367.6. Samples: 104048410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:05:37,794][52567] Avg episode reward: [(0, '70.799')] [2024-08-06 04:05:38,296][52670] DAMAGECOUNT value on done: 483392.0 [2024-08-06 04:05:38,296][52670] Sum rewards: 76.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.086', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '65.000'} [2024-08-06 04:05:38,422][52667] DAMAGECOUNT value on done: 480689.0 [2024-08-06 04:05:38,424][52667] Sum rewards: 73.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.082', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:38,693][52663] DAMAGECOUNT value on done: 474719.0 [2024-08-06 04:05:38,695][52663] Sum rewards: 64.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.398', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '55.000'} [2024-08-06 04:05:39,652][52803] DAMAGECOUNT value on done: 448820.0 [2024-08-06 04:05:39,653][52803] Sum rewards: 85.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.955', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.182', 'weapon5': '0.194', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '68.000'} [2024-08-06 04:05:40,164][52811] DAMAGECOUNT value on done: 449601.0 [2024-08-06 04:05:40,167][52811] Sum rewards: 77.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.515', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.105', 'weapon5': '0.128', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '66.000'} [2024-08-06 04:05:40,611][52666] DAMAGECOUNT value on done: 477139.0 [2024-08-06 04:05:40,612][52666] Sum rewards: 78.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.731', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon4': '0.076', 'WEAPON4': '0.100', 'weapon2': '0.148', 'AMMO3': '0.276', 'WEAPON3': '1.650', 'HITCOUNT': '3.510', 'weapon3': '3.548', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '68.000'} [2024-08-06 04:05:41,202][52670] DAMAGECOUNT value on done: 477499.0 [2024-08-06 04:05:41,203][52670] Sum rewards: 81.429, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.012', 'AMMO4': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.266', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.422', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '69.000'} [2024-08-06 04:05:41,301][52650] Updated weights for policy 0, policy_version 50811 (0.0020) [2024-08-06 04:05:41,639][52667] DAMAGECOUNT value on done: 489063.0 [2024-08-06 04:05:41,641][52667] Sum rewards: 73.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.615', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.166', 'weapon5': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.650', 'weapon3': '3.068', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:41,849][52663] DAMAGECOUNT value on done: 485142.0 [2024-08-06 04:05:41,849][52663] Sum rewards: 66.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.316', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.212', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '54.000'} [2024-08-06 04:05:42,729][52803] DAMAGECOUNT value on done: 446260.0 [2024-08-06 04:05:42,730][52803] Sum rewards: 87.148, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.024', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon4': '0.336', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '70.000'} [2024-08-06 04:05:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 416268288. Throughput: 0: 4371.3. Samples: 104074790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:05:42,802][52567] Avg episode reward: [(0, '71.433')] [2024-08-06 04:05:43,221][52811] DAMAGECOUNT value on done: 455462.0 [2024-08-06 04:05:43,221][52811] Sum rewards: 82.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon2': '0.184', 'weapon5': '0.186', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '68.000'} [2024-08-06 04:05:43,308][52666] DAMAGECOUNT value on done: 478489.0 [2024-08-06 04:05:43,309][52666] Sum rewards: 81.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.222', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.542', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '68.000'} [2024-08-06 04:05:44,074][52667] DAMAGECOUNT value on done: 490226.0 [2024-08-06 04:05:44,074][52667] Sum rewards: 83.394, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.728', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.153', 'weapon4': '0.220', 'weapon2': '0.284', 'WEAPON3': '1.000', 'weapon3': '3.276', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '65.500'} [2024-08-06 04:05:44,145][52670] DAMAGECOUNT value on done: 463156.0 [2024-08-06 04:05:44,147][52670] Sum rewards: 59.667, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.065', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.130', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.130', 'weapon3': '3.310', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:44,248][52663] DAMAGECOUNT value on done: 475859.0 [2024-08-06 04:05:44,249][52663] Sum rewards: 80.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.668', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.366', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '67.000'} [2024-08-06 04:05:45,772][52650] Updated weights for policy 0, policy_version 50821 (0.0028) [2024-08-06 04:05:45,911][52803] DAMAGECOUNT value on done: 453958.0 [2024-08-06 04:05:45,913][52803] Sum rewards: 76.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.096', 'AMMO4': '0.176', 'weapon5': '0.182', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:46,427][52811] DAMAGECOUNT value on done: 450479.0 [2024-08-06 04:05:46,429][52811] Sum rewards: 78.563, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.461', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.080', 'weapon5': '0.084', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.508', 'WEAPON3': '1.000', 'weapon3': '3.218', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '62.000'} [2024-08-06 04:05:46,481][52666] DAMAGECOUNT value on done: 481943.0 [2024-08-06 04:05:46,483][52666] Sum rewards: 68.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.116', 'weapon4': '0.140', 'AMMO4': '0.199', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '56.000'} [2024-08-06 04:05:46,933][52667] DAMAGECOUNT value on done: 482533.0 [2024-08-06 04:05:46,934][52667] Sum rewards: 68.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.329', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.102', 'AMMO4': '0.109', 'weapon5': '0.118', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.706', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:46,991][52663] DAMAGECOUNT value on done: 485563.0 [2024-08-06 04:05:46,993][52663] Sum rewards: 74.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.886', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.130', 'weapon5': '0.174', 'AMMO3': '0.219', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '61.000'} [2024-08-06 04:05:47,164][52670] DAMAGECOUNT value on done: 474172.0 [2024-08-06 04:05:47,165][52670] Sum rewards: 83.883, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.169', 'weapon4': '0.180', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '68.000'} [2024-08-06 04:05:47,691][52660] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon5', 0.002)] [2024-08-06 04:05:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 416350208. Throughput: 0: 4380.4. Samples: 104088220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:05:47,802][52567] Avg episode reward: [(0, '72.086')] [2024-08-06 04:05:48,932][52803] DAMAGECOUNT value on done: 455811.0 [2024-08-06 04:05:48,932][52803] Sum rewards: 64.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.080', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.230', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '54.000'} [2024-08-06 04:05:49,005][52658] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:05:49,486][52666] DAMAGECOUNT value on done: 466184.0 [2024-08-06 04:05:49,486][52666] Sum rewards: 61.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.233', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.064', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.320', 'WEAPON3': '1.550', 'HITCOUNT': '3.130', 'weapon3': '3.336', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '55.000'} [2024-08-06 04:05:49,562][52811] DAMAGECOUNT value on done: 449472.0 [2024-08-06 04:05:49,563][52811] Sum rewards: 62.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.581', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'weapon2': '0.184', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.390', 'weapon3': '3.454', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '53.000'} [2024-08-06 04:05:49,701][52663] DAMAGECOUNT value on done: 480428.0 [2024-08-06 04:05:49,703][52663] Sum rewards: 68.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.843', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.090', 'weapon5': '0.120', 'AMMO4': '0.202', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.222', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '56.000'} [2024-08-06 04:05:49,736][52667] DAMAGECOUNT value on done: 481957.0 [2024-08-06 04:05:49,740][52667] Sum rewards: 67.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.209', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.120', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:50,251][52670] DAMAGECOUNT value on done: 483530.0 [2024-08-06 04:05:50,253][52670] Sum rewards: 63.673, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.438', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.153', 'AMMO4': '0.167', 'weapon5': '0.214', 'weapon4': '0.236', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '2.974', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '50.000'} [2024-08-06 04:05:50,463][52650] Updated weights for policy 0, policy_version 50831 (0.0022) [2024-08-06 04:05:51,893][52803] DAMAGECOUNT value on done: 453718.0 [2024-08-06 04:05:51,895][52803] Sum rewards: 89.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.084', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.642', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '4.270', 'DAMAGECOUNT': '21.534', 'FRAGCOUNT': '73.000'} [2024-08-06 04:05:52,223][52667] DAMAGECOUNT value on done: 487210.0 [2024-08-06 04:05:52,225][52667] Sum rewards: 82.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.038', 'weapon4': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.204', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '68.000'} [2024-08-06 04:05:52,296][52666] DAMAGECOUNT value on done: 474661.0 [2024-08-06 04:05:52,297][52666] Sum rewards: 72.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.275', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.180', 'AMMO4': '0.212', 'weapon5': '0.274', 'weapon4': '0.300', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.764', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 04:05:52,337][52663] DAMAGECOUNT value on done: 475454.0 [2024-08-06 04:05:52,337][52663] Sum rewards: 71.100, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.850', 'AMMO5': '0.023', 'AMMO2': '0.074', 'weapon2': '0.274', 'weapon4': '0.286', 'AMMO3': '0.290', 'weapon5': '0.324', 'AMMO4': '0.368', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.712', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 04:05:52,684][52811] DAMAGECOUNT value on done: 454968.0 [2024-08-06 04:05:52,686][52811] Sum rewards: 62.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.302', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.135', 'weapon4': '0.172', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '51.000'} [2024-08-06 04:05:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 416440320. Throughput: 0: 4385.3. Samples: 104114710. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:05:52,802][52567] Avg episode reward: [(0, '71.810')] [2024-08-06 04:05:53,046][52670] DAMAGECOUNT value on done: 475413.0 [2024-08-06 04:05:53,046][52670] Sum rewards: 62.792, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.655', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.222', 'weapon5': '0.238', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.062', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '51.000'} [2024-08-06 04:05:53,697][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:05:54,616][52667] DAMAGECOUNT value on done: 490419.0 [2024-08-06 04:05:54,616][52667] Sum rewards: 88.278, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.490', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.068', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon2': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.350', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.844', 'FRAGCOUNT': '76.000'} [2024-08-06 04:05:54,978][52803] DAMAGECOUNT value on done: 441666.0 [2024-08-06 04:05:54,978][52803] Sum rewards: 63.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.964', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.118', 'AMMO4': '0.130', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.276', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '54.000'} [2024-08-06 04:05:55,132][52669] DAMAGECOUNT value on done: 484976.0 [2024-08-06 04:05:55,133][52669] Sum rewards: 78.999, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.115', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '65.000'} [2024-08-06 04:05:55,431][52650] Updated weights for policy 0, policy_version 50841 (0.0023) [2024-08-06 04:05:55,793][52811] DAMAGECOUNT value on done: 451094.0 [2024-08-06 04:05:55,794][52811] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.060', 'AMMO4': '0.187', 'weapon5': '0.190', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '65.000'} [2024-08-06 04:05:55,832][52614] Signal inference workers to stop experience collection... (9250 times) [2024-08-06 04:05:55,846][52614] Signal inference workers to resume experience collection... (9250 times) [2024-08-06 04:05:55,931][52670] DAMAGECOUNT value on done: 479224.0 [2024-08-06 04:05:55,934][52670] Sum rewards: 71.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.019', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.066', 'AMMO4': '0.111', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.810', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '57.000'} [2024-08-06 04:05:55,932][52650] InferenceWorker_p0-w0: stopping experience collection (9250 times) [2024-08-06 04:05:55,942][52650] InferenceWorker_p0-w0: resuming experience collection (9250 times) [2024-08-06 04:05:57,495][52667] DAMAGECOUNT value on done: 479518.0 [2024-08-06 04:05:57,495][52667] Sum rewards: 74.248, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.790', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.152', 'AMMO3': '0.164', 'AMMO4': '0.183', 'weapon5': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 04:05:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 416522240. Throughput: 0: 4384.7. Samples: 104140960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:05:57,802][52567] Avg episode reward: [(0, '72.267')] [2024-08-06 04:05:57,952][52803] DAMAGECOUNT value on done: 444718.0 [2024-08-06 04:05:57,953][52803] Sum rewards: 81.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO3': '0.158', 'AMMO4': '0.170', 'weapon2': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.420', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 04:05:58,381][52669] DAMAGECOUNT value on done: 476269.0 [2024-08-06 04:05:58,383][52669] Sum rewards: 78.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.852', 'AMMO5': '0.004', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO4': '0.036', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '64.000'} [2024-08-06 04:05:58,947][52811] DAMAGECOUNT value on done: 449428.0 [2024-08-06 04:05:58,949][52811] Sum rewards: 77.218, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.281', 'AMMO5': '0.026', 'AMMO2': '0.068', 'weapon4': '0.152', 'weapon5': '0.258', 'AMMO3': '0.259', 'weapon2': '0.286', 'AMMO4': '0.339', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.838', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '68.000'} [2024-08-06 04:06:00,192][52667] DAMAGECOUNT value on done: 479888.0 [2024-08-06 04:06:00,194][52667] Sum rewards: 59.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.130', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.326', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '3.000', 'weapon3': '3.052', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '48.000'} [2024-08-06 04:06:00,325][52650] Updated weights for policy 0, policy_version 50851 (0.0013) [2024-08-06 04:06:00,939][52669] DAMAGECOUNT value on done: 486478.0 [2024-08-06 04:06:00,940][52669] Sum rewards: 82.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.093', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '69.000'} [2024-08-06 04:06:01,119][52803] DAMAGECOUNT value on done: 443338.0 [2024-08-06 04:06:01,122][52803] Sum rewards: 60.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.076', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.202', 'AMMO3': '0.244', 'weapon4': '0.298', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '51.500'} [2024-08-06 04:06:02,040][52811] DAMAGECOUNT value on done: 461077.0 [2024-08-06 04:06:02,040][52811] Sum rewards: 76.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.340', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.036', 'weapon4': '0.066', 'AMMO4': '0.135', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.384', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 416620544. Throughput: 0: 4390.2. Samples: 104154200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:06:02,795][52567] Avg episode reward: [(0, '72.499')] [2024-08-06 04:06:02,912][52667] DAMAGECOUNT value on done: 486784.0 [2024-08-06 04:06:02,912][52667] Sum rewards: 67.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO4': '0.207', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.124', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2024-08-06 04:06:04,266][52669] DAMAGECOUNT value on done: 483730.0 [2024-08-06 04:06:04,269][52669] Sum rewards: 78.927, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.504', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.166', 'AMMO3': '0.207', 'AMMO4': '0.256', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '65.000'} [2024-08-06 04:06:04,294][52803] DAMAGECOUNT value on done: 449425.0 [2024-08-06 04:06:04,294][52803] Sum rewards: 62.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.546', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon2': '0.192', 'AMMO4': '0.201', 'AMMO3': '0.206', 'weapon5': '0.212', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.562', 'WEAPON3': '1.250', 'weapon3': '2.740', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '53.000'} [2024-08-06 04:06:04,516][52650] Updated weights for policy 0, policy_version 50861 (0.0023) [2024-08-06 04:06:05,289][52811] DAMAGECOUNT value on done: 449060.0 [2024-08-06 04:06:05,291][52811] Sum rewards: 71.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.753', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.159', 'weapon4': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:05,694][52667] DAMAGECOUNT value on done: 478996.0 [2024-08-06 04:06:05,694][52667] Sum rewards: 63.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.774', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon2': '0.172', 'weapon4': '0.180', 'AMMO3': '0.203', 'AMMO4': '0.221', 'weapon5': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.146', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '54.000'} [2024-08-06 04:06:06,135][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:06:06,583][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:06:06,983][52669] DAMAGECOUNT value on done: 481948.0 [2024-08-06 04:06:06,984][52669] Sum rewards: 68.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.374', 'WEAPON3': '1.600', 'weapon3': '3.320', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:07,438][52803] DAMAGECOUNT value on done: 439867.0 [2024-08-06 04:06:07,440][52803] Sum rewards: 56.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.753', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO4': '0.174', 'AMMO3': '0.226', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'ARMOR': '0.464', 'weapon2': '0.744', 'WEAPON3': '1.400', 'weapon3': '2.590', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '49.000'} [2024-08-06 04:06:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 416710656. Throughput: 0: 4382.2. Samples: 104180180. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:06:07,794][52567] Avg episode reward: [(0, '72.206')] [2024-08-06 04:06:08,413][52811] DAMAGECOUNT value on done: 448110.0 [2024-08-06 04:06:08,415][52811] Sum rewards: 70.348, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.678', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.102', 'weapon5': '0.116', 'AMMO3': '0.202', 'AMMO4': '0.278', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:08,727][52667] DAMAGECOUNT value on done: 486660.0 [2024-08-06 04:06:08,728][52667] Sum rewards: 67.868, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.091', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.288', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '55.500'} [2024-08-06 04:06:09,429][52650] Updated weights for policy 0, policy_version 50871 (0.0012) [2024-08-06 04:06:09,608][52669] DAMAGECOUNT value on done: 485036.0 [2024-08-06 04:06:09,609][52669] Sum rewards: 64.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.386', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:10,543][52803] DAMAGECOUNT value on done: 456474.0 [2024-08-06 04:06:10,544][52803] Sum rewards: 77.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.092', 'AMMO3': '0.167', 'weapon5': '0.196', 'AMMO4': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:10,710][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:06:10,826][52668] DAMAGECOUNT value on done: 479648.0 [2024-08-06 04:06:10,827][52668] Sum rewards: 59.305, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.868', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.151', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.342', 'weapon2': '0.386', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.954', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '47.000'} [2024-08-06 04:06:11,588][52811] DAMAGECOUNT value on done: 450787.0 [2024-08-06 04:06:11,593][52811] Sum rewards: 58.663, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.282', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.126', 'AMMO3': '0.166', 'AMMO4': '0.220', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.504', 'WEAPON3': '0.900', 'HITCOUNT': '2.580', 'weapon3': '2.878', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '47.000'} [2024-08-06 04:06:11,888][52667] DAMAGECOUNT value on done: 491082.0 [2024-08-06 04:06:11,888][52667] Sum rewards: 71.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.638', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:12,631][52669] DAMAGECOUNT value on done: 484336.0 [2024-08-06 04:06:12,632][52669] Sum rewards: 71.722, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.102', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '0.950', 'weapon3': '3.170', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '56.000'} [2024-08-06 04:06:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 416792576. Throughput: 0: 4384.0. Samples: 104206410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:06:12,794][52567] Avg episode reward: [(0, '71.898')] [2024-08-06 04:06:13,634][52803] DAMAGECOUNT value on done: 451897.0 [2024-08-06 04:06:13,636][52803] Sum rewards: 76.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.524', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.098', 'AMMO4': '0.193', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:13,684][52668] DAMAGECOUNT value on done: 485458.0 [2024-08-06 04:06:13,684][52668] Sum rewards: 63.781, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.680', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.134', 'weapon5': '0.230', 'AMMO4': '0.258', 'AMMO3': '0.261', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2024-08-06 04:06:13,852][52650] Updated weights for policy 0, policy_version 50881 (0.0013) [2024-08-06 04:06:14,525][52811] DAMAGECOUNT value on done: 446134.0 [2024-08-06 04:06:14,525][52811] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.215', 'weapon2': '0.246', 'AMMO4': '0.253', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:15,074][52667] DAMAGECOUNT value on done: 491365.0 [2024-08-06 04:06:15,074][52667] Sum rewards: 83.689, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.672', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.222', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '69.000'} [2024-08-06 04:06:15,649][52669] DAMAGECOUNT value on done: 482879.0 [2024-08-06 04:06:15,649][52669] Sum rewards: 65.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.626', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.090', 'weapon5': '0.164', 'AMMO3': '0.186', 'AMMO4': '0.196', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.316', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '53.000'} [2024-08-06 04:06:16,329][52668] DAMAGECOUNT value on done: 485493.0 [2024-08-06 04:06:16,330][52668] Sum rewards: 70.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.131', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:16,708][52803] DAMAGECOUNT value on done: 448485.0 [2024-08-06 04:06:16,709][52803] Sum rewards: 66.195, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.059', 'AMMO3': '0.142', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.254', 'HEALTH': '0.286', 'AMMO4': '0.295', 'weapon4': '0.470', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.752', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '53.000'} [2024-08-06 04:06:17,105][52671] DAMAGECOUNT value on done: 486357.0 [2024-08-06 04:06:17,105][52671] Sum rewards: 56.713, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.848', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon5': '0.236', 'AMMO4': '0.259', 'weapon2': '0.260', 'AMMO3': '0.262', 'weapon4': '0.280', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '52.500'} [2024-08-06 04:06:17,640][52811] DAMAGECOUNT value on done: 451280.0 [2024-08-06 04:06:17,641][52811] Sum rewards: 77.873, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.420', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.181', 'weapon5': '0.202', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 416882688. Throughput: 0: 4389.1. Samples: 104219740. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:06:17,795][52567] Avg episode reward: [(0, '71.679')] [2024-08-06 04:06:18,184][52667] DAMAGECOUNT value on done: 487573.0 [2024-08-06 04:06:18,186][52667] Sum rewards: 67.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.752', 'AMMO5': '0.024', 'AMMO2': '0.048', 'weapon4': '0.084', 'weapon5': '0.182', 'AMMO3': '0.226', 'AMMO4': '0.242', 'weapon2': '0.288', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.180', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:18,745][52669] DAMAGECOUNT value on done: 489250.0 [2024-08-06 04:06:18,747][52669] Sum rewards: 79.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.605', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.167', 'weapon5': '0.182', 'weapon4': '0.268', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.994', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:18,847][52650] Updated weights for policy 0, policy_version 50891 (0.0020) [2024-08-06 04:06:19,187][52668] DAMAGECOUNT value on done: 486546.0 [2024-08-06 04:06:19,187][52668] Sum rewards: 67.483, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.892', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.168', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.314', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:19,781][52671] DAMAGECOUNT value on done: 485793.0 [2024-08-06 04:06:19,781][52671] Sum rewards: 68.241, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.775', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.246', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:20,053][52803] DAMAGECOUNT value on done: 452719.0 [2024-08-06 04:06:20,055][52803] Sum rewards: 76.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.828', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.096', 'weapon2': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.412', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '65.000'} [2024-08-06 04:06:20,679][52811] DAMAGECOUNT value on done: 451646.0 [2024-08-06 04:06:20,681][52811] Sum rewards: 69.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.945', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.072', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.352', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:21,316][52667] DAMAGECOUNT value on done: 482020.0 [2024-08-06 04:06:21,317][52667] Sum rewards: 66.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.235', 'weapon2': '0.418', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.352', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:21,684][52669] DAMAGECOUNT value on done: 481297.0 [2024-08-06 04:06:21,684][52669] Sum rewards: 72.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.470', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:22,275][52668] DAMAGECOUNT value on done: 476322.0 [2024-08-06 04:06:22,276][52668] Sum rewards: 66.960, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.160', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.650', 'weapon3': '3.036', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:22,685][52671] DAMAGECOUNT value on done: 486999.0 [2024-08-06 04:06:22,686][52671] Sum rewards: 78.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.235', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.026', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.520', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 416972800. Throughput: 0: 4390.0. Samples: 104245960. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 04:06:22,794][52567] Avg episode reward: [(0, '71.736')] [2024-08-06 04:06:23,053][52803] DAMAGECOUNT value on done: 449073.0 [2024-08-06 04:06:23,054][52803] Sum rewards: 71.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:23,165][52650] Updated weights for policy 0, policy_version 50901 (0.0014) [2024-08-06 04:06:23,619][52811] DAMAGECOUNT value on done: 449769.0 [2024-08-06 04:06:23,620][52811] Sum rewards: 66.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.333', 'AMMO5': '0.005', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.214', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.490', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:24,000][52667] DAMAGECOUNT value on done: 488800.0 [2024-08-06 04:06:24,002][52667] Sum rewards: 82.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.111', 'weapon5': '0.196', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '68.000'} [2024-08-06 04:06:24,490][52669] DAMAGECOUNT value on done: 489362.0 [2024-08-06 04:06:24,490][52669] Sum rewards: 69.220, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.260', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.084', 'AMMO4': '0.156', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.824', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:25,270][52668] DAMAGECOUNT value on done: 487794.0 [2024-08-06 04:06:25,271][52668] Sum rewards: 64.508, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.618', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.136', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '0.950', 'weapon3': '2.776', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '51.000'} [2024-08-06 04:06:25,591][52671] DAMAGECOUNT value on done: 485592.0 [2024-08-06 04:06:25,591][52671] Sum rewards: 73.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.356', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:25,623][52662] DAMAGECOUNT value on done: 487549.0 [2024-08-06 04:06:25,625][52662] Sum rewards: 71.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.152', 'weapon5': '0.186', 'AMMO3': '0.196', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.202', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:26,248][52803] DAMAGECOUNT value on done: 446414.0 [2024-08-06 04:06:26,249][52803] Sum rewards: 79.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.026', 'AMMO4': '0.036', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '65.000'} [2024-08-06 04:06:26,425][52658] DAMAGECOUNT value on done: 480309.0 [2024-08-06 04:06:26,426][52658] Sum rewards: 67.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.132', 'weapon2': '0.134', 'AMMO3': '0.190', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.522', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2024-08-06 04:06:26,740][52811] DAMAGECOUNT value on done: 450034.0 [2024-08-06 04:06:26,742][52811] Sum rewards: 70.864, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.370', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'weapon4': '0.274', 'weapon2': '0.728', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:27,378][52669] DAMAGECOUNT value on done: 489042.0 [2024-08-06 04:06:27,381][52669] Sum rewards: 73.034, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.200', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.126', 'weapon4': '0.154', 'AMMO4': '0.173', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.700', 'weapon3': '3.028', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 417054720. Throughput: 0: 4384.9. Samples: 104272110. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 04:06:27,794][52567] Avg episode reward: [(0, '71.718')] [2024-08-06 04:06:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050910_417054720.pth... [2024-08-06 04:06:27,961][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050397_412852224.pth [2024-08-06 04:06:28,101][52650] Updated weights for policy 0, policy_version 50911 (0.0022) [2024-08-06 04:06:28,454][52662] DAMAGECOUNT value on done: 490490.0 [2024-08-06 04:06:28,454][52662] Sum rewards: 75.639, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.088', 'weapon4': '0.116', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.216', 'WEAPON3': '1.300', 'weapon3': '3.392', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:28,702][52668] DAMAGECOUNT value on done: 487603.0 [2024-08-06 04:06:28,702][52668] Sum rewards: 67.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.364', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.008', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon4': '0.394', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.588', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:28,743][52671] DAMAGECOUNT value on done: 496317.0 [2024-08-06 04:06:28,744][52671] Sum rewards: 76.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.503', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.142', 'AMMO4': '0.148', 'weapon2': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.400', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '66.000'} [2024-08-06 04:06:29,117][52658] DAMAGECOUNT value on done: 485248.0 [2024-08-06 04:06:29,117][52658] Sum rewards: 76.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.166', 'AMMO3': '0.214', 'AMMO4': '0.273', 'WEAPON5': '0.300', 'weapon4': '0.374', 'weapon2': '0.436', 'ARMOR': '0.451', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.720', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '66.000'} [2024-08-06 04:06:29,488][52803] DAMAGECOUNT value on done: 454888.0 [2024-08-06 04:06:29,488][52803] Sum rewards: 70.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.511', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO3': '0.170', 'weapon4': '0.198', 'AMMO4': '0.206', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:30,469][52669] DAMAGECOUNT value on done: 475222.0 [2024-08-06 04:06:30,470][52669] Sum rewards: 78.139, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.406', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.182', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.418', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:30,905][52662] DAMAGECOUNT value on done: 487794.0 [2024-08-06 04:06:30,905][52662] Sum rewards: 77.055, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.848', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '62.000'} [2024-08-06 04:06:31,641][52668] DAMAGECOUNT value on done: 477444.0 [2024-08-06 04:06:31,642][52668] Sum rewards: 71.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.946', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.482', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:31,853][52658] DAMAGECOUNT value on done: 488194.0 [2024-08-06 04:06:31,855][52658] Sum rewards: 58.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.320', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.098', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '49.500'} [2024-08-06 04:06:31,880][52671] DAMAGECOUNT value on done: 485806.0 [2024-08-06 04:06:31,880][52671] Sum rewards: 59.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.225', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '49.000'} [2024-08-06 04:06:32,505][52803] DAMAGECOUNT value on done: 451808.0 [2024-08-06 04:06:32,505][52803] Sum rewards: 74.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.259', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.202', 'weapon5': '0.226', 'AMMO4': '0.244', 'weapon4': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.594', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:32,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 417136640. Throughput: 0: 4370.6. Samples: 104284900. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 04:06:32,795][52567] Avg episode reward: [(0, '71.846')] [2024-08-06 04:06:32,884][52650] Updated weights for policy 0, policy_version 50921 (0.0012) [2024-08-06 04:06:33,528][52669] DAMAGECOUNT value on done: 486572.0 [2024-08-06 04:06:33,536][52669] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.871', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.108', 'AMMO3': '0.156', 'weapon5': '0.164', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.096', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 04:06:33,673][52662] DAMAGECOUNT value on done: 478120.0 [2024-08-06 04:06:33,674][52662] Sum rewards: 82.714, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.826', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.176', 'AMMO4': '0.220', 'weapon2': '0.230', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '71.000'} [2024-08-06 04:06:34,143][52668] DAMAGECOUNT value on done: 480590.0 [2024-08-06 04:06:34,143][52668] Sum rewards: 62.042, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.944', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.084', 'weapon5': '0.138', 'AMMO3': '0.259', 'weapon2': '0.278', 'AMMO4': '0.321', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.222', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '56.000'} [2024-08-06 04:06:34,444][52658] DAMAGECOUNT value on done: 486724.0 [2024-08-06 04:06:34,445][52658] Sum rewards: 75.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.127', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:34,598][52660] DAMAGECOUNT value on done: 483005.0 [2024-08-06 04:06:34,598][52660] Sum rewards: 76.507, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.555', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.124', 'AMMO4': '0.145', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:35,010][52671] DAMAGECOUNT value on done: 491361.0 [2024-08-06 04:06:35,011][52671] Sum rewards: 71.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.080', 'weapon2': '0.200', 'weapon5': '0.212', 'AMMO4': '0.225', 'AMMO3': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.294', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '58.500'} [2024-08-06 04:06:35,704][52803] DAMAGECOUNT value on done: 453601.0 [2024-08-06 04:06:35,707][52803] Sum rewards: 59.321, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.062', 'weapon5': '0.098', 'AMMO4': '0.109', 'AMMO3': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '0.900', 'HITCOUNT': '2.720', 'weapon3': '2.908', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '48.000'} [2024-08-06 04:06:36,648][52669] DAMAGECOUNT value on done: 487323.0 [2024-08-06 04:06:36,649][52669] Sum rewards: 70.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.176', 'AMMO3': '0.179', 'AMMO4': '0.189', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:36,674][52662] DAMAGECOUNT value on done: 488033.0 [2024-08-06 04:06:36,677][52662] Sum rewards: 62.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.709', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.202', 'AMMO4': '0.207', 'AMMO3': '0.300', 'weapon2': '0.322', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.722', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:36,729][52668] DAMAGECOUNT value on done: 489071.0 [2024-08-06 04:06:36,730][52668] Sum rewards: 77.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.174', 'weapon4': '0.178', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:37,318][52650] Updated weights for policy 0, policy_version 50931 (0.0012) [2024-08-06 04:06:37,346][52658] DAMAGECOUNT value on done: 476948.0 [2024-08-06 04:06:37,349][52658] Sum rewards: 67.920, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.910', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.132', 'weapon4': '0.176', 'AMMO3': '0.230', 'AMMO4': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '57.500'} [2024-08-06 04:06:37,450][52660] DAMAGECOUNT value on done: 473317.0 [2024-08-06 04:06:37,452][52660] Sum rewards: 66.044, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.892', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.130', 'weapon5': '0.162', 'AMMO4': '0.202', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:37,701][52671] DAMAGECOUNT value on done: 486699.0 [2024-08-06 04:06:37,702][52671] Sum rewards: 56.592, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.940', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.146', 'AMMO3': '0.173', 'weapon5': '0.216', 'AMMO4': '0.259', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '45.500'} [2024-08-06 04:06:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 417226752. Throughput: 0: 4363.3. Samples: 104311060. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 04:06:37,794][52567] Avg episode reward: [(0, '70.808')] [2024-08-06 04:06:38,752][52803] DAMAGECOUNT value on done: 446301.0 [2024-08-06 04:06:38,761][52803] Sum rewards: 68.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.076', 'WEAPON4': '0.150', 'weapon2': '0.154', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.500', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:39,144][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:06:39,568][52669] DAMAGECOUNT value on done: 500197.0 [2024-08-06 04:06:39,568][52669] Sum rewards: 75.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.217', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.050', 'weapon4': '0.132', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.386', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:39,590][52668] DAMAGECOUNT value on done: 482366.0 [2024-08-06 04:06:39,591][52668] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.284', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '54.000'} [2024-08-06 04:06:39,644][52662] DAMAGECOUNT value on done: 480970.0 [2024-08-06 04:06:39,646][52662] Sum rewards: 61.433, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.748', 'AMMO5': '0.027', 'AMMO2': '0.058', 'AMMO3': '0.235', 'weapon5': '0.244', 'weapon2': '0.248', 'AMMO4': '0.290', 'weapon4': '0.552', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.568', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '53.000'} [2024-08-06 04:06:40,120][52660] DAMAGECOUNT value on done: 486211.0 [2024-08-06 04:06:40,122][52660] Sum rewards: 73.120, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.140', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.170', 'AMMO4': '0.185', 'AMMO3': '0.261', 'weapon4': '0.306', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.884', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '62.000'} [2024-08-06 04:06:40,397][52658] DAMAGECOUNT value on done: 480593.0 [2024-08-06 04:06:40,397][52658] Sum rewards: 64.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.474', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.086', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.195', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.266', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:41,007][52671] DAMAGECOUNT value on done: 481884.0 [2024-08-06 04:06:41,008][52671] Sum rewards: 77.194, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.083', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.060', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '62.000'} [2024-08-06 04:06:41,940][52662] DAMAGECOUNT value on done: 488095.0 [2024-08-06 04:06:41,941][52662] Sum rewards: 74.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon4': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 04:06:42,090][52650] Updated weights for policy 0, policy_version 50941 (0.0031) [2024-08-06 04:06:42,473][52668] DAMAGECOUNT value on done: 477757.0 [2024-08-06 04:06:42,474][52668] Sum rewards: 67.920, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.230', 'AMMO5': '0.027', 'AMMO2': '0.076', 'AMMO3': '0.207', 'weapon4': '0.280', 'weapon5': '0.314', 'AMMO4': '0.380', 'weapon2': '0.406', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.596', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:42,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 417316864. Throughput: 0: 4361.1. Samples: 104337210. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 04:06:42,794][52567] Avg episode reward: [(0, '70.710')] [2024-08-06 04:06:42,840][52669] DAMAGECOUNT value on done: 488047.0 [2024-08-06 04:06:42,842][52669] Sum rewards: 72.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.896', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.116', 'weapon4': '0.168', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:43,157][52660] DAMAGECOUNT value on done: 490784.0 [2024-08-06 04:06:43,157][52660] Sum rewards: 76.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.102', 'AMMO3': '0.242', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:43,218][52658] DAMAGECOUNT value on done: 488251.0 [2024-08-06 04:06:43,218][52658] Sum rewards: 78.713, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.259', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.328', 'WEAPON3': '1.950', 'weapon3': '3.514', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '71.000'} [2024-08-06 04:06:44,041][52671] DAMAGECOUNT value on done: 488256.0 [2024-08-06 04:06:44,049][52671] Sum rewards: 58.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.577', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.212', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.218', 'DAMAGECOUNT': '14.763', 'FRAGCOUNT': '49.000'} [2024-08-06 04:06:44,488][52662] DAMAGECOUNT value on done: 492818.0 [2024-08-06 04:06:44,492][52662] Sum rewards: 66.060, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.978', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.097', 'AMMO3': '0.177', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.414', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '53.000'} [2024-08-06 04:06:45,082][52664] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:06:45,370][52668] DAMAGECOUNT value on done: 472326.0 [2024-08-06 04:06:45,370][52668] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.335', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.096', 'AMMO3': '0.217', 'weapon5': '0.220', 'AMMO4': '0.257', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:45,977][52669] DAMAGECOUNT value on done: 485539.0 [2024-08-06 04:06:45,979][52669] Sum rewards: 72.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.114', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:45,981][52660] DAMAGECOUNT value on done: 483656.0 [2024-08-06 04:06:45,982][52660] Sum rewards: 67.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:46,130][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:06:46,184][52658] DAMAGECOUNT value on done: 479034.0 [2024-08-06 04:06:46,184][52658] Sum rewards: 68.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.588', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.054', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:46,715][52795] DAMAGECOUNT value on done: 449577.0 [2024-08-06 04:06:46,716][52795] Sum rewards: 70.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.020', 'AMMO2': '0.079', 'AMMO3': '0.165', 'weapon4': '0.216', 'weapon2': '0.288', 'weapon5': '0.296', 'AMMO4': '0.397', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '56.000'} [2024-08-06 04:06:46,946][52650] Updated weights for policy 0, policy_version 50951 (0.0013) [2024-08-06 04:06:47,045][52671] DAMAGECOUNT value on done: 490453.0 [2024-08-06 04:06:47,045][52671] Sum rewards: 63.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.025', 'AMMO2': '0.048', 'AMMO3': '0.183', 'weapon5': '0.234', 'AMMO4': '0.239', 'weapon4': '0.264', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '53.000'} [2024-08-06 04:06:47,344][52662] DAMAGECOUNT value on done: 482581.0 [2024-08-06 04:06:47,345][52662] Sum rewards: 78.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.170', 'weapon4': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 417398784. Throughput: 0: 4363.8. Samples: 104350570. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 04:06:47,794][52567] Avg episode reward: [(0, '70.440')] [2024-08-06 04:06:48,164][52668] DAMAGECOUNT value on done: 473081.0 [2024-08-06 04:06:48,164][52668] Sum rewards: 66.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.308', 'AMMO5': '0.024', 'AMMO2': '0.056', 'weapon4': '0.124', 'AMMO3': '0.201', 'weapon5': '0.242', 'AMMO4': '0.281', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.654', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:48,685][52660] DAMAGECOUNT value on done: 480009.0 [2024-08-06 04:06:48,686][52660] Sum rewards: 77.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.019', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.204', 'weapon5': '0.206', 'weapon4': '0.238', 'AMMO4': '0.253', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:49,002][52669] DAMAGECOUNT value on done: 490208.0 [2024-08-06 04:06:49,002][52669] Sum rewards: 69.409, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.635', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.285', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:49,026][52658] DAMAGECOUNT value on done: 492923.0 [2024-08-06 04:06:49,026][52658] Sum rewards: 69.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.208', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.188', 'weapon2': '0.220', 'AMMO4': '0.224', 'weapon5': '0.316', 'weapon4': '0.436', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:49,786][52671] DAMAGECOUNT value on done: 486818.0 [2024-08-06 04:06:49,788][52671] Sum rewards: 78.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.047', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'weapon4': '0.096', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon2': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.398', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '67.000'} [2024-08-06 04:06:49,907][52795] DAMAGECOUNT value on done: 438778.0 [2024-08-06 04:06:49,907][52795] Sum rewards: 73.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.933', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.176', 'AMMO3': '0.197', 'weapon5': '0.236', 'AMMO4': '0.251', 'weapon2': '0.308', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:49,915][52665] DAMAGECOUNT value on done: 473128.0 [2024-08-06 04:06:49,916][52665] Sum rewards: 74.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.226', 'AMMO4': '0.282', 'weapon4': '0.298', 'weapon2': '0.378', 'weapon5': '0.420', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.592', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:50,019][52662] DAMAGECOUNT value on done: 495845.0 [2024-08-06 04:06:50,021][52662] Sum rewards: 66.477, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.620', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO4': '0.247', 'weapon5': '0.272', 'AMMO3': '0.290', 'weapon4': '0.298', 'weapon2': '0.336', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.740', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:51,036][52668] DAMAGECOUNT value on done: 474368.0 [2024-08-06 04:06:51,038][52668] Sum rewards: 58.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.391', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.066', 'AMMO4': '0.110', 'weapon5': '0.170', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '3.140', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '49.000'} [2024-08-06 04:06:51,443][52650] Updated weights for policy 0, policy_version 50961 (0.0032) [2024-08-06 04:06:51,624][52660] DAMAGECOUNT value on done: 479899.0 [2024-08-06 04:06:51,625][52660] Sum rewards: 60.960, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.659', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon7': '0.062', 'AMMO4': '0.120', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.164', 'AMMO3': '0.179', 'WEAPON7': '0.200', 'weapon4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.086', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '50.000'} [2024-08-06 04:06:52,086][52658] DAMAGECOUNT value on done: 481198.0 [2024-08-06 04:06:52,089][52658] Sum rewards: 70.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.106', 'AMMO4': '0.149', 'weapon5': '0.198', 'weapon2': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.210', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:52,125][52669] DAMAGECOUNT value on done: 490303.0 [2024-08-06 04:06:52,125][52669] Sum rewards: 77.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.932', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.130', 'weapon4': '0.146', 'AMMO4': '0.165', 'AMMO3': '0.212', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:52,401][52671] DAMAGECOUNT value on done: 493747.0 [2024-08-06 04:06:52,402][52671] Sum rewards: 79.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.172', 'AMMO3': '0.184', 'weapon4': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '2.698', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:52,741][52665] DAMAGECOUNT value on done: 485928.0 [2024-08-06 04:06:52,749][52665] Sum rewards: 78.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.425', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.139', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '0.950', 'weapon3': '3.288', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:52,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.9). Total num frames: 417488896. Throughput: 0: 4370.6. Samples: 104376860. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 04:06:52,796][52567] Avg episode reward: [(0, '70.235')] [2024-08-06 04:06:52,887][52662] DAMAGECOUNT value on done: 481763.0 [2024-08-06 04:06:52,891][52662] Sum rewards: 67.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.074', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon2': '0.184', 'AMMO4': '0.209', 'weapon5': '0.228', 'AMMO3': '0.235', 'weapon4': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:53,119][52795] DAMAGECOUNT value on done: 439605.0 [2024-08-06 04:06:53,119][52795] Sum rewards: 71.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.240', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.428', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.346', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '61.000'} [2024-08-06 04:06:54,158][52668] DAMAGECOUNT value on done: 481542.0 [2024-08-06 04:06:54,158][52668] Sum rewards: 74.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.144', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.083', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '63.000'} [2024-08-06 04:06:54,770][52660] DAMAGECOUNT value on done: 487624.0 [2024-08-06 04:06:54,772][52660] Sum rewards: 101.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.466', 'HITCOUNT': '4.450', 'DAMAGECOUNT': '23.253', 'FRAGCOUNT': '82.000'} [2024-08-06 04:06:54,933][52671] DAMAGECOUNT value on done: 486883.0 [2024-08-06 04:06:54,942][52671] Sum rewards: 70.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.056', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.000'} [2024-08-06 04:06:55,207][52658] DAMAGECOUNT value on done: 495155.0 [2024-08-06 04:06:55,207][52658] Sum rewards: 79.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.862', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.094', 'weapon5': '0.134', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '65.000'} [2024-08-06 04:06:55,443][52665] DAMAGECOUNT value on done: 481405.0 [2024-08-06 04:06:55,443][52665] Sum rewards: 69.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.006', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '58.000'} [2024-08-06 04:06:56,047][52650] Updated weights for policy 0, policy_version 50971 (0.0011) [2024-08-06 04:06:56,133][52662] DAMAGECOUNT value on done: 486435.0 [2024-08-06 04:06:56,135][52662] Sum rewards: 68.913, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.656', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.168', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.315', 'weapon2': '0.420', 'WEAPON3': '1.750', 'weapon3': '3.056', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:56,268][52795] DAMAGECOUNT value on done: 445323.0 [2024-08-06 04:06:56,270][52795] Sum rewards: 66.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.262', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO3': '0.174', 'AMMO4': '0.198', 'weapon2': '0.254', 'weapon4': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '55.000'} [2024-08-06 04:06:57,112][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:06:57,187][52668] DAMAGECOUNT value on done: 485178.0 [2024-08-06 04:06:57,190][52668] Sum rewards: 84.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.326', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.087', 'FRAGCOUNT': '70.000'} [2024-08-06 04:06:57,753][52658] DAMAGECOUNT value on done: 476647.0 [2024-08-06 04:06:57,753][52658] Sum rewards: 80.546, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.409', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.346', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '64.000'} [2024-08-06 04:06:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 417579008. Throughput: 0: 4370.0. Samples: 104403060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:06:57,795][52567] Avg episode reward: [(0, '71.282')] [2024-08-06 04:06:57,878][52660] DAMAGECOUNT value on done: 484563.0 [2024-08-06 04:06:57,879][52660] Sum rewards: 62.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.304', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.223', 'AMMO4': '0.236', 'weapon5': '0.246', 'weapon4': '0.304', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.704', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '53.000'} [2024-08-06 04:06:58,064][52671] DAMAGECOUNT value on done: 473603.0 [2024-08-06 04:06:58,066][52671] Sum rewards: 65.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.084', 'weapon5': '0.124', 'AMMO4': '0.155', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:58,484][52665] DAMAGECOUNT value on done: 476662.0 [2024-08-06 04:06:58,485][52665] Sum rewards: 65.389, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.063', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.084', 'AMMO4': '0.209', 'weapon5': '0.218', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.956', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '57.000'} [2024-08-06 04:06:59,176][52662] DAMAGECOUNT value on done: 483082.0 [2024-08-06 04:06:59,176][52662] Sum rewards: 66.583, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.070', 'AMMO5': '0.025', 'AMMO2': '0.062', 'weapon5': '0.134', 'AMMO3': '0.230', 'AMMO4': '0.308', 'weapon2': '0.326', 'weapon4': '0.358', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '60.000'} [2024-08-06 04:06:59,478][52795] DAMAGECOUNT value on done: 442030.0 [2024-08-06 04:06:59,480][52795] Sum rewards: 69.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.164', 'AMMO3': '0.203', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.688', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:00,300][52668] DAMAGECOUNT value on done: 482564.0 [2024-08-06 04:07:00,310][52668] Sum rewards: 67.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.169', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.226', 'AMMO4': '0.275', 'weapon5': '0.302', 'weapon2': '0.344', 'weapon4': '0.380', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.632', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '55.000'} [2024-08-06 04:07:00,718][52658] DAMAGECOUNT value on done: 485137.0 [2024-08-06 04:07:00,719][52658] Sum rewards: 65.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.716', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.182', 'AMMO3': '0.185', 'weapon5': '0.194', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.104', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2024-08-06 04:07:00,819][52650] Updated weights for policy 0, policy_version 50981 (0.0011) [2024-08-06 04:07:00,956][52660] DAMAGECOUNT value on done: 479491.0 [2024-08-06 04:07:00,956][52660] Sum rewards: 68.582, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.752', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.130', 'AMMO4': '0.149', 'weapon5': '0.178', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '58.500'} [2024-08-06 04:07:01,149][52671] DAMAGECOUNT value on done: 493810.0 [2024-08-06 04:07:01,149][52671] Sum rewards: 67.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.951', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.090', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:01,550][52665] DAMAGECOUNT value on done: 468613.0 [2024-08-06 04:07:01,553][52665] Sum rewards: 79.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.174', 'weapon5': '0.204', 'weapon4': '0.348', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '65.000'} [2024-08-06 04:07:02,377][52662] DAMAGECOUNT value on done: 491509.0 [2024-08-06 04:07:02,378][52662] Sum rewards: 72.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.098', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.172', 'weapon2': '0.204', 'AMMO3': '0.247', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '63.000'} [2024-08-06 04:07:02,653][52795] DAMAGECOUNT value on done: 450324.0 [2024-08-06 04:07:02,654][52795] Sum rewards: 79.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.080', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '66.000'} [2024-08-06 04:07:02,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 417669120. Throughput: 0: 4371.6. Samples: 104416460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:07:02,794][52567] Avg episode reward: [(0, '71.132')] [2024-08-06 04:07:02,865][52668] DAMAGECOUNT value on done: 487144.0 [2024-08-06 04:07:02,865][52668] Sum rewards: 70.145, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.112', 'weapon5': '0.170', 'weapon2': '0.204', 'AMMO4': '0.212', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.206', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:02,900][52658] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 04:07:03,438][52660] DAMAGECOUNT value on done: 488863.0 [2024-08-06 04:07:03,440][52660] Sum rewards: 59.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.233', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'weapon4': '0.176', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '3.102', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '48.000'} [2024-08-06 04:07:03,509][52658] DAMAGECOUNT value on done: 482295.0 [2024-08-06 04:07:03,511][52658] Sum rewards: 64.341, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.475', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.062', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.286', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.054', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:04,102][52671] DAMAGECOUNT value on done: 490955.0 [2024-08-06 04:07:04,104][52671] Sum rewards: 66.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.024', 'AMMO2': '0.077', 'AMMO3': '0.218', 'weapon4': '0.254', 'weapon5': '0.316', 'AMMO4': '0.384', 'weapon2': '0.462', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '54.000'} [2024-08-06 04:07:04,109][52665] DAMAGECOUNT value on done: 474029.0 [2024-08-06 04:07:04,109][52665] Sum rewards: 66.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon2': '0.136', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon4': '0.302', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.114', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '54.000'} [2024-08-06 04:07:05,639][52650] Updated weights for policy 0, policy_version 50991 (0.0030) [2024-08-06 04:07:05,762][52662] DAMAGECOUNT value on done: 484616.0 [2024-08-06 04:07:05,764][52662] Sum rewards: 70.287, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.054', 'AMMO4': '0.154', 'weapon4': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.500'} [2024-08-06 04:07:05,788][52795] DAMAGECOUNT value on done: 454566.0 [2024-08-06 04:07:05,788][52795] Sum rewards: 70.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.648', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.170', 'weapon5': '0.222', 'AMMO3': '0.247', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:05,794][52668] DAMAGECOUNT value on done: 484022.0 [2024-08-06 04:07:05,794][52668] Sum rewards: 74.095, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.935', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO3': '0.190', 'AMMO4': '0.196', 'weapon2': '0.270', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:06,302][52658] DAMAGECOUNT value on done: 481976.0 [2024-08-06 04:07:06,303][52658] Sum rewards: 72.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.428', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.158', 'AMMO4': '0.182', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:06,502][52660] DAMAGECOUNT value on done: 475781.0 [2024-08-06 04:07:06,503][52660] Sum rewards: 71.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.332', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.178', 'weapon2': '0.722', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:06,740][52671] DAMAGECOUNT value on done: 491563.0 [2024-08-06 04:07:06,742][52671] Sum rewards: 70.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.996', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.111', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:07,054][52665] DAMAGECOUNT value on done: 478110.0 [2024-08-06 04:07:07,057][52665] Sum rewards: 70.327, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.030', 'HEALTH': '0.036', 'AMMO4': '0.036', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:07,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17339.5, 300 sec: 17494.7). Total num frames: 417751040. Throughput: 0: 4370.6. Samples: 104442640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:07:07,795][52567] Avg episode reward: [(0, '70.862')] [2024-08-06 04:07:08,400][52662] DAMAGECOUNT value on done: 494393.0 [2024-08-06 04:07:08,400][52662] Sum rewards: 53.068, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.228', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.111', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.276', 'WEAPON3': '0.700', 'HITCOUNT': '2.480', 'weapon3': '3.240', 'DAMAGECOUNT': '12.369', 'FRAGCOUNT': '40.000'} [2024-08-06 04:07:09,045][52795] DAMAGECOUNT value on done: 450697.0 [2024-08-06 04:07:09,048][52795] Sum rewards: 79.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.305', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon5': '0.040', 'weapon4': '0.078', 'AMMO4': '0.133', 'AMMO3': '0.155', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '3.306', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '64.000'} [2024-08-06 04:07:09,066][52658] DAMAGECOUNT value on done: 476407.0 [2024-08-06 04:07:09,068][52658] Sum rewards: 59.062, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.284', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.076', 'weapon5': '0.170', 'AMMO4': '0.182', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.960', 'weapon3': '3.074', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '52.000'} [2024-08-06 04:07:09,317][52660] DAMAGECOUNT value on done: 483602.0 [2024-08-06 04:07:09,319][52660] Sum rewards: 86.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.100', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.542', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '74.000'} [2024-08-06 04:07:09,430][52671] DAMAGECOUNT value on done: 489509.0 [2024-08-06 04:07:09,430][52671] Sum rewards: 77.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.202', 'AMMO3': '0.236', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.640', 'WEAPON3': '1.500', 'weapon3': '2.572', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '66.000'} [2024-08-06 04:07:10,127][52650] Updated weights for policy 0, policy_version 51001 (0.0012) [2024-08-06 04:07:10,454][52665] DAMAGECOUNT value on done: 479451.0 [2024-08-06 04:07:10,458][52665] Sum rewards: 84.571, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.020', 'weapon4': '0.022', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon2': '0.380', 'WEAPON3': '0.950', 'weapon3': '3.428', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '68.000'} [2024-08-06 04:07:10,488][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:07:11,078][52662] DAMAGECOUNT value on done: 488180.0 [2024-08-06 04:07:11,078][52662] Sum rewards: 66.208, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.038', 'HEALTH': '0.094', 'weapon5': '0.124', 'AMMO4': '0.188', 'AMMO3': '0.200', 'weapon2': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '53.000'} [2024-08-06 04:07:11,532][52658] DAMAGECOUNT value on done: 491812.0 [2024-08-06 04:07:11,534][52658] Sum rewards: 70.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.155', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.176', 'weapon4': '0.186', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:12,118][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:07:12,133][52660] DAMAGECOUNT value on done: 491163.0 [2024-08-06 04:07:12,134][52660] Sum rewards: 66.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.804', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.116', 'weapon5': '0.128', 'AMMO4': '0.148', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:12,202][52795] DAMAGECOUNT value on done: 440173.0 [2024-08-06 04:07:12,203][52795] Sum rewards: 73.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.401', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon5': '0.170', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:12,419][52671] DAMAGECOUNT value on done: 483876.0 [2024-08-06 04:07:12,419][52671] Sum rewards: 70.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO3': '0.178', 'AMMO4': '0.193', 'weapon4': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.180', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 417841152. Throughput: 0: 4376.9. Samples: 104469070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:07:12,794][52567] Avg episode reward: [(0, '70.718')] [2024-08-06 04:07:13,428][52665] DAMAGECOUNT value on done: 485482.0 [2024-08-06 04:07:13,428][52665] Sum rewards: 66.169, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.168', 'AMMO4': '0.212', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:13,743][52662] DAMAGECOUNT value on done: 481352.0 [2024-08-06 04:07:13,747][52662] Sum rewards: 65.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.178', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '55.000'} [2024-08-06 04:07:14,084][52647] DAMAGECOUNT value on done: 510506.0 [2024-08-06 04:07:14,085][52647] Sum rewards: 81.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.087', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '67.000'} [2024-08-06 04:07:14,541][52658] DAMAGECOUNT value on done: 482563.0 [2024-08-06 04:07:14,544][52658] Sum rewards: 74.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO4': '0.171', 'AMMO3': '0.242', 'weapon5': '0.242', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '63.500'} [2024-08-06 04:07:14,626][52660] DAMAGECOUNT value on done: 496576.0 [2024-08-06 04:07:14,626][52660] Sum rewards: 82.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.173', 'AMMO3': '0.176', 'weapon5': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '66.000'} [2024-08-06 04:07:14,648][52650] Updated weights for policy 0, policy_version 51011 (0.0019) [2024-08-06 04:07:15,282][52795] DAMAGECOUNT value on done: 453409.0 [2024-08-06 04:07:15,283][52795] Sum rewards: 64.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.646', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.143', 'AMMO3': '0.190', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '53.500'} [2024-08-06 04:07:15,817][52665] DAMAGECOUNT value on done: 477662.0 [2024-08-06 04:07:15,818][52665] Sum rewards: 77.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.271', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.201', 'weapon5': '0.278', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.598', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.500'} [2024-08-06 04:07:16,527][52662] DAMAGECOUNT value on done: 483968.0 [2024-08-06 04:07:16,527][52662] Sum rewards: 81.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.086', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.064', 'AMMO4': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '67.000'} [2024-08-06 04:07:17,288][52647] DAMAGECOUNT value on done: 510507.0 [2024-08-06 04:07:17,290][52647] Sum rewards: 76.700, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'HEALTH': '0.010', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.082', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.258', 'WEAPON3': '1.100', 'weapon3': '3.456', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:17,484][52660] DAMAGECOUNT value on done: 480266.0 [2024-08-06 04:07:17,484][52660] Sum rewards: 69.630, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.629', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.245', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:17,699][52658] DAMAGECOUNT value on done: 485722.0 [2024-08-06 04:07:17,699][52658] Sum rewards: 76.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.122', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:17,794][52567] Fps is (10 sec: 18023.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 417931264. Throughput: 0: 4387.4. Samples: 104482330. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:07:17,794][52567] Avg episode reward: [(0, '71.037')] [2024-08-06 04:07:18,454][52795] DAMAGECOUNT value on done: 446881.0 [2024-08-06 04:07:18,455][52795] Sum rewards: 61.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.368', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.618', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.092', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '50.000'} [2024-08-06 04:07:18,493][52665] DAMAGECOUNT value on done: 487476.0 [2024-08-06 04:07:18,493][52665] Sum rewards: 60.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.175', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.197', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon5': '0.254', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '50.500'} [2024-08-06 04:07:19,128][52662] DAMAGECOUNT value on done: 479991.0 [2024-08-06 04:07:19,130][52662] Sum rewards: 75.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.152', 'weapon5': '0.152', 'AMMO4': '0.156', 'AMMO3': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.970', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:19,331][52650] Updated weights for policy 0, policy_version 51021 (0.0023) [2024-08-06 04:07:19,478][52794] DAMAGECOUNT value on done: 485314.0 [2024-08-06 04:07:19,479][52794] Sum rewards: 71.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.868', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon2': '0.186', 'weapon5': '0.228', 'AMMO4': '0.247', 'weapon4': '0.248', 'AMMO3': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.992', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:20,158][52660] DAMAGECOUNT value on done: 487820.0 [2024-08-06 04:07:20,158][52660] Sum rewards: 69.548, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.909', 'AMMO5': '0.027', 'AMMO2': '0.069', 'weapon4': '0.146', 'weapon2': '0.250', 'weapon5': '0.252', 'AMMO3': '0.258', 'AMMO4': '0.347', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'weapon3': '3.034', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '59.500'} [2024-08-06 04:07:20,248][52647] DAMAGECOUNT value on done: 506395.0 [2024-08-06 04:07:20,250][52647] Sum rewards: 59.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon5': '0.168', 'AMMO3': '0.182', 'AMMO4': '0.285', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.608', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '48.000'} [2024-08-06 04:07:20,763][52658] DAMAGECOUNT value on done: 489827.0 [2024-08-06 04:07:20,764][52658] Sum rewards: 80.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.045', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.148', 'weapon4': '0.172', 'weapon2': '0.208', 'AMMO4': '0.214', 'AMMO3': '0.259', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '70.000'} [2024-08-06 04:07:21,597][52795] DAMAGECOUNT value on done: 444683.0 [2024-08-06 04:07:21,597][52795] Sum rewards: 62.478, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.140', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'weapon2': '0.342', 'WEAPON3': '1.700', 'HITCOUNT': '3.090', 'weapon3': '3.230', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '56.000'} [2024-08-06 04:07:21,718][52665] DAMAGECOUNT value on done: 484294.0 [2024-08-06 04:07:21,719][52665] Sum rewards: 68.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.150', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '56.500'} [2024-08-06 04:07:22,237][52794] DAMAGECOUNT value on done: 490541.0 [2024-08-06 04:07:22,239][52794] Sum rewards: 67.119, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.813', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.154', 'AMMO4': '0.157', 'weapon5': '0.158', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.862', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '53.500'} [2024-08-06 04:07:22,575][52660] DAMAGECOUNT value on done: 480292.0 [2024-08-06 04:07:22,577][52660] Sum rewards: 72.014, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 418021376. Throughput: 0: 4394.7. Samples: 104508820. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:07:22,794][52567] Avg episode reward: [(0, '71.102')] [2024-08-06 04:07:23,386][52647] DAMAGECOUNT value on done: 517981.0 [2024-08-06 04:07:23,388][52647] Sum rewards: 72.042, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.214', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:23,898][52820] DAMAGECOUNT value on done: 447251.0 [2024-08-06 04:07:23,901][52820] Sum rewards: 88.083, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.088', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.760', 'FRAGCOUNT': '74.000'} [2024-08-06 04:07:24,426][52665] DAMAGECOUNT value on done: 479011.0 [2024-08-06 04:07:24,429][52665] Sum rewards: 68.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.667', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.122', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:24,463][52650] Updated weights for policy 0, policy_version 51031 (0.0032) [2024-08-06 04:07:24,795][52795] DAMAGECOUNT value on done: 441962.0 [2024-08-06 04:07:24,795][52795] Sum rewards: 60.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.190', 'AMMO3': '0.198', 'weapon4': '0.232', 'AMMO4': '0.235', 'weapon2': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.012', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '51.000'} [2024-08-06 04:07:24,910][52794] DAMAGECOUNT value on done: 488767.0 [2024-08-06 04:07:24,911][52794] Sum rewards: 70.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.270', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:25,391][52660] DAMAGECOUNT value on done: 481929.0 [2024-08-06 04:07:25,393][52660] Sum rewards: 72.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.395', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.174', 'AMMO4': '0.190', 'AMMO3': '0.226', 'weapon2': '0.280', 'WEAPON5': '0.400', 'weapon4': '0.594', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.668', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:26,019][52664] DAMAGECOUNT value on done: 503473.0 [2024-08-06 04:07:26,020][52664] Sum rewards: 70.213, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.562', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.124', 'weapon4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.650', 'weapon3': '3.016', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '62.000'} [2024-08-06 04:07:26,243][52647] DAMAGECOUNT value on done: 516984.0 [2024-08-06 04:07:26,244][52647] Sum rewards: 78.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.406', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.118', 'AMMO4': '0.126', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.424', 'FRAGCOUNT': '63.000'} [2024-08-06 04:07:27,104][52820] DAMAGECOUNT value on done: 447674.0 [2024-08-06 04:07:27,105][52820] Sum rewards: 68.453, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.176', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon2': '0.176', 'weapon4': '0.178', 'weapon5': '0.180', 'AMMO4': '0.196', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.220', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:27,499][52665] DAMAGECOUNT value on done: 476158.0 [2024-08-06 04:07:27,500][52665] Sum rewards: 65.516, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.630', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.118', 'weapon5': '0.136', 'weapon2': '0.198', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.311', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '3.210', 'weapon3': '3.280', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:27,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 418103296. Throughput: 0: 4380.9. Samples: 104534350. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:07:27,795][52567] Avg episode reward: [(0, '71.211')] [2024-08-06 04:07:28,072][52794] DAMAGECOUNT value on done: 481667.0 [2024-08-06 04:07:28,073][52794] Sum rewards: 78.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.306', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '62.000'} [2024-08-06 04:07:28,093][52795] DAMAGECOUNT value on done: 450586.0 [2024-08-06 04:07:28,096][52795] Sum rewards: 72.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.021', 'AMMO2': '0.048', 'AMMO3': '0.204', 'weapon4': '0.234', 'AMMO4': '0.238', 'weapon5': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.604', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:28,223][52659] DAMAGECOUNT value on done: 487267.0 [2024-08-06 04:07:28,224][52659] Sum rewards: 67.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.998', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.156', 'weapon5': '0.240', 'AMMO4': '0.256', 'weapon2': '0.290', 'WEAPON5': '0.400', 'weapon4': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '54.000'} [2024-08-06 04:07:28,289][52660] DAMAGECOUNT value on done: 475301.0 [2024-08-06 04:07:28,291][52660] Sum rewards: 67.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.360', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.323', 'weapon2': '0.470', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:28,763][52650] Updated weights for policy 0, policy_version 51041 (0.0021) [2024-08-06 04:07:28,930][52664] DAMAGECOUNT value on done: 509332.0 [2024-08-06 04:07:28,933][52664] Sum rewards: 73.714, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.108', 'AMMO3': '0.136', 'AMMO4': '0.217', 'weapon5': '0.226', 'HEALTH': '0.351', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.534', 'WEAPON3': '0.800', 'weapon3': '2.894', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:29,098][52647] DAMAGECOUNT value on done: 513288.0 [2024-08-06 04:07:29,100][52647] Sum rewards: 69.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.147', 'weapon4': '0.184', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '55.000'} [2024-08-06 04:07:29,369][52664] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:07:30,246][52820] DAMAGECOUNT value on done: 450620.0 [2024-08-06 04:07:30,248][52820] Sum rewards: 75.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.082', 'weapon5': '0.146', 'AMMO3': '0.197', 'AMMO4': '0.209', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '62.000'} [2024-08-06 04:07:30,558][52665] DAMAGECOUNT value on done: 479232.0 [2024-08-06 04:07:30,558][52665] Sum rewards: 62.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.102', 'AMMO4': '0.186', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.208', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '53.000'} [2024-08-06 04:07:30,730][52794] DAMAGECOUNT value on done: 483558.0 [2024-08-06 04:07:30,732][52794] Sum rewards: 79.323, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.405', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.076', 'weapon5': '0.098', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.374', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '67.000'} [2024-08-06 04:07:31,245][52795] DAMAGECOUNT value on done: 439931.0 [2024-08-06 04:07:31,248][52795] Sum rewards: 75.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'weapon2': '0.238', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.598', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '64.000'} [2024-08-06 04:07:31,295][52659] DAMAGECOUNT value on done: 485233.0 [2024-08-06 04:07:31,296][52659] Sum rewards: 70.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.726', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon5': '0.170', 'AMMO3': '0.220', 'weapon4': '0.248', 'AMMO4': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:31,360][52664] DAMAGECOUNT value on done: 507647.0 [2024-08-06 04:07:31,360][52664] Sum rewards: 79.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.635', 'AMMO2': '0.007', 'AMMO4': '0.034', 'AMMO3': '0.233', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.418', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '66.000'} [2024-08-06 04:07:31,641][52647] DAMAGECOUNT value on done: 510588.0 [2024-08-06 04:07:31,642][52647] Sum rewards: 68.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.559', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.080', 'weapon5': '0.090', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.250', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 418185216. Throughput: 0: 4373.6. Samples: 104547380. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:07:32,794][52567] Avg episode reward: [(0, '71.409')] [2024-08-06 04:07:33,399][52820] DAMAGECOUNT value on done: 442282.0 [2024-08-06 04:07:33,402][52820] Sum rewards: 56.425, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.332', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.275', 'weapon2': '0.292', 'WEAPON3': '1.650', 'HITCOUNT': '3.040', 'weapon3': '3.148', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '50.000'} [2024-08-06 04:07:33,433][52650] Updated weights for policy 0, policy_version 51051 (0.0026) [2024-08-06 04:07:33,564][52794] DAMAGECOUNT value on done: 486111.0 [2024-08-06 04:07:33,564][52794] Sum rewards: 71.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.882', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.086', 'AMMO4': '0.194', 'weapon5': '0.198', 'AMMO3': '0.232', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:33,673][52665] DAMAGECOUNT value on done: 474506.0 [2024-08-06 04:07:33,673][52665] Sum rewards: 71.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO3': '0.168', 'AMMO4': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.704', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:33,794][52664] DAMAGECOUNT value on done: 497656.0 [2024-08-06 04:07:33,794][52664] Sum rewards: 65.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.220', 'weapon2': '0.296', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.524', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '55.000'} [2024-08-06 04:07:33,959][52647] DAMAGECOUNT value on done: 505482.0 [2024-08-06 04:07:33,959][52647] Sum rewards: 64.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.074', 'AMMO3': '0.198', 'AMMO4': '0.211', 'weapon5': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '53.000'} [2024-08-06 04:07:34,334][52795] DAMAGECOUNT value on done: 458130.0 [2024-08-06 04:07:34,335][52795] Sum rewards: 79.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.272', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.188', 'AMMO4': '0.232', 'weapon5': '0.258', 'weapon4': '0.290', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '64.000'} [2024-08-06 04:07:34,483][52659] DAMAGECOUNT value on done: 488672.0 [2024-08-06 04:07:34,484][52659] Sum rewards: 55.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.328', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.152', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.872', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '50.000'} [2024-08-06 04:07:36,298][52665] DAMAGECOUNT value on done: 477628.0 [2024-08-06 04:07:36,298][52665] Sum rewards: 77.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.658', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon5': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '62.000'} [2024-08-06 04:07:36,539][52664] DAMAGECOUNT value on done: 505759.0 [2024-08-06 04:07:36,539][52664] Sum rewards: 69.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.110', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.199', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:36,564][52820] DAMAGECOUNT value on done: 452039.0 [2024-08-06 04:07:36,567][52820] Sum rewards: 70.305, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.712', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '56.000'} [2024-08-06 04:07:36,717][52647] DAMAGECOUNT value on done: 514846.0 [2024-08-06 04:07:36,717][52647] Sum rewards: 63.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.536', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.211', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '52.000'} [2024-08-06 04:07:36,759][52794] DAMAGECOUNT value on done: 491796.0 [2024-08-06 04:07:36,759][52794] Sum rewards: 73.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.894', 'AMMO5': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO3': '0.213', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:37,272][52659] DAMAGECOUNT value on done: 484149.0 [2024-08-06 04:07:37,272][52659] Sum rewards: 67.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.098', 'AMMO4': '0.157', 'weapon5': '0.196', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:37,510][52795] DAMAGECOUNT value on done: 449976.0 [2024-08-06 04:07:37,510][52795] Sum rewards: 74.325, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.669', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 418275328. Throughput: 0: 4376.5. Samples: 104573800. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:07:37,795][52567] Avg episode reward: [(0, '70.757')] [2024-08-06 04:07:38,225][52650] Updated weights for policy 0, policy_version 51061 (0.0011) [2024-08-06 04:07:38,733][52664] DAMAGECOUNT value on done: 502833.0 [2024-08-06 04:07:38,735][52664] Sum rewards: 74.393, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.386', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon4': '0.274', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '2.926', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '63.000'} [2024-08-06 04:07:38,822][52647] DAMAGECOUNT value on done: 507861.0 [2024-08-06 04:07:38,822][52647] Sum rewards: 67.776, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.957', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.139', 'weapon5': '0.160', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '53.000'} [2024-08-06 04:07:39,475][52665] DAMAGECOUNT value on done: 474795.0 [2024-08-06 04:07:39,476][52665] Sum rewards: 64.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.154', 'weapon5': '0.160', 'AMMO3': '0.199', 'AMMO4': '0.223', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.124', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '52.000'} [2024-08-06 04:07:39,648][52820] DAMAGECOUNT value on done: 444268.0 [2024-08-06 04:07:39,649][52820] Sum rewards: 83.480, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.848', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.165', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '69.000'} [2024-08-06 04:07:39,857][52794] DAMAGECOUNT value on done: 479105.0 [2024-08-06 04:07:39,859][52794] Sum rewards: 65.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.682', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.102', 'weapon5': '0.154', 'AMMO4': '0.186', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.116', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '54.000'} [2024-08-06 04:07:39,981][52659] DAMAGECOUNT value on done: 483230.0 [2024-08-06 04:07:39,981][52659] Sum rewards: 63.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.180', 'weapon5': '0.182', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '51.000'} [2024-08-06 04:07:40,682][52795] DAMAGECOUNT value on done: 439997.0 [2024-08-06 04:07:40,682][52795] Sum rewards: 70.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.528', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.114', 'AMMO4': '0.123', 'weapon5': '0.146', 'weapon2': '0.174', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.346', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:41,306][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:07:41,548][52664] DAMAGECOUNT value on done: 501815.0 [2024-08-06 04:07:41,549][52664] Sum rewards: 72.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:41,578][52647] DAMAGECOUNT value on done: 512070.0 [2024-08-06 04:07:41,579][52647] Sum rewards: 68.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.076', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.198', 'AMMO3': '0.218', 'AMMO4': '0.232', 'weapon2': '0.240', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '57.500'} [2024-08-06 04:07:42,266][52794] DAMAGECOUNT value on done: 490188.0 [2024-08-06 04:07:42,267][52794] Sum rewards: 78.252, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO2': '0.005', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon4': '0.022', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '63.000'} [2024-08-06 04:07:42,716][52665] DAMAGECOUNT value on done: 475846.0 [2024-08-06 04:07:42,717][52665] Sum rewards: 66.730, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.875', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.128', 'weapon5': '0.198', 'AMMO4': '0.251', 'AMMO3': '0.262', 'weapon2': '0.264', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.112', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:42,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 418365440. Throughput: 0: 4379.3. Samples: 104600130. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:07:42,795][52567] Avg episode reward: [(0, '70.717')] [2024-08-06 04:07:42,857][52650] Updated weights for policy 0, policy_version 51071 (0.0012) [2024-08-06 04:07:42,889][52820] DAMAGECOUNT value on done: 447170.0 [2024-08-06 04:07:42,892][52820] Sum rewards: 72.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.108', 'AMMO4': '0.192', 'AMMO3': '0.240', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:42,967][52659] DAMAGECOUNT value on done: 486736.0 [2024-08-06 04:07:42,967][52659] Sum rewards: 71.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.080', 'AMMO4': '0.094', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:43,883][52647] DAMAGECOUNT value on done: 503316.0 [2024-08-06 04:07:43,885][52647] Sum rewards: 76.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.568', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '65.000'} [2024-08-06 04:07:43,891][52664] DAMAGECOUNT value on done: 497503.0 [2024-08-06 04:07:43,892][52664] Sum rewards: 80.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.214', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.148', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.340', 'weapon4': '0.396', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '65.000'} [2024-08-06 04:07:43,930][52795] DAMAGECOUNT value on done: 449836.0 [2024-08-06 04:07:43,933][52795] Sum rewards: 57.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.565', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.080', 'AMMO4': '0.198', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.450', 'weapon4': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '50.000'} [2024-08-06 04:07:45,203][52794] DAMAGECOUNT value on done: 486852.0 [2024-08-06 04:07:45,203][52794] Sum rewards: 81.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '65.000'} [2024-08-06 04:07:45,389][52659] DAMAGECOUNT value on done: 484786.0 [2024-08-06 04:07:45,393][52659] Sum rewards: 62.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.957', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.084', 'AMMO3': '0.210', 'weapon5': '0.216', 'AMMO4': '0.278', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.144', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 04:07:45,814][52665] DAMAGECOUNT value on done: 480625.0 [2024-08-06 04:07:45,814][52665] Sum rewards: 68.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.137', 'weapon5': '0.152', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:46,087][52820] DAMAGECOUNT value on done: 449297.0 [2024-08-06 04:07:46,087][52820] Sum rewards: 59.606, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.176', 'weapon4': '0.194', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '52.000'} [2024-08-06 04:07:46,389][52647] DAMAGECOUNT value on done: 513305.0 [2024-08-06 04:07:46,390][52647] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.290', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.468', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '56.000'} [2024-08-06 04:07:46,494][52664] DAMAGECOUNT value on done: 509159.0 [2024-08-06 04:07:46,495][52664] Sum rewards: 72.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.421', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.152', 'AMMO3': '0.206', 'weapon4': '0.214', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.000'} [2024-08-06 04:07:47,042][52795] DAMAGECOUNT value on done: 453318.0 [2024-08-06 04:07:47,042][52795] Sum rewards: 69.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.093', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'weapon4': '0.288', 'weapon5': '0.316', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '56.000'} [2024-08-06 04:07:47,706][52650] Updated weights for policy 0, policy_version 51081 (0.0014) [2024-08-06 04:07:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 418455552. Throughput: 0: 4378.9. Samples: 104613510. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:07:47,794][52567] Avg episode reward: [(0, '70.859')] [2024-08-06 04:07:48,360][52794] DAMAGECOUNT value on done: 481523.0 [2024-08-06 04:07:48,361][52794] Sum rewards: 71.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.175', 'weapon5': '0.196', 'AMMO4': '0.207', 'weapon4': '0.286', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:48,507][52659] DAMAGECOUNT value on done: 483813.0 [2024-08-06 04:07:48,510][52659] Sum rewards: 62.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.468', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.366', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '51.000'} [2024-08-06 04:07:49,178][52647] DAMAGECOUNT value on done: 508583.0 [2024-08-06 04:07:49,180][52647] Sum rewards: 71.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.062', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.118', 'AMMO4': '0.122', 'weapon5': '0.156', 'AMMO3': '0.221', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:49,213][52820] DAMAGECOUNT value on done: 447342.0 [2024-08-06 04:07:49,215][52820] Sum rewards: 78.772, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.149', 'HEALTH': '0.191', 'weapon5': '0.222', 'weapon2': '0.224', 'AMMO4': '0.279', 'weapon4': '0.458', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '0.800', 'weapon3': '2.770', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:49,306][52664] DAMAGECOUNT value on done: 500914.0 [2024-08-06 04:07:49,306][52664] Sum rewards: 83.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.553', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.160', 'AMMO3': '0.181', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '3.084', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '67.000'} [2024-08-06 04:07:50,798][52794] DAMAGECOUNT value on done: 491545.0 [2024-08-06 04:07:50,799][52794] Sum rewards: 77.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.455', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.142', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '63.000'} [2024-08-06 04:07:51,463][52659] DAMAGECOUNT value on done: 490834.0 [2024-08-06 04:07:51,466][52659] Sum rewards: 84.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.568', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.758', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '71.000'} [2024-08-06 04:07:52,164][52647] DAMAGECOUNT value on done: 517270.0 [2024-08-06 04:07:52,164][52647] Sum rewards: 75.287, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO3': '0.129', 'AMMO4': '0.132', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'weapon4': '0.318', 'WEAPON3': '0.950', 'weapon3': '3.038', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:52,311][52664] DAMAGECOUNT value on done: 510179.0 [2024-08-06 04:07:52,312][52664] Sum rewards: 68.730, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.859', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon5': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.318', 'weapon4': '0.432', 'WEAPON3': '1.000', 'weapon3': '2.812', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '54.000'} [2024-08-06 04:07:52,315][52820] DAMAGECOUNT value on done: 455597.0 [2024-08-06 04:07:52,317][52820] Sum rewards: 68.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.092', 'weapon5': '0.124', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.212', 'weapon7': '0.216', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:52,444][52650] Updated weights for policy 0, policy_version 51091 (0.0012) [2024-08-06 04:07:52,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 418545664. Throughput: 0: 4373.4. Samples: 104639440. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:07:52,794][52567] Avg episode reward: [(0, '71.382')] [2024-08-06 04:07:53,597][52794] DAMAGECOUNT value on done: 478885.0 [2024-08-06 04:07:53,597][52794] Sum rewards: 75.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.705', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.038', 'AMMO4': '0.173', 'weapon5': '0.188', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '62.000'} [2024-08-06 04:07:53,683][52649] DAMAGECOUNT value on done: 469676.0 [2024-08-06 04:07:53,688][52649] Sum rewards: 72.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.463', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.142', 'AMMO4': '0.158', 'weapon5': '0.190', 'weapon2': '0.214', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '61.000'} [2024-08-06 04:07:54,418][52659] DAMAGECOUNT value on done: 496864.0 [2024-08-06 04:07:54,421][52659] Sum rewards: 71.875, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.316', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '59.500'} [2024-08-06 04:07:55,015][52647] DAMAGECOUNT value on done: 509294.0 [2024-08-06 04:07:55,017][52647] Sum rewards: 62.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.611', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.036', 'weapon4': '0.092', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.496', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '53.500'} [2024-08-06 04:07:55,220][52664] DAMAGECOUNT value on done: 505954.0 [2024-08-06 04:07:55,220][52664] Sum rewards: 73.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.152', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.078', 'AMMO4': '0.144', 'weapon5': '0.172', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '59.000'} [2024-08-06 04:07:55,581][52820] DAMAGECOUNT value on done: 445272.0 [2024-08-06 04:07:55,582][52820] Sum rewards: 59.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.086', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.192', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '50.000'} [2024-08-06 04:07:56,547][52649] DAMAGECOUNT value on done: 463367.0 [2024-08-06 04:07:56,547][52649] Sum rewards: 76.752, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '62.000'} [2024-08-06 04:07:56,547][52811] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:07:56,672][52794] DAMAGECOUNT value on done: 497695.0 [2024-08-06 04:07:56,674][52794] Sum rewards: 66.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.168', 'weapon5': '0.174', 'AMMO3': '0.193', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '55.000'} [2024-08-06 04:07:56,879][52650] Updated weights for policy 0, policy_version 51101 (0.0015) [2024-08-06 04:07:57,281][52659] DAMAGECOUNT value on done: 483903.0 [2024-08-06 04:07:57,281][52659] Sum rewards: 58.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.762', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.110', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.460', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.064', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 04:07:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 418627584. Throughput: 0: 4369.8. Samples: 104665710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:07:57,794][52567] Avg episode reward: [(0, '70.927')] [2024-08-06 04:07:57,831][52647] DAMAGECOUNT value on done: 500596.0 [2024-08-06 04:07:57,831][52647] Sum rewards: 65.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.125', 'weapon5': '0.168', 'weapon4': '0.188', 'AMMO4': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON3': '0.800', 'weapon3': '2.892', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '52.000'} [2024-08-06 04:07:58,029][52664] DAMAGECOUNT value on done: 514052.0 [2024-08-06 04:07:58,029][52664] Sum rewards: 77.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.658', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.064', 'AMMO3': '0.155', 'AMMO4': '0.167', 'weapon5': '0.174', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.346', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 04:07:58,686][52820] DAMAGECOUNT value on done: 450668.0 [2024-08-06 04:07:58,688][52820] Sum rewards: 71.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.181', 'weapon5': '0.214', 'AMMO4': '0.236', 'weapon4': '0.268', 'weapon2': '0.414', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.000'} [2024-08-06 04:07:59,322][52649] DAMAGECOUNT value on done: 478092.0 [2024-08-06 04:07:59,322][52649] Sum rewards: 62.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.451', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.242', 'AMMO4': '0.247', 'weapon4': '0.270', 'weapon5': '0.274', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.690', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '53.500'} [2024-08-06 04:07:59,463][52659] DAMAGECOUNT value on done: 490126.0 [2024-08-06 04:07:59,463][52659] Sum rewards: 70.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.170', 'weapon2': '0.176', 'AMMO4': '0.188', 'AMMO3': '0.250', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '57.000'} [2024-08-06 04:07:59,634][52794] DAMAGECOUNT value on done: 478442.0 [2024-08-06 04:07:59,634][52794] Sum rewards: 63.408, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.290', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.102', 'weapon5': '0.138', 'AMMO4': '0.167', 'weapon2': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.312', 'WEAPON3': '1.900', 'HITCOUNT': '3.110', 'weapon3': '3.266', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:01,120][52647] DAMAGECOUNT value on done: 507311.0 [2024-08-06 04:08:01,121][52647] Sum rewards: 66.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.785', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.219', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.294', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:01,297][52664] DAMAGECOUNT value on done: 509779.0 [2024-08-06 04:08:01,300][52664] Sum rewards: 75.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.688', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon4': '0.310', 'weapon2': '0.390', 'ARMOR': '0.496', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '63.000'} [2024-08-06 04:08:01,635][52650] Updated weights for policy 0, policy_version 51111 (0.0019) [2024-08-06 04:08:01,770][52820] DAMAGECOUNT value on done: 455478.0 [2024-08-06 04:08:01,770][52820] Sum rewards: 81.634, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.138', 'AMMO3': '0.161', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '0.950', 'weapon3': '2.846', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '65.000'} [2024-08-06 04:08:02,097][52649] DAMAGECOUNT value on done: 470300.0 [2024-08-06 04:08:02,098][52649] Sum rewards: 76.008, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.030', 'HEALTH': '0.040', 'weapon5': '0.134', 'AMMO4': '0.147', 'weapon4': '0.160', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 04:08:02,506][52659] DAMAGECOUNT value on done: 479629.0 [2024-08-06 04:08:02,506][52659] Sum rewards: 62.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.172', 'AMMO3': '0.177', 'AMMO4': '0.207', 'weapon4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '50.000'} [2024-08-06 04:08:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 418717696. Throughput: 0: 4367.6. Samples: 104678870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:08:02,794][52567] Avg episode reward: [(0, '70.530')] [2024-08-06 04:08:02,804][52794] DAMAGECOUNT value on done: 495958.0 [2024-08-06 04:08:02,806][52794] Sum rewards: 67.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.903', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.196', 'weapon5': '0.198', 'AMMO4': '0.246', 'weapon4': '0.264', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:03,582][52647] DAMAGECOUNT value on done: 505779.0 [2024-08-06 04:08:03,583][52647] Sum rewards: 74.266, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.108', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.126', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'weapon2': '0.312', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '66.000'} [2024-08-06 04:08:03,864][52664] DAMAGECOUNT value on done: 509287.0 [2024-08-06 04:08:03,865][52664] Sum rewards: 74.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.159', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.148', 'weapon4': '0.148', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '1.000', 'weapon3': '3.298', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '59.000'} [2024-08-06 04:08:04,830][52649] DAMAGECOUNT value on done: 463261.0 [2024-08-06 04:08:04,830][52649] Sum rewards: 66.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.275', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon5': '0.222', 'AMMO4': '0.239', 'weapon2': '0.250', 'AMMO3': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.090', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:04,835][52667] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:08:04,966][52820] DAMAGECOUNT value on done: 450008.0 [2024-08-06 04:08:04,967][52820] Sum rewards: 64.477, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.452', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.138', 'weapon5': '0.180', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '55.000'} [2024-08-06 04:08:05,206][52659] DAMAGECOUNT value on done: 486862.0 [2024-08-06 04:08:05,208][52659] Sum rewards: 70.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.636', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.446', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '59.000'} [2024-08-06 04:08:05,834][52794] DAMAGECOUNT value on done: 486161.0 [2024-08-06 04:08:05,834][52794] Sum rewards: 64.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.174', 'weapon5': '0.190', 'AMMO4': '0.253', 'AMMO3': '0.285', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.026', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:06,321][52650] Updated weights for policy 0, policy_version 51121 (0.0012) [2024-08-06 04:08:06,627][52647] DAMAGECOUNT value on done: 505977.0 [2024-08-06 04:08:06,627][52647] Sum rewards: 69.852, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.076', 'AMMO3': '0.198', 'weapon5': '0.232', 'AMMO4': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:06,851][52664] DAMAGECOUNT value on done: 502730.0 [2024-08-06 04:08:06,851][52664] Sum rewards: 89.019, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.022', 'HEALTH': '0.089', 'weapon4': '0.106', 'AMMO4': '0.111', 'weapon5': '0.138', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '72.000'} [2024-08-06 04:08:07,025][52663] DAMAGECOUNT value on done: 492949.0 [2024-08-06 04:08:07,025][52663] Sum rewards: 74.811, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.555', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.145', 'weapon5': '0.152', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:07,599][52649] DAMAGECOUNT value on done: 476053.0 [2024-08-06 04:08:07,599][52649] Sum rewards: 76.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.858', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.009', 'weapon4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.148', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.826', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17613.0, 300 sec: 17522.5). Total num frames: 418807808. Throughput: 0: 4365.1. Samples: 104705250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:08:07,794][52567] Avg episode reward: [(0, '70.863')] [2024-08-06 04:08:07,961][52794] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:08:08,161][52820] DAMAGECOUNT value on done: 455526.0 [2024-08-06 04:08:08,162][52820] Sum rewards: 67.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.517', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon5': '0.154', 'AMMO3': '0.158', 'AMMO4': '0.277', 'weapon4': '0.388', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.562', 'WEAPON3': '0.950', 'weapon3': '2.636', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '52.500'} [2024-08-06 04:08:08,383][52794] DAMAGECOUNT value on done: 491001.0 [2024-08-06 04:08:08,383][52794] Sum rewards: 77.037, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.155', 'weapon4': '0.162', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '65.000'} [2024-08-06 04:08:08,437][52659] DAMAGECOUNT value on done: 497140.0 [2024-08-06 04:08:08,440][52659] Sum rewards: 70.186, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.128', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.830', 'WEAPON3': '0.900', 'weapon3': '2.888', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 04:08:09,001][52666] DAMAGECOUNT value on done: 482516.0 [2024-08-06 04:08:09,003][52666] Sum rewards: 57.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.275', 'weapon2': '0.280', 'weapon4': '0.298', 'weapon5': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.778', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '49.000'} [2024-08-06 04:08:09,249][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:08:09,752][52663] DAMAGECOUNT value on done: 487135.0 [2024-08-06 04:08:09,755][52663] Sum rewards: 68.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon2': '0.164', 'AMMO3': '0.182', 'weapon4': '0.196', 'AMMO4': '0.240', 'weapon5': '0.264', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.158', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:10,037][52664] DAMAGECOUNT value on done: 501832.0 [2024-08-06 04:08:10,041][52664] Sum rewards: 69.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.416', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.054', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.668', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '55.500'} [2024-08-06 04:08:10,136][52649] DAMAGECOUNT value on done: 470889.0 [2024-08-06 04:08:10,136][52649] Sum rewards: 66.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.424', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '56.500'} [2024-08-06 04:08:11,049][52650] Updated weights for policy 0, policy_version 51131 (0.0025) [2024-08-06 04:08:11,178][52659] DAMAGECOUNT value on done: 492916.0 [2024-08-06 04:08:11,180][52659] Sum rewards: 70.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.134', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.038', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:11,231][52820] DAMAGECOUNT value on done: 450410.0 [2024-08-06 04:08:11,236][52820] Sum rewards: 77.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.522', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.120', 'weapon5': '0.170', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '66.000'} [2024-08-06 04:08:11,441][52794] DAMAGECOUNT value on done: 493238.0 [2024-08-06 04:08:11,441][52794] Sum rewards: 77.066, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.675', 'AMMO5': '0.019', 'AMMO2': '0.059', 'AMMO3': '0.209', 'weapon5': '0.262', 'weapon4': '0.280', 'AMMO4': '0.293', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.632', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '65.000'} [2024-08-06 04:08:11,992][52666] DAMAGECOUNT value on done: 486882.0 [2024-08-06 04:08:11,992][52666] Sum rewards: 71.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.955', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.180', 'AMMO4': '0.199', 'weapon4': '0.214', 'AMMO3': '0.231', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '62.000'} [2024-08-06 04:08:12,420][52663] DAMAGECOUNT value on done: 480824.0 [2024-08-06 04:08:12,423][52663] Sum rewards: 68.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.205', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:12,680][52670] DAMAGECOUNT value on done: 475776.0 [2024-08-06 04:08:12,680][52670] Sum rewards: 78.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '66.000'} [2024-08-06 04:08:12,798][52567] Fps is (10 sec: 17195.7, 60 sec: 17475.0, 300 sec: 17494.5). Total num frames: 418889728. Throughput: 0: 4384.7. Samples: 104731680. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:08:12,799][52567] Avg episode reward: [(0, '70.786')] [2024-08-06 04:08:12,823][52664] DAMAGECOUNT value on done: 506022.0 [2024-08-06 04:08:12,827][52664] Sum rewards: 78.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.349', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.434', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '66.000'} [2024-08-06 04:08:13,332][52649] DAMAGECOUNT value on done: 475995.0 [2024-08-06 04:08:13,334][52649] Sum rewards: 76.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.070', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '63.000'} [2024-08-06 04:08:13,966][52659] DAMAGECOUNT value on done: 490223.0 [2024-08-06 04:08:13,967][52659] Sum rewards: 77.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.335', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 04:08:14,208][52794] DAMAGECOUNT value on done: 484362.0 [2024-08-06 04:08:14,209][52794] Sum rewards: 79.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.140', 'AMMO4': '0.185', 'AMMO3': '0.216', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '66.000'} [2024-08-06 04:08:14,246][52820] DAMAGECOUNT value on done: 450018.0 [2024-08-06 04:08:14,247][52820] Sum rewards: 67.006, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.505', 'AMMO5': '0.017', 'AMMO2': '0.061', 'AMMO3': '0.205', 'weapon5': '0.226', 'AMMO4': '0.305', 'weapon4': '0.412', 'WEAPON5': '0.500', 'weapon2': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.550', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '53.000'} [2024-08-06 04:08:14,988][52666] DAMAGECOUNT value on done: 489849.0 [2024-08-06 04:08:14,988][52666] Sum rewards: 68.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.575', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.134', 'weapon5': '0.136', 'AMMO4': '0.169', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:15,156][52663] DAMAGECOUNT value on done: 483978.0 [2024-08-06 04:08:15,156][52663] Sum rewards: 74.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.396', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.130', 'weapon4': '0.168', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:15,557][52650] Updated weights for policy 0, policy_version 51141 (0.0021) [2024-08-06 04:08:15,716][52649] DAMAGECOUNT value on done: 476098.0 [2024-08-06 04:08:15,718][52649] Sum rewards: 62.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.076', 'AMMO3': '0.162', 'weapon5': '0.176', 'AMMO4': '0.205', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '51.000'} [2024-08-06 04:08:15,797][52670] DAMAGECOUNT value on done: 488551.0 [2024-08-06 04:08:15,797][52670] Sum rewards: 62.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.688', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.182', 'weapon5': '0.198', 'AMMO4': '0.286', 'weapon4': '0.358', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.650', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '52.000'} [2024-08-06 04:08:15,939][52664] DAMAGECOUNT value on done: 503498.0 [2024-08-06 04:08:15,940][52664] Sum rewards: 74.206, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.170', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.096', 'weapon5': '0.166', 'AMMO4': '0.226', 'AMMO3': '0.273', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '63.000'} [2024-08-06 04:08:16,914][52659] DAMAGECOUNT value on done: 486316.0 [2024-08-06 04:08:16,917][52659] Sum rewards: 76.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.096', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '64.500'} [2024-08-06 04:08:17,303][52820] DAMAGECOUNT value on done: 461879.0 [2024-08-06 04:08:17,303][52820] Sum rewards: 71.297, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.210', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.100', 'AMMO4': '0.115', 'weapon5': '0.122', 'WEAPON4': '0.250', 'weapon2': '0.252', 'AMMO3': '0.278', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.216', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '63.000'} [2024-08-06 04:08:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 418979840. Throughput: 0: 4385.1. Samples: 104744710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:08:17,794][52567] Avg episode reward: [(0, '70.958')] [2024-08-06 04:08:17,803][52666] DAMAGECOUNT value on done: 487784.0 [2024-08-06 04:08:17,805][52666] Sum rewards: 73.278, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.465', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.080', 'weapon5': '0.090', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.358', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '62.000'} [2024-08-06 04:08:17,847][52663] DAMAGECOUNT value on done: 484885.0 [2024-08-06 04:08:17,850][52663] Sum rewards: 59.397, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'HEALTH': '0.227', 'weapon2': '0.334', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '3.490', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '49.000'} [2024-08-06 04:08:18,553][52649] DAMAGECOUNT value on done: 470103.0 [2024-08-06 04:08:18,554][52649] Sum rewards: 60.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.890', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.056', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.236', 'AMMO3': '0.272', 'WEAPON3': '1.800', 'weapon3': '3.254', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '54.000'} [2024-08-06 04:08:18,608][52670] DAMAGECOUNT value on done: 480060.0 [2024-08-06 04:08:18,613][52670] Sum rewards: 55.800, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.857', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon2': '0.188', 'weapon5': '0.214', 'weapon4': '0.256', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '3.050', 'weapon3': '3.080', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '50.000'} [2024-08-06 04:08:19,083][52664] DAMAGECOUNT value on done: 501887.0 [2024-08-06 04:08:19,083][52664] Sum rewards: 81.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.655', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.168', 'weapon5': '0.188', 'AMMO4': '0.190', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '64.000'} [2024-08-06 04:08:19,429][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:08:19,461][52614] Signal inference workers to stop experience collection... (9300 times) [2024-08-06 04:08:19,465][52614] Signal inference workers to resume experience collection... (9300 times) [2024-08-06 04:08:19,543][52650] InferenceWorker_p0-w0: stopping experience collection (9300 times) [2024-08-06 04:08:19,543][52650] InferenceWorker_p0-w0: resuming experience collection (9300 times) [2024-08-06 04:08:20,044][52659] DAMAGECOUNT value on done: 488645.0 [2024-08-06 04:08:20,047][52659] Sum rewards: 83.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.931', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.126', 'AMMO4': '0.152', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.258', 'FRAGCOUNT': '68.000'} [2024-08-06 04:08:20,347][52650] Updated weights for policy 0, policy_version 51151 (0.0027) [2024-08-06 04:08:20,394][52663] DAMAGECOUNT value on done: 489848.0 [2024-08-06 04:08:20,395][52663] Sum rewards: 83.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.491', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.154', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'weapon4': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '67.000'} [2024-08-06 04:08:20,410][52666] DAMAGECOUNT value on done: 485969.0 [2024-08-06 04:08:20,411][52666] Sum rewards: 71.769, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.056', 'HEALTH': '0.116', 'weapon5': '0.132', 'AMMO4': '0.148', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:20,476][52820] DAMAGECOUNT value on done: 460019.0 [2024-08-06 04:08:20,477][52820] Sum rewards: 69.070, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.240', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.119', 'weapon5': '0.138', 'AMMO4': '0.174', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '0.800', 'weapon3': '3.102', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '55.000'} [2024-08-06 04:08:20,801][52649] DAMAGECOUNT value on done: 478577.0 [2024-08-06 04:08:20,801][52649] Sum rewards: 64.973, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.746', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '54.000'} [2024-08-06 04:08:20,947][52670] DAMAGECOUNT value on done: 478962.0 [2024-08-06 04:08:20,948][52670] Sum rewards: 58.369, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.856', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon7': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.134', 'AMMO4': '0.152', 'weapon2': '0.246', 'weapon4': '0.252', 'WEAPON5': '0.300', 'AMMO3': '0.311', 'WEAPON4': '0.350', 'WEAPON3': '1.900', 'weapon3': '2.902', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '53.000'} [2024-08-06 04:08:22,794][52567] Fps is (10 sec: 18030.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 419069952. Throughput: 0: 4383.3. Samples: 104771050. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:08:22,794][52567] Avg episode reward: [(0, '70.950')] [2024-08-06 04:08:22,894][52659] DAMAGECOUNT value on done: 489601.0 [2024-08-06 04:08:22,902][52659] Sum rewards: 76.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.080', 'AMMO4': '0.138', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '63.500'} [2024-08-06 04:08:22,981][52663] DAMAGECOUNT value on done: 486073.0 [2024-08-06 04:08:22,982][52663] Sum rewards: 65.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.639', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.158', 'weapon4': '0.198', 'AMMO4': '0.252', 'weapon5': '0.252', 'weapon2': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.048', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '53.000'} [2024-08-06 04:08:23,269][52649] DAMAGECOUNT value on done: 483063.0 [2024-08-06 04:08:23,270][52649] Sum rewards: 73.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.080', 'weapon4': '0.124', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:23,486][52666] DAMAGECOUNT value on done: 480068.0 [2024-08-06 04:08:23,488][52666] Sum rewards: 68.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.210', 'AMMO3': '0.212', 'weapon2': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:23,633][52820] DAMAGECOUNT value on done: 447567.0 [2024-08-06 04:08:23,638][52820] Sum rewards: 79.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.587', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.116', 'weapon5': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '64.000'} [2024-08-06 04:08:24,266][52670] DAMAGECOUNT value on done: 490959.0 [2024-08-06 04:08:24,268][52670] Sum rewards: 72.315, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.033', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.143', 'weapon5': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '62.000'} [2024-08-06 04:08:24,845][52650] Updated weights for policy 0, policy_version 51161 (0.0023) [2024-08-06 04:08:25,484][52663] DAMAGECOUNT value on done: 480778.0 [2024-08-06 04:08:25,485][52663] Sum rewards: 72.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.068', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.188', 'weapon2': '0.346', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:26,177][52666] DAMAGECOUNT value on done: 483339.0 [2024-08-06 04:08:26,177][52666] Sum rewards: 68.165, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.125', 'weapon5': '0.156', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:26,337][52649] DAMAGECOUNT value on done: 484500.0 [2024-08-06 04:08:26,339][52649] Sum rewards: 74.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.404', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.118', 'weapon4': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '63.000'} [2024-08-06 04:08:26,835][52670] DAMAGECOUNT value on done: 485372.0 [2024-08-06 04:08:26,835][52670] Sum rewards: 78.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.256', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.686', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '66.000'} [2024-08-06 04:08:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 419160064. Throughput: 0: 4392.7. Samples: 104797800. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:08:27,794][52567] Avg episode reward: [(0, '71.170')] [2024-08-06 04:08:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051167_419160064.pth... [2024-08-06 04:08:27,926][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050654_414957568.pth [2024-08-06 04:08:28,423][52663] DAMAGECOUNT value on done: 479803.0 [2024-08-06 04:08:28,434][52663] Sum rewards: 70.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.106', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.332', 'WEAPON3': '1.100', 'HITCOUNT': '3.310', 'weapon3': '3.456', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:29,238][52649] DAMAGECOUNT value on done: 479273.0 [2024-08-06 04:08:29,240][52649] Sum rewards: 72.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.414', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.138', 'AMMO4': '0.172', 'weapon5': '0.208', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:29,282][52666] DAMAGECOUNT value on done: 484099.0 [2024-08-06 04:08:29,283][52666] Sum rewards: 64.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.804', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.111', 'weapon5': '0.128', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:29,585][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:08:29,811][52650] Updated weights for policy 0, policy_version 51171 (0.0012) [2024-08-06 04:08:30,022][52670] DAMAGECOUNT value on done: 475258.0 [2024-08-06 04:08:30,025][52670] Sum rewards: 66.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.254', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.166', 'AMMO3': '0.216', 'weapon4': '0.264', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '55.000'} [2024-08-06 04:08:30,028][52663] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0)] [2024-08-06 04:08:31,007][52663] DAMAGECOUNT value on done: 487828.0 [2024-08-06 04:08:31,007][52663] Sum rewards: 68.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.096', 'AMMO4': '0.188', 'AMMO3': '0.223', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.802', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:31,789][52649] DAMAGECOUNT value on done: 468779.0 [2024-08-06 04:08:31,789][52649] Sum rewards: 72.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.218', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon2': '0.190', 'AMMO3': '0.220', 'weapon4': '0.242', 'AMMO4': '0.248', 'weapon5': '0.248', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:32,430][52666] DAMAGECOUNT value on done: 482784.0 [2024-08-06 04:08:32,432][52666] Sum rewards: 73.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.178', 'AMMO4': '0.232', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 419241984. Throughput: 0: 4380.2. Samples: 104810620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:08:32,794][52567] Avg episode reward: [(0, '71.007')] [2024-08-06 04:08:33,152][52670] DAMAGECOUNT value on done: 482560.0 [2024-08-06 04:08:33,154][52670] Sum rewards: 76.171, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.106', 'weapon4': '0.134', 'AMMO4': '0.153', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'HEALTH': '0.412', 'WEAPON3': '1.000', 'weapon3': '3.182', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '64.000'} [2024-08-06 04:08:33,431][52663] DAMAGECOUNT value on done: 494444.0 [2024-08-06 04:08:33,432][52663] Sum rewards: 73.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.974', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.108', 'weapon2': '0.146', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:34,322][52650] Updated weights for policy 0, policy_version 51181 (0.0012) [2024-08-06 04:08:34,757][52649] DAMAGECOUNT value on done: 479094.0 [2024-08-06 04:08:34,757][52649] Sum rewards: 67.460, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.762', 'AMMO5': '0.022', 'AMMO2': '0.068', 'weapon4': '0.120', 'weapon5': '0.208', 'weapon2': '0.250', 'AMMO3': '0.290', 'AMMO4': '0.342', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.750', 'weapon3': '3.094', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:35,521][52666] DAMAGECOUNT value on done: 476774.0 [2024-08-06 04:08:35,521][52666] Sum rewards: 70.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.711', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.143', 'weapon4': '0.176', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:36,108][52670] DAMAGECOUNT value on done: 481781.0 [2024-08-06 04:08:36,108][52670] Sum rewards: 66.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.090', 'AMMO4': '0.167', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:36,224][52663] DAMAGECOUNT value on done: 483197.0 [2024-08-06 04:08:36,226][52663] Sum rewards: 72.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.668', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.060', 'weapon5': '0.096', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:37,793][52649] DAMAGECOUNT value on done: 466452.0 [2024-08-06 04:08:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 419332096. Throughput: 0: 4393.8. Samples: 104837160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:08:37,794][52567] Avg episode reward: [(0, '71.244')] [2024-08-06 04:08:37,795][52649] Sum rewards: 67.487, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.895', 'AMMO5': '0.029', 'AMMO2': '0.065', 'AMMO3': '0.250', 'weapon5': '0.250', 'weapon4': '0.262', 'AMMO4': '0.323', 'weapon2': '0.372', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.772', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:38,339][52666] DAMAGECOUNT value on done: 481448.0 [2024-08-06 04:08:38,347][52666] Sum rewards: 76.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.564', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO3': '0.186', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:38,782][52663] DAMAGECOUNT value on done: 480390.0 [2024-08-06 04:08:38,782][52663] Sum rewards: 73.520, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.930', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.145', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.780', 'WEAPON3': '0.950', 'weapon3': '2.542', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:39,002][52650] Updated weights for policy 0, policy_version 51191 (0.0025) [2024-08-06 04:08:39,064][52670] DAMAGECOUNT value on done: 478264.0 [2024-08-06 04:08:39,065][52670] Sum rewards: 71.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.440', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.388', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:39,268][52667] DAMAGECOUNT value on done: 485237.0 [2024-08-06 04:08:39,271][52667] Sum rewards: 77.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.092', 'WEAPON4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.195', 'WEAPON3': '1.300', 'HITCOUNT': '3.560', 'weapon3': '3.580', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '63.000'} [2024-08-06 04:08:40,954][52666] DAMAGECOUNT value on done: 478219.0 [2024-08-06 04:08:40,954][52666] Sum rewards: 64.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.462', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.096', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:40,967][52649] DAMAGECOUNT value on done: 479615.0 [2024-08-06 04:08:40,967][52649] Sum rewards: 70.248, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'weapon5': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.324', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:41,609][52670] DAMAGECOUNT value on done: 483920.0 [2024-08-06 04:08:41,610][52670] Sum rewards: 68.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.325', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.150', 'AMMO4': '0.207', 'weapon5': '0.210', 'weapon2': '0.214', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '58.500'} [2024-08-06 04:08:41,706][52663] DAMAGECOUNT value on done: 480096.0 [2024-08-06 04:08:41,707][52663] Sum rewards: 83.958, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.966', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.056', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '70.000'} [2024-08-06 04:08:42,283][52667] DAMAGECOUNT value on done: 495236.0 [2024-08-06 04:08:42,284][52667] Sum rewards: 60.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.012', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.514', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.290', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '51.000'} [2024-08-06 04:08:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 419422208. Throughput: 0: 4394.9. Samples: 104863480. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:08:42,794][52567] Avg episode reward: [(0, '70.943')] [2024-08-06 04:08:43,462][52650] Updated weights for policy 0, policy_version 51201 (0.0053) [2024-08-06 04:08:43,476][52660] Large shaping reward 2.510 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.459, 153.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:08:43,867][52666] DAMAGECOUNT value on done: 492801.0 [2024-08-06 04:08:43,870][52666] Sum rewards: 70.133, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.368', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.150', 'weapon4': '0.166', 'AMMO4': '0.175', 'weapon5': '0.222', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '2.936', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:44,019][52649] DAMAGECOUNT value on done: 481507.0 [2024-08-06 04:08:44,023][52649] Sum rewards: 63.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.124', 'weapon5': '0.188', 'AMMO4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '3.096', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '54.000'} [2024-08-06 04:08:44,546][52663] DAMAGECOUNT value on done: 480547.0 [2024-08-06 04:08:44,546][52663] Sum rewards: 69.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.195', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.169', 'weapon5': '0.232', 'AMMO4': '0.277', 'weapon4': '0.294', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.712', 'WEAPON3': '1.050', 'weapon3': '2.422', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:44,567][52670] DAMAGECOUNT value on done: 474386.0 [2024-08-06 04:08:44,568][52670] Sum rewards: 56.670, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.898', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.124', 'weapon5': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '2.740', 'weapon3': '3.228', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '53.000'} [2024-08-06 04:08:44,956][52667] DAMAGECOUNT value on done: 484591.0 [2024-08-06 04:08:44,956][52667] Sum rewards: 73.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.817', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.170', 'weapon2': '0.198', 'weapon5': '0.200', 'AMMO3': '0.223', 'AMMO4': '0.223', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '62.000'} [2024-08-06 04:08:46,854][52666] DAMAGECOUNT value on done: 486143.0 [2024-08-06 04:08:46,856][52666] Sum rewards: 68.412, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.245', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.162', 'AMMO4': '0.223', 'weapon5': '0.266', 'weapon2': '0.346', 'weapon4': '0.398', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '55.000'} [2024-08-06 04:08:46,989][52649] DAMAGECOUNT value on done: 474118.0 [2024-08-06 04:08:46,989][52649] Sum rewards: 75.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.967', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.436', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:47,271][52663] DAMAGECOUNT value on done: 491173.0 [2024-08-06 04:08:47,272][52663] Sum rewards: 72.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.379', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.034', 'AMMO4': '0.123', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:47,597][52670] DAMAGECOUNT value on done: 480507.0 [2024-08-06 04:08:47,597][52670] Sum rewards: 69.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.082', 'weapon5': '0.140', 'AMMO3': '0.192', 'AMMO4': '0.214', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.212', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '59.000'} [2024-08-06 04:08:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 419504128. Throughput: 0: 4394.4. Samples: 104876620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:08:47,794][52567] Avg episode reward: [(0, '70.961')] [2024-08-06 04:08:48,067][52667] DAMAGECOUNT value on done: 486634.0 [2024-08-06 04:08:48,069][52667] Sum rewards: 71.249, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.269', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:48,357][52650] Updated weights for policy 0, policy_version 51211 (0.0010) [2024-08-06 04:08:49,664][52666] DAMAGECOUNT value on done: 481626.0 [2024-08-06 04:08:49,665][52666] Sum rewards: 68.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.188', 'weapon5': '0.192', 'AMMO3': '0.229', 'weapon2': '0.246', 'AMMO4': '0.257', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 04:08:49,809][52811] DAMAGECOUNT value on done: 466109.0 [2024-08-06 04:08:49,809][52811] Sum rewards: 67.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon4': '0.210', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:50,061][52663] DAMAGECOUNT value on done: 481732.0 [2024-08-06 04:08:50,063][52663] Sum rewards: 71.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.114', 'weapon5': '0.126', 'weapon2': '0.212', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.282', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '60.000'} [2024-08-06 04:08:50,338][52670] DAMAGECOUNT value on done: 489039.0 [2024-08-06 04:08:50,339][52670] Sum rewards: 68.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.026', 'AMMO2': '0.048', 'weapon5': '0.184', 'AMMO3': '0.217', 'AMMO4': '0.242', 'weapon4': '0.252', 'weapon2': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '59.000'} [2024-08-06 04:08:50,774][52667] DAMAGECOUNT value on done: 495231.0 [2024-08-06 04:08:50,775][52667] Sum rewards: 73.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.804', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:52,652][52666] DAMAGECOUNT value on done: 482582.0 [2024-08-06 04:08:52,654][52666] Sum rewards: 67.846, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.320', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.084', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.228', 'weapon2': '0.322', 'WEAPON3': '0.950', 'weapon3': '3.216', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '53.000'} [2024-08-06 04:08:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 419594240. Throughput: 0: 4391.6. Samples: 104902870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:08:52,794][52567] Avg episode reward: [(0, '71.080')] [2024-08-06 04:08:52,851][52811] DAMAGECOUNT value on done: 448770.0 [2024-08-06 04:08:52,851][52811] Sum rewards: 66.494, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.972', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.032', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.258', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:52,918][52650] Updated weights for policy 0, policy_version 51221 (0.0012) [2024-08-06 04:08:52,960][52663] DAMAGECOUNT value on done: 490905.0 [2024-08-06 04:08:52,961][52663] Sum rewards: 68.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.457', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon4': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'weapon2': '0.372', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.444', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '57.000'} [2024-08-06 04:08:53,317][52670] DAMAGECOUNT value on done: 483676.0 [2024-08-06 04:08:53,319][52670] Sum rewards: 77.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.265', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.084', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '61.000'} [2024-08-06 04:08:53,920][52667] DAMAGECOUNT value on done: 496788.0 [2024-08-06 04:08:53,920][52667] Sum rewards: 83.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.192', 'AMMO3': '0.203', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '68.000'} [2024-08-06 04:08:55,444][52666] DAMAGECOUNT value on done: 483531.0 [2024-08-06 04:08:55,446][52666] Sum rewards: 64.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.112', 'weapon4': '0.136', 'AMMO4': '0.165', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '55.000'} [2024-08-06 04:08:55,599][52663] DAMAGECOUNT value on done: 487043.0 [2024-08-06 04:08:55,599][52663] Sum rewards: 85.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.058', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.102', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '69.000'} [2024-08-06 04:08:55,991][52811] DAMAGECOUNT value on done: 447859.0 [2024-08-06 04:08:55,991][52811] Sum rewards: 66.837, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.989', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.172', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.268', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '55.000'} [2024-08-06 04:08:56,107][52670] DAMAGECOUNT value on done: 468932.0 [2024-08-06 04:08:56,109][52670] Sum rewards: 71.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.024', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.234', 'weapon2': '0.252', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.110', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '62.000'} [2024-08-06 04:08:56,778][52667] DAMAGECOUNT value on done: 487672.0 [2024-08-06 04:08:56,780][52667] Sum rewards: 60.332, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.928', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.202', 'AMMO4': '0.207', 'weapon5': '0.218', 'AMMO3': '0.308', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.972', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '56.000'} [2024-08-06 04:08:57,595][52650] Updated weights for policy 0, policy_version 51231 (0.0028) [2024-08-06 04:08:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 419684352. Throughput: 0: 4390.4. Samples: 104929230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:08:57,794][52567] Avg episode reward: [(0, '71.087')] [2024-08-06 04:08:58,021][52666] DAMAGECOUNT value on done: 486616.0 [2024-08-06 04:08:58,023][52666] Sum rewards: 54.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.753', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.140', 'AMMO3': '0.180', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.352', 'weapon4': '0.398', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.862', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '46.000'} [2024-08-06 04:08:58,241][52663] DAMAGECOUNT value on done: 481843.0 [2024-08-06 04:08:58,243][52663] Sum rewards: 84.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.814', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.398', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '69.000'} [2024-08-06 04:08:58,788][52670] DAMAGECOUNT value on done: 480282.0 [2024-08-06 04:08:58,796][52670] Sum rewards: 74.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon2': '0.154', 'AMMO3': '0.192', 'weapon5': '0.280', 'AMMO4': '0.284', 'weapon4': '0.402', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '59.000'} [2024-08-06 04:08:58,996][52811] DAMAGECOUNT value on done: 452698.0 [2024-08-06 04:08:59,000][52811] Sum rewards: 80.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.101', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.248', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '66.000'} [2024-08-06 04:08:59,999][52667] DAMAGECOUNT value on done: 486996.0 [2024-08-06 04:08:59,999][52667] Sum rewards: 57.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.767', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.162', 'weapon5': '0.214', 'AMMO4': '0.227', 'AMMO3': '0.245', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.500', 'weapon3': '2.840', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '49.500'} [2024-08-06 04:09:00,126][52669] DAMAGECOUNT value on done: 491038.0 [2024-08-06 04:09:00,126][52669] Sum rewards: 73.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.705', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 04:09:01,022][52666] DAMAGECOUNT value on done: 471824.0 [2024-08-06 04:09:01,024][52666] Sum rewards: 67.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.925', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.119', 'weapon5': '0.134', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'weapon3': '3.294', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:01,869][52670] DAMAGECOUNT value on done: 489542.0 [2024-08-06 04:09:01,871][52670] Sum rewards: 72.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.595', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.384', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:02,088][52811] DAMAGECOUNT value on done: 455266.0 [2024-08-06 04:09:02,088][52811] Sum rewards: 67.779, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.345', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.128', 'AMMO3': '0.139', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.810', 'WEAPON3': '1.000', 'weapon3': '2.620', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '54.000'} [2024-08-06 04:09:02,446][52650] Updated weights for policy 0, policy_version 51241 (0.0027) [2024-08-06 04:09:02,576][52667] DAMAGECOUNT value on done: 493797.0 [2024-08-06 04:09:02,577][52667] Sum rewards: 77.328, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.122', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.124', 'weapon5': '0.132', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.302', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '65.000'} [2024-08-06 04:09:02,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 419766272. Throughput: 0: 4391.5. Samples: 104942330. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:09:02,796][52567] Avg episode reward: [(0, '71.024')] [2024-08-06 04:09:02,849][52669] DAMAGECOUNT value on done: 481345.0 [2024-08-06 04:09:02,851][52669] Sum rewards: 68.316, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.046', 'WEAPON5': '0.050', 'HEALTH': '0.143', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.274', 'weapon2': '0.386', 'WEAPON3': '0.950', 'weapon3': '2.974', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:03,806][52803] DAMAGECOUNT value on done: 454640.0 [2024-08-06 04:09:03,806][52803] Sum rewards: 70.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.165', 'weapon4': '0.188', 'AMMO3': '0.197', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:04,244][52666] DAMAGECOUNT value on done: 480156.0 [2024-08-06 04:09:04,244][52666] Sum rewards: 70.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.426', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.040', 'weapon4': '0.076', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:05,030][52670] DAMAGECOUNT value on done: 481237.0 [2024-08-06 04:09:05,031][52670] Sum rewards: 71.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.156', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon4': '0.190', 'AMMO3': '0.234', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:05,289][52811] DAMAGECOUNT value on done: 462049.0 [2024-08-06 04:09:05,293][52811] Sum rewards: 73.526, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.108', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.315', 'weapon4': '0.346', 'WEAPON3': '1.850', 'weapon3': '3.098', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '64.000'} [2024-08-06 04:09:05,407][52667] DAMAGECOUNT value on done: 496164.0 [2024-08-06 04:09:05,411][52667] Sum rewards: 73.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.224', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:06,025][52669] DAMAGECOUNT value on done: 493116.0 [2024-08-06 04:09:06,028][52669] Sum rewards: 71.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.158', 'weapon5': '0.196', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.592', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '58.500'} [2024-08-06 04:09:06,815][52803] DAMAGECOUNT value on done: 453033.0 [2024-08-06 04:09:06,816][52803] Sum rewards: 86.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '70.000'} [2024-08-06 04:09:07,233][52650] Updated weights for policy 0, policy_version 51251 (0.0020) [2024-08-06 04:09:07,535][52670] DAMAGECOUNT value on done: 484444.0 [2024-08-06 04:09:07,535][52670] Sum rewards: 64.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.035', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.128', 'weapon4': '0.168', 'weapon2': '0.210', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.318', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '55.000'} [2024-08-06 04:09:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 419856384. Throughput: 0: 4388.2. Samples: 104968520. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:09:07,794][52567] Avg episode reward: [(0, '71.033')] [2024-08-06 04:09:08,280][52667] DAMAGECOUNT value on done: 485237.0 [2024-08-06 04:09:08,282][52667] Sum rewards: 68.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.555', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.104', 'AMMO3': '0.211', 'AMMO4': '0.213', 'weapon4': '0.238', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:08,403][52811] DAMAGECOUNT value on done: 457250.0 [2024-08-06 04:09:08,404][52811] Sum rewards: 83.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.203', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.402', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '68.000'} [2024-08-06 04:09:09,077][52669] DAMAGECOUNT value on done: 489648.0 [2024-08-06 04:09:09,087][52669] Sum rewards: 75.477, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.203', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.052', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'weapon2': '0.362', 'WEAPON3': '0.950', 'HITCOUNT': '3.420', 'weapon3': '3.438', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:09,984][52803] DAMAGECOUNT value on done: 460302.0 [2024-08-06 04:09:09,985][52803] Sum rewards: 78.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.097', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO4': '0.101', 'weapon4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.230', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '66.000'} [2024-08-06 04:09:11,121][52667] DAMAGECOUNT value on done: 485826.0 [2024-08-06 04:09:11,121][52667] Sum rewards: 75.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.514', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.172', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.358', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '62.000'} [2024-08-06 04:09:11,494][52811] DAMAGECOUNT value on done: 455214.0 [2024-08-06 04:09:11,494][52811] Sum rewards: 70.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.312', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:11,583][52650] Updated weights for policy 0, policy_version 51261 (0.0019) [2024-08-06 04:09:11,909][52669] DAMAGECOUNT value on done: 487537.0 [2024-08-06 04:09:11,909][52669] Sum rewards: 65.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.315', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.174', 'AMMO4': '0.207', 'AMMO3': '0.235', 'weapon4': '0.248', 'weapon2': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '55.000'} [2024-08-06 04:09:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17614.0, 300 sec: 17522.6). Total num frames: 419946496. Throughput: 0: 4376.2. Samples: 104994730. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:09:12,795][52567] Avg episode reward: [(0, '70.979')] [2024-08-06 04:09:13,138][52803] DAMAGECOUNT value on done: 462059.0 [2024-08-06 04:09:13,139][52803] Sum rewards: 76.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.138', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.332', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 04:09:13,610][52667] DAMAGECOUNT value on done: 493986.0 [2024-08-06 04:09:13,610][52667] Sum rewards: 85.474, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.690', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.146', 'AMMO4': '0.147', 'weapon2': '0.234', 'AMMO3': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '73.000'} [2024-08-06 04:09:14,763][52811] DAMAGECOUNT value on done: 461206.0 [2024-08-06 04:09:14,765][52811] Sum rewards: 73.331, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.353', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.190', 'weapon5': '0.230', 'AMMO4': '0.247', 'AMMO3': '0.303', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.878', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '64.000'} [2024-08-06 04:09:15,288][52669] DAMAGECOUNT value on done: 491216.0 [2024-08-06 04:09:15,290][52669] Sum rewards: 76.733, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.062', 'weapon2': '0.184', 'AMMO3': '0.245', 'WEAPON3': '1.400', 'weapon3': '3.490', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 04:09:15,974][52667] DAMAGECOUNT value on done: 484745.0 [2024-08-06 04:09:15,975][52667] Sum rewards: 67.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.127', 'weapon5': '0.138', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.044', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:16,285][52803] DAMAGECOUNT value on done: 458396.0 [2024-08-06 04:09:16,285][52803] Sum rewards: 60.766, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.148', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.106', 'AMMO3': '0.126', 'AMMO4': '0.140', 'weapon5': '0.152', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.696', 'WEAPON3': '0.900', 'weapon3': '2.870', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '50.000'} [2024-08-06 04:09:16,719][52650] Updated weights for policy 0, policy_version 51271 (0.0013) [2024-08-06 04:09:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 420036608. Throughput: 0: 4382.9. Samples: 105007850. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:09:17,794][52567] Avg episode reward: [(0, '71.183')] [2024-08-06 04:09:17,909][52811] DAMAGECOUNT value on done: 456854.0 [2024-08-06 04:09:17,912][52811] Sum rewards: 75.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.808', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO3': '0.174', 'AMMO4': '0.175', 'weapon4': '0.256', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:18,122][52669] DAMAGECOUNT value on done: 490028.0 [2024-08-06 04:09:18,124][52669] Sum rewards: 73.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.042', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:18,808][52667] DAMAGECOUNT value on done: 491989.0 [2024-08-06 04:09:18,810][52667] Sum rewards: 67.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '55.000'} [2024-08-06 04:09:19,391][52803] DAMAGECOUNT value on done: 447776.0 [2024-08-06 04:09:19,391][52803] Sum rewards: 73.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.866', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.476', 'WEAPON3': '1.650', 'weapon3': '3.198', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '64.000'} [2024-08-06 04:09:20,737][52650] Updated weights for policy 0, policy_version 51281 (0.0016) [2024-08-06 04:09:21,079][52811] DAMAGECOUNT value on done: 455632.0 [2024-08-06 04:09:21,082][52811] Sum rewards: 68.003, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.910', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO4': '0.127', 'weapon4': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.288', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:21,343][52669] DAMAGECOUNT value on done: 488185.0 [2024-08-06 04:09:21,345][52669] Sum rewards: 68.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.125', 'AMMO4': '-0.045', 'AMMO2': '-0.009', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.157', 'weapon2': '0.878', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '57.000'} [2024-08-06 04:09:21,374][52667] DAMAGECOUNT value on done: 497328.0 [2024-08-06 04:09:21,375][52667] Sum rewards: 81.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.948', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.164', 'AMMO3': '0.183', 'AMMO4': '0.240', 'weapon2': '0.260', 'WEAPON5': '0.500', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '67.000'} [2024-08-06 04:09:21,684][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:09:22,269][52668] DAMAGECOUNT value on done: 486161.0 [2024-08-06 04:09:22,270][52668] Sum rewards: 79.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.558', 'AMMO5': '0.012', 'AMMO2': '0.049', 'AMMO3': '0.194', 'weapon5': '0.224', 'AMMO4': '0.247', 'weapon4': '0.278', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '64.000'} [2024-08-06 04:09:22,457][52803] DAMAGECOUNT value on done: 450517.0 [2024-08-06 04:09:22,457][52803] Sum rewards: 76.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.974', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.178', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '3.352', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '62.000'} [2024-08-06 04:09:22,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 420110336. Throughput: 0: 4377.3. Samples: 105034140. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:09:22,795][52567] Avg episode reward: [(0, '71.519')] [2024-08-06 04:09:24,209][52811] DAMAGECOUNT value on done: 466710.0 [2024-08-06 04:09:24,211][52811] Sum rewards: 68.807, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.134', 'weapon4': '0.144', 'weapon5': '0.146', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.588', 'WEAPON3': '0.950', 'weapon3': '2.942', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '54.500'} [2024-08-06 04:09:24,214][52667] DAMAGECOUNT value on done: 497418.0 [2024-08-06 04:09:24,215][52667] Sum rewards: 71.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.191', 'weapon5': '0.198', 'AMMO4': '0.203', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '57.000'} [2024-08-06 04:09:24,337][52669] DAMAGECOUNT value on done: 495310.0 [2024-08-06 04:09:24,338][52669] Sum rewards: 74.333, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.387', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.069', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.258', 'WEAPON3': '1.150', 'HITCOUNT': '3.220', 'weapon3': '3.468', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:25,127][52668] DAMAGECOUNT value on done: 490978.0 [2024-08-06 04:09:25,127][52668] Sum rewards: 66.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.248', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.068', 'weapon5': '0.184', 'weapon2': '0.216', 'AMMO3': '0.247', 'AMMO4': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:25,623][52803] DAMAGECOUNT value on done: 449593.0 [2024-08-06 04:09:25,623][52803] Sum rewards: 76.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.145', 'weapon5': '0.152', 'AMMO4': '0.156', 'weapon4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '0.950', 'weapon3': '3.014', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 04:09:26,044][52650] Updated weights for policy 0, policy_version 51291 (0.0038) [2024-08-06 04:09:26,183][52671] DAMAGECOUNT value on done: 492860.0 [2024-08-06 04:09:26,184][52671] Sum rewards: 72.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.262', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.100', 'AMMO4': '0.153', 'weapon5': '0.162', 'AMMO3': '0.186', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:27,365][52811] DAMAGECOUNT value on done: 454246.0 [2024-08-06 04:09:27,365][52811] Sum rewards: 71.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.142', 'weapon5': '0.146', 'AMMO4': '0.156', 'AMMO3': '0.217', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.244', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:27,395][52669] DAMAGECOUNT value on done: 487695.0 [2024-08-06 04:09:27,396][52669] Sum rewards: 80.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.201', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '65.000'} [2024-08-06 04:09:27,533][52667] DAMAGECOUNT value on done: 494081.0 [2024-08-06 04:09:27,534][52667] Sum rewards: 81.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.359', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '67.000'} [2024-08-06 04:09:27,618][52668] DAMAGECOUNT value on done: 491735.0 [2024-08-06 04:09:27,619][52668] Sum rewards: 79.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.047', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.366', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '65.000'} [2024-08-06 04:09:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 420208640. Throughput: 0: 4374.5. Samples: 105060330. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:09:27,794][52567] Avg episode reward: [(0, '71.849')] [2024-08-06 04:09:28,791][52803] DAMAGECOUNT value on done: 455648.0 [2024-08-06 04:09:28,792][52803] Sum rewards: 76.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.240', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.352', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:29,321][52671] DAMAGECOUNT value on done: 491992.0 [2024-08-06 04:09:29,322][52671] Sum rewards: 72.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.044', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.179', 'weapon5': '0.184', 'AMMO4': '0.218', 'weapon4': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:30,247][52668] DAMAGECOUNT value on done: 492195.0 [2024-08-06 04:09:30,249][52668] Sum rewards: 66.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.118', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.500'} [2024-08-06 04:09:30,324][52650] Updated weights for policy 0, policy_version 51301 (0.0015) [2024-08-06 04:09:30,408][52811] DAMAGECOUNT value on done: 454546.0 [2024-08-06 04:09:30,408][52811] Sum rewards: 75.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.570', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.172', 'AMMO4': '0.236', 'weapon5': '0.254', 'AMMO3': '0.258', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '63.000'} [2024-08-06 04:09:30,440][52669] DAMAGECOUNT value on done: 495045.0 [2024-08-06 04:09:30,442][52669] Sum rewards: 73.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.012', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.160', 'weapon2': '0.166', 'AMMO4': '0.192', 'weapon5': '0.234', 'weapon4': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.978', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:30,574][52667] DAMAGECOUNT value on done: 487671.0 [2024-08-06 04:09:30,574][52667] Sum rewards: 68.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.048', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.246', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.494', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:31,910][52803] DAMAGECOUNT value on done: 446533.0 [2024-08-06 04:09:31,911][52803] Sum rewards: 79.620, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.337', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.172', 'AMMO4': '0.198', 'weapon2': '0.206', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.312', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '67.500'} [2024-08-06 04:09:32,378][52671] DAMAGECOUNT value on done: 492684.0 [2024-08-06 04:09:32,378][52671] Sum rewards: 72.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.799', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:32,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 420298752. Throughput: 0: 4375.8. Samples: 105073530. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 04:09:32,794][52567] Avg episode reward: [(0, '72.005')] [2024-08-06 04:09:33,382][52668] DAMAGECOUNT value on done: 482097.0 [2024-08-06 04:09:33,384][52668] Sum rewards: 70.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.316', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.156', 'AMMO3': '0.180', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:33,487][52669] DAMAGECOUNT value on done: 494128.0 [2024-08-06 04:09:33,488][52669] Sum rewards: 62.856, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.893', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.608', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.246', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '50.000'} [2024-08-06 04:09:33,598][52667] DAMAGECOUNT value on done: 495417.0 [2024-08-06 04:09:33,599][52667] Sum rewards: 84.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.318', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.116', 'AMMO4': '0.173', 'weapon2': '0.174', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.404', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '71.000'} [2024-08-06 04:09:33,716][52811] DAMAGECOUNT value on done: 456128.0 [2024-08-06 04:09:33,716][52811] Sum rewards: 63.880, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon2': '0.230', 'weapon4': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '51.000'} [2024-08-06 04:09:33,941][52662] DAMAGECOUNT value on done: 493680.0 [2024-08-06 04:09:33,941][52662] Sum rewards: 75.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.138', 'AMMO3': '0.207', 'weapon5': '0.246', 'AMMO4': '0.280', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '62.000'} [2024-08-06 04:09:34,937][52803] DAMAGECOUNT value on done: 462592.0 [2024-08-06 04:09:34,937][52803] Sum rewards: 72.154, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.452', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.164', 'weapon4': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:35,216][52650] Updated weights for policy 0, policy_version 51311 (0.0023) [2024-08-06 04:09:35,386][52671] DAMAGECOUNT value on done: 491816.0 [2024-08-06 04:09:35,388][52671] Sum rewards: 78.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.132', 'weapon4': '0.144', 'AMMO4': '0.177', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '62.000'} [2024-08-06 04:09:36,158][52658] DAMAGECOUNT value on done: 487234.0 [2024-08-06 04:09:36,158][52658] Sum rewards: 84.526, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.684', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '69.000'} [2024-08-06 04:09:36,175][52669] DAMAGECOUNT value on done: 480969.0 [2024-08-06 04:09:36,177][52669] Sum rewards: 72.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:36,437][52668] DAMAGECOUNT value on done: 494072.0 [2024-08-06 04:09:36,438][52668] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.755', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.174', 'AMMO4': '0.179', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:36,562][52662] DAMAGECOUNT value on done: 495947.0 [2024-08-06 04:09:36,564][52662] Sum rewards: 67.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.942', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '57.000'} [2024-08-06 04:09:36,853][52811] DAMAGECOUNT value on done: 451621.0 [2024-08-06 04:09:36,853][52811] Sum rewards: 64.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.098', 'AMMO3': '0.193', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2024-08-06 04:09:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 420380672. Throughput: 0: 4372.2. Samples: 105099620. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 04:09:37,794][52567] Avg episode reward: [(0, '72.138')] [2024-08-06 04:09:37,997][52803] DAMAGECOUNT value on done: 457784.0 [2024-08-06 04:09:37,998][52803] Sum rewards: 72.116, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'AMMO2': '0.054', 'AMMO3': '0.167', 'weapon2': '0.198', 'weapon5': '0.212', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.634', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:38,042][52671] DAMAGECOUNT value on done: 500912.0 [2024-08-06 04:09:38,042][52671] Sum rewards: 58.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.674', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'WEAPON4': '0.300', 'weapon4': '0.478', 'weapon2': '0.572', 'WEAPON3': '0.850', 'weapon3': '2.658', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '46.000'} [2024-08-06 04:09:39,164][52669] DAMAGECOUNT value on done: 492114.0 [2024-08-06 04:09:39,167][52669] Sum rewards: 69.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.446', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.119', 'weapon5': '0.124', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:39,225][52658] DAMAGECOUNT value on done: 491262.0 [2024-08-06 04:09:39,227][52658] Sum rewards: 69.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.220', 'AMMO4': '0.234', 'weapon5': '0.258', 'WEAPON5': '0.450', 'weapon4': '0.544', 'weapon2': '0.590', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.300', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '57.000'} [2024-08-06 04:09:39,241][52668] DAMAGECOUNT value on done: 492749.0 [2024-08-06 04:09:39,243][52668] Sum rewards: 64.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.403', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.193', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '53.000'} [2024-08-06 04:09:39,561][52662] DAMAGECOUNT value on done: 493047.0 [2024-08-06 04:09:39,565][52662] Sum rewards: 58.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.725', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.251', 'weapon2': '0.420', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.244', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '50.000'} [2024-08-06 04:09:39,715][52650] Updated weights for policy 0, policy_version 51321 (0.0020) [2024-08-06 04:09:40,182][52811] DAMAGECOUNT value on done: 456172.0 [2024-08-06 04:09:40,182][52811] Sum rewards: 55.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.496', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.106', 'weapon4': '0.192', 'AMMO4': '0.213', 'AMMO3': '0.218', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.224', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '48.000'} [2024-08-06 04:09:40,616][52671] DAMAGECOUNT value on done: 491707.0 [2024-08-06 04:09:40,618][52671] Sum rewards: 75.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.686', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'weapon2': '0.192', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '64.000'} [2024-08-06 04:09:40,988][52803] DAMAGECOUNT value on done: 453946.0 [2024-08-06 04:09:40,989][52803] Sum rewards: 66.877, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.970', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.090', 'AMMO3': '0.161', 'AMMO4': '0.212', 'weapon4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '54.000'} [2024-08-06 04:09:41,623][52658] DAMAGECOUNT value on done: 493398.0 [2024-08-06 04:09:41,623][52658] Sum rewards: 60.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.384', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.178', 'AMMO4': '0.185', 'AMMO3': '0.213', 'weapon2': '0.416', 'WEAPON5': '0.500', 'weapon4': '0.520', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.610', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '51.000'} [2024-08-06 04:09:42,160][52668] DAMAGECOUNT value on done: 483153.0 [2024-08-06 04:09:42,161][52668] Sum rewards: 70.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.204', 'weapon5': '0.216', 'AMMO3': '0.222', 'AMMO4': '0.238', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:42,229][52669] DAMAGECOUNT value on done: 493429.0 [2024-08-06 04:09:42,229][52669] Sum rewards: 77.376, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.208', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.086', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon2': '0.360', 'WEAPON3': '0.950', 'weapon3': '3.340', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:42,553][52662] DAMAGECOUNT value on done: 483562.0 [2024-08-06 04:09:42,554][52662] Sum rewards: 66.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.140', 'AMMO3': '0.188', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '54.000'} [2024-08-06 04:09:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 420470784. Throughput: 0: 4368.4. Samples: 105125810. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 04:09:42,795][52567] Avg episode reward: [(0, '71.767')] [2024-08-06 04:09:43,286][52811] DAMAGECOUNT value on done: 457700.0 [2024-08-06 04:09:43,286][52811] Sum rewards: 73.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.924', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.184', 'AMMO3': '0.209', 'weapon2': '0.214', 'AMMO4': '0.228', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:43,727][52671] DAMAGECOUNT value on done: 497620.0 [2024-08-06 04:09:43,731][52671] Sum rewards: 82.418, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.832', 'AMMO5': '0.013', 'ARMOR': '0.024', 'AMMO2': '0.041', 'weapon4': '0.178', 'weapon5': '0.184', 'AMMO4': '0.207', 'AMMO3': '0.246', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '69.000'} [2024-08-06 04:09:44,032][52803] DAMAGECOUNT value on done: 459436.0 [2024-08-06 04:09:44,034][52803] Sum rewards: 83.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.235', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.400', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '71.000'} [2024-08-06 04:09:44,276][52658] DAMAGECOUNT value on done: 492819.0 [2024-08-06 04:09:44,276][52658] Sum rewards: 72.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.287', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.188', 'weapon2': '0.204', 'AMMO4': '0.229', 'weapon4': '0.322', 'weapon5': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '59.000'} [2024-08-06 04:09:44,533][52650] Updated weights for policy 0, policy_version 51331 (0.0012) [2024-08-06 04:09:44,918][52669] DAMAGECOUNT value on done: 505713.0 [2024-08-06 04:09:44,922][52669] Sum rewards: 63.895, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.422', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon5': '0.196', 'weapon4': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.232', 'weapon2': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '55.000'} [2024-08-06 04:09:45,118][52668] DAMAGECOUNT value on done: 486328.0 [2024-08-06 04:09:45,118][52668] Sum rewards: 70.341, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.249', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.312', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:45,377][52662] DAMAGECOUNT value on done: 493874.0 [2024-08-06 04:09:45,378][52662] Sum rewards: 62.857, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.172', 'AMMO3': '0.189', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.868', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '49.000'} [2024-08-06 04:09:45,689][52660] DAMAGECOUNT value on done: 489315.0 [2024-08-06 04:09:45,692][52660] Sum rewards: 75.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.188', 'AMMO3': '0.232', 'AMMO4': '0.264', 'weapon5': '0.266', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.806', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '63.000'} [2024-08-06 04:09:45,940][52659] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2024-08-06 04:09:46,514][52811] DAMAGECOUNT value on done: 453793.0 [2024-08-06 04:09:46,515][52811] Sum rewards: 50.178, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.516', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.086', 'weapon4': '0.090', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '0.950', 'HITCOUNT': '2.450', 'weapon3': '3.130', 'DAMAGECOUNT': '12.072', 'FRAGCOUNT': '40.000'} [2024-08-06 04:09:46,613][52671] DAMAGECOUNT value on done: 491905.0 [2024-08-06 04:09:46,613][52671] Sum rewards: 64.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.218', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.568', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '55.000'} [2024-08-06 04:09:47,130][52803] DAMAGECOUNT value on done: 455250.0 [2024-08-06 04:09:47,139][52803] Sum rewards: 77.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.262', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.178', 'weapon4': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '62.000'} [2024-08-06 04:09:47,365][52658] DAMAGECOUNT value on done: 482330.0 [2024-08-06 04:09:47,367][52658] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.992', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.690', 'weapon3': '3.360', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 420560896. Throughput: 0: 4372.7. Samples: 105139100. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 04:09:47,794][52567] Avg episode reward: [(0, '71.718')] [2024-08-06 04:09:47,951][52668] DAMAGECOUNT value on done: 495013.0 [2024-08-06 04:09:47,951][52668] Sum rewards: 75.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.004', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.174', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:48,168][52669] DAMAGECOUNT value on done: 494314.0 [2024-08-06 04:09:48,169][52669] Sum rewards: 74.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.396', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '62.000'} [2024-08-06 04:09:48,327][52662] DAMAGECOUNT value on done: 486871.0 [2024-08-06 04:09:48,330][52662] Sum rewards: 73.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.786', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.163', 'AMMO4': '0.176', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'weapon4': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '57.000'} [2024-08-06 04:09:48,607][52660] DAMAGECOUNT value on done: 480626.0 [2024-08-06 04:09:48,607][52660] Sum rewards: 84.728, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.842', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.094', 'AMMO4': '0.149', 'weapon5': '0.204', 'AMMO3': '0.262', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.134', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.927', 'FRAGCOUNT': '71.000'} [2024-08-06 04:09:49,271][52650] Updated weights for policy 0, policy_version 51341 (0.0013) [2024-08-06 04:09:49,426][52671] DAMAGECOUNT value on done: 487445.0 [2024-08-06 04:09:49,426][52671] Sum rewards: 70.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.188', 'weapon5': '0.208', 'AMMO4': '0.240', 'weapon4': '0.308', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 04:09:49,701][52811] DAMAGECOUNT value on done: 455757.0 [2024-08-06 04:09:49,701][52811] Sum rewards: 76.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.459', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.175', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '65.000'} [2024-08-06 04:09:50,090][52803] DAMAGECOUNT value on done: 451415.0 [2024-08-06 04:09:50,091][52803] Sum rewards: 68.136, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.514', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.008', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.112', 'weapon4': '0.222', 'weapon5': '0.280', 'weapon2': '0.400', 'WEAPON3': '0.750', 'weapon3': '2.812', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '54.000'} [2024-08-06 04:09:50,118][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:09:50,202][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:09:50,448][52658] DAMAGECOUNT value on done: 486486.0 [2024-08-06 04:09:50,449][52658] Sum rewards: 68.496, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.408', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.153', 'weapon4': '0.154', 'AMMO4': '0.175', 'weapon5': '0.176', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '53.000'} [2024-08-06 04:09:50,712][52668] DAMAGECOUNT value on done: 487987.0 [2024-08-06 04:09:50,712][52668] Sum rewards: 68.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.396', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.300', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:51,021][52662] DAMAGECOUNT value on done: 494047.0 [2024-08-06 04:09:51,023][52662] Sum rewards: 70.006, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.256', 'AMMO3': '0.266', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:51,217][52669] DAMAGECOUNT value on done: 491785.0 [2024-08-06 04:09:51,219][52669] Sum rewards: 75.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.652', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'weapon2': '0.184', 'weapon4': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.388', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '64.000'} [2024-08-06 04:09:51,283][52660] DAMAGECOUNT value on done: 491304.0 [2024-08-06 04:09:51,283][52660] Sum rewards: 60.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.122', 'AMMO4': '0.202', 'weapon5': '0.216', 'AMMO3': '0.234', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.110', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '52.000'} [2024-08-06 04:09:52,380][52671] DAMAGECOUNT value on done: 493084.0 [2024-08-06 04:09:52,389][52671] Sum rewards: 61.132, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.925', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.171', 'WEAPON3': '1.000', 'weapon2': '1.014', 'weapon3': '2.808', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '49.000'} [2024-08-06 04:09:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 420642816. Throughput: 0: 4372.7. Samples: 105165290. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 04:09:52,794][52567] Avg episode reward: [(0, '71.823')] [2024-08-06 04:09:53,077][52803] DAMAGECOUNT value on done: 459937.0 [2024-08-06 04:09:53,080][52803] Sum rewards: 68.514, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.398', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.016', 'AMMO4': '0.016', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.153', 'WEAPON3': '1.000', 'weapon2': '1.002', 'weapon3': '2.854', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '56.000'} [2024-08-06 04:09:53,168][52668] DAMAGECOUNT value on done: 484153.0 [2024-08-06 04:09:53,168][52668] Sum rewards: 83.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.102', 'AMMO4': '0.126', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.226', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '67.000'} [2024-08-06 04:09:53,381][52658] DAMAGECOUNT value on done: 494123.0 [2024-08-06 04:09:53,382][52658] Sum rewards: 79.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.072', 'AMMO4': '0.122', 'weapon4': '0.146', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '65.000'} [2024-08-06 04:09:53,724][52650] Updated weights for policy 0, policy_version 51351 (0.0010) [2024-08-06 04:09:53,959][52660] DAMAGECOUNT value on done: 497104.0 [2024-08-06 04:09:53,960][52660] Sum rewards: 73.356, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.440', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.082', 'AMMO4': '0.141', 'weapon5': '0.178', 'AMMO3': '0.248', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:54,011][52662] DAMAGECOUNT value on done: 498761.0 [2024-08-06 04:09:54,014][52662] Sum rewards: 69.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.486', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.146', 'AMMO4': '0.166', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:54,140][52669] DAMAGECOUNT value on done: 496334.0 [2024-08-06 04:09:54,140][52669] Sum rewards: 79.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.104', 'weapon5': '0.126', 'AMMO4': '0.146', 'weapon2': '0.202', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '66.000'} [2024-08-06 04:09:55,236][52671] DAMAGECOUNT value on done: 495423.0 [2024-08-06 04:09:55,239][52671] Sum rewards: 63.404, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.082', 'weapon5': '0.084', 'AMMO4': '0.194', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.408', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '53.000'} [2024-08-06 04:09:56,070][52668] DAMAGECOUNT value on done: 478192.0 [2024-08-06 04:09:56,074][52668] Sum rewards: 70.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.046', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.204', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:56,243][52803] DAMAGECOUNT value on done: 457820.0 [2024-08-06 04:09:56,245][52803] Sum rewards: 73.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.102', 'weapon4': '0.136', 'AMMO3': '0.202', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '61.000'} [2024-08-06 04:09:56,729][52669] DAMAGECOUNT value on done: 495846.0 [2024-08-06 04:09:56,730][52669] Sum rewards: 64.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.174', 'AMMO3': '0.180', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '52.000'} [2024-08-06 04:09:56,742][52658] DAMAGECOUNT value on done: 484734.0 [2024-08-06 04:09:56,743][52658] Sum rewards: 72.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.284', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.126', 'weapon4': '0.144', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '60.000'} [2024-08-06 04:09:56,990][52660] DAMAGECOUNT value on done: 489456.0 [2024-08-06 04:09:56,991][52660] Sum rewards: 69.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.221', 'weapon2': '0.228', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.138', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '58.000'} [2024-08-06 04:09:57,216][52662] DAMAGECOUNT value on done: 488366.0 [2024-08-06 04:09:57,218][52662] Sum rewards: 76.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '63.000'} [2024-08-06 04:09:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 420732928. Throughput: 0: 4380.2. Samples: 105191840. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 04:09:57,794][52567] Avg episode reward: [(0, '71.727')] [2024-08-06 04:09:58,090][52665] DAMAGECOUNT value on done: 478773.0 [2024-08-06 04:09:58,092][52665] Sum rewards: 61.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.198', 'weapon5': '0.260', 'AMMO3': '0.297', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.886', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '53.000'} [2024-08-06 04:09:58,275][52671] DAMAGECOUNT value on done: 491988.0 [2024-08-06 04:09:58,275][52671] Sum rewards: 64.615, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.465', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.212', 'weapon4': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '52.000'} [2024-08-06 04:09:58,578][52650] Updated weights for policy 0, policy_version 51361 (0.0031) [2024-08-06 04:09:59,287][52668] DAMAGECOUNT value on done: 478563.0 [2024-08-06 04:09:59,289][52668] Sum rewards: 60.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.598', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.188', 'AMMO3': '0.191', 'AMMO4': '0.199', 'weapon4': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '51.000'} [2024-08-06 04:09:59,325][52658] DAMAGECOUNT value on done: 499154.0 [2024-08-06 04:09:59,329][52658] Sum rewards: 80.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon5': '0.044', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '66.000'} [2024-08-06 04:09:59,400][52803] DAMAGECOUNT value on done: 460346.0 [2024-08-06 04:09:59,401][52803] Sum rewards: 77.979, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.985', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.140', 'weapon4': '0.174', 'AMMO4': '0.190', 'weapon2': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.184', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '67.000'} [2024-08-06 04:10:00,119][52662] DAMAGECOUNT value on done: 501264.0 [2024-08-06 04:10:00,119][52662] Sum rewards: 56.820, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.124', 'AMMO5': '0.021', 'AMMO2': '0.069', 'AMMO3': '0.242', 'weapon4': '0.274', 'weapon5': '0.286', 'AMMO4': '0.347', 'weapon2': '0.524', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.604', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '49.500'} [2024-08-06 04:10:00,155][52660] DAMAGECOUNT value on done: 486264.0 [2024-08-06 04:10:00,157][52660] Sum rewards: 73.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.172', 'AMMO3': '0.183', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:00,512][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:10:01,120][52665] DAMAGECOUNT value on done: 491644.0 [2024-08-06 04:10:01,123][52665] Sum rewards: 68.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.676', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.090', 'weapon5': '0.102', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.824', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '55.000'} [2024-08-06 04:10:01,640][52671] DAMAGECOUNT value on done: 499991.0 [2024-08-06 04:10:01,641][52671] Sum rewards: 70.589, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.894', 'AMMO5': '0.023', 'AMMO2': '0.070', 'weapon4': '0.142', 'AMMO3': '0.246', 'weapon5': '0.262', 'weapon2': '0.344', 'AMMO4': '0.350', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '60.500'} [2024-08-06 04:10:02,046][52658] DAMAGECOUNT value on done: 486805.0 [2024-08-06 04:10:02,049][52658] Sum rewards: 65.216, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.834', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.092', 'weapon5': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.306', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.202', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:02,481][52668] DAMAGECOUNT value on done: 480014.0 [2024-08-06 04:10:02,481][52668] Sum rewards: 71.197, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.058', 'AMMO5': '0.023', 'AMMO2': '0.055', 'AMMO3': '0.198', 'AMMO4': '0.277', 'weapon5': '0.284', 'weapon2': '0.304', 'weapon4': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:02,556][52803] DAMAGECOUNT value on done: 452109.0 [2024-08-06 04:10:02,556][52803] Sum rewards: 75.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.156', 'weapon4': '0.158', 'AMMO4': '0.165', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 420823040. Throughput: 0: 4380.9. Samples: 105204990. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 04:10:02,802][52567] Avg episode reward: [(0, '71.203')] [2024-08-06 04:10:03,278][52662] DAMAGECOUNT value on done: 488280.0 [2024-08-06 04:10:03,279][52662] Sum rewards: 76.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.092', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:03,359][52650] Updated weights for policy 0, policy_version 51371 (0.0023) [2024-08-06 04:10:03,410][52660] DAMAGECOUNT value on done: 485285.0 [2024-08-06 04:10:03,410][52660] Sum rewards: 72.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.878', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon4': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.050', 'weapon3': '3.172', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:03,971][52665] DAMAGECOUNT value on done: 488123.0 [2024-08-06 04:10:03,972][52665] Sum rewards: 79.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.614', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.232', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:04,213][52671] DAMAGECOUNT value on done: 492831.0 [2024-08-06 04:10:04,214][52671] Sum rewards: 67.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.824', 'AMMO5': '0.014', 'weapon5': '0.036', 'AMMO2': '0.046', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.232', 'weapon4': '0.324', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:04,892][52658] DAMAGECOUNT value on done: 500169.0 [2024-08-06 04:10:04,893][52658] Sum rewards: 55.710, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.584', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.174', 'AMMO3': '0.230', 'AMMO4': '0.230', 'weapon5': '0.256', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.882', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '48.000'} [2024-08-06 04:10:05,416][52668] DAMAGECOUNT value on done: 487899.0 [2024-08-06 04:10:05,417][52668] Sum rewards: 76.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.018', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.238', 'AMMO3': '0.246', 'weapon2': '0.320', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '64.000'} [2024-08-06 04:10:06,122][52662] DAMAGECOUNT value on done: 492648.0 [2024-08-06 04:10:06,122][52662] Sum rewards: 75.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.820', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:06,390][52660] DAMAGECOUNT value on done: 493783.0 [2024-08-06 04:10:06,390][52660] Sum rewards: 74.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.414', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.230', 'AMMO3': '0.257', 'weapon4': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.138', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:07,190][52665] DAMAGECOUNT value on done: 482916.0 [2024-08-06 04:10:07,190][52665] Sum rewards: 79.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.624', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.572', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:07,263][52671] DAMAGECOUNT value on done: 480085.0 [2024-08-06 04:10:07,264][52671] Sum rewards: 79.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.096', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:07,391][52658] DAMAGECOUNT value on done: 483112.0 [2024-08-06 04:10:07,391][52658] Sum rewards: 83.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.642', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.044', 'weapon5': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '67.000'} [2024-08-06 04:10:07,721][52650] Updated weights for policy 0, policy_version 51381 (0.0013) [2024-08-06 04:10:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 420913152. Throughput: 0: 4375.6. Samples: 105231040. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 04:10:07,794][52567] Avg episode reward: [(0, '71.447')] [2024-08-06 04:10:08,232][52668] DAMAGECOUNT value on done: 491819.0 [2024-08-06 04:10:08,232][52668] Sum rewards: 80.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.131', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.222', 'weapon2': '0.224', 'AMMO3': '0.233', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:09,205][52660] DAMAGECOUNT value on done: 489627.0 [2024-08-06 04:10:09,206][52660] Sum rewards: 61.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.560', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon2': '0.184', 'AMMO3': '0.185', 'weapon4': '0.186', 'AMMO4': '0.254', 'weapon5': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.128', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:09,292][52662] DAMAGECOUNT value on done: 487607.0 [2024-08-06 04:10:09,292][52662] Sum rewards: 54.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.261', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.114', 'AMMO3': '0.211', 'weapon5': '0.226', 'AMMO4': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.774', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.658', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '46.000'} [2024-08-06 04:10:09,826][52665] DAMAGECOUNT value on done: 473348.0 [2024-08-06 04:10:09,829][52665] Sum rewards: 58.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.145', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.131', 'weapon4': '0.210', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.050', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:09,848][52649] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:10:10,178][52658] DAMAGECOUNT value on done: 491013.0 [2024-08-06 04:10:10,179][52658] Sum rewards: 68.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.136', 'AMMO3': '0.181', 'AMMO4': '0.236', 'weapon5': '0.240', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:10,500][52671] DAMAGECOUNT value on done: 500051.0 [2024-08-06 04:10:10,502][52671] Sum rewards: 77.532, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.034', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.171', 'weapon5': '0.172', 'WEAPON5': '0.200', 'HEALTH': '0.229', 'weapon4': '0.256', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '2.816', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:10,553][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:10:11,131][52668] DAMAGECOUNT value on done: 489013.0 [2024-08-06 04:10:11,133][52668] Sum rewards: 81.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.154', 'AMMO4': '0.207', 'AMMO3': '0.211', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '67.000'} [2024-08-06 04:10:11,828][52660] DAMAGECOUNT value on done: 486481.0 [2024-08-06 04:10:11,832][52660] Sum rewards: 88.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.178', 'AMMO3': '0.181', 'weapon2': '0.266', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.970', 'FRAGCOUNT': '72.000'} [2024-08-06 04:10:12,527][52650] Updated weights for policy 0, policy_version 51391 (0.0014) [2024-08-06 04:10:12,589][52662] DAMAGECOUNT value on done: 497045.0 [2024-08-06 04:10:12,589][52662] Sum rewards: 69.367, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.126', 'AMMO4': '0.152', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 420995072. Throughput: 0: 4378.2. Samples: 105257350. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 04:10:12,794][52567] Avg episode reward: [(0, '71.093')] [2024-08-06 04:10:12,894][52665] DAMAGECOUNT value on done: 479824.0 [2024-08-06 04:10:12,896][52665] Sum rewards: 66.990, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.400', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.028', 'weapon4': '0.054', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.281', 'WEAPON3': '1.750', 'HITCOUNT': '3.350', 'weapon3': '3.450', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:13,007][52671] DAMAGECOUNT value on done: 497354.0 [2024-08-06 04:10:13,009][52671] Sum rewards: 77.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.152', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.318', 'weapon4': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:13,124][52658] DAMAGECOUNT value on done: 488945.0 [2024-08-06 04:10:13,124][52658] Sum rewards: 73.726, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.408', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.088', 'weapon4': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.110', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:13,495][52795] DAMAGECOUNT value on done: 455365.0 [2024-08-06 04:10:13,496][52795] Sum rewards: 76.087, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.955', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon2': '0.158', 'AMMO3': '0.168', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.540', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:13,901][52668] DAMAGECOUNT value on done: 493358.0 [2024-08-06 04:10:13,902][52668] Sum rewards: 75.155, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.108', 'HEALTH': '0.181', 'AMMO3': '0.211', 'weapon2': '0.214', 'WEAPON3': '1.200', 'weapon3': '3.366', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:14,581][52666] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.558, 186.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:10:14,630][52660] DAMAGECOUNT value on done: 494917.0 [2024-08-06 04:10:14,631][52660] Sum rewards: 76.238, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.476', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:15,811][52665] DAMAGECOUNT value on done: 483423.0 [2024-08-06 04:10:15,811][52665] Sum rewards: 63.959, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.645', 'AMMO5': '0.007', 'AMMO2': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.076', 'weapon4': '0.092', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.436', 'WEAPON3': '1.650', 'weapon3': '3.118', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '58.000'} [2024-08-06 04:10:15,877][52671] DAMAGECOUNT value on done: 496302.0 [2024-08-06 04:10:15,881][52671] Sum rewards: 59.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.176', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.320', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.452', 'DAMAGECOUNT': '14.217', 'FRAGCOUNT': '50.000'} [2024-08-06 04:10:15,931][52647] DAMAGECOUNT value on done: 516411.0 [2024-08-06 04:10:15,931][52647] Sum rewards: 76.115, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.865', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.338', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.412', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:16,037][52662] DAMAGECOUNT value on done: 490715.0 [2024-08-06 04:10:16,039][52662] Sum rewards: 78.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.781', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon4': '0.284', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:16,337][52658] DAMAGECOUNT value on done: 487861.0 [2024-08-06 04:10:16,339][52658] Sum rewards: 77.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.460', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:16,485][52668] DAMAGECOUNT value on done: 489017.0 [2024-08-06 04:10:16,485][52668] Sum rewards: 64.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.224', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon4': '0.136', 'AMMO3': '0.182', 'weapon2': '0.186', 'weapon5': '0.252', 'AMMO4': '0.325', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.174', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '54.000'} [2024-08-06 04:10:16,709][52795] DAMAGECOUNT value on done: 444989.0 [2024-08-06 04:10:16,709][52795] Sum rewards: 77.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.130', 'weapon5': '0.138', 'AMMO3': '0.193', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:17,150][52660] DAMAGECOUNT value on done: 480952.0 [2024-08-06 04:10:17,151][52660] Sum rewards: 63.804, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.373', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.082', 'AMMO4': '0.187', 'weapon5': '0.194', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '54.000'} [2024-08-06 04:10:17,344][52650] Updated weights for policy 0, policy_version 51401 (0.0012) [2024-08-06 04:10:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 421085184. Throughput: 0: 4370.7. Samples: 105270210. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 04:10:17,794][52567] Avg episode reward: [(0, '70.836')] [2024-08-06 04:10:18,605][52647] DAMAGECOUNT value on done: 516866.0 [2024-08-06 04:10:18,605][52647] Sum rewards: 76.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.832', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.360', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:18,874][52665] DAMAGECOUNT value on done: 485973.0 [2024-08-06 04:10:18,875][52665] Sum rewards: 79.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.715', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.232', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:18,927][52671] DAMAGECOUNT value on done: 494094.0 [2024-08-06 04:10:18,932][52671] Sum rewards: 55.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.655', 'AMMO5': '0.023', 'AMMO2': '0.069', 'AMMO3': '0.191', 'weapon5': '0.276', 'weapon4': '0.308', 'AMMO4': '0.347', 'weapon2': '0.458', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.520', 'weapon3': '2.592', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '48.000'} [2024-08-06 04:10:19,152][52658] DAMAGECOUNT value on done: 481806.0 [2024-08-06 04:10:19,153][52658] Sum rewards: 67.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.068', 'AMMO4': '0.074', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:19,387][52662] DAMAGECOUNT value on done: 500296.0 [2024-08-06 04:10:19,387][52662] Sum rewards: 71.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.202', 'weapon2': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '3.350', 'weapon3': '3.434', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '58.000'} [2024-08-06 04:10:19,916][52795] DAMAGECOUNT value on done: 445794.0 [2024-08-06 04:10:19,919][52795] Sum rewards: 78.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO4': '0.131', 'weapon5': '0.138', 'weapon2': '0.242', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:20,084][52660] DAMAGECOUNT value on done: 489347.0 [2024-08-06 04:10:20,084][52660] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.744', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon4': '0.122', 'AMMO3': '0.181', 'weapon2': '0.332', 'WEAPON3': '1.050', 'HITCOUNT': '3.370', 'weapon3': '3.404', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:21,538][52665] DAMAGECOUNT value on done: 490860.0 [2024-08-06 04:10:21,538][52665] Sum rewards: 65.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.033', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.114', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.478', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.200', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '55.000'} [2024-08-06 04:10:21,758][52647] DAMAGECOUNT value on done: 512856.0 [2024-08-06 04:10:21,759][52647] Sum rewards: 79.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.309', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.144', 'AMMO3': '0.188', 'weapon4': '0.218', 'AMMO4': '0.236', 'weapon2': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:21,775][52650] Updated weights for policy 0, policy_version 51411 (0.0028) [2024-08-06 04:10:21,798][52658] DAMAGECOUNT value on done: 498661.0 [2024-08-06 04:10:21,798][52658] Sum rewards: 80.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.421', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.168', 'AMMO4': '0.189', 'weapon5': '0.214', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.650', 'weapon3': '2.914', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '68.000'} [2024-08-06 04:10:22,022][52671] DAMAGECOUNT value on done: 489304.0 [2024-08-06 04:10:22,024][52671] Sum rewards: 60.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.130', 'weapon5': '0.180', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.218', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:22,342][52662] DAMAGECOUNT value on done: 494063.0 [2024-08-06 04:10:22,344][52662] Sum rewards: 71.826, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.310', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '58.000'} [2024-08-06 04:10:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 421167104. Throughput: 0: 4376.9. Samples: 105296580. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 04:10:22,802][52567] Avg episode reward: [(0, '71.444')] [2024-08-06 04:10:23,032][52660] DAMAGECOUNT value on done: 497122.0 [2024-08-06 04:10:23,034][52660] Sum rewards: 67.574, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.520', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.136', 'AMMO4': '0.144', 'weapon2': '0.218', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.238', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '60.500'} [2024-08-06 04:10:23,088][52795] DAMAGECOUNT value on done: 452140.0 [2024-08-06 04:10:23,088][52795] Sum rewards: 85.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.040', 'AMMO4': '0.040', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '69.000'} [2024-08-06 04:10:24,367][52658] DAMAGECOUNT value on done: 487720.0 [2024-08-06 04:10:24,368][52658] Sum rewards: 58.996, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.010', 'HEALTH': '0.010', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.312', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:24,412][52647] DAMAGECOUNT value on done: 523694.0 [2024-08-06 04:10:24,413][52647] Sum rewards: 65.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.806', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.124', 'AMMO4': '0.135', 'weapon5': '0.140', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.700', 'weapon3': '3.102', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:24,710][52665] DAMAGECOUNT value on done: 482759.0 [2024-08-06 04:10:24,713][52665] Sum rewards: 60.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.902', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.154', 'AMMO3': '0.230', 'AMMO4': '0.346', 'weapon5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:25,588][52662] DAMAGECOUNT value on done: 486692.0 [2024-08-06 04:10:25,589][52662] Sum rewards: 64.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.645', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.194', 'weapon2': '0.208', 'AMMO3': '0.221', 'AMMO4': '0.225', 'weapon5': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.024', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '55.000'} [2024-08-06 04:10:25,719][52660] DAMAGECOUNT value on done: 502349.0 [2024-08-06 04:10:25,721][52660] Sum rewards: 69.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO3': '0.187', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '57.000'} [2024-08-06 04:10:26,366][52795] DAMAGECOUNT value on done: 447994.0 [2024-08-06 04:10:26,368][52795] Sum rewards: 72.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.840', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:26,579][52650] Updated weights for policy 0, policy_version 51421 (0.0014) [2024-08-06 04:10:26,983][52647] DAMAGECOUNT value on done: 522333.0 [2024-08-06 04:10:26,984][52647] Sum rewards: 60.330, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.830', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.296', 'weapon2': '0.298', 'WEAPON3': '1.900', 'HITCOUNT': '3.110', 'weapon3': '3.134', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:27,065][52658] DAMAGECOUNT value on done: 492139.0 [2024-08-06 04:10:27,066][52658] Sum rewards: 86.768, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.382', 'HEALTH': '0.733', 'WEAPON3': '1.000', 'weapon3': '3.316', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '69.000'} [2024-08-06 04:10:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 421265408. Throughput: 0: 4370.2. Samples: 105322470. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 04:10:27,794][52567] Avg episode reward: [(0, '71.149')] [2024-08-06 04:10:27,802][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051424_421265408.pth... [2024-08-06 04:10:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000050910_417054720.pth [2024-08-06 04:10:28,025][52665] DAMAGECOUNT value on done: 493918.0 [2024-08-06 04:10:28,025][52665] Sum rewards: 77.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.050', 'weapon5': '0.090', 'weapon2': '0.182', 'AMMO4': '0.198', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.434', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:28,607][52662] DAMAGECOUNT value on done: 491353.0 [2024-08-06 04:10:28,608][52662] Sum rewards: 84.800, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.520', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.154', 'weapon5': '0.174', 'AMMO3': '0.224', 'weapon2': '0.260', 'AMMO4': '0.261', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '22.155', 'FRAGCOUNT': '70.000'} [2024-08-06 04:10:28,795][52664] DAMAGECOUNT value on done: 509253.0 [2024-08-06 04:10:28,795][52664] Sum rewards: 74.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.511', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:29,065][52660] DAMAGECOUNT value on done: 486309.0 [2024-08-06 04:10:29,065][52660] Sum rewards: 74.931, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.664', 'AMMO2': '0.004', 'AMMO5': '0.006', 'AMMO4': '0.018', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.376', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:29,168][52647] DAMAGECOUNT value on done: 519502.0 [2024-08-06 04:10:29,178][52647] Sum rewards: 77.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.912', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.168', 'weapon5': '0.232', 'weapon2': '0.242', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:29,663][52795] DAMAGECOUNT value on done: 456767.0 [2024-08-06 04:10:29,666][52795] Sum rewards: 79.193, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.830', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon4': '0.018', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.752', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '64.000'} [2024-08-06 04:10:30,398][52658] DAMAGECOUNT value on done: 496545.0 [2024-08-06 04:10:30,399][52658] Sum rewards: 86.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.227', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.108', 'AMMO3': '0.166', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.000', 'weapon3': '3.192', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '69.000'} [2024-08-06 04:10:31,128][52665] DAMAGECOUNT value on done: 489735.0 [2024-08-06 04:10:31,128][52665] Sum rewards: 62.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.240', 'AMMO5': '0.027', 'AMMO2': '0.082', 'AMMO3': '0.217', 'weapon2': '0.250', 'weapon5': '0.272', 'weapon4': '0.312', 'AMMO4': '0.412', 'WEAPON5': '0.750', 'WEAPON4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:31,453][52664] DAMAGECOUNT value on done: 515137.0 [2024-08-06 04:10:31,453][52664] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.153', 'AMMO3': '0.177', 'weapon4': '0.218', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.188', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 04:10:31,795][52650] Updated weights for policy 0, policy_version 51431 (0.0012) [2024-08-06 04:10:31,854][52662] DAMAGECOUNT value on done: 485566.0 [2024-08-06 04:10:31,855][52662] Sum rewards: 68.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.562', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.064', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:31,871][52647] DAMAGECOUNT value on done: 516803.0 [2024-08-06 04:10:31,874][52647] Sum rewards: 75.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.171', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.170', 'weapon2': '0.170', 'AMMO3': '0.217', 'weapon4': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:32,097][52660] DAMAGECOUNT value on done: 494328.0 [2024-08-06 04:10:32,098][52660] Sum rewards: 75.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.116', 'weapon4': '0.136', 'AMMO4': '0.171', 'weapon2': '0.210', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:32,436][52794] DAMAGECOUNT value on done: 491595.0 [2024-08-06 04:10:32,439][52794] Sum rewards: 81.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.158', 'AMMO4': '0.163', 'weapon5': '0.186', 'weapon2': '0.228', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '68.000'} [2024-08-06 04:10:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 421347328. Throughput: 0: 4361.1. Samples: 105335350. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 04:10:32,794][52567] Avg episode reward: [(0, '71.833')] [2024-08-06 04:10:32,803][52795] DAMAGECOUNT value on done: 460385.0 [2024-08-06 04:10:32,803][52795] Sum rewards: 72.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'AMMO5': '0.024', 'AMMO2': '0.036', 'weapon4': '0.138', 'AMMO3': '0.154', 'weapon5': '0.170', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.822', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:34,209][52664] DAMAGECOUNT value on done: 512581.0 [2024-08-06 04:10:34,209][52664] Sum rewards: 53.058, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.086', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO4': '0.256', 'AMMO3': '0.318', 'weapon4': '0.342', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.076', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '48.000'} [2024-08-06 04:10:34,312][52665] DAMAGECOUNT value on done: 484514.0 [2024-08-06 04:10:34,314][52665] Sum rewards: 62.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.492', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '51.500'} [2024-08-06 04:10:34,495][52647] DAMAGECOUNT value on done: 510577.0 [2024-08-06 04:10:34,496][52647] Sum rewards: 64.143, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.995', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.141', 'weapon5': '0.148', 'weapon2': '0.160', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.906', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '50.000'} [2024-08-06 04:10:34,680][52660] DAMAGECOUNT value on done: 486487.0 [2024-08-06 04:10:34,681][52660] Sum rewards: 75.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.878', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.110', 'weapon5': '0.124', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:34,984][52794] DAMAGECOUNT value on done: 496083.0 [2024-08-06 04:10:34,984][52794] Sum rewards: 64.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.132', 'weapon5': '0.200', 'AMMO3': '0.215', 'AMMO4': '0.236', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '53.000'} [2024-08-06 04:10:35,797][52650] Updated weights for policy 0, policy_version 51441 (0.0013) [2024-08-06 04:10:35,958][52795] DAMAGECOUNT value on done: 456305.0 [2024-08-06 04:10:35,959][52795] Sum rewards: 63.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.048', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.068', 'AMMO4': '0.090', 'weapon5': '0.112', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.348', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '54.000'} [2024-08-06 04:10:37,027][52664] DAMAGECOUNT value on done: 504071.0 [2024-08-06 04:10:37,028][52664] Sum rewards: 85.697, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.680', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO4': '0.112', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '69.000'} [2024-08-06 04:10:37,075][52665] DAMAGECOUNT value on done: 482316.0 [2024-08-06 04:10:37,076][52665] Sum rewards: 74.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.273', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.098', 'AMMO4': '0.151', 'weapon5': '0.156', 'AMMO3': '0.223', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:37,143][52660] DAMAGECOUNT value on done: 487884.0 [2024-08-06 04:10:37,146][52660] Sum rewards: 77.871, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.608', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon4': '0.168', 'weapon2': '0.434', 'WEAPON3': '0.900', 'weapon3': '3.052', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:37,221][52647] DAMAGECOUNT value on done: 520801.0 [2024-08-06 04:10:37,221][52647] Sum rewards: 72.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.088', 'weapon4': '0.090', 'AMMO3': '0.186', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:37,460][52794] DAMAGECOUNT value on done: 493905.0 [2024-08-06 04:10:37,464][52794] Sum rewards: 58.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.387', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.081', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'weapon2': '0.418', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.150', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 421429248. Throughput: 0: 4365.8. Samples: 105361750. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 04:10:37,794][52567] Avg episode reward: [(0, '71.507')] [2024-08-06 04:10:38,644][52659] DAMAGECOUNT value on done: 493783.0 [2024-08-06 04:10:38,652][52659] Sum rewards: 77.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.289', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.128', 'weapon5': '0.148', 'AMMO4': '0.173', 'weapon2': '0.226', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.262', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:38,966][52795] DAMAGECOUNT value on done: 445799.0 [2024-08-06 04:10:38,966][52795] Sum rewards: 68.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.200', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.265', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:39,923][52664] DAMAGECOUNT value on done: 511363.0 [2024-08-06 04:10:39,923][52664] Sum rewards: 70.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.144', 'weapon4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.237', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:40,003][52665] DAMAGECOUNT value on done: 484500.0 [2024-08-06 04:10:40,003][52665] Sum rewards: 63.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.087', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.177', 'weapon2': '0.224', 'WEAPON3': '1.200', 'weapon3': '3.318', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:40,066][52647] DAMAGECOUNT value on done: 514628.0 [2024-08-06 04:10:40,066][52647] Sum rewards: 81.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.860', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.138', 'weapon5': '0.166', 'AMMO4': '0.222', 'AMMO3': '0.264', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '68.000'} [2024-08-06 04:10:40,086][52660] DAMAGECOUNT value on done: 481264.0 [2024-08-06 04:10:40,087][52660] Sum rewards: 75.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.180', 'weapon5': '0.182', 'AMMO3': '0.211', 'AMMO4': '0.282', 'weapon2': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:40,754][52794] DAMAGECOUNT value on done: 488143.0 [2024-08-06 04:10:40,754][52794] Sum rewards: 83.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.152', 'AMMO3': '0.182', 'WEAPON3': '1.250', 'weapon3': '3.742', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '69.000'} [2024-08-06 04:10:40,950][52650] Updated weights for policy 0, policy_version 51451 (0.0014) [2024-08-06 04:10:41,097][52659] DAMAGECOUNT value on done: 490787.0 [2024-08-06 04:10:41,098][52659] Sum rewards: 64.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.104', 'AMMO4': '0.161', 'AMMO3': '0.166', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.812', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '52.000'} [2024-08-06 04:10:42,036][52795] DAMAGECOUNT value on done: 459194.0 [2024-08-06 04:10:42,039][52795] Sum rewards: 74.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.072', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:42,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 421511168. Throughput: 0: 4360.4. Samples: 105388060. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 04:10:42,794][52567] Avg episode reward: [(0, '71.918')] [2024-08-06 04:10:42,991][52664] DAMAGECOUNT value on done: 508064.0 [2024-08-06 04:10:42,992][52664] Sum rewards: 64.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.384', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.148', 'weapon5': '0.148', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.816', 'WEAPON3': '1.250', 'weapon3': '2.626', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '55.000'} [2024-08-06 04:10:43,073][52665] DAMAGECOUNT value on done: 480980.0 [2024-08-06 04:10:43,073][52665] Sum rewards: 80.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.674', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.080', 'AMMO4': '0.188', 'weapon5': '0.192', 'AMMO3': '0.208', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '66.000'} [2024-08-06 04:10:43,096][52647] DAMAGECOUNT value on done: 517830.0 [2024-08-06 04:10:43,096][52647] Sum rewards: 77.795, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.848', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.175', 'weapon2': '0.610', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:43,662][52794] DAMAGECOUNT value on done: 489185.0 [2024-08-06 04:10:43,670][52794] Sum rewards: 74.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.409', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.328', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:44,230][52659] DAMAGECOUNT value on done: 494031.0 [2024-08-06 04:10:44,232][52659] Sum rewards: 67.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO2': '0.002', 'AMMO5': '0.004', 'AMMO4': '0.009', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.146', 'AMMO3': '0.275', 'weapon4': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.348', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:44,528][52614] Signal inference workers to stop experience collection... (9350 times) [2024-08-06 04:10:44,528][52614] Signal inference workers to resume experience collection... (9350 times) [2024-08-06 04:10:44,571][52650] InferenceWorker_p0-w0: stopping experience collection (9350 times) [2024-08-06 04:10:44,577][52650] InferenceWorker_p0-w0: resuming experience collection (9350 times) [2024-08-06 04:10:45,191][52795] DAMAGECOUNT value on done: 451492.0 [2024-08-06 04:10:45,192][52795] Sum rewards: 53.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.130', 'weapon5': '0.176', 'AMMO4': '0.180', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.510', 'weapon3': '3.090', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '45.000'} [2024-08-06 04:10:45,637][52650] Updated weights for policy 0, policy_version 51461 (0.0013) [2024-08-06 04:10:45,824][52664] DAMAGECOUNT value on done: 507381.0 [2024-08-06 04:10:45,824][52664] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.174', 'AMMO3': '0.188', 'AMMO4': '0.243', 'weapon4': '0.330', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '58.000'} [2024-08-06 04:10:45,872][52647] DAMAGECOUNT value on done: 509050.0 [2024-08-06 04:10:45,872][52647] Sum rewards: 67.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.108', 'AMMO3': '0.215', 'AMMO4': '0.255', 'weapon5': '0.378', 'weapon2': '0.544', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.678', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:45,926][52665] DAMAGECOUNT value on done: 483498.0 [2024-08-06 04:10:45,927][52665] Sum rewards: 74.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.246', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:46,708][52794] DAMAGECOUNT value on done: 491473.0 [2024-08-06 04:10:46,708][52794] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.792', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.186', 'weapon2': '0.394', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.290', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:46,861][52659] DAMAGECOUNT value on done: 490442.0 [2024-08-06 04:10:46,864][52659] Sum rewards: 76.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.070', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.342', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 421609472. Throughput: 0: 4351.6. Samples: 105400810. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 04:10:47,794][52567] Avg episode reward: [(0, '71.870')] [2024-08-06 04:10:48,315][52795] DAMAGECOUNT value on done: 450253.0 [2024-08-06 04:10:48,315][52795] Sum rewards: 71.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.685', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.174', 'weapon4': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.209', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.104', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '58.000'} [2024-08-06 04:10:48,636][52647] DAMAGECOUNT value on done: 520236.0 [2024-08-06 04:10:48,636][52647] Sum rewards: 75.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.245', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.222', 'AMMO4': '0.232', 'weapon4': '0.238', 'AMMO3': '0.241', 'weapon2': '0.292', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.940', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '20.793', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:48,669][52664] DAMAGECOUNT value on done: 503124.0 [2024-08-06 04:10:48,677][52664] Sum rewards: 66.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.226', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '56.000'} [2024-08-06 04:10:48,820][52665] DAMAGECOUNT value on done: 480755.0 [2024-08-06 04:10:48,820][52665] Sum rewards: 72.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.030', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.201', 'weapon2': '0.346', 'WEAPON3': '1.300', 'HITCOUNT': '3.370', 'weapon3': '3.402', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:49,410][52820] DAMAGECOUNT value on done: 452369.0 [2024-08-06 04:10:49,412][52820] Sum rewards: 58.728, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.276', 'AMMO5': '0.021', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.138', 'AMMO3': '0.169', 'weapon5': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.784', 'WEAPON3': '1.200', 'weapon3': '2.636', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '48.500'} [2024-08-06 04:10:49,661][52794] DAMAGECOUNT value on done: 497150.0 [2024-08-06 04:10:49,662][52794] Sum rewards: 65.770, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO3': '0.192', 'AMMO4': '0.206', 'weapon2': '0.226', 'weapon4': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.070', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '55.000'} [2024-08-06 04:10:49,774][52659] DAMAGECOUNT value on done: 488737.0 [2024-08-06 04:10:49,775][52659] Sum rewards: 65.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.157', 'weapon4': '0.162', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '55.000'} [2024-08-06 04:10:50,153][52650] Updated weights for policy 0, policy_version 51471 (0.0017) [2024-08-06 04:10:51,078][52647] DAMAGECOUNT value on done: 514338.0 [2024-08-06 04:10:51,079][52647] Sum rewards: 68.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.390', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.256', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.500'} [2024-08-06 04:10:51,138][52664] DAMAGECOUNT value on done: 514762.0 [2024-08-06 04:10:51,138][52664] Sum rewards: 66.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.045', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.138', 'AMMO4': '0.163', 'weapon5': '0.172', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.600', 'weapon3': '2.864', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '57.000'} [2024-08-06 04:10:51,489][52795] DAMAGECOUNT value on done: 447367.0 [2024-08-06 04:10:51,492][52795] Sum rewards: 64.961, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.182', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO4': '0.198', 'AMMO3': '0.240', 'weapon2': '0.242', 'weapon4': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '58.000'} [2024-08-06 04:10:51,956][52665] DAMAGECOUNT value on done: 482732.0 [2024-08-06 04:10:51,958][52665] Sum rewards: 85.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.155', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '71.000'} [2024-08-06 04:10:52,077][52794] DAMAGECOUNT value on done: 484814.0 [2024-08-06 04:10:52,080][52794] Sum rewards: 70.698, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.415', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.151', 'weapon4': '0.176', 'weapon2': '0.202', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:52,499][52820] DAMAGECOUNT value on done: 453226.0 [2024-08-06 04:10:52,499][52820] Sum rewards: 72.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.475', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.178', 'weapon2': '0.240', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.364', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 421691392. Throughput: 0: 4354.0. Samples: 105426970. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 04:10:52,794][52567] Avg episode reward: [(0, '71.514')] [2024-08-06 04:10:52,998][52659] DAMAGECOUNT value on done: 493014.0 [2024-08-06 04:10:53,007][52659] Sum rewards: 81.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.191', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'weapon4': '0.100', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 04:10:53,783][52647] DAMAGECOUNT value on done: 522691.0 [2024-08-06 04:10:53,792][52647] Sum rewards: 67.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.664', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'weapon2': '0.504', 'weapon4': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.726', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 04:10:53,933][52664] DAMAGECOUNT value on done: 505746.0 [2024-08-06 04:10:53,935][52664] Sum rewards: 56.013, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.215', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.192', 'weapon5': '0.212', 'AMMO4': '0.284', 'AMMO3': '0.297', 'weapon2': '0.388', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'HITCOUNT': '2.810', 'weapon3': '2.824', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '52.000'} [2024-08-06 04:10:54,610][52795] DAMAGECOUNT value on done: 456663.0 [2024-08-06 04:10:54,614][52795] Sum rewards: 72.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.094', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.188', 'AMMO3': '0.223', 'weapon4': '0.270', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '59.000'} [2024-08-06 04:10:54,693][52665] DAMAGECOUNT value on done: 485667.0 [2024-08-06 04:10:54,694][52665] Sum rewards: 62.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.362', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon2': '0.118', 'AMMO4': '0.157', 'weapon4': '0.168', 'AMMO3': '0.175', 'weapon5': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.302', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '51.000'} [2024-08-06 04:10:55,052][52650] Updated weights for policy 0, policy_version 51481 (0.0017) [2024-08-06 04:10:55,061][52794] DAMAGECOUNT value on done: 496652.0 [2024-08-06 04:10:55,062][52794] Sum rewards: 79.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.152', 'weapon5': '0.178', 'AMMO3': '0.209', 'weapon2': '0.212', 'AMMO4': '0.213', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '65.000'} [2024-08-06 04:10:55,690][52820] DAMAGECOUNT value on done: 456506.0 [2024-08-06 04:10:55,691][52820] Sum rewards: 69.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.136', 'weapon4': '0.154', 'weapon2': '0.214', 'AMMO3': '0.231', 'AMMO4': '0.237', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 04:10:55,877][52659] DAMAGECOUNT value on done: 490114.0 [2024-08-06 04:10:55,878][52659] Sum rewards: 61.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.236', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon2': '0.234', 'weapon5': '0.240', 'AMMO4': '0.256', 'AMMO3': '0.257', 'weapon4': '0.268', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '2.914', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '52.000'} [2024-08-06 04:10:56,651][52647] DAMAGECOUNT value on done: 515536.0 [2024-08-06 04:10:56,651][52647] Sum rewards: 71.542, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.135', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.246', 'WEAPON3': '1.550', 'weapon3': '3.320', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '61.000'} [2024-08-06 04:10:56,899][52664] DAMAGECOUNT value on done: 516571.0 [2024-08-06 04:10:56,903][52664] Sum rewards: 73.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.626', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.230', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'weapon3': '3.522', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:57,729][52795] DAMAGECOUNT value on done: 446688.0 [2024-08-06 04:10:57,729][52795] Sum rewards: 82.550, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.736', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.098', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '69.000'} [2024-08-06 04:10:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 421781504. Throughput: 0: 4353.6. Samples: 105453260. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 04:10:57,795][52567] Avg episode reward: [(0, '71.160')] [2024-08-06 04:10:58,196][52794] DAMAGECOUNT value on done: 492660.0 [2024-08-06 04:10:58,198][52794] Sum rewards: 70.530, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.882', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.138', 'weapon4': '0.162', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:58,456][52659] DAMAGECOUNT value on done: 490216.0 [2024-08-06 04:10:58,457][52659] Sum rewards: 77.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.105', 'weapon5': '0.156', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:58,898][52820] DAMAGECOUNT value on done: 448515.0 [2024-08-06 04:10:58,899][52820] Sum rewards: 77.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.204', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.122', 'AMMO4': '0.145', 'AMMO3': '0.214', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '63.000'} [2024-08-06 04:10:59,159][52647] DAMAGECOUNT value on done: 506807.0 [2024-08-06 04:10:59,161][52647] Sum rewards: 70.743, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.564', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.158', 'weapon2': '0.210', 'weapon4': '0.258', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.092', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '62.000'} [2024-08-06 04:10:59,388][52664] DAMAGECOUNT value on done: 511702.0 [2024-08-06 04:10:59,389][52664] Sum rewards: 63.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.956', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.159', 'weapon4': '0.172', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.698', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '52.500'} [2024-08-06 04:10:59,390][52650] Updated weights for policy 0, policy_version 51491 (0.0023) [2024-08-06 04:11:00,934][52795] DAMAGECOUNT value on done: 464636.0 [2024-08-06 04:11:00,935][52795] Sum rewards: 88.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.560', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.161', 'weapon2': '0.208', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '74.000'} [2024-08-06 04:11:01,364][52659] DAMAGECOUNT value on done: 496810.0 [2024-08-06 04:11:01,365][52659] Sum rewards: 73.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.635', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.078', 'weapon5': '0.172', 'AMMO4': '0.232', 'AMMO3': '0.236', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:01,388][52794] DAMAGECOUNT value on done: 487342.0 [2024-08-06 04:11:01,391][52794] Sum rewards: 75.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.072', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '64.000'} [2024-08-06 04:11:01,518][52647] DAMAGECOUNT value on done: 514178.0 [2024-08-06 04:11:01,518][52647] Sum rewards: 78.234, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.036', 'weapon5': '0.054', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'weapon3': '3.512', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '66.000'} [2024-08-06 04:11:01,804][52664] DAMAGECOUNT value on done: 520151.0 [2024-08-06 04:11:01,805][52664] Sum rewards: 76.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.740', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.157', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:02,084][52820] DAMAGECOUNT value on done: 457328.0 [2024-08-06 04:11:02,087][52820] Sum rewards: 61.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.956', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.074', 'weapon5': '0.112', 'AMMO4': '0.136', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.130', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '52.000'} [2024-08-06 04:11:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 421871616. Throughput: 0: 4359.8. Samples: 105466400. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 04:11:02,794][52567] Avg episode reward: [(0, '71.340')] [2024-08-06 04:11:03,871][52647] DAMAGECOUNT value on done: 512344.0 [2024-08-06 04:11:03,871][52647] Sum rewards: 83.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.432', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '70.000'} [2024-08-06 04:11:03,987][52659] DAMAGECOUNT value on done: 501970.0 [2024-08-06 04:11:03,988][52659] Sum rewards: 64.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.840', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.114', 'AMMO3': '0.184', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '54.000'} [2024-08-06 04:11:04,080][52795] DAMAGECOUNT value on done: 455718.0 [2024-08-06 04:11:04,083][52795] Sum rewards: 68.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.888', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.128', 'weapon5': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 04:11:04,152][52664] DAMAGECOUNT value on done: 515465.0 [2024-08-06 04:11:04,154][52664] Sum rewards: 74.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.008', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.084', 'AMMO4': '0.146', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '60.000'} [2024-08-06 04:11:04,389][52794] DAMAGECOUNT value on done: 497834.0 [2024-08-06 04:11:04,391][52794] Sum rewards: 82.149, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.062', 'weapon5': '0.180', 'AMMO3': '0.187', 'AMMO4': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '65.000'} [2024-08-06 04:11:04,592][52650] Updated weights for policy 0, policy_version 51501 (0.0029) [2024-08-06 04:11:05,177][52649] DAMAGECOUNT value on done: 476036.0 [2024-08-06 04:11:05,179][52649] Sum rewards: 78.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.407', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '63.000'} [2024-08-06 04:11:05,369][52820] DAMAGECOUNT value on done: 450636.0 [2024-08-06 04:11:05,370][52820] Sum rewards: 74.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.743', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.100', 'weapon5': '0.136', 'AMMO4': '0.157', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.150', 'weapon3': '3.278', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '60.000'} [2024-08-06 04:11:06,448][52647] DAMAGECOUNT value on done: 511624.0 [2024-08-06 04:11:06,448][52647] Sum rewards: 69.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.088', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.262', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '56.000'} [2024-08-06 04:11:06,789][52664] DAMAGECOUNT value on done: 515516.0 [2024-08-06 04:11:06,790][52664] Sum rewards: 72.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.650', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon5': '0.182', 'AMMO3': '0.244', 'weapon2': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:07,032][52659] DAMAGECOUNT value on done: 489980.0 [2024-08-06 04:11:07,033][52659] Sum rewards: 72.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.068', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.412', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:07,338][52795] DAMAGECOUNT value on done: 445524.0 [2024-08-06 04:11:07,338][52795] Sum rewards: 68.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.309', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.145', 'weapon2': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:07,474][52794] DAMAGECOUNT value on done: 484655.0 [2024-08-06 04:11:07,474][52794] Sum rewards: 60.006, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.920', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.082', 'weapon5': '0.194', 'AMMO4': '0.211', 'AMMO3': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON3': '2.050', 'weapon3': '2.858', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 421953536. Throughput: 0: 4358.0. Samples: 105492690. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 04:11:07,794][52567] Avg episode reward: [(0, '71.471')] [2024-08-06 04:11:08,372][52649] DAMAGECOUNT value on done: 468823.0 [2024-08-06 04:11:08,375][52649] Sum rewards: 62.101, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.220', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.170', 'weapon5': '0.172', 'weapon2': '0.194', 'WEAPON4': '0.300', 'AMMO3': '0.309', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.262', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2024-08-06 04:11:08,496][52820] DAMAGECOUNT value on done: 452710.0 [2024-08-06 04:11:08,497][52820] Sum rewards: 69.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO4': '0.133', 'weapon5': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:08,557][52650] Updated weights for policy 0, policy_version 51511 (0.0015) [2024-08-06 04:11:09,727][52659] DAMAGECOUNT value on done: 495212.0 [2024-08-06 04:11:09,728][52659] Sum rewards: 67.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.138', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.165', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.268', 'WEAPON3': '1.000', 'weapon3': '3.024', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:09,920][52664] DAMAGECOUNT value on done: 508798.0 [2024-08-06 04:11:09,921][52664] Sum rewards: 73.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.795', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.214', 'AMMO3': '0.220', 'AMMO4': '0.283', 'weapon2': '0.344', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '60.000'} [2024-08-06 04:11:10,409][52795] DAMAGECOUNT value on done: 455832.0 [2024-08-06 04:11:10,409][52795] Sum rewards: 74.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.188', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '61.000'} [2024-08-06 04:11:10,511][52794] DAMAGECOUNT value on done: 504711.0 [2024-08-06 04:11:10,512][52794] Sum rewards: 82.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.440', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.165', 'weapon4': '0.196', 'AMMO4': '0.281', 'weapon5': '0.314', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.638', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '21.048', 'FRAGCOUNT': '63.000'} [2024-08-06 04:11:11,375][52649] DAMAGECOUNT value on done: 484490.0 [2024-08-06 04:11:11,376][52649] Sum rewards: 77.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.002', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.124', 'AMMO3': '0.218', 'AMMO4': '0.255', 'weapon5': '0.262', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '63.500'} [2024-08-06 04:11:11,614][52820] DAMAGECOUNT value on done: 456464.0 [2024-08-06 04:11:11,616][52820] Sum rewards: 86.344, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.116', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.251', 'weapon2': '0.496', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.501', 'FRAGCOUNT': '72.000'} [2024-08-06 04:11:12,422][52659] DAMAGECOUNT value on done: 485144.0 [2024-08-06 04:11:12,427][52659] Sum rewards: 65.835, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.409', 'AMMO5': '0.025', 'AMMO2': '0.060', 'AMMO3': '0.247', 'weapon4': '0.262', 'weapon5': '0.278', 'weapon2': '0.298', 'AMMO4': '0.299', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.800', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '58.000'} [2024-08-06 04:11:12,724][52664] DAMAGECOUNT value on done: 508394.0 [2024-08-06 04:11:12,725][52664] Sum rewards: 78.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.114', 'weapon4': '0.122', 'AMMO3': '0.208', 'AMMO4': '0.260', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '66.000'} [2024-08-06 04:11:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 422043648. Throughput: 0: 4361.1. Samples: 105518720. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:11:12,794][52567] Avg episode reward: [(0, '71.840')] [2024-08-06 04:11:13,142][52794] DAMAGECOUNT value on done: 484482.0 [2024-08-06 04:11:13,143][52794] Sum rewards: 73.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.094', 'weapon5': '0.096', 'AMMO4': '0.190', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '61.000'} [2024-08-06 04:11:13,535][52795] DAMAGECOUNT value on done: 458890.0 [2024-08-06 04:11:13,537][52795] Sum rewards: 68.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.344', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.106', 'AMMO4': '0.177', 'AMMO3': '0.220', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '58.000'} [2024-08-06 04:11:13,748][52650] Updated weights for policy 0, policy_version 51521 (0.0010) [2024-08-06 04:11:14,307][52649] DAMAGECOUNT value on done: 476877.0 [2024-08-06 04:11:14,307][52649] Sum rewards: 77.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'weapon2': '0.322', 'WEAPON3': '1.700', 'weapon3': '3.100', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '66.000'} [2024-08-06 04:11:14,595][52663] DAMAGECOUNT value on done: 498888.0 [2024-08-06 04:11:14,596][52663] Sum rewards: 73.285, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.696', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '58.000'} [2024-08-06 04:11:14,663][52820] DAMAGECOUNT value on done: 453833.0 [2024-08-06 04:11:14,663][52820] Sum rewards: 82.238, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.155', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.340', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '65.000'} [2024-08-06 04:11:15,352][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:11:15,381][52664] DAMAGECOUNT value on done: 512331.0 [2024-08-06 04:11:15,381][52664] Sum rewards: 74.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.448', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:15,550][52659] DAMAGECOUNT value on done: 492158.0 [2024-08-06 04:11:15,553][52659] Sum rewards: 62.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.470', 'AMMO5': '0.021', 'AMMO2': '0.063', 'weapon5': '0.206', 'weapon4': '0.222', 'AMMO3': '0.229', 'AMMO4': '0.315', 'weapon2': '0.496', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.762', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '54.000'} [2024-08-06 04:11:16,383][52794] DAMAGECOUNT value on done: 502209.0 [2024-08-06 04:11:16,385][52794] Sum rewards: 83.572, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.301', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.092', 'AMMO3': '0.173', 'weapon5': '0.184', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '67.000'} [2024-08-06 04:11:17,491][52649] DAMAGECOUNT value on done: 468538.0 [2024-08-06 04:11:17,493][52649] Sum rewards: 64.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.083', 'weapon5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.348', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '53.500'} [2024-08-06 04:11:17,589][52663] DAMAGECOUNT value on done: 492541.0 [2024-08-06 04:11:17,590][52663] Sum rewards: 67.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.042', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 422125568. Throughput: 0: 4370.0. Samples: 105532000. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:11:17,795][52567] Avg episode reward: [(0, '71.653')] [2024-08-06 04:11:17,830][52820] DAMAGECOUNT value on done: 461741.0 [2024-08-06 04:11:17,832][52820] Sum rewards: 78.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.583', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.450', 'weapon3': '3.522', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '67.000'} [2024-08-06 04:11:18,175][52664] DAMAGECOUNT value on done: 508994.0 [2024-08-06 04:11:18,176][52664] Sum rewards: 58.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.522', 'AMMO5': '0.029', 'AMMO2': '0.081', 'AMMO3': '0.248', 'weapon2': '0.256', 'weapon5': '0.286', 'AMMO4': '0.405', 'weapon4': '0.442', 'WEAPON5': '0.750', 'WEAPON4': '0.950', 'WEAPON3': '1.500', 'weapon3': '2.700', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '50.500'} [2024-08-06 04:11:18,306][52650] Updated weights for policy 0, policy_version 51531 (0.0014) [2024-08-06 04:11:18,445][52666] DAMAGECOUNT value on done: 489292.0 [2024-08-06 04:11:18,445][52666] Sum rewards: 79.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO4': '0.196', 'weapon2': '0.216', 'AMMO3': '0.230', 'weapon4': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '66.000'} [2024-08-06 04:11:18,555][52659] DAMAGECOUNT value on done: 502053.0 [2024-08-06 04:11:18,557][52659] Sum rewards: 61.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.176', 'AMMO4': '0.181', 'AMMO3': '0.185', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.314', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2024-08-06 04:11:19,396][52794] DAMAGECOUNT value on done: 492129.0 [2024-08-06 04:11:19,397][52794] Sum rewards: 71.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.168', 'weapon5': '0.186', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.000'} [2024-08-06 04:11:20,283][52649] DAMAGECOUNT value on done: 481801.0 [2024-08-06 04:11:20,291][52649] Sum rewards: 72.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.136', 'weapon5': '0.144', 'AMMO4': '0.145', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:20,415][52663] DAMAGECOUNT value on done: 486881.0 [2024-08-06 04:11:20,416][52663] Sum rewards: 76.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.402', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.172', 'weapon5': '0.198', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:20,842][52820] DAMAGECOUNT value on done: 450728.0 [2024-08-06 04:11:20,842][52820] Sum rewards: 66.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.134', 'weapon5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:20,887][52666] DAMAGECOUNT value on done: 492741.0 [2024-08-06 04:11:20,887][52666] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'weapon2': '0.618', 'WEAPON3': '0.850', 'weapon3': '3.120', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '58.000'} [2024-08-06 04:11:21,235][52664] DAMAGECOUNT value on done: 507067.0 [2024-08-06 04:11:21,237][52664] Sum rewards: 64.599, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.083', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO3': '0.172', 'weapon2': '0.760', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '2.920', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '52.500'} [2024-08-06 04:11:21,695][52659] DAMAGECOUNT value on done: 499271.0 [2024-08-06 04:11:21,697][52659] Sum rewards: 77.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.138', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.098', 'weapon2': '0.214', 'AMMO3': '0.230', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2024-08-06 04:11:21,745][52670] DAMAGECOUNT value on done: 481525.0 [2024-08-06 04:11:21,746][52670] Sum rewards: 67.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.122', 'AMMO3': '0.233', 'weapon5': '0.278', 'weapon2': '0.288', 'AMMO4': '0.299', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '56.000'} [2024-08-06 04:11:22,621][52794] DAMAGECOUNT value on done: 497797.0 [2024-08-06 04:11:22,623][52794] Sum rewards: 84.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.160', 'weapon4': '0.226', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '70.000'} [2024-08-06 04:11:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 422215680. Throughput: 0: 4369.1. Samples: 105558360. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:11:22,794][52567] Avg episode reward: [(0, '71.935')] [2024-08-06 04:11:22,948][52650] Updated weights for policy 0, policy_version 51541 (0.0038) [2024-08-06 04:11:22,958][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:11:23,160][52663] DAMAGECOUNT value on done: 489726.0 [2024-08-06 04:11:23,161][52663] Sum rewards: 66.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.828', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.192', 'weapon5': '0.208', 'weapon2': '0.288', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '54.000'} [2024-08-06 04:11:23,184][52649] DAMAGECOUNT value on done: 476112.0 [2024-08-06 04:11:23,185][52649] Sum rewards: 59.583, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.542', 'ARMOR': '0.016', 'AMMO5': '0.030', 'AMMO2': '0.052', 'weapon5': '0.150', 'AMMO3': '0.227', 'AMMO4': '0.260', 'weapon2': '0.332', 'weapon4': '0.364', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '53.000'} [2024-08-06 04:11:23,958][52666] DAMAGECOUNT value on done: 494995.0 [2024-08-06 04:11:23,960][52820] DAMAGECOUNT value on done: 456093.0 [2024-08-06 04:11:23,959][52666] Sum rewards: 64.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.040', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.096', 'AMMO4': '0.192', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.276', 'weapon4': '0.290', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:23,960][52820] Sum rewards: 70.927, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.159', 'weapon4': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:24,209][52659] DAMAGECOUNT value on done: 496201.0 [2024-08-06 04:11:24,209][52659] Sum rewards: 73.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'weapon4': '0.092', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.280', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:24,869][52670] DAMAGECOUNT value on done: 494736.0 [2024-08-06 04:11:24,870][52670] Sum rewards: 73.557, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '59.500'} [2024-08-06 04:11:25,271][52794] DAMAGECOUNT value on done: 500241.0 [2024-08-06 04:11:25,271][52794] Sum rewards: 88.280, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.590', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.204', 'AMMO4': '0.222', 'weapon2': '0.242', 'AMMO3': '0.285', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.176', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.009', 'FRAGCOUNT': '75.000'} [2024-08-06 04:11:26,044][52663] DAMAGECOUNT value on done: 491136.0 [2024-08-06 04:11:26,049][52663] Sum rewards: 73.154, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.254', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon5': '0.258', 'AMMO3': '0.270', 'AMMO4': '0.285', 'weapon2': '0.314', 'weapon4': '0.378', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.744', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '61.000'} [2024-08-06 04:11:26,153][52649] DAMAGECOUNT value on done: 481993.0 [2024-08-06 04:11:26,155][52649] Sum rewards: 73.668, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.055', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.176', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'weapon4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 04:11:27,120][52659] DAMAGECOUNT value on done: 492633.0 [2024-08-06 04:11:27,121][52659] Sum rewards: 79.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.176', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.100', 'AMMO4': '0.104', 'weapon5': '0.106', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '66.000'} [2024-08-06 04:11:27,211][52820] DAMAGECOUNT value on done: 461575.0 [2024-08-06 04:11:27,213][52820] Sum rewards: 76.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.113', 'weapon4': '0.172', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '64.000'} [2024-08-06 04:11:27,295][52666] DAMAGECOUNT value on done: 493913.0 [2024-08-06 04:11:27,296][52666] Sum rewards: 79.998, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.124', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '64.000'} [2024-08-06 04:11:27,701][52650] Updated weights for policy 0, policy_version 51551 (0.0020) [2024-08-06 04:11:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 422305792. Throughput: 0: 4362.2. Samples: 105584360. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:11:27,794][52567] Avg episode reward: [(0, '71.915')] [2024-08-06 04:11:27,856][52794] DAMAGECOUNT value on done: 490538.0 [2024-08-06 04:11:27,858][52794] Sum rewards: 70.537, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.106', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.122', 'weapon4': '0.124', 'AMMO4': '0.187', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '60.000'} [2024-08-06 04:11:27,924][52670] DAMAGECOUNT value on done: 486556.0 [2024-08-06 04:11:27,925][52670] Sum rewards: 75.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.775', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.140', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:29,088][52649] DAMAGECOUNT value on done: 482009.0 [2024-08-06 04:11:29,088][52649] Sum rewards: 77.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.218', 'AMMO4': '0.223', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '64.000'} [2024-08-06 04:11:29,400][52663] DAMAGECOUNT value on done: 495773.0 [2024-08-06 04:11:29,400][52663] Sum rewards: 74.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.122', 'AMMO4': '0.173', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '61.000'} [2024-08-06 04:11:30,022][52659] DAMAGECOUNT value on done: 495480.0 [2024-08-06 04:11:30,022][52659] Sum rewards: 86.264, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.252', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '70.000'} [2024-08-06 04:11:30,061][52666] DAMAGECOUNT value on done: 491456.0 [2024-08-06 04:11:30,062][52666] Sum rewards: 67.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'weapon4': '0.098', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '56.000'} [2024-08-06 04:11:30,313][52820] DAMAGECOUNT value on done: 456460.0 [2024-08-06 04:11:30,313][52820] Sum rewards: 83.303, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.652', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.018', 'weapon4': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.480', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '70.000'} [2024-08-06 04:11:30,768][52811] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:11:30,817][52670] DAMAGECOUNT value on done: 484420.0 [2024-08-06 04:11:30,819][52670] Sum rewards: 61.280, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.555', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.436', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '55.500'} [2024-08-06 04:11:30,821][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:11:32,036][52649] DAMAGECOUNT value on done: 475350.0 [2024-08-06 04:11:32,036][52649] Sum rewards: 62.756, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon5': '0.334', 'weapon2': '0.498', 'WEAPON3': '1.000', 'weapon3': '2.788', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '50.000'} [2024-08-06 04:11:32,302][52650] Updated weights for policy 0, policy_version 51561 (0.0017) [2024-08-06 04:11:32,397][52663] DAMAGECOUNT value on done: 492430.0 [2024-08-06 04:11:32,397][52663] Sum rewards: 76.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.832', 'AMMO5': '0.012', 'AMMO2': '0.035', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO4': '0.176', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon4': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.674', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '63.000'} [2024-08-06 04:11:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 422387712. Throughput: 0: 4371.6. Samples: 105597530. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:11:32,794][52567] Avg episode reward: [(0, '72.309')] [2024-08-06 04:11:32,993][52659] DAMAGECOUNT value on done: 494766.0 [2024-08-06 04:11:32,993][52659] Sum rewards: 55.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.796', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.182', 'weapon5': '0.256', 'AMMO4': '0.308', 'AMMO3': '0.312', 'weapon2': '0.352', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.800', 'HITCOUNT': '2.790', 'weapon3': '2.892', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '49.000'} [2024-08-06 04:11:33,144][52666] DAMAGECOUNT value on done: 485733.0 [2024-08-06 04:11:33,146][52666] Sum rewards: 72.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.130', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:33,375][52820] DAMAGECOUNT value on done: 461671.0 [2024-08-06 04:11:33,377][52820] Sum rewards: 75.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.675', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.718', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 04:11:33,953][52670] DAMAGECOUNT value on done: 496832.0 [2024-08-06 04:11:33,953][52670] Sum rewards: 73.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.128', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.076', 'AMMO4': '0.142', 'weapon4': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 04:11:34,412][52649] DAMAGECOUNT value on done: 484052.0 [2024-08-06 04:11:34,414][52649] Sum rewards: 67.005, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.627', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.052', 'AMMO4': '0.138', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.418', 'WEAPON3': '1.650', 'weapon3': '3.122', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:34,882][52663] DAMAGECOUNT value on done: 487026.0 [2024-08-06 04:11:34,884][52663] Sum rewards: 78.296, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.264', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'weapon5': '0.082', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.632', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.500'} [2024-08-06 04:11:35,773][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:11:36,267][52666] DAMAGECOUNT value on done: 489244.0 [2024-08-06 04:11:36,277][52666] Sum rewards: 70.761, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.575', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:36,585][52820] DAMAGECOUNT value on done: 456119.0 [2024-08-06 04:11:36,585][52820] Sum rewards: 65.704, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.050', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.258', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:36,766][52650] Updated weights for policy 0, policy_version 51571 (0.0012) [2024-08-06 04:11:36,854][52670] DAMAGECOUNT value on done: 490870.0 [2024-08-06 04:11:36,854][52670] Sum rewards: 67.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.272', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.093', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'weapon2': '0.786', 'WEAPON3': '1.000', 'weapon3': '2.924', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '54.500'} [2024-08-06 04:11:37,350][52649] DAMAGECOUNT value on done: 488604.0 [2024-08-06 04:11:37,352][52649] Sum rewards: 64.503, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.570', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.132', 'AMMO4': '0.218', 'weapon5': '0.222', 'AMMO3': '0.307', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.002', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 422477824. Throughput: 0: 4376.2. Samples: 105623900. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:11:37,794][52567] Avg episode reward: [(0, '72.367')] [2024-08-06 04:11:37,865][52663] DAMAGECOUNT value on done: 486690.0 [2024-08-06 04:11:37,866][52663] Sum rewards: 80.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.599', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.064', 'AMMO4': '0.084', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'weapon2': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.194', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.661', 'FRAGCOUNT': '68.000'} [2024-08-06 04:11:39,302][52666] DAMAGECOUNT value on done: 489607.0 [2024-08-06 04:11:39,304][52666] Sum rewards: 60.278, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.088', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon5': '0.152', 'AMMO4': '0.200', 'AMMO3': '0.305', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.750', 'weapon3': '2.932', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:39,732][52820] DAMAGECOUNT value on done: 456399.0 [2024-08-06 04:11:39,733][52820] Sum rewards: 75.049, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.124', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.000'} [2024-08-06 04:11:40,095][52670] DAMAGECOUNT value on done: 480667.0 [2024-08-06 04:11:40,096][52670] Sum rewards: 59.450, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.264', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.172', 'weapon4': '0.226', 'AMMO3': '0.252', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.952', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '51.000'} [2024-08-06 04:11:40,426][52649] DAMAGECOUNT value on done: 489701.0 [2024-08-06 04:11:40,427][52649] Sum rewards: 64.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.178', 'weapon2': '0.204', 'AMMO4': '0.207', 'weapon5': '0.212', 'AMMO3': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.116', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:41,273][52663] DAMAGECOUNT value on done: 493481.0 [2024-08-06 04:11:41,288][52663] Sum rewards: 70.549, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon4': '0.060', 'AMMO3': '0.208', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.418', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '58.000'} [2024-08-06 04:11:41,885][52650] Updated weights for policy 0, policy_version 51581 (0.0018) [2024-08-06 04:11:42,021][52666] DAMAGECOUNT value on done: 488040.0 [2024-08-06 04:11:42,023][52666] Sum rewards: 68.115, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.355', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.170', 'weapon5': '0.214', 'AMMO4': '0.219', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '54.000'} [2024-08-06 04:11:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 422567936. Throughput: 0: 4373.1. Samples: 105650050. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-06 04:11:42,794][52567] Avg episode reward: [(0, '72.241')] [2024-08-06 04:11:42,827][52670] DAMAGECOUNT value on done: 487552.0 [2024-08-06 04:11:42,827][52670] Sum rewards: 62.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.515', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.205', 'weapon4': '0.336', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '52.000'} [2024-08-06 04:11:42,976][52820] DAMAGECOUNT value on done: 467125.0 [2024-08-06 04:11:42,977][52820] Sum rewards: 66.792, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.355', 'AMMO5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.028', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.111', 'WEAPON5': '0.150', 'weapon2': '0.630', 'WEAPON3': '0.800', 'weapon3': '3.088', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '51.000'} [2024-08-06 04:11:43,157][52649] DAMAGECOUNT value on done: 485643.0 [2024-08-06 04:11:43,161][52649] Sum rewards: 72.499, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.536', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.124', 'AMMO3': '0.226', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:44,239][52663] DAMAGECOUNT value on done: 500864.0 [2024-08-06 04:11:44,241][52663] Sum rewards: 82.871, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'HEALTH': '0.258', 'weapon2': '0.388', 'WEAPON3': '0.900', 'weapon3': '3.332', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '65.000'} [2024-08-06 04:11:44,776][52666] DAMAGECOUNT value on done: 482644.0 [2024-08-06 04:11:44,780][52666] Sum rewards: 66.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.662', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.170', 'AMMO3': '0.213', 'weapon4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.798', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:45,012][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:11:45,550][52670] DAMAGECOUNT value on done: 486788.0 [2024-08-06 04:11:45,553][52670] Sum rewards: 63.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.738', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.170', 'weapon4': '0.170', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.000', 'HITCOUNT': '3.080', 'weapon3': '3.136', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '52.000'} [2024-08-06 04:11:46,074][52650] Updated weights for policy 0, policy_version 51591 (0.0028) [2024-08-06 04:11:46,108][52649] DAMAGECOUNT value on done: 475141.0 [2024-08-06 04:11:46,109][52649] Sum rewards: 82.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.044', 'AMMO4': '0.046', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.208', 'WEAPON3': '1.300', 'weapon3': '3.508', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '68.000'} [2024-08-06 04:11:46,112][52820] DAMAGECOUNT value on done: 465566.0 [2024-08-06 04:11:46,116][52820] Sum rewards: 66.236, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.884', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.052', 'weapon5': '0.096', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.850', 'weapon3': '3.192', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '60.000'} [2024-08-06 04:11:46,784][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:11:46,981][52663] DAMAGECOUNT value on done: 488435.0 [2024-08-06 04:11:46,981][52663] Sum rewards: 62.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.196', 'AMMO3': '0.221', 'weapon2': '0.222', 'AMMO4': '0.271', 'weapon4': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '54.000'} [2024-08-06 04:11:47,798][52567] Fps is (10 sec: 17197.6, 60 sec: 17338.8, 300 sec: 17494.6). Total num frames: 422649856. Throughput: 0: 4371.7. Samples: 105663140. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-06 04:11:47,799][52567] Avg episode reward: [(0, '71.950')] [2024-08-06 04:11:47,846][52667] DAMAGECOUNT value on done: 491228.0 [2024-08-06 04:11:47,846][52667] Sum rewards: 68.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.964', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.149', 'weapon4': '0.194', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:48,288][52666] DAMAGECOUNT value on done: 487938.0 [2024-08-06 04:11:48,288][52666] Sum rewards: 77.482, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.650', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.180', 'weapon5': '0.232', 'weapon2': '0.296', 'AMMO4': '0.310', 'AMMO3': '0.317', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.850', 'weapon3': '2.926', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '68.000'} [2024-08-06 04:11:49,026][52649] DAMAGECOUNT value on done: 484199.0 [2024-08-06 04:11:49,032][52649] Sum rewards: 60.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.965', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.094', 'weapon5': '0.124', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.108', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '50.000'} [2024-08-06 04:11:49,039][52670] DAMAGECOUNT value on done: 483631.0 [2024-08-06 04:11:49,041][52670] Sum rewards: 67.246, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.140', 'weapon5': '0.178', 'AMMO4': '0.182', 'weapon2': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.300', 'HEALTH': '0.348', 'WEAPON3': '0.850', 'HITCOUNT': '2.990', 'weapon3': '3.136', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '52.000'} [2024-08-06 04:11:49,234][52820] DAMAGECOUNT value on done: 452746.0 [2024-08-06 04:11:49,236][52820] Sum rewards: 66.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.782', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.179', 'AMMO3': '0.196', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:49,606][52663] DAMAGECOUNT value on done: 486055.0 [2024-08-06 04:11:49,608][52663] Sum rewards: 71.559, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.500', 'weapon4': '0.006', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.028', 'WEAPON4': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.580', 'WEAPON3': '0.850', 'weapon3': '3.242', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '56.000'} [2024-08-06 04:11:50,973][52667] DAMAGECOUNT value on done: 501031.0 [2024-08-06 04:11:50,973][52667] Sum rewards: 72.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.080', 'AMMO4': '0.115', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.210', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.408', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:51,267][52650] Updated weights for policy 0, policy_version 51601 (0.0011) [2024-08-06 04:11:51,348][52666] DAMAGECOUNT value on done: 483110.0 [2024-08-06 04:11:51,350][52666] Sum rewards: 60.518, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.846', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.012', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '50.500'} [2024-08-06 04:11:51,961][52670] DAMAGECOUNT value on done: 489047.0 [2024-08-06 04:11:51,961][52670] Sum rewards: 61.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.590', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.104', 'AMMO4': '0.204', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '52.000'} [2024-08-06 04:11:52,020][52649] DAMAGECOUNT value on done: 473307.0 [2024-08-06 04:11:52,021][52649] Sum rewards: 83.558, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.066', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.138', 'AMMO3': '0.241', 'weapon2': '0.254', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '70.000'} [2024-08-06 04:11:52,603][52663] DAMAGECOUNT value on done: 485307.0 [2024-08-06 04:11:52,605][52663] Sum rewards: 64.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.059', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.146', 'weapon5': '0.174', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.054', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 422748160. Throughput: 0: 4367.1. Samples: 105689210. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-06 04:11:52,794][52567] Avg episode reward: [(0, '71.438')] [2024-08-06 04:11:53,877][52667] DAMAGECOUNT value on done: 491087.0 [2024-08-06 04:11:53,877][52667] Sum rewards: 75.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon4': '0.182', 'weapon5': '0.228', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:54,461][52666] DAMAGECOUNT value on done: 498026.0 [2024-08-06 04:11:54,462][52666] Sum rewards: 62.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.194', 'weapon2': '0.206', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.316', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '52.000'} [2024-08-06 04:11:54,732][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:11:54,750][52649] DAMAGECOUNT value on done: 486159.0 [2024-08-06 04:11:54,750][52649] Sum rewards: 81.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.310', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.184', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '3.088', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '64.000'} [2024-08-06 04:11:55,279][52670] DAMAGECOUNT value on done: 480016.0 [2024-08-06 04:11:55,280][52670] Sum rewards: 66.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'AMMO2': '0.019', 'ARMOR': '0.020', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '55.000'} [2024-08-06 04:11:55,412][52663] DAMAGECOUNT value on done: 486028.0 [2024-08-06 04:11:55,412][52663] Sum rewards: 60.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.260', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.820', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '50.000'} [2024-08-06 04:11:55,795][52650] Updated weights for policy 0, policy_version 51611 (0.0030) [2024-08-06 04:11:56,876][52667] DAMAGECOUNT value on done: 492639.0 [2024-08-06 04:11:56,878][52667] Sum rewards: 67.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.427', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.095', 'weapon5': '0.138', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '53.000'} [2024-08-06 04:11:57,153][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:11:57,155][52666] DAMAGECOUNT value on done: 492230.0 [2024-08-06 04:11:57,161][52666] Sum rewards: 71.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.172', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.058', 'AMMO4': '0.143', 'weapon5': '0.156', 'AMMO3': '0.230', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:57,528][52649] DAMAGECOUNT value on done: 487068.0 [2024-08-06 04:11:57,528][52649] Sum rewards: 64.266, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.828', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.152', 'AMMO3': '0.241', 'AMMO4': '0.299', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.356', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 04:11:57,719][52670] DAMAGECOUNT value on done: 486112.0 [2024-08-06 04:11:57,720][52670] Sum rewards: 69.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.785', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.096', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.240', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.334', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 04:11:57,794][52567] Fps is (10 sec: 18028.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 422830080. Throughput: 0: 4373.1. Samples: 105715510. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-06 04:11:57,794][52567] Avg episode reward: [(0, '71.235')] [2024-08-06 04:11:58,290][52663] DAMAGECOUNT value on done: 496767.0 [2024-08-06 04:11:58,292][52663] Sum rewards: 72.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.933', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '62.000'} [2024-08-06 04:11:59,685][52666] DAMAGECOUNT value on done: 487461.0 [2024-08-06 04:11:59,685][52666] Sum rewards: 71.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.664', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.170', 'weapon5': '0.176', 'AMMO3': '0.191', 'AMMO4': '0.267', 'weapon2': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:00,259][52670] DAMAGECOUNT value on done: 495413.0 [2024-08-06 04:12:00,260][52670] Sum rewards: 78.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.094', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.086', 'AMMO4': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:00,319][52667] DAMAGECOUNT value on done: 500706.0 [2024-08-06 04:12:00,320][52667] Sum rewards: 62.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.176', 'weapon5': '0.208', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.450', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.576', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '50.000'} [2024-08-06 04:12:00,497][52650] Updated weights for policy 0, policy_version 51621 (0.0021) [2024-08-06 04:12:00,559][52649] DAMAGECOUNT value on done: 480054.0 [2024-08-06 04:12:00,559][52649] Sum rewards: 72.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.415', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.098', 'AMMO4': '0.172', 'weapon5': '0.188', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:01,372][52663] DAMAGECOUNT value on done: 487558.0 [2024-08-06 04:12:01,380][52663] Sum rewards: 71.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.166', 'AMMO5': '0.028', 'AMMO2': '0.059', 'AMMO3': '0.182', 'weapon4': '0.194', 'weapon5': '0.264', 'AMMO4': '0.293', 'weapon2': '0.468', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:02,611][52666] DAMAGECOUNT value on done: 488658.0 [2024-08-06 04:12:02,612][52666] Sum rewards: 73.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.723', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.034', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'weapon5': '0.160', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '59.500'} [2024-08-06 04:12:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 422912000. Throughput: 0: 4369.8. Samples: 105728640. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-06 04:12:02,794][52567] Avg episode reward: [(0, '70.945')] [2024-08-06 04:12:03,290][52670] DAMAGECOUNT value on done: 490019.0 [2024-08-06 04:12:03,293][52670] Sum rewards: 75.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.730', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'weapon2': '0.154', 'AMMO3': '0.268', 'WEAPON3': '1.750', 'weapon3': '3.500', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '65.000'} [2024-08-06 04:12:03,508][52667] DAMAGECOUNT value on done: 502642.0 [2024-08-06 04:12:03,509][52667] Sum rewards: 74.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '62.000'} [2024-08-06 04:12:04,338][52663] DAMAGECOUNT value on done: 496702.0 [2024-08-06 04:12:04,339][52663] Sum rewards: 66.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.476', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon4': '0.242', 'AMMO3': '0.252', 'weapon5': '0.272', 'AMMO4': '0.281', 'weapon2': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '2.852', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '56.000'} [2024-08-06 04:12:05,061][52650] Updated weights for policy 0, policy_version 51631 (0.0012) [2024-08-06 04:12:05,654][52649] Large shaping reward 2.742 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 04:12:05,740][52666] DAMAGECOUNT value on done: 488691.0 [2024-08-06 04:12:05,740][52666] Sum rewards: 61.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.342', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.326', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '53.000'} [2024-08-06 04:12:06,421][52670] DAMAGECOUNT value on done: 475673.0 [2024-08-06 04:12:06,422][52670] Sum rewards: 76.758, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.286', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.084', 'AMMO4': '0.199', 'weapon5': '0.228', 'weapon2': '0.290', 'AMMO3': '0.307', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.090', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '65.000'} [2024-08-06 04:12:06,502][52667] DAMAGECOUNT value on done: 493743.0 [2024-08-06 04:12:06,503][52667] Sum rewards: 73.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.204', 'AMMO4': '0.262', 'weapon5': '0.296', 'weapon4': '0.304', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.588', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '60.000'} [2024-08-06 04:12:07,103][52663] DAMAGECOUNT value on done: 493542.0 [2024-08-06 04:12:07,104][52663] Sum rewards: 80.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.836', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.052', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.364', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 423002112. Throughput: 0: 4371.6. Samples: 105755080. Policy #0 lag: (min: 0.0, avg: 4.6, max: 9.0) [2024-08-06 04:12:07,794][52567] Avg episode reward: [(0, '70.844')] [2024-08-06 04:12:08,679][52666] DAMAGECOUNT value on done: 493014.0 [2024-08-06 04:12:08,679][52666] Sum rewards: 74.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.221', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.138', 'AMMO4': '0.145', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.206', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '63.000'} [2024-08-06 04:12:09,234][52667] DAMAGECOUNT value on done: 493639.0 [2024-08-06 04:12:09,237][52667] Sum rewards: 79.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.652', 'AMMO5': '0.019', 'AMMO2': '0.067', 'AMMO3': '0.231', 'weapon4': '0.270', 'weapon2': '0.288', 'weapon5': '0.292', 'AMMO4': '0.335', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:09,334][52670] DAMAGECOUNT value on done: 486819.0 [2024-08-06 04:12:09,335][52670] Sum rewards: 81.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.134', 'AMMO4': '0.144', 'weapon2': '0.168', 'weapon5': '0.224', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:09,798][52650] Updated weights for policy 0, policy_version 51641 (0.0026) [2024-08-06 04:12:10,190][52663] DAMAGECOUNT value on done: 487963.0 [2024-08-06 04:12:10,191][52663] Sum rewards: 75.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.525', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.046', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.231', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:10,895][52669] DAMAGECOUNT value on done: 496362.0 [2024-08-06 04:12:10,897][52669] Sum rewards: 64.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.724', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.072', 'weapon5': '0.074', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '55.000'} [2024-08-06 04:12:11,224][52666] DAMAGECOUNT value on done: 477590.0 [2024-08-06 04:12:11,227][52666] Sum rewards: 72.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.149', 'AMMO3': '0.167', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '58.500'} [2024-08-06 04:12:12,096][52670] DAMAGECOUNT value on done: 495541.0 [2024-08-06 04:12:12,097][52670] Sum rewards: 75.354, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.896', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.126', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:12,305][52667] DAMAGECOUNT value on done: 498596.0 [2024-08-06 04:12:12,306][52667] Sum rewards: 58.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.750', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO4': '0.226', 'AMMO3': '0.230', 'weapon4': '0.346', 'weapon5': '0.348', 'weapon2': '0.376', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.602', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '50.000'} [2024-08-06 04:12:12,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 423100416. Throughput: 0: 4380.9. Samples: 105781500. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 04:12:12,794][52567] Avg episode reward: [(0, '70.983')] [2024-08-06 04:12:14,231][52669] DAMAGECOUNT value on done: 487474.0 [2024-08-06 04:12:14,232][52669] Sum rewards: 72.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.867', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.214', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:14,396][52650] Updated weights for policy 0, policy_version 51651 (0.0018) [2024-08-06 04:12:14,475][52811] DAMAGECOUNT value on done: 472797.0 [2024-08-06 04:12:14,475][52811] Sum rewards: 87.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.546', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO4': '0.164', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.282', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '72.000'} [2024-08-06 04:12:14,547][52666] DAMAGECOUNT value on done: 485865.0 [2024-08-06 04:12:14,550][52666] Sum rewards: 71.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.022', 'AMMO4': '0.032', 'weapon4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.253', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.390', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '62.000'} [2024-08-06 04:12:15,154][52667] DAMAGECOUNT value on done: 501726.0 [2024-08-06 04:12:15,154][52667] Sum rewards: 72.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.926', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.120', 'AMMO4': '0.173', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:15,227][52670] DAMAGECOUNT value on done: 486288.0 [2024-08-06 04:12:15,227][52670] Sum rewards: 65.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.072', 'AMMO4': '0.106', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:16,950][52669] DAMAGECOUNT value on done: 498813.0 [2024-08-06 04:12:16,951][52669] Sum rewards: 66.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.108', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.200', 'AMMO4': '0.216', 'weapon4': '0.236', 'weapon5': '0.270', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '55.000'} [2024-08-06 04:12:17,582][52811] DAMAGECOUNT value on done: 456143.0 [2024-08-06 04:12:17,583][52811] Sum rewards: 85.717, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.560', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.124', 'AMMO3': '0.237', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '22.119', 'FRAGCOUNT': '72.000'} [2024-08-06 04:12:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 423182336. Throughput: 0: 4385.1. Samples: 105794860. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 04:12:17,795][52567] Avg episode reward: [(0, '71.319')] [2024-08-06 04:12:17,819][52667] DAMAGECOUNT value on done: 491278.0 [2024-08-06 04:12:17,821][52667] Sum rewards: 71.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.208', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.080', 'weapon5': '0.114', 'AMMO4': '0.156', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:18,336][52670] DAMAGECOUNT value on done: 489795.0 [2024-08-06 04:12:18,337][52670] Sum rewards: 64.066, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.544', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.166', 'AMMO3': '0.202', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '51.500'} [2024-08-06 04:12:19,132][52650] Updated weights for policy 0, policy_version 51661 (0.0010) [2024-08-06 04:12:19,911][52669] DAMAGECOUNT value on done: 495478.0 [2024-08-06 04:12:19,911][52669] Sum rewards: 73.658, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.102', 'weapon4': '0.106', 'weapon2': '0.208', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.328', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '65.000'} [2024-08-06 04:12:20,622][52811] DAMAGECOUNT value on done: 454020.0 [2024-08-06 04:12:20,623][52811] Sum rewards: 67.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.675', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.240', 'weapon4': '0.244', 'weapon5': '0.270', 'AMMO4': '0.283', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '56.500'} [2024-08-06 04:12:20,804][52667] DAMAGECOUNT value on done: 492641.0 [2024-08-06 04:12:20,805][52667] Sum rewards: 84.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'AMMO3': '0.189', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.445', 'FRAGCOUNT': '70.000'} [2024-08-06 04:12:22,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 423264256. Throughput: 0: 4389.3. Samples: 105821420. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 04:12:22,795][52567] Avg episode reward: [(0, '71.377')] [2024-08-06 04:12:22,822][52669] DAMAGECOUNT value on done: 493737.0 [2024-08-06 04:12:22,825][52669] Sum rewards: 72.755, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.361', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.048', 'weapon4': '0.056', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '60.000'} [2024-08-06 04:12:23,484][52667] DAMAGECOUNT value on done: 500198.0 [2024-08-06 04:12:23,486][52667] Sum rewards: 74.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.178', 'AMMO4': '0.181', 'AMMO3': '0.245', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.000'} [2024-08-06 04:12:23,500][52668] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:12:23,601][52650] Updated weights for policy 0, policy_version 51671 (0.0022) [2024-08-06 04:12:23,670][52811] DAMAGECOUNT value on done: 457881.0 [2024-08-06 04:12:23,673][52811] Sum rewards: 59.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.216', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '49.000'} [2024-08-06 04:12:25,714][52669] DAMAGECOUNT value on done: 497239.0 [2024-08-06 04:12:25,715][52669] Sum rewards: 74.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.098', 'AMMO4': '0.172', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '62.000'} [2024-08-06 04:12:26,787][52667] DAMAGECOUNT value on done: 489930.0 [2024-08-06 04:12:26,789][52667] Sum rewards: 68.985, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.019', 'HEALTH': '0.020', 'weapon5': '0.076', 'weapon4': '0.088', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.746', 'WEAPON3': '0.850', 'weapon3': '2.986', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '54.000'} [2024-08-06 04:12:26,882][52811] DAMAGECOUNT value on done: 461205.0 [2024-08-06 04:12:26,884][52811] Sum rewards: 70.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.382', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.201', 'weapon4': '0.242', 'weapon5': '0.242', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '58.000'} [2024-08-06 04:12:26,961][52803] DAMAGECOUNT value on done: 460471.0 [2024-08-06 04:12:26,962][52803] Sum rewards: 69.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.629', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.184', 'AMMO4': '0.195', 'weapon5': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:27,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.6, 300 sec: 17550.3). Total num frames: 423362560. Throughput: 0: 4398.2. Samples: 105847970. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 04:12:27,795][52567] Avg episode reward: [(0, '71.108')] [2024-08-06 04:12:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051680_423362560.pth... [2024-08-06 04:12:27,928][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051167_419160064.pth [2024-08-06 04:12:28,320][52669] DAMAGECOUNT value on done: 496553.0 [2024-08-06 04:12:28,320][52669] Sum rewards: 83.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.070', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.718', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '69.000'} [2024-08-06 04:12:28,578][52650] Updated weights for policy 0, policy_version 51681 (0.0015) [2024-08-06 04:12:29,348][52667] DAMAGECOUNT value on done: 498077.0 [2024-08-06 04:12:29,349][52667] Sum rewards: 72.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.281', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.140', 'AMMO4': '0.197', 'AMMO3': '0.199', 'weapon2': '0.220', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:29,532][52614] Signal inference workers to stop experience collection... (9400 times) [2024-08-06 04:12:29,541][52614] Signal inference workers to resume experience collection... (9400 times) [2024-08-06 04:12:29,616][52650] InferenceWorker_p0-w0: stopping experience collection (9400 times) [2024-08-06 04:12:29,616][52650] InferenceWorker_p0-w0: resuming experience collection (9400 times) [2024-08-06 04:12:30,064][52811] DAMAGECOUNT value on done: 467924.0 [2024-08-06 04:12:30,065][52811] Sum rewards: 69.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.158', 'AMMO3': '0.184', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'weapon4': '0.392', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.694', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:30,151][52803] DAMAGECOUNT value on done: 458163.0 [2024-08-06 04:12:30,152][52803] Sum rewards: 60.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.200', 'weapon4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '53.000'} [2024-08-06 04:12:30,732][52668] DAMAGECOUNT value on done: 491967.0 [2024-08-06 04:12:30,733][52668] Sum rewards: 76.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.152', 'weapon5': '0.178', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '64.000'} [2024-08-06 04:12:30,985][52669] DAMAGECOUNT value on done: 494557.0 [2024-08-06 04:12:30,985][52669] Sum rewards: 76.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.256', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.464', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '64.000'} [2024-08-06 04:12:32,116][52667] DAMAGECOUNT value on done: 504242.0 [2024-08-06 04:12:32,116][52667] Sum rewards: 82.313, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.287', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.038', 'weapon4': '0.104', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'AMMO3': '0.288', 'WEAPON3': '1.800', 'weapon3': '3.340', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '71.000'} [2024-08-06 04:12:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 423444480. Throughput: 0: 4389.9. Samples: 105860670. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 04:12:32,794][52567] Avg episode reward: [(0, '70.973')] [2024-08-06 04:12:32,882][52650] Updated weights for policy 0, policy_version 51691 (0.0023) [2024-08-06 04:12:33,138][52803] DAMAGECOUNT value on done: 465515.0 [2024-08-06 04:12:33,146][52803] Sum rewards: 64.030, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON4': '0.050', 'weapon5': '0.086', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '52.000'} [2024-08-06 04:12:33,210][52811] DAMAGECOUNT value on done: 462838.0 [2024-08-06 04:12:33,211][52811] Sum rewards: 79.091, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.968', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '65.000'} [2024-08-06 04:12:33,234][52671] DAMAGECOUNT value on done: 499067.0 [2024-08-06 04:12:33,236][52671] Sum rewards: 75.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.156', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.234', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '62.000'} [2024-08-06 04:12:33,596][52668] DAMAGECOUNT value on done: 496744.0 [2024-08-06 04:12:33,597][52668] Sum rewards: 72.491, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.475', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.354', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:34,014][52669] DAMAGECOUNT value on done: 502384.0 [2024-08-06 04:12:34,016][52669] Sum rewards: 83.155, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.795', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'weapon3': '3.494', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.222', 'FRAGCOUNT': '70.000'} [2024-08-06 04:12:35,119][52667] DAMAGECOUNT value on done: 503326.0 [2024-08-06 04:12:35,121][52667] Sum rewards: 76.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.374', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '65.000'} [2024-08-06 04:12:35,779][52671] DAMAGECOUNT value on done: 497861.0 [2024-08-06 04:12:35,781][52671] Sum rewards: 72.007, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.826', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO4': '0.217', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.408', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '2.708', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '62.000'} [2024-08-06 04:12:36,274][52660] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:12:36,278][52803] DAMAGECOUNT value on done: 467988.0 [2024-08-06 04:12:36,278][52803] Sum rewards: 69.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.531', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO4': '0.215', 'weapon2': '0.220', 'AMMO3': '0.241', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:36,337][52811] DAMAGECOUNT value on done: 461313.0 [2024-08-06 04:12:36,337][52811] Sum rewards: 72.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.547', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.228', 'AMMO4': '0.243', 'AMMO3': '0.253', 'weapon2': '0.282', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:36,472][52668] DAMAGECOUNT value on done: 497531.0 [2024-08-06 04:12:36,474][52668] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.612', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.185', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.396', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:37,257][52669] DAMAGECOUNT value on done: 493394.0 [2024-08-06 04:12:37,257][52669] Sum rewards: 62.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.232', 'AMMO3': '0.262', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '53.000'} [2024-08-06 04:12:37,709][52667] DAMAGECOUNT value on done: 499886.0 [2024-08-06 04:12:37,711][52667] Sum rewards: 69.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.128', 'weapon5': '0.152', 'AMMO3': '0.214', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:37,794][52567] Fps is (10 sec: 16384.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 423526400. Throughput: 0: 4386.2. Samples: 105886590. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 04:12:37,794][52567] Avg episode reward: [(0, '71.077')] [2024-08-06 04:12:37,898][52650] Updated weights for policy 0, policy_version 51701 (0.0024) [2024-08-06 04:12:38,884][52671] DAMAGECOUNT value on done: 498661.0 [2024-08-06 04:12:38,885][52671] Sum rewards: 77.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.044', 'AMMO4': '0.051', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '64.000'} [2024-08-06 04:12:39,381][52803] DAMAGECOUNT value on done: 463916.0 [2024-08-06 04:12:39,382][52803] Sum rewards: 68.206, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.178', 'HEALTH': '0.214', 'weapon5': '0.214', 'AMMO4': '0.263', 'weapon2': '0.310', 'weapon4': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 04:12:39,418][52811] DAMAGECOUNT value on done: 467125.0 [2024-08-06 04:12:39,418][52811] Sum rewards: 72.942, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.330', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.092', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.300', 'AMMO3': '0.332', 'weapon2': '0.450', 'WEAPON3': '1.950', 'weapon3': '3.016', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:39,643][52668] DAMAGECOUNT value on done: 498163.0 [2024-08-06 04:12:39,643][52668] Sum rewards: 74.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.328', 'weapon4': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.000'} [2024-08-06 04:12:40,158][52669] DAMAGECOUNT value on done: 500997.0 [2024-08-06 04:12:40,161][52669] Sum rewards: 74.826, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.333', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.197', 'weapon4': '0.200', 'AMMO4': '0.228', 'weapon2': '0.278', 'weapon5': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:40,568][52667] DAMAGECOUNT value on done: 494258.0 [2024-08-06 04:12:40,568][52667] Sum rewards: 80.143, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'weapon2': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.522', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '63.000'} [2024-08-06 04:12:41,622][52671] DAMAGECOUNT value on done: 496791.0 [2024-08-06 04:12:41,622][52671] Sum rewards: 58.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.168', 'weapon4': '0.178', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '49.000'} [2024-08-06 04:12:42,445][52803] DAMAGECOUNT value on done: 453469.0 [2024-08-06 04:12:42,448][52803] Sum rewards: 64.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.357', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.174', 'AMMO3': '0.193', 'weapon4': '0.196', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '51.500'} [2024-08-06 04:12:42,501][52811] DAMAGECOUNT value on done: 462818.0 [2024-08-06 04:12:42,502][52811] Sum rewards: 73.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.132', 'AMMO4': '0.199', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:42,538][52650] Updated weights for policy 0, policy_version 51711 (0.0013) [2024-08-06 04:12:42,623][52669] DAMAGECOUNT value on done: 499278.0 [2024-08-06 04:12:42,624][52669] Sum rewards: 62.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.075', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'weapon4': '0.160', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.118', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '52.000'} [2024-08-06 04:12:42,790][52668] DAMAGECOUNT value on done: 487768.0 [2024-08-06 04:12:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 423616512. Throughput: 0: 4388.0. Samples: 105912970. Policy #0 lag: (min: 1.0, avg: 2.9, max: 7.0) [2024-08-06 04:12:42,792][52668] Sum rewards: 73.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.378', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '62.000'} [2024-08-06 04:12:42,795][52567] Avg episode reward: [(0, '71.348')] [2024-08-06 04:12:43,539][52667] DAMAGECOUNT value on done: 501556.0 [2024-08-06 04:12:43,539][52667] Sum rewards: 77.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.401', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.138', 'weapon4': '0.170', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '64.000'} [2024-08-06 04:12:44,274][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:12:44,639][52671] DAMAGECOUNT value on done: 507510.0 [2024-08-06 04:12:44,641][52671] Sum rewards: 78.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.386', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.166', 'AMMO4': '0.172', 'weapon2': '0.230', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.262', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '66.000'} [2024-08-06 04:12:45,339][52669] DAMAGECOUNT value on done: 486553.0 [2024-08-06 04:12:45,340][52669] Sum rewards: 70.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.191', 'weapon2': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.336', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:45,507][52803] DAMAGECOUNT value on done: 457054.0 [2024-08-06 04:12:45,509][52803] Sum rewards: 82.090, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.802', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.102', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '66.000'} [2024-08-06 04:12:45,683][52811] DAMAGECOUNT value on done: 460680.0 [2024-08-06 04:12:45,684][52811] Sum rewards: 64.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.128', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON4': '0.450', 'weapon4': '0.830', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '52.000'} [2024-08-06 04:12:45,963][52668] DAMAGECOUNT value on done: 500172.0 [2024-08-06 04:12:45,964][52668] Sum rewards: 72.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.350', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.094', 'weapon5': '0.144', 'AMMO3': '0.154', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '0.900', 'weapon3': '3.158', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '58.000'} [2024-08-06 04:12:46,138][52658] DAMAGECOUNT value on done: 492755.0 [2024-08-06 04:12:46,141][52658] Sum rewards: 66.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.153', 'weapon4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '55.000'} [2024-08-06 04:12:46,319][52662] DAMAGECOUNT value on done: 498898.0 [2024-08-06 04:12:46,320][52662] Sum rewards: 72.122, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.323', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.113', 'weapon4': '0.124', 'WEAPON3': '0.800', 'weapon2': '0.908', 'weapon3': '2.878', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:46,562][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:12:47,163][52671] DAMAGECOUNT value on done: 498105.0 [2024-08-06 04:12:47,166][52671] Sum rewards: 78.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.506', 'AMMO5': '0.023', 'AMMO2': '0.071', 'weapon4': '0.144', 'AMMO3': '0.187', 'weapon5': '0.296', 'AMMO4': '0.354', 'weapon2': '0.412', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.816', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '63.000'} [2024-08-06 04:12:47,317][52650] Updated weights for policy 0, policy_version 51721 (0.0023) [2024-08-06 04:12:47,468][52811] Large shaping reward -2.515 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.264, -88.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:12:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17477.2, 300 sec: 17467.0). Total num frames: 423698432. Throughput: 0: 4384.0. Samples: 105925920. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:12:47,794][52567] Avg episode reward: [(0, '71.777')] [2024-08-06 04:12:48,536][52803] DAMAGECOUNT value on done: 455239.0 [2024-08-06 04:12:48,538][52803] Sum rewards: 72.145, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.184', 'weapon4': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '58.000'} [2024-08-06 04:12:48,583][52669] DAMAGECOUNT value on done: 498008.0 [2024-08-06 04:12:48,584][52669] Sum rewards: 71.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.314', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.186', 'weapon4': '0.252', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.600', 'weapon3': '2.854', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:48,836][52811] DAMAGECOUNT value on done: 472729.0 [2024-08-06 04:12:48,842][52811] Sum rewards: 72.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.126', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2024-08-06 04:12:49,065][52662] DAMAGECOUNT value on done: 500770.0 [2024-08-06 04:12:49,066][52662] Sum rewards: 58.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.727', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'weapon2': '0.338', 'WEAPON3': '0.950', 'HITCOUNT': '3.000', 'weapon3': '3.386', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '47.000'} [2024-08-06 04:12:49,201][52668] DAMAGECOUNT value on done: 498440.0 [2024-08-06 04:12:49,203][52668] Sum rewards: 69.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.542', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.261', 'weapon2': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.402', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:49,213][52658] DAMAGECOUNT value on done: 496747.0 [2024-08-06 04:12:49,215][52658] Sum rewards: 67.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.364', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.116', 'AMMO4': '0.164', 'weapon2': '0.232', 'AMMO3': '0.235', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:50,066][52671] DAMAGECOUNT value on done: 503591.0 [2024-08-06 04:12:50,066][52671] Sum rewards: 70.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.134', 'weapon5': '0.158', 'AMMO4': '0.198', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:51,081][52669] DAMAGECOUNT value on done: 498429.0 [2024-08-06 04:12:51,081][52669] Sum rewards: 65.863, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.815', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.176', 'weapon2': '0.270', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.576', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '54.000'} [2024-08-06 04:12:51,611][52803] DAMAGECOUNT value on done: 461778.0 [2024-08-06 04:12:51,612][52803] Sum rewards: 75.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.486', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.170', 'AMMO4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.250', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '61.000'} [2024-08-06 04:12:51,613][52658] DAMAGECOUNT value on done: 499652.0 [2024-08-06 04:12:51,614][52658] Sum rewards: 78.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.892', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.232', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '65.000'} [2024-08-06 04:12:51,660][52662] DAMAGECOUNT value on done: 499696.0 [2024-08-06 04:12:51,665][52662] Sum rewards: 84.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.898', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.042', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.224', 'weapon2': '0.684', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '70.000'} [2024-08-06 04:12:51,691][52650] Updated weights for policy 0, policy_version 51731 (0.0016) [2024-08-06 04:12:51,959][52811] DAMAGECOUNT value on done: 460423.0 [2024-08-06 04:12:51,961][52811] Sum rewards: 78.481, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.205', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.185', 'weapon5': '0.220', 'weapon4': '0.276', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 04:12:52,441][52668] DAMAGECOUNT value on done: 489600.0 [2024-08-06 04:12:52,441][52668] Sum rewards: 78.948, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.002', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.070', 'AMMO4': '0.252', 'weapon5': '0.276', 'AMMO3': '0.284', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.976', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:52,474][52803] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:12:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 423796736. Throughput: 0: 4378.7. Samples: 105952120. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:12:52,794][52567] Avg episode reward: [(0, '72.285')] [2024-08-06 04:12:52,895][52671] DAMAGECOUNT value on done: 497335.0 [2024-08-06 04:12:52,897][52671] Sum rewards: 67.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.576', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.159', 'weapon2': '0.272', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.160', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '54.000'} [2024-08-06 04:12:54,000][52669] DAMAGECOUNT value on done: 512856.0 [2024-08-06 04:12:54,000][52669] Sum rewards: 93.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.082', 'AMMO4': '0.098', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.429', 'FRAGCOUNT': '76.000'} [2024-08-06 04:12:54,686][52803] DAMAGECOUNT value on done: 452770.0 [2024-08-06 04:12:54,687][52803] Sum rewards: 77.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '3.410', 'weapon3': '3.482', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '65.000'} [2024-08-06 04:12:54,712][52658] DAMAGECOUNT value on done: 498260.0 [2024-08-06 04:12:54,712][52658] Sum rewards: 60.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.369', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.102', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.342', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '51.500'} [2024-08-06 04:12:54,887][52662] DAMAGECOUNT value on done: 489575.0 [2024-08-06 04:12:54,889][52662] Sum rewards: 71.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.254', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.090', 'AMMO4': '0.166', 'AMMO3': '0.221', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:55,091][52811] DAMAGECOUNT value on done: 459860.0 [2024-08-06 04:12:55,099][52811] Sum rewards: 63.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.196', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.344', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '53.000'} [2024-08-06 04:12:55,420][52671] DAMAGECOUNT value on done: 493200.0 [2024-08-06 04:12:55,421][52671] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.858', 'AMMO5': '0.022', 'AMMO2': '0.069', 'AMMO3': '0.258', 'weapon4': '0.270', 'weapon5': '0.328', 'weapon2': '0.336', 'AMMO4': '0.347', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 04:12:55,542][52668] DAMAGECOUNT value on done: 492209.0 [2024-08-06 04:12:55,542][52668] Sum rewards: 71.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.082', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '59.000'} [2024-08-06 04:12:56,120][52660] DAMAGECOUNT value on done: 495727.0 [2024-08-06 04:12:56,121][52660] Sum rewards: 75.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.214', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO4': '0.216', 'weapon5': '0.226', 'AMMO3': '0.235', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '60.000'} [2024-08-06 04:12:56,873][52669] DAMAGECOUNT value on done: 500539.0 [2024-08-06 04:12:56,874][52669] Sum rewards: 80.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.586', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.142', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:56,902][52650] Updated weights for policy 0, policy_version 51741 (0.0013) [2024-08-06 04:12:57,427][52662] DAMAGECOUNT value on done: 500046.0 [2024-08-06 04:12:57,429][52662] Sum rewards: 76.226, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO4': '0.213', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '66.000'} [2024-08-06 04:12:57,730][52803] DAMAGECOUNT value on done: 468176.0 [2024-08-06 04:12:57,730][52803] Sum rewards: 66.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.096', 'weapon4': '0.190', 'AMMO4': '0.237', 'AMMO3': '0.241', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '57.000'} [2024-08-06 04:12:57,762][52658] DAMAGECOUNT value on done: 488567.0 [2024-08-06 04:12:57,763][52658] Sum rewards: 77.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'weapon2': '0.206', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.476', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '67.000'} [2024-08-06 04:12:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 423878656. Throughput: 0: 4375.8. Samples: 105978410. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:12:57,794][52567] Avg episode reward: [(0, '72.691')] [2024-08-06 04:12:57,805][52614] Saving new best policy, reward=72.691! [2024-08-06 04:12:57,925][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:12:57,942][52671] DAMAGECOUNT value on done: 499403.0 [2024-08-06 04:12:57,950][52671] Sum rewards: 73.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.983', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.114', 'AMMO4': '0.197', 'weapon2': '0.216', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '62.000'} [2024-08-06 04:12:58,073][52811] DAMAGECOUNT value on done: 462040.0 [2024-08-06 04:12:58,081][52811] Sum rewards: 75.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.788', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.118', 'weapon5': '0.170', 'AMMO3': '0.201', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '63.000'} [2024-08-06 04:12:58,767][52668] DAMAGECOUNT value on done: 500927.0 [2024-08-06 04:12:58,767][52668] Sum rewards: 75.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.113', 'weapon5': '0.134', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '63.000'} [2024-08-06 04:12:59,210][52660] DAMAGECOUNT value on done: 486301.0 [2024-08-06 04:12:59,211][52660] Sum rewards: 72.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.211', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO4': '0.106', 'AMMO3': '0.224', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.444', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '60.500'} [2024-08-06 04:12:59,977][52669] DAMAGECOUNT value on done: 497982.0 [2024-08-06 04:12:59,978][52669] Sum rewards: 82.960, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.042', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.258', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '67.000'} [2024-08-06 04:13:00,446][52662] DAMAGECOUNT value on done: 492001.0 [2024-08-06 04:13:00,447][52662] Sum rewards: 66.531, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.671', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.055', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.330', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.456', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '54.000'} [2024-08-06 04:13:00,478][52658] DAMAGECOUNT value on done: 491417.0 [2024-08-06 04:13:00,478][52658] Sum rewards: 61.583, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.318', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.106', 'AMMO3': '0.154', 'weapon4': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.174', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '50.000'} [2024-08-06 04:13:00,935][52650] Updated weights for policy 0, policy_version 51751 (0.0012) [2024-08-06 04:13:00,956][52803] DAMAGECOUNT value on done: 464022.0 [2024-08-06 04:13:00,957][52803] Sum rewards: 78.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.395', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.092', 'AMMO3': '0.183', 'weapon2': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:01,173][52671] DAMAGECOUNT value on done: 500948.0 [2024-08-06 04:13:01,174][52671] Sum rewards: 68.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.094', 'weapon5': '0.182', 'AMMO3': '0.190', 'AMMO4': '0.227', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.216', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '57.000'} [2024-08-06 04:13:01,462][52811] DAMAGECOUNT value on done: 457229.0 [2024-08-06 04:13:01,463][52811] Sum rewards: 71.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.885', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.154', 'weapon5': '0.220', 'AMMO3': '0.222', 'weapon2': '0.280', 'AMMO4': '0.281', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:01,724][52668] DAMAGECOUNT value on done: 494612.0 [2024-08-06 04:13:01,725][52668] Sum rewards: 81.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.120', 'AMMO4': '0.191', 'AMMO3': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '66.000'} [2024-08-06 04:13:02,327][52660] DAMAGECOUNT value on done: 496867.0 [2024-08-06 04:13:02,328][52660] Sum rewards: 69.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.260', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:02,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 423960576. Throughput: 0: 4366.0. Samples: 105991330. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:13:02,795][52567] Avg episode reward: [(0, '72.528')] [2024-08-06 04:13:02,946][52658] DAMAGECOUNT value on done: 500885.0 [2024-08-06 04:13:02,946][52658] Sum rewards: 83.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.345', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.140', 'weapon5': '0.158', 'AMMO4': '0.182', 'AMMO3': '0.234', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '70.000'} [2024-08-06 04:13:02,983][52669] DAMAGECOUNT value on done: 501198.0 [2024-08-06 04:13:02,991][52669] Sum rewards: 59.876, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.110', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '3.450', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '49.000'} [2024-08-06 04:13:03,463][52662] DAMAGECOUNT value on done: 500405.0 [2024-08-06 04:13:03,464][52662] Sum rewards: 72.990, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.950', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.068', 'weapon4': '0.094', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.648', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:04,066][52803] DAMAGECOUNT value on done: 458663.0 [2024-08-06 04:13:04,067][52803] Sum rewards: 60.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.126', 'AMMO4': '0.242', 'AMMO3': '0.261', 'weapon5': '0.304', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.854', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '53.000'} [2024-08-06 04:13:04,107][52671] DAMAGECOUNT value on done: 497549.0 [2024-08-06 04:13:04,108][52671] Sum rewards: 72.821, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.045', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO3': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON5': '0.350', 'weapon4': '0.478', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:04,586][52811] DAMAGECOUNT value on done: 462786.0 [2024-08-06 04:13:04,591][52811] Sum rewards: 77.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.095', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.380', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:04,827][52668] DAMAGECOUNT value on done: 488395.0 [2024-08-06 04:13:04,827][52668] Sum rewards: 54.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.432', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.150', 'HITCOUNT': '2.510', 'weapon3': '2.828', 'DAMAGECOUNT': '12.726', 'FRAGCOUNT': '46.000'} [2024-08-06 04:13:05,271][52660] DAMAGECOUNT value on done: 503216.0 [2024-08-06 04:13:05,272][52660] Sum rewards: 76.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.595', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:05,826][52658] DAMAGECOUNT value on done: 490420.0 [2024-08-06 04:13:05,827][52658] Sum rewards: 66.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.175', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.072', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'weapon2': '0.190', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.454', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '56.000'} [2024-08-06 04:13:05,907][52669] DAMAGECOUNT value on done: 501634.0 [2024-08-06 04:13:05,908][52669] Sum rewards: 74.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.038', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.262', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:06,082][52650] Updated weights for policy 0, policy_version 51761 (0.0024) [2024-08-06 04:13:06,199][52662] DAMAGECOUNT value on done: 504516.0 [2024-08-06 04:13:06,200][52662] Sum rewards: 71.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.585', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.122', 'weapon5': '0.162', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:07,001][52671] DAMAGECOUNT value on done: 505854.0 [2024-08-06 04:13:07,002][52671] Sum rewards: 75.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.685', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.490', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:07,300][52803] DAMAGECOUNT value on done: 465413.0 [2024-08-06 04:13:07,301][52803] Sum rewards: 76.527, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.177', 'weapon5': '0.178', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON4': '0.450', 'weapon4': '0.492', 'WEAPON3': '1.050', 'weapon3': '2.686', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:07,550][52668] DAMAGECOUNT value on done: 484249.0 [2024-08-06 04:13:07,550][52668] Sum rewards: 74.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.135', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.142', 'AMMO3': '0.211', 'AMMO4': '0.266', 'weapon2': '0.314', 'weapon5': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:07,645][52811] DAMAGECOUNT value on done: 464548.0 [2024-08-06 04:13:07,648][52811] Sum rewards: 84.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.560', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '70.000'} [2024-08-06 04:13:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.8). Total num frames: 424058880. Throughput: 0: 4362.5. Samples: 106017730. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:13:07,794][52567] Avg episode reward: [(0, '72.633')] [2024-08-06 04:13:07,994][52660] DAMAGECOUNT value on done: 495535.0 [2024-08-06 04:13:08,001][52660] Sum rewards: 68.722, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.174', 'AMMO3': '0.212', 'AMMO4': '0.264', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:08,911][52658] DAMAGECOUNT value on done: 505735.0 [2024-08-06 04:13:08,911][52658] Sum rewards: 79.341, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.095', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.096', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.224', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '66.000'} [2024-08-06 04:13:08,924][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:13:09,373][52662] DAMAGECOUNT value on done: 494302.0 [2024-08-06 04:13:09,373][52662] Sum rewards: 76.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.932', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.222', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:09,883][52671] DAMAGECOUNT value on done: 500202.0 [2024-08-06 04:13:09,883][52671] Sum rewards: 93.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.235', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.172', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.422', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.113', 'FRAGCOUNT': '74.000'} [2024-08-06 04:13:09,890][52665] DAMAGECOUNT value on done: 484975.0 [2024-08-06 04:13:09,893][52665] Sum rewards: 76.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.269', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.066', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:10,092][52668] DAMAGECOUNT value on done: 483958.0 [2024-08-06 04:13:10,095][52668] Sum rewards: 65.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.306', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.312', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '57.000'} [2024-08-06 04:13:10,562][52803] DAMAGECOUNT value on done: 460764.0 [2024-08-06 04:13:10,563][52803] Sum rewards: 63.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.110', 'weapon5': '0.140', 'AMMO3': '0.240', 'AMMO4': '0.262', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.990', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '53.000'} [2024-08-06 04:13:10,580][52650] Updated weights for policy 0, policy_version 51771 (0.0012) [2024-08-06 04:13:10,717][52660] DAMAGECOUNT value on done: 492461.0 [2024-08-06 04:13:10,719][52660] Sum rewards: 77.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:10,751][52811] DAMAGECOUNT value on done: 459118.0 [2024-08-06 04:13:10,752][52811] Sum rewards: 72.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.050', 'HITCOUNT': '3.300', 'weapon3': '3.370', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:11,458][52658] DAMAGECOUNT value on done: 492563.0 [2024-08-06 04:13:11,459][52658] Sum rewards: 74.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.466', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon2': '0.192', 'weapon5': '0.202', 'AMMO3': '0.206', 'weapon4': '0.266', 'AMMO4': '0.294', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:11,631][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:13:12,528][52662] DAMAGECOUNT value on done: 507239.0 [2024-08-06 04:13:12,528][52662] Sum rewards: 75.603, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.114', 'AMMO4': '0.221', 'AMMO3': '0.243', 'weapon5': '0.258', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '65.000'} [2024-08-06 04:13:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 424140800. Throughput: 0: 4349.8. Samples: 106043710. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:13:12,794][52567] Avg episode reward: [(0, '72.848')] [2024-08-06 04:13:12,795][52614] Saving new best policy, reward=72.848! [2024-08-06 04:13:12,826][52668] DAMAGECOUNT value on done: 486036.0 [2024-08-06 04:13:12,826][52668] Sum rewards: 73.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.265', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.034', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.390', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:12,834][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:13:12,876][52671] DAMAGECOUNT value on done: 486824.0 [2024-08-06 04:13:12,878][52671] Sum rewards: 76.922, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.000', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.134', 'weapon5': '0.152', 'AMMO4': '0.218', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '65.500'} [2024-08-06 04:13:12,976][52665] DAMAGECOUNT value on done: 497944.0 [2024-08-06 04:13:12,976][52665] Sum rewards: 74.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.142', 'weapon4': '0.154', 'AMMO3': '0.216', 'AMMO4': '0.230', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:13,499][52660] DAMAGECOUNT value on done: 490299.0 [2024-08-06 04:13:13,501][52660] Sum rewards: 60.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.634', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.122', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '51.000'} [2024-08-06 04:13:13,593][52803] DAMAGECOUNT value on done: 457611.0 [2024-08-06 04:13:13,594][52803] Sum rewards: 80.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.645', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.165', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '3.316', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:13,859][52811] DAMAGECOUNT value on done: 461805.0 [2024-08-06 04:13:13,861][52811] Sum rewards: 74.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.101', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.000', 'weapon3': '3.328', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:14,569][52658] DAMAGECOUNT value on done: 506847.0 [2024-08-06 04:13:14,569][52658] Sum rewards: 78.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.989', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.242', 'AMMO3': '0.298', 'WEAPON3': '1.700', 'weapon3': '3.412', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '67.000'} [2024-08-06 04:13:15,287][52647] DAMAGECOUNT value on done: 522404.0 [2024-08-06 04:13:15,289][52647] Sum rewards: 77.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.068', 'weapon5': '0.068', 'AMMO4': '0.090', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON3': '1.350', 'HITCOUNT': '3.500', 'weapon3': '3.506', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '66.000'} [2024-08-06 04:13:15,302][52650] Updated weights for policy 0, policy_version 51781 (0.0011) [2024-08-06 04:13:15,497][52668] DAMAGECOUNT value on done: 493993.0 [2024-08-06 04:13:15,498][52668] Sum rewards: 73.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO4': '0.189', 'weapon2': '0.198', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:15,714][52671] DAMAGECOUNT value on done: 505369.0 [2024-08-06 04:13:15,717][52671] Sum rewards: 68.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.174', 'AMMO3': '0.235', 'weapon4': '0.240', 'AMMO4': '0.259', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:15,770][52662] DAMAGECOUNT value on done: 494808.0 [2024-08-06 04:13:15,771][52662] Sum rewards: 77.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.322', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.115', 'weapon5': '0.132', 'WEAPON4': '0.250', 'AMMO3': '0.293', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.650', 'weapon3': '2.966', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '66.000'} [2024-08-06 04:13:15,982][52665] DAMAGECOUNT value on done: 493727.0 [2024-08-06 04:13:15,984][52665] Sum rewards: 64.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.805', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.172', 'weapon5': '0.174', 'AMMO3': '0.186', 'weapon2': '0.220', 'AMMO4': '0.248', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.154', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '54.000'} [2024-08-06 04:13:16,249][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:13:16,259][52660] DAMAGECOUNT value on done: 500035.0 [2024-08-06 04:13:16,260][52660] Sum rewards: 78.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon4': '0.296', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:16,686][52803] DAMAGECOUNT value on done: 465461.0 [2024-08-06 04:13:16,688][52803] Sum rewards: 66.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.354', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.174', 'AMMO3': '0.219', 'AMMO4': '0.221', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '56.000'} [2024-08-06 04:13:17,254][52658] DAMAGECOUNT value on done: 489224.0 [2024-08-06 04:13:17,255][52658] Sum rewards: 70.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.906', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:17,763][52647] DAMAGECOUNT value on done: 523308.0 [2024-08-06 04:13:17,764][52647] Sum rewards: 73.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.348', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.048', 'AMMO4': '0.135', 'weapon5': '0.138', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:17,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 424222720. Throughput: 0: 4354.0. Samples: 106056600. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 04:13:17,795][52567] Avg episode reward: [(0, '72.846')] [2024-08-06 04:13:18,025][52668] DAMAGECOUNT value on done: 497412.0 [2024-08-06 04:13:18,026][52668] Sum rewards: 60.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.060', 'weapon4': '0.078', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '51.000'} [2024-08-06 04:13:18,550][52660] DAMAGECOUNT value on done: 495083.0 [2024-08-06 04:13:18,552][52660] Sum rewards: 62.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.441', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.242', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '53.000'} [2024-08-06 04:13:18,872][52671] DAMAGECOUNT value on done: 503189.0 [2024-08-06 04:13:18,873][52671] Sum rewards: 69.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:18,908][52665] DAMAGECOUNT value on done: 488907.0 [2024-08-06 04:13:18,908][52665] Sum rewards: 76.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.126', 'weapon4': '0.140', 'AMMO4': '0.165', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:19,374][52662] DAMAGECOUNT value on done: 498060.0 [2024-08-06 04:13:19,374][52662] Sum rewards: 63.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.124', 'AMMO4': '0.200', 'weapon5': '0.212', 'AMMO3': '0.213', 'weapon2': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.210', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '53.500'} [2024-08-06 04:13:19,758][52803] DAMAGECOUNT value on done: 463825.0 [2024-08-06 04:13:19,760][52803] Sum rewards: 69.901, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.082', 'AMMO4': '0.196', 'weapon2': '0.238', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:20,110][52650] Updated weights for policy 0, policy_version 51791 (0.0013) [2024-08-06 04:13:20,305][52658] DAMAGECOUNT value on done: 496080.0 [2024-08-06 04:13:20,310][52658] Sum rewards: 61.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.120', 'AMMO3': '0.169', 'weapon5': '0.208', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '50.500'} [2024-08-06 04:13:20,694][52647] DAMAGECOUNT value on done: 518517.0 [2024-08-06 04:13:20,694][52647] Sum rewards: 71.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:20,934][52668] DAMAGECOUNT value on done: 494493.0 [2024-08-06 04:13:20,935][52668] Sum rewards: 64.395, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.030', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.150', 'weapon4': '0.256', 'AMMO4': '0.271', 'AMMO3': '0.298', 'weapon2': '0.342', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.966', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:21,571][52671] DAMAGECOUNT value on done: 502545.0 [2024-08-06 04:13:21,571][52671] Sum rewards: 71.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.230', 'AMMO4': '0.251', 'AMMO3': '0.261', 'weapon5': '0.294', 'weapon2': '0.334', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.806', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:21,665][52660] DAMAGECOUNT value on done: 493150.0 [2024-08-06 04:13:21,668][52660] Sum rewards: 78.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.146', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.046', 'AMMO4': '0.151', 'weapon5': '0.172', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '66.000'} [2024-08-06 04:13:21,851][52665] DAMAGECOUNT value on done: 478734.0 [2024-08-06 04:13:21,852][52665] Sum rewards: 66.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.932', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.152', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '53.000'} [2024-08-06 04:13:22,469][52662] DAMAGECOUNT value on done: 493560.0 [2024-08-06 04:13:22,469][52662] Sum rewards: 75.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.114', 'AMMO3': '0.196', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 424312832. Throughput: 0: 4359.3. Samples: 106082760. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 04:13:22,794][52567] Avg episode reward: [(0, '72.451')] [2024-08-06 04:13:22,881][52803] DAMAGECOUNT value on done: 466179.0 [2024-08-06 04:13:22,881][52803] Sum rewards: 73.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.249', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO3': '0.158', 'AMMO4': '0.162', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '0.950', 'weapon3': '2.976', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:23,182][52658] DAMAGECOUNT value on done: 495180.0 [2024-08-06 04:13:23,182][52658] Sum rewards: 79.985, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.334', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:23,499][52647] DAMAGECOUNT value on done: 528893.0 [2024-08-06 04:13:23,499][52647] Sum rewards: 65.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.819', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.106', 'AMMO4': '0.119', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.212', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:23,757][52668] DAMAGECOUNT value on done: 498718.0 [2024-08-06 04:13:23,759][52668] Sum rewards: 65.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO4': '0.185', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.500'} [2024-08-06 04:13:24,417][52660] DAMAGECOUNT value on done: 501181.0 [2024-08-06 04:13:24,419][52660] Sum rewards: 78.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.244', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.456', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '66.000'} [2024-08-06 04:13:24,737][52671] DAMAGECOUNT value on done: 499244.0 [2024-08-06 04:13:24,739][52671] Sum rewards: 66.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.821', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.148', 'AMMO3': '0.194', 'AMMO4': '0.222', 'weapon2': '0.224', 'weapon5': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.074', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:24,971][52665] DAMAGECOUNT value on done: 485793.0 [2024-08-06 04:13:24,972][52665] Sum rewards: 72.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.775', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon4': '0.162', 'weapon5': '0.176', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:25,085][52650] Updated weights for policy 0, policy_version 51801 (0.0026) [2024-08-06 04:13:25,332][52662] DAMAGECOUNT value on done: 502771.0 [2024-08-06 04:13:25,332][52662] Sum rewards: 70.665, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.802', 'AMMO5': '0.022', 'AMMO2': '0.044', 'AMMO4': '0.218', 'AMMO3': '0.231', 'weapon2': '0.250', 'weapon5': '0.266', 'weapon4': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:25,880][52658] DAMAGECOUNT value on done: 494277.0 [2024-08-06 04:13:25,882][52658] Sum rewards: 78.576, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.540', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.664', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:26,038][52803] DAMAGECOUNT value on done: 456767.0 [2024-08-06 04:13:26,039][52803] Sum rewards: 55.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.945', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.110', 'weapon5': '0.138', 'AMMO4': '0.168', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.226', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '48.000'} [2024-08-06 04:13:26,153][52647] DAMAGECOUNT value on done: 527866.0 [2024-08-06 04:13:26,153][52647] Sum rewards: 69.873, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.530', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.080', 'weapon5': '0.236', 'AMMO4': '0.248', 'weapon2': '0.252', 'AMMO3': '0.291', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.104', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:26,825][52668] DAMAGECOUNT value on done: 494773.0 [2024-08-06 04:13:26,827][52668] Sum rewards: 64.718, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.844', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.106', 'AMMO4': '0.237', 'weapon5': '0.242', 'AMMO3': '0.279', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2024-08-06 04:13:27,172][52671] DAMAGECOUNT value on done: 495575.0 [2024-08-06 04:13:27,173][52671] Sum rewards: 79.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.452', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.084', 'weapon4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '68.000'} [2024-08-06 04:13:27,333][52660] DAMAGECOUNT value on done: 487001.0 [2024-08-06 04:13:27,334][52660] Sum rewards: 73.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:27,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17339.9, 300 sec: 17494.8). Total num frames: 424402944. Throughput: 0: 4358.4. Samples: 106109100. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 04:13:27,794][52567] Avg episode reward: [(0, '72.485')] [2024-08-06 04:13:27,908][52665] DAMAGECOUNT value on done: 489143.0 [2024-08-06 04:13:27,909][52665] Sum rewards: 68.211, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.458', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.110', 'weapon5': '0.128', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'weapon2': '0.298', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.168', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:28,050][52662] DAMAGECOUNT value on done: 496544.0 [2024-08-06 04:13:28,050][52662] Sum rewards: 70.587, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.070', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.276', 'AMMO3': '0.294', 'WEAPON3': '1.600', 'weapon3': '3.354', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:28,866][52658] DAMAGECOUNT value on done: 487697.0 [2024-08-06 04:13:28,876][52658] Sum rewards: 75.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.083', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:29,309][52650] Updated weights for policy 0, policy_version 51811 (0.0014) [2024-08-06 04:13:29,320][52647] DAMAGECOUNT value on done: 526278.0 [2024-08-06 04:13:29,320][52647] Sum rewards: 85.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.021', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.204', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '71.000'} [2024-08-06 04:13:30,160][52660] DAMAGECOUNT value on done: 495670.0 [2024-08-06 04:13:30,163][52660] Sum rewards: 75.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.254', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon4': '0.206', 'weapon5': '0.216', 'AMMO3': '0.225', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:30,858][52665] DAMAGECOUNT value on done: 492109.0 [2024-08-06 04:13:30,861][52665] Sum rewards: 68.842, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.730', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.164', 'weapon2': '0.204', 'weapon5': '0.218', 'AMMO4': '0.225', 'AMMO3': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:30,923][52662] DAMAGECOUNT value on done: 506397.0 [2024-08-06 04:13:30,925][52662] Sum rewards: 76.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:31,922][52647] DAMAGECOUNT value on done: 522160.0 [2024-08-06 04:13:31,922][52647] Sum rewards: 64.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.144', 'AMMO4': '0.146', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.246', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '53.000'} [2024-08-06 04:13:31,952][52658] DAMAGECOUNT value on done: 503886.0 [2024-08-06 04:13:31,955][52658] Sum rewards: 67.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.084', 'AMMO3': '0.207', 'AMMO4': '0.210', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '57.000'} [2024-08-06 04:13:31,998][52664] DAMAGECOUNT value on done: 513776.0 [2024-08-06 04:13:31,998][52664] Sum rewards: 53.759, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.045', 'AMMO5': '0.007', 'AMMO2': '0.038', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.121', 'weapon5': '0.154', 'weapon7': '0.156', 'AMMO4': '0.192', 'weapon2': '0.198', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.400', 'weapon4': '0.606', 'WEAPON3': '0.700', 'HITCOUNT': '2.460', 'weapon3': '2.562', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '41.000'} [2024-08-06 04:13:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 424493056. Throughput: 0: 4356.2. Samples: 106121950. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 04:13:32,794][52567] Avg episode reward: [(0, '71.930')] [2024-08-06 04:13:33,064][52660] DAMAGECOUNT value on done: 503932.0 [2024-08-06 04:13:33,067][52660] Sum rewards: 80.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.102', 'weapon4': '0.114', 'weapon2': '0.166', 'AMMO4': '0.187', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.440', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 04:13:33,798][52662] DAMAGECOUNT value on done: 499897.0 [2024-08-06 04:13:33,800][52662] Sum rewards: 79.781, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.168', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.128', 'AMMO4': '0.183', 'weapon2': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.316', 'WEAPON3': '0.750', 'weapon4': '0.844', 'weapon3': '2.406', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:33,910][52665] DAMAGECOUNT value on done: 497608.0 [2024-08-06 04:13:33,910][52665] Sum rewards: 81.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.472', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.132', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '65.000'} [2024-08-06 04:13:34,440][52650] Updated weights for policy 0, policy_version 51821 (0.0022) [2024-08-06 04:13:34,511][52647] DAMAGECOUNT value on done: 516463.0 [2024-08-06 04:13:34,512][52647] Sum rewards: 75.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.617', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.197', 'WEAPON3': '1.250', 'weapon3': '3.522', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:34,598][52664] DAMAGECOUNT value on done: 519548.0 [2024-08-06 04:13:34,598][52664] Sum rewards: 47.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.410', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'weapon7': '0.214', 'AMMO3': '0.253', 'weapon2': '0.580', 'WEAPON3': '1.500', 'HITCOUNT': '2.570', 'weapon3': '2.986', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '42.000'} [2024-08-06 04:13:34,821][52658] DAMAGECOUNT value on done: 494046.0 [2024-08-06 04:13:34,822][52658] Sum rewards: 77.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.478', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.071', 'weapon5': '0.082', 'weapon2': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON3': '1.350', 'weapon3': '3.498', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:35,914][52660] DAMAGECOUNT value on done: 508304.0 [2024-08-06 04:13:35,914][52660] Sum rewards: 75.563, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.162', 'weapon2': '0.256', 'weapon4': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:36,735][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:13:36,819][52662] DAMAGECOUNT value on done: 492429.0 [2024-08-06 04:13:36,819][52662] Sum rewards: 74.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.851', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.120', 'AMMO3': '0.183', 'AMMO4': '0.211', 'weapon5': '0.218', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:36,934][52665] DAMAGECOUNT value on done: 488019.0 [2024-08-06 04:13:36,937][52665] Sum rewards: 60.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.025', 'AMMO2': '0.060', 'weapon4': '0.110', 'weapon5': '0.202', 'AMMO3': '0.223', 'AMMO4': '0.298', 'weapon2': '0.352', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.054', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '54.000'} [2024-08-06 04:13:37,053][52647] DAMAGECOUNT value on done: 526759.0 [2024-08-06 04:13:37,054][52647] Sum rewards: 71.314, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.798', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.200', 'weapon5': '0.252', 'AMMO3': '0.258', 'weapon2': '0.266', 'AMMO4': '0.301', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:37,244][52664] DAMAGECOUNT value on done: 518374.0 [2024-08-06 04:13:37,245][52664] Sum rewards: 62.754, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.070', 'weapon5': '0.148', 'AMMO3': '0.268', 'weapon4': '0.290', 'AMMO4': '0.352', 'WEAPON5': '0.400', 'weapon2': '0.628', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.644', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 424574976. Throughput: 0: 4366.7. Samples: 106148620. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 04:13:37,794][52567] Avg episode reward: [(0, '71.804')] [2024-08-06 04:13:37,838][52658] DAMAGECOUNT value on done: 497998.0 [2024-08-06 04:13:37,838][52658] Sum rewards: 69.536, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.165', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.152', 'AMMO3': '0.230', 'weapon2': '0.242', 'AMMO4': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:38,595][52650] Updated weights for policy 0, policy_version 51831 (0.0010) [2024-08-06 04:13:38,918][52660] DAMAGECOUNT value on done: 491214.0 [2024-08-06 04:13:38,928][52660] Sum rewards: 52.267, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.054', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.164', 'weapon4': '0.236', 'AMMO4': '0.267', 'weapon2': '0.294', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '2.860', 'weapon3': '2.966', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '48.000'} [2024-08-06 04:13:39,681][52647] DAMAGECOUNT value on done: 520565.0 [2024-08-06 04:13:39,682][52647] Sum rewards: 74.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.183', 'weapon4': '0.192', 'weapon5': '0.248', 'AMMO4': '0.248', 'weapon2': '0.412', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:39,794][52664] DAMAGECOUNT value on done: 510240.0 [2024-08-06 04:13:39,796][52664] Sum rewards: 77.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.188', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.168', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '3.350', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:39,811][52662] DAMAGECOUNT value on done: 497374.0 [2024-08-06 04:13:39,812][52662] Sum rewards: 69.173, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.098', 'weapon4': '0.102', 'AMMO4': '0.106', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:40,011][52795] DAMAGECOUNT value on done: 461200.0 [2024-08-06 04:13:40,013][52795] Sum rewards: 72.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.738', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.171', 'weapon5': '0.262', 'weapon4': '0.278', 'AMMO4': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.622', 'WEAPON3': '1.000', 'weapon3': '2.544', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:40,089][52665] DAMAGECOUNT value on done: 498888.0 [2024-08-06 04:13:40,089][52665] Sum rewards: 54.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.214', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'weapon2': '0.392', 'weapon4': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '45.000'} [2024-08-06 04:13:40,944][52658] DAMAGECOUNT value on done: 502271.0 [2024-08-06 04:13:40,944][52658] Sum rewards: 65.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.145', 'weapon4': '0.158', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:42,176][52662] DAMAGECOUNT value on done: 491332.0 [2024-08-06 04:13:42,177][52662] Sum rewards: 69.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.248', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.136', 'weapon4': '0.226', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '57.000'} [2024-08-06 04:13:42,243][52660] DAMAGECOUNT value on done: 500354.0 [2024-08-06 04:13:42,243][52660] Sum rewards: 75.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.138', 'weapon5': '0.144', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:42,306][52647] DAMAGECOUNT value on done: 523944.0 [2024-08-06 04:13:42,307][52647] Sum rewards: 77.749, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.024', 'HEALTH': '0.083', 'AMMO4': '0.117', 'weapon4': '0.126', 'AMMO3': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.526', 'WEAPON3': '0.900', 'weapon3': '2.996', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '59.500'} [2024-08-06 04:13:42,502][52664] DAMAGECOUNT value on done: 517482.0 [2024-08-06 04:13:42,502][52664] Sum rewards: 69.147, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.983', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.250', 'AMMO3': '0.329', 'weapon2': '0.360', 'WEAPON3': '1.900', 'weapon3': '3.014', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 424665088. Throughput: 0: 4361.3. Samples: 106174670. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 04:13:42,795][52567] Avg episode reward: [(0, '71.352')] [2024-08-06 04:13:42,863][52665] DAMAGECOUNT value on done: 495704.0 [2024-08-06 04:13:42,864][52665] Sum rewards: 77.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.655', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.136', 'AMMO4': '0.173', 'weapon5': '0.226', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '0.900', 'weapon3': '2.884', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:42,898][52794] DAMAGECOUNT value on done: 498726.0 [2024-08-06 04:13:42,898][52794] Sum rewards: 84.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.446', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.202', 'AMMO3': '0.208', 'AMMO4': '0.219', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.393', 'FRAGCOUNT': '68.000'} [2024-08-06 04:13:43,088][52795] DAMAGECOUNT value on done: 450341.0 [2024-08-06 04:13:43,088][52795] Sum rewards: 61.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.198', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.290', 'ARMOR': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.138', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '53.000'} [2024-08-06 04:13:43,832][52650] Updated weights for policy 0, policy_version 51841 (0.0026) [2024-08-06 04:13:43,878][52659] DAMAGECOUNT value on done: 499844.0 [2024-08-06 04:13:43,878][52659] Sum rewards: 72.340, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.414', 'AMMO5': '0.025', 'AMMO2': '0.060', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO3': '0.245', 'AMMO4': '0.301', 'weapon2': '0.346', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:45,180][52647] DAMAGECOUNT value on done: 514374.0 [2024-08-06 04:13:45,181][52647] Sum rewards: 67.881, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.050', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.149', 'weapon2': '0.816', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2024-08-06 04:13:45,235][52660] DAMAGECOUNT value on done: 492131.0 [2024-08-06 04:13:45,236][52660] Sum rewards: 74.734, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.066', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.234', 'WEAPON3': '1.050', 'weapon3': '3.330', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '60.000'} [2024-08-06 04:13:45,342][52664] DAMAGECOUNT value on done: 513040.0 [2024-08-06 04:13:45,343][52664] Sum rewards: 61.907, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.104', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '56.000'} [2024-08-06 04:13:45,382][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:13:45,750][52665] DAMAGECOUNT value on done: 491069.0 [2024-08-06 04:13:45,755][52665] Sum rewards: 83.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.836', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.114', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '68.000'} [2024-08-06 04:13:46,060][52794] DAMAGECOUNT value on done: 501577.0 [2024-08-06 04:13:46,060][52794] Sum rewards: 70.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.102', 'weapon5': '0.114', 'AMMO4': '0.164', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '57.000'} [2024-08-06 04:13:46,365][52795] DAMAGECOUNT value on done: 450794.0 [2024-08-06 04:13:46,365][52795] Sum rewards: 60.106, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.268', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO4': '0.193', 'weapon4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.318', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.900', 'weapon3': '2.938', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:46,474][52659] DAMAGECOUNT value on done: 496271.0 [2024-08-06 04:13:46,480][52659] Sum rewards: 64.058, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.007', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.180', 'weapon2': '0.184', 'weapon4': '0.198', 'AMMO4': '0.222', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.152', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 424755200. Throughput: 0: 4363.8. Samples: 106187700. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 04:13:47,794][52567] Avg episode reward: [(0, '71.345')] [2024-08-06 04:13:47,903][52647] DAMAGECOUNT value on done: 526331.0 [2024-08-06 04:13:47,906][52647] Sum rewards: 73.647, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.416', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '63.000'} [2024-08-06 04:13:47,927][52650] Updated weights for policy 0, policy_version 51851 (0.0033) [2024-08-06 04:13:48,073][52660] DAMAGECOUNT value on done: 494249.0 [2024-08-06 04:13:48,075][52660] Sum rewards: 83.442, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.776', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO4': '0.173', 'weapon4': '0.184', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '71.000'} [2024-08-06 04:13:48,196][52664] DAMAGECOUNT value on done: 513827.0 [2024-08-06 04:13:48,196][52664] Sum rewards: 74.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.177', 'AMMO5': '0.025', 'AMMO2': '0.072', 'weapon4': '0.130', 'AMMO3': '0.196', 'weapon5': '0.322', 'AMMO4': '0.358', 'weapon2': '0.454', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '59.000'} [2024-08-06 04:13:48,342][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:13:49,019][52665] DAMAGECOUNT value on done: 488567.0 [2024-08-06 04:13:49,021][52665] Sum rewards: 72.698, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.135', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.166', 'weapon2': '0.202', 'AMMO4': '0.206', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:49,122][52794] DAMAGECOUNT value on done: 500589.0 [2024-08-06 04:13:49,124][52794] Sum rewards: 77.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.573', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.246', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '2.956', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '64.000'} [2024-08-06 04:13:49,459][52795] DAMAGECOUNT value on done: 458131.0 [2024-08-06 04:13:49,459][52795] Sum rewards: 69.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.969', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.172', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.350', 'weapon3': '3.460', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '57.500'} [2024-08-06 04:13:49,493][52659] DAMAGECOUNT value on done: 499471.0 [2024-08-06 04:13:49,493][52659] Sum rewards: 68.960, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.164', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.720', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:51,011][52647] DAMAGECOUNT value on done: 519793.0 [2024-08-06 04:13:51,011][52647] Sum rewards: 66.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.516', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.144', 'weapon5': '0.172', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.194', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '55.000'} [2024-08-06 04:13:51,124][52660] DAMAGECOUNT value on done: 487322.0 [2024-08-06 04:13:51,125][52660] Sum rewards: 72.248, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.048', 'AMMO4': '0.074', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.612', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:51,360][52664] DAMAGECOUNT value on done: 508836.0 [2024-08-06 04:13:51,360][52664] Sum rewards: 67.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.182', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.256', 'AMMO3': '0.260', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:52,096][52794] DAMAGECOUNT value on done: 493618.0 [2024-08-06 04:13:52,100][52794] Sum rewards: 65.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.068', 'weapon5': '0.168', 'AMMO3': '0.204', 'AMMO4': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.206', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 04:13:52,135][52665] DAMAGECOUNT value on done: 489295.0 [2024-08-06 04:13:52,138][52665] Sum rewards: 58.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.192', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.188', 'AMMO4': '0.215', 'AMMO3': '0.234', 'weapon4': '0.288', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '2.902', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '50.000'} [2024-08-06 04:13:52,374][52794] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:13:52,583][52795] DAMAGECOUNT value on done: 453516.0 [2024-08-06 04:13:52,583][52795] Sum rewards: 65.368, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.191', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.018', 'weapon4': '0.034', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.264', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '3.430', 'weapon3': '3.470', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:52,598][52659] DAMAGECOUNT value on done: 496441.0 [2024-08-06 04:13:52,601][52659] Sum rewards: 75.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.878', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.097', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 424837120. Throughput: 0: 4351.3. Samples: 106213540. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:13:52,795][52567] Avg episode reward: [(0, '70.729')] [2024-08-06 04:13:53,061][52650] Updated weights for policy 0, policy_version 51861 (0.0023) [2024-08-06 04:13:53,971][52647] DAMAGECOUNT value on done: 528535.0 [2024-08-06 04:13:53,971][52647] Sum rewards: 73.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.145', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.322', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.452', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:54,301][52664] DAMAGECOUNT value on done: 520122.0 [2024-08-06 04:13:54,303][52664] Sum rewards: 63.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.136', 'AMMO4': '0.173', 'weapon5': '0.194', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '2.952', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2024-08-06 04:13:55,071][52665] DAMAGECOUNT value on done: 486635.0 [2024-08-06 04:13:55,071][52665] Sum rewards: 66.919, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.172', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.116', 'AMMO4': '0.141', 'weapon5': '0.216', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '2.926', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '58.000'} [2024-08-06 04:13:55,238][52794] DAMAGECOUNT value on done: 495255.0 [2024-08-06 04:13:55,239][52794] Sum rewards: 73.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.676', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.104', 'AMMO4': '0.241', 'AMMO3': '0.243', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '62.000'} [2024-08-06 04:13:55,658][52659] DAMAGECOUNT value on done: 494972.0 [2024-08-06 04:13:55,660][52659] Sum rewards: 80.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.106', 'weapon4': '0.122', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.214', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '69.000'} [2024-08-06 04:13:55,741][52795] DAMAGECOUNT value on done: 462648.0 [2024-08-06 04:13:55,741][52795] Sum rewards: 73.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.818', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.116', 'AMMO4': '0.187', 'AMMO3': '0.191', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.720', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:56,804][52647] DAMAGECOUNT value on done: 521209.0 [2024-08-06 04:13:56,806][52647] Sum rewards: 69.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon4': '0.186', 'weapon2': '0.196', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.322', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '57.000'} [2024-08-06 04:13:57,049][52664] DAMAGECOUNT value on done: 511633.0 [2024-08-06 04:13:57,051][52664] Sum rewards: 68.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.750', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.072', 'weapon5': '0.202', 'AMMO3': '0.222', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '56.000'} [2024-08-06 04:13:57,638][52650] Updated weights for policy 0, policy_version 51871 (0.0024) [2024-08-06 04:13:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 424927232. Throughput: 0: 4357.5. Samples: 106239800. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:13:57,795][52567] Avg episode reward: [(0, '70.443')] [2024-08-06 04:13:57,833][52665] DAMAGECOUNT value on done: 489498.0 [2024-08-06 04:13:57,835][52665] Sum rewards: 73.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.734', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.073', 'AMMO3': '0.228', 'weapon4': '0.272', 'weapon2': '0.280', 'weapon5': '0.304', 'AMMO4': '0.363', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '61.000'} [2024-08-06 04:13:58,306][52794] DAMAGECOUNT value on done: 495604.0 [2024-08-06 04:13:58,306][52794] Sum rewards: 50.883, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.147', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.204', 'weapon7': '0.330', 'weapon4': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.534', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '12.393', 'FRAGCOUNT': '42.000'} [2024-08-06 04:13:58,657][52659] DAMAGECOUNT value on done: 498206.0 [2024-08-06 04:13:58,657][52659] Sum rewards: 61.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.062', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.522', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.182', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '51.000'} [2024-08-06 04:13:58,826][52795] DAMAGECOUNT value on done: 465761.0 [2024-08-06 04:13:58,838][52795] Sum rewards: 68.740, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'HEALTH': '0.074', 'AMMO4': '0.082', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.316', 'weapon4': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '56.000'} [2024-08-06 04:13:59,102][52647] DAMAGECOUNT value on done: 512983.0 [2024-08-06 04:13:59,102][52647] Sum rewards: 78.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.072', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '65.000'} [2024-08-06 04:13:59,313][52664] DAMAGECOUNT value on done: 521513.0 [2024-08-06 04:13:59,314][52664] Sum rewards: 61.289, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.954', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.154', 'weapon5': '0.164', 'AMMO4': '0.169', 'AMMO3': '0.234', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.108', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '54.000'} [2024-08-06 04:14:01,083][52665] DAMAGECOUNT value on done: 486919.0 [2024-08-06 04:14:01,083][52665] Sum rewards: 74.497, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.128', 'weapon4': '0.138', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON3': '1.750', 'weapon3': '3.268', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '65.000'} [2024-08-06 04:14:01,394][52794] DAMAGECOUNT value on done: 503469.0 [2024-08-06 04:14:01,394][52794] Sum rewards: 73.909, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.405', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.208', 'weapon4': '0.246', 'weapon2': '0.254', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:01,773][52659] DAMAGECOUNT value on done: 495296.0 [2024-08-06 04:14:01,774][52659] Sum rewards: 63.082, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.612', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.203', 'weapon4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.630', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:02,020][52795] DAMAGECOUNT value on done: 462861.0 [2024-08-06 04:14:02,023][52795] Sum rewards: 79.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.893', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.072', 'weapon5': '0.084', 'AMMO4': '0.120', 'AMMO3': '0.205', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 04:14:02,207][52650] Updated weights for policy 0, policy_version 51881 (0.0021) [2024-08-06 04:14:02,259][52647] DAMAGECOUNT value on done: 520079.0 [2024-08-06 04:14:02,259][52647] Sum rewards: 75.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:02,510][52664] DAMAGECOUNT value on done: 517778.0 [2024-08-06 04:14:02,510][52664] Sum rewards: 79.233, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '3.350', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 425009152. Throughput: 0: 4362.7. Samples: 106252920. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:14:02,796][52567] Avg episode reward: [(0, '70.527')] [2024-08-06 04:14:03,270][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:14:04,132][52665] DAMAGECOUNT value on done: 488837.0 [2024-08-06 04:14:04,132][52665] Sum rewards: 78.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.080', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:04,151][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:14:04,391][52794] DAMAGECOUNT value on done: 491380.0 [2024-08-06 04:14:04,393][52794] Sum rewards: 78.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.038', 'AMMO4': '0.122', 'weapon4': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '66.000'} [2024-08-06 04:14:04,434][52659] DAMAGECOUNT value on done: 496302.0 [2024-08-06 04:14:04,434][52659] Sum rewards: 72.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.475', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon2': '0.204', 'weapon5': '0.238', 'AMMO3': '0.279', 'AMMO4': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.700', 'weapon3': '2.790', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:04,985][52795] DAMAGECOUNT value on done: 451302.0 [2024-08-06 04:14:04,986][52795] Sum rewards: 61.006, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.722', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.082', 'AMMO4': '0.138', 'weapon5': '0.166', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '51.000'} [2024-08-06 04:14:05,013][52647] DAMAGECOUNT value on done: 517531.0 [2024-08-06 04:14:05,013][52647] Sum rewards: 63.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.517', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.166', 'weapon2': '0.190', 'AMMO4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '52.000'} [2024-08-06 04:14:05,486][52664] DAMAGECOUNT value on done: 526057.0 [2024-08-06 04:14:05,487][52664] Sum rewards: 67.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.955', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.128', 'AMMO4': '0.221', 'weapon5': '0.258', 'AMMO3': '0.259', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '59.000'} [2024-08-06 04:14:06,829][52665] DAMAGECOUNT value on done: 491724.0 [2024-08-06 04:14:06,829][52665] Sum rewards: 71.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.923', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:06,889][52650] Updated weights for policy 0, policy_version 51891 (0.0026) [2024-08-06 04:14:06,951][52659] DAMAGECOUNT value on done: 502991.0 [2024-08-06 04:14:06,951][52659] Sum rewards: 76.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.332', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.138', 'weapon5': '0.178', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '65.000'} [2024-08-06 04:14:07,447][52794] DAMAGECOUNT value on done: 501619.0 [2024-08-06 04:14:07,448][52794] Sum rewards: 65.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon5': '0.102', 'AMMO3': '0.163', 'weapon4': '0.166', 'AMMO4': '0.307', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '54.000'} [2024-08-06 04:14:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 425099264. Throughput: 0: 4365.8. Samples: 106279220. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:14:07,794][52567] Avg episode reward: [(0, '70.557')] [2024-08-06 04:14:08,150][52795] DAMAGECOUNT value on done: 464926.0 [2024-08-06 04:14:08,151][52795] Sum rewards: 68.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.088', 'weapon4': '0.146', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '58.000'} [2024-08-06 04:14:08,195][52647] DAMAGECOUNT value on done: 516896.0 [2024-08-06 04:14:08,195][52647] Sum rewards: 68.661, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.471', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.099', 'weapon5': '0.136', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '1.050', 'HITCOUNT': '3.270', 'weapon3': '3.282', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '55.000'} [2024-08-06 04:14:08,676][52664] DAMAGECOUNT value on done: 521103.0 [2024-08-06 04:14:08,676][52664] Sum rewards: 68.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.130', 'AMMO3': '0.226', 'AMMO4': '0.255', 'weapon5': '0.288', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '58.000'} [2024-08-06 04:14:09,541][52659] DAMAGECOUNT value on done: 507860.0 [2024-08-06 04:14:09,541][52659] Sum rewards: 72.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.066', 'AMMO5': '0.023', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.180', 'weapon2': '0.298', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:10,224][52794] DAMAGECOUNT value on done: 498966.0 [2024-08-06 04:14:10,225][52794] Sum rewards: 77.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO4': '0.149', 'weapon2': '0.184', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:11,157][52795] DAMAGECOUNT value on done: 456754.0 [2024-08-06 04:14:11,158][52795] Sum rewards: 56.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.147', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon5': '0.154', 'AMMO3': '0.245', 'weapon2': '0.282', 'AMMO4': '0.315', 'weapon4': '0.442', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.788', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '48.000'} [2024-08-06 04:14:11,177][52664] DAMAGECOUNT value on done: 520370.0 [2024-08-06 04:14:11,177][52664] Sum rewards: 57.357, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.684', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.186', 'AMMO4': '0.228', 'AMMO3': '0.263', 'weapon5': '0.264', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.660', 'weapon3': '2.948', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '51.000'} [2024-08-06 04:14:11,711][52650] Updated weights for policy 0, policy_version 51901 (0.0039) [2024-08-06 04:14:12,641][52794] DAMAGECOUNT value on done: 493227.0 [2024-08-06 04:14:12,642][52794] Sum rewards: 76.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.945', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.490', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '65.000'} [2024-08-06 04:14:12,696][52659] DAMAGECOUNT value on done: 494727.0 [2024-08-06 04:14:12,696][52659] Sum rewards: 55.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.162', 'weapon4': '0.208', 'AMMO3': '0.241', 'AMMO4': '0.248', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.030', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '49.000'} [2024-08-06 04:14:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 425189376. Throughput: 0: 4366.7. Samples: 106305600. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:14:12,795][52567] Avg episode reward: [(0, '70.239')] [2024-08-06 04:14:13,095][52614] Signal inference workers to stop experience collection... (9450 times) [2024-08-06 04:14:13,095][52614] Signal inference workers to resume experience collection... (9450 times) [2024-08-06 04:14:13,140][52650] InferenceWorker_p0-w0: stopping experience collection (9450 times) [2024-08-06 04:14:13,140][52650] InferenceWorker_p0-w0: resuming experience collection (9450 times) [2024-08-06 04:14:14,225][52664] DAMAGECOUNT value on done: 514782.0 [2024-08-06 04:14:14,233][52664] Sum rewards: 77.397, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.915', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.147', 'AMMO4': '0.183', 'weapon5': '0.230', 'weapon2': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.474', 'WEAPON3': '0.900', 'weapon3': '2.816', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:14,465][52795] DAMAGECOUNT value on done: 455885.0 [2024-08-06 04:14:14,465][52795] Sum rewards: 67.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '55.000'} [2024-08-06 04:14:14,978][52820] DAMAGECOUNT value on done: 458787.0 [2024-08-06 04:14:14,978][52820] Sum rewards: 76.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.076', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:15,200][52659] DAMAGECOUNT value on done: 501217.0 [2024-08-06 04:14:15,202][52659] Sum rewards: 74.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.041', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO3': '0.193', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:15,566][52794] DAMAGECOUNT value on done: 502201.0 [2024-08-06 04:14:15,568][52794] Sum rewards: 52.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.040', 'AMMO4': '0.124', 'weapon5': '0.132', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.250', 'HITCOUNT': '2.440', 'weapon3': '3.124', 'DAMAGECOUNT': '13.101', 'FRAGCOUNT': '45.500'} [2024-08-06 04:14:16,143][52650] Updated weights for policy 0, policy_version 51911 (0.0024) [2024-08-06 04:14:17,484][52664] DAMAGECOUNT value on done: 513476.0 [2024-08-06 04:14:17,485][52664] Sum rewards: 55.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.883', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon4': '0.222', 'weapon5': '0.238', 'AMMO3': '0.247', 'AMMO4': '0.343', 'WEAPON5': '0.500', 'weapon2': '0.570', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.662', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '48.000'} [2024-08-06 04:14:17,704][52795] DAMAGECOUNT value on done: 453117.0 [2024-08-06 04:14:17,708][52795] Sum rewards: 69.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.955', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.204', 'AMMO4': '0.266', 'weapon2': '0.304', 'weapon5': '0.348', 'weapon4': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.632', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:17,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 425279488. Throughput: 0: 4372.2. Samples: 106318700. Policy #0 lag: (min: 1.0, avg: 3.1, max: 8.0) [2024-08-06 04:14:17,795][52567] Avg episode reward: [(0, '69.956')] [2024-08-06 04:14:18,012][52659] DAMAGECOUNT value on done: 490601.0 [2024-08-06 04:14:18,013][52659] Sum rewards: 71.698, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.194', 'weapon5': '0.194', 'weapon2': '0.218', 'AMMO4': '0.221', 'AMMO3': '0.227', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.142', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:18,264][52820] DAMAGECOUNT value on done: 459445.0 [2024-08-06 04:14:18,266][52820] Sum rewards: 77.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.169', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.154', 'AMMO3': '0.157', 'weapon4': '0.180', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:18,422][52794] DAMAGECOUNT value on done: 490874.0 [2024-08-06 04:14:18,422][52794] Sum rewards: 72.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.080', 'weapon5': '0.168', 'AMMO4': '0.219', 'weapon2': '0.220', 'AMMO3': '0.269', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:18,591][52649] DAMAGECOUNT value on done: 482121.0 [2024-08-06 04:14:18,591][52649] Sum rewards: 68.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.655', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.052', 'weapon5': '0.060', 'AMMO4': '0.186', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '57.500'} [2024-08-06 04:14:19,946][52664] DAMAGECOUNT value on done: 518002.0 [2024-08-06 04:14:19,947][52664] Sum rewards: 66.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.709', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.058', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.626', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '55.000'} [2024-08-06 04:14:20,824][52795] DAMAGECOUNT value on done: 461442.0 [2024-08-06 04:14:20,827][52795] Sum rewards: 61.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO4': '0.196', 'weapon5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.070', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:20,905][52659] DAMAGECOUNT value on done: 498349.0 [2024-08-06 04:14:20,905][52659] Sum rewards: 78.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.159', 'weapon5': '0.208', 'AMMO4': '0.219', 'weapon4': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.958', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:21,104][52650] Updated weights for policy 0, policy_version 51921 (0.0027) [2024-08-06 04:14:21,570][52820] DAMAGECOUNT value on done: 461964.0 [2024-08-06 04:14:21,572][52820] Sum rewards: 66.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.828', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.088', 'AMMO4': '0.142', 'weapon5': '0.146', 'weapon2': '0.180', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.366', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '56.000'} [2024-08-06 04:14:21,700][52794] DAMAGECOUNT value on done: 510483.0 [2024-08-06 04:14:21,700][52794] Sum rewards: 68.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.266', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.078', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '56.000'} [2024-08-06 04:14:21,742][52649] DAMAGECOUNT value on done: 474347.0 [2024-08-06 04:14:21,744][52649] Sum rewards: 66.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.017', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.146', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.406', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.674', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:22,689][52664] DAMAGECOUNT value on done: 514754.0 [2024-08-06 04:14:22,689][52664] Sum rewards: 67.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.124', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 425361408. Throughput: 0: 4364.7. Samples: 106345030. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 04:14:22,795][52567] Avg episode reward: [(0, '69.530')] [2024-08-06 04:14:23,776][52659] DAMAGECOUNT value on done: 507718.0 [2024-08-06 04:14:23,776][52659] Sum rewards: 68.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.635', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.040', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.384', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '58.000'} [2024-08-06 04:14:24,002][52795] DAMAGECOUNT value on done: 452522.0 [2024-08-06 04:14:24,003][52795] Sum rewards: 74.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.160', 'AMMO3': '0.161', 'AMMO4': '0.219', 'weapon2': '0.270', 'weapon4': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.074', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:24,403][52794] DAMAGECOUNT value on done: 490727.0 [2024-08-06 04:14:24,405][52794] Sum rewards: 75.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.895', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.125', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:24,626][52820] DAMAGECOUNT value on done: 454324.0 [2024-08-06 04:14:24,627][52820] Sum rewards: 66.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.098', 'AMMO4': '0.190', 'weapon5': '0.240', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:24,827][52649] DAMAGECOUNT value on done: 490291.0 [2024-08-06 04:14:24,828][52649] Sum rewards: 76.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.519', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.072', 'AMMO4': '0.173', 'weapon5': '0.178', 'weapon2': '0.184', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.318', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '65.000'} [2024-08-06 04:14:25,511][52664] DAMAGECOUNT value on done: 513158.0 [2024-08-06 04:14:25,519][52664] Sum rewards: 75.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.945', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.384', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:25,635][52663] DAMAGECOUNT value on done: 504930.0 [2024-08-06 04:14:25,635][52663] Sum rewards: 76.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO4': '0.181', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:25,814][52650] Updated weights for policy 0, policy_version 51931 (0.0032) [2024-08-06 04:14:26,563][52659] DAMAGECOUNT value on done: 505025.0 [2024-08-06 04:14:26,563][52659] Sum rewards: 70.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.179', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.152', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.312', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:27,092][52795] DAMAGECOUNT value on done: 470062.0 [2024-08-06 04:14:27,092][52795] Sum rewards: 66.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.088', 'weapon5': '0.090', 'AMMO4': '0.106', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '56.000'} [2024-08-06 04:14:27,390][52794] DAMAGECOUNT value on done: 507490.0 [2024-08-06 04:14:27,393][52794] Sum rewards: 70.379, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.706', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.110', 'AMMO3': '0.156', 'weapon5': '0.160', 'AMMO4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.204', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:27,619][52649] DAMAGECOUNT value on done: 482927.0 [2024-08-06 04:14:27,620][52649] Sum rewards: 78.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.310', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.276', 'weapon4': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:27,786][52820] DAMAGECOUNT value on done: 462443.0 [2024-08-06 04:14:27,787][52820] Sum rewards: 60.916, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.130', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.094', 'weapon5': '0.148', 'AMMO4': '0.174', 'AMMO3': '0.260', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.266', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '54.000'} [2024-08-06 04:14:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 425451520. Throughput: 0: 4369.1. Samples: 106371280. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 04:14:27,795][52567] Avg episode reward: [(0, '70.089')] [2024-08-06 04:14:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051935_425451520.pth... [2024-08-06 04:14:27,936][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051424_421265408.pth [2024-08-06 04:14:28,579][52663] DAMAGECOUNT value on done: 498122.0 [2024-08-06 04:14:28,580][52663] Sum rewards: 62.878, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.060', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.204', 'AMMO3': '0.218', 'weapon2': '0.280', 'AMMO4': '0.295', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:29,365][52659] DAMAGECOUNT value on done: 502326.0 [2024-08-06 04:14:29,367][52659] Sum rewards: 77.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.165', 'weapon2': '0.320', 'WEAPON3': '1.050', 'weapon3': '3.430', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:30,252][52650] Updated weights for policy 0, policy_version 51941 (0.0040) [2024-08-06 04:14:30,280][52795] DAMAGECOUNT value on done: 461026.0 [2024-08-06 04:14:30,280][52795] Sum rewards: 65.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.233', 'weapon2': '0.258', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.522', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '56.000'} [2024-08-06 04:14:30,785][52794] DAMAGECOUNT value on done: 497040.0 [2024-08-06 04:14:30,785][52794] Sum rewards: 64.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.618', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon5': '0.154', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.354', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '2.864', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '52.000'} [2024-08-06 04:14:30,786][52649] DAMAGECOUNT value on done: 473323.0 [2024-08-06 04:14:30,787][52649] Sum rewards: 60.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.216', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '51.000'} [2024-08-06 04:14:31,107][52820] DAMAGECOUNT value on done: 456658.0 [2024-08-06 04:14:31,107][52820] Sum rewards: 76.586, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.100', 'AMMO3': '0.178', 'weapon5': '0.236', 'weapon2': '0.242', 'AMMO4': '0.248', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:31,312][52663] DAMAGECOUNT value on done: 491966.0 [2024-08-06 04:14:31,312][52663] Sum rewards: 64.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.907', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'weapon5': '0.020', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.156', 'weapon2': '0.592', 'WEAPON3': '1.050', 'HITCOUNT': '3.260', 'weapon3': '3.268', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '52.000'} [2024-08-06 04:14:31,926][52659] DAMAGECOUNT value on done: 498172.0 [2024-08-06 04:14:31,926][52659] Sum rewards: 67.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.106', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.164', 'AMMO3': '0.194', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.252', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '56.000'} [2024-08-06 04:14:32,253][52666] DAMAGECOUNT value on done: 495675.0 [2024-08-06 04:14:32,254][52666] Sum rewards: 78.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.114', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO3': '0.182', 'AMMO4': '0.200', 'weapon5': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 425533440. Throughput: 0: 4362.0. Samples: 106383990. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 04:14:32,795][52567] Avg episode reward: [(0, '69.731')] [2024-08-06 04:14:33,470][52795] DAMAGECOUNT value on done: 450848.0 [2024-08-06 04:14:33,470][52795] Sum rewards: 61.551, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.619', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.226', 'weapon5': '0.282', 'weapon2': '0.298', 'weapon4': '0.318', 'AMMO4': '0.338', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.696', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2024-08-06 04:14:33,731][52794] DAMAGECOUNT value on done: 504026.0 [2024-08-06 04:14:33,731][52794] Sum rewards: 70.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.630', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.128', 'AMMO3': '0.235', 'weapon2': '0.256', 'weapon5': '0.312', 'AMMO4': '0.347', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '59.000'} [2024-08-06 04:14:33,733][52649] DAMAGECOUNT value on done: 487342.0 [2024-08-06 04:14:33,734][52649] Sum rewards: 63.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.732', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.106', 'weapon5': '0.184', 'AMMO3': '0.210', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:33,951][52663] DAMAGECOUNT value on done: 495684.0 [2024-08-06 04:14:33,953][52663] Sum rewards: 72.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.444', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.092', 'AMMO4': '0.153', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:34,329][52820] DAMAGECOUNT value on done: 458771.0 [2024-08-06 04:14:34,330][52820] Sum rewards: 81.376, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.979', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.082', 'weapon5': '0.088', 'AMMO4': '0.156', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.000', 'weapon3': '3.272', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:34,928][52659] DAMAGECOUNT value on done: 500604.0 [2024-08-06 04:14:34,929][52659] Sum rewards: 62.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.228', 'weapon2': '0.354', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.214', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:35,195][52650] Updated weights for policy 0, policy_version 51951 (0.0021) [2024-08-06 04:14:35,494][52666] DAMAGECOUNT value on done: 499150.0 [2024-08-06 04:14:35,496][52666] Sum rewards: 74.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.515', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.018', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:35,731][52670] DAMAGECOUNT value on done: 488616.0 [2024-08-06 04:14:35,739][52670] Sum rewards: 90.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.273', 'FRAGCOUNT': '75.000'} [2024-08-06 04:14:36,221][52663] DAMAGECOUNT value on done: 497128.0 [2024-08-06 04:14:36,221][52663] Sum rewards: 72.184, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.164', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.328', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:36,611][52795] DAMAGECOUNT value on done: 461114.0 [2024-08-06 04:14:36,613][52795] Sum rewards: 63.930, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.496', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.142', 'AMMO4': '0.192', 'AMMO3': '0.236', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.154', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '56.000'} [2024-08-06 04:14:36,643][52794] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:14:36,657][52649] DAMAGECOUNT value on done: 482525.0 [2024-08-06 04:14:36,659][52649] Sum rewards: 80.154, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.090', 'WEAPON4': '0.150', 'HEALTH': '0.162', 'AMMO3': '0.173', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:36,875][52794] DAMAGECOUNT value on done: 506233.0 [2024-08-06 04:14:36,877][52794] Sum rewards: 74.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO3': '0.210', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:37,453][52820] DAMAGECOUNT value on done: 462532.0 [2024-08-06 04:14:37,454][52820] Sum rewards: 76.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.599', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.112', 'weapon5': '0.114', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:37,601][52659] DAMAGECOUNT value on done: 499421.0 [2024-08-06 04:14:37,602][52659] Sum rewards: 59.572, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.070', 'HEALTH': '0.160', 'AMMO3': '0.189', 'weapon5': '0.194', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.050', 'HITCOUNT': '2.740', 'weapon3': '3.072', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '48.000'} [2024-08-06 04:14:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 425623552. Throughput: 0: 4375.6. Samples: 106410440. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 04:14:37,794][52567] Avg episode reward: [(0, '69.787')] [2024-08-06 04:14:38,530][52666] DAMAGECOUNT value on done: 501009.0 [2024-08-06 04:14:38,532][52666] Sum rewards: 73.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.894', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.088', 'AMMO3': '0.220', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:38,913][52670] DAMAGECOUNT value on done: 500587.0 [2024-08-06 04:14:38,916][52670] Sum rewards: 68.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.678', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.148', 'weapon4': '0.156', 'AMMO4': '0.245', 'AMMO3': '0.251', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '58.000'} [2024-08-06 04:14:39,023][52663] DAMAGECOUNT value on done: 502093.0 [2024-08-06 04:14:39,023][52663] Sum rewards: 76.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.153', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.244', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:39,508][52794] DAMAGECOUNT value on done: 496148.0 [2024-08-06 04:14:39,510][52794] Sum rewards: 67.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.500'} [2024-08-06 04:14:39,533][52649] DAMAGECOUNT value on done: 487656.0 [2024-08-06 04:14:39,534][52649] Sum rewards: 76.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.024', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'HITCOUNT': '3.380', 'weapon3': '3.446', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '66.000'} [2024-08-06 04:14:39,617][52650] Updated weights for policy 0, policy_version 51961 (0.0043) [2024-08-06 04:14:39,715][52795] DAMAGECOUNT value on done: 465158.0 [2024-08-06 04:14:39,715][52795] Sum rewards: 81.359, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.110', 'AMMO3': '0.141', 'WEAPON3': '0.800', 'weapon2': '0.816', 'weapon3': '2.966', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:40,656][52820] DAMAGECOUNT value on done: 459631.0 [2024-08-06 04:14:40,657][52820] Sum rewards: 71.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.124', 'weapon4': '0.168', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:41,628][52666] DAMAGECOUNT value on done: 499248.0 [2024-08-06 04:14:41,631][52666] Sum rewards: 63.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.756', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.126', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.262', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.300', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.000'} [2024-08-06 04:14:41,994][52670] DAMAGECOUNT value on done: 492561.0 [2024-08-06 04:14:41,996][52670] Sum rewards: 74.548, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.130', 'AMMO3': '0.205', 'AMMO4': '0.233', 'weapon5': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '64.000'} [2024-08-06 04:14:42,070][52663] DAMAGECOUNT value on done: 498741.0 [2024-08-06 04:14:42,070][52663] Sum rewards: 70.098, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.078', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.119', 'weapon5': '0.228', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '2.830', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '58.500'} [2024-08-06 04:14:42,445][52649] DAMAGECOUNT value on done: 487368.0 [2024-08-06 04:14:42,446][52649] Sum rewards: 66.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.144', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.318', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:42,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 425713664. Throughput: 0: 4379.8. Samples: 106436890. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 04:14:42,794][52567] Avg episode reward: [(0, '70.207')] [2024-08-06 04:14:43,713][52820] DAMAGECOUNT value on done: 467822.0 [2024-08-06 04:14:43,714][52820] Sum rewards: 73.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:44,427][52650] Updated weights for policy 0, policy_version 51971 (0.0019) [2024-08-06 04:14:44,617][52663] DAMAGECOUNT value on done: 493093.0 [2024-08-06 04:14:44,617][52663] Sum rewards: 75.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.310', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.151', 'AMMO3': '0.213', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.392', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:44,618][52666] DAMAGECOUNT value on done: 497717.0 [2024-08-06 04:14:44,620][52666] Sum rewards: 81.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.423', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.138', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.236', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '66.000'} [2024-08-06 04:14:44,980][52670] DAMAGECOUNT value on done: 490300.0 [2024-08-06 04:14:44,980][52670] Sum rewards: 68.043, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.260', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'HITCOUNT': '3.430', 'weapon3': '3.492', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 04:14:45,338][52649] DAMAGECOUNT value on done: 481638.0 [2024-08-06 04:14:45,341][52649] Sum rewards: 78.612, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.462', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.064', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.184', 'AMMO3': '0.283', 'weapon2': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.126', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '68.000'} [2024-08-06 04:14:46,976][52820] DAMAGECOUNT value on done: 456163.0 [2024-08-06 04:14:46,985][52820] Sum rewards: 66.566, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.274', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:47,775][52666] DAMAGECOUNT value on done: 491608.0 [2024-08-06 04:14:47,777][52666] Sum rewards: 73.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.226', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 425803776. Throughput: 0: 4382.2. Samples: 106450120. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 04:14:47,794][52567] Avg episode reward: [(0, '70.322')] [2024-08-06 04:14:47,833][52663] DAMAGECOUNT value on done: 492406.0 [2024-08-06 04:14:47,834][52663] Sum rewards: 72.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.124', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.206', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '59.000'} [2024-08-06 04:14:47,993][52670] DAMAGECOUNT value on done: 502354.0 [2024-08-06 04:14:47,996][52670] Sum rewards: 71.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.940', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon5': '0.194', 'AMMO3': '0.236', 'weapon2': '0.246', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:48,492][52649] DAMAGECOUNT value on done: 488894.0 [2024-08-06 04:14:48,492][52649] Sum rewards: 57.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.122', 'weapon5': '0.132', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '3.202', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '49.000'} [2024-08-06 04:14:49,131][52650] Updated weights for policy 0, policy_version 51981 (0.0011) [2024-08-06 04:14:50,120][52820] DAMAGECOUNT value on done: 462239.0 [2024-08-06 04:14:50,121][52820] Sum rewards: 72.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.997', 'AMMO5': '0.010', 'AMMO2': '0.060', 'weapon5': '0.174', 'AMMO3': '0.209', 'AMMO4': '0.301', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '58.000'} [2024-08-06 04:14:50,558][52666] DAMAGECOUNT value on done: 495289.0 [2024-08-06 04:14:50,560][52666] Sum rewards: 74.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.484', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.152', 'weapon5': '0.218', 'AMMO3': '0.239', 'AMMO4': '0.258', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:50,739][52663] DAMAGECOUNT value on done: 498631.0 [2024-08-06 04:14:50,743][52663] Sum rewards: 54.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.875', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.252', 'weapon5': '0.260', 'AMMO4': '0.266', 'AMMO3': '0.267', 'weapon2': '0.470', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.632', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '47.000'} [2024-08-06 04:14:50,977][52670] DAMAGECOUNT value on done: 496318.0 [2024-08-06 04:14:50,978][52670] Sum rewards: 62.565, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.036', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.124', 'AMMO4': '0.243', 'weapon5': '0.246', 'AMMO3': '0.254', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.760', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 04:14:51,656][52649] DAMAGECOUNT value on done: 494869.0 [2024-08-06 04:14:51,658][52649] Sum rewards: 76.888, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.152', 'weapon5': '0.156', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 425893888. Throughput: 0: 4388.9. Samples: 106476720. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 04:14:52,795][52567] Avg episode reward: [(0, '70.399')] [2024-08-06 04:14:53,229][52820] DAMAGECOUNT value on done: 467060.0 [2024-08-06 04:14:53,230][52820] Sum rewards: 72.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.512', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.292', 'weapon4': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '60.000'} [2024-08-06 04:14:53,466][52666] DAMAGECOUNT value on done: 495281.0 [2024-08-06 04:14:53,468][52666] Sum rewards: 68.472, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.800', 'AMMO5': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.166', 'AMMO3': '0.167', 'weapon4': '0.182', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.200', 'weapon3': '3.210', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:53,516][52663] DAMAGECOUNT value on done: 507240.0 [2024-08-06 04:14:53,517][52663] Sum rewards: 76.004, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.184', 'weapon5': '0.198', 'weapon2': '0.202', 'AMMO4': '0.230', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '65.000'} [2024-08-06 04:14:53,724][52670] DAMAGECOUNT value on done: 485554.0 [2024-08-06 04:14:53,725][52670] Sum rewards: 56.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.752', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.158', 'AMMO4': '0.204', 'weapon5': '0.210', 'weapon2': '0.244', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.690', 'weapon3': '3.126', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '49.000'} [2024-08-06 04:14:53,841][52650] Updated weights for policy 0, policy_version 51991 (0.0027) [2024-08-06 04:14:54,621][52649] DAMAGECOUNT value on done: 494915.0 [2024-08-06 04:14:54,622][52649] Sum rewards: 62.349, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.416', 'AMMO4': '-0.018', 'AMMO2': '-0.003', 'AMMO3': '0.198', 'weapon2': '0.512', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.364', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '52.000'} [2024-08-06 04:14:56,216][52820] DAMAGECOUNT value on done: 462335.0 [2024-08-06 04:14:56,219][52820] Sum rewards: 71.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.435', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.138', 'AMMO4': '0.169', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '62.000'} [2024-08-06 04:14:56,241][52666] DAMAGECOUNT value on done: 493556.0 [2024-08-06 04:14:56,243][52666] Sum rewards: 66.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.120', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '57.000'} [2024-08-06 04:14:56,518][52670] DAMAGECOUNT value on done: 492588.0 [2024-08-06 04:14:56,523][52670] Sum rewards: 65.202, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon4': '0.170', 'WEAPON4': '0.200', 'HEALTH': '0.265', 'weapon2': '0.318', 'WEAPON3': '0.900', 'HITCOUNT': '3.110', 'weapon3': '3.280', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:56,531][52667] DAMAGECOUNT value on done: 497276.0 [2024-08-06 04:14:56,532][52667] Sum rewards: 73.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.178', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.092', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '61.000'} [2024-08-06 04:14:56,823][52663] DAMAGECOUNT value on done: 493449.0 [2024-08-06 04:14:56,823][52663] Sum rewards: 62.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon5': '0.174', 'weapon4': '0.198', 'AMMO3': '0.206', 'AMMO4': '0.217', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '2.972', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '53.000'} [2024-08-06 04:14:57,728][52649] DAMAGECOUNT value on done: 492001.0 [2024-08-06 04:14:57,734][52649] Sum rewards: 72.746, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.194', 'weapon5': '0.210', 'weapon4': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '59.000'} [2024-08-06 04:14:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 425975808. Throughput: 0: 4387.3. Samples: 106503030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:14:57,802][52567] Avg episode reward: [(0, '69.873')] [2024-08-06 04:14:58,046][52650] Updated weights for policy 0, policy_version 52001 (0.0018) [2024-08-06 04:14:59,207][52820] DAMAGECOUNT value on done: 466695.0 [2024-08-06 04:14:59,207][52820] Sum rewards: 58.960, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.660', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.086', 'AMMO4': '0.154', 'weapon5': '0.190', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '52.000'} [2024-08-06 04:14:59,254][52666] DAMAGECOUNT value on done: 488275.0 [2024-08-06 04:14:59,254][52666] Sum rewards: 72.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.845', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO3': '0.203', 'weapon2': '0.214', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.326', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '59.000'} [2024-08-06 04:14:59,580][52670] DAMAGECOUNT value on done: 492470.0 [2024-08-06 04:14:59,582][52670] Sum rewards: 72.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.060', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.064', 'weapon5': '0.152', 'AMMO3': '0.252', 'AMMO4': '0.274', 'weapon2': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.258', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '63.000'} [2024-08-06 04:14:59,622][52667] DAMAGECOUNT value on done: 507702.0 [2024-08-06 04:14:59,624][52667] Sum rewards: 84.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.464', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '69.000'} [2024-08-06 04:14:59,878][52663] DAMAGECOUNT value on done: 491236.0 [2024-08-06 04:14:59,880][52663] Sum rewards: 61.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon4': '0.210', 'AMMO3': '0.268', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '53.500'} [2024-08-06 04:15:00,766][52649] DAMAGECOUNT value on done: 480228.0 [2024-08-06 04:15:00,770][52649] Sum rewards: 66.199, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.294', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.166', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:02,383][52820] DAMAGECOUNT value on done: 462577.0 [2024-08-06 04:15:02,385][52820] Sum rewards: 74.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.120', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '62.000'} [2024-08-06 04:15:02,409][52666] DAMAGECOUNT value on done: 493388.0 [2024-08-06 04:15:02,411][52666] Sum rewards: 63.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.042', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.150', 'AMMO4': '0.153', 'weapon5': '0.170', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '2.926', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '56.000'} [2024-08-06 04:15:02,453][52667] DAMAGECOUNT value on done: 496640.0 [2024-08-06 04:15:02,455][52667] Sum rewards: 70.270, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.513', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.138', 'weapon4': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.748', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.000'} [2024-08-06 04:15:02,743][52670] DAMAGECOUNT value on done: 489368.0 [2024-08-06 04:15:02,745][52670] Sum rewards: 73.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.655', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.126', 'AMMO4': '0.142', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.758', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '60.000'} [2024-08-06 04:15:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 426057728. Throughput: 0: 4389.4. Samples: 106516220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:15:02,795][52567] Avg episode reward: [(0, '69.963')] [2024-08-06 04:15:02,942][52663] DAMAGECOUNT value on done: 491538.0 [2024-08-06 04:15:02,943][52663] Sum rewards: 75.517, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.185', 'AMMO5': '0.018', 'AMMO2': '0.071', 'weapon4': '0.138', 'AMMO3': '0.186', 'weapon5': '0.212', 'weapon2': '0.308', 'AMMO4': '0.356', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.000'} [2024-08-06 04:15:03,264][52650] Updated weights for policy 0, policy_version 52011 (0.0031) [2024-08-06 04:15:04,022][52649] DAMAGECOUNT value on done: 489507.0 [2024-08-06 04:15:04,022][52649] Sum rewards: 60.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.256', 'weapon2': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.344', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '52.000'} [2024-08-06 04:15:05,107][52666] DAMAGECOUNT value on done: 489509.0 [2024-08-06 04:15:05,107][52666] Sum rewards: 80.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.138', 'weapon4': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '66.000'} [2024-08-06 04:15:05,197][52667] DAMAGECOUNT value on done: 499029.0 [2024-08-06 04:15:05,198][52667] Sum rewards: 77.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.575', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO2': '0.025', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'weapon2': '0.334', 'WEAPON3': '1.650', 'weapon3': '3.196', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '66.000'} [2024-08-06 04:15:05,254][52670] DAMAGECOUNT value on done: 495478.0 [2024-08-06 04:15:05,255][52670] Sum rewards: 78.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.064', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.126', 'AMMO3': '0.181', 'weapon5': '0.236', 'AMMO4': '0.267', 'weapon2': '0.350', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '65.000'} [2024-08-06 04:15:05,407][52820] DAMAGECOUNT value on done: 462957.0 [2024-08-06 04:15:05,407][52820] Sum rewards: 76.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.188', 'AMMO3': '0.228', 'WEAPON3': '1.350', 'weapon3': '3.542', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '63.000'} [2024-08-06 04:15:06,245][52663] DAMAGECOUNT value on done: 491335.0 [2024-08-06 04:15:06,246][52663] Sum rewards: 65.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.658', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.082', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:07,207][52649] DAMAGECOUNT value on done: 479487.0 [2024-08-06 04:15:07,207][52649] Sum rewards: 76.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.142', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '63.000'} [2024-08-06 04:15:07,532][52666] DAMAGECOUNT value on done: 504296.0 [2024-08-06 04:15:07,533][52666] Sum rewards: 74.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO3': '0.168', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '59.000'} [2024-08-06 04:15:07,628][52667] DAMAGECOUNT value on done: 505534.0 [2024-08-06 04:15:07,628][52667] Sum rewards: 59.538, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.136', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:07,686][52670] DAMAGECOUNT value on done: 484685.0 [2024-08-06 04:15:07,688][52670] Sum rewards: 55.514, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.132', 'AMMO4': '0.132', 'AMMO3': '0.168', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '44.000'} [2024-08-06 04:15:07,732][52794] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.057, -19.0), ('weapon5', 0.002)] [2024-08-06 04:15:07,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 426147840. Throughput: 0: 4386.2. Samples: 106542410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:15:07,802][52567] Avg episode reward: [(0, '70.325')] [2024-08-06 04:15:07,904][52650] Updated weights for policy 0, policy_version 52021 (0.0019) [2024-08-06 04:15:08,495][52820] DAMAGECOUNT value on done: 472249.0 [2024-08-06 04:15:08,495][52820] Sum rewards: 65.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.105', 'AMMO3': '0.223', 'weapon2': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.572', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '56.000'} [2024-08-06 04:15:09,185][52663] DAMAGECOUNT value on done: 503077.0 [2024-08-06 04:15:09,185][52663] Sum rewards: 77.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.110', 'weapon5': '0.212', 'AMMO3': '0.249', 'AMMO4': '0.269', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '64.000'} [2024-08-06 04:15:09,991][52666] DAMAGECOUNT value on done: 497365.0 [2024-08-06 04:15:09,993][52666] Sum rewards: 57.617, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.372', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.106', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.464', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '51.000'} [2024-08-06 04:15:10,146][52670] DAMAGECOUNT value on done: 492147.0 [2024-08-06 04:15:10,146][52670] Sum rewards: 70.244, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.648', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.174', 'weapon5': '0.238', 'AMMO4': '0.254', 'AMMO3': '0.273', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 04:15:10,327][52667] DAMAGECOUNT value on done: 509235.0 [2024-08-06 04:15:10,328][52667] Sum rewards: 78.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.046', 'AMMO4': '0.055', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.224', 'WEAPON3': '1.250', 'weapon3': '3.488', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '63.000'} [2024-08-06 04:15:10,450][52649] DAMAGECOUNT value on done: 491507.0 [2024-08-06 04:15:10,451][52649] Sum rewards: 71.614, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.350', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO3': '0.165', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.356', 'weapon2': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.674', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:11,104][52665] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:15:11,805][52820] DAMAGECOUNT value on done: 470902.0 [2024-08-06 04:15:11,805][52820] Sum rewards: 75.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.100', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '63.000'} [2024-08-06 04:15:12,231][52650] Updated weights for policy 0, policy_version 52031 (0.0013) [2024-08-06 04:15:12,413][52663] DAMAGECOUNT value on done: 492265.0 [2024-08-06 04:15:12,413][52663] Sum rewards: 61.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.763', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.140', 'weapon2': '0.148', 'AMMO4': '0.149', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.446', 'DAMAGECOUNT': '14.121', 'FRAGCOUNT': '52.000'} [2024-08-06 04:15:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 426246144. Throughput: 0: 4389.5. Samples: 106568810. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:15:12,794][52567] Avg episode reward: [(0, '70.456')] [2024-08-06 04:15:13,040][52666] DAMAGECOUNT value on done: 492616.0 [2024-08-06 04:15:13,040][52666] Sum rewards: 62.511, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.700', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.242', 'weapon2': '0.432', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.242', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '54.500'} [2024-08-06 04:15:13,274][52667] DAMAGECOUNT value on done: 500013.0 [2024-08-06 04:15:13,274][52667] Sum rewards: 71.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'AMMO5': '0.027', 'AMMO2': '0.054', 'weapon4': '0.130', 'AMMO3': '0.183', 'AMMO4': '0.271', 'weapon5': '0.338', 'WEAPON4': '0.550', 'weapon2': '0.592', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.656', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '58.000'} [2024-08-06 04:15:13,287][52670] DAMAGECOUNT value on done: 500823.0 [2024-08-06 04:15:13,288][52670] Sum rewards: 67.161, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.480', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.162', 'AMMO4': '0.174', 'weapon2': '0.188', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.310', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:13,518][52649] DAMAGECOUNT value on done: 492187.0 [2024-08-06 04:15:13,521][52649] Sum rewards: 61.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.082', 'weapon5': '0.134', 'AMMO4': '0.162', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '55.000'} [2024-08-06 04:15:13,932][52820] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:15:14,851][52820] DAMAGECOUNT value on done: 458563.0 [2024-08-06 04:15:14,851][52820] Sum rewards: 73.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.938', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.154', 'AMMO3': '0.186', 'AMMO4': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '60.000'} [2024-08-06 04:15:14,931][52663] DAMAGECOUNT value on done: 503089.0 [2024-08-06 04:15:14,933][52663] Sum rewards: 75.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.096', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.098', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.424', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '63.000'} [2024-08-06 04:15:16,062][52667] DAMAGECOUNT value on done: 499162.0 [2024-08-06 04:15:16,063][52667] Sum rewards: 69.901, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:16,209][52666] DAMAGECOUNT value on done: 495828.0 [2024-08-06 04:15:16,209][52666] Sum rewards: 92.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.091', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'weapon2': '0.556', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.510', 'FRAGCOUNT': '74.000'} [2024-08-06 04:15:16,392][52649] DAMAGECOUNT value on done: 485166.0 [2024-08-06 04:15:16,393][52649] Sum rewards: 55.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.194', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '47.000'} [2024-08-06 04:15:16,424][52670] DAMAGECOUNT value on done: 496088.0 [2024-08-06 04:15:16,426][52670] Sum rewards: 73.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.190', 'AMMO4': '0.191', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '62.000'} [2024-08-06 04:15:17,172][52650] Updated weights for policy 0, policy_version 52041 (0.0019) [2024-08-06 04:15:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 426328064. Throughput: 0: 4397.8. Samples: 106581890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:15:17,802][52567] Avg episode reward: [(0, '70.173')] [2024-08-06 04:15:18,070][52663] DAMAGECOUNT value on done: 498828.0 [2024-08-06 04:15:18,070][52663] Sum rewards: 63.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.416', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.200', 'AMMO3': '0.212', 'AMMO4': '0.257', 'weapon2': '0.258', 'weapon4': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '55.000'} [2024-08-06 04:15:18,555][52666] DAMAGECOUNT value on done: 495221.0 [2024-08-06 04:15:18,557][52666] Sum rewards: 74.984, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.577', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.102', 'weapon5': '0.124', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.318', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '64.000'} [2024-08-06 04:15:18,912][52670] DAMAGECOUNT value on done: 481633.0 [2024-08-06 04:15:18,913][52670] Sum rewards: 64.984, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.634', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.310', 'weapon2': '0.436', 'WEAPON3': '1.800', 'weapon3': '3.154', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:19,268][52667] DAMAGECOUNT value on done: 504436.0 [2024-08-06 04:15:19,270][52667] Sum rewards: 75.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.054', 'AMMO4': '0.173', 'AMMO3': '0.210', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon5': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '62.000'} [2024-08-06 04:15:20,746][52669] DAMAGECOUNT value on done: 501840.0 [2024-08-06 04:15:20,747][52669] Sum rewards: 66.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.800', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:21,282][52663] DAMAGECOUNT value on done: 494255.0 [2024-08-06 04:15:21,288][52663] Sum rewards: 78.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.916', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.400', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 04:15:21,582][52650] Updated weights for policy 0, policy_version 52051 (0.0013) [2024-08-06 04:15:21,609][52666] DAMAGECOUNT value on done: 499785.0 [2024-08-06 04:15:21,610][52666] Sum rewards: 75.525, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.502', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.058', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.297', 'WEAPON3': '1.800', 'weapon3': '3.482', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '65.000'} [2024-08-06 04:15:22,011][52670] DAMAGECOUNT value on done: 492324.0 [2024-08-06 04:15:22,011][52670] Sum rewards: 67.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.168', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '58.000'} [2024-08-06 04:15:22,283][52667] DAMAGECOUNT value on done: 507819.0 [2024-08-06 04:15:22,284][52667] Sum rewards: 72.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO4': '0.176', 'weapon5': '0.188', 'AMMO3': '0.274', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.186', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '61.500'} [2024-08-06 04:15:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 426418176. Throughput: 0: 4393.8. Samples: 106608160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:15:22,802][52567] Avg episode reward: [(0, '70.569')] [2024-08-06 04:15:23,809][52669] DAMAGECOUNT value on done: 493722.0 [2024-08-06 04:15:23,809][52669] Sum rewards: 78.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.155', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.206', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 04:15:24,663][52666] DAMAGECOUNT value on done: 483869.0 [2024-08-06 04:15:24,664][52666] Sum rewards: 82.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.125', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '68.000'} [2024-08-06 04:15:25,059][52670] DAMAGECOUNT value on done: 501544.0 [2024-08-06 04:15:25,060][52670] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.054', 'weapon5': '0.068', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.390', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 04:15:25,085][52667] DAMAGECOUNT value on done: 496959.0 [2024-08-06 04:15:25,089][52667] Sum rewards: 66.904, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.703', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon5': '0.152', 'AMMO4': '0.240', 'weapon2': '0.292', 'AMMO3': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.134', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 04:15:26,239][52669] DAMAGECOUNT value on done: 504310.0 [2024-08-06 04:15:26,240][52669] Sum rewards: 63.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.026', 'AMMO5': '0.012', 'ARMOR': '0.020', 'AMMO2': '0.039', 'weapon5': '0.140', 'weapon4': '0.170', 'AMMO3': '0.191', 'AMMO4': '0.195', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '52.000'} [2024-08-06 04:15:26,477][52650] Updated weights for policy 0, policy_version 52061 (0.0033) [2024-08-06 04:15:27,660][52666] DAMAGECOUNT value on done: 491396.0 [2024-08-06 04:15:27,660][52666] Sum rewards: 70.869, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.157', 'AMMO4': '0.222', 'weapon5': '0.244', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '2.538', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '55.000'} [2024-08-06 04:15:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 426508288. Throughput: 0: 4391.3. Samples: 106634500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:15:27,794][52567] Avg episode reward: [(0, '70.650')] [2024-08-06 04:15:27,833][52667] DAMAGECOUNT value on done: 498562.0 [2024-08-06 04:15:27,834][52667] Sum rewards: 76.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.924', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.122', 'weapon5': '0.156', 'weapon2': '0.158', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.334', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '65.000'} [2024-08-06 04:15:28,041][52670] DAMAGECOUNT value on done: 491829.0 [2024-08-06 04:15:28,043][52670] Sum rewards: 71.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '60.000'} [2024-08-06 04:15:28,644][52669] DAMAGECOUNT value on done: 501046.0 [2024-08-06 04:15:28,648][52669] Sum rewards: 65.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.626', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.090', 'weapon5': '0.144', 'AMMO4': '0.154', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:30,722][52667] DAMAGECOUNT value on done: 505038.0 [2024-08-06 04:15:30,724][52667] Sum rewards: 58.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.404', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon5': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '2.908', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '50.000'} [2024-08-06 04:15:30,916][52670] DAMAGECOUNT value on done: 495915.0 [2024-08-06 04:15:30,918][52670] Sum rewards: 71.735, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.136', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.146', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 04:15:31,138][52650] Updated weights for policy 0, policy_version 52071 (0.0026) [2024-08-06 04:15:31,878][52669] DAMAGECOUNT value on done: 499230.0 [2024-08-06 04:15:31,878][52669] Sum rewards: 64.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.234', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon4': '0.218', 'weapon2': '0.224', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.324', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17522.5). Total num frames: 426598400. Throughput: 0: 4390.9. Samples: 106647710. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:15:32,795][52567] Avg episode reward: [(0, '70.302')] [2024-08-06 04:15:33,604][52667] DAMAGECOUNT value on done: 495275.0 [2024-08-06 04:15:33,604][52667] Sum rewards: 62.057, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.641', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon5': '0.242', 'weapon4': '0.244', 'AMMO3': '0.302', 'AMMO4': '0.331', 'weapon2': '0.382', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.766', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '58.000'} [2024-08-06 04:15:34,941][52669] DAMAGECOUNT value on done: 502987.0 [2024-08-06 04:15:34,945][52669] Sum rewards: 67.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.903', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.154', 'weapon5': '0.196', 'AMMO3': '0.235', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.882', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:35,586][52650] Updated weights for policy 0, policy_version 52081 (0.0012) [2024-08-06 04:15:36,151][52670] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:15:36,247][52667] DAMAGECOUNT value on done: 504246.0 [2024-08-06 04:15:36,249][52667] Sum rewards: 70.690, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.044', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.190', 'AMMO4': '0.233', 'weapon5': '0.244', 'AMMO3': '0.275', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.992', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '61.000'} [2024-08-06 04:15:37,719][52669] DAMAGECOUNT value on done: 502574.0 [2024-08-06 04:15:37,720][52669] Sum rewards: 77.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.105', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.027', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.498', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '65.000'} [2024-08-06 04:15:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 426680320. Throughput: 0: 4385.6. Samples: 106674070. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:15:37,802][52567] Avg episode reward: [(0, '70.240')] [2024-08-06 04:15:38,082][52811] DAMAGECOUNT value on done: 478437.0 [2024-08-06 04:15:38,083][52811] Sum rewards: 66.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.178', 'AMMO3': '0.197', 'AMMO4': '0.216', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '55.000'} [2024-08-06 04:15:38,997][52667] DAMAGECOUNT value on done: 509157.0 [2024-08-06 04:15:38,998][52667] Sum rewards: 61.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.094', 'weapon4': '0.104', 'AMMO3': '0.147', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.640', 'WEAPON3': '0.950', 'HITCOUNT': '2.820', 'weapon3': '2.966', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '51.000'} [2024-08-06 04:15:39,606][52671] DAMAGECOUNT value on done: 505380.0 [2024-08-06 04:15:39,611][52671] Sum rewards: 74.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.106', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.056', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '62.000'} [2024-08-06 04:15:40,395][52650] Updated weights for policy 0, policy_version 52091 (0.0023) [2024-08-06 04:15:40,857][52669] DAMAGECOUNT value on done: 499964.0 [2024-08-06 04:15:40,857][52669] Sum rewards: 67.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.618', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.103', 'weapon5': '0.120', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.902', 'WEAPON3': '1.000', 'weapon3': '2.726', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:41,207][52811] DAMAGECOUNT value on done: 462015.0 [2024-08-06 04:15:41,211][52811] Sum rewards: 67.377, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.292', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.072', 'weapon4': '0.074', 'AMMO4': '0.187', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:41,529][52667] DAMAGECOUNT value on done: 509875.0 [2024-08-06 04:15:41,531][52667] Sum rewards: 79.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.211', 'AMMO4': '0.213', 'weapon2': '0.262', 'weapon5': '0.320', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.764', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '64.000'} [2024-08-06 04:15:42,537][52671] DAMAGECOUNT value on done: 505153.0 [2024-08-06 04:15:42,538][52671] Sum rewards: 88.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.166', 'AMMO4': '0.190', 'AMMO3': '0.195', 'weapon5': '0.218', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '21.576', 'FRAGCOUNT': '72.000'} [2024-08-06 04:15:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 426770432. Throughput: 0: 4384.7. Samples: 106700340. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:15:42,794][52567] Avg episode reward: [(0, '70.250')] [2024-08-06 04:15:43,595][52669] DAMAGECOUNT value on done: 507711.0 [2024-08-06 04:15:43,596][52669] Sum rewards: 65.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.471', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.203', 'weapon2': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:44,290][52811] DAMAGECOUNT value on done: 459457.0 [2024-08-06 04:15:44,291][52811] Sum rewards: 62.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.749', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'weapon4': '0.154', 'AMMO3': '0.249', 'weapon2': '0.404', 'WEAPON3': '1.550', 'weapon3': '3.146', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '53.000'} [2024-08-06 04:15:44,358][52667] DAMAGECOUNT value on done: 506581.0 [2024-08-06 04:15:44,360][52667] Sum rewards: 80.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.116', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.164', 'weapon5': '0.190', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.802', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '66.000'} [2024-08-06 04:15:44,539][52668] DAMAGECOUNT value on done: 497433.0 [2024-08-06 04:15:44,539][52668] Sum rewards: 67.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.042', 'weapon5': '0.068', 'AMMO4': '0.208', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.340', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '58.000'} [2024-08-06 04:15:45,248][52650] Updated weights for policy 0, policy_version 52101 (0.0011) [2024-08-06 04:15:45,698][52671] DAMAGECOUNT value on done: 504508.0 [2024-08-06 04:15:45,698][52671] Sum rewards: 65.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.152', 'AMMO4': '0.192', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:46,153][52669] DAMAGECOUNT value on done: 499922.0 [2024-08-06 04:15:46,156][52669] Sum rewards: 86.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '71.000'} [2024-08-06 04:15:46,719][52667] DAMAGECOUNT value on done: 500034.0 [2024-08-06 04:15:46,722][52667] Sum rewards: 76.792, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.254', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.071', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.150', 'weapon3': '3.364', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '63.000'} [2024-08-06 04:15:47,401][52811] DAMAGECOUNT value on done: 463085.0 [2024-08-06 04:15:47,403][52811] Sum rewards: 65.438, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'weapon4': '0.202', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '56.000'} [2024-08-06 04:15:47,688][52668] DAMAGECOUNT value on done: 503535.0 [2024-08-06 04:15:47,688][52668] Sum rewards: 81.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.591', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.146', 'AMMO4': '0.184', 'weapon5': '0.196', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '67.000'} [2024-08-06 04:15:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 426852352. Throughput: 0: 4381.5. Samples: 106713390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:15:47,795][52567] Avg episode reward: [(0, '70.222')] [2024-08-06 04:15:48,497][52671] DAMAGECOUNT value on done: 502789.0 [2024-08-06 04:15:48,499][52671] Sum rewards: 73.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.923', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.239', 'weapon2': '0.468', 'WEAPON3': '1.500', 'weapon3': '3.378', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '62.000'} [2024-08-06 04:15:48,630][52803] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:15:49,317][52669] DAMAGECOUNT value on done: 506950.0 [2024-08-06 04:15:49,318][52669] Sum rewards: 72.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.494', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.070', 'weapon2': '0.178', 'AMMO3': '0.197', 'weapon5': '0.202', 'AMMO4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.330', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 04:15:49,501][52667] DAMAGECOUNT value on done: 507377.0 [2024-08-06 04:15:49,524][52667] Sum rewards: 70.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.030', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.148', 'weapon4': '0.158', 'AMMO4': '0.180', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '61.000'} [2024-08-06 04:15:49,549][52803] DAMAGECOUNT value on done: 465970.0 [2024-08-06 04:15:49,549][52803] Sum rewards: 63.713, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.236', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.162', 'AMMO4': '0.190', 'weapon5': '0.212', 'AMMO3': '0.299', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.750', 'weapon3': '2.834', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:49,745][52650] Updated weights for policy 0, policy_version 52111 (0.0036) [2024-08-06 04:15:50,380][52668] DAMAGECOUNT value on done: 502435.0 [2024-08-06 04:15:50,382][52668] Sum rewards: 65.632, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.911', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.113', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.250', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:50,471][52811] DAMAGECOUNT value on done: 467462.0 [2024-08-06 04:15:50,472][52811] Sum rewards: 83.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.473', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.134', 'weapon4': '0.164', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '69.000'} [2024-08-06 04:15:50,723][52811] Large shaping reward 2.584 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon3', 0.002)] [2024-08-06 04:15:51,692][52671] DAMAGECOUNT value on done: 513879.0 [2024-08-06 04:15:51,693][52671] Sum rewards: 78.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.102', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.496', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '65.000'} [2024-08-06 04:15:51,849][52669] DAMAGECOUNT value on done: 504687.0 [2024-08-06 04:15:51,850][52669] Sum rewards: 69.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.438', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.158', 'weapon4': '0.188', 'AMMO3': '0.215', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '59.000'} [2024-08-06 04:15:52,419][52658] DAMAGECOUNT value on done: 499695.0 [2024-08-06 04:15:52,419][52658] Sum rewards: 84.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.456', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.820', 'FRAGCOUNT': '70.500'} [2024-08-06 04:15:52,748][52803] DAMAGECOUNT value on done: 465274.0 [2024-08-06 04:15:52,750][52803] Sum rewards: 87.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.327', 'FRAGCOUNT': '73.000'} [2024-08-06 04:15:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 426942464. Throughput: 0: 4384.9. Samples: 106739730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:15:52,794][52567] Avg episode reward: [(0, '70.839')] [2024-08-06 04:15:53,650][52668] DAMAGECOUNT value on done: 503416.0 [2024-08-06 04:15:53,651][52668] Sum rewards: 60.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.995', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon5': '0.182', 'AMMO3': '0.200', 'AMMO4': '0.254', 'weapon2': '0.356', 'weapon4': '0.364', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '51.000'} [2024-08-06 04:15:53,770][52811] DAMAGECOUNT value on done: 474283.0 [2024-08-06 04:15:53,770][52811] Sum rewards: 73.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.098', 'AMMO3': '0.188', 'AMMO4': '0.244', 'weapon5': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.892', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '60.000'} [2024-08-06 04:15:54,351][52650] Updated weights for policy 0, policy_version 52121 (0.0015) [2024-08-06 04:15:54,396][52671] DAMAGECOUNT value on done: 503693.0 [2024-08-06 04:15:54,397][52671] Sum rewards: 68.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.591', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'AMMO3': '0.306', 'WEAPON3': '1.700', 'HITCOUNT': '3.310', 'weapon3': '3.322', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '60.000'} [2024-08-06 04:15:54,707][52669] DAMAGECOUNT value on done: 492273.0 [2024-08-06 04:15:54,708][52669] Sum rewards: 65.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.224', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.104', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.370', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '56.000'} [2024-08-06 04:15:55,412][52658] DAMAGECOUNT value on done: 501741.0 [2024-08-06 04:15:55,420][52658] Sum rewards: 58.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.163', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.074', 'weapon2': '0.186', 'weapon5': '0.214', 'AMMO4': '0.222', 'AMMO3': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.750', 'weapon3': '3.286', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '51.000'} [2024-08-06 04:15:55,794][52803] DAMAGECOUNT value on done: 470685.0 [2024-08-06 04:15:55,794][52803] Sum rewards: 68.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon4': '0.078', 'WEAPON4': '0.150', 'weapon2': '0.194', 'AMMO3': '0.199', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.532', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:56,395][52662] DAMAGECOUNT value on done: 504442.0 [2024-08-06 04:15:56,396][52662] Sum rewards: 67.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.122', 'weapon5': '0.226', 'AMMO4': '0.227', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 04:15:56,762][52668] DAMAGECOUNT value on done: 493054.0 [2024-08-06 04:15:56,763][52668] Sum rewards: 69.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.928', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.650', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.260', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '55.000'} [2024-08-06 04:15:56,966][52811] DAMAGECOUNT value on done: 468137.0 [2024-08-06 04:15:56,966][52811] Sum rewards: 64.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.958', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.233', 'weapon4': '0.242', 'weapon5': '0.258', 'AMMO4': '0.272', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '54.000'} [2024-08-06 04:15:57,314][52671] DAMAGECOUNT value on done: 509785.0 [2024-08-06 04:15:57,317][52671] Sum rewards: 75.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.845', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.040', 'weapon5': '0.044', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.418', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '61.000'} [2024-08-06 04:15:57,431][52669] DAMAGECOUNT value on done: 502877.0 [2024-08-06 04:15:57,432][52669] Sum rewards: 60.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.088', 'weapon4': '0.178', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.044', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '51.000'} [2024-08-06 04:15:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 427032576. Throughput: 0: 4375.6. Samples: 106765710. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:15:57,795][52567] Avg episode reward: [(0, '70.826')] [2024-08-06 04:15:58,181][52658] DAMAGECOUNT value on done: 505186.0 [2024-08-06 04:15:58,181][52658] Sum rewards: 61.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.563', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.074', 'AMMO4': '0.138', 'AMMO3': '0.221', 'weapon5': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.918', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '51.000'} [2024-08-06 04:15:58,739][52803] DAMAGECOUNT value on done: 473174.0 [2024-08-06 04:15:58,740][52803] Sum rewards: 63.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.594', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.106', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.938', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '52.000'} [2024-08-06 04:15:59,112][52650] Updated weights for policy 0, policy_version 52131 (0.0023) [2024-08-06 04:15:59,238][52662] DAMAGECOUNT value on done: 506245.0 [2024-08-06 04:15:59,239][52662] Sum rewards: 67.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.105', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.223', 'weapon2': '0.396', 'WEAPON3': '1.300', 'HITCOUNT': '3.370', 'weapon3': '3.402', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2024-08-06 04:15:59,543][52668] DAMAGECOUNT value on done: 505941.0 [2024-08-06 04:15:59,544][52668] Sum rewards: 73.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.727', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.134', 'AMMO4': '0.174', 'AMMO3': '0.174', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.236', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:00,143][52811] DAMAGECOUNT value on done: 466734.0 [2024-08-06 04:16:00,143][52811] Sum rewards: 63.158, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.064', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.154', 'AMMO3': '0.227', 'AMMO4': '0.277', 'weapon5': '0.314', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '2.594', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '53.000'} [2024-08-06 04:16:00,269][52669] DAMAGECOUNT value on done: 503739.0 [2024-08-06 04:16:00,271][52669] Sum rewards: 64.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.114', 'AMMO4': '0.174', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.002', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '54.000'} [2024-08-06 04:16:00,319][52671] DAMAGECOUNT value on done: 503883.0 [2024-08-06 04:16:00,320][52671] Sum rewards: 81.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.138', 'AMMO4': '0.144', 'weapon2': '0.216', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.316', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:00,919][52658] DAMAGECOUNT value on done: 504073.0 [2024-08-06 04:16:00,923][52658] Sum rewards: 75.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.074', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '64.000'} [2024-08-06 04:16:01,885][52803] DAMAGECOUNT value on done: 470232.0 [2024-08-06 04:16:01,886][52803] Sum rewards: 72.895, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.134', 'weapon4': '0.162', 'AMMO4': '0.166', 'AMMO3': '0.239', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:02,324][52662] DAMAGECOUNT value on done: 505291.0 [2024-08-06 04:16:02,325][52662] Sum rewards: 68.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.695', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.110', 'AMMO3': '0.206', 'weapon5': '0.238', 'AMMO4': '0.346', 'weapon2': '0.352', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.500'} [2024-08-06 04:16:02,397][52668] DAMAGECOUNT value on done: 505468.0 [2024-08-06 04:16:02,398][52668] Sum rewards: 91.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.097', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '74.000'} [2024-08-06 04:16:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 427114496. Throughput: 0: 4381.5. Samples: 106779060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:16:02,795][52567] Avg episode reward: [(0, '70.902')] [2024-08-06 04:16:03,211][52811] DAMAGECOUNT value on done: 472711.0 [2024-08-06 04:16:03,212][52811] Sum rewards: 70.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.874', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:03,303][52669] DAMAGECOUNT value on done: 519241.0 [2024-08-06 04:16:03,303][52669] Sum rewards: 74.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO4': '0.173', 'AMMO3': '0.283', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.242', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '63.000'} [2024-08-06 04:16:03,835][52650] Updated weights for policy 0, policy_version 52141 (0.0014) [2024-08-06 04:16:03,857][52671] DAMAGECOUNT value on done: 498857.0 [2024-08-06 04:16:03,858][52671] Sum rewards: 71.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.216', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.384', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:03,884][52658] DAMAGECOUNT value on done: 495014.0 [2024-08-06 04:16:03,885][52658] Sum rewards: 80.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.038', 'weapon4': '0.040', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.264', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'weapon3': '3.474', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '69.000'} [2024-08-06 04:16:05,020][52803] DAMAGECOUNT value on done: 460087.0 [2024-08-06 04:16:05,021][52803] Sum rewards: 79.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.154', 'weapon5': '0.154', 'AMMO4': '0.208', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '67.000'} [2024-08-06 04:16:05,411][52662] DAMAGECOUNT value on done: 494810.0 [2024-08-06 04:16:05,413][52662] Sum rewards: 61.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.585', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.112', 'AMMO3': '0.178', 'AMMO4': '0.224', 'weapon4': '0.288', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:05,522][52668] DAMAGECOUNT value on done: 494862.0 [2024-08-06 04:16:05,522][52668] Sum rewards: 67.937, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.775', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.678', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:05,722][52669] DAMAGECOUNT value on done: 506179.0 [2024-08-06 04:16:05,722][52669] Sum rewards: 71.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.068', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:06,373][52811] DAMAGECOUNT value on done: 468752.0 [2024-08-06 04:16:06,374][52811] Sum rewards: 71.201, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.074', 'weapon5': '0.140', 'AMMO3': '0.209', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '60.500'} [2024-08-06 04:16:06,566][52658] DAMAGECOUNT value on done: 497110.0 [2024-08-06 04:16:06,567][52658] Sum rewards: 70.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:06,633][52671] DAMAGECOUNT value on done: 504582.0 [2024-08-06 04:16:06,637][52671] Sum rewards: 68.418, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.114', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.298', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 427204608. Throughput: 0: 4374.2. Samples: 106805000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:16:07,802][52567] Avg episode reward: [(0, '70.901')] [2024-08-06 04:16:08,129][52803] DAMAGECOUNT value on done: 462390.0 [2024-08-06 04:16:08,129][52803] Sum rewards: 64.286, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.325', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.078', 'AMMO4': '0.198', 'weapon5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.202', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:08,378][52650] Updated weights for policy 0, policy_version 52151 (0.0011) [2024-08-06 04:16:08,462][52662] DAMAGECOUNT value on done: 506588.0 [2024-08-06 04:16:08,466][52662] Sum rewards: 82.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.025', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.086', 'AMMO3': '0.184', 'weapon5': '0.222', 'AMMO4': '0.257', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:08,578][52669] DAMAGECOUNT value on done: 505185.0 [2024-08-06 04:16:08,578][52669] Sum rewards: 88.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.277', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.168', 'AMMO3': '0.212', 'AMMO4': '0.243', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.609', 'FRAGCOUNT': '72.000'} [2024-08-06 04:16:08,805][52668] DAMAGECOUNT value on done: 498025.0 [2024-08-06 04:16:08,807][52668] Sum rewards: 67.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.738', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.140', 'AMMO4': '0.183', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:09,016][52658] DAMAGECOUNT value on done: 506208.0 [2024-08-06 04:16:09,016][52658] Sum rewards: 65.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.610', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.080', 'AMMO4': '0.139', 'weapon5': '0.190', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.098', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:09,266][52660] DAMAGECOUNT value on done: 500966.0 [2024-08-06 04:16:09,267][52660] Sum rewards: 60.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.476', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '49.500'} [2024-08-06 04:16:09,485][52811] DAMAGECOUNT value on done: 466680.0 [2024-08-06 04:16:09,488][52811] Sum rewards: 73.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.021', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.140', 'weapon5': '0.170', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:09,818][52671] DAMAGECOUNT value on done: 506515.0 [2024-08-06 04:16:09,818][52671] Sum rewards: 72.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.151', 'AMMO3': '0.161', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:11,243][52803] DAMAGECOUNT value on done: 461032.0 [2024-08-06 04:16:11,245][52803] Sum rewards: 70.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.158', 'AMMO3': '0.178', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:11,381][52669] DAMAGECOUNT value on done: 506278.0 [2024-08-06 04:16:11,382][52669] Sum rewards: 62.413, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.050', 'AMMO4': '0.067', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.078', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '51.000'} [2024-08-06 04:16:11,496][52662] DAMAGECOUNT value on done: 499295.0 [2024-08-06 04:16:11,496][52662] Sum rewards: 87.390, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.751', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.162', 'weapon2': '0.182', 'weapon5': '0.210', 'weapon4': '0.216', 'AMMO4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '21.882', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:11,882][52668] DAMAGECOUNT value on done: 506667.0 [2024-08-06 04:16:11,883][52668] Sum rewards: 69.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.256', 'WEAPON3': '1.350', 'weapon3': '3.500', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '57.000'} [2024-08-06 04:16:11,995][52658] DAMAGECOUNT value on done: 496622.0 [2024-08-06 04:16:11,997][52658] Sum rewards: 78.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.530', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.754', 'WEAPON3': '1.350', 'weapon3': '2.904', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '65.000'} [2024-08-06 04:16:12,373][52660] DAMAGECOUNT value on done: 491878.0 [2024-08-06 04:16:12,374][52660] Sum rewards: 66.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.012', 'AMMO2': '0.062', 'weapon2': '0.170', 'weapon5': '0.178', 'AMMO3': '0.251', 'weapon4': '0.270', 'AMMO4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:12,484][52671] DAMAGECOUNT value on done: 504037.0 [2024-08-06 04:16:12,487][52671] Sum rewards: 79.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.668', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.108', 'AMMO4': '0.204', 'weapon5': '0.210', 'AMMO3': '0.244', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '66.000'} [2024-08-06 04:16:12,576][52811] DAMAGECOUNT value on done: 478577.0 [2024-08-06 04:16:12,576][52811] Sum rewards: 71.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.068', 'AMMO3': '0.212', 'weapon5': '0.248', 'weapon2': '0.250', 'AMMO4': '0.341', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'weapon4': '0.782', 'WEAPON3': '1.300', 'weapon3': '2.328', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 427294720. Throughput: 0: 4375.6. Samples: 106831400. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:16:12,794][52567] Avg episode reward: [(0, '71.334')] [2024-08-06 04:16:13,066][52647] DAMAGECOUNT value on done: 528540.0 [2024-08-06 04:16:13,068][52647] Sum rewards: 73.268, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.242', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.132', 'AMMO4': '0.144', 'AMMO3': '0.177', 'weapon5': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:13,215][52650] Updated weights for policy 0, policy_version 52161 (0.0020) [2024-08-06 04:16:14,172][52662] DAMAGECOUNT value on done: 505941.0 [2024-08-06 04:16:14,172][52662] Sum rewards: 56.360, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.690', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.174', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'weapon2': '0.476', 'WEAPON3': '1.650', 'weapon3': '2.952', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '50.500'} [2024-08-06 04:16:14,234][52669] DAMAGECOUNT value on done: 508431.0 [2024-08-06 04:16:14,234][52669] Sum rewards: 89.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.624', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.073', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.233', 'WEAPON3': '1.500', 'weapon3': '3.510', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.391', 'FRAGCOUNT': '75.000'} [2024-08-06 04:16:14,241][52803] DAMAGECOUNT value on done: 467630.0 [2024-08-06 04:16:14,242][52803] Sum rewards: 74.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:15,153][52658] DAMAGECOUNT value on done: 511544.0 [2024-08-06 04:16:15,155][52658] Sum rewards: 68.465, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.053', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO4': '0.265', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.600', 'weapon3': '2.936', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:15,256][52671] DAMAGECOUNT value on done: 512504.0 [2024-08-06 04:16:15,257][52671] Sum rewards: 82.465, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.042', 'AMMO4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '66.000'} [2024-08-06 04:16:15,263][52668] DAMAGECOUNT value on done: 500252.0 [2024-08-06 04:16:15,263][52668] Sum rewards: 68.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.082', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.578', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:15,551][52811] DAMAGECOUNT value on done: 466956.0 [2024-08-06 04:16:15,552][52811] Sum rewards: 85.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.014', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon4': '0.264', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '72.000'} [2024-08-06 04:16:15,680][52660] DAMAGECOUNT value on done: 502945.0 [2024-08-06 04:16:15,681][52660] Sum rewards: 73.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:15,782][52647] DAMAGECOUNT value on done: 530091.0 [2024-08-06 04:16:15,783][52647] Sum rewards: 80.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.030', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.140', 'weapon4': '0.146', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.298', 'WEAPON3': '1.850', 'weapon3': '3.218', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '69.000'} [2024-08-06 04:16:16,936][52662] DAMAGECOUNT value on done: 509503.0 [2024-08-06 04:16:16,938][52662] Sum rewards: 57.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.452', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.458', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '48.000'} [2024-08-06 04:16:17,394][52803] DAMAGECOUNT value on done: 458277.0 [2024-08-06 04:16:17,394][52803] Sum rewards: 69.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.115', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.152', 'AMMO3': '0.179', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.198', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:17,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 427376640. Throughput: 0: 4376.7. Samples: 106844660. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:16:17,795][52567] Avg episode reward: [(0, '71.379')] [2024-08-06 04:16:17,884][52650] Updated weights for policy 0, policy_version 52171 (0.0030) [2024-08-06 04:16:17,890][52658] DAMAGECOUNT value on done: 498866.0 [2024-08-06 04:16:17,896][52658] Sum rewards: 75.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.830', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.094', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.282', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.050', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '64.000'} [2024-08-06 04:16:18,475][52668] DAMAGECOUNT value on done: 494348.0 [2024-08-06 04:16:18,476][52668] Sum rewards: 71.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.442', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.064', 'AMMO4': '0.164', 'weapon5': '0.178', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:18,621][52671] DAMAGECOUNT value on done: 505514.0 [2024-08-06 04:16:18,623][52671] Sum rewards: 61.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.755', 'AMMO5': '0.017', 'weapon5': '0.030', 'AMMO2': '0.057', 'weapon4': '0.156', 'AMMO3': '0.202', 'AMMO4': '0.288', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.302', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '54.000'} [2024-08-06 04:16:18,703][52647] DAMAGECOUNT value on done: 525223.0 [2024-08-06 04:16:18,703][52647] Sum rewards: 79.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.496', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:18,721][52811] DAMAGECOUNT value on done: 466314.0 [2024-08-06 04:16:18,725][52811] Sum rewards: 76.860, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.214', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.148', 'AMMO4': '0.173', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'weapon3': '3.324', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '66.000'} [2024-08-06 04:16:18,890][52660] DAMAGECOUNT value on done: 508475.0 [2024-08-06 04:16:18,892][52660] Sum rewards: 65.794, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.871', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.104', 'AMMO3': '0.151', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.952', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:20,003][52662] DAMAGECOUNT value on done: 500591.0 [2024-08-06 04:16:20,005][52662] Sum rewards: 74.132, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.598', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.138', 'AMMO4': '0.198', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.330', 'WEAPON3': '1.900', 'weapon3': '3.188', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '67.000'} [2024-08-06 04:16:20,386][52658] DAMAGECOUNT value on done: 513166.0 [2024-08-06 04:16:20,387][52658] Sum rewards: 74.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.528', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.224', 'AMMO4': '0.251', 'AMMO3': '0.255', 'weapon4': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.796', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 04:16:20,505][52803] DAMAGECOUNT value on done: 474396.0 [2024-08-06 04:16:20,507][52803] Sum rewards: 73.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.700', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.161', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.990', 'WEAPON3': '1.350', 'weapon3': '2.674', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:21,345][52647] DAMAGECOUNT value on done: 535023.0 [2024-08-06 04:16:21,346][52647] Sum rewards: 75.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.349', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.072', 'weapon5': '0.200', 'AMMO3': '0.215', 'AMMO4': '0.253', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:21,831][52668] DAMAGECOUNT value on done: 489914.0 [2024-08-06 04:16:21,834][52668] Sum rewards: 67.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.908', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.166', 'AMMO3': '0.202', 'weapon5': '0.232', 'AMMO4': '0.238', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '57.000'} [2024-08-06 04:16:21,876][52811] DAMAGECOUNT value on done: 468670.0 [2024-08-06 04:16:21,876][52811] Sum rewards: 82.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.122', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.456', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '66.000'} [2024-08-06 04:16:21,893][52671] DAMAGECOUNT value on done: 491839.0 [2024-08-06 04:16:21,893][52671] Sum rewards: 65.790, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.902', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.151', 'AMMO4': '0.212', 'weapon2': '0.240', 'weapon5': '0.264', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.774', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:22,202][52660] DAMAGECOUNT value on done: 501376.0 [2024-08-06 04:16:22,204][52660] Sum rewards: 70.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.430', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.152', 'weapon5': '0.182', 'AMMO3': '0.199', 'AMMO4': '0.235', 'weapon2': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:22,208][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:16:22,423][52650] Updated weights for policy 0, policy_version 52181 (0.0022) [2024-08-06 04:16:22,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 427466752. Throughput: 0: 4368.2. Samples: 106870640. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:16:22,795][52567] Avg episode reward: [(0, '71.978')] [2024-08-06 04:16:22,972][52658] DAMAGECOUNT value on done: 494727.0 [2024-08-06 04:16:22,972][52658] Sum rewards: 67.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'AMMO5': '0.005', 'AMMO2': '0.056', 'weapon5': '0.096', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'AMMO4': '0.278', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:23,077][52662] DAMAGECOUNT value on done: 513074.0 [2024-08-06 04:16:23,080][52662] Sum rewards: 72.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.496', 'weapon5': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.858', 'WEAPON3': '1.000', 'weapon3': '2.946', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:23,344][52665] DAMAGECOUNT value on done: 489905.0 [2024-08-06 04:16:23,344][52665] Sum rewards: 58.123, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.100', 'weapon4': '0.184', 'AMMO3': '0.205', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.830', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '49.000'} [2024-08-06 04:16:23,667][52803] DAMAGECOUNT value on done: 469498.0 [2024-08-06 04:16:23,668][52803] Sum rewards: 67.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.008', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.118', 'weapon4': '0.122', 'AMMO4': '0.160', 'weapon2': '0.206', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.318', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:24,444][52647] DAMAGECOUNT value on done: 533903.0 [2024-08-06 04:16:24,444][52647] Sum rewards: 74.559, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.136', 'AMMO3': '0.171', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:24,609][52671] DAMAGECOUNT value on done: 511567.0 [2024-08-06 04:16:24,610][52671] Sum rewards: 74.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:24,896][52811] DAMAGECOUNT value on done: 463389.0 [2024-08-06 04:16:24,898][52811] Sum rewards: 72.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.760', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.142', 'weapon5': '0.188', 'AMMO4': '0.207', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:25,210][52668] DAMAGECOUNT value on done: 490435.0 [2024-08-06 04:16:25,210][52668] Sum rewards: 83.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.060', 'AMMO4': '0.088', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.050', 'weapon3': '3.440', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '67.000'} [2024-08-06 04:16:25,575][52660] DAMAGECOUNT value on done: 498750.0 [2024-08-06 04:16:25,575][52660] Sum rewards: 76.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.780', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.064', 'AMMO4': '0.124', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.272', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 04:16:25,707][52658] DAMAGECOUNT value on done: 501645.0 [2024-08-06 04:16:25,709][52658] Sum rewards: 67.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.021', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.174', 'AMMO3': '0.222', 'weapon4': '0.234', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:25,745][52667] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:16:25,943][52665] DAMAGECOUNT value on done: 503561.0 [2024-08-06 04:16:25,943][52665] Sum rewards: 74.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.164', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:26,336][52662] DAMAGECOUNT value on done: 500435.0 [2024-08-06 04:16:26,338][52662] Sum rewards: 72.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.863', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:26,838][52803] DAMAGECOUNT value on done: 463677.0 [2024-08-06 04:16:26,841][52803] Sum rewards: 67.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'weapon4': '0.076', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.298', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.376', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:27,136][52650] Updated weights for policy 0, policy_version 52191 (0.0020) [2024-08-06 04:16:27,182][52647] DAMAGECOUNT value on done: 532397.0 [2024-08-06 04:16:27,183][52647] Sum rewards: 71.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.203', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:27,741][52671] DAMAGECOUNT value on done: 508662.0 [2024-08-06 04:16:27,742][52671] Sum rewards: 71.176, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.255', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.050', 'weapon4': '0.068', 'AMMO3': '0.157', 'weapon5': '0.182', 'AMMO4': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.658', 'WEAPON3': '0.900', 'weapon3': '2.886', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:27,795][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.1, 300 sec: 17522.5). Total num frames: 427556864. Throughput: 0: 4368.4. Samples: 106896920. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:16:27,802][52567] Avg episode reward: [(0, '71.785')] [2024-08-06 04:16:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052192_427556864.pth... [2024-08-06 04:16:27,883][52811] DAMAGECOUNT value on done: 468654.0 [2024-08-06 04:16:27,884][52811] Sum rewards: 73.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.036', 'weapon4': '0.084', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051680_423362560.pth [2024-08-06 04:16:28,207][52668] DAMAGECOUNT value on done: 491944.0 [2024-08-06 04:16:28,209][52668] Sum rewards: 71.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.895', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'weapon4': '0.202', 'AMMO3': '0.217', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:28,539][52660] DAMAGECOUNT value on done: 497863.0 [2024-08-06 04:16:28,540][52660] Sum rewards: 95.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.821', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.096', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '22.692', 'FRAGCOUNT': '79.000'} [2024-08-06 04:16:28,637][52658] DAMAGECOUNT value on done: 502018.0 [2024-08-06 04:16:28,637][52658] Sum rewards: 83.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:28,949][52665] DAMAGECOUNT value on done: 499613.0 [2024-08-06 04:16:28,950][52665] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.366', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.062', 'weapon5': '0.176', 'AMMO4': '0.228', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:29,354][52647] DAMAGECOUNT value on done: 527955.0 [2024-08-06 04:16:29,354][52647] Sum rewards: 73.610, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'HEALTH': '0.016', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.099', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.234', 'WEAPON3': '1.200', 'HITCOUNT': '3.370', 'weapon3': '3.428', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:29,764][52662] DAMAGECOUNT value on done: 503122.0 [2024-08-06 04:16:29,764][52662] Sum rewards: 63.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.200', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon2': '0.190', 'AMMO3': '0.203', 'weapon5': '0.266', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.978', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:30,141][52803] DAMAGECOUNT value on done: 472017.0 [2024-08-06 04:16:30,142][52803] Sum rewards: 78.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.026', 'AMMO2': '0.061', 'weapon4': '0.174', 'AMMO3': '0.193', 'weapon5': '0.264', 'AMMO4': '0.307', 'weapon2': '0.466', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '63.000'} [2024-08-06 04:16:31,000][52671] DAMAGECOUNT value on done: 508311.0 [2024-08-06 04:16:31,001][52671] Sum rewards: 66.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.994', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.210', 'AMMO3': '0.238', 'AMMO4': '0.243', 'weapon5': '0.250', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:31,055][52811] DAMAGECOUNT value on done: 471094.0 [2024-08-06 04:16:31,055][52811] Sum rewards: 73.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon5': '0.132', 'AMMO3': '0.220', 'AMMO4': '0.243', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '61.500'} [2024-08-06 04:16:31,102][52668] DAMAGECOUNT value on done: 500556.0 [2024-08-06 04:16:31,103][52668] Sum rewards: 85.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.155', 'weapon4': '0.180', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '70.000'} [2024-08-06 04:16:31,607][52660] DAMAGECOUNT value on done: 505719.0 [2024-08-06 04:16:31,609][52660] Sum rewards: 71.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.124', 'weapon5': '0.146', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:31,629][52658] DAMAGECOUNT value on done: 499798.0 [2024-08-06 04:16:31,629][52658] Sum rewards: 64.369, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.574', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.123', 'weapon5': '0.158', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.352', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:31,768][52665] DAMAGECOUNT value on done: 494845.0 [2024-08-06 04:16:31,768][52665] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.013', 'AMMO2': '0.057', 'AMMO3': '0.188', 'weapon5': '0.230', 'weapon4': '0.236', 'AMMO4': '0.286', 'weapon2': '0.436', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:31,961][52650] Updated weights for policy 0, policy_version 52201 (0.0044) [2024-08-06 04:16:32,079][52647] DAMAGECOUNT value on done: 522381.0 [2024-08-06 04:16:32,079][52647] Sum rewards: 67.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.120', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.195', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:32,497][52664] DAMAGECOUNT value on done: 520540.0 [2024-08-06 04:16:32,498][52664] Sum rewards: 81.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.042', 'weapon5': '0.062', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.606', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '67.000'} [2024-08-06 04:16:32,742][52662] DAMAGECOUNT value on done: 499467.0 [2024-08-06 04:16:32,743][52662] Sum rewards: 66.900, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.118', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.332', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 427646976. Throughput: 0: 4362.4. Samples: 106909700. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 04:16:32,795][52567] Avg episode reward: [(0, '72.267')] [2024-08-06 04:16:33,222][52803] DAMAGECOUNT value on done: 466660.0 [2024-08-06 04:16:33,232][52803] Sum rewards: 73.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.076', 'AMMO4': '0.169', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:34,040][52671] DAMAGECOUNT value on done: 504725.0 [2024-08-06 04:16:34,043][52671] Sum rewards: 68.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.124', 'weapon5': '0.176', 'AMMO3': '0.215', 'AMMO4': '0.216', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:34,092][52668] DAMAGECOUNT value on done: 503856.0 [2024-08-06 04:16:34,092][52668] Sum rewards: 83.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.130', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '67.000'} [2024-08-06 04:16:34,125][52811] DAMAGECOUNT value on done: 464947.0 [2024-08-06 04:16:34,125][52811] Sum rewards: 63.547, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.054', 'weapon4': '0.056', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.352', 'WEAPON3': '1.950', 'weapon3': '3.400', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '57.000'} [2024-08-06 04:16:34,454][52658] DAMAGECOUNT value on done: 493256.0 [2024-08-06 04:16:34,455][52658] Sum rewards: 69.399, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.052', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'HEALTH': '0.162', 'AMMO3': '0.168', 'weapon2': '0.338', 'WEAPON3': '0.950', 'HITCOUNT': '3.310', 'weapon3': '3.328', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:34,540][52660] DAMAGECOUNT value on done: 501092.0 [2024-08-06 04:16:34,542][52660] Sum rewards: 68.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.226', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.180', 'weapon4': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:34,686][52665] DAMAGECOUNT value on done: 485662.0 [2024-08-06 04:16:34,688][52665] Sum rewards: 86.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.981', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'weapon4': '0.148', 'AMMO4': '0.151', 'weapon2': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.244', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '72.000'} [2024-08-06 04:16:34,734][52647] DAMAGECOUNT value on done: 533128.0 [2024-08-06 04:16:34,734][52647] Sum rewards: 79.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.186', 'weapon4': '0.188', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '66.000'} [2024-08-06 04:16:35,110][52664] DAMAGECOUNT value on done: 524789.0 [2024-08-06 04:16:35,111][52664] Sum rewards: 66.202, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.034', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'AMMO4': '0.169', 'weapon2': '0.768', 'WEAPON3': '0.900', 'weapon3': '2.994', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '51.000'} [2024-08-06 04:16:35,876][52662] DAMAGECOUNT value on done: 508972.0 [2024-08-06 04:16:35,878][52662] Sum rewards: 77.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.490', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.070', 'AMMO4': '0.181', 'weapon5': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:36,422][52668] DAMAGECOUNT value on done: 499965.0 [2024-08-06 04:16:36,424][52668] Sum rewards: 67.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.226', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.110', 'AMMO4': '0.198', 'AMMO3': '0.203', 'weapon2': '0.234', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.180', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:36,442][52803] DAMAGECOUNT value on done: 464052.0 [2024-08-06 04:16:36,443][52803] Sum rewards: 77.987, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.074', 'AMMO4': '0.142', 'weapon5': '0.176', 'AMMO3': '0.188', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:36,723][52650] Updated weights for policy 0, policy_version 52211 (0.0014) [2024-08-06 04:16:36,854][52660] DAMAGECOUNT value on done: 499615.0 [2024-08-06 04:16:36,854][52660] Sum rewards: 82.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.414', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.120', 'weapon2': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:36,976][52671] DAMAGECOUNT value on done: 501171.0 [2024-08-06 04:16:36,976][52671] Sum rewards: 69.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.709', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.118', 'AMMO4': '0.149', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.378', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:37,148][52811] DAMAGECOUNT value on done: 467435.0 [2024-08-06 04:16:37,149][52811] Sum rewards: 66.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.803', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.180', 'AMMO4': '0.180', 'weapon5': '0.212', 'weapon2': '0.214', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.024', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '53.500'} [2024-08-06 04:16:37,221][52658] DAMAGECOUNT value on done: 509602.0 [2024-08-06 04:16:37,221][52658] Sum rewards: 75.238, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.975', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.156', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.312', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:37,502][52647] DAMAGECOUNT value on done: 527301.0 [2024-08-06 04:16:37,504][52647] Sum rewards: 71.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.180', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.227', 'weapon5': '0.254', 'weapon2': '0.288', 'AMMO4': '0.316', 'weapon4': '0.320', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.750', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.208', 'FRAGCOUNT': '59.500'} [2024-08-06 04:16:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 427728896. Throughput: 0: 4363.3. Samples: 106936080. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 04:16:37,795][52567] Avg episode reward: [(0, '72.755')] [2024-08-06 04:16:37,852][52665] DAMAGECOUNT value on done: 492340.0 [2024-08-06 04:16:37,853][52665] Sum rewards: 82.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.636', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.166', 'AMMO4': '0.167', 'weapon4': '0.212', 'AMMO3': '0.236', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:37,859][52664] DAMAGECOUNT value on done: 525687.0 [2024-08-06 04:16:37,860][52664] Sum rewards: 89.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.915', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.112', 'weapon5': '0.146', 'AMMO3': '0.211', 'weapon2': '0.214', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.939', 'FRAGCOUNT': '73.000'} [2024-08-06 04:16:39,070][52662] DAMAGECOUNT value on done: 502440.0 [2024-08-06 04:16:39,071][52662] Sum rewards: 76.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.128', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.194', 'weapon2': '0.230', 'WEAPON3': '1.150', 'weapon3': '3.522', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '64.000'} [2024-08-06 04:16:39,420][52668] DAMAGECOUNT value on done: 504144.0 [2024-08-06 04:16:39,420][52668] Sum rewards: 65.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.088', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.262', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.298', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:39,445][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:16:39,533][52803] DAMAGECOUNT value on done: 470370.0 [2024-08-06 04:16:39,536][52803] Sum rewards: 63.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.379', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.166', 'AMMO3': '0.174', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '51.500'} [2024-08-06 04:16:39,863][52647] DAMAGECOUNT value on done: 529373.0 [2024-08-06 04:16:39,863][52647] Sum rewards: 64.652, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.076', 'weapon5': '0.090', 'AMMO3': '0.165', 'AMMO4': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.032', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:39,900][52660] DAMAGECOUNT value on done: 506839.0 [2024-08-06 04:16:39,901][52660] Sum rewards: 69.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.340', 'weapon4': '0.384', 'WEAPON3': '1.600', 'weapon3': '2.816', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:39,974][52658] DAMAGECOUNT value on done: 500391.0 [2024-08-06 04:16:39,976][52658] Sum rewards: 80.634, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.596', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.139', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '0.950', 'weapon3': '3.334', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.000'} [2024-08-06 04:16:40,292][52664] DAMAGECOUNT value on done: 516071.0 [2024-08-06 04:16:40,293][52664] Sum rewards: 75.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.220', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.127', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.100', 'weapon3': '3.312', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:41,025][52665] DAMAGECOUNT value on done: 495311.0 [2024-08-06 04:16:41,025][52665] Sum rewards: 74.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'weapon4': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.372', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '63.000'} [2024-08-06 04:16:41,278][52650] Updated weights for policy 0, policy_version 52221 (0.0011) [2024-08-06 04:16:41,694][52662] DAMAGECOUNT value on done: 511235.0 [2024-08-06 04:16:41,694][52662] Sum rewards: 58.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.172', 'weapon4': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.251', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.044', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '50.000'} [2024-08-06 04:16:42,053][52647] DAMAGECOUNT value on done: 520320.0 [2024-08-06 04:16:42,055][52647] Sum rewards: 77.344, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.378', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO3': '0.144', 'AMMO4': '0.156', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.518', 'WEAPON3': '0.900', 'weapon3': '2.898', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:42,595][52803] DAMAGECOUNT value on done: 470144.0 [2024-08-06 04:16:42,599][52803] Sum rewards: 77.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.661', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO3': '0.160', 'AMMO4': '0.177', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '0.950', 'weapon3': '2.978', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:42,738][52664] DAMAGECOUNT value on done: 522588.0 [2024-08-06 04:16:42,738][52664] Sum rewards: 63.150, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO3': '0.197', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:42,740][52668] DAMAGECOUNT value on done: 501554.0 [2024-08-06 04:16:42,741][52668] Sum rewards: 77.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.615', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.084', 'weapon5': '0.194', 'AMMO3': '0.252', 'AMMO4': '0.292', 'weapon2': '0.402', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '65.000'} [2024-08-06 04:16:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17522.7). Total num frames: 427819008. Throughput: 0: 4373.6. Samples: 106962520. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 04:16:42,794][52567] Avg episode reward: [(0, '72.860')] [2024-08-06 04:16:42,795][52614] Saving new best policy, reward=72.860! [2024-08-06 04:16:43,057][52658] DAMAGECOUNT value on done: 504318.0 [2024-08-06 04:16:43,057][52658] Sum rewards: 78.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.105', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.058', 'AMMO4': '0.147', 'weapon5': '0.174', 'weapon2': '0.184', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.360', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '67.000'} [2024-08-06 04:16:43,183][52660] DAMAGECOUNT value on done: 492773.0 [2024-08-06 04:16:43,183][52660] Sum rewards: 73.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.768', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.172', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.294', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:44,101][52665] DAMAGECOUNT value on done: 497657.0 [2024-08-06 04:16:44,102][52665] Sum rewards: 70.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.149', 'weapon5': '0.186', 'weapon2': '0.202', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.330', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:44,954][52662] DAMAGECOUNT value on done: 505507.0 [2024-08-06 04:16:44,956][52662] Sum rewards: 74.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.062', 'AMMO4': '0.178', 'weapon5': '0.182', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:45,248][52647] DAMAGECOUNT value on done: 533236.0 [2024-08-06 04:16:45,249][52647] Sum rewards: 89.535, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.192', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.309', 'weapon2': '0.404', 'WEAPON3': '1.850', 'weapon3': '3.176', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.715', 'FRAGCOUNT': '78.000'} [2024-08-06 04:16:45,760][52660] DAMAGECOUNT value on done: 501235.0 [2024-08-06 04:16:45,762][52660] Sum rewards: 68.135, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.070', 'weapon4': '0.094', 'AMMO4': '0.116', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '56.000'} [2024-08-06 04:16:45,840][52803] DAMAGECOUNT value on done: 471529.0 [2024-08-06 04:16:45,843][52803] Sum rewards: 68.240, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.128', 'AMMO4': '0.193', 'weapon5': '0.208', 'weapon4': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.612', 'WEAPON3': '0.900', 'weapon3': '2.782', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '54.000'} [2024-08-06 04:16:46,057][52650] Updated weights for policy 0, policy_version 52231 (0.0012) [2024-08-06 04:16:46,092][52664] DAMAGECOUNT value on done: 519850.0 [2024-08-06 04:16:46,093][52664] Sum rewards: 85.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.136', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.227', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.516', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '70.000'} [2024-08-06 04:16:46,306][52658] DAMAGECOUNT value on done: 508420.0 [2024-08-06 04:16:46,308][52658] Sum rewards: 83.746, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'HEALTH': '0.216', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.234', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '68.000'} [2024-08-06 04:16:47,181][52665] DAMAGECOUNT value on done: 503165.0 [2024-08-06 04:16:47,183][52665] Sum rewards: 71.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.796', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '58.000'} [2024-08-06 04:16:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 427909120. Throughput: 0: 4362.7. Samples: 106975380. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 04:16:47,794][52567] Avg episode reward: [(0, '73.319')] [2024-08-06 04:16:47,797][52614] Saving new best policy, reward=73.319! [2024-08-06 04:16:48,047][52662] DAMAGECOUNT value on done: 497520.0 [2024-08-06 04:16:48,048][52662] Sum rewards: 64.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.836', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.108', 'AMMO4': '0.178', 'weapon5': '0.180', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:48,123][52647] DAMAGECOUNT value on done: 524706.0 [2024-08-06 04:16:48,124][52647] Sum rewards: 60.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.498', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.206', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '2.942', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2024-08-06 04:16:48,479][52660] DAMAGECOUNT value on done: 510997.0 [2024-08-06 04:16:48,482][52660] Sum rewards: 85.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO4': '0.192', 'weapon2': '0.196', 'weapon4': '0.270', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.988', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.195', 'FRAGCOUNT': '71.000'} [2024-08-06 04:16:48,877][52803] DAMAGECOUNT value on done: 462425.0 [2024-08-06 04:16:48,884][52803] Sum rewards: 68.713, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.702', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.124', 'AMMO3': '0.251', 'weapon2': '0.312', 'AMMO4': '0.313', 'weapon5': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.916', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:49,041][52664] DAMAGECOUNT value on done: 519142.0 [2024-08-06 04:16:49,041][52664] Sum rewards: 63.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.172', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.258', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 04:16:50,248][52665] DAMAGECOUNT value on done: 494289.0 [2024-08-06 04:16:50,249][52665] Sum rewards: 77.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon4': '0.196', 'AMMO3': '0.230', 'weapon2': '0.268', 'weapon5': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '65.000'} [2024-08-06 04:16:50,660][52650] Updated weights for policy 0, policy_version 52241 (0.0031) [2024-08-06 04:16:50,784][52647] DAMAGECOUNT value on done: 534731.0 [2024-08-06 04:16:50,786][52647] Sum rewards: 75.806, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.384', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.266', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '65.000'} [2024-08-06 04:16:50,956][52662] DAMAGECOUNT value on done: 504058.0 [2024-08-06 04:16:50,957][52662] Sum rewards: 81.829, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.262', 'ARMOR': '0.004', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.144', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '66.000'} [2024-08-06 04:16:51,298][52660] DAMAGECOUNT value on done: 513773.0 [2024-08-06 04:16:51,298][52660] Sum rewards: 70.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.656', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon4': '0.220', 'AMMO3': '0.249', 'weapon2': '0.258', 'weapon5': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.922', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '60.000'} [2024-08-06 04:16:51,710][52664] DAMAGECOUNT value on done: 514472.0 [2024-08-06 04:16:51,710][52664] Sum rewards: 75.747, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.226', 'AMMO5': '0.003', 'weapon5': '0.018', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon2': '0.722', 'WEAPON3': '1.000', 'weapon3': '3.078', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 427991040. Throughput: 0: 4366.0. Samples: 107001470. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 04:16:52,794][52567] Avg episode reward: [(0, '73.041')] [2024-08-06 04:16:53,090][52665] DAMAGECOUNT value on done: 504617.0 [2024-08-06 04:16:53,099][52665] Sum rewards: 79.092, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.023', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.124', 'weapon5': '0.180', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '65.000'} [2024-08-06 04:16:53,592][52662] DAMAGECOUNT value on done: 497220.0 [2024-08-06 04:16:53,593][52662] Sum rewards: 73.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.729', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.384', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '62.000'} [2024-08-06 04:16:53,834][52647] DAMAGECOUNT value on done: 527298.0 [2024-08-06 04:16:53,835][52647] Sum rewards: 68.270, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.854', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon5': '0.178', 'weapon2': '0.216', 'AMMO3': '0.260', 'weapon4': '0.296', 'AMMO4': '0.345', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '59.000'} [2024-08-06 04:16:54,143][52660] DAMAGECOUNT value on done: 496560.0 [2024-08-06 04:16:54,143][52660] Sum rewards: 63.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.388', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.056', 'AMMO4': '0.152', 'AMMO3': '0.188', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.032', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:54,707][52664] DAMAGECOUNT value on done: 526567.0 [2024-08-06 04:16:54,709][52664] Sum rewards: 77.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.108', 'AMMO5': '0.021', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.188', 'AMMO3': '0.190', 'weapon2': '0.262', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '63.000'} [2024-08-06 04:16:54,859][52659] DAMAGECOUNT value on done: 506436.0 [2024-08-06 04:16:54,859][52659] Sum rewards: 82.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.126', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '67.000'} [2024-08-06 04:16:55,324][52794] DAMAGECOUNT value on done: 505189.0 [2024-08-06 04:16:55,325][52794] Sum rewards: 76.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.641', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.130', 'weapon4': '0.148', 'AMMO4': '0.162', 'AMMO3': '0.198', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '61.000'} [2024-08-06 04:16:55,330][52650] Updated weights for policy 0, policy_version 52251 (0.0013) [2024-08-06 04:16:55,937][52665] DAMAGECOUNT value on done: 501051.0 [2024-08-06 04:16:55,940][52665] Sum rewards: 68.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.156', 'AMMO3': '0.196', 'weapon2': '0.236', 'AMMO4': '0.245', 'weapon5': '0.262', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.096', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '57.000'} [2024-08-06 04:16:56,651][52647] DAMAGECOUNT value on done: 518512.0 [2024-08-06 04:16:56,655][52647] Sum rewards: 62.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.758', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.220', 'AMMO3': '0.240', 'weapon4': '0.240', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '52.000'} [2024-08-06 04:16:56,843][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:16:57,267][52660] DAMAGECOUNT value on done: 505401.0 [2024-08-06 04:16:57,267][52660] Sum rewards: 64.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.015', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.068', 'weapon5': '0.128', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.634', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '54.000'} [2024-08-06 04:16:57,622][52664] DAMAGECOUNT value on done: 517697.0 [2024-08-06 04:16:57,623][52664] Sum rewards: 77.692, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.129', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '63.000'} [2024-08-06 04:16:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 428081152. Throughput: 0: 4367.8. Samples: 107027950. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 04:16:57,794][52567] Avg episode reward: [(0, '73.188')] [2024-08-06 04:16:57,966][52659] DAMAGECOUNT value on done: 502516.0 [2024-08-06 04:16:57,969][52659] Sum rewards: 77.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.120', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.146', 'AMMO4': '0.206', 'AMMO3': '0.214', 'weapon2': '0.344', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '65.000'} [2024-08-06 04:16:58,109][52794] DAMAGECOUNT value on done: 506820.0 [2024-08-06 04:16:58,117][52794] Sum rewards: 65.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.213', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.152', 'weapon5': '0.196', 'weapon2': '0.218', 'AMMO3': '0.233', 'AMMO4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.140', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '57.000'} [2024-08-06 04:16:58,703][52665] DAMAGECOUNT value on done: 496531.0 [2024-08-06 04:16:58,703][52665] Sum rewards: 63.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.866', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.214', 'AMMO3': '0.220', 'weapon2': '0.222', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.334', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '54.000'} [2024-08-06 04:16:59,003][52614] Signal inference workers to stop experience collection... (9500 times) [2024-08-06 04:16:59,011][52614] Signal inference workers to resume experience collection... (9500 times) [2024-08-06 04:16:59,083][52650] InferenceWorker_p0-w0: stopping experience collection (9500 times) [2024-08-06 04:16:59,090][52650] InferenceWorker_p0-w0: resuming experience collection (9500 times) [2024-08-06 04:16:59,917][52647] DAMAGECOUNT value on done: 527411.0 [2024-08-06 04:16:59,918][52647] Sum rewards: 86.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.210', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '4.380', 'DAMAGECOUNT': '21.996', 'FRAGCOUNT': '69.000'} [2024-08-06 04:17:00,123][52650] Updated weights for policy 0, policy_version 52261 (0.0023) [2024-08-06 04:17:00,199][52660] DAMAGECOUNT value on done: 498121.0 [2024-08-06 04:17:00,200][52668] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:17:00,201][52660] Sum rewards: 71.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.665', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:00,367][52794] DAMAGECOUNT value on done: 507066.0 [2024-08-06 04:17:00,367][52794] Sum rewards: 82.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.418', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.103', 'weapon4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.262', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '68.000'} [2024-08-06 04:17:00,370][52659] DAMAGECOUNT value on done: 505716.0 [2024-08-06 04:17:00,373][52659] Sum rewards: 79.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.724', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.130', 'weapon5': '0.180', 'AMMO4': '0.190', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '67.000'} [2024-08-06 04:17:00,890][52664] DAMAGECOUNT value on done: 527330.0 [2024-08-06 04:17:00,892][52664] Sum rewards: 69.900, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'weapon4': '0.096', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.366', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:01,592][52665] DAMAGECOUNT value on done: 495389.0 [2024-08-06 04:17:01,593][52665] Sum rewards: 82.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon4': '0.106', 'weapon5': '0.194', 'AMMO3': '0.254', 'AMMO4': '0.281', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '70.000'} [2024-08-06 04:17:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 428171264. Throughput: 0: 4366.7. Samples: 107041160. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 04:17:02,794][52567] Avg episode reward: [(0, '73.705')] [2024-08-06 04:17:02,795][52614] Saving new best policy, reward=73.705! [2024-08-06 04:17:02,871][52660] DAMAGECOUNT value on done: 500015.0 [2024-08-06 04:17:02,871][52660] Sum rewards: 67.915, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.342', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.188', 'weapon4': '0.224', 'AMMO3': '0.267', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2024-08-06 04:17:03,029][52647] DAMAGECOUNT value on done: 522233.0 [2024-08-06 04:17:03,030][52647] Sum rewards: 58.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.178', 'AMMO3': '0.228', 'AMMO4': '0.259', 'weapon5': '0.334', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.806', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '49.000'} [2024-08-06 04:17:03,466][52794] DAMAGECOUNT value on done: 500357.0 [2024-08-06 04:17:03,467][52794] Sum rewards: 85.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.177', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '68.000'} [2024-08-06 04:17:03,468][52659] DAMAGECOUNT value on done: 502516.0 [2024-08-06 04:17:03,471][52659] Sum rewards: 74.625, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.135', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.154', 'weapon5': '0.210', 'AMMO4': '0.219', 'weapon4': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.566', 'WEAPON3': '0.850', 'weapon3': '2.716', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '58.000'} [2024-08-06 04:17:04,095][52664] DAMAGECOUNT value on done: 524331.0 [2024-08-06 04:17:04,095][52664] Sum rewards: 75.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.098', 'AMMO3': '0.205', 'weapon5': '0.242', 'AMMO4': '0.312', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:04,411][52665] DAMAGECOUNT value on done: 495160.0 [2024-08-06 04:17:04,411][52665] Sum rewards: 73.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.840', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.135', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.282', 'weapon2': '0.502', 'WEAPON3': '0.950', 'weapon3': '2.976', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '56.000'} [2024-08-06 04:17:04,667][52650] Updated weights for policy 0, policy_version 52271 (0.0012) [2024-08-06 04:17:05,497][52795] DAMAGECOUNT value on done: 466839.0 [2024-08-06 04:17:05,498][52795] Sum rewards: 70.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.144', 'AMMO3': '0.166', 'weapon5': '0.176', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.236', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '56.000'} [2024-08-06 04:17:05,675][52660] DAMAGECOUNT value on done: 491887.0 [2024-08-06 04:17:05,676][52660] Sum rewards: 54.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.696', 'AMMO5': '0.017', 'AMMO2': '0.068', 'AMMO3': '0.212', 'weapon4': '0.222', 'weapon5': '0.238', 'weapon2': '0.326', 'AMMO4': '0.340', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.946', 'DAMAGECOUNT': '13.695', 'FRAGCOUNT': '47.000'} [2024-08-06 04:17:06,241][52647] DAMAGECOUNT value on done: 521807.0 [2024-08-06 04:17:06,241][52647] Sum rewards: 66.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.144', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.396', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.058', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '56.000'} [2024-08-06 04:17:06,460][52794] DAMAGECOUNT value on done: 500882.0 [2024-08-06 04:17:06,460][52794] Sum rewards: 73.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.055', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.058', 'weapon4': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.950', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:06,740][52659] DAMAGECOUNT value on done: 500343.0 [2024-08-06 04:17:06,740][52659] Sum rewards: 65.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.160', 'AMMO3': '0.199', 'weapon5': '0.206', 'AMMO4': '0.206', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.082', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:06,820][52665] DAMAGECOUNT value on done: 491323.0 [2024-08-06 04:17:06,820][52665] Sum rewards: 58.873, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.122', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.424', 'weapon4': '0.530', 'WEAPON3': '0.900', 'weapon3': '2.518', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '46.000'} [2024-08-06 04:17:07,282][52664] DAMAGECOUNT value on done: 531932.0 [2024-08-06 04:17:07,282][52664] Sum rewards: 67.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.050', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.162', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.470', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '57.000'} [2024-08-06 04:17:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 428253184. Throughput: 0: 4372.7. Samples: 107067410. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:17:07,794][52567] Avg episode reward: [(0, '73.105')] [2024-08-06 04:17:08,008][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:17:08,622][52795] DAMAGECOUNT value on done: 455540.0 [2024-08-06 04:17:08,622][52795] Sum rewards: 62.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.445', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.164', 'AMMO3': '0.189', 'AMMO4': '0.208', 'weapon4': '0.218', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:09,257][52794] DAMAGECOUNT value on done: 501242.0 [2024-08-06 04:17:09,259][52794] Sum rewards: 73.122, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.076', 'HEALTH': '0.095', 'AMMO3': '0.141', 'AMMO4': '0.172', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '0.750', 'weapon3': '2.802', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '58.000'} [2024-08-06 04:17:09,596][52650] Updated weights for policy 0, policy_version 52281 (0.0010) [2024-08-06 04:17:09,640][52659] DAMAGECOUNT value on done: 503073.0 [2024-08-06 04:17:09,641][52659] Sum rewards: 62.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.254', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.142', 'AMMO4': '0.160', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.820', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '2.736', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '53.000'} [2024-08-06 04:17:09,847][52665] DAMAGECOUNT value on done: 495499.0 [2024-08-06 04:17:09,847][52665] Sum rewards: 73.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.288', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.090', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.276', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.252', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:10,233][52664] DAMAGECOUNT value on done: 526801.0 [2024-08-06 04:17:10,236][52664] Sum rewards: 68.038, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.106', 'AMMO4': '0.203', 'AMMO3': '0.222', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.500'} [2024-08-06 04:17:11,807][52795] DAMAGECOUNT value on done: 456025.0 [2024-08-06 04:17:11,808][52795] Sum rewards: 66.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.260', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.120', 'weapon4': '0.130', 'AMMO3': '0.166', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '0.950', 'HITCOUNT': '2.910', 'weapon3': '3.250', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:11,810][52794] DAMAGECOUNT value on done: 508710.0 [2024-08-06 04:17:11,814][52794] Sum rewards: 57.647, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.884', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.098', 'weapon5': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.258', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.062', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '52.000'} [2024-08-06 04:17:12,672][52659] DAMAGECOUNT value on done: 501911.0 [2024-08-06 04:17:12,672][52659] Sum rewards: 85.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.085', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.194', 'AMMO3': '0.208', 'weapon4': '0.214', 'AMMO4': '0.227', 'weapon2': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '71.000'} [2024-08-06 04:17:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 428335104. Throughput: 0: 4370.0. Samples: 107093570. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:17:12,794][52567] Avg episode reward: [(0, '72.546')] [2024-08-06 04:17:12,924][52664] DAMAGECOUNT value on done: 526710.0 [2024-08-06 04:17:12,924][52664] Sum rewards: 76.988, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.423', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon4': '0.030', 'AMMO4': '0.055', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 04:17:12,930][52665] DAMAGECOUNT value on done: 491997.0 [2024-08-06 04:17:12,932][52665] Sum rewards: 56.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.655', 'AMMO5': '0.019', 'AMMO2': '0.071', 'weapon2': '0.222', 'AMMO3': '0.273', 'AMMO4': '0.354', 'weapon5': '0.362', 'weapon4': '0.462', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.564', 'HITCOUNT': '2.650', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '48.000'} [2024-08-06 04:17:14,103][52650] Updated weights for policy 0, policy_version 52291 (0.0012) [2024-08-06 04:17:14,999][52795] DAMAGECOUNT value on done: 463515.0 [2024-08-06 04:17:14,999][52795] Sum rewards: 62.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.734', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.084', 'AMMO4': '0.161', 'weapon5': '0.224', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '53.000'} [2024-08-06 04:17:15,066][52794] DAMAGECOUNT value on done: 496595.0 [2024-08-06 04:17:15,068][52794] Sum rewards: 66.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.028', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.219', 'weapon2': '0.466', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.364', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '56.000'} [2024-08-06 04:17:15,580][52665] DAMAGECOUNT value on done: 495127.0 [2024-08-06 04:17:15,582][52665] Sum rewards: 77.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'weapon2': '0.576', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 04:17:15,854][52659] DAMAGECOUNT value on done: 502265.0 [2024-08-06 04:17:15,857][52659] Sum rewards: 69.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.145', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.070', 'AMMO4': '0.165', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '58.000'} [2024-08-06 04:17:15,987][52664] DAMAGECOUNT value on done: 521249.0 [2024-08-06 04:17:15,989][52664] Sum rewards: 80.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.132', 'AMMO4': '0.173', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 04:17:17,381][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:17:17,558][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:17:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 428425216. Throughput: 0: 4373.6. Samples: 107106510. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:17:17,794][52567] Avg episode reward: [(0, '72.341')] [2024-08-06 04:17:18,156][52795] DAMAGECOUNT value on done: 458744.0 [2024-08-06 04:17:18,157][52795] Sum rewards: 60.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.510', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon5': '0.150', 'AMMO3': '0.218', 'weapon4': '0.228', 'weapon2': '0.306', 'AMMO4': '0.322', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '51.000'} [2024-08-06 04:17:18,493][52794] DAMAGECOUNT value on done: 507284.0 [2024-08-06 04:17:18,493][52794] Sum rewards: 70.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.726', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon4': '0.130', 'AMMO3': '0.181', 'weapon5': '0.244', 'AMMO4': '0.329', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '57.000'} [2024-08-06 04:17:18,507][52664] DAMAGECOUNT value on done: 518971.0 [2024-08-06 04:17:18,507][52664] Sum rewards: 67.828, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.136', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.285', 'weapon2': '0.524', 'WEAPON3': '0.950', 'weapon3': '3.186', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:18,582][52665] DAMAGECOUNT value on done: 496762.0 [2024-08-06 04:17:18,583][52665] Sum rewards: 62.822, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.467', 'AMMO5': '0.015', 'AMMO2': '0.064', 'AMMO3': '0.128', 'weapon5': '0.180', 'AMMO4': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.572', 'weapon2': '0.610', 'WEAPON3': '0.700', 'weapon3': '2.438', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '48.000'} [2024-08-06 04:17:18,676][52659] DAMAGECOUNT value on done: 508949.0 [2024-08-06 04:17:18,677][52659] Sum rewards: 75.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.125', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:18,687][52650] Updated weights for policy 0, policy_version 52301 (0.0026) [2024-08-06 04:17:20,884][52664] DAMAGECOUNT value on done: 523438.0 [2024-08-06 04:17:20,884][52664] Sum rewards: 72.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.675', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.086', 'weapon2': '0.144', 'AMMO4': '0.149', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.568', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:21,075][52794] DAMAGECOUNT value on done: 504575.0 [2024-08-06 04:17:21,076][52794] Sum rewards: 71.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.114', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.316', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '59.000'} [2024-08-06 04:17:21,153][52659] DAMAGECOUNT value on done: 512929.0 [2024-08-06 04:17:21,153][52659] Sum rewards: 69.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.126', 'weapon5': '0.134', 'AMMO4': '0.161', 'AMMO3': '0.188', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.304', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '57.000'} [2024-08-06 04:17:21,329][52795] DAMAGECOUNT value on done: 468510.0 [2024-08-06 04:17:21,329][52795] Sum rewards: 68.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.765', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.108', 'weapon4': '0.210', 'AMMO3': '0.227', 'AMMO4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.738', 'WEAPON3': '1.350', 'weapon3': '2.664', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2024-08-06 04:17:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 428515328. Throughput: 0: 4368.7. Samples: 107132670. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:17:22,794][52567] Avg episode reward: [(0, '71.949')] [2024-08-06 04:17:23,099][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:17:23,492][52650] Updated weights for policy 0, policy_version 52311 (0.0012) [2024-08-06 04:17:23,614][52794] DAMAGECOUNT value on done: 498706.0 [2024-08-06 04:17:23,617][52794] Sum rewards: 60.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.052', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.152', 'AMMO3': '0.165', 'weapon4': '0.238', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '47.000'} [2024-08-06 04:17:23,777][52659] DAMAGECOUNT value on done: 500246.0 [2024-08-06 04:17:23,778][52659] Sum rewards: 67.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.044', 'weapon5': '0.080', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '57.000'} [2024-08-06 04:17:24,210][52664] DAMAGECOUNT value on done: 519919.0 [2024-08-06 04:17:24,210][52664] Sum rewards: 68.313, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.084', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'HEALTH': '0.394', 'weapon2': '0.416', 'WEAPON3': '0.950', 'weapon3': '3.184', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '55.000'} [2024-08-06 04:17:24,531][52795] DAMAGECOUNT value on done: 472464.0 [2024-08-06 04:17:24,531][52795] Sum rewards: 83.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.105', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.088', 'weapon2': '0.192', 'AMMO4': '0.199', 'weapon5': '0.210', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '71.000'} [2024-08-06 04:17:26,338][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:17:26,525][52794] DAMAGECOUNT value on done: 508613.0 [2024-08-06 04:17:26,527][52794] Sum rewards: 75.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.460', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 04:17:26,628][52659] DAMAGECOUNT value on done: 506323.0 [2024-08-06 04:17:26,628][52659] Sum rewards: 61.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'AMMO5': '0.004', 'ARMOR': '0.004', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.226', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.588', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '52.000'} [2024-08-06 04:17:27,299][52664] DAMAGECOUNT value on done: 518762.0 [2024-08-06 04:17:27,299][52664] Sum rewards: 71.433, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.696', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.190', 'weapon4': '0.210', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '59.000'} [2024-08-06 04:17:27,562][52668] Large shaping reward 2.525 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47400000000000003, 158.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:17:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 428605440. Throughput: 0: 4367.1. Samples: 107159040. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:17:27,794][52567] Avg episode reward: [(0, '71.667')] [2024-08-06 04:17:27,822][52795] DAMAGECOUNT value on done: 469466.0 [2024-08-06 04:17:27,823][52795] Sum rewards: 80.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.025', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.112', 'weapon4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '3.010', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '67.000'} [2024-08-06 04:17:28,011][52650] Updated weights for policy 0, policy_version 52321 (0.0044) [2024-08-06 04:17:29,300][52794] DAMAGECOUNT value on done: 496444.0 [2024-08-06 04:17:29,303][52794] Sum rewards: 60.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.250', 'weapon4': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '50.000'} [2024-08-06 04:17:29,390][52659] DAMAGECOUNT value on done: 497012.0 [2024-08-06 04:17:29,391][52659] Sum rewards: 77.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.396', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon4': '0.098', 'AMMO3': '0.176', 'weapon5': '0.192', 'AMMO4': '0.209', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '63.000'} [2024-08-06 04:17:30,937][52795] DAMAGECOUNT value on done: 457915.0 [2024-08-06 04:17:30,937][52795] Sum rewards: 78.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.097', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.153', 'weapon2': '0.210', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '64.000'} [2024-08-06 04:17:32,059][52794] DAMAGECOUNT value on done: 516688.0 [2024-08-06 04:17:32,059][52794] Sum rewards: 73.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.415', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.084', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '59.500'} [2024-08-06 04:17:32,062][52649] DAMAGECOUNT value on done: 488133.0 [2024-08-06 04:17:32,062][52649] Sum rewards: 69.093, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.513', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.311', 'WEAPON3': '1.900', 'weapon3': '3.274', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:32,109][52659] DAMAGECOUNT value on done: 503628.0 [2024-08-06 04:17:32,110][52659] Sum rewards: 66.412, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.144', 'AMMO3': '0.164', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.240', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:32,795][52567] Fps is (10 sec: 17202.2, 60 sec: 17339.6, 300 sec: 17494.7). Total num frames: 428687360. Throughput: 0: 4368.6. Samples: 107171970. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:17:32,795][52567] Avg episode reward: [(0, '71.587')] [2024-08-06 04:17:33,162][52650] Updated weights for policy 0, policy_version 52331 (0.0015) [2024-08-06 04:17:34,096][52795] DAMAGECOUNT value on done: 470410.0 [2024-08-06 04:17:34,098][52795] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon5': '0.176', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '58.000'} [2024-08-06 04:17:34,583][52659] DAMAGECOUNT value on done: 513688.0 [2024-08-06 04:17:34,583][52659] Sum rewards: 80.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.122', 'AMMO4': '0.169', 'weapon5': '0.198', 'AMMO3': '0.205', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '66.000'} [2024-08-06 04:17:34,733][52649] DAMAGECOUNT value on done: 479836.0 [2024-08-06 04:17:34,734][52649] Sum rewards: 65.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.565', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.178', 'AMMO3': '0.194', 'weapon4': '0.200', 'AMMO4': '0.227', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:35,452][52663] DAMAGECOUNT value on done: 510404.0 [2024-08-06 04:17:35,453][52663] Sum rewards: 69.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.207', 'weapon2': '0.230', 'weapon5': '0.254', 'AMMO4': '0.320', 'weapon4': '0.468', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '58.000'} [2024-08-06 04:17:35,684][52794] DAMAGECOUNT value on done: 496447.0 [2024-08-06 04:17:35,685][52794] Sum rewards: 60.921, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.665', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.158', 'weapon5': '0.176', 'AMMO4': '0.263', 'AMMO3': '0.273', 'weapon2': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '53.000'} [2024-08-06 04:17:37,094][52650] Updated weights for policy 0, policy_version 52341 (0.0026) [2024-08-06 04:17:37,303][52659] DAMAGECOUNT value on done: 507943.0 [2024-08-06 04:17:37,303][52659] Sum rewards: 31.131, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.650', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.098', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.124', 'WEAPON7': '0.200', 'weapon2': '0.228', 'AMMO4': '0.298', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.700', 'weapon3': '1.306', 'HITCOUNT': '1.760', 'weapon4': '1.896', 'DAMAGECOUNT': '8.754', 'FRAGCOUNT': '26.000'} [2024-08-06 04:17:37,389][52795] DAMAGECOUNT value on done: 463244.0 [2024-08-06 04:17:37,391][52795] Sum rewards: 75.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.382', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.126', 'weapon4': '0.130', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '62.000'} [2024-08-06 04:17:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 428777472. Throughput: 0: 4371.3. Samples: 107198180. Policy #0 lag: (min: 1.0, avg: 4.7, max: 8.0) [2024-08-06 04:17:37,794][52567] Avg episode reward: [(0, '70.996')] [2024-08-06 04:17:37,925][52649] DAMAGECOUNT value on done: 495417.0 [2024-08-06 04:17:37,926][52649] Sum rewards: 64.562, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.006', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.112', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.316', 'weapon2': '0.720', 'WEAPON3': '1.150', 'weapon3': '2.704', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '53.000'} [2024-08-06 04:17:38,373][52663] DAMAGECOUNT value on done: 503572.0 [2024-08-06 04:17:38,375][52663] Sum rewards: 67.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.180', 'AMMO3': '0.244', 'AMMO4': '0.281', 'weapon4': '0.308', 'weapon2': '0.466', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.790', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '57.000'} [2024-08-06 04:17:38,839][52794] DAMAGECOUNT value on done: 513561.0 [2024-08-06 04:17:38,839][52794] Sum rewards: 74.894, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.799', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.165', 'weapon5': '0.166', 'AMMO3': '0.285', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.134', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '66.000'} [2024-08-06 04:17:39,914][52659] DAMAGECOUNT value on done: 508514.0 [2024-08-06 04:17:39,916][52659] Sum rewards: 75.999, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.702', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon7': '0.028', 'AMMO4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.165', 'weapon5': '0.166', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:40,564][52795] DAMAGECOUNT value on done: 461996.0 [2024-08-06 04:17:40,568][52795] Sum rewards: 72.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.648', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon2': '0.168', 'AMMO3': '0.228', 'weapon5': '0.232', 'weapon4': '0.278', 'AMMO4': '0.291', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:41,193][52649] DAMAGECOUNT value on done: 489235.0 [2024-08-06 04:17:41,193][52649] Sum rewards: 81.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.398', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO3': '0.182', 'AMMO4': '0.201', 'weapon4': '0.236', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '65.000'} [2024-08-06 04:17:41,274][52820] DAMAGECOUNT value on done: 465207.0 [2024-08-06 04:17:41,278][52820] Sum rewards: 77.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.975', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.098', 'weapon2': '0.164', 'AMMO3': '0.194', 'AMMO4': '0.220', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '62.500'} [2024-08-06 04:17:41,350][52794] DAMAGECOUNT value on done: 503433.0 [2024-08-06 04:17:41,352][52794] Sum rewards: 73.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.665', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.128', 'weapon4': '0.132', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:41,578][52663] DAMAGECOUNT value on done: 497859.0 [2024-08-06 04:17:41,578][52663] Sum rewards: 65.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.172', 'AMMO3': '0.201', 'weapon5': '0.222', 'AMMO4': '0.315', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.770', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:42,277][52650] Updated weights for policy 0, policy_version 52351 (0.0029) [2024-08-06 04:17:42,512][52659] DAMAGECOUNT value on done: 504100.0 [2024-08-06 04:17:42,514][52659] Sum rewards: 70.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.191', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:42,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 428867584. Throughput: 0: 4366.2. Samples: 107224430. Policy #0 lag: (min: 1.0, avg: 4.7, max: 8.0) [2024-08-06 04:17:42,795][52567] Avg episode reward: [(0, '70.742')] [2024-08-06 04:17:43,602][52666] DAMAGECOUNT value on done: 502434.0 [2024-08-06 04:17:43,604][52666] Sum rewards: 85.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.084', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.396', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '72.000'} [2024-08-06 04:17:43,651][52795] DAMAGECOUNT value on done: 458601.0 [2024-08-06 04:17:43,653][52795] Sum rewards: 69.807, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.099', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '56.000'} [2024-08-06 04:17:43,906][52794] DAMAGECOUNT value on done: 510747.0 [2024-08-06 04:17:43,906][52794] Sum rewards: 81.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.400', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.223', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.650', 'weapon3': '2.844', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '69.000'} [2024-08-06 04:17:44,323][52649] DAMAGECOUNT value on done: 479929.0 [2024-08-06 04:17:44,325][52649] Sum rewards: 69.404, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.356', 'WEAPON3': '1.700', 'weapon3': '3.274', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:44,402][52820] DAMAGECOUNT value on done: 465555.0 [2024-08-06 04:17:44,403][52820] Sum rewards: 75.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.788', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.165', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '62.000'} [2024-08-06 04:17:44,589][52663] DAMAGECOUNT value on done: 501772.0 [2024-08-06 04:17:44,591][52663] Sum rewards: 74.753, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.743', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.170', 'AMMO4': '0.178', 'weapon5': '0.188', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '59.000'} [2024-08-06 04:17:44,825][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:17:45,449][52659] DAMAGECOUNT value on done: 507427.0 [2024-08-06 04:17:45,449][52659] Sum rewards: 80.764, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.020', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.146', 'AMMO4': '0.218', 'weapon2': '0.246', 'AMMO3': '0.307', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.252', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '72.000'} [2024-08-06 04:17:46,498][52794] DAMAGECOUNT value on done: 512979.0 [2024-08-06 04:17:46,499][52794] Sum rewards: 80.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.203', 'weapon5': '0.206', 'AMMO4': '0.246', 'weapon4': '0.310', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '66.000'} [2024-08-06 04:17:46,770][52666] DAMAGECOUNT value on done: 504565.0 [2024-08-06 04:17:46,772][52666] Sum rewards: 65.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.875', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.110', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.306', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:46,782][52650] Updated weights for policy 0, policy_version 52361 (0.0012) [2024-08-06 04:17:46,833][52795] DAMAGECOUNT value on done: 467316.0 [2024-08-06 04:17:46,833][52795] Sum rewards: 70.801, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.877', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.162', 'weapon5': '0.178', 'AMMO4': '0.216', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:46,842][52670] DAMAGECOUNT value on done: 494445.0 [2024-08-06 04:17:46,842][52670] Sum rewards: 65.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.635', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.281', 'weapon5': '0.316', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '55.000'} [2024-08-06 04:17:47,447][52649] DAMAGECOUNT value on done: 492857.0 [2024-08-06 04:17:47,449][52649] Sum rewards: 72.502, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.242', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.134', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.764', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2024-08-06 04:17:47,539][52820] DAMAGECOUNT value on done: 468132.0 [2024-08-06 04:17:47,547][52820] Sum rewards: 73.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.269', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO3': '0.179', 'AMMO4': '0.199', 'weapon5': '0.226', 'weapon2': '0.372', 'weapon4': '0.416', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '59.000'} [2024-08-06 04:17:47,584][52663] DAMAGECOUNT value on done: 502877.0 [2024-08-06 04:17:47,584][52663] Sum rewards: 68.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.202', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '57.000'} [2024-08-06 04:17:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 428949504. Throughput: 0: 4365.8. Samples: 107237620. Policy #0 lag: (min: 1.0, avg: 4.7, max: 8.0) [2024-08-06 04:17:47,794][52567] Avg episode reward: [(0, '70.754')] [2024-08-06 04:17:48,479][52659] DAMAGECOUNT value on done: 505497.0 [2024-08-06 04:17:48,481][52659] Sum rewards: 76.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.943', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:48,946][52794] DAMAGECOUNT value on done: 501431.0 [2024-08-06 04:17:48,949][52794] Sum rewards: 62.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.070', 'AMMO4': '0.153', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.270', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '53.000'} [2024-08-06 04:17:49,785][52666] DAMAGECOUNT value on done: 506911.0 [2024-08-06 04:17:49,788][52666] Sum rewards: 74.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.682', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.190', 'weapon2': '0.322', 'weapon4': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:49,878][52670] DAMAGECOUNT value on done: 505421.0 [2024-08-06 04:17:49,878][52670] Sum rewards: 60.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.228', 'weapon2': '0.724', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '52.000'} [2024-08-06 04:17:49,949][52795] DAMAGECOUNT value on done: 458629.0 [2024-08-06 04:17:49,949][52795] Sum rewards: 71.523, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.370', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon5': '0.184', 'AMMO3': '0.242', 'weapon2': '0.288', 'weapon4': '0.324', 'AMMO4': '0.325', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:50,298][52649] DAMAGECOUNT value on done: 488036.0 [2024-08-06 04:17:50,299][52649] Sum rewards: 66.681, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.183', 'weapon2': '0.458', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.160', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:50,622][52820] DAMAGECOUNT value on done: 460102.0 [2024-08-06 04:17:50,624][52820] Sum rewards: 65.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.192', 'AMMO4': '0.196', 'weapon5': '0.236', 'weapon4': '0.276', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.670', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '54.000'} [2024-08-06 04:17:50,756][52663] DAMAGECOUNT value on done: 508749.0 [2024-08-06 04:17:50,756][52663] Sum rewards: 79.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.098', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.105', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '65.000'} [2024-08-06 04:17:51,755][52650] Updated weights for policy 0, policy_version 52371 (0.0012) [2024-08-06 04:17:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 429039616. Throughput: 0: 4366.9. Samples: 107263920. Policy #0 lag: (min: 1.0, avg: 4.7, max: 8.0) [2024-08-06 04:17:52,794][52567] Avg episode reward: [(0, '70.683')] [2024-08-06 04:17:52,877][52666] DAMAGECOUNT value on done: 505107.0 [2024-08-06 04:17:52,880][52666] Sum rewards: 66.830, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.786', 'AMMO5': '0.024', 'AMMO2': '0.050', 'weapon5': '0.122', 'weapon4': '0.140', 'AMMO4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.076', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:52,968][52670] DAMAGECOUNT value on done: 497070.0 [2024-08-06 04:17:52,969][52670] Sum rewards: 52.149, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.544', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.118', 'weapon5': '0.126', 'AMMO4': '0.165', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.100', 'HITCOUNT': '2.670', 'weapon3': '3.136', 'DAMAGECOUNT': '13.527', 'FRAGCOUNT': '42.000'} [2024-08-06 04:17:53,089][52795] DAMAGECOUNT value on done: 475765.0 [2024-08-06 04:17:53,090][52795] Sum rewards: 72.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.805', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.096', 'AMMO4': '0.195', 'weapon5': '0.202', 'AMMO3': '0.228', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '62.000'} [2024-08-06 04:17:53,354][52649] DAMAGECOUNT value on done: 493214.0 [2024-08-06 04:17:53,354][52649] Sum rewards: 68.444, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.790', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.140', 'weapon5': '0.158', 'weapon2': '0.192', 'AMMO3': '0.243', 'AMMO4': '0.273', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:53,750][52820] DAMAGECOUNT value on done: 468942.0 [2024-08-06 04:17:53,751][52820] Sum rewards: 84.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.961', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.192', 'weapon2': '0.202', 'AMMO3': '0.241', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '70.000'} [2024-08-06 04:17:53,797][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:17:53,949][52663] DAMAGECOUNT value on done: 504328.0 [2024-08-06 04:17:53,951][52663] Sum rewards: 70.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.024', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.084', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:55,274][52666] DAMAGECOUNT value on done: 503110.0 [2024-08-06 04:17:55,275][52666] Sum rewards: 66.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.702', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.209', 'weapon4': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.244', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '55.000'} [2024-08-06 04:17:55,377][52670] DAMAGECOUNT value on done: 496554.0 [2024-08-06 04:17:55,378][52670] Sum rewards: 79.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.190', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO3': '0.152', 'weapon4': '0.182', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.162', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '63.000'} [2024-08-06 04:17:56,025][52649] DAMAGECOUNT value on done: 493409.0 [2024-08-06 04:17:56,026][52649] Sum rewards: 76.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.179', 'AMMO3': '0.187', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 04:17:56,158][52795] DAMAGECOUNT value on done: 467518.0 [2024-08-06 04:17:56,161][52795] Sum rewards: 76.684, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.240', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.102', 'weapon5': '0.144', 'AMMO3': '0.206', 'AMMO4': '0.288', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '61.500'} [2024-08-06 04:17:56,620][52650] Updated weights for policy 0, policy_version 52381 (0.0012) [2024-08-06 04:17:56,824][52820] DAMAGECOUNT value on done: 462242.0 [2024-08-06 04:17:56,825][52820] Sum rewards: 74.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.298', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '61.000'} [2024-08-06 04:17:56,878][52663] DAMAGECOUNT value on done: 498985.0 [2024-08-06 04:17:56,883][52663] Sum rewards: 67.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.182', 'weapon5': '0.220', 'AMMO4': '0.237', 'AMMO3': '0.241', 'weapon2': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '56.000'} [2024-08-06 04:17:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 429129728. Throughput: 0: 4366.9. Samples: 107290080. Policy #0 lag: (min: 1.0, avg: 4.7, max: 8.0) [2024-08-06 04:17:57,794][52567] Avg episode reward: [(0, '70.426')] [2024-08-06 04:17:58,053][52666] DAMAGECOUNT value on done: 497455.0 [2024-08-06 04:17:58,053][52666] Sum rewards: 75.866, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.497', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.114', 'AMMO4': '0.157', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '62.000'} [2024-08-06 04:17:58,179][52670] DAMAGECOUNT value on done: 507944.0 [2024-08-06 04:17:58,179][52670] Sum rewards: 75.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.184', 'AMMO3': '0.201', 'weapon4': '0.256', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '63.000'} [2024-08-06 04:17:58,823][52649] DAMAGECOUNT value on done: 486674.0 [2024-08-06 04:17:58,824][52649] Sum rewards: 60.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.200', 'weapon5': '0.214', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '3.074', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '49.000'} [2024-08-06 04:17:59,352][52795] DAMAGECOUNT value on done: 456784.0 [2024-08-06 04:17:59,352][52795] Sum rewards: 70.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.371', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.074', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '60.000'} [2024-08-06 04:17:59,954][52820] DAMAGECOUNT value on done: 464572.0 [2024-08-06 04:17:59,957][52820] Sum rewards: 69.830, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.210', 'HEALTH': '0.274', 'WEAPON3': '1.050', 'HITCOUNT': '3.320', 'weapon3': '3.528', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '55.500'} [2024-08-06 04:18:00,106][52663] DAMAGECOUNT value on done: 498705.0 [2024-08-06 04:18:00,108][52663] Sum rewards: 81.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.096', 'AMMO3': '0.226', 'weapon5': '0.284', 'weapon2': '0.286', 'AMMO4': '0.294', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.996', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '67.000'} [2024-08-06 04:18:00,723][52666] DAMAGECOUNT value on done: 500508.0 [2024-08-06 04:18:00,723][52666] Sum rewards: 62.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.357', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.152', 'weapon7': '0.156', 'WEAPON7': '0.200', 'weapon5': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.232', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '54.000'} [2024-08-06 04:18:00,892][52670] DAMAGECOUNT value on done: 502253.0 [2024-08-06 04:18:00,892][52670] Sum rewards: 77.986, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon2': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.178', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.592', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '62.000'} [2024-08-06 04:18:01,156][52649] DAMAGECOUNT value on done: 494856.0 [2024-08-06 04:18:01,157][52649] Sum rewards: 70.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.226', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon5': '0.180', 'AMMO3': '0.231', 'weapon4': '0.264', 'AMMO4': '0.289', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '59.000'} [2024-08-06 04:18:01,174][52650] Updated weights for policy 0, policy_version 52391 (0.0011) [2024-08-06 04:18:02,586][52795] DAMAGECOUNT value on done: 467411.0 [2024-08-06 04:18:02,586][52795] Sum rewards: 72.524, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.682', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.182', 'weapon4': '0.220', 'AMMO3': '0.276', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.922', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2024-08-06 04:18:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 429211648. Throughput: 0: 4374.2. Samples: 107303350. Policy #0 lag: (min: 1.0, avg: 4.7, max: 8.0) [2024-08-06 04:18:02,795][52567] Avg episode reward: [(0, '70.615')] [2024-08-06 04:18:03,140][52820] DAMAGECOUNT value on done: 468112.0 [2024-08-06 04:18:03,141][52820] Sum rewards: 67.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.655', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.153', 'AMMO4': '0.188', 'weapon5': '0.188', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.586', 'weapon4': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.354', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '54.000'} [2024-08-06 04:18:03,196][52663] DAMAGECOUNT value on done: 504838.0 [2024-08-06 04:18:03,196][52663] Sum rewards: 73.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.098', 'AMMO4': '0.240', 'AMMO3': '0.259', 'weapon5': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.930', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '62.000'} [2024-08-06 04:18:03,356][52667] DAMAGECOUNT value on done: 503564.0 [2024-08-06 04:18:03,357][52667] Sum rewards: 80.068, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.775', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.340', 'WEAPON3': '1.700', 'weapon3': '3.408', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '70.000'} [2024-08-06 04:18:03,539][52649] DAMAGECOUNT value on done: 499817.0 [2024-08-06 04:18:03,540][52649] Sum rewards: 61.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.144', 'AMMO4': '0.169', 'weapon5': '0.170', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.650', 'weapon3': '2.922', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '55.000'} [2024-08-06 04:18:03,599][52666] DAMAGECOUNT value on done: 500745.0 [2024-08-06 04:18:03,599][52666] Sum rewards: 71.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.175', 'weapon2': '0.216', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.646', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:03,785][52670] DAMAGECOUNT value on done: 491886.0 [2024-08-06 04:18:03,785][52670] Sum rewards: 78.670, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.264', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.024', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon2': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.464', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '68.000'} [2024-08-06 04:18:05,637][52650] Updated weights for policy 0, policy_version 52401 (0.0011) [2024-08-06 04:18:05,667][52795] DAMAGECOUNT value on done: 471023.0 [2024-08-06 04:18:05,667][52795] Sum rewards: 73.529, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.067', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.344', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '63.000'} [2024-08-06 04:18:05,824][52663] DAMAGECOUNT value on done: 513404.0 [2024-08-06 04:18:05,827][52663] Sum rewards: 73.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.832', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.108', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '61.000'} [2024-08-06 04:18:05,863][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:18:05,904][52649] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:18:06,117][52820] DAMAGECOUNT value on done: 465356.0 [2024-08-06 04:18:06,120][52820] Sum rewards: 66.849, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.254', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.142', 'AMMO4': '0.201', 'AMMO3': '0.244', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:06,285][52667] DAMAGECOUNT value on done: 513094.0 [2024-08-06 04:18:06,285][52667] Sum rewards: 73.609, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.589', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.158', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.352', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:06,372][52666] DAMAGECOUNT value on done: 499980.0 [2024-08-06 04:18:06,373][52666] Sum rewards: 82.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.662', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '69.000'} [2024-08-06 04:18:06,476][52649] DAMAGECOUNT value on done: 500532.0 [2024-08-06 04:18:06,476][52649] Sum rewards: 70.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.262', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.516', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:06,601][52670] DAMAGECOUNT value on done: 498556.0 [2024-08-06 04:18:06,603][52670] Sum rewards: 75.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.942', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.204', 'AMMO4': '0.206', 'weapon5': '0.208', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.456', 'weapon2': '0.662', 'WEAPON3': '1.250', 'weapon3': '2.424', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '61.000'} [2024-08-06 04:18:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 429301760. Throughput: 0: 4378.0. Samples: 107329680. Policy #0 lag: (min: 1.0, avg: 4.7, max: 8.0) [2024-08-06 04:18:07,794][52567] Avg episode reward: [(0, '71.316')] [2024-08-06 04:18:08,710][52663] DAMAGECOUNT value on done: 499917.0 [2024-08-06 04:18:08,714][52663] Sum rewards: 77.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.702', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.093', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '65.000'} [2024-08-06 04:18:09,157][52667] DAMAGECOUNT value on done: 502874.0 [2024-08-06 04:18:09,158][52667] Sum rewards: 74.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.060', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.202', 'AMMO4': '0.214', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.074', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '63.000'} [2024-08-06 04:18:09,194][52820] DAMAGECOUNT value on done: 473098.0 [2024-08-06 04:18:09,194][52820] Sum rewards: 61.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.094', 'AMMO4': '0.195', 'weapon5': '0.236', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.600', 'weapon3': '2.778', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 04:18:09,255][52649] DAMAGECOUNT value on done: 497901.0 [2024-08-06 04:18:09,255][52649] Sum rewards: 75.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.567', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.492', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '64.000'} [2024-08-06 04:18:09,610][52647] Large shaping reward 2.555 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.504, 168.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:18:09,777][52666] DAMAGECOUNT value on done: 494169.0 [2024-08-06 04:18:09,778][52666] Sum rewards: 70.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.602', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.108', 'AMMO4': '0.136', 'weapon5': '0.154', 'weapon2': '0.212', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:09,937][52670] DAMAGECOUNT value on done: 497882.0 [2024-08-06 04:18:09,938][52670] Sum rewards: 68.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.120', 'weapon5': '0.172', 'AMMO4': '0.183', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:10,544][52650] Updated weights for policy 0, policy_version 52411 (0.0011) [2024-08-06 04:18:11,637][52667] DAMAGECOUNT value on done: 504498.0 [2024-08-06 04:18:11,637][52667] Sum rewards: 62.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.124', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.160', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '54.000'} [2024-08-06 04:18:11,688][52663] DAMAGECOUNT value on done: 497615.0 [2024-08-06 04:18:11,689][52663] Sum rewards: 78.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.220', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.184', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '64.000'} [2024-08-06 04:18:12,060][52649] DAMAGECOUNT value on done: 486405.0 [2024-08-06 04:18:12,060][52649] Sum rewards: 71.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.217', 'weapon5': '0.238', 'weapon4': '0.362', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '59.000'} [2024-08-06 04:18:12,249][52820] DAMAGECOUNT value on done: 461754.0 [2024-08-06 04:18:12,250][52820] Sum rewards: 65.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.096', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.122', 'weapon4': '0.176', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.992', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '57.000'} [2024-08-06 04:18:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 429391872. Throughput: 0: 4374.0. Samples: 107355870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 04:18:12,802][52567] Avg episode reward: [(0, '71.295')] [2024-08-06 04:18:12,822][52666] DAMAGECOUNT value on done: 499924.0 [2024-08-06 04:18:12,822][52666] Sum rewards: 79.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.912', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.279', 'weapon2': '0.356', 'WEAPON3': '1.800', 'weapon3': '3.458', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '69.000'} [2024-08-06 04:18:13,080][52670] DAMAGECOUNT value on done: 495275.0 [2024-08-06 04:18:13,082][52670] Sum rewards: 71.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.703', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.218', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.516', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '59.000'} [2024-08-06 04:18:13,993][52663] DAMAGECOUNT value on done: 497041.0 [2024-08-06 04:18:13,997][52663] Sum rewards: 70.420, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.104', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '3.014', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '57.000'} [2024-08-06 04:18:14,817][52667] DAMAGECOUNT value on done: 510752.0 [2024-08-06 04:18:14,817][52667] Sum rewards: 67.286, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.148', 'AMMO3': '0.184', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.542', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '55.000'} [2024-08-06 04:18:14,876][52650] Updated weights for policy 0, policy_version 52421 (0.0013) [2024-08-06 04:18:15,179][52649] DAMAGECOUNT value on done: 495309.0 [2024-08-06 04:18:15,180][52649] Sum rewards: 66.289, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.038', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.295', 'WEAPON3': '1.750', 'HITCOUNT': '3.250', 'weapon3': '3.372', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:15,389][52820] DAMAGECOUNT value on done: 468414.0 [2024-08-06 04:18:15,389][52820] Sum rewards: 69.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.570', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.168', 'weapon2': '0.190', 'weapon5': '0.202', 'AMMO3': '0.235', 'AMMO4': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.182', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '59.000'} [2024-08-06 04:18:15,978][52666] DAMAGECOUNT value on done: 494460.0 [2024-08-06 04:18:15,979][52666] Sum rewards: 59.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.219', 'weapon2': '0.482', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.282', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '50.000'} [2024-08-06 04:18:16,187][52670] DAMAGECOUNT value on done: 501170.0 [2024-08-06 04:18:16,188][52670] Sum rewards: 74.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.173', 'AMMO3': '0.182', 'weapon4': '0.198', 'weapon2': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.316', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '62.000'} [2024-08-06 04:18:16,587][52663] DAMAGECOUNT value on done: 497660.0 [2024-08-06 04:18:16,587][52663] Sum rewards: 70.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.842', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.058', 'weapon5': '0.082', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.194', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 429481984. Throughput: 0: 4378.1. Samples: 107368980. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 04:18:17,802][52567] Avg episode reward: [(0, '71.334')] [2024-08-06 04:18:17,903][52667] DAMAGECOUNT value on done: 515242.0 [2024-08-06 04:18:17,903][52667] Sum rewards: 74.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.042', 'AMMO4': '0.141', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '63.000'} [2024-08-06 04:18:18,340][52649] DAMAGECOUNT value on done: 484616.0 [2024-08-06 04:18:18,340][52649] Sum rewards: 65.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.240', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO3': '0.152', 'AMMO4': '0.156', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '3.210', 'weapon3': '3.298', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '53.000'} [2024-08-06 04:18:18,561][52820] DAMAGECOUNT value on done: 473204.0 [2024-08-06 04:18:18,563][52820] Sum rewards: 75.813, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.068', 'weapon4': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.674', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:18,764][52666] DAMAGECOUNT value on done: 510137.0 [2024-08-06 04:18:18,764][52666] Sum rewards: 72.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.535', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.084', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '58.500'} [2024-08-06 04:18:18,975][52670] DAMAGECOUNT value on done: 490324.0 [2024-08-06 04:18:18,975][52670] Sum rewards: 64.555, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.384', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.184', 'AMMO4': '0.224', 'AMMO3': '0.278', 'weapon2': '0.284', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.780', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:19,142][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:18:19,327][52663] DAMAGECOUNT value on done: 508970.0 [2024-08-06 04:18:19,327][52663] Sum rewards: 73.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.179', 'weapon4': '0.196', 'weapon5': '0.226', 'AMMO4': '0.234', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:19,881][52650] Updated weights for policy 0, policy_version 52431 (0.0031) [2024-08-06 04:18:20,862][52667] DAMAGECOUNT value on done: 506877.0 [2024-08-06 04:18:20,865][52667] Sum rewards: 84.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.673', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO4': '0.196', 'AMMO3': '0.251', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '70.000'} [2024-08-06 04:18:21,448][52649] DAMAGECOUNT value on done: 498020.0 [2024-08-06 04:18:21,450][52649] Sum rewards: 78.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.030', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.126', 'weapon4': '0.184', 'AMMO3': '0.205', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '64.000'} [2024-08-06 04:18:21,667][52820] DAMAGECOUNT value on done: 467859.0 [2024-08-06 04:18:21,668][52820] Sum rewards: 65.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.998', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO4': '0.142', 'weapon5': '0.156', 'AMMO3': '0.191', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.232', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '53.000'} [2024-08-06 04:18:21,828][52666] DAMAGECOUNT value on done: 502500.0 [2024-08-06 04:18:21,830][52666] Sum rewards: 58.035, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.227', 'AMMO5': '0.032', 'AMMO2': '0.066', 'weapon4': '0.204', 'AMMO3': '0.272', 'weapon5': '0.282', 'AMMO4': '0.332', 'weapon2': '0.478', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.630', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 04:18:21,977][52670] DAMAGECOUNT value on done: 497889.0 [2024-08-06 04:18:21,980][52670] Sum rewards: 68.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.102', 'weapon4': '0.106', 'AMMO3': '0.231', 'AMMO4': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:22,253][52663] DAMAGECOUNT value on done: 498182.0 [2024-08-06 04:18:22,254][52663] Sum rewards: 71.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.588', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.104', 'weapon5': '0.128', 'AMMO4': '0.136', 'weapon2': '0.226', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.358', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 429563904. Throughput: 0: 4384.9. Samples: 107395500. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 04:18:22,794][52567] Avg episode reward: [(0, '71.314')] [2024-08-06 04:18:23,998][52667] DAMAGECOUNT value on done: 504993.0 [2024-08-06 04:18:24,000][52667] Sum rewards: 68.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.638', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon2': '0.198', 'AMMO4': '0.215', 'AMMO3': '0.228', 'weapon4': '0.236', 'weapon5': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.000'} [2024-08-06 04:18:24,146][52650] Updated weights for policy 0, policy_version 52441 (0.0021) [2024-08-06 04:18:24,576][52649] DAMAGECOUNT value on done: 497887.0 [2024-08-06 04:18:24,577][52649] Sum rewards: 67.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.072', 'AMMO4': '0.109', 'weapon5': '0.116', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '56.000'} [2024-08-06 04:18:24,577][52666] DAMAGECOUNT value on done: 498121.0 [2024-08-06 04:18:24,580][52666] Sum rewards: 66.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.815', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.046', 'AMMO4': '0.188', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.146', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '56.000'} [2024-08-06 04:18:24,774][52670] DAMAGECOUNT value on done: 506278.0 [2024-08-06 04:18:24,775][52670] Sum rewards: 63.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.175', 'AMMO4': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.152', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '51.500'} [2024-08-06 04:18:24,850][52820] DAMAGECOUNT value on done: 472411.0 [2024-08-06 04:18:24,850][52820] Sum rewards: 70.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.678', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.075', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.342', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.376', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:25,512][52663] DAMAGECOUNT value on done: 508251.0 [2024-08-06 04:18:25,512][52663] Sum rewards: 60.735, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.192', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.161', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON3': '0.900', 'HITCOUNT': '2.930', 'weapon3': '3.116', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '46.000'} [2024-08-06 04:18:26,940][52667] DAMAGECOUNT value on done: 510411.0 [2024-08-06 04:18:26,942][52667] Sum rewards: 75.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.504', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 04:18:27,458][52666] DAMAGECOUNT value on done: 500763.0 [2024-08-06 04:18:27,459][52666] Sum rewards: 63.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.150', 'weapon2': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '55.000'} [2024-08-06 04:18:27,699][52670] DAMAGECOUNT value on done: 502043.0 [2024-08-06 04:18:27,699][52670] Sum rewards: 69.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.760', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.212', 'weapon2': '0.220', 'weapon4': '0.226', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:27,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 429654016. Throughput: 0: 4384.0. Samples: 107421710. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 04:18:27,795][52567] Avg episode reward: [(0, '71.178')] [2024-08-06 04:18:27,834][52649] DAMAGECOUNT value on done: 490784.0 [2024-08-06 04:18:27,836][52649] Sum rewards: 71.239, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.725', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon5': '0.334', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:27,851][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052449_429662208.pth... [2024-08-06 04:18:27,986][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000051935_425451520.pth [2024-08-06 04:18:27,996][52820] DAMAGECOUNT value on done: 469669.0 [2024-08-06 04:18:27,998][52820] Sum rewards: 89.893, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.845', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.173', 'weapon4': '0.202', 'weapon2': '0.206', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.206', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.276', 'FRAGCOUNT': '78.000'} [2024-08-06 04:18:28,161][52663] DAMAGECOUNT value on done: 505481.0 [2024-08-06 04:18:28,162][52663] Sum rewards: 72.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.023', 'AMMO2': '0.065', 'weapon4': '0.234', 'AMMO3': '0.292', 'weapon5': '0.306', 'AMMO4': '0.323', 'weapon2': '0.328', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.792', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '59.000'} [2024-08-06 04:18:28,958][52669] DAMAGECOUNT value on done: 507751.0 [2024-08-06 04:18:28,959][52669] Sum rewards: 74.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.119', 'weapon2': '0.212', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.428', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '64.000'} [2024-08-06 04:18:29,367][52650] Updated weights for policy 0, policy_version 52451 (0.0012) [2024-08-06 04:18:29,854][52667] DAMAGECOUNT value on done: 513174.0 [2024-08-06 04:18:29,855][52667] Sum rewards: 64.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.054', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon2': '0.364', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '52.000'} [2024-08-06 04:18:30,883][52666] DAMAGECOUNT value on done: 501038.0 [2024-08-06 04:18:30,883][52666] Sum rewards: 73.276, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.090', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '63.000'} [2024-08-06 04:18:30,888][52663] DAMAGECOUNT value on done: 500457.0 [2024-08-06 04:18:30,888][52663] Sum rewards: 79.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.341', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.093', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.156', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '68.000'} [2024-08-06 04:18:31,155][52820] DAMAGECOUNT value on done: 468686.0 [2024-08-06 04:18:31,155][52820] Sum rewards: 71.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.271', 'weapon2': '0.340', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.296', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '62.000'} [2024-08-06 04:18:31,190][52670] DAMAGECOUNT value on done: 487841.0 [2024-08-06 04:18:31,196][52670] Sum rewards: 69.457, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.113', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'weapon2': '0.398', 'WEAPON3': '1.750', 'weapon3': '3.084', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:31,812][52669] DAMAGECOUNT value on done: 499966.0 [2024-08-06 04:18:31,816][52669] Sum rewards: 71.136, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.154', 'AMMO3': '0.224', 'AMMO4': '0.240', 'weapon4': '0.334', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '62.000'} [2024-08-06 04:18:32,638][52667] DAMAGECOUNT value on done: 502256.0 [2024-08-06 04:18:32,642][52667] Sum rewards: 64.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.402', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.080', 'AMMO3': '0.196', 'weapon5': '0.206', 'AMMO4': '0.226', 'weapon2': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.242', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '54.000'} [2024-08-06 04:18:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17522.5). Total num frames: 429744128. Throughput: 0: 4374.9. Samples: 107434490. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 04:18:32,794][52567] Avg episode reward: [(0, '70.930')] [2024-08-06 04:18:33,525][52650] Updated weights for policy 0, policy_version 52461 (0.0039) [2024-08-06 04:18:34,130][52666] DAMAGECOUNT value on done: 504372.0 [2024-08-06 04:18:34,131][52666] Sum rewards: 53.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.437', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.132', 'AMMO4': '0.162', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.050', 'HITCOUNT': '2.720', 'weapon3': '3.106', 'DAMAGECOUNT': '13.761', 'FRAGCOUNT': '43.500'} [2024-08-06 04:18:34,403][52820] DAMAGECOUNT value on done: 476818.0 [2024-08-06 04:18:34,406][52820] Sum rewards: 57.940, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.098', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.177', 'weapon4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '3.138', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '48.000'} [2024-08-06 04:18:34,504][52670] DAMAGECOUNT value on done: 498272.0 [2024-08-06 04:18:34,506][52670] Sum rewards: 77.245, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.087', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon2': '0.156', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.304', 'WEAPON3': '0.900', 'weapon3': '3.308', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '61.000'} [2024-08-06 04:18:34,726][52669] DAMAGECOUNT value on done: 510934.0 [2024-08-06 04:18:34,728][52669] Sum rewards: 83.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.644', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.172', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '66.000'} [2024-08-06 04:18:35,035][52667] DAMAGECOUNT value on done: 503525.0 [2024-08-06 04:18:35,035][52667] Sum rewards: 59.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.334', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.149', 'weapon5': '0.246', 'AMMO4': '0.268', 'weapon4': '0.374', 'weapon2': '0.432', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.510', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '46.000'} [2024-08-06 04:18:37,060][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:18:37,181][52666] DAMAGECOUNT value on done: 490361.0 [2024-08-06 04:18:37,183][52666] Sum rewards: 82.481, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.878', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.154', 'weapon2': '0.194', 'AMMO3': '0.212', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '67.000'} [2024-08-06 04:18:37,472][52670] DAMAGECOUNT value on done: 506919.0 [2024-08-06 04:18:37,473][52670] Sum rewards: 60.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.822', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.364', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.262', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '51.000'} [2024-08-06 04:18:37,618][52820] DAMAGECOUNT value on done: 476293.0 [2024-08-06 04:18:37,619][52820] Sum rewards: 57.984, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.958', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.044', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.222', 'weapon2': '0.286', 'AMMO3': '0.322', 'WEAPON3': '1.850', 'HITCOUNT': '3.150', 'weapon3': '3.340', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '54.000'} [2024-08-06 04:18:37,645][52667] DAMAGECOUNT value on done: 511090.0 [2024-08-06 04:18:37,645][52667] Sum rewards: 73.270, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.540', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.161', 'weapon4': '0.162', 'weapon5': '0.180', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.830', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:37,726][52669] DAMAGECOUNT value on done: 507096.0 [2024-08-06 04:18:37,726][52669] Sum rewards: 71.073, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.668', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.142', 'weapon5': '0.152', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.308', 'weapon2': '0.356', 'WEAPON3': '1.800', 'weapon3': '3.038', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '63.000'} [2024-08-06 04:18:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 429826048. Throughput: 0: 4378.4. Samples: 107460950. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 04:18:37,794][52567] Avg episode reward: [(0, '70.808')] [2024-08-06 04:18:38,354][52650] Updated weights for policy 0, policy_version 52471 (0.0022) [2024-08-06 04:18:40,268][52666] DAMAGECOUNT value on done: 497759.0 [2024-08-06 04:18:40,269][52666] Sum rewards: 78.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.212', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.106', 'weapon4': '0.110', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '66.000'} [2024-08-06 04:18:40,398][52667] DAMAGECOUNT value on done: 501709.0 [2024-08-06 04:18:40,400][52667] Sum rewards: 75.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.158', 'AMMO4': '0.177', 'AMMO3': '0.187', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.746', 'WEAPON3': '1.200', 'weapon3': '2.698', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '61.000'} [2024-08-06 04:18:40,654][52670] DAMAGECOUNT value on done: 497436.0 [2024-08-06 04:18:40,654][52670] Sum rewards: 63.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.084', 'AMMO4': '0.147', 'weapon5': '0.184', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '55.000'} [2024-08-06 04:18:40,730][52820] DAMAGECOUNT value on done: 464215.0 [2024-08-06 04:18:40,731][52820] Sum rewards: 67.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.973', 'AMMO5': '0.009', 'AMMO2': '0.055', 'weapon5': '0.124', 'weapon4': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'AMMO4': '0.273', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '56.000'} [2024-08-06 04:18:40,895][52669] DAMAGECOUNT value on done: 505301.0 [2024-08-06 04:18:40,897][52669] Sum rewards: 70.074, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.753', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO4': '0.153', 'weapon2': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.192', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '61.000'} [2024-08-06 04:18:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 429916160. Throughput: 0: 4383.8. Samples: 107487350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:18:42,794][52567] Avg episode reward: [(0, '70.868')] [2024-08-06 04:18:42,964][52667] DAMAGECOUNT value on done: 510246.0 [2024-08-06 04:18:42,964][52667] Sum rewards: 75.052, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.228', 'weapon4': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 04:18:43,120][52650] Updated weights for policy 0, policy_version 52481 (0.0017) [2024-08-06 04:18:43,559][52665] Large shaping reward 2.506 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.126, -42.0), ('weapon5', 0.002)] [2024-08-06 04:18:43,695][52669] DAMAGECOUNT value on done: 509047.0 [2024-08-06 04:18:43,696][52669] Sum rewards: 72.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.396', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.228', 'AMMO3': '0.241', 'weapon4': '0.322', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:43,767][52670] DAMAGECOUNT value on done: 502498.0 [2024-08-06 04:18:43,769][52670] Sum rewards: 80.813, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.598', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.256', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.322', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '69.000'} [2024-08-06 04:18:45,933][52667] DAMAGECOUNT value on done: 514349.0 [2024-08-06 04:18:45,935][52667] Sum rewards: 64.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.075', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.146', 'weapon5': '0.178', 'AMMO3': '0.218', 'AMMO4': '0.246', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.110', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '54.000'} [2024-08-06 04:18:46,991][52669] DAMAGECOUNT value on done: 508859.0 [2024-08-06 04:18:46,993][52669] Sum rewards: 77.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.667', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.168', 'weapon5': '0.176', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 04:18:47,672][52650] Updated weights for policy 0, policy_version 52491 (0.0039) [2024-08-06 04:18:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 430006272. Throughput: 0: 4378.7. Samples: 107500390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:18:47,794][52567] Avg episode reward: [(0, '71.085')] [2024-08-06 04:18:48,180][52671] DAMAGECOUNT value on done: 512643.0 [2024-08-06 04:18:48,182][52671] Sum rewards: 90.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.227', 'weapon2': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.498', 'HITCOUNT': '4.330', 'DAMAGECOUNT': '21.789', 'FRAGCOUNT': '75.000'} [2024-08-06 04:18:48,911][52667] DAMAGECOUNT value on done: 515706.0 [2024-08-06 04:18:48,912][52667] Sum rewards: 67.143, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.400', 'AMMO5': '0.023', 'weapon5': '0.044', 'AMMO2': '0.055', 'weapon4': '0.152', 'AMMO3': '0.235', 'weapon2': '0.266', 'AMMO4': '0.273', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:49,968][52669] DAMAGECOUNT value on done: 505881.0 [2024-08-06 04:18:49,968][52669] Sum rewards: 67.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.665', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.077', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '3.226', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:50,059][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:18:50,489][52794] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:18:50,875][52671] DAMAGECOUNT value on done: 510589.0 [2024-08-06 04:18:50,876][52671] Sum rewards: 70.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.773', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.066', 'weapon5': '0.186', 'AMMO4': '0.216', 'AMMO3': '0.222', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.216', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '59.000'} [2024-08-06 04:18:51,663][52667] DAMAGECOUNT value on done: 512583.0 [2024-08-06 04:18:51,664][52667] Sum rewards: 72.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.100', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'weapon2': '0.362', 'ARMOR': '0.400', 'weapon4': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.706', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '59.000'} [2024-08-06 04:18:52,467][52650] Updated weights for policy 0, policy_version 52501 (0.0028) [2024-08-06 04:18:52,605][52614] Signal inference workers to stop experience collection... (9550 times) [2024-08-06 04:18:52,606][52614] Signal inference workers to resume experience collection... (9550 times) [2024-08-06 04:18:52,669][52650] InferenceWorker_p0-w0: stopping experience collection (9550 times) [2024-08-06 04:18:52,669][52650] InferenceWorker_p0-w0: resuming experience collection (9550 times) [2024-08-06 04:18:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 430096384. Throughput: 0: 4380.5. Samples: 107526800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:18:52,794][52567] Avg episode reward: [(0, '71.032')] [2024-08-06 04:18:52,853][52669] DAMAGECOUNT value on done: 513623.0 [2024-08-06 04:18:52,853][52669] Sum rewards: 69.337, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.016', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon5': '0.174', 'AMMO3': '0.263', 'AMMO4': '0.290', 'weapon2': '0.320', 'weapon4': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.832', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '60.000'} [2024-08-06 04:18:53,735][52671] DAMAGECOUNT value on done: 510902.0 [2024-08-06 04:18:53,736][52671] Sum rewards: 82.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO2': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.035', 'AMMO3': '0.201', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '67.000'} [2024-08-06 04:18:54,280][52667] DAMAGECOUNT value on done: 505728.0 [2024-08-06 04:18:54,280][52667] Sum rewards: 63.124, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.610', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon5': '0.172', 'weapon4': '0.184', 'weapon2': '0.258', 'AMMO4': '0.273', 'AMMO3': '0.321', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.028', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '56.500'} [2024-08-06 04:18:55,735][52669] DAMAGECOUNT value on done: 506199.0 [2024-08-06 04:18:55,737][52669] Sum rewards: 68.889, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.847', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.340', 'WEAPON3': '1.650', 'weapon3': '3.232', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:56,843][52671] DAMAGECOUNT value on done: 508981.0 [2024-08-06 04:18:56,845][52671] Sum rewards: 78.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.066', 'weapon4': '0.070', 'AMMO4': '0.135', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '66.000'} [2024-08-06 04:18:57,061][52650] Updated weights for policy 0, policy_version 52511 (0.0012) [2024-08-06 04:18:57,111][52668] DAMAGECOUNT value on done: 503886.0 [2024-08-06 04:18:57,112][52668] Sum rewards: 76.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.228', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '63.000'} [2024-08-06 04:18:57,145][52667] DAMAGECOUNT value on done: 513771.0 [2024-08-06 04:18:57,145][52667] Sum rewards: 77.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.666', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.084', 'AMMO4': '0.142', 'weapon5': '0.204', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.600', 'weapon3': '3.140', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '65.000'} [2024-08-06 04:18:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 430178304. Throughput: 0: 4376.0. Samples: 107552790. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:18:57,794][52567] Avg episode reward: [(0, '71.180')] [2024-08-06 04:18:58,939][52669] DAMAGECOUNT value on done: 513110.0 [2024-08-06 04:18:58,948][52669] Sum rewards: 69.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.492', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.186', 'AMMO3': '0.240', 'AMMO4': '0.255', 'weapon5': '0.280', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '58.000'} [2024-08-06 04:18:59,368][52671] DAMAGECOUNT value on done: 520432.0 [2024-08-06 04:18:59,388][52671] Sum rewards: 80.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.102', 'weapon5': '0.142', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.376', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '68.000'} [2024-08-06 04:18:59,581][52668] DAMAGECOUNT value on done: 509307.0 [2024-08-06 04:18:59,581][52668] Sum rewards: 70.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.088', 'weapon4': '0.160', 'AMMO4': '0.186', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 04:19:00,045][52658] DAMAGECOUNT value on done: 505393.0 [2024-08-06 04:19:00,045][52658] Sum rewards: 74.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.860', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.160', 'AMMO3': '0.178', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '62.000'} [2024-08-06 04:19:00,178][52811] DAMAGECOUNT value on done: 483528.0 [2024-08-06 04:19:00,178][52811] Sum rewards: 63.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.328', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.180', 'weapon2': '0.198', 'AMMO3': '0.208', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '54.000'} [2024-08-06 04:19:01,690][52650] Updated weights for policy 0, policy_version 52521 (0.0055) [2024-08-06 04:19:01,947][52669] DAMAGECOUNT value on done: 510517.0 [2024-08-06 04:19:01,949][52669] Sum rewards: 74.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.111', 'AMMO5': '0.023', 'AMMO2': '0.050', 'weapon4': '0.124', 'AMMO3': '0.168', 'weapon2': '0.246', 'AMMO4': '0.250', 'weapon5': '0.262', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.000'} [2024-08-06 04:19:02,277][52671] DAMAGECOUNT value on done: 509870.0 [2024-08-06 04:19:02,278][52671] Sum rewards: 70.745, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.180', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.574', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:02,615][52647] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:19:02,664][52668] DAMAGECOUNT value on done: 508299.0 [2024-08-06 04:19:02,664][52668] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.013', 'HEALTH': '0.018', 'AMMO2': '0.036', 'weapon4': '0.108', 'AMMO4': '0.180', 'AMMO3': '0.199', 'weapon5': '0.228', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 430268416. Throughput: 0: 4376.7. Samples: 107565930. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:19:02,794][52567] Avg episode reward: [(0, '71.297')] [2024-08-06 04:19:02,921][52658] DAMAGECOUNT value on done: 507546.0 [2024-08-06 04:19:02,923][52658] Sum rewards: 70.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.114', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.260', 'weapon2': '0.424', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:03,321][52811] DAMAGECOUNT value on done: 468634.0 [2024-08-06 04:19:03,323][52811] Sum rewards: 84.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.140', 'AMMO3': '0.187', 'weapon2': '0.232', 'AMMO4': '0.255', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:04,726][52669] DAMAGECOUNT value on done: 498309.0 [2024-08-06 04:19:04,726][52669] Sum rewards: 77.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.068', 'weapon5': '0.116', 'AMMO4': '0.127', 'weapon2': '0.208', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.376', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:05,259][52671] DAMAGECOUNT value on done: 516337.0 [2024-08-06 04:19:05,260][52671] Sum rewards: 83.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.054', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.394', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '70.000'} [2024-08-06 04:19:05,677][52668] DAMAGECOUNT value on done: 508699.0 [2024-08-06 04:19:05,677][52668] Sum rewards: 58.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.782', 'AMMO5': '0.008', 'AMMO2': '0.033', 'AMMO4': '0.162', 'weapon5': '0.164', 'weapon4': '0.168', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '49.000'} [2024-08-06 04:19:05,738][52658] DAMAGECOUNT value on done: 510868.0 [2024-08-06 04:19:05,738][52658] Sum rewards: 74.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.125', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.082', 'AMMO4': '0.096', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.322', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:06,405][52811] DAMAGECOUNT value on done: 465432.0 [2024-08-06 04:19:06,405][52811] Sum rewards: 73.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.180', 'AMMO4': '0.227', 'weapon4': '0.232', 'AMMO3': '0.243', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:06,626][52650] Updated weights for policy 0, policy_version 52531 (0.0023) [2024-08-06 04:19:06,627][52662] DAMAGECOUNT value on done: 510920.0 [2024-08-06 04:19:06,640][52662] Sum rewards: 82.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.176', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.210', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:07,579][52669] DAMAGECOUNT value on done: 508510.0 [2024-08-06 04:19:07,582][52669] Sum rewards: 77.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO3': '0.202', 'weapon2': '0.292', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 430342144. Throughput: 0: 4368.2. Samples: 107592070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:19:07,794][52567] Avg episode reward: [(0, '71.448')] [2024-08-06 04:19:07,897][52668] DAMAGECOUNT value on done: 498666.0 [2024-08-06 04:19:07,898][52668] Sum rewards: 67.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.398', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.118', 'weapon5': '0.142', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.196', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '57.500'} [2024-08-06 04:19:07,954][52649] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2024-08-06 04:19:08,356][52671] DAMAGECOUNT value on done: 509825.0 [2024-08-06 04:19:08,356][52671] Sum rewards: 77.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.764', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.096', 'weapon4': '0.098', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:08,943][52658] DAMAGECOUNT value on done: 510557.0 [2024-08-06 04:19:08,943][52658] Sum rewards: 79.387, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.048', 'AMMO5': '0.024', 'AMMO2': '0.076', 'weapon4': '0.184', 'weapon5': '0.202', 'AMMO3': '0.256', 'weapon2': '0.348', 'AMMO4': '0.379', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:09,488][52811] DAMAGECOUNT value on done: 469724.0 [2024-08-06 04:19:09,489][52811] Sum rewards: 83.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.836', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.140', 'AMMO4': '0.189', 'weapon2': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.230', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '69.000'} [2024-08-06 04:19:10,119][52662] DAMAGECOUNT value on done: 511457.0 [2024-08-06 04:19:10,119][52662] Sum rewards: 64.184, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.572', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.076', 'weapon5': '0.164', 'AMMO3': '0.169', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '3.172', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '51.000'} [2024-08-06 04:19:10,333][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:19:10,477][52669] DAMAGECOUNT value on done: 509734.0 [2024-08-06 04:19:10,478][52669] Sum rewards: 76.869, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.410', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.158', 'AMMO4': '0.160', 'weapon4': '0.166', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.950', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:10,775][52671] DAMAGECOUNT value on done: 504517.0 [2024-08-06 04:19:10,775][52671] Sum rewards: 70.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.735', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.097', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:11,017][52668] DAMAGECOUNT value on done: 511409.0 [2024-08-06 04:19:11,018][52668] Sum rewards: 63.697, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.435', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.161', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon2': '0.412', 'WEAPON3': '1.700', 'weapon3': '2.958', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '57.500'} [2024-08-06 04:19:11,161][52650] Updated weights for policy 0, policy_version 52541 (0.0036) [2024-08-06 04:19:11,724][52658] DAMAGECOUNT value on done: 502155.0 [2024-08-06 04:19:11,724][52658] Sum rewards: 87.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.937', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO4': '0.169', 'AMMO3': '0.190', 'weapon4': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.423', 'FRAGCOUNT': '69.000'} [2024-08-06 04:19:12,549][52811] DAMAGECOUNT value on done: 474262.0 [2024-08-06 04:19:12,550][52811] Sum rewards: 84.418, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO4': '0.164', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'HEALTH': '0.682', 'WEAPON3': '0.950', 'weapon3': '3.192', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '66.000'} [2024-08-06 04:19:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 430440448. Throughput: 0: 4370.5. Samples: 107618380. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:19:12,794][52567] Avg episode reward: [(0, '71.931')] [2024-08-06 04:19:12,950][52662] DAMAGECOUNT value on done: 511631.0 [2024-08-06 04:19:12,952][52662] Sum rewards: 72.079, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.496', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.040', 'AMMO4': '0.046', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.346', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:13,426][52668] DAMAGECOUNT value on done: 511290.0 [2024-08-06 04:19:13,426][52668] Sum rewards: 69.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.268', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.128', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:13,565][52669] DAMAGECOUNT value on done: 524794.0 [2024-08-06 04:19:13,565][52669] Sum rewards: 67.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.643', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.194', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'weapon4': '0.332', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:13,848][52803] DAMAGECOUNT value on done: 471102.0 [2024-08-06 04:19:13,849][52803] Sum rewards: 62.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.011', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.185', 'weapon5': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2024-08-06 04:19:14,041][52647] DAMAGECOUNT value on done: 534442.0 [2024-08-06 04:19:14,041][52647] Sum rewards: 72.640, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon2': '0.658', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.000'} [2024-08-06 04:19:14,087][52671] DAMAGECOUNT value on done: 510595.0 [2024-08-06 04:19:14,087][52671] Sum rewards: 80.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.119', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.116', 'AMMO3': '0.169', 'AMMO4': '0.234', 'weapon5': '0.266', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '64.000'} [2024-08-06 04:19:14,565][52658] DAMAGECOUNT value on done: 503502.0 [2024-08-06 04:19:14,566][52658] Sum rewards: 82.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.518', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.059', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.336', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:15,613][52811] DAMAGECOUNT value on done: 479969.0 [2024-08-06 04:19:15,616][52811] Sum rewards: 75.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.030', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.155', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '0.950', 'weapon3': '2.978', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:15,981][52650] Updated weights for policy 0, policy_version 52551 (0.0036) [2024-08-06 04:19:16,048][52668] DAMAGECOUNT value on done: 501172.0 [2024-08-06 04:19:16,049][52668] Sum rewards: 76.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.840', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.152', 'AMMO3': '0.178', 'AMMO4': '0.204', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.266', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '62.000'} [2024-08-06 04:19:16,145][52662] DAMAGECOUNT value on done: 501056.0 [2024-08-06 04:19:16,147][52662] Sum rewards: 81.552, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.382', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.128', 'AMMO3': '0.222', 'AMMO4': '0.258', 'weapon4': '0.296', 'weapon2': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:16,535][52669] DAMAGECOUNT value on done: 512807.0 [2024-08-06 04:19:16,537][52669] Sum rewards: 73.631, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.102', 'weapon5': '0.160', 'AMMO4': '0.169', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:16,925][52803] DAMAGECOUNT value on done: 471079.0 [2024-08-06 04:19:16,927][52803] Sum rewards: 71.296, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.110', 'HEALTH': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '3.350', 'weapon3': '3.372', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:16,997][52671] DAMAGECOUNT value on done: 511813.0 [2024-08-06 04:19:17,000][52671] Sum rewards: 68.067, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.138', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.086', 'weapon4': '0.112', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.398', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.240', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:17,182][52647] DAMAGECOUNT value on done: 536603.0 [2024-08-06 04:19:17,182][52647] Sum rewards: 77.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.318', 'AMMO2': '0.005', 'AMMO4': '0.026', 'ARMOR': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon4': '0.332', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:17,547][52658] DAMAGECOUNT value on done: 511683.0 [2024-08-06 04:19:17,547][52658] Sum rewards: 66.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.677', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.184', 'weapon4': '0.214', 'AMMO3': '0.217', 'AMMO4': '0.253', 'weapon2': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:17,794][52567] Fps is (10 sec: 19660.8, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 430538752. Throughput: 0: 4380.7. Samples: 107631620. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:19:17,794][52567] Avg episode reward: [(0, '72.361')] [2024-08-06 04:19:18,671][52811] DAMAGECOUNT value on done: 475403.0 [2024-08-06 04:19:18,672][52811] Sum rewards: 88.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.350', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.232', 'AMMO3': '0.240', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '21.798', 'FRAGCOUNT': '73.000'} [2024-08-06 04:19:18,848][52668] DAMAGECOUNT value on done: 504113.0 [2024-08-06 04:19:18,851][52668] Sum rewards: 77.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.189', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.124', 'AMMO4': '0.146', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:19,338][52662] DAMAGECOUNT value on done: 511693.0 [2024-08-06 04:19:19,340][52662] Sum rewards: 68.839, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.189', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.040', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:19,393][52660] DAMAGECOUNT value on done: 506787.0 [2024-08-06 04:19:19,396][52660] Sum rewards: 68.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.186', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.164', 'weapon4': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:19,422][52671] DAMAGECOUNT value on done: 509557.0 [2024-08-06 04:19:19,422][52671] Sum rewards: 68.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.633', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.212', 'AMMO4': '0.234', 'weapon5': '0.234', 'weapon2': '0.288', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.716', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '58.000'} [2024-08-06 04:19:19,426][52669] DAMAGECOUNT value on done: 511100.0 [2024-08-06 04:19:19,427][52669] Sum rewards: 77.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.524', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.216', 'weapon2': '0.364', 'WEAPON3': '1.250', 'HITCOUNT': '3.480', 'weapon3': '3.508', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '64.000'} [2024-08-06 04:19:19,746][52647] DAMAGECOUNT value on done: 530966.0 [2024-08-06 04:19:19,746][52647] Sum rewards: 68.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.334', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:20,058][52803] DAMAGECOUNT value on done: 476889.0 [2024-08-06 04:19:20,059][52803] Sum rewards: 75.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.254', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:20,366][52650] Updated weights for policy 0, policy_version 52561 (0.0012) [2024-08-06 04:19:20,600][52658] DAMAGECOUNT value on done: 502481.0 [2024-08-06 04:19:20,601][52658] Sum rewards: 68.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.476', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.102', 'AMMO3': '0.185', 'AMMO4': '0.192', 'weapon5': '0.288', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '54.000'} [2024-08-06 04:19:20,777][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:19:21,676][52811] DAMAGECOUNT value on done: 472711.0 [2024-08-06 04:19:21,676][52811] Sum rewards: 74.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.145', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.170', 'AMMO3': '0.243', 'WEAPON3': '1.400', 'weapon3': '3.584', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:21,810][52668] DAMAGECOUNT value on done: 512225.0 [2024-08-06 04:19:21,813][52668] Sum rewards: 71.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon2': '0.340', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.426', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:22,020][52669] DAMAGECOUNT value on done: 512141.0 [2024-08-06 04:19:22,022][52669] Sum rewards: 68.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.070', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.246', 'AMMO3': '0.261', 'WEAPON3': '1.600', 'weapon3': '3.360', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 04:19:22,041][52662] DAMAGECOUNT value on done: 504855.0 [2024-08-06 04:19:22,043][52662] Sum rewards: 71.130, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.915', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.148', 'weapon5': '0.198', 'AMMO3': '0.221', 'weapon2': '0.262', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:22,421][52671] DAMAGECOUNT value on done: 518570.0 [2024-08-06 04:19:22,422][52671] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.287', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon5': '0.170', 'weapon4': '0.180', 'AMMO3': '0.253', 'AMMO4': '0.324', 'weapon2': '0.494', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.876', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:22,512][52660] DAMAGECOUNT value on done: 498492.0 [2024-08-06 04:19:22,513][52660] Sum rewards: 80.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.132', 'weapon5': '0.168', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 430612480. Throughput: 0: 4375.8. Samples: 107657860. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:19:22,795][52567] Avg episode reward: [(0, '73.047')] [2024-08-06 04:19:23,058][52803] DAMAGECOUNT value on done: 479670.0 [2024-08-06 04:19:23,059][52803] Sum rewards: 82.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.767', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.038', 'weapon5': '0.054', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:23,129][52658] DAMAGECOUNT value on done: 517284.0 [2024-08-06 04:19:23,133][52658] Sum rewards: 72.873, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.897', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.082', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon2': '0.284', 'AMMO3': '0.314', 'WEAPON3': '1.850', 'weapon3': '3.214', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:23,232][52647] DAMAGECOUNT value on done: 541815.0 [2024-08-06 04:19:23,232][52647] Sum rewards: 83.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.434', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.410', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:24,782][52811] DAMAGECOUNT value on done: 478212.0 [2024-08-06 04:19:24,783][52811] Sum rewards: 62.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.457', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.124', 'weapon2': '0.190', 'weapon5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.306', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '53.000'} [2024-08-06 04:19:24,791][52662] DAMAGECOUNT value on done: 511506.0 [2024-08-06 04:19:24,792][52662] Sum rewards: 64.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.042', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.196', 'AMMO3': '0.240', 'AMMO4': '0.287', 'weapon2': '0.290', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:24,893][52668] DAMAGECOUNT value on done: 505683.0 [2024-08-06 04:19:24,894][52668] Sum rewards: 67.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.926', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.124', 'weapon4': '0.184', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.834', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:25,009][52669] DAMAGECOUNT value on done: 513824.0 [2024-08-06 04:19:25,009][52669] Sum rewards: 68.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.291', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.144', 'AMMO3': '0.169', 'AMMO4': '0.205', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:25,361][52650] Updated weights for policy 0, policy_version 52571 (0.0019) [2024-08-06 04:19:25,448][52671] DAMAGECOUNT value on done: 511574.0 [2024-08-06 04:19:25,449][52671] Sum rewards: 79.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.036', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.235', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:25,507][52660] DAMAGECOUNT value on done: 510114.0 [2024-08-06 04:19:25,507][52660] Sum rewards: 84.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.102', 'weapon4': '0.160', 'AMMO4': '0.217', 'AMMO3': '0.219', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.276', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.507', 'FRAGCOUNT': '69.000'} [2024-08-06 04:19:25,603][52658] DAMAGECOUNT value on done: 506098.0 [2024-08-06 04:19:25,604][52658] Sum rewards: 86.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.656', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.158', 'weapon4': '0.160', 'AMMO3': '0.265', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.110', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.261', 'FRAGCOUNT': '73.000'} [2024-08-06 04:19:25,796][52647] DAMAGECOUNT value on done: 540334.0 [2024-08-06 04:19:25,805][52647] Sum rewards: 83.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.899', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '71.000'} [2024-08-06 04:19:26,093][52803] DAMAGECOUNT value on done: 476387.0 [2024-08-06 04:19:26,095][52803] Sum rewards: 77.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.126', 'AMMO4': '0.172', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '66.000'} [2024-08-06 04:19:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 430702592. Throughput: 0: 4374.7. Samples: 107684210. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:19:27,794][52567] Avg episode reward: [(0, '73.632')] [2024-08-06 04:19:27,977][52811] DAMAGECOUNT value on done: 473522.0 [2024-08-06 04:19:27,978][52811] Sum rewards: 55.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.758', 'AMMO5': '0.016', 'AMMO2': '0.085', 'weapon5': '0.160', 'AMMO3': '0.179', 'weapon4': '0.226', 'AMMO4': '0.426', 'WEAPON5': '0.450', 'weapon2': '0.544', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '47.000'} [2024-08-06 04:19:28,018][52668] DAMAGECOUNT value on done: 499946.0 [2024-08-06 04:19:28,018][52668] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.015', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.116', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:28,021][52662] DAMAGECOUNT value on done: 515819.0 [2024-08-06 04:19:28,021][52662] Sum rewards: 72.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.034', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.344', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '62.000'} [2024-08-06 04:19:28,151][52671] DAMAGECOUNT value on done: 497845.0 [2024-08-06 04:19:28,153][52671] Sum rewards: 72.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.395', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.060', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.172', 'WEAPON3': '1.050', 'HITCOUNT': '3.250', 'weapon3': '3.554', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '58.000'} [2024-08-06 04:19:28,440][52647] DAMAGECOUNT value on done: 538484.0 [2024-08-06 04:19:28,441][52647] Sum rewards: 69.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.597', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.269', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.992', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 04:19:28,532][52660] DAMAGECOUNT value on done: 514127.0 [2024-08-06 04:19:28,533][52660] Sum rewards: 74.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.535', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.136', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.175', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:28,654][52658] DAMAGECOUNT value on done: 518326.0 [2024-08-06 04:19:28,654][52658] Sum rewards: 67.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.101', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.090', 'AMMO4': '0.147', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.486', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:29,147][52803] DAMAGECOUNT value on done: 465740.0 [2024-08-06 04:19:29,149][52803] Sum rewards: 67.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.084', 'AMMO3': '0.196', 'weapon5': '0.244', 'AMMO4': '0.258', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:29,909][52650] Updated weights for policy 0, policy_version 52581 (0.0015) [2024-08-06 04:19:30,622][52668] DAMAGECOUNT value on done: 495367.0 [2024-08-06 04:19:30,623][52668] Sum rewards: 67.444, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.834', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.142', 'AMMO3': '0.173', 'AMMO4': '0.219', 'weapon5': '0.224', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.046', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '54.000'} [2024-08-06 04:19:30,814][52662] DAMAGECOUNT value on done: 506694.0 [2024-08-06 04:19:30,814][52662] Sum rewards: 73.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.104', 'AMMO4': '0.167', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '62.000'} [2024-08-06 04:19:30,947][52811] DAMAGECOUNT value on done: 473458.0 [2024-08-06 04:19:30,947][52811] Sum rewards: 80.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.117', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.294', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '66.000'} [2024-08-06 04:19:31,101][52660] DAMAGECOUNT value on done: 507378.0 [2024-08-06 04:19:31,102][52660] Sum rewards: 66.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.059', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.231', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '55.500'} [2024-08-06 04:19:31,437][52671] DAMAGECOUNT value on done: 517824.0 [2024-08-06 04:19:31,438][52671] Sum rewards: 75.642, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.178', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.162', 'weapon5': '0.228', 'weapon2': '0.272', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '59.000'} [2024-08-06 04:19:31,454][52647] DAMAGECOUNT value on done: 534590.0 [2024-08-06 04:19:31,454][52647] Sum rewards: 86.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.017', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.236', 'WEAPON3': '1.200', 'weapon3': '3.572', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '71.000'} [2024-08-06 04:19:31,894][52658] DAMAGECOUNT value on done: 501371.0 [2024-08-06 04:19:31,895][52658] Sum rewards: 83.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.235', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.614', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '69.000'} [2024-08-06 04:19:32,286][52803] DAMAGECOUNT value on done: 468824.0 [2024-08-06 04:19:32,288][52803] Sum rewards: 83.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.487', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 430792704. Throughput: 0: 4382.2. Samples: 107697590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:19:32,794][52567] Avg episode reward: [(0, '74.071')] [2024-08-06 04:19:32,795][52614] Saving new best policy, reward=74.071! [2024-08-06 04:19:33,527][52668] DAMAGECOUNT value on done: 496818.0 [2024-08-06 04:19:33,528][52668] Sum rewards: 80.848, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.043', 'weapon5': '0.124', 'weapon4': '0.188', 'AMMO4': '0.216', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.044', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '69.000'} [2024-08-06 04:19:33,535][52665] DAMAGECOUNT value on done: 496632.0 [2024-08-06 04:19:33,535][52665] Sum rewards: 82.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.416', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.118', 'weapon5': '0.138', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:33,598][52662] DAMAGECOUNT value on done: 519051.0 [2024-08-06 04:19:33,598][52662] Sum rewards: 70.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.312', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon4': '0.214', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:34,143][52660] DAMAGECOUNT value on done: 504023.0 [2024-08-06 04:19:34,143][52660] Sum rewards: 62.729, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.968', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon5': '0.136', 'weapon4': '0.176', 'AMMO3': '0.287', 'AMMO4': '0.287', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.604', 'WEAPON3': '1.650', 'weapon3': '2.782', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:34,209][52811] DAMAGECOUNT value on done: 484801.0 [2024-08-06 04:19:34,209][52811] Sum rewards: 73.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.128', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.207', 'WEAPON3': '1.250', 'weapon3': '3.470', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '59.000'} [2024-08-06 04:19:34,310][52671] DAMAGECOUNT value on done: 514856.0 [2024-08-06 04:19:34,310][52671] Sum rewards: 76.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.775', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.150', 'weapon5': '0.188', 'AMMO3': '0.211', 'AMMO4': '0.284', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '64.000'} [2024-08-06 04:19:34,493][52650] Updated weights for policy 0, policy_version 52591 (0.0012) [2024-08-06 04:19:34,516][52647] DAMAGECOUNT value on done: 527765.0 [2024-08-06 04:19:34,518][52647] Sum rewards: 68.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '58.000'} [2024-08-06 04:19:35,080][52658] DAMAGECOUNT value on done: 508068.0 [2024-08-06 04:19:35,081][52658] Sum rewards: 71.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.166', 'AMMO4': '0.188', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:35,398][52803] DAMAGECOUNT value on done: 466883.0 [2024-08-06 04:19:35,399][52803] Sum rewards: 75.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.318', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.169', 'weapon2': '0.718', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:36,157][52662] DAMAGECOUNT value on done: 505585.0 [2024-08-06 04:19:36,159][52662] Sum rewards: 59.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.492', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.316', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.000'} [2024-08-06 04:19:36,275][52668] DAMAGECOUNT value on done: 498508.0 [2024-08-06 04:19:36,276][52668] Sum rewards: 75.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.154', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.132', 'AMMO4': '0.147', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:36,592][52647] DAMAGECOUNT value on done: 537983.0 [2024-08-06 04:19:36,593][52647] Sum rewards: 60.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.602', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.354', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.300', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '53.000'} [2024-08-06 04:19:36,614][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:19:36,712][52665] DAMAGECOUNT value on done: 509986.0 [2024-08-06 04:19:36,714][52665] Sum rewards: 81.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.126', 'weapon4': '0.154', 'AMMO4': '0.177', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:36,925][52660] DAMAGECOUNT value on done: 503385.0 [2024-08-06 04:19:36,926][52660] Sum rewards: 73.411, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.790', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon2': '0.126', 'AMMO3': '0.130', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.532', 'WEAPON3': '0.850', 'weapon3': '2.970', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '58.000'} [2024-08-06 04:19:37,271][52664] DAMAGECOUNT value on done: 526161.0 [2024-08-06 04:19:37,271][52664] Sum rewards: 63.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.894', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.148', 'AMMO3': '0.202', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '54.000'} [2024-08-06 04:19:37,343][52811] DAMAGECOUNT value on done: 472764.0 [2024-08-06 04:19:37,343][52811] Sum rewards: 67.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.959', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.104', 'weapon5': '0.128', 'AMMO4': '0.155', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:37,411][52671] DAMAGECOUNT value on done: 514040.0 [2024-08-06 04:19:37,415][52671] Sum rewards: 73.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.166', 'AMMO3': '0.193', 'AMMO4': '0.228', 'weapon2': '0.264', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 430882816. Throughput: 0: 4373.1. Samples: 107723590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:19:37,795][52567] Avg episode reward: [(0, '73.658')] [2024-08-06 04:19:38,055][52658] DAMAGECOUNT value on done: 507407.0 [2024-08-06 04:19:38,063][52658] Sum rewards: 58.148, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.839', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.166', 'weapon2': '0.204', 'weapon5': '0.214', 'AMMO4': '0.249', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.106', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '50.000'} [2024-08-06 04:19:38,531][52803] DAMAGECOUNT value on done: 472504.0 [2024-08-06 04:19:38,532][52803] Sum rewards: 61.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.636', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.134', 'AMMO4': '0.166', 'weapon5': '0.182', 'weapon2': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.860', 'weapon3': '3.122', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:38,967][52662] DAMAGECOUNT value on done: 509060.0 [2024-08-06 04:19:38,969][52662] Sum rewards: 66.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.030', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.224', 'weapon4': '0.246', 'AMMO4': '0.266', 'weapon5': '0.266', 'weapon2': '0.370', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:39,073][52647] DAMAGECOUNT value on done: 532285.0 [2024-08-06 04:19:39,073][52647] Sum rewards: 61.847, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.870', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.072', 'AMMO4': '0.104', 'weapon5': '0.126', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '2.760', 'weapon3': '3.374', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '49.000'} [2024-08-06 04:19:39,378][52650] Updated weights for policy 0, policy_version 52601 (0.0015) [2024-08-06 04:19:39,400][52668] DAMAGECOUNT value on done: 506171.0 [2024-08-06 04:19:39,400][52668] Sum rewards: 66.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.756', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.151', 'weapon4': '0.208', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '55.500'} [2024-08-06 04:19:39,556][52664] DAMAGECOUNT value on done: 530068.0 [2024-08-06 04:19:39,558][52664] Sum rewards: 64.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.968', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.082', 'AMMO4': '0.214', 'weapon5': '0.252', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:39,696][52665] DAMAGECOUNT value on done: 504213.0 [2024-08-06 04:19:39,696][52665] Sum rewards: 52.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.171', 'weapon5': '0.188', 'AMMO4': '0.212', 'weapon4': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.462', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '13.800', 'FRAGCOUNT': '46.000'} [2024-08-06 04:19:39,892][52660] DAMAGECOUNT value on done: 512395.0 [2024-08-06 04:19:39,893][52660] Sum rewards: 80.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.120', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO4': '0.172', 'weapon5': '0.218', 'AMMO3': '0.238', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:40,448][52811] DAMAGECOUNT value on done: 472588.0 [2024-08-06 04:19:40,449][52811] Sum rewards: 81.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.884', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.175', 'weapon2': '0.218', 'AMMO4': '0.246', 'weapon5': '0.302', 'weapon4': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.828', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:40,684][52671] DAMAGECOUNT value on done: 510418.0 [2024-08-06 04:19:40,684][52671] Sum rewards: 69.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.098', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 04:19:41,079][52658] DAMAGECOUNT value on done: 505145.0 [2024-08-06 04:19:41,080][52658] Sum rewards: 62.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.163', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.254', 'weapon5': '0.278', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '2.624', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '53.000'} [2024-08-06 04:19:41,551][52662] DAMAGECOUNT value on done: 505726.0 [2024-08-06 04:19:41,553][52662] Sum rewards: 77.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.675', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.100', 'AMMO4': '0.215', 'weapon5': '0.224', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.400', 'weapon3': '2.724', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '64.000'} [2024-08-06 04:19:41,705][52803] DAMAGECOUNT value on done: 463849.0 [2024-08-06 04:19:41,708][52803] Sum rewards: 72.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'AMMO5': '0.011', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon5': '0.212', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:41,953][52647] DAMAGECOUNT value on done: 534575.0 [2024-08-06 04:19:41,955][52647] Sum rewards: 58.275, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.280', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon5': '0.168', 'AMMO3': '0.259', 'AMMO4': '0.298', 'weapon4': '0.306', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.616', 'WEAPON3': '1.500', 'weapon3': '2.566', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2024-08-06 04:19:42,285][52668] DAMAGECOUNT value on done: 509266.0 [2024-08-06 04:19:42,285][52668] Sum rewards: 68.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '1.062', 'WEAPON3': '1.200', 'weapon3': '2.630', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:42,473][52665] DAMAGECOUNT value on done: 500545.0 [2024-08-06 04:19:42,473][52665] Sum rewards: 67.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.764', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.140', 'AMMO4': '0.206', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:42,628][52664] DAMAGECOUNT value on done: 531964.0 [2024-08-06 04:19:42,630][52664] Sum rewards: 78.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.938', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.112', 'AMMO3': '0.198', 'AMMO4': '0.217', 'weapon5': '0.262', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 430964736. Throughput: 0: 4378.0. Samples: 107749800. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:19:42,795][52567] Avg episode reward: [(0, '72.613')] [2024-08-06 04:19:42,946][52660] DAMAGECOUNT value on done: 507055.0 [2024-08-06 04:19:42,947][52660] Sum rewards: 76.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.512', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.183', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 04:19:43,502][52658] DAMAGECOUNT value on done: 497842.0 [2024-08-06 04:19:43,510][52671] DAMAGECOUNT value on done: 507110.0 [2024-08-06 04:19:43,511][52658] Sum rewards: 59.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.013', 'AMMO5': '0.005', 'AMMO2': '0.029', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.120', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.163', 'weapon7': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.736', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '49.000'} [2024-08-06 04:19:43,512][52671] Sum rewards: 74.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.597', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.230', 'WEAPON3': '1.350', 'weapon3': '3.470', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:43,574][52811] DAMAGECOUNT value on done: 474045.0 [2024-08-06 04:19:43,574][52811] Sum rewards: 61.937, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.318', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.122', 'weapon4': '0.168', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.300', 'AMMO3': '0.320', 'WEAPON3': '1.750', 'HITCOUNT': '3.070', 'weapon3': '3.108', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:43,798][52650] Updated weights for policy 0, policy_version 52611 (0.0012) [2024-08-06 04:19:44,227][52662] DAMAGECOUNT value on done: 513877.0 [2024-08-06 04:19:44,227][52662] Sum rewards: 57.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.604', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.101', 'weapon5': '0.110', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.742', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.715', 'FRAGCOUNT': '47.000'} [2024-08-06 04:19:44,838][52803] DAMAGECOUNT value on done: 480106.0 [2024-08-06 04:19:44,842][52803] Sum rewards: 66.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.110', 'AMMO4': '0.151', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:45,179][52665] DAMAGECOUNT value on done: 491885.0 [2024-08-06 04:19:45,180][52665] Sum rewards: 75.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-5.225', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.120', 'AMMO4': '0.171', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON3': '1.900', 'weapon3': '3.368', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:45,218][52647] DAMAGECOUNT value on done: 526309.0 [2024-08-06 04:19:45,219][52647] Sum rewards: 66.224, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.818', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon2': '0.218', 'weapon5': '0.246', 'AMMO4': '0.267', 'AMMO3': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.850', 'weapon3': '2.752', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '58.000'} [2024-08-06 04:19:45,389][52668] DAMAGECOUNT value on done: 506751.0 [2024-08-06 04:19:45,390][52668] Sum rewards: 86.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.038', 'weapon4': '0.090', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.420', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '72.000'} [2024-08-06 04:19:45,835][52664] DAMAGECOUNT value on done: 521732.0 [2024-08-06 04:19:45,835][52664] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.264', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO3': '0.136', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.814', 'WEAPON3': '0.900', 'weapon3': '2.600', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '50.500'} [2024-08-06 04:19:45,895][52660] DAMAGECOUNT value on done: 505981.0 [2024-08-06 04:19:45,896][52660] Sum rewards: 75.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon4': '0.206', 'AMMO3': '0.230', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '62.000'} [2024-08-06 04:19:46,157][52658] DAMAGECOUNT value on done: 514950.0 [2024-08-06 04:19:46,160][52658] Sum rewards: 60.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.715', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'weapon4': '0.094', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '51.000'} [2024-08-06 04:19:46,635][52811] DAMAGECOUNT value on done: 468884.0 [2024-08-06 04:19:46,635][52811] Sum rewards: 67.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.984', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.116', 'weapon4': '0.136', 'AMMO4': '0.191', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:46,865][52662] DAMAGECOUNT value on done: 508903.0 [2024-08-06 04:19:46,867][52662] Sum rewards: 83.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.212', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '70.000'} [2024-08-06 04:19:47,600][52665] DAMAGECOUNT value on done: 497866.0 [2024-08-06 04:19:47,600][52665] Sum rewards: 70.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 431054848. Throughput: 0: 4378.0. Samples: 107762940. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 04:19:47,794][52567] Avg episode reward: [(0, '71.933')] [2024-08-06 04:19:47,933][52803] DAMAGECOUNT value on done: 475477.0 [2024-08-06 04:19:47,933][52803] Sum rewards: 76.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon5': '0.056', 'weapon4': '0.158', 'AMMO4': '0.167', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '64.000'} [2024-08-06 04:19:48,339][52647] DAMAGECOUNT value on done: 539561.0 [2024-08-06 04:19:48,339][52647] Sum rewards: 77.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.588', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.175', 'weapon5': '0.182', 'AMMO4': '0.216', 'weapon2': '0.298', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:48,405][52668] DAMAGECOUNT value on done: 510147.0 [2024-08-06 04:19:48,407][52668] Sum rewards: 76.060, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.158', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.120', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.412', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:48,557][52650] Updated weights for policy 0, policy_version 52621 (0.0010) [2024-08-06 04:19:48,883][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:19:48,961][52660] DAMAGECOUNT value on done: 512584.0 [2024-08-06 04:19:48,961][52660] Sum rewards: 69.299, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.355', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.133', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'weapon5': '0.262', 'weapon2': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.590', 'WEAPON3': '0.900', 'weapon3': '2.646', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '53.000'} [2024-08-06 04:19:48,962][52664] DAMAGECOUNT value on done: 528532.0 [2024-08-06 04:19:48,963][52664] Sum rewards: 77.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.234', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.110', 'AMMO4': '0.182', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:49,503][52658] DAMAGECOUNT value on done: 507224.0 [2024-08-06 04:19:49,504][52658] Sum rewards: 82.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.552', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.222', 'weapon5': '0.228', 'AMMO4': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '68.000'} [2024-08-06 04:19:49,548][52662] DAMAGECOUNT value on done: 517009.0 [2024-08-06 04:19:49,549][52662] Sum rewards: 73.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.486', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.100', 'weapon2': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.612', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '62.000'} [2024-08-06 04:19:49,650][52811] DAMAGECOUNT value on done: 474460.0 [2024-08-06 04:19:49,651][52811] Sum rewards: 68.474, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.114', 'AMMO4': '0.219', 'AMMO3': '0.259', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.282', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:50,373][52665] DAMAGECOUNT value on done: 501870.0 [2024-08-06 04:19:50,374][52665] Sum rewards: 74.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.015', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.086', 'weapon4': '0.120', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '61.500'} [2024-08-06 04:19:51,030][52803] DAMAGECOUNT value on done: 469668.0 [2024-08-06 04:19:51,033][52803] Sum rewards: 73.771, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.658', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.100', 'AMMO4': '0.119', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:51,507][52668] DAMAGECOUNT value on done: 508293.0 [2024-08-06 04:19:51,508][52668] Sum rewards: 83.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon4': '0.314', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '68.500'} [2024-08-06 04:19:51,549][52647] DAMAGECOUNT value on done: 530855.0 [2024-08-06 04:19:51,550][52647] Sum rewards: 76.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'weapon2': '0.142', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'HITCOUNT': '3.320', 'weapon3': '3.622', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '66.000'} [2024-08-06 04:19:52,021][52660] DAMAGECOUNT value on done: 498858.0 [2024-08-06 04:19:52,025][52660] Sum rewards: 71.347, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.076', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '60.000'} [2024-08-06 04:19:52,031][52662] DAMAGECOUNT value on done: 511873.0 [2024-08-06 04:19:52,033][52662] Sum rewards: 80.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.531', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon2': '0.184', 'AMMO3': '0.195', 'WEAPON3': '1.250', 'weapon3': '3.584', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:52,176][52664] DAMAGECOUNT value on done: 526025.0 [2024-08-06 04:19:52,177][52664] Sum rewards: 75.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.659', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.218', 'AMMO3': '0.239', 'AMMO4': '0.272', 'weapon2': '0.320', 'weapon5': '0.342', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.752', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '64.000'} [2024-08-06 04:19:52,708][52811] DAMAGECOUNT value on done: 476651.0 [2024-08-06 04:19:52,709][52811] Sum rewards: 69.520, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.346', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.190', 'weapon5': '0.192', 'AMMO4': '0.242', 'weapon2': '0.338', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.680', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 431144960. Throughput: 0: 4384.0. Samples: 107789350. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:19:52,794][52567] Avg episode reward: [(0, '72.158')] [2024-08-06 04:19:52,796][52658] DAMAGECOUNT value on done: 509295.0 [2024-08-06 04:19:52,799][52658] Sum rewards: 67.032, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO5': '0.014', 'AMMO2': '0.060', 'AMMO3': '0.131', 'weapon7': '0.156', 'weapon5': '0.176', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.302', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.602', 'WEAPON3': '0.850', 'weapon3': '2.368', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '53.000'} [2024-08-06 04:19:53,226][52650] Updated weights for policy 0, policy_version 52631 (0.0043) [2024-08-06 04:19:53,323][52665] DAMAGECOUNT value on done: 503280.0 [2024-08-06 04:19:53,325][52665] Sum rewards: 71.574, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.852', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.165', 'weapon5': '0.174', 'AMMO4': '0.182', 'weapon4': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:54,177][52803] DAMAGECOUNT value on done: 478214.0 [2024-08-06 04:19:54,180][52803] Sum rewards: 74.913, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.535', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon5': '0.134', 'weapon4': '0.156', 'weapon2': '0.258', 'AMMO3': '0.278', 'AMMO4': '0.287', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.110', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '65.000'} [2024-08-06 04:19:54,668][52662] DAMAGECOUNT value on done: 503920.0 [2024-08-06 04:19:54,669][52662] Sum rewards: 76.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.359', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.242', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '63.000'} [2024-08-06 04:19:54,709][52647] DAMAGECOUNT value on done: 540652.0 [2024-08-06 04:19:54,709][52647] Sum rewards: 73.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.778', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.019', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.220', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:55,220][52660] DAMAGECOUNT value on done: 506271.0 [2024-08-06 04:19:55,220][52660] Sum rewards: 62.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.436', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.126', 'weapon4': '0.170', 'AMMO4': '0.207', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:55,378][52664] DAMAGECOUNT value on done: 524451.0 [2024-08-06 04:19:55,379][52664] Sum rewards: 68.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.008', 'ARMOR': '0.008', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.146', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '56.000'} [2024-08-06 04:19:55,666][52665] DAMAGECOUNT value on done: 509425.0 [2024-08-06 04:19:55,667][52665] Sum rewards: 76.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.032', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon4': '0.282', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '64.000'} [2024-08-06 04:19:55,727][52811] DAMAGECOUNT value on done: 470722.0 [2024-08-06 04:19:55,727][52811] Sum rewards: 70.446, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.638', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.045', 'weapon5': '0.204', 'AMMO4': '0.227', 'AMMO3': '0.271', 'weapon4': '0.282', 'weapon2': '0.344', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.828', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:55,845][52658] DAMAGECOUNT value on done: 512987.0 [2024-08-06 04:19:55,846][52658] Sum rewards: 57.738, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.961', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.135', 'weapon4': '0.170', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '3.050', 'DAMAGECOUNT': '13.701', 'FRAGCOUNT': '48.000'} [2024-08-06 04:19:57,354][52803] DAMAGECOUNT value on done: 473273.0 [2024-08-06 04:19:57,355][52803] Sum rewards: 81.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.470', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '69.000'} [2024-08-06 04:19:57,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 431226880. Throughput: 0: 4376.2. Samples: 107815310. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:19:57,795][52567] Avg episode reward: [(0, '71.871')] [2024-08-06 04:19:57,872][52647] DAMAGECOUNT value on done: 532649.0 [2024-08-06 04:19:57,873][52647] Sum rewards: 62.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.701', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.072', 'AMMO4': '0.074', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.570', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.084', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '49.000'} [2024-08-06 04:19:57,874][52662] DAMAGECOUNT value on done: 509848.0 [2024-08-06 04:19:57,877][52662] Sum rewards: 73.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.150', 'HITCOUNT': '3.490', 'weapon3': '3.498', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '61.000'} [2024-08-06 04:19:57,997][52660] DAMAGECOUNT value on done: 516352.0 [2024-08-06 04:19:57,997][52660] Sum rewards: 64.210, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.875', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.178', 'AMMO4': '0.189', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.052', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '55.000'} [2024-08-06 04:19:58,117][52650] Updated weights for policy 0, policy_version 52641 (0.0020) [2024-08-06 04:19:58,198][52665] DAMAGECOUNT value on done: 499630.0 [2024-08-06 04:19:58,198][52665] Sum rewards: 69.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.072', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.160', 'AMMO3': '0.184', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '57.000'} [2024-08-06 04:19:58,518][52664] DAMAGECOUNT value on done: 521168.0 [2024-08-06 04:19:58,518][52664] Sum rewards: 83.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.064', 'weapon5': '0.134', 'AMMO4': '0.137', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '67.000'} [2024-08-06 04:19:58,640][52811] DAMAGECOUNT value on done: 473841.0 [2024-08-06 04:19:58,642][52811] Sum rewards: 78.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.872', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.434', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '65.000'} [2024-08-06 04:20:00,468][52662] DAMAGECOUNT value on done: 503310.0 [2024-08-06 04:20:00,469][52662] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'weapon5': '0.040', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '60.500'} [2024-08-06 04:20:00,518][52803] DAMAGECOUNT value on done: 470399.0 [2024-08-06 04:20:00,518][52803] Sum rewards: 84.936, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.096', 'AMMO3': '0.138', 'weapon4': '0.162', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'weapon3': '3.466', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '68.000'} [2024-08-06 04:20:00,683][52647] DAMAGECOUNT value on done: 523715.0 [2024-08-06 04:20:00,685][52647] Sum rewards: 63.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.545', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.122', 'AMMO4': '0.169', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '53.500'} [2024-08-06 04:20:00,700][52660] DAMAGECOUNT value on done: 520315.0 [2024-08-06 04:20:00,704][52660] Sum rewards: 85.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.756', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.050', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '71.000'} [2024-08-06 04:20:01,164][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:20:01,171][52665] DAMAGECOUNT value on done: 510122.0 [2024-08-06 04:20:01,172][52665] Sum rewards: 67.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.994', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon4': '0.066', 'AMMO4': '0.073', 'weapon5': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.198', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '57.000'} [2024-08-06 04:20:01,217][52664] DAMAGECOUNT value on done: 532068.0 [2024-08-06 04:20:01,218][52664] Sum rewards: 69.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.465', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.120', 'weapon4': '0.138', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '59.000'} [2024-08-06 04:20:02,651][52650] Updated weights for policy 0, policy_version 52651 (0.0014) [2024-08-06 04:20:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 431316992. Throughput: 0: 4376.9. Samples: 107828580. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:20:02,794][52567] Avg episode reward: [(0, '71.712')] [2024-08-06 04:20:02,893][52794] DAMAGECOUNT value on done: 511460.0 [2024-08-06 04:20:02,893][52794] Sum rewards: 72.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.319', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.223', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.520', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:03,354][52647] DAMAGECOUNT value on done: 532874.0 [2024-08-06 04:20:03,355][52647] Sum rewards: 70.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.193', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.536', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:03,636][52803] DAMAGECOUNT value on done: 476938.0 [2024-08-06 04:20:03,637][52803] Sum rewards: 81.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.138', 'AMMO4': '0.159', 'weapon5': '0.164', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '67.000'} [2024-08-06 04:20:03,646][52659] DAMAGECOUNT value on done: 513012.0 [2024-08-06 04:20:03,648][52659] Sum rewards: 85.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.714', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.056', 'AMMO4': '0.092', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.494', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '69.000'} [2024-08-06 04:20:03,977][52660] DAMAGECOUNT value on done: 502537.0 [2024-08-06 04:20:03,979][52660] Sum rewards: 72.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.470', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon2': '0.130', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'HITCOUNT': '3.640', 'weapon3': '3.740', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '63.000'} [2024-08-06 04:20:04,064][52664] DAMAGECOUNT value on done: 524543.0 [2024-08-06 04:20:04,065][52664] Sum rewards: 78.761, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.325', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.240', 'AMMO3': '0.298', 'WEAPON3': '1.750', 'weapon3': '3.418', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '67.000'} [2024-08-06 04:20:04,339][52665] DAMAGECOUNT value on done: 506776.0 [2024-08-06 04:20:04,348][52665] Sum rewards: 69.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO3': '0.193', 'AMMO4': '0.193', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '57.000'} [2024-08-06 04:20:05,349][52794] DAMAGECOUNT value on done: 513136.0 [2024-08-06 04:20:05,350][52794] Sum rewards: 74.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.730', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.173', 'AMMO4': '0.213', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:06,021][52647] DAMAGECOUNT value on done: 528135.0 [2024-08-06 04:20:06,021][52647] Sum rewards: 67.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.029', 'AMMO2': '0.059', 'AMMO3': '0.206', 'AMMO4': '0.295', 'weapon5': '0.322', 'weapon4': '0.368', 'weapon2': '0.480', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.330', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '55.500'} [2024-08-06 04:20:06,684][52664] DAMAGECOUNT value on done: 533335.0 [2024-08-06 04:20:06,685][52664] Sum rewards: 74.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.566', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.138', 'weapon4': '0.160', 'AMMO4': '0.233', 'weapon2': '0.272', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '3.110', 'weapon3': '3.144', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '65.000'} [2024-08-06 04:20:06,752][52659] DAMAGECOUNT value on done: 508212.0 [2024-08-06 04:20:06,755][52659] Sum rewards: 68.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.462', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.144', 'AMMO3': '0.155', 'AMMO4': '0.167', 'weapon5': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '2.924', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '54.500'} [2024-08-06 04:20:06,771][52803] DAMAGECOUNT value on done: 475961.0 [2024-08-06 04:20:06,772][52803] Sum rewards: 72.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.154', 'AMMO4': '0.170', 'AMMO3': '0.221', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:07,176][52660] DAMAGECOUNT value on done: 511658.0 [2024-08-06 04:20:07,176][52660] Sum rewards: 78.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.128', 'weapon5': '0.136', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 04:20:07,430][52650] Updated weights for policy 0, policy_version 52661 (0.0030) [2024-08-06 04:20:07,545][52665] DAMAGECOUNT value on done: 502622.0 [2024-08-06 04:20:07,546][52665] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.287', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.422', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '64.000'} [2024-08-06 04:20:07,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 431407104. Throughput: 0: 4368.9. Samples: 107854460. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:20:07,794][52567] Avg episode reward: [(0, '71.519')] [2024-08-06 04:20:08,109][52794] DAMAGECOUNT value on done: 513750.0 [2024-08-06 04:20:08,113][52794] Sum rewards: 84.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.965', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.031', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.240', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '70.000'} [2024-08-06 04:20:08,865][52647] DAMAGECOUNT value on done: 528211.0 [2024-08-06 04:20:08,868][52647] Sum rewards: 78.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.085', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.086', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '66.000'} [2024-08-06 04:20:09,577][52659] DAMAGECOUNT value on done: 512337.0 [2024-08-06 04:20:09,577][52659] Sum rewards: 79.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.355', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon4': '0.124', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '66.000'} [2024-08-06 04:20:09,635][52664] DAMAGECOUNT value on done: 530276.0 [2024-08-06 04:20:09,636][52664] Sum rewards: 75.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.236', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '63.000'} [2024-08-06 04:20:09,794][52803] DAMAGECOUNT value on done: 477093.0 [2024-08-06 04:20:09,797][52803] Sum rewards: 65.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.067', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.134', 'weapon4': '0.220', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '2.926', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '57.000'} [2024-08-06 04:20:10,178][52660] DAMAGECOUNT value on done: 503992.0 [2024-08-06 04:20:10,180][52660] Sum rewards: 63.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.208', 'AMMO4': '0.218', 'weapon2': '0.236', 'weapon5': '0.262', 'weapon4': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '51.000'} [2024-08-06 04:20:10,636][52665] DAMAGECOUNT value on done: 502255.0 [2024-08-06 04:20:10,636][52665] Sum rewards: 80.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.123', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.564', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '67.500'} [2024-08-06 04:20:11,060][52794] DAMAGECOUNT value on done: 507513.0 [2024-08-06 04:20:11,061][52794] Sum rewards: 82.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.211', 'weapon4': '0.226', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.264', 'FRAGCOUNT': '66.000'} [2024-08-06 04:20:12,099][52650] Updated weights for policy 0, policy_version 52671 (0.0011) [2024-08-06 04:20:12,154][52664] DAMAGECOUNT value on done: 537992.0 [2024-08-06 04:20:12,154][52664] Sum rewards: 76.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.134', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.102', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '1.050', 'weapon3': '3.416', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2024-08-06 04:20:12,375][52659] DAMAGECOUNT value on done: 509128.0 [2024-08-06 04:20:12,375][52659] Sum rewards: 79.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.432', 'AMMO5': '0.025', 'AMMO2': '0.065', 'weapon2': '0.210', 'AMMO3': '0.242', 'AMMO4': '0.323', 'weapon5': '0.326', 'weapon4': '0.400', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.740', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '65.000'} [2024-08-06 04:20:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 431497216. Throughput: 0: 4370.7. Samples: 107880890. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:20:12,794][52567] Avg episode reward: [(0, '72.234')] [2024-08-06 04:20:12,797][52803] DAMAGECOUNT value on done: 468570.0 [2024-08-06 04:20:12,799][52803] Sum rewards: 74.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.984', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.150', 'weapon5': '0.152', 'weapon2': '0.158', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.398', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 04:20:13,346][52660] DAMAGECOUNT value on done: 505921.0 [2024-08-06 04:20:13,347][52660] Sum rewards: 70.349, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.094', 'AMMO4': '0.141', 'AMMO3': '0.148', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.000', 'HITCOUNT': '3.240', 'weapon3': '3.248', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '55.000'} [2024-08-06 04:20:13,583][52794] DAMAGECOUNT value on done: 506333.0 [2024-08-06 04:20:13,584][52794] Sum rewards: 60.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.030', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.144', 'weapon2': '0.206', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '51.000'} [2024-08-06 04:20:13,718][52665] DAMAGECOUNT value on done: 500547.0 [2024-08-06 04:20:13,718][52665] Sum rewards: 65.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.189', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.146', 'AMMO4': '0.178', 'weapon5': '0.194', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '55.000'} [2024-08-06 04:20:14,910][52664] DAMAGECOUNT value on done: 533127.0 [2024-08-06 04:20:14,918][52664] Sum rewards: 76.123, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.172', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.203', 'weapon5': '0.230', 'weapon2': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '61.000'} [2024-08-06 04:20:15,154][52659] DAMAGECOUNT value on done: 505850.0 [2024-08-06 04:20:15,155][52659] Sum rewards: 67.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.092', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon4': '0.118', 'weapon5': '0.172', 'AMMO3': '0.236', 'AMMO4': '0.277', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.654', 'WEAPON3': '1.400', 'weapon3': '2.792', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '58.000'} [2024-08-06 04:20:16,276][52660] DAMAGECOUNT value on done: 497869.0 [2024-08-06 04:20:16,277][52660] Sum rewards: 71.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.102', 'weapon4': '0.154', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.534', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '60.500'} [2024-08-06 04:20:16,694][52665] DAMAGECOUNT value on done: 497977.0 [2024-08-06 04:20:16,696][52665] Sum rewards: 86.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.239', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.520', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '73.000'} [2024-08-06 04:20:16,880][52794] DAMAGECOUNT value on done: 506618.0 [2024-08-06 04:20:16,881][52794] Sum rewards: 67.172, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.300', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon4': '0.112', 'AMMO3': '0.153', 'AMMO4': '0.235', 'weapon5': '0.242', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.106', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '53.000'} [2024-08-06 04:20:17,028][52650] Updated weights for policy 0, policy_version 52681 (0.0040) [2024-08-06 04:20:17,449][52659] DAMAGECOUNT value on done: 508501.0 [2024-08-06 04:20:17,449][52659] Sum rewards: 67.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.806', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.210', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.216', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '56.000'} [2024-08-06 04:20:17,506][52664] DAMAGECOUNT value on done: 533808.0 [2024-08-06 04:20:17,508][52664] Sum rewards: 83.659, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.082', 'HEALTH': '0.092', 'weapon5': '0.170', 'AMMO4': '0.176', 'AMMO3': '0.222', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.294', 'FRAGCOUNT': '69.000'} [2024-08-06 04:20:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 431570944. Throughput: 0: 4369.8. Samples: 107894230. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:20:17,794][52567] Avg episode reward: [(0, '72.760')] [2024-08-06 04:20:19,772][52665] DAMAGECOUNT value on done: 501633.0 [2024-08-06 04:20:19,775][52665] Sum rewards: 68.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.700', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon4': '0.100', 'weapon5': '0.238', 'AMMO3': '0.281', 'AMMO4': '0.316', 'weapon2': '0.332', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.062', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '59.000'} [2024-08-06 04:20:20,150][52794] DAMAGECOUNT value on done: 514693.0 [2024-08-06 04:20:20,158][52794] Sum rewards: 72.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.554', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.056', 'weapon4': '0.072', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '59.000'} [2024-08-06 04:20:20,323][52664] DAMAGECOUNT value on done: 526951.0 [2024-08-06 04:20:20,326][52664] Sum rewards: 70.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon2': '0.192', 'weapon4': '0.218', 'AMMO3': '0.221', 'weapon5': '0.248', 'AMMO4': '0.291', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '58.000'} [2024-08-06 04:20:20,509][52659] DAMAGECOUNT value on done: 507868.0 [2024-08-06 04:20:20,513][52659] Sum rewards: 70.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.120', 'AMMO4': '0.173', 'weapon5': '0.206', 'AMMO3': '0.241', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '59.500'} [2024-08-06 04:20:21,372][52650] Updated weights for policy 0, policy_version 52691 (0.0013) [2024-08-06 04:20:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 431669248. Throughput: 0: 4374.5. Samples: 107920440. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:20:22,794][52567] Avg episode reward: [(0, '72.736')] [2024-08-06 04:20:22,898][52665] DAMAGECOUNT value on done: 498174.0 [2024-08-06 04:20:22,899][52665] Sum rewards: 76.764, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.214', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.162', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'weapon4': '0.374', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:22,981][52794] DAMAGECOUNT value on done: 502750.0 [2024-08-06 04:20:22,982][52794] Sum rewards: 72.126, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.065', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.271', 'weapon2': '0.424', 'WEAPON3': '1.700', 'weapon3': '3.218', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '63.000'} [2024-08-06 04:20:23,257][52659] DAMAGECOUNT value on done: 508404.0 [2024-08-06 04:20:23,258][52659] Sum rewards: 73.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.000'} [2024-08-06 04:20:23,357][52664] DAMAGECOUNT value on done: 524411.0 [2024-08-06 04:20:23,357][52664] Sum rewards: 73.696, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:25,620][52794] DAMAGECOUNT value on done: 513555.0 [2024-08-06 04:20:25,620][52794] Sum rewards: 78.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.160', 'AMMO3': '0.191', 'weapon2': '0.212', 'weapon4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '64.000'} [2024-08-06 04:20:25,716][52665] DAMAGECOUNT value on done: 501813.0 [2024-08-06 04:20:25,717][52665] Sum rewards: 80.164, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.172', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.239', 'AMMO4': '0.241', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '70.000'} [2024-08-06 04:20:26,118][52664] DAMAGECOUNT value on done: 529284.0 [2024-08-06 04:20:26,118][52664] Sum rewards: 70.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.190', 'weapon5': '0.190', 'weapon4': '0.216', 'AMMO4': '0.264', 'WEAPON5': '0.450', 'weapon2': '0.518', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.000'} [2024-08-06 04:20:26,261][52650] Updated weights for policy 0, policy_version 52701 (0.0021) [2024-08-06 04:20:26,336][52659] DAMAGECOUNT value on done: 514955.0 [2024-08-06 04:20:26,337][52659] Sum rewards: 72.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.041', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.155', 'AMMO3': '0.203', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '61.000'} [2024-08-06 04:20:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 431751168. Throughput: 0: 4360.2. Samples: 107946010. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:20:27,802][52567] Avg episode reward: [(0, '73.086')] [2024-08-06 04:20:27,894][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052705_431759360.pth... [2024-08-06 04:20:28,025][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052192_427556864.pth [2024-08-06 04:20:28,467][52794] DAMAGECOUNT value on done: 510031.0 [2024-08-06 04:20:28,467][52794] Sum rewards: 73.844, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.564', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.056', 'weapon4': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '3.164', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:28,749][52665] DAMAGECOUNT value on done: 502953.0 [2024-08-06 04:20:28,749][52665] Sum rewards: 73.380, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.714', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.101', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '62.000'} [2024-08-06 04:20:29,113][52664] DAMAGECOUNT value on done: 526420.0 [2024-08-06 04:20:29,114][52664] Sum rewards: 81.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '66.000'} [2024-08-06 04:20:29,415][52659] DAMAGECOUNT value on done: 518171.0 [2024-08-06 04:20:29,415][52659] Sum rewards: 60.874, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.248', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.198', 'AMMO3': '0.256', 'AMMO4': '0.263', 'weapon4': '0.278', 'weapon2': '0.412', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.800', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.000'} [2024-08-06 04:20:30,915][52650] Updated weights for policy 0, policy_version 52711 (0.0015) [2024-08-06 04:20:31,230][52795] DAMAGECOUNT value on done: 472069.0 [2024-08-06 04:20:31,230][52795] Sum rewards: 67.176, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.658', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.185', 'weapon2': '0.520', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '54.000'} [2024-08-06 04:20:31,360][52794] DAMAGECOUNT value on done: 504604.0 [2024-08-06 04:20:31,361][52794] Sum rewards: 74.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.124', 'weapon4': '0.134', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '63.000'} [2024-08-06 04:20:32,014][52664] DAMAGECOUNT value on done: 525124.0 [2024-08-06 04:20:32,015][52664] Sum rewards: 79.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.074', 'AMMO4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '65.000'} [2024-08-06 04:20:32,035][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:20:32,260][52659] DAMAGECOUNT value on done: 506474.0 [2024-08-06 04:20:32,262][52659] Sum rewards: 77.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.760', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.060', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.332', 'WEAPON3': '1.650', 'weapon3': '3.278', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '68.000'} [2024-08-06 04:20:32,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 431833088. Throughput: 0: 4356.9. Samples: 107959000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:20:32,795][52567] Avg episode reward: [(0, '73.465')] [2024-08-06 04:20:34,419][52795] DAMAGECOUNT value on done: 461469.0 [2024-08-06 04:20:34,419][52795] Sum rewards: 80.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.207', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.066', 'weapon5': '0.126', 'AMMO3': '0.176', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.000', 'weapon3': '3.306', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '65.000'} [2024-08-06 04:20:34,537][52794] DAMAGECOUNT value on done: 511358.0 [2024-08-06 04:20:34,540][52794] Sum rewards: 33.443, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.168', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.106', 'weapon2': '0.116', 'WEAPON3': '0.700', 'weapon7': '0.772', 'weapon4': '1.096', 'weapon3': '1.414', 'HITCOUNT': '1.590', 'DAMAGECOUNT': '8.235', 'FRAGCOUNT': '26.000'} [2024-08-06 04:20:34,846][52659] DAMAGECOUNT value on done: 512337.0 [2024-08-06 04:20:34,846][52659] Sum rewards: 77.837, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.956', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.147', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'weapon4': '0.426', 'WEAPON3': '0.950', 'weapon3': '2.812', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 04:20:35,805][52650] Updated weights for policy 0, policy_version 52721 (0.0026) [2024-08-06 04:20:37,035][52794] DAMAGECOUNT value on done: 502693.0 [2024-08-06 04:20:37,037][52794] Sum rewards: 83.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.656', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO4': '0.096', 'weapon4': '0.122', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '3.280', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '68.000'} [2024-08-06 04:20:37,502][52659] DAMAGECOUNT value on done: 503155.0 [2024-08-06 04:20:37,504][52659] Sum rewards: 74.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.948', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.156', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.342', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '2.754', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:37,597][52795] DAMAGECOUNT value on done: 461594.0 [2024-08-06 04:20:37,598][52795] Sum rewards: 67.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.386', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon4': '0.308', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '56.000'} [2024-08-06 04:20:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 431923200. Throughput: 0: 4351.5. Samples: 107985170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:20:37,795][52567] Avg episode reward: [(0, '73.410')] [2024-08-06 04:20:40,064][52794] DAMAGECOUNT value on done: 522175.0 [2024-08-06 04:20:40,064][52794] Sum rewards: 66.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.098', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '55.000'} [2024-08-06 04:20:40,246][52650] Updated weights for policy 0, policy_version 52731 (0.0014) [2024-08-06 04:20:40,411][52659] DAMAGECOUNT value on done: 508927.0 [2024-08-06 04:20:40,413][52659] Sum rewards: 60.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.748', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.216', 'weapon2': '0.226', 'AMMO3': '0.233', 'AMMO4': '0.249', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.672', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '52.000'} [2024-08-06 04:20:40,756][52795] DAMAGECOUNT value on done: 469698.0 [2024-08-06 04:20:40,758][52795] Sum rewards: 76.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.268', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2024-08-06 04:20:41,298][52665] Large shaping reward 2.588 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.537, 179.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:20:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 432013312. Throughput: 0: 4357.6. Samples: 108011400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:20:42,795][52567] Avg episode reward: [(0, '73.131')] [2024-08-06 04:20:43,198][52794] DAMAGECOUNT value on done: 502887.0 [2024-08-06 04:20:43,198][52794] Sum rewards: 79.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.191', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '67.000'} [2024-08-06 04:20:43,658][52659] DAMAGECOUNT value on done: 518967.0 [2024-08-06 04:20:43,659][52659] Sum rewards: 64.694, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.147', 'weapon5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.286', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '57.000'} [2024-08-06 04:20:43,884][52795] DAMAGECOUNT value on done: 464741.0 [2024-08-06 04:20:43,885][52795] Sum rewards: 72.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.755', 'AMMO5': '0.026', 'AMMO2': '0.061', 'AMMO3': '0.193', 'weapon2': '0.236', 'weapon4': '0.286', 'AMMO4': '0.304', 'weapon5': '0.356', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '58.000'} [2024-08-06 04:20:43,986][52649] DAMAGECOUNT value on done: 493733.0 [2024-08-06 04:20:43,987][52649] Sum rewards: 68.132, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.708', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.158', 'AMMO4': '0.163', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.638', 'WEAPON3': '0.950', 'weapon3': '2.730', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '52.000'} [2024-08-06 04:20:44,940][52650] Updated weights for policy 0, policy_version 52741 (0.0038) [2024-08-06 04:20:45,234][52663] DAMAGECOUNT value on done: 517371.0 [2024-08-06 04:20:45,235][52663] Sum rewards: 88.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.004', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.236', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '75.000'} [2024-08-06 04:20:46,232][52794] DAMAGECOUNT value on done: 519691.0 [2024-08-06 04:20:46,233][52794] Sum rewards: 72.584, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.068', 'weapon5': '0.076', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 04:20:46,458][52659] DAMAGECOUNT value on done: 513057.0 [2024-08-06 04:20:46,459][52659] Sum rewards: 62.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.716', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.294', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '54.000'} [2024-08-06 04:20:46,569][52649] DAMAGECOUNT value on done: 485173.0 [2024-08-06 04:20:46,569][52649] Sum rewards: 61.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.014', 'AMMO2': '0.068', 'weapon5': '0.132', 'AMMO3': '0.217', 'weapon4': '0.288', 'AMMO4': '0.340', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '51.000'} [2024-08-06 04:20:47,178][52795] DAMAGECOUNT value on done: 473770.0 [2024-08-06 04:20:47,186][52795] Sum rewards: 65.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.175', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.112', 'AMMO3': '0.168', 'weapon5': '0.176', 'AMMO4': '0.207', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.970', 'weapon3': '3.080', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '53.000'} [2024-08-06 04:20:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 432103424. Throughput: 0: 4354.7. Samples: 108024540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:20:47,794][52567] Avg episode reward: [(0, '72.704')] [2024-08-06 04:20:48,119][52663] DAMAGECOUNT value on done: 509510.0 [2024-08-06 04:20:48,119][52663] Sum rewards: 72.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.160', 'AMMO3': '0.204', 'weapon2': '0.232', 'weapon5': '0.246', 'AMMO4': '0.315', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '62.000'} [2024-08-06 04:20:48,659][52794] DAMAGECOUNT value on done: 508327.0 [2024-08-06 04:20:48,660][52794] Sum rewards: 53.230, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.605', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon4': '0.104', 'weapon5': '0.206', 'AMMO3': '0.238', 'AMMO4': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.400', 'HITCOUNT': '2.620', 'weapon3': '2.992', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '47.000'} [2024-08-06 04:20:48,984][52614] Signal inference workers to stop experience collection... (9600 times) [2024-08-06 04:20:48,985][52614] Signal inference workers to resume experience collection... (9600 times) [2024-08-06 04:20:49,050][52650] InferenceWorker_p0-w0: stopping experience collection (9600 times) [2024-08-06 04:20:49,051][52650] InferenceWorker_p0-w0: resuming experience collection (9600 times) [2024-08-06 04:20:49,290][52659] DAMAGECOUNT value on done: 514449.0 [2024-08-06 04:20:49,292][52659] Sum rewards: 76.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '65.000'} [2024-08-06 04:20:49,481][52650] Updated weights for policy 0, policy_version 52751 (0.0028) [2024-08-06 04:20:49,659][52649] DAMAGECOUNT value on done: 501552.0 [2024-08-06 04:20:49,659][52649] Sum rewards: 71.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.756', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO4': '0.215', 'AMMO3': '0.221', 'weapon5': '0.264', 'weapon4': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '58.500'} [2024-08-06 04:20:50,356][52795] DAMAGECOUNT value on done: 478672.0 [2024-08-06 04:20:50,356][52795] Sum rewards: 74.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.722', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.116', 'AMMO4': '0.149', 'weapon5': '0.172', 'weapon2': '0.190', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '62.500'} [2024-08-06 04:20:51,278][52663] DAMAGECOUNT value on done: 503780.0 [2024-08-06 04:20:51,279][52663] Sum rewards: 71.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.012', 'weapon4': '0.050', 'AMMO2': '0.055', 'weapon5': '0.196', 'AMMO3': '0.215', 'AMMO4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.236', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '58.000'} [2024-08-06 04:20:51,593][52794] DAMAGECOUNT value on done: 517773.0 [2024-08-06 04:20:51,593][52794] Sum rewards: 82.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.518', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.102', 'weapon5': '0.208', 'AMMO4': '0.215', 'weapon2': '0.256', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.090', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.051', 'FRAGCOUNT': '69.000'} [2024-08-06 04:20:52,239][52649] DAMAGECOUNT value on done: 495521.0 [2024-08-06 04:20:52,239][52649] Sum rewards: 73.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.768', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.172', 'AMMO3': '0.216', 'AMMO4': '0.250', 'weapon5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:52,519][52659] DAMAGECOUNT value on done: 509236.0 [2024-08-06 04:20:52,519][52659] Sum rewards: 66.307, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.513', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'AMMO4': '0.246', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '53.000'} [2024-08-06 04:20:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 432193536. Throughput: 0: 4362.7. Samples: 108050780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:20:52,794][52567] Avg episode reward: [(0, '72.504')] [2024-08-06 04:20:53,574][52795] DAMAGECOUNT value on done: 475523.0 [2024-08-06 04:20:53,576][52795] Sum rewards: 74.173, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.965', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.049', 'weapon5': '0.106', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '60.000'} [2024-08-06 04:20:54,481][52650] Updated weights for policy 0, policy_version 52761 (0.0012) [2024-08-06 04:20:54,492][52794] DAMAGECOUNT value on done: 519092.0 [2024-08-06 04:20:54,494][52794] Sum rewards: 72.442, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.896', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.208', 'weapon5': '0.224', 'weapon2': '0.232', 'AMMO3': '0.269', 'AMMO4': '0.299', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '3.016', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '62.000'} [2024-08-06 04:20:54,531][52663] DAMAGECOUNT value on done: 507003.0 [2024-08-06 04:20:54,532][52663] Sum rewards: 66.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.424', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.314', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.418', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '58.000'} [2024-08-06 04:20:54,931][52659] DAMAGECOUNT value on done: 513820.0 [2024-08-06 04:20:54,932][52659] Sum rewards: 76.076, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.895', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.152', 'weapon2': '0.186', 'weapon5': '0.216', 'AMMO4': '0.233', 'AMMO3': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.158', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '66.500'} [2024-08-06 04:20:55,042][52649] DAMAGECOUNT value on done: 486294.0 [2024-08-06 04:20:55,044][52649] Sum rewards: 82.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.814', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.171', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.398', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '66.000'} [2024-08-06 04:20:56,196][52666] DAMAGECOUNT value on done: 507564.0 [2024-08-06 04:20:56,217][52666] Sum rewards: 68.185, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.077', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'AMMO3': '0.114', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON3': '0.750', 'weapon2': '0.850', 'weapon3': '2.826', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '53.000'} [2024-08-06 04:20:56,714][52795] DAMAGECOUNT value on done: 463956.0 [2024-08-06 04:20:56,714][52795] Sum rewards: 75.380, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'weapon5': '0.108', 'HEALTH': '0.126', 'AMMO3': '0.229', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '63.000'} [2024-08-06 04:20:56,955][52794] DAMAGECOUNT value on done: 508599.0 [2024-08-06 04:20:56,956][52794] Sum rewards: 84.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.810', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.096', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.268', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.501', 'FRAGCOUNT': '71.000'} [2024-08-06 04:20:57,506][52663] DAMAGECOUNT value on done: 508316.0 [2024-08-06 04:20:57,506][52663] Sum rewards: 62.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.176', 'weapon5': '0.178', 'AMMO3': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.208', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '50.000'} [2024-08-06 04:20:57,763][52659] DAMAGECOUNT value on done: 510564.0 [2024-08-06 04:20:57,765][52659] Sum rewards: 57.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.378', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.146', 'weapon5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.216', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.000', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '48.000'} [2024-08-06 04:20:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 432275456. Throughput: 0: 4353.8. Samples: 108076810. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:20:57,794][52567] Avg episode reward: [(0, '72.958')] [2024-08-06 04:20:58,253][52649] DAMAGECOUNT value on done: 497855.0 [2024-08-06 04:20:58,253][52649] Sum rewards: 64.389, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO3': '0.160', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'HEALTH': '0.330', 'weapon2': '0.520', 'WEAPON3': '0.900', 'weapon3': '2.854', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.000'} [2024-08-06 04:20:58,619][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:20:59,324][52650] Updated weights for policy 0, policy_version 52771 (0.0027) [2024-08-06 04:20:59,424][52670] DAMAGECOUNT value on done: 499634.0 [2024-08-06 04:20:59,424][52670] Sum rewards: 58.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.363', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.238', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '48.000'} [2024-08-06 04:20:59,442][52666] DAMAGECOUNT value on done: 510346.0 [2024-08-06 04:20:59,443][52666] Sum rewards: 70.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon5': '0.132', 'AMMO4': '0.219', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '57.000'} [2024-08-06 04:20:59,912][52795] DAMAGECOUNT value on done: 476203.0 [2024-08-06 04:20:59,913][52795] Sum rewards: 71.404, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.174', 'weapon5': '0.322', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.608', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '56.000'} [2024-08-06 04:21:00,255][52663] DAMAGECOUNT value on done: 515249.0 [2024-08-06 04:21:00,256][52663] Sum rewards: 78.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.126', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '65.000'} [2024-08-06 04:21:00,949][52649] DAMAGECOUNT value on done: 494528.0 [2024-08-06 04:21:00,950][52649] Sum rewards: 75.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.962', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.106', 'AMMO4': '0.166', 'AMMO3': '0.209', 'weapon5': '0.240', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '61.000'} [2024-08-06 04:21:01,825][52670] DAMAGECOUNT value on done: 510389.0 [2024-08-06 04:21:01,828][52670] Sum rewards: 62.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.604', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.148', 'weapon5': '0.156', 'weapon2': '0.180', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '2.740', 'weapon3': '3.346', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '55.000'} [2024-08-06 04:21:01,861][52666] DAMAGECOUNT value on done: 512896.0 [2024-08-06 04:21:01,863][52666] Sum rewards: 74.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.966', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.106', 'weapon5': '0.168', 'AMMO4': '0.192', 'AMMO3': '0.236', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:02,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 432357376. Throughput: 0: 4349.1. Samples: 108089940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:21:02,796][52567] Avg episode reward: [(0, '72.352')] [2024-08-06 04:21:03,301][52795] DAMAGECOUNT value on done: 470304.0 [2024-08-06 04:21:03,303][52795] Sum rewards: 86.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.044', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.318', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '72.000'} [2024-08-06 04:21:03,451][52663] DAMAGECOUNT value on done: 510559.0 [2024-08-06 04:21:03,451][52663] Sum rewards: 76.644, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.754', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.104', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.258', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.000'} [2024-08-06 04:21:03,881][52650] Updated weights for policy 0, policy_version 52781 (0.0020) [2024-08-06 04:21:04,192][52649] DAMAGECOUNT value on done: 498534.0 [2024-08-06 04:21:04,194][52649] Sum rewards: 61.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.384', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO4': '0.188', 'AMMO3': '0.194', 'weapon4': '0.212', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '52.000'} [2024-08-06 04:21:04,205][52670] DAMAGECOUNT value on done: 503580.0 [2024-08-06 04:21:04,205][52670] Sum rewards: 78.113, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.072', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.264', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '67.000'} [2024-08-06 04:21:04,256][52666] DAMAGECOUNT value on done: 511128.0 [2024-08-06 04:21:04,257][52666] Sum rewards: 72.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.153', 'weapon5': '0.310', 'AMMO4': '0.318', 'weapon2': '0.368', 'weapon4': '0.462', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.538', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '60.000'} [2024-08-06 04:21:06,361][52659] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:21:06,409][52795] DAMAGECOUNT value on done: 467058.0 [2024-08-06 04:21:06,411][52795] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.180', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.130', 'weapon2': '0.178', 'weapon4': '0.194', 'AMMO3': '0.218', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.248', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '52.000'} [2024-08-06 04:21:06,750][52670] DAMAGECOUNT value on done: 502450.0 [2024-08-06 04:21:06,751][52670] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON4': '0.350', 'weapon4': '0.396', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '55.500'} [2024-08-06 04:21:06,767][52649] DAMAGECOUNT value on done: 499706.0 [2024-08-06 04:21:06,768][52649] Sum rewards: 75.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.338', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.068', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:06,832][52666] DAMAGECOUNT value on done: 508560.0 [2024-08-06 04:21:06,835][52666] Sum rewards: 62.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.131', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.070', 'AMMO4': '0.156', 'weapon5': '0.160', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '54.500'} [2024-08-06 04:21:06,855][52820] DAMAGECOUNT value on done: 471175.0 [2024-08-06 04:21:06,856][52820] Sum rewards: 68.464, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.066', 'AMMO4': '0.124', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.464', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '59.000'} [2024-08-06 04:21:07,093][52663] DAMAGECOUNT value on done: 505437.0 [2024-08-06 04:21:07,094][52663] Sum rewards: 81.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.256', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.150', 'weapon5': '0.154', 'weapon2': '0.204', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '67.000'} [2024-08-06 04:21:07,346][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:21:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 432447488. Throughput: 0: 4351.6. Samples: 108116260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:21:07,794][52567] Avg episode reward: [(0, '72.173')] [2024-08-06 04:21:08,122][52650] Updated weights for policy 0, policy_version 52791 (0.0025) [2024-08-06 04:21:09,519][52795] DAMAGECOUNT value on done: 464784.0 [2024-08-06 04:21:09,519][52795] Sum rewards: 76.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.655', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.062', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:09,720][52649] DAMAGECOUNT value on done: 491889.0 [2024-08-06 04:21:09,721][52649] Sum rewards: 63.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.140', 'AMMO4': '0.190', 'AMMO3': '0.238', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.208', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '53.000'} [2024-08-06 04:21:09,732][52670] DAMAGECOUNT value on done: 513775.0 [2024-08-06 04:21:09,732][52670] Sum rewards: 71.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.444', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.428', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '60.000'} [2024-08-06 04:21:09,845][52666] DAMAGECOUNT value on done: 502864.0 [2024-08-06 04:21:09,847][52666] Sum rewards: 67.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.490', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.142', 'AMMO3': '0.183', 'weapon5': '0.214', 'AMMO4': '0.260', 'weapon2': '0.436', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.942', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '56.000'} [2024-08-06 04:21:09,869][52663] DAMAGECOUNT value on done: 504312.0 [2024-08-06 04:21:09,869][52663] Sum rewards: 65.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'weapon2': '0.312', 'WEAPON3': '1.550', 'weapon3': '3.346', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '56.000'} [2024-08-06 04:21:09,985][52820] DAMAGECOUNT value on done: 472033.0 [2024-08-06 04:21:09,985][52820] Sum rewards: 81.701, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.433', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.104', 'AMMO3': '0.186', 'weapon5': '0.192', 'AMMO4': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '66.000'} [2024-08-06 04:21:12,578][52795] DAMAGECOUNT value on done: 473685.0 [2024-08-06 04:21:12,578][52795] Sum rewards: 78.091, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.134', 'weapon5': '0.156', 'AMMO3': '0.230', 'AMMO4': '0.276', 'weapon2': '0.388', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:12,778][52667] DAMAGECOUNT value on done: 510492.0 [2024-08-06 04:21:12,880][52667] Sum rewards: 84.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.064', 'AMMO5': '0.023', 'AMMO2': '0.069', 'weapon2': '0.234', 'AMMO3': '0.242', 'weapon4': '0.248', 'weapon5': '0.300', 'AMMO4': '0.345', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.890', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.778', 'FRAGCOUNT': '70.000'} [2024-08-06 04:21:12,778][52670] DAMAGECOUNT value on done: 508127.0 [2024-08-06 04:21:12,884][52670] Sum rewards: 70.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.423', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.120', 'weapon5': '0.196', 'weapon2': '0.244', 'AMMO3': '0.260', 'AMMO4': '0.317', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.138', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '61.000'} [2024-08-06 04:21:12,780][52649] DAMAGECOUNT value on done: 501270.0 [2024-08-06 04:21:12,832][52567] Fps is (10 sec: 17138.6, 60 sec: 17192.3, 300 sec: 17464.8). Total num frames: 432529408. Throughput: 0: 4369.2. Samples: 108142790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:21:12,908][52567] Avg episode reward: [(0, '71.795')] [2024-08-06 04:21:12,908][52649] Sum rewards: 79.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.570', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.058', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '68.000'} [2024-08-06 04:21:12,961][52666] DAMAGECOUNT value on done: 507052.0 [2024-08-06 04:21:12,962][52666] Sum rewards: 74.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.850', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.164', 'AMMO3': '0.196', 'AMMO4': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '62.500'} [2024-08-06 04:21:13,048][52663] DAMAGECOUNT value on done: 510322.0 [2024-08-06 04:21:13,048][52663] Sum rewards: 67.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.081', 'AMMO5': '0.021', 'AMMO2': '0.057', 'AMMO3': '0.175', 'weapon5': '0.230', 'AMMO4': '0.286', 'weapon4': '0.324', 'weapon2': '0.342', 'ARMOR': '0.495', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '53.000'} [2024-08-06 04:21:13,185][52650] Updated weights for policy 0, policy_version 52801 (0.0024) [2024-08-06 04:21:13,270][52820] DAMAGECOUNT value on done: 474503.0 [2024-08-06 04:21:13,271][52820] Sum rewards: 72.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.249', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.152', 'AMMO4': '0.195', 'weapon5': '0.268', 'weapon2': '0.280', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.956', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '61.000'} [2024-08-06 04:21:14,013][52658] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:21:14,667][52820] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:21:15,393][52649] DAMAGECOUNT value on done: 505443.0 [2024-08-06 04:21:15,395][52649] Sum rewards: 69.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.975', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.088', 'weapon5': '0.168', 'AMMO3': '0.185', 'weapon2': '0.214', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.316', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '57.000'} [2024-08-06 04:21:15,733][52670] DAMAGECOUNT value on done: 497298.0 [2024-08-06 04:21:15,733][52670] Sum rewards: 68.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.735', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.069', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '56.000'} [2024-08-06 04:21:15,848][52795] DAMAGECOUNT value on done: 464024.0 [2024-08-06 04:21:15,849][52795] Sum rewards: 67.574, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.560', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.161', 'AMMO4': '0.214', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'weapon4': '0.436', 'WEAPON3': '1.000', 'weapon3': '2.668', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 04:21:15,857][52666] DAMAGECOUNT value on done: 505207.0 [2024-08-06 04:21:15,857][52666] Sum rewards: 57.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon7': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.212', 'AMMO3': '0.224', 'weapon4': '0.254', 'AMMO4': '0.264', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.518', 'HITCOUNT': '2.540', 'DAMAGECOUNT': '13.386', 'FRAGCOUNT': '49.000'} [2024-08-06 04:21:16,106][52667] DAMAGECOUNT value on done: 520301.0 [2024-08-06 04:21:16,106][52667] Sum rewards: 89.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.024', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO4': '0.127', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.332', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.621', 'FRAGCOUNT': '71.000'} [2024-08-06 04:21:16,272][52663] DAMAGECOUNT value on done: 518953.0 [2024-08-06 04:21:16,274][52663] Sum rewards: 67.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.172', 'AMMO3': '0.215', 'weapon5': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '55.000'} [2024-08-06 04:21:16,417][52820] DAMAGECOUNT value on done: 465396.0 [2024-08-06 04:21:16,418][52820] Sum rewards: 63.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.462', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.191', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '52.000'} [2024-08-06 04:21:16,647][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:21:16,803][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 04:21:17,790][52650] Updated weights for policy 0, policy_version 52811 (0.0018) [2024-08-06 04:21:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 432627712. Throughput: 0: 4358.9. Samples: 108155150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:21:17,798][52567] Avg episode reward: [(0, '71.780')] [2024-08-06 04:21:18,205][52649] DAMAGECOUNT value on done: 506018.0 [2024-08-06 04:21:18,206][52649] Sum rewards: 69.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.645', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon4': '0.286', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '3.026', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '56.000'} [2024-08-06 04:21:18,573][52670] DAMAGECOUNT value on done: 504254.0 [2024-08-06 04:21:18,574][52670] Sum rewards: 68.328, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.523', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon4': '0.162', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.000'} [2024-08-06 04:21:18,680][52666] DAMAGECOUNT value on done: 506123.0 [2024-08-06 04:21:18,684][52666] Sum rewards: 70.949, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.828', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.458', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '60.000'} [2024-08-06 04:21:19,045][52795] DAMAGECOUNT value on done: 481263.0 [2024-08-06 04:21:19,047][52795] Sum rewards: 65.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.405', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '55.000'} [2024-08-06 04:21:19,048][52667] DAMAGECOUNT value on done: 507894.0 [2024-08-06 04:21:19,050][52667] Sum rewards: 61.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.021', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.166', 'weapon4': '0.180', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.004', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '51.000'} [2024-08-06 04:21:19,152][52663] DAMAGECOUNT value on done: 505823.0 [2024-08-06 04:21:19,152][52663] Sum rewards: 71.328, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.858', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.084', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.358', 'WEAPON3': '1.750', 'weapon3': '3.208', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '63.000'} [2024-08-06 04:21:19,458][52820] DAMAGECOUNT value on done: 474790.0 [2024-08-06 04:21:19,459][52820] Sum rewards: 74.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.061', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.276', 'WEAPON4': '0.300', 'AMMO4': '0.303', 'weapon4': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.762', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:21,024][52649] DAMAGECOUNT value on done: 504113.0 [2024-08-06 04:21:21,025][52649] Sum rewards: 71.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon2': '0.242', 'weapon5': '0.284', 'AMMO3': '0.285', 'AMMO4': '0.321', 'weapon4': '0.396', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.572', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '61.000'} [2024-08-06 04:21:21,176][52670] DAMAGECOUNT value on done: 503211.0 [2024-08-06 04:21:21,176][52670] Sum rewards: 63.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.171', 'weapon2': '0.202', 'weapon5': '0.214', 'weapon4': '0.266', 'AMMO4': '0.305', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '3.072', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '51.000'} [2024-08-06 04:21:21,303][52666] DAMAGECOUNT value on done: 500439.0 [2024-08-06 04:21:21,303][52666] Sum rewards: 73.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.619', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.144', 'weapon5': '0.160', 'AMMO3': '0.212', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '59.000'} [2024-08-06 04:21:21,954][52667] DAMAGECOUNT value on done: 509946.0 [2024-08-06 04:21:21,955][52667] Sum rewards: 65.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.635', 'AMMO5': '0.006', 'weapon4': '0.036', 'AMMO2': '0.043', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.228', 'weapon2': '0.520', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.178', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 04:21:21,971][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:21:22,176][52795] DAMAGECOUNT value on done: 474720.0 [2024-08-06 04:21:22,176][52795] Sum rewards: 85.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.086', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.255', 'WEAPON3': '1.650', 'weapon3': '3.426', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '71.000'} [2024-08-06 04:21:22,260][52663] DAMAGECOUNT value on done: 503333.0 [2024-08-06 04:21:22,261][52663] Sum rewards: 68.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.219', 'weapon2': '0.674', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 04:21:22,646][52650] Updated weights for policy 0, policy_version 52821 (0.0011) [2024-08-06 04:21:22,730][52820] DAMAGECOUNT value on done: 467605.0 [2024-08-06 04:21:22,731][52820] Sum rewards: 64.466, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon4': '0.190', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '52.000'} [2024-08-06 04:21:22,794][52567] Fps is (10 sec: 18091.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 432709632. Throughput: 0: 4355.4. Samples: 108181160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:21:22,794][52567] Avg episode reward: [(0, '71.098')] [2024-08-06 04:21:23,856][52649] DAMAGECOUNT value on done: 492008.0 [2024-08-06 04:21:23,858][52649] Sum rewards: 67.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.168', 'AMMO3': '0.187', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.484', 'weapon4': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '54.000'} [2024-08-06 04:21:24,054][52670] DAMAGECOUNT value on done: 500997.0 [2024-08-06 04:21:24,056][52670] Sum rewards: 75.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:24,280][52666] DAMAGECOUNT value on done: 506527.0 [2024-08-06 04:21:24,282][52666] Sum rewards: 88.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.085', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.208', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '73.000'} [2024-08-06 04:21:24,686][52667] DAMAGECOUNT value on done: 515555.0 [2024-08-06 04:21:24,688][52667] Sum rewards: 62.692, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.181', 'AMMO5': '0.014', 'AMMO2': '0.060', 'AMMO3': '0.162', 'weapon5': '0.222', 'AMMO4': '0.298', 'weapon2': '0.374', 'weapon4': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '50.000'} [2024-08-06 04:21:25,176][52663] DAMAGECOUNT value on done: 501684.0 [2024-08-06 04:21:25,178][52663] Sum rewards: 55.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.052', 'AMMO4': '0.114', 'weapon4': '0.136', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.648', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.929', 'FRAGCOUNT': '48.000'} [2024-08-06 04:21:25,311][52795] DAMAGECOUNT value on done: 462531.0 [2024-08-06 04:21:25,312][52795] Sum rewards: 71.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.154', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '57.000'} [2024-08-06 04:21:25,915][52820] DAMAGECOUNT value on done: 470481.0 [2024-08-06 04:21:25,915][52820] Sum rewards: 75.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.354', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.116', 'weapon5': '0.176', 'AMMO3': '0.179', 'AMMO4': '0.184', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.000'} [2024-08-06 04:21:26,909][52649] DAMAGECOUNT value on done: 500768.0 [2024-08-06 04:21:26,909][52649] Sum rewards: 65.154, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.756', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.142', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.410', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.622', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '50.000'} [2024-08-06 04:21:27,433][52650] Updated weights for policy 0, policy_version 52831 (0.0023) [2024-08-06 04:21:27,494][52670] DAMAGECOUNT value on done: 507606.0 [2024-08-06 04:21:27,495][52670] Sum rewards: 80.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.169', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.064', 'AMMO4': '0.116', 'AMMO3': '0.179', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:27,764][52666] DAMAGECOUNT value on done: 499986.0 [2024-08-06 04:21:27,765][52666] Sum rewards: 65.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.085', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.122', 'weapon5': '0.132', 'AMMO3': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.378', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '53.500'} [2024-08-06 04:21:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 432791552. Throughput: 0: 4361.3. Samples: 108207660. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:21:27,802][52567] Avg episode reward: [(0, '70.998')] [2024-08-06 04:21:27,820][52667] DAMAGECOUNT value on done: 521174.0 [2024-08-06 04:21:27,821][52667] Sum rewards: 77.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO3': '0.213', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:27,920][52663] DAMAGECOUNT value on done: 502472.0 [2024-08-06 04:21:27,922][52663] Sum rewards: 52.962, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.142', 'AMMO4': '0.203', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'HITCOUNT': '2.870', 'weapon3': '3.272', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '48.000'} [2024-08-06 04:21:28,424][52795] DAMAGECOUNT value on done: 472277.0 [2024-08-06 04:21:28,427][52795] Sum rewards: 61.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.026', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.037', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.780', 'WEAPON3': '1.050', 'weapon3': '2.984', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.598', 'FRAGCOUNT': '50.000'} [2024-08-06 04:21:29,089][52820] DAMAGECOUNT value on done: 474480.0 [2024-08-06 04:21:29,090][52820] Sum rewards: 78.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.015', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.190', 'AMMO3': '0.197', 'weapon5': '0.248', 'AMMO4': '0.315', 'weapon2': '0.438', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.838', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '65.000'} [2024-08-06 04:21:29,730][52649] DAMAGECOUNT value on done: 490061.0 [2024-08-06 04:21:29,733][52649] Sum rewards: 61.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.139', 'AMMO3': '0.218', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '2.732', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '51.000'} [2024-08-06 04:21:30,543][52670] DAMAGECOUNT value on done: 496497.0 [2024-08-06 04:21:30,545][52670] Sum rewards: 70.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.292', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.042', 'AMMO4': '0.199', 'AMMO3': '0.223', 'weapon5': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '58.000'} [2024-08-06 04:21:30,648][52667] DAMAGECOUNT value on done: 512038.0 [2024-08-06 04:21:30,649][52667] Sum rewards: 64.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.645', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.102', 'weapon5': '0.130', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '52.500'} [2024-08-06 04:21:30,693][52666] DAMAGECOUNT value on done: 515508.0 [2024-08-06 04:21:30,693][52666] Sum rewards: 68.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.027', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.086', 'weapon5': '0.110', 'AMMO4': '0.153', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.182', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '58.000'} [2024-08-06 04:21:31,023][52663] DAMAGECOUNT value on done: 515393.0 [2024-08-06 04:21:31,023][52663] Sum rewards: 80.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.604', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.040', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.534', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:31,559][52795] DAMAGECOUNT value on done: 476440.0 [2024-08-06 04:21:31,559][52795] Sum rewards: 67.139, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.061', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '54.000'} [2024-08-06 04:21:31,798][52650] Updated weights for policy 0, policy_version 52841 (0.0012) [2024-08-06 04:21:32,272][52820] DAMAGECOUNT value on done: 471237.0 [2024-08-06 04:21:32,272][52820] Sum rewards: 71.050, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.078', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.246', 'HEALTH': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.336', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '60.000'} [2024-08-06 04:21:32,581][52649] DAMAGECOUNT value on done: 504463.0 [2024-08-06 04:21:32,582][52649] Sum rewards: 78.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'weapon2': '0.208', 'weapon4': '0.214', 'AMMO3': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 432881664. Throughput: 0: 4356.7. Samples: 108220590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:21:32,802][52567] Avg episode reward: [(0, '70.817')] [2024-08-06 04:21:33,649][52667] DAMAGECOUNT value on done: 509751.0 [2024-08-06 04:21:33,652][52667] Sum rewards: 64.874, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.067', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.132', 'weapon2': '0.158', 'AMMO4': '0.161', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.498', 'WEAPON3': '0.800', 'weapon3': '2.878', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '52.000'} [2024-08-06 04:21:33,687][52670] DAMAGECOUNT value on done: 503012.0 [2024-08-06 04:21:33,687][52670] Sum rewards: 63.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.375', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.106', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.340', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '51.500'} [2024-08-06 04:21:33,918][52666] DAMAGECOUNT value on done: 508285.0 [2024-08-06 04:21:33,919][52666] Sum rewards: 71.077, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.230', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.173', 'weapon5': '0.178', 'weapon2': '0.200', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '57.000'} [2024-08-06 04:21:33,985][52663] DAMAGECOUNT value on done: 503307.0 [2024-08-06 04:21:33,985][52663] Sum rewards: 65.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.634', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '3.276', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '53.000'} [2024-08-06 04:21:35,371][52820] DAMAGECOUNT value on done: 478459.0 [2024-08-06 04:21:35,373][52820] Sum rewards: 64.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.084', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '53.000'} [2024-08-06 04:21:35,440][52649] DAMAGECOUNT value on done: 503731.0 [2024-08-06 04:21:35,442][52649] Sum rewards: 70.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.200', 'weapon3': '3.402', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '57.000'} [2024-08-06 04:21:36,312][52667] DAMAGECOUNT value on done: 516167.0 [2024-08-06 04:21:36,312][52667] Sum rewards: 74.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:36,671][52650] Updated weights for policy 0, policy_version 52851 (0.0013) [2024-08-06 04:21:37,018][52670] DAMAGECOUNT value on done: 511388.0 [2024-08-06 04:21:37,019][52670] Sum rewards: 55.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.094', 'AMMO3': '0.195', 'AMMO4': '0.240', 'weapon5': '0.246', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '2.996', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '47.000'} [2024-08-06 04:21:37,032][52663] DAMAGECOUNT value on done: 513338.0 [2024-08-06 04:21:37,032][52663] Sum rewards: 60.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.013', 'AMMO2': '0.054', 'AMMO3': '0.193', 'weapon5': '0.220', 'weapon2': '0.260', 'AMMO4': '0.268', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '49.000'} [2024-08-06 04:21:37,246][52666] DAMAGECOUNT value on done: 505056.0 [2024-08-06 04:21:37,246][52666] Sum rewards: 85.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.885', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.206', 'weapon4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '68.000'} [2024-08-06 04:21:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 432971776. Throughput: 0: 4357.6. Samples: 108246870. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:21:37,794][52567] Avg episode reward: [(0, '70.668')] [2024-08-06 04:21:38,443][52649] DAMAGECOUNT value on done: 497159.0 [2024-08-06 04:21:38,445][52649] Sum rewards: 72.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.462', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.116', 'weapon5': '0.200', 'AMMO3': '0.249', 'AMMO4': '0.262', 'weapon2': '0.280', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.144', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:38,502][52820] DAMAGECOUNT value on done: 467376.0 [2024-08-06 04:21:38,504][52820] Sum rewards: 60.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.632', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.122', 'AMMO4': '0.183', 'weapon5': '0.196', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.946', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '50.500'} [2024-08-06 04:21:38,546][52667] DAMAGECOUNT value on done: 519163.0 [2024-08-06 04:21:38,548][52667] Sum rewards: 72.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.104', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:39,664][52669] DAMAGECOUNT value on done: 513448.0 [2024-08-06 04:21:39,665][52669] Sum rewards: 67.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.978', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.104', 'AMMO4': '0.138', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '55.000'} [2024-08-06 04:21:39,678][52670] DAMAGECOUNT value on done: 508579.0 [2024-08-06 04:21:39,678][52670] Sum rewards: 78.086, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.920', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.194', 'weapon2': '0.248', 'AMMO3': '0.257', 'weapon5': '0.258', 'AMMO4': '0.347', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '66.000'} [2024-08-06 04:21:39,821][52666] DAMAGECOUNT value on done: 506867.0 [2024-08-06 04:21:39,821][52666] Sum rewards: 70.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.422', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.170', 'weapon4': '0.194', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '60.000'} [2024-08-06 04:21:40,076][52663] DAMAGECOUNT value on done: 511809.0 [2024-08-06 04:21:40,077][52663] Sum rewards: 77.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.070', 'weapon4': '0.098', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.370', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '63.000'} [2024-08-06 04:21:41,060][52667] DAMAGECOUNT value on done: 507560.0 [2024-08-06 04:21:41,061][52667] Sum rewards: 60.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.576', 'AMMO5': '0.020', 'AMMO2': '0.074', 'AMMO3': '0.203', 'weapon2': '0.210', 'weapon5': '0.260', 'AMMO4': '0.368', 'weapon4': '0.450', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.658', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '51.000'} [2024-08-06 04:21:41,561][52820] DAMAGECOUNT value on done: 474809.0 [2024-08-06 04:21:41,563][52820] Sum rewards: 77.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.283', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon2': '0.174', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:41,629][52650] Updated weights for policy 0, policy_version 52861 (0.0014) [2024-08-06 04:21:42,648][52670] DAMAGECOUNT value on done: 493675.0 [2024-08-06 04:21:42,650][52670] Sum rewards: 78.317, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.198', 'weapon2': '0.504', 'WEAPON3': '0.900', 'weapon3': '3.052', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '63.000'} [2024-08-06 04:21:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 433061888. Throughput: 0: 4362.2. Samples: 108273110. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:21:42,794][52567] Avg episode reward: [(0, '70.430')] [2024-08-06 04:21:42,849][52666] DAMAGECOUNT value on done: 508158.0 [2024-08-06 04:21:42,849][52666] Sum rewards: 84.433, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.874', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.076', 'AMMO4': '0.178', 'weapon2': '0.206', 'weapon4': '0.240', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.360', 'FRAGCOUNT': '71.000'} [2024-08-06 04:21:42,959][52669] DAMAGECOUNT value on done: 505668.0 [2024-08-06 04:21:42,960][52669] Sum rewards: 72.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.158', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.115', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:43,167][52663] DAMAGECOUNT value on done: 506878.0 [2024-08-06 04:21:43,167][52663] Sum rewards: 76.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.226', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.112', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.014', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '65.000'} [2024-08-06 04:21:43,887][52671] Large shaping reward 2.510 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('HEALTH', -0.006, -2.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:21:43,933][52667] DAMAGECOUNT value on done: 508116.0 [2024-08-06 04:21:43,934][52667] Sum rewards: 51.937, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.124', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon2': '0.216', 'AMMO3': '0.249', 'weapon4': '0.250', 'weapon5': '0.308', 'AMMO4': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.390', 'weapon3': '2.896', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '47.000'} [2024-08-06 04:21:44,307][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:21:44,584][52820] DAMAGECOUNT value on done: 480261.0 [2024-08-06 04:21:44,585][52820] Sum rewards: 81.423, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.063', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.180', 'weapon5': '0.214', 'AMMO3': '0.252', 'AMMO4': '0.277', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.942', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '21.171', 'FRAGCOUNT': '68.000'} [2024-08-06 04:21:45,656][52669] DAMAGECOUNT value on done: 517090.0 [2024-08-06 04:21:45,658][52669] Sum rewards: 74.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.801', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.100', 'weapon5': '0.176', 'AMMO4': '0.201', 'AMMO3': '0.217', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '60.000'} [2024-08-06 04:21:45,803][52670] DAMAGECOUNT value on done: 504233.0 [2024-08-06 04:21:45,804][52670] Sum rewards: 70.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.855', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.294', 'WEAPON3': '1.600', 'weapon3': '3.376', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 04:21:45,824][52658] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 04:21:45,910][52666] DAMAGECOUNT value on done: 510329.0 [2024-08-06 04:21:45,910][52666] Sum rewards: 75.506, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.461', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.136', 'weapon4': '0.148', 'AMMO4': '0.166', 'AMMO3': '0.177', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '61.000'} [2024-08-06 04:21:46,091][52650] Updated weights for policy 0, policy_version 52871 (0.0013) [2024-08-06 04:21:46,518][52667] DAMAGECOUNT value on done: 517073.0 [2024-08-06 04:21:46,520][52667] Sum rewards: 74.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.151', 'weapon2': '0.182', 'weapon4': '0.188', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.294', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '63.000'} [2024-08-06 04:21:47,613][52820] DAMAGECOUNT value on done: 474471.0 [2024-08-06 04:21:47,617][52820] Sum rewards: 83.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.672', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.080', 'weapon5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '67.000'} [2024-08-06 04:21:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 433143808. Throughput: 0: 4367.6. Samples: 108286480. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:21:47,795][52567] Avg episode reward: [(0, '70.973')] [2024-08-06 04:21:48,536][52669] DAMAGECOUNT value on done: 512995.0 [2024-08-06 04:21:48,536][52669] Sum rewards: 75.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.128', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.122', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '62.000'} [2024-08-06 04:21:48,904][52670] DAMAGECOUNT value on done: 512847.0 [2024-08-06 04:21:48,904][52670] Sum rewards: 69.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.058', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.144', 'AMMO4': '0.160', 'AMMO3': '0.208', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '56.000'} [2024-08-06 04:21:49,032][52667] DAMAGECOUNT value on done: 507431.0 [2024-08-06 04:21:49,033][52667] Sum rewards: 66.275, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.070', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.124', 'weapon5': '0.172', 'AMMO4': '0.183', 'AMMO3': '0.275', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.750', 'weapon3': '2.942', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '59.000'} [2024-08-06 04:21:49,065][52666] DAMAGECOUNT value on done: 495448.0 [2024-08-06 04:21:49,065][52666] Sum rewards: 61.804, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.575', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.094', 'AMMO4': '0.113', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '0.950', 'HITCOUNT': '2.760', 'weapon3': '3.220', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '49.500'} [2024-08-06 04:21:50,671][52820] DAMAGECOUNT value on done: 478212.0 [2024-08-06 04:21:50,671][52820] Sum rewards: 71.188, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.746', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '57.000'} [2024-08-06 04:21:50,850][52650] Updated weights for policy 0, policy_version 52881 (0.0012) [2024-08-06 04:21:51,736][52669] DAMAGECOUNT value on done: 511193.0 [2024-08-06 04:21:51,736][52669] Sum rewards: 77.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.944', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.096', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '64.000'} [2024-08-06 04:21:51,811][52670] DAMAGECOUNT value on done: 502576.0 [2024-08-06 04:21:51,811][52670] Sum rewards: 63.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.710', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon5': '0.026', 'AMMO4': '0.040', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.860', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '52.000'} [2024-08-06 04:21:51,993][52666] DAMAGECOUNT value on done: 503536.0 [2024-08-06 04:21:51,997][52666] Sum rewards: 74.150, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.411', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.244', 'weapon4': '0.248', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '59.000'} [2024-08-06 04:21:52,056][52667] DAMAGECOUNT value on done: 516477.0 [2024-08-06 04:21:52,057][52667] Sum rewards: 76.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.580', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.062', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.246', 'WEAPON3': '1.450', 'weapon3': '3.356', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '65.000'} [2024-08-06 04:21:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 433233920. Throughput: 0: 4359.1. Samples: 108312420. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:21:52,794][52567] Avg episode reward: [(0, '70.836')] [2024-08-06 04:21:53,807][52820] DAMAGECOUNT value on done: 474901.0 [2024-08-06 04:21:53,808][52820] Sum rewards: 64.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.689', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.146', 'weapon2': '0.160', 'AMMO3': '0.181', 'AMMO4': '0.212', 'weapon5': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.058', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '53.000'} [2024-08-06 04:21:54,424][52669] DAMAGECOUNT value on done: 514773.0 [2024-08-06 04:21:54,426][52669] Sum rewards: 67.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.856', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.188', 'AMMO3': '0.202', 'weapon2': '0.336', 'weapon5': '0.338', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.000'} [2024-08-06 04:21:54,896][52670] DAMAGECOUNT value on done: 509047.0 [2024-08-06 04:21:54,897][52670] Sum rewards: 79.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.102', 'AMMO4': '0.176', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '65.000'} [2024-08-06 04:21:55,240][52667] DAMAGECOUNT value on done: 520699.0 [2024-08-06 04:21:55,242][52667] Sum rewards: 72.480, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.738', 'AMMO5': '0.023', 'AMMO2': '0.074', 'weapon4': '0.144', 'AMMO3': '0.211', 'weapon2': '0.244', 'weapon5': '0.274', 'AMMO4': '0.371', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '61.000'} [2024-08-06 04:21:55,397][52650] Updated weights for policy 0, policy_version 52891 (0.0022) [2024-08-06 04:21:56,459][52671] DAMAGECOUNT value on done: 518452.0 [2024-08-06 04:21:56,460][52671] Sum rewards: 71.594, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.864', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.140', 'AMMO4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.868', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '55.000'} [2024-08-06 04:21:56,633][52669] DAMAGECOUNT value on done: 515542.0 [2024-08-06 04:21:56,634][52669] Sum rewards: 79.488, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.099', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '66.000'} [2024-08-06 04:21:56,981][52820] DAMAGECOUNT value on done: 474981.0 [2024-08-06 04:21:56,982][52820] Sum rewards: 81.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '69.000'} [2024-08-06 04:21:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 433324032. Throughput: 0: 4349.5. Samples: 108338350. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:21:57,794][52567] Avg episode reward: [(0, '70.948')] [2024-08-06 04:21:58,044][52667] DAMAGECOUNT value on done: 522187.0 [2024-08-06 04:21:58,045][52667] Sum rewards: 77.260, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.170', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '61.500'} [2024-08-06 04:21:59,359][52669] DAMAGECOUNT value on done: 511663.0 [2024-08-06 04:21:59,360][52669] Sum rewards: 76.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.770', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.165', 'weapon4': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.374', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '63.000'} [2024-08-06 04:21:59,397][52671] DAMAGECOUNT value on done: 515597.0 [2024-08-06 04:21:59,398][52671] Sum rewards: 59.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO4': '0.161', 'AMMO3': '0.202', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '2.908', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '50.000'} [2024-08-06 04:22:00,143][52820] DAMAGECOUNT value on done: 482549.0 [2024-08-06 04:22:00,144][52820] Sum rewards: 67.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.578', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.120', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '55.500'} [2024-08-06 04:22:00,159][52650] Updated weights for policy 0, policy_version 52901 (0.0024) [2024-08-06 04:22:01,310][52667] DAMAGECOUNT value on done: 518039.0 [2024-08-06 04:22:01,313][52667] Sum rewards: 67.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.197', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.204', 'AMMO3': '0.244', 'weapon5': '0.262', 'AMMO4': '0.295', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.854', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:01,982][52669] DAMAGECOUNT value on done: 519755.0 [2024-08-06 04:22:01,984][52669] Sum rewards: 73.468, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.528', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.126', 'AMMO4': '0.147', 'weapon5': '0.148', 'weapon2': '0.222', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:02,342][52671] DAMAGECOUNT value on done: 516510.0 [2024-08-06 04:22:02,342][52671] Sum rewards: 65.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.162', 'weapon4': '0.206', 'weapon5': '0.232', 'AMMO4': '0.253', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.684', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 433405952. Throughput: 0: 4365.1. Samples: 108351580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:22:02,795][52567] Avg episode reward: [(0, '70.694')] [2024-08-06 04:22:03,276][52820] DAMAGECOUNT value on done: 482001.0 [2024-08-06 04:22:03,278][52820] Sum rewards: 73.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.605', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.197', 'weapon5': '0.216', 'AMMO4': '0.245', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '60.000'} [2024-08-06 04:22:03,835][52667] DAMAGECOUNT value on done: 511592.0 [2024-08-06 04:22:03,836][52667] Sum rewards: 79.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.170', 'weapon4': '0.184', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.878', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:04,569][52650] Updated weights for policy 0, policy_version 52911 (0.0013) [2024-08-06 04:22:04,638][52669] DAMAGECOUNT value on done: 511364.0 [2024-08-06 04:22:04,638][52669] Sum rewards: 65.501, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.554', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.064', 'AMMO3': '0.139', 'weapon5': '0.154', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.606', 'WEAPON3': '0.900', 'weapon3': '3.028', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '50.000'} [2024-08-06 04:22:05,526][52671] DAMAGECOUNT value on done: 515367.0 [2024-08-06 04:22:05,529][52671] Sum rewards: 70.502, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.710', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.202', 'AMMO4': '0.266', 'AMMO3': '0.289', 'weapon2': '0.370', 'weapon4': '0.388', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.658', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '64.000'} [2024-08-06 04:22:06,292][52667] DAMAGECOUNT value on done: 520380.0 [2024-08-06 04:22:06,292][52667] Sum rewards: 84.556, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.366', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.104', 'AMMO3': '0.170', 'weapon5': '0.196', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '66.000'} [2024-08-06 04:22:06,524][52820] DAMAGECOUNT value on done: 470814.0 [2024-08-06 04:22:06,524][52820] Sum rewards: 77.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.197', 'weapon5': '0.216', 'weapon4': '0.288', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:07,317][52669] DAMAGECOUNT value on done: 518608.0 [2024-08-06 04:22:07,320][52669] Sum rewards: 70.618, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.001', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'AMMO4': '0.161', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '3.092', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 433504256. Throughput: 0: 4376.7. Samples: 108378110. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:22:07,794][52567] Avg episode reward: [(0, '70.904')] [2024-08-06 04:22:08,533][52671] DAMAGECOUNT value on done: 525684.0 [2024-08-06 04:22:08,535][52671] Sum rewards: 63.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.171', 'weapon5': '0.228', 'AMMO4': '0.234', 'weapon4': '0.244', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '2.846', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '50.000'} [2024-08-06 04:22:08,634][52811] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:22:09,425][52658] DAMAGECOUNT value on done: 511326.0 [2024-08-06 04:22:09,427][52658] Sum rewards: 77.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.401', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.195', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.354', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:09,679][52650] Updated weights for policy 0, policy_version 52921 (0.0013) [2024-08-06 04:22:09,764][52669] DAMAGECOUNT value on done: 517071.0 [2024-08-06 04:22:09,764][52669] Sum rewards: 76.655, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.724', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.040', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.280', 'weapon2': '0.368', 'WEAPON3': '1.750', 'weapon3': '3.274', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '68.000'} [2024-08-06 04:22:10,278][52668] DAMAGECOUNT value on done: 509863.0 [2024-08-06 04:22:10,278][52668] Sum rewards: 69.410, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.300', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.100', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.800', 'weapon3': '3.128', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:11,708][52671] DAMAGECOUNT value on done: 514855.0 [2024-08-06 04:22:11,710][52671] Sum rewards: 62.813, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.415', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon2': '0.404', 'WEAPON3': '0.900', 'HITCOUNT': '2.960', 'weapon3': '3.266', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '50.000'} [2024-08-06 04:22:11,941][52658] DAMAGECOUNT value on done: 512685.0 [2024-08-06 04:22:11,942][52658] Sum rewards: 60.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.170', 'weapon4': '0.184', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.082', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:12,384][52669] DAMAGECOUNT value on done: 504497.0 [2024-08-06 04:22:12,388][52669] Sum rewards: 76.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.174', 'weapon4': '0.214', 'AMMO3': '0.222', 'AMMO4': '0.225', 'weapon2': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:12,653][52662] DAMAGECOUNT value on done: 516532.0 [2024-08-06 04:22:12,655][52662] Sum rewards: 68.165, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.078', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'AMMO3': '0.248', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.394', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17487.3, 300 sec: 17467.0). Total num frames: 433577984. Throughput: 0: 4369.1. Samples: 108404270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:22:12,795][52567] Avg episode reward: [(0, '70.978')] [2024-08-06 04:22:13,335][52668] DAMAGECOUNT value on done: 515122.0 [2024-08-06 04:22:13,339][52668] Sum rewards: 77.169, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.125', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.216', 'HEALTH': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:13,915][52650] Updated weights for policy 0, policy_version 52931 (0.0050) [2024-08-06 04:22:14,201][52671] DAMAGECOUNT value on done: 522425.0 [2024-08-06 04:22:14,201][52671] Sum rewards: 74.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.670', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.104', 'weapon5': '0.130', 'weapon2': '0.224', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'AMMO3': '0.301', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.300', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '64.000'} [2024-08-06 04:22:14,931][52658] DAMAGECOUNT value on done: 517496.0 [2024-08-06 04:22:14,931][52658] Sum rewards: 82.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.621', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.062', 'weapon5': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO4': '0.251', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '67.000'} [2024-08-06 04:22:15,328][52662] DAMAGECOUNT value on done: 516988.0 [2024-08-06 04:22:15,329][52662] Sum rewards: 70.925, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.105', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon5': '0.038', 'AMMO4': '0.040', 'weapon4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon2': '0.330', 'WEAPON3': '1.000', 'HITCOUNT': '3.230', 'weapon3': '3.402', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:15,928][52669] DAMAGECOUNT value on done: 514776.0 [2024-08-06 04:22:15,928][52669] Sum rewards: 78.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.142', 'weapon4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:16,268][52668] DAMAGECOUNT value on done: 513812.0 [2024-08-06 04:22:16,269][52668] Sum rewards: 72.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.384', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.139', 'weapon5': '0.160', 'AMMO3': '0.167', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.204', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:16,649][52671] DAMAGECOUNT value on done: 514609.0 [2024-08-06 04:22:16,650][52671] Sum rewards: 56.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.804', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.171', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.220', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '46.000'} [2024-08-06 04:22:17,656][52662] DAMAGECOUNT value on done: 516969.0 [2024-08-06 04:22:17,656][52662] Sum rewards: 66.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.152', 'AMMO3': '0.171', 'AMMO4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'weapon4': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.684', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '53.000'} [2024-08-06 04:22:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 433668096. Throughput: 0: 4370.7. Samples: 108417270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:22:17,794][52567] Avg episode reward: [(0, '71.065')] [2024-08-06 04:22:18,150][52647] DAMAGECOUNT value on done: 540000.0 [2024-08-06 04:22:18,150][52647] Sum rewards: 60.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.212', 'AMMO3': '0.237', 'AMMO4': '0.252', 'weapon4': '0.332', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.760', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '50.000'} [2024-08-06 04:22:18,278][52658] DAMAGECOUNT value on done: 516737.0 [2024-08-06 04:22:18,279][52658] Sum rewards: 75.857, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.762', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.186', 'weapon2': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:18,337][52669] DAMAGECOUNT value on done: 514828.0 [2024-08-06 04:22:18,338][52669] Sum rewards: 65.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.272', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.137', 'weapon5': '0.170', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.824', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:18,637][52659] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2024-08-06 04:22:18,874][52650] Updated weights for policy 0, policy_version 52941 (0.0031) [2024-08-06 04:22:19,259][52668] DAMAGECOUNT value on done: 514134.0 [2024-08-06 04:22:19,259][52668] Sum rewards: 67.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.495', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.096', 'weapon5': '0.116', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 04:22:19,277][52671] DAMAGECOUNT value on done: 510219.0 [2024-08-06 04:22:19,277][52671] Sum rewards: 69.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.247', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon4': '0.104', 'AMMO4': '0.123', 'weapon5': '0.188', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '57.000'} [2024-08-06 04:22:20,605][52662] DAMAGECOUNT value on done: 506116.0 [2024-08-06 04:22:20,605][52662] Sum rewards: 62.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.150', 'AMMO3': '0.155', 'weapon5': '0.212', 'AMMO4': '0.222', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.520', 'WEAPON3': '0.900', 'weapon3': '2.886', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '51.000'} [2024-08-06 04:22:20,862][52658] DAMAGECOUNT value on done: 507373.0 [2024-08-06 04:22:20,862][52658] Sum rewards: 66.710, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.372', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.142', 'weapon5': '0.142', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.350', 'weapon4': '0.538', 'WEAPON3': '0.850', 'weapon3': '2.840', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '51.000'} [2024-08-06 04:22:21,162][52647] DAMAGECOUNT value on done: 541534.0 [2024-08-06 04:22:21,163][52647] Sum rewards: 57.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.116', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.080', 'weapon5': '0.112', 'AMMO4': '0.214', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '2.944', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '52.500'} [2024-08-06 04:22:21,231][52669] DAMAGECOUNT value on done: 531240.0 [2024-08-06 04:22:21,231][52669] Sum rewards: 82.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.238', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '68.000'} [2024-08-06 04:22:22,179][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:22:22,264][52668] DAMAGECOUNT value on done: 504261.0 [2024-08-06 04:22:22,266][52668] Sum rewards: 64.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.360', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.128', 'AMMO4': '0.155', 'weapon5': '0.180', 'AMMO3': '0.233', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.112', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '54.000'} [2024-08-06 04:22:22,307][52671] DAMAGECOUNT value on done: 515805.0 [2024-08-06 04:22:22,308][52671] Sum rewards: 62.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.897', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.105', 'weapon4': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.260', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '53.000'} [2024-08-06 04:22:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 433766400. Throughput: 0: 4378.0. Samples: 108443880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:22:22,795][52567] Avg episode reward: [(0, '70.670')] [2024-08-06 04:22:22,965][52662] DAMAGECOUNT value on done: 517908.0 [2024-08-06 04:22:22,965][52662] Sum rewards: 77.488, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.036', 'HEALTH': '0.157', 'AMMO3': '0.176', 'AMMO4': '0.179', 'weapon5': '0.204', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.732', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:23,235][52650] Updated weights for policy 0, policy_version 52951 (0.0019) [2024-08-06 04:22:23,298][52811] DAMAGECOUNT value on done: 488336.0 [2024-08-06 04:22:23,298][52811] Sum rewards: 55.932, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.013', 'AMMO2': '0.040', 'HEALTH': '0.068', 'weapon4': '0.078', 'weapon5': '0.120', 'AMMO3': '0.197', 'AMMO4': '0.202', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.370', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '47.000'} [2024-08-06 04:22:23,745][52647] DAMAGECOUNT value on done: 536841.0 [2024-08-06 04:22:23,746][52647] Sum rewards: 71.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.882', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.110', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.218', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:23,775][52658] DAMAGECOUNT value on done: 508869.0 [2024-08-06 04:22:23,775][52658] Sum rewards: 67.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.055', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.181', 'weapon2': '0.552', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.206', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '55.000'} [2024-08-06 04:22:24,408][52669] DAMAGECOUNT value on done: 519067.0 [2024-08-06 04:22:24,409][52669] Sum rewards: 75.199, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.956', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.550', 'weapon3': '2.856', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:24,880][52671] DAMAGECOUNT value on done: 517246.0 [2024-08-06 04:22:24,881][52671] Sum rewards: 60.836, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.145', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.166', 'AMMO4': '0.256', 'AMMO3': '0.259', 'weapon5': '0.264', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.912', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:25,001][52668] DAMAGECOUNT value on done: 518192.0 [2024-08-06 04:22:25,001][52668] Sum rewards: 79.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.754', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.146', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '67.000'} [2024-08-06 04:22:25,480][52662] DAMAGECOUNT value on done: 510712.0 [2024-08-06 04:22:25,481][52662] Sum rewards: 73.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.043', 'WEAPON5': '0.100', 'weapon5': '0.116', 'weapon4': '0.122', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO4': '0.215', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:26,298][52811] DAMAGECOUNT value on done: 475027.0 [2024-08-06 04:22:26,299][52811] Sum rewards: 74.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.192', 'weapon2': '0.194', 'AMMO3': '0.208', 'AMMO4': '0.226', 'weapon4': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:26,761][52658] DAMAGECOUNT value on done: 517958.0 [2024-08-06 04:22:26,761][52658] Sum rewards: 76.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.080', 'weapon5': '0.152', 'AMMO3': '0.196', 'AMMO4': '0.220', 'weapon2': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.500'} [2024-08-06 04:22:26,823][52647] DAMAGECOUNT value on done: 547344.0 [2024-08-06 04:22:26,824][52647] Sum rewards: 68.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:27,483][52669] DAMAGECOUNT value on done: 517371.0 [2024-08-06 04:22:27,485][52669] Sum rewards: 83.678, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.272', 'weapon2': '0.318', 'WEAPON3': '1.700', 'weapon3': '3.430', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '73.000'} [2024-08-06 04:22:27,489][52647] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:22:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 433848320. Throughput: 0: 4378.4. Samples: 108470140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:22:27,794][52567] Avg episode reward: [(0, '71.124')] [2024-08-06 04:22:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052960_433848320.pth... [2024-08-06 04:22:27,926][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052449_429662208.pth [2024-08-06 04:22:27,974][52671] DAMAGECOUNT value on done: 514731.0 [2024-08-06 04:22:27,975][52671] Sum rewards: 65.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.160', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.196', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '54.000'} [2024-08-06 04:22:28,121][52668] DAMAGECOUNT value on done: 515777.0 [2024-08-06 04:22:28,121][52668] Sum rewards: 50.811, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.308', 'weapon2': '0.536', 'WEAPON3': '1.800', 'HITCOUNT': '3.110', 'weapon3': '3.120', 'DAMAGECOUNT': '13.461', 'FRAGCOUNT': '47.000'} [2024-08-06 04:22:28,206][52650] Updated weights for policy 0, policy_version 52961 (0.0012) [2024-08-06 04:22:28,360][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:22:28,494][52662] DAMAGECOUNT value on done: 517179.0 [2024-08-06 04:22:28,496][52662] Sum rewards: 68.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.284', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:29,230][52647] DAMAGECOUNT value on done: 546641.0 [2024-08-06 04:22:29,230][52647] Sum rewards: 79.114, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.178', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:29,442][52658] DAMAGECOUNT value on done: 509179.0 [2024-08-06 04:22:29,442][52658] Sum rewards: 80.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO3': '0.184', 'AMMO4': '0.185', 'weapon4': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '64.500'} [2024-08-06 04:22:29,617][52811] DAMAGECOUNT value on done: 471379.0 [2024-08-06 04:22:29,617][52811] Sum rewards: 75.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.079', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.034', 'AMMO4': '0.036', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:30,408][52669] DAMAGECOUNT value on done: 517000.0 [2024-08-06 04:22:30,409][52669] Sum rewards: 57.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.186', 'weapon4': '0.228', 'AMMO4': '0.264', 'weapon2': '0.304', 'weapon5': '0.316', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.530', 'weapon3': '2.892', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '47.000'} [2024-08-06 04:22:30,945][52671] DAMAGECOUNT value on done: 524804.0 [2024-08-06 04:22:30,947][52671] Sum rewards: 70.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.418', 'WEAPON3': '1.650', 'weapon3': '3.194', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '60.000'} [2024-08-06 04:22:30,999][52662] DAMAGECOUNT value on done: 522000.0 [2024-08-06 04:22:31,002][52662] Sum rewards: 75.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.495', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.058', 'weapon5': '0.170', 'AMMO3': '0.255', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:31,154][52668] DAMAGECOUNT value on done: 507391.0 [2024-08-06 04:22:31,155][52668] Sum rewards: 81.412, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.262', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:32,158][52647] DAMAGECOUNT value on done: 545172.0 [2024-08-06 04:22:32,159][52647] Sum rewards: 83.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.134', 'weapon4': '0.184', 'weapon2': '0.202', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '69.000'} [2024-08-06 04:22:32,458][52658] DAMAGECOUNT value on done: 523373.0 [2024-08-06 04:22:32,458][52658] Sum rewards: 70.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.416', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.186', 'AMMO4': '0.196', 'weapon2': '0.242', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '59.500'} [2024-08-06 04:22:32,743][52811] DAMAGECOUNT value on done: 475872.0 [2024-08-06 04:22:32,746][52811] Sum rewards: 75.184, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.660', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'weapon3': '3.458', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:32,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 433930240. Throughput: 0: 4368.5. Samples: 108483060. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:22:32,794][52567] Avg episode reward: [(0, '71.589')] [2024-08-06 04:22:33,166][52650] Updated weights for policy 0, policy_version 52971 (0.0017) [2024-08-06 04:22:33,600][52669] DAMAGECOUNT value on done: 520126.0 [2024-08-06 04:22:33,602][52669] Sum rewards: 80.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.052', 'weapon5': '0.054', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '67.000'} [2024-08-06 04:22:33,715][52671] DAMAGECOUNT value on done: 517982.0 [2024-08-06 04:22:33,715][52671] Sum rewards: 79.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.586', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.118', 'weapon5': '0.128', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '67.000'} [2024-08-06 04:22:33,718][52668] DAMAGECOUNT value on done: 509858.0 [2024-08-06 04:22:33,718][52668] Sum rewards: 74.101, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.395', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.162', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.620', 'WEAPON3': '0.950', 'weapon3': '2.930', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:34,162][52662] DAMAGECOUNT value on done: 512627.0 [2024-08-06 04:22:34,164][52662] Sum rewards: 72.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.192', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO4': '0.198', 'weapon5': '0.220', 'weapon4': '0.230', 'AMMO3': '0.243', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.896', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:34,300][52662] Large shaping reward -2.512 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.264, -88.0), ('weapon5', 0.002)] [2024-08-06 04:22:34,583][52660] DAMAGECOUNT value on done: 512525.0 [2024-08-06 04:22:34,583][52660] Sum rewards: 72.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.154', 'AMMO3': '0.174', 'AMMO4': '0.182', 'weapon5': '0.202', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:35,192][52647] DAMAGECOUNT value on done: 540953.0 [2024-08-06 04:22:35,198][52647] Sum rewards: 77.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.035', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:35,463][52658] DAMAGECOUNT value on done: 511553.0 [2024-08-06 04:22:35,463][52658] Sum rewards: 69.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'weapon2': '0.416', 'weapon4': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '57.000'} [2024-08-06 04:22:35,691][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:22:35,711][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:22:35,833][52811] DAMAGECOUNT value on done: 480529.0 [2024-08-06 04:22:35,835][52811] Sum rewards: 78.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.080', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.096', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:36,231][52668] DAMAGECOUNT value on done: 517640.0 [2024-08-06 04:22:36,234][52668] Sum rewards: 61.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.035', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.267', 'weapon2': '0.382', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.362', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '53.000'} [2024-08-06 04:22:36,408][52671] DAMAGECOUNT value on done: 503570.0 [2024-08-06 04:22:36,408][52671] Sum rewards: 69.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.606', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.110', 'AMMO4': '0.191', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:36,799][52662] DAMAGECOUNT value on done: 524720.0 [2024-08-06 04:22:36,800][52662] Sum rewards: 65.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.946', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO3': '0.190', 'weapon5': '0.206', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:37,343][52650] Updated weights for policy 0, policy_version 52981 (0.0020) [2024-08-06 04:22:37,355][52660] DAMAGECOUNT value on done: 503991.0 [2024-08-06 04:22:37,356][52660] Sum rewards: 68.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO4': '0.205', 'weapon2': '0.232', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.366', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.900', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:37,446][52803] DAMAGECOUNT value on done: 476856.0 [2024-08-06 04:22:37,448][52803] Sum rewards: 69.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.528', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.342', 'weapon4': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 434020352. Throughput: 0: 4375.3. Samples: 108509310. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 04:22:37,794][52567] Avg episode reward: [(0, '71.501')] [2024-08-06 04:22:38,154][52647] DAMAGECOUNT value on done: 534152.0 [2024-08-06 04:22:38,154][52647] Sum rewards: 81.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.264', 'WEAPON3': '1.250', 'weapon3': '3.440', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '67.000'} [2024-08-06 04:22:38,481][52794] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.075, -25.0), ('weapon5', 0.002)] [2024-08-06 04:22:38,721][52658] DAMAGECOUNT value on done: 524352.0 [2024-08-06 04:22:38,731][52658] Sum rewards: 72.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.913', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.138', 'AMMO4': '0.202', 'weapon2': '0.224', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:38,830][52811] DAMAGECOUNT value on done: 485767.0 [2024-08-06 04:22:38,831][52811] Sum rewards: 69.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.188', 'AMMO3': '0.192', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '55.000'} [2024-08-06 04:22:39,157][52668] DAMAGECOUNT value on done: 511908.0 [2024-08-06 04:22:39,157][52668] Sum rewards: 73.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.969', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.124', 'AMMO3': '0.161', 'AMMO4': '0.178', 'weapon2': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '58.500'} [2024-08-06 04:22:39,349][52662] DAMAGECOUNT value on done: 510697.0 [2024-08-06 04:22:39,351][52662] Sum rewards: 57.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.134', 'weapon5': '0.142', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.550', 'weapon3': '2.774', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '49.500'} [2024-08-06 04:22:39,378][52671] DAMAGECOUNT value on done: 523915.0 [2024-08-06 04:22:39,378][52671] Sum rewards: 76.164, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.354', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.134', 'AMMO3': '0.166', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:40,289][52660] DAMAGECOUNT value on done: 516009.0 [2024-08-06 04:22:40,289][52660] Sum rewards: 71.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.090', 'weapon5': '0.218', 'AMMO4': '0.258', 'AMMO3': '0.277', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.980', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:40,500][52803] DAMAGECOUNT value on done: 476370.0 [2024-08-06 04:22:40,500][52803] Sum rewards: 64.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.082', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.352', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '53.000'} [2024-08-06 04:22:41,257][52647] DAMAGECOUNT value on done: 543061.0 [2024-08-06 04:22:41,258][52647] Sum rewards: 63.708, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.870', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.122', 'AMMO4': '0.232', 'AMMO3': '0.251', 'weapon5': '0.274', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '55.000'} [2024-08-06 04:22:41,871][52658] DAMAGECOUNT value on done: 507157.0 [2024-08-06 04:22:41,873][52658] Sum rewards: 70.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.064', 'weapon5': '0.146', 'AMMO3': '0.246', 'AMMO4': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '60.000'} [2024-08-06 04:22:41,921][52668] DAMAGECOUNT value on done: 505641.0 [2024-08-06 04:22:41,922][52668] Sum rewards: 59.945, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.182', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.198', 'AMMO4': '0.210', 'weapon4': '0.254', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.650', 'weapon3': '2.712', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '54.000'} [2024-08-06 04:22:41,999][52811] DAMAGECOUNT value on done: 482046.0 [2024-08-06 04:22:42,001][52811] Sum rewards: 78.744, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.818', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.164', 'weapon5': '0.172', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'WEAPON3': '1.750', 'weapon3': '3.078', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '68.000'} [2024-08-06 04:22:42,090][52662] DAMAGECOUNT value on done: 515264.0 [2024-08-06 04:22:42,091][52662] Sum rewards: 76.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.604', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.052', 'AMMO4': '0.055', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '64.000'} [2024-08-06 04:22:42,222][52671] DAMAGECOUNT value on done: 520036.0 [2024-08-06 04:22:42,224][52671] Sum rewards: 64.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.495', 'AMMO5': '0.011', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.086', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '53.000'} [2024-08-06 04:22:42,512][52650] Updated weights for policy 0, policy_version 52991 (0.0013) [2024-08-06 04:22:42,616][52614] Signal inference workers to stop experience collection... (9650 times) [2024-08-06 04:22:42,616][52614] Signal inference workers to resume experience collection... (9650 times) [2024-08-06 04:22:42,669][52650] InferenceWorker_p0-w0: stopping experience collection (9650 times) [2024-08-06 04:22:42,684][52650] InferenceWorker_p0-w0: resuming experience collection (9650 times) [2024-08-06 04:22:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 434110464. Throughput: 0: 4372.7. Samples: 108535120. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 04:22:42,794][52567] Avg episode reward: [(0, '71.156')] [2024-08-06 04:22:43,174][52660] DAMAGECOUNT value on done: 520569.0 [2024-08-06 04:22:43,174][52660] Sum rewards: 78.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.825', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.104', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:43,698][52803] DAMAGECOUNT value on done: 482973.0 [2024-08-06 04:22:43,700][52803] Sum rewards: 67.842, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.922', 'AMMO5': '0.020', 'AMMO2': '0.073', 'weapon2': '0.228', 'weapon5': '0.242', 'AMMO3': '0.249', 'AMMO4': '0.364', 'weapon4': '0.472', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.694', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '58.500'} [2024-08-06 04:22:43,890][52665] DAMAGECOUNT value on done: 502282.0 [2024-08-06 04:22:43,898][52665] Sum rewards: 73.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.106', 'AMMO4': '0.129', 'weapon5': '0.138', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:44,193][52647] DAMAGECOUNT value on done: 537740.0 [2024-08-06 04:22:44,193][52647] Sum rewards: 66.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.706', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.188', 'weapon2': '0.196', 'weapon4': '0.214', 'AMMO3': '0.223', 'AMMO4': '0.224', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:44,776][52668] DAMAGECOUNT value on done: 500251.0 [2024-08-06 04:22:44,776][52668] Sum rewards: 61.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.055', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.448', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.250', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:44,852][52664] DAMAGECOUNT value on done: 532069.0 [2024-08-06 04:22:44,853][52664] Sum rewards: 74.043, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.105', 'AMMO5': '0.013', 'AMMO2': '0.067', 'weapon5': '0.150', 'weapon4': '0.152', 'weapon2': '0.266', 'AMMO3': '0.296', 'AMMO4': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.066', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:45,134][52658] DAMAGECOUNT value on done: 513988.0 [2024-08-06 04:22:45,134][52658] Sum rewards: 76.114, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.256', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.178', 'AMMO3': '0.197', 'weapon4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:45,176][52811] DAMAGECOUNT value on done: 478098.0 [2024-08-06 04:22:45,177][52811] Sum rewards: 68.656, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:45,206][52662] DAMAGECOUNT value on done: 511645.0 [2024-08-06 04:22:45,209][52662] Sum rewards: 73.388, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.525', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.148', 'weapon2': '0.218', 'AMMO4': '0.250', 'weapon5': '0.256', 'AMMO3': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:45,461][52671] DAMAGECOUNT value on done: 519804.0 [2024-08-06 04:22:45,470][52671] Sum rewards: 72.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.032', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.114', 'AMMO3': '0.182', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.046', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:45,704][52660] DAMAGECOUNT value on done: 513465.0 [2024-08-06 04:22:45,705][52660] Sum rewards: 76.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.971', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.142', 'AMMO3': '0.186', 'weapon5': '0.204', 'AMMO4': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:46,870][52803] DAMAGECOUNT value on done: 484133.0 [2024-08-06 04:22:46,872][52803] Sum rewards: 48.887, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.340', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.114', 'weapon5': '0.148', 'AMMO4': '0.221', 'weapon2': '0.262', 'AMMO3': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.660', 'weapon3': '3.202', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '46.000'} [2024-08-06 04:22:47,075][52665] DAMAGECOUNT value on done: 515710.0 [2024-08-06 04:22:47,075][52665] Sum rewards: 68.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.983', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.410', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:47,123][52647] DAMAGECOUNT value on done: 540625.0 [2024-08-06 04:22:47,124][52647] Sum rewards: 67.177, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.094', 'weapon5': '0.168', 'AMMO4': '0.247', 'weapon2': '0.248', 'AMMO3': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.178', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:47,381][52650] Updated weights for policy 0, policy_version 53001 (0.0013) [2024-08-06 04:22:47,714][52668] DAMAGECOUNT value on done: 502473.0 [2024-08-06 04:22:47,714][52668] Sum rewards: 67.144, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.914', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.146', 'weapon4': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '57.000'} [2024-08-06 04:22:47,793][52664] DAMAGECOUNT value on done: 537032.0 [2024-08-06 04:22:47,794][52664] Sum rewards: 83.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '67.000'} [2024-08-06 04:22:47,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 434192384. Throughput: 0: 4368.0. Samples: 108548140. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 04:22:47,795][52567] Avg episode reward: [(0, '70.794')] [2024-08-06 04:22:47,965][52671] DAMAGECOUNT value on done: 515364.0 [2024-08-06 04:22:47,966][52671] Sum rewards: 59.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.074', 'AMMO3': '0.177', 'weapon5': '0.180', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.042', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '49.000'} [2024-08-06 04:22:48,162][52658] DAMAGECOUNT value on done: 513181.0 [2024-08-06 04:22:48,163][52658] Sum rewards: 69.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.140', 'AMMO4': '0.151', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 04:22:48,380][52811] DAMAGECOUNT value on done: 484249.0 [2024-08-06 04:22:48,380][52811] Sum rewards: 74.120, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.042', 'weapon5': '0.052', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.242', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.424', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '64.500'} [2024-08-06 04:22:48,391][52662] DAMAGECOUNT value on done: 519810.0 [2024-08-06 04:22:48,391][52662] Sum rewards: 65.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.942', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.034', 'AMMO4': '0.110', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '53.500'} [2024-08-06 04:22:48,869][52660] DAMAGECOUNT value on done: 510432.0 [2024-08-06 04:22:48,869][52660] Sum rewards: 74.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.082', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:50,003][52647] DAMAGECOUNT value on done: 531611.0 [2024-08-06 04:22:50,003][52647] Sum rewards: 68.747, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.364', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.092', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.360', 'WEAPON3': '0.950', 'weapon3': '3.092', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '55.000'} [2024-08-06 04:22:50,025][52803] DAMAGECOUNT value on done: 481653.0 [2024-08-06 04:22:50,027][52803] Sum rewards: 67.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.448', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO3': '0.126', 'weapon4': '0.166', 'AMMO4': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon2': '1.240', 'weapon3': '2.316', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:50,084][52665] DAMAGECOUNT value on done: 509357.0 [2024-08-06 04:22:50,084][52665] Sum rewards: 64.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO4': '0.215', 'AMMO3': '0.222', 'weapon5': '0.250', 'weapon4': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '55.000'} [2024-08-06 04:22:50,720][52671] DAMAGECOUNT value on done: 513634.0 [2024-08-06 04:22:50,720][52671] Sum rewards: 74.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.886', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '60.000'} [2024-08-06 04:22:50,721][52664] DAMAGECOUNT value on done: 537337.0 [2024-08-06 04:22:50,723][52664] Sum rewards: 65.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon2': '0.250', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'HITCOUNT': '3.250', 'weapon3': '3.442', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:50,822][52658] DAMAGECOUNT value on done: 511877.0 [2024-08-06 04:22:50,823][52658] Sum rewards: 84.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.169', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.293', 'weapon2': '0.328', 'WEAPON3': '1.700', 'weapon3': '3.438', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '72.000'} [2024-08-06 04:22:50,823][52668] DAMAGECOUNT value on done: 503671.0 [2024-08-06 04:22:50,824][52668] Sum rewards: 66.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.635', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.142', 'AMMO3': '0.199', 'weapon5': '0.204', 'AMMO4': '0.230', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.110', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '55.000'} [2024-08-06 04:22:51,063][52662] DAMAGECOUNT value on done: 514597.0 [2024-08-06 04:22:51,065][52662] Sum rewards: 70.719, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.220', 'HEALTH': '0.220', 'weapon2': '0.258', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:51,460][52650] Updated weights for policy 0, policy_version 53011 (0.0026) [2024-08-06 04:22:51,563][52811] DAMAGECOUNT value on done: 479455.0 [2024-08-06 04:22:51,563][52811] Sum rewards: 63.374, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.985', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.110', 'AMMO3': '0.206', 'AMMO4': '0.225', 'weapon5': '0.232', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '52.000'} [2024-08-06 04:22:52,068][52660] DAMAGECOUNT value on done: 509153.0 [2024-08-06 04:22:52,069][52660] Sum rewards: 66.101, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.112', 'weapon4': '0.114', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:52,659][52665] DAMAGECOUNT value on done: 506353.0 [2024-08-06 04:22:52,661][52665] Sum rewards: 75.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.068', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.736', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 434282496. Throughput: 0: 4360.4. Samples: 108574330. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 04:22:52,794][52567] Avg episode reward: [(0, '70.350')] [2024-08-06 04:22:52,916][52647] DAMAGECOUNT value on done: 544502.0 [2024-08-06 04:22:52,918][52647] Sum rewards: 62.434, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.120', 'weapon5': '0.124', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.066', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '51.000'} [2024-08-06 04:22:53,062][52803] DAMAGECOUNT value on done: 471666.0 [2024-08-06 04:22:53,065][52803] Sum rewards: 77.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.788', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '63.000'} [2024-08-06 04:22:53,580][52658] DAMAGECOUNT value on done: 503890.0 [2024-08-06 04:22:53,581][52658] Sum rewards: 75.777, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.130', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO3': '0.257', 'WEAPON3': '1.600', 'weapon3': '3.328', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '65.000'} [2024-08-06 04:22:53,602][52664] DAMAGECOUNT value on done: 528177.0 [2024-08-06 04:22:53,603][52664] Sum rewards: 84.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.733', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.052', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '71.000'} [2024-08-06 04:22:53,978][52662] DAMAGECOUNT value on done: 522220.0 [2024-08-06 04:22:53,979][52662] Sum rewards: 66.422, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.530', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.084', 'weapon4': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.268', 'AMMO3': '0.302', 'WEAPON3': '1.800', 'weapon3': '3.320', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:54,155][52668] DAMAGECOUNT value on done: 511507.0 [2024-08-06 04:22:54,158][52668] Sum rewards: 66.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.779', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.156', 'weapon5': '0.194', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '57.000'} [2024-08-06 04:22:54,642][52811] DAMAGECOUNT value on done: 480561.0 [2024-08-06 04:22:54,643][52811] Sum rewards: 90.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.222', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.309', 'FRAGCOUNT': '73.000'} [2024-08-06 04:22:55,130][52660] DAMAGECOUNT value on done: 517805.0 [2024-08-06 04:22:55,131][52660] Sum rewards: 70.275, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.295', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.408', 'WEAPON3': '1.000', 'HITCOUNT': '3.360', 'weapon3': '3.382', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:55,488][52665] DAMAGECOUNT value on done: 496493.0 [2024-08-06 04:22:55,489][52665] Sum rewards: 53.644, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.002', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.126', 'AMMO4': '0.216', 'weapon4': '0.222', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.712', 'WEAPON3': '1.400', 'weapon3': '2.674', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '48.000'} [2024-08-06 04:22:55,864][52647] DAMAGECOUNT value on done: 536136.0 [2024-08-06 04:22:55,865][52647] Sum rewards: 57.737, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.280', 'AMMO5': '0.024', 'AMMO2': '0.037', 'weapon4': '0.130', 'AMMO4': '0.184', 'AMMO3': '0.273', 'weapon5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.794', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '51.000'} [2024-08-06 04:22:56,280][52803] DAMAGECOUNT value on done: 474698.0 [2024-08-06 04:22:56,280][52803] Sum rewards: 70.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.146', 'AMMO4': '0.163', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '58.000'} [2024-08-06 04:22:56,331][52658] DAMAGECOUNT value on done: 520549.0 [2024-08-06 04:22:56,331][52658] Sum rewards: 72.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.904', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.172', 'weapon4': '0.190', 'AMMO3': '0.211', 'AMMO4': '0.225', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '61.000'} [2024-08-06 04:22:56,683][52650] Updated weights for policy 0, policy_version 53021 (0.0016) [2024-08-06 04:22:56,723][52668] DAMAGECOUNT value on done: 514982.0 [2024-08-06 04:22:56,723][52668] Sum rewards: 70.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.167', 'weapon4': '0.222', 'weapon5': '0.228', 'AMMO4': '0.246', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.940', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '57.000'} [2024-08-06 04:22:56,789][52664] DAMAGECOUNT value on done: 534344.0 [2024-08-06 04:22:56,789][52664] Sum rewards: 75.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.438', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO4': '0.166', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '62.000'} [2024-08-06 04:22:57,107][52662] DAMAGECOUNT value on done: 517444.0 [2024-08-06 04:22:57,110][52662] Sum rewards: 67.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.160', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '56.000'} [2024-08-06 04:22:57,699][52811] DAMAGECOUNT value on done: 490373.0 [2024-08-06 04:22:57,700][52811] Sum rewards: 71.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.757', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'weapon4': '0.112', 'AMMO4': '0.126', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.382', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:57,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 434372608. Throughput: 0: 4354.5. Samples: 108600220. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 04:22:57,794][52567] Avg episode reward: [(0, '70.873')] [2024-08-06 04:22:57,984][52660] DAMAGECOUNT value on done: 512859.0 [2024-08-06 04:22:57,986][52660] Sum rewards: 73.524, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO3': '0.169', 'AMMO4': '0.171', 'weapon4': '0.184', 'weapon2': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:58,453][52665] DAMAGECOUNT value on done: 503866.0 [2024-08-06 04:22:58,454][52665] Sum rewards: 69.881, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.904', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.246', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:58,880][52658] DAMAGECOUNT value on done: 513942.0 [2024-08-06 04:22:58,881][52658] Sum rewards: 88.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.876', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '72.000'} [2024-08-06 04:22:58,985][52647] DAMAGECOUNT value on done: 545652.0 [2024-08-06 04:22:58,985][52647] Sum rewards: 65.628, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.095', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.194', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.396', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '54.000'} [2024-08-06 04:22:59,453][52803] DAMAGECOUNT value on done: 473033.0 [2024-08-06 04:22:59,453][52803] Sum rewards: 75.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.324', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.136', 'weapon5': '0.168', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '0.850', 'weapon3': '2.848', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '59.000'} [2024-08-06 04:22:59,621][52668] DAMAGECOUNT value on done: 512996.0 [2024-08-06 04:22:59,623][52668] Sum rewards: 76.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.241', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.000'} [2024-08-06 04:22:59,626][52664] DAMAGECOUNT value on done: 532089.0 [2024-08-06 04:22:59,627][52664] Sum rewards: 77.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '65.000'} [2024-08-06 04:23:00,261][52662] DAMAGECOUNT value on done: 509102.0 [2024-08-06 04:23:00,269][52662] Sum rewards: 62.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:00,607][52660] DAMAGECOUNT value on done: 511592.0 [2024-08-06 04:23:00,609][52660] Sum rewards: 68.872, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.100', 'weapon5': '0.218', 'AMMO3': '0.277', 'AMMO4': '0.317', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.600', 'weapon3': '2.790', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:00,798][52811] DAMAGECOUNT value on done: 478035.0 [2024-08-06 04:23:00,798][52811] Sum rewards: 60.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.901', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.167', 'AMMO4': '0.237', 'weapon5': '0.270', 'weapon4': '0.362', 'WEAPON5': '0.500', 'weapon2': '0.586', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.478', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '49.500'} [2024-08-06 04:23:00,987][52650] Updated weights for policy 0, policy_version 53031 (0.0012) [2024-08-06 04:23:01,433][52647] DAMAGECOUNT value on done: 538678.0 [2024-08-06 04:23:01,434][52647] Sum rewards: 68.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.394', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:01,731][52665] DAMAGECOUNT value on done: 508310.0 [2024-08-06 04:23:01,731][52665] Sum rewards: 80.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.050', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon5': '0.124', 'AMMO3': '0.175', 'AMMO4': '0.200', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.254', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '66.000'} [2024-08-06 04:23:01,915][52658] DAMAGECOUNT value on done: 514724.0 [2024-08-06 04:23:01,916][52658] Sum rewards: 66.097, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.026', 'HEALTH': '0.064', 'weapon4': '0.086', 'weapon5': '0.092', 'AMMO4': '0.129', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.560', 'WEAPON3': '0.950', 'weapon3': '3.026', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '53.000'} [2024-08-06 04:23:02,220][52668] DAMAGECOUNT value on done: 515621.0 [2024-08-06 04:23:02,220][52668] Sum rewards: 58.215, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.976', 'AMMO5': '0.013', 'AMMO2': '0.062', 'weapon4': '0.146', 'weapon5': '0.216', 'weapon2': '0.232', 'AMMO4': '0.310', 'AMMO3': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'HITCOUNT': '3.000', 'weapon3': '3.072', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '52.000'} [2024-08-06 04:23:02,448][52664] DAMAGECOUNT value on done: 530482.0 [2024-08-06 04:23:02,449][52664] Sum rewards: 75.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '64.000'} [2024-08-06 04:23:02,630][52803] DAMAGECOUNT value on done: 478471.0 [2024-08-06 04:23:02,630][52803] Sum rewards: 72.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.121', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.120', 'AMMO3': '0.188', 'weapon4': '0.204', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '58.500'} [2024-08-06 04:23:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 434454528. Throughput: 0: 4360.2. Samples: 108613480. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 04:23:02,795][52567] Avg episode reward: [(0, '70.997')] [2024-08-06 04:23:03,190][52660] DAMAGECOUNT value on done: 517755.0 [2024-08-06 04:23:03,190][52660] Sum rewards: 61.216, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.420', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon5': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.169', 'weapon2': '0.874', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '50.000'} [2024-08-06 04:23:03,483][52662] DAMAGECOUNT value on done: 514936.0 [2024-08-06 04:23:03,487][52662] Sum rewards: 63.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.166', 'AMMO4': '0.166', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'weapon4': '0.380', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '51.500'} [2024-08-06 04:23:03,872][52811] DAMAGECOUNT value on done: 477622.0 [2024-08-06 04:23:03,873][52811] Sum rewards: 59.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.648', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.158', 'weapon5': '0.186', 'AMMO4': '0.224', 'AMMO3': '0.271', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.918', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '53.000'} [2024-08-06 04:23:04,047][52664] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 04:23:04,168][52647] DAMAGECOUNT value on done: 529666.0 [2024-08-06 04:23:04,170][52647] Sum rewards: 78.368, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.064', 'AMMO4': '0.073', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'weapon3': '3.458', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '65.000'} [2024-08-06 04:23:04,656][52665] DAMAGECOUNT value on done: 508410.0 [2024-08-06 04:23:04,660][52665] Sum rewards: 66.422, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.638', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '55.000'} [2024-08-06 04:23:04,787][52668] DAMAGECOUNT value on done: 514730.0 [2024-08-06 04:23:04,787][52668] Sum rewards: 76.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.138', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '65.000'} [2024-08-06 04:23:04,850][52658] DAMAGECOUNT value on done: 519112.0 [2024-08-06 04:23:04,852][52658] Sum rewards: 69.979, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.046', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.552', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:05,216][52664] DAMAGECOUNT value on done: 526831.0 [2024-08-06 04:23:05,217][52664] Sum rewards: 64.551, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.009', 'AMMO2': '0.046', 'weapon5': '0.096', 'weapon4': '0.116', 'AMMO4': '0.232', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '3.064', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '56.000'} [2024-08-06 04:23:05,606][52803] DAMAGECOUNT value on done: 469990.0 [2024-08-06 04:23:05,606][52803] Sum rewards: 79.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO5': '0.020', 'AMMO2': '0.069', 'AMMO3': '0.200', 'weapon5': '0.296', 'weapon2': '0.306', 'AMMO4': '0.346', 'weapon4': '0.370', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '66.000'} [2024-08-06 04:23:05,727][52650] Updated weights for policy 0, policy_version 53041 (0.0029) [2024-08-06 04:23:05,855][52664] Large shaping reward 3.651 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:23:05,874][52660] DAMAGECOUNT value on done: 504768.0 [2024-08-06 04:23:05,875][52660] Sum rewards: 69.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.954', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.143', 'AMMO3': '0.175', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '55.000'} [2024-08-06 04:23:06,203][52662] DAMAGECOUNT value on done: 509516.0 [2024-08-06 04:23:06,205][52662] Sum rewards: 83.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.102', 'weapon5': '0.128', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '71.000'} [2024-08-06 04:23:06,880][52811] DAMAGECOUNT value on done: 478869.0 [2024-08-06 04:23:06,881][52811] Sum rewards: 63.116, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.410', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.155', 'weapon5': '0.174', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.436', 'weapon2': '0.710', 'WEAPON3': '0.950', 'weapon3': '2.486', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '50.000'} [2024-08-06 04:23:07,131][52647] DAMAGECOUNT value on done: 538479.0 [2024-08-06 04:23:07,132][52647] Sum rewards: 65.612, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.124', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.140', 'weapon5': '0.202', 'AMMO3': '0.259', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '56.000'} [2024-08-06 04:23:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 434544640. Throughput: 0: 4347.1. Samples: 108639500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:23:07,794][52567] Avg episode reward: [(0, '70.249')] [2024-08-06 04:23:07,849][52665] DAMAGECOUNT value on done: 515708.0 [2024-08-06 04:23:07,849][52665] Sum rewards: 73.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.948', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.050', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.223', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:08,007][52664] DAMAGECOUNT value on done: 537740.0 [2024-08-06 04:23:08,008][52664] Sum rewards: 63.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.132', 'weapon4': '0.148', 'AMMO3': '0.175', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '50.500'} [2024-08-06 04:23:08,730][52803] DAMAGECOUNT value on done: 486084.0 [2024-08-06 04:23:08,731][52660] DAMAGECOUNT value on done: 511541.0 [2024-08-06 04:23:08,733][52660] Sum rewards: 62.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '51.000'} [2024-08-06 04:23:08,734][52803] Sum rewards: 73.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.160', 'AMMO4': '0.163', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '61.000'} [2024-08-06 04:23:09,623][52794] DAMAGECOUNT value on done: 517365.0 [2024-08-06 04:23:09,623][52794] Sum rewards: 68.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.661', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '58.000'} [2024-08-06 04:23:09,911][52811] DAMAGECOUNT value on done: 475322.0 [2024-08-06 04:23:09,911][52811] Sum rewards: 74.510, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.376', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.129', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'AMMO3': '0.319', 'WEAPON3': '1.850', 'weapon3': '3.088', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '67.000'} [2024-08-06 04:23:10,014][52647] DAMAGECOUNT value on done: 534015.0 [2024-08-06 04:23:10,014][52647] Sum rewards: 66.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.730', 'AMMO5': '0.029', 'AMMO2': '0.076', 'weapon4': '0.152', 'AMMO3': '0.190', 'weapon5': '0.252', 'AMMO4': '0.378', 'weapon2': '0.510', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '57.000'} [2024-08-06 04:23:10,539][52650] Updated weights for policy 0, policy_version 53051 (0.0050) [2024-08-06 04:23:10,884][52664] DAMAGECOUNT value on done: 530165.0 [2024-08-06 04:23:10,892][52664] Sum rewards: 66.232, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.058', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.108', 'weapon5': '0.232', 'AMMO4': '0.279', 'AMMO3': '0.281', 'weapon2': '0.548', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.798', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:11,032][52665] DAMAGECOUNT value on done: 505750.0 [2024-08-06 04:23:11,033][52665] Sum rewards: 76.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.084', 'weapon5': '0.152', 'AMMO4': '0.161', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.000'} [2024-08-06 04:23:11,342][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:23:11,533][52660] DAMAGECOUNT value on done: 521440.0 [2024-08-06 04:23:11,535][52660] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.776', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.074', 'AMMO4': '0.161', 'AMMO3': '0.204', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.120', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '53.000'} [2024-08-06 04:23:11,943][52803] DAMAGECOUNT value on done: 481011.0 [2024-08-06 04:23:11,945][52803] Sum rewards: 70.104, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.174', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.138', 'AMMO4': '0.146', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.248', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '57.000'} [2024-08-06 04:23:12,546][52659] DAMAGECOUNT value on done: 518476.0 [2024-08-06 04:23:12,547][52659] Sum rewards: 61.551, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.185', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.054', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.264', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.478', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '50.000'} [2024-08-06 04:23:12,652][52794] DAMAGECOUNT value on done: 520106.0 [2024-08-06 04:23:12,654][52794] Sum rewards: 88.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.176', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.182', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.910', 'FRAGCOUNT': '71.000'} [2024-08-06 04:23:12,725][52647] DAMAGECOUNT value on done: 532305.0 [2024-08-06 04:23:12,725][52647] Sum rewards: 52.069, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.685', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.046', 'weapon7': '0.092', 'AMMO3': '0.116', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.196', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '0.800', 'weapon4': '0.886', 'weapon3': '2.368', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '12.282', 'FRAGCOUNT': '42.000'} [2024-08-06 04:23:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 434626560. Throughput: 0: 4350.2. Samples: 108665900. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:23:12,794][52567] Avg episode reward: [(0, '69.973')] [2024-08-06 04:23:13,059][52811] DAMAGECOUNT value on done: 480608.0 [2024-08-06 04:23:13,060][52811] Sum rewards: 71.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.117', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.096', 'weapon4': '0.124', 'AMMO4': '0.177', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '59.000'} [2024-08-06 04:23:13,714][52665] DAMAGECOUNT value on done: 515753.0 [2024-08-06 04:23:13,714][52665] Sum rewards: 65.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.672', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:14,090][52664] DAMAGECOUNT value on done: 539770.0 [2024-08-06 04:23:14,091][52664] Sum rewards: 76.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.252', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '63.000'} [2024-08-06 04:23:14,561][52660] DAMAGECOUNT value on done: 527456.0 [2024-08-06 04:23:14,563][52660] Sum rewards: 93.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.232', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.231', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '4.430', 'DAMAGECOUNT': '21.423', 'FRAGCOUNT': '77.000'} [2024-08-06 04:23:15,119][52803] DAMAGECOUNT value on done: 475954.0 [2024-08-06 04:23:15,119][52803] Sum rewards: 79.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.034', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon5': '0.176', 'weapon2': '0.530', 'WEAPON3': '0.950', 'weapon3': '2.996', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '63.000'} [2024-08-06 04:23:15,323][52650] Updated weights for policy 0, policy_version 53061 (0.0024) [2024-08-06 04:23:15,411][52659] DAMAGECOUNT value on done: 513520.0 [2024-08-06 04:23:15,414][52659] Sum rewards: 59.993, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.347', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.966', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '48.000'} [2024-08-06 04:23:15,543][52794] DAMAGECOUNT value on done: 518881.0 [2024-08-06 04:23:15,544][52794] Sum rewards: 61.154, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.170', 'AMMO5': '0.019', 'AMMO2': '0.029', 'weapon4': '0.038', 'AMMO4': '0.145', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.320', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '3.060', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '49.000'} [2024-08-06 04:23:16,165][52811] DAMAGECOUNT value on done: 483323.0 [2024-08-06 04:23:16,173][52811] Sum rewards: 83.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.470', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO3': '0.167', 'AMMO4': '0.198', 'weapon5': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.056', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '65.000'} [2024-08-06 04:23:16,684][52664] DAMAGECOUNT value on done: 536024.0 [2024-08-06 04:23:16,686][52664] Sum rewards: 70.516, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.552', 'AMMO5': '0.029', 'AMMO2': '0.078', 'AMMO3': '0.232', 'weapon5': '0.280', 'weapon2': '0.304', 'weapon4': '0.348', 'AMMO4': '0.390', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.672', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '61.000'} [2024-08-06 04:23:16,729][52665] DAMAGECOUNT value on done: 512620.0 [2024-08-06 04:23:16,731][52665] Sum rewards: 79.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.156', 'AMMO3': '0.207', 'AMMO4': '0.223', 'weapon4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '66.000'} [2024-08-06 04:23:17,200][52660] DAMAGECOUNT value on done: 508901.0 [2024-08-06 04:23:17,201][52660] Sum rewards: 67.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.128', 'AMMO4': '0.194', 'weapon5': '0.214', 'AMMO3': '0.279', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.066', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '56.500'} [2024-08-06 04:23:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 434716672. Throughput: 0: 4352.9. Samples: 108678940. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:23:17,794][52567] Avg episode reward: [(0, '70.340')] [2024-08-06 04:23:18,191][52794] DAMAGECOUNT value on done: 513153.0 [2024-08-06 04:23:18,192][52794] Sum rewards: 64.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '51.000'} [2024-08-06 04:23:18,408][52803] DAMAGECOUNT value on done: 484103.0 [2024-08-06 04:23:18,408][52803] Sum rewards: 79.116, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.044', 'AMMO3': '0.138', 'weapon5': '0.138', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.256', 'weapon2': '0.462', 'WEAPON3': '0.800', 'weapon3': '3.200', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '62.000'} [2024-08-06 04:23:18,791][52659] DAMAGECOUNT value on done: 518314.0 [2024-08-06 04:23:18,792][52659] Sum rewards: 67.697, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.616', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.140', 'AMMO4': '0.220', 'weapon2': '0.220', 'weapon5': '0.220', 'AMMO3': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.108', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '58.000'} [2024-08-06 04:23:19,217][52811] DAMAGECOUNT value on done: 476432.0 [2024-08-06 04:23:19,219][52811] Sum rewards: 64.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.017', 'AMMO2': '0.069', 'weapon4': '0.190', 'weapon5': '0.232', 'AMMO3': '0.237', 'AMMO4': '0.345', 'weapon2': '0.364', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:19,355][52664] DAMAGECOUNT value on done: 544657.0 [2024-08-06 04:23:19,355][52664] Sum rewards: 83.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.744', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.112', 'weapon5': '0.124', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '70.000'} [2024-08-06 04:23:19,607][52650] Updated weights for policy 0, policy_version 53071 (0.0013) [2024-08-06 04:23:19,689][52660] DAMAGECOUNT value on done: 516269.0 [2024-08-06 04:23:19,689][52660] Sum rewards: 59.219, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.814', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.090', 'AMMO3': '0.175', 'AMMO4': '0.215', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.560', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '2.930', 'DAMAGECOUNT': '13.833', 'FRAGCOUNT': '47.000'} [2024-08-06 04:23:19,791][52665] DAMAGECOUNT value on done: 509165.0 [2024-08-06 04:23:19,794][52665] Sum rewards: 87.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.439', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO4': '0.021', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.448', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '72.000'} [2024-08-06 04:23:21,060][52794] DAMAGECOUNT value on done: 511613.0 [2024-08-06 04:23:21,061][52794] Sum rewards: 60.522, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.092', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon4': '0.094', 'AMMO3': '0.249', 'weapon5': '0.274', 'AMMO4': '0.325', 'weapon2': '0.478', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.832', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '52.000'} [2024-08-06 04:23:21,579][52803] DAMAGECOUNT value on done: 478746.0 [2024-08-06 04:23:21,581][52803] Sum rewards: 61.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.142', 'AMMO4': '0.192', 'weapon4': '0.224', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.650', 'weapon3': '2.880', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '53.000'} [2024-08-06 04:23:21,928][52664] DAMAGECOUNT value on done: 539160.0 [2024-08-06 04:23:21,930][52664] Sum rewards: 71.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon5': '0.146', 'AMMO3': '0.199', 'AMMO4': '0.247', 'weapon2': '0.398', 'weapon4': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:22,007][52659] DAMAGECOUNT value on done: 515377.0 [2024-08-06 04:23:22,007][52659] Sum rewards: 77.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '64.000'} [2024-08-06 04:23:22,133][52811] DAMAGECOUNT value on done: 478850.0 [2024-08-06 04:23:22,137][52811] Sum rewards: 63.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.821', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.148', 'AMMO4': '0.201', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.168', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '55.000'} [2024-08-06 04:23:22,598][52660] DAMAGECOUNT value on done: 509971.0 [2024-08-06 04:23:22,600][52660] Sum rewards: 71.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '3.290', 'weapon3': '3.398', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '61.000'} [2024-08-06 04:23:22,729][52665] DAMAGECOUNT value on done: 508385.0 [2024-08-06 04:23:22,730][52665] Sum rewards: 76.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.043', 'weapon4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 04:23:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 434806784. Throughput: 0: 4353.1. Samples: 108705200. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:23:22,794][52567] Avg episode reward: [(0, '70.458')] [2024-08-06 04:23:23,618][52659] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:23:24,074][52794] DAMAGECOUNT value on done: 512369.0 [2024-08-06 04:23:24,076][52794] Sum rewards: 68.066, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'weapon2': '0.358', 'WEAPON3': '1.700', 'HITCOUNT': '3.240', 'weapon3': '3.264', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '59.000'} [2024-08-06 04:23:24,628][52803] DAMAGECOUNT value on done: 475531.0 [2024-08-06 04:23:24,628][52803] Sum rewards: 58.450, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.460', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.176', 'weapon4': '0.190', 'weapon2': '0.204', 'AMMO4': '0.254', 'AMMO3': '0.273', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '52.000'} [2024-08-06 04:23:24,771][52659] DAMAGECOUNT value on done: 511993.0 [2024-08-06 04:23:24,772][52659] Sum rewards: 70.546, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.377', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.096', 'weapon5': '0.110', 'AMMO4': '0.178', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.160', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '61.000'} [2024-08-06 04:23:24,847][52650] Updated weights for policy 0, policy_version 53081 (0.0010) [2024-08-06 04:23:25,061][52664] DAMAGECOUNT value on done: 539849.0 [2024-08-06 04:23:25,064][52664] Sum rewards: 68.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.149', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '56.500'} [2024-08-06 04:23:25,379][52665] DAMAGECOUNT value on done: 505757.0 [2024-08-06 04:23:25,381][52665] Sum rewards: 65.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.991', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.180', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:25,408][52663] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:23:25,486][52660] DAMAGECOUNT value on done: 512190.0 [2024-08-06 04:23:25,489][52660] Sum rewards: 72.454, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.282', 'weapon2': '0.412', 'WEAPON3': '1.750', 'weapon3': '3.388', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '62.000'} [2024-08-06 04:23:26,777][52794] DAMAGECOUNT value on done: 521228.0 [2024-08-06 04:23:26,777][52794] Sum rewards: 75.487, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.850', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon4': '0.150', 'AMMO3': '0.263', 'weapon5': '0.264', 'AMMO4': '0.309', 'weapon2': '0.314', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.910', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '64.500'} [2024-08-06 04:23:27,581][52659] DAMAGECOUNT value on done: 514275.0 [2024-08-06 04:23:27,581][52659] Sum rewards: 70.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.596', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.156', 'AMMO4': '0.164', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '55.000'} [2024-08-06 04:23:27,693][52803] DAMAGECOUNT value on done: 481657.0 [2024-08-06 04:23:27,695][52803] Sum rewards: 56.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.222', 'weapon5': '0.266', 'weapon2': '0.282', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '2.806', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '48.500'} [2024-08-06 04:23:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 434888704. Throughput: 0: 4365.8. Samples: 108731580. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:23:27,794][52567] Avg episode reward: [(0, '70.428')] [2024-08-06 04:23:27,961][52664] DAMAGECOUNT value on done: 533376.0 [2024-08-06 04:23:27,962][52664] Sum rewards: 72.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.233', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.196', 'weapon4': '0.208', 'AMMO4': '0.229', 'AMMO3': '0.256', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.996', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:28,250][52665] DAMAGECOUNT value on done: 503342.0 [2024-08-06 04:23:28,251][52665] Sum rewards: 64.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.203', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.720', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:28,674][52660] DAMAGECOUNT value on done: 503698.0 [2024-08-06 04:23:28,676][52660] Sum rewards: 75.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.000'} [2024-08-06 04:23:29,014][52650] Updated weights for policy 0, policy_version 53091 (0.0016) [2024-08-06 04:23:29,846][52794] DAMAGECOUNT value on done: 509049.0 [2024-08-06 04:23:29,847][52794] Sum rewards: 72.239, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.932', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.086', 'weapon5': '0.090', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '62.000'} [2024-08-06 04:23:30,418][52664] DAMAGECOUNT value on done: 529789.0 [2024-08-06 04:23:30,418][52664] Sum rewards: 67.457, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.840', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.132', 'AMMO4': '0.191', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '56.000'} [2024-08-06 04:23:30,524][52659] DAMAGECOUNT value on done: 513966.0 [2024-08-06 04:23:30,525][52659] Sum rewards: 70.684, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.405', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.140', 'AMMO4': '0.193', 'weapon2': '0.220', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.304', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '60.500'} [2024-08-06 04:23:30,829][52803] DAMAGECOUNT value on done: 481871.0 [2024-08-06 04:23:30,829][52803] Sum rewards: 77.757, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO3': '0.217', 'weapon2': '0.328', 'WEAPON3': '1.450', 'HITCOUNT': '3.400', 'weapon3': '3.550', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '67.000'} [2024-08-06 04:23:31,211][52665] DAMAGECOUNT value on done: 507226.0 [2024-08-06 04:23:31,212][52665] Sum rewards: 71.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.341', 'AMMO2': '0.021', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.205', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 434978816. Throughput: 0: 4370.9. Samples: 108744830. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:23:32,795][52567] Avg episode reward: [(0, '70.516')] [2024-08-06 04:23:32,795][52794] DAMAGECOUNT value on done: 518714.0 [2024-08-06 04:23:32,796][52794] Sum rewards: 62.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.472', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:33,384][52664] DAMAGECOUNT value on done: 534462.0 [2024-08-06 04:23:33,384][52664] Sum rewards: 65.676, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.938', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.100', 'AMMO3': '0.186', 'AMMO4': '0.247', 'weapon5': '0.252', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '53.000'} [2024-08-06 04:23:33,441][52659] DAMAGECOUNT value on done: 511759.0 [2024-08-06 04:23:33,441][52659] Sum rewards: 43.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.338', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon2': '0.118', 'AMMO3': '0.125', 'WEAPON4': '0.150', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon7': '0.318', 'WEAPON3': '0.700', 'weapon4': '0.908', 'weapon3': '2.048', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '10.065', 'FRAGCOUNT': '36.000'} [2024-08-06 04:23:33,899][52650] Updated weights for policy 0, policy_version 53101 (0.0013) [2024-08-06 04:23:33,936][52803] DAMAGECOUNT value on done: 483513.0 [2024-08-06 04:23:33,937][52665] DAMAGECOUNT value on done: 503968.0 [2024-08-06 04:23:33,938][52803] Sum rewards: 81.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.021', 'AMMO2': '0.026', 'weapon5': '0.130', 'AMMO4': '0.132', 'weapon4': '0.174', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '66.000'} [2024-08-06 04:23:33,939][52665] Sum rewards: 70.119, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.640', 'AMMO2': '0.009', 'AMMO5': '0.018', 'AMMO4': '0.043', 'AMMO3': '0.165', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.332', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '56.000'} [2024-08-06 04:23:35,249][52794] DAMAGECOUNT value on done: 516113.0 [2024-08-06 04:23:35,250][52794] Sum rewards: 75.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.052', 'AMMO3': '0.168', 'AMMO4': '0.184', 'weapon5': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '60.000'} [2024-08-06 04:23:36,316][52664] DAMAGECOUNT value on done: 532793.0 [2024-08-06 04:23:36,317][52664] Sum rewards: 79.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.796', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '67.000'} [2024-08-06 04:23:36,653][52659] DAMAGECOUNT value on done: 519780.0 [2024-08-06 04:23:36,653][52659] Sum rewards: 62.929, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.512', 'AMMO5': '0.008', 'AMMO2': '0.049', 'AMMO3': '0.115', 'weapon5': '0.154', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO4': '0.245', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '0.750', 'weapon3': '2.894', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.475', 'FRAGCOUNT': '49.500'} [2024-08-06 04:23:36,710][52665] DAMAGECOUNT value on done: 507479.0 [2024-08-06 04:23:36,710][52665] Sum rewards: 68.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.124', 'AMMO4': '0.133', 'weapon5': '0.152', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '55.000'} [2024-08-06 04:23:37,035][52803] DAMAGECOUNT value on done: 474983.0 [2024-08-06 04:23:37,037][52803] Sum rewards: 79.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.781', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '65.000'} [2024-08-06 04:23:37,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 435068928. Throughput: 0: 4368.0. Samples: 108770890. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:23:37,795][52567] Avg episode reward: [(0, '70.270')] [2024-08-06 04:23:37,900][52794] DAMAGECOUNT value on done: 510310.0 [2024-08-06 04:23:37,901][52794] Sum rewards: 68.486, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.754', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.068', 'weapon5': '0.116', 'AMMO4': '0.130', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '58.500'} [2024-08-06 04:23:38,502][52650] Updated weights for policy 0, policy_version 53111 (0.0010) [2024-08-06 04:23:38,776][52664] DAMAGECOUNT value on done: 530824.0 [2024-08-06 04:23:38,778][52664] Sum rewards: 69.303, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.970', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.110', 'weapon5': '0.122', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '54.000'} [2024-08-06 04:23:39,425][52659] DAMAGECOUNT value on done: 523752.0 [2024-08-06 04:23:39,430][52659] Sum rewards: 61.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.105', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO4': '0.172', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '49.000'} [2024-08-06 04:23:39,682][52665] DAMAGECOUNT value on done: 508762.0 [2024-08-06 04:23:39,682][52665] Sum rewards: 72.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.352', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.136', 'AMMO3': '0.197', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.314', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.000'} [2024-08-06 04:23:41,116][52794] DAMAGECOUNT value on done: 516755.0 [2024-08-06 04:23:41,117][52794] Sum rewards: 68.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.024', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.102', 'AMMO3': '0.209', 'weapon5': '0.270', 'AMMO4': '0.293', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.026', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '56.000'} [2024-08-06 04:23:42,184][52659] DAMAGECOUNT value on done: 513099.0 [2024-08-06 04:23:42,192][52659] Sum rewards: 73.368, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO4': '0.251', 'AMMO3': '0.260', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '63.000'} [2024-08-06 04:23:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 435159040. Throughput: 0: 4381.8. Samples: 108797400. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:23:42,794][52567] Avg episode reward: [(0, '70.095')] [2024-08-06 04:23:43,140][52650] Updated weights for policy 0, policy_version 53121 (0.0026) [2024-08-06 04:23:44,136][52794] DAMAGECOUNT value on done: 508568.0 [2024-08-06 04:23:44,138][52794] Sum rewards: 70.176, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.168', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.098', 'AMMO3': '0.194', 'weapon4': '0.194', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '59.000'} [2024-08-06 04:23:45,422][52659] DAMAGECOUNT value on done: 517303.0 [2024-08-06 04:23:45,423][52659] Sum rewards: 63.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.178', 'weapon5': '0.208', 'AMMO4': '0.326', 'weapon4': '0.364', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '2.546', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '52.000'} [2024-08-06 04:23:47,259][52794] DAMAGECOUNT value on done: 527846.0 [2024-08-06 04:23:47,267][52794] Sum rewards: 75.058, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.140', 'weapon4': '0.172', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '63.000'} [2024-08-06 04:23:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 435240960. Throughput: 0: 4379.5. Samples: 108810560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:23:47,795][52567] Avg episode reward: [(0, '69.943')] [2024-08-06 04:23:47,856][52650] Updated weights for policy 0, policy_version 53131 (0.0019) [2024-08-06 04:23:48,222][52659] DAMAGECOUNT value on done: 509448.0 [2024-08-06 04:23:48,223][52659] Sum rewards: 75.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.052', 'AMMO4': '0.060', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '62.000'} [2024-08-06 04:23:49,960][52794] DAMAGECOUNT value on done: 509257.0 [2024-08-06 04:23:49,960][52794] Sum rewards: 72.212, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.610', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.170', 'AMMO4': '0.212', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.850', 'weapon3': '3.134', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '64.000'} [2024-08-06 04:23:50,923][52659] DAMAGECOUNT value on done: 514163.0 [2024-08-06 04:23:50,923][52659] Sum rewards: 66.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.982', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.170', 'AMMO3': '0.210', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.416', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '56.000'} [2024-08-06 04:23:50,974][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:23:52,443][52650] Updated weights for policy 0, policy_version 53141 (0.0021) [2024-08-06 04:23:52,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 435331072. Throughput: 0: 4385.7. Samples: 108836860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:23:52,795][52567] Avg episode reward: [(0, '69.775')] [2024-08-06 04:23:53,197][52794] DAMAGECOUNT value on done: 525917.0 [2024-08-06 04:23:53,197][52794] Sum rewards: 72.239, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.624', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.098', 'weapon5': '0.236', 'AMMO4': '0.242', 'AMMO3': '0.246', 'weapon2': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '61.000'} [2024-08-06 04:23:53,917][52659] DAMAGECOUNT value on done: 525266.0 [2024-08-06 04:23:53,919][52659] Sum rewards: 74.075, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.298', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.126', 'weapon4': '0.128', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '65.000'} [2024-08-06 04:23:55,944][52649] DAMAGECOUNT value on done: 499209.0 [2024-08-06 04:23:55,944][52649] Sum rewards: 67.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.188', 'AMMO3': '0.238', 'weapon2': '0.248', 'weapon4': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '57.000'} [2024-08-06 04:23:56,043][52794] DAMAGECOUNT value on done: 515502.0 [2024-08-06 04:23:56,044][52794] Sum rewards: 87.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.186', 'weapon4': '0.210', 'weapon5': '0.212', 'AMMO4': '0.243', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.525', 'FRAGCOUNT': '70.000'} [2024-08-06 04:23:56,472][52663] DAMAGECOUNT value on done: 523042.0 [2024-08-06 04:23:56,472][52663] Sum rewards: 62.385, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.845', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.286', 'weapon2': '0.438', 'WEAPON3': '1.700', 'weapon3': '3.148', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '55.000'} [2024-08-06 04:23:56,926][52659] DAMAGECOUNT value on done: 517772.0 [2024-08-06 04:23:56,928][52659] Sum rewards: 60.504, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.082', 'AMMO3': '0.160', 'AMMO4': '0.196', 'weapon5': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '2.894', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '49.000'} [2024-08-06 04:23:57,209][52650] Updated weights for policy 0, policy_version 53151 (0.0032) [2024-08-06 04:23:57,655][52795] DAMAGECOUNT value on done: 478282.0 [2024-08-06 04:23:57,657][52795] Sum rewards: 75.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.694', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.156', 'AMMO4': '0.183', 'weapon4': '0.252', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.600', 'weapon3': '2.840', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '64.000'} [2024-08-06 04:23:57,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 435412992. Throughput: 0: 4386.2. Samples: 108863280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:23:57,794][52567] Avg episode reward: [(0, '70.117')] [2024-08-06 04:23:58,654][52794] DAMAGECOUNT value on done: 524195.0 [2024-08-06 04:23:58,654][52794] Sum rewards: 78.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.377', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.172', 'weapon5': '0.176', 'AMMO3': '0.216', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '64.000'} [2024-08-06 04:23:58,942][52649] DAMAGECOUNT value on done: 491555.0 [2024-08-06 04:23:58,950][52649] Sum rewards: 81.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.142', 'AMMO4': '0.173', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '67.000'} [2024-08-06 04:23:59,549][52659] DAMAGECOUNT value on done: 520819.0 [2024-08-06 04:23:59,550][52659] Sum rewards: 75.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'AMMO3': '0.245', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.550', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '63.000'} [2024-08-06 04:23:59,674][52663] DAMAGECOUNT value on done: 516126.0 [2024-08-06 04:23:59,674][52663] Sum rewards: 83.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'weapon3': '3.356', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '70.000'} [2024-08-06 04:24:00,828][52795] DAMAGECOUNT value on done: 467750.0 [2024-08-06 04:24:00,830][52795] Sum rewards: 74.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.485', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.135', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:01,718][52650] Updated weights for policy 0, policy_version 53161 (0.0013) [2024-08-06 04:24:01,780][52794] DAMAGECOUNT value on done: 525982.0 [2024-08-06 04:24:01,782][52794] Sum rewards: 87.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.208', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.148', 'AMMO4': '0.152', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '71.000'} [2024-08-06 04:24:02,202][52649] DAMAGECOUNT value on done: 507438.0 [2024-08-06 04:24:02,202][52649] Sum rewards: 76.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.821', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.218', 'weapon2': '0.606', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:02,281][52663] DAMAGECOUNT value on done: 509527.0 [2024-08-06 04:24:02,284][52663] Sum rewards: 72.136, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.910', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon2': '0.128', 'weapon5': '0.132', 'AMMO4': '0.162', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.428', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:02,410][52659] DAMAGECOUNT value on done: 515773.0 [2024-08-06 04:24:02,410][52659] Sum rewards: 80.206, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon2': '0.196', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'weapon3': '3.622', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 435503104. Throughput: 0: 4386.7. Samples: 108876340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:24:02,794][52567] Avg episode reward: [(0, '70.962')] [2024-08-06 04:24:03,937][52795] DAMAGECOUNT value on done: 468122.0 [2024-08-06 04:24:03,937][52795] Sum rewards: 80.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.096', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:04,908][52794] DAMAGECOUNT value on done: 513215.0 [2024-08-06 04:24:04,910][52794] Sum rewards: 60.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.630', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.126', 'weapon5': '0.234', 'AMMO3': '0.238', 'AMMO4': '0.255', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.964', 'DAMAGECOUNT': '13.848', 'FRAGCOUNT': '54.000'} [2024-08-06 04:24:05,058][52663] DAMAGECOUNT value on done: 513294.0 [2024-08-06 04:24:05,058][52663] Sum rewards: 74.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.345', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.110', 'AMMO4': '0.159', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '61.000'} [2024-08-06 04:24:05,266][52649] DAMAGECOUNT value on done: 501929.0 [2024-08-06 04:24:05,266][52649] Sum rewards: 75.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.074', 'weapon5': '0.152', 'AMMO3': '0.241', 'AMMO4': '0.254', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:05,422][52659] DAMAGECOUNT value on done: 519835.0 [2024-08-06 04:24:05,426][52659] Sum rewards: 74.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.176', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.220', 'AMMO3': '0.227', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.430', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '63.000'} [2024-08-06 04:24:06,712][52650] Updated weights for policy 0, policy_version 53171 (0.0030) [2024-08-06 04:24:07,272][52795] DAMAGECOUNT value on done: 474556.0 [2024-08-06 04:24:07,273][52795] Sum rewards: 59.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.203', 'weapon5': '0.252', 'weapon2': '0.308', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.718', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.379', 'FRAGCOUNT': '50.000'} [2024-08-06 04:24:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 435601408. Throughput: 0: 4388.4. Samples: 108902680. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:24:07,794][52567] Avg episode reward: [(0, '70.948')] [2024-08-06 04:24:07,908][52663] DAMAGECOUNT value on done: 514198.0 [2024-08-06 04:24:07,909][52663] Sum rewards: 70.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.132', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:08,263][52666] DAMAGECOUNT value on done: 513919.0 [2024-08-06 04:24:08,265][52666] Sum rewards: 80.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.352', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.209', 'weapon2': '0.284', 'WEAPON5': '0.400', 'weapon4': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '65.000'} [2024-08-06 04:24:08,324][52659] DAMAGECOUNT value on done: 517014.0 [2024-08-06 04:24:08,326][52659] Sum rewards: 78.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '65.000'} [2024-08-06 04:24:08,559][52649] DAMAGECOUNT value on done: 492159.0 [2024-08-06 04:24:08,560][52649] Sum rewards: 68.213, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.130', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.104', 'weapon5': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:10,469][52795] DAMAGECOUNT value on done: 470022.0 [2024-08-06 04:24:10,469][52795] Sum rewards: 69.187, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.215', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.162', 'weapon2': '0.578', 'WEAPON3': '0.950', 'HITCOUNT': '3.130', 'weapon3': '3.252', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '55.000'} [2024-08-06 04:24:10,566][52663] DAMAGECOUNT value on done: 521579.0 [2024-08-06 04:24:10,567][52663] Sum rewards: 72.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.740', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.168', 'weapon4': '0.218', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.700', 'weapon3': '2.866', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:11,127][52666] DAMAGECOUNT value on done: 516933.0 [2024-08-06 04:24:11,131][52666] Sum rewards: 79.891, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.912', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO4': '0.158', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '3.400', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '63.000'} [2024-08-06 04:24:11,149][52670] DAMAGECOUNT value on done: 505065.0 [2024-08-06 04:24:11,151][52670] Sum rewards: 64.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.212', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '53.000'} [2024-08-06 04:24:11,386][52650] Updated weights for policy 0, policy_version 53181 (0.0018) [2024-08-06 04:24:11,611][52649] DAMAGECOUNT value on done: 503181.0 [2024-08-06 04:24:11,612][52649] Sum rewards: 67.730, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'HEALTH': '0.010', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon2': '0.656', 'WEAPON3': '0.950', 'weapon3': '3.156', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '53.000'} [2024-08-06 04:24:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 435683328. Throughput: 0: 4385.6. Samples: 108928930. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:24:12,794][52567] Avg episode reward: [(0, '71.199')] [2024-08-06 04:24:13,168][52663] DAMAGECOUNT value on done: 516364.0 [2024-08-06 04:24:13,169][52663] Sum rewards: 68.151, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.314', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.204', 'AMMO3': '0.267', 'weapon2': '0.282', 'weapon4': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.876', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:13,546][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:24:13,619][52795] DAMAGECOUNT value on done: 478999.0 [2024-08-06 04:24:13,619][52795] Sum rewards: 70.156, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.263', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.179', 'weapon2': '0.206', 'weapon5': '0.224', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.702', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:14,272][52670] DAMAGECOUNT value on done: 515780.0 [2024-08-06 04:24:14,273][52666] DAMAGECOUNT value on done: 518635.0 [2024-08-06 04:24:14,273][52670] Sum rewards: 66.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.505', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.094', 'weapon4': '0.100', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.266', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:14,274][52666] Sum rewards: 74.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.305', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.185', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:14,462][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:24:14,646][52649] DAMAGECOUNT value on done: 500631.0 [2024-08-06 04:24:14,646][52649] Sum rewards: 68.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.602', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.114', 'AMMO4': '0.141', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:15,860][52663] DAMAGECOUNT value on done: 511630.0 [2024-08-06 04:24:15,869][52663] Sum rewards: 82.169, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.125', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.097', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON3': '1.250', 'HITCOUNT': '3.420', 'weapon3': '3.518', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:16,101][52650] Updated weights for policy 0, policy_version 53191 (0.0029) [2024-08-06 04:24:16,400][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:24:16,755][52795] DAMAGECOUNT value on done: 484846.0 [2024-08-06 04:24:16,758][52795] Sum rewards: 78.603, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.878', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.096', 'weapon5': '0.128', 'AMMO4': '0.179', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.144', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '65.000'} [2024-08-06 04:24:16,865][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:24:16,990][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:24:17,010][52666] DAMAGECOUNT value on done: 517174.0 [2024-08-06 04:24:17,013][52666] Sum rewards: 78.745, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.019', 'HEALTH': '0.054', 'AMMO4': '0.096', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.404', 'weapon4': '0.448', 'WEAPON3': '0.900', 'weapon3': '2.846', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:17,040][52670] DAMAGECOUNT value on done: 509219.0 [2024-08-06 04:24:17,042][52670] Sum rewards: 72.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.028', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.180', 'weapon4': '0.190', 'AMMO3': '0.226', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:17,471][52649] DAMAGECOUNT value on done: 504174.0 [2024-08-06 04:24:17,473][52649] Sum rewards: 77.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.505', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.046', 'AMMO4': '0.060', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 435773440. Throughput: 0: 4386.4. Samples: 108942220. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:24:17,795][52567] Avg episode reward: [(0, '71.341')] [2024-08-06 04:24:18,948][52663] DAMAGECOUNT value on done: 510031.0 [2024-08-06 04:24:18,949][52663] Sum rewards: 67.183, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.480', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.134', 'weapon5': '0.138', 'weapon4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.894', 'WEAPON3': '1.000', 'weapon3': '2.538', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '52.000'} [2024-08-06 04:24:19,989][52795] DAMAGECOUNT value on done: 481573.0 [2024-08-06 04:24:19,992][52795] Sum rewards: 76.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.112', 'AMMO3': '0.193', 'weapon2': '0.196', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:20,264][52649] DAMAGECOUNT value on done: 506019.0 [2024-08-06 04:24:20,265][52649] Sum rewards: 83.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.048', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.227', 'WEAPON3': '1.350', 'weapon3': '3.498', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '70.000'} [2024-08-06 04:24:20,285][52666] DAMAGECOUNT value on done: 513787.0 [2024-08-06 04:24:20,285][52666] Sum rewards: 66.650, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.445', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.085', 'weapon5': '0.114', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '0.950', 'HITCOUNT': '2.950', 'weapon3': '3.230', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '53.000'} [2024-08-06 04:24:20,292][52670] DAMAGECOUNT value on done: 507755.0 [2024-08-06 04:24:20,293][52670] Sum rewards: 58.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.187', 'weapon5': '0.194', 'AMMO4': '0.202', 'weapon2': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.454', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '48.000'} [2024-08-06 04:24:20,381][52650] Updated weights for policy 0, policy_version 53201 (0.0011) [2024-08-06 04:24:21,746][52667] DAMAGECOUNT value on done: 516856.0 [2024-08-06 04:24:21,747][52667] Sum rewards: 68.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.482', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.076', 'AMMO4': '0.144', 'weapon5': '0.170', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '3.056', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:21,883][52663] DAMAGECOUNT value on done: 516653.0 [2024-08-06 04:24:21,884][52663] Sum rewards: 76.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.050', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.128', 'AMMO4': '0.158', 'weapon5': '0.166', 'weapon2': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 435855360. Throughput: 0: 4394.3. Samples: 108968630. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:24:22,794][52567] Avg episode reward: [(0, '71.457')] [2024-08-06 04:24:23,164][52649] DAMAGECOUNT value on done: 498238.0 [2024-08-06 04:24:23,167][52649] Sum rewards: 73.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.459', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon4': '0.016', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.253', 'weapon2': '0.530', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:23,208][52666] DAMAGECOUNT value on done: 508571.0 [2024-08-06 04:24:23,211][52670] DAMAGECOUNT value on done: 519367.0 [2024-08-06 04:24:23,210][52666] Sum rewards: 65.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.815', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon2': '0.218', 'weapon5': '0.220', 'AMMO3': '0.230', 'weapon4': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '56.000'} [2024-08-06 04:24:23,213][52670] Sum rewards: 69.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.867', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.384', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.354', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:23,339][52795] DAMAGECOUNT value on done: 470091.0 [2024-08-06 04:24:23,339][52795] Sum rewards: 80.327, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.391', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'AMMO3': '0.167', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '3.252', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:24,422][52663] DAMAGECOUNT value on done: 524687.0 [2024-08-06 04:24:24,425][52663] Sum rewards: 69.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.076', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:24,743][52667] DAMAGECOUNT value on done: 526299.0 [2024-08-06 04:24:24,744][52667] Sum rewards: 71.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.078', 'weapon5': '0.154', 'AMMO3': '0.210', 'AMMO4': '0.253', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:25,014][52650] Updated weights for policy 0, policy_version 53211 (0.0024) [2024-08-06 04:24:25,915][52670] DAMAGECOUNT value on done: 513697.0 [2024-08-06 04:24:25,915][52670] Sum rewards: 69.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.548', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:25,942][52666] DAMAGECOUNT value on done: 513107.0 [2024-08-06 04:24:25,944][52666] Sum rewards: 75.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.068', 'weapon5': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:25,954][52649] DAMAGECOUNT value on done: 507842.0 [2024-08-06 04:24:25,956][52649] Sum rewards: 83.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.156', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '69.000'} [2024-08-06 04:24:26,641][52795] DAMAGECOUNT value on done: 481754.0 [2024-08-06 04:24:26,644][52795] Sum rewards: 61.603, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.828', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.088', 'AMMO4': '0.218', 'AMMO3': '0.238', 'weapon5': '0.248', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '53.000'} [2024-08-06 04:24:27,217][52663] DAMAGECOUNT value on done: 512095.0 [2024-08-06 04:24:27,218][52663] Sum rewards: 67.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.168', 'AMMO3': '0.222', 'AMMO4': '0.321', 'weapon2': '0.328', 'weapon5': '0.356', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:27,315][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:24:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 435945472. Throughput: 0: 4383.1. Samples: 108994640. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:24:27,794][52567] Avg episode reward: [(0, '71.569')] [2024-08-06 04:24:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053216_435945472.pth... [2024-08-06 04:24:27,889][52667] DAMAGECOUNT value on done: 514359.0 [2024-08-06 04:24:27,891][52667] Sum rewards: 78.128, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052705_431759360.pth [2024-08-06 04:24:29,017][52670] DAMAGECOUNT value on done: 502763.0 [2024-08-06 04:24:29,017][52670] Sum rewards: 67.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'weapon5': '0.128', 'weapon2': '0.220', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'HITCOUNT': '3.460', 'weapon3': '3.468', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:29,047][52666] DAMAGECOUNT value on done: 510741.0 [2024-08-06 04:24:29,047][52666] Sum rewards: 63.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.705', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.194', 'AMMO4': '0.219', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.650', 'HITCOUNT': '2.940', 'weapon3': '2.994', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '55.000'} [2024-08-06 04:24:29,179][52649] DAMAGECOUNT value on done: 511231.0 [2024-08-06 04:24:29,180][52649] Sum rewards: 70.043, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.175', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.086', 'AMMO4': '0.147', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.600', 'weapon3': '3.184', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '61.000'} [2024-08-06 04:24:29,795][52795] DAMAGECOUNT value on done: 475533.0 [2024-08-06 04:24:29,795][52795] Sum rewards: 69.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.162', 'AMMO3': '0.175', 'weapon2': '0.250', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:30,339][52650] Updated weights for policy 0, policy_version 53221 (0.0011) [2024-08-06 04:24:30,358][52663] DAMAGECOUNT value on done: 508909.0 [2024-08-06 04:24:30,361][52663] Sum rewards: 69.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.073', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.050', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 04:24:30,890][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:24:30,960][52667] DAMAGECOUNT value on done: 516445.0 [2024-08-06 04:24:30,961][52667] Sum rewards: 82.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.060', 'AMMO4': '0.109', 'weapon5': '0.112', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:31,970][52670] DAMAGECOUNT value on done: 510731.0 [2024-08-06 04:24:31,972][52670] Sum rewards: 73.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.126', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'AMMO4': '0.245', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:32,036][52666] DAMAGECOUNT value on done: 512232.0 [2024-08-06 04:24:32,036][52666] Sum rewards: 73.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.803', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.116', 'AMMO4': '0.123', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon5': '0.338', 'WEAPON5': '0.400', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.596', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.000'} [2024-08-06 04:24:32,148][52820] DAMAGECOUNT value on done: 477128.0 [2024-08-06 04:24:32,152][52820] Sum rewards: 78.290, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.170', 'weapon5': '0.170', 'weapon4': '0.218', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '63.000'} [2024-08-06 04:24:32,307][52649] DAMAGECOUNT value on done: 512060.0 [2024-08-06 04:24:32,308][52649] Sum rewards: 72.113, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.605', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.038', 'weapon5': '0.052', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.298', 'WEAPON3': '1.550', 'weapon3': '3.342', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 436027392. Throughput: 0: 4379.4. Samples: 109007630. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:24:32,794][52567] Avg episode reward: [(0, '72.015')] [2024-08-06 04:24:32,937][52795] DAMAGECOUNT value on done: 473000.0 [2024-08-06 04:24:32,939][52795] Sum rewards: 69.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.148', 'AMMO3': '0.184', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:33,401][52663] DAMAGECOUNT value on done: 507878.0 [2024-08-06 04:24:33,402][52663] Sum rewards: 79.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.472', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.182', 'AMMO3': '0.224', 'weapon2': '0.242', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '66.000'} [2024-08-06 04:24:33,692][52667] DAMAGECOUNT value on done: 521540.0 [2024-08-06 04:24:33,695][52667] Sum rewards: 75.582, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.698', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.084', 'weapon5': '0.116', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:34,479][52650] Updated weights for policy 0, policy_version 53231 (0.0012) [2024-08-06 04:24:35,127][52670] DAMAGECOUNT value on done: 508145.0 [2024-08-06 04:24:35,129][52670] Sum rewards: 57.471, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.694', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.164', 'AMMO4': '0.192', 'AMMO3': '0.222', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '50.000'} [2024-08-06 04:24:35,147][52666] DAMAGECOUNT value on done: 507021.0 [2024-08-06 04:24:35,147][52666] Sum rewards: 84.435, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.558', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '69.000'} [2024-08-06 04:24:35,342][52820] DAMAGECOUNT value on done: 478252.0 [2024-08-06 04:24:35,342][52820] Sum rewards: 76.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'weapon4': '0.122', 'AMMO4': '0.133', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '61.000'} [2024-08-06 04:24:35,413][52649] DAMAGECOUNT value on done: 510133.0 [2024-08-06 04:24:35,414][52649] Sum rewards: 71.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.528', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon5': '0.178', 'AMMO3': '0.191', 'weapon4': '0.202', 'AMMO4': '0.299', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.780', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:36,085][52795] DAMAGECOUNT value on done: 470093.0 [2024-08-06 04:24:36,093][52795] Sum rewards: 65.549, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.108', 'weapon4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:36,347][52663] DAMAGECOUNT value on done: 510068.0 [2024-08-06 04:24:36,352][52663] Sum rewards: 90.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.907', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.084', 'AMMO4': '0.103', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.490', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '22.788', 'FRAGCOUNT': '72.000'} [2024-08-06 04:24:36,923][52667] DAMAGECOUNT value on done: 527551.0 [2024-08-06 04:24:36,923][52667] Sum rewards: 73.633, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.104', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:37,095][52614] Signal inference workers to stop experience collection... (9700 times) [2024-08-06 04:24:37,095][52614] Signal inference workers to resume experience collection... (9700 times) [2024-08-06 04:24:37,185][52650] InferenceWorker_p0-w0: stopping experience collection (9700 times) [2024-08-06 04:24:37,185][52650] InferenceWorker_p0-w0: resuming experience collection (9700 times) [2024-08-06 04:24:37,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 436125696. Throughput: 0: 4377.1. Samples: 109033830. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:24:37,795][52567] Avg episode reward: [(0, '72.441')] [2024-08-06 04:24:37,932][52670] DAMAGECOUNT value on done: 506984.0 [2024-08-06 04:24:37,933][52670] Sum rewards: 66.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.172', 'weapon4': '0.196', 'AMMO4': '0.202', 'AMMO3': '0.270', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:37,981][52666] DAMAGECOUNT value on done: 512063.0 [2024-08-06 04:24:37,981][52666] Sum rewards: 67.862, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.118', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:38,131][52794] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2024-08-06 04:24:38,144][52649] DAMAGECOUNT value on done: 498742.0 [2024-08-06 04:24:38,145][52649] Sum rewards: 84.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.136', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.026', 'weapon4': '0.030', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '70.000'} [2024-08-06 04:24:38,562][52820] DAMAGECOUNT value on done: 480243.0 [2024-08-06 04:24:38,564][52820] Sum rewards: 73.225, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.690', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.142', 'weapon2': '0.586', 'WEAPON3': '1.050', 'weapon3': '3.252', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:39,288][52795] DAMAGECOUNT value on done: 479349.0 [2024-08-06 04:24:39,290][52795] Sum rewards: 73.213, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.834', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.098', 'weapon4': '0.122', 'AMMO4': '0.175', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.208', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:39,306][52667] DAMAGECOUNT value on done: 518306.0 [2024-08-06 04:24:39,310][52667] Sum rewards: 79.960, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.010', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.698', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '66.000'} [2024-08-06 04:24:39,404][52650] Updated weights for policy 0, policy_version 53241 (0.0013) [2024-08-06 04:24:39,568][52663] DAMAGECOUNT value on done: 521224.0 [2024-08-06 04:24:39,569][52663] Sum rewards: 75.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.142', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.148', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.222', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '61.000'} [2024-08-06 04:24:40,971][52670] DAMAGECOUNT value on done: 513659.0 [2024-08-06 04:24:40,975][52670] Sum rewards: 72.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.463', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.206', 'AMMO4': '0.236', 'weapon2': '0.240', 'weapon5': '0.248', 'weapon4': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:40,990][52649] DAMAGECOUNT value on done: 506431.0 [2024-08-06 04:24:40,991][52649] Sum rewards: 68.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.156', 'AMMO3': '0.190', 'AMMO4': '0.207', 'weapon4': '0.224', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:41,146][52666] DAMAGECOUNT value on done: 505748.0 [2024-08-06 04:24:41,147][52666] Sum rewards: 72.031, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.099', 'weapon5': '0.138', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.224', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:41,752][52820] DAMAGECOUNT value on done: 470512.0 [2024-08-06 04:24:41,753][52820] Sum rewards: 61.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.249', 'weapon2': '0.354', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.416', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '54.000'} [2024-08-06 04:24:41,833][52667] DAMAGECOUNT value on done: 515194.0 [2024-08-06 04:24:41,834][52667] Sum rewards: 70.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.434', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.074', 'weapon4': '0.076', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.302', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '58.000'} [2024-08-06 04:24:41,857][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:24:42,467][52795] DAMAGECOUNT value on done: 470733.0 [2024-08-06 04:24:42,467][52795] Sum rewards: 81.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.044', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO4': '0.202', 'weapon5': '0.214', 'AMMO3': '0.219', 'weapon4': '0.378', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.666', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:42,611][52663] DAMAGECOUNT value on done: 509042.0 [2024-08-06 04:24:42,613][52663] Sum rewards: 72.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.671', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.104', 'AMMO4': '0.167', 'weapon5': '0.182', 'weapon2': '0.266', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 436207616. Throughput: 0: 4370.2. Samples: 109059940. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 04:24:42,794][52567] Avg episode reward: [(0, '72.910')] [2024-08-06 04:24:43,734][52670] DAMAGECOUNT value on done: 503701.0 [2024-08-06 04:24:43,734][52670] Sum rewards: 84.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon2': '0.258', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.398', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.537', 'FRAGCOUNT': '70.000'} [2024-08-06 04:24:43,857][52666] DAMAGECOUNT value on done: 521397.0 [2024-08-06 04:24:43,858][52666] Sum rewards: 69.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.080', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.131', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.448', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:44,071][52650] Updated weights for policy 0, policy_version 53251 (0.0013) [2024-08-06 04:24:44,216][52649] DAMAGECOUNT value on done: 495866.0 [2024-08-06 04:24:44,218][52649] Sum rewards: 69.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.555', 'AMMO5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.098', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO3': '0.279', 'WEAPON5': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.700', 'weapon3': '2.956', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:44,850][52820] DAMAGECOUNT value on done: 480856.0 [2024-08-06 04:24:44,852][52820] Sum rewards: 76.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.792', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.354', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:44,865][52667] DAMAGECOUNT value on done: 522299.0 [2024-08-06 04:24:44,866][52667] Sum rewards: 77.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.014', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'weapon4': '0.110', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:44,932][52663] DAMAGECOUNT value on done: 519498.0 [2024-08-06 04:24:44,933][52663] Sum rewards: 72.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.485', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.632', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:45,594][52795] DAMAGECOUNT value on done: 487313.0 [2024-08-06 04:24:45,594][52795] Sum rewards: 68.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.194', 'AMMO3': '0.241', 'AMMO4': '0.255', 'weapon5': '0.340', 'WEAPON4': '0.600', 'weapon2': '0.610', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.544', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:46,029][52669] DAMAGECOUNT value on done: 519746.0 [2024-08-06 04:24:46,030][52669] Sum rewards: 79.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.552', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.108', 'AMMO4': '0.199', 'weapon5': '0.210', 'weapon2': '0.226', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.202', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '69.000'} [2024-08-06 04:24:46,867][52670] DAMAGECOUNT value on done: 509011.0 [2024-08-06 04:24:46,867][52670] Sum rewards: 70.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.630', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.170', 'AMMO3': '0.179', 'weapon2': '0.212', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.098', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '55.000'} [2024-08-06 04:24:46,982][52666] DAMAGECOUNT value on done: 513642.0 [2024-08-06 04:24:46,983][52666] Sum rewards: 66.628, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.880', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.192', 'weapon5': '0.216', 'weapon2': '0.222', 'AMMO4': '0.283', 'AMMO3': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.950', 'weapon3': '3.038', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:47,344][52663] DAMAGECOUNT value on done: 518414.0 [2024-08-06 04:24:47,346][52663] Sum rewards: 81.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.564', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.052', 'WEAPON4': '0.100', 'weapon2': '0.146', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.614', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '69.000'} [2024-08-06 04:24:47,702][52649] DAMAGECOUNT value on done: 510458.0 [2024-08-06 04:24:47,702][52649] Sum rewards: 74.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.128', 'weapon4': '0.130', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '61.000'} [2024-08-06 04:24:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 436297728. Throughput: 0: 4368.4. Samples: 109072920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:24:47,794][52567] Avg episode reward: [(0, '73.353')] [2024-08-06 04:24:47,817][52667] DAMAGECOUNT value on done: 524677.0 [2024-08-06 04:24:47,820][52667] Sum rewards: 67.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.178', 'AMMO3': '0.184', 'weapon5': '0.204', 'AMMO4': '0.272', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '56.000'} [2024-08-06 04:24:47,895][52820] DAMAGECOUNT value on done: 473093.0 [2024-08-06 04:24:47,898][52820] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.125', 'weapon5': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:48,434][52669] DAMAGECOUNT value on done: 511281.0 [2024-08-06 04:24:48,434][52669] Sum rewards: 68.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.488', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.207', 'weapon2': '0.208', 'weapon5': '0.278', 'AMMO4': '0.338', 'weapon4': '0.356', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '56.000'} [2024-08-06 04:24:48,563][52795] DAMAGECOUNT value on done: 479380.0 [2024-08-06 04:24:48,563][52795] Sum rewards: 56.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.894', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon4': '0.190', 'AMMO3': '0.199', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '46.500'} [2024-08-06 04:24:48,748][52650] Updated weights for policy 0, policy_version 53261 (0.0012) [2024-08-06 04:24:49,787][52670] DAMAGECOUNT value on done: 517217.0 [2024-08-06 04:24:49,787][52670] Sum rewards: 70.173, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.952', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.044', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.208', 'AMMO3': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.456', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '61.000'} [2024-08-06 04:24:49,857][52666] DAMAGECOUNT value on done: 512250.0 [2024-08-06 04:24:49,858][52666] Sum rewards: 87.897, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.094', 'weapon4': '0.104', 'AMMO4': '0.218', 'weapon2': '0.260', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.582', 'FRAGCOUNT': '74.000'} [2024-08-06 04:24:50,213][52663] DAMAGECOUNT value on done: 513521.0 [2024-08-06 04:24:50,213][52663] Sum rewards: 76.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.672', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.164', 'AMMO4': '0.180', 'weapon2': '0.230', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.288', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:50,735][52649] DAMAGECOUNT value on done: 509677.0 [2024-08-06 04:24:50,736][52649] Sum rewards: 72.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.734', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.170', 'AMMO3': '0.190', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '57.000'} [2024-08-06 04:24:50,762][52667] DAMAGECOUNT value on done: 513021.0 [2024-08-06 04:24:50,764][52667] Sum rewards: 71.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:51,027][52820] DAMAGECOUNT value on done: 476736.0 [2024-08-06 04:24:51,030][52820] Sum rewards: 78.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.223', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.094', 'weapon5': '0.132', 'AMMO3': '0.178', 'AMMO4': '0.190', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 04:24:51,609][52669] DAMAGECOUNT value on done: 522402.0 [2024-08-06 04:24:51,610][52669] Sum rewards: 62.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.338', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.318', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '53.000'} [2024-08-06 04:24:51,726][52795] DAMAGECOUNT value on done: 469029.0 [2024-08-06 04:24:51,726][52795] Sum rewards: 80.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.418', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.110', 'AMMO4': '0.148', 'weapon4': '0.162', 'weapon2': '0.242', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:52,657][52670] DAMAGECOUNT value on done: 515194.0 [2024-08-06 04:24:52,659][52670] Sum rewards: 77.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.183', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.142', 'AMMO4': '0.146', 'weapon5': '0.162', 'AMMO3': '0.228', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:52,721][52666] DAMAGECOUNT value on done: 512920.0 [2024-08-06 04:24:52,722][52666] Sum rewards: 74.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.502', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.092', 'weapon5': '0.100', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 436379648. Throughput: 0: 4375.1. Samples: 109099560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:24:52,794][52567] Avg episode reward: [(0, '72.742')] [2024-08-06 04:24:53,310][52650] Updated weights for policy 0, policy_version 53271 (0.0020) [2024-08-06 04:24:53,624][52649] DAMAGECOUNT value on done: 503169.0 [2024-08-06 04:24:53,625][52649] Sum rewards: 79.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.817', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.090', 'weapon2': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.258', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '65.000'} [2024-08-06 04:24:53,936][52667] DAMAGECOUNT value on done: 514566.0 [2024-08-06 04:24:53,936][52667] Sum rewards: 80.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.080', 'AMMO4': '0.124', 'weapon5': '0.138', 'weapon2': '0.174', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '67.000'} [2024-08-06 04:24:54,152][52803] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:24:54,210][52820] DAMAGECOUNT value on done: 480716.0 [2024-08-06 04:24:54,210][52820] Sum rewards: 75.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.505', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.207', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.476', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '62.000'} [2024-08-06 04:24:54,390][52669] DAMAGECOUNT value on done: 518777.0 [2024-08-06 04:24:54,390][52669] Sum rewards: 72.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.314', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:54,905][52795] DAMAGECOUNT value on done: 478256.0 [2024-08-06 04:24:54,906][52795] Sum rewards: 73.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.209', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '60.000'} [2024-08-06 04:24:55,442][52670] DAMAGECOUNT value on done: 499015.0 [2024-08-06 04:24:55,442][52670] Sum rewards: 70.778, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '0.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'weapon4': '0.200', 'AMMO3': '0.211', 'weapon5': '0.224', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.164', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '59.000'} [2024-08-06 04:24:55,544][52666] DAMAGECOUNT value on done: 514789.0 [2024-08-06 04:24:55,544][52666] Sum rewards: 82.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.004', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.090', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '70.000'} [2024-08-06 04:24:56,807][52667] DAMAGECOUNT value on done: 522672.0 [2024-08-06 04:24:56,810][52667] Sum rewards: 68.879, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.254', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.131', 'AMMO3': '0.182', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '56.000'} [2024-08-06 04:24:57,268][52669] DAMAGECOUNT value on done: 516966.0 [2024-08-06 04:24:57,274][52669] Sum rewards: 68.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.171', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.166', 'AMMO3': '0.186', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '55.000'} [2024-08-06 04:24:57,345][52820] DAMAGECOUNT value on done: 477468.0 [2024-08-06 04:24:57,347][52820] Sum rewards: 78.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.918', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.110', 'weapon5': '0.116', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.364', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 04:24:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 436469760. Throughput: 0: 4370.9. Samples: 109125620. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:24:57,795][52567] Avg episode reward: [(0, '73.080')] [2024-08-06 04:24:58,103][52795] DAMAGECOUNT value on done: 482852.0 [2024-08-06 04:24:58,104][52795] Sum rewards: 79.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.601', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.199', 'weapon4': '0.208', 'AMMO4': '0.227', 'weapon2': '0.262', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:58,334][52650] Updated weights for policy 0, policy_version 53281 (0.0021) [2024-08-06 04:24:58,411][52670] DAMAGECOUNT value on done: 510566.0 [2024-08-06 04:24:58,413][52670] Sum rewards: 76.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.626', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.182', 'AMMO4': '0.192', 'weapon5': '0.194', 'AMMO3': '0.216', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '64.000'} [2024-08-06 04:24:58,636][52666] DAMAGECOUNT value on done: 516022.0 [2024-08-06 04:24:58,636][52666] Sum rewards: 74.300, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.236', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.108', 'AMMO3': '0.237', 'weapon5': '0.246', 'AMMO4': '0.273', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '64.000'} [2024-08-06 04:25:00,031][52667] DAMAGECOUNT value on done: 513407.0 [2024-08-06 04:25:00,031][52667] Sum rewards: 79.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.261', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '67.000'} [2024-08-06 04:25:00,048][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:25:00,092][52669] DAMAGECOUNT value on done: 520203.0 [2024-08-06 04:25:00,094][52669] Sum rewards: 66.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.450', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.116', 'weapon4': '0.118', 'AMMO4': '0.186', 'weapon2': '0.226', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.272', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:00,446][52820] DAMAGECOUNT value on done: 485359.0 [2024-08-06 04:25:00,447][52820] Sum rewards: 85.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.057', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '69.000'} [2024-08-06 04:25:01,470][52670] DAMAGECOUNT value on done: 517973.0 [2024-08-06 04:25:01,472][52670] Sum rewards: 65.460, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.070', 'weapon5': '0.096', 'AMMO4': '0.136', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.282', 'weapon2': '0.570', 'WEAPON3': '0.850', 'weapon3': '3.062', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '54.000'} [2024-08-06 04:25:01,718][52666] DAMAGECOUNT value on done: 500949.0 [2024-08-06 04:25:01,719][52666] Sum rewards: 70.479, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.676', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:02,695][52667] DAMAGECOUNT value on done: 522454.0 [2024-08-06 04:25:02,696][52667] Sum rewards: 71.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.543', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.096', 'weapon4': '0.106', 'AMMO3': '0.167', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:02,720][52650] Updated weights for policy 0, policy_version 53291 (0.0012) [2024-08-06 04:25:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 436559872. Throughput: 0: 4365.4. Samples: 109138660. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:25:02,794][52567] Avg episode reward: [(0, '73.236')] [2024-08-06 04:25:03,095][52669] DAMAGECOUNT value on done: 521087.0 [2024-08-06 04:25:03,096][52669] Sum rewards: 66.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.814', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.217', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:03,523][52820] DAMAGECOUNT value on done: 472716.0 [2024-08-06 04:25:03,523][52820] Sum rewards: 67.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.062', 'weapon5': '0.084', 'AMMO3': '0.168', 'AMMO4': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.294', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '55.000'} [2024-08-06 04:25:04,168][52670] DAMAGECOUNT value on done: 508743.0 [2024-08-06 04:25:04,170][52670] Sum rewards: 73.418, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.246', 'weapon2': '0.398', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:04,287][52666] DAMAGECOUNT value on done: 509582.0 [2024-08-06 04:25:04,289][52666] Sum rewards: 71.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.136', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:04,824][52671] DAMAGECOUNT value on done: 524478.0 [2024-08-06 04:25:04,825][52671] Sum rewards: 64.408, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.940', 'AMMO5': '0.025', 'AMMO2': '0.063', 'weapon4': '0.166', 'weapon2': '0.252', 'weapon5': '0.292', 'AMMO4': '0.314', 'AMMO3': '0.322', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.900', 'weapon3': '2.916', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:05,730][52667] DAMAGECOUNT value on done: 526854.0 [2024-08-06 04:25:05,730][52667] Sum rewards: 77.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.949', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:06,304][52669] DAMAGECOUNT value on done: 517213.0 [2024-08-06 04:25:06,306][52669] Sum rewards: 63.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.993', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.126', 'weapon5': '0.130', 'AMMO4': '0.169', 'weapon2': '0.230', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '54.000'} [2024-08-06 04:25:06,656][52820] DAMAGECOUNT value on done: 479953.0 [2024-08-06 04:25:06,658][52820] Sum rewards: 67.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.124', 'weapon5': '0.148', 'weapon2': '0.154', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.450', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:07,040][52670] DAMAGECOUNT value on done: 514107.0 [2024-08-06 04:25:07,042][52670] Sum rewards: 66.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.288', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.182', 'AMMO3': '0.209', 'AMMO4': '0.247', 'weapon2': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:07,723][52650] Updated weights for policy 0, policy_version 53301 (0.0012) [2024-08-06 04:25:07,729][52671] DAMAGECOUNT value on done: 521853.0 [2024-08-06 04:25:07,730][52671] Sum rewards: 76.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.376', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.094', 'weapon5': '0.240', 'AMMO4': '0.242', 'AMMO3': '0.274', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.092', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '66.000'} [2024-08-06 04:25:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 436641792. Throughput: 0: 4359.8. Samples: 109164820. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:25:07,795][52567] Avg episode reward: [(0, '72.973')] [2024-08-06 04:25:08,165][52667] DAMAGECOUNT value on done: 527474.0 [2024-08-06 04:25:08,165][52667] Sum rewards: 67.255, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.078', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.324', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '55.000'} [2024-08-06 04:25:09,451][52669] DAMAGECOUNT value on done: 526685.0 [2024-08-06 04:25:09,452][52669] Sum rewards: 84.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.776', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.123', 'weapon5': '0.170', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '69.000'} [2024-08-06 04:25:09,848][52820] DAMAGECOUNT value on done: 486341.0 [2024-08-06 04:25:09,848][52820] Sum rewards: 78.938, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.675', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.146', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon2': '0.560', 'WEAPON3': '0.900', 'weapon3': '3.084', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '61.500'} [2024-08-06 04:25:10,679][52667] DAMAGECOUNT value on done: 523504.0 [2024-08-06 04:25:10,679][52667] Sum rewards: 63.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.229', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.090', 'weapon5': '0.200', 'AMMO3': '0.224', 'AMMO4': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.450', 'HITCOUNT': '2.960', 'weapon3': '3.018', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:10,876][52671] DAMAGECOUNT value on done: 521615.0 [2024-08-06 04:25:10,877][52671] Sum rewards: 62.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.819', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.049', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.356', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:12,140][52650] Updated weights for policy 0, policy_version 53311 (0.0012) [2024-08-06 04:25:12,648][52669] DAMAGECOUNT value on done: 517776.0 [2024-08-06 04:25:12,649][52669] Sum rewards: 75.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.305', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.162', 'AMMO4': '0.212', 'weapon5': '0.222', 'weapon2': '0.232', 'AMMO3': '0.251', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 436740096. Throughput: 0: 4371.3. Samples: 109191350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:25:12,795][52567] Avg episode reward: [(0, '73.038')] [2024-08-06 04:25:13,047][52820] DAMAGECOUNT value on done: 480539.0 [2024-08-06 04:25:13,048][52820] Sum rewards: 77.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.440', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.068', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.450', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '66.000'} [2024-08-06 04:25:13,202][52667] DAMAGECOUNT value on done: 517395.0 [2024-08-06 04:25:13,202][52667] Sum rewards: 70.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.315', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.130', 'weapon5': '0.162', 'AMMO3': '0.208', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:14,016][52671] DAMAGECOUNT value on done: 521412.0 [2024-08-06 04:25:14,016][52671] Sum rewards: 71.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.154', 'AMMO4': '0.199', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.314', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '58.500'} [2024-08-06 04:25:15,608][52669] DAMAGECOUNT value on done: 524334.0 [2024-08-06 04:25:15,610][52669] Sum rewards: 67.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon4': '0.216', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:15,913][52667] DAMAGECOUNT value on done: 527297.0 [2024-08-06 04:25:15,913][52667] Sum rewards: 81.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.136', 'weapon4': '0.184', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '65.000'} [2024-08-06 04:25:16,164][52820] DAMAGECOUNT value on done: 484277.0 [2024-08-06 04:25:16,166][52820] Sum rewards: 74.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.781', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.186', 'weapon5': '0.202', 'weapon4': '0.228', 'AMMO4': '0.234', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.500'} [2024-08-06 04:25:16,888][52671] DAMAGECOUNT value on done: 531308.0 [2024-08-06 04:25:16,889][52671] Sum rewards: 71.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.982', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.144', 'AMMO4': '0.226', 'AMMO3': '0.236', 'weapon5': '0.244', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '60.000'} [2024-08-06 04:25:16,965][52650] Updated weights for policy 0, policy_version 53321 (0.0011) [2024-08-06 04:25:17,601][52664] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:25:17,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 436822016. Throughput: 0: 4373.8. Samples: 109204450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:25:17,794][52567] Avg episode reward: [(0, '73.207')] [2024-08-06 04:25:18,444][52669] DAMAGECOUNT value on done: 522489.0 [2024-08-06 04:25:18,445][52669] Sum rewards: 65.418, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.777', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.128', 'weapon4': '0.172', 'AMMO4': '0.215', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '58.500'} [2024-08-06 04:25:19,134][52820] DAMAGECOUNT value on done: 480175.0 [2024-08-06 04:25:19,135][52820] Sum rewards: 62.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.154', 'AMMO4': '0.186', 'weapon5': '0.188', 'AMMO3': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.550', 'weapon3': '2.752', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '54.000'} [2024-08-06 04:25:19,388][52668] DAMAGECOUNT value on done: 515634.0 [2024-08-06 04:25:19,392][52668] Sum rewards: 71.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'AMMO3': '0.199', 'weapon4': '0.278', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:19,462][52658] DAMAGECOUNT value on done: 516887.0 [2024-08-06 04:25:19,462][52658] Sum rewards: 64.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.015', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.200', 'AMMO3': '0.225', 'AMMO4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.406', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.574', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:19,973][52671] DAMAGECOUNT value on done: 520838.0 [2024-08-06 04:25:19,974][52671] Sum rewards: 68.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.375', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.034', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.490', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:20,193][52662] DAMAGECOUNT value on done: 522629.0 [2024-08-06 04:25:20,193][52662] Sum rewards: 72.646, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.140', 'weapon2': '0.178', 'AMMO4': '0.185', 'AMMO3': '0.218', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '61.000'} [2024-08-06 04:25:20,949][52669] DAMAGECOUNT value on done: 509806.0 [2024-08-06 04:25:20,950][52669] Sum rewards: 67.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.114', 'weapon4': '0.152', 'AMMO4': '0.160', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:21,319][52650] Updated weights for policy 0, policy_version 53331 (0.0013) [2024-08-06 04:25:21,706][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:25:22,254][52820] DAMAGECOUNT value on done: 482046.0 [2024-08-06 04:25:22,258][52820] Sum rewards: 84.308, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.502', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.050', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.254', 'WEAPON3': '1.300', 'weapon3': '3.442', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.195', 'FRAGCOUNT': '69.000'} [2024-08-06 04:25:22,431][52668] DAMAGECOUNT value on done: 520551.0 [2024-08-06 04:25:22,432][52668] Sum rewards: 66.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.108', 'weapon4': '0.178', 'AMMO3': '0.262', 'AMMO4': '0.268', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.100', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:22,600][52658] DAMAGECOUNT value on done: 518282.0 [2024-08-06 04:25:22,601][52658] Sum rewards: 65.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.985', 'AMMO2': '0.010', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.192', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:22,680][52647] DAMAGECOUNT value on done: 546883.0 [2024-08-06 04:25:22,680][52647] Sum rewards: 89.054, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.174', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '70.000'} [2024-08-06 04:25:22,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 436903936. Throughput: 0: 4378.3. Samples: 109230850. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:22,794][52567] Avg episode reward: [(0, '72.847')] [2024-08-06 04:25:22,864][52662] DAMAGECOUNT value on done: 522671.0 [2024-08-06 04:25:22,866][52662] Sum rewards: 64.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.222', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.170', 'weapon4': '0.198', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '54.500'} [2024-08-06 04:25:23,004][52671] DAMAGECOUNT value on done: 528000.0 [2024-08-06 04:25:23,005][52671] Sum rewards: 68.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.869', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.152', 'AMMO4': '0.174', 'weapon2': '0.210', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.362', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:23,977][52669] DAMAGECOUNT value on done: 519890.0 [2024-08-06 04:25:23,979][52669] Sum rewards: 62.828, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.331', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.116', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.332', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2024-08-06 04:25:25,394][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:25:25,408][52820] DAMAGECOUNT value on done: 488886.0 [2024-08-06 04:25:25,408][52820] Sum rewards: 74.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.130', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '61.000'} [2024-08-06 04:25:25,473][52668] DAMAGECOUNT value on done: 518911.0 [2024-08-06 04:25:25,473][52668] Sum rewards: 66.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.248', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '54.000'} [2024-08-06 04:25:25,654][52647] DAMAGECOUNT value on done: 546943.0 [2024-08-06 04:25:25,655][52647] Sum rewards: 64.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.151', 'weapon5': '0.200', 'weapon2': '0.230', 'AMMO4': '0.235', 'weapon4': '0.418', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '52.000'} [2024-08-06 04:25:25,664][52662] DAMAGECOUNT value on done: 522831.0 [2024-08-06 04:25:25,666][52662] Sum rewards: 71.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.396', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:25,733][52658] DAMAGECOUNT value on done: 523196.0 [2024-08-06 04:25:25,736][52658] Sum rewards: 70.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.184', 'AMMO3': '0.205', 'weapon2': '0.228', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:25,770][52671] DAMAGECOUNT value on done: 520125.0 [2024-08-06 04:25:25,773][52671] Sum rewards: 70.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.152', 'weapon2': '0.176', 'weapon5': '0.196', 'AMMO4': '0.222', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.246', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:26,149][52650] Updated weights for policy 0, policy_version 53341 (0.0011) [2024-08-06 04:25:26,861][52669] DAMAGECOUNT value on done: 520975.0 [2024-08-06 04:25:26,861][52669] Sum rewards: 81.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.594', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.190', 'AMMO4': '0.201', 'AMMO3': '0.211', 'weapon2': '0.222', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '68.000'} [2024-08-06 04:25:27,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 437002240. Throughput: 0: 4384.2. Samples: 109257230. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:27,795][52567] Avg episode reward: [(0, '72.409')] [2024-08-06 04:25:28,376][52662] DAMAGECOUNT value on done: 512199.0 [2024-08-06 04:25:28,376][52662] Sum rewards: 68.248, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.209', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.084', 'weapon5': '0.150', 'AMMO4': '0.249', 'AMMO3': '0.273', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.140', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:28,486][52647] DAMAGECOUNT value on done: 542934.0 [2024-08-06 04:25:28,486][52647] Sum rewards: 73.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.876', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.236', 'weapon2': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '3.450', 'weapon3': '3.526', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '62.000'} [2024-08-06 04:25:28,522][52820] DAMAGECOUNT value on done: 487715.0 [2024-08-06 04:25:28,524][52820] Sum rewards: 71.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.124', 'weapon4': '0.156', 'AMMO4': '0.215', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:28,541][52668] DAMAGECOUNT value on done: 519988.0 [2024-08-06 04:25:28,542][52668] Sum rewards: 69.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.132', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.458', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '60.000'} [2024-08-06 04:25:28,568][52671] DAMAGECOUNT value on done: 516443.0 [2024-08-06 04:25:28,570][52671] Sum rewards: 81.933, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.176', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.084', 'weapon4': '0.164', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '71.000'} [2024-08-06 04:25:28,706][52658] DAMAGECOUNT value on done: 522884.0 [2024-08-06 04:25:28,708][52658] Sum rewards: 73.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.174', 'AMMO4': '0.180', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:30,033][52669] DAMAGECOUNT value on done: 537689.0 [2024-08-06 04:25:30,035][52669] Sum rewards: 76.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon2': '0.186', 'AMMO3': '0.195', 'AMMO4': '0.228', 'weapon5': '0.238', 'weapon4': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '62.000'} [2024-08-06 04:25:30,604][52650] Updated weights for policy 0, policy_version 53351 (0.0028) [2024-08-06 04:25:31,328][52671] DAMAGECOUNT value on done: 521587.0 [2024-08-06 04:25:31,328][52671] Sum rewards: 74.261, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.232', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon5': '0.202', 'weapon2': '0.314', 'weapon4': '0.352', 'WEAPON3': '1.000', 'weapon3': '2.834', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:31,383][52662] DAMAGECOUNT value on done: 523880.0 [2024-08-06 04:25:31,384][52662] Sum rewards: 76.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.266', 'AMMO5': '0.014', 'AMMO2': '0.058', 'AMMO3': '0.201', 'weapon5': '0.236', 'AMMO4': '0.289', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '62.000'} [2024-08-06 04:25:31,387][52668] DAMAGECOUNT value on done: 510451.0 [2024-08-06 04:25:31,388][52668] Sum rewards: 76.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.064', 'weapon5': '0.204', 'AMMO3': '0.214', 'AMMO4': '0.242', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '63.500'} [2024-08-06 04:25:31,496][52647] DAMAGECOUNT value on done: 553007.0 [2024-08-06 04:25:31,496][52647] Sum rewards: 69.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.090', 'AMMO4': '0.141', 'weapon5': '0.222', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:31,559][52658] DAMAGECOUNT value on done: 513663.0 [2024-08-06 04:25:31,559][52658] Sum rewards: 74.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO4': '0.163', 'weapon4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '2.996', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:31,648][52820] DAMAGECOUNT value on done: 476591.0 [2024-08-06 04:25:31,651][52820] Sum rewards: 72.381, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.500', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.116', 'weapon4': '0.172', 'AMMO3': '0.256', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:32,700][52669] DAMAGECOUNT value on done: 524680.0 [2024-08-06 04:25:32,700][52669] Sum rewards: 66.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.114', 'AMMO3': '0.213', 'AMMO4': '0.275', 'weapon5': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '54.500'} [2024-08-06 04:25:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 437084160. Throughput: 0: 4386.4. Samples: 109270310. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:32,802][52567] Avg episode reward: [(0, '72.429')] [2024-08-06 04:25:33,872][52671] DAMAGECOUNT value on done: 522918.0 [2024-08-06 04:25:33,872][52671] Sum rewards: 73.587, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.254', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.040', 'AMMO4': '0.047', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.384', 'WEAPON3': '0.950', 'weapon3': '3.352', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:34,337][52668] DAMAGECOUNT value on done: 524196.0 [2024-08-06 04:25:34,340][52668] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO4': '0.217', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '2.930', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 04:25:34,384][52662] DAMAGECOUNT value on done: 515997.0 [2024-08-06 04:25:34,384][52662] Sum rewards: 66.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.014', 'AMMO2': '0.062', 'AMMO3': '0.183', 'weapon5': '0.212', 'AMMO4': '0.311', 'weapon4': '0.320', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:34,464][52647] DAMAGECOUNT value on done: 552412.0 [2024-08-06 04:25:34,464][52647] Sum rewards: 75.282, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.120', 'weapon4': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.184', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '66.000'} [2024-08-06 04:25:34,732][52658] DAMAGECOUNT value on done: 514469.0 [2024-08-06 04:25:34,733][52658] Sum rewards: 66.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.680', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon2': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.225', 'weapon5': '0.230', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '55.000'} [2024-08-06 04:25:35,363][52650] Updated weights for policy 0, policy_version 53361 (0.0013) [2024-08-06 04:25:35,381][52669] DAMAGECOUNT value on done: 523381.0 [2024-08-06 04:25:35,381][52669] Sum rewards: 72.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.058', 'weapon5': '0.072', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.206', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:36,741][52647] DAMAGECOUNT value on done: 551639.0 [2024-08-06 04:25:36,743][52647] Sum rewards: 78.237, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.358', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.118', 'weapon4': '0.186', 'AMMO4': '0.194', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '67.500'} [2024-08-06 04:25:36,921][52671] DAMAGECOUNT value on done: 520191.0 [2024-08-06 04:25:36,922][52671] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.322', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.037', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.212', 'weapon2': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.434', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '60.000'} [2024-08-06 04:25:37,406][52662] DAMAGECOUNT value on done: 522661.0 [2024-08-06 04:25:37,407][52662] Sum rewards: 65.386, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.094', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.128', 'AMMO3': '0.158', 'AMMO4': '0.197', 'weapon5': '0.298', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '54.000'} [2024-08-06 04:25:37,600][52668] DAMAGECOUNT value on done: 521645.0 [2024-08-06 04:25:37,602][52668] Sum rewards: 75.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.481', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.202', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.526', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 04:25:37,772][52658] DAMAGECOUNT value on done: 523422.0 [2024-08-06 04:25:37,775][52658] Sum rewards: 64.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.757', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.227', 'weapon4': '0.248', 'weapon2': '0.260', 'AMMO4': '0.293', 'weapon5': '0.298', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '54.000'} [2024-08-06 04:25:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 437174272. Throughput: 0: 4380.2. Samples: 109296670. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:37,794][52567] Avg episode reward: [(0, '72.265')] [2024-08-06 04:25:38,136][52669] DAMAGECOUNT value on done: 523283.0 [2024-08-06 04:25:38,137][52669] Sum rewards: 78.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.793', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.155', 'weapon4': '0.182', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '64.000'} [2024-08-06 04:25:39,102][52647] DAMAGECOUNT value on done: 546641.0 [2024-08-06 04:25:39,102][52647] Sum rewards: 75.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.345', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.122', 'AMMO4': '0.152', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.122', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '61.000'} [2024-08-06 04:25:39,579][52671] DAMAGECOUNT value on done: 530143.0 [2024-08-06 04:25:39,580][52671] Sum rewards: 72.232, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.104', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.198', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '60.000'} [2024-08-06 04:25:40,021][52650] Updated weights for policy 0, policy_version 53371 (0.0019) [2024-08-06 04:25:40,235][52658] DAMAGECOUNT value on done: 514992.0 [2024-08-06 04:25:40,238][52658] Sum rewards: 76.001, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.089', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO3': '0.169', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '60.000'} [2024-08-06 04:25:40,606][52662] DAMAGECOUNT value on done: 528177.0 [2024-08-06 04:25:40,608][52662] Sum rewards: 74.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.092', 'AMMO4': '0.093', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '61.000'} [2024-08-06 04:25:40,619][52668] DAMAGECOUNT value on done: 512880.0 [2024-08-06 04:25:40,620][52668] Sum rewards: 67.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.648', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.120', 'AMMO4': '0.205', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:41,045][52669] DAMAGECOUNT value on done: 526234.0 [2024-08-06 04:25:41,045][52669] Sum rewards: 68.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.460', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.132', 'weapon4': '0.162', 'AMMO4': '0.172', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:41,577][52647] DAMAGECOUNT value on done: 539302.0 [2024-08-06 04:25:41,577][52647] Sum rewards: 67.729, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.245', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.145', 'weapon4': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.248', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:42,327][52671] DAMAGECOUNT value on done: 523125.0 [2024-08-06 04:25:42,327][52671] Sum rewards: 57.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.035', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.230', 'weapon2': '0.232', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.442', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2024-08-06 04:25:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 437256192. Throughput: 0: 4390.9. Samples: 109323210. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:42,795][52567] Avg episode reward: [(0, '72.165')] [2024-08-06 04:25:43,223][52658] DAMAGECOUNT value on done: 529647.0 [2024-08-06 04:25:43,226][52658] Sum rewards: 81.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.446', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '68.000'} [2024-08-06 04:25:43,650][52662] DAMAGECOUNT value on done: 519298.0 [2024-08-06 04:25:43,650][52662] Sum rewards: 79.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.710', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.258', 'AMMO3': '0.273', 'weapon2': '0.424', 'WEAPON3': '1.750', 'weapon3': '2.966', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '68.000'} [2024-08-06 04:25:43,700][52668] DAMAGECOUNT value on done: 514904.0 [2024-08-06 04:25:43,701][52668] Sum rewards: 60.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.597', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.140', 'weapon5': '0.176', 'AMMO4': '0.216', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:44,329][52647] DAMAGECOUNT value on done: 548374.0 [2024-08-06 04:25:44,329][52647] Sum rewards: 70.837, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.143', 'weapon2': '0.646', 'WEAPON3': '0.950', 'weapon3': '3.194', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:44,504][52811] DAMAGECOUNT value on done: 494801.0 [2024-08-06 04:25:44,506][52811] Sum rewards: 80.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.063', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.262', 'weapon2': '0.362', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '68.000'} [2024-08-06 04:25:44,777][52660] DAMAGECOUNT value on done: 519228.0 [2024-08-06 04:25:44,777][52660] Sum rewards: 79.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.926', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.148', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'WEAPON3': '1.650', 'weapon3': '3.528', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '66.000'} [2024-08-06 04:25:44,812][52671] DAMAGECOUNT value on done: 508749.0 [2024-08-06 04:25:44,812][52671] Sum rewards: 64.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.358', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.344', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '55.000'} [2024-08-06 04:25:45,119][52650] Updated weights for policy 0, policy_version 53381 (0.0023) [2024-08-06 04:25:46,081][52669] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2024-08-06 04:25:46,386][52662] DAMAGECOUNT value on done: 530210.0 [2024-08-06 04:25:46,387][52662] Sum rewards: 71.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.228', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.098', 'AMMO4': '0.168', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '60.000'} [2024-08-06 04:25:46,393][52668] DAMAGECOUNT value on done: 523319.0 [2024-08-06 04:25:46,393][52668] Sum rewards: 66.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.080', 'AMMO4': '0.092', 'weapon5': '0.136', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.344', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:46,404][52658] DAMAGECOUNT value on done: 516434.0 [2024-08-06 04:25:46,405][52658] Sum rewards: 57.665, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.045', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON3': '0.950', 'weapon2': '0.988', 'weapon3': '2.874', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '44.000'} [2024-08-06 04:25:47,631][52647] DAMAGECOUNT value on done: 543978.0 [2024-08-06 04:25:47,631][52647] Sum rewards: 74.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.026', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:47,655][52671] DAMAGECOUNT value on done: 530057.0 [2024-08-06 04:25:47,657][52671] Sum rewards: 67.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.252', 'AMMO4': '0.273', 'weapon5': '0.286', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '2.680', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '54.000'} [2024-08-06 04:25:47,681][52811] DAMAGECOUNT value on done: 481172.0 [2024-08-06 04:25:47,682][52811] Sum rewards: 75.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:47,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 437338112. Throughput: 0: 4391.1. Samples: 109336260. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:47,802][52567] Avg episode reward: [(0, '71.607')] [2024-08-06 04:25:48,051][52660] DAMAGECOUNT value on done: 508759.0 [2024-08-06 04:25:48,051][52660] Sum rewards: 57.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.765', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.189', 'AMMO4': '0.204', 'weapon5': '0.234', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.588', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '47.000'} [2024-08-06 04:25:49,042][52662] DAMAGECOUNT value on done: 516663.0 [2024-08-06 04:25:49,043][52662] Sum rewards: 71.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.379', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.204', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.390', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:49,129][52658] DAMAGECOUNT value on done: 530471.0 [2024-08-06 04:25:49,130][52658] Sum rewards: 78.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.324', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.151', 'weapon5': '0.174', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.222', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '64.000'} [2024-08-06 04:25:49,262][52650] Updated weights for policy 0, policy_version 53391 (0.0011) [2024-08-06 04:25:49,752][52668] DAMAGECOUNT value on done: 517668.0 [2024-08-06 04:25:49,753][52668] Sum rewards: 64.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.333', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.046', 'AMMO4': '0.064', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.540', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '54.500'} [2024-08-06 04:25:50,494][52647] DAMAGECOUNT value on done: 546729.0 [2024-08-06 04:25:50,494][52647] Sum rewards: 76.979, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.084', 'weapon5': '0.212', 'AMMO3': '0.242', 'AMMO4': '0.260', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '64.000'} [2024-08-06 04:25:50,569][52671] DAMAGECOUNT value on done: 526194.0 [2024-08-06 04:25:50,570][52671] Sum rewards: 70.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.440', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.144', 'AMMO3': '0.183', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '3.018', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '55.500'} [2024-08-06 04:25:50,964][52811] DAMAGECOUNT value on done: 476966.0 [2024-08-06 04:25:50,964][52811] Sum rewards: 67.796, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.990', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'AMMO3': '0.124', 'AMMO4': '0.128', 'weapon4': '0.132', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.576', 'WEAPON3': '0.850', 'weapon3': '2.826', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:51,276][52664] DAMAGECOUNT value on done: 537672.0 [2024-08-06 04:25:51,279][52664] Sum rewards: 71.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.120', 'AMMO4': '0.181', 'AMMO3': '0.183', 'weapon4': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:51,355][52660] DAMAGECOUNT value on done: 521817.0 [2024-08-06 04:25:51,356][52660] Sum rewards: 73.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.084', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 04:25:52,120][52662] DAMAGECOUNT value on done: 521048.0 [2024-08-06 04:25:52,121][52662] Sum rewards: 75.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.092', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.209', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.374', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '63.000'} [2024-08-06 04:25:52,218][52658] DAMAGECOUNT value on done: 512526.0 [2024-08-06 04:25:52,220][52658] Sum rewards: 69.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.060', 'weapon5': '0.116', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 437436416. Throughput: 0: 4393.8. Samples: 109362540. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:52,794][52567] Avg episode reward: [(0, '71.342')] [2024-08-06 04:25:52,859][52668] DAMAGECOUNT value on done: 511775.0 [2024-08-06 04:25:52,859][52668] Sum rewards: 75.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.888', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.090', 'AMMO4': '0.171', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '64.000'} [2024-08-06 04:25:53,090][52647] DAMAGECOUNT value on done: 538190.0 [2024-08-06 04:25:53,092][52647] Sum rewards: 81.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.078', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'weapon3': '3.422', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '67.000'} [2024-08-06 04:25:53,394][52671] DAMAGECOUNT value on done: 526141.0 [2024-08-06 04:25:53,396][52671] Sum rewards: 80.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.641', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.240', 'WEAPON3': '1.550', 'weapon3': '3.402', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '68.000'} [2024-08-06 04:25:53,820][52664] DAMAGECOUNT value on done: 542713.0 [2024-08-06 04:25:53,820][52664] Sum rewards: 69.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.319', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.081', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.448', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:53,962][52665] DAMAGECOUNT value on done: 507297.0 [2024-08-06 04:25:53,965][52665] Sum rewards: 62.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.510', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.414', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.294', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '51.000'} [2024-08-06 04:25:54,103][52650] Updated weights for policy 0, policy_version 53401 (0.0022) [2024-08-06 04:25:54,129][52811] DAMAGECOUNT value on done: 481365.0 [2024-08-06 04:25:54,132][52811] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.118', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.146', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'weapon4': '0.508', 'WEAPON3': '0.950', 'weapon3': '2.742', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '57.000'} [2024-08-06 04:25:54,336][52660] DAMAGECOUNT value on done: 526613.0 [2024-08-06 04:25:54,337][52660] Sum rewards: 73.926, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.918', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.142', 'weapon4': '0.156', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.084', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '65.000'} [2024-08-06 04:25:54,772][52662] DAMAGECOUNT value on done: 517037.0 [2024-08-06 04:25:54,772][52662] Sum rewards: 69.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.054', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.218', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.500', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:55,468][52658] DAMAGECOUNT value on done: 519591.0 [2024-08-06 04:25:55,471][52658] Sum rewards: 64.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.335', 'AMMO5': '0.025', 'AMMO2': '0.068', 'weapon2': '0.230', 'weapon4': '0.260', 'AMMO3': '0.262', 'weapon5': '0.272', 'AMMO4': '0.341', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.650', 'weapon3': '2.868', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:55,563][52647] DAMAGECOUNT value on done: 550047.0 [2024-08-06 04:25:55,564][52647] Sum rewards: 68.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.104', 'AMMO4': '0.176', 'weapon5': '0.198', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:55,614][52668] DAMAGECOUNT value on done: 505921.0 [2024-08-06 04:25:55,614][52668] Sum rewards: 73.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.161', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.163', 'weapon2': '0.896', 'WEAPON3': '1.000', 'weapon3': '2.970', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:56,499][52671] DAMAGECOUNT value on done: 521312.0 [2024-08-06 04:25:56,500][52671] Sum rewards: 78.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.709', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.054', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '64.000'} [2024-08-06 04:25:56,555][52665] DAMAGECOUNT value on done: 522045.0 [2024-08-06 04:25:56,556][52665] Sum rewards: 78.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.256', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.212', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.538', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '66.000'} [2024-08-06 04:25:56,557][52664] DAMAGECOUNT value on done: 542970.0 [2024-08-06 04:25:56,558][52664] Sum rewards: 62.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.128', 'weapon5': '0.184', 'AMMO4': '0.214', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '2.872', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '52.000'} [2024-08-06 04:25:56,947][52660] DAMAGECOUNT value on done: 519414.0 [2024-08-06 04:25:56,948][52660] Sum rewards: 71.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.578', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '58.000'} [2024-08-06 04:25:57,284][52811] DAMAGECOUNT value on done: 487012.0 [2024-08-06 04:25:57,285][52811] Sum rewards: 79.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.216', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '65.000'} [2024-08-06 04:25:57,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 437526528. Throughput: 0: 4379.3. Samples: 109388420. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:25:57,795][52567] Avg episode reward: [(0, '71.548')] [2024-08-06 04:25:57,805][52662] DAMAGECOUNT value on done: 526122.0 [2024-08-06 04:25:57,809][52662] Sum rewards: 81.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.175', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.070', 'weapon4': '0.096', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '67.000'} [2024-08-06 04:25:58,461][52658] DAMAGECOUNT value on done: 519048.0 [2024-08-06 04:25:58,461][52658] Sum rewards: 74.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.187', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.098', 'AMMO3': '0.170', 'AMMO4': '0.185', 'weapon5': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '61.000'} [2024-08-06 04:25:58,473][52668] DAMAGECOUNT value on done: 508603.0 [2024-08-06 04:25:58,474][52668] Sum rewards: 78.302, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.541', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.165', 'weapon5': '0.222', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 04:25:58,682][52647] DAMAGECOUNT value on done: 542339.0 [2024-08-06 04:25:58,685][52647] Sum rewards: 71.296, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.103', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.126', 'AMMO4': '0.195', 'weapon4': '0.222', 'AMMO3': '0.251', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '59.000'} [2024-08-06 04:25:58,961][52650] Updated weights for policy 0, policy_version 53411 (0.0014) [2024-08-06 04:25:59,065][52665] DAMAGECOUNT value on done: 514600.0 [2024-08-06 04:25:59,065][52665] Sum rewards: 63.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.180', 'weapon4': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.274', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.050', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '56.000'} [2024-08-06 04:25:59,249][52671] DAMAGECOUNT value on done: 518961.0 [2024-08-06 04:25:59,250][52671] Sum rewards: 65.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.082', 'AMMO3': '0.184', 'AMMO4': '0.220', 'weapon5': '0.354', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '2.956', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '53.000'} [2024-08-06 04:25:59,661][52664] DAMAGECOUNT value on done: 533838.0 [2024-08-06 04:25:59,662][52664] Sum rewards: 70.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.368', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.186', 'AMMO3': '0.264', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.550', 'weapon3': '2.844', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:00,303][52660] DAMAGECOUNT value on done: 516105.0 [2024-08-06 04:26:00,304][52660] Sum rewards: 75.563, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.555', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.163', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:00,385][52811] DAMAGECOUNT value on done: 492104.0 [2024-08-06 04:26:00,386][52811] Sum rewards: 77.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.576', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'WEAPON4': '0.300', 'weapon4': '0.334', 'weapon2': '0.356', 'WEAPON3': '0.900', 'weapon3': '3.080', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:00,711][52662] DAMAGECOUNT value on done: 520099.0 [2024-08-06 04:26:00,713][52662] Sum rewards: 70.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.165', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:00,976][52803] DAMAGECOUNT value on done: 483711.0 [2024-08-06 04:26:00,980][52803] Sum rewards: 80.983, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.142', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.123', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.244', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '69.000'} [2024-08-06 04:26:01,211][52658] DAMAGECOUNT value on done: 517936.0 [2024-08-06 04:26:01,215][52658] Sum rewards: 69.453, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.118', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.154', 'AMMO4': '0.176', 'AMMO3': '0.266', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.172', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:01,356][52647] DAMAGECOUNT value on done: 551885.0 [2024-08-06 04:26:01,358][52647] Sum rewards: 66.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.300', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.162', 'weapon4': '0.164', 'AMMO4': '0.180', 'AMMO3': '0.235', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '56.500'} [2024-08-06 04:26:01,787][52668] DAMAGECOUNT value on done: 509716.0 [2024-08-06 04:26:01,788][52668] Sum rewards: 78.709, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.054', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon4': '0.286', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:02,093][52665] DAMAGECOUNT value on done: 512315.0 [2024-08-06 04:26:02,093][52665] Sum rewards: 68.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.069', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:02,209][52664] DAMAGECOUNT value on done: 540489.0 [2024-08-06 04:26:02,211][52664] Sum rewards: 74.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.512', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.172', 'weapon4': '0.192', 'AMMO4': '0.243', 'AMMO3': '0.272', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:02,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 437608448. Throughput: 0: 4382.4. Samples: 109401660. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:26:02,795][52567] Avg episode reward: [(0, '71.783')] [2024-08-06 04:26:03,444][52811] DAMAGECOUNT value on done: 487934.0 [2024-08-06 04:26:03,444][52811] Sum rewards: 73.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.926', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.102', 'AMMO4': '0.208', 'AMMO3': '0.222', 'weapon5': '0.226', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '62.000'} [2024-08-06 04:26:03,445][52660] DAMAGECOUNT value on done: 514718.0 [2024-08-06 04:26:03,448][52660] Sum rewards: 66.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'weapon7': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon4': '0.274', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 04:26:03,591][52650] Updated weights for policy 0, policy_version 53421 (0.0012) [2024-08-06 04:26:03,659][52662] DAMAGECOUNT value on done: 528959.0 [2024-08-06 04:26:03,660][52662] Sum rewards: 81.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.394', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon4': '0.294', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:03,841][52647] DAMAGECOUNT value on done: 545308.0 [2024-08-06 04:26:03,843][52647] Sum rewards: 86.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.173', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '71.000'} [2024-08-06 04:26:03,911][52658] DAMAGECOUNT value on done: 509675.0 [2024-08-06 04:26:03,913][52658] Sum rewards: 70.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.654', 'ARMOR': '0.004', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.170', 'AMMO3': '0.191', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:04,153][52803] DAMAGECOUNT value on done: 482379.0 [2024-08-06 04:26:04,153][52803] Sum rewards: 68.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.310', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO4': '0.171', 'weapon5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:04,634][52664] DAMAGECOUNT value on done: 538834.0 [2024-08-06 04:26:04,635][52664] Sum rewards: 81.640, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.495', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon2': '0.236', 'AMMO3': '0.311', 'WEAPON3': '1.950', 'weapon3': '3.514', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '72.000'} [2024-08-06 04:26:04,904][52668] DAMAGECOUNT value on done: 516915.0 [2024-08-06 04:26:04,904][52668] Sum rewards: 68.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.253', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO3': '0.189', 'AMMO4': '0.247', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.270', 'weapon3': '3.286', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:05,300][52665] DAMAGECOUNT value on done: 503183.0 [2024-08-06 04:26:05,300][52665] Sum rewards: 90.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.302', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.116', 'AMMO4': '0.160', 'weapon5': '0.182', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '75.000'} [2024-08-06 04:26:05,415][52670] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:26:06,333][52658] DAMAGECOUNT value on done: 525461.0 [2024-08-06 04:26:06,334][52658] Sum rewards: 61.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.897', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.146', 'weapon5': '0.160', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.164', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '51.000'} [2024-08-06 04:26:06,404][52660] DAMAGECOUNT value on done: 523464.0 [2024-08-06 04:26:06,404][52660] Sum rewards: 66.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.400', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.155', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.850', 'weapon3': '3.056', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:06,411][52647] DAMAGECOUNT value on done: 534825.0 [2024-08-06 04:26:06,411][52647] Sum rewards: 65.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.084', 'weapon5': '0.092', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.446', 'WEAPON3': '0.950', 'HITCOUNT': '3.000', 'weapon3': '3.280', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '51.000'} [2024-08-06 04:26:06,441][52811] DAMAGECOUNT value on done: 484163.0 [2024-08-06 04:26:06,441][52811] Sum rewards: 78.951, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.126', 'AMMO4': '0.155', 'AMMO3': '0.167', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:06,483][52662] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.039, -13.0), ('weapon5', 0.002)] [2024-08-06 04:26:07,173][52662] DAMAGECOUNT value on done: 523254.0 [2024-08-06 04:26:07,173][52662] Sum rewards: 68.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.658', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.116', 'weapon5': '0.120', 'AMMO3': '0.165', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.364', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:07,344][52803] DAMAGECOUNT value on done: 488729.0 [2024-08-06 04:26:07,345][52803] Sum rewards: 69.897, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.382', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:07,380][52664] DAMAGECOUNT value on done: 536530.0 [2024-08-06 04:26:07,381][52664] Sum rewards: 70.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.056', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17524.8). Total num frames: 437698560. Throughput: 0: 4377.3. Samples: 109427830. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:26:07,794][52567] Avg episode reward: [(0, '72.143')] [2024-08-06 04:26:07,830][52668] DAMAGECOUNT value on done: 521418.0 [2024-08-06 04:26:07,831][52668] Sum rewards: 75.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.009', 'AMMO2': '0.067', 'weapon5': '0.114', 'weapon4': '0.180', 'AMMO3': '0.199', 'weapon2': '0.238', 'WEAPON5': '0.300', 'AMMO4': '0.336', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:08,024][52665] DAMAGECOUNT value on done: 509074.0 [2024-08-06 04:26:08,026][52665] Sum rewards: 58.811, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.110', 'weapon4': '0.140', 'AMMO3': '0.232', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.022', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '51.500'} [2024-08-06 04:26:08,355][52650] Updated weights for policy 0, policy_version 53431 (0.0012) [2024-08-06 04:26:09,072][52658] DAMAGECOUNT value on done: 519506.0 [2024-08-06 04:26:09,073][52658] Sum rewards: 59.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.318', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.163', 'AMMO4': '0.213', 'weapon5': '0.320', 'WEAPON5': '0.350', 'weapon4': '0.350', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.592', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '46.000'} [2024-08-06 04:26:09,165][52647] DAMAGECOUNT value on done: 543878.0 [2024-08-06 04:26:09,166][52647] Sum rewards: 68.833, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.168', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.160', 'weapon4': '0.168', 'AMMO4': '0.185', 'weapon5': '0.214', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '3.010', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:09,394][52660] DAMAGECOUNT value on done: 518247.0 [2024-08-06 04:26:09,394][52660] Sum rewards: 62.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.594', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.118', 'AMMO4': '0.204', 'weapon5': '0.232', 'AMMO3': '0.257', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:09,457][52811] DAMAGECOUNT value on done: 490466.0 [2024-08-06 04:26:09,460][52811] Sum rewards: 73.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.080', 'AMMO4': '0.137', 'weapon5': '0.180', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:09,703][52662] DAMAGECOUNT value on done: 515271.0 [2024-08-06 04:26:09,705][52662] Sum rewards: 74.131, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '64.000'} [2024-08-06 04:26:10,354][52664] DAMAGECOUNT value on done: 532485.0 [2024-08-06 04:26:10,356][52664] Sum rewards: 67.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.957', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.084', 'AMMO4': '0.171', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.388', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '55.000'} [2024-08-06 04:26:10,587][52668] DAMAGECOUNT value on done: 518820.0 [2024-08-06 04:26:10,588][52668] Sum rewards: 71.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.019', 'AMMO2': '0.061', 'AMMO3': '0.197', 'weapon2': '0.240', 'weapon5': '0.300', 'AMMO4': '0.307', 'weapon4': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:10,614][52803] DAMAGECOUNT value on done: 489989.0 [2024-08-06 04:26:10,614][52803] Sum rewards: 69.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon5': '0.196', 'weapon4': '0.212', 'AMMO3': '0.251', 'weapon2': '0.280', 'AMMO4': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:10,764][52665] DAMAGECOUNT value on done: 513866.0 [2024-08-06 04:26:10,766][52665] Sum rewards: 68.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.207', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon4': '0.160', 'weapon5': '0.226', 'AMMO3': '0.236', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2024-08-06 04:26:11,606][52668] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:26:11,874][52647] DAMAGECOUNT value on done: 539268.0 [2024-08-06 04:26:11,874][52647] Sum rewards: 60.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2024-08-06 04:26:12,150][52660] DAMAGECOUNT value on done: 516786.0 [2024-08-06 04:26:12,152][52660] Sum rewards: 66.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.046', 'weapon4': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.446', 'WEAPON3': '1.500', 'HITCOUNT': '3.200', 'weapon3': '3.240', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:12,186][52658] DAMAGECOUNT value on done: 520211.0 [2024-08-06 04:26:12,189][52658] Sum rewards: 73.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.423', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.138', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:12,497][52811] DAMAGECOUNT value on done: 484887.0 [2024-08-06 04:26:12,499][52811] Sum rewards: 64.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.954', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.080', 'weapon2': '0.186', 'weapon5': '0.200', 'AMMO4': '0.247', 'AMMO3': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '3.140', 'weapon3': '3.244', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '57.000'} [2024-08-06 04:26:12,730][52662] DAMAGECOUNT value on done: 520656.0 [2024-08-06 04:26:12,730][52662] Sum rewards: 72.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.634', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.181', 'AMMO3': '0.224', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.500'} [2024-08-06 04:26:12,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 437780480. Throughput: 0: 4373.3. Samples: 109454030. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:26:12,795][52567] Avg episode reward: [(0, '71.365')] [2024-08-06 04:26:12,819][52664] DAMAGECOUNT value on done: 543708.0 [2024-08-06 04:26:12,829][52664] Sum rewards: 79.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.089', 'weapon5': '0.094', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:12,927][52650] Updated weights for policy 0, policy_version 53441 (0.0034) [2024-08-06 04:26:13,443][52668] DAMAGECOUNT value on done: 521714.0 [2024-08-06 04:26:13,445][52668] Sum rewards: 74.508, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.966', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.096', 'AMMO3': '0.191', 'weapon5': '0.226', 'AMMO4': '0.240', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '62.000'} [2024-08-06 04:26:13,742][52803] DAMAGECOUNT value on done: 486862.0 [2024-08-06 04:26:13,742][52803] Sum rewards: 61.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.865', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.134', 'AMMO4': '0.207', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.046', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:13,874][52665] DAMAGECOUNT value on done: 514846.0 [2024-08-06 04:26:13,874][52665] Sum rewards: 84.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.542', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.197', 'weapon2': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.490', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '70.000'} [2024-08-06 04:26:14,330][52647] DAMAGECOUNT value on done: 538290.0 [2024-08-06 04:26:14,331][52647] Sum rewards: 66.411, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO4': '0.189', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:14,652][52660] DAMAGECOUNT value on done: 523813.0 [2024-08-06 04:26:14,652][52660] Sum rewards: 71.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.230', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'AMMO3': '0.249', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.454', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:15,341][52658] DAMAGECOUNT value on done: 525149.0 [2024-08-06 04:26:15,345][52658] Sum rewards: 72.929, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.028', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon5': '0.222', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 04:26:15,572][52664] DAMAGECOUNT value on done: 535263.0 [2024-08-06 04:26:15,574][52664] Sum rewards: 58.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.166', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.080', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'AMMO3': '0.228', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.306', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '49.000'} [2024-08-06 04:26:15,618][52811] DAMAGECOUNT value on done: 486206.0 [2024-08-06 04:26:15,620][52811] Sum rewards: 72.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:15,732][52662] DAMAGECOUNT value on done: 514964.0 [2024-08-06 04:26:15,733][52662] Sum rewards: 63.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.021', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.192', 'AMMO4': '0.197', 'weapon2': '0.204', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:15,922][52668] DAMAGECOUNT value on done: 520514.0 [2024-08-06 04:26:15,926][52668] Sum rewards: 72.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.098', 'weapon5': '0.180', 'AMMO3': '0.195', 'AMMO4': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:16,808][52665] DAMAGECOUNT value on done: 522069.0 [2024-08-06 04:26:16,808][52665] Sum rewards: 74.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.042', 'AMMO5': '0.011', 'weapon5': '0.030', 'AMMO2': '0.041', 'weapon4': '0.110', 'AMMO3': '0.206', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:16,836][52803] DAMAGECOUNT value on done: 476819.0 [2024-08-06 04:26:16,836][52803] Sum rewards: 63.718, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'weapon2': '0.538', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.292', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '51.000'} [2024-08-06 04:26:17,502][52650] Updated weights for policy 0, policy_version 53451 (0.0012) [2024-08-06 04:26:17,526][52660] DAMAGECOUNT value on done: 511562.0 [2024-08-06 04:26:17,529][52660] Sum rewards: 82.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.303', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '68.000'} [2024-08-06 04:26:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 437870592. Throughput: 0: 4374.2. Samples: 109467150. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:26:17,794][52567] Avg episode reward: [(0, '71.320')] [2024-08-06 04:26:18,122][52664] DAMAGECOUNT value on done: 545054.0 [2024-08-06 04:26:18,134][52664] Sum rewards: 67.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.258', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.274', 'weapon4': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:18,774][52811] DAMAGECOUNT value on done: 495653.0 [2024-08-06 04:26:18,774][52811] Sum rewards: 62.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.100', 'weapon5': '0.234', 'AMMO3': '0.260', 'AMMO4': '0.303', 'weapon2': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '2.996', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '55.000'} [2024-08-06 04:26:19,858][52665] DAMAGECOUNT value on done: 511509.0 [2024-08-06 04:26:19,859][52665] Sum rewards: 65.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.785', 'AMMO5': '0.026', 'AMMO2': '0.077', 'AMMO3': '0.172', 'weapon5': '0.186', 'weapon4': '0.204', 'AMMO4': '0.385', 'weapon2': '0.446', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:19,870][52794] DAMAGECOUNT value on done: 522682.0 [2024-08-06 04:26:19,871][52794] Sum rewards: 61.112, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.241', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.168', 'AMMO4': '0.182', 'AMMO3': '0.251', 'weapon5': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.728', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '55.000'} [2024-08-06 04:26:19,926][52803] DAMAGECOUNT value on done: 481023.0 [2024-08-06 04:26:19,926][52803] Sum rewards: 74.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon5': '0.220', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:20,606][52660] DAMAGECOUNT value on done: 516746.0 [2024-08-06 04:26:20,611][52660] Sum rewards: 71.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.228', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.410', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:20,671][52664] DAMAGECOUNT value on done: 542182.0 [2024-08-06 04:26:20,672][52664] Sum rewards: 74.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.546', 'AMMO5': '0.025', 'AMMO2': '0.035', 'weapon4': '0.146', 'AMMO3': '0.170', 'AMMO4': '0.176', 'weapon5': '0.176', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:20,739][52659] DAMAGECOUNT value on done: 523768.0 [2024-08-06 04:26:20,740][52659] Sum rewards: 66.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:21,837][52811] DAMAGECOUNT value on done: 483549.0 [2024-08-06 04:26:21,839][52811] Sum rewards: 71.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.182', 'AMMO3': '0.191', 'weapon4': '0.210', 'AMMO4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:22,373][52650] Updated weights for policy 0, policy_version 53461 (0.0026) [2024-08-06 04:26:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 437960704. Throughput: 0: 4377.1. Samples: 109493640. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:26:22,794][52567] Avg episode reward: [(0, '71.294')] [2024-08-06 04:26:22,827][52794] DAMAGECOUNT value on done: 526241.0 [2024-08-06 04:26:22,828][52794] Sum rewards: 76.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.667', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.476', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '65.000'} [2024-08-06 04:26:22,914][52665] DAMAGECOUNT value on done: 521642.0 [2024-08-06 04:26:22,915][52665] Sum rewards: 75.756, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.155', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.135', 'weapon2': '0.158', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:23,002][52664] DAMAGECOUNT value on done: 549733.0 [2024-08-06 04:26:23,003][52664] Sum rewards: 57.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.842', 'AMMO5': '0.023', 'AMMO2': '0.087', 'AMMO3': '0.226', 'weapon4': '0.300', 'weapon5': '0.374', 'weapon2': '0.390', 'AMMO4': '0.437', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.350', 'weapon3': '2.606', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '48.000'} [2024-08-06 04:26:23,010][52803] DAMAGECOUNT value on done: 478943.0 [2024-08-06 04:26:23,010][52803] Sum rewards: 80.645, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO4': '0.143', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.214', 'HEALTH': '0.242', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '2.864', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '65.000'} [2024-08-06 04:26:23,386][52660] DAMAGECOUNT value on done: 527564.0 [2024-08-06 04:26:23,394][52660] Sum rewards: 73.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.068', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.225', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:23,450][52659] DAMAGECOUNT value on done: 519219.0 [2024-08-06 04:26:23,450][52659] Sum rewards: 71.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon4': '0.188', 'AMMO4': '0.195', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.742', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:24,863][52811] DAMAGECOUNT value on done: 483175.0 [2024-08-06 04:26:24,864][52811] Sum rewards: 67.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.918', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.134', 'weapon4': '0.156', 'AMMO3': '0.180', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:25,795][52664] DAMAGECOUNT value on done: 544760.0 [2024-08-06 04:26:25,798][52664] Sum rewards: 68.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.194', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.292', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '57.000'} [2024-08-06 04:26:25,974][52665] DAMAGECOUNT value on done: 518636.0 [2024-08-06 04:26:25,977][52665] Sum rewards: 81.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.931', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.091', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '69.000'} [2024-08-06 04:26:26,008][52803] DAMAGECOUNT value on done: 484127.0 [2024-08-06 04:26:26,011][52803] Sum rewards: 69.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.173', 'AMMO4': '0.212', 'weapon4': '0.302', 'weapon5': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.506', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:26,181][52659] DAMAGECOUNT value on done: 523933.0 [2024-08-06 04:26:26,181][52659] Sum rewards: 69.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.217', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:26,240][52794] DAMAGECOUNT value on done: 524472.0 [2024-08-06 04:26:26,241][52794] Sum rewards: 67.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.171', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.118', 'AMMO4': '0.119', 'weapon5': '0.128', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.126', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:26,402][52660] DAMAGECOUNT value on done: 532908.0 [2024-08-06 04:26:26,403][52660] Sum rewards: 70.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.056', 'AMMO4': '0.196', 'weapon2': '0.210', 'AMMO3': '0.251', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '62.000'} [2024-08-06 04:26:26,692][52650] Updated weights for policy 0, policy_version 53471 (0.0016) [2024-08-06 04:26:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 438042624. Throughput: 0: 4373.6. Samples: 109520020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:26:27,795][52567] Avg episode reward: [(0, '71.312')] [2024-08-06 04:26:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053472_438042624.pth... [2024-08-06 04:26:27,838][52811] DAMAGECOUNT value on done: 485462.0 [2024-08-06 04:26:27,838][52811] Sum rewards: 87.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.198', 'weapon2': '0.208', 'AMMO4': '0.211', 'AMMO3': '0.224', 'weapon4': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '73.000'} [2024-08-06 04:26:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000052960_433848320.pth [2024-08-06 04:26:28,192][52664] DAMAGECOUNT value on done: 545673.0 [2024-08-06 04:26:28,194][52664] Sum rewards: 64.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.874', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.082', 'AMMO3': '0.251', 'weapon5': '0.292', 'AMMO4': '0.306', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.848', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '53.500'} [2024-08-06 04:26:28,908][52794] DAMAGECOUNT value on done: 517956.0 [2024-08-06 04:26:28,910][52794] Sum rewards: 64.826, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.022', 'AMMO2': '0.008', 'AMMO5': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon4': '0.130', 'AMMO3': '0.146', 'weapon5': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.502', 'WEAPON3': '0.850', 'weapon3': '3.026', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.409', 'FRAGCOUNT': '52.000'} [2024-08-06 04:26:29,046][52665] DAMAGECOUNT value on done: 515231.0 [2024-08-06 04:26:29,048][52665] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.708', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.182', 'AMMO3': '0.227', 'weapon2': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '61.500'} [2024-08-06 04:26:29,140][52803] DAMAGECOUNT value on done: 476683.0 [2024-08-06 04:26:29,141][52803] Sum rewards: 80.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:29,261][52659] DAMAGECOUNT value on done: 520806.0 [2024-08-06 04:26:29,262][52659] Sum rewards: 67.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.126', 'weapon4': '0.128', 'AMMO4': '0.207', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.156', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '57.000'} [2024-08-06 04:26:29,464][52660] DAMAGECOUNT value on done: 515374.0 [2024-08-06 04:26:29,466][52660] Sum rewards: 78.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.925', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '64.000'} [2024-08-06 04:26:30,915][52811] DAMAGECOUNT value on done: 481734.0 [2024-08-06 04:26:30,918][52811] Sum rewards: 77.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.112', 'AMMO4': '0.130', 'AMMO3': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '0.950', 'weapon3': '3.160', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:31,261][52664] DAMAGECOUNT value on done: 539358.0 [2024-08-06 04:26:31,262][52664] Sum rewards: 72.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.043', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.174', 'AMMO3': '0.199', 'weapon4': '0.204', 'AMMO4': '0.209', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:31,652][52650] Updated weights for policy 0, policy_version 53481 (0.0015) [2024-08-06 04:26:31,937][52660] DAMAGECOUNT value on done: 522768.0 [2024-08-06 04:26:31,937][52660] Sum rewards: 81.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.212', 'weapon5': '0.254', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.300', 'weapon3': '2.700', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:32,026][52794] DAMAGECOUNT value on done: 517417.0 [2024-08-06 04:26:32,035][52794] Sum rewards: 60.653, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.600', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon5': '0.182', 'weapon2': '0.246', 'AMMO4': '0.289', 'weapon4': '0.308', 'AMMO3': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.950', 'weapon3': '2.844', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:32,304][52803] DAMAGECOUNT value on done: 492539.0 [2024-08-06 04:26:32,306][52803] Sum rewards: 79.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.933', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:32,389][52659] DAMAGECOUNT value on done: 517390.0 [2024-08-06 04:26:32,390][52659] Sum rewards: 66.243, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.136', 'weapon2': '0.202', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '55.000'} [2024-08-06 04:26:32,401][52665] DAMAGECOUNT value on done: 514652.0 [2024-08-06 04:26:32,401][52665] Sum rewards: 73.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.300', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.326', 'WEAPON3': '1.700', 'weapon3': '3.282', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 438132736. Throughput: 0: 4368.9. Samples: 109532860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:26:32,794][52567] Avg episode reward: [(0, '71.498')] [2024-08-06 04:26:33,988][52811] DAMAGECOUNT value on done: 486367.0 [2024-08-06 04:26:33,989][52811] Sum rewards: 65.984, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.995', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.088', 'weapon5': '0.136', 'AMMO4': '0.234', 'AMMO3': '0.277', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.750', 'weapon3': '2.992', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:34,126][52664] DAMAGECOUNT value on done: 535375.0 [2024-08-06 04:26:34,130][52664] Sum rewards: 67.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.023', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.084', 'weapon5': '0.178', 'AMMO3': '0.230', 'weapon2': '0.242', 'AMMO4': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.234', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:34,924][52660] DAMAGECOUNT value on done: 517059.0 [2024-08-06 04:26:34,926][52660] Sum rewards: 88.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.636', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.182', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.264', 'FRAGCOUNT': '72.000'} [2024-08-06 04:26:35,015][52794] DAMAGECOUNT value on done: 518435.0 [2024-08-06 04:26:35,015][52794] Sum rewards: 73.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.124', 'AMMO4': '0.231', 'weapon4': '0.244', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '64.000'} [2024-08-06 04:26:35,116][52665] DAMAGECOUNT value on done: 511052.0 [2024-08-06 04:26:35,116][52665] Sum rewards: 68.902, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.645', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.092', 'weapon4': '0.126', 'AMMO3': '0.171', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.174', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:35,394][52659] DAMAGECOUNT value on done: 519243.0 [2024-08-06 04:26:35,395][52659] Sum rewards: 61.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.899', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.107', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.730', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '52.000'} [2024-08-06 04:26:35,401][52803] DAMAGECOUNT value on done: 486704.0 [2024-08-06 04:26:35,402][52803] Sum rewards: 72.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.134', 'AMMO4': '0.135', 'AMMO3': '0.218', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '62.000'} [2024-08-06 04:26:36,187][52650] Updated weights for policy 0, policy_version 53491 (0.0011) [2024-08-06 04:26:36,788][52664] DAMAGECOUNT value on done: 540656.0 [2024-08-06 04:26:36,790][52664] Sum rewards: 79.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.264', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.183', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.418', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:37,167][52647] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2024-08-06 04:26:37,168][52811] DAMAGECOUNT value on done: 489748.0 [2024-08-06 04:26:37,170][52811] Sum rewards: 73.782, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.440', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.134', 'weapon4': '0.226', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '64.000'} [2024-08-06 04:26:37,553][52660] DAMAGECOUNT value on done: 518792.0 [2024-08-06 04:26:37,557][52660] Sum rewards: 86.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.236', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.126', 'AMMO3': '0.193', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '69.000'} [2024-08-06 04:26:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 438222848. Throughput: 0: 4369.6. Samples: 109559170. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:26:37,794][52567] Avg episode reward: [(0, '71.580')] [2024-08-06 04:26:38,066][52794] DAMAGECOUNT value on done: 527175.0 [2024-08-06 04:26:38,068][52794] Sum rewards: 78.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:38,124][52665] DAMAGECOUNT value on done: 509388.0 [2024-08-06 04:26:38,125][52665] Sum rewards: 71.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.665', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:38,556][52659] DAMAGECOUNT value on done: 520275.0 [2024-08-06 04:26:38,557][52659] Sum rewards: 81.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.128', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.170', 'AMMO3': '0.211', 'WEAPON3': '1.200', 'weapon3': '3.434', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:38,648][52803] DAMAGECOUNT value on done: 481857.0 [2024-08-06 04:26:38,648][52803] Sum rewards: 72.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.196', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.410', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:39,697][52664] DAMAGECOUNT value on done: 538921.0 [2024-08-06 04:26:39,697][52664] Sum rewards: 74.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.323', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.037', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.392', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '61.000'} [2024-08-06 04:26:40,348][52811] DAMAGECOUNT value on done: 482893.0 [2024-08-06 04:26:40,348][52811] Sum rewards: 76.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.048', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.062', 'AMMO4': '0.066', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.744', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '62.000'} [2024-08-06 04:26:40,490][52660] DAMAGECOUNT value on done: 510302.0 [2024-08-06 04:26:40,491][52660] Sum rewards: 78.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.118', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.234', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:40,586][52794] DAMAGECOUNT value on done: 514713.0 [2024-08-06 04:26:40,586][52794] Sum rewards: 67.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.722', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.124', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.652', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '57.000'} [2024-08-06 04:26:40,881][52665] DAMAGECOUNT value on done: 512400.0 [2024-08-06 04:26:40,882][52665] Sum rewards: 64.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.974', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.158', 'AMMO3': '0.175', 'weapon5': '0.262', 'AMMO4': '0.296', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.812', 'WEAPON3': '1.100', 'weapon3': '2.524', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '53.500'} [2024-08-06 04:26:41,028][52650] Updated weights for policy 0, policy_version 53501 (0.0012) [2024-08-06 04:26:41,529][52659] DAMAGECOUNT value on done: 517683.0 [2024-08-06 04:26:41,529][52659] Sum rewards: 74.224, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.155', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.132', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:41,622][52803] DAMAGECOUNT value on done: 490496.0 [2024-08-06 04:26:41,624][52803] Sum rewards: 83.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.698', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.134', 'weapon2': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '68.000'} [2024-08-06 04:26:42,137][52664] DAMAGECOUNT value on done: 537069.0 [2024-08-06 04:26:42,138][52664] Sum rewards: 75.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.201', 'AMMO4': '0.206', 'weapon2': '0.262', 'weapon5': '0.268', 'weapon4': '0.288', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 438312960. Throughput: 0: 4376.9. Samples: 109585380. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:26:42,794][52567] Avg episode reward: [(0, '71.604')] [2024-08-06 04:26:43,515][52811] DAMAGECOUNT value on done: 483961.0 [2024-08-06 04:26:43,519][52811] Sum rewards: 67.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.116', 'weapon5': '0.164', 'AMMO3': '0.194', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '56.000'} [2024-08-06 04:26:43,717][52794] DAMAGECOUNT value on done: 524192.0 [2024-08-06 04:26:43,717][52794] Sum rewards: 65.754, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.193', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.066', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.360', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '53.000'} [2024-08-06 04:26:44,008][52665] DAMAGECOUNT value on done: 510250.0 [2024-08-06 04:26:44,008][52665] Sum rewards: 69.863, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.410', 'AMMO5': '0.017', 'AMMO2': '0.072', 'weapon5': '0.184', 'weapon4': '0.190', 'AMMO3': '0.225', 'AMMO4': '0.359', 'weapon2': '0.412', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:44,564][52659] DAMAGECOUNT value on done: 525759.0 [2024-08-06 04:26:44,565][52659] Sum rewards: 73.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.906', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.052', 'AMMO3': '0.187', 'AMMO4': '0.189', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:44,749][52803] DAMAGECOUNT value on done: 484430.0 [2024-08-06 04:26:44,760][52803] Sum rewards: 74.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.480', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.082', 'AMMO4': '0.097', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:45,461][52650] Updated weights for policy 0, policy_version 53511 (0.0012) [2024-08-06 04:26:46,665][52794] DAMAGECOUNT value on done: 521945.0 [2024-08-06 04:26:46,665][52794] Sum rewards: 70.092, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO2': '0.004', 'AMMO5': '0.010', 'AMMO4': '0.021', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.194', 'weapon4': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '57.000'} [2024-08-06 04:26:46,762][52662] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 04:26:47,009][52665] DAMAGECOUNT value on done: 512943.0 [2024-08-06 04:26:47,010][52665] Sum rewards: 65.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.028', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.262', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '55.000'} [2024-08-06 04:26:47,293][52659] DAMAGECOUNT value on done: 529457.0 [2024-08-06 04:26:47,293][52659] Sum rewards: 69.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.218', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 438394880. Throughput: 0: 4376.7. Samples: 109598610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:26:47,794][52567] Avg episode reward: [(0, '71.448')] [2024-08-06 04:26:47,872][52803] DAMAGECOUNT value on done: 482370.0 [2024-08-06 04:26:47,874][52803] Sum rewards: 81.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.915', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.144', 'AMMO4': '0.170', 'weapon2': '0.184', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '66.500'} [2024-08-06 04:26:49,238][52794] DAMAGECOUNT value on done: 515634.0 [2024-08-06 04:26:49,239][52794] Sum rewards: 68.499, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.122', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.149', 'AMMO4': '0.241', 'weapon2': '0.270', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.506', 'WEAPON3': '0.900', 'weapon3': '2.606', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:50,062][52665] DAMAGECOUNT value on done: 514521.0 [2024-08-06 04:26:50,062][52665] Sum rewards: 69.990, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.095', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '57.000'} [2024-08-06 04:26:50,169][52659] DAMAGECOUNT value on done: 518968.0 [2024-08-06 04:26:50,169][52659] Sum rewards: 73.874, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.095', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '63.000'} [2024-08-06 04:26:50,187][52650] Updated weights for policy 0, policy_version 53521 (0.0011) [2024-08-06 04:26:50,916][52803] DAMAGECOUNT value on done: 487934.0 [2024-08-06 04:26:50,916][52803] Sum rewards: 73.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.094', 'weapon5': '0.178', 'AMMO4': '0.207', 'AMMO3': '0.225', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '60.000'} [2024-08-06 04:26:52,014][52794] DAMAGECOUNT value on done: 522141.0 [2024-08-06 04:26:52,016][52794] Sum rewards: 67.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.546', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.122', 'AMMO3': '0.201', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2024-08-06 04:26:52,757][52659] DAMAGECOUNT value on done: 523576.0 [2024-08-06 04:26:52,758][52659] Sum rewards: 76.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.124', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.078', 'AMMO4': '0.172', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.312', 'WEAPON3': '1.750', 'weapon3': '3.246', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '66.000'} [2024-08-06 04:26:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 438484992. Throughput: 0: 4385.1. Samples: 109625160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:26:52,794][52567] Avg episode reward: [(0, '71.746')] [2024-08-06 04:26:53,377][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:26:54,105][52803] DAMAGECOUNT value on done: 487614.0 [2024-08-06 04:26:54,106][52803] Sum rewards: 73.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO3': '0.163', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '59.000'} [2024-08-06 04:26:54,253][52614] Signal inference workers to stop experience collection... (9750 times) [2024-08-06 04:26:54,254][52614] Signal inference workers to resume experience collection... (9750 times) [2024-08-06 04:26:54,325][52650] InferenceWorker_p0-w0: stopping experience collection (9750 times) [2024-08-06 04:26:54,326][52650] InferenceWorker_p0-w0: resuming experience collection (9750 times) [2024-08-06 04:26:54,823][52650] Updated weights for policy 0, policy_version 53531 (0.0021) [2024-08-06 04:26:55,117][52794] DAMAGECOUNT value on done: 515613.0 [2024-08-06 04:26:55,128][52794] Sum rewards: 90.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.837', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.233', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.524', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '75.000'} [2024-08-06 04:26:56,124][52659] DAMAGECOUNT value on done: 514941.0 [2024-08-06 04:26:56,126][52659] Sum rewards: 66.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.201', 'weapon5': '0.210', 'weapon2': '0.248', 'AMMO4': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '54.000'} [2024-08-06 04:26:57,215][52803] DAMAGECOUNT value on done: 490009.0 [2024-08-06 04:26:57,215][52803] Sum rewards: 83.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.090', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '67.000'} [2024-08-06 04:26:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 438566912. Throughput: 0: 4388.0. Samples: 109651490. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:26:57,794][52567] Avg episode reward: [(0, '72.079')] [2024-08-06 04:26:58,198][52794] DAMAGECOUNT value on done: 534191.0 [2024-08-06 04:26:58,198][52794] Sum rewards: 75.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.065', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.221', 'AMMO3': '0.263', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.346', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.000'} [2024-08-06 04:26:58,965][52659] DAMAGECOUNT value on done: 519557.0 [2024-08-06 04:26:58,967][52659] Sum rewards: 68.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.282', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '58.000'} [2024-08-06 04:26:59,592][52650] Updated weights for policy 0, policy_version 53541 (0.0018) [2024-08-06 04:27:00,195][52803] DAMAGECOUNT value on done: 481317.0 [2024-08-06 04:27:00,204][52803] Sum rewards: 73.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.510', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.189', 'AMMO4': '0.195', 'weapon5': '0.250', 'weapon2': '0.252', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '60.500'} [2024-08-06 04:27:01,409][52794] DAMAGECOUNT value on done: 515564.0 [2024-08-06 04:27:01,409][52794] Sum rewards: 77.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.535', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.200', 'AMMO3': '0.201', 'weapon5': '0.226', 'weapon4': '0.234', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '63.000'} [2024-08-06 04:27:01,928][52659] DAMAGECOUNT value on done: 530813.0 [2024-08-06 04:27:01,930][52659] Sum rewards: 68.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.433', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.178', 'AMMO3': '0.209', 'weapon5': '0.290', 'AMMO4': '0.319', 'weapon2': '0.392', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 438657024. Throughput: 0: 4387.8. Samples: 109664600. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:27:02,794][52567] Avg episode reward: [(0, '72.326')] [2024-08-06 04:27:04,220][52794] DAMAGECOUNT value on done: 531293.0 [2024-08-06 04:27:04,221][52794] Sum rewards: 65.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.271', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.216', 'weapon5': '0.218', 'weapon2': '0.312', 'weapon4': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '54.500'} [2024-08-06 04:27:04,458][52650] Updated weights for policy 0, policy_version 53551 (0.0012) [2024-08-06 04:27:04,908][52659] DAMAGECOUNT value on done: 522923.0 [2024-08-06 04:27:04,910][52659] Sum rewards: 67.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.488', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.212', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:05,221][52663] DAMAGECOUNT value on done: 529003.0 [2024-08-06 04:27:05,232][52663] Sum rewards: 70.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.042', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.838', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '56.500'} [2024-08-06 04:27:07,257][52794] DAMAGECOUNT value on done: 521889.0 [2024-08-06 04:27:07,261][52794] Sum rewards: 73.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.895', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'weapon5': '0.118', 'AMMO3': '0.236', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.368', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '62.000'} [2024-08-06 04:27:07,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 438755328. Throughput: 0: 4388.0. Samples: 109691100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:27:07,795][52567] Avg episode reward: [(0, '72.336')] [2024-08-06 04:27:08,059][52659] DAMAGECOUNT value on done: 527230.0 [2024-08-06 04:27:08,062][52659] Sum rewards: 78.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.751', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.092', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '66.000'} [2024-08-06 04:27:08,112][52663] DAMAGECOUNT value on done: 521199.0 [2024-08-06 04:27:08,112][52663] Sum rewards: 62.723, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.614', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.074', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '51.000'} [2024-08-06 04:27:08,792][52650] Updated weights for policy 0, policy_version 53561 (0.0026) [2024-08-06 04:27:09,771][52649] DAMAGECOUNT value on done: 504982.0 [2024-08-06 04:27:09,771][52649] Sum rewards: 74.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.348', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.172', 'AMMO3': '0.176', 'weapon4': '0.374', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:10,174][52794] DAMAGECOUNT value on done: 530004.0 [2024-08-06 04:27:10,175][52794] Sum rewards: 71.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.714', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '60.000'} [2024-08-06 04:27:10,735][52659] DAMAGECOUNT value on done: 521362.0 [2024-08-06 04:27:10,735][52659] Sum rewards: 67.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.408', 'AMMO5': '0.024', 'AMMO2': '0.081', 'weapon4': '0.178', 'AMMO3': '0.194', 'weapon2': '0.344', 'weapon5': '0.352', 'AMMO4': '0.407', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '55.000'} [2024-08-06 04:27:11,202][52663] DAMAGECOUNT value on done: 514822.0 [2024-08-06 04:27:11,202][52663] Sum rewards: 68.140, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.154', 'weapon2': '0.928', 'WEAPON3': '1.000', 'weapon3': '2.976', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '54.000'} [2024-08-06 04:27:12,432][52649] DAMAGECOUNT value on done: 497830.0 [2024-08-06 04:27:12,432][52649] Sum rewards: 74.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.047', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.732', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '60.000'} [2024-08-06 04:27:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 438829056. Throughput: 0: 4383.8. Samples: 109717290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:27:12,794][52567] Avg episode reward: [(0, '72.196')] [2024-08-06 04:27:13,409][52794] DAMAGECOUNT value on done: 530911.0 [2024-08-06 04:27:13,410][52794] Sum rewards: 56.347, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon2': '0.188', 'weapon5': '0.194', 'AMMO4': '0.238', 'AMMO3': '0.259', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '49.000'} [2024-08-06 04:27:13,526][52650] Updated weights for policy 0, policy_version 53571 (0.0023) [2024-08-06 04:27:13,636][52659] DAMAGECOUNT value on done: 525897.0 [2024-08-06 04:27:13,636][52659] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.128', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.122', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:13,937][52649] Large shaping reward 2.518 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0)] [2024-08-06 04:27:14,315][52663] DAMAGECOUNT value on done: 519485.0 [2024-08-06 04:27:14,316][52663] Sum rewards: 77.509, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.162', 'AMMO4': '0.165', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:15,186][52649] DAMAGECOUNT value on done: 513650.0 [2024-08-06 04:27:15,188][52649] Sum rewards: 78.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.015', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '64.000'} [2024-08-06 04:27:16,505][52659] DAMAGECOUNT value on done: 522161.0 [2024-08-06 04:27:16,505][52659] Sum rewards: 62.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.211', 'weapon4': '0.360', 'weapon2': '0.370', 'WEAPON5': '0.450', 'ARMOR': '0.453', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '53.000'} [2024-08-06 04:27:16,561][52794] DAMAGECOUNT value on done: 518738.0 [2024-08-06 04:27:16,562][52794] Sum rewards: 64.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.379', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.084', 'weapon5': '0.204', 'AMMO4': '0.206', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.684', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '54.000'} [2024-08-06 04:27:16,724][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:27:17,147][52663] DAMAGECOUNT value on done: 521169.0 [2024-08-06 04:27:17,147][52663] Sum rewards: 83.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.095', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.148', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.360', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '2.820', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.913', 'FRAGCOUNT': '68.000'} [2024-08-06 04:27:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 438927360. Throughput: 0: 4385.8. Samples: 109730220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:27:17,794][52567] Avg episode reward: [(0, '72.241')] [2024-08-06 04:27:18,055][52649] DAMAGECOUNT value on done: 508432.0 [2024-08-06 04:27:18,057][52649] Sum rewards: 78.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.102', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '66.000'} [2024-08-06 04:27:18,413][52650] Updated weights for policy 0, policy_version 53581 (0.0023) [2024-08-06 04:27:19,663][52663] DAMAGECOUNT value on done: 527285.0 [2024-08-06 04:27:19,663][52663] Sum rewards: 67.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.182', 'weapon2': '0.244', 'weapon5': '0.254', 'weapon4': '0.258', 'AMMO4': '0.268', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '54.000'} [2024-08-06 04:27:20,217][52666] DAMAGECOUNT value on done: 520234.0 [2024-08-06 04:27:20,218][52666] Sum rewards: 73.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.530', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '62.500'} [2024-08-06 04:27:20,800][52649] DAMAGECOUNT value on done: 498030.0 [2024-08-06 04:27:20,802][52649] Sum rewards: 71.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.348', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.134', 'AMMO3': '0.186', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:22,681][52670] DAMAGECOUNT value on done: 511740.0 [2024-08-06 04:27:22,682][52670] Sum rewards: 77.055, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.700', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.118', 'AMMO4': '0.245', 'AMMO3': '0.263', 'weapon5': '0.282', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.918', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '65.000'} [2024-08-06 04:27:22,759][52663] DAMAGECOUNT value on done: 522368.0 [2024-08-06 04:27:22,760][52663] Sum rewards: 77.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.948', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.102', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 04:27:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 439009280. Throughput: 0: 4380.4. Samples: 109756290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:27:22,794][52567] Avg episode reward: [(0, '72.614')] [2024-08-06 04:27:22,801][52794] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:27:22,857][52666] DAMAGECOUNT value on done: 522522.0 [2024-08-06 04:27:22,858][52666] Sum rewards: 67.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.718', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '56.000'} [2024-08-06 04:27:23,251][52650] Updated weights for policy 0, policy_version 53591 (0.0030) [2024-08-06 04:27:23,817][52795] DAMAGECOUNT value on done: 483972.0 [2024-08-06 04:27:23,817][52795] Sum rewards: 66.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.055', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.184', 'AMMO3': '0.219', 'weapon2': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '54.000'} [2024-08-06 04:27:23,887][52649] DAMAGECOUNT value on done: 510047.0 [2024-08-06 04:27:23,887][52649] Sum rewards: 89.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.295', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.042', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '72.000'} [2024-08-06 04:27:25,681][52670] DAMAGECOUNT value on done: 521813.0 [2024-08-06 04:27:25,681][52670] Sum rewards: 70.731, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.898', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.082', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:25,892][52663] DAMAGECOUNT value on done: 517227.0 [2024-08-06 04:27:25,894][52663] Sum rewards: 66.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.924', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon4': '0.172', 'AMMO3': '0.255', 'weapon5': '0.300', 'AMMO4': '0.310', 'weapon2': '0.416', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.776', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:25,924][52666] DAMAGECOUNT value on done: 523833.0 [2024-08-06 04:27:25,924][52666] Sum rewards: 61.634, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon2': '0.148', 'AMMO3': '0.181', 'AMMO4': '0.188', 'weapon5': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HEALTH': '0.376', 'weapon4': '0.396', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '48.000'} [2024-08-06 04:27:26,832][52649] DAMAGECOUNT value on done: 505632.0 [2024-08-06 04:27:26,833][52649] Sum rewards: 62.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.042', 'weapon4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.193', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.436', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '53.000'} [2024-08-06 04:27:27,046][52795] DAMAGECOUNT value on done: 473306.0 [2024-08-06 04:27:27,046][52795] Sum rewards: 66.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.150', 'weapon2': '0.244', 'AMMO3': '0.256', 'AMMO4': '0.264', 'weapon5': '0.278', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '2.870', 'weapon3': '3.022', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:27,655][52650] Updated weights for policy 0, policy_version 53601 (0.0032) [2024-08-06 04:27:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 439099392. Throughput: 0: 4376.7. Samples: 109782330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 04:27:27,802][52567] Avg episode reward: [(0, '72.423')] [2024-08-06 04:27:28,835][52663] DAMAGECOUNT value on done: 514825.0 [2024-08-06 04:27:28,837][52663] Sum rewards: 59.248, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.492', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.126', 'weapon4': '0.138', 'weapon5': '0.190', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '2.800', 'weapon3': '2.906', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '46.000'} [2024-08-06 04:27:28,850][52670] DAMAGECOUNT value on done: 514714.0 [2024-08-06 04:27:28,850][52670] Sum rewards: 65.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.606', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.215', 'weapon5': '0.224', 'AMMO4': '0.230', 'weapon4': '0.268', 'weapon2': '0.346', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '54.000'} [2024-08-06 04:27:29,019][52666] DAMAGECOUNT value on done: 521954.0 [2024-08-06 04:27:29,021][52666] Sum rewards: 60.439, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.485', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.086', 'AMMO3': '0.178', 'weapon2': '0.194', 'AMMO4': '0.223', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.284', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '49.000'} [2024-08-06 04:27:29,802][52649] DAMAGECOUNT value on done: 510181.0 [2024-08-06 04:27:29,803][52649] Sum rewards: 71.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.152', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.600', 'weapon3': '2.712', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:30,205][52795] DAMAGECOUNT value on done: 474290.0 [2024-08-06 04:27:30,205][52795] Sum rewards: 73.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.182', 'AMMO4': '0.189', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:30,953][52667] DAMAGECOUNT value on done: 522545.0 [2024-08-06 04:27:30,954][52667] Sum rewards: 68.049, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.738', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.102', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:31,906][52670] DAMAGECOUNT value on done: 513741.0 [2024-08-06 04:27:31,907][52670] Sum rewards: 72.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.070', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:31,942][52663] DAMAGECOUNT value on done: 522227.0 [2024-08-06 04:27:31,942][52663] Sum rewards: 69.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.988', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '3.370', 'weapon3': '3.442', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:32,223][52650] Updated weights for policy 0, policy_version 53611 (0.0010) [2024-08-06 04:27:32,241][52666] DAMAGECOUNT value on done: 519811.0 [2024-08-06 04:27:32,243][52666] Sum rewards: 79.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.200', 'AMMO3': '0.202', 'weapon5': '0.218', 'AMMO4': '0.226', 'weapon4': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '65.000'} [2024-08-06 04:27:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 439181312. Throughput: 0: 4379.1. Samples: 109795670. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:27:32,794][52567] Avg episode reward: [(0, '72.103')] [2024-08-06 04:27:32,818][52649] DAMAGECOUNT value on done: 512085.0 [2024-08-06 04:27:32,818][52649] Sum rewards: 72.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.672', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.204', 'weapon5': '0.244', 'AMMO4': '0.277', 'weapon4': '0.320', 'weapon2': '0.338', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '60.000'} [2024-08-06 04:27:33,441][52795] DAMAGECOUNT value on done: 481068.0 [2024-08-06 04:27:33,441][52795] Sum rewards: 81.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.727', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO4': '0.140', 'weapon5': '0.176', 'AMMO3': '0.240', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '68.000'} [2024-08-06 04:27:33,650][52667] DAMAGECOUNT value on done: 532972.0 [2024-08-06 04:27:33,653][52667] Sum rewards: 85.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO4': '0.042', 'weapon4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.160', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '68.000'} [2024-08-06 04:27:34,950][52663] DAMAGECOUNT value on done: 529419.0 [2024-08-06 04:27:34,950][52663] Sum rewards: 55.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.072', 'weapon4': '0.132', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.114', 'DAMAGECOUNT': '14.196', 'FRAGCOUNT': '50.000'} [2024-08-06 04:27:35,011][52670] DAMAGECOUNT value on done: 525285.0 [2024-08-06 04:27:35,012][52670] Sum rewards: 74.695, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.260', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '60.000'} [2024-08-06 04:27:35,189][52666] DAMAGECOUNT value on done: 513641.0 [2024-08-06 04:27:35,193][52666] Sum rewards: 59.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.626', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.082', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon4': '0.388', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '50.500'} [2024-08-06 04:27:35,604][52649] DAMAGECOUNT value on done: 504987.0 [2024-08-06 04:27:35,606][52649] Sum rewards: 86.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.415', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.242', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.580', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '72.000'} [2024-08-06 04:27:36,478][52795] DAMAGECOUNT value on done: 475845.0 [2024-08-06 04:27:36,478][52795] Sum rewards: 71.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.684', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.154', 'AMMO4': '0.190', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.380', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.702', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2024-08-06 04:27:36,702][52667] DAMAGECOUNT value on done: 520641.0 [2024-08-06 04:27:36,702][52667] Sum rewards: 74.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.960', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.098', 'weapon5': '0.166', 'AMMO3': '0.188', 'AMMO4': '0.236', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:36,766][52650] Updated weights for policy 0, policy_version 53621 (0.0010) [2024-08-06 04:27:37,353][52663] DAMAGECOUNT value on done: 517667.0 [2024-08-06 04:27:37,355][52663] Sum rewards: 60.131, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.520', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.089', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'weapon2': '0.366', 'WEAPON3': '1.750', 'HITCOUNT': '3.050', 'weapon3': '3.196', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '53.000'} [2024-08-06 04:27:37,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 439271424. Throughput: 0: 4374.4. Samples: 109822010. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:27:37,795][52567] Avg episode reward: [(0, '72.080')] [2024-08-06 04:27:38,065][52670] DAMAGECOUNT value on done: 519779.0 [2024-08-06 04:27:38,067][52670] Sum rewards: 71.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.175', 'weapon5': '0.206', 'weapon2': '0.218', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:38,309][52666] DAMAGECOUNT value on done: 519262.0 [2024-08-06 04:27:38,313][52666] Sum rewards: 81.757, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.543', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'weapon4': '0.180', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.344', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '69.000'} [2024-08-06 04:27:38,544][52649] DAMAGECOUNT value on done: 513465.0 [2024-08-06 04:27:38,546][52649] Sum rewards: 70.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO4': '0.115', 'AMMO3': '0.194', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.400', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:39,482][52795] DAMAGECOUNT value on done: 485079.0 [2024-08-06 04:27:39,484][52795] Sum rewards: 71.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.359', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:39,707][52667] DAMAGECOUNT value on done: 523113.0 [2024-08-06 04:27:39,709][52667] Sum rewards: 77.317, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.118', 'weapon2': '0.168', 'weapon5': '0.236', 'AMMO4': '0.271', 'AMMO3': '0.281', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.158', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '65.000'} [2024-08-06 04:27:40,517][52663] DAMAGECOUNT value on done: 515237.0 [2024-08-06 04:27:40,519][52663] Sum rewards: 72.646, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.158', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.101', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.270', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '62.000'} [2024-08-06 04:27:40,642][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:27:41,115][52670] DAMAGECOUNT value on done: 508621.0 [2024-08-06 04:27:41,115][52670] Sum rewards: 74.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.832', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.068', 'weapon5': '0.072', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:41,334][52666] DAMAGECOUNT value on done: 516928.0 [2024-08-06 04:27:41,337][52666] Sum rewards: 74.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.424', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.166', 'AMMO3': '0.178', 'AMMO4': '0.207', 'weapon5': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '58.000'} [2024-08-06 04:27:41,738][52650] Updated weights for policy 0, policy_version 53631 (0.0011) [2024-08-06 04:27:41,744][52649] DAMAGECOUNT value on done: 517125.0 [2024-08-06 04:27:41,747][52649] Sum rewards: 74.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'weapon4': '0.044', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.500', 'WEAPON3': '0.950', 'weapon3': '3.218', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:42,605][52795] DAMAGECOUNT value on done: 489602.0 [2024-08-06 04:27:42,605][52795] Sum rewards: 54.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.166', 'AMMO4': '0.181', 'weapon5': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '45.000'} [2024-08-06 04:27:42,640][52667] DAMAGECOUNT value on done: 527883.0 [2024-08-06 04:27:42,641][52667] Sum rewards: 78.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.855', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.126', 'weapon4': '0.138', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '63.000'} [2024-08-06 04:27:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 439361536. Throughput: 0: 4379.3. Samples: 109848560. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:27:42,794][52567] Avg episode reward: [(0, '72.124')] [2024-08-06 04:27:43,382][52663] DAMAGECOUNT value on done: 513471.0 [2024-08-06 04:27:43,384][52663] Sum rewards: 73.655, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.108', 'AMMO3': '0.153', 'AMMO4': '0.170', 'weapon5': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:43,735][52670] DAMAGECOUNT value on done: 516420.0 [2024-08-06 04:27:43,736][52670] Sum rewards: 74.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.491', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:43,904][52666] DAMAGECOUNT value on done: 518301.0 [2024-08-06 04:27:43,904][52666] Sum rewards: 69.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.532', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:44,576][52649] DAMAGECOUNT value on done: 518669.0 [2024-08-06 04:27:44,576][52649] Sum rewards: 76.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.962', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.120', 'weapon2': '0.192', 'weapon5': '0.224', 'AMMO4': '0.250', 'AMMO3': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '64.000'} [2024-08-06 04:27:45,005][52667] DAMAGECOUNT value on done: 532641.0 [2024-08-06 04:27:45,005][52667] Sum rewards: 63.105, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.108', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.155', 'AMMO4': '0.226', 'weapon5': '0.226', 'weapon4': '0.304', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '49.000'} [2024-08-06 04:27:45,704][52795] DAMAGECOUNT value on done: 487063.0 [2024-08-06 04:27:45,704][52795] Sum rewards: 61.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.558', 'AMMO5': '0.007', 'AMMO2': '0.049', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.192', 'AMMO3': '0.196', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '50.500'} [2024-08-06 04:27:46,404][52650] Updated weights for policy 0, policy_version 53641 (0.0012) [2024-08-06 04:27:46,631][52670] DAMAGECOUNT value on done: 512484.0 [2024-08-06 04:27:46,633][52670] Sum rewards: 56.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.054', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.145', 'weapon4': '0.146', 'weapon5': '0.172', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '2.530', 'weapon3': '3.240', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '44.000'} [2024-08-06 04:27:46,800][52663] DAMAGECOUNT value on done: 516019.0 [2024-08-06 04:27:46,802][52663] Sum rewards: 75.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.522', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '64.000'} [2024-08-06 04:27:46,836][52666] DAMAGECOUNT value on done: 512844.0 [2024-08-06 04:27:46,839][52666] Sum rewards: 72.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.242', 'weapon4': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:46,883][52649] DAMAGECOUNT value on done: 515939.0 [2024-08-06 04:27:46,883][52649] Sum rewards: 69.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.452', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO4': '0.142', 'weapon5': '0.182', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.146', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:47,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 439451648. Throughput: 0: 4383.1. Samples: 109861840. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:27:47,802][52567] Avg episode reward: [(0, '71.439')] [2024-08-06 04:27:47,891][52667] DAMAGECOUNT value on done: 523981.0 [2024-08-06 04:27:47,892][52667] Sum rewards: 67.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.149', 'weapon2': '0.156', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.432', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.000'} [2024-08-06 04:27:48,827][52795] DAMAGECOUNT value on done: 476635.0 [2024-08-06 04:27:48,830][52795] Sum rewards: 81.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.968', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.112', 'AMMO4': '0.138', 'weapon5': '0.174', 'AMMO3': '0.234', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '67.000'} [2024-08-06 04:27:49,798][52649] DAMAGECOUNT value on done: 503890.0 [2024-08-06 04:27:49,799][52649] Sum rewards: 62.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.072', 'weapon4': '0.096', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'HITCOUNT': '3.080', 'weapon3': '3.428', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '55.000'} [2024-08-06 04:27:49,872][52670] DAMAGECOUNT value on done: 513614.0 [2024-08-06 04:27:49,874][52670] Sum rewards: 84.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.275', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.118', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '69.000'} [2024-08-06 04:27:49,873][52663] DAMAGECOUNT value on done: 526794.0 [2024-08-06 04:27:49,875][52663] Sum rewards: 69.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.696', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.097', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.396', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:50,137][52666] DAMAGECOUNT value on done: 517933.0 [2024-08-06 04:27:50,139][52666] Sum rewards: 68.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.084', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.190', 'AMMO3': '0.198', 'weapon5': '0.212', 'AMMO4': '0.263', 'WEAPON5': '0.500', 'weapon2': '0.558', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '56.500'} [2024-08-06 04:27:50,550][52667] DAMAGECOUNT value on done: 520336.0 [2024-08-06 04:27:50,551][52667] Sum rewards: 63.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.200', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.084', 'AMMO4': '0.130', 'weapon5': '0.140', 'WEAPON4': '0.250', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '56.000'} [2024-08-06 04:27:51,079][52650] Updated weights for policy 0, policy_version 53651 (0.0023) [2024-08-06 04:27:52,021][52795] DAMAGECOUNT value on done: 487469.0 [2024-08-06 04:27:52,023][52795] Sum rewards: 65.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.013', 'AMMO2': '0.062', 'weapon4': '0.114', 'weapon5': '0.228', 'AMMO3': '0.230', 'AMMO4': '0.309', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '2.894', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '54.500'} [2024-08-06 04:27:52,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 439541760. Throughput: 0: 4381.1. Samples: 109888250. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:27:52,795][52567] Avg episode reward: [(0, '71.325')] [2024-08-06 04:27:52,799][52663] DAMAGECOUNT value on done: 514694.0 [2024-08-06 04:27:52,801][52663] Sum rewards: 69.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.526', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.450', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:52,811][52670] DAMAGECOUNT value on done: 519441.0 [2024-08-06 04:27:52,812][52670] Sum rewards: 71.456, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.194', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.158', 'weapon5': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '2.546', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '56.000'} [2024-08-06 04:27:52,904][52649] DAMAGECOUNT value on done: 512138.0 [2024-08-06 04:27:52,904][52649] Sum rewards: 68.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.645', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO4': '0.197', 'weapon2': '0.198', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.370', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.000'} [2024-08-06 04:27:52,949][52666] DAMAGECOUNT value on done: 511744.0 [2024-08-06 04:27:52,950][52666] Sum rewards: 70.408, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.803', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.168', 'AMMO4': '0.176', 'weapon4': '0.184', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '60.000'} [2024-08-06 04:27:53,272][52667] DAMAGECOUNT value on done: 528048.0 [2024-08-06 04:27:53,272][52667] Sum rewards: 73.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.196', 'weapon2': '0.832', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '62.000'} [2024-08-06 04:27:54,120][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:27:55,252][52795] DAMAGECOUNT value on done: 481991.0 [2024-08-06 04:27:55,253][52795] Sum rewards: 77.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.120', 'AMMO4': '0.121', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '64.000'} [2024-08-06 04:27:55,328][52669] DAMAGECOUNT value on done: 525887.0 [2024-08-06 04:27:55,332][52669] Sum rewards: 76.401, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.155', 'weapon5': '0.176', 'AMMO4': '0.211', 'weapon4': '0.212', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '62.000'} [2024-08-06 04:27:55,412][52650] Updated weights for policy 0, policy_version 53661 (0.0014) [2024-08-06 04:27:55,439][52663] DAMAGECOUNT value on done: 525532.0 [2024-08-06 04:27:55,440][52663] Sum rewards: 69.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.156', 'weapon2': '0.218', 'AMMO3': '0.240', 'weapon5': '0.240', 'AMMO4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:55,487][52649] DAMAGECOUNT value on done: 501026.0 [2024-08-06 04:27:55,487][52649] Sum rewards: 64.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.638', 'AMMO2': '0.017', 'weapon4': '0.060', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon2': '0.290', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.490', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '56.000'} [2024-08-06 04:27:55,743][52670] DAMAGECOUNT value on done: 509806.0 [2024-08-06 04:27:55,743][52670] Sum rewards: 75.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.128', 'weapon4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '62.000'} [2024-08-06 04:27:55,925][52666] DAMAGECOUNT value on done: 526483.0 [2024-08-06 04:27:55,926][52666] Sum rewards: 61.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.610', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.068', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '53.000'} [2024-08-06 04:27:56,097][52667] DAMAGECOUNT value on done: 531199.0 [2024-08-06 04:27:56,098][52667] Sum rewards: 80.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.966', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '66.000'} [2024-08-06 04:27:57,330][52820] DAMAGECOUNT value on done: 483885.0 [2024-08-06 04:27:57,331][52820] Sum rewards: 87.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.213', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.464', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '72.000'} [2024-08-06 04:27:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 439623680. Throughput: 0: 4386.0. Samples: 109914660. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:27:57,794][52567] Avg episode reward: [(0, '71.230')] [2024-08-06 04:27:58,107][52669] DAMAGECOUNT value on done: 516822.0 [2024-08-06 04:27:58,108][52669] Sum rewards: 62.035, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.162', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.078', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '55.000'} [2024-08-06 04:27:58,141][52663] DAMAGECOUNT value on done: 523985.0 [2024-08-06 04:27:58,143][52663] Sum rewards: 71.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.561', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.038', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon5': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '59.000'} [2024-08-06 04:27:58,261][52649] DAMAGECOUNT value on done: 515920.0 [2024-08-06 04:27:58,262][52649] Sum rewards: 68.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.791', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.173', 'weapon5': '0.182', 'AMMO4': '0.199', 'weapon4': '0.232', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.020', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:58,398][52795] DAMAGECOUNT value on done: 478666.0 [2024-08-06 04:27:58,399][52795] Sum rewards: 70.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO2': '0.007', 'AMMO5': '0.009', 'weapon4': '0.018', 'AMMO4': '0.036', 'weapon5': '0.036', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.334', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 04:27:58,816][52670] DAMAGECOUNT value on done: 515148.0 [2024-08-06 04:27:58,817][52670] Sum rewards: 73.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.904', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.194', 'weapon5': '0.198', 'AMMO4': '0.198', 'weapon2': '0.208', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '61.000'} [2024-08-06 04:27:58,905][52667] DAMAGECOUNT value on done: 519302.0 [2024-08-06 04:27:58,905][52667] Sum rewards: 87.037, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.495', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.151', 'AMMO4': '0.158', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'weapon4': '0.476', 'WEAPON3': '0.900', 'weapon3': '2.624', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '69.000'} [2024-08-06 04:27:58,935][52666] DAMAGECOUNT value on done: 518907.0 [2024-08-06 04:27:58,935][52666] Sum rewards: 66.294, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.994', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.090', 'AMMO3': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.070', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '52.000'} [2024-08-06 04:28:00,310][52820] DAMAGECOUNT value on done: 483572.0 [2024-08-06 04:28:00,311][52820] Sum rewards: 72.018, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.070', 'AMMO3': '0.148', 'AMMO4': '0.164', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.345', 'weapon2': '0.768', 'WEAPON3': '0.850', 'weapon3': '2.810', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '56.000'} [2024-08-06 04:28:00,590][52650] Updated weights for policy 0, policy_version 53671 (0.0012) [2024-08-06 04:28:01,265][52670] DAMAGECOUNT value on done: 523679.0 [2024-08-06 04:28:01,265][52670] Sum rewards: 74.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.502', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.072', 'AMMO4': '0.179', 'weapon5': '0.192', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '62.000'} [2024-08-06 04:28:01,276][52669] DAMAGECOUNT value on done: 528658.0 [2024-08-06 04:28:01,277][52669] Sum rewards: 83.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.636', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.236', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '71.000'} [2024-08-06 04:28:01,437][52663] DAMAGECOUNT value on done: 518412.0 [2024-08-06 04:28:01,437][52663] Sum rewards: 62.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.036', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.166', 'weapon5': '0.174', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.960', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '52.000'} [2024-08-06 04:28:01,460][52649] DAMAGECOUNT value on done: 515319.0 [2024-08-06 04:28:01,460][52649] Sum rewards: 69.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.270', 'weapon2': '0.334', 'WEAPON3': '1.650', 'HITCOUNT': '3.230', 'weapon3': '3.322', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:01,463][52667] DAMAGECOUNT value on done: 520781.0 [2024-08-06 04:28:01,463][52667] Sum rewards: 76.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.051', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '64.000'} [2024-08-06 04:28:01,471][52666] DAMAGECOUNT value on done: 518993.0 [2024-08-06 04:28:01,471][52666] Sum rewards: 84.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.118', 'AMMO3': '0.178', 'weapon5': '0.234', 'AMMO4': '0.285', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '69.000'} [2024-08-06 04:28:01,510][52795] DAMAGECOUNT value on done: 476821.0 [2024-08-06 04:28:01,512][52795] Sum rewards: 81.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.064', 'AMMO4': '0.098', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'weapon3': '3.334', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 439713792. Throughput: 0: 4391.3. Samples: 109927830. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:28:02,794][52567] Avg episode reward: [(0, '71.525')] [2024-08-06 04:28:03,502][52820] DAMAGECOUNT value on done: 486230.0 [2024-08-06 04:28:03,504][52820] Sum rewards: 69.856, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.828', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.224', 'weapon4': '0.260', 'AMMO3': '0.266', 'AMMO4': '0.267', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.874', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '60.000'} [2024-08-06 04:28:03,720][52670] DAMAGECOUNT value on done: 520168.0 [2024-08-06 04:28:03,721][52670] Sum rewards: 62.105, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.045', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.108', 'AMMO4': '0.111', 'weapon5': '0.114', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON3': '0.950', 'HITCOUNT': '3.040', 'weapon3': '3.298', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '49.000'} [2024-08-06 04:28:03,903][52666] DAMAGECOUNT value on done: 519037.0 [2024-08-06 04:28:03,903][52666] Sum rewards: 75.522, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.535', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.128', 'weapon4': '0.136', 'AMMO4': '0.201', 'weapon2': '0.204', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '64.000'} [2024-08-06 04:28:04,048][52667] DAMAGECOUNT value on done: 529149.0 [2024-08-06 04:28:04,048][52667] Sum rewards: 82.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.405', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.132', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:04,438][52669] DAMAGECOUNT value on done: 525444.0 [2024-08-06 04:28:04,438][52669] Sum rewards: 83.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.910', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.088', 'weapon5': '0.140', 'AMMO3': '0.227', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '69.000'} [2024-08-06 04:28:04,690][52795] DAMAGECOUNT value on done: 484233.0 [2024-08-06 04:28:04,691][52795] Sum rewards: 61.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.109', 'weapon4': '0.172', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.140', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '52.000'} [2024-08-06 04:28:04,719][52649] DAMAGECOUNT value on done: 509555.0 [2024-08-06 04:28:04,719][52649] Sum rewards: 82.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.310', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '69.000'} [2024-08-06 04:28:04,807][52650] Updated weights for policy 0, policy_version 53681 (0.0012) [2024-08-06 04:28:06,508][52670] DAMAGECOUNT value on done: 503929.0 [2024-08-06 04:28:06,509][52670] Sum rewards: 64.125, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.596', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.000', 'weapon3': '3.018', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:06,614][52820] DAMAGECOUNT value on done: 476110.0 [2024-08-06 04:28:06,615][52820] Sum rewards: 61.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.822', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.118', 'AMMO3': '0.227', 'AMMO4': '0.246', 'weapon5': '0.274', 'weapon2': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.038', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '52.000'} [2024-08-06 04:28:06,782][52666] DAMAGECOUNT value on done: 520584.0 [2024-08-06 04:28:06,788][52666] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.171', 'AMMO2': '0.032', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.203', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:06,994][52667] DAMAGECOUNT value on done: 518796.0 [2024-08-06 04:28:06,996][52667] Sum rewards: 57.258, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.500', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.154', 'weapon5': '0.160', 'AMMO4': '0.216', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.500', 'weapon3': '2.830', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:07,514][52669] DAMAGECOUNT value on done: 523618.0 [2024-08-06 04:28:07,514][52669] Sum rewards: 75.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.415', 'AMMO5': '0.020', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO4': '0.142', 'AMMO3': '0.195', 'weapon5': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 439803904. Throughput: 0: 4391.8. Samples: 109953920. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 04:28:07,795][52567] Avg episode reward: [(0, '71.491')] [2024-08-06 04:28:07,795][52795] DAMAGECOUNT value on done: 477506.0 [2024-08-06 04:28:07,803][52795] Sum rewards: 80.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.458', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon5': '0.128', 'AMMO4': '0.246', 'AMMO3': '0.255', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '67.000'} [2024-08-06 04:28:09,319][52667] DAMAGECOUNT value on done: 527594.0 [2024-08-06 04:28:09,321][52667] Sum rewards: 67.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.286', 'ARMOR': '0.457', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.292', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '57.000'} [2024-08-06 04:28:09,326][52670] DAMAGECOUNT value on done: 516748.0 [2024-08-06 04:28:09,326][52670] Sum rewards: 78.031, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.966', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.446', 'WEAPON3': '1.000', 'weapon3': '3.192', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '62.000'} [2024-08-06 04:28:09,652][52650] Updated weights for policy 0, policy_version 53691 (0.0011) [2024-08-06 04:28:09,690][52666] DAMAGECOUNT value on done: 522864.0 [2024-08-06 04:28:09,691][52666] Sum rewards: 89.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.028', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'weapon4': '0.176', 'AMMO3': '0.197', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '73.000'} [2024-08-06 04:28:09,808][52820] DAMAGECOUNT value on done: 487102.0 [2024-08-06 04:28:09,809][52820] Sum rewards: 80.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.561', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.100', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:10,693][52669] DAMAGECOUNT value on done: 526216.0 [2024-08-06 04:28:10,696][52669] Sum rewards: 71.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:10,963][52795] DAMAGECOUNT value on done: 493153.0 [2024-08-06 04:28:10,963][52795] Sum rewards: 71.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.855', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.192', 'weapon4': '0.228', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:12,041][52670] DAMAGECOUNT value on done: 524368.0 [2024-08-06 04:28:12,042][52670] Sum rewards: 75.986, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.644', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.126', 'AMMO3': '0.245', 'AMMO4': '0.264', 'weapon5': '0.326', 'weapon2': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '65.000'} [2024-08-06 04:28:12,193][52667] DAMAGECOUNT value on done: 532151.0 [2024-08-06 04:28:12,194][52667] Sum rewards: 64.868, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.038', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.192', 'AMMO3': '0.211', 'weapon2': '0.586', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.130', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '54.000'} [2024-08-06 04:28:12,450][52666] DAMAGECOUNT value on done: 506406.0 [2024-08-06 04:28:12,451][52666] Sum rewards: 62.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.312', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 439885824. Throughput: 0: 4396.9. Samples: 109980190. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 04:28:12,802][52567] Avg episode reward: [(0, '71.687')] [2024-08-06 04:28:12,973][52820] DAMAGECOUNT value on done: 478592.0 [2024-08-06 04:28:12,973][52820] Sum rewards: 64.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.634', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.166', 'AMMO4': '0.167', 'weapon5': '0.190', 'weapon2': '0.202', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.144', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2024-08-06 04:28:13,778][52669] DAMAGECOUNT value on done: 527036.0 [2024-08-06 04:28:13,781][52669] Sum rewards: 76.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.851', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:13,972][52795] DAMAGECOUNT value on done: 485319.0 [2024-08-06 04:28:13,973][52795] Sum rewards: 66.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.234', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.241', 'weapon2': '0.306', 'WEAPON3': '1.450', 'HITCOUNT': '3.510', 'weapon3': '3.538', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '55.000'} [2024-08-06 04:28:14,644][52650] Updated weights for policy 0, policy_version 53701 (0.0013) [2024-08-06 04:28:14,887][52667] DAMAGECOUNT value on done: 533474.0 [2024-08-06 04:28:14,889][52667] Sum rewards: 74.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.325', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.158', 'AMMO3': '0.172', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.562', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:15,145][52670] DAMAGECOUNT value on done: 513994.0 [2024-08-06 04:28:15,149][52670] Sum rewards: 63.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.188', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.088', 'weapon4': '0.110', 'AMMO4': '0.168', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.336', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2024-08-06 04:28:15,466][52666] DAMAGECOUNT value on done: 516786.0 [2024-08-06 04:28:15,467][52666] Sum rewards: 94.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.134', 'AMMO3': '0.184', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '4.350', 'DAMAGECOUNT': '21.612', 'FRAGCOUNT': '77.000'} [2024-08-06 04:28:15,758][52668] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:28:16,058][52820] DAMAGECOUNT value on done: 482620.0 [2024-08-06 04:28:16,060][52820] Sum rewards: 64.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.575', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.090', 'weapon2': '0.216', 'AMMO4': '0.222', 'weapon5': '0.238', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '53.000'} [2024-08-06 04:28:16,726][52669] DAMAGECOUNT value on done: 523557.0 [2024-08-06 04:28:16,727][52669] Sum rewards: 76.285, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.354', 'AMMO5': '0.011', 'weapon4': '0.036', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '62.000'} [2024-08-06 04:28:16,881][52671] DAMAGECOUNT value on done: 530372.0 [2024-08-06 04:28:16,881][52671] Sum rewards: 71.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.347', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.122', 'weapon5': '0.126', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '60.500'} [2024-08-06 04:28:17,053][52795] DAMAGECOUNT value on done: 474675.0 [2024-08-06 04:28:17,054][52795] Sum rewards: 66.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.055', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.032', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.376', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '55.000'} [2024-08-06 04:28:17,635][52667] DAMAGECOUNT value on done: 529269.0 [2024-08-06 04:28:17,635][52667] Sum rewards: 69.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.869', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '57.000'} [2024-08-06 04:28:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 439975936. Throughput: 0: 4392.7. Samples: 109993340. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 04:28:17,794][52567] Avg episode reward: [(0, '72.093')] [2024-08-06 04:28:18,113][52670] DAMAGECOUNT value on done: 520186.0 [2024-08-06 04:28:18,115][52670] Sum rewards: 74.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.516', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.080', 'weapon5': '0.132', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:18,988][52650] Updated weights for policy 0, policy_version 53711 (0.0013) [2024-08-06 04:28:19,236][52820] DAMAGECOUNT value on done: 487194.0 [2024-08-06 04:28:19,236][52820] Sum rewards: 82.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.010', 'weapon4': '0.048', 'AMMO2': '0.050', 'weapon5': '0.128', 'AMMO3': '0.202', 'AMMO4': '0.247', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:19,955][52671] DAMAGECOUNT value on done: 527446.0 [2024-08-06 04:28:19,956][52671] Sum rewards: 66.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.645', 'AMMO5': '0.021', 'AMMO2': '0.059', 'AMMO3': '0.161', 'weapon4': '0.228', 'weapon5': '0.232', 'AMMO4': '0.296', 'weapon2': '0.546', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.716', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '55.000'} [2024-08-06 04:28:20,058][52669] DAMAGECOUNT value on done: 533266.0 [2024-08-06 04:28:20,060][52669] Sum rewards: 77.679, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.550', 'AMMO5': '0.027', 'AMMO2': '0.085', 'AMMO3': '0.253', 'weapon2': '0.282', 'weapon4': '0.294', 'weapon5': '0.372', 'AMMO4': '0.424', 'WEAPON5': '0.750', 'WEAPON4': '0.900', 'WEAPON3': '1.550', 'weapon3': '2.658', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '67.000'} [2024-08-06 04:28:20,314][52795] DAMAGECOUNT value on done: 484065.0 [2024-08-06 04:28:20,314][52795] Sum rewards: 71.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.220', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:20,828][52667] DAMAGECOUNT value on done: 523327.0 [2024-08-06 04:28:20,829][52667] Sum rewards: 72.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.199', 'weapon4': '0.254', 'weapon5': '0.274', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:21,292][52647] DAMAGECOUNT value on done: 551772.0 [2024-08-06 04:28:21,292][52647] Sum rewards: 61.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.174', 'weapon4': '0.178', 'AMMO3': '0.193', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.250', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:22,280][52820] DAMAGECOUNT value on done: 483054.0 [2024-08-06 04:28:22,280][52820] Sum rewards: 70.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.072', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.184', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:22,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17550.3). Total num frames: 440066048. Throughput: 0: 4395.1. Samples: 110019790. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 04:28:22,795][52567] Avg episode reward: [(0, '72.016')] [2024-08-06 04:28:23,192][52671] DAMAGECOUNT value on done: 527397.0 [2024-08-06 04:28:23,193][52671] Sum rewards: 74.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.776', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '62.000'} [2024-08-06 04:28:23,240][52669] DAMAGECOUNT value on done: 523782.0 [2024-08-06 04:28:23,240][52669] Sum rewards: 74.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:23,495][52795] DAMAGECOUNT value on done: 487402.0 [2024-08-06 04:28:23,495][52795] Sum rewards: 57.562, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.355', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.144', 'weapon2': '0.158', 'AMMO3': '0.172', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '3.462', 'DAMAGECOUNT': '13.650', 'FRAGCOUNT': '48.000'} [2024-08-06 04:28:23,511][52650] Updated weights for policy 0, policy_version 53721 (0.0035) [2024-08-06 04:28:23,884][52667] DAMAGECOUNT value on done: 533429.0 [2024-08-06 04:28:23,886][52667] Sum rewards: 76.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.202', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:24,114][52647] DAMAGECOUNT value on done: 552458.0 [2024-08-06 04:28:24,114][52647] Sum rewards: 64.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon5': '0.216', 'AMMO3': '0.228', 'weapon4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '2.796', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '54.000'} [2024-08-06 04:28:25,349][52820] DAMAGECOUNT value on done: 490919.0 [2024-08-06 04:28:25,353][52820] Sum rewards: 69.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.620', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.028', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.261', 'WEAPON3': '1.650', 'weapon3': '3.422', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '60.000'} [2024-08-06 04:28:25,711][52671] DAMAGECOUNT value on done: 527515.0 [2024-08-06 04:28:25,713][52671] Sum rewards: 69.658, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.520', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.130', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.326', 'AMMO3': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '2.100', 'weapon3': '3.166', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '64.000'} [2024-08-06 04:28:26,071][52669] DAMAGECOUNT value on done: 529407.0 [2024-08-06 04:28:26,072][52669] Sum rewards: 65.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.913', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.136', 'weapon4': '0.166', 'AMMO4': '0.197', 'weapon5': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.784', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '53.000'} [2024-08-06 04:28:27,319][52647] DAMAGECOUNT value on done: 549176.0 [2024-08-06 04:28:27,320][52647] Sum rewards: 80.466, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.898', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.118', 'AMMO4': '0.193', 'weapon5': '0.216', 'weapon2': '0.220', 'AMMO3': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.162', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '70.000'} [2024-08-06 04:28:27,777][52658] DAMAGECOUNT value on done: 523085.0 [2024-08-06 04:28:27,779][52658] Sum rewards: 69.441, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.280', 'WEAPON3': '1.650', 'weapon3': '3.436', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 440147968. Throughput: 0: 4387.1. Samples: 110045980. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 04:28:27,794][52567] Avg episode reward: [(0, '71.801')] [2024-08-06 04:28:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053729_440147968.pth... [2024-08-06 04:28:27,921][52668] DAMAGECOUNT value on done: 521404.0 [2024-08-06 04:28:27,922][52668] Sum rewards: 71.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.148', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.068', 'AMMO4': '0.110', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '0.950', 'weapon3': '3.150', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '56.000'} [2024-08-06 04:28:27,941][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053216_435945472.pth [2024-08-06 04:28:28,347][52671] DAMAGECOUNT value on done: 536988.0 [2024-08-06 04:28:28,348][52671] Sum rewards: 70.838, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.105', 'HEALTH': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:28,466][52820] DAMAGECOUNT value on done: 478780.0 [2024-08-06 04:28:28,471][52820] Sum rewards: 71.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.308', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.205', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:28,540][52650] Updated weights for policy 0, policy_version 53731 (0.0023) [2024-08-06 04:28:28,985][52669] DAMAGECOUNT value on done: 528042.0 [2024-08-06 04:28:28,985][52669] Sum rewards: 59.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.206', 'weapon5': '0.256', 'AMMO4': '0.269', 'weapon4': '0.332', 'weapon2': '0.400', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.690', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '49.000'} [2024-08-06 04:28:30,315][52647] DAMAGECOUNT value on done: 559494.0 [2024-08-06 04:28:30,316][52647] Sum rewards: 78.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.370', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.130', 'weapon5': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.292', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.076', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:30,322][52662] DAMAGECOUNT value on done: 528353.0 [2024-08-06 04:28:30,322][52662] Sum rewards: 64.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.174', 'AMMO4': '0.195', 'AMMO3': '0.223', 'weapon4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '53.000'} [2024-08-06 04:28:30,742][52658] DAMAGECOUNT value on done: 523410.0 [2024-08-06 04:28:30,747][52658] Sum rewards: 62.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.179', 'AMMO4': '0.219', 'weapon5': '0.232', 'weapon4': '0.302', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.792', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:30,844][52668] DAMAGECOUNT value on done: 526422.0 [2024-08-06 04:28:30,845][52668] Sum rewards: 67.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.904', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.116', 'AMMO4': '0.163', 'weapon5': '0.218', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '56.000'} [2024-08-06 04:28:31,562][52671] DAMAGECOUNT value on done: 527604.0 [2024-08-06 04:28:31,563][52671] Sum rewards: 81.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.360', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.170', 'AMMO3': '0.211', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.870', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '65.000'} [2024-08-06 04:28:31,564][52820] DAMAGECOUNT value on done: 487141.0 [2024-08-06 04:28:31,564][52820] Sum rewards: 93.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.032', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.150', 'weapon2': '0.158', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.456', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.564', 'FRAGCOUNT': '77.000'} [2024-08-06 04:28:31,793][52669] DAMAGECOUNT value on done: 515813.0 [2024-08-06 04:28:31,794][52669] Sum rewards: 71.981, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO2': '0.003', 'AMMO5': '0.012', 'AMMO4': '0.016', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'weapon5': '0.242', 'weapon2': '0.470', 'WEAPON3': '0.950', 'HITCOUNT': '3.120', 'weapon3': '3.142', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '56.000'} [2024-08-06 04:28:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 440238080. Throughput: 0: 4377.1. Samples: 110058810. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 04:28:32,795][52567] Avg episode reward: [(0, '72.093')] [2024-08-06 04:28:32,888][52647] DAMAGECOUNT value on done: 557452.0 [2024-08-06 04:28:32,888][52647] Sum rewards: 58.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.476', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '49.000'} [2024-08-06 04:28:33,153][52650] Updated weights for policy 0, policy_version 53741 (0.0013) [2024-08-06 04:28:33,404][52662] DAMAGECOUNT value on done: 527966.0 [2024-08-06 04:28:33,405][52662] Sum rewards: 69.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.482', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.155', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.468', 'WEAPON3': '0.900', 'weapon3': '3.006', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '57.000'} [2024-08-06 04:28:33,899][52668] DAMAGECOUNT value on done: 525452.0 [2024-08-06 04:28:33,900][52668] Sum rewards: 84.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.296', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.187', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.506', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:34,040][52669] DAMAGECOUNT value on done: 526591.0 [2024-08-06 04:28:34,041][52669] Sum rewards: 77.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.098', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:34,073][52658] DAMAGECOUNT value on done: 529523.0 [2024-08-06 04:28:34,073][52658] Sum rewards: 78.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.169', 'AMMO4': '0.246', 'weapon5': '0.252', 'weapon2': '0.320', 'weapon4': '0.490', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.486', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '66.000'} [2024-08-06 04:28:34,690][52820] DAMAGECOUNT value on done: 492637.0 [2024-08-06 04:28:34,691][52820] Sum rewards: 75.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.462', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.170', 'weapon5': '0.180', 'weapon4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.920', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:34,738][52671] DAMAGECOUNT value on done: 533170.0 [2024-08-06 04:28:34,740][52671] Sum rewards: 64.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.825', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.488', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '55.000'} [2024-08-06 04:28:35,453][52647] DAMAGECOUNT value on done: 556730.0 [2024-08-06 04:28:35,453][52647] Sum rewards: 61.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.591', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon4': '0.186', 'AMMO3': '0.187', 'weapon5': '0.246', 'weapon2': '0.272', 'AMMO4': '0.309', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.034', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:36,148][52662] DAMAGECOUNT value on done: 529363.0 [2024-08-06 04:28:36,148][52662] Sum rewards: 82.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.069', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon4': '0.104', 'AMMO4': '0.125', 'weapon2': '0.202', 'AMMO3': '0.205', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '67.000'} [2024-08-06 04:28:36,660][52658] DAMAGECOUNT value on done: 529018.0 [2024-08-06 04:28:36,662][52658] Sum rewards: 77.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.070', 'weapon4': '0.114', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:36,848][52669] DAMAGECOUNT value on done: 526845.0 [2024-08-06 04:28:36,849][52669] Sum rewards: 73.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO4': '0.202', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:37,035][52668] DAMAGECOUNT value on done: 525883.0 [2024-08-06 04:28:37,037][52668] Sum rewards: 68.682, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.335', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '54.000'} [2024-08-06 04:28:37,725][52650] Updated weights for policy 0, policy_version 53751 (0.0026) [2024-08-06 04:28:37,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 440328192. Throughput: 0: 4370.9. Samples: 110084940. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 04:28:37,795][52567] Avg episode reward: [(0, '72.359')] [2024-08-06 04:28:37,847][52671] DAMAGECOUNT value on done: 525744.0 [2024-08-06 04:28:37,848][52671] Sum rewards: 72.740, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.705', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.170', 'weapon4': '0.176', 'AMMO4': '0.177', 'weapon5': '0.228', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:37,868][52820] DAMAGECOUNT value on done: 487085.0 [2024-08-06 04:28:37,868][52820] Sum rewards: 83.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.961', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.228', 'weapon4': '0.246', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:38,146][52647] DAMAGECOUNT value on done: 552654.0 [2024-08-06 04:28:38,146][52647] Sum rewards: 77.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.097', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.144', 'weapon5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:38,847][52662] DAMAGECOUNT value on done: 517761.0 [2024-08-06 04:28:38,857][52662] Sum rewards: 68.455, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.804', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.147', 'AMMO4': '0.176', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.722', 'WEAPON3': '0.900', 'weapon3': '2.746', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '54.000'} [2024-08-06 04:28:39,302][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:28:39,513][52669] DAMAGECOUNT value on done: 543530.0 [2024-08-06 04:28:39,514][52669] Sum rewards: 68.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.174', 'weapon2': '0.210', 'weapon4': '0.220', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.150', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '57.000'} [2024-08-06 04:28:39,598][52658] DAMAGECOUNT value on done: 519288.0 [2024-08-06 04:28:39,598][52658] Sum rewards: 64.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.182', 'weapon2': '0.200', 'weapon4': '0.228', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '54.000'} [2024-08-06 04:28:40,162][52668] DAMAGECOUNT value on done: 515667.0 [2024-08-06 04:28:40,163][52668] Sum rewards: 63.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.990', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.078', 'weapon5': '0.140', 'AMMO4': '0.210', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.096', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '55.000'} [2024-08-06 04:28:40,764][52671] DAMAGECOUNT value on done: 521903.0 [2024-08-06 04:28:40,764][52671] Sum rewards: 71.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.752', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.320', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:40,915][52647] DAMAGECOUNT value on done: 545893.0 [2024-08-06 04:28:40,917][52647] Sum rewards: 84.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.418', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.072', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.245', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '71.000'} [2024-08-06 04:28:41,055][52820] DAMAGECOUNT value on done: 490797.0 [2024-08-06 04:28:41,056][52820] Sum rewards: 86.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.103', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.364', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '72.000'} [2024-08-06 04:28:41,885][52662] DAMAGECOUNT value on done: 529526.0 [2024-08-06 04:28:41,887][52662] Sum rewards: 68.438, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.426', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.170', 'AMMO4': '0.174', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:42,002][52669] DAMAGECOUNT value on done: 530548.0 [2024-08-06 04:28:42,003][52669] Sum rewards: 74.457, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.074', 'weapon5': '0.090', 'AMMO4': '0.111', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '3.134', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:42,522][52658] DAMAGECOUNT value on done: 520548.0 [2024-08-06 04:28:42,522][52658] Sum rewards: 73.600, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.834', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.128', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.084', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:42,588][52650] Updated weights for policy 0, policy_version 53761 (0.0017) [2024-08-06 04:28:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 440410112. Throughput: 0: 4364.9. Samples: 110111080. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:28:42,794][52567] Avg episode reward: [(0, '72.534')] [2024-08-06 04:28:43,279][52668] DAMAGECOUNT value on done: 530649.0 [2024-08-06 04:28:43,280][52668] Sum rewards: 80.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.386', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:43,472][52647] DAMAGECOUNT value on done: 554532.0 [2024-08-06 04:28:43,473][52647] Sum rewards: 73.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.208', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.112', 'AMMO4': '0.122', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '62.000'} [2024-08-06 04:28:43,839][52671] DAMAGECOUNT value on done: 528514.0 [2024-08-06 04:28:43,841][52671] Sum rewards: 85.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.184', 'AMMO3': '0.208', 'weapon5': '0.232', 'AMMO4': '0.252', 'weapon2': '0.292', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.781', 'FRAGCOUNT': '70.000'} [2024-08-06 04:28:44,388][52669] DAMAGECOUNT value on done: 528916.0 [2024-08-06 04:28:44,390][52669] Sum rewards: 77.574, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.249', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.141', 'weapon2': '0.776', 'WEAPON3': '0.850', 'weapon3': '3.148', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:44,402][52820] DAMAGECOUNT value on done: 486228.0 [2024-08-06 04:28:44,403][52820] Sum rewards: 71.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.164', 'weapon5': '0.168', 'AMMO3': '0.213', 'weapon2': '0.238', 'AMMO4': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:44,909][52662] DAMAGECOUNT value on done: 521714.0 [2024-08-06 04:28:44,910][52662] Sum rewards: 68.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.144', 'weapon2': '0.192', 'AMMO4': '0.220', 'AMMO3': '0.224', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '57.000'} [2024-08-06 04:28:45,380][52663] Large shaping reward 2.542 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon7', 0.002)] [2024-08-06 04:28:45,629][52658] DAMAGECOUNT value on done: 529204.0 [2024-08-06 04:28:45,630][52658] Sum rewards: 72.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.148', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.102', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.276', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 04:28:46,133][52668] DAMAGECOUNT value on done: 526949.0 [2024-08-06 04:28:46,133][52668] Sum rewards: 68.054, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.546', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.134', 'AMMO3': '0.183', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.100', 'HITCOUNT': '3.170', 'weapon3': '3.182', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '54.000'} [2024-08-06 04:28:46,422][52647] DAMAGECOUNT value on done: 550079.0 [2024-08-06 04:28:46,422][52647] Sum rewards: 79.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.414', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.124', 'weapon4': '0.132', 'AMMO4': '0.212', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '67.000'} [2024-08-06 04:28:46,719][52671] DAMAGECOUNT value on done: 528728.0 [2024-08-06 04:28:46,719][52671] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.090', 'AMMO4': '0.197', 'AMMO3': '0.210', 'HEALTH': '0.218', 'weapon2': '0.228', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.180', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:47,090][52650] Updated weights for policy 0, policy_version 53771 (0.0019) [2024-08-06 04:28:47,481][52669] DAMAGECOUNT value on done: 528780.0 [2024-08-06 04:28:47,481][52669] Sum rewards: 60.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.400', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.146', 'weapon5': '0.162', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.612', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '52.000'} [2024-08-06 04:28:47,556][52820] DAMAGECOUNT value on done: 488217.0 [2024-08-06 04:28:47,557][52820] Sum rewards: 75.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.912', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.080', 'weapon5': '0.162', 'AMMO4': '0.203', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.600', 'weapon3': '3.050', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '64.000'} [2024-08-06 04:28:47,788][52662] DAMAGECOUNT value on done: 528475.0 [2024-08-06 04:28:47,788][52662] Sum rewards: 71.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.515', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.156', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon4': '0.438', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '60.000'} [2024-08-06 04:28:47,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 440500224. Throughput: 0: 4364.9. Samples: 110124250. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:28:47,794][52567] Avg episode reward: [(0, '72.502')] [2024-08-06 04:28:48,401][52658] DAMAGECOUNT value on done: 520129.0 [2024-08-06 04:28:48,401][52658] Sum rewards: 62.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.288', 'weapon2': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:48,551][52668] DAMAGECOUNT value on done: 518428.0 [2024-08-06 04:28:48,553][52668] Sum rewards: 71.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.382', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.138', 'weapon4': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.682', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '60.000'} [2024-08-06 04:28:48,852][52647] DAMAGECOUNT value on done: 552608.0 [2024-08-06 04:28:48,852][52647] Sum rewards: 73.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.062', 'AMMO4': '0.114', 'AMMO3': '0.218', 'weapon5': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:49,727][52671] DAMAGECOUNT value on done: 525277.0 [2024-08-06 04:28:49,736][52671] Sum rewards: 63.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.985', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.153', 'AMMO3': '0.193', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 04:28:50,360][52669] DAMAGECOUNT value on done: 532973.0 [2024-08-06 04:28:50,361][52669] Sum rewards: 76.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.098', 'AMMO4': '0.118', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:50,704][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:28:50,716][52820] DAMAGECOUNT value on done: 495901.0 [2024-08-06 04:28:50,718][52820] Sum rewards: 87.160, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.275', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.056', 'AMMO4': '0.173', 'weapon5': '0.180', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'weapon3': '3.240', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '74.000'} [2024-08-06 04:28:50,971][52662] DAMAGECOUNT value on done: 532849.0 [2024-08-06 04:28:50,971][52662] Sum rewards: 49.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.898', 'AMMO5': '0.008', 'WEAPON1': '0.030', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO4': '0.173', 'weapon5': '0.180', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.108', 'DAMAGECOUNT': '14.016', 'FRAGCOUNT': '43.500'} [2024-08-06 04:28:51,284][52647] DAMAGECOUNT value on done: 543442.0 [2024-08-06 04:28:51,284][52647] Sum rewards: 61.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.056', 'AMMO4': '0.057', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.366', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '50.000'} [2024-08-06 04:28:51,511][52668] DAMAGECOUNT value on done: 521182.0 [2024-08-06 04:28:51,514][52668] Sum rewards: 73.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.265', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.224', 'AMMO3': '0.230', 'AMMO4': '0.253', 'weapon2': '0.272', 'weapon4': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '61.000'} [2024-08-06 04:28:51,593][52658] DAMAGECOUNT value on done: 535955.0 [2024-08-06 04:28:51,594][52658] Sum rewards: 76.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.519', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.072', 'AMMO4': '0.164', 'weapon5': '0.194', 'AMMO3': '0.215', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '64.000'} [2024-08-06 04:28:51,734][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:28:51,947][52650] Updated weights for policy 0, policy_version 53781 (0.0011) [2024-08-06 04:28:52,023][52664] DAMAGECOUNT value on done: 543044.0 [2024-08-06 04:28:52,023][52664] Sum rewards: 67.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.530', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.186', 'AMMO3': '0.189', 'weapon2': '0.200', 'weapon4': '0.200', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.164', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2024-08-06 04:28:52,777][52671] DAMAGECOUNT value on done: 535439.0 [2024-08-06 04:28:52,777][52671] Sum rewards: 58.818, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.740', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.144', 'weapon5': '0.214', 'AMMO3': '0.238', 'weapon2': '0.280', 'AMMO4': '0.317', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '49.000'} [2024-08-06 04:28:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 440590336. Throughput: 0: 4369.6. Samples: 110150550. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:28:52,794][52567] Avg episode reward: [(0, '72.337')] [2024-08-06 04:28:53,164][52660] DAMAGECOUNT value on done: 526130.0 [2024-08-06 04:28:53,166][52660] Sum rewards: 82.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.798', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.095', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '68.000'} [2024-08-06 04:28:53,793][52662] DAMAGECOUNT value on done: 525515.0 [2024-08-06 04:28:53,794][52662] Sum rewards: 75.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.112', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.042', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '62.000'} [2024-08-06 04:28:53,847][52820] DAMAGECOUNT value on done: 494076.0 [2024-08-06 04:28:53,847][52820] Sum rewards: 77.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.993', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.070', 'AMMO4': '0.161', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.128', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '66.000'} [2024-08-06 04:28:54,060][52647] DAMAGECOUNT value on done: 556989.0 [2024-08-06 04:28:54,061][52647] Sum rewards: 84.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.412', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.292', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '71.000'} [2024-08-06 04:28:54,177][52668] DAMAGECOUNT value on done: 529675.0 [2024-08-06 04:28:54,177][52668] Sum rewards: 79.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.012', 'AMMO4': '0.021', 'WEAPON5': '0.050', 'AMMO3': '0.230', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '65.000'} [2024-08-06 04:28:54,658][52658] DAMAGECOUNT value on done: 522401.0 [2024-08-06 04:28:54,658][52658] Sum rewards: 78.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.144', 'AMMO5': '0.027', 'AMMO2': '0.060', 'AMMO3': '0.177', 'weapon4': '0.238', 'weapon5': '0.256', 'AMMO4': '0.301', 'weapon2': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '64.000'} [2024-08-06 04:28:55,128][52664] DAMAGECOUNT value on done: 548679.0 [2024-08-06 04:28:55,129][52664] Sum rewards: 73.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.755', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.179', 'weapon4': '0.208', 'weapon5': '0.226', 'AMMO4': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '57.500'} [2024-08-06 04:28:55,420][52671] DAMAGECOUNT value on done: 528797.0 [2024-08-06 04:28:55,421][52671] Sum rewards: 65.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon4': '0.278', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '54.000'} [2024-08-06 04:28:56,025][52660] DAMAGECOUNT value on done: 514621.0 [2024-08-06 04:28:56,027][52660] Sum rewards: 73.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.846', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '62.000'} [2024-08-06 04:28:56,485][52650] Updated weights for policy 0, policy_version 53791 (0.0012) [2024-08-06 04:28:56,685][52662] DAMAGECOUNT value on done: 536201.0 [2024-08-06 04:28:56,685][52662] Sum rewards: 77.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.281', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.076', 'AMMO4': '0.136', 'weapon5': '0.174', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '63.000'} [2024-08-06 04:28:57,063][52647] DAMAGECOUNT value on done: 548830.0 [2024-08-06 04:28:57,064][52647] Sum rewards: 80.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.054', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '66.000'} [2024-08-06 04:28:57,081][52820] DAMAGECOUNT value on done: 482821.0 [2024-08-06 04:28:57,083][52820] Sum rewards: 78.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.174', 'weapon5': '0.186', 'AMMO4': '0.194', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '65.000'} [2024-08-06 04:28:57,211][52668] DAMAGECOUNT value on done: 523878.0 [2024-08-06 04:28:57,213][52668] Sum rewards: 78.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.916', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.088', 'weapon5': '0.148', 'AMMO3': '0.197', 'AMMO4': '0.270', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '66.000'} [2024-08-06 04:28:57,355][52658] DAMAGECOUNT value on done: 536104.0 [2024-08-06 04:28:57,356][52658] Sum rewards: 70.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.064', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon5': '0.142', 'weapon4': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 440672256. Throughput: 0: 4369.3. Samples: 110176810. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:28:57,794][52567] Avg episode reward: [(0, '72.675')] [2024-08-06 04:28:58,198][52664] DAMAGECOUNT value on done: 548807.0 [2024-08-06 04:28:58,200][52664] Sum rewards: 63.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.237', 'weapon4': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '52.000'} [2024-08-06 04:28:58,561][52671] DAMAGECOUNT value on done: 514443.0 [2024-08-06 04:28:58,562][52671] Sum rewards: 69.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.682', 'AMMO5': '0.029', 'AMMO2': '0.059', 'weapon4': '0.140', 'AMMO3': '0.180', 'weapon5': '0.218', 'AMMO4': '0.293', 'WEAPON4': '0.500', 'weapon2': '0.572', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.742', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '58.000'} [2024-08-06 04:28:59,202][52660] DAMAGECOUNT value on done: 527469.0 [2024-08-06 04:28:59,210][52660] Sum rewards: 67.660, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.720', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon4': '0.122', 'weapon5': '0.130', 'AMMO3': '0.289', 'weapon2': '0.296', 'AMMO4': '0.309', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.122', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '60.000'} [2024-08-06 04:28:59,540][52662] DAMAGECOUNT value on done: 522346.0 [2024-08-06 04:28:59,541][52662] Sum rewards: 68.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.136', 'weapon5': '0.156', 'AMMO4': '0.159', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 04:28:59,963][52647] DAMAGECOUNT value on done: 557552.0 [2024-08-06 04:28:59,964][52647] Sum rewards: 65.072, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.515', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.032', 'weapon4': '0.034', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.368', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '56.000'} [2024-08-06 04:29:00,041][52658] DAMAGECOUNT value on done: 518681.0 [2024-08-06 04:29:00,042][52658] Sum rewards: 71.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.384', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.168', 'weapon5': '0.186', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '56.000'} [2024-08-06 04:29:00,218][52668] DAMAGECOUNT value on done: 518081.0 [2024-08-06 04:29:00,219][52668] Sum rewards: 74.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.895', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.226', 'AMMO3': '0.283', 'WEAPON3': '1.800', 'weapon3': '3.468', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '65.000'} [2024-08-06 04:29:00,828][52664] DAMAGECOUNT value on done: 539936.0 [2024-08-06 04:29:00,829][52664] Sum rewards: 72.634, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.873', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.176', 'AMMO4': '0.194', 'weapon2': '0.202', 'AMMO3': '0.305', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.248', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:01,182][52650] Updated weights for policy 0, policy_version 53801 (0.0012) [2024-08-06 04:29:01,712][52671] DAMAGECOUNT value on done: 536342.0 [2024-08-06 04:29:01,713][52671] Sum rewards: 76.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.589', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.124', 'AMMO4': '0.144', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:02,047][52660] DAMAGECOUNT value on done: 532650.0 [2024-08-06 04:29:02,048][52660] Sum rewards: 69.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.474', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.160', 'weapon5': '0.208', 'AMMO3': '0.211', 'AMMO4': '0.297', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.714', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '57.000'} [2024-08-06 04:29:02,285][52665] DAMAGECOUNT value on done: 512761.0 [2024-08-06 04:29:02,285][52665] Sum rewards: 69.991, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.264', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.167', 'AMMO3': '0.173', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.490', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2024-08-06 04:29:02,456][52647] DAMAGECOUNT value on done: 551299.0 [2024-08-06 04:29:02,457][52647] Sum rewards: 73.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.086', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.202', 'weapon4': '0.220', 'AMMO3': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:02,762][52662] DAMAGECOUNT value on done: 526932.0 [2024-08-06 04:29:02,762][52662] Sum rewards: 69.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.556', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.090', 'weapon5': '0.168', 'AMMO4': '0.215', 'AMMO3': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:02,765][52658] DAMAGECOUNT value on done: 525619.0 [2024-08-06 04:29:02,766][52658] Sum rewards: 78.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.132', 'weapon4': '0.146', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 440762368. Throughput: 0: 4367.3. Samples: 110189870. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:29:02,794][52567] Avg episode reward: [(0, '72.287')] [2024-08-06 04:29:02,919][52659] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:29:03,087][52668] DAMAGECOUNT value on done: 511903.0 [2024-08-06 04:29:03,090][52668] Sum rewards: 77.080, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.389', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.216', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:03,439][52664] DAMAGECOUNT value on done: 545801.0 [2024-08-06 04:29:03,439][52664] Sum rewards: 66.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.013', 'AMMO2': '0.066', 'AMMO3': '0.173', 'weapon5': '0.214', 'weapon2': '0.282', 'AMMO4': '0.329', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '53.000'} [2024-08-06 04:29:04,370][52671] DAMAGECOUNT value on done: 531938.0 [2024-08-06 04:29:04,371][52671] Sum rewards: 72.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.167', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'weapon4': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:04,849][52660] DAMAGECOUNT value on done: 525685.0 [2024-08-06 04:29:04,850][52660] Sum rewards: 78.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.066', 'AMMO3': '0.185', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '64.000'} [2024-08-06 04:29:05,042][52647] DAMAGECOUNT value on done: 540771.0 [2024-08-06 04:29:05,044][52647] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'weapon2': '0.202', 'AMMO3': '0.306', 'WEAPON3': '1.800', 'weapon3': '3.446', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:05,258][52665] DAMAGECOUNT value on done: 528022.0 [2024-08-06 04:29:05,258][52665] Sum rewards: 64.014, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.587', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.267', 'weapon2': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '54.000'} [2024-08-06 04:29:05,878][52650] Updated weights for policy 0, policy_version 53811 (0.0012) [2024-08-06 04:29:05,886][52668] DAMAGECOUNT value on done: 513717.0 [2024-08-06 04:29:05,888][52668] Sum rewards: 65.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.981', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.102', 'weapon5': '0.126', 'AMMO3': '0.228', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.064', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '57.000'} [2024-08-06 04:29:05,981][52811] DAMAGECOUNT value on done: 500687.0 [2024-08-06 04:29:05,982][52811] Sum rewards: 74.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.696', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.082', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.500'} [2024-08-06 04:29:05,986][52658] DAMAGECOUNT value on done: 524274.0 [2024-08-06 04:29:05,986][52658] Sum rewards: 60.778, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.616', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.117', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.290', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '48.000'} [2024-08-06 04:29:06,035][52662] DAMAGECOUNT value on done: 523449.0 [2024-08-06 04:29:06,035][52662] Sum rewards: 73.122, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.139', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.132', 'AMMO4': '0.170', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.202', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:06,044][52664] DAMAGECOUNT value on done: 544847.0 [2024-08-06 04:29:06,044][52664] Sum rewards: 70.174, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.446', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.092', 'weapon4': '0.166', 'AMMO4': '0.199', 'AMMO3': '0.240', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:07,211][52671] DAMAGECOUNT value on done: 532652.0 [2024-08-06 04:29:07,213][52671] Sum rewards: 74.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'AMMO5': '0.009', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.082', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.430', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:07,388][52660] DAMAGECOUNT value on done: 522088.0 [2024-08-06 04:29:07,389][52660] Sum rewards: 70.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.124', 'weapon5': '0.178', 'weapon2': '0.206', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 440852480. Throughput: 0: 4363.6. Samples: 110216150. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:29:07,794][52567] Avg episode reward: [(0, '72.476')] [2024-08-06 04:29:07,796][52647] DAMAGECOUNT value on done: 550586.0 [2024-08-06 04:29:07,797][52647] Sum rewards: 82.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.485', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.414', 'WEAPON3': '1.650', 'weapon3': '3.344', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '69.000'} [2024-08-06 04:29:08,459][52665] DAMAGECOUNT value on done: 521428.0 [2024-08-06 04:29:08,459][52665] Sum rewards: 80.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.219', 'AMMO5': '0.005', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.281', 'weapon2': '0.290', 'WEAPON3': '1.600', 'weapon3': '3.460', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '68.000'} [2024-08-06 04:29:08,584][52668] DAMAGECOUNT value on done: 515306.0 [2024-08-06 04:29:08,584][52668] Sum rewards: 69.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.137', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '56.000'} [2024-08-06 04:29:08,717][52664] DAMAGECOUNT value on done: 542577.0 [2024-08-06 04:29:08,717][52664] Sum rewards: 73.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.030', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.181', 'weapon4': '0.182', 'AMMO4': '0.212', 'weapon5': '0.220', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:08,965][52811] DAMAGECOUNT value on done: 486771.0 [2024-08-06 04:29:08,965][52811] Sum rewards: 64.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.669', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.182', 'AMMO4': '0.211', 'weapon5': '0.220', 'AMMO3': '0.237', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '57.000'} [2024-08-06 04:29:08,972][52658] DAMAGECOUNT value on done: 524839.0 [2024-08-06 04:29:08,976][52658] Sum rewards: 82.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.874', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon2': '0.210', 'weapon5': '0.222', 'weapon4': '0.224', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.709', 'FRAGCOUNT': '68.000'} [2024-08-06 04:29:09,171][52662] DAMAGECOUNT value on done: 531693.0 [2024-08-06 04:29:09,171][52662] Sum rewards: 68.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:10,194][52660] DAMAGECOUNT value on done: 520050.0 [2024-08-06 04:29:10,196][52671] DAMAGECOUNT value on done: 527328.0 [2024-08-06 04:29:10,197][52671] Sum rewards: 74.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.120', 'AMMO4': '0.174', 'weapon4': '0.216', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:10,196][52660] Sum rewards: 65.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.716', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:10,221][52647] DAMAGECOUNT value on done: 544595.0 [2024-08-06 04:29:10,222][52647] Sum rewards: 66.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.412', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.076', 'AMMO3': '0.230', 'weapon5': '0.236', 'AMMO4': '0.253', 'weapon2': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.084', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:10,511][52650] Updated weights for policy 0, policy_version 53821 (0.0019) [2024-08-06 04:29:11,410][52664] DAMAGECOUNT value on done: 538122.0 [2024-08-06 04:29:11,416][52665] DAMAGECOUNT value on done: 518419.0 [2024-08-06 04:29:11,417][52664] Sum rewards: 63.571, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.336', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.204', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '51.000'} [2024-08-06 04:29:11,418][52665] Sum rewards: 70.395, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.945', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO4': '0.173', 'AMMO3': '0.261', 'weapon5': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:11,531][52668] DAMAGECOUNT value on done: 523378.0 [2024-08-06 04:29:11,531][52668] Sum rewards: 82.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.156', 'AMMO3': '0.202', 'weapon5': '0.224', 'AMMO4': '0.226', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '66.000'} [2024-08-06 04:29:11,874][52662] DAMAGECOUNT value on done: 526016.0 [2024-08-06 04:29:11,876][52662] Sum rewards: 72.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.114', 'weapon4': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'AMMO4': '0.257', 'weapon2': '0.328', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:11,924][52658] DAMAGECOUNT value on done: 515110.0 [2024-08-06 04:29:11,925][52658] Sum rewards: 68.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.829', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.034', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon2': '0.206', 'AMMO3': '0.207', 'WEAPON3': '1.350', 'HITCOUNT': '3.370', 'weapon3': '3.512', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:12,037][52811] DAMAGECOUNT value on done: 482985.0 [2024-08-06 04:29:12,038][52811] Sum rewards: 75.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.078', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:12,525][52671] DAMAGECOUNT value on done: 524654.0 [2024-08-06 04:29:12,526][52671] Sum rewards: 75.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.072', 'weapon5': '0.090', 'AMMO4': '0.160', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 440934400. Throughput: 0: 4367.1. Samples: 110242500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:12,794][52567] Avg episode reward: [(0, '72.631')] [2024-08-06 04:29:13,070][52647] DAMAGECOUNT value on done: 544765.0 [2024-08-06 04:29:13,070][52647] Sum rewards: 74.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.077', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.402', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:13,475][52660] DAMAGECOUNT value on done: 529971.0 [2024-08-06 04:29:13,476][52660] Sum rewards: 73.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.686', 'AMMO5': '0.024', 'AMMO2': '0.076', 'weapon4': '0.206', 'AMMO3': '0.229', 'weapon5': '0.374', 'AMMO4': '0.382', 'weapon2': '0.404', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.656', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:14,115][52665] DAMAGECOUNT value on done: 509041.0 [2024-08-06 04:29:14,116][52665] Sum rewards: 74.608, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.314', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.085', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '3.294', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:14,314][52664] DAMAGECOUNT value on done: 549174.0 [2024-08-06 04:29:14,314][52664] Sum rewards: 63.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO2': '0.012', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon4': '0.160', 'weapon2': '0.234', 'AMMO3': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.444', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:14,771][52662] DAMAGECOUNT value on done: 534781.0 [2024-08-06 04:29:14,772][52662] Sum rewards: 73.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.764', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.054', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:14,796][52668] DAMAGECOUNT value on done: 527879.0 [2024-08-06 04:29:14,797][52668] Sum rewards: 76.278, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.142', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO3': '0.163', 'AMMO4': '0.173', 'weapon5': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.000', 'weapon3': '2.586', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:15,000][52658] DAMAGECOUNT value on done: 531102.0 [2024-08-06 04:29:15,001][52658] Sum rewards: 70.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.138', 'weapon5': '0.182', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.450', 'weapon3': '2.790', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:15,179][52811] DAMAGECOUNT value on done: 487368.0 [2024-08-06 04:29:15,179][52811] Sum rewards: 74.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.864', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon5': '0.164', 'AMMO3': '0.217', 'AMMO4': '0.335', 'weapon4': '0.430', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.618', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:15,622][52650] Updated weights for policy 0, policy_version 53831 (0.0013) [2024-08-06 04:29:16,397][52660] DAMAGECOUNT value on done: 524114.0 [2024-08-06 04:29:16,397][52660] Sum rewards: 68.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO4': '0.183', 'weapon4': '0.190', 'AMMO3': '0.218', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '57.000'} [2024-08-06 04:29:16,625][52660] Large shaping reward 3.381 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.33, 110.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:29:17,277][52664] DAMAGECOUNT value on done: 541506.0 [2024-08-06 04:29:17,279][52664] Sum rewards: 75.739, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.965', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.090', 'weapon5': '0.142', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.270', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '65.000'} [2024-08-06 04:29:17,311][52665] DAMAGECOUNT value on done: 515098.0 [2024-08-06 04:29:17,312][52665] Sum rewards: 76.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.497', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.096', 'weapon5': '0.184', 'AMMO4': '0.201', 'AMMO3': '0.227', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:17,520][52662] DAMAGECOUNT value on done: 529397.0 [2024-08-06 04:29:17,521][52662] Sum rewards: 76.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.512', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '66.000'} [2024-08-06 04:29:17,527][52668] DAMAGECOUNT value on done: 524745.0 [2024-08-06 04:29:17,527][52668] Sum rewards: 71.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.275', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO4': '0.131', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 441024512. Throughput: 0: 4372.9. Samples: 110255590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:17,795][52567] Avg episode reward: [(0, '72.577')] [2024-08-06 04:29:17,822][52658] DAMAGECOUNT value on done: 524003.0 [2024-08-06 04:29:17,824][52658] Sum rewards: 60.669, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.112', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.844', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.491', 'FRAGCOUNT': '49.000'} [2024-08-06 04:29:18,044][52811] DAMAGECOUNT value on done: 493368.0 [2024-08-06 04:29:18,045][52811] Sum rewards: 79.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '65.000'} [2024-08-06 04:29:19,281][52660] DAMAGECOUNT value on done: 522830.0 [2024-08-06 04:29:19,283][52660] Sum rewards: 76.778, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.054', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'HEALTH': '0.242', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:19,671][52650] Updated weights for policy 0, policy_version 53841 (0.0021) [2024-08-06 04:29:19,827][52664] DAMAGECOUNT value on done: 550999.0 [2024-08-06 04:29:19,827][52664] Sum rewards: 73.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.176', 'weapon4': '0.184', 'AMMO3': '0.218', 'AMMO4': '0.231', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:20,160][52668] DAMAGECOUNT value on done: 527158.0 [2024-08-06 04:29:20,162][52668] Sum rewards: 68.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.124', 'AMMO4': '0.127', 'weapon5': '0.142', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:20,394][52658] DAMAGECOUNT value on done: 525257.0 [2024-08-06 04:29:20,394][52658] Sum rewards: 68.539, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.299', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.092', 'weapon5': '0.130', 'AMMO3': '0.153', 'AMMO4': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:20,501][52662] DAMAGECOUNT value on done: 520873.0 [2024-08-06 04:29:20,503][52662] Sum rewards: 68.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.006', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.072', 'weapon5': '0.136', 'AMMO4': '0.161', 'AMMO3': '0.167', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.050', 'weapon3': '3.174', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:20,621][52665] DAMAGECOUNT value on done: 519325.0 [2024-08-06 04:29:20,629][52665] Sum rewards: 63.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO4': '0.210', 'AMMO3': '0.222', 'weapon5': '0.240', 'weapon2': '0.344', 'weapon4': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '54.000'} [2024-08-06 04:29:21,110][52811] DAMAGECOUNT value on done: 497472.0 [2024-08-06 04:29:21,112][52811] Sum rewards: 66.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.700', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.196', 'weapon2': '0.228', 'AMMO4': '0.242', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon5': '0.372', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.632', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:22,096][52660] DAMAGECOUNT value on done: 530754.0 [2024-08-06 04:29:22,097][52660] Sum rewards: 87.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.925', 'AMMO2': '0.011', 'weapon4': '0.048', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.492', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.823', 'FRAGCOUNT': '73.000'} [2024-08-06 04:29:22,529][52664] DAMAGECOUNT value on done: 548467.0 [2024-08-06 04:29:22,529][52664] Sum rewards: 74.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.828', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO4': '0.160', 'AMMO3': '0.208', 'weapon4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 441114624. Throughput: 0: 4378.0. Samples: 110281950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:22,794][52567] Avg episode reward: [(0, '72.130')] [2024-08-06 04:29:23,135][52658] DAMAGECOUNT value on done: 529789.0 [2024-08-06 04:29:23,135][52658] Sum rewards: 56.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.090', 'AMMO3': '0.158', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.400', 'weapon2': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.778', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '47.000'} [2024-08-06 04:29:23,326][52668] DAMAGECOUNT value on done: 525939.0 [2024-08-06 04:29:23,328][52668] Sum rewards: 59.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.152', 'weapon4': '0.188', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '2.930', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '50.000'} [2024-08-06 04:29:23,416][52662] DAMAGECOUNT value on done: 526099.0 [2024-08-06 04:29:23,417][52662] Sum rewards: 68.090, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO3': '0.174', 'weapon2': '0.314', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.232', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:23,575][52665] DAMAGECOUNT value on done: 520346.0 [2024-08-06 04:29:23,576][52665] Sum rewards: 73.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.008', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.094', 'AMMO3': '0.202', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:24,035][52820] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:29:24,267][52811] DAMAGECOUNT value on done: 494460.0 [2024-08-06 04:29:24,267][52811] Sum rewards: 79.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.971', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.070', 'AMMO4': '0.125', 'weapon5': '0.136', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.100', 'weapon3': '3.306', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '64.000'} [2024-08-06 04:29:24,675][52650] Updated weights for policy 0, policy_version 53851 (0.0034) [2024-08-06 04:29:24,922][52803] DAMAGECOUNT value on done: 489560.0 [2024-08-06 04:29:24,924][52803] Sum rewards: 74.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.860', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.004', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.184', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:25,082][52664] DAMAGECOUNT value on done: 555413.0 [2024-08-06 04:29:25,084][52664] Sum rewards: 67.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.081', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.008', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:25,092][52668] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:29:25,275][52660] DAMAGECOUNT value on done: 517226.0 [2024-08-06 04:29:25,277][52660] Sum rewards: 65.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.285', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.209', 'AMMO4': '0.231', 'weapon2': '0.232', 'weapon5': '0.238', 'weapon4': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '55.000'} [2024-08-06 04:29:26,460][52662] DAMAGECOUNT value on done: 520882.0 [2024-08-06 04:29:26,462][52662] Sum rewards: 75.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'AMMO3': '0.210', 'weapon2': '0.242', 'WEAPON3': '1.350', 'HITCOUNT': '3.520', 'weapon3': '3.586', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:26,537][52665] DAMAGECOUNT value on done: 527136.0 [2024-08-06 04:29:26,538][52665] Sum rewards: 62.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.172', 'AMMO4': '0.206', 'AMMO3': '0.227', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.148', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '53.000'} [2024-08-06 04:29:26,916][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:29:27,419][52811] DAMAGECOUNT value on done: 490335.0 [2024-08-06 04:29:27,421][52811] Sum rewards: 80.912, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.258', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.320', 'ARMOR': '0.450', 'weapon4': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '65.000'} [2024-08-06 04:29:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 441196544. Throughput: 0: 4379.6. Samples: 110308160. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:27,794][52567] Avg episode reward: [(0, '72.007')] [2024-08-06 04:29:27,969][52664] DAMAGECOUNT value on done: 550272.0 [2024-08-06 04:29:27,970][52664] Sum rewards: 62.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.142', 'weapon4': '0.204', 'AMMO4': '0.217', 'AMMO3': '0.242', 'weapon2': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.150', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '52.000'} [2024-08-06 04:29:27,994][52803] DAMAGECOUNT value on done: 487928.0 [2024-08-06 04:29:27,994][52803] Sum rewards: 75.434, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.085', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO3': '0.141', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.698', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:28,373][52660] DAMAGECOUNT value on done: 521812.0 [2024-08-06 04:29:28,374][52660] Sum rewards: 65.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.013', 'ARMOR': '0.020', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.145', 'AMMO3': '0.184', 'weapon4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '54.000'} [2024-08-06 04:29:29,402][52650] Updated weights for policy 0, policy_version 53861 (0.0022) [2024-08-06 04:29:29,717][52665] DAMAGECOUNT value on done: 518194.0 [2024-08-06 04:29:29,719][52665] Sum rewards: 74.750, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.120', 'weapon5': '0.134', 'AMMO4': '0.191', 'AMMO3': '0.251', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:29,965][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:29:30,588][52811] DAMAGECOUNT value on done: 496551.0 [2024-08-06 04:29:30,588][52811] Sum rewards: 77.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.918', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.270', 'weapon4': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:30,718][52664] DAMAGECOUNT value on done: 552248.0 [2024-08-06 04:29:30,718][52664] Sum rewards: 81.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.748', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.074', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon5': '0.226', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '67.000'} [2024-08-06 04:29:31,137][52803] DAMAGECOUNT value on done: 494382.0 [2024-08-06 04:29:31,137][52803] Sum rewards: 69.271, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.165', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.170', 'AMMO4': '0.181', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:31,620][52660] DAMAGECOUNT value on done: 533473.0 [2024-08-06 04:29:31,621][52660] Sum rewards: 72.791, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.110', 'weapon5': '0.172', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:31,916][52794] DAMAGECOUNT value on done: 529195.0 [2024-08-06 04:29:31,918][52794] Sum rewards: 79.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.062', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '66.000'} [2024-08-06 04:29:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 441286656. Throughput: 0: 4378.2. Samples: 110321270. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:32,794][52567] Avg episode reward: [(0, '72.276')] [2024-08-06 04:29:32,916][52665] DAMAGECOUNT value on done: 528198.0 [2024-08-06 04:29:32,916][52665] Sum rewards: 82.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.072', 'AMMO4': '0.106', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '67.000'} [2024-08-06 04:29:33,249][52664] DAMAGECOUNT value on done: 545174.0 [2024-08-06 04:29:33,249][52664] Sum rewards: 68.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.188', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.088', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:33,794][52811] DAMAGECOUNT value on done: 491285.0 [2024-08-06 04:29:33,796][52811] Sum rewards: 78.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.524', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.195', 'weapon2': '0.252', 'WEAPON3': '1.150', 'weapon3': '3.562', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:33,999][52650] Updated weights for policy 0, policy_version 53871 (0.0027) [2024-08-06 04:29:34,162][52659] DAMAGECOUNT value on done: 529533.0 [2024-08-06 04:29:34,162][52659] Sum rewards: 66.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon4': '0.208', 'AMMO3': '0.246', 'weapon2': '0.338', 'weapon5': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '55.500'} [2024-08-06 04:29:34,302][52803] DAMAGECOUNT value on done: 495574.0 [2024-08-06 04:29:34,303][52803] Sum rewards: 76.137, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.009', 'AMMO2': '0.032', 'AMMO3': '0.126', 'weapon5': '0.158', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'HEALTH': '0.262', 'weapon4': '0.330', 'WEAPON3': '0.800', 'weapon3': '3.094', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '58.500'} [2024-08-06 04:29:34,726][52660] DAMAGECOUNT value on done: 539065.0 [2024-08-06 04:29:34,729][52794] DAMAGECOUNT value on done: 532447.0 [2024-08-06 04:29:34,729][52660] Sum rewards: 75.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.052', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.090', 'AMMO4': '0.182', 'AMMO3': '0.188', 'weapon5': '0.188', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:34,730][52794] Sum rewards: 75.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.145', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:35,715][52663] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2024-08-06 04:29:35,845][52664] DAMAGECOUNT value on done: 539838.0 [2024-08-06 04:29:35,845][52664] Sum rewards: 56.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.299', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.010', 'AMMO4': '0.037', 'weapon2': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.182', 'AMMO3': '0.192', 'WEAPON7': '0.200', 'weapon4': '0.754', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.766', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '48.000'} [2024-08-06 04:29:36,109][52665] DAMAGECOUNT value on done: 525190.0 [2024-08-06 04:29:36,110][52665] Sum rewards: 76.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.380', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.154', 'AMMO3': '0.244', 'weapon4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '64.000'} [2024-08-06 04:29:36,933][52811] DAMAGECOUNT value on done: 492245.0 [2024-08-06 04:29:36,934][52811] Sum rewards: 75.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:37,146][52659] DAMAGECOUNT value on done: 525212.0 [2024-08-06 04:29:37,147][52659] Sum rewards: 71.043, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.114', 'AMMO3': '0.231', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.500', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:37,379][52803] DAMAGECOUNT value on done: 492721.0 [2024-08-06 04:29:37,380][52803] Sum rewards: 72.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.201', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.205', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '3.420', 'weapon3': '3.512', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:37,646][52794] DAMAGECOUNT value on done: 530440.0 [2024-08-06 04:29:37,646][52794] Sum rewards: 69.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.285', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.136', 'weapon5': '0.154', 'AMMO4': '0.217', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '58.500'} [2024-08-06 04:29:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17522.5). Total num frames: 441376768. Throughput: 0: 4379.1. Samples: 110347610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:37,794][52567] Avg episode reward: [(0, '71.916')] [2024-08-06 04:29:38,001][52660] DAMAGECOUNT value on done: 521752.0 [2024-08-06 04:29:38,001][52660] Sum rewards: 76.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.652', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.080', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:38,179][52664] DAMAGECOUNT value on done: 546641.0 [2024-08-06 04:29:38,180][52664] Sum rewards: 77.675, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.556', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.164', 'AMMO4': '0.175', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '65.000'} [2024-08-06 04:29:38,855][52650] Updated weights for policy 0, policy_version 53881 (0.0014) [2024-08-06 04:29:39,249][52665] DAMAGECOUNT value on done: 520359.0 [2024-08-06 04:29:39,250][52665] Sum rewards: 66.912, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.680', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.740', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '56.000'} [2024-08-06 04:29:39,894][52659] DAMAGECOUNT value on done: 530405.0 [2024-08-06 04:29:39,894][52659] Sum rewards: 81.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.142', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '67.000'} [2024-08-06 04:29:40,112][52811] DAMAGECOUNT value on done: 501911.0 [2024-08-06 04:29:40,113][52811] Sum rewards: 75.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.904', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.088', 'AMMO4': '0.101', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.232', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:40,545][52803] DAMAGECOUNT value on done: 483017.0 [2024-08-06 04:29:40,547][52803] Sum rewards: 78.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.374', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.157', 'weapon2': '0.456', 'WEAPON3': '0.950', 'weapon3': '3.348', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:40,857][52794] DAMAGECOUNT value on done: 522934.0 [2024-08-06 04:29:40,866][52794] Sum rewards: 60.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.166', 'weapon2': '0.184', 'AMMO4': '0.195', 'AMMO3': '0.206', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.700', 'weapon3': '3.136', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '51.000'} [2024-08-06 04:29:40,878][52664] DAMAGECOUNT value on done: 544645.0 [2024-08-06 04:29:40,882][52664] Sum rewards: 71.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.868', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.062', 'AMMO4': '0.065', 'weapon5': '0.108', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.730', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:41,077][52660] DAMAGECOUNT value on done: 529068.0 [2024-08-06 04:29:41,077][52660] Sum rewards: 78.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.228', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.494', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '65.000'} [2024-08-06 04:29:41,775][52665] DAMAGECOUNT value on done: 520751.0 [2024-08-06 04:29:41,776][52665] Sum rewards: 75.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.019', 'weapon4': '0.038', 'AMMO4': '0.092', 'weapon5': '0.112', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.050', 'weapon3': '3.302', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:41,936][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:29:42,391][52614] Signal inference workers to stop experience collection... (9800 times) [2024-08-06 04:29:42,392][52614] Signal inference workers to resume experience collection... (9800 times) [2024-08-06 04:29:42,432][52650] InferenceWorker_p0-w0: stopping experience collection (9800 times) [2024-08-06 04:29:42,435][52650] InferenceWorker_p0-w0: resuming experience collection (9800 times) [2024-08-06 04:29:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 441466880. Throughput: 0: 4374.2. Samples: 110373650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:42,794][52567] Avg episode reward: [(0, '72.285')] [2024-08-06 04:29:43,027][52650] Updated weights for policy 0, policy_version 53891 (0.0013) [2024-08-06 04:29:43,053][52659] DAMAGECOUNT value on done: 526976.0 [2024-08-06 04:29:43,053][52659] Sum rewards: 78.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.411', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.152', 'weapon4': '0.194', 'AMMO4': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '66.000'} [2024-08-06 04:29:43,232][52811] DAMAGECOUNT value on done: 489861.0 [2024-08-06 04:29:43,234][52811] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.088', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.102', 'weapon4': '0.120', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:43,578][52660] DAMAGECOUNT value on done: 521917.0 [2024-08-06 04:29:43,580][52660] Sum rewards: 57.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.567', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.076', 'weapon5': '0.122', 'AMMO4': '0.133', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '2.988', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '48.000'} [2024-08-06 04:29:43,604][52803] DAMAGECOUNT value on done: 486401.0 [2024-08-06 04:29:43,605][52803] Sum rewards: 59.436, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.879', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.194', 'weapon4': '0.202', 'AMMO4': '0.278', 'AMMO3': '0.304', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.952', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2024-08-06 04:29:43,805][52794] DAMAGECOUNT value on done: 522920.0 [2024-08-06 04:29:43,806][52794] Sum rewards: 70.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.106', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.240', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.364', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:44,048][52664] DAMAGECOUNT value on done: 542774.0 [2024-08-06 04:29:44,049][52664] Sum rewards: 71.022, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.976', 'AMMO5': '0.003', 'AMMO2': '0.038', 'WEAPON5': '0.050', 'weapon5': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.190', 'weapon4': '0.190', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 04:29:44,374][52665] DAMAGECOUNT value on done: 517009.0 [2024-08-06 04:29:44,374][52665] Sum rewards: 79.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.028', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.272', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '68.000'} [2024-08-06 04:29:45,813][52659] DAMAGECOUNT value on done: 523335.0 [2024-08-06 04:29:45,813][52659] Sum rewards: 73.409, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.015', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.040', 'weapon4': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.227', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:46,140][52660] DAMAGECOUNT value on done: 524162.0 [2024-08-06 04:29:46,150][52660] Sum rewards: 71.874, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.772', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.196', 'weapon4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '0.950', 'weapon3': '3.068', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '57.000'} [2024-08-06 04:29:46,434][52811] DAMAGECOUNT value on done: 488499.0 [2024-08-06 04:29:46,435][52811] Sum rewards: 63.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.920', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.116', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '54.000'} [2024-08-06 04:29:46,764][52803] DAMAGECOUNT value on done: 484880.0 [2024-08-06 04:29:46,766][52803] Sum rewards: 68.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.830', 'AMMO5': '0.025', 'AMMO2': '0.082', 'weapon4': '0.146', 'AMMO3': '0.273', 'weapon5': '0.300', 'weapon2': '0.336', 'AMMO4': '0.410', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.700', 'weapon3': '2.830', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '58.500'} [2024-08-06 04:29:46,855][52794] DAMAGECOUNT value on done: 524298.0 [2024-08-06 04:29:46,857][52794] Sum rewards: 72.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.146', 'AMMO4': '0.174', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:47,561][52665] DAMAGECOUNT value on done: 515111.0 [2024-08-06 04:29:47,561][52665] Sum rewards: 69.505, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.824', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.078', 'weapon4': '0.092', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'weapon2': '0.406', 'WEAPON3': '1.650', 'weapon3': '3.116', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:47,648][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:29:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 441540608. Throughput: 0: 4373.3. Samples: 110386670. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:47,795][52567] Avg episode reward: [(0, '72.081')] [2024-08-06 04:29:48,155][52650] Updated weights for policy 0, policy_version 53901 (0.0013) [2024-08-06 04:29:48,349][52659] DAMAGECOUNT value on done: 524767.0 [2024-08-06 04:29:48,353][52659] Sum rewards: 74.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.544', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.138', 'AMMO3': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:48,846][52660] DAMAGECOUNT value on done: 515533.0 [2024-08-06 04:29:48,846][52660] Sum rewards: 70.363, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.969', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon2': '0.804', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '57.000'} [2024-08-06 04:29:49,522][52811] DAMAGECOUNT value on done: 492095.0 [2024-08-06 04:29:49,522][52811] Sum rewards: 84.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '69.000'} [2024-08-06 04:29:49,739][52803] DAMAGECOUNT value on done: 488564.0 [2024-08-06 04:29:49,740][52803] Sum rewards: 51.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.270', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.026', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.616', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '2.990', 'DAMAGECOUNT': '13.311', 'FRAGCOUNT': '44.000'} [2024-08-06 04:29:49,945][52794] DAMAGECOUNT value on done: 534313.0 [2024-08-06 04:29:49,945][52794] Sum rewards: 87.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'weapon4': '0.050', 'AMMO2': '0.052', 'weapon5': '0.128', 'AMMO3': '0.236', 'AMMO4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.414', 'FRAGCOUNT': '71.000'} [2024-08-06 04:29:50,456][52665] DAMAGECOUNT value on done: 518722.0 [2024-08-06 04:29:50,456][52665] Sum rewards: 73.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.645', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.104', 'weapon5': '0.126', 'AMMO4': '0.228', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '62.500'} [2024-08-06 04:29:50,830][52659] DAMAGECOUNT value on done: 526200.0 [2024-08-06 04:29:50,830][52659] Sum rewards: 71.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.050', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.276', 'weapon4': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:52,685][52811] DAMAGECOUNT value on done: 488416.0 [2024-08-06 04:29:52,685][52811] Sum rewards: 80.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.152', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.082', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.246', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '66.000'} [2024-08-06 04:29:52,716][52650] Updated weights for policy 0, policy_version 53911 (0.0012) [2024-08-06 04:29:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 441638912. Throughput: 0: 4370.4. Samples: 110412820. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:52,794][52567] Avg episode reward: [(0, '72.157')] [2024-08-06 04:29:52,908][52794] DAMAGECOUNT value on done: 520969.0 [2024-08-06 04:29:52,908][52803] DAMAGECOUNT value on done: 482091.0 [2024-08-06 04:29:52,911][52794] Sum rewards: 74.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.078', 'weapon5': '0.138', 'AMMO4': '0.165', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:52,913][52803] Sum rewards: 61.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.025', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.233', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '51.000'} [2024-08-06 04:29:53,113][52665] DAMAGECOUNT value on done: 516092.0 [2024-08-06 04:29:53,114][52665] Sum rewards: 78.573, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.699', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.158', 'AMMO3': '0.167', 'AMMO4': '0.207', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '63.000'} [2024-08-06 04:29:54,029][52659] DAMAGECOUNT value on done: 524263.0 [2024-08-06 04:29:54,030][52659] Sum rewards: 81.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.210', 'weapon2': '0.236', 'AMMO3': '0.242', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '69.000'} [2024-08-06 04:29:55,841][52665] DAMAGECOUNT value on done: 519817.0 [2024-08-06 04:29:55,842][52665] Sum rewards: 84.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.904', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.230', 'AMMO3': '0.249', 'WEAPON3': '1.600', 'weapon3': '3.462', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '70.000'} [2024-08-06 04:29:55,887][52811] DAMAGECOUNT value on done: 492772.0 [2024-08-06 04:29:55,888][52811] Sum rewards: 80.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.095', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '66.000'} [2024-08-06 04:29:56,049][52794] DAMAGECOUNT value on done: 530587.0 [2024-08-06 04:29:56,049][52794] Sum rewards: 84.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.465', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.276', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '70.000'} [2024-08-06 04:29:56,065][52803] DAMAGECOUNT value on done: 498755.0 [2024-08-06 04:29:56,066][52803] Sum rewards: 73.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.437', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon4': '0.166', 'weapon5': '0.222', 'AMMO3': '0.225', 'AMMO4': '0.319', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '61.000'} [2024-08-06 04:29:56,390][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:29:57,380][52659] DAMAGECOUNT value on done: 531520.0 [2024-08-06 04:29:57,381][52659] Sum rewards: 73.359, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.461', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.144', 'AMMO3': '0.158', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '58.000'} [2024-08-06 04:29:57,391][52650] Updated weights for policy 0, policy_version 53921 (0.0026) [2024-08-06 04:29:57,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 441729024. Throughput: 0: 4365.6. Samples: 110438950. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 04:29:57,794][52567] Avg episode reward: [(0, '72.610')] [2024-08-06 04:29:58,879][52665] DAMAGECOUNT value on done: 520425.0 [2024-08-06 04:29:58,881][52665] Sum rewards: 71.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.612', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '3.300', 'weapon3': '3.396', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:59,071][52811] DAMAGECOUNT value on done: 495582.0 [2024-08-06 04:29:59,072][52811] Sum rewards: 70.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'HITCOUNT': '3.290', 'weapon3': '3.426', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '60.000'} [2024-08-06 04:29:59,079][52794] DAMAGECOUNT value on done: 527600.0 [2024-08-06 04:29:59,081][52794] Sum rewards: 74.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '62.000'} [2024-08-06 04:29:59,243][52803] DAMAGECOUNT value on done: 492405.0 [2024-08-06 04:29:59,245][52803] Sum rewards: 68.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.076', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon4': '0.140', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '59.000'} [2024-08-06 04:29:59,858][52659] DAMAGECOUNT value on done: 534827.0 [2024-08-06 04:29:59,859][52659] Sum rewards: 65.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.164', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.206', 'weapon5': '0.208', 'weapon2': '0.282', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '55.000'} [2024-08-06 04:30:02,103][52794] DAMAGECOUNT value on done: 520458.0 [2024-08-06 04:30:02,103][52794] Sum rewards: 57.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.970', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.052', 'AMMO3': '0.195', 'weapon4': '0.196', 'AMMO4': '0.262', 'weapon5': '0.302', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.794', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '49.000'} [2024-08-06 04:30:02,333][52650] Updated weights for policy 0, policy_version 53931 (0.0047) [2024-08-06 04:30:02,337][52811] DAMAGECOUNT value on done: 488255.0 [2024-08-06 04:30:02,337][52811] Sum rewards: 68.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.156', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.382', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '58.000'} [2024-08-06 04:30:02,484][52803] DAMAGECOUNT value on done: 487057.0 [2024-08-06 04:30:02,486][52803] Sum rewards: 59.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.223', 'AMMO4': '0.230', 'weapon5': '0.234', 'weapon2': '0.354', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '50.000'} [2024-08-06 04:30:02,499][52659] DAMAGECOUNT value on done: 524594.0 [2024-08-06 04:30:02,500][52659] Sum rewards: 76.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.183', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.182', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'ARMOR': '0.400', 'weapon4': '0.552', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '61.000'} [2024-08-06 04:30:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 441810944. Throughput: 0: 4370.7. Samples: 110452270. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 04:30:02,794][52567] Avg episode reward: [(0, '72.182')] [2024-08-06 04:30:04,987][52794] DAMAGECOUNT value on done: 527026.0 [2024-08-06 04:30:04,987][52794] Sum rewards: 65.010, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.140', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'weapon4': '0.346', 'weapon2': '0.438', 'WEAPON3': '0.900', 'weapon3': '2.908', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '51.000'} [2024-08-06 04:30:05,165][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:30:05,293][52659] DAMAGECOUNT value on done: 529667.0 [2024-08-06 04:30:05,294][52659] Sum rewards: 72.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.142', 'weapon4': '0.176', 'AMMO3': '0.190', 'AMMO4': '0.239', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '62.000'} [2024-08-06 04:30:05,490][52811] DAMAGECOUNT value on done: 489590.0 [2024-08-06 04:30:05,492][52811] Sum rewards: 72.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.190', 'AMMO4': '0.194', 'AMMO3': '0.214', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '60.000'} [2024-08-06 04:30:05,633][52803] DAMAGECOUNT value on done: 496867.0 [2024-08-06 04:30:05,634][52803] Sum rewards: 79.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.951', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.149', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '63.500'} [2024-08-06 04:30:06,804][52650] Updated weights for policy 0, policy_version 53941 (0.0014) [2024-08-06 04:30:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 441892864. Throughput: 0: 4349.1. Samples: 110477660. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 04:30:07,794][52567] Avg episode reward: [(0, '72.183')] [2024-08-06 04:30:07,912][52794] DAMAGECOUNT value on done: 521735.0 [2024-08-06 04:30:07,912][52794] Sum rewards: 70.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.154', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.285', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '59.000'} [2024-08-06 04:30:08,610][52659] DAMAGECOUNT value on done: 520320.0 [2024-08-06 04:30:08,611][52659] Sum rewards: 63.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.121', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.570', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.016', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '53.000'} [2024-08-06 04:30:08,645][52803] DAMAGECOUNT value on done: 490018.0 [2024-08-06 04:30:08,647][52803] Sum rewards: 63.861, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.122', 'weapon5': '0.136', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '56.000'} [2024-08-06 04:30:10,007][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:30:11,043][52794] DAMAGECOUNT value on done: 540515.0 [2024-08-06 04:30:11,044][52794] Sum rewards: 82.644, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.425', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'weapon2': '0.386', 'WEAPON3': '0.900', 'weapon3': '3.528', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '64.000'} [2024-08-06 04:30:11,579][52659] DAMAGECOUNT value on done: 525820.0 [2024-08-06 04:30:11,579][52659] Sum rewards: 77.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.068', 'weapon5': '0.092', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '64.000'} [2024-08-06 04:30:11,686][52650] Updated weights for policy 0, policy_version 53951 (0.0016) [2024-08-06 04:30:11,811][52803] DAMAGECOUNT value on done: 488291.0 [2024-08-06 04:30:11,813][52803] Sum rewards: 77.003, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.945', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.182', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '3.328', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '63.000'} [2024-08-06 04:30:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 441982976. Throughput: 0: 4350.4. Samples: 110503930. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 04:30:12,794][52567] Avg episode reward: [(0, '72.112')] [2024-08-06 04:30:14,127][52794] DAMAGECOUNT value on done: 520466.0 [2024-08-06 04:30:14,129][52794] Sum rewards: 64.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.094', 'weapon4': '0.142', 'AMMO3': '0.191', 'AMMO4': '0.217', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.178', 'DAMAGECOUNT': '14.706', 'FRAGCOUNT': '56.000'} [2024-08-06 04:30:14,714][52659] DAMAGECOUNT value on done: 537121.0 [2024-08-06 04:30:14,715][52659] Sum rewards: 72.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.162', 'AMMO4': '0.193', 'weapon2': '0.218', 'weapon5': '0.234', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '61.000'} [2024-08-06 04:30:14,931][52803] DAMAGECOUNT value on done: 493787.0 [2024-08-06 04:30:14,932][52803] Sum rewards: 77.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '66.000'} [2024-08-06 04:30:16,222][52663] DAMAGECOUNT value on done: 534939.0 [2024-08-06 04:30:16,224][52663] Sum rewards: 75.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.724', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.236', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '63.000'} [2024-08-06 04:30:16,476][52650] Updated weights for policy 0, policy_version 53961 (0.0027) [2024-08-06 04:30:16,551][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:30:16,961][52794] DAMAGECOUNT value on done: 536697.0 [2024-08-06 04:30:16,962][52794] Sum rewards: 68.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.074', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '57.000'} [2024-08-06 04:30:17,601][52659] DAMAGECOUNT value on done: 528842.0 [2024-08-06 04:30:17,603][52659] Sum rewards: 67.091, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.025', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.056', 'weapon5': '0.132', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.286', 'weapon2': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.262', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '58.000'} [2024-08-06 04:30:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 442073088. Throughput: 0: 4353.6. Samples: 110517180. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 04:30:17,794][52567] Avg episode reward: [(0, '72.270')] [2024-08-06 04:30:18,055][52803] DAMAGECOUNT value on done: 493364.0 [2024-08-06 04:30:18,057][52803] Sum rewards: 64.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.076', 'AMMO3': '0.180', 'weapon5': '0.188', 'AMMO4': '0.230', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '51.000'} [2024-08-06 04:30:18,869][52663] DAMAGECOUNT value on done: 526615.0 [2024-08-06 04:30:18,870][52663] Sum rewards: 67.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.082', 'AMMO4': '0.091', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.000', 'HITCOUNT': '3.110', 'weapon3': '3.494', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '55.000'} [2024-08-06 04:30:20,147][52794] DAMAGECOUNT value on done: 527598.0 [2024-08-06 04:30:20,148][52794] Sum rewards: 72.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '61.000'} [2024-08-06 04:30:20,762][52650] Updated weights for policy 0, policy_version 53971 (0.0011) [2024-08-06 04:30:20,782][52659] DAMAGECOUNT value on done: 534314.0 [2024-08-06 04:30:20,783][52659] Sum rewards: 91.026, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.585', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.183', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.458', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.252', 'FRAGCOUNT': '74.000'} [2024-08-06 04:30:21,169][52803] DAMAGECOUNT value on done: 496211.0 [2024-08-06 04:30:21,171][52803] Sum rewards: 80.512, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'weapon4': '0.028', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.198', 'weapon2': '0.246', 'HEALTH': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.372', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '66.000'} [2024-08-06 04:30:21,596][52649] DAMAGECOUNT value on done: 511154.0 [2024-08-06 04:30:21,596][52649] Sum rewards: 70.154, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.044', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.148', 'weapon2': '0.180', 'weapon5': '0.238', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '59.000'} [2024-08-06 04:30:22,052][52663] DAMAGECOUNT value on done: 516860.0 [2024-08-06 04:30:22,053][52663] Sum rewards: 27.486, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.104', 'weapon2': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.542', 'WEAPON3': '0.650', 'HITCOUNT': '1.100', 'weapon3': '1.174', 'weapon4': '1.556', 'DAMAGECOUNT': '6.114', 'FRAGCOUNT': '21.000'} [2024-08-06 04:30:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 442155008. Throughput: 0: 4354.9. Samples: 110543580. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:30:22,794][52567] Avg episode reward: [(0, '72.012')] [2024-08-06 04:30:23,016][52794] DAMAGECOUNT value on done: 536155.0 [2024-08-06 04:30:23,018][52794] Sum rewards: 74.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.936', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon2': '0.164', 'weapon5': '0.170', 'AMMO3': '0.212', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '61.000'} [2024-08-06 04:30:23,919][52659] DAMAGECOUNT value on done: 527282.0 [2024-08-06 04:30:23,919][52659] Sum rewards: 74.487, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.092', 'weapon5': '0.124', 'AMMO4': '0.146', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.234', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '60.000'} [2024-08-06 04:30:24,413][52803] DAMAGECOUNT value on done: 486585.0 [2024-08-06 04:30:24,414][52803] Sum rewards: 63.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon2': '0.152', 'weapon5': '0.206', 'AMMO3': '0.243', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '54.000'} [2024-08-06 04:30:24,846][52649] DAMAGECOUNT value on done: 503971.0 [2024-08-06 04:30:24,846][52649] Sum rewards: 77.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.609', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.074', 'weapon4': '0.108', 'AMMO3': '0.208', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '66.000'} [2024-08-06 04:30:25,223][52663] DAMAGECOUNT value on done: 525017.0 [2024-08-06 04:30:25,225][52663] Sum rewards: 69.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.644', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.186', 'AMMO3': '0.189', 'AMMO4': '0.195', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '57.500'} [2024-08-06 04:30:25,708][52650] Updated weights for policy 0, policy_version 53981 (0.0014) [2024-08-06 04:30:26,181][52794] DAMAGECOUNT value on done: 535979.0 [2024-08-06 04:30:26,181][52794] Sum rewards: 63.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.635', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '55.000'} [2024-08-06 04:30:27,000][52659] DAMAGECOUNT value on done: 531089.0 [2024-08-06 04:30:27,002][52659] Sum rewards: 64.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.780', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.198', 'weapon2': '0.566', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.224', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '53.000'} [2024-08-06 04:30:27,244][52649] DAMAGECOUNT value on done: 518980.0 [2024-08-06 04:30:27,245][52649] Sum rewards: 66.011, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.920', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.082', 'weapon4': '0.086', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON3': '1.000', 'weapon2': '1.008', 'weapon3': '2.668', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '52.000'} [2024-08-06 04:30:27,583][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:30:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 442245120. Throughput: 0: 4361.3. Samples: 110569910. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:30:27,794][52567] Avg episode reward: [(0, '71.925')] [2024-08-06 04:30:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053985_442245120.pth... [2024-08-06 04:30:27,859][52663] DAMAGECOUNT value on done: 526534.0 [2024-08-06 04:30:27,861][52663] Sum rewards: 67.234, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.153', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '53.000'} [2024-08-06 04:30:27,946][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053472_438042624.pth [2024-08-06 04:30:28,505][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:30:28,974][52794] DAMAGECOUNT value on done: 523952.0 [2024-08-06 04:30:28,975][52794] Sum rewards: 64.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.006', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '54.000'} [2024-08-06 04:30:29,939][52659] DAMAGECOUNT value on done: 527683.0 [2024-08-06 04:30:29,940][52659] Sum rewards: 61.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.853', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.152', 'weapon2': '0.170', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.309', 'WEAPON3': '1.850', 'HITCOUNT': '3.050', 'weapon3': '3.328', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '55.000'} [2024-08-06 04:30:30,181][52649] DAMAGECOUNT value on done: 514862.0 [2024-08-06 04:30:30,182][52649] Sum rewards: 82.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.058', 'AMMO4': '0.127', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '66.000'} [2024-08-06 04:30:30,384][52650] Updated weights for policy 0, policy_version 53991 (0.0027) [2024-08-06 04:30:30,409][52660] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('HEALTH', 0.05, 10.0), ('weapon5', 0.002)] [2024-08-06 04:30:31,100][52663] DAMAGECOUNT value on done: 532898.0 [2024-08-06 04:30:31,102][52663] Sum rewards: 72.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.162', 'AMMO3': '0.204', 'AMMO4': '0.205', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.316', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '59.000'} [2024-08-06 04:30:31,485][52666] DAMAGECOUNT value on done: 525623.0 [2024-08-06 04:30:31,487][52666] Sum rewards: 61.824, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.570', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.130', 'AMMO3': '0.160', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.544', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '3.024', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '49.000'} [2024-08-06 04:30:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 442335232. Throughput: 0: 4358.5. Samples: 110582800. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:30:32,794][52567] Avg episode reward: [(0, '71.610')] [2024-08-06 04:30:33,359][52649] DAMAGECOUNT value on done: 504727.0 [2024-08-06 04:30:33,366][52649] Sum rewards: 80.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.735', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.142', 'weapon5': '0.164', 'AMMO4': '0.201', 'AMMO3': '0.224', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '68.000'} [2024-08-06 04:30:34,163][52670] DAMAGECOUNT value on done: 517310.0 [2024-08-06 04:30:34,165][52670] Sum rewards: 69.417, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.197', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '57.000'} [2024-08-06 04:30:34,374][52663] DAMAGECOUNT value on done: 528371.0 [2024-08-06 04:30:34,374][52663] Sum rewards: 81.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.141', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '68.000'} [2024-08-06 04:30:34,608][52666] DAMAGECOUNT value on done: 528770.0 [2024-08-06 04:30:34,610][52666] Sum rewards: 74.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.263', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.185', 'AMMO3': '0.202', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '60.000'} [2024-08-06 04:30:35,233][52650] Updated weights for policy 0, policy_version 54001 (0.0012) [2024-08-06 04:30:36,590][52649] DAMAGECOUNT value on done: 515738.0 [2024-08-06 04:30:36,592][52649] Sum rewards: 78.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.376', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.079', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.209', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.484', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '67.000'} [2024-08-06 04:30:37,252][52663] DAMAGECOUNT value on done: 522668.0 [2024-08-06 04:30:37,252][52663] Sum rewards: 70.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.052', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '59.000'} [2024-08-06 04:30:37,288][52670] DAMAGECOUNT value on done: 526994.0 [2024-08-06 04:30:37,290][52670] Sum rewards: 63.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.905', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.178', 'AMMO3': '0.203', 'AMMO4': '0.218', 'weapon5': '0.252', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '2.986', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '54.500'} [2024-08-06 04:30:37,391][52667] DAMAGECOUNT value on done: 529429.0 [2024-08-06 04:30:37,392][52667] Sum rewards: 83.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon2': '0.138', 'AMMO3': '0.229', 'WEAPON3': '1.500', 'weapon3': '3.712', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '69.000'} [2024-08-06 04:30:37,788][52666] DAMAGECOUNT value on done: 529395.0 [2024-08-06 04:30:37,788][52666] Sum rewards: 69.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.098', 'weapon4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 04:30:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 442417152. Throughput: 0: 4361.5. Samples: 110609090. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:30:37,794][52567] Avg episode reward: [(0, '71.611')] [2024-08-06 04:30:39,322][52670] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 04:30:39,486][52650] Updated weights for policy 0, policy_version 54011 (0.0021) [2024-08-06 04:30:39,597][52649] DAMAGECOUNT value on done: 512455.0 [2024-08-06 04:30:39,597][52649] Sum rewards: 81.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.046', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.418', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '67.000'} [2024-08-06 04:30:40,053][52670] DAMAGECOUNT value on done: 519819.0 [2024-08-06 04:30:40,055][52670] Sum rewards: 64.948, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.700', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.124', 'AMMO3': '0.142', 'WEAPON5': '0.250', 'AMMO4': '0.269', 'weapon2': '0.304', 'weapon4': '0.308', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'HITCOUNT': '3.020', 'weapon3': '3.048', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '52.000'} [2024-08-06 04:30:40,382][52663] DAMAGECOUNT value on done: 520780.0 [2024-08-06 04:30:40,385][52663] Sum rewards: 68.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.399', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.046', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '57.000'} [2024-08-06 04:30:40,410][52666] DAMAGECOUNT value on done: 527279.0 [2024-08-06 04:30:40,410][52666] Sum rewards: 63.778, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.202', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.524', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '52.000'} [2024-08-06 04:30:40,732][52667] DAMAGECOUNT value on done: 538454.0 [2024-08-06 04:30:40,734][52667] Sum rewards: 60.102, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.976', 'AMMO5': '0.012', 'AMMO2': '0.063', 'weapon5': '0.150', 'weapon4': '0.232', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'AMMO4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.032', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '53.000'} [2024-08-06 04:30:41,558][52820] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:30:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17522.6). Total num frames: 442507264. Throughput: 0: 4363.6. Samples: 110635310. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:30:42,794][52567] Avg episode reward: [(0, '71.480')] [2024-08-06 04:30:42,868][52649] DAMAGECOUNT value on done: 516213.0 [2024-08-06 04:30:42,868][52649] Sum rewards: 69.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.135', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.238', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '58.000'} [2024-08-06 04:30:42,893][52670] DAMAGECOUNT value on done: 519961.0 [2024-08-06 04:30:42,895][52670] Sum rewards: 74.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.040', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.254', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.352', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 04:30:43,307][52666] DAMAGECOUNT value on done: 526082.0 [2024-08-06 04:30:43,309][52666] Sum rewards: 79.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.012', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.032', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '63.000'} [2024-08-06 04:30:43,748][52663] DAMAGECOUNT value on done: 528196.0 [2024-08-06 04:30:43,749][52663] Sum rewards: 68.660, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.668', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.166', 'weapon5': '0.180', 'AMMO4': '0.204', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '2.774', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '59.000'} [2024-08-06 04:30:43,876][52667] DAMAGECOUNT value on done: 527147.0 [2024-08-06 04:30:43,878][52667] Sum rewards: 79.261, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.898', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.242', 'weapon2': '0.270', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '62.000'} [2024-08-06 04:30:44,445][52650] Updated weights for policy 0, policy_version 54021 (0.0016) [2024-08-06 04:30:45,626][52649] DAMAGECOUNT value on done: 517936.0 [2024-08-06 04:30:45,628][52649] Sum rewards: 79.635, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.454', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.158', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '64.000'} [2024-08-06 04:30:46,228][52667] DAMAGECOUNT value on done: 528810.0 [2024-08-06 04:30:46,230][52667] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.116', 'AMMO3': '0.201', 'AMMO4': '0.226', 'weapon4': '0.262', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '54.000'} [2024-08-06 04:30:46,259][52663] DAMAGECOUNT value on done: 535184.0 [2024-08-06 04:30:46,259][52663] Sum rewards: 67.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.114', 'weapon4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '56.000'} [2024-08-06 04:30:46,278][52670] DAMAGECOUNT value on done: 530917.0 [2024-08-06 04:30:46,278][52670] Sum rewards: 61.654, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.338', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO4': '0.222', 'weapon5': '0.238', 'AMMO3': '0.277', 'weapon2': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.668', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '53.500'} [2024-08-06 04:30:46,655][52666] DAMAGECOUNT value on done: 519995.0 [2024-08-06 04:30:46,656][52666] Sum rewards: 79.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.136', 'weapon2': '0.178', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.336', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '67.000'} [2024-08-06 04:30:46,854][52794] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:30:47,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.4, 300 sec: 17522.5). Total num frames: 442605568. Throughput: 0: 4360.2. Samples: 110648480. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:30:47,794][52567] Avg episode reward: [(0, '71.306')] [2024-08-06 04:30:48,704][52649] DAMAGECOUNT value on done: 511136.0 [2024-08-06 04:30:48,707][52649] Sum rewards: 73.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.107', 'AMMO5': '0.023', 'AMMO2': '0.046', 'weapon4': '0.108', 'AMMO3': '0.203', 'AMMO4': '0.229', 'weapon5': '0.316', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '58.000'} [2024-08-06 04:30:48,846][52667] DAMAGECOUNT value on done: 533584.0 [2024-08-06 04:30:48,848][52667] Sum rewards: 71.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.973', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.190', 'AMMO4': '0.199', 'weapon2': '0.208', 'AMMO3': '0.236', 'weapon5': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '59.000'} [2024-08-06 04:30:49,268][52663] DAMAGECOUNT value on done: 523700.0 [2024-08-06 04:30:49,269][52663] Sum rewards: 72.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.166', 'AMMO3': '0.177', 'weapon4': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '59.000'} [2024-08-06 04:30:49,313][52670] DAMAGECOUNT value on done: 525379.0 [2024-08-06 04:30:49,315][52670] Sum rewards: 62.622, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.480', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.190', 'AMMO4': '0.201', 'AMMO3': '0.292', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.140', 'weapon3': '3.164', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '55.000'} [2024-08-06 04:30:49,409][52650] Updated weights for policy 0, policy_version 54031 (0.0026) [2024-08-06 04:30:49,630][52666] DAMAGECOUNT value on done: 525195.0 [2024-08-06 04:30:49,631][52666] Sum rewards: 72.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.308', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 04:30:49,681][52795] DAMAGECOUNT value on done: 490360.0 [2024-08-06 04:30:49,682][52795] Sum rewards: 80.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.214', 'AMMO3': '0.243', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '68.000'} [2024-08-06 04:30:51,950][52667] DAMAGECOUNT value on done: 538183.0 [2024-08-06 04:30:51,951][52667] Sum rewards: 64.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.695', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO3': '0.238', 'AMMO4': '0.276', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 04:30:52,202][52649] DAMAGECOUNT value on done: 519611.0 [2024-08-06 04:30:52,202][52649] Sum rewards: 74.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.102', 'AMMO4': '0.153', 'weapon4': '0.166', 'AMMO3': '0.232', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '63.000'} [2024-08-06 04:30:52,238][52670] DAMAGECOUNT value on done: 514265.0 [2024-08-06 04:30:52,238][52670] Sum rewards: 64.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.954', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.098', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '54.000'} [2024-08-06 04:30:52,506][52666] DAMAGECOUNT value on done: 523152.0 [2024-08-06 04:30:52,506][52666] Sum rewards: 74.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.133', 'weapon5': '0.140', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.682', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '60.000'} [2024-08-06 04:30:52,707][52663] DAMAGECOUNT value on done: 520801.0 [2024-08-06 04:30:52,707][52663] Sum rewards: 68.770, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.555', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.142', 'weapon5': '0.182', 'AMMO3': '0.183', 'AMMO4': '0.205', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '55.000'} [2024-08-06 04:30:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 442679296. Throughput: 0: 4371.8. Samples: 110674390. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:30:52,794][52567] Avg episode reward: [(0, '71.469')] [2024-08-06 04:30:52,885][52795] DAMAGECOUNT value on done: 479724.0 [2024-08-06 04:30:52,885][52795] Sum rewards: 77.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.365', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.124', 'weapon2': '0.170', 'AMMO3': '0.179', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '62.000'} [2024-08-06 04:30:53,637][52650] Updated weights for policy 0, policy_version 54041 (0.0024) [2024-08-06 04:30:54,713][52670] DAMAGECOUNT value on done: 523403.0 [2024-08-06 04:30:54,713][52670] Sum rewards: 87.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.531', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.634', 'FRAGCOUNT': '70.000'} [2024-08-06 04:30:54,934][52649] DAMAGECOUNT value on done: 522845.0 [2024-08-06 04:30:54,935][52649] Sum rewards: 67.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.253', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.368', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '58.000'} [2024-08-06 04:30:55,069][52667] DAMAGECOUNT value on done: 530638.0 [2024-08-06 04:30:55,069][52667] Sum rewards: 84.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.034', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.179', 'weapon5': '0.184', 'weapon2': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '68.000'} [2024-08-06 04:30:55,165][52666] DAMAGECOUNT value on done: 524669.0 [2024-08-06 04:30:55,165][52666] Sum rewards: 74.785, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.806', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.248', 'weapon2': '0.474', 'WEAPON3': '1.600', 'weapon3': '3.076', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '64.000'} [2024-08-06 04:30:55,961][52663] DAMAGECOUNT value on done: 520021.0 [2024-08-06 04:30:55,963][52663] Sum rewards: 75.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.615', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.123', 'weapon5': '0.136', 'weapon2': '0.164', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.436', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '63.000'} [2024-08-06 04:30:56,003][52795] DAMAGECOUNT value on done: 480081.0 [2024-08-06 04:30:56,003][52795] Sum rewards: 68.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.072', 'AMMO4': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '57.000'} [2024-08-06 04:30:57,725][52649] DAMAGECOUNT value on done: 524599.0 [2024-08-06 04:30:57,727][52649] Sum rewards: 77.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.317', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.124', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.183', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '64.000'} [2024-08-06 04:30:57,736][52667] DAMAGECOUNT value on done: 524900.0 [2024-08-06 04:30:57,736][52667] Sum rewards: 51.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.168', 'AMMO5': '0.023', 'AMMO2': '0.036', 'weapon4': '0.132', 'weapon5': '0.174', 'AMMO4': '0.178', 'AMMO3': '0.183', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '2.942', 'DAMAGECOUNT': '13.692', 'FRAGCOUNT': '43.500'} [2024-08-06 04:30:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 442769408. Throughput: 0: 4372.0. Samples: 110700670. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:30:57,794][52567] Avg episode reward: [(0, '71.562')] [2024-08-06 04:30:57,806][52670] DAMAGECOUNT value on done: 518009.0 [2024-08-06 04:30:57,806][52670] Sum rewards: 61.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.372', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.032', 'AMMO4': '0.122', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '50.000'} [2024-08-06 04:30:58,287][52666] DAMAGECOUNT value on done: 518768.0 [2024-08-06 04:30:58,289][52666] Sum rewards: 72.217, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.932', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.192', 'AMMO4': '0.207', 'AMMO3': '0.256', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '63.000'} [2024-08-06 04:30:58,511][52650] Updated weights for policy 0, policy_version 54051 (0.0014) [2024-08-06 04:30:59,029][52663] DAMAGECOUNT value on done: 522397.0 [2024-08-06 04:30:59,030][52663] Sum rewards: 79.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.181', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.188', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '64.000'} [2024-08-06 04:30:59,100][52795] DAMAGECOUNT value on done: 486982.0 [2024-08-06 04:30:59,102][52795] Sum rewards: 66.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.196', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO4': '0.208', 'AMMO3': '0.220', 'weapon4': '0.230', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '55.000'} [2024-08-06 04:30:59,430][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:31:00,549][52667] DAMAGECOUNT value on done: 533864.0 [2024-08-06 04:31:00,551][52667] Sum rewards: 71.937, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.629', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.138', 'weapon5': '0.220', 'AMMO4': '0.226', 'AMMO3': '0.252', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:00,709][52670] DAMAGECOUNT value on done: 518081.0 [2024-08-06 04:31:00,709][52670] Sum rewards: 55.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.029', 'AMMO2': '0.077', 'weapon5': '0.138', 'AMMO3': '0.167', 'weapon2': '0.204', 'weapon4': '0.294', 'AMMO4': '0.387', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'HITCOUNT': '2.800', 'weapon3': '3.140', 'DAMAGECOUNT': '13.401', 'FRAGCOUNT': '49.000'} [2024-08-06 04:31:00,978][52649] DAMAGECOUNT value on done: 522698.0 [2024-08-06 04:31:00,982][52649] Sum rewards: 82.886, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.156', 'AMMO3': '0.165', 'AMMO4': '0.171', 'weapon5': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '65.000'} [2024-08-06 04:31:01,224][52666] DAMAGECOUNT value on done: 523842.0 [2024-08-06 04:31:01,224][52666] Sum rewards: 70.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.231', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:01,589][52663] DAMAGECOUNT value on done: 532733.0 [2024-08-06 04:31:01,590][52663] Sum rewards: 75.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.832', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.219', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:02,374][52795] DAMAGECOUNT value on done: 481633.0 [2024-08-06 04:31:02,374][52795] Sum rewards: 66.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.155', 'weapon4': '0.160', 'weapon2': '0.214', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '56.500'} [2024-08-06 04:31:02,449][52670] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 04:31:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 442859520. Throughput: 0: 4370.9. Samples: 110713870. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:31:02,794][52567] Avg episode reward: [(0, '70.871')] [2024-08-06 04:31:03,231][52650] Updated weights for policy 0, policy_version 54061 (0.0023) [2024-08-06 04:31:03,485][52667] DAMAGECOUNT value on done: 536586.0 [2024-08-06 04:31:03,485][52667] Sum rewards: 65.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.385', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'AMMO3': '0.210', 'weapon2': '0.628', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:03,507][52670] DAMAGECOUNT value on done: 526041.0 [2024-08-06 04:31:03,508][52670] Sum rewards: 81.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.322', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.118', 'weapon5': '0.138', 'AMMO3': '0.153', 'AMMO4': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '0.900', 'weapon3': '3.156', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:03,984][52666] DAMAGECOUNT value on done: 518239.0 [2024-08-06 04:31:03,985][52666] Sum rewards: 84.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'weapon5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.128', 'AMMO4': '0.129', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.316', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '69.000'} [2024-08-06 04:31:04,119][52649] DAMAGECOUNT value on done: 509039.0 [2024-08-06 04:31:04,119][52649] Sum rewards: 64.936, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.932', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.070', 'weapon5': '0.176', 'AMMO4': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:04,257][52663] DAMAGECOUNT value on done: 520115.0 [2024-08-06 04:31:04,258][52663] Sum rewards: 66.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.160', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.144', 'AMMO3': '0.157', 'weapon4': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:05,495][52795] DAMAGECOUNT value on done: 490063.0 [2024-08-06 04:31:05,496][52795] Sum rewards: 64.749, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.705', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.210', 'weapon4': '0.390', 'WEAPON3': '0.950', 'weapon3': '3.034', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '51.000'} [2024-08-06 04:31:06,286][52670] DAMAGECOUNT value on done: 516374.0 [2024-08-06 04:31:06,295][52670] Sum rewards: 80.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '66.000'} [2024-08-06 04:31:06,314][52669] DAMAGECOUNT value on done: 531895.0 [2024-08-06 04:31:06,315][52669] Sum rewards: 78.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.664', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.092', 'AMMO4': '0.109', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:06,385][52667] DAMAGECOUNT value on done: 524343.0 [2024-08-06 04:31:06,388][52667] Sum rewards: 62.674, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.400', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.074', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.660', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '2.978', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:06,665][52666] DAMAGECOUNT value on done: 532012.0 [2024-08-06 04:31:06,665][52666] Sum rewards: 71.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.315', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.128', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '58.000'} [2024-08-06 04:31:06,852][52663] DAMAGECOUNT value on done: 531697.0 [2024-08-06 04:31:06,853][52663] Sum rewards: 75.169, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.078', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.146', 'weapon5': '0.184', 'AMMO4': '0.209', 'weapon4': '0.236', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.976', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:07,193][52649] DAMAGECOUNT value on done: 517881.0 [2024-08-06 04:31:07,196][52649] Sum rewards: 62.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.724', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.162', 'AMMO4': '0.172', 'weapon5': '0.244', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '2.866', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 442941440. Throughput: 0: 4366.2. Samples: 110740060. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:31:07,794][52567] Avg episode reward: [(0, '71.222')] [2024-08-06 04:31:07,879][52650] Updated weights for policy 0, policy_version 54071 (0.0011) [2024-08-06 04:31:08,655][52795] DAMAGECOUNT value on done: 495069.0 [2024-08-06 04:31:08,655][52795] Sum rewards: 66.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.092', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '56.000'} [2024-08-06 04:31:08,806][52670] DAMAGECOUNT value on done: 521081.0 [2024-08-06 04:31:08,806][52670] Sum rewards: 71.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.808', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.174', 'AMMO4': '0.204', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:09,168][52667] DAMAGECOUNT value on done: 526981.0 [2024-08-06 04:31:09,168][52667] Sum rewards: 81.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.142', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'weapon3': '3.340', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '66.000'} [2024-08-06 04:31:09,195][52666] DAMAGECOUNT value on done: 525327.0 [2024-08-06 04:31:09,197][52666] Sum rewards: 72.026, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.284', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.080', 'weapon5': '0.134', 'AMMO4': '0.203', 'weapon2': '0.274', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.188', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:09,213][52664] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.561, 187.0)] [2024-08-06 04:31:09,425][52669] DAMAGECOUNT value on done: 522353.0 [2024-08-06 04:31:09,428][52669] Sum rewards: 66.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.437', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.106', 'weapon4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.210', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '58.000'} [2024-08-06 04:31:09,903][52663] DAMAGECOUNT value on done: 529730.0 [2024-08-06 04:31:09,904][52663] Sum rewards: 63.545, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.712', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.118', 'weapon5': '0.132', 'AMMO4': '0.140', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:10,156][52649] DAMAGECOUNT value on done: 506409.0 [2024-08-06 04:31:10,157][52649] Sum rewards: 65.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.042', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.132', 'AMMO3': '0.189', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:11,681][52670] DAMAGECOUNT value on done: 530625.0 [2024-08-06 04:31:11,683][52670] Sum rewards: 89.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.035', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.498', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.838', 'FRAGCOUNT': '74.000'} [2024-08-06 04:31:11,848][52795] DAMAGECOUNT value on done: 492168.0 [2024-08-06 04:31:11,848][52795] Sum rewards: 64.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.664', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.113', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '52.000'} [2024-08-06 04:31:11,920][52667] DAMAGECOUNT value on done: 534362.0 [2024-08-06 04:31:11,920][52667] Sum rewards: 69.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.220', 'weapon2': '0.222', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.394', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '60.000'} [2024-08-06 04:31:12,079][52666] DAMAGECOUNT value on done: 525897.0 [2024-08-06 04:31:12,079][52666] Sum rewards: 91.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.927', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.078', 'AMMO4': '0.128', 'weapon5': '0.160', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '75.000'} [2024-08-06 04:31:12,465][52669] DAMAGECOUNT value on done: 534812.0 [2024-08-06 04:31:12,465][52669] Sum rewards: 74.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.740', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.185', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 443023360. Throughput: 0: 4362.9. Samples: 110766240. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:31:12,795][52567] Avg episode reward: [(0, '71.264')] [2024-08-06 04:31:12,857][52650] Updated weights for policy 0, policy_version 54081 (0.0025) [2024-08-06 04:31:12,951][52663] DAMAGECOUNT value on done: 523698.0 [2024-08-06 04:31:12,953][52663] Sum rewards: 63.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.202', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.200', 'weapon4': '0.202', 'AMMO4': '0.224', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:13,237][52649] DAMAGECOUNT value on done: 522138.0 [2024-08-06 04:31:13,237][52649] Sum rewards: 78.336, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.268', 'weapon2': '0.478', 'WEAPON3': '1.650', 'weapon3': '3.224', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '68.000'} [2024-08-06 04:31:14,530][52670] DAMAGECOUNT value on done: 526024.0 [2024-08-06 04:31:14,531][52670] Sum rewards: 68.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.214', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '55.500'} [2024-08-06 04:31:14,756][52667] DAMAGECOUNT value on done: 525173.0 [2024-08-06 04:31:14,758][52667] Sum rewards: 76.323, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon2': '0.192', 'weapon4': '0.216', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:14,833][52666] DAMAGECOUNT value on done: 524502.0 [2024-08-06 04:31:14,834][52666] Sum rewards: 68.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.636', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.112', 'weapon4': '0.118', 'AMMO3': '0.229', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '58.000'} [2024-08-06 04:31:14,939][52795] DAMAGECOUNT value on done: 483274.0 [2024-08-06 04:31:14,939][52795] Sum rewards: 76.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.746', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon4': '0.168', 'weapon5': '0.230', 'AMMO3': '0.257', 'weapon2': '0.268', 'AMMO4': '0.337', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '64.500'} [2024-08-06 04:31:15,470][52669] DAMAGECOUNT value on done: 530998.0 [2024-08-06 04:31:15,471][52669] Sum rewards: 65.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.431', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.098', 'AMMO4': '0.118', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:16,358][52649] DAMAGECOUNT value on done: 520595.0 [2024-08-06 04:31:16,359][52649] Sum rewards: 59.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.784', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon4': '0.274', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '50.000'} [2024-08-06 04:31:16,944][52650] Updated weights for policy 0, policy_version 54091 (0.0029) [2024-08-06 04:31:17,450][52670] DAMAGECOUNT value on done: 508861.0 [2024-08-06 04:31:17,451][52670] Sum rewards: 59.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.178', 'weapon2': '0.188', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.018', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '50.000'} [2024-08-06 04:31:17,527][52667] DAMAGECOUNT value on done: 534439.0 [2024-08-06 04:31:17,529][52667] Sum rewards: 82.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.142', 'weapon5': '0.174', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.535', 'FRAGCOUNT': '69.000'} [2024-08-06 04:31:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 443121664. Throughput: 0: 4366.2. Samples: 110779280. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:31:17,795][52567] Avg episode reward: [(0, '71.338')] [2024-08-06 04:31:17,922][52666] DAMAGECOUNT value on done: 527807.0 [2024-08-06 04:31:17,925][52666] Sum rewards: 91.790, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.566', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.158', 'AMMO4': '0.161', 'AMMO3': '0.174', 'weapon5': '0.178', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '21.669', 'FRAGCOUNT': '72.000'} [2024-08-06 04:31:18,021][52795] DAMAGECOUNT value on done: 493619.0 [2024-08-06 04:31:18,023][52795] Sum rewards: 73.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.108', 'AMMO3': '0.192', 'weapon5': '0.246', 'AMMO4': '0.252', 'weapon2': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '60.000'} [2024-08-06 04:31:18,256][52669] DAMAGECOUNT value on done: 529561.0 [2024-08-06 04:31:18,258][52669] Sum rewards: 72.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.101', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon4': '0.172', 'weapon2': '0.184', 'AMMO3': '0.283', 'WEAPON3': '1.850', 'weapon3': '3.442', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:19,208][52649] DAMAGECOUNT value on done: 515747.0 [2024-08-06 04:31:19,209][52649] Sum rewards: 75.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.872', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon4': '0.182', 'weapon5': '0.184', 'AMMO3': '0.202', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '63.000'} [2024-08-06 04:31:19,676][52647] DAMAGECOUNT value on done: 558116.0 [2024-08-06 04:31:19,677][52647] Sum rewards: 75.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.540', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.142', 'AMMO4': '0.180', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '61.000'} [2024-08-06 04:31:20,441][52667] DAMAGECOUNT value on done: 537696.0 [2024-08-06 04:31:20,441][52667] Sum rewards: 64.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.136', 'AMMO4': '0.147', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:20,574][52670] DAMAGECOUNT value on done: 521562.0 [2024-08-06 04:31:20,576][52670] Sum rewards: 58.111, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.550', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.132', 'weapon4': '0.156', 'AMMO4': '0.197', 'weapon2': '0.234', 'AMMO3': '0.301', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.850', 'HITCOUNT': '2.870', 'weapon3': '3.172', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:20,975][52666] DAMAGECOUNT value on done: 528445.0 [2024-08-06 04:31:20,977][52666] Sum rewards: 69.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.467', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.088', 'weapon5': '0.186', 'AMMO4': '0.192', 'AMMO3': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '3.016', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '61.000'} [2024-08-06 04:31:21,149][52795] DAMAGECOUNT value on done: 489250.0 [2024-08-06 04:31:21,150][52795] Sum rewards: 91.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.234', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.364', 'HITCOUNT': '4.370', 'DAMAGECOUNT': '21.777', 'FRAGCOUNT': '75.000'} [2024-08-06 04:31:21,361][52669] DAMAGECOUNT value on done: 532472.0 [2024-08-06 04:31:21,364][52669] Sum rewards: 71.324, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.610', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.146', 'AMMO4': '0.204', 'weapon5': '0.226', 'AMMO3': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.918', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:21,869][52820] DAMAGECOUNT value on done: 489621.0 [2024-08-06 04:31:21,870][52820] Sum rewards: 70.153, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.383', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.032', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.204', 'AMMO3': '0.209', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '56.500'} [2024-08-06 04:31:22,146][52650] Updated weights for policy 0, policy_version 54101 (0.0011) [2024-08-06 04:31:22,568][52647] DAMAGECOUNT value on done: 558487.0 [2024-08-06 04:31:22,568][52647] Sum rewards: 70.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.594', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.052', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:22,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 443211776. Throughput: 0: 4369.8. Samples: 110805730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 04:31:22,794][52567] Avg episode reward: [(0, '72.026')] [2024-08-06 04:31:22,815][52614] Signal inference workers to stop experience collection... (9850 times) [2024-08-06 04:31:22,822][52614] Signal inference workers to resume experience collection... (9850 times) [2024-08-06 04:31:22,868][52650] InferenceWorker_p0-w0: stopping experience collection (9850 times) [2024-08-06 04:31:22,885][52650] InferenceWorker_p0-w0: resuming experience collection (9850 times) [2024-08-06 04:31:23,366][52667] DAMAGECOUNT value on done: 538809.0 [2024-08-06 04:31:23,367][52667] Sum rewards: 64.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.415', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.150', 'weapon2': '0.162', 'AMMO3': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.280', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:23,716][52670] DAMAGECOUNT value on done: 530548.0 [2024-08-06 04:31:23,717][52670] Sum rewards: 81.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.036', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '68.000'} [2024-08-06 04:31:24,105][52666] DAMAGECOUNT value on done: 511739.0 [2024-08-06 04:31:24,106][52666] Sum rewards: 60.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.608', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO4': '0.194', 'weapon5': '0.208', 'AMMO3': '0.224', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.204', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '50.000'} [2024-08-06 04:31:24,196][52669] DAMAGECOUNT value on done: 532491.0 [2024-08-06 04:31:24,197][52669] Sum rewards: 67.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.251', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.126', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:24,252][52795] DAMAGECOUNT value on done: 484225.0 [2024-08-06 04:31:24,253][52795] Sum rewards: 63.485, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.540', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.106', 'AMMO4': '0.200', 'weapon5': '0.258', 'AMMO3': '0.260', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.014', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:25,030][52820] DAMAGECOUNT value on done: 489665.0 [2024-08-06 04:31:25,031][52820] Sum rewards: 69.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.122', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:25,785][52647] DAMAGECOUNT value on done: 555330.0 [2024-08-06 04:31:25,786][52647] Sum rewards: 73.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.800', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.176', 'AMMO3': '0.217', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '61.000'} [2024-08-06 04:31:25,858][52667] DAMAGECOUNT value on done: 536242.0 [2024-08-06 04:31:25,858][52667] Sum rewards: 86.093, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.126', 'AMMO4': '0.130', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.326', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '69.000'} [2024-08-06 04:31:26,474][52670] DAMAGECOUNT value on done: 519539.0 [2024-08-06 04:31:26,474][52670] Sum rewards: 65.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.144', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.078', 'AMMO4': '0.188', 'weapon5': '0.188', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:26,725][52666] DAMAGECOUNT value on done: 521898.0 [2024-08-06 04:31:26,726][52666] Sum rewards: 62.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.559', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.128', 'weapon5': '0.142', 'AMMO3': '0.189', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '51.000'} [2024-08-06 04:31:26,928][52650] Updated weights for policy 0, policy_version 54111 (0.0030) [2024-08-06 04:31:27,132][52669] DAMAGECOUNT value on done: 529907.0 [2024-08-06 04:31:27,134][52669] Sum rewards: 77.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon5': '0.038', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.488', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '66.000'} [2024-08-06 04:31:27,443][52795] DAMAGECOUNT value on done: 482279.0 [2024-08-06 04:31:27,445][52795] Sum rewards: 66.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.243', 'weapon4': '0.288', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.790', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '58.000'} [2024-08-06 04:31:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 443293696. Throughput: 0: 4367.1. Samples: 110831830. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 04:31:27,794][52567] Avg episode reward: [(0, '71.589')] [2024-08-06 04:31:27,915][52803] Large shaping reward 2.536 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0)] [2024-08-06 04:31:28,223][52820] DAMAGECOUNT value on done: 492109.0 [2024-08-06 04:31:28,223][52820] Sum rewards: 72.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.284', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.129', 'weapon5': '0.168', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:28,262][52671] DAMAGECOUNT value on done: 535651.0 [2024-08-06 04:31:28,262][52671] Sum rewards: 64.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.329', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.136', 'AMMO3': '0.203', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:28,614][52647] DAMAGECOUNT value on done: 564547.0 [2024-08-06 04:31:28,614][52647] Sum rewards: 62.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.172', 'AMMO4': '0.199', 'weapon4': '0.202', 'AMMO3': '0.281', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.046', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:28,861][52667] DAMAGECOUNT value on done: 529615.0 [2024-08-06 04:31:28,862][52667] Sum rewards: 76.530, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.221', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.156', 'weapon5': '0.182', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.016', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '66.000'} [2024-08-06 04:31:29,590][52670] DAMAGECOUNT value on done: 525597.0 [2024-08-06 04:31:29,591][52670] Sum rewards: 64.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.118', 'weapon5': '0.180', 'AMMO3': '0.211', 'AMMO4': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:29,857][52669] DAMAGECOUNT value on done: 539558.0 [2024-08-06 04:31:29,859][52669] Sum rewards: 83.675, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.465', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.100', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '71.000'} [2024-08-06 04:31:30,518][52795] DAMAGECOUNT value on done: 489963.0 [2024-08-06 04:31:30,518][52795] Sum rewards: 71.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.134', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.168', 'AMMO3': '0.248', 'weapon5': '0.262', 'AMMO4': '0.282', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '60.000'} [2024-08-06 04:31:31,010][52671] DAMAGECOUNT value on done: 533029.0 [2024-08-06 04:31:31,011][52671] Sum rewards: 70.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.108', 'AMMO4': '0.166', 'AMMO3': '0.188', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:31,215][52650] Updated weights for policy 0, policy_version 54121 (0.0040) [2024-08-06 04:31:31,268][52820] DAMAGECOUNT value on done: 482757.0 [2024-08-06 04:31:31,268][52820] Sum rewards: 86.243, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.745', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.143', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.520', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '68.000'} [2024-08-06 04:31:31,313][52647] DAMAGECOUNT value on done: 563338.0 [2024-08-06 04:31:31,316][52647] Sum rewards: 72.554, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.356', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.092', 'weapon5': '0.202', 'AMMO3': '0.240', 'AMMO4': '0.322', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.968', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '63.000'} [2024-08-06 04:31:32,003][52667] DAMAGECOUNT value on done: 538602.0 [2024-08-06 04:31:32,004][52667] Sum rewards: 66.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.510', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.152', 'AMMO3': '0.182', 'AMMO4': '0.206', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 443375616. Throughput: 0: 4365.3. Samples: 110844920. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 04:31:32,795][52567] Avg episode reward: [(0, '71.771')] [2024-08-06 04:31:32,852][52669] DAMAGECOUNT value on done: 529917.0 [2024-08-06 04:31:32,852][52669] Sum rewards: 77.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.242', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.228', 'weapon4': '0.248', 'WEAPON3': '1.100', 'weapon3': '3.264', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '61.000'} [2024-08-06 04:31:33,604][52795] DAMAGECOUNT value on done: 482739.0 [2024-08-06 04:31:33,605][52795] Sum rewards: 63.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.128', 'weapon5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:33,797][52647] DAMAGECOUNT value on done: 562007.0 [2024-08-06 04:31:33,799][52647] Sum rewards: 66.582, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.218', 'weapon5': '0.230', 'AMMO3': '0.233', 'weapon2': '0.270', 'AMMO4': '0.289', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:33,972][52671] DAMAGECOUNT value on done: 533360.0 [2024-08-06 04:31:33,973][52671] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.102', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '61.500'} [2024-08-06 04:31:34,394][52820] DAMAGECOUNT value on done: 493042.0 [2024-08-06 04:31:34,394][52820] Sum rewards: 73.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'weapon4': '0.022', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:35,385][52669] DAMAGECOUNT value on done: 535707.0 [2024-08-06 04:31:35,387][52669] Sum rewards: 74.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.134', 'weapon4': '0.144', 'AMMO4': '0.155', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '60.500'} [2024-08-06 04:31:35,641][52658] DAMAGECOUNT value on done: 528163.0 [2024-08-06 04:31:35,641][52658] Sum rewards: 58.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.463', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.172', 'AMMO4': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '3.068', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '49.000'} [2024-08-06 04:31:36,126][52650] Updated weights for policy 0, policy_version 54131 (0.0018) [2024-08-06 04:31:36,357][52647] DAMAGECOUNT value on done: 558972.0 [2024-08-06 04:31:36,358][52647] Sum rewards: 81.050, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.462', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.066', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '70.000'} [2024-08-06 04:31:36,651][52795] DAMAGECOUNT value on done: 498470.0 [2024-08-06 04:31:36,654][52795] Sum rewards: 60.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.016', 'AMMO2': '0.064', 'AMMO3': '0.192', 'weapon5': '0.224', 'weapon4': '0.256', 'AMMO4': '0.322', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '50.000'} [2024-08-06 04:31:36,653][52671] DAMAGECOUNT value on done: 533647.0 [2024-08-06 04:31:36,660][52671] Sum rewards: 77.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.140', 'ARMOR': '0.004', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.176', 'weapon2': '0.218', 'weapon5': '0.260', 'weapon4': '0.308', 'AMMO4': '0.310', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:37,466][52820] DAMAGECOUNT value on done: 484058.0 [2024-08-06 04:31:37,467][52820] Sum rewards: 61.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.167', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '52.000'} [2024-08-06 04:31:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 443473920. Throughput: 0: 4374.2. Samples: 110871230. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 04:31:37,794][52567] Avg episode reward: [(0, '71.545')] [2024-08-06 04:31:37,861][52669] DAMAGECOUNT value on done: 533944.0 [2024-08-06 04:31:37,863][52669] Sum rewards: 70.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon2': '0.158', 'AMMO3': '0.186', 'weapon5': '0.212', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'weapon4': '0.380', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '55.500'} [2024-08-06 04:31:37,916][52668] DAMAGECOUNT value on done: 527564.0 [2024-08-06 04:31:37,916][52668] Sum rewards: 78.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.105', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '65.000'} [2024-08-06 04:31:38,683][52658] DAMAGECOUNT value on done: 529076.0 [2024-08-06 04:31:38,684][52658] Sum rewards: 68.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.346', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:39,220][52671] DAMAGECOUNT value on done: 542248.0 [2024-08-06 04:31:39,221][52671] Sum rewards: 61.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.844', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.144', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.280', 'WEAPON3': '1.600', 'HITCOUNT': '2.970', 'weapon3': '3.296', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:39,267][52647] DAMAGECOUNT value on done: 551843.0 [2024-08-06 04:31:39,268][52647] Sum rewards: 68.167, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.846', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.176', 'weapon4': '0.228', 'weapon2': '0.264', 'AMMO3': '0.288', 'AMMO4': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '60.000'} [2024-08-06 04:31:40,012][52795] DAMAGECOUNT value on done: 491553.0 [2024-08-06 04:31:40,012][52795] Sum rewards: 75.672, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.781', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.172', 'weapon5': '0.190', 'AMMO4': '0.220', 'AMMO3': '0.227', 'weapon2': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:40,548][52820] DAMAGECOUNT value on done: 488809.0 [2024-08-06 04:31:40,549][52820] Sum rewards: 78.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.175', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon4': '0.106', 'AMMO3': '0.190', 'weapon5': '0.208', 'AMMO4': '0.328', 'weapon2': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 04:31:40,633][52650] Updated weights for policy 0, policy_version 54141 (0.0012) [2024-08-06 04:31:40,937][52669] DAMAGECOUNT value on done: 521917.0 [2024-08-06 04:31:40,938][52669] Sum rewards: 75.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.605', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.101', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:41,037][52668] DAMAGECOUNT value on done: 532731.0 [2024-08-06 04:31:41,038][52668] Sum rewards: 73.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.775', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.128', 'weapon2': '0.166', 'AMMO4': '0.198', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.360', 'weapon3': '3.466', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:41,781][52658] DAMAGECOUNT value on done: 535150.0 [2024-08-06 04:31:41,783][52671] DAMAGECOUNT value on done: 532936.0 [2024-08-06 04:31:41,785][52671] Sum rewards: 59.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.472', 'AMMO5': '0.025', 'AMMO2': '0.070', 'AMMO3': '0.169', 'weapon5': '0.242', 'weapon4': '0.326', 'weapon2': '0.336', 'AMMO4': '0.348', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.798', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '50.000'} [2024-08-06 04:31:41,785][52658] Sum rewards: 64.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.088', 'AMMO3': '0.254', 'AMMO4': '0.254', 'weapon2': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:41,794][52647] DAMAGECOUNT value on done: 560746.0 [2024-08-06 04:31:41,795][52647] Sum rewards: 80.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.293', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.000', 'weapon3': '3.266', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '63.000'} [2024-08-06 04:31:42,008][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:31:42,702][52662] DAMAGECOUNT value on done: 533869.0 [2024-08-06 04:31:42,704][52662] Sum rewards: 59.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.118', 'weapon4': '0.122', 'AMMO4': '0.155', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '50.000'} [2024-08-06 04:31:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 443555840. Throughput: 0: 4376.9. Samples: 110897630. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 04:31:42,794][52567] Avg episode reward: [(0, '71.219')] [2024-08-06 04:31:43,094][52795] DAMAGECOUNT value on done: 481640.0 [2024-08-06 04:31:43,096][52795] Sum rewards: 83.049, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.535', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.132', 'weapon2': '0.168', 'AMMO4': '0.174', 'AMMO3': '0.200', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '65.000'} [2024-08-06 04:31:43,628][52820] DAMAGECOUNT value on done: 492633.0 [2024-08-06 04:31:43,630][52820] Sum rewards: 72.729, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.118', 'AMMO4': '0.158', 'AMMO3': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '3.236', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '58.000'} [2024-08-06 04:31:43,671][52669] DAMAGECOUNT value on done: 531693.0 [2024-08-06 04:31:43,674][52669] Sum rewards: 60.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.175', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.076', 'AMMO3': '0.197', 'AMMO4': '0.217', 'weapon5': '0.258', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '50.500'} [2024-08-06 04:31:43,954][52668] DAMAGECOUNT value on done: 530719.0 [2024-08-06 04:31:43,954][52668] Sum rewards: 59.535, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.934', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.216', 'weapon5': '0.248', 'AMMO3': '0.249', 'AMMO4': '0.317', 'weapon2': '0.354', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '2.856', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '51.000'} [2024-08-06 04:31:44,311][52647] DAMAGECOUNT value on done: 555644.0 [2024-08-06 04:31:44,312][52647] Sum rewards: 67.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.305', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.102', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.244', 'WEAPON3': '1.200', 'HITCOUNT': '3.340', 'weapon3': '3.378', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '56.000'} [2024-08-06 04:31:44,627][52658] DAMAGECOUNT value on done: 534561.0 [2024-08-06 04:31:44,627][52658] Sum rewards: 65.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.086', 'weapon5': '0.200', 'AMMO3': '0.238', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:44,915][52671] DAMAGECOUNT value on done: 539948.0 [2024-08-06 04:31:44,917][52671] Sum rewards: 81.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.352', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.104', 'AMMO3': '0.183', 'AMMO4': '0.238', 'weapon5': '0.286', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '65.000'} [2024-08-06 04:31:45,325][52650] Updated weights for policy 0, policy_version 54151 (0.0019) [2024-08-06 04:31:45,832][52662] DAMAGECOUNT value on done: 533844.0 [2024-08-06 04:31:45,832][52662] Sum rewards: 65.658, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.022', 'ARMOR': '0.024', 'AMMO2': '0.053', 'weapon4': '0.134', 'weapon5': '0.238', 'AMMO3': '0.241', 'AMMO4': '0.266', 'weapon2': '0.412', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '56.000'} [2024-08-06 04:31:46,238][52795] DAMAGECOUNT value on done: 489155.0 [2024-08-06 04:31:46,239][52795] Sum rewards: 63.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.109', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2024-08-06 04:31:46,463][52668] DAMAGECOUNT value on done: 531429.0 [2024-08-06 04:31:46,464][52668] Sum rewards: 67.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.335', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon5': '0.038', 'weapon4': '0.044', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.050', 'weapon3': '3.204', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:46,864][52820] DAMAGECOUNT value on done: 488760.0 [2024-08-06 04:31:46,866][52820] Sum rewards: 65.656, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.764', 'AMMO5': '0.026', 'AMMO2': '0.074', 'weapon4': '0.152', 'AMMO3': '0.244', 'weapon5': '0.302', 'weapon2': '0.330', 'AMMO4': '0.368', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.450', 'HITCOUNT': '2.780', 'weapon3': '2.826', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:46,931][52669] DAMAGECOUNT value on done: 533140.0 [2024-08-06 04:31:46,933][52669] Sum rewards: 77.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.086', 'AMMO3': '0.178', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:47,164][52647] DAMAGECOUNT value on done: 557706.0 [2024-08-06 04:31:47,164][52647] Sum rewards: 66.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.892', 'AMMO5': '0.012', 'AMMO2': '0.012', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon5': '0.108', 'AMMO3': '0.147', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '0.950', 'HITCOUNT': '3.160', 'weapon3': '3.166', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '53.000'} [2024-08-06 04:31:47,318][52658] DAMAGECOUNT value on done: 525203.0 [2024-08-06 04:31:47,318][52658] Sum rewards: 73.355, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.350', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon5': '0.140', 'weapon4': '0.186', 'AMMO4': '0.201', 'AMMO3': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:47,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17203.1, 300 sec: 17467.0). Total num frames: 443637760. Throughput: 0: 4377.1. Samples: 110910840. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 04:31:47,795][52567] Avg episode reward: [(0, '70.927')] [2024-08-06 04:31:48,004][52671] DAMAGECOUNT value on done: 531547.0 [2024-08-06 04:31:48,004][52671] Sum rewards: 65.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.954', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.068', 'weapon4': '0.096', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.216', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.440', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '54.000'} [2024-08-06 04:31:48,666][52662] DAMAGECOUNT value on done: 535861.0 [2024-08-06 04:31:48,668][52662] Sum rewards: 75.481, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.007', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.130', 'AMMO4': '0.221', 'weapon5': '0.226', 'weapon2': '0.252', 'AMMO3': '0.255', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '63.500'} [2024-08-06 04:31:49,365][52795] DAMAGECOUNT value on done: 493133.0 [2024-08-06 04:31:49,365][52795] Sum rewards: 76.319, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.866', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.008', 'weapon5': '0.016', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:49,408][52663] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:31:49,551][52668] DAMAGECOUNT value on done: 521589.0 [2024-08-06 04:31:49,551][52668] Sum rewards: 66.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon4': '0.184', 'weapon5': '0.204', 'AMMO3': '0.216', 'AMMO4': '0.292', 'weapon2': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:49,636][52647] DAMAGECOUNT value on done: 548938.0 [2024-08-06 04:31:49,637][52647] Sum rewards: 70.872, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.735', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.143', 'AMMO4': '0.202', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'weapon4': '0.572', 'WEAPON3': '0.900', 'weapon3': '2.496', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:49,642][52668] Large shaping reward 2.503 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.129, -43.0), ('weapon5', 0.002)] [2024-08-06 04:31:49,920][52669] DAMAGECOUNT value on done: 548716.0 [2024-08-06 04:31:49,922][52669] Sum rewards: 64.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.648', 'AMMO5': '0.020', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.112', 'AMMO4': '0.151', 'weapon2': '0.222', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.254', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:50,076][52650] Updated weights for policy 0, policy_version 54161 (0.0013) [2024-08-06 04:31:50,127][52820] DAMAGECOUNT value on done: 496739.0 [2024-08-06 04:31:50,127][52820] Sum rewards: 74.674, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.914', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.138', 'AMMO3': '0.151', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.954', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '59.500'} [2024-08-06 04:31:50,244][52658] DAMAGECOUNT value on done: 526470.0 [2024-08-06 04:31:50,247][52658] Sum rewards: 75.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.222', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.328', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:51,137][52662] DAMAGECOUNT value on done: 523433.0 [2024-08-06 04:31:51,139][52662] Sum rewards: 66.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.035', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.260', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.558', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:51,165][52671] DAMAGECOUNT value on done: 528079.0 [2024-08-06 04:31:51,167][52671] Sum rewards: 74.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.116', 'AMMO3': '0.193', 'weapon5': '0.198', 'AMMO4': '0.260', 'weapon2': '0.302', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:52,141][52668] DAMAGECOUNT value on done: 536904.0 [2024-08-06 04:31:52,144][52668] Sum rewards: 76.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.176', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.238', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '65.000'} [2024-08-06 04:31:52,590][52647] DAMAGECOUNT value on done: 562023.0 [2024-08-06 04:31:52,592][52647] Sum rewards: 61.661, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.365', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.201', 'weapon5': '0.264', 'weapon2': '0.358', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.582', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '51.000'} [2024-08-06 04:31:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 443727872. Throughput: 0: 4376.4. Samples: 110937000. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 04:31:52,794][52567] Avg episode reward: [(0, '71.031')] [2024-08-06 04:31:52,827][52669] DAMAGECOUNT value on done: 537091.0 [2024-08-06 04:31:52,836][52669] Sum rewards: 78.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.156', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.134', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '65.000'} [2024-08-06 04:31:52,992][52658] DAMAGECOUNT value on done: 534759.0 [2024-08-06 04:31:52,992][52658] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.248', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon5': '0.286', 'weapon4': '0.292', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.774', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:53,332][52820] DAMAGECOUNT value on done: 484363.0 [2024-08-06 04:31:53,333][52820] Sum rewards: 68.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.890', 'AMMO5': '0.027', 'AMMO2': '0.058', 'AMMO3': '0.194', 'weapon2': '0.204', 'AMMO4': '0.289', 'weapon4': '0.306', 'weapon5': '0.342', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:53,599][52664] DAMAGECOUNT value on done: 549686.0 [2024-08-06 04:31:53,601][52664] Sum rewards: 86.233, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'HEALTH': '0.140', 'AMMO3': '0.191', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '69.000'} [2024-08-06 04:31:53,988][52671] DAMAGECOUNT value on done: 534873.0 [2024-08-06 04:31:53,990][52671] Sum rewards: 74.701, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.895', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:54,416][52650] Updated weights for policy 0, policy_version 54171 (0.0012) [2024-08-06 04:31:54,431][52662] DAMAGECOUNT value on done: 535548.0 [2024-08-06 04:31:54,431][52662] Sum rewards: 65.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.075', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.054', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.670', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:55,049][52668] DAMAGECOUNT value on done: 533251.0 [2024-08-06 04:31:55,049][52668] Sum rewards: 76.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.462', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.088', 'AMMO4': '0.120', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '64.000'} [2024-08-06 04:31:55,206][52647] DAMAGECOUNT value on done: 554654.0 [2024-08-06 04:31:55,208][52647] Sum rewards: 72.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.013', 'AMMO2': '0.064', 'weapon4': '0.108', 'weapon2': '0.228', 'AMMO3': '0.229', 'weapon5': '0.230', 'AMMO4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.194', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:55,633][52669] DAMAGECOUNT value on done: 534563.0 [2024-08-06 04:31:55,634][52669] Sum rewards: 68.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.108', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '57.000'} [2024-08-06 04:31:56,005][52664] DAMAGECOUNT value on done: 555004.0 [2024-08-06 04:31:56,005][52664] Sum rewards: 81.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.122', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '69.000'} [2024-08-06 04:31:56,285][52658] DAMAGECOUNT value on done: 526157.0 [2024-08-06 04:31:56,288][52658] Sum rewards: 77.143, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.122', 'AMMO3': '0.179', 'AMMO4': '0.282', 'weapon2': '0.380', 'weapon5': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'HEALTH': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.860', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:56,322][52820] DAMAGECOUNT value on done: 492715.0 [2024-08-06 04:31:56,323][52820] Sum rewards: 71.068, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.160', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.140', 'weapon5': '0.150', 'AMMO4': '0.203', 'weapon4': '0.328', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon3': '2.932', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '55.000'} [2024-08-06 04:31:56,996][52671] DAMAGECOUNT value on done: 535063.0 [2024-08-06 04:31:56,996][52671] Sum rewards: 76.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.172', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:57,333][52662] DAMAGECOUNT value on done: 527726.0 [2024-08-06 04:31:57,334][52662] Sum rewards: 74.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.172', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 04:31:57,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 443826176. Throughput: 0: 4377.8. Samples: 110963240. Policy #0 lag: (min: 0.0, avg: 4.7, max: 8.0) [2024-08-06 04:31:57,794][52567] Avg episode reward: [(0, '71.391')] [2024-08-06 04:31:57,799][52668] DAMAGECOUNT value on done: 524723.0 [2024-08-06 04:31:57,800][52668] Sum rewards: 75.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.252', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.094', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:58,075][52647] DAMAGECOUNT value on done: 562856.0 [2024-08-06 04:31:58,077][52647] Sum rewards: 61.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.661', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon4': '0.102', 'AMMO4': '0.227', 'AMMO3': '0.255', 'weapon5': '0.280', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.912', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '52.000'} [2024-08-06 04:31:58,491][52669] DAMAGECOUNT value on done: 535193.0 [2024-08-06 04:31:58,493][52669] Sum rewards: 76.263, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.565', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.122', 'weapon5': '0.124', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '3.310', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '60.000'} [2024-08-06 04:31:58,637][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon7', 0.002)] [2024-08-06 04:31:58,985][52658] DAMAGECOUNT value on done: 541985.0 [2024-08-06 04:31:58,987][52658] Sum rewards: 76.384, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'HEALTH': '0.024', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.171', 'weapon5': '0.180', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '60.000'} [2024-08-06 04:31:59,089][52664] DAMAGECOUNT value on done: 555096.0 [2024-08-06 04:31:59,089][52664] Sum rewards: 75.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.681', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.110', 'weapon5': '0.194', 'AMMO4': '0.198', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '62.000'} [2024-08-06 04:31:59,409][52650] Updated weights for policy 0, policy_version 54181 (0.0012) [2024-08-06 04:31:59,437][52820] DAMAGECOUNT value on done: 499135.0 [2024-08-06 04:31:59,438][52820] Sum rewards: 82.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.159', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.184', 'weapon5': '0.196', 'AMMO3': '0.220', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '67.000'} [2024-08-06 04:32:00,046][52671] DAMAGECOUNT value on done: 531267.0 [2024-08-06 04:32:00,048][52671] Sum rewards: 70.505, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.548', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.128', 'AMMO4': '0.225', 'weapon2': '0.228', 'AMMO3': '0.270', 'weapon5': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.022', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:00,471][52668] DAMAGECOUNT value on done: 527655.0 [2024-08-06 04:32:00,472][52668] Sum rewards: 76.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.348', 'AMMO5': '0.020', 'AMMO2': '0.063', 'AMMO3': '0.204', 'weapon4': '0.242', 'weapon5': '0.296', 'AMMO4': '0.316', 'weapon2': '0.320', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:00,528][52662] DAMAGECOUNT value on done: 534838.0 [2024-08-06 04:32:00,529][52662] Sum rewards: 80.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.122', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '66.000'} [2024-08-06 04:32:00,914][52647] DAMAGECOUNT value on done: 558015.0 [2024-08-06 04:32:00,916][52647] Sum rewards: 79.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.504', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO4': '0.155', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '65.000'} [2024-08-06 04:32:01,606][52669] DAMAGECOUNT value on done: 539236.0 [2024-08-06 04:32:01,606][52669] Sum rewards: 73.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.821', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.118', 'AMMO4': '0.153', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:01,653][52664] DAMAGECOUNT value on done: 546148.0 [2024-08-06 04:32:01,653][52664] Sum rewards: 78.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.140', 'AMMO4': '0.152', 'weapon5': '0.152', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '66.000'} [2024-08-06 04:32:02,164][52658] DAMAGECOUNT value on done: 527877.0 [2024-08-06 04:32:02,165][52658] Sum rewards: 71.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.518', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.090', 'weapon5': '0.142', 'AMMO3': '0.198', 'weapon2': '0.238', 'AMMO4': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.296', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:02,629][52820] DAMAGECOUNT value on done: 493268.0 [2024-08-06 04:32:02,629][52820] Sum rewards: 68.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.342', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.098', 'AMMO3': '0.201', 'weapon5': '0.204', 'AMMO4': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:02,656][52660] DAMAGECOUNT value on done: 532082.0 [2024-08-06 04:32:02,657][52660] Sum rewards: 78.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.212', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '3.420', 'weapon3': '3.450', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '67.000'} [2024-08-06 04:32:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 443908096. Throughput: 0: 4378.5. Samples: 110976310. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:32:02,794][52567] Avg episode reward: [(0, '71.498')] [2024-08-06 04:32:03,039][52668] DAMAGECOUNT value on done: 535500.0 [2024-08-06 04:32:03,047][52668] Sum rewards: 73.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.932', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.124', 'AMMO4': '0.154', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:03,192][52671] DAMAGECOUNT value on done: 540969.0 [2024-08-06 04:32:03,193][52671] Sum rewards: 59.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.953', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon2': '0.186', 'AMMO4': '0.221', 'weapon5': '0.226', 'AMMO3': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.900', 'weapon3': '2.974', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '53.000'} [2024-08-06 04:32:03,221][52647] DAMAGECOUNT value on done: 547388.0 [2024-08-06 04:32:03,222][52647] Sum rewards: 86.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.423', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.201', 'weapon2': '0.232', 'weapon4': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '71.000'} [2024-08-06 04:32:03,392][52662] DAMAGECOUNT value on done: 538227.0 [2024-08-06 04:32:03,393][52662] Sum rewards: 70.485, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon2': '0.132', 'weapon5': '0.180', 'AMMO3': '0.187', 'AMMO4': '0.224', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:03,749][52650] Updated weights for policy 0, policy_version 54191 (0.0012) [2024-08-06 04:32:04,037][52664] DAMAGECOUNT value on done: 551314.0 [2024-08-06 04:32:04,039][52664] Sum rewards: 63.420, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.066', 'weapon5': '0.136', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon2': '0.312', 'WEAPON3': '1.700', 'weapon3': '3.196', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:05,166][52660] DAMAGECOUNT value on done: 520441.0 [2024-08-06 04:32:05,168][52660] Sum rewards: 69.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.174', 'weapon5': '0.178', 'AMMO4': '0.292', 'weapon2': '0.306', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:05,304][52658] DAMAGECOUNT value on done: 541837.0 [2024-08-06 04:32:05,308][52658] Sum rewards: 70.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.498', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.128', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.196', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:05,566][52668] DAMAGECOUNT value on done: 530044.0 [2024-08-06 04:32:05,566][52668] Sum rewards: 76.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.708', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 04:32:05,645][52647] DAMAGECOUNT value on done: 555731.0 [2024-08-06 04:32:05,645][52647] Sum rewards: 62.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO3': '0.160', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.330', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '51.500'} [2024-08-06 04:32:05,818][52671] DAMAGECOUNT value on done: 534933.0 [2024-08-06 04:32:05,818][52671] Sum rewards: 71.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.706', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.102', 'weapon2': '0.182', 'AMMO4': '0.200', 'weapon5': '0.224', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:05,824][52820] DAMAGECOUNT value on done: 497396.0 [2024-08-06 04:32:05,825][52820] Sum rewards: 80.603, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.272', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.106', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'AMMO3': '0.303', 'weapon2': '0.358', 'WEAPON3': '2.000', 'weapon3': '3.240', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '72.000'} [2024-08-06 04:32:06,451][52662] DAMAGECOUNT value on done: 531962.0 [2024-08-06 04:32:06,451][52662] Sum rewards: 79.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.664', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.113', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:06,628][52664] DAMAGECOUNT value on done: 551212.0 [2024-08-06 04:32:06,629][52664] Sum rewards: 78.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.375', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO4': '0.180', 'AMMO3': '0.239', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '65.000'} [2024-08-06 04:32:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 443990016. Throughput: 0: 4378.7. Samples: 111002770. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:32:07,794][52567] Avg episode reward: [(0, '71.975')] [2024-08-06 04:32:07,996][52647] DAMAGECOUNT value on done: 550375.0 [2024-08-06 04:32:07,996][52647] Sum rewards: 74.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.450', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.148', 'AMMO3': '0.198', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:08,144][52660] DAMAGECOUNT value on done: 533445.0 [2024-08-06 04:32:08,152][52660] Sum rewards: 73.422, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.554', 'AMMO5': '0.012', 'AMMO2': '0.063', 'AMMO3': '0.155', 'weapon5': '0.160', 'weapon4': '0.180', 'AMMO4': '0.315', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:08,386][52658] DAMAGECOUNT value on done: 524506.0 [2024-08-06 04:32:08,387][52658] Sum rewards: 70.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.142', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.124', 'weapon5': '0.170', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:08,493][52668] DAMAGECOUNT value on done: 524379.0 [2024-08-06 04:32:08,494][52668] Sum rewards: 78.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.224', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon2': '0.118', 'weapon5': '0.136', 'AMMO4': '0.191', 'weapon4': '0.224', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '65.000'} [2024-08-06 04:32:08,663][52671] DAMAGECOUNT value on done: 520020.0 [2024-08-06 04:32:08,664][52671] Sum rewards: 66.579, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.179', 'weapon2': '0.226', 'weapon5': '0.278', 'AMMO4': '0.297', 'weapon4': '0.314', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '53.500'} [2024-08-06 04:32:08,685][52650] Updated weights for policy 0, policy_version 54201 (0.0030) [2024-08-06 04:32:08,942][52820] DAMAGECOUNT value on done: 491687.0 [2024-08-06 04:32:08,944][52820] Sum rewards: 65.994, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.920', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.044', 'AMMO3': '0.153', 'AMMO4': '0.164', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '51.500'} [2024-08-06 04:32:08,965][52664] DAMAGECOUNT value on done: 548471.0 [2024-08-06 04:32:08,967][52664] Sum rewards: 75.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.177', 'AMMO4': '0.184', 'weapon5': '0.200', 'weapon4': '0.286', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:09,530][52662] DAMAGECOUNT value on done: 541899.0 [2024-08-06 04:32:09,531][52662] Sum rewards: 63.915, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.585', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.086', 'weapon5': '0.200', 'AMMO4': '0.240', 'AMMO3': '0.291', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.118', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:10,519][52647] DAMAGECOUNT value on done: 551151.0 [2024-08-06 04:32:10,519][52647] Sum rewards: 77.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.084', 'weapon5': '0.196', 'AMMO3': '0.197', 'AMMO4': '0.210', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:11,269][52658] DAMAGECOUNT value on done: 530948.0 [2024-08-06 04:32:11,269][52658] Sum rewards: 65.815, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.205', 'AMMO5': '0.028', 'AMMO2': '0.058', 'AMMO3': '0.197', 'weapon5': '0.236', 'AMMO4': '0.288', 'weapon4': '0.350', 'weapon2': '0.456', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.640', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:11,398][52660] DAMAGECOUNT value on done: 538909.0 [2024-08-06 04:32:11,398][52660] Sum rewards: 80.532, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon2': '0.224', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'weapon3': '3.552', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '68.000'} [2024-08-06 04:32:11,404][52664] DAMAGECOUNT value on done: 542511.0 [2024-08-06 04:32:11,404][52664] Sum rewards: 56.196, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.170', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.068', 'weapon4': '0.082', 'AMMO3': '0.094', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '0.700', 'HITCOUNT': '2.680', 'weapon3': '3.320', 'DAMAGECOUNT': '13.167', 'FRAGCOUNT': '43.000'} [2024-08-06 04:32:11,740][52668] DAMAGECOUNT value on done: 517778.0 [2024-08-06 04:32:11,740][52668] Sum rewards: 72.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.246', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.124', 'AMMO3': '0.172', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:11,744][52671] DAMAGECOUNT value on done: 541371.0 [2024-08-06 04:32:11,745][52671] Sum rewards: 62.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.179', 'weapon4': '0.206', 'AMMO4': '0.218', 'weapon5': '0.266', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '52.000'} [2024-08-06 04:32:12,219][52820] DAMAGECOUNT value on done: 493280.0 [2024-08-06 04:32:12,220][52820] Sum rewards: 63.926, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.325', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.086', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.262', 'weapon2': '0.690', 'WEAPON3': '0.850', 'weapon3': '2.798', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '49.000'} [2024-08-06 04:32:12,614][52662] DAMAGECOUNT value on done: 527722.0 [2024-08-06 04:32:12,615][52662] Sum rewards: 59.223, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.825', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.121', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.228', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '53.000'} [2024-08-06 04:32:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17494.8). Total num frames: 444088320. Throughput: 0: 4380.4. Samples: 111028950. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:32:12,795][52567] Avg episode reward: [(0, '71.439')] [2024-08-06 04:32:13,058][52650] Updated weights for policy 0, policy_version 54211 (0.0022) [2024-08-06 04:32:14,027][52658] DAMAGECOUNT value on done: 529725.0 [2024-08-06 04:32:14,027][52658] Sum rewards: 60.539, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.178', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.102', 'AMMO4': '0.149', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.358', 'WEAPON3': '2.100', 'weapon3': '3.238', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:14,402][52671] DAMAGECOUNT value on done: 537679.0 [2024-08-06 04:32:14,403][52671] Sum rewards: 67.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.037', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.062', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.271', 'weapon2': '0.514', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:14,447][52664] DAMAGECOUNT value on done: 554893.0 [2024-08-06 04:32:14,447][52664] Sum rewards: 69.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.602', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:14,606][52660] DAMAGECOUNT value on done: 530734.0 [2024-08-06 04:32:14,608][52660] Sum rewards: 62.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.218', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon2': '0.178', 'AMMO3': '0.206', 'weapon5': '0.218', 'AMMO4': '0.220', 'weapon4': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.088', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '53.000'} [2024-08-06 04:32:14,864][52668] DAMAGECOUNT value on done: 519291.0 [2024-08-06 04:32:14,868][52668] Sum rewards: 66.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.152', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.358', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:15,042][52665] DAMAGECOUNT value on done: 518635.0 [2024-08-06 04:32:15,042][52665] Sum rewards: 73.861, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.110', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.225', 'HEALTH': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:15,354][52820] DAMAGECOUNT value on done: 502810.0 [2024-08-06 04:32:15,354][52820] Sum rewards: 85.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.462', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.173', 'AMMO3': '0.207', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.727', 'FRAGCOUNT': '69.000'} [2024-08-06 04:32:15,522][52662] DAMAGECOUNT value on done: 532662.0 [2024-08-06 04:32:15,523][52662] Sum rewards: 71.242, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.089', 'AMMO5': '0.024', 'AMMO2': '0.052', 'AMMO3': '0.145', 'weapon4': '0.242', 'AMMO4': '0.262', 'weapon5': '0.378', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.712', 'WEAPON3': '0.950', 'weapon3': '2.346', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:16,905][52664] DAMAGECOUNT value on done: 546572.0 [2024-08-06 04:32:16,906][52664] Sum rewards: 66.115, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.109', 'AMMO4': '0.135', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '0.750', 'weapon3': '2.824', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '50.000'} [2024-08-06 04:32:16,938][52658] DAMAGECOUNT value on done: 531316.0 [2024-08-06 04:32:16,938][52658] Sum rewards: 77.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.972', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.192', 'AMMO3': '0.263', 'weapon4': '0.268', 'weapon2': '0.270', 'AMMO4': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.934', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '65.000'} [2024-08-06 04:32:17,260][52671] DAMAGECOUNT value on done: 538494.0 [2024-08-06 04:32:17,264][52671] Sum rewards: 70.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.213', 'AMMO4': '0.217', 'weapon5': '0.236', 'weapon4': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:17,740][52660] DAMAGECOUNT value on done: 527179.0 [2024-08-06 04:32:17,741][52660] Sum rewards: 65.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.706', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.196', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '54.000'} [2024-08-06 04:32:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 444170240. Throughput: 0: 4380.5. Samples: 111042040. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:32:17,795][52567] Avg episode reward: [(0, '71.402')] [2024-08-06 04:32:17,969][52668] DAMAGECOUNT value on done: 521753.0 [2024-08-06 04:32:17,971][52668] Sum rewards: 82.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.308', 'weapon4': '0.340', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.000'} [2024-08-06 04:32:18,077][52650] Updated weights for policy 0, policy_version 54221 (0.0016) [2024-08-06 04:32:18,269][52665] DAMAGECOUNT value on done: 533505.0 [2024-08-06 04:32:18,271][52665] Sum rewards: 62.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.708', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon4': '0.170', 'weapon5': '0.224', 'AMMO3': '0.260', 'AMMO4': '0.337', 'weapon2': '0.404', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '2.880', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '53.000'} [2024-08-06 04:32:18,339][52820] DAMAGECOUNT value on done: 501752.0 [2024-08-06 04:32:18,339][52820] Sum rewards: 96.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.905', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.082', 'AMMO4': '0.087', 'weapon5': '0.092', 'weapon2': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.376', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '23.025', 'FRAGCOUNT': '80.000'} [2024-08-06 04:32:18,346][52662] DAMAGECOUNT value on done: 529054.0 [2024-08-06 04:32:18,346][52662] Sum rewards: 67.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.525', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.140', 'weapon4': '0.180', 'AMMO3': '0.213', 'AMMO4': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:19,603][52658] DAMAGECOUNT value on done: 521264.0 [2024-08-06 04:32:19,604][52658] Sum rewards: 73.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.381', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:19,875][52664] DAMAGECOUNT value on done: 556767.0 [2024-08-06 04:32:19,876][52664] Sum rewards: 64.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.000'} [2024-08-06 04:32:20,221][52671] DAMAGECOUNT value on done: 533383.0 [2024-08-06 04:32:20,223][52671] Sum rewards: 74.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.028', 'weapon4': '0.062', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.150', 'AMMO3': '0.213', 'WEAPON3': '1.350', 'HITCOUNT': '3.500', 'weapon3': '3.608', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:20,301][52660] DAMAGECOUNT value on done: 525018.0 [2024-08-06 04:32:20,301][52660] Sum rewards: 54.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.908', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.136', 'weapon4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.060', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '46.000'} [2024-08-06 04:32:20,473][52668] DAMAGECOUNT value on done: 529531.0 [2024-08-06 04:32:20,474][52668] Sum rewards: 76.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.052', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.110', 'weapon4': '0.124', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:21,478][52820] DAMAGECOUNT value on done: 488386.0 [2024-08-06 04:32:21,480][52820] Sum rewards: 72.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.698', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.086', 'weapon5': '0.194', 'AMMO4': '0.197', 'weapon2': '0.216', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.258', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:21,547][52662] DAMAGECOUNT value on done: 538147.0 [2024-08-06 04:32:21,549][52662] Sum rewards: 77.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.500', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.201', 'AMMO3': '0.203', 'weapon2': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.416', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '63.000'} [2024-08-06 04:32:21,572][52665] DAMAGECOUNT value on done: 526663.0 [2024-08-06 04:32:21,572][52665] Sum rewards: 61.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.015', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.070', 'weapon4': '0.108', 'AMMO4': '0.230', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.174', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '54.000'} [2024-08-06 04:32:22,391][52650] Updated weights for policy 0, policy_version 54231 (0.0012) [2024-08-06 04:32:22,683][52658] DAMAGECOUNT value on done: 536428.0 [2024-08-06 04:32:22,683][52658] Sum rewards: 69.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.525', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.096', 'AMMO4': '0.200', 'AMMO3': '0.233', 'weapon5': '0.254', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:22,736][52664] DAMAGECOUNT value on done: 554410.0 [2024-08-06 04:32:22,736][52664] Sum rewards: 73.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.172', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.150', 'AMMO3': '0.212', 'AMMO4': '0.257', 'weapon5': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 444260352. Throughput: 0: 4384.2. Samples: 111068520. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:32:22,794][52567] Avg episode reward: [(0, '71.882')] [2024-08-06 04:32:22,866][52671] DAMAGECOUNT value on done: 530575.0 [2024-08-06 04:32:22,866][52671] Sum rewards: 67.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.082', 'weapon4': '0.092', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:22,915][52660] DAMAGECOUNT value on done: 535400.0 [2024-08-06 04:32:22,916][52660] Sum rewards: 67.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.939', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.114', 'weapon5': '0.146', 'AMMO4': '0.213', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:23,080][52668] DAMAGECOUNT value on done: 532819.0 [2024-08-06 04:32:23,082][52668] Sum rewards: 55.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.145', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.144', 'AMMO3': '0.264', 'AMMO4': '0.265', 'weapon5': '0.344', 'weapon2': '0.406', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '2.812', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '48.000'} [2024-08-06 04:32:24,295][52662] DAMAGECOUNT value on done: 531881.0 [2024-08-06 04:32:24,295][52662] Sum rewards: 68.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.519', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.188', 'AMMO3': '0.194', 'weapon5': '0.266', 'AMMO4': '0.299', 'weapon2': '0.324', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '55.000'} [2024-08-06 04:32:24,616][52665] DAMAGECOUNT value on done: 523909.0 [2024-08-06 04:32:24,616][52665] Sum rewards: 70.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:25,293][52664] DAMAGECOUNT value on done: 561062.0 [2024-08-06 04:32:25,294][52664] Sum rewards: 70.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.444', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.148', 'weapon4': '0.172', 'AMMO4': '0.174', 'weapon2': '0.204', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:25,716][52660] DAMAGECOUNT value on done: 529407.0 [2024-08-06 04:32:25,718][52660] Sum rewards: 67.732, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.830', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '54.000'} [2024-08-06 04:32:25,858][52668] DAMAGECOUNT value on done: 529816.0 [2024-08-06 04:32:25,860][52668] Sum rewards: 63.993, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO3': '0.164', 'weapon5': '0.170', 'AMMO4': '0.194', 'weapon2': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.026', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '52.000'} [2024-08-06 04:32:25,871][52658] DAMAGECOUNT value on done: 528756.0 [2024-08-06 04:32:25,873][52658] Sum rewards: 54.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.190', 'AMMO3': '0.201', 'AMMO4': '0.249', 'weapon2': '0.338', 'weapon4': '0.354', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '2.820', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '46.000'} [2024-08-06 04:32:27,186][52662] DAMAGECOUNT value on done: 540737.0 [2024-08-06 04:32:27,186][52662] Sum rewards: 70.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon2': '0.192', 'AMMO4': '0.213', 'weapon4': '0.228', 'AMMO3': '0.232', 'weapon5': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:27,586][52650] Updated weights for policy 0, policy_version 54241 (0.0012) [2024-08-06 04:32:27,717][52665] DAMAGECOUNT value on done: 514993.0 [2024-08-06 04:32:27,717][52665] Sum rewards: 73.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.865', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.222', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 444342272. Throughput: 0: 4385.6. Samples: 111094980. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:32:27,792][52664] DAMAGECOUNT value on done: 556797.0 [2024-08-06 04:32:27,794][52567] Avg episode reward: [(0, '71.419')] [2024-08-06 04:32:27,795][52664] Sum rewards: 74.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.241', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '62.500'} [2024-08-06 04:32:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000054241_444342272.pth... [2024-08-06 04:32:27,936][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053729_440147968.pth [2024-08-06 04:32:28,299][52660] DAMAGECOUNT value on done: 528048.0 [2024-08-06 04:32:28,301][52660] Sum rewards: 68.981, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.903', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.145', 'AMMO3': '0.168', 'weapon5': '0.184', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.322', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:28,477][52811] DAMAGECOUNT value on done: 506439.0 [2024-08-06 04:32:28,477][52811] Sum rewards: 69.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.211', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.058', 'AMMO4': '0.179', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.252', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.186', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:28,629][52668] DAMAGECOUNT value on done: 533092.0 [2024-08-06 04:32:28,635][52668] Sum rewards: 70.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.132', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.102', 'AMMO4': '0.143', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.404', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:28,930][52658] DAMAGECOUNT value on done: 530966.0 [2024-08-06 04:32:28,931][52658] Sum rewards: 71.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.022', 'AMMO4': '0.097', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.338', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:30,045][52662] DAMAGECOUNT value on done: 535090.0 [2024-08-06 04:32:30,047][52662] Sum rewards: 69.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon5': '0.202', 'weapon2': '0.352', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.218', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:30,527][52665] DAMAGECOUNT value on done: 521427.0 [2024-08-06 04:32:30,529][52665] Sum rewards: 78.592, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.641', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.128', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.050', 'weapon3': '3.158', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:30,917][52664] DAMAGECOUNT value on done: 558035.0 [2024-08-06 04:32:30,917][52664] Sum rewards: 76.128, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.773', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.153', 'weapon5': '0.160', 'weapon2': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.222', 'WEAPON3': '1.050', 'weapon3': '3.296', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '60.500'} [2024-08-06 04:32:30,922][52660] DAMAGECOUNT value on done: 536925.0 [2024-08-06 04:32:30,922][52660] Sum rewards: 73.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.649', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.098', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:31,210][52668] DAMAGECOUNT value on done: 531798.0 [2024-08-06 04:32:31,211][52668] Sum rewards: 77.291, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.096', 'AMMO3': '0.167', 'weapon5': '0.204', 'AMMO4': '0.264', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:31,648][52811] DAMAGECOUNT value on done: 493093.0 [2024-08-06 04:32:31,652][52811] Sum rewards: 77.617, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.042', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.132', 'weapon5': '0.140', 'AMMO4': '0.197', 'AMMO3': '0.285', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.068', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '68.000'} [2024-08-06 04:32:31,726][52650] Updated weights for policy 0, policy_version 54251 (0.0016) [2024-08-06 04:32:32,236][52658] DAMAGECOUNT value on done: 535534.0 [2024-08-06 04:32:32,236][52658] Sum rewards: 73.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.227', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.214', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.450', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:32,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 444424192. Throughput: 0: 4375.1. Samples: 111107720. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 04:32:32,795][52567] Avg episode reward: [(0, '71.508')] [2024-08-06 04:32:32,935][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:32:33,117][52665] DAMAGECOUNT value on done: 525979.0 [2024-08-06 04:32:33,117][52665] Sum rewards: 78.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.117', 'weapon5': '0.166', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '63.000'} [2024-08-06 04:32:33,186][52662] DAMAGECOUNT value on done: 526338.0 [2024-08-06 04:32:33,187][52662] Sum rewards: 63.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.573', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.124', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '52.500'} [2024-08-06 04:32:33,974][52660] DAMAGECOUNT value on done: 521835.0 [2024-08-06 04:32:33,974][52660] Sum rewards: 52.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.005', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.110', 'weapon4': '0.166', 'AMMO4': '0.229', 'weapon2': '0.248', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.216', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '47.000'} [2024-08-06 04:32:34,155][52664] DAMAGECOUNT value on done: 550427.0 [2024-08-06 04:32:34,156][52664] Sum rewards: 62.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.150', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.190', 'AMMO4': '0.206', 'AMMO3': '0.223', 'weapon4': '0.246', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '2.968', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2024-08-06 04:32:34,752][52811] DAMAGECOUNT value on done: 489155.0 [2024-08-06 04:32:34,754][52811] Sum rewards: 70.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.355', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.128', 'AMMO3': '0.205', 'weapon5': '0.252', 'AMMO4': '0.291', 'weapon2': '0.524', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '58.500'} [2024-08-06 04:32:35,454][52665] DAMAGECOUNT value on done: 526175.0 [2024-08-06 04:32:35,454][52665] Sum rewards: 72.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.105', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:35,550][52662] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 04:32:35,849][52662] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0), ('HEALTH', -0.012, -4.0), ('weapon5', 0.002)] [2024-08-06 04:32:36,426][52662] DAMAGECOUNT value on done: 531610.0 [2024-08-06 04:32:36,428][52662] Sum rewards: 68.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.206', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.179', 'weapon5': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.236', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:36,821][52650] Updated weights for policy 0, policy_version 54261 (0.0012) [2024-08-06 04:32:37,033][52660] DAMAGECOUNT value on done: 527146.0 [2024-08-06 04:32:37,037][52660] Sum rewards: 65.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.476', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.175', 'weapon5': '0.204', 'weapon2': '0.282', 'AMMO4': '0.298', 'WEAPON5': '0.500', 'weapon4': '0.510', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.666', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.000'} [2024-08-06 04:32:37,134][52664] DAMAGECOUNT value on done: 545581.0 [2024-08-06 04:32:37,135][52664] Sum rewards: 74.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.235', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.175', 'AMMO4': '0.200', 'weapon5': '0.210', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.676', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:37,772][52811] DAMAGECOUNT value on done: 493692.0 [2024-08-06 04:32:37,773][52811] Sum rewards: 76.797, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.120', 'weapon4': '0.124', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.384', 'WEAPON3': '1.650', 'weapon3': '3.094', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '66.000'} [2024-08-06 04:32:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 444522496. Throughput: 0: 4379.3. Samples: 111134070. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 04:32:37,794][52567] Avg episode reward: [(0, '70.999')] [2024-08-06 04:32:38,443][52665] DAMAGECOUNT value on done: 532693.0 [2024-08-06 04:32:38,452][52665] Sum rewards: 69.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.108', 'AMMO3': '0.166', 'AMMO4': '0.175', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.386', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:39,154][52667] Large shaping reward 3.632 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:32:39,185][52662] DAMAGECOUNT value on done: 527396.0 [2024-08-06 04:32:39,186][52662] Sum rewards: 78.645, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.873', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon4': '0.118', 'weapon5': '0.268', 'AMMO3': '0.292', 'AMMO4': '0.329', 'weapon2': '0.344', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.928', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '67.000'} [2024-08-06 04:32:39,546][52664] DAMAGECOUNT value on done: 552453.0 [2024-08-06 04:32:39,548][52664] Sum rewards: 71.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:39,941][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:32:39,995][52660] DAMAGECOUNT value on done: 538467.0 [2024-08-06 04:32:39,997][52660] Sum rewards: 55.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.025', 'AMMO2': '0.081', 'AMMO3': '0.177', 'weapon5': '0.298', 'weapon4': '0.354', 'AMMO4': '0.407', 'weapon2': '0.550', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.398', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '46.000'} [2024-08-06 04:32:40,810][52811] DAMAGECOUNT value on done: 498976.0 [2024-08-06 04:32:40,811][52811] Sum rewards: 66.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.138', 'weapon4': '0.148', 'AMMO3': '0.236', 'AMMO4': '0.275', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:40,974][52666] Large shaping reward -2.503 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('weapon5', 0.002)] [2024-08-06 04:32:41,526][52665] DAMAGECOUNT value on done: 523955.0 [2024-08-06 04:32:41,528][52665] Sum rewards: 66.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.226', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.404', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '55.000'} [2024-08-06 04:32:41,652][52650] Updated weights for policy 0, policy_version 54271 (0.0014) [2024-08-06 04:32:42,411][52664] DAMAGECOUNT value on done: 550079.0 [2024-08-06 04:32:42,411][52664] Sum rewards: 66.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.531', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.404', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.202', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '57.000'} [2024-08-06 04:32:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 444612608. Throughput: 0: 4374.7. Samples: 111160100. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 04:32:42,795][52567] Avg episode reward: [(0, '70.351')] [2024-08-06 04:32:42,961][52660] DAMAGECOUNT value on done: 544952.0 [2024-08-06 04:32:42,963][52660] Sum rewards: 70.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.068', 'AMMO4': '0.167', 'weapon5': '0.184', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '58.000'} [2024-08-06 04:32:43,900][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:32:43,970][52811] DAMAGECOUNT value on done: 502577.0 [2024-08-06 04:32:43,971][52811] Sum rewards: 60.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.218', 'AMMO4': '0.242', 'weapon5': '0.280', 'weapon2': '0.288', 'weapon4': '0.334', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '50.000'} [2024-08-06 04:32:44,454][52665] DAMAGECOUNT value on done: 533985.0 [2024-08-06 04:32:44,454][52665] Sum rewards: 72.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.784', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.178', 'AMMO3': '0.185', 'weapon5': '0.222', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:44,727][52664] DAMAGECOUNT value on done: 549144.0 [2024-08-06 04:32:44,727][52664] Sum rewards: 75.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.088', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '62.500'} [2024-08-06 04:32:45,254][52794] DAMAGECOUNT value on done: 534795.0 [2024-08-06 04:32:45,254][52794] Sum rewards: 68.927, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.156', 'AMMO4': '0.195', 'weapon5': '0.210', 'AMMO3': '0.232', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:45,647][52660] DAMAGECOUNT value on done: 527590.0 [2024-08-06 04:32:45,647][52660] Sum rewards: 74.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.070', 'AMMO4': '0.104', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.242', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:45,783][52659] DAMAGECOUNT value on done: 535410.0 [2024-08-06 04:32:45,783][52659] Sum rewards: 73.526, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.106', 'weapon2': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO3': '0.241', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '61.000'} [2024-08-06 04:32:46,339][52650] Updated weights for policy 0, policy_version 54281 (0.0021) [2024-08-06 04:32:47,134][52811] DAMAGECOUNT value on done: 500400.0 [2024-08-06 04:32:47,137][52811] Sum rewards: 77.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.120', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.088', 'AMMO4': '0.172', 'AMMO3': '0.184', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:47,481][52665] DAMAGECOUNT value on done: 531475.0 [2024-08-06 04:32:47,484][52665] Sum rewards: 72.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.405', 'AMMO5': '0.012', 'AMMO2': '0.044', 'AMMO4': '0.220', 'weapon5': '0.224', 'weapon2': '0.230', 'weapon4': '0.238', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '60.500'} [2024-08-06 04:32:47,796][52567] Fps is (10 sec: 17199.5, 60 sec: 17612.2, 300 sec: 17466.9). Total num frames: 444694528. Throughput: 0: 4380.0. Samples: 111173420. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 04:32:47,797][52567] Avg episode reward: [(0, '70.219')] [2024-08-06 04:32:48,140][52660] DAMAGECOUNT value on done: 534379.0 [2024-08-06 04:32:48,141][52660] Sum rewards: 68.214, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.643', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.140', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.472', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '54.000'} [2024-08-06 04:32:48,151][52794] DAMAGECOUNT value on done: 538219.0 [2024-08-06 04:32:48,151][52794] Sum rewards: 69.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:48,794][52659] DAMAGECOUNT value on done: 531403.0 [2024-08-06 04:32:48,794][52659] Sum rewards: 78.447, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'ARMOR': '0.016', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.165', 'weapon5': '0.220', 'AMMO4': '0.254', 'weapon4': '0.438', 'weapon2': '0.462', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.610', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:49,850][52803] DAMAGECOUNT value on done: 495476.0 [2024-08-06 04:32:49,850][52803] Sum rewards: 67.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.562', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.064', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '56.000'} [2024-08-06 04:32:50,374][52811] DAMAGECOUNT value on done: 495724.0 [2024-08-06 04:32:50,375][52811] Sum rewards: 59.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'weapon4': '0.238', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '50.000'} [2024-08-06 04:32:50,539][52665] DAMAGECOUNT value on done: 526763.0 [2024-08-06 04:32:50,539][52665] Sum rewards: 79.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.118', 'weapon5': '0.118', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '66.000'} [2024-08-06 04:32:50,680][52650] Updated weights for policy 0, policy_version 54291 (0.0026) [2024-08-06 04:32:50,709][52660] DAMAGECOUNT value on done: 528235.0 [2024-08-06 04:32:50,710][52660] Sum rewards: 81.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.160', 'weapon5': '0.164', 'weapon2': '0.182', 'AMMO3': '0.214', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '66.000'} [2024-08-06 04:32:51,208][52794] DAMAGECOUNT value on done: 537149.0 [2024-08-06 04:32:51,210][52794] Sum rewards: 82.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.034', 'AMMO4': '0.036', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '68.000'} [2024-08-06 04:32:51,988][52659] DAMAGECOUNT value on done: 536858.0 [2024-08-06 04:32:51,990][52659] Sum rewards: 79.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.915', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.220', 'WEAPON3': '1.350', 'weapon3': '3.634', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '65.000'} [2024-08-06 04:32:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 444776448. Throughput: 0: 4379.3. Samples: 111199840. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 04:32:52,794][52567] Avg episode reward: [(0, '70.352')] [2024-08-06 04:32:53,028][52665] DAMAGECOUNT value on done: 526648.0 [2024-08-06 04:32:53,029][52665] Sum rewards: 68.702, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.206', 'AMMO3': '0.243', 'weapon4': '0.294', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '59.000'} [2024-08-06 04:32:53,058][52803] DAMAGECOUNT value on done: 493927.0 [2024-08-06 04:32:53,058][52803] Sum rewards: 73.636, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.672', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.174', 'AMMO3': '0.228', 'AMMO4': '0.236', 'weapon2': '0.272', 'weapon4': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '64.000'} [2024-08-06 04:32:53,463][52811] DAMAGECOUNT value on done: 502034.0 [2024-08-06 04:32:53,465][52811] Sum rewards: 63.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.892', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.108', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'weapon2': '0.468', 'WEAPON3': '1.650', 'weapon3': '2.980', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '55.000'} [2024-08-06 04:32:53,769][52660] DAMAGECOUNT value on done: 530175.0 [2024-08-06 04:32:53,769][52660] Sum rewards: 75.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon4': '0.082', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '62.000'} [2024-08-06 04:32:54,246][52794] DAMAGECOUNT value on done: 529611.0 [2024-08-06 04:32:54,247][52794] Sum rewards: 86.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.125', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '70.000'} [2024-08-06 04:32:54,828][52659] DAMAGECOUNT value on done: 533329.0 [2024-08-06 04:32:54,829][52659] Sum rewards: 79.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.485', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.028', 'weapon4': '0.060', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '64.000'} [2024-08-06 04:32:55,071][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:32:55,887][52650] Updated weights for policy 0, policy_version 54301 (0.0017) [2024-08-06 04:32:56,026][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:32:56,184][52803] DAMAGECOUNT value on done: 500749.0 [2024-08-06 04:32:56,185][52803] Sum rewards: 75.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.930', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.245', 'weapon5': '0.256', 'AMMO4': '0.283', 'weapon2': '0.384', 'weapon4': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.578', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '64.000'} [2024-08-06 04:32:56,314][52665] DAMAGECOUNT value on done: 523437.0 [2024-08-06 04:32:56,314][52665] Sum rewards: 76.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.052', 'AMMO4': '0.141', 'weapon5': '0.156', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '65.000'} [2024-08-06 04:32:56,400][52811] DAMAGECOUNT value on done: 497707.0 [2024-08-06 04:32:56,401][52811] Sum rewards: 74.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.759', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.115', 'weapon5': '0.134', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.074', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '63.000'} [2024-08-06 04:32:56,637][52660] DAMAGECOUNT value on done: 520566.0 [2024-08-06 04:32:56,640][52660] Sum rewards: 54.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'weapon5': '0.042', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.388', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '46.000'} [2024-08-06 04:32:57,272][52794] DAMAGECOUNT value on done: 527886.0 [2024-08-06 04:32:57,274][52794] Sum rewards: 57.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.728', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.208', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '51.000'} [2024-08-06 04:32:57,794][52567] Fps is (10 sec: 17207.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 444866560. Throughput: 0: 4383.3. Samples: 111226200. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 04:32:57,794][52567] Avg episode reward: [(0, '70.270')] [2024-08-06 04:32:57,890][52659] DAMAGECOUNT value on done: 529222.0 [2024-08-06 04:32:57,890][52659] Sum rewards: 64.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.662', 'AMMO5': '0.026', 'AMMO2': '0.068', 'weapon4': '0.166', 'weapon2': '0.258', 'AMMO3': '0.270', 'weapon5': '0.336', 'AMMO4': '0.343', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'HITCOUNT': '2.730', 'weapon3': '2.900', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '54.000'} [2024-08-06 04:32:59,278][52803] DAMAGECOUNT value on done: 502122.0 [2024-08-06 04:32:59,279][52803] Sum rewards: 76.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.573', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.120', 'weapon5': '0.174', 'AMMO4': '0.188', 'weapon2': '0.188', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '63.000'} [2024-08-06 04:32:59,483][52665] DAMAGECOUNT value on done: 521604.0 [2024-08-06 04:32:59,486][52665] Sum rewards: 80.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.114', 'AMMO5': '0.023', 'AMMO2': '0.030', 'weapon4': '0.082', 'AMMO4': '0.148', 'AMMO3': '0.189', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon2': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '64.000'} [2024-08-06 04:32:59,572][52811] DAMAGECOUNT value on done: 498404.0 [2024-08-06 04:32:59,573][52811] Sum rewards: 74.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.345', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.116', 'AMMO4': '0.119', 'AMMO3': '0.194', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '60.000'} [2024-08-06 04:32:59,892][52650] Updated weights for policy 0, policy_version 54311 (0.0023) [2024-08-06 04:33:00,031][52794] DAMAGECOUNT value on done: 529873.0 [2024-08-06 04:33:00,032][52794] Sum rewards: 62.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.012', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '53.000'} [2024-08-06 04:33:00,898][52659] DAMAGECOUNT value on done: 531162.0 [2024-08-06 04:33:00,906][52659] Sum rewards: 79.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.314', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.122', 'weapon4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:02,354][52803] DAMAGECOUNT value on done: 498535.0 [2024-08-06 04:33:02,355][52803] Sum rewards: 75.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '62.000'} [2024-08-06 04:33:02,475][52794] DAMAGECOUNT value on done: 539673.0 [2024-08-06 04:33:02,475][52794] Sum rewards: 62.582, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.228', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.160', 'AMMO4': '0.218', 'weapon2': '0.226', 'weapon5': '0.254', 'AMMO3': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.870', 'weapon3': '3.052', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:02,483][52665] DAMAGECOUNT value on done: 525058.0 [2024-08-06 04:33:02,483][52665] Sum rewards: 67.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.051', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.116', 'AMMO3': '0.236', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.442', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:02,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 444964864. Throughput: 0: 4375.6. Samples: 111238940. Policy #0 lag: (min: 1.0, avg: 3.2, max: 8.0) [2024-08-06 04:33:02,794][52567] Avg episode reward: [(0, '70.953')] [2024-08-06 04:33:02,887][52811] DAMAGECOUNT value on done: 507824.0 [2024-08-06 04:33:02,887][52811] Sum rewards: 72.496, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.504', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.170', 'weapon2': '0.808', 'WEAPON3': '1.000', 'weapon3': '2.790', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '57.000'} [2024-08-06 04:33:03,751][52659] DAMAGECOUNT value on done: 532010.0 [2024-08-06 04:33:03,753][52659] Sum rewards: 69.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.792', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.090', 'weapon5': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '59.000'} [2024-08-06 04:33:05,165][52650] Updated weights for policy 0, policy_version 54321 (0.0026) [2024-08-06 04:33:05,414][52803] DAMAGECOUNT value on done: 488876.0 [2024-08-06 04:33:05,417][52803] Sum rewards: 73.325, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.805', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.128', 'weapon5': '0.128', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.730', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:05,619][52794] DAMAGECOUNT value on done: 526934.0 [2024-08-06 04:33:05,619][52794] Sum rewards: 68.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.166', 'AMMO4': '0.217', 'AMMO3': '0.227', 'weapon4': '0.342', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.700', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '57.000'} [2024-08-06 04:33:05,693][52665] DAMAGECOUNT value on done: 521740.0 [2024-08-06 04:33:05,694][52665] Sum rewards: 68.714, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.899', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'weapon4': '0.114', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'HITCOUNT': '3.400', 'weapon3': '3.414', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:06,099][52811] DAMAGECOUNT value on done: 495206.0 [2024-08-06 04:33:06,100][52811] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.168', 'weapon2': '0.192', 'AMMO4': '0.198', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.282', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:06,787][52659] DAMAGECOUNT value on done: 530342.0 [2024-08-06 04:33:06,788][52659] Sum rewards: 75.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.120', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'weapon2': '0.302', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:07,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 445046784. Throughput: 0: 4375.1. Samples: 111265400. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:33:07,795][52567] Avg episode reward: [(0, '70.764')] [2024-08-06 04:33:08,533][52803] DAMAGECOUNT value on done: 492392.0 [2024-08-06 04:33:08,533][52803] Sum rewards: 75.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.569', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO3': '0.190', 'AMMO4': '0.232', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '64.000'} [2024-08-06 04:33:08,740][52794] DAMAGECOUNT value on done: 535458.0 [2024-08-06 04:33:08,744][52794] Sum rewards: 61.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.124', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.144', 'AMMO3': '0.193', 'AMMO4': '0.230', 'weapon5': '0.230', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.618', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '51.500'} [2024-08-06 04:33:08,823][52671] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:33:08,847][52665] DAMAGECOUNT value on done: 525959.0 [2024-08-06 04:33:08,847][52665] Sum rewards: 75.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.055', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.111', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '63.000'} [2024-08-06 04:33:08,855][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:33:09,265][52650] Updated weights for policy 0, policy_version 54331 (0.0019) [2024-08-06 04:33:09,359][52811] DAMAGECOUNT value on done: 493783.0 [2024-08-06 04:33:09,360][52811] Sum rewards: 65.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.222', 'AMMO4': '0.242', 'weapon4': '0.242', 'AMMO3': '0.255', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '2.956', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:09,715][52659] DAMAGECOUNT value on done: 537079.0 [2024-08-06 04:33:09,717][52659] Sum rewards: 67.970, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.920', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.144', 'weapon4': '0.152', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON3': '1.700', 'weapon3': '3.184', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:11,413][52665] DAMAGECOUNT value on done: 526783.0 [2024-08-06 04:33:11,421][52665] Sum rewards: 75.304, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.620', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.100', 'weapon2': '0.172', 'weapon4': '0.188', 'AMMO3': '0.289', 'WEAPON3': '1.800', 'weapon3': '3.388', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:11,571][52803] DAMAGECOUNT value on done: 490740.0 [2024-08-06 04:33:11,571][52803] Sum rewards: 74.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.122', 'AMMO4': '0.218', 'AMMO3': '0.261', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '64.000'} [2024-08-06 04:33:11,755][52794] DAMAGECOUNT value on done: 532717.0 [2024-08-06 04:33:11,755][52794] Sum rewards: 64.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.125', 'weapon2': '0.146', 'weapon5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.336', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:12,459][52811] DAMAGECOUNT value on done: 498881.0 [2024-08-06 04:33:12,461][52811] Sum rewards: 83.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '69.000'} [2024-08-06 04:33:12,623][52659] DAMAGECOUNT value on done: 541078.0 [2024-08-06 04:33:12,625][52659] Sum rewards: 80.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.306', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.027', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 445128704. Throughput: 0: 4376.2. Samples: 111291910. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:33:12,794][52567] Avg episode reward: [(0, '70.834')] [2024-08-06 04:33:14,131][52650] Updated weights for policy 0, policy_version 54341 (0.0013) [2024-08-06 04:33:14,573][52803] DAMAGECOUNT value on done: 495410.0 [2024-08-06 04:33:14,573][52803] Sum rewards: 79.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.038', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.138', 'AMMO4': '0.188', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:15,136][52659] DAMAGECOUNT value on done: 529988.0 [2024-08-06 04:33:15,136][52659] Sum rewards: 74.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.366', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '63.000'} [2024-08-06 04:33:15,251][52794] DAMAGECOUNT value on done: 527388.0 [2024-08-06 04:33:15,251][52794] Sum rewards: 88.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.078', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.240', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '73.000'} [2024-08-06 04:33:15,582][52811] DAMAGECOUNT value on done: 494336.0 [2024-08-06 04:33:15,582][52811] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'weapon4': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.406', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:17,681][52803] DAMAGECOUNT value on done: 487528.0 [2024-08-06 04:33:17,682][52803] Sum rewards: 70.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.649', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.156', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.520', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '57.000'} [2024-08-06 04:33:17,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 445218816. Throughput: 0: 4384.9. Samples: 111305040. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:33:17,795][52567] Avg episode reward: [(0, '71.132')] [2024-08-06 04:33:18,127][52659] DAMAGECOUNT value on done: 534946.0 [2024-08-06 04:33:18,127][52659] Sum rewards: 62.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.122', 'weapon5': '0.154', 'AMMO3': '0.208', 'AMMO4': '0.216', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.172', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '54.000'} [2024-08-06 04:33:18,170][52794] DAMAGECOUNT value on done: 532961.0 [2024-08-06 04:33:18,170][52794] Sum rewards: 72.135, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.743', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.095', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.212', 'WEAPON3': '1.300', 'HITCOUNT': '3.430', 'weapon3': '3.480', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.000'} [2024-08-06 04:33:18,755][52811] DAMAGECOUNT value on done: 499757.0 [2024-08-06 04:33:18,756][52811] Sum rewards: 86.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.912', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.122', 'AMMO3': '0.201', 'weapon2': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.438', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.955', 'FRAGCOUNT': '69.000'} [2024-08-06 04:33:19,107][52650] Updated weights for policy 0, policy_version 54351 (0.0019) [2024-08-06 04:33:20,942][52803] DAMAGECOUNT value on done: 503728.0 [2024-08-06 04:33:20,942][52803] Sum rewards: 68.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon7': '0.060', 'weapon5': '0.072', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.168', 'WEAPON7': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.360', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.146', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '57.000'} [2024-08-06 04:33:21,027][52794] DAMAGECOUNT value on done: 527773.0 [2024-08-06 04:33:21,028][52794] Sum rewards: 77.520, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.970', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO3': '0.136', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.710', 'WEAPON3': '0.950', 'weapon3': '2.912', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:21,152][52659] DAMAGECOUNT value on done: 526276.0 [2024-08-06 04:33:21,152][52659] Sum rewards: 73.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.858', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.187', 'weapon4': '0.208', 'AMMO4': '0.319', 'weapon5': '0.374', 'weapon2': '0.464', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.600', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 04:33:21,908][52811] DAMAGECOUNT value on done: 502159.0 [2024-08-06 04:33:21,911][52811] Sum rewards: 81.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.955', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.080', 'AMMO4': '0.139', 'weapon5': '0.152', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '66.000'} [2024-08-06 04:33:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 445317120. Throughput: 0: 4387.1. Samples: 111331490. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:33:22,794][52567] Avg episode reward: [(0, '71.673')] [2024-08-06 04:33:23,691][52650] Updated weights for policy 0, policy_version 54361 (0.0013) [2024-08-06 04:33:24,037][52803] DAMAGECOUNT value on done: 497749.0 [2024-08-06 04:33:24,038][52803] Sum rewards: 59.898, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.271', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.080', 'weapon5': '0.168', 'AMMO4': '0.211', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '52.000'} [2024-08-06 04:33:24,219][52794] DAMAGECOUNT value on done: 546529.0 [2024-08-06 04:33:24,221][52794] Sum rewards: 74.937, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.809', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.052', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:24,221][52659] DAMAGECOUNT value on done: 531110.0 [2024-08-06 04:33:24,223][52659] Sum rewards: 64.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.278', 'weapon2': '0.446', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '57.000'} [2024-08-06 04:33:25,113][52811] DAMAGECOUNT value on done: 494725.0 [2024-08-06 04:33:25,115][52811] Sum rewards: 83.017, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.388', 'HEALTH': '0.708', 'WEAPON3': '0.800', 'weapon3': '3.128', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '63.000'} [2024-08-06 04:33:25,915][52671] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:33:26,835][52659] DAMAGECOUNT value on done: 542830.0 [2024-08-06 04:33:26,837][52659] Sum rewards: 69.519, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.785', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.104', 'AMMO3': '0.153', 'weapon5': '0.178', 'AMMO4': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.660', 'WEAPON3': '1.000', 'weapon3': '2.854', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:27,097][52803] DAMAGECOUNT value on done: 492733.0 [2024-08-06 04:33:27,098][52803] Sum rewards: 67.660, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.822', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.052', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'weapon3': '3.304', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:27,281][52794] DAMAGECOUNT value on done: 525856.0 [2024-08-06 04:33:27,283][52794] Sum rewards: 69.246, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.485', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.068', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon2': '0.448', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.122', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 445399040. Throughput: 0: 4390.0. Samples: 111357650. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:33:27,802][52567] Avg episode reward: [(0, '71.812')] [2024-08-06 04:33:28,022][52650] Updated weights for policy 0, policy_version 54371 (0.0012) [2024-08-06 04:33:28,273][52811] DAMAGECOUNT value on done: 495340.0 [2024-08-06 04:33:28,274][52811] Sum rewards: 69.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.783', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.070', 'AMMO4': '0.140', 'weapon5': '0.238', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '59.000'} [2024-08-06 04:33:29,085][52663] DAMAGECOUNT value on done: 541320.0 [2024-08-06 04:33:29,086][52663] Sum rewards: 68.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.154', 'weapon5': '0.216', 'AMMO4': '0.239', 'AMMO3': '0.270', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.850', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:29,615][52794] DAMAGECOUNT value on done: 542224.0 [2024-08-06 04:33:29,616][52794] Sum rewards: 69.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.232', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.528', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:29,644][52659] DAMAGECOUNT value on done: 535014.0 [2024-08-06 04:33:29,644][52659] Sum rewards: 76.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.179', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '62.000'} [2024-08-06 04:33:30,222][52803] DAMAGECOUNT value on done: 503996.0 [2024-08-06 04:33:30,225][52803] Sum rewards: 88.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.551', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.288', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '21.387', 'FRAGCOUNT': '73.000'} [2024-08-06 04:33:31,454][52614] Signal inference workers to stop experience collection... (9900 times) [2024-08-06 04:33:31,462][52614] Signal inference workers to resume experience collection... (9900 times) [2024-08-06 04:33:31,542][52650] InferenceWorker_p0-w0: stopping experience collection (9900 times) [2024-08-06 04:33:31,542][52650] InferenceWorker_p0-w0: resuming experience collection (9900 times) [2024-08-06 04:33:32,212][52663] DAMAGECOUNT value on done: 532630.0 [2024-08-06 04:33:32,213][52663] Sum rewards: 67.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.419', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.246', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.366', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:32,383][52794] DAMAGECOUNT value on done: 533393.0 [2024-08-06 04:33:32,384][52794] Sum rewards: 76.387, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.183', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '63.000'} [2024-08-06 04:33:32,746][52659] DAMAGECOUNT value on done: 540677.0 [2024-08-06 04:33:32,746][52659] Sum rewards: 71.405, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.114', 'AMMO5': '0.023', 'AMMO2': '0.052', 'AMMO3': '0.228', 'weapon4': '0.246', 'AMMO4': '0.261', 'weapon5': '0.262', 'WEAPON5': '0.450', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.684', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '60.000'} [2024-08-06 04:33:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 445480960. Throughput: 0: 4388.9. Samples: 111370910. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:33:32,794][52567] Avg episode reward: [(0, '71.789')] [2024-08-06 04:33:33,241][52650] Updated weights for policy 0, policy_version 54381 (0.0034) [2024-08-06 04:33:33,346][52803] DAMAGECOUNT value on done: 495565.0 [2024-08-06 04:33:33,347][52803] Sum rewards: 63.157, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.850', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.172', 'AMMO4': '0.230', 'weapon4': '0.234', 'AMMO3': '0.274', 'weapon2': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.974', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:33,615][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:33:35,031][52663] DAMAGECOUNT value on done: 522323.0 [2024-08-06 04:33:35,033][52663] Sum rewards: 68.368, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.595', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO3': '0.188', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.114', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:35,100][52794] DAMAGECOUNT value on done: 541762.0 [2024-08-06 04:33:35,100][52794] Sum rewards: 67.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.439', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.174', 'AMMO3': '0.270', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.350', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '59.000'} [2024-08-06 04:33:35,926][52659] DAMAGECOUNT value on done: 533549.0 [2024-08-06 04:33:35,928][52659] Sum rewards: 71.809, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.148', 'weapon5': '0.208', 'AMMO4': '0.214', 'AMMO3': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '2.896', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '60.000'} [2024-08-06 04:33:36,226][52649] DAMAGECOUNT value on done: 516065.0 [2024-08-06 04:33:36,228][52649] Sum rewards: 58.023, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.185', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.146', 'AMMO3': '0.166', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.674', 'WEAPON3': '1.000', 'weapon3': '2.814', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '46.000'} [2024-08-06 04:33:36,540][52803] DAMAGECOUNT value on done: 494704.0 [2024-08-06 04:33:36,540][52803] Sum rewards: 83.488, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.735', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.126', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.208', 'weapon2': '0.256', 'WEAPON3': '0.900', 'weapon3': '3.306', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:37,477][52650] Updated weights for policy 0, policy_version 54391 (0.0018) [2024-08-06 04:33:37,689][52663] DAMAGECOUNT value on done: 529418.0 [2024-08-06 04:33:37,691][52663] Sum rewards: 52.042, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.820', 'AMMO5': '0.016', 'AMMO2': '0.063', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'weapon2': '0.170', 'WEAPON7': '0.200', 'weapon5': '0.244', 'weapon7': '0.276', 'AMMO4': '0.315', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'weapon4': '1.218', 'weapon3': '1.784', 'HITCOUNT': '2.140', 'DAMAGECOUNT': '13.107', 'FRAGCOUNT': '41.000'} [2024-08-06 04:33:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 445571072. Throughput: 0: 4382.4. Samples: 111397050. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:33:37,794][52567] Avg episode reward: [(0, '71.634')] [2024-08-06 04:33:38,342][52794] DAMAGECOUNT value on done: 542303.0 [2024-08-06 04:33:38,344][52794] Sum rewards: 79.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.496', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.126', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 04:33:38,577][52659] DAMAGECOUNT value on done: 536870.0 [2024-08-06 04:33:38,578][52659] Sum rewards: 72.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.189', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.078', 'AMMO4': '0.164', 'weapon5': '0.178', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:38,716][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:33:39,449][52803] DAMAGECOUNT value on done: 499228.0 [2024-08-06 04:33:39,449][52803] Sum rewards: 64.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.998', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.178', 'weapon5': '0.186', 'AMMO3': '0.188', 'weapon2': '0.234', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.234', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '52.000'} [2024-08-06 04:33:39,475][52649] DAMAGECOUNT value on done: 509261.0 [2024-08-06 04:33:39,476][52649] Sum rewards: 67.354, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.999', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.130', 'weapon5': '0.154', 'AMMO4': '0.170', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.232', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:40,061][52666] DAMAGECOUNT value on done: 531625.0 [2024-08-06 04:33:40,064][52666] Sum rewards: 74.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.954', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.136', 'AMMO4': '0.212', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '64.000'} [2024-08-06 04:33:40,478][52663] DAMAGECOUNT value on done: 532938.0 [2024-08-06 04:33:40,479][52663] Sum rewards: 78.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.290', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.216', 'weapon2': '0.238', 'WEAPON3': '1.200', 'weapon3': '3.574', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:41,269][52794] DAMAGECOUNT value on done: 529952.0 [2024-08-06 04:33:41,270][52794] Sum rewards: 81.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.565', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.358', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '67.000'} [2024-08-06 04:33:41,464][52659] DAMAGECOUNT value on done: 533269.0 [2024-08-06 04:33:41,466][52659] Sum rewards: 68.267, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.594', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO3': '0.145', 'weapon4': '0.166', 'AMMO4': '0.193', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:42,164][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:33:42,302][52650] Updated weights for policy 0, policy_version 54401 (0.0013) [2024-08-06 04:33:42,468][52803] DAMAGECOUNT value on done: 499424.0 [2024-08-06 04:33:42,469][52803] Sum rewards: 70.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.178', 'weapon5': '0.188', 'AMMO3': '0.233', 'AMMO4': '0.249', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '59.000'} [2024-08-06 04:33:42,590][52670] DAMAGECOUNT value on done: 521817.0 [2024-08-06 04:33:42,590][52670] Sum rewards: 50.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.238', 'weapon2': '0.256', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.382', 'DAMAGECOUNT': '13.521', 'FRAGCOUNT': '44.000'} [2024-08-06 04:33:42,700][52649] DAMAGECOUNT value on done: 524797.0 [2024-08-06 04:33:42,702][52649] Sum rewards: 69.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.118', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.184', 'AMMO3': '0.203', 'AMMO4': '0.218', 'weapon2': '0.238', 'weapon4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 445661184. Throughput: 0: 4378.0. Samples: 111423210. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 04:33:42,802][52567] Avg episode reward: [(0, '71.807')] [2024-08-06 04:33:42,819][52666] DAMAGECOUNT value on done: 534157.0 [2024-08-06 04:33:42,822][52666] Sum rewards: 67.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.362', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.169', 'weapon2': '0.952', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '54.000'} [2024-08-06 04:33:43,788][52663] DAMAGECOUNT value on done: 539446.0 [2024-08-06 04:33:43,788][52663] Sum rewards: 81.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.222', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '67.000'} [2024-08-06 04:33:45,079][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:33:45,574][52649] DAMAGECOUNT value on done: 520727.0 [2024-08-06 04:33:45,574][52649] Sum rewards: 71.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.160', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.142', 'AMMO3': '0.152', 'weapon5': '0.182', 'AMMO4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '0.900', 'weapon3': '3.026', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:45,580][52803] DAMAGECOUNT value on done: 502806.0 [2024-08-06 04:33:45,582][52803] Sum rewards: 77.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.838', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.207', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '62.000'} [2024-08-06 04:33:45,668][52670] DAMAGECOUNT value on done: 533324.0 [2024-08-06 04:33:45,671][52670] Sum rewards: 75.098, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.675', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.319', 'WEAPON3': '1.950', 'weapon3': '3.376', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '66.000'} [2024-08-06 04:33:45,883][52666] DAMAGECOUNT value on done: 535432.0 [2024-08-06 04:33:45,884][52666] Sum rewards: 71.160, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.654', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.160', 'weapon5': '0.224', 'AMMO3': '0.273', 'AMMO4': '0.286', 'weapon2': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.924', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.500'} [2024-08-06 04:33:46,050][52667] DAMAGECOUNT value on done: 535626.0 [2024-08-06 04:33:46,051][52667] Sum rewards: 76.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.094', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.694', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '62.500'} [2024-08-06 04:33:46,484][52663] DAMAGECOUNT value on done: 534616.0 [2024-08-06 04:33:46,485][52663] Sum rewards: 73.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'AMMO5': '0.016', 'AMMO2': '0.074', 'weapon4': '0.094', 'weapon5': '0.170', 'AMMO3': '0.219', 'AMMO4': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '60.500'} [2024-08-06 04:33:46,758][52650] Updated weights for policy 0, policy_version 54411 (0.0026) [2024-08-06 04:33:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.5, 300 sec: 17494.8). Total num frames: 445751296. Throughput: 0: 4390.9. Samples: 111436530. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 04:33:47,794][52567] Avg episode reward: [(0, '72.003')] [2024-08-06 04:33:48,480][52649] DAMAGECOUNT value on done: 510492.0 [2024-08-06 04:33:48,482][52649] Sum rewards: 67.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO4': '0.151', 'weapon5': '0.190', 'weapon2': '0.220', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.308', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '57.000'} [2024-08-06 04:33:48,690][52670] DAMAGECOUNT value on done: 525660.0 [2024-08-06 04:33:48,691][52670] Sum rewards: 73.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.985', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.270', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.334', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '62.000'} [2024-08-06 04:33:48,692][52803] DAMAGECOUNT value on done: 492975.0 [2024-08-06 04:33:48,692][52803] Sum rewards: 80.926, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.132', 'AMMO4': '0.168', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'HEALTH': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.410', 'WEAPON3': '1.000', 'weapon3': '2.930', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:48,809][52666] DAMAGECOUNT value on done: 533336.0 [2024-08-06 04:33:48,810][52666] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.066', 'AMMO5': '0.024', 'AMMO2': '0.059', 'AMMO3': '0.180', 'weapon5': '0.242', 'AMMO4': '0.294', 'weapon4': '0.410', 'weapon2': '0.486', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.516', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:48,863][52667] DAMAGECOUNT value on done: 544340.0 [2024-08-06 04:33:48,863][52667] Sum rewards: 69.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.003', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.092', 'AMMO3': '0.186', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.312', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:49,738][52663] DAMAGECOUNT value on done: 529066.0 [2024-08-06 04:33:49,739][52663] Sum rewards: 76.633, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.118', 'AMMO4': '0.192', 'HEALTH': '0.196', 'AMMO3': '0.208', 'weapon5': '0.216', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '62.000'} [2024-08-06 04:33:51,120][52659] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.012, -4.0), ('weapon5', 0.002)] [2024-08-06 04:33:51,362][52649] DAMAGECOUNT value on done: 521636.0 [2024-08-06 04:33:51,362][52649] Sum rewards: 67.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'AMMO2': '0.066', 'weapon4': '0.112', 'weapon5': '0.146', 'AMMO3': '0.196', 'AMMO4': '0.330', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '54.000'} [2024-08-06 04:33:51,415][52670] DAMAGECOUNT value on done: 526005.0 [2024-08-06 04:33:51,417][52670] Sum rewards: 71.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.262', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.072', 'weapon5': '0.076', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 04:33:51,575][52666] DAMAGECOUNT value on done: 531500.0 [2024-08-06 04:33:51,576][52666] Sum rewards: 67.428, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.082', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2024-08-06 04:33:51,819][52650] Updated weights for policy 0, policy_version 54421 (0.0023) [2024-08-06 04:33:52,098][52667] DAMAGECOUNT value on done: 533665.0 [2024-08-06 04:33:52,098][52667] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.142', 'AMMO3': '0.247', 'AMMO4': '0.284', 'weapon5': '0.290', 'weapon2': '0.316', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '62.000'} [2024-08-06 04:33:52,747][52663] DAMAGECOUNT value on done: 526150.0 [2024-08-06 04:33:52,748][52663] Sum rewards: 67.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.554', 'AMMO5': '0.026', 'AMMO2': '0.073', 'AMMO3': '0.156', 'weapon5': '0.290', 'AMMO4': '0.366', 'weapon4': '0.402', 'weapon2': '0.586', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '0.950', 'weapon3': '2.418', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 445833216. Throughput: 0: 4384.5. Samples: 111462700. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 04:33:52,802][52567] Avg episode reward: [(0, '71.830')] [2024-08-06 04:33:54,172][52670] DAMAGECOUNT value on done: 537005.0 [2024-08-06 04:33:54,172][52670] Sum rewards: 69.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.156', 'weapon4': '0.162', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:54,310][52649] DAMAGECOUNT value on done: 518656.0 [2024-08-06 04:33:54,311][52649] Sum rewards: 81.552, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.215', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.122', 'AMMO4': '0.129', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.316', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '66.000'} [2024-08-06 04:33:54,335][52666] DAMAGECOUNT value on done: 526151.0 [2024-08-06 04:33:54,338][52666] Sum rewards: 75.429, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.246', 'WEAPON3': '1.550', 'weapon3': '3.490', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '65.000'} [2024-08-06 04:33:55,092][52667] DAMAGECOUNT value on done: 534734.0 [2024-08-06 04:33:55,093][52667] Sum rewards: 72.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.974', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon4': '0.108', 'AMMO4': '0.166', 'weapon5': '0.182', 'weapon2': '0.224', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '62.000'} [2024-08-06 04:33:55,723][52663] DAMAGECOUNT value on done: 533968.0 [2024-08-06 04:33:55,723][52663] Sum rewards: 69.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.894', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.524', 'WEAPON3': '1.550', 'weapon3': '3.174', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 04:33:55,821][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:33:56,227][52650] Updated weights for policy 0, policy_version 54431 (0.0031) [2024-08-06 04:33:57,441][52670] DAMAGECOUNT value on done: 531028.0 [2024-08-06 04:33:57,443][52670] Sum rewards: 68.504, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.134', 'AMMO3': '0.149', 'weapon4': '0.192', 'AMMO4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '54.000'} [2024-08-06 04:33:57,492][52649] DAMAGECOUNT value on done: 522100.0 [2024-08-06 04:33:57,492][52649] Sum rewards: 68.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.239', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.354', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '58.000'} [2024-08-06 04:33:57,553][52666] DAMAGECOUNT value on done: 530474.0 [2024-08-06 04:33:57,554][52666] Sum rewards: 68.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.273', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.181', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2024-08-06 04:33:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 445915136. Throughput: 0: 4373.1. Samples: 111488700. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 04:33:57,794][52567] Avg episode reward: [(0, '71.515')] [2024-08-06 04:33:58,012][52667] DAMAGECOUNT value on done: 539264.0 [2024-08-06 04:33:58,014][52667] Sum rewards: 68.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'weapon4': '0.500', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.666', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '56.000'} [2024-08-06 04:33:58,420][52663] DAMAGECOUNT value on done: 540302.0 [2024-08-06 04:33:58,421][52663] Sum rewards: 55.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.116', 'weapon4': '0.178', 'AMMO4': '0.197', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '3.222', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '48.000'} [2024-08-06 04:33:58,542][52660] Large shaping reward 2.530 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.498, 166.0), ('weapon3', 0.002)] [2024-08-06 04:34:00,528][52649] DAMAGECOUNT value on done: 524646.0 [2024-08-06 04:34:00,528][52649] Sum rewards: 81.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.705', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.184', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:00,582][52670] DAMAGECOUNT value on done: 519661.0 [2024-08-06 04:34:00,585][52670] Sum rewards: 68.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.340', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.104', 'weapon5': '0.148', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.210', 'weapon3': '3.232', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '56.000'} [2024-08-06 04:34:00,699][52666] DAMAGECOUNT value on done: 529364.0 [2024-08-06 04:34:00,700][52666] Sum rewards: 74.568, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.632', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:01,244][52667] DAMAGECOUNT value on done: 543329.0 [2024-08-06 04:34:01,246][52667] Sum rewards: 63.340, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.104', 'AMMO4': '0.183', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.350', 'HEALTH': '0.470', 'WEAPON3': '1.000', 'HITCOUNT': '2.950', 'weapon3': '2.996', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '53.000'} [2024-08-06 04:34:01,355][52650] Updated weights for policy 0, policy_version 54441 (0.0013) [2024-08-06 04:34:01,641][52663] DAMAGECOUNT value on done: 528179.0 [2024-08-06 04:34:01,641][52663] Sum rewards: 58.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.164', 'weapon7': '0.192', 'AMMO4': '0.214', 'AMMO3': '0.216', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.920', 'WEAPON3': '1.200', 'weapon3': '2.164', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '13.437', 'FRAGCOUNT': '51.000'} [2024-08-06 04:34:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 446013440. Throughput: 0: 4367.3. Samples: 111501570. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 04:34:02,794][52567] Avg episode reward: [(0, '71.524')] [2024-08-06 04:34:03,535][52670] DAMAGECOUNT value on done: 529754.0 [2024-08-06 04:34:03,536][52670] Sum rewards: 75.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon5': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:03,719][52666] DAMAGECOUNT value on done: 529998.0 [2024-08-06 04:34:03,719][52666] Sum rewards: 70.322, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.585', 'AMMO5': '0.008', 'AMMO2': '0.033', 'AMMO3': '0.116', 'weapon5': '0.134', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.368', 'weapon2': '0.376', 'WEAPON3': '0.850', 'weapon3': '2.972', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '54.000'} [2024-08-06 04:34:03,728][52649] DAMAGECOUNT value on done: 515953.0 [2024-08-06 04:34:03,729][52649] Sum rewards: 60.952, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.076', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon5': '0.296', 'weapon2': '0.516', 'WEAPON3': '1.000', 'HITCOUNT': '2.780', 'weapon3': '2.924', 'DAMAGECOUNT': '14.451', 'FRAGCOUNT': '49.000'} [2024-08-06 04:34:04,290][52667] DAMAGECOUNT value on done: 536095.0 [2024-08-06 04:34:04,291][52667] Sum rewards: 65.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.344', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '52.000'} [2024-08-06 04:34:04,525][52663] DAMAGECOUNT value on done: 526479.0 [2024-08-06 04:34:04,525][52663] Sum rewards: 70.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.342', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.152', 'AMMO4': '0.164', 'weapon5': '0.212', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:05,570][52650] Updated weights for policy 0, policy_version 54451 (0.0014) [2024-08-06 04:34:06,625][52670] DAMAGECOUNT value on done: 524121.0 [2024-08-06 04:34:06,626][52670] Sum rewards: 73.064, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.718', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.600', 'weapon3': '3.238', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '63.000'} [2024-08-06 04:34:06,818][52666] DAMAGECOUNT value on done: 524572.0 [2024-08-06 04:34:06,820][52666] Sum rewards: 67.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.056', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.268', 'weapon2': '0.406', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:06,956][52649] DAMAGECOUNT value on done: 524779.0 [2024-08-06 04:34:06,956][52649] Sum rewards: 61.453, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.371', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.164', 'weapon4': '0.198', 'AMMO4': '0.239', 'AMMO3': '0.269', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '56.000'} [2024-08-06 04:34:07,196][52663] DAMAGECOUNT value on done: 526377.0 [2024-08-06 04:34:07,196][52663] Sum rewards: 74.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.988', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.035', 'weapon5': '0.092', 'AMMO4': '0.176', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'weapon4': '0.388', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.796', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '63.000'} [2024-08-06 04:34:07,388][52667] DAMAGECOUNT value on done: 531158.0 [2024-08-06 04:34:07,389][52667] Sum rewards: 71.140, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.136', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'weapon2': '0.480', 'WEAPON3': '1.700', 'weapon3': '3.012', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 446087168. Throughput: 0: 4359.5. Samples: 111527670. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 04:34:07,795][52567] Avg episode reward: [(0, '71.411')] [2024-08-06 04:34:09,748][52670] DAMAGECOUNT value on done: 524953.0 [2024-08-06 04:34:09,748][52670] Sum rewards: 79.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.068', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.080', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:09,811][52663] DAMAGECOUNT value on done: 527192.0 [2024-08-06 04:34:09,811][52663] Sum rewards: 57.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.484', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon4': '0.210', 'weapon5': '0.220', 'AMMO3': '0.250', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.710', 'weapon3': '2.896', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '49.500'} [2024-08-06 04:34:09,985][52666] DAMAGECOUNT value on done: 529599.0 [2024-08-06 04:34:09,986][52666] Sum rewards: 71.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.047', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.122', 'weapon2': '0.188', 'AMMO3': '0.241', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.490', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:10,126][52649] DAMAGECOUNT value on done: 529338.0 [2024-08-06 04:34:10,130][52649] Sum rewards: 82.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.212', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'weapon3': '3.552', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '69.000'} [2024-08-06 04:34:10,256][52667] DAMAGECOUNT value on done: 540451.0 [2024-08-06 04:34:10,257][52667] Sum rewards: 83.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '68.000'} [2024-08-06 04:34:10,539][52650] Updated weights for policy 0, policy_version 54461 (0.0031) [2024-08-06 04:34:12,619][52663] DAMAGECOUNT value on done: 538736.0 [2024-08-06 04:34:12,620][52663] Sum rewards: 74.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.351', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.096', 'AMMO3': '0.177', 'weapon5': '0.218', 'AMMO4': '0.245', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '58.000'} [2024-08-06 04:34:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 446177280. Throughput: 0: 4365.8. Samples: 111554110. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 04:34:12,794][52567] Avg episode reward: [(0, '71.677')] [2024-08-06 04:34:12,825][52670] DAMAGECOUNT value on done: 532416.0 [2024-08-06 04:34:12,827][52670] Sum rewards: 75.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.591', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.110', 'AMMO3': '0.218', 'weapon5': '0.220', 'AMMO4': '0.223', 'weapon2': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:13,010][52666] DAMAGECOUNT value on done: 523615.0 [2024-08-06 04:34:13,011][52666] Sum rewards: 64.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.099', 'ARMOR': '0.008', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.166', 'weapon5': '0.176', 'AMMO3': '0.177', 'AMMO4': '0.242', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.752', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '53.500'} [2024-08-06 04:34:13,179][52667] DAMAGECOUNT value on done: 542089.0 [2024-08-06 04:34:13,183][52667] Sum rewards: 70.981, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.695', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.193', 'AMMO4': '0.194', 'weapon2': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '58.000'} [2024-08-06 04:34:13,603][52649] DAMAGECOUNT value on done: 529092.0 [2024-08-06 04:34:13,605][52649] Sum rewards: 50.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon4': '0.038', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.200', 'HITCOUNT': '2.750', 'weapon3': '3.162', 'DAMAGECOUNT': '13.479', 'FRAGCOUNT': '43.000'} [2024-08-06 04:34:15,488][52663] DAMAGECOUNT value on done: 525049.0 [2024-08-06 04:34:15,496][52650] Updated weights for policy 0, policy_version 54471 (0.0020) [2024-08-06 04:34:15,496][52663] Sum rewards: 55.822, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.162', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '2.840', 'weapon3': '3.188', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '52.000'} [2024-08-06 04:34:15,719][52795] DAMAGECOUNT value on done: 496637.0 [2024-08-06 04:34:15,720][52795] Sum rewards: 81.098, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.382', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.132', 'AMMO3': '0.199', 'weapon5': '0.310', 'AMMO4': '0.312', 'weapon2': '0.442', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:16,046][52667] DAMAGECOUNT value on done: 529829.0 [2024-08-06 04:34:16,050][52667] Sum rewards: 67.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.155', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon2': '0.184', 'weapon5': '0.218', 'weapon4': '0.236', 'AMMO4': '0.268', 'AMMO3': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'HITCOUNT': '3.070', 'weapon3': '3.084', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:16,207][52670] DAMAGECOUNT value on done: 522574.0 [2024-08-06 04:34:16,207][52670] Sum rewards: 78.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:16,523][52666] DAMAGECOUNT value on done: 537963.0 [2024-08-06 04:34:16,524][52666] Sum rewards: 75.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.112', 'AMMO3': '0.192', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.500'} [2024-08-06 04:34:16,618][52649] DAMAGECOUNT value on done: 528538.0 [2024-08-06 04:34:16,620][52649] Sum rewards: 66.102, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.118', 'AMMO4': '0.141', 'weapon5': '0.166', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.450', 'weapon3': '2.804', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:16,714][52647] DAMAGECOUNT value on done: 563732.0 [2024-08-06 04:34:16,714][52647] Sum rewards: 65.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.555', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'weapon2': '0.208', 'weapon5': '0.214', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.256', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '55.000'} [2024-08-06 04:34:16,882][52669] DAMAGECOUNT value on done: 536548.0 [2024-08-06 04:34:16,882][52669] Sum rewards: 49.615, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.650', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.130', 'weapon5': '0.136', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.884', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '40.000'} [2024-08-06 04:34:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 446267392. Throughput: 0: 4345.1. Samples: 111566440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:34:17,794][52567] Avg episode reward: [(0, '70.716')] [2024-08-06 04:34:18,631][52663] DAMAGECOUNT value on done: 537330.0 [2024-08-06 04:34:18,634][52663] Sum rewards: 71.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.122', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '58.000'} [2024-08-06 04:34:18,694][52667] DAMAGECOUNT value on done: 532945.0 [2024-08-06 04:34:18,694][52667] Sum rewards: 79.293, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.312', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.171', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '64.000'} [2024-08-06 04:34:18,699][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:34:18,756][52670] DAMAGECOUNT value on done: 526785.0 [2024-08-06 04:34:18,757][52670] Sum rewards: 70.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.090', 'weapon5': '0.120', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.264', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:18,869][52666] DAMAGECOUNT value on done: 530922.0 [2024-08-06 04:34:18,871][52666] Sum rewards: 68.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2024-08-06 04:34:18,904][52795] DAMAGECOUNT value on done: 485810.0 [2024-08-06 04:34:18,905][52795] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.698', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.152', 'AMMO3': '0.171', 'AMMO4': '0.188', 'weapon5': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.050', 'weapon3': '2.834', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:19,523][52649] DAMAGECOUNT value on done: 514674.0 [2024-08-06 04:34:19,526][52649] Sum rewards: 75.977, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.350', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO3': '0.124', 'AMMO4': '0.126', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.308', 'weapon4': '0.308', 'WEAPON3': '0.800', 'weapon3': '3.062', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:19,848][52647] DAMAGECOUNT value on done: 564285.0 [2024-08-06 04:34:19,849][52647] Sum rewards: 68.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.164', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON4': '0.350', 'weapon4': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '54.500'} [2024-08-06 04:34:20,077][52669] DAMAGECOUNT value on done: 528216.0 [2024-08-06 04:34:20,078][52669] Sum rewards: 70.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.066', 'AMMO4': '0.210', 'weapon5': '0.234', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:20,106][52650] Updated weights for policy 0, policy_version 54481 (0.0019) [2024-08-06 04:34:21,134][52667] DAMAGECOUNT value on done: 539798.0 [2024-08-06 04:34:21,135][52667] Sum rewards: 71.528, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.498', 'AMMO5': '0.014', 'AMMO2': '0.060', 'weapon5': '0.116', 'weapon4': '0.126', 'weapon2': '0.170', 'AMMO3': '0.200', 'AMMO4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.324', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '60.000'} [2024-08-06 04:34:21,173][52670] DAMAGECOUNT value on done: 536865.0 [2024-08-06 04:34:21,176][52670] Sum rewards: 76.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.585', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.466', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:21,291][52666] DAMAGECOUNT value on done: 532275.0 [2024-08-06 04:34:21,294][52666] Sum rewards: 71.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.615', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon2': '0.314', 'WEAPON3': '1.800', 'weapon3': '3.218', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:21,794][52663] DAMAGECOUNT value on done: 536669.0 [2024-08-06 04:34:21,796][52663] Sum rewards: 84.428, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.582', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.036', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.817', 'FRAGCOUNT': '69.000'} [2024-08-06 04:34:22,002][52795] DAMAGECOUNT value on done: 486440.0 [2024-08-06 04:34:22,003][52795] Sum rewards: 80.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.064', 'weapon2': '0.172', 'weapon5': '0.210', 'AMMO3': '0.212', 'weapon4': '0.282', 'AMMO4': '0.322', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '66.000'} [2024-08-06 04:34:22,374][52647] DAMAGECOUNT value on done: 561493.0 [2024-08-06 04:34:22,376][52647] Sum rewards: 82.115, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.181', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon2': '0.132', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'weapon4': '0.362', 'WEAPON3': '0.950', 'weapon3': '3.258', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '64.000'} [2024-08-06 04:34:22,450][52649] DAMAGECOUNT value on done: 524336.0 [2024-08-06 04:34:22,451][52649] Sum rewards: 74.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.116', 'weapon2': '0.232', 'weapon5': '0.232', 'AMMO4': '0.251', 'AMMO3': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 446357504. Throughput: 0: 4343.8. Samples: 111592520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:34:22,794][52567] Avg episode reward: [(0, '71.065')] [2024-08-06 04:34:23,215][52669] DAMAGECOUNT value on done: 540228.0 [2024-08-06 04:34:23,218][52669] Sum rewards: 65.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.794', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.082', 'weapon5': '0.216', 'AMMO4': '0.248', 'AMMO3': '0.266', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '56.000'} [2024-08-06 04:34:23,550][52667] DAMAGECOUNT value on done: 530812.0 [2024-08-06 04:34:23,550][52667] Sum rewards: 72.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.136', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.586', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:24,112][52670] DAMAGECOUNT value on done: 532280.0 [2024-08-06 04:34:24,114][52670] Sum rewards: 73.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.039', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.162', 'weapon5': '0.174', 'AMMO3': '0.246', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:24,195][52666] DAMAGECOUNT value on done: 529434.0 [2024-08-06 04:34:24,196][52666] Sum rewards: 61.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.214', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.118', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '51.000'} [2024-08-06 04:34:24,640][52650] Updated weights for policy 0, policy_version 54491 (0.0047) [2024-08-06 04:34:24,796][52647] DAMAGECOUNT value on done: 570058.0 [2024-08-06 04:34:24,796][52647] Sum rewards: 64.942, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.643', 'AMMO5': '0.025', 'AMMO2': '0.070', 'weapon5': '0.130', 'weapon4': '0.164', 'AMMO3': '0.279', 'AMMO4': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.516', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.848', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '58.000'} [2024-08-06 04:34:24,890][52663] DAMAGECOUNT value on done: 529965.0 [2024-08-06 04:34:24,890][52663] Sum rewards: 69.035, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.050', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.281', 'weapon2': '0.466', 'WEAPON3': '1.700', 'weapon3': '3.152', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '60.000'} [2024-08-06 04:34:25,232][52795] DAMAGECOUNT value on done: 493290.0 [2024-08-06 04:34:25,235][52795] Sum rewards: 74.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.122', 'weapon5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:25,672][52649] DAMAGECOUNT value on done: 513193.0 [2024-08-06 04:34:25,675][52649] Sum rewards: 87.317, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.648', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.068', 'AMMO4': '0.187', 'AMMO3': '0.190', 'weapon5': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '70.000'} [2024-08-06 04:34:26,148][52667] DAMAGECOUNT value on done: 541179.0 [2024-08-06 04:34:26,149][52667] Sum rewards: 76.272, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.868', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.084', 'weapon4': '0.104', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.496', 'WEAPON3': '1.600', 'weapon3': '3.040', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:26,247][52669] DAMAGECOUNT value on done: 536894.0 [2024-08-06 04:34:26,248][52669] Sum rewards: 72.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.768', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.172', 'weapon2': '0.176', 'AMMO3': '0.220', 'WEAPON3': '1.250', 'weapon3': '3.368', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:26,785][52670] DAMAGECOUNT value on done: 514933.0 [2024-08-06 04:34:26,787][52670] Sum rewards: 68.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.150', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.338', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '56.500'} [2024-08-06 04:34:26,972][52666] DAMAGECOUNT value on done: 533107.0 [2024-08-06 04:34:26,974][52666] Sum rewards: 68.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.870', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.179', 'AMMO4': '0.212', 'weapon5': '0.286', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.452', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '54.000'} [2024-08-06 04:34:27,551][52647] DAMAGECOUNT value on done: 568850.0 [2024-08-06 04:34:27,551][52647] Sum rewards: 63.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.984', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.130', 'AMMO4': '0.185', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '54.000'} [2024-08-06 04:34:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 446439424. Throughput: 0: 4350.4. Samples: 111618980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:34:27,802][52567] Avg episode reward: [(0, '71.007')] [2024-08-06 04:34:27,809][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000054498_446447616.pth... [2024-08-06 04:34:27,940][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000053985_442245120.pth [2024-08-06 04:34:28,361][52795] DAMAGECOUNT value on done: 487353.0 [2024-08-06 04:34:28,370][52795] Sum rewards: 62.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.078', 'AMMO4': '0.177', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon5': '0.358', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.660', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '52.000'} [2024-08-06 04:34:28,711][52667] DAMAGECOUNT value on done: 544000.0 [2024-08-06 04:34:28,711][52667] Sum rewards: 77.235, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.911', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.221', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '64.000'} [2024-08-06 04:34:28,936][52649] DAMAGECOUNT value on done: 527773.0 [2024-08-06 04:34:28,938][52649] Sum rewards: 69.615, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.660', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.164', 'AMMO4': '0.273', 'weapon4': '0.288', 'weapon5': '0.288', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.556', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '55.000'} [2024-08-06 04:34:29,139][52650] Updated weights for policy 0, policy_version 54501 (0.0022) [2024-08-06 04:34:29,260][52669] DAMAGECOUNT value on done: 535526.0 [2024-08-06 04:34:29,260][52669] Sum rewards: 73.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon2': '0.170', 'weapon5': '0.212', 'AMMO3': '0.249', 'AMMO4': '0.273', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.268', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '63.000'} [2024-08-06 04:34:29,959][52670] DAMAGECOUNT value on done: 528288.0 [2024-08-06 04:34:29,960][52670] Sum rewards: 78.721, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.178', 'AMMO4': '0.244', 'AMMO3': '0.276', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.136', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '67.000'} [2024-08-06 04:34:30,125][52666] DAMAGECOUNT value on done: 533415.0 [2024-08-06 04:34:30,125][52666] Sum rewards: 60.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.152', 'AMMO3': '0.176', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.272', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '49.000'} [2024-08-06 04:34:30,450][52647] DAMAGECOUNT value on done: 567881.0 [2024-08-06 04:34:30,450][52647] Sum rewards: 66.694, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.084', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.184', 'AMMO4': '0.226', 'AMMO3': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.850', 'weapon3': '3.018', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:30,563][52666] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2024-08-06 04:34:31,238][52667] DAMAGECOUNT value on done: 544857.0 [2024-08-06 04:34:31,238][52667] Sum rewards: 76.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.205', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.034', 'weapon4': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '64.000'} [2024-08-06 04:34:31,519][52795] DAMAGECOUNT value on done: 496171.0 [2024-08-06 04:34:31,521][52795] Sum rewards: 68.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.278', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.080', 'AMMO4': '0.216', 'weapon5': '0.228', 'AMMO3': '0.256', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.094', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:32,204][52649] DAMAGECOUNT value on done: 526660.0 [2024-08-06 04:34:32,205][52649] Sum rewards: 78.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.454', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon4': '0.162', 'AMMO3': '0.198', 'weapon5': '0.218', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '64.000'} [2024-08-06 04:34:32,409][52669] DAMAGECOUNT value on done: 538781.0 [2024-08-06 04:34:32,411][52669] Sum rewards: 80.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.210', 'weapon2': '0.218', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '67.000'} [2024-08-06 04:34:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 446529536. Throughput: 0: 4337.3. Samples: 111631710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:34:32,794][52567] Avg episode reward: [(0, '71.282')] [2024-08-06 04:34:32,824][52670] DAMAGECOUNT value on done: 536467.0 [2024-08-06 04:34:32,826][52670] Sum rewards: 73.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.246', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO3': '0.166', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:32,963][52666] DAMAGECOUNT value on done: 517497.0 [2024-08-06 04:34:32,965][52666] Sum rewards: 71.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:33,041][52647] DAMAGECOUNT value on done: 565105.0 [2024-08-06 04:34:33,041][52647] Sum rewards: 73.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.604', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.118', 'AMMO4': '0.157', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:34,226][52650] Updated weights for policy 0, policy_version 54511 (0.0013) [2024-08-06 04:34:34,234][52667] DAMAGECOUNT value on done: 541156.0 [2024-08-06 04:34:34,238][52667] Sum rewards: 63.346, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'HEALTH': '0.110', 'weapon5': '0.122', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'weapon4': '0.322', 'WEAPON3': '0.900', 'HITCOUNT': '2.860', 'weapon3': '3.124', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '50.000'} [2024-08-06 04:34:34,691][52795] DAMAGECOUNT value on done: 501300.0 [2024-08-06 04:34:34,691][52795] Sum rewards: 71.657, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '3.002', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:35,330][52647] DAMAGECOUNT value on done: 558131.0 [2024-08-06 04:34:35,330][52647] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.964', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.114', 'weapon4': '0.120', 'AMMO4': '0.202', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '60.000'} [2024-08-06 04:34:35,414][52649] DAMAGECOUNT value on done: 521402.0 [2024-08-06 04:34:35,414][52649] Sum rewards: 74.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.186', 'AMMO3': '0.203', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.634', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:35,641][52669] DAMAGECOUNT value on done: 538961.0 [2024-08-06 04:34:35,651][52669] Sum rewards: 82.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.342', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'weapon5': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '67.000'} [2024-08-06 04:34:35,910][52670] DAMAGECOUNT value on done: 525258.0 [2024-08-06 04:34:35,910][52670] Sum rewards: 74.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.064', 'weapon5': '0.182', 'AMMO4': '0.219', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '63.000'} [2024-08-06 04:34:36,041][52666] DAMAGECOUNT value on done: 528098.0 [2024-08-06 04:34:36,043][52666] Sum rewards: 73.157, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.975', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'weapon2': '0.366', 'WEAPON3': '1.650', 'weapon3': '3.236', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '62.000'} [2024-08-06 04:34:37,288][52667] DAMAGECOUNT value on done: 535042.0 [2024-08-06 04:34:37,289][52667] Sum rewards: 64.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.704', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.230', 'weapon5': '0.230', 'weapon2': '0.278', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '53.000'} [2024-08-06 04:34:37,761][52795] DAMAGECOUNT value on done: 497621.0 [2024-08-06 04:34:37,764][52795] Sum rewards: 64.318, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.982', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.016', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '55.000'} [2024-08-06 04:34:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 446611456. Throughput: 0: 4341.3. Samples: 111658060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:34:37,794][52567] Avg episode reward: [(0, '71.043')] [2024-08-06 04:34:38,033][52647] DAMAGECOUNT value on done: 565791.0 [2024-08-06 04:34:38,033][52647] Sum rewards: 61.977, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.698', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.110', 'AMMO4': '0.245', 'weapon5': '0.246', 'AMMO3': '0.261', 'weapon2': '0.288', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '3.022', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:38,174][52671] DAMAGECOUNT value on done: 541198.0 [2024-08-06 04:34:38,174][52671] Sum rewards: 67.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.126', 'weapon5': '0.180', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '2.990', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:38,375][52650] Updated weights for policy 0, policy_version 54521 (0.0012) [2024-08-06 04:34:38,685][52669] DAMAGECOUNT value on done: 535189.0 [2024-08-06 04:34:38,685][52669] Sum rewards: 72.990, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'AMMO3': '0.164', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.248', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:38,960][52670] DAMAGECOUNT value on done: 531372.0 [2024-08-06 04:34:38,960][52670] Sum rewards: 77.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.138', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '63.000'} [2024-08-06 04:34:40,188][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:34:40,409][52647] DAMAGECOUNT value on done: 561801.0 [2024-08-06 04:34:40,409][52647] Sum rewards: 71.163, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.720', 'AMMO5': '0.012', 'AMMO2': '0.063', 'weapon4': '0.138', 'weapon5': '0.154', 'AMMO3': '0.314', 'AMMO4': '0.317', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.950', 'weapon3': '3.104', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '63.000'} [2024-08-06 04:34:40,434][52667] DAMAGECOUNT value on done: 543901.0 [2024-08-06 04:34:40,436][52667] Sum rewards: 72.966, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.654', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.058', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.297', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.152', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '66.000'} [2024-08-06 04:34:40,645][52671] DAMAGECOUNT value on done: 539229.0 [2024-08-06 04:34:40,655][52671] Sum rewards: 78.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.044', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.136', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.248', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '67.000'} [2024-08-06 04:34:40,945][52795] DAMAGECOUNT value on done: 488814.0 [2024-08-06 04:34:40,948][52795] Sum rewards: 64.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.184', 'weapon4': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '54.000'} [2024-08-06 04:34:41,676][52669] DAMAGECOUNT value on done: 545292.0 [2024-08-06 04:34:41,678][52669] Sum rewards: 70.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.072', 'AMMO4': '0.090', 'weapon5': '0.104', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:41,858][52667] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:34:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 446701568. Throughput: 0: 4344.2. Samples: 111684190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:34:42,795][52567] Avg episode reward: [(0, '70.834')] [2024-08-06 04:34:43,324][52647] DAMAGECOUNT value on done: 563330.0 [2024-08-06 04:34:43,325][52647] Sum rewards: 70.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.062', 'weapon5': '0.094', 'AMMO4': '0.110', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.332', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:43,344][52671] DAMAGECOUNT value on done: 539629.0 [2024-08-06 04:34:43,345][52671] Sum rewards: 74.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.886', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:43,375][52650] Updated weights for policy 0, policy_version 54531 (0.0018) [2024-08-06 04:34:44,054][52795] DAMAGECOUNT value on done: 499241.0 [2024-08-06 04:34:44,056][52795] Sum rewards: 68.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.206', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon5': '0.104', 'AMMO3': '0.202', 'AMMO4': '0.253', 'weapon2': '0.256', 'weapon4': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:44,204][52658] DAMAGECOUNT value on done: 535086.0 [2024-08-06 04:34:44,204][52658] Sum rewards: 82.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.040', 'AMMO4': '0.060', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.769', 'FRAGCOUNT': '67.000'} [2024-08-06 04:34:44,687][52669] DAMAGECOUNT value on done: 534807.0 [2024-08-06 04:34:44,688][52669] Sum rewards: 62.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.360', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon5': '0.072', 'weapon4': '0.090', 'AMMO3': '0.162', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '3.066', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '52.000'} [2024-08-06 04:34:45,656][52647] DAMAGECOUNT value on done: 555619.0 [2024-08-06 04:34:45,664][52668] DAMAGECOUNT value on done: 534173.0 [2024-08-06 04:34:45,666][52647] Sum rewards: 83.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.112', 'ARMOR': '0.008', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.116', 'AMMO4': '0.152', 'weapon5': '0.152', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '68.000'} [2024-08-06 04:34:45,666][52668] Sum rewards: 76.013, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.224', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.160', 'weapon2': '0.240', 'AMMO4': '0.246', 'weapon5': '0.264', 'AMMO3': '0.287', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.990', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:46,240][52671] DAMAGECOUNT value on done: 539569.0 [2024-08-06 04:34:46,242][52671] Sum rewards: 73.172, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.072', 'HEALTH': '0.152', 'weapon5': '0.164', 'AMMO3': '0.169', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 04:34:47,116][52795] DAMAGECOUNT value on done: 495300.0 [2024-08-06 04:34:47,116][52795] Sum rewards: 72.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.445', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.088', 'AMMO4': '0.209', 'AMMO3': '0.214', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 04:34:47,148][52820] DAMAGECOUNT value on done: 495090.0 [2024-08-06 04:34:47,152][52820] Sum rewards: 69.651, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO3': '0.176', 'AMMO4': '0.196', 'weapon2': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 04:34:47,286][52658] DAMAGECOUNT value on done: 535450.0 [2024-08-06 04:34:47,286][52658] Sum rewards: 75.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.652', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.108', 'weapon5': '0.134', 'AMMO4': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:47,485][52669] DAMAGECOUNT value on done: 541177.0 [2024-08-06 04:34:47,485][52669] Sum rewards: 66.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.666', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon4': '0.220', 'AMMO3': '0.245', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.400', 'weapon3': '2.566', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.000'} [2024-08-06 04:34:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 446791680. Throughput: 0: 4354.2. Samples: 111697510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:34:47,794][52567] Avg episode reward: [(0, '71.402')] [2024-08-06 04:34:48,270][52665] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:34:48,279][52650] Updated weights for policy 0, policy_version 54541 (0.0012) [2024-08-06 04:34:48,327][52668] DAMAGECOUNT value on done: 537570.0 [2024-08-06 04:34:48,327][52668] Sum rewards: 57.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.167', 'AMMO3': '0.167', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon5': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '3.166', 'DAMAGECOUNT': '14.517', 'FRAGCOUNT': '46.500'} [2024-08-06 04:34:48,576][52647] DAMAGECOUNT value on done: 568375.0 [2024-08-06 04:34:48,580][52647] Sum rewards: 77.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.499', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.074', 'AMMO4': '0.075', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:49,215][52671] DAMAGECOUNT value on done: 549066.0 [2024-08-06 04:34:49,217][52671] Sum rewards: 80.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.426', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.254', 'weapon2': '0.490', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '66.000'} [2024-08-06 04:34:50,024][52658] DAMAGECOUNT value on done: 540454.0 [2024-08-06 04:34:50,026][52658] Sum rewards: 72.640, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.942', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.134', 'AMMO3': '0.150', 'weapon4': '0.192', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '0.900', 'weapon3': '3.000', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:50,047][52820] DAMAGECOUNT value on done: 495586.0 [2024-08-06 04:34:50,047][52820] Sum rewards: 72.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.162', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 04:34:50,266][52795] DAMAGECOUNT value on done: 489926.0 [2024-08-06 04:34:50,266][52795] Sum rewards: 61.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.480', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.230', 'weapon2': '0.242', 'AMMO4': '0.263', 'AMMO3': '0.306', 'WEAPON5': '0.400', 'weapon4': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.800', 'weapon3': '2.702', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '54.000'} [2024-08-06 04:34:50,431][52669] DAMAGECOUNT value on done: 539673.0 [2024-08-06 04:34:50,432][52669] Sum rewards: 69.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.076', 'AMMO4': '0.134', 'weapon5': '0.160', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.162', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:51,314][52668] DAMAGECOUNT value on done: 537224.0 [2024-08-06 04:34:51,323][52668] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.356', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '60.000'} [2024-08-06 04:34:51,511][52647] DAMAGECOUNT value on done: 561276.0 [2024-08-06 04:34:51,511][52647] Sum rewards: 80.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.532', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '67.000'} [2024-08-06 04:34:51,737][52659] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon5', 0.002)] [2024-08-06 04:34:52,406][52650] Updated weights for policy 0, policy_version 54551 (0.0010) [2024-08-06 04:34:52,594][52671] DAMAGECOUNT value on done: 538312.0 [2024-08-06 04:34:52,595][52671] Sum rewards: 63.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.834', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'weapon4': '0.172', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '52.000'} [2024-08-06 04:34:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 446881792. Throughput: 0: 4355.5. Samples: 111723670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:34:52,795][52567] Avg episode reward: [(0, '71.616')] [2024-08-06 04:34:53,007][52820] DAMAGECOUNT value on done: 498996.0 [2024-08-06 04:34:53,007][52820] Sum rewards: 87.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.217', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon4': '0.184', 'AMMO3': '0.205', 'weapon5': '0.222', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.661', 'FRAGCOUNT': '70.000'} [2024-08-06 04:34:53,056][52669] DAMAGECOUNT value on done: 527917.0 [2024-08-06 04:34:53,056][52669] Sum rewards: 69.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.474', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon4': '0.226', 'weapon5': '0.238', 'AMMO3': '0.267', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.920', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '58.000'} [2024-08-06 04:34:53,168][52658] DAMAGECOUNT value on done: 540527.0 [2024-08-06 04:34:53,169][52658] Sum rewards: 74.134, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.288', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '58.500'} [2024-08-06 04:34:53,212][52664] DAMAGECOUNT value on done: 554818.0 [2024-08-06 04:34:53,212][52664] Sum rewards: 57.740, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.715', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO4': '0.218', 'weapon2': '0.260', 'weapon5': '0.270', 'AMMO3': '0.298', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.732', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2024-08-06 04:34:53,414][52795] DAMAGECOUNT value on done: 488897.0 [2024-08-06 04:34:53,418][52795] Sum rewards: 79.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.014', 'AMMO5': '0.009', 'ARMOR': '0.032', 'AMMO2': '0.045', 'AMMO3': '0.176', 'weapon5': '0.188', 'weapon4': '0.202', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '63.500'} [2024-08-06 04:34:53,808][52668] DAMAGECOUNT value on done: 537066.0 [2024-08-06 04:34:53,809][52668] Sum rewards: 67.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.140', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '3.290', 'weapon3': '3.404', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '55.000'} [2024-08-06 04:34:54,792][52662] DAMAGECOUNT value on done: 539853.0 [2024-08-06 04:34:54,793][52662] Sum rewards: 82.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.146', 'AMMO3': '0.182', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '68.000'} [2024-08-06 04:34:54,803][52647] DAMAGECOUNT value on done: 568248.0 [2024-08-06 04:34:54,805][52647] Sum rewards: 64.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.252', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2024-08-06 04:34:55,192][52671] DAMAGECOUNT value on done: 545358.0 [2024-08-06 04:34:55,194][52671] Sum rewards: 54.912, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.650', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.096', 'weapon5': '0.158', 'AMMO4': '0.215', 'weapon2': '0.268', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.910', 'weapon3': '3.172', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '50.000'} [2024-08-06 04:34:56,023][52669] DAMAGECOUNT value on done: 537288.0 [2024-08-06 04:34:56,025][52669] Sum rewards: 69.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.136', 'weapon5': '0.136', 'AMMO4': '0.175', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:56,056][52820] DAMAGECOUNT value on done: 489560.0 [2024-08-06 04:34:56,057][52820] Sum rewards: 84.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.069', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '70.000'} [2024-08-06 04:34:56,216][52664] DAMAGECOUNT value on done: 561167.0 [2024-08-06 04:34:56,217][52664] Sum rewards: 76.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.100', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'weapon4': '0.164', 'weapon5': '0.164', 'AMMO3': '0.196', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '60.500'} [2024-08-06 04:34:56,232][52658] DAMAGECOUNT value on done: 530458.0 [2024-08-06 04:34:56,233][52658] Sum rewards: 61.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.064', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '53.000'} [2024-08-06 04:34:56,659][52795] DAMAGECOUNT value on done: 496280.0 [2024-08-06 04:34:56,664][52795] Sum rewards: 71.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.282', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.080', 'AMMO4': '0.146', 'weapon5': '0.190', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '59.000'} [2024-08-06 04:34:56,700][52668] DAMAGECOUNT value on done: 527938.0 [2024-08-06 04:34:56,700][52668] Sum rewards: 78.058, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.005', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.146', 'AMMO4': '0.222', 'weapon2': '0.232', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.318', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '68.000'} [2024-08-06 04:34:57,307][52647] DAMAGECOUNT value on done: 564185.0 [2024-08-06 04:34:57,308][52647] Sum rewards: 75.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.043', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.364', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '64.000'} [2024-08-06 04:34:57,530][52668] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:34:57,579][52662] DAMAGECOUNT value on done: 539352.0 [2024-08-06 04:34:57,582][52662] Sum rewards: 69.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.018', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.094', 'weapon5': '0.174', 'AMMO3': '0.202', 'AMMO4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.190', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.000'} [2024-08-06 04:34:57,783][52650] Updated weights for policy 0, policy_version 54561 (0.0011) [2024-08-06 04:34:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 446963712. Throughput: 0: 4351.6. Samples: 111749930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:34:57,794][52567] Avg episode reward: [(0, '71.840')] [2024-08-06 04:34:58,028][52671] DAMAGECOUNT value on done: 537986.0 [2024-08-06 04:34:58,029][52671] Sum rewards: 80.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.325', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.146', 'weapon5': '0.160', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:58,726][52669] DAMAGECOUNT value on done: 538546.0 [2024-08-06 04:34:58,728][52669] Sum rewards: 66.615, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.156', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.682', 'WEAPON3': '0.950', 'weapon3': '2.750', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '54.000'} [2024-08-06 04:34:58,780][52664] DAMAGECOUNT value on done: 560094.0 [2024-08-06 04:34:58,780][52664] Sum rewards: 66.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.166', 'AMMO3': '0.179', 'AMMO4': '0.230', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '55.000'} [2024-08-06 04:34:59,271][52820] DAMAGECOUNT value on done: 499106.0 [2024-08-06 04:34:59,272][52820] Sum rewards: 69.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.855', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.146', 'weapon4': '0.148', 'weapon2': '0.196', 'AMMO3': '0.214', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '57.000'} [2024-08-06 04:34:59,405][52658] DAMAGECOUNT value on done: 532822.0 [2024-08-06 04:34:59,406][52658] Sum rewards: 77.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.232', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.530', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '65.000'} [2024-08-06 04:34:59,659][52647] DAMAGECOUNT value on done: 552210.0 [2024-08-06 04:34:59,662][52647] Sum rewards: 59.684, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.977', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.136', 'weapon4': '0.172', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '49.000'} [2024-08-06 04:34:59,761][52668] DAMAGECOUNT value on done: 541414.0 [2024-08-06 04:34:59,763][52668] Sum rewards: 52.715, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.082', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.104', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.322', 'weapon2': '0.624', 'WEAPON3': '0.750', 'HITCOUNT': '2.420', 'weapon3': '2.844', 'DAMAGECOUNT': '13.530', 'FRAGCOUNT': '39.000'} [2024-08-06 04:34:59,866][52795] DAMAGECOUNT value on done: 488821.0 [2024-08-06 04:34:59,867][52795] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.595', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.198', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '62.500'} [2024-08-06 04:35:00,577][52662] DAMAGECOUNT value on done: 541655.0 [2024-08-06 04:35:00,578][52662] Sum rewards: 74.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.065', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon5': '0.140', 'AMMO4': '0.157', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:00,704][52671] DAMAGECOUNT value on done: 534369.0 [2024-08-06 04:35:00,705][52671] Sum rewards: 75.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.028', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.143', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:01,014][52664] DAMAGECOUNT value on done: 551833.0 [2024-08-06 04:35:01,015][52664] Sum rewards: 66.278, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '53.000'} [2024-08-06 04:35:01,827][52650] Updated weights for policy 0, policy_version 54571 (0.0036) [2024-08-06 04:35:01,892][52669] DAMAGECOUNT value on done: 555128.0 [2024-08-06 04:35:01,893][52669] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.381', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.212', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:02,040][52647] DAMAGECOUNT value on done: 561398.0 [2024-08-06 04:35:02,041][52647] Sum rewards: 64.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.055', 'weapon5': '0.128', 'weapon4': '0.224', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'AMMO4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '53.000'} [2024-08-06 04:35:02,373][52820] DAMAGECOUNT value on done: 490458.0 [2024-08-06 04:35:02,375][52820] Sum rewards: 78.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.174', 'AMMO3': '0.211', 'AMMO4': '0.260', 'weapon4': '0.302', 'weapon2': '0.338', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '65.000'} [2024-08-06 04:35:02,581][52658] DAMAGECOUNT value on done: 539912.0 [2024-08-06 04:35:02,581][52658] Sum rewards: 64.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.016', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.156', 'AMMO4': '0.177', 'AMMO3': '0.201', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '54.000'} [2024-08-06 04:35:02,722][52668] DAMAGECOUNT value on done: 538699.0 [2024-08-06 04:35:02,722][52668] Sum rewards: 70.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.053', 'AMMO5': '0.013', 'weapon4': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.180', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.214', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:02,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 447045632. Throughput: 0: 4368.4. Samples: 111763020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:35:02,794][52567] Avg episode reward: [(0, '71.347')] [2024-08-06 04:35:03,197][52795] DAMAGECOUNT value on done: 504184.0 [2024-08-06 04:35:03,197][52795] Sum rewards: 68.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.180', 'AMMO3': '0.199', 'weapon4': '0.288', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:03,473][52664] DAMAGECOUNT value on done: 556544.0 [2024-08-06 04:35:03,473][52664] Sum rewards: 59.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.623', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.194', 'AMMO3': '0.198', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '49.000'} [2024-08-06 04:35:03,679][52662] DAMAGECOUNT value on done: 528828.0 [2024-08-06 04:35:03,680][52662] Sum rewards: 67.468, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.310', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:03,737][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:35:03,842][52671] DAMAGECOUNT value on done: 540666.0 [2024-08-06 04:35:03,842][52671] Sum rewards: 68.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.469', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '57.000'} [2024-08-06 04:35:04,526][52647] DAMAGECOUNT value on done: 555723.0 [2024-08-06 04:35:04,527][52647] Sum rewards: 62.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.838', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.140', 'AMMO4': '0.190', 'AMMO3': '0.193', 'weapon2': '0.198', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '52.000'} [2024-08-06 04:35:04,632][52669] DAMAGECOUNT value on done: 542614.0 [2024-08-06 04:35:04,633][52669] Sum rewards: 65.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.252', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '55.000'} [2024-08-06 04:35:05,428][52820] DAMAGECOUNT value on done: 494943.0 [2024-08-06 04:35:05,428][52820] Sum rewards: 76.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.052', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.213', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:05,454][52658] DAMAGECOUNT value on done: 531536.0 [2024-08-06 04:35:05,456][52658] Sum rewards: 64.095, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.262', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.208', 'AMMO3': '0.214', 'AMMO4': '0.226', 'weapon4': '0.246', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '55.000'} [2024-08-06 04:35:06,034][52668] DAMAGECOUNT value on done: 529520.0 [2024-08-06 04:35:06,035][52668] Sum rewards: 56.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.088', 'weapon5': '0.146', 'AMMO4': '0.192', 'AMMO3': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.960', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '49.500'} [2024-08-06 04:35:06,296][52795] DAMAGECOUNT value on done: 497362.0 [2024-08-06 04:35:06,297][52795] Sum rewards: 68.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.106', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.211', 'AMMO3': '0.238', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:06,470][52664] DAMAGECOUNT value on done: 557287.0 [2024-08-06 04:35:06,471][52664] Sum rewards: 73.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.609', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.040', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:06,624][52662] DAMAGECOUNT value on done: 541837.0 [2024-08-06 04:35:06,626][52662] Sum rewards: 68.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.457', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.171', 'weapon5': '0.172', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:06,770][52671] DAMAGECOUNT value on done: 540098.0 [2024-08-06 04:35:06,770][52671] Sum rewards: 60.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.681', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon5': '0.144', 'AMMO3': '0.188', 'weapon4': '0.272', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '51.000'} [2024-08-06 04:35:06,944][52650] Updated weights for policy 0, policy_version 54581 (0.0024) [2024-08-06 04:35:07,479][52647] DAMAGECOUNT value on done: 557066.0 [2024-08-06 04:35:07,480][52647] Sum rewards: 75.952, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.351', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.190', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:07,480][52669] DAMAGECOUNT value on done: 540903.0 [2024-08-06 04:35:07,481][52669] Sum rewards: 75.546, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.430', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.104', 'weapon4': '0.156', 'AMMO4': '0.197', 'weapon2': '0.230', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '66.000'} [2024-08-06 04:35:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 447143936. Throughput: 0: 4369.3. Samples: 111789140. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:35:07,794][52567] Avg episode reward: [(0, '70.886')] [2024-08-06 04:35:08,427][52658] DAMAGECOUNT value on done: 548457.0 [2024-08-06 04:35:08,429][52658] Sum rewards: 81.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.846', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.134', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '64.000'} [2024-08-06 04:35:08,548][52820] DAMAGECOUNT value on done: 498529.0 [2024-08-06 04:35:08,548][52820] Sum rewards: 69.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon2': '0.156', 'AMMO3': '0.261', 'WEAPON3': '1.600', 'HITCOUNT': '3.440', 'weapon3': '3.696', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:08,921][52668] DAMAGECOUNT value on done: 533656.0 [2024-08-06 04:35:08,922][52668] Sum rewards: 72.242, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.606', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.160', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:08,940][52664] DAMAGECOUNT value on done: 553436.0 [2024-08-06 04:35:08,940][52664] Sum rewards: 67.684, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'ARMOR': '0.005', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.179', 'AMMO3': '0.180', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '55.000'} [2024-08-06 04:35:09,511][52795] DAMAGECOUNT value on done: 487471.0 [2024-08-06 04:35:09,512][52795] Sum rewards: 71.924, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.132', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:09,803][52669] DAMAGECOUNT value on done: 541256.0 [2024-08-06 04:35:09,803][52669] Sum rewards: 73.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.135', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.074', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:09,851][52662] DAMAGECOUNT value on done: 533462.0 [2024-08-06 04:35:09,853][52662] Sum rewards: 74.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.024', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.128', 'weapon5': '0.204', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:09,963][52671] DAMAGECOUNT value on done: 537383.0 [2024-08-06 04:35:09,963][52671] Sum rewards: 71.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.066', 'AMMO4': '0.166', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:11,235][52658] DAMAGECOUNT value on done: 533883.0 [2024-08-06 04:35:11,235][52658] Sum rewards: 80.641, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.528', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.066', 'AMMO4': '0.102', 'AMMO3': '0.151', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '64.000'} [2024-08-06 04:35:11,649][52664] DAMAGECOUNT value on done: 547632.0 [2024-08-06 04:35:11,650][52664] Sum rewards: 62.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.204', 'AMMO3': '0.215', 'weapon5': '0.250', 'AMMO4': '0.293', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '53.000'} [2024-08-06 04:35:11,715][52820] DAMAGECOUNT value on done: 494849.0 [2024-08-06 04:35:11,716][52820] Sum rewards: 78.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.815', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.207', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.480', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '66.000'} [2024-08-06 04:35:11,732][52650] Updated weights for policy 0, policy_version 54591 (0.0027) [2024-08-06 04:35:12,075][52668] DAMAGECOUNT value on done: 541264.0 [2024-08-06 04:35:12,083][52668] Sum rewards: 70.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.708', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.122', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:12,730][52671] DAMAGECOUNT value on done: 547302.0 [2024-08-06 04:35:12,733][52671] Sum rewards: 76.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:12,755][52795] DAMAGECOUNT value on done: 494725.0 [2024-08-06 04:35:12,757][52795] Sum rewards: 65.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.967', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.148', 'AMMO4': '0.170', 'weapon5': '0.224', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.728', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '51.000'} [2024-08-06 04:35:12,764][52660] DAMAGECOUNT value on done: 538302.0 [2024-08-06 04:35:12,765][52660] Sum rewards: 80.947, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.469', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon4': '0.208', 'weapon2': '0.340', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 04:35:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 447234048. Throughput: 0: 4358.2. Samples: 111815100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:35:12,794][52567] Avg episode reward: [(0, '71.155')] [2024-08-06 04:35:12,985][52669] DAMAGECOUNT value on done: 546317.0 [2024-08-06 04:35:12,987][52669] Sum rewards: 83.485, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.525', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.146', 'AMMO4': '0.172', 'AMMO3': '0.266', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.243', 'FRAGCOUNT': '70.000'} [2024-08-06 04:35:13,027][52662] DAMAGECOUNT value on done: 541006.0 [2024-08-06 04:35:13,029][52662] Sum rewards: 75.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.166', 'weapon4': '0.168', 'AMMO3': '0.170', 'AMMO4': '0.239', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:13,987][52658] DAMAGECOUNT value on done: 547946.0 [2024-08-06 04:35:13,988][52658] Sum rewards: 69.487, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.078', 'AMMO4': '0.127', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.128', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:14,185][52664] DAMAGECOUNT value on done: 560639.0 [2024-08-06 04:35:14,186][52664] Sum rewards: 70.068, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.160', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.130', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon5': '0.294', 'weapon4': '0.348', 'weapon2': '0.548', 'WEAPON3': '0.800', 'weapon3': '2.558', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '53.500'} [2024-08-06 04:35:14,754][52820] DAMAGECOUNT value on done: 503227.0 [2024-08-06 04:35:14,756][52820] Sum rewards: 76.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.102', 'AMMO3': '0.207', 'AMMO4': '0.264', 'weapon5': '0.274', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:14,921][52668] DAMAGECOUNT value on done: 536487.0 [2024-08-06 04:35:14,922][52668] Sum rewards: 74.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.935', 'AMMO5': '0.007', 'AMMO2': '0.056', 'weapon5': '0.128', 'weapon4': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'AMMO4': '0.282', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:15,716][52671] DAMAGECOUNT value on done: 541255.0 [2024-08-06 04:35:15,717][52671] Sum rewards: 76.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.816', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.135', 'weapon2': '0.158', 'AMMO3': '0.195', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:15,784][52662] DAMAGECOUNT value on done: 543737.0 [2024-08-06 04:35:15,786][52662] Sum rewards: 66.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.935', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.154', 'weapon5': '0.154', 'AMMO4': '0.162', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.622', 'WEAPON3': '0.950', 'weapon3': '2.650', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '52.500'} [2024-08-06 04:35:15,791][52660] DAMAGECOUNT value on done: 526573.0 [2024-08-06 04:35:15,792][52660] Sum rewards: 80.247, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.545', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO3': '0.116', 'AMMO4': '0.168', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '0.800', 'weapon3': '2.944', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:15,965][52795] DAMAGECOUNT value on done: 499454.0 [2024-08-06 04:35:15,966][52795] Sum rewards: 74.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.576', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:16,307][52650] Updated weights for policy 0, policy_version 54601 (0.0016) [2024-08-06 04:35:16,715][52658] DAMAGECOUNT value on done: 530802.0 [2024-08-06 04:35:16,718][52658] Sum rewards: 76.527, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.432', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.108', 'AMMO4': '0.126', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:17,011][52664] DAMAGECOUNT value on done: 553140.0 [2024-08-06 04:35:17,012][52664] Sum rewards: 82.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.701', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.214', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '68.000'} [2024-08-06 04:35:17,754][52820] DAMAGECOUNT value on done: 490673.0 [2024-08-06 04:35:17,754][52820] Sum rewards: 77.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.042', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 447315968. Throughput: 0: 4366.4. Samples: 111828200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:35:17,794][52567] Avg episode reward: [(0, '71.571')] [2024-08-06 04:35:18,184][52668] DAMAGECOUNT value on done: 529903.0 [2024-08-06 04:35:18,185][52668] Sum rewards: 71.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.164', 'weapon5': '0.194', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:18,416][52662] DAMAGECOUNT value on done: 537423.0 [2024-08-06 04:35:18,416][52662] Sum rewards: 70.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.835', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.195', 'weapon2': '0.214', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:18,692][52671] DAMAGECOUNT value on done: 525812.0 [2024-08-06 04:35:18,694][52671] Sum rewards: 67.694, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.074', 'weapon4': '0.090', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon2': '0.240', 'WEAPON3': '1.100', 'weapon3': '3.400', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '53.000'} [2024-08-06 04:35:18,969][52660] DAMAGECOUNT value on done: 538714.0 [2024-08-06 04:35:18,970][52660] Sum rewards: 65.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.140', 'AMMO4': '0.147', 'AMMO3': '0.228', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '55.000'} [2024-08-06 04:35:19,762][52658] DAMAGECOUNT value on done: 536759.0 [2024-08-06 04:35:19,762][52658] Sum rewards: 73.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.392', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.212', 'weapon2': '0.340', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.522', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:19,886][52664] DAMAGECOUNT value on done: 562176.0 [2024-08-06 04:35:19,887][52664] Sum rewards: 67.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.143', 'weapon5': '0.148', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '3.200', 'weapon3': '3.284', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:20,760][52650] Updated weights for policy 0, policy_version 54611 (0.0025) [2024-08-06 04:35:20,879][52820] DAMAGECOUNT value on done: 497807.0 [2024-08-06 04:35:20,879][52820] Sum rewards: 56.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.202', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.148', 'weapon5': '0.152', 'weapon2': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.240', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '49.000'} [2024-08-06 04:35:21,275][52662] DAMAGECOUNT value on done: 546932.0 [2024-08-06 04:35:21,277][52662] Sum rewards: 55.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.176', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.199', 'AMMO4': '0.254', 'weapon4': '0.256', 'weapon2': '0.522', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.668', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '49.000'} [2024-08-06 04:35:21,460][52668] DAMAGECOUNT value on done: 523705.0 [2024-08-06 04:35:21,462][52668] Sum rewards: 71.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.665', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.130', 'AMMO3': '0.207', 'AMMO4': '0.233', 'weapon5': '0.238', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:21,649][52671] DAMAGECOUNT value on done: 546570.0 [2024-08-06 04:35:21,652][52671] Sum rewards: 59.728, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon2': '0.238', 'AMMO3': '0.274', 'AMMO4': '0.283', 'weapon5': '0.308', 'weapon4': '0.340', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.720', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '53.000'} [2024-08-06 04:35:21,753][52614] Signal inference workers to stop experience collection... (9950 times) [2024-08-06 04:35:21,758][52614] Signal inference workers to resume experience collection... (9950 times) [2024-08-06 04:35:21,815][52650] InferenceWorker_p0-w0: stopping experience collection (9950 times) [2024-08-06 04:35:21,816][52650] InferenceWorker_p0-w0: resuming experience collection (9950 times) [2024-08-06 04:35:22,244][52660] DAMAGECOUNT value on done: 545244.0 [2024-08-06 04:35:22,246][52660] Sum rewards: 78.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.799', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.128', 'weapon2': '0.154', 'AMMO3': '0.259', 'WEAPON3': '1.650', 'weapon3': '3.392', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '67.000'} [2024-08-06 04:35:22,377][52664] DAMAGECOUNT value on done: 560246.0 [2024-08-06 04:35:22,377][52664] Sum rewards: 73.611, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.190', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO3': '0.142', 'AMMO4': '0.150', 'weapon5': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON5': '0.400', 'weapon2': '0.588', 'WEAPON3': '0.850', 'weapon3': '2.640', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:22,477][52658] DAMAGECOUNT value on done: 535532.0 [2024-08-06 04:35:22,479][52658] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.096', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 447397888. Throughput: 0: 4367.3. Samples: 111854590. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 04:35:22,794][52567] Avg episode reward: [(0, '70.964')] [2024-08-06 04:35:24,003][52820] DAMAGECOUNT value on done: 504855.0 [2024-08-06 04:35:24,005][52820] Sum rewards: 70.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.754', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.108', 'AMMO4': '0.124', 'weapon5': '0.178', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '57.500'} [2024-08-06 04:35:24,300][52662] DAMAGECOUNT value on done: 532908.0 [2024-08-06 04:35:24,300][52662] Sum rewards: 64.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.154', 'AMMO3': '0.187', 'AMMO4': '0.196', 'weapon5': '0.204', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '54.000'} [2024-08-06 04:35:24,301][52668] DAMAGECOUNT value on done: 524435.0 [2024-08-06 04:35:24,302][52668] Sum rewards: 61.225, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.714', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.134', 'AMMO4': '0.170', 'weapon2': '0.214', 'weapon5': '0.218', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.130', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '53.000'} [2024-08-06 04:35:24,606][52671] DAMAGECOUNT value on done: 543262.0 [2024-08-06 04:35:24,607][52671] Sum rewards: 76.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.260', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.147', 'AMMO3': '0.162', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.120', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:25,135][52664] DAMAGECOUNT value on done: 566879.0 [2024-08-06 04:35:25,135][52664] Sum rewards: 74.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.734', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.098', 'weapon4': '0.108', 'AMMO4': '0.122', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:25,178][52660] DAMAGECOUNT value on done: 536217.0 [2024-08-06 04:35:25,179][52660] Sum rewards: 67.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.082', 'weapon4': '0.106', 'AMMO3': '0.160', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.830', 'WEAPON3': '1.000', 'weapon3': '2.746', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '55.500'} [2024-08-06 04:35:25,434][52658] DAMAGECOUNT value on done: 537630.0 [2024-08-06 04:35:25,435][52658] Sum rewards: 76.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.077', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.090', 'AMMO4': '0.134', 'weapon5': '0.178', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:25,687][52650] Updated weights for policy 0, policy_version 54621 (0.0011) [2024-08-06 04:35:26,953][52662] DAMAGECOUNT value on done: 539417.0 [2024-08-06 04:35:26,954][52662] Sum rewards: 85.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.135', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.112', 'weapon5': '0.140', 'AMMO3': '0.201', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '70.000'} [2024-08-06 04:35:27,121][52820] DAMAGECOUNT value on done: 499053.0 [2024-08-06 04:35:27,121][52820] Sum rewards: 75.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.158', 'AMMO3': '0.184', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:27,491][52668] DAMAGECOUNT value on done: 526911.0 [2024-08-06 04:35:27,491][52668] Sum rewards: 63.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.123', 'weapon4': '0.132', 'weapon2': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.478', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '51.000'} [2024-08-06 04:35:27,603][52671] DAMAGECOUNT value on done: 544134.0 [2024-08-06 04:35:27,603][52671] Sum rewards: 65.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '53.000'} [2024-08-06 04:35:27,695][52664] DAMAGECOUNT value on done: 562016.0 [2024-08-06 04:35:27,696][52664] Sum rewards: 56.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '47.000'} [2024-08-06 04:35:27,719][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:35:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 447488000. Throughput: 0: 4366.5. Samples: 111880680. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:35:27,795][52567] Avg episode reward: [(0, '70.697')] [2024-08-06 04:35:28,275][52660] DAMAGECOUNT value on done: 532897.0 [2024-08-06 04:35:28,276][52660] Sum rewards: 72.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.218', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.130', 'AMMO4': '0.176', 'AMMO3': '0.239', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:28,312][52658] DAMAGECOUNT value on done: 526590.0 [2024-08-06 04:35:28,314][52658] Sum rewards: 66.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.330', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.316', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '55.000'} [2024-08-06 04:35:29,696][52662] DAMAGECOUNT value on done: 534936.0 [2024-08-06 04:35:29,696][52662] Sum rewards: 68.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '57.000'} [2024-08-06 04:35:30,236][52668] DAMAGECOUNT value on done: 535400.0 [2024-08-06 04:35:30,239][52668] Sum rewards: 63.727, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.136', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.130', 'weapon5': '0.236', 'AMMO4': '0.246', 'AMMO3': '0.278', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '54.000'} [2024-08-06 04:35:30,259][52650] Updated weights for policy 0, policy_version 54631 (0.0036) [2024-08-06 04:35:30,318][52820] DAMAGECOUNT value on done: 503208.0 [2024-08-06 04:35:30,319][52820] Sum rewards: 71.660, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO3': '0.178', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:30,713][52671] DAMAGECOUNT value on done: 539699.0 [2024-08-06 04:35:30,713][52671] Sum rewards: 68.628, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.042', 'AMMO5': '0.022', 'AMMO2': '0.050', 'weapon4': '0.132', 'AMMO3': '0.228', 'AMMO4': '0.250', 'weapon5': '0.266', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '57.500'} [2024-08-06 04:35:30,805][52660] DAMAGECOUNT value on done: 530754.0 [2024-08-06 04:35:30,807][52660] Sum rewards: 69.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.381', 'AMMO2': '0.007', 'AMMO5': '0.008', 'AMMO4': '0.033', 'weapon4': '0.034', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:30,932][52664] DAMAGECOUNT value on done: 564465.0 [2024-08-06 04:35:30,933][52664] Sum rewards: 81.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.666', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.034', 'AMMO4': '0.158', 'weapon5': '0.182', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '66.000'} [2024-08-06 04:35:31,312][52658] DAMAGECOUNT value on done: 542742.0 [2024-08-06 04:35:31,313][52658] Sum rewards: 76.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.195', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.058', 'AMMO4': '0.167', 'weapon5': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:31,832][52665] DAMAGECOUNT value on done: 524077.0 [2024-08-06 04:35:31,832][52665] Sum rewards: 65.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.806', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.180', 'weapon2': '0.190', 'AMMO4': '0.223', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.308', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:32,659][52662] DAMAGECOUNT value on done: 543957.0 [2024-08-06 04:35:32,660][52662] Sum rewards: 70.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.058', 'weapon5': '0.170', 'AMMO3': '0.240', 'AMMO4': '0.251', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.262', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:32,766][52668] DAMAGECOUNT value on done: 537318.0 [2024-08-06 04:35:32,766][52668] Sum rewards: 54.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.136', 'weapon4': '0.158', 'AMMO4': '0.180', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.600', 'HITCOUNT': '2.910', 'weapon3': '3.026', 'DAMAGECOUNT': '13.497', 'FRAGCOUNT': '49.000'} [2024-08-06 04:35:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 447569920. Throughput: 0: 4361.3. Samples: 111893770. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:35:32,794][52567] Avg episode reward: [(0, '70.648')] [2024-08-06 04:35:33,511][52820] DAMAGECOUNT value on done: 497424.0 [2024-08-06 04:35:33,511][52820] Sum rewards: 67.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.905', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.118', 'AMMO4': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:33,635][52660] DAMAGECOUNT value on done: 541959.0 [2024-08-06 04:35:33,637][52660] Sum rewards: 75.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.136', 'weapon5': '0.140', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:33,664][52671] DAMAGECOUNT value on done: 536409.0 [2024-08-06 04:35:33,665][52671] Sum rewards: 70.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.118', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.156', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '59.000'} [2024-08-06 04:35:33,843][52664] DAMAGECOUNT value on done: 556199.0 [2024-08-06 04:35:33,843][52664] Sum rewards: 70.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.658', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.132', 'AMMO3': '0.222', 'AMMO4': '0.241', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.350', 'weapon3': '2.730', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 04:35:34,045][52658] DAMAGECOUNT value on done: 534350.0 [2024-08-06 04:35:34,045][52658] Sum rewards: 67.763, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.624', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.226', 'AMMO4': '0.246', 'AMMO3': '0.249', 'weapon4': '0.266', 'weapon2': '0.296', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.930', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '57.000'} [2024-08-06 04:35:34,741][52665] DAMAGECOUNT value on done: 539106.0 [2024-08-06 04:35:34,745][52665] Sum rewards: 70.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.765', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon4': '0.322', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:35,200][52650] Updated weights for policy 0, policy_version 54641 (0.0028) [2024-08-06 04:35:35,711][52668] DAMAGECOUNT value on done: 536529.0 [2024-08-06 04:35:35,713][52668] Sum rewards: 82.550, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.772', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.130', 'AMMO4': '0.154', 'weapon5': '0.186', 'AMMO3': '0.202', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '65.000'} [2024-08-06 04:35:35,926][52662] DAMAGECOUNT value on done: 537430.0 [2024-08-06 04:35:35,929][52662] Sum rewards: 72.439, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.718', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.182', 'AMMO3': '0.187', 'weapon4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '59.000'} [2024-08-06 04:35:36,690][52660] DAMAGECOUNT value on done: 535395.0 [2024-08-06 04:35:36,690][52660] Sum rewards: 73.285, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.302', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.134', 'AMMO3': '0.164', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.664', 'WEAPON3': '0.950', 'weapon3': '2.752', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '57.000'} [2024-08-06 04:35:36,695][52820] DAMAGECOUNT value on done: 499281.0 [2024-08-06 04:35:36,695][52820] Sum rewards: 77.922, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.139', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '64.000'} [2024-08-06 04:35:36,723][52664] DAMAGECOUNT value on done: 551450.0 [2024-08-06 04:35:36,746][52664] Sum rewards: 73.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.215', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:36,815][52658] DAMAGECOUNT value on done: 536667.0 [2024-08-06 04:35:36,815][52658] Sum rewards: 71.320, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.502', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.072', 'AMMO4': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '3.164', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:37,666][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:35:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 447660032. Throughput: 0: 4362.0. Samples: 111919960. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:35:37,794][52567] Avg episode reward: [(0, '70.889')] [2024-08-06 04:35:37,837][52665] DAMAGECOUNT value on done: 532537.0 [2024-08-06 04:35:37,839][52665] Sum rewards: 70.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.680', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.124', 'weapon2': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.305', 'WEAPON3': '1.850', 'weapon3': '3.402', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '63.000'} [2024-08-06 04:35:38,422][52668] DAMAGECOUNT value on done: 538456.0 [2024-08-06 04:35:38,425][52668] Sum rewards: 66.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.072', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.398', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:38,632][52662] DAMAGECOUNT value on done: 547030.0 [2024-08-06 04:35:38,634][52662] Sum rewards: 67.951, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.956', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.120', 'AMMO4': '0.124', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'HITCOUNT': '3.330', 'weapon3': '3.352', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:39,323][52660] DAMAGECOUNT value on done: 533651.0 [2024-08-06 04:35:39,324][52660] Sum rewards: 69.372, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'weapon2': '0.430', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:39,388][52664] DAMAGECOUNT value on done: 558273.0 [2024-08-06 04:35:39,389][52664] Sum rewards: 75.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.817', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.178', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'AMMO4': '0.214', 'weapon4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '61.000'} [2024-08-06 04:35:39,609][52650] Updated weights for policy 0, policy_version 54651 (0.0018) [2024-08-06 04:35:39,754][52658] DAMAGECOUNT value on done: 540825.0 [2024-08-06 04:35:39,755][52658] Sum rewards: 66.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.221', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.072', 'weapon4': '0.122', 'AMMO3': '0.187', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:39,804][52820] DAMAGECOUNT value on done: 508406.0 [2024-08-06 04:35:39,804][52820] Sum rewards: 68.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.584', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.174', 'AMMO3': '0.206', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:41,081][52665] DAMAGECOUNT value on done: 530119.0 [2024-08-06 04:35:41,082][52665] Sum rewards: 81.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.426', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '67.000'} [2024-08-06 04:35:41,335][52668] DAMAGECOUNT value on done: 539063.0 [2024-08-06 04:35:41,336][52668] Sum rewards: 89.690, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.005', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.132', 'weapon4': '0.196', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.600', 'weapon3': '3.018', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.795', 'FRAGCOUNT': '74.000'} [2024-08-06 04:35:41,411][52662] DAMAGECOUNT value on done: 540967.0 [2024-08-06 04:35:41,411][52662] Sum rewards: 75.970, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.340', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO3': '0.161', 'AMMO4': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '2.708', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:41,786][52664] DAMAGECOUNT value on done: 556752.0 [2024-08-06 04:35:41,786][52664] Sum rewards: 78.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.174', 'AMMO3': '0.223', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '65.000'} [2024-08-06 04:35:42,127][52660] DAMAGECOUNT value on done: 542781.0 [2024-08-06 04:35:42,127][52660] Sum rewards: 71.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.088', 'weapon5': '0.094', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '59.000'} [2024-08-06 04:35:42,794][52567] Fps is (10 sec: 18841.0, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 447758336. Throughput: 0: 4360.6. Samples: 111946160. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:35:42,795][52567] Avg episode reward: [(0, '71.370')] [2024-08-06 04:35:42,919][52820] DAMAGECOUNT value on done: 507294.0 [2024-08-06 04:35:42,919][52820] Sum rewards: 68.793, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.154', 'AMMO4': '0.195', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.150', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:44,161][52664] DAMAGECOUNT value on done: 555300.0 [2024-08-06 04:35:44,162][52664] Sum rewards: 77.613, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.068', 'AMMO4': '0.210', 'AMMO3': '0.214', 'weapon5': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 04:35:44,170][52665] DAMAGECOUNT value on done: 521734.0 [2024-08-06 04:35:44,175][52665] Sum rewards: 73.944, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.539', 'AMMO5': '0.027', 'AMMO2': '0.079', 'AMMO3': '0.205', 'weapon4': '0.226', 'weapon2': '0.290', 'weapon5': '0.314', 'AMMO4': '0.393', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '62.000'} [2024-08-06 04:35:44,434][52662] DAMAGECOUNT value on done: 532287.0 [2024-08-06 04:35:44,439][52662] Sum rewards: 72.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.215', 'AMMO4': '0.221', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:44,516][52650] Updated weights for policy 0, policy_version 54661 (0.0030) [2024-08-06 04:35:45,055][52660] DAMAGECOUNT value on done: 528565.0 [2024-08-06 04:35:45,056][52660] Sum rewards: 82.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.672', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.102', 'weapon5': '0.218', 'AMMO4': '0.218', 'AMMO3': '0.228', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '68.000'} [2024-08-06 04:35:46,059][52820] DAMAGECOUNT value on done: 493801.0 [2024-08-06 04:35:46,059][52820] Sum rewards: 67.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.075', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.130', 'AMMO3': '0.200', 'AMMO4': '0.219', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.500'} [2024-08-06 04:35:46,544][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:35:47,205][52662] DAMAGECOUNT value on done: 538056.0 [2024-08-06 04:35:47,206][52662] Sum rewards: 82.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.582', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.137', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '69.000'} [2024-08-06 04:35:47,216][52665] DAMAGECOUNT value on done: 527903.0 [2024-08-06 04:35:47,218][52665] Sum rewards: 80.381, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.078', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.144', 'AMMO3': '0.185', 'HEALTH': '0.824', 'WEAPON3': '1.050', 'weapon3': '3.494', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '64.000'} [2024-08-06 04:35:47,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 447832064. Throughput: 0: 4360.4. Samples: 111959240. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:35:47,795][52567] Avg episode reward: [(0, '72.068')] [2024-08-06 04:35:47,939][52660] DAMAGECOUNT value on done: 532600.0 [2024-08-06 04:35:47,941][52660] Sum rewards: 71.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.314', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.014', 'WEAPON5': '0.050', 'AMMO3': '0.177', 'weapon2': '0.390', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.442', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '57.500'} [2024-08-06 04:35:49,031][52650] Updated weights for policy 0, policy_version 54671 (0.0023) [2024-08-06 04:35:49,836][52665] DAMAGECOUNT value on done: 532232.0 [2024-08-06 04:35:49,837][52665] Sum rewards: 75.069, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.162', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '66.000'} [2024-08-06 04:35:50,132][52662] DAMAGECOUNT value on done: 533437.0 [2024-08-06 04:35:50,133][52662] Sum rewards: 69.633, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.088', 'weapon4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:51,138][52660] DAMAGECOUNT value on done: 544304.0 [2024-08-06 04:35:51,142][52660] Sum rewards: 74.341, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.460', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.122', 'AMMO3': '0.145', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '3.082', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '58.000'} [2024-08-06 04:35:51,365][52663] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 04:35:51,411][52811] DAMAGECOUNT value on done: 512742.0 [2024-08-06 04:35:51,411][52811] Sum rewards: 67.882, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.180', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon5': '0.196', 'AMMO4': '0.240', 'AMMO3': '0.288', 'weapon2': '0.370', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.850', 'weapon3': '2.626', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:52,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 447930368. Throughput: 0: 4369.1. Samples: 111985750. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:35:52,794][52567] Avg episode reward: [(0, '72.015')] [2024-08-06 04:35:52,809][52665] DAMAGECOUNT value on done: 531044.0 [2024-08-06 04:35:52,810][52665] Sum rewards: 58.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.178', 'AMMO4': '0.188', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.160', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '51.000'} [2024-08-06 04:35:53,688][52650] Updated weights for policy 0, policy_version 54681 (0.0011) [2024-08-06 04:35:53,860][52660] DAMAGECOUNT value on done: 548506.0 [2024-08-06 04:35:53,860][52660] Sum rewards: 47.987, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.420', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.068', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.137', 'weapon7': '0.184', 'WEAPON7': '0.200', 'WEAPON3': '0.800', 'weapon2': '1.048', 'HITCOUNT': '2.120', 'weapon3': '2.334', 'DAMAGECOUNT': '10.662', 'FRAGCOUNT': '39.000'} [2024-08-06 04:35:54,601][52811] DAMAGECOUNT value on done: 499086.0 [2024-08-06 04:35:54,603][52811] Sum rewards: 73.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.000'} [2024-08-06 04:35:55,453][52665] DAMAGECOUNT value on done: 537984.0 [2024-08-06 04:35:55,455][52665] Sum rewards: 64.215, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon4': '0.084', 'AMMO3': '0.269', 'weapon2': '0.452', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '56.000'} [2024-08-06 04:35:56,798][52660] DAMAGECOUNT value on done: 532725.0 [2024-08-06 04:35:56,805][52660] Sum rewards: 60.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.495', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.122', 'AMMO4': '0.206', 'weapon5': '0.252', 'AMMO3': '0.273', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.880', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '55.000'} [2024-08-06 04:35:57,427][52659] DAMAGECOUNT value on done: 542655.0 [2024-08-06 04:35:57,427][52659] Sum rewards: 86.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.104', 'weapon5': '0.134', 'AMMO4': '0.141', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.456', 'FRAGCOUNT': '70.000'} [2024-08-06 04:35:57,764][52794] DAMAGECOUNT value on done: 541599.0 [2024-08-06 04:35:57,768][52794] Sum rewards: 81.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.560', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.055', 'weapon4': '0.174', 'AMMO3': '0.194', 'weapon5': '0.248', 'AMMO4': '0.277', 'weapon2': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '65.000'} [2024-08-06 04:35:57,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 448012288. Throughput: 0: 4366.9. Samples: 112011610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:35:57,794][52567] Avg episode reward: [(0, '71.614')] [2024-08-06 04:35:57,827][52811] DAMAGECOUNT value on done: 495374.0 [2024-08-06 04:35:57,829][52811] Sum rewards: 79.039, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.108', 'AMMO3': '0.198', 'AMMO4': '0.243', 'weapon5': '0.304', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '64.000'} [2024-08-06 04:35:58,503][52665] DAMAGECOUNT value on done: 530603.0 [2024-08-06 04:35:58,504][52665] Sum rewards: 81.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.268', 'weapon2': '0.378', 'WEAPON3': '1.550', 'weapon3': '3.426', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '69.000'} [2024-08-06 04:35:58,760][52650] Updated weights for policy 0, policy_version 54691 (0.0013) [2024-08-06 04:35:59,422][52660] DAMAGECOUNT value on done: 540797.0 [2024-08-06 04:35:59,424][52660] Sum rewards: 82.305, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.044', 'weapon4': '0.146', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.000', 'weapon3': '3.394', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '65.000'} [2024-08-06 04:36:00,057][52659] DAMAGECOUNT value on done: 536931.0 [2024-08-06 04:36:00,057][52659] Sum rewards: 69.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.892', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '57.000'} [2024-08-06 04:36:00,361][52794] DAMAGECOUNT value on done: 544172.0 [2024-08-06 04:36:00,361][52794] Sum rewards: 77.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.019', 'AMMO2': '0.062', 'AMMO3': '0.169', 'weapon5': '0.232', 'AMMO4': '0.312', 'weapon2': '0.376', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon4': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.398', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '65.000'} [2024-08-06 04:36:00,834][52811] DAMAGECOUNT value on done: 499438.0 [2024-08-06 04:36:00,835][52811] Sum rewards: 74.390, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.386', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'weapon2': '0.314', 'WEAPON3': '1.600', 'weapon3': '3.326', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '65.000'} [2024-08-06 04:36:00,922][52662] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:36:01,400][52665] DAMAGECOUNT value on done: 540128.0 [2024-08-06 04:36:01,401][52665] Sum rewards: 75.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.498', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO4': '0.223', 'AMMO3': '0.238', 'weapon5': '0.256', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 04:36:02,473][52660] DAMAGECOUNT value on done: 533469.0 [2024-08-06 04:36:02,475][52660] Sum rewards: 60.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.190', 'AMMO3': '0.214', 'weapon2': '0.222', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '50.000'} [2024-08-06 04:36:02,789][52659] DAMAGECOUNT value on done: 542708.0 [2024-08-06 04:36:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 448102400. Throughput: 0: 4370.4. Samples: 112024870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:36:02,800][52567] Avg episode reward: [(0, '71.684')] [2024-08-06 04:36:02,799][52659] Sum rewards: 74.203, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.387', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.048', 'weapon5': '0.052', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.668', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 04:36:03,055][52794] DAMAGECOUNT value on done: 543580.0 [2024-08-06 04:36:03,056][52794] Sum rewards: 79.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.172', 'weapon5': '0.214', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '63.500'} [2024-08-06 04:36:03,232][52650] Updated weights for policy 0, policy_version 54701 (0.0014) [2024-08-06 04:36:03,904][52811] DAMAGECOUNT value on done: 504414.0 [2024-08-06 04:36:03,904][52811] Sum rewards: 67.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.015', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.154', 'weapon4': '0.166', 'AMMO3': '0.211', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '56.000'} [2024-08-06 04:36:04,489][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:36:04,531][52665] DAMAGECOUNT value on done: 536881.0 [2024-08-06 04:36:04,531][52665] Sum rewards: 65.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.040', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.129', 'weapon5': '0.154', 'AMMO3': '0.187', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.240', 'weapon3': '3.366', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '54.000'} [2024-08-06 04:36:05,417][52660] DAMAGECOUNT value on done: 536655.0 [2024-08-06 04:36:05,418][52660] Sum rewards: 81.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.154', 'weapon5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.209', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '66.000'} [2024-08-06 04:36:05,626][52659] DAMAGECOUNT value on done: 538994.0 [2024-08-06 04:36:05,629][52659] Sum rewards: 61.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.124', 'AMMO3': '0.233', 'AMMO4': '0.269', 'weapon5': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.778', 'WEAPON3': '1.350', 'weapon3': '2.550', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '49.000'} [2024-08-06 04:36:05,653][52794] DAMAGECOUNT value on done: 535228.0 [2024-08-06 04:36:05,654][52794] Sum rewards: 68.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.592', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.180', 'weapon5': '0.180', 'weapon4': '0.230', 'AMMO4': '0.251', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.500'} [2024-08-06 04:36:07,038][52811] DAMAGECOUNT value on done: 508303.0 [2024-08-06 04:36:07,041][52811] Sum rewards: 75.563, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.160', 'AMMO3': '0.208', 'HEALTH': '0.280', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '62.000'} [2024-08-06 04:36:07,370][52665] DAMAGECOUNT value on done: 532906.0 [2024-08-06 04:36:07,374][52665] Sum rewards: 77.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.856', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.208', 'AMMO4': '0.231', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.554', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 04:36:07,621][52650] Updated weights for policy 0, policy_version 54711 (0.0013) [2024-08-06 04:36:07,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 448192512. Throughput: 0: 4362.6. Samples: 112050910. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:36:07,795][52567] Avg episode reward: [(0, '71.530')] [2024-08-06 04:36:08,306][52659] DAMAGECOUNT value on done: 534794.0 [2024-08-06 04:36:08,308][52659] Sum rewards: 69.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.029', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.086', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.328', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2024-08-06 04:36:08,474][52660] DAMAGECOUNT value on done: 526454.0 [2024-08-06 04:36:08,474][52660] Sum rewards: 73.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.782', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.186', 'weapon4': '0.234', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '60.000'} [2024-08-06 04:36:08,794][52794] DAMAGECOUNT value on done: 534656.0 [2024-08-06 04:36:08,795][52794] Sum rewards: 77.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.052', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '63.000'} [2024-08-06 04:36:10,101][52811] DAMAGECOUNT value on done: 505878.0 [2024-08-06 04:36:10,102][52811] Sum rewards: 69.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.184', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.738', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '57.000'} [2024-08-06 04:36:10,330][52665] DAMAGECOUNT value on done: 532376.0 [2024-08-06 04:36:10,330][52665] Sum rewards: 71.143, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.815', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.146', 'weapon2': '0.204', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:11,213][52659] DAMAGECOUNT value on done: 537380.0 [2024-08-06 04:36:11,215][52659] Sum rewards: 70.175, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.726', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon5': '0.192', 'weapon4': '0.268', 'AMMO3': '0.284', 'AMMO4': '0.296', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.910', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 04:36:11,843][52794] DAMAGECOUNT value on done: 535052.0 [2024-08-06 04:36:11,844][52794] Sum rewards: 65.242, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.040', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.130', 'AMMO4': '0.144', 'AMMO3': '0.147', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '0.900', 'HITCOUNT': '2.940', 'weapon3': '3.168', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '51.000'} [2024-08-06 04:36:12,793][52650] Updated weights for policy 0, policy_version 54721 (0.0025) [2024-08-06 04:36:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 448274432. Throughput: 0: 4367.1. Samples: 112077200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:36:12,801][52567] Avg episode reward: [(0, '71.422')] [2024-08-06 04:36:13,222][52811] DAMAGECOUNT value on done: 501775.0 [2024-08-06 04:36:13,224][52811] Sum rewards: 78.935, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO4': '0.137', 'AMMO3': '0.158', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '62.000'} [2024-08-06 04:36:13,646][52665] DAMAGECOUNT value on done: 529958.0 [2024-08-06 04:36:13,647][52665] Sum rewards: 82.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.196', 'weapon4': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '65.000'} [2024-08-06 04:36:14,304][52659] DAMAGECOUNT value on done: 538532.0 [2024-08-06 04:36:14,306][52659] Sum rewards: 80.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '66.000'} [2024-08-06 04:36:14,534][52794] DAMAGECOUNT value on done: 544670.0 [2024-08-06 04:36:14,534][52794] Sum rewards: 61.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.182', 'AMMO3': '0.229', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '53.000'} [2024-08-06 04:36:14,580][52803] DAMAGECOUNT value on done: 501562.0 [2024-08-06 04:36:14,580][52803] Sum rewards: 72.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.158', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.136', 'AMMO3': '0.208', 'AMMO4': '0.253', 'weapon5': '0.268', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.000'} [2024-08-06 04:36:16,319][52811] DAMAGECOUNT value on done: 508162.0 [2024-08-06 04:36:16,320][52811] Sum rewards: 75.784, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.617', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.118', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.916', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:16,677][52665] DAMAGECOUNT value on done: 527698.0 [2024-08-06 04:36:16,679][52665] Sum rewards: 74.248, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.593', 'AMMO5': '0.021', 'AMMO2': '0.066', 'AMMO3': '0.188', 'weapon4': '0.202', 'weapon5': '0.280', 'AMMO4': '0.330', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:17,040][52659] DAMAGECOUNT value on done: 536155.0 [2024-08-06 04:36:17,040][52659] Sum rewards: 73.927, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.892', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.201', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '60.000'} [2024-08-06 04:36:17,114][52650] Updated weights for policy 0, policy_version 54731 (0.0024) [2024-08-06 04:36:17,286][52794] DAMAGECOUNT value on done: 532338.0 [2024-08-06 04:36:17,287][52794] Sum rewards: 63.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.224', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon4': '0.190', 'weapon5': '0.212', 'AMMO3': '0.261', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.932', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '54.000'} [2024-08-06 04:36:17,695][52803] DAMAGECOUNT value on done: 500105.0 [2024-08-06 04:36:17,695][52803] Sum rewards: 78.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.426', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.126', 'AMMO3': '0.185', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '64.000'} [2024-08-06 04:36:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 448364544. Throughput: 0: 4367.8. Samples: 112090320. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:36:17,795][52567] Avg episode reward: [(0, '72.157')] [2024-08-06 04:36:19,504][52811] DAMAGECOUNT value on done: 504027.0 [2024-08-06 04:36:19,504][52811] Sum rewards: 82.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.948', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.048', 'AMMO4': '0.137', 'AMMO3': '0.182', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '67.000'} [2024-08-06 04:36:19,846][52665] DAMAGECOUNT value on done: 530986.0 [2024-08-06 04:36:19,846][52665] Sum rewards: 66.842, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.116', 'weapon5': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.258', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '57.000'} [2024-08-06 04:36:20,088][52659] DAMAGECOUNT value on done: 542305.0 [2024-08-06 04:36:20,088][52659] Sum rewards: 62.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.138', 'weapon5': '0.138', 'AMMO4': '0.211', 'AMMO3': '0.232', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.126', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '54.000'} [2024-08-06 04:36:20,190][52794] DAMAGECOUNT value on done: 541534.0 [2024-08-06 04:36:20,192][52794] Sum rewards: 73.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.985', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.118', 'AMMO4': '0.132', 'weapon5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:20,860][52803] DAMAGECOUNT value on done: 506950.0 [2024-08-06 04:36:20,862][52803] Sum rewards: 68.658, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.570', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.312', 'weapon2': '0.556', 'WEAPON3': '1.900', 'weapon3': '3.082', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:22,174][52650] Updated weights for policy 0, policy_version 54741 (0.0015) [2024-08-06 04:36:22,591][52811] DAMAGECOUNT value on done: 503848.0 [2024-08-06 04:36:22,591][52811] Sum rewards: 65.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.038', 'weapon5': '0.086', 'AMMO4': '0.190', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2024-08-06 04:36:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 448454656. Throughput: 0: 4367.8. Samples: 112116510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:36:22,794][52567] Avg episode reward: [(0, '71.938')] [2024-08-06 04:36:22,943][52665] DAMAGECOUNT value on done: 527903.0 [2024-08-06 04:36:22,943][52665] Sum rewards: 75.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.108', 'AMMO4': '0.175', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '64.000'} [2024-08-06 04:36:22,988][52659] DAMAGECOUNT value on done: 545910.0 [2024-08-06 04:36:22,989][52659] Sum rewards: 61.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.146', 'weapon2': '0.220', 'AMMO3': '0.223', 'weapon5': '0.236', 'AMMO4': '0.283', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.072', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '52.000'} [2024-08-06 04:36:23,077][52794] DAMAGECOUNT value on done: 537851.0 [2024-08-06 04:36:23,077][52794] Sum rewards: 59.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.814', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.686', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '2.988', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '50.000'} [2024-08-06 04:36:24,081][52803] DAMAGECOUNT value on done: 507501.0 [2024-08-06 04:36:24,081][52803] Sum rewards: 64.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.008', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.184', 'AMMO3': '0.186', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.144', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '52.000'} [2024-08-06 04:36:25,613][52811] DAMAGECOUNT value on done: 513871.0 [2024-08-06 04:36:25,616][52811] Sum rewards: 66.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon5': '0.192', 'AMMO3': '0.258', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '55.000'} [2024-08-06 04:36:25,664][52794] DAMAGECOUNT value on done: 533480.0 [2024-08-06 04:36:25,664][52794] Sum rewards: 73.282, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.545', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.142', 'weapon5': '0.176', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '63.000'} [2024-08-06 04:36:25,758][52659] DAMAGECOUNT value on done: 535497.0 [2024-08-06 04:36:25,758][52659] Sum rewards: 67.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.125', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.214', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.324', 'weapon4': '0.362', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '56.000'} [2024-08-06 04:36:26,161][52665] DAMAGECOUNT value on done: 531237.0 [2024-08-06 04:36:26,162][52665] Sum rewards: 69.979, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.116', 'AMMO3': '0.158', 'weapon4': '0.228', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.010', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '56.000'} [2024-08-06 04:36:26,587][52650] Updated weights for policy 0, policy_version 54751 (0.0027) [2024-08-06 04:36:27,338][52803] DAMAGECOUNT value on done: 503985.0 [2024-08-06 04:36:27,340][52803] Sum rewards: 62.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.178', 'AMMO4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.830', 'weapon3': '3.128', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '53.000'} [2024-08-06 04:36:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 448536576. Throughput: 0: 4364.7. Samples: 112142570. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 04:36:27,802][52567] Avg episode reward: [(0, '71.889')] [2024-08-06 04:36:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000054753_448536576.pth... [2024-08-06 04:36:27,946][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000054241_444342272.pth [2024-08-06 04:36:28,432][52794] DAMAGECOUNT value on done: 538834.0 [2024-08-06 04:36:28,436][52794] Sum rewards: 72.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.418', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:28,480][52659] DAMAGECOUNT value on done: 541113.0 [2024-08-06 04:36:28,480][52659] Sum rewards: 79.939, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.052', 'weapon5': '0.104', 'HEALTH': '0.170', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON3': '1.000', 'weapon3': '3.412', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '63.000'} [2024-08-06 04:36:28,725][52811] DAMAGECOUNT value on done: 501037.0 [2024-08-06 04:36:28,725][52811] Sum rewards: 69.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.039', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.243', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 04:36:29,282][52665] DAMAGECOUNT value on done: 532517.0 [2024-08-06 04:36:29,282][52665] Sum rewards: 70.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.090', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:30,455][52803] DAMAGECOUNT value on done: 495427.0 [2024-08-06 04:36:30,455][52803] Sum rewards: 77.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.186', 'weapon5': '0.190', 'weapon4': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:31,018][52659] DAMAGECOUNT value on done: 532168.0 [2024-08-06 04:36:31,019][52659] Sum rewards: 73.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.712', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.122', 'weapon4': '0.206', 'AMMO4': '0.212', 'weapon2': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '63.000'} [2024-08-06 04:36:31,340][52650] Updated weights for policy 0, policy_version 54761 (0.0013) [2024-08-06 04:36:31,587][52794] DAMAGECOUNT value on done: 533857.0 [2024-08-06 04:36:31,589][52794] Sum rewards: 67.208, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.499', 'AMMO5': '0.029', 'AMMO2': '0.063', 'AMMO3': '0.232', 'weapon4': '0.236', 'AMMO4': '0.315', 'weapon5': '0.398', 'weapon2': '0.478', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.504', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '57.000'} [2024-08-06 04:36:31,896][52811] DAMAGECOUNT value on done: 499556.0 [2024-08-06 04:36:31,896][52811] Sum rewards: 73.274, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.136', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.414', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 448626688. Throughput: 0: 4360.7. Samples: 112155470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:36:32,794][52567] Avg episode reward: [(0, '72.185')] [2024-08-06 04:36:33,617][52803] DAMAGECOUNT value on done: 498667.0 [2024-08-06 04:36:33,620][52803] Sum rewards: 74.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.194', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.610', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:33,682][52659] DAMAGECOUNT value on done: 537060.0 [2024-08-06 04:36:33,682][52659] Sum rewards: 72.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.137', 'AMMO3': '0.159', 'WEAPON5': '0.300', 'weapon4': '0.328', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '58.000'} [2024-08-06 04:36:34,866][52794] DAMAGECOUNT value on done: 553080.0 [2024-08-06 04:36:34,867][52794] Sum rewards: 80.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.140', 'AMMO4': '0.193', 'weapon5': '0.198', 'AMMO3': '0.212', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '66.000'} [2024-08-06 04:36:34,983][52811] DAMAGECOUNT value on done: 503874.0 [2024-08-06 04:36:34,986][52811] Sum rewards: 63.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'weapon5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '3.218', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '14.979', 'FRAGCOUNT': '53.000'} [2024-08-06 04:36:36,158][52650] Updated weights for policy 0, policy_version 54771 (0.0023) [2024-08-06 04:36:36,414][52659] DAMAGECOUNT value on done: 548629.0 [2024-08-06 04:36:36,415][52659] Sum rewards: 68.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.172', 'AMMO5': '0.022', 'AMMO2': '0.066', 'weapon4': '0.120', 'weapon5': '0.194', 'AMMO3': '0.224', 'weapon2': '0.292', 'AMMO4': '0.328', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 04:36:36,786][52803] DAMAGECOUNT value on done: 496127.0 [2024-08-06 04:36:36,789][52803] Sum rewards: 65.308, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.698', 'AMMO5': '0.025', 'AMMO2': '0.057', 'weapon5': '0.126', 'weapon4': '0.144', 'AMMO3': '0.240', 'AMMO4': '0.285', 'weapon2': '0.436', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:37,587][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:36:37,745][52794] DAMAGECOUNT value on done: 531724.0 [2024-08-06 04:36:37,745][52794] Sum rewards: 68.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.212', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.176', 'weapon4': '0.186', 'AMMO3': '0.191', 'AMMO4': '0.231', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.144', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '54.000'} [2024-08-06 04:36:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 448708608. Throughput: 0: 4353.8. Samples: 112181670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:36:37,795][52567] Avg episode reward: [(0, '72.019')] [2024-08-06 04:36:38,135][52811] DAMAGECOUNT value on done: 500387.0 [2024-08-06 04:36:38,135][52811] Sum rewards: 71.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:39,357][52659] DAMAGECOUNT value on done: 541337.0 [2024-08-06 04:36:39,367][52659] Sum rewards: 75.165, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.140', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '58.000'} [2024-08-06 04:36:39,945][52803] DAMAGECOUNT value on done: 501459.0 [2024-08-06 04:36:39,948][52803] Sum rewards: 75.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '62.000'} [2024-08-06 04:36:40,867][52794] DAMAGECOUNT value on done: 548535.0 [2024-08-06 04:36:40,869][52794] Sum rewards: 76.617, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.737', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.130', 'weapon4': '0.138', 'AMMO4': '0.160', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '64.000'} [2024-08-06 04:36:40,885][52650] Updated weights for policy 0, policy_version 54781 (0.0030) [2024-08-06 04:36:41,027][52663] DAMAGECOUNT value on done: 547545.0 [2024-08-06 04:36:41,028][52663] Sum rewards: 72.707, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.066', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.314', 'weapon2': '0.396', 'WEAPON3': '1.800', 'weapon3': '3.246', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '64.000'} [2024-08-06 04:36:41,214][52811] DAMAGECOUNT value on done: 506185.0 [2024-08-06 04:36:41,214][52811] Sum rewards: 82.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.469', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.134', 'AMMO3': '0.200', 'AMMO4': '0.204', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '68.000'} [2024-08-06 04:36:42,293][52659] DAMAGECOUNT value on done: 547694.0 [2024-08-06 04:36:42,295][52659] Sum rewards: 84.838, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.294', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO4': '0.223', 'AMMO3': '0.247', 'weapon5': '0.266', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '21.048', 'FRAGCOUNT': '70.000'} [2024-08-06 04:36:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 448798720. Throughput: 0: 4354.4. Samples: 112207560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:36:42,794][52567] Avg episode reward: [(0, '72.406')] [2024-08-06 04:36:43,140][52803] DAMAGECOUNT value on done: 493872.0 [2024-08-06 04:36:43,140][52803] Sum rewards: 68.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.481', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.146', 'AMMO3': '0.205', 'weapon2': '0.214', 'weapon5': '0.260', 'AMMO4': '0.266', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '54.000'} [2024-08-06 04:36:43,937][52663] DAMAGECOUNT value on done: 538737.0 [2024-08-06 04:36:43,937][52663] Sum rewards: 75.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.416', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.056', 'AMMO4': '0.141', 'weapon5': '0.166', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '64.000'} [2024-08-06 04:36:43,984][52663] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2024-08-06 04:36:44,246][52794] DAMAGECOUNT value on done: 538861.0 [2024-08-06 04:36:44,246][52794] Sum rewards: 67.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.118', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.145', 'AMMO3': '0.194', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.076', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '55.000'} [2024-08-06 04:36:44,293][52811] DAMAGECOUNT value on done: 507295.0 [2024-08-06 04:36:44,293][52811] Sum rewards: 65.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.167', 'AMMO3': '0.202', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '54.000'} [2024-08-06 04:36:45,285][52659] DAMAGECOUNT value on done: 538802.0 [2024-08-06 04:36:45,287][52659] Sum rewards: 66.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.664', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.120', 'AMMO4': '0.201', 'weapon5': '0.214', 'AMMO3': '0.215', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.088', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '56.000'} [2024-08-06 04:36:45,438][52650] Updated weights for policy 0, policy_version 54791 (0.0044) [2024-08-06 04:36:45,663][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 04:36:46,179][52803] DAMAGECOUNT value on done: 510291.0 [2024-08-06 04:36:46,182][52803] Sum rewards: 82.581, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.090', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '69.000'} [2024-08-06 04:36:46,648][52663] DAMAGECOUNT value on done: 527283.0 [2024-08-06 04:36:46,648][52663] Sum rewards: 55.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.184', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '46.000'} [2024-08-06 04:36:46,824][52794] DAMAGECOUNT value on done: 547206.0 [2024-08-06 04:36:46,825][52794] Sum rewards: 73.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.195', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.078', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon4': '0.288', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '60.500'} [2024-08-06 04:36:47,227][52811] DAMAGECOUNT value on done: 500765.0 [2024-08-06 04:36:47,227][52811] Sum rewards: 74.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.630', 'AMMO5': '0.012', 'AMMO2': '0.056', 'AMMO3': '0.186', 'weapon5': '0.260', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON4': '0.550', 'weapon4': '0.708', 'WEAPON3': '1.100', 'weapon3': '2.260', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 448880640. Throughput: 0: 4345.6. Samples: 112220420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:36:47,794][52567] Avg episode reward: [(0, '71.922')] [2024-08-06 04:36:48,158][52794] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:36:48,268][52659] DAMAGECOUNT value on done: 543610.0 [2024-08-06 04:36:48,269][52659] Sum rewards: 82.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.661', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.236', 'WEAPON3': '1.500', 'weapon3': '3.376', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '68.000'} [2024-08-06 04:36:49,245][52803] DAMAGECOUNT value on done: 502477.0 [2024-08-06 04:36:49,246][52803] Sum rewards: 58.609, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.018', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '47.000'} [2024-08-06 04:36:49,390][52663] DAMAGECOUNT value on done: 535331.0 [2024-08-06 04:36:49,390][52663] Sum rewards: 76.418, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.525', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.058', 'weapon4': '0.108', 'weapon5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.246', 'AMMO4': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '66.000'} [2024-08-06 04:36:49,650][52794] DAMAGECOUNT value on done: 547836.0 [2024-08-06 04:36:49,652][52794] Sum rewards: 65.123, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.556', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.121', 'weapon5': '0.124', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '52.000'} [2024-08-06 04:36:50,160][52811] DAMAGECOUNT value on done: 500950.0 [2024-08-06 04:36:50,161][52811] Sum rewards: 64.636, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.860', 'AMMO5': '0.016', 'AMMO2': '0.065', 'weapon5': '0.244', 'AMMO3': '0.251', 'weapon2': '0.276', 'weapon4': '0.282', 'AMMO4': '0.328', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '57.000'} [2024-08-06 04:36:50,410][52650] Updated weights for policy 0, policy_version 54801 (0.0015) [2024-08-06 04:36:51,457][52666] DAMAGECOUNT value on done: 538132.0 [2024-08-06 04:36:51,457][52666] Sum rewards: 76.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.174', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon2': '0.194', 'AMMO4': '0.221', 'weapon5': '0.260', 'AMMO3': '0.293', 'WEAPON5': '0.450', 'weapon4': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.746', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '65.000'} [2024-08-06 04:36:51,661][52659] DAMAGECOUNT value on done: 538724.0 [2024-08-06 04:36:51,661][52659] Sum rewards: 67.309, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.275', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.088', 'weapon4': '0.134', 'AMMO3': '0.187', 'weapon2': '0.404', 'WEAPON3': '1.050', 'HITCOUNT': '3.210', 'weapon3': '3.328', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2024-08-06 04:36:52,259][52663] DAMAGECOUNT value on done: 539053.0 [2024-08-06 04:36:52,259][52663] Sum rewards: 78.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.152', 'AMMO3': '0.187', 'weapon5': '0.242', 'AMMO4': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.828', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '65.000'} [2024-08-06 04:36:52,453][52803] DAMAGECOUNT value on done: 498736.0 [2024-08-06 04:36:52,455][52803] Sum rewards: 75.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.300', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.174', 'AMMO3': '0.224', 'weapon2': '0.254', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 04:36:52,481][52794] DAMAGECOUNT value on done: 535774.0 [2024-08-06 04:36:52,482][52794] Sum rewards: 71.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.625', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.174', 'AMMO4': '0.189', 'weapon5': '0.216', 'weapon4': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '58.000'} [2024-08-06 04:36:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 448970752. Throughput: 0: 4354.5. Samples: 112246860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:36:52,794][52567] Avg episode reward: [(0, '71.576')] [2024-08-06 04:36:54,128][52670] DAMAGECOUNT value on done: 528173.0 [2024-08-06 04:36:54,129][52670] Sum rewards: 80.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.035', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.172', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.628', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '68.000'} [2024-08-06 04:36:54,573][52650] Updated weights for policy 0, policy_version 54811 (0.0018) [2024-08-06 04:36:54,598][52666] DAMAGECOUNT value on done: 539971.0 [2024-08-06 04:36:54,598][52666] Sum rewards: 68.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon4': '0.162', 'AMMO3': '0.239', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '58.000'} [2024-08-06 04:36:54,862][52667] DAMAGECOUNT value on done: 541404.0 [2024-08-06 04:36:54,862][52667] Sum rewards: 72.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.028', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon2': '0.208', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'HITCOUNT': '3.490', 'weapon3': '3.566', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:55,336][52663] DAMAGECOUNT value on done: 546543.0 [2024-08-06 04:36:55,337][52663] Sum rewards: 84.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.826', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.134', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.224', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '21.051', 'FRAGCOUNT': '67.000'} [2024-08-06 04:36:55,444][52803] DAMAGECOUNT value on done: 510942.0 [2024-08-06 04:36:55,452][52803] Sum rewards: 83.557, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.347', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.069', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.838', 'FRAGCOUNT': '70.000'} [2024-08-06 04:36:56,479][52649] DAMAGECOUNT value on done: 521638.0 [2024-08-06 04:36:56,479][52649] Sum rewards: 73.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.632', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.124', 'weapon5': '0.180', 'AMMO3': '0.195', 'AMMO4': '0.227', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '62.000'} [2024-08-06 04:36:57,274][52670] DAMAGECOUNT value on done: 539023.0 [2024-08-06 04:36:57,274][52670] Sum rewards: 72.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'weapon4': '0.190', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:57,627][52666] DAMAGECOUNT value on done: 541386.0 [2024-08-06 04:36:57,629][52666] Sum rewards: 75.378, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.495', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO3': '0.138', 'AMMO4': '0.148', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '59.000'} [2024-08-06 04:36:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 449060864. Throughput: 0: 4359.8. Samples: 112273390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:36:57,794][52567] Avg episode reward: [(0, '72.526')] [2024-08-06 04:36:57,966][52667] DAMAGECOUNT value on done: 550063.0 [2024-08-06 04:36:57,966][52667] Sum rewards: 69.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '58.000'} [2024-08-06 04:36:58,326][52663] DAMAGECOUNT value on done: 540244.0 [2024-08-06 04:36:58,326][52663] Sum rewards: 67.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.142', 'weapon5': '0.182', 'AMMO3': '0.201', 'AMMO4': '0.205', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '55.000'} [2024-08-06 04:36:58,621][52803] DAMAGECOUNT value on done: 501267.0 [2024-08-06 04:36:58,622][52803] Sum rewards: 69.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.280', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.270', 'weapon2': '0.482', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '61.000'} [2024-08-06 04:36:59,223][52649] DAMAGECOUNT value on done: 514599.0 [2024-08-06 04:36:59,224][52649] Sum rewards: 61.322, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.212', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.144', 'weapon4': '0.154', 'weapon2': '0.238', 'AMMO4': '0.286', 'AMMO3': '0.289', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.156', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2024-08-06 04:36:59,450][52650] Updated weights for policy 0, policy_version 54821 (0.0030) [2024-08-06 04:36:59,508][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:37:00,402][52670] DAMAGECOUNT value on done: 531502.0 [2024-08-06 04:37:00,404][52670] Sum rewards: 73.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.586', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.112', 'AMMO3': '0.180', 'AMMO4': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:00,767][52666] DAMAGECOUNT value on done: 539530.0 [2024-08-06 04:37:00,768][52666] Sum rewards: 73.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.499', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.122', 'AMMO4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '59.500'} [2024-08-06 04:37:01,162][52663] DAMAGECOUNT value on done: 535322.0 [2024-08-06 04:37:01,163][52663] Sum rewards: 76.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.382', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.044', 'AMMO4': '0.187', 'AMMO3': '0.212', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.500'} [2024-08-06 04:37:01,193][52667] DAMAGECOUNT value on done: 539394.0 [2024-08-06 04:37:01,195][52667] Sum rewards: 68.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.072', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.113', 'weapon4': '0.170', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 04:37:01,794][52803] DAMAGECOUNT value on done: 500419.0 [2024-08-06 04:37:01,794][52803] Sum rewards: 74.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.223', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:02,095][52649] DAMAGECOUNT value on done: 530445.0 [2024-08-06 04:37:02,095][52649] Sum rewards: 71.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 449142784. Throughput: 0: 4355.3. Samples: 112286310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:37:02,794][52567] Avg episode reward: [(0, '71.908')] [2024-08-06 04:37:03,022][52670] DAMAGECOUNT value on done: 531241.0 [2024-08-06 04:37:03,024][52670] Sum rewards: 66.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.572', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.058', 'weapon5': '0.080', 'AMMO4': '0.110', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:03,267][52666] DAMAGECOUNT value on done: 537901.0 [2024-08-06 04:37:03,269][52666] Sum rewards: 74.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.114', 'weapon5': '0.184', 'AMMO3': '0.229', 'AMMO4': '0.241', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '2.860', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '64.000'} [2024-08-06 04:37:03,865][52667] DAMAGECOUNT value on done: 541176.0 [2024-08-06 04:37:03,865][52667] Sum rewards: 73.737, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.981', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.147', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:04,038][52650] Updated weights for policy 0, policy_version 54831 (0.0010) [2024-08-06 04:37:04,324][52663] DAMAGECOUNT value on done: 531446.0 [2024-08-06 04:37:04,324][52663] Sum rewards: 63.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.190', 'AMMO4': '0.220', 'AMMO3': '0.285', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '3.130', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:04,880][52803] DAMAGECOUNT value on done: 504508.0 [2024-08-06 04:37:04,881][52803] Sum rewards: 69.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.209', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO4': '0.141', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:05,120][52649] DAMAGECOUNT value on done: 526407.0 [2024-08-06 04:37:05,121][52649] Sum rewards: 71.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.566', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon2': '0.170', 'AMMO4': '0.185', 'AMMO3': '0.220', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:05,532][52670] DAMAGECOUNT value on done: 542292.0 [2024-08-06 04:37:05,533][52670] Sum rewards: 67.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.226', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.101', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.138', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '55.000'} [2024-08-06 04:37:05,877][52666] DAMAGECOUNT value on done: 532644.0 [2024-08-06 04:37:05,885][52666] Sum rewards: 76.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.928', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.130', 'AMMO4': '0.194', 'weapon5': '0.236', 'AMMO3': '0.261', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '64.000'} [2024-08-06 04:37:06,545][52667] DAMAGECOUNT value on done: 545922.0 [2024-08-06 04:37:06,547][52667] Sum rewards: 88.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.488', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.134', 'weapon5': '0.174', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '71.000'} [2024-08-06 04:37:07,282][52663] DAMAGECOUNT value on done: 539116.0 [2024-08-06 04:37:07,284][52663] Sum rewards: 67.125, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.165', 'AMMO3': '0.167', 'weapon2': '0.274', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '55.000'} [2024-08-06 04:37:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 449232896. Throughput: 0: 4357.8. Samples: 112312610. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:37:07,794][52567] Avg episode reward: [(0, '71.897')] [2024-08-06 04:37:07,932][52803] DAMAGECOUNT value on done: 505508.0 [2024-08-06 04:37:07,932][52803] Sum rewards: 74.680, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.168', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.130', 'AMMO4': '0.131', 'weapon5': '0.176', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.766', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:08,182][52649] DAMAGECOUNT value on done: 516882.0 [2024-08-06 04:37:08,183][52649] Sum rewards: 72.258, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.070', 'weapon4': '0.166', 'AMMO4': '0.196', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:08,292][52670] DAMAGECOUNT value on done: 536331.0 [2024-08-06 04:37:08,292][52670] Sum rewards: 63.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon5': '0.036', 'AMMO4': '0.111', 'weapon4': '0.124', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.834', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '53.000'} [2024-08-06 04:37:08,596][52650] Updated weights for policy 0, policy_version 54841 (0.0012) [2024-08-06 04:37:08,809][52794] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2024-08-06 04:37:08,826][52666] DAMAGECOUNT value on done: 536306.0 [2024-08-06 04:37:08,827][52666] Sum rewards: 66.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.145', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.080', 'AMMO4': '0.202', 'weapon5': '0.210', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:09,417][52667] DAMAGECOUNT value on done: 548557.0 [2024-08-06 04:37:09,418][52667] Sum rewards: 57.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.014', 'AMMO5': '0.025', 'AMMO2': '0.077', 'weapon4': '0.170', 'weapon5': '0.224', 'AMMO3': '0.261', 'weapon2': '0.316', 'AMMO4': '0.383', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.996', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '50.000'} [2024-08-06 04:37:10,512][52663] DAMAGECOUNT value on done: 546363.0 [2024-08-06 04:37:10,515][52663] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.382', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:10,996][52803] DAMAGECOUNT value on done: 508230.0 [2024-08-06 04:37:11,004][52803] Sum rewards: 62.450, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.694', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.131', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.330', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '53.000'} [2024-08-06 04:37:11,343][52649] DAMAGECOUNT value on done: 528017.0 [2024-08-06 04:37:11,343][52649] Sum rewards: 75.406, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.326', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.174', 'weapon5': '0.180', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:11,537][52670] DAMAGECOUNT value on done: 524399.0 [2024-08-06 04:37:11,540][52670] Sum rewards: 56.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.893', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.228', 'weapon2': '0.334', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.098', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '48.000'} [2024-08-06 04:37:11,973][52666] DAMAGECOUNT value on done: 535473.0 [2024-08-06 04:37:11,973][52666] Sum rewards: 76.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.250', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.149', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '61.000'} [2024-08-06 04:37:12,602][52667] DAMAGECOUNT value on done: 541897.0 [2024-08-06 04:37:12,602][52667] Sum rewards: 77.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.603', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.124', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.224', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.394', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 449323008. Throughput: 0: 4362.5. Samples: 112338880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:37:12,794][52567] Avg episode reward: [(0, '71.385')] [2024-08-06 04:37:13,205][52663] DAMAGECOUNT value on done: 534520.0 [2024-08-06 04:37:13,207][52663] Sum rewards: 76.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.072', 'AMMO4': '0.093', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:13,498][52665] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:37:13,639][52650] Updated weights for policy 0, policy_version 54851 (0.0023) [2024-08-06 04:37:14,065][52649] DAMAGECOUNT value on done: 524311.0 [2024-08-06 04:37:14,065][52649] Sum rewards: 70.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.025', 'AMMO2': '0.040', 'weapon4': '0.106', 'AMMO3': '0.156', 'AMMO4': '0.202', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.666', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '56.500'} [2024-08-06 04:37:14,242][52803] DAMAGECOUNT value on done: 499237.0 [2024-08-06 04:37:14,243][52803] Sum rewards: 78.688, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.258', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '68.000'} [2024-08-06 04:37:14,645][52670] DAMAGECOUNT value on done: 535971.0 [2024-08-06 04:37:14,645][52670] Sum rewards: 74.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '62.500'} [2024-08-06 04:37:15,109][52666] DAMAGECOUNT value on done: 536623.0 [2024-08-06 04:37:15,110][52666] Sum rewards: 84.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.255', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.208', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '70.000'} [2024-08-06 04:37:15,280][52647] DAMAGECOUNT value on done: 569907.0 [2024-08-06 04:37:15,280][52647] Sum rewards: 73.988, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.434', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.212', 'AMMO3': '0.253', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:15,571][52667] DAMAGECOUNT value on done: 536712.0 [2024-08-06 04:37:15,574][52667] Sum rewards: 63.008, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.538', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.124', 'weapon5': '0.166', 'AMMO4': '0.229', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.592', 'WEAPON3': '1.450', 'weapon3': '2.838', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '54.000'} [2024-08-06 04:37:16,159][52670] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0), ('weapon5', 0.002)] [2024-08-06 04:37:16,315][52663] DAMAGECOUNT value on done: 531936.0 [2024-08-06 04:37:16,317][52663] Sum rewards: 67.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.102', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.066', 'AMMO3': '0.191', 'AMMO4': '0.200', 'weapon5': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:17,127][52649] DAMAGECOUNT value on done: 527243.0 [2024-08-06 04:37:17,128][52649] Sum rewards: 61.690, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.188', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.244', 'weapon2': '0.454', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.216', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '53.000'} [2024-08-06 04:37:17,618][52670] DAMAGECOUNT value on done: 530977.0 [2024-08-06 04:37:17,618][52670] Sum rewards: 81.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO3': '0.196', 'AMMO4': '0.196', 'weapon4': '0.280', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '66.000'} [2024-08-06 04:37:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 449413120. Throughput: 0: 4371.8. Samples: 112352200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:37:17,794][52567] Avg episode reward: [(0, '71.507')] [2024-08-06 04:37:17,913][52667] DAMAGECOUNT value on done: 546004.0 [2024-08-06 04:37:17,915][52667] Sum rewards: 66.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.072', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.064', 'AMMO4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:17,935][52647] DAMAGECOUNT value on done: 569957.0 [2024-08-06 04:37:17,936][52647] Sum rewards: 73.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.172', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.097', 'weapon2': '0.168', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.406', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:17,993][52666] DAMAGECOUNT value on done: 530575.0 [2024-08-06 04:37:17,993][52666] Sum rewards: 70.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.110', 'weapon5': '0.184', 'AMMO4': '0.218', 'weapon2': '0.236', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:18,236][52650] Updated weights for policy 0, policy_version 54861 (0.0027) [2024-08-06 04:37:19,615][52663] DAMAGECOUNT value on done: 531544.0 [2024-08-06 04:37:19,617][52663] Sum rewards: 60.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.820', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.206', 'AMMO3': '0.221', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '51.500'} [2024-08-06 04:37:19,930][52649] DAMAGECOUNT value on done: 530455.0 [2024-08-06 04:37:19,930][52649] Sum rewards: 69.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.070', 'AMMO4': '0.155', 'weapon4': '0.174', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:20,742][52647] DAMAGECOUNT value on done: 567106.0 [2024-08-06 04:37:20,743][52647] Sum rewards: 71.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.154', 'AMMO2': '0.005', 'AMMO5': '0.012', 'weapon4': '0.018', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.968', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:20,773][52667] DAMAGECOUNT value on done: 547881.0 [2024-08-06 04:37:20,773][52667] Sum rewards: 67.480, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.322', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.301', 'weapon2': '0.420', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:20,797][52670] DAMAGECOUNT value on done: 530094.0 [2024-08-06 04:37:20,798][52670] Sum rewards: 63.652, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.150', 'weapon2': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.299', 'WEAPON3': '1.700', 'HITCOUNT': '2.980', 'weapon3': '3.418', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '58.000'} [2024-08-06 04:37:21,184][52666] DAMAGECOUNT value on done: 535702.0 [2024-08-06 04:37:21,185][52666] Sum rewards: 73.743, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'HEALTH': '0.109', 'AMMO3': '0.201', 'weapon5': '0.202', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:21,611][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:37:22,481][52663] DAMAGECOUNT value on done: 532664.0 [2024-08-06 04:37:22,482][52663] Sum rewards: 65.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.428', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.198', 'weapon5': '0.218', 'weapon2': '0.222', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.190', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '55.000'} [2024-08-06 04:37:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 449495040. Throughput: 0: 4368.9. Samples: 112378270. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:37:22,795][52567] Avg episode reward: [(0, '71.670')] [2024-08-06 04:37:22,865][52650] Updated weights for policy 0, policy_version 54871 (0.0013) [2024-08-06 04:37:22,933][52649] DAMAGECOUNT value on done: 521098.0 [2024-08-06 04:37:22,934][52649] Sum rewards: 64.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.268', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.134', 'weapon4': '0.140', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.114', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:23,360][52647] DAMAGECOUNT value on done: 575049.0 [2024-08-06 04:37:23,360][52647] Sum rewards: 59.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.186', 'AMMO3': '0.229', 'AMMO4': '0.287', 'weapon2': '0.356', 'WEAPON5': '0.400', 'weapon4': '0.488', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.688', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '49.500'} [2024-08-06 04:37:23,742][52667] DAMAGECOUNT value on done: 536001.0 [2024-08-06 04:37:23,742][52667] Sum rewards: 72.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.406', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:23,789][52670] DAMAGECOUNT value on done: 538906.0 [2024-08-06 04:37:23,789][52670] Sum rewards: 76.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.048', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.420', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '65.000'} [2024-08-06 04:37:24,224][52666] DAMAGECOUNT value on done: 530340.0 [2024-08-06 04:37:24,225][52666] Sum rewards: 80.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.348', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.122', 'weapon5': '0.142', 'weapon2': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'weapon3': '3.416', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '67.000'} [2024-08-06 04:37:25,397][52663] DAMAGECOUNT value on done: 544237.0 [2024-08-06 04:37:25,399][52663] Sum rewards: 65.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.148', 'AMMO4': '0.221', 'weapon2': '0.230', 'AMMO3': '0.266', 'weapon5': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.054', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:25,753][52649] DAMAGECOUNT value on done: 530054.0 [2024-08-06 04:37:25,756][52649] Sum rewards: 62.487, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.537', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.162', 'weapon5': '0.190', 'AMMO4': '0.240', 'AMMO3': '0.255', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:25,857][52647] DAMAGECOUNT value on done: 575512.0 [2024-08-06 04:37:25,857][52647] Sum rewards: 76.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.440', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.148', 'weapon5': '0.156', 'weapon2': '0.178', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.900', 'weapon3': '3.296', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '66.000'} [2024-08-06 04:37:26,710][52667] DAMAGECOUNT value on done: 539279.0 [2024-08-06 04:37:26,711][52667] Sum rewards: 80.599, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.822', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.150', 'weapon2': '0.176', 'AMMO4': '0.199', 'AMMO3': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.302', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '70.000'} [2024-08-06 04:37:27,003][52670] DAMAGECOUNT value on done: 529320.0 [2024-08-06 04:37:27,004][52670] Sum rewards: 76.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.542', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.138', 'AMMO3': '0.192', 'AMMO4': '0.215', 'weapon5': '0.230', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '61.000'} [2024-08-06 04:37:27,453][52666] DAMAGECOUNT value on done: 542763.0 [2024-08-06 04:37:27,455][52666] Sum rewards: 64.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.014', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.082', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.000', 'HITCOUNT': '2.840', 'weapon3': '3.272', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '53.000'} [2024-08-06 04:37:27,649][52650] Updated weights for policy 0, policy_version 54881 (0.0033) [2024-08-06 04:37:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 449585152. Throughput: 0: 4378.0. Samples: 112404570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:37:27,794][52567] Avg episode reward: [(0, '71.364')] [2024-08-06 04:37:28,426][52647] DAMAGECOUNT value on done: 574404.0 [2024-08-06 04:37:28,426][52647] Sum rewards: 84.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.121', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'weapon4': '0.172', 'weapon2': '0.176', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.420', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '69.000'} [2024-08-06 04:37:28,615][52663] DAMAGECOUNT value on done: 532083.0 [2024-08-06 04:37:28,615][52663] Sum rewards: 85.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.202', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.097', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.102', 'FRAGCOUNT': '70.000'} [2024-08-06 04:37:28,938][52669] DAMAGECOUNT value on done: 543584.0 [2024-08-06 04:37:28,940][52669] Sum rewards: 84.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.743', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.414', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.108', 'FRAGCOUNT': '67.000'} [2024-08-06 04:37:29,105][52649] DAMAGECOUNT value on done: 534863.0 [2024-08-06 04:37:29,107][52649] Sum rewards: 74.552, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.171', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'weapon2': '0.304', 'WEAPON3': '1.050', 'weapon3': '3.056', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:29,234][52647] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:37:29,745][52667] DAMAGECOUNT value on done: 547293.0 [2024-08-06 04:37:29,745][52667] Sum rewards: 89.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.627', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO4': '0.138', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '22.257', 'FRAGCOUNT': '71.000'} [2024-08-06 04:37:30,202][52670] DAMAGECOUNT value on done: 533147.0 [2024-08-06 04:37:30,203][52670] Sum rewards: 75.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.798', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.166', 'weapon2': '0.244', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:30,688][52666] DAMAGECOUNT value on done: 535591.0 [2024-08-06 04:37:30,689][52666] Sum rewards: 54.071, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO3': '0.175', 'weapon2': '0.664', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.026', 'DAMAGECOUNT': '14.007', 'FRAGCOUNT': '45.000'} [2024-08-06 04:37:30,996][52647] DAMAGECOUNT value on done: 571578.0 [2024-08-06 04:37:30,997][52647] Sum rewards: 83.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.171', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.346', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '67.000'} [2024-08-06 04:37:31,810][52663] DAMAGECOUNT value on done: 543609.0 [2024-08-06 04:37:31,818][52663] Sum rewards: 71.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.878', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.094', 'weapon5': '0.254', 'AMMO3': '0.267', 'AMMO4': '0.275', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.992', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:32,059][52650] Updated weights for policy 0, policy_version 54891 (0.0017) [2024-08-06 04:37:32,089][52669] DAMAGECOUNT value on done: 534663.0 [2024-08-06 04:37:32,090][52669] Sum rewards: 73.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.702', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.209', 'AMMO4': '0.241', 'weapon4': '0.248', 'weapon5': '0.254', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '59.500'} [2024-08-06 04:37:32,198][52649] DAMAGECOUNT value on done: 535199.0 [2024-08-06 04:37:32,198][52649] Sum rewards: 78.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon2': '0.180', 'weapon4': '0.190', 'AMMO3': '0.209', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '66.000'} [2024-08-06 04:37:32,581][52667] DAMAGECOUNT value on done: 536699.0 [2024-08-06 04:37:32,583][52667] Sum rewards: 72.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.175', 'weapon2': '0.178', 'weapon4': '0.182', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '61.000'} [2024-08-06 04:37:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 449675264. Throughput: 0: 4385.8. Samples: 112417780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:37:32,794][52567] Avg episode reward: [(0, '71.884')] [2024-08-06 04:37:32,987][52670] DAMAGECOUNT value on done: 542956.0 [2024-08-06 04:37:32,988][52670] Sum rewards: 74.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.128', 'AMMO3': '0.249', 'weapon2': '0.270', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:33,439][52666] DAMAGECOUNT value on done: 538732.0 [2024-08-06 04:37:33,441][52666] Sum rewards: 78.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.694', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.213', 'AMMO3': '0.227', 'weapon4': '0.256', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '64.000'} [2024-08-06 04:37:33,638][52647] DAMAGECOUNT value on done: 563026.0 [2024-08-06 04:37:33,638][52647] Sum rewards: 56.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.144', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.106', 'weapon4': '0.120', 'AMMO3': '0.175', 'AMMO4': '0.186', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '2.968', 'DAMAGECOUNT': '14.685', 'FRAGCOUNT': '48.000'} [2024-08-06 04:37:34,438][52663] DAMAGECOUNT value on done: 542947.0 [2024-08-06 04:37:34,440][52663] Sum rewards: 79.931, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.098', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.138', 'AMMO3': '0.160', 'weapon2': '0.228', 'AMMO4': '0.268', 'weapon5': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:34,648][52669] DAMAGECOUNT value on done: 546583.0 [2024-08-06 04:37:34,653][52669] Sum rewards: 76.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.298', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '64.000'} [2024-08-06 04:37:34,970][52649] DAMAGECOUNT value on done: 534406.0 [2024-08-06 04:37:34,972][52649] Sum rewards: 75.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.784', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.207', 'AMMO4': '0.216', 'weapon4': '0.240', 'weapon5': '0.248', 'weapon2': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:35,104][52614] Signal inference workers to stop experience collection... (10000 times) [2024-08-06 04:37:35,109][52614] Signal inference workers to resume experience collection... (10000 times) [2024-08-06 04:37:35,151][52650] InferenceWorker_p0-w0: stopping experience collection (10000 times) [2024-08-06 04:37:35,151][52650] InferenceWorker_p0-w0: resuming experience collection (10000 times) [2024-08-06 04:37:35,490][52667] DAMAGECOUNT value on done: 546343.0 [2024-08-06 04:37:35,492][52667] Sum rewards: 57.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.308', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.072', 'weapon4': '0.082', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.286', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '48.500'} [2024-08-06 04:37:35,915][52670] DAMAGECOUNT value on done: 538150.0 [2024-08-06 04:37:35,916][52670] Sum rewards: 73.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.095', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 04:37:36,293][52666] DAMAGECOUNT value on done: 535241.0 [2024-08-06 04:37:36,293][52666] Sum rewards: 77.447, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.102', 'AMMO3': '0.160', 'weapon2': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '64.000'} [2024-08-06 04:37:36,420][52647] DAMAGECOUNT value on done: 572575.0 [2024-08-06 04:37:36,420][52647] Sum rewards: 80.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.312', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.130', 'AMMO4': '0.211', 'AMMO3': '0.217', 'weapon5': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:37,032][52663] DAMAGECOUNT value on done: 535835.0 [2024-08-06 04:37:37,056][52663] Sum rewards: 73.533, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.167', 'weapon4': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.600', 'weapon3': '2.940', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:37,148][52650] Updated weights for policy 0, policy_version 54901 (0.0013) [2024-08-06 04:37:37,354][52669] DAMAGECOUNT value on done: 543187.0 [2024-08-06 04:37:37,354][52669] Sum rewards: 79.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.346', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.148', 'AMMO4': '0.186', 'AMMO3': '0.223', 'weapon2': '0.268', 'weapon5': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '65.000'} [2024-08-06 04:37:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 449765376. Throughput: 0: 4380.9. Samples: 112444000. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:37:37,795][52567] Avg episode reward: [(0, '72.284')] [2024-08-06 04:37:37,864][52649] DAMAGECOUNT value on done: 520359.0 [2024-08-06 04:37:37,867][52649] Sum rewards: 70.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.074', 'weapon5': '0.108', 'AMMO4': '0.129', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:38,696][52647] DAMAGECOUNT value on done: 567493.0 [2024-08-06 04:37:38,698][52647] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.915', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.189', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.350', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:38,724][52667] DAMAGECOUNT value on done: 549345.0 [2024-08-06 04:37:38,727][52667] Sum rewards: 61.820, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.605', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.148', 'weapon5': '0.180', 'AMMO4': '0.201', 'AMMO3': '0.256', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.068', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '54.500'} [2024-08-06 04:37:39,016][52670] DAMAGECOUNT value on done: 521292.0 [2024-08-06 04:37:39,018][52670] Sum rewards: 78.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.092', 'AMMO4': '0.144', 'weapon5': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '65.000'} [2024-08-06 04:37:39,494][52666] DAMAGECOUNT value on done: 538401.0 [2024-08-06 04:37:39,495][52666] Sum rewards: 57.339, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.101', 'weapon4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.296', 'WEAPON3': '1.700', 'HITCOUNT': '3.040', 'weapon3': '3.308', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '52.000'} [2024-08-06 04:37:39,908][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:37:40,046][52669] DAMAGECOUNT value on done: 541366.0 [2024-08-06 04:37:40,047][52669] Sum rewards: 71.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.142', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.170', 'weapon5': '0.184', 'AMMO4': '0.232', 'weapon2': '0.306', 'weapon4': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 04:37:40,666][52670] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:37:41,103][52649] DAMAGECOUNT value on done: 530036.0 [2024-08-06 04:37:41,105][52649] Sum rewards: 64.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.193', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.190', 'AMMO3': '0.271', 'weapon2': '0.272', 'WEAPON5': '0.300', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.856', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '56.000'} [2024-08-06 04:37:41,439][52647] DAMAGECOUNT value on done: 569537.0 [2024-08-06 04:37:41,442][52647] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.666', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.126', 'weapon4': '0.172', 'AMMO3': '0.239', 'AMMO4': '0.246', 'weapon2': '0.332', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '65.000'} [2024-08-06 04:37:41,601][52667] DAMAGECOUNT value on done: 551252.0 [2024-08-06 04:37:41,602][52667] Sum rewards: 76.608, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.439', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.172', 'weapon4': '0.192', 'weapon5': '0.204', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:41,771][52795] DAMAGECOUNT value on done: 502501.0 [2024-08-06 04:37:41,774][52795] Sum rewards: 69.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.130', 'weapon5': '0.146', 'AMMO4': '0.153', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:41,818][52650] Updated weights for policy 0, policy_version 54911 (0.0011) [2024-08-06 04:37:41,916][52670] DAMAGECOUNT value on done: 534677.0 [2024-08-06 04:37:41,917][52670] Sum rewards: 81.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.312', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.192', 'AMMO3': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '67.000'} [2024-08-06 04:37:42,373][52666] DAMAGECOUNT value on done: 539142.0 [2024-08-06 04:37:42,381][52666] Sum rewards: 68.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.217', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.076', 'AMMO4': '0.089', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.298', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.282', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 04:37:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.1). Total num frames: 449847296. Throughput: 0: 4377.6. Samples: 112470380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:37:42,795][52567] Avg episode reward: [(0, '71.781')] [2024-08-06 04:37:43,098][52669] DAMAGECOUNT value on done: 544946.0 [2024-08-06 04:37:43,100][52669] Sum rewards: 76.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.118', 'weapon5': '0.128', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.326', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '64.000'} [2024-08-06 04:37:44,233][52647] DAMAGECOUNT value on done: 562114.0 [2024-08-06 04:37:44,233][52647] Sum rewards: 88.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.106', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '74.000'} [2024-08-06 04:37:44,254][52649] DAMAGECOUNT value on done: 519202.0 [2024-08-06 04:37:44,256][52649] Sum rewards: 71.383, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO4': '0.221', 'weapon2': '0.232', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.232', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:44,554][52667] DAMAGECOUNT value on done: 547463.0 [2024-08-06 04:37:44,554][52667] Sum rewards: 79.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'weapon4': '0.004', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '66.000'} [2024-08-06 04:37:44,887][52670] DAMAGECOUNT value on done: 542496.0 [2024-08-06 04:37:44,888][52670] Sum rewards: 72.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.505', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:44,930][52795] DAMAGECOUNT value on done: 492123.0 [2024-08-06 04:37:44,931][52795] Sum rewards: 74.121, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.790', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon5': '0.194', 'AMMO4': '0.244', 'weapon2': '0.248', 'AMMO3': '0.283', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.156', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '65.000'} [2024-08-06 04:37:45,028][52671] DAMAGECOUNT value on done: 546785.0 [2024-08-06 04:37:45,029][52671] Sum rewards: 67.886, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.046', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.178', 'weapon4': '0.204', 'AMMO3': '0.216', 'AMMO4': '0.253', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:45,331][52666] DAMAGECOUNT value on done: 523886.0 [2024-08-06 04:37:45,334][52666] Sum rewards: 76.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.150', 'weapon4': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.236', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:46,421][52669] DAMAGECOUNT value on done: 544708.0 [2024-08-06 04:37:46,422][52669] Sum rewards: 69.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.136', 'AMMO4': '0.179', 'AMMO3': '0.197', 'weapon5': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:46,466][52650] Updated weights for policy 0, policy_version 54921 (0.0039) [2024-08-06 04:37:46,510][52647] DAMAGECOUNT value on done: 573782.0 [2024-08-06 04:37:46,511][52647] Sum rewards: 65.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.258', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO3': '0.205', 'AMMO4': '0.227', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.042', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '54.000'} [2024-08-06 04:37:47,220][52649] DAMAGECOUNT value on done: 532839.0 [2024-08-06 04:37:47,220][52649] Sum rewards: 65.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.134', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.242', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '58.000'} [2024-08-06 04:37:47,334][52667] DAMAGECOUNT value on done: 540723.0 [2024-08-06 04:37:47,334][52667] Sum rewards: 67.347, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.060', 'AMMO4': '0.110', 'weapon5': '0.160', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '54.000'} [2024-08-06 04:37:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 449937408. Throughput: 0: 4388.4. Samples: 112483790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:37:47,794][52567] Avg episode reward: [(0, '71.969')] [2024-08-06 04:37:47,839][52670] DAMAGECOUNT value on done: 531896.0 [2024-08-06 04:37:47,839][52670] Sum rewards: 75.344, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.190', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.305', 'weapon2': '0.416', 'WEAPON3': '1.900', 'weapon3': '3.346', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '66.000'} [2024-08-06 04:37:47,842][52671] DAMAGECOUNT value on done: 546587.0 [2024-08-06 04:37:47,843][52671] Sum rewards: 92.672, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.715', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.140', 'weapon2': '0.734', 'WEAPON3': '0.950', 'weapon3': '3.022', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '22.074', 'FRAGCOUNT': '71.000'} [2024-08-06 04:37:48,049][52795] DAMAGECOUNT value on done: 491809.0 [2024-08-06 04:37:48,050][52795] Sum rewards: 65.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.054', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.184', 'AMMO4': '0.240', 'weapon2': '0.246', 'weapon5': '0.286', 'weapon4': '0.438', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '52.000'} [2024-08-06 04:37:48,356][52666] DAMAGECOUNT value on done: 533709.0 [2024-08-06 04:37:48,358][52666] Sum rewards: 73.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.448', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.144', 'weapon5': '0.156', 'AMMO3': '0.200', 'AMMO4': '0.225', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '61.000'} [2024-08-06 04:37:49,654][52647] DAMAGECOUNT value on done: 566896.0 [2024-08-06 04:37:49,656][52647] Sum rewards: 68.937, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.055', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '3.284', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '55.000'} [2024-08-06 04:37:49,684][52669] DAMAGECOUNT value on done: 542571.0 [2024-08-06 04:37:49,685][52669] Sum rewards: 82.362, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.235', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.104', 'weapon5': '0.224', 'AMMO4': '0.268', 'AMMO3': '0.276', 'weapon2': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.122', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '22.146', 'FRAGCOUNT': '69.000'} [2024-08-06 04:37:49,860][52649] DAMAGECOUNT value on done: 533048.0 [2024-08-06 04:37:49,861][52649] Sum rewards: 77.652, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.596', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.080', 'AMMO4': '0.144', 'AMMO3': '0.179', 'weapon5': '0.206', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:50,421][52667] DAMAGECOUNT value on done: 549783.0 [2024-08-06 04:37:50,421][52667] Sum rewards: 74.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.389', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.129', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON3': '1.050', 'HITCOUNT': '3.490', 'weapon3': '3.508', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:50,487][52670] DAMAGECOUNT value on done: 537192.0 [2024-08-06 04:37:50,489][52670] Sum rewards: 73.006, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon2': '0.144', 'weapon5': '0.146', 'AMMO3': '0.263', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:50,696][52671] DAMAGECOUNT value on done: 545295.0 [2024-08-06 04:37:50,698][52671] Sum rewards: 74.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.111', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.054', 'weapon4': '0.118', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '62.000'} [2024-08-06 04:37:50,919][52650] Updated weights for policy 0, policy_version 54931 (0.0038) [2024-08-06 04:37:51,174][52795] DAMAGECOUNT value on done: 498884.0 [2024-08-06 04:37:51,174][52795] Sum rewards: 65.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.162', 'weapon5': '0.174', 'AMMO4': '0.207', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '55.000'} [2024-08-06 04:37:52,357][52649] DAMAGECOUNT value on done: 526851.0 [2024-08-06 04:37:52,357][52649] Sum rewards: 67.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.536', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.054', 'weapon4': '0.074', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.268', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.370', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:52,447][52669] DAMAGECOUNT value on done: 551575.0 [2024-08-06 04:37:52,448][52669] Sum rewards: 66.479, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.585', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.044', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.192', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.330', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '57.000'} [2024-08-06 04:37:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 450027520. Throughput: 0: 4382.9. Samples: 112509840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:37:52,802][52567] Avg episode reward: [(0, '72.264')] [2024-08-06 04:37:52,807][52647] DAMAGECOUNT value on done: 573582.0 [2024-08-06 04:37:52,809][52647] Sum rewards: 64.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.045', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.686', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '55.000'} [2024-08-06 04:37:53,476][52671] DAMAGECOUNT value on done: 545097.0 [2024-08-06 04:37:53,478][52671] Sum rewards: 68.013, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.608', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.164', 'weapon5': '0.210', 'AMMO4': '0.231', 'weapon2': '0.358', 'weapon4': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 04:37:54,317][52795] DAMAGECOUNT value on done: 493638.0 [2024-08-06 04:37:54,319][52795] Sum rewards: 77.417, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.142', 'weapon2': '0.188', 'AMMO3': '0.212', 'AMMO4': '0.246', 'weapon5': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:54,424][52664] DAMAGECOUNT value on done: 560846.0 [2024-08-06 04:37:54,425][52664] Sum rewards: 65.966, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.980', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.120', 'weapon4': '0.126', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'AMMO3': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.114', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '58.000'} [2024-08-06 04:37:54,570][52658] DAMAGECOUNT value on done: 541496.0 [2024-08-06 04:37:54,571][52658] Sum rewards: 70.048, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.967', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.116', 'weapon5': '0.116', 'AMMO4': '0.178', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.700', 'weapon3': '2.950', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '61.500'} [2024-08-06 04:37:54,725][52668] DAMAGECOUNT value on done: 540319.0 [2024-08-06 04:37:54,725][52668] Sum rewards: 77.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.646', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.091', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:55,162][52669] DAMAGECOUNT value on done: 541612.0 [2024-08-06 04:37:55,165][52669] Sum rewards: 86.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.875', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.415', 'FRAGCOUNT': '72.000'} [2024-08-06 04:37:55,460][52650] Updated weights for policy 0, policy_version 54941 (0.0020) [2024-08-06 04:37:55,639][52647] DAMAGECOUNT value on done: 570436.0 [2024-08-06 04:37:55,640][52647] Sum rewards: 76.062, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.286', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.098', 'weapon5': '0.218', 'AMMO3': '0.242', 'AMMO4': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '65.000'} [2024-08-06 04:37:56,685][52671] DAMAGECOUNT value on done: 555392.0 [2024-08-06 04:37:56,686][52671] Sum rewards: 80.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.110', 'weapon4': '0.130', 'AMMO3': '0.206', 'AMMO4': '0.229', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '67.000'} [2024-08-06 04:37:56,808][52658] DAMAGECOUNT value on done: 541420.0 [2024-08-06 04:37:56,809][52658] Sum rewards: 68.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.505', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.159', 'weapon5': '0.264', 'AMMO4': '0.265', 'weapon4': '0.306', 'weapon2': '0.402', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '54.500'} [2024-08-06 04:37:57,322][52664] DAMAGECOUNT value on done: 567000.0 [2024-08-06 04:37:57,322][52664] Sum rewards: 71.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.052', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:57,492][52795] DAMAGECOUNT value on done: 502183.0 [2024-08-06 04:37:57,492][52795] Sum rewards: 73.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.525', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '58.500'} [2024-08-06 04:37:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 450109440. Throughput: 0: 4382.2. Samples: 112536080. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:37:57,802][52567] Avg episode reward: [(0, '72.639')] [2024-08-06 04:37:57,875][52668] DAMAGECOUNT value on done: 544230.0 [2024-08-06 04:37:57,876][52668] Sum rewards: 81.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.651', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.388', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '69.000'} [2024-08-06 04:37:57,937][52669] DAMAGECOUNT value on done: 547551.0 [2024-08-06 04:37:57,941][52669] Sum rewards: 75.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon4': '0.078', 'AMMO3': '0.173', 'weapon5': '0.186', 'AMMO4': '0.254', 'weapon2': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '60.000'} [2024-08-06 04:37:58,744][52647] DAMAGECOUNT value on done: 558161.0 [2024-08-06 04:37:58,745][52647] Sum rewards: 77.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.407', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '63.000'} [2024-08-06 04:37:59,415][52658] DAMAGECOUNT value on done: 546452.0 [2024-08-06 04:37:59,417][52658] Sum rewards: 71.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.870', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.118', 'AMMO4': '0.193', 'weapon5': '0.214', 'weapon2': '0.244', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.000'} [2024-08-06 04:37:59,845][52671] DAMAGECOUNT value on done: 544045.0 [2024-08-06 04:37:59,846][52671] Sum rewards: 72.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.158', 'weapon2': '0.192', 'AMMO3': '0.202', 'weapon4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '61.000'} [2024-08-06 04:38:00,085][52650] Updated weights for policy 0, policy_version 54951 (0.0013) [2024-08-06 04:38:00,559][52664] DAMAGECOUNT value on done: 565328.0 [2024-08-06 04:38:00,560][52664] Sum rewards: 63.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.096', 'AMMO3': '0.176', 'AMMO4': '0.194', 'weapon4': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '52.000'} [2024-08-06 04:38:00,658][52795] DAMAGECOUNT value on done: 507208.0 [2024-08-06 04:38:00,658][52795] Sum rewards: 71.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.169', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '59.500'} [2024-08-06 04:38:00,680][52669] DAMAGECOUNT value on done: 545832.0 [2024-08-06 04:38:00,681][52669] Sum rewards: 77.546, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.395', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.122', 'weapon5': '0.186', 'weapon2': '0.188', 'AMMO3': '0.211', 'AMMO4': '0.223', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:01,011][52668] DAMAGECOUNT value on done: 542385.0 [2024-08-06 04:38:01,014][52668] Sum rewards: 58.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.130', 'weapon5': '0.202', 'AMMO3': '0.205', 'AMMO4': '0.241', 'weapon2': '0.314', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.082', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '48.000'} [2024-08-06 04:38:01,803][52647] DAMAGECOUNT value on done: 567380.0 [2024-08-06 04:38:01,804][52647] Sum rewards: 75.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.190', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '61.000'} [2024-08-06 04:38:02,778][52658] DAMAGECOUNT value on done: 546220.0 [2024-08-06 04:38:02,778][52658] Sum rewards: 65.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.110', 'AMMO4': '0.189', 'AMMO3': '0.199', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 450199552. Throughput: 0: 4378.9. Samples: 112549250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:38:02,794][52567] Avg episode reward: [(0, '72.870')] [2024-08-06 04:38:02,878][52671] DAMAGECOUNT value on done: 551400.0 [2024-08-06 04:38:02,880][52671] Sum rewards: 69.203, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.831', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.097', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon2': '0.380', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '60.000'} [2024-08-06 04:38:03,392][52664] DAMAGECOUNT value on done: 557550.0 [2024-08-06 04:38:03,393][52664] Sum rewards: 66.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.717', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon2': '0.192', 'weapon5': '0.206', 'AMMO3': '0.225', 'weapon4': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.112', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:03,477][52669] DAMAGECOUNT value on done: 533783.0 [2024-08-06 04:38:03,478][52669] Sum rewards: 79.469, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.455', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.274', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.392', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:03,670][52795] DAMAGECOUNT value on done: 502806.0 [2024-08-06 04:38:03,670][52795] Sum rewards: 66.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.075', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.110', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.134', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '54.000'} [2024-08-06 04:38:03,958][52668] DAMAGECOUNT value on done: 542844.0 [2024-08-06 04:38:03,958][52668] Sum rewards: 64.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.791', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.198', 'AMMO3': '0.221', 'AMMO4': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.418', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.588', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '52.500'} [2024-08-06 04:38:04,355][52647] DAMAGECOUNT value on done: 560741.0 [2024-08-06 04:38:04,355][52647] Sum rewards: 68.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.030', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.092', 'weapon2': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.198', 'weapon5': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.530', 'weapon3': '3.342', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:04,834][52650] Updated weights for policy 0, policy_version 54961 (0.0034) [2024-08-06 04:38:05,382][52658] DAMAGECOUNT value on done: 536906.0 [2024-08-06 04:38:05,382][52658] Sum rewards: 80.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.709', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.164', 'AMMO3': '0.192', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:05,773][52662] DAMAGECOUNT value on done: 546313.0 [2024-08-06 04:38:05,774][52662] Sum rewards: 73.849, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.196', 'AMMO4': '0.201', 'weapon5': '0.260', 'AMMO3': '0.276', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.836', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '63.000'} [2024-08-06 04:38:05,858][52671] DAMAGECOUNT value on done: 545213.0 [2024-08-06 04:38:05,859][52671] Sum rewards: 93.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.073', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.488', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.681', 'FRAGCOUNT': '77.000'} [2024-08-06 04:38:05,913][52664] DAMAGECOUNT value on done: 562617.0 [2024-08-06 04:38:05,913][52664] Sum rewards: 77.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.701', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.094', 'weapon2': '0.122', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.554', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:06,165][52669] DAMAGECOUNT value on done: 543483.0 [2024-08-06 04:38:06,165][52669] Sum rewards: 75.945, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.230', 'weapon4': '0.260', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:06,808][52795] DAMAGECOUNT value on done: 494460.0 [2024-08-06 04:38:06,809][52795] Sum rewards: 70.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.816', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon2': '0.176', 'weapon5': '0.178', 'AMMO3': '0.195', 'AMMO4': '0.199', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:06,989][52647] DAMAGECOUNT value on done: 562762.0 [2024-08-06 04:38:06,989][52647] Sum rewards: 75.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.246', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:07,357][52668] DAMAGECOUNT value on done: 534086.0 [2024-08-06 04:38:07,358][52668] Sum rewards: 78.299, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.154', 'weapon5': '0.184', 'weapon4': '0.208', 'weapon2': '0.240', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'HEALTH': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.122', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '61.500'} [2024-08-06 04:38:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 450281472. Throughput: 0: 4384.7. Samples: 112575580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:38:07,795][52567] Avg episode reward: [(0, '73.420')] [2024-08-06 04:38:08,034][52658] DAMAGECOUNT value on done: 538317.0 [2024-08-06 04:38:08,035][52658] Sum rewards: 66.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.254', 'weapon4': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '56.000'} [2024-08-06 04:38:08,478][52671] DAMAGECOUNT value on done: 539737.0 [2024-08-06 04:38:08,479][52671] Sum rewards: 61.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.108', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.178', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '2.988', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '50.000'} [2024-08-06 04:38:08,575][52662] DAMAGECOUNT value on done: 545309.0 [2024-08-06 04:38:08,577][52662] Sum rewards: 74.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.588', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.198', 'AMMO3': '0.200', 'AMMO4': '0.278', 'weapon2': '0.342', 'WEAPON5': '0.400', 'weapon4': '0.478', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.756', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '60.000'} [2024-08-06 04:38:08,697][52664] DAMAGECOUNT value on done: 562956.0 [2024-08-06 04:38:08,698][52664] Sum rewards: 71.622, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'HEALTH': '0.026', 'AMMO2': '0.045', 'weapon5': '0.090', 'AMMO3': '0.125', 'weapon4': '0.144', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.604', 'WEAPON3': '0.750', 'weapon3': '2.942', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:09,233][52669] DAMAGECOUNT value on done: 544628.0 [2024-08-06 04:38:09,235][52669] Sum rewards: 77.157, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.070', 'weapon5': '0.088', 'AMMO4': '0.099', 'HEALTH': '0.100', 'weapon2': '0.146', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'HITCOUNT': '3.340', 'weapon3': '3.468', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '62.000'} [2024-08-06 04:38:09,888][52650] Updated weights for policy 0, policy_version 54971 (0.0017) [2024-08-06 04:38:09,989][52795] DAMAGECOUNT value on done: 505314.0 [2024-08-06 04:38:09,989][52795] Sum rewards: 77.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.104', 'weapon5': '0.196', 'AMMO3': '0.204', 'AMMO4': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '66.000'} [2024-08-06 04:38:10,375][52668] DAMAGECOUNT value on done: 548199.0 [2024-08-06 04:38:10,375][52668] Sum rewards: 81.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.458', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.018', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '65.500'} [2024-08-06 04:38:10,487][52658] DAMAGECOUNT value on done: 546156.0 [2024-08-06 04:38:10,489][52658] Sum rewards: 79.493, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.548', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.502', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '66.000'} [2024-08-06 04:38:10,996][52664] DAMAGECOUNT value on done: 559378.0 [2024-08-06 04:38:10,997][52664] Sum rewards: 69.899, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.106', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.076', 'weapon4': '0.086', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.271', 'weapon2': '0.438', 'WEAPON3': '1.650', 'weapon3': '3.170', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2024-08-06 04:38:11,461][52671] DAMAGECOUNT value on done: 546078.0 [2024-08-06 04:38:11,461][52671] Sum rewards: 62.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.837', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.108', 'weapon5': '0.178', 'AMMO4': '0.232', 'AMMO3': '0.243', 'weapon2': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.172', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '52.000'} [2024-08-06 04:38:11,876][52662] DAMAGECOUNT value on done: 547871.0 [2024-08-06 04:38:11,878][52662] Sum rewards: 73.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.958', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.216', 'weapon2': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.494', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '62.000'} [2024-08-06 04:38:12,015][52820] DAMAGECOUNT value on done: 498425.0 [2024-08-06 04:38:12,015][52820] Sum rewards: 40.143, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.146', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon7': '0.254', 'weapon2': '0.434', 'WEAPON3': '0.950', 'weapon4': '1.220', 'weapon3': '1.662', 'HITCOUNT': '2.190', 'DAMAGECOUNT': '10.005', 'FRAGCOUNT': '34.000'} [2024-08-06 04:38:12,057][52669] DAMAGECOUNT value on done: 562494.0 [2024-08-06 04:38:12,059][52669] Sum rewards: 94.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.382', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.096', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '22.098', 'FRAGCOUNT': '76.000'} [2024-08-06 04:38:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 450379776. Throughput: 0: 4388.2. Samples: 112602040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:38:12,794][52567] Avg episode reward: [(0, '72.781')] [2024-08-06 04:38:13,231][52795] DAMAGECOUNT value on done: 501680.0 [2024-08-06 04:38:13,232][52795] Sum rewards: 73.823, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.165', 'weapon2': '0.192', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.482', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:13,351][52658] DAMAGECOUNT value on done: 538307.0 [2024-08-06 04:38:13,354][52658] Sum rewards: 77.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.112', 'AMMO4': '0.187', 'AMMO3': '0.222', 'weapon5': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '62.500'} [2024-08-06 04:38:13,410][52664] DAMAGECOUNT value on done: 554650.0 [2024-08-06 04:38:13,411][52664] Sum rewards: 83.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.848', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.204', 'AMMO3': '0.243', 'AMMO4': '0.244', 'weapon2': '0.282', 'weapon5': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.800', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '21.054', 'FRAGCOUNT': '67.000'} [2024-08-06 04:38:13,539][52668] DAMAGECOUNT value on done: 544372.0 [2024-08-06 04:38:13,539][52668] Sum rewards: 71.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon7': '0.238', 'weapon2': '0.310', 'weapon4': '0.328', 'WEAPON3': '0.950', 'weapon3': '2.766', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '56.000'} [2024-08-06 04:38:13,901][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:38:14,056][52671] DAMAGECOUNT value on done: 547041.0 [2024-08-06 04:38:14,057][52671] Sum rewards: 78.084, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.164', 'AMMO3': '0.193', 'weapon5': '0.200', 'AMMO4': '0.292', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:14,190][52650] Updated weights for policy 0, policy_version 54981 (0.0035) [2024-08-06 04:38:14,526][52662] DAMAGECOUNT value on done: 535070.0 [2024-08-06 04:38:14,528][52662] Sum rewards: 72.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.216', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.134', 'AMMO3': '0.208', 'weapon5': '0.228', 'AMMO4': '0.245', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:14,913][52669] DAMAGECOUNT value on done: 547812.0 [2024-08-06 04:38:14,933][52669] Sum rewards: 65.905, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.455', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.130', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '0.900', 'HITCOUNT': '3.270', 'weapon3': '3.356', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '51.000'} [2024-08-06 04:38:15,206][52820] DAMAGECOUNT value on done: 501440.0 [2024-08-06 04:38:15,206][52820] Sum rewards: 66.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.038', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.192', 'AMMO3': '0.193', 'AMMO4': '0.220', 'weapon5': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.712', 'WEAPON3': '1.200', 'weapon3': '2.450', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '53.000'} [2024-08-06 04:38:16,074][52658] DAMAGECOUNT value on done: 554215.0 [2024-08-06 04:38:16,076][52658] Sum rewards: 72.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.360', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.125', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.248', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:16,351][52664] DAMAGECOUNT value on done: 566197.0 [2024-08-06 04:38:16,352][52664] Sum rewards: 74.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.521', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.068', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '3.164', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '61.000'} [2024-08-06 04:38:16,429][52795] DAMAGECOUNT value on done: 495946.0 [2024-08-06 04:38:16,429][52795] Sum rewards: 71.100, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.118', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.152', 'AMMO3': '0.183', 'weapon2': '0.266', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'weapon4': '0.490', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:16,670][52668] DAMAGECOUNT value on done: 536555.0 [2024-08-06 04:38:16,675][52668] Sum rewards: 86.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.154', 'AMMO3': '0.224', 'weapon5': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '21.105', 'FRAGCOUNT': '70.000'} [2024-08-06 04:38:16,923][52671] DAMAGECOUNT value on done: 542800.0 [2024-08-06 04:38:16,923][52671] Sum rewards: 65.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.331', 'AMMO5': '0.011', 'AMMO2': '0.061', 'weapon5': '0.166', 'weapon4': '0.214', 'AMMO3': '0.228', 'AMMO4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.500'} [2024-08-06 04:38:17,294][52669] DAMAGECOUNT value on done: 546568.0 [2024-08-06 04:38:17,296][52669] Sum rewards: 66.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.056', 'weapon4': '0.068', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:17,308][52662] DAMAGECOUNT value on done: 548099.0 [2024-08-06 04:38:17,308][52662] Sum rewards: 75.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '63.000'} [2024-08-06 04:38:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 450461696. Throughput: 0: 4381.1. Samples: 112614930. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:38:17,794][52567] Avg episode reward: [(0, '72.816')] [2024-08-06 04:38:18,330][52820] DAMAGECOUNT value on done: 505043.0 [2024-08-06 04:38:18,331][52820] Sum rewards: 74.606, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.667', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.192', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.492', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 04:38:18,986][52650] Updated weights for policy 0, policy_version 54991 (0.0016) [2024-08-06 04:38:19,268][52658] DAMAGECOUNT value on done: 540301.0 [2024-08-06 04:38:19,269][52658] Sum rewards: 79.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.134', 'weapon4': '0.186', 'AMMO4': '0.197', 'weapon2': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.170', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '69.000'} [2024-08-06 04:38:19,351][52664] DAMAGECOUNT value on done: 559480.0 [2024-08-06 04:38:19,351][52664] Sum rewards: 80.051, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.111', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.330', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:19,591][52795] DAMAGECOUNT value on done: 494912.0 [2024-08-06 04:38:19,591][52795] Sum rewards: 67.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.881', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.216', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '56.000'} [2024-08-06 04:38:19,637][52671] DAMAGECOUNT value on done: 553628.0 [2024-08-06 04:38:19,639][52671] Sum rewards: 72.320, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.506', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.086', 'weapon5': '0.196', 'weapon2': '0.234', 'AMMO3': '0.247', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '60.000'} [2024-08-06 04:38:19,838][52669] DAMAGECOUNT value on done: 547304.0 [2024-08-06 04:38:19,839][52669] Sum rewards: 76.976, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.170', 'weapon5': '0.202', 'weapon2': '0.284', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.572', 'WEAPON3': '0.900', 'weapon3': '2.966', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '61.000'} [2024-08-06 04:38:19,996][52668] DAMAGECOUNT value on done: 539154.0 [2024-08-06 04:38:19,997][52668] Sum rewards: 71.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.340', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.262', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:20,174][52662] DAMAGECOUNT value on done: 539226.0 [2024-08-06 04:38:20,175][52662] Sum rewards: 72.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.098', 'weapon5': '0.122', 'AMMO4': '0.131', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:21,590][52820] DAMAGECOUNT value on done: 495190.0 [2024-08-06 04:38:21,590][52820] Sum rewards: 63.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.140', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.196', 'weapon2': '0.680', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '53.000'} [2024-08-06 04:38:21,939][52658] DAMAGECOUNT value on done: 553176.0 [2024-08-06 04:38:21,940][52658] Sum rewards: 60.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.410', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.230', 'AMMO3': '0.243', 'AMMO4': '0.245', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.078', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2024-08-06 04:38:22,127][52664] DAMAGECOUNT value on done: 567307.0 [2024-08-06 04:38:22,127][52664] Sum rewards: 65.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.104', 'AMMO3': '0.168', 'weapon5': '0.198', 'AMMO4': '0.263', 'weapon2': '0.290', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.118', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:22,472][52669] DAMAGECOUNT value on done: 551924.0 [2024-08-06 04:38:22,473][52669] Sum rewards: 71.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.100', 'weapon5': '0.118', 'AMMO4': '0.143', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.292', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '61.000'} [2024-08-06 04:38:22,776][52795] DAMAGECOUNT value on done: 502106.0 [2024-08-06 04:38:22,777][52795] Sum rewards: 68.318, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.148', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.116', 'AMMO4': '0.129', 'weapon5': '0.140', 'AMMO3': '0.219', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 450543616. Throughput: 0: 4372.9. Samples: 112640780. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:38:22,794][52567] Avg episode reward: [(0, '72.688')] [2024-08-06 04:38:22,911][52671] DAMAGECOUNT value on done: 546327.0 [2024-08-06 04:38:22,912][52671] Sum rewards: 62.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.974', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.145', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon5': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '2.954', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '53.000'} [2024-08-06 04:38:23,049][52668] DAMAGECOUNT value on done: 547058.0 [2024-08-06 04:38:23,049][52668] Sum rewards: 68.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.176', 'weapon4': '0.204', 'AMMO3': '0.221', 'AMMO4': '0.228', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:23,210][52662] DAMAGECOUNT value on done: 547153.0 [2024-08-06 04:38:23,211][52662] Sum rewards: 71.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.118', 'AMMO4': '0.203', 'weapon5': '0.220', 'AMMO3': '0.234', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:23,763][52650] Updated weights for policy 0, policy_version 55001 (0.0026) [2024-08-06 04:38:24,328][52660] DAMAGECOUNT value on done: 544305.0 [2024-08-06 04:38:24,329][52660] Sum rewards: 72.608, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.354', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.062', 'weapon5': '0.138', 'AMMO4': '0.210', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 04:38:24,411][52658] DAMAGECOUNT value on done: 537513.0 [2024-08-06 04:38:24,413][52658] Sum rewards: 79.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.063', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.394', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '66.000'} [2024-08-06 04:38:24,788][52820] DAMAGECOUNT value on done: 505553.0 [2024-08-06 04:38:24,788][52820] Sum rewards: 81.399, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.457', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.058', 'weapon5': '0.062', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '69.000'} [2024-08-06 04:38:25,013][52664] DAMAGECOUNT value on done: 566721.0 [2024-08-06 04:38:25,014][52664] Sum rewards: 80.958, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.024', 'weapon5': '0.056', 'AMMO4': '0.073', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '66.000'} [2024-08-06 04:38:25,866][52671] DAMAGECOUNT value on done: 531531.0 [2024-08-06 04:38:25,868][52671] Sum rewards: 69.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.055', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO4': '0.157', 'weapon2': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.260', 'weapon3': '3.318', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '60.500'} [2024-08-06 04:38:25,891][52668] DAMAGECOUNT value on done: 543106.0 [2024-08-06 04:38:25,892][52668] Sum rewards: 78.845, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.169', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.038', 'AMMO4': '0.123', 'weapon5': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'weapon2': '0.360', 'WEAPON3': '1.750', 'weapon3': '3.204', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '68.000'} [2024-08-06 04:38:25,941][52795] DAMAGECOUNT value on done: 494618.0 [2024-08-06 04:38:25,941][52795] Sum rewards: 64.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.100', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon5': '0.182', 'AMMO3': '0.228', 'AMMO4': '0.244', 'weapon4': '0.280', 'WEAPON5': '0.500', 'weapon2': '0.524', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.698', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:26,298][52662] DAMAGECOUNT value on done: 549682.0 [2024-08-06 04:38:26,299][52662] Sum rewards: 71.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO2': '0.004', 'AMMO5': '0.012', 'AMMO4': '0.018', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.209', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.480', 'weapon3': '3.510', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:27,234][52660] DAMAGECOUNT value on done: 532312.0 [2024-08-06 04:38:27,234][52660] Sum rewards: 67.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.744', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.088', 'AMMO4': '0.158', 'AMMO3': '0.187', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '52.500'} [2024-08-06 04:38:27,318][52658] DAMAGECOUNT value on done: 543242.0 [2024-08-06 04:38:27,318][52658] Sum rewards: 77.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.831', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.058', 'AMMO4': '0.167', 'weapon4': '0.172', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '63.000'} [2024-08-06 04:38:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 450633728. Throughput: 0: 4372.7. Samples: 112667150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:38:27,794][52567] Avg episode reward: [(0, '72.671')] [2024-08-06 04:38:27,871][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055010_450641920.pth... [2024-08-06 04:38:27,935][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:38:28,006][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000054498_446447616.pth [2024-08-06 04:38:28,023][52820] DAMAGECOUNT value on done: 496180.0 [2024-08-06 04:38:28,025][52820] Sum rewards: 75.867, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.414', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.130', 'weapon4': '0.162', 'weapon5': '0.176', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '0.900', 'weapon3': '3.008', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '61.000'} [2024-08-06 04:38:28,178][52664] DAMAGECOUNT value on done: 572362.0 [2024-08-06 04:38:28,179][52664] Sum rewards: 68.574, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.650', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.165', 'weapon2': '0.652', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:28,554][52650] Updated weights for policy 0, policy_version 55011 (0.0013) [2024-08-06 04:38:29,115][52668] DAMAGECOUNT value on done: 535530.0 [2024-08-06 04:38:29,117][52668] Sum rewards: 67.025, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.821', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.074', 'weapon4': '0.086', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:29,152][52795] DAMAGECOUNT value on done: 509365.0 [2024-08-06 04:38:29,156][52795] Sum rewards: 65.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.782', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.120', 'weapon4': '0.132', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '56.000'} [2024-08-06 04:38:29,215][52671] DAMAGECOUNT value on done: 553052.0 [2024-08-06 04:38:29,215][52671] Sum rewards: 78.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.174', 'AMMO3': '0.220', 'weapon4': '0.244', 'AMMO4': '0.254', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:29,312][52662] DAMAGECOUNT value on done: 542995.0 [2024-08-06 04:38:29,313][52662] Sum rewards: 70.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.400', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:29,940][52658] DAMAGECOUNT value on done: 541009.0 [2024-08-06 04:38:29,941][52658] Sum rewards: 60.213, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.878', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.264', 'weapon5': '0.274', 'weapon2': '0.298', 'AMMO4': '0.302', 'weapon4': '0.306', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.734', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '53.000'} [2024-08-06 04:38:30,683][52660] DAMAGECOUNT value on done: 545029.0 [2024-08-06 04:38:30,683][52660] Sum rewards: 79.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.608', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '65.500'} [2024-08-06 04:38:30,946][52664] DAMAGECOUNT value on done: 567534.0 [2024-08-06 04:38:30,948][52664] Sum rewards: 71.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.240', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.296', 'WEAPON3': '1.100', 'HITCOUNT': '3.410', 'weapon3': '3.464', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 04:38:31,160][52820] DAMAGECOUNT value on done: 501468.0 [2024-08-06 04:38:31,162][52820] Sum rewards: 79.913, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.233', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.442', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '67.000'} [2024-08-06 04:38:32,041][52662] DAMAGECOUNT value on done: 552610.0 [2024-08-06 04:38:32,041][52662] Sum rewards: 75.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.174', 'weapon4': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '62.000'} [2024-08-06 04:38:32,222][52668] DAMAGECOUNT value on done: 528623.0 [2024-08-06 04:38:32,224][52668] Sum rewards: 58.738, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.058', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.244', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '3.412', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '52.000'} [2024-08-06 04:38:32,261][52795] DAMAGECOUNT value on done: 502898.0 [2024-08-06 04:38:32,263][52795] Sum rewards: 71.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.464', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.187', 'weapon4': '0.210', 'weapon5': '0.244', 'AMMO4': '0.258', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:32,345][52671] DAMAGECOUNT value on done: 549424.0 [2024-08-06 04:38:32,345][52671] Sum rewards: 78.194, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.305', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'weapon4': '0.122', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'weapon2': '0.262', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.750', 'weapon3': '3.268', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '68.000'} [2024-08-06 04:38:32,364][52658] DAMAGECOUNT value on done: 542939.0 [2024-08-06 04:38:32,366][52658] Sum rewards: 67.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.714', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.160', 'weapon5': '0.188', 'AMMO4': '0.196', 'AMMO3': '0.232', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.032', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 450723840. Throughput: 0: 4358.2. Samples: 112679910. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:38:32,794][52567] Avg episode reward: [(0, '72.628')] [2024-08-06 04:38:33,056][52650] Updated weights for policy 0, policy_version 55021 (0.0011) [2024-08-06 04:38:33,458][52660] DAMAGECOUNT value on done: 550609.0 [2024-08-06 04:38:33,466][52660] Sum rewards: 70.284, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.693', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO3': '0.154', 'weapon4': '0.158', 'AMMO4': '0.165', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '0.950', 'weapon3': '3.128', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:33,539][52664] DAMAGECOUNT value on done: 570171.0 [2024-08-06 04:38:33,541][52664] Sum rewards: 69.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.132', 'AMMO4': '0.201', 'AMMO3': '0.204', 'weapon5': '0.232', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:34,201][52820] DAMAGECOUNT value on done: 504327.0 [2024-08-06 04:38:34,201][52820] Sum rewards: 67.978, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.950', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon4': '0.244', 'weapon5': '0.244', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.810', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:34,844][52668] DAMAGECOUNT value on done: 531404.0 [2024-08-06 04:38:34,846][52668] Sum rewards: 87.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.066', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.024', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.195', 'weapon2': '0.234', 'WEAPON3': '1.300', 'weapon3': '3.442', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.907', 'FRAGCOUNT': '71.500'} [2024-08-06 04:38:35,073][52671] DAMAGECOUNT value on done: 550405.0 [2024-08-06 04:38:35,073][52671] Sum rewards: 77.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.905', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.050', 'weapon5': '0.188', 'AMMO4': '0.226', 'AMMO3': '0.288', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.170', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '67.000'} [2024-08-06 04:38:35,289][52662] DAMAGECOUNT value on done: 538826.0 [2024-08-06 04:38:35,290][52662] Sum rewards: 70.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.986', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.080', 'AMMO4': '0.137', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:35,329][52795] DAMAGECOUNT value on done: 493642.0 [2024-08-06 04:38:35,330][52795] Sum rewards: 75.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.146', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon2': '0.132', 'weapon5': '0.136', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON3': '1.550', 'weapon3': '3.330', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '63.000'} [2024-08-06 04:38:35,503][52658] DAMAGECOUNT value on done: 532500.0 [2024-08-06 04:38:35,503][52658] Sum rewards: 67.856, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.090', 'weapon5': '0.136', 'AMMO4': '0.212', 'AMMO3': '0.257', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '57.500'} [2024-08-06 04:38:35,967][52660] DAMAGECOUNT value on done: 540506.0 [2024-08-06 04:38:35,968][52660] Sum rewards: 49.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.458', 'AMMO5': '0.023', 'AMMO2': '0.066', 'AMMO3': '0.226', 'weapon5': '0.284', 'weapon2': '0.294', 'weapon4': '0.322', 'AMMO4': '0.330', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.420', 'weapon3': '2.758', 'DAMAGECOUNT': '12.867', 'FRAGCOUNT': '43.000'} [2024-08-06 04:38:35,988][52664] DAMAGECOUNT value on done: 561899.0 [2024-08-06 04:38:35,989][52664] Sum rewards: 66.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.212', 'AMMO3': '0.244', 'AMMO4': '0.273', 'weapon4': '0.318', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '56.000'} [2024-08-06 04:38:37,356][52820] DAMAGECOUNT value on done: 500337.0 [2024-08-06 04:38:37,359][52820] Sum rewards: 67.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.184', 'AMMO3': '0.238', 'weapon5': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:37,437][52668] DAMAGECOUNT value on done: 533405.0 [2024-08-06 04:38:37,441][52668] Sum rewards: 81.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.202', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO3': '0.172', 'AMMO4': '0.186', 'weapon2': '0.204', 'weapon4': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '66.000'} [2024-08-06 04:38:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 450805760. Throughput: 0: 4366.2. Samples: 112706320. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:38:37,795][52567] Avg episode reward: [(0, '72.156')] [2024-08-06 04:38:37,847][52650] Updated weights for policy 0, policy_version 55031 (0.0015) [2024-08-06 04:38:38,002][52671] DAMAGECOUNT value on done: 545909.0 [2024-08-06 04:38:38,002][52671] Sum rewards: 75.783, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.253', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.190', 'weapon4': '0.204', 'AMMO3': '0.229', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '62.000'} [2024-08-06 04:38:38,316][52662] DAMAGECOUNT value on done: 545557.0 [2024-08-06 04:38:38,318][52662] Sum rewards: 71.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.620', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.140', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '60.000'} [2024-08-06 04:38:38,546][52795] DAMAGECOUNT value on done: 501234.0 [2024-08-06 04:38:38,546][52795] Sum rewards: 77.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.437', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.161', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '63.000'} [2024-08-06 04:38:38,689][52658] DAMAGECOUNT value on done: 548665.0 [2024-08-06 04:38:38,691][52658] Sum rewards: 66.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.850', 'AMMO5': '0.028', 'AMMO2': '0.059', 'weapon5': '0.252', 'AMMO3': '0.262', 'weapon4': '0.272', 'AMMO4': '0.297', 'weapon2': '0.398', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.724', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:38,831][52660] DAMAGECOUNT value on done: 538637.0 [2024-08-06 04:38:38,833][52660] Sum rewards: 74.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.164', 'AMMO3': '0.238', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '62.000'} [2024-08-06 04:38:39,174][52664] DAMAGECOUNT value on done: 557050.0 [2024-08-06 04:38:39,174][52664] Sum rewards: 71.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.042', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.088', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:40,111][52668] DAMAGECOUNT value on done: 542194.0 [2024-08-06 04:38:40,111][52668] Sum rewards: 86.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.644', 'AMMO5': '0.005', 'weapon5': '0.022', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon2': '0.194', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.242', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '71.000'} [2024-08-06 04:38:40,488][52820] DAMAGECOUNT value on done: 508613.0 [2024-08-06 04:38:40,489][52820] Sum rewards: 63.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.346', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.145', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.186', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '53.000'} [2024-08-06 04:38:40,909][52671] DAMAGECOUNT value on done: 542846.0 [2024-08-06 04:38:40,914][52671] Sum rewards: 78.480, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.545', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.148', 'weapon5': '0.184', 'AMMO3': '0.202', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:41,371][52660] DAMAGECOUNT value on done: 536220.0 [2024-08-06 04:38:41,373][52660] Sum rewards: 71.214, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.252', 'HEALTH': '0.459', 'WEAPON3': '0.950', 'HITCOUNT': '3.210', 'weapon3': '3.476', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:41,390][52662] DAMAGECOUNT value on done: 540146.0 [2024-08-06 04:38:41,390][52662] Sum rewards: 60.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.608', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.138', 'WEAPON7': '0.200', 'AMMO3': '0.210', 'weapon7': '0.214', 'weapon2': '0.216', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '50.000'} [2024-08-06 04:38:41,640][52658] DAMAGECOUNT value on done: 538816.0 [2024-08-06 04:38:41,640][52658] Sum rewards: 54.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.216', 'AMMO5': '0.023', 'AMMO2': '0.044', 'weapon4': '0.186', 'AMMO3': '0.187', 'AMMO4': '0.222', 'weapon2': '0.254', 'weapon5': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.500', 'weapon3': '2.902', 'DAMAGECOUNT': '13.398', 'FRAGCOUNT': '45.000'} [2024-08-06 04:38:41,685][52795] DAMAGECOUNT value on done: 505686.0 [2024-08-06 04:38:41,686][52795] Sum rewards: 79.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:42,324][52664] DAMAGECOUNT value on done: 563753.0 [2024-08-06 04:38:42,325][52664] Sum rewards: 69.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.046', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.125', 'weapon5': '0.180', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.212', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:42,336][52650] Updated weights for policy 0, policy_version 55041 (0.0014) [2024-08-06 04:38:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 450895872. Throughput: 0: 4369.8. Samples: 112732720. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:38:42,794][52567] Avg episode reward: [(0, '72.038')] [2024-08-06 04:38:42,909][52668] DAMAGECOUNT value on done: 543948.0 [2024-08-06 04:38:42,909][52668] Sum rewards: 84.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.703', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.127', 'weapon5': '0.128', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '70.000'} [2024-08-06 04:38:42,943][52665] DAMAGECOUNT value on done: 529171.0 [2024-08-06 04:38:42,943][52665] Sum rewards: 63.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.152', 'AMMO3': '0.182', 'weapon5': '0.234', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.630', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '51.000'} [2024-08-06 04:38:43,618][52820] DAMAGECOUNT value on done: 496813.0 [2024-08-06 04:38:43,618][52820] Sum rewards: 72.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO2': '0.038', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon4': '0.224', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:44,077][52658] DAMAGECOUNT value on done: 541826.0 [2024-08-06 04:38:44,078][52658] Sum rewards: 67.726, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.124', 'AMMO3': '0.134', 'HEALTH': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.251', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.670', 'WEAPON3': '0.800', 'weapon3': '2.706', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '53.000'} [2024-08-06 04:38:44,152][52662] DAMAGECOUNT value on done: 549451.0 [2024-08-06 04:38:44,153][52662] Sum rewards: 58.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.845', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.064', 'weapon5': '0.142', 'AMMO3': '0.241', 'AMMO4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.550', 'HITCOUNT': '2.730', 'weapon3': '3.196', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '51.000'} [2024-08-06 04:38:44,612][52660] DAMAGECOUNT value on done: 547949.0 [2024-08-06 04:38:44,613][52660] Sum rewards: 68.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.010', 'AMMO5': '0.026', 'AMMO2': '0.082', 'weapon4': '0.190', 'AMMO3': '0.199', 'weapon5': '0.352', 'AMMO4': '0.410', 'weapon2': '0.722', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.366', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:45,233][52664] DAMAGECOUNT value on done: 562632.0 [2024-08-06 04:38:45,235][52664] Sum rewards: 71.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.364', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.172', 'AMMO3': '0.188', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:45,716][52665] DAMAGECOUNT value on done: 544788.0 [2024-08-06 04:38:45,716][52665] Sum rewards: 73.347, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.358', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '60.000'} [2024-08-06 04:38:45,911][52668] DAMAGECOUNT value on done: 542578.0 [2024-08-06 04:38:45,912][52668] Sum rewards: 79.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.150', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '66.000'} [2024-08-06 04:38:46,838][52820] DAMAGECOUNT value on done: 503478.0 [2024-08-06 04:38:46,838][52820] Sum rewards: 68.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.311', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.170', 'weapon5': '0.174', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '55.000'} [2024-08-06 04:38:47,100][52650] Updated weights for policy 0, policy_version 55051 (0.0024) [2024-08-06 04:38:47,102][52658] DAMAGECOUNT value on done: 547397.0 [2024-08-06 04:38:47,103][52658] Sum rewards: 76.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.651', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:47,148][52660] DAMAGECOUNT value on done: 540659.0 [2024-08-06 04:38:47,149][52660] Sum rewards: 67.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.764', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.140', 'weapon5': '0.174', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '56.000'} [2024-08-06 04:38:47,573][52662] DAMAGECOUNT value on done: 543359.0 [2024-08-06 04:38:47,575][52662] Sum rewards: 70.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.375', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.298', 'weapon4': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:47,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 450985984. Throughput: 0: 4365.8. Samples: 112745710. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:38:47,794][52567] Avg episode reward: [(0, '71.600')] [2024-08-06 04:38:48,387][52664] DAMAGECOUNT value on done: 560231.0 [2024-08-06 04:38:48,387][52664] Sum rewards: 63.667, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.419', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.159', 'AMMO4': '0.194', 'weapon2': '0.208', 'weapon4': '0.212', 'weapon5': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.110', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '51.000'} [2024-08-06 04:38:48,429][52665] DAMAGECOUNT value on done: 538610.0 [2024-08-06 04:38:48,430][52665] Sum rewards: 75.330, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.919', 'AMMO2': '0.004', 'AMMO5': '0.008', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'AMMO3': '0.147', 'weapon5': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.588', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '59.000'} [2024-08-06 04:38:48,820][52668] DAMAGECOUNT value on done: 545674.0 [2024-08-06 04:38:48,828][52668] Sum rewards: 86.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.098', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.067', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.506', 'WEAPON3': '1.500', 'weapon3': '3.178', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.654', 'FRAGCOUNT': '72.000'} [2024-08-06 04:38:49,799][52660] DAMAGECOUNT value on done: 539660.0 [2024-08-06 04:38:49,799][52660] Sum rewards: 70.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.086', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO4': '0.207', 'AMMO3': '0.220', 'weapon5': '0.238', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:49,962][52820] DAMAGECOUNT value on done: 510629.0 [2024-08-06 04:38:49,967][52820] Sum rewards: 66.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.231', 'AMMO4': '0.243', 'weapon5': '0.250', 'weapon4': '0.266', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '56.500'} [2024-08-06 04:38:50,204][52662] DAMAGECOUNT value on done: 552392.0 [2024-08-06 04:38:50,207][52662] Sum rewards: 68.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.296', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.120', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.488', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '58.000'} [2024-08-06 04:38:51,317][52668] DAMAGECOUNT value on done: 544416.0 [2024-08-06 04:38:51,317][52668] Sum rewards: 67.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.465', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.075', 'weapon5': '0.082', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.318', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:51,493][52665] DAMAGECOUNT value on done: 534620.0 [2024-08-06 04:38:51,493][52665] Sum rewards: 55.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.034', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.572', 'WEAPON3': '1.200', 'HITCOUNT': '2.730', 'weapon3': '3.206', 'DAMAGECOUNT': '13.503', 'FRAGCOUNT': '46.000'} [2024-08-06 04:38:51,820][52650] Updated weights for policy 0, policy_version 55061 (0.0029) [2024-08-06 04:38:52,565][52660] DAMAGECOUNT value on done: 548942.0 [2024-08-06 04:38:52,567][52660] Sum rewards: 78.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.188', 'weapon5': '0.224', 'AMMO3': '0.234', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:52,726][52662] DAMAGECOUNT value on done: 546676.0 [2024-08-06 04:38:52,728][52662] Sum rewards: 67.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'AMMO5': '0.028', 'AMMO2': '0.059', 'weapon4': '0.144', 'AMMO3': '0.229', 'AMMO4': '0.296', 'weapon5': '0.340', 'WEAPON4': '0.600', 'weapon2': '0.632', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.586', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 04:38:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 451067904. Throughput: 0: 4367.1. Samples: 112772100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:38:52,794][52567] Avg episode reward: [(0, '71.373')] [2024-08-06 04:38:53,003][52820] DAMAGECOUNT value on done: 505712.0 [2024-08-06 04:38:53,006][52820] Sum rewards: 85.575, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.222', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '68.000'} [2024-08-06 04:38:53,757][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:38:54,473][52665] DAMAGECOUNT value on done: 527229.0 [2024-08-06 04:38:54,475][52665] Sum rewards: 68.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.123', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon4': '0.214', 'AMMO3': '0.235', 'weapon5': '0.236', 'weapon2': '0.250', 'AMMO4': '0.283', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '59.500'} [2024-08-06 04:38:55,686][52660] DAMAGECOUNT value on done: 534978.0 [2024-08-06 04:38:55,687][52660] Sum rewards: 78.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.070', 'AMMO3': '0.193', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.480', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:55,876][52662] DAMAGECOUNT value on done: 538585.0 [2024-08-06 04:38:55,878][52662] Sum rewards: 79.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.106', 'weapon5': '0.136', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:56,210][52820] DAMAGECOUNT value on done: 508185.0 [2024-08-06 04:38:56,213][52820] Sum rewards: 57.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.782', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon2': '0.190', 'AMMO3': '0.199', 'AMMO4': '0.298', 'weapon5': '0.350', 'WEAPON5': '0.550', 'weapon4': '0.558', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.300', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '47.500'} [2024-08-06 04:38:56,673][52650] Updated weights for policy 0, policy_version 55071 (0.0013) [2024-08-06 04:38:57,300][52665] DAMAGECOUNT value on done: 534171.0 [2024-08-06 04:38:57,300][52665] Sum rewards: 77.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.233', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.464', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '65.000'} [2024-08-06 04:38:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 451158016. Throughput: 0: 4364.4. Samples: 112798440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:38:57,795][52567] Avg episode reward: [(0, '71.614')] [2024-08-06 04:38:58,859][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:38:58,950][52662] DAMAGECOUNT value on done: 544446.0 [2024-08-06 04:38:58,951][52662] Sum rewards: 75.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.386', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '63.000'} [2024-08-06 04:38:58,991][52660] DAMAGECOUNT value on done: 539393.0 [2024-08-06 04:38:58,992][52660] Sum rewards: 81.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'AMMO5': '0.024', 'AMMO2': '0.076', 'AMMO3': '0.201', 'weapon2': '0.292', 'AMMO4': '0.378', 'weapon5': '0.400', 'weapon4': '0.416', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.542', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '64.000'} [2024-08-06 04:38:59,209][52820] DAMAGECOUNT value on done: 503592.0 [2024-08-06 04:38:59,212][52820] Sum rewards: 79.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.099', 'weapon5': '0.172', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.248', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '64.000'} [2024-08-06 04:39:00,358][52665] DAMAGECOUNT value on done: 538042.0 [2024-08-06 04:39:00,358][52665] Sum rewards: 76.295, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.034', 'HEALTH': '0.044', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.558', 'WEAPON3': '0.900', 'weapon3': '3.344', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '59.000'} [2024-08-06 04:39:00,653][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:39:00,995][52650] Updated weights for policy 0, policy_version 55081 (0.0013) [2024-08-06 04:39:01,681][52662] DAMAGECOUNT value on done: 538194.0 [2024-08-06 04:39:01,682][52662] Sum rewards: 50.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.624', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.241', 'weapon2': '0.278', 'AMMO4': '0.281', 'weapon5': '0.292', 'WEAPON5': '0.550', 'weapon4': '0.628', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.444', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.271', 'FRAGCOUNT': '43.000'} [2024-08-06 04:39:01,868][52660] DAMAGECOUNT value on done: 550786.0 [2024-08-06 04:39:01,868][52660] Sum rewards: 81.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.110', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '68.000'} [2024-08-06 04:39:02,254][52820] DAMAGECOUNT value on done: 505628.0 [2024-08-06 04:39:02,255][52820] Sum rewards: 74.312, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.016', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.149', 'weapon4': '0.240', 'weapon2': '0.258', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 04:39:02,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 451248128. Throughput: 0: 4372.6. Samples: 112811700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:39:02,795][52567] Avg episode reward: [(0, '71.529')] [2024-08-06 04:39:02,872][52665] DAMAGECOUNT value on done: 537095.0 [2024-08-06 04:39:02,873][52665] Sum rewards: 76.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.686', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '64.000'} [2024-08-06 04:39:05,195][52660] DAMAGECOUNT value on done: 555103.0 [2024-08-06 04:39:05,197][52660] Sum rewards: 76.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.720', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.354', 'weapon4': '0.476', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:05,408][52659] DAMAGECOUNT value on done: 549036.0 [2024-08-06 04:39:05,409][52659] Sum rewards: 80.914, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.494', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.206', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '66.000'} [2024-08-06 04:39:05,449][52820] DAMAGECOUNT value on done: 514455.0 [2024-08-06 04:39:05,449][52820] Sum rewards: 67.081, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.176', 'AMMO4': '0.202', 'AMMO3': '0.292', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.122', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '58.000'} [2024-08-06 04:39:05,639][52665] DAMAGECOUNT value on done: 543565.0 [2024-08-06 04:39:05,639][52665] Sum rewards: 68.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.133', 'AMMO3': '0.220', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '58.000'} [2024-08-06 04:39:05,836][52650] Updated weights for policy 0, policy_version 55091 (0.0014) [2024-08-06 04:39:07,339][52664] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon3', 0.002)] [2024-08-06 04:39:07,785][52659] DAMAGECOUNT value on done: 543265.0 [2024-08-06 04:39:07,787][52659] Sum rewards: 73.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.010', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.094', 'weapon5': '0.208', 'AMMO3': '0.235', 'AMMO4': '0.273', 'weapon2': '0.302', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '62.000'} [2024-08-06 04:39:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 451338240. Throughput: 0: 4367.3. Samples: 112837310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:39:07,794][52567] Avg episode reward: [(0, '71.616')] [2024-08-06 04:39:07,867][52660] DAMAGECOUNT value on done: 538906.0 [2024-08-06 04:39:07,869][52660] Sum rewards: 79.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.645', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.048', 'weapon5': '0.132', 'AMMO4': '0.212', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '67.000'} [2024-08-06 04:39:08,607][52820] DAMAGECOUNT value on done: 512993.0 [2024-08-06 04:39:08,608][52820] Sum rewards: 70.221, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.136', 'weapon5': '0.152', 'AMMO3': '0.161', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.278', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '56.000'} [2024-08-06 04:39:09,024][52665] DAMAGECOUNT value on done: 536921.0 [2024-08-06 04:39:09,024][52665] Sum rewards: 75.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.617', 'AMMO2': '0.002', 'AMMO4': '0.009', 'WEAPON4': '0.050', 'weapon4': '0.122', 'AMMO3': '0.193', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '61.000'} [2024-08-06 04:39:09,891][52794] DAMAGECOUNT value on done: 547748.0 [2024-08-06 04:39:09,894][52794] Sum rewards: 71.610, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.005', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.260', 'AMMO3': '0.266', 'WEAPON3': '1.700', 'weapon3': '3.368', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '63.000'} [2024-08-06 04:39:10,371][52659] DAMAGECOUNT value on done: 548358.0 [2024-08-06 04:39:10,372][52659] Sum rewards: 70.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.137', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon2': '0.670', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '58.000'} [2024-08-06 04:39:10,406][52650] Updated weights for policy 0, policy_version 55101 (0.0029) [2024-08-06 04:39:10,940][52660] DAMAGECOUNT value on done: 546225.0 [2024-08-06 04:39:10,940][52660] Sum rewards: 67.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.176', 'weapon4': '0.222', 'AMMO4': '0.223', 'AMMO3': '0.257', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '58.000'} [2024-08-06 04:39:11,654][52665] DAMAGECOUNT value on done: 546976.0 [2024-08-06 04:39:11,655][52665] Sum rewards: 83.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.723', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.114', 'AMMO4': '0.171', 'AMMO3': '0.202', 'weapon5': '0.224', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '67.000'} [2024-08-06 04:39:11,789][52820] DAMAGECOUNT value on done: 498569.0 [2024-08-06 04:39:11,789][52820] Sum rewards: 57.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.140', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.410', 'WEAPON3': '1.500', 'HITCOUNT': '2.840', 'weapon3': '3.144', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '50.000'} [2024-08-06 04:39:12,789][52659] DAMAGECOUNT value on done: 544129.0 [2024-08-06 04:39:12,791][52659] Sum rewards: 61.819, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.454', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.294', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 04:39:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 451420160. Throughput: 0: 4360.9. Samples: 112863390. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:39:12,795][52567] Avg episode reward: [(0, '72.052')] [2024-08-06 04:39:12,984][52794] DAMAGECOUNT value on done: 550100.0 [2024-08-06 04:39:12,986][52794] Sum rewards: 65.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.153', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.068', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '55.000'} [2024-08-06 04:39:14,114][52660] DAMAGECOUNT value on done: 540065.0 [2024-08-06 04:39:14,116][52660] Sum rewards: 77.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.926', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.252', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '65.000'} [2024-08-06 04:39:14,141][52811] DAMAGECOUNT value on done: 518864.0 [2024-08-06 04:39:14,143][52811] Sum rewards: 69.583, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.052', 'AMMO5': '0.025', 'AMMO2': '0.059', 'weapon4': '0.124', 'weapon5': '0.236', 'AMMO3': '0.257', 'AMMO4': '0.298', 'weapon2': '0.334', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.916', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:14,865][52665] DAMAGECOUNT value on done: 542224.0 [2024-08-06 04:39:14,866][52665] Sum rewards: 62.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.115', 'AMMO5': '0.021', 'AMMO2': '0.039', 'weapon4': '0.114', 'AMMO4': '0.196', 'weapon5': '0.236', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.634', 'WEAPON3': '1.600', 'weapon3': '2.688', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '54.000'} [2024-08-06 04:39:15,459][52650] Updated weights for policy 0, policy_version 55111 (0.0019) [2024-08-06 04:39:16,047][52659] DAMAGECOUNT value on done: 540709.0 [2024-08-06 04:39:16,048][52659] Sum rewards: 70.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.647', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.114', 'AMMO3': '0.174', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.096', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '57.000'} [2024-08-06 04:39:16,208][52794] DAMAGECOUNT value on done: 549822.0 [2024-08-06 04:39:16,211][52794] Sum rewards: 76.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.945', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.112', 'weapon5': '0.138', 'AMMO4': '0.167', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '62.000'} [2024-08-06 04:39:17,193][52660] DAMAGECOUNT value on done: 541703.0 [2024-08-06 04:39:17,193][52660] Sum rewards: 56.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.569', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO4': '0.215', 'weapon5': '0.216', 'weapon2': '0.236', 'AMMO3': '0.272', 'weapon4': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.890', 'weapon3': '2.938', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '50.000'} [2024-08-06 04:39:17,213][52811] DAMAGECOUNT value on done: 504561.0 [2024-08-06 04:39:17,215][52811] Sum rewards: 70.591, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.266', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.432', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.232', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.500'} [2024-08-06 04:39:17,556][52665] DAMAGECOUNT value on done: 538974.0 [2024-08-06 04:39:17,557][52665] Sum rewards: 73.781, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.095', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.122', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '59.000'} [2024-08-06 04:39:17,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 451502080. Throughput: 0: 4370.9. Samples: 112876600. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:39:17,794][52567] Avg episode reward: [(0, '71.426')] [2024-08-06 04:39:18,795][52794] DAMAGECOUNT value on done: 541081.0 [2024-08-06 04:39:18,796][52794] Sum rewards: 74.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.835', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.150', 'weapon5': '0.166', 'AMMO4': '0.178', 'AMMO3': '0.227', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '63.000'} [2024-08-06 04:39:19,044][52659] DAMAGECOUNT value on done: 543621.0 [2024-08-06 04:39:19,046][52659] Sum rewards: 73.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.879', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.140', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '59.000'} [2024-08-06 04:39:19,967][52650] Updated weights for policy 0, policy_version 55121 (0.0012) [2024-08-06 04:39:20,431][52811] DAMAGECOUNT value on done: 501477.0 [2024-08-06 04:39:20,431][52811] Sum rewards: 76.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.136', 'AMMO3': '0.217', 'weapon5': '0.218', 'AMMO4': '0.251', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '63.000'} [2024-08-06 04:39:20,443][52665] DAMAGECOUNT value on done: 538714.0 [2024-08-06 04:39:20,444][52665] Sum rewards: 67.074, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.278', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.075', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.216', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.346', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '58.000'} [2024-08-06 04:39:20,462][52660] DAMAGECOUNT value on done: 532293.0 [2024-08-06 04:39:20,463][52660] Sum rewards: 69.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.156', 'weapon5': '0.166', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '58.000'} [2024-08-06 04:39:21,555][52794] Large shaping reward -2.536 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:39:21,589][52794] DAMAGECOUNT value on done: 540324.0 [2024-08-06 04:39:21,590][52794] Sum rewards: 73.152, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.079', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.716', 'WEAPON3': '0.950', 'weapon3': '2.880', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '57.500'} [2024-08-06 04:39:21,850][52659] DAMAGECOUNT value on done: 544548.0 [2024-08-06 04:39:21,850][52659] Sum rewards: 76.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.696', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.314', 'WEAPON3': '1.550', 'weapon3': '3.324', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '65.000'} [2024-08-06 04:39:21,973][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:39:22,795][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 451592192. Throughput: 0: 4364.4. Samples: 112902720. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 04:39:22,795][52567] Avg episode reward: [(0, '71.605')] [2024-08-06 04:39:23,394][52665] DAMAGECOUNT value on done: 535977.0 [2024-08-06 04:39:23,396][52665] Sum rewards: 66.278, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.368', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon4': '0.102', 'AMMO3': '0.255', 'weapon5': '0.268', 'AMMO4': '0.333', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.820', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '57.000'} [2024-08-06 04:39:23,447][52811] DAMAGECOUNT value on done: 505626.0 [2024-08-06 04:39:23,448][52811] Sum rewards: 77.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.066', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.122', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '64.000'} [2024-08-06 04:39:24,397][52794] DAMAGECOUNT value on done: 542280.0 [2024-08-06 04:39:24,399][52794] Sum rewards: 88.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.138', 'weapon5': '0.166', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.684', 'FRAGCOUNT': '72.000'} [2024-08-06 04:39:24,579][52650] Updated weights for policy 0, policy_version 55131 (0.0017) [2024-08-06 04:39:25,032][52659] DAMAGECOUNT value on done: 541081.0 [2024-08-06 04:39:25,035][52659] Sum rewards: 64.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.351', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'weapon4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.518', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.124', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '55.000'} [2024-08-06 04:39:25,984][52665] DAMAGECOUNT value on done: 533109.0 [2024-08-06 04:39:25,985][52665] Sum rewards: 61.143, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.555', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon5': '0.162', 'weapon4': '0.184', 'AMMO3': '0.272', 'AMMO4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.560', 'WEAPON3': '1.700', 'weapon3': '2.810', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '55.000'} [2024-08-06 04:39:26,518][52811] DAMAGECOUNT value on done: 509716.0 [2024-08-06 04:39:26,518][52811] Sum rewards: 61.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.822', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.145', 'weapon5': '0.146', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '54.000'} [2024-08-06 04:39:27,305][52794] DAMAGECOUNT value on done: 550792.0 [2024-08-06 04:39:27,305][52794] Sum rewards: 73.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.102', 'AMMO4': '0.140', 'AMMO3': '0.180', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '59.000'} [2024-08-06 04:39:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 451682304. Throughput: 0: 4359.6. Samples: 112928900. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 04:39:27,794][52567] Avg episode reward: [(0, '71.494')] [2024-08-06 04:39:27,885][52659] DAMAGECOUNT value on done: 547435.0 [2024-08-06 04:39:27,887][52659] Sum rewards: 63.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.126', 'weapon5': '0.182', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.120', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '52.000'} [2024-08-06 04:39:28,618][52665] DAMAGECOUNT value on done: 536872.0 [2024-08-06 04:39:28,620][52665] Sum rewards: 71.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.634', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.138', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:29,407][52650] Updated weights for policy 0, policy_version 55141 (0.0036) [2024-08-06 04:39:29,567][52811] DAMAGECOUNT value on done: 515422.0 [2024-08-06 04:39:29,571][52811] Sum rewards: 89.058, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.224', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.136', 'weapon4': '0.140', 'weapon2': '0.214', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.357', 'FRAGCOUNT': '73.000'} [2024-08-06 04:39:30,483][52794] DAMAGECOUNT value on done: 538083.0 [2024-08-06 04:39:30,484][52794] Sum rewards: 66.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO4': '0.183', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.500'} [2024-08-06 04:39:30,533][52659] DAMAGECOUNT value on done: 551507.0 [2024-08-06 04:39:30,536][52659] Sum rewards: 75.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.360', 'AMMO5': '0.019', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon4': '0.198', 'AMMO3': '0.214', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.612', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '63.000'} [2024-08-06 04:39:30,583][52649] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:39:31,271][52663] Large shaping reward 2.518 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0)] [2024-08-06 04:39:31,529][52665] DAMAGECOUNT value on done: 533284.0 [2024-08-06 04:39:31,529][52665] Sum rewards: 66.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.972', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.210', 'AMMO3': '0.211', 'weapon5': '0.262', 'AMMO4': '0.282', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '55.500'} [2024-08-06 04:39:32,589][52811] DAMAGECOUNT value on done: 511809.0 [2024-08-06 04:39:32,591][52811] Sum rewards: 69.867, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.252', 'WEAPON3': '1.600', 'weapon3': '3.348', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:32,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 451772416. Throughput: 0: 4365.5. Samples: 112942160. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 04:39:32,794][52567] Avg episode reward: [(0, '71.330')] [2024-08-06 04:39:33,336][52659] DAMAGECOUNT value on done: 541748.0 [2024-08-06 04:39:33,336][52659] Sum rewards: 75.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.860', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '62.000'} [2024-08-06 04:39:33,745][52794] DAMAGECOUNT value on done: 546963.0 [2024-08-06 04:39:33,745][52794] Sum rewards: 71.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.638', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:33,983][52650] Updated weights for policy 0, policy_version 55151 (0.0021) [2024-08-06 04:39:34,182][52665] DAMAGECOUNT value on done: 536712.0 [2024-08-06 04:39:34,183][52665] Sum rewards: 69.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.318', 'weapon2': '0.326', 'WEAPON3': '1.000', 'weapon3': '2.996', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '56.000'} [2024-08-06 04:39:35,630][52811] DAMAGECOUNT value on done: 507373.0 [2024-08-06 04:39:35,638][52811] Sum rewards: 72.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.122', 'weapon4': '0.140', 'AMMO4': '0.157', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '61.000'} [2024-08-06 04:39:35,956][52659] DAMAGECOUNT value on done: 545035.0 [2024-08-06 04:39:35,957][52659] Sum rewards: 48.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.147', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON7': '0.200', 'weapon2': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon7': '0.334', 'weapon4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.500', 'weapon3': '2.566', 'DAMAGECOUNT': '11.766', 'FRAGCOUNT': '42.000'} [2024-08-06 04:39:36,528][52794] DAMAGECOUNT value on done: 543608.0 [2024-08-06 04:39:36,528][52794] Sum rewards: 70.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.394', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.096', 'AMMO3': '0.153', 'AMMO4': '0.195', 'weapon5': '0.214', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.186', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '55.500'} [2024-08-06 04:39:36,916][52665] DAMAGECOUNT value on done: 538066.0 [2024-08-06 04:39:36,919][52665] Sum rewards: 67.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.160', 'weapon5': '0.190', 'AMMO4': '0.196', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '57.000'} [2024-08-06 04:39:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 451854336. Throughput: 0: 4366.0. Samples: 112968570. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 04:39:37,795][52567] Avg episode reward: [(0, '71.280')] [2024-08-06 04:39:38,668][52650] Updated weights for policy 0, policy_version 55161 (0.0012) [2024-08-06 04:39:38,766][52811] DAMAGECOUNT value on done: 514434.0 [2024-08-06 04:39:38,770][52811] Sum rewards: 79.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '65.000'} [2024-08-06 04:39:38,836][52659] DAMAGECOUNT value on done: 538264.0 [2024-08-06 04:39:38,838][52659] Sum rewards: 70.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.216', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'weapon3': '3.546', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '59.000'} [2024-08-06 04:39:39,113][52803] DAMAGECOUNT value on done: 507356.0 [2024-08-06 04:39:39,114][52803] Sum rewards: 68.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 04:39:39,427][52794] DAMAGECOUNT value on done: 539717.0 [2024-08-06 04:39:39,428][52794] Sum rewards: 79.339, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.764', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '65.000'} [2024-08-06 04:39:41,931][52659] DAMAGECOUNT value on done: 543112.0 [2024-08-06 04:39:41,933][52659] Sum rewards: 76.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.855', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.132', 'AMMO4': '0.203', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '63.000'} [2024-08-06 04:39:41,964][52811] DAMAGECOUNT value on done: 509248.0 [2024-08-06 04:39:41,964][52811] Sum rewards: 64.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.036', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.522', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.190', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '55.000'} [2024-08-06 04:39:42,374][52803] DAMAGECOUNT value on done: 506182.0 [2024-08-06 04:39:42,375][52803] Sum rewards: 67.878, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.346', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.088', 'AMMO4': '0.198', 'weapon5': '0.208', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.320', 'WEAPON3': '1.950', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:42,649][52794] DAMAGECOUNT value on done: 544686.0 [2024-08-06 04:39:42,654][52794] Sum rewards: 72.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.688', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.144', 'weapon4': '0.178', 'AMMO3': '0.204', 'AMMO4': '0.244', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '59.000'} [2024-08-06 04:39:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 451944448. Throughput: 0: 4356.2. Samples: 112994470. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 04:39:42,795][52567] Avg episode reward: [(0, '71.190')] [2024-08-06 04:39:43,623][52650] Updated weights for policy 0, policy_version 55171 (0.0037) [2024-08-06 04:39:44,871][52659] DAMAGECOUNT value on done: 554077.0 [2024-08-06 04:39:44,871][52659] Sum rewards: 69.212, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.488', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.088', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '56.000'} [2024-08-06 04:39:45,030][52811] DAMAGECOUNT value on done: 510516.0 [2024-08-06 04:39:45,032][52811] Sum rewards: 83.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.006', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.199', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '67.000'} [2024-08-06 04:39:45,596][52803] DAMAGECOUNT value on done: 511997.0 [2024-08-06 04:39:45,596][52803] Sum rewards: 62.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.106', 'AMMO3': '0.215', 'AMMO4': '0.236', 'weapon5': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.700', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '52.000'} [2024-08-06 04:39:45,781][52794] DAMAGECOUNT value on done: 540955.0 [2024-08-06 04:39:45,783][52794] Sum rewards: 81.648, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.870', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'weapon4': '0.076', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.334', 'WEAPON3': '2.000', 'weapon3': '3.386', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.294', 'FRAGCOUNT': '71.000'} [2024-08-06 04:39:47,619][52659] DAMAGECOUNT value on done: 546617.0 [2024-08-06 04:39:47,620][52659] Sum rewards: 62.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon5': '0.206', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.040', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '52.000'} [2024-08-06 04:39:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 452034560. Throughput: 0: 4350.3. Samples: 113007460. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 04:39:47,794][52567] Avg episode reward: [(0, '71.282')] [2024-08-06 04:39:47,954][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:39:48,107][52650] Updated weights for policy 0, policy_version 55181 (0.0025) [2024-08-06 04:39:48,325][52811] DAMAGECOUNT value on done: 519946.0 [2024-08-06 04:39:48,329][52811] Sum rewards: 74.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.360', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:48,414][52794] DAMAGECOUNT value on done: 558612.0 [2024-08-06 04:39:48,415][52794] Sum rewards: 63.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.885', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.168', 'AMMO4': '0.186', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '2.834', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '56.500'} [2024-08-06 04:39:48,676][52803] DAMAGECOUNT value on done: 513290.0 [2024-08-06 04:39:48,678][52803] Sum rewards: 68.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.528', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.231', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.430', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '57.000'} [2024-08-06 04:39:50,144][52663] DAMAGECOUNT value on done: 552880.0 [2024-08-06 04:39:50,145][52663] Sum rewards: 60.462, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.920', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.134', 'weapon4': '0.138', 'AMMO4': '0.199', 'weapon2': '0.216', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '52.500'} [2024-08-06 04:39:50,332][52659] DAMAGECOUNT value on done: 553014.0 [2024-08-06 04:39:50,333][52659] Sum rewards: 63.896, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.925', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.132', 'AMMO3': '0.145', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.014', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '51.000'} [2024-08-06 04:39:51,436][52811] DAMAGECOUNT value on done: 505798.0 [2024-08-06 04:39:51,436][52811] Sum rewards: 65.641, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.436', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.170', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.472', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '53.000'} [2024-08-06 04:39:51,520][52794] DAMAGECOUNT value on done: 537073.0 [2024-08-06 04:39:51,523][52794] Sum rewards: 64.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.140', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.170', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '56.000'} [2024-08-06 04:39:51,824][52803] DAMAGECOUNT value on done: 509499.0 [2024-08-06 04:39:51,825][52803] Sum rewards: 65.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.180', 'AMMO3': '0.225', 'AMMO4': '0.241', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.832', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '54.000'} [2024-08-06 04:39:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 452116480. Throughput: 0: 4363.1. Samples: 113033650. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 04:39:52,794][52567] Avg episode reward: [(0, '70.985')] [2024-08-06 04:39:52,970][52663] DAMAGECOUNT value on done: 543810.0 [2024-08-06 04:39:52,972][52663] Sum rewards: 57.879, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.036', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.154', 'AMMO4': '0.206', 'AMMO3': '0.256', 'weapon5': '0.288', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.930', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 04:39:53,014][52650] Updated weights for policy 0, policy_version 55191 (0.0034) [2024-08-06 04:39:53,311][52659] DAMAGECOUNT value on done: 543995.0 [2024-08-06 04:39:53,312][52659] Sum rewards: 66.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon4': '0.122', 'weapon5': '0.124', 'AMMO3': '0.227', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '57.000'} [2024-08-06 04:39:54,077][52794] DAMAGECOUNT value on done: 553439.0 [2024-08-06 04:39:54,077][52794] Sum rewards: 61.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.503', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.144', 'weapon2': '0.154', 'AMMO3': '0.155', 'AMMO4': '0.165', 'weapon4': '0.168', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '3.326', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.500'} [2024-08-06 04:39:54,556][52811] DAMAGECOUNT value on done: 504218.0 [2024-08-06 04:39:54,556][52811] Sum rewards: 61.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.115', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.190', 'AMMO3': '0.205', 'weapon4': '0.212', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.338', 'DAMAGECOUNT': '13.986', 'FRAGCOUNT': '53.000'} [2024-08-06 04:39:54,998][52803] DAMAGECOUNT value on done: 501493.0 [2024-08-06 04:39:54,999][52803] Sum rewards: 74.054, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.685', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon4': '0.190', 'AMMO3': '0.246', 'weapon2': '0.300', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.758', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 04:39:56,010][52659] DAMAGECOUNT value on done: 548814.0 [2024-08-06 04:39:56,010][52659] Sum rewards: 65.758, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.194', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.140', 'AMMO4': '0.183', 'AMMO3': '0.199', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '53.000'} [2024-08-06 04:39:56,057][52663] DAMAGECOUNT value on done: 533313.0 [2024-08-06 04:39:56,057][52663] Sum rewards: 72.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.022', 'AMMO2': '0.052', 'weapon4': '0.142', 'AMMO3': '0.212', 'weapon5': '0.256', 'AMMO4': '0.260', 'weapon2': '0.400', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '60.000'} [2024-08-06 04:39:56,887][52794] DAMAGECOUNT value on done: 543771.0 [2024-08-06 04:39:56,887][52794] Sum rewards: 60.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.127', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.170', 'DAMAGECOUNT': '14.730', 'FRAGCOUNT': '52.000'} [2024-08-06 04:39:57,513][52650] Updated weights for policy 0, policy_version 55201 (0.0020) [2024-08-06 04:39:57,556][52811] DAMAGECOUNT value on done: 508918.0 [2024-08-06 04:39:57,556][52811] Sum rewards: 62.435, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '52.000'} [2024-08-06 04:39:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 452206592. Throughput: 0: 4359.4. Samples: 113059560. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:39:57,794][52567] Avg episode reward: [(0, '70.330')] [2024-08-06 04:39:58,240][52803] DAMAGECOUNT value on done: 504202.0 [2024-08-06 04:39:58,240][52803] Sum rewards: 70.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.032', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon4': '0.220', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '57.000'} [2024-08-06 04:39:58,763][52663] DAMAGECOUNT value on done: 541458.0 [2024-08-06 04:39:58,763][52663] Sum rewards: 74.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.827', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO4': '0.171', 'weapon5': '0.212', 'AMMO3': '0.258', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.112', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '63.000'} [2024-08-06 04:39:59,070][52659] DAMAGECOUNT value on done: 545050.0 [2024-08-06 04:39:59,072][52659] Sum rewards: 77.317, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.080', 'weapon4': '0.088', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.486', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '65.000'} [2024-08-06 04:39:59,703][52794] DAMAGECOUNT value on done: 552662.0 [2024-08-06 04:39:59,703][52794] Sum rewards: 67.319, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.680', 'AMMO5': '0.005', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.076', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:00,237][52614] Signal inference workers to stop experience collection... (10050 times) [2024-08-06 04:40:00,238][52614] Signal inference workers to resume experience collection... (10050 times) [2024-08-06 04:40:00,289][52650] InferenceWorker_p0-w0: stopping experience collection (10050 times) [2024-08-06 04:40:00,290][52650] InferenceWorker_p0-w0: resuming experience collection (10050 times) [2024-08-06 04:40:00,656][52811] DAMAGECOUNT value on done: 506821.0 [2024-08-06 04:40:00,657][52811] Sum rewards: 81.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.228', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.170', 'AMMO3': '0.183', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '3.150', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '65.000'} [2024-08-06 04:40:01,329][52803] DAMAGECOUNT value on done: 501600.0 [2024-08-06 04:40:01,331][52803] Sum rewards: 65.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.238', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '54.500'} [2024-08-06 04:40:01,652][52663] DAMAGECOUNT value on done: 545676.0 [2024-08-06 04:40:01,652][52663] Sum rewards: 79.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.260', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.118', 'AMMO4': '0.197', 'weapon5': '0.198', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '67.000'} [2024-08-06 04:40:01,773][52667] DAMAGECOUNT value on done: 546558.0 [2024-08-06 04:40:01,775][52667] Sum rewards: 62.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.142', 'AMMO4': '0.145', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.348', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.000'} [2024-08-06 04:40:02,182][52650] Updated weights for policy 0, policy_version 55211 (0.0019) [2024-08-06 04:40:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 452296704. Throughput: 0: 4362.4. Samples: 113072910. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:40:02,794][52567] Avg episode reward: [(0, '70.395')] [2024-08-06 04:40:02,871][52794] DAMAGECOUNT value on done: 555009.0 [2024-08-06 04:40:02,871][52794] Sum rewards: 87.572, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.665', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'weapon4': '0.114', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.519', 'FRAGCOUNT': '71.000'} [2024-08-06 04:40:03,756][52811] DAMAGECOUNT value on done: 511885.0 [2024-08-06 04:40:03,756][52811] Sum rewards: 73.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.226', 'weapon5': '0.252', 'AMMO3': '0.254', 'AMMO4': '0.268', 'weapon2': '0.394', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.852', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:04,075][52666] DAMAGECOUNT value on done: 543520.0 [2024-08-06 04:40:04,077][52666] Sum rewards: 67.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '3.204', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:04,396][52803] DAMAGECOUNT value on done: 507576.0 [2024-08-06 04:40:04,396][52803] Sum rewards: 72.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.467', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.086', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:04,628][52663] DAMAGECOUNT value on done: 551640.0 [2024-08-06 04:40:04,630][52663] Sum rewards: 66.552, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.067', 'weapon5': '0.090', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.950', 'weapon2': '1.164', 'weapon3': '2.608', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '52.000'} [2024-08-06 04:40:04,742][52667] DAMAGECOUNT value on done: 555406.0 [2024-08-06 04:40:04,742][52667] Sum rewards: 69.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.112', 'AMMO4': '0.153', 'weapon5': '0.178', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:05,996][52794] DAMAGECOUNT value on done: 542284.0 [2024-08-06 04:40:05,999][52794] Sum rewards: 75.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.378', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.096', 'weapon5': '0.118', 'AMMO4': '0.165', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:06,059][52670] DAMAGECOUNT value on done: 534278.0 [2024-08-06 04:40:06,060][52670] Sum rewards: 69.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.586', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.214', 'AMMO3': '0.220', 'weapon4': '0.254', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:06,713][52666] DAMAGECOUNT value on done: 546266.0 [2024-08-06 04:40:06,713][52666] Sum rewards: 77.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.464', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:06,783][52811] DAMAGECOUNT value on done: 513236.0 [2024-08-06 04:40:06,785][52811] Sum rewards: 76.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.604', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.082', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.504', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '65.000'} [2024-08-06 04:40:07,140][52650] Updated weights for policy 0, policy_version 55221 (0.0014) [2024-08-06 04:40:07,370][52663] DAMAGECOUNT value on done: 546244.0 [2024-08-06 04:40:07,370][52663] Sum rewards: 75.766, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon2': '0.152', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'HITCOUNT': '3.520', 'weapon3': '3.680', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '66.000'} [2024-08-06 04:40:07,408][52803] DAMAGECOUNT value on done: 499630.0 [2024-08-06 04:40:07,408][52803] Sum rewards: 72.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.928', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.071', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.496', 'WEAPON3': '1.650', 'weapon3': '3.034', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '64.000'} [2024-08-06 04:40:07,625][52667] DAMAGECOUNT value on done: 545577.0 [2024-08-06 04:40:07,626][52667] Sum rewards: 77.075, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.080', 'AMMO3': '0.164', 'AMMO4': '0.216', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.050', 'weapon3': '2.794', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:07,653][52649] DAMAGECOUNT value on done: 527724.0 [2024-08-06 04:40:07,654][52649] Sum rewards: 70.502, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.725', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.112', 'AMMO4': '0.162', 'weapon5': '0.178', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.040', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 452386816. Throughput: 0: 4367.4. Samples: 113099250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:40:07,794][52567] Avg episode reward: [(0, '70.368')] [2024-08-06 04:40:08,543][52670] DAMAGECOUNT value on done: 545062.0 [2024-08-06 04:40:08,545][52670] Sum rewards: 73.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.194', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.264', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.474', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:09,421][52666] DAMAGECOUNT value on done: 547816.0 [2024-08-06 04:40:09,422][52666] Sum rewards: 72.301, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.486', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.114', 'weapon5': '0.248', 'AMMO3': '0.264', 'AMMO4': '0.268', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.998', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '62.000'} [2024-08-06 04:40:09,874][52811] DAMAGECOUNT value on done: 506924.0 [2024-08-06 04:40:09,874][52811] Sum rewards: 69.579, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.136', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.112', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.268', 'AMMO3': '0.294', 'WEAPON3': '1.850', 'weapon3': '3.238', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:10,103][52663] DAMAGECOUNT value on done: 541326.0 [2024-08-06 04:40:10,105][52663] Sum rewards: 76.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.414', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.096', 'AMMO3': '0.170', 'AMMO4': '0.190', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.000', 'weapon3': '3.002', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:10,530][52649] DAMAGECOUNT value on done: 520044.0 [2024-08-06 04:40:10,530][52649] Sum rewards: 70.478, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.148', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'weapon4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:10,545][52803] DAMAGECOUNT value on done: 515609.0 [2024-08-06 04:40:10,547][52803] Sum rewards: 64.930, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.025', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.136', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.342', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '52.000'} [2024-08-06 04:40:10,698][52667] DAMAGECOUNT value on done: 547175.0 [2024-08-06 04:40:10,699][52667] Sum rewards: 76.817, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.008', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.042', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.280', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:11,329][52670] DAMAGECOUNT value on done: 537054.0 [2024-08-06 04:40:11,330][52670] Sum rewards: 68.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.109', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.194', 'weapon5': '0.216', 'AMMO3': '0.219', 'weapon2': '0.260', 'AMMO4': '0.275', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:11,574][52650] Updated weights for policy 0, policy_version 55231 (0.0042) [2024-08-06 04:40:12,143][52666] DAMAGECOUNT value on done: 545321.0 [2024-08-06 04:40:12,144][52666] Sum rewards: 72.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.982', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.144', 'AMMO3': '0.215', 'weapon5': '0.248', 'AMMO4': '0.265', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:12,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 452468736. Throughput: 0: 4364.2. Samples: 113125290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:40:12,795][52567] Avg episode reward: [(0, '70.223')] [2024-08-06 04:40:12,888][52811] DAMAGECOUNT value on done: 506561.0 [2024-08-06 04:40:12,890][52811] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.172', 'AMMO4': '0.178', 'weapon5': '0.190', 'weapon4': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.648', 'WEAPON3': '1.050', 'weapon3': '2.704', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '56.500'} [2024-08-06 04:40:13,027][52663] DAMAGECOUNT value on done: 537266.0 [2024-08-06 04:40:13,029][52663] Sum rewards: 75.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.124', 'AMMO4': '0.148', 'weapon5': '0.180', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '62.000'} [2024-08-06 04:40:13,610][52803] DAMAGECOUNT value on done: 509247.0 [2024-08-06 04:40:13,611][52803] Sum rewards: 81.658, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.112', 'AMMO4': '0.214', 'weapon5': '0.238', 'AMMO3': '0.252', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '68.000'} [2024-08-06 04:40:13,616][52649] DAMAGECOUNT value on done: 537470.0 [2024-08-06 04:40:13,616][52649] Sum rewards: 84.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.231', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.494', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.030', 'FRAGCOUNT': '69.000'} [2024-08-06 04:40:13,633][52667] DAMAGECOUNT value on done: 551789.0 [2024-08-06 04:40:13,633][52667] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.300', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.248', 'weapon2': '0.528', 'WEAPON3': '0.950', 'weapon3': '3.038', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:14,467][52670] DAMAGECOUNT value on done: 536307.0 [2024-08-06 04:40:14,467][52670] Sum rewards: 62.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.851', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.106', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.258', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.394', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:15,434][52666] DAMAGECOUNT value on done: 543735.0 [2024-08-06 04:40:15,434][52666] Sum rewards: 61.200, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.346', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.098', 'weapon5': '0.216', 'AMMO4': '0.222', 'weapon2': '0.278', 'AMMO3': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'HITCOUNT': '3.060', 'weapon3': '3.114', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:15,684][52663] DAMAGECOUNT value on done: 545396.0 [2024-08-06 04:40:15,685][52663] Sum rewards: 80.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.366', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.120', 'AMMO4': '0.194', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '67.000'} [2024-08-06 04:40:16,185][52649] DAMAGECOUNT value on done: 532850.0 [2024-08-06 04:40:16,187][52649] Sum rewards: 79.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.945', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.056', 'AMMO4': '0.115', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.286', 'WEAPON3': '1.750', 'weapon3': '3.282', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '69.000'} [2024-08-06 04:40:16,329][52650] Updated weights for policy 0, policy_version 55241 (0.0019) [2024-08-06 04:40:16,506][52667] DAMAGECOUNT value on done: 554812.0 [2024-08-06 04:40:16,506][52667] Sum rewards: 75.042, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.223', 'HEALTH': '0.284', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.446', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:16,695][52803] DAMAGECOUNT value on done: 504773.0 [2024-08-06 04:40:16,697][52803] Sum rewards: 74.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.122', 'weapon2': '0.180', 'AMMO4': '0.198', 'weapon5': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.218', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:17,551][52670] DAMAGECOUNT value on done: 549144.0 [2024-08-06 04:40:17,552][52670] Sum rewards: 81.683, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.431', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.118', 'weapon4': '0.166', 'AMMO4': '0.179', 'AMMO3': '0.190', 'weapon2': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '65.500'} [2024-08-06 04:40:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 452558848. Throughput: 0: 4363.6. Samples: 113138520. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:40:17,794][52567] Avg episode reward: [(0, '71.095')] [2024-08-06 04:40:18,313][52647] DAMAGECOUNT value on done: 575968.0 [2024-08-06 04:40:18,314][52647] Sum rewards: 72.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.142', 'weapon5': '0.168', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:18,471][52666] DAMAGECOUNT value on done: 538286.0 [2024-08-06 04:40:18,471][52666] Sum rewards: 65.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.756', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.230', 'weapon4': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:18,733][52663] DAMAGECOUNT value on done: 552146.0 [2024-08-06 04:40:18,733][52663] Sum rewards: 62.723, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.485', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.140', 'AMMO4': '0.225', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:18,949][52667] DAMAGECOUNT value on done: 548723.0 [2024-08-06 04:40:18,949][52667] Sum rewards: 78.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.106', 'AMMO4': '0.147', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '63.500'} [2024-08-06 04:40:19,516][52649] DAMAGECOUNT value on done: 523011.0 [2024-08-06 04:40:19,517][52649] Sum rewards: 72.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.082', 'weapon5': '0.186', 'AMMO3': '0.210', 'AMMO4': '0.213', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:19,740][52803] DAMAGECOUNT value on done: 517110.0 [2024-08-06 04:40:19,741][52803] Sum rewards: 74.485, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.612', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '64.000'} [2024-08-06 04:40:20,353][52670] DAMAGECOUNT value on done: 541379.0 [2024-08-06 04:40:20,353][52670] Sum rewards: 61.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.963', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.090', 'AMMO4': '0.183', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.170', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:20,970][52647] DAMAGECOUNT value on done: 575508.0 [2024-08-06 04:40:20,970][52647] Sum rewards: 68.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.166', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:21,124][52666] DAMAGECOUNT value on done: 542157.0 [2024-08-06 04:40:21,124][52666] Sum rewards: 72.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.502', 'AMMO5': '0.007', 'weapon5': '0.022', 'AMMO2': '0.029', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.500'} [2024-08-06 04:40:21,231][52650] Updated weights for policy 0, policy_version 55251 (0.0010) [2024-08-06 04:40:21,243][52663] DAMAGECOUNT value on done: 540007.0 [2024-08-06 04:40:21,245][52663] Sum rewards: 70.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.695', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.398', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '59.500'} [2024-08-06 04:40:21,585][52667] DAMAGECOUNT value on done: 543007.0 [2024-08-06 04:40:21,587][52667] Sum rewards: 80.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.136', 'AMMO4': '0.199', 'weapon4': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '68.000'} [2024-08-06 04:40:22,687][52649] DAMAGECOUNT value on done: 534275.0 [2024-08-06 04:40:22,687][52649] Sum rewards: 77.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.531', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.142', 'weapon5': '0.158', 'AMMO4': '0.168', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:22,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 452648960. Throughput: 0: 4358.7. Samples: 113164710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:40:22,795][52567] Avg episode reward: [(0, '71.125')] [2024-08-06 04:40:22,929][52803] DAMAGECOUNT value on done: 508237.0 [2024-08-06 04:40:22,930][52803] Sum rewards: 88.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.910', 'FRAGCOUNT': '70.000'} [2024-08-06 04:40:23,537][52670] DAMAGECOUNT value on done: 530736.0 [2024-08-06 04:40:23,541][52670] Sum rewards: 73.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.026', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:23,982][52663] DAMAGECOUNT value on done: 537519.0 [2024-08-06 04:40:23,983][52663] Sum rewards: 70.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.090', 'weapon5': '0.178', 'AMMO3': '0.196', 'AMMO4': '0.197', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.242', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:23,990][52647] DAMAGECOUNT value on done: 573766.0 [2024-08-06 04:40:23,991][52647] Sum rewards: 85.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.090', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '70.000'} [2024-08-06 04:40:24,148][52658] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:40:24,184][52667] DAMAGECOUNT value on done: 551489.0 [2024-08-06 04:40:24,185][52667] Sum rewards: 67.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.227', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'AMMO4': '0.152', 'weapon5': '0.168', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'WEAPON3': '1.700', 'HITCOUNT': '3.090', 'weapon3': '3.256', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:24,540][52666] DAMAGECOUNT value on done: 541349.0 [2024-08-06 04:40:24,542][52666] Sum rewards: 68.718, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.682', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.206', 'AMMO4': '0.221', 'AMMO3': '0.233', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:25,155][52649] DAMAGECOUNT value on done: 529911.0 [2024-08-06 04:40:25,157][52649] Sum rewards: 69.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.767', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.188', 'AMMO3': '0.197', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:25,673][52650] Updated weights for policy 0, policy_version 55261 (0.0012) [2024-08-06 04:40:25,995][52803] DAMAGECOUNT value on done: 505804.0 [2024-08-06 04:40:25,997][52803] Sum rewards: 64.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.376', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon2': '0.136', 'AMMO4': '0.172', 'weapon5': '0.184', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '52.000'} [2024-08-06 04:40:26,551][52670] DAMAGECOUNT value on done: 541539.0 [2024-08-06 04:40:26,551][52670] Sum rewards: 68.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.282', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '57.500'} [2024-08-06 04:40:26,833][52647] DAMAGECOUNT value on done: 580641.0 [2024-08-06 04:40:26,833][52647] Sum rewards: 65.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.436', 'WEAPON3': '1.600', 'weapon3': '3.032', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:27,034][52663] DAMAGECOUNT value on done: 538063.0 [2024-08-06 04:40:27,035][52663] Sum rewards: 78.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.925', 'AMMO5': '0.022', 'AMMO2': '0.061', 'AMMO3': '0.193', 'weapon4': '0.202', 'weapon5': '0.236', 'AMMO4': '0.304', 'weapon2': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '64.000'} [2024-08-06 04:40:27,251][52666] DAMAGECOUNT value on done: 542090.0 [2024-08-06 04:40:27,253][52666] Sum rewards: 66.384, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.194', 'AMMO3': '0.199', 'weapon5': '0.314', 'AMMO4': '0.318', 'WEAPON5': '0.550', 'weapon2': '0.564', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.582', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:27,297][52667] DAMAGECOUNT value on done: 553578.0 [2024-08-06 04:40:27,299][52667] Sum rewards: 73.482, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.785', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.150', 'weapon5': '0.204', 'AMMO4': '0.210', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 452730880. Throughput: 0: 4362.7. Samples: 113190790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:40:27,794][52567] Avg episode reward: [(0, '71.399')] [2024-08-06 04:40:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055265_452730880.pth... [2024-08-06 04:40:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000054753_448536576.pth [2024-08-06 04:40:28,315][52649] DAMAGECOUNT value on done: 532351.0 [2024-08-06 04:40:28,317][52649] Sum rewards: 57.732, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO4': '0.219', 'weapon4': '0.260', 'AMMO3': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.186', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '51.000'} [2024-08-06 04:40:29,235][52803] DAMAGECOUNT value on done: 510940.0 [2024-08-06 04:40:29,237][52803] Sum rewards: 76.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.178', 'weapon4': '0.190', 'weapon2': '0.198', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:29,322][52670] DAMAGECOUNT value on done: 536742.0 [2024-08-06 04:40:29,324][52670] Sum rewards: 70.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.420', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.154', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:29,459][52647] DAMAGECOUNT value on done: 582393.0 [2024-08-06 04:40:29,459][52647] Sum rewards: 85.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.358', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '70.000'} [2024-08-06 04:40:29,709][52663] DAMAGECOUNT value on done: 538123.0 [2024-08-06 04:40:29,710][52663] Sum rewards: 61.731, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.658', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.140', 'weapon4': '0.218', 'AMMO3': '0.226', 'AMMO4': '0.269', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '53.000'} [2024-08-06 04:40:30,293][52667] DAMAGECOUNT value on done: 541761.0 [2024-08-06 04:40:30,295][52667] Sum rewards: 72.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.202', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.518', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:30,412][52650] Updated weights for policy 0, policy_version 55271 (0.0031) [2024-08-06 04:40:30,420][52666] DAMAGECOUNT value on done: 536572.0 [2024-08-06 04:40:30,421][52666] Sum rewards: 73.429, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.064', 'HEALTH': '0.198', 'weapon2': '0.202', 'weapon5': '0.214', 'AMMO4': '0.227', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:31,444][52649] DAMAGECOUNT value on done: 535738.0 [2024-08-06 04:40:31,445][52649] Sum rewards: 65.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO2': '0.010', 'AMMO5': '0.015', 'weapon4': '0.040', 'AMMO4': '0.049', 'weapon5': '0.088', 'WEAPON4': '0.100', 'weapon2': '0.196', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.480', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:31,827][52647] DAMAGECOUNT value on done: 580942.0 [2024-08-06 04:40:31,828][52647] Sum rewards: 86.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.416', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.044', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.220', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '69.000'} [2024-08-06 04:40:32,242][52670] DAMAGECOUNT value on done: 535702.0 [2024-08-06 04:40:32,243][52670] Sum rewards: 70.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon5': '0.180', 'AMMO3': '0.195', 'AMMO4': '0.280', 'weapon2': '0.294', 'WEAPON5': '0.450', 'weapon4': '0.540', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '58.500'} [2024-08-06 04:40:32,394][52803] DAMAGECOUNT value on done: 511269.0 [2024-08-06 04:40:32,395][52803] Sum rewards: 68.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.285', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.048', 'weapon5': '0.132', 'AMMO3': '0.198', 'AMMO4': '0.238', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '57.000'} [2024-08-06 04:40:32,557][52663] DAMAGECOUNT value on done: 550696.0 [2024-08-06 04:40:32,559][52663] Sum rewards: 83.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.444', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.084', 'weapon4': '0.126', 'AMMO4': '0.198', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '69.000'} [2024-08-06 04:40:32,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 452812800. Throughput: 0: 4360.2. Samples: 113203670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:40:32,794][52567] Avg episode reward: [(0, '71.421')] [2024-08-06 04:40:32,873][52664] Large shaping reward 2.522 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:40:32,969][52667] DAMAGECOUNT value on done: 545341.0 [2024-08-06 04:40:32,972][52667] Sum rewards: 69.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.146', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.158', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:33,167][52666] DAMAGECOUNT value on done: 541334.0 [2024-08-06 04:40:33,173][52666] Sum rewards: 71.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.660', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.326', 'WEAPON3': '1.000', 'HITCOUNT': '3.220', 'weapon3': '3.374', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:34,596][52649] DAMAGECOUNT value on done: 525621.0 [2024-08-06 04:40:34,598][52649] Sum rewards: 56.075, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.855', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.160', 'WEAPON7': '0.200', 'weapon2': '0.278', 'weapon7': '0.356', 'weapon4': '0.866', 'WEAPON3': '1.100', 'weapon3': '2.214', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '13.569', 'FRAGCOUNT': '46.000'} [2024-08-06 04:40:34,708][52669] DAMAGECOUNT value on done: 549761.0 [2024-08-06 04:40:34,709][52669] Sum rewards: 77.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'weapon4': '0.124', 'AMMO3': '0.236', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '64.000'} [2024-08-06 04:40:34,742][52647] DAMAGECOUNT value on done: 577253.0 [2024-08-06 04:40:34,742][52647] Sum rewards: 69.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.048', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.070', 'weapon4': '0.098', 'AMMO3': '0.178', 'AMMO4': '0.218', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.336', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 04:40:35,281][52663] DAMAGECOUNT value on done: 537393.0 [2024-08-06 04:40:35,285][52663] Sum rewards: 60.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.480', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.086', 'weapon5': '0.144', 'AMMO4': '0.230', 'AMMO3': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.000', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:35,350][52650] Updated weights for policy 0, policy_version 55281 (0.0011) [2024-08-06 04:40:35,402][52670] DAMAGECOUNT value on done: 544567.0 [2024-08-06 04:40:35,403][52670] Sum rewards: 70.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.442', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.042', 'weapon4': '0.058', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.440', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:35,476][52803] DAMAGECOUNT value on done: 513868.0 [2024-08-06 04:40:35,476][52803] Sum rewards: 72.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.259', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.056', 'weapon2': '0.192', 'AMMO3': '0.215', 'weapon5': '0.236', 'AMMO4': '0.279', 'weapon4': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.874', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:35,930][52667] DAMAGECOUNT value on done: 552295.0 [2024-08-06 04:40:35,932][52667] Sum rewards: 61.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.374', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.169', 'AMMO4': '0.210', 'weapon4': '0.232', 'weapon5': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.744', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.006', 'FRAGCOUNT': '48.500'} [2024-08-06 04:40:36,318][52666] DAMAGECOUNT value on done: 536195.0 [2024-08-06 04:40:36,319][52666] Sum rewards: 75.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.064', 'AMMO3': '0.164', 'AMMO4': '0.173', 'weapon4': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '62.000'} [2024-08-06 04:40:37,250][52647] DAMAGECOUNT value on done: 568766.0 [2024-08-06 04:40:37,251][52647] Sum rewards: 70.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.653', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.154', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon5': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.450', 'weapon3': '2.606', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:37,571][52649] DAMAGECOUNT value on done: 535145.0 [2024-08-06 04:40:37,572][52649] Sum rewards: 66.713, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.310', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.156', 'AMMO3': '0.162', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.020', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '53.000'} [2024-08-06 04:40:37,698][52669] DAMAGECOUNT value on done: 539421.0 [2024-08-06 04:40:37,698][52669] Sum rewards: 58.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.119', 'AMMO5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.037', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.304', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '49.000'} [2024-08-06 04:40:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 452902912. Throughput: 0: 4357.8. Samples: 113229750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:40:37,794][52567] Avg episode reward: [(0, '71.658')] [2024-08-06 04:40:38,294][52670] DAMAGECOUNT value on done: 534534.0 [2024-08-06 04:40:38,295][52670] Sum rewards: 57.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.124', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.446', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.282', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '48.500'} [2024-08-06 04:40:38,473][52663] DAMAGECOUNT value on done: 549393.0 [2024-08-06 04:40:38,475][52663] Sum rewards: 66.463, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.344', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.072', 'AMMO4': '0.140', 'AMMO3': '0.146', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.000', 'weapon3': '2.924', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '51.000'} [2024-08-06 04:40:38,751][52803] DAMAGECOUNT value on done: 504815.0 [2024-08-06 04:40:38,752][52803] Sum rewards: 69.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.153', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon7': '0.032', 'AMMO4': '0.082', 'weapon5': '0.096', 'AMMO6': '0.160', 'AMMO7': '0.160', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon4': '0.252', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '2.722', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:39,240][52667] DAMAGECOUNT value on done: 542010.0 [2024-08-06 04:40:39,241][52667] Sum rewards: 59.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.204', 'AMMO3': '0.214', 'AMMO4': '0.219', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.776', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '49.500'} [2024-08-06 04:40:39,313][52666] DAMAGECOUNT value on done: 548465.0 [2024-08-06 04:40:39,315][52666] Sum rewards: 72.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.350', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.126', 'AMMO4': '0.177', 'AMMO3': '0.194', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.300', 'weapon3': '3.386', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:39,839][52650] Updated weights for policy 0, policy_version 55291 (0.0025) [2024-08-06 04:40:39,920][52647] DAMAGECOUNT value on done: 578849.0 [2024-08-06 04:40:39,920][52647] Sum rewards: 78.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '66.000'} [2024-08-06 04:40:40,693][52669] DAMAGECOUNT value on done: 552010.0 [2024-08-06 04:40:40,693][52669] Sum rewards: 58.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.021', 'AMMO2': '0.072', 'AMMO3': '0.208', 'weapon4': '0.236', 'AMMO4': '0.360', 'weapon2': '0.364', 'weapon5': '0.394', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.630', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '48.500'} [2024-08-06 04:40:40,704][52670] DAMAGECOUNT value on done: 539179.0 [2024-08-06 04:40:40,705][52670] Sum rewards: 71.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.050', 'AMMO5': '0.021', 'AMMO2': '0.028', 'weapon4': '0.114', 'AMMO4': '0.138', 'weapon5': '0.204', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.830', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:40,715][52649] DAMAGECOUNT value on done: 541117.0 [2024-08-06 04:40:40,716][52649] Sum rewards: 78.758, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.300', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.132', 'weapon4': '0.156', 'AMMO4': '0.251', 'weapon5': '0.274', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:41,273][52663] DAMAGECOUNT value on done: 549140.0 [2024-08-06 04:40:41,273][52663] Sum rewards: 74.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.702', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.207', 'weapon4': '0.252', 'weapon5': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.604', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:41,803][52666] DAMAGECOUNT value on done: 540658.0 [2024-08-06 04:40:41,805][52666] Sum rewards: 50.517, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.974', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon2': '0.212', 'weapon4': '0.214', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.840', 'weapon3': '3.276', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '45.000'} [2024-08-06 04:40:41,971][52667] DAMAGECOUNT value on done: 553007.0 [2024-08-06 04:40:41,976][52667] Sum rewards: 78.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.024', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.078', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.460', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '64.000'} [2024-08-06 04:40:42,650][52647] DAMAGECOUNT value on done: 574189.0 [2024-08-06 04:40:42,653][52647] Sum rewards: 87.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.801', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.109', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.298', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '71.000'} [2024-08-06 04:40:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 452993024. Throughput: 0: 4369.6. Samples: 113256190. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:40:42,794][52567] Avg episode reward: [(0, '71.766')] [2024-08-06 04:40:43,017][52660] Large shaping reward 2.504 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:40:43,550][52669] DAMAGECOUNT value on done: 549524.0 [2024-08-06 04:40:43,550][52669] Sum rewards: 81.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.355', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '67.000'} [2024-08-06 04:40:43,709][52649] DAMAGECOUNT value on done: 541190.0 [2024-08-06 04:40:43,709][52649] Sum rewards: 72.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.344', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.130', 'weapon4': '0.144', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:43,737][52670] DAMAGECOUNT value on done: 548923.0 [2024-08-06 04:40:43,738][52670] Sum rewards: 69.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon4': '0.106', 'weapon5': '0.110', 'AMMO3': '0.193', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '57.000'} [2024-08-06 04:40:44,448][52663] DAMAGECOUNT value on done: 541756.0 [2024-08-06 04:40:44,449][52663] Sum rewards: 67.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:44,688][52650] Updated weights for policy 0, policy_version 55301 (0.0011) [2024-08-06 04:40:44,712][52666] DAMAGECOUNT value on done: 544216.0 [2024-08-06 04:40:44,712][52666] Sum rewards: 65.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.238', 'weapon4': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:44,880][52667] DAMAGECOUNT value on done: 555537.0 [2024-08-06 04:40:44,880][52667] Sum rewards: 73.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.239', 'AMMO5': '0.024', 'AMMO2': '0.060', 'AMMO3': '0.178', 'weapon5': '0.286', 'AMMO4': '0.302', 'weapon4': '0.330', 'weapon2': '0.412', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '58.500'} [2024-08-06 04:40:45,068][52647] DAMAGECOUNT value on done: 575673.0 [2024-08-06 04:40:45,071][52647] Sum rewards: 74.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.086', 'weapon4': '0.102', 'AMMO4': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:46,360][52669] DAMAGECOUNT value on done: 547311.0 [2024-08-06 04:40:46,361][52669] Sum rewards: 76.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.134', 'AMMO4': '0.137', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.106', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '65.000'} [2024-08-06 04:40:46,702][52670] DAMAGECOUNT value on done: 544228.0 [2024-08-06 04:40:46,702][52670] Sum rewards: 78.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.124', 'weapon2': '0.160', 'weapon4': '0.196', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '66.000'} [2024-08-06 04:40:46,743][52649] DAMAGECOUNT value on done: 539811.0 [2024-08-06 04:40:46,745][52649] Sum rewards: 67.465, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.604', 'ARMOR': '0.008', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.046', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'AMMO4': '0.226', 'weapon5': '0.264', 'WEAPON5': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 04:40:47,422][52647] DAMAGECOUNT value on done: 568790.0 [2024-08-06 04:40:47,422][52647] Sum rewards: 82.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.498', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '68.000'} [2024-08-06 04:40:47,598][52666] DAMAGECOUNT value on done: 540299.0 [2024-08-06 04:40:47,602][52666] Sum rewards: 59.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.188', 'AMMO4': '0.195', 'weapon5': '0.212', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '51.000'} [2024-08-06 04:40:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 453083136. Throughput: 0: 4366.2. Samples: 113269390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:40:47,794][52567] Avg episode reward: [(0, '71.671')] [2024-08-06 04:40:47,962][52667] DAMAGECOUNT value on done: 555967.0 [2024-08-06 04:40:47,964][52667] Sum rewards: 64.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.956', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.084', 'AMMO3': '0.184', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.220', 'DAMAGECOUNT': '14.145', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:48,968][52650] Updated weights for policy 0, policy_version 55311 (0.0021) [2024-08-06 04:40:49,046][52669] DAMAGECOUNT value on done: 551124.0 [2024-08-06 04:40:49,046][52669] Sum rewards: 76.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.966', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon2': '0.164', 'AMMO3': '0.192', 'weapon5': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '62.000'} [2024-08-06 04:40:49,315][52670] DAMAGECOUNT value on done: 526449.0 [2024-08-06 04:40:49,317][52670] Sum rewards: 65.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.320', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.048', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.188', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.506', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '57.000'} [2024-08-06 04:40:49,948][52649] DAMAGECOUNT value on done: 526603.0 [2024-08-06 04:40:49,948][52649] Sum rewards: 78.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.287', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.204', 'weapon4': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '64.000'} [2024-08-06 04:40:49,952][52647] DAMAGECOUNT value on done: 580150.0 [2024-08-06 04:40:49,953][52647] Sum rewards: 79.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.156', 'AMMO4': '0.167', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.626', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '64.000'} [2024-08-06 04:40:50,409][52666] DAMAGECOUNT value on done: 544086.0 [2024-08-06 04:40:50,409][52666] Sum rewards: 68.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.948', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.149', 'weapon4': '0.186', 'weapon5': '0.256', 'AMMO4': '0.283', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:50,917][52667] DAMAGECOUNT value on done: 553523.0 [2024-08-06 04:40:50,917][52667] Sum rewards: 70.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.380', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '56.000'} [2024-08-06 04:40:51,189][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:40:51,696][52669] DAMAGECOUNT value on done: 551000.0 [2024-08-06 04:40:51,701][52669] Sum rewards: 80.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.842', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.154', 'AMMO3': '0.204', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '65.000'} [2024-08-06 04:40:52,354][52670] DAMAGECOUNT value on done: 539996.0 [2024-08-06 04:40:52,355][52670] Sum rewards: 69.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.213', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.128', 'AMMO4': '0.176', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:52,525][52647] DAMAGECOUNT value on done: 572190.0 [2024-08-06 04:40:52,525][52647] Sum rewards: 65.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.143', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.178', 'weapon5': '0.182', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.206', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 453165056. Throughput: 0: 4366.2. Samples: 113295730. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:40:52,795][52567] Avg episode reward: [(0, '71.625')] [2024-08-06 04:40:53,092][52666] DAMAGECOUNT value on done: 545721.0 [2024-08-06 04:40:53,093][52666] Sum rewards: 78.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.539', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.098', 'AMMO3': '0.153', 'weapon5': '0.156', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:53,115][52649] DAMAGECOUNT value on done: 535099.0 [2024-08-06 04:40:53,117][52649] Sum rewards: 60.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.116', 'AMMO3': '0.184', 'weapon5': '0.202', 'AMMO4': '0.270', 'weapon2': '0.394', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.850', 'weapon3': '2.980', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '52.000'} [2024-08-06 04:40:53,818][52667] DAMAGECOUNT value on done: 546371.0 [2024-08-06 04:40:53,818][52667] Sum rewards: 65.015, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO5': '0.024', 'AMMO2': '0.037', 'weapon4': '0.104', 'AMMO3': '0.138', 'weapon5': '0.184', 'AMMO4': '0.186', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.196', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '51.000'} [2024-08-06 04:40:53,959][52650] Updated weights for policy 0, policy_version 55321 (0.0013) [2024-08-06 04:40:54,321][52671] DAMAGECOUNT value on done: 552396.0 [2024-08-06 04:40:54,322][52671] Sum rewards: 73.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.418', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'weapon2': '0.198', 'AMMO3': '0.268', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '63.000'} [2024-08-06 04:40:54,793][52669] DAMAGECOUNT value on done: 548631.0 [2024-08-06 04:40:54,796][52669] Sum rewards: 67.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.665', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon4': '0.144', 'AMMO3': '0.235', 'weapon5': '0.244', 'weapon2': '0.262', 'AMMO4': '0.313', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '57.000'} [2024-08-06 04:40:54,912][52647] DAMAGECOUNT value on done: 579961.0 [2024-08-06 04:40:54,914][52647] Sum rewards: 75.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.298', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '60.000'} [2024-08-06 04:40:54,980][52670] DAMAGECOUNT value on done: 548711.0 [2024-08-06 04:40:54,982][52670] Sum rewards: 73.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.812', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:55,767][52666] DAMAGECOUNT value on done: 530239.0 [2024-08-06 04:40:55,768][52666] Sum rewards: 76.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.509', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.174', 'AMMO4': '0.185', 'AMMO3': '0.189', 'weapon5': '0.248', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '61.000'} [2024-08-06 04:40:56,144][52649] DAMAGECOUNT value on done: 524757.0 [2024-08-06 04:40:56,148][52649] Sum rewards: 65.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.952', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.159', 'weapon4': '0.184', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.500'} [2024-08-06 04:40:56,380][52667] DAMAGECOUNT value on done: 554953.0 [2024-08-06 04:40:56,380][52667] Sum rewards: 61.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.500', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.166', 'weapon4': '0.228', 'AMMO3': '0.232', 'AMMO4': '0.279', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:56,483][52649] Large shaping reward 2.573 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.522, 174.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:40:57,381][52671] DAMAGECOUNT value on done: 552292.0 [2024-08-06 04:40:57,383][52671] Sum rewards: 69.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.186', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.168', 'AMMO3': '0.189', 'weapon2': '0.190', 'AMMO4': '0.224', 'weapon5': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.126', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 04:40:57,512][52647] DAMAGECOUNT value on done: 576928.0 [2024-08-06 04:40:57,512][52647] Sum rewards: 81.964, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.631', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.170', 'weapon2': '0.724', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '65.000'} [2024-08-06 04:40:57,671][52670] DAMAGECOUNT value on done: 537835.0 [2024-08-06 04:40:57,671][52670] Sum rewards: 72.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.472', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.176', 'weapon5': '0.178', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '59.000'} [2024-08-06 04:40:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 453255168. Throughput: 0: 4369.8. Samples: 113321930. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:40:57,794][52567] Avg episode reward: [(0, '71.164')] [2024-08-06 04:40:57,905][52669] DAMAGECOUNT value on done: 557738.0 [2024-08-06 04:40:57,907][52669] Sum rewards: 74.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.124', 'weapon5': '0.134', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '62.000'} [2024-08-06 04:40:58,500][52650] Updated weights for policy 0, policy_version 55331 (0.0013) [2024-08-06 04:40:58,812][52666] DAMAGECOUNT value on done: 539352.0 [2024-08-06 04:40:58,813][52666] Sum rewards: 68.378, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.204', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.160', 'AMMO4': '0.237', 'weapon4': '0.268', 'weapon5': '0.282', 'weapon2': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.890', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '54.000'} [2024-08-06 04:40:59,159][52649] DAMAGECOUNT value on done: 538709.0 [2024-08-06 04:40:59,159][52649] Sum rewards: 73.154, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.465', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.304', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '58.000'} [2024-08-06 04:40:59,376][52664] DAMAGECOUNT value on done: 567030.0 [2024-08-06 04:40:59,378][52664] Sum rewards: 78.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.359', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.114', 'weapon5': '0.208', 'AMMO4': '0.210', 'AMMO3': '0.266', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '67.000'} [2024-08-06 04:41:00,105][52658] DAMAGECOUNT value on done: 547740.0 [2024-08-06 04:41:00,106][52658] Sum rewards: 78.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.912', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.110', 'AMMO4': '0.172', 'weapon5': '0.192', 'AMMO3': '0.217', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:00,335][52670] DAMAGECOUNT value on done: 541820.0 [2024-08-06 04:41:00,336][52670] Sum rewards: 56.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.287', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.128', 'weapon2': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.204', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon4': '0.484', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '13.884', 'FRAGCOUNT': '49.000'} [2024-08-06 04:41:00,418][52669] DAMAGECOUNT value on done: 547835.0 [2024-08-06 04:41:00,418][52669] Sum rewards: 77.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.027', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:00,563][52671] DAMAGECOUNT value on done: 550079.0 [2024-08-06 04:41:00,563][52671] Sum rewards: 58.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.307', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.104', 'AMMO3': '0.167', 'AMMO4': '0.168', 'weapon7': '0.194', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.050', 'weapon3': '2.704', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '49.000'} [2024-08-06 04:41:00,824][52647] DAMAGECOUNT value on done: 564639.0 [2024-08-06 04:41:00,825][52647] Sum rewards: 82.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.872', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon4': '0.084', 'weapon5': '0.152', 'weapon2': '0.180', 'AMMO3': '0.188', 'AMMO4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.366', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '65.000'} [2024-08-06 04:41:02,238][52649] DAMAGECOUNT value on done: 539279.0 [2024-08-06 04:41:02,238][52649] Sum rewards: 74.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.123', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.076', 'weapon4': '0.088', 'AMMO4': '0.184', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.500'} [2024-08-06 04:41:02,424][52664] DAMAGECOUNT value on done: 572958.0 [2024-08-06 04:41:02,425][52664] Sum rewards: 74.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.164', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'weapon4': '0.384', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 453337088. Throughput: 0: 4369.1. Samples: 113335130. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:41:02,794][52567] Avg episode reward: [(0, '71.284')] [2024-08-06 04:41:03,171][52669] DAMAGECOUNT value on done: 552845.0 [2024-08-06 04:41:03,183][52669] Sum rewards: 63.069, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.141', 'AMMO4': '0.216', 'weapon4': '0.232', 'weapon5': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '0.950', 'weapon3': '2.794', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.882', 'FRAGCOUNT': '49.000'} [2024-08-06 04:41:03,215][52671] DAMAGECOUNT value on done: 550892.0 [2024-08-06 04:41:03,217][52671] Sum rewards: 68.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.206', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.132', 'weapon5': '0.138', 'AMMO4': '0.189', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.134', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:03,234][52658] DAMAGECOUNT value on done: 546870.0 [2024-08-06 04:41:03,236][52658] Sum rewards: 65.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.634', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon5': '0.166', 'weapon4': '0.206', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:03,388][52650] Updated weights for policy 0, policy_version 55341 (0.0013) [2024-08-06 04:41:03,480][52647] DAMAGECOUNT value on done: 573119.0 [2024-08-06 04:41:03,481][52647] Sum rewards: 66.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.985', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.191', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '53.000'} [2024-08-06 04:41:05,126][52649] DAMAGECOUNT value on done: 531770.0 [2024-08-06 04:41:05,126][52649] Sum rewards: 60.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.645', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.100', 'AMMO4': '0.140', 'weapon5': '0.142', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '52.000'} [2024-08-06 04:41:05,519][52664] DAMAGECOUNT value on done: 571044.0 [2024-08-06 04:41:05,519][52664] Sum rewards: 73.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.073', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.144', 'AMMO4': '0.151', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:05,762][52669] DAMAGECOUNT value on done: 551763.0 [2024-08-06 04:41:05,764][52669] Sum rewards: 68.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.512', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.108', 'weapon5': '0.122', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:05,959][52658] DAMAGECOUNT value on done: 552410.0 [2024-08-06 04:41:05,959][52658] Sum rewards: 73.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.686', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'weapon4': '0.094', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '62.000'} [2024-08-06 04:41:06,057][52671] DAMAGECOUNT value on done: 561587.0 [2024-08-06 04:41:06,059][52671] Sum rewards: 76.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.872', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.084', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '61.000'} [2024-08-06 04:41:06,645][52647] DAMAGECOUNT value on done: 566426.0 [2024-08-06 04:41:06,645][52647] Sum rewards: 65.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.520', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.178', 'AMMO3': '0.232', 'weapon4': '0.234', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:07,496][52650] Updated weights for policy 0, policy_version 55351 (0.0013) [2024-08-06 04:41:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 453435392. Throughput: 0: 4366.4. Samples: 113361200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:41:07,794][52567] Avg episode reward: [(0, '70.590')] [2024-08-06 04:41:08,293][52669] DAMAGECOUNT value on done: 539395.0 [2024-08-06 04:41:08,293][52669] Sum rewards: 68.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.318', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.034', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.232', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.410', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '58.000'} [2024-08-06 04:41:08,612][52671] DAMAGECOUNT value on done: 550658.0 [2024-08-06 04:41:08,612][52671] Sum rewards: 84.269, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.038', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.101', 'weapon5': '0.136', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.738', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '68.000'} [2024-08-06 04:41:08,778][52795] DAMAGECOUNT value on done: 508328.0 [2024-08-06 04:41:08,779][52795] Sum rewards: 71.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.213', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.486', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:08,868][52658] DAMAGECOUNT value on done: 552017.0 [2024-08-06 04:41:08,869][52658] Sum rewards: 71.901, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.128', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.406', 'weapon4': '0.418', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 04:41:08,921][52664] DAMAGECOUNT value on done: 563197.0 [2024-08-06 04:41:08,921][52664] Sum rewards: 71.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.939', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.144', 'AMMO4': '0.163', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 04:41:10,029][52647] DAMAGECOUNT value on done: 569063.0 [2024-08-06 04:41:10,032][52647] Sum rewards: 75.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.079', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon2': '0.180', 'AMMO4': '0.180', 'weapon5': '0.190', 'AMMO3': '0.242', 'weapon4': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:10,239][52668] DAMAGECOUNT value on done: 547282.0 [2024-08-06 04:41:10,247][52668] Sum rewards: 85.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.200', 'weapon2': '0.210', 'AMMO4': '0.224', 'AMMO3': '0.245', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.889', 'FRAGCOUNT': '72.000'} [2024-08-06 04:41:10,685][52669] Large shaping reward 2.509 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0), ('HEALTH', -0.111, -37.0), ('weapon5', 0.002)] [2024-08-06 04:41:11,040][52669] DAMAGECOUNT value on done: 549678.0 [2024-08-06 04:41:11,040][52669] Sum rewards: 78.070, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.564', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.168', 'AMMO3': '0.189', 'weapon4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '61.000'} [2024-08-06 04:41:11,283][52671] DAMAGECOUNT value on done: 557709.0 [2024-08-06 04:41:11,283][52671] Sum rewards: 77.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.156', 'AMMO3': '0.186', 'AMMO4': '0.236', 'weapon4': '0.320', 'weapon2': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:11,781][52664] DAMAGECOUNT value on done: 568528.0 [2024-08-06 04:41:11,781][52664] Sum rewards: 73.035, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.134', 'weapon5': '0.146', 'AMMO4': '0.216', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:11,803][52658] DAMAGECOUNT value on done: 541845.0 [2024-08-06 04:41:11,804][52658] Sum rewards: 60.704, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.072', 'weapon2': '0.162', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.168', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '49.000'} [2024-08-06 04:41:11,866][52795] DAMAGECOUNT value on done: 497860.0 [2024-08-06 04:41:11,868][52795] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.238', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.146', 'weapon5': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:12,467][52650] Updated weights for policy 0, policy_version 55361 (0.0024) [2024-08-06 04:41:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 453525504. Throughput: 0: 4370.2. Samples: 113387450. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:41:12,794][52567] Avg episode reward: [(0, '71.061')] [2024-08-06 04:41:13,129][52668] DAMAGECOUNT value on done: 549705.0 [2024-08-06 04:41:13,130][52668] Sum rewards: 59.835, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.916', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon2': '0.188', 'weapon5': '0.200', 'AMMO4': '0.219', 'AMMO3': '0.236', 'weapon4': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '50.500'} [2024-08-06 04:41:13,133][52794] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:41:13,975][52669] DAMAGECOUNT value on done: 550428.0 [2024-08-06 04:41:13,976][52669] Sum rewards: 70.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.584', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon4': '0.236', 'weapon2': '0.244', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:14,074][52671] DAMAGECOUNT value on done: 551425.0 [2024-08-06 04:41:14,074][52671] Sum rewards: 78.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.174', 'weapon2': '0.304', 'WEAPON3': '1.050', 'weapon3': '3.512', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '62.000'} [2024-08-06 04:41:14,385][52664] DAMAGECOUNT value on done: 568176.0 [2024-08-06 04:41:14,385][52664] Sum rewards: 65.139, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.794', 'AMMO5': '0.021', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.166', 'weapon4': '0.196', 'weapon2': '0.218', 'AMMO3': '0.305', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.800', 'HITCOUNT': '3.090', 'weapon3': '3.128', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:14,798][52795] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.057, -19.0), ('weapon5', 0.002)] [2024-08-06 04:41:14,992][52795] DAMAGECOUNT value on done: 497370.0 [2024-08-06 04:41:14,993][52795] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.340', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon2': '0.236', 'weapon4': '0.236', 'weapon5': '0.246', 'AMMO3': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '58.000'} [2024-08-06 04:41:15,181][52658] DAMAGECOUNT value on done: 543477.0 [2024-08-06 04:41:15,181][52658] Sum rewards: 69.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:15,902][52668] DAMAGECOUNT value on done: 547778.0 [2024-08-06 04:41:15,903][52668] Sum rewards: 65.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.156', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.000'} [2024-08-06 04:41:16,913][52669] DAMAGECOUNT value on done: 568613.0 [2024-08-06 04:41:16,913][52669] Sum rewards: 74.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.635', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.158', 'weapon2': '0.228', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.378', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:17,250][52671] DAMAGECOUNT value on done: 545129.0 [2024-08-06 04:41:17,251][52671] Sum rewards: 59.152, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.050', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.054', 'weapon4': '0.074', 'AMMO4': '0.146', 'weapon2': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.309', 'WEAPON3': '1.950', 'weapon3': '3.432', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 04:41:17,319][52664] DAMAGECOUNT value on done: 564307.0 [2024-08-06 04:41:17,319][52664] Sum rewards: 58.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.560', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.177', 'weapon4': '0.194', 'weapon5': '0.230', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '48.000'} [2024-08-06 04:41:17,530][52650] Updated weights for policy 0, policy_version 55371 (0.0012) [2024-08-06 04:41:17,758][52658] DAMAGECOUNT value on done: 552151.0 [2024-08-06 04:41:17,760][52658] Sum rewards: 71.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.750', 'AMMO5': '0.015', 'AMMO2': '0.077', 'AMMO3': '0.221', 'weapon4': '0.234', 'weapon5': '0.260', 'weapon2': '0.278', 'AMMO4': '0.387', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:17,795][52567] Fps is (10 sec: 16382.7, 60 sec: 17339.5, 300 sec: 17439.2). Total num frames: 453599232. Throughput: 0: 4378.6. Samples: 113400710. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:41:17,796][52567] Avg episode reward: [(0, '70.539')] [2024-08-06 04:41:18,130][52795] DAMAGECOUNT value on done: 504125.0 [2024-08-06 04:41:18,131][52795] Sum rewards: 66.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.162', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.168', 'weapon2': '0.230', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.340', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:18,549][52662] DAMAGECOUNT value on done: 552518.0 [2024-08-06 04:41:18,552][52662] Sum rewards: 84.699, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.849', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO4': '0.121', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '69.000'} [2024-08-06 04:41:18,699][52668] DAMAGECOUNT value on done: 549241.0 [2024-08-06 04:41:18,700][52668] Sum rewards: 74.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.926', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.232', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '62.500'} [2024-08-06 04:41:19,807][52669] DAMAGECOUNT value on done: 553191.0 [2024-08-06 04:41:19,809][52669] Sum rewards: 71.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.823', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO3': '0.200', 'AMMO4': '0.211', 'weapon4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:20,162][52658] DAMAGECOUNT value on done: 542954.0 [2024-08-06 04:41:20,162][52658] Sum rewards: 51.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.502', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.098', 'weapon5': '0.178', 'AMMO4': '0.203', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.912', 'DAMAGECOUNT': '13.941', 'FRAGCOUNT': '45.000'} [2024-08-06 04:41:20,216][52664] DAMAGECOUNT value on done: 559907.0 [2024-08-06 04:41:20,218][52664] Sum rewards: 61.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.040', 'weapon4': '0.052', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:20,413][52671] DAMAGECOUNT value on done: 552309.0 [2024-08-06 04:41:20,413][52671] Sum rewards: 78.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '66.000'} [2024-08-06 04:41:21,222][52795] DAMAGECOUNT value on done: 499551.0 [2024-08-06 04:41:21,224][52795] Sum rewards: 74.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.850', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.091', 'AMMO3': '0.197', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 04:41:21,479][52668] DAMAGECOUNT value on done: 539893.0 [2024-08-06 04:41:21,479][52668] Sum rewards: 66.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.306', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.148', 'AMMO4': '0.204', 'AMMO3': '0.224', 'weapon2': '0.260', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:21,684][52662] DAMAGECOUNT value on done: 551416.0 [2024-08-06 04:41:21,684][52662] Sum rewards: 72.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.804', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon2': '0.170', 'AMMO4': '0.179', 'weapon5': '0.182', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 04:41:21,705][52650] Updated weights for policy 0, policy_version 55381 (0.0021) [2024-08-06 04:41:22,578][52669] DAMAGECOUNT value on done: 553274.0 [2024-08-06 04:41:22,578][52669] Sum rewards: 82.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.752', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.156', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.224', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '66.000'} [2024-08-06 04:41:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 453689344. Throughput: 0: 4386.9. Samples: 113427160. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:41:22,794][52567] Avg episode reward: [(0, '71.111')] [2024-08-06 04:41:23,140][52658] DAMAGECOUNT value on done: 561155.0 [2024-08-06 04:41:23,142][52658] Sum rewards: 79.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.916', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'weapon2': '0.140', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.370', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.820', 'FRAGCOUNT': '67.000'} [2024-08-06 04:41:23,164][52671] DAMAGECOUNT value on done: 552027.0 [2024-08-06 04:41:23,166][52671] Sum rewards: 58.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.158', 'AMMO3': '0.180', 'weapon5': '0.264', 'AMMO4': '0.305', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '2.986', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '48.000'} [2024-08-06 04:41:23,331][52664] DAMAGECOUNT value on done: 571938.0 [2024-08-06 04:41:23,331][52664] Sum rewards: 69.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.454', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:24,373][52795] DAMAGECOUNT value on done: 508356.0 [2024-08-06 04:41:24,374][52795] Sum rewards: 76.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.644', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.188', 'AMMO4': '0.192', 'AMMO3': '0.202', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '62.000'} [2024-08-06 04:41:24,420][52662] DAMAGECOUNT value on done: 553969.0 [2024-08-06 04:41:24,421][52662] Sum rewards: 72.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.158', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.140', 'weapon4': '0.180', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:24,843][52668] DAMAGECOUNT value on done: 554489.0 [2024-08-06 04:41:24,843][52668] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.048', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.064', 'AMMO4': '0.096', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:25,704][52669] DAMAGECOUNT value on done: 553828.0 [2024-08-06 04:41:25,705][52669] Sum rewards: 78.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '66.000'} [2024-08-06 04:41:25,797][52658] DAMAGECOUNT value on done: 545977.0 [2024-08-06 04:41:25,808][52658] Sum rewards: 66.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.214', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.060', 'AMMO4': '0.112', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:26,192][52671] DAMAGECOUNT value on done: 548920.0 [2024-08-06 04:41:26,192][52671] Sum rewards: 80.697, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.565', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.086', 'AMMO3': '0.171', 'AMMO4': '0.234', 'weapon5': '0.234', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:26,319][52664] DAMAGECOUNT value on done: 565922.0 [2024-08-06 04:41:26,320][52664] Sum rewards: 80.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'AMMO5': '0.028', 'AMMO2': '0.053', 'AMMO3': '0.201', 'weapon4': '0.222', 'weapon2': '0.250', 'AMMO4': '0.263', 'weapon5': '0.290', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '66.000'} [2024-08-06 04:41:26,656][52650] Updated weights for policy 0, policy_version 55391 (0.0031) [2024-08-06 04:41:27,262][52662] DAMAGECOUNT value on done: 541510.0 [2024-08-06 04:41:27,263][52662] Sum rewards: 81.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.049', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.071', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.275', 'WEAPON3': '1.800', 'weapon3': '3.448', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '71.000'} [2024-08-06 04:41:27,474][52795] DAMAGECOUNT value on done: 513234.0 [2024-08-06 04:41:27,474][52795] Sum rewards: 72.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.062', 'AMMO4': '0.160', 'weapon5': '0.196', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:27,786][52668] DAMAGECOUNT value on done: 550809.0 [2024-08-06 04:41:27,788][52668] Sum rewards: 77.892, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.174', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.068', 'weapon5': '0.080', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.374', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '68.000'} [2024-08-06 04:41:27,794][52567] Fps is (10 sec: 18023.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 453779456. Throughput: 0: 4386.4. Samples: 113453580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:41:27,794][52567] Avg episode reward: [(0, '71.374')] [2024-08-06 04:41:28,240][52669] DAMAGECOUNT value on done: 558695.0 [2024-08-06 04:41:28,241][52669] Sum rewards: 86.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.589', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.084', 'weapon5': '0.138', 'AMMO4': '0.242', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '73.000'} [2024-08-06 04:41:28,531][52658] DAMAGECOUNT value on done: 559284.0 [2024-08-06 04:41:28,531][52658] Sum rewards: 78.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.232', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '67.000'} [2024-08-06 04:41:29,190][52664] DAMAGECOUNT value on done: 573247.0 [2024-08-06 04:41:29,191][52664] Sum rewards: 68.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.640', 'AMMO5': '0.007', 'weapon4': '0.048', 'AMMO2': '0.055', 'weapon5': '0.106', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'AMMO4': '0.277', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.236', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:29,200][52671] DAMAGECOUNT value on done: 558879.0 [2024-08-06 04:41:29,200][52671] Sum rewards: 71.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.210', 'AMMO2': '0.018', 'AMMO5': '0.018', 'weapon5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.292', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.388', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '61.000'} [2024-08-06 04:41:30,042][52662] DAMAGECOUNT value on done: 554389.0 [2024-08-06 04:41:30,042][52662] Sum rewards: 79.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.364', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'AMMO3': '0.227', 'weapon4': '0.284', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 04:41:30,759][52668] DAMAGECOUNT value on done: 542293.0 [2024-08-06 04:41:30,760][52668] Sum rewards: 69.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.405', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.118', 'weapon5': '0.172', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:30,882][52795] DAMAGECOUNT value on done: 508582.0 [2024-08-06 04:41:30,883][52795] Sum rewards: 70.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.698', 'AMMO5': '0.022', 'AMMO2': '0.058', 'AMMO3': '0.199', 'weapon4': '0.232', 'weapon5': '0.246', 'AMMO4': '0.291', 'weapon2': '0.462', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '58.000'} [2024-08-06 04:41:31,320][52650] Updated weights for policy 0, policy_version 55401 (0.0012) [2024-08-06 04:41:31,370][52658] DAMAGECOUNT value on done: 544026.0 [2024-08-06 04:41:31,371][52658] Sum rewards: 81.123, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.914', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '65.000'} [2024-08-06 04:41:31,816][52664] DAMAGECOUNT value on done: 572680.0 [2024-08-06 04:41:31,817][52664] Sum rewards: 79.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.000', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon4': '0.230', 'weapon2': '0.508', 'WEAPON3': '0.950', 'weapon3': '3.092', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:32,180][52671] DAMAGECOUNT value on done: 552007.0 [2024-08-06 04:41:32,181][52671] Sum rewards: 66.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.087', 'AMMO5': '0.005', 'AMMO2': '0.048', 'weapon5': '0.100', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '55.000'} [2024-08-06 04:41:32,647][52662] DAMAGECOUNT value on done: 543788.0 [2024-08-06 04:41:32,649][52662] Sum rewards: 61.366, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.166', 'AMMO3': '0.171', 'AMMO4': '0.224', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '3.234', 'DAMAGECOUNT': '13.686', 'FRAGCOUNT': '50.000'} [2024-08-06 04:41:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 453869568. Throughput: 0: 4384.0. Samples: 113466670. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:41:32,794][52567] Avg episode reward: [(0, '71.714')] [2024-08-06 04:41:33,715][52668] DAMAGECOUNT value on done: 545717.0 [2024-08-06 04:41:33,716][52668] Sum rewards: 86.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '71.000'} [2024-08-06 04:41:34,127][52795] DAMAGECOUNT value on done: 500547.0 [2024-08-06 04:41:34,129][52795] Sum rewards: 80.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.192', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'weapon4': '0.078', 'AMMO3': '0.202', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.406', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '66.000'} [2024-08-06 04:41:34,156][52664] DAMAGECOUNT value on done: 577351.0 [2024-08-06 04:41:34,156][52664] Sum rewards: 62.336, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.008', 'AMMO2': '0.045', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.140', 'AMMO3': '0.154', 'weapon5': '0.190', 'WEAPON7': '0.200', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon7': '0.410', 'weapon4': '0.538', 'WEAPON3': '0.900', 'weapon3': '2.356', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '50.000'} [2024-08-06 04:41:34,465][52658] DAMAGECOUNT value on done: 549492.0 [2024-08-06 04:41:34,466][52658] Sum rewards: 71.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.394', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.061', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:34,716][52671] DAMAGECOUNT value on done: 538108.0 [2024-08-06 04:41:34,717][52671] Sum rewards: 76.180, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.414', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.138', 'weapon4': '0.150', 'AMMO4': '0.240', 'AMMO3': '0.296', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.092', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '65.000'} [2024-08-06 04:41:35,936][52662] DAMAGECOUNT value on done: 553840.0 [2024-08-06 04:41:35,937][52662] Sum rewards: 78.363, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.092', 'weapon5': '0.156', 'AMMO3': '0.230', 'weapon2': '0.252', 'AMMO4': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '66.000'} [2024-08-06 04:41:35,952][52650] Updated weights for policy 0, policy_version 55411 (0.0021) [2024-08-06 04:41:36,842][52668] DAMAGECOUNT value on done: 552909.0 [2024-08-06 04:41:36,842][52668] Sum rewards: 74.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.614', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:37,028][52664] DAMAGECOUNT value on done: 574297.0 [2024-08-06 04:41:37,030][52664] Sum rewards: 82.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.134', 'AMMO4': '0.168', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '67.000'} [2024-08-06 04:41:37,280][52795] DAMAGECOUNT value on done: 510755.0 [2024-08-06 04:41:37,282][52795] Sum rewards: 60.331, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.355', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.100', 'weapon5': '0.124', 'AMMO4': '0.185', 'weapon2': '0.252', 'AMMO3': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.174', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '54.000'} [2024-08-06 04:41:37,480][52671] DAMAGECOUNT value on done: 558622.0 [2024-08-06 04:41:37,481][52671] Sum rewards: 66.046, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.110', 'weapon5': '0.114', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '55.000'} [2024-08-06 04:41:37,491][52658] DAMAGECOUNT value on done: 545595.0 [2024-08-06 04:41:37,492][52658] Sum rewards: 56.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.398', 'AMMO5': '0.016', 'AMMO2': '0.068', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO3': '0.203', 'weapon2': '0.316', 'AMMO4': '0.341', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.660', 'weapon3': '3.198', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '49.000'} [2024-08-06 04:41:37,533][52820] DAMAGECOUNT value on done: 504088.0 [2024-08-06 04:41:37,535][52820] Sum rewards: 67.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.434', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.106', 'weapon5': '0.190', 'AMMO4': '0.195', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 453959680. Throughput: 0: 4387.1. Samples: 113493150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:41:37,794][52567] Avg episode reward: [(0, '71.792')] [2024-08-06 04:41:38,485][52660] DAMAGECOUNT value on done: 550515.0 [2024-08-06 04:41:38,486][52660] Sum rewards: 77.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.223', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.202', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:38,609][52662] DAMAGECOUNT value on done: 555631.0 [2024-08-06 04:41:38,610][52662] Sum rewards: 71.261, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.618', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.170', 'weapon4': '0.244', 'weapon2': '0.278', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.070', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '62.000'} [2024-08-06 04:41:39,594][52668] DAMAGECOUNT value on done: 549497.0 [2024-08-06 04:41:39,595][52668] Sum rewards: 78.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.962', 'AMMO2': '0.001', 'AMMO4': '0.007', 'weapon2': '0.240', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'weapon3': '3.578', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '68.000'} [2024-08-06 04:41:39,675][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:41:40,026][52671] DAMAGECOUNT value on done: 555983.0 [2024-08-06 04:41:40,026][52671] Sum rewards: 79.336, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.494', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.134', 'weapon5': '0.250', 'AMMO4': '0.265', 'AMMO3': '0.270', 'weapon2': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.938', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '68.000'} [2024-08-06 04:41:40,135][52664] DAMAGECOUNT value on done: 575077.0 [2024-08-06 04:41:40,135][52664] Sum rewards: 60.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.796', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.123', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.274', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '52.000'} [2024-08-06 04:41:40,258][52658] DAMAGECOUNT value on done: 550091.0 [2024-08-06 04:41:40,258][52658] Sum rewards: 84.866, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.128', 'weapon4': '0.184', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.456', 'FRAGCOUNT': '71.000'} [2024-08-06 04:41:40,374][52650] Updated weights for policy 0, policy_version 55421 (0.0011) [2024-08-06 04:41:40,410][52795] DAMAGECOUNT value on done: 507928.0 [2024-08-06 04:41:40,410][52795] Sum rewards: 74.471, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.016', 'AMMO2': '0.033', 'HEALTH': '0.145', 'AMMO4': '0.165', 'AMMO3': '0.186', 'weapon4': '0.194', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:40,810][52820] DAMAGECOUNT value on done: 506961.0 [2024-08-06 04:41:40,811][52820] Sum rewards: 71.364, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.595', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.062', 'AMMO4': '0.075', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:41,039][52660] DAMAGECOUNT value on done: 538817.0 [2024-08-06 04:41:41,040][52660] Sum rewards: 79.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.797', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.076', 'AMMO4': '0.116', 'AMMO3': '0.186', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:41,611][52662] DAMAGECOUNT value on done: 548529.0 [2024-08-06 04:41:41,611][52662] Sum rewards: 63.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.266', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.136', 'AMMO4': '0.194', 'AMMO3': '0.214', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2024-08-06 04:41:42,153][52668] DAMAGECOUNT value on done: 541004.0 [2024-08-06 04:41:42,162][52668] Sum rewards: 61.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.366', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.102', 'AMMO4': '0.139', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '50.000'} [2024-08-06 04:41:42,804][52567] Fps is (10 sec: 17186.1, 60 sec: 17473.4, 300 sec: 17494.2). Total num frames: 454041600. Throughput: 0: 4384.4. Samples: 113519270. Policy #0 lag: (min: 1.0, avg: 3.5, max: 9.0) [2024-08-06 04:41:42,804][52567] Avg episode reward: [(0, '71.965')] [2024-08-06 04:41:42,904][52664] DAMAGECOUNT value on done: 567983.0 [2024-08-06 04:41:42,904][52664] Sum rewards: 77.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.755', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO4': '0.068', 'AMMO3': '0.208', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:42,951][52671] DAMAGECOUNT value on done: 556265.0 [2024-08-06 04:41:42,951][52671] Sum rewards: 72.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.310', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.064', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.726', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '60.500'} [2024-08-06 04:41:43,394][52658] DAMAGECOUNT value on done: 538299.0 [2024-08-06 04:41:43,397][52658] Sum rewards: 69.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.090', 'AMMO3': '0.208', 'AMMO4': '0.258', 'weapon5': '0.298', 'WEAPON4': '0.450', 'weapon2': '0.480', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:43,584][52795] DAMAGECOUNT value on done: 501592.0 [2024-08-06 04:41:43,585][52795] Sum rewards: 71.027, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.864', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.224', 'WEAPON3': '1.100', 'HITCOUNT': '3.340', 'weapon3': '3.562', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:43,585][52660] DAMAGECOUNT value on done: 551302.0 [2024-08-06 04:41:43,588][52660] Sum rewards: 74.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.098', 'AMMO4': '0.225', 'AMMO3': '0.241', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.714', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:43,843][52820] DAMAGECOUNT value on done: 510650.0 [2024-08-06 04:41:43,846][52820] Sum rewards: 61.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.063', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.036', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.226', 'weapon2': '0.270', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.398', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '51.000'} [2024-08-06 04:41:44,352][52662] DAMAGECOUNT value on done: 558361.0 [2024-08-06 04:41:44,354][52662] Sum rewards: 75.831, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.144', 'weapon5': '0.150', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.442', 'HEALTH': '0.463', 'WEAPON3': '0.850', 'weapon3': '3.036', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:44,670][52668] DAMAGECOUNT value on done: 534602.0 [2024-08-06 04:41:44,671][52668] Sum rewards: 70.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.038', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.072', 'weapon5': '0.182', 'AMMO4': '0.234', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '58.000'} [2024-08-06 04:41:44,967][52650] Updated weights for policy 0, policy_version 55431 (0.0018) [2024-08-06 04:41:45,075][52665] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0)] [2024-08-06 04:41:45,563][52671] DAMAGECOUNT value on done: 552279.0 [2024-08-06 04:41:45,566][52671] Sum rewards: 79.543, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.366', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.080', 'weapon4': '0.086', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.352', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '69.000'} [2024-08-06 04:41:46,130][52660] DAMAGECOUNT value on done: 556538.0 [2024-08-06 04:41:46,131][52660] Sum rewards: 76.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.204', 'AMMO4': '0.237', 'weapon4': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '64.500'} [2024-08-06 04:41:46,207][52664] DAMAGECOUNT value on done: 562979.0 [2024-08-06 04:41:46,208][52664] Sum rewards: 74.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.190', 'weapon2': '0.202', 'AMMO3': '0.220', 'AMMO4': '0.228', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 04:41:46,347][52658] DAMAGECOUNT value on done: 554435.0 [2024-08-06 04:41:46,349][52658] Sum rewards: 71.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.868', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.216', 'weapon7': '0.226', 'AMMO3': '0.248', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.848', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '61.000'} [2024-08-06 04:41:46,711][52795] DAMAGECOUNT value on done: 500733.0 [2024-08-06 04:41:46,713][52795] Sum rewards: 79.290, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.505', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.176', 'weapon2': '0.222', 'WEAPON3': '1.050', 'HITCOUNT': '3.510', 'weapon3': '3.642', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:47,000][52662] DAMAGECOUNT value on done: 544700.0 [2024-08-06 04:41:47,003][52662] Sum rewards: 66.483, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.098', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.114', 'weapon2': '0.208', 'AMMO3': '0.221', 'weapon5': '0.242', 'AMMO4': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.174', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '55.000'} [2024-08-06 04:41:47,111][52820] DAMAGECOUNT value on done: 500660.0 [2024-08-06 04:41:47,113][52820] Sum rewards: 68.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.469', 'AMMO5': '0.008', 'AMMO2': '0.052', 'weapon5': '0.140', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'AMMO4': '0.260', 'weapon4': '0.308', 'weapon2': '0.374', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.888', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:47,311][52668] DAMAGECOUNT value on done: 537372.0 [2024-08-06 04:41:47,319][52668] Sum rewards: 70.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.378', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon2': '0.214', 'AMMO3': '0.285', 'AMMO4': '0.285', 'weapon4': '0.292', 'weapon5': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.842', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 454131712. Throughput: 0: 4387.8. Samples: 113532580. Policy #0 lag: (min: 1.0, avg: 3.5, max: 9.0) [2024-08-06 04:41:47,794][52567] Avg episode reward: [(0, '72.353')] [2024-08-06 04:41:48,337][52671] DAMAGECOUNT value on done: 549408.0 [2024-08-06 04:41:48,338][52671] Sum rewards: 78.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.375', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.124', 'AMMO4': '0.219', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '67.000'} [2024-08-06 04:41:49,127][52660] DAMAGECOUNT value on done: 546961.0 [2024-08-06 04:41:49,128][52660] Sum rewards: 82.020, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.495', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.054', 'weapon5': '0.082', 'AMMO4': '0.093', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.556', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '64.500'} [2024-08-06 04:41:49,302][52658] DAMAGECOUNT value on done: 545620.0 [2024-08-06 04:41:49,302][52658] Sum rewards: 82.835, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.354', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon2': '0.244', 'AMMO3': '0.299', 'WEAPON3': '1.900', 'weapon3': '3.494', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '72.000'} [2024-08-06 04:41:49,339][52664] DAMAGECOUNT value on done: 570073.0 [2024-08-06 04:41:49,339][52664] Sum rewards: 80.887, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.124', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.052', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.420', 'WEAPON3': '0.900', 'weapon3': '3.334', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:49,620][52650] Updated weights for policy 0, policy_version 55441 (0.0019) [2024-08-06 04:41:49,801][52795] DAMAGECOUNT value on done: 508283.0 [2024-08-06 04:41:49,802][52795] Sum rewards: 75.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.174', 'weapon5': '0.194', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 04:41:49,813][52662] DAMAGECOUNT value on done: 550244.0 [2024-08-06 04:41:49,814][52662] Sum rewards: 57.010, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.136', 'HEALTH': '0.148', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.100', 'HITCOUNT': '2.650', 'weapon3': '3.070', 'DAMAGECOUNT': '14.061', 'FRAGCOUNT': '48.000'} [2024-08-06 04:41:50,164][52820] DAMAGECOUNT value on done: 511519.0 [2024-08-06 04:41:50,165][52820] Sum rewards: 72.996, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.970', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.116', 'weapon5': '0.116', 'AMMO4': '0.174', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.226', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:50,406][52668] DAMAGECOUNT value on done: 538921.0 [2024-08-06 04:41:50,406][52668] Sum rewards: 68.221, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.112', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.354', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.250', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:52,106][52660] DAMAGECOUNT value on done: 544238.0 [2024-08-06 04:41:52,106][52660] Sum rewards: 69.669, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon2': '0.158', 'AMMO3': '0.183', 'AMMO4': '0.220', 'weapon5': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.232', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:52,273][52664] DAMAGECOUNT value on done: 568917.0 [2024-08-06 04:41:52,274][52664] Sum rewards: 81.847, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.053', 'weapon5': '0.092', 'weapon4': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.265', 'weapon2': '0.290', 'AMMO3': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.190', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '72.000'} [2024-08-06 04:41:52,460][52658] DAMAGECOUNT value on done: 546854.0 [2024-08-06 04:41:52,462][52658] Sum rewards: 64.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.274', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.112', 'AMMO4': '0.155', 'AMMO3': '0.166', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.840', 'WEAPON3': '1.000', 'weapon3': '2.536', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '53.000'} [2024-08-06 04:41:52,686][52662] DAMAGECOUNT value on done: 545755.0 [2024-08-06 04:41:52,687][52662] Sum rewards: 72.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.539', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.149', 'weapon5': '0.172', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.168', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '59.000'} [2024-08-06 04:41:52,794][52567] Fps is (10 sec: 18040.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 454221824. Throughput: 0: 4397.1. Samples: 113559070. Policy #0 lag: (min: 1.0, avg: 3.5, max: 9.0) [2024-08-06 04:41:52,794][52567] Avg episode reward: [(0, '72.209')] [2024-08-06 04:41:52,973][52795] DAMAGECOUNT value on done: 499851.0 [2024-08-06 04:41:52,975][52795] Sum rewards: 66.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.526', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon2': '0.174', 'AMMO4': '0.176', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.352', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:53,220][52820] DAMAGECOUNT value on done: 502365.0 [2024-08-06 04:41:53,221][52820] Sum rewards: 76.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.843', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 04:41:53,436][52668] DAMAGECOUNT value on done: 548195.0 [2024-08-06 04:41:53,437][52668] Sum rewards: 69.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.842', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO3': '0.228', 'AMMO4': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.686', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '57.000'} [2024-08-06 04:41:54,196][52665] DAMAGECOUNT value on done: 534888.0 [2024-08-06 04:41:54,197][52665] Sum rewards: 67.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.215', 'weapon5': '0.252', 'AMMO4': '0.257', 'weapon2': '0.322', 'WEAPON5': '0.500', 'weapon4': '0.506', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.556', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '58.000'} [2024-08-06 04:41:54,566][52650] Updated weights for policy 0, policy_version 55451 (0.0015) [2024-08-06 04:41:55,112][52662] DAMAGECOUNT value on done: 555152.0 [2024-08-06 04:41:55,112][52662] Sum rewards: 76.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.136', 'AMMO3': '0.189', 'AMMO4': '0.223', 'weapon5': '0.248', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:55,305][52660] DAMAGECOUNT value on done: 542253.0 [2024-08-06 04:41:55,306][52660] Sum rewards: 74.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.675', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.122', 'weapon5': '0.150', 'AMMO4': '0.217', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '64.000'} [2024-08-06 04:41:55,432][52658] DAMAGECOUNT value on done: 552868.0 [2024-08-06 04:41:55,433][52658] Sum rewards: 65.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.935', 'AMMO5': '0.016', 'AMMO2': '0.069', 'weapon4': '0.086', 'weapon5': '0.170', 'AMMO3': '0.204', 'AMMO4': '0.346', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.110', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '55.000'} [2024-08-06 04:41:55,509][52664] DAMAGECOUNT value on done: 566129.0 [2024-08-06 04:41:55,516][52664] Sum rewards: 76.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.065', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '65.000'} [2024-08-06 04:41:56,218][52795] DAMAGECOUNT value on done: 515228.0 [2024-08-06 04:41:56,218][52795] Sum rewards: 74.211, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.678', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.144', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '66.000'} [2024-08-06 04:41:56,370][52820] DAMAGECOUNT value on done: 507339.0 [2024-08-06 04:41:56,372][52820] Sum rewards: 69.396, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.296', 'AMMO5': '0.010', 'ARMOR': '0.032', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.164', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.650', 'weapon3': '3.016', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '60.000'} [2024-08-06 04:41:56,551][52668] DAMAGECOUNT value on done: 549581.0 [2024-08-06 04:41:56,551][52668] Sum rewards: 69.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.698', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '56.000'} [2024-08-06 04:41:56,784][52665] DAMAGECOUNT value on done: 551273.0 [2024-08-06 04:41:56,785][52665] Sum rewards: 81.604, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.048', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.518', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '65.000'} [2024-08-06 04:41:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 454311936. Throughput: 0: 4394.0. Samples: 113585180. Policy #0 lag: (min: 1.0, avg: 3.5, max: 9.0) [2024-08-06 04:41:57,794][52567] Avg episode reward: [(0, '72.739')] [2024-08-06 04:41:58,134][52660] DAMAGECOUNT value on done: 553210.0 [2024-08-06 04:41:58,134][52660] Sum rewards: 61.364, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.594', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.102', 'weapon4': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.255', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.192', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '55.000'} [2024-08-06 04:41:58,215][52662] DAMAGECOUNT value on done: 548764.0 [2024-08-06 04:41:58,218][52662] Sum rewards: 62.640, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.804', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.144', 'weapon2': '0.170', 'AMMO4': '0.184', 'weapon5': '0.252', 'AMMO3': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.102', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 04:41:58,995][52668] DAMAGECOUNT value on done: 549419.0 [2024-08-06 04:41:58,997][52668] Sum rewards: 85.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.600', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.243', 'WEAPON3': '1.600', 'weapon3': '3.464', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '73.000'} [2024-08-06 04:41:59,317][52650] Updated weights for policy 0, policy_version 55461 (0.0012) [2024-08-06 04:41:59,363][52795] DAMAGECOUNT value on done: 507786.0 [2024-08-06 04:41:59,366][52795] Sum rewards: 54.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.425', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.152', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.146', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '47.000'} [2024-08-06 04:41:59,520][52665] DAMAGECOUNT value on done: 545744.0 [2024-08-06 04:41:59,523][52665] Sum rewards: 91.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.402', 'FRAGCOUNT': '75.000'} [2024-08-06 04:41:59,602][52820] DAMAGECOUNT value on done: 509330.0 [2024-08-06 04:41:59,602][52820] Sum rewards: 57.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.546', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.112', 'weapon4': '0.136', 'AMMO3': '0.214', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.086', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '49.000'} [2024-08-06 04:42:00,587][52660] DAMAGECOUNT value on done: 546720.0 [2024-08-06 04:42:00,587][52660] Sum rewards: 70.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.725', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '58.000'} [2024-08-06 04:42:01,014][52662] DAMAGECOUNT value on done: 558502.0 [2024-08-06 04:42:01,014][52662] Sum rewards: 75.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.794', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.069', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.216', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '64.000'} [2024-08-06 04:42:02,087][52668] DAMAGECOUNT value on done: 551556.0 [2024-08-06 04:42:02,088][52668] Sum rewards: 71.252, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.150', 'weapon5': '0.180', 'weapon4': '0.184', 'HEALTH': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '58.000'} [2024-08-06 04:42:02,514][52795] DAMAGECOUNT value on done: 500765.0 [2024-08-06 04:42:02,515][52795] Sum rewards: 83.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.164', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.144', 'AMMO4': '0.150', 'weapon2': '0.182', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.369', 'FRAGCOUNT': '69.000'} [2024-08-06 04:42:02,728][52665] DAMAGECOUNT value on done: 541062.0 [2024-08-06 04:42:02,728][52665] Sum rewards: 74.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.132', 'weapon4': '0.184', 'AMMO3': '0.220', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '62.000'} [2024-08-06 04:42:02,752][52820] DAMAGECOUNT value on done: 505745.0 [2024-08-06 04:42:02,753][52820] Sum rewards: 62.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.434', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.122', 'weapon4': '0.162', 'AMMO3': '0.216', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '54.000'} [2024-08-06 04:42:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 454393856. Throughput: 0: 4393.0. Samples: 113598390. Policy #0 lag: (min: 1.0, avg: 3.5, max: 9.0) [2024-08-06 04:42:02,794][52567] Avg episode reward: [(0, '73.027')] [2024-08-06 04:42:03,067][52671] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:42:03,421][52660] DAMAGECOUNT value on done: 546465.0 [2024-08-06 04:42:03,421][52660] Sum rewards: 83.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'weapon5': '0.012', 'AMMO2': '0.017', 'AMMO5': '0.020', 'weapon4': '0.032', 'AMMO4': '0.083', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '71.000'} [2024-08-06 04:42:03,450][52662] DAMAGECOUNT value on done: 552877.0 [2024-08-06 04:42:03,450][52662] Sum rewards: 70.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.296', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.084', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '58.000'} [2024-08-06 04:42:03,819][52650] Updated weights for policy 0, policy_version 55471 (0.0014) [2024-08-06 04:42:04,972][52668] DAMAGECOUNT value on done: 549873.0 [2024-08-06 04:42:04,973][52668] Sum rewards: 71.204, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.252', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO3': '0.140', 'weapon2': '0.732', 'WEAPON3': '0.950', 'weapon3': '3.180', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 04:42:05,662][52795] DAMAGECOUNT value on done: 506997.0 [2024-08-06 04:42:05,664][52795] Sum rewards: 68.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.026', 'weapon4': '0.048', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '57.000'} [2024-08-06 04:42:05,705][52820] DAMAGECOUNT value on done: 515267.0 [2024-08-06 04:42:05,708][52820] Sum rewards: 83.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon4': '0.214', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '68.000'} [2024-08-06 04:42:05,765][52665] DAMAGECOUNT value on done: 533394.0 [2024-08-06 04:42:05,766][52665] Sum rewards: 68.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon4': '0.338', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '56.000'} [2024-08-06 04:42:06,193][52662] DAMAGECOUNT value on done: 544882.0 [2024-08-06 04:42:06,195][52662] Sum rewards: 76.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.970', 'AMMO2': '0.015', 'weapon4': '0.062', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.304', 'weapon2': '0.438', 'WEAPON3': '1.850', 'weapon3': '3.262', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '67.000'} [2024-08-06 04:42:06,735][52660] DAMAGECOUNT value on done: 555171.0 [2024-08-06 04:42:06,736][52660] Sum rewards: 75.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.878', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.097', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 454483968. Throughput: 0: 4384.7. Samples: 113624470. Policy #0 lag: (min: 1.0, avg: 3.5, max: 9.0) [2024-08-06 04:42:07,794][52567] Avg episode reward: [(0, '72.994')] [2024-08-06 04:42:08,765][52820] DAMAGECOUNT value on done: 503400.0 [2024-08-06 04:42:08,766][52820] Sum rewards: 86.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.765', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.076', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.220', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '72.000'} [2024-08-06 04:42:08,779][52662] DAMAGECOUNT value on done: 549958.0 [2024-08-06 04:42:08,781][52662] Sum rewards: 68.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.294', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.221', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '57.000'} [2024-08-06 04:42:08,789][52795] DAMAGECOUNT value on done: 512564.0 [2024-08-06 04:42:08,789][52795] Sum rewards: 83.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.048', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.144', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.310', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '68.000'} [2024-08-06 04:42:08,869][52650] Updated weights for policy 0, policy_version 55481 (0.0015) [2024-08-06 04:42:08,870][52665] DAMAGECOUNT value on done: 539491.0 [2024-08-06 04:42:08,871][52665] Sum rewards: 70.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.276', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.204', 'weapon2': '0.216', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '58.000'} [2024-08-06 04:42:09,257][52660] DAMAGECOUNT value on done: 542165.0 [2024-08-06 04:42:09,260][52660] Sum rewards: 89.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon2': '0.186', 'AMMO3': '0.251', 'WEAPON3': '1.600', 'weapon3': '3.646', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.516', 'FRAGCOUNT': '75.000'} [2024-08-06 04:42:11,931][52665] DAMAGECOUNT value on done: 543489.0 [2024-08-06 04:42:11,934][52662] DAMAGECOUNT value on done: 543661.0 [2024-08-06 04:42:11,932][52665] Sum rewards: 61.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.566', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon5': '0.202', 'AMMO3': '0.235', 'AMMO4': '0.240', 'weapon2': '0.328', 'weapon4': '0.346', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '52.000'} [2024-08-06 04:42:11,937][52662] Sum rewards: 60.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.172', 'weapon5': '0.214', 'AMMO4': '0.225', 'AMMO3': '0.245', 'weapon2': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.002', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '53.000'} [2024-08-06 04:42:11,981][52820] DAMAGECOUNT value on done: 509308.0 [2024-08-06 04:42:11,983][52820] Sum rewards: 70.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.324', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.082', 'weapon5': '0.142', 'AMMO3': '0.192', 'AMMO4': '0.321', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.500'} [2024-08-06 04:42:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 454574080. Throughput: 0: 4374.7. Samples: 113650440. Policy #0 lag: (min: 1.0, avg: 3.5, max: 9.0) [2024-08-06 04:42:12,794][52567] Avg episode reward: [(0, '72.642')] [2024-08-06 04:42:12,948][52659] DAMAGECOUNT value on done: 554648.0 [2024-08-06 04:42:12,957][52659] Sum rewards: 72.479, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.305', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.088', 'AMMO4': '0.128', 'weapon5': '0.172', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '59.000'} [2024-08-06 04:42:13,023][52660] DAMAGECOUNT value on done: 545313.0 [2024-08-06 04:42:13,023][52660] Sum rewards: 72.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.724', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:13,318][52650] Updated weights for policy 0, policy_version 55491 (0.0011) [2024-08-06 04:42:15,184][52820] DAMAGECOUNT value on done: 517106.0 [2024-08-06 04:42:15,188][52820] Sum rewards: 84.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.871', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.108', 'AMMO3': '0.240', 'weapon5': '0.240', 'weapon2': '0.244', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '71.000'} [2024-08-06 04:42:15,321][52665] DAMAGECOUNT value on done: 542419.0 [2024-08-06 04:42:15,323][52665] Sum rewards: 59.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.152', 'weapon2': '0.198', 'AMMO3': '0.220', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.438', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '50.000'} [2024-08-06 04:42:15,457][52659] DAMAGECOUNT value on done: 548616.0 [2024-08-06 04:42:15,457][52659] Sum rewards: 63.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.156', 'weapon4': '0.188', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.210', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '52.000'} [2024-08-06 04:42:15,776][52660] DAMAGECOUNT value on done: 555969.0 [2024-08-06 04:42:15,778][52660] Sum rewards: 66.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.182', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '56.000'} [2024-08-06 04:42:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17613.0, 300 sec: 17494.8). Total num frames: 454656000. Throughput: 0: 4371.5. Samples: 113663390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:42:17,795][52567] Avg episode reward: [(0, '72.445')] [2024-08-06 04:42:18,164][52650] Updated weights for policy 0, policy_version 55501 (0.0019) [2024-08-06 04:42:18,348][52820] DAMAGECOUNT value on done: 511891.0 [2024-08-06 04:42:18,348][52820] Sum rewards: 70.978, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.157', 'weapon2': '0.202', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.320', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:18,429][52665] DAMAGECOUNT value on done: 549060.0 [2024-08-06 04:42:18,431][52665] Sum rewards: 70.940, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.098', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.158', 'weapon4': '0.168', 'AMMO3': '0.269', 'AMMO4': '0.271', 'weapon2': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '63.000'} [2024-08-06 04:42:18,485][52659] DAMAGECOUNT value on done: 554402.0 [2024-08-06 04:42:18,485][52659] Sum rewards: 71.387, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.044', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.148', 'AMMO4': '0.224', 'AMMO3': '0.273', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 04:42:18,642][52660] DAMAGECOUNT value on done: 561173.0 [2024-08-06 04:42:18,645][52660] Sum rewards: 78.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.262', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.124', 'AMMO4': '0.182', 'weapon2': '0.184', 'AMMO3': '0.194', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '64.000'} [2024-08-06 04:42:20,838][52665] DAMAGECOUNT value on done: 543192.0 [2024-08-06 04:42:20,838][52665] Sum rewards: 78.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.644', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.092', 'weapon4': '0.104', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.000'} [2024-08-06 04:42:21,441][52659] DAMAGECOUNT value on done: 549922.0 [2024-08-06 04:42:21,441][52659] Sum rewards: 67.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.245', 'weapon2': '0.278', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.392', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '57.000'} [2024-08-06 04:42:21,488][52794] DAMAGECOUNT value on done: 552539.0 [2024-08-06 04:42:21,493][52794] Sum rewards: 57.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.268', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.142', 'weapon5': '0.150', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '3.002', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '51.000'} [2024-08-06 04:42:21,575][52820] DAMAGECOUNT value on done: 514239.0 [2024-08-06 04:42:21,577][52820] Sum rewards: 76.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.214', 'AMMO3': '0.240', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '64.000'} [2024-08-06 04:42:21,603][52660] DAMAGECOUNT value on done: 544249.0 [2024-08-06 04:42:21,603][52660] Sum rewards: 69.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.098', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.160', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '58.000'} [2024-08-06 04:42:22,771][52650] Updated weights for policy 0, policy_version 55511 (0.0011) [2024-08-06 04:42:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 454746112. Throughput: 0: 4363.8. Samples: 113689520. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:42:22,793][52660] Large shaping reward 2.552 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.501, 167.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:42:22,795][52567] Avg episode reward: [(0, '72.238')] [2024-08-06 04:42:23,172][52665] DAMAGECOUNT value on done: 553920.0 [2024-08-06 04:42:23,174][52665] Sum rewards: 79.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.236', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.213', 'weapon2': '0.296', 'weapon5': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '63.500'} [2024-08-06 04:42:24,291][52660] DAMAGECOUNT value on done: 551918.0 [2024-08-06 04:42:24,291][52660] Sum rewards: 75.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.013', 'AMMO2': '0.057', 'AMMO3': '0.174', 'weapon5': '0.212', 'AMMO4': '0.284', 'weapon4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '61.000'} [2024-08-06 04:42:24,424][52659] DAMAGECOUNT value on done: 546210.0 [2024-08-06 04:42:24,425][52659] Sum rewards: 66.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.516', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.149', 'AMMO3': '0.176', 'weapon4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '53.000'} [2024-08-06 04:42:24,638][52794] DAMAGECOUNT value on done: 556711.0 [2024-08-06 04:42:24,639][52794] Sum rewards: 80.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.630', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.732', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '63.000'} [2024-08-06 04:42:24,676][52820] DAMAGECOUNT value on done: 509172.0 [2024-08-06 04:42:24,678][52820] Sum rewards: 68.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.086', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.148', 'AMMO3': '0.202', 'AMMO4': '0.235', 'weapon2': '0.236', 'weapon4': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '58.000'} [2024-08-06 04:42:25,565][52665] DAMAGECOUNT value on done: 548222.0 [2024-08-06 04:42:25,565][52665] Sum rewards: 74.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.815', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.124', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.374', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.000'} [2024-08-06 04:42:27,103][52660] DAMAGECOUNT value on done: 546395.0 [2024-08-06 04:42:27,106][52660] Sum rewards: 82.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.608', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.152', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '68.000'} [2024-08-06 04:42:27,417][52650] Updated weights for policy 0, policy_version 55521 (0.0020) [2024-08-06 04:42:27,498][52794] DAMAGECOUNT value on done: 555282.0 [2024-08-06 04:42:27,501][52794] Sum rewards: 70.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO3': '0.180', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.338', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '58.000'} [2024-08-06 04:42:27,672][52659] DAMAGECOUNT value on done: 549704.0 [2024-08-06 04:42:27,675][52659] Sum rewards: 78.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.558', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.204', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '65.000'} [2024-08-06 04:42:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 454828032. Throughput: 0: 4370.1. Samples: 113715880. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:42:27,795][52567] Avg episode reward: [(0, '72.648')] [2024-08-06 04:42:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055521_454828032.pth... [2024-08-06 04:42:27,843][52820] DAMAGECOUNT value on done: 511849.0 [2024-08-06 04:42:27,843][52820] Sum rewards: 76.355, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.520', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'weapon4': '0.172', 'AMMO3': '0.202', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '61.000'} [2024-08-06 04:42:27,979][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055010_450641920.pth [2024-08-06 04:42:28,350][52665] DAMAGECOUNT value on done: 544401.0 [2024-08-06 04:42:28,351][52665] Sum rewards: 64.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.110', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '54.000'} [2024-08-06 04:42:30,264][52794] DAMAGECOUNT value on done: 546841.0 [2024-08-06 04:42:30,268][52794] Sum rewards: 65.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.150', 'AMMO3': '0.207', 'AMMO4': '0.218', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '53.000'} [2024-08-06 04:42:30,323][52660] DAMAGECOUNT value on done: 547507.0 [2024-08-06 04:42:30,323][52660] Sum rewards: 66.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.615', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.172', 'weapon5': '0.196', 'AMMO3': '0.204', 'AMMO4': '0.268', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '55.000'} [2024-08-06 04:42:30,570][52659] DAMAGECOUNT value on done: 550154.0 [2024-08-06 04:42:30,570][52659] Sum rewards: 68.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.296', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:30,991][52820] DAMAGECOUNT value on done: 520407.0 [2024-08-06 04:42:30,993][52820] Sum rewards: 75.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.178', 'weapon5': '0.248', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '2.524', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '59.000'} [2024-08-06 04:42:31,071][52665] DAMAGECOUNT value on done: 544741.0 [2024-08-06 04:42:31,071][52665] Sum rewards: 72.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.592', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.082', 'AMMO4': '0.160', 'weapon5': '0.174', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:31,159][52670] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:42:32,113][52650] Updated weights for policy 0, policy_version 55531 (0.0011) [2024-08-06 04:42:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 454918144. Throughput: 0: 4360.2. Samples: 113728790. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:42:32,794][52567] Avg episode reward: [(0, '72.408')] [2024-08-06 04:42:33,156][52660] DAMAGECOUNT value on done: 538754.0 [2024-08-06 04:42:33,164][52660] Sum rewards: 80.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.838', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.127', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.400', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '66.000'} [2024-08-06 04:42:33,403][52794] DAMAGECOUNT value on done: 546412.0 [2024-08-06 04:42:33,408][52794] Sum rewards: 72.566, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.312', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.134', 'weapon5': '0.190', 'AMMO3': '0.217', 'AMMO4': '0.287', 'weapon2': '0.322', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 04:42:33,418][52659] DAMAGECOUNT value on done: 546836.0 [2024-08-06 04:42:33,419][52659] Sum rewards: 71.279, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '56.000'} [2024-08-06 04:42:34,024][52820] DAMAGECOUNT value on done: 518627.0 [2024-08-06 04:42:34,026][52820] Sum rewards: 68.515, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon4': '0.168', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '55.000'} [2024-08-06 04:42:34,191][52665] DAMAGECOUNT value on done: 542637.0 [2024-08-06 04:42:34,191][52665] Sum rewards: 82.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.197', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.382', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '65.000'} [2024-08-06 04:42:34,791][52811] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:42:36,114][52659] DAMAGECOUNT value on done: 553623.0 [2024-08-06 04:42:36,116][52659] Sum rewards: 66.255, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.264', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.178', 'weapon5': '0.214', 'AMMO3': '0.216', 'AMMO4': '0.224', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '56.000'} [2024-08-06 04:42:36,552][52794] DAMAGECOUNT value on done: 548079.0 [2024-08-06 04:42:36,552][52794] Sum rewards: 71.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.595', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.128', 'AMMO4': '0.197', 'AMMO3': '0.200', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:37,081][52820] DAMAGECOUNT value on done: 503683.0 [2024-08-06 04:42:37,082][52820] Sum rewards: 62.259, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.155', 'weapon2': '0.582', 'WEAPON3': '0.950', 'HITCOUNT': '3.040', 'weapon3': '3.300', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '49.000'} [2024-08-06 04:42:37,152][52650] Updated weights for policy 0, policy_version 55541 (0.0034) [2024-08-06 04:42:37,262][52811] DAMAGECOUNT value on done: 524757.0 [2024-08-06 04:42:37,264][52811] Sum rewards: 72.533, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.246', 'HEALTH': '0.254', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '59.000'} [2024-08-06 04:42:37,391][52665] DAMAGECOUNT value on done: 539223.0 [2024-08-06 04:42:37,391][52665] Sum rewards: 76.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.016', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.158', 'weapon4': '0.166', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '61.000'} [2024-08-06 04:42:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 455008256. Throughput: 0: 4356.0. Samples: 113755090. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:42:37,794][52567] Avg episode reward: [(0, '72.505')] [2024-08-06 04:42:37,833][52659] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:42:38,617][52659] DAMAGECOUNT value on done: 556747.0 [2024-08-06 04:42:38,618][52659] Sum rewards: 63.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.186', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '52.000'} [2024-08-06 04:42:39,703][52794] DAMAGECOUNT value on done: 556479.0 [2024-08-06 04:42:39,708][52794] Sum rewards: 72.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.881', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.138', 'weapon5': '0.162', 'AMMO4': '0.182', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '59.000'} [2024-08-06 04:42:40,225][52665] DAMAGECOUNT value on done: 542734.0 [2024-08-06 04:42:40,226][52665] Sum rewards: 78.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.254', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.113', 'weapon4': '0.128', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '64.000'} [2024-08-06 04:42:40,357][52811] DAMAGECOUNT value on done: 510108.0 [2024-08-06 04:42:40,358][52811] Sum rewards: 69.068, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.520', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.256', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '56.000'} [2024-08-06 04:42:41,371][52650] Updated weights for policy 0, policy_version 55551 (0.0012) [2024-08-06 04:42:41,593][52659] DAMAGECOUNT value on done: 546719.0 [2024-08-06 04:42:41,593][52659] Sum rewards: 63.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.124', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '54.000'} [2024-08-06 04:42:42,692][52794] DAMAGECOUNT value on done: 543392.0 [2024-08-06 04:42:42,693][52794] Sum rewards: 61.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.198', 'weapon5': '0.224', 'weapon7': '0.230', 'weapon2': '0.248', 'AMMO4': '0.264', 'weapon4': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.512', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '51.000'} [2024-08-06 04:42:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17479.2, 300 sec: 17467.0). Total num frames: 455090176. Throughput: 0: 4361.1. Samples: 113781430. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:42:42,794][52567] Avg episode reward: [(0, '72.215')] [2024-08-06 04:42:42,983][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:42:43,085][52665] DAMAGECOUNT value on done: 538379.0 [2024-08-06 04:42:43,087][52665] Sum rewards: 62.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.584', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.176', 'AMMO4': '0.184', 'weapon5': '0.210', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.736', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '54.000'} [2024-08-06 04:42:43,421][52811] DAMAGECOUNT value on done: 507828.0 [2024-08-06 04:42:43,422][52811] Sum rewards: 73.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.954', 'AMMO5': '0.024', 'AMMO2': '0.083', 'weapon4': '0.180', 'AMMO3': '0.205', 'weapon5': '0.206', 'AMMO4': '0.417', 'weapon2': '0.434', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:44,346][52659] DAMAGECOUNT value on done: 551355.0 [2024-08-06 04:42:44,366][52659] Sum rewards: 79.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.084', 'AMMO4': '0.175', 'weapon5': '0.206', 'weapon2': '0.244', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.174', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '68.000'} [2024-08-06 04:42:45,321][52794] DAMAGECOUNT value on done: 553074.0 [2024-08-06 04:42:45,321][52794] Sum rewards: 73.515, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.135', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.116', 'weapon4': '0.152', 'AMMO4': '0.187', 'AMMO3': '0.272', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.150', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '65.000'} [2024-08-06 04:42:46,167][52650] Updated weights for policy 0, policy_version 55561 (0.0035) [2024-08-06 04:42:46,241][52665] DAMAGECOUNT value on done: 542342.0 [2024-08-06 04:42:46,245][52665] Sum rewards: 74.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.129', 'weapon2': '0.196', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.330', 'weapon3': '3.480', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '62.000'} [2024-08-06 04:42:46,421][52811] DAMAGECOUNT value on done: 511448.0 [2024-08-06 04:42:46,423][52811] Sum rewards: 76.149, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.675', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.122', 'AMMO3': '0.155', 'weapon4': '0.168', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:47,229][52659] DAMAGECOUNT value on done: 544008.0 [2024-08-06 04:42:47,229][52659] Sum rewards: 71.933, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.177', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '61.000'} [2024-08-06 04:42:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 455180288. Throughput: 0: 4358.9. Samples: 113794540. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 04:42:47,794][52567] Avg episode reward: [(0, '72.069')] [2024-08-06 04:42:47,817][52614] Signal inference workers to stop experience collection... (10100 times) [2024-08-06 04:42:47,824][52614] Signal inference workers to resume experience collection... (10100 times) [2024-08-06 04:42:47,901][52650] InferenceWorker_p0-w0: stopping experience collection (10100 times) [2024-08-06 04:42:47,901][52650] InferenceWorker_p0-w0: resuming experience collection (10100 times) [2024-08-06 04:42:47,906][52794] DAMAGECOUNT value on done: 549494.0 [2024-08-06 04:42:47,908][52794] Sum rewards: 66.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.428', 'AMMO5': '0.028', 'AMMO2': '0.048', 'AMMO4': '0.242', 'weapon4': '0.248', 'weapon2': '0.264', 'AMMO3': '0.270', 'weapon5': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.812', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '56.000'} [2024-08-06 04:42:49,299][52665] DAMAGECOUNT value on done: 543463.0 [2024-08-06 04:42:49,299][52665] Sum rewards: 68.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.176', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.110', 'AMMO4': '0.208', 'AMMO3': '0.226', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '59.000'} [2024-08-06 04:42:49,519][52811] DAMAGECOUNT value on done: 516490.0 [2024-08-06 04:42:49,529][52811] Sum rewards: 83.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'AMMO3': '0.223', 'weapon2': '0.224', 'weapon4': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '68.000'} [2024-08-06 04:42:50,154][52659] DAMAGECOUNT value on done: 547874.0 [2024-08-06 04:42:50,156][52659] Sum rewards: 61.049, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.278', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '51.000'} [2024-08-06 04:42:50,217][52649] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)] [2024-08-06 04:42:50,660][52794] DAMAGECOUNT value on done: 545644.0 [2024-08-06 04:42:50,663][52794] Sum rewards: 77.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.349', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.110', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'weapon4': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '64.000'} [2024-08-06 04:42:50,793][52650] Updated weights for policy 0, policy_version 55571 (0.0012) [2024-08-06 04:42:52,672][52811] DAMAGECOUNT value on done: 521447.0 [2024-08-06 04:42:52,672][52811] Sum rewards: 72.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.094', 'weapon5': '0.098', 'AMMO4': '0.148', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '57.000'} [2024-08-06 04:42:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 455270400. Throughput: 0: 4360.0. Samples: 113820670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:42:52,794][52567] Avg episode reward: [(0, '72.070')] [2024-08-06 04:42:53,261][52659] DAMAGECOUNT value on done: 559723.0 [2024-08-06 04:42:53,263][52659] Sum rewards: 77.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.135', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '64.000'} [2024-08-06 04:42:53,417][52794] DAMAGECOUNT value on done: 550375.0 [2024-08-06 04:42:53,417][52794] Sum rewards: 71.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.308', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '3.360', 'weapon3': '3.432', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '60.000'} [2024-08-06 04:42:55,536][52650] Updated weights for policy 0, policy_version 55581 (0.0013) [2024-08-06 04:42:55,760][52811] DAMAGECOUNT value on done: 517560.0 [2024-08-06 04:42:55,761][52811] Sum rewards: 69.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.003', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.170', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '59.000'} [2024-08-06 04:42:55,968][52659] DAMAGECOUNT value on done: 552324.0 [2024-08-06 04:42:55,969][52659] Sum rewards: 67.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.132', 'weapon5': '0.178', 'AMMO4': '0.189', 'AMMO3': '0.259', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.500'} [2024-08-06 04:42:56,309][52794] DAMAGECOUNT value on done: 546453.0 [2024-08-06 04:42:56,309][52794] Sum rewards: 69.576, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.120', 'AMMO5': '0.010', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.354', 'WEAPON3': '0.950', 'weapon3': '3.238', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '55.000'} [2024-08-06 04:42:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 455352320. Throughput: 0: 4355.6. Samples: 113846440. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:42:57,802][52567] Avg episode reward: [(0, '72.068')] [2024-08-06 04:42:58,617][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:42:58,944][52811] DAMAGECOUNT value on done: 512148.0 [2024-08-06 04:42:58,946][52811] Sum rewards: 61.519, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.032', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon7': '0.160', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.404', 'weapon2': '0.442', 'WEAPON3': '0.950', 'weapon3': '2.574', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '14.325', 'FRAGCOUNT': '49.000'} [2024-08-06 04:42:59,081][52794] DAMAGECOUNT value on done: 565245.0 [2024-08-06 04:42:59,082][52794] Sum rewards: 77.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.191', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.203', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '63.000'} [2024-08-06 04:42:59,416][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:42:59,483][52659] DAMAGECOUNT value on done: 559412.0 [2024-08-06 04:42:59,483][52659] Sum rewards: 75.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.998', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.158', 'AMMO3': '0.185', 'weapon5': '0.210', 'AMMO4': '0.217', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '63.000'} [2024-08-06 04:42:59,695][52663] DAMAGECOUNT value on done: 558854.0 [2024-08-06 04:42:59,696][52663] Sum rewards: 75.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.925', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.062', 'weapon4': '0.106', 'AMMO3': '0.198', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:00,531][52650] Updated weights for policy 0, policy_version 55591 (0.0019) [2024-08-06 04:43:02,007][52811] DAMAGECOUNT value on done: 521577.0 [2024-08-06 04:43:02,010][52811] Sum rewards: 91.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.718', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.100', 'AMMO4': '0.131', 'weapon5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.429', 'FRAGCOUNT': '74.000'} [2024-08-06 04:43:02,096][52794] DAMAGECOUNT value on done: 543405.0 [2024-08-06 04:43:02,099][52794] Sum rewards: 80.576, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.092', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.285', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.424', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '69.000'} [2024-08-06 04:43:02,400][52659] DAMAGECOUNT value on done: 549338.0 [2024-08-06 04:43:02,401][52659] Sum rewards: 59.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.738', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.136', 'weapon5': '0.180', 'AMMO4': '0.228', 'AMMO3': '0.228', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '52.000'} [2024-08-06 04:43:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 455434240. Throughput: 0: 4362.0. Samples: 113859680. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:43:02,794][52567] Avg episode reward: [(0, '72.184')] [2024-08-06 04:43:02,905][52663] DAMAGECOUNT value on done: 550196.0 [2024-08-06 04:43:02,905][52663] Sum rewards: 80.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.072', 'AMMO5': '0.013', 'AMMO2': '0.058', 'AMMO3': '0.208', 'weapon5': '0.212', 'weapon2': '0.256', 'AMMO4': '0.292', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:03,345][52803] DAMAGECOUNT value on done: 513136.0 [2024-08-06 04:43:03,346][52803] Sum rewards: 71.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.298', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.068', 'weapon4': '0.110', 'AMMO4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.466', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:05,122][52659] DAMAGECOUNT value on done: 554672.0 [2024-08-06 04:43:05,122][52659] Sum rewards: 73.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.656', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.128', 'AMMO4': '0.162', 'weapon5': '0.202', 'AMMO3': '0.207', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:05,167][52794] DAMAGECOUNT value on done: 558499.0 [2024-08-06 04:43:05,167][52794] Sum rewards: 64.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.118', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.147', 'weapon5': '0.148', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:05,255][52811] DAMAGECOUNT value on done: 515415.0 [2024-08-06 04:43:05,256][52811] Sum rewards: 73.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.662', 'AMMO5': '0.014', 'AMMO2': '0.066', 'weapon5': '0.182', 'weapon4': '0.210', 'AMMO3': '0.226', 'AMMO4': '0.331', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:05,263][52650] Updated weights for policy 0, policy_version 55601 (0.0014) [2024-08-06 04:43:05,406][52663] DAMAGECOUNT value on done: 539481.0 [2024-08-06 04:43:05,407][52663] Sum rewards: 79.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.144', 'AMMO4': '0.204', 'weapon4': '0.226', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.094', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '68.000'} [2024-08-06 04:43:06,411][52803] DAMAGECOUNT value on done: 512347.0 [2024-08-06 04:43:06,421][52803] Sum rewards: 79.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '63.000'} [2024-08-06 04:43:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 455524352. Throughput: 0: 4358.4. Samples: 113885650. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:43:07,794][52567] Avg episode reward: [(0, '72.565')] [2024-08-06 04:43:08,039][52663] DAMAGECOUNT value on done: 547740.0 [2024-08-06 04:43:08,039][52663] Sum rewards: 77.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.160', 'AMMO3': '0.171', 'weapon4': '0.182', 'AMMO4': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:08,123][52659] DAMAGECOUNT value on done: 550560.0 [2024-08-06 04:43:08,124][52659] Sum rewards: 73.666, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.090', 'weapon4': '0.168', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:08,198][52794] DAMAGECOUNT value on done: 549030.0 [2024-08-06 04:43:08,199][52794] Sum rewards: 67.016, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.412', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:08,303][52811] DAMAGECOUNT value on done: 516886.0 [2024-08-06 04:43:08,303][52811] Sum rewards: 78.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.112', 'weapon4': '0.134', 'AMMO4': '0.164', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:08,626][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 04:43:09,545][52650] Updated weights for policy 0, policy_version 55611 (0.0038) [2024-08-06 04:43:09,591][52803] DAMAGECOUNT value on done: 517428.0 [2024-08-06 04:43:09,592][52803] Sum rewards: 64.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.526', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.190', 'weapon2': '0.242', 'AMMO3': '0.248', 'AMMO4': '0.273', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '54.000'} [2024-08-06 04:43:10,689][52663] DAMAGECOUNT value on done: 551987.0 [2024-08-06 04:43:10,691][52663] Sum rewards: 81.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.208', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.456', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '68.000'} [2024-08-06 04:43:10,828][52667] DAMAGECOUNT value on done: 551753.0 [2024-08-06 04:43:10,828][52667] Sum rewards: 62.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.417', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.116', 'weapon4': '0.124', 'AMMO4': '0.197', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:11,023][52794] DAMAGECOUNT value on done: 559064.0 [2024-08-06 04:43:11,024][52794] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.023', 'AMMO2': '0.071', 'weapon4': '0.128', 'AMMO3': '0.204', 'weapon2': '0.292', 'weapon5': '0.342', 'AMMO4': '0.353', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '59.000'} [2024-08-06 04:43:11,307][52811] DAMAGECOUNT value on done: 525279.0 [2024-08-06 04:43:11,308][52811] Sum rewards: 64.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.832', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.096', 'weapon5': '0.096', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '52.000'} [2024-08-06 04:43:12,564][52803] DAMAGECOUNT value on done: 519475.0 [2024-08-06 04:43:12,564][52803] Sum rewards: 69.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.834', 'AMMO5': '0.020', 'AMMO2': '0.068', 'AMMO3': '0.211', 'weapon4': '0.244', 'weapon5': '0.288', 'weapon2': '0.312', 'AMMO4': '0.342', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 455614464. Throughput: 0: 4355.3. Samples: 113911870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:43:12,795][52567] Avg episode reward: [(0, '72.248')] [2024-08-06 04:43:13,467][52663] DAMAGECOUNT value on done: 557237.0 [2024-08-06 04:43:13,468][52663] Sum rewards: 74.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.325', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.081', 'weapon5': '0.112', 'AMMO3': '0.209', 'weapon2': '0.240', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.410', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:13,557][52667] DAMAGECOUNT value on done: 560373.0 [2024-08-06 04:43:13,557][52667] Sum rewards: 67.653, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.010', 'AMMO5': '0.016', 'AMMO4': '0.052', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon5': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.386', 'HEALTH': '0.514', 'WEAPON3': '0.800', 'HITCOUNT': '2.970', 'weapon3': '3.078', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '53.000'} [2024-08-06 04:43:13,988][52794] DAMAGECOUNT value on done: 560743.0 [2024-08-06 04:43:13,989][52794] Sum rewards: 62.371, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.109', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.084', 'AMMO4': '0.124', 'weapon2': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.456', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '54.000'} [2024-08-06 04:43:14,441][52811] DAMAGECOUNT value on done: 511724.0 [2024-08-06 04:43:14,442][52811] Sum rewards: 68.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.964', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.118', 'AMMO4': '0.181', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:14,511][52666] DAMAGECOUNT value on done: 549170.0 [2024-08-06 04:43:14,513][52666] Sum rewards: 72.188, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.745', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.164', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '57.000'} [2024-08-06 04:43:14,789][52650] Updated weights for policy 0, policy_version 55621 (0.0024) [2024-08-06 04:43:15,694][52803] DAMAGECOUNT value on done: 515267.0 [2024-08-06 04:43:15,695][52803] Sum rewards: 75.363, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.134', 'weapon5': '0.142', 'AMMO4': '0.176', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:16,328][52663] DAMAGECOUNT value on done: 552199.0 [2024-08-06 04:43:16,330][52663] Sum rewards: 72.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.486', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.177', 'weapon2': '0.208', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.440', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:16,392][52670] DAMAGECOUNT value on done: 539729.0 [2024-08-06 04:43:16,392][52670] Sum rewards: 63.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.678', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.068', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.282', 'WEAPON3': '1.700', 'HITCOUNT': '3.040', 'weapon3': '3.412', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:16,491][52667] DAMAGECOUNT value on done: 551556.0 [2024-08-06 04:43:16,492][52667] Sum rewards: 74.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.404', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.103', 'weapon4': '0.110', 'weapon2': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.418', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2024-08-06 04:43:17,009][52794] DAMAGECOUNT value on done: 547674.0 [2024-08-06 04:43:17,011][52794] Sum rewards: 70.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.258', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.186', 'weapon2': '0.216', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.440', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:17,418][52666] DAMAGECOUNT value on done: 552642.0 [2024-08-06 04:43:17,418][52666] Sum rewards: 80.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.572', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.135', 'weapon4': '0.142', 'WEAPON4': '0.250', 'weapon2': '0.658', 'WEAPON3': '0.900', 'weapon3': '2.906', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '63.500'} [2024-08-06 04:43:17,579][52811] DAMAGECOUNT value on done: 508970.0 [2024-08-06 04:43:17,590][52811] Sum rewards: 57.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.172', 'AMMO4': '0.199', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.306', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.256', 'FRAGCOUNT': '50.000'} [2024-08-06 04:43:17,771][52647] DAMAGECOUNT value on done: 582726.0 [2024-08-06 04:43:17,771][52647] Sum rewards: 81.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.232', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.102', 'weapon5': '0.116', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '67.000'} [2024-08-06 04:43:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 455704576. Throughput: 0: 4355.3. Samples: 113924780. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:43:17,794][52567] Avg episode reward: [(0, '71.815')] [2024-08-06 04:43:18,764][52670] DAMAGECOUNT value on done: 551210.0 [2024-08-06 04:43:18,766][52670] Sum rewards: 73.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon5': '0.170', 'AMMO3': '0.174', 'weapon4': '0.186', 'weapon2': '0.236', 'AMMO4': '0.307', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:18,803][52803] DAMAGECOUNT value on done: 507538.0 [2024-08-06 04:43:18,805][52803] Sum rewards: 67.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:19,030][52650] Updated weights for policy 0, policy_version 55631 (0.0013) [2024-08-06 04:43:19,135][52663] DAMAGECOUNT value on done: 546887.0 [2024-08-06 04:43:19,135][52663] Sum rewards: 68.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.396', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.140', 'AMMO4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '59.000'} [2024-08-06 04:43:19,435][52667] DAMAGECOUNT value on done: 553661.0 [2024-08-06 04:43:19,436][52667] Sum rewards: 78.963, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.402', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.115', 'weapon5': '0.148', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.550', 'weapon3': '3.172', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '67.000'} [2024-08-06 04:43:19,960][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:43:19,971][52666] DAMAGECOUNT value on done: 554094.0 [2024-08-06 04:43:19,972][52666] Sum rewards: 80.682, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'HEALTH': '0.105', 'AMMO4': '0.108', 'weapon4': '0.134', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.356', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '66.000'} [2024-08-06 04:43:20,342][52668] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.534, 178.0), ('weapon5', 0.002)] [2024-08-06 04:43:20,521][52647] DAMAGECOUNT value on done: 580767.0 [2024-08-06 04:43:20,521][52647] Sum rewards: 65.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.201', 'weapon2': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:20,747][52811] DAMAGECOUNT value on done: 514579.0 [2024-08-06 04:43:20,748][52811] Sum rewards: 65.710, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.412', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.086', 'weapon4': '0.090', 'WEAPON5': '0.100', 'weapon2': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.446', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '57.000'} [2024-08-06 04:43:21,607][52663] DAMAGECOUNT value on done: 542745.0 [2024-08-06 04:43:21,607][52663] Sum rewards: 66.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'AMMO4': '0.247', 'weapon4': '0.270', 'weapon2': '0.308', 'WEAPON4': '0.350', 'ARMOR': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:21,903][52670] DAMAGECOUNT value on done: 543112.0 [2024-08-06 04:43:21,904][52670] Sum rewards: 75.351, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.112', 'weapon4': '0.146', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'AMMO4': '0.287', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.202', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:21,904][52803] DAMAGECOUNT value on done: 509205.0 [2024-08-06 04:43:21,906][52803] Sum rewards: 56.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.235', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.132', 'weapon5': '0.226', 'AMMO4': '0.240', 'weapon2': '0.248', 'AMMO3': '0.251', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.084', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '50.000'} [2024-08-06 04:43:22,101][52649] DAMAGECOUNT value on done: 533651.0 [2024-08-06 04:43:22,102][52649] Sum rewards: 71.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.739', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.126', 'weapon4': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '57.000'} [2024-08-06 04:43:22,338][52667] DAMAGECOUNT value on done: 557587.0 [2024-08-06 04:43:22,339][52667] Sum rewards: 71.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.595', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO4': '0.220', 'AMMO3': '0.235', 'weapon2': '0.238', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.866', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 455786496. Throughput: 0: 4359.1. Samples: 113951250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:43:22,802][52567] Avg episode reward: [(0, '71.869')] [2024-08-06 04:43:23,103][52666] DAMAGECOUNT value on done: 551322.0 [2024-08-06 04:43:23,107][52666] Sum rewards: 74.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.554', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.116', 'AMMO4': '0.157', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '60.500'} [2024-08-06 04:43:23,160][52647] DAMAGECOUNT value on done: 580371.0 [2024-08-06 04:43:23,160][52647] Sum rewards: 77.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.100', 'weapon5': '0.136', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:23,849][52811] DAMAGECOUNT value on done: 513491.0 [2024-08-06 04:43:23,849][52811] Sum rewards: 82.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.114', 'weapon5': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:23,959][52650] Updated weights for policy 0, policy_version 55641 (0.0021) [2024-08-06 04:43:24,381][52663] DAMAGECOUNT value on done: 551284.0 [2024-08-06 04:43:24,381][52663] Sum rewards: 71.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.078', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '59.000'} [2024-08-06 04:43:24,766][52649] DAMAGECOUNT value on done: 526200.0 [2024-08-06 04:43:24,766][52649] Sum rewards: 79.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:24,938][52803] DAMAGECOUNT value on done: 507145.0 [2024-08-06 04:43:24,939][52803] Sum rewards: 57.830, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.406', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.104', 'AMMO4': '0.245', 'AMMO3': '0.274', 'weapon5': '0.284', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.980', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '52.000'} [2024-08-06 04:43:24,968][52670] DAMAGECOUNT value on done: 542237.0 [2024-08-06 04:43:24,968][52670] Sum rewards: 76.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.553', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:25,136][52667] DAMAGECOUNT value on done: 560654.0 [2024-08-06 04:43:25,138][52667] Sum rewards: 74.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.678', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.171', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:26,131][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:43:26,187][52666] DAMAGECOUNT value on done: 545935.0 [2024-08-06 04:43:26,189][52666] Sum rewards: 28.112, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.884', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.138', 'AMMO4': '0.165', 'weapon5': '0.166', 'weapon7': '0.166', 'WEAPON7': '0.200', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon3': '1.242', 'HITCOUNT': '1.280', 'weapon4': '1.838', 'DAMAGECOUNT': '6.600', 'FRAGCOUNT': '25.000'} [2024-08-06 04:43:26,363][52647] DAMAGECOUNT value on done: 586566.0 [2024-08-06 04:43:26,365][52647] Sum rewards: 66.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.540', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.140', 'AMMO3': '0.167', 'weapon5': '0.188', 'AMMO4': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.754', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '53.000'} [2024-08-06 04:43:26,950][52811] DAMAGECOUNT value on done: 517948.0 [2024-08-06 04:43:26,951][52811] Sum rewards: 71.470, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.404', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.168', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:27,003][52663] DAMAGECOUNT value on done: 558022.0 [2024-08-06 04:43:27,003][52663] Sum rewards: 74.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.259', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.111', 'weapon5': '0.136', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '0.900', 'weapon3': '3.004', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 455876608. Throughput: 0: 4356.7. Samples: 113977480. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:43:27,802][52567] Avg episode reward: [(0, '71.356')] [2024-08-06 04:43:27,911][52670] DAMAGECOUNT value on done: 554989.0 [2024-08-06 04:43:27,911][52670] Sum rewards: 68.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.724', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:27,944][52667] DAMAGECOUNT value on done: 554244.0 [2024-08-06 04:43:27,945][52667] Sum rewards: 71.104, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.342', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.162', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'weapon4': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:27,983][52649] DAMAGECOUNT value on done: 544365.0 [2024-08-06 04:43:27,984][52649] Sum rewards: 81.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.088', 'weapon2': '0.162', 'AMMO4': '0.175', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.410', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '67.000'} [2024-08-06 04:43:28,148][52803] DAMAGECOUNT value on done: 513016.0 [2024-08-06 04:43:28,149][52803] Sum rewards: 70.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.155', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.138', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.454', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:28,404][52650] Updated weights for policy 0, policy_version 55651 (0.0018) [2024-08-06 04:43:28,998][52647] DAMAGECOUNT value on done: 588211.0 [2024-08-06 04:43:29,000][52647] Sum rewards: 68.443, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.570', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO4': '0.188', 'weapon2': '0.226', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.084', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:29,117][52666] DAMAGECOUNT value on done: 544924.0 [2024-08-06 04:43:29,117][52666] Sum rewards: 73.177, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.144', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.104', 'weapon4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:29,910][52663] DAMAGECOUNT value on done: 545316.0 [2024-08-06 04:43:29,910][52663] Sum rewards: 64.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.425', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.061', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.466', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.244', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:30,064][52811] DAMAGECOUNT value on done: 518476.0 [2024-08-06 04:43:30,067][52811] Sum rewards: 64.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.971', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '54.000'} [2024-08-06 04:43:30,607][52667] DAMAGECOUNT value on done: 548999.0 [2024-08-06 04:43:30,608][52667] Sum rewards: 75.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.224', 'AMMO2': '0.005', 'AMMO5': '0.014', 'weapon4': '0.016', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.114', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.200', 'weapon3': '3.394', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:30,835][52670] DAMAGECOUNT value on done: 547843.0 [2024-08-06 04:43:30,837][52670] Sum rewards: 76.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.262', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO3': '0.177', 'AMMO4': '0.191', 'weapon4': '0.252', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:31,174][52649] DAMAGECOUNT value on done: 539317.0 [2024-08-06 04:43:31,176][52649] Sum rewards: 76.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.423', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.516', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '63.000'} [2024-08-06 04:43:31,179][52803] DAMAGECOUNT value on done: 505929.0 [2024-08-06 04:43:31,181][52803] Sum rewards: 76.302, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.647', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon2': '0.154', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.514', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:31,553][52647] DAMAGECOUNT value on done: 587026.0 [2024-08-06 04:43:31,553][52647] Sum rewards: 80.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.014', 'AMMO4': '0.057', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON3': '1.200', 'weapon3': '3.456', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:32,062][52666] DAMAGECOUNT value on done: 547480.0 [2024-08-06 04:43:32,063][52666] Sum rewards: 57.828, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.272', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon2': '0.698', 'WEAPON3': '1.700', 'weapon3': '2.948', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '51.500'} [2024-08-06 04:43:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 455958528. Throughput: 0: 4354.7. Samples: 113990500. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:43:32,802][52567] Avg episode reward: [(0, '71.469')] [2024-08-06 04:43:32,802][52663] DAMAGECOUNT value on done: 543018.0 [2024-08-06 04:43:32,804][52663] Sum rewards: 71.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.197', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '59.000'} [2024-08-06 04:43:33,161][52811] DAMAGECOUNT value on done: 512790.0 [2024-08-06 04:43:33,163][52811] Sum rewards: 67.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.954', 'AMMO5': '0.020', 'AMMO2': '0.081', 'AMMO3': '0.206', 'weapon4': '0.214', 'weapon5': '0.266', 'weapon2': '0.286', 'AMMO4': '0.405', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '54.000'} [2024-08-06 04:43:33,298][52650] Updated weights for policy 0, policy_version 55661 (0.0046) [2024-08-06 04:43:33,388][52667] DAMAGECOUNT value on done: 557073.0 [2024-08-06 04:43:33,392][52667] Sum rewards: 70.793, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.014', 'HEALTH': '0.029', 'AMMO2': '0.048', 'AMMO3': '0.178', 'weapon4': '0.194', 'AMMO4': '0.238', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.538', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:33,961][52670] DAMAGECOUNT value on done: 536657.0 [2024-08-06 04:43:33,962][52670] Sum rewards: 76.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.536', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.158', 'weapon4': '0.162', 'AMMO3': '0.181', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:34,021][52647] DAMAGECOUNT value on done: 583161.0 [2024-08-06 04:43:34,022][52647] Sum rewards: 74.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.029', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.424', 'weapon4': '0.446', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:34,091][52803] DAMAGECOUNT value on done: 522579.0 [2024-08-06 04:43:34,092][52803] Sum rewards: 80.892, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.324', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.136', 'weapon4': '0.190', 'weapon2': '0.212', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.910', 'FRAGCOUNT': '68.000'} [2024-08-06 04:43:34,288][52649] DAMAGECOUNT value on done: 529036.0 [2024-08-06 04:43:34,289][52649] Sum rewards: 74.404, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.263', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.166', 'AMMO3': '0.174', 'AMMO4': '0.183', 'weapon4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:35,260][52666] DAMAGECOUNT value on done: 547404.0 [2024-08-06 04:43:35,260][52666] Sum rewards: 79.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '67.000'} [2024-08-06 04:43:35,873][52663] DAMAGECOUNT value on done: 545021.0 [2024-08-06 04:43:35,873][52663] Sum rewards: 82.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.047', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.394', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '68.000'} [2024-08-06 04:43:36,225][52811] DAMAGECOUNT value on done: 512530.0 [2024-08-06 04:43:36,226][52811] Sum rewards: 71.585, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.402', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.145', 'weapon4': '0.192', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.600', 'weapon3': '2.954', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:36,421][52667] DAMAGECOUNT value on done: 560434.0 [2024-08-06 04:43:36,422][52667] Sum rewards: 84.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.794', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.054', 'weapon4': '0.122', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '68.000'} [2024-08-06 04:43:36,686][52647] DAMAGECOUNT value on done: 574296.0 [2024-08-06 04:43:36,687][52647] Sum rewards: 68.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.128', 'weapon5': '0.168', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:36,842][52670] DAMAGECOUNT value on done: 546553.0 [2024-08-06 04:43:36,843][52670] Sum rewards: 65.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.221', 'weapon2': '0.404', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.274', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:37,111][52649] DAMAGECOUNT value on done: 540511.0 [2024-08-06 04:43:37,112][52649] Sum rewards: 70.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.638', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.106', 'AMMO4': '0.152', 'weapon5': '0.174', 'AMMO3': '0.238', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:37,246][52803] DAMAGECOUNT value on done: 514766.0 [2024-08-06 04:43:37,247][52803] Sum rewards: 73.130, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.166', 'HEALTH': '0.171', 'AMMO4': '0.180', 'weapon5': '0.216', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '0.950', 'weapon3': '2.910', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:37,578][52650] Updated weights for policy 0, policy_version 55671 (0.0013) [2024-08-06 04:43:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 456056832. Throughput: 0: 4355.8. Samples: 114016680. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:43:37,794][52567] Avg episode reward: [(0, '71.973')] [2024-08-06 04:43:38,161][52666] DAMAGECOUNT value on done: 547633.0 [2024-08-06 04:43:38,162][52666] Sum rewards: 65.601, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.422', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.216', 'weapon5': '0.228', 'AMMO4': '0.242', 'weapon2': '0.258', 'AMMO3': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.982', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:38,860][52663] DAMAGECOUNT value on done: 542977.0 [2024-08-06 04:43:38,861][52663] Sum rewards: 62.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.506', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.054', 'weapon5': '0.168', 'AMMO3': '0.227', 'AMMO4': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.110', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '53.000'} [2024-08-06 04:43:39,261][52667] DAMAGECOUNT value on done: 546960.0 [2024-08-06 04:43:39,263][52667] Sum rewards: 66.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.558', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.196', 'AMMO4': '0.199', 'weapon5': '0.218', 'weapon2': '0.274', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 04:43:39,276][52647] DAMAGECOUNT value on done: 584513.0 [2024-08-06 04:43:39,278][52647] Sum rewards: 70.688, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.755', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.062', 'AMMO4': '0.097', 'weapon4': '0.108', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '57.000'} [2024-08-06 04:43:39,802][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:43:39,904][52670] DAMAGECOUNT value on done: 543031.0 [2024-08-06 04:43:39,909][52670] Sum rewards: 79.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.784', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:40,257][52649] DAMAGECOUNT value on done: 535529.0 [2024-08-06 04:43:40,259][52649] Sum rewards: 73.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.684', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:40,368][52803] DAMAGECOUNT value on done: 509900.0 [2024-08-06 04:43:40,368][52803] Sum rewards: 64.631, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.054', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.172', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2024-08-06 04:43:41,118][52666] DAMAGECOUNT value on done: 541337.0 [2024-08-06 04:43:41,119][52666] Sum rewards: 64.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.956', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.636', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:41,467][52663] DAMAGECOUNT value on done: 555701.0 [2024-08-06 04:43:41,470][52663] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.157', 'weapon2': '0.364', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.398', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '52.000'} [2024-08-06 04:43:41,542][52795] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:43:41,647][52647] DAMAGECOUNT value on done: 580105.0 [2024-08-06 04:43:41,647][52647] Sum rewards: 68.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.583', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.172', 'weapon4': '0.180', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:42,270][52667] DAMAGECOUNT value on done: 550134.0 [2024-08-06 04:43:42,271][52667] Sum rewards: 60.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.565', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.234', 'weapon5': '0.244', 'AMMO3': '0.262', 'AMMO4': '0.300', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.770', 'weapon3': '2.788', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '54.000'} [2024-08-06 04:43:42,425][52650] Updated weights for policy 0, policy_version 55681 (0.0011) [2024-08-06 04:43:42,691][52670] DAMAGECOUNT value on done: 541800.0 [2024-08-06 04:43:42,691][52670] Sum rewards: 69.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.106', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.176', 'weapon2': '1.004', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:42,751][52669] DAMAGECOUNT value on done: 555676.0 [2024-08-06 04:43:42,752][52669] Sum rewards: 73.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.012', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 456138752. Throughput: 0: 4369.6. Samples: 114043070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:43:42,794][52567] Avg episode reward: [(0, '71.464')] [2024-08-06 04:43:43,277][52649] DAMAGECOUNT value on done: 537634.0 [2024-08-06 04:43:43,277][52649] Sum rewards: 59.279, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.025', 'AMMO2': '0.064', 'AMMO3': '0.209', 'weapon4': '0.298', 'AMMO4': '0.319', 'weapon2': '0.368', 'weapon5': '0.440', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.442', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '48.000'} [2024-08-06 04:43:43,487][52803] DAMAGECOUNT value on done: 522777.0 [2024-08-06 04:43:43,488][52803] Sum rewards: 67.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '57.000'} [2024-08-06 04:43:43,757][52666] DAMAGECOUNT value on done: 545884.0 [2024-08-06 04:43:43,758][52666] Sum rewards: 50.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.114', 'weapon5': '0.136', 'weapon2': '0.218', 'AMMO4': '0.234', 'AMMO3': '0.251', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.790', 'weapon3': '3.288', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '45.000'} [2024-08-06 04:43:44,060][52663] DAMAGECOUNT value on done: 542864.0 [2024-08-06 04:43:44,062][52663] Sum rewards: 67.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.124', 'AMMO4': '0.170', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '57.000'} [2024-08-06 04:43:44,355][52647] DAMAGECOUNT value on done: 581233.0 [2024-08-06 04:43:44,356][52647] Sum rewards: 70.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.192', 'weapon4': '0.198', 'AMMO4': '0.220', 'weapon2': '0.242', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:45,241][52669] DAMAGECOUNT value on done: 545709.0 [2024-08-06 04:43:45,245][52669] Sum rewards: 75.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.970', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.122', 'AMMO4': '0.147', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.900', 'weapon3': '3.312', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '66.000'} [2024-08-06 04:43:45,353][52667] DAMAGECOUNT value on done: 558433.0 [2024-08-06 04:43:45,354][52667] Sum rewards: 72.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO4': '0.174', 'weapon5': '0.210', 'weapon2': '0.216', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:45,576][52670] DAMAGECOUNT value on done: 550644.0 [2024-08-06 04:43:45,579][52670] Sum rewards: 71.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.788', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.190', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.650', 'weapon3': '3.204', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:46,345][52649] DAMAGECOUNT value on done: 541695.0 [2024-08-06 04:43:46,351][52649] Sum rewards: 75.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.313', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.122', 'weapon5': '0.198', 'AMMO3': '0.217', 'weapon2': '0.230', 'AMMO4': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.154', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:46,574][52803] DAMAGECOUNT value on done: 514667.0 [2024-08-06 04:43:46,575][52803] Sum rewards: 77.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.010', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.179', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:46,688][52666] DAMAGECOUNT value on done: 542176.0 [2024-08-06 04:43:46,690][52666] Sum rewards: 72.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.141', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.220', 'WEAPON3': '1.500', 'weapon3': '3.360', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:46,991][52647] DAMAGECOUNT value on done: 574466.0 [2024-08-06 04:43:46,992][52647] Sum rewards: 68.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon4': '0.168', 'weapon5': '0.196', 'AMMO3': '0.197', 'AMMO4': '0.315', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:47,008][52663] DAMAGECOUNT value on done: 555268.0 [2024-08-06 04:43:47,010][52663] Sum rewards: 70.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.480', 'AMMO5': '0.008', 'AMMO2': '0.055', 'weapon4': '0.090', 'weapon5': '0.102', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.276', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.172', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:47,440][52650] Updated weights for policy 0, policy_version 55691 (0.0028) [2024-08-06 04:43:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 456228864. Throughput: 0: 4362.7. Samples: 114056000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:43:47,794][52567] Avg episode reward: [(0, '70.640')] [2024-08-06 04:43:47,983][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:43:48,238][52669] DAMAGECOUNT value on done: 557301.0 [2024-08-06 04:43:48,239][52669] Sum rewards: 60.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.894', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.214', 'weapon5': '0.242', 'AMMO3': '0.264', 'AMMO4': '0.265', 'weapon2': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.830', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '52.000'} [2024-08-06 04:43:48,278][52670] DAMAGECOUNT value on done: 540668.0 [2024-08-06 04:43:48,278][52670] Sum rewards: 73.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.598', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.252', 'weapon4': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '60.500'} [2024-08-06 04:43:48,304][52667] DAMAGECOUNT value on done: 548293.0 [2024-08-06 04:43:48,306][52667] Sum rewards: 77.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '0.014', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.215', 'weapon5': '0.248', 'AMMO4': '0.286', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.582', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '63.000'} [2024-08-06 04:43:49,328][52647] DAMAGECOUNT value on done: 586851.0 [2024-08-06 04:43:49,328][52647] Sum rewards: 77.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.104', 'weapon5': '0.118', 'AMMO4': '0.208', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.103', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:49,495][52666] DAMAGECOUNT value on done: 554110.0 [2024-08-06 04:43:49,495][52666] Sum rewards: 68.892, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.080', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.088', 'weapon5': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.279', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:49,673][52803] DAMAGECOUNT value on done: 512048.0 [2024-08-06 04:43:49,674][52803] Sum rewards: 80.153, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.124', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.074', 'AMMO3': '0.168', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.324', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '63.000'} [2024-08-06 04:43:49,707][52649] DAMAGECOUNT value on done: 532005.0 [2024-08-06 04:43:49,707][52649] Sum rewards: 81.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.605', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '67.000'} [2024-08-06 04:43:50,115][52663] DAMAGECOUNT value on done: 554393.0 [2024-08-06 04:43:50,119][52663] Sum rewards: 65.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.554', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.180', 'weapon2': '0.184', 'AMMO3': '0.221', 'weapon4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.086', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:50,944][52667] DAMAGECOUNT value on done: 558345.0 [2024-08-06 04:43:50,945][52667] Sum rewards: 71.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.920', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.030', 'weapon5': '0.036', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.564', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.232', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:51,264][52669] DAMAGECOUNT value on done: 555466.0 [2024-08-06 04:43:51,264][52669] Sum rewards: 68.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.129', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.216', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:51,339][52670] DAMAGECOUNT value on done: 544911.0 [2024-08-06 04:43:51,341][52670] Sum rewards: 71.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.160', 'AMMO3': '0.179', 'AMMO4': '0.272', 'weapon2': '0.320', 'weapon4': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '59.000'} [2024-08-06 04:43:51,830][52650] Updated weights for policy 0, policy_version 55701 (0.0029) [2024-08-06 04:43:52,191][52647] DAMAGECOUNT value on done: 578094.0 [2024-08-06 04:43:52,192][52647] Sum rewards: 70.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.659', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.236', 'weapon2': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 04:43:52,474][52649] DAMAGECOUNT value on done: 541563.0 [2024-08-06 04:43:52,475][52649] Sum rewards: 82.080, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.711', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.102', 'AMMO3': '0.181', 'weapon5': '0.192', 'AMMO4': '0.204', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '66.000'} [2024-08-06 04:43:52,570][52666] DAMAGECOUNT value on done: 545453.0 [2024-08-06 04:43:52,570][52666] Sum rewards: 66.769, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.025', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.418', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '3.128', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:52,731][52803] DAMAGECOUNT value on done: 516675.0 [2024-08-06 04:43:52,733][52803] Sum rewards: 68.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.138', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.040', 'AMMO4': '0.178', 'AMMO3': '0.178', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 456310784. Throughput: 0: 4374.2. Samples: 114082490. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:43:52,794][52567] Avg episode reward: [(0, '70.939')] [2024-08-06 04:43:53,195][52663] DAMAGECOUNT value on done: 547055.0 [2024-08-06 04:43:53,196][52663] Sum rewards: 65.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.083', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.076', 'AMMO3': '0.177', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.050', 'weapon3': '2.890', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '55.000'} [2024-08-06 04:43:53,694][52667] DAMAGECOUNT value on done: 560939.0 [2024-08-06 04:43:53,698][52667] Sum rewards: 67.470, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.500', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.156', 'weapon4': '0.170', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:54,123][52670] DAMAGECOUNT value on done: 555004.0 [2024-08-06 04:43:54,124][52670] Sum rewards: 76.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.080', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.658', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:54,346][52669] DAMAGECOUNT value on done: 552663.0 [2024-08-06 04:43:54,348][52669] Sum rewards: 69.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.561', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.108', 'AMMO4': '0.137', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.990', 'weapon3': '3.306', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '60.000'} [2024-08-06 04:43:55,075][52649] DAMAGECOUNT value on done: 546970.0 [2024-08-06 04:43:55,075][52649] Sum rewards: 66.650, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.464', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'weapon2': '0.226', 'AMMO3': '0.256', 'weapon4': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.006', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '57.000'} [2024-08-06 04:43:55,140][52666] DAMAGECOUNT value on done: 550648.0 [2024-08-06 04:43:55,142][52666] Sum rewards: 79.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.176', 'AMMO3': '0.210', 'weapon2': '0.274', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:55,147][52647] DAMAGECOUNT value on done: 586047.0 [2024-08-06 04:43:55,147][52647] Sum rewards: 74.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.145', 'weapon4': '0.154', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '2.922', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '62.000'} [2024-08-06 04:43:55,852][52660] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 04:43:56,020][52803] DAMAGECOUNT value on done: 517536.0 [2024-08-06 04:43:56,020][52803] Sum rewards: 82.156, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.150', 'AMMO3': '0.155', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:56,522][52650] Updated weights for policy 0, policy_version 55711 (0.0014) [2024-08-06 04:43:56,631][52667] DAMAGECOUNT value on done: 562095.0 [2024-08-06 04:43:56,631][52667] Sum rewards: 73.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:56,671][52670] DAMAGECOUNT value on done: 549682.0 [2024-08-06 04:43:56,671][52670] Sum rewards: 69.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.356', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '58.000'} [2024-08-06 04:43:57,062][52669] DAMAGECOUNT value on done: 557368.0 [2024-08-06 04:43:57,062][52669] Sum rewards: 79.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.482', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '65.000'} [2024-08-06 04:43:57,725][52666] DAMAGECOUNT value on done: 545832.0 [2024-08-06 04:43:57,725][52666] Sum rewards: 70.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.228', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.196', 'weapon5': '0.258', 'weapon2': '0.270', 'AMMO4': '0.275', 'weapon4': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '56.000'} [2024-08-06 04:43:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 456400896. Throughput: 0: 4373.8. Samples: 114108690. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:43:57,795][52567] Avg episode reward: [(0, '71.034')] [2024-08-06 04:43:57,984][52647] DAMAGECOUNT value on done: 582768.0 [2024-08-06 04:43:57,984][52647] Sum rewards: 76.527, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.174', 'HEALTH': '0.255', 'weapon2': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.934', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 04:43:58,225][52649] DAMAGECOUNT value on done: 547393.0 [2024-08-06 04:43:58,225][52649] Sum rewards: 80.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.506', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon4': '0.248', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:59,202][52803] DAMAGECOUNT value on done: 520211.0 [2024-08-06 04:43:59,203][52803] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.092', 'weapon4': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '64.000'} [2024-08-06 04:43:59,251][52670] DAMAGECOUNT value on done: 532064.0 [2024-08-06 04:43:59,252][52670] Sum rewards: 62.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.946', 'AMMO5': '0.033', 'AMMO2': '0.063', 'weapon4': '0.108', 'AMMO3': '0.183', 'weapon2': '0.258', 'AMMO4': '0.317', 'weapon5': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '2.998', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '52.500'} [2024-08-06 04:43:59,418][52667] DAMAGECOUNT value on done: 559360.0 [2024-08-06 04:43:59,420][52667] Sum rewards: 70.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.180', 'AMMO4': '0.193', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.218', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:00,048][52669] DAMAGECOUNT value on done: 556436.0 [2024-08-06 04:44:00,048][52669] Sum rewards: 67.560, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.875', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.068', 'weapon4': '0.106', 'weapon5': '0.212', 'AMMO3': '0.244', 'AMMO4': '0.342', 'weapon2': '0.364', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:00,253][52666] DAMAGECOUNT value on done: 549250.0 [2024-08-06 04:44:00,255][52666] Sum rewards: 64.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.174', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.192', 'weapon5': '0.228', 'weapon4': '0.386', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.618', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '54.000'} [2024-08-06 04:44:01,049][52649] DAMAGECOUNT value on done: 545698.0 [2024-08-06 04:44:01,050][52649] Sum rewards: 72.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.450', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.212', 'weapon5': '0.244', 'weapon4': '0.250', 'weapon2': '0.260', 'AMMO4': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '60.000'} [2024-08-06 04:44:01,069][52647] DAMAGECOUNT value on done: 570767.0 [2024-08-06 04:44:01,069][52647] Sum rewards: 72.939, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.156', 'AMMO4': '0.203', 'weapon4': '0.226', 'AMMO3': '0.280', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.978', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:01,346][52650] Updated weights for policy 0, policy_version 55721 (0.0014) [2024-08-06 04:44:01,470][52670] DAMAGECOUNT value on done: 545598.0 [2024-08-06 04:44:01,471][52670] Sum rewards: 59.435, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.620', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.223', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.365', 'WEAPON3': '2.150', 'HITCOUNT': '3.180', 'weapon3': '3.268', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '55.000'} [2024-08-06 04:44:02,202][52803] DAMAGECOUNT value on done: 510281.0 [2024-08-06 04:44:02,203][52803] Sum rewards: 64.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.784', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.156', 'AMMO3': '0.198', 'weapon5': '0.236', 'AMMO4': '0.283', 'weapon2': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '56.500'} [2024-08-06 04:44:02,288][52667] DAMAGECOUNT value on done: 552766.0 [2024-08-06 04:44:02,288][52667] Sum rewards: 79.082, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '64.000'} [2024-08-06 04:44:02,647][52666] DAMAGECOUNT value on done: 551351.0 [2024-08-06 04:44:02,650][52666] Sum rewards: 68.438, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.005', 'AMMO5': '0.017', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.132', 'AMMO3': '0.163', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:02,786][52671] DAMAGECOUNT value on done: 558751.0 [2024-08-06 04:44:02,788][52671] Sum rewards: 79.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.594', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 456491008. Throughput: 0: 4376.6. Samples: 114121730. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:44:02,794][52567] Avg episode reward: [(0, '70.900')] [2024-08-06 04:44:02,927][52669] DAMAGECOUNT value on done: 553986.0 [2024-08-06 04:44:02,927][52669] Sum rewards: 65.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.273', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO4': '0.166', 'weapon5': '0.182', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '55.000'} [2024-08-06 04:44:03,270][52664] DAMAGECOUNT value on done: 573059.0 [2024-08-06 04:44:03,271][52664] Sum rewards: 76.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.052', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.214', 'AMMO3': '0.215', 'weapon4': '0.270', 'AMMO4': '0.283', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.786', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '64.000'} [2024-08-06 04:44:03,905][52647] DAMAGECOUNT value on done: 579471.0 [2024-08-06 04:44:03,905][52647] Sum rewards: 82.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.395', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.112', 'weapon4': '0.154', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '68.000'} [2024-08-06 04:44:03,965][52649] DAMAGECOUNT value on done: 532063.0 [2024-08-06 04:44:03,967][52649] Sum rewards: 65.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:04,085][52670] DAMAGECOUNT value on done: 553901.0 [2024-08-06 04:44:04,086][52670] Sum rewards: 69.654, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.154', 'AMMO3': '0.156', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.062', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:04,880][52667] DAMAGECOUNT value on done: 560613.0 [2024-08-06 04:44:04,881][52667] Sum rewards: 69.904, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.994', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.159', 'weapon2': '0.494', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.316', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:04,946][52666] DAMAGECOUNT value on done: 536984.0 [2024-08-06 04:44:04,947][52666] Sum rewards: 84.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.352', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '69.000'} [2024-08-06 04:44:05,531][52671] DAMAGECOUNT value on done: 557670.0 [2024-08-06 04:44:05,532][52671] Sum rewards: 64.714, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.094', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.086', 'weapon4': '0.098', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:05,772][52650] Updated weights for policy 0, policy_version 55731 (0.0011) [2024-08-06 04:44:05,848][52669] DAMAGECOUNT value on done: 562927.0 [2024-08-06 04:44:05,848][52669] Sum rewards: 64.154, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO4': '0.196', 'weapon4': '0.224', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:05,971][52664] DAMAGECOUNT value on done: 578238.0 [2024-08-06 04:44:05,973][52664] Sum rewards: 60.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.136', 'AMMO4': '0.202', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.240', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '52.000'} [2024-08-06 04:44:06,413][52647] DAMAGECOUNT value on done: 570771.0 [2024-08-06 04:44:06,415][52647] Sum rewards: 57.237, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.099', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.126', 'weapon4': '0.136', 'weapon2': '0.298', 'WEAPON3': '0.850', 'HITCOUNT': '2.670', 'weapon3': '3.460', 'DAMAGECOUNT': '13.035', 'FRAGCOUNT': '45.000'} [2024-08-06 04:44:06,963][52670] DAMAGECOUNT value on done: 544540.0 [2024-08-06 04:44:06,963][52670] Sum rewards: 79.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.692', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.424', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:07,049][52649] DAMAGECOUNT value on done: 540578.0 [2024-08-06 04:44:07,049][52649] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon4': '0.108', 'weapon5': '0.136', 'AMMO3': '0.206', 'AMMO4': '0.295', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.160', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '54.000'} [2024-08-06 04:44:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 456581120. Throughput: 0: 4379.6. Samples: 114148330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:44:07,794][52567] Avg episode reward: [(0, '71.195')] [2024-08-06 04:44:08,010][52666] DAMAGECOUNT value on done: 545648.0 [2024-08-06 04:44:08,012][52666] Sum rewards: 73.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.445', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.136', 'weapon2': '0.166', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:08,271][52664] DAMAGECOUNT value on done: 576566.0 [2024-08-06 04:44:08,271][52664] Sum rewards: 68.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.160', 'weapon5': '0.178', 'AMMO4': '0.216', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:08,387][52669] DAMAGECOUNT value on done: 554302.0 [2024-08-06 04:44:08,389][52669] Sum rewards: 76.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.886', 'ARMOR': '0.008', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.142', 'AMMO3': '0.228', 'AMMO4': '0.309', 'weapon5': '0.340', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon2': '0.656', 'WEAPON3': '1.400', 'weapon3': '2.550', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '63.000'} [2024-08-06 04:44:08,478][52671] DAMAGECOUNT value on done: 555878.0 [2024-08-06 04:44:08,479][52671] Sum rewards: 68.655, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.926', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.136', 'weapon4': '0.142', 'AMMO3': '0.249', 'AMMO4': '0.259', 'weapon2': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:08,860][52647] DAMAGECOUNT value on done: 574900.0 [2024-08-06 04:44:08,861][52647] Sum rewards: 68.476, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.138', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.380', 'weapon3': '3.424', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '58.500'} [2024-08-06 04:44:09,643][52658] DAMAGECOUNT value on done: 553467.0 [2024-08-06 04:44:09,645][52658] Sum rewards: 77.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.066', 'AMMO4': '0.129', 'weapon5': '0.132', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.716', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '64.000'} [2024-08-06 04:44:09,891][52670] DAMAGECOUNT value on done: 548830.0 [2024-08-06 04:44:09,933][52670] Sum rewards: 81.490, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.180', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.370', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.030', 'FRAGCOUNT': '70.000'} [2024-08-06 04:44:10,174][52649] DAMAGECOUNT value on done: 530691.0 [2024-08-06 04:44:10,175][52649] Sum rewards: 69.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.128', 'AMMO3': '0.176', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '55.500'} [2024-08-06 04:44:10,655][52650] Updated weights for policy 0, policy_version 55741 (0.0027) [2024-08-06 04:44:11,110][52669] DAMAGECOUNT value on done: 558533.0 [2024-08-06 04:44:11,110][52669] Sum rewards: 68.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.458', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.156', 'AMMO4': '0.215', 'weapon2': '0.258', 'AMMO3': '0.259', 'weapon5': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:11,175][52664] DAMAGECOUNT value on done: 569234.0 [2024-08-06 04:44:11,176][52664] Sum rewards: 74.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.213', 'weapon2': '0.284', 'weapon4': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 04:44:11,523][52671] DAMAGECOUNT value on done: 556435.0 [2024-08-06 04:44:11,524][52671] Sum rewards: 74.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'weapon4': '0.180', 'weapon2': '0.812', 'WEAPON3': '0.900', 'weapon3': '2.898', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:12,466][52658] DAMAGECOUNT value on done: 552532.0 [2024-08-06 04:44:12,466][52658] Sum rewards: 60.468, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.159', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.192', 'weapon5': '0.198', 'AMMO4': '0.238', 'AMMO3': '0.273', 'weapon2': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.976', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '54.000'} [2024-08-06 04:44:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 456663040. Throughput: 0: 4373.6. Samples: 114174290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:44:12,794][52567] Avg episode reward: [(0, '70.970')] [2024-08-06 04:44:13,126][52649] DAMAGECOUNT value on done: 544544.0 [2024-08-06 04:44:13,127][52649] Sum rewards: 69.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 04:44:14,106][52669] DAMAGECOUNT value on done: 558195.0 [2024-08-06 04:44:14,106][52669] Sum rewards: 78.476, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.116', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.126', 'weapon2': '0.188', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.442', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '64.000'} [2024-08-06 04:44:14,245][52664] DAMAGECOUNT value on done: 574309.0 [2024-08-06 04:44:14,245][52664] Sum rewards: 76.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.135', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.150', 'weapon4': '0.182', 'AMMO4': '0.184', 'weapon2': '0.206', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '65.000'} [2024-08-06 04:44:14,283][52671] DAMAGECOUNT value on done: 567291.0 [2024-08-06 04:44:14,283][52671] Sum rewards: 70.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.109', 'weapon5': '0.138', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 04:44:15,303][52650] Updated weights for policy 0, policy_version 55751 (0.0013) [2024-08-06 04:44:15,470][52658] DAMAGECOUNT value on done: 557463.0 [2024-08-06 04:44:15,470][52658] Sum rewards: 64.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.236', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.106', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.328', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.274', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:16,194][52649] DAMAGECOUNT value on done: 544772.0 [2024-08-06 04:44:16,195][52649] Sum rewards: 68.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.192', 'weapon5': '0.206', 'AMMO3': '0.223', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:16,293][52671] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:44:17,002][52671] DAMAGECOUNT value on done: 556791.0 [2024-08-06 04:44:17,002][52671] Sum rewards: 75.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO4': '0.126', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.100', 'HITCOUNT': '3.360', 'weapon3': '3.364', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '60.000'} [2024-08-06 04:44:17,112][52664] DAMAGECOUNT value on done: 573843.0 [2024-08-06 04:44:17,114][52664] Sum rewards: 65.410, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.294', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon2': '0.168', 'AMMO4': '0.174', 'weapon5': '0.174', 'weapon4': '0.198', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.226', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:17,122][52669] DAMAGECOUNT value on done: 546300.0 [2024-08-06 04:44:17,129][52669] Sum rewards: 89.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.176', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'AMMO3': '0.180', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.494', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.715', 'FRAGCOUNT': '72.000'} [2024-08-06 04:44:17,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 456744960. Throughput: 0: 4379.8. Samples: 114187590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:44:17,795][52567] Avg episode reward: [(0, '70.938')] [2024-08-06 04:44:18,624][52658] DAMAGECOUNT value on done: 558283.0 [2024-08-06 04:44:18,625][52658] Sum rewards: 76.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.106', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.187', 'weapon5': '0.212', 'AMMO3': '0.225', 'weapon2': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '63.000'} [2024-08-06 04:44:19,415][52649] DAMAGECOUNT value on done: 537212.0 [2024-08-06 04:44:19,416][52649] Sum rewards: 64.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.162', 'AMMO3': '0.192', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '52.000'} [2024-08-06 04:44:19,849][52669] DAMAGECOUNT value on done: 554679.0 [2024-08-06 04:44:19,849][52669] Sum rewards: 62.944, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.156', 'weapon5': '0.180', 'weapon4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '2.744', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.958', 'FRAGCOUNT': '50.000'} [2024-08-06 04:44:19,851][52650] Updated weights for policy 0, policy_version 55761 (0.0030) [2024-08-06 04:44:20,005][52671] DAMAGECOUNT value on done: 562715.0 [2024-08-06 04:44:20,006][52671] Sum rewards: 55.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.088', 'weapon5': '0.096', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.320', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '46.000'} [2024-08-06 04:44:20,234][52664] DAMAGECOUNT value on done: 569338.0 [2024-08-06 04:44:20,235][52664] Sum rewards: 58.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.895', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.213', 'weapon4': '0.288', 'AMMO4': '0.301', 'weapon2': '0.316', 'weapon5': '0.370', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.664', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '50.500'} [2024-08-06 04:44:21,384][52658] DAMAGECOUNT value on done: 547646.0 [2024-08-06 04:44:21,386][52658] Sum rewards: 69.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.102', 'weapon4': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '58.000'} [2024-08-06 04:44:22,194][52669] DAMAGECOUNT value on done: 556013.0 [2024-08-06 04:44:22,195][52669] Sum rewards: 64.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.798', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.147', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '54.000'} [2024-08-06 04:44:22,712][52668] DAMAGECOUNT value on done: 552830.0 [2024-08-06 04:44:22,713][52668] Sum rewards: 65.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.408', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:22,788][52671] DAMAGECOUNT value on done: 557241.0 [2024-08-06 04:44:22,788][52671] Sum rewards: 70.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon2': '0.216', 'AMMO3': '0.239', 'AMMO4': '0.271', 'weapon5': '0.294', 'weapon4': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '58.000'} [2024-08-06 04:44:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 456843264. Throughput: 0: 4382.2. Samples: 114213880. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:44:22,794][52567] Avg episode reward: [(0, '70.662')] [2024-08-06 04:44:23,144][52664] DAMAGECOUNT value on done: 566977.0 [2024-08-06 04:44:23,145][52664] Sum rewards: 89.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.092', 'AMMO3': '0.206', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.210', 'FRAGCOUNT': '74.000'} [2024-08-06 04:44:24,199][52658] DAMAGECOUNT value on done: 549887.0 [2024-08-06 04:44:24,199][52658] Sum rewards: 82.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon4': '0.248', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:24,707][52650] Updated weights for policy 0, policy_version 55771 (0.0025) [2024-08-06 04:44:25,109][52669] DAMAGECOUNT value on done: 574210.0 [2024-08-06 04:44:25,111][52669] Sum rewards: 66.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.879', 'AMMO5': '0.019', 'AMMO2': '0.024', 'weapon4': '0.076', 'weapon5': '0.116', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '56.500'} [2024-08-06 04:44:25,547][52668] DAMAGECOUNT value on done: 555650.0 [2024-08-06 04:44:25,549][52668] Sum rewards: 70.843, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.132', 'AMMO4': '0.189', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon4': '0.284', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:25,970][52671] DAMAGECOUNT value on done: 550656.0 [2024-08-06 04:44:25,974][52671] Sum rewards: 64.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.270', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '52.000'} [2024-08-06 04:44:26,062][52664] DAMAGECOUNT value on done: 578131.0 [2024-08-06 04:44:26,062][52664] Sum rewards: 75.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.066', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '63.000'} [2024-08-06 04:44:26,897][52658] DAMAGECOUNT value on done: 557720.0 [2024-08-06 04:44:26,898][52658] Sum rewards: 64.654, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.688', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.124', 'weapon5': '0.216', 'AMMO4': '0.221', 'AMMO3': '0.289', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.996', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '58.000'} [2024-08-06 04:44:27,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 456925184. Throughput: 0: 4374.8. Samples: 114239940. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:44:27,795][52567] Avg episode reward: [(0, '71.340')] [2024-08-06 04:44:27,796][52669] DAMAGECOUNT value on done: 561013.0 [2024-08-06 04:44:27,796][52669] Sum rewards: 94.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.072', 'weapon5': '0.148', 'AMMO3': '0.181', 'AMMO4': '0.207', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '23.466', 'FRAGCOUNT': '75.000'} [2024-08-06 04:44:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055777_456925184.pth... [2024-08-06 04:44:27,954][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055265_452730880.pth [2024-08-06 04:44:28,390][52662] DAMAGECOUNT value on done: 558911.0 [2024-08-06 04:44:28,390][52662] Sum rewards: 80.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.259', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.076', 'AMMO4': '0.104', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:28,497][52668] DAMAGECOUNT value on done: 553762.0 [2024-08-06 04:44:28,497][52668] Sum rewards: 72.691, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.038', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'AMMO3': '0.302', 'weapon2': '0.448', 'WEAPON3': '1.800', 'weapon3': '3.322', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '64.000'} [2024-08-06 04:44:28,993][52671] DAMAGECOUNT value on done: 559100.0 [2024-08-06 04:44:28,995][52671] Sum rewards: 80.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.930', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.162', 'AMMO4': '0.176', 'weapon2': '0.236', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:28,999][52664] DAMAGECOUNT value on done: 571316.0 [2024-08-06 04:44:28,999][52664] Sum rewards: 57.706, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.361', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.118', 'weapon4': '0.126', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon2': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.960', 'weapon3': '3.110', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '51.000'} [2024-08-06 04:44:29,478][52650] Updated weights for policy 0, policy_version 55781 (0.0021) [2024-08-06 04:44:29,849][52658] DAMAGECOUNT value on done: 548364.0 [2024-08-06 04:44:29,850][52658] Sum rewards: 67.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.125', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.114', 'weapon5': '0.146', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.648', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:30,623][52669] DAMAGECOUNT value on done: 559529.0 [2024-08-06 04:44:30,625][52669] Sum rewards: 79.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.146', 'weapon5': '0.172', 'AMMO3': '0.193', 'AMMO4': '0.210', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '65.000'} [2024-08-06 04:44:31,063][52662] DAMAGECOUNT value on done: 555755.0 [2024-08-06 04:44:31,065][52662] Sum rewards: 58.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.204', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.102', 'weapon4': '0.132', 'AMMO3': '0.184', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '3.074', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '48.000'} [2024-08-06 04:44:31,474][52663] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.081, -27.0), ('weapon5', 0.002)] [2024-08-06 04:44:31,650][52668] DAMAGECOUNT value on done: 555053.0 [2024-08-06 04:44:31,652][52668] Sum rewards: 72.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.828', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.079', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:31,744][52664] DAMAGECOUNT value on done: 579750.0 [2024-08-06 04:44:31,745][52664] Sum rewards: 80.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.555', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.834', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '64.000'} [2024-08-06 04:44:32,025][52671] DAMAGECOUNT value on done: 558222.0 [2024-08-06 04:44:32,028][52671] Sum rewards: 73.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.070', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.676', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '60.000'} [2024-08-06 04:44:32,528][52658] DAMAGECOUNT value on done: 567796.0 [2024-08-06 04:44:32,529][52658] Sum rewards: 78.936, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.108', 'weapon5': '0.166', 'AMMO3': '0.243', 'AMMO4': '0.254', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '66.000'} [2024-08-06 04:44:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 457015296. Throughput: 0: 4368.9. Samples: 114252600. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:44:32,794][52567] Avg episode reward: [(0, '71.630')] [2024-08-06 04:44:33,289][52669] DAMAGECOUNT value on done: 559457.0 [2024-08-06 04:44:33,292][52669] Sum rewards: 66.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.074', 'weapon4': '0.112', 'AMMO4': '0.160', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.762', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.500'} [2024-08-06 04:44:34,209][52662] DAMAGECOUNT value on done: 559931.0 [2024-08-06 04:44:34,211][52662] Sum rewards: 77.851, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.349', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon2': '0.696', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:34,391][52650] Updated weights for policy 0, policy_version 55791 (0.0026) [2024-08-06 04:44:34,399][52664] DAMAGECOUNT value on done: 578350.0 [2024-08-06 04:44:34,400][52664] Sum rewards: 70.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.899', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.117', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:34,917][52668] DAMAGECOUNT value on done: 545620.0 [2024-08-06 04:44:34,918][52668] Sum rewards: 68.307, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.600', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon2': '0.222', 'AMMO3': '0.242', 'weapon4': '0.242', 'AMMO4': '0.280', 'weapon5': '0.364', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:35,162][52658] DAMAGECOUNT value on done: 552228.0 [2024-08-06 04:44:35,162][52671] DAMAGECOUNT value on done: 554779.0 [2024-08-06 04:44:35,165][52671] Sum rewards: 78.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.072', 'AMMO3': '0.177', 'weapon5': '0.180', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '63.000'} [2024-08-06 04:44:35,165][52658] Sum rewards: 76.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.097', 'weapon5': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '63.000'} [2024-08-06 04:44:35,842][52795] DAMAGECOUNT value on done: 513721.0 [2024-08-06 04:44:35,850][52795] Sum rewards: 69.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.525', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.043', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.216', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.464', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '60.000'} [2024-08-06 04:44:36,431][52669] DAMAGECOUNT value on done: 564895.0 [2024-08-06 04:44:36,432][52669] Sum rewards: 76.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.375', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:36,571][52658] Large shaping reward 2.545 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 04:44:36,912][52664] DAMAGECOUNT value on done: 582286.0 [2024-08-06 04:44:36,914][52664] Sum rewards: 58.598, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.934', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO3': '0.229', 'weapon5': '0.242', 'AMMO4': '0.262', 'weapon2': '0.282', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.805', 'FRAGCOUNT': '51.000'} [2024-08-06 04:44:37,160][52662] DAMAGECOUNT value on done: 547391.0 [2024-08-06 04:44:37,160][52662] Sum rewards: 71.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '60.000'} [2024-08-06 04:44:37,291][52666] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:44:37,468][52668] DAMAGECOUNT value on done: 560421.0 [2024-08-06 04:44:37,469][52668] Sum rewards: 75.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.122', 'AMMO4': '0.144', 'AMMO3': '0.191', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:37,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 457097216. Throughput: 0: 4366.0. Samples: 114278960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:44:37,796][52567] Avg episode reward: [(0, '71.494')] [2024-08-06 04:44:37,971][52671] DAMAGECOUNT value on done: 564246.0 [2024-08-06 04:44:37,971][52671] Sum rewards: 75.284, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.090', 'AMMO3': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.276', 'weapon2': '0.620', 'WEAPON3': '0.900', 'weapon3': '2.906', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:38,096][52658] DAMAGECOUNT value on done: 564998.0 [2024-08-06 04:44:38,097][52658] Sum rewards: 69.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.298', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.194', 'AMMO3': '0.205', 'AMMO4': '0.228', 'weapon4': '0.230', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:38,851][52650] Updated weights for policy 0, policy_version 55801 (0.0033) [2024-08-06 04:44:39,055][52795] DAMAGECOUNT value on done: 504866.0 [2024-08-06 04:44:39,056][52795] Sum rewards: 82.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.423', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.116', 'weapon5': '0.116', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '69.000'} [2024-08-06 04:44:39,544][52664] DAMAGECOUNT value on done: 579825.0 [2024-08-06 04:44:39,544][52664] Sum rewards: 61.113, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.724', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.096', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.530', 'WEAPON3': '1.500', 'weapon3': '2.890', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '53.000'} [2024-08-06 04:44:40,197][52662] DAMAGECOUNT value on done: 561251.0 [2024-08-06 04:44:40,198][52662] Sum rewards: 84.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.047', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.144', 'weapon5': '0.160', 'weapon2': '0.180', 'AMMO4': '0.180', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.586', 'FRAGCOUNT': '70.000'} [2024-08-06 04:44:40,492][52671] DAMAGECOUNT value on done: 557272.0 [2024-08-06 04:44:40,494][52671] Sum rewards: 67.624, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.042', 'weapon4': '0.086', 'WEAPON5': '0.100', 'weapon2': '0.162', 'AMMO4': '0.163', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.620', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:40,715][52668] DAMAGECOUNT value on done: 555852.0 [2024-08-06 04:44:40,717][52668] Sum rewards: 55.001, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.833', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.138', 'AMMO4': '0.144', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.650', 'HITCOUNT': '3.040', 'weapon3': '3.198', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '49.000'} [2024-08-06 04:44:40,817][52658] DAMAGECOUNT value on done: 550809.0 [2024-08-06 04:44:40,817][52658] Sum rewards: 82.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.550', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '66.000'} [2024-08-06 04:44:42,248][52795] DAMAGECOUNT value on done: 503085.0 [2024-08-06 04:44:42,248][52795] Sum rewards: 74.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.054', 'AMMO4': '0.108', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '61.000'} [2024-08-06 04:44:42,594][52668] Large shaping reward 2.543 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.492, 164.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:44:42,699][52664] DAMAGECOUNT value on done: 581991.0 [2024-08-06 04:44:42,702][52664] Sum rewards: 85.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.168', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.043', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '71.000'} [2024-08-06 04:44:42,769][52662] DAMAGECOUNT value on done: 550259.0 [2024-08-06 04:44:42,771][52662] Sum rewards: 75.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.308', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.174', 'AMMO3': '0.206', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '61.000'} [2024-08-06 04:44:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 457187328. Throughput: 0: 4364.0. Samples: 114305070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:44:42,794][52567] Avg episode reward: [(0, '71.632')] [2024-08-06 04:44:43,396][52671] DAMAGECOUNT value on done: 543842.0 [2024-08-06 04:44:43,396][52671] Sum rewards: 71.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.188', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:43,432][52650] Updated weights for policy 0, policy_version 55811 (0.0020) [2024-08-06 04:44:43,456][52658] DAMAGECOUNT value on done: 556017.0 [2024-08-06 04:44:43,461][52658] Sum rewards: 81.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.316', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO3': '0.165', 'AMMO4': '0.167', 'weapon4': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '65.000'} [2024-08-06 04:44:43,751][52668] DAMAGECOUNT value on done: 548306.0 [2024-08-06 04:44:43,753][52668] Sum rewards: 69.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.104', 'weapon5': '0.174', 'AMMO3': '0.200', 'AMMO4': '0.215', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:45,336][52795] DAMAGECOUNT value on done: 509547.0 [2024-08-06 04:44:45,338][52795] Sum rewards: 67.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.154', 'AMMO4': '0.180', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '57.500'} [2024-08-06 04:44:45,435][52662] DAMAGECOUNT value on done: 560166.0 [2024-08-06 04:44:45,438][52662] Sum rewards: 75.563, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.046', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.094', 'AMMO4': '0.201', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.350', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '61.000'} [2024-08-06 04:44:45,897][52664] DAMAGECOUNT value on done: 575096.0 [2024-08-06 04:44:45,901][52664] Sum rewards: 83.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.864', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.064', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.344', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.339', 'FRAGCOUNT': '69.000'} [2024-08-06 04:44:46,167][52658] DAMAGECOUNT value on done: 550374.0 [2024-08-06 04:44:46,169][52658] Sum rewards: 59.080, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.052', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.024', 'weapon4': '0.034', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.184', 'weapon2': '0.754', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.040', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '49.000'} [2024-08-06 04:44:46,218][52671] DAMAGECOUNT value on done: 564385.0 [2024-08-06 04:44:46,218][52671] Sum rewards: 66.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.885', 'AMMO5': '0.021', 'AMMO2': '0.071', 'weapon4': '0.120', 'AMMO3': '0.232', 'weapon5': '0.306', 'AMMO4': '0.357', 'weapon2': '0.420', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.870', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:46,844][52668] DAMAGECOUNT value on done: 550971.0 [2024-08-06 04:44:46,845][52668] Sum rewards: 58.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.565', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.088', 'AMMO4': '0.118', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '51.000'} [2024-08-06 04:44:47,294][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:44:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 457277440. Throughput: 0: 4368.0. Samples: 114318290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:44:47,795][52567] Avg episode reward: [(0, '71.550')] [2024-08-06 04:44:47,952][52662] DAMAGECOUNT value on done: 561043.0 [2024-08-06 04:44:47,954][52662] Sum rewards: 67.566, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.168', 'AMMO3': '0.178', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '54.000'} [2024-08-06 04:44:48,296][52650] Updated weights for policy 0, policy_version 55821 (0.0023) [2024-08-06 04:44:48,644][52795] DAMAGECOUNT value on done: 505989.0 [2024-08-06 04:44:48,647][52795] Sum rewards: 80.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.356', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO4': '0.186', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.326', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:49,074][52671] DAMAGECOUNT value on done: 561482.0 [2024-08-06 04:44:49,075][52671] Sum rewards: 59.892, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.166', 'weapon5': '0.220', 'AMMO3': '0.257', 'AMMO4': '0.276', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.824', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '51.500'} [2024-08-06 04:44:49,103][52658] DAMAGECOUNT value on done: 555807.0 [2024-08-06 04:44:49,103][52658] Sum rewards: 71.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.137', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon4': '0.264', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:49,137][52664] DAMAGECOUNT value on done: 568086.0 [2024-08-06 04:44:49,137][52664] Sum rewards: 52.777, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.910', 'ARMOR': '0.012', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.247', 'AMMO4': '0.280', 'weapon5': '0.290', 'weapon2': '0.314', 'WEAPON5': '0.550', 'weapon4': '0.552', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.394', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '47.000'} [2024-08-06 04:44:49,473][52668] DAMAGECOUNT value on done: 558426.0 [2024-08-06 04:44:49,473][52668] Sum rewards: 66.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.432', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.206', 'AMMO3': '0.213', 'AMMO4': '0.227', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '55.000'} [2024-08-06 04:44:50,299][52662] DAMAGECOUNT value on done: 553874.0 [2024-08-06 04:44:50,300][52662] Sum rewards: 67.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.108', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.160', 'weapon5': '0.170', 'AMMO4': '0.225', 'AMMO3': '0.229', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.002', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:50,844][52660] DAMAGECOUNT value on done: 555399.0 [2024-08-06 04:44:50,846][52660] Sum rewards: 59.096, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.514', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon7': '0.052', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.159', 'weapon5': '0.192', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.950', 'WEAPON3': '1.100', 'weapon3': '2.442', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '48.000'} [2024-08-06 04:44:51,468][52664] DAMAGECOUNT value on done: 575646.0 [2024-08-06 04:44:51,470][52664] Sum rewards: 70.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.124', 'AMMO4': '0.151', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '61.000'} [2024-08-06 04:44:51,882][52668] DAMAGECOUNT value on done: 555998.0 [2024-08-06 04:44:51,883][52668] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.644', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.076', 'AMMO4': '0.132', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:51,892][52795] DAMAGECOUNT value on done: 514248.0 [2024-08-06 04:44:51,893][52795] Sum rewards: 74.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.208', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.110', 'weapon5': '0.136', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:52,248][52671] DAMAGECOUNT value on done: 560459.0 [2024-08-06 04:44:52,249][52671] Sum rewards: 51.959, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.146', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.180', 'WEAPON7': '0.200', 'weapon7': '0.230', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.454', 'WEAPON3': '1.100', 'HITCOUNT': '2.360', 'weapon3': '2.502', 'DAMAGECOUNT': '12.582', 'FRAGCOUNT': '43.000'} [2024-08-06 04:44:52,294][52658] DAMAGECOUNT value on done: 543997.0 [2024-08-06 04:44:52,294][52658] Sum rewards: 65.472, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.538', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.000'} [2024-08-06 04:44:52,504][52659] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:44:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 457359360. Throughput: 0: 4362.0. Samples: 114344620. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:44:52,802][52567] Avg episode reward: [(0, '70.950')] [2024-08-06 04:44:52,836][52650] Updated weights for policy 0, policy_version 55831 (0.0018) [2024-08-06 04:44:53,419][52662] DAMAGECOUNT value on done: 564334.0 [2024-08-06 04:44:53,420][52662] Sum rewards: 71.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.077', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.500'} [2024-08-06 04:44:53,898][52660] DAMAGECOUNT value on done: 545389.0 [2024-08-06 04:44:53,899][52660] Sum rewards: 83.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.318', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.191', 'weapon5': '0.232', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '66.000'} [2024-08-06 04:44:54,196][52664] DAMAGECOUNT value on done: 575166.0 [2024-08-06 04:44:54,196][52664] Sum rewards: 78.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.248', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.350', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '67.000'} [2024-08-06 04:44:54,753][52671] DAMAGECOUNT value on done: 557947.0 [2024-08-06 04:44:54,753][52671] Sum rewards: 67.772, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.169', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.080', 'AMMO4': '0.126', 'weapon5': '0.138', 'WEAPON4': '0.300', 'AMMO3': '0.318', 'WEAPON5': '0.450', 'weapon2': '0.606', 'WEAPON3': '1.950', 'weapon3': '2.836', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '62.000'} [2024-08-06 04:44:54,957][52795] DAMAGECOUNT value on done: 519794.0 [2024-08-06 04:44:54,957][52795] Sum rewards: 84.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.737', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.149', 'weapon4': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '68.000'} [2024-08-06 04:44:55,109][52668] DAMAGECOUNT value on done: 546650.0 [2024-08-06 04:44:55,110][52668] Sum rewards: 67.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.186', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.110', 'AMMO3': '0.210', 'weapon5': '0.218', 'AMMO4': '0.230', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '55.000'} [2024-08-06 04:44:55,216][52658] DAMAGECOUNT value on done: 559801.0 [2024-08-06 04:44:55,216][52658] Sum rewards: 68.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.173', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO3': '0.165', 'weapon2': '0.354', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.504', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '56.000'} [2024-08-06 04:44:55,987][52662] DAMAGECOUNT value on done: 550523.0 [2024-08-06 04:44:55,989][52662] Sum rewards: 69.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.332', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.142', 'AMMO4': '0.162', 'weapon5': '0.184', 'weapon2': '0.244', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.164', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '60.000'} [2024-08-06 04:44:56,630][52664] DAMAGECOUNT value on done: 572264.0 [2024-08-06 04:44:56,630][52664] Sum rewards: 77.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.685', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.096', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '64.500'} [2024-08-06 04:44:56,785][52660] DAMAGECOUNT value on done: 557116.0 [2024-08-06 04:44:56,787][52660] Sum rewards: 64.025, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.096', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.154', 'weapon5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.247', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '55.000'} [2024-08-06 04:44:57,338][52671] DAMAGECOUNT value on done: 555100.0 [2024-08-06 04:44:57,338][52671] Sum rewards: 71.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.088', 'weapon2': '0.200', 'AMMO3': '0.216', 'weapon5': '0.224', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:57,666][52650] Updated weights for policy 0, policy_version 55841 (0.0018) [2024-08-06 04:44:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 457449472. Throughput: 0: 4366.2. Samples: 114370770. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:44:57,794][52567] Avg episode reward: [(0, '71.381')] [2024-08-06 04:44:57,865][52668] DAMAGECOUNT value on done: 540348.0 [2024-08-06 04:44:57,866][52668] Sum rewards: 65.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.088', 'AMMO3': '0.214', 'weapon5': '0.234', 'AMMO4': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '52.500'} [2024-08-06 04:44:58,148][52795] DAMAGECOUNT value on done: 514408.0 [2024-08-06 04:44:58,149][52795] Sum rewards: 71.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.974', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.112', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.000'} [2024-08-06 04:44:58,312][52658] DAMAGECOUNT value on done: 551126.0 [2024-08-06 04:44:58,312][52658] Sum rewards: 64.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.108', 'weapon4': '0.108', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '53.000'} [2024-08-06 04:44:58,586][52662] DAMAGECOUNT value on done: 556647.0 [2024-08-06 04:44:58,587][52662] Sum rewards: 86.120, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '69.000'} [2024-08-06 04:44:59,545][52660] DAMAGECOUNT value on done: 562318.0 [2024-08-06 04:44:59,545][52660] Sum rewards: 71.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.841', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.162', 'weapon2': '0.196', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '59.000'} [2024-08-06 04:45:00,638][52668] DAMAGECOUNT value on done: 543263.0 [2024-08-06 04:45:00,638][52668] Sum rewards: 69.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.013', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.130', 'AMMO3': '0.240', 'AMMO4': '0.241', 'weapon2': '0.300', 'weapon4': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:01,320][52795] DAMAGECOUNT value on done: 507115.0 [2024-08-06 04:45:01,320][52795] Sum rewards: 83.071, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.840', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.106', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '67.000'} [2024-08-06 04:45:01,365][52658] DAMAGECOUNT value on done: 552290.0 [2024-08-06 04:45:01,368][52658] Sum rewards: 63.964, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.468', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.092', 'AMMO4': '0.136', 'weapon5': '0.172', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '53.000'} [2024-08-06 04:45:01,397][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:45:01,630][52662] DAMAGECOUNT value on done: 552629.0 [2024-08-06 04:45:01,630][52662] Sum rewards: 81.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.175', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.036', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.233', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '66.000'} [2024-08-06 04:45:02,022][52650] Updated weights for policy 0, policy_version 55851 (0.0022) [2024-08-06 04:45:02,342][52669] Large shaping reward 2.524 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.108, -36.0), ('weapon5', 0.002)] [2024-08-06 04:45:02,394][52660] DAMAGECOUNT value on done: 553561.0 [2024-08-06 04:45:02,394][52660] Sum rewards: 80.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.144', 'weapon5': '0.176', 'AMMO4': '0.198', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '65.000'} [2024-08-06 04:45:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 457531392. Throughput: 0: 4364.0. Samples: 114383970. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:45:02,795][52567] Avg episode reward: [(0, '71.535')] [2024-08-06 04:45:02,924][52820] DAMAGECOUNT value on done: 509982.0 [2024-08-06 04:45:02,926][52820] Sum rewards: 67.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.199', 'weapon4': '0.244', 'AMMO4': '0.263', 'weapon5': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.538', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.604', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '58.000'} [2024-08-06 04:45:03,805][52668] DAMAGECOUNT value on done: 545193.0 [2024-08-06 04:45:03,806][52668] Sum rewards: 76.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.609', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.172', 'weapon4': '0.180', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '62.000'} [2024-08-06 04:45:04,430][52795] DAMAGECOUNT value on done: 516634.0 [2024-08-06 04:45:04,430][52795] Sum rewards: 76.339, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.149', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'HEALTH': '0.230', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '65.000'} [2024-08-06 04:45:04,453][52662] DAMAGECOUNT value on done: 560577.0 [2024-08-06 04:45:04,454][52662] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.434', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.168', 'AMMO3': '0.193', 'weapon5': '0.194', 'AMMO4': '0.196', 'weapon2': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.118', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '50.000'} [2024-08-06 04:45:04,487][52658] DAMAGECOUNT value on done: 559654.0 [2024-08-06 04:45:04,487][52658] Sum rewards: 82.133, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.024', 'AMMO4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '68.000'} [2024-08-06 04:45:05,607][52660] DAMAGECOUNT value on done: 550088.0 [2024-08-06 04:45:05,607][52660] Sum rewards: 72.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.965', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.196', 'AMMO3': '0.206', 'weapon2': '0.284', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:06,037][52820] DAMAGECOUNT value on done: 513423.0 [2024-08-06 04:45:06,038][52820] Sum rewards: 83.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.651', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.190', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '68.000'} [2024-08-06 04:45:06,593][52668] DAMAGECOUNT value on done: 551650.0 [2024-08-06 04:45:06,593][52668] Sum rewards: 43.822, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO2': '0.021', 'weapon7': '0.072', 'AMMO4': '0.103', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.142', 'AMMO3': '0.147', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon4': '1.186', 'HITCOUNT': '2.080', 'weapon3': '2.436', 'DAMAGECOUNT': '10.365', 'FRAGCOUNT': '37.000'} [2024-08-06 04:45:06,870][52614] Signal inference workers to stop experience collection... (10150 times) [2024-08-06 04:45:06,870][52614] Signal inference workers to resume experience collection... (10150 times) [2024-08-06 04:45:06,967][52650] InferenceWorker_p0-w0: stopping experience collection (10150 times) [2024-08-06 04:45:06,972][52650] InferenceWorker_p0-w0: resuming experience collection (10150 times) [2024-08-06 04:45:06,974][52650] Updated weights for policy 0, policy_version 55861 (0.0012) [2024-08-06 04:45:07,365][52662] DAMAGECOUNT value on done: 554120.0 [2024-08-06 04:45:07,367][52662] Sum rewards: 67.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.019', 'AMMO2': '0.067', 'weapon4': '0.184', 'AMMO3': '0.228', 'weapon5': '0.304', 'AMMO4': '0.336', 'weapon2': '0.368', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.820', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '57.000'} [2024-08-06 04:45:07,526][52795] DAMAGECOUNT value on done: 513394.0 [2024-08-06 04:45:07,526][52795] Sum rewards: 71.046, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'weapon4': '0.010', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.091', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.412', 'WEAPON3': '0.950', 'weapon3': '3.088', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '56.000'} [2024-08-06 04:45:07,780][52662] Large shaping reward 3.201 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.15, 50.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:45:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 457629696. Throughput: 0: 4366.5. Samples: 114410370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:45:07,794][52567] Avg episode reward: [(0, '71.422')] [2024-08-06 04:45:08,238][52660] DAMAGECOUNT value on done: 548500.0 [2024-08-06 04:45:08,239][52660] Sum rewards: 74.157, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon5': '0.214', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.902', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '57.000'} [2024-08-06 04:45:08,943][52665] DAMAGECOUNT value on done: 540625.0 [2024-08-06 04:45:08,944][52665] Sum rewards: 65.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.976', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.078', 'AMMO3': '0.178', 'AMMO4': '0.193', 'weapon5': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '53.500'} [2024-08-06 04:45:09,252][52820] DAMAGECOUNT value on done: 517065.0 [2024-08-06 04:45:09,257][52820] Sum rewards: 83.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.805', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '70.000'} [2024-08-06 04:45:09,260][52668] DAMAGECOUNT value on done: 556142.0 [2024-08-06 04:45:09,260][52668] Sum rewards: 78.896, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.585', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'AMMO4': '0.081', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.528', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '67.000'} [2024-08-06 04:45:10,085][52662] DAMAGECOUNT value on done: 565666.0 [2024-08-06 04:45:10,087][52662] Sum rewards: 93.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon2': '0.158', 'AMMO3': '0.206', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.492', 'FRAGCOUNT': '76.000'} [2024-08-06 04:45:10,609][52795] DAMAGECOUNT value on done: 507286.0 [2024-08-06 04:45:10,609][52795] Sum rewards: 67.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.065', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.128', 'weapon2': '0.208', 'weapon5': '0.250', 'AMMO4': '0.268', 'AMMO3': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.134', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 04:45:10,630][52660] DAMAGECOUNT value on done: 559792.0 [2024-08-06 04:45:10,631][52660] Sum rewards: 82.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.362', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon2': '0.150', 'AMMO3': '0.188', 'WEAPON3': '1.200', 'weapon3': '3.596', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '68.000'} [2024-08-06 04:45:11,533][52668] DAMAGECOUNT value on done: 554554.0 [2024-08-06 04:45:11,533][52668] Sum rewards: 63.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.636', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.106', 'AMMO3': '0.168', 'AMMO4': '0.170', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '2.880', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '52.000'} [2024-08-06 04:45:11,560][52665] DAMAGECOUNT value on done: 558068.0 [2024-08-06 04:45:11,560][52665] Sum rewards: 79.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.768', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO3': '0.217', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '66.000'} [2024-08-06 04:45:11,825][52650] Updated weights for policy 0, policy_version 55871 (0.0014) [2024-08-06 04:45:12,578][52820] DAMAGECOUNT value on done: 506865.0 [2024-08-06 04:45:12,582][52820] Sum rewards: 76.454, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '61.000'} [2024-08-06 04:45:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 457711616. Throughput: 0: 4367.3. Samples: 114436470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:45:12,795][52567] Avg episode reward: [(0, '72.157')] [2024-08-06 04:45:12,880][52662] DAMAGECOUNT value on done: 559135.0 [2024-08-06 04:45:12,881][52662] Sum rewards: 76.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.112', 'weapon5': '0.164', 'AMMO4': '0.206', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2024-08-06 04:45:13,135][52660] DAMAGECOUNT value on done: 552345.0 [2024-08-06 04:45:13,136][52660] Sum rewards: 68.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.732', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.080', 'weapon4': '0.152', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.168', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '58.000'} [2024-08-06 04:45:13,756][52795] DAMAGECOUNT value on done: 507553.0 [2024-08-06 04:45:13,756][52795] Sum rewards: 76.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.395', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.072', 'AMMO4': '0.142', 'weapon5': '0.212', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '64.000'} [2024-08-06 04:45:14,001][52668] DAMAGECOUNT value on done: 558061.0 [2024-08-06 04:45:14,002][52668] Sum rewards: 79.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '67.000'} [2024-08-06 04:45:14,351][52665] DAMAGECOUNT value on done: 552186.0 [2024-08-06 04:45:14,352][52665] Sum rewards: 77.163, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.108', 'AMMO3': '0.188', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '62.000'} [2024-08-06 04:45:15,724][52660] DAMAGECOUNT value on done: 552213.0 [2024-08-06 04:45:15,726][52660] Sum rewards: 70.169, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.124', 'weapon5': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.204', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:15,897][52820] DAMAGECOUNT value on done: 517200.0 [2024-08-06 04:45:15,897][52820] Sum rewards: 69.841, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.888', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.128', 'AMMO4': '0.204', 'weapon2': '0.206', 'AMMO3': '0.257', 'weapon4': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '61.000'} [2024-08-06 04:45:16,003][52650] Updated weights for policy 0, policy_version 55881 (0.0012) [2024-08-06 04:45:16,065][52662] DAMAGECOUNT value on done: 550847.0 [2024-08-06 04:45:16,066][52662] Sum rewards: 78.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.743', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'weapon2': '0.282', 'WEAPON3': '1.100', 'weapon3': '3.486', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '64.000'} [2024-08-06 04:45:16,845][52668] DAMAGECOUNT value on done: 555428.0 [2024-08-06 04:45:16,845][52668] Sum rewards: 69.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.126', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.500'} [2024-08-06 04:45:16,950][52795] DAMAGECOUNT value on done: 513811.0 [2024-08-06 04:45:16,953][52795] Sum rewards: 65.853, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.713', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.104', 'AMMO3': '0.186', 'AMMO4': '0.226', 'weapon5': '0.230', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '53.000'} [2024-08-06 04:45:17,307][52665] DAMAGECOUNT value on done: 546549.0 [2024-08-06 04:45:17,309][52665] Sum rewards: 68.879, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.945', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.139', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.408', 'ARMOR': '0.491', 'WEAPON3': '1.000', 'weapon3': '3.050', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2024-08-06 04:45:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 457793536. Throughput: 0: 4376.4. Samples: 114449540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:45:17,794][52567] Avg episode reward: [(0, '72.205')] [2024-08-06 04:45:18,604][52660] DAMAGECOUNT value on done: 560711.0 [2024-08-06 04:45:18,605][52660] Sum rewards: 57.145, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.600', 'AMMO5': '0.024', 'AMMO2': '0.049', 'weapon5': '0.176', 'AMMO4': '0.247', 'weapon4': '0.262', 'AMMO3': '0.295', 'weapon2': '0.410', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.802', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '50.000'} [2024-08-06 04:45:19,032][52662] DAMAGECOUNT value on done: 555448.0 [2024-08-06 04:45:19,032][52662] Sum rewards: 70.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.031', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO4': '0.162', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 04:45:19,068][52820] DAMAGECOUNT value on done: 508415.0 [2024-08-06 04:45:19,068][52820] Sum rewards: 75.787, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.856', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.042', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.256', 'AMMO3': '0.259', 'WEAPON3': '1.450', 'weapon3': '3.418', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '65.000'} [2024-08-06 04:45:20,034][52795] DAMAGECOUNT value on done: 506253.0 [2024-08-06 04:45:20,035][52795] Sum rewards: 83.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.380', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.134', 'AMMO4': '0.154', 'weapon5': '0.166', 'AMMO3': '0.201', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '68.000'} [2024-08-06 04:45:20,363][52665] DAMAGECOUNT value on done: 539370.0 [2024-08-06 04:45:20,365][52665] Sum rewards: 74.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.156', 'AMMO3': '0.185', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.222', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:21,013][52650] Updated weights for policy 0, policy_version 55891 (0.0031) [2024-08-06 04:45:21,066][52660] DAMAGECOUNT value on done: 547999.0 [2024-08-06 04:45:21,067][52660] Sum rewards: 74.440, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.360', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.082', 'AMMO3': '0.191', 'weapon5': '0.220', 'AMMO4': '0.226', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '61.000'} [2024-08-06 04:45:21,279][52659] DAMAGECOUNT value on done: 560449.0 [2024-08-06 04:45:21,280][52659] Sum rewards: 64.544, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.129', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.112', 'weapon5': '0.178', 'AMMO4': '0.211', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '56.000'} [2024-08-06 04:45:21,679][52662] DAMAGECOUNT value on done: 549273.0 [2024-08-06 04:45:21,681][52662] Sum rewards: 68.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '57.000'} [2024-08-06 04:45:22,241][52820] DAMAGECOUNT value on done: 513255.0 [2024-08-06 04:45:22,242][52820] Sum rewards: 69.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.032', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '58.000'} [2024-08-06 04:45:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 457891840. Throughput: 0: 4376.9. Samples: 114475920. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:45:22,794][52567] Avg episode reward: [(0, '71.927')] [2024-08-06 04:45:23,143][52795] DAMAGECOUNT value on done: 520850.0 [2024-08-06 04:45:23,145][52795] Sum rewards: 75.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.446', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.088', 'weapon4': '0.102', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '63.000'} [2024-08-06 04:45:23,404][52665] DAMAGECOUNT value on done: 545198.0 [2024-08-06 04:45:23,408][52665] Sum rewards: 72.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.221', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO4': '0.211', 'AMMO3': '0.234', 'weapon2': '0.234', 'weapon4': '0.248', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '62.000'} [2024-08-06 04:45:24,035][52660] DAMAGECOUNT value on done: 550542.0 [2024-08-06 04:45:24,038][52660] Sum rewards: 61.311, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.600', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.062', 'weapon5': '0.170', 'AMMO4': '0.250', 'weapon2': '0.256', 'AMMO3': '0.293', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '3.200', 'weapon3': '3.232', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '55.000'} [2024-08-06 04:45:24,132][52659] DAMAGECOUNT value on done: 553778.0 [2024-08-06 04:45:24,132][52659] Sum rewards: 65.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.108', 'weapon2': '0.180', 'AMMO3': '0.208', 'weapon5': '0.236', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '3.238', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '54.000'} [2024-08-06 04:45:25,390][52820] DAMAGECOUNT value on done: 514971.0 [2024-08-06 04:45:25,391][52820] Sum rewards: 75.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.926', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.126', 'AMMO3': '0.191', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.342', 'weapon4': '0.414', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '61.000'} [2024-08-06 04:45:25,653][52650] Updated weights for policy 0, policy_version 55901 (0.0017) [2024-08-06 04:45:26,181][52665] DAMAGECOUNT value on done: 549318.0 [2024-08-06 04:45:26,182][52665] Sum rewards: 65.145, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.980', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.084', 'AMMO4': '0.125', 'weapon2': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.318', 'WEAPON3': '1.900', 'HITCOUNT': '3.260', 'weapon3': '3.442', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '59.000'} [2024-08-06 04:45:26,335][52660] DAMAGECOUNT value on done: 561784.0 [2024-08-06 04:45:26,337][52660] Sum rewards: 75.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.892', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.128', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '65.000'} [2024-08-06 04:45:26,593][52795] DAMAGECOUNT value on done: 512767.0 [2024-08-06 04:45:26,594][52795] Sum rewards: 61.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.605', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon4': '0.180', 'AMMO3': '0.184', 'AMMO4': '0.256', 'weapon5': '0.318', 'weapon2': '0.446', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.740', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '50.500'} [2024-08-06 04:45:27,258][52659] DAMAGECOUNT value on done: 560101.0 [2024-08-06 04:45:27,258][52659] Sum rewards: 65.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.854', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.160', 'weapon4': '0.180', 'AMMO4': '0.191', 'weapon2': '0.260', 'AMMO3': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.124', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '56.000'} [2024-08-06 04:45:27,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 457981952. Throughput: 0: 4376.9. Samples: 114502030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:45:27,802][52567] Avg episode reward: [(0, '71.548')] [2024-08-06 04:45:28,605][52820] DAMAGECOUNT value on done: 510645.0 [2024-08-06 04:45:28,606][52820] Sum rewards: 60.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.092', 'AMMO4': '0.154', 'AMMO3': '0.176', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.100', 'HITCOUNT': '2.760', 'weapon3': '3.140', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '50.000'} [2024-08-06 04:45:29,154][52665] DAMAGECOUNT value on done: 548406.0 [2024-08-06 04:45:29,154][52665] Sum rewards: 73.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.749', 'AMMO5': '0.025', 'AMMO2': '0.051', 'weapon4': '0.086', 'weapon5': '0.112', 'AMMO3': '0.141', 'AMMO4': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.694', 'WEAPON3': '0.950', 'weapon3': '2.902', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '59.000'} [2024-08-06 04:45:29,392][52660] DAMAGECOUNT value on done: 567132.0 [2024-08-06 04:45:29,394][52660] Sum rewards: 68.509, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.692', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'weapon2': '0.192', 'AMMO3': '0.256', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '59.000'} [2024-08-06 04:45:29,709][52795] DAMAGECOUNT value on done: 507048.0 [2024-08-06 04:45:29,710][52795] Sum rewards: 75.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.267', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.179', 'weapon4': '0.184', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:30,079][52659] DAMAGECOUNT value on done: 555371.0 [2024-08-06 04:45:30,080][52659] Sum rewards: 57.239, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.290', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.196', 'weapon5': '0.202', 'AMMO4': '0.231', 'AMMO3': '0.285', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '2.962', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '50.000'} [2024-08-06 04:45:30,496][52650] Updated weights for policy 0, policy_version 55911 (0.0020) [2024-08-06 04:45:31,134][52794] DAMAGECOUNT value on done: 558433.0 [2024-08-06 04:45:31,135][52794] Sum rewards: 67.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.134', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '57.000'} [2024-08-06 04:45:31,694][52820] DAMAGECOUNT value on done: 521225.0 [2024-08-06 04:45:31,695][52820] Sum rewards: 74.797, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.266', 'weapon2': '0.436', 'WEAPON3': '1.650', 'weapon3': '3.264', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '65.000'} [2024-08-06 04:45:32,232][52665] DAMAGECOUNT value on done: 555082.0 [2024-08-06 04:45:32,234][52665] Sum rewards: 75.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.369', 'AMMO5': '0.024', 'AMMO2': '0.048', 'weapon2': '0.182', 'AMMO3': '0.184', 'AMMO4': '0.240', 'weapon5': '0.306', 'WEAPON5': '0.450', 'weapon4': '0.526', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.646', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:32,574][52660] DAMAGECOUNT value on done: 549879.0 [2024-08-06 04:45:32,575][52660] Sum rewards: 61.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.115', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.059', 'weapon4': '0.116', 'AMMO3': '0.232', 'AMMO4': '0.297', 'weapon5': '0.342', 'weapon2': '0.598', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.634', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '51.000'} [2024-08-06 04:45:32,747][52659] DAMAGECOUNT value on done: 552188.0 [2024-08-06 04:45:32,748][52659] Sum rewards: 78.104, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.104', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.147', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'weapon5': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '64.000'} [2024-08-06 04:45:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 458063872. Throughput: 0: 4380.5. Samples: 114515410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:45:32,794][52567] Avg episode reward: [(0, '71.088')] [2024-08-06 04:45:32,893][52795] DAMAGECOUNT value on done: 513538.0 [2024-08-06 04:45:32,894][52795] Sum rewards: 80.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.196', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.273', 'weapon2': '0.352', 'WEAPON3': '1.750', 'weapon3': '3.288', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '69.000'} [2024-08-06 04:45:34,274][52794] DAMAGECOUNT value on done: 563050.0 [2024-08-06 04:45:34,275][52794] Sum rewards: 74.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.050', 'AMMO4': '0.057', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.512', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 04:45:34,772][52820] DAMAGECOUNT value on done: 509230.0 [2024-08-06 04:45:34,773][52820] Sum rewards: 70.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.070', 'weapon5': '0.228', 'AMMO4': '0.231', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '58.000'} [2024-08-06 04:45:35,039][52650] Updated weights for policy 0, policy_version 55921 (0.0013) [2024-08-06 04:45:35,437][52665] DAMAGECOUNT value on done: 549254.0 [2024-08-06 04:45:35,439][52665] Sum rewards: 65.551, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.440', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.120', 'AMMO4': '0.221', 'weapon5': '0.242', 'weapon2': '0.246', 'AMMO3': '0.281', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.074', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '57.000'} [2024-08-06 04:45:35,540][52660] DAMAGECOUNT value on done: 557861.0 [2024-08-06 04:45:35,540][52660] Sum rewards: 73.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.074', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.251', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '63.000'} [2024-08-06 04:45:35,684][52659] DAMAGECOUNT value on done: 555258.0 [2024-08-06 04:45:35,684][52659] Sum rewards: 65.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.385', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.144', 'weapon5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '53.000'} [2024-08-06 04:45:36,091][52795] DAMAGECOUNT value on done: 518121.0 [2024-08-06 04:45:36,091][52795] Sum rewards: 69.778, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.783', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.086', 'weapon4': '0.124', 'AMMO4': '0.156', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '56.000'} [2024-08-06 04:45:36,460][52795] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:45:36,771][52794] DAMAGECOUNT value on done: 561619.0 [2024-08-06 04:45:36,774][52794] Sum rewards: 78.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.716', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.040', 'AMMO4': '0.105', 'weapon5': '0.136', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '66.000'} [2024-08-06 04:45:37,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 458153984. Throughput: 0: 4371.3. Samples: 114541330. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:45:37,795][52567] Avg episode reward: [(0, '71.401')] [2024-08-06 04:45:38,023][52820] DAMAGECOUNT value on done: 515810.0 [2024-08-06 04:45:38,023][52820] Sum rewards: 77.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.505', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.172', 'AMMO4': '0.205', 'weapon5': '0.234', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.698', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '63.000'} [2024-08-06 04:45:38,512][52659] DAMAGECOUNT value on done: 556144.0 [2024-08-06 04:45:38,514][52659] Sum rewards: 74.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.271', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.096', 'weapon2': '0.168', 'weapon5': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.340', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '61.000'} [2024-08-06 04:45:38,593][52665] DAMAGECOUNT value on done: 559431.0 [2024-08-06 04:45:38,595][52665] Sum rewards: 64.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.331', 'AMMO5': '0.024', 'AMMO2': '0.062', 'AMMO3': '0.127', 'weapon4': '0.140', 'weapon5': '0.304', 'AMMO4': '0.312', 'weapon2': '0.476', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.750', 'HITCOUNT': '2.760', 'weapon3': '2.784', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '50.000'} [2024-08-06 04:45:38,616][52660] DAMAGECOUNT value on done: 552256.0 [2024-08-06 04:45:38,617][52660] Sum rewards: 71.802, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.475', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.120', 'weapon5': '0.176', 'AMMO4': '0.194', 'weapon2': '0.226', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '61.500'} [2024-08-06 04:45:39,714][52650] Updated weights for policy 0, policy_version 55931 (0.0036) [2024-08-06 04:45:39,787][52794] DAMAGECOUNT value on done: 552877.0 [2024-08-06 04:45:39,788][52794] Sum rewards: 74.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.076', 'weapon5': '0.176', 'AMMO3': '0.199', 'AMMO4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:41,111][52820] DAMAGECOUNT value on done: 523006.0 [2024-08-06 04:45:41,112][52820] Sum rewards: 76.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.636', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.128', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '63.000'} [2024-08-06 04:45:41,482][52665] DAMAGECOUNT value on done: 554427.0 [2024-08-06 04:45:41,483][52665] Sum rewards: 77.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.900', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.042', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.466', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '64.000'} [2024-08-06 04:45:41,579][52659] DAMAGECOUNT value on done: 552765.0 [2024-08-06 04:45:41,580][52659] Sum rewards: 72.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.702', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.079', 'weapon4': '0.226', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '62.000'} [2024-08-06 04:45:41,615][52660] DAMAGECOUNT value on done: 553327.0 [2024-08-06 04:45:41,616][52660] Sum rewards: 65.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.219', 'AMMO5': '0.028', 'AMMO2': '0.078', 'AMMO3': '0.196', 'weapon4': '0.326', 'weapon2': '0.342', 'weapon5': '0.364', 'AMMO4': '0.390', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.468', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '55.500'} [2024-08-06 04:45:41,912][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:45:42,163][52794] DAMAGECOUNT value on done: 552687.0 [2024-08-06 04:45:42,163][52794] Sum rewards: 80.593, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.478', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon4': '0.112', 'AMMO4': '0.229', 'AMMO3': '0.233', 'weapon5': '0.238', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '69.000'} [2024-08-06 04:45:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 458235904. Throughput: 0: 4374.7. Samples: 114567630. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:45:42,794][52567] Avg episode reward: [(0, '71.953')] [2024-08-06 04:45:43,429][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:45:44,201][52659] DAMAGECOUNT value on done: 559234.0 [2024-08-06 04:45:44,202][52659] Sum rewards: 64.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.401', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.080', 'weapon5': '0.196', 'AMMO4': '0.226', 'AMMO3': '0.274', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '3.120', 'weapon3': '3.172', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '56.000'} [2024-08-06 04:45:44,306][52650] Updated weights for policy 0, policy_version 55941 (0.0012) [2024-08-06 04:45:44,369][52820] DAMAGECOUNT value on done: 517609.0 [2024-08-06 04:45:44,370][52820] Sum rewards: 68.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.148', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon4': '0.176', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.212', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '59.000'} [2024-08-06 04:45:44,403][52665] DAMAGECOUNT value on done: 550149.0 [2024-08-06 04:45:44,404][52665] Sum rewards: 70.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.166', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.038', 'AMMO4': '0.055', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.922', 'WEAPON3': '1.450', 'weapon3': '2.760', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:44,656][52660] DAMAGECOUNT value on done: 545165.0 [2024-08-06 04:45:44,659][52660] Sum rewards: 74.804, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.714', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.080', 'weapon4': '0.106', 'AMMO3': '0.262', 'AMMO4': '0.278', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.144', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '65.000'} [2024-08-06 04:45:44,809][52794] DAMAGECOUNT value on done: 554358.0 [2024-08-06 04:45:44,809][52794] Sum rewards: 77.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.216', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.152', 'AMMO4': '0.175', 'weapon5': '0.188', 'AMMO3': '0.192', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '62.000'} [2024-08-06 04:45:46,825][52659] DAMAGECOUNT value on done: 562096.0 [2024-08-06 04:45:46,827][52659] Sum rewards: 64.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.722', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.167', 'weapon5': '0.246', 'AMMO4': '0.283', 'weapon2': '0.376', 'WEAPON5': '0.500', 'weapon4': '0.580', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.512', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '52.000'} [2024-08-06 04:45:47,266][52665] DAMAGECOUNT value on done: 550387.0 [2024-08-06 04:45:47,266][52665] Sum rewards: 71.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.085', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'weapon2': '0.386', 'WEAPON3': '0.850', 'HITCOUNT': '3.200', 'weapon3': '3.364', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '56.000'} [2024-08-06 04:45:47,592][52820] DAMAGECOUNT value on done: 520259.0 [2024-08-06 04:45:47,592][52820] Sum rewards: 72.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.136', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.414', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:47,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 458326016. Throughput: 0: 4376.5. Samples: 114580910. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:45:47,794][52567] Avg episode reward: [(0, '71.876')] [2024-08-06 04:45:47,807][52794] DAMAGECOUNT value on done: 561919.0 [2024-08-06 04:45:47,809][52794] Sum rewards: 66.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.979', 'AMMO5': '0.015', 'AMMO2': '0.063', 'AMMO3': '0.230', 'weapon5': '0.238', 'weapon4': '0.244', 'AMMO4': '0.315', 'weapon2': '0.338', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 04:45:48,976][52650] Updated weights for policy 0, policy_version 55951 (0.0028) [2024-08-06 04:45:49,668][52659] DAMAGECOUNT value on done: 552014.0 [2024-08-06 04:45:49,668][52659] Sum rewards: 60.789, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.250', 'AMMO3': '0.282', 'weapon2': '0.366', 'WEAPON3': '1.650', 'weapon3': '2.900', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '53.000'} [2024-08-06 04:45:50,362][52665] DAMAGECOUNT value on done: 547589.0 [2024-08-06 04:45:50,363][52665] Sum rewards: 56.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.885', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.162', 'weapon5': '0.216', 'AMMO3': '0.243', 'AMMO4': '0.254', 'weapon2': '0.278', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '49.000'} [2024-08-06 04:45:50,799][52820] DAMAGECOUNT value on done: 515182.0 [2024-08-06 04:45:50,799][52820] Sum rewards: 71.707, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.188', 'weapon5': '0.196', 'weapon2': '0.238', 'AMMO3': '0.257', 'AMMO4': '0.293', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '63.000'} [2024-08-06 04:45:51,190][52794] DAMAGECOUNT value on done: 548447.0 [2024-08-06 04:45:51,190][52794] Sum rewards: 58.823, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO3': '0.153', 'AMMO4': '0.157', 'weapon4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.816', 'WEAPON3': '1.000', 'weapon3': '2.578', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '45.000'} [2024-08-06 04:45:52,128][52659] DAMAGECOUNT value on done: 557462.0 [2024-08-06 04:45:52,128][52659] Sum rewards: 73.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.705', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO3': '0.188', 'weapon2': '0.280', 'WEAPON3': '1.250', 'HITCOUNT': '3.460', 'weapon3': '3.510', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 458416128. Throughput: 0: 4374.4. Samples: 114607220. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:45:52,794][52567] Avg episode reward: [(0, '71.587')] [2024-08-06 04:45:53,210][52665] DAMAGECOUNT value on done: 545043.0 [2024-08-06 04:45:53,213][52665] Sum rewards: 70.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.280', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.086', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.600', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:53,833][52650] Updated weights for policy 0, policy_version 55961 (0.0012) [2024-08-06 04:45:54,002][52820] DAMAGECOUNT value on done: 517461.0 [2024-08-06 04:45:54,002][52820] Sum rewards: 66.308, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.628', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.281', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '58.000'} [2024-08-06 04:45:54,374][52794] DAMAGECOUNT value on done: 559324.0 [2024-08-06 04:45:54,377][52794] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.285', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.136', 'AMMO3': '0.197', 'weapon4': '0.214', 'weapon2': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '59.000'} [2024-08-06 04:45:54,693][52659] DAMAGECOUNT value on done: 550055.0 [2024-08-06 04:45:54,701][52659] Sum rewards: 68.917, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.665', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.104', 'AMMO3': '0.245', 'AMMO4': '0.251', 'weapon2': '0.316', 'weapon5': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.892', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '59.000'} [2024-08-06 04:45:56,443][52665] DAMAGECOUNT value on done: 547866.0 [2024-08-06 04:45:56,448][52665] Sum rewards: 64.416, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.641', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.080', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.000', 'weapon3': '2.940', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '51.000'} [2024-08-06 04:45:57,103][52794] DAMAGECOUNT value on done: 555080.0 [2024-08-06 04:45:57,105][52794] Sum rewards: 69.759, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.163', 'AMMO4': '0.178', 'weapon2': '0.198', 'weapon5': '0.230', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '56.000'} [2024-08-06 04:45:57,165][52820] DAMAGECOUNT value on done: 526378.0 [2024-08-06 04:45:57,165][52820] Sum rewards: 70.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.148', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '57.000'} [2024-08-06 04:45:57,638][52659] DAMAGECOUNT value on done: 554090.0 [2024-08-06 04:45:57,639][52659] Sum rewards: 72.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.106', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.144', 'weapon5': '0.176', 'AMMO3': '0.204', 'AMMO4': '0.265', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '60.000'} [2024-08-06 04:45:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 458506240. Throughput: 0: 4380.5. Samples: 114633590. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:45:57,796][52567] Avg episode reward: [(0, '71.238')] [2024-08-06 04:45:58,144][52650] Updated weights for policy 0, policy_version 55971 (0.0033) [2024-08-06 04:45:59,550][52665] DAMAGECOUNT value on done: 544136.0 [2024-08-06 04:45:59,551][52665] Sum rewards: 72.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.596', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon4': '0.236', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.324', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '58.000'} [2024-08-06 04:46:00,254][52794] DAMAGECOUNT value on done: 551892.0 [2024-08-06 04:46:00,256][52794] Sum rewards: 78.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.094', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.208', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:00,265][52820] DAMAGECOUNT value on done: 524274.0 [2024-08-06 04:46:00,267][52820] Sum rewards: 66.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.264', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.076', 'weapon5': '0.144', 'AMMO3': '0.218', 'AMMO4': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '55.500'} [2024-08-06 04:46:00,305][52811] DAMAGECOUNT value on done: 531321.0 [2024-08-06 04:46:00,306][52811] Sum rewards: 73.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.506', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.116', 'AMMO4': '0.199', 'AMMO3': '0.265', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '61.500'} [2024-08-06 04:46:00,841][52659] DAMAGECOUNT value on done: 565791.0 [2024-08-06 04:46:00,844][52659] Sum rewards: 77.571, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.127', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.202', 'weapon2': '0.286', 'WEAPON3': '0.950', 'weapon3': '3.218', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:02,732][52665] DAMAGECOUNT value on done: 548171.0 [2024-08-06 04:46:02,740][52665] Sum rewards: 63.127, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.070', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.148', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'weapon2': '0.404', 'WEAPON3': '1.900', 'weapon3': '2.996', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '56.000'} [2024-08-06 04:46:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 458588160. Throughput: 0: 4378.7. Samples: 114646580. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:46:02,794][52567] Avg episode reward: [(0, '71.289')] [2024-08-06 04:46:02,983][52650] Updated weights for policy 0, policy_version 55981 (0.0028) [2024-08-06 04:46:03,145][52794] DAMAGECOUNT value on done: 557103.0 [2024-08-06 04:46:03,145][52794] Sum rewards: 81.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.122', 'weapon5': '0.148', 'AMMO4': '0.164', 'AMMO3': '0.185', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:03,432][52811] DAMAGECOUNT value on done: 515495.0 [2024-08-06 04:46:03,436][52811] Sum rewards: 65.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.758', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.162', 'AMMO3': '0.223', 'weapon2': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '54.000'} [2024-08-06 04:46:03,556][52820] DAMAGECOUNT value on done: 510350.0 [2024-08-06 04:46:03,558][52820] Sum rewards: 77.806, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.322', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon4': '0.058', 'WEAPON4': '0.100', 'weapon2': '0.184', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.536', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '66.000'} [2024-08-06 04:46:03,667][52659] DAMAGECOUNT value on done: 557583.0 [2024-08-06 04:46:03,667][52659] Sum rewards: 63.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.178', 'weapon4': '0.196', 'weapon2': '0.200', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '54.000'} [2024-08-06 04:46:05,580][52665] DAMAGECOUNT value on done: 549371.0 [2024-08-06 04:46:05,581][52665] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.402', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.206', 'weapon5': '0.226', 'AMMO3': '0.271', 'AMMO4': '0.304', 'weapon2': '0.314', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.920', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:05,677][52794] DAMAGECOUNT value on done: 552156.0 [2024-08-06 04:46:05,679][52794] Sum rewards: 60.343, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.002', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.140', 'weapon4': '0.174', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.850', 'weapon3': '3.066', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '54.000'} [2024-08-06 04:46:06,503][52811] DAMAGECOUNT value on done: 513836.0 [2024-08-06 04:46:06,503][52811] Sum rewards: 78.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.215', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.158', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '64.000'} [2024-08-06 04:46:06,862][52659] DAMAGECOUNT value on done: 565531.0 [2024-08-06 04:46:06,864][52659] Sum rewards: 72.134, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.200', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO4': '0.228', 'weapon4': '0.230', 'AMMO3': '0.238', 'weapon2': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:07,581][52650] Updated weights for policy 0, policy_version 55991 (0.0011) [2024-08-06 04:46:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 458678272. Throughput: 0: 4376.6. Samples: 114672870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:46:07,795][52567] Avg episode reward: [(0, '71.187')] [2024-08-06 04:46:08,178][52794] DAMAGECOUNT value on done: 571190.0 [2024-08-06 04:46:08,180][52794] Sum rewards: 71.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.136', 'weapon5': '0.166', 'AMMO3': '0.216', 'AMMO4': '0.255', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '58.500'} [2024-08-06 04:46:09,628][52811] DAMAGECOUNT value on done: 516633.0 [2024-08-06 04:46:09,630][52811] Sum rewards: 60.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.505', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.096', 'AMMO3': '0.218', 'weapon5': '0.248', 'AMMO4': '0.255', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.114', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '51.000'} [2024-08-06 04:46:10,142][52659] DAMAGECOUNT value on done: 555352.0 [2024-08-06 04:46:10,142][52659] Sum rewards: 71.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.827', 'AMMO5': '0.035', 'AMMO2': '0.081', 'AMMO3': '0.127', 'weapon5': '0.278', 'weapon4': '0.312', 'AMMO4': '0.406', 'weapon2': '0.544', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '57.000'} [2024-08-06 04:46:10,359][52663] DAMAGECOUNT value on done: 564857.0 [2024-08-06 04:46:10,361][52663] Sum rewards: 71.399, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.860', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon4': '0.160', 'weapon2': '0.176', 'WEAPON3': '1.100', 'weapon3': '3.358', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '56.000'} [2024-08-06 04:46:10,967][52794] DAMAGECOUNT value on done: 549390.0 [2024-08-06 04:46:10,968][52794] Sum rewards: 76.211, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.557', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.196', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:12,501][52650] Updated weights for policy 0, policy_version 56001 (0.0019) [2024-08-06 04:46:12,784][52811] DAMAGECOUNT value on done: 522390.0 [2024-08-06 04:46:12,793][52811] Sum rewards: 68.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.132', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '59.000'} [2024-08-06 04:46:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 458768384. Throughput: 0: 4379.6. Samples: 114699110. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 04:46:12,794][52567] Avg episode reward: [(0, '70.832')] [2024-08-06 04:46:12,922][52659] DAMAGECOUNT value on done: 560708.0 [2024-08-06 04:46:12,926][52659] Sum rewards: 70.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.251', 'weapon4': '0.280', 'WEAPON4': '0.450', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '60.000'} [2024-08-06 04:46:13,404][52663] DAMAGECOUNT value on done: 556134.0 [2024-08-06 04:46:13,404][52663] Sum rewards: 76.603, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.185', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.169', 'weapon2': '0.196', 'AMMO4': '0.215', 'weapon5': '0.220', 'weapon4': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:13,919][52794] DAMAGECOUNT value on done: 565075.0 [2024-08-06 04:46:13,919][52794] Sum rewards: 86.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.805', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.140', 'weapon5': '0.162', 'weapon4': '0.190', 'AMMO4': '0.247', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.030', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:14,643][52647] DAMAGECOUNT value on done: 588989.0 [2024-08-06 04:46:14,643][52647] Sum rewards: 75.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.106', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.150', 'weapon3': '2.914', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:15,266][52668] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:46:15,783][52811] DAMAGECOUNT value on done: 527700.0 [2024-08-06 04:46:15,785][52811] Sum rewards: 73.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.064', 'weapon5': '0.194', 'AMMO3': '0.199', 'AMMO4': '0.241', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 04:46:15,832][52659] DAMAGECOUNT value on done: 556388.0 [2024-08-06 04:46:15,833][52659] Sum rewards: 75.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'weapon2': '0.224', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.396', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:16,136][52663] DAMAGECOUNT value on done: 546051.0 [2024-08-06 04:46:16,136][52663] Sum rewards: 83.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.469', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.064', 'weapon5': '0.144', 'AMMO3': '0.205', 'AMMO4': '0.250', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '68.000'} [2024-08-06 04:46:16,902][52794] DAMAGECOUNT value on done: 555221.0 [2024-08-06 04:46:16,904][52794] Sum rewards: 75.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.342', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.162', 'AMMO3': '0.251', 'WEAPON3': '1.700', 'weapon3': '3.578', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:17,162][52650] Updated weights for policy 0, policy_version 56011 (0.0015) [2024-08-06 04:46:17,283][52647] DAMAGECOUNT value on done: 586484.0 [2024-08-06 04:46:17,283][52647] Sum rewards: 61.011, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.324', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.152', 'AMMO4': '0.226', 'weapon5': '0.226', 'weapon2': '0.318', 'AMMO3': '0.327', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '2.940', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '56.000'} [2024-08-06 04:46:17,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 458850304. Throughput: 0: 4371.6. Samples: 114712130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:46:17,794][52567] Avg episode reward: [(0, '70.778')] [2024-08-06 04:46:18,885][52811] DAMAGECOUNT value on done: 523210.0 [2024-08-06 04:46:18,892][52811] Sum rewards: 67.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.252', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.422', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '57.000'} [2024-08-06 04:46:19,043][52663] DAMAGECOUNT value on done: 553513.0 [2024-08-06 04:46:19,045][52663] Sum rewards: 72.950, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.134', 'weapon5': '0.190', 'AMMO4': '0.224', 'AMMO3': '0.231', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:20,038][52665] Large shaping reward 2.513 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.462, 154.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:46:20,098][52794] DAMAGECOUNT value on done: 565032.0 [2024-08-06 04:46:20,098][52794] Sum rewards: 69.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.139', 'weapon4': '0.154', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '58.000'} [2024-08-06 04:46:20,256][52647] DAMAGECOUNT value on done: 586718.0 [2024-08-06 04:46:20,257][52647] Sum rewards: 73.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.874', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.132', 'AMMO4': '0.166', 'weapon5': '0.204', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '60.000'} [2024-08-06 04:46:20,391][52667] DAMAGECOUNT value on done: 558148.0 [2024-08-06 04:46:20,392][52667] Sum rewards: 76.421, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.036', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.470', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '64.000'} [2024-08-06 04:46:21,696][52650] Updated weights for policy 0, policy_version 56021 (0.0028) [2024-08-06 04:46:21,811][52663] DAMAGECOUNT value on done: 557889.0 [2024-08-06 04:46:21,811][52663] Sum rewards: 62.423, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.682', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.142', 'weapon5': '0.172', 'AMMO4': '0.214', 'AMMO3': '0.279', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '54.500'} [2024-08-06 04:46:22,085][52811] DAMAGECOUNT value on done: 517963.0 [2024-08-06 04:46:22,085][52811] Sum rewards: 73.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO4': '0.219', 'weapon4': '0.232', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 458940416. Throughput: 0: 4371.2. Samples: 114738030. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:46:22,794][52567] Avg episode reward: [(0, '70.836')] [2024-08-06 04:46:23,179][52647] DAMAGECOUNT value on done: 593581.0 [2024-08-06 04:46:23,179][52647] Sum rewards: 90.678, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.865', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.136', 'weapon4': '0.150', 'AMMO4': '0.170', 'weapon2': '0.214', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.214', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '77.000'} [2024-08-06 04:46:23,225][52794] DAMAGECOUNT value on done: 565938.0 [2024-08-06 04:46:23,227][52794] Sum rewards: 62.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.196', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.055', 'AMMO3': '0.198', 'weapon5': '0.264', 'AMMO4': '0.276', 'weapon4': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '2.500', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '50.000'} [2024-08-06 04:46:23,600][52667] DAMAGECOUNT value on done: 566014.0 [2024-08-06 04:46:23,602][52667] Sum rewards: 68.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.176', 'AMMO3': '0.190', 'weapon4': '0.250', 'AMMO4': '0.251', 'weapon2': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '55.000'} [2024-08-06 04:46:24,445][52663] DAMAGECOUNT value on done: 562838.0 [2024-08-06 04:46:24,446][52663] Sum rewards: 63.164, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.602', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.094', 'weapon5': '0.128', 'AMMO4': '0.213', 'weapon2': '0.248', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.254', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '56.000'} [2024-08-06 04:46:25,099][52811] DAMAGECOUNT value on done: 527444.0 [2024-08-06 04:46:25,100][52811] Sum rewards: 69.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.476', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.216', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '57.000'} [2024-08-06 04:46:26,090][52647] DAMAGECOUNT value on done: 593795.0 [2024-08-06 04:46:26,092][52647] Sum rewards: 71.987, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.132', 'weapon4': '0.290', 'weapon5': '0.314', 'AMMO4': '0.324', 'weapon2': '0.568', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.522', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '57.000'} [2024-08-06 04:46:26,314][52794] DAMAGECOUNT value on done: 553810.0 [2024-08-06 04:46:26,315][52794] Sum rewards: 76.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '64.000'} [2024-08-06 04:46:26,499][52803] DAMAGECOUNT value on done: 518527.0 [2024-08-06 04:46:26,499][52803] Sum rewards: 67.343, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.928', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.172', 'weapon2': '0.954', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '54.000'} [2024-08-06 04:46:26,628][52650] Updated weights for policy 0, policy_version 56031 (0.0026) [2024-08-06 04:46:26,944][52667] DAMAGECOUNT value on done: 558252.0 [2024-08-06 04:46:26,944][52667] Sum rewards: 80.704, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.040', 'weapon5': '0.098', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.700', 'weapon3': '3.096', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '70.000'} [2024-08-06 04:46:27,285][52666] DAMAGECOUNT value on done: 555051.0 [2024-08-06 04:46:27,289][52666] Sum rewards: 68.890, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.974', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.074', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '58.000'} [2024-08-06 04:46:27,413][52663] DAMAGECOUNT value on done: 557328.0 [2024-08-06 04:46:27,413][52663] Sum rewards: 70.263, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.147', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.146', 'weapon5': '0.154', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '58.000'} [2024-08-06 04:46:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 459030528. Throughput: 0: 4367.3. Samples: 114764160. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:46:27,794][52567] Avg episode reward: [(0, '71.061')] [2024-08-06 04:46:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056034_459030528.pth... [2024-08-06 04:46:27,953][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055521_454828032.pth [2024-08-06 04:46:28,137][52811] DAMAGECOUNT value on done: 521736.0 [2024-08-06 04:46:28,139][52811] Sum rewards: 78.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.445', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.106', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 04:46:29,284][52670] DAMAGECOUNT value on done: 546137.0 [2024-08-06 04:46:29,284][52670] Sum rewards: 82.621, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.581', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.072', 'AMMO4': '0.101', 'weapon5': '0.134', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.222', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:29,295][52647] DAMAGECOUNT value on done: 593683.0 [2024-08-06 04:46:29,296][52647] Sum rewards: 80.143, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.900', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.174', 'weapon4': '0.216', 'weapon2': '0.246', 'AMMO4': '0.272', 'AMMO3': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.080', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:29,704][52803] DAMAGECOUNT value on done: 518558.0 [2024-08-06 04:46:29,707][52803] Sum rewards: 73.467, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.436', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon5': '0.244', 'weapon2': '0.250', 'AMMO4': '0.262', 'weapon4': '0.278', 'AMMO3': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.880', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:29,919][52667] DAMAGECOUNT value on done: 559939.0 [2024-08-06 04:46:29,924][52667] Sum rewards: 76.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.128', 'weapon4': '0.132', 'AMMO4': '0.180', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:30,032][52663] DAMAGECOUNT value on done: 552387.0 [2024-08-06 04:46:30,032][52663] Sum rewards: 71.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.755', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.094', 'weapon4': '0.108', 'AMMO4': '0.173', 'AMMO3': '0.228', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:30,271][52666] DAMAGECOUNT value on done: 558825.0 [2024-08-06 04:46:30,275][52666] Sum rewards: 72.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.008', 'weapon4': '0.040', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO4': '0.203', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:30,971][52650] Updated weights for policy 0, policy_version 56041 (0.0021) [2024-08-06 04:46:31,242][52811] DAMAGECOUNT value on done: 523074.0 [2024-08-06 04:46:31,242][52811] Sum rewards: 67.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.960', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.056', 'weapon5': '0.086', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'HITCOUNT': '3.300', 'weapon3': '3.354', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '59.000'} [2024-08-06 04:46:31,883][52647] DAMAGECOUNT value on done: 589170.0 [2024-08-06 04:46:31,883][52647] Sum rewards: 77.446, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.084', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.296', 'WEAPON3': '1.150', 'weapon3': '3.476', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:31,973][52670] DAMAGECOUNT value on done: 556631.0 [2024-08-06 04:46:31,974][52670] Sum rewards: 65.329, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.028', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.276', 'weapon2': '0.296', 'WEAPON3': '1.600', 'HITCOUNT': '3.400', 'weapon3': '3.448', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '58.000'} [2024-08-06 04:46:32,664][52803] DAMAGECOUNT value on done: 523565.0 [2024-08-06 04:46:32,666][52803] Sum rewards: 77.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.092', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.204', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.380', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 459112448. Throughput: 0: 4361.5. Samples: 114777180. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:46:32,795][52567] Avg episode reward: [(0, '71.727')] [2024-08-06 04:46:32,950][52667] DAMAGECOUNT value on done: 562733.0 [2024-08-06 04:46:32,950][52667] Sum rewards: 61.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.676', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.152', 'AMMO4': '0.171', 'weapon5': '0.204', 'AMMO3': '0.222', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '52.000'} [2024-08-06 04:46:33,130][52663] DAMAGECOUNT value on done: 548170.0 [2024-08-06 04:46:33,141][52663] Sum rewards: 67.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.943', 'AMMO5': '0.028', 'AMMO2': '0.063', 'AMMO3': '0.199', 'AMMO4': '0.314', 'weapon4': '0.318', 'weapon5': '0.342', 'weapon2': '0.442', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.616', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '54.000'} [2024-08-06 04:46:33,149][52666] DAMAGECOUNT value on done: 559612.0 [2024-08-06 04:46:33,159][52666] Sum rewards: 69.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.242', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '57.000'} [2024-08-06 04:46:34,364][52811] DAMAGECOUNT value on done: 530855.0 [2024-08-06 04:46:34,366][52811] Sum rewards: 69.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.142', 'AMMO4': '0.151', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 04:46:34,694][52647] DAMAGECOUNT value on done: 579175.0 [2024-08-06 04:46:34,694][52647] Sum rewards: 59.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.253', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO4': '0.087', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.068', 'DAMAGECOUNT': '14.637', 'FRAGCOUNT': '52.000'} [2024-08-06 04:46:35,152][52670] DAMAGECOUNT value on done: 549161.0 [2024-08-06 04:46:35,152][52670] Sum rewards: 78.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.404', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.490', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '66.000'} [2024-08-06 04:46:35,809][52667] DAMAGECOUNT value on done: 566839.0 [2024-08-06 04:46:35,810][52667] Sum rewards: 73.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.901', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.068', 'AMMO3': '0.232', 'AMMO4': '0.246', 'weapon5': '0.276', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:35,857][52803] DAMAGECOUNT value on done: 526199.0 [2024-08-06 04:46:35,858][52803] Sum rewards: 82.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.134', 'weapon5': '0.190', 'AMMO4': '0.233', 'AMMO3': '0.257', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:35,997][52650] Updated weights for policy 0, policy_version 56051 (0.0014) [2024-08-06 04:46:36,286][52666] DAMAGECOUNT value on done: 557931.0 [2024-08-06 04:46:36,287][52666] Sum rewards: 76.350, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.968', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.142', 'AMMO3': '0.199', 'weapon5': '0.250', 'AMMO4': '0.347', 'weapon2': '0.452', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:36,387][52663] DAMAGECOUNT value on done: 556532.0 [2024-08-06 04:46:36,388][52663] Sum rewards: 63.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.914', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon4': '0.154', 'AMMO4': '0.156', 'AMMO3': '0.205', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.252', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '54.000'} [2024-08-06 04:46:37,461][52811] DAMAGECOUNT value on done: 517507.0 [2024-08-06 04:46:37,463][52811] Sum rewards: 71.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.985', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.134', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.245', 'AMMO4': '0.245', 'weapon4': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:37,593][52647] DAMAGECOUNT value on done: 590000.0 [2024-08-06 04:46:37,595][52647] Sum rewards: 63.583, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.098', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.260', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '53.000'} [2024-08-06 04:46:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17467.6). Total num frames: 459194368. Throughput: 0: 4351.1. Samples: 114803020. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:46:37,795][52567] Avg episode reward: [(0, '71.395')] [2024-08-06 04:46:37,894][52670] DAMAGECOUNT value on done: 548157.0 [2024-08-06 04:46:37,895][52670] Sum rewards: 77.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.772', 'AMMO5': '0.006', 'weapon5': '0.028', 'AMMO2': '0.034', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon4': '0.292', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:38,739][52649] DAMAGECOUNT value on done: 539262.0 [2024-08-06 04:46:38,741][52649] Sum rewards: 71.378, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.009', 'AMMO2': '0.009', 'AMMO5': '0.009', 'AMMO4': '0.044', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon4': '0.202', 'weapon2': '0.308', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '57.500'} [2024-08-06 04:46:38,904][52666] DAMAGECOUNT value on done: 551720.0 [2024-08-06 04:46:38,905][52666] Sum rewards: 76.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '64.000'} [2024-08-06 04:46:38,949][52667] DAMAGECOUNT value on done: 560756.0 [2024-08-06 04:46:38,950][52667] Sum rewards: 81.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '66.500'} [2024-08-06 04:46:39,014][52803] DAMAGECOUNT value on done: 521033.0 [2024-08-06 04:46:39,014][52803] Sum rewards: 71.760, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.974', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.084', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.638', 'WEAPON3': '1.000', 'weapon3': '2.684', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '57.000'} [2024-08-06 04:46:39,406][52663] DAMAGECOUNT value on done: 564472.0 [2024-08-06 04:46:39,407][52663] Sum rewards: 82.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon4': '0.240', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:40,338][52647] DAMAGECOUNT value on done: 585756.0 [2024-08-06 04:46:40,339][52647] Sum rewards: 64.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.850', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.366', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '53.500'} [2024-08-06 04:46:40,500][52811] DAMAGECOUNT value on done: 514579.0 [2024-08-06 04:46:40,500][52811] Sum rewards: 75.313, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.643', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.169', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '3.232', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:40,503][52670] DAMAGECOUNT value on done: 561317.0 [2024-08-06 04:46:40,503][52670] Sum rewards: 77.367, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.346', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.110', 'AMMO4': '0.133', 'weapon5': '0.168', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:40,845][52650] Updated weights for policy 0, policy_version 56061 (0.0019) [2024-08-06 04:46:41,314][52666] DAMAGECOUNT value on done: 550383.0 [2024-08-06 04:46:41,315][52666] Sum rewards: 61.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.158', 'AMMO4': '0.171', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.412', 'weapon4': '0.428', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '52.000'} [2024-08-06 04:46:42,155][52649] DAMAGECOUNT value on done: 532310.0 [2024-08-06 04:46:42,158][52649] Sum rewards: 75.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.809', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.102', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:42,203][52803] DAMAGECOUNT value on done: 513796.0 [2024-08-06 04:46:42,229][52803] Sum rewards: 76.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.061', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.011', 'weapon5': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:42,405][52667] DAMAGECOUNT value on done: 555346.0 [2024-08-06 04:46:42,405][52667] Sum rewards: 83.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.014', 'AMMO2': '0.068', 'AMMO3': '0.190', 'weapon2': '0.202', 'weapon5': '0.214', 'weapon4': '0.268', 'AMMO4': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '67.000'} [2024-08-06 04:46:42,405][52663] DAMAGECOUNT value on done: 551091.0 [2024-08-06 04:46:42,414][52663] Sum rewards: 73.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.008', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '59.000'} [2024-08-06 04:46:42,710][52647] DAMAGECOUNT value on done: 586397.0 [2024-08-06 04:46:42,710][52647] Sum rewards: 56.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.106', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'weapon4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '48.000'} [2024-08-06 04:46:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 459284480. Throughput: 0: 4345.3. Samples: 114829130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:46:42,794][52567] Avg episode reward: [(0, '71.692')] [2024-08-06 04:46:42,973][52670] DAMAGECOUNT value on done: 554265.0 [2024-08-06 04:46:42,975][52670] Sum rewards: 75.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.662', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.130', 'AMMO3': '0.253', 'WEAPON3': '1.650', 'weapon3': '3.614', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '64.000'} [2024-08-06 04:46:43,733][52811] DAMAGECOUNT value on done: 520999.0 [2024-08-06 04:46:43,735][52811] Sum rewards: 78.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.898', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.184', 'weapon2': '0.822', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:44,075][52666] DAMAGECOUNT value on done: 553877.0 [2024-08-06 04:46:44,075][52666] Sum rewards: 82.141, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.360', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '67.500'} [2024-08-06 04:46:44,971][52647] DAMAGECOUNT value on done: 580553.0 [2024-08-06 04:46:44,972][52647] Sum rewards: 76.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.436', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.500'} [2024-08-06 04:46:45,320][52649] DAMAGECOUNT value on done: 550893.0 [2024-08-06 04:46:45,323][52649] Sum rewards: 73.991, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.955', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.074', 'weapon5': '0.160', 'AMMO4': '0.251', 'AMMO3': '0.263', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:45,449][52803] DAMAGECOUNT value on done: 515555.0 [2024-08-06 04:46:45,449][52803] Sum rewards: 82.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.113', 'AMMO3': '0.173', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '67.000'} [2024-08-06 04:46:45,535][52650] Updated weights for policy 0, policy_version 56071 (0.0035) [2024-08-06 04:46:45,587][52667] DAMAGECOUNT value on done: 562484.0 [2024-08-06 04:46:45,588][52667] Sum rewards: 71.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.665', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.128', 'AMMO3': '0.165', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '2.768', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '59.000'} [2024-08-06 04:46:45,702][52670] DAMAGECOUNT value on done: 543097.0 [2024-08-06 04:46:45,702][52670] Sum rewards: 79.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.095', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.147', 'weapon5': '0.180', 'AMMO4': '0.192', 'weapon4': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.812', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:45,786][52663] DAMAGECOUNT value on done: 549143.0 [2024-08-06 04:46:45,786][52663] Sum rewards: 80.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.195', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '68.000'} [2024-08-06 04:46:46,767][52811] DAMAGECOUNT value on done: 520188.0 [2024-08-06 04:46:46,769][52811] Sum rewards: 85.950, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.287', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.284', 'weapon4': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:46,824][52666] DAMAGECOUNT value on done: 553895.0 [2024-08-06 04:46:46,824][52666] Sum rewards: 82.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.326', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '68.000'} [2024-08-06 04:46:47,636][52647] DAMAGECOUNT value on done: 592844.0 [2024-08-06 04:46:47,636][52647] Sum rewards: 68.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.060', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.166', 'AMMO4': '0.172', 'weapon2': '0.210', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '53.000'} [2024-08-06 04:46:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 459374592. Throughput: 0: 4350.2. Samples: 114842340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 04:46:47,794][52567] Avg episode reward: [(0, '73.028')] [2024-08-06 04:46:48,342][52663] DAMAGECOUNT value on done: 551198.0 [2024-08-06 04:46:48,342][52663] Sum rewards: 75.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.214', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:48,442][52649] DAMAGECOUNT value on done: 545320.0 [2024-08-06 04:46:48,443][52649] Sum rewards: 72.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon4': '0.192', 'weapon5': '0.196', 'AMMO3': '0.197', 'AMMO4': '0.303', 'weapon2': '0.498', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '60.000'} [2024-08-06 04:46:48,585][52667] DAMAGECOUNT value on done: 566693.0 [2024-08-06 04:46:48,587][52667] Sum rewards: 80.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO3': '0.220', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.466', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '66.000'} [2024-08-06 04:46:48,695][52803] DAMAGECOUNT value on done: 512953.0 [2024-08-06 04:46:48,697][52803] Sum rewards: 70.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon2': '0.182', 'weapon4': '0.224', 'weapon5': '0.226', 'AMMO4': '0.228', 'AMMO3': '0.230', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '59.000'} [2024-08-06 04:46:48,766][52670] DAMAGECOUNT value on done: 552858.0 [2024-08-06 04:46:48,766][52670] Sum rewards: 75.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.584', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.228', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '61.000'} [2024-08-06 04:46:49,894][52811] DAMAGECOUNT value on done: 523743.0 [2024-08-06 04:46:49,895][52811] Sum rewards: 63.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.328', 'AMMO5': '0.013', 'AMMO2': '0.062', 'weapon5': '0.216', 'AMMO3': '0.264', 'weapon4': '0.294', 'AMMO4': '0.310', 'weapon2': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.828', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '54.000'} [2024-08-06 04:46:49,949][52666] DAMAGECOUNT value on done: 553558.0 [2024-08-06 04:46:49,949][52666] Sum rewards: 73.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.400', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:50,195][52647] DAMAGECOUNT value on done: 584164.0 [2024-08-06 04:46:50,196][52647] Sum rewards: 76.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.640', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.095', 'weapon4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:50,207][52650] Updated weights for policy 0, policy_version 56081 (0.0026) [2024-08-06 04:46:50,222][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:46:51,386][52670] DAMAGECOUNT value on done: 550093.0 [2024-08-06 04:46:51,386][52670] Sum rewards: 86.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.847', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.129', 'weapon5': '0.174', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:51,470][52649] DAMAGECOUNT value on done: 535058.0 [2024-08-06 04:46:51,471][52649] Sum rewards: 76.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.445', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.181', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.502', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:51,487][52667] DAMAGECOUNT value on done: 552691.0 [2024-08-06 04:46:51,488][52667] Sum rewards: 68.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.252', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.151', 'weapon4': '0.156', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '58.000'} [2024-08-06 04:46:51,536][52663] DAMAGECOUNT value on done: 548887.0 [2024-08-06 04:46:51,536][52663] Sum rewards: 73.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.185', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '60.000'} [2024-08-06 04:46:51,834][52803] DAMAGECOUNT value on done: 518871.0 [2024-08-06 04:46:51,835][52803] Sum rewards: 65.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.327', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.080', 'AMMO4': '0.175', 'weapon2': '0.208', 'weapon5': '0.212', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.248', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '54.500'} [2024-08-06 04:46:52,565][52666] DAMAGECOUNT value on done: 547865.0 [2024-08-06 04:46:52,567][52666] Sum rewards: 79.645, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.982', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.038', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.278', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.196', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '68.000'} [2024-08-06 04:46:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 459456512. Throughput: 0: 4347.1. Samples: 114868490. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:46:52,794][52567] Avg episode reward: [(0, '73.391')] [2024-08-06 04:46:53,048][52811] DAMAGECOUNT value on done: 524502.0 [2024-08-06 04:46:53,048][52811] Sum rewards: 76.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.132', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.152', 'weapon5': '0.154', 'weapon2': '0.188', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:53,248][52647] DAMAGECOUNT value on done: 591933.0 [2024-08-06 04:46:53,250][52647] Sum rewards: 75.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.084', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.142', 'AMMO4': '0.160', 'weapon5': '0.174', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:53,945][52649] DAMAGECOUNT value on done: 546181.0 [2024-08-06 04:46:53,946][52649] Sum rewards: 71.062, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'HEALTH': '0.065', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'weapon4': '0.210', 'weapon2': '0.532', 'WEAPON3': '1.000', 'weapon3': '3.028', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '58.000'} [2024-08-06 04:46:54,149][52667] DAMAGECOUNT value on done: 555227.0 [2024-08-06 04:46:54,150][52667] Sum rewards: 58.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.122', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.228', 'weapon4': '0.228', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.214', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '49.000'} [2024-08-06 04:46:54,153][52663] DAMAGECOUNT value on done: 562535.0 [2024-08-06 04:46:54,154][52663] Sum rewards: 82.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.983', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.180', 'AMMO3': '0.224', 'AMMO4': '0.275', 'weapon5': '0.296', 'weapon2': '0.308', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '68.000'} [2024-08-06 04:46:54,229][52669] DAMAGECOUNT value on done: 561545.0 [2024-08-06 04:46:54,230][52669] Sum rewards: 67.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.096', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '56.000'} [2024-08-06 04:46:54,281][52670] DAMAGECOUNT value on done: 548204.0 [2024-08-06 04:46:54,283][52670] Sum rewards: 79.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.665', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.086', 'weapon5': '0.188', 'AMMO3': '0.227', 'weapon2': '0.262', 'AMMO4': '0.277', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '67.000'} [2024-08-06 04:46:54,820][52650] Updated weights for policy 0, policy_version 56091 (0.0026) [2024-08-06 04:46:54,898][52803] DAMAGECOUNT value on done: 511481.0 [2024-08-06 04:46:54,907][52803] Sum rewards: 72.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '62.000'} [2024-08-06 04:46:55,415][52666] DAMAGECOUNT value on done: 551704.0 [2024-08-06 04:46:55,415][52666] Sum rewards: 72.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.196', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.024', 'AMMO4': '0.069', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '60.000'} [2024-08-06 04:46:55,707][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:46:56,220][52647] DAMAGECOUNT value on done: 589115.0 [2024-08-06 04:46:56,221][52647] Sum rewards: 81.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.119', 'weapon5': '0.140', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:56,242][52811] DAMAGECOUNT value on done: 518703.0 [2024-08-06 04:46:56,243][52811] Sum rewards: 72.309, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.118', 'AMMO4': '0.120', 'weapon5': '0.170', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.708', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '57.000'} [2024-08-06 04:46:56,644][52667] DAMAGECOUNT value on done: 563736.0 [2024-08-06 04:46:56,645][52667] Sum rewards: 67.631, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.388', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.201', 'weapon5': '0.222', 'weapon2': '0.224', 'AMMO4': '0.270', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.774', 'WEAPON3': '1.200', 'weapon3': '2.290', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '55.000'} [2024-08-06 04:46:56,920][52649] DAMAGECOUNT value on done: 542235.0 [2024-08-06 04:46:56,924][52649] Sum rewards: 73.802, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.560', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.116', 'AMMO4': '0.168', 'weapon5': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.300', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.092', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '65.000'} [2024-08-06 04:46:57,024][52670] DAMAGECOUNT value on done: 555979.0 [2024-08-06 04:46:57,025][52670] Sum rewards: 62.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.424', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.316', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '51.000'} [2024-08-06 04:46:57,340][52663] DAMAGECOUNT value on done: 549614.0 [2024-08-06 04:46:57,340][52663] Sum rewards: 79.475, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.128', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'weapon3': '3.356', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '68.000'} [2024-08-06 04:46:57,400][52669] DAMAGECOUNT value on done: 552424.0 [2024-08-06 04:46:57,402][52669] Sum rewards: 83.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.030', 'AMMO2': '0.050', 'weapon4': '0.112', 'weapon5': '0.164', 'AMMO3': '0.199', 'AMMO4': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '69.000'} [2024-08-06 04:46:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 459546624. Throughput: 0: 4345.3. Samples: 114894650. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:46:57,794][52567] Avg episode reward: [(0, '73.435')] [2024-08-06 04:46:57,981][52803] DAMAGECOUNT value on done: 528995.0 [2024-08-06 04:46:57,983][52803] Sum rewards: 76.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.217', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.226', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '63.000'} [2024-08-06 04:46:58,143][52666] DAMAGECOUNT value on done: 547151.0 [2024-08-06 04:46:58,145][52666] Sum rewards: 60.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.565', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.127', 'weapon2': '0.186', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.250', 'HITCOUNT': '2.690', 'weapon3': '3.052', 'DAMAGECOUNT': '14.925', 'FRAGCOUNT': '51.000'} [2024-08-06 04:46:58,552][52665] Large shaping reward 2.521 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0)] [2024-08-06 04:46:58,865][52647] DAMAGECOUNT value on done: 576321.0 [2024-08-06 04:46:58,866][52647] Sum rewards: 69.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.880', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon4': '0.088', 'AMMO4': '0.157', 'AMMO3': '0.183', 'weapon5': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '56.000'} [2024-08-06 04:46:59,352][52811] DAMAGECOUNT value on done: 517728.0 [2024-08-06 04:46:59,355][52811] Sum rewards: 60.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.920', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.090', 'weapon5': '0.186', 'AMMO3': '0.203', 'AMMO4': '0.226', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.194', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '51.000'} [2024-08-06 04:46:59,416][52667] DAMAGECOUNT value on done: 554376.0 [2024-08-06 04:46:59,417][52667] Sum rewards: 77.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon5': '0.178', 'AMMO3': '0.203', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '64.000'} [2024-08-06 04:46:59,536][52650] Updated weights for policy 0, policy_version 56101 (0.0029) [2024-08-06 04:46:59,878][52649] DAMAGECOUNT value on done: 543982.0 [2024-08-06 04:46:59,880][52649] Sum rewards: 82.458, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.565', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.146', 'WEAPON3': '0.950', 'weapon2': '1.016', 'weapon3': '2.780', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '64.000'} [2024-08-06 04:47:00,089][52670] DAMAGECOUNT value on done: 545613.0 [2024-08-06 04:47:00,091][52670] Sum rewards: 58.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.082', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.090', 'WEAPON5': '0.150', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.996', 'WEAPON3': '1.250', 'weapon3': '2.548', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '48.500'} [2024-08-06 04:47:00,452][52663] DAMAGECOUNT value on done: 560422.0 [2024-08-06 04:47:00,453][52663] Sum rewards: 63.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.296', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.218', 'AMMO4': '0.221', 'weapon4': '0.234', 'AMMO3': '0.272', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.900', 'weapon3': '2.942', 'DAMAGECOUNT': '15.432', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:00,512][52669] DAMAGECOUNT value on done: 563651.0 [2024-08-06 04:47:00,513][52669] Sum rewards: 75.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.146', 'AMMO3': '0.195', 'AMMO4': '0.195', 'weapon5': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.760', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:01,173][52666] DAMAGECOUNT value on done: 559786.0 [2024-08-06 04:47:01,175][52666] Sum rewards: 71.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.868', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.102', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.594', 'WEAPON3': '1.600', 'weapon3': '2.946', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:01,211][52803] DAMAGECOUNT value on done: 520415.0 [2024-08-06 04:47:01,212][52803] Sum rewards: 69.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.718', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.126', 'weapon4': '0.200', 'AMMO3': '0.254', 'AMMO4': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:01,625][52647] DAMAGECOUNT value on done: 585115.0 [2024-08-06 04:47:01,625][52647] Sum rewards: 70.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.638', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.156', 'weapon4': '0.160', 'AMMO4': '0.184', 'weapon5': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.600', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.000'} [2024-08-06 04:47:02,308][52649] DAMAGECOUNT value on done: 547389.0 [2024-08-06 04:47:02,308][52649] Sum rewards: 77.049, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.071', 'weapon5': '0.114', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:02,448][52667] DAMAGECOUNT value on done: 564521.0 [2024-08-06 04:47:02,451][52667] Sum rewards: 74.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.062', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.110', 'AMMO3': '0.191', 'weapon5': '0.200', 'AMMO4': '0.275', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 459628544. Throughput: 0: 4346.9. Samples: 114907740. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:47:02,794][52567] Avg episode reward: [(0, '73.427')] [2024-08-06 04:47:03,175][52670] DAMAGECOUNT value on done: 550833.0 [2024-08-06 04:47:03,175][52670] Sum rewards: 70.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.470', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.052', 'weapon5': '0.144', 'AMMO4': '0.221', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '58.000'} [2024-08-06 04:47:03,655][52663] DAMAGECOUNT value on done: 560814.0 [2024-08-06 04:47:03,657][52663] Sum rewards: 72.665, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.235', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.172', 'AMMO3': '0.244', 'weapon5': '0.256', 'AMMO4': '0.320', 'weapon2': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:03,719][52669] DAMAGECOUNT value on done: 562021.0 [2024-08-06 04:47:03,720][52669] Sum rewards: 81.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.945', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.088', 'weapon5': '0.174', 'AMMO3': '0.175', 'AMMO4': '0.213', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '65.500'} [2024-08-06 04:47:03,997][52664] DAMAGECOUNT value on done: 579302.0 [2024-08-06 04:47:03,998][52664] Sum rewards: 77.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.014', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.024', 'weapon4': '0.026', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.452', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:04,182][52647] DAMAGECOUNT value on done: 576342.0 [2024-08-06 04:47:04,184][52647] Sum rewards: 61.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.078', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.360', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.192', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '53.000'} [2024-08-06 04:47:04,307][52666] DAMAGECOUNT value on done: 551948.0 [2024-08-06 04:47:04,309][52666] Sum rewards: 80.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.142', 'weapon4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.273', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '67.000'} [2024-08-06 04:47:04,331][52650] Updated weights for policy 0, policy_version 56111 (0.0035) [2024-08-06 04:47:04,502][52803] DAMAGECOUNT value on done: 515694.0 [2024-08-06 04:47:04,503][52803] Sum rewards: 70.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 04:47:04,918][52667] DAMAGECOUNT value on done: 567095.0 [2024-08-06 04:47:04,919][52667] Sum rewards: 81.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '67.000'} [2024-08-06 04:47:05,100][52649] DAMAGECOUNT value on done: 537081.0 [2024-08-06 04:47:05,110][52649] Sum rewards: 63.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.090', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.038', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.484', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.108', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '54.000'} [2024-08-06 04:47:06,368][52670] DAMAGECOUNT value on done: 560059.0 [2024-08-06 04:47:06,373][52670] Sum rewards: 62.697, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.648', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.208', 'weapon2': '0.216', 'AMMO3': '0.240', 'weapon5': '0.250', 'AMMO4': '0.298', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '2.970', 'DAMAGECOUNT': '15.165', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:06,740][52663] DAMAGECOUNT value on done: 553240.0 [2024-08-06 04:47:06,742][52663] Sum rewards: 81.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.070', 'AMMO4': '0.110', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '66.500'} [2024-08-06 04:47:06,840][52669] DAMAGECOUNT value on done: 558114.0 [2024-08-06 04:47:06,841][52669] Sum rewards: 69.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO2': '0.005', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO4': '0.024', 'weapon5': '0.096', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:06,974][52664] DAMAGECOUNT value on done: 583268.0 [2024-08-06 04:47:06,975][52664] Sum rewards: 60.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.865', 'AMMO5': '0.022', 'AMMO2': '0.044', 'weapon4': '0.096', 'AMMO3': '0.162', 'weapon5': '0.182', 'AMMO4': '0.221', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '52.000'} [2024-08-06 04:47:07,203][52647] DAMAGECOUNT value on done: 580157.0 [2024-08-06 04:47:07,203][52647] Sum rewards: 67.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.372', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.178', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'AMMO4': '0.278', 'weapon2': '0.282', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:07,445][52666] DAMAGECOUNT value on done: 556495.0 [2024-08-06 04:47:07,447][52666] Sum rewards: 70.538, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.282', 'weapon4': '0.342', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '56.000'} [2024-08-06 04:47:07,579][52649] DAMAGECOUNT value on done: 547772.0 [2024-08-06 04:47:07,579][52649] Sum rewards: 73.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.998', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.188', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'weapon4': '0.284', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:07,622][52803] DAMAGECOUNT value on done: 528965.0 [2024-08-06 04:47:07,623][52803] Sum rewards: 72.465, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.889', 'AMMO5': '0.028', 'AMMO2': '0.066', 'AMMO3': '0.211', 'weapon4': '0.280', 'weapon5': '0.282', 'AMMO4': '0.332', 'weapon2': '0.488', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:07,762][52667] DAMAGECOUNT value on done: 567558.0 [2024-08-06 04:47:07,763][52667] Sum rewards: 62.892, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.485', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.114', 'AMMO3': '0.157', 'AMMO4': '0.223', 'weapon5': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '49.500'} [2024-08-06 04:47:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 459718656. Throughput: 0: 4359.8. Samples: 114934220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:47:07,794][52567] Avg episode reward: [(0, '73.009')] [2024-08-06 04:47:08,794][52650] Updated weights for policy 0, policy_version 56121 (0.0015) [2024-08-06 04:47:09,286][52670] DAMAGECOUNT value on done: 556420.0 [2024-08-06 04:47:09,288][52670] Sum rewards: 78.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.200', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.056', 'AMMO4': '0.167', 'weapon5': '0.188', 'AMMO3': '0.249', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.126', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '66.000'} [2024-08-06 04:47:09,795][52669] DAMAGECOUNT value on done: 563631.0 [2024-08-06 04:47:09,796][52669] Sum rewards: 81.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.096', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '3.258', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:09,806][52671] DAMAGECOUNT value on done: 565499.0 [2024-08-06 04:47:09,806][52671] Sum rewards: 76.382, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.662', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.246', 'AMMO4': '0.269', 'weapon5': '0.280', 'weapon4': '0.380', 'weapon2': '0.382', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.608', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '64.000'} [2024-08-06 04:47:09,888][52664] DAMAGECOUNT value on done: 582134.0 [2024-08-06 04:47:09,889][52664] Sum rewards: 68.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.205', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.007', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.360', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:10,115][52666] DAMAGECOUNT value on done: 551352.0 [2024-08-06 04:47:10,125][52666] Sum rewards: 66.959, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.601', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.169', 'weapon2': '0.260', 'WEAPON3': '1.050', 'HITCOUNT': '3.280', 'weapon3': '3.476', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '53.000'} [2024-08-06 04:47:10,571][52649] DAMAGECOUNT value on done: 553022.0 [2024-08-06 04:47:10,573][52649] Sum rewards: 74.260, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.092', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:10,646][52803] DAMAGECOUNT value on done: 521206.0 [2024-08-06 04:47:10,649][52803] Sum rewards: 79.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.144', 'weapon5': '0.218', 'AMMO4': '0.230', 'AMMO3': '0.244', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:10,714][52667] DAMAGECOUNT value on done: 564583.0 [2024-08-06 04:47:10,714][52667] Sum rewards: 64.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.021', 'AMMO2': '0.071', 'weapon5': '0.220', 'weapon2': '0.230', 'AMMO3': '0.251', 'AMMO4': '0.353', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:12,068][52670] DAMAGECOUNT value on done: 538587.0 [2024-08-06 04:47:12,068][52670] Sum rewards: 82.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.118', 'weapon4': '0.120', 'AMMO4': '0.165', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '69.000'} [2024-08-06 04:47:12,254][52669] DAMAGECOUNT value on done: 561234.0 [2024-08-06 04:47:12,256][52669] Sum rewards: 57.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.692', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.108', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '48.000'} [2024-08-06 04:47:12,508][52664] DAMAGECOUNT value on done: 575141.0 [2024-08-06 04:47:12,508][52664] Sum rewards: 72.469, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.512', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.198', 'AMMO4': '0.201', 'weapon5': '0.220', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:12,781][52671] DAMAGECOUNT value on done: 563724.0 [2024-08-06 04:47:12,784][52671] Sum rewards: 74.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.130', 'weapon5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.696', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 459808768. Throughput: 0: 4364.0. Samples: 114960540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:47:12,794][52567] Avg episode reward: [(0, '73.284')] [2024-08-06 04:47:13,126][52666] DAMAGECOUNT value on done: 555010.0 [2024-08-06 04:47:13,129][52666] Sum rewards: 68.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.168', 'weapon5': '0.182', 'weapon2': '0.196', 'AMMO4': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '54.000'} [2024-08-06 04:47:13,646][52650] Updated weights for policy 0, policy_version 56131 (0.0012) [2024-08-06 04:47:13,731][52667] DAMAGECOUNT value on done: 557692.0 [2024-08-06 04:47:13,731][52667] Sum rewards: 60.864, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.908', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.158', 'weapon4': '0.170', 'AMMO4': '0.196', 'weapon5': '0.244', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.820', 'weapon3': '2.932', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '48.000'} [2024-08-06 04:47:13,757][52649] DAMAGECOUNT value on done: 553314.0 [2024-08-06 04:47:13,759][52649] Sum rewards: 75.062, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.346', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.141', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.366', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:13,765][52803] DAMAGECOUNT value on done: 518256.0 [2024-08-06 04:47:13,766][52803] Sum rewards: 75.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.102', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:13,858][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:47:14,596][52614] Signal inference workers to stop experience collection... (10200 times) [2024-08-06 04:47:14,597][52614] Signal inference workers to resume experience collection... (10200 times) [2024-08-06 04:47:14,655][52650] InferenceWorker_p0-w0: stopping experience collection (10200 times) [2024-08-06 04:47:14,655][52650] InferenceWorker_p0-w0: resuming experience collection (10200 times) [2024-08-06 04:47:14,828][52669] DAMAGECOUNT value on done: 558511.0 [2024-08-06 04:47:14,830][52669] Sum rewards: 52.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.178', 'AMMO3': '0.196', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '44.000'} [2024-08-06 04:47:15,011][52664] DAMAGECOUNT value on done: 580224.0 [2024-08-06 04:47:15,013][52664] Sum rewards: 70.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.228', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.352', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:15,149][52670] DAMAGECOUNT value on done: 551578.0 [2024-08-06 04:47:15,157][52670] Sum rewards: 68.870, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '59.000'} [2024-08-06 04:47:15,831][52671] DAMAGECOUNT value on done: 562446.0 [2024-08-06 04:47:15,832][52671] Sum rewards: 78.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.150', 'AMMO3': '0.188', 'WEAPON3': '1.200', 'HITCOUNT': '3.580', 'weapon3': '3.638', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '63.000'} [2024-08-06 04:47:16,214][52666] DAMAGECOUNT value on done: 557531.0 [2024-08-06 04:47:16,215][52666] Sum rewards: 79.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.824', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.026', 'weapon5': '0.040', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '3.248', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 04:47:16,643][52667] DAMAGECOUNT value on done: 566380.0 [2024-08-06 04:47:16,645][52667] Sum rewards: 71.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.022', 'weapon5': '0.046', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.420', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.310', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:16,776][52649] DAMAGECOUNT value on done: 551077.0 [2024-08-06 04:47:16,777][52649] Sum rewards: 70.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.718', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.098', 'weapon5': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.284', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '58.000'} [2024-08-06 04:47:16,855][52803] DAMAGECOUNT value on done: 522745.0 [2024-08-06 04:47:16,858][52803] Sum rewards: 77.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.055', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:17,472][52664] DAMAGECOUNT value on done: 580554.0 [2024-08-06 04:47:17,474][52664] Sum rewards: 87.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.124', 'AMMO3': '0.201', 'weapon2': '0.222', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '72.000'} [2024-08-06 04:47:17,672][52662] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:47:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 459898880. Throughput: 0: 4363.6. Samples: 114973540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:47:17,794][52669] DAMAGECOUNT value on done: 568404.0 [2024-08-06 04:47:17,794][52567] Avg episode reward: [(0, '72.910')] [2024-08-06 04:47:17,795][52669] Sum rewards: 68.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.100', 'weapon2': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.564', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:18,274][52650] Updated weights for policy 0, policy_version 56141 (0.0020) [2024-08-06 04:47:18,300][52670] DAMAGECOUNT value on done: 559790.0 [2024-08-06 04:47:18,304][52670] Sum rewards: 74.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.443', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.282', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:18,702][52671] DAMAGECOUNT value on done: 562788.0 [2024-08-06 04:47:18,703][52671] Sum rewards: 74.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.875', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.260', 'weapon2': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.486', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '63.000'} [2024-08-06 04:47:19,403][52666] DAMAGECOUNT value on done: 542501.0 [2024-08-06 04:47:19,408][52666] Sum rewards: 64.368, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.962', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.074', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.286', 'weapon2': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.206', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:19,830][52803] DAMAGECOUNT value on done: 523299.0 [2024-08-06 04:47:19,832][52803] Sum rewards: 74.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.266', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:19,942][52649] DAMAGECOUNT value on done: 538976.0 [2024-08-06 04:47:19,943][52649] Sum rewards: 85.244, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.123', 'weapon4': '0.182', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.739', 'FRAGCOUNT': '71.000'} [2024-08-06 04:47:20,414][52669] DAMAGECOUNT value on done: 560002.0 [2024-08-06 04:47:20,416][52669] Sum rewards: 67.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.934', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '56.000'} [2024-08-06 04:47:20,470][52664] DAMAGECOUNT value on done: 574818.0 [2024-08-06 04:47:20,471][52664] Sum rewards: 61.534, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.456', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.070', 'AMMO4': '0.148', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.424', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '56.000'} [2024-08-06 04:47:20,477][52658] DAMAGECOUNT value on done: 559209.0 [2024-08-06 04:47:20,477][52658] Sum rewards: 64.672, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.175', 'weapon2': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.320', 'WEAPON3': '1.850', 'HITCOUNT': '3.180', 'weapon3': '3.302', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 04:47:21,523][52670] DAMAGECOUNT value on done: 550255.0 [2024-08-06 04:47:21,526][52670] Sum rewards: 70.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.328', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.079', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.510', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '56.000'} [2024-08-06 04:47:21,763][52671] DAMAGECOUNT value on done: 573023.0 [2024-08-06 04:47:21,764][52671] Sum rewards: 75.898, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.153', 'AMMO3': '0.171', 'weapon2': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.082', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:22,593][52666] DAMAGECOUNT value on done: 552152.0 [2024-08-06 04:47:22,595][52666] Sum rewards: 81.370, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.840', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.052', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.262', 'weapon2': '0.384', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '72.000'} [2024-08-06 04:47:22,680][52649] DAMAGECOUNT value on done: 547287.0 [2024-08-06 04:47:22,680][52649] Sum rewards: 85.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.530', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.048', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '68.000'} [2024-08-06 04:47:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 459988992. Throughput: 0: 4375.8. Samples: 114999930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 04:47:22,795][52567] Avg episode reward: [(0, '72.447')] [2024-08-06 04:47:22,801][52650] Updated weights for policy 0, policy_version 56151 (0.0029) [2024-08-06 04:47:22,953][52669] DAMAGECOUNT value on done: 565046.0 [2024-08-06 04:47:22,953][52669] Sum rewards: 80.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.448', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.156', 'weapon5': '0.206', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '66.000'} [2024-08-06 04:47:23,110][52803] DAMAGECOUNT value on done: 526426.0 [2024-08-06 04:47:23,111][52803] Sum rewards: 71.226, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.112', 'weapon5': '0.170', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:23,301][52658] DAMAGECOUNT value on done: 558853.0 [2024-08-06 04:47:23,302][52658] Sum rewards: 76.302, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.270', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.108', 'weapon4': '0.116', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.082', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '65.500'} [2024-08-06 04:47:23,514][52664] DAMAGECOUNT value on done: 573123.0 [2024-08-06 04:47:23,514][52664] Sum rewards: 82.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.216', 'WEAPON3': '1.250', 'weapon3': '3.506', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '68.000'} [2024-08-06 04:47:24,156][52670] DAMAGECOUNT value on done: 555587.0 [2024-08-06 04:47:24,157][52670] Sum rewards: 78.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.065', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.158', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '2.894', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '64.000'} [2024-08-06 04:47:24,721][52671] DAMAGECOUNT value on done: 563500.0 [2024-08-06 04:47:24,721][52671] Sum rewards: 74.937, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.110', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.168', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'weapon2': '0.392', 'WEAPON3': '1.800', 'weapon3': '3.068', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:25,384][52649] DAMAGECOUNT value on done: 536495.0 [2024-08-06 04:47:25,385][52649] Sum rewards: 64.558, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.719', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.304', 'weapon5': '0.304', 'weapon4': '0.308', 'AMMO4': '0.337', 'weapon2': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.516', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:25,997][52658] DAMAGECOUNT value on done: 563563.0 [2024-08-06 04:47:25,997][52658] Sum rewards: 71.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.907', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.184', 'weapon4': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.676', 'WEAPON3': '1.100', 'weapon3': '2.642', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:26,109][52803] DAMAGECOUNT value on done: 517006.0 [2024-08-06 04:47:26,109][52803] Sum rewards: 79.555, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.108', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.239', 'AMMO4': '0.247', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '67.000'} [2024-08-06 04:47:26,209][52669] DAMAGECOUNT value on done: 564179.0 [2024-08-06 04:47:26,209][52669] Sum rewards: 65.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.458', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.233', 'weapon4': '0.290', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '54.000'} [2024-08-06 04:47:26,303][52664] DAMAGECOUNT value on done: 583989.0 [2024-08-06 04:47:26,303][52664] Sum rewards: 70.702, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'weapon4': '0.234', 'AMMO3': '0.244', 'weapon2': '0.246', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '59.000'} [2024-08-06 04:47:27,595][52650] Updated weights for policy 0, policy_version 56161 (0.0022) [2024-08-06 04:47:27,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 460070912. Throughput: 0: 4376.9. Samples: 115026090. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 04:47:27,795][52567] Avg episode reward: [(0, '72.396')] [2024-08-06 04:47:27,830][52671] DAMAGECOUNT value on done: 568680.0 [2024-08-06 04:47:27,832][52671] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.372', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:27,911][52649] DAMAGECOUNT value on done: 550403.0 [2024-08-06 04:47:27,913][52649] Sum rewards: 67.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.834', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.127', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:28,810][52658] DAMAGECOUNT value on done: 563995.0 [2024-08-06 04:47:28,812][52658] Sum rewards: 60.640, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.485', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.106', 'AMMO4': '0.146', 'weapon5': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '52.000'} [2024-08-06 04:47:29,097][52664] DAMAGECOUNT value on done: 576725.0 [2024-08-06 04:47:29,097][52664] Sum rewards: 65.714, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.388', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.092', 'weapon4': '0.146', 'AMMO3': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '3.086', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '52.000'} [2024-08-06 04:47:29,391][52669] DAMAGECOUNT value on done: 551492.0 [2024-08-06 04:47:29,392][52669] Sum rewards: 56.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.120', 'weapon5': '0.164', 'AMMO3': '0.251', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.606', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '47.000'} [2024-08-06 04:47:30,882][52671] DAMAGECOUNT value on done: 562720.0 [2024-08-06 04:47:30,883][52671] Sum rewards: 69.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.178', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.412', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '2.550', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '58.000'} [2024-08-06 04:47:30,968][52649] DAMAGECOUNT value on done: 550987.0 [2024-08-06 04:47:30,976][52649] Sum rewards: 76.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.054', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'AMMO4': '0.208', 'weapon4': '0.236', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:31,318][52658] DAMAGECOUNT value on done: 552757.0 [2024-08-06 04:47:31,319][52658] Sum rewards: 56.781, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.900', 'ARMOR': '0.008', 'AMMO5': '0.027', 'AMMO2': '0.053', 'weapon4': '0.216', 'AMMO3': '0.261', 'AMMO4': '0.265', 'weapon5': '0.290', 'weapon2': '0.492', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.576', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '53.000'} [2024-08-06 04:47:31,802][52668] DAMAGECOUNT value on done: 558046.0 [2024-08-06 04:47:31,805][52668] Sum rewards: 63.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.598', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.094', 'weapon5': '0.176', 'AMMO4': '0.210', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '54.000'} [2024-08-06 04:47:31,987][52650] Updated weights for policy 0, policy_version 56171 (0.0013) [2024-08-06 04:47:32,139][52664] DAMAGECOUNT value on done: 584702.0 [2024-08-06 04:47:32,140][52664] Sum rewards: 54.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.108', 'AMMO4': '0.235', 'weapon4': '0.236', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.790', 'weapon3': '3.072', 'DAMAGECOUNT': '14.856', 'FRAGCOUNT': '47.000'} [2024-08-06 04:47:32,203][52669] DAMAGECOUNT value on done: 560588.0 [2024-08-06 04:47:32,204][52669] Sum rewards: 73.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.592', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.144', 'AMMO3': '0.198', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 04:47:32,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 460152832. Throughput: 0: 4375.3. Samples: 115039230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 04:47:32,795][52567] Avg episode reward: [(0, '71.530')] [2024-08-06 04:47:33,963][52671] DAMAGECOUNT value on done: 556656.0 [2024-08-06 04:47:33,965][52671] Sum rewards: 72.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.406', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.112', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:34,054][52649] DAMAGECOUNT value on done: 543583.0 [2024-08-06 04:47:34,054][52649] Sum rewards: 78.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:34,126][52658] DAMAGECOUNT value on done: 555738.0 [2024-08-06 04:47:34,127][52658] Sum rewards: 76.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.825', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.174', 'AMMO3': '0.201', 'weapon4': '0.208', 'WEAPON3': '1.350', 'weapon3': '3.346', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:34,397][52664] DAMAGECOUNT value on done: 584504.0 [2024-08-06 04:47:34,397][52664] Sum rewards: 71.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.925', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'weapon4': '0.104', 'AMMO3': '0.249', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:34,550][52668] DAMAGECOUNT value on done: 561709.0 [2024-08-06 04:47:34,552][52668] Sum rewards: 76.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.877', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.280', 'weapon4': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:35,045][52662] DAMAGECOUNT value on done: 565631.0 [2024-08-06 04:47:35,045][52662] Sum rewards: 81.201, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.302', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.062', 'weapon2': '0.256', 'AMMO3': '0.259', 'WEAPON3': '1.700', 'weapon3': '3.484', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '69.000'} [2024-08-06 04:47:35,316][52669] DAMAGECOUNT value on done: 562713.0 [2024-08-06 04:47:35,316][52669] Sum rewards: 81.348, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.134', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '66.500'} [2024-08-06 04:47:36,886][52650] Updated weights for policy 0, policy_version 56181 (0.0018) [2024-08-06 04:47:36,994][52664] DAMAGECOUNT value on done: 588214.0 [2024-08-06 04:47:36,995][52664] Sum rewards: 71.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.146', 'AMMO3': '0.232', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:37,057][52671] DAMAGECOUNT value on done: 564908.0 [2024-08-06 04:47:37,059][52671] Sum rewards: 69.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.010', 'weapon4': '0.034', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon5': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '58.000'} [2024-08-06 04:47:37,117][52658] DAMAGECOUNT value on done: 563471.0 [2024-08-06 04:47:37,118][52658] Sum rewards: 74.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.298', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon4': '0.114', 'AMMO3': '0.173', 'AMMO4': '0.196', 'weapon5': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:37,133][52668] DAMAGECOUNT value on done: 559340.0 [2024-08-06 04:47:37,134][52668] Sum rewards: 72.234, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.400', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.042', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.622', 'WEAPON3': '0.950', 'weapon3': '3.154', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:37,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 460251136. Throughput: 0: 4377.3. Samples: 115065470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 04:47:37,794][52567] Avg episode reward: [(0, '71.784')] [2024-08-06 04:47:38,125][52662] DAMAGECOUNT value on done: 562218.0 [2024-08-06 04:47:38,125][52662] Sum rewards: 77.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.126', 'weapon4': '0.146', 'weapon2': '0.154', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '64.000'} [2024-08-06 04:47:38,264][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:47:38,395][52669] DAMAGECOUNT value on done: 580215.0 [2024-08-06 04:47:38,395][52669] Sum rewards: 75.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.705', 'AMMO5': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.036', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.516', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:39,719][52671] DAMAGECOUNT value on done: 563653.0 [2024-08-06 04:47:39,721][52671] Sum rewards: 68.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.995', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon4': '0.172', 'AMMO4': '0.200', 'weapon5': '0.222', 'AMMO3': '0.236', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '58.000'} [2024-08-06 04:47:39,797][52668] DAMAGECOUNT value on done: 561842.0 [2024-08-06 04:47:39,797][52668] Sum rewards: 83.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.327', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.078', 'AMMO4': '0.184', 'weapon5': '0.228', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '70.000'} [2024-08-06 04:47:39,959][52658] DAMAGECOUNT value on done: 555165.0 [2024-08-06 04:47:39,960][52658] Sum rewards: 84.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.108', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '68.000'} [2024-08-06 04:47:40,326][52664] DAMAGECOUNT value on done: 585969.0 [2024-08-06 04:47:40,326][52664] Sum rewards: 76.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.806', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.114', 'AMMO4': '0.122', 'weapon4': '0.134', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:41,045][52662] DAMAGECOUNT value on done: 566172.0 [2024-08-06 04:47:41,046][52662] Sum rewards: 78.765, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.355', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.146', 'AMMO3': '0.183', 'AMMO4': '0.228', 'weapon5': '0.230', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.098', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '63.000'} [2024-08-06 04:47:41,689][52650] Updated weights for policy 0, policy_version 56191 (0.0038) [2024-08-06 04:47:41,717][52669] DAMAGECOUNT value on done: 567944.0 [2024-08-06 04:47:41,717][52669] Sum rewards: 83.163, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO4': '0.241', 'weapon2': '0.248', 'AMMO3': '0.259', 'weapon5': '0.262', 'weapon4': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.830', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.793', 'FRAGCOUNT': '69.000'} [2024-08-06 04:47:42,388][52658] DAMAGECOUNT value on done: 573601.0 [2024-08-06 04:47:42,398][52658] Sum rewards: 73.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.394', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.204', 'weapon5': '0.224', 'AMMO3': '0.226', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:42,576][52664] DAMAGECOUNT value on done: 588424.0 [2024-08-06 04:47:42,578][52664] Sum rewards: 82.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.366', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.122', 'AMMO3': '0.167', 'AMMO4': '0.175', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '67.500'} [2024-08-06 04:47:42,792][52671] DAMAGECOUNT value on done: 561085.0 [2024-08-06 04:47:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 460333056. Throughput: 0: 4382.2. Samples: 115091850. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 04:47:42,798][52567] Avg episode reward: [(0, '72.542')] [2024-08-06 04:47:42,794][52671] Sum rewards: 78.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.206', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.304', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '65.000'} [2024-08-06 04:47:42,979][52668] DAMAGECOUNT value on done: 551125.0 [2024-08-06 04:47:42,981][52668] Sum rewards: 66.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.345', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.160', 'AMMO3': '0.197', 'weapon4': '0.216', 'weapon2': '0.226', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.120', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '56.000'} [2024-08-06 04:47:43,451][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:47:43,545][52662] DAMAGECOUNT value on done: 553844.0 [2024-08-06 04:47:43,545][52662] Sum rewards: 81.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.132', 'AMMO4': '0.141', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '67.000'} [2024-08-06 04:47:44,659][52669] DAMAGECOUNT value on done: 565081.0 [2024-08-06 04:47:44,659][52669] Sum rewards: 65.624, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.617', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.102', 'AMMO4': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '52.000'} [2024-08-06 04:47:45,158][52664] DAMAGECOUNT value on done: 580702.0 [2024-08-06 04:47:45,160][52664] Sum rewards: 71.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.555', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.167', 'AMMO3': '0.173', 'weapon5': '0.178', 'WEAPON5': '0.350', 'weapon4': '0.378', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.662', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 04:47:45,177][52671] DAMAGECOUNT value on done: 569353.0 [2024-08-06 04:47:45,179][52671] Sum rewards: 67.519, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.212', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.044', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon2': '0.370', 'WEAPON3': '0.900', 'HITCOUNT': '3.250', 'weapon3': '3.364', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '53.000'} [2024-08-06 04:47:45,462][52658] DAMAGECOUNT value on done: 558516.0 [2024-08-06 04:47:45,463][52658] Sum rewards: 74.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.995', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.197', 'AMMO4': '0.197', 'weapon4': '0.258', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '63.000'} [2024-08-06 04:47:46,056][52668] DAMAGECOUNT value on done: 566205.0 [2024-08-06 04:47:46,059][52668] Sum rewards: 65.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.824', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.294', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.410', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '57.000'} [2024-08-06 04:47:46,196][52662] DAMAGECOUNT value on done: 567826.0 [2024-08-06 04:47:46,197][52662] Sum rewards: 84.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.098', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.282', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '69.000'} [2024-08-06 04:47:46,197][52650] Updated weights for policy 0, policy_version 56201 (0.0016) [2024-08-06 04:47:47,717][52671] DAMAGECOUNT value on done: 563780.0 [2024-08-06 04:47:47,720][52671] Sum rewards: 87.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.691', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.524', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '72.000'} [2024-08-06 04:47:47,736][52669] DAMAGECOUNT value on done: 565286.0 [2024-08-06 04:47:47,737][52669] Sum rewards: 72.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.108', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.174', 'AMMO3': '0.228', 'weapon5': '0.244', 'AMMO4': '0.284', 'WEAPON5': '0.500', 'weapon2': '0.566', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 04:47:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 460423168. Throughput: 0: 4385.3. Samples: 115105080. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 04:47:47,794][52567] Avg episode reward: [(0, '72.669')] [2024-08-06 04:47:48,253][52658] DAMAGECOUNT value on done: 570805.0 [2024-08-06 04:47:48,254][52658] Sum rewards: 71.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.070', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:48,377][52664] DAMAGECOUNT value on done: 574613.0 [2024-08-06 04:47:48,379][52664] Sum rewards: 82.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.425', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.290', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '68.000'} [2024-08-06 04:47:48,693][52662] DAMAGECOUNT value on done: 556451.0 [2024-08-06 04:47:48,694][52662] Sum rewards: 76.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.891', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.132', 'weapon5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:48,951][52668] DAMAGECOUNT value on done: 562270.0 [2024-08-06 04:47:48,952][52668] Sum rewards: 84.291, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.011', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.185', 'weapon2': '0.290', 'HEALTH': '0.770', 'WEAPON3': '1.050', 'weapon3': '3.510', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '68.000'} [2024-08-06 04:47:50,488][52671] DAMAGECOUNT value on done: 550116.0 [2024-08-06 04:47:50,488][52671] Sum rewards: 80.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.096', 'weapon4': '0.134', 'AMMO4': '0.192', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '67.000'} [2024-08-06 04:47:50,635][52669] DAMAGECOUNT value on done: 570234.0 [2024-08-06 04:47:50,636][52669] Sum rewards: 62.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.406', 'ARMOR': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.088', 'weapon4': '0.094', 'AMMO4': '0.170', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:51,023][52650] Updated weights for policy 0, policy_version 56211 (0.0013) [2024-08-06 04:47:51,257][52658] DAMAGECOUNT value on done: 557304.0 [2024-08-06 04:47:51,257][52658] Sum rewards: 84.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.755', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.650', 'weapon3': '2.978', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '72.000'} [2024-08-06 04:47:51,694][52662] DAMAGECOUNT value on done: 566859.0 [2024-08-06 04:47:51,696][52662] Sum rewards: 77.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.140', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '2.930', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '64.000'} [2024-08-06 04:47:51,712][52664] DAMAGECOUNT value on done: 580565.0 [2024-08-06 04:47:51,713][52664] Sum rewards: 50.253, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.170', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.138', 'weapon2': '0.210', 'AMMO4': '0.235', 'AMMO3': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.504', 'WEAPON3': '1.750', 'HITCOUNT': '2.800', 'weapon3': '2.814', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '47.000'} [2024-08-06 04:47:51,980][52668] DAMAGECOUNT value on done: 553729.0 [2024-08-06 04:47:51,982][52668] Sum rewards: 67.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.186', 'AMMO3': '0.188', 'AMMO4': '0.196', 'weapon5': '0.244', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '56.500'} [2024-08-06 04:47:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 460513280. Throughput: 0: 4377.8. Samples: 115131220. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 04:47:52,794][52567] Avg episode reward: [(0, '72.963')] [2024-08-06 04:47:52,997][52671] DAMAGECOUNT value on done: 570400.0 [2024-08-06 04:47:52,999][52671] Sum rewards: 71.909, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.120', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.076', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.326', 'WEAPON3': '1.950', 'weapon3': '3.418', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '64.000'} [2024-08-06 04:47:54,056][52658] DAMAGECOUNT value on done: 562917.0 [2024-08-06 04:47:54,057][52658] Sum rewards: 80.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon4': '0.172', 'weapon2': '0.194', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '68.000'} [2024-08-06 04:47:54,221][52664] DAMAGECOUNT value on done: 580557.0 [2024-08-06 04:47:54,221][52664] Sum rewards: 65.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.788', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.183', 'AMMO4': '0.201', 'weapon4': '0.212', 'weapon5': '0.242', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:54,919][52662] DAMAGECOUNT value on done: 567275.0 [2024-08-06 04:47:54,919][52662] Sum rewards: 74.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.524', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.070', 'weapon5': '0.120', 'AMMO4': '0.185', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:55,050][52668] DAMAGECOUNT value on done: 556248.0 [2024-08-06 04:47:55,050][52668] Sum rewards: 66.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.598', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.068', 'AMMO4': '0.121', 'weapon5': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.810', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:55,574][52650] Updated weights for policy 0, policy_version 56221 (0.0014) [2024-08-06 04:47:55,585][52671] DAMAGECOUNT value on done: 567407.0 [2024-08-06 04:47:55,585][52671] Sum rewards: 75.955, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon4': '0.292', 'HEALTH': '0.313', 'weapon2': '0.342', 'WEAPON3': '0.900', 'weapon3': '3.018', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '59.000'} [2024-08-06 04:47:56,160][52668] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2024-08-06 04:47:56,682][52664] DAMAGECOUNT value on done: 578755.0 [2024-08-06 04:47:56,682][52664] Sum rewards: 76.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.064', 'AMMO4': '0.140', 'weapon5': '0.178', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '62.000'} [2024-08-06 04:47:57,070][52658] DAMAGECOUNT value on done: 555778.0 [2024-08-06 04:47:57,070][52658] Sum rewards: 65.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.581', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.146', 'AMMO3': '0.199', 'AMMO4': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.258', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '54.000'} [2024-08-06 04:47:57,571][52662] DAMAGECOUNT value on done: 559356.0 [2024-08-06 04:47:57,572][52662] Sum rewards: 68.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.767', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon5': '0.186', 'weapon4': '0.190', 'AMMO3': '0.197', 'AMMO4': '0.234', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '55.000'} [2024-08-06 04:47:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 460595200. Throughput: 0: 4377.8. Samples: 115157540. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 04:47:57,794][52567] Avg episode reward: [(0, '73.014')] [2024-08-06 04:47:58,010][52671] DAMAGECOUNT value on done: 565567.0 [2024-08-06 04:47:58,010][52671] Sum rewards: 62.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.036', 'weapon5': '0.078', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.288', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.372', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '53.000'} [2024-08-06 04:47:58,089][52668] DAMAGECOUNT value on done: 564336.0 [2024-08-06 04:47:58,089][52668] Sum rewards: 75.531, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO2': '0.002', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon5': '0.182', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '61.000'} [2024-08-06 04:47:59,680][52660] DAMAGECOUNT value on done: 561334.0 [2024-08-06 04:47:59,680][52660] Sum rewards: 79.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.862', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.163', 'weapon2': '0.292', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '65.000'} [2024-08-06 04:48:00,134][52658] DAMAGECOUNT value on done: 562705.0 [2024-08-06 04:48:00,134][52658] Sum rewards: 87.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.544', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.137', 'AMMO3': '0.243', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '74.000'} [2024-08-06 04:48:00,169][52650] Updated weights for policy 0, policy_version 56231 (0.0013) [2024-08-06 04:48:00,632][52662] DAMAGECOUNT value on done: 570155.0 [2024-08-06 04:48:00,634][52662] Sum rewards: 72.536, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.075', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon2': '0.172', 'AMMO3': '0.188', 'AMMO4': '0.203', 'weapon5': '0.276', 'weapon4': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:00,802][52671] DAMAGECOUNT value on done: 563373.0 [2024-08-06 04:48:00,803][52671] Sum rewards: 62.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '50.000'} [2024-08-06 04:48:00,848][52668] DAMAGECOUNT value on done: 561704.0 [2024-08-06 04:48:00,849][52668] Sum rewards: 74.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.156', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '60.000'} [2024-08-06 04:48:00,858][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:48:01,650][52795] DAMAGECOUNT value on done: 519381.0 [2024-08-06 04:48:01,651][52795] Sum rewards: 77.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'weapon2': '0.270', 'weapon4': '0.302', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:02,507][52660] DAMAGECOUNT value on done: 551055.0 [2024-08-06 04:48:02,510][52660] Sum rewards: 70.781, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.128', 'AMMO3': '0.163', 'weapon4': '0.186', 'WEAPON4': '0.300', 'HEALTH': '0.333', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.114', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '54.000'} [2024-08-06 04:48:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 460685312. Throughput: 0: 4381.6. Samples: 115170710. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:48:02,802][52567] Avg episode reward: [(0, '73.395')] [2024-08-06 04:48:02,919][52820] Large shaping reward 2.503 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('weapon5', 0.002)] [2024-08-06 04:48:02,959][52658] DAMAGECOUNT value on done: 550360.0 [2024-08-06 04:48:02,960][52658] Sum rewards: 77.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.606', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.166', 'weapon2': '0.182', 'weapon5': '0.190', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:03,392][52671] DAMAGECOUNT value on done: 560991.0 [2024-08-06 04:48:03,394][52671] Sum rewards: 74.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.696', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.118', 'AMMO3': '0.217', 'weapon5': '0.230', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 04:48:03,662][52668] DAMAGECOUNT value on done: 552894.0 [2024-08-06 04:48:03,665][52668] Sum rewards: 76.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.754', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.237', 'weapon5': '0.256', 'weapon2': '0.282', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:03,765][52662] DAMAGECOUNT value on done: 556453.0 [2024-08-06 04:48:03,765][52662] Sum rewards: 70.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.509', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.048', 'AMMO4': '0.155', 'AMMO3': '0.242', 'weapon5': '0.256', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:04,817][52650] Updated weights for policy 0, policy_version 56241 (0.0022) [2024-08-06 04:48:04,833][52795] DAMAGECOUNT value on done: 511139.0 [2024-08-06 04:48:04,834][52795] Sum rewards: 77.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.764', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.207', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:05,243][52660] DAMAGECOUNT value on done: 562389.0 [2024-08-06 04:48:05,244][52660] Sum rewards: 67.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.424', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon4': '0.138', 'AMMO4': '0.142', 'AMMO3': '0.200', 'weapon5': '0.222', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.034', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '56.000'} [2024-08-06 04:48:05,984][52658] DAMAGECOUNT value on done: 566161.0 [2024-08-06 04:48:05,984][52658] Sum rewards: 88.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.713', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.064', 'AMMO4': '0.067', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '73.000'} [2024-08-06 04:48:06,581][52668] DAMAGECOUNT value on done: 546361.0 [2024-08-06 04:48:06,581][52668] Sum rewards: 72.273, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '2.804', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:06,603][52662] DAMAGECOUNT value on done: 562107.0 [2024-08-06 04:48:06,603][52662] Sum rewards: 65.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO4': '0.240', 'weapon4': '0.244', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '55.000'} [2024-08-06 04:48:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 460775424. Throughput: 0: 4377.8. Samples: 115196930. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:48:07,795][52567] Avg episode reward: [(0, '73.405')] [2024-08-06 04:48:08,047][52795] DAMAGECOUNT value on done: 508933.0 [2024-08-06 04:48:08,051][52795] Sum rewards: 71.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.903', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.112', 'AMMO3': '0.204', 'weapon5': '0.224', 'AMMO4': '0.278', 'weapon2': '0.342', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '59.000'} [2024-08-06 04:48:08,180][52660] DAMAGECOUNT value on done: 568450.0 [2024-08-06 04:48:08,181][52660] Sum rewards: 68.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.634', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.176', 'AMMO4': '0.195', 'weapon2': '0.230', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.166', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '59.000'} [2024-08-06 04:48:09,042][52658] DAMAGECOUNT value on done: 556525.0 [2024-08-06 04:48:09,045][52658] Sum rewards: 66.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.128', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '55.000'} [2024-08-06 04:48:09,543][52668] DAMAGECOUNT value on done: 548805.0 [2024-08-06 04:48:09,544][52668] Sum rewards: 58.445, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.186', 'weapon5': '0.212', 'AMMO3': '0.215', 'AMMO4': '0.279', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '51.000'} [2024-08-06 04:48:09,563][52650] Updated weights for policy 0, policy_version 56251 (0.0012) [2024-08-06 04:48:09,736][52662] DAMAGECOUNT value on done: 558270.0 [2024-08-06 04:48:09,737][52662] Sum rewards: 70.802, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.068', 'weapon5': '0.088', 'AMMO4': '0.099', 'HEALTH': '0.124', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON3': '1.100', 'weapon3': '3.320', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '59.000'} [2024-08-06 04:48:11,192][52795] DAMAGECOUNT value on done: 515058.0 [2024-08-06 04:48:11,194][52795] Sum rewards: 74.096, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.058', 'AMMO4': '0.084', 'weapon5': '0.114', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.768', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '59.000'} [2024-08-06 04:48:11,200][52660] DAMAGECOUNT value on done: 559293.0 [2024-08-06 04:48:11,203][52660] Sum rewards: 70.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.182', 'weapon2': '0.202', 'AMMO4': '0.221', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '60.000'} [2024-08-06 04:48:11,881][52658] DAMAGECOUNT value on done: 557618.0 [2024-08-06 04:48:11,883][52658] Sum rewards: 65.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.662', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.116', 'weapon5': '0.122', 'AMMO4': '0.153', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.064', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '53.000'} [2024-08-06 04:48:12,488][52668] DAMAGECOUNT value on done: 551334.0 [2024-08-06 04:48:12,489][52668] Sum rewards: 78.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.503', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.078', 'AMMO3': '0.186', 'weapon2': '0.218', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '66.000'} [2024-08-06 04:48:12,755][52662] DAMAGECOUNT value on done: 566714.0 [2024-08-06 04:48:12,757][52662] Sum rewards: 76.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.301', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.232', 'weapon5': '0.240', 'AMMO4': '0.254', 'AMMO3': '0.267', 'weapon2': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.866', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '65.000'} [2024-08-06 04:48:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 460865536. Throughput: 0: 4376.9. Samples: 115223050. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:48:12,794][52567] Avg episode reward: [(0, '72.976')] [2024-08-06 04:48:14,184][52660] DAMAGECOUNT value on done: 556411.0 [2024-08-06 04:48:14,185][52660] Sum rewards: 71.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.334', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.130', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '59.000'} [2024-08-06 04:48:14,397][52795] DAMAGECOUNT value on done: 512095.0 [2024-08-06 04:48:14,398][52795] Sum rewards: 76.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.700', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.168', 'weapon5': '0.182', 'AMMO4': '0.242', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.700', 'weapon3': '2.914', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '65.000'} [2024-08-06 04:48:14,517][52650] Updated weights for policy 0, policy_version 56261 (0.0022) [2024-08-06 04:48:14,542][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:48:14,596][52658] DAMAGECOUNT value on done: 565427.0 [2024-08-06 04:48:14,596][52658] Sum rewards: 73.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.256', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '61.000'} [2024-08-06 04:48:15,255][52668] DAMAGECOUNT value on done: 558053.0 [2024-08-06 04:48:15,255][52668] Sum rewards: 79.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.168', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.096', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.219', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '65.000'} [2024-08-06 04:48:15,830][52662] DAMAGECOUNT value on done: 559243.0 [2024-08-06 04:48:15,832][52662] Sum rewards: 67.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.115', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.006', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'weapon2': '0.180', 'AMMO3': '0.221', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.548', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:17,136][52660] DAMAGECOUNT value on done: 553461.0 [2024-08-06 04:48:17,136][52660] Sum rewards: 62.459, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.104', 'weapon4': '0.112', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '3.028', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '51.000'} [2024-08-06 04:48:17,673][52795] DAMAGECOUNT value on done: 520644.0 [2024-08-06 04:48:17,676][52795] Sum rewards: 68.132, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.350', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.148', 'weapon5': '0.212', 'AMMO4': '0.228', 'AMMO3': '0.306', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'weapon3': '2.946', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '60.000'} [2024-08-06 04:48:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 460947456. Throughput: 0: 4381.1. Samples: 115236380. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:48:17,794][52567] Avg episode reward: [(0, '72.715')] [2024-08-06 04:48:18,303][52668] DAMAGECOUNT value on done: 562316.0 [2024-08-06 04:48:18,306][52668] Sum rewards: 72.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.120', 'AMMO4': '0.172', 'AMMO3': '0.218', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '60.500'} [2024-08-06 04:48:18,887][52662] DAMAGECOUNT value on done: 571307.0 [2024-08-06 04:48:18,889][52662] Sum rewards: 76.831, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.408', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.142', 'weapon4': '0.170', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:19,200][52650] Updated weights for policy 0, policy_version 56271 (0.0011) [2024-08-06 04:48:19,998][52660] DAMAGECOUNT value on done: 564589.0 [2024-08-06 04:48:20,000][52660] Sum rewards: 58.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon4': '0.198', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '2.982', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '50.000'} [2024-08-06 04:48:21,012][52795] DAMAGECOUNT value on done: 525892.0 [2024-08-06 04:48:21,016][52795] Sum rewards: 81.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.168', 'weapon2': '0.174', 'AMMO3': '0.179', 'AMMO4': '0.198', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '67.000'} [2024-08-06 04:48:21,253][52668] DAMAGECOUNT value on done: 559689.0 [2024-08-06 04:48:21,257][52668] Sum rewards: 62.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.586', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.060', 'weapon4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.210', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '50.500'} [2024-08-06 04:48:22,022][52662] DAMAGECOUNT value on done: 564492.0 [2024-08-06 04:48:22,024][52662] Sum rewards: 61.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.134', 'AMMO4': '0.202', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.180', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '51.000'} [2024-08-06 04:48:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 461037568. Throughput: 0: 4378.0. Samples: 115262480. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:48:22,794][52567] Avg episode reward: [(0, '72.696')] [2024-08-06 04:48:22,884][52665] DAMAGECOUNT value on done: 547148.0 [2024-08-06 04:48:22,884][52665] Sum rewards: 77.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.698', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.142', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:23,102][52660] DAMAGECOUNT value on done: 557399.0 [2024-08-06 04:48:23,106][52660] Sum rewards: 63.487, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.013', 'AMMO2': '0.062', 'AMMO3': '0.164', 'weapon5': '0.226', 'weapon2': '0.248', 'AMMO4': '0.310', 'weapon4': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '52.000'} [2024-08-06 04:48:23,666][52650] Updated weights for policy 0, policy_version 56281 (0.0012) [2024-08-06 04:48:24,163][52795] DAMAGECOUNT value on done: 519912.0 [2024-08-06 04:48:24,163][52795] Sum rewards: 66.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.642', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '55.000'} [2024-08-06 04:48:24,435][52668] DAMAGECOUNT value on done: 563776.0 [2024-08-06 04:48:24,435][52668] Sum rewards: 70.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.360', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.180', 'AMMO4': '0.183', 'AMMO3': '0.205', 'weapon2': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:25,092][52662] DAMAGECOUNT value on done: 556057.0 [2024-08-06 04:48:25,094][52662] Sum rewards: 59.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon2': '0.156', 'weapon5': '0.176', 'AMMO3': '0.198', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '47.000'} [2024-08-06 04:48:25,752][52660] DAMAGECOUNT value on done: 558525.0 [2024-08-06 04:48:25,754][52660] Sum rewards: 80.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.244', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.146', 'weapon2': '0.180', 'weapon5': '0.186', 'AMMO4': '0.215', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.174', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '69.000'} [2024-08-06 04:48:25,968][52665] DAMAGECOUNT value on done: 564347.0 [2024-08-06 04:48:25,969][52665] Sum rewards: 74.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO4': '0.194', 'AMMO3': '0.198', 'weapon4': '0.290', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:27,117][52668] DAMAGECOUNT value on done: 561203.0 [2024-08-06 04:48:27,119][52668] Sum rewards: 66.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.744', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.106', 'AMMO4': '0.134', 'weapon5': '0.164', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '54.500'} [2024-08-06 04:48:27,280][52795] DAMAGECOUNT value on done: 513508.0 [2024-08-06 04:48:27,281][52795] Sum rewards: 78.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.488', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.112', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '65.000'} [2024-08-06 04:48:27,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 461119488. Throughput: 0: 4378.9. Samples: 115288900. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:48:27,795][52567] Avg episode reward: [(0, '73.178')] [2024-08-06 04:48:27,836][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056290_461127680.pth... [2024-08-06 04:48:27,959][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000055777_456925184.pth [2024-08-06 04:48:28,092][52662] DAMAGECOUNT value on done: 561385.0 [2024-08-06 04:48:28,093][52662] Sum rewards: 80.916, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.807', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.140', 'AMMO4': '0.163', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '66.000'} [2024-08-06 04:48:28,303][52650] Updated weights for policy 0, policy_version 56291 (0.0024) [2024-08-06 04:48:28,906][52660] DAMAGECOUNT value on done: 566547.0 [2024-08-06 04:48:28,906][52660] Sum rewards: 63.812, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.078', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.072', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.321', 'WEAPON3': '1.900', 'HITCOUNT': '3.270', 'weapon3': '3.414', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:28,923][52665] DAMAGECOUNT value on done: 557618.0 [2024-08-06 04:48:28,923][52665] Sum rewards: 72.078, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.112', 'AMMO3': '0.166', 'weapon5': '0.176', 'AMMO4': '0.237', 'HEALTH': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '3.094', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:28,998][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:48:29,423][52820] DAMAGECOUNT value on done: 515762.0 [2024-08-06 04:48:29,423][52820] Sum rewards: 74.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'weapon5': '0.002', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.658', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:30,195][52659] DAMAGECOUNT value on done: 565414.0 [2024-08-06 04:48:30,196][52659] Sum rewards: 62.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.374', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '52.000'} [2024-08-06 04:48:30,488][52795] DAMAGECOUNT value on done: 522564.0 [2024-08-06 04:48:30,489][52795] Sum rewards: 70.580, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.106', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.090', 'weapon5': '0.182', 'AMMO4': '0.266', 'AMMO3': '0.283', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.068', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:31,263][52662] DAMAGECOUNT value on done: 554690.0 [2024-08-06 04:48:31,263][52662] Sum rewards: 64.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.360', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.270', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '56.000'} [2024-08-06 04:48:31,314][52665] DAMAGECOUNT value on done: 552408.0 [2024-08-06 04:48:31,314][52665] Sum rewards: 74.323, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO4': '0.099', 'weapon2': '0.192', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'HITCOUNT': '3.450', 'weapon3': '3.588', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '63.000'} [2024-08-06 04:48:31,661][52660] DAMAGECOUNT value on done: 553151.0 [2024-08-06 04:48:31,661][52660] Sum rewards: 67.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.226', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.138', 'AMMO3': '0.179', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.886', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '55.000'} [2024-08-06 04:48:32,536][52820] DAMAGECOUNT value on done: 518317.0 [2024-08-06 04:48:32,538][52820] Sum rewards: 58.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.823', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.430', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.310', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '49.500'} [2024-08-06 04:48:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 461209600. Throughput: 0: 4371.5. Samples: 115301800. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:48:32,795][52567] Avg episode reward: [(0, '72.548')] [2024-08-06 04:48:33,080][52650] Updated weights for policy 0, policy_version 56301 (0.0025) [2024-08-06 04:48:33,185][52659] DAMAGECOUNT value on done: 560303.0 [2024-08-06 04:48:33,185][52659] Sum rewards: 74.312, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.863', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.198', 'AMMO4': '0.230', 'weapon2': '0.232', 'AMMO3': '0.253', 'weapon5': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.988', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:33,771][52795] DAMAGECOUNT value on done: 519500.0 [2024-08-06 04:48:33,772][52795] Sum rewards: 75.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:34,551][52660] DAMAGECOUNT value on done: 556765.0 [2024-08-06 04:48:34,553][52660] Sum rewards: 82.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.054', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '69.000'} [2024-08-06 04:48:34,584][52665] DAMAGECOUNT value on done: 545035.0 [2024-08-06 04:48:34,588][52665] Sum rewards: 72.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.418', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.166', 'weapon5': '0.204', 'AMMO4': '0.267', 'weapon2': '0.280', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 04:48:35,502][52820] DAMAGECOUNT value on done: 522929.0 [2024-08-06 04:48:35,505][52820] Sum rewards: 75.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.086', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.202', 'weapon4': '0.208', 'AMMO3': '0.234', 'AMMO4': '0.283', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '63.000'} [2024-08-06 04:48:36,322][52659] DAMAGECOUNT value on done: 565497.0 [2024-08-06 04:48:36,323][52659] Sum rewards: 62.452, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.302', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.208', 'AMMO3': '0.240', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.572', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '54.000'} [2024-08-06 04:48:36,857][52795] DAMAGECOUNT value on done: 512809.0 [2024-08-06 04:48:36,857][52795] Sum rewards: 69.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.201', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:37,503][52660] DAMAGECOUNT value on done: 566982.0 [2024-08-06 04:48:37,503][52660] Sum rewards: 69.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.014', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.116', 'AMMO4': '0.139', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:37,552][52665] DAMAGECOUNT value on done: 550829.0 [2024-08-06 04:48:37,557][52665] Sum rewards: 68.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.050', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 461291520. Throughput: 0: 4374.2. Samples: 115328060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:48:37,794][52567] Avg episode reward: [(0, '72.040')] [2024-08-06 04:48:37,952][52650] Updated weights for policy 0, policy_version 56311 (0.0012) [2024-08-06 04:48:38,670][52820] DAMAGECOUNT value on done: 513235.0 [2024-08-06 04:48:38,670][52820] Sum rewards: 82.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'weapon3': '3.502', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '68.000'} [2024-08-06 04:48:39,330][52659] DAMAGECOUNT value on done: 561288.0 [2024-08-06 04:48:39,330][52659] Sum rewards: 76.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.816', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.206', 'AMMO3': '0.224', 'AMMO4': '0.224', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:40,017][52795] DAMAGECOUNT value on done: 514218.0 [2024-08-06 04:48:40,017][52795] Sum rewards: 80.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.055', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.257', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.334', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '67.000'} [2024-08-06 04:48:40,171][52662] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:48:40,457][52660] DAMAGECOUNT value on done: 573591.0 [2024-08-06 04:48:40,458][52660] Sum rewards: 73.261, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.031', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.100', 'weapon5': '0.146', 'AMMO3': '0.241', 'AMMO4': '0.254', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '61.000'} [2024-08-06 04:48:40,633][52665] DAMAGECOUNT value on done: 555188.0 [2024-08-06 04:48:40,636][52665] Sum rewards: 66.342, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.976', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.088', 'AMMO4': '0.139', 'weapon5': '0.142', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.176', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:41,019][52647] Large shaping reward 2.599 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.033, -11.0), ('weapon5', 0.002)] [2024-08-06 04:48:41,653][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:48:41,793][52820] DAMAGECOUNT value on done: 523439.0 [2024-08-06 04:48:41,793][52820] Sum rewards: 84.553, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.202', 'weapon2': '0.312', 'HEALTH': '0.540', 'WEAPON3': '1.100', 'weapon3': '3.432', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '69.000'} [2024-08-06 04:48:42,018][52794] DAMAGECOUNT value on done: 564243.0 [2024-08-06 04:48:42,020][52794] Sum rewards: 74.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.647', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.102', 'weapon4': '0.104', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:42,060][52659] DAMAGECOUNT value on done: 557578.0 [2024-08-06 04:48:42,060][52659] Sum rewards: 68.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.140', 'weapon5': '0.174', 'AMMO4': '0.180', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:42,398][52650] Updated weights for policy 0, policy_version 56321 (0.0013) [2024-08-06 04:48:42,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 461381632. Throughput: 0: 4375.8. Samples: 115354450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:48:42,794][52567] Avg episode reward: [(0, '72.220')] [2024-08-06 04:48:43,083][52795] DAMAGECOUNT value on done: 519587.0 [2024-08-06 04:48:43,083][52795] Sum rewards: 75.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.278', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.162', 'weapon2': '0.166', 'weapon5': '0.178', 'AMMO3': '0.231', 'AMMO4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '63.000'} [2024-08-06 04:48:43,324][52660] DAMAGECOUNT value on done: 555821.0 [2024-08-06 04:48:43,326][52660] Sum rewards: 65.392, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.304', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.070', 'weapon4': '0.124', 'AMMO3': '0.232', 'weapon2': '0.272', 'weapon5': '0.300', 'AMMO4': '0.349', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '2.878', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:43,661][52665] DAMAGECOUNT value on done: 554290.0 [2024-08-06 04:48:43,664][52665] Sum rewards: 70.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.114', 'weapon4': '0.156', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:44,746][52659] DAMAGECOUNT value on done: 560692.0 [2024-08-06 04:48:44,750][52659] Sum rewards: 66.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.118', 'weapon4': '0.138', 'AMMO4': '0.160', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.500', 'weapon3': '2.966', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:44,856][52820] DAMAGECOUNT value on done: 514740.0 [2024-08-06 04:48:44,856][52820] Sum rewards: 77.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.434', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '63.000'} [2024-08-06 04:48:45,093][52794] DAMAGECOUNT value on done: 570345.0 [2024-08-06 04:48:45,093][52794] Sum rewards: 89.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.147', 'AMMO3': '0.200', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.885', 'FRAGCOUNT': '71.000'} [2024-08-06 04:48:46,140][52795] DAMAGECOUNT value on done: 510993.0 [2024-08-06 04:48:46,142][52795] Sum rewards: 60.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.075', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon2': '0.168', 'weapon5': '0.188', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.392', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '2.936', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '51.000'} [2024-08-06 04:48:46,272][52660] DAMAGECOUNT value on done: 563326.0 [2024-08-06 04:48:46,273][52660] Sum rewards: 66.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.185', 'weapon2': '0.232', 'WEAPON4': '0.350', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '55.000'} [2024-08-06 04:48:46,563][52670] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:48:46,891][52665] DAMAGECOUNT value on done: 561111.0 [2024-08-06 04:48:46,891][52665] Sum rewards: 76.399, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.142', 'AMMO3': '0.201', 'weapon5': '0.206', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:47,219][52650] Updated weights for policy 0, policy_version 56331 (0.0033) [2024-08-06 04:48:47,423][52659] DAMAGECOUNT value on done: 562113.0 [2024-08-06 04:48:47,423][52659] Sum rewards: 72.723, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.792', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.172', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 461471744. Throughput: 0: 4373.6. Samples: 115367520. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:48:47,794][52567] Avg episode reward: [(0, '71.746')] [2024-08-06 04:48:48,027][52647] Large shaping reward 2.750 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 04:48:48,064][52820] DAMAGECOUNT value on done: 519496.0 [2024-08-06 04:48:48,064][52820] Sum rewards: 78.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.825', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.108', 'weapon5': '0.134', 'AMMO3': '0.176', 'AMMO4': '0.196', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.276', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '62.000'} [2024-08-06 04:48:48,403][52794] DAMAGECOUNT value on done: 567586.0 [2024-08-06 04:48:48,404][52794] Sum rewards: 77.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO3': '0.213', 'weapon2': '0.248', 'WEAPON3': '1.350', 'weapon3': '3.514', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '65.000'} [2024-08-06 04:48:49,059][52660] DAMAGECOUNT value on done: 558547.0 [2024-08-06 04:48:49,061][52660] Sum rewards: 76.149, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.144', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:49,285][52795] DAMAGECOUNT value on done: 527364.0 [2024-08-06 04:48:49,285][52795] Sum rewards: 77.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.531', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.181', 'weapon5': '0.186', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '63.000'} [2024-08-06 04:48:49,946][52665] DAMAGECOUNT value on done: 555550.0 [2024-08-06 04:48:49,954][52665] Sum rewards: 79.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.672', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.142', 'weapon4': '0.146', 'AMMO4': '0.180', 'AMMO3': '0.215', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '65.000'} [2024-08-06 04:48:50,136][52659] DAMAGECOUNT value on done: 559149.0 [2024-08-06 04:48:50,136][52659] Sum rewards: 73.634, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.025', 'AMMO2': '0.059', 'weapon4': '0.158', 'AMMO3': '0.237', 'AMMO4': '0.296', 'weapon5': '0.308', 'weapon2': '0.318', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '61.000'} [2024-08-06 04:48:51,197][52794] DAMAGECOUNT value on done: 559397.0 [2024-08-06 04:48:51,198][52794] Sum rewards: 71.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.272', 'AMMO5': '0.023', 'AMMO2': '0.074', 'weapon5': '0.202', 'AMMO3': '0.214', 'weapon4': '0.228', 'AMMO4': '0.369', 'WEAPON5': '0.600', 'weapon2': '0.674', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.598', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '58.000'} [2024-08-06 04:48:51,274][52820] DAMAGECOUNT value on done: 521146.0 [2024-08-06 04:48:51,278][52820] Sum rewards: 75.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.614', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.320', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:51,600][52650] Updated weights for policy 0, policy_version 56341 (0.0017) [2024-08-06 04:48:51,805][52660] DAMAGECOUNT value on done: 559025.0 [2024-08-06 04:48:51,807][52660] Sum rewards: 61.027, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.786', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.214', 'AMMO3': '0.258', 'weapon5': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.710', 'WEAPON3': '1.250', 'weapon3': '2.498', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '50.500'} [2024-08-06 04:48:52,450][52795] DAMAGECOUNT value on done: 517783.0 [2024-08-06 04:48:52,452][52795] Sum rewards: 59.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon4': '0.090', 'weapon5': '0.184', 'AMMO3': '0.239', 'AMMO4': '0.242', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '2.910', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '52.000'} [2024-08-06 04:48:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 461561856. Throughput: 0: 4371.1. Samples: 115393630. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:48:52,794][52567] Avg episode reward: [(0, '71.889')] [2024-08-06 04:48:52,833][52665] DAMAGECOUNT value on done: 565587.0 [2024-08-06 04:48:52,835][52665] Sum rewards: 75.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.104', 'weapon2': '0.166', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.440', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 04:48:52,911][52659] DAMAGECOUNT value on done: 565366.0 [2024-08-06 04:48:52,911][52659] Sum rewards: 79.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.526', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.088', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '67.000'} [2024-08-06 04:48:54,316][52794] DAMAGECOUNT value on done: 558454.0 [2024-08-06 04:48:54,317][52794] Sum rewards: 70.528, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.182', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '59.000'} [2024-08-06 04:48:54,426][52820] DAMAGECOUNT value on done: 516581.0 [2024-08-06 04:48:54,427][52820] Sum rewards: 74.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.478', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '61.000'} [2024-08-06 04:48:54,911][52660] DAMAGECOUNT value on done: 551133.0 [2024-08-06 04:48:54,913][52660] Sum rewards: 70.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.024', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.282', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '56.000'} [2024-08-06 04:48:55,614][52795] DAMAGECOUNT value on done: 512316.0 [2024-08-06 04:48:55,616][52795] Sum rewards: 66.974, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.368', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.114', 'weapon5': '0.132', 'AMMO3': '0.245', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.122', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '60.000'} [2024-08-06 04:48:55,768][52665] DAMAGECOUNT value on done: 560701.0 [2024-08-06 04:48:55,769][52665] Sum rewards: 79.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.124', 'weapon4': '0.182', 'AMMO4': '0.212', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '66.000'} [2024-08-06 04:48:56,064][52659] DAMAGECOUNT value on done: 568516.0 [2024-08-06 04:48:56,066][52659] Sum rewards: 72.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.875', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon4': '0.116', 'AMMO4': '0.164', 'AMMO3': '0.221', 'weapon5': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '60.000'} [2024-08-06 04:48:56,470][52650] Updated weights for policy 0, policy_version 56351 (0.0013) [2024-08-06 04:48:57,304][52794] DAMAGECOUNT value on done: 560783.0 [2024-08-06 04:48:57,306][52794] Sum rewards: 81.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.143', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.148', 'weapon5': '0.164', 'AMMO4': '0.210', 'AMMO3': '0.256', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '68.000'} [2024-08-06 04:48:57,607][52820] DAMAGECOUNT value on done: 526231.0 [2024-08-06 04:48:57,609][52820] Sum rewards: 67.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon2': '0.144', 'AMMO4': '0.149', 'AMMO3': '0.212', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.292', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 461643776. Throughput: 0: 4375.3. Samples: 115419940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:48:57,794][52567] Avg episode reward: [(0, '72.001')] [2024-08-06 04:48:58,718][52795] DAMAGECOUNT value on done: 519057.0 [2024-08-06 04:48:58,721][52795] Sum rewards: 68.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.714', 'AMMO5': '0.016', 'AMMO2': '0.067', 'weapon4': '0.104', 'AMMO3': '0.235', 'weapon5': '0.276', 'AMMO4': '0.337', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '57.000'} [2024-08-06 04:48:58,891][52665] DAMAGECOUNT value on done: 555645.0 [2024-08-06 04:48:58,893][52665] Sum rewards: 63.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.088', 'AMMO4': '0.149', 'weapon5': '0.170', 'AMMO3': '0.201', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.268', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '51.000'} [2024-08-06 04:48:58,976][52659] DAMAGECOUNT value on done: 558003.0 [2024-08-06 04:48:58,978][52659] Sum rewards: 70.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.959', 'AMMO5': '0.026', 'AMMO2': '0.073', 'AMMO3': '0.185', 'weapon5': '0.314', 'AMMO4': '0.363', 'weapon4': '0.380', 'weapon2': '0.426', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.510', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '57.000'} [2024-08-06 04:49:00,598][52794] DAMAGECOUNT value on done: 568611.0 [2024-08-06 04:49:00,598][52794] Sum rewards: 83.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.186', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.090', 'AMMO4': '0.095', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.440', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '69.000'} [2024-08-06 04:49:00,720][52820] DAMAGECOUNT value on done: 516024.0 [2024-08-06 04:49:00,721][52820] Sum rewards: 83.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.144', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.088', 'AMMO4': '0.168', 'weapon5': '0.174', 'AMMO3': '0.254', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '69.000'} [2024-08-06 04:49:01,154][52650] Updated weights for policy 0, policy_version 56361 (0.0018) [2024-08-06 04:49:01,433][52665] DAMAGECOUNT value on done: 556150.0 [2024-08-06 04:49:01,435][52665] Sum rewards: 70.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.714', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.175', 'weapon5': '0.176', 'weapon4': '0.184', 'AMMO4': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.000', 'weapon3': '2.802', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:01,825][52795] DAMAGECOUNT value on done: 524090.0 [2024-08-06 04:49:01,825][52795] Sum rewards: 76.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:02,018][52659] DAMAGECOUNT value on done: 563837.0 [2024-08-06 04:49:02,018][52659] Sum rewards: 76.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.118', 'weapon5': '0.164', 'AMMO4': '0.208', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 461733888. Throughput: 0: 4378.2. Samples: 115433400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:49:02,794][52567] Avg episode reward: [(0, '71.997')] [2024-08-06 04:49:03,493][52794] DAMAGECOUNT value on done: 555029.0 [2024-08-06 04:49:03,493][52794] Sum rewards: 79.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.658', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO4': '0.138', 'AMMO3': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:03,831][52820] DAMAGECOUNT value on done: 521290.0 [2024-08-06 04:49:03,835][52820] Sum rewards: 72.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.360', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.217', 'weapon4': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.238', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:04,185][52665] DAMAGECOUNT value on done: 552949.0 [2024-08-06 04:49:04,188][52665] Sum rewards: 68.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.802', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.118', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:04,975][52659] DAMAGECOUNT value on done: 555807.0 [2024-08-06 04:49:04,977][52659] Sum rewards: 68.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.076', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO3': '0.193', 'AMMO4': '0.220', 'weapon4': '0.234', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:05,848][52650] Updated weights for policy 0, policy_version 56371 (0.0018) [2024-08-06 04:49:05,895][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:49:06,236][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:49:06,399][52794] DAMAGECOUNT value on done: 565533.0 [2024-08-06 04:49:06,402][52794] Sum rewards: 73.812, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.025', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.072', 'weapon5': '0.108', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:06,658][52665] DAMAGECOUNT value on done: 550762.0 [2024-08-06 04:49:06,660][52665] Sum rewards: 69.161, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.025', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.104', 'AMMO3': '0.175', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.400', 'weapon2': '0.878', 'WEAPON3': '1.100', 'weapon3': '2.488', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '55.000'} [2024-08-06 04:49:06,902][52820] DAMAGECOUNT value on done: 528987.0 [2024-08-06 04:49:06,903][52820] Sum rewards: 73.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.306', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.124', 'AMMO4': '0.148', 'weapon2': '0.206', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.332', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:07,756][52659] DAMAGECOUNT value on done: 559800.0 [2024-08-06 04:49:07,759][52659] Sum rewards: 70.766, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.445', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.100', 'weapon5': '0.126', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 461824000. Throughput: 0: 4383.6. Samples: 115459740. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 04:49:07,794][52567] Avg episode reward: [(0, '72.142')] [2024-08-06 04:49:08,565][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:49:08,926][52794] DAMAGECOUNT value on done: 561424.0 [2024-08-06 04:49:08,926][52794] Sum rewards: 81.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.169', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.854', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '66.000'} [2024-08-06 04:49:09,718][52665] DAMAGECOUNT value on done: 553350.0 [2024-08-06 04:49:09,718][52665] Sum rewards: 71.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.170', 'weapon2': '0.466', 'WEAPON3': '1.100', 'HITCOUNT': '3.350', 'weapon3': '3.362', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:10,036][52820] DAMAGECOUNT value on done: 523605.0 [2024-08-06 04:49:10,039][52820] Sum rewards: 71.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.118', 'AMMO3': '0.212', 'weapon5': '0.250', 'AMMO4': '0.275', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '2.836', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '59.000'} [2024-08-06 04:49:10,321][52650] Updated weights for policy 0, policy_version 56381 (0.0028) [2024-08-06 04:49:10,809][52659] DAMAGECOUNT value on done: 571107.0 [2024-08-06 04:49:10,811][52659] Sum rewards: 69.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.240', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.163', 'weapon5': '0.184', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.426', 'WEAPON3': '1.000', 'weapon3': '2.864', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '55.000'} [2024-08-06 04:49:11,981][52794] DAMAGECOUNT value on done: 557908.0 [2024-08-06 04:49:11,982][52794] Sum rewards: 71.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '57.000'} [2024-08-06 04:49:12,514][52647] DAMAGECOUNT value on done: 595893.0 [2024-08-06 04:49:12,515][52647] Sum rewards: 85.776, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.168', 'weapon5': '0.170', 'AMMO3': '0.265', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.150', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '73.000'} [2024-08-06 04:49:12,786][52665] DAMAGECOUNT value on done: 550249.0 [2024-08-06 04:49:12,786][52665] Sum rewards: 73.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.895', 'AMMO5': '0.013', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.122', 'AMMO3': '0.188', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.794', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 461914112. Throughput: 0: 4377.1. Samples: 115485870. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 04:49:12,794][52567] Avg episode reward: [(0, '72.282')] [2024-08-06 04:49:13,157][52820] DAMAGECOUNT value on done: 526377.0 [2024-08-06 04:49:13,157][52820] Sum rewards: 75.503, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.129', 'weapon4': '0.164', 'weapon5': '0.178', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon3': '3.202', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:13,892][52659] DAMAGECOUNT value on done: 563497.0 [2024-08-06 04:49:13,892][52659] Sum rewards: 77.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.284', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.156', 'AMMO3': '0.221', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.174', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '64.000'} [2024-08-06 04:49:14,332][52794] DAMAGECOUNT value on done: 562958.0 [2024-08-06 04:49:14,335][52794] Sum rewards: 65.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.115', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'weapon4': '0.096', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.490', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:15,144][52647] DAMAGECOUNT value on done: 591709.0 [2024-08-06 04:49:15,151][52647] Sum rewards: 61.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.016', 'AMMO2': '0.034', 'WEAPON1': '0.040', 'weapon5': '0.104', 'weapon4': '0.158', 'AMMO3': '0.167', 'AMMO4': '0.172', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.188', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '51.000'} [2024-08-06 04:49:15,189][52650] Updated weights for policy 0, policy_version 56391 (0.0012) [2024-08-06 04:49:15,899][52665] DAMAGECOUNT value on done: 554537.0 [2024-08-06 04:49:15,901][52665] Sum rewards: 79.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.104', 'AMMO3': '0.185', 'weapon5': '0.200', 'weapon2': '0.240', 'AMMO4': '0.273', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:16,269][52820] DAMAGECOUNT value on done: 521077.0 [2024-08-06 04:49:16,272][52820] Sum rewards: 76.292, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.293', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.098', 'AMMO4': '0.120', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.234', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:16,810][52659] DAMAGECOUNT value on done: 571493.0 [2024-08-06 04:49:16,810][52659] Sum rewards: 72.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.080', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.124', 'weapon5': '0.148', 'AMMO4': '0.172', 'AMMO3': '0.268', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.086', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:17,113][52794] DAMAGECOUNT value on done: 558501.0 [2024-08-06 04:49:17,113][52794] Sum rewards: 76.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'AMMO4': '0.179', 'weapon5': '0.180', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 461996032. Throughput: 0: 4383.4. Samples: 115499050. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 04:49:17,794][52567] Avg episode reward: [(0, '72.525')] [2024-08-06 04:49:18,029][52647] DAMAGECOUNT value on done: 592361.0 [2024-08-06 04:49:18,032][52647] Sum rewards: 68.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.584', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.142', 'AMMO3': '0.214', 'weapon2': '0.254', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:18,995][52665] DAMAGECOUNT value on done: 555406.0 [2024-08-06 04:49:18,997][52665] Sum rewards: 74.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.532', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.098', 'weapon5': '0.140', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:19,430][52820] DAMAGECOUNT value on done: 523328.0 [2024-08-06 04:49:19,430][52820] Sum rewards: 71.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.315', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.368', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:19,506][52659] DAMAGECOUNT value on done: 561664.0 [2024-08-06 04:49:19,506][52659] Sum rewards: 82.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.032', 'AMMO4': '0.092', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '68.000'} [2024-08-06 04:49:19,854][52650] Updated weights for policy 0, policy_version 56401 (0.0027) [2024-08-06 04:49:20,044][52794] DAMAGECOUNT value on done: 576782.0 [2024-08-06 04:49:20,045][52794] Sum rewards: 69.003, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.808', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.111', 'weapon4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:20,411][52647] DAMAGECOUNT value on done: 599283.0 [2024-08-06 04:49:20,411][52647] Sum rewards: 70.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.988', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.134', 'weapon5': '0.164', 'AMMO4': '0.209', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:22,576][52659] DAMAGECOUNT value on done: 566543.0 [2024-08-06 04:49:22,577][52659] Sum rewards: 75.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.112', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:22,618][52820] DAMAGECOUNT value on done: 532816.0 [2024-08-06 04:49:22,619][52820] Sum rewards: 79.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '66.000'} [2024-08-06 04:49:22,700][52663] DAMAGECOUNT value on done: 571981.0 [2024-08-06 04:49:22,703][52663] Sum rewards: 96.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.208', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.190', 'AMMO3': '0.220', 'AMMO4': '0.243', 'weapon2': '0.254', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '80.000'} [2024-08-06 04:49:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 462086144. Throughput: 0: 4383.3. Samples: 115525310. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 04:49:22,795][52567] Avg episode reward: [(0, '73.193')] [2024-08-06 04:49:23,202][52811] DAMAGECOUNT value on done: 537450.0 [2024-08-06 04:49:23,202][52811] Sum rewards: 79.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.680', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.155', 'weapon4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:23,252][52794] DAMAGECOUNT value on done: 554277.0 [2024-08-06 04:49:23,252][52794] Sum rewards: 64.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.298', 'weapon2': '0.322', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.008', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '53.000'} [2024-08-06 04:49:23,294][52647] DAMAGECOUNT value on done: 600581.0 [2024-08-06 04:49:23,294][52647] Sum rewards: 80.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.222', 'weapon4': '0.246', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '64.000'} [2024-08-06 04:49:23,366][52614] Signal inference workers to stop experience collection... (10250 times) [2024-08-06 04:49:23,368][52614] Signal inference workers to resume experience collection... (10250 times) [2024-08-06 04:49:23,423][52650] InferenceWorker_p0-w0: stopping experience collection (10250 times) [2024-08-06 04:49:23,423][52650] InferenceWorker_p0-w0: resuming experience collection (10250 times) [2024-08-06 04:49:24,424][52650] Updated weights for policy 0, policy_version 56411 (0.0027) [2024-08-06 04:49:25,414][52811] Large shaping reward 3.641 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:49:25,618][52663] DAMAGECOUNT value on done: 562029.0 [2024-08-06 04:49:25,618][52663] Sum rewards: 71.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.177', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:25,670][52659] DAMAGECOUNT value on done: 562545.0 [2024-08-06 04:49:25,673][52659] Sum rewards: 71.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.704', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.314', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:25,808][52820] DAMAGECOUNT value on done: 529885.0 [2024-08-06 04:49:25,811][52820] Sum rewards: 64.838, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.322', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.304', 'WEAPON3': '1.900', 'HITCOUNT': '3.020', 'weapon3': '3.390', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:26,069][52811] DAMAGECOUNT value on done: 520350.0 [2024-08-06 04:49:26,071][52811] Sum rewards: 61.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.123', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.058', 'weapon5': '0.112', 'AMMO4': '0.134', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.702', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '50.000'} [2024-08-06 04:49:26,219][52647] DAMAGECOUNT value on done: 599302.0 [2024-08-06 04:49:26,219][52647] Sum rewards: 69.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:26,281][52794] DAMAGECOUNT value on done: 571747.0 [2024-08-06 04:49:26,282][52794] Sum rewards: 80.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.309', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.084', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '66.000'} [2024-08-06 04:49:27,122][52663] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:49:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 462176256. Throughput: 0: 4372.2. Samples: 115551200. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 04:49:27,794][52567] Avg episode reward: [(0, '73.177')] [2024-08-06 04:49:28,512][52647] DAMAGECOUNT value on done: 595441.0 [2024-08-06 04:49:28,512][52647] Sum rewards: 78.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.172', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.078', 'weapon5': '0.144', 'weapon2': '0.204', 'AMMO3': '0.228', 'AMMO4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '66.000'} [2024-08-06 04:49:28,586][52667] DAMAGECOUNT value on done: 564198.0 [2024-08-06 04:49:28,586][52667] Sum rewards: 75.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.985', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO4': '0.167', 'weapon2': '0.176', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'weapon3': '3.408', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:28,765][52663] DAMAGECOUNT value on done: 552401.0 [2024-08-06 04:49:28,765][52663] Sum rewards: 74.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.296', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.110', 'weapon5': '0.190', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:28,975][52820] DAMAGECOUNT value on done: 516526.0 [2024-08-06 04:49:28,975][52820] Sum rewards: 72.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.144', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '59.000'} [2024-08-06 04:49:29,159][52811] DAMAGECOUNT value on done: 519801.0 [2024-08-06 04:49:29,163][52811] Sum rewards: 69.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.132', 'weapon4': '0.166', 'weapon2': '0.190', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.266', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:29,171][52794] DAMAGECOUNT value on done: 561019.0 [2024-08-06 04:49:29,172][52794] Sum rewards: 67.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.616', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.133', 'weapon5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '55.000'} [2024-08-06 04:49:29,390][52650] Updated weights for policy 0, policy_version 56421 (0.0019) [2024-08-06 04:49:31,027][52647] DAMAGECOUNT value on done: 585482.0 [2024-08-06 04:49:31,027][52647] Sum rewards: 77.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO4': '0.136', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '64.000'} [2024-08-06 04:49:31,668][52667] DAMAGECOUNT value on done: 571690.0 [2024-08-06 04:49:31,668][52667] Sum rewards: 71.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.894', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.128', 'weapon2': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:31,903][52663] DAMAGECOUNT value on done: 559112.0 [2024-08-06 04:49:31,904][52663] Sum rewards: 68.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '57.000'} [2024-08-06 04:49:32,071][52794] DAMAGECOUNT value on done: 571315.0 [2024-08-06 04:49:32,075][52794] Sum rewards: 72.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.832', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.176', 'AMMO3': '0.209', 'AMMO4': '0.232', 'weapon4': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:32,267][52811] DAMAGECOUNT value on done: 522205.0 [2024-08-06 04:49:32,269][52811] Sum rewards: 62.492, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.450', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.082', 'weapon5': '0.182', 'AMMO3': '0.248', 'AMMO4': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 462258176. Throughput: 0: 4372.9. Samples: 115564300. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 04:49:32,795][52567] Avg episode reward: [(0, '73.309')] [2024-08-06 04:49:33,420][52647] DAMAGECOUNT value on done: 596574.0 [2024-08-06 04:49:33,421][52647] Sum rewards: 78.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.052', 'AMMO4': '0.131', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:33,771][52650] Updated weights for policy 0, policy_version 56431 (0.0025) [2024-08-06 04:49:34,653][52667] DAMAGECOUNT value on done: 564336.0 [2024-08-06 04:49:34,654][52667] Sum rewards: 73.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.114', 'weapon5': '0.146', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:34,973][52663] DAMAGECOUNT value on done: 563359.0 [2024-08-06 04:49:34,974][52663] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.605', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.121', 'weapon5': '0.142', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.326', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:35,104][52794] DAMAGECOUNT value on done: 572211.0 [2024-08-06 04:49:35,106][52794] Sum rewards: 85.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.288', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '71.000'} [2024-08-06 04:49:35,330][52811] DAMAGECOUNT value on done: 527950.0 [2024-08-06 04:49:35,331][52811] Sum rewards: 62.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.177', 'AMMO4': '0.218', 'weapon4': '0.226', 'weapon5': '0.242', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.728', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '50.000'} [2024-08-06 04:49:36,575][52647] DAMAGECOUNT value on done: 592569.0 [2024-08-06 04:49:36,576][52647] Sum rewards: 81.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon4': '0.140', 'AMMO3': '0.199', 'weapon2': '0.244', 'weapon5': '0.274', 'AMMO4': '0.326', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '64.000'} [2024-08-06 04:49:37,676][52667] DAMAGECOUNT value on done: 565793.0 [2024-08-06 04:49:37,677][52667] Sum rewards: 72.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.284', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.070', 'weapon4': '0.072', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 462340096. Throughput: 0: 4374.0. Samples: 115590460. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 04:49:37,794][52567] Avg episode reward: [(0, '73.338')] [2024-08-06 04:49:37,969][52666] DAMAGECOUNT value on done: 561204.0 [2024-08-06 04:49:37,970][52666] Sum rewards: 76.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.187', 'weapon4': '0.206', 'AMMO3': '0.207', 'weapon5': '0.240', 'weapon2': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:38,090][52663] DAMAGECOUNT value on done: 569008.0 [2024-08-06 04:49:38,092][52663] Sum rewards: 76.229, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon2': '0.128', 'weapon5': '0.132', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:38,400][52811] DAMAGECOUNT value on done: 532607.0 [2024-08-06 04:49:38,403][52811] Sum rewards: 60.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.894', 'AMMO5': '0.003', 'AMMO2': '0.034', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.213', 'weapon2': '0.232', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.166', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '52.000'} [2024-08-06 04:49:38,623][52650] Updated weights for policy 0, policy_version 56441 (0.0012) [2024-08-06 04:49:38,806][52794] DAMAGECOUNT value on done: 560628.0 [2024-08-06 04:49:38,807][52794] Sum rewards: 82.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.686', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.288', 'weapon4': '0.328', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '68.000'} [2024-08-06 04:49:39,755][52647] DAMAGECOUNT value on done: 592150.0 [2024-08-06 04:49:39,756][52647] Sum rewards: 71.056, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.056', 'weapon5': '0.132', 'AMMO4': '0.246', 'AMMO3': '0.251', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '63.500'} [2024-08-06 04:49:39,839][52670] DAMAGECOUNT value on done: 552787.0 [2024-08-06 04:49:39,841][52670] Sum rewards: 71.951, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.055', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.148', 'weapon5': '0.166', 'AMMO4': '0.188', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'AMMO3': '0.368', 'WEAPON3': '2.050', 'weapon3': '3.038', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:40,569][52667] DAMAGECOUNT value on done: 569282.0 [2024-08-06 04:49:40,569][52667] Sum rewards: 82.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.175', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon4': '0.234', 'weapon2': '0.248', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '69.000'} [2024-08-06 04:49:41,219][52666] DAMAGECOUNT value on done: 564999.0 [2024-08-06 04:49:41,219][52666] Sum rewards: 76.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.020', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'weapon5': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:41,436][52663] DAMAGECOUNT value on done: 562946.0 [2024-08-06 04:49:41,440][52663] Sum rewards: 67.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.970', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.214', 'weapon2': '0.248', 'weapon5': '0.292', 'weapon4': '0.496', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.530', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:41,625][52811] DAMAGECOUNT value on done: 529796.0 [2024-08-06 04:49:41,633][52811] Sum rewards: 81.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.084', 'AMMO3': '0.204', 'AMMO4': '0.218', 'weapon2': '0.242', 'weapon5': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:42,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 462438400. Throughput: 0: 4367.8. Samples: 115616490. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 04:49:42,794][52567] Avg episode reward: [(0, '73.489')] [2024-08-06 04:49:42,821][52647] DAMAGECOUNT value on done: 585988.0 [2024-08-06 04:49:42,821][52647] Sum rewards: 67.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.538', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.476', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:42,963][52670] DAMAGECOUNT value on done: 563589.0 [2024-08-06 04:49:42,966][52670] Sum rewards: 86.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.048', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.245', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '72.000'} [2024-08-06 04:49:43,239][52650] Updated weights for policy 0, policy_version 56451 (0.0019) [2024-08-06 04:49:43,322][52667] DAMAGECOUNT value on done: 572572.0 [2024-08-06 04:49:43,323][52667] Sum rewards: 63.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.232', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.068', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '3.300', 'weapon3': '3.414', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '53.000'} [2024-08-06 04:49:44,083][52666] DAMAGECOUNT value on done: 565389.0 [2024-08-06 04:49:44,084][52666] Sum rewards: 73.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.877', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '59.000'} [2024-08-06 04:49:44,380][52663] DAMAGECOUNT value on done: 557728.0 [2024-08-06 04:49:44,380][52663] Sum rewards: 63.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.855', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.162', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon5': '0.218', 'AMMO4': '0.231', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '53.000'} [2024-08-06 04:49:44,733][52811] DAMAGECOUNT value on done: 523079.0 [2024-08-06 04:49:44,734][52811] Sum rewards: 62.546, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.133', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.280', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '53.000'} [2024-08-06 04:49:45,604][52670] DAMAGECOUNT value on done: 555836.0 [2024-08-06 04:49:45,605][52670] Sum rewards: 80.163, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.887', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO4': '0.203', 'AMMO3': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '67.000'} [2024-08-06 04:49:45,949][52647] DAMAGECOUNT value on done: 599654.0 [2024-08-06 04:49:45,949][52647] Sum rewards: 78.954, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.939', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon2': '0.190', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '67.000'} [2024-08-06 04:49:46,058][52667] DAMAGECOUNT value on done: 567063.0 [2024-08-06 04:49:46,059][52667] Sum rewards: 81.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.232', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.122', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '66.000'} [2024-08-06 04:49:46,916][52666] DAMAGECOUNT value on done: 564213.0 [2024-08-06 04:49:46,927][52666] Sum rewards: 77.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.877', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.223', 'weapon5': '0.226', 'weapon2': '0.228', 'WEAPON5': '0.400', 'weapon4': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:47,128][52663] DAMAGECOUNT value on done: 553816.0 [2024-08-06 04:49:47,128][52663] Sum rewards: 73.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.666', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.056', 'AMMO4': '0.117', 'AMMO3': '0.196', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:47,762][52811] DAMAGECOUNT value on done: 533542.0 [2024-08-06 04:49:47,762][52811] Sum rewards: 75.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'weapon4': '0.186', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 462520320. Throughput: 0: 4360.7. Samples: 115629630. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 04:49:47,794][52567] Avg episode reward: [(0, '73.322')] [2024-08-06 04:49:48,080][52650] Updated weights for policy 0, policy_version 56461 (0.0042) [2024-08-06 04:49:48,329][52670] DAMAGECOUNT value on done: 553819.0 [2024-08-06 04:49:48,331][52670] Sum rewards: 75.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.390', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.110', 'weapon5': '0.116', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '0.700', 'weapon3': '3.084', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:48,510][52667] DAMAGECOUNT value on done: 561180.0 [2024-08-06 04:49:48,510][52667] Sum rewards: 66.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.074', 'AMMO5': '0.024', 'AMMO2': '0.046', 'AMMO3': '0.192', 'AMMO4': '0.231', 'weapon4': '0.252', 'weapon5': '0.264', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '54.000'} [2024-08-06 04:49:49,119][52647] DAMAGECOUNT value on done: 589664.0 [2024-08-06 04:49:49,119][52647] Sum rewards: 64.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.421', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.082', 'AMMO3': '0.195', 'weapon5': '0.222', 'AMMO4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '53.000'} [2024-08-06 04:49:49,599][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:49:49,630][52666] DAMAGECOUNT value on done: 557871.0 [2024-08-06 04:49:49,631][52666] Sum rewards: 75.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.830', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.110', 'weapon5': '0.120', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '61.000'} [2024-08-06 04:49:49,743][52803] DAMAGECOUNT value on done: 524779.0 [2024-08-06 04:49:49,747][52803] Sum rewards: 80.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.211', 'weapon5': '0.212', 'weapon2': '0.236', 'weapon4': '0.242', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:49,890][52663] DAMAGECOUNT value on done: 562265.0 [2024-08-06 04:49:49,890][52663] Sum rewards: 64.959, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO3': '0.238', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '54.000'} [2024-08-06 04:49:50,832][52811] DAMAGECOUNT value on done: 527619.0 [2024-08-06 04:49:50,832][52811] Sum rewards: 70.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.586', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.096', 'weapon5': '0.146', 'AMMO4': '0.199', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:50,912][52670] DAMAGECOUNT value on done: 567735.0 [2024-08-06 04:49:50,914][52670] Sum rewards: 70.850, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.988', 'AMMO5': '0.023', 'AMMO2': '0.054', 'weapon5': '0.216', 'weapon4': '0.232', 'weapon2': '0.260', 'AMMO4': '0.268', 'AMMO3': '0.291', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.930', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:51,133][52667] DAMAGECOUNT value on done: 569022.0 [2024-08-06 04:49:51,133][52667] Sum rewards: 75.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.486', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.228', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:51,893][52649] DAMAGECOUNT value on done: 544982.0 [2024-08-06 04:49:51,893][52649] Sum rewards: 66.561, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.130', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO3': '0.184', 'AMMO4': '0.198', 'weapon5': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '51.000'} [2024-08-06 04:49:52,144][52666] DAMAGECOUNT value on done: 555748.0 [2024-08-06 04:49:52,153][52666] Sum rewards: 66.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.102', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.160', 'weapon5': '0.178', 'AMMO3': '0.229', 'AMMO4': '0.242', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '57.000'} [2024-08-06 04:49:52,244][52647] DAMAGECOUNT value on done: 597898.0 [2024-08-06 04:49:52,247][52647] Sum rewards: 72.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.490', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.102', 'weapon5': '0.138', 'weapon2': '0.178', 'AMMO3': '0.186', 'AMMO4': '0.218', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.312', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:52,770][52650] Updated weights for policy 0, policy_version 56471 (0.0018) [2024-08-06 04:49:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 462610432. Throughput: 0: 4362.0. Samples: 115656030. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 04:49:52,794][52567] Avg episode reward: [(0, '73.315')] [2024-08-06 04:49:52,810][52803] DAMAGECOUNT value on done: 524337.0 [2024-08-06 04:49:52,811][52803] Sum rewards: 73.964, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO3': '0.148', 'AMMO4': '0.173', 'weapon5': '0.222', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '59.000'} [2024-08-06 04:49:52,998][52663] DAMAGECOUNT value on done: 571462.0 [2024-08-06 04:49:52,998][52663] Sum rewards: 83.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.090', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon2': '0.178', 'weapon4': '0.206', 'AMMO3': '0.207', 'weapon5': '0.290', 'AMMO4': '0.321', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.970', 'FRAGCOUNT': '67.000'} [2024-08-06 04:49:53,904][52670] DAMAGECOUNT value on done: 560674.0 [2024-08-06 04:49:53,909][52670] Sum rewards: 80.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.835', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.087', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.364', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:53,985][52811] DAMAGECOUNT value on done: 529177.0 [2024-08-06 04:49:53,985][52811] Sum rewards: 71.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.360', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.153', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.826', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:54,048][52667] DAMAGECOUNT value on done: 572559.0 [2024-08-06 04:49:54,051][52667] Sum rewards: 69.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO3': '0.230', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.374', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '58.000'} [2024-08-06 04:49:54,306][52649] DAMAGECOUNT value on done: 538421.0 [2024-08-06 04:49:54,306][52649] Sum rewards: 64.793, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.842', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO4': '0.155', 'weapon4': '0.156', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '56.000'} [2024-08-06 04:49:55,039][52666] DAMAGECOUNT value on done: 560197.0 [2024-08-06 04:49:55,039][52666] Sum rewards: 74.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.676', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.122', 'weapon5': '0.122', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:55,255][52647] DAMAGECOUNT value on done: 596170.0 [2024-08-06 04:49:55,257][52647] Sum rewards: 78.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.618', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.140', 'weapon4': '0.160', 'AMMO4': '0.218', 'AMMO3': '0.261', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '65.000'} [2024-08-06 04:49:55,420][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:49:56,057][52803] DAMAGECOUNT value on done: 529925.0 [2024-08-06 04:49:56,058][52803] Sum rewards: 79.037, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.485', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.100', 'AMMO3': '0.235', 'weapon5': '0.246', 'AMMO4': '0.272', 'weapon2': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '68.000'} [2024-08-06 04:49:56,405][52667] DAMAGECOUNT value on done: 558403.0 [2024-08-06 04:49:56,407][52667] Sum rewards: 71.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.268', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.084', 'AMMO3': '0.279', 'weapon2': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.092', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '62.000'} [2024-08-06 04:49:56,421][52663] DAMAGECOUNT value on done: 557117.0 [2024-08-06 04:49:56,422][52663] Sum rewards: 78.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.510', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.152', 'weapon5': '0.196', 'AMMO4': '0.220', 'weapon2': '0.230', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '67.000'} [2024-08-06 04:49:56,544][52670] DAMAGECOUNT value on done: 549678.0 [2024-08-06 04:49:56,548][52670] Sum rewards: 78.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.134', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '64.000'} [2024-08-06 04:49:57,043][52811] DAMAGECOUNT value on done: 537218.0 [2024-08-06 04:49:57,045][52811] Sum rewards: 74.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.268', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '3.362', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '64.000'} [2024-08-06 04:49:57,114][52649] DAMAGECOUNT value on done: 555988.0 [2024-08-06 04:49:57,117][52649] Sum rewards: 60.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.015', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.094', 'AMMO3': '0.203', 'AMMO4': '0.278', 'weapon2': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '51.000'} [2024-08-06 04:49:57,373][52650] Updated weights for policy 0, policy_version 56481 (0.0011) [2024-08-06 04:49:57,696][52647] DAMAGECOUNT value on done: 582608.0 [2024-08-06 04:49:57,697][52647] Sum rewards: 80.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.194', 'AMMO4': '0.220', 'weapon4': '0.234', 'weapon5': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '64.500'} [2024-08-06 04:49:57,795][52567] Fps is (10 sec: 17201.8, 60 sec: 17476.0, 300 sec: 17494.7). Total num frames: 462692352. Throughput: 0: 4362.4. Samples: 115682180. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 04:49:57,795][52567] Avg episode reward: [(0, '73.507')] [2024-08-06 04:49:58,111][52666] DAMAGECOUNT value on done: 559991.0 [2024-08-06 04:49:58,111][52666] Sum rewards: 75.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:58,967][52667] DAMAGECOUNT value on done: 561270.0 [2024-08-06 04:49:58,968][52667] Sum rewards: 76.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.074', 'weapon4': '0.076', 'AMMO3': '0.164', 'AMMO4': '0.274', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.370', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '63.000'} [2024-08-06 04:49:59,292][52663] DAMAGECOUNT value on done: 555486.0 [2024-08-06 04:49:59,295][52663] Sum rewards: 81.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.172', 'AMMO4': '0.197', 'weapon5': '0.222', 'weapon2': '0.334', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '66.000'} [2024-08-06 04:49:59,401][52803] DAMAGECOUNT value on done: 532239.0 [2024-08-06 04:49:59,403][52803] Sum rewards: 74.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.014', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '3.256', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '60.000'} [2024-08-06 04:49:59,519][52670] DAMAGECOUNT value on done: 557948.0 [2024-08-06 04:49:59,519][52670] Sum rewards: 61.862, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.911', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.283', 'weapon2': '0.368', 'WEAPON3': '1.700', 'HITCOUNT': '3.080', 'weapon3': '3.198', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:00,154][52811] DAMAGECOUNT value on done: 524479.0 [2024-08-06 04:50:00,157][52811] Sum rewards: 86.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.088', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '71.000'} [2024-08-06 04:50:00,225][52649] DAMAGECOUNT value on done: 551031.0 [2024-08-06 04:50:00,227][52649] Sum rewards: 74.360, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'weapon4': '0.348', 'weapon2': '0.600', 'HEALTH': '0.615', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:00,284][52647] DAMAGECOUNT value on done: 591141.0 [2024-08-06 04:50:00,284][52647] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.508', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.062', 'weapon5': '0.182', 'AMMO3': '0.187', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.136', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:00,693][52666] DAMAGECOUNT value on done: 559781.0 [2024-08-06 04:50:00,693][52666] Sum rewards: 69.776, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.208', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.104', 'weapon5': '0.144', 'AMMO4': '0.190', 'weapon2': '0.276', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.146', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '63.000'} [2024-08-06 04:50:01,724][52667] DAMAGECOUNT value on done: 569568.0 [2024-08-06 04:50:01,725][52667] Sum rewards: 76.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.180', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '66.000'} [2024-08-06 04:50:01,922][52670] DAMAGECOUNT value on done: 556306.0 [2024-08-06 04:50:01,923][52670] Sum rewards: 79.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.112', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.218', 'AMMO4': '0.227', 'AMMO3': '0.229', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '66.000'} [2024-08-06 04:50:02,288][52659] Large shaping reward 2.552 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.501, 167.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:50:02,313][52663] DAMAGECOUNT value on done: 557352.0 [2024-08-06 04:50:02,313][52663] Sum rewards: 76.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.298', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '66.000'} [2024-08-06 04:50:02,340][52650] Updated weights for policy 0, policy_version 56491 (0.0035) [2024-08-06 04:50:02,487][52803] DAMAGECOUNT value on done: 526274.0 [2024-08-06 04:50:02,487][52803] Sum rewards: 72.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.782', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.151', 'AMMO4': '0.159', 'weapon5': '0.168', 'weapon4': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 462782464. Throughput: 0: 4356.4. Samples: 115695090. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 04:50:02,795][52567] Avg episode reward: [(0, '73.751')] [2024-08-06 04:50:03,070][52666] DAMAGECOUNT value on done: 554886.0 [2024-08-06 04:50:03,071][52666] Sum rewards: 83.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.129', 'weapon4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.063', 'FRAGCOUNT': '69.000'} [2024-08-06 04:50:03,126][52647] DAMAGECOUNT value on done: 582307.0 [2024-08-06 04:50:03,128][52647] Sum rewards: 73.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.862', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.152', 'weapon5': '0.158', 'AMMO3': '0.241', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:03,324][52811] DAMAGECOUNT value on done: 520462.0 [2024-08-06 04:50:03,325][52811] Sum rewards: 74.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.655', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.178', 'weapon4': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.232', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.328', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '61.000'} [2024-08-06 04:50:03,726][52649] DAMAGECOUNT value on done: 540537.0 [2024-08-06 04:50:03,726][52649] Sum rewards: 66.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.564', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.132', 'weapon4': '0.152', 'AMMO4': '0.227', 'AMMO3': '0.234', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.254', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:04,212][52667] DAMAGECOUNT value on done: 559290.0 [2024-08-06 04:50:04,214][52667] Sum rewards: 55.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.205', 'weapon2': '0.222', 'weapon4': '0.240', 'AMMO4': '0.248', 'weapon5': '0.314', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '2.896', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '48.000'} [2024-08-06 04:50:04,744][52670] DAMAGECOUNT value on done: 553987.0 [2024-08-06 04:50:04,746][52670] Sum rewards: 73.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.219', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.108', 'AMMO3': '0.164', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:05,156][52663] DAMAGECOUNT value on done: 555011.0 [2024-08-06 04:50:05,156][52663] Sum rewards: 70.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.088', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.112', 'weapon5': '0.166', 'AMMO4': '0.170', 'weapon2': '0.178', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '58.500'} [2024-08-06 04:50:05,584][52664] DAMAGECOUNT value on done: 585887.0 [2024-08-06 04:50:05,585][52664] Sum rewards: 81.058, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.252', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.072', 'weapon5': '0.146', 'AMMO4': '0.155', 'AMMO3': '0.263', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '69.000'} [2024-08-06 04:50:05,609][52647] DAMAGECOUNT value on done: 586101.0 [2024-08-06 04:50:05,610][52647] Sum rewards: 65.777, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.960', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.126', 'weapon5': '0.174', 'AMMO4': '0.183', 'AMMO3': '0.278', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.112', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '57.500'} [2024-08-06 04:50:05,672][52803] DAMAGECOUNT value on done: 519806.0 [2024-08-06 04:50:05,675][52803] Sum rewards: 72.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.172', 'AMMO4': '0.187', 'AMMO3': '0.261', 'weapon2': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.436', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.796', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:05,805][52664] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2024-08-06 04:50:06,180][52666] DAMAGECOUNT value on done: 557194.0 [2024-08-06 04:50:06,181][52666] Sum rewards: 69.754, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.202', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:06,371][52811] DAMAGECOUNT value on done: 526249.0 [2024-08-06 04:50:06,373][52811] Sum rewards: 60.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.327', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.172', 'AMMO3': '0.208', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.292', 'weapon4': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '49.000'} [2024-08-06 04:50:06,642][52650] Updated weights for policy 0, policy_version 56501 (0.0017) [2024-08-06 04:50:06,853][52667] DAMAGECOUNT value on done: 570109.0 [2024-08-06 04:50:06,853][52667] Sum rewards: 69.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.178', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.050', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon4': '0.452', 'weapon2': '0.688', 'WEAPON3': '1.350', 'weapon3': '2.632', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:07,001][52649] DAMAGECOUNT value on done: 551271.0 [2024-08-06 04:50:07,002][52649] Sum rewards: 59.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.244', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.206', 'weapon5': '0.208', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '2.876', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '49.000'} [2024-08-06 04:50:07,592][52669] DAMAGECOUNT value on done: 566950.0 [2024-08-06 04:50:07,593][52669] Sum rewards: 65.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.756', 'AMMO5': '0.018', 'AMMO2': '0.021', 'weapon4': '0.092', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon5': '0.302', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '54.000'} [2024-08-06 04:50:07,794][52567] Fps is (10 sec: 17204.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 462864384. Throughput: 0: 4349.1. Samples: 115721020. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 04:50:07,794][52567] Avg episode reward: [(0, '72.816')] [2024-08-06 04:50:07,831][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:50:07,846][52670] DAMAGECOUNT value on done: 562108.0 [2024-08-06 04:50:07,848][52670] Sum rewards: 73.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.707', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.096', 'weapon5': '0.248', 'AMMO3': '0.251', 'AMMO4': '0.252', 'WEAPON4': '0.500', 'weapon2': '0.526', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '63.000'} [2024-08-06 04:50:08,140][52663] DAMAGECOUNT value on done: 569046.0 [2024-08-06 04:50:08,140][52663] Sum rewards: 78.110, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.810', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon4': '0.204', 'weapon5': '0.232', 'weapon2': '0.234', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '2.930', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:08,286][52664] DAMAGECOUNT value on done: 589199.0 [2024-08-06 04:50:08,287][52664] Sum rewards: 69.212, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.946', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.094', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:08,885][52803] DAMAGECOUNT value on done: 521857.0 [2024-08-06 04:50:08,885][52803] Sum rewards: 78.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.870', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.140', 'weapon5': '0.194', 'AMMO3': '0.237', 'weapon2': '0.250', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:09,297][52666] DAMAGECOUNT value on done: 552341.0 [2024-08-06 04:50:09,298][52666] Sum rewards: 66.369, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.089', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.064', 'AMMO4': '0.118', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'weapon2': '0.484', 'WEAPON3': '0.850', 'weapon3': '3.144', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 04:50:09,364][52811] DAMAGECOUNT value on done: 526041.0 [2024-08-06 04:50:09,366][52811] Sum rewards: 66.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.735', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.080', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'weapon2': '0.366', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:09,917][52649] DAMAGECOUNT value on done: 548436.0 [2024-08-06 04:50:09,918][52649] Sum rewards: 77.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.080', 'weapon4': '0.084', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '64.000'} [2024-08-06 04:50:09,946][52667] DAMAGECOUNT value on done: 573137.0 [2024-08-06 04:50:09,948][52667] Sum rewards: 77.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.228', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.176', 'AMMO3': '0.186', 'AMMO4': '0.188', 'weapon5': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '64.000'} [2024-08-06 04:50:10,476][52669] DAMAGECOUNT value on done: 558025.0 [2024-08-06 04:50:10,477][52669] Sum rewards: 69.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.517', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.180', 'AMMO4': '0.182', 'weapon4': '0.222', 'AMMO3': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.988', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:10,786][52670] DAMAGECOUNT value on done: 551224.0 [2024-08-06 04:50:10,788][52670] Sum rewards: 75.167, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.607', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.159', 'weapon2': '0.284', 'WEAPON3': '1.000', 'weapon3': '3.504', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:11,050][52663] DAMAGECOUNT value on done: 555805.0 [2024-08-06 04:50:11,052][52663] Sum rewards: 79.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.019', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.116', 'AMMO3': '0.170', 'AMMO4': '0.176', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.344', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '65.000'} [2024-08-06 04:50:11,420][52664] DAMAGECOUNT value on done: 588715.0 [2024-08-06 04:50:11,421][52664] Sum rewards: 74.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.431', 'ARMOR': '0.012', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon5': '0.156', 'weapon4': '0.158', 'AMMO3': '0.172', 'AMMO4': '0.243', 'weapon2': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '61.000'} [2024-08-06 04:50:11,664][52650] Updated weights for policy 0, policy_version 56511 (0.0017) [2024-08-06 04:50:12,053][52803] DAMAGECOUNT value on done: 518341.0 [2024-08-06 04:50:12,054][52803] Sum rewards: 68.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.190', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.152', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.700', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:12,275][52666] DAMAGECOUNT value on done: 565119.0 [2024-08-06 04:50:12,276][52666] Sum rewards: 68.042, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.062', 'weapon4': '0.078', 'AMMO4': '0.113', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.702', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:12,479][52811] DAMAGECOUNT value on done: 529049.0 [2024-08-06 04:50:12,483][52811] Sum rewards: 66.144, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.328', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.434', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:12,613][52649] DAMAGECOUNT value on done: 551013.0 [2024-08-06 04:50:12,613][52649] Sum rewards: 85.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.775', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.144', 'weapon2': '0.184', 'AMMO3': '0.235', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.093', 'FRAGCOUNT': '70.000'} [2024-08-06 04:50:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 462962688. Throughput: 0: 4361.1. Samples: 115747450. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 04:50:12,794][52567] Avg episode reward: [(0, '73.183')] [2024-08-06 04:50:12,911][52667] DAMAGECOUNT value on done: 573182.0 [2024-08-06 04:50:12,911][52667] Sum rewards: 62.881, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.536', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:13,406][52670] DAMAGECOUNT value on done: 557099.0 [2024-08-06 04:50:13,407][52670] Sum rewards: 73.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.324', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.070', 'weapon4': '0.108', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:13,505][52669] DAMAGECOUNT value on done: 569312.0 [2024-08-06 04:50:13,506][52669] Sum rewards: 64.906, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.025', 'AMMO2': '0.059', 'weapon4': '0.158', 'AMMO3': '0.209', 'weapon5': '0.238', 'AMMO4': '0.296', 'weapon2': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:13,948][52663] DAMAGECOUNT value on done: 567066.0 [2024-08-06 04:50:13,949][52663] Sum rewards: 79.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.002', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO4': '0.173', 'AMMO3': '0.212', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '64.500'} [2024-08-06 04:50:14,765][52666] DAMAGECOUNT value on done: 558854.0 [2024-08-06 04:50:14,765][52666] Sum rewards: 83.619, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.636', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.297', 'weapon2': '0.328', 'WEAPON3': '1.750', 'weapon3': '3.290', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.718', 'FRAGCOUNT': '71.000'} [2024-08-06 04:50:14,790][52664] DAMAGECOUNT value on done: 581516.0 [2024-08-06 04:50:14,790][52664] Sum rewards: 75.667, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.403', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.148', 'AMMO3': '0.211', 'AMMO4': '0.221', 'weapon4': '0.366', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.844', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:15,181][52803] DAMAGECOUNT value on done: 524747.0 [2024-08-06 04:50:15,182][52803] Sum rewards: 72.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.377', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.176', 'weapon4': '0.226', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '2.892', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:15,518][52811] DAMAGECOUNT value on done: 530811.0 [2024-08-06 04:50:15,519][52811] Sum rewards: 76.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.155', 'AMMO4': '0.207', 'weapon5': '0.226', 'weapon2': '0.394', 'WEAPON5': '0.450', 'weapon4': '0.530', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.524', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '61.000'} [2024-08-06 04:50:15,823][52667] DAMAGECOUNT value on done: 570226.0 [2024-08-06 04:50:15,823][52667] Sum rewards: 68.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.134', 'AMMO4': '0.148', 'weapon2': '0.192', 'AMMO3': '0.209', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.180', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:15,913][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:50:15,927][52649] DAMAGECOUNT value on done: 553131.0 [2024-08-06 04:50:15,927][52649] Sum rewards: 70.499, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.804', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.136', 'weapon4': '0.142', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:16,209][52670] DAMAGECOUNT value on done: 565723.0 [2024-08-06 04:50:16,213][52670] Sum rewards: 77.900, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.215', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.117', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.360', 'WEAPON3': '0.950', 'weapon3': '3.072', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:16,232][52669] DAMAGECOUNT value on done: 568450.0 [2024-08-06 04:50:16,235][52669] Sum rewards: 81.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.143', 'AMMO3': '0.233', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:16,432][52650] Updated weights for policy 0, policy_version 56521 (0.0028) [2024-08-06 04:50:16,888][52663] DAMAGECOUNT value on done: 567673.0 [2024-08-06 04:50:16,889][52663] Sum rewards: 83.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '66.500'} [2024-08-06 04:50:17,039][52664] DAMAGECOUNT value on done: 585310.0 [2024-08-06 04:50:17,039][52664] Sum rewards: 63.386, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.162', 'weapon5': '0.184', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 04:50:17,598][52666] DAMAGECOUNT value on done: 562308.0 [2024-08-06 04:50:17,599][52666] Sum rewards: 73.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.635', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.432', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.242', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 463044608. Throughput: 0: 4361.3. Samples: 115760560. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 04:50:17,795][52567] Avg episode reward: [(0, '73.085')] [2024-08-06 04:50:18,272][52803] DAMAGECOUNT value on done: 518123.0 [2024-08-06 04:50:18,272][52803] Sum rewards: 79.087, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.880', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon2': '0.212', 'weapon5': '0.250', 'AMMO3': '0.272', 'AMMO4': '0.335', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.874', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:18,544][52811] DAMAGECOUNT value on done: 524661.0 [2024-08-06 04:50:18,547][52811] Sum rewards: 65.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.146', 'weapon4': '0.174', 'AMMO4': '0.219', 'weapon2': '0.276', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.156', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '57.000'} [2024-08-06 04:50:18,644][52667] DAMAGECOUNT value on done: 563499.0 [2024-08-06 04:50:18,645][52667] Sum rewards: 66.658, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.975', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.254', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:18,834][52649] DAMAGECOUNT value on done: 541936.0 [2024-08-06 04:50:18,834][52649] Sum rewards: 61.394, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.338', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.078', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.614', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.130', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '49.500'} [2024-08-06 04:50:19,243][52669] DAMAGECOUNT value on done: 563458.0 [2024-08-06 04:50:19,243][52669] Sum rewards: 67.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.243', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.101', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.370', 'WEAPON3': '1.650', 'HITCOUNT': '3.150', 'weapon3': '3.232', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:19,276][52671] DAMAGECOUNT value on done: 571507.0 [2024-08-06 04:50:19,276][52671] Sum rewards: 75.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.677', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.058', 'AMMO4': '0.187', 'weapon5': '0.214', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 04:50:19,312][52670] DAMAGECOUNT value on done: 563173.0 [2024-08-06 04:50:19,312][52670] Sum rewards: 84.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.168', 'weapon2': '0.190', 'AMMO3': '0.246', 'AMMO4': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '71.000'} [2024-08-06 04:50:19,826][52663] DAMAGECOUNT value on done: 558648.0 [2024-08-06 04:50:19,827][52663] Sum rewards: 64.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.562', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.136', 'weapon5': '0.182', 'AMMO4': '0.221', 'AMMO3': '0.240', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.108', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:20,216][52666] DAMAGECOUNT value on done: 557579.0 [2024-08-06 04:50:20,218][52666] Sum rewards: 73.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'weapon4': '0.080', 'weapon5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.234', 'AMMO4': '0.271', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '61.000'} [2024-08-06 04:50:20,460][52664] DAMAGECOUNT value on done: 585977.0 [2024-08-06 04:50:20,460][52664] Sum rewards: 68.763, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO3': '0.167', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:20,692][52811] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:50:20,765][52650] Updated weights for policy 0, policy_version 56531 (0.0012) [2024-08-06 04:50:21,395][52649] DAMAGECOUNT value on done: 553645.0 [2024-08-06 04:50:21,396][52649] Sum rewards: 70.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.074', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.158', 'weapon5': '0.176', 'AMMO4': '0.195', 'AMMO3': '0.223', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:21,401][52667] DAMAGECOUNT value on done: 572124.0 [2024-08-06 04:50:21,402][52667] Sum rewards: 66.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.098', 'weapon5': '0.160', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:21,419][52803] DAMAGECOUNT value on done: 535161.0 [2024-08-06 04:50:21,423][52803] Sum rewards: 81.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.641', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.139', 'AMMO3': '0.163', 'weapon4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '67.000'} [2024-08-06 04:50:21,640][52811] DAMAGECOUNT value on done: 523646.0 [2024-08-06 04:50:21,642][52811] Sum rewards: 71.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:21,979][52670] DAMAGECOUNT value on done: 543867.0 [2024-08-06 04:50:21,981][52670] Sum rewards: 64.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon5': '0.174', 'weapon4': '0.234', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:22,190][52669] DAMAGECOUNT value on done: 569796.0 [2024-08-06 04:50:22,192][52669] Sum rewards: 76.084, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.114', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO3': '0.140', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.698', 'WEAPON3': '0.900', 'weapon3': '2.964', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:22,485][52671] DAMAGECOUNT value on done: 570697.0 [2024-08-06 04:50:22,485][52671] Sum rewards: 83.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon5': '0.220', 'AMMO3': '0.242', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '69.000'} [2024-08-06 04:50:22,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 463126528. Throughput: 0: 4360.4. Samples: 115786680. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:50:22,802][52567] Avg episode reward: [(0, '72.905')] [2024-08-06 04:50:23,102][52666] DAMAGECOUNT value on done: 559954.0 [2024-08-06 04:50:23,102][52666] Sum rewards: 52.603, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.069', 'weapon4': '0.102', 'weapon5': '0.186', 'weapon2': '0.212', 'AMMO3': '0.294', 'AMMO4': '0.346', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.820', 'weapon3': '3.178', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '48.000'} [2024-08-06 04:50:23,366][52664] DAMAGECOUNT value on done: 581350.0 [2024-08-06 04:50:23,367][52664] Sum rewards: 78.168, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.890', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'weapon2': '0.204', 'AMMO3': '0.289', 'WEAPON3': '1.750', 'weapon3': '3.402', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:24,593][52649] DAMAGECOUNT value on done: 558899.0 [2024-08-06 04:50:24,594][52649] Sum rewards: 69.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.182', 'weapon5': '0.210', 'AMMO4': '0.229', 'weapon2': '0.246', 'weapon4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:24,694][52669] DAMAGECOUNT value on done: 566634.0 [2024-08-06 04:50:24,696][52669] Sum rewards: 63.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.502', 'AMMO5': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.175', 'weapon5': '0.230', 'AMMO4': '0.286', 'WEAPON5': '0.400', 'weapon2': '0.434', 'weapon4': '0.516', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.538', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '50.000'} [2024-08-06 04:50:24,718][52803] DAMAGECOUNT value on done: 526087.0 [2024-08-06 04:50:24,722][52803] Sum rewards: 76.396, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.312', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO4': '0.202', 'weapon4': '0.288', 'WEAPON3': '1.050', 'weapon3': '3.226', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:24,853][52670] DAMAGECOUNT value on done: 557095.0 [2024-08-06 04:50:24,857][52670] Sum rewards: 63.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.188', 'AMMO3': '0.203', 'weapon5': '0.222', 'AMMO4': '0.228', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '52.000'} [2024-08-06 04:50:25,349][52671] DAMAGECOUNT value on done: 568858.0 [2024-08-06 04:50:25,351][52671] Sum rewards: 84.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.427', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.112', 'weapon4': '0.144', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '70.000'} [2024-08-06 04:50:25,813][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:50:25,912][52650] Updated weights for policy 0, policy_version 56541 (0.0030) [2024-08-06 04:50:26,080][52666] DAMAGECOUNT value on done: 563937.0 [2024-08-06 04:50:26,081][52666] Sum rewards: 79.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.828', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.038', 'weapon5': '0.094', 'AMMO4': '0.182', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.840', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '66.000'} [2024-08-06 04:50:26,158][52664] DAMAGECOUNT value on done: 578446.0 [2024-08-06 04:50:26,159][52664] Sum rewards: 62.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.195', 'weapon5': '0.274', 'AMMO4': '0.288', 'weapon2': '0.440', 'WEAPON5': '0.500', 'weapon4': '0.584', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.392', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '50.000'} [2024-08-06 04:50:26,198][52658] DAMAGECOUNT value on done: 565629.0 [2024-08-06 04:50:26,199][52658] Sum rewards: 84.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.192', 'weapon4': '0.208', 'AMMO4': '0.217', 'weapon5': '0.222', 'weapon2': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:27,572][52669] DAMAGECOUNT value on done: 564615.0 [2024-08-06 04:50:27,573][52669] Sum rewards: 75.522, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.045', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.278', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '65.000'} [2024-08-06 04:50:27,747][52649] DAMAGECOUNT value on done: 558595.0 [2024-08-06 04:50:27,747][52649] Sum rewards: 63.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon2': '0.184', 'AMMO4': '0.189', 'weapon5': '0.202', 'weapon4': '0.220', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.178', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '52.000'} [2024-08-06 04:50:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 463216640. Throughput: 0: 4364.0. Samples: 115812870. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:50:27,794][52567] Avg episode reward: [(0, '72.628')] [2024-08-06 04:50:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056545_463216640.pth... [2024-08-06 04:50:27,817][52803] DAMAGECOUNT value on done: 520982.0 [2024-08-06 04:50:27,820][52803] Sum rewards: 67.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:27,931][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056034_459030528.pth [2024-08-06 04:50:28,125][52671] DAMAGECOUNT value on done: 569167.0 [2024-08-06 04:50:28,125][52671] Sum rewards: 78.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.254', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.092', 'AMMO4': '0.181', 'weapon5': '0.188', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '65.000'} [2024-08-06 04:50:28,209][52670] DAMAGECOUNT value on done: 566419.0 [2024-08-06 04:50:28,209][52670] Sum rewards: 73.070, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'AMMO5': '0.006', 'weapon4': '0.018', 'weapon5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'HITCOUNT': '3.600', 'weapon3': '3.654', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:28,901][52658] DAMAGECOUNT value on done: 564795.0 [2024-08-06 04:50:28,901][52658] Sum rewards: 69.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.275', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'weapon4': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:29,047][52666] DAMAGECOUNT value on done: 548385.0 [2024-08-06 04:50:29,050][52666] Sum rewards: 74.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.724', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.152', 'weapon4': '0.182', 'AMMO3': '0.237', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '63.000'} [2024-08-06 04:50:29,108][52664] DAMAGECOUNT value on done: 589209.0 [2024-08-06 04:50:29,109][52664] Sum rewards: 59.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.397', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.168', 'AMMO3': '0.177', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.104', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '48.000'} [2024-08-06 04:50:29,604][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:50:30,441][52650] Updated weights for policy 0, policy_version 56551 (0.0012) [2024-08-06 04:50:30,505][52669] DAMAGECOUNT value on done: 574709.0 [2024-08-06 04:50:30,507][52669] Sum rewards: 76.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.745', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.130', 'AMMO4': '0.162', 'weapon4': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '64.000'} [2024-08-06 04:50:30,888][52670] DAMAGECOUNT value on done: 556402.0 [2024-08-06 04:50:30,888][52670] Sum rewards: 81.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.136', 'weapon5': '0.164', 'AMMO4': '0.193', 'weapon2': '0.202', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '67.000'} [2024-08-06 04:50:31,012][52803] DAMAGECOUNT value on done: 535801.0 [2024-08-06 04:50:31,012][52803] Sum rewards: 82.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.080', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '2.890', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.508', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:31,052][52649] DAMAGECOUNT value on done: 556340.0 [2024-08-06 04:50:31,053][52649] Sum rewards: 66.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.978', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.132', 'weapon5': '0.162', 'AMMO3': '0.181', 'AMMO4': '0.187', 'weapon2': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.344', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.000'} [2024-08-06 04:50:31,137][52671] DAMAGECOUNT value on done: 578965.0 [2024-08-06 04:50:31,137][52671] Sum rewards: 74.784, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.147', 'AMMO3': '0.157', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.194', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:31,566][52658] DAMAGECOUNT value on done: 569924.0 [2024-08-06 04:50:31,567][52658] Sum rewards: 77.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.154', 'weapon5': '0.164', 'weapon2': '0.236', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '64.000'} [2024-08-06 04:50:31,851][52666] DAMAGECOUNT value on done: 557639.0 [2024-08-06 04:50:31,851][52666] Sum rewards: 67.136, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.265', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.176', 'AMMO3': '0.296', 'WEAPON3': '1.750', 'HITCOUNT': '3.240', 'weapon3': '3.524', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '61.000'} [2024-08-06 04:50:31,907][52664] DAMAGECOUNT value on done: 582860.0 [2024-08-06 04:50:31,908][52664] Sum rewards: 75.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.685', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.092', 'weapon4': '0.096', 'AMMO4': '0.130', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '64.000'} [2024-08-06 04:50:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 463306752. Throughput: 0: 4350.2. Samples: 115825390. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:50:32,794][52567] Avg episode reward: [(0, '72.547')] [2024-08-06 04:50:33,489][52669] DAMAGECOUNT value on done: 566312.0 [2024-08-06 04:50:33,489][52669] Sum rewards: 81.664, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.368', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.280', 'weapon4': '0.288', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:33,682][52670] DAMAGECOUNT value on done: 561557.0 [2024-08-06 04:50:33,682][52670] Sum rewards: 67.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.254', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'weapon5': '0.154', 'weapon4': '0.218', 'AMMO3': '0.254', 'ARMOR': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '57.000'} [2024-08-06 04:50:33,955][52671] DAMAGECOUNT value on done: 569753.0 [2024-08-06 04:50:33,956][52671] Sum rewards: 74.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.342', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.112', 'weapon5': '0.124', 'AMMO3': '0.188', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:34,076][52649] DAMAGECOUNT value on done: 545832.0 [2024-08-06 04:50:34,077][52649] Sum rewards: 83.483, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.442', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.070', 'weapon5': '0.192', 'AMMO3': '0.222', 'weapon2': '0.232', 'AMMO4': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:34,117][52803] DAMAGECOUNT value on done: 526426.0 [2024-08-06 04:50:34,118][52803] Sum rewards: 63.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.288', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.034', 'weapon4': '0.056', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:34,592][52658] DAMAGECOUNT value on done: 569426.0 [2024-08-06 04:50:34,593][52658] Sum rewards: 63.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.356', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.154', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '50.000'} [2024-08-06 04:50:34,814][52664] DAMAGECOUNT value on done: 590680.0 [2024-08-06 04:50:34,814][52664] Sum rewards: 77.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '65.000'} [2024-08-06 04:50:35,159][52650] Updated weights for policy 0, policy_version 56561 (0.0013) [2024-08-06 04:50:36,536][52669] DAMAGECOUNT value on done: 569892.0 [2024-08-06 04:50:36,536][52669] Sum rewards: 61.562, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.311', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.168', 'AMMO3': '0.198', 'weapon2': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.730', 'weapon3': '2.982', 'DAMAGECOUNT': '14.538', 'FRAGCOUNT': '51.000'} [2024-08-06 04:50:36,617][52671] DAMAGECOUNT value on done: 574612.0 [2024-08-06 04:50:36,619][52671] Sum rewards: 68.857, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.194', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO3': '0.204', 'weapon4': '0.208', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:36,897][52649] DAMAGECOUNT value on done: 553911.0 [2024-08-06 04:50:36,897][52649] Sum rewards: 78.678, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.177', 'weapon2': '0.252', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.278', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:37,211][52803] DAMAGECOUNT value on done: 523634.0 [2024-08-06 04:50:37,212][52803] Sum rewards: 67.622, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.903', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.194', 'weapon4': '0.198', 'AMMO4': '0.225', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:37,761][52658] DAMAGECOUNT value on done: 557914.0 [2024-08-06 04:50:37,763][52664] DAMAGECOUNT value on done: 590603.0 [2024-08-06 04:50:37,763][52664] Sum rewards: 73.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.630', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.130', 'weapon4': '0.222', 'AMMO3': '0.224', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '60.500'} [2024-08-06 04:50:37,764][52658] Sum rewards: 62.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.578', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.093', 'weapon5': '0.118', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.262', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '52.000'} [2024-08-06 04:50:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 463388672. Throughput: 0: 4348.7. Samples: 115851720. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:50:37,794][52567] Avg episode reward: [(0, '72.108')] [2024-08-06 04:50:39,065][52671] DAMAGECOUNT value on done: 569216.0 [2024-08-06 04:50:39,065][52671] Sum rewards: 79.532, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.905', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.168', 'weapon4': '0.214', 'AMMO4': '0.227', 'AMMO3': '0.298', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.990', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '70.000'} [2024-08-06 04:50:39,551][52669] DAMAGECOUNT value on done: 571137.0 [2024-08-06 04:50:39,552][52669] Sum rewards: 78.856, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.238', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.182', 'AMMO4': '0.198', 'weapon2': '0.214', 'AMMO3': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.950', 'weapon3': '3.166', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:39,828][52650] Updated weights for policy 0, policy_version 56571 (0.0030) [2024-08-06 04:50:39,940][52649] DAMAGECOUNT value on done: 542215.0 [2024-08-06 04:50:39,940][52649] Sum rewards: 64.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.998', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.358', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.422', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:40,290][52803] DAMAGECOUNT value on done: 527951.0 [2024-08-06 04:50:40,290][52803] Sum rewards: 66.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.247', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.082', 'AMMO4': '0.119', 'AMMO3': '0.158', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '54.000'} [2024-08-06 04:50:40,614][52658] DAMAGECOUNT value on done: 561509.0 [2024-08-06 04:50:40,614][52658] Sum rewards: 71.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.044', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon4': '0.082', 'weapon5': '0.110', 'AMMO3': '0.163', 'AMMO4': '0.278', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.290', 'weapon3': '3.366', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 04:50:40,727][52668] DAMAGECOUNT value on done: 564636.0 [2024-08-06 04:50:40,730][52668] Sum rewards: 85.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.910', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.122', 'weapon4': '0.206', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '72.000'} [2024-08-06 04:50:40,917][52664] DAMAGECOUNT value on done: 593788.0 [2024-08-06 04:50:40,917][52664] Sum rewards: 67.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.695', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.192', 'weapon5': '0.228', 'AMMO4': '0.239', 'weapon4': '0.280', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:41,857][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:50:42,013][52671] DAMAGECOUNT value on done: 562155.0 [2024-08-06 04:50:42,015][52671] Sum rewards: 64.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.211', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '54.000'} [2024-08-06 04:50:42,728][52669] DAMAGECOUNT value on done: 557927.0 [2024-08-06 04:50:42,729][52669] Sum rewards: 79.104, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon4': '0.116', 'AMMO4': '0.167', 'weapon5': '0.184', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '64.000'} [2024-08-06 04:50:42,773][52649] DAMAGECOUNT value on done: 555326.0 [2024-08-06 04:50:42,773][52649] Sum rewards: 62.044, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.790', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '50.000'} [2024-08-06 04:50:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 463478784. Throughput: 0: 4349.6. Samples: 115877910. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:50:42,794][52567] Avg episode reward: [(0, '72.187')] [2024-08-06 04:50:43,352][52803] DAMAGECOUNT value on done: 528646.0 [2024-08-06 04:50:43,355][52803] Sum rewards: 65.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.074', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO4': '0.199', 'weapon5': '0.212', 'weapon2': '0.220', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.232', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:43,814][52668] DAMAGECOUNT value on done: 568722.0 [2024-08-06 04:50:43,814][52668] Sum rewards: 86.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.126', 'AMMO4': '0.138', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.039', 'FRAGCOUNT': '70.000'} [2024-08-06 04:50:43,864][52658] DAMAGECOUNT value on done: 569618.0 [2024-08-06 04:50:43,866][52658] Sum rewards: 80.458, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.424', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.130', 'AMMO3': '0.139', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.502', 'WEAPON3': '0.950', 'weapon3': '2.914', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '65.000'} [2024-08-06 04:50:44,091][52664] DAMAGECOUNT value on done: 591592.0 [2024-08-06 04:50:44,092][52664] Sum rewards: 69.876, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.135', 'weapon5': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.354', 'weapon2': '0.390', 'WEAPON3': '0.900', 'weapon3': '2.860', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '53.000'} [2024-08-06 04:50:44,352][52650] Updated weights for policy 0, policy_version 56581 (0.0016) [2024-08-06 04:50:44,598][52671] DAMAGECOUNT value on done: 570547.0 [2024-08-06 04:50:44,603][52671] Sum rewards: 64.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.954', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO4': '0.213', 'weapon5': '0.252', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.768', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '55.000'} [2024-08-06 04:50:45,871][52649] DAMAGECOUNT value on done: 556244.0 [2024-08-06 04:50:45,872][52649] Sum rewards: 62.506, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.718', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.170', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon5': '0.376', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '49.000'} [2024-08-06 04:50:46,001][52669] DAMAGECOUNT value on done: 565915.0 [2024-08-06 04:50:46,002][52669] Sum rewards: 65.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.504', 'ARMOR': '0.008', 'AMMO5': '0.022', 'AMMO2': '0.065', 'AMMO3': '0.198', 'weapon5': '0.234', 'weapon4': '0.248', 'AMMO4': '0.323', 'weapon2': '0.448', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:46,436][52803] DAMAGECOUNT value on done: 532477.0 [2024-08-06 04:50:46,439][52803] Sum rewards: 74.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.888', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.168', 'AMMO4': '0.198', 'AMMO3': '0.234', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '64.000'} [2024-08-06 04:50:46,600][52664] DAMAGECOUNT value on done: 594341.0 [2024-08-06 04:50:46,600][52664] Sum rewards: 74.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'weapon4': '0.024', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.156', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.890', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:46,618][52658] DAMAGECOUNT value on done: 560905.0 [2024-08-06 04:50:46,620][52658] Sum rewards: 77.894, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.148', 'HEALTH': '0.265', 'weapon2': '0.588', 'WEAPON3': '0.850', 'weapon3': '3.278', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '61.000'} [2024-08-06 04:50:46,853][52668] DAMAGECOUNT value on done: 565864.0 [2024-08-06 04:50:46,855][52668] Sum rewards: 75.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.085', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.084', 'weapon4': '0.102', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:47,673][52671] DAMAGECOUNT value on done: 569580.0 [2024-08-06 04:50:47,673][52671] Sum rewards: 71.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.632', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.221', 'AMMO4': '0.240', 'weapon5': '0.276', 'weapon2': '0.366', 'weapon4': '0.376', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 463568896. Throughput: 0: 4355.8. Samples: 115891100. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:50:47,794][52567] Avg episode reward: [(0, '72.386')] [2024-08-06 04:50:48,343][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:50:48,731][52649] DAMAGECOUNT value on done: 549340.0 [2024-08-06 04:50:48,734][52649] Sum rewards: 69.194, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.975', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.111', 'weapon5': '0.136', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '58.000'} [2024-08-06 04:50:48,912][52662] DAMAGECOUNT value on done: 572098.0 [2024-08-06 04:50:48,912][52662] Sum rewards: 68.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.098', 'AMMO4': '0.182', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '56.000'} [2024-08-06 04:50:48,946][52669] DAMAGECOUNT value on done: 568862.0 [2024-08-06 04:50:48,946][52669] Sum rewards: 73.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.019', 'AMMO2': '0.059', 'AMMO3': '0.204', 'weapon4': '0.256', 'AMMO4': '0.294', 'weapon5': '0.314', 'weapon2': '0.324', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.802', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:49,174][52650] Updated weights for policy 0, policy_version 56591 (0.0013) [2024-08-06 04:50:49,510][52664] DAMAGECOUNT value on done: 586140.0 [2024-08-06 04:50:49,510][52664] Sum rewards: 61.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.124', 'weapon5': '0.128', 'AMMO4': '0.173', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.074', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '52.000'} [2024-08-06 04:50:49,589][52803] DAMAGECOUNT value on done: 521884.0 [2024-08-06 04:50:49,590][52803] Sum rewards: 61.021, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.652', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.103', 'AMMO3': '0.130', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '0.850', 'HITCOUNT': '2.830', 'weapon3': '3.048', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '47.000'} [2024-08-06 04:50:49,613][52668] DAMAGECOUNT value on done: 568281.0 [2024-08-06 04:50:49,615][52668] Sum rewards: 81.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.388', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.195', 'weapon2': '0.204', 'weapon5': '0.208', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '67.000'} [2024-08-06 04:50:49,721][52658] DAMAGECOUNT value on done: 580020.0 [2024-08-06 04:50:49,724][52658] Sum rewards: 77.550, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.254', 'AMMO3': '0.308', 'WEAPON3': '1.850', 'weapon3': '3.352', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '68.000'} [2024-08-06 04:50:50,244][52671] DAMAGECOUNT value on done: 567574.0 [2024-08-06 04:50:50,245][52671] Sum rewards: 66.111, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.781', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.116', 'AMMO4': '0.172', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.700', 'weapon3': '2.988', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '57.500'} [2024-08-06 04:50:51,730][52669] DAMAGECOUNT value on done: 586047.0 [2024-08-06 04:50:51,731][52669] Sum rewards: 69.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.517', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.144', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:51,886][52664] DAMAGECOUNT value on done: 580916.0 [2024-08-06 04:50:51,886][52664] Sum rewards: 78.056, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon2': '0.148', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.552', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '67.000'} [2024-08-06 04:50:51,890][52662] DAMAGECOUNT value on done: 568035.0 [2024-08-06 04:50:51,891][52662] Sum rewards: 71.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.684', 'AMMO5': '0.025', 'AMMO2': '0.048', 'AMMO3': '0.206', 'weapon5': '0.210', 'weapon2': '0.236', 'AMMO4': '0.241', 'weapon4': '0.248', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '61.000'} [2024-08-06 04:50:52,584][52668] DAMAGECOUNT value on done: 557472.0 [2024-08-06 04:50:52,587][52668] Sum rewards: 74.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.420', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:52,751][52671] DAMAGECOUNT value on done: 575373.0 [2024-08-06 04:50:52,754][52671] Sum rewards: 66.882, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.862', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.210', 'AMMO4': '0.216', 'AMMO3': '0.270', 'weapon2': '0.316', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.742', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '56.500'} [2024-08-06 04:50:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 463659008. Throughput: 0: 4363.6. Samples: 115917380. Policy #0 lag: (min: 0.0, avg: 4.6, max: 8.0) [2024-08-06 04:50:52,794][52567] Avg episode reward: [(0, '72.008')] [2024-08-06 04:50:52,892][52658] DAMAGECOUNT value on done: 564429.0 [2024-08-06 04:50:52,892][52658] Sum rewards: 69.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.698', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.368', 'WEAPON3': '1.500', 'weapon3': '2.906', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:53,573][52650] Updated weights for policy 0, policy_version 56601 (0.0013) [2024-08-06 04:50:54,739][52662] DAMAGECOUNT value on done: 572134.0 [2024-08-06 04:50:54,740][52662] Sum rewards: 72.258, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.055', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.086', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon4': '0.276', 'weapon2': '0.398', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '62.000'} [2024-08-06 04:50:54,819][52669] DAMAGECOUNT value on done: 573504.0 [2024-08-06 04:50:54,821][52669] Sum rewards: 72.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.981', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.122', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'AMMO4': '0.256', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '63.000'} [2024-08-06 04:50:55,111][52664] DAMAGECOUNT value on done: 586546.0 [2024-08-06 04:50:55,114][52664] Sum rewards: 74.120, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.797', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.127', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '59.000'} [2024-08-06 04:50:55,151][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:50:55,603][52668] DAMAGECOUNT value on done: 572376.0 [2024-08-06 04:50:55,604][52668] Sum rewards: 78.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.878', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.240', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.522', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '67.000'} [2024-08-06 04:50:55,679][52671] DAMAGECOUNT value on done: 569505.0 [2024-08-06 04:50:55,681][52671] Sum rewards: 72.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.120', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.102', 'AMMO3': '0.193', 'AMMO4': '0.202', 'weapon5': '0.258', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:56,001][52658] DAMAGECOUNT value on done: 577106.0 [2024-08-06 04:50:56,001][52658] Sum rewards: 77.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.005', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.062', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.256', 'WEAPON3': '1.150', 'weapon3': '3.486', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '63.000'} [2024-08-06 04:50:57,299][52662] DAMAGECOUNT value on done: 560244.0 [2024-08-06 04:50:57,301][52662] Sum rewards: 82.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.468', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.056', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '69.000'} [2024-08-06 04:50:57,472][52664] DAMAGECOUNT value on done: 586531.0 [2024-08-06 04:50:57,472][52664] Sum rewards: 71.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon4': '0.106', 'weapon5': '0.198', 'AMMO3': '0.236', 'AMMO4': '0.291', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '60.000'} [2024-08-06 04:50:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17340.0, 300 sec: 17439.2). Total num frames: 463732736. Throughput: 0: 4361.8. Samples: 115943730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:50:57,794][52567] Avg episode reward: [(0, '72.030')] [2024-08-06 04:50:57,958][52669] DAMAGECOUNT value on done: 571550.0 [2024-08-06 04:50:57,958][52669] Sum rewards: 86.159, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.169', 'weapon2': '0.212', 'WEAPON3': '1.100', 'weapon3': '3.394', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '69.000'} [2024-08-06 04:50:58,304][52668] DAMAGECOUNT value on done: 568674.0 [2024-08-06 04:50:58,306][52668] Sum rewards: 86.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.134', 'AMMO4': '0.170', 'AMMO3': '0.218', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '73.000'} [2024-08-06 04:50:58,521][52671] DAMAGECOUNT value on done: 555843.0 [2024-08-06 04:50:58,522][52671] Sum rewards: 62.785, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.895', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.132', 'AMMO4': '0.188', 'weapon5': '0.216', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.718', 'WEAPON3': '0.900', 'weapon3': '2.630', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '48.000'} [2024-08-06 04:50:58,559][52650] Updated weights for policy 0, policy_version 56611 (0.0023) [2024-08-06 04:50:59,131][52658] DAMAGECOUNT value on done: 562709.0 [2024-08-06 04:50:59,132][52658] Sum rewards: 63.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.048', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.282', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '51.000'} [2024-08-06 04:50:59,851][52662] DAMAGECOUNT value on done: 574166.0 [2024-08-06 04:50:59,852][52662] Sum rewards: 78.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.843', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.034', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'weapon2': '0.302', 'WEAPON3': '1.300', 'HITCOUNT': '3.380', 'weapon3': '3.480', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '65.000'} [2024-08-06 04:51:00,211][52664] DAMAGECOUNT value on done: 584959.0 [2024-08-06 04:51:00,212][52664] Sum rewards: 77.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.669', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.122', 'AMMO4': '0.144', 'AMMO3': '0.175', 'weapon5': '0.178', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '62.000'} [2024-08-06 04:51:00,927][52668] DAMAGECOUNT value on done: 559797.0 [2024-08-06 04:51:00,929][52668] Sum rewards: 70.144, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.617', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO4': '0.222', 'weapon4': '0.258', 'AMMO3': '0.264', 'weapon5': '0.274', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.774', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:01,198][52669] DAMAGECOUNT value on done: 572123.0 [2024-08-06 04:51:01,199][52669] Sum rewards: 85.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.322', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.044', 'AMMO4': '0.105', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'weapon3': '3.370', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '71.000'} [2024-08-06 04:51:01,714][52671] DAMAGECOUNT value on done: 575293.0 [2024-08-06 04:51:01,717][52671] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.124', 'weapon2': '0.192', 'AMMO4': '0.243', 'HEALTH': '0.256', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.642', 'WEAPON3': '0.700', 'weapon3': '2.586', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '45.000'} [2024-08-06 04:51:01,974][52658] DAMAGECOUNT value on done: 569911.0 [2024-08-06 04:51:01,976][52658] Sum rewards: 86.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.099', 'weapon5': '0.104', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.380', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.982', 'FRAGCOUNT': '71.000'} [2024-08-06 04:51:02,726][52662] DAMAGECOUNT value on done: 562556.0 [2024-08-06 04:51:02,727][52662] Sum rewards: 74.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.244', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 463822848. Throughput: 0: 4358.2. Samples: 115956680. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:51:02,796][52567] Avg episode reward: [(0, '72.583')] [2024-08-06 04:51:03,280][52650] Updated weights for policy 0, policy_version 56621 (0.0013) [2024-08-06 04:51:03,538][52668] DAMAGECOUNT value on done: 563003.0 [2024-08-06 04:51:03,539][52668] Sum rewards: 79.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.628', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.216', 'weapon5': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '63.000'} [2024-08-06 04:51:04,238][52669] DAMAGECOUNT value on done: 576868.0 [2024-08-06 04:51:04,238][52669] Sum rewards: 81.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.695', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.100', 'AMMO4': '0.125', 'weapon5': '0.158', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '68.000'} [2024-08-06 04:51:04,455][52671] DAMAGECOUNT value on done: 573702.0 [2024-08-06 04:51:04,455][52671] Sum rewards: 78.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.165', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.184', 'weapon2': '0.198', 'AMMO3': '0.213', 'weapon5': '0.232', 'AMMO4': '0.254', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '64.500'} [2024-08-06 04:51:04,653][52658] DAMAGECOUNT value on done: 561139.0 [2024-08-06 04:51:04,654][52658] Sum rewards: 60.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.060', 'weapon2': '0.178', 'weapon4': '0.190', 'weapon5': '0.230', 'AMMO3': '0.240', 'AMMO4': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.172', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '50.000'} [2024-08-06 04:51:05,793][52662] DAMAGECOUNT value on done: 572548.0 [2024-08-06 04:51:05,793][52662] Sum rewards: 71.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.738', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.080', 'weapon4': '0.084', 'AMMO4': '0.182', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:06,287][52668] DAMAGECOUNT value on done: 570150.0 [2024-08-06 04:51:06,288][52668] Sum rewards: 73.206, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.052', 'weapon4': '0.130', 'weapon5': '0.184', 'AMMO3': '0.200', 'AMMO4': '0.260', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '62.000'} [2024-08-06 04:51:07,163][52671] DAMAGECOUNT value on done: 571110.0 [2024-08-06 04:51:07,164][52671] Sum rewards: 65.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.170', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.420', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '2.536', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '55.500'} [2024-08-06 04:51:07,619][52658] DAMAGECOUNT value on done: 568632.0 [2024-08-06 04:51:07,621][52658] Sum rewards: 72.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.892', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.324', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '58.000'} [2024-08-06 04:51:07,794][52650] Updated weights for policy 0, policy_version 56631 (0.0033) [2024-08-06 04:51:07,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 463921152. Throughput: 0: 4360.7. Samples: 115982910. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:51:07,802][52567] Avg episode reward: [(0, '72.670')] [2024-08-06 04:51:07,857][52660] DAMAGECOUNT value on done: 566926.0 [2024-08-06 04:51:07,859][52660] Sum rewards: 75.947, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.246', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.109', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '61.000'} [2024-08-06 04:51:08,517][52662] DAMAGECOUNT value on done: 572949.0 [2024-08-06 04:51:08,517][52662] Sum rewards: 69.433, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.201', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.182', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '56.000'} [2024-08-06 04:51:08,810][52794] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:51:08,977][52668] DAMAGECOUNT value on done: 567614.0 [2024-08-06 04:51:08,977][52668] Sum rewards: 69.049, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.068', 'weapon5': '0.112', 'AMMO4': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'AMMO3': '0.288', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:10,113][52671] DAMAGECOUNT value on done: 568943.0 [2024-08-06 04:51:10,116][52671] Sum rewards: 60.108, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.098', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.236', 'weapon5': '0.236', 'AMMO3': '0.253', 'AMMO4': '0.290', 'weapon2': '0.462', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.690', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '53.500'} [2024-08-06 04:51:10,495][52660] DAMAGECOUNT value on done: 556837.0 [2024-08-06 04:51:10,497][52660] Sum rewards: 67.620, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.658', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '55.000'} [2024-08-06 04:51:10,746][52658] DAMAGECOUNT value on done: 555957.0 [2024-08-06 04:51:10,746][52658] Sum rewards: 70.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.702', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.196', 'weapon5': '0.214', 'AMMO4': '0.238', 'weapon2': '0.370', 'weapon4': '0.412', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.712', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 04:51:10,869][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:51:11,602][52662] DAMAGECOUNT value on done: 564892.0 [2024-08-06 04:51:11,603][52662] Sum rewards: 67.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.079', 'AMMO3': '0.156', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '54.000'} [2024-08-06 04:51:11,627][52668] DAMAGECOUNT value on done: 559135.0 [2024-08-06 04:51:11,628][52668] Sum rewards: 72.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.104', 'AMMO3': '0.159', 'AMMO4': '0.281', 'weapon5': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.732', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:12,555][52650] Updated weights for policy 0, policy_version 56641 (0.0015) [2024-08-06 04:51:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 464003072. Throughput: 0: 4363.1. Samples: 116009210. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:51:12,802][52567] Avg episode reward: [(0, '72.366')] [2024-08-06 04:51:12,869][52671] DAMAGECOUNT value on done: 568338.0 [2024-08-06 04:51:12,871][52671] Sum rewards: 88.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.144', 'weapon5': '0.156', 'AMMO4': '0.175', 'weapon2': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '22.041', 'FRAGCOUNT': '73.000'} [2024-08-06 04:51:13,466][52660] DAMAGECOUNT value on done: 568105.0 [2024-08-06 04:51:13,466][52660] Sum rewards: 74.527, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.151', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.120', 'weapon4': '0.124', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.630', 'WEAPON3': '0.800', 'weapon3': '2.802', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.000'} [2024-08-06 04:51:13,583][52658] DAMAGECOUNT value on done: 572386.0 [2024-08-06 04:51:13,583][52658] Sum rewards: 72.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.775', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:13,951][52662] DAMAGECOUNT value on done: 576157.0 [2024-08-06 04:51:13,952][52662] Sum rewards: 75.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.403', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.154', 'weapon5': '0.188', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '63.000'} [2024-08-06 04:51:14,855][52668] DAMAGECOUNT value on done: 551802.0 [2024-08-06 04:51:14,866][52668] Sum rewards: 71.044, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.258', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.139', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.364', 'WEAPON3': '0.850', 'HITCOUNT': '3.000', 'weapon3': '3.100', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '57.000'} [2024-08-06 04:51:16,528][52660] DAMAGECOUNT value on done: 574516.0 [2024-08-06 04:51:16,529][52660] Sum rewards: 76.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.915', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.126', 'weapon5': '0.126', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '64.000'} [2024-08-06 04:51:16,716][52662] DAMAGECOUNT value on done: 561836.0 [2024-08-06 04:51:16,717][52662] Sum rewards: 70.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.870', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.128', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '57.000'} [2024-08-06 04:51:16,852][52658] DAMAGECOUNT value on done: 562165.0 [2024-08-06 04:51:16,854][52658] Sum rewards: 71.838, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.092', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.046', 'AMMO4': '0.058', 'weapon5': '0.136', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.634', 'WEAPON3': '0.950', 'weapon3': '3.020', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '57.000'} [2024-08-06 04:51:17,068][52650] Updated weights for policy 0, policy_version 56651 (0.0011) [2024-08-06 04:51:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 464093184. Throughput: 0: 4382.2. Samples: 116022590. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:51:17,795][52567] Avg episode reward: [(0, '72.762')] [2024-08-06 04:51:17,920][52668] DAMAGECOUNT value on done: 554678.0 [2024-08-06 04:51:17,921][52668] Sum rewards: 71.563, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.778', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.142', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.160', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:19,189][52662] DAMAGECOUNT value on done: 567620.0 [2024-08-06 04:51:19,190][52662] Sum rewards: 69.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.607', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.205', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '58.000'} [2024-08-06 04:51:19,620][52660] DAMAGECOUNT value on done: 563890.0 [2024-08-06 04:51:19,621][52660] Sum rewards: 63.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.484', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.191', 'weapon2': '0.370', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.430', 'DAMAGECOUNT': '13.791', 'FRAGCOUNT': '53.000'} [2024-08-06 04:51:19,690][52614] Signal inference workers to stop experience collection... (10300 times) [2024-08-06 04:51:19,691][52614] Signal inference workers to resume experience collection... (10300 times) [2024-08-06 04:51:19,733][52650] InferenceWorker_p0-w0: stopping experience collection (10300 times) [2024-08-06 04:51:19,733][52650] InferenceWorker_p0-w0: resuming experience collection (10300 times) [2024-08-06 04:51:20,090][52658] DAMAGECOUNT value on done: 563204.0 [2024-08-06 04:51:20,091][52658] Sum rewards: 71.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.128', 'AMMO4': '0.187', 'AMMO3': '0.197', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:20,793][52668] DAMAGECOUNT value on done: 556343.0 [2024-08-06 04:51:20,795][52668] Sum rewards: 58.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.129', 'weapon5': '0.178', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '3.150', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.000'} [2024-08-06 04:51:21,775][52650] Updated weights for policy 0, policy_version 56661 (0.0030) [2024-08-06 04:51:22,055][52662] DAMAGECOUNT value on done: 563596.0 [2024-08-06 04:51:22,056][52662] Sum rewards: 68.530, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.142', 'weapon5': '0.150', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.678', 'WEAPON3': '0.900', 'weapon3': '2.610', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 04:51:22,412][52660] DAMAGECOUNT value on done: 561557.0 [2024-08-06 04:51:22,412][52660] Sum rewards: 60.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.174', 'AMMO3': '0.202', 'AMMO4': '0.206', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '2.888', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '51.000'} [2024-08-06 04:51:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 464183296. Throughput: 0: 4383.3. Samples: 116048970. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:51:22,795][52567] Avg episode reward: [(0, '72.129')] [2024-08-06 04:51:22,843][52658] DAMAGECOUNT value on done: 569139.0 [2024-08-06 04:51:22,844][52658] Sum rewards: 40.481, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.524', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon7': '0.096', 'AMMO3': '0.100', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON3': '0.700', 'weapon4': '1.598', 'weapon3': '1.666', 'HITCOUNT': '1.700', 'DAMAGECOUNT': '9.636', 'FRAGCOUNT': '31.000'} [2024-08-06 04:51:23,460][52668] DAMAGECOUNT value on done: 563956.0 [2024-08-06 04:51:23,460][52668] Sum rewards: 67.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.021', 'AMMO2': '0.073', 'weapon4': '0.166', 'AMMO3': '0.225', 'weapon5': '0.304', 'AMMO4': '0.364', 'weapon2': '0.464', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '56.000'} [2024-08-06 04:51:24,229][52803] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.432, 144.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 04:51:24,850][52660] DAMAGECOUNT value on done: 560188.0 [2024-08-06 04:51:24,852][52660] Sum rewards: 85.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.149', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.490', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '72.000'} [2024-08-06 04:51:25,144][52662] DAMAGECOUNT value on done: 572063.0 [2024-08-06 04:51:25,145][52662] Sum rewards: 66.552, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.031', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.076', 'weapon4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '55.000'} [2024-08-06 04:51:26,088][52668] DAMAGECOUNT value on done: 568304.0 [2024-08-06 04:51:26,088][52668] Sum rewards: 71.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.950', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon2': '0.248', 'weapon5': '0.260', 'AMMO3': '0.264', 'weapon4': '0.340', 'AMMO4': '0.342', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.650', 'weapon3': '2.770', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '61.000'} [2024-08-06 04:51:26,600][52650] Updated weights for policy 0, policy_version 56671 (0.0035) [2024-08-06 04:51:27,565][52660] DAMAGECOUNT value on done: 570142.0 [2024-08-06 04:51:27,567][52660] Sum rewards: 72.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.924', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.167', 'weapon2': '0.242', 'weapon4': '0.258', 'AMMO4': '0.279', 'weapon5': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.890', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '57.000'} [2024-08-06 04:51:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 464265216. Throughput: 0: 4380.7. Samples: 116075040. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 04:51:27,802][52567] Avg episode reward: [(0, '71.703')] [2024-08-06 04:51:28,025][52795] DAMAGECOUNT value on done: 525926.0 [2024-08-06 04:51:28,025][52795] Sum rewards: 77.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.423', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'AMMO4': '0.065', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.394', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '64.000'} [2024-08-06 04:51:28,098][52662] DAMAGECOUNT value on done: 564452.0 [2024-08-06 04:51:28,100][52662] Sum rewards: 65.800, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.072', 'weapon5': '0.192', 'AMMO3': '0.199', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '53.000'} [2024-08-06 04:51:28,786][52668] DAMAGECOUNT value on done: 565864.0 [2024-08-06 04:51:28,787][52668] Sum rewards: 77.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.104', 'AMMO4': '0.134', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '64.000'} [2024-08-06 04:51:30,286][52660] DAMAGECOUNT value on done: 563864.0 [2024-08-06 04:51:30,286][52660] Sum rewards: 87.791, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.187', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '71.000'} [2024-08-06 04:51:31,216][52668] DAMAGECOUNT value on done: 569170.0 [2024-08-06 04:51:31,217][52668] Sum rewards: 70.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.382', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.126', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:31,237][52662] DAMAGECOUNT value on done: 577261.0 [2024-08-06 04:51:31,237][52662] Sum rewards: 75.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.762', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.138', 'weapon4': '0.164', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '61.000'} [2024-08-06 04:51:31,245][52795] DAMAGECOUNT value on done: 516767.0 [2024-08-06 04:51:31,246][52795] Sum rewards: 71.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.850', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.050', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:31,382][52650] Updated weights for policy 0, policy_version 56681 (0.0020) [2024-08-06 04:51:32,754][52660] DAMAGECOUNT value on done: 564880.0 [2024-08-06 04:51:32,755][52660] Sum rewards: 73.236, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.369', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.069', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '62.000'} [2024-08-06 04:51:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 464355328. Throughput: 0: 4382.2. Samples: 116088300. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:51:32,794][52567] Avg episode reward: [(0, '72.070')] [2024-08-06 04:51:33,008][52665] DAMAGECOUNT value on done: 552650.0 [2024-08-06 04:51:33,008][52665] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.082', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.114', 'AMMO3': '0.143', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.000', 'weapon3': '2.998', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '55.500'} [2024-08-06 04:51:33,829][52668] DAMAGECOUNT value on done: 567682.0 [2024-08-06 04:51:33,830][52668] Sum rewards: 82.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.415', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.042', 'AMMO4': '0.112', 'weapon2': '0.160', 'weapon4': '0.192', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '67.000'} [2024-08-06 04:51:33,838][52662] DAMAGECOUNT value on done: 570226.0 [2024-08-06 04:51:33,838][52662] Sum rewards: 71.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.125', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon2': '0.166', 'weapon5': '0.180', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'weapon4': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '57.000'} [2024-08-06 04:51:34,454][52795] DAMAGECOUNT value on done: 514944.0 [2024-08-06 04:51:34,455][52795] Sum rewards: 76.121, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:34,582][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:51:35,419][52660] DAMAGECOUNT value on done: 572323.0 [2024-08-06 04:51:35,420][52660] Sum rewards: 74.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.200', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.179', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:35,689][52665] DAMAGECOUNT value on done: 570916.0 [2024-08-06 04:51:35,691][52665] Sum rewards: 81.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.058', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '64.000'} [2024-08-06 04:51:35,937][52650] Updated weights for policy 0, policy_version 56691 (0.0013) [2024-08-06 04:51:36,798][52662] DAMAGECOUNT value on done: 562419.0 [2024-08-06 04:51:36,799][52662] Sum rewards: 83.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.151', 'weapon5': '0.154', 'AMMO3': '0.205', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '69.000'} [2024-08-06 04:51:37,544][52795] DAMAGECOUNT value on done: 521498.0 [2024-08-06 04:51:37,544][52795] Sum rewards: 70.855, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.710', 'AMMO5': '0.026', 'AMMO2': '0.076', 'AMMO3': '0.248', 'weapon5': '0.268', 'weapon4': '0.304', 'weapon2': '0.316', 'AMMO4': '0.379', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.742', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '60.500'} [2024-08-06 04:51:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 464445440. Throughput: 0: 4383.1. Samples: 116114620. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:51:37,794][52567] Avg episode reward: [(0, '72.511')] [2024-08-06 04:51:38,308][52665] DAMAGECOUNT value on done: 564101.0 [2024-08-06 04:51:38,309][52665] Sum rewards: 79.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.088', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.060', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '68.000'} [2024-08-06 04:51:38,476][52660] DAMAGECOUNT value on done: 559537.0 [2024-08-06 04:51:38,477][52660] Sum rewards: 82.169, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.206', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.170', 'AMMO3': '0.174', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.434', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '65.500'} [2024-08-06 04:51:39,926][52662] DAMAGECOUNT value on done: 566759.0 [2024-08-06 04:51:39,926][52662] Sum rewards: 67.356, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.757', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.324', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2024-08-06 04:51:40,546][52650] Updated weights for policy 0, policy_version 56701 (0.0012) [2024-08-06 04:51:40,646][52795] DAMAGECOUNT value on done: 517630.0 [2024-08-06 04:51:40,662][52795] Sum rewards: 70.068, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.444', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.030', 'AMMO4': '0.032', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon2': '0.426', 'WEAPON3': '1.000', 'HITCOUNT': '3.240', 'weapon3': '3.372', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '56.000'} [2024-08-06 04:51:40,816][52659] DAMAGECOUNT value on done: 572468.0 [2024-08-06 04:51:40,818][52659] Sum rewards: 82.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.292', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.162', 'FRAGCOUNT': '68.000'} [2024-08-06 04:51:41,146][52665] DAMAGECOUNT value on done: 557934.0 [2024-08-06 04:51:41,149][52665] Sum rewards: 67.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.038', 'AMMO5': '0.008', 'weapon4': '0.010', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon2': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.600', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:41,513][52660] DAMAGECOUNT value on done: 562520.0 [2024-08-06 04:51:41,513][52660] Sum rewards: 70.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.725', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.076', 'weapon5': '0.100', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.000'} [2024-08-06 04:51:42,514][52662] DAMAGECOUNT value on done: 561942.0 [2024-08-06 04:51:42,514][52662] Sum rewards: 86.111, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.612', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.172', 'weapon4': '0.210', 'weapon2': '0.234', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.076', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '74.000'} [2024-08-06 04:51:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 464527360. Throughput: 0: 4378.7. Samples: 116140770. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:51:42,795][52567] Avg episode reward: [(0, '72.865')] [2024-08-06 04:51:42,938][52794] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:51:43,874][52795] DAMAGECOUNT value on done: 527175.0 [2024-08-06 04:51:43,874][52795] Sum rewards: 80.883, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.365', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.048', 'AMMO3': '0.156', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '0.900', 'weapon3': '3.058', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '63.000'} [2024-08-06 04:51:44,039][52659] DAMAGECOUNT value on done: 565851.0 [2024-08-06 04:51:44,040][52659] Sum rewards: 63.528, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.410', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.212', 'AMMO3': '0.242', 'weapon4': '0.272', 'AMMO4': '0.287', 'weapon2': '0.440', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.818', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '53.000'} [2024-08-06 04:51:44,162][52665] DAMAGECOUNT value on done: 550745.0 [2024-08-06 04:51:44,162][52665] Sum rewards: 64.965, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.953', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.066', 'weapon5': '0.112', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '56.000'} [2024-08-06 04:51:44,307][52660] DAMAGECOUNT value on done: 572224.0 [2024-08-06 04:51:44,307][52660] Sum rewards: 63.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.469', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.138', 'weapon4': '0.174', 'AMMO4': '0.182', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '51.000'} [2024-08-06 04:51:45,343][52650] Updated weights for policy 0, policy_version 56711 (0.0010) [2024-08-06 04:51:46,616][52659] DAMAGECOUNT value on done: 571666.0 [2024-08-06 04:51:46,616][52659] Sum rewards: 78.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.623', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.140', 'AMMO4': '0.141', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '65.000'} [2024-08-06 04:51:46,715][52660] DAMAGECOUNT value on done: 579314.0 [2024-08-06 04:51:46,715][52660] Sum rewards: 61.143, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.312', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.086', 'AMMO4': '0.168', 'weapon5': '0.196', 'weapon2': '0.270', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '3.080', 'weapon3': '3.142', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '54.000'} [2024-08-06 04:51:46,991][52795] DAMAGECOUNT value on done: 531234.0 [2024-08-06 04:51:46,992][52795] Sum rewards: 65.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.198', 'weapon5': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.494', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.538', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '55.000'} [2024-08-06 04:51:47,018][52665] DAMAGECOUNT value on done: 557216.0 [2024-08-06 04:51:47,022][52665] Sum rewards: 81.992, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.548', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.028', 'AMMO4': '0.105', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.246', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '70.000'} [2024-08-06 04:51:47,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 464609280. Throughput: 0: 4382.2. Samples: 116153880. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:51:47,794][52567] Avg episode reward: [(0, '72.683')] [2024-08-06 04:51:49,292][52660] DAMAGECOUNT value on done: 561906.0 [2024-08-06 04:51:49,294][52660] Sum rewards: 77.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.826', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.142', 'weapon4': '0.158', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '64.000'} [2024-08-06 04:51:49,919][52659] DAMAGECOUNT value on done: 567474.0 [2024-08-06 04:51:49,919][52659] Sum rewards: 73.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.240', 'WEAPON3': '1.550', 'weapon3': '3.462', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '61.000'} [2024-08-06 04:51:49,965][52650] Updated weights for policy 0, policy_version 56721 (0.0013) [2024-08-06 04:51:50,099][52795] DAMAGECOUNT value on done: 526433.0 [2024-08-06 04:51:50,099][52795] Sum rewards: 74.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.134', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '62.000'} [2024-08-06 04:51:50,681][52665] DAMAGECOUNT value on done: 560983.0 [2024-08-06 04:51:50,682][52665] Sum rewards: 75.502, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.645', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.155', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.534', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '60.000'} [2024-08-06 04:51:51,727][52671] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 04:51:52,525][52660] DAMAGECOUNT value on done: 569721.0 [2024-08-06 04:51:52,525][52660] Sum rewards: 78.066, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.770', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.227', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '66.500'} [2024-08-06 04:51:52,526][52659] DAMAGECOUNT value on done: 563060.0 [2024-08-06 04:51:52,527][52659] Sum rewards: 62.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.054', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.134', 'AMMO4': '0.151', 'weapon5': '0.194', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '51.000'} [2024-08-06 04:51:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 464707584. Throughput: 0: 4378.9. Samples: 116179960. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:51:52,794][52567] Avg episode reward: [(0, '72.879')] [2024-08-06 04:51:53,324][52795] DAMAGECOUNT value on done: 519381.0 [2024-08-06 04:51:53,327][52795] Sum rewards: 69.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.335', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO3': '0.210', 'weapon2': '0.624', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '58.000'} [2024-08-06 04:51:53,492][52665] DAMAGECOUNT value on done: 559631.0 [2024-08-06 04:51:53,493][52665] Sum rewards: 66.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.759', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.154', 'weapon4': '0.182', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2024-08-06 04:51:53,832][52794] DAMAGECOUNT value on done: 571039.0 [2024-08-06 04:51:53,833][52794] Sum rewards: 85.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'weapon4': '0.038', 'AMMO2': '0.050', 'weapon5': '0.098', 'AMMO3': '0.220', 'AMMO4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '70.500'} [2024-08-06 04:51:54,595][52650] Updated weights for policy 0, policy_version 56731 (0.0027) [2024-08-06 04:51:54,950][52820] DAMAGECOUNT value on done: 522273.0 [2024-08-06 04:51:54,952][52820] Sum rewards: 80.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.138', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.215', 'weapon5': '0.252', 'weapon2': '0.256', 'AMMO4': '0.290', 'weapon4': '0.292', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '67.000'} [2024-08-06 04:51:55,218][52659] DAMAGECOUNT value on done: 567004.0 [2024-08-06 04:51:55,218][52659] Sum rewards: 79.085, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.094', 'AMMO4': '0.153', 'weapon5': '0.208', 'AMMO3': '0.215', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.283', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '64.000'} [2024-08-06 04:51:55,760][52660] DAMAGECOUNT value on done: 564723.0 [2024-08-06 04:51:55,761][52660] Sum rewards: 82.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.110', 'weapon5': '0.216', 'weapon2': '0.242', 'AMMO4': '0.245', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '70.000'} [2024-08-06 04:51:55,848][52665] DAMAGECOUNT value on done: 566236.0 [2024-08-06 04:51:55,848][52665] Sum rewards: 71.996, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.696', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO3': '0.166', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.350', 'weapon4': '0.504', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:56,508][52795] DAMAGECOUNT value on done: 527996.0 [2024-08-06 04:51:56,509][52795] Sum rewards: 63.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.176', 'AMMO3': '0.215', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.144', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '54.000'} [2024-08-06 04:51:56,832][52794] DAMAGECOUNT value on done: 576224.0 [2024-08-06 04:51:56,832][52794] Sum rewards: 79.507, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.161', 'weapon2': '0.238', 'HEALTH': '0.594', 'WEAPON3': '0.950', 'weapon3': '3.486', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '63.000'} [2024-08-06 04:51:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 464789504. Throughput: 0: 4375.1. Samples: 116206090. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:51:57,794][52567] Avg episode reward: [(0, '73.192')] [2024-08-06 04:51:57,975][52820] DAMAGECOUNT value on done: 524159.0 [2024-08-06 04:51:57,979][52820] Sum rewards: 75.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.052', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon2': '0.182', 'weapon4': '0.184', 'AMMO4': '0.208', 'AMMO3': '0.225', 'weapon5': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 04:51:58,253][52659] DAMAGECOUNT value on done: 567873.0 [2024-08-06 04:51:58,256][52659] Sum rewards: 73.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.010', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.128', 'AMMO3': '0.174', 'weapon2': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON3': '1.000', 'weapon3': '3.124', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '59.000'} [2024-08-06 04:51:58,292][52665] DAMAGECOUNT value on done: 561171.0 [2024-08-06 04:51:58,294][52665] Sum rewards: 65.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.150', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.100', 'AMMO3': '0.225', 'weapon5': '0.256', 'AMMO4': '0.274', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '57.000'} [2024-08-06 04:51:58,519][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:51:58,708][52660] DAMAGECOUNT value on done: 565202.0 [2024-08-06 04:51:58,710][52660] Sum rewards: 76.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO4': '0.206', 'weapon2': '0.236', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '65.000'} [2024-08-06 04:51:59,371][52650] Updated weights for policy 0, policy_version 56741 (0.0041) [2024-08-06 04:51:59,374][52794] DAMAGECOUNT value on done: 573075.0 [2024-08-06 04:51:59,374][52794] Sum rewards: 67.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.244', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '54.000'} [2024-08-06 04:51:59,658][52795] DAMAGECOUNT value on done: 524980.0 [2024-08-06 04:51:59,660][52795] Sum rewards: 68.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.106', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.216', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:00,804][52665] DAMAGECOUNT value on done: 571094.0 [2024-08-06 04:52:00,804][52665] Sum rewards: 67.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.594', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO4': '0.181', 'AMMO3': '0.210', 'weapon4': '0.230', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '58.500'} [2024-08-06 04:52:01,158][52820] DAMAGECOUNT value on done: 528662.0 [2024-08-06 04:52:01,159][52820] Sum rewards: 63.441, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.022', 'AMMO2': '0.066', 'weapon4': '0.172', 'AMMO3': '0.249', 'weapon5': '0.258', 'AMMO4': '0.333', 'weapon2': '0.518', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.704', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '54.000'} [2024-08-06 04:52:01,458][52659] DAMAGECOUNT value on done: 564747.0 [2024-08-06 04:52:01,460][52659] Sum rewards: 70.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.180', 'AMMO3': '0.207', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:01,606][52660] DAMAGECOUNT value on done: 556950.0 [2024-08-06 04:52:01,607][52660] Sum rewards: 66.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.154', 'AMMO4': '0.201', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '55.000'} [2024-08-06 04:52:02,317][52794] DAMAGECOUNT value on done: 565499.0 [2024-08-06 04:52:02,318][52794] Sum rewards: 77.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.096', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.538', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:02,772][52795] DAMAGECOUNT value on done: 518588.0 [2024-08-06 04:52:02,772][52795] Sum rewards: 72.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.164', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.228', 'weapon4': '0.236', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.734', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 464879616. Throughput: 0: 4372.2. Samples: 116219340. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:52:02,802][52567] Avg episode reward: [(0, '72.533')] [2024-08-06 04:52:03,756][52665] DAMAGECOUNT value on done: 565727.0 [2024-08-06 04:52:03,758][52665] Sum rewards: 57.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.302', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.130', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '3.126', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '46.500'} [2024-08-06 04:52:03,979][52650] Updated weights for policy 0, policy_version 56751 (0.0024) [2024-08-06 04:52:04,298][52820] DAMAGECOUNT value on done: 518850.0 [2024-08-06 04:52:04,300][52820] Sum rewards: 61.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.138', 'weapon2': '0.198', 'AMMO3': '0.228', 'AMMO4': '0.287', 'weapon5': '0.314', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.056', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '50.000'} [2024-08-06 04:52:04,352][52659] DAMAGECOUNT value on done: 571234.0 [2024-08-06 04:52:04,354][52659] Sum rewards: 71.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.055', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO4': '0.173', 'AMMO3': '0.199', 'weapon5': '0.220', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.226', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:04,726][52794] DAMAGECOUNT value on done: 564383.0 [2024-08-06 04:52:04,729][52794] Sum rewards: 73.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.575', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.160', 'AMMO3': '0.209', 'AMMO4': '0.217', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:05,978][52795] DAMAGECOUNT value on done: 520295.0 [2024-08-06 04:52:05,981][52795] Sum rewards: 77.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.066', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:06,583][52665] DAMAGECOUNT value on done: 562281.0 [2024-08-06 04:52:06,584][52665] Sum rewards: 88.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.872', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.118', 'AMMO4': '0.168', 'AMMO3': '0.195', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '73.000'} [2024-08-06 04:52:06,922][52659] DAMAGECOUNT value on done: 575005.0 [2024-08-06 04:52:06,923][52659] Sum rewards: 81.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon4': '0.216', 'weapon5': '0.224', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.996', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '70.000'} [2024-08-06 04:52:07,489][52820] DAMAGECOUNT value on done: 528854.0 [2024-08-06 04:52:07,489][52820] Sum rewards: 69.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.173', 'weapon2': '0.330', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.364', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.000'} [2024-08-06 04:52:07,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 464961536. Throughput: 0: 4365.1. Samples: 116245400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 04:52:07,795][52567] Avg episode reward: [(0, '72.279')] [2024-08-06 04:52:08,145][52794] DAMAGECOUNT value on done: 566051.0 [2024-08-06 04:52:08,147][52794] Sum rewards: 67.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.858', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon7': '0.058', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.788', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '56.000'} [2024-08-06 04:52:08,581][52650] Updated weights for policy 0, policy_version 56761 (0.0041) [2024-08-06 04:52:09,111][52795] DAMAGECOUNT value on done: 525736.0 [2024-08-06 04:52:09,113][52795] Sum rewards: 72.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.058', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.512', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:09,154][52665] DAMAGECOUNT value on done: 561321.0 [2024-08-06 04:52:09,154][52665] Sum rewards: 67.109, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.138', 'weapon4': '0.220', 'weapon5': '0.258', 'AMMO4': '0.270', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.836', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '53.000'} [2024-08-06 04:52:09,837][52659] DAMAGECOUNT value on done: 563757.0 [2024-08-06 04:52:09,839][52659] Sum rewards: 71.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon4': '0.112', 'AMMO3': '0.179', 'weapon5': '0.218', 'AMMO4': '0.229', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:10,464][52820] DAMAGECOUNT value on done: 520382.0 [2024-08-06 04:52:10,465][52820] Sum rewards: 70.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.380', 'WEAPON3': '1.000', 'weapon3': '3.026', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '56.000'} [2024-08-06 04:52:11,046][52794] DAMAGECOUNT value on done: 574412.0 [2024-08-06 04:52:11,046][52794] Sum rewards: 67.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.470', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.056', 'AMMO4': '0.167', 'weapon5': '0.182', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.100', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:12,016][52665] DAMAGECOUNT value on done: 559162.0 [2024-08-06 04:52:12,016][52665] Sum rewards: 73.284, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.044', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:12,364][52795] DAMAGECOUNT value on done: 516860.0 [2024-08-06 04:52:12,365][52795] Sum rewards: 70.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.320', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.106', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.702', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '56.000'} [2024-08-06 04:52:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 465059840. Throughput: 0: 4371.1. Samples: 116271740. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:52:12,794][52567] Avg episode reward: [(0, '72.295')] [2024-08-06 04:52:12,993][52659] DAMAGECOUNT value on done: 570900.0 [2024-08-06 04:52:12,993][52659] Sum rewards: 83.850, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.182', 'weapon2': '0.202', 'weapon4': '0.232', 'weapon5': '0.278', 'AMMO4': '0.322', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '68.000'} [2024-08-06 04:52:13,570][52650] Updated weights for policy 0, policy_version 56771 (0.0021) [2024-08-06 04:52:13,611][52794] DAMAGECOUNT value on done: 561390.0 [2024-08-06 04:52:13,611][52794] Sum rewards: 74.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.136', 'AMMO4': '0.190', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:13,777][52820] DAMAGECOUNT value on done: 524864.0 [2024-08-06 04:52:13,779][52820] Sum rewards: 54.643, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.330', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.136', 'weapon5': '0.226', 'AMMO3': '0.290', 'AMMO4': '0.293', 'weapon2': '0.332', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.990', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '50.000'} [2024-08-06 04:52:15,148][52665] DAMAGECOUNT value on done: 557677.0 [2024-08-06 04:52:15,150][52665] Sum rewards: 91.274, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.203', 'weapon2': '0.212', 'HEALTH': '0.725', 'WEAPON3': '1.100', 'weapon3': '3.328', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '73.000'} [2024-08-06 04:52:15,518][52795] DAMAGECOUNT value on done: 533402.0 [2024-08-06 04:52:15,519][52795] Sum rewards: 78.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.145', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '65.000'} [2024-08-06 04:52:15,916][52659] DAMAGECOUNT value on done: 561292.0 [2024-08-06 04:52:15,918][52659] Sum rewards: 67.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.680', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.180', 'weapon4': '0.244', 'AMMO3': '0.257', 'weapon2': '0.278', 'AMMO4': '0.283', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '59.000'} [2024-08-06 04:52:16,508][52794] DAMAGECOUNT value on done: 571166.0 [2024-08-06 04:52:16,509][52794] Sum rewards: 68.450, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.827', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.158', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.278', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.750', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '54.000'} [2024-08-06 04:52:16,870][52820] DAMAGECOUNT value on done: 528111.0 [2024-08-06 04:52:16,871][52820] Sum rewards: 85.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.455', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.018', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.352', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '71.000'} [2024-08-06 04:52:17,067][52647] DAMAGECOUNT value on done: 601986.0 [2024-08-06 04:52:17,067][52647] Sum rewards: 74.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.080', 'AMMO3': '0.183', 'weapon5': '0.212', 'AMMO4': '0.269', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.126', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:17,738][52665] DAMAGECOUNT value on done: 559240.0 [2024-08-06 04:52:17,738][52665] Sum rewards: 71.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.865', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.138', 'AMMO4': '0.186', 'weapon5': '0.186', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 465141760. Throughput: 0: 4368.9. Samples: 116284900. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:52:17,794][52567] Avg episode reward: [(0, '72.416')] [2024-08-06 04:52:17,893][52650] Updated weights for policy 0, policy_version 56781 (0.0022) [2024-08-06 04:52:18,642][52795] DAMAGECOUNT value on done: 524399.0 [2024-08-06 04:52:18,644][52795] Sum rewards: 83.423, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.403', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.136', 'weapon4': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '70.000'} [2024-08-06 04:52:19,115][52659] DAMAGECOUNT value on done: 565278.0 [2024-08-06 04:52:19,119][52659] Sum rewards: 61.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.936', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.158', 'AMMO4': '0.173', 'weapon2': '0.246', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.242', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '53.000'} [2024-08-06 04:52:19,276][52794] DAMAGECOUNT value on done: 567049.0 [2024-08-06 04:52:19,276][52794] Sum rewards: 70.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.114', 'weapon5': '0.152', 'AMMO3': '0.224', 'weapon2': '0.232', 'AMMO4': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '60.000'} [2024-08-06 04:52:19,637][52647] DAMAGECOUNT value on done: 596449.0 [2024-08-06 04:52:19,639][52647] Sum rewards: 53.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.555', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.146', 'AMMO4': '0.203', 'AMMO3': '0.258', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.220', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '48.000'} [2024-08-06 04:52:20,043][52820] DAMAGECOUNT value on done: 523035.0 [2024-08-06 04:52:20,046][52820] Sum rewards: 81.029, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '64.000'} [2024-08-06 04:52:20,815][52665] DAMAGECOUNT value on done: 556249.0 [2024-08-06 04:52:20,816][52665] Sum rewards: 76.596, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.798', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:21,702][52795] DAMAGECOUNT value on done: 518584.0 [2024-08-06 04:52:21,705][52795] Sum rewards: 82.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.478', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '66.000'} [2024-08-06 04:52:21,964][52659] DAMAGECOUNT value on done: 577247.0 [2024-08-06 04:52:21,966][52659] Sum rewards: 83.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.866', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon4': '0.182', 'AMMO3': '0.183', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '68.000'} [2024-08-06 04:52:21,994][52794] DAMAGECOUNT value on done: 564057.0 [2024-08-06 04:52:21,997][52794] Sum rewards: 83.720, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.336', 'WEAPON3': '0.950', 'weapon3': '3.448', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '66.000'} [2024-08-06 04:52:22,403][52647] DAMAGECOUNT value on done: 598316.0 [2024-08-06 04:52:22,406][52647] Sum rewards: 73.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.765', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '60.000'} [2024-08-06 04:52:22,708][52650] Updated weights for policy 0, policy_version 56791 (0.0012) [2024-08-06 04:52:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 465231872. Throughput: 0: 4370.2. Samples: 116311280. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:52:22,794][52567] Avg episode reward: [(0, '73.448')] [2024-08-06 04:52:23,125][52820] DAMAGECOUNT value on done: 531936.0 [2024-08-06 04:52:23,125][52820] Sum rewards: 69.015, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.488', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.030', 'AMMO3': '0.281', 'weapon2': '0.324', 'WEAPON3': '1.700', 'HITCOUNT': '3.320', 'weapon3': '3.466', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:23,614][52662] Large shaping reward 3.651 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:52:23,920][52665] DAMAGECOUNT value on done: 560479.0 [2024-08-06 04:52:23,920][52665] Sum rewards: 74.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.194', 'AMMO4': '0.197', 'weapon2': '0.200', 'AMMO3': '0.210', 'weapon5': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:24,334][52659] DAMAGECOUNT value on done: 568808.0 [2024-08-06 04:52:24,335][52659] Sum rewards: 61.363, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.131', 'weapon4': '0.174', 'AMMO4': '0.252', 'weapon5': '0.288', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '2.720', 'weapon3': '2.804', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '48.500'} [2024-08-06 04:52:24,869][52794] DAMAGECOUNT value on done: 568917.0 [2024-08-06 04:52:24,872][52794] Sum rewards: 68.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.015', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.194', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.352', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:25,007][52795] DAMAGECOUNT value on done: 525145.0 [2024-08-06 04:52:25,007][52795] Sum rewards: 75.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.758', 'AMMO5': '0.005', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.041', 'weapon5': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.278', 'weapon4': '0.396', 'WEAPON3': '1.350', 'weapon3': '2.948', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '64.000'} [2024-08-06 04:52:25,571][52647] DAMAGECOUNT value on done: 605046.0 [2024-08-06 04:52:25,571][52647] Sum rewards: 70.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.030', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.116', 'weapon5': '0.194', 'AMMO4': '0.242', 'AMMO3': '0.246', 'weapon2': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '60.000'} [2024-08-06 04:52:26,164][52820] DAMAGECOUNT value on done: 522062.0 [2024-08-06 04:52:26,165][52820] Sum rewards: 77.829, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.158', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.202', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '63.500'} [2024-08-06 04:52:26,797][52665] DAMAGECOUNT value on done: 562053.0 [2024-08-06 04:52:26,801][52665] Sum rewards: 81.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.253', 'weapon2': '0.428', 'WEAPON3': '1.550', 'weapon3': '3.342', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '68.000'} [2024-08-06 04:52:27,252][52659] DAMAGECOUNT value on done: 577786.0 [2024-08-06 04:52:27,253][52659] Sum rewards: 81.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.130', 'weapon4': '0.134', 'AMMO4': '0.173', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '67.000'} [2024-08-06 04:52:27,505][52794] DAMAGECOUNT value on done: 563970.0 [2024-08-06 04:52:27,506][52794] Sum rewards: 67.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.251', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.118', 'AMMO3': '0.193', 'weapon5': '0.252', 'AMMO4': '0.311', 'weapon2': '0.408', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.760', 'weapon3': '2.886', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:27,530][52650] Updated weights for policy 0, policy_version 56801 (0.0030) [2024-08-06 04:52:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 465313792. Throughput: 0: 4375.8. Samples: 116337680. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:52:27,794][52567] Avg episode reward: [(0, '73.288')] [2024-08-06 04:52:27,869][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056802_465321984.pth... [2024-08-06 04:52:28,016][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056290_461127680.pth [2024-08-06 04:52:28,124][52647] DAMAGECOUNT value on done: 606891.0 [2024-08-06 04:52:28,124][52647] Sum rewards: 79.470, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.902', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO3': '0.155', 'weapon2': '0.166', 'AMMO4': '0.170', 'weapon5': '0.310', 'weapon4': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.952', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:28,262][52795] DAMAGECOUNT value on done: 530554.0 [2024-08-06 04:52:28,265][52795] Sum rewards: 78.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.917', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.070', 'AMMO4': '0.157', 'weapon5': '0.170', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '65.000'} [2024-08-06 04:52:29,489][52820] DAMAGECOUNT value on done: 527050.0 [2024-08-06 04:52:29,492][52820] Sum rewards: 70.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.126', 'AMMO4': '0.195', 'AMMO3': '0.220', 'weapon5': '0.238', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.092', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:30,335][52794] DAMAGECOUNT value on done: 582351.0 [2024-08-06 04:52:30,337][52794] Sum rewards: 72.743, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.785', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.239', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:30,490][52659] DAMAGECOUNT value on done: 568083.0 [2024-08-06 04:52:30,491][52659] Sum rewards: 75.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.084', 'weapon4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:30,797][52647] DAMAGECOUNT value on done: 606108.0 [2024-08-06 04:52:30,797][52647] Sum rewards: 78.308, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.123', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '66.000'} [2024-08-06 04:52:32,085][52650] Updated weights for policy 0, policy_version 56811 (0.0021) [2024-08-06 04:52:32,594][52820] DAMAGECOUNT value on done: 535182.0 [2024-08-06 04:52:32,598][52820] Sum rewards: 77.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.227', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.095', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 465403904. Throughput: 0: 4366.2. Samples: 116350360. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:52:32,795][52567] Avg episode reward: [(0, '73.401')] [2024-08-06 04:52:33,427][52794] DAMAGECOUNT value on done: 560321.0 [2024-08-06 04:52:33,435][52794] Sum rewards: 78.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.553', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.098', 'weapon4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.050', 'weapon3': '3.290', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '64.000'} [2024-08-06 04:52:33,637][52659] DAMAGECOUNT value on done: 573818.0 [2024-08-06 04:52:33,639][52659] Sum rewards: 91.300, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.832', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon5': '0.184', 'AMMO3': '0.245', 'AMMO4': '0.250', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.825', 'FRAGCOUNT': '78.000'} [2024-08-06 04:52:33,759][52647] DAMAGECOUNT value on done: 601727.0 [2024-08-06 04:52:33,759][52647] Sum rewards: 81.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.159', 'weapon4': '0.166', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '67.000'} [2024-08-06 04:52:35,705][52820] DAMAGECOUNT value on done: 530143.0 [2024-08-06 04:52:35,707][52820] Sum rewards: 81.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.855', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'weapon5': '0.060', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.308', 'WEAPON3': '1.650', 'weapon3': '3.382', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '70.000'} [2024-08-06 04:52:36,152][52794] DAMAGECOUNT value on done: 576982.0 [2024-08-06 04:52:36,152][52794] Sum rewards: 69.455, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.267', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.492', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '3.216', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '55.000'} [2024-08-06 04:52:36,638][52647] DAMAGECOUNT value on done: 591123.0 [2024-08-06 04:52:36,639][52647] Sum rewards: 72.177, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO4': '0.170', 'AMMO3': '0.205', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '59.000'} [2024-08-06 04:52:36,661][52659] DAMAGECOUNT value on done: 569251.0 [2024-08-06 04:52:36,663][52659] Sum rewards: 80.763, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.900', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.182', 'AMMO4': '0.187', 'weapon5': '0.204', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '65.000'} [2024-08-06 04:52:37,169][52650] Updated weights for policy 0, policy_version 56821 (0.0024) [2024-08-06 04:52:37,410][52667] DAMAGECOUNT value on done: 569963.0 [2024-08-06 04:52:37,411][52667] Sum rewards: 71.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.784', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.115', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON5': '0.350', 'weapon5': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 465494016. Throughput: 0: 4372.4. Samples: 116376720. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:52:37,794][52567] Avg episode reward: [(0, '73.566')] [2024-08-06 04:52:38,807][52663] DAMAGECOUNT value on done: 577845.0 [2024-08-06 04:52:38,815][52663] Sum rewards: 70.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.256', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.176', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.356', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:38,886][52820] DAMAGECOUNT value on done: 532570.0 [2024-08-06 04:52:38,886][52820] Sum rewards: 79.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.685', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.196', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '65.000'} [2024-08-06 04:52:39,353][52794] DAMAGECOUNT value on done: 566458.0 [2024-08-06 04:52:39,353][52794] Sum rewards: 67.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.052', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.412', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.500'} [2024-08-06 04:52:39,650][52647] DAMAGECOUNT value on done: 602496.0 [2024-08-06 04:52:39,651][52647] Sum rewards: 75.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.184', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.048', 'AMMO4': '0.097', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.100', 'weapon3': '3.454', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:40,380][52667] DAMAGECOUNT value on done: 577441.0 [2024-08-06 04:52:40,381][52667] Sum rewards: 63.478, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.300', 'AMMO3': '0.301', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.724', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:41,473][52650] Updated weights for policy 0, policy_version 56831 (0.0027) [2024-08-06 04:52:41,871][52663] DAMAGECOUNT value on done: 568541.0 [2024-08-06 04:52:41,871][52663] Sum rewards: 79.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.332', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.064', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon5': '0.252', 'weapon2': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:41,931][52820] DAMAGECOUNT value on done: 527971.0 [2024-08-06 04:52:41,932][52820] Sum rewards: 83.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.579', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.146', 'weapon2': '0.178', 'AMMO3': '0.195', 'weapon4': '0.206', 'AMMO4': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '68.000'} [2024-08-06 04:52:42,204][52647] DAMAGECOUNT value on done: 598419.0 [2024-08-06 04:52:42,204][52647] Sum rewards: 74.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.459', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'weapon4': '0.094', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:42,327][52794] DAMAGECOUNT value on done: 575843.0 [2024-08-06 04:52:42,328][52794] Sum rewards: 57.795, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.168', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.072', 'AMMO3': '0.131', 'AMMO4': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '0.950', 'HITCOUNT': '2.730', 'weapon3': '3.236', 'DAMAGECOUNT': '13.584', 'FRAGCOUNT': '47.000'} [2024-08-06 04:52:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 465575936. Throughput: 0: 4373.3. Samples: 116402890. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 04:52:42,794][52567] Avg episode reward: [(0, '73.501')] [2024-08-06 04:52:43,412][52667] DAMAGECOUNT value on done: 571665.0 [2024-08-06 04:52:43,413][52667] Sum rewards: 93.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.054', 'weapon4': '0.098', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.230', 'WEAPON3': '1.350', 'weapon3': '3.448', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.987', 'FRAGCOUNT': '76.000'} [2024-08-06 04:52:44,733][52663] DAMAGECOUNT value on done: 559239.0 [2024-08-06 04:52:44,733][52663] Sum rewards: 87.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '71.000'} [2024-08-06 04:52:44,872][52794] DAMAGECOUNT value on done: 578294.0 [2024-08-06 04:52:44,872][52794] Sum rewards: 76.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO4': '0.185', 'weapon5': '0.220', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:44,880][52811] DAMAGECOUNT value on done: 543443.0 [2024-08-06 04:52:44,880][52811] Sum rewards: 70.819, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.896', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO3': '0.147', 'weapon4': '0.164', 'AMMO4': '0.200', 'weapon5': '0.210', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.764', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '56.500'} [2024-08-06 04:52:44,881][52647] DAMAGECOUNT value on done: 598087.0 [2024-08-06 04:52:44,881][52647] Sum rewards: 77.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.815', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.388', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:45,065][52820] DAMAGECOUNT value on done: 529752.0 [2024-08-06 04:52:45,065][52820] Sum rewards: 78.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.666', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.134', 'AMMO3': '0.236', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '64.000'} [2024-08-06 04:52:46,210][52650] Updated weights for policy 0, policy_version 56841 (0.0020) [2024-08-06 04:52:46,347][52667] DAMAGECOUNT value on done: 571934.0 [2024-08-06 04:52:46,350][52667] Sum rewards: 79.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.210', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon2': '0.166', 'weapon5': '0.166', 'AMMO4': '0.168', 'weapon4': '0.188', 'AMMO3': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '66.000'} [2024-08-06 04:52:47,364][52666] DAMAGECOUNT value on done: 567033.0 [2024-08-06 04:52:47,365][52666] Sum rewards: 70.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.056', 'weapon5': '0.088', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.390', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:47,792][52794] DAMAGECOUNT value on done: 566852.0 [2024-08-06 04:52:47,793][52794] Sum rewards: 74.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.998', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.198', 'AMMO3': '0.214', 'AMMO4': '0.225', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 465666048. Throughput: 0: 4372.2. Samples: 116416090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:52:47,794][52567] Avg episode reward: [(0, '74.102')] [2024-08-06 04:52:47,797][52614] Saving new best policy, reward=74.102! [2024-08-06 04:52:47,830][52647] DAMAGECOUNT value on done: 591688.0 [2024-08-06 04:52:47,830][52647] Sum rewards: 70.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.006', 'WEAPON5': '0.050', 'AMMO3': '0.232', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.408', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 04:52:47,834][52663] DAMAGECOUNT value on done: 565902.0 [2024-08-06 04:52:47,836][52663] Sum rewards: 87.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.772', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.042', 'AMMO4': '0.061', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '72.000'} [2024-08-06 04:52:47,934][52811] DAMAGECOUNT value on done: 526417.0 [2024-08-06 04:52:47,935][52811] Sum rewards: 74.061, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.312', 'weapon4': '0.420', 'WEAPON3': '1.450', 'weapon3': '2.854', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '65.000'} [2024-08-06 04:52:48,213][52820] DAMAGECOUNT value on done: 539083.0 [2024-08-06 04:52:48,215][52820] Sum rewards: 70.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.822', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.144', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:48,511][52668] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 04:52:49,221][52667] DAMAGECOUNT value on done: 575524.0 [2024-08-06 04:52:49,223][52667] Sum rewards: 76.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.214', 'weapon4': '0.232', 'AMMO3': '0.263', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.896', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '64.000'} [2024-08-06 04:52:49,268][52670] DAMAGECOUNT value on done: 559262.0 [2024-08-06 04:52:49,269][52670] Sum rewards: 74.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.718', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.134', 'AMMO3': '0.162', 'AMMO4': '0.216', 'weapon2': '0.232', 'weapon5': '0.242', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '58.500'} [2024-08-06 04:52:50,216][52666] DAMAGECOUNT value on done: 571012.0 [2024-08-06 04:52:50,217][52666] Sum rewards: 72.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.256', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.134', 'weapon4': '0.188', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 04:52:50,344][52647] DAMAGECOUNT value on done: 605585.0 [2024-08-06 04:52:50,345][52647] Sum rewards: 66.880, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.275', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.316', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:50,970][52650] Updated weights for policy 0, policy_version 56851 (0.0017) [2024-08-06 04:52:51,096][52663] DAMAGECOUNT value on done: 570535.0 [2024-08-06 04:52:51,098][52663] Sum rewards: 88.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.388', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.528', 'FRAGCOUNT': '72.000'} [2024-08-06 04:52:51,176][52811] DAMAGECOUNT value on done: 525575.0 [2024-08-06 04:52:51,177][52811] Sum rewards: 63.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.040', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.136', 'AMMO3': '0.215', 'weapon2': '0.248', 'AMMO4': '0.299', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '52.000'} [2024-08-06 04:52:51,478][52820] DAMAGECOUNT value on done: 536065.0 [2024-08-06 04:52:51,480][52820] Sum rewards: 78.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.734', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON3': '1.200', 'weapon3': '3.476', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 04:52:51,695][52667] DAMAGECOUNT value on done: 578049.0 [2024-08-06 04:52:51,695][52667] Sum rewards: 63.615, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.606', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.116', 'AMMO4': '0.199', 'AMMO3': '0.253', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.208', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '56.000'} [2024-08-06 04:52:52,270][52670] DAMAGECOUNT value on done: 568581.0 [2024-08-06 04:52:52,270][52670] Sum rewards: 58.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.134', 'weapon4': '0.180', 'AMMO3': '0.187', 'AMMO4': '0.259', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.120', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '49.000'} [2024-08-06 04:52:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 465747968. Throughput: 0: 4366.5. Samples: 116441890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:52:52,795][52567] Avg episode reward: [(0, '73.820')] [2024-08-06 04:52:53,289][52647] DAMAGECOUNT value on done: 595439.0 [2024-08-06 04:52:53,290][52647] Sum rewards: 73.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.524', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.092', 'AMMO3': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.438', 'WEAPON3': '0.850', 'weapon3': '2.986', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '57.000'} [2024-08-06 04:52:53,364][52666] DAMAGECOUNT value on done: 571523.0 [2024-08-06 04:52:53,365][52666] Sum rewards: 80.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.725', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO3': '0.172', 'AMMO4': '0.194', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '65.000'} [2024-08-06 04:52:53,997][52663] DAMAGECOUNT value on done: 574944.0 [2024-08-06 04:52:53,998][52663] Sum rewards: 72.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.054', 'weapon4': '0.090', 'AMMO4': '0.143', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon2': '1.152', 'weapon3': '2.510', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:54,263][52667] DAMAGECOUNT value on done: 573400.0 [2024-08-06 04:52:54,264][52667] Sum rewards: 74.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.336', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon4': '0.198', 'AMMO3': '0.220', 'weapon5': '0.240', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '62.000'} [2024-08-06 04:52:54,283][52811] DAMAGECOUNT value on done: 526343.0 [2024-08-06 04:52:54,285][52811] Sum rewards: 54.005, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.276', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.176', 'AMMO3': '0.185', 'weapon4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.150', 'HITCOUNT': '2.560', 'weapon3': '2.946', 'DAMAGECOUNT': '12.414', 'FRAGCOUNT': '45.000'} [2024-08-06 04:52:54,360][52660] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 04:52:54,738][52820] DAMAGECOUNT value on done: 522026.0 [2024-08-06 04:52:54,738][52820] Sum rewards: 65.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.100', 'weapon5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.662', 'WEAPON3': '1.500', 'weapon3': '2.730', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 04:52:55,509][52670] DAMAGECOUNT value on done: 562215.0 [2024-08-06 04:52:55,510][52670] Sum rewards: 74.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.505', 'AMMO5': '0.008', 'AMMO2': '0.028', 'WEAPON1': '0.040', 'weapon5': '0.124', 'AMMO4': '0.140', 'weapon2': '0.166', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:55,752][52647] DAMAGECOUNT value on done: 603834.0 [2024-08-06 04:52:55,754][52647] Sum rewards: 73.595, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.995', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.164', 'weapon2': '0.192', 'AMMO4': '0.244', 'AMMO3': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.264', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '65.000'} [2024-08-06 04:52:55,986][52650] Updated weights for policy 0, policy_version 56861 (0.0031) [2024-08-06 04:52:56,674][52666] DAMAGECOUNT value on done: 569824.0 [2024-08-06 04:52:56,675][52666] Sum rewards: 67.880, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.855', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.075', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.256', 'weapon4': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '58.000'} [2024-08-06 04:52:57,082][52663] DAMAGECOUNT value on done: 569315.0 [2024-08-06 04:52:57,082][52663] Sum rewards: 78.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.949', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.131', 'weapon5': '0.194', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '63.000'} [2024-08-06 04:52:57,347][52667] DAMAGECOUNT value on done: 567669.0 [2024-08-06 04:52:57,349][52667] Sum rewards: 82.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.920', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.225', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.522', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '68.000'} [2024-08-06 04:52:57,363][52811] DAMAGECOUNT value on done: 534394.0 [2024-08-06 04:52:57,364][52811] Sum rewards: 79.898, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.965', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.140', 'weapon5': '0.166', 'AMMO4': '0.178', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.648', 'WEAPON3': '0.900', 'weapon3': '2.736', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '61.000'} [2024-08-06 04:52:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 465838080. Throughput: 0: 4366.4. Samples: 116468230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:52:57,795][52567] Avg episode reward: [(0, '74.417')] [2024-08-06 04:52:57,798][52614] Saving new best policy, reward=74.417! [2024-08-06 04:52:58,631][52670] DAMAGECOUNT value on done: 559214.0 [2024-08-06 04:52:58,632][52670] Sum rewards: 60.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.182', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.212', 'weapon5': '0.246', 'weapon4': '0.266', 'AMMO4': '0.297', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '51.000'} [2024-08-06 04:52:58,785][52647] DAMAGECOUNT value on done: 602497.0 [2024-08-06 04:52:58,787][52647] Sum rewards: 76.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.432', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'weapon5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 04:52:59,706][52666] DAMAGECOUNT value on done: 563617.0 [2024-08-06 04:52:59,706][52666] Sum rewards: 76.374, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.975', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.176', 'weapon4': '0.192', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '62.000'} [2024-08-06 04:53:00,003][52667] DAMAGECOUNT value on done: 574781.0 [2024-08-06 04:53:00,004][52667] Sum rewards: 73.187, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.486', 'AMMO5': '0.017', 'AMMO2': '0.071', 'weapon2': '0.180', 'AMMO3': '0.260', 'weapon5': '0.284', 'AMMO4': '0.355', 'weapon4': '0.454', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.724', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:00,034][52663] DAMAGECOUNT value on done: 563844.0 [2024-08-06 04:53:00,035][52663] Sum rewards: 71.370, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.158', 'weapon5': '0.174', 'AMMO4': '0.190', 'AMMO3': '0.239', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.516', 'WEAPON3': '1.500', 'weapon3': '2.800', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '62.000'} [2024-08-06 04:53:00,266][52650] Updated weights for policy 0, policy_version 56871 (0.0011) [2024-08-06 04:53:00,551][52811] DAMAGECOUNT value on done: 538693.0 [2024-08-06 04:53:00,552][52811] Sum rewards: 78.094, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.240', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '66.000'} [2024-08-06 04:53:01,519][52670] DAMAGECOUNT value on done: 573643.0 [2024-08-06 04:53:01,521][52670] Sum rewards: 74.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon4': '0.166', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:01,560][52647] DAMAGECOUNT value on done: 588311.0 [2024-08-06 04:53:01,561][52647] Sum rewards: 64.642, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.480', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.144', 'weapon5': '0.146', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.800', 'weapon3': '2.976', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 04:53:02,399][52666] DAMAGECOUNT value on done: 562341.0 [2024-08-06 04:53:02,400][52666] Sum rewards: 78.226, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.162', 'weapon2': '0.176', 'AMMO4': '0.198', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '66.500'} [2024-08-06 04:53:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 465928192. Throughput: 0: 4362.4. Samples: 116481210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:53:02,795][52567] Avg episode reward: [(0, '74.306')] [2024-08-06 04:53:02,998][52667] DAMAGECOUNT value on done: 578284.0 [2024-08-06 04:53:02,998][52667] Sum rewards: 73.488, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.168', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.199', 'weapon2': '0.212', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:03,365][52663] DAMAGECOUNT value on done: 560401.0 [2024-08-06 04:53:03,365][52663] Sum rewards: 77.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.677', 'AMMO5': '0.024', 'AMMO2': '0.055', 'weapon4': '0.120', 'AMMO3': '0.229', 'weapon2': '0.240', 'AMMO4': '0.273', 'weapon5': '0.308', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.988', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:03,841][52811] DAMAGECOUNT value on done: 536023.0 [2024-08-06 04:53:03,842][52811] Sum rewards: 75.578, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.460', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.094', 'AMMO4': '0.173', 'weapon4': '0.230', 'AMMO3': '0.246', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '65.000'} [2024-08-06 04:53:04,286][52670] DAMAGECOUNT value on done: 566583.0 [2024-08-06 04:53:04,287][52670] Sum rewards: 70.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.064', 'AMMO4': '0.162', 'weapon4': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.500', 'weapon3': '2.966', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:04,343][52647] DAMAGECOUNT value on done: 596250.0 [2024-08-06 04:53:04,343][52647] Sum rewards: 65.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.102', 'weapon5': '0.116', 'AMMO4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.304', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:04,446][52649] DAMAGECOUNT value on done: 551626.0 [2024-08-06 04:53:04,448][52649] Sum rewards: 78.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.860', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.248', 'AMMO3': '0.251', 'WEAPON3': '1.700', 'weapon3': '3.374', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '66.000'} [2024-08-06 04:53:05,115][52650] Updated weights for policy 0, policy_version 56881 (0.0014) [2024-08-06 04:53:05,291][52666] DAMAGECOUNT value on done: 566658.0 [2024-08-06 04:53:05,292][52666] Sum rewards: 78.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.926', 'AMMO5': '0.017', 'AMMO2': '0.073', 'weapon4': '0.202', 'AMMO3': '0.213', 'weapon5': '0.216', 'weapon2': '0.334', 'AMMO4': '0.367', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:06,080][52667] DAMAGECOUNT value on done: 564958.0 [2024-08-06 04:53:06,082][52667] Sum rewards: 85.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.408', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '70.000'} [2024-08-06 04:53:06,772][52663] DAMAGECOUNT value on done: 568170.0 [2024-08-06 04:53:06,774][52663] Sum rewards: 68.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.068', 'weapon4': '0.128', 'AMMO3': '0.203', 'weapon2': '0.222', 'AMMO4': '0.287', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.376', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:07,077][52649] DAMAGECOUNT value on done: 544297.0 [2024-08-06 04:53:07,079][52649] Sum rewards: 68.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.060', 'weapon4': '0.084', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.590', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '56.000'} [2024-08-06 04:53:07,094][52670] DAMAGECOUNT value on done: 555566.0 [2024-08-06 04:53:07,096][52670] Sum rewards: 71.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.206', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon2': '0.210', 'weapon4': '0.222', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:07,168][52647] DAMAGECOUNT value on done: 588409.0 [2024-08-06 04:53:07,168][52647] Sum rewards: 76.440, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.173', 'weapon5': '0.180', 'weapon4': '0.190', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.978', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:07,170][52811] DAMAGECOUNT value on done: 529472.0 [2024-08-06 04:53:07,170][52811] Sum rewards: 86.605, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.172', 'AMMO3': '0.181', 'weapon2': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '69.000'} [2024-08-06 04:53:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 466010112. Throughput: 0: 4356.9. Samples: 116507340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:53:07,794][52567] Avg episode reward: [(0, '74.461')] [2024-08-06 04:53:07,798][52614] Saving new best policy, reward=74.461! [2024-08-06 04:53:08,050][52666] DAMAGECOUNT value on done: 566375.0 [2024-08-06 04:53:08,050][52666] Sum rewards: 80.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.104', 'AMMO4': '0.145', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '66.000'} [2024-08-06 04:53:08,894][52667] DAMAGECOUNT value on done: 567447.0 [2024-08-06 04:53:08,894][52667] Sum rewards: 77.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.060', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.712', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:09,525][52666] Large shaping reward 2.534 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.483, 161.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:53:09,691][52650] Updated weights for policy 0, policy_version 56891 (0.0022) [2024-08-06 04:53:09,746][52649] DAMAGECOUNT value on done: 562436.0 [2024-08-06 04:53:09,748][52649] Sum rewards: 80.613, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.534', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.151', 'weapon5': '0.180', 'AMMO3': '0.189', 'weapon2': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.270', 'weapon3': '3.308', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:09,981][52663] DAMAGECOUNT value on done: 577876.0 [2024-08-06 04:53:09,982][52663] Sum rewards: 75.742, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.238', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.201', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:10,030][52670] DAMAGECOUNT value on done: 564028.0 [2024-08-06 04:53:10,032][52670] Sum rewards: 76.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.038', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:10,333][52647] DAMAGECOUNT value on done: 591965.0 [2024-08-06 04:53:10,334][52647] Sum rewards: 63.399, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.470', 'AMMO5': '0.028', 'AMMO2': '0.067', 'weapon4': '0.244', 'AMMO3': '0.285', 'weapon2': '0.290', 'AMMO4': '0.333', 'weapon5': '0.392', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.710', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:10,611][52811] DAMAGECOUNT value on done: 539378.0 [2024-08-06 04:53:10,611][52811] Sum rewards: 74.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.229', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '3.290', 'weapon3': '3.328', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:11,236][52666] DAMAGECOUNT value on done: 566071.0 [2024-08-06 04:53:11,236][52666] Sum rewards: 78.911, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.787', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon4': '0.238', 'weapon2': '0.274', 'WEAPON3': '0.950', 'weapon3': '3.184', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:11,746][52667] DAMAGECOUNT value on done: 575797.0 [2024-08-06 04:53:11,748][52667] Sum rewards: 77.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.474', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:12,426][52649] DAMAGECOUNT value on done: 556269.0 [2024-08-06 04:53:12,426][52649] Sum rewards: 58.671, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO3': '0.162', 'AMMO4': '0.194', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.312', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '46.500'} [2024-08-06 04:53:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 466100224. Throughput: 0: 4347.6. Samples: 116533320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:53:12,794][52567] Avg episode reward: [(0, '74.415')] [2024-08-06 04:53:12,833][52664] DAMAGECOUNT value on done: 591567.0 [2024-08-06 04:53:12,833][52664] Sum rewards: 73.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.060', 'weapon5': '0.142', 'AMMO4': '0.155', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:12,900][52670] DAMAGECOUNT value on done: 562298.0 [2024-08-06 04:53:12,901][52670] Sum rewards: 62.826, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.105', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon4': '0.256', 'AMMO3': '0.265', 'weapon5': '0.266', 'weapon2': '0.338', 'AMMO4': '0.347', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.770', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '54.500'} [2024-08-06 04:53:13,097][52663] DAMAGECOUNT value on done: 563321.0 [2024-08-06 04:53:13,105][52663] Sum rewards: 75.217, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.914', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.140', 'AMMO4': '0.165', 'weapon5': '0.192', 'AMMO3': '0.253', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '64.500'} [2024-08-06 04:53:13,733][52811] DAMAGECOUNT value on done: 534016.0 [2024-08-06 04:53:13,733][52811] Sum rewards: 79.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.109', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '64.500'} [2024-08-06 04:53:13,934][52666] DAMAGECOUNT value on done: 561475.0 [2024-08-06 04:53:13,935][52666] Sum rewards: 78.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.888', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.172', 'weapon5': '0.198', 'AMMO3': '0.203', 'AMMO4': '0.264', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '64.500'} [2024-08-06 04:53:14,319][52803] DAMAGECOUNT value on done: 530516.0 [2024-08-06 04:53:14,319][52803] Sum rewards: 64.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.244', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.208', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '2.820', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:14,342][52650] Updated weights for policy 0, policy_version 56901 (0.0013) [2024-08-06 04:53:14,877][52667] DAMAGECOUNT value on done: 564910.0 [2024-08-06 04:53:14,879][52667] Sum rewards: 65.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:15,071][52649] DAMAGECOUNT value on done: 545916.0 [2024-08-06 04:53:15,071][52649] Sum rewards: 68.388, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.964', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.152', 'AMMO3': '0.154', 'AMMO4': '0.185', 'weapon4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.638', 'WEAPON3': '0.950', 'weapon3': '2.776', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '54.500'} [2024-08-06 04:53:15,592][52670] DAMAGECOUNT value on done: 560883.0 [2024-08-06 04:53:15,592][52670] Sum rewards: 89.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.118', 'AMMO3': '0.175', 'weapon5': '0.214', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.708', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '71.000'} [2024-08-06 04:53:15,805][52663] DAMAGECOUNT value on done: 561270.0 [2024-08-06 04:53:15,807][52663] Sum rewards: 68.753, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.921', 'AMMO5': '0.026', 'AMMO2': '0.084', 'AMMO3': '0.200', 'weapon4': '0.288', 'weapon5': '0.306', 'weapon2': '0.322', 'AMMO4': '0.421', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:15,976][52664] DAMAGECOUNT value on done: 595039.0 [2024-08-06 04:53:15,977][52664] Sum rewards: 68.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon2': '0.182', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 04:53:16,418][52666] DAMAGECOUNT value on done: 563320.0 [2024-08-06 04:53:16,419][52666] Sum rewards: 77.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.416', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.060', 'AMMO4': '0.164', 'weapon5': '0.166', 'AMMO3': '0.228', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:16,859][52811] DAMAGECOUNT value on done: 535275.0 [2024-08-06 04:53:16,861][52811] Sum rewards: 70.471, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.194', 'weapon2': '0.240', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.960', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:17,364][52803] DAMAGECOUNT value on done: 529563.0 [2024-08-06 04:53:17,365][52803] Sum rewards: 66.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.428', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO3': '0.205', 'weapon2': '0.354', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:17,394][52667] DAMAGECOUNT value on done: 575388.0 [2024-08-06 04:53:17,395][52667] Sum rewards: 68.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.728', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.187', 'weapon2': '0.308', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.492', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:17,399][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:53:17,795][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 466190336. Throughput: 0: 4360.9. Samples: 116546600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 04:53:17,795][52567] Avg episode reward: [(0, '74.133')] [2024-08-06 04:53:18,070][52670] DAMAGECOUNT value on done: 567513.0 [2024-08-06 04:53:18,070][52670] Sum rewards: 65.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'weapon4': '0.074', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.336', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.344', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:18,131][52649] DAMAGECOUNT value on done: 557162.0 [2024-08-06 04:53:18,131][52649] Sum rewards: 70.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.525', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.144', 'AMMO3': '0.204', 'weapon5': '0.228', 'AMMO4': '0.242', 'weapon2': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:18,950][52663] DAMAGECOUNT value on done: 563191.0 [2024-08-06 04:53:18,951][52663] Sum rewards: 67.278, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.242', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:18,983][52664] DAMAGECOUNT value on done: 594641.0 [2024-08-06 04:53:18,984][52664] Sum rewards: 75.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:19,181][52650] Updated weights for policy 0, policy_version 56911 (0.0013) [2024-08-06 04:53:19,217][52666] DAMAGECOUNT value on done: 558662.0 [2024-08-06 04:53:19,219][52666] Sum rewards: 72.017, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.730', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.090', 'weapon5': '0.180', 'AMMO4': '0.262', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.600', 'weapon3': '2.928', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:19,907][52667] DAMAGECOUNT value on done: 578744.0 [2024-08-06 04:53:19,907][52667] Sum rewards: 63.552, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.468', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.132', 'AMMO4': '0.145', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.500', 'weapon3': '2.848', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:20,001][52811] DAMAGECOUNT value on done: 542538.0 [2024-08-06 04:53:20,002][52811] Sum rewards: 61.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.268', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.456', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '51.500'} [2024-08-06 04:53:20,557][52803] DAMAGECOUNT value on done: 535774.0 [2024-08-06 04:53:20,557][52803] Sum rewards: 69.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.215', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.050', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.218', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:20,879][52670] DAMAGECOUNT value on done: 556358.0 [2024-08-06 04:53:20,879][52670] Sum rewards: 64.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO3': '0.197', 'AMMO4': '0.228', 'weapon4': '0.312', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:20,910][52649] DAMAGECOUNT value on done: 553855.0 [2024-08-06 04:53:20,911][52649] Sum rewards: 65.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.140', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.171', 'weapon5': '0.230', 'AMMO4': '0.232', 'weapon4': '0.236', 'weapon2': '0.294', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '53.500'} [2024-08-06 04:53:21,435][52664] DAMAGECOUNT value on done: 587317.0 [2024-08-06 04:53:21,435][52664] Sum rewards: 71.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.709', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.094', 'AMMO4': '0.181', 'AMMO3': '0.224', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:22,006][52663] DAMAGECOUNT value on done: 561699.0 [2024-08-06 04:53:22,006][52663] Sum rewards: 81.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.183', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.142', 'weapon5': '0.162', 'AMMO4': '0.195', 'weapon2': '0.238', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.156', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '70.000'} [2024-08-06 04:53:22,209][52666] DAMAGECOUNT value on done: 570234.0 [2024-08-06 04:53:22,210][52666] Sum rewards: 63.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.166', 'AMMO3': '0.186', 'weapon5': '0.214', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '2.956', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '52.000'} [2024-08-06 04:53:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 466272256. Throughput: 0: 4358.0. Samples: 116572830. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 04:53:22,794][52567] Avg episode reward: [(0, '73.041')] [2024-08-06 04:53:22,907][52667] DAMAGECOUNT value on done: 579155.0 [2024-08-06 04:53:22,911][52667] Sum rewards: 68.177, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.960', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.186', 'weapon4': '0.196', 'AMMO4': '0.207', 'AMMO3': '0.224', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:22,933][52669] DAMAGECOUNT value on done: 573456.0 [2024-08-06 04:53:22,934][52669] Sum rewards: 76.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.191', 'AMMO4': '0.222', 'weapon5': '0.252', 'weapon4': '0.306', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:23,053][52811] DAMAGECOUNT value on done: 530867.0 [2024-08-06 04:53:23,053][52811] Sum rewards: 80.845, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.406', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'weapon3': '3.368', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '69.000'} [2024-08-06 04:53:23,533][52803] DAMAGECOUNT value on done: 538967.0 [2024-08-06 04:53:23,542][52803] Sum rewards: 75.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.341', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.066', 'AMMO4': '0.104', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.232', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:23,676][52650] Updated weights for policy 0, policy_version 56921 (0.0011) [2024-08-06 04:53:24,123][52670] DAMAGECOUNT value on done: 563094.0 [2024-08-06 04:53:24,128][52670] Sum rewards: 77.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.038', 'AMMO4': '0.110', 'weapon5': '0.118', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:24,190][52649] DAMAGECOUNT value on done: 556066.0 [2024-08-06 04:53:24,190][52649] Sum rewards: 59.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.495', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.048', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.270', 'weapon4': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.202', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '53.000'} [2024-08-06 04:53:24,235][52664] DAMAGECOUNT value on done: 592165.0 [2024-08-06 04:53:24,237][52664] Sum rewards: 85.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.905', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.228', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.584', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '70.000'} [2024-08-06 04:53:24,338][52663] DAMAGECOUNT value on done: 575102.0 [2024-08-06 04:53:24,338][52663] Sum rewards: 72.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:25,009][52666] DAMAGECOUNT value on done: 564626.0 [2024-08-06 04:53:25,010][52666] Sum rewards: 76.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.547', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.144', 'AMMO4': '0.167', 'AMMO3': '0.188', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:25,295][52669] DAMAGECOUNT value on done: 564052.0 [2024-08-06 04:53:25,296][52669] Sum rewards: 76.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.995', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.160', 'weapon5': '0.176', 'weapon4': '0.206', 'AMMO4': '0.237', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:25,916][52667] DAMAGECOUNT value on done: 576568.0 [2024-08-06 04:53:25,916][52667] Sum rewards: 74.582, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.835', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.146', 'AMMO4': '0.175', 'weapon5': '0.220', 'AMMO3': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '62.000'} [2024-08-06 04:53:26,138][52811] DAMAGECOUNT value on done: 525784.0 [2024-08-06 04:53:26,140][52811] Sum rewards: 59.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.524', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.018', 'AMMO4': '0.061', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.418', 'WEAPON3': '1.650', 'HITCOUNT': '3.110', 'weapon3': '3.232', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '53.000'} [2024-08-06 04:53:26,565][52670] DAMAGECOUNT value on done: 572013.0 [2024-08-06 04:53:26,565][52670] Sum rewards: 78.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.603', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.526', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '65.000'} [2024-08-06 04:53:26,651][52803] DAMAGECOUNT value on done: 532125.0 [2024-08-06 04:53:26,651][52803] Sum rewards: 69.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.587', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.124', 'weapon4': '0.132', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.490', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:26,862][52663] DAMAGECOUNT value on done: 563062.0 [2024-08-06 04:53:26,863][52663] Sum rewards: 92.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.381', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.082', 'weapon5': '0.096', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '4.300', 'DAMAGECOUNT': '21.771', 'FRAGCOUNT': '75.000'} [2024-08-06 04:53:27,247][52671] DAMAGECOUNT value on done: 577902.0 [2024-08-06 04:53:27,249][52671] Sum rewards: 79.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.129', 'weapon5': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '67.000'} [2024-08-06 04:53:27,415][52649] DAMAGECOUNT value on done: 558465.0 [2024-08-06 04:53:27,415][52649] Sum rewards: 66.293, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.126', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.254', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:27,564][52664] DAMAGECOUNT value on done: 590918.0 [2024-08-06 04:53:27,565][52664] Sum rewards: 61.779, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'HEALTH': '0.254', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.172', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '53.000'} [2024-08-06 04:53:27,739][52666] DAMAGECOUNT value on done: 568082.0 [2024-08-06 04:53:27,740][52666] Sum rewards: 70.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.615', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.058', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:27,795][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 466362368. Throughput: 0: 4354.8. Samples: 116598860. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 04:53:27,795][52567] Avg episode reward: [(0, '72.618')] [2024-08-06 04:53:27,881][52669] DAMAGECOUNT value on done: 575310.0 [2024-08-06 04:53:27,883][52669] Sum rewards: 68.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.632', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.188', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.646', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:28,663][52650] Updated weights for policy 0, policy_version 56931 (0.0066) [2024-08-06 04:53:28,789][52667] DAMAGECOUNT value on done: 569471.0 [2024-08-06 04:53:28,790][52667] Sum rewards: 71.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.290', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon5': '0.080', 'weapon4': '0.128', 'AMMO4': '0.210', 'weapon2': '0.214', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:29,208][52811] DAMAGECOUNT value on done: 532483.0 [2024-08-06 04:53:29,208][52811] Sum rewards: 74.259, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.162', 'AMMO3': '0.260', 'weapon4': '0.276', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.882', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:29,736][52670] DAMAGECOUNT value on done: 568763.0 [2024-08-06 04:53:29,738][52670] Sum rewards: 67.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.336', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.172', 'weapon4': '0.206', 'AMMO3': '0.223', 'AMMO4': '0.230', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:29,841][52663] DAMAGECOUNT value on done: 572520.0 [2024-08-06 04:53:29,842][52663] Sum rewards: 67.534, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.962', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.136', 'weapon5': '0.150', 'AMMO3': '0.171', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '56.000'} [2024-08-06 04:53:29,858][52803] DAMAGECOUNT value on done: 525877.0 [2024-08-06 04:53:29,858][52803] Sum rewards: 70.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.074', 'weapon4': '0.116', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:30,047][52649] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 04:53:30,116][52671] DAMAGECOUNT value on done: 575944.0 [2024-08-06 04:53:30,118][52671] Sum rewards: 63.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.451', 'AMMO5': '0.022', 'AMMO2': '0.053', 'weapon5': '0.140', 'weapon4': '0.160', 'AMMO3': '0.170', 'AMMO4': '0.264', 'weapon2': '0.340', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.132', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:30,191][52664] DAMAGECOUNT value on done: 587112.0 [2024-08-06 04:53:30,192][52664] Sum rewards: 67.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.566', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.121', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.428', 'weapon4': '0.430', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:30,516][52649] DAMAGECOUNT value on done: 548425.0 [2024-08-06 04:53:30,516][52649] Sum rewards: 78.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.555', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.124', 'AMMO4': '0.218', 'AMMO3': '0.232', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.806', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '66.000'} [2024-08-06 04:53:30,909][52666] DAMAGECOUNT value on done: 563155.0 [2024-08-06 04:53:30,910][52666] Sum rewards: 63.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.335', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.142', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '52.000'} [2024-08-06 04:53:30,929][52669] DAMAGECOUNT value on done: 573895.0 [2024-08-06 04:53:30,930][52669] Sum rewards: 63.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.174', 'AMMO3': '0.181', 'AMMO4': '0.234', 'weapon5': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '51.000'} [2024-08-06 04:53:32,003][52667] DAMAGECOUNT value on done: 577970.0 [2024-08-06 04:53:32,003][52667] Sum rewards: 73.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.775', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.246', 'weapon2': '0.248', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.516', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:32,312][52811] DAMAGECOUNT value on done: 531809.0 [2024-08-06 04:53:32,314][52811] Sum rewards: 67.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.474', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.120', 'AMMO3': '0.181', 'AMMO4': '0.197', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '56.000'} [2024-08-06 04:53:32,525][52670] DAMAGECOUNT value on done: 550540.0 [2024-08-06 04:53:32,527][52670] Sum rewards: 84.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.188', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '69.000'} [2024-08-06 04:53:32,602][52663] DAMAGECOUNT value on done: 573739.0 [2024-08-06 04:53:32,603][52663] Sum rewards: 76.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.805', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.058', 'weapon4': '0.090', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.262', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:32,639][52664] DAMAGECOUNT value on done: 584767.0 [2024-08-06 04:53:32,639][52664] Sum rewards: 83.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.550', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.074', 'AMMO4': '0.110', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.050', 'weapon3': '3.266', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '66.500'} [2024-08-06 04:53:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 466444288. Throughput: 0: 4357.6. Samples: 116612180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 04:53:32,794][52567] Avg episode reward: [(0, '72.640')] [2024-08-06 04:53:33,145][52803] DAMAGECOUNT value on done: 527446.0 [2024-08-06 04:53:33,145][52650] Updated weights for policy 0, policy_version 56941 (0.0022) [2024-08-06 04:53:33,148][52803] Sum rewards: 75.965, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.110', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.124', 'AMMO3': '0.220', 'weapon5': '0.250', 'weapon2': '0.270', 'AMMO4': '0.273', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:33,434][52666] DAMAGECOUNT value on done: 566082.0 [2024-08-06 04:53:33,435][52666] Sum rewards: 81.663, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'HEALTH': '0.062', 'AMMO4': '0.129', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '68.000'} [2024-08-06 04:53:33,501][52671] DAMAGECOUNT value on done: 573878.0 [2024-08-06 04:53:33,502][52671] Sum rewards: 64.666, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.565', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.149', 'weapon5': '0.222', 'AMMO3': '0.226', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.152', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:33,551][52649] DAMAGECOUNT value on done: 559840.0 [2024-08-06 04:53:33,552][52649] Sum rewards: 79.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.670', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.134', 'AMMO4': '0.149', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '65.000'} [2024-08-06 04:53:33,592][52669] DAMAGECOUNT value on done: 568939.0 [2024-08-06 04:53:33,593][52669] Sum rewards: 60.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.986', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.138', 'AMMO3': '0.229', 'AMMO4': '0.235', 'weapon4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '51.000'} [2024-08-06 04:53:35,282][52670] DAMAGECOUNT value on done: 562958.0 [2024-08-06 04:53:35,282][52670] Sum rewards: 72.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'HITCOUNT': '3.460', 'weapon3': '3.498', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:35,442][52664] DAMAGECOUNT value on done: 595356.0 [2024-08-06 04:53:35,442][52664] Sum rewards: 78.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.545', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:35,456][52811] DAMAGECOUNT value on done: 535568.0 [2024-08-06 04:53:35,457][52811] Sum rewards: 82.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.100', 'AMMO4': '0.187', 'weapon4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '68.000'} [2024-08-06 04:53:35,582][52663] DAMAGECOUNT value on done: 565575.0 [2024-08-06 04:53:35,583][52663] Sum rewards: 88.328, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.382', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.026', 'AMMO4': '0.053', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.416', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.781', 'FRAGCOUNT': '74.000'} [2024-08-06 04:53:36,320][52803] DAMAGECOUNT value on done: 524377.0 [2024-08-06 04:53:36,323][52803] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO2': '0.007', 'AMMO5': '0.013', 'weapon4': '0.020', 'AMMO4': '0.037', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.260', 'weapon2': '0.426', 'WEAPON3': '1.650', 'weapon3': '3.274', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '65.000'} [2024-08-06 04:53:36,419][52649] DAMAGECOUNT value on done: 564327.0 [2024-08-06 04:53:36,420][52649] Sum rewards: 61.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.534', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.098', 'weapon4': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.356', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '53.000'} [2024-08-06 04:53:36,475][52666] DAMAGECOUNT value on done: 570883.0 [2024-08-06 04:53:36,477][52666] Sum rewards: 82.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.758', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.146', 'AMMO3': '0.244', 'AMMO4': '0.309', 'weapon5': '0.328', 'weapon2': '0.398', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.838', 'FRAGCOUNT': '67.000'} [2024-08-06 04:53:36,496][52671] DAMAGECOUNT value on done: 575301.0 [2024-08-06 04:53:36,496][52671] Sum rewards: 75.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.170', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.130', 'AMMO3': '0.191', 'AMMO4': '0.200', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:36,840][52669] DAMAGECOUNT value on done: 575365.0 [2024-08-06 04:53:36,841][52669] Sum rewards: 71.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.612', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:37,117][52658] DAMAGECOUNT value on done: 571861.0 [2024-08-06 04:53:37,117][52658] Sum rewards: 76.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.152', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'weapon4': '0.348', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:37,784][52650] Updated weights for policy 0, policy_version 56951 (0.0011) [2024-08-06 04:53:37,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 466542592. Throughput: 0: 4361.4. Samples: 116638150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 04:53:37,794][52567] Avg episode reward: [(0, '72.823')] [2024-08-06 04:53:37,893][52664] DAMAGECOUNT value on done: 588005.0 [2024-08-06 04:53:37,895][52664] Sum rewards: 67.639, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.109', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon2': '0.388', 'WEAPON3': '0.800', 'HEALTH': '1.158', 'HITCOUNT': '2.960', 'weapon3': '3.084', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:38,621][52670] DAMAGECOUNT value on done: 572183.0 [2024-08-06 04:53:38,621][52670] Sum rewards: 70.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.122', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.092', 'weapon5': '0.124', 'AMMO4': '0.208', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.550', 'weapon3': '2.896', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:38,685][52811] DAMAGECOUNT value on done: 537184.0 [2024-08-06 04:53:38,686][52811] Sum rewards: 79.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.076', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.283', 'weapon2': '0.398', 'WEAPON3': '1.700', 'weapon3': '3.106', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '68.000'} [2024-08-06 04:53:39,236][52669] DAMAGECOUNT value on done: 573137.0 [2024-08-06 04:53:39,236][52669] Sum rewards: 79.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.688', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.185', 'weapon4': '0.206', 'weapon5': '0.206', 'AMMO4': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.930', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '62.500'} [2024-08-06 04:53:39,387][52671] DAMAGECOUNT value on done: 585519.0 [2024-08-06 04:53:39,391][52671] Sum rewards: 80.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.968', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.221', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '66.000'} [2024-08-06 04:53:39,453][52803] DAMAGECOUNT value on done: 530658.0 [2024-08-06 04:53:39,456][52803] Sum rewards: 69.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.168', 'AMMO3': '0.176', 'weapon4': '0.312', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '56.000'} [2024-08-06 04:53:39,678][52649] DAMAGECOUNT value on done: 564824.0 [2024-08-06 04:53:39,679][52649] Sum rewards: 77.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.048', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.172', 'AMMO3': '0.174', 'weapon2': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:39,744][52666] DAMAGECOUNT value on done: 554722.0 [2024-08-06 04:53:39,745][52666] Sum rewards: 77.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.185', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.136', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '65.000'} [2024-08-06 04:53:40,087][52658] DAMAGECOUNT value on done: 570038.0 [2024-08-06 04:53:40,087][52658] Sum rewards: 65.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.000', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.110', 'AMMO3': '0.206', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.450', 'weapon3': '2.932', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:40,767][52664] DAMAGECOUNT value on done: 596958.0 [2024-08-06 04:53:40,767][52664] Sum rewards: 74.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.539', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.128', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.190', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:41,760][52670] DAMAGECOUNT value on done: 562000.0 [2024-08-06 04:53:41,761][52670] Sum rewards: 71.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.496', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.024', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.466', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.234', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '58.000'} [2024-08-06 04:53:41,776][52811] DAMAGECOUNT value on done: 530591.0 [2024-08-06 04:53:41,776][52811] Sum rewards: 72.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.803', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.048', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:42,114][52649] DAMAGECOUNT value on done: 561538.0 [2024-08-06 04:53:42,115][52649] Sum rewards: 61.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.374', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.214', 'weapon4': '0.258', 'weapon2': '0.264', 'weapon5': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '51.000'} [2024-08-06 04:53:42,231][52614] Signal inference workers to stop experience collection... (10350 times) [2024-08-06 04:53:42,231][52614] Signal inference workers to resume experience collection... (10350 times) [2024-08-06 04:53:42,283][52650] InferenceWorker_p0-w0: stopping experience collection (10350 times) [2024-08-06 04:53:42,283][52650] InferenceWorker_p0-w0: resuming experience collection (10350 times) [2024-08-06 04:53:42,381][52669] DAMAGECOUNT value on done: 571071.0 [2024-08-06 04:53:42,382][52669] Sum rewards: 78.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.475', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.104', 'weapon5': '0.154', 'AMMO4': '0.215', 'AMMO3': '0.230', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 04:53:42,536][52671] DAMAGECOUNT value on done: 575987.0 [2024-08-06 04:53:42,539][52671] Sum rewards: 77.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.332', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.096', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.286', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:42,557][52650] Updated weights for policy 0, policy_version 56961 (0.0012) [2024-08-06 04:53:42,568][52803] DAMAGECOUNT value on done: 523641.0 [2024-08-06 04:53:42,569][52803] Sum rewards: 71.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.555', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.161', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.268', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:42,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 466624512. Throughput: 0: 4360.7. Samples: 116664460. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 04:53:42,795][52567] Avg episode reward: [(0, '72.417')] [2024-08-06 04:53:42,829][52666] DAMAGECOUNT value on done: 564110.0 [2024-08-06 04:53:42,829][52666] Sum rewards: 78.683, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.428', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.224', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:42,918][52658] DAMAGECOUNT value on done: 575807.0 [2024-08-06 04:53:42,920][52658] Sum rewards: 74.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO3': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.430', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:43,916][52664] DAMAGECOUNT value on done: 596316.0 [2024-08-06 04:53:43,916][52664] Sum rewards: 74.296, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.122', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.135', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.252', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.248', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:44,683][52670] DAMAGECOUNT value on done: 568110.0 [2024-08-06 04:53:44,683][52670] Sum rewards: 78.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.116', 'AMMO3': '0.187', 'AMMO4': '0.191', 'weapon5': '0.216', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '62.000'} [2024-08-06 04:53:44,764][52811] DAMAGECOUNT value on done: 530105.0 [2024-08-06 04:53:44,765][52811] Sum rewards: 79.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.022', 'AMMO2': '0.061', 'weapon5': '0.184', 'AMMO3': '0.191', 'weapon4': '0.228', 'AMMO4': '0.306', 'weapon2': '0.392', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '66.000'} [2024-08-06 04:53:45,084][52649] DAMAGECOUNT value on done: 552011.0 [2024-08-06 04:53:45,088][52649] Sum rewards: 72.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:45,398][52669] DAMAGECOUNT value on done: 580208.0 [2024-08-06 04:53:45,402][52669] Sum rewards: 65.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.485', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.098', 'AMMO4': '0.148', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.136', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '54.000'} [2024-08-06 04:53:45,437][52671] DAMAGECOUNT value on done: 580865.0 [2024-08-06 04:53:45,438][52671] Sum rewards: 76.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.150', 'weapon2': '0.188', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '65.000'} [2024-08-06 04:53:45,521][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:53:45,546][52803] DAMAGECOUNT value on done: 541702.0 [2024-08-06 04:53:45,546][52803] Sum rewards: 91.831, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'HEALTH': '0.573', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '3.030', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '73.000'} [2024-08-06 04:53:45,601][52658] DAMAGECOUNT value on done: 575029.0 [2024-08-06 04:53:45,601][52658] Sum rewards: 72.715, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'HEALTH': '0.110', 'weapon5': '0.164', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.694', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:46,817][52664] DAMAGECOUNT value on done: 599776.0 [2024-08-06 04:53:46,817][52664] Sum rewards: 73.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.458', 'AMMO5': '0.018', 'AMMO2': '0.067', 'AMMO3': '0.197', 'weapon4': '0.220', 'weapon2': '0.222', 'weapon5': '0.238', 'AMMO4': '0.334', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:47,155][52647] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:53:47,163][52668] DAMAGECOUNT value on done: 571124.0 [2024-08-06 04:53:47,164][52668] Sum rewards: 80.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '67.000'} [2024-08-06 04:53:47,729][52650] Updated weights for policy 0, policy_version 56971 (0.0020) [2024-08-06 04:53:47,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 466706432. Throughput: 0: 4361.8. Samples: 116677490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 04:53:47,794][52567] Avg episode reward: [(0, '72.967')] [2024-08-06 04:53:48,252][52671] DAMAGECOUNT value on done: 575503.0 [2024-08-06 04:53:48,253][52671] Sum rewards: 80.106, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.058', 'HEALTH': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.274', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:48,367][52669] DAMAGECOUNT value on done: 572649.0 [2024-08-06 04:53:48,369][52669] Sum rewards: 76.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.825', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.112', 'weapon5': '0.128', 'AMMO4': '0.223', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:48,430][52649] DAMAGECOUNT value on done: 559967.0 [2024-08-06 04:53:48,431][52649] Sum rewards: 84.538, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.345', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.093', 'weapon5': '0.130', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.334', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '69.000'} [2024-08-06 04:53:48,806][52658] DAMAGECOUNT value on done: 564203.0 [2024-08-06 04:53:48,808][52658] Sum rewards: 70.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.470', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.124', 'weapon2': '0.200', 'weapon5': '0.230', 'AMMO4': '0.267', 'AMMO3': '0.277', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.152', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:48,828][52803] DAMAGECOUNT value on done: 531329.0 [2024-08-06 04:53:48,832][52803] Sum rewards: 67.068, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.120', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.102', 'AMMO4': '0.212', 'AMMO3': '0.215', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '2.972', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '56.000'} [2024-08-06 04:53:49,709][52664] DAMAGECOUNT value on done: 598591.0 [2024-08-06 04:53:49,711][52664] Sum rewards: 83.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.337', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.088', 'weapon2': '0.194', 'AMMO3': '0.268', 'weapon5': '0.270', 'AMMO4': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.072', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '69.000'} [2024-08-06 04:53:49,800][52668] DAMAGECOUNT value on done: 574496.0 [2024-08-06 04:53:49,800][52668] Sum rewards: 72.305, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.088', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:51,003][52649] DAMAGECOUNT value on done: 548631.0 [2024-08-06 04:53:51,003][52649] Sum rewards: 83.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.215', 'weapon2': '0.222', 'WEAPON3': '1.300', 'weapon3': '3.562', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '69.000'} [2024-08-06 04:53:51,317][52669] DAMAGECOUNT value on done: 577175.0 [2024-08-06 04:53:51,318][52669] Sum rewards: 88.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.128', 'weapon2': '0.210', 'AMMO3': '0.227', 'AMMO4': '0.272', 'weapon5': '0.282', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.849', 'FRAGCOUNT': '73.000'} [2024-08-06 04:53:51,324][52658] DAMAGECOUNT value on done: 567374.0 [2024-08-06 04:53:51,325][52658] Sum rewards: 74.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.734', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.164', 'weapon4': '0.184', 'AMMO3': '0.201', 'AMMO4': '0.206', 'weapon2': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '62.000'} [2024-08-06 04:53:51,483][52671] DAMAGECOUNT value on done: 568181.0 [2024-08-06 04:53:51,483][52671] Sum rewards: 74.770, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.191', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.082', 'AMMO4': '0.186', 'AMMO3': '0.211', 'weapon5': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '62.000'} [2024-08-06 04:53:51,775][52650] Updated weights for policy 0, policy_version 56981 (0.0024) [2024-08-06 04:53:51,811][52803] DAMAGECOUNT value on done: 526938.0 [2024-08-06 04:53:51,811][52803] Sum rewards: 76.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon2': '0.202', 'weapon5': '0.212', 'AMMO3': '0.238', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'weapon4': '0.492', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.786', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:52,577][52668] DAMAGECOUNT value on done: 572599.0 [2024-08-06 04:53:52,584][52668] Sum rewards: 79.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.219', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.456', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '65.000'} [2024-08-06 04:53:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 466804736. Throughput: 0: 4366.2. Samples: 116703820. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 04:53:52,795][52567] Avg episode reward: [(0, '73.889')] [2024-08-06 04:53:52,981][52664] DAMAGECOUNT value on done: 599597.0 [2024-08-06 04:53:52,982][52664] Sum rewards: 68.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.255', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.038', 'weapon4': '0.072', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.348', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:53,677][52649] DAMAGECOUNT value on done: 560174.0 [2024-08-06 04:53:53,677][52649] Sum rewards: 59.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.104', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.217', 'weapon5': '0.232', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '50.000'} [2024-08-06 04:53:53,973][52658] DAMAGECOUNT value on done: 575488.0 [2024-08-06 04:53:53,975][52658] Sum rewards: 75.347, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.360', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.170', 'AMMO3': '0.238', 'weapon5': '0.264', 'AMMO4': '0.270', 'weapon2': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:54,154][52669] DAMAGECOUNT value on done: 577180.0 [2024-08-06 04:53:54,155][52669] Sum rewards: 74.142, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.585', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO3': '0.149', 'AMMO4': '0.155', 'weapon4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '58.000'} [2024-08-06 04:53:54,502][52671] DAMAGECOUNT value on done: 576059.0 [2024-08-06 04:53:54,502][52671] Sum rewards: 67.647, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.078', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.162', 'AMMO3': '0.234', 'AMMO4': '0.248', 'weapon5': '0.264', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '57.000'} [2024-08-06 04:53:54,803][52803] DAMAGECOUNT value on done: 542459.0 [2024-08-06 04:53:54,805][52803] Sum rewards: 80.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.215', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO3': '0.182', 'weapon4': '0.186', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:55,327][52668] DAMAGECOUNT value on done: 574575.0 [2024-08-06 04:53:55,329][52668] Sum rewards: 73.779, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.794', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.142', 'AMMO4': '0.189', 'AMMO3': '0.242', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '61.000'} [2024-08-06 04:53:55,828][52664] DAMAGECOUNT value on done: 591898.0 [2024-08-06 04:53:55,829][52664] Sum rewards: 66.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.134', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.187', 'AMMO4': '0.195', 'weapon4': '0.210', 'weapon5': '0.210', 'weapon2': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.102', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '54.500'} [2024-08-06 04:53:55,902][52662] DAMAGECOUNT value on done: 577450.0 [2024-08-06 04:53:55,903][52662] Sum rewards: 68.132, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO4': '0.177', 'weapon5': '0.188', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:56,379][52649] DAMAGECOUNT value on done: 561849.0 [2024-08-06 04:53:56,379][52649] Sum rewards: 69.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.188', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 04:53:56,881][52650] Updated weights for policy 0, policy_version 56991 (0.0025) [2024-08-06 04:53:56,979][52669] DAMAGECOUNT value on done: 563415.0 [2024-08-06 04:53:56,979][52669] Sum rewards: 67.292, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.108', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'AMMO3': '0.284', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.318', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:57,211][52658] DAMAGECOUNT value on done: 567124.0 [2024-08-06 04:53:57,212][52658] Sum rewards: 70.734, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.518', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.138', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.305', 'weapon2': '0.324', 'WEAPON3': '1.750', 'weapon3': '3.188', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:57,533][52671] DAMAGECOUNT value on done: 575055.0 [2024-08-06 04:53:57,534][52671] Sum rewards: 69.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.188', 'AMMO3': '0.225', 'weapon2': '0.234', 'AMMO4': '0.254', 'weapon4': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '60.000'} [2024-08-06 04:53:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 466886656. Throughput: 0: 4369.8. Samples: 116729960. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 04:53:57,794][52567] Avg episode reward: [(0, '73.866')] [2024-08-06 04:53:57,853][52803] DAMAGECOUNT value on done: 532377.0 [2024-08-06 04:53:57,857][52803] Sum rewards: 77.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.348', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '64.000'} [2024-08-06 04:53:58,340][52668] DAMAGECOUNT value on done: 563806.0 [2024-08-06 04:53:58,341][52668] Sum rewards: 78.970, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.993', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.140', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.298', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '63.000'} [2024-08-06 04:53:58,478][52662] DAMAGECOUNT value on done: 573977.0 [2024-08-06 04:53:58,478][52662] Sum rewards: 73.558, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.135', 'AMMO4': '0.157', 'weapon5': '0.188', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.436', 'weapon2': '0.498', 'WEAPON3': '0.750', 'weapon3': '2.896', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '55.000'} [2024-08-06 04:53:58,701][52664] DAMAGECOUNT value on done: 586799.0 [2024-08-06 04:53:58,703][52664] Sum rewards: 68.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.052', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '56.000'} [2024-08-06 04:53:59,052][52649] DAMAGECOUNT value on done: 554409.0 [2024-08-06 04:53:59,053][52649] Sum rewards: 61.763, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.706', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.103', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '52.000'} [2024-08-06 04:53:59,874][52669] DAMAGECOUNT value on done: 570387.0 [2024-08-06 04:53:59,876][52669] Sum rewards: 59.773, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.209', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.066', 'weapon5': '0.104', 'AMMO4': '0.113', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.100', 'HITCOUNT': '2.590', 'weapon3': '3.328', 'DAMAGECOUNT': '13.416', 'FRAGCOUNT': '50.000'} [2024-08-06 04:54:00,168][52671] DAMAGECOUNT value on done: 573052.0 [2024-08-06 04:54:00,169][52671] Sum rewards: 67.799, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.805', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.286', 'weapon4': '0.366', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '53.000'} [2024-08-06 04:54:00,381][52658] DAMAGECOUNT value on done: 585744.0 [2024-08-06 04:54:00,381][52658] Sum rewards: 70.032, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.632', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.084', 'weapon5': '0.104', 'AMMO4': '0.178', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.128', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '61.000'} [2024-08-06 04:54:01,026][52803] DAMAGECOUNT value on done: 528853.0 [2024-08-06 04:54:01,027][52803] Sum rewards: 65.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.791', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.131', 'AMMO3': '0.174', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.050', 'HITCOUNT': '2.850', 'weapon3': '2.862', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '53.000'} [2024-08-06 04:54:01,163][52650] Updated weights for policy 0, policy_version 57001 (0.0012) [2024-08-06 04:54:01,520][52668] DAMAGECOUNT value on done: 577896.0 [2024-08-06 04:54:01,521][52668] Sum rewards: 68.296, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.937', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.176', 'weapon2': '0.228', 'AMMO3': '0.242', 'AMMO4': '0.249', 'weapon5': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:01,598][52662] DAMAGECOUNT value on done: 578381.0 [2024-08-06 04:54:01,599][52662] Sum rewards: 85.084, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.560', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.242', 'WEAPON3': '1.550', 'weapon3': '3.412', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '72.000'} [2024-08-06 04:54:01,680][52664] DAMAGECOUNT value on done: 591976.0 [2024-08-06 04:54:01,680][52664] Sum rewards: 70.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.122', 'weapon5': '0.192', 'AMMO4': '0.207', 'AMMO3': '0.220', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '60.000'} [2024-08-06 04:54:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 466976768. Throughput: 0: 4370.0. Samples: 116743250. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 04:54:02,802][52567] Avg episode reward: [(0, '73.347')] [2024-08-06 04:54:02,860][52669] DAMAGECOUNT value on done: 574216.0 [2024-08-06 04:54:02,863][52669] Sum rewards: 58.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.031', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon5': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.012', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '47.000'} [2024-08-06 04:54:02,900][52671] DAMAGECOUNT value on done: 581281.0 [2024-08-06 04:54:02,903][52671] Sum rewards: 72.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.215', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.346', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:03,079][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:54:03,209][52794] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:54:03,487][52658] DAMAGECOUNT value on done: 570881.0 [2024-08-06 04:54:03,489][52658] Sum rewards: 77.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.480', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '63.000'} [2024-08-06 04:54:04,151][52803] DAMAGECOUNT value on done: 534267.0 [2024-08-06 04:54:04,151][52803] Sum rewards: 81.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.559', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.076', 'weapon4': '0.114', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.210', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '67.000'} [2024-08-06 04:54:04,187][52668] DAMAGECOUNT value on done: 573981.0 [2024-08-06 04:54:04,187][52668] Sum rewards: 67.665, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.521', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO3': '0.156', 'AMMO4': '0.169', 'weapon5': '0.208', 'weapon2': '0.374', 'weapon4': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.658', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '54.000'} [2024-08-06 04:54:04,281][52664] DAMAGECOUNT value on done: 591669.0 [2024-08-06 04:54:04,281][52664] Sum rewards: 66.979, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.232', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.126', 'weapon5': '0.142', 'AMMO4': '0.146', 'WEAPON5': '0.250', 'weapon2': '0.272', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.180', 'weapon3': '3.206', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '59.000'} [2024-08-06 04:54:04,535][52662] DAMAGECOUNT value on done: 566272.0 [2024-08-06 04:54:04,536][52662] Sum rewards: 79.973, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.197', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon4': '0.156', 'weapon2': '0.406', 'WEAPON3': '0.950', 'weapon3': '3.210', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '63.000'} [2024-08-06 04:54:05,823][52669] DAMAGECOUNT value on done: 591923.0 [2024-08-06 04:54:05,823][52669] Sum rewards: 71.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.491', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2024-08-06 04:54:05,863][52650] Updated weights for policy 0, policy_version 57011 (0.0021) [2024-08-06 04:54:05,986][52671] DAMAGECOUNT value on done: 574952.0 [2024-08-06 04:54:05,986][52671] Sum rewards: 57.359, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.490', 'AMMO5': '0.027', 'AMMO2': '0.094', 'weapon4': '0.274', 'AMMO3': '0.280', 'weapon2': '0.282', 'weapon5': '0.294', 'AMMO4': '0.472', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.700', 'weapon3': '2.794', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '52.000'} [2024-08-06 04:54:06,057][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:54:06,592][52658] DAMAGECOUNT value on done: 583874.0 [2024-08-06 04:54:06,592][52658] Sum rewards: 88.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.121', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.100', 'weapon3': '3.282', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '73.000'} [2024-08-06 04:54:07,012][52668] DAMAGECOUNT value on done: 564955.0 [2024-08-06 04:54:07,013][52668] Sum rewards: 66.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.557', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.172', 'weapon5': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.203', 'weapon2': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.840', 'weapon3': '3.222', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '56.000'} [2024-08-06 04:54:07,223][52803] DAMAGECOUNT value on done: 533987.0 [2024-08-06 04:54:07,225][52803] Sum rewards: 69.097, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.186', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO4': '0.186', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '59.000'} [2024-08-06 04:54:07,337][52664] DAMAGECOUNT value on done: 590885.0 [2024-08-06 04:54:07,337][52664] Sum rewards: 79.056, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.075', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.061', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '3.274', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '64.000'} [2024-08-06 04:54:07,566][52662] DAMAGECOUNT value on done: 580179.0 [2024-08-06 04:54:07,567][52662] Sum rewards: 77.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.231', 'WEAPON3': '1.450', 'weapon3': '3.442', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '65.000'} [2024-08-06 04:54:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 467066880. Throughput: 0: 4372.2. Samples: 116769580. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 04:54:07,795][52567] Avg episode reward: [(0, '73.925')] [2024-08-06 04:54:08,954][52669] DAMAGECOUNT value on done: 579435.0 [2024-08-06 04:54:08,954][52669] Sum rewards: 69.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.762', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.064', 'AMMO4': '0.114', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.422', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.042', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '59.000'} [2024-08-06 04:54:09,021][52671] DAMAGECOUNT value on done: 561196.0 [2024-08-06 04:54:09,021][52671] Sum rewards: 63.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO4': '0.134', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.364', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.180', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '55.000'} [2024-08-06 04:54:09,556][52658] DAMAGECOUNT value on done: 568215.0 [2024-08-06 04:54:09,556][52658] Sum rewards: 66.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.106', 'AMMO3': '0.190', 'weapon5': '0.216', 'AMMO4': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.758', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 04:54:09,800][52668] DAMAGECOUNT value on done: 568087.0 [2024-08-06 04:54:09,800][52668] Sum rewards: 60.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.684', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.204', 'AMMO4': '0.211', 'weapon4': '0.224', 'AMMO3': '0.239', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '52.000'} [2024-08-06 04:54:10,282][52803] DAMAGECOUNT value on done: 539405.0 [2024-08-06 04:54:10,284][52803] Sum rewards: 84.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.050', 'weapon4': '0.084', 'weapon5': '0.174', 'AMMO3': '0.240', 'AMMO4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.910', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '70.000'} [2024-08-06 04:54:10,753][52662] DAMAGECOUNT value on done: 568426.0 [2024-08-06 04:54:10,754][52662] Sum rewards: 77.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.166', 'weapon5': '0.192', 'AMMO4': '0.223', 'weapon2': '0.228', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '62.000'} [2024-08-06 04:54:10,767][52650] Updated weights for policy 0, policy_version 57021 (0.0013) [2024-08-06 04:54:11,228][52669] DAMAGECOUNT value on done: 577820.0 [2024-08-06 04:54:11,229][52669] Sum rewards: 81.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.134', 'AMMO4': '0.164', 'weapon5': '0.166', 'weapon2': '0.180', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '67.000'} [2024-08-06 04:54:11,970][52671] DAMAGECOUNT value on done: 582109.0 [2024-08-06 04:54:11,974][52671] Sum rewards: 80.785, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.472', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.252', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.046', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.448', 'FRAGCOUNT': '70.000'} [2024-08-06 04:54:12,130][52658] DAMAGECOUNT value on done: 576037.0 [2024-08-06 04:54:12,132][52658] Sum rewards: 76.405, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.100', 'weapon5': '0.104', 'AMMO4': '0.109', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '61.000'} [2024-08-06 04:54:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 467148800. Throughput: 0: 4378.0. Samples: 116795870. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 04:54:12,802][52567] Avg episode reward: [(0, '73.660')] [2024-08-06 04:54:12,981][52668] DAMAGECOUNT value on done: 576652.0 [2024-08-06 04:54:12,981][52668] Sum rewards: 79.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.693', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.590', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '66.000'} [2024-08-06 04:54:13,195][52662] DAMAGECOUNT value on done: 578219.0 [2024-08-06 04:54:13,196][52662] Sum rewards: 66.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.656', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon4': '0.100', 'weapon5': '0.214', 'AMMO4': '0.230', 'AMMO3': '0.277', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.750', 'weapon3': '2.764', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:13,224][52803] DAMAGECOUNT value on done: 527517.0 [2024-08-06 04:54:13,228][52803] Sum rewards: 66.203, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.455', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON5': '0.050', 'weapon5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.232', 'weapon2': '0.260', 'AMMO3': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:13,562][52803] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:54:14,235][52669] DAMAGECOUNT value on done: 578207.0 [2024-08-06 04:54:14,235][52669] Sum rewards: 79.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.295', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.178', 'AMMO3': '0.198', 'weapon2': '0.208', 'weapon5': '0.224', 'AMMO4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '64.000'} [2024-08-06 04:54:14,612][52671] DAMAGECOUNT value on done: 579781.0 [2024-08-06 04:54:14,612][52671] Sum rewards: 74.781, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.964', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.098', 'weapon5': '0.126', 'AMMO4': '0.154', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '64.000'} [2024-08-06 04:54:14,877][52658] DAMAGECOUNT value on done: 567369.0 [2024-08-06 04:54:14,878][52658] Sum rewards: 75.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.524', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '63.000'} [2024-08-06 04:54:15,042][52650] Updated weights for policy 0, policy_version 57031 (0.0011) [2024-08-06 04:54:15,500][52660] DAMAGECOUNT value on done: 572849.0 [2024-08-06 04:54:15,501][52660] Sum rewards: 73.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.123', 'weapon5': '0.136', 'weapon4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '0.950', 'weapon3': '3.168', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:15,976][52668] DAMAGECOUNT value on done: 573094.0 [2024-08-06 04:54:15,977][52668] Sum rewards: 68.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.056', 'AMMO4': '0.083', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.620', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:16,011][52662] DAMAGECOUNT value on done: 579824.0 [2024-08-06 04:54:16,012][52662] Sum rewards: 83.312, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.658', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.050', 'AMMO4': '0.141', 'weapon5': '0.142', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '65.000'} [2024-08-06 04:54:17,292][52669] DAMAGECOUNT value on done: 582543.0 [2024-08-06 04:54:17,293][52669] Sum rewards: 67.531, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.135', 'weapon5': '0.170', 'weapon4': '0.242', 'AMMO4': '0.274', 'weapon2': '0.422', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.900', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '53.000'} [2024-08-06 04:54:17,761][52671] DAMAGECOUNT value on done: 576938.0 [2024-08-06 04:54:17,762][52671] Sum rewards: 72.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.417', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO4': '0.123', 'weapon4': '0.160', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.396', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 04:54:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 467238912. Throughput: 0: 4373.6. Samples: 116808990. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 04:54:17,794][52567] Avg episode reward: [(0, '73.516')] [2024-08-06 04:54:17,990][52660] DAMAGECOUNT value on done: 562516.0 [2024-08-06 04:54:17,991][52660] Sum rewards: 67.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.078', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.202', 'AMMO3': '0.211', 'AMMO4': '0.222', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:18,073][52658] DAMAGECOUNT value on done: 575085.0 [2024-08-06 04:54:18,075][52658] Sum rewards: 72.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.723', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.104', 'AMMO4': '0.112', 'weapon5': '0.196', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '60.000'} [2024-08-06 04:54:18,688][52668] DAMAGECOUNT value on done: 564815.0 [2024-08-06 04:54:18,688][52668] Sum rewards: 62.058, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.958', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.172', 'weapon2': '0.226', 'weapon5': '0.226', 'AMMO4': '0.267', 'AMMO3': '0.339', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.950', 'weapon3': '3.034', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:18,689][52662] DAMAGECOUNT value on done: 570536.0 [2024-08-06 04:54:18,691][52662] Sum rewards: 63.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.116', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.196', 'AMMO4': '0.209', 'AMMO3': '0.233', 'weapon2': '0.266', 'weapon4': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '54.000'} [2024-08-06 04:54:20,254][52650] Updated weights for policy 0, policy_version 57041 (0.0048) [2024-08-06 04:54:20,651][52658] DAMAGECOUNT value on done: 561754.0 [2024-08-06 04:54:20,652][52658] Sum rewards: 62.902, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.520', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.112', 'AMMO4': '0.166', 'weapon4': '0.194', 'weapon2': '0.202', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.218', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '55.000'} [2024-08-06 04:54:20,840][52660] DAMAGECOUNT value on done: 573853.0 [2024-08-06 04:54:20,841][52660] Sum rewards: 64.045, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.870', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.192', 'AMMO3': '0.286', 'AMMO4': '0.294', 'weapon4': '0.296', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.698', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '56.000'} [2024-08-06 04:54:20,882][52671] DAMAGECOUNT value on done: 575924.0 [2024-08-06 04:54:20,884][52671] Sum rewards: 83.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.174', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.096', 'weapon4': '0.112', 'AMMO4': '0.187', 'weapon2': '0.210', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.943', 'FRAGCOUNT': '70.000'} [2024-08-06 04:54:21,279][52662] DAMAGECOUNT value on done: 581516.0 [2024-08-06 04:54:21,281][52662] Sum rewards: 63.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.032', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.100', 'weapon5': '0.164', 'AMMO4': '0.178', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '52.000'} [2024-08-06 04:54:21,569][52668] DAMAGECOUNT value on done: 557649.0 [2024-08-06 04:54:21,569][52668] Sum rewards: 74.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.144', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.122', 'AMMO4': '0.124', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '63.000'} [2024-08-06 04:54:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 467320832. Throughput: 0: 4380.6. Samples: 116835280. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 04:54:22,795][52567] Avg episode reward: [(0, '72.925')] [2024-08-06 04:54:23,014][52658] DAMAGECOUNT value on done: 578207.0 [2024-08-06 04:54:23,014][52658] Sum rewards: 70.474, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.164', 'AMMO3': '0.206', 'weapon5': '0.224', 'HEALTH': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:23,919][52671] DAMAGECOUNT value on done: 574111.0 [2024-08-06 04:54:23,920][52671] Sum rewards: 68.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.636', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:23,959][52660] DAMAGECOUNT value on done: 580512.0 [2024-08-06 04:54:23,960][52660] Sum rewards: 77.513, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.666', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.104', 'AMMO3': '0.176', 'AMMO4': '0.185', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.646', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 04:54:24,188][52662] DAMAGECOUNT value on done: 567959.0 [2024-08-06 04:54:24,188][52662] Sum rewards: 77.032, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.739', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.150', 'weapon5': '0.182', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '0.950', 'weapon3': '2.974', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '60.000'} [2024-08-06 04:54:24,499][52650] Updated weights for policy 0, policy_version 57051 (0.0027) [2024-08-06 04:54:24,640][52668] DAMAGECOUNT value on done: 560507.0 [2024-08-06 04:54:24,642][52668] Sum rewards: 70.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.316', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.209', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '57.500'} [2024-08-06 04:54:25,942][52658] DAMAGECOUNT value on done: 568622.0 [2024-08-06 04:54:25,945][52658] Sum rewards: 77.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.405', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.089', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.352', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '66.000'} [2024-08-06 04:54:27,066][52662] DAMAGECOUNT value on done: 573361.0 [2024-08-06 04:54:27,066][52662] Sum rewards: 67.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.211', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.422', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '55.000'} [2024-08-06 04:54:27,069][52660] DAMAGECOUNT value on done: 569445.0 [2024-08-06 04:54:27,070][52660] Sum rewards: 66.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.745', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.052', 'AMMO4': '0.174', 'weapon5': '0.182', 'weapon2': '0.230', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.280', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 467410944. Throughput: 0: 4385.3. Samples: 116861800. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 04:54:27,794][52567] Avg episode reward: [(0, '72.813')] [2024-08-06 04:54:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057057_467410944.pth... [2024-08-06 04:54:27,855][52668] DAMAGECOUNT value on done: 562961.0 [2024-08-06 04:54:27,859][52668] Sum rewards: 79.442, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.058', 'weapon4': '0.118', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '66.000'} [2024-08-06 04:54:27,927][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056545_463216640.pth [2024-08-06 04:54:29,026][52658] DAMAGECOUNT value on done: 568647.0 [2024-08-06 04:54:29,027][52658] Sum rewards: 68.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:29,223][52650] Updated weights for policy 0, policy_version 57061 (0.0040) [2024-08-06 04:54:30,149][52660] DAMAGECOUNT value on done: 568143.0 [2024-08-06 04:54:30,155][52660] Sum rewards: 77.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.812', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.230', 'weapon4': '0.234', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '63.000'} [2024-08-06 04:54:30,206][52662] DAMAGECOUNT value on done: 569106.0 [2024-08-06 04:54:30,208][52662] Sum rewards: 62.526, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.147', 'AMMO4': '0.174', 'weapon5': '0.190', 'weapon4': '0.310', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '48.500'} [2024-08-06 04:54:30,697][52668] DAMAGECOUNT value on done: 570313.0 [2024-08-06 04:54:30,698][52668] Sum rewards: 71.132, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.748', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.128', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.750', 'weapon3': '2.988', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '62.000'} [2024-08-06 04:54:31,712][52658] DAMAGECOUNT value on done: 575404.0 [2024-08-06 04:54:31,713][52658] Sum rewards: 69.206, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.548', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.148', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.650', 'weapon3': '2.938', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:32,781][52660] DAMAGECOUNT value on done: 566862.0 [2024-08-06 04:54:32,781][52660] Sum rewards: 79.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.486', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.094', 'weapon5': '0.172', 'AMMO3': '0.245', 'AMMO4': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.644', 'WEAPON3': '1.500', 'weapon3': '2.818', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '68.000'} [2024-08-06 04:54:32,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17749.3, 300 sec: 17522.6). Total num frames: 467509248. Throughput: 0: 4379.1. Samples: 116874550. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 04:54:32,794][52567] Avg episode reward: [(0, '72.653')] [2024-08-06 04:54:33,169][52662] DAMAGECOUNT value on done: 577724.0 [2024-08-06 04:54:33,170][52662] Sum rewards: 70.639, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.212', 'WEAPON5': '0.300', 'weapon5': '0.306', 'weapon2': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.606', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '55.500'} [2024-08-06 04:54:33,207][52668] DAMAGECOUNT value on done: 573472.0 [2024-08-06 04:54:33,208][52668] Sum rewards: 65.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.484', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.143', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '53.000'} [2024-08-06 04:54:34,206][52650] Updated weights for policy 0, policy_version 57071 (0.0015) [2024-08-06 04:54:35,191][52660] DAMAGECOUNT value on done: 575990.0 [2024-08-06 04:54:35,192][52660] Sum rewards: 69.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.553', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon4': '0.216', 'AMMO3': '0.235', 'weapon5': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.772', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:35,576][52668] DAMAGECOUNT value on done: 572053.0 [2024-08-06 04:54:35,576][52668] Sum rewards: 77.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.404', 'AMMO4': '-0.000', 'AMMO2': '0.000', 'AMMO5': '0.006', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon4': '0.256', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 04:54:36,473][52662] DAMAGECOUNT value on done: 570233.0 [2024-08-06 04:54:36,483][52662] Sum rewards: 66.776, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon2': '0.262', 'AMMO3': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.446', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 467582976. Throughput: 0: 4380.2. Samples: 116900930. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 04:54:37,794][52567] Avg episode reward: [(0, '72.196')] [2024-08-06 04:54:37,965][52660] DAMAGECOUNT value on done: 569400.0 [2024-08-06 04:54:37,965][52660] Sum rewards: 66.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.444', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:38,350][52668] DAMAGECOUNT value on done: 575442.0 [2024-08-06 04:54:38,350][52668] Sum rewards: 74.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '61.000'} [2024-08-06 04:54:38,802][52650] Updated weights for policy 0, policy_version 57081 (0.0015) [2024-08-06 04:54:39,249][52665] DAMAGECOUNT value on done: 559136.0 [2024-08-06 04:54:39,250][52665] Sum rewards: 79.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.205', 'weapon2': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '64.000'} [2024-08-06 04:54:39,357][52671] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:54:39,472][52662] DAMAGECOUNT value on done: 583499.0 [2024-08-06 04:54:39,473][52662] Sum rewards: 79.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.819', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.342', 'WEAPON3': '1.050', 'weapon3': '3.394', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '63.000'} [2024-08-06 04:54:40,749][52660] DAMAGECOUNT value on done: 570486.0 [2024-08-06 04:54:40,751][52660] Sum rewards: 69.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.188', 'weapon2': '0.378', 'WEAPON3': '1.150', 'HITCOUNT': '3.350', 'weapon3': '3.532', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 04:54:41,368][52668] DAMAGECOUNT value on done: 573718.0 [2024-08-06 04:54:41,371][52668] Sum rewards: 71.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.094', 'AMMO4': '0.147', 'weapon5': '0.172', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '59.500'} [2024-08-06 04:54:41,780][52662] DAMAGECOUNT value on done: 575840.0 [2024-08-06 04:54:41,788][52662] Sum rewards: 62.105, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.310', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon2': '0.326', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.272', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '54.000'} [2024-08-06 04:54:42,291][52665] DAMAGECOUNT value on done: 576818.0 [2024-08-06 04:54:42,293][52665] Sum rewards: 64.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.004', 'weapon4': '0.008', 'AMMO2': '0.010', 'weapon5': '0.030', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.428', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '52.000'} [2024-08-06 04:54:42,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 467673088. Throughput: 0: 4382.7. Samples: 116927180. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 04:54:42,795][52567] Avg episode reward: [(0, '71.602')] [2024-08-06 04:54:43,383][52650] Updated weights for policy 0, policy_version 57091 (0.0011) [2024-08-06 04:54:43,548][52668] Large shaping reward 2.627 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:54:43,770][52660] DAMAGECOUNT value on done: 577675.0 [2024-08-06 04:54:43,772][52660] Sum rewards: 62.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.096', 'AMMO4': '0.163', 'weapon5': '0.188', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.040', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '51.500'} [2024-08-06 04:54:44,735][52662] DAMAGECOUNT value on done: 568838.0 [2024-08-06 04:54:44,736][52662] Sum rewards: 76.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.278', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon2': '0.164', 'AMMO3': '0.176', 'weapon4': '0.182', 'weapon5': '0.214', 'AMMO4': '0.287', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.176', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '61.000'} [2024-08-06 04:54:45,061][52665] DAMAGECOUNT value on done: 569799.0 [2024-08-06 04:54:45,062][52665] Sum rewards: 72.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.116', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.184', 'weapon5': '0.218', 'weapon4': '0.284', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '59.000'} [2024-08-06 04:54:46,763][52660] DAMAGECOUNT value on done: 565882.0 [2024-08-06 04:54:46,764][52660] Sum rewards: 78.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.685', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.166', 'weapon4': '0.170', 'AMMO3': '0.204', 'AMMO4': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.000'} [2024-08-06 04:54:47,734][52662] DAMAGECOUNT value on done: 572344.0 [2024-08-06 04:54:47,735][52662] Sum rewards: 68.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.322', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.098', 'AMMO4': '0.149', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '58.000'} [2024-08-06 04:54:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 467763200. Throughput: 0: 4382.0. Samples: 116940440. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 04:54:47,794][52567] Avg episode reward: [(0, '71.438')] [2024-08-06 04:54:48,215][52665] DAMAGECOUNT value on done: 564403.0 [2024-08-06 04:54:48,217][52665] Sum rewards: 76.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.655', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.162', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '60.000'} [2024-08-06 04:54:48,475][52650] Updated weights for policy 0, policy_version 57101 (0.0017) [2024-08-06 04:54:49,759][52660] DAMAGECOUNT value on done: 568185.0 [2024-08-06 04:54:49,759][52660] Sum rewards: 69.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.996', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.176', 'AMMO3': '0.184', 'weapon5': '0.192', 'AMMO4': '0.197', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '2.982', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:51,083][52662] DAMAGECOUNT value on done: 567296.0 [2024-08-06 04:54:51,083][52662] Sum rewards: 58.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.830', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.124', 'weapon2': '0.188', 'AMMO4': '0.218', 'AMMO3': '0.241', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '3.130', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '50.000'} [2024-08-06 04:54:51,450][52665] DAMAGECOUNT value on done: 555557.0 [2024-08-06 04:54:51,451][52665] Sum rewards: 64.668, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.093', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.468', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.208', 'DAMAGECOUNT': '14.436', 'FRAGCOUNT': '53.000'} [2024-08-06 04:54:52,194][52659] DAMAGECOUNT value on done: 578692.0 [2024-08-06 04:54:52,197][52659] Sum rewards: 67.597, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.778', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'weapon4': '0.182', 'weapon2': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.800', 'weapon3': '3.242', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '60.000'} [2024-08-06 04:54:52,309][52660] DAMAGECOUNT value on done: 578586.0 [2024-08-06 04:54:52,310][52660] Sum rewards: 87.234, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.264', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '71.000'} [2024-08-06 04:54:52,790][52650] Updated weights for policy 0, policy_version 57111 (0.0012) [2024-08-06 04:54:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 467853312. Throughput: 0: 4367.3. Samples: 116966110. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 04:54:52,798][52567] Avg episode reward: [(0, '71.363')] [2024-08-06 04:54:54,672][52665] DAMAGECOUNT value on done: 562687.0 [2024-08-06 04:54:54,672][52665] Sum rewards: 67.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.704', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.028', 'weapon5': '0.042', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.178', 'AMMO3': '0.198', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.610', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '56.000'} [2024-08-06 04:54:54,886][52660] DAMAGECOUNT value on done: 585690.0 [2024-08-06 04:54:54,887][52660] Sum rewards: 80.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.211', 'weapon2': '0.236', 'weapon5': '0.312', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.740', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '65.000'} [2024-08-06 04:54:55,052][52659] DAMAGECOUNT value on done: 571372.0 [2024-08-06 04:54:55,053][52659] Sum rewards: 63.420, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.690', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.166', 'AMMO4': '0.170', 'weapon2': '0.308', 'AMMO3': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.176', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:55,509][52795] DAMAGECOUNT value on done: 531721.0 [2024-08-06 04:54:55,510][52795] Sum rewards: 67.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.122', 'AMMO4': '0.147', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:57,005][52665] DAMAGECOUNT value on done: 566556.0 [2024-08-06 04:54:57,007][52665] Sum rewards: 68.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.465', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.130', 'AMMO3': '0.180', 'weapon5': '0.242', 'AMMO4': '0.257', 'weapon2': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.064', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '57.000'} [2024-08-06 04:54:57,493][52650] Updated weights for policy 0, policy_version 57121 (0.0027) [2024-08-06 04:54:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 467935232. Throughput: 0: 4371.6. Samples: 116992590. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 04:54:57,794][52567] Avg episode reward: [(0, '71.419')] [2024-08-06 04:54:57,806][52660] DAMAGECOUNT value on done: 568204.0 [2024-08-06 04:54:57,806][52660] Sum rewards: 73.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.060', 'AMMO4': '0.191', 'AMMO3': '0.216', 'weapon5': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '60.000'} [2024-08-06 04:54:58,129][52659] DAMAGECOUNT value on done: 577518.0 [2024-08-06 04:54:58,130][52659] Sum rewards: 78.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.135', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon2': '0.192', 'AMMO3': '0.193', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '65.000'} [2024-08-06 04:54:58,623][52795] DAMAGECOUNT value on done: 522670.0 [2024-08-06 04:54:58,623][52795] Sum rewards: 64.090, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.401', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'AMMO3': '0.297', 'WEAPON3': '1.750', 'weapon3': '3.248', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '55.000'} [2024-08-06 04:54:59,667][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:54:59,891][52665] DAMAGECOUNT value on done: 565698.0 [2024-08-06 04:54:59,895][52665] Sum rewards: 72.356, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.191', 'weapon2': '0.802', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '58.000'} [2024-08-06 04:55:00,236][52660] DAMAGECOUNT value on done: 575990.0 [2024-08-06 04:55:00,238][52660] Sum rewards: 78.147, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.356', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.266', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.398', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:00,896][52659] DAMAGECOUNT value on done: 573453.0 [2024-08-06 04:55:00,897][52659] Sum rewards: 73.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.062', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.346', 'WEAPON3': '1.050', 'weapon3': '3.392', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '58.000'} [2024-08-06 04:55:01,792][52795] DAMAGECOUNT value on done: 520417.0 [2024-08-06 04:55:01,792][52795] Sum rewards: 67.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.976', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'weapon4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '55.000'} [2024-08-06 04:55:01,977][52650] Updated weights for policy 0, policy_version 57131 (0.0012) [2024-08-06 04:55:02,739][52660] DAMAGECOUNT value on done: 569925.0 [2024-08-06 04:55:02,740][52660] Sum rewards: 68.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.914', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.108', 'AMMO3': '0.223', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.350', 'weapon4': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '57.000'} [2024-08-06 04:55:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 468025344. Throughput: 0: 4373.6. Samples: 117005800. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 04:55:02,794][52567] Avg episode reward: [(0, '71.591')] [2024-08-06 04:55:02,881][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:55:03,039][52665] DAMAGECOUNT value on done: 572586.0 [2024-08-06 04:55:03,041][52665] Sum rewards: 74.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.128', 'weapon4': '0.228', 'AMMO3': '0.239', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:03,455][52794] DAMAGECOUNT value on done: 577275.0 [2024-08-06 04:55:03,456][52794] Sum rewards: 78.247, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.966', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.112', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'weapon2': '0.510', 'WEAPON3': '1.750', 'weapon3': '2.988', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '68.000'} [2024-08-06 04:55:04,094][52659] DAMAGECOUNT value on done: 569216.0 [2024-08-06 04:55:04,098][52659] Sum rewards: 76.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.661', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.068', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 04:55:04,897][52795] DAMAGECOUNT value on done: 527906.0 [2024-08-06 04:55:04,898][52795] Sum rewards: 79.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.845', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon4': '0.210', 'weapon5': '0.212', 'AMMO3': '0.229', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:05,458][52660] DAMAGECOUNT value on done: 571733.0 [2024-08-06 04:55:05,458][52660] Sum rewards: 77.866, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.860', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.180', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'weapon3': '3.596', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:05,881][52665] DAMAGECOUNT value on done: 566802.0 [2024-08-06 04:55:05,882][52665] Sum rewards: 67.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.774', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.080', 'AMMO4': '0.138', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.242', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 04:55:06,303][52794] DAMAGECOUNT value on done: 582105.0 [2024-08-06 04:55:06,303][52794] Sum rewards: 64.079, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.426', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.088', 'weapon5': '0.176', 'AMMO4': '0.252', 'weapon2': '0.270', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.176', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '57.000'} [2024-08-06 04:55:07,141][52650] Updated weights for policy 0, policy_version 57141 (0.0015) [2024-08-06 04:55:07,157][52659] DAMAGECOUNT value on done: 573478.0 [2024-08-06 04:55:07,157][52659] Sum rewards: 80.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.123', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.182', 'weapon2': '0.212', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.316', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '68.000'} [2024-08-06 04:55:07,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 468115456. Throughput: 0: 4375.8. Samples: 117032190. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:55:07,795][52567] Avg episode reward: [(0, '71.896')] [2024-08-06 04:55:07,926][52795] DAMAGECOUNT value on done: 524380.0 [2024-08-06 04:55:07,927][52795] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.734', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon2': '0.204', 'AMMO3': '0.266', 'WEAPON3': '1.750', 'weapon3': '3.432', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '64.000'} [2024-08-06 04:55:08,204][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:55:08,787][52660] DAMAGECOUNT value on done: 562791.0 [2024-08-06 04:55:08,787][52660] Sum rewards: 75.730, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.316', 'weapon2': '0.360', 'WEAPON3': '0.850', 'weapon3': '3.070', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:08,807][52665] DAMAGECOUNT value on done: 577126.0 [2024-08-06 04:55:08,809][52665] Sum rewards: 73.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.712', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.128', 'AMMO4': '0.173', 'weapon2': '0.206', 'AMMO3': '0.224', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:09,297][52794] DAMAGECOUNT value on done: 579265.0 [2024-08-06 04:55:09,300][52794] Sum rewards: 78.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.082', 'weapon2': '0.194', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.562', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:10,008][52671] Large shaping reward 2.549 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.093, -31.0), ('weapon5', 0.002)] [2024-08-06 04:55:10,283][52659] DAMAGECOUNT value on done: 573660.0 [2024-08-06 04:55:10,284][52659] Sum rewards: 67.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.413', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.198', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.206', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:10,644][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:55:11,125][52650] Updated weights for policy 0, policy_version 57151 (0.0026) [2024-08-06 04:55:11,218][52795] DAMAGECOUNT value on done: 533598.0 [2024-08-06 04:55:11,230][52795] Sum rewards: 77.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.459', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.140', 'weapon5': '0.190', 'AMMO3': '0.229', 'AMMO4': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '63.000'} [2024-08-06 04:55:12,164][52665] DAMAGECOUNT value on done: 571487.0 [2024-08-06 04:55:12,165][52665] Sum rewards: 71.867, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.328', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.386', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:12,202][52794] DAMAGECOUNT value on done: 571372.0 [2024-08-06 04:55:12,202][52794] Sum rewards: 72.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.098', 'weapon5': '0.118', 'AMMO4': '0.129', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 468189184. Throughput: 0: 4368.9. Samples: 117058400. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:55:12,794][52567] Avg episode reward: [(0, '72.030')] [2024-08-06 04:55:13,411][52659] DAMAGECOUNT value on done: 569999.0 [2024-08-06 04:55:13,412][52659] Sum rewards: 60.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.200', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.098', 'AMMO4': '0.215', 'AMMO3': '0.234', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '2.960', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '49.500'} [2024-08-06 04:55:14,466][52795] DAMAGECOUNT value on done: 537140.0 [2024-08-06 04:55:14,467][52795] Sum rewards: 75.479, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.126', 'weapon4': '0.156', 'AMMO3': '0.196', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:14,961][52794] DAMAGECOUNT value on done: 570689.0 [2024-08-06 04:55:14,964][52794] Sum rewards: 78.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.838', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.128', 'AMMO4': '0.167', 'weapon5': '0.210', 'AMMO3': '0.223', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:15,305][52665] DAMAGECOUNT value on done: 568569.0 [2024-08-06 04:55:15,305][52665] Sum rewards: 76.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.134', 'weapon4': '0.148', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '64.000'} [2024-08-06 04:55:15,974][52659] DAMAGECOUNT value on done: 577201.0 [2024-08-06 04:55:15,975][52659] Sum rewards: 68.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.334', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.174', 'AMMO3': '0.186', 'weapon4': '0.186', 'AMMO4': '0.218', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '55.000'} [2024-08-06 04:55:16,231][52650] Updated weights for policy 0, policy_version 57161 (0.0010) [2024-08-06 04:55:17,596][52795] DAMAGECOUNT value on done: 531956.0 [2024-08-06 04:55:17,596][52795] Sum rewards: 72.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.122', 'weapon4': '0.148', 'AMMO3': '0.176', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.278', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:17,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 468287488. Throughput: 0: 4370.2. Samples: 117071210. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:55:17,794][52567] Avg episode reward: [(0, '72.099')] [2024-08-06 04:55:17,901][52665] DAMAGECOUNT value on done: 567047.0 [2024-08-06 04:55:17,903][52665] Sum rewards: 69.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.745', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.068', 'weapon5': '0.076', 'AMMO4': '0.135', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '57.000'} [2024-08-06 04:55:18,043][52794] DAMAGECOUNT value on done: 572644.0 [2024-08-06 04:55:18,043][52794] Sum rewards: 83.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.251', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO4': '0.177', 'weapon4': '0.178', 'AMMO3': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '68.000'} [2024-08-06 04:55:18,804][52659] DAMAGECOUNT value on done: 579349.0 [2024-08-06 04:55:18,804][52659] Sum rewards: 57.706, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.880', 'AMMO2': '0.000', 'AMMO4': '0.000', 'AMMO5': '0.003', 'weapon5': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.144', 'WEAPON7': '0.200', 'weapon7': '0.458', 'weapon4': '0.474', 'weapon2': '0.640', 'WEAPON3': '0.950', 'weapon3': '2.148', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.032', 'FRAGCOUNT': '46.500'} [2024-08-06 04:55:18,950][52820] Large shaping reward 2.586 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon5', 0.002)] [2024-08-06 04:55:20,264][52820] DAMAGECOUNT value on done: 528273.0 [2024-08-06 04:55:20,264][52820] Sum rewards: 71.464, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.068', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'weapon2': '0.522', 'WEAPON3': '1.050', 'weapon3': '3.240', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:20,528][52665] DAMAGECOUNT value on done: 565550.0 [2024-08-06 04:55:20,530][52665] Sum rewards: 78.131, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.121', 'weapon5': '0.170', 'AMMO3': '0.203', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '65.000'} [2024-08-06 04:55:20,687][52795] DAMAGECOUNT value on done: 524863.0 [2024-08-06 04:55:20,687][52795] Sum rewards: 67.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.347', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.157', 'weapon4': '0.212', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '57.000'} [2024-08-06 04:55:20,721][52794] DAMAGECOUNT value on done: 580712.0 [2024-08-06 04:55:20,722][52794] Sum rewards: 84.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.467', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon5': '0.130', 'weapon4': '0.154', 'AMMO4': '0.175', 'AMMO3': '0.178', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '69.000'} [2024-08-06 04:55:21,203][52650] Updated weights for policy 0, policy_version 57171 (0.0012) [2024-08-06 04:55:22,049][52659] DAMAGECOUNT value on done: 568898.0 [2024-08-06 04:55:22,051][52659] Sum rewards: 56.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.048', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.196', 'weapon5': '0.220', 'AMMO4': '0.220', 'weapon4': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '47.000'} [2024-08-06 04:55:22,376][52614] Signal inference workers to stop experience collection... (10400 times) [2024-08-06 04:55:22,376][52614] Signal inference workers to resume experience collection... (10400 times) [2024-08-06 04:55:22,436][52650] InferenceWorker_p0-w0: stopping experience collection (10400 times) [2024-08-06 04:55:22,437][52650] InferenceWorker_p0-w0: resuming experience collection (10400 times) [2024-08-06 04:55:22,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 468377600. Throughput: 0: 4365.3. Samples: 117097370. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:55:22,802][52567] Avg episode reward: [(0, '71.714')] [2024-08-06 04:55:23,235][52647] DAMAGECOUNT value on done: 607048.0 [2024-08-06 04:55:23,235][52647] Sum rewards: 67.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.888', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.190', 'weapon5': '0.216', 'AMMO4': '0.228', 'weapon4': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.720', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:23,293][52820] DAMAGECOUNT value on done: 530479.0 [2024-08-06 04:55:23,298][52820] Sum rewards: 74.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO3': '0.170', 'weapon2': '0.172', 'AMMO4': '0.199', 'weapon5': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.260', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '58.500'} [2024-08-06 04:55:23,414][52794] DAMAGECOUNT value on done: 566388.0 [2024-08-06 04:55:23,416][52794] Sum rewards: 61.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.112', 'AMMO3': '0.140', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '0.900', 'HITCOUNT': '2.850', 'weapon3': '2.852', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '49.000'} [2024-08-06 04:55:23,588][52665] DAMAGECOUNT value on done: 563710.0 [2024-08-06 04:55:23,590][52665] Sum rewards: 73.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon5': '0.092', 'weapon4': '0.188', 'AMMO3': '0.197', 'weapon2': '0.236', 'WEAPON5': '0.250', 'AMMO4': '0.275', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:23,809][52795] DAMAGECOUNT value on done: 534947.0 [2024-08-06 04:55:23,811][52795] Sum rewards: 85.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.099', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.853', 'FRAGCOUNT': '69.500'} [2024-08-06 04:55:25,165][52659] DAMAGECOUNT value on done: 577334.0 [2024-08-06 04:55:25,167][52659] Sum rewards: 77.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.140', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon5': '0.048', 'weapon4': '0.162', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:25,523][52650] Updated weights for policy 0, policy_version 57181 (0.0016) [2024-08-06 04:55:26,031][52647] DAMAGECOUNT value on done: 602999.0 [2024-08-06 04:55:26,031][52647] Sum rewards: 78.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.326', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.049', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.348', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '64.000'} [2024-08-06 04:55:26,404][52820] DAMAGECOUNT value on done: 535025.0 [2024-08-06 04:55:26,404][52820] Sum rewards: 72.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.122', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO4': '0.185', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:26,433][52794] DAMAGECOUNT value on done: 577215.0 [2024-08-06 04:55:26,433][52794] Sum rewards: 74.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.070', 'weapon5': '0.156', 'AMMO4': '0.210', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:26,461][52665] DAMAGECOUNT value on done: 565636.0 [2024-08-06 04:55:26,475][52665] Sum rewards: 83.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.820', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.115', 'weapon4': '0.138', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '71.000'} [2024-08-06 04:55:27,003][52795] DAMAGECOUNT value on done: 531194.0 [2024-08-06 04:55:27,005][52795] Sum rewards: 76.420, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 468459520. Throughput: 0: 4367.6. Samples: 117123720. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:55:27,794][52567] Avg episode reward: [(0, '71.970')] [2024-08-06 04:55:28,394][52659] DAMAGECOUNT value on done: 567594.0 [2024-08-06 04:55:28,394][52659] Sum rewards: 74.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.064', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.340', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '64.000'} [2024-08-06 04:55:28,858][52665] DAMAGECOUNT value on done: 563111.0 [2024-08-06 04:55:28,860][52665] Sum rewards: 87.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon4': '0.106', 'AMMO4': '0.155', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '72.000'} [2024-08-06 04:55:29,140][52647] DAMAGECOUNT value on done: 604173.0 [2024-08-06 04:55:29,140][52647] Sum rewards: 72.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.913', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.167', 'weapon4': '0.172', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.000'} [2024-08-06 04:55:29,577][52820] DAMAGECOUNT value on done: 525328.0 [2024-08-06 04:55:29,577][52820] Sum rewards: 83.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.090', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '68.000'} [2024-08-06 04:55:29,584][52794] DAMAGECOUNT value on done: 572770.0 [2024-08-06 04:55:29,584][52794] Sum rewards: 70.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.978', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.046', 'AMMO4': '0.137', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:30,106][52795] DAMAGECOUNT value on done: 524595.0 [2024-08-06 04:55:30,107][52795] Sum rewards: 71.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.526', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon4': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.231', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:30,259][52650] Updated weights for policy 0, policy_version 57191 (0.0011) [2024-08-06 04:55:31,278][52659] DAMAGECOUNT value on done: 571211.0 [2024-08-06 04:55:31,279][52659] Sum rewards: 69.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-4.190', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.166', 'AMMO3': '0.215', 'weapon4': '0.268', 'weapon2': '0.298', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '57.000'} [2024-08-06 04:55:32,099][52665] DAMAGECOUNT value on done: 566381.0 [2024-08-06 04:55:32,101][52665] Sum rewards: 73.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.112', 'weapon4': '0.136', 'AMMO4': '0.180', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:32,266][52647] DAMAGECOUNT value on done: 611017.0 [2024-08-06 04:55:32,266][52647] Sum rewards: 73.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.384', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '60.000'} [2024-08-06 04:55:32,670][52820] DAMAGECOUNT value on done: 534189.0 [2024-08-06 04:55:32,670][52820] Sum rewards: 53.918, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.926', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon5': '0.268', 'AMMO4': '0.273', 'weapon4': '0.276', 'AMMO3': '0.327', 'weapon2': '0.338', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.900', 'weapon3': '2.690', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '51.000'} [2024-08-06 04:55:32,747][52794] DAMAGECOUNT value on done: 569218.0 [2024-08-06 04:55:32,747][52794] Sum rewards: 62.024, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.112', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.700', 'HITCOUNT': '3.210', 'weapon3': '3.278', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '57.000'} [2024-08-06 04:55:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 468549632. Throughput: 0: 4365.5. Samples: 117136890. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:55:32,802][52567] Avg episode reward: [(0, '72.218')] [2024-08-06 04:55:33,339][52795] DAMAGECOUNT value on done: 526719.0 [2024-08-06 04:55:33,343][52795] Sum rewards: 76.003, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.674', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.156', 'weapon5': '0.242', 'AMMO3': '0.272', 'weapon2': '0.292', 'AMMO4': '0.317', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '64.000'} [2024-08-06 04:55:33,981][52659] DAMAGECOUNT value on done: 583777.0 [2024-08-06 04:55:33,981][52659] Sum rewards: 82.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.098', 'AMMO3': '0.192', 'AMMO4': '0.231', 'weapon5': '0.274', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:34,842][52650] Updated weights for policy 0, policy_version 57201 (0.0015) [2024-08-06 04:55:35,188][52647] DAMAGECOUNT value on done: 612822.0 [2024-08-06 04:55:35,189][52647] Sum rewards: 73.371, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.080', 'AMMO4': '0.102', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:35,250][52665] DAMAGECOUNT value on done: 567907.0 [2024-08-06 04:55:35,255][52665] Sum rewards: 72.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.686', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO4': '0.177', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:35,344][52794] DAMAGECOUNT value on done: 574460.0 [2024-08-06 04:55:35,344][52794] Sum rewards: 71.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.538', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.028', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.430', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '60.000'} [2024-08-06 04:55:35,759][52820] DAMAGECOUNT value on done: 525652.0 [2024-08-06 04:55:35,759][52820] Sum rewards: 61.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.325', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.177', 'weapon5': '0.190', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '50.000'} [2024-08-06 04:55:36,204][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:55:36,599][52795] DAMAGECOUNT value on done: 531279.0 [2024-08-06 04:55:36,599][52795] Sum rewards: 60.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.844', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.292', 'weapon4': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '52.000'} [2024-08-06 04:55:36,986][52659] DAMAGECOUNT value on done: 574820.0 [2024-08-06 04:55:36,989][52659] Sum rewards: 78.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.156', 'weapon5': '0.162', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 04:55:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 468639744. Throughput: 0: 4378.9. Samples: 117163160. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 04:55:37,802][52567] Avg episode reward: [(0, '72.279')] [2024-08-06 04:55:38,067][52658] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:55:38,084][52794] DAMAGECOUNT value on done: 569501.0 [2024-08-06 04:55:38,086][52794] Sum rewards: 64.807, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.155', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.094', 'AMMO4': '0.128', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.146', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '54.000'} [2024-08-06 04:55:38,327][52647] DAMAGECOUNT value on done: 612113.0 [2024-08-06 04:55:38,327][52647] Sum rewards: 76.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.243', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.050', 'weapon5': '0.066', 'AMMO4': '0.096', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.304', 'WEAPON3': '0.900', 'HITCOUNT': '3.300', 'weapon3': '3.410', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '60.000'} [2024-08-06 04:55:38,813][52820] DAMAGECOUNT value on done: 531651.0 [2024-08-06 04:55:38,814][52820] Sum rewards: 87.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.552', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.020', 'weapon4': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.366', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '74.000'} [2024-08-06 04:55:39,760][52650] Updated weights for policy 0, policy_version 57211 (0.0021) [2024-08-06 04:55:39,768][52795] DAMAGECOUNT value on done: 522671.0 [2024-08-06 04:55:39,772][52795] Sum rewards: 75.192, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.046', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '60.000'} [2024-08-06 04:55:39,932][52659] DAMAGECOUNT value on done: 583749.0 [2024-08-06 04:55:39,933][52659] Sum rewards: 76.702, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.102', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:40,661][52647] DAMAGECOUNT value on done: 607072.0 [2024-08-06 04:55:40,662][52647] Sum rewards: 66.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.068', 'weapon5': '0.152', 'AMMO4': '0.161', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '58.000'} [2024-08-06 04:55:40,871][52794] DAMAGECOUNT value on done: 588601.0 [2024-08-06 04:55:40,872][52794] Sum rewards: 76.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.003', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.031', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.235', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.494', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '63.000'} [2024-08-06 04:55:42,013][52820] DAMAGECOUNT value on done: 533981.0 [2024-08-06 04:55:42,014][52820] Sum rewards: 69.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.394', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.182', 'weapon4': '0.196', 'AMMO3': '0.243', 'AMMO4': '0.249', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:42,663][52659] DAMAGECOUNT value on done: 573337.0 [2024-08-06 04:55:42,664][52659] Sum rewards: 60.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.598', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.210', 'AMMO4': '0.222', 'weapon2': '0.264', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.030', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 04:55:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 468729856. Throughput: 0: 4363.8. Samples: 117188960. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:55:42,794][52567] Avg episode reward: [(0, '72.457')] [2024-08-06 04:55:42,999][52795] DAMAGECOUNT value on done: 538371.0 [2024-08-06 04:55:43,000][52795] Sum rewards: 62.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.774', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.392', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.316', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '53.000'} [2024-08-06 04:55:43,189][52647] DAMAGECOUNT value on done: 597874.0 [2024-08-06 04:55:43,189][52647] Sum rewards: 83.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.883', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.096', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '69.500'} [2024-08-06 04:55:43,300][52667] DAMAGECOUNT value on done: 575772.0 [2024-08-06 04:55:43,300][52667] Sum rewards: 73.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.036', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.116', 'weapon4': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.256', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '61.000'} [2024-08-06 04:55:44,131][52794] DAMAGECOUNT value on done: 566194.0 [2024-08-06 04:55:44,132][52794] Sum rewards: 76.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.094', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.160', 'AMMO4': '0.162', 'AMMO3': '0.196', 'weapon4': '0.236', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:44,505][52650] Updated weights for policy 0, policy_version 57221 (0.0012) [2024-08-06 04:55:45,280][52820] DAMAGECOUNT value on done: 528592.0 [2024-08-06 04:55:45,280][52820] Sum rewards: 71.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.298', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.084', 'AMMO3': '0.183', 'weapon5': '0.198', 'AMMO4': '0.318', 'weapon2': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.120', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:45,376][52659] DAMAGECOUNT value on done: 579526.0 [2024-08-06 04:55:45,377][52659] Sum rewards: 72.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.262', 'weapon4': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:45,664][52647] DAMAGECOUNT value on done: 608371.0 [2024-08-06 04:55:45,664][52647] Sum rewards: 65.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.282', 'AMMO5': '0.022', 'AMMO2': '0.037', 'weapon5': '0.118', 'weapon4': '0.134', 'AMMO4': '0.183', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:46,091][52795] DAMAGECOUNT value on done: 530683.0 [2024-08-06 04:55:46,093][52795] Sum rewards: 72.566, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.530', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon5': '0.086', 'weapon4': '0.134', 'weapon2': '0.186', 'AMMO4': '0.235', 'AMMO3': '0.293', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.850', 'weapon3': '3.360', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '64.000'} [2024-08-06 04:55:46,143][52667] DAMAGECOUNT value on done: 583174.0 [2024-08-06 04:55:46,144][52667] Sum rewards: 67.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.694', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'weapon4': '0.122', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '54.000'} [2024-08-06 04:55:47,082][52794] DAMAGECOUNT value on done: 582879.0 [2024-08-06 04:55:47,088][52794] Sum rewards: 71.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.425', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon4': '0.172', 'weapon5': '0.176', 'AMMO3': '0.206', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:47,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 468803584. Throughput: 0: 4367.1. Samples: 117202320. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:55:47,802][52567] Avg episode reward: [(0, '72.525')] [2024-08-06 04:55:48,272][52659] DAMAGECOUNT value on done: 574741.0 [2024-08-06 04:55:48,274][52659] Sum rewards: 70.324, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.645', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.220', 'weapon5': '0.240', 'weapon2': '0.242', 'AMMO4': '0.251', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '60.000'} [2024-08-06 04:55:48,378][52820] DAMAGECOUNT value on done: 539196.0 [2024-08-06 04:55:48,378][52820] Sum rewards: 90.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.780', 'FRAGCOUNT': '74.000'} [2024-08-06 04:55:48,655][52667] DAMAGECOUNT value on done: 577490.0 [2024-08-06 04:55:48,656][52667] Sum rewards: 70.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.934', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:48,776][52647] DAMAGECOUNT value on done: 603744.0 [2024-08-06 04:55:48,778][52647] Sum rewards: 66.095, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.505', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.162', 'weapon2': '0.678', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 04:55:48,868][52650] Updated weights for policy 0, policy_version 57231 (0.0013) [2024-08-06 04:55:49,169][52795] DAMAGECOUNT value on done: 524624.0 [2024-08-06 04:55:49,170][52795] Sum rewards: 81.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.180', 'weapon4': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '65.000'} [2024-08-06 04:55:50,300][52794] DAMAGECOUNT value on done: 573567.0 [2024-08-06 04:55:50,303][52794] Sum rewards: 90.581, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.048', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.240', 'HEALTH': '0.735', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.327', 'FRAGCOUNT': '73.000'} [2024-08-06 04:55:51,223][52647] DAMAGECOUNT value on done: 605061.0 [2024-08-06 04:55:51,223][52647] Sum rewards: 92.102, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.177', 'weapon2': '0.260', 'weapon4': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '20.922', 'FRAGCOUNT': '74.000'} [2024-08-06 04:55:51,477][52820] DAMAGECOUNT value on done: 527730.0 [2024-08-06 04:55:51,481][52820] Sum rewards: 72.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.124', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.126', 'weapon5': '0.160', 'AMMO3': '0.178', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.404', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:52,030][52667] DAMAGECOUNT value on done: 578426.0 [2024-08-06 04:55:52,032][52667] Sum rewards: 76.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.153', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.092', 'AMMO4': '0.124', 'weapon2': '0.138', 'AMMO3': '0.224', 'WEAPON3': '1.450', 'weapon3': '3.556', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '63.000'} [2024-08-06 04:55:52,104][52663] DAMAGECOUNT value on done: 583837.0 [2024-08-06 04:55:52,106][52663] Sum rewards: 69.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.030', 'AMMO4': '0.056', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '59.000'} [2024-08-06 04:55:52,369][52795] DAMAGECOUNT value on done: 531084.0 [2024-08-06 04:55:52,370][52795] Sum rewards: 74.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO3': '0.169', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '60.000'} [2024-08-06 04:55:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 468901888. Throughput: 0: 4365.1. Samples: 117228620. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:55:52,794][52567] Avg episode reward: [(0, '73.260')] [2024-08-06 04:55:53,552][52794] DAMAGECOUNT value on done: 581823.0 [2024-08-06 04:55:53,553][52794] Sum rewards: 79.138, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO4': '0.124', 'AMMO3': '0.159', 'weapon4': '0.216', 'weapon2': '0.274', 'WEAPON3': '0.850', 'HEALTH': '0.979', 'weapon3': '3.222', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:53,748][52647] DAMAGECOUNT value on done: 598018.0 [2024-08-06 04:55:53,748][52647] Sum rewards: 74.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.873', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.240', 'AMMO4': '0.252', 'weapon4': '0.286', 'weapon2': '0.302', 'weapon5': '0.328', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.716', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:53,830][52650] Updated weights for policy 0, policy_version 57241 (0.0011) [2024-08-06 04:55:54,582][52820] DAMAGECOUNT value on done: 533434.0 [2024-08-06 04:55:54,586][52820] Sum rewards: 76.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.266', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.134', 'AMMO3': '0.209', 'AMMO4': '0.245', 'weapon5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:54,587][52667] DAMAGECOUNT value on done: 581255.0 [2024-08-06 04:55:54,597][52667] Sum rewards: 68.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.578', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.186', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.256', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '58.500'} [2024-08-06 04:55:55,114][52663] DAMAGECOUNT value on done: 573935.0 [2024-08-06 04:55:55,114][52663] Sum rewards: 66.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.188', 'AMMO5': '0.026', 'AMMO2': '0.090', 'AMMO3': '0.174', 'weapon5': '0.380', 'weapon4': '0.424', 'AMMO4': '0.452', 'weapon2': '0.516', 'WEAPON5': '0.850', 'WEAPON4': '0.950', 'WEAPON3': '1.100', 'weapon3': '2.366', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '55.000'} [2024-08-06 04:55:55,565][52795] DAMAGECOUNT value on done: 536141.0 [2024-08-06 04:55:55,565][52795] Sum rewards: 67.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.473', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.146', 'weapon4': '0.148', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2024-08-06 04:55:56,053][52666] DAMAGECOUNT value on done: 573447.0 [2024-08-06 04:55:56,055][52666] Sum rewards: 82.311, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.166', 'AMMO3': '0.175', 'weapon5': '0.200', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '65.000'} [2024-08-06 04:55:56,682][52794] DAMAGECOUNT value on done: 583835.0 [2024-08-06 04:55:56,682][52794] Sum rewards: 67.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '55.000'} [2024-08-06 04:55:56,762][52647] DAMAGECOUNT value on done: 611646.0 [2024-08-06 04:55:56,762][52647] Sum rewards: 79.804, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'HEALTH': '0.288', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '67.000'} [2024-08-06 04:55:56,970][52667] DAMAGECOUNT value on done: 583935.0 [2024-08-06 04:55:56,972][52667] Sum rewards: 76.353, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.603', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.078', 'AMMO4': '0.131', 'AMMO3': '0.231', 'weapon5': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.870', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '66.000'} [2024-08-06 04:55:57,391][52670] DAMAGECOUNT value on done: 565276.0 [2024-08-06 04:55:57,393][52670] Sum rewards: 74.939, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.523', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.165', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 04:55:57,692][52820] DAMAGECOUNT value on done: 541116.0 [2024-08-06 04:55:57,693][52820] Sum rewards: 66.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.146', 'AMMO3': '0.224', 'weapon5': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.212', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '54.000'} [2024-08-06 04:55:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 468983808. Throughput: 0: 4366.7. Samples: 117254900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:55:57,794][52567] Avg episode reward: [(0, '73.414')] [2024-08-06 04:55:58,084][52663] DAMAGECOUNT value on done: 564714.0 [2024-08-06 04:55:58,085][52663] Sum rewards: 65.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.085', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.112', 'AMMO4': '0.197', 'weapon5': '0.246', 'AMMO3': '0.258', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.042', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:58,136][52650] Updated weights for policy 0, policy_version 57251 (0.0009) [2024-08-06 04:55:58,758][52666] DAMAGECOUNT value on done: 576600.0 [2024-08-06 04:55:58,759][52666] Sum rewards: 64.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.787', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.204', 'weapon4': '0.230', 'weapon2': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.916', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:59,696][52794] DAMAGECOUNT value on done: 572370.0 [2024-08-06 04:55:59,698][52794] Sum rewards: 70.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.186', 'AMMO4': '0.196', 'weapon2': '0.208', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.262', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '62.000'} [2024-08-06 04:55:59,883][52667] DAMAGECOUNT value on done: 578677.0 [2024-08-06 04:55:59,886][52667] Sum rewards: 66.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.805', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.442', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '56.000'} [2024-08-06 04:55:59,905][52647] DAMAGECOUNT value on done: 601465.0 [2024-08-06 04:55:59,908][52647] Sum rewards: 78.463, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.368', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon2': '0.256', 'WEAPON5': '0.300', 'weapon5': '0.320', 'weapon4': '0.366', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:00,412][52670] DAMAGECOUNT value on done: 574123.0 [2024-08-06 04:56:00,414][52670] Sum rewards: 63.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.126', 'AMMO4': '0.183', 'weapon5': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '54.000'} [2024-08-06 04:56:00,839][52820] DAMAGECOUNT value on done: 536932.0 [2024-08-06 04:56:00,840][52820] Sum rewards: 82.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.572', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.064', 'AMMO4': '0.176', 'weapon5': '0.176', 'AMMO3': '0.239', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '68.000'} [2024-08-06 04:56:01,108][52663] DAMAGECOUNT value on done: 571944.0 [2024-08-06 04:56:01,109][52663] Sum rewards: 75.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.394', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.146', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.786', 'WEAPON3': '1.000', 'weapon3': '2.598', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:01,393][52666] DAMAGECOUNT value on done: 577744.0 [2024-08-06 04:56:01,393][52666] Sum rewards: 76.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.122', 'AMMO3': '0.207', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:02,583][52667] DAMAGECOUNT value on done: 572335.0 [2024-08-06 04:56:02,586][52667] Sum rewards: 56.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon5': '0.146', 'weapon4': '0.174', 'AMMO3': '0.236', 'AMMO4': '0.298', 'WEAPON5': '0.450', 'weapon2': '0.510', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.640', 'weapon3': '2.832', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '49.000'} [2024-08-06 04:56:02,655][52647] DAMAGECOUNT value on done: 609751.0 [2024-08-06 04:56:02,656][52647] Sum rewards: 68.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.008', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.222', 'AMMO3': '0.227', 'AMMO4': '0.279', 'weapon5': '0.346', 'weapon2': '0.456', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.602', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:02,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 469073920. Throughput: 0: 4376.2. Samples: 117268140. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:56:02,795][52567] Avg episode reward: [(0, '72.917')] [2024-08-06 04:56:03,222][52650] Updated weights for policy 0, policy_version 57261 (0.0014) [2024-08-06 04:56:03,263][52670] DAMAGECOUNT value on done: 567820.0 [2024-08-06 04:56:03,263][52670] Sum rewards: 69.337, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.085', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.095', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.786', 'WEAPON3': '1.450', 'weapon3': '2.752', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:03,919][52820] DAMAGECOUNT value on done: 538825.0 [2024-08-06 04:56:03,919][52820] Sum rewards: 79.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.382', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.120', 'AMMO4': '0.155', 'AMMO3': '0.205', 'weapon2': '0.222', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '64.000'} [2024-08-06 04:56:04,134][52663] DAMAGECOUNT value on done: 576982.0 [2024-08-06 04:56:04,138][52663] Sum rewards: 83.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.199', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon5': '0.302', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.000'} [2024-08-06 04:56:04,471][52666] DAMAGECOUNT value on done: 575421.0 [2024-08-06 04:56:04,473][52666] Sum rewards: 62.957, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.720', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO4': '0.203', 'weapon4': '0.220', 'AMMO3': '0.304', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '2.932', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:05,281][52647] DAMAGECOUNT value on done: 608255.0 [2024-08-06 04:56:05,282][52647] Sum rewards: 66.475, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.107', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.290', 'WEAPON3': '1.650', 'HITCOUNT': '3.280', 'weapon3': '3.298', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:05,770][52667] DAMAGECOUNT value on done: 580855.0 [2024-08-06 04:56:05,770][52667] Sum rewards: 73.187, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.742', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.136', 'weapon4': '0.148', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.341', 'WEAPON3': '2.000', 'weapon3': '3.200', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '67.000'} [2024-08-06 04:56:06,012][52670] DAMAGECOUNT value on done: 565107.0 [2024-08-06 04:56:06,012][52670] Sum rewards: 73.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.176', 'weapon4': '0.184', 'AMMO3': '0.190', 'AMMO4': '0.208', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:07,085][52820] DAMAGECOUNT value on done: 535132.0 [2024-08-06 04:56:07,085][52820] Sum rewards: 88.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.013', 'AMMO2': '0.056', 'AMMO3': '0.165', 'weapon4': '0.170', 'weapon5': '0.192', 'AMMO4': '0.278', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.474', 'FRAGCOUNT': '70.000'} [2024-08-06 04:56:07,272][52666] DAMAGECOUNT value on done: 570232.0 [2024-08-06 04:56:07,273][52666] Sum rewards: 84.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.128', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.224', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '70.000'} [2024-08-06 04:56:07,450][52663] DAMAGECOUNT value on done: 581238.0 [2024-08-06 04:56:07,451][52663] Sum rewards: 78.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '66.000'} [2024-08-06 04:56:07,790][52650] Updated weights for policy 0, policy_version 57271 (0.0011) [2024-08-06 04:56:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 469164032. Throughput: 0: 4371.6. Samples: 117294090. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:56:07,794][52567] Avg episode reward: [(0, '73.291')] [2024-08-06 04:56:07,829][52647] DAMAGECOUNT value on done: 594398.0 [2024-08-06 04:56:07,829][52647] Sum rewards: 72.937, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.893', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.062', 'AMMO4': '0.116', 'weapon5': '0.162', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:08,062][52667] DAMAGECOUNT value on done: 583187.0 [2024-08-06 04:56:08,064][52667] Sum rewards: 57.159, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.761', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.192', 'weapon5': '0.196', 'AMMO4': '0.210', 'weapon2': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.010', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '45.000'} [2024-08-06 04:56:08,208][52811] DAMAGECOUNT value on done: 548927.0 [2024-08-06 04:56:08,209][52811] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.120', 'weapon5': '0.154', 'AMMO3': '0.213', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:09,107][52670] DAMAGECOUNT value on done: 579766.0 [2024-08-06 04:56:09,107][52670] Sum rewards: 77.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.066', 'weapon4': '0.104', 'AMMO4': '0.207', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '66.000'} [2024-08-06 04:56:10,145][52820] DAMAGECOUNT value on done: 535777.0 [2024-08-06 04:56:10,147][52820] Sum rewards: 73.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.985', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.122', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.550', 'HITCOUNT': '3.530', 'weapon3': '3.532', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:10,258][52666] DAMAGECOUNT value on done: 568450.0 [2024-08-06 04:56:10,259][52666] Sum rewards: 70.851, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.488', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.266', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:10,463][52647] DAMAGECOUNT value on done: 601714.0 [2024-08-06 04:56:10,464][52647] Sum rewards: 65.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.332', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.462', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '56.000'} [2024-08-06 04:56:10,627][52663] DAMAGECOUNT value on done: 574805.0 [2024-08-06 04:56:10,628][52663] Sum rewards: 67.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.770', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.100', 'weapon5': '0.196', 'AMMO3': '0.211', 'AMMO4': '0.227', 'weapon2': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:10,785][52667] DAMAGECOUNT value on done: 572060.0 [2024-08-06 04:56:10,785][52667] Sum rewards: 85.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.770', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.136', 'weapon2': '0.232', 'AMMO4': '0.249', 'AMMO3': '0.294', 'weapon5': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.850', 'weapon3': '2.986', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.306', 'FRAGCOUNT': '73.000'} [2024-08-06 04:56:11,326][52811] DAMAGECOUNT value on done: 532079.0 [2024-08-06 04:56:11,328][52811] Sum rewards: 68.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.224', 'weapon4': '0.294', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.270', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '56.000'} [2024-08-06 04:56:12,198][52670] DAMAGECOUNT value on done: 572767.0 [2024-08-06 04:56:12,198][52670] Sum rewards: 71.120, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.329', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.080', 'weapon4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:12,337][52650] Updated weights for policy 0, policy_version 57281 (0.0022) [2024-08-06 04:56:12,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 469245952. Throughput: 0: 4374.7. Samples: 117320580. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 04:56:12,802][52567] Avg episode reward: [(0, '73.351')] [2024-08-06 04:56:13,301][52663] DAMAGECOUNT value on done: 570140.0 [2024-08-06 04:56:13,303][52663] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.355', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.428', 'WEAPON3': '1.700', 'weapon3': '3.204', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:13,348][52820] DAMAGECOUNT value on done: 544348.0 [2024-08-06 04:56:13,349][52820] Sum rewards: 62.495, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.745', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.144', 'weapon4': '0.184', 'AMMO4': '0.185', 'weapon5': '0.202', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.012', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '49.500'} [2024-08-06 04:56:13,468][52647] DAMAGECOUNT value on done: 594183.0 [2024-08-06 04:56:13,468][52647] Sum rewards: 75.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.270', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon2': '0.206', 'AMMO3': '0.252', 'weapon5': '0.276', 'AMMO4': '0.287', 'weapon4': '0.350', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.826', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '65.000'} [2024-08-06 04:56:13,508][52666] DAMAGECOUNT value on done: 572709.0 [2024-08-06 04:56:13,508][52666] Sum rewards: 75.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.074', 'weapon4': '0.134', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:13,757][52667] DAMAGECOUNT value on done: 573408.0 [2024-08-06 04:56:13,760][52667] Sum rewards: 68.778, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.966', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.179', 'weapon4': '0.198', 'weapon2': '0.300', 'AMMO3': '0.301', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.050', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:14,515][52811] DAMAGECOUNT value on done: 531361.0 [2024-08-06 04:56:14,516][52811] Sum rewards: 67.026, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.035', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.188', 'weapon4': '0.196', 'weapon2': '0.220', 'AMMO4': '0.258', 'AMMO3': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.800', 'weapon3': '3.130', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:14,558][52649] DAMAGECOUNT value on done: 556940.0 [2024-08-06 04:56:14,559][52649] Sum rewards: 64.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.619', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.168', 'AMMO4': '0.189', 'AMMO3': '0.228', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.284', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '54.000'} [2024-08-06 04:56:15,497][52670] DAMAGECOUNT value on done: 561115.0 [2024-08-06 04:56:15,499][52670] Sum rewards: 66.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.078', 'AMMO3': '0.143', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '0.900', 'HITCOUNT': '3.020', 'weapon3': '3.076', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '52.000'} [2024-08-06 04:56:15,786][52647] DAMAGECOUNT value on done: 598421.0 [2024-08-06 04:56:15,786][52647] Sum rewards: 77.245, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.005', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon5': '0.096', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.664', 'WEAPON3': '1.000', 'weapon3': '3.090', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:16,246][52663] DAMAGECOUNT value on done: 566906.0 [2024-08-06 04:56:16,247][52663] Sum rewards: 77.639, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.268', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.094', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '67.000'} [2024-08-06 04:56:16,378][52820] DAMAGECOUNT value on done: 542282.0 [2024-08-06 04:56:16,379][52820] Sum rewards: 78.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.114', 'weapon5': '0.204', 'AMMO3': '0.206', 'AMMO4': '0.209', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:16,678][52666] DAMAGECOUNT value on done: 572364.0 [2024-08-06 04:56:16,679][52666] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.212', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.140', 'AMMO4': '0.184', 'weapon5': '0.194', 'weapon2': '0.238', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:16,767][52667] DAMAGECOUNT value on done: 581662.0 [2024-08-06 04:56:16,769][52667] Sum rewards: 66.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.017', 'AMMO2': '0.070', 'AMMO3': '0.243', 'weapon4': '0.250', 'weapon5': '0.252', 'AMMO4': '0.350', 'weapon2': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.716', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:17,235][52650] Updated weights for policy 0, policy_version 57291 (0.0011) [2024-08-06 04:56:17,279][52649] DAMAGECOUNT value on done: 549881.0 [2024-08-06 04:56:17,280][52649] Sum rewards: 77.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.880', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.142', 'weapon2': '0.194', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.232', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '64.000'} [2024-08-06 04:56:17,577][52811] DAMAGECOUNT value on done: 532396.0 [2024-08-06 04:56:17,578][52811] Sum rewards: 71.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.532', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon2': '0.216', 'weapon4': '0.240', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 469336064. Throughput: 0: 4371.6. Samples: 117333610. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:56:17,794][52567] Avg episode reward: [(0, '72.566')] [2024-08-06 04:56:18,457][52670] DAMAGECOUNT value on done: 569801.0 [2024-08-06 04:56:18,460][52670] Sum rewards: 68.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.225', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO4': '0.223', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.032', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:18,660][52668] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2024-08-06 04:56:19,111][52663] DAMAGECOUNT value on done: 574305.0 [2024-08-06 04:56:19,115][52663] Sum rewards: 80.580, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.128', 'HEALTH': '0.159', 'weapon2': '0.182', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON3': '1.100', 'weapon3': '3.240', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '65.000'} [2024-08-06 04:56:19,279][52667] DAMAGECOUNT value on done: 570871.0 [2024-08-06 04:56:19,281][52667] Sum rewards: 70.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.472', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:19,563][52820] DAMAGECOUNT value on done: 527729.0 [2024-08-06 04:56:19,563][52820] Sum rewards: 73.629, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.055', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.128', 'AMMO3': '0.135', 'weapon5': '0.156', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.584', 'WEAPON3': '0.800', 'weapon3': '3.034', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '56.500'} [2024-08-06 04:56:19,664][52666] DAMAGECOUNT value on done: 572447.0 [2024-08-06 04:56:19,668][52649] DAMAGECOUNT value on done: 569036.0 [2024-08-06 04:56:19,670][52666] Sum rewards: 80.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.134', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.130', 'weapon5': '0.160', 'AMMO4': '0.178', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '66.000'} [2024-08-06 04:56:19,670][52649] Sum rewards: 77.854, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON5': '0.350', 'weapon5': '0.356', 'HEALTH': '0.404', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '60.500'} [2024-08-06 04:56:20,784][52811] DAMAGECOUNT value on done: 540352.0 [2024-08-06 04:56:20,785][52811] Sum rewards: 71.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.434', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.266', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:21,581][52670] DAMAGECOUNT value on done: 568532.0 [2024-08-06 04:56:21,581][52670] Sum rewards: 68.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.951', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '56.500'} [2024-08-06 04:56:21,679][52664] DAMAGECOUNT value on done: 596979.0 [2024-08-06 04:56:21,680][52664] Sum rewards: 70.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.232', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:21,778][52650] Updated weights for policy 0, policy_version 57301 (0.0036) [2024-08-06 04:56:21,891][52663] DAMAGECOUNT value on done: 583351.0 [2024-08-06 04:56:21,892][52663] Sum rewards: 70.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.326', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.148', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:22,130][52649] DAMAGECOUNT value on done: 562335.0 [2024-08-06 04:56:22,130][52649] Sum rewards: 74.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.170', 'weapon2': '0.174', 'weapon5': '0.174', 'AMMO3': '0.202', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:22,250][52667] DAMAGECOUNT value on done: 581355.0 [2024-08-06 04:56:22,250][52667] Sum rewards: 76.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.097', 'weapon5': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '65.000'} [2024-08-06 04:56:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 469417984. Throughput: 0: 4373.3. Samples: 117359960. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:56:22,795][52567] Avg episode reward: [(0, '73.096')] [2024-08-06 04:56:22,909][52666] DAMAGECOUNT value on done: 567776.0 [2024-08-06 04:56:22,917][52666] Sum rewards: 75.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.880', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon4': '0.156', 'AMMO3': '0.194', 'weapon5': '0.242', 'AMMO4': '0.333', 'weapon2': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:24,020][52811] DAMAGECOUNT value on done: 544435.0 [2024-08-06 04:56:24,020][52811] Sum rewards: 68.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.044', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.194', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:24,437][52670] DAMAGECOUNT value on done: 567763.0 [2024-08-06 04:56:24,440][52670] Sum rewards: 86.226, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.265', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.482', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '69.000'} [2024-08-06 04:56:24,490][52664] DAMAGECOUNT value on done: 601394.0 [2024-08-06 04:56:24,490][52664] Sum rewards: 73.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.210', 'weapon4': '0.212', 'weapon5': '0.214', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:24,751][52667] DAMAGECOUNT value on done: 584105.0 [2024-08-06 04:56:24,753][52667] Sum rewards: 64.436, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.865', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.120', 'weapon2': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.404', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:24,809][52663] DAMAGECOUNT value on done: 568723.0 [2024-08-06 04:56:24,810][52663] Sum rewards: 68.072, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO3': '0.176', 'AMMO4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:25,069][52649] DAMAGECOUNT value on done: 551162.0 [2024-08-06 04:56:25,075][52649] Sum rewards: 66.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.072', 'weapon4': '0.108', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '56.000'} [2024-08-06 04:56:25,671][52666] DAMAGECOUNT value on done: 568607.0 [2024-08-06 04:56:25,674][52666] Sum rewards: 67.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.856', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.174', 'weapon5': '0.202', 'AMMO3': '0.217', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:26,231][52650] Updated weights for policy 0, policy_version 57311 (0.0035) [2024-08-06 04:56:27,001][52811] DAMAGECOUNT value on done: 541469.0 [2024-08-06 04:56:27,003][52811] Sum rewards: 72.532, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.082', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.092', 'AMMO3': '0.155', 'AMMO4': '0.195', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:27,436][52670] DAMAGECOUNT value on done: 573950.0 [2024-08-06 04:56:27,436][52670] Sum rewards: 76.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.175', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.176', 'weapon5': '0.212', 'AMMO4': '0.225', 'weapon4': '0.244', 'AMMO3': '0.261', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '65.000'} [2024-08-06 04:56:27,567][52660] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:27,619][52664] DAMAGECOUNT value on done: 599587.0 [2024-08-06 04:56:27,620][52664] Sum rewards: 60.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.063', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.100', 'AMMO3': '0.251', 'weapon2': '0.254', 'weapon5': '0.272', 'AMMO4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.080', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '52.000'} [2024-08-06 04:56:27,623][52667] DAMAGECOUNT value on done: 585661.0 [2024-08-06 04:56:27,625][52667] Sum rewards: 77.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.347', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.068', 'AMMO4': '0.084', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:27,761][52663] DAMAGECOUNT value on done: 565928.0 [2024-08-06 04:56:27,761][52663] Sum rewards: 52.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.157', 'AMMO4': '0.168', 'weapon5': '0.178', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.000', 'weapon3': '2.650', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '13.974', 'FRAGCOUNT': '44.000'} [2024-08-06 04:56:27,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 469508096. Throughput: 0: 4388.4. Samples: 117386440. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:56:27,795][52567] Avg episode reward: [(0, '72.815')] [2024-08-06 04:56:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057313_469508096.pth... [2024-08-06 04:56:27,962][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000056802_465321984.pth [2024-08-06 04:56:28,036][52649] DAMAGECOUNT value on done: 563922.0 [2024-08-06 04:56:28,037][52649] Sum rewards: 79.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.188', 'AMMO4': '0.196', 'AMMO3': '0.210', 'weapon5': '0.258', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '64.000'} [2024-08-06 04:56:28,717][52666] DAMAGECOUNT value on done: 564185.0 [2024-08-06 04:56:28,721][52666] Sum rewards: 67.676, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO3': '0.177', 'AMMO4': '0.182', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:29,176][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:30,081][52811] DAMAGECOUNT value on done: 535814.0 [2024-08-06 04:56:30,083][52811] Sum rewards: 74.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon4': '0.206', 'weapon2': '0.238', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:30,114][52670] DAMAGECOUNT value on done: 562176.0 [2024-08-06 04:56:30,115][52670] Sum rewards: 70.789, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.433', 'AMMO5': '0.011', 'AMMO2': '0.053', 'AMMO3': '0.126', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'weapon4': '0.422', 'weapon2': '0.498', 'WEAPON3': '0.800', 'weapon3': '2.750', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '53.500'} [2024-08-06 04:56:30,283][52664] DAMAGECOUNT value on done: 591854.0 [2024-08-06 04:56:30,284][52664] Sum rewards: 52.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.106', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.101', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '3.164', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '43.000'} [2024-08-06 04:56:30,394][52667] DAMAGECOUNT value on done: 583569.0 [2024-08-06 04:56:30,395][52667] Sum rewards: 86.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.315', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.198', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.003', 'FRAGCOUNT': '71.000'} [2024-08-06 04:56:30,647][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:31,269][52666] DAMAGECOUNT value on done: 575198.0 [2024-08-06 04:56:31,270][52666] Sum rewards: 66.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.210', 'weapon2': '0.302', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.258', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:31,285][52663] DAMAGECOUNT value on done: 568736.0 [2024-08-06 04:56:31,286][52663] Sum rewards: 68.138, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.414', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.646', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:31,288][52650] Updated weights for policy 0, policy_version 57321 (0.0023) [2024-08-06 04:56:31,510][52649] DAMAGECOUNT value on done: 559174.0 [2024-08-06 04:56:31,511][52649] Sum rewards: 70.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.116', 'weapon5': '0.152', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.244', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:32,794][52664] DAMAGECOUNT value on done: 598910.0 [2024-08-06 04:56:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 469598208. Throughput: 0: 4375.1. Samples: 117399200. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:56:32,796][52567] Avg episode reward: [(0, '72.524')] [2024-08-06 04:56:32,794][52664] Sum rewards: 85.683, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.807', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.110', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '68.000'} [2024-08-06 04:56:32,834][52667] DAMAGECOUNT value on done: 575123.0 [2024-08-06 04:56:32,834][52667] Sum rewards: 69.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.814', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.129', 'weapon4': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.326', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:32,913][52670] DAMAGECOUNT value on done: 569435.0 [2024-08-06 04:56:32,913][52670] Sum rewards: 67.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.130', 'weapon5': '0.162', 'AMMO3': '0.206', 'AMMO4': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:33,287][52811] DAMAGECOUNT value on done: 544914.0 [2024-08-06 04:56:33,287][52811] Sum rewards: 70.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.996', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.088', 'AMMO3': '0.181', 'weapon5': '0.198', 'AMMO4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:34,087][52669] DAMAGECOUNT value on done: 579590.0 [2024-08-06 04:56:34,088][52669] Sum rewards: 71.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.058', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:34,153][52666] DAMAGECOUNT value on done: 570365.0 [2024-08-06 04:56:34,155][52666] Sum rewards: 73.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.490', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:34,262][52663] DAMAGECOUNT value on done: 568599.0 [2024-08-06 04:56:34,263][52649] DAMAGECOUNT value on done: 561366.0 [2024-08-06 04:56:34,263][52663] Sum rewards: 90.321, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.178', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.212', 'HEALTH': '0.214', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '72.000'} [2024-08-06 04:56:34,264][52649] Sum rewards: 56.659, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.296', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.136', 'AMMO4': '0.257', 'AMMO3': '0.279', 'weapon5': '0.380', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.672', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '49.000'} [2024-08-06 04:56:35,535][52667] DAMAGECOUNT value on done: 583299.0 [2024-08-06 04:56:35,535][52667] Sum rewards: 60.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.378', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon5': '0.170', 'weapon4': '0.236', 'AMMO4': '0.241', 'AMMO3': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.822', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '53.500'} [2024-08-06 04:56:35,845][52664] DAMAGECOUNT value on done: 596932.0 [2024-08-06 04:56:35,847][52664] Sum rewards: 71.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.538', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.090', 'weapon5': '0.162', 'AMMO4': '0.177', 'weapon2': '0.220', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:35,883][52650] Updated weights for policy 0, policy_version 57331 (0.0020) [2024-08-06 04:56:35,973][52670] DAMAGECOUNT value on done: 577876.0 [2024-08-06 04:56:35,975][52670] Sum rewards: 77.060, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.896', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.060', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.364', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:36,322][52811] DAMAGECOUNT value on done: 539600.0 [2024-08-06 04:56:36,322][52811] Sum rewards: 70.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon2': '0.738', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:36,569][52669] DAMAGECOUNT value on done: 570042.0 [2024-08-06 04:56:36,570][52669] Sum rewards: 71.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.100', 'AMMO3': '0.206', 'weapon5': '0.228', 'AMMO4': '0.276', 'weapon2': '0.308', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:36,794][52663] DAMAGECOUNT value on done: 580552.0 [2024-08-06 04:56:36,795][52663] Sum rewards: 65.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon4': '0.202', 'weapon2': '0.266', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.318', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '54.000'} [2024-08-06 04:56:36,891][52666] DAMAGECOUNT value on done: 574121.0 [2024-08-06 04:56:36,894][52666] Sum rewards: 75.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'weapon2': '0.224', 'AMMO3': '0.232', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.456', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '64.000'} [2024-08-06 04:56:37,045][52649] DAMAGECOUNT value on done: 564345.0 [2024-08-06 04:56:37,045][52649] Sum rewards: 71.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.938', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.090', 'AMMO3': '0.146', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'weapon4': '0.282', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:37,743][52803] DAMAGECOUNT value on done: 536290.0 [2024-08-06 04:56:37,745][52803] Sum rewards: 69.962, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.440', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'weapon4': '0.100', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.292', 'AMMO3': '0.301', 'WEAPON3': '1.800', 'weapon3': '3.230', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 469688320. Throughput: 0: 4374.2. Samples: 117425460. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:56:37,795][52567] Avg episode reward: [(0, '71.762')] [2024-08-06 04:56:38,179][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:38,974][52670] DAMAGECOUNT value on done: 574262.0 [2024-08-06 04:56:38,974][52670] Sum rewards: 64.979, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.350', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.080', 'AMMO4': '0.198', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.315', 'WEAPON3': '1.900', 'HITCOUNT': '3.330', 'weapon3': '3.364', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:38,976][52664] DAMAGECOUNT value on done: 593296.0 [2024-08-06 04:56:38,977][52664] Sum rewards: 73.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.832', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.078', 'weapon5': '0.082', 'AMMO4': '0.129', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:38,995][52669] DAMAGECOUNT value on done: 580609.0 [2024-08-06 04:56:38,997][52669] Sum rewards: 66.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.169', 'weapon5': '0.284', 'AMMO4': '0.311', 'weapon4': '0.340', 'weapon2': '0.596', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '54.000'} [2024-08-06 04:56:39,047][52671] DAMAGECOUNT value on done: 583917.0 [2024-08-06 04:56:39,048][52671] Sum rewards: 72.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:39,192][52663] DAMAGECOUNT value on done: 569196.0 [2024-08-06 04:56:39,193][52663] Sum rewards: 79.113, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.081', 'weapon5': '0.144', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '64.000'} [2024-08-06 04:56:39,346][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:39,387][52649] DAMAGECOUNT value on done: 553803.0 [2024-08-06 04:56:39,387][52649] Sum rewards: 72.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'weapon4': '0.208', 'AMMO3': '0.224', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:39,402][52658] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:39,402][52811] DAMAGECOUNT value on done: 540975.0 [2024-08-06 04:56:39,405][52811] Sum rewards: 65.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.788', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.132', 'weapon5': '0.154', 'AMMO4': '0.160', 'AMMO3': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.700', 'weapon3': '2.976', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:40,193][52666] DAMAGECOUNT value on done: 568391.0 [2024-08-06 04:56:40,193][52666] Sum rewards: 66.583, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.173', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.502', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '54.000'} [2024-08-06 04:56:40,271][52650] Updated weights for policy 0, policy_version 57341 (0.0030) [2024-08-06 04:56:40,968][52803] DAMAGECOUNT value on done: 534827.0 [2024-08-06 04:56:40,973][52803] Sum rewards: 61.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.004', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.694', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.070', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '51.000'} [2024-08-06 04:56:41,039][52658] DAMAGECOUNT value on done: 577726.0 [2024-08-06 04:56:41,039][52658] Sum rewards: 76.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.985', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.132', 'weapon5': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:41,769][52669] DAMAGECOUNT value on done: 580575.0 [2024-08-06 04:56:41,772][52669] Sum rewards: 84.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.115', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '70.500'} [2024-08-06 04:56:41,789][52664] DAMAGECOUNT value on done: 590791.0 [2024-08-06 04:56:41,790][52664] Sum rewards: 77.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.911', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.130', 'AMMO4': '0.151', 'weapon5': '0.172', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:42,014][52663] DAMAGECOUNT value on done: 579464.0 [2024-08-06 04:56:42,015][52663] Sum rewards: 81.347, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.970', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.124', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.264', 'WEAPON3': '0.950', 'weapon3': '3.176', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:42,017][52670] DAMAGECOUNT value on done: 556627.0 [2024-08-06 04:56:42,018][52670] Sum rewards: 73.269, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.443', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.106', 'AMMO4': '0.170', 'weapon5': '0.172', 'weapon2': '0.250', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.174', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '64.000'} [2024-08-06 04:56:42,508][52671] DAMAGECOUNT value on done: 581885.0 [2024-08-06 04:56:42,509][52671] Sum rewards: 75.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.052', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:42,549][52649] DAMAGECOUNT value on done: 566033.0 [2024-08-06 04:56:42,551][52649] Sum rewards: 74.517, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.322', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.086', 'AMMO4': '0.136', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:42,590][52811] DAMAGECOUNT value on done: 547705.0 [2024-08-06 04:56:42,592][52811] Sum rewards: 65.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.252', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.136', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.078', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:42,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 469770240. Throughput: 0: 4374.2. Samples: 117451740. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:56:42,795][52567] Avg episode reward: [(0, '72.051')] [2024-08-06 04:56:43,200][52666] DAMAGECOUNT value on done: 571737.0 [2024-08-06 04:56:43,201][52666] Sum rewards: 71.880, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.976', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.098', 'AMMO3': '0.190', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:43,989][52658] DAMAGECOUNT value on done: 576098.0 [2024-08-06 04:56:43,989][52658] Sum rewards: 68.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:44,050][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:44,117][52664] DAMAGECOUNT value on done: 601181.0 [2024-08-06 04:56:44,117][52664] Sum rewards: 71.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.982', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.067', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.352', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:44,172][52803] DAMAGECOUNT value on done: 542130.0 [2024-08-06 04:56:44,175][52803] Sum rewards: 76.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.908', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.176', 'AMMO3': '0.227', 'weapon2': '0.686', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:44,674][52669] DAMAGECOUNT value on done: 574918.0 [2024-08-06 04:56:44,674][52669] Sum rewards: 73.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.201', 'AMMO5': '0.005', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.275', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:44,887][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:56:44,928][52663] DAMAGECOUNT value on done: 580087.0 [2024-08-06 04:56:44,928][52663] Sum rewards: 83.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.367', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.082', 'AMMO3': '0.192', 'AMMO4': '0.210', 'weapon5': '0.216', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '67.000'} [2024-08-06 04:56:45,014][52670] DAMAGECOUNT value on done: 568729.0 [2024-08-06 04:56:45,016][52670] Sum rewards: 63.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.220', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.116', 'AMMO4': '0.123', 'weapon2': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'WEAPON3': '1.850', 'HITCOUNT': '3.300', 'weapon3': '3.354', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '56.000'} [2024-08-06 04:56:45,289][52650] Updated weights for policy 0, policy_version 57351 (0.0028) [2024-08-06 04:56:45,600][52811] DAMAGECOUNT value on done: 536519.0 [2024-08-06 04:56:45,601][52811] Sum rewards: 66.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.432', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.153', 'AMMO3': '0.156', 'weapon2': '0.294', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '53.000'} [2024-08-06 04:56:45,636][52649] DAMAGECOUNT value on done: 570325.0 [2024-08-06 04:56:45,637][52649] Sum rewards: 78.999, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.274', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon5': '0.236', 'weapon2': '0.390', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:45,772][52671] DAMAGECOUNT value on done: 580445.0 [2024-08-06 04:56:45,773][52671] Sum rewards: 79.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.364', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.052', 'AMMO4': '0.170', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '66.500'} [2024-08-06 04:56:46,409][52666] DAMAGECOUNT value on done: 577394.0 [2024-08-06 04:56:46,409][52666] Sum rewards: 82.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.983', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO4': '0.167', 'AMMO3': '0.236', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '69.000'} [2024-08-06 04:56:46,692][52664] DAMAGECOUNT value on done: 593837.0 [2024-08-06 04:56:46,694][52664] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:47,219][52658] DAMAGECOUNT value on done: 582219.0 [2024-08-06 04:56:47,221][52658] Sum rewards: 81.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.219', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '67.500'} [2024-08-06 04:56:47,285][52803] DAMAGECOUNT value on done: 544981.0 [2024-08-06 04:56:47,286][52803] Sum rewards: 71.271, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.330', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.098', 'weapon4': '0.124', 'AMMO4': '0.224', 'weapon2': '0.248', 'AMMO3': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 469860352. Throughput: 0: 4369.8. Samples: 117464780. Policy #0 lag: (min: 1.0, avg: 4.0, max: 7.0) [2024-08-06 04:56:47,794][52567] Avg episode reward: [(0, '72.234')] [2024-08-06 04:56:47,827][52669] DAMAGECOUNT value on done: 581639.0 [2024-08-06 04:56:47,828][52669] Sum rewards: 72.444, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.530', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.132', 'weapon4': '0.134', 'WEAPON5': '0.150', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.296', 'WEAPON3': '1.800', 'weapon3': '3.274', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:48,147][52663] DAMAGECOUNT value on done: 570158.0 [2024-08-06 04:56:48,149][52663] Sum rewards: 54.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.792', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.116', 'AMMO4': '0.175', 'AMMO3': '0.238', 'weapon4': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.936', 'DAMAGECOUNT': '13.749', 'FRAGCOUNT': '48.000'} [2024-08-06 04:56:48,478][52670] DAMAGECOUNT value on done: 578509.0 [2024-08-06 04:56:48,482][52670] Sum rewards: 79.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.596', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.138', 'weapon5': '0.172', 'weapon2': '0.178', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '67.000'} [2024-08-06 04:56:48,535][52671] DAMAGECOUNT value on done: 580502.0 [2024-08-06 04:56:48,536][52671] Sum rewards: 57.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon4': '0.224', 'weapon5': '0.232', 'AMMO3': '0.250', 'AMMO4': '0.303', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.720', 'weapon3': '2.884', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '49.000'} [2024-08-06 04:56:48,764][52811] DAMAGECOUNT value on done: 531241.0 [2024-08-06 04:56:48,765][52811] Sum rewards: 67.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.168', 'weapon5': '0.170', 'weapon4': '0.280', 'weapon2': '0.310', 'AMMO4': '0.330', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 04:56:48,803][52649] DAMAGECOUNT value on done: 570437.0 [2024-08-06 04:56:48,804][52649] Sum rewards: 68.792, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.733', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.155', 'weapon5': '0.240', 'AMMO4': '0.322', 'weapon4': '0.382', 'weapon2': '0.506', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.638', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:49,084][52664] DAMAGECOUNT value on done: 602479.0 [2024-08-06 04:56:49,085][52664] Sum rewards: 71.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.009', 'weapon5': '0.034', 'AMMO2': '0.035', 'weapon4': '0.120', 'AMMO3': '0.162', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.100', 'weapon3': '3.348', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:49,572][52658] DAMAGECOUNT value on done: 581170.0 [2024-08-06 04:56:49,572][52658] Sum rewards: 72.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.164', 'weapon2': '0.194', 'AMMO3': '0.206', 'weapon5': '0.218', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '60.000'} [2024-08-06 04:56:49,646][52666] DAMAGECOUNT value on done: 560693.0 [2024-08-06 04:56:49,649][52666] Sum rewards: 72.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.891', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.187', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:49,847][52650] Updated weights for policy 0, policy_version 57361 (0.0012) [2024-08-06 04:56:50,373][52803] DAMAGECOUNT value on done: 538133.0 [2024-08-06 04:56:50,373][52803] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.290', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:50,926][52669] DAMAGECOUNT value on done: 578241.0 [2024-08-06 04:56:50,926][52669] Sum rewards: 58.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.765', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.126', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'weapon4': '0.260', 'WEAPON3': '1.050', 'HITCOUNT': '2.880', 'weapon3': '3.192', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '48.000'} [2024-08-06 04:56:51,277][52667] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:51,474][52671] DAMAGECOUNT value on done: 591280.0 [2024-08-06 04:56:51,476][52671] Sum rewards: 68.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon2': '0.180', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '56.000'} [2024-08-06 04:56:51,557][52664] DAMAGECOUNT value on done: 602146.0 [2024-08-06 04:56:51,560][52664] Sum rewards: 66.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.442', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.110', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.292', 'WEAPON4': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:51,629][52670] DAMAGECOUNT value on done: 567779.0 [2024-08-06 04:56:51,631][52670] Sum rewards: 69.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.747', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.070', 'weapon5': '0.130', 'AMMO4': '0.218', 'AMMO3': '0.218', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.318', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:51,845][52811] DAMAGECOUNT value on done: 537942.0 [2024-08-06 04:56:51,846][52811] Sum rewards: 63.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.202', 'weapon5': '0.230', 'weapon4': '0.332', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '51.000'} [2024-08-06 04:56:52,018][52649] DAMAGECOUNT value on done: 567281.0 [2024-08-06 04:56:52,019][52649] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.946', 'AMMO5': '0.014', 'AMMO2': '0.074', 'weapon5': '0.188', 'weapon2': '0.258', 'weapon4': '0.264', 'AMMO3': '0.281', 'AMMO4': '0.369', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '55.500'} [2024-08-06 04:56:52,206][52658] DAMAGECOUNT value on done: 569638.0 [2024-08-06 04:56:52,208][52658] Sum rewards: 65.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'AMMO2': '0.029', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon5': '0.162', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.352', 'weapon4': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.584', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '53.000'} [2024-08-06 04:56:52,729][52666] DAMAGECOUNT value on done: 570358.0 [2024-08-06 04:56:52,729][52666] Sum rewards: 73.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.132', 'AMMO4': '0.199', 'AMMO3': '0.224', 'weapon2': '0.292', 'weapon5': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '60.500'} [2024-08-06 04:56:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 469950464. Throughput: 0: 4384.7. Samples: 117491400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:56:52,794][52567] Avg episode reward: [(0, '71.451')] [2024-08-06 04:56:53,481][52803] DAMAGECOUNT value on done: 531387.0 [2024-08-06 04:56:53,481][52803] Sum rewards: 65.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.322', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.132', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '54.000'} [2024-08-06 04:56:53,711][52669] DAMAGECOUNT value on done: 577464.0 [2024-08-06 04:56:53,712][52669] Sum rewards: 77.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO5': '0.014', 'AMMO2': '0.057', 'AMMO3': '0.213', 'weapon5': '0.226', 'AMMO4': '0.286', 'weapon2': '0.302', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.796', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '63.000'} [2024-08-06 04:56:54,313][52670] DAMAGECOUNT value on done: 573550.0 [2024-08-06 04:56:54,321][52670] Sum rewards: 61.104, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO4': '0.209', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.086', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2024-08-06 04:56:54,560][52650] Updated weights for policy 0, policy_version 57371 (0.0040) [2024-08-06 04:56:54,587][52671] DAMAGECOUNT value on done: 582065.0 [2024-08-06 04:56:54,588][52671] Sum rewards: 75.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.335', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.101', 'weapon5': '0.104', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.150', 'weapon3': '3.374', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '61.000'} [2024-08-06 04:56:54,652][52664] DAMAGECOUNT value on done: 604810.0 [2024-08-06 04:56:54,652][52664] Sum rewards: 63.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.725', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.204', 'weapon2': '0.206', 'AMMO3': '0.248', 'weapon5': '0.290', 'AMMO4': '0.297', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.490', 'weapon3': '3.022', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '55.000'} [2024-08-06 04:56:54,854][52658] DAMAGECOUNT value on done: 573101.0 [2024-08-06 04:56:54,858][52658] Sum rewards: 66.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.504', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.162', 'AMMO3': '0.168', 'weapon5': '0.212', 'AMMO4': '0.254', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.706', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '53.000'} [2024-08-06 04:56:54,995][52811] DAMAGECOUNT value on done: 538795.0 [2024-08-06 04:56:54,996][52811] Sum rewards: 87.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.174', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon5': '0.090', 'weapon4': '0.166', 'AMMO3': '0.223', 'AMMO4': '0.299', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '73.000'} [2024-08-06 04:56:55,020][52649] DAMAGECOUNT value on done: 558055.0 [2024-08-06 04:56:55,020][52649] Sum rewards: 74.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.240', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '62.000'} [2024-08-06 04:56:56,270][52669] DAMAGECOUNT value on done: 586479.0 [2024-08-06 04:56:56,270][52669] Sum rewards: 73.410, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.820', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.062', 'weapon4': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.207', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '64.000'} [2024-08-06 04:56:56,627][52803] DAMAGECOUNT value on done: 533080.0 [2024-08-06 04:56:56,629][52803] Sum rewards: 58.754, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.478', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.222', 'weapon2': '0.226', 'weapon5': '0.270', 'AMMO4': '0.288', 'AMMO3': '0.333', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.850', 'HITCOUNT': '2.850', 'weapon3': '2.862', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '53.000'} [2024-08-06 04:56:57,026][52671] DAMAGECOUNT value on done: 586945.0 [2024-08-06 04:56:57,028][52671] Sum rewards: 74.767, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.055', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.090', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:57,477][52668] DAMAGECOUNT value on done: 577642.0 [2024-08-06 04:56:57,481][52668] Sum rewards: 73.310, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.242', 'AMMO3': '0.272', 'weapon4': '0.298', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.804', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '62.500'} [2024-08-06 04:56:57,677][52664] DAMAGECOUNT value on done: 604682.0 [2024-08-06 04:56:57,678][52664] Sum rewards: 68.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.196', 'weapon4': '0.220', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.942', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '57.000'} [2024-08-06 04:56:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 470032384. Throughput: 0: 4376.0. Samples: 117517500. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:56:57,794][52567] Avg episode reward: [(0, '71.077')] [2024-08-06 04:56:57,892][52658] DAMAGECOUNT value on done: 581286.0 [2024-08-06 04:56:57,893][52658] Sum rewards: 74.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.816', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.166', 'weapon5': '0.206', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.410', 'weapon2': '0.466', 'WEAPON3': '0.950', 'weapon3': '2.700', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '58.500'} [2024-08-06 04:56:57,996][52811] DAMAGECOUNT value on done: 540659.0 [2024-08-06 04:56:58,000][52811] Sum rewards: 60.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.942', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.422', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '52.000'} [2024-08-06 04:56:58,313][52649] DAMAGECOUNT value on done: 565874.0 [2024-08-06 04:56:58,314][52649] Sum rewards: 66.948, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.765', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.134', 'AMMO4': '0.217', 'weapon5': '0.250', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.862', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '58.000'} [2024-08-06 04:56:59,231][52650] Updated weights for policy 0, policy_version 57381 (0.0010) [2024-08-06 04:56:59,310][52669] DAMAGECOUNT value on done: 578228.0 [2024-08-06 04:56:59,321][52669] Sum rewards: 72.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.071', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.844', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '59.000'} [2024-08-06 04:56:59,418][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:56:59,695][52803] DAMAGECOUNT value on done: 529892.0 [2024-08-06 04:56:59,698][52803] Sum rewards: 67.032, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.842', 'AMMO5': '0.026', 'AMMO2': '0.098', 'AMMO3': '0.202', 'weapon5': '0.294', 'weapon2': '0.322', 'weapon4': '0.346', 'AMMO4': '0.489', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '57.000'} [2024-08-06 04:57:00,027][52671] DAMAGECOUNT value on done: 581328.0 [2024-08-06 04:57:00,028][52671] Sum rewards: 70.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.084', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.213', 'weapon5': '0.218', 'AMMO4': '0.230', 'weapon2': '0.346', 'weapon4': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '57.000'} [2024-08-06 04:57:00,283][52664] DAMAGECOUNT value on done: 605689.0 [2024-08-06 04:57:00,285][52664] Sum rewards: 71.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.110', 'AMMO5': '0.021', 'AMMO2': '0.079', 'AMMO3': '0.264', 'weapon4': '0.264', 'weapon2': '0.298', 'weapon5': '0.388', 'AMMO4': '0.397', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.692', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:00,694][52668] DAMAGECOUNT value on done: 579683.0 [2024-08-06 04:57:00,694][52668] Sum rewards: 61.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.408', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.084', 'AMMO3': '0.174', 'weapon5': '0.186', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '3.086', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '50.000'} [2024-08-06 04:57:00,808][52658] DAMAGECOUNT value on done: 572832.0 [2024-08-06 04:57:00,808][52658] Sum rewards: 59.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.254', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.080', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '48.000'} [2024-08-06 04:57:01,295][52811] DAMAGECOUNT value on done: 544104.0 [2024-08-06 04:57:01,295][52811] Sum rewards: 81.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.374', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.162', 'AMMO4': '0.199', 'AMMO3': '0.213', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '66.000'} [2024-08-06 04:57:01,453][52649] DAMAGECOUNT value on done: 554861.0 [2024-08-06 04:57:01,456][52649] Sum rewards: 73.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.222', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO4': '0.045', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.482', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:01,522][52794] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:57:01,906][52669] DAMAGECOUNT value on done: 583675.0 [2024-08-06 04:57:01,906][52669] Sum rewards: 83.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.687', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.174', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'weapon3': '3.572', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '69.000'} [2024-08-06 04:57:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 470122496. Throughput: 0: 4374.9. Samples: 117530480. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:57:02,794][52567] Avg episode reward: [(0, '71.152')] [2024-08-06 04:57:02,844][52803] DAMAGECOUNT value on done: 536203.0 [2024-08-06 04:57:02,845][52803] Sum rewards: 67.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.222', 'AMMO4': '0.228', 'weapon5': '0.262', 'weapon2': '0.304', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.696', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '56.000'} [2024-08-06 04:57:02,850][52664] DAMAGECOUNT value on done: 598203.0 [2024-08-06 04:57:02,850][52664] Sum rewards: 81.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.220', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '66.000'} [2024-08-06 04:57:03,084][52671] DAMAGECOUNT value on done: 573906.0 [2024-08-06 04:57:03,085][52671] Sum rewards: 70.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.078', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.180', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.338', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.598', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '58.000'} [2024-08-06 04:57:03,601][52668] DAMAGECOUNT value on done: 579779.0 [2024-08-06 04:57:03,602][52668] Sum rewards: 83.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.414', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon2': '0.176', 'weapon5': '0.222', 'AMMO4': '0.235', 'AMMO3': '0.240', 'weapon4': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '21.540', 'FRAGCOUNT': '67.000'} [2024-08-06 04:57:03,839][52650] Updated weights for policy 0, policy_version 57391 (0.0011) [2024-08-06 04:57:03,973][52658] DAMAGECOUNT value on done: 592027.0 [2024-08-06 04:57:03,974][52658] Sum rewards: 81.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.956', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.081', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '67.000'} [2024-08-06 04:57:04,229][52649] DAMAGECOUNT value on done: 565579.0 [2024-08-06 04:57:04,230][52649] Sum rewards: 68.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.843', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.136', 'weapon5': '0.148', 'AMMO3': '0.190', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.274', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '56.000'} [2024-08-06 04:57:04,414][52811] DAMAGECOUNT value on done: 536764.0 [2024-08-06 04:57:04,422][52811] Sum rewards: 79.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.175', 'AMMO3': '0.226', 'weapon2': '0.228', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2024-08-06 04:57:05,091][52669] DAMAGECOUNT value on done: 583338.0 [2024-08-06 04:57:05,091][52669] Sum rewards: 78.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.219', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'weapon2': '0.260', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.308', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '68.000'} [2024-08-06 04:57:05,279][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:57:05,629][52662] DAMAGECOUNT value on done: 583899.0 [2024-08-06 04:57:05,630][52662] Sum rewards: 75.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.086', 'weapon5': '0.212', 'AMMO4': '0.280', 'weapon2': '0.284', 'AMMO3': '0.285', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.094', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:05,878][52803] DAMAGECOUNT value on done: 529595.0 [2024-08-06 04:57:05,880][52803] Sum rewards: 71.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.160', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.414', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.752', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:05,936][52671] DAMAGECOUNT value on done: 581873.0 [2024-08-06 04:57:05,937][52671] Sum rewards: 69.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.154', 'AMMO4': '0.191', 'AMMO3': '0.214', 'weapon5': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '56.000'} [2024-08-06 04:57:06,035][52664] DAMAGECOUNT value on done: 592779.0 [2024-08-06 04:57:06,036][52664] Sum rewards: 73.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.112', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '58.000'} [2024-08-06 04:57:06,047][52668] DAMAGECOUNT value on done: 580800.0 [2024-08-06 04:57:06,047][52668] Sum rewards: 75.905, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.544', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.104', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon2': '0.302', 'WEAPON3': '1.750', 'weapon3': '3.170', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '66.500'} [2024-08-06 04:57:06,794][52649] DAMAGECOUNT value on done: 567959.0 [2024-08-06 04:57:06,795][52649] Sum rewards: 71.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '58.000'} [2024-08-06 04:57:07,091][52658] DAMAGECOUNT value on done: 576752.0 [2024-08-06 04:57:07,093][52658] Sum rewards: 76.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.099', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '63.000'} [2024-08-06 04:57:07,532][52811] DAMAGECOUNT value on done: 535535.0 [2024-08-06 04:57:07,536][52811] Sum rewards: 64.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon4': '0.072', 'AMMO3': '0.163', 'weapon5': '0.192', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '52.000'} [2024-08-06 04:57:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 470212608. Throughput: 0: 4373.5. Samples: 117556770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:57:07,795][52567] Avg episode reward: [(0, '71.709')] [2024-08-06 04:57:08,248][52669] DAMAGECOUNT value on done: 569768.0 [2024-08-06 04:57:08,249][52669] Sum rewards: 77.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.184', 'AMMO3': '0.216', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '64.500'} [2024-08-06 04:57:08,614][52662] DAMAGECOUNT value on done: 579519.0 [2024-08-06 04:57:08,614][52662] Sum rewards: 70.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.175', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.090', 'AMMO4': '0.112', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '58.000'} [2024-08-06 04:57:08,645][52650] Updated weights for policy 0, policy_version 57401 (0.0014) [2024-08-06 04:57:08,723][52671] DAMAGECOUNT value on done: 581539.0 [2024-08-06 04:57:08,724][52671] Sum rewards: 79.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.964', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.116', 'AMMO4': '0.125', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.350', 'weapon3': '3.364', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '65.000'} [2024-08-06 04:57:08,829][52668] DAMAGECOUNT value on done: 568593.0 [2024-08-06 04:57:08,829][52668] Sum rewards: 59.021, reward structure: {'DEATHCOUNT': '-6.000', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO3': '0.085', 'HEALTH': '0.112', 'AMMO4': '0.153', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'WEAPON3': '0.500', 'weapon2': '0.918', 'HITCOUNT': '2.600', 'weapon3': '2.628', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '42.500'} [2024-08-06 04:57:09,044][52803] DAMAGECOUNT value on done: 549236.0 [2024-08-06 04:57:09,045][52803] Sum rewards: 96.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.131', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '4.330', 'DAMAGECOUNT': '22.602', 'FRAGCOUNT': '78.000'} [2024-08-06 04:57:09,231][52649] DAMAGECOUNT value on done: 561121.0 [2024-08-06 04:57:09,233][52649] Sum rewards: 80.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.121', 'weapon2': '0.142', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '64.000'} [2024-08-06 04:57:09,241][52664] DAMAGECOUNT value on done: 598045.0 [2024-08-06 04:57:09,241][52664] Sum rewards: 76.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.129', 'weapon4': '0.172', 'AMMO3': '0.192', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:10,352][52658] DAMAGECOUNT value on done: 590014.0 [2024-08-06 04:57:10,360][52658] Sum rewards: 85.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.442', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '71.000'} [2024-08-06 04:57:10,781][52669] DAMAGECOUNT value on done: 576838.0 [2024-08-06 04:57:10,781][52669] Sum rewards: 78.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.905', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.096', 'weapon5': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.650', 'weapon3': '2.934', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '67.500'} [2024-08-06 04:57:11,423][52662] DAMAGECOUNT value on done: 584365.0 [2024-08-06 04:57:11,424][52662] Sum rewards: 73.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.456', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.200', 'AMMO4': '0.221', 'weapon2': '0.222', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.224', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:11,800][52668] DAMAGECOUNT value on done: 582842.0 [2024-08-06 04:57:11,800][52668] Sum rewards: 53.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.681', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.187', 'AMMO4': '0.241', 'weapon5': '0.252', 'weapon2': '0.268', 'weapon4': '0.346', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '43.000'} [2024-08-06 04:57:11,866][52671] DAMAGECOUNT value on done: 578619.0 [2024-08-06 04:57:11,866][52671] Sum rewards: 71.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.774', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.141', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.212', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.198', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '57.500'} [2024-08-06 04:57:12,157][52803] DAMAGECOUNT value on done: 536795.0 [2024-08-06 04:57:12,157][52803] Sum rewards: 71.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.645', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.175', 'AMMO4': '0.186', 'weapon5': '0.286', 'weapon4': '0.392', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.600', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:12,478][52664] DAMAGECOUNT value on done: 597708.0 [2024-08-06 04:57:12,479][52664] Sum rewards: 71.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.138', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 470302720. Throughput: 0: 4367.6. Samples: 117582980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:57:12,794][52567] Avg episode reward: [(0, '72.125')] [2024-08-06 04:57:12,905][52658] DAMAGECOUNT value on done: 575033.0 [2024-08-06 04:57:12,905][52658] Sum rewards: 86.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.124', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon2': '0.180', 'AMMO3': '0.196', 'AMMO4': '0.196', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '69.000'} [2024-08-06 04:57:13,096][52650] Updated weights for policy 0, policy_version 57411 (0.0012) [2024-08-06 04:57:13,625][52669] DAMAGECOUNT value on done: 580805.0 [2024-08-06 04:57:13,627][52669] Sum rewards: 83.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.525', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon2': '0.170', 'weapon5': '0.178', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '68.000'} [2024-08-06 04:57:14,209][52671] DAMAGECOUNT value on done: 586909.0 [2024-08-06 04:57:14,211][52671] Sum rewards: 65.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.984', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.134', 'AMMO4': '0.195', 'weapon5': '0.204', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.776', 'WEAPON3': '1.250', 'weapon3': '2.646', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '53.000'} [2024-08-06 04:57:14,660][52662] DAMAGECOUNT value on done: 571444.0 [2024-08-06 04:57:14,661][52662] Sum rewards: 65.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.608', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.181', 'weapon4': '0.210', 'AMMO4': '0.247', 'weapon5': '0.258', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 04:57:14,781][52668] DAMAGECOUNT value on done: 578992.0 [2024-08-06 04:57:14,783][52668] Sum rewards: 55.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.600', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.088', 'weapon5': '0.202', 'AMMO3': '0.242', 'AMMO4': '0.255', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.770', 'weapon3': '3.020', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '47.000'} [2024-08-06 04:57:15,089][52803] DAMAGECOUNT value on done: 533538.0 [2024-08-06 04:57:15,091][52803] Sum rewards: 84.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.118', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.330', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '69.000'} [2024-08-06 04:57:15,354][52664] DAMAGECOUNT value on done: 596791.0 [2024-08-06 04:57:15,355][52664] Sum rewards: 74.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.112', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.111', 'AMMO3': '0.211', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '61.000'} [2024-08-06 04:57:15,924][52658] DAMAGECOUNT value on done: 582321.0 [2024-08-06 04:57:15,925][52658] Sum rewards: 74.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.158', 'AMMO3': '0.219', 'AMMO4': '0.233', 'weapon2': '0.272', 'weapon4': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:16,206][52669] DAMAGECOUNT value on done: 597936.0 [2024-08-06 04:57:16,208][52669] Sum rewards: 76.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.004', 'weapon4': '0.022', 'AMMO2': '0.035', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '65.000'} [2024-08-06 04:57:17,030][52671] DAMAGECOUNT value on done: 580657.0 [2024-08-06 04:57:17,035][52671] Sum rewards: 60.507, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.360', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO4': '0.235', 'AMMO3': '0.269', 'weapon5': '0.276', 'weapon4': '0.390', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.460', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '53.000'} [2024-08-06 04:57:17,772][52650] Updated weights for policy 0, policy_version 57421 (0.0011) [2024-08-06 04:57:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 470392832. Throughput: 0: 4380.6. Samples: 117596330. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:57:17,795][52567] Avg episode reward: [(0, '72.005')] [2024-08-06 04:57:17,822][52662] DAMAGECOUNT value on done: 585902.0 [2024-08-06 04:57:17,822][52662] Sum rewards: 73.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.042', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.226', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:17,954][52668] DAMAGECOUNT value on done: 570419.0 [2024-08-06 04:57:17,955][52668] Sum rewards: 70.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.152', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.188', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '57.000'} [2024-08-06 04:57:18,156][52803] DAMAGECOUNT value on done: 548051.0 [2024-08-06 04:57:18,156][52803] Sum rewards: 61.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.180', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.206', 'AMMO3': '0.257', 'weapon2': '0.276', 'weapon5': '0.294', 'AMMO4': '0.326', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.650', 'HITCOUNT': '2.720', 'weapon3': '2.878', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '54.000'} [2024-08-06 04:57:18,659][52658] DAMAGECOUNT value on done: 573676.0 [2024-08-06 04:57:18,661][52658] Sum rewards: 81.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.432', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.124', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '67.000'} [2024-08-06 04:57:19,193][52669] DAMAGECOUNT value on done: 585436.0 [2024-08-06 04:57:19,195][52669] Sum rewards: 71.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.612', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:20,007][52671] DAMAGECOUNT value on done: 567241.0 [2024-08-06 04:57:20,009][52671] Sum rewards: 70.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.651', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO4': '0.228', 'AMMO3': '0.239', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:20,584][52662] DAMAGECOUNT value on done: 574061.0 [2024-08-06 04:57:20,587][52662] Sum rewards: 65.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.180', 'AMMO4': '0.181', 'AMMO3': '0.197', 'weapon2': '0.210', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '54.000'} [2024-08-06 04:57:20,851][52668] DAMAGECOUNT value on done: 573173.0 [2024-08-06 04:57:20,852][52668] Sum rewards: 62.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.402', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.198', 'AMMO4': '0.210', 'AMMO3': '0.228', 'weapon5': '0.248', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 04:57:21,157][52803] DAMAGECOUNT value on done: 537735.0 [2024-08-06 04:57:21,158][52803] Sum rewards: 59.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.506', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.125', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.122', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '49.000'} [2024-08-06 04:57:21,341][52658] DAMAGECOUNT value on done: 580050.0 [2024-08-06 04:57:21,343][52658] Sum rewards: 55.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.178', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.182', 'AMMO4': '0.197', 'weapon5': '0.268', 'AMMO3': '0.269', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.895', 'FRAGCOUNT': '49.000'} [2024-08-06 04:57:22,338][52669] DAMAGECOUNT value on done: 584080.0 [2024-08-06 04:57:22,338][52669] Sum rewards: 67.808, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.230', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.104', 'weapon4': '0.126', 'AMMO4': '0.193', 'weapon2': '0.316', 'AMMO3': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '2.000', 'weapon3': '3.132', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '63.000'} [2024-08-06 04:57:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 470466560. Throughput: 0: 4379.4. Samples: 117622530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 04:57:22,794][52567] Avg episode reward: [(0, '71.502')] [2024-08-06 04:57:22,820][52650] Updated weights for policy 0, policy_version 57431 (0.0021) [2024-08-06 04:57:22,847][52671] DAMAGECOUNT value on done: 588086.0 [2024-08-06 04:57:22,848][52671] Sum rewards: 76.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.123', 'weapon5': '0.166', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '64.500'} [2024-08-06 04:57:23,646][52662] DAMAGECOUNT value on done: 584435.0 [2024-08-06 04:57:23,648][52662] Sum rewards: 69.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.378', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.170', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '2.914', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:23,961][52668] DAMAGECOUNT value on done: 582788.0 [2024-08-06 04:57:23,961][52668] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.757', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.095', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.262', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:24,160][52658] DAMAGECOUNT value on done: 568534.0 [2024-08-06 04:57:24,160][52658] Sum rewards: 81.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.346', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.386', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '68.000'} [2024-08-06 04:57:24,219][52803] DAMAGECOUNT value on done: 534929.0 [2024-08-06 04:57:24,221][52803] Sum rewards: 75.002, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.693', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.098', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'weapon2': '0.318', 'WEAPON3': '1.800', 'weapon3': '3.222', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '67.000'} [2024-08-06 04:57:25,138][52669] DAMAGECOUNT value on done: 584726.0 [2024-08-06 04:57:25,140][52669] Sum rewards: 79.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO3': '0.232', 'weapon2': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.506', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '66.000'} [2024-08-06 04:57:25,584][52671] DAMAGECOUNT value on done: 585801.0 [2024-08-06 04:57:25,592][52671] Sum rewards: 69.714, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'weapon4': '0.022', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.249', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.440', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:26,598][52662] DAMAGECOUNT value on done: 586206.0 [2024-08-06 04:57:26,600][52662] Sum rewards: 81.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.030', 'AMMO2': '0.003', 'AMMO5': '0.004', 'AMMO4': '0.014', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.246', 'weapon2': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '69.000'} [2024-08-06 04:57:27,073][52658] DAMAGECOUNT value on done: 583852.0 [2024-08-06 04:57:27,075][52658] Sum rewards: 74.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.209', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.462', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:27,200][52650] Updated weights for policy 0, policy_version 57441 (0.0014) [2024-08-06 04:57:27,239][52660] DAMAGECOUNT value on done: 578142.0 [2024-08-06 04:57:27,242][52660] Sum rewards: 66.309, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.388', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO3': '0.162', 'AMMO4': '0.176', 'weapon2': '0.304', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '3.478', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '54.000'} [2024-08-06 04:57:27,256][52668] DAMAGECOUNT value on done: 579460.0 [2024-08-06 04:57:27,257][52668] Sum rewards: 82.867, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'weapon4': '0.212', 'weapon2': '0.392', 'WEAPON3': '1.000', 'weapon3': '3.122', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '65.000'} [2024-08-06 04:57:27,370][52803] DAMAGECOUNT value on done: 540312.0 [2024-08-06 04:57:27,370][52803] Sum rewards: 74.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.043', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.340', 'weapon3': '3.386', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '64.000'} [2024-08-06 04:57:27,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 470564864. Throughput: 0: 4374.7. Samples: 117648600. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:57:27,794][52567] Avg episode reward: [(0, '71.894')] [2024-08-06 04:57:28,138][52669] DAMAGECOUNT value on done: 589694.0 [2024-08-06 04:57:28,140][52669] Sum rewards: 84.615, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.074', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.244', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.453', 'FRAGCOUNT': '71.000'} [2024-08-06 04:57:28,518][52671] DAMAGECOUNT value on done: 582987.0 [2024-08-06 04:57:28,520][52671] Sum rewards: 74.618, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.351', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.134', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.638', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:29,540][52662] DAMAGECOUNT value on done: 576789.0 [2024-08-06 04:57:29,540][52662] Sum rewards: 76.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.128', 'AMMO4': '0.175', 'weapon2': '0.196', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.356', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '63.000'} [2024-08-06 04:57:29,559][52658] DAMAGECOUNT value on done: 575336.0 [2024-08-06 04:57:29,559][52658] Sum rewards: 76.148, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.834', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.038', 'weapon4': '0.048', 'AMMO4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.444', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '64.500'} [2024-08-06 04:57:29,684][52668] DAMAGECOUNT value on done: 570660.0 [2024-08-06 04:57:29,684][52668] Sum rewards: 71.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.984', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO4': '0.175', 'weapon5': '0.180', 'weapon2': '0.214', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:29,685][52660] DAMAGECOUNT value on done: 569287.0 [2024-08-06 04:57:29,686][52660] Sum rewards: 83.009, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.670', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.304', 'WEAPON3': '1.850', 'weapon3': '3.332', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '73.000'} [2024-08-06 04:57:30,637][52803] DAMAGECOUNT value on done: 539376.0 [2024-08-06 04:57:30,645][52803] Sum rewards: 63.894, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.021', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.058', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.281', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.208', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '57.000'} [2024-08-06 04:57:31,344][52671] DAMAGECOUNT value on done: 582227.0 [2024-08-06 04:57:31,345][52671] Sum rewards: 81.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.582', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.178', 'weapon2': '0.180', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.382', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '68.000'} [2024-08-06 04:57:32,187][52650] Updated weights for policy 0, policy_version 57451 (0.0012) [2024-08-06 04:57:32,321][52668] DAMAGECOUNT value on done: 563602.0 [2024-08-06 04:57:32,322][52668] Sum rewards: 81.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.096', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '68.000'} [2024-08-06 04:57:32,324][52660] DAMAGECOUNT value on done: 580635.0 [2024-08-06 04:57:32,328][52660] Sum rewards: 78.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.579', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.170', 'weapon5': '0.190', 'AMMO4': '0.202', 'AMMO3': '0.291', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.990', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '67.000'} [2024-08-06 04:57:32,648][52658] DAMAGECOUNT value on done: 574763.0 [2024-08-06 04:57:32,648][52658] Sum rewards: 69.698, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.068', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.147', 'weapon4': '0.180', 'weapon2': '0.234', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.166', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:32,785][52662] DAMAGECOUNT value on done: 587437.0 [2024-08-06 04:57:32,786][52662] Sum rewards: 70.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.612', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.241', 'weapon2': '0.248', 'WEAPON3': '1.400', 'HITCOUNT': '3.530', 'weapon3': '3.586', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:32,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 470654976. Throughput: 0: 4377.3. Samples: 117661760. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:57:32,794][52567] Avg episode reward: [(0, '72.866')] [2024-08-06 04:57:33,733][52803] DAMAGECOUNT value on done: 545868.0 [2024-08-06 04:57:33,734][52803] Sum rewards: 76.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.015', 'AMMO2': '0.058', 'AMMO3': '0.213', 'weapon5': '0.216', 'weapon4': '0.220', 'AMMO4': '0.291', 'weapon2': '0.460', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '61.000'} [2024-08-06 04:57:33,834][52671] DAMAGECOUNT value on done: 580017.0 [2024-08-06 04:57:33,836][52671] Sum rewards: 76.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.868', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.116', 'weapon4': '0.126', 'AMMO4': '0.135', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.500'} [2024-08-06 04:57:35,363][52660] DAMAGECOUNT value on done: 586602.0 [2024-08-06 04:57:35,364][52668] DAMAGECOUNT value on done: 566500.0 [2024-08-06 04:57:35,365][52668] Sum rewards: 76.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.289', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.164', 'AMMO4': '0.180', 'weapon2': '0.184', 'AMMO3': '0.203', 'weapon5': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 04:57:35,366][52660] Sum rewards: 77.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.216', 'weapon2': '0.292', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '64.000'} [2024-08-06 04:57:35,618][52662] DAMAGECOUNT value on done: 574090.0 [2024-08-06 04:57:35,620][52662] Sum rewards: 68.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'AMMO5': '0.025', 'AMMO2': '0.071', 'weapon4': '0.096', 'weapon5': '0.214', 'AMMO3': '0.227', 'AMMO4': '0.353', 'weapon2': '0.390', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '57.000'} [2024-08-06 04:57:35,638][52658] DAMAGECOUNT value on done: 581301.0 [2024-08-06 04:57:35,646][52658] Sum rewards: 78.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.906', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '64.000'} [2024-08-06 04:57:36,660][52650] Updated weights for policy 0, policy_version 57461 (0.0013) [2024-08-06 04:57:36,928][52803] DAMAGECOUNT value on done: 534283.0 [2024-08-06 04:57:36,928][52803] Sum rewards: 86.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.304', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO4': '0.174', 'weapon5': '0.224', 'AMMO3': '0.227', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '70.000'} [2024-08-06 04:57:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 470736896. Throughput: 0: 4367.8. Samples: 117687950. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:57:37,794][52567] Avg episode reward: [(0, '73.258')] [2024-08-06 04:57:38,200][52662] DAMAGECOUNT value on done: 579037.0 [2024-08-06 04:57:38,200][52662] Sum rewards: 72.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.138', 'AMMO3': '0.183', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:38,525][52660] DAMAGECOUNT value on done: 575676.0 [2024-08-06 04:57:38,526][52660] Sum rewards: 72.830, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.376', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:38,550][52668] DAMAGECOUNT value on done: 568538.0 [2024-08-06 04:57:38,550][52668] Sum rewards: 70.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:41,035][52662] DAMAGECOUNT value on done: 575023.0 [2024-08-06 04:57:41,043][52662] Sum rewards: 78.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon2': '0.196', 'WEAPON3': '1.050', 'HITCOUNT': '3.450', 'weapon3': '3.594', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '63.000'} [2024-08-06 04:57:41,295][52650] Updated weights for policy 0, policy_version 57471 (0.0042) [2024-08-06 04:57:41,465][52660] DAMAGECOUNT value on done: 574329.0 [2024-08-06 04:57:41,465][52660] Sum rewards: 79.232, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.032', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO4': '0.162', 'AMMO3': '0.166', 'weapon2': '0.268', 'HEALTH': '0.306', 'weapon4': '0.346', 'WEAPON3': '0.950', 'weapon3': '2.930', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '61.000'} [2024-08-06 04:57:41,496][52668] DAMAGECOUNT value on done: 575352.0 [2024-08-06 04:57:41,497][52668] Sum rewards: 61.876, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.163', 'AMMO4': '0.244', 'weapon2': '0.270', 'weapon5': '0.362', 'HEALTH': '0.375', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.528', 'WEAPON3': '0.950', 'weapon3': '2.488', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '49.500'} [2024-08-06 04:57:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 470827008. Throughput: 0: 4375.5. Samples: 117714400. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:57:42,795][52567] Avg episode reward: [(0, '73.371')] [2024-08-06 04:57:44,015][52662] DAMAGECOUNT value on done: 583851.0 [2024-08-06 04:57:44,016][52662] Sum rewards: 77.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.142', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO3': '0.137', 'AMMO4': '0.182', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.522', 'WEAPON3': '0.850', 'weapon3': '2.810', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:44,243][52794] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:57:44,681][52660] DAMAGECOUNT value on done: 572125.0 [2024-08-06 04:57:44,682][52668] DAMAGECOUNT value on done: 579652.0 [2024-08-06 04:57:44,682][52660] Sum rewards: 69.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.855', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.038', 'weapon5': '0.074', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '58.000'} [2024-08-06 04:57:44,683][52668] Sum rewards: 71.805, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.786', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.176', 'AMMO4': '0.237', 'weapon2': '0.262', 'weapon5': '0.266', 'AMMO3': '0.269', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '61.000'} [2024-08-06 04:57:45,895][52650] Updated weights for policy 0, policy_version 57481 (0.0031) [2024-08-06 04:57:46,968][52662] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:57:47,397][52662] DAMAGECOUNT value on done: 576855.0 [2024-08-06 04:57:47,400][52662] Sum rewards: 80.463, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.142', 'weapon4': '0.154', 'AMMO4': '0.184', 'weapon2': '0.208', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '67.000'} [2024-08-06 04:57:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 470917120. Throughput: 0: 4378.7. Samples: 117727520. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:57:47,794][52567] Avg episode reward: [(0, '73.617')] [2024-08-06 04:57:47,842][52668] DAMAGECOUNT value on done: 577953.0 [2024-08-06 04:57:47,843][52668] Sum rewards: 75.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.572', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.146', 'weapon5': '0.156', 'AMMO3': '0.189', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.380', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:47,875][52660] DAMAGECOUNT value on done: 581653.0 [2024-08-06 04:57:47,876][52660] Sum rewards: 62.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.545', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.172', 'AMMO4': '0.176', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '52.000'} [2024-08-06 04:57:49,476][52658] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 04:57:49,724][52665] DAMAGECOUNT value on done: 564939.0 [2024-08-06 04:57:49,725][52665] Sum rewards: 74.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.238', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.132', 'weapon4': '0.166', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '61.000'} [2024-08-06 04:57:50,354][52662] DAMAGECOUNT value on done: 589588.0 [2024-08-06 04:57:50,356][52662] Sum rewards: 74.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.206', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:50,620][52650] Updated weights for policy 0, policy_version 57491 (0.0029) [2024-08-06 04:57:51,086][52668] DAMAGECOUNT value on done: 581358.0 [2024-08-06 04:57:51,104][52668] Sum rewards: 73.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.714', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.066', 'AMMO4': '0.181', 'weapon5': '0.204', 'AMMO3': '0.244', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '62.000'} [2024-08-06 04:57:51,165][52660] DAMAGECOUNT value on done: 575083.0 [2024-08-06 04:57:51,166][52660] Sum rewards: 67.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.963', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.166', 'AMMO3': '0.229', 'weapon4': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '2.736', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 04:57:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 470999040. Throughput: 0: 4379.3. Samples: 117753840. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:57:52,794][52567] Avg episode reward: [(0, '73.785')] [2024-08-06 04:57:52,847][52662] DAMAGECOUNT value on done: 581070.0 [2024-08-06 04:57:52,847][52662] Sum rewards: 64.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '54.500'} [2024-08-06 04:57:52,885][52665] DAMAGECOUNT value on done: 582575.0 [2024-08-06 04:57:52,885][52665] Sum rewards: 67.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '54.000'} [2024-08-06 04:57:53,761][52668] DAMAGECOUNT value on done: 579581.0 [2024-08-06 04:57:53,761][52668] Sum rewards: 71.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.114', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.176', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 04:57:53,860][52660] DAMAGECOUNT value on done: 577318.0 [2024-08-06 04:57:53,861][52660] Sum rewards: 76.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.753', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.146', 'weapon4': '0.166', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '59.500'} [2024-08-06 04:57:55,488][52662] DAMAGECOUNT value on done: 574837.0 [2024-08-06 04:57:55,488][52662] Sum rewards: 73.287, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.347', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.049', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.267', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '63.000'} [2024-08-06 04:57:55,501][52650] Updated weights for policy 0, policy_version 57501 (0.0036) [2024-08-06 04:57:56,189][52665] DAMAGECOUNT value on done: 576468.0 [2024-08-06 04:57:56,190][52665] Sum rewards: 86.759, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.406', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.412', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '71.000'} [2024-08-06 04:57:56,677][52660] DAMAGECOUNT value on done: 582669.0 [2024-08-06 04:57:56,677][52660] Sum rewards: 63.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.174', 'AMMO3': '0.205', 'weapon4': '0.234', 'AMMO4': '0.252', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.046', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '53.000'} [2024-08-06 04:57:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 471089152. Throughput: 0: 4379.8. Samples: 117780070. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 04:57:57,794][52567] Avg episode reward: [(0, '73.403')] [2024-08-06 04:57:58,119][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:57:58,207][52662] DAMAGECOUNT value on done: 578090.0 [2024-08-06 04:57:58,208][52662] Sum rewards: 73.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.128', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.392', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '60.000'} [2024-08-06 04:57:59,143][52665] DAMAGECOUNT value on done: 570517.0 [2024-08-06 04:57:59,143][52665] Sum rewards: 79.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.080', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '67.000'} [2024-08-06 04:57:59,584][52660] DAMAGECOUNT value on done: 571827.0 [2024-08-06 04:57:59,587][52660] Sum rewards: 68.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon2': '0.116', 'weapon5': '0.116', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '55.000'} [2024-08-06 04:57:59,911][52650] Updated weights for policy 0, policy_version 57511 (0.0017) [2024-08-06 04:58:00,907][52662] DAMAGECOUNT value on done: 572912.0 [2024-08-06 04:58:00,908][52662] Sum rewards: 69.126, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.210', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.100', 'AMMO3': '0.160', 'AMMO4': '0.187', 'weapon5': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '55.000'} [2024-08-06 04:58:01,894][52665] DAMAGECOUNT value on done: 562053.0 [2024-08-06 04:58:01,894][52665] Sum rewards: 74.022, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.090', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon5': '0.226', 'AMMO4': '0.238', 'AMMO3': '0.264', 'weapon2': '0.370', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '64.000'} [2024-08-06 04:58:02,264][52614] Signal inference workers to stop experience collection... (10450 times) [2024-08-06 04:58:02,264][52614] Signal inference workers to resume experience collection... (10450 times) [2024-08-06 04:58:02,320][52650] InferenceWorker_p0-w0: stopping experience collection (10450 times) [2024-08-06 04:58:02,320][52650] InferenceWorker_p0-w0: resuming experience collection (10450 times) [2024-08-06 04:58:02,608][52660] DAMAGECOUNT value on done: 573999.0 [2024-08-06 04:58:02,609][52660] Sum rewards: 67.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.857', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.068', 'AMMO4': '0.110', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '56.000'} [2024-08-06 04:58:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 471179264. Throughput: 0: 4370.9. Samples: 117793020. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:02,795][52567] Avg episode reward: [(0, '73.305')] [2024-08-06 04:58:03,028][52658] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon7', 0.002)] [2024-08-06 04:58:03,094][52659] DAMAGECOUNT value on done: 585337.0 [2024-08-06 04:58:03,094][52659] Sum rewards: 81.722, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.076', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '69.000'} [2024-08-06 04:58:04,531][52665] DAMAGECOUNT value on done: 568552.0 [2024-08-06 04:58:04,533][52665] Sum rewards: 70.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.676', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.060', 'AMMO3': '0.197', 'AMMO4': '0.198', 'weapon2': '0.232', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '55.000'} [2024-08-06 04:58:05,143][52650] Updated weights for policy 0, policy_version 57521 (0.0025) [2024-08-06 04:58:05,657][52659] DAMAGECOUNT value on done: 577197.0 [2024-08-06 04:58:05,658][52659] Sum rewards: 74.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.744', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.070', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '62.000'} [2024-08-06 04:58:05,680][52660] DAMAGECOUNT value on done: 585666.0 [2024-08-06 04:58:05,681][52660] Sum rewards: 85.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.294', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.206', 'AMMO3': '0.210', 'weapon4': '0.240', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '69.000'} [2024-08-06 04:58:07,240][52665] DAMAGECOUNT value on done: 573342.0 [2024-08-06 04:58:07,248][52665] Sum rewards: 78.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.116', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.076', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.474', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '65.000'} [2024-08-06 04:58:07,287][52811] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:58:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 471261184. Throughput: 0: 4368.9. Samples: 117819130. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:07,794][52567] Avg episode reward: [(0, '73.591')] [2024-08-06 04:58:08,179][52660] DAMAGECOUNT value on done: 592211.0 [2024-08-06 04:58:08,180][52660] Sum rewards: 78.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.535', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.084', 'AMMO4': '0.184', 'AMMO3': '0.195', 'weapon5': '0.226', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '64.000'} [2024-08-06 04:58:08,581][52659] DAMAGECOUNT value on done: 584248.0 [2024-08-06 04:58:08,583][52659] Sum rewards: 83.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.112', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '68.000'} [2024-08-06 04:58:09,573][52650] Updated weights for policy 0, policy_version 57531 (0.0024) [2024-08-06 04:58:10,535][52665] DAMAGECOUNT value on done: 571519.0 [2024-08-06 04:58:10,536][52665] Sum rewards: 74.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.708', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.082', 'weapon4': '0.094', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon2': '0.586', 'WEAPON3': '1.700', 'weapon3': '3.038', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '64.000'} [2024-08-06 04:58:10,928][52660] DAMAGECOUNT value on done: 574182.0 [2024-08-06 04:58:10,932][52660] Sum rewards: 70.820, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.121', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.106', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:11,879][52659] DAMAGECOUNT value on done: 579545.0 [2024-08-06 04:58:11,879][52659] Sum rewards: 79.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.183', 'weapon5': '0.194', 'AMMO4': '0.230', 'weapon2': '0.256', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '64.000'} [2024-08-06 04:58:12,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 471343104. Throughput: 0: 4372.4. Samples: 117845360. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:12,794][52567] Avg episode reward: [(0, '73.622')] [2024-08-06 04:58:13,641][52665] DAMAGECOUNT value on done: 578515.0 [2024-08-06 04:58:13,642][52665] Sum rewards: 76.243, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.076', 'weapon4': '0.170', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'HEALTH': '0.937', 'WEAPON3': '1.100', 'weapon3': '3.324', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 04:58:13,905][52660] DAMAGECOUNT value on done: 582831.0 [2024-08-06 04:58:13,906][52660] Sum rewards: 87.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.213', 'weapon2': '0.250', 'weapon5': '0.270', 'WEAPON5': '0.550', 'weapon4': '0.568', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.552', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '71.000'} [2024-08-06 04:58:14,102][52650] Updated weights for policy 0, policy_version 57541 (0.0013) [2024-08-06 04:58:14,191][52794] DAMAGECOUNT value on done: 582546.0 [2024-08-06 04:58:14,191][52794] Sum rewards: 68.562, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.395', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.162', 'weapon5': '0.164', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.708', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '54.000'} [2024-08-06 04:58:14,810][52659] DAMAGECOUNT value on done: 574392.0 [2024-08-06 04:58:14,810][52659] Sum rewards: 63.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.095', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '51.000'} [2024-08-06 04:58:16,204][52665] DAMAGECOUNT value on done: 572261.0 [2024-08-06 04:58:16,206][52665] Sum rewards: 67.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.138', 'AMMO3': '0.184', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'weapon4': '0.342', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '55.000'} [2024-08-06 04:58:16,951][52794] DAMAGECOUNT value on done: 587370.0 [2024-08-06 04:58:16,951][52794] Sum rewards: 65.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.070', 'AMMO4': '0.202', 'weapon5': '0.216', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.138', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 04:58:17,000][52660] DAMAGECOUNT value on done: 576612.0 [2024-08-06 04:58:17,001][52660] Sum rewards: 80.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.326', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.186', 'weapon5': '0.202', 'weapon2': '0.230', 'AMMO4': '0.257', 'weapon4': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '65.000'} [2024-08-06 04:58:17,567][52659] DAMAGECOUNT value on done: 579989.0 [2024-08-06 04:58:17,567][52659] Sum rewards: 74.689, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.794', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon5': '0.214', 'weapon2': '0.236', 'weapon4': '0.240', 'AMMO3': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.952', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '66.000'} [2024-08-06 04:58:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 471433216. Throughput: 0: 4364.7. Samples: 117858170. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:17,802][52567] Avg episode reward: [(0, '73.571')] [2024-08-06 04:58:18,957][52665] DAMAGECOUNT value on done: 582369.0 [2024-08-06 04:58:18,957][52665] Sum rewards: 63.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.182', 'AMMO3': '0.203', 'weapon5': '0.240', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.464', 'WEAPON3': '1.350', 'weapon3': '2.612', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '53.000'} [2024-08-06 04:58:19,162][52650] Updated weights for policy 0, policy_version 57551 (0.0024) [2024-08-06 04:58:19,954][52794] DAMAGECOUNT value on done: 585360.0 [2024-08-06 04:58:19,957][52794] Sum rewards: 79.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.222', 'weapon2': '0.270', 'WEAPON3': '1.400', 'weapon3': '3.496', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '67.000'} [2024-08-06 04:58:20,015][52660] DAMAGECOUNT value on done: 578119.0 [2024-08-06 04:58:20,015][52660] Sum rewards: 80.044, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.100', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon5': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.350', 'weapon3': '2.810', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '65.000'} [2024-08-06 04:58:20,095][52659] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:58:20,342][52659] DAMAGECOUNT value on done: 578796.0 [2024-08-06 04:58:20,344][52659] Sum rewards: 62.073, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.798', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.108', 'AMMO4': '0.164', 'weapon5': '0.186', 'AMMO3': '0.238', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '54.000'} [2024-08-06 04:58:22,125][52665] DAMAGECOUNT value on done: 577658.0 [2024-08-06 04:58:22,127][52665] Sum rewards: 76.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.974', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.240', 'WEAPON3': '1.600', 'weapon3': '3.456', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 04:58:22,647][52795] DAMAGECOUNT value on done: 536990.0 [2024-08-06 04:58:22,648][52795] Sum rewards: 67.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.118', 'weapon4': '0.132', 'AMMO4': '0.168', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '54.000'} [2024-08-06 04:58:22,664][52794] DAMAGECOUNT value on done: 577219.0 [2024-08-06 04:58:22,666][52794] Sum rewards: 68.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon4': '0.162', 'weapon5': '0.182', 'AMMO3': '0.231', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.134', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '56.000'} [2024-08-06 04:58:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 471515136. Throughput: 0: 4360.4. Samples: 117884170. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:22,795][52567] Avg episode reward: [(0, '73.413')] [2024-08-06 04:58:22,929][52660] DAMAGECOUNT value on done: 568509.0 [2024-08-06 04:58:22,929][52660] Sum rewards: 69.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.894', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.169', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.278', 'weapon2': '0.332', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '54.500'} [2024-08-06 04:58:23,322][52659] DAMAGECOUNT value on done: 575702.0 [2024-08-06 04:58:23,323][52659] Sum rewards: 71.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '0.000', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.100', 'AMMO4': '0.233', 'AMMO3': '0.235', 'weapon5': '0.280', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 04:58:23,499][52650] Updated weights for policy 0, policy_version 57561 (0.0024) [2024-08-06 04:58:24,494][52647] DAMAGECOUNT value on done: 613090.0 [2024-08-06 04:58:24,495][52647] Sum rewards: 75.337, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.098', 'AMMO4': '0.147', 'weapon5': '0.172', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '60.000'} [2024-08-06 04:58:25,348][52665] DAMAGECOUNT value on done: 574660.0 [2024-08-06 04:58:25,351][52665] Sum rewards: 75.684, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.064', 'weapon5': '0.098', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'weapon2': '0.354', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '66.000'} [2024-08-06 04:58:25,731][52794] DAMAGECOUNT value on done: 576811.0 [2024-08-06 04:58:25,732][52794] Sum rewards: 70.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:25,954][52795] DAMAGECOUNT value on done: 528193.0 [2024-08-06 04:58:25,955][52795] Sum rewards: 64.629, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.697', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon5': '0.196', 'AMMO3': '0.220', 'weapon2': '0.290', 'AMMO4': '0.325', 'WEAPON5': '0.500', 'weapon4': '0.580', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.620', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '53.000'} [2024-08-06 04:58:26,347][52659] DAMAGECOUNT value on done: 582934.0 [2024-08-06 04:58:26,350][52659] Sum rewards: 78.120, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.687', 'AMMO5': '0.011', 'AMMO2': '0.054', 'AMMO3': '0.143', 'weapon5': '0.166', 'AMMO4': '0.268', 'weapon2': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.484', 'WEAPON3': '1.000', 'weapon3': '2.574', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '63.000'} [2024-08-06 04:58:26,882][52647] DAMAGECOUNT value on done: 608153.0 [2024-08-06 04:58:26,885][52647] Sum rewards: 66.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.152', 'AMMO3': '0.220', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '55.000'} [2024-08-06 04:58:26,996][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 04:58:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 471605248. Throughput: 0: 4357.8. Samples: 117910500. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:27,794][52567] Avg episode reward: [(0, '73.392')] [2024-08-06 04:58:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057569_471605248.pth... [2024-08-06 04:58:27,941][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057057_467410944.pth [2024-08-06 04:58:28,369][52665] DAMAGECOUNT value on done: 573529.0 [2024-08-06 04:58:28,370][52665] Sum rewards: 78.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.778', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.128', 'weapon4': '0.164', 'AMMO4': '0.183', 'AMMO3': '0.200', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '65.000'} [2024-08-06 04:58:28,518][52650] Updated weights for policy 0, policy_version 57571 (0.0012) [2024-08-06 04:58:29,132][52794] DAMAGECOUNT value on done: 579193.0 [2024-08-06 04:58:29,134][52794] Sum rewards: 74.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.245', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.108', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '62.000'} [2024-08-06 04:58:29,152][52795] DAMAGECOUNT value on done: 526316.0 [2024-08-06 04:58:29,152][52795] Sum rewards: 71.131, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'HITCOUNT': '3.530', 'weapon3': '3.562', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '62.000'} [2024-08-06 04:58:29,367][52647] DAMAGECOUNT value on done: 610821.0 [2024-08-06 04:58:29,367][52647] Sum rewards: 77.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon4': '0.088', 'weapon5': '0.146', 'AMMO4': '0.166', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '66.000'} [2024-08-06 04:58:29,371][52659] DAMAGECOUNT value on done: 585197.0 [2024-08-06 04:58:29,372][52659] Sum rewards: 68.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.082', 'weapon4': '0.086', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:31,852][52665] DAMAGECOUNT value on done: 571395.0 [2024-08-06 04:58:31,853][52665] Sum rewards: 69.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.465', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.151', 'weapon4': '0.172', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '58.500'} [2024-08-06 04:58:31,919][52794] DAMAGECOUNT value on done: 586149.0 [2024-08-06 04:58:31,919][52794] Sum rewards: 68.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.120', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.104', 'AMMO3': '0.195', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.288', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:32,035][52647] DAMAGECOUNT value on done: 616882.0 [2024-08-06 04:58:32,035][52647] Sum rewards: 72.488, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.461', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:32,232][52659] DAMAGECOUNT value on done: 575008.0 [2024-08-06 04:58:32,233][52659] Sum rewards: 75.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.506', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.133', 'weapon5': '0.176', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '63.000'} [2024-08-06 04:58:32,479][52795] DAMAGECOUNT value on done: 534025.0 [2024-08-06 04:58:32,479][52795] Sum rewards: 72.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.833', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.152', 'AMMO3': '0.224', 'AMMO4': '0.225', 'weapon2': '0.264', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '58.000'} [2024-08-06 04:58:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 471695360. Throughput: 0: 4348.4. Samples: 117923200. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:32,795][52567] Avg episode reward: [(0, '73.954')] [2024-08-06 04:58:33,149][52650] Updated weights for policy 0, policy_version 57581 (0.0013) [2024-08-06 04:58:34,256][52794] DAMAGECOUNT value on done: 572645.0 [2024-08-06 04:58:34,257][52794] Sum rewards: 68.409, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.994', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.176', 'weapon4': '0.192', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'AMMO3': '0.290', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '2.934', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '59.000'} [2024-08-06 04:58:34,729][52665] DAMAGECOUNT value on done: 569934.0 [2024-08-06 04:58:34,730][52665] Sum rewards: 82.404, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.796', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '65.000'} [2024-08-06 04:58:35,108][52659] DAMAGECOUNT value on done: 583626.0 [2024-08-06 04:58:35,109][52659] Sum rewards: 70.204, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.382', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.088', 'weapon5': '0.138', 'AMMO4': '0.226', 'AMMO3': '0.301', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.750', 'weapon3': '3.012', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '61.000'} [2024-08-06 04:58:35,161][52647] DAMAGECOUNT value on done: 619293.0 [2024-08-06 04:58:35,162][52647] Sum rewards: 75.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.984', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.149', 'weapon2': '0.176', 'weapon5': '0.180', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '62.000'} [2024-08-06 04:58:35,633][52795] DAMAGECOUNT value on done: 530781.0 [2024-08-06 04:58:35,637][52795] Sum rewards: 74.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.713', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.066', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.404', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '61.000'} [2024-08-06 04:58:37,305][52665] DAMAGECOUNT value on done: 571751.0 [2024-08-06 04:58:37,305][52665] Sum rewards: 73.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '60.500'} [2024-08-06 04:58:37,374][52794] DAMAGECOUNT value on done: 583659.0 [2024-08-06 04:58:37,375][52794] Sum rewards: 77.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.017', 'AMMO2': '0.071', 'weapon4': '0.090', 'AMMO3': '0.235', 'weapon5': '0.282', 'weapon2': '0.324', 'AMMO4': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '65.000'} [2024-08-06 04:58:37,692][52659] DAMAGECOUNT value on done: 572409.0 [2024-08-06 04:58:37,693][52659] Sum rewards: 56.364, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.572', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.032', 'weapon4': '0.050', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.438', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.278', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '51.000'} [2024-08-06 04:58:37,766][52650] Updated weights for policy 0, policy_version 57591 (0.0011) [2024-08-06 04:58:37,812][52567] Fps is (10 sec: 17990.3, 60 sec: 17471.1, 300 sec: 17493.7). Total num frames: 471785472. Throughput: 0: 4343.8. Samples: 117949390. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 04:58:37,812][52567] Avg episode reward: [(0, '73.632')] [2024-08-06 04:58:38,256][52647] DAMAGECOUNT value on done: 618392.0 [2024-08-06 04:58:38,256][52647] Sum rewards: 80.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.684', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.156', 'weapon5': '0.184', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '64.000'} [2024-08-06 04:58:38,786][52795] DAMAGECOUNT value on done: 539729.0 [2024-08-06 04:58:38,788][52795] Sum rewards: 71.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.179', 'AMMO5': '0.028', 'AMMO2': '0.072', 'AMMO3': '0.192', 'weapon4': '0.232', 'weapon5': '0.328', 'AMMO4': '0.362', 'weapon2': '0.408', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.740', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:40,252][52659] DAMAGECOUNT value on done: 576707.0 [2024-08-06 04:58:40,253][52659] Sum rewards: 65.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.422', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.063', 'AMMO3': '0.141', 'weapon4': '0.246', 'weapon5': '0.260', 'AMMO4': '0.318', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon2': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.482', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '53.000'} [2024-08-06 04:58:40,441][52665] DAMAGECOUNT value on done: 569395.0 [2024-08-06 04:58:40,443][52665] Sum rewards: 75.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.158', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '63.000'} [2024-08-06 04:58:40,656][52794] DAMAGECOUNT value on done: 577891.0 [2024-08-06 04:58:40,657][52794] Sum rewards: 61.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.318', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.175', 'AMMO3': '0.216', 'weapon4': '0.216', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '2.948', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '52.000'} [2024-08-06 04:58:40,970][52647] DAMAGECOUNT value on done: 612960.0 [2024-08-06 04:58:40,970][52647] Sum rewards: 73.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.442', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.044', 'AMMO4': '0.065', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '60.000'} [2024-08-06 04:58:41,840][52795] DAMAGECOUNT value on done: 543074.0 [2024-08-06 04:58:41,842][52795] Sum rewards: 66.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.224', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO4': '0.231', 'AMMO3': '0.248', 'weapon5': '0.276', 'weapon4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.634', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '54.000'} [2024-08-06 04:58:42,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 471859200. Throughput: 0: 4351.8. Samples: 117975900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:58:42,795][52567] Avg episode reward: [(0, '73.147')] [2024-08-06 04:58:42,870][52650] Updated weights for policy 0, policy_version 57601 (0.0012) [2024-08-06 04:58:43,102][52659] DAMAGECOUNT value on done: 589851.0 [2024-08-06 04:58:43,105][52659] Sum rewards: 74.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.915', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon5': '0.096', 'AMMO4': '0.196', 'AMMO3': '0.199', 'weapon4': '0.224', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 04:58:43,347][52794] DAMAGECOUNT value on done: 575298.0 [2024-08-06 04:58:43,348][52794] Sum rewards: 75.281, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.175', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.100', 'weapon2': '0.164', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.430', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '61.000'} [2024-08-06 04:58:43,357][52647] DAMAGECOUNT value on done: 604506.0 [2024-08-06 04:58:43,357][52647] Sum rewards: 82.749, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.193', 'weapon4': '0.196', 'AMMO4': '0.202', 'weapon5': '0.360', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '66.000'} [2024-08-06 04:58:43,495][52665] DAMAGECOUNT value on done: 571359.0 [2024-08-06 04:58:43,495][52665] Sum rewards: 62.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.066', 'AMMO4': '0.073', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.223', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.354', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '53.000'} [2024-08-06 04:58:44,932][52795] DAMAGECOUNT value on done: 537241.0 [2024-08-06 04:58:44,937][52795] Sum rewards: 69.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.236', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO3': '0.153', 'AMMO4': '0.174', 'weapon5': '0.186', 'weapon2': '0.254', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon3': '2.964', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '56.000'} [2024-08-06 04:58:45,659][52820] DAMAGECOUNT value on done: 534648.0 [2024-08-06 04:58:45,659][52820] Sum rewards: 83.802, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.035', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.193', 'HEALTH': '0.270', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '67.000'} [2024-08-06 04:58:46,077][52659] DAMAGECOUNT value on done: 581465.0 [2024-08-06 04:58:46,079][52659] Sum rewards: 64.227, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.000', 'AMMO5': '0.020', 'AMMO2': '0.071', 'weapon2': '0.248', 'weapon5': '0.252', 'AMMO3': '0.268', 'weapon4': '0.276', 'AMMO4': '0.356', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.910', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '56.000'} [2024-08-06 04:58:46,245][52794] DAMAGECOUNT value on done: 580359.0 [2024-08-06 04:58:46,245][52794] Sum rewards: 70.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.470', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.209', 'weapon5': '0.228', 'AMMO4': '0.288', 'weapon4': '0.292', 'weapon2': '0.464', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 04:58:46,266][52647] DAMAGECOUNT value on done: 614054.0 [2024-08-06 04:58:46,266][52647] Sum rewards: 67.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.805', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.094', 'AMMO4': '0.171', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.650', 'HITCOUNT': '3.330', 'weapon3': '3.420', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 04:58:46,635][52665] DAMAGECOUNT value on done: 573752.0 [2024-08-06 04:58:46,636][52665] Sum rewards: 74.927, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.933', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.140', 'weapon5': '0.176', 'AMMO4': '0.180', 'AMMO3': '0.199', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '61.000'} [2024-08-06 04:58:47,018][52650] Updated weights for policy 0, policy_version 57611 (0.0021) [2024-08-06 04:58:47,794][52567] Fps is (10 sec: 16413.3, 60 sec: 17203.2, 300 sec: 17439.3). Total num frames: 471949312. Throughput: 0: 4356.0. Samples: 117989040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:58:47,794][52567] Avg episode reward: [(0, '72.873')] [2024-08-06 04:58:48,197][52795] DAMAGECOUNT value on done: 531509.0 [2024-08-06 04:58:48,202][52795] Sum rewards: 85.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.146', 'AMMO4': '0.154', 'weapon2': '0.180', 'weapon5': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '69.000'} [2024-08-06 04:58:48,679][52647] DAMAGECOUNT value on done: 609812.0 [2024-08-06 04:58:48,680][52647] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.649', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.202', 'weapon2': '0.222', 'AMMO4': '0.234', 'weapon5': '0.246', 'weapon4': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.032', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 04:58:48,713][52820] DAMAGECOUNT value on done: 536924.0 [2024-08-06 04:58:48,715][52820] Sum rewards: 76.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.358', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO4': '0.149', 'weapon2': '0.232', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '64.000'} [2024-08-06 04:58:48,827][52659] DAMAGECOUNT value on done: 589677.0 [2024-08-06 04:58:48,827][52659] Sum rewards: 72.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.158', 'AMMO4': '0.174', 'weapon5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '59.000'} [2024-08-06 04:58:49,165][52794] DAMAGECOUNT value on done: 575037.0 [2024-08-06 04:58:49,165][52794] Sum rewards: 68.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.919', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.178', 'AMMO3': '0.179', 'weapon2': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '56.500'} [2024-08-06 04:58:49,292][52667] DAMAGECOUNT value on done: 581954.0 [2024-08-06 04:58:49,292][52667] Sum rewards: 78.077, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.325', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.260', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '63.000'} [2024-08-06 04:58:49,672][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:58:51,412][52795] DAMAGECOUNT value on done: 539976.0 [2024-08-06 04:58:51,416][52795] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.470', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.182', 'weapon5': '0.244', 'AMMO4': '0.249', 'AMMO3': '0.266', 'weapon2': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'HITCOUNT': '2.670', 'weapon3': '2.906', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '49.000'} [2024-08-06 04:58:51,436][52659] DAMAGECOUNT value on done: 578270.0 [2024-08-06 04:58:51,441][52659] Sum rewards: 59.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.064', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.302', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.420', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '48.000'} [2024-08-06 04:58:51,765][52650] Updated weights for policy 0, policy_version 57621 (0.0011) [2024-08-06 04:58:51,889][52647] DAMAGECOUNT value on done: 610830.0 [2024-08-06 04:58:51,889][52647] Sum rewards: 73.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.085', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.036', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.196', 'weapon4': '0.220', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '63.000'} [2024-08-06 04:58:51,923][52820] DAMAGECOUNT value on done: 541264.0 [2024-08-06 04:58:51,925][52820] Sum rewards: 73.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.071', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.122', 'AMMO4': '0.139', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '60.000'} [2024-08-06 04:58:52,033][52794] DAMAGECOUNT value on done: 594040.0 [2024-08-06 04:58:52,034][52794] Sum rewards: 63.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.016', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon5': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '50.000'} [2024-08-06 04:58:52,164][52667] DAMAGECOUNT value on done: 589358.0 [2024-08-06 04:58:52,164][52667] Sum rewards: 72.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.447', 'AMMO5': '0.029', 'AMMO2': '0.060', 'AMMO3': '0.203', 'weapon2': '0.242', 'AMMO4': '0.302', 'weapon4': '0.312', 'weapon5': '0.382', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '58.000'} [2024-08-06 04:58:52,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 472047616. Throughput: 0: 4353.1. Samples: 118015020. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:58:52,794][52567] Avg episode reward: [(0, '72.555')] [2024-08-06 04:58:53,301][52820] Large shaping reward 2.750 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 04:58:54,528][52659] DAMAGECOUNT value on done: 585483.0 [2024-08-06 04:58:54,535][52659] Sum rewards: 71.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.933', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO3': '0.177', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:54,617][52795] DAMAGECOUNT value on done: 536967.0 [2024-08-06 04:58:54,618][52795] Sum rewards: 72.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon4': '0.020', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.410', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '62.000'} [2024-08-06 04:58:54,859][52667] DAMAGECOUNT value on done: 583482.0 [2024-08-06 04:58:54,859][52667] Sum rewards: 70.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO4': '0.195', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.310', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '57.000'} [2024-08-06 04:58:54,918][52794] DAMAGECOUNT value on done: 573864.0 [2024-08-06 04:58:54,918][52794] Sum rewards: 89.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.133', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.053', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.480', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '23.010', 'FRAGCOUNT': '71.000'} [2024-08-06 04:58:54,998][52820] DAMAGECOUNT value on done: 532174.0 [2024-08-06 04:58:54,999][52820] Sum rewards: 93.303, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.254', 'HEALTH': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '77.000'} [2024-08-06 04:58:55,061][52647] DAMAGECOUNT value on done: 604512.0 [2024-08-06 04:58:55,061][52647] Sum rewards: 82.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.116', 'AMMO4': '0.157', 'AMMO3': '0.178', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '66.000'} [2024-08-06 04:58:56,474][52650] Updated weights for policy 0, policy_version 57631 (0.0012) [2024-08-06 04:58:57,511][52659] DAMAGECOUNT value on done: 580352.0 [2024-08-06 04:58:57,512][52659] Sum rewards: 65.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.342', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.175', 'AMMO3': '0.243', 'weapon2': '0.248', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '55.000'} [2024-08-06 04:58:57,624][52795] DAMAGECOUNT value on done: 530462.0 [2024-08-06 04:58:57,625][52795] Sum rewards: 68.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.744', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.218', 'weapon4': '0.358', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '55.000'} [2024-08-06 04:58:57,681][52647] DAMAGECOUNT value on done: 617452.0 [2024-08-06 04:58:57,683][52647] Sum rewards: 65.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.598', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.160', 'AMMO4': '0.195', 'AMMO3': '0.228', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '54.000'} [2024-08-06 04:58:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 472129536. Throughput: 0: 4351.3. Samples: 118041170. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:58:57,794][52567] Avg episode reward: [(0, '72.927')] [2024-08-06 04:58:57,841][52667] DAMAGECOUNT value on done: 585125.0 [2024-08-06 04:58:57,842][52667] Sum rewards: 89.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.086', 'weapon4': '0.114', 'AMMO3': '0.201', 'AMMO4': '0.210', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '76.000'} [2024-08-06 04:58:58,043][52820] DAMAGECOUNT value on done: 540554.0 [2024-08-06 04:58:58,044][52820] Sum rewards: 79.733, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.134', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.131', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '68.000'} [2024-08-06 04:58:58,077][52794] DAMAGECOUNT value on done: 587818.0 [2024-08-06 04:58:58,079][52794] Sum rewards: 59.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.187', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.250', 'HITCOUNT': '2.870', 'weapon3': '3.062', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '50.000'} [2024-08-06 04:59:00,239][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 04:59:00,780][52795] DAMAGECOUNT value on done: 532299.0 [2024-08-06 04:59:00,781][52795] Sum rewards: 68.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.170', 'weapon4': '0.196', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 04:59:00,804][52647] DAMAGECOUNT value on done: 607277.0 [2024-08-06 04:59:00,804][52647] Sum rewards: 75.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.130', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:00,846][52667] DAMAGECOUNT value on done: 587621.0 [2024-08-06 04:59:00,847][52667] Sum rewards: 80.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.583', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.232', 'weapon2': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '67.000'} [2024-08-06 04:59:01,007][52794] DAMAGECOUNT value on done: 580522.0 [2024-08-06 04:59:01,008][52794] Sum rewards: 81.669, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.710', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.078', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.269', 'WEAPON3': '1.500', 'weapon3': '3.436', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.865', 'FRAGCOUNT': '68.000'} [2024-08-06 04:59:01,146][52820] DAMAGECOUNT value on done: 531809.0 [2024-08-06 04:59:01,147][52820] Sum rewards: 73.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.272', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.072', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '61.000'} [2024-08-06 04:59:01,235][52650] Updated weights for policy 0, policy_version 57641 (0.0022) [2024-08-06 04:59:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 472219648. Throughput: 0: 4358.0. Samples: 118054280. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:59:02,794][52567] Avg episode reward: [(0, '73.077')] [2024-08-06 04:59:02,880][52663] DAMAGECOUNT value on done: 590002.0 [2024-08-06 04:59:02,881][52663] Sum rewards: 77.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:03,448][52647] DAMAGECOUNT value on done: 616149.0 [2024-08-06 04:59:03,448][52647] Sum rewards: 74.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.183', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:03,816][52667] DAMAGECOUNT value on done: 590052.0 [2024-08-06 04:59:03,816][52667] Sum rewards: 73.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.157', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:03,866][52795] DAMAGECOUNT value on done: 536945.0 [2024-08-06 04:59:03,868][52795] Sum rewards: 69.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.461', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.201', 'weapon5': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 04:59:03,902][52794] DAMAGECOUNT value on done: 587995.0 [2024-08-06 04:59:03,903][52794] Sum rewards: 70.383, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.248', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.114', 'weapon5': '0.204', 'AMMO4': '0.222', 'weapon2': '0.312', 'AMMO3': '0.325', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.946', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:04,467][52820] DAMAGECOUNT value on done: 537159.0 [2024-08-06 04:59:04,468][52820] Sum rewards: 64.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.143', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '52.000'} [2024-08-06 04:59:05,674][52663] DAMAGECOUNT value on done: 579552.0 [2024-08-06 04:59:05,674][52663] Sum rewards: 62.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon5': '0.172', 'weapon4': '0.184', 'AMMO3': '0.193', 'weapon2': '0.282', 'AMMO4': '0.303', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.140', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '51.000'} [2024-08-06 04:59:06,024][52650] Updated weights for policy 0, policy_version 57651 (0.0013) [2024-08-06 04:59:06,124][52647] DAMAGECOUNT value on done: 614894.0 [2024-08-06 04:59:06,124][52647] Sum rewards: 79.781, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.390', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '68.000'} [2024-08-06 04:59:06,182][52667] DAMAGECOUNT value on done: 586289.0 [2024-08-06 04:59:06,183][52667] Sum rewards: 89.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.599', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'weapon2': '0.236', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'weapon3': '3.456', 'HITCOUNT': '4.420', 'DAMAGECOUNT': '22.836', 'FRAGCOUNT': '75.500'} [2024-08-06 04:59:06,912][52794] DAMAGECOUNT value on done: 589939.0 [2024-08-06 04:59:06,915][52794] Sum rewards: 70.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.125', 'AMMO3': '0.187', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:07,026][52795] DAMAGECOUNT value on done: 528410.0 [2024-08-06 04:59:07,027][52795] Sum rewards: 73.806, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.242', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.204', 'WEAPON3': '1.000', 'weapon3': '3.490', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:07,546][52820] DAMAGECOUNT value on done: 540798.0 [2024-08-06 04:59:07,548][52820] Sum rewards: 81.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.504', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.086', 'AMMO4': '0.130', 'weapon5': '0.188', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 472309760. Throughput: 0: 4367.3. Samples: 118080700. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:59:07,794][52567] Avg episode reward: [(0, '72.876')] [2024-08-06 04:59:08,129][52663] DAMAGECOUNT value on done: 570713.0 [2024-08-06 04:59:08,129][52663] Sum rewards: 73.608, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.024', 'WEAPON1': '0.030', 'HEALTH': '0.059', 'weapon4': '0.116', 'AMMO4': '0.120', 'weapon5': '0.136', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '0.950', 'weapon3': '3.152', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:08,176][52666] DAMAGECOUNT value on done: 579569.0 [2024-08-06 04:59:08,176][52666] Sum rewards: 64.379, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.358', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.105', 'weapon4': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'weapon3': '3.366', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '55.500'} [2024-08-06 04:59:09,247][52647] DAMAGECOUNT value on done: 599892.0 [2024-08-06 04:59:09,248][52647] Sum rewards: 62.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.029', 'AMMO2': '0.042', 'AMMO3': '0.194', 'weapon5': '0.194', 'AMMO4': '0.208', 'weapon4': '0.342', 'weapon2': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '53.000'} [2024-08-06 04:59:09,357][52667] DAMAGECOUNT value on done: 579066.0 [2024-08-06 04:59:09,359][52667] Sum rewards: 82.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.106', 'AMMO4': '0.181', 'AMMO3': '0.228', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '68.000'} [2024-08-06 04:59:09,915][52794] DAMAGECOUNT value on done: 578818.0 [2024-08-06 04:59:09,917][52794] Sum rewards: 80.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.331', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.099', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.264', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '65.000'} [2024-08-06 04:59:10,188][52795] DAMAGECOUNT value on done: 543326.0 [2024-08-06 04:59:10,188][52795] Sum rewards: 63.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.334', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.376', 'WEAPON3': '0.950', 'HITCOUNT': '2.930', 'weapon3': '3.326', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '52.000'} [2024-08-06 04:59:10,458][52670] DAMAGECOUNT value on done: 571733.0 [2024-08-06 04:59:10,459][52670] Sum rewards: 79.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.896', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'weapon3': '3.450', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:10,521][52650] Updated weights for policy 0, policy_version 57661 (0.0011) [2024-08-06 04:59:10,656][52820] DAMAGECOUNT value on done: 534530.0 [2024-08-06 04:59:10,659][52820] Sum rewards: 77.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.150', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.155', 'AMMO4': '0.185', 'weapon5': '0.230', 'weapon2': '0.302', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '2.958', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 04:59:11,040][52666] DAMAGECOUNT value on done: 581696.0 [2024-08-06 04:59:11,045][52666] Sum rewards: 58.146, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.106', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '48.000'} [2024-08-06 04:59:11,202][52663] DAMAGECOUNT value on done: 577114.0 [2024-08-06 04:59:11,203][52663] Sum rewards: 63.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.831', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.070', 'weapon4': '0.124', 'AMMO4': '0.149', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.188', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '51.000'} [2024-08-06 04:59:11,849][52667] DAMAGECOUNT value on done: 586997.0 [2024-08-06 04:59:11,852][52667] Sum rewards: 78.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.100', 'AMMO3': '0.200', 'weapon5': '0.250', 'AMMO4': '0.275', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:12,365][52647] DAMAGECOUNT value on done: 607718.0 [2024-08-06 04:59:12,366][52647] Sum rewards: 66.713, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.573', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.216', 'AMMO4': '0.218', 'weapon5': '0.252', 'AMMO3': '0.295', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.830', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 472391680. Throughput: 0: 4371.5. Samples: 118107220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 04:59:12,795][52567] Avg episode reward: [(0, '72.515')] [2024-08-06 04:59:13,280][52795] DAMAGECOUNT value on done: 536471.0 [2024-08-06 04:59:13,281][52795] Sum rewards: 68.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.171', 'weapon4': '0.190', 'AMMO3': '0.193', 'weapon2': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:13,655][52670] DAMAGECOUNT value on done: 580072.0 [2024-08-06 04:59:13,657][52670] Sum rewards: 72.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.116', 'weapon5': '0.128', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:13,883][52820] DAMAGECOUNT value on done: 544929.0 [2024-08-06 04:59:13,886][52820] Sum rewards: 64.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.170', 'AMMO3': '0.205', 'weapon2': '0.232', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.724', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '52.000'} [2024-08-06 04:59:14,195][52666] DAMAGECOUNT value on done: 582956.0 [2024-08-06 04:59:14,196][52666] Sum rewards: 60.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.040', 'weapon4': '0.108', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.346', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '53.000'} [2024-08-06 04:59:14,284][52663] DAMAGECOUNT value on done: 582741.0 [2024-08-06 04:59:14,287][52663] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.733', 'AMMO5': '0.024', 'AMMO2': '0.052', 'weapon4': '0.114', 'AMMO3': '0.191', 'weapon5': '0.214', 'AMMO4': '0.261', 'weapon2': '0.440', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:14,742][52667] DAMAGECOUNT value on done: 589079.0 [2024-08-06 04:59:14,753][52667] Sum rewards: 71.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.177', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.360', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:15,290][52650] Updated weights for policy 0, policy_version 57671 (0.0012) [2024-08-06 04:59:15,450][52647] DAMAGECOUNT value on done: 599521.0 [2024-08-06 04:59:15,451][52647] Sum rewards: 66.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.794', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.173', 'weapon5': '0.196', 'AMMO3': '0.204', 'weapon4': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '54.000'} [2024-08-06 04:59:16,418][52795] DAMAGECOUNT value on done: 529939.0 [2024-08-06 04:59:16,419][52795] Sum rewards: 60.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.846', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon2': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.260', 'weapon4': '0.284', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '53.000'} [2024-08-06 04:59:16,708][52670] DAMAGECOUNT value on done: 574307.0 [2024-08-06 04:59:16,710][52670] Sum rewards: 71.700, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.902', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.278', 'AMMO3': '0.325', 'WEAPON3': '1.950', 'weapon3': '3.336', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:17,022][52820] DAMAGECOUNT value on done: 533588.0 [2024-08-06 04:59:17,023][52820] Sum rewards: 77.008, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.025', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.124', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'WEAPON3': '0.900', 'weapon2': '0.966', 'weapon3': '2.760', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:17,085][52663] DAMAGECOUNT value on done: 587581.0 [2024-08-06 04:59:17,085][52663] Sum rewards: 78.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.008', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.169', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.320', 'WEAPON3': '1.000', 'weapon3': '3.094', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:17,414][52667] DAMAGECOUNT value on done: 577456.0 [2024-08-06 04:59:17,415][52667] Sum rewards: 64.080, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.068', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.430', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '55.000'} [2024-08-06 04:59:17,484][52666] DAMAGECOUNT value on done: 581536.0 [2024-08-06 04:59:17,486][52666] Sum rewards: 73.882, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.014', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.208', 'AMMO4': '0.223', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 472481792. Throughput: 0: 4378.9. Samples: 118120250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:59:17,794][52567] Avg episode reward: [(0, '72.285')] [2024-08-06 04:59:18,333][52669] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 04:59:18,696][52647] DAMAGECOUNT value on done: 604733.0 [2024-08-06 04:59:18,697][52647] Sum rewards: 78.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.136', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.380', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:19,466][52670] DAMAGECOUNT value on done: 571006.0 [2024-08-06 04:59:19,466][52670] Sum rewards: 69.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.555', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.126', 'AMMO4': '0.218', 'weapon5': '0.224', 'AMMO3': '0.248', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:19,512][52795] DAMAGECOUNT value on done: 537452.0 [2024-08-06 04:59:19,513][52795] Sum rewards: 76.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.183', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon4': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:19,868][52650] Updated weights for policy 0, policy_version 57681 (0.0023) [2024-08-06 04:59:19,941][52666] DAMAGECOUNT value on done: 576848.0 [2024-08-06 04:59:19,942][52666] Sum rewards: 78.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon2': '0.180', 'weapon5': '0.206', 'weapon4': '0.246', 'AMMO3': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.100', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '67.000'} [2024-08-06 04:59:20,048][52667] DAMAGECOUNT value on done: 579496.0 [2024-08-06 04:59:20,048][52667] Sum rewards: 76.890, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.984', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.237', 'weapon2': '0.242', 'weapon5': '0.256', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '65.000'} [2024-08-06 04:59:20,096][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:59:20,187][52820] DAMAGECOUNT value on done: 539444.0 [2024-08-06 04:59:20,188][52820] Sum rewards: 74.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.063', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.306', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.414', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:20,402][52663] DAMAGECOUNT value on done: 579803.0 [2024-08-06 04:59:20,403][52663] Sum rewards: 62.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.509', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.205', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.000'} [2024-08-06 04:59:22,109][52670] DAMAGECOUNT value on done: 585234.0 [2024-08-06 04:59:22,111][52670] Sum rewards: 70.724, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon5': '0.130', 'AMMO3': '0.175', 'weapon4': '0.188', 'weapon2': '0.256', 'AMMO4': '0.288', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:22,620][52666] DAMAGECOUNT value on done: 573180.0 [2024-08-06 04:59:22,621][52666] Sum rewards: 56.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.019', 'weapon5': '0.032', 'AMMO2': '0.036', 'weapon4': '0.124', 'AMMO4': '0.182', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.162', 'DAMAGECOUNT': '14.190', 'FRAGCOUNT': '49.500'} [2024-08-06 04:59:22,771][52795] DAMAGECOUNT value on done: 542968.0 [2024-08-06 04:59:22,771][52795] Sum rewards: 77.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.050', 'AMMO4': '0.208', 'weapon5': '0.212', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 472571904. Throughput: 0: 4382.4. Samples: 118146520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:59:22,794][52567] Avg episode reward: [(0, '72.219')] [2024-08-06 04:59:22,874][52667] DAMAGECOUNT value on done: 586745.0 [2024-08-06 04:59:22,874][52667] Sum rewards: 53.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.200', 'weapon5': '0.264', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.450', 'weapon3': '2.722', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '45.000'} [2024-08-06 04:59:23,443][52820] DAMAGECOUNT value on done: 547057.0 [2024-08-06 04:59:23,443][52820] Sum rewards: 69.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.784', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.082', 'AMMO4': '0.193', 'weapon5': '0.228', 'weapon2': '0.244', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.130', 'weapon3': '3.198', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:23,544][52663] DAMAGECOUNT value on done: 575928.0 [2024-08-06 04:59:23,545][52663] Sum rewards: 73.069, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.122', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.290', 'AMMO3': '0.294', 'WEAPON3': '1.800', 'weapon3': '3.338', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '65.000'} [2024-08-06 04:59:24,194][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:59:24,550][52650] Updated weights for policy 0, policy_version 57691 (0.0013) [2024-08-06 04:59:25,111][52670] DAMAGECOUNT value on done: 578528.0 [2024-08-06 04:59:25,120][52670] Sum rewards: 71.068, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO4': '0.165', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.244', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:25,810][52649] DAMAGECOUNT value on done: 563252.0 [2024-08-06 04:59:25,813][52649] Sum rewards: 68.921, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.364', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.128', 'weapon5': '0.206', 'AMMO4': '0.218', 'AMMO3': '0.239', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:25,852][52666] DAMAGECOUNT value on done: 578133.0 [2024-08-06 04:59:25,853][52666] Sum rewards: 66.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'weapon4': '0.106', 'weapon5': '0.176', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.204', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.000'} [2024-08-06 04:59:26,152][52663] DAMAGECOUNT value on done: 572418.0 [2024-08-06 04:59:26,153][52663] Sum rewards: 67.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.215', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '56.000'} [2024-08-06 04:59:26,259][52667] DAMAGECOUNT value on done: 576583.0 [2024-08-06 04:59:26,260][52667] Sum rewards: 70.021, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.602', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.168', 'AMMO4': '0.187', 'weapon2': '0.222', 'AMMO3': '0.256', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:26,639][52820] DAMAGECOUNT value on done: 541915.0 [2024-08-06 04:59:26,639][52820] Sum rewards: 66.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.494', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.206', 'weapon5': '0.232', 'weapon2': '0.242', 'AMMO4': '0.275', 'WEAPON4': '0.400', 'weapon4': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '54.000'} [2024-08-06 04:59:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 472662016. Throughput: 0: 4369.3. Samples: 118172520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:59:27,794][52567] Avg episode reward: [(0, '71.758')] [2024-08-06 04:59:28,102][52670] DAMAGECOUNT value on done: 567188.0 [2024-08-06 04:59:28,102][52670] Sum rewards: 70.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.199', 'AMMO4': '0.213', 'weapon4': '0.218', 'weapon5': '0.218', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.780', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:28,461][52664] DAMAGECOUNT value on done: 601902.0 [2024-08-06 04:59:28,461][52664] Sum rewards: 55.592, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.460', 'AMMO5': '0.032', 'AMMO2': '0.093', 'weapon2': '0.270', 'AMMO3': '0.272', 'weapon5': '0.410', 'weapon4': '0.444', 'AMMO4': '0.465', 'WEAPON5': '0.900', 'WEAPON4': '0.950', 'WEAPON3': '1.550', 'weapon3': '2.396', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '50.000'} [2024-08-06 04:59:28,786][52666] DAMAGECOUNT value on done: 577406.0 [2024-08-06 04:59:28,787][52666] Sum rewards: 63.568, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.125', 'weapon5': '0.138', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '0.950', 'HITCOUNT': '2.820', 'weapon3': '3.250', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '50.000'} [2024-08-06 04:59:28,934][52649] DAMAGECOUNT value on done: 555836.0 [2024-08-06 04:59:28,934][52649] Sum rewards: 77.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.019', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon2': '0.182', 'AMMO4': '0.194', 'weapon4': '0.196', 'weapon5': '0.198', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:29,196][52663] DAMAGECOUNT value on done: 579829.0 [2024-08-06 04:59:29,197][52663] Sum rewards: 75.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.152', 'AMMO3': '0.219', 'weapon2': '0.272', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.276', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '65.000'} [2024-08-06 04:59:29,234][52667] DAMAGECOUNT value on done: 586733.0 [2024-08-06 04:59:29,235][52667] Sum rewards: 67.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.722', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.153', 'weapon2': '0.182', 'weapon5': '0.182', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'ARMOR': '0.460', 'weapon4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.704', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '52.000'} [2024-08-06 04:59:29,410][52650] Updated weights for policy 0, policy_version 57701 (0.0012) [2024-08-06 04:59:29,603][52820] DAMAGECOUNT value on done: 544195.0 [2024-08-06 04:59:29,604][52820] Sum rewards: 70.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.142', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.209', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:30,792][52670] DAMAGECOUNT value on done: 575591.0 [2024-08-06 04:59:30,795][52670] Sum rewards: 66.502, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.781', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.070', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.282', 'weapon2': '0.328', 'WEAPON3': '1.700', 'weapon3': '3.234', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:31,266][52666] DAMAGECOUNT value on done: 578669.0 [2024-08-06 04:59:31,268][52666] Sum rewards: 82.169, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.648', 'weapon4': '0.002', 'AMMO2': '0.008', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon2': '0.228', 'WEAPON3': '1.350', 'HITCOUNT': '3.600', 'weapon3': '3.628', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '69.000'} [2024-08-06 04:59:31,415][52664] DAMAGECOUNT value on done: 606668.0 [2024-08-06 04:59:31,416][52664] Sum rewards: 65.826, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.509', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.206', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '53.000'} [2024-08-06 04:59:31,717][52811] DAMAGECOUNT value on done: 554872.0 [2024-08-06 04:59:31,717][52811] Sum rewards: 67.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.497', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.174', 'weapon5': '0.198', 'AMMO3': '0.227', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '56.500'} [2024-08-06 04:59:31,874][52649] DAMAGECOUNT value on done: 574824.0 [2024-08-06 04:59:31,876][52649] Sum rewards: 65.163, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.974', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.076', 'AMMO4': '0.166', 'weapon5': '0.188', 'AMMO3': '0.260', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '55.000'} [2024-08-06 04:59:31,985][52663] DAMAGECOUNT value on done: 589674.0 [2024-08-06 04:59:31,986][52663] Sum rewards: 80.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.106', 'AMMO4': '0.119', 'weapon5': '0.126', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.270', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:32,151][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 04:59:32,209][52667] DAMAGECOUNT value on done: 591178.0 [2024-08-06 04:59:32,210][52667] Sum rewards: 87.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.138', 'weapon5': '0.142', 'AMMO4': '0.203', 'AMMO3': '0.219', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.219', 'FRAGCOUNT': '73.000'} [2024-08-06 04:59:32,682][52820] DAMAGECOUNT value on done: 541006.0 [2024-08-06 04:59:32,683][52820] Sum rewards: 78.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.151', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.098', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon2': '0.374', 'WEAPON3': '1.000', 'weapon3': '3.322', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 472743936. Throughput: 0: 4371.6. Samples: 118185760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:59:32,794][52567] Avg episode reward: [(0, '71.830')] [2024-08-06 04:59:33,522][52670] DAMAGECOUNT value on done: 574842.0 [2024-08-06 04:59:33,522][52670] Sum rewards: 73.039, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.622', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.124', 'weapon4': '0.158', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.600', 'weapon3': '3.214', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:33,916][52664] DAMAGECOUNT value on done: 605338.0 [2024-08-06 04:59:33,918][52664] Sum rewards: 70.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO3': '0.177', 'AMMO4': '0.192', 'weapon2': '0.228', 'weapon4': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 04:59:34,048][52650] Updated weights for policy 0, policy_version 57711 (0.0015) [2024-08-06 04:59:34,158][52666] DAMAGECOUNT value on done: 573544.0 [2024-08-06 04:59:34,159][52666] Sum rewards: 64.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.292', 'weapon4': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.000'} [2024-08-06 04:59:34,360][52663] DAMAGECOUNT value on done: 574234.0 [2024-08-06 04:59:34,361][52663] Sum rewards: 69.019, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '54.000'} [2024-08-06 04:59:34,822][52811] DAMAGECOUNT value on done: 538788.0 [2024-08-06 04:59:34,824][52811] Sum rewards: 86.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.116', 'weapon4': '0.122', 'AMMO4': '0.155', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '69.000'} [2024-08-06 04:59:35,242][52649] DAMAGECOUNT value on done: 568703.0 [2024-08-06 04:59:35,242][52649] Sum rewards: 76.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.146', 'AMMO4': '0.166', 'AMMO3': '0.200', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:35,259][52667] DAMAGECOUNT value on done: 591534.0 [2024-08-06 04:59:35,260][52667] Sum rewards: 66.522, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.685', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon4': '0.150', 'weapon5': '0.152', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.280', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '57.500'} [2024-08-06 04:59:35,806][52820] DAMAGECOUNT value on done: 541506.0 [2024-08-06 04:59:35,806][52820] Sum rewards: 69.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.073', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.098', 'weapon4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.244', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:36,322][52670] DAMAGECOUNT value on done: 573732.0 [2024-08-06 04:59:36,322][52670] Sum rewards: 78.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.115', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.191', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '3.352', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:36,838][52666] DAMAGECOUNT value on done: 574191.0 [2024-08-06 04:59:36,839][52666] Sum rewards: 60.609, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.010', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon4': '0.222', 'AMMO4': '0.290', 'AMMO3': '0.301', 'weapon2': '0.324', 'weapon5': '0.390', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'HITCOUNT': '2.630', 'weapon3': '2.678', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '55.000'} [2024-08-06 04:59:37,127][52663] DAMAGECOUNT value on done: 571510.0 [2024-08-06 04:59:37,128][52663] Sum rewards: 70.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.021', 'AMMO2': '0.069', 'weapon2': '0.184', 'AMMO3': '0.211', 'weapon5': '0.336', 'AMMO4': '0.346', 'weapon4': '0.412', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:37,139][52664] DAMAGECOUNT value on done: 597352.0 [2024-08-06 04:59:37,140][52664] Sum rewards: 65.629, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.154', 'weapon5': '0.168', 'weapon2': '0.224', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '3.328', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '55.000'} [2024-08-06 04:59:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17481.4, 300 sec: 17494.8). Total num frames: 472834048. Throughput: 0: 4378.7. Samples: 118212060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:59:37,794][52567] Avg episode reward: [(0, '71.790')] [2024-08-06 04:59:37,886][52811] DAMAGECOUNT value on done: 537052.0 [2024-08-06 04:59:37,886][52811] Sum rewards: 69.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.145', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.848', 'WEAPON3': '1.400', 'weapon3': '2.720', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '57.000'} [2024-08-06 04:59:37,944][52649] DAMAGECOUNT value on done: 557449.0 [2024-08-06 04:59:37,945][52649] Sum rewards: 82.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.742', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.223', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '70.000'} [2024-08-06 04:59:38,191][52667] DAMAGECOUNT value on done: 590157.0 [2024-08-06 04:59:38,191][52667] Sum rewards: 79.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.140', 'AMMO3': '0.213', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.330', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:38,518][52650] Updated weights for policy 0, policy_version 57721 (0.0019) [2024-08-06 04:59:38,894][52820] DAMAGECOUNT value on done: 550334.0 [2024-08-06 04:59:38,897][52820] Sum rewards: 71.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.112', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:39,128][52670] DAMAGECOUNT value on done: 579298.0 [2024-08-06 04:59:39,128][52670] Sum rewards: 66.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.934', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon2': '0.198', 'AMMO3': '0.219', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.244', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:39,746][52663] DAMAGECOUNT value on done: 575743.0 [2024-08-06 04:59:39,749][52663] Sum rewards: 84.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.884', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.274', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '21.021', 'FRAGCOUNT': '67.000'} [2024-08-06 04:59:39,812][52666] DAMAGECOUNT value on done: 569406.0 [2024-08-06 04:59:39,812][52666] Sum rewards: 61.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.690', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.094', 'weapon5': '0.134', 'AMMO4': '0.209', 'AMMO3': '0.218', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.104', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '53.000'} [2024-08-06 04:59:39,958][52664] DAMAGECOUNT value on done: 605171.0 [2024-08-06 04:59:39,960][52664] Sum rewards: 77.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.562', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.219', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.438', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:40,865][52649] DAMAGECOUNT value on done: 570268.0 [2024-08-06 04:59:40,880][52649] Sum rewards: 80.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO3': '0.212', 'AMMO4': '0.265', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '67.000'} [2024-08-06 04:59:40,964][52811] DAMAGECOUNT value on done: 538896.0 [2024-08-06 04:59:40,966][52811] Sum rewards: 74.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.128', 'AMMO5': '0.006', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'weapon4': '0.130', 'weapon5': '0.142', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '61.000'} [2024-08-06 04:59:41,011][52667] DAMAGECOUNT value on done: 581489.0 [2024-08-06 04:59:41,013][52667] Sum rewards: 73.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.362', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON1': '0.010', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.230', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.886', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '61.000'} [2024-08-06 04:59:41,448][52669] DAMAGECOUNT value on done: 585842.0 [2024-08-06 04:59:41,448][52669] Sum rewards: 81.916, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.023', 'weapon4': '0.084', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.302', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '65.000'} [2024-08-06 04:59:41,946][52670] DAMAGECOUNT value on done: 567112.0 [2024-08-06 04:59:41,948][52670] Sum rewards: 58.608, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.147', 'AMMO3': '0.169', 'weapon5': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '46.000'} [2024-08-06 04:59:41,976][52820] DAMAGECOUNT value on done: 548557.0 [2024-08-06 04:59:41,976][52820] Sum rewards: 80.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.646', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:42,371][52663] DAMAGECOUNT value on done: 574292.0 [2024-08-06 04:59:42,371][52663] Sum rewards: 65.811, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.164', 'AMMO3': '0.202', 'weapon4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '55.000'} [2024-08-06 04:59:42,475][52666] DAMAGECOUNT value on done: 581330.0 [2024-08-06 04:59:42,475][52666] Sum rewards: 83.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.900', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.492', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '69.000'} [2024-08-06 04:59:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.4, 300 sec: 17494.8). Total num frames: 472924160. Throughput: 0: 4377.8. Samples: 118238170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:59:42,794][52567] Avg episode reward: [(0, '71.575')] [2024-08-06 04:59:43,195][52664] DAMAGECOUNT value on done: 603154.0 [2024-08-06 04:59:43,195][52664] Sum rewards: 76.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.618', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.159', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:43,451][52650] Updated weights for policy 0, policy_version 57731 (0.0031) [2024-08-06 04:59:43,717][52649] DAMAGECOUNT value on done: 564938.0 [2024-08-06 04:59:43,720][52649] Sum rewards: 74.606, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.030', 'HEALTH': '0.078', 'AMMO4': '0.151', 'weapon5': '0.154', 'weapon2': '0.166', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:43,955][52667] DAMAGECOUNT value on done: 589238.0 [2024-08-06 04:59:43,955][52667] Sum rewards: 80.300, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.824', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO3': '0.143', 'AMMO4': '0.180', 'weapon5': '0.318', 'WEAPON4': '0.350', 'weapon4': '0.350', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.608', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:44,192][52811] DAMAGECOUNT value on done: 545370.0 [2024-08-06 04:59:44,193][52811] Sum rewards: 55.680, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.294', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.176', 'weapon5': '0.186', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.650', 'HITCOUNT': '2.930', 'weapon3': '3.004', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '50.000'} [2024-08-06 04:59:44,397][52669] DAMAGECOUNT value on done: 575227.0 [2024-08-06 04:59:44,398][52669] Sum rewards: 65.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.240', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '53.000'} [2024-08-06 04:59:44,813][52670] DAMAGECOUNT value on done: 575447.0 [2024-08-06 04:59:44,813][52670] Sum rewards: 82.629, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.922', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.104', 'AMMO3': '0.138', 'weapon2': '0.368', 'WEAPON3': '0.900', 'weapon3': '3.470', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 04:59:45,098][52820] DAMAGECOUNT value on done: 534272.0 [2024-08-06 04:59:45,098][52820] Sum rewards: 79.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.942', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:45,327][52666] DAMAGECOUNT value on done: 575750.0 [2024-08-06 04:59:45,330][52666] Sum rewards: 68.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.100', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.128', 'weapon4': '0.188', 'AMMO4': '0.206', 'AMMO3': '0.230', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:45,671][52664] DAMAGECOUNT value on done: 599418.0 [2024-08-06 04:59:45,674][52664] Sum rewards: 73.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.805', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.138', 'weapon5': '0.176', 'AMMO4': '0.213', 'AMMO3': '0.219', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:45,695][52663] DAMAGECOUNT value on done: 585533.0 [2024-08-06 04:59:45,695][52663] Sum rewards: 55.164, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.440', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon5': '0.148', 'weapon4': '0.264', 'AMMO3': '0.286', 'AMMO4': '0.286', 'weapon2': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.932', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '50.500'} [2024-08-06 04:59:46,905][52649] DAMAGECOUNT value on done: 566705.0 [2024-08-06 04:59:46,905][52649] Sum rewards: 69.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.112', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.088', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.000', 'weapon3': '3.228', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '56.000'} [2024-08-06 04:59:47,275][52811] DAMAGECOUNT value on done: 550351.0 [2024-08-06 04:59:47,276][52811] Sum rewards: 75.758, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.022', 'AMMO4': '0.070', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'weapon2': '0.574', 'WEAPON3': '1.000', 'weapon3': '3.158', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:47,420][52671] DAMAGECOUNT value on done: 589929.0 [2024-08-06 04:59:47,422][52671] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO3': '0.172', 'AMMO4': '0.188', 'weapon4': '0.240', 'weapon5': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '2.764', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:47,572][52669] DAMAGECOUNT value on done: 586123.0 [2024-08-06 04:59:47,573][52669] Sum rewards: 62.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.162', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '52.000'} [2024-08-06 04:59:47,650][52670] DAMAGECOUNT value on done: 584261.0 [2024-08-06 04:59:47,650][52670] Sum rewards: 81.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.144', 'weapon4': '0.162', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '67.000'} [2024-08-06 04:59:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 473006080. Throughput: 0: 4382.2. Samples: 118251480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 04:59:47,794][52567] Avg episode reward: [(0, '71.336')] [2024-08-06 04:59:47,917][52650] Updated weights for policy 0, policy_version 57741 (0.0014) [2024-08-06 04:59:48,172][52664] DAMAGECOUNT value on done: 595852.0 [2024-08-06 04:59:48,174][52664] Sum rewards: 56.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.839', 'AMMO5': '0.023', 'AMMO2': '0.070', 'AMMO3': '0.154', 'weapon4': '0.212', 'weapon5': '0.308', 'AMMO4': '0.351', 'WEAPON5': '0.600', 'weapon2': '0.690', 'WEAPON4': '0.700', 'WEAPON3': '0.900', 'weapon3': '2.486', 'HITCOUNT': '2.550', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '47.000'} [2024-08-06 04:59:48,215][52666] DAMAGECOUNT value on done: 580055.0 [2024-08-06 04:59:48,218][52666] Sum rewards: 71.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:48,835][52663] DAMAGECOUNT value on done: 574824.0 [2024-08-06 04:59:48,836][52663] Sum rewards: 74.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.243', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon2': '0.234', 'AMMO3': '0.237', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:49,230][52658] DAMAGECOUNT value on done: 583612.0 [2024-08-06 04:59:49,231][52658] Sum rewards: 75.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.740', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.176', 'weapon2': '0.198', 'AMMO4': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.994', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:49,506][52665] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 04:59:50,080][52649] DAMAGECOUNT value on done: 569986.0 [2024-08-06 04:59:50,080][52649] Sum rewards: 66.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.022', 'weapon5': '0.042', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.478', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:50,291][52671] DAMAGECOUNT value on done: 588469.0 [2024-08-06 04:59:50,292][52671] Sum rewards: 80.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.122', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '68.000'} [2024-08-06 04:59:50,514][52811] DAMAGECOUNT value on done: 547516.0 [2024-08-06 04:59:50,515][52811] Sum rewards: 71.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.362', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.194', 'AMMO3': '0.214', 'weapon2': '0.220', 'AMMO4': '0.265', 'weapon5': '0.306', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '2.982', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '57.000'} [2024-08-06 04:59:50,554][52670] DAMAGECOUNT value on done: 580218.0 [2024-08-06 04:59:50,556][52670] Sum rewards: 70.151, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.150', 'weapon2': '0.154', 'AMMO4': '0.190', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.472', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:50,796][52664] DAMAGECOUNT value on done: 607519.0 [2024-08-06 04:59:50,797][52664] Sum rewards: 74.894, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.011', 'AMMO2': '0.041', 'AMMO3': '0.171', 'weapon5': '0.172', 'weapon4': '0.184', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '58.000'} [2024-08-06 04:59:50,802][52669] DAMAGECOUNT value on done: 585585.0 [2024-08-06 04:59:50,804][52669] Sum rewards: 57.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.247', 'weapon2': '0.312', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.348', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '50.000'} [2024-08-06 04:59:51,264][52666] DAMAGECOUNT value on done: 574115.0 [2024-08-06 04:59:51,265][52666] Sum rewards: 71.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.012', 'weapon4': '0.024', 'AMMO2': '0.038', 'weapon5': '0.054', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:51,705][52663] DAMAGECOUNT value on done: 585736.0 [2024-08-06 04:59:51,706][52663] Sum rewards: 76.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.967', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.084', 'AMMO4': '0.173', 'weapon5': '0.182', 'AMMO3': '0.192', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:52,150][52658] DAMAGECOUNT value on done: 582039.0 [2024-08-06 04:59:52,151][52658] Sum rewards: 70.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.144', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:52,626][52650] Updated weights for policy 0, policy_version 57751 (0.0028) [2024-08-06 04:59:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 473096192. Throughput: 0: 4376.4. Samples: 118277640. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 04:59:52,795][52567] Avg episode reward: [(0, '71.329')] [2024-08-06 04:59:53,133][52649] DAMAGECOUNT value on done: 560084.0 [2024-08-06 04:59:53,134][52649] Sum rewards: 80.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.122', 'weapon4': '0.134', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '67.000'} [2024-08-06 04:59:53,205][52671] DAMAGECOUNT value on done: 586190.0 [2024-08-06 04:59:53,205][52671] Sum rewards: 63.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.518', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon4': '0.126', 'AMMO3': '0.156', 'AMMO4': '0.214', 'weapon5': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.844', 'WEAPON3': '1.000', 'weapon3': '2.378', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '50.000'} [2024-08-06 04:59:53,627][52811] DAMAGECOUNT value on done: 540612.0 [2024-08-06 04:59:53,631][52811] Sum rewards: 64.692, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.630', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.212', 'weapon2': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.678', 'WEAPON3': '0.900', 'weapon3': '2.614', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '51.000'} [2024-08-06 04:59:53,666][52669] DAMAGECOUNT value on done: 581280.0 [2024-08-06 04:59:53,667][52669] Sum rewards: 78.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.128', 'weapon5': '0.168', 'AMMO3': '0.212', 'AMMO4': '0.229', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:53,678][52670] DAMAGECOUNT value on done: 563017.0 [2024-08-06 04:59:53,678][52670] Sum rewards: 74.126, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.642', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.168', 'AMMO4': '0.207', 'AMMO3': '0.259', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:53,972][52664] DAMAGECOUNT value on done: 600194.0 [2024-08-06 04:59:53,975][52664] Sum rewards: 77.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.068', 'weapon4': '0.072', 'AMMO4': '0.152', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:54,400][52666] DAMAGECOUNT value on done: 577781.0 [2024-08-06 04:59:54,400][52666] Sum rewards: 80.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:54,790][52663] DAMAGECOUNT value on done: 586523.0 [2024-08-06 04:59:54,790][52663] Sum rewards: 80.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.868', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.386', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:55,260][52658] DAMAGECOUNT value on done: 588175.0 [2024-08-06 04:59:55,262][52658] Sum rewards: 73.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.220', 'weapon2': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.538', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '62.000'} [2024-08-06 04:59:55,643][52649] DAMAGECOUNT value on done: 572806.0 [2024-08-06 04:59:55,643][52649] Sum rewards: 87.631, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.158', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.147', 'AMMO3': '0.221', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '72.000'} [2024-08-06 04:59:56,163][52671] DAMAGECOUNT value on done: 586729.0 [2024-08-06 04:59:56,164][52671] Sum rewards: 79.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.438', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.138', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:56,547][52670] DAMAGECOUNT value on done: 574482.0 [2024-08-06 04:59:56,549][52670] Sum rewards: 77.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.222', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.093', 'weapon2': '0.112', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '63.000'} [2024-08-06 04:59:56,735][52664] DAMAGECOUNT value on done: 607910.0 [2024-08-06 04:59:56,736][52664] Sum rewards: 68.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.157', 'AMMO4': '0.184', 'weapon2': '0.208', 'weapon5': '0.244', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '2.940', 'weapon3': '2.986', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '55.000'} [2024-08-06 04:59:56,740][52669] DAMAGECOUNT value on done: 587737.0 [2024-08-06 04:59:56,740][52669] Sum rewards: 73.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.381', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.188', 'weapon4': '0.244', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.914', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '64.000'} [2024-08-06 04:59:56,761][52811] DAMAGECOUNT value on done: 551104.0 [2024-08-06 04:59:56,762][52811] Sum rewards: 71.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.092', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.271', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '61.000'} [2024-08-06 04:59:57,417][52666] DAMAGECOUNT value on done: 584228.0 [2024-08-06 04:59:57,427][52666] Sum rewards: 80.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.027', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.124', 'AMMO4': '0.213', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.146', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '70.000'} [2024-08-06 04:59:57,542][52650] Updated weights for policy 0, policy_version 57761 (0.0037) [2024-08-06 04:59:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 473178112. Throughput: 0: 4365.8. Samples: 118303680. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 04:59:57,795][52567] Avg episode reward: [(0, '71.959')] [2024-08-06 04:59:57,825][52663] DAMAGECOUNT value on done: 576067.0 [2024-08-06 04:59:57,849][52663] Sum rewards: 75.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.414', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon2': '0.148', 'AMMO4': '0.185', 'AMMO3': '0.212', 'weapon5': '0.278', 'weapon4': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '61.000'} [2024-08-06 04:59:58,457][52658] DAMAGECOUNT value on done: 587242.0 [2024-08-06 04:59:58,457][52658] Sum rewards: 68.972, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'HEALTH': '0.014', 'AMMO2': '0.020', 'weapon5': '0.036', 'weapon7': '0.074', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon2': '0.192', 'AMMO3': '0.204', 'weapon4': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2024-08-06 04:59:58,660][52671] DAMAGECOUNT value on done: 597118.0 [2024-08-06 04:59:58,661][52671] Sum rewards: 72.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.092', 'weapon5': '0.190', 'AMMO3': '0.202', 'AMMO4': '0.215', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '60.000'} [2024-08-06 04:59:58,794][52649] DAMAGECOUNT value on done: 575335.0 [2024-08-06 04:59:58,794][52649] Sum rewards: 60.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.340', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.184', 'weapon2': '0.572', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.302', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '50.000'} [2024-08-06 04:59:59,585][52669] DAMAGECOUNT value on done: 584506.0 [2024-08-06 04:59:59,586][52669] Sum rewards: 80.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.849', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon4': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'weapon5': '0.392', 'WEAPON5': '0.550', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.534', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '66.000'} [2024-08-06 04:59:59,731][52664] DAMAGECOUNT value on done: 607336.0 [2024-08-06 04:59:59,731][52664] Sum rewards: 67.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.396', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.028', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.406', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '59.000'} [2024-08-06 04:59:59,859][52670] DAMAGECOUNT value on done: 584602.0 [2024-08-06 04:59:59,859][52670] Sum rewards: 71.730, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.377', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.124', 'AMMO4': '0.174', 'weapon5': '0.194', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '61.000'} [2024-08-06 04:59:59,883][52811] DAMAGECOUNT value on done: 545691.0 [2024-08-06 04:59:59,885][52811] Sum rewards: 78.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.963', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:00,415][52803] DAMAGECOUNT value on done: 542488.0 [2024-08-06 05:00:00,419][52803] Sum rewards: 78.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '66.000'} [2024-08-06 05:00:00,785][52666] DAMAGECOUNT value on done: 565982.0 [2024-08-06 05:00:00,787][52666] Sum rewards: 68.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.470', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.104', 'AMMO3': '0.210', 'AMMO4': '0.221', 'weapon5': '0.268', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.028', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '57.000'} [2024-08-06 05:00:01,317][52649] DAMAGECOUNT value on done: 576904.0 [2024-08-06 05:00:01,318][52649] Sum rewards: 81.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.050', 'AMMO4': '0.163', 'AMMO3': '0.185', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '64.000'} [2024-08-06 05:00:01,329][52671] DAMAGECOUNT value on done: 587913.0 [2024-08-06 05:00:01,330][52671] Sum rewards: 67.375, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.106', 'weapon5': '0.196', 'AMMO4': '0.239', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '2.910', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '58.000'} [2024-08-06 05:00:01,598][52658] DAMAGECOUNT value on done: 576028.0 [2024-08-06 05:00:01,599][52658] Sum rewards: 76.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.004', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO4': '0.195', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 05:00:01,904][52650] Updated weights for policy 0, policy_version 57771 (0.0032) [2024-08-06 05:00:02,524][52670] DAMAGECOUNT value on done: 574191.0 [2024-08-06 05:00:02,532][52670] Sum rewards: 72.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.713', 'AMMO5': '0.021', 'AMMO2': '0.069', 'weapon4': '0.092', 'weapon5': '0.188', 'AMMO3': '0.218', 'AMMO4': '0.343', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.660', 'WEAPON3': '1.350', 'weapon3': '2.784', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:02,692][52669] DAMAGECOUNT value on done: 583483.0 [2024-08-06 05:00:02,692][52669] Sum rewards: 71.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.020', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.174', 'AMMO4': '0.179', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 473260032. Throughput: 0: 4360.4. Samples: 118316470. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:00:02,794][52567] Avg episode reward: [(0, '72.895')] [2024-08-06 05:00:02,795][52664] DAMAGECOUNT value on done: 611329.0 [2024-08-06 05:00:02,795][52664] Sum rewards: 80.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.170', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.324', 'weapon2': '0.592', 'WEAPON3': '1.050', 'weapon3': '2.552', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:03,040][52811] DAMAGECOUNT value on done: 547137.0 [2024-08-06 05:00:03,041][52811] Sum rewards: 76.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.146', 'weapon5': '0.202', 'AMMO3': '0.208', 'AMMO4': '0.269', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '63.000'} [2024-08-06 05:00:03,199][52666] DAMAGECOUNT value on done: 576825.0 [2024-08-06 05:00:03,201][52666] Sum rewards: 79.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.166', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.142', 'weapon5': '0.194', 'AMMO3': '0.218', 'weapon2': '0.220', 'AMMO4': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:03,618][52803] DAMAGECOUNT value on done: 540976.0 [2024-08-06 05:00:03,618][52803] Sum rewards: 72.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.132', 'AMMO4': '0.194', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:04,118][52671] DAMAGECOUNT value on done: 592460.0 [2024-08-06 05:00:04,119][52671] Sum rewards: 66.621, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.444', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon7': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.165', 'WEAPON7': '0.200', 'weapon5': '0.206', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON4': '0.500', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '2.282', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '54.000'} [2024-08-06 05:00:04,138][52649] DAMAGECOUNT value on done: 573003.0 [2024-08-06 05:00:04,138][52649] Sum rewards: 69.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.293', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.100', 'AMMO4': '0.127', 'weapon5': '0.142', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.258', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2024-08-06 05:00:04,798][52658] DAMAGECOUNT value on done: 578722.0 [2024-08-06 05:00:04,801][52658] Sum rewards: 67.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.120', 'weapon4': '0.124', 'AMMO3': '0.204', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.744', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '55.000'} [2024-08-06 05:00:05,426][52669] DAMAGECOUNT value on done: 591788.0 [2024-08-06 05:00:05,428][52669] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.827', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.038', 'weapon5': '0.090', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'WEAPON3': '0.900', 'weapon2': '0.982', 'weapon3': '2.770', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '51.000'} [2024-08-06 05:00:05,712][52670] DAMAGECOUNT value on done: 579037.0 [2024-08-06 05:00:05,714][52670] Sum rewards: 67.127, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.194', 'HEALTH': '0.231', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon5': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '55.000'} [2024-08-06 05:00:05,726][52664] DAMAGECOUNT value on done: 611057.0 [2024-08-06 05:00:05,726][52664] Sum rewards: 83.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.550', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.241', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.146', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '71.000'} [2024-08-06 05:00:06,220][52811] DAMAGECOUNT value on done: 553607.0 [2024-08-06 05:00:06,222][52811] Sum rewards: 76.214, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.455', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.038', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.153', 'weapon2': '0.644', 'WEAPON3': '0.950', 'weapon3': '3.118', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:06,473][52671] DAMAGECOUNT value on done: 586977.0 [2024-08-06 05:00:06,474][52671] Sum rewards: 68.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.692', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.256', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '58.000'} [2024-08-06 05:00:06,756][52803] DAMAGECOUNT value on done: 547437.0 [2024-08-06 05:00:06,762][52803] Sum rewards: 67.086, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.557', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.042', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon2': '0.372', 'WEAPON3': '0.950', 'HITCOUNT': '3.270', 'weapon3': '3.284', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '53.000'} [2024-08-06 05:00:06,799][52650] Updated weights for policy 0, policy_version 57781 (0.0010) [2024-08-06 05:00:07,021][52649] DAMAGECOUNT value on done: 563597.0 [2024-08-06 05:00:07,024][52649] Sum rewards: 57.298, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.538', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon4': '0.198', 'weapon2': '0.312', 'AMMO4': '0.330', 'AMMO3': '0.331', 'weapon5': '0.332', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.850', 'weapon3': '2.690', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '53.000'} [2024-08-06 05:00:07,382][52614] Signal inference workers to stop experience collection... (10500 times) [2024-08-06 05:00:07,384][52614] Signal inference workers to resume experience collection... (10500 times) [2024-08-06 05:00:07,447][52650] InferenceWorker_p0-w0: stopping experience collection (10500 times) [2024-08-06 05:00:07,447][52650] InferenceWorker_p0-w0: resuming experience collection (10500 times) [2024-08-06 05:00:07,744][52668] DAMAGECOUNT value on done: 583152.0 [2024-08-06 05:00:07,752][52668] Sum rewards: 68.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.498', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.172', 'weapon5': '0.198', 'AMMO4': '0.221', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.588', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 473358336. Throughput: 0: 4365.6. Samples: 118342970. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:00:07,794][52567] Avg episode reward: [(0, '72.650')] [2024-08-06 05:00:07,871][52658] DAMAGECOUNT value on done: 587468.0 [2024-08-06 05:00:07,872][52658] Sum rewards: 77.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.515', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'weapon5': '0.018', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.185', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.536', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '63.500'} [2024-08-06 05:00:08,237][52669] DAMAGECOUNT value on done: 583463.0 [2024-08-06 05:00:08,238][52669] Sum rewards: 69.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.870', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.220', 'weapon2': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.190', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:08,390][52664] DAMAGECOUNT value on done: 611455.0 [2024-08-06 05:00:08,391][52664] Sum rewards: 67.073, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.166', 'AMMO4': '0.212', 'weapon4': '0.212', 'AMMO3': '0.230', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '57.000'} [2024-08-06 05:00:08,434][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:00:09,072][52671] DAMAGECOUNT value on done: 579837.0 [2024-08-06 05:00:09,073][52671] Sum rewards: 75.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.780', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.142', 'weapon4': '0.218', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '63.000'} [2024-08-06 05:00:09,236][52811] DAMAGECOUNT value on done: 542998.0 [2024-08-06 05:00:09,236][52811] Sum rewards: 77.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.205', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:09,809][52803] DAMAGECOUNT value on done: 550747.0 [2024-08-06 05:00:09,810][52803] Sum rewards: 66.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.160', 'weapon2': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.650', 'weapon3': '3.036', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '57.000'} [2024-08-06 05:00:10,104][52649] DAMAGECOUNT value on done: 571370.0 [2024-08-06 05:00:10,105][52649] Sum rewards: 73.424, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.287', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.312', 'weapon4': '0.414', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:10,571][52668] DAMAGECOUNT value on done: 586688.0 [2024-08-06 05:00:10,572][52668] Sum rewards: 88.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.454', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.233', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.015', 'FRAGCOUNT': '73.000'} [2024-08-06 05:00:10,793][52658] DAMAGECOUNT value on done: 578669.0 [2024-08-06 05:00:10,794][52658] Sum rewards: 68.398, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.186', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.158', 'weapon2': '0.170', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.318', 'WEAPON3': '1.750', 'weapon3': '3.174', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:11,066][52664] DAMAGECOUNT value on done: 604303.0 [2024-08-06 05:00:11,067][52664] Sum rewards: 74.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.585', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon4': '0.292', 'ARMOR': '0.453', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '64.000'} [2024-08-06 05:00:11,153][52669] DAMAGECOUNT value on done: 588975.0 [2024-08-06 05:00:11,154][52669] Sum rewards: 61.168, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.820', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon4': '0.066', 'weapon5': '0.148', 'AMMO3': '0.249', 'AMMO4': '0.275', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.190', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '55.000'} [2024-08-06 05:00:11,511][52650] Updated weights for policy 0, policy_version 57791 (0.0012) [2024-08-06 05:00:11,935][52671] DAMAGECOUNT value on done: 587246.0 [2024-08-06 05:00:11,939][52671] Sum rewards: 65.133, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.054', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.172', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'weapon4': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.774', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '51.500'} [2024-08-06 05:00:12,397][52811] DAMAGECOUNT value on done: 537258.0 [2024-08-06 05:00:12,399][52811] Sum rewards: 72.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.122', 'weapon5': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.236', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.340', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '61.000'} [2024-08-06 05:00:12,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 473448448. Throughput: 0: 4372.9. Samples: 118369300. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:00:12,802][52567] Avg episode reward: [(0, '72.625')] [2024-08-06 05:00:12,853][52803] DAMAGECOUNT value on done: 544046.0 [2024-08-06 05:00:12,854][52803] Sum rewards: 76.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.015', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:13,110][52649] DAMAGECOUNT value on done: 560468.0 [2024-08-06 05:00:13,112][52649] Sum rewards: 70.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.058', 'weapon4': '0.106', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.246', 'WEAPON3': '1.500', 'HITCOUNT': '3.370', 'weapon3': '3.418', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:13,171][52658] DAMAGECOUNT value on done: 597410.0 [2024-08-06 05:00:13,171][52658] Sum rewards: 66.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon2': '0.188', 'AMMO3': '0.202', 'AMMO4': '0.206', 'weapon5': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '55.000'} [2024-08-06 05:00:13,372][52668] DAMAGECOUNT value on done: 585319.0 [2024-08-06 05:00:13,372][52668] Sum rewards: 61.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.294', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.112', 'AMMO4': '0.147', 'AMMO3': '0.206', 'weapon5': '0.222', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '51.000'} [2024-08-06 05:00:13,973][52669] DAMAGECOUNT value on done: 588682.0 [2024-08-06 05:00:13,973][52669] Sum rewards: 62.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.164', 'weapon5': '0.216', 'AMMO3': '0.237', 'AMMO4': '0.242', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '53.500'} [2024-08-06 05:00:14,310][52664] DAMAGECOUNT value on done: 599118.0 [2024-08-06 05:00:14,310][52664] Sum rewards: 78.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.920', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.064', 'AMMO4': '0.130', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:15,069][52671] DAMAGECOUNT value on done: 587294.0 [2024-08-06 05:00:15,070][52671] Sum rewards: 71.346, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.089', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.000'} [2024-08-06 05:00:15,541][52811] DAMAGECOUNT value on done: 544647.0 [2024-08-06 05:00:15,541][52811] Sum rewards: 84.341, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.977', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.060', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.220', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '71.000'} [2024-08-06 05:00:15,891][52803] DAMAGECOUNT value on done: 538013.0 [2024-08-06 05:00:15,894][52803] Sum rewards: 83.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.136', 'weapon2': '0.182', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '68.000'} [2024-08-06 05:00:15,988][52649] DAMAGECOUNT value on done: 572494.0 [2024-08-06 05:00:15,989][52649] Sum rewards: 82.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.545', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.098', 'weapon5': '0.122', 'AMMO3': '0.170', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '66.500'} [2024-08-06 05:00:16,061][52650] Updated weights for policy 0, policy_version 57801 (0.0020) [2024-08-06 05:00:16,062][52658] DAMAGECOUNT value on done: 582515.0 [2024-08-06 05:00:16,065][52658] Sum rewards: 68.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '57.000'} [2024-08-06 05:00:16,252][52668] DAMAGECOUNT value on done: 586458.0 [2024-08-06 05:00:16,254][52668] Sum rewards: 73.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:16,355][52662] DAMAGECOUNT value on done: 589612.0 [2024-08-06 05:00:16,356][52662] Sum rewards: 68.321, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.035', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.190', 'weapon5': '0.236', 'AMMO3': '0.273', 'AMMO4': '0.295', 'weapon2': '0.366', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.870', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:16,724][52664] DAMAGECOUNT value on done: 604364.0 [2024-08-06 05:00:16,725][52664] Sum rewards: 76.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.095', 'weapon5': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:17,179][52669] DAMAGECOUNT value on done: 575924.0 [2024-08-06 05:00:17,180][52669] Sum rewards: 74.426, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.731', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.096', 'weapon5': '0.110', 'AMMO4': '0.164', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '58.000'} [2024-08-06 05:00:17,481][52671] DAMAGECOUNT value on done: 585133.0 [2024-08-06 05:00:17,481][52671] Sum rewards: 86.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.882', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '72.000'} [2024-08-06 05:00:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 473530368. Throughput: 0: 4374.9. Samples: 118382630. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:00:17,794][52567] Avg episode reward: [(0, '72.559')] [2024-08-06 05:00:18,580][52811] DAMAGECOUNT value on done: 543823.0 [2024-08-06 05:00:18,581][52811] Sum rewards: 66.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.146', 'AMMO3': '0.172', 'weapon4': '0.194', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '2.856', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:18,923][52668] DAMAGECOUNT value on done: 574847.0 [2024-08-06 05:00:18,925][52668] Sum rewards: 83.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.845', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.118', 'weapon2': '0.150', 'weapon4': '0.182', 'AMMO4': '0.193', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '70.000'} [2024-08-06 05:00:18,981][52658] DAMAGECOUNT value on done: 596159.0 [2024-08-06 05:00:18,983][52658] Sum rewards: 69.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.219', 'weapon5': '0.270', 'AMMO4': '0.278', 'weapon2': '0.334', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '57.500'} [2024-08-06 05:00:19,012][52803] DAMAGECOUNT value on done: 538984.0 [2024-08-06 05:00:19,012][52803] Sum rewards: 72.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.072', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:19,116][52649] DAMAGECOUNT value on done: 574100.0 [2024-08-06 05:00:19,117][52649] Sum rewards: 77.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.130', 'AMMO3': '0.196', 'weapon2': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 05:00:19,368][52662] DAMAGECOUNT value on done: 584896.0 [2024-08-06 05:00:19,369][52662] Sum rewards: 65.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.094', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.308', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.364', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:19,413][52664] DAMAGECOUNT value on done: 604562.0 [2024-08-06 05:00:19,413][52664] Sum rewards: 87.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.094', 'weapon5': '0.136', 'AMMO4': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.562', 'FRAGCOUNT': '71.000'} [2024-08-06 05:00:20,096][52669] DAMAGECOUNT value on done: 582758.0 [2024-08-06 05:00:20,096][52669] Sum rewards: 76.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.702', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.270', 'weapon2': '0.272', 'weapon4': '0.290', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:20,326][52671] DAMAGECOUNT value on done: 592260.0 [2024-08-06 05:00:20,326][52671] Sum rewards: 61.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.180', 'AMMO4': '0.201', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.218', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '51.000'} [2024-08-06 05:00:20,863][52650] Updated weights for policy 0, policy_version 57811 (0.0022) [2024-08-06 05:00:21,524][52811] DAMAGECOUNT value on done: 546159.0 [2024-08-06 05:00:21,526][52811] Sum rewards: 64.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.511', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon2': '0.134', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.738', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '54.000'} [2024-08-06 05:00:21,745][52664] DAMAGECOUNT value on done: 603589.0 [2024-08-06 05:00:21,745][52664] Sum rewards: 77.595, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.498', 'AMMO5': '0.022', 'AMMO2': '0.065', 'weapon4': '0.198', 'AMMO3': '0.224', 'weapon5': '0.274', 'weapon2': '0.288', 'AMMO4': '0.326', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.394', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:21,904][52668] DAMAGECOUNT value on done: 589213.0 [2024-08-06 05:00:21,904][52668] Sum rewards: 80.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.044', 'AMMO2': '0.015', 'AMMO5': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.143', 'weapon5': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.050', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:22,070][52658] DAMAGECOUNT value on done: 580315.0 [2024-08-06 05:00:22,071][52658] Sum rewards: 65.115, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.156', 'AMMO4': '0.169', 'weapon4': '0.200', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '0.950', 'weapon3': '2.826', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '53.000'} [2024-08-06 05:00:22,215][52649] DAMAGECOUNT value on done: 567107.0 [2024-08-06 05:00:22,215][52649] Sum rewards: 78.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.932', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.024', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:22,334][52803] DAMAGECOUNT value on done: 535464.0 [2024-08-06 05:00:22,334][52803] Sum rewards: 66.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.770', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.286', 'WEAPON3': '1.600', 'HITCOUNT': '3.370', 'weapon3': '3.434', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '57.000'} [2024-08-06 05:00:22,349][52662] DAMAGECOUNT value on done: 590663.0 [2024-08-06 05:00:22,350][52662] Sum rewards: 78.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.122', 'AMMO4': '0.161', 'AMMO3': '0.227', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '66.000'} [2024-08-06 05:00:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 473620480. Throughput: 0: 4383.6. Samples: 118409320. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:00:22,794][52567] Avg episode reward: [(0, '73.045')] [2024-08-06 05:00:22,847][52669] DAMAGECOUNT value on done: 585332.0 [2024-08-06 05:00:22,848][52669] Sum rewards: 60.893, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon2': '0.316', 'WEAPON3': '1.050', 'HITCOUNT': '2.800', 'weapon3': '3.464', 'DAMAGECOUNT': '13.581', 'FRAGCOUNT': '50.500'} [2024-08-06 05:00:23,357][52671] DAMAGECOUNT value on done: 586596.0 [2024-08-06 05:00:23,358][52671] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.122', 'weapon5': '0.148', 'AMMO4': '0.184', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '59.500'} [2024-08-06 05:00:24,502][52811] DAMAGECOUNT value on done: 550042.0 [2024-08-06 05:00:24,502][52811] Sum rewards: 72.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.704', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.174', 'AMMO4': '0.231', 'weapon5': '0.264', 'weapon4': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.720', 'WEAPON3': '1.100', 'weapon3': '2.380', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:24,900][52668] DAMAGECOUNT value on done: 585937.0 [2024-08-06 05:00:24,902][52668] Sum rewards: 83.406, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.764', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.122', 'weapon5': '0.182', 'weapon2': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.835', 'FRAGCOUNT': '70.000'} [2024-08-06 05:00:25,093][52658] DAMAGECOUNT value on done: 587838.0 [2024-08-06 05:00:25,093][52658] Sum rewards: 66.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.265', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.120', 'AMMO3': '0.183', 'weapon5': '0.188', 'AMMO4': '0.236', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '55.500'} [2024-08-06 05:00:25,115][52662] DAMAGECOUNT value on done: 577062.0 [2024-08-06 05:00:25,115][52662] Sum rewards: 70.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.230', 'AMMO3': '0.255', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:25,244][52650] Updated weights for policy 0, policy_version 57821 (0.0010) [2024-08-06 05:00:25,420][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:00:25,421][52803] DAMAGECOUNT value on done: 542170.0 [2024-08-06 05:00:25,422][52803] Sum rewards: 65.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.063', 'weapon5': '0.188', 'AMMO3': '0.239', 'weapon4': '0.284', 'WEAPON5': '0.300', 'AMMO4': '0.315', 'WEAPON4': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:25,567][52669] DAMAGECOUNT value on done: 602889.0 [2024-08-06 05:00:25,568][52669] Sum rewards: 63.980, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.716', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.396', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '53.000'} [2024-08-06 05:00:26,440][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:00:26,637][52671] DAMAGECOUNT value on done: 573572.0 [2024-08-06 05:00:26,637][52671] Sum rewards: 79.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.725', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.120', 'weapon4': '0.222', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '68.000'} [2024-08-06 05:00:27,596][52811] DAMAGECOUNT value on done: 542246.0 [2024-08-06 05:00:27,599][52811] Sum rewards: 67.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.127', 'weapon4': '0.146', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:27,773][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:00:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 473710592. Throughput: 0: 4384.9. Samples: 118435490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:00:27,794][52567] Avg episode reward: [(0, '72.860')] [2024-08-06 05:00:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057826_473710592.pth... [2024-08-06 05:00:27,907][52658] DAMAGECOUNT value on done: 579378.0 [2024-08-06 05:00:27,909][52658] Sum rewards: 65.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.245', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.156', 'weapon5': '0.168', 'AMMO3': '0.223', 'weapon2': '0.224', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.204', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '55.000'} [2024-08-06 05:00:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057313_469508096.pth [2024-08-06 05:00:28,081][52668] DAMAGECOUNT value on done: 576990.0 [2024-08-06 05:00:28,081][52668] Sum rewards: 83.709, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.910', 'AMMO2': '0.010', 'AMMO5': '0.013', 'AMMO4': '0.049', 'weapon5': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon4': '0.340', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '67.000'} [2024-08-06 05:00:28,171][52662] DAMAGECOUNT value on done: 591900.0 [2024-08-06 05:00:28,172][52662] Sum rewards: 75.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.609', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.156', 'AMMO3': '0.191', 'weapon4': '0.196', 'AMMO4': '0.197', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:28,455][52669] DAMAGECOUNT value on done: 591554.0 [2024-08-06 05:00:28,455][52669] Sum rewards: 76.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.164', 'weapon2': '0.182', 'weapon5': '0.182', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '64.000'} [2024-08-06 05:00:28,729][52803] DAMAGECOUNT value on done: 536013.0 [2024-08-06 05:00:28,731][52803] Sum rewards: 82.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.253', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.172', 'AMMO3': '0.214', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '69.000'} [2024-08-06 05:00:29,278][52803] Large shaping reward 2.555 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.534, 178.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:00:30,095][52650] Updated weights for policy 0, policy_version 57831 (0.0024) [2024-08-06 05:00:30,107][52671] DAMAGECOUNT value on done: 595147.0 [2024-08-06 05:00:30,108][52671] Sum rewards: 81.601, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO4': '0.123', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'WEAPON3': '1.650', 'weapon3': '3.346', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.183', 'FRAGCOUNT': '69.000'} [2024-08-06 05:00:30,641][52811] DAMAGECOUNT value on done: 542741.0 [2024-08-06 05:00:30,644][52811] Sum rewards: 86.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.447', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.084', 'AMMO4': '0.128', 'weapon5': '0.192', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.618', 'FRAGCOUNT': '71.000'} [2024-08-06 05:00:30,822][52658] DAMAGECOUNT value on done: 585908.0 [2024-08-06 05:00:30,822][52658] Sum rewards: 66.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.106', 'weapon4': '0.122', 'AMMO3': '0.176', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.864', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '54.000'} [2024-08-06 05:00:31,077][52668] DAMAGECOUNT value on done: 579036.0 [2024-08-06 05:00:31,079][52668] Sum rewards: 72.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.160', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.326', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:31,390][52669] DAMAGECOUNT value on done: 589518.0 [2024-08-06 05:00:31,390][52669] Sum rewards: 68.878, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.085', 'weapon5': '0.144', 'WEAPON4': '0.150', 'HEALTH': '0.170', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.354', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '55.000'} [2024-08-06 05:00:31,409][52662] DAMAGECOUNT value on done: 579094.0 [2024-08-06 05:00:31,409][52662] Sum rewards: 64.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.442', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.044', 'AMMO4': '0.157', 'weapon4': '0.168', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '3.130', 'weapon3': '3.388', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '53.000'} [2024-08-06 05:00:31,942][52803] DAMAGECOUNT value on done: 555257.0 [2024-08-06 05:00:31,944][52803] Sum rewards: 77.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.798', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.167', 'weapon5': '0.186', 'weapon2': '0.262', 'AMMO4': '0.282', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '63.000'} [2024-08-06 05:00:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 473792512. Throughput: 0: 4370.0. Samples: 118448130. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:00:32,794][52567] Avg episode reward: [(0, '72.823')] [2024-08-06 05:00:32,936][52671] DAMAGECOUNT value on done: 590928.0 [2024-08-06 05:00:32,936][52671] Sum rewards: 64.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.344', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.178', 'AMMO4': '0.195', 'AMMO3': '0.228', 'weapon5': '0.264', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '2.960', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:33,437][52658] DAMAGECOUNT value on done: 574827.0 [2024-08-06 05:00:33,437][52658] Sum rewards: 74.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.457', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:33,832][52668] DAMAGECOUNT value on done: 587553.0 [2024-08-06 05:00:33,833][52668] Sum rewards: 59.329, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.052', 'HEALTH': '0.073', 'AMMO4': '0.128', 'AMMO3': '0.133', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.668', 'WEAPON3': '0.800', 'HITCOUNT': '2.710', 'weapon3': '2.998', 'DAMAGECOUNT': '14.295', 'FRAGCOUNT': '45.000'} [2024-08-06 05:00:34,381][52662] DAMAGECOUNT value on done: 591636.0 [2024-08-06 05:00:34,381][52662] Sum rewards: 91.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'weapon3': '3.502', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.603', 'FRAGCOUNT': '75.000'} [2024-08-06 05:00:34,483][52669] DAMAGECOUNT value on done: 590856.0 [2024-08-06 05:00:34,483][52669] Sum rewards: 66.423, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.239', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.180', 'weapon4': '0.204', 'weapon2': '0.250', 'AMMO4': '0.262', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.006', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '60.500'} [2024-08-06 05:00:35,030][52650] Updated weights for policy 0, policy_version 57841 (0.0027) [2024-08-06 05:00:35,100][52803] DAMAGECOUNT value on done: 542652.0 [2024-08-06 05:00:35,101][52803] Sum rewards: 69.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.078', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.316', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.370', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.500'} [2024-08-06 05:00:35,850][52671] DAMAGECOUNT value on done: 588543.0 [2024-08-06 05:00:35,851][52671] Sum rewards: 66.221, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon4': '0.158', 'weapon5': '0.184', 'weapon2': '0.208', 'AMMO3': '0.252', 'AMMO4': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '58.000'} [2024-08-06 05:00:36,060][52658] DAMAGECOUNT value on done: 590192.0 [2024-08-06 05:00:36,060][52658] Sum rewards: 79.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.386', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.064', 'weapon4': '0.090', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.794', 'WEAPON3': '1.350', 'weapon3': '2.772', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '66.000'} [2024-08-06 05:00:36,812][52668] DAMAGECOUNT value on done: 584576.0 [2024-08-06 05:00:36,814][52668] Sum rewards: 61.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.386', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '52.000'} [2024-08-06 05:00:37,033][52660] DAMAGECOUNT value on done: 584222.0 [2024-08-06 05:00:37,033][52660] Sum rewards: 81.493, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.183', 'weapon2': '0.258', 'HEALTH': '0.688', 'WEAPON3': '0.950', 'weapon3': '3.526', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:37,163][52662] DAMAGECOUNT value on done: 592448.0 [2024-08-06 05:00:37,163][52662] Sum rewards: 77.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'weapon4': '0.072', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:37,482][52669] DAMAGECOUNT value on done: 595605.0 [2024-08-06 05:00:37,482][52669] Sum rewards: 75.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.078', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:37,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 473874432. Throughput: 0: 4371.8. Samples: 118474370. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:00:37,795][52567] Avg episode reward: [(0, '72.701')] [2024-08-06 05:00:38,244][52803] DAMAGECOUNT value on done: 539979.0 [2024-08-06 05:00:38,246][52803] Sum rewards: 73.812, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.536', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'AMMO3': '0.307', 'WEAPON3': '1.850', 'weapon3': '3.250', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:38,590][52671] DAMAGECOUNT value on done: 588494.0 [2024-08-06 05:00:38,600][52671] Sum rewards: 75.755, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.690', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.100', 'AMMO3': '0.203', 'AMMO4': '0.248', 'weapon2': '0.256', 'weapon5': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '64.000'} [2024-08-06 05:00:39,109][52658] DAMAGECOUNT value on done: 581102.0 [2024-08-06 05:00:39,109][52658] Sum rewards: 66.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.671', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.186', 'weapon5': '0.194', 'AMMO3': '0.220', 'AMMO4': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:39,258][52650] Updated weights for policy 0, policy_version 57851 (0.0012) [2024-08-06 05:00:40,045][52662] DAMAGECOUNT value on done: 583134.0 [2024-08-06 05:00:40,045][52662] Sum rewards: 76.526, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.068', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.170', 'AMMO4': '0.263', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.376', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '66.000'} [2024-08-06 05:00:40,056][52668] DAMAGECOUNT value on done: 576396.0 [2024-08-06 05:00:40,057][52668] Sum rewards: 67.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.025', 'AMMO2': '0.050', 'weapon4': '0.108', 'AMMO3': '0.191', 'AMMO4': '0.249', 'weapon5': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:40,274][52660] DAMAGECOUNT value on done: 576169.0 [2024-08-06 05:00:40,276][52660] Sum rewards: 93.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO2': '0.001', 'AMMO4': '0.004', 'weapon2': '0.246', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.600', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '79.000'} [2024-08-06 05:00:41,061][52671] DAMAGECOUNT value on done: 585528.0 [2024-08-06 05:00:41,065][52671] Sum rewards: 70.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.088', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.228', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.374', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '58.000'} [2024-08-06 05:00:41,291][52803] DAMAGECOUNT value on done: 554980.0 [2024-08-06 05:00:41,292][52803] Sum rewards: 86.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.506', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.186', 'weapon5': '0.222', 'AMMO4': '0.234', 'weapon2': '0.288', 'weapon4': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.787', 'FRAGCOUNT': '69.000'} [2024-08-06 05:00:42,203][52658] DAMAGECOUNT value on done: 580841.0 [2024-08-06 05:00:42,203][52658] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon2': '0.172', 'AMMO3': '0.194', 'weapon5': '0.204', 'AMMO4': '0.214', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 473972736. Throughput: 0: 4373.8. Samples: 118500500. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:00:42,794][52567] Avg episode reward: [(0, '72.797')] [2024-08-06 05:00:42,905][52662] DAMAGECOUNT value on done: 593374.0 [2024-08-06 05:00:42,906][52662] Sum rewards: 77.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.882', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO4': '0.183', 'AMMO3': '0.237', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.272', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '65.000'} [2024-08-06 05:00:43,225][52668] DAMAGECOUNT value on done: 570082.0 [2024-08-06 05:00:43,227][52668] Sum rewards: 82.837, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.159', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '66.000'} [2024-08-06 05:00:43,415][52660] DAMAGECOUNT value on done: 586982.0 [2024-08-06 05:00:43,415][52660] Sum rewards: 76.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.858', 'AMMO5': '0.003', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.124', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 05:00:44,093][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:00:44,401][52803] DAMAGECOUNT value on done: 543546.0 [2024-08-06 05:00:44,402][52803] Sum rewards: 72.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.010', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO3': '0.161', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '0.950', 'weapon3': '3.158', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '58.000'} [2024-08-06 05:00:44,469][52650] Updated weights for policy 0, policy_version 57861 (0.0013) [2024-08-06 05:00:45,364][52658] DAMAGECOUNT value on done: 586450.0 [2024-08-06 05:00:45,366][52658] Sum rewards: 60.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.112', 'AMMO3': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.510', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '48.000'} [2024-08-06 05:00:45,498][52662] DAMAGECOUNT value on done: 580508.0 [2024-08-06 05:00:45,498][52662] Sum rewards: 84.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.846', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.246', 'weapon2': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.578', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '73.000'} [2024-08-06 05:00:46,429][52668] DAMAGECOUNT value on done: 572227.0 [2024-08-06 05:00:46,431][52668] Sum rewards: 72.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.842', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.368', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:46,573][52660] DAMAGECOUNT value on done: 592448.0 [2024-08-06 05:00:46,573][52660] Sum rewards: 72.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.225', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:47,460][52803] DAMAGECOUNT value on done: 541377.0 [2024-08-06 05:00:47,461][52803] Sum rewards: 78.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 474062848. Throughput: 0: 4383.6. Samples: 118513730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:00:47,794][52567] Avg episode reward: [(0, '73.199')] [2024-08-06 05:00:48,184][52662] DAMAGECOUNT value on done: 585023.0 [2024-08-06 05:00:48,185][52662] Sum rewards: 73.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.663', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '61.000'} [2024-08-06 05:00:48,969][52650] Updated weights for policy 0, policy_version 57871 (0.0013) [2024-08-06 05:00:49,489][52668] DAMAGECOUNT value on done: 574600.0 [2024-08-06 05:00:49,490][52668] Sum rewards: 71.557, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.716', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.150', 'weapon4': '0.166', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:49,546][52660] DAMAGECOUNT value on done: 581091.0 [2024-08-06 05:00:49,548][52660] Sum rewards: 65.670, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.300', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO4': '0.187', 'AMMO3': '0.269', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.548', 'WEAPON3': '1.650', 'weapon3': '2.784', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '57.000'} [2024-08-06 05:00:50,547][52803] DAMAGECOUNT value on done: 545452.0 [2024-08-06 05:00:50,552][52803] Sum rewards: 64.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.416', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.106', 'weapon4': '0.124', 'AMMO4': '0.134', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.694', 'WEAPON3': '1.100', 'weapon3': '2.876', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '53.000'} [2024-08-06 05:00:50,776][52662] DAMAGECOUNT value on done: 581424.0 [2024-08-06 05:00:50,778][52662] Sum rewards: 74.580, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.165', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.074', 'AMMO4': '0.091', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '63.000'} [2024-08-06 05:00:52,362][52668] DAMAGECOUNT value on done: 580821.0 [2024-08-06 05:00:52,363][52668] Sum rewards: 63.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.240', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '54.500'} [2024-08-06 05:00:52,490][52660] DAMAGECOUNT value on done: 579883.0 [2024-08-06 05:00:52,504][52660] Sum rewards: 57.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.578', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.118', 'AMMO3': '0.199', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.522', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.420', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '47.000'} [2024-08-06 05:00:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 474144768. Throughput: 0: 4378.9. Samples: 118540020. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:00:52,795][52567] Avg episode reward: [(0, '73.089')] [2024-08-06 05:00:53,285][52662] DAMAGECOUNT value on done: 589967.0 [2024-08-06 05:00:53,285][52662] Sum rewards: 77.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.042', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:53,560][52650] Updated weights for policy 0, policy_version 57881 (0.0014) [2024-08-06 05:00:53,604][52803] DAMAGECOUNT value on done: 546765.0 [2024-08-06 05:00:53,606][52803] Sum rewards: 82.384, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.172', 'weapon2': '0.192', 'AMMO4': '0.224', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.348', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.912', 'FRAGCOUNT': '68.000'} [2024-08-06 05:00:55,677][52668] DAMAGECOUNT value on done: 585192.0 [2024-08-06 05:00:55,677][52668] Sum rewards: 74.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.127', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '60.000'} [2024-08-06 05:00:55,870][52660] DAMAGECOUNT value on done: 577996.0 [2024-08-06 05:00:55,870][52660] Sum rewards: 71.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.944', 'AMMO5': '0.022', 'AMMO2': '0.032', 'weapon5': '0.162', 'AMMO4': '0.162', 'weapon4': '0.184', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:56,006][52662] DAMAGECOUNT value on done: 582797.0 [2024-08-06 05:00:56,008][52662] Sum rewards: 68.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.270', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.040', 'AMMO4': '0.079', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '56.000'} [2024-08-06 05:00:56,691][52803] DAMAGECOUNT value on done: 551890.0 [2024-08-06 05:00:56,693][52803] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.476', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.138', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.372', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '2.840', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '59.000'} [2024-08-06 05:00:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 474234880. Throughput: 0: 4380.0. Samples: 118566400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:00:57,795][52567] Avg episode reward: [(0, '73.094')] [2024-08-06 05:00:58,189][52650] Updated weights for policy 0, policy_version 57891 (0.0012) [2024-08-06 05:00:58,395][52668] DAMAGECOUNT value on done: 583643.0 [2024-08-06 05:00:58,396][52668] Sum rewards: 65.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.334', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.192', 'weapon2': '0.786', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '54.000'} [2024-08-06 05:00:58,558][52660] DAMAGECOUNT value on done: 587587.0 [2024-08-06 05:00:58,560][52660] Sum rewards: 77.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON5': '0.050', 'AMMO3': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.584', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '64.000'} [2024-08-06 05:00:59,317][52662] DAMAGECOUNT value on done: 595838.0 [2024-08-06 05:00:59,318][52662] Sum rewards: 77.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.762', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.116', 'AMMO4': '0.131', 'AMMO3': '0.173', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '62.000'} [2024-08-06 05:00:59,920][52803] DAMAGECOUNT value on done: 540604.0 [2024-08-06 05:00:59,920][52803] Sum rewards: 83.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.145', 'weapon4': '0.204', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '0.950', 'weapon3': '3.008', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '67.000'} [2024-08-06 05:01:01,112][52665] DAMAGECOUNT value on done: 571320.0 [2024-08-06 05:01:01,124][52665] Sum rewards: 71.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.084', 'AMMO4': '0.178', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '61.000'} [2024-08-06 05:01:01,284][52668] DAMAGECOUNT value on done: 587359.0 [2024-08-06 05:01:01,286][52668] Sum rewards: 71.815, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.560', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.092', 'weapon4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.280', 'AMMO4': '0.283', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.128', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '65.000'} [2024-08-06 05:01:01,485][52660] DAMAGECOUNT value on done: 580225.0 [2024-08-06 05:01:01,485][52660] Sum rewards: 61.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.804', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.188', 'AMMO4': '0.199', 'weapon5': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.382', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.490', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2024-08-06 05:01:02,065][52662] DAMAGECOUNT value on done: 586927.0 [2024-08-06 05:01:02,066][52662] Sum rewards: 77.613, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.336', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.141', 'weapon4': '0.178', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.850', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '62.000'} [2024-08-06 05:01:02,746][52650] Updated weights for policy 0, policy_version 57901 (0.0010) [2024-08-06 05:01:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 474324992. Throughput: 0: 4375.3. Samples: 118579520. Policy #0 lag: (min: 1.0, avg: 3.2, max: 9.0) [2024-08-06 05:01:02,794][52567] Avg episode reward: [(0, '73.583')] [2024-08-06 05:01:03,850][52665] DAMAGECOUNT value on done: 588840.0 [2024-08-06 05:01:03,850][52665] Sum rewards: 84.360, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'HEALTH': '0.024', 'AMMO4': '0.104', 'weapon4': '0.140', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '69.000'} [2024-08-06 05:01:04,359][52668] DAMAGECOUNT value on done: 586174.0 [2024-08-06 05:01:04,359][52668] Sum rewards: 84.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.237', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.062', 'AMMO4': '0.075', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.195', 'WEAPON3': '1.150', 'weapon3': '3.428', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '68.000'} [2024-08-06 05:01:04,514][52660] DAMAGECOUNT value on done: 582638.0 [2024-08-06 05:01:04,515][52660] Sum rewards: 67.016, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.108', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.065', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.374', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.350', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '54.000'} [2024-08-06 05:01:04,963][52662] DAMAGECOUNT value on done: 579016.0 [2024-08-06 05:01:04,963][52662] Sum rewards: 54.433, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.108', 'weapon5': '0.128', 'AMMO4': '0.145', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.762', 'WEAPON3': '1.050', 'HITCOUNT': '2.560', 'weapon3': '2.854', 'DAMAGECOUNT': '12.537', 'FRAGCOUNT': '44.000'} [2024-08-06 05:01:06,930][52665] DAMAGECOUNT value on done: 583421.0 [2024-08-06 05:01:06,930][52665] Sum rewards: 80.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.651', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.084', 'weapon5': '0.226', 'AMMO3': '0.233', 'AMMO4': '0.237', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.036', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '66.000'} [2024-08-06 05:01:07,247][52660] DAMAGECOUNT value on done: 588880.0 [2024-08-06 05:01:07,247][52660] Sum rewards: 76.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.488', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon4': '0.190', 'AMMO3': '0.216', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '63.500'} [2024-08-06 05:01:07,521][52650] Updated weights for policy 0, policy_version 57911 (0.0015) [2024-08-06 05:01:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 474406912. Throughput: 0: 4362.0. Samples: 118605610. Policy #0 lag: (min: 1.0, avg: 3.2, max: 9.0) [2024-08-06 05:01:07,794][52567] Avg episode reward: [(0, '73.370')] [2024-08-06 05:01:07,927][52662] DAMAGECOUNT value on done: 584086.0 [2024-08-06 05:01:07,929][52662] Sum rewards: 73.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.304', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '59.500'} [2024-08-06 05:01:09,940][52665] DAMAGECOUNT value on done: 577072.0 [2024-08-06 05:01:09,940][52665] Sum rewards: 86.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.986', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.184', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.522', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '71.000'} [2024-08-06 05:01:10,271][52660] DAMAGECOUNT value on done: 578331.0 [2024-08-06 05:01:10,272][52660] Sum rewards: 82.655, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.154', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.112', 'weapon4': '0.148', 'AMMO3': '0.179', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.190', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 05:01:10,883][52662] DAMAGECOUNT value on done: 578494.0 [2024-08-06 05:01:10,883][52662] Sum rewards: 65.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.146', 'weapon5': '0.222', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.000'} [2024-08-06 05:01:11,867][52659] DAMAGECOUNT value on done: 591437.0 [2024-08-06 05:01:11,870][52659] Sum rewards: 73.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.038', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.248', 'AMMO3': '0.249', 'WEAPON3': '1.600', 'weapon3': '3.426', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '63.000'} [2024-08-06 05:01:12,336][52650] Updated weights for policy 0, policy_version 57921 (0.0023) [2024-08-06 05:01:12,784][52665] DAMAGECOUNT value on done: 567489.0 [2024-08-06 05:01:12,784][52665] Sum rewards: 65.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.817', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.164', 'AMMO3': '0.166', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.412', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '52.000'} [2024-08-06 05:01:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 474497024. Throughput: 0: 4368.4. Samples: 118632070. Policy #0 lag: (min: 1.0, avg: 3.2, max: 9.0) [2024-08-06 05:01:12,795][52567] Avg episode reward: [(0, '73.401')] [2024-08-06 05:01:13,161][52660] DAMAGECOUNT value on done: 581021.0 [2024-08-06 05:01:13,162][52660] Sum rewards: 86.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.200', 'weapon4': '0.238', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.066', 'FRAGCOUNT': '69.000'} [2024-08-06 05:01:14,687][52659] DAMAGECOUNT value on done: 582860.0 [2024-08-06 05:01:14,688][52659] Sum rewards: 67.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.444', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.126', 'weapon5': '0.186', 'AMMO3': '0.203', 'AMMO4': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '55.000'} [2024-08-06 05:01:15,720][52665] DAMAGECOUNT value on done: 574211.0 [2024-08-06 05:01:15,722][52665] Sum rewards: 69.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.955', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.144', 'weapon5': '0.182', 'AMMO3': '0.205', 'AMMO4': '0.207', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '59.000'} [2024-08-06 05:01:16,365][52660] DAMAGECOUNT value on done: 591568.0 [2024-08-06 05:01:16,365][52660] Sum rewards: 65.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.192', 'AMMO4': '0.195', 'AMMO3': '0.251', 'weapon4': '0.312', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.870', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '54.000'} [2024-08-06 05:01:16,920][52650] Updated weights for policy 0, policy_version 57931 (0.0035) [2024-08-06 05:01:17,474][52659] DAMAGECOUNT value on done: 590061.0 [2024-08-06 05:01:17,482][52659] Sum rewards: 71.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.749', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.219', 'weapon4': '0.280', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 05:01:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 474587136. Throughput: 0: 4375.3. Samples: 118645020. Policy #0 lag: (min: 1.0, avg: 3.2, max: 9.0) [2024-08-06 05:01:17,794][52567] Avg episode reward: [(0, '73.309')] [2024-08-06 05:01:18,826][52665] DAMAGECOUNT value on done: 579698.0 [2024-08-06 05:01:18,828][52665] Sum rewards: 70.741, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.802', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.160', 'AMMO4': '0.209', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.332', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.930', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:19,083][52660] DAMAGECOUNT value on done: 597311.0 [2024-08-06 05:01:19,083][52660] Sum rewards: 66.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.816', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.070', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.162', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.282', 'WEAPON5': '0.300', 'weapon4': '0.492', 'WEAPON3': '1.350', 'weapon3': '2.656', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '56.000'} [2024-08-06 05:01:20,470][52659] DAMAGECOUNT value on done: 585600.0 [2024-08-06 05:01:20,470][52659] Sum rewards: 77.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon4': '0.124', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '64.000'} [2024-08-06 05:01:20,496][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:01:21,652][52660] DAMAGECOUNT value on done: 579685.0 [2024-08-06 05:01:21,653][52660] Sum rewards: 65.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.225', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.132', 'weapon4': '0.152', 'AMMO3': '0.176', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '55.000'} [2024-08-06 05:01:21,775][52650] Updated weights for policy 0, policy_version 57941 (0.0011) [2024-08-06 05:01:21,856][52665] DAMAGECOUNT value on done: 577349.0 [2024-08-06 05:01:21,856][52665] Sum rewards: 73.306, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.235', 'AMMO5': '0.014', 'AMMO2': '0.069', 'weapon4': '0.106', 'weapon5': '0.106', 'AMMO3': '0.246', 'weapon2': '0.324', 'AMMO4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.182', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '63.000'} [2024-08-06 05:01:22,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 474669056. Throughput: 0: 4386.4. Samples: 118671760. Policy #0 lag: (min: 1.0, avg: 3.2, max: 9.0) [2024-08-06 05:01:22,802][52567] Avg episode reward: [(0, '73.181')] [2024-08-06 05:01:23,315][52659] DAMAGECOUNT value on done: 580813.0 [2024-08-06 05:01:23,317][52659] Sum rewards: 78.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON3': '1.450', 'weapon3': '3.546', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '65.000'} [2024-08-06 05:01:23,473][52794] DAMAGECOUNT value on done: 588565.0 [2024-08-06 05:01:23,475][52794] Sum rewards: 74.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.164', 'weapon5': '0.174', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.366', 'weapon4': '0.426', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:24,498][52660] DAMAGECOUNT value on done: 587849.0 [2024-08-06 05:01:24,500][52660] Sum rewards: 61.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.996', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.100', 'weapon5': '0.168', 'AMMO4': '0.180', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.650', 'HITCOUNT': '2.940', 'weapon3': '3.046', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '54.000'} [2024-08-06 05:01:24,593][52665] DAMAGECOUNT value on done: 584631.0 [2024-08-06 05:01:24,594][52665] Sum rewards: 74.358, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.650', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.155', 'weapon2': '0.486', 'WEAPON3': '1.000', 'HITCOUNT': '3.380', 'weapon3': '3.390', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '58.000'} [2024-08-06 05:01:26,126][52650] Updated weights for policy 0, policy_version 57951 (0.0016) [2024-08-06 05:01:26,401][52659] DAMAGECOUNT value on done: 586101.0 [2024-08-06 05:01:26,402][52659] Sum rewards: 69.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.264', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'weapon2': '0.146', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'HITCOUNT': '3.450', 'weapon3': '3.608', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '59.000'} [2024-08-06 05:01:26,747][52794] DAMAGECOUNT value on done: 592773.0 [2024-08-06 05:01:26,750][52794] Sum rewards: 59.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.125', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'HITCOUNT': '3.060', 'weapon3': '3.506', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '51.000'} [2024-08-06 05:01:27,357][52647] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:01:27,430][52665] DAMAGECOUNT value on done: 577625.0 [2024-08-06 05:01:27,431][52665] Sum rewards: 67.084, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.118', 'HEALTH': '0.130', 'weapon5': '0.132', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '0.850', 'HITCOUNT': '2.970', 'weapon3': '3.242', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '53.000'} [2024-08-06 05:01:27,442][52660] DAMAGECOUNT value on done: 582063.0 [2024-08-06 05:01:27,443][52660] Sum rewards: 67.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.913', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.158', 'AMMO4': '0.172', 'AMMO3': '0.238', 'weapon2': '0.274', 'weapon4': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '57.000'} [2024-08-06 05:01:27,472][52658] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:01:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 474750976. Throughput: 0: 4388.7. Samples: 118697990. Policy #0 lag: (min: 1.0, avg: 3.2, max: 9.0) [2024-08-06 05:01:27,794][52567] Avg episode reward: [(0, '72.962')] [2024-08-06 05:01:28,026][52647] DAMAGECOUNT value on done: 618537.0 [2024-08-06 05:01:28,026][52647] Sum rewards: 67.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.562', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.166', 'AMMO4': '0.195', 'weapon5': '0.212', 'weapon4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.552', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '56.000'} [2024-08-06 05:01:29,130][52659] DAMAGECOUNT value on done: 584661.0 [2024-08-06 05:01:29,130][52659] Sum rewards: 74.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.108', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.134', 'AMMO3': '0.200', 'weapon4': '0.232', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:29,730][52794] DAMAGECOUNT value on done: 591059.0 [2024-08-06 05:01:29,732][52794] Sum rewards: 66.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.171', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '54.000'} [2024-08-06 05:01:30,330][52647] DAMAGECOUNT value on done: 612913.0 [2024-08-06 05:01:30,330][52647] Sum rewards: 57.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.854', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.334', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.392', 'DAMAGECOUNT': '14.280', 'FRAGCOUNT': '49.000'} [2024-08-06 05:01:30,519][52665] DAMAGECOUNT value on done: 588096.0 [2024-08-06 05:01:30,521][52665] Sum rewards: 74.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.584', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.090', 'AMMO4': '0.184', 'weapon5': '0.214', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '63.000'} [2024-08-06 05:01:30,607][52660] DAMAGECOUNT value on done: 580582.0 [2024-08-06 05:01:30,607][52660] Sum rewards: 31.470, reward structure: {'DEATHCOUNT': '-4.500', 'HEALTH': '-1.065', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.080', 'weapon2': '0.096', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.130', 'weapon7': '0.156', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.500', 'weapon3': '0.968', 'HITCOUNT': '1.470', 'weapon4': '2.242', 'DAMAGECOUNT': '7.389', 'FRAGCOUNT': '23.000'} [2024-08-06 05:01:31,089][52650] Updated weights for policy 0, policy_version 57961 (0.0016) [2024-08-06 05:01:32,483][52659] DAMAGECOUNT value on done: 582173.0 [2024-08-06 05:01:32,487][52659] Sum rewards: 74.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.293', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.162', 'AMMO4': '0.196', 'weapon5': '0.196', 'weapon2': '0.282', 'WEAPON5': '0.500', 'weapon4': '0.536', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.366', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '61.000'} [2024-08-06 05:01:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 474849280. Throughput: 0: 4386.4. Samples: 118711120. Policy #0 lag: (min: 1.0, avg: 3.2, max: 9.0) [2024-08-06 05:01:32,794][52567] Avg episode reward: [(0, '72.462')] [2024-08-06 05:01:32,821][52647] DAMAGECOUNT value on done: 617466.0 [2024-08-06 05:01:32,821][52647] Sum rewards: 75.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.995', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'AMMO3': '0.292', 'WEAPON3': '1.750', 'weapon3': '3.320', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '63.000'} [2024-08-06 05:01:32,831][52794] DAMAGECOUNT value on done: 582237.0 [2024-08-06 05:01:32,832][52794] Sum rewards: 58.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon5': '0.180', 'AMMO3': '0.190', 'weapon4': '0.194', 'AMMO4': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '49.000'} [2024-08-06 05:01:33,229][52660] DAMAGECOUNT value on done: 573941.0 [2024-08-06 05:01:33,231][52660] Sum rewards: 59.612, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.646', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO4': '0.249', 'weapon5': '0.260', 'AMMO3': '0.266', 'weapon4': '0.338', 'weapon2': '0.392', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.668', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '53.500'} [2024-08-06 05:01:33,736][52665] DAMAGECOUNT value on done: 583323.0 [2024-08-06 05:01:33,737][52665] Sum rewards: 73.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.024', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.126', 'weapon2': '0.142', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '62.000'} [2024-08-06 05:01:35,419][52659] DAMAGECOUNT value on done: 588383.0 [2024-08-06 05:01:35,414][52650] Updated weights for policy 0, policy_version 57971 (0.0039) [2024-08-06 05:01:35,421][52659] Sum rewards: 69.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.038', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon2': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.240', 'AMMO3': '0.241', 'WEAPON3': '1.550', 'weapon3': '3.320', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:35,713][52794] DAMAGECOUNT value on done: 582299.0 [2024-08-06 05:01:35,714][52794] Sum rewards: 67.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.042', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.458', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '57.000'} [2024-08-06 05:01:35,935][52647] DAMAGECOUNT value on done: 622961.0 [2024-08-06 05:01:35,936][52647] Sum rewards: 68.417, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.124', 'WEAPON5': '0.150', 'weapon2': '0.254', 'AMMO3': '0.310', 'WEAPON3': '1.850', 'weapon3': '3.318', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 05:01:36,821][52665] DAMAGECOUNT value on done: 580722.0 [2024-08-06 05:01:36,821][52665] Sum rewards: 66.259, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.452', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO4': '0.220', 'weapon5': '0.234', 'weapon4': '0.240', 'weapon2': '0.256', 'AMMO3': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '2.000', 'weapon3': '2.914', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '59.000'} [2024-08-06 05:01:37,795][52567] Fps is (10 sec: 18021.1, 60 sec: 17612.6, 300 sec: 17494.7). Total num frames: 474931200. Throughput: 0: 4385.1. Samples: 118737350. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:01:37,795][52567] Avg episode reward: [(0, '71.654')] [2024-08-06 05:01:37,952][52659] DAMAGECOUNT value on done: 591308.0 [2024-08-06 05:01:37,953][52659] Sum rewards: 72.590, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.582', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.230', 'AMMO3': '0.238', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '61.000'} [2024-08-06 05:01:38,682][52647] DAMAGECOUNT value on done: 626268.0 [2024-08-06 05:01:38,682][52647] Sum rewards: 78.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.375', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.096', 'weapon5': '0.158', 'AMMO4': '0.225', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.925', 'FRAGCOUNT': '65.000'} [2024-08-06 05:01:39,026][52794] DAMAGECOUNT value on done: 585614.0 [2024-08-06 05:01:39,028][52794] Sum rewards: 80.845, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.268', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.026', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.241', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '69.000'} [2024-08-06 05:01:39,996][52665] DAMAGECOUNT value on done: 579051.0 [2024-08-06 05:01:39,996][52665] Sum rewards: 60.821, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.627', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.132', 'AMMO3': '0.203', 'weapon5': '0.212', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '51.500'} [2024-08-06 05:01:40,363][52650] Updated weights for policy 0, policy_version 57981 (0.0039) [2024-08-06 05:01:40,379][52659] DAMAGECOUNT value on done: 580066.0 [2024-08-06 05:01:40,379][52659] Sum rewards: 62.505, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.420', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.023', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.155', 'weapon4': '0.410', 'weapon2': '0.660', 'WEAPON3': '0.950', 'weapon3': '2.584', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '49.000'} [2024-08-06 05:01:41,374][52647] DAMAGECOUNT value on done: 624255.0 [2024-08-06 05:01:41,374][52647] Sum rewards: 73.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.138', 'AMMO4': '0.190', 'AMMO3': '0.226', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.358', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '61.000'} [2024-08-06 05:01:41,867][52794] DAMAGECOUNT value on done: 591173.0 [2024-08-06 05:01:41,868][52794] Sum rewards: 62.153, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.244', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.170', 'weapon5': '0.170', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '52.000'} [2024-08-06 05:01:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 475021312. Throughput: 0: 4383.3. Samples: 118763650. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:01:42,802][52567] Avg episode reward: [(0, '71.729')] [2024-08-06 05:01:43,095][52665] DAMAGECOUNT value on done: 577149.0 [2024-08-06 05:01:43,097][52665] Sum rewards: 66.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.025', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon5': '0.070', 'AMMO4': '0.086', 'weapon4': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.292', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '56.000'} [2024-08-06 05:01:43,444][52659] DAMAGECOUNT value on done: 590457.0 [2024-08-06 05:01:43,446][52659] Sum rewards: 80.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.214', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.090', 'AMMO4': '0.148', 'weapon5': '0.184', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '67.000'} [2024-08-06 05:01:43,685][52647] DAMAGECOUNT value on done: 619142.0 [2024-08-06 05:01:43,685][52647] Sum rewards: 80.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.030', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '65.000'} [2024-08-06 05:01:44,553][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:01:44,965][52650] Updated weights for policy 0, policy_version 57991 (0.0021) [2024-08-06 05:01:44,984][52794] DAMAGECOUNT value on done: 578805.0 [2024-08-06 05:01:44,984][52794] Sum rewards: 73.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.107', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.654', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:45,988][52647] DAMAGECOUNT value on done: 609597.0 [2024-08-06 05:01:45,989][52647] Sum rewards: 67.786, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.406', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.103', 'weapon2': '0.174', 'weapon5': '0.192', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.620', 'WEAPON3': '0.700', 'weapon3': '2.606', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.273', 'FRAGCOUNT': '52.000'} [2024-08-06 05:01:46,172][52665] DAMAGECOUNT value on done: 575980.0 [2024-08-06 05:01:46,173][52665] Sum rewards: 71.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.278', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.096', 'AMMO4': '0.135', 'weapon5': '0.138', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '58.500'} [2024-08-06 05:01:46,219][52659] DAMAGECOUNT value on done: 577565.0 [2024-08-06 05:01:46,220][52659] Sum rewards: 66.256, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.074', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'weapon4': '0.318', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '54.000'} [2024-08-06 05:01:46,325][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:01:47,813][52567] Fps is (10 sec: 17172.5, 60 sec: 17334.4, 300 sec: 17465.9). Total num frames: 475103232. Throughput: 0: 4385.1. Samples: 118776930. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:01:47,821][52567] Avg episode reward: [(0, '71.638')] [2024-08-06 05:01:48,355][52794] DAMAGECOUNT value on done: 589127.0 [2024-08-06 05:01:48,357][52794] Sum rewards: 68.158, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.459', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.062', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon2': '0.202', 'weapon4': '0.324', 'WEAPON3': '0.900', 'weapon3': '3.002', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '53.000'} [2024-08-06 05:01:48,904][52659] DAMAGECOUNT value on done: 582829.0 [2024-08-06 05:01:48,905][52659] Sum rewards: 74.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.295', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.102', 'AMMO4': '0.121', 'weapon5': '0.128', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '63.000'} [2024-08-06 05:01:48,966][52647] DAMAGECOUNT value on done: 619322.0 [2024-08-06 05:01:48,966][52647] Sum rewards: 68.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '58.000'} [2024-08-06 05:01:49,139][52795] DAMAGECOUNT value on done: 543413.0 [2024-08-06 05:01:49,139][52795] Sum rewards: 82.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon2': '0.168', 'weapon4': '0.196', 'AMMO4': '0.209', 'weapon5': '0.218', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '68.000'} [2024-08-06 05:01:49,291][52665] DAMAGECOUNT value on done: 578585.0 [2024-08-06 05:01:49,292][52665] Sum rewards: 89.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.212', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.384', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '74.000'} [2024-08-06 05:01:49,742][52650] Updated weights for policy 0, policy_version 58001 (0.0014) [2024-08-06 05:01:51,116][52794] DAMAGECOUNT value on done: 584292.0 [2024-08-06 05:01:51,117][52794] Sum rewards: 82.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '67.000'} [2024-08-06 05:01:51,588][52662] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:01:51,946][52665] DAMAGECOUNT value on done: 575384.0 [2024-08-06 05:01:51,947][52665] Sum rewards: 73.151, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.040', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.098', 'weapon5': '0.104', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.238', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '63.000'} [2024-08-06 05:01:51,981][52659] DAMAGECOUNT value on done: 596656.0 [2024-08-06 05:01:51,981][52659] Sum rewards: 80.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.098', 'weapon4': '0.118', 'AMMO4': '0.178', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.415', 'FRAGCOUNT': '65.000'} [2024-08-06 05:01:52,055][52647] DAMAGECOUNT value on done: 615002.0 [2024-08-06 05:01:52,055][52647] Sum rewards: 70.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.014', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '58.000'} [2024-08-06 05:01:52,197][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 05:01:52,248][52795] DAMAGECOUNT value on done: 533334.0 [2024-08-06 05:01:52,248][52795] Sum rewards: 67.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.090', 'AMMO4': '0.102', 'AMMO3': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '0.900', 'HITCOUNT': '3.040', 'weapon3': '3.188', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '54.000'} [2024-08-06 05:01:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 475193344. Throughput: 0: 4386.7. Samples: 118803010. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:01:52,794][52567] Avg episode reward: [(0, '71.585')] [2024-08-06 05:01:53,924][52794] DAMAGECOUNT value on done: 581395.0 [2024-08-06 05:01:53,926][52794] Sum rewards: 69.933, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.203', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '59.000'} [2024-08-06 05:01:54,197][52650] Updated weights for policy 0, policy_version 58011 (0.0011) [2024-08-06 05:01:54,443][52665] DAMAGECOUNT value on done: 576705.0 [2024-08-06 05:01:54,444][52665] Sum rewards: 64.984, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.854', 'AMMO5': '0.014', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.098', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.688', 'WEAPON3': '1.050', 'weapon3': '2.864', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.000'} [2024-08-06 05:01:54,714][52659] DAMAGECOUNT value on done: 586904.0 [2024-08-06 05:01:54,716][52659] Sum rewards: 60.756, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.373', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.322', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '54.000'} [2024-08-06 05:01:54,938][52647] DAMAGECOUNT value on done: 615707.0 [2024-08-06 05:01:54,939][52647] Sum rewards: 54.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.048', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.182', 'WEAPON7': '0.200', 'weapon4': '0.246', 'AMMO3': '0.255', 'AMMO4': '0.282', 'weapon5': '0.332', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.490', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.631', 'FRAGCOUNT': '47.500'} [2024-08-06 05:01:55,339][52795] DAMAGECOUNT value on done: 530918.0 [2024-08-06 05:01:55,340][52795] Sum rewards: 54.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.154', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.104', 'weapon4': '0.130', 'AMMO4': '0.175', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '2.906', 'DAMAGECOUNT': '13.806', 'FRAGCOUNT': '47.000'} [2024-08-06 05:01:56,916][52794] DAMAGECOUNT value on done: 586007.0 [2024-08-06 05:01:56,919][52794] Sum rewards: 71.804, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.115', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.141', 'AMMO3': '0.150', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '3.048', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '56.000'} [2024-08-06 05:01:57,237][52647] DAMAGECOUNT value on done: 610149.0 [2024-08-06 05:01:57,239][52647] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.402', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.167', 'weapon4': '0.208', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '52.000'} [2024-08-06 05:01:57,538][52665] DAMAGECOUNT value on done: 579558.0 [2024-08-06 05:01:57,539][52665] Sum rewards: 72.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.133', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.157', 'AMMO3': '0.215', 'weapon2': '0.292', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:57,618][52659] DAMAGECOUNT value on done: 595346.0 [2024-08-06 05:01:57,620][52659] Sum rewards: 72.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO3': '0.158', 'AMMO4': '0.192', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.804', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:57,794][52567] Fps is (10 sec: 18055.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 475283456. Throughput: 0: 4382.0. Samples: 118829260. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:01:57,794][52567] Avg episode reward: [(0, '70.723')] [2024-08-06 05:01:58,389][52795] DAMAGECOUNT value on done: 539392.0 [2024-08-06 05:01:58,391][52795] Sum rewards: 65.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.615', 'AMMO5': '0.020', 'AMMO2': '0.069', 'weapon2': '0.188', 'weapon5': '0.198', 'AMMO3': '0.230', 'AMMO4': '0.345', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '57.000'} [2024-08-06 05:01:58,773][52650] Updated weights for policy 0, policy_version 58021 (0.0019) [2024-08-06 05:01:59,724][52794] DAMAGECOUNT value on done: 581137.0 [2024-08-06 05:01:59,724][52794] Sum rewards: 73.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.681', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.116', 'AMMO4': '0.145', 'weapon5': '0.168', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '60.000'} [2024-08-06 05:01:59,863][52647] DAMAGECOUNT value on done: 623500.0 [2024-08-06 05:01:59,864][52647] Sum rewards: 78.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.146', 'AMMO3': '0.189', 'AMMO4': '0.206', 'weapon2': '0.290', 'weapon4': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:00,027][52667] DAMAGECOUNT value on done: 588011.0 [2024-08-06 05:02:00,029][52667] Sum rewards: 78.265, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.147', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.320', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '66.000'} [2024-08-06 05:02:00,545][52659] DAMAGECOUNT value on done: 584005.0 [2024-08-06 05:02:00,546][52659] Sum rewards: 67.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.096', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon2': '0.224', 'AMMO3': '0.230', 'weapon5': '0.246', 'weapon4': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:00,650][52820] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 05:02:01,517][52795] DAMAGECOUNT value on done: 535624.0 [2024-08-06 05:02:01,518][52795] Sum rewards: 63.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.255', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.136', 'AMMO3': '0.170', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.042', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '52.000'} [2024-08-06 05:02:02,641][52794] DAMAGECOUNT value on done: 600115.0 [2024-08-06 05:02:02,643][52794] Sum rewards: 75.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.004', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.028', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '62.000'} [2024-08-06 05:02:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 475373568. Throughput: 0: 4384.5. Samples: 118842320. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:02:02,794][52567] Avg episode reward: [(0, '70.824')] [2024-08-06 05:02:03,036][52647] DAMAGECOUNT value on done: 613913.0 [2024-08-06 05:02:03,044][52647] Sum rewards: 78.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.718', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon4': '0.060', 'weapon5': '0.106', 'weapon2': '0.186', 'AMMO3': '0.241', 'AMMO4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.400', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:03,092][52667] DAMAGECOUNT value on done: 594395.0 [2024-08-06 05:02:03,092][52667] Sum rewards: 55.444, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.668', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.158', 'AMMO4': '0.171', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.696', 'WEAPON3': '1.500', 'HITCOUNT': '2.660', 'weapon3': '2.830', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '48.500'} [2024-08-06 05:02:03,416][52659] DAMAGECOUNT value on done: 591219.0 [2024-08-06 05:02:03,419][52659] Sum rewards: 73.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.374', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.069', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.262', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '61.000'} [2024-08-06 05:02:03,482][52650] Updated weights for policy 0, policy_version 58031 (0.0017) [2024-08-06 05:02:04,689][52795] DAMAGECOUNT value on done: 545223.0 [2024-08-06 05:02:04,690][52795] Sum rewards: 62.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.227', 'AMMO4': '0.234', 'weapon2': '0.308', 'weapon5': '0.312', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '52.000'} [2024-08-06 05:02:05,745][52667] DAMAGECOUNT value on done: 589436.0 [2024-08-06 05:02:05,750][52667] Sum rewards: 78.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.655', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.094', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.216', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.312', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '69.000'} [2024-08-06 05:02:05,894][52794] DAMAGECOUNT value on done: 580054.0 [2024-08-06 05:02:05,898][52794] Sum rewards: 72.396, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.808', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.154', 'weapon5': '0.220', 'AMMO3': '0.232', 'AMMO4': '0.249', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:06,001][52647] DAMAGECOUNT value on done: 621413.0 [2024-08-06 05:02:06,002][52647] Sum rewards: 62.962, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.480', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.076', 'AMMO4': '0.121', 'weapon5': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '56.000'} [2024-08-06 05:02:06,381][52659] DAMAGECOUNT value on done: 585896.0 [2024-08-06 05:02:06,381][52659] Sum rewards: 64.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.090', 'weapon4': '0.126', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.272', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '3.228', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '53.000'} [2024-08-06 05:02:07,713][52795] DAMAGECOUNT value on done: 550036.0 [2024-08-06 05:02:07,713][52795] Sum rewards: 79.583, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.820', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.033', 'weapon4': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.270', 'weapon2': '0.296', 'WEAPON3': '1.750', 'weapon3': '3.418', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.886', 'FRAGCOUNT': '68.000'} [2024-08-06 05:02:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 475455488. Throughput: 0: 4375.8. Samples: 118868670. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:02:07,794][52567] Avg episode reward: [(0, '70.603')] [2024-08-06 05:02:08,432][52650] Updated weights for policy 0, policy_version 58041 (0.0015) [2024-08-06 05:02:08,439][52647] DAMAGECOUNT value on done: 620942.0 [2024-08-06 05:02:08,440][52647] Sum rewards: 72.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.178', 'AMMO3': '0.190', 'weapon4': '0.246', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:08,494][52667] DAMAGECOUNT value on done: 591562.0 [2024-08-06 05:02:08,494][52667] Sum rewards: 78.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.732', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.246', 'WEAPON3': '1.550', 'weapon3': '3.528', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '67.000'} [2024-08-06 05:02:08,996][52794] DAMAGECOUNT value on done: 593571.0 [2024-08-06 05:02:08,997][52794] Sum rewards: 76.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.955', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.342', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:10,159][52820] DAMAGECOUNT value on done: 540239.0 [2024-08-06 05:02:10,160][52820] Sum rewards: 65.615, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.726', 'WEAPON3': '1.400', 'weapon3': '2.466', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '53.000'} [2024-08-06 05:02:10,288][52663] DAMAGECOUNT value on done: 595648.0 [2024-08-06 05:02:10,289][52663] Sum rewards: 69.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.016', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.151', 'AMMO3': '0.176', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:10,845][52667] DAMAGECOUNT value on done: 593980.0 [2024-08-06 05:02:10,845][52667] Sum rewards: 75.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.014', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.116', 'weapon5': '0.218', 'AMMO3': '0.234', 'AMMO4': '0.254', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '63.000'} [2024-08-06 05:02:10,919][52795] DAMAGECOUNT value on done: 542752.0 [2024-08-06 05:02:10,919][52795] Sum rewards: 70.311, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.075', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.064', 'AMMO4': '0.106', 'weapon5': '0.120', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.278', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '56.000'} [2024-08-06 05:02:11,603][52647] DAMAGECOUNT value on done: 605576.0 [2024-08-06 05:02:11,605][52647] Sum rewards: 69.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.149', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.076', 'weapon5': '0.090', 'AMMO4': '0.156', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.866', 'WEAPON3': '1.200', 'weapon3': '2.688', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:11,723][52794] DAMAGECOUNT value on done: 586474.0 [2024-08-06 05:02:11,724][52794] Sum rewards: 71.208, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.250', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.098', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.300', 'weapon5': '0.300', 'weapon2': '0.474', 'WEAPON3': '0.850', 'weapon3': '2.960', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '53.000'} [2024-08-06 05:02:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 475553792. Throughput: 0: 4377.3. Samples: 118894970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:12,794][52567] Avg episode reward: [(0, '70.299')] [2024-08-06 05:02:12,784][52650] Updated weights for policy 0, policy_version 58051 (0.0038) [2024-08-06 05:02:13,235][52820] DAMAGECOUNT value on done: 542358.0 [2024-08-06 05:02:13,236][52820] Sum rewards: 67.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.952', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.136', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:13,262][52663] DAMAGECOUNT value on done: 585294.0 [2024-08-06 05:02:13,262][52663] Sum rewards: 72.064, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:13,343][52667] DAMAGECOUNT value on done: 596284.0 [2024-08-06 05:02:13,343][52667] Sum rewards: 71.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.651', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.162', 'weapon4': '0.202', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.600', 'weapon3': '2.954', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '61.000'} [2024-08-06 05:02:14,073][52795] DAMAGECOUNT value on done: 537221.0 [2024-08-06 05:02:14,082][52795] Sum rewards: 67.725, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.910', 'AMMO5': '0.014', 'ARMOR': '0.020', 'AMMO2': '0.042', 'weapon5': '0.128', 'weapon4': '0.198', 'AMMO4': '0.212', 'weapon2': '0.236', 'AMMO3': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.950', 'weapon3': '3.182', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '61.500'} [2024-08-06 05:02:14,337][52647] DAMAGECOUNT value on done: 613807.0 [2024-08-06 05:02:14,338][52647] Sum rewards: 77.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.760', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.312', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.000'} [2024-08-06 05:02:14,693][52794] DAMAGECOUNT value on done: 593542.0 [2024-08-06 05:02:14,696][52794] Sum rewards: 66.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.066', 'weapon4': '0.144', 'AMMO4': '0.217', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:15,909][52667] DAMAGECOUNT value on done: 592496.0 [2024-08-06 05:02:15,911][52667] Sum rewards: 77.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '63.000'} [2024-08-06 05:02:16,197][52663] DAMAGECOUNT value on done: 576209.0 [2024-08-06 05:02:16,198][52663] Sum rewards: 62.756, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.146', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.108', 'weapon5': '0.200', 'AMMO3': '0.238', 'AMMO4': '0.294', 'weapon2': '0.428', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:16,620][52820] DAMAGECOUNT value on done: 546551.0 [2024-08-06 05:02:16,620][52820] Sum rewards: 69.460, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.168', 'weapon4': '0.176', 'AMMO3': '0.184', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:16,986][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:02:17,259][52795] DAMAGECOUNT value on done: 546342.0 [2024-08-06 05:02:17,261][52795] Sum rewards: 78.782, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.130', 'weapon5': '0.208', 'weapon2': '0.256', 'AMMO3': '0.259', 'AMMO4': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '68.000'} [2024-08-06 05:02:17,466][52647] DAMAGECOUNT value on done: 605500.0 [2024-08-06 05:02:17,467][52647] Sum rewards: 71.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.788', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon5': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '59.000'} [2024-08-06 05:02:17,628][52650] Updated weights for policy 0, policy_version 58061 (0.0032) [2024-08-06 05:02:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 475635712. Throughput: 0: 4371.6. Samples: 118907840. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:17,794][52567] Avg episode reward: [(0, '69.998')] [2024-08-06 05:02:17,849][52794] DAMAGECOUNT value on done: 595198.0 [2024-08-06 05:02:17,853][52794] Sum rewards: 71.634, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.115', 'weapon5': '0.124', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.806', 'WEAPON3': '1.000', 'weapon3': '2.858', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:18,093][52666] DAMAGECOUNT value on done: 586412.0 [2024-08-06 05:02:18,094][52666] Sum rewards: 82.697, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.936', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO4': '0.226', 'AMMO3': '0.239', 'weapon2': '0.254', 'weapon4': '0.266', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '71.000'} [2024-08-06 05:02:18,856][52667] DAMAGECOUNT value on done: 585629.0 [2024-08-06 05:02:18,859][52667] Sum rewards: 81.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.080', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:19,222][52663] DAMAGECOUNT value on done: 582769.0 [2024-08-06 05:02:19,223][52663] Sum rewards: 67.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.595', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.088', 'weapon5': '0.118', 'AMMO3': '0.234', 'AMMO4': '0.297', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '59.000'} [2024-08-06 05:02:19,756][52820] DAMAGECOUNT value on done: 538485.0 [2024-08-06 05:02:19,758][52820] Sum rewards: 80.183, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.475', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.274', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.468', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '69.000'} [2024-08-06 05:02:20,414][52647] DAMAGECOUNT value on done: 610657.0 [2024-08-06 05:02:20,415][52647] Sum rewards: 72.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.822', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.078', 'weapon5': '0.204', 'AMMO4': '0.205', 'AMMO3': '0.205', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:20,425][52795] DAMAGECOUNT value on done: 542037.0 [2024-08-06 05:02:20,425][52795] Sum rewards: 64.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.292', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.444', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:20,661][52670] DAMAGECOUNT value on done: 577260.0 [2024-08-06 05:02:20,664][52670] Sum rewards: 64.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.729', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon5': '0.222', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '53.000'} [2024-08-06 05:02:21,079][52794] DAMAGECOUNT value on done: 584791.0 [2024-08-06 05:02:21,080][52794] Sum rewards: 73.082, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.334', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon2': '0.140', 'AMMO4': '0.141', 'AMMO3': '0.168', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:21,315][52666] DAMAGECOUNT value on done: 588448.0 [2024-08-06 05:02:21,318][52666] Sum rewards: 86.588, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.966', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.159', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.150', 'weapon3': '2.664', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '68.000'} [2024-08-06 05:02:21,370][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:02:21,687][52667] DAMAGECOUNT value on done: 592800.0 [2024-08-06 05:02:21,688][52667] Sum rewards: 73.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.747', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.265', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '63.000'} [2024-08-06 05:02:21,981][52663] DAMAGECOUNT value on done: 587787.0 [2024-08-06 05:02:21,982][52663] Sum rewards: 60.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.958', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.127', 'weapon5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '2.954', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '52.000'} [2024-08-06 05:02:22,228][52650] Updated weights for policy 0, policy_version 58071 (0.0013) [2024-08-06 05:02:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 475717632. Throughput: 0: 4376.1. Samples: 118934270. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:22,794][52567] Avg episode reward: [(0, '70.294')] [2024-08-06 05:02:22,916][52820] DAMAGECOUNT value on done: 546481.0 [2024-08-06 05:02:22,916][52820] Sum rewards: 69.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.795', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.158', 'AMMO4': '0.205', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:23,673][52670] DAMAGECOUNT value on done: 585951.0 [2024-08-06 05:02:23,675][52670] Sum rewards: 74.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.183', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:23,676][52795] DAMAGECOUNT value on done: 536324.0 [2024-08-06 05:02:23,678][52795] Sum rewards: 71.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.428', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:24,062][52666] DAMAGECOUNT value on done: 589808.0 [2024-08-06 05:02:24,062][52666] Sum rewards: 88.997, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.163', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.149', 'AMMO4': '0.171', 'weapon2': '0.236', 'weapon5': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.774', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '69.000'} [2024-08-06 05:02:24,840][52667] DAMAGECOUNT value on done: 595229.0 [2024-08-06 05:02:24,842][52667] Sum rewards: 72.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.332', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon2': '0.168', 'weapon4': '0.194', 'weapon5': '0.212', 'AMMO3': '0.233', 'AMMO4': '0.273', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:24,867][52663] DAMAGECOUNT value on done: 593775.0 [2024-08-06 05:02:24,868][52663] Sum rewards: 72.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.140', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.092', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.191', 'WEAPON3': '1.050', 'weapon3': '3.454', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '56.000'} [2024-08-06 05:02:26,061][52820] DAMAGECOUNT value on done: 537858.0 [2024-08-06 05:02:26,061][52820] Sum rewards: 69.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.766', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon4': '0.128', 'weapon5': '0.150', 'AMMO3': '0.273', 'AMMO4': '0.317', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.996', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:26,357][52670] DAMAGECOUNT value on done: 580138.0 [2024-08-06 05:02:26,358][52670] Sum rewards: 76.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.271', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.232', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:26,771][52795] DAMAGECOUNT value on done: 538330.0 [2024-08-06 05:02:26,772][52795] Sum rewards: 73.144, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.876', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.090', 'weapon4': '0.196', 'weapon2': '0.258', 'AMMO4': '0.262', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.162', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:26,864][52650] Updated weights for policy 0, policy_version 58081 (0.0023) [2024-08-06 05:02:26,991][52803] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:02:26,994][52666] DAMAGECOUNT value on done: 587784.0 [2024-08-06 05:02:26,995][52666] Sum rewards: 68.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.410', 'weapon3': '3.440', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:27,531][52663] DAMAGECOUNT value on done: 585769.0 [2024-08-06 05:02:27,539][52663] Sum rewards: 70.050, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.426', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.062', 'AMMO4': '0.155', 'weapon5': '0.180', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '59.000'} [2024-08-06 05:02:27,714][52667] DAMAGECOUNT value on done: 582997.0 [2024-08-06 05:02:27,715][52667] Sum rewards: 69.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 475807744. Throughput: 0: 4372.2. Samples: 118960400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:27,794][52567] Avg episode reward: [(0, '71.213')] [2024-08-06 05:02:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058082_475807744.pth... [2024-08-06 05:02:27,963][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057569_471605248.pth [2024-08-06 05:02:29,222][52614] Signal inference workers to stop experience collection... (10550 times) [2024-08-06 05:02:29,222][52614] Signal inference workers to resume experience collection... (10550 times) [2024-08-06 05:02:29,253][52820] DAMAGECOUNT value on done: 543313.0 [2024-08-06 05:02:29,253][52820] Sum rewards: 75.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.102', 'weapon5': '0.128', 'AMMO4': '0.167', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.000'} [2024-08-06 05:02:29,302][52650] InferenceWorker_p0-w0: stopping experience collection (10550 times) [2024-08-06 05:02:29,302][52650] InferenceWorker_p0-w0: resuming experience collection (10550 times) [2024-08-06 05:02:29,412][52670] DAMAGECOUNT value on done: 576023.0 [2024-08-06 05:02:29,414][52670] Sum rewards: 63.300, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.730', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.170', 'AMMO3': '0.193', 'weapon4': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '53.000'} [2024-08-06 05:02:29,908][52666] DAMAGECOUNT value on done: 582382.0 [2024-08-06 05:02:29,909][52666] Sum rewards: 69.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.247', 'weapon2': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.236', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '59.000'} [2024-08-06 05:02:30,138][52795] DAMAGECOUNT value on done: 543650.0 [2024-08-06 05:02:30,139][52795] Sum rewards: 86.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'weapon5': '0.012', 'weapon4': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '71.000'} [2024-08-06 05:02:30,570][52663] DAMAGECOUNT value on done: 582165.0 [2024-08-06 05:02:30,570][52663] Sum rewards: 81.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.112', 'AMMO4': '0.171', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.328', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '68.000'} [2024-08-06 05:02:30,659][52667] DAMAGECOUNT value on done: 585615.0 [2024-08-06 05:02:30,659][52667] Sum rewards: 76.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.103', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '61.000'} [2024-08-06 05:02:31,947][52650] Updated weights for policy 0, policy_version 58091 (0.0023) [2024-08-06 05:02:32,062][52670] DAMAGECOUNT value on done: 590920.0 [2024-08-06 05:02:32,062][52670] Sum rewards: 67.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.146', 'weapon4': '0.184', 'AMMO3': '0.220', 'WEAPON3': '1.400', 'weapon3': '3.426', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '56.000'} [2024-08-06 05:02:32,409][52820] DAMAGECOUNT value on done: 546922.0 [2024-08-06 05:02:32,412][52820] Sum rewards: 75.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.890', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.056', 'AMMO4': '0.189', 'weapon5': '0.220', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '63.000'} [2024-08-06 05:02:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 475897856. Throughput: 0: 4362.2. Samples: 118973150. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:32,794][52567] Avg episode reward: [(0, '71.810')] [2024-08-06 05:02:32,802][52666] DAMAGECOUNT value on done: 579107.0 [2024-08-06 05:02:32,802][52666] Sum rewards: 73.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.264', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.196', 'weapon4': '0.246', 'AMMO4': '0.253', 'weapon2': '0.438', 'weapon5': '0.468', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.540', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:33,234][52795] DAMAGECOUNT value on done: 534082.0 [2024-08-06 05:02:33,242][52795] Sum rewards: 68.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.540', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'WEAPON3': '1.700', 'HITCOUNT': '3.170', 'weapon3': '3.564', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:33,418][52663] DAMAGECOUNT value on done: 578158.0 [2024-08-06 05:02:33,419][52663] Sum rewards: 80.610, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.042', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.097', 'AMMO3': '0.141', 'weapon2': '0.504', 'WEAPON3': '0.850', 'weapon3': '3.286', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:33,677][52664] DAMAGECOUNT value on done: 608579.0 [2024-08-06 05:02:33,677][52667] DAMAGECOUNT value on done: 592537.0 [2024-08-06 05:02:33,679][52664] Sum rewards: 84.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.836', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.082', 'weapon5': '0.142', 'AMMO3': '0.220', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '70.000'} [2024-08-06 05:02:33,679][52667] Sum rewards: 72.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.921', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:34,890][52670] DAMAGECOUNT value on done: 584285.0 [2024-08-06 05:02:34,892][52670] Sum rewards: 73.959, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.912', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.171', 'weapon5': '0.210', 'AMMO4': '0.221', 'weapon4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.876', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:35,607][52666] DAMAGECOUNT value on done: 584205.0 [2024-08-06 05:02:35,609][52666] Sum rewards: 74.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.373', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.078', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.368', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '63.000'} [2024-08-06 05:02:35,631][52820] DAMAGECOUNT value on done: 540507.0 [2024-08-06 05:02:35,633][52820] Sum rewards: 77.491, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.035', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.120', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.232', 'WEAPON3': '1.100', 'weapon3': '3.448', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '62.000'} [2024-08-06 05:02:36,111][52664] DAMAGECOUNT value on done: 613117.0 [2024-08-06 05:02:36,113][52664] Sum rewards: 82.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.134', 'AMMO4': '0.187', 'AMMO3': '0.206', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '69.000'} [2024-08-06 05:02:36,237][52663] DAMAGECOUNT value on done: 585571.0 [2024-08-06 05:02:36,239][52663] Sum rewards: 75.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.066', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.096', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon2': '0.368', 'WEAPON3': '1.000', 'weapon3': '3.318', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '61.000'} [2024-08-06 05:02:36,330][52795] DAMAGECOUNT value on done: 549697.0 [2024-08-06 05:02:36,331][52795] Sum rewards: 78.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.915', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.170', 'weapon5': '0.236', 'AMMO3': '0.251', 'AMMO4': '0.254', 'weapon2': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.884', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:36,689][52650] Updated weights for policy 0, policy_version 58101 (0.0030) [2024-08-06 05:02:36,803][52667] DAMAGECOUNT value on done: 582113.0 [2024-08-06 05:02:36,803][52667] Sum rewards: 67.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.206', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.074', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:37,755][52670] DAMAGECOUNT value on done: 573019.0 [2024-08-06 05:02:37,756][52670] Sum rewards: 65.044, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.695', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO4': '0.135', 'weapon5': '0.140', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.5, 300 sec: 17467.0). Total num frames: 475979776. Throughput: 0: 4360.7. Samples: 118999240. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:37,794][52567] Avg episode reward: [(0, '72.334')] [2024-08-06 05:02:38,427][52666] DAMAGECOUNT value on done: 583020.0 [2024-08-06 05:02:38,428][52666] Sum rewards: 64.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.132', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.270', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.126', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '56.000'} [2024-08-06 05:02:38,804][52664] DAMAGECOUNT value on done: 611610.0 [2024-08-06 05:02:38,805][52664] Sum rewards: 80.857, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.485', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.134', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:38,911][52820] DAMAGECOUNT value on done: 551042.0 [2024-08-06 05:02:38,914][52820] Sum rewards: 71.076, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.418', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.162', 'weapon5': '0.184', 'AMMO3': '0.240', 'AMMO4': '0.255', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '62.000'} [2024-08-06 05:02:38,943][52663] DAMAGECOUNT value on done: 594604.0 [2024-08-06 05:02:38,947][52663] Sum rewards: 59.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.661', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.112', 'AMMO3': '0.184', 'weapon2': '0.282', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.320', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '48.000'} [2024-08-06 05:02:39,163][52649] DAMAGECOUNT value on done: 567841.0 [2024-08-06 05:02:39,164][52649] Sum rewards: 55.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.965', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.168', 'AMMO3': '0.192', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '3.120', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '45.000'} [2024-08-06 05:02:39,452][52795] DAMAGECOUNT value on done: 542972.0 [2024-08-06 05:02:39,452][52795] Sum rewards: 83.579, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.391', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.128', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.278', 'weapon2': '0.582', 'WEAPON3': '0.950', 'weapon3': '2.782', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:39,618][52667] DAMAGECOUNT value on done: 592326.0 [2024-08-06 05:02:39,619][52667] Sum rewards: 72.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.945', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.124', 'AMMO3': '0.166', 'AMMO4': '0.166', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:39,804][52662] Large shaping reward 2.530 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.10200000000000001, -34.0), ('weapon5', 0.002)] [2024-08-06 05:02:40,790][52670] DAMAGECOUNT value on done: 581290.0 [2024-08-06 05:02:40,790][52670] Sum rewards: 64.139, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:41,069][52650] Updated weights for policy 0, policy_version 58111 (0.0032) [2024-08-06 05:02:41,527][52666] DAMAGECOUNT value on done: 584577.0 [2024-08-06 05:02:41,528][52666] Sum rewards: 72.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.182', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.158', 'AMMO3': '0.178', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.280', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:41,564][52664] DAMAGECOUNT value on done: 604002.0 [2024-08-06 05:02:41,564][52664] Sum rewards: 77.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.072', 'AMMO4': '0.093', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '65.500'} [2024-08-06 05:02:41,969][52820] DAMAGECOUNT value on done: 538850.0 [2024-08-06 05:02:41,970][52820] Sum rewards: 61.993, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.563', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.162', 'weapon2': '0.196', 'AMMO4': '0.248', 'AMMO3': '0.285', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.034', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:42,086][52663] DAMAGECOUNT value on done: 580625.0 [2024-08-06 05:02:42,087][52663] Sum rewards: 79.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.259', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.186', 'AMMO4': '0.202', 'AMMO3': '0.255', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '68.000'} [2024-08-06 05:02:42,128][52667] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon3', 0.002)] [2024-08-06 05:02:42,266][52649] DAMAGECOUNT value on done: 562060.0 [2024-08-06 05:02:42,268][52649] Sum rewards: 75.223, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.174', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO4': '0.201', 'weapon2': '0.212', 'weapon4': '0.242', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:42,564][52795] DAMAGECOUNT value on done: 535292.0 [2024-08-06 05:02:42,565][52795] Sum rewards: 73.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.142', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.322', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:42,787][52667] DAMAGECOUNT value on done: 597834.0 [2024-08-06 05:02:42,790][52667] Sum rewards: 82.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.116', 'weapon5': '0.132', 'AMMO3': '0.207', 'AMMO4': '0.269', 'weapon2': '0.342', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '69.000'} [2024-08-06 05:02:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 476061696. Throughput: 0: 4363.1. Samples: 119025600. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:42,794][52567] Avg episode reward: [(0, '72.155')] [2024-08-06 05:02:43,408][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:02:44,154][52664] DAMAGECOUNT value on done: 611411.0 [2024-08-06 05:02:44,154][52664] Sum rewards: 78.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.104', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:44,171][52670] DAMAGECOUNT value on done: 580118.0 [2024-08-06 05:02:44,172][52670] Sum rewards: 63.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.244', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.490', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '52.000'} [2024-08-06 05:02:44,724][52666] DAMAGECOUNT value on done: 579056.0 [2024-08-06 05:02:44,724][52666] Sum rewards: 74.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.152', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.130', 'weapon5': '0.154', 'AMMO3': '0.180', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '62.000'} [2024-08-06 05:02:44,811][52663] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 05:02:44,955][52663] DAMAGECOUNT value on done: 577962.0 [2024-08-06 05:02:44,956][52663] Sum rewards: 71.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.320', 'AMMO5': '0.018', 'AMMO2': '0.067', 'weapon5': '0.240', 'AMMO3': '0.253', 'AMMO4': '0.333', 'weapon4': '0.366', 'weapon2': '0.436', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.466', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:45,185][52820] DAMAGECOUNT value on done: 544688.0 [2024-08-06 05:02:45,185][52820] Sum rewards: 60.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.085', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.247', 'weapon2': '0.268', 'weapon5': '0.280', 'AMMO4': '0.306', 'weapon4': '0.404', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.674', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '52.000'} [2024-08-06 05:02:45,264][52649] DAMAGECOUNT value on done: 580033.0 [2024-08-06 05:02:45,267][52649] Sum rewards: 65.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.156', 'weapon4': '0.186', 'AMMO3': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.458', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:45,688][52795] DAMAGECOUNT value on done: 542485.0 [2024-08-06 05:02:45,690][52795] Sum rewards: 63.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.130', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.119', 'weapon5': '0.138', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '51.000'} [2024-08-06 05:02:46,007][52667] DAMAGECOUNT value on done: 596530.0 [2024-08-06 05:02:46,010][52667] Sum rewards: 52.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.126', 'AMMO4': '0.182', 'AMMO3': '0.219', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.894', 'WEAPON3': '1.300', 'weapon3': '2.494', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '14.943', 'FRAGCOUNT': '45.500'} [2024-08-06 05:02:46,096][52650] Updated weights for policy 0, policy_version 58121 (0.0014) [2024-08-06 05:02:46,867][52670] DAMAGECOUNT value on done: 579851.0 [2024-08-06 05:02:46,869][52670] Sum rewards: 74.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.018', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:46,917][52664] DAMAGECOUNT value on done: 609040.0 [2024-08-06 05:02:46,917][52664] Sum rewards: 65.765, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.466', 'AMMO5': '0.024', 'AMMO2': '0.049', 'weapon4': '0.180', 'AMMO3': '0.238', 'AMMO4': '0.245', 'weapon5': '0.256', 'weapon2': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:47,516][52666] DAMAGECOUNT value on done: 580238.0 [2024-08-06 05:02:47,516][52666] Sum rewards: 76.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.677', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.136', 'weapon4': '0.142', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'WEAPON3': '1.700', 'weapon3': '3.282', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '66.000'} [2024-08-06 05:02:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17481.7, 300 sec: 17467.0). Total num frames: 476151808. Throughput: 0: 4360.0. Samples: 119038520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:02:47,794][52567] Avg episode reward: [(0, '72.045')] [2024-08-06 05:02:48,186][52663] DAMAGECOUNT value on done: 581632.0 [2024-08-06 05:02:48,191][52663] Sum rewards: 64.632, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.550', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.116', 'weapon5': '0.236', 'weapon2': '0.296', 'AMMO3': '0.299', 'AMMO4': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'HITCOUNT': '3.010', 'weapon3': '3.040', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:48,293][52820] DAMAGECOUNT value on done: 552847.0 [2024-08-06 05:02:48,294][52820] Sum rewards: 73.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.233', 'weapon2': '0.608', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '62.000'} [2024-08-06 05:02:48,329][52649] DAMAGECOUNT value on done: 575000.0 [2024-08-06 05:02:48,330][52649] Sum rewards: 80.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.253', 'weapon2': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.560', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '69.000'} [2024-08-06 05:02:48,783][52795] DAMAGECOUNT value on done: 548999.0 [2024-08-06 05:02:48,784][52795] Sum rewards: 81.060, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.150', 'AMMO3': '0.155', 'weapon5': '0.160', 'AMMO4': '0.229', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '2.946', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '66.000'} [2024-08-06 05:02:49,070][52667] DAMAGECOUNT value on done: 595087.0 [2024-08-06 05:02:49,071][52667] Sum rewards: 60.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.099', 'weapon5': '0.132', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.152', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '50.000'} [2024-08-06 05:02:49,250][52669] DAMAGECOUNT value on done: 590452.0 [2024-08-06 05:02:49,257][52669] Sum rewards: 54.636, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.138', 'AMMO4': '0.181', 'weapon5': '0.262', 'weapon4': '0.340', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '2.470', 'weapon3': '2.600', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '44.000'} [2024-08-06 05:02:49,392][52664] DAMAGECOUNT value on done: 604995.0 [2024-08-06 05:02:49,393][52664] Sum rewards: 66.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.737', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon2': '0.204', 'AMMO3': '0.214', 'weapon5': '0.216', 'weapon4': '0.218', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.128', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:49,771][52670] DAMAGECOUNT value on done: 585634.0 [2024-08-06 05:02:49,772][52670] Sum rewards: 72.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.126', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.486', 'weapon4': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.586', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '59.000'} [2024-08-06 05:02:50,316][52666] DAMAGECOUNT value on done: 574593.0 [2024-08-06 05:02:50,317][52666] Sum rewards: 62.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.891', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.170', 'AMMO3': '0.223', 'weapon2': '0.224', 'AMMO4': '0.249', 'weapon5': '0.260', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.056', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '52.000'} [2024-08-06 05:02:50,921][52663] DAMAGECOUNT value on done: 579783.0 [2024-08-06 05:02:50,921][52663] Sum rewards: 70.935, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon7': '0.056', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'AMMO4': '0.192', 'WEAPON7': '0.200', 'HEALTH': '0.222', 'weapon5': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.520', 'weapon4': '0.676', 'WEAPON3': '0.800', 'weapon3': '2.158', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '56.000'} [2024-08-06 05:02:51,051][52650] Updated weights for policy 0, policy_version 58131 (0.0031) [2024-08-06 05:02:51,418][52649] DAMAGECOUNT value on done: 563325.0 [2024-08-06 05:02:51,419][52649] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'weapon5': '0.126', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.500'} [2024-08-06 05:02:51,557][52820] DAMAGECOUNT value on done: 548385.0 [2024-08-06 05:02:51,557][52820] Sum rewards: 79.333, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.055', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.274', 'weapon2': '0.310', 'WEAPON3': '1.700', 'weapon3': '3.342', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '68.000'} [2024-08-06 05:02:51,801][52669] DAMAGECOUNT value on done: 581497.0 [2024-08-06 05:02:51,803][52669] Sum rewards: 73.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '61.000'} [2024-08-06 05:02:52,019][52667] DAMAGECOUNT value on done: 588063.0 [2024-08-06 05:02:52,021][52667] Sum rewards: 82.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.202', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '67.000'} [2024-08-06 05:02:52,103][52664] DAMAGECOUNT value on done: 601672.0 [2024-08-06 05:02:52,105][52664] Sum rewards: 68.946, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.710', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.326', 'weapon2': '0.508', 'WEAPON3': '1.900', 'weapon3': '2.998', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:52,448][52670] DAMAGECOUNT value on done: 572265.0 [2024-08-06 05:02:52,450][52670] Sum rewards: 65.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.785', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.128', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.268', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 476241920. Throughput: 0: 4355.3. Samples: 119064660. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:02:52,794][52567] Avg episode reward: [(0, '72.007')] [2024-08-06 05:02:53,119][52666] DAMAGECOUNT value on done: 587792.0 [2024-08-06 05:02:53,120][52666] Sum rewards: 72.988, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.324', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon2': '0.148', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon4': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:53,882][52811] DAMAGECOUNT value on done: 560617.0 [2024-08-06 05:02:53,883][52811] Sum rewards: 67.537, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.448', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.188', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon4': '0.282', 'weapon2': '0.318', 'ARMOR': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.878', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 05:02:53,889][52663] DAMAGECOUNT value on done: 590660.0 [2024-08-06 05:02:53,891][52663] Sum rewards: 67.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.164', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.052', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.196', 'weapon2': '0.392', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.346', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '56.000'} [2024-08-06 05:02:54,151][52649] DAMAGECOUNT value on done: 576256.0 [2024-08-06 05:02:54,151][52649] Sum rewards: 75.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.298', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.050', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.180', 'AMMO3': '0.218', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.504', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '63.000'} [2024-08-06 05:02:54,163][52671] DAMAGECOUNT value on done: 595666.0 [2024-08-06 05:02:54,163][52671] Sum rewards: 67.242, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.802', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.100', 'weapon2': '0.142', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'WEAPON3': '1.650', 'HITCOUNT': '3.330', 'weapon3': '3.416', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:54,613][52820] DAMAGECOUNT value on done: 550325.0 [2024-08-06 05:02:54,613][52820] Sum rewards: 69.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.741', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon4': '0.034', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon5': '0.246', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:54,786][52669] DAMAGECOUNT value on done: 592052.0 [2024-08-06 05:02:54,787][52669] Sum rewards: 68.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.255', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.088', 'weapon5': '0.110', 'AMMO4': '0.134', 'AMMO3': '0.275', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 05:02:55,136][52664] DAMAGECOUNT value on done: 613693.0 [2024-08-06 05:02:55,137][52664] Sum rewards: 71.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:55,168][52667] DAMAGECOUNT value on done: 595865.0 [2024-08-06 05:02:55,169][52667] Sum rewards: 78.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.648', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.042', 'AMMO4': '0.086', 'weapon5': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:55,282][52650] Updated weights for policy 0, policy_version 58141 (0.0012) [2024-08-06 05:02:55,549][52670] DAMAGECOUNT value on done: 580745.0 [2024-08-06 05:02:55,551][52670] Sum rewards: 62.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.124', 'weapon4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.228', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:55,951][52666] DAMAGECOUNT value on done: 581366.0 [2024-08-06 05:02:55,952][52666] Sum rewards: 68.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.092', 'AMMO4': '0.146', 'weapon5': '0.150', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.298', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 05:02:56,778][52663] DAMAGECOUNT value on done: 581363.0 [2024-08-06 05:02:56,779][52663] Sum rewards: 79.090, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.174', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.168', 'weapon4': '0.188', 'AMMO3': '0.212', 'AMMO4': '0.234', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '63.000'} [2024-08-06 05:02:56,926][52811] DAMAGECOUNT value on done: 543804.0 [2024-08-06 05:02:56,926][52811] Sum rewards: 62.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.154', 'AMMO3': '0.211', 'AMMO4': '0.232', 'weapon4': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.594', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '53.000'} [2024-08-06 05:02:57,129][52671] DAMAGECOUNT value on done: 594916.0 [2024-08-06 05:02:57,129][52671] Sum rewards: 78.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.627', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon2': '0.136', 'weapon4': '0.156', 'AMMO4': '0.174', 'AMMO3': '0.227', 'weapon5': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '65.000'} [2024-08-06 05:02:57,497][52649] DAMAGECOUNT value on done: 571351.0 [2024-08-06 05:02:57,497][52649] Sum rewards: 83.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.775', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.052', 'AMMO4': '0.072', 'weapon4': '0.080', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '69.500'} [2024-08-06 05:02:57,654][52664] DAMAGECOUNT value on done: 606520.0 [2024-08-06 05:02:57,655][52664] Sum rewards: 78.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.733', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '64.000'} [2024-08-06 05:02:57,722][52820] DAMAGECOUNT value on done: 546547.0 [2024-08-06 05:02:57,724][52820] Sum rewards: 71.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.256', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.112', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.644', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '60.000'} [2024-08-06 05:02:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 476332032. Throughput: 0: 4355.1. Samples: 119090950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:02:57,794][52567] Avg episode reward: [(0, '71.974')] [2024-08-06 05:02:57,809][52669] DAMAGECOUNT value on done: 591456.0 [2024-08-06 05:02:57,809][52669] Sum rewards: 72.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.144', 'AMMO4': '0.180', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '61.000'} [2024-08-06 05:02:57,820][52670] DAMAGECOUNT value on done: 589571.0 [2024-08-06 05:02:57,821][52670] Sum rewards: 65.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.508', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.118', 'weapon2': '0.188', 'AMMO4': '0.203', 'weapon4': '0.218', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.238', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '57.000'} [2024-08-06 05:02:58,238][52666] DAMAGECOUNT value on done: 585666.0 [2024-08-06 05:02:58,239][52666] Sum rewards: 60.988, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.727', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.104', 'AMMO4': '0.142', 'weapon5': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '2.892', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '51.000'} [2024-08-06 05:02:59,850][52664] DAMAGECOUNT value on done: 613363.0 [2024-08-06 05:02:59,861][52664] Sum rewards: 64.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.452', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.092', 'weapon5': '0.124', 'AMMO3': '0.199', 'AMMO4': '0.209', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '55.000'} [2024-08-06 05:02:59,932][52663] DAMAGECOUNT value on done: 591097.0 [2024-08-06 05:02:59,936][52663] Sum rewards: 65.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.126', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.102', 'weapon5': '0.124', 'AMMO4': '0.188', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.286', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:00,016][52811] DAMAGECOUNT value on done: 543444.0 [2024-08-06 05:03:00,016][52811] Sum rewards: 76.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.060', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:00,114][52671] DAMAGECOUNT value on done: 591649.0 [2024-08-06 05:03:00,114][52671] Sum rewards: 60.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.655', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.054', 'AMMO4': '0.147', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.400', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '50.000'} [2024-08-06 05:03:00,308][52650] Updated weights for policy 0, policy_version 58151 (0.0011) [2024-08-06 05:03:00,485][52794] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon5', 0.002)] [2024-08-06 05:03:00,679][52670] DAMAGECOUNT value on done: 585424.0 [2024-08-06 05:03:00,680][52670] Sum rewards: 64.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.160', 'weapon5': '0.170', 'AMMO3': '0.221', 'AMMO4': '0.248', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '53.000'} [2024-08-06 05:03:00,692][52649] DAMAGECOUNT value on done: 573488.0 [2024-08-06 05:03:00,692][52649] Sum rewards: 79.558, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.141', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon4': '0.278', 'weapon2': '0.302', 'WEAPON3': '1.600', 'weapon3': '2.998', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '67.000'} [2024-08-06 05:03:00,788][52658] DAMAGECOUNT value on done: 589461.0 [2024-08-06 05:03:00,788][52658] Sum rewards: 69.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.271', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.096', 'AMMO4': '0.147', 'weapon5': '0.214', 'weapon2': '0.230', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:00,845][52820] DAMAGECOUNT value on done: 547860.0 [2024-08-06 05:03:00,845][52820] Sum rewards: 77.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.217', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.088', 'weapon5': '0.138', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'AMMO4': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:00,933][52669] DAMAGECOUNT value on done: 587247.0 [2024-08-06 05:03:00,935][52669] Sum rewards: 73.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.482', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.141', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:01,243][52666] DAMAGECOUNT value on done: 580105.0 [2024-08-06 05:03:01,245][52666] Sum rewards: 72.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.628', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO4': '0.224', 'weapon5': '0.226', 'AMMO3': '0.233', 'weapon4': '0.264', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:02,790][52671] DAMAGECOUNT value on done: 592773.0 [2024-08-06 05:03:02,790][52671] Sum rewards: 73.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.023', 'AMMO2': '0.066', 'weapon4': '0.118', 'AMMO3': '0.225', 'weapon5': '0.242', 'AMMO4': '0.328', 'weapon2': '0.368', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:02,793][52664] DAMAGECOUNT value on done: 612194.0 [2024-08-06 05:03:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 476413952. Throughput: 0: 4364.0. Samples: 119104220. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:03:02,795][52567] Avg episode reward: [(0, '71.497')] [2024-08-06 05:03:02,795][52664] Sum rewards: 56.345, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.708', 'AMMO5': '0.010', 'AMMO2': '0.055', 'AMMO3': '0.173', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.275', 'weapon2': '0.296', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.000', 'weapon3': '2.828', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '43.000'} [2024-08-06 05:03:03,123][52663] DAMAGECOUNT value on done: 592187.0 [2024-08-06 05:03:03,124][52663] Sum rewards: 66.582, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.098', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.286', 'WEAPON3': '1.650', 'HITCOUNT': '3.170', 'weapon3': '3.290', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '58.500'} [2024-08-06 05:03:03,137][52811] DAMAGECOUNT value on done: 545122.0 [2024-08-06 05:03:03,141][52811] Sum rewards: 75.280, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.716', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:03,471][52649] DAMAGECOUNT value on done: 575750.0 [2024-08-06 05:03:03,472][52649] Sum rewards: 76.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.229', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.125', 'weapon4': '0.172', 'AMMO3': '0.215', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '64.000'} [2024-08-06 05:03:03,762][52670] DAMAGECOUNT value on done: 568835.0 [2024-08-06 05:03:03,763][52670] Sum rewards: 72.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.073', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'weapon4': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:03,891][52820] DAMAGECOUNT value on done: 555877.0 [2024-08-06 05:03:03,891][52820] Sum rewards: 68.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.005', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.207', 'weapon5': '0.220', 'weapon2': '0.262', 'weapon4': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:03,959][52658] DAMAGECOUNT value on done: 588766.0 [2024-08-06 05:03:03,960][52658] Sum rewards: 85.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.542', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '70.000'} [2024-08-06 05:03:04,138][52669] DAMAGECOUNT value on done: 594636.0 [2024-08-06 05:03:04,141][52669] Sum rewards: 88.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.547', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.160', 'weapon4': '0.170', 'AMMO3': '0.207', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.697', 'FRAGCOUNT': '73.000'} [2024-08-06 05:03:04,268][52666] DAMAGECOUNT value on done: 583426.0 [2024-08-06 05:03:04,270][52666] Sum rewards: 67.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.500', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.226', 'weapon5': '0.228', 'weapon2': '0.246', 'AMMO4': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '55.000'} [2024-08-06 05:03:04,392][52650] Updated weights for policy 0, policy_version 58161 (0.0011) [2024-08-06 05:03:05,568][52671] DAMAGECOUNT value on done: 603543.0 [2024-08-06 05:03:05,568][52671] Sum rewards: 76.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.853', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.189', 'weapon4': '0.198', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:05,637][52664] DAMAGECOUNT value on done: 616249.0 [2024-08-06 05:03:05,637][52664] Sum rewards: 58.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.014', 'AMMO2': '0.060', 'weapon4': '0.130', 'AMMO3': '0.191', 'weapon5': '0.230', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '49.000'} [2024-08-06 05:03:05,915][52663] DAMAGECOUNT value on done: 582014.0 [2024-08-06 05:03:05,915][52663] Sum rewards: 75.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.359', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon2': '0.160', 'weapon5': '0.178', 'AMMO3': '0.198', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:06,352][52811] DAMAGECOUNT value on done: 550930.0 [2024-08-06 05:03:06,354][52811] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.530', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.056', 'AMMO4': '0.113', 'AMMO3': '0.186', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:06,439][52649] DAMAGECOUNT value on done: 566883.0 [2024-08-06 05:03:06,439][52649] Sum rewards: 80.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.079', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '64.000'} [2024-08-06 05:03:06,641][52670] DAMAGECOUNT value on done: 579585.0 [2024-08-06 05:03:06,642][52670] Sum rewards: 64.228, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.740', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.158', 'weapon5': '0.224', 'AMMO4': '0.224', 'weapon4': '0.234', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.662', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '51.000'} [2024-08-06 05:03:06,907][52669] DAMAGECOUNT value on done: 590338.0 [2024-08-06 05:03:06,910][52669] Sum rewards: 70.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.634', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.174', 'weapon4': '0.192', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:06,986][52820] DAMAGECOUNT value on done: 554950.0 [2024-08-06 05:03:06,990][52820] Sum rewards: 75.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.741', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'weapon2': '0.202', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:07,060][52658] DAMAGECOUNT value on done: 594039.0 [2024-08-06 05:03:07,061][52658] Sum rewards: 68.019, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.134', 'AMMO4': '0.194', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:07,214][52666] DAMAGECOUNT value on done: 590372.0 [2024-08-06 05:03:07,217][52666] Sum rewards: 81.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.136', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.056', 'AMMO4': '0.077', 'weapon5': '0.118', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '67.000'} [2024-08-06 05:03:07,592][52671] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:03:07,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 476512256. Throughput: 0: 4362.9. Samples: 119130600. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:03:07,795][52567] Avg episode reward: [(0, '71.285')] [2024-08-06 05:03:08,214][52664] DAMAGECOUNT value on done: 616762.0 [2024-08-06 05:03:08,214][52664] Sum rewards: 70.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.102', 'AMMO3': '0.199', 'weapon5': '0.200', 'AMMO4': '0.283', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:08,635][52671] DAMAGECOUNT value on done: 593702.0 [2024-08-06 05:03:08,638][52671] Sum rewards: 69.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.082', 'AMMO4': '0.128', 'weapon5': '0.186', 'AMMO3': '0.221', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.284', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:09,315][52669] DAMAGECOUNT value on done: 589294.0 [2024-08-06 05:03:09,316][52669] Sum rewards: 69.872, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'HEALTH': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.332', 'weapon2': '0.396', 'WEAPON3': '0.900', 'weapon3': '2.940', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '54.000'} [2024-08-06 05:03:09,395][52811] DAMAGECOUNT value on done: 555677.0 [2024-08-06 05:03:09,396][52811] Sum rewards: 62.048, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.296', 'weapon2': '0.316', 'WEAPON3': '1.650', 'HITCOUNT': '3.150', 'weapon3': '3.254', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:09,425][52650] Updated weights for policy 0, policy_version 58171 (0.0018) [2024-08-06 05:03:09,760][52649] DAMAGECOUNT value on done: 578334.0 [2024-08-06 05:03:09,763][52649] Sum rewards: 66.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.845', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'AMMO3': '0.211', 'weapon2': '0.308', 'WEAPON4': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:09,831][52670] DAMAGECOUNT value on done: 590902.0 [2024-08-06 05:03:09,832][52670] Sum rewards: 75.697, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.768', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon5': '0.210', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:10,118][52820] DAMAGECOUNT value on done: 540865.0 [2024-08-06 05:03:10,118][52820] Sum rewards: 84.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon4': '0.086', 'weapon5': '0.132', 'AMMO3': '0.140', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.624', 'WEAPON3': '0.950', 'weapon3': '2.912', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '66.000'} [2024-08-06 05:03:10,138][52658] DAMAGECOUNT value on done: 592831.0 [2024-08-06 05:03:10,139][52658] Sum rewards: 70.165, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.136', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.098', 'AMMO4': '0.176', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:10,178][52666] DAMAGECOUNT value on done: 571747.0 [2024-08-06 05:03:10,180][52666] Sum rewards: 67.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.247', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.218', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:10,827][52664] DAMAGECOUNT value on done: 617091.0 [2024-08-06 05:03:10,834][52664] Sum rewards: 68.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.968', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.134', 'AMMO4': '0.153', 'AMMO3': '0.192', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '55.000'} [2024-08-06 05:03:11,835][52671] DAMAGECOUNT value on done: 598117.0 [2024-08-06 05:03:11,846][52671] Sum rewards: 69.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.112', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon2': '0.160', 'AMMO4': '0.170', 'AMMO3': '0.217', 'weapon5': '0.228', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:12,224][52670] DAMAGECOUNT value on done: 579624.0 [2024-08-06 05:03:12,225][52670] Sum rewards: 57.792, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.828', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.246', 'weapon2': '0.356', 'WEAPON5': '0.400', 'weapon4': '0.480', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.662', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '50.000'} [2024-08-06 05:03:12,343][52669] DAMAGECOUNT value on done: 597960.0 [2024-08-06 05:03:12,343][52669] Sum rewards: 77.107, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.395', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'weapon5': '0.130', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.726', 'WEAPON3': '0.800', 'weapon3': '2.930', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:12,506][52811] DAMAGECOUNT value on done: 553579.0 [2024-08-06 05:03:12,506][52811] Sum rewards: 71.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.040', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.108', 'weapon5': '0.136', 'AMMO4': '0.156', 'AMMO3': '0.260', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.264', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:12,730][52666] DAMAGECOUNT value on done: 582652.0 [2024-08-06 05:03:12,731][52666] Sum rewards: 78.374, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.019', 'HEALTH': '0.080', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon5': '0.156', 'weapon2': '0.300', 'weapon4': '0.470', 'WEAPON3': '0.850', 'weapon3': '2.800', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:12,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 476602368. Throughput: 0: 4362.4. Samples: 119156710. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:03:12,794][52567] Avg episode reward: [(0, '70.986')] [2024-08-06 05:03:12,861][52649] DAMAGECOUNT value on done: 581830.0 [2024-08-06 05:03:12,862][52649] Sum rewards: 80.993, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.794', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.196', 'weapon4': '0.204', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.750', 'weapon3': '2.898', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '71.000'} [2024-08-06 05:03:12,984][52658] DAMAGECOUNT value on done: 581941.0 [2024-08-06 05:03:12,986][52658] Sum rewards: 71.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO4': '0.157', 'weapon5': '0.184', 'AMMO3': '0.229', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:13,723][52664] DAMAGECOUNT value on done: 610132.0 [2024-08-06 05:03:13,723][52664] Sum rewards: 66.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.561', 'AMMO5': '0.028', 'AMMO2': '0.067', 'AMMO3': '0.201', 'weapon5': '0.302', 'weapon4': '0.326', 'AMMO4': '0.336', 'weapon2': '0.376', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.676', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:13,846][52667] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.501, 167.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:03:14,398][52650] Updated weights for policy 0, policy_version 58181 (0.0012) [2024-08-06 05:03:14,874][52671] DAMAGECOUNT value on done: 593238.0 [2024-08-06 05:03:14,874][52671] Sum rewards: 75.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.204', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.094', 'weapon4': '0.104', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:15,204][52669] DAMAGECOUNT value on done: 588807.0 [2024-08-06 05:03:15,206][52669] Sum rewards: 68.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.064', 'AMMO4': '0.104', 'weapon4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:15,245][52658] DAMAGECOUNT value on done: 584780.0 [2024-08-06 05:03:15,245][52658] Sum rewards: 69.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.240', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:15,296][52670] DAMAGECOUNT value on done: 584921.0 [2024-08-06 05:03:15,297][52670] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.428', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.134', 'weapon5': '0.194', 'AMMO4': '0.251', 'AMMO3': '0.280', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.994', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:15,528][52811] DAMAGECOUNT value on done: 546589.0 [2024-08-06 05:03:15,529][52811] Sum rewards: 69.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.304', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.292', 'WEAPON3': '1.700', 'weapon3': '3.324', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:16,131][52649] DAMAGECOUNT value on done: 582331.0 [2024-08-06 05:03:16,139][52649] Sum rewards: 67.789, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.226', 'weapon2': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '55.000'} [2024-08-06 05:03:16,572][52664] DAMAGECOUNT value on done: 605263.0 [2024-08-06 05:03:16,572][52664] Sum rewards: 76.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.318', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:17,715][52671] DAMAGECOUNT value on done: 585121.0 [2024-08-06 05:03:17,717][52671] Sum rewards: 66.647, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.078', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.000'} [2024-08-06 05:03:17,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 476676096. Throughput: 0: 4371.3. Samples: 119169860. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:03:17,794][52567] Avg episode reward: [(0, '70.857')] [2024-08-06 05:03:18,107][52668] DAMAGECOUNT value on done: 588740.0 [2024-08-06 05:03:18,110][52668] Sum rewards: 72.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.145', 'weapon5': '0.148', 'weapon2': '0.186', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.348', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:18,346][52669] DAMAGECOUNT value on done: 594930.0 [2024-08-06 05:03:18,346][52669] Sum rewards: 72.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.209', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'weapon4': '0.102', 'AMMO4': '0.110', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:18,465][52658] DAMAGECOUNT value on done: 594286.0 [2024-08-06 05:03:18,466][52658] Sum rewards: 85.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.682', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.206', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '69.000'} [2024-08-06 05:03:18,575][52811] DAMAGECOUNT value on done: 556574.0 [2024-08-06 05:03:18,578][52811] Sum rewards: 61.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'weapon5': '0.144', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.370', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '53.000'} [2024-08-06 05:03:18,677][52650] Updated weights for policy 0, policy_version 58191 (0.0033) [2024-08-06 05:03:19,080][52664] DAMAGECOUNT value on done: 610189.0 [2024-08-06 05:03:19,080][52664] Sum rewards: 73.251, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'weapon5': '0.176', 'AMMO3': '0.181', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:19,309][52649] DAMAGECOUNT value on done: 579102.0 [2024-08-06 05:03:19,309][52649] Sum rewards: 80.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.142', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.424', 'weapon4': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '66.000'} [2024-08-06 05:03:20,855][52671] DAMAGECOUNT value on done: 591835.0 [2024-08-06 05:03:20,856][52671] Sum rewards: 57.655, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.016', 'AMMO2': '0.034', 'HEALTH': '0.120', 'AMMO3': '0.144', 'AMMO4': '0.170', 'weapon5': '0.322', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON4': '0.500', 'weapon4': '0.658', 'WEAPON3': '0.800', 'weapon3': '2.096', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.767', 'FRAGCOUNT': '45.000'} [2024-08-06 05:03:20,870][52668] DAMAGECOUNT value on done: 592385.0 [2024-08-06 05:03:20,870][52668] Sum rewards: 72.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.148', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.231', 'weapon5': '0.232', 'weapon2': '0.238', 'weapon4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:21,183][52669] DAMAGECOUNT value on done: 595162.0 [2024-08-06 05:03:21,189][52669] Sum rewards: 79.860, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.490', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '64.000'} [2024-08-06 05:03:21,428][52658] DAMAGECOUNT value on done: 584823.0 [2024-08-06 05:03:21,428][52658] Sum rewards: 76.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.154', 'AMMO4': '0.201', 'AMMO3': '0.212', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:21,535][52811] DAMAGECOUNT value on done: 551319.0 [2024-08-06 05:03:21,537][52811] Sum rewards: 70.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.754', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.068', 'weapon4': '0.084', 'AMMO3': '0.153', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '0.950', 'weapon3': '3.164', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:21,782][52664] DAMAGECOUNT value on done: 610635.0 [2024-08-06 05:03:21,782][52664] Sum rewards: 77.060, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.580', 'AMMO5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.201', 'weapon2': '0.260', 'AMMO4': '0.263', 'weapon4': '0.284', 'weapon5': '0.330', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:22,097][52649] DAMAGECOUNT value on done: 569415.0 [2024-08-06 05:03:22,099][52649] Sum rewards: 76.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.589', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.063', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '65.000'} [2024-08-06 05:03:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 476774400. Throughput: 0: 4375.8. Samples: 119196150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:03:22,794][52567] Avg episode reward: [(0, '71.523')] [2024-08-06 05:03:23,330][52650] Updated weights for policy 0, policy_version 58201 (0.0021) [2024-08-06 05:03:23,385][52668] DAMAGECOUNT value on done: 592441.0 [2024-08-06 05:03:23,386][52668] Sum rewards: 87.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.218', 'AMMO3': '0.229', 'WEAPON3': '1.500', 'weapon3': '3.518', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.366', 'FRAGCOUNT': '72.000'} [2024-08-06 05:03:23,843][52671] DAMAGECOUNT value on done: 594034.0 [2024-08-06 05:03:23,843][52671] Sum rewards: 84.959, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.322', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO4': '0.136', 'weapon2': '0.192', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '72.000'} [2024-08-06 05:03:23,925][52803] DAMAGECOUNT value on done: 548691.0 [2024-08-06 05:03:23,928][52803] Sum rewards: 74.590, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.417', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon2': '0.162', 'weapon5': '0.162', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon4': '0.526', 'WEAPON3': '1.400', 'weapon3': '2.808', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:24,049][52669] DAMAGECOUNT value on done: 582945.0 [2024-08-06 05:03:24,050][52669] Sum rewards: 84.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.435', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.072', 'weapon4': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '68.000'} [2024-08-06 05:03:24,428][52664] DAMAGECOUNT value on done: 609466.0 [2024-08-06 05:03:24,429][52664] Sum rewards: 74.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon2': '0.208', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:24,468][52658] DAMAGECOUNT value on done: 602919.0 [2024-08-06 05:03:24,475][52658] Sum rewards: 70.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.176', 'weapon4': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:24,630][52811] DAMAGECOUNT value on done: 553152.0 [2024-08-06 05:03:24,632][52811] Sum rewards: 68.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'AMMO5': '0.008', 'weapon5': '0.032', 'AMMO2': '0.039', 'weapon4': '0.132', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.220', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:25,336][52649] DAMAGECOUNT value on done: 577507.0 [2024-08-06 05:03:25,338][52649] Sum rewards: 76.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.024', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '65.000'} [2024-08-06 05:03:26,256][52668] DAMAGECOUNT value on done: 591862.0 [2024-08-06 05:03:26,264][52668] Sum rewards: 66.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.731', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.228', 'AMMO3': '0.284', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.146', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:26,581][52671] DAMAGECOUNT value on done: 589689.0 [2024-08-06 05:03:26,581][52671] Sum rewards: 56.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.136', 'AMMO4': '0.155', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.080', 'DAMAGECOUNT': '13.668', 'FRAGCOUNT': '47.000'} [2024-08-06 05:03:26,805][52669] DAMAGECOUNT value on done: 588672.0 [2024-08-06 05:03:26,806][52669] Sum rewards: 72.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.318', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.155', 'weapon4': '0.254', 'AMMO3': '0.258', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:27,163][52803] DAMAGECOUNT value on done: 546636.0 [2024-08-06 05:03:27,164][52803] Sum rewards: 68.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:27,625][52658] DAMAGECOUNT value on done: 588985.0 [2024-08-06 05:03:27,626][52658] Sum rewards: 75.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.752', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.088', 'weapon5': '0.212', 'AMMO3': '0.218', 'AMMO4': '0.252', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:27,671][52662] DAMAGECOUNT value on done: 595515.0 [2024-08-06 05:03:27,671][52662] Sum rewards: 76.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.212', 'weapon5': '0.224', 'weapon2': '0.244', 'weapon4': '0.270', 'AMMO4': '0.274', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '64.000'} [2024-08-06 05:03:27,684][52811] DAMAGECOUNT value on done: 559367.0 [2024-08-06 05:03:27,685][52811] Sum rewards: 70.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon4': '0.206', 'AMMO3': '0.219', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 476856320. Throughput: 0: 4375.6. Samples: 119222500. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 05:03:27,794][52567] Avg episode reward: [(0, '72.135')] [2024-08-06 05:03:27,976][52649] DAMAGECOUNT value on done: 566624.0 [2024-08-06 05:03:27,976][52649] Sum rewards: 77.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 05:03:28,106][52650] Updated weights for policy 0, policy_version 58211 (0.0023) [2024-08-06 05:03:29,424][52668] DAMAGECOUNT value on done: 580384.0 [2024-08-06 05:03:29,425][52668] Sum rewards: 65.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon4': '0.228', 'weapon2': '0.322', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '54.000'} [2024-08-06 05:03:29,453][52671] DAMAGECOUNT value on done: 597936.0 [2024-08-06 05:03:29,453][52671] Sum rewards: 74.159, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.259', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.174', 'weapon2': '0.430', 'WEAPON3': '1.000', 'weapon3': '3.192', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:29,576][52669] DAMAGECOUNT value on done: 591169.0 [2024-08-06 05:03:29,579][52669] Sum rewards: 68.143, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.042', 'weapon4': '0.112', 'AMMO4': '0.132', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'HEALTH': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '54.000'} [2024-08-06 05:03:30,276][52658] DAMAGECOUNT value on done: 601713.0 [2024-08-06 05:03:30,277][52658] Sum rewards: 67.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.513', 'AMMO5': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.164', 'weapon4': '0.206', 'weapon5': '0.266', 'AMMO4': '0.318', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.620', 'WEAPON3': '1.000', 'weapon3': '2.612', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:30,353][52803] DAMAGECOUNT value on done: 553419.0 [2024-08-06 05:03:30,354][52803] Sum rewards: 74.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.155', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'AMMO3': '0.134', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.354', 'WEAPON3': '0.800', 'weapon3': '3.088', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:30,679][52649] DAMAGECOUNT value on done: 578965.0 [2024-08-06 05:03:30,681][52649] Sum rewards: 74.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.744', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.084', 'AMMO3': '0.211', 'weapon4': '0.234', 'weapon2': '0.244', 'AMMO4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:30,724][52662] DAMAGECOUNT value on done: 591288.0 [2024-08-06 05:03:30,725][52662] Sum rewards: 74.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.684', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO4': '0.184', 'weapon5': '0.224', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:30,846][52811] DAMAGECOUNT value on done: 548160.0 [2024-08-06 05:03:30,848][52811] Sum rewards: 59.422, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.479', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.086', 'weapon5': '0.210', 'AMMO4': '0.286', 'AMMO3': '0.296', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.948', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '53.000'} [2024-08-06 05:03:32,226][52795] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.027, -9.0), ('weapon5', 0.002)] [2024-08-06 05:03:32,285][52671] DAMAGECOUNT value on done: 592394.0 [2024-08-06 05:03:32,288][52671] Sum rewards: 68.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.604', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.178', 'weapon2': '0.194', 'AMMO3': '0.208', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:32,295][52669] DAMAGECOUNT value on done: 609043.0 [2024-08-06 05:03:32,296][52669] Sum rewards: 76.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.741', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.082', 'AMMO3': '0.221', 'weapon2': '0.248', 'WEAPON3': '1.350', 'weapon3': '3.418', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:32,495][52665] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:03:32,541][52668] DAMAGECOUNT value on done: 596029.0 [2024-08-06 05:03:32,541][52668] Sum rewards: 82.376, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.174', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.566', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.448', 'FRAGCOUNT': '69.000'} [2024-08-06 05:03:32,606][52650] Updated weights for policy 0, policy_version 58221 (0.0031) [2024-08-06 05:03:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17495.8). Total num frames: 476946432. Throughput: 0: 4376.2. Samples: 119235450. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 05:03:32,794][52567] Avg episode reward: [(0, '72.003')] [2024-08-06 05:03:33,354][52658] DAMAGECOUNT value on done: 586874.0 [2024-08-06 05:03:33,358][52658] Sum rewards: 77.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.392', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.136', 'AMMO3': '0.213', 'weapon2': '0.246', 'weapon5': '0.250', 'AMMO4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:33,468][52803] DAMAGECOUNT value on done: 557559.0 [2024-08-06 05:03:33,470][52803] Sum rewards: 80.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.621', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:33,736][52662] DAMAGECOUNT value on done: 596792.0 [2024-08-06 05:03:33,736][52662] Sum rewards: 73.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.164', 'weapon5': '0.204', 'AMMO3': '0.237', 'AMMO4': '0.246', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:33,867][52649] DAMAGECOUNT value on done: 579456.0 [2024-08-06 05:03:33,868][52649] Sum rewards: 74.401, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.243', 'AMMO5': '0.026', 'AMMO2': '0.060', 'AMMO3': '0.132', 'weapon5': '0.262', 'AMMO4': '0.298', 'weapon2': '0.374', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon3': '2.662', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:33,917][52811] DAMAGECOUNT value on done: 542916.0 [2024-08-06 05:03:33,918][52811] Sum rewards: 66.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.231', 'AMMO5': '0.033', 'AMMO2': '0.058', 'weapon4': '0.194', 'AMMO3': '0.215', 'AMMO4': '0.290', 'weapon5': '0.308', 'weapon2': '0.374', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '56.500'} [2024-08-06 05:03:34,443][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:03:34,917][52671] DAMAGECOUNT value on done: 579259.0 [2024-08-06 05:03:34,917][52671] Sum rewards: 72.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon4': '0.082', 'weapon5': '0.130', 'AMMO4': '0.163', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:34,939][52668] DAMAGECOUNT value on done: 592194.0 [2024-08-06 05:03:34,941][52668] Sum rewards: 75.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.162', 'AMMO4': '0.177', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.030', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 05:03:35,493][52669] DAMAGECOUNT value on done: 597640.0 [2024-08-06 05:03:35,494][52669] Sum rewards: 72.636, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.868', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.192', 'weapon5': '0.222', 'weapon4': '0.230', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:36,448][52658] DAMAGECOUNT value on done: 594614.0 [2024-08-06 05:03:36,449][52658] Sum rewards: 82.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.229', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.482', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '67.000'} [2024-08-06 05:03:36,568][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:03:36,658][52803] DAMAGECOUNT value on done: 550134.0 [2024-08-06 05:03:36,660][52803] Sum rewards: 74.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.139', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.342', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.500'} [2024-08-06 05:03:36,723][52662] DAMAGECOUNT value on done: 583677.0 [2024-08-06 05:03:36,723][52662] Sum rewards: 80.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.869', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.180', 'weapon4': '0.240', 'weapon5': '0.240', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:36,928][52811] DAMAGECOUNT value on done: 551426.0 [2024-08-06 05:03:36,928][52811] Sum rewards: 70.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.760', 'AMMO5': '0.006', 'AMMO2': '0.057', 'weapon5': '0.080', 'weapon4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'AMMO4': '0.285', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.268', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:37,102][52649] DAMAGECOUNT value on done: 573281.0 [2024-08-06 05:03:37,104][52649] Sum rewards: 77.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.916', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.084', 'weapon5': '0.176', 'AMMO4': '0.178', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:37,309][52671] DAMAGECOUNT value on done: 600847.0 [2024-08-06 05:03:37,318][52671] Sum rewards: 71.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.360', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.106', 'AMMO3': '0.173', 'weapon5': '0.244', 'AMMO4': '0.254', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:37,516][52650] Updated weights for policy 0, policy_version 58231 (0.0026) [2024-08-06 05:03:37,741][52668] DAMAGECOUNT value on done: 583282.0 [2024-08-06 05:03:37,743][52668] Sum rewards: 76.525, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.133', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 05:03:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 477036544. Throughput: 0: 4380.9. Samples: 119261800. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 05:03:37,794][52567] Avg episode reward: [(0, '72.767')] [2024-08-06 05:03:38,526][52669] DAMAGECOUNT value on done: 596382.0 [2024-08-06 05:03:38,526][52669] Sum rewards: 82.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.296', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.119', 'weapon4': '0.132', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.700', 'weapon3': '3.360', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '69.000'} [2024-08-06 05:03:39,433][52658] DAMAGECOUNT value on done: 584953.0 [2024-08-06 05:03:39,433][52658] Sum rewards: 67.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.217', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.090', 'AMMO4': '0.155', 'weapon5': '0.168', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.906', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:39,720][52803] DAMAGECOUNT value on done: 544350.0 [2024-08-06 05:03:39,720][52803] Sum rewards: 74.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.512', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:39,853][52662] DAMAGECOUNT value on done: 598718.0 [2024-08-06 05:03:39,854][52662] Sum rewards: 88.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.906', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '73.000'} [2024-08-06 05:03:40,029][52811] DAMAGECOUNT value on done: 550756.0 [2024-08-06 05:03:40,031][52811] Sum rewards: 92.264, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.379', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.145', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.248', 'weapon4': '0.264', 'WEAPON3': '1.000', 'weapon3': '3.146', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '72.000'} [2024-08-06 05:03:40,133][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:03:40,372][52668] DAMAGECOUNT value on done: 585087.0 [2024-08-06 05:03:40,373][52668] Sum rewards: 74.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon2': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:40,378][52671] DAMAGECOUNT value on done: 596498.0 [2024-08-06 05:03:40,378][52671] Sum rewards: 70.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.184', 'weapon5': '0.214', 'AMMO4': '0.269', 'weapon4': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.630', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '58.500'} [2024-08-06 05:03:41,515][52669] DAMAGECOUNT value on done: 594186.0 [2024-08-06 05:03:41,517][52669] Sum rewards: 45.238, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.271', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.138', 'AMMO3': '0.149', 'WEAPON7': '0.200', 'weapon2': '0.296', 'weapon4': '0.706', 'WEAPON3': '0.900', 'HITCOUNT': '2.120', 'weapon3': '2.598', 'DAMAGECOUNT': '9.990', 'FRAGCOUNT': '38.000'} [2024-08-06 05:03:42,212][52650] Updated weights for policy 0, policy_version 58241 (0.0013) [2024-08-06 05:03:42,375][52658] DAMAGECOUNT value on done: 591961.0 [2024-08-06 05:03:42,376][52658] Sum rewards: 73.474, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.522', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.122', 'weapon4': '0.142', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:42,753][52803] DAMAGECOUNT value on done: 544942.0 [2024-08-06 05:03:42,755][52803] Sum rewards: 72.135, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.014', 'HEALTH': '0.020', 'weapon4': '0.034', 'AMMO4': '0.069', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.304', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:42,804][52567] Fps is (10 sec: 17186.4, 60 sec: 17609.9, 300 sec: 17522.0). Total num frames: 477118464. Throughput: 0: 4370.8. Samples: 119287680. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 05:03:42,804][52567] Avg episode reward: [(0, '72.884')] [2024-08-06 05:03:42,851][52662] DAMAGECOUNT value on done: 585513.0 [2024-08-06 05:03:42,851][52662] Sum rewards: 79.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.596', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.182', 'weapon4': '0.198', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '2.890', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '66.000'} [2024-08-06 05:03:43,063][52668] DAMAGECOUNT value on done: 594007.0 [2024-08-06 05:03:43,067][52668] Sum rewards: 81.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.550', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.142', 'AMMO3': '0.195', 'AMMO4': '0.204', 'weapon5': '0.224', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '66.500'} [2024-08-06 05:03:43,139][52811] DAMAGECOUNT value on done: 551702.0 [2024-08-06 05:03:43,140][52811] Sum rewards: 67.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.186', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.130', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.284', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '55.000'} [2024-08-06 05:03:43,277][52671] DAMAGECOUNT value on done: 595864.0 [2024-08-06 05:03:43,277][52671] Sum rewards: 88.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.354', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.130', 'weapon2': '0.210', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.963', 'FRAGCOUNT': '72.000'} [2024-08-06 05:03:43,493][52811] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:03:44,394][52669] DAMAGECOUNT value on done: 601536.0 [2024-08-06 05:03:44,394][52669] Sum rewards: 74.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.857', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.194', 'weapon4': '0.212', 'AMMO3': '0.219', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:45,168][52658] DAMAGECOUNT value on done: 580417.0 [2024-08-06 05:03:45,170][52658] Sum rewards: 69.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO2': '0.001', 'AMMO4': '0.006', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.210', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:45,295][52662] DAMAGECOUNT value on done: 597197.0 [2024-08-06 05:03:45,297][52662] Sum rewards: 68.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.454', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO3': '0.168', 'AMMO4': '0.189', 'weapon4': '0.336', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:45,882][52803] DAMAGECOUNT value on done: 541246.0 [2024-08-06 05:03:45,882][52803] Sum rewards: 71.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.614', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:46,090][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:03:46,093][52668] DAMAGECOUNT value on done: 591387.0 [2024-08-06 05:03:46,093][52668] Sum rewards: 86.857, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'HEALTH': '0.240', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '3.338', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '68.000'} [2024-08-06 05:03:46,121][52671] DAMAGECOUNT value on done: 595315.0 [2024-08-06 05:03:46,122][52671] Sum rewards: 84.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.558', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.068', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.484', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.463', 'FRAGCOUNT': '72.500'} [2024-08-06 05:03:46,169][52811] DAMAGECOUNT value on done: 555454.0 [2024-08-06 05:03:46,170][52811] Sum rewards: 60.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.960', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.156', 'AMMO3': '0.196', 'AMMO4': '0.198', 'weapon4': '0.242', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.010', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '50.000'} [2024-08-06 05:03:46,656][52660] DAMAGECOUNT value on done: 590342.0 [2024-08-06 05:03:46,657][52660] Sum rewards: 74.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.086', 'AMMO4': '0.189', 'AMMO3': '0.224', 'weapon5': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:46,931][52650] Updated weights for policy 0, policy_version 58251 (0.0011) [2024-08-06 05:03:47,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 477200384. Throughput: 0: 4372.4. Samples: 119300980. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 05:03:47,794][52567] Avg episode reward: [(0, '73.346')] [2024-08-06 05:03:48,149][52658] DAMAGECOUNT value on done: 595721.0 [2024-08-06 05:03:48,149][52658] Sum rewards: 67.638, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.105', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.086', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '55.000'} [2024-08-06 05:03:48,483][52662] DAMAGECOUNT value on done: 598970.0 [2024-08-06 05:03:48,485][52662] Sum rewards: 71.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.025', 'AMMO2': '0.048', 'weapon4': '0.124', 'AMMO3': '0.166', 'AMMO4': '0.238', 'weapon5': '0.326', 'WEAPON4': '0.500', 'weapon2': '0.556', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.654', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:49,018][52803] DAMAGECOUNT value on done: 547871.0 [2024-08-06 05:03:49,021][52803] Sum rewards: 69.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.155', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.225', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.504', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '58.000'} [2024-08-06 05:03:49,035][52671] DAMAGECOUNT value on done: 591994.0 [2024-08-06 05:03:49,035][52671] Sum rewards: 81.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.075', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.070', 'AMMO4': '0.149', 'weapon4': '0.150', 'weapon2': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.432', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '69.000'} [2024-08-06 05:03:49,165][52668] DAMAGECOUNT value on done: 582155.0 [2024-08-06 05:03:49,166][52668] Sum rewards: 66.462, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.280', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'AMMO4': '0.031', 'weapon4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.280', 'AMMO3': '0.309', 'WEAPON3': '1.800', 'weapon3': '3.346', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:49,303][52811] DAMAGECOUNT value on done: 548883.0 [2024-08-06 05:03:49,304][52811] Sum rewards: 81.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.285', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.134', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.288', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '65.000'} [2024-08-06 05:03:49,796][52660] DAMAGECOUNT value on done: 581444.0 [2024-08-06 05:03:49,799][52660] Sum rewards: 64.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.825', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.116', 'AMMO3': '0.165', 'weapon2': '0.220', 'weapon5': '0.230', 'AMMO4': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.140', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.000'} [2024-08-06 05:03:51,187][52658] DAMAGECOUNT value on done: 587789.0 [2024-08-06 05:03:51,188][52658] Sum rewards: 77.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.355', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO4': '0.031', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.255', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.420', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '65.000'} [2024-08-06 05:03:51,359][52662] DAMAGECOUNT value on done: 588741.0 [2024-08-06 05:03:51,359][52662] Sum rewards: 67.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.108', 'AMMO3': '0.214', 'AMMO4': '0.255', 'weapon4': '0.274', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:51,548][52650] Updated weights for policy 0, policy_version 58261 (0.0026) [2024-08-06 05:03:52,065][52803] DAMAGECOUNT value on done: 542380.0 [2024-08-06 05:03:52,065][52803] Sum rewards: 77.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.636', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO3': '0.179', 'AMMO4': '0.187', 'weapon5': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.084', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '63.000'} [2024-08-06 05:03:52,258][52668] DAMAGECOUNT value on done: 575876.0 [2024-08-06 05:03:52,262][52668] Sum rewards: 74.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.455', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.112', 'AMMO4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '61.000'} [2024-08-06 05:03:52,423][52811] DAMAGECOUNT value on done: 548550.0 [2024-08-06 05:03:52,428][52811] Sum rewards: 74.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.976', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.302', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:52,794][52567] Fps is (10 sec: 17220.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 477290496. Throughput: 0: 4364.9. Samples: 119327020. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 05:03:52,794][52567] Avg episode reward: [(0, '73.609')] [2024-08-06 05:03:52,982][52660] DAMAGECOUNT value on done: 592854.0 [2024-08-06 05:03:52,983][52660] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.276', 'AMMO5': '0.025', 'AMMO2': '0.051', 'weapon4': '0.168', 'AMMO3': '0.240', 'weapon5': '0.242', 'AMMO4': '0.257', 'weapon2': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 05:03:53,951][52662] DAMAGECOUNT value on done: 599090.0 [2024-08-06 05:03:53,952][52662] Sum rewards: 75.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.845', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.153', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.096', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '62.000'} [2024-08-06 05:03:54,117][52658] DAMAGECOUNT value on done: 586780.0 [2024-08-06 05:03:54,118][52658] Sum rewards: 73.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.184', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon4': '0.124', 'weapon5': '0.156', 'weapon2': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:55,117][52668] DAMAGECOUNT value on done: 578134.0 [2024-08-06 05:03:55,121][52668] Sum rewards: 70.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.104', 'AMMO4': '0.160', 'weapon4': '0.166', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '57.000'} [2024-08-06 05:03:55,182][52803] DAMAGECOUNT value on done: 561398.0 [2024-08-06 05:03:55,184][52803] Sum rewards: 74.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.625', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.090', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '60.000'} [2024-08-06 05:03:55,809][52660] DAMAGECOUNT value on done: 597777.0 [2024-08-06 05:03:55,811][52660] Sum rewards: 63.596, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon2': '0.180', 'AMMO3': '0.192', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.720', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '52.000'} [2024-08-06 05:03:56,166][52650] Updated weights for policy 0, policy_version 58271 (0.0014) [2024-08-06 05:03:56,757][52658] DAMAGECOUNT value on done: 591979.0 [2024-08-06 05:03:56,757][52658] Sum rewards: 61.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.354', 'AMMO5': '0.018', 'AMMO2': '0.062', 'AMMO3': '0.206', 'weapon5': '0.258', 'weapon2': '0.284', 'AMMO4': '0.312', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '49.000'} [2024-08-06 05:03:56,963][52662] DAMAGECOUNT value on done: 586896.0 [2024-08-06 05:03:56,963][52662] Sum rewards: 80.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.234', 'WEAPON3': '1.300', 'weapon3': '3.442', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 05:03:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 477380608. Throughput: 0: 4369.3. Samples: 119353330. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 05:03:57,794][52567] Avg episode reward: [(0, '73.559')] [2024-08-06 05:03:57,871][52668] DAMAGECOUNT value on done: 579762.0 [2024-08-06 05:03:57,872][52668] Sum rewards: 61.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.080', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.510', 'WEAPON3': '1.550', 'HITCOUNT': '2.970', 'weapon3': '3.126', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '53.000'} [2024-08-06 05:03:58,261][52803] DAMAGECOUNT value on done: 547969.0 [2024-08-06 05:03:58,261][52803] Sum rewards: 68.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.087', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.476', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.262', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2024-08-06 05:03:58,497][52660] DAMAGECOUNT value on done: 587314.0 [2024-08-06 05:03:58,497][52660] Sum rewards: 69.075, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.518', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.086', 'weapon5': '0.202', 'AMMO4': '0.251', 'AMMO3': '0.290', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.068', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:00,336][52662] DAMAGECOUNT value on done: 591049.0 [2024-08-06 05:04:00,336][52662] Sum rewards: 74.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.163', 'AMMO4': '0.203', 'weapon5': '0.230', 'weapon4': '0.438', 'weapon2': '0.480', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.554', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:00,482][52668] DAMAGECOUNT value on done: 586815.0 [2024-08-06 05:04:00,483][52668] Sum rewards: 70.015, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.268', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.156', 'AMMO4': '0.219', 'weapon2': '0.230', 'AMMO3': '0.256', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.040', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:00,831][52650] Updated weights for policy 0, policy_version 58281 (0.0031) [2024-08-06 05:04:01,045][52660] DAMAGECOUNT value on done: 585856.0 [2024-08-06 05:04:01,047][52660] Sum rewards: 72.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.184', 'AMMO3': '0.221', 'weapon2': '0.272', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.964', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:01,459][52803] DAMAGECOUNT value on done: 546897.0 [2024-08-06 05:04:01,459][52803] Sum rewards: 79.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.593', 'AMMO5': '0.005', 'AMMO2': '0.041', 'WEAPON5': '0.100', 'weapon5': '0.104', 'weapon4': '0.126', 'AMMO4': '0.205', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.754', 'FRAGCOUNT': '66.000'} [2024-08-06 05:04:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 477470720. Throughput: 0: 4367.8. Samples: 119366410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:04:02,794][52567] Avg episode reward: [(0, '73.493')] [2024-08-06 05:04:03,036][52668] DAMAGECOUNT value on done: 589823.0 [2024-08-06 05:04:03,039][52668] Sum rewards: 59.505, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.660', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.138', 'AMMO3': '0.177', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.288', 'DAMAGECOUNT': '13.893', 'FRAGCOUNT': '48.000'} [2024-08-06 05:04:03,488][52662] DAMAGECOUNT value on done: 586403.0 [2024-08-06 05:04:03,489][52662] Sum rewards: 67.471, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.687', 'AMMO5': '0.021', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO3': '0.147', 'AMMO4': '0.147', 'weapon5': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.158', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '55.000'} [2024-08-06 05:04:03,742][52660] DAMAGECOUNT value on done: 584703.0 [2024-08-06 05:04:03,742][52660] Sum rewards: 83.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.332', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.148', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.382', 'ARMOR': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '68.000'} [2024-08-06 05:04:04,607][52803] DAMAGECOUNT value on done: 560673.0 [2024-08-06 05:04:04,609][52803] Sum rewards: 65.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.153', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO4': '0.175', 'weapon5': '0.210', 'AMMO3': '0.226', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.172', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '55.000'} [2024-08-06 05:04:05,542][52650] Updated weights for policy 0, policy_version 58291 (0.0026) [2024-08-06 05:04:05,997][52662] DAMAGECOUNT value on done: 595846.0 [2024-08-06 05:04:05,997][52662] Sum rewards: 75.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.189', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.152', 'AMMO3': '0.174', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.100', 'weapon3': '2.742', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:06,058][52668] DAMAGECOUNT value on done: 588355.0 [2024-08-06 05:04:06,059][52668] Sum rewards: 55.555, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.880', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.150', 'AMMO4': '0.243', 'weapon2': '0.272', 'AMMO3': '0.281', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.590', 'weapon3': '3.186', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '52.000'} [2024-08-06 05:04:06,676][52660] DAMAGECOUNT value on done: 594297.0 [2024-08-06 05:04:06,677][52660] Sum rewards: 79.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.704', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.410', 'WEAPON3': '1.700', 'weapon3': '3.194', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '67.000'} [2024-08-06 05:04:07,646][52803] DAMAGECOUNT value on done: 548999.0 [2024-08-06 05:04:07,648][52803] Sum rewards: 62.806, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.110', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.198', 'weapon5': '0.210', 'weapon2': '0.240', 'AMMO3': '0.313', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '3.070', 'weapon3': '3.180', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '56.000'} [2024-08-06 05:04:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 477552640. Throughput: 0: 4368.0. Samples: 119392710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:04:07,794][52567] Avg episode reward: [(0, '73.095')] [2024-08-06 05:04:08,909][52662] DAMAGECOUNT value on done: 588338.0 [2024-08-06 05:04:08,910][52662] Sum rewards: 71.955, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.075', 'AMMO5': '0.008', 'AMMO2': '0.023', 'WEAPON1': '0.030', 'AMMO4': '0.116', 'weapon4': '0.118', 'weapon5': '0.166', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '58.000'} [2024-08-06 05:04:08,917][52668] DAMAGECOUNT value on done: 593605.0 [2024-08-06 05:04:08,919][52668] Sum rewards: 78.076, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.760', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.125', 'AMMO4': '0.193', 'weapon5': '0.232', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '0.900', 'weapon3': '2.778', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:09,621][52660] DAMAGECOUNT value on done: 585780.0 [2024-08-06 05:04:09,621][52660] Sum rewards: 65.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.506', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.174', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '56.000'} [2024-08-06 05:04:10,227][52650] Updated weights for policy 0, policy_version 58301 (0.0025) [2024-08-06 05:04:10,707][52803] DAMAGECOUNT value on done: 547517.0 [2024-08-06 05:04:10,712][52803] Sum rewards: 72.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.078', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '3.140', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '61.000'} [2024-08-06 05:04:11,529][52668] DAMAGECOUNT value on done: 591946.0 [2024-08-06 05:04:11,530][52668] Sum rewards: 74.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.625', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO3': '0.210', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '62.000'} [2024-08-06 05:04:11,862][52662] DAMAGECOUNT value on done: 601799.0 [2024-08-06 05:04:11,864][52662] Sum rewards: 79.008, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.117', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.350', 'weapon2': '0.518', 'WEAPON3': '0.850', 'weapon3': '2.662', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '61.000'} [2024-08-06 05:04:12,159][52660] DAMAGECOUNT value on done: 588296.0 [2024-08-06 05:04:12,162][52660] Sum rewards: 65.258, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.958', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '55.000'} [2024-08-06 05:04:12,537][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 05:04:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 477642752. Throughput: 0: 4364.9. Samples: 119418920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:04:12,802][52567] Avg episode reward: [(0, '72.643')] [2024-08-06 05:04:13,104][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:13,604][52647] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2024-08-06 05:04:13,795][52803] DAMAGECOUNT value on done: 551328.0 [2024-08-06 05:04:13,796][52803] Sum rewards: 71.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.926', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.036', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.284', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.370', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:14,827][52660] DAMAGECOUNT value on done: 595077.0 [2024-08-06 05:04:14,827][52660] Sum rewards: 77.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.270', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.169', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '3.290', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '61.000'} [2024-08-06 05:04:14,928][52650] Updated weights for policy 0, policy_version 58311 (0.0017) [2024-08-06 05:04:14,973][52662] DAMAGECOUNT value on done: 593419.0 [2024-08-06 05:04:14,974][52662] Sum rewards: 79.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.868', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '65.000'} [2024-08-06 05:04:15,938][52665] DAMAGECOUNT value on done: 578489.0 [2024-08-06 05:04:15,939][52665] Sum rewards: 87.570, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.215', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.160', 'AMMO3': '0.191', 'AMMO4': '0.204', 'weapon2': '0.204', 'weapon4': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.507', 'FRAGCOUNT': '70.000'} [2024-08-06 05:04:16,930][52803] DAMAGECOUNT value on done: 553776.0 [2024-08-06 05:04:16,930][52803] Sum rewards: 84.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.033', 'FRAGCOUNT': '69.000'} [2024-08-06 05:04:17,287][52660] DAMAGECOUNT value on done: 584709.0 [2024-08-06 05:04:17,288][52660] Sum rewards: 82.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.064', 'weapon4': '0.066', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '68.000'} [2024-08-06 05:04:17,500][52662] DAMAGECOUNT value on done: 584834.0 [2024-08-06 05:04:17,503][52662] Sum rewards: 70.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.164', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.116', 'weapon5': '0.122', 'AMMO3': '0.190', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '58.000'} [2024-08-06 05:04:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 477724672. Throughput: 0: 4371.8. Samples: 119432180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:04:17,802][52567] Avg episode reward: [(0, '73.324')] [2024-08-06 05:04:19,142][52665] DAMAGECOUNT value on done: 594782.0 [2024-08-06 05:04:19,145][52665] Sum rewards: 64.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.907', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.354', 'weapon4': '0.392', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '52.000'} [2024-08-06 05:04:19,553][52650] Updated weights for policy 0, policy_version 58321 (0.0010) [2024-08-06 05:04:20,001][52803] DAMAGECOUNT value on done: 557642.0 [2024-08-06 05:04:20,001][52803] Sum rewards: 62.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.044', 'weapon4': '0.052', 'AMMO4': '0.116', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.228', 'WEAPON3': '1.150', 'HITCOUNT': '3.410', 'weapon3': '3.452', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '51.500'} [2024-08-06 05:04:20,002][52660] DAMAGECOUNT value on done: 587128.0 [2024-08-06 05:04:20,002][52660] Sum rewards: 77.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.051', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.208', 'AMMO3': '0.244', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.474', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '65.000'} [2024-08-06 05:04:20,302][52662] DAMAGECOUNT value on done: 590221.0 [2024-08-06 05:04:20,304][52662] Sum rewards: 71.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.978', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.137', 'AMMO3': '0.186', 'weapon4': '0.256', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon5': '0.360', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '58.000'} [2024-08-06 05:04:20,910][52659] DAMAGECOUNT value on done: 597262.0 [2024-08-06 05:04:20,913][52659] Sum rewards: 71.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.062', 'AMMO4': '0.069', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:21,828][52665] DAMAGECOUNT value on done: 589703.0 [2024-08-06 05:04:21,830][52665] Sum rewards: 76.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.622', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.099', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.242', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '63.000'} [2024-08-06 05:04:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 477822976. Throughput: 0: 4371.1. Samples: 119458500. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:04:22,794][52567] Avg episode reward: [(0, '73.237')] [2024-08-06 05:04:22,846][52660] DAMAGECOUNT value on done: 597688.0 [2024-08-06 05:04:22,847][52660] Sum rewards: 70.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.282', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.127', 'weapon5': '0.188', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '57.000'} [2024-08-06 05:04:23,054][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:23,142][52803] DAMAGECOUNT value on done: 546407.0 [2024-08-06 05:04:23,142][52803] Sum rewards: 73.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.868', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.126', 'AMMO4': '0.162', 'weapon5': '0.172', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:23,184][52662] DAMAGECOUNT value on done: 583887.0 [2024-08-06 05:04:23,184][52662] Sum rewards: 70.996, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.134', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.150', 'weapon5': '0.154', 'AMMO4': '0.219', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.630', 'WEAPON3': '0.800', 'weapon3': '2.582', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '56.000'} [2024-08-06 05:04:23,509][52659] DAMAGECOUNT value on done: 588849.0 [2024-08-06 05:04:23,510][52659] Sum rewards: 73.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.580', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.110', 'weapon5': '0.122', 'AMMO4': '0.163', 'weapon2': '0.182', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '62.000'} [2024-08-06 05:04:24,169][52650] Updated weights for policy 0, policy_version 58331 (0.0010) [2024-08-06 05:04:24,691][52665] DAMAGECOUNT value on done: 582956.0 [2024-08-06 05:04:24,691][52665] Sum rewards: 69.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.056', 'AMMO3': '0.164', 'weapon5': '0.184', 'AMMO4': '0.282', 'weapon4': '0.284', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '55.000'} [2024-08-06 05:04:25,635][52660] DAMAGECOUNT value on done: 603354.0 [2024-08-06 05:04:25,637][52660] Sum rewards: 73.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.865', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.014', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.320', 'WEAPON3': '1.600', 'weapon3': '3.346', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '63.000'} [2024-08-06 05:04:26,666][52659] DAMAGECOUNT value on done: 596114.0 [2024-08-06 05:04:26,666][52659] Sum rewards: 70.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.482', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.328', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '56.000'} [2024-08-06 05:04:27,156][52647] DAMAGECOUNT value on done: 625173.0 [2024-08-06 05:04:27,158][52647] Sum rewards: 77.423, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.844', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.074', 'weapon5': '0.192', 'AMMO4': '0.217', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.996', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '64.500'} [2024-08-06 05:04:27,460][52665] DAMAGECOUNT value on done: 572984.0 [2024-08-06 05:04:27,460][52665] Sum rewards: 68.622, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.446', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.048', 'weapon4': '0.106', 'AMMO4': '0.131', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '0.800', 'weapon3': '3.164', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '53.000'} [2024-08-06 05:04:27,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 477913088. Throughput: 0: 4383.0. Samples: 119484870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:04:27,794][52567] Avg episode reward: [(0, '73.174')] [2024-08-06 05:04:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058339_477913088.pth... [2024-08-06 05:04:27,942][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000057826_473710592.pth [2024-08-06 05:04:28,616][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:28,859][52660] DAMAGECOUNT value on done: 585657.0 [2024-08-06 05:04:28,860][52660] Sum rewards: 79.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.600', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.207', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '65.000'} [2024-08-06 05:04:28,956][52650] Updated weights for policy 0, policy_version 58341 (0.0016) [2024-08-06 05:04:29,636][52659] DAMAGECOUNT value on done: 591243.0 [2024-08-06 05:04:29,638][52659] Sum rewards: 66.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.106', 'AMMO5': '0.013', 'AMMO2': '0.052', 'AMMO3': '0.201', 'weapon5': '0.208', 'weapon4': '0.214', 'AMMO4': '0.258', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '56.000'} [2024-08-06 05:04:30,262][52665] DAMAGECOUNT value on done: 579932.0 [2024-08-06 05:04:30,262][52665] Sum rewards: 71.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.081', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:30,265][52647] DAMAGECOUNT value on done: 618941.0 [2024-08-06 05:04:30,265][52647] Sum rewards: 72.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.285', 'AMMO5': '0.012', 'weapon5': '0.038', 'AMMO2': '0.041', 'weapon4': '0.106', 'AMMO3': '0.200', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:31,358][52660] DAMAGECOUNT value on done: 593645.0 [2024-08-06 05:04:31,359][52660] Sum rewards: 69.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.076', 'weapon5': '0.192', 'AMMO3': '0.263', 'AMMO4': '0.266', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:32,566][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:32,651][52647] DAMAGECOUNT value on done: 623216.0 [2024-08-06 05:04:32,651][52647] Sum rewards: 66.672, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.640', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.142', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '57.000'} [2024-08-06 05:04:32,705][52659] DAMAGECOUNT value on done: 586800.0 [2024-08-06 05:04:32,706][52659] Sum rewards: 71.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.222', 'WEAPON3': '1.400', 'HITCOUNT': '3.400', 'weapon3': '3.524', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 477986816. Throughput: 0: 4368.4. Samples: 119497560. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:04:32,794][52567] Avg episode reward: [(0, '72.986')] [2024-08-06 05:04:33,336][52665] DAMAGECOUNT value on done: 585707.0 [2024-08-06 05:04:33,336][52665] Sum rewards: 75.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.134', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.066', 'weapon5': '0.088', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '62.000'} [2024-08-06 05:04:33,650][52650] Updated weights for policy 0, policy_version 58351 (0.0013) [2024-08-06 05:04:33,793][52660] DAMAGECOUNT value on done: 588363.0 [2024-08-06 05:04:33,793][52660] Sum rewards: 76.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.000'} [2024-08-06 05:04:35,140][52647] DAMAGECOUNT value on done: 628155.0 [2024-08-06 05:04:35,141][52647] Sum rewards: 61.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.738', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.132', 'weapon4': '0.170', 'AMMO3': '0.181', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.174', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '51.000'} [2024-08-06 05:04:35,372][52659] DAMAGECOUNT value on done: 593264.0 [2024-08-06 05:04:35,372][52659] Sum rewards: 86.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.490', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.122', 'AMMO4': '0.192', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.465', 'FRAGCOUNT': '73.000'} [2024-08-06 05:04:36,541][52660] DAMAGECOUNT value on done: 586353.0 [2024-08-06 05:04:36,543][52660] Sum rewards: 73.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.492', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '63.000'} [2024-08-06 05:04:36,620][52665] DAMAGECOUNT value on done: 582884.0 [2024-08-06 05:04:36,622][52665] Sum rewards: 67.082, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.806', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.082', 'weapon4': '0.104', 'AMMO4': '0.192', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.266', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '55.000'} [2024-08-06 05:04:37,470][52794] DAMAGECOUNT value on done: 593684.0 [2024-08-06 05:04:37,470][52794] Sum rewards: 62.770, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO3': '0.128', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.644', 'WEAPON3': '0.850', 'weapon3': '2.802', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '48.000'} [2024-08-06 05:04:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 478085120. Throughput: 0: 4377.1. Samples: 119523990. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:04:37,795][52567] Avg episode reward: [(0, '72.701')] [2024-08-06 05:04:37,940][52647] DAMAGECOUNT value on done: 633546.0 [2024-08-06 05:04:37,940][52647] Sum rewards: 92.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.834', 'FRAGCOUNT': '74.500'} [2024-08-06 05:04:38,589][52659] DAMAGECOUNT value on done: 590057.0 [2024-08-06 05:04:38,589][52659] Sum rewards: 62.836, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon5': '0.194', 'weapon4': '0.204', 'AMMO4': '0.259', 'AMMO3': '0.269', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.918', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '55.000'} [2024-08-06 05:04:38,803][52650] Updated weights for policy 0, policy_version 58361 (0.0018) [2024-08-06 05:04:39,746][52660] DAMAGECOUNT value on done: 580658.0 [2024-08-06 05:04:39,747][52660] Sum rewards: 80.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.225', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.148', 'weapon2': '0.184', 'weapon4': '0.242', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '67.000'} [2024-08-06 05:04:39,789][52665] DAMAGECOUNT value on done: 590983.0 [2024-08-06 05:04:39,790][52665] Sum rewards: 78.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.212', 'weapon5': '0.212', 'weapon2': '0.310', 'weapon4': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '64.000'} [2024-08-06 05:04:40,012][52794] DAMAGECOUNT value on done: 598957.0 [2024-08-06 05:04:40,014][52794] Sum rewards: 74.159, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.975', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.088', 'weapon2': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.215', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.206', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:41,254][52647] DAMAGECOUNT value on done: 630248.0 [2024-08-06 05:04:41,254][52647] Sum rewards: 72.461, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.335', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.122', 'AMMO3': '0.176', 'AMMO4': '0.256', 'weapon5': '0.266', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '56.000'} [2024-08-06 05:04:41,690][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:41,914][52659] DAMAGECOUNT value on done: 588326.0 [2024-08-06 05:04:41,915][52659] Sum rewards: 75.939, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.119', 'weapon4': '0.132', 'weapon5': '0.140', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '0.900', 'weapon3': '2.898', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:42,130][52665] DAMAGECOUNT value on done: 583122.0 [2024-08-06 05:04:42,130][52665] Sum rewards: 69.664, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.321', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.102', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.258', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '58.000'} [2024-08-06 05:04:42,749][52650] Updated weights for policy 0, policy_version 58371 (0.0015) [2024-08-06 05:04:42,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17615.6, 300 sec: 17522.5). Total num frames: 478175232. Throughput: 0: 4368.2. Samples: 119549900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:04:42,795][52567] Avg episode reward: [(0, '72.821')] [2024-08-06 05:04:42,906][52794] DAMAGECOUNT value on done: 596915.0 [2024-08-06 05:04:42,906][52794] Sum rewards: 72.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.426', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO3': '0.171', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.358', 'weapon4': '0.368', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:44,465][52647] DAMAGECOUNT value on done: 624693.0 [2024-08-06 05:04:44,466][52647] Sum rewards: 66.002, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.962', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '57.000'} [2024-08-06 05:04:44,775][52665] DAMAGECOUNT value on done: 594501.0 [2024-08-06 05:04:44,775][52665] Sum rewards: 79.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.110', 'weapon5': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.260', 'WEAPON3': '1.200', 'weapon3': '3.310', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '63.000'} [2024-08-06 05:04:44,959][52659] DAMAGECOUNT value on done: 594279.0 [2024-08-06 05:04:44,960][52659] Sum rewards: 71.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.248', 'AMMO3': '0.249', 'AMMO4': '0.262', 'weapon4': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.714', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:45,766][52794] DAMAGECOUNT value on done: 587657.0 [2024-08-06 05:04:45,768][52794] Sum rewards: 66.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.300', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.218', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '58.000'} [2024-08-06 05:04:46,424][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:47,460][52647] DAMAGECOUNT value on done: 611782.0 [2024-08-06 05:04:47,464][52647] Sum rewards: 29.530, reward structure: {'DEATHCOUNT': '-5.250', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.076', 'weapon7': '0.088', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.238', 'HEALTH': '0.362', 'WEAPON3': '0.400', 'weapon3': '0.854', 'HITCOUNT': '1.210', 'weapon4': '1.992', 'DAMAGECOUNT': '6.555', 'FRAGCOUNT': '22.000'} [2024-08-06 05:04:47,678][52650] Updated weights for policy 0, policy_version 58381 (0.0014) [2024-08-06 05:04:47,783][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 478257152. Throughput: 0: 4366.7. Samples: 119562910. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:04:47,794][52567] Avg episode reward: [(0, '72.044')] [2024-08-06 05:04:48,000][52659] DAMAGECOUNT value on done: 597479.0 [2024-08-06 05:04:48,001][52659] Sum rewards: 66.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.154', 'weapon4': '0.192', 'AMMO4': '0.234', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '55.000'} [2024-08-06 05:04:48,414][52665] DAMAGECOUNT value on done: 588982.0 [2024-08-06 05:04:48,415][52665] Sum rewards: 70.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.208', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '2.874', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:48,424][52794] DAMAGECOUNT value on done: 587825.0 [2024-08-06 05:04:48,424][52794] Sum rewards: 64.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon4': '0.198', 'AMMO3': '0.235', 'weapon5': '0.298', 'AMMO4': '0.327', 'weapon2': '0.430', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.710', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '53.000'} [2024-08-06 05:04:48,448][52667] Large shaping reward 2.571 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:04:50,024][52647] DAMAGECOUNT value on done: 625811.0 [2024-08-06 05:04:50,025][52647] Sum rewards: 85.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.410', 'AMMO5': '0.006', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.122', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon3': '3.272', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '68.000'} [2024-08-06 05:04:51,284][52659] DAMAGECOUNT value on done: 585632.0 [2024-08-06 05:04:51,284][52659] Sum rewards: 66.973, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.458', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '58.000'} [2024-08-06 05:04:51,386][52665] DAMAGECOUNT value on done: 587233.0 [2024-08-06 05:04:51,386][52665] Sum rewards: 83.328, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '68.000'} [2024-08-06 05:04:51,531][52794] DAMAGECOUNT value on done: 591403.0 [2024-08-06 05:04:51,532][52794] Sum rewards: 77.592, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.262', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.078', 'weapon5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '3.092', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '62.000'} [2024-08-06 05:04:52,212][52650] Updated weights for policy 0, policy_version 58391 (0.0024) [2024-08-06 05:04:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 478339072. Throughput: 0: 4368.9. Samples: 119589310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:04:52,794][52567] Avg episode reward: [(0, '72.036')] [2024-08-06 05:04:53,097][52647] DAMAGECOUNT value on done: 621125.0 [2024-08-06 05:04:53,097][52647] Sum rewards: 72.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.855', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.156', 'AMMO3': '0.229', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.664', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '60.000'} [2024-08-06 05:04:53,917][52659] DAMAGECOUNT value on done: 595979.0 [2024-08-06 05:04:53,918][52659] Sum rewards: 64.544, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.464', 'AMMO5': '0.018', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.095', 'weapon5': '0.130', 'WEAPON4': '0.200', 'weapon2': '0.260', 'AMMO3': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '3.090', 'weapon3': '3.224', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '59.000'} [2024-08-06 05:04:54,143][52665] DAMAGECOUNT value on done: 584323.0 [2024-08-06 05:04:54,144][52665] Sum rewards: 63.942, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.236', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.162', 'weapon5': '0.232', 'AMMO4': '0.248', 'AMMO3': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.002', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '56.500'} [2024-08-06 05:04:54,704][52794] DAMAGECOUNT value on done: 596624.0 [2024-08-06 05:04:54,705][52794] Sum rewards: 62.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.132', 'AMMO4': '0.169', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '52.000'} [2024-08-06 05:04:54,951][52670] Large shaping reward 3.456 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.405, 135.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:04:55,605][52647] DAMAGECOUNT value on done: 621278.0 [2024-08-06 05:04:55,607][52647] Sum rewards: 64.382, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.100', 'AMMO4': '0.195', 'weapon2': '0.200', 'weapon5': '0.234', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.190', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '56.000'} [2024-08-06 05:04:56,572][52659] DAMAGECOUNT value on done: 584596.0 [2024-08-06 05:04:56,573][52659] Sum rewards: 85.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.188', 'AMMO4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.093', 'FRAGCOUNT': '68.000'} [2024-08-06 05:04:56,971][52650] Updated weights for policy 0, policy_version 58401 (0.0014) [2024-08-06 05:04:57,530][52665] DAMAGECOUNT value on done: 583454.0 [2024-08-06 05:04:57,531][52665] Sum rewards: 75.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.764', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon2': '0.168', 'weapon5': '0.194', 'AMMO3': '0.253', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.998', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '63.000'} [2024-08-06 05:04:57,580][52794] DAMAGECOUNT value on done: 584446.0 [2024-08-06 05:04:57,580][52794] Sum rewards: 71.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.812', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.164', 'weapon4': '0.174', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.038', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '57.000'} [2024-08-06 05:04:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 478429184. Throughput: 0: 4366.4. Samples: 119615410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:04:57,794][52567] Avg episode reward: [(0, '71.872')] [2024-08-06 05:04:58,211][52647] DAMAGECOUNT value on done: 616114.0 [2024-08-06 05:04:58,212][52647] Sum rewards: 74.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.006', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.162', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '63.000'} [2024-08-06 05:04:59,614][52614] Signal inference workers to stop experience collection... (10600 times) [2024-08-06 05:04:59,614][52614] Signal inference workers to resume experience collection... (10600 times) [2024-08-06 05:04:59,697][52650] InferenceWorker_p0-w0: stopping experience collection (10600 times) [2024-08-06 05:04:59,697][52650] InferenceWorker_p0-w0: resuming experience collection (10600 times) [2024-08-06 05:04:59,766][52659] DAMAGECOUNT value on done: 589363.0 [2024-08-06 05:04:59,770][52659] Sum rewards: 84.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.041', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.064', 'weapon4': '0.102', 'AMMO4': '0.153', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.316', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '67.000'} [2024-08-06 05:05:00,506][52794] DAMAGECOUNT value on done: 595319.0 [2024-08-06 05:05:00,506][52794] Sum rewards: 74.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.549', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.154', 'AMMO3': '0.169', 'weapon2': '0.218', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon4': '0.272', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.100', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '59.000'} [2024-08-06 05:05:00,685][52665] DAMAGECOUNT value on done: 581742.0 [2024-08-06 05:05:00,685][52665] Sum rewards: 72.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.425', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.136', 'weapon5': '0.176', 'weapon2': '0.188', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.204', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:00,960][52647] DAMAGECOUNT value on done: 629732.0 [2024-08-06 05:05:00,960][52647] Sum rewards: 76.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.830', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO3': '0.243', 'AMMO4': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '66.000'} [2024-08-06 05:05:01,711][52650] Updated weights for policy 0, policy_version 58411 (0.0011) [2024-08-06 05:05:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 478519296. Throughput: 0: 4366.2. Samples: 119628660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:05:02,802][52567] Avg episode reward: [(0, '71.966')] [2024-08-06 05:05:02,883][52659] DAMAGECOUNT value on done: 602732.0 [2024-08-06 05:05:02,885][52659] Sum rewards: 74.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.132', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.220', 'AMMO4': '0.238', 'AMMO3': '0.239', 'weapon2': '0.242', 'weapon4': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.946', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '61.000'} [2024-08-06 05:05:03,502][52794] DAMAGECOUNT value on done: 589001.0 [2024-08-06 05:05:03,502][52794] Sum rewards: 57.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.088', 'weapon5': '0.098', 'AMMO3': '0.151', 'AMMO4': '0.229', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '2.946', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '48.000'} [2024-08-06 05:05:03,708][52647] DAMAGECOUNT value on done: 619144.0 [2024-08-06 05:05:03,708][52647] Sum rewards: 62.821, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.311', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'weapon7': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.147', 'weapon2': '0.390', 'weapon4': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.634', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '49.000'} [2024-08-06 05:05:03,882][52665] DAMAGECOUNT value on done: 584941.0 [2024-08-06 05:05:03,882][52665] Sum rewards: 79.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.442', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.128', 'WEAPON4': '0.150', 'weapon2': '0.188', 'AMMO3': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.502', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '69.000'} [2024-08-06 05:05:05,353][52659] Large shaping reward 2.752 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:05:05,792][52659] DAMAGECOUNT value on done: 592360.0 [2024-08-06 05:05:05,794][52659] Sum rewards: 69.028, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.160', 'weapon5': '0.192', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'HEALTH': '0.572', 'weapon4': '0.572', 'WEAPON3': '0.850', 'weapon3': '2.594', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '54.000'} [2024-08-06 05:05:06,206][52647] DAMAGECOUNT value on done: 627000.0 [2024-08-06 05:05:06,207][52647] Sum rewards: 66.802, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.969', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.138', 'AMMO3': '0.159', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'weapon4': '0.376', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '52.000'} [2024-08-06 05:05:06,482][52650] Updated weights for policy 0, policy_version 58421 (0.0013) [2024-08-06 05:05:06,756][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:05:06,912][52794] DAMAGECOUNT value on done: 587541.0 [2024-08-06 05:05:06,913][52794] Sum rewards: 68.267, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.890', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.152', 'AMMO4': '0.230', 'weapon4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.322', 'AMMO3': '0.329', 'WEAPON4': '0.350', 'WEAPON3': '1.900', 'weapon3': '2.986', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '62.000'} [2024-08-06 05:05:07,258][52665] DAMAGECOUNT value on done: 580941.0 [2024-08-06 05:05:07,259][52665] Sum rewards: 70.423, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.092', 'AMMO3': '0.177', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.282', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '57.000'} [2024-08-06 05:05:07,796][52567] Fps is (10 sec: 17200.0, 60 sec: 17475.7, 300 sec: 17466.9). Total num frames: 478601216. Throughput: 0: 4361.6. Samples: 119654780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:05:07,804][52567] Avg episode reward: [(0, '71.766')] [2024-08-06 05:05:08,035][52667] DAMAGECOUNT value on done: 593851.0 [2024-08-06 05:05:08,035][52667] Sum rewards: 73.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.863', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.070', 'weapon4': '0.074', 'AMMO4': '0.123', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 05:05:08,448][52659] DAMAGECOUNT value on done: 600115.0 [2024-08-06 05:05:08,450][52659] Sum rewards: 56.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.492', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '2.570', 'weapon3': '3.354', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '49.000'} [2024-08-06 05:05:09,064][52647] DAMAGECOUNT value on done: 626879.0 [2024-08-06 05:05:09,064][52647] Sum rewards: 69.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.420', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.054', 'weapon4': '0.116', 'AMMO3': '0.227', 'weapon2': '0.228', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.402', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 05:05:09,265][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:05:10,125][52794] DAMAGECOUNT value on done: 591232.0 [2024-08-06 05:05:10,127][52794] Sum rewards: 64.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.521', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon4': '0.130', 'weapon5': '0.198', 'AMMO3': '0.220', 'weapon2': '0.318', 'AMMO4': '0.321', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.060', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '55.000'} [2024-08-06 05:05:10,418][52665] DAMAGECOUNT value on done: 582107.0 [2024-08-06 05:05:10,420][52665] Sum rewards: 63.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.140', 'AMMO4': '0.165', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.706', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '52.500'} [2024-08-06 05:05:10,937][52659] DAMAGECOUNT value on done: 590529.0 [2024-08-06 05:05:10,938][52659] Sum rewards: 79.381, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.086', 'AMMO4': '0.106', 'weapon5': '0.108', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'AMMO3': '0.308', 'weapon2': '0.448', 'WEAPON3': '1.700', 'weapon3': '3.062', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '68.000'} [2024-08-06 05:05:11,122][52667] DAMAGECOUNT value on done: 600396.0 [2024-08-06 05:05:11,124][52667] Sum rewards: 73.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.608', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.122', 'weapon4': '0.134', 'AMMO4': '0.150', 'weapon2': '0.238', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '63.000'} [2024-08-06 05:05:11,299][52650] Updated weights for policy 0, policy_version 58431 (0.0014) [2024-08-06 05:05:11,868][52647] DAMAGECOUNT value on done: 610858.0 [2024-08-06 05:05:11,868][52647] Sum rewards: 67.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.389', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.274', 'weapon2': '0.292', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '55.000'} [2024-08-06 05:05:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 478691328. Throughput: 0: 4352.4. Samples: 119680730. Policy #0 lag: (min: 0.0, avg: 3.7, max: 9.0) [2024-08-06 05:05:12,794][52567] Avg episode reward: [(0, '71.681')] [2024-08-06 05:05:13,176][52794] DAMAGECOUNT value on done: 586210.0 [2024-08-06 05:05:13,187][52794] Sum rewards: 61.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.865', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.204', 'weapon2': '0.604', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '51.000'} [2024-08-06 05:05:13,216][52665] DAMAGECOUNT value on done: 584908.0 [2024-08-06 05:05:13,217][52665] Sum rewards: 66.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.574', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO4': '0.193', 'AMMO3': '0.202', 'weapon4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '55.000'} [2024-08-06 05:05:13,575][52659] DAMAGECOUNT value on done: 597181.0 [2024-08-06 05:05:13,575][52659] Sum rewards: 68.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.120', 'weapon5': '0.146', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '57.000'} [2024-08-06 05:05:14,325][52794] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 05:05:14,355][52667] DAMAGECOUNT value on done: 595472.0 [2024-08-06 05:05:14,356][52667] Sum rewards: 74.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.198', 'weapon2': '0.240', 'AMMO3': '0.242', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '2.960', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '64.000'} [2024-08-06 05:05:14,543][52647] DAMAGECOUNT value on done: 619958.0 [2024-08-06 05:05:14,543][52647] Sum rewards: 72.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.125', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.162', 'AMMO3': '0.166', 'AMMO4': '0.180', 'WEAPON4': '0.300', 'weapon5': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:15,518][52795] DAMAGECOUNT value on done: 549431.0 [2024-08-06 05:05:15,521][52795] Sum rewards: 66.363, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.802', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.174', 'weapon5': '0.264', 'AMMO4': '0.271', 'AMMO3': '0.287', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.886', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:15,640][52794] DAMAGECOUNT value on done: 605590.0 [2024-08-06 05:05:15,641][52794] Sum rewards: 60.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon2': '0.196', 'weapon5': '0.238', 'AMMO4': '0.247', 'AMMO3': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'HITCOUNT': '2.750', 'weapon3': '3.184', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '52.000'} [2024-08-06 05:05:16,199][52650] Updated weights for policy 0, policy_version 58441 (0.0049) [2024-08-06 05:05:16,287][52659] DAMAGECOUNT value on done: 591453.0 [2024-08-06 05:05:16,289][52659] Sum rewards: 67.997, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.075', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.144', 'weapon5': '0.144', 'AMMO4': '0.200', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.760', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '53.000'} [2024-08-06 05:05:17,372][52667] DAMAGECOUNT value on done: 596563.0 [2024-08-06 05:05:17,372][52667] Sum rewards: 64.617, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.547', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon5': '0.210', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '0.950', 'HITCOUNT': '2.630', 'weapon3': '3.166', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '51.000'} [2024-08-06 05:05:17,625][52647] DAMAGECOUNT value on done: 611918.0 [2024-08-06 05:05:17,625][52647] Sum rewards: 82.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.146', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.064', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '69.000'} [2024-08-06 05:05:17,794][52567] Fps is (10 sec: 18025.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 478781440. Throughput: 0: 4364.0. Samples: 119693940. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:05:17,794][52567] Avg episode reward: [(0, '71.478')] [2024-08-06 05:05:18,584][52794] DAMAGECOUNT value on done: 585333.0 [2024-08-06 05:05:18,586][52794] Sum rewards: 62.909, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.456', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.286', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'HITCOUNT': '3.200', 'weapon3': '3.450', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '56.000'} [2024-08-06 05:05:18,628][52795] DAMAGECOUNT value on done: 538876.0 [2024-08-06 05:05:18,630][52795] Sum rewards: 64.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.236', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '53.000'} [2024-08-06 05:05:18,741][52663] DAMAGECOUNT value on done: 601161.0 [2024-08-06 05:05:18,741][52663] Sum rewards: 63.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.244', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'HITCOUNT': '3.340', 'weapon3': '3.440', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '55.000'} [2024-08-06 05:05:20,028][52647] DAMAGECOUNT value on done: 616416.0 [2024-08-06 05:05:20,029][52647] Sum rewards: 69.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.204', 'weapon5': '0.224', 'AMMO3': '0.226', 'AMMO4': '0.284', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:20,333][52667] DAMAGECOUNT value on done: 600236.0 [2024-08-06 05:05:20,334][52667] Sum rewards: 77.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon4': '0.118', 'AMMO4': '0.193', 'weapon5': '0.210', 'AMMO3': '0.220', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:20,391][52650] Updated weights for policy 0, policy_version 58451 (0.0018) [2024-08-06 05:05:21,496][52794] DAMAGECOUNT value on done: 599544.0 [2024-08-06 05:05:21,499][52794] Sum rewards: 71.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.172', 'AMMO3': '0.183', 'weapon4': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '57.000'} [2024-08-06 05:05:21,543][52663] DAMAGECOUNT value on done: 590723.0 [2024-08-06 05:05:21,544][52663] Sum rewards: 68.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.158', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.219', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '57.000'} [2024-08-06 05:05:21,868][52795] DAMAGECOUNT value on done: 537907.0 [2024-08-06 05:05:21,869][52795] Sum rewards: 81.254, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.025', 'AMMO2': '0.067', 'weapon5': '0.140', 'weapon4': '0.182', 'AMMO3': '0.233', 'weapon2': '0.284', 'AMMO4': '0.337', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.967', 'FRAGCOUNT': '69.000'} [2024-08-06 05:05:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 478863360. Throughput: 0: 4363.3. Samples: 119720340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:05:22,794][52567] Avg episode reward: [(0, '70.998')] [2024-08-06 05:05:23,564][52667] DAMAGECOUNT value on done: 602227.0 [2024-08-06 05:05:23,565][52667] Sum rewards: 79.318, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.508', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.066', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '64.000'} [2024-08-06 05:05:24,171][52663] DAMAGECOUNT value on done: 581865.0 [2024-08-06 05:05:24,180][52663] Sum rewards: 65.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.186', 'AMMO4': '0.198', 'weapon5': '0.210', 'AMMO3': '0.218', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '54.000'} [2024-08-06 05:05:24,606][52794] DAMAGECOUNT value on done: 592839.0 [2024-08-06 05:05:24,608][52794] Sum rewards: 72.009, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.864', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.154', 'weapon4': '0.196', 'AMMO3': '0.213', 'AMMO4': '0.221', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:25,028][52795] DAMAGECOUNT value on done: 546048.0 [2024-08-06 05:05:25,030][52795] Sum rewards: 77.641, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.122', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.126', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'AMMO3': '0.277', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.600', 'weapon3': '2.938', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '67.000'} [2024-08-06 05:05:25,257][52650] Updated weights for policy 0, policy_version 58461 (0.0012) [2024-08-06 05:05:25,826][52667] DAMAGECOUNT value on done: 597825.0 [2024-08-06 05:05:25,826][52667] Sum rewards: 61.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.143', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.276', 'weapon4': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '51.000'} [2024-08-06 05:05:26,603][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:05:26,840][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:05:26,889][52663] DAMAGECOUNT value on done: 588356.0 [2024-08-06 05:05:26,892][52663] Sum rewards: 66.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.090', 'weapon5': '0.104', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '56.000'} [2024-08-06 05:05:27,728][52794] DAMAGECOUNT value on done: 599820.0 [2024-08-06 05:05:27,729][52794] Sum rewards: 75.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.254', 'weapon2': '0.314', 'WEAPON3': '1.550', 'weapon3': '3.400', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '64.000'} [2024-08-06 05:05:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 478945280. Throughput: 0: 4372.0. Samples: 119746640. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:05:27,794][52567] Avg episode reward: [(0, '70.816')] [2024-08-06 05:05:28,211][52795] DAMAGECOUNT value on done: 542594.0 [2024-08-06 05:05:28,211][52795] Sum rewards: 82.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.432', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.396', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.910', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:28,772][52667] DAMAGECOUNT value on done: 591449.0 [2024-08-06 05:05:28,772][52667] Sum rewards: 78.336, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.679', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.104', 'AMMO4': '0.115', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.304', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '63.000'} [2024-08-06 05:05:29,894][52663] DAMAGECOUNT value on done: 593790.0 [2024-08-06 05:05:29,896][52663] Sum rewards: 77.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.846', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.188', 'weapon2': '0.252', 'weapon5': '0.262', 'AMMO4': '0.269', 'weapon4': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '63.000'} [2024-08-06 05:05:29,902][52650] Updated weights for policy 0, policy_version 58471 (0.0029) [2024-08-06 05:05:30,138][52666] DAMAGECOUNT value on done: 593066.0 [2024-08-06 05:05:30,138][52666] Sum rewards: 85.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.908', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'weapon2': '0.226', 'AMMO3': '0.241', 'WEAPON3': '1.600', 'weapon3': '3.534', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '72.000'} [2024-08-06 05:05:31,040][52794] DAMAGECOUNT value on done: 600655.0 [2024-08-06 05:05:31,040][52794] Sum rewards: 70.879, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.051', 'AMMO3': '0.154', 'weapon5': '0.158', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'WEAPON4': '0.350', 'weapon4': '0.406', 'weapon2': '0.572', 'HEALTH': '0.734', 'WEAPON3': '0.850', 'weapon3': '2.604', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 05:05:31,290][52667] DAMAGECOUNT value on done: 598146.0 [2024-08-06 05:05:31,292][52667] Sum rewards: 64.023, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.224', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.183', 'weapon5': '0.190', 'AMMO4': '0.201', 'weapon4': '0.242', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.052', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '50.000'} [2024-08-06 05:05:31,323][52795] DAMAGECOUNT value on done: 552167.0 [2024-08-06 05:05:31,324][52795] Sum rewards: 87.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.044', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.132', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '71.000'} [2024-08-06 05:05:32,593][52670] DAMAGECOUNT value on done: 583217.0 [2024-08-06 05:05:32,595][52670] Sum rewards: 76.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.125', 'AMMO3': '0.166', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '61.000'} [2024-08-06 05:05:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 479043584. Throughput: 0: 4373.1. Samples: 119759700. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:05:32,794][52567] Avg episode reward: [(0, '71.275')] [2024-08-06 05:05:33,006][52666] DAMAGECOUNT value on done: 595070.0 [2024-08-06 05:05:33,009][52666] Sum rewards: 81.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.225', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.166', 'AMMO3': '0.223', 'AMMO4': '0.251', 'weapon5': '0.270', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:33,051][52663] DAMAGECOUNT value on done: 600330.0 [2024-08-06 05:05:33,052][52663] Sum rewards: 80.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.438', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.082', 'AMMO4': '0.093', 'weapon5': '0.130', 'weapon2': '0.158', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.438', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:33,948][52667] DAMAGECOUNT value on done: 599929.0 [2024-08-06 05:05:33,950][52667] Sum rewards: 55.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.100', 'AMMO4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.400', 'HITCOUNT': '2.620', 'weapon3': '3.190', 'DAMAGECOUNT': '14.100', 'FRAGCOUNT': '49.000'} [2024-08-06 05:05:33,955][52666] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:05:34,181][52794] DAMAGECOUNT value on done: 590548.0 [2024-08-06 05:05:34,185][52794] Sum rewards: 65.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.836', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.054', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.014', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '56.500'} [2024-08-06 05:05:34,506][52795] DAMAGECOUNT value on done: 555515.0 [2024-08-06 05:05:34,513][52795] Sum rewards: 64.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.859', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.094', 'weapon5': '0.146', 'AMMO3': '0.238', 'AMMO4': '0.274', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '57.000'} [2024-08-06 05:05:34,656][52650] Updated weights for policy 0, policy_version 58481 (0.0012) [2024-08-06 05:05:35,203][52670] DAMAGECOUNT value on done: 592156.0 [2024-08-06 05:05:35,204][52670] Sum rewards: 71.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.122', 'weapon4': '0.128', 'AMMO3': '0.221', 'AMMO4': '0.235', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '59.000'} [2024-08-06 05:05:35,589][52666] DAMAGECOUNT value on done: 595455.0 [2024-08-06 05:05:35,590][52666] Sum rewards: 64.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.086', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.070', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'weapon4': '0.334', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '2.782', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '55.000'} [2024-08-06 05:05:35,800][52663] DAMAGECOUNT value on done: 592020.0 [2024-08-06 05:05:35,801][52663] Sum rewards: 82.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.068', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '70.000'} [2024-08-06 05:05:35,907][52664] DAMAGECOUNT value on done: 613689.0 [2024-08-06 05:05:35,907][52664] Sum rewards: 65.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.068', 'AMMO3': '0.226', 'weapon2': '0.226', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.500', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '56.000'} [2024-08-06 05:05:35,980][52820] DAMAGECOUNT value on done: 545963.0 [2024-08-06 05:05:35,980][52820] Sum rewards: 70.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.122', 'weapon5': '0.124', 'AMMO4': '0.127', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:37,055][52667] DAMAGECOUNT value on done: 588523.0 [2024-08-06 05:05:37,057][52667] Sum rewards: 68.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.324', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.045', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'AMMO4': '0.225', 'weapon2': '0.270', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.508', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '55.000'} [2024-08-06 05:05:37,622][52795] DAMAGECOUNT value on done: 549201.0 [2024-08-06 05:05:37,624][52795] Sum rewards: 76.887, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.640', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.180', 'weapon4': '0.222', 'AMMO3': '0.246', 'AMMO4': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '64.000'} [2024-08-06 05:05:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 479125504. Throughput: 0: 4368.7. Samples: 119785900. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:05:37,795][52567] Avg episode reward: [(0, '71.091')] [2024-08-06 05:05:38,127][52670] DAMAGECOUNT value on done: 584548.0 [2024-08-06 05:05:38,131][52670] Sum rewards: 51.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.020', 'AMMO2': '0.037', 'AMMO4': '0.182', 'weapon5': '0.214', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'weapon4': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.694', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '13.230', 'FRAGCOUNT': '45.000'} [2024-08-06 05:05:38,525][52664] DAMAGECOUNT value on done: 618850.0 [2024-08-06 05:05:38,526][52664] Sum rewards: 70.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'weapon4': '0.168', 'AMMO3': '0.179', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:38,533][52663] DAMAGECOUNT value on done: 588108.0 [2024-08-06 05:05:38,534][52663] Sum rewards: 76.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.160', 'weapon5': '0.176', 'AMMO4': '0.192', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:38,824][52666] DAMAGECOUNT value on done: 594531.0 [2024-08-06 05:05:38,825][52666] Sum rewards: 79.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.386', 'WEAPON3': '1.600', 'weapon3': '3.294', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '67.000'} [2024-08-06 05:05:38,879][52647] Large shaping reward -2.518 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.006, 2.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:05:39,112][52820] DAMAGECOUNT value on done: 548744.0 [2024-08-06 05:05:39,112][52820] Sum rewards: 67.207, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.636', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.228', 'weapon5': '0.262', 'AMMO4': '0.299', 'weapon4': '0.372', 'WEAPON5': '0.500', 'weapon2': '0.582', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.432', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '57.000'} [2024-08-06 05:05:39,201][52650] Updated weights for policy 0, policy_version 58491 (0.0014) [2024-08-06 05:05:40,134][52667] DAMAGECOUNT value on done: 591874.0 [2024-08-06 05:05:40,142][52667] Sum rewards: 77.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '64.000'} [2024-08-06 05:05:40,776][52663] DAMAGECOUNT value on done: 583785.0 [2024-08-06 05:05:40,779][52663] Sum rewards: 71.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.072', 'AMMO4': '0.087', 'weapon5': '0.114', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:40,814][52795] DAMAGECOUNT value on done: 542583.0 [2024-08-06 05:05:40,814][52795] Sum rewards: 61.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.013', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.150', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '52.000'} [2024-08-06 05:05:40,828][52670] DAMAGECOUNT value on done: 581678.0 [2024-08-06 05:05:40,830][52670] Sum rewards: 75.889, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.574', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.171', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.392', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '62.000'} [2024-08-06 05:05:41,523][52666] DAMAGECOUNT value on done: 588640.0 [2024-08-06 05:05:41,523][52666] Sum rewards: 72.685, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.210', 'weapon4': '0.230', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '62.000'} [2024-08-06 05:05:41,654][52664] DAMAGECOUNT value on done: 617255.0 [2024-08-06 05:05:41,654][52664] Sum rewards: 70.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.156', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.082', 'AMMO4': '0.088', 'weapon5': '0.162', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '57.000'} [2024-08-06 05:05:42,464][52820] DAMAGECOUNT value on done: 551763.0 [2024-08-06 05:05:42,464][52820] Sum rewards: 69.231, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.960', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.128', 'weapon5': '0.182', 'AMMO4': '0.207', 'weapon4': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '0.850', 'weapon3': '2.908', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '54.000'} [2024-08-06 05:05:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 479223808. Throughput: 0: 4368.7. Samples: 119812000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:05:42,794][52567] Avg episode reward: [(0, '70.638')] [2024-08-06 05:05:43,501][52667] DAMAGECOUNT value on done: 598108.0 [2024-08-06 05:05:43,503][52667] Sum rewards: 66.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.769', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.148', 'AMMO4': '0.158', 'weapon5': '0.168', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '56.000'} [2024-08-06 05:05:43,583][52663] DAMAGECOUNT value on done: 591303.0 [2024-08-06 05:05:43,585][52663] Sum rewards: 64.648, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.979', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.094', 'weapon5': '0.130', 'AMMO4': '0.154', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'weapon2': '0.442', 'WEAPON3': '1.800', 'weapon3': '3.014', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:43,680][52670] DAMAGECOUNT value on done: 596803.0 [2024-08-06 05:05:43,682][52670] Sum rewards: 66.072, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.192', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.112', 'AMMO4': '0.197', 'AMMO3': '0.296', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.238', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.000'} [2024-08-06 05:05:43,961][52795] DAMAGECOUNT value on done: 552578.0 [2024-08-06 05:05:43,964][52795] Sum rewards: 79.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.172', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.100', 'weapon3': '3.348', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:44,219][52666] DAMAGECOUNT value on done: 584964.0 [2024-08-06 05:05:44,221][52666] Sum rewards: 70.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.070', 'weapon4': '0.072', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '59.000'} [2024-08-06 05:05:44,332][52650] Updated weights for policy 0, policy_version 58501 (0.0013) [2024-08-06 05:05:44,895][52664] DAMAGECOUNT value on done: 610868.0 [2024-08-06 05:05:44,896][52664] Sum rewards: 86.402, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.564', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.128', 'weapon5': '0.128', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '69.000'} [2024-08-06 05:05:45,574][52820] DAMAGECOUNT value on done: 544442.0 [2024-08-06 05:05:45,575][52820] Sum rewards: 75.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.168', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.096', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:46,231][52667] DAMAGECOUNT value on done: 588170.0 [2024-08-06 05:05:46,231][52667] Sum rewards: 76.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.242', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.068', 'weapon5': '0.156', 'AMMO3': '0.219', 'AMMO4': '0.239', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:46,245][52670] DAMAGECOUNT value on done: 590816.0 [2024-08-06 05:05:46,245][52670] Sum rewards: 76.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.995', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.188', 'AMMO4': '0.197', 'weapon2': '0.210', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.288', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:46,554][52663] DAMAGECOUNT value on done: 600796.0 [2024-08-06 05:05:46,554][52663] Sum rewards: 78.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.495', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.216', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.386', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:47,090][52795] DAMAGECOUNT value on done: 549143.0 [2024-08-06 05:05:47,091][52795] Sum rewards: 88.365, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.037', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'weapon4': '0.078', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.318', 'FRAGCOUNT': '70.000'} [2024-08-06 05:05:47,095][52666] DAMAGECOUNT value on done: 590268.0 [2024-08-06 05:05:47,096][52666] Sum rewards: 79.218, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.090', 'HEALTH': '0.096', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '3.108', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '63.000'} [2024-08-06 05:05:47,379][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:05:47,596][52664] DAMAGECOUNT value on done: 617106.0 [2024-08-06 05:05:47,596][52664] Sum rewards: 72.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.138', 'weapon4': '0.140', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 479305728. Throughput: 0: 4370.9. Samples: 119825350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:05:47,795][52567] Avg episode reward: [(0, '71.543')] [2024-08-06 05:05:48,294][52650] Updated weights for policy 0, policy_version 58511 (0.0012) [2024-08-06 05:05:48,617][52820] DAMAGECOUNT value on done: 551670.0 [2024-08-06 05:05:48,618][52820] Sum rewards: 68.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.182', 'weapon4': '0.184', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '58.000'} [2024-08-06 05:05:49,094][52667] DAMAGECOUNT value on done: 597633.0 [2024-08-06 05:05:49,095][52667] Sum rewards: 69.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.262', 'weapon4': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon2': '0.178', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.380', 'weapon3': '3.696', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:49,141][52670] DAMAGECOUNT value on done: 579199.0 [2024-08-06 05:05:49,141][52670] Sum rewards: 73.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.136', 'weapon4': '0.174', 'AMMO3': '0.205', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:49,510][52663] DAMAGECOUNT value on done: 586046.0 [2024-08-06 05:05:49,510][52663] Sum rewards: 69.228, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.415', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.161', 'weapon4': '0.168', 'weapon5': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.914', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '56.000'} [2024-08-06 05:05:49,880][52664] DAMAGECOUNT value on done: 615049.0 [2024-08-06 05:05:49,881][52664] Sum rewards: 74.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.126', 'weapon5': '0.180', 'AMMO3': '0.186', 'AMMO4': '0.216', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '59.000'} [2024-08-06 05:05:50,084][52666] DAMAGECOUNT value on done: 588703.0 [2024-08-06 05:05:50,084][52666] Sum rewards: 73.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO4': '0.202', 'weapon2': '0.206', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.350', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '62.000'} [2024-08-06 05:05:50,203][52795] DAMAGECOUNT value on done: 542299.0 [2024-08-06 05:05:50,204][52795] Sum rewards: 70.330, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.135', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.016', 'AMMO4': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.269', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:51,454][52820] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:05:51,652][52667] DAMAGECOUNT value on done: 603881.0 [2024-08-06 05:05:51,653][52667] Sum rewards: 69.474, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.714', 'AMMO5': '0.012', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.044', 'AMMO4': '0.154', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.420', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '58.500'} [2024-08-06 05:05:51,762][52820] DAMAGECOUNT value on done: 544408.0 [2024-08-06 05:05:51,763][52820] Sum rewards: 78.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.635', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon4': '0.252', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:52,041][52670] DAMAGECOUNT value on done: 587588.0 [2024-08-06 05:05:52,043][52670] Sum rewards: 73.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.940', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.162', 'AMMO4': '0.184', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.282', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:52,526][52663] DAMAGECOUNT value on done: 583715.0 [2024-08-06 05:05:52,528][52663] Sum rewards: 68.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.254', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.076', 'AMMO4': '0.188', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:52,588][52664] DAMAGECOUNT value on done: 610942.0 [2024-08-06 05:05:52,588][52664] Sum rewards: 77.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.032', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.058', 'weapon4': '0.070', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '65.000'} [2024-08-06 05:05:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 479387648. Throughput: 0: 4373.7. Samples: 119851590. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:05:52,794][52567] Avg episode reward: [(0, '71.502')] [2024-08-06 05:05:52,875][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:05:53,011][52666] DAMAGECOUNT value on done: 591400.0 [2024-08-06 05:05:53,012][52666] Sum rewards: 81.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.735', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.164', 'AMMO3': '0.188', 'weapon5': '0.290', 'AMMO4': '0.303', 'weapon2': '0.642', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.574', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '66.000'} [2024-08-06 05:05:53,443][52650] Updated weights for policy 0, policy_version 58521 (0.0017) [2024-08-06 05:05:53,456][52795] DAMAGECOUNT value on done: 545067.0 [2024-08-06 05:05:53,460][52795] Sum rewards: 85.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.095', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.138', 'AMMO3': '0.183', 'WEAPON3': '1.150', 'weapon3': '3.652', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '68.000'} [2024-08-06 05:05:54,503][52667] DAMAGECOUNT value on done: 602358.0 [2024-08-06 05:05:54,503][52667] Sum rewards: 67.905, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.786', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'weapon4': '0.152', 'weapon5': '0.198', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '54.000'} [2024-08-06 05:05:54,940][52820] DAMAGECOUNT value on done: 548524.0 [2024-08-06 05:05:54,943][52820] Sum rewards: 66.509, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.810', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.139', 'weapon2': '0.446', 'WEAPON3': '0.900', 'HITCOUNT': '2.980', 'weapon3': '3.482', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '52.000'} [2024-08-06 05:05:55,038][52670] DAMAGECOUNT value on done: 586108.0 [2024-08-06 05:05:55,038][52670] Sum rewards: 76.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.072', 'AMMO4': '0.092', 'AMMO3': '0.186', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '62.000'} [2024-08-06 05:05:55,175][52669] DAMAGECOUNT value on done: 596542.0 [2024-08-06 05:05:55,175][52669] Sum rewards: 72.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.168', 'weapon4': '0.236', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.500', 'weapon3': '2.860', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:55,203][52663] DAMAGECOUNT value on done: 588689.0 [2024-08-06 05:05:55,203][52663] Sum rewards: 87.552, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.809', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.120', 'AMMO4': '0.194', 'AMMO3': '0.226', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.171', 'FRAGCOUNT': '73.000'} [2024-08-06 05:05:55,289][52664] DAMAGECOUNT value on done: 607553.0 [2024-08-06 05:05:55,290][52664] Sum rewards: 71.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.106', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO4': '0.174', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '61.000'} [2024-08-06 05:05:55,598][52666] DAMAGECOUNT value on done: 584401.0 [2024-08-06 05:05:55,598][52666] Sum rewards: 61.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.586', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.221', 'weapon2': '0.264', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.370', 'WEAPON3': '1.300', 'weapon3': '2.594', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '52.000'} [2024-08-06 05:05:56,634][52795] DAMAGECOUNT value on done: 549105.0 [2024-08-06 05:05:56,635][52795] Sum rewards: 66.516, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.128', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.062', 'weapon4': '0.114', 'AMMO3': '0.140', 'weapon2': '0.650', 'WEAPON3': '0.950', 'weapon3': '3.054', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '52.000'} [2024-08-06 05:05:57,004][52667] DAMAGECOUNT value on done: 601581.0 [2024-08-06 05:05:57,008][52667] Sum rewards: 70.048, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.524', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon4': '0.106', 'weapon5': '0.230', 'weapon2': '0.262', 'AMMO3': '0.294', 'AMMO4': '0.325', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.040', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '60.000'} [2024-08-06 05:05:57,770][52649] DAMAGECOUNT value on done: 573698.0 [2024-08-06 05:05:57,774][52649] Sum rewards: 75.495, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.088', 'weapon5': '0.090', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.406', 'HEALTH': '0.678', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '61.000'} [2024-08-06 05:05:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 479477760. Throughput: 0: 4381.1. Samples: 119877880. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:05:57,794][52567] Avg episode reward: [(0, '71.868')] [2024-08-06 05:05:57,832][52670] DAMAGECOUNT value on done: 585673.0 [2024-08-06 05:05:57,833][52670] Sum rewards: 65.885, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.645', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.098', 'weapon5': '0.136', 'AMMO3': '0.212', 'weapon2': '0.232', 'AMMO4': '0.273', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.306', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '56.000'} [2024-08-06 05:05:57,832][52650] Updated weights for policy 0, policy_version 58531 (0.0012) [2024-08-06 05:05:57,988][52820] DAMAGECOUNT value on done: 552898.0 [2024-08-06 05:05:57,990][52820] Sum rewards: 63.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.832', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.111', 'weapon5': '0.128', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '54.500'} [2024-08-06 05:05:58,243][52664] DAMAGECOUNT value on done: 618894.0 [2024-08-06 05:05:58,243][52664] Sum rewards: 62.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.110', 'weapon4': '0.134', 'AMMO4': '0.192', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.134', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '53.000'} [2024-08-06 05:05:58,345][52669] DAMAGECOUNT value on done: 587283.0 [2024-08-06 05:05:58,346][52669] Sum rewards: 75.314, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.384', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.149', 'AMMO3': '0.159', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '61.000'} [2024-08-06 05:05:58,390][52663] DAMAGECOUNT value on done: 586163.0 [2024-08-06 05:05:58,390][52663] Sum rewards: 83.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '69.000'} [2024-08-06 05:05:58,661][52666] DAMAGECOUNT value on done: 585431.0 [2024-08-06 05:05:58,661][52666] Sum rewards: 65.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.096', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.202', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '54.000'} [2024-08-06 05:05:59,784][52795] DAMAGECOUNT value on done: 540410.0 [2024-08-06 05:05:59,785][52795] Sum rewards: 75.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.956', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.167', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:00,268][52667] DAMAGECOUNT value on done: 594148.0 [2024-08-06 05:06:00,269][52667] Sum rewards: 75.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.228', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.096', 'weapon5': '0.204', 'AMMO3': '0.260', 'AMMO4': '0.267', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:00,918][52649] DAMAGECOUNT value on done: 566619.0 [2024-08-06 05:06:00,920][52649] Sum rewards: 54.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.729', 'AMMO5': '0.029', 'AMMO2': '0.072', 'AMMO3': '0.181', 'weapon5': '0.248', 'weapon4': '0.266', 'AMMO4': '0.361', 'weapon2': '0.512', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.656', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '13.677', 'FRAGCOUNT': '47.000'} [2024-08-06 05:06:00,929][52670] DAMAGECOUNT value on done: 592897.0 [2024-08-06 05:06:00,930][52670] Sum rewards: 93.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.162', 'AMMO4': '0.182', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.774', 'WEAPON3': '1.100', 'weapon3': '2.788', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.789', 'FRAGCOUNT': '76.000'} [2024-08-06 05:06:01,077][52820] DAMAGECOUNT value on done: 546941.0 [2024-08-06 05:06:01,079][52820] Sum rewards: 75.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.647', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.178', 'AMMO4': '0.194', 'AMMO3': '0.195', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '60.500'} [2024-08-06 05:06:01,307][52664] DAMAGECOUNT value on done: 612230.0 [2024-08-06 05:06:01,307][52664] Sum rewards: 72.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.180', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.404', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:01,379][52669] DAMAGECOUNT value on done: 597214.0 [2024-08-06 05:06:01,380][52669] Sum rewards: 60.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.125', 'weapon5': '0.142', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '52.000'} [2024-08-06 05:06:01,469][52663] DAMAGECOUNT value on done: 596580.0 [2024-08-06 05:06:01,470][52663] Sum rewards: 74.330, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.074', 'weapon4': '0.086', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.444', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '64.000'} [2024-08-06 05:06:01,534][52666] DAMAGECOUNT value on done: 580457.0 [2024-08-06 05:06:01,535][52666] Sum rewards: 69.202, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.770', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.094', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon2': '0.358', 'WEAPON3': '1.750', 'weapon3': '3.242', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:02,744][52650] Updated weights for policy 0, policy_version 58541 (0.0026) [2024-08-06 05:06:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 479567872. Throughput: 0: 4373.6. Samples: 119890750. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:06:02,794][52567] Avg episode reward: [(0, '72.541')] [2024-08-06 05:06:03,013][52795] DAMAGECOUNT value on done: 555244.0 [2024-08-06 05:06:03,015][52795] Sum rewards: 69.794, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.015', 'AMMO2': '0.032', 'HEALTH': '0.049', 'weapon4': '0.146', 'AMMO4': '0.160', 'AMMO3': '0.171', 'weapon5': '0.224', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '3.040', 'weapon3': '3.084', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 05:06:03,234][52667] DAMAGECOUNT value on done: 601933.0 [2024-08-06 05:06:03,235][52667] Sum rewards: 72.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.184', 'AMMO4': '0.258', 'weapon5': '0.270', 'weapon4': '0.376', 'weapon2': '0.382', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.684', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:03,692][52670] DAMAGECOUNT value on done: 578253.0 [2024-08-06 05:06:03,694][52670] Sum rewards: 74.278, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.830', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:03,754][52664] DAMAGECOUNT value on done: 619675.0 [2024-08-06 05:06:03,754][52664] Sum rewards: 77.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.546', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '64.000'} [2024-08-06 05:06:04,146][52649] DAMAGECOUNT value on done: 585805.0 [2024-08-06 05:06:04,149][52649] Sum rewards: 74.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.139', 'weapon2': '0.186', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:04,199][52671] DAMAGECOUNT value on done: 601673.0 [2024-08-06 05:06:04,199][52671] Sum rewards: 64.984, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.756', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.108', 'AMMO3': '0.259', 'weapon5': '0.266', 'AMMO4': '0.277', 'weapon2': '0.378', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.930', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:04,237][52820] DAMAGECOUNT value on done: 557056.0 [2024-08-06 05:06:04,239][52820] Sum rewards: 72.089, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.546', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:04,366][52669] DAMAGECOUNT value on done: 597721.0 [2024-08-06 05:06:04,368][52669] Sum rewards: 74.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.173', 'weapon4': '0.186', 'weapon5': '0.214', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.868', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:04,437][52663] DAMAGECOUNT value on done: 588224.0 [2024-08-06 05:06:04,437][52663] Sum rewards: 86.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.079', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.146', 'AMMO3': '0.209', 'AMMO4': '0.218', 'weapon4': '0.218', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.583', 'FRAGCOUNT': '71.000'} [2024-08-06 05:06:04,439][52666] DAMAGECOUNT value on done: 594006.0 [2024-08-06 05:06:04,439][52666] Sum rewards: 77.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.351', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:06,162][52795] DAMAGECOUNT value on done: 549874.0 [2024-08-06 05:06:06,162][52795] Sum rewards: 84.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.172', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.122', 'AMMO4': '0.195', 'weapon5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '70.000'} [2024-08-06 05:06:06,423][52664] DAMAGECOUNT value on done: 618130.0 [2024-08-06 05:06:06,423][52664] Sum rewards: 73.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.120', 'AMMO4': '0.174', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:06,641][52670] DAMAGECOUNT value on done: 586355.0 [2024-08-06 05:06:06,642][52670] Sum rewards: 75.560, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.152', 'AMMO3': '0.164', 'weapon5': '0.180', 'AMMO4': '0.208', 'HEALTH': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.736', 'WEAPON3': '0.900', 'weapon3': '2.498', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:06,926][52669] DAMAGECOUNT value on done: 593222.0 [2024-08-06 05:06:06,928][52669] Sum rewards: 75.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.028', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.169', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:07,010][52663] DAMAGECOUNT value on done: 597164.0 [2024-08-06 05:06:07,011][52663] Sum rewards: 68.937, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.588', 'AMMO5': '0.016', 'AMMO2': '0.072', 'weapon4': '0.144', 'weapon5': '0.218', 'AMMO3': '0.242', 'weapon2': '0.286', 'AMMO4': '0.358', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '3.038', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:07,078][52666] DAMAGECOUNT value on done: 586908.0 [2024-08-06 05:06:07,080][52666] Sum rewards: 66.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:07,094][52671] DAMAGECOUNT value on done: 600541.0 [2024-08-06 05:06:07,094][52671] Sum rewards: 72.221, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.927', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.129', 'weapon2': '0.674', 'WEAPON3': '0.900', 'weapon3': '3.236', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:07,276][52649] DAMAGECOUNT value on done: 581467.0 [2024-08-06 05:06:07,277][52649] Sum rewards: 78.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.110', 'weapon5': '0.130', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:07,340][52820] DAMAGECOUNT value on done: 545550.0 [2024-08-06 05:06:07,340][52820] Sum rewards: 82.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.285', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.172', 'AMMO4': '0.185', 'weapon5': '0.220', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:07,517][52650] Updated weights for policy 0, policy_version 58551 (0.0024) [2024-08-06 05:06:07,800][52567] Fps is (10 sec: 17193.0, 60 sec: 17475.0, 300 sec: 17466.7). Total num frames: 479649792. Throughput: 0: 4370.3. Samples: 119917030. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:06:07,800][52567] Avg episode reward: [(0, '72.962')] [2024-08-06 05:06:09,191][52670] DAMAGECOUNT value on done: 595754.0 [2024-08-06 05:06:09,193][52670] Sum rewards: 73.702, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.649', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.174', 'AMMO3': '0.182', 'AMMO4': '0.249', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.844', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '57.500'} [2024-08-06 05:06:09,335][52669] DAMAGECOUNT value on done: 600458.0 [2024-08-06 05:06:09,335][52669] Sum rewards: 67.998, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.125', 'AMMO4': '0.194', 'weapon4': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon5': '0.428', 'HEALTH': '0.529', 'weapon2': '0.684', 'WEAPON3': '0.700', 'weapon3': '2.402', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '52.000'} [2024-08-06 05:06:09,408][52664] DAMAGECOUNT value on done: 621639.0 [2024-08-06 05:06:09,408][52664] Sum rewards: 62.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.124', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '2.990', 'weapon3': '3.290', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:09,477][52795] DAMAGECOUNT value on done: 542024.0 [2024-08-06 05:06:09,477][52795] Sum rewards: 80.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.730', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.171', 'AMMO3': '0.199', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon5': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '65.500'} [2024-08-06 05:06:09,499][52658] DAMAGECOUNT value on done: 595417.0 [2024-08-06 05:06:09,500][52658] Sum rewards: 80.419, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.388', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.600', 'WEAPON3': '0.950', 'weapon3': '3.222', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:09,530][52663] DAMAGECOUNT value on done: 598122.0 [2024-08-06 05:06:09,533][52663] Sum rewards: 73.634, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.124', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon5': '0.252', 'weapon2': '0.332', 'HEALTH': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:10,009][52666] DAMAGECOUNT value on done: 590770.0 [2024-08-06 05:06:10,011][52666] Sum rewards: 65.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.029', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.164', 'AMMO3': '0.186', 'AMMO4': '0.193', 'weapon5': '0.252', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '54.000'} [2024-08-06 05:06:10,088][52671] DAMAGECOUNT value on done: 597565.0 [2024-08-06 05:06:10,088][52671] Sum rewards: 72.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.110', 'weapon4': '0.184', 'AMMO3': '0.216', 'AMMO4': '0.285', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:10,204][52649] DAMAGECOUNT value on done: 569631.0 [2024-08-06 05:06:10,206][52649] Sum rewards: 74.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.580', 'AMMO5': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.166', 'weapon4': '0.184', 'weapon5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:10,528][52820] DAMAGECOUNT value on done: 551033.0 [2024-08-06 05:06:10,529][52820] Sum rewards: 78.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.398', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:12,088][52650] Updated weights for policy 0, policy_version 58561 (0.0029) [2024-08-06 05:06:12,214][52670] DAMAGECOUNT value on done: 590452.0 [2024-08-06 05:06:12,215][52670] Sum rewards: 61.379, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.432', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.032', 'AMMO4': '0.118', 'AMMO3': '0.178', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.762', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '51.000'} [2024-08-06 05:06:12,428][52664] DAMAGECOUNT value on done: 623108.0 [2024-08-06 05:06:12,431][52664] Sum rewards: 79.708, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.130', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.102', 'AMMO4': '0.230', 'weapon5': '0.234', 'AMMO3': '0.264', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.922', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '69.000'} [2024-08-06 05:06:12,542][52669] DAMAGECOUNT value on done: 596139.0 [2024-08-06 05:06:12,542][52669] Sum rewards: 70.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon2': '0.140', 'weapon5': '0.182', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:12,560][52658] DAMAGECOUNT value on done: 593681.0 [2024-08-06 05:06:12,561][52658] Sum rewards: 62.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.836', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '54.000'} [2024-08-06 05:06:12,691][52795] DAMAGECOUNT value on done: 547807.0 [2024-08-06 05:06:12,691][52795] Sum rewards: 59.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.573', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'weapon5': '0.162', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '49.000'} [2024-08-06 05:06:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 479739904. Throughput: 0: 4374.2. Samples: 119943480. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:06:12,794][52567] Avg episode reward: [(0, '72.738')] [2024-08-06 05:06:12,839][52663] DAMAGECOUNT value on done: 588047.0 [2024-08-06 05:06:12,840][52663] Sum rewards: 72.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.654', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.130', 'AMMO4': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.782', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:12,891][52666] DAMAGECOUNT value on done: 584999.0 [2024-08-06 05:06:12,894][52666] Sum rewards: 60.839, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.715', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.120', 'weapon5': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '0.850', 'HITCOUNT': '2.850', 'weapon3': '2.872', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '47.000'} [2024-08-06 05:06:13,264][52671] DAMAGECOUNT value on done: 598674.0 [2024-08-06 05:06:13,267][52671] Sum rewards: 64.601, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.865', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.216', 'weapon4': '0.220', 'WEAPON4': '0.300', 'AMMO3': '0.317', 'WEAPON3': '1.800', 'weapon3': '3.202', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:13,282][52649] DAMAGECOUNT value on done: 582790.0 [2024-08-06 05:06:13,282][52649] Sum rewards: 84.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.012', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.138', 'AMMO4': '0.200', 'AMMO3': '0.213', 'weapon5': '0.286', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '70.000'} [2024-08-06 05:06:13,524][52820] DAMAGECOUNT value on done: 558943.0 [2024-08-06 05:06:13,525][52820] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.171', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.138', 'weapon5': '0.148', 'AMMO3': '0.179', 'AMMO4': '0.192', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:15,023][52658] DAMAGECOUNT value on done: 599898.0 [2024-08-06 05:06:15,023][52658] Sum rewards: 74.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.970', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO4': '0.130', 'AMMO3': '0.185', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:15,109][52664] DAMAGECOUNT value on done: 623873.0 [2024-08-06 05:06:15,110][52664] Sum rewards: 87.596, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.164', 'AMMO3': '0.167', 'AMMO4': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '70.000'} [2024-08-06 05:06:15,177][52670] DAMAGECOUNT value on done: 574704.0 [2024-08-06 05:06:15,177][52670] Sum rewards: 65.061, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.156', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.130', 'AMMO3': '0.257', 'AMMO4': '0.277', 'weapon5': '0.296', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.798', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:15,503][52669] DAMAGECOUNT value on done: 596178.0 [2024-08-06 05:06:15,505][52669] Sum rewards: 81.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.178', 'AMMO4': '0.214', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '67.000'} [2024-08-06 05:06:15,879][52795] DAMAGECOUNT value on done: 555154.0 [2024-08-06 05:06:15,880][52795] Sum rewards: 72.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.124', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.410', 'WEAPON3': '1.650', 'weapon3': '3.284', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:16,055][52666] DAMAGECOUNT value on done: 589108.0 [2024-08-06 05:06:16,056][52666] Sum rewards: 69.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.256', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.086', 'AMMO3': '0.192', 'weapon4': '0.202', 'AMMO4': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:16,168][52811] DAMAGECOUNT value on done: 566866.0 [2024-08-06 05:06:16,170][52811] Sum rewards: 75.655, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.094', 'weapon5': '0.112', 'AMMO4': '0.176', 'AMMO3': '0.246', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '64.000'} [2024-08-06 05:06:16,262][52671] DAMAGECOUNT value on done: 609132.0 [2024-08-06 05:06:16,262][52671] Sum rewards: 65.770, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.970', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO3': '0.282', 'WEAPON3': '1.700', 'HITCOUNT': '3.310', 'weapon3': '3.334', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:16,395][52649] DAMAGECOUNT value on done: 576074.0 [2024-08-06 05:06:16,396][52649] Sum rewards: 57.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.280', 'AMMO5': '0.024', 'AMMO2': '0.071', 'weapon4': '0.174', 'AMMO3': '0.237', 'weapon5': '0.258', 'AMMO4': '0.357', 'weapon2': '0.394', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.798', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.154', 'FRAGCOUNT': '50.000'} [2024-08-06 05:06:16,630][52820] DAMAGECOUNT value on done: 553454.0 [2024-08-06 05:06:16,631][52820] Sum rewards: 60.588, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.560', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.132', 'AMMO4': '0.147', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.306', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:16,666][52650] Updated weights for policy 0, policy_version 58571 (0.0015) [2024-08-06 05:06:17,794][52567] Fps is (10 sec: 18033.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 479830016. Throughput: 0: 4374.2. Samples: 119956540. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:06:17,794][52567] Avg episode reward: [(0, '72.836')] [2024-08-06 05:06:17,911][52664] DAMAGECOUNT value on done: 615919.0 [2024-08-06 05:06:17,919][52664] Sum rewards: 70.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.185', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.338', 'weapon4': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:17,977][52670] DAMAGECOUNT value on done: 585517.0 [2024-08-06 05:06:17,978][52670] Sum rewards: 72.202, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.018', 'AMMO2': '0.053', 'HEALTH': '0.138', 'weapon4': '0.176', 'AMMO3': '0.186', 'AMMO4': '0.265', 'weapon5': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.000', 'weapon3': '2.694', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '57.000'} [2024-08-06 05:06:18,189][52669] DAMAGECOUNT value on done: 604139.0 [2024-08-06 05:06:18,189][52669] Sum rewards: 72.972, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.115', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.152', 'AMMO4': '0.173', 'AMMO3': '0.221', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:18,217][52658] DAMAGECOUNT value on done: 598450.0 [2024-08-06 05:06:18,217][52658] Sum rewards: 74.244, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.102', 'AMMO3': '0.207', 'AMMO4': '0.208', 'weapon5': '0.230', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:18,712][52666] DAMAGECOUNT value on done: 597003.0 [2024-08-06 05:06:18,714][52666] Sum rewards: 76.509, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.275', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO4': '0.221', 'weapon4': '0.248', 'weapon5': '0.248', 'AMMO3': '0.251', 'weapon2': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '63.500'} [2024-08-06 05:06:18,811][52671] DAMAGECOUNT value on done: 600450.0 [2024-08-06 05:06:18,812][52671] Sum rewards: 84.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.561', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.229', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '70.000'} [2024-08-06 05:06:19,417][52811] DAMAGECOUNT value on done: 549314.0 [2024-08-06 05:06:19,419][52811] Sum rewards: 67.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.126', 'AMMO3': '0.183', 'AMMO4': '0.190', 'weapon5': '0.254', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:19,492][52649] DAMAGECOUNT value on done: 580446.0 [2024-08-06 05:06:19,492][52649] Sum rewards: 80.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.445', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.128', 'weapon5': '0.148', 'AMMO4': '0.170', 'weapon2': '0.204', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:19,672][52820] DAMAGECOUNT value on done: 556549.0 [2024-08-06 05:06:19,672][52820] Sum rewards: 70.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.565', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.086', 'AMMO4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.550', 'weapon3': '2.934', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:20,559][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:06:20,870][52669] DAMAGECOUNT value on done: 595505.0 [2024-08-06 05:06:20,870][52669] Sum rewards: 83.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.120', 'weapon5': '0.138', 'AMMO3': '0.192', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '68.000'} [2024-08-06 05:06:20,923][52670] DAMAGECOUNT value on done: 596528.0 [2024-08-06 05:06:20,923][52670] Sum rewards: 64.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.201', 'weapon5': '0.240', 'AMMO4': '0.262', 'weapon2': '0.314', 'weapon4': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '54.000'} [2024-08-06 05:06:20,948][52664] DAMAGECOUNT value on done: 611449.0 [2024-08-06 05:06:20,950][52664] Sum rewards: 72.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.099', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:21,309][52658] DAMAGECOUNT value on done: 587528.0 [2024-08-06 05:06:21,311][52658] Sum rewards: 68.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:21,415][52671] DAMAGECOUNT value on done: 604257.0 [2024-08-06 05:06:21,417][52671] Sum rewards: 74.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.481', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.106', 'weapon4': '0.112', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:21,506][52650] Updated weights for policy 0, policy_version 58581 (0.0011) [2024-08-06 05:06:21,822][52666] DAMAGECOUNT value on done: 578365.0 [2024-08-06 05:06:21,824][52666] Sum rewards: 82.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.070', 'AMMO5': '0.010', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '64.500'} [2024-08-06 05:06:22,455][52649] DAMAGECOUNT value on done: 581291.0 [2024-08-06 05:06:22,457][52649] Sum rewards: 64.825, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.865', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.186', 'AMMO4': '0.219', 'AMMO3': '0.238', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '55.500'} [2024-08-06 05:06:22,526][52811] DAMAGECOUNT value on done: 549369.0 [2024-08-06 05:06:22,528][52811] Sum rewards: 79.686, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'weapon4': '0.014', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon5': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.143', 'WEAPON5': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '64.000'} [2024-08-06 05:06:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 479920128. Throughput: 0: 4376.0. Samples: 119982820. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:06:22,795][52567] Avg episode reward: [(0, '72.738')] [2024-08-06 05:06:22,907][52820] DAMAGECOUNT value on done: 552050.0 [2024-08-06 05:06:22,908][52820] Sum rewards: 66.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.893', 'AMMO5': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.186', 'weapon5': '0.258', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.788', 'WEAPON3': '1.250', 'weapon3': '2.372', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:23,655][52669] DAMAGECOUNT value on done: 600867.0 [2024-08-06 05:06:23,656][52669] Sum rewards: 72.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.719', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.500'} [2024-08-06 05:06:23,921][52664] DAMAGECOUNT value on done: 615751.0 [2024-08-06 05:06:23,923][52664] Sum rewards: 70.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '57.000'} [2024-08-06 05:06:24,070][52658] DAMAGECOUNT value on done: 591060.0 [2024-08-06 05:06:24,071][52658] Sum rewards: 87.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.521', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.074', 'AMMO4': '0.141', 'AMMO3': '0.210', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '72.000'} [2024-08-06 05:06:24,082][52671] DAMAGECOUNT value on done: 598368.0 [2024-08-06 05:06:24,082][52671] Sum rewards: 58.713, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon5': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '2.996', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '49.000'} [2024-08-06 05:06:24,203][52670] DAMAGECOUNT value on done: 585569.0 [2024-08-06 05:06:24,203][52670] Sum rewards: 73.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.744', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.134', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:24,831][52666] DAMAGECOUNT value on done: 588393.0 [2024-08-06 05:06:24,832][52666] Sum rewards: 77.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.154', 'AMMO3': '0.201', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:25,590][52811] DAMAGECOUNT value on done: 550782.0 [2024-08-06 05:06:25,590][52811] Sum rewards: 64.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.086', 'AMMO4': '0.112', 'weapon5': '0.128', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '54.000'} [2024-08-06 05:06:25,715][52649] DAMAGECOUNT value on done: 571985.0 [2024-08-06 05:06:25,718][52649] Sum rewards: 64.251, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.555', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.107', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.254', 'weapon2': '0.366', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.096', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '51.000'} [2024-08-06 05:06:25,732][52668] DAMAGECOUNT value on done: 593298.0 [2024-08-06 05:06:25,732][52668] Sum rewards: 55.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon7': '0.064', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON7': '0.200', 'AMMO3': '0.203', 'weapon5': '0.220', 'weapon2': '0.254', 'AMMO4': '0.278', 'weapon4': '0.418', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.600', 'weapon3': '2.698', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '47.000'} [2024-08-06 05:06:25,953][52650] Updated weights for policy 0, policy_version 58591 (0.0021) [2024-08-06 05:06:26,043][52820] DAMAGECOUNT value on done: 554218.0 [2024-08-06 05:06:26,044][52820] Sum rewards: 82.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.656', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.106', 'AMMO4': '0.193', 'weapon5': '0.202', 'AMMO3': '0.209', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.210', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '68.000'} [2024-08-06 05:06:26,238][52669] DAMAGECOUNT value on done: 601145.0 [2024-08-06 05:06:26,240][52669] Sum rewards: 73.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.878', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.112', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:26,459][52670] DAMAGECOUNT value on done: 590668.0 [2024-08-06 05:06:26,460][52670] Sum rewards: 74.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.476', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.104', 'weapon5': '0.122', 'AMMO3': '0.163', 'AMMO4': '0.261', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '61.500'} [2024-08-06 05:06:26,492][52664] DAMAGECOUNT value on done: 615707.0 [2024-08-06 05:06:26,492][52664] Sum rewards: 60.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.313', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'weapon2': '0.292', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.392', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '51.000'} [2024-08-06 05:06:26,926][52671] DAMAGECOUNT value on done: 590798.0 [2024-08-06 05:06:26,927][52671] Sum rewards: 76.021, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.042', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.098', 'AMMO4': '0.147', 'AMMO3': '0.154', 'weapon5': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.000', 'weapon3': '3.136', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:27,152][52658] DAMAGECOUNT value on done: 599480.0 [2024-08-06 05:06:27,153][52658] Sum rewards: 61.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.094', 'AMMO4': '0.146', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.930', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '49.500'} [2024-08-06 05:06:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 480002048. Throughput: 0: 4381.1. Samples: 120009150. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:06:27,794][52567] Avg episode reward: [(0, '72.108')] [2024-08-06 05:06:27,861][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058595_480010240.pth... [2024-08-06 05:06:27,989][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058082_475807744.pth [2024-08-06 05:06:28,547][52811] DAMAGECOUNT value on done: 556374.0 [2024-08-06 05:06:28,550][52811] Sum rewards: 70.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.827', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.124', 'weapon2': '0.212', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:28,861][52668] DAMAGECOUNT value on done: 598245.0 [2024-08-06 05:06:28,861][52668] Sum rewards: 75.134, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:28,882][52649] DAMAGECOUNT value on done: 584818.0 [2024-08-06 05:06:28,882][52649] Sum rewards: 75.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.259', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.188', 'weapon2': '0.238', 'AMMO3': '0.253', 'AMMO4': '0.262', 'weapon5': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:28,911][52669] DAMAGECOUNT value on done: 589007.0 [2024-08-06 05:06:28,912][52669] Sum rewards: 77.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.148', 'AMMO4': '0.160', 'AMMO3': '0.200', 'weapon5': '0.218', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:29,014][52664] DAMAGECOUNT value on done: 616317.0 [2024-08-06 05:06:29,014][52664] Sum rewards: 81.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.406', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.148', 'weapon4': '0.152', 'AMMO3': '0.227', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '66.000'} [2024-08-06 05:06:29,323][52820] DAMAGECOUNT value on done: 561209.0 [2024-08-06 05:06:29,323][52820] Sum rewards: 64.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.622', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:29,897][52658] DAMAGECOUNT value on done: 589707.0 [2024-08-06 05:06:29,897][52658] Sum rewards: 52.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.118', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO4': '0.235', 'weapon4': '0.244', 'AMMO3': '0.271', 'weapon5': '0.286', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.734', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.652', 'FRAGCOUNT': '45.000'} [2024-08-06 05:06:30,511][52671] DAMAGECOUNT value on done: 598172.0 [2024-08-06 05:06:30,512][52671] Sum rewards: 76.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.148', 'weapon4': '0.164', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:30,745][52650] Updated weights for policy 0, policy_version 58601 (0.0013) [2024-08-06 05:06:31,678][52811] DAMAGECOUNT value on done: 561754.0 [2024-08-06 05:06:31,679][52811] Sum rewards: 73.960, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.526', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.150', 'weapon5': '0.182', 'weapon2': '0.270', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.164', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '64.000'} [2024-08-06 05:06:31,781][52649] DAMAGECOUNT value on done: 587826.0 [2024-08-06 05:06:31,782][52649] Sum rewards: 76.747, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.780', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO3': '0.123', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.430', 'WEAPON3': '0.850', 'weapon3': '2.944', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:31,812][52669] DAMAGECOUNT value on done: 594758.0 [2024-08-06 05:06:31,812][52669] Sum rewards: 70.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.135', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.426', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:31,967][52668] DAMAGECOUNT value on done: 597712.0 [2024-08-06 05:06:31,968][52668] Sum rewards: 63.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.405', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.086', 'weapon4': '0.132', 'AMMO3': '0.175', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.676', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '51.000'} [2024-08-06 05:06:32,511][52820] DAMAGECOUNT value on done: 560730.0 [2024-08-06 05:06:32,511][52820] Sum rewards: 69.355, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO4': '0.175', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.291', 'weapon2': '0.308', 'WEAPON3': '1.700', 'HITCOUNT': '3.100', 'weapon3': '3.138', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:32,523][52658] DAMAGECOUNT value on done: 610283.0 [2024-08-06 05:06:32,525][52658] Sum rewards: 89.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.004', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.270', 'weapon2': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.532', 'HITCOUNT': '4.360', 'DAMAGECOUNT': '22.092', 'FRAGCOUNT': '74.000'} [2024-08-06 05:06:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 480092160. Throughput: 0: 4370.5. Samples: 120022020. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:06:32,794][52567] Avg episode reward: [(0, '72.249')] [2024-08-06 05:06:33,667][52671] DAMAGECOUNT value on done: 600093.0 [2024-08-06 05:06:33,670][52671] Sum rewards: 73.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.364', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon5': '0.080', 'AMMO3': '0.179', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:34,244][52669] DAMAGECOUNT value on done: 597037.0 [2024-08-06 05:06:34,244][52669] Sum rewards: 70.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon4': '0.168', 'AMMO3': '0.233', 'weapon5': '0.282', 'AMMO4': '0.301', 'weapon2': '0.442', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.790', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:34,700][52649] DAMAGECOUNT value on done: 588276.0 [2024-08-06 05:06:34,701][52649] Sum rewards: 73.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.876', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.060', 'AMMO4': '0.179', 'weapon5': '0.214', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:34,851][52811] DAMAGECOUNT value on done: 559689.0 [2024-08-06 05:06:34,852][52811] Sum rewards: 70.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.182', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '59.000'} [2024-08-06 05:06:35,132][52668] DAMAGECOUNT value on done: 598242.0 [2024-08-06 05:06:35,132][52668] Sum rewards: 71.714, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.722', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.068', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'weapon4': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.308', 'WEAPON3': '1.800', 'weapon3': '3.302', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:35,143][52658] DAMAGECOUNT value on done: 595248.0 [2024-08-06 05:06:35,144][52658] Sum rewards: 81.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.949', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.156', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.264', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '68.000'} [2024-08-06 05:06:35,666][52820] DAMAGECOUNT value on done: 547084.0 [2024-08-06 05:06:35,667][52820] Sum rewards: 75.506, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.106', 'weapon4': '0.138', 'weapon2': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.416', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:35,679][52650] Updated weights for policy 0, policy_version 58611 (0.0053) [2024-08-06 05:06:35,926][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:06:36,894][52671] DAMAGECOUNT value on done: 596178.0 [2024-08-06 05:06:36,895][52671] Sum rewards: 81.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.038', 'AMMO4': '0.085', 'weapon4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.446', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '69.000'} [2024-08-06 05:06:37,051][52669] DAMAGECOUNT value on done: 614736.0 [2024-08-06 05:06:37,051][52669] Sum rewards: 67.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.163', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.140', 'weapon4': '0.160', 'AMMO3': '0.231', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '57.000'} [2024-08-06 05:06:37,576][52649] DAMAGECOUNT value on done: 585099.0 [2024-08-06 05:06:37,578][52649] Sum rewards: 73.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.750', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.088', 'AMMO4': '0.194', 'AMMO3': '0.205', 'weapon5': '0.276', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '62.500'} [2024-08-06 05:06:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 480174080. Throughput: 0: 4363.6. Samples: 120047950. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:06:37,794][52567] Avg episode reward: [(0, '72.554')] [2024-08-06 05:06:37,829][52811] DAMAGECOUNT value on done: 552266.0 [2024-08-06 05:06:37,831][52811] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.205', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:37,996][52658] DAMAGECOUNT value on done: 607601.0 [2024-08-06 05:06:37,999][52658] Sum rewards: 73.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.456', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.122', 'AMMO3': '0.142', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.000', 'weapon3': '3.122', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:38,040][52668] DAMAGECOUNT value on done: 585947.0 [2024-08-06 05:06:38,041][52668] Sum rewards: 71.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.357', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.164', 'weapon2': '0.250', 'weapon5': '0.262', 'AMMO4': '0.279', 'weapon4': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.768', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:38,921][52662] DAMAGECOUNT value on done: 600069.0 [2024-08-06 05:06:38,921][52662] Sum rewards: 63.026, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.565', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.114', 'weapon4': '0.122', 'AMMO4': '0.135', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.752', 'WEAPON3': '0.850', 'weapon3': '2.770', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.662', 'FRAGCOUNT': '50.000'} [2024-08-06 05:06:39,931][52669] DAMAGECOUNT value on done: 603402.0 [2024-08-06 05:06:39,932][52669] Sum rewards: 75.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.865', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.190', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:40,209][52649] DAMAGECOUNT value on done: 575336.0 [2024-08-06 05:06:40,209][52649] Sum rewards: 72.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.093', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.542', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:40,326][52650] Updated weights for policy 0, policy_version 58621 (0.0021) [2024-08-06 05:06:40,336][52671] DAMAGECOUNT value on done: 603779.0 [2024-08-06 05:06:40,338][52671] Sum rewards: 72.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.192', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.146', 'AMMO3': '0.147', 'weapon5': '0.154', 'AMMO4': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.960', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:40,777][52658] DAMAGECOUNT value on done: 592475.0 [2024-08-06 05:06:40,777][52658] Sum rewards: 73.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.644', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.120', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:40,802][52668] DAMAGECOUNT value on done: 601885.0 [2024-08-06 05:06:40,802][52668] Sum rewards: 75.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon4': '0.302', 'weapon2': '0.686', 'WEAPON3': '1.300', 'weapon3': '2.710', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:41,017][52811] DAMAGECOUNT value on done: 562943.0 [2024-08-06 05:06:41,017][52811] Sum rewards: 79.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.236', 'WEAPON3': '1.300', 'weapon3': '3.436', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '66.000'} [2024-08-06 05:06:41,724][52662] DAMAGECOUNT value on done: 596210.0 [2024-08-06 05:06:41,724][52662] Sum rewards: 60.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.437', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.189', 'weapon5': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.350', 'weapon4': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.456', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '49.500'} [2024-08-06 05:06:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17495.9). Total num frames: 480264192. Throughput: 0: 4362.2. Samples: 120074180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:06:42,795][52567] Avg episode reward: [(0, '72.204')] [2024-08-06 05:06:43,069][52669] DAMAGECOUNT value on done: 602024.0 [2024-08-06 05:06:43,070][52669] Sum rewards: 63.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.651', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.208', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.100', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '52.500'} [2024-08-06 05:06:43,390][52671] DAMAGECOUNT value on done: 598047.0 [2024-08-06 05:06:43,393][52671] Sum rewards: 66.276, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.380', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.104', 'AMMO3': '0.210', 'weapon5': '0.254', 'AMMO4': '0.286', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:43,400][52658] DAMAGECOUNT value on done: 600980.0 [2024-08-06 05:06:43,400][52658] Sum rewards: 77.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.174', 'weapon5': '0.178', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:43,700][52649] DAMAGECOUNT value on done: 582504.0 [2024-08-06 05:06:43,701][52649] Sum rewards: 64.241, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.042', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.228', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '51.000'} [2024-08-06 05:06:43,870][52668] DAMAGECOUNT value on done: 598314.0 [2024-08-06 05:06:43,870][52668] Sum rewards: 78.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.503', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.062', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:44,068][52811] DAMAGECOUNT value on done: 557255.0 [2024-08-06 05:06:44,068][52811] Sum rewards: 68.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.678', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.152', 'AMMO4': '0.222', 'AMMO3': '0.268', 'weapon2': '0.274', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.978', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:44,806][52662] DAMAGECOUNT value on done: 603247.0 [2024-08-06 05:06:44,807][52662] Sum rewards: 73.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.102', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.160', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:44,811][52650] Updated weights for policy 0, policy_version 58631 (0.0025) [2024-08-06 05:06:45,874][52669] DAMAGECOUNT value on done: 600478.0 [2024-08-06 05:06:45,874][52669] Sum rewards: 78.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.055', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:46,015][52658] DAMAGECOUNT value on done: 590606.0 [2024-08-06 05:06:46,015][52658] Sum rewards: 66.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.715', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.114', 'weapon5': '0.124', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.264', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:46,389][52671] DAMAGECOUNT value on done: 585614.0 [2024-08-06 05:06:46,391][52671] Sum rewards: 72.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.668', 'AMMO5': '0.029', 'AMMO2': '0.061', 'AMMO3': '0.174', 'AMMO4': '0.307', 'weapon4': '0.418', 'weapon2': '0.424', 'weapon5': '0.428', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.378', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:46,574][52668] DAMAGECOUNT value on done: 590238.0 [2024-08-06 05:06:46,574][52668] Sum rewards: 86.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.320', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.094', 'weapon4': '0.120', 'AMMO3': '0.156', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.823', 'FRAGCOUNT': '69.000'} [2024-08-06 05:06:46,966][52649] DAMAGECOUNT value on done: 572180.0 [2024-08-06 05:06:46,967][52649] Sum rewards: 70.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.275', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.078', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon5': '0.262', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:47,121][52811] DAMAGECOUNT value on done: 559508.0 [2024-08-06 05:06:47,121][52811] Sum rewards: 78.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.116', 'weapon5': '0.132', 'AMMO4': '0.167', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '66.000'} [2024-08-06 05:06:47,230][52803] DAMAGECOUNT value on done: 554562.0 [2024-08-06 05:06:47,232][52803] Sum rewards: 64.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.119', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.316', 'WEAPON3': '1.650', 'weapon3': '3.132', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:47,673][52662] DAMAGECOUNT value on done: 590054.0 [2024-08-06 05:06:47,673][52662] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.102', 'weapon4': '0.108', 'AMMO4': '0.139', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 480354304. Throughput: 0: 4364.0. Samples: 120087130. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:06:47,794][52567] Avg episode reward: [(0, '72.123')] [2024-08-06 05:06:48,711][52658] DAMAGECOUNT value on done: 598183.0 [2024-08-06 05:06:48,712][52658] Sum rewards: 76.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.126', 'weapon5': '0.174', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '64.000'} [2024-08-06 05:06:48,734][52669] DAMAGECOUNT value on done: 607400.0 [2024-08-06 05:06:48,734][52669] Sum rewards: 68.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.070', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '3.064', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '54.000'} [2024-08-06 05:06:49,287][52668] DAMAGECOUNT value on done: 590649.0 [2024-08-06 05:06:49,295][52668] Sum rewards: 66.027, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.392', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.136', 'weapon2': '0.176', 'weapon5': '0.224', 'AMMO4': '0.248', 'AMMO3': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.204', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:49,325][52671] DAMAGECOUNT value on done: 606583.0 [2024-08-06 05:06:49,326][52671] Sum rewards: 73.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.525', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO3': '0.186', 'AMMO4': '0.216', 'weapon4': '0.262', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:49,587][52650] Updated weights for policy 0, policy_version 58641 (0.0029) [2024-08-06 05:06:49,762][52649] DAMAGECOUNT value on done: 585425.0 [2024-08-06 05:06:49,762][52649] Sum rewards: 73.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.470', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'AMMO4': '0.056', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.158', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:50,283][52803] DAMAGECOUNT value on done: 552949.0 [2024-08-06 05:06:50,284][52803] Sum rewards: 78.468, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.183', 'weapon4': '0.190', 'weapon5': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '63.000'} [2024-08-06 05:06:50,359][52811] DAMAGECOUNT value on done: 565010.0 [2024-08-06 05:06:50,359][52811] Sum rewards: 62.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.406', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.092', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'weapon3': '3.460', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '53.000'} [2024-08-06 05:06:50,827][52662] DAMAGECOUNT value on done: 605469.0 [2024-08-06 05:06:50,827][52662] Sum rewards: 79.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.202', 'AMMO3': '0.211', 'weapon5': '0.238', 'AMMO4': '0.244', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '66.000'} [2024-08-06 05:06:51,585][52658] DAMAGECOUNT value on done: 587126.0 [2024-08-06 05:06:51,587][52658] Sum rewards: 81.034, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.616', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.132', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.340', 'WEAPON3': '1.650', 'weapon3': '3.134', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '69.500'} [2024-08-06 05:06:52,142][52668] DAMAGECOUNT value on done: 599872.0 [2024-08-06 05:06:52,143][52668] Sum rewards: 74.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.128', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '62.000'} [2024-08-06 05:06:52,347][52671] DAMAGECOUNT value on done: 601780.0 [2024-08-06 05:06:52,348][52671] Sum rewards: 65.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.079', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.358', 'weapon4': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.384', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '54.000'} [2024-08-06 05:06:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 480436224. Throughput: 0: 4363.5. Samples: 120113360. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:06:52,795][52567] Avg episode reward: [(0, '72.163')] [2024-08-06 05:06:53,021][52649] DAMAGECOUNT value on done: 585285.0 [2024-08-06 05:06:53,024][52649] Sum rewards: 71.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.265', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.130', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:53,410][52803] DAMAGECOUNT value on done: 558852.0 [2024-08-06 05:06:53,410][52803] Sum rewards: 62.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.830', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.142', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.266', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '52.000'} [2024-08-06 05:06:53,555][52811] DAMAGECOUNT value on done: 554857.0 [2024-08-06 05:06:53,557][52811] Sum rewards: 86.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.283', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '71.000'} [2024-08-06 05:06:53,884][52662] DAMAGECOUNT value on done: 592121.0 [2024-08-06 05:06:53,885][52662] Sum rewards: 82.780, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.050', 'weapon4': '0.112', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '71.000'} [2024-08-06 05:06:54,206][52650] Updated weights for policy 0, policy_version 58651 (0.0028) [2024-08-06 05:06:54,241][52658] DAMAGECOUNT value on done: 601531.0 [2024-08-06 05:06:54,241][52658] Sum rewards: 68.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.122', 'AMMO4': '0.130', 'AMMO3': '0.214', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '57.000'} [2024-08-06 05:06:55,134][52671] DAMAGECOUNT value on done: 601822.0 [2024-08-06 05:06:55,135][52671] Sum rewards: 78.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '65.000'} [2024-08-06 05:06:55,368][52668] DAMAGECOUNT value on done: 597975.0 [2024-08-06 05:06:55,368][52668] Sum rewards: 79.538, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.770', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.310', 'weapon2': '0.386', 'WEAPON3': '1.800', 'weapon3': '3.040', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '68.000'} [2024-08-06 05:06:55,802][52649] DAMAGECOUNT value on done: 579056.0 [2024-08-06 05:06:55,805][52649] Sum rewards: 67.045, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.126', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '3.178', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:56,293][52660] DAMAGECOUNT value on done: 595679.0 [2024-08-06 05:06:56,296][52660] Sum rewards: 68.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.353', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.042', 'weapon4': '0.130', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.190', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.448', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '58.000'} [2024-08-06 05:06:56,459][52662] DAMAGECOUNT value on done: 601502.0 [2024-08-06 05:06:56,459][52662] Sum rewards: 48.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.174', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.168', 'AMMO4': '0.205', 'AMMO3': '0.227', 'weapon2': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.550', 'weapon3': '3.218', 'DAMAGECOUNT': '12.915', 'FRAGCOUNT': '44.000'} [2024-08-06 05:06:56,501][52803] DAMAGECOUNT value on done: 562910.0 [2024-08-06 05:06:56,505][52803] Sum rewards: 58.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.146', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO4': '0.153', 'weapon4': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.236', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '50.000'} [2024-08-06 05:06:56,671][52658] DAMAGECOUNT value on done: 593170.0 [2024-08-06 05:06:56,671][52658] Sum rewards: 65.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.806', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon4': '0.046', 'AMMO3': '0.183', 'weapon5': '0.198', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.962', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '52.000'} [2024-08-06 05:06:56,742][52811] DAMAGECOUNT value on done: 548432.0 [2024-08-06 05:06:56,745][52811] Sum rewards: 66.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.186', 'AMMO3': '0.223', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 480526336. Throughput: 0: 4355.1. Samples: 120139460. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:06:57,794][52567] Avg episode reward: [(0, '72.013')] [2024-08-06 05:06:58,218][52671] DAMAGECOUNT value on done: 601046.0 [2024-08-06 05:06:58,220][52671] Sum rewards: 71.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '60.000'} [2024-08-06 05:06:58,332][52668] DAMAGECOUNT value on done: 588845.0 [2024-08-06 05:06:58,334][52668] Sum rewards: 79.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.057', 'weapon5': '0.182', 'weapon4': '0.204', 'AMMO3': '0.257', 'AMMO4': '0.286', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.896', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '66.000'} [2024-08-06 05:06:59,158][52650] Updated weights for policy 0, policy_version 58661 (0.0011) [2024-08-06 05:06:59,369][52662] DAMAGECOUNT value on done: 604668.0 [2024-08-06 05:06:59,369][52662] Sum rewards: 65.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.774', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon2': '0.154', 'weapon5': '0.170', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '56.000'} [2024-08-06 05:06:59,426][52660] DAMAGECOUNT value on done: 586822.0 [2024-08-06 05:06:59,426][52660] Sum rewards: 65.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.372', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '55.000'} [2024-08-06 05:06:59,582][52658] DAMAGECOUNT value on done: 592569.0 [2024-08-06 05:06:59,583][52658] Sum rewards: 66.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.146', 'AMMO3': '0.184', 'AMMO4': '0.259', 'weapon5': '0.322', 'WEAPON4': '0.400', 'weapon2': '0.490', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '53.000'} [2024-08-06 05:06:59,602][52803] DAMAGECOUNT value on done: 556399.0 [2024-08-06 05:06:59,608][52803] Sum rewards: 72.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.014', 'weapon4': '0.032', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'AMMO3': '0.292', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.176', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '61.000'} [2024-08-06 05:06:59,797][52811] DAMAGECOUNT value on done: 557286.0 [2024-08-06 05:06:59,799][52811] Sum rewards: 72.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.905', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.136', 'weapon5': '0.138', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '59.000'} [2024-08-06 05:07:00,958][52671] DAMAGECOUNT value on done: 597304.0 [2024-08-06 05:07:00,958][52671] Sum rewards: 66.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO2': '0.006', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO4': '0.031', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.484', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.210', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '57.000'} [2024-08-06 05:07:01,429][52668] DAMAGECOUNT value on done: 581107.0 [2024-08-06 05:07:01,431][52668] Sum rewards: 69.790, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.833', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.187', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.220', 'weapon3': '3.380', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '58.000'} [2024-08-06 05:07:01,880][52662] DAMAGECOUNT value on done: 594416.0 [2024-08-06 05:07:01,881][52662] Sum rewards: 67.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.835', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.110', 'AMMO4': '0.174', 'AMMO3': '0.198', 'weapon4': '0.286', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.968', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '55.500'} [2024-08-06 05:07:02,514][52660] DAMAGECOUNT value on done: 597706.0 [2024-08-06 05:07:02,514][52660] Sum rewards: 56.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.205', 'AMMO5': '0.028', 'AMMO2': '0.073', 'weapon4': '0.176', 'AMMO3': '0.225', 'weapon5': '0.282', 'AMMO4': '0.363', 'weapon2': '0.378', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'HITCOUNT': '2.510', 'weapon3': '2.846', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '50.000'} [2024-08-06 05:07:02,615][52658] DAMAGECOUNT value on done: 596930.0 [2024-08-06 05:07:02,615][52658] Sum rewards: 56.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.056', 'AMMO4': '0.121', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.746', 'WEAPON3': '1.250', 'weapon3': '2.826', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.853', 'FRAGCOUNT': '49.000'} [2024-08-06 05:07:02,788][52803] DAMAGECOUNT value on done: 550242.0 [2024-08-06 05:07:02,790][52803] Sum rewards: 65.855, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.350', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.038', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.300', 'WEAPON3': '1.900', 'weapon3': '3.442', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '58.000'} [2024-08-06 05:07:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 480616448. Throughput: 0: 4358.7. Samples: 120152680. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:02,794][52567] Avg episode reward: [(0, '71.283')] [2024-08-06 05:07:02,815][52811] DAMAGECOUNT value on done: 556543.0 [2024-08-06 05:07:02,815][52811] Sum rewards: 70.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.105', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.420', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '57.000'} [2024-08-06 05:07:03,818][52650] Updated weights for policy 0, policy_version 58671 (0.0014) [2024-08-06 05:07:04,510][52668] DAMAGECOUNT value on done: 583682.0 [2024-08-06 05:07:04,512][52668] Sum rewards: 68.831, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.235', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon4': '0.070', 'weapon5': '0.168', 'AMMO3': '0.171', 'AMMO4': '0.270', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.500'} [2024-08-06 05:07:04,931][52662] DAMAGECOUNT value on done: 605170.0 [2024-08-06 05:07:04,931][52662] Sum rewards: 69.476, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.098', 'AMMO4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '56.000'} [2024-08-06 05:07:05,610][52660] DAMAGECOUNT value on done: 604128.0 [2024-08-06 05:07:05,611][52660] Sum rewards: 84.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.342', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.612', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '71.000'} [2024-08-06 05:07:05,811][52811] DAMAGECOUNT value on done: 556781.0 [2024-08-06 05:07:05,812][52811] Sum rewards: 59.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.540', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon5': '0.206', 'AMMO4': '0.232', 'weapon2': '0.246', 'weapon4': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '2.972', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '49.000'} [2024-08-06 05:07:05,902][52803] DAMAGECOUNT value on done: 550288.0 [2024-08-06 05:07:05,904][52803] Sum rewards: 68.326, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.102', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.115', 'weapon5': '0.124', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '55.500'} [2024-08-06 05:07:06,253][52614] Signal inference workers to stop experience collection... (10650 times) [2024-08-06 05:07:06,263][52614] Signal inference workers to resume experience collection... (10650 times) [2024-08-06 05:07:06,334][52650] InferenceWorker_p0-w0: stopping experience collection (10650 times) [2024-08-06 05:07:06,336][52650] InferenceWorker_p0-w0: resuming experience collection (10650 times) [2024-08-06 05:07:07,512][52668] DAMAGECOUNT value on done: 586407.0 [2024-08-06 05:07:07,516][52668] Sum rewards: 83.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.060', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '3.518', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '67.000'} [2024-08-06 05:07:07,607][52669] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 05:07:07,788][52662] DAMAGECOUNT value on done: 592737.0 [2024-08-06 05:07:07,788][52662] Sum rewards: 68.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.055', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.172', 'weapon4': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '55.000'} [2024-08-06 05:07:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17478.0, 300 sec: 17439.2). Total num frames: 480698368. Throughput: 0: 4364.2. Samples: 120179210. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:07,794][52567] Avg episode reward: [(0, '71.463')] [2024-08-06 05:07:08,167][52650] Updated weights for policy 0, policy_version 58681 (0.0026) [2024-08-06 05:07:08,544][52660] DAMAGECOUNT value on done: 593124.0 [2024-08-06 05:07:08,546][52660] Sum rewards: 78.964, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.505', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.138', 'AMMO3': '0.151', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '0.950', 'weapon3': '2.870', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '63.000'} [2024-08-06 05:07:08,968][52803] DAMAGECOUNT value on done: 546291.0 [2024-08-06 05:07:08,970][52803] Sum rewards: 63.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.702', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.110', 'AMMO3': '0.168', 'weapon2': '0.226', 'AMMO4': '0.227', 'weapon5': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '3.100', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '52.000'} [2024-08-06 05:07:09,029][52811] DAMAGECOUNT value on done: 560377.0 [2024-08-06 05:07:09,031][52811] Sum rewards: 64.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.166', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.280', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '53.000'} [2024-08-06 05:07:10,396][52668] DAMAGECOUNT value on done: 593040.0 [2024-08-06 05:07:10,396][52668] Sum rewards: 79.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '66.000'} [2024-08-06 05:07:11,337][52662] DAMAGECOUNT value on done: 596644.0 [2024-08-06 05:07:11,337][52662] Sum rewards: 68.736, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.538', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.194', 'weapon2': '0.214', 'weapon4': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2024-08-06 05:07:11,540][52660] DAMAGECOUNT value on done: 591046.0 [2024-08-06 05:07:11,540][52660] Sum rewards: 62.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.729', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.136', 'weapon5': '0.194', 'AMMO4': '0.203', 'AMMO3': '0.235', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.160', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '53.000'} [2024-08-06 05:07:11,830][52803] DAMAGECOUNT value on done: 553877.0 [2024-08-06 05:07:11,831][52803] Sum rewards: 70.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon4': '0.078', 'weapon5': '0.136', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.054', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '59.000'} [2024-08-06 05:07:12,140][52811] DAMAGECOUNT value on done: 555891.0 [2024-08-06 05:07:12,142][52811] Sum rewards: 89.616, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.396', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.165', 'AMMO4': '0.196', 'weapon2': '0.196', 'weapon5': '0.202', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.024', 'FRAGCOUNT': '71.500'} [2024-08-06 05:07:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 480788480. Throughput: 0: 4358.6. Samples: 120205290. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:12,795][52567] Avg episode reward: [(0, '71.428')] [2024-08-06 05:07:12,843][52650] Updated weights for policy 0, policy_version 58691 (0.0013) [2024-08-06 05:07:13,607][52668] DAMAGECOUNT value on done: 595822.0 [2024-08-06 05:07:13,607][52668] Sum rewards: 76.792, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.462', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.144', 'AMMO3': '0.177', 'AMMO4': '0.204', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.500'} [2024-08-06 05:07:14,309][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:07:14,522][52662] DAMAGECOUNT value on done: 592518.0 [2024-08-06 05:07:14,523][52662] Sum rewards: 72.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.050', 'weapon5': '0.108', 'AMMO3': '0.197', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.226', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '58.000'} [2024-08-06 05:07:14,661][52660] DAMAGECOUNT value on done: 591325.0 [2024-08-06 05:07:14,662][52660] Sum rewards: 81.292, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.759', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO3': '0.167', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '67.000'} [2024-08-06 05:07:14,879][52803] DAMAGECOUNT value on done: 548134.0 [2024-08-06 05:07:14,879][52803] Sum rewards: 73.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.424', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.218', 'WEAPON4': '0.250', 'weapon4': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '61.000'} [2024-08-06 05:07:15,277][52811] DAMAGECOUNT value on done: 554445.0 [2024-08-06 05:07:15,278][52811] Sum rewards: 72.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.064', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.298', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '60.000'} [2024-08-06 05:07:16,581][52668] DAMAGECOUNT value on done: 594280.0 [2024-08-06 05:07:16,589][52668] Sum rewards: 72.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.904', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.178', 'weapon5': '0.186', 'AMMO4': '0.234', 'AMMO3': '0.241', 'weapon2': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '61.000'} [2024-08-06 05:07:17,682][52662] DAMAGECOUNT value on done: 601315.0 [2024-08-06 05:07:17,694][52662] Sum rewards: 65.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.188', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.080', 'AMMO3': '0.175', 'weapon5': '0.200', 'AMMO4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '53.000'} [2024-08-06 05:07:17,726][52660] DAMAGECOUNT value on done: 599570.0 [2024-08-06 05:07:17,727][52660] Sum rewards: 66.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.232', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.134', 'weapon5': '0.144', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.202', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '56.000'} [2024-08-06 05:07:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 480870400. Throughput: 0: 4362.2. Samples: 120218320. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:17,794][52567] Avg episode reward: [(0, '71.513')] [2024-08-06 05:07:17,968][52650] Updated weights for policy 0, policy_version 58701 (0.0012) [2024-08-06 05:07:18,102][52803] DAMAGECOUNT value on done: 566604.0 [2024-08-06 05:07:18,102][52803] Sum rewards: 65.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.644', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.086', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.616', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.068', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '52.000'} [2024-08-06 05:07:19,506][52668] DAMAGECOUNT value on done: 599535.0 [2024-08-06 05:07:19,506][52668] Sum rewards: 67.495, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.019', 'AMMO2': '0.074', 'weapon4': '0.108', 'AMMO3': '0.205', 'weapon2': '0.228', 'weapon5': '0.252', 'AMMO4': '0.369', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '56.000'} [2024-08-06 05:07:20,240][52670] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:07:20,455][52660] DAMAGECOUNT value on done: 591047.0 [2024-08-06 05:07:20,455][52660] Sum rewards: 63.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.163', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO4': '0.155', 'AMMO3': '0.162', 'weapon2': '0.256', 'weapon4': '0.260', 'WEAPON3': '0.900', 'weapon3': '3.206', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '50.000'} [2024-08-06 05:07:20,734][52662] DAMAGECOUNT value on done: 595064.0 [2024-08-06 05:07:20,735][52662] Sum rewards: 82.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.132', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '67.000'} [2024-08-06 05:07:21,116][52803] DAMAGECOUNT value on done: 553030.0 [2024-08-06 05:07:21,116][52803] Sum rewards: 60.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.598', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.126', 'weapon5': '0.162', 'AMMO4': '0.236', 'AMMO3': '0.287', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.900', 'weapon3': '3.080', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '53.000'} [2024-08-06 05:07:21,810][52668] DAMAGECOUNT value on done: 598533.0 [2024-08-06 05:07:21,845][52668] Sum rewards: 80.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.232', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '64.000'} [2024-08-06 05:07:21,937][52649] Large shaping reward 2.537 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.486, 162.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:07:22,207][52650] Updated weights for policy 0, policy_version 58711 (0.0022) [2024-08-06 05:07:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 480960512. Throughput: 0: 4378.4. Samples: 120244980. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:22,794][52567] Avg episode reward: [(0, '71.311')] [2024-08-06 05:07:22,966][52660] DAMAGECOUNT value on done: 594013.0 [2024-08-06 05:07:22,968][52660] Sum rewards: 73.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.135', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO4': '0.116', 'weapon4': '0.146', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.242', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '59.000'} [2024-08-06 05:07:23,958][52662] DAMAGECOUNT value on done: 607917.0 [2024-08-06 05:07:23,959][52662] Sum rewards: 74.627, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.884', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.132', 'AMMO4': '0.238', 'weapon5': '0.240', 'weapon2': '0.264', 'AMMO3': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.018', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '64.000'} [2024-08-06 05:07:24,364][52803] DAMAGECOUNT value on done: 552019.0 [2024-08-06 05:07:24,366][52803] Sum rewards: 63.496, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.696', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.122', 'AMMO3': '0.170', 'weapon5': '0.226', 'AMMO4': '0.255', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.038', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2024-08-06 05:07:25,964][52660] DAMAGECOUNT value on done: 600657.0 [2024-08-06 05:07:25,964][52660] Sum rewards: 68.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.130', 'AMMO4': '0.135', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '59.000'} [2024-08-06 05:07:26,989][52662] DAMAGECOUNT value on done: 598633.0 [2024-08-06 05:07:26,990][52662] Sum rewards: 62.615, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.215', 'AMMO5': '0.022', 'AMMO2': '0.078', 'weapon4': '0.160', 'AMMO3': '0.249', 'weapon2': '0.268', 'weapon5': '0.320', 'AMMO4': '0.393', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'HITCOUNT': '2.730', 'weapon3': '2.918', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '56.000'} [2024-08-06 05:07:27,059][52650] Updated weights for policy 0, policy_version 58721 (0.0046) [2024-08-06 05:07:27,485][52803] DAMAGECOUNT value on done: 566169.0 [2024-08-06 05:07:27,485][52803] Sum rewards: 67.291, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.442', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '58.000'} [2024-08-06 05:07:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 481050624. Throughput: 0: 4376.9. Samples: 120271140. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:27,794][52567] Avg episode reward: [(0, '70.918')] [2024-08-06 05:07:28,957][52647] DAMAGECOUNT value on done: 630298.0 [2024-08-06 05:07:28,957][52647] Sum rewards: 63.484, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.295', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.096', 'weapon5': '0.108', 'AMMO4': '0.139', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.296', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '51.000'} [2024-08-06 05:07:29,198][52660] DAMAGECOUNT value on done: 591429.0 [2024-08-06 05:07:29,199][52660] Sum rewards: 86.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.138', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '73.000'} [2024-08-06 05:07:29,490][52662] DAMAGECOUNT value on done: 590699.0 [2024-08-06 05:07:29,491][52662] Sum rewards: 74.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.082', 'weapon5': '0.160', 'AMMO3': '0.225', 'AMMO4': '0.272', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '63.000'} [2024-08-06 05:07:30,647][52803] DAMAGECOUNT value on done: 554962.0 [2024-08-06 05:07:30,649][52803] Sum rewards: 73.075, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.276', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.064', 'AMMO3': '0.147', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon3': '3.048', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '57.000'} [2024-08-06 05:07:31,851][52647] DAMAGECOUNT value on done: 625219.0 [2024-08-06 05:07:31,852][52647] Sum rewards: 81.243, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.526', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.126', 'weapon4': '0.132', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '68.000'} [2024-08-06 05:07:31,856][52659] DAMAGECOUNT value on done: 603528.0 [2024-08-06 05:07:31,857][52659] Sum rewards: 74.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.702', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '3.362', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '58.000'} [2024-08-06 05:07:31,857][52662] DAMAGECOUNT value on done: 596476.0 [2024-08-06 05:07:31,859][52662] Sum rewards: 78.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.130', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 05:07:31,922][52650] Updated weights for policy 0, policy_version 58731 (0.0026) [2024-08-06 05:07:32,460][52660] DAMAGECOUNT value on done: 593654.0 [2024-08-06 05:07:32,469][52660] Sum rewards: 81.167, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.423', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.168', 'weapon5': '0.174', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '63.000'} [2024-08-06 05:07:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 481140736. Throughput: 0: 4380.2. Samples: 120284240. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:32,794][52567] Avg episode reward: [(0, '71.283')] [2024-08-06 05:07:33,466][52665] DAMAGECOUNT value on done: 583997.0 [2024-08-06 05:07:33,469][52665] Sum rewards: 73.404, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO3': '0.139', 'weapon5': '0.140', 'AMMO4': '0.169', 'weapon2': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.406', 'WEAPON3': '0.900', 'HITCOUNT': '3.100', 'weapon3': '3.122', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '58.000'} [2024-08-06 05:07:33,773][52803] DAMAGECOUNT value on done: 553407.0 [2024-08-06 05:07:33,776][52803] Sum rewards: 71.671, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.698', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.320', 'WEAPON3': '1.700', 'weapon3': '3.300', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '63.000'} [2024-08-06 05:07:34,376][52647] DAMAGECOUNT value on done: 629725.0 [2024-08-06 05:07:34,377][52647] Sum rewards: 74.576, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.752', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.128', 'weapon5': '0.194', 'AMMO4': '0.238', 'AMMO3': '0.265', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.942', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '64.000'} [2024-08-06 05:07:34,636][52662] DAMAGECOUNT value on done: 590209.0 [2024-08-06 05:07:34,637][52662] Sum rewards: 81.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.206', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '66.000'} [2024-08-06 05:07:34,931][52659] DAMAGECOUNT value on done: 595209.0 [2024-08-06 05:07:34,931][52659] Sum rewards: 74.948, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.281', 'weapon2': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.142', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '65.000'} [2024-08-06 05:07:35,536][52660] DAMAGECOUNT value on done: 604508.0 [2024-08-06 05:07:35,539][52660] Sum rewards: 76.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.066', 'weapon4': '0.158', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.600', 'weapon3': '2.920', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '64.000'} [2024-08-06 05:07:36,447][52650] Updated weights for policy 0, policy_version 58741 (0.0023) [2024-08-06 05:07:36,708][52803] DAMAGECOUNT value on done: 557150.0 [2024-08-06 05:07:36,709][52803] Sum rewards: 69.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.044', 'weapon5': '0.070', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '58.500'} [2024-08-06 05:07:36,843][52665] DAMAGECOUNT value on done: 600316.0 [2024-08-06 05:07:36,844][52665] Sum rewards: 61.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.579', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO3': '0.197', 'AMMO4': '0.234', 'weapon4': '0.378', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.570', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '51.000'} [2024-08-06 05:07:37,208][52647] DAMAGECOUNT value on done: 633435.0 [2024-08-06 05:07:37,208][52647] Sum rewards: 66.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.451', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO4': '0.168', 'AMMO3': '0.181', 'weapon5': '0.240', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.188', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '54.000'} [2024-08-06 05:07:37,596][52659] DAMAGECOUNT value on done: 602389.0 [2024-08-06 05:07:37,596][52659] Sum rewards: 87.214, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.815', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.139', 'weapon2': '0.604', 'WEAPON3': '0.900', 'weapon3': '3.316', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '70.000'} [2024-08-06 05:07:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 481230848. Throughput: 0: 4386.5. Samples: 120310750. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 05:07:37,794][52567] Avg episode reward: [(0, '71.583')] [2024-08-06 05:07:38,289][52660] DAMAGECOUNT value on done: 608999.0 [2024-08-06 05:07:38,290][52660] Sum rewards: 63.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.683', 'AMMO5': '0.022', 'AMMO2': '0.066', 'weapon4': '0.146', 'AMMO3': '0.207', 'weapon5': '0.298', 'AMMO4': '0.328', 'weapon2': '0.402', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '52.000'} [2024-08-06 05:07:39,646][52803] DAMAGECOUNT value on done: 560777.0 [2024-08-06 05:07:39,649][52803] Sum rewards: 85.140, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.552', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.193', 'weapon5': '0.216', 'weapon2': '0.232', 'AMMO3': '0.277', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.156', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.003', 'FRAGCOUNT': '71.000'} [2024-08-06 05:07:39,778][52647] DAMAGECOUNT value on done: 639662.0 [2024-08-06 05:07:39,779][52647] Sum rewards: 81.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.812', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.072', 'weapon4': '0.084', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '67.000'} [2024-08-06 05:07:39,991][52665] DAMAGECOUNT value on done: 596284.0 [2024-08-06 05:07:39,994][52665] Sum rewards: 81.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.316', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.122', 'weapon4': '0.138', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '66.000'} [2024-08-06 05:07:40,645][52659] DAMAGECOUNT value on done: 596098.0 [2024-08-06 05:07:40,647][52659] Sum rewards: 57.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.232', 'weapon2': '0.338', 'WEAPON3': '1.300', 'HITCOUNT': '2.870', 'weapon3': '3.338', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '48.000'} [2024-08-06 05:07:41,130][52650] Updated weights for policy 0, policy_version 58751 (0.0020) [2024-08-06 05:07:41,247][52660] DAMAGECOUNT value on done: 590987.0 [2024-08-06 05:07:41,247][52660] Sum rewards: 69.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.195', 'AMMO5': '0.028', 'AMMO2': '0.082', 'AMMO3': '0.217', 'weapon2': '0.222', 'weapon5': '0.348', 'AMMO4': '0.409', 'weapon4': '0.700', 'WEAPON5': '0.750', 'WEAPON4': '0.900', 'WEAPON3': '1.250', 'weapon3': '2.386', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '56.000'} [2024-08-06 05:07:42,688][52647] DAMAGECOUNT value on done: 635800.0 [2024-08-06 05:07:42,703][52647] Sum rewards: 71.231, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.675', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.126', 'AMMO3': '0.132', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.878', 'WEAPON3': '0.900', 'weapon3': '2.690', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '57.000'} [2024-08-06 05:07:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 481312768. Throughput: 0: 4389.1. Samples: 120336970. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:07:42,794][52567] Avg episode reward: [(0, '71.402')] [2024-08-06 05:07:43,021][52803] DAMAGECOUNT value on done: 563862.0 [2024-08-06 05:07:43,022][52803] Sum rewards: 79.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.535', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.100', 'AMMO3': '0.167', 'weapon5': '0.178', 'AMMO4': '0.264', 'weapon2': '0.488', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 05:07:43,124][52665] DAMAGECOUNT value on done: 588839.0 [2024-08-06 05:07:43,124][52665] Sum rewards: 74.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.555', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO4': '0.194', 'AMMO3': '0.211', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '61.000'} [2024-08-06 05:07:43,845][52660] DAMAGECOUNT value on done: 599926.0 [2024-08-06 05:07:43,847][52660] Sum rewards: 79.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.055', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.136', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.221', 'WEAPON3': '1.300', 'weapon3': '3.456', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '65.000'} [2024-08-06 05:07:43,930][52659] DAMAGECOUNT value on done: 592999.0 [2024-08-06 05:07:43,933][52659] Sum rewards: 79.860, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.732', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.056', 'AMMO4': '0.142', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '66.000'} [2024-08-06 05:07:45,223][52647] DAMAGECOUNT value on done: 629033.0 [2024-08-06 05:07:45,233][52647] Sum rewards: 53.382, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.210', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.148', 'weapon7': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.406', 'weapon2': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '2.510', 'weapon3': '2.614', 'DAMAGECOUNT': '13.020', 'FRAGCOUNT': '44.000'} [2024-08-06 05:07:45,799][52650] Updated weights for policy 0, policy_version 58761 (0.0010) [2024-08-06 05:07:46,065][52803] DAMAGECOUNT value on done: 551612.0 [2024-08-06 05:07:46,067][52803] Sum rewards: 64.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '53.000'} [2024-08-06 05:07:46,347][52665] DAMAGECOUNT value on done: 579244.0 [2024-08-06 05:07:46,348][52665] Sum rewards: 81.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.699', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.046', 'AMMO4': '0.139', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.306', 'WEAPON3': '0.950', 'weapon3': '3.288', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '65.000'} [2024-08-06 05:07:46,935][52659] DAMAGECOUNT value on done: 599350.0 [2024-08-06 05:07:46,940][52659] Sum rewards: 80.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.656', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.118', 'weapon5': '0.160', 'weapon2': '0.162', 'AMMO3': '0.195', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '68.000'} [2024-08-06 05:07:47,057][52660] DAMAGECOUNT value on done: 594843.0 [2024-08-06 05:07:47,057][52660] Sum rewards: 75.528, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.006', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.118', 'AMMO4': '0.208', 'weapon5': '0.226', 'AMMO3': '0.251', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '64.000'} [2024-08-06 05:07:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 481402880. Throughput: 0: 4388.9. Samples: 120350180. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:07:47,794][52567] Avg episode reward: [(0, '71.710')] [2024-08-06 05:07:48,005][52647] DAMAGECOUNT value on done: 619175.0 [2024-08-06 05:07:48,006][52647] Sum rewards: 92.214, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.772', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.120', 'AMMO4': '0.128', 'weapon2': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.464', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '22.179', 'FRAGCOUNT': '76.000'} [2024-08-06 05:07:48,890][52794] DAMAGECOUNT value on done: 599561.0 [2024-08-06 05:07:48,894][52794] Sum rewards: 72.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.193', 'weapon4': '0.254', 'weapon5': '0.254', 'AMMO4': '0.277', 'weapon2': '0.360', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '60.000'} [2024-08-06 05:07:49,077][52665] DAMAGECOUNT value on done: 585174.0 [2024-08-06 05:07:49,079][52665] Sum rewards: 66.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.440', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '56.000'} [2024-08-06 05:07:49,883][52659] DAMAGECOUNT value on done: 596105.0 [2024-08-06 05:07:49,884][52659] Sum rewards: 78.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.355', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.086', 'weapon4': '0.088', 'AMMO4': '0.176', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '66.000'} [2024-08-06 05:07:50,158][52660] DAMAGECOUNT value on done: 592904.0 [2024-08-06 05:07:50,159][52660] Sum rewards: 79.021, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.166', 'weapon4': '0.226', 'AMMO4': '0.246', 'weapon2': '0.266', 'AMMO3': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.996', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '67.000'} [2024-08-06 05:07:50,507][52647] DAMAGECOUNT value on done: 631384.0 [2024-08-06 05:07:50,507][52647] Sum rewards: 71.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.458', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.142', 'AMMO3': '0.184', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '58.000'} [2024-08-06 05:07:50,513][52650] Updated weights for policy 0, policy_version 58771 (0.0011) [2024-08-06 05:07:51,952][52794] DAMAGECOUNT value on done: 604623.0 [2024-08-06 05:07:51,952][52794] Sum rewards: 77.203, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.195', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.100', 'weapon5': '0.162', 'AMMO4': '0.173', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '0.750', 'weapon3': '2.696', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '60.000'} [2024-08-06 05:07:52,110][52665] DAMAGECOUNT value on done: 591796.0 [2024-08-06 05:07:52,111][52665] Sum rewards: 76.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.794', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.082', 'AMMO4': '0.147', 'weapon5': '0.166', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.500', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.000'} [2024-08-06 05:07:52,518][52659] DAMAGECOUNT value on done: 593877.0 [2024-08-06 05:07:52,519][52659] Sum rewards: 68.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.177', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.736', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '55.000'} [2024-08-06 05:07:52,761][52647] DAMAGECOUNT value on done: 627399.0 [2024-08-06 05:07:52,762][52647] Sum rewards: 77.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.222', 'weapon2': '0.686', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '63.000'} [2024-08-06 05:07:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 481492992. Throughput: 0: 4384.0. Samples: 120376490. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:07:52,795][52567] Avg episode reward: [(0, '71.817')] [2024-08-06 05:07:53,253][52660] DAMAGECOUNT value on done: 585804.0 [2024-08-06 05:07:53,253][52660] Sum rewards: 60.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '52.000'} [2024-08-06 05:07:54,425][52794] DAMAGECOUNT value on done: 603157.0 [2024-08-06 05:07:54,427][52794] Sum rewards: 68.791, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.036', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.207', 'weapon5': '0.232', 'AMMO3': '0.279', 'weapon4': '0.334', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.708', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '59.000'} [2024-08-06 05:07:54,881][52665] DAMAGECOUNT value on done: 589503.0 [2024-08-06 05:07:54,883][52665] Sum rewards: 77.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.795', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.214', 'weapon2': '0.248', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '64.000'} [2024-08-06 05:07:55,026][52650] Updated weights for policy 0, policy_version 58781 (0.0015) [2024-08-06 05:07:55,382][52659] DAMAGECOUNT value on done: 601175.0 [2024-08-06 05:07:55,383][52659] Sum rewards: 83.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.969', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.128', 'weapon4': '0.144', 'AMMO4': '0.164', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '68.000'} [2024-08-06 05:07:55,564][52647] DAMAGECOUNT value on done: 626998.0 [2024-08-06 05:07:55,572][52647] Sum rewards: 73.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.112', 'weapon2': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.536', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '62.000'} [2024-08-06 05:07:57,334][52794] DAMAGECOUNT value on done: 593401.0 [2024-08-06 05:07:57,336][52794] Sum rewards: 76.233, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'weapon4': '0.060', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '62.000'} [2024-08-06 05:07:57,612][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:07:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 481574912. Throughput: 0: 4396.9. Samples: 120403150. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:07:57,795][52567] Avg episode reward: [(0, '72.320')] [2024-08-06 05:07:57,941][52665] DAMAGECOUNT value on done: 597217.0 [2024-08-06 05:07:57,942][52665] Sum rewards: 75.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.102', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '63.000'} [2024-08-06 05:07:57,983][52659] DAMAGECOUNT value on done: 604141.0 [2024-08-06 05:07:57,984][52659] Sum rewards: 84.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.087', 'weapon5': '0.118', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '69.000'} [2024-08-06 05:07:58,081][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:07:58,268][52647] DAMAGECOUNT value on done: 621797.0 [2024-08-06 05:07:58,269][52647] Sum rewards: 64.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.615', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.090', 'weapon5': '0.206', 'AMMO4': '0.221', 'AMMO3': '0.281', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.040', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '55.500'} [2024-08-06 05:07:59,698][52650] Updated weights for policy 0, policy_version 58791 (0.0019) [2024-08-06 05:08:00,233][52794] DAMAGECOUNT value on done: 593447.0 [2024-08-06 05:08:00,233][52794] Sum rewards: 65.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.141', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.112', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '57.000'} [2024-08-06 05:08:00,852][52659] DAMAGECOUNT value on done: 591661.0 [2024-08-06 05:08:00,853][52659] Sum rewards: 69.471, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO4': '0.218', 'weapon4': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.600', 'weapon3': '2.924', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '59.000'} [2024-08-06 05:08:00,865][52647] DAMAGECOUNT value on done: 635453.0 [2024-08-06 05:08:00,866][52647] Sum rewards: 69.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.092', 'weapon5': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:01,137][52665] DAMAGECOUNT value on done: 588384.0 [2024-08-06 05:08:01,138][52665] Sum rewards: 61.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.842', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.178', 'weapon2': '0.198', 'AMMO4': '0.220', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.280', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '52.000'} [2024-08-06 05:08:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 481665024. Throughput: 0: 4394.4. Samples: 120416070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:08:02,794][52567] Avg episode reward: [(0, '72.344')] [2024-08-06 05:08:03,222][52647] DAMAGECOUNT value on done: 625504.0 [2024-08-06 05:08:03,222][52647] Sum rewards: 76.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.052', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.186', 'weapon4': '0.210', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '2.720', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:03,325][52659] DAMAGECOUNT value on done: 602566.0 [2024-08-06 05:08:03,327][52659] Sum rewards: 81.988, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.945', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO4': '0.148', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '70.000'} [2024-08-06 05:08:03,345][52794] DAMAGECOUNT value on done: 597370.0 [2024-08-06 05:08:03,345][52794] Sum rewards: 79.063, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'HEALTH': '0.007', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.314', 'WEAPON3': '0.950', 'weapon3': '3.468', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '63.000'} [2024-08-06 05:08:04,344][52665] DAMAGECOUNT value on done: 599893.0 [2024-08-06 05:08:04,346][52665] Sum rewards: 69.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.104', 'weapon5': '0.178', 'AMMO3': '0.188', 'weapon2': '0.204', 'AMMO4': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.218', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2024-08-06 05:08:04,502][52650] Updated weights for policy 0, policy_version 58801 (0.0043) [2024-08-06 05:08:05,944][52647] DAMAGECOUNT value on done: 633528.0 [2024-08-06 05:08:05,954][52647] Sum rewards: 79.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.488', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.180', 'weapon5': '0.188', 'weapon2': '0.228', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.090', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '68.000'} [2024-08-06 05:08:06,070][52659] DAMAGECOUNT value on done: 591054.0 [2024-08-06 05:08:06,072][52659] Sum rewards: 78.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.559', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO3': '0.188', 'AMMO4': '0.195', 'weapon5': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:06,094][52794] DAMAGECOUNT value on done: 602181.0 [2024-08-06 05:08:06,095][52794] Sum rewards: 69.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon2': '0.172', 'AMMO3': '0.200', 'AMMO4': '0.207', 'weapon5': '0.224', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '57.000'} [2024-08-06 05:08:07,240][52665] DAMAGECOUNT value on done: 594792.0 [2024-08-06 05:08:07,240][52665] Sum rewards: 73.437, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.088', 'weapon4': '0.130', 'AMMO4': '0.137', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '0.950', 'weapon3': '3.108', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:07,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 481755136. Throughput: 0: 4385.5. Samples: 120442330. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:08:07,794][52567] Avg episode reward: [(0, '73.172')] [2024-08-06 05:08:08,587][52659] DAMAGECOUNT value on done: 594441.0 [2024-08-06 05:08:08,588][52659] Sum rewards: 62.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.228', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.132', 'weapon4': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.232', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '54.000'} [2024-08-06 05:08:08,708][52647] DAMAGECOUNT value on done: 633563.0 [2024-08-06 05:08:08,708][52647] Sum rewards: 82.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '69.000'} [2024-08-06 05:08:09,324][52650] Updated weights for policy 0, policy_version 58811 (0.0033) [2024-08-06 05:08:09,402][52794] DAMAGECOUNT value on done: 590456.0 [2024-08-06 05:08:09,403][52794] Sum rewards: 71.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.470', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:10,205][52665] DAMAGECOUNT value on done: 592350.0 [2024-08-06 05:08:10,206][52665] Sum rewards: 54.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon5': '0.128', 'weapon4': '0.160', 'AMMO3': '0.220', 'AMMO4': '0.297', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.108', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '46.000'} [2024-08-06 05:08:11,177][52647] DAMAGECOUNT value on done: 617933.0 [2024-08-06 05:08:11,185][52647] Sum rewards: 87.825, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.734', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.036', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon2': '0.302', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.225', 'FRAGCOUNT': '74.000'} [2024-08-06 05:08:11,672][52659] DAMAGECOUNT value on done: 609148.0 [2024-08-06 05:08:11,672][52659] Sum rewards: 77.691, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.786', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:12,511][52794] DAMAGECOUNT value on done: 602327.0 [2024-08-06 05:08:12,513][52794] Sum rewards: 85.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.047', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.222', 'WEAPON3': '1.450', 'weapon3': '3.546', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.024', 'FRAGCOUNT': '70.500'} [2024-08-06 05:08:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 481837056. Throughput: 0: 4382.7. Samples: 120468360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:08:12,795][52567] Avg episode reward: [(0, '73.375')] [2024-08-06 05:08:13,165][52665] DAMAGECOUNT value on done: 591112.0 [2024-08-06 05:08:13,166][52665] Sum rewards: 87.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.042', 'AMMO4': '0.101', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '71.000'} [2024-08-06 05:08:13,512][52650] Updated weights for policy 0, policy_version 58821 (0.0019) [2024-08-06 05:08:13,796][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:08:13,870][52647] DAMAGECOUNT value on done: 625610.0 [2024-08-06 05:08:13,871][52647] Sum rewards: 69.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon4': '0.178', 'AMMO3': '0.224', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:14,162][52659] DAMAGECOUNT value on done: 599335.0 [2024-08-06 05:08:14,166][52659] Sum rewards: 87.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.564', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.144', 'AMMO3': '0.199', 'weapon2': '0.256', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '20.925', 'FRAGCOUNT': '71.000'} [2024-08-06 05:08:15,519][52794] DAMAGECOUNT value on done: 594619.0 [2024-08-06 05:08:15,520][52794] Sum rewards: 69.306, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.674', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.162', 'weapon5': '0.172', 'AMMO3': '0.207', 'AMMO4': '0.212', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.074', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '60.000'} [2024-08-06 05:08:15,623][52665] DAMAGECOUNT value on done: 589291.0 [2024-08-06 05:08:15,624][52665] Sum rewards: 70.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.640', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.116', 'weapon5': '0.186', 'AMMO3': '0.226', 'AMMO4': '0.259', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '59.000'} [2024-08-06 05:08:16,627][52659] DAMAGECOUNT value on done: 606050.0 [2024-08-06 05:08:16,629][52659] Sum rewards: 72.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.012', 'weapon5': '0.028', 'AMMO2': '0.039', 'weapon4': '0.154', 'AMMO4': '0.196', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:16,720][52667] DAMAGECOUNT value on done: 599637.0 [2024-08-06 05:08:16,720][52667] Sum rewards: 64.008, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.316', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.180', 'AMMO4': '0.196', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '54.000'} [2024-08-06 05:08:17,005][52647] DAMAGECOUNT value on done: 617045.0 [2024-08-06 05:08:17,005][52647] Sum rewards: 62.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.069', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO4': '0.171', 'weapon2': '0.212', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.438', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.500'} [2024-08-06 05:08:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 481927168. Throughput: 0: 4378.7. Samples: 120481280. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-06 05:08:17,794][52567] Avg episode reward: [(0, '73.444')] [2024-08-06 05:08:18,058][52665] DAMAGECOUNT value on done: 588273.0 [2024-08-06 05:08:18,058][52665] Sum rewards: 75.333, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.248', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.072', 'weapon4': '0.090', 'AMMO3': '0.235', 'AMMO4': '0.243', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '64.500'} [2024-08-06 05:08:18,444][52650] Updated weights for policy 0, policy_version 58831 (0.0011) [2024-08-06 05:08:18,607][52794] DAMAGECOUNT value on done: 593795.0 [2024-08-06 05:08:18,610][52794] Sum rewards: 78.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.334', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '64.500'} [2024-08-06 05:08:19,491][52659] DAMAGECOUNT value on done: 596268.0 [2024-08-06 05:08:19,493][52659] Sum rewards: 70.267, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.044', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.206', 'weapon2': '0.322', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.364', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:19,541][52667] DAMAGECOUNT value on done: 605718.0 [2024-08-06 05:08:19,542][52667] Sum rewards: 66.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.094', 'AMMO4': '0.097', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon2': '0.206', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.342', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '57.000'} [2024-08-06 05:08:20,040][52647] DAMAGECOUNT value on done: 621848.0 [2024-08-06 05:08:20,041][52647] Sum rewards: 66.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.478', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.156', 'AMMO3': '0.192', 'weapon5': '0.212', 'AMMO4': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '57.000'} [2024-08-06 05:08:20,746][52665] DAMAGECOUNT value on done: 591491.0 [2024-08-06 05:08:20,747][52665] Sum rewards: 80.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.685', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.070', 'AMMO4': '0.086', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '68.000'} [2024-08-06 05:08:21,760][52660] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:08:22,071][52794] DAMAGECOUNT value on done: 597877.0 [2024-08-06 05:08:22,072][52794] Sum rewards: 83.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '68.000'} [2024-08-06 05:08:22,325][52667] DAMAGECOUNT value on done: 601550.0 [2024-08-06 05:08:22,328][52667] Sum rewards: 78.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.486', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.179', 'weapon4': '0.180', 'weapon5': '0.214', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:22,531][52659] DAMAGECOUNT value on done: 603065.0 [2024-08-06 05:08:22,532][52659] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.826', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.104', 'weapon5': '0.230', 'AMMO3': '0.237', 'weapon2': '0.272', 'AMMO4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:22,795][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 482017280. Throughput: 0: 4379.1. Samples: 120507810. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-06 05:08:22,795][52567] Avg episode reward: [(0, '73.703')] [2024-08-06 05:08:23,584][52650] Updated weights for policy 0, policy_version 58841 (0.0014) [2024-08-06 05:08:23,721][52665] DAMAGECOUNT value on done: 586465.0 [2024-08-06 05:08:23,724][52665] Sum rewards: 59.032, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.588', 'AMMO5': '0.018', 'AMMO2': '0.023', 'weapon4': '0.068', 'AMMO4': '0.116', 'weapon5': '0.168', 'WEAPON4': '0.250', 'AMMO3': '0.329', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.900', 'weapon3': '2.906', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '54.000'} [2024-08-06 05:08:24,601][52794] DAMAGECOUNT value on done: 591919.0 [2024-08-06 05:08:24,601][52794] Sum rewards: 70.049, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.814', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.056', 'weapon5': '0.128', 'AMMO4': '0.178', 'AMMO3': '0.197', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.294', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:24,966][52659] DAMAGECOUNT value on done: 597214.0 [2024-08-06 05:08:24,967][52659] Sum rewards: 77.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.230', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.036', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'AMMO4': '0.181', 'weapon2': '0.372', 'WEAPON3': '0.950', 'HITCOUNT': '3.370', 'weapon3': '3.372', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:25,391][52667] DAMAGECOUNT value on done: 601834.0 [2024-08-06 05:08:25,394][52667] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.123', 'AMMO3': '0.188', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.454', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '55.000'} [2024-08-06 05:08:25,806][52663] DAMAGECOUNT value on done: 607036.0 [2024-08-06 05:08:25,806][52663] Sum rewards: 75.422, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.984', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.750', 'weapon3': '3.042', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '68.000'} [2024-08-06 05:08:25,939][52794] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:08:26,903][52665] DAMAGECOUNT value on done: 587031.0 [2024-08-06 05:08:26,904][52665] Sum rewards: 64.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.105', 'AMMO5': '0.005', 'AMMO2': '0.051', 'weapon4': '0.066', 'weapon5': '0.096', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.254', 'weapon2': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.290', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '54.000'} [2024-08-06 05:08:26,965][52794] DAMAGECOUNT value on done: 611619.0 [2024-08-06 05:08:26,966][52794] Sum rewards: 74.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.154', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.082', 'AMMO4': '0.152', 'weapon5': '0.162', 'AMMO3': '0.189', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '60.000'} [2024-08-06 05:08:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 482099200. Throughput: 0: 4372.0. Samples: 120533710. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-06 05:08:27,794][52567] Avg episode reward: [(0, '73.539')] [2024-08-06 05:08:27,884][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058851_482107392.pth... [2024-08-06 05:08:27,910][52650] Updated weights for policy 0, policy_version 58851 (0.0020) [2024-08-06 05:08:28,038][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058339_477913088.pth [2024-08-06 05:08:28,063][52667] DAMAGECOUNT value on done: 606319.0 [2024-08-06 05:08:28,064][52667] Sum rewards: 78.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:28,719][52663] DAMAGECOUNT value on done: 597257.0 [2024-08-06 05:08:28,719][52663] Sum rewards: 77.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.076', 'weapon5': '0.090', 'weapon2': '0.198', 'AMMO3': '0.206', 'AMMO4': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '64.500'} [2024-08-06 05:08:29,526][52665] DAMAGECOUNT value on done: 590514.0 [2024-08-06 05:08:29,526][52665] Sum rewards: 73.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.222', 'weapon4': '0.232', 'weapon2': '0.252', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:30,217][52794] DAMAGECOUNT value on done: 591091.0 [2024-08-06 05:08:30,218][52794] Sum rewards: 72.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.328', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.180', 'weapon4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:31,522][52667] DAMAGECOUNT value on done: 609048.0 [2024-08-06 05:08:31,522][52667] Sum rewards: 82.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.082', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.236', 'weapon2': '0.250', 'weapon4': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '69.000'} [2024-08-06 05:08:31,692][52663] DAMAGECOUNT value on done: 587272.0 [2024-08-06 05:08:31,703][52663] Sum rewards: 64.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.082', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.104', 'AMMO3': '0.212', 'AMMO4': '0.228', 'weapon5': '0.240', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.038', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '55.000'} [2024-08-06 05:08:32,670][52650] Updated weights for policy 0, policy_version 58861 (0.0018) [2024-08-06 05:08:32,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 482189312. Throughput: 0: 4366.2. Samples: 120546660. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-06 05:08:32,795][52567] Avg episode reward: [(0, '73.911')] [2024-08-06 05:08:33,271][52794] DAMAGECOUNT value on done: 605490.0 [2024-08-06 05:08:33,272][52794] Sum rewards: 74.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.718', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '61.000'} [2024-08-06 05:08:34,330][52667] DAMAGECOUNT value on done: 602991.0 [2024-08-06 05:08:34,330][52667] Sum rewards: 68.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.167', 'weapon5': '0.212', 'AMMO4': '0.319', 'weapon4': '0.458', 'weapon2': '0.474', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.568', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '55.000'} [2024-08-06 05:08:34,363][52663] DAMAGECOUNT value on done: 595160.0 [2024-08-06 05:08:34,365][52663] Sum rewards: 86.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.088', 'weapon5': '0.172', 'AMMO4': '0.202', 'AMMO3': '0.246', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '73.000'} [2024-08-06 05:08:36,403][52794] DAMAGECOUNT value on done: 599034.0 [2024-08-06 05:08:36,407][52794] Sum rewards: 79.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.186', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.082', 'AMMO3': '0.193', 'weapon5': '0.198', 'AMMO4': '0.237', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '66.000'} [2024-08-06 05:08:36,910][52663] DAMAGECOUNT value on done: 599176.0 [2024-08-06 05:08:36,912][52663] Sum rewards: 63.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.246', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.092', 'weapon5': '0.170', 'AMMO3': '0.232', 'AMMO4': '0.257', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '56.000'} [2024-08-06 05:08:37,151][52650] Updated weights for policy 0, policy_version 58871 (0.0018) [2024-08-06 05:08:37,237][52667] DAMAGECOUNT value on done: 597549.0 [2024-08-06 05:08:37,237][52667] Sum rewards: 75.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.034', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '63.000'} [2024-08-06 05:08:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.6). Total num frames: 482271232. Throughput: 0: 4372.0. Samples: 120573230. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-06 05:08:37,794][52567] Avg episode reward: [(0, '73.747')] [2024-08-06 05:08:38,849][52664] DAMAGECOUNT value on done: 619386.0 [2024-08-06 05:08:38,849][52664] Sum rewards: 76.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.450', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.180', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:39,247][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:08:39,366][52794] DAMAGECOUNT value on done: 605449.0 [2024-08-06 05:08:39,368][52794] Sum rewards: 73.373, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'HEALTH': '0.020', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.127', 'weapon5': '0.130', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.298', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '59.500'} [2024-08-06 05:08:39,616][52663] DAMAGECOUNT value on done: 606186.0 [2024-08-06 05:08:39,616][52663] Sum rewards: 73.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '61.000'} [2024-08-06 05:08:39,618][52666] DAMAGECOUNT value on done: 599132.0 [2024-08-06 05:08:39,618][52666] Sum rewards: 67.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.475', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.132', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '57.000'} [2024-08-06 05:08:39,711][52667] DAMAGECOUNT value on done: 604139.0 [2024-08-06 05:08:39,713][52667] Sum rewards: 73.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.105', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.000'} [2024-08-06 05:08:41,073][52670] DAMAGECOUNT value on done: 588281.0 [2024-08-06 05:08:41,073][52670] Sum rewards: 60.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.110', 'weapon5': '0.126', 'weapon2': '0.174', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.110', 'weapon3': '3.328', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '54.000'} [2024-08-06 05:08:41,958][52650] Updated weights for policy 0, policy_version 58881 (0.0045) [2024-08-06 05:08:42,008][52664] DAMAGECOUNT value on done: 624025.0 [2024-08-06 05:08:42,008][52664] Sum rewards: 62.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.654', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.070', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '3.412', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '53.000'} [2024-08-06 05:08:42,104][52794] DAMAGECOUNT value on done: 606695.0 [2024-08-06 05:08:42,104][52794] Sum rewards: 78.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO4': '0.186', 'weapon4': '0.228', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '67.000'} [2024-08-06 05:08:42,374][52666] DAMAGECOUNT value on done: 601353.0 [2024-08-06 05:08:42,376][52666] Sum rewards: 80.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.752', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.046', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.158', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:42,417][52663] DAMAGECOUNT value on done: 597749.0 [2024-08-06 05:08:42,417][52663] Sum rewards: 64.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.026', 'weapon5': '0.090', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.268', 'WEAPON3': '1.450', 'HITCOUNT': '3.360', 'weapon3': '3.410', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '53.000'} [2024-08-06 05:08:42,674][52795] DAMAGECOUNT value on done: 556715.0 [2024-08-06 05:08:42,674][52795] Sum rewards: 91.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.982', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.152', 'weapon2': '0.216', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.852', 'FRAGCOUNT': '75.000'} [2024-08-06 05:08:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 482361344. Throughput: 0: 4359.6. Samples: 120599330. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-06 05:08:42,794][52567] Avg episode reward: [(0, '73.757')] [2024-08-06 05:08:43,061][52667] DAMAGECOUNT value on done: 606058.0 [2024-08-06 05:08:43,062][52667] Sum rewards: 74.359, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.307', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.044', 'AMMO4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '58.500'} [2024-08-06 05:08:43,605][52670] DAMAGECOUNT value on done: 598377.0 [2024-08-06 05:08:43,605][52670] Sum rewards: 77.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.528', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.450', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '63.000'} [2024-08-06 05:08:45,046][52664] DAMAGECOUNT value on done: 623453.0 [2024-08-06 05:08:45,047][52664] Sum rewards: 81.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.522', 'AMMO5': '0.005', 'weapon4': '0.044', 'AMMO2': '0.047', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.236', 'AMMO3': '0.241', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '69.000'} [2024-08-06 05:08:45,154][52666] DAMAGECOUNT value on done: 601293.0 [2024-08-06 05:08:45,154][52666] Sum rewards: 66.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.334', 'AMMO5': '0.031', 'AMMO2': '0.061', 'weapon5': '0.166', 'AMMO3': '0.212', 'weapon4': '0.256', 'AMMO4': '0.306', 'weapon2': '0.500', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '57.000'} [2024-08-06 05:08:45,248][52663] DAMAGECOUNT value on done: 592914.0 [2024-08-06 05:08:45,249][52663] Sum rewards: 53.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.708', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.226', 'AMMO4': '0.284', 'weapon5': '0.350', 'weapon4': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon2': '0.674', 'WEAPON3': '1.350', 'weapon3': '2.212', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '47.000'} [2024-08-06 05:08:45,518][52667] DAMAGECOUNT value on done: 594641.0 [2024-08-06 05:08:45,520][52667] Sum rewards: 73.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.141', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:45,566][52794] DAMAGECOUNT value on done: 596994.0 [2024-08-06 05:08:45,567][52794] Sum rewards: 73.351, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.820', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.144', 'weapon5': '0.158', 'weapon2': '0.228', 'AMMO4': '0.232', 'AMMO3': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 05:08:45,763][52795] DAMAGECOUNT value on done: 545545.0 [2024-08-06 05:08:45,763][52795] Sum rewards: 81.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.851', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.054', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.510', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '67.000'} [2024-08-06 05:08:46,567][52650] Updated weights for policy 0, policy_version 58891 (0.0012) [2024-08-06 05:08:46,688][52670] DAMAGECOUNT value on done: 590373.0 [2024-08-06 05:08:46,689][52670] Sum rewards: 75.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.466', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.078', 'weapon5': '0.152', 'AMMO3': '0.210', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 482451456. Throughput: 0: 4368.7. Samples: 120612660. Policy #0 lag: (min: 0.0, avg: 2.6, max: 8.0) [2024-08-06 05:08:47,794][52567] Avg episode reward: [(0, '73.535')] [2024-08-06 05:08:47,876][52663] DAMAGECOUNT value on done: 589867.0 [2024-08-06 05:08:47,877][52663] Sum rewards: 71.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.194', 'weapon2': '0.232', 'weapon4': '0.234', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '60.000'} [2024-08-06 05:08:48,160][52664] DAMAGECOUNT value on done: 616846.0 [2024-08-06 05:08:48,160][52664] Sum rewards: 75.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.418', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon2': '0.172', 'AMMO3': '0.177', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '61.000'} [2024-08-06 05:08:48,189][52666] DAMAGECOUNT value on done: 600809.0 [2024-08-06 05:08:48,189][52666] Sum rewards: 74.080, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.112', 'weapon4': '0.122', 'AMMO4': '0.192', 'AMMO3': '0.221', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '63.000'} [2024-08-06 05:08:48,458][52667] DAMAGECOUNT value on done: 598359.0 [2024-08-06 05:08:48,459][52667] Sum rewards: 76.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.196', 'weapon2': '0.398', 'weapon4': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:48,971][52795] DAMAGECOUNT value on done: 543866.0 [2024-08-06 05:08:48,971][52795] Sum rewards: 60.849, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.285', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.178', 'weapon5': '0.184', 'AMMO4': '0.198', 'weapon2': '0.216', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '51.500'} [2024-08-06 05:08:49,776][52670] DAMAGECOUNT value on done: 587720.0 [2024-08-06 05:08:49,776][52670] Sum rewards: 72.856, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.057', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.272', 'weapon4': '0.276', 'AMMO4': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.204', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:50,176][52671] Large shaping reward 2.597 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('HEALTH', -0.024, -8.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:08:50,447][52663] DAMAGECOUNT value on done: 597161.0 [2024-08-06 05:08:50,449][52663] Sum rewards: 74.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.495', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.136', 'weapon4': '0.164', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:51,082][52664] DAMAGECOUNT value on done: 623482.0 [2024-08-06 05:08:51,086][52664] Sum rewards: 77.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.445', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO4': '0.171', 'AMMO3': '0.214', 'weapon5': '0.238', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '64.000'} [2024-08-06 05:08:51,386][52666] DAMAGECOUNT value on done: 594631.0 [2024-08-06 05:08:51,389][52666] Sum rewards: 70.813, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.048', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'HEALTH': '0.320', 'weapon2': '0.334', 'WEAPON3': '1.150', 'HITCOUNT': '3.340', 'weapon3': '3.350', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:51,579][52650] Updated weights for policy 0, policy_version 58901 (0.0013) [2024-08-06 05:08:51,701][52667] DAMAGECOUNT value on done: 604135.0 [2024-08-06 05:08:51,704][52667] Sum rewards: 74.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.188', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.140', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:52,242][52795] DAMAGECOUNT value on done: 552026.0 [2024-08-06 05:08:52,242][52795] Sum rewards: 67.988, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.366', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.078', 'weapon4': '0.088', 'weapon2': '0.204', 'AMMO3': '0.298', 'WEAPON3': '1.750', 'weapon3': '3.436', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '60.000'} [2024-08-06 05:08:52,795][52567] Fps is (10 sec: 18020.8, 60 sec: 17476.1, 300 sec: 17494.7). Total num frames: 482541568. Throughput: 0: 4365.5. Samples: 120638780. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:08:52,795][52567] Avg episode reward: [(0, '73.274')] [2024-08-06 05:08:52,938][52670] DAMAGECOUNT value on done: 602966.0 [2024-08-06 05:08:52,939][52670] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.226', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.042', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.285', 'weapon2': '0.490', 'WEAPON3': '1.650', 'weapon3': '3.184', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.000'} [2024-08-06 05:08:53,045][52663] DAMAGECOUNT value on done: 606322.0 [2024-08-06 05:08:53,046][52663] Sum rewards: 71.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.512', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.094', 'AMMO4': '0.163', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '59.000'} [2024-08-06 05:08:54,130][52664] DAMAGECOUNT value on done: 620203.0 [2024-08-06 05:08:54,132][52664] Sum rewards: 64.916, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.870', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.170', 'AMMO3': '0.180', 'weapon4': '0.184', 'AMMO4': '0.313', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '2.722', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.000'} [2024-08-06 05:08:54,313][52666] DAMAGECOUNT value on done: 591306.0 [2024-08-06 05:08:54,316][52666] Sum rewards: 73.365, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.141', 'AMMO3': '0.155', 'weapon5': '0.168', 'HEALTH': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.572', 'WEAPON3': '0.900', 'weapon3': '2.960', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '56.000'} [2024-08-06 05:08:54,554][52667] DAMAGECOUNT value on done: 594734.0 [2024-08-06 05:08:54,555][52667] Sum rewards: 77.020, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.072', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.293', 'WEAPON3': '1.700', 'weapon3': '3.364', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '66.000'} [2024-08-06 05:08:55,435][52795] DAMAGECOUNT value on done: 549627.0 [2024-08-06 05:08:55,436][52795] Sum rewards: 91.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.245', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.099', 'FRAGCOUNT': '75.000'} [2024-08-06 05:08:55,727][52670] DAMAGECOUNT value on done: 596404.0 [2024-08-06 05:08:55,735][52670] Sum rewards: 70.995, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.275', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '62.000'} [2024-08-06 05:08:55,995][52663] DAMAGECOUNT value on done: 593023.0 [2024-08-06 05:08:55,995][52663] Sum rewards: 87.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon4': '0.242', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.931', 'FRAGCOUNT': '72.000'} [2024-08-06 05:08:56,193][52650] Updated weights for policy 0, policy_version 58911 (0.0017) [2024-08-06 05:08:56,233][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:08:56,652][52664] DAMAGECOUNT value on done: 616800.0 [2024-08-06 05:08:56,652][52664] Sum rewards: 75.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.302', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.326', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '66.000'} [2024-08-06 05:08:57,140][52666] DAMAGECOUNT value on done: 596913.0 [2024-08-06 05:08:57,140][52666] Sum rewards: 86.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.442', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '72.000'} [2024-08-06 05:08:57,623][52667] DAMAGECOUNT value on done: 603772.0 [2024-08-06 05:08:57,623][52667] Sum rewards: 72.581, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.854', 'AMMO5': '0.026', 'AMMO2': '0.083', 'weapon4': '0.154', 'weapon5': '0.222', 'AMMO3': '0.237', 'weapon2': '0.302', 'AMMO4': '0.417', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '63.000'} [2024-08-06 05:08:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 482631680. Throughput: 0: 4364.5. Samples: 120664760. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:08:57,794][52567] Avg episode reward: [(0, '73.593')] [2024-08-06 05:08:58,656][52795] DAMAGECOUNT value on done: 558414.0 [2024-08-06 05:08:58,656][52795] Sum rewards: 66.832, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.170', 'AMMO5': '0.017', 'AMMO2': '0.069', 'weapon5': '0.182', 'weapon4': '0.262', 'AMMO3': '0.311', 'AMMO4': '0.347', 'weapon2': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.750', 'WEAPON3': '1.750', 'weapon3': '2.780', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '60.000'} [2024-08-06 05:08:58,693][52670] DAMAGECOUNT value on done: 585639.0 [2024-08-06 05:08:58,695][52670] Sum rewards: 79.411, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO2': '0.007', 'AMMO4': '0.034', 'HEALTH': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.238', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.364', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '65.000'} [2024-08-06 05:08:59,217][52664] DAMAGECOUNT value on done: 613050.0 [2024-08-06 05:08:59,217][52664] Sum rewards: 70.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.078', 'weapon4': '0.118', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.270', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '58.000'} [2024-08-06 05:08:59,269][52663] DAMAGECOUNT value on done: 589691.0 [2024-08-06 05:08:59,269][52663] Sum rewards: 76.613, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.555', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO3': '0.131', 'AMMO4': '0.137', 'weapon4': '0.176', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '0.800', 'weapon3': '2.884', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:00,208][52666] DAMAGECOUNT value on done: 594704.0 [2024-08-06 05:09:00,209][52666] Sum rewards: 74.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.478', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.110', 'AMMO4': '0.145', 'AMMO3': '0.196', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:00,472][52820] DAMAGECOUNT value on done: 551738.0 [2024-08-06 05:09:00,472][52820] Sum rewards: 73.959, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.225', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.084', 'weapon5': '0.122', 'AMMO3': '0.171', 'AMMO4': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:00,752][52650] Updated weights for policy 0, policy_version 58921 (0.0023) [2024-08-06 05:09:00,808][52667] DAMAGECOUNT value on done: 609320.0 [2024-08-06 05:09:00,809][52667] Sum rewards: 66.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.146', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.127', 'weapon5': '0.146', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.888', 'WEAPON3': '1.350', 'weapon3': '2.652', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:01,301][52669] DAMAGECOUNT value on done: 602572.0 [2024-08-06 05:09:01,301][52669] Sum rewards: 79.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.222', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:01,738][52795] DAMAGECOUNT value on done: 561926.0 [2024-08-06 05:09:01,739][52795] Sum rewards: 78.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.064', 'weapon4': '0.086', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:01,878][52670] DAMAGECOUNT value on done: 594074.0 [2024-08-06 05:09:01,878][52670] Sum rewards: 83.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.265', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.144', 'AMMO3': '0.190', 'weapon4': '0.190', 'AMMO4': '0.203', 'weapon2': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '68.000'} [2024-08-06 05:09:02,032][52664] DAMAGECOUNT value on done: 624918.0 [2024-08-06 05:09:02,032][52664] Sum rewards: 72.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.140', 'weapon5': '0.204', 'AMMO3': '0.238', 'AMMO4': '0.251', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '61.000'} [2024-08-06 05:09:02,397][52663] DAMAGECOUNT value on done: 594898.0 [2024-08-06 05:09:02,399][52663] Sum rewards: 73.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.860', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.076', 'weapon5': '0.154', 'AMMO4': '0.231', 'AMMO3': '0.245', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.190', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:02,794][52567] Fps is (10 sec: 17204.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 482713600. Throughput: 0: 4370.0. Samples: 120677930. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:09:02,794][52567] Avg episode reward: [(0, '73.783')] [2024-08-06 05:09:03,540][52666] DAMAGECOUNT value on done: 596242.0 [2024-08-06 05:09:03,541][52666] Sum rewards: 56.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.221', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '2.978', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '49.000'} [2024-08-06 05:09:03,656][52667] DAMAGECOUNT value on done: 607883.0 [2024-08-06 05:09:03,656][52667] Sum rewards: 65.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.424', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.078', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon4': '0.218', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '52.000'} [2024-08-06 05:09:03,717][52820] DAMAGECOUNT value on done: 554605.0 [2024-08-06 05:09:03,718][52820] Sum rewards: 72.574, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.340', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.110', 'AMMO3': '0.139', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.272', 'weapon2': '0.558', 'WEAPON3': '0.950', 'weapon3': '2.846', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:04,348][52669] DAMAGECOUNT value on done: 593190.0 [2024-08-06 05:09:04,349][52669] Sum rewards: 73.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.264', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.160', 'AMMO4': '0.180', 'AMMO3': '0.194', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:04,854][52795] DAMAGECOUNT value on done: 554699.0 [2024-08-06 05:09:04,854][52795] Sum rewards: 70.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.036', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.546', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.222', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:05,021][52664] DAMAGECOUNT value on done: 617334.0 [2024-08-06 05:09:05,021][52664] Sum rewards: 59.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.848', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.177', 'AMMO3': '0.192', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.150', 'HITCOUNT': '2.680', 'weapon3': '3.024', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '48.000'} [2024-08-06 05:09:05,281][52670] DAMAGECOUNT value on done: 592233.0 [2024-08-06 05:09:05,282][52670] Sum rewards: 70.964, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.021', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.167', 'weapon4': '0.216', 'AMMO4': '0.239', 'weapon5': '0.312', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '55.000'} [2024-08-06 05:09:05,381][52663] DAMAGECOUNT value on done: 591400.0 [2024-08-06 05:09:05,382][52663] Sum rewards: 60.246, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.374', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.112', 'weapon5': '0.226', 'AMMO3': '0.231', 'AMMO4': '0.270', 'weapon2': '0.522', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 05:09:05,926][52650] Updated weights for policy 0, policy_version 58931 (0.0018) [2024-08-06 05:09:06,644][52667] DAMAGECOUNT value on done: 607990.0 [2024-08-06 05:09:06,645][52667] Sum rewards: 83.045, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.062', 'weapon4': '0.080', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.440', 'WEAPON3': '0.800', 'HEALTH': '1.224', 'weapon3': '3.164', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:06,822][52820] DAMAGECOUNT value on done: 557585.0 [2024-08-06 05:09:06,823][52820] Sum rewards: 65.880, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.926', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.118', 'AMMO4': '0.236', 'weapon4': '0.252', 'AMMO3': '0.276', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.972', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:06,872][52666] DAMAGECOUNT value on done: 590488.0 [2024-08-06 05:09:06,873][52666] Sum rewards: 72.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.362', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.056', 'AMMO4': '0.169', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon5': '0.344', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '61.000'} [2024-08-06 05:09:07,415][52669] DAMAGECOUNT value on done: 603067.0 [2024-08-06 05:09:07,415][52669] Sum rewards: 69.680, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.409', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.062', 'weapon4': '0.090', 'AMMO3': '0.151', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '0.950', 'weapon3': '3.218', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '55.000'} [2024-08-06 05:09:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 482795520. Throughput: 0: 4358.5. Samples: 120703940. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:09:07,794][52567] Avg episode reward: [(0, '72.969')] [2024-08-06 05:09:07,829][52664] DAMAGECOUNT value on done: 625809.0 [2024-08-06 05:09:07,830][52664] Sum rewards: 77.088, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.838', 'AMMO5': '0.011', 'AMMO2': '0.039', 'AMMO3': '0.162', 'AMMO4': '0.192', 'weapon4': '0.234', 'weapon5': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:08,128][52795] DAMAGECOUNT value on done: 547851.0 [2024-08-06 05:09:08,128][52795] Sum rewards: 64.245, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.164', 'weapon2': '0.266', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.326', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '50.000'} [2024-08-06 05:09:08,199][52670] DAMAGECOUNT value on done: 590202.0 [2024-08-06 05:09:08,199][52670] Sum rewards: 56.453, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.076', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.136', 'AMMO3': '0.142', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '3.610', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '45.000'} [2024-08-06 05:09:08,490][52663] DAMAGECOUNT value on done: 602158.0 [2024-08-06 05:09:08,491][52663] Sum rewards: 72.934, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.134', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.438', 'weapon2': '0.504', 'WEAPON3': '0.950', 'weapon3': '2.686', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:09,008][52614] Signal inference workers to stop experience collection... (10700 times) [2024-08-06 05:09:09,009][52614] Signal inference workers to resume experience collection... (10700 times) [2024-08-06 05:09:09,056][52650] InferenceWorker_p0-w0: stopping experience collection (10700 times) [2024-08-06 05:09:09,057][52650] InferenceWorker_p0-w0: resuming experience collection (10700 times) [2024-08-06 05:09:09,407][52667] DAMAGECOUNT value on done: 600815.0 [2024-08-06 05:09:09,409][52667] Sum rewards: 82.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.935', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.024', 'AMMO4': '0.032', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '69.000'} [2024-08-06 05:09:09,718][52666] DAMAGECOUNT value on done: 592050.0 [2024-08-06 05:09:09,718][52666] Sum rewards: 75.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.546', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.169', 'weapon5': '0.186', 'AMMO4': '0.214', 'weapon2': '0.334', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:10,017][52820] DAMAGECOUNT value on done: 549683.0 [2024-08-06 05:09:10,017][52820] Sum rewards: 65.769, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.524', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.134', 'AMMO3': '0.172', 'AMMO4': '0.193', 'weapon5': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.808', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '53.000'} [2024-08-06 05:09:10,195][52650] Updated weights for policy 0, policy_version 58941 (0.0025) [2024-08-06 05:09:10,234][52664] DAMAGECOUNT value on done: 623990.0 [2024-08-06 05:09:10,235][52664] Sum rewards: 72.057, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.224', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.042', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.208', 'AMMO3': '0.324', 'weapon2': '0.352', 'WEAPON3': '1.900', 'weapon3': '3.264', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:10,621][52669] DAMAGECOUNT value on done: 603877.0 [2024-08-06 05:09:10,622][52669] Sum rewards: 72.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.423', 'AMMO5': '0.017', 'AMMO2': '0.068', 'AMMO3': '0.213', 'weapon5': '0.254', 'weapon2': '0.300', 'AMMO4': '0.342', 'weapon4': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.760', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:11,376][52670] DAMAGECOUNT value on done: 598320.0 [2024-08-06 05:09:11,378][52670] Sum rewards: 68.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.228', 'AMMO3': '0.231', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.508', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:11,435][52795] DAMAGECOUNT value on done: 558998.0 [2024-08-06 05:09:11,436][52795] Sum rewards: 82.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.189', 'AMMO4': '0.190', 'weapon4': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:11,500][52663] DAMAGECOUNT value on done: 594269.0 [2024-08-06 05:09:11,501][52663] Sum rewards: 76.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.234', 'WEAPON3': '1.250', 'weapon3': '3.444', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:11,767][52671] DAMAGECOUNT value on done: 605820.0 [2024-08-06 05:09:11,775][52671] Sum rewards: 43.619, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.922', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.138', 'AMMO4': '0.226', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'weapon4': '0.312', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.420', 'weapon3': '2.840', 'DAMAGECOUNT': '12.441', 'FRAGCOUNT': '40.000'} [2024-08-06 05:09:12,538][52667] DAMAGECOUNT value on done: 607699.0 [2024-08-06 05:09:12,539][52667] Sum rewards: 73.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.647', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.067', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.372', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:12,544][52666] DAMAGECOUNT value on done: 586296.0 [2024-08-06 05:09:12,546][52666] Sum rewards: 72.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO3': '0.177', 'AMMO4': '0.189', 'weapon5': '0.214', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.582', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 482885632. Throughput: 0: 4372.4. Samples: 120730470. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:09:12,794][52567] Avg episode reward: [(0, '72.531')] [2024-08-06 05:09:13,131][52820] DAMAGECOUNT value on done: 557461.0 [2024-08-06 05:09:13,132][52820] Sum rewards: 74.096, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.283', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.184', 'weapon4': '0.460', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:13,169][52649] DAMAGECOUNT value on done: 579710.0 [2024-08-06 05:09:13,170][52649] Sum rewards: 70.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.056', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:13,461][52669] DAMAGECOUNT value on done: 599064.0 [2024-08-06 05:09:13,461][52669] Sum rewards: 70.455, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.770', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.206', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:13,478][52664] DAMAGECOUNT value on done: 627502.0 [2024-08-06 05:09:13,478][52664] Sum rewards: 67.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.309', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.314', 'weapon4': '0.362', 'WEAPON3': '1.550', 'weapon3': '2.876', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:14,035][52670] DAMAGECOUNT value on done: 585133.0 [2024-08-06 05:09:14,036][52670] Sum rewards: 75.848, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.918', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.100', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.850', 'weapon3': '3.050', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '65.500'} [2024-08-06 05:09:14,388][52663] DAMAGECOUNT value on done: 603471.0 [2024-08-06 05:09:14,388][52663] Sum rewards: 81.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.715', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.132', 'weapon4': '0.186', 'AMMO3': '0.198', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:14,640][52671] DAMAGECOUNT value on done: 607176.0 [2024-08-06 05:09:14,641][52671] Sum rewards: 83.364, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.284', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.144', 'AMMO3': '0.174', 'weapon2': '0.210', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:14,694][52795] DAMAGECOUNT value on done: 555183.0 [2024-08-06 05:09:14,695][52795] Sum rewards: 71.757, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.790', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.086', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.299', 'weapon2': '0.386', 'WEAPON3': '1.850', 'weapon3': '3.186', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:14,838][52650] Updated weights for policy 0, policy_version 58951 (0.0012) [2024-08-06 05:09:15,256][52666] DAMAGECOUNT value on done: 600234.0 [2024-08-06 05:09:15,256][52666] Sum rewards: 74.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.732', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.180', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:16,179][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:09:16,279][52820] DAMAGECOUNT value on done: 550611.0 [2024-08-06 05:09:16,279][52820] Sum rewards: 72.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.718', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.080', 'WEAPON4': '0.100', 'weapon2': '0.224', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.502', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:16,318][52664] DAMAGECOUNT value on done: 628666.0 [2024-08-06 05:09:16,319][52664] Sum rewards: 62.980, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.064', 'weapon5': '0.248', 'weapon2': '0.258', 'AMMO3': '0.272', 'weapon4': '0.312', 'AMMO4': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.826', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:16,336][52649] DAMAGECOUNT value on done: 572504.0 [2024-08-06 05:09:16,337][52649] Sum rewards: 67.490, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.170', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.175', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'weapon3': '3.298', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:16,345][52669] DAMAGECOUNT value on done: 606119.0 [2024-08-06 05:09:16,346][52669] Sum rewards: 66.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.278', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.271', 'weapon2': '0.278', 'weapon4': '0.316', 'WEAPON3': '1.600', 'weapon3': '3.080', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:16,525][52670] DAMAGECOUNT value on done: 592290.0 [2024-08-06 05:09:16,525][52670] Sum rewards: 78.826, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.346', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.110', 'weapon5': '0.114', 'AMMO4': '0.149', 'weapon2': '0.174', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:17,135][52663] DAMAGECOUNT value on done: 603408.0 [2024-08-06 05:09:17,143][52663] Sum rewards: 62.115, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.398', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.092', 'weapon4': '0.128', 'AMMO4': '0.217', 'AMMO3': '0.263', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.158', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:17,651][52666] DAMAGECOUNT value on done: 593230.0 [2024-08-06 05:09:17,651][52666] Sum rewards: 70.579, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.830', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.114', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.750', 'weapon3': '3.056', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '61.000'} [2024-08-06 05:09:17,698][52658] DAMAGECOUNT value on done: 601710.0 [2024-08-06 05:09:17,698][52658] Sum rewards: 74.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.394', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.116', 'AMMO4': '0.189', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '61.000'} [2024-08-06 05:09:17,743][52671] DAMAGECOUNT value on done: 603843.0 [2024-08-06 05:09:17,744][52671] Sum rewards: 73.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.082', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.170', 'AMMO4': '0.210', 'AMMO3': '0.222', 'weapon2': '0.310', 'weapon4': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 482975744. Throughput: 0: 4379.6. Samples: 120743740. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:09:17,794][52567] Avg episode reward: [(0, '72.440')] [2024-08-06 05:09:17,875][52795] DAMAGECOUNT value on done: 548638.0 [2024-08-06 05:09:17,875][52795] Sum rewards: 80.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.254', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon5': '0.122', 'AMMO3': '0.186', 'weapon4': '0.192', 'AMMO4': '0.242', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '66.000'} [2024-08-06 05:09:19,093][52669] DAMAGECOUNT value on done: 602002.0 [2024-08-06 05:09:19,094][52669] Sum rewards: 73.454, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.080', 'AMMO4': '0.158', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.000', 'weapon3': '3.348', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:19,180][52670] DAMAGECOUNT value on done: 601782.0 [2024-08-06 05:09:19,182][52670] Sum rewards: 75.889, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.967', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.007', 'WEAPON4': '0.100', 'weapon5': '0.126', 'weapon4': '0.144', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:19,407][52649] DAMAGECOUNT value on done: 591605.0 [2024-08-06 05:09:19,407][52649] Sum rewards: 68.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.655', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.152', 'AMMO3': '0.217', 'AMMO4': '0.217', 'weapon4': '0.288', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.860', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:19,467][52664] DAMAGECOUNT value on done: 630232.0 [2024-08-06 05:09:19,467][52664] Sum rewards: 84.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.715', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.116', 'weapon4': '0.116', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '3.126', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:19,491][52820] DAMAGECOUNT value on done: 554779.0 [2024-08-06 05:09:19,492][52820] Sum rewards: 71.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.447', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.180', 'AMMO3': '0.240', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:19,627][52650] Updated weights for policy 0, policy_version 58961 (0.0014) [2024-08-06 05:09:20,185][52658] DAMAGECOUNT value on done: 599340.0 [2024-08-06 05:09:20,187][52658] Sum rewards: 65.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.040', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.214', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '53.000'} [2024-08-06 05:09:20,242][52663] DAMAGECOUNT value on done: 593533.0 [2024-08-06 05:09:20,245][52663] Sum rewards: 64.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.190', 'weapon5': '0.244', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.472', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '51.000'} [2024-08-06 05:09:20,446][52666] DAMAGECOUNT value on done: 596908.0 [2024-08-06 05:09:20,446][52666] Sum rewards: 75.629, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.072', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:20,805][52671] DAMAGECOUNT value on done: 603929.0 [2024-08-06 05:09:20,809][52671] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.114', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:21,053][52795] DAMAGECOUNT value on done: 550575.0 [2024-08-06 05:09:21,054][52795] Sum rewards: 67.789, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.167', 'weapon5': '0.216', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON4': '0.450', 'weapon2': '0.608', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '54.000'} [2024-08-06 05:09:22,019][52649] DAMAGECOUNT value on done: 588199.0 [2024-08-06 05:09:22,022][52649] Sum rewards: 76.009, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'AMMO5': '0.017', 'AMMO2': '0.093', 'weapon5': '0.168', 'AMMO3': '0.237', 'weapon2': '0.246', 'AMMO4': '0.463', 'WEAPON5': '0.500', 'weapon4': '0.518', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.690', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:22,043][52670] DAMAGECOUNT value on done: 596817.0 [2024-08-06 05:09:22,043][52670] Sum rewards: 77.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:22,293][52669] DAMAGECOUNT value on done: 602343.0 [2024-08-06 05:09:22,305][52669] Sum rewards: 74.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.091', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.123', 'weapon2': '0.204', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.424', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:22,434][52664] DAMAGECOUNT value on done: 621693.0 [2024-08-06 05:09:22,435][52664] Sum rewards: 72.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.308', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.211', 'weapon2': '0.234', 'WEAPON3': '1.250', 'HITCOUNT': '3.450', 'weapon3': '3.468', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:22,795][52567] Fps is (10 sec: 18021.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 483065856. Throughput: 0: 4368.6. Samples: 120769820. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:09:22,795][52567] Avg episode reward: [(0, '72.296')] [2024-08-06 05:09:22,817][52658] DAMAGECOUNT value on done: 606305.0 [2024-08-06 05:09:22,817][52820] DAMAGECOUNT value on done: 558401.0 [2024-08-06 05:09:22,819][52658] Sum rewards: 82.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.607', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.158', 'weapon5': '0.178', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '66.000'} [2024-08-06 05:09:22,820][52820] Sum rewards: 64.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.185', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.118', 'weapon4': '0.240', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:23,617][52671] DAMAGECOUNT value on done: 615515.0 [2024-08-06 05:09:23,618][52671] Sum rewards: 80.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.275', 'weapon2': '0.374', 'WEAPON3': '1.650', 'weapon3': '3.408', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '70.000'} [2024-08-06 05:09:23,642][52666] DAMAGECOUNT value on done: 590728.0 [2024-08-06 05:09:23,642][52666] Sum rewards: 70.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.228', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.154', 'weapon4': '0.170', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:24,225][52650] Updated weights for policy 0, policy_version 58971 (0.0022) [2024-08-06 05:09:24,269][52795] DAMAGECOUNT value on done: 555454.0 [2024-08-06 05:09:24,269][52795] Sum rewards: 77.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.915', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.120', 'AMMO4': '0.170', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:24,772][52668] Large shaping reward 3.339 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.28800000000000003, 96.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:09:24,971][52664] DAMAGECOUNT value on done: 617094.0 [2024-08-06 05:09:24,971][52664] Sum rewards: 71.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'AMMO3': '0.218', 'weapon2': '0.486', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.304', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:25,053][52649] DAMAGECOUNT value on done: 575709.0 [2024-08-06 05:09:25,054][52649] Sum rewards: 67.828, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.825', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.078', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:25,087][52669] DAMAGECOUNT value on done: 610072.0 [2024-08-06 05:09:25,089][52669] Sum rewards: 72.560, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.195', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.158', 'AMMO3': '0.189', 'weapon4': '0.196', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:25,201][52670] DAMAGECOUNT value on done: 581480.0 [2024-08-06 05:09:25,203][52670] Sum rewards: 87.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.590', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon2': '0.170', 'AMMO3': '0.239', 'WEAPON3': '1.650', 'weapon3': '3.526', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '74.000'} [2024-08-06 05:09:25,716][52658] DAMAGECOUNT value on done: 604209.0 [2024-08-06 05:09:25,716][52658] Sum rewards: 64.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.270', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO4': '0.109', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '55.000'} [2024-08-06 05:09:25,967][52820] DAMAGECOUNT value on done: 552704.0 [2024-08-06 05:09:25,968][52820] Sum rewards: 77.476, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.823', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:26,369][52671] DAMAGECOUNT value on done: 605556.0 [2024-08-06 05:09:26,371][52671] Sum rewards: 53.240, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.210', 'AMMO5': '0.024', 'AMMO2': '0.068', 'AMMO3': '0.280', 'weapon5': '0.284', 'AMMO4': '0.339', 'weapon4': '0.372', 'weapon2': '0.446', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'WEAPON3': '1.700', 'weapon3': '2.540', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '49.000'} [2024-08-06 05:09:26,529][52666] DAMAGECOUNT value on done: 594446.0 [2024-08-06 05:09:26,530][52666] Sum rewards: 70.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.799', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.173', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.276', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:27,402][52795] DAMAGECOUNT value on done: 545890.0 [2024-08-06 05:09:27,402][52795] Sum rewards: 63.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.009', 'AMMO2': '0.035', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon4': '0.232', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '52.000'} [2024-08-06 05:09:27,637][52670] DAMAGECOUNT value on done: 591065.0 [2024-08-06 05:09:27,638][52670] Sum rewards: 69.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.872', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.074', 'weapon5': '0.222', 'AMMO4': '0.234', 'AMMO3': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:27,698][52649] DAMAGECOUNT value on done: 589402.0 [2024-08-06 05:09:27,699][52649] Sum rewards: 76.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.191', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:27,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17494.8). Total num frames: 483147776. Throughput: 0: 4365.3. Samples: 120795770. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 05:09:27,796][52567] Avg episode reward: [(0, '72.252')] [2024-08-06 05:09:27,993][52669] DAMAGECOUNT value on done: 601557.0 [2024-08-06 05:09:27,994][52669] Sum rewards: 78.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.553', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.264', 'WEAPON3': '1.250', 'HITCOUNT': '3.490', 'weapon3': '3.516', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:28,021][52664] DAMAGECOUNT value on done: 621757.0 [2024-08-06 05:09:28,021][52664] Sum rewards: 74.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.918', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon5': '0.174', 'AMMO3': '0.183', 'weapon4': '0.208', 'AMMO4': '0.224', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:28,984][52666] DAMAGECOUNT value on done: 602619.0 [2024-08-06 05:09:28,984][52666] Sum rewards: 66.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.878', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.190', 'AMMO3': '0.199', 'AMMO4': '0.227', 'weapon2': '0.318', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:29,013][52650] Updated weights for policy 0, policy_version 58981 (0.0013) [2024-08-06 05:09:29,023][52820] DAMAGECOUNT value on done: 563007.0 [2024-08-06 05:09:29,026][52820] Sum rewards: 67.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.948', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.172', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '55.000'} [2024-08-06 05:09:29,048][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:09:29,133][52658] DAMAGECOUNT value on done: 592368.0 [2024-08-06 05:09:29,133][52658] Sum rewards: 61.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.183', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon7': '0.078', 'AMMO4': '0.097', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.214', 'weapon2': '0.342', 'weapon4': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '51.000'} [2024-08-06 05:09:29,725][52671] DAMAGECOUNT value on done: 609803.0 [2024-08-06 05:09:29,726][52671] Sum rewards: 61.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.254', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '49.000'} [2024-08-06 05:09:30,353][52670] DAMAGECOUNT value on done: 602807.0 [2024-08-06 05:09:30,353][52670] Sum rewards: 75.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.041', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.124', 'AMMO3': '0.173', 'weapon5': '0.270', 'AMMO4': '0.288', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.874', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:30,409][52649] DAMAGECOUNT value on done: 582313.0 [2024-08-06 05:09:30,409][52649] Sum rewards: 77.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.632', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.038', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:30,469][52795] DAMAGECOUNT value on done: 561771.0 [2024-08-06 05:09:30,469][52795] Sum rewards: 86.194, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.074', 'AMMO3': '0.224', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.464', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '72.000'} [2024-08-06 05:09:30,752][52664] DAMAGECOUNT value on done: 621453.0 [2024-08-06 05:09:30,753][52664] Sum rewards: 71.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.836', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.109', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:30,916][52669] DAMAGECOUNT value on done: 606152.0 [2024-08-06 05:09:30,916][52669] Sum rewards: 63.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.082', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 05:09:31,867][52658] DAMAGECOUNT value on done: 596710.0 [2024-08-06 05:09:31,869][52658] Sum rewards: 67.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.122', 'AMMO4': '0.140', 'weapon5': '0.140', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '55.000'} [2024-08-06 05:09:32,117][52666] DAMAGECOUNT value on done: 584493.0 [2024-08-06 05:09:32,120][52666] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.526', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.036', 'weapon4': '0.038', 'AMMO4': '0.139', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.378', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:32,207][52820] DAMAGECOUNT value on done: 551164.0 [2024-08-06 05:09:32,208][52820] Sum rewards: 64.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.680', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.227', 'AMMO4': '0.247', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '55.000'} [2024-08-06 05:09:32,680][52671] DAMAGECOUNT value on done: 604578.0 [2024-08-06 05:09:32,682][52671] Sum rewards: 72.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.163', 'AMMO4': '0.193', 'weapon4': '0.236', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.968', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:32,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 483237888. Throughput: 0: 4357.3. Samples: 120808740. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:09:32,794][52567] Avg episode reward: [(0, '71.598')] [2024-08-06 05:09:33,117][52664] DAMAGECOUNT value on done: 621932.0 [2024-08-06 05:09:33,117][52664] Sum rewards: 68.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.152', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.024', 'AMMO4': '0.058', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:33,316][52670] DAMAGECOUNT value on done: 591107.0 [2024-08-06 05:09:33,319][52670] Sum rewards: 70.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon4': '0.242', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '2.862', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '61.000'} [2024-08-06 05:09:33,514][52649] DAMAGECOUNT value on done: 586484.0 [2024-08-06 05:09:33,514][52649] Sum rewards: 67.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.202', 'weapon4': '0.210', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '53.500'} [2024-08-06 05:09:33,560][52795] DAMAGECOUNT value on done: 556090.0 [2024-08-06 05:09:33,562][52795] Sum rewards: 80.527, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.106', 'HEALTH': '0.150', 'AMMO3': '0.156', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.496', 'WEAPON3': '0.950', 'weapon3': '3.106', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:33,753][52650] Updated weights for policy 0, policy_version 58991 (0.0012) [2024-08-06 05:09:33,783][52669] DAMAGECOUNT value on done: 607321.0 [2024-08-06 05:09:33,787][52669] Sum rewards: 79.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.167', 'weapon2': '0.168', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:34,577][52658] DAMAGECOUNT value on done: 605370.0 [2024-08-06 05:09:34,577][52658] Sum rewards: 74.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.164', 'AMMO4': '0.168', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:34,892][52666] DAMAGECOUNT value on done: 594137.0 [2024-08-06 05:09:34,894][52666] Sum rewards: 69.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.172', 'AMMO3': '0.202', 'weapon4': '0.224', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:35,344][52647] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:09:35,473][52820] DAMAGECOUNT value on done: 557073.0 [2024-08-06 05:09:35,474][52820] Sum rewards: 75.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.674', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.055', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.296', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:35,839][52671] DAMAGECOUNT value on done: 595894.0 [2024-08-06 05:09:35,847][52671] Sum rewards: 60.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.294', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.075', 'weapon4': '0.094', 'WEAPON5': '0.100', 'weapon2': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.572', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '51.000'} [2024-08-06 05:09:36,250][52670] DAMAGECOUNT value on done: 596179.0 [2024-08-06 05:09:36,251][52670] Sum rewards: 70.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.180', 'AMMO4': '0.190', 'weapon4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:36,693][52649] DAMAGECOUNT value on done: 587454.0 [2024-08-06 05:09:36,696][52649] Sum rewards: 69.137, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.888', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.100', 'weapon5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.213', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '56.500'} [2024-08-06 05:09:36,798][52669] DAMAGECOUNT value on done: 594801.0 [2024-08-06 05:09:36,798][52669] Sum rewards: 76.159, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO3': '0.153', 'weapon2': '0.660', 'WEAPON3': '1.000', 'weapon3': '3.054', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:36,813][52795] DAMAGECOUNT value on done: 547709.0 [2024-08-06 05:09:36,813][52795] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.452', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.168', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon4': '0.326', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:37,476][52658] DAMAGECOUNT value on done: 595520.0 [2024-08-06 05:09:37,478][52658] Sum rewards: 68.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.380', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.088', 'weapon5': '0.166', 'AMMO4': '0.189', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.600', 'weapon3': '2.960', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:37,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 483319808. Throughput: 0: 4362.5. Samples: 120835090. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:09:37,794][52567] Avg episode reward: [(0, '71.449')] [2024-08-06 05:09:37,954][52794] Large shaping reward 2.509 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('weapon5', 0.002)] [2024-08-06 05:09:38,083][52811] DAMAGECOUNT value on done: 573035.0 [2024-08-06 05:09:38,084][52811] Sum rewards: 75.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.514', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.094', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:38,187][52650] Updated weights for policy 0, policy_version 59001 (0.0019) [2024-08-06 05:09:38,491][52668] DAMAGECOUNT value on done: 600315.0 [2024-08-06 05:09:38,494][52668] Sum rewards: 85.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.905', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.213', 'weapon5': '0.252', 'AMMO4': '0.296', 'weapon2': '0.326', 'weapon4': '0.426', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.642', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '71.000'} [2024-08-06 05:09:38,503][52671] DAMAGECOUNT value on done: 603655.0 [2024-08-06 05:09:38,506][52671] Sum rewards: 72.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.711', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '61.000'} [2024-08-06 05:09:38,637][52820] DAMAGECOUNT value on done: 564839.0 [2024-08-06 05:09:38,639][52820] Sum rewards: 74.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.352', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.221', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:39,988][52649] DAMAGECOUNT value on done: 578158.0 [2024-08-06 05:09:39,988][52649] Sum rewards: 69.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.036', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon2': '0.226', 'weapon5': '0.240', 'AMMO3': '0.241', 'AMMO4': '0.245', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:40,017][52795] DAMAGECOUNT value on done: 553490.0 [2024-08-06 05:09:40,018][52795] Sum rewards: 57.328, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.843', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.172', 'AMMO4': '0.190', 'weapon2': '0.240', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '49.000'} [2024-08-06 05:09:40,184][52658] DAMAGECOUNT value on done: 614629.0 [2024-08-06 05:09:40,185][52658] Sum rewards: 51.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.774', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.610', 'weapon3': '3.460', 'DAMAGECOUNT': '13.038', 'FRAGCOUNT': '43.000'} [2024-08-06 05:09:40,219][52669] DAMAGECOUNT value on done: 600390.0 [2024-08-06 05:09:40,219][52669] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.709', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.128', 'weapon5': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.442', 'weapon4': '0.586', 'WEAPON3': '0.850', 'weapon3': '2.520', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:41,137][52811] DAMAGECOUNT value on done: 554765.0 [2024-08-06 05:09:41,145][52811] Sum rewards: 66.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.113', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.118', 'weapon5': '0.186', 'AMMO3': '0.215', 'AMMO4': '0.265', 'weapon2': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.144', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:41,398][52668] DAMAGECOUNT value on done: 604094.0 [2024-08-06 05:09:41,399][52668] Sum rewards: 68.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.086', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:41,480][52671] DAMAGECOUNT value on done: 606147.0 [2024-08-06 05:09:41,481][52671] Sum rewards: 78.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.275', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.160', 'weapon4': '0.178', 'AMMO3': '0.190', 'AMMO4': '0.206', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '66.000'} [2024-08-06 05:09:41,687][52820] DAMAGECOUNT value on done: 559873.0 [2024-08-06 05:09:41,688][52820] Sum rewards: 80.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.375', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.052', 'AMMO4': '0.086', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:42,706][52649] DAMAGECOUNT value on done: 591905.0 [2024-08-06 05:09:42,708][52649] Sum rewards: 86.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.032', 'weapon5': '0.052', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.261', 'FRAGCOUNT': '71.000'} [2024-08-06 05:09:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 483409920. Throughput: 0: 4364.7. Samples: 120861170. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:09:42,794][52567] Avg episode reward: [(0, '71.760')] [2024-08-06 05:09:42,810][52650] Updated weights for policy 0, policy_version 59011 (0.0022) [2024-08-06 05:09:43,048][52658] DAMAGECOUNT value on done: 601526.0 [2024-08-06 05:09:43,048][52658] Sum rewards: 78.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.312', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.062', 'weapon5': '0.096', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.688', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:43,085][52795] DAMAGECOUNT value on done: 561054.0 [2024-08-06 05:09:43,085][52795] Sum rewards: 73.766, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.708', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:43,205][52669] DAMAGECOUNT value on done: 602645.0 [2024-08-06 05:09:43,205][52669] Sum rewards: 67.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.194', 'weapon5': '0.262', 'weapon4': '0.264', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '54.000'} [2024-08-06 05:09:44,159][52811] DAMAGECOUNT value on done: 555211.0 [2024-08-06 05:09:44,161][52811] Sum rewards: 73.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.917', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO4': '0.160', 'weapon5': '0.194', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:44,225][52668] DAMAGECOUNT value on done: 603622.0 [2024-08-06 05:09:44,228][52668] Sum rewards: 68.916, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.765', 'AMMO5': '0.025', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.166', 'AMMO4': '0.221', 'weapon2': '0.252', 'AMMO3': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.800', 'weapon3': '3.152', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:44,360][52671] DAMAGECOUNT value on done: 600978.0 [2024-08-06 05:09:44,364][52671] Sum rewards: 63.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.736', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.178', 'weapon2': '0.830', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '52.000'} [2024-08-06 05:09:44,777][52820] DAMAGECOUNT value on done: 562232.0 [2024-08-06 05:09:44,780][52820] Sum rewards: 73.950, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon5': '0.022', 'AMMO2': '0.029', 'weapon4': '0.104', 'AMMO4': '0.147', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '3.268', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:45,293][52649] DAMAGECOUNT value on done: 594354.0 [2024-08-06 05:09:45,293][52649] Sum rewards: 78.938, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.515', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.152', 'weapon4': '0.208', 'AMMO4': '0.239', 'AMMO3': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.888', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '68.000'} [2024-08-06 05:09:45,553][52658] DAMAGECOUNT value on done: 613791.0 [2024-08-06 05:09:45,554][52658] Sum rewards: 77.374, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO4': '-0.028', 'AMMO2': '-0.006', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.620', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:45,729][52669] DAMAGECOUNT value on done: 620277.0 [2024-08-06 05:09:45,729][52669] Sum rewards: 69.449, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.828', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.096', 'AMMO3': '0.205', 'weapon5': '0.208', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 05:09:47,096][52668] DAMAGECOUNT value on done: 604638.0 [2024-08-06 05:09:47,099][52668] Sum rewards: 81.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.662', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.578', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '68.000'} [2024-08-06 05:09:47,301][52811] DAMAGECOUNT value on done: 556302.0 [2024-08-06 05:09:47,303][52811] Sum rewards: 67.624, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.164', 'AMMO3': '0.182', 'weapon2': '0.234', 'AMMO4': '0.316', 'weapon5': '0.320', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '54.000'} [2024-08-06 05:09:47,369][52671] DAMAGECOUNT value on done: 608467.0 [2024-08-06 05:09:47,369][52671] Sum rewards: 47.038, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.948', 'AMMO5': '0.025', 'AMMO2': '0.071', 'weapon5': '0.202', 'AMMO3': '0.302', 'AMMO4': '0.353', 'weapon4': '0.358', 'weapon2': '0.526', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.524', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.064', 'FRAGCOUNT': '46.000'} [2024-08-06 05:09:47,527][52650] Updated weights for policy 0, policy_version 59021 (0.0023) [2024-08-06 05:09:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 483500032. Throughput: 0: 4365.5. Samples: 120874380. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:09:47,794][52567] Avg episode reward: [(0, '71.906')] [2024-08-06 05:09:47,919][52820] DAMAGECOUNT value on done: 558135.0 [2024-08-06 05:09:47,923][52820] Sum rewards: 75.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.290', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.056', 'AMMO4': '0.145', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:48,033][52658] DAMAGECOUNT value on done: 599009.0 [2024-08-06 05:09:48,037][52658] Sum rewards: 78.901, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.112', 'weapon5': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'HEALTH': '0.212', 'weapon2': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:48,477][52649] DAMAGECOUNT value on done: 593886.0 [2024-08-06 05:09:48,478][52649] Sum rewards: 76.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.434', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.177', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:48,576][52669] DAMAGECOUNT value on done: 609279.0 [2024-08-06 05:09:48,578][52669] Sum rewards: 74.789, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.615', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.147', 'weapon4': '0.172', 'AMMO4': '0.174', 'WEAPON4': '0.300', 'weapon5': '0.410', 'WEAPON5': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.632', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:49,814][52668] DAMAGECOUNT value on done: 591854.0 [2024-08-06 05:09:49,816][52668] Sum rewards: 68.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon4': '0.138', 'AMMO4': '0.227', 'weapon5': '0.234', 'AMMO3': '0.248', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.930', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:50,318][52811] DAMAGECOUNT value on done: 561242.0 [2024-08-06 05:09:50,322][52811] Sum rewards: 56.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.118', 'weapon4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.243', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '3.242', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '49.000'} [2024-08-06 05:09:50,566][52671] DAMAGECOUNT value on done: 603742.0 [2024-08-06 05:09:50,567][52671] Sum rewards: 74.496, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.084', 'AMMO3': '0.143', 'weapon4': '0.174', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:50,709][52658] DAMAGECOUNT value on done: 606665.0 [2024-08-06 05:09:50,710][52658] Sum rewards: 69.994, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.123', 'weapon5': '0.132', 'weapon2': '0.242', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.272', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '61.000'} [2024-08-06 05:09:51,080][52662] DAMAGECOUNT value on done: 606139.0 [2024-08-06 05:09:51,081][52662] Sum rewards: 69.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.787', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.122', 'weapon4': '0.140', 'AMMO4': '0.195', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '58.000'} [2024-08-06 05:09:51,105][52820] DAMAGECOUNT value on done: 560533.0 [2024-08-06 05:09:51,105][52820] Sum rewards: 70.851, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.678', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.217', 'weapon4': '0.256', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon5': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.668', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '60.000'} [2024-08-06 05:09:51,391][52669] DAMAGECOUNT value on done: 608335.0 [2024-08-06 05:09:51,391][52669] Sum rewards: 82.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.080', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:51,683][52649] DAMAGECOUNT value on done: 591448.0 [2024-08-06 05:09:51,683][52649] Sum rewards: 79.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.098', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:52,310][52650] Updated weights for policy 0, policy_version 59031 (0.0015) [2024-08-06 05:09:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.5, 300 sec: 17494.8). Total num frames: 483590144. Throughput: 0: 4377.1. Samples: 120900910. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:09:52,794][52567] Avg episode reward: [(0, '72.014')] [2024-08-06 05:09:52,929][52668] DAMAGECOUNT value on done: 608270.0 [2024-08-06 05:09:52,930][52668] Sum rewards: 82.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'weapon5': '0.042', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.458', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '68.000'} [2024-08-06 05:09:53,182][52671] DAMAGECOUNT value on done: 592019.0 [2024-08-06 05:09:53,183][52671] Sum rewards: 82.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '67.000'} [2024-08-06 05:09:53,464][52811] DAMAGECOUNT value on done: 568012.0 [2024-08-06 05:09:53,467][52811] Sum rewards: 70.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.932', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO4': '0.174', 'AMMO3': '0.202', 'weapon2': '0.210', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:53,818][52658] DAMAGECOUNT value on done: 595570.0 [2024-08-06 05:09:53,821][52658] Sum rewards: 55.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.538', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.112', 'weapon4': '0.134', 'weapon2': '0.216', 'AMMO4': '0.259', 'AMMO3': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '2.680', 'weapon3': '3.242', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '50.000'} [2024-08-06 05:09:54,150][52669] DAMAGECOUNT value on done: 607083.0 [2024-08-06 05:09:54,152][52669] Sum rewards: 86.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.338', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.448', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '72.000'} [2024-08-06 05:09:54,169][52662] DAMAGECOUNT value on done: 601847.0 [2024-08-06 05:09:54,169][52662] Sum rewards: 65.866, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.595', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.152', 'AMMO3': '0.180', 'AMMO4': '0.277', 'weapon5': '0.294', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '54.000'} [2024-08-06 05:09:54,418][52820] DAMAGECOUNT value on done: 566909.0 [2024-08-06 05:09:54,421][52820] Sum rewards: 75.626, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon2': '0.552', 'WEAPON3': '0.950', 'weapon3': '3.288', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 05:09:54,668][52649] DAMAGECOUNT value on done: 580500.0 [2024-08-06 05:09:54,669][52649] Sum rewards: 61.299, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.632', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.178', 'AMMO4': '0.185', 'weapon4': '0.204', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '49.000'} [2024-08-06 05:09:55,906][52671] DAMAGECOUNT value on done: 611762.0 [2024-08-06 05:09:55,906][52671] Sum rewards: 64.603, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.010', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon4': '0.218', 'AMMO3': '0.227', 'weapon5': '0.232', 'AMMO4': '0.332', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:56,005][52668] DAMAGECOUNT value on done: 604249.0 [2024-08-06 05:09:56,010][52668] Sum rewards: 69.826, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.038', 'weapon5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.500'} [2024-08-06 05:09:56,602][52811] DAMAGECOUNT value on done: 565351.0 [2024-08-06 05:09:56,602][52811] Sum rewards: 73.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.086', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '63.000'} [2024-08-06 05:09:56,733][52669] DAMAGECOUNT value on done: 612998.0 [2024-08-06 05:09:56,734][52669] Sum rewards: 68.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.660', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon4': '0.174', 'AMMO3': '0.175', 'weapon2': '0.274', 'weapon5': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.760', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:56,799][52662] DAMAGECOUNT value on done: 609800.0 [2024-08-06 05:09:56,800][52662] Sum rewards: 84.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.776', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.084', 'AMMO4': '0.126', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.098', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '68.000'} [2024-08-06 05:09:56,826][52650] Updated weights for policy 0, policy_version 59041 (0.0026) [2024-08-06 05:09:56,936][52658] DAMAGECOUNT value on done: 604197.0 [2024-08-06 05:09:56,938][52658] Sum rewards: 80.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.651', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.384', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '65.000'} [2024-08-06 05:09:57,570][52649] DAMAGECOUNT value on done: 588192.0 [2024-08-06 05:09:57,572][52649] Sum rewards: 69.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.727', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.798', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '56.000'} [2024-08-06 05:09:57,598][52820] DAMAGECOUNT value on done: 567086.0 [2024-08-06 05:09:57,599][52820] Sum rewards: 77.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.124', 'AMMO4': '0.132', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '64.000'} [2024-08-06 05:09:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 483672064. Throughput: 0: 4370.4. Samples: 120927140. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:09:57,794][52567] Avg episode reward: [(0, '72.002')] [2024-08-06 05:09:58,377][52671] DAMAGECOUNT value on done: 608385.0 [2024-08-06 05:09:58,377][52671] Sum rewards: 77.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.598', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO3': '0.186', 'weapon5': '0.198', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:59,118][52668] DAMAGECOUNT value on done: 596189.0 [2024-08-06 05:09:59,119][52668] Sum rewards: 73.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.224', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.490', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.000'} [2024-08-06 05:09:59,260][52662] DAMAGECOUNT value on done: 595425.0 [2024-08-06 05:09:59,262][52662] Sum rewards: 67.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon2': '0.318', 'WEAPON3': '0.900', 'weapon3': '3.196', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '54.000'} [2024-08-06 05:09:59,648][52811] DAMAGECOUNT value on done: 557368.0 [2024-08-06 05:09:59,648][52811] Sum rewards: 60.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.985', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.090', 'weapon4': '0.132', 'AMMO4': '0.220', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.092', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '52.000'} [2024-08-06 05:10:00,069][52649] DAMAGECOUNT value on done: 579073.0 [2024-08-06 05:10:00,069][52649] Sum rewards: 87.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '72.000'} [2024-08-06 05:10:00,096][52658] DAMAGECOUNT value on done: 593013.0 [2024-08-06 05:10:00,096][52658] Sum rewards: 70.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.078', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon2': '0.176', 'AMMO3': '0.206', 'AMMO4': '0.252', 'weapon5': '0.258', 'weapon4': '0.332', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '58.000'} [2024-08-06 05:10:00,710][52820] DAMAGECOUNT value on done: 553538.0 [2024-08-06 05:10:00,712][52820] Sum rewards: 75.880, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.145', 'weapon5': '0.172', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '63.000'} [2024-08-06 05:10:01,191][52671] DAMAGECOUNT value on done: 607743.0 [2024-08-06 05:10:01,191][52671] Sum rewards: 74.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.108', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.226', 'weapon4': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.316', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:01,707][52650] Updated weights for policy 0, policy_version 59051 (0.0011) [2024-08-06 05:10:01,844][52662] DAMAGECOUNT value on done: 611832.0 [2024-08-06 05:10:01,845][52662] Sum rewards: 82.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.225', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '68.000'} [2024-08-06 05:10:01,959][52668] DAMAGECOUNT value on done: 596950.0 [2024-08-06 05:10:01,960][52668] Sum rewards: 77.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.350', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.468', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '66.000'} [2024-08-06 05:10:02,735][52811] DAMAGECOUNT value on done: 568322.0 [2024-08-06 05:10:02,735][52811] Sum rewards: 70.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.062', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '58.000'} [2024-08-06 05:10:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.9). Total num frames: 483762176. Throughput: 0: 4368.7. Samples: 120940330. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:02,802][52567] Avg episode reward: [(0, '71.997')] [2024-08-06 05:10:03,004][52658] DAMAGECOUNT value on done: 606842.0 [2024-08-06 05:10:03,004][52658] Sum rewards: 60.298, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.470', 'weapon7': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.208', 'weapon5': '0.210', 'AMMO4': '0.248', 'AMMO3': '0.311', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'weapon3': '2.782', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '56.000'} [2024-08-06 05:10:03,211][52649] DAMAGECOUNT value on done: 591208.0 [2024-08-06 05:10:03,211][52649] Sum rewards: 67.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '56.000'} [2024-08-06 05:10:04,342][52671] DAMAGECOUNT value on done: 606865.0 [2024-08-06 05:10:04,343][52671] Sum rewards: 74.017, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.736', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.111', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:04,657][52662] DAMAGECOUNT value on done: 597504.0 [2024-08-06 05:10:04,657][52662] Sum rewards: 66.519, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.180', 'AMMO3': '0.196', 'AMMO4': '0.202', 'weapon2': '0.276', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:04,826][52668] DAMAGECOUNT value on done: 606094.0 [2024-08-06 05:10:04,826][52668] Sum rewards: 84.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.533', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.102', 'AMMO3': '0.159', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON4': '0.350', 'weapon4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.998', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '67.000'} [2024-08-06 05:10:05,890][52811] DAMAGECOUNT value on done: 562593.0 [2024-08-06 05:10:05,891][52811] Sum rewards: 62.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.512', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO4': '0.219', 'weapon5': '0.224', 'weapon4': '0.246', 'AMMO3': '0.268', 'weapon2': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.916', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '54.000'} [2024-08-06 05:10:06,212][52658] DAMAGECOUNT value on done: 598746.0 [2024-08-06 05:10:06,213][52658] Sum rewards: 66.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.956', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.170', 'AMMO3': '0.194', 'AMMO4': '0.254', 'weapon5': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.652', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '53.000'} [2024-08-06 05:10:06,215][52650] Updated weights for policy 0, policy_version 59061 (0.0021) [2024-08-06 05:10:06,281][52649] DAMAGECOUNT value on done: 590693.0 [2024-08-06 05:10:06,281][52649] Sum rewards: 63.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.289', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.128', 'AMMO3': '0.174', 'AMMO4': '0.226', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '52.000'} [2024-08-06 05:10:07,135][52671] DAMAGECOUNT value on done: 604038.0 [2024-08-06 05:10:07,135][52671] Sum rewards: 81.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.835', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.094', 'weapon2': '0.218', 'AMMO3': '0.236', 'AMMO4': '0.249', 'weapon5': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '67.500'} [2024-08-06 05:10:07,375][52662] DAMAGECOUNT value on done: 607166.0 [2024-08-06 05:10:07,376][52662] Sum rewards: 71.861, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.946', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.112', 'AMMO3': '0.138', 'AMMO4': '0.167', 'weapon5': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.900', 'weapon2': '0.920', 'weapon3': '2.608', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '56.000'} [2024-08-06 05:10:07,607][52668] DAMAGECOUNT value on done: 603080.0 [2024-08-06 05:10:07,607][52668] Sum rewards: 63.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.243', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.172', 'AMMO3': '0.197', 'AMMO4': '0.280', 'weapon5': '0.282', 'weapon2': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2024-08-06 05:10:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 483844096. Throughput: 0: 4369.4. Samples: 120966440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:07,802][52567] Avg episode reward: [(0, '72.088')] [2024-08-06 05:10:08,914][52811] DAMAGECOUNT value on done: 565975.0 [2024-08-06 05:10:08,917][52811] Sum rewards: 81.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.724', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 05:10:08,958][52660] DAMAGECOUNT value on done: 601019.0 [2024-08-06 05:10:08,958][52660] Sum rewards: 68.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.888', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.712', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '58.000'} [2024-08-06 05:10:09,349][52658] DAMAGECOUNT value on done: 598823.0 [2024-08-06 05:10:09,349][52658] Sum rewards: 69.742, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.255', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.198', 'AMMO4': '0.245', 'weapon4': '0.252', 'weapon2': '0.266', 'AMMO3': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.964', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:09,442][52649] DAMAGECOUNT value on done: 584537.0 [2024-08-06 05:10:09,444][52649] Sum rewards: 65.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.326', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.224', 'weapon5': '0.228', 'weapon4': '0.292', 'AMMO4': '0.316', 'weapon2': '0.342', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.844', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 05:10:09,545][52820] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:10:10,269][52662] DAMAGECOUNT value on done: 611106.0 [2024-08-06 05:10:10,269][52662] Sum rewards: 75.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.090', 'weapon5': '0.182', 'AMMO4': '0.214', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.550', 'weapon3': '2.856', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '63.000'} [2024-08-06 05:10:10,704][52668] DAMAGECOUNT value on done: 594301.0 [2024-08-06 05:10:10,705][52668] Sum rewards: 65.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.378', 'AMMO5': '0.010', 'weapon4': '0.034', 'AMMO2': '0.044', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:10,773][52803] DAMAGECOUNT value on done: 560002.0 [2024-08-06 05:10:10,773][52803] Sum rewards: 64.866, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.062', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon7': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.132', 'AMMO3': '0.176', 'AMMO4': '0.187', 'WEAPON7': '0.200', 'weapon5': '0.290', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.574', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '51.000'} [2024-08-06 05:10:11,215][52650] Updated weights for policy 0, policy_version 59071 (0.0014) [2024-08-06 05:10:12,033][52658] DAMAGECOUNT value on done: 602751.0 [2024-08-06 05:10:12,035][52658] Sum rewards: 69.667, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.201', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '57.000'} [2024-08-06 05:10:12,059][52660] DAMAGECOUNT value on done: 592959.0 [2024-08-06 05:10:12,059][52660] Sum rewards: 77.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.485', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.147', 'AMMO3': '0.167', 'weapon5': '0.174', 'weapon2': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '63.000'} [2024-08-06 05:10:12,133][52811] DAMAGECOUNT value on done: 570337.0 [2024-08-06 05:10:12,134][52811] Sum rewards: 60.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.692', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.062', 'AMMO4': '0.062', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '3.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '52.000'} [2024-08-06 05:10:12,192][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:10:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 483942400. Throughput: 0: 4370.9. Samples: 120992460. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:12,795][52567] Avg episode reward: [(0, '71.946')] [2024-08-06 05:10:13,569][52662] DAMAGECOUNT value on done: 600725.0 [2024-08-06 05:10:13,571][52662] Sum rewards: 84.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.335', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.140', 'weapon5': '0.164', 'AMMO4': '0.180', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '70.000'} [2024-08-06 05:10:13,711][52668] DAMAGECOUNT value on done: 586191.0 [2024-08-06 05:10:13,713][52668] Sum rewards: 69.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.465', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.123', 'AMMO3': '0.134', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.850', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '57.000'} [2024-08-06 05:10:13,972][52803] DAMAGECOUNT value on done: 558350.0 [2024-08-06 05:10:13,974][52803] Sum rewards: 64.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.179', 'weapon4': '0.210', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:14,348][52795] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:10:15,085][52660] DAMAGECOUNT value on done: 603829.0 [2024-08-06 05:10:15,086][52660] Sum rewards: 71.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.026', 'AMMO2': '0.059', 'AMMO3': '0.201', 'weapon4': '0.292', 'AMMO4': '0.294', 'weapon5': '0.304', 'weapon2': '0.494', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '59.000'} [2024-08-06 05:10:15,146][52811] DAMAGECOUNT value on done: 560647.0 [2024-08-06 05:10:15,148][52811] Sum rewards: 67.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.184', 'weapon5': '0.212', 'AMMO3': '0.238', 'AMMO4': '0.269', 'weapon2': '0.380', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.910', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '57.000'} [2024-08-06 05:10:15,727][52650] Updated weights for policy 0, policy_version 59081 (0.0027) [2024-08-06 05:10:16,209][52662] DAMAGECOUNT value on done: 611415.0 [2024-08-06 05:10:16,211][52662] Sum rewards: 79.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.284', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.172', 'AMMO3': '0.200', 'weapon4': '0.238', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '65.000'} [2024-08-06 05:10:16,934][52668] DAMAGECOUNT value on done: 589706.0 [2024-08-06 05:10:16,934][52668] Sum rewards: 78.661, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.619', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.174', 'weapon2': '0.176', 'AMMO3': '0.189', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '64.000'} [2024-08-06 05:10:17,140][52803] DAMAGECOUNT value on done: 564553.0 [2024-08-06 05:10:17,140][52803] Sum rewards: 71.242, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.842', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.110', 'AMMO3': '0.169', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.960', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '58.000'} [2024-08-06 05:10:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 484024320. Throughput: 0: 4377.1. Samples: 121005710. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:17,795][52567] Avg episode reward: [(0, '71.954')] [2024-08-06 05:10:18,241][52660] DAMAGECOUNT value on done: 610423.0 [2024-08-06 05:10:18,242][52660] Sum rewards: 75.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.424', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.100', 'AMMO3': '0.157', 'AMMO4': '0.163', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '0.950', 'weapon3': '3.020', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '60.000'} [2024-08-06 05:10:18,270][52811] DAMAGECOUNT value on done: 554872.0 [2024-08-06 05:10:18,272][52811] Sum rewards: 80.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.502', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.132', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.384', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 05:10:19,060][52662] DAMAGECOUNT value on done: 598892.0 [2024-08-06 05:10:19,060][52662] Sum rewards: 80.574, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.170', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.165', 'weapon4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '65.000'} [2024-08-06 05:10:19,967][52668] DAMAGECOUNT value on done: 592608.0 [2024-08-06 05:10:19,969][52668] Sum rewards: 82.136, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.162', 'weapon4': '0.186', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '66.000'} [2024-08-06 05:10:20,233][52803] DAMAGECOUNT value on done: 568428.0 [2024-08-06 05:10:20,234][52803] Sum rewards: 72.327, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.525', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.122', 'AMMO3': '0.209', 'weapon5': '0.274', 'AMMO4': '0.282', 'weapon2': '0.378', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '59.000'} [2024-08-06 05:10:20,387][52650] Updated weights for policy 0, policy_version 59091 (0.0029) [2024-08-06 05:10:21,315][52811] DAMAGECOUNT value on done: 562696.0 [2024-08-06 05:10:21,318][52811] Sum rewards: 65.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.098', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.422', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:21,367][52660] DAMAGECOUNT value on done: 599274.0 [2024-08-06 05:10:21,370][52660] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.074', 'weapon5': '0.190', 'AMMO4': '0.240', 'weapon2': '0.254', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:22,053][52662] DAMAGECOUNT value on done: 600737.0 [2024-08-06 05:10:22,056][52662] Sum rewards: 46.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.864', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.136', 'weapon5': '0.172', 'AMMO4': '0.212', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.636', 'WEAPON3': '1.300', 'HITCOUNT': '2.290', 'weapon3': '2.408', 'DAMAGECOUNT': '12.279', 'FRAGCOUNT': '40.000'} [2024-08-06 05:10:22,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 484114432. Throughput: 0: 4376.7. Samples: 121032040. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:22,794][52567] Avg episode reward: [(0, '71.967')] [2024-08-06 05:10:23,008][52668] DAMAGECOUNT value on done: 599475.0 [2024-08-06 05:10:23,009][52668] Sum rewards: 78.564, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.134', 'weapon5': '0.180', 'AMMO4': '0.200', 'AMMO3': '0.225', 'HEALTH': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.758', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '65.000'} [2024-08-06 05:10:23,391][52803] DAMAGECOUNT value on done: 562483.0 [2024-08-06 05:10:23,391][52803] Sum rewards: 80.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.196', 'AMMO4': '0.199', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '68.000'} [2024-08-06 05:10:23,938][52660] DAMAGECOUNT value on done: 597020.0 [2024-08-06 05:10:23,947][52660] Sum rewards: 72.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.995', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.146', 'AMMO3': '0.166', 'AMMO4': '0.173', 'weapon5': '0.202', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '58.000'} [2024-08-06 05:10:24,436][52811] DAMAGECOUNT value on done: 562599.0 [2024-08-06 05:10:24,438][52811] Sum rewards: 80.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.352', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.082', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.332', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '68.000'} [2024-08-06 05:10:24,808][52662] DAMAGECOUNT value on done: 599033.0 [2024-08-06 05:10:24,809][52662] Sum rewards: 82.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.809', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon4': '0.298', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.600', 'weapon3': '2.926', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '71.000'} [2024-08-06 05:10:25,031][52650] Updated weights for policy 0, policy_version 59101 (0.0040) [2024-08-06 05:10:25,804][52668] DAMAGECOUNT value on done: 601056.0 [2024-08-06 05:10:25,805][52668] Sum rewards: 67.645, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-2.262', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.110', 'AMMO4': '0.221', 'weapon5': '0.256', 'weapon4': '0.548', 'weapon2': '0.586', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.850', 'weapon3': '2.252', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '52.000'} [2024-08-06 05:10:26,469][52803] DAMAGECOUNT value on done: 556360.0 [2024-08-06 05:10:26,469][52803] Sum rewards: 75.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.094', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:26,809][52660] DAMAGECOUNT value on done: 596346.0 [2024-08-06 05:10:26,811][52660] Sum rewards: 55.916, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.124', 'weapon4': '0.134', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.260', 'AMMO3': '0.272', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.222', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '49.000'} [2024-08-06 05:10:27,522][52811] DAMAGECOUNT value on done: 562796.0 [2024-08-06 05:10:27,522][52811] Sum rewards: 78.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.116', 'AMMO4': '0.162', 'AMMO3': '0.183', 'weapon5': '0.230', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '64.000'} [2024-08-06 05:10:27,587][52662] DAMAGECOUNT value on done: 606586.0 [2024-08-06 05:10:27,593][52662] Sum rewards: 55.119, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.246', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.051', 'weapon4': '0.212', 'AMMO4': '0.253', 'weapon5': '0.294', 'weapon2': '0.312', 'AMMO3': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'HITCOUNT': '2.720', 'weapon3': '2.758', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '50.000'} [2024-08-06 05:10:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 484196352. Throughput: 0: 4376.2. Samples: 121058100. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:27,802][52567] Avg episode reward: [(0, '72.283')] [2024-08-06 05:10:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059106_484196352.pth... [2024-08-06 05:10:27,885][52794] Large shaping reward 2.536 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0)] [2024-08-06 05:10:27,963][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058595_480010240.pth [2024-08-06 05:10:28,195][52668] DAMAGECOUNT value on done: 599670.0 [2024-08-06 05:10:28,196][52668] Sum rewards: 69.719, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.276', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '57.000'} [2024-08-06 05:10:29,199][52660] DAMAGECOUNT value on done: 605688.0 [2024-08-06 05:10:29,200][52660] Sum rewards: 74.639, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.299', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.088', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '65.000'} [2024-08-06 05:10:29,290][52647] DAMAGECOUNT value on done: 636621.0 [2024-08-06 05:10:29,290][52647] Sum rewards: 82.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.586', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.108', 'weapon5': '0.134', 'AMMO4': '0.227', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '69.000'} [2024-08-06 05:10:29,795][52803] DAMAGECOUNT value on done: 556346.0 [2024-08-06 05:10:29,795][52803] Sum rewards: 73.933, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.798', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.488', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:29,948][52650] Updated weights for policy 0, policy_version 59111 (0.0013) [2024-08-06 05:10:30,554][52668] DAMAGECOUNT value on done: 605716.0 [2024-08-06 05:10:30,557][52668] Sum rewards: 76.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.132', 'weapon4': '0.156', 'AMMO4': '0.171', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:30,812][52811] DAMAGECOUNT value on done: 566469.0 [2024-08-06 05:10:30,815][52811] Sum rewards: 77.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.009', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'weapon5': '0.082', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.866', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '65.000'} [2024-08-06 05:10:31,002][52662] DAMAGECOUNT value on done: 601253.0 [2024-08-06 05:10:31,003][52662] Sum rewards: 78.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.500', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 05:10:31,689][52660] DAMAGECOUNT value on done: 596474.0 [2024-08-06 05:10:31,691][52660] Sum rewards: 67.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO2': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.161', 'AMMO4': '0.169', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:31,781][52647] DAMAGECOUNT value on done: 631235.0 [2024-08-06 05:10:31,782][52647] Sum rewards: 73.199, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.136', 'AMMO3': '0.208', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '59.000'} [2024-08-06 05:10:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 484278272. Throughput: 0: 4365.6. Samples: 121070830. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:32,794][52567] Avg episode reward: [(0, '72.368')] [2024-08-06 05:10:32,940][52803] DAMAGECOUNT value on done: 552196.0 [2024-08-06 05:10:32,943][52803] Sum rewards: 78.606, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.224', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:33,134][52668] DAMAGECOUNT value on done: 603672.0 [2024-08-06 05:10:33,143][52668] Sum rewards: 55.666, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.927', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.094', 'AMMO4': '0.270', 'AMMO3': '0.287', 'weapon5': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.558', 'WEAPON3': '1.600', 'weapon3': '2.602', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '48.000'} [2024-08-06 05:10:33,834][52811] DAMAGECOUNT value on done: 561789.0 [2024-08-06 05:10:33,836][52811] Sum rewards: 72.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.500', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:34,010][52662] DAMAGECOUNT value on done: 613490.0 [2024-08-06 05:10:34,010][52662] Sum rewards: 66.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.733', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.142', 'AMMO3': '0.208', 'weapon2': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.518', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:34,297][52647] DAMAGECOUNT value on done: 636067.0 [2024-08-06 05:10:34,297][52647] Sum rewards: 72.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.743', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.170', 'weapon5': '0.194', 'AMMO3': '0.238', 'AMMO4': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:34,468][52650] Updated weights for policy 0, policy_version 59121 (0.0012) [2024-08-06 05:10:34,564][52660] DAMAGECOUNT value on done: 599244.0 [2024-08-06 05:10:34,566][52660] Sum rewards: 64.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.325', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO4': '0.173', 'weapon4': '0.182', 'AMMO3': '0.236', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.160', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:35,795][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:10:36,184][52803] DAMAGECOUNT value on done: 559445.0 [2024-08-06 05:10:36,186][52803] Sum rewards: 62.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.076', 'AMMO5': '0.015', 'AMMO2': '0.083', 'weapon4': '0.138', 'weapon5': '0.198', 'AMMO3': '0.232', 'AMMO4': '0.415', 'WEAPON5': '0.450', 'weapon2': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '52.000'} [2024-08-06 05:10:36,444][52662] DAMAGECOUNT value on done: 604634.0 [2024-08-06 05:10:36,444][52662] Sum rewards: 77.262, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.138', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.122', 'AMMO4': '0.150', 'AMMO3': '0.162', 'weapon5': '0.180', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.190', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:36,974][52811] DAMAGECOUNT value on done: 560364.0 [2024-08-06 05:10:36,977][52811] Sum rewards: 69.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon4': '0.062', 'weapon5': '0.152', 'AMMO3': '0.239', 'AMMO4': '0.241', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '59.000'} [2024-08-06 05:10:37,348][52660] DAMAGECOUNT value on done: 606405.0 [2024-08-06 05:10:37,348][52660] Sum rewards: 68.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.301', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.152', 'weapon4': '0.170', 'AMMO4': '0.174', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '56.500'} [2024-08-06 05:10:37,363][52647] DAMAGECOUNT value on done: 639752.0 [2024-08-06 05:10:37,364][52647] Sum rewards: 81.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.454', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'weapon4': '0.102', 'weapon2': '0.108', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON3': '1.300', 'weapon3': '3.544', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '66.000'} [2024-08-06 05:10:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 484376576. Throughput: 0: 4358.7. Samples: 121097050. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:10:37,794][52567] Avg episode reward: [(0, '72.328')] [2024-08-06 05:10:39,300][52662] DAMAGECOUNT value on done: 594954.0 [2024-08-06 05:10:39,301][52662] Sum rewards: 52.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon2': '0.212', 'AMMO3': '0.216', 'weapon5': '0.252', 'AMMO4': '0.276', 'WEAPON5': '0.450', 'weapon4': '0.592', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '12.765', 'FRAGCOUNT': '45.000'} [2024-08-06 05:10:39,310][52803] DAMAGECOUNT value on done: 554229.0 [2024-08-06 05:10:39,313][52803] Sum rewards: 77.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.158', 'AMMO3': '0.199', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '63.000'} [2024-08-06 05:10:39,552][52650] Updated weights for policy 0, policy_version 59131 (0.0015) [2024-08-06 05:10:40,009][52647] DAMAGECOUNT value on done: 645518.0 [2024-08-06 05:10:40,011][52647] Sum rewards: 72.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.134', 'weapon4': '0.152', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '59.000'} [2024-08-06 05:10:40,113][52660] DAMAGECOUNT value on done: 597762.0 [2024-08-06 05:10:40,113][52660] Sum rewards: 75.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.946', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.131', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:40,247][52659] DAMAGECOUNT value on done: 608251.0 [2024-08-06 05:10:40,250][52659] Sum rewards: 52.789, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.340', 'AMMO5': '0.026', 'AMMO2': '0.058', 'weapon5': '0.112', 'weapon4': '0.160', 'AMMO3': '0.256', 'AMMO4': '0.292', 'weapon2': '0.320', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'HITCOUNT': '2.850', 'weapon3': '3.136', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '51.000'} [2024-08-06 05:10:42,339][52803] DAMAGECOUNT value on done: 572444.0 [2024-08-06 05:10:42,340][52803] Sum rewards: 65.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:42,365][52662] DAMAGECOUNT value on done: 602125.0 [2024-08-06 05:10:42,365][52662] Sum rewards: 66.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.458', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.036', 'weapon4': '0.046', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.294', 'ARMOR': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.420', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.000'} [2024-08-06 05:10:42,384][52647] DAMAGECOUNT value on done: 640871.0 [2024-08-06 05:10:42,384][52647] Sum rewards: 63.954, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.446', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.130', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '0.800', 'HITCOUNT': '2.790', 'weapon3': '3.158', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '50.000'} [2024-08-06 05:10:42,684][52659] DAMAGECOUNT value on done: 601055.0 [2024-08-06 05:10:42,684][52659] Sum rewards: 74.426, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.348', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.112', 'weapon5': '0.166', 'AMMO4': '0.210', 'weapon4': '0.252', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon3': '2.972', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '57.000'} [2024-08-06 05:10:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 484458496. Throughput: 0: 4362.4. Samples: 121123450. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:10:42,794][52567] Avg episode reward: [(0, '71.522')] [2024-08-06 05:10:42,988][52660] DAMAGECOUNT value on done: 599459.0 [2024-08-06 05:10:42,991][52660] Sum rewards: 73.245, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.142', 'AMMO3': '0.143', 'weapon4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '0.900', 'weapon3': '3.030', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 05:10:43,669][52650] Updated weights for policy 0, policy_version 59141 (0.0019) [2024-08-06 05:10:43,699][52665] DAMAGECOUNT value on done: 590283.0 [2024-08-06 05:10:43,700][52665] Sum rewards: 75.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.950', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.171', 'weapon5': '0.172', 'AMMO3': '0.207', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:45,353][52647] DAMAGECOUNT value on done: 635037.0 [2024-08-06 05:10:45,355][52647] Sum rewards: 75.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.138', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.448', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:45,450][52803] DAMAGECOUNT value on done: 558409.0 [2024-08-06 05:10:45,453][52803] Sum rewards: 70.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.881', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.126', 'weapon4': '0.136', 'AMMO4': '0.149', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:45,520][52659] DAMAGECOUNT value on done: 607835.0 [2024-08-06 05:10:45,520][52659] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.078', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '58.000'} [2024-08-06 05:10:45,552][52662] DAMAGECOUNT value on done: 596546.0 [2024-08-06 05:10:45,554][52662] Sum rewards: 76.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.847', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.026', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '63.000'} [2024-08-06 05:10:46,071][52660] DAMAGECOUNT value on done: 610759.0 [2024-08-06 05:10:46,071][52660] Sum rewards: 70.443, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.526', 'AMMO5': '0.025', 'AMMO2': '0.054', 'weapon2': '0.238', 'weapon4': '0.246', 'AMMO3': '0.263', 'AMMO4': '0.271', 'weapon5': '0.352', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.766', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '60.000'} [2024-08-06 05:10:46,285][52665] DAMAGECOUNT value on done: 605561.0 [2024-08-06 05:10:46,285][52665] Sum rewards: 63.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.830', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.118', 'AMMO3': '0.219', 'weapon2': '0.376', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.320', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '54.000'} [2024-08-06 05:10:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 484548608. Throughput: 0: 4362.9. Samples: 121136660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:10:47,794][52567] Avg episode reward: [(0, '71.747')] [2024-08-06 05:10:48,062][52647] DAMAGECOUNT value on done: 624295.0 [2024-08-06 05:10:48,063][52647] Sum rewards: 64.522, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.906', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.152', 'AMMO3': '0.165', 'weapon4': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '51.000'} [2024-08-06 05:10:48,492][52803] DAMAGECOUNT value on done: 557362.0 [2024-08-06 05:10:48,494][52803] Sum rewards: 58.979, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.070', 'weapon5': '0.086', 'AMMO4': '0.128', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '52.000'} [2024-08-06 05:10:48,677][52650] Updated weights for policy 0, policy_version 59151 (0.0020) [2024-08-06 05:10:48,858][52659] DAMAGECOUNT value on done: 601680.0 [2024-08-06 05:10:48,860][52659] Sum rewards: 69.803, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.768', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.142', 'AMMO4': '0.200', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.336', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:49,120][52660] DAMAGECOUNT value on done: 614663.0 [2024-08-06 05:10:49,121][52660] Sum rewards: 66.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.443', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.102', 'weapon5': '0.180', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.154', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '54.000'} [2024-08-06 05:10:49,455][52665] DAMAGECOUNT value on done: 602091.0 [2024-08-06 05:10:49,455][52665] Sum rewards: 73.548, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.106', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.144', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '64.000'} [2024-08-06 05:10:51,061][52647] DAMAGECOUNT value on done: 636882.0 [2024-08-06 05:10:51,061][52647] Sum rewards: 68.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.091', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.174', 'AMMO4': '0.176', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '57.000'} [2024-08-06 05:10:51,343][52659] DAMAGECOUNT value on done: 599435.0 [2024-08-06 05:10:51,343][52659] Sum rewards: 80.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.713', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '66.500'} [2024-08-06 05:10:51,661][52803] DAMAGECOUNT value on done: 572109.0 [2024-08-06 05:10:51,663][52803] Sum rewards: 71.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.783', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.360', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '60.000'} [2024-08-06 05:10:51,744][52820] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2024-08-06 05:10:52,006][52660] DAMAGECOUNT value on done: 597141.0 [2024-08-06 05:10:52,008][52660] Sum rewards: 79.816, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HEALTH': '0.068', 'weapon5': '0.070', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon4': '0.220', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '3.012', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '64.000'} [2024-08-06 05:10:52,167][52665] DAMAGECOUNT value on done: 594843.0 [2024-08-06 05:10:52,167][52665] Sum rewards: 80.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.168', 'AMMO4': '0.175', 'weapon2': '0.198', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '68.000'} [2024-08-06 05:10:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 484638720. Throughput: 0: 4359.8. Samples: 121162630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:10:52,794][52567] Avg episode reward: [(0, '71.423')] [2024-08-06 05:10:53,183][52650] Updated weights for policy 0, policy_version 59161 (0.0013) [2024-08-06 05:10:54,207][52647] DAMAGECOUNT value on done: 633463.0 [2024-08-06 05:10:54,209][52647] Sum rewards: 77.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.865', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.066', 'AMMO4': '0.172', 'weapon5': '0.188', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '64.000'} [2024-08-06 05:10:54,525][52659] DAMAGECOUNT value on done: 605383.0 [2024-08-06 05:10:54,527][52659] Sum rewards: 74.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.408', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.156', 'AMMO4': '0.181', 'AMMO3': '0.184', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.226', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '60.000'} [2024-08-06 05:10:54,552][52660] DAMAGECOUNT value on done: 606117.0 [2024-08-06 05:10:54,554][52660] Sum rewards: 70.067, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.204', 'AMMO3': '0.316', 'WEAPON3': '1.700', 'weapon3': '3.458', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '61.000'} [2024-08-06 05:10:54,751][52665] DAMAGECOUNT value on done: 585726.0 [2024-08-06 05:10:54,753][52665] Sum rewards: 81.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon2': '0.152', 'weapon5': '0.160', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '64.000'} [2024-08-06 05:10:54,787][52803] DAMAGECOUNT value on done: 561228.0 [2024-08-06 05:10:54,787][52803] Sum rewards: 73.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO4': '0.108', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon2': '0.520', 'WEAPON3': '1.650', 'weapon3': '3.112', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '62.000'} [2024-08-06 05:10:57,044][52647] DAMAGECOUNT value on done: 632986.0 [2024-08-06 05:10:57,046][52647] Sum rewards: 75.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.576', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.046', 'AMMO4': '0.210', 'AMMO3': '0.240', 'weapon2': '0.262', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '66.000'} [2024-08-06 05:10:57,342][52659] DAMAGECOUNT value on done: 601893.0 [2024-08-06 05:10:57,344][52659] Sum rewards: 66.445, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.900', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.184', 'AMMO4': '0.222', 'AMMO3': '0.320', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.952', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '60.000'} [2024-08-06 05:10:57,469][52665] DAMAGECOUNT value on done: 590870.0 [2024-08-06 05:10:57,470][52665] Sum rewards: 63.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.722', 'AMMO5': '0.029', 'AMMO2': '0.054', 'weapon2': '0.262', 'AMMO3': '0.263', 'AMMO4': '0.270', 'weapon5': '0.346', 'weapon4': '0.604', 'WEAPON4': '0.750', 'WEAPON5': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.358', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '54.000'} [2024-08-06 05:10:57,564][52660] DAMAGECOUNT value on done: 599960.0 [2024-08-06 05:10:57,571][52660] Sum rewards: 62.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon4': '0.058', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.334', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.280', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '51.000'} [2024-08-06 05:10:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 484720640. Throughput: 0: 4362.2. Samples: 121188760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:10:57,794][52567] Avg episode reward: [(0, '71.348')] [2024-08-06 05:10:58,007][52803] DAMAGECOUNT value on done: 559822.0 [2024-08-06 05:10:58,008][52803] Sum rewards: 73.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.025', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.181', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '59.000'} [2024-08-06 05:10:58,058][52650] Updated weights for policy 0, policy_version 59171 (0.0031) [2024-08-06 05:10:58,821][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:10:59,947][52659] DAMAGECOUNT value on done: 599282.0 [2024-08-06 05:10:59,947][52659] Sum rewards: 66.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.066', 'AMMO4': '0.191', 'weapon5': '0.202', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.550', 'HITCOUNT': '3.130', 'weapon3': '3.146', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '57.000'} [2024-08-06 05:11:00,147][52647] DAMAGECOUNT value on done: 627180.0 [2024-08-06 05:11:00,148][52647] Sum rewards: 63.031, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.666', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.180', 'weapon5': '0.220', 'AMMO4': '0.238', 'AMMO3': '0.243', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '54.000'} [2024-08-06 05:11:00,426][52660] DAMAGECOUNT value on done: 598994.0 [2024-08-06 05:11:00,428][52660] Sum rewards: 75.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.176', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 05:11:00,636][52665] DAMAGECOUNT value on done: 597029.0 [2024-08-06 05:11:00,638][52665] Sum rewards: 58.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.140', 'weapon4': '0.148', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '49.500'} [2024-08-06 05:11:01,106][52803] DAMAGECOUNT value on done: 563879.0 [2024-08-06 05:11:01,109][52803] Sum rewards: 86.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.925', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.117', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '68.000'} [2024-08-06 05:11:01,561][52794] DAMAGECOUNT value on done: 605395.0 [2024-08-06 05:11:01,564][52794] Sum rewards: 66.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.034', 'AMMO2': '0.062', 'AMMO3': '0.174', 'weapon4': '0.180', 'AMMO4': '0.312', 'weapon5': '0.434', 'WEAPON4': '0.700', 'weapon2': '0.772', 'WEAPON5': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.306', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '53.000'} [2024-08-06 05:11:02,652][52650] Updated weights for policy 0, policy_version 59181 (0.0025) [2024-08-06 05:11:02,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17495.1). Total num frames: 484810752. Throughput: 0: 4360.0. Samples: 121201910. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:11:02,795][52567] Avg episode reward: [(0, '71.267')] [2024-08-06 05:11:03,178][52647] DAMAGECOUNT value on done: 640904.0 [2024-08-06 05:11:03,179][52647] Sum rewards: 62.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.266', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.416', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '52.000'} [2024-08-06 05:11:03,183][52660] DAMAGECOUNT value on done: 591560.0 [2024-08-06 05:11:03,184][52660] Sum rewards: 70.236, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.935', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '57.000'} [2024-08-06 05:11:03,200][52659] DAMAGECOUNT value on done: 606376.0 [2024-08-06 05:11:03,202][52659] Sum rewards: 64.715, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '0.000', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.160', 'AMMO4': '0.209', 'weapon2': '0.214', 'weapon5': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.576', 'WEAPON3': '0.900', 'weapon3': '2.508', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '50.000'} [2024-08-06 05:11:03,351][52665] DAMAGECOUNT value on done: 595683.0 [2024-08-06 05:11:03,351][52665] Sum rewards: 76.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.234', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.086', 'weapon5': '0.148', 'AMMO3': '0.216', 'weapon2': '0.244', 'AMMO4': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:04,190][52803] DAMAGECOUNT value on done: 567054.0 [2024-08-06 05:11:04,192][52803] Sum rewards: 80.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '67.000'} [2024-08-06 05:11:04,537][52794] DAMAGECOUNT value on done: 610799.0 [2024-08-06 05:11:04,538][52794] Sum rewards: 69.662, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.904', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon4': '0.138', 'weapon2': '0.256', 'AMMO3': '0.292', 'weapon5': '0.300', 'AMMO4': '0.321', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.750', 'HITCOUNT': '2.910', 'weapon3': '2.934', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '61.000'} [2024-08-06 05:11:05,543][52647] DAMAGECOUNT value on done: 632136.0 [2024-08-06 05:11:05,544][52647] Sum rewards: 78.996, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.528', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.162', 'AMMO4': '0.244', 'AMMO3': '0.262', 'weapon5': '0.266', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.878', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '67.000'} [2024-08-06 05:11:05,965][52659] DAMAGECOUNT value on done: 610101.0 [2024-08-06 05:11:05,965][52659] Sum rewards: 78.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.182', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.316', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '66.000'} [2024-08-06 05:11:06,494][52665] DAMAGECOUNT value on done: 603635.0 [2024-08-06 05:11:06,494][52665] Sum rewards: 79.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '67.000'} [2024-08-06 05:11:07,234][52803] DAMAGECOUNT value on done: 570032.0 [2024-08-06 05:11:07,236][52803] Sum rewards: 76.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.078', 'AMMO4': '0.097', 'weapon4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:07,295][52794] DAMAGECOUNT value on done: 609153.0 [2024-08-06 05:11:07,295][52794] Sum rewards: 74.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.124', 'weapon5': '0.158', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:07,303][52650] Updated weights for policy 0, policy_version 59191 (0.0012) [2024-08-06 05:11:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 484900864. Throughput: 0: 4358.6. Samples: 121228180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:11:07,795][52567] Avg episode reward: [(0, '71.763')] [2024-08-06 05:11:08,333][52647] DAMAGECOUNT value on done: 639943.0 [2024-08-06 05:11:08,333][52647] Sum rewards: 84.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.405', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.194', 'weapon5': '0.194', 'weapon2': '0.198', 'AMMO4': '0.214', 'weapon4': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '69.000'} [2024-08-06 05:11:08,967][52659] DAMAGECOUNT value on done: 599124.0 [2024-08-06 05:11:08,967][52659] Sum rewards: 97.970, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.122', 'weapon2': '0.176', 'AMMO3': '0.234', 'WEAPON3': '1.300', 'weapon3': '3.582', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '22.389', 'FRAGCOUNT': '80.000'} [2024-08-06 05:11:09,289][52665] DAMAGECOUNT value on done: 593988.0 [2024-08-06 05:11:09,290][52665] Sum rewards: 73.010, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.339', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.077', 'weapon4': '0.114', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.000', 'weapon3': '3.010', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '59.000'} [2024-08-06 05:11:09,944][52794] DAMAGECOUNT value on done: 599895.0 [2024-08-06 05:11:09,946][52794] Sum rewards: 77.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'weapon4': '0.212', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '66.000'} [2024-08-06 05:11:10,288][52803] DAMAGECOUNT value on done: 558048.0 [2024-08-06 05:11:10,288][52803] Sum rewards: 74.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.023', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.152', 'AMMO3': '0.174', 'AMMO4': '0.233', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '60.000'} [2024-08-06 05:11:11,450][52659] DAMAGECOUNT value on done: 608700.0 [2024-08-06 05:11:11,450][52659] Sum rewards: 72.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.082', 'AMMO3': '0.205', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.408', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '59.000'} [2024-08-06 05:11:11,600][52647] DAMAGECOUNT value on done: 640226.0 [2024-08-06 05:11:11,602][52647] Sum rewards: 74.836, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.600', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon5': '0.118', 'weapon2': '0.242', 'AMMO4': '0.275', 'weapon4': '0.280', 'AMMO3': '0.304', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'weapon3': '3.052', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '66.000'} [2024-08-06 05:11:11,957][52650] Updated weights for policy 0, policy_version 59201 (0.0020) [2024-08-06 05:11:12,549][52665] DAMAGECOUNT value on done: 605185.0 [2024-08-06 05:11:12,549][52665] Sum rewards: 64.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.081', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.462', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.138', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '54.000'} [2024-08-06 05:11:12,624][52794] DAMAGECOUNT value on done: 600798.0 [2024-08-06 05:11:12,625][52794] Sum rewards: 84.904, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.878', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.072', 'weapon5': '0.190', 'AMMO4': '0.193', 'AMMO3': '0.263', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '22.053', 'FRAGCOUNT': '70.000'} [2024-08-06 05:11:12,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 484982784. Throughput: 0: 4362.9. Samples: 121254430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:11:12,794][52567] Avg episode reward: [(0, '72.170')] [2024-08-06 05:11:13,831][52647] DAMAGECOUNT value on done: 624826.0 [2024-08-06 05:11:13,832][52647] Sum rewards: 84.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.375', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.112', 'weapon5': '0.152', 'AMMO3': '0.231', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '71.000'} [2024-08-06 05:11:14,678][52659] DAMAGECOUNT value on done: 597399.0 [2024-08-06 05:11:14,679][52659] Sum rewards: 79.859, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.535', 'AMMO5': '0.008', 'AMMO2': '0.043', 'AMMO3': '0.146', 'weapon4': '0.148', 'weapon5': '0.156', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:15,534][52665] DAMAGECOUNT value on done: 600982.0 [2024-08-06 05:11:15,535][52665] Sum rewards: 73.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:15,779][52794] DAMAGECOUNT value on done: 603290.0 [2024-08-06 05:11:15,779][52794] Sum rewards: 69.772, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.150', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.304', 'WEAPON3': '1.750', 'weapon3': '3.452', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '61.000'} [2024-08-06 05:11:16,576][52647] DAMAGECOUNT value on done: 631536.0 [2024-08-06 05:11:16,576][52647] Sum rewards: 70.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.702', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.059', 'AMMO3': '0.186', 'weapon5': '0.250', 'AMMO4': '0.297', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.480', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '59.500'} [2024-08-06 05:11:16,741][52650] Updated weights for policy 0, policy_version 59211 (0.0012) [2024-08-06 05:11:17,761][52659] DAMAGECOUNT value on done: 600451.0 [2024-08-06 05:11:17,761][52659] Sum rewards: 77.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.170', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.130', 'weapon5': '0.154', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 485072896. Throughput: 0: 4372.4. Samples: 121267590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:11:17,794][52567] Avg episode reward: [(0, '72.153')] [2024-08-06 05:11:18,522][52665] DAMAGECOUNT value on done: 599399.0 [2024-08-06 05:11:18,523][52665] Sum rewards: 85.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.905', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.180', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.147', 'FRAGCOUNT': '67.000'} [2024-08-06 05:11:18,598][52794] DAMAGECOUNT value on done: 608556.0 [2024-08-06 05:11:18,598][52794] Sum rewards: 74.178, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.090', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO4': '0.205', 'weapon2': '0.236', 'weapon4': '0.278', 'AMMO3': '0.280', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.848', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '63.000'} [2024-08-06 05:11:19,109][52647] DAMAGECOUNT value on done: 623310.0 [2024-08-06 05:11:19,110][52647] Sum rewards: 73.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.378', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.059', 'weapon4': '0.198', 'AMMO3': '0.270', 'weapon2': '0.272', 'weapon5': '0.292', 'AMMO4': '0.295', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.864', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:20,560][52659] DAMAGECOUNT value on done: 614713.0 [2024-08-06 05:11:20,562][52659] Sum rewards: 66.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.249', 'weapon2': '0.376', 'WEAPON3': '1.600', 'weapon3': '3.296', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '57.000'} [2024-08-06 05:11:21,076][52650] Updated weights for policy 0, policy_version 59221 (0.0016) [2024-08-06 05:11:21,179][52794] DAMAGECOUNT value on done: 595181.0 [2024-08-06 05:11:21,181][52794] Sum rewards: 57.880, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.844', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '48.000'} [2024-08-06 05:11:21,508][52665] DAMAGECOUNT value on done: 597337.0 [2024-08-06 05:11:21,508][52665] Sum rewards: 79.476, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.126', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'weapon4': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:21,838][52647] DAMAGECOUNT value on done: 627257.0 [2024-08-06 05:11:21,840][52647] Sum rewards: 60.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.270', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.288', 'WEAPON3': '1.700', 'HITCOUNT': '3.160', 'weapon3': '3.328', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '53.000'} [2024-08-06 05:11:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 485154816. Throughput: 0: 4371.8. Samples: 121293780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:11:22,802][52567] Avg episode reward: [(0, '72.087')] [2024-08-06 05:11:23,027][52614] Signal inference workers to stop experience collection... (10750 times) [2024-08-06 05:11:23,028][52614] Signal inference workers to resume experience collection... (10750 times) [2024-08-06 05:11:23,066][52650] InferenceWorker_p0-w0: stopping experience collection (10750 times) [2024-08-06 05:11:23,067][52650] InferenceWorker_p0-w0: resuming experience collection (10750 times) [2024-08-06 05:11:23,778][52659] DAMAGECOUNT value on done: 605879.0 [2024-08-06 05:11:23,780][52659] Sum rewards: 86.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.565', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.210', 'weapon5': '0.234', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '70.000'} [2024-08-06 05:11:23,999][52794] DAMAGECOUNT value on done: 608173.0 [2024-08-06 05:11:24,002][52794] Sum rewards: 65.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.698', 'AMMO5': '0.019', 'AMMO2': '0.059', 'AMMO3': '0.203', 'weapon4': '0.206', 'weapon2': '0.228', 'weapon5': '0.240', 'AMMO4': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '52.000'} [2024-08-06 05:11:24,647][52665] DAMAGECOUNT value on done: 594343.0 [2024-08-06 05:11:24,650][52665] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'AMMO4': '0.166', 'weapon2': '0.394', 'WEAPON3': '0.900', 'HITCOUNT': '2.910', 'weapon3': '3.074', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '53.000'} [2024-08-06 05:11:26,071][52650] Updated weights for policy 0, policy_version 59231 (0.0023) [2024-08-06 05:11:26,130][52667] DAMAGECOUNT value on done: 604710.0 [2024-08-06 05:11:26,134][52667] Sum rewards: 69.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.186', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.136', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.632', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '57.000'} [2024-08-06 05:11:26,815][52659] DAMAGECOUNT value on done: 612182.0 [2024-08-06 05:11:26,816][52659] Sum rewards: 77.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.038', 'weapon5': '0.136', 'AMMO4': '0.172', 'AMMO3': '0.245', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '65.000'} [2024-08-06 05:11:26,986][52794] DAMAGECOUNT value on done: 600756.0 [2024-08-06 05:11:26,988][52794] Sum rewards: 74.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.212', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.342', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 485253120. Throughput: 0: 4368.4. Samples: 121320030. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:11:27,802][52567] Avg episode reward: [(0, '72.393')] [2024-08-06 05:11:27,957][52665] DAMAGECOUNT value on done: 593681.0 [2024-08-06 05:11:27,959][52665] Sum rewards: 66.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.632', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.238', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '56.000'} [2024-08-06 05:11:28,990][52667] DAMAGECOUNT value on done: 611460.0 [2024-08-06 05:11:28,991][52667] Sum rewards: 70.383, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.064', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO3': '0.145', 'AMMO4': '0.151', 'weapon5': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '56.000'} [2024-08-06 05:11:29,739][52794] DAMAGECOUNT value on done: 599426.0 [2024-08-06 05:11:29,739][52794] Sum rewards: 69.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.662', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.168', 'weapon2': '0.244', 'AMMO4': '0.248', 'AMMO3': '0.258', 'weapon5': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '60.000'} [2024-08-06 05:11:29,921][52659] DAMAGECOUNT value on done: 602455.0 [2024-08-06 05:11:29,921][52659] Sum rewards: 78.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.727', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.124', 'weapon5': '0.126', 'weapon2': '0.178', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.404', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:30,615][52650] Updated weights for policy 0, policy_version 59241 (0.0028) [2024-08-06 05:11:30,852][52665] DAMAGECOUNT value on done: 596573.0 [2024-08-06 05:11:30,854][52665] Sum rewards: 63.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.058', 'AMMO3': '0.134', 'weapon4': '0.144', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '0.950', 'weapon3': '2.980', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '51.000'} [2024-08-06 05:11:31,410][52658] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:11:31,630][52667] DAMAGECOUNT value on done: 607438.0 [2024-08-06 05:11:31,632][52667] Sum rewards: 77.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.171', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.312', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '65.000'} [2024-08-06 05:11:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 485335040. Throughput: 0: 4369.3. Samples: 121333280. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:11:32,794][52567] Avg episode reward: [(0, '72.084')] [2024-08-06 05:11:32,808][52794] DAMAGECOUNT value on done: 603682.0 [2024-08-06 05:11:32,808][52794] Sum rewards: 69.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.458', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.500'} [2024-08-06 05:11:32,879][52659] DAMAGECOUNT value on done: 608901.0 [2024-08-06 05:11:32,881][52659] Sum rewards: 66.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.295', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon4': '0.172', 'AMMO3': '0.244', 'weapon5': '0.284', 'AMMO4': '0.324', 'weapon2': '0.344', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '2.904', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '54.000'} [2024-08-06 05:11:33,225][52665] DAMAGECOUNT value on done: 591505.0 [2024-08-06 05:11:33,225][52665] Sum rewards: 65.789, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.945', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.116', 'AMMO3': '0.176', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.758', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '54.000'} [2024-08-06 05:11:34,687][52667] DAMAGECOUNT value on done: 607893.0 [2024-08-06 05:11:34,688][52667] Sum rewards: 69.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.490', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.244', 'weapon2': '0.562', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '59.000'} [2024-08-06 05:11:35,292][52650] Updated weights for policy 0, policy_version 59251 (0.0010) [2024-08-06 05:11:35,437][52794] DAMAGECOUNT value on done: 596817.0 [2024-08-06 05:11:35,437][52794] Sum rewards: 67.728, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.724', 'AMMO5': '0.016', 'AMMO2': '0.066', 'AMMO3': '0.148', 'weapon5': '0.188', 'AMMO4': '0.331', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.810', 'WEAPON3': '1.000', 'weapon3': '2.384', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '55.000'} [2024-08-06 05:11:35,440][52659] DAMAGECOUNT value on done: 602822.0 [2024-08-06 05:11:35,440][52659] Sum rewards: 65.175, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.740', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.124', 'weapon5': '0.140', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.301', 'weapon2': '0.376', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.000'} [2024-08-06 05:11:35,780][52665] DAMAGECOUNT value on done: 592721.0 [2024-08-06 05:11:35,781][52665] Sum rewards: 63.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.245', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.166', 'AMMO3': '0.218', 'weapon5': '0.226', 'AMMO4': '0.251', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.546', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '53.000'} [2024-08-06 05:11:37,107][52663] DAMAGECOUNT value on done: 613585.0 [2024-08-06 05:11:37,107][52663] Sum rewards: 83.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.082', 'weapon5': '0.116', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '68.000'} [2024-08-06 05:11:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 485416960. Throughput: 0: 4378.0. Samples: 121359640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:11:37,802][52567] Avg episode reward: [(0, '72.119')] [2024-08-06 05:11:37,812][52794] DAMAGECOUNT value on done: 617855.0 [2024-08-06 05:11:37,813][52794] Sum rewards: 77.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.154', 'AMMO4': '0.179', 'weapon5': '0.214', 'AMMO3': '0.218', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 05:11:37,835][52667] DAMAGECOUNT value on done: 611814.0 [2024-08-06 05:11:37,836][52667] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.724', 'AMMO5': '0.013', 'AMMO2': '0.014', 'weapon5': '0.044', 'weapon4': '0.060', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '54.000'} [2024-08-06 05:11:38,566][52665] DAMAGECOUNT value on done: 596947.0 [2024-08-06 05:11:38,567][52665] Sum rewards: 72.730, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.334', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon4': '0.154', 'weapon5': '0.188', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:39,607][52663] DAMAGECOUNT value on done: 603831.0 [2024-08-06 05:11:39,609][52663] Sum rewards: 82.651, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.950', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.084', 'AMMO4': '0.159', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '72.000'} [2024-08-06 05:11:39,916][52650] Updated weights for policy 0, policy_version 59261 (0.0033) [2024-08-06 05:11:40,676][52794] DAMAGECOUNT value on done: 597800.0 [2024-08-06 05:11:40,680][52794] Sum rewards: 83.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.459', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon2': '0.116', 'weapon4': '0.142', 'AMMO4': '0.149', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.546', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '67.000'} [2024-08-06 05:11:40,956][52667] DAMAGECOUNT value on done: 614499.0 [2024-08-06 05:11:40,961][52667] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.185', 'weapon5': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '59.000'} [2024-08-06 05:11:42,506][52663] DAMAGECOUNT value on done: 593671.0 [2024-08-06 05:11:42,506][52663] Sum rewards: 75.162, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.482', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.080', 'AMMO4': '0.178', 'weapon5': '0.256', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.946', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 485515264. Throughput: 0: 4382.4. Samples: 121385970. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:11:42,802][52567] Avg episode reward: [(0, '72.386')] [2024-08-06 05:11:43,088][52664] DAMAGECOUNT value on done: 626047.0 [2024-08-06 05:11:43,088][52664] Sum rewards: 84.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.244', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '69.000'} [2024-08-06 05:11:43,512][52667] DAMAGECOUNT value on done: 609137.0 [2024-08-06 05:11:43,512][52667] Sum rewards: 71.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.040', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.119', 'weapon4': '0.180', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.686', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '59.000'} [2024-08-06 05:11:43,761][52794] DAMAGECOUNT value on done: 611768.0 [2024-08-06 05:11:43,763][52794] Sum rewards: 80.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon5': '0.156', 'AMMO3': '0.175', 'AMMO4': '0.200', 'weapon4': '0.222', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '66.000'} [2024-08-06 05:11:44,823][52650] Updated weights for policy 0, policy_version 59271 (0.0032) [2024-08-06 05:11:45,638][52663] DAMAGECOUNT value on done: 601683.0 [2024-08-06 05:11:45,638][52663] Sum rewards: 78.510, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.470', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.066', 'weapon5': '0.206', 'AMMO4': '0.251', 'weapon2': '0.266', 'AMMO3': '0.323', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.106', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '69.000'} [2024-08-06 05:11:45,852][52664] DAMAGECOUNT value on done: 630052.0 [2024-08-06 05:11:45,853][52664] Sum rewards: 69.522, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.790', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon2': '0.370', 'WEAPON3': '1.600', 'weapon3': '3.202', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:46,172][52667] DAMAGECOUNT value on done: 603786.0 [2024-08-06 05:11:46,173][52667] Sum rewards: 78.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.112', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '62.000'} [2024-08-06 05:11:46,974][52794] DAMAGECOUNT value on done: 604338.0 [2024-08-06 05:11:46,974][52794] Sum rewards: 66.275, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.315', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'weapon4': '0.054', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.656', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.088', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '53.000'} [2024-08-06 05:11:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 485597184. Throughput: 0: 4382.7. Samples: 121399130. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:11:47,802][52567] Avg episode reward: [(0, '72.946')] [2024-08-06 05:11:48,451][52663] DAMAGECOUNT value on done: 605646.0 [2024-08-06 05:11:48,451][52663] Sum rewards: 76.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.292', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:48,764][52667] DAMAGECOUNT value on done: 610487.0 [2024-08-06 05:11:48,764][52667] Sum rewards: 72.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.159', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.094', 'weapon5': '0.102', 'AMMO4': '0.123', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.600', 'weapon3': '2.968', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '61.000'} [2024-08-06 05:11:49,023][52664] DAMAGECOUNT value on done: 630116.0 [2024-08-06 05:11:49,024][52664] Sum rewards: 88.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.247', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon4': '0.130', 'weapon5': '0.138', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.176', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '70.000'} [2024-08-06 05:11:49,365][52650] Updated weights for policy 0, policy_version 59281 (0.0030) [2024-08-06 05:11:49,857][52794] DAMAGECOUNT value on done: 612109.0 [2024-08-06 05:11:49,861][52794] Sum rewards: 87.666, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.112', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon4': '0.148', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '69.000'} [2024-08-06 05:11:51,182][52663] DAMAGECOUNT value on done: 611675.0 [2024-08-06 05:11:51,184][52663] Sum rewards: 65.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.618', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.224', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '56.000'} [2024-08-06 05:11:51,561][52664] DAMAGECOUNT value on done: 621509.0 [2024-08-06 05:11:51,561][52664] Sum rewards: 59.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.638', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.207', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.098', 'DAMAGECOUNT': '13.989', 'FRAGCOUNT': '51.000'} [2024-08-06 05:11:51,935][52667] DAMAGECOUNT value on done: 612217.0 [2024-08-06 05:11:51,937][52667] Sum rewards: 74.957, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.875', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.112', 'weapon5': '0.140', 'AMMO4': '0.227', 'AMMO3': '0.231', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:51,954][52666] DAMAGECOUNT value on done: 604274.0 [2024-08-06 05:11:51,955][52666] Sum rewards: 61.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.164', 'AMMO4': '0.166', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.056', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '51.000'} [2024-08-06 05:11:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 485687296. Throughput: 0: 4386.0. Samples: 121425550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:11:52,802][52567] Avg episode reward: [(0, '73.159')] [2024-08-06 05:11:53,037][52794] DAMAGECOUNT value on done: 613076.0 [2024-08-06 05:11:53,039][52794] Sum rewards: 72.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.692', 'AMMO5': '0.021', 'AMMO2': '0.035', 'weapon4': '0.108', 'AMMO3': '0.161', 'AMMO4': '0.176', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '1.050', 'WEAPON3': '1.100', 'weapon3': '2.360', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '59.500'} [2024-08-06 05:11:53,542][52670] DAMAGECOUNT value on done: 594483.0 [2024-08-06 05:11:53,543][52670] Sum rewards: 76.455, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.896', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.122', 'weapon5': '0.134', 'AMMO4': '0.148', 'weapon2': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.305', 'WEAPON3': '1.850', 'weapon3': '3.272', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '67.000'} [2024-08-06 05:11:53,835][52650] Updated weights for policy 0, policy_version 59291 (0.0020) [2024-08-06 05:11:54,089][52663] DAMAGECOUNT value on done: 604438.0 [2024-08-06 05:11:54,090][52663] Sum rewards: 76.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.502', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.090', 'weapon5': '0.124', 'AMMO3': '0.208', 'AMMO4': '0.277', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '61.000'} [2024-08-06 05:11:54,591][52664] DAMAGECOUNT value on done: 629576.0 [2024-08-06 05:11:54,592][52664] Sum rewards: 78.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.089', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '65.000'} [2024-08-06 05:11:54,857][52666] DAMAGECOUNT value on done: 607416.0 [2024-08-06 05:11:54,857][52666] Sum rewards: 65.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.275', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.078', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '55.000'} [2024-08-06 05:11:55,056][52667] DAMAGECOUNT value on done: 600410.0 [2024-08-06 05:11:55,058][52667] Sum rewards: 73.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.130', 'AMMO3': '0.216', 'weapon5': '0.234', 'AMMO4': '0.246', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 05:11:56,071][52670] DAMAGECOUNT value on done: 604595.0 [2024-08-06 05:11:56,071][52670] Sum rewards: 78.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.905', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.064', 'weapon5': '0.066', 'AMMO4': '0.102', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '63.000'} [2024-08-06 05:11:56,243][52794] DAMAGECOUNT value on done: 602770.0 [2024-08-06 05:11:56,245][52794] Sum rewards: 72.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.179', 'weapon4': '0.252', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '58.000'} [2024-08-06 05:11:57,116][52663] DAMAGECOUNT value on done: 598181.0 [2024-08-06 05:11:57,116][52663] Sum rewards: 67.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.545', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.152', 'weapon4': '0.166', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '56.000'} [2024-08-06 05:11:57,547][52664] DAMAGECOUNT value on done: 625554.0 [2024-08-06 05:11:57,547][52664] Sum rewards: 67.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'AMMO4': '0.153', 'weapon4': '0.182', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 05:11:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 485769216. Throughput: 0: 4385.3. Samples: 121451770. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 05:11:57,795][52567] Avg episode reward: [(0, '73.183')] [2024-08-06 05:11:57,850][52667] DAMAGECOUNT value on done: 604708.0 [2024-08-06 05:11:57,851][52667] Sum rewards: 79.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.018', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.074', 'AMMO3': '0.204', 'weapon5': '0.208', 'AMMO4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '65.000'} [2024-08-06 05:11:57,908][52666] DAMAGECOUNT value on done: 607597.0 [2024-08-06 05:11:57,908][52666] Sum rewards: 76.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.308', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.054', 'AMMO4': '0.160', 'weapon5': '0.188', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '64.000'} [2024-08-06 05:11:58,615][52650] Updated weights for policy 0, policy_version 59301 (0.0012) [2024-08-06 05:11:59,246][52670] DAMAGECOUNT value on done: 596080.0 [2024-08-06 05:11:59,246][52670] Sum rewards: 68.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 05:11:59,695][52663] DAMAGECOUNT value on done: 595979.0 [2024-08-06 05:11:59,696][52663] Sum rewards: 78.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.416', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.038', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.194', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.398', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '64.000'} [2024-08-06 05:12:00,042][52664] DAMAGECOUNT value on done: 622873.0 [2024-08-06 05:12:00,042][52664] Sum rewards: 72.664, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.369', 'AMMO5': '0.027', 'AMMO2': '0.060', 'weapon4': '0.202', 'AMMO3': '0.245', 'weapon2': '0.296', 'AMMO4': '0.298', 'weapon5': '0.338', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.798', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:00,789][52667] DAMAGECOUNT value on done: 610012.0 [2024-08-06 05:12:00,791][52667] Sum rewards: 72.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.118', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.090', 'weapon4': '0.120', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '3.022', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:00,846][52666] DAMAGECOUNT value on done: 607158.0 [2024-08-06 05:12:00,846][52666] Sum rewards: 70.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.657', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.052', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.492', 'WEAPON3': '1.700', 'weapon3': '3.206', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:01,541][52794] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:12:02,070][52670] DAMAGECOUNT value on done: 593222.0 [2024-08-06 05:12:02,071][52670] Sum rewards: 64.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.145', 'AMMO3': '0.205', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '53.000'} [2024-08-06 05:12:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 485867520. Throughput: 0: 4383.6. Samples: 121464850. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 05:12:02,802][52567] Avg episode reward: [(0, '73.339')] [2024-08-06 05:12:02,872][52663] DAMAGECOUNT value on done: 603828.0 [2024-08-06 05:12:02,873][52663] Sum rewards: 82.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.130', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '69.000'} [2024-08-06 05:12:02,974][52664] DAMAGECOUNT value on done: 619127.0 [2024-08-06 05:12:02,974][52664] Sum rewards: 76.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.827', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.131', 'weapon5': '0.190', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:03,371][52650] Updated weights for policy 0, policy_version 59311 (0.0033) [2024-08-06 05:12:03,755][52667] DAMAGECOUNT value on done: 600527.0 [2024-08-06 05:12:03,758][52667] Sum rewards: 72.468, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO3': '0.173', 'weapon4': '0.174', 'AMMO4': '0.200', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.184', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:03,787][52666] DAMAGECOUNT value on done: 600083.0 [2024-08-06 05:12:03,789][52666] Sum rewards: 63.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.110', 'weapon4': '0.116', 'AMMO4': '0.197', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '53.000'} [2024-08-06 05:12:05,165][52670] DAMAGECOUNT value on done: 608967.0 [2024-08-06 05:12:05,168][52670] Sum rewards: 74.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO2': '0.012', 'AMMO4': '0.062', 'AMMO3': '0.211', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:05,967][52663] DAMAGECOUNT value on done: 611905.0 [2024-08-06 05:12:05,967][52663] Sum rewards: 74.031, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.050', 'AMMO4': '0.066', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:06,245][52667] DAMAGECOUNT value on done: 609113.0 [2024-08-06 05:12:06,248][52667] Sum rewards: 64.429, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.915', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.142', 'AMMO4': '0.151', 'weapon2': '0.208', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.120', 'weapon3': '3.338', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '56.000'} [2024-08-06 05:12:06,330][52664] DAMAGECOUNT value on done: 631091.0 [2024-08-06 05:12:06,331][52664] Sum rewards: 78.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.493', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.148', 'AMMO3': '0.202', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2024-08-06 05:12:07,084][52666] DAMAGECOUNT value on done: 597378.0 [2024-08-06 05:12:07,084][52666] Sum rewards: 77.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.142', 'weapon2': '0.190', 'AMMO4': '0.221', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 485949440. Throughput: 0: 4386.0. Samples: 121491150. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 05:12:07,795][52567] Avg episode reward: [(0, '73.764')] [2024-08-06 05:12:08,165][52650] Updated weights for policy 0, policy_version 59321 (0.0012) [2024-08-06 05:12:08,240][52670] DAMAGECOUNT value on done: 602255.0 [2024-08-06 05:12:08,242][52670] Sum rewards: 74.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.121', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:08,555][52663] DAMAGECOUNT value on done: 598525.0 [2024-08-06 05:12:08,555][52663] Sum rewards: 66.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.367', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.134', 'weapon4': '0.188', 'AMMO3': '0.195', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '56.000'} [2024-08-06 05:12:09,105][52664] DAMAGECOUNT value on done: 623192.0 [2024-08-06 05:12:09,106][52664] Sum rewards: 68.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'weapon2': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.328', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:09,337][52667] DAMAGECOUNT value on done: 616143.0 [2024-08-06 05:12:09,338][52667] Sum rewards: 79.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.124', 'weapon5': '0.134', 'AMMO4': '0.152', 'weapon2': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:09,643][52795] DAMAGECOUNT value on done: 561443.0 [2024-08-06 05:12:09,644][52795] Sum rewards: 58.250, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.046', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon7': '0.168', 'AMMO3': '0.174', 'weapon2': '0.318', 'weapon4': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.626', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '46.000'} [2024-08-06 05:12:09,974][52666] DAMAGECOUNT value on done: 602642.0 [2024-08-06 05:12:09,974][52666] Sum rewards: 69.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.178', 'AMMO4': '0.205', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:11,273][52670] DAMAGECOUNT value on done: 591818.0 [2024-08-06 05:12:11,274][52670] Sum rewards: 72.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.175', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:11,546][52663] DAMAGECOUNT value on done: 595682.0 [2024-08-06 05:12:11,546][52663] Sum rewards: 76.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.807', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '65.500'} [2024-08-06 05:12:11,597][52664] DAMAGECOUNT value on done: 632011.0 [2024-08-06 05:12:11,598][52664] Sum rewards: 76.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.348', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.070', 'AMMO4': '0.090', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '64.000'} [2024-08-06 05:12:12,210][52667] DAMAGECOUNT value on done: 613841.0 [2024-08-06 05:12:12,212][52667] Sum rewards: 72.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.312', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.193', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:12,405][52669] DAMAGECOUNT value on done: 608271.0 [2024-08-06 05:12:12,405][52669] Sum rewards: 72.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.118', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 486031360. Throughput: 0: 4389.3. Samples: 121517550. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 05:12:12,795][52567] Avg episode reward: [(0, '73.018')] [2024-08-06 05:12:12,808][52650] Updated weights for policy 0, policy_version 59331 (0.0015) [2024-08-06 05:12:12,835][52666] DAMAGECOUNT value on done: 599999.0 [2024-08-06 05:12:12,836][52666] Sum rewards: 68.860, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.081', 'weapon5': '0.112', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.194', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '56.000'} [2024-08-06 05:12:12,879][52795] DAMAGECOUNT value on done: 551973.0 [2024-08-06 05:12:12,880][52795] Sum rewards: 77.204, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.018', 'AMMO2': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.259', 'weapon2': '0.498', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:13,854][52670] DAMAGECOUNT value on done: 600688.0 [2024-08-06 05:12:13,856][52670] Sum rewards: 78.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.460', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.248', 'WEAPON3': '1.600', 'weapon3': '3.496', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:14,279][52663] DAMAGECOUNT value on done: 601416.0 [2024-08-06 05:12:14,279][52663] Sum rewards: 77.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.212', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.184', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.362', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.774', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:14,798][52664] DAMAGECOUNT value on done: 628751.0 [2024-08-06 05:12:14,798][52664] Sum rewards: 53.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.260', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.132', 'AMMO4': '0.182', 'AMMO3': '0.238', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.256', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '47.000'} [2024-08-06 05:12:15,009][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:12:15,079][52667] DAMAGECOUNT value on done: 613847.0 [2024-08-06 05:12:15,081][52667] Sum rewards: 73.082, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.708', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.251', 'weapon2': '0.260', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:15,299][52669] DAMAGECOUNT value on done: 599028.0 [2024-08-06 05:12:15,299][52669] Sum rewards: 73.673, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.223', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.124', 'AMMO3': '0.144', 'AMMO4': '0.234', 'weapon5': '0.294', 'weapon2': '0.494', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.826', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '57.500'} [2024-08-06 05:12:15,523][52666] DAMAGECOUNT value on done: 602449.0 [2024-08-06 05:12:15,525][52666] Sum rewards: 73.855, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.434', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.104', 'weapon5': '0.180', 'AMMO3': '0.259', 'AMMO4': '0.263', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.924', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 05:12:16,042][52795] DAMAGECOUNT value on done: 549900.0 [2024-08-06 05:12:16,042][52795] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.180', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.754', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:16,822][52670] DAMAGECOUNT value on done: 598352.0 [2024-08-06 05:12:16,823][52670] Sum rewards: 74.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon2': '0.248', 'AMMO3': '0.277', 'WEAPON3': '1.750', 'weapon3': '3.532', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:17,263][52664] DAMAGECOUNT value on done: 633429.0 [2024-08-06 05:12:17,264][52664] Sum rewards: 73.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.126', 'weapon4': '0.176', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:17,466][52663] DAMAGECOUNT value on done: 597577.0 [2024-08-06 05:12:17,466][52663] Sum rewards: 71.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:17,637][52650] Updated weights for policy 0, policy_version 59341 (0.0024) [2024-08-06 05:12:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 486121472. Throughput: 0: 4384.2. Samples: 121530570. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 05:12:17,794][52567] Avg episode reward: [(0, '72.661')] [2024-08-06 05:12:17,873][52667] DAMAGECOUNT value on done: 607056.0 [2024-08-06 05:12:17,874][52667] Sum rewards: 75.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.470', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.086', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'weapon3': '3.440', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:18,312][52666] DAMAGECOUNT value on done: 595852.0 [2024-08-06 05:12:18,314][52666] Sum rewards: 63.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.200', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2024-08-06 05:12:18,419][52669] DAMAGECOUNT value on done: 610170.0 [2024-08-06 05:12:18,419][52669] Sum rewards: 84.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.309', 'FRAGCOUNT': '69.000'} [2024-08-06 05:12:19,236][52795] DAMAGECOUNT value on done: 557721.0 [2024-08-06 05:12:19,238][52795] Sum rewards: 72.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.705', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.195', 'weapon5': '0.240', 'weapon4': '0.276', 'AMMO4': '0.292', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:19,636][52670] DAMAGECOUNT value on done: 595848.0 [2024-08-06 05:12:19,638][52670] Sum rewards: 65.935, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.080', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.168', 'weapon5': '0.258', 'AMMO4': '0.297', 'AMMO3': '0.306', 'weapon2': '0.336', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.862', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:20,022][52664] DAMAGECOUNT value on done: 635040.0 [2024-08-06 05:12:20,024][52664] Sum rewards: 79.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.342', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:20,449][52663] DAMAGECOUNT value on done: 608235.0 [2024-08-06 05:12:20,449][52663] Sum rewards: 65.109, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.247', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.164', 'weapon4': '0.218', 'AMMO3': '0.246', 'AMMO4': '0.248', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '55.000'} [2024-08-06 05:12:20,503][52667] DAMAGECOUNT value on done: 614253.0 [2024-08-06 05:12:20,504][52667] Sum rewards: 77.382, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.060', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.142', 'AMMO4': '0.170', 'weapon2': '0.210', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.336', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:21,224][52666] DAMAGECOUNT value on done: 597464.0 [2024-08-06 05:12:21,225][52666] Sum rewards: 64.581, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.054', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon2': '0.218', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.200', 'weapon3': '3.372', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:21,394][52669] DAMAGECOUNT value on done: 609626.0 [2024-08-06 05:12:21,397][52669] Sum rewards: 67.537, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.260', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.148', 'AMMO4': '0.151', 'weapon5': '0.226', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.312', 'WEAPON3': '1.700', 'weapon3': '3.034', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:21,861][52650] Updated weights for policy 0, policy_version 59351 (0.0033) [2024-08-06 05:12:22,245][52664] DAMAGECOUNT value on done: 636487.0 [2024-08-06 05:12:22,245][52664] Sum rewards: 71.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.023', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.074', 'weapon4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.548', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:22,331][52795] DAMAGECOUNT value on done: 555459.0 [2024-08-06 05:12:22,331][52795] Sum rewards: 64.092, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.364', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.158', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '55.000'} [2024-08-06 05:12:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 486211584. Throughput: 0: 4372.9. Samples: 121556420. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 05:12:22,798][52671] DAMAGECOUNT value on done: 611173.0 [2024-08-06 05:12:22,802][52567] Avg episode reward: [(0, '72.543')] [2024-08-06 05:12:22,802][52671] Sum rewards: 71.556, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.237', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO3': '0.132', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.776', 'WEAPON3': '0.800', 'weapon3': '2.904', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '56.000'} [2024-08-06 05:12:22,823][52670] DAMAGECOUNT value on done: 604326.0 [2024-08-06 05:12:22,825][52670] Sum rewards: 76.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.148', 'AMMO4': '0.207', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '64.000'} [2024-08-06 05:12:22,957][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:12:23,380][52663] DAMAGECOUNT value on done: 600331.0 [2024-08-06 05:12:23,381][52663] Sum rewards: 71.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.126', 'weapon4': '0.168', 'AMMO4': '0.225', 'AMMO3': '0.242', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:24,444][52669] DAMAGECOUNT value on done: 604918.0 [2024-08-06 05:12:24,445][52669] Sum rewards: 78.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.776', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.150', 'weapon5': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.185', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:24,650][52664] DAMAGECOUNT value on done: 626813.0 [2024-08-06 05:12:24,650][52664] Sum rewards: 65.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '55.000'} [2024-08-06 05:12:24,743][52666] DAMAGECOUNT value on done: 592084.0 [2024-08-06 05:12:24,743][52666] Sum rewards: 72.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.122', 'AMMO3': '0.212', 'weapon5': '0.218', 'AMMO4': '0.262', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:25,529][52671] DAMAGECOUNT value on done: 613146.0 [2024-08-06 05:12:25,530][52671] Sum rewards: 75.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.504', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:25,541][52795] DAMAGECOUNT value on done: 565030.0 [2024-08-06 05:12:25,542][52795] Sum rewards: 82.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.655', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.087', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.316', 'WEAPON3': '1.650', 'weapon3': '3.350', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '70.000'} [2024-08-06 05:12:25,990][52670] DAMAGECOUNT value on done: 590305.0 [2024-08-06 05:12:25,991][52670] Sum rewards: 64.175, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.150', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '2.796', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:26,072][52663] DAMAGECOUNT value on done: 609573.0 [2024-08-06 05:12:26,074][52663] Sum rewards: 77.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.283', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.205', 'weapon2': '0.210', 'weapon5': '0.226', 'AMMO4': '0.236', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:26,089][52820] DAMAGECOUNT value on done: 557937.0 [2024-08-06 05:12:26,092][52820] Sum rewards: 76.406, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.232', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.150', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:26,114][52658] DAMAGECOUNT value on done: 608478.0 [2024-08-06 05:12:26,114][52658] Sum rewards: 90.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.878', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.196', 'weapon5': '0.206', 'AMMO4': '0.238', 'weapon4': '0.276', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '74.000'} [2024-08-06 05:12:26,638][52649] DAMAGECOUNT value on done: 585818.0 [2024-08-06 05:12:26,639][52649] Sum rewards: 74.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.276', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.092', 'weapon5': '0.176', 'AMMO3': '0.193', 'AMMO4': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:26,817][52669] DAMAGECOUNT value on done: 612175.0 [2024-08-06 05:12:26,819][52669] Sum rewards: 74.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.729', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.112', 'weapon5': '0.160', 'AMMO4': '0.198', 'weapon2': '0.218', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.244', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:26,991][52650] Updated weights for policy 0, policy_version 59361 (0.0026) [2024-08-06 05:12:27,536][52664] DAMAGECOUNT value on done: 623122.0 [2024-08-06 05:12:27,537][52664] Sum rewards: 71.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.166', 'AMMO3': '0.203', 'weapon5': '0.222', 'AMMO4': '0.272', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 486301696. Throughput: 0: 4374.2. Samples: 121582810. Policy #0 lag: (min: 0.0, avg: 3.0, max: 8.0) [2024-08-06 05:12:27,794][52567] Avg episode reward: [(0, '73.356')] [2024-08-06 05:12:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059363_486301696.pth... [2024-08-06 05:12:27,937][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000058851_482107392.pth [2024-08-06 05:12:28,114][52666] DAMAGECOUNT value on done: 606083.0 [2024-08-06 05:12:28,115][52666] Sum rewards: 74.733, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.218', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.252', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:28,619][52671] DAMAGECOUNT value on done: 609753.0 [2024-08-06 05:12:28,619][52671] Sum rewards: 72.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.522', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.204', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.328', 'ARMOR': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:28,758][52795] DAMAGECOUNT value on done: 568777.0 [2024-08-06 05:12:28,758][52795] Sum rewards: 87.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.960', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.145', 'weapon5': '0.166', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '72.500'} [2024-08-06 05:12:28,783][52663] DAMAGECOUNT value on done: 609372.0 [2024-08-06 05:12:28,783][52658] DAMAGECOUNT value on done: 605860.0 [2024-08-06 05:12:28,785][52658] Sum rewards: 73.082, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.210', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.090', 'weapon5': '0.228', 'AMMO4': '0.230', 'weapon2': '0.284', 'AMMO3': '0.293', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:28,786][52663] Sum rewards: 76.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.242', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon2': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon4': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:29,341][52649] DAMAGECOUNT value on done: 578441.0 [2024-08-06 05:12:29,342][52649] Sum rewards: 71.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.634', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.174', 'AMMO3': '0.206', 'AMMO4': '0.226', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:29,428][52820] DAMAGECOUNT value on done: 561344.0 [2024-08-06 05:12:29,428][52820] Sum rewards: 78.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.274', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:29,630][52670] DAMAGECOUNT value on done: 598958.0 [2024-08-06 05:12:29,630][52670] Sum rewards: 83.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.117', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.408', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '70.000'} [2024-08-06 05:12:29,758][52669] DAMAGECOUNT value on done: 608627.0 [2024-08-06 05:12:29,758][52669] Sum rewards: 79.751, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.385', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'weapon2': '0.246', 'AMMO3': '0.253', 'WEAPON3': '1.650', 'weapon3': '3.568', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '68.000'} [2024-08-06 05:12:30,731][52664] DAMAGECOUNT value on done: 627767.0 [2024-08-06 05:12:30,731][52664] Sum rewards: 78.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '68.000'} [2024-08-06 05:12:31,336][52666] DAMAGECOUNT value on done: 598599.0 [2024-08-06 05:12:31,337][52666] Sum rewards: 67.775, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.706', 'AMMO2': '0.023', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.192', 'weapon2': '0.706', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '55.000'} [2024-08-06 05:12:31,502][52650] Updated weights for policy 0, policy_version 59371 (0.0027) [2024-08-06 05:12:31,598][52671] DAMAGECOUNT value on done: 610091.0 [2024-08-06 05:12:31,599][52671] Sum rewards: 72.664, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.623', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.138', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'weapon3': '3.310', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:31,709][52658] DAMAGECOUNT value on done: 611803.0 [2024-08-06 05:12:31,710][52658] Sum rewards: 65.696, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.623', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.096', 'AMMO3': '0.242', 'AMMO4': '0.250', 'weapon5': '0.256', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:31,796][52663] DAMAGECOUNT value on done: 600327.0 [2024-08-06 05:12:31,798][52663] Sum rewards: 87.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.742', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.174', 'weapon4': '0.178', 'weapon2': '0.216', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '70.000'} [2024-08-06 05:12:32,228][52649] DAMAGECOUNT value on done: 597077.0 [2024-08-06 05:12:32,229][52649] Sum rewards: 69.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.594', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO4': '0.170', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:32,242][52795] DAMAGECOUNT value on done: 560360.0 [2024-08-06 05:12:32,243][52795] Sum rewards: 68.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.568', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.080', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'weapon5': '0.224', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:32,467][52820] DAMAGECOUNT value on done: 563524.0 [2024-08-06 05:12:32,468][52820] Sum rewards: 74.142, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.042', 'AMMO4': '0.099', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:32,598][52670] DAMAGECOUNT value on done: 607614.0 [2024-08-06 05:12:32,599][52670] Sum rewards: 67.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.664', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.206', 'AMMO3': '0.238', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.000'} [2024-08-06 05:12:32,747][52669] DAMAGECOUNT value on done: 607740.0 [2024-08-06 05:12:32,747][52669] Sum rewards: 62.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.781', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.137', 'AMMO3': '0.203', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '52.000'} [2024-08-06 05:12:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 486383616. Throughput: 0: 4365.1. Samples: 121595560. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:12:32,794][52567] Avg episode reward: [(0, '73.102')] [2024-08-06 05:12:33,449][52664] DAMAGECOUNT value on done: 628191.0 [2024-08-06 05:12:33,457][52664] Sum rewards: 79.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.502', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.080', 'weapon5': '0.082', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.288', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:34,193][52658] DAMAGECOUNT value on done: 610261.0 [2024-08-06 05:12:34,195][52658] Sum rewards: 76.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.856', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.122', 'weapon5': '0.196', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:34,303][52666] DAMAGECOUNT value on done: 602901.0 [2024-08-06 05:12:34,303][52666] Sum rewards: 68.461, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.102', 'weapon2': '0.190', 'weapon5': '0.196', 'AMMO4': '0.225', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.178', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:34,725][52671] DAMAGECOUNT value on done: 620960.0 [2024-08-06 05:12:34,726][52671] Sum rewards: 68.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.016', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon2': '0.196', 'AMMO3': '0.225', 'weapon4': '0.288', 'weapon5': '0.298', 'AMMO4': '0.307', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.838', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:35,237][52649] DAMAGECOUNT value on done: 594218.0 [2024-08-06 05:12:35,237][52649] Sum rewards: 78.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.412', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:35,326][52795] DAMAGECOUNT value on done: 554303.0 [2024-08-06 05:12:35,331][52795] Sum rewards: 82.390, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.856', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.089', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '70.000'} [2024-08-06 05:12:35,451][52820] DAMAGECOUNT value on done: 556463.0 [2024-08-06 05:12:35,452][52820] Sum rewards: 83.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.522', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.124', 'weapon2': '0.176', 'weapon5': '0.190', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '68.000'} [2024-08-06 05:12:35,646][52670] DAMAGECOUNT value on done: 602610.0 [2024-08-06 05:12:35,652][52670] Sum rewards: 77.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.988', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.125', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:35,733][52669] DAMAGECOUNT value on done: 615931.0 [2024-08-06 05:12:35,734][52669] Sum rewards: 70.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.454', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO4': '0.209', 'weapon2': '0.218', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:35,798][52664] DAMAGECOUNT value on done: 628169.0 [2024-08-06 05:12:35,798][52664] Sum rewards: 77.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.474', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.163', 'weapon2': '0.284', 'WEAPON3': '1.000', 'weapon3': '3.432', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:36,344][52650] Updated weights for policy 0, policy_version 59381 (0.0023) [2024-08-06 05:12:37,025][52658] DAMAGECOUNT value on done: 598532.0 [2024-08-06 05:12:37,025][52658] Sum rewards: 78.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.882', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:37,282][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:12:37,456][52666] DAMAGECOUNT value on done: 596485.0 [2024-08-06 05:12:37,460][52666] Sum rewards: 67.355, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.884', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.114', 'AMMO3': '0.241', 'weapon5': '0.292', 'AMMO4': '0.306', 'weapon2': '0.386', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:37,745][52671] DAMAGECOUNT value on done: 612309.0 [2024-08-06 05:12:37,746][52671] Sum rewards: 81.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.774', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '67.000'} [2024-08-06 05:12:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 486473728. Throughput: 0: 4366.6. Samples: 121622050. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:12:37,795][52567] Avg episode reward: [(0, '73.385')] [2024-08-06 05:12:38,326][52649] DAMAGECOUNT value on done: 581797.0 [2024-08-06 05:12:38,327][52649] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.542', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.152', 'weapon4': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.283', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.192', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:38,388][52795] DAMAGECOUNT value on done: 565207.0 [2024-08-06 05:12:38,389][52795] Sum rewards: 74.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.080', 'weapon5': '0.210', 'AMMO3': '0.241', 'AMMO4': '0.248', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:38,592][52820] DAMAGECOUNT value on done: 563725.0 [2024-08-06 05:12:38,600][52820] Sum rewards: 80.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.094', 'weapon5': '0.180', 'AMMO4': '0.211', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:38,855][52669] DAMAGECOUNT value on done: 607733.0 [2024-08-06 05:12:38,855][52669] Sum rewards: 68.150, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.584', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.142', 'weapon4': '0.152', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.600', 'weapon3': '2.906', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:38,959][52670] DAMAGECOUNT value on done: 587360.0 [2024-08-06 05:12:38,959][52670] Sum rewards: 72.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.813', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.194', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:39,604][52658] DAMAGECOUNT value on done: 603031.0 [2024-08-06 05:12:39,605][52658] Sum rewards: 80.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'weapon4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:40,713][52666] DAMAGECOUNT value on done: 601688.0 [2024-08-06 05:12:40,714][52666] Sum rewards: 82.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.017', 'AMMO2': '0.072', 'weapon4': '0.152', 'weapon2': '0.246', 'AMMO3': '0.253', 'weapon5': '0.306', 'AMMO4': '0.362', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.900', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '21.726', 'FRAGCOUNT': '68.000'} [2024-08-06 05:12:40,772][52671] DAMAGECOUNT value on done: 614863.0 [2024-08-06 05:12:40,772][52671] Sum rewards: 62.311, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.904', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.446', 'weapon2': '0.470', 'WEAPON3': '1.000', 'weapon3': '2.872', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '48.000'} [2024-08-06 05:12:40,784][52650] Updated weights for policy 0, policy_version 59391 (0.0022) [2024-08-06 05:12:41,252][52649] DAMAGECOUNT value on done: 595688.0 [2024-08-06 05:12:41,253][52649] Sum rewards: 85.030, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.282', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '68.000'} [2024-08-06 05:12:41,534][52795] DAMAGECOUNT value on done: 561766.0 [2024-08-06 05:12:41,534][52795] Sum rewards: 85.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.276', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '72.000'} [2024-08-06 05:12:41,795][52820] DAMAGECOUNT value on done: 556411.0 [2024-08-06 05:12:41,796][52820] Sum rewards: 69.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.999', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.176', 'weapon5': '0.178', 'AMMO3': '0.226', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:41,827][52670] DAMAGECOUNT value on done: 597777.0 [2024-08-06 05:12:41,827][52670] Sum rewards: 82.756, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.597', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.088', 'AMMO4': '0.102', 'weapon5': '0.138', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:41,859][52669] DAMAGECOUNT value on done: 612612.0 [2024-08-06 05:12:41,860][52669] Sum rewards: 81.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.311', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:42,179][52811] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 05:12:42,262][52658] DAMAGECOUNT value on done: 610751.0 [2024-08-06 05:12:42,265][52658] Sum rewards: 65.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.436', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.268', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.328', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '56.500'} [2024-08-06 05:12:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 486563840. Throughput: 0: 4365.1. Samples: 121648200. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:12:42,794][52567] Avg episode reward: [(0, '73.934')] [2024-08-06 05:12:43,317][52666] DAMAGECOUNT value on done: 609189.0 [2024-08-06 05:12:43,320][52666] Sum rewards: 82.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.197', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.420', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '68.000'} [2024-08-06 05:12:43,627][52671] DAMAGECOUNT value on done: 610828.0 [2024-08-06 05:12:43,628][52671] Sum rewards: 77.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.154', 'weapon2': '0.172', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:44,403][52670] DAMAGECOUNT value on done: 608055.0 [2024-08-06 05:12:44,404][52670] Sum rewards: 62.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.625', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.166', 'AMMO4': '0.172', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '52.000'} [2024-08-06 05:12:44,487][52649] DAMAGECOUNT value on done: 587826.0 [2024-08-06 05:12:44,487][52649] Sum rewards: 65.861, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO4': '0.190', 'AMMO3': '0.235', 'weapon4': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '55.000'} [2024-08-06 05:12:44,545][52669] DAMAGECOUNT value on done: 612987.0 [2024-08-06 05:12:44,545][52669] Sum rewards: 68.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.289', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.106', 'AMMO4': '0.153', 'AMMO3': '0.196', 'weapon5': '0.228', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.168', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '55.000'} [2024-08-06 05:12:44,707][52795] DAMAGECOUNT value on done: 556291.0 [2024-08-06 05:12:44,707][52795] Sum rewards: 89.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.741', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon4': '0.180', 'AMMO3': '0.267', 'weapon2': '0.280', 'AMMO4': '0.316', 'weapon5': '0.440', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.690', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '22.959', 'FRAGCOUNT': '74.000'} [2024-08-06 05:12:44,952][52820] DAMAGECOUNT value on done: 561183.0 [2024-08-06 05:12:44,956][52820] Sum rewards: 78.324, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.191', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.344', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '67.000'} [2024-08-06 05:12:45,218][52658] DAMAGECOUNT value on done: 601078.0 [2024-08-06 05:12:45,219][52658] Sum rewards: 64.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.545', 'AMMO5': '0.028', 'AMMO2': '0.071', 'AMMO3': '0.219', 'weapon2': '0.292', 'AMMO4': '0.353', 'weapon5': '0.392', 'weapon4': '0.428', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.548', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '52.000'} [2024-08-06 05:12:45,544][52650] Updated weights for policy 0, policy_version 59401 (0.0014) [2024-08-06 05:12:45,920][52668] DAMAGECOUNT value on done: 606511.0 [2024-08-06 05:12:45,920][52668] Sum rewards: 81.376, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.615', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'weapon5': '0.088', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.408', 'weapon2': '0.746', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:46,019][52666] DAMAGECOUNT value on done: 590721.0 [2024-08-06 05:12:46,019][52666] Sum rewards: 76.356, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.176', 'AMMO3': '0.256', 'AMMO4': '0.266', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.798', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:46,599][52671] DAMAGECOUNT value on done: 601713.0 [2024-08-06 05:12:46,599][52671] Sum rewards: 73.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.106', 'AMMO4': '0.106', 'AMMO3': '0.201', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:47,155][52670] DAMAGECOUNT value on done: 597258.0 [2024-08-06 05:12:47,156][52670] Sum rewards: 75.492, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.182', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.290', 'weapon2': '0.490', 'WEAPON3': '1.700', 'weapon3': '3.132', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:47,552][52669] DAMAGECOUNT value on done: 600450.0 [2024-08-06 05:12:47,553][52669] Sum rewards: 67.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.868', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.223', 'weapon5': '0.234', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.000'} [2024-08-06 05:12:47,731][52649] DAMAGECOUNT value on done: 592627.0 [2024-08-06 05:12:47,731][52649] Sum rewards: 76.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.376', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:47,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 486645760. Throughput: 0: 4368.2. Samples: 121661420. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:12:47,794][52567] Avg episode reward: [(0, '74.228')] [2024-08-06 05:12:47,883][52795] DAMAGECOUNT value on done: 556925.0 [2024-08-06 05:12:47,886][52795] Sum rewards: 78.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.714', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.240', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:48,065][52820] DAMAGECOUNT value on done: 564663.0 [2024-08-06 05:12:48,065][52820] Sum rewards: 79.941, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.595', 'AMMO5': '0.008', 'weapon4': '0.052', 'AMMO2': '0.054', 'weapon5': '0.132', 'weapon2': '0.162', 'AMMO4': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'WEAPON3': '1.800', 'weapon3': '3.388', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '70.000'} [2024-08-06 05:12:48,258][52658] DAMAGECOUNT value on done: 620466.0 [2024-08-06 05:12:48,258][52658] Sum rewards: 68.497, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.724', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.058', 'weapon5': '0.130', 'AMMO4': '0.222', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'HITCOUNT': '3.240', 'weapon3': '3.278', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '62.000'} [2024-08-06 05:12:48,675][52668] DAMAGECOUNT value on done: 610268.0 [2024-08-06 05:12:48,675][52668] Sum rewards: 80.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.392', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.226', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '67.000'} [2024-08-06 05:12:48,764][52666] DAMAGECOUNT value on done: 599912.0 [2024-08-06 05:12:48,765][52666] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.240', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.140', 'AMMO4': '0.166', 'weapon5': '0.206', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '60.000'} [2024-08-06 05:12:49,714][52670] DAMAGECOUNT value on done: 602256.0 [2024-08-06 05:12:49,715][52670] Sum rewards: 78.481, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.904', 'AMMO5': '0.005', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'weapon5': '0.118', 'AMMO4': '0.155', 'AMMO3': '0.197', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '64.500'} [2024-08-06 05:12:49,816][52671] DAMAGECOUNT value on done: 609762.0 [2024-08-06 05:12:49,816][52671] Sum rewards: 74.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.898', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.034', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:50,294][52650] Updated weights for policy 0, policy_version 59411 (0.0011) [2024-08-06 05:12:50,608][52658] DAMAGECOUNT value on done: 607034.0 [2024-08-06 05:12:50,609][52658] Sum rewards: 63.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.208', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.358', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '52.000'} [2024-08-06 05:12:50,814][52669] DAMAGECOUNT value on done: 605484.0 [2024-08-06 05:12:50,815][52669] Sum rewards: 62.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.022', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.134', 'AMMO4': '0.201', 'AMMO3': '0.207', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.804', 'WEAPON3': '1.200', 'weapon3': '2.568', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '52.000'} [2024-08-06 05:12:50,827][52649] DAMAGECOUNT value on done: 593322.0 [2024-08-06 05:12:50,828][52649] Sum rewards: 67.168, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.520', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.138', 'weapon5': '0.172', 'AMMO4': '0.196', 'AMMO3': '0.268', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.068', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '59.000'} [2024-08-06 05:12:50,980][52795] DAMAGECOUNT value on done: 561576.0 [2024-08-06 05:12:50,980][52795] Sum rewards: 81.941, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.936', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO3': '0.169', 'weapon2': '0.696', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '66.000'} [2024-08-06 05:12:51,231][52820] DAMAGECOUNT value on done: 558069.0 [2024-08-06 05:12:51,234][52820] Sum rewards: 69.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.138', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.524', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.234', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:51,794][52668] DAMAGECOUNT value on done: 609778.0 [2024-08-06 05:12:51,795][52668] Sum rewards: 73.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.210', 'AMMO3': '0.234', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 486735872. Throughput: 0: 4365.1. Samples: 121687580. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:12:52,795][52567] Avg episode reward: [(0, '74.332')] [2024-08-06 05:12:53,010][52671] DAMAGECOUNT value on done: 612784.0 [2024-08-06 05:12:53,010][52671] Sum rewards: 81.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.280', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.088', 'AMMO4': '0.133', 'weapon5': '0.138', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '68.000'} [2024-08-06 05:12:53,453][52669] DAMAGECOUNT value on done: 609189.0 [2024-08-06 05:12:53,455][52669] Sum rewards: 73.558, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.310', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.171', 'weapon5': '0.194', 'AMMO3': '0.279', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.116', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:53,533][52649] DAMAGECOUNT value on done: 584741.0 [2024-08-06 05:12:53,534][52649] Sum rewards: 88.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.750', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.169', 'weapon5': '0.178', 'weapon4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '71.000'} [2024-08-06 05:12:53,631][52658] DAMAGECOUNT value on done: 619598.0 [2024-08-06 05:12:53,633][52658] Sum rewards: 69.753, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.359', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.201', 'weapon2': '0.238', 'WEAPON3': '1.250', 'HITCOUNT': '3.400', 'weapon3': '3.606', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:54,146][52795] DAMAGECOUNT value on done: 551035.0 [2024-08-06 05:12:54,146][52795] Sum rewards: 63.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.488', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.258', 'AMMO3': '0.268', 'AMMO4': '0.294', 'weapon5': '0.332', 'weapon2': '0.348', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.656', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '56.000'} [2024-08-06 05:12:54,424][52820] DAMAGECOUNT value on done: 567084.0 [2024-08-06 05:12:54,425][52820] Sum rewards: 45.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.086', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.124', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.378', 'WEAPON3': '1.050', 'HITCOUNT': '2.530', 'weapon3': '2.916', 'DAMAGECOUNT': '12.231', 'FRAGCOUNT': '37.500'} [2024-08-06 05:12:54,562][52668] DAMAGECOUNT value on done: 610450.0 [2024-08-06 05:12:54,562][52668] Sum rewards: 65.304, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.252', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.112', 'weapon4': '0.142', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.650', 'weapon3': '2.926', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:54,835][52650] Updated weights for policy 0, policy_version 59421 (0.0016) [2024-08-06 05:12:55,949][52671] DAMAGECOUNT value on done: 607323.0 [2024-08-06 05:12:55,949][52671] Sum rewards: 78.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.934', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.168', 'AMMO3': '0.185', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:56,099][52649] DAMAGECOUNT value on done: 597689.0 [2024-08-06 05:12:56,100][52649] Sum rewards: 76.284, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.139', 'AMMO3': '0.189', 'HEALTH': '0.210', 'weapon4': '0.306', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:56,625][52658] DAMAGECOUNT value on done: 604791.0 [2024-08-06 05:12:56,627][52658] Sum rewards: 76.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.102', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon4': '0.122', 'AMMO3': '0.153', 'weapon5': '0.212', 'AMMO4': '0.321', 'weapon2': '0.500', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.932', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:56,677][52669] DAMAGECOUNT value on done: 626348.0 [2024-08-06 05:12:56,677][52669] Sum rewards: 77.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.028', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.212', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '64.000'} [2024-08-06 05:12:56,932][52668] DAMAGECOUNT value on done: 598325.0 [2024-08-06 05:12:56,934][52668] Sum rewards: 73.609, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.056', 'weapon4': '0.130', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '61.500'} [2024-08-06 05:12:57,295][52795] DAMAGECOUNT value on done: 567477.0 [2024-08-06 05:12:57,298][52795] Sum rewards: 73.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '61.000'} [2024-08-06 05:12:57,593][52820] DAMAGECOUNT value on done: 557685.0 [2024-08-06 05:12:57,593][52820] Sum rewards: 78.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.905', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.094', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '65.000'} [2024-08-06 05:12:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 486825984. Throughput: 0: 4364.5. Samples: 121713950. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:12:57,794][52567] Avg episode reward: [(0, '74.523')] [2024-08-06 05:12:57,798][52614] Saving new best policy, reward=74.523! [2024-08-06 05:12:59,079][52671] DAMAGECOUNT value on done: 614433.0 [2024-08-06 05:12:59,081][52658] DAMAGECOUNT value on done: 612359.0 [2024-08-06 05:12:59,083][52671] Sum rewards: 71.597, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.990', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.090', 'weapon4': '0.188', 'weapon2': '0.220', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '63.000'} [2024-08-06 05:12:59,083][52658] Sum rewards: 70.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon5': '0.004', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 05:12:59,096][52649] DAMAGECOUNT value on done: 599966.0 [2024-08-06 05:12:59,097][52649] Sum rewards: 64.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.856', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.066', 'AMMO4': '0.136', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.286', 'weapon2': '0.370', 'WEAPON3': '1.750', 'weapon3': '3.106', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '57.000'} [2024-08-06 05:12:59,643][52650] Updated weights for policy 0, policy_version 59431 (0.0012) [2024-08-06 05:12:59,767][52669] DAMAGECOUNT value on done: 616222.0 [2024-08-06 05:12:59,767][52669] Sum rewards: 85.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.141', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.184', 'weapon5': '0.184', 'AMMO3': '0.194', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '67.000'} [2024-08-06 05:12:59,936][52668] DAMAGECOUNT value on done: 614190.0 [2024-08-06 05:12:59,938][52668] Sum rewards: 73.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.210', 'AMMO3': '0.224', 'AMMO4': '0.256', 'weapon5': '0.260', 'weapon2': '0.344', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:00,493][52795] DAMAGECOUNT value on done: 562089.0 [2024-08-06 05:13:00,497][52795] Sum rewards: 71.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.252', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:00,629][52662] DAMAGECOUNT value on done: 611531.0 [2024-08-06 05:13:00,630][52662] Sum rewards: 63.191, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon2': '0.158', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.498', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.500'} [2024-08-06 05:13:00,921][52811] DAMAGECOUNT value on done: 579047.0 [2024-08-06 05:13:00,921][52811] Sum rewards: 76.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.146', 'AMMO3': '0.172', 'AMMO4': '0.208', 'weapon5': '0.222', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:01,069][52820] DAMAGECOUNT value on done: 562538.0 [2024-08-06 05:13:01,071][52820] Sum rewards: 71.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.421', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.182', 'weapon5': '0.214', 'AMMO4': '0.217', 'weapon4': '0.372', 'weapon2': '0.424', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.710', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:01,813][52658] DAMAGECOUNT value on done: 601132.0 [2024-08-06 05:13:01,815][52658] Sum rewards: 72.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.905', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.108', 'weapon4': '0.130', 'AMMO4': '0.227', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.212', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:01,865][52649] DAMAGECOUNT value on done: 598970.0 [2024-08-06 05:13:01,866][52649] Sum rewards: 60.502, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.778', 'AMMO5': '0.014', 'AMMO2': '0.053', 'AMMO3': '0.163', 'weapon5': '0.234', 'AMMO4': '0.265', 'weapon2': '0.340', 'weapon4': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '47.000'} [2024-08-06 05:13:02,256][52671] DAMAGECOUNT value on done: 610001.0 [2024-08-06 05:13:02,259][52671] Sum rewards: 76.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon4': '0.340', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '2.838', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:02,602][52669] DAMAGECOUNT value on done: 613936.0 [2024-08-06 05:13:02,603][52669] Sum rewards: 69.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.176', 'AMMO3': '0.182', 'weapon2': '0.298', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.868', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:02,610][52668] DAMAGECOUNT value on done: 610577.0 [2024-08-06 05:13:02,611][52668] Sum rewards: 76.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.464', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:02,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 486907904. Throughput: 0: 4359.1. Samples: 121726730. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:13:02,795][52567] Avg episode reward: [(0, '74.043')] [2024-08-06 05:13:03,366][52662] DAMAGECOUNT value on done: 607069.0 [2024-08-06 05:13:03,367][52662] Sum rewards: 58.222, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.145', 'AMMO5': '0.027', 'AMMO2': '0.050', 'weapon4': '0.118', 'weapon5': '0.182', 'AMMO4': '0.248', 'AMMO3': '0.288', 'weapon2': '0.542', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.836', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '53.000'} [2024-08-06 05:13:03,560][52795] DAMAGECOUNT value on done: 553846.0 [2024-08-06 05:13:03,560][52795] Sum rewards: 73.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.554', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.041', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.266', 'weapon2': '0.384', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:04,021][52811] DAMAGECOUNT value on done: 560638.0 [2024-08-06 05:13:04,024][52811] Sum rewards: 74.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.106', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.282', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:04,240][52650] Updated weights for policy 0, policy_version 59441 (0.0032) [2024-08-06 05:13:04,282][52820] DAMAGECOUNT value on done: 570789.0 [2024-08-06 05:13:04,282][52820] Sum rewards: 72.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.365', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.176', 'AMMO4': '0.188', 'weapon2': '0.194', 'weapon4': '0.222', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:04,762][52671] DAMAGECOUNT value on done: 597999.0 [2024-08-06 05:13:04,762][52671] Sum rewards: 74.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.784', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.128', 'weapon5': '0.128', 'AMMO4': '0.173', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:04,995][52658] DAMAGECOUNT value on done: 610255.0 [2024-08-06 05:13:04,995][52658] Sum rewards: 73.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon5': '0.162', 'weapon4': '0.176', 'AMMO3': '0.195', 'weapon2': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:05,012][52649] DAMAGECOUNT value on done: 597500.0 [2024-08-06 05:13:05,013][52649] Sum rewards: 73.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.868', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon5': '0.122', 'weapon4': '0.132', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.808', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2024-08-06 05:13:05,443][52668] DAMAGECOUNT value on done: 602374.0 [2024-08-06 05:13:05,444][52668] Sum rewards: 75.340, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.545', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.122', 'weapon5': '0.162', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 05:13:05,666][52669] DAMAGECOUNT value on done: 612365.0 [2024-08-06 05:13:05,666][52669] Sum rewards: 58.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.182', 'weapon5': '0.188', 'AMMO3': '0.217', 'AMMO4': '0.251', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '2.984', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '50.000'} [2024-08-06 05:13:06,223][52662] DAMAGECOUNT value on done: 615536.0 [2024-08-06 05:13:06,224][52662] Sum rewards: 71.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.306', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.265', 'weapon2': '0.516', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:06,644][52795] DAMAGECOUNT value on done: 559856.0 [2024-08-06 05:13:06,645][52795] Sum rewards: 74.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.568', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO4': '0.208', 'AMMO3': '0.241', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.500', 'weapon3': '2.930', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:07,232][52811] DAMAGECOUNT value on done: 561194.0 [2024-08-06 05:13:07,236][52811] Sum rewards: 75.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.203', 'WEAPON3': '1.250', 'weapon3': '3.506', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:07,475][52671] DAMAGECOUNT value on done: 618098.0 [2024-08-06 05:13:07,475][52671] Sum rewards: 77.233, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.679', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.042', 'AMMO4': '0.087', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '66.000'} [2024-08-06 05:13:07,599][52820] DAMAGECOUNT value on done: 566129.0 [2024-08-06 05:13:07,599][52820] Sum rewards: 76.344, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.516', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.028', 'weapon4': '0.038', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.410', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 486989824. Throughput: 0: 4366.9. Samples: 121752930. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 05:13:07,794][52567] Avg episode reward: [(0, '73.478')] [2024-08-06 05:13:07,880][52658] DAMAGECOUNT value on done: 598176.0 [2024-08-06 05:13:07,880][52658] Sum rewards: 69.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.860', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'AMMO3': '0.185', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:08,057][52649] DAMAGECOUNT value on done: 585698.0 [2024-08-06 05:13:08,058][52649] Sum rewards: 65.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon2': '0.142', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.770', 'weapon3': '3.438', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '54.000'} [2024-08-06 05:13:08,645][52668] DAMAGECOUNT value on done: 602511.0 [2024-08-06 05:13:08,647][52668] Sum rewards: 70.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:08,906][52650] Updated weights for policy 0, policy_version 59451 (0.0028) [2024-08-06 05:13:08,942][52669] DAMAGECOUNT value on done: 620748.0 [2024-08-06 05:13:08,943][52669] Sum rewards: 92.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.248', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.392', 'HITCOUNT': '4.330', 'DAMAGECOUNT': '23.115', 'FRAGCOUNT': '75.000'} [2024-08-06 05:13:09,292][52662] DAMAGECOUNT value on done: 600808.0 [2024-08-06 05:13:09,292][52662] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.642', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.096', 'weapon5': '0.216', 'AMMO4': '0.231', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '54.000'} [2024-08-06 05:13:09,728][52795] DAMAGECOUNT value on done: 567336.0 [2024-08-06 05:13:09,730][52795] Sum rewards: 74.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.875', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.111', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.424', 'WEAPON3': '1.600', 'weapon3': '3.160', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:10,276][52671] DAMAGECOUNT value on done: 614221.0 [2024-08-06 05:13:10,277][52671] Sum rewards: 68.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.295', 'ARMOR': '0.004', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.116', 'AMMO3': '0.207', 'weapon5': '0.212', 'AMMO4': '0.271', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '56.500'} [2024-08-06 05:13:10,429][52811] DAMAGECOUNT value on done: 562876.0 [2024-08-06 05:13:10,429][52811] Sum rewards: 79.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.005', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.170', 'weapon4': '0.258', 'weapon5': '0.258', 'AMMO4': '0.263', 'weapon2': '0.512', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.712', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '63.000'} [2024-08-06 05:13:10,677][52649] DAMAGECOUNT value on done: 594321.0 [2024-08-06 05:13:10,679][52649] Sum rewards: 74.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.927', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.136', 'weapon2': '0.152', 'weapon4': '0.186', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '63.000'} [2024-08-06 05:13:10,709][52820] DAMAGECOUNT value on done: 568553.0 [2024-08-06 05:13:10,709][52820] Sum rewards: 77.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.792', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.092', 'AMMO4': '0.169', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:10,891][52658] DAMAGECOUNT value on done: 612656.0 [2024-08-06 05:13:10,891][52658] Sum rewards: 73.453, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.172', 'AMMO3': '0.275', 'weapon4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.872', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '65.000'} [2024-08-06 05:13:11,606][52668] DAMAGECOUNT value on done: 612510.0 [2024-08-06 05:13:11,606][52668] Sum rewards: 80.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.148', 'weapon5': '0.194', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '66.000'} [2024-08-06 05:13:11,962][52662] DAMAGECOUNT value on done: 618191.0 [2024-08-06 05:13:11,962][52662] Sum rewards: 77.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.114', 'AMMO4': '0.166', 'weapon5': '0.186', 'AMMO3': '0.192', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '63.000'} [2024-08-06 05:13:12,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 487088128. Throughput: 0: 4369.3. Samples: 121779430. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 05:13:12,794][52567] Avg episode reward: [(0, '73.557')] [2024-08-06 05:13:13,147][52671] DAMAGECOUNT value on done: 613944.0 [2024-08-06 05:13:13,156][52671] Sum rewards: 74.189, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.265', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.170', 'weapon5': '0.178', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.648', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:13,485][52658] DAMAGECOUNT value on done: 605049.0 [2024-08-06 05:13:13,486][52658] Sum rewards: 78.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.253', 'weapon2': '0.404', 'WEAPON3': '1.550', 'weapon3': '3.422', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '67.000'} [2024-08-06 05:13:13,623][52811] DAMAGECOUNT value on done: 566819.0 [2024-08-06 05:13:13,623][52811] Sum rewards: 65.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.170', 'AMMO3': '0.195', 'weapon2': '0.224', 'weapon4': '0.226', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '54.000'} [2024-08-06 05:13:13,861][52820] DAMAGECOUNT value on done: 564879.0 [2024-08-06 05:13:13,861][52820] Sum rewards: 79.576, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.250', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon5': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.352', 'WEAPON3': '0.950', 'weapon3': '2.844', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.232', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:13,916][52650] Updated weights for policy 0, policy_version 59461 (0.0013) [2024-08-06 05:13:13,984][52649] DAMAGECOUNT value on done: 585502.0 [2024-08-06 05:13:13,986][52649] Sum rewards: 79.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.736', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.052', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '65.000'} [2024-08-06 05:13:14,542][52668] DAMAGECOUNT value on done: 609061.0 [2024-08-06 05:13:14,544][52668] Sum rewards: 73.965, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO4': '0.207', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.600', 'weapon3': '3.160', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:14,828][52662] DAMAGECOUNT value on done: 602437.0 [2024-08-06 05:13:14,830][52662] Sum rewards: 59.560, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.751', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.118', 'weapon4': '0.154', 'AMMO3': '0.176', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.130', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '48.000'} [2024-08-06 05:13:15,800][52671] DAMAGECOUNT value on done: 612689.0 [2024-08-06 05:13:15,801][52671] Sum rewards: 70.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.137', 'weapon5': '0.148', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.126', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:16,325][52658] DAMAGECOUNT value on done: 604920.0 [2024-08-06 05:13:16,327][52658] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.464', 'AMMO5': '0.003', 'weapon7': '0.008', 'AMMO2': '0.012', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.186', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:16,338][52660] DAMAGECOUNT value on done: 606661.0 [2024-08-06 05:13:16,339][52660] Sum rewards: 67.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.142', 'weapon4': '0.158', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:16,873][52811] DAMAGECOUNT value on done: 574197.0 [2024-08-06 05:13:16,875][52811] Sum rewards: 73.218, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.108', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.098', 'weapon4': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:16,976][52649] DAMAGECOUNT value on done: 596994.0 [2024-08-06 05:13:16,976][52649] Sum rewards: 68.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.817', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.098', 'weapon5': '0.164', 'AMMO4': '0.258', 'AMMO3': '0.259', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:17,013][52820] DAMAGECOUNT value on done: 566283.0 [2024-08-06 05:13:17,013][52820] Sum rewards: 78.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'weapon4': '0.136', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:17,528][52668] DAMAGECOUNT value on done: 599427.0 [2024-08-06 05:13:17,529][52668] Sum rewards: 62.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.783', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.170', 'AMMO4': '0.219', 'AMMO3': '0.275', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.970', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:17,752][52662] DAMAGECOUNT value on done: 612742.0 [2024-08-06 05:13:17,756][52662] Sum rewards: 63.667, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.112', 'weapon4': '0.130', 'AMMO4': '0.132', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.600', 'weapon3': '2.836', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 05:13:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 487170048. Throughput: 0: 4378.0. Samples: 121792570. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 05:13:17,795][52567] Avg episode reward: [(0, '72.895')] [2024-08-06 05:13:18,526][52671] DAMAGECOUNT value on done: 610295.0 [2024-08-06 05:13:18,526][52671] Sum rewards: 80.436, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 05:13:18,731][52650] Updated weights for policy 0, policy_version 59471 (0.0018) [2024-08-06 05:13:18,811][52658] DAMAGECOUNT value on done: 608958.0 [2024-08-06 05:13:18,812][52658] Sum rewards: 71.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.819', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:19,237][52660] DAMAGECOUNT value on done: 598961.0 [2024-08-06 05:13:19,239][52660] Sum rewards: 73.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.190', 'AMMO4': '0.227', 'AMMO3': '0.239', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:19,891][52811] DAMAGECOUNT value on done: 570906.0 [2024-08-06 05:13:19,895][52811] Sum rewards: 67.364, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon4': '0.118', 'AMMO3': '0.208', 'weapon5': '0.242', 'weapon2': '0.286', 'AMMO4': '0.322', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.000'} [2024-08-06 05:13:20,088][52820] DAMAGECOUNT value on done: 573559.0 [2024-08-06 05:13:20,091][52820] Sum rewards: 78.160, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.950', 'AMMO5': '0.024', 'AMMO2': '0.079', 'weapon4': '0.154', 'AMMO3': '0.191', 'weapon2': '0.254', 'weapon5': '0.262', 'AMMO4': '0.395', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '64.500'} [2024-08-06 05:13:20,180][52649] DAMAGECOUNT value on done: 596956.0 [2024-08-06 05:13:20,181][52649] Sum rewards: 79.860, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.035', 'HEALTH': '0.058', 'weapon5': '0.134', 'weapon4': '0.142', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '65.000'} [2024-08-06 05:13:20,497][52668] DAMAGECOUNT value on done: 591360.0 [2024-08-06 05:13:20,499][52668] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon2': '0.182', 'weapon5': '0.208', 'AMMO4': '0.222', 'AMMO3': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:20,754][52662] DAMAGECOUNT value on done: 616348.0 [2024-08-06 05:13:20,756][52662] Sum rewards: 61.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.242', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon4': '0.098', 'AMMO4': '0.211', 'AMMO3': '0.223', 'weapon5': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '53.000'} [2024-08-06 05:13:21,720][52660] DAMAGECOUNT value on done: 610541.0 [2024-08-06 05:13:21,720][52660] Sum rewards: 83.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.102', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '67.000'} [2024-08-06 05:13:22,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 487260160. Throughput: 0: 4375.1. Samples: 121818930. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 05:13:22,795][52567] Avg episode reward: [(0, '72.716')] [2024-08-06 05:13:22,800][52650] Updated weights for policy 0, policy_version 59481 (0.0022) [2024-08-06 05:13:22,861][52649] DAMAGECOUNT value on done: 591229.0 [2024-08-06 05:13:22,864][52649] Sum rewards: 81.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.016', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.150', 'weapon2': '0.252', 'AMMO3': '0.269', 'weapon4': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '70.000'} [2024-08-06 05:13:22,982][52811] DAMAGECOUNT value on done: 562988.0 [2024-08-06 05:13:22,985][52811] Sum rewards: 73.649, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.584', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.052', 'weapon4': '0.074', 'AMMO4': '0.092', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:23,097][52820] DAMAGECOUNT value on done: 572409.0 [2024-08-06 05:13:23,097][52820] Sum rewards: 65.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.208', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.164', 'weapon5': '0.240', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'weapon4': '0.354', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.778', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 05:13:23,192][52668] DAMAGECOUNT value on done: 594836.0 [2024-08-06 05:13:23,194][52668] Sum rewards: 59.703, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.088', 'weapon5': '0.136', 'AMMO4': '0.209', 'AMMO3': '0.237', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.232', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '51.000'} [2024-08-06 05:13:23,631][52662] DAMAGECOUNT value on done: 607127.0 [2024-08-06 05:13:23,635][52662] Sum rewards: 82.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.828', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.070', 'weapon5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '68.000'} [2024-08-06 05:13:24,784][52660] DAMAGECOUNT value on done: 617006.0 [2024-08-06 05:13:24,785][52660] Sum rewards: 82.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.802', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon5': '0.190', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '67.000'} [2024-08-06 05:13:26,032][52820] DAMAGECOUNT value on done: 560052.0 [2024-08-06 05:13:26,033][52820] Sum rewards: 78.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.323', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.086', 'AMMO4': '0.169', 'AMMO3': '0.179', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:26,092][52811] DAMAGECOUNT value on done: 574230.0 [2024-08-06 05:13:26,093][52811] Sum rewards: 71.368, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.270', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.176', 'AMMO3': '0.227', 'weapon5': '0.240', 'AMMO4': '0.248', 'weapon2': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:26,136][52668] DAMAGECOUNT value on done: 598574.0 [2024-08-06 05:13:26,136][52668] Sum rewards: 74.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.508', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.093', 'AMMO3': '0.199', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '60.000'} [2024-08-06 05:13:26,575][52662] DAMAGECOUNT value on done: 617915.0 [2024-08-06 05:13:26,575][52662] Sum rewards: 78.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.847', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.170', 'weapon5': '0.172', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '63.000'} [2024-08-06 05:13:27,280][52660] DAMAGECOUNT value on done: 604479.0 [2024-08-06 05:13:27,281][52660] Sum rewards: 64.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.064', 'AMMO3': '0.204', 'weapon5': '0.210', 'AMMO4': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '2.932', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '54.500'} [2024-08-06 05:13:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 487342080. Throughput: 0: 4379.1. Samples: 121845260. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 05:13:27,794][52567] Avg episode reward: [(0, '72.641')] [2024-08-06 05:13:27,891][52650] Updated weights for policy 0, policy_version 59491 (0.0027) [2024-08-06 05:13:28,393][52614] Signal inference workers to stop experience collection... (10800 times) [2024-08-06 05:13:28,393][52614] Signal inference workers to resume experience collection... (10800 times) [2024-08-06 05:13:28,451][52650] InferenceWorker_p0-w0: stopping experience collection (10800 times) [2024-08-06 05:13:28,451][52650] InferenceWorker_p0-w0: resuming experience collection (10800 times) [2024-08-06 05:13:28,564][52668] DAMAGECOUNT value on done: 605655.0 [2024-08-06 05:13:28,565][52668] Sum rewards: 75.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.158', 'weapon5': '0.168', 'AMMO4': '0.198', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:28,701][52647] DAMAGECOUNT value on done: 642750.0 [2024-08-06 05:13:28,703][52647] Sum rewards: 67.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.800', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.104', 'AMMO4': '0.116', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.800', 'weapon3': '2.854', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '58.500'} [2024-08-06 05:13:29,147][52811] DAMAGECOUNT value on done: 568441.0 [2024-08-06 05:13:29,149][52811] Sum rewards: 67.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.087', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.197', 'weapon4': '0.232', 'weapon5': '0.236', 'AMMO4': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.592', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '55.000'} [2024-08-06 05:13:29,760][52662] DAMAGECOUNT value on done: 604888.0 [2024-08-06 05:13:29,760][52662] Sum rewards: 73.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.202', 'weapon5': '0.242', 'AMMO3': '0.252', 'AMMO4': '0.255', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.776', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:29,879][52660] DAMAGECOUNT value on done: 602356.0 [2024-08-06 05:13:29,880][52660] Sum rewards: 65.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.496', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.092', 'WEAPON4': '0.150', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '55.000'} [2024-08-06 05:13:31,020][52668] DAMAGECOUNT value on done: 607594.0 [2024-08-06 05:13:31,020][52668] Sum rewards: 77.474, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.130', 'weapon4': '0.178', 'AMMO3': '0.180', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:31,471][52647] DAMAGECOUNT value on done: 637684.0 [2024-08-06 05:13:31,471][52647] Sum rewards: 77.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.050', 'weapon4': '0.138', 'AMMO4': '0.149', 'weapon2': '0.160', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.378', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '64.500'} [2024-08-06 05:13:32,201][52811] DAMAGECOUNT value on done: 571977.0 [2024-08-06 05:13:32,202][52811] Sum rewards: 73.682, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.716', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.024', 'AMMO4': '0.043', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:32,236][52650] Updated weights for policy 0, policy_version 59501 (0.0014) [2024-08-06 05:13:32,409][52660] DAMAGECOUNT value on done: 601876.0 [2024-08-06 05:13:32,411][52660] Sum rewards: 69.172, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.280', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.098', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.364', 'WEAPON3': '0.900', 'weapon3': '3.064', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '54.000'} [2024-08-06 05:13:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 487432192. Throughput: 0: 4377.5. Samples: 121858410. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 05:13:32,795][52567] Avg episode reward: [(0, '72.637')] [2024-08-06 05:13:33,019][52803] DAMAGECOUNT value on done: 565811.0 [2024-08-06 05:13:33,019][52803] Sum rewards: 69.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.090', 'AMMO4': '0.153', 'AMMO3': '0.177', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '56.000'} [2024-08-06 05:13:33,590][52662] DAMAGECOUNT value on done: 607391.0 [2024-08-06 05:13:33,592][52662] Sum rewards: 81.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.782', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '67.000'} [2024-08-06 05:13:33,656][52668] DAMAGECOUNT value on done: 605585.0 [2024-08-06 05:13:33,658][52668] Sum rewards: 70.860, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.170', 'weapon4': '0.240', 'AMMO4': '0.243', 'HEALTH': '0.259', 'weapon5': '0.278', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.826', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:34,458][52647] DAMAGECOUNT value on done: 641705.0 [2024-08-06 05:13:34,467][52647] Sum rewards: 71.341, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.850', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO3': '0.127', 'AMMO4': '0.146', 'weapon2': '0.300', 'weapon5': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon4': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.450', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '54.500'} [2024-08-06 05:13:35,240][52811] DAMAGECOUNT value on done: 575789.0 [2024-08-06 05:13:35,242][52811] Sum rewards: 69.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.896', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.108', 'weapon5': '0.182', 'AMMO3': '0.210', 'AMMO4': '0.267', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.100', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:35,470][52660] DAMAGECOUNT value on done: 611549.0 [2024-08-06 05:13:35,472][52660] Sum rewards: 63.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.435', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.098', 'weapon5': '0.158', 'AMMO3': '0.245', 'AMMO4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.028', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '55.000'} [2024-08-06 05:13:36,117][52803] DAMAGECOUNT value on done: 564125.0 [2024-08-06 05:13:36,117][52803] Sum rewards: 76.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.412', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '65.000'} [2024-08-06 05:13:36,629][52662] DAMAGECOUNT value on done: 605321.0 [2024-08-06 05:13:36,629][52662] Sum rewards: 74.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.186', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.144', 'weapon5': '0.176', 'AMMO4': '0.208', 'AMMO3': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.816', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:36,653][52668] DAMAGECOUNT value on done: 611792.0 [2024-08-06 05:13:36,653][52668] Sum rewards: 71.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.105', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.184', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:36,899][52647] DAMAGECOUNT value on done: 645060.0 [2024-08-06 05:13:36,900][52647] Sum rewards: 67.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.325', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.126', 'weapon4': '0.182', 'AMMO3': '0.209', 'AMMO4': '0.217', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.126', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '55.000'} [2024-08-06 05:13:37,311][52650] Updated weights for policy 0, policy_version 59511 (0.0011) [2024-08-06 05:13:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 487522304. Throughput: 0: 4377.8. Samples: 121884580. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 05:13:37,794][52567] Avg episode reward: [(0, '72.660')] [2024-08-06 05:13:38,440][52811] DAMAGECOUNT value on done: 566578.0 [2024-08-06 05:13:38,442][52811] Sum rewards: 75.556, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.006', 'AMMO4': '0.030', 'HEALTH': '0.050', 'AMMO3': '0.190', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '3.164', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:38,443][52660] DAMAGECOUNT value on done: 603200.0 [2024-08-06 05:13:38,446][52660] Sum rewards: 78.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon2': '0.212', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.520', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '66.000'} [2024-08-06 05:13:39,175][52662] DAMAGECOUNT value on done: 612551.0 [2024-08-06 05:13:39,176][52662] Sum rewards: 73.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon2': '0.188', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.562', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:39,203][52803] DAMAGECOUNT value on done: 570334.0 [2024-08-06 05:13:39,204][52803] Sum rewards: 71.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:39,726][52647] DAMAGECOUNT value on done: 651390.0 [2024-08-06 05:13:39,735][52647] Sum rewards: 71.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.080', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:39,985][52668] DAMAGECOUNT value on done: 609622.0 [2024-08-06 05:13:39,985][52668] Sum rewards: 76.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO3': '0.207', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '64.000'} [2024-08-06 05:13:41,577][52650] Updated weights for policy 0, policy_version 59521 (0.0021) [2024-08-06 05:13:41,633][52811] DAMAGECOUNT value on done: 561132.0 [2024-08-06 05:13:41,636][52811] Sum rewards: 73.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.135', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.057', 'weapon4': '0.112', 'weapon2': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'WEAPON3': '1.350', 'weapon3': '3.494', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '60.000'} [2024-08-06 05:13:41,812][52662] DAMAGECOUNT value on done: 606420.0 [2024-08-06 05:13:41,813][52662] Sum rewards: 63.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.587', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO3': '0.193', 'AMMO4': '0.199', 'weapon2': '0.286', 'weapon4': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '2.952', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '53.000'} [2024-08-06 05:13:41,980][52660] DAMAGECOUNT value on done: 604631.0 [2024-08-06 05:13:41,980][52660] Sum rewards: 70.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.169', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '3.266', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:42,169][52647] DAMAGECOUNT value on done: 647001.0 [2024-08-06 05:13:42,171][52647] Sum rewards: 72.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.254', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.213', 'weapon5': '0.274', 'weapon4': '0.284', 'AMMO4': '0.313', 'weapon2': '0.428', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:42,361][52803] DAMAGECOUNT value on done: 573993.0 [2024-08-06 05:13:42,365][52803] Sum rewards: 74.348, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.464', 'HEALTH': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 487604224. Throughput: 0: 4378.2. Samples: 121910970. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 05:13:42,794][52567] Avg episode reward: [(0, '72.519')] [2024-08-06 05:13:43,985][52667] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:13:44,739][52811] DAMAGECOUNT value on done: 567938.0 [2024-08-06 05:13:44,748][52811] Sum rewards: 68.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.765', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.102', 'weapon2': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.183', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.384', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '56.000'} [2024-08-06 05:13:44,830][52660] DAMAGECOUNT value on done: 612545.0 [2024-08-06 05:13:44,831][52660] Sum rewards: 68.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.854', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.094', 'AMMO3': '0.196', 'weapon5': '0.198', 'AMMO4': '0.273', 'weapon2': '0.456', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '56.000'} [2024-08-06 05:13:44,831][52662] DAMAGECOUNT value on done: 619794.0 [2024-08-06 05:13:44,834][52662] Sum rewards: 77.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.118', 'AMMO4': '0.144', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '65.000'} [2024-08-06 05:13:44,901][52647] DAMAGECOUNT value on done: 640525.0 [2024-08-06 05:13:44,902][52647] Sum rewards: 70.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.072', 'weapon5': '0.138', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '60.000'} [2024-08-06 05:13:45,494][52803] DAMAGECOUNT value on done: 567708.0 [2024-08-06 05:13:45,496][52803] Sum rewards: 60.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.030', 'AMMO2': '0.052', 'weapon4': '0.122', 'AMMO3': '0.179', 'weapon5': '0.230', 'AMMO4': '0.260', 'weapon2': '0.478', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.928', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '50.500'} [2024-08-06 05:13:46,546][52650] Updated weights for policy 0, policy_version 59531 (0.0019) [2024-08-06 05:13:47,391][52647] DAMAGECOUNT value on done: 630933.0 [2024-08-06 05:13:47,391][52647] Sum rewards: 84.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.726', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.356', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '70.000'} [2024-08-06 05:13:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 487702528. Throughput: 0: 4386.5. Samples: 121924120. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:13:47,794][52567] Avg episode reward: [(0, '72.611')] [2024-08-06 05:13:47,878][52811] DAMAGECOUNT value on done: 567660.0 [2024-08-06 05:13:47,878][52811] Sum rewards: 65.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.916', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.568', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '54.000'} [2024-08-06 05:13:47,929][52662] DAMAGECOUNT value on done: 611426.0 [2024-08-06 05:13:47,929][52662] Sum rewards: 84.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.755', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.130', 'AMMO4': '0.212', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '69.000'} [2024-08-06 05:13:48,022][52660] DAMAGECOUNT value on done: 603131.0 [2024-08-06 05:13:48,025][52660] Sum rewards: 62.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.095', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon5': '0.176', 'AMMO4': '0.212', 'AMMO3': '0.233', 'weapon4': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.714', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '55.000'} [2024-08-06 05:13:48,649][52803] DAMAGECOUNT value on done: 562522.0 [2024-08-06 05:13:48,650][52803] Sum rewards: 70.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.936', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.108', 'weapon4': '0.120', 'AMMO4': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.293', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.850', 'weapon3': '3.120', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:49,753][52647] DAMAGECOUNT value on done: 643458.0 [2024-08-06 05:13:49,761][52647] Sum rewards: 77.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.790', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.098', 'AMMO4': '0.129', 'weapon4': '0.130', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '66.000'} [2024-08-06 05:13:50,922][52662] DAMAGECOUNT value on done: 601030.0 [2024-08-06 05:13:50,923][52662] Sum rewards: 73.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.594', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.218', 'AMMO3': '0.236', 'AMMO4': '0.246', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '61.000'} [2024-08-06 05:13:51,005][52811] DAMAGECOUNT value on done: 568504.0 [2024-08-06 05:13:51,006][52811] Sum rewards: 71.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.435', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.151', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:51,160][52660] DAMAGECOUNT value on done: 604959.0 [2024-08-06 05:13:51,160][52660] Sum rewards: 69.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.085', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.048', 'weapon4': '0.170', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.320', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:51,256][52650] Updated weights for policy 0, policy_version 59541 (0.0028) [2024-08-06 05:13:51,331][52659] DAMAGECOUNT value on done: 614413.0 [2024-08-06 05:13:51,331][52659] Sum rewards: 74.006, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.074', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.120', 'AMMO4': '0.172', 'weapon2': '0.194', 'AMMO3': '0.216', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '60.000'} [2024-08-06 05:13:51,871][52803] DAMAGECOUNT value on done: 562525.0 [2024-08-06 05:13:51,873][52803] Sum rewards: 79.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.328', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.134', 'AMMO4': '0.174', 'AMMO3': '0.232', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '67.000'} [2024-08-06 05:13:52,555][52647] DAMAGECOUNT value on done: 639424.0 [2024-08-06 05:13:52,557][52647] Sum rewards: 72.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.825', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO3': '0.208', 'AMMO4': '0.231', 'weapon2': '0.312', 'WEAPON5': '0.500', 'weapon4': '0.504', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.682', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 487784448. Throughput: 0: 4386.4. Samples: 121950320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:13:52,794][52567] Avg episode reward: [(0, '72.819')] [2024-08-06 05:13:53,851][52662] DAMAGECOUNT value on done: 608330.0 [2024-08-06 05:13:53,852][52662] Sum rewards: 81.744, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.730', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'weapon5': '0.058', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'weapon2': '0.704', 'WEAPON3': '1.000', 'weapon3': '2.990', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '65.000'} [2024-08-06 05:13:54,121][52811] DAMAGECOUNT value on done: 572354.0 [2024-08-06 05:13:54,123][52811] Sum rewards: 83.520, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.144', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.336', 'WEAPON3': '1.050', 'weapon3': '3.424', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '68.000'} [2024-08-06 05:13:54,164][52660] DAMAGECOUNT value on done: 617342.0 [2024-08-06 05:13:54,167][52660] Sum rewards: 86.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.935', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.209', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.398', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '71.000'} [2024-08-06 05:13:54,279][52659] DAMAGECOUNT value on done: 606805.0 [2024-08-06 05:13:54,280][52659] Sum rewards: 66.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.326', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.092', 'AMMO4': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.196', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '55.000'} [2024-08-06 05:13:55,014][52803] DAMAGECOUNT value on done: 558246.0 [2024-08-06 05:13:55,022][52803] Sum rewards: 76.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.125', 'weapon2': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.580', 'weapon3': '3.592', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '63.000'} [2024-08-06 05:13:55,412][52665] DAMAGECOUNT value on done: 596770.0 [2024-08-06 05:13:55,413][52665] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.660', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon5': '0.122', 'weapon4': '0.148', 'AMMO3': '0.200', 'AMMO4': '0.220', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '59.000'} [2024-08-06 05:13:55,541][52647] DAMAGECOUNT value on done: 638358.0 [2024-08-06 05:13:55,541][52647] Sum rewards: 63.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.401', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.188', 'AMMO3': '0.202', 'AMMO4': '0.221', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '52.000'} [2024-08-06 05:13:55,911][52650] Updated weights for policy 0, policy_version 59551 (0.0014) [2024-08-06 05:13:56,701][52662] DAMAGECOUNT value on done: 602306.0 [2024-08-06 05:13:56,703][52662] Sum rewards: 75.107, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.162', 'AMMO4': '0.198', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '62.000'} [2024-08-06 05:13:57,188][52659] DAMAGECOUNT value on done: 613149.0 [2024-08-06 05:13:57,190][52659] Sum rewards: 70.217, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.090', 'weapon4': '0.118', 'AMMO4': '0.181', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '58.000'} [2024-08-06 05:13:57,253][52811] DAMAGECOUNT value on done: 568832.0 [2024-08-06 05:13:57,253][52811] Sum rewards: 86.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.126', 'weapon5': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.129', 'FRAGCOUNT': '70.000'} [2024-08-06 05:13:57,322][52660] DAMAGECOUNT value on done: 620948.0 [2024-08-06 05:13:57,323][52660] Sum rewards: 82.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.098', 'weapon2': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '68.000'} [2024-08-06 05:13:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 487874560. Throughput: 0: 4382.4. Samples: 121976640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:13:57,794][52567] Avg episode reward: [(0, '73.149')] [2024-08-06 05:13:58,080][52803] DAMAGECOUNT value on done: 564734.0 [2024-08-06 05:13:58,081][52803] Sum rewards: 65.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.576', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.138', 'weapon4': '0.186', 'AMMO4': '0.223', 'AMMO3': '0.245', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '57.000'} [2024-08-06 05:13:58,201][52647] DAMAGECOUNT value on done: 633837.0 [2024-08-06 05:13:58,201][52647] Sum rewards: 80.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.079', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.218', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '66.000'} [2024-08-06 05:13:58,393][52665] DAMAGECOUNT value on done: 610994.0 [2024-08-06 05:13:58,393][52665] Sum rewards: 70.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.284', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.132', 'AMMO4': '0.134', 'weapon5': '0.148', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2024-08-06 05:13:59,724][52659] DAMAGECOUNT value on done: 606991.0 [2024-08-06 05:13:59,730][52659] Sum rewards: 56.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.112', 'weapon5': '0.112', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '48.000'} [2024-08-06 05:14:00,209][52660] DAMAGECOUNT value on done: 602262.0 [2024-08-06 05:14:00,209][52660] Sum rewards: 63.531, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.077', 'weapon5': '0.088', 'AMMO3': '0.134', 'HEALTH': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.448', 'WEAPON3': '0.800', 'HITCOUNT': '3.080', 'weapon3': '3.276', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '48.000'} [2024-08-06 05:14:00,298][52650] Updated weights for policy 0, policy_version 59561 (0.0027) [2024-08-06 05:14:00,440][52647] DAMAGECOUNT value on done: 647246.0 [2024-08-06 05:14:00,442][52647] Sum rewards: 82.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.124', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '69.000'} [2024-08-06 05:14:00,549][52811] DAMAGECOUNT value on done: 566136.0 [2024-08-06 05:14:00,549][52811] Sum rewards: 68.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.322', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.212', 'weapon2': '0.272', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:01,156][52803] DAMAGECOUNT value on done: 559532.0 [2024-08-06 05:14:01,158][52803] Sum rewards: 62.826, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.714', 'AMMO5': '0.025', 'AMMO2': '0.050', 'AMMO3': '0.150', 'weapon5': '0.238', 'AMMO4': '0.247', 'weapon4': '0.290', 'WEAPON4': '0.500', 'weapon2': '0.574', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.650', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '49.000'} [2024-08-06 05:14:01,534][52665] DAMAGECOUNT value on done: 608316.0 [2024-08-06 05:14:01,534][52665] Sum rewards: 74.654, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.163', 'AMMO3': '0.165', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:02,641][52659] DAMAGECOUNT value on done: 605500.0 [2024-08-06 05:14:02,643][52659] Sum rewards: 77.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.284', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '65.000'} [2024-08-06 05:14:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 487964672. Throughput: 0: 4382.2. Samples: 121989770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:14:02,794][52567] Avg episode reward: [(0, '72.678')] [2024-08-06 05:14:02,915][52647] DAMAGECOUNT value on done: 638471.0 [2024-08-06 05:14:02,919][52647] Sum rewards: 79.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '64.000'} [2024-08-06 05:14:03,007][52660] DAMAGECOUNT value on done: 611768.0 [2024-08-06 05:14:03,007][52660] Sum rewards: 67.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.066', 'WEAPON4': '0.150', 'AMMO4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.410', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.262', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '57.000'} [2024-08-06 05:14:04,370][52803] DAMAGECOUNT value on done: 578058.0 [2024-08-06 05:14:04,373][52803] Sum rewards: 67.235, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.720', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.064', 'weapon5': '0.128', 'AMMO4': '0.272', 'AMMO3': '0.303', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.750', 'weapon3': '3.072', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '61.000'} [2024-08-06 05:14:04,541][52665] DAMAGECOUNT value on done: 600974.0 [2024-08-06 05:14:04,543][52665] Sum rewards: 75.509, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.613', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.128', 'AMMO4': '0.144', 'AMMO3': '0.169', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.770', 'WEAPON3': '1.000', 'weapon3': '2.718', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '60.000'} [2024-08-06 05:14:05,258][52650] Updated weights for policy 0, policy_version 59571 (0.0025) [2024-08-06 05:14:05,841][52659] DAMAGECOUNT value on done: 611903.0 [2024-08-06 05:14:05,841][52659] Sum rewards: 80.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.015', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.110', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '68.000'} [2024-08-06 05:14:05,841][52647] DAMAGECOUNT value on done: 646533.0 [2024-08-06 05:14:05,844][52647] Sum rewards: 77.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:05,895][52660] DAMAGECOUNT value on done: 605236.0 [2024-08-06 05:14:05,896][52660] Sum rewards: 70.834, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.350', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.102', 'weapon4': '0.134', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.786', 'WEAPON3': '0.850', 'weapon3': '2.606', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '56.000'} [2024-08-06 05:14:07,541][52803] DAMAGECOUNT value on done: 563988.0 [2024-08-06 05:14:07,543][52803] Sum rewards: 64.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.281', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.094', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.392', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '54.000'} [2024-08-06 05:14:07,701][52665] DAMAGECOUNT value on done: 592263.0 [2024-08-06 05:14:07,703][52665] Sum rewards: 76.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.098', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.180', 'AMMO3': '0.214', 'weapon2': '0.250', 'weapon5': '0.272', 'AMMO4': '0.320', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '63.000'} [2024-08-06 05:14:07,791][52647] Large shaping reward 2.626 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0), ('weapon5', 0.002)] [2024-08-06 05:14:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 488046592. Throughput: 0: 4380.2. Samples: 122016040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:14:07,794][52567] Avg episode reward: [(0, '72.831')] [2024-08-06 05:14:08,195][52660] DAMAGECOUNT value on done: 604899.0 [2024-08-06 05:14:08,196][52660] Sum rewards: 71.353, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.500', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.126', 'AMMO3': '0.136', 'weapon5': '0.182', 'AMMO4': '0.191', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.882', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '55.000'} [2024-08-06 05:14:08,250][52647] DAMAGECOUNT value on done: 646633.0 [2024-08-06 05:14:08,250][52647] Sum rewards: 80.158, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.361', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.088', 'AMMO4': '0.221', 'AMMO3': '0.237', 'weapon5': '0.266', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '68.000'} [2024-08-06 05:14:08,911][52659] DAMAGECOUNT value on done: 606810.0 [2024-08-06 05:14:08,911][52659] Sum rewards: 55.029, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.062', 'weapon5': '0.088', 'AMMO4': '0.131', 'AMMO3': '0.231', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.238', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '48.000'} [2024-08-06 05:14:09,979][52650] Updated weights for policy 0, policy_version 59581 (0.0036) [2024-08-06 05:14:10,643][52803] DAMAGECOUNT value on done: 562944.0 [2024-08-06 05:14:10,643][52803] Sum rewards: 71.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.781', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.156', 'weapon5': '0.172', 'AMMO4': '0.259', 'weapon4': '0.322', 'weapon2': '0.344', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '59.500'} [2024-08-06 05:14:10,842][52660] DAMAGECOUNT value on done: 597666.0 [2024-08-06 05:14:10,851][52660] Sum rewards: 71.612, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.246', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.138', 'AMMO4': '0.143', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:10,874][52647] DAMAGECOUNT value on done: 630532.0 [2024-08-06 05:14:10,876][52647] Sum rewards: 70.198, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.427', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.147', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '56.000'} [2024-08-06 05:14:10,925][52665] DAMAGECOUNT value on done: 596185.0 [2024-08-06 05:14:10,927][52665] Sum rewards: 60.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.285', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.201', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '49.000'} [2024-08-06 05:14:11,437][52659] DAMAGECOUNT value on done: 605519.0 [2024-08-06 05:14:11,437][52659] Sum rewards: 74.076, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.065', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.022', 'weapon5': '0.034', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.206', 'AMMO3': '0.295', 'WEAPON3': '1.850', 'weapon3': '3.512', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '66.000'} [2024-08-06 05:14:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 488136704. Throughput: 0: 4377.8. Samples: 122042260. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:14:12,794][52567] Avg episode reward: [(0, '72.615')] [2024-08-06 05:14:13,260][52794] DAMAGECOUNT value on done: 610847.0 [2024-08-06 05:14:13,261][52794] Sum rewards: 71.917, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.776', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.280', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:13,364][52647] DAMAGECOUNT value on done: 637546.0 [2024-08-06 05:14:13,366][52647] Sum rewards: 68.144, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.154', 'weapon2': '0.172', 'AMMO4': '0.175', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'WEAPON3': '1.700', 'weapon3': '3.142', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:13,701][52803] DAMAGECOUNT value on done: 578417.0 [2024-08-06 05:14:13,701][52803] Sum rewards: 75.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '61.000'} [2024-08-06 05:14:14,088][52665] DAMAGECOUNT value on done: 602795.0 [2024-08-06 05:14:14,089][52665] Sum rewards: 74.109, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.608', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.136', 'weapon4': '0.162', 'weapon2': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '61.000'} [2024-08-06 05:14:14,404][52650] Updated weights for policy 0, policy_version 59591 (0.0015) [2024-08-06 05:14:14,466][52659] DAMAGECOUNT value on done: 612176.0 [2024-08-06 05:14:14,466][52659] Sum rewards: 70.728, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.197', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '58.000'} [2024-08-06 05:14:16,104][52794] DAMAGECOUNT value on done: 616715.0 [2024-08-06 05:14:16,112][52794] Sum rewards: 63.048, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.510', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.106', 'weapon5': '0.120', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.300', 'AMMO3': '0.332', 'WEAPON3': '1.900', 'weapon3': '3.226', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '58.000'} [2024-08-06 05:14:16,228][52647] DAMAGECOUNT value on done: 629200.0 [2024-08-06 05:14:16,228][52647] Sum rewards: 70.406, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.716', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.094', 'weapon4': '0.130', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.000', 'weapon3': '3.220', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '55.000'} [2024-08-06 05:14:16,796][52803] DAMAGECOUNT value on done: 566396.0 [2024-08-06 05:14:16,796][52803] Sum rewards: 65.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.058', 'AMMO4': '0.149', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.556', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '57.000'} [2024-08-06 05:14:17,391][52665] DAMAGECOUNT value on done: 600881.0 [2024-08-06 05:14:17,394][52665] Sum rewards: 60.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.832', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.090', 'weapon5': '0.150', 'AMMO3': '0.224', 'AMMO4': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.120', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '51.000'} [2024-08-06 05:14:17,587][52659] DAMAGECOUNT value on done: 615495.0 [2024-08-06 05:14:17,588][52659] Sum rewards: 64.891, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.974', 'AMMO2': '0.004', 'AMMO5': '0.011', 'AMMO4': '0.022', 'weapon4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.159', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.192', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '51.000'} [2024-08-06 05:14:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 488226816. Throughput: 0: 4373.1. Samples: 122055200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:14:17,794][52567] Avg episode reward: [(0, '72.089')] [2024-08-06 05:14:18,767][52794] DAMAGECOUNT value on done: 615185.0 [2024-08-06 05:14:18,768][52794] Sum rewards: 74.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.120', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.187', 'weapon2': '0.288', 'WEAPON3': '1.050', 'weapon3': '3.494', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 05:14:18,847][52647] DAMAGECOUNT value on done: 634147.0 [2024-08-06 05:14:18,848][52647] Sum rewards: 85.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.494', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '72.000'} [2024-08-06 05:14:19,239][52650] Updated weights for policy 0, policy_version 59601 (0.0020) [2024-08-06 05:14:19,990][52803] DAMAGECOUNT value on done: 566024.0 [2024-08-06 05:14:19,991][52803] Sum rewards: 78.528, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.136', 'HEALTH': '0.159', 'AMMO3': '0.161', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon3': '3.056', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '61.000'} [2024-08-06 05:14:20,468][52665] DAMAGECOUNT value on done: 610303.0 [2024-08-06 05:14:20,474][52665] Sum rewards: 77.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.715', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.076', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.278', 'WEAPON3': '1.650', 'weapon3': '3.390', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '66.000'} [2024-08-06 05:14:20,472][52659] DAMAGECOUNT value on done: 605182.0 [2024-08-06 05:14:20,474][52659] Sum rewards: 69.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.136', 'weapon4': '0.172', 'AMMO4': '0.189', 'weapon2': '0.202', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:21,150][52794] DAMAGECOUNT value on done: 605693.0 [2024-08-06 05:14:21,158][52794] Sum rewards: 71.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.170', 'AMMO4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:22,795][52567] Fps is (10 sec: 16383.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 488300544. Throughput: 0: 4372.9. Samples: 122081360. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:14:22,795][52567] Avg episode reward: [(0, '72.226')] [2024-08-06 05:14:23,214][52803] DAMAGECOUNT value on done: 569533.0 [2024-08-06 05:14:23,216][52803] Sum rewards: 71.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.404', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.332', 'WEAPON3': '1.200', 'HITCOUNT': '3.400', 'weapon3': '3.464', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:23,254][52659] DAMAGECOUNT value on done: 615145.0 [2024-08-06 05:14:23,254][52659] Sum rewards: 74.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.155', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.610', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:23,579][52665] DAMAGECOUNT value on done: 600406.0 [2024-08-06 05:14:23,579][52665] Sum rewards: 77.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.070', 'AMMO3': '0.179', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'weapon5': '0.252', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '63.000'} [2024-08-06 05:14:23,726][52794] DAMAGECOUNT value on done: 606113.0 [2024-08-06 05:14:23,729][52794] Sum rewards: 66.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.170', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '3.048', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2024-08-06 05:14:23,873][52650] Updated weights for policy 0, policy_version 59611 (0.0013) [2024-08-06 05:14:26,147][52659] DAMAGECOUNT value on done: 604629.0 [2024-08-06 05:14:26,151][52659] Sum rewards: 85.695, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.504', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.088', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.432', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.690', 'FRAGCOUNT': '72.000'} [2024-08-06 05:14:26,287][52665] DAMAGECOUNT value on done: 611017.0 [2024-08-06 05:14:26,290][52665] Sum rewards: 70.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.175', 'AMMO3': '0.204', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '58.000'} [2024-08-06 05:14:26,341][52803] DAMAGECOUNT value on done: 572478.0 [2024-08-06 05:14:26,343][52803] Sum rewards: 64.293, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.130', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.114', 'weapon4': '0.120', 'AMMO4': '0.177', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.120', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '57.000'} [2024-08-06 05:14:26,544][52794] DAMAGECOUNT value on done: 609812.0 [2024-08-06 05:14:26,546][52794] Sum rewards: 72.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.621', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.200', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.500', 'weapon3': '2.622', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 488398848. Throughput: 0: 4369.8. Samples: 122107610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:14:27,794][52567] Avg episode reward: [(0, '72.336')] [2024-08-06 05:14:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059619_488398848.pth... [2024-08-06 05:14:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059106_484196352.pth [2024-08-06 05:14:28,906][52650] Updated weights for policy 0, policy_version 59621 (0.0035) [2024-08-06 05:14:29,354][52659] DAMAGECOUNT value on done: 606797.0 [2024-08-06 05:14:29,357][52659] Sum rewards: 79.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.224', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.052', 'weapon5': '0.186', 'AMMO3': '0.215', 'AMMO4': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '65.000'} [2024-08-06 05:14:29,399][52794] DAMAGECOUNT value on done: 614950.0 [2024-08-06 05:14:29,401][52794] Sum rewards: 77.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.744', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.032', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO3': '0.226', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '64.500'} [2024-08-06 05:14:29,423][52665] DAMAGECOUNT value on done: 607288.0 [2024-08-06 05:14:29,424][52665] Sum rewards: 76.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.342', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:29,534][52803] DAMAGECOUNT value on done: 575565.0 [2024-08-06 05:14:29,534][52803] Sum rewards: 70.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.030', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.264', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '56.000'} [2024-08-06 05:14:31,031][52667] DAMAGECOUNT value on done: 610447.0 [2024-08-06 05:14:31,032][52667] Sum rewards: 68.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.090', 'AMMO4': '0.161', 'weapon5': '0.198', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '58.000'} [2024-08-06 05:14:31,996][52659] DAMAGECOUNT value on done: 619635.0 [2024-08-06 05:14:31,997][52659] Sum rewards: 60.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.486', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.124', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.192', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.318', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '49.000'} [2024-08-06 05:14:32,199][52794] DAMAGECOUNT value on done: 601751.0 [2024-08-06 05:14:32,200][52794] Sum rewards: 84.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.599', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.207', 'weapon2': '0.248', 'WEAPON3': '1.350', 'weapon3': '3.642', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '70.000'} [2024-08-06 05:14:32,454][52665] DAMAGECOUNT value on done: 605825.0 [2024-08-06 05:14:32,454][52665] Sum rewards: 88.173, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.090', 'AMMO4': '0.120', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.050', 'weapon3': '3.234', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '70.000'} [2024-08-06 05:14:32,628][52803] DAMAGECOUNT value on done: 564521.0 [2024-08-06 05:14:32,629][52803] Sum rewards: 74.982, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.679', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO4': '0.210', 'weapon4': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'weapon2': '0.452', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '63.000'} [2024-08-06 05:14:32,794][52567] Fps is (10 sec: 18842.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 488488960. Throughput: 0: 4368.2. Samples: 122120690. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:14:32,794][52567] Avg episode reward: [(0, '72.662')] [2024-08-06 05:14:33,234][52650] Updated weights for policy 0, policy_version 59631 (0.0023) [2024-08-06 05:14:33,906][52667] DAMAGECOUNT value on done: 617585.0 [2024-08-06 05:14:33,907][52667] Sum rewards: 82.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'AMMO3': '0.183', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.342', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '67.000'} [2024-08-06 05:14:34,890][52659] DAMAGECOUNT value on done: 612379.0 [2024-08-06 05:14:34,891][52659] Sum rewards: 79.337, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.140', 'AMMO4': '0.160', 'weapon5': '0.168', 'AMMO3': '0.200', 'HEALTH': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '63.000'} [2024-08-06 05:14:35,072][52665] DAMAGECOUNT value on done: 602890.0 [2024-08-06 05:14:35,073][52665] Sum rewards: 75.366, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.767', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.129', 'WEAPON5': '0.200', 'weapon4': '0.272', 'weapon2': '0.540', 'WEAPON3': '0.850', 'weapon3': '2.868', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:35,091][52794] DAMAGECOUNT value on done: 613571.0 [2024-08-06 05:14:35,091][52794] Sum rewards: 69.282, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'HEALTH': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.127', 'weapon5': '0.166', 'AMMO4': '0.204', 'weapon4': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '0.750', 'weapon3': '2.800', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.000'} [2024-08-06 05:14:35,119][52803] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2024-08-06 05:14:36,654][52667] DAMAGECOUNT value on done: 612636.0 [2024-08-06 05:14:36,657][52667] Sum rewards: 64.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.084', 'AMMO4': '0.127', 'AMMO3': '0.176', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.782', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '54.000'} [2024-08-06 05:14:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 488570880. Throughput: 0: 4376.2. Samples: 122147250. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:14:37,794][52567] Avg episode reward: [(0, '72.706')] [2024-08-06 05:14:37,909][52650] Updated weights for policy 0, policy_version 59641 (0.0029) [2024-08-06 05:14:37,969][52659] DAMAGECOUNT value on done: 618232.0 [2024-08-06 05:14:37,969][52659] Sum rewards: 71.336, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.785', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.116', 'weapon4': '0.148', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.600', 'weapon3': '2.784', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 05:14:37,975][52794] DAMAGECOUNT value on done: 607138.0 [2024-08-06 05:14:37,975][52794] Sum rewards: 78.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.072', 'AMMO4': '0.135', 'weapon5': '0.180', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '63.500'} [2024-08-06 05:14:38,042][52665] DAMAGECOUNT value on done: 600467.0 [2024-08-06 05:14:38,043][52665] Sum rewards: 72.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.086', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '59.000'} [2024-08-06 05:14:39,598][52667] DAMAGECOUNT value on done: 613418.0 [2024-08-06 05:14:39,599][52667] Sum rewards: 77.880, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.565', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.138', 'weapon5': '0.186', 'AMMO4': '0.199', 'weapon2': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.934', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '61.000'} [2024-08-06 05:14:40,498][52671] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:14:40,600][52794] DAMAGECOUNT value on done: 605872.0 [2024-08-06 05:14:40,600][52794] Sum rewards: 78.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.039', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.172', 'AMMO4': '0.203', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '65.000'} [2024-08-06 05:14:41,223][52659] DAMAGECOUNT value on done: 608638.0 [2024-08-06 05:14:41,225][52659] Sum rewards: 74.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.445', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.208', 'AMMO3': '0.209', 'AMMO4': '0.218', 'weapon2': '0.262', 'weapon4': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.820', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '60.000'} [2024-08-06 05:14:41,258][52665] DAMAGECOUNT value on done: 600045.0 [2024-08-06 05:14:41,258][52665] Sum rewards: 80.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.481', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.154', 'weapon5': '0.184', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '66.000'} [2024-08-06 05:14:42,051][52664] DAMAGECOUNT value on done: 631944.0 [2024-08-06 05:14:42,059][52664] Sum rewards: 75.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.031', 'AMMO5': '0.004', 'weapon4': '0.018', 'weapon5': '0.024', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.193', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:42,296][52667] DAMAGECOUNT value on done: 618331.0 [2024-08-06 05:14:42,297][52667] Sum rewards: 80.980, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.145', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.346', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '68.000'} [2024-08-06 05:14:42,696][52650] Updated weights for policy 0, policy_version 59651 (0.0013) [2024-08-06 05:14:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 488660992. Throughput: 0: 4372.7. Samples: 122173410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:14:42,794][52567] Avg episode reward: [(0, '73.207')] [2024-08-06 05:14:43,607][52794] DAMAGECOUNT value on done: 609759.0 [2024-08-06 05:14:43,607][52794] Sum rewards: 75.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.004', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.082', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:44,037][52659] DAMAGECOUNT value on done: 614951.0 [2024-08-06 05:14:44,039][52659] Sum rewards: 72.430, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.184', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.255', 'WEAPON3': '1.700', 'HITCOUNT': '3.430', 'weapon3': '3.454', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:44,190][52664] DAMAGECOUNT value on done: 635687.0 [2024-08-06 05:14:44,192][52664] Sum rewards: 67.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.495', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.170', 'AMMO3': '0.191', 'AMMO4': '0.204', 'weapon5': '0.262', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '57.000'} [2024-08-06 05:14:44,366][52665] DAMAGECOUNT value on done: 602366.0 [2024-08-06 05:14:44,367][52665] Sum rewards: 71.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.784', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.207', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 05:14:44,908][52667] DAMAGECOUNT value on done: 620398.0 [2024-08-06 05:14:44,908][52667] Sum rewards: 65.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.615', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon4': '0.090', 'weapon5': '0.158', 'AMMO4': '0.209', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '56.000'} [2024-08-06 05:14:46,706][52664] DAMAGECOUNT value on done: 636670.0 [2024-08-06 05:14:46,706][52664] Sum rewards: 78.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.126', 'weapon5': '0.178', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '64.000'} [2024-08-06 05:14:46,750][52794] DAMAGECOUNT value on done: 603453.0 [2024-08-06 05:14:46,750][52794] Sum rewards: 72.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '60.000'} [2024-08-06 05:14:47,045][52650] Updated weights for policy 0, policy_version 59661 (0.0035) [2024-08-06 05:14:47,209][52659] DAMAGECOUNT value on done: 609021.0 [2024-08-06 05:14:47,211][52659] Sum rewards: 65.218, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.300', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.182', 'weapon5': '0.214', 'AMMO4': '0.265', 'AMMO3': '0.280', 'weapon2': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.876', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '57.000'} [2024-08-06 05:14:47,330][52667] DAMAGECOUNT value on done: 614758.0 [2024-08-06 05:14:47,332][52667] Sum rewards: 68.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.078', 'AMMO4': '0.105', 'weapon5': '0.170', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '57.000'} [2024-08-06 05:14:47,407][52665] DAMAGECOUNT value on done: 596625.0 [2024-08-06 05:14:47,408][52665] Sum rewards: 61.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.090', 'AMMO3': '0.153', 'weapon5': '0.176', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.560', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '2.998', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '50.000'} [2024-08-06 05:14:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 488751104. Throughput: 0: 4374.9. Samples: 122186640. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:14:47,794][52567] Avg episode reward: [(0, '72.914')] [2024-08-06 05:14:48,714][52663] DAMAGECOUNT value on done: 619127.0 [2024-08-06 05:14:48,716][52663] Sum rewards: 64.880, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.186', 'weapon4': '0.190', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 05:14:49,876][52664] DAMAGECOUNT value on done: 627444.0 [2024-08-06 05:14:49,879][52664] Sum rewards: 74.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.058', 'AMMO4': '0.115', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:49,988][52794] DAMAGECOUNT value on done: 624364.0 [2024-08-06 05:14:49,988][52794] Sum rewards: 82.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.455', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO4': '0.138', 'weapon5': '0.170', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '65.000'} [2024-08-06 05:14:50,255][52667] DAMAGECOUNT value on done: 610992.0 [2024-08-06 05:14:50,255][52667] Sum rewards: 84.731, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.826', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.231', 'WEAPON3': '1.450', 'weapon3': '3.410', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.618', 'FRAGCOUNT': '70.000'} [2024-08-06 05:14:50,282][52665] DAMAGECOUNT value on done: 599914.0 [2024-08-06 05:14:50,283][52665] Sum rewards: 88.048, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.600', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.089', 'weapon5': '0.102', 'WEAPON4': '0.200', 'weapon2': '0.278', 'WEAPON5': '0.300', 'AMMO3': '0.302', 'WEAPON3': '1.900', 'weapon3': '3.302', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.579', 'FRAGCOUNT': '76.000'} [2024-08-06 05:14:51,313][52663] DAMAGECOUNT value on done: 610087.0 [2024-08-06 05:14:51,313][52663] Sum rewards: 76.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.114', 'weapon5': '0.230', 'AMMO3': '0.239', 'AMMO4': '0.298', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '64.000'} [2024-08-06 05:14:52,269][52650] Updated weights for policy 0, policy_version 59671 (0.0014) [2024-08-06 05:14:52,683][52664] DAMAGECOUNT value on done: 635502.0 [2024-08-06 05:14:52,685][52664] Sum rewards: 75.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.545', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.088', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 488833024. Throughput: 0: 4370.0. Samples: 122212690. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:14:52,794][52567] Avg episode reward: [(0, '73.067')] [2024-08-06 05:14:52,876][52794] DAMAGECOUNT value on done: 604130.0 [2024-08-06 05:14:52,878][52794] Sum rewards: 80.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.124', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.804', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '66.000'} [2024-08-06 05:14:52,899][52667] DAMAGECOUNT value on done: 615619.0 [2024-08-06 05:14:52,899][52667] Sum rewards: 65.771, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '58.000'} [2024-08-06 05:14:53,306][52665] DAMAGECOUNT value on done: 603457.0 [2024-08-06 05:14:53,307][52665] Sum rewards: 79.939, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.048', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.104', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '68.000'} [2024-08-06 05:14:54,159][52663] DAMAGECOUNT value on done: 599943.0 [2024-08-06 05:14:54,159][52663] Sum rewards: 77.789, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.362', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '62.000'} [2024-08-06 05:14:55,505][52794] DAMAGECOUNT value on done: 618429.0 [2024-08-06 05:14:55,506][52794] Sum rewards: 82.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.068', 'AMMO5': '0.007', 'AMMO2': '0.050', 'weapon5': '0.130', 'AMMO3': '0.170', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.410', 'weapon2': '0.532', 'WEAPON3': '1.000', 'weapon3': '2.680', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '66.000'} [2024-08-06 05:14:55,523][52667] DAMAGECOUNT value on done: 618235.0 [2024-08-06 05:14:55,525][52667] Sum rewards: 74.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.176', 'AMMO3': '0.212', 'AMMO4': '0.217', 'weapon5': '0.284', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.500'} [2024-08-06 05:14:55,781][52664] DAMAGECOUNT value on done: 631413.0 [2024-08-06 05:14:55,782][52664] Sum rewards: 72.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.100', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.281', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.330', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '63.000'} [2024-08-06 05:14:56,383][52650] Updated weights for policy 0, policy_version 59681 (0.0022) [2024-08-06 05:14:56,800][52663] DAMAGECOUNT value on done: 607712.0 [2024-08-06 05:14:56,801][52663] Sum rewards: 79.581, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.420', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '66.000'} [2024-08-06 05:14:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 488923136. Throughput: 0: 4369.8. Samples: 122238900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:14:57,794][52567] Avg episode reward: [(0, '73.224')] [2024-08-06 05:14:58,317][52667] DAMAGECOUNT value on done: 607471.0 [2024-08-06 05:14:58,318][52667] Sum rewards: 89.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.094', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.396', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.183', 'FRAGCOUNT': '75.000'} [2024-08-06 05:14:58,394][52658] Large shaping reward 2.609 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.558, 186.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:14:58,896][52794] DAMAGECOUNT value on done: 610249.0 [2024-08-06 05:14:58,898][52794] Sum rewards: 73.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.435', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '61.000'} [2024-08-06 05:14:58,959][52664] DAMAGECOUNT value on done: 628966.0 [2024-08-06 05:14:58,960][52664] Sum rewards: 79.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.811', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.232', 'WEAPON3': '1.450', 'weapon3': '3.444', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '68.000'} [2024-08-06 05:14:59,799][52663] DAMAGECOUNT value on done: 611924.0 [2024-08-06 05:14:59,799][52663] Sum rewards: 79.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.402', 'AMMO5': '0.010', 'weapon5': '0.046', 'weapon4': '0.050', 'AMMO2': '0.051', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.255', 'weapon2': '0.420', 'WEAPON3': '1.000', 'weapon3': '3.312', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:00,941][52670] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:15:01,307][52794] DAMAGECOUNT value on done: 618852.0 [2024-08-06 05:15:01,309][52794] Sum rewards: 84.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.068', 'weapon5': '0.176', 'AMMO3': '0.210', 'AMMO4': '0.221', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '69.000'} [2024-08-06 05:15:01,340][52667] DAMAGECOUNT value on done: 610314.0 [2024-08-06 05:15:01,340][52667] Sum rewards: 75.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.048', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.544', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '65.000'} [2024-08-06 05:15:01,666][52650] Updated weights for policy 0, policy_version 59691 (0.0011) [2024-08-06 05:15:01,739][52664] DAMAGECOUNT value on done: 625294.0 [2024-08-06 05:15:01,739][52664] Sum rewards: 72.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.470', 'weapon3': '3.510', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 489013248. Throughput: 0: 4372.7. Samples: 122251970. Policy #0 lag: (min: 0.0, avg: 4.6, max: 10.0) [2024-08-06 05:15:02,794][52567] Avg episode reward: [(0, '73.769')] [2024-08-06 05:15:03,064][52663] DAMAGECOUNT value on done: 618577.0 [2024-08-06 05:15:03,066][52663] Sum rewards: 80.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.176', 'weapon5': '0.202', 'weapon2': '0.216', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '64.500'} [2024-08-06 05:15:03,947][52794] DAMAGECOUNT value on done: 618973.0 [2024-08-06 05:15:03,947][52794] Sum rewards: 72.728, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.924', 'AMMO5': '0.018', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.136', 'AMMO3': '0.170', 'weapon4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:04,313][52667] DAMAGECOUNT value on done: 615741.0 [2024-08-06 05:15:04,315][52667] Sum rewards: 73.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.626', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.170', 'AMMO3': '0.188', 'AMMO4': '0.240', 'weapon4': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:05,010][52664] DAMAGECOUNT value on done: 636838.0 [2024-08-06 05:15:05,010][52664] Sum rewards: 69.337, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.136', 'AMMO4': '0.161', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '55.000'} [2024-08-06 05:15:06,056][52650] Updated weights for policy 0, policy_version 59701 (0.0019) [2024-08-06 05:15:06,172][52663] DAMAGECOUNT value on done: 610995.0 [2024-08-06 05:15:06,175][52663] Sum rewards: 74.685, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.612', 'AMMO5': '0.024', 'AMMO2': '0.083', 'weapon4': '0.180', 'AMMO3': '0.227', 'weapon5': '0.234', 'AMMO4': '0.414', 'weapon2': '0.426', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:06,404][52666] DAMAGECOUNT value on done: 610460.0 [2024-08-06 05:15:06,404][52666] Sum rewards: 71.266, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.096', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon2': '0.270', 'AMMO3': '0.321', 'WEAPON3': '1.900', 'weapon3': '3.446', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:06,958][52670] DAMAGECOUNT value on done: 600675.0 [2024-08-06 05:15:06,958][52670] Sum rewards: 74.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.031', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.259', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.418', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:06,980][52794] DAMAGECOUNT value on done: 609836.0 [2024-08-06 05:15:06,981][52794] Sum rewards: 84.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.294', 'weapon4': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.908', 'HITCOUNT': '4.510', 'DAMAGECOUNT': '21.198', 'FRAGCOUNT': '69.000'} [2024-08-06 05:15:07,337][52667] DAMAGECOUNT value on done: 606227.0 [2024-08-06 05:15:07,340][52667] Sum rewards: 71.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.763', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon4': '0.184', 'AMMO3': '0.197', 'weapon5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 05:15:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 489095168. Throughput: 0: 4370.9. Samples: 122278050. Policy #0 lag: (min: 0.0, avg: 4.6, max: 10.0) [2024-08-06 05:15:07,802][52567] Avg episode reward: [(0, '73.974')] [2024-08-06 05:15:08,171][52664] DAMAGECOUNT value on done: 629488.0 [2024-08-06 05:15:08,171][52664] Sum rewards: 82.635, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.131', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '67.000'} [2024-08-06 05:15:08,813][52663] DAMAGECOUNT value on done: 603672.0 [2024-08-06 05:15:08,815][52663] Sum rewards: 73.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.705', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.152', 'weapon2': '0.548', 'WEAPON3': '0.950', 'HITCOUNT': '3.260', 'weapon3': '3.328', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '58.000'} [2024-08-06 05:15:09,153][52666] DAMAGECOUNT value on done: 613535.0 [2024-08-06 05:15:09,153][52666] Sum rewards: 77.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'weapon4': '0.090', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '66.000'} [2024-08-06 05:15:09,566][52670] DAMAGECOUNT value on done: 610998.0 [2024-08-06 05:15:09,570][52670] Sum rewards: 83.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.465', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.024', 'AMMO4': '0.049', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.118', 'AMMO3': '0.219', 'WEAPON3': '1.350', 'weapon3': '3.606', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '69.000'} [2024-08-06 05:15:10,526][52667] DAMAGECOUNT value on done: 614980.0 [2024-08-06 05:15:10,528][52667] Sum rewards: 71.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.711', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:10,811][52650] Updated weights for policy 0, policy_version 59711 (0.0020) [2024-08-06 05:15:10,919][52664] DAMAGECOUNT value on done: 637646.0 [2024-08-06 05:15:10,920][52664] Sum rewards: 68.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.182', 'AMMO3': '0.193', 'AMMO4': '0.222', 'weapon5': '0.226', 'weapon2': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '56.000'} [2024-08-06 05:15:11,596][52663] DAMAGECOUNT value on done: 602400.0 [2024-08-06 05:15:11,600][52663] Sum rewards: 76.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.475', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.086', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.259', 'weapon4': '0.270', 'weapon2': '0.272', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.082', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '66.000'} [2024-08-06 05:15:12,135][52666] DAMAGECOUNT value on done: 613556.0 [2024-08-06 05:15:12,136][52666] Sum rewards: 67.759, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.680', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.108', 'AMMO4': '0.236', 'weapon5': '0.252', 'AMMO3': '0.330', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '2.000', 'weapon3': '2.894', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:12,656][52670] DAMAGECOUNT value on done: 601973.0 [2024-08-06 05:15:12,659][52670] Sum rewards: 74.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.194', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.116', 'AMMO4': '0.197', 'AMMO3': '0.198', 'weapon5': '0.204', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.142', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '62.000'} [2024-08-06 05:15:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 489185280. Throughput: 0: 4372.0. Samples: 122304350. Policy #0 lag: (min: 0.0, avg: 4.6, max: 10.0) [2024-08-06 05:15:12,794][52567] Avg episode reward: [(0, '74.335')] [2024-08-06 05:15:13,437][52667] DAMAGECOUNT value on done: 622279.0 [2024-08-06 05:15:13,439][52667] Sum rewards: 73.412, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.094', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.152', 'AMMO4': '0.178', 'AMMO3': '0.282', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.208', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:14,103][52664] DAMAGECOUNT value on done: 636215.0 [2024-08-06 05:15:14,104][52664] Sum rewards: 86.973, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.457', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.192', 'AMMO4': '0.221', 'AMMO3': '0.269', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.392', 'FRAGCOUNT': '72.000'} [2024-08-06 05:15:14,296][52663] DAMAGECOUNT value on done: 609045.0 [2024-08-06 05:15:14,296][52663] Sum rewards: 65.015, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.169', 'HEALTH': '0.180', 'weapon2': '0.422', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.232', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '52.000'} [2024-08-06 05:15:15,206][52650] Updated weights for policy 0, policy_version 59721 (0.0019) [2024-08-06 05:15:15,305][52666] DAMAGECOUNT value on done: 613170.0 [2024-08-06 05:15:15,308][52666] Sum rewards: 72.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.128', 'AMMO3': '0.190', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:15,818][52670] DAMAGECOUNT value on done: 598206.0 [2024-08-06 05:15:15,818][52670] Sum rewards: 66.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.958', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.150', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.044', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '56.000'} [2024-08-06 05:15:16,014][52667] DAMAGECOUNT value on done: 619588.0 [2024-08-06 05:15:16,014][52667] Sum rewards: 69.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.629', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon2': '0.154', 'weapon5': '0.182', 'weapon4': '0.194', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '56.000'} [2024-08-06 05:15:16,943][52664] DAMAGECOUNT value on done: 639872.0 [2024-08-06 05:15:16,944][52664] Sum rewards: 80.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.025', 'AMMO2': '0.067', 'weapon4': '0.232', 'AMMO3': '0.245', 'weapon5': '0.264', 'weapon2': '0.276', 'AMMO4': '0.333', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.880', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '68.000'} [2024-08-06 05:15:17,144][52663] DAMAGECOUNT value on done: 617932.0 [2024-08-06 05:15:17,144][52663] Sum rewards: 78.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.064', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.086', 'AMMO3': '0.178', 'weapon5': '0.190', 'AMMO4': '0.214', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 489275392. Throughput: 0: 4372.9. Samples: 122317470. Policy #0 lag: (min: 0.0, avg: 4.6, max: 10.0) [2024-08-06 05:15:17,794][52567] Avg episode reward: [(0, '74.591')] [2024-08-06 05:15:17,805][52614] Saving new best policy, reward=74.591! [2024-08-06 05:15:18,354][52666] DAMAGECOUNT value on done: 605202.0 [2024-08-06 05:15:18,354][52666] Sum rewards: 62.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.106', 'weapon4': '0.138', 'AMMO4': '0.176', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.056', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '56.000'} [2024-08-06 05:15:18,866][52670] DAMAGECOUNT value on done: 614026.0 [2024-08-06 05:15:18,867][52670] Sum rewards: 62.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '54.000'} [2024-08-06 05:15:18,884][52667] DAMAGECOUNT value on done: 620037.0 [2024-08-06 05:15:18,885][52667] Sum rewards: 75.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.237', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.191', 'weapon5': '0.264', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.926', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:19,464][52664] DAMAGECOUNT value on done: 640684.0 [2024-08-06 05:15:19,466][52664] Sum rewards: 74.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.146', 'weapon5': '0.146', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:20,278][52663] DAMAGECOUNT value on done: 604698.0 [2024-08-06 05:15:20,278][52663] Sum rewards: 72.069, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.840', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'weapon2': '0.188', 'AMMO3': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.446', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:20,389][52650] Updated weights for policy 0, policy_version 59731 (0.0020) [2024-08-06 05:15:21,666][52666] DAMAGECOUNT value on done: 603683.0 [2024-08-06 05:15:21,667][52666] Sum rewards: 79.963, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon4': '0.078', 'AMMO3': '0.149', 'weapon5': '0.154', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:21,933][52664] DAMAGECOUNT value on done: 642876.0 [2024-08-06 05:15:21,933][52664] Sum rewards: 68.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.222', 'AMMO4': '0.235', 'AMMO3': '0.238', 'weapon2': '0.300', 'weapon4': '0.302', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.866', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '58.000'} [2024-08-06 05:15:21,937][52667] DAMAGECOUNT value on done: 613438.0 [2024-08-06 05:15:21,938][52667] Sum rewards: 72.812, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.098', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.156', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.430', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '62.000'} [2024-08-06 05:15:22,148][52670] DAMAGECOUNT value on done: 607576.0 [2024-08-06 05:15:22,150][52670] Sum rewards: 71.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.111', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.064', 'AMMO4': '0.141', 'weapon2': '0.186', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.400', 'weapon3': '3.556', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 489357312. Throughput: 0: 4354.4. Samples: 122343200. Policy #0 lag: (min: 0.0, avg: 4.6, max: 10.0) [2024-08-06 05:15:22,794][52567] Avg episode reward: [(0, '74.678')] [2024-08-06 05:15:22,795][52614] Saving new best policy, reward=74.678! [2024-08-06 05:15:23,523][52663] DAMAGECOUNT value on done: 600513.0 [2024-08-06 05:15:23,524][52663] Sum rewards: 60.880, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.499', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.125', 'weapon5': '0.140', 'AMMO4': '0.150', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '0.850', 'weapon3': '2.868', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '48.000'} [2024-08-06 05:15:23,621][52669] DAMAGECOUNT value on done: 613599.0 [2024-08-06 05:15:23,625][52669] Sum rewards: 62.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'ARMOR': '0.004', 'AMMO5': '0.027', 'AMMO2': '0.063', 'weapon4': '0.132', 'AMMO3': '0.214', 'weapon2': '0.276', 'weapon5': '0.304', 'AMMO4': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'HITCOUNT': '2.790', 'weapon3': '2.938', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '52.000'} [2024-08-06 05:15:24,475][52664] DAMAGECOUNT value on done: 631976.0 [2024-08-06 05:15:24,475][52664] Sum rewards: 59.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.242', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.172', 'AMMO3': '0.197', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '50.000'} [2024-08-06 05:15:24,566][52667] DAMAGECOUNT value on done: 619834.0 [2024-08-06 05:15:24,567][52667] Sum rewards: 72.343, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.582', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.166', 'weapon2': '0.680', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:25,092][52666] DAMAGECOUNT value on done: 608230.0 [2024-08-06 05:15:25,092][52666] Sum rewards: 67.568, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.166', 'AMMO3': '0.172', 'weapon4': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '55.000'} [2024-08-06 05:15:25,095][52650] Updated weights for policy 0, policy_version 59741 (0.0017) [2024-08-06 05:15:25,428][52670] DAMAGECOUNT value on done: 598057.0 [2024-08-06 05:15:25,432][52670] Sum rewards: 79.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.110', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.054', 'weapon4': '0.056', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '67.000'} [2024-08-06 05:15:26,218][52663] DAMAGECOUNT value on done: 606754.0 [2024-08-06 05:15:26,218][52663] Sum rewards: 63.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.900', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.132', 'AMMO4': '0.258', 'AMMO3': '0.270', 'weapon5': '0.356', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.742', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '56.000'} [2024-08-06 05:15:26,361][52669] DAMAGECOUNT value on done: 603871.0 [2024-08-06 05:15:26,363][52669] Sum rewards: 58.267, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.076', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.070', 'weapon5': '0.172', 'AMMO3': '0.183', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '47.000'} [2024-08-06 05:15:27,006][52664] DAMAGECOUNT value on done: 629268.0 [2024-08-06 05:15:27,006][52664] Sum rewards: 74.603, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.547', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.136', 'weapon4': '0.176', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '62.500'} [2024-08-06 05:15:27,636][52666] DAMAGECOUNT value on done: 605588.0 [2024-08-06 05:15:27,636][52666] Sum rewards: 71.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.168', 'AMMO3': '0.217', 'weapon5': '0.224', 'AMMO4': '0.279', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 489447424. Throughput: 0: 4352.9. Samples: 122369290. Policy #0 lag: (min: 0.0, avg: 4.6, max: 10.0) [2024-08-06 05:15:27,794][52567] Avg episode reward: [(0, '74.059')] [2024-08-06 05:15:27,895][52670] DAMAGECOUNT value on done: 606018.0 [2024-08-06 05:15:27,895][52670] Sum rewards: 62.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.815', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.072', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '52.000'} [2024-08-06 05:15:29,202][52663] DAMAGECOUNT value on done: 602092.0 [2024-08-06 05:15:29,202][52663] Sum rewards: 54.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.107', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '2.996', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '48.000'} [2024-08-06 05:15:29,287][52669] DAMAGECOUNT value on done: 615556.0 [2024-08-06 05:15:29,289][52669] Sum rewards: 61.415, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.860', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.088', 'AMMO4': '0.164', 'AMMO3': '0.329', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.950', 'weapon3': '3.098', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '58.500'} [2024-08-06 05:15:29,350][52664] DAMAGECOUNT value on done: 633267.0 [2024-08-06 05:15:29,351][52664] Sum rewards: 62.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.618', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.110', 'AMMO4': '0.171', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.240', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '52.500'} [2024-08-06 05:15:29,637][52650] Updated weights for policy 0, policy_version 59751 (0.0025) [2024-08-06 05:15:29,765][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:15:29,824][52658] DAMAGECOUNT value on done: 614270.0 [2024-08-06 05:15:29,824][52658] Sum rewards: 69.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.085', 'AMMO5': '0.032', 'AMMO2': '0.072', 'AMMO3': '0.236', 'weapon5': '0.290', 'AMMO4': '0.359', 'weapon2': '0.376', 'weapon4': '0.566', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.384', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '62.000'} [2024-08-06 05:15:30,075][52666] DAMAGECOUNT value on done: 608561.0 [2024-08-06 05:15:30,077][52666] Sum rewards: 71.197, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.668', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.146', 'weapon4': '0.168', 'AMMO3': '0.225', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:30,452][52670] DAMAGECOUNT value on done: 604402.0 [2024-08-06 05:15:30,453][52670] Sum rewards: 77.489, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'HEALTH': '0.112', 'AMMO3': '0.202', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 05:15:31,711][52671] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:15:32,103][52663] DAMAGECOUNT value on done: 614615.0 [2024-08-06 05:15:32,103][52663] Sum rewards: 75.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.102', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:32,204][52669] DAMAGECOUNT value on done: 615418.0 [2024-08-06 05:15:32,208][52669] Sum rewards: 67.937, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.184', 'AMMO3': '0.207', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.846', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '57.000'} [2024-08-06 05:15:32,535][52664] DAMAGECOUNT value on done: 634218.0 [2024-08-06 05:15:32,535][52664] Sum rewards: 69.682, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.002', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.136', 'weapon5': '0.218', 'AMMO4': '0.277', 'AMMO3': '0.285', 'weapon2': '0.292', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.946', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 489529344. Throughput: 0: 4353.3. Samples: 122382540. Policy #0 lag: (min: 0.0, avg: 4.6, max: 10.0) [2024-08-06 05:15:32,794][52567] Avg episode reward: [(0, '73.155')] [2024-08-06 05:15:32,800][52658] DAMAGECOUNT value on done: 611884.0 [2024-08-06 05:15:32,801][52658] Sum rewards: 72.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.024', 'weapon4': '0.070', 'AMMO2': '0.074', 'weapon5': '0.232', 'AMMO3': '0.257', 'weapon2': '0.306', 'AMMO4': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:32,931][52666] DAMAGECOUNT value on done: 601527.0 [2024-08-06 05:15:32,931][52666] Sum rewards: 67.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.394', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.146', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 05:15:33,355][52670] DAMAGECOUNT value on done: 601717.0 [2024-08-06 05:15:33,357][52670] Sum rewards: 77.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.795', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.118', 'AMMO3': '0.182', 'AMMO4': '0.233', 'weapon5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:34,290][52650] Updated weights for policy 0, policy_version 59761 (0.0023) [2024-08-06 05:15:34,966][52664] DAMAGECOUNT value on done: 633798.0 [2024-08-06 05:15:34,966][52664] Sum rewards: 67.319, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '56.000'} [2024-08-06 05:15:35,062][52658] DAMAGECOUNT value on done: 617763.0 [2024-08-06 05:15:35,063][52658] Sum rewards: 77.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '65.000'} [2024-08-06 05:15:35,275][52663] DAMAGECOUNT value on done: 606371.0 [2024-08-06 05:15:35,279][52663] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.203', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.267', 'weapon2': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.296', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:35,415][52669] DAMAGECOUNT value on done: 611452.0 [2024-08-06 05:15:35,417][52669] Sum rewards: 75.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.842', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.118', 'weapon5': '0.168', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:35,563][52671] DAMAGECOUNT value on done: 616425.0 [2024-08-06 05:15:35,565][52671] Sum rewards: 62.505, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.030', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.102', 'AMMO4': '0.123', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '50.500'} [2024-08-06 05:15:35,901][52666] DAMAGECOUNT value on done: 603227.0 [2024-08-06 05:15:35,902][52666] Sum rewards: 69.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.144', 'AMMO4': '0.146', 'weapon4': '0.196', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.898', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:36,340][52670] DAMAGECOUNT value on done: 609806.0 [2024-08-06 05:15:36,341][52670] Sum rewards: 66.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.046', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.146', 'AMMO4': '0.206', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '57.000'} [2024-08-06 05:15:36,968][52795] DAMAGECOUNT value on done: 568116.0 [2024-08-06 05:15:36,970][52795] Sum rewards: 76.547, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.212', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.104', 'AMMO4': '0.243', 'AMMO3': '0.289', 'weapon2': '0.296', 'weapon5': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.918', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:37,461][52658] DAMAGECOUNT value on done: 616079.0 [2024-08-06 05:15:37,462][52658] Sum rewards: 65.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.098', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.162', 'weapon5': '0.166', 'AMMO3': '0.215', 'AMMO4': '0.227', 'weapon2': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '55.000'} [2024-08-06 05:15:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 489619456. Throughput: 0: 4353.8. Samples: 122408610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:15:37,794][52567] Avg episode reward: [(0, '72.709')] [2024-08-06 05:15:38,460][52671] DAMAGECOUNT value on done: 619392.0 [2024-08-06 05:15:38,462][52671] Sum rewards: 76.260, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.586', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.159', 'AMMO4': '0.163', 'weapon4': '0.178', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.000', 'weapon3': '2.960', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:38,497][52663] DAMAGECOUNT value on done: 614761.0 [2024-08-06 05:15:38,497][52663] Sum rewards: 63.096, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.832', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.103', 'weapon5': '0.124', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.938', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '50.000'} [2024-08-06 05:15:38,614][52669] DAMAGECOUNT value on done: 618364.0 [2024-08-06 05:15:38,616][52669] Sum rewards: 78.240, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.073', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.136', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:39,064][52650] Updated weights for policy 0, policy_version 59771 (0.0011) [2024-08-06 05:15:39,079][52666] DAMAGECOUNT value on done: 597554.0 [2024-08-06 05:15:39,079][52666] Sum rewards: 67.844, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.722', 'AMMO5': '0.011', 'AMMO2': '0.063', 'weapon5': '0.170', 'AMMO3': '0.188', 'weapon4': '0.230', 'AMMO4': '0.317', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '55.000'} [2024-08-06 05:15:39,516][52670] DAMAGECOUNT value on done: 596344.0 [2024-08-06 05:15:39,516][52670] Sum rewards: 80.493, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.965', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:40,116][52795] DAMAGECOUNT value on done: 558059.0 [2024-08-06 05:15:40,116][52795] Sum rewards: 78.802, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.136', 'AMMO3': '0.198', 'weapon5': '0.248', 'AMMO4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'HEALTH': '0.768', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:40,287][52649] DAMAGECOUNT value on done: 591990.0 [2024-08-06 05:15:40,287][52649] Sum rewards: 73.041, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.563', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.122', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.254', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:40,367][52658] DAMAGECOUNT value on done: 604866.0 [2024-08-06 05:15:40,368][52658] Sum rewards: 76.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.040', 'AMMO4': '0.111', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:40,799][52671] DAMAGECOUNT value on done: 615351.0 [2024-08-06 05:15:40,799][52671] Sum rewards: 63.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.280', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.118', 'AMMO3': '0.241', 'AMMO4': '0.260', 'weapon5': '0.274', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.984', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '53.000'} [2024-08-06 05:15:41,446][52663] DAMAGECOUNT value on done: 615347.0 [2024-08-06 05:15:41,446][52663] Sum rewards: 72.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'weapon2': '0.244', 'weapon4': '0.246', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:41,535][52669] DAMAGECOUNT value on done: 614598.0 [2024-08-06 05:15:41,537][52669] Sum rewards: 70.739, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.873', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.324', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:42,019][52666] DAMAGECOUNT value on done: 612374.0 [2024-08-06 05:15:42,021][52666] Sum rewards: 76.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.735', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.084', 'weapon5': '0.138', 'AMMO4': '0.163', 'AMMO3': '0.237', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.330', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:42,149][52614] Signal inference workers to stop experience collection... (10850 times) [2024-08-06 05:15:42,157][52614] Signal inference workers to resume experience collection... (10850 times) [2024-08-06 05:15:42,207][52650] InferenceWorker_p0-w0: stopping experience collection (10850 times) [2024-08-06 05:15:42,207][52650] InferenceWorker_p0-w0: resuming experience collection (10850 times) [2024-08-06 05:15:42,579][52670] DAMAGECOUNT value on done: 605021.0 [2024-08-06 05:15:42,584][52670] Sum rewards: 72.238, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.798', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.102', 'AMMO4': '0.236', 'weapon5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.926', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 489709568. Throughput: 0: 4356.7. Samples: 122434950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:15:42,794][52567] Avg episode reward: [(0, '73.011')] [2024-08-06 05:15:43,289][52795] DAMAGECOUNT value on done: 556021.0 [2024-08-06 05:15:43,289][52795] Sum rewards: 80.956, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.418', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.070', 'AMMO3': '0.175', 'weapon5': '0.186', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.652', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '65.000'} [2024-08-06 05:15:43,353][52658] DAMAGECOUNT value on done: 609671.0 [2024-08-06 05:15:43,353][52658] Sum rewards: 79.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.085', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.114', 'AMMO4': '0.140', 'weapon5': '0.160', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '67.000'} [2024-08-06 05:15:43,421][52671] DAMAGECOUNT value on done: 616433.0 [2024-08-06 05:15:43,422][52671] Sum rewards: 76.009, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.594', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon2': '0.250', 'AMMO3': '0.324', 'WEAPON3': '1.950', 'weapon3': '3.530', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '68.000'} [2024-08-06 05:15:43,530][52649] DAMAGECOUNT value on done: 584417.0 [2024-08-06 05:15:43,531][52649] Sum rewards: 73.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.332', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:43,744][52650] Updated weights for policy 0, policy_version 59781 (0.0014) [2024-08-06 05:15:43,822][52667] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:15:44,091][52663] DAMAGECOUNT value on done: 606375.0 [2024-08-06 05:15:44,093][52663] Sum rewards: 75.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.560', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.126', 'AMMO4': '0.172', 'weapon5': '0.200', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '0.900', 'weapon3': '2.698', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:44,179][52669] DAMAGECOUNT value on done: 613942.0 [2024-08-06 05:15:44,179][52669] Sum rewards: 73.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.118', 'weapon5': '0.212', 'AMMO3': '0.219', 'AMMO4': '0.264', 'weapon2': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '60.500'} [2024-08-06 05:15:44,861][52666] DAMAGECOUNT value on done: 604703.0 [2024-08-06 05:15:44,870][52666] Sum rewards: 72.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.011', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.118', 'AMMO4': '0.227', 'weapon5': '0.238', 'AMMO3': '0.277', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.010', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 05:15:45,250][52670] DAMAGECOUNT value on done: 613927.0 [2024-08-06 05:15:45,251][52670] Sum rewards: 73.634, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.172', 'weapon5': '0.194', 'weapon2': '0.294', 'AMMO3': '0.299', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.090', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:46,338][52671] DAMAGECOUNT value on done: 627087.0 [2024-08-06 05:15:46,340][52671] Sum rewards: 75.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.983', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.130', 'weapon5': '0.144', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '65.000'} [2024-08-06 05:15:46,408][52795] DAMAGECOUNT value on done: 564106.0 [2024-08-06 05:15:46,409][52795] Sum rewards: 76.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.822', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.168', 'weapon2': '0.214', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'weapon3': '3.132', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '64.500'} [2024-08-06 05:15:46,441][52649] DAMAGECOUNT value on done: 602897.0 [2024-08-06 05:15:46,441][52649] Sum rewards: 72.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon2': '0.172', 'AMMO4': '0.178', 'AMMO3': '0.183', 'weapon5': '0.216', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.144', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:46,677][52658] DAMAGECOUNT value on done: 617997.0 [2024-08-06 05:15:46,677][52658] Sum rewards: 83.835, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.136', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'AMMO3': '0.324', 'WEAPON3': '1.850', 'weapon3': '3.080', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.738', 'FRAGCOUNT': '73.000'} [2024-08-06 05:15:47,105][52669] DAMAGECOUNT value on done: 621104.0 [2024-08-06 05:15:47,108][52669] Sum rewards: 65.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.358', 'AMMO5': '0.010', 'AMMO2': '0.043', 'AMMO3': '0.149', 'weapon5': '0.180', 'AMMO4': '0.214', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.640', 'WEAPON3': '0.900', 'weapon3': '2.592', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '51.000'} [2024-08-06 05:15:47,499][52647] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 05:15:47,721][52666] DAMAGECOUNT value on done: 608707.0 [2024-08-06 05:15:47,721][52666] Sum rewards: 74.972, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.820', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.036', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'AMMO4': '0.181', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.452', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 489791488. Throughput: 0: 4358.7. Samples: 122448110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:15:47,794][52567] Avg episode reward: [(0, '72.452')] [2024-08-06 05:15:48,183][52670] DAMAGECOUNT value on done: 608788.0 [2024-08-06 05:15:48,187][52670] Sum rewards: 73.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.476', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.066', 'AMMO3': '0.225', 'weapon5': '0.242', 'AMMO4': '0.263', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:48,326][52650] Updated weights for policy 0, policy_version 59791 (0.0021) [2024-08-06 05:15:49,120][52671] DAMAGECOUNT value on done: 617440.0 [2024-08-06 05:15:49,122][52671] Sum rewards: 61.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '52.000'} [2024-08-06 05:15:49,426][52649] DAMAGECOUNT value on done: 599708.0 [2024-08-06 05:15:49,428][52649] Sum rewards: 72.763, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.134', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.288', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:49,466][52669] DAMAGECOUNT value on done: 613904.0 [2024-08-06 05:15:49,466][52669] Sum rewards: 75.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.172', 'AMMO3': '0.239', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:49,597][52795] DAMAGECOUNT value on done: 560622.0 [2024-08-06 05:15:49,597][52795] Sum rewards: 62.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.860', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.084', 'weapon5': '0.158', 'AMMO4': '0.218', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '53.000'} [2024-08-06 05:15:49,871][52658] DAMAGECOUNT value on done: 607019.0 [2024-08-06 05:15:49,878][52658] Sum rewards: 72.759, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.677', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.124', 'weapon4': '0.190', 'AMMO3': '0.221', 'AMMO4': '0.272', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:50,629][52666] DAMAGECOUNT value on done: 602058.0 [2024-08-06 05:15:50,630][52666] Sum rewards: 69.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.927', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.130', 'weapon4': '0.184', 'AMMO3': '0.186', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '57.000'} [2024-08-06 05:15:51,181][52670] DAMAGECOUNT value on done: 593321.0 [2024-08-06 05:15:51,183][52670] Sum rewards: 72.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.038', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.212', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON5': '0.400', 'weapon4': '0.446', 'WEAPON3': '1.350', 'weapon3': '2.596', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:51,573][52820] DAMAGECOUNT value on done: 564195.0 [2024-08-06 05:15:51,574][52820] Sum rewards: 75.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.018', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.112', 'weapon4': '0.122', 'AMMO4': '0.161', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:52,164][52669] DAMAGECOUNT value on done: 618503.0 [2024-08-06 05:15:52,168][52669] Sum rewards: 72.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.342', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.114', 'weapon4': '0.218', 'AMMO3': '0.229', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:52,309][52671] DAMAGECOUNT value on done: 620747.0 [2024-08-06 05:15:52,309][52671] Sum rewards: 68.994, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.870', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.171', 'weapon4': '0.176', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '57.000'} [2024-08-06 05:15:52,482][52649] DAMAGECOUNT value on done: 587404.0 [2024-08-06 05:15:52,483][52649] Sum rewards: 64.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.028', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.060', 'weapon4': '0.084', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '56.000'} [2024-08-06 05:15:52,648][52795] DAMAGECOUNT value on done: 571514.0 [2024-08-06 05:15:52,649][52795] Sum rewards: 73.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.200', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.078', 'weapon5': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '63.000'} [2024-08-06 05:15:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 489881600. Throughput: 0: 4364.9. Samples: 122474470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:15:52,794][52567] Avg episode reward: [(0, '71.785')] [2024-08-06 05:15:52,796][52660] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('HEALTH', -0.06, -20.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:15:52,883][52658] DAMAGECOUNT value on done: 626373.0 [2024-08-06 05:15:52,885][52658] Sum rewards: 71.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.505', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.224', 'weapon2': '0.236', 'WEAPON3': '1.500', 'weapon3': '3.590', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:52,920][52669] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.063, -21.0)] [2024-08-06 05:15:52,920][52650] Updated weights for policy 0, policy_version 59801 (0.0018) [2024-08-06 05:15:53,870][52666] DAMAGECOUNT value on done: 607423.0 [2024-08-06 05:15:53,871][52666] Sum rewards: 73.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.776', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.084', 'AMMO3': '0.198', 'weapon5': '0.206', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.668', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '61.500'} [2024-08-06 05:15:54,424][52670] DAMAGECOUNT value on done: 603779.0 [2024-08-06 05:15:54,427][52670] Sum rewards: 74.216, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.592', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon5': '0.182', 'AMMO3': '0.191', 'AMMO4': '0.199', 'weapon4': '0.210', 'weapon2': '0.212', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:54,812][52820] DAMAGECOUNT value on done: 567792.0 [2024-08-06 05:15:54,815][52820] Sum rewards: 75.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.098', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.116', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '62.000'} [2024-08-06 05:15:55,006][52669] DAMAGECOUNT value on done: 619019.0 [2024-08-06 05:15:55,014][52669] Sum rewards: 75.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.136', 'weapon4': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '62.000'} [2024-08-06 05:15:55,061][52649] DAMAGECOUNT value on done: 601520.0 [2024-08-06 05:15:55,061][52649] Sum rewards: 71.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.118', 'weapon4': '0.212', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.454', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:55,463][52671] DAMAGECOUNT value on done: 616932.0 [2024-08-06 05:15:55,465][52671] Sum rewards: 66.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.914', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon2': '0.186', 'weapon5': '0.192', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '54.500'} [2024-08-06 05:15:55,883][52795] DAMAGECOUNT value on done: 575369.0 [2024-08-06 05:15:55,883][52795] Sum rewards: 74.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.246', 'AMMO3': '0.256', 'weapon2': '0.284', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '61.000'} [2024-08-06 05:15:56,150][52658] DAMAGECOUNT value on done: 613003.0 [2024-08-06 05:15:56,150][52658] Sum rewards: 71.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.130', 'weapon2': '0.156', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.482', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '60.000'} [2024-08-06 05:15:56,920][52666] DAMAGECOUNT value on done: 614916.0 [2024-08-06 05:15:56,924][52666] Sum rewards: 71.773, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.285', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 05:15:57,402][52670] DAMAGECOUNT value on done: 612299.0 [2024-08-06 05:15:57,403][52670] Sum rewards: 52.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.395', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.174', 'weapon5': '0.174', 'AMMO3': '0.175', 'AMMO4': '0.190', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.150', 'HITCOUNT': '2.770', 'weapon3': '3.012', 'DAMAGECOUNT': '12.732', 'FRAGCOUNT': '45.000'} [2024-08-06 05:15:57,603][52649] DAMAGECOUNT value on done: 593755.0 [2024-08-06 05:15:57,604][52649] Sum rewards: 79.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.513', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO3': '0.208', 'weapon2': '0.642', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '67.000'} [2024-08-06 05:15:57,741][52669] DAMAGECOUNT value on done: 606561.0 [2024-08-06 05:15:57,742][52669] Sum rewards: 71.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.028', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.150', 'weapon3': '3.324', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '57.000'} [2024-08-06 05:15:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 489963520. Throughput: 0: 4366.9. Samples: 122500860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:15:57,795][52567] Avg episode reward: [(0, '71.174')] [2024-08-06 05:15:57,892][52820] DAMAGECOUNT value on done: 570182.0 [2024-08-06 05:15:57,892][52820] Sum rewards: 77.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.702', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.112', 'AMMO4': '0.127', 'weapon4': '0.140', 'AMMO3': '0.220', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '64.000'} [2024-08-06 05:15:57,907][52650] Updated weights for policy 0, policy_version 59811 (0.0020) [2024-08-06 05:15:58,264][52668] DAMAGECOUNT value on done: 612892.0 [2024-08-06 05:15:58,268][52668] Sum rewards: 73.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.038', 'AMMO4': '0.177', 'weapon5': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.650', 'weapon3': '3.014', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '61.500'} [2024-08-06 05:15:58,486][52671] DAMAGECOUNT value on done: 608589.0 [2024-08-06 05:15:58,487][52671] Sum rewards: 87.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.092', 'weapon2': '0.178', 'weapon5': '0.182', 'AMMO4': '0.196', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '72.000'} [2024-08-06 05:15:58,844][52658] DAMAGECOUNT value on done: 625526.0 [2024-08-06 05:15:58,845][52658] Sum rewards: 71.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.190', 'AMMO3': '0.223', 'AMMO4': '0.237', 'weapon2': '0.288', 'WEAPON5': '0.400', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.724', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '59.000'} [2024-08-06 05:15:59,051][52795] DAMAGECOUNT value on done: 565614.0 [2024-08-06 05:15:59,054][52795] Sum rewards: 62.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.715', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon5': '0.198', 'AMMO4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.020', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 05:15:59,908][52666] DAMAGECOUNT value on done: 596693.0 [2024-08-06 05:15:59,909][52666] Sum rewards: 81.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.114', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.138', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.218', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '67.000'} [2024-08-06 05:16:00,509][52670] DAMAGECOUNT value on done: 603050.0 [2024-08-06 05:16:00,509][52670] Sum rewards: 72.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.882', 'AMMO5': '0.008', 'AMMO2': '0.061', 'weapon5': '0.114', 'AMMO3': '0.232', 'weapon4': '0.232', 'WEAPON5': '0.250', 'AMMO4': '0.306', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:00,783][52649] DAMAGECOUNT value on done: 599059.0 [2024-08-06 05:16:00,783][52649] Sum rewards: 77.936, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.540', 'AMMO5': '0.023', 'AMMO2': '0.063', 'weapon4': '0.190', 'AMMO3': '0.209', 'weapon5': '0.252', 'AMMO4': '0.314', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '64.000'} [2024-08-06 05:16:00,827][52669] DAMAGECOUNT value on done: 611586.0 [2024-08-06 05:16:00,828][52669] Sum rewards: 71.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.289', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '58.000'} [2024-08-06 05:16:00,972][52820] DAMAGECOUNT value on done: 561469.0 [2024-08-06 05:16:00,972][52820] Sum rewards: 69.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.172', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'weapon4': '0.366', 'weapon2': '0.398', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '57.000'} [2024-08-06 05:16:01,100][52668] DAMAGECOUNT value on done: 616196.0 [2024-08-06 05:16:01,103][52668] Sum rewards: 72.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.354', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.140', 'AMMO4': '0.142', 'weapon5': '0.156', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.500'} [2024-08-06 05:16:01,539][52671] DAMAGECOUNT value on done: 616090.0 [2024-08-06 05:16:01,540][52671] Sum rewards: 82.283, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.092', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.316', 'weapon2': '0.392', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:01,661][52658] DAMAGECOUNT value on done: 610033.0 [2024-08-06 05:16:01,661][52658] Sum rewards: 59.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.032', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.136', 'AMMO4': '0.173', 'AMMO3': '0.223', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '50.000'} [2024-08-06 05:16:02,308][52795] DAMAGECOUNT value on done: 560335.0 [2024-08-06 05:16:02,309][52795] Sum rewards: 75.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.060', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '63.000'} [2024-08-06 05:16:02,541][52650] Updated weights for policy 0, policy_version 59821 (0.0064) [2024-08-06 05:16:02,638][52666] DAMAGECOUNT value on done: 606022.0 [2024-08-06 05:16:02,640][52666] Sum rewards: 73.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.188', 'AMMO3': '0.193', 'AMMO4': '0.205', 'weapon4': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 490061824. Throughput: 0: 4364.4. Samples: 122513870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:16:02,794][52567] Avg episode reward: [(0, '71.515')] [2024-08-06 05:16:03,310][52670] DAMAGECOUNT value on done: 608875.0 [2024-08-06 05:16:03,310][52670] Sum rewards: 79.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.327', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '64.000'} [2024-08-06 05:16:03,645][52649] DAMAGECOUNT value on done: 599757.0 [2024-08-06 05:16:03,649][52649] Sum rewards: 77.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.580', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon4': '0.132', 'weapon5': '0.132', 'AMMO3': '0.242', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '67.000'} [2024-08-06 05:16:04,195][52669] DAMAGECOUNT value on done: 615586.0 [2024-08-06 05:16:04,197][52669] Sum rewards: 71.086, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.209', 'AMMO5': '0.016', 'AMMO2': '0.077', 'weapon4': '0.154', 'AMMO3': '0.252', 'weapon5': '0.282', 'weapon2': '0.318', 'AMMO4': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.882', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '61.500'} [2024-08-06 05:16:04,213][52820] DAMAGECOUNT value on done: 570379.0 [2024-08-06 05:16:04,214][52820] Sum rewards: 78.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.136', 'AMMO4': '0.137', 'weapon5': '0.166', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:04,257][52658] DAMAGECOUNT value on done: 618020.0 [2024-08-06 05:16:04,264][52658] Sum rewards: 70.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.200', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon2': '0.144', 'AMMO4': '0.190', 'AMMO3': '0.223', 'weapon5': '0.272', 'weapon4': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.966', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '58.000'} [2024-08-06 05:16:04,307][52668] DAMAGECOUNT value on done: 615642.0 [2024-08-06 05:16:04,308][52668] Sum rewards: 75.635, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.480', 'AMMO2': '0.004', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.193', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:04,505][52671] DAMAGECOUNT value on done: 618841.0 [2024-08-06 05:16:04,505][52671] Sum rewards: 74.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.536', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon5': '0.218', 'weapon4': '0.248', 'AMMO3': '0.267', 'AMMO4': '0.287', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.870', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:05,471][52795] DAMAGECOUNT value on done: 570167.0 [2024-08-06 05:16:05,471][52795] Sum rewards: 55.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.816', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon4': '0.420', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '2.820', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '47.000'} [2024-08-06 05:16:06,814][52668] DAMAGECOUNT value on done: 617385.0 [2024-08-06 05:16:06,816][52668] Sum rewards: 85.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.230', 'weapon2': '0.240', 'weapon5': '0.298', 'AMMO4': '0.299', 'weapon4': '0.430', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.734', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '70.000'} [2024-08-06 05:16:06,909][52649] DAMAGECOUNT value on done: 591145.0 [2024-08-06 05:16:06,911][52649] Sum rewards: 81.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.195', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '66.000'} [2024-08-06 05:16:07,014][52669] DAMAGECOUNT value on done: 632731.0 [2024-08-06 05:16:07,016][52669] Sum rewards: 76.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.728', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.160', 'weapon4': '0.184', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '63.000'} [2024-08-06 05:16:07,092][52650] Updated weights for policy 0, policy_version 59831 (0.0014) [2024-08-06 05:16:07,230][52658] DAMAGECOUNT value on done: 607634.0 [2024-08-06 05:16:07,230][52658] Sum rewards: 75.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon4': '0.076', 'weapon5': '0.152', 'weapon2': '0.224', 'AMMO4': '0.243', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.272', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:07,516][52820] DAMAGECOUNT value on done: 561172.0 [2024-08-06 05:16:07,520][52820] Sum rewards: 60.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.364', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.040', 'weapon5': '0.088', 'weapon2': '0.144', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON3': '1.750', 'HITCOUNT': '2.640', 'weapon3': '3.540', 'DAMAGECOUNT': '14.283', 'FRAGCOUNT': '55.000'} [2024-08-06 05:16:07,674][52671] DAMAGECOUNT value on done: 612987.0 [2024-08-06 05:16:07,675][52671] Sum rewards: 69.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.909', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.156', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '57.000'} [2024-08-06 05:16:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 490143744. Throughput: 0: 4374.0. Samples: 122540030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:16:07,795][52567] Avg episode reward: [(0, '72.707')] [2024-08-06 05:16:08,805][52795] DAMAGECOUNT value on done: 567569.0 [2024-08-06 05:16:08,806][52795] Sum rewards: 67.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.525', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon2': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.212', 'weapon5': '0.286', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '55.000'} [2024-08-06 05:16:09,620][52668] DAMAGECOUNT value on done: 603157.0 [2024-08-06 05:16:09,623][52668] Sum rewards: 63.155, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.344', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.112', 'AMMO3': '0.174', 'weapon2': '0.220', 'AMMO4': '0.223', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.770', 'weapon3': '3.134', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '50.000'} [2024-08-06 05:16:09,791][52649] DAMAGECOUNT value on done: 603946.0 [2024-08-06 05:16:09,793][52649] Sum rewards: 75.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.158', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:09,868][52669] DAMAGECOUNT value on done: 621621.0 [2024-08-06 05:16:09,869][52669] Sum rewards: 67.972, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.260', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon4': '0.068', 'weapon5': '0.180', 'AMMO3': '0.249', 'AMMO4': '0.281', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.566', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:09,908][52671] DAMAGECOUNT value on done: 620436.0 [2024-08-06 05:16:09,909][52671] Sum rewards: 74.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.076', 'AMMO4': '0.113', 'weapon5': '0.154', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:10,378][52662] DAMAGECOUNT value on done: 617471.0 [2024-08-06 05:16:10,380][52662] Sum rewards: 75.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.084', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '3.202', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:10,394][52658] DAMAGECOUNT value on done: 615594.0 [2024-08-06 05:16:10,394][52658] Sum rewards: 62.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon4': '0.234', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '51.000'} [2024-08-06 05:16:10,535][52820] DAMAGECOUNT value on done: 567446.0 [2024-08-06 05:16:10,539][52820] Sum rewards: 77.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.411', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.630', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '64.000'} [2024-08-06 05:16:11,692][52650] Updated weights for policy 0, policy_version 59841 (0.0036) [2024-08-06 05:16:11,931][52795] DAMAGECOUNT value on done: 563057.0 [2024-08-06 05:16:11,932][52795] Sum rewards: 83.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.092', 'weapon5': '0.128', 'AMMO4': '0.196', 'AMMO3': '0.210', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '70.000'} [2024-08-06 05:16:12,019][52665] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:16:12,262][52649] DAMAGECOUNT value on done: 605383.0 [2024-08-06 05:16:12,262][52649] Sum rewards: 57.902, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.220', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon5': '0.218', 'AMMO4': '0.240', 'weapon4': '0.244', 'AMMO3': '0.268', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.600', 'weapon3': '2.674', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '52.000'} [2024-08-06 05:16:12,690][52668] DAMAGECOUNT value on done: 620035.0 [2024-08-06 05:16:12,691][52668] Sum rewards: 73.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.477', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:12,748][52671] DAMAGECOUNT value on done: 616279.0 [2024-08-06 05:16:12,748][52671] Sum rewards: 72.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.244', 'weapon2': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.504', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:12,795][52567] Fps is (10 sec: 17201.2, 60 sec: 17475.9, 300 sec: 17494.7). Total num frames: 490233856. Throughput: 0: 4377.0. Samples: 122566260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:16:12,796][52567] Avg episode reward: [(0, '72.535')] [2024-08-06 05:16:13,080][52669] DAMAGECOUNT value on done: 620361.0 [2024-08-06 05:16:13,081][52669] Sum rewards: 76.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.156', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:13,404][52658] DAMAGECOUNT value on done: 603105.0 [2024-08-06 05:16:13,405][52658] Sum rewards: 62.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.140', 'AMMO3': '0.194', 'AMMO4': '0.197', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '52.000'} [2024-08-06 05:16:13,465][52662] DAMAGECOUNT value on done: 613002.0 [2024-08-06 05:16:13,466][52662] Sum rewards: 69.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.862', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.078', 'weapon4': '0.102', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:13,652][52820] DAMAGECOUNT value on done: 571319.0 [2024-08-06 05:16:13,653][52820] Sum rewards: 85.528, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.088', 'AMMO4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '69.000'} [2024-08-06 05:16:15,066][52649] DAMAGECOUNT value on done: 604379.0 [2024-08-06 05:16:15,066][52649] Sum rewards: 66.855, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.357', 'AMMO5': '0.024', 'AMMO2': '0.042', 'AMMO3': '0.168', 'weapon4': '0.174', 'AMMO4': '0.209', 'weapon5': '0.242', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '53.000'} [2024-08-06 05:16:15,070][52795] DAMAGECOUNT value on done: 561942.0 [2024-08-06 05:16:15,070][52795] Sum rewards: 66.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.162', 'AMMO3': '0.189', 'weapon5': '0.196', 'AMMO4': '0.275', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.890', 'WEAPON3': '1.150', 'weapon3': '2.538', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '55.000'} [2024-08-06 05:16:15,533][52671] DAMAGECOUNT value on done: 604258.0 [2024-08-06 05:16:15,535][52671] Sum rewards: 80.672, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.003', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.213', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '66.000'} [2024-08-06 05:16:15,710][52668] DAMAGECOUNT value on done: 616351.0 [2024-08-06 05:16:15,710][52668] Sum rewards: 74.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.398', 'WEAPON3': '0.900', 'weapon3': '3.256', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:15,985][52658] DAMAGECOUNT value on done: 618418.0 [2024-08-06 05:16:15,986][52658] Sum rewards: 69.369, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.292', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 05:16:16,207][52669] DAMAGECOUNT value on done: 619518.0 [2024-08-06 05:16:16,208][52669] Sum rewards: 86.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.645', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.160', 'weapon5': '0.170', 'AMMO4': '0.178', 'weapon2': '0.248', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.459', 'FRAGCOUNT': '71.000'} [2024-08-06 05:16:16,423][52662] DAMAGECOUNT value on done: 621506.0 [2024-08-06 05:16:16,423][52662] Sum rewards: 72.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.626', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.208', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:16,531][52650] Updated weights for policy 0, policy_version 59851 (0.0012) [2024-08-06 05:16:16,779][52820] DAMAGECOUNT value on done: 564967.0 [2024-08-06 05:16:16,782][52820] Sum rewards: 86.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.800', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.122', 'weapon4': '0.166', 'weapon2': '0.222', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '70.000'} [2024-08-06 05:16:16,983][52649] Large shaping reward 2.594 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.543, 181.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:16:17,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 490323968. Throughput: 0: 4381.6. Samples: 122579710. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:16:17,794][52567] Avg episode reward: [(0, '72.894')] [2024-08-06 05:16:18,203][52649] DAMAGECOUNT value on done: 603661.0 [2024-08-06 05:16:18,204][52649] Sum rewards: 77.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.692', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'AMMO4': '0.196', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '3.216', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:18,239][52795] DAMAGECOUNT value on done: 568348.0 [2024-08-06 05:16:18,245][52795] Sum rewards: 84.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.654', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.283', 'weapon2': '0.298', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '72.000'} [2024-08-06 05:16:18,455][52671] DAMAGECOUNT value on done: 624203.0 [2024-08-06 05:16:18,455][52671] Sum rewards: 76.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.061', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.162', 'AMMO3': '0.187', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '62.500'} [2024-08-06 05:16:18,583][52658] DAMAGECOUNT value on done: 610589.0 [2024-08-06 05:16:18,585][52658] Sum rewards: 64.443, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.297', 'AMMO5': '0.022', 'AMMO2': '0.073', 'weapon4': '0.136', 'AMMO3': '0.232', 'weapon5': '0.286', 'AMMO4': '0.363', 'weapon2': '0.566', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.716', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 05:16:18,815][52668] DAMAGECOUNT value on done: 608210.0 [2024-08-06 05:16:18,817][52668] Sum rewards: 75.651, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.581', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon5': '0.202', 'AMMO3': '0.205', 'weapon4': '0.272', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:19,224][52669] DAMAGECOUNT value on done: 626886.0 [2024-08-06 05:16:19,226][52669] Sum rewards: 72.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.944', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.176', 'AMMO4': '0.205', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:19,457][52662] DAMAGECOUNT value on done: 607777.0 [2024-08-06 05:16:19,457][52662] Sum rewards: 88.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.064', 'weapon5': '0.088', 'AMMO4': '0.107', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.438', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.907', 'FRAGCOUNT': '71.000'} [2024-08-06 05:16:19,884][52820] DAMAGECOUNT value on done: 572306.0 [2024-08-06 05:16:19,885][52820] Sum rewards: 61.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.930', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon7': '0.090', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.180', 'AMMO4': '0.228', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.400', 'weapon4': '0.454', 'WEAPON3': '1.650', 'weapon3': '2.588', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '54.000'} [2024-08-06 05:16:21,082][52650] Updated weights for policy 0, policy_version 59861 (0.0011) [2024-08-06 05:16:21,199][52671] DAMAGECOUNT value on done: 619238.0 [2024-08-06 05:16:21,200][52671] Sum rewards: 65.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon2': '0.182', 'AMMO3': '0.188', 'weapon4': '0.218', 'AMMO4': '0.228', 'weapon5': '0.240', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.082', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '53.000'} [2024-08-06 05:16:21,210][52649] DAMAGECOUNT value on done: 592166.0 [2024-08-06 05:16:21,210][52649] Sum rewards: 79.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.734', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:21,382][52795] DAMAGECOUNT value on done: 557099.0 [2024-08-06 05:16:21,382][52795] Sum rewards: 69.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.970', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.099', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.270', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:21,590][52668] DAMAGECOUNT value on done: 608517.0 [2024-08-06 05:16:21,590][52668] Sum rewards: 71.367, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.125', 'weapon5': '0.172', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '58.500'} [2024-08-06 05:16:21,889][52658] DAMAGECOUNT value on done: 610288.0 [2024-08-06 05:16:21,900][52658] Sum rewards: 69.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.380', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.074', 'weapon5': '0.098', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.630', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:22,637][52662] DAMAGECOUNT value on done: 624863.0 [2024-08-06 05:16:22,639][52662] Sum rewards: 79.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.220', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:22,794][52567] Fps is (10 sec: 17205.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 490405888. Throughput: 0: 4386.9. Samples: 122606020. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:16:22,794][52567] Avg episode reward: [(0, '72.891')] [2024-08-06 05:16:23,101][52820] DAMAGECOUNT value on done: 563975.0 [2024-08-06 05:16:23,102][52820] Sum rewards: 80.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.225', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.314', 'WEAPON3': '1.550', 'weapon3': '3.342', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '68.000'} [2024-08-06 05:16:24,103][52649] DAMAGECOUNT value on done: 599650.0 [2024-08-06 05:16:24,103][52649] Sum rewards: 68.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.552', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.038', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.502', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.270', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:24,220][52647] DAMAGECOUNT value on done: 649808.0 [2024-08-06 05:16:24,220][52647] Sum rewards: 88.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.484', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.174', 'FRAGCOUNT': '73.000'} [2024-08-06 05:16:24,473][52811] DAMAGECOUNT value on done: 585434.0 [2024-08-06 05:16:24,475][52811] Sum rewards: 76.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.615', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.168', 'AMMO3': '0.201', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:24,526][52671] DAMAGECOUNT value on done: 620089.0 [2024-08-06 05:16:24,527][52671] Sum rewards: 72.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.224', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'HITCOUNT': '3.470', 'weapon3': '3.478', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:24,601][52668] DAMAGECOUNT value on done: 617873.0 [2024-08-06 05:16:24,603][52668] Sum rewards: 69.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.032', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.173', 'weapon4': '0.302', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '57.000'} [2024-08-06 05:16:24,638][52795] DAMAGECOUNT value on done: 573666.0 [2024-08-06 05:16:24,638][52795] Sum rewards: 72.544, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.095', 'AMMO5': '0.008', 'weapon4': '0.008', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.296', 'WEAPON3': '1.800', 'weapon3': '3.502', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '63.000'} [2024-08-06 05:16:24,666][52658] DAMAGECOUNT value on done: 615177.0 [2024-08-06 05:16:24,666][52658] Sum rewards: 74.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.092', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.136', 'AMMO4': '0.182', 'AMMO3': '0.202', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:25,477][52662] DAMAGECOUNT value on done: 608068.0 [2024-08-06 05:16:25,478][52662] Sum rewards: 74.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.482', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon4': '0.236', 'weapon2': '0.702', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:25,794][52650] Updated weights for policy 0, policy_version 59871 (0.0035) [2024-08-06 05:16:26,202][52820] DAMAGECOUNT value on done: 568698.0 [2024-08-06 05:16:26,202][52820] Sum rewards: 78.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.414', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.159', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.356', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:26,970][52649] DAMAGECOUNT value on done: 591530.0 [2024-08-06 05:16:26,970][52649] Sum rewards: 71.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.364', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.114', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '58.000'} [2024-08-06 05:16:27,041][52647] DAMAGECOUNT value on done: 642771.0 [2024-08-06 05:16:27,041][52647] Sum rewards: 60.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.903', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '49.000'} [2024-08-06 05:16:27,655][52811] DAMAGECOUNT value on done: 566534.0 [2024-08-06 05:16:27,663][52811] Sum rewards: 69.692, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.374', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.166', 'AMMO4': '0.245', 'weapon2': '0.248', 'AMMO3': '0.256', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.992', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:27,707][52671] DAMAGECOUNT value on done: 618538.0 [2024-08-06 05:16:27,708][52671] Sum rewards: 68.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.131', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:27,717][52668] DAMAGECOUNT value on done: 615195.0 [2024-08-06 05:16:27,717][52668] Sum rewards: 71.287, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.426', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.056', 'weapon4': '0.098', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.326', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '60.500'} [2024-08-06 05:16:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 490496000. Throughput: 0: 4378.9. Samples: 122632000. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:16:27,794][52567] Avg episode reward: [(0, '73.034')] [2024-08-06 05:16:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059875_490496000.pth... [2024-08-06 05:16:27,889][52662] DAMAGECOUNT value on done: 618042.0 [2024-08-06 05:16:27,889][52662] Sum rewards: 63.549, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.536', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO3': '0.153', 'AMMO4': '0.169', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.554', 'WEAPON3': '0.950', 'weapon3': '2.712', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '51.000'} [2024-08-06 05:16:27,890][52795] DAMAGECOUNT value on done: 567989.0 [2024-08-06 05:16:27,890][52795] Sum rewards: 68.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.820', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.098', 'weapon5': '0.196', 'AMMO4': '0.228', 'AMMO3': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:27,922][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059363_486301696.pth [2024-08-06 05:16:29,341][52820] DAMAGECOUNT value on done: 577110.0 [2024-08-06 05:16:29,344][52820] Sum rewards: 79.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.124', 'AMMO4': '0.177', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 05:16:29,811][52647] DAMAGECOUNT value on done: 647649.0 [2024-08-06 05:16:29,812][52647] Sum rewards: 74.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.975', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.121', 'weapon4': '0.140', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '60.500'} [2024-08-06 05:16:29,986][52660] DAMAGECOUNT value on done: 613307.0 [2024-08-06 05:16:29,987][52660] Sum rewards: 74.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.182', 'AMMO3': '0.224', 'AMMO4': '0.277', 'weapon5': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.622', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:30,129][52649] DAMAGECOUNT value on done: 602709.0 [2024-08-06 05:16:30,131][52649] Sum rewards: 71.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.658', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.186', 'weapon5': '0.264', 'weapon4': '0.268', 'AMMO4': '0.356', 'weapon2': '0.458', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.690', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:30,592][52650] Updated weights for policy 0, policy_version 59881 (0.0028) [2024-08-06 05:16:30,810][52811] DAMAGECOUNT value on done: 567238.0 [2024-08-06 05:16:30,812][52811] Sum rewards: 69.577, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.631', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.156', 'weapon5': '0.168', 'AMMO4': '0.261', 'AMMO3': '0.292', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.024', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:30,881][52668] DAMAGECOUNT value on done: 605477.0 [2024-08-06 05:16:30,883][52668] Sum rewards: 70.880, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.031', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.114', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:30,882][52662] DAMAGECOUNT value on done: 622208.0 [2024-08-06 05:16:30,885][52662] Sum rewards: 78.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.076', 'AMMO3': '0.210', 'weapon5': '0.212', 'AMMO4': '0.249', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:30,943][52671] DAMAGECOUNT value on done: 616062.0 [2024-08-06 05:16:30,944][52671] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO5': '0.010', 'AMMO2': '0.047', 'AMMO3': '0.179', 'weapon5': '0.184', 'AMMO4': '0.234', 'weapon4': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '58.000'} [2024-08-06 05:16:31,070][52795] DAMAGECOUNT value on done: 559905.0 [2024-08-06 05:16:31,070][52795] Sum rewards: 75.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.203', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '63.000'} [2024-08-06 05:16:32,434][52820] DAMAGECOUNT value on done: 572394.0 [2024-08-06 05:16:32,435][52820] Sum rewards: 76.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO2': '0.007', 'AMMO5': '0.011', 'AMMO4': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.114', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '63.000'} [2024-08-06 05:16:32,747][52647] DAMAGECOUNT value on done: 650049.0 [2024-08-06 05:16:32,747][52647] Sum rewards: 58.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.015', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO4': '0.076', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '50.000'} [2024-08-06 05:16:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 490586112. Throughput: 0: 4373.6. Samples: 122644920. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:16:32,794][52567] Avg episode reward: [(0, '73.126')] [2024-08-06 05:16:32,842][52660] DAMAGECOUNT value on done: 604653.0 [2024-08-06 05:16:32,842][52660] Sum rewards: 67.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.800', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.138', 'weapon5': '0.138', 'AMMO4': '0.165', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 05:16:33,395][52649] DAMAGECOUNT value on done: 603013.0 [2024-08-06 05:16:33,403][52649] Sum rewards: 75.650, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.023', 'HEALTH': '0.047', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:33,467][52662] DAMAGECOUNT value on done: 613393.0 [2024-08-06 05:16:33,468][52662] Sum rewards: 74.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.296', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.076', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:33,546][52668] DAMAGECOUNT value on done: 597240.0 [2024-08-06 05:16:33,547][52668] Sum rewards: 74.156, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.486', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.128', 'weapon5': '0.144', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:33,822][52811] DAMAGECOUNT value on done: 568556.0 [2024-08-06 05:16:33,826][52811] Sum rewards: 69.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.676', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.220', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:34,237][52795] DAMAGECOUNT value on done: 566793.0 [2024-08-06 05:16:34,240][52795] Sum rewards: 88.854, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.024', 'weapon5': '0.042', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.320', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.811', 'FRAGCOUNT': '74.000'} [2024-08-06 05:16:35,239][52650] Updated weights for policy 0, policy_version 59891 (0.0037) [2024-08-06 05:16:35,409][52647] DAMAGECOUNT value on done: 656941.0 [2024-08-06 05:16:35,410][52647] Sum rewards: 66.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.098', 'weapon5': '0.102', 'AMMO4': '0.170', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:35,558][52660] DAMAGECOUNT value on done: 616126.0 [2024-08-06 05:16:35,558][52660] Sum rewards: 69.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.666', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.178', 'AMMO3': '0.200', 'AMMO4': '0.224', 'weapon4': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '58.000'} [2024-08-06 05:16:35,654][52820] DAMAGECOUNT value on done: 575247.0 [2024-08-06 05:16:35,654][52820] Sum rewards: 81.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.993', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.110', 'weapon5': '0.222', 'AMMO3': '0.225', 'weapon2': '0.248', 'AMMO4': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '68.000'} [2024-08-06 05:16:36,448][52662] DAMAGECOUNT value on done: 624115.0 [2024-08-06 05:16:36,448][52662] Sum rewards: 77.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.698', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.166', 'AMMO4': '0.174', 'AMMO3': '0.216', 'weapon4': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '66.000'} [2024-08-06 05:16:36,523][52668] DAMAGECOUNT value on done: 600403.0 [2024-08-06 05:16:36,523][52668] Sum rewards: 67.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon2': '0.158', 'AMMO3': '0.225', 'weapon4': '0.228', 'weapon5': '0.256', 'AMMO4': '0.287', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.078', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2024-08-06 05:16:36,632][52649] DAMAGECOUNT value on done: 597581.0 [2024-08-06 05:16:36,633][52649] Sum rewards: 84.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.094', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.182', 'WEAPON3': '1.100', 'weapon3': '3.406', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '69.000'} [2024-08-06 05:16:36,817][52811] DAMAGECOUNT value on done: 572448.0 [2024-08-06 05:16:36,819][52811] Sum rewards: 70.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.577', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon2': '0.296', 'weapon4': '0.364', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:36,913][52666] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:16:37,370][52795] DAMAGECOUNT value on done: 573161.0 [2024-08-06 05:16:37,372][52795] Sum rewards: 71.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.232', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.508', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '59.000'} [2024-08-06 05:16:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 490668032. Throughput: 0: 4369.6. Samples: 122671100. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:16:37,794][52567] Avg episode reward: [(0, '73.154')] [2024-08-06 05:16:37,928][52647] DAMAGECOUNT value on done: 652017.0 [2024-08-06 05:16:37,928][52647] Sum rewards: 59.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.328', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.156', 'weapon5': '0.178', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.110', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '49.000'} [2024-08-06 05:16:38,433][52660] DAMAGECOUNT value on done: 621980.0 [2024-08-06 05:16:38,443][52660] Sum rewards: 60.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.139', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.049', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.438', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '50.000'} [2024-08-06 05:16:38,876][52820] DAMAGECOUNT value on done: 570889.0 [2024-08-06 05:16:38,877][52820] Sum rewards: 72.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.266', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.111', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:39,215][52668] DAMAGECOUNT value on done: 604778.0 [2024-08-06 05:16:39,216][52668] Sum rewards: 74.589, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.010', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.782', 'WEAPON3': '1.250', 'weapon3': '2.744', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:39,329][52662] DAMAGECOUNT value on done: 610145.0 [2024-08-06 05:16:39,331][52662] Sum rewards: 65.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.148', 'weapon5': '0.192', 'AMMO3': '0.210', 'AMMO4': '0.295', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.708', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:39,869][52650] Updated weights for policy 0, policy_version 59901 (0.0013) [2024-08-06 05:16:40,038][52811] DAMAGECOUNT value on done: 580585.0 [2024-08-06 05:16:40,040][52811] Sum rewards: 84.655, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.173', 'weapon2': '0.178', 'weapon4': '0.182', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HEALTH': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.334', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '68.000'} [2024-08-06 05:16:40,437][52647] DAMAGECOUNT value on done: 646869.0 [2024-08-06 05:16:40,437][52647] Sum rewards: 81.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.078', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.226', 'WEAPON3': '1.250', 'weapon3': '3.438', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '67.000'} [2024-08-06 05:16:40,954][52660] DAMAGECOUNT value on done: 610159.0 [2024-08-06 05:16:40,954][52660] Sum rewards: 73.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.168', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.034', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.512', 'WEAPON3': '0.950', 'weapon3': '3.172', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:42,033][52820] DAMAGECOUNT value on done: 571469.0 [2024-08-06 05:16:42,038][52820] Sum rewards: 64.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.660', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO4': '0.196', 'weapon2': '0.230', 'AMMO3': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '3.050', 'weapon3': '3.294', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:42,074][52668] DAMAGECOUNT value on done: 611607.0 [2024-08-06 05:16:42,075][52668] Sum rewards: 71.940, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.126', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:42,312][52662] DAMAGECOUNT value on done: 613619.0 [2024-08-06 05:16:42,313][52662] Sum rewards: 76.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.664', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO4': '0.172', 'AMMO3': '0.209', 'weapon4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 05:16:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 490758144. Throughput: 0: 4369.1. Samples: 122697470. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:16:42,794][52567] Avg episode reward: [(0, '72.911')] [2024-08-06 05:16:43,152][52811] DAMAGECOUNT value on done: 576832.0 [2024-08-06 05:16:43,154][52811] Sum rewards: 67.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.406', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.514', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '57.000'} [2024-08-06 05:16:43,261][52647] DAMAGECOUNT value on done: 635946.0 [2024-08-06 05:16:43,261][52647] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.110', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '54.000'} [2024-08-06 05:16:43,700][52660] DAMAGECOUNT value on done: 607964.0 [2024-08-06 05:16:43,708][52660] Sum rewards: 69.465, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.110', 'weapon5': '0.132', 'AMMO4': '0.174', 'HEALTH': '0.180', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.232', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '57.000'} [2024-08-06 05:16:44,173][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:16:44,324][52650] Updated weights for policy 0, policy_version 59911 (0.0012) [2024-08-06 05:16:44,637][52668] DAMAGECOUNT value on done: 612524.0 [2024-08-06 05:16:44,638][52668] Sum rewards: 65.222, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.136', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.158', 'weapon5': '0.200', 'weapon2': '0.230', 'AMMO4': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.828', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.790', 'FRAGCOUNT': '53.000'} [2024-08-06 05:16:45,187][52820] DAMAGECOUNT value on done: 580235.0 [2024-08-06 05:16:45,190][52820] Sum rewards: 88.147, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.057', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO4': '0.114', 'AMMO3': '0.123', 'WEAPON4': '0.150', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '0.900', 'weapon3': '3.216', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '69.000'} [2024-08-06 05:16:45,208][52662] DAMAGECOUNT value on done: 610516.0 [2024-08-06 05:16:45,208][52662] Sum rewards: 65.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.718', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.126', 'weapon4': '0.168', 'AMMO4': '0.188', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '55.000'} [2024-08-06 05:16:45,863][52647] DAMAGECOUNT value on done: 649215.0 [2024-08-06 05:16:45,863][52647] Sum rewards: 75.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.183', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.076', 'weapon5': '0.164', 'AMMO3': '0.196', 'AMMO4': '0.258', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '63.000'} [2024-08-06 05:16:46,255][52811] DAMAGECOUNT value on done: 569643.0 [2024-08-06 05:16:46,256][52811] Sum rewards: 86.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.536', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.154', 'AMMO4': '0.160', 'weapon5': '0.184', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '70.000'} [2024-08-06 05:16:46,429][52660] DAMAGECOUNT value on done: 608706.0 [2024-08-06 05:16:46,431][52660] Sum rewards: 85.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.702', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.199', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '69.000'} [2024-08-06 05:16:47,248][52668] DAMAGECOUNT value on done: 611561.0 [2024-08-06 05:16:47,248][52668] Sum rewards: 77.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.779', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.134', 'weapon4': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 490848256. Throughput: 0: 4376.4. Samples: 122710810. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:16:47,795][52567] Avg episode reward: [(0, '73.147')] [2024-08-06 05:16:48,020][52662] DAMAGECOUNT value on done: 619623.0 [2024-08-06 05:16:48,020][52662] Sum rewards: 85.428, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.400', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.060', 'weapon4': '0.060', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.282', 'WEAPON3': '1.900', 'weapon3': '3.476', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '21.216', 'FRAGCOUNT': '73.000'} [2024-08-06 05:16:48,321][52820] DAMAGECOUNT value on done: 578849.0 [2024-08-06 05:16:48,321][52820] Sum rewards: 75.119, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.092', 'weapon4': '0.120', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.297', 'WEAPON3': '1.700', 'weapon3': '3.290', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '66.000'} [2024-08-06 05:16:48,806][52647] DAMAGECOUNT value on done: 645754.0 [2024-08-06 05:16:48,808][52647] Sum rewards: 78.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.120', 'AMMO4': '0.162', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '65.000'} [2024-08-06 05:16:49,156][52660] DAMAGECOUNT value on done: 617838.0 [2024-08-06 05:16:49,157][52660] Sum rewards: 74.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.462', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.158', 'AMMO4': '0.194', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:49,347][52811] DAMAGECOUNT value on done: 580269.0 [2024-08-06 05:16:49,348][52811] Sum rewards: 73.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.239', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'weapon4': '0.424', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '61.000'} [2024-08-06 05:16:49,422][52650] Updated weights for policy 0, policy_version 59921 (0.0026) [2024-08-06 05:16:49,950][52668] DAMAGECOUNT value on done: 617543.0 [2024-08-06 05:16:49,951][52668] Sum rewards: 74.742, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.355', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.116', 'AMMO3': '0.228', 'AMMO4': '0.244', 'weapon2': '0.246', 'weapon5': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:50,936][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:16:50,966][52662] DAMAGECOUNT value on done: 611699.0 [2024-08-06 05:16:50,968][52662] Sum rewards: 68.161, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.026', 'HEALTH': '0.088', 'weapon5': '0.110', 'AMMO4': '0.129', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '57.000'} [2024-08-06 05:16:51,544][52820] DAMAGECOUNT value on done: 566217.0 [2024-08-06 05:16:51,544][52820] Sum rewards: 72.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.911', 'AMMO5': '0.013', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.172', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '60.000'} [2024-08-06 05:16:51,570][52660] DAMAGECOUNT value on done: 609189.0 [2024-08-06 05:16:51,570][52660] Sum rewards: 71.805, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.663', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.134', 'AMMO3': '0.182', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:51,916][52647] DAMAGECOUNT value on done: 643729.0 [2024-08-06 05:16:51,917][52647] Sum rewards: 61.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.880', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.074', 'weapon5': '0.208', 'AMMO4': '0.255', 'AMMO3': '0.257', 'weapon2': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.114', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '54.000'} [2024-08-06 05:16:52,269][52668] DAMAGECOUNT value on done: 615487.0 [2024-08-06 05:16:52,271][52668] Sum rewards: 76.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.404', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.126', 'weapon7': '0.128', 'AMMO4': '0.172', 'weapon2': '0.192', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.940', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '66.000'} [2024-08-06 05:16:52,401][52811] DAMAGECOUNT value on done: 573771.0 [2024-08-06 05:16:52,401][52811] Sum rewards: 65.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.066', 'AMMO4': '0.208', 'weapon5': '0.214', 'AMMO3': '0.230', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '55.000'} [2024-08-06 05:16:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 490930176. Throughput: 0: 4382.2. Samples: 122737230. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:16:52,794][52567] Avg episode reward: [(0, '73.326')] [2024-08-06 05:16:53,428][52662] DAMAGECOUNT value on done: 625159.0 [2024-08-06 05:16:53,430][52662] Sum rewards: 62.599, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.565', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.120', 'AMMO4': '0.220', 'weapon2': '0.268', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '3.200', 'weapon3': '3.244', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:53,605][52650] Updated weights for policy 0, policy_version 59931 (0.0011) [2024-08-06 05:16:53,894][52660] DAMAGECOUNT value on done: 611027.0 [2024-08-06 05:16:53,894][52660] Sum rewards: 77.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.390', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.068', 'weapon4': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.276', 'WEAPON3': '1.650', 'weapon3': '3.372', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '67.000'} [2024-08-06 05:16:54,986][52647] DAMAGECOUNT value on done: 639273.0 [2024-08-06 05:16:54,987][52647] Sum rewards: 69.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.172', 'AMMO5': '0.018', 'AMMO2': '0.023', 'weapon4': '0.062', 'AMMO4': '0.116', 'weapon5': '0.158', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:55,534][52811] DAMAGECOUNT value on done: 577949.0 [2024-08-06 05:16:55,536][52811] Sum rewards: 78.582, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.059', 'weapon5': '0.064', 'HEALTH': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '0.850', 'weapon3': '3.310', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '62.000'} [2024-08-06 05:16:56,609][52660] DAMAGECOUNT value on done: 618590.0 [2024-08-06 05:16:56,609][52660] Sum rewards: 69.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.167', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.156', 'AMMO3': '0.221', 'weapon2': '0.228', 'AMMO4': '0.299', 'weapon5': '0.312', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:56,658][52662] DAMAGECOUNT value on done: 617123.0 [2024-08-06 05:16:56,659][52662] Sum rewards: 67.646, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.975', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon2': '0.166', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.376', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 05:16:57,185][52803] DAMAGECOUNT value on done: 572582.0 [2024-08-06 05:16:57,185][52803] Sum rewards: 81.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.068', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '69.000'} [2024-08-06 05:16:57,563][52647] DAMAGECOUNT value on done: 653475.0 [2024-08-06 05:16:57,565][52647] Sum rewards: 77.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.145', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.158', 'AMMO3': '0.194', 'weapon2': '0.194', 'weapon5': '0.304', 'AMMO4': '0.320', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '63.000'} [2024-08-06 05:16:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 491020288. Throughput: 0: 4384.6. Samples: 122763560. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:16:57,794][52567] Avg episode reward: [(0, '73.418')] [2024-08-06 05:16:58,552][52650] Updated weights for policy 0, policy_version 59941 (0.0016) [2024-08-06 05:16:58,652][52811] DAMAGECOUNT value on done: 580805.0 [2024-08-06 05:16:58,652][52811] Sum rewards: 61.838, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.005', 'AMMO5': '0.013', 'AMMO2': '0.062', 'AMMO3': '0.187', 'weapon5': '0.238', 'weapon2': '0.242', 'weapon4': '0.260', 'AMMO4': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '2.970', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '50.000'} [2024-08-06 05:16:59,136][52660] DAMAGECOUNT value on done: 608746.0 [2024-08-06 05:16:59,138][52660] Sum rewards: 66.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.112', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.088', 'weapon5': '0.130', 'AMMO4': '0.204', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.300', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 05:16:59,544][52662] DAMAGECOUNT value on done: 606470.0 [2024-08-06 05:16:59,545][52662] Sum rewards: 68.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.130', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.122', 'AMMO3': '0.188', 'AMMO4': '0.223', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.254', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '58.000'} [2024-08-06 05:17:00,236][52647] DAMAGECOUNT value on done: 644805.0 [2024-08-06 05:17:00,238][52647] Sum rewards: 84.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.135', 'AMMO3': '0.174', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '2.788', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '69.000'} [2024-08-06 05:17:00,405][52803] DAMAGECOUNT value on done: 569822.0 [2024-08-06 05:17:00,406][52803] Sum rewards: 66.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.932', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.182', 'weapon5': '0.262', 'AMMO4': '0.270', 'weapon2': '0.280', 'weapon4': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '54.000'} [2024-08-06 05:17:01,903][52660] DAMAGECOUNT value on done: 610775.0 [2024-08-06 05:17:01,903][52660] Sum rewards: 67.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.846', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.126', 'AMMO3': '0.204', 'AMMO4': '0.285', 'weapon2': '0.328', 'WEAPON5': '0.350', 'weapon4': '0.404', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.844', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '56.000'} [2024-08-06 05:17:01,954][52811] DAMAGECOUNT value on done: 572462.0 [2024-08-06 05:17:01,958][52811] Sum rewards: 78.742, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.701', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'weapon4': '0.258', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:01,986][52659] DAMAGECOUNT value on done: 620241.0 [2024-08-06 05:17:01,986][52659] Sum rewards: 68.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.339', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.096', 'weapon5': '0.166', 'AMMO4': '0.167', 'weapon2': '0.176', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.270', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:02,399][52662] DAMAGECOUNT value on done: 614498.0 [2024-08-06 05:17:02,399][52662] Sum rewards: 75.613, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.169', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '60.000'} [2024-08-06 05:17:02,495][52647] DAMAGECOUNT value on done: 652092.0 [2024-08-06 05:17:02,495][52647] Sum rewards: 64.549, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.036', 'AMMO5': '0.023', 'AMMO2': '0.076', 'weapon5': '0.166', 'weapon4': '0.212', 'AMMO3': '0.231', 'AMMO4': '0.379', 'weapon2': '0.630', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.670', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 491110400. Throughput: 0: 4376.4. Samples: 122776650. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:17:02,794][52567] Avg episode reward: [(0, '72.608')] [2024-08-06 05:17:03,003][52650] Updated weights for policy 0, policy_version 59951 (0.0015) [2024-08-06 05:17:03,016][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:17:03,432][52803] DAMAGECOUNT value on done: 575796.0 [2024-08-06 05:17:03,432][52803] Sum rewards: 66.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.038', 'weapon5': '0.084', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 05:17:04,921][52649] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon5', 0.002)] [2024-08-06 05:17:04,975][52659] DAMAGECOUNT value on done: 613089.0 [2024-08-06 05:17:04,975][52659] Sum rewards: 85.016, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.629', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon5': '0.082', 'AMMO3': '0.180', 'weapon4': '0.254', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '69.000'} [2024-08-06 05:17:05,094][52660] DAMAGECOUNT value on done: 623198.0 [2024-08-06 05:17:05,095][52660] Sum rewards: 72.992, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.340', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.138', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '62.000'} [2024-08-06 05:17:05,147][52811] DAMAGECOUNT value on done: 567515.0 [2024-08-06 05:17:05,150][52811] Sum rewards: 75.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.302', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.070', 'AMMO4': '0.105', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '60.000'} [2024-08-06 05:17:05,230][52647] DAMAGECOUNT value on done: 652323.0 [2024-08-06 05:17:05,232][52647] Sum rewards: 69.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.485', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.139', 'weapon4': '0.170', 'weapon5': '0.184', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.666', 'WEAPON3': '0.850', 'weapon3': '2.760', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.500'} [2024-08-06 05:17:05,621][52662] DAMAGECOUNT value on done: 608186.0 [2024-08-06 05:17:05,621][52662] Sum rewards: 67.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.207', 'weapon2': '0.664', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '54.000'} [2024-08-06 05:17:06,554][52803] DAMAGECOUNT value on done: 580396.0 [2024-08-06 05:17:06,554][52803] Sum rewards: 78.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.205', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:07,002][52665] DAMAGECOUNT value on done: 603260.0 [2024-08-06 05:17:07,004][52665] Sum rewards: 83.187, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.178', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '67.000'} [2024-08-06 05:17:07,198][52659] DAMAGECOUNT value on done: 619036.0 [2024-08-06 05:17:07,198][52659] Sum rewards: 70.689, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.034', 'HEALTH': '0.070', 'AMMO4': '0.167', 'weapon5': '0.178', 'AMMO3': '0.213', 'weapon4': '0.226', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 491192320. Throughput: 0: 4374.4. Samples: 122802870. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:17:07,794][52567] Avg episode reward: [(0, '72.845')] [2024-08-06 05:17:07,938][52650] Updated weights for policy 0, policy_version 59961 (0.0016) [2024-08-06 05:17:08,068][52647] DAMAGECOUNT value on done: 636487.0 [2024-08-06 05:17:08,068][52647] Sum rewards: 67.159, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.500', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.040', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.201', 'AMMO3': '0.282', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.336', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:08,337][52660] DAMAGECOUNT value on done: 626796.0 [2024-08-06 05:17:08,340][52660] Sum rewards: 69.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.884', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.180', 'weapon5': '0.182', 'AMMO4': '0.187', 'AMMO3': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.984', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 05:17:08,435][52811] DAMAGECOUNT value on done: 573678.0 [2024-08-06 05:17:08,436][52811] Sum rewards: 71.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.816', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '58.000'} [2024-08-06 05:17:09,653][52803] DAMAGECOUNT value on done: 574035.0 [2024-08-06 05:17:09,657][52803] Sum rewards: 80.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.089', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.074', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO4': '0.221', 'weapon5': '0.224', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.294', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:09,808][52665] DAMAGECOUNT value on done: 617372.0 [2024-08-06 05:17:09,810][52665] Sum rewards: 80.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.148', 'weapon5': '0.176', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '65.000'} [2024-08-06 05:17:10,514][52647] DAMAGECOUNT value on done: 642495.0 [2024-08-06 05:17:10,514][52647] Sum rewards: 60.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.058', 'weapon5': '0.180', 'AMMO4': '0.210', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.742', 'WEAPON3': '1.350', 'weapon3': '2.810', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '51.500'} [2024-08-06 05:17:10,656][52659] DAMAGECOUNT value on done: 613454.0 [2024-08-06 05:17:10,661][52659] Sum rewards: 84.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.526', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.131', 'AMMO3': '0.139', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.618', 'WEAPON3': '0.900', 'weapon3': '2.988', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '67.000'} [2024-08-06 05:17:10,974][52660] DAMAGECOUNT value on done: 609298.0 [2024-08-06 05:17:10,975][52660] Sum rewards: 82.446, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.300', 'AMMO5': '0.021', 'AMMO2': '0.070', 'weapon4': '0.132', 'AMMO3': '0.236', 'weapon2': '0.290', 'weapon5': '0.292', 'AMMO4': '0.351', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '21.108', 'FRAGCOUNT': '68.000'} [2024-08-06 05:17:11,678][52811] DAMAGECOUNT value on done: 572160.0 [2024-08-06 05:17:11,679][52811] Sum rewards: 60.681, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.416', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.171', 'weapon5': '0.236', 'AMMO4': '0.246', 'weapon2': '0.260', 'weapon4': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.930', 'DAMAGECOUNT': '13.500', 'FRAGCOUNT': '51.000'} [2024-08-06 05:17:12,537][52650] Updated weights for policy 0, policy_version 59971 (0.0024) [2024-08-06 05:17:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.6, 300 sec: 17494.8). Total num frames: 491282432. Throughput: 0: 4378.2. Samples: 122829020. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:17:12,794][52567] Avg episode reward: [(0, '72.665')] [2024-08-06 05:17:12,814][52803] DAMAGECOUNT value on done: 568168.0 [2024-08-06 05:17:12,814][52803] Sum rewards: 69.895, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.202', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.203', 'AMMO3': '0.273', 'weapon5': '0.274', 'weapon2': '0.284', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.764', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '61.000'} [2024-08-06 05:17:12,928][52665] DAMAGECOUNT value on done: 614423.0 [2024-08-06 05:17:12,929][52665] Sum rewards: 70.531, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.302', 'weapon2': '0.314', 'WEAPON3': '1.800', 'weapon3': '3.222', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 05:17:13,327][52647] DAMAGECOUNT value on done: 634569.0 [2024-08-06 05:17:13,327][52647] Sum rewards: 67.297, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.074', 'weapon4': '0.158', 'AMMO3': '0.162', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '54.000'} [2024-08-06 05:17:13,506][52659] DAMAGECOUNT value on done: 610467.0 [2024-08-06 05:17:13,508][52659] Sum rewards: 61.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.134', 'AMMO4': '0.177', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.144', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '52.000'} [2024-08-06 05:17:13,829][52660] DAMAGECOUNT value on done: 617953.0 [2024-08-06 05:17:13,829][52660] Sum rewards: 69.893, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.190', 'AMMO5': '0.004', 'weapon5': '0.016', 'weapon4': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.310', 'weapon2': '0.310', 'WEAPON3': '2.000', 'weapon3': '3.400', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:14,810][52811] DAMAGECOUNT value on done: 574012.0 [2024-08-06 05:17:14,810][52811] Sum rewards: 72.532, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.628', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.103', 'weapon4': '0.124', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.800', 'WEAPON3': '0.900', 'weapon3': '2.828', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:15,101][52664] Large shaping reward 2.521 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.111, -37.0), ('weapon5', 0.002)] [2024-08-06 05:17:15,817][52665] DAMAGECOUNT value on done: 607342.0 [2024-08-06 05:17:15,825][52665] Sum rewards: 76.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.059', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '62.000'} [2024-08-06 05:17:15,960][52803] DAMAGECOUNT value on done: 568032.0 [2024-08-06 05:17:15,963][52803] Sum rewards: 65.015, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.988', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.150', 'weapon5': '0.190', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:16,163][52647] DAMAGECOUNT value on done: 640109.0 [2024-08-06 05:17:16,163][52647] Sum rewards: 69.599, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.172', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.306', 'WEAPON3': '1.650', 'weapon3': '3.166', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:16,442][52659] DAMAGECOUNT value on done: 617779.0 [2024-08-06 05:17:16,445][52659] Sum rewards: 75.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.521', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.086', 'weapon5': '0.126', 'AMMO4': '0.127', 'weapon2': '0.212', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:16,565][52660] DAMAGECOUNT value on done: 610953.0 [2024-08-06 05:17:16,565][52660] Sum rewards: 69.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.140', 'weapon4': '0.168', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:16,960][52650] Updated weights for policy 0, policy_version 59981 (0.0026) [2024-08-06 05:17:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 491372544. Throughput: 0: 4384.7. Samples: 122842230. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:17:17,794][52567] Avg episode reward: [(0, '72.622')] [2024-08-06 05:17:17,865][52811] DAMAGECOUNT value on done: 578541.0 [2024-08-06 05:17:17,865][52811] Sum rewards: 76.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.076', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:18,592][52665] DAMAGECOUNT value on done: 597590.0 [2024-08-06 05:17:18,593][52665] Sum rewards: 69.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.191', 'weapon2': '0.516', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.148', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '58.000'} [2024-08-06 05:17:18,885][52803] DAMAGECOUNT value on done: 564292.0 [2024-08-06 05:17:18,887][52803] Sum rewards: 74.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.094', 'weapon5': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '60.000'} [2024-08-06 05:17:19,657][52659] DAMAGECOUNT value on done: 613282.0 [2024-08-06 05:17:19,660][52659] Sum rewards: 81.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.061', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.068', 'AMMO4': '0.108', 'weapon4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.458', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '66.000'} [2024-08-06 05:17:19,703][52660] DAMAGECOUNT value on done: 609937.0 [2024-08-06 05:17:19,706][52660] Sum rewards: 61.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'AMMO5': '0.026', 'AMMO2': '0.052', 'weapon4': '0.116', 'AMMO3': '0.193', 'AMMO4': '0.259', 'weapon5': '0.310', 'WEAPON4': '0.500', 'weapon2': '0.580', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.114', 'FRAGCOUNT': '51.000'} [2024-08-06 05:17:20,626][52794] DAMAGECOUNT value on done: 617167.0 [2024-08-06 05:17:20,627][52794] Sum rewards: 71.501, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.341', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.088', 'weapon5': '0.138', 'AMMO4': '0.217', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.750', 'weapon3': '3.152', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:20,978][52811] DAMAGECOUNT value on done: 575012.0 [2024-08-06 05:17:20,979][52811] Sum rewards: 75.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.308', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.168', 'AMMO4': '0.209', 'weapon2': '0.232', 'weapon4': '0.272', 'weapon5': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:21,601][52665] DAMAGECOUNT value on done: 602402.0 [2024-08-06 05:17:21,601][52665] Sum rewards: 81.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.056', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.082', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.484', 'WEAPON3': '0.950', 'weapon3': '3.274', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:21,983][52650] Updated weights for policy 0, policy_version 59991 (0.0011) [2024-08-06 05:17:22,080][52803] DAMAGECOUNT value on done: 570845.0 [2024-08-06 05:17:22,082][52803] Sum rewards: 74.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.966', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO3': '0.276', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:22,728][52659] DAMAGECOUNT value on done: 610802.0 [2024-08-06 05:17:22,728][52659] Sum rewards: 66.719, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.625', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.160', 'weapon2': '0.204', 'AMMO4': '0.217', 'weapon5': '0.224', 'weapon4': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '55.000'} [2024-08-06 05:17:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 491462656. Throughput: 0: 4386.7. Samples: 122868500. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:17:22,794][52567] Avg episode reward: [(0, '72.694')] [2024-08-06 05:17:22,845][52660] DAMAGECOUNT value on done: 603369.0 [2024-08-06 05:17:22,846][52660] Sum rewards: 72.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.735', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.217', 'weapon2': '0.358', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '61.000'} [2024-08-06 05:17:23,730][52794] DAMAGECOUNT value on done: 622209.0 [2024-08-06 05:17:23,732][52794] Sum rewards: 66.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.167', 'weapon5': '0.202', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.486', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '53.500'} [2024-08-06 05:17:24,036][52811] DAMAGECOUNT value on done: 571455.0 [2024-08-06 05:17:24,038][52811] Sum rewards: 68.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.692', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.045', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:24,729][52665] DAMAGECOUNT value on done: 608850.0 [2024-08-06 05:17:24,731][52665] Sum rewards: 75.664, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.117', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.600', 'weapon3': '3.230', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:25,170][52803] DAMAGECOUNT value on done: 565824.0 [2024-08-06 05:17:25,170][52803] Sum rewards: 79.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.558', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.164', 'weapon2': '0.170', 'AMMO3': '0.232', 'weapon4': '0.252', 'AMMO4': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '66.000'} [2024-08-06 05:17:25,642][52659] DAMAGECOUNT value on done: 618999.0 [2024-08-06 05:17:25,643][52659] Sum rewards: 81.920, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.129', 'weapon5': '0.144', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '66.000'} [2024-08-06 05:17:26,653][52650] Updated weights for policy 0, policy_version 60001 (0.0017) [2024-08-06 05:17:26,892][52794] DAMAGECOUNT value on done: 621068.0 [2024-08-06 05:17:26,892][52794] Sum rewards: 72.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.054', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.090', 'weapon5': '0.140', 'AMMO4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.284', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '60.000'} [2024-08-06 05:17:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 491544576. Throughput: 0: 4384.4. Samples: 122894770. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 05:17:27,794][52567] Avg episode reward: [(0, '72.648')] [2024-08-06 05:17:27,889][52665] DAMAGECOUNT value on done: 605764.0 [2024-08-06 05:17:27,889][52665] Sum rewards: 63.596, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO3': '0.156', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.292', 'weapon4': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.828', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '51.000'} [2024-08-06 05:17:28,203][52659] DAMAGECOUNT value on done: 620773.0 [2024-08-06 05:17:28,204][52659] Sum rewards: 63.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.934', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon5': '0.188', 'AMMO3': '0.189', 'weapon4': '0.218', 'AMMO4': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '55.000'} [2024-08-06 05:17:28,454][52803] DAMAGECOUNT value on done: 584081.0 [2024-08-06 05:17:28,456][52803] Sum rewards: 73.328, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.818', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.080', 'AMMO4': '0.153', 'weapon5': '0.162', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:29,825][52794] DAMAGECOUNT value on done: 611798.0 [2024-08-06 05:17:29,826][52794] Sum rewards: 73.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.210', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:30,344][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:17:30,475][52665] DAMAGECOUNT value on done: 616835.0 [2024-08-06 05:17:30,476][52665] Sum rewards: 70.100, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.674', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.170', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.306', 'WEAPON3': '1.700', 'weapon3': '3.184', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:30,758][52659] DAMAGECOUNT value on done: 611303.0 [2024-08-06 05:17:30,759][52659] Sum rewards: 71.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.053', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon4': '0.164', 'weapon5': '0.184', 'AMMO4': '0.220', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:31,167][52650] Updated weights for policy 0, policy_version 60011 (0.0017) [2024-08-06 05:17:31,564][52803] DAMAGECOUNT value on done: 569641.0 [2024-08-06 05:17:31,572][52803] Sum rewards: 68.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.122', 'AMMO4': '0.124', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'HITCOUNT': '3.540', 'weapon3': '3.690', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '58.000'} [2024-08-06 05:17:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 491634688. Throughput: 0: 4382.0. Samples: 122908000. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:17:32,795][52567] Avg episode reward: [(0, '72.560')] [2024-08-06 05:17:32,916][52794] DAMAGECOUNT value on done: 612104.0 [2024-08-06 05:17:32,917][52794] Sum rewards: 71.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.055', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.062', 'weapon5': '0.182', 'AMMO3': '0.239', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '60.000'} [2024-08-06 05:17:33,428][52665] DAMAGECOUNT value on done: 606020.0 [2024-08-06 05:17:33,432][52665] Sum rewards: 64.875, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.096', 'weapon4': '0.130', 'AMMO4': '0.190', 'AMMO3': '0.255', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '55.000'} [2024-08-06 05:17:33,770][52659] DAMAGECOUNT value on done: 620679.0 [2024-08-06 05:17:33,770][52659] Sum rewards: 62.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.194', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.144', 'weapon5': '0.206', 'AMMO3': '0.223', 'AMMO4': '0.263', 'weapon2': '0.288', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '53.000'} [2024-08-06 05:17:34,142][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:17:34,602][52803] DAMAGECOUNT value on done: 567689.0 [2024-08-06 05:17:34,605][52803] Sum rewards: 61.749, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.125', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.129', 'WEAPON3': '0.750', 'weapon2': '1.018', 'weapon3': '2.698', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '47.000'} [2024-08-06 05:17:35,456][52794] DAMAGECOUNT value on done: 615741.0 [2024-08-06 05:17:35,457][52794] Sum rewards: 66.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.326', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.154', 'weapon4': '0.164', 'AMMO4': '0.239', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '2.936', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '55.000'} [2024-08-06 05:17:35,850][52650] Updated weights for policy 0, policy_version 60021 (0.0011) [2024-08-06 05:17:36,441][52665] DAMAGECOUNT value on done: 616336.0 [2024-08-06 05:17:36,441][52665] Sum rewards: 69.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon2': '0.190', 'AMMO3': '0.200', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.580', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '58.000'} [2024-08-06 05:17:36,595][52659] DAMAGECOUNT value on done: 610755.0 [2024-08-06 05:17:36,596][52659] Sum rewards: 79.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.085', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.234', 'weapon2': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.518', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '67.000'} [2024-08-06 05:17:37,752][52803] DAMAGECOUNT value on done: 584478.0 [2024-08-06 05:17:37,754][52803] Sum rewards: 64.577, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.436', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.098', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.218', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 491724800. Throughput: 0: 4385.8. Samples: 122934590. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:17:37,794][52567] Avg episode reward: [(0, '72.141')] [2024-08-06 05:17:38,391][52794] DAMAGECOUNT value on done: 620719.0 [2024-08-06 05:17:38,392][52794] Sum rewards: 62.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.595', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'HITCOUNT': '3.340', 'weapon3': '3.530', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '53.000'} [2024-08-06 05:17:39,370][52659] DAMAGECOUNT value on done: 612526.0 [2024-08-06 05:17:39,372][52659] Sum rewards: 67.082, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.186', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.086', 'weapon4': '0.198', 'AMMO3': '0.241', 'weapon2': '0.262', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:39,451][52665] DAMAGECOUNT value on done: 612718.0 [2024-08-06 05:17:39,451][52665] Sum rewards: 62.261, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.120', 'weapon5': '0.226', 'AMMO4': '0.235', 'AMMO3': '0.277', 'weapon2': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '2.986', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '54.000'} [2024-08-06 05:17:39,950][52667] DAMAGECOUNT value on done: 615374.0 [2024-08-06 05:17:39,954][52667] Sum rewards: 64.588, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.842', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.126', 'AMMO4': '0.135', 'weapon5': '0.172', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.680', 'WEAPON3': '0.900', 'weapon3': '2.390', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '51.000'} [2024-08-06 05:17:40,476][52650] Updated weights for policy 0, policy_version 60031 (0.0014) [2024-08-06 05:17:40,852][52803] DAMAGECOUNT value on done: 572701.0 [2024-08-06 05:17:40,853][52803] Sum rewards: 80.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '67.000'} [2024-08-06 05:17:41,556][52794] DAMAGECOUNT value on done: 608349.0 [2024-08-06 05:17:41,557][52794] Sum rewards: 78.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.739', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.116', 'weapon5': '0.212', 'AMMO3': '0.242', 'AMMO4': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '2.864', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:42,415][52659] DAMAGECOUNT value on done: 625761.0 [2024-08-06 05:17:42,415][52659] Sum rewards: 75.279, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.791', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.092', 'AMMO3': '0.191', 'AMMO4': '0.205', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '60.000'} [2024-08-06 05:17:42,492][52667] DAMAGECOUNT value on done: 623872.0 [2024-08-06 05:17:42,492][52667] Sum rewards: 79.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'weapon4': '0.174', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:42,568][52665] DAMAGECOUNT value on done: 611894.0 [2024-08-06 05:17:42,569][52665] Sum rewards: 70.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.762', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.078', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '58.000'} [2024-08-06 05:17:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 491806720. Throughput: 0: 4382.2. Samples: 122960760. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:17:42,794][52567] Avg episode reward: [(0, '71.743')] [2024-08-06 05:17:42,827][52664] DAMAGECOUNT value on done: 638508.0 [2024-08-06 05:17:42,827][52664] Sum rewards: 85.129, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.174', 'AMMO3': '0.176', 'weapon2': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '67.000'} [2024-08-06 05:17:44,020][52803] DAMAGECOUNT value on done: 571082.0 [2024-08-06 05:17:44,022][52803] Sum rewards: 64.883, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.485', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.036', 'weapon5': '0.082', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '53.000'} [2024-08-06 05:17:44,060][52794] DAMAGECOUNT value on done: 619955.0 [2024-08-06 05:17:44,060][52794] Sum rewards: 77.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.614', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.104', 'AMMO4': '0.111', 'weapon5': '0.140', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.686', 'WEAPON3': '1.500', 'weapon3': '2.816', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '65.000'} [2024-08-06 05:17:45,006][52650] Updated weights for policy 0, policy_version 60041 (0.0025) [2024-08-06 05:17:45,415][52665] DAMAGECOUNT value on done: 609204.0 [2024-08-06 05:17:45,415][52665] Sum rewards: 76.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.292', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:45,442][52659] DAMAGECOUNT value on done: 618076.0 [2024-08-06 05:17:45,444][52659] Sum rewards: 68.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.066', 'AMMO4': '0.159', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 05:17:45,508][52667] DAMAGECOUNT value on done: 618794.0 [2024-08-06 05:17:45,510][52667] Sum rewards: 73.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.114', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '61.000'} [2024-08-06 05:17:45,817][52664] DAMAGECOUNT value on done: 642166.0 [2024-08-06 05:17:45,818][52664] Sum rewards: 81.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.638', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.110', 'weapon5': '0.160', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '67.000'} [2024-08-06 05:17:46,912][52794] DAMAGECOUNT value on done: 612557.0 [2024-08-06 05:17:46,916][52794] Sum rewards: 64.553, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.270', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.082', 'AMMO4': '0.206', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2024-08-06 05:17:47,028][52803] DAMAGECOUNT value on done: 575568.0 [2024-08-06 05:17:47,031][52803] Sum rewards: 65.740, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.175', 'AMMO5': '0.011', 'AMMO2': '0.066', 'weapon5': '0.186', 'weapon2': '0.244', 'AMMO3': '0.275', 'weapon4': '0.294', 'WEAPON5': '0.300', 'AMMO4': '0.329', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 491905024. Throughput: 0: 4379.6. Samples: 122973730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:17:47,794][52567] Avg episode reward: [(0, '71.577')] [2024-08-06 05:17:47,927][52665] DAMAGECOUNT value on done: 606703.0 [2024-08-06 05:17:47,928][52665] Sum rewards: 82.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '69.000'} [2024-08-06 05:17:48,244][52667] DAMAGECOUNT value on done: 619394.0 [2024-08-06 05:17:48,245][52667] Sum rewards: 74.047, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.601', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '60.000'} [2024-08-06 05:17:48,473][52659] DAMAGECOUNT value on done: 624905.0 [2024-08-06 05:17:48,476][52659] Sum rewards: 76.581, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.775', 'AMMO5': '0.021', 'AMMO2': '0.074', 'weapon4': '0.214', 'weapon5': '0.232', 'AMMO3': '0.272', 'weapon2': '0.296', 'AMMO4': '0.371', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.896', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '66.000'} [2024-08-06 05:17:48,927][52664] DAMAGECOUNT value on done: 642193.0 [2024-08-06 05:17:48,927][52664] Sum rewards: 66.112, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.530', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.133', 'weapon5': '0.178', 'AMMO4': '0.203', 'weapon4': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.780', 'WEAPON3': '0.850', 'weapon3': '2.570', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '51.000'} [2024-08-06 05:17:49,648][52794] DAMAGECOUNT value on done: 611442.0 [2024-08-06 05:17:49,649][52794] Sum rewards: 70.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.535', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO4': '0.221', 'weapon5': '0.224', 'weapon4': '0.242', 'AMMO3': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '2.764', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '62.000'} [2024-08-06 05:17:50,068][52650] Updated weights for policy 0, policy_version 60051 (0.0013) [2024-08-06 05:17:50,384][52803] DAMAGECOUNT value on done: 577989.0 [2024-08-06 05:17:50,387][52803] Sum rewards: 70.512, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.116', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'weapon5': '0.264', 'weapon4': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.722', 'WEAPON3': '0.800', 'weapon3': '2.480', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '55.000'} [2024-08-06 05:17:50,931][52665] DAMAGECOUNT value on done: 607273.0 [2024-08-06 05:17:50,931][52665] Sum rewards: 83.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.658', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'weapon4': '0.088', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.246', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.684', 'FRAGCOUNT': '68.000'} [2024-08-06 05:17:51,022][52659] DAMAGECOUNT value on done: 614453.0 [2024-08-06 05:17:51,023][52659] Sum rewards: 64.866, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.430', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.120', 'weapon5': '0.148', 'weapon2': '0.200', 'AMMO4': '0.293', 'AMMO3': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.208', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:51,354][52667] DAMAGECOUNT value on done: 623891.0 [2024-08-06 05:17:51,356][52667] Sum rewards: 67.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.114', 'AMMO5': '0.026', 'AMMO2': '0.055', 'AMMO3': '0.183', 'weapon5': '0.270', 'AMMO4': '0.273', 'weapon2': '0.370', 'weapon4': '0.408', 'WEAPON5': '0.700', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '56.000'} [2024-08-06 05:17:51,683][52664] DAMAGECOUNT value on done: 633589.0 [2024-08-06 05:17:51,684][52664] Sum rewards: 72.988, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.162', 'AMMO3': '0.302', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.164', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 491978752. Throughput: 0: 4383.3. Samples: 123000120. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:17:52,794][52567] Avg episode reward: [(0, '71.754')] [2024-08-06 05:17:52,966][52794] DAMAGECOUNT value on done: 615064.0 [2024-08-06 05:17:52,968][52794] Sum rewards: 58.924, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.132', 'AMMO4': '0.198', 'weapon5': '0.212', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '50.000'} [2024-08-06 05:17:53,548][52803] DAMAGECOUNT value on done: 581288.0 [2024-08-06 05:17:53,550][52803] Sum rewards: 71.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon5': '0.064', 'weapon4': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:53,823][52659] DAMAGECOUNT value on done: 620555.0 [2024-08-06 05:17:53,823][52659] Sum rewards: 73.121, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.070', 'AMMO3': '0.189', 'AMMO4': '0.222', 'weapon5': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.798', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:53,936][52665] DAMAGECOUNT value on done: 607726.0 [2024-08-06 05:17:53,937][52665] Sum rewards: 64.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.372', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.146', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2024-08-06 05:17:54,018][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:17:54,300][52667] DAMAGECOUNT value on done: 626354.0 [2024-08-06 05:17:54,300][52667] Sum rewards: 73.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.446', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.316', 'WEAPON3': '1.700', 'weapon3': '3.242', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '64.000'} [2024-08-06 05:17:54,470][52650] Updated weights for policy 0, policy_version 60061 (0.0011) [2024-08-06 05:17:54,847][52664] DAMAGECOUNT value on done: 642297.0 [2024-08-06 05:17:54,848][52664] Sum rewards: 83.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.588', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon4': '0.074', 'AMMO3': '0.201', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '67.000'} [2024-08-06 05:17:56,094][52794] DAMAGECOUNT value on done: 609823.0 [2024-08-06 05:17:56,095][52794] Sum rewards: 77.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.642', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.074', 'weapon5': '0.108', 'AMMO3': '0.218', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '63.000'} [2024-08-06 05:17:56,535][52659] DAMAGECOUNT value on done: 615271.0 [2024-08-06 05:17:56,536][52659] Sum rewards: 75.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.836', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.179', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.650', 'weapon3': '3.236', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.000'} [2024-08-06 05:17:56,561][52803] DAMAGECOUNT value on done: 570050.0 [2024-08-06 05:17:56,562][52803] Sum rewards: 66.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.801', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.180', 'AMMO4': '0.182', 'weapon2': '0.236', 'weapon5': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.100', 'HITCOUNT': '2.750', 'weapon3': '2.864', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '52.000'} [2024-08-06 05:17:56,965][52665] DAMAGECOUNT value on done: 602212.0 [2024-08-06 05:17:56,965][52665] Sum rewards: 68.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.335', 'AMMO5': '0.023', 'AMMO2': '0.047', 'weapon4': '0.094', 'AMMO3': '0.159', 'AMMO4': '0.236', 'weapon5': '0.244', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.994', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '57.000'} [2024-08-06 05:17:57,086][52667] DAMAGECOUNT value on done: 619961.0 [2024-08-06 05:17:57,086][52667] Sum rewards: 62.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.288', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO4': '0.017', 'weapon5': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.852', 'WEAPON3': '1.450', 'weapon3': '2.922', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '54.000'} [2024-08-06 05:17:57,671][52664] DAMAGECOUNT value on done: 637356.0 [2024-08-06 05:17:57,672][52664] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.654', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.050', 'AMMO4': '0.163', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '55.000'} [2024-08-06 05:17:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 492077056. Throughput: 0: 4384.0. Samples: 123026300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:17:57,794][52567] Avg episode reward: [(0, '71.746')] [2024-08-06 05:17:58,988][52794] DAMAGECOUNT value on done: 630060.0 [2024-08-06 05:17:58,989][52794] Sum rewards: 71.524, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.963', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.134', 'weapon5': '0.182', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '59.000'} [2024-08-06 05:17:59,186][52650] Updated weights for policy 0, policy_version 60071 (0.0031) [2024-08-06 05:17:59,924][52667] DAMAGECOUNT value on done: 617171.0 [2024-08-06 05:17:59,926][52667] Sum rewards: 70.221, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.066', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.207', 'AMMO3': '0.242', 'weapon5': '0.242', 'weapon2': '0.308', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:00,050][52665] DAMAGECOUNT value on done: 607618.0 [2024-08-06 05:18:00,050][52665] Sum rewards: 89.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.132', 'AMMO4': '0.197', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '22.812', 'FRAGCOUNT': '72.500'} [2024-08-06 05:18:00,303][52664] DAMAGECOUNT value on done: 635448.0 [2024-08-06 05:18:00,303][52664] Sum rewards: 79.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.700', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.128', 'AMMO3': '0.213', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '66.000'} [2024-08-06 05:18:01,226][52663] DAMAGECOUNT value on done: 626134.0 [2024-08-06 05:18:01,229][52663] Sum rewards: 88.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.261', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.148', 'weapon5': '0.158', 'AMMO3': '0.196', 'AMMO4': '0.231', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.021', 'FRAGCOUNT': '72.000'} [2024-08-06 05:18:01,819][52794] DAMAGECOUNT value on done: 610689.0 [2024-08-06 05:18:01,820][52794] Sum rewards: 77.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.486', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '63.000'} [2024-08-06 05:18:02,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 492158976. Throughput: 0: 4390.2. Samples: 123039790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:18:02,795][52567] Avg episode reward: [(0, '72.031')] [2024-08-06 05:18:02,970][52665] DAMAGECOUNT value on done: 609691.0 [2024-08-06 05:18:02,971][52665] Sum rewards: 75.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.003', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.092', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.248', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '62.000'} [2024-08-06 05:18:03,014][52667] DAMAGECOUNT value on done: 621289.0 [2024-08-06 05:18:03,015][52667] Sum rewards: 68.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.021', 'AMMO2': '0.070', 'AMMO3': '0.173', 'weapon4': '0.178', 'weapon5': '0.348', 'AMMO4': '0.349', 'weapon2': '0.396', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2024-08-06 05:18:03,302][52664] DAMAGECOUNT value on done: 631132.0 [2024-08-06 05:18:03,302][52664] Sum rewards: 73.135, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.114', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.072', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '61.000'} [2024-08-06 05:18:03,824][52650] Updated weights for policy 0, policy_version 60081 (0.0032) [2024-08-06 05:18:03,948][52663] DAMAGECOUNT value on done: 616114.0 [2024-08-06 05:18:03,949][52663] Sum rewards: 68.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.808', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.066', 'AMMO4': '0.176', 'weapon5': '0.184', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '55.000'} [2024-08-06 05:18:05,056][52794] DAMAGECOUNT value on done: 624598.0 [2024-08-06 05:18:05,056][52794] Sum rewards: 73.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.524', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '61.000'} [2024-08-06 05:18:06,015][52667] DAMAGECOUNT value on done: 624748.0 [2024-08-06 05:18:06,016][52667] Sum rewards: 78.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.103', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.092', 'weapon5': '0.106', 'AMMO4': '0.119', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '65.000'} [2024-08-06 05:18:06,129][52664] DAMAGECOUNT value on done: 642921.0 [2024-08-06 05:18:06,130][52664] Sum rewards: 69.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.161', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.096', 'weapon5': '0.180', 'AMMO4': '0.216', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:07,240][52663] DAMAGECOUNT value on done: 605852.0 [2024-08-06 05:18:07,240][52663] Sum rewards: 68.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.120', 'AMMO3': '0.206', 'weapon2': '0.208', 'AMMO4': '0.298', 'weapon5': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '56.000'} [2024-08-06 05:18:07,714][52794] DAMAGECOUNT value on done: 616705.0 [2024-08-06 05:18:07,714][52794] Sum rewards: 77.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.315', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.108', 'weapon4': '0.142', 'AMMO4': '0.171', 'AMMO3': '0.252', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.160', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 05:18:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 492249088. Throughput: 0: 4389.8. Samples: 123066040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:18:07,802][52567] Avg episode reward: [(0, '71.890')] [2024-08-06 05:18:08,617][52650] Updated weights for policy 0, policy_version 60091 (0.0017) [2024-08-06 05:18:08,733][52667] DAMAGECOUNT value on done: 612806.0 [2024-08-06 05:18:08,735][52667] Sum rewards: 65.128, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.960', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.068', 'weapon4': '0.100', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.700', 'HITCOUNT': '3.100', 'weapon3': '3.224', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:08,987][52664] DAMAGECOUNT value on done: 635900.0 [2024-08-06 05:18:08,987][52664] Sum rewards: 79.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.043', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.232', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.404', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '67.000'} [2024-08-06 05:18:09,755][52663] DAMAGECOUNT value on done: 614697.0 [2024-08-06 05:18:09,756][52663] Sum rewards: 78.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.078', 'weapon5': '0.216', 'AMMO3': '0.227', 'AMMO4': '0.230', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.955', 'FRAGCOUNT': '62.500'} [2024-08-06 05:18:10,792][52794] DAMAGECOUNT value on done: 624628.0 [2024-08-06 05:18:10,793][52794] Sum rewards: 73.733, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.187', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '3.410', 'weapon3': '3.444', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:11,638][52664] DAMAGECOUNT value on done: 644089.0 [2024-08-06 05:18:11,639][52664] Sum rewards: 81.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.088', 'weapon5': '0.122', 'AMMO4': '0.168', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '67.000'} [2024-08-06 05:18:11,841][52667] DAMAGECOUNT value on done: 615312.0 [2024-08-06 05:18:11,842][52667] Sum rewards: 59.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.230', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.372', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '51.000'} [2024-08-06 05:18:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.7, 300 sec: 17522.6). Total num frames: 492339200. Throughput: 0: 4383.5. Samples: 123092030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:18:12,802][52567] Avg episode reward: [(0, '72.146')] [2024-08-06 05:18:13,015][52650] Updated weights for policy 0, policy_version 60101 (0.0011) [2024-08-06 05:18:13,134][52663] DAMAGECOUNT value on done: 617841.0 [2024-08-06 05:18:13,136][52663] Sum rewards: 73.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.086', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.190', 'weapon5': '0.198', 'AMMO4': '0.224', 'AMMO3': '0.266', 'weapon2': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:14,029][52794] DAMAGECOUNT value on done: 625144.0 [2024-08-06 05:18:14,031][52794] Sum rewards: 74.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.706', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.154', 'AMMO3': '0.166', 'weapon4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:14,123][52664] DAMAGECOUNT value on done: 641827.0 [2024-08-06 05:18:14,123][52664] Sum rewards: 69.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.091', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '56.000'} [2024-08-06 05:18:14,612][52614] Signal inference workers to stop experience collection... (10900 times) [2024-08-06 05:18:14,613][52614] Signal inference workers to resume experience collection... (10900 times) [2024-08-06 05:18:14,662][52650] InferenceWorker_p0-w0: stopping experience collection (10900 times) [2024-08-06 05:18:14,674][52650] InferenceWorker_p0-w0: resuming experience collection (10900 times) [2024-08-06 05:18:14,883][52667] DAMAGECOUNT value on done: 621635.0 [2024-08-06 05:18:14,884][52667] Sum rewards: 69.466, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.818', 'AMMO5': '0.019', 'AMMO2': '0.076', 'AMMO3': '0.223', 'weapon5': '0.316', 'weapon2': '0.328', 'AMMO4': '0.381', 'weapon4': '0.480', 'WEAPON5': '0.500', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.488', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:15,862][52666] DAMAGECOUNT value on done: 616498.0 [2024-08-06 05:18:15,864][52666] Sum rewards: 72.761, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.655', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.120', 'weapon4': '0.122', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.940', 'WEAPON3': '1.050', 'weapon3': '2.658', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '56.000'} [2024-08-06 05:18:15,877][52663] DAMAGECOUNT value on done: 625520.0 [2024-08-06 05:18:15,878][52663] Sum rewards: 81.053, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.143', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.102', 'weapon5': '0.182', 'AMMO4': '0.239', 'AMMO3': '0.298', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '2.996', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.691', 'FRAGCOUNT': '72.500'} [2024-08-06 05:18:16,552][52670] DAMAGECOUNT value on done: 607460.0 [2024-08-06 05:18:16,553][52670] Sum rewards: 79.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.792', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.086', 'weapon5': '0.168', 'AMMO3': '0.230', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '64.500'} [2024-08-06 05:18:17,024][52664] DAMAGECOUNT value on done: 645401.0 [2024-08-06 05:18:17,026][52664] Sum rewards: 68.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.119', 'weapon5': '0.180', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '57.000'} [2024-08-06 05:18:17,285][52794] DAMAGECOUNT value on done: 616203.0 [2024-08-06 05:18:17,286][52794] Sum rewards: 76.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.020', 'AMMO2': '0.067', 'weapon4': '0.108', 'AMMO3': '0.231', 'weapon5': '0.302', 'AMMO4': '0.334', 'weapon2': '0.430', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '63.000'} [2024-08-06 05:18:17,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 492421120. Throughput: 0: 4387.3. Samples: 123105430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:18:17,796][52567] Avg episode reward: [(0, '72.368')] [2024-08-06 05:18:17,857][52650] Updated weights for policy 0, policy_version 60111 (0.0014) [2024-08-06 05:18:17,893][52667] DAMAGECOUNT value on done: 612156.0 [2024-08-06 05:18:17,894][52667] Sum rewards: 71.797, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.545', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.199', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '57.000'} [2024-08-06 05:18:18,955][52663] DAMAGECOUNT value on done: 616774.0 [2024-08-06 05:18:18,956][52663] Sum rewards: 70.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.059', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.102', 'weapon4': '0.108', 'AMMO4': '0.151', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:18,976][52666] DAMAGECOUNT value on done: 618494.0 [2024-08-06 05:18:18,977][52666] Sum rewards: 62.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '2.920', 'weapon3': '3.416', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '53.000'} [2024-08-06 05:18:19,428][52670] DAMAGECOUNT value on done: 617168.0 [2024-08-06 05:18:19,429][52670] Sum rewards: 77.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '63.000'} [2024-08-06 05:18:20,306][52664] DAMAGECOUNT value on done: 646486.0 [2024-08-06 05:18:20,308][52664] Sum rewards: 73.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon4': '0.058', 'weapon5': '0.138', 'AMMO3': '0.229', 'AMMO4': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '61.000'} [2024-08-06 05:18:20,443][52667] DAMAGECOUNT value on done: 621919.0 [2024-08-06 05:18:20,443][52667] Sum rewards: 89.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.600', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.232', 'AMMO3': '0.239', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '20.817', 'FRAGCOUNT': '74.000'} [2024-08-06 05:18:21,561][52666] DAMAGECOUNT value on done: 619254.0 [2024-08-06 05:18:21,562][52666] Sum rewards: 70.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.059', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.098', 'weapon5': '0.106', 'AMMO4': '0.163', 'AMMO3': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:21,832][52663] DAMAGECOUNT value on done: 609706.0 [2024-08-06 05:18:21,833][52663] Sum rewards: 79.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.084', 'AMMO3': '0.239', 'AMMO4': '0.298', 'weapon5': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.714', 'WEAPON3': '1.400', 'weapon3': '2.640', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '66.000'} [2024-08-06 05:18:22,236][52670] DAMAGECOUNT value on done: 607855.0 [2024-08-06 05:18:22,236][52670] Sum rewards: 67.592, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.147', 'weapon2': '0.222', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.218', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 492503040. Throughput: 0: 4374.4. Samples: 123131440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:18:22,794][52567] Avg episode reward: [(0, '72.392')] [2024-08-06 05:18:23,017][52650] Updated weights for policy 0, policy_version 60121 (0.0010) [2024-08-06 05:18:23,490][52667] DAMAGECOUNT value on done: 627654.0 [2024-08-06 05:18:23,490][52667] Sum rewards: 69.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.952', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.022', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:23,523][52664] DAMAGECOUNT value on done: 648918.0 [2024-08-06 05:18:23,524][52664] Sum rewards: 72.233, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.084', 'weapon4': '0.092', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '62.000'} [2024-08-06 05:18:24,352][52663] DAMAGECOUNT value on done: 608565.0 [2024-08-06 05:18:24,353][52663] Sum rewards: 73.096, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.563', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.275', 'WEAPON3': '1.750', 'weapon3': '3.526', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:24,437][52666] DAMAGECOUNT value on done: 618653.0 [2024-08-06 05:18:24,438][52666] Sum rewards: 68.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.110', 'AMMO4': '0.217', 'AMMO3': '0.223', 'weapon5': '0.230', 'weapon2': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '56.000'} [2024-08-06 05:18:25,182][52670] DAMAGECOUNT value on done: 604161.0 [2024-08-06 05:18:25,184][52670] Sum rewards: 73.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.058', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.412', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.000'} [2024-08-06 05:18:25,674][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:18:25,994][52664] DAMAGECOUNT value on done: 637847.0 [2024-08-06 05:18:25,994][52664] Sum rewards: 76.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.084', 'weapon5': '0.122', 'AMMO4': '0.134', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:26,472][52667] DAMAGECOUNT value on done: 624874.0 [2024-08-06 05:18:26,475][52667] Sum rewards: 66.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.086', 'weapon4': '0.096', 'AMMO4': '0.133', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.316', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '55.000'} [2024-08-06 05:18:27,078][52666] DAMAGECOUNT value on done: 611928.0 [2024-08-06 05:18:27,078][52666] Sum rewards: 79.670, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.142', 'weapon4': '0.158', 'AMMO4': '0.246', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '69.000'} [2024-08-06 05:18:27,248][52650] Updated weights for policy 0, policy_version 60131 (0.0013) [2024-08-06 05:18:27,332][52663] DAMAGECOUNT value on done: 615120.0 [2024-08-06 05:18:27,333][52663] Sum rewards: 70.554, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.128', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.146', 'weapon4': '0.152', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:27,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 492601344. Throughput: 0: 4382.0. Samples: 123157950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:18:27,794][52567] Avg episode reward: [(0, '72.443')] [2024-08-06 05:18:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060132_492601344.pth... [2024-08-06 05:18:27,914][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059619_488398848.pth [2024-08-06 05:18:27,971][52670] DAMAGECOUNT value on done: 619728.0 [2024-08-06 05:18:27,971][52670] Sum rewards: 68.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.803', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.080', 'AMMO4': '0.178', 'weapon5': '0.182', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '57.000'} [2024-08-06 05:18:28,672][52664] DAMAGECOUNT value on done: 635350.0 [2024-08-06 05:18:28,672][52664] Sum rewards: 76.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.511', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.096', 'weapon5': '0.182', 'AMMO4': '0.193', 'AMMO3': '0.201', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 05:18:29,432][52667] DAMAGECOUNT value on done: 626008.0 [2024-08-06 05:18:29,433][52667] Sum rewards: 69.943, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.838', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon5': '0.182', 'weapon2': '0.256', 'AMMO3': '0.263', 'AMMO4': '0.327', 'weapon4': '0.436', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.798', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:30,144][52666] DAMAGECOUNT value on done: 609850.0 [2024-08-06 05:18:30,144][52666] Sum rewards: 74.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.132', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.142', 'weapon2': '0.190', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '61.000'} [2024-08-06 05:18:30,466][52663] DAMAGECOUNT value on done: 624434.0 [2024-08-06 05:18:30,469][52663] Sum rewards: 77.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.068', 'weapon5': '0.146', 'weapon2': '0.204', 'AMMO4': '0.227', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '65.000'} [2024-08-06 05:18:30,941][52670] DAMAGECOUNT value on done: 614211.0 [2024-08-06 05:18:30,941][52670] Sum rewards: 78.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.645', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.178', 'weapon4': '0.214', 'weapon2': '0.228', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.136', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '68.000'} [2024-08-06 05:18:31,385][52664] DAMAGECOUNT value on done: 639725.0 [2024-08-06 05:18:31,385][52664] Sum rewards: 73.264, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.178', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.072', 'AMMO4': '0.174', 'weapon5': '0.182', 'weapon2': '0.202', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.246', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '63.000'} [2024-08-06 05:18:32,216][52650] Updated weights for policy 0, policy_version 60141 (0.0012) [2024-08-06 05:18:32,604][52667] DAMAGECOUNT value on done: 619563.0 [2024-08-06 05:18:32,605][52667] Sum rewards: 71.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.088', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.060', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.778', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:32,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 492691456. Throughput: 0: 4377.1. Samples: 123170700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:18:32,794][52567] Avg episode reward: [(0, '72.892')] [2024-08-06 05:18:32,908][52666] DAMAGECOUNT value on done: 613954.0 [2024-08-06 05:18:32,909][52666] Sum rewards: 66.873, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.776', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon2': '0.144', 'AMMO3': '0.157', 'weapon5': '0.252', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.948', 'WEAPON3': '1.000', 'weapon3': '2.140', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '52.000'} [2024-08-06 05:18:33,236][52663] DAMAGECOUNT value on done: 611372.0 [2024-08-06 05:18:33,244][52663] Sum rewards: 82.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.814', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.158', 'weapon5': '0.172', 'AMMO4': '0.197', 'weapon2': '0.214', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '68.000'} [2024-08-06 05:18:33,600][52670] DAMAGECOUNT value on done: 604230.0 [2024-08-06 05:18:33,600][52670] Sum rewards: 75.704, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.326', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.169', 'weapon2': '0.210', 'WEAPON3': '1.100', 'weapon3': '3.492', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:34,075][52664] DAMAGECOUNT value on done: 640463.0 [2024-08-06 05:18:34,077][52664] Sum rewards: 77.898, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.136', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.152', 'AMMO3': '0.163', 'AMMO4': '0.226', 'weapon2': '0.232', 'WEAPON4': '0.300', 'weapon5': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.048', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:35,103][52669] DAMAGECOUNT value on done: 619597.0 [2024-08-06 05:18:35,104][52669] Sum rewards: 72.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO2': '0.004', 'AMMO5': '0.009', 'AMMO4': '0.019', 'weapon5': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.690', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:35,388][52666] DAMAGECOUNT value on done: 610813.0 [2024-08-06 05:18:35,389][52666] Sum rewards: 66.054, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.846', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.099', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.247', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.310', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:35,871][52667] DAMAGECOUNT value on done: 626051.0 [2024-08-06 05:18:35,871][52667] Sum rewards: 78.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.144', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.052', 'weapon5': '0.168', 'AMMO3': '0.181', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '62.000'} [2024-08-06 05:18:35,937][52663] DAMAGECOUNT value on done: 606191.0 [2024-08-06 05:18:35,938][52663] Sum rewards: 71.697, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.381', 'AMMO2': '0.017', 'weapon4': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.155', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.370', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:36,302][52670] DAMAGECOUNT value on done: 612849.0 [2024-08-06 05:18:36,302][52670] Sum rewards: 85.410, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.193', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.126', 'weapon4': '0.154', 'AMMO3': '0.224', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '72.000'} [2024-08-06 05:18:36,866][52650] Updated weights for policy 0, policy_version 60151 (0.0022) [2024-08-06 05:18:37,254][52664] DAMAGECOUNT value on done: 639996.0 [2024-08-06 05:18:37,254][52664] Sum rewards: 76.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.911', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.082', 'AMMO4': '0.156', 'AMMO3': '0.212', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 492773376. Throughput: 0: 4376.2. Samples: 123197050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:18:37,795][52567] Avg episode reward: [(0, '73.493')] [2024-08-06 05:18:37,993][52666] DAMAGECOUNT value on done: 614865.0 [2024-08-06 05:18:37,993][52666] Sum rewards: 75.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.146', 'weapon4': '0.156', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:38,055][52669] DAMAGECOUNT value on done: 609369.0 [2024-08-06 05:18:38,056][52669] Sum rewards: 63.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.058', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.676', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '53.000'} [2024-08-06 05:18:38,761][52670] DAMAGECOUNT value on done: 609475.0 [2024-08-06 05:18:38,762][52670] Sum rewards: 62.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.065', 'weapon7': '0.084', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.306', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '52.000'} [2024-08-06 05:18:38,931][52663] DAMAGECOUNT value on done: 612039.0 [2024-08-06 05:18:38,931][52663] Sum rewards: 65.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.656', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.144', 'weapon4': '0.204', 'AMMO4': '0.207', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.718', 'WEAPON3': '1.450', 'weapon3': '2.680', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '56.000'} [2024-08-06 05:18:40,554][52671] DAMAGECOUNT value on done: 621515.0 [2024-08-06 05:18:40,554][52671] Sum rewards: 61.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.454', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.144', 'AMMO4': '0.195', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.160', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2024-08-06 05:18:40,673][52669] DAMAGECOUNT value on done: 621709.0 [2024-08-06 05:18:40,673][52669] Sum rewards: 72.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.132', 'AMMO3': '0.211', 'weapon2': '0.212', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:41,122][52666] DAMAGECOUNT value on done: 608441.0 [2024-08-06 05:18:41,124][52666] Sum rewards: 88.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.094', 'WEAPON4': '0.150', 'weapon2': '0.170', 'AMMO3': '0.187', 'weapon4': '0.202', 'WEAPON3': '1.200', 'weapon3': '3.364', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '72.000'} [2024-08-06 05:18:41,266][52663] DAMAGECOUNT value on done: 607635.0 [2024-08-06 05:18:41,267][52663] Sum rewards: 69.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.842', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.072', 'AMMO4': '0.206', 'weapon5': '0.218', 'AMMO3': '0.245', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:41,534][52650] Updated weights for policy 0, policy_version 60161 (0.0014) [2024-08-06 05:18:41,739][52658] DAMAGECOUNT value on done: 620321.0 [2024-08-06 05:18:41,740][52658] Sum rewards: 69.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.112', 'AMMO4': '0.163', 'weapon5': '0.184', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:42,139][52670] DAMAGECOUNT value on done: 607471.0 [2024-08-06 05:18:42,140][52670] Sum rewards: 71.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.734', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.108', 'weapon5': '0.120', 'AMMO4': '0.156', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.326', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:42,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 492863488. Throughput: 0: 4376.6. Samples: 123223250. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:18:42,795][52567] Avg episode reward: [(0, '72.952')] [2024-08-06 05:18:43,270][52671] DAMAGECOUNT value on done: 625772.0 [2024-08-06 05:18:43,270][52671] Sum rewards: 77.938, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.514', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.062', 'AMMO4': '0.118', 'weapon4': '0.156', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '65.000'} [2024-08-06 05:18:43,663][52669] DAMAGECOUNT value on done: 620331.0 [2024-08-06 05:18:43,665][52669] Sum rewards: 60.437, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.298', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.137', 'WEAPON3': '0.850', 'weapon2': '0.886', 'weapon3': '2.842', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '46.000'} [2024-08-06 05:18:43,876][52666] DAMAGECOUNT value on done: 609595.0 [2024-08-06 05:18:43,884][52666] Sum rewards: 76.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.026', 'AMMO4': '0.101', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:44,383][52658] DAMAGECOUNT value on done: 617069.0 [2024-08-06 05:18:44,384][52658] Sum rewards: 58.183, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.514', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.162', 'AMMO4': '0.193', 'AMMO3': '0.203', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.112', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2024-08-06 05:18:44,398][52663] DAMAGECOUNT value on done: 619805.0 [2024-08-06 05:18:44,399][52663] Sum rewards: 66.730, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.211', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.110', 'weapon2': '0.134', 'AMMO4': '0.164', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.520', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '55.000'} [2024-08-06 05:18:44,940][52670] DAMAGECOUNT value on done: 616690.0 [2024-08-06 05:18:44,943][52670] Sum rewards: 82.621, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.124', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO3': '0.288', 'WEAPON3': '1.650', 'weapon3': '3.414', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '70.000'} [2024-08-06 05:18:46,039][52671] DAMAGECOUNT value on done: 621656.0 [2024-08-06 05:18:46,039][52671] Sum rewards: 79.583, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.074', 'AMMO3': '0.161', 'weapon5': '0.176', 'AMMO4': '0.186', 'HEALTH': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '0.900', 'weapon3': '3.102', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '62.000'} [2024-08-06 05:18:46,159][52650] Updated weights for policy 0, policy_version 60171 (0.0035) [2024-08-06 05:18:46,592][52669] DAMAGECOUNT value on done: 617375.0 [2024-08-06 05:18:46,594][52669] Sum rewards: 74.284, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.442', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.036', 'AMMO4': '0.124', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '65.000'} [2024-08-06 05:18:47,060][52658] DAMAGECOUNT value on done: 622867.0 [2024-08-06 05:18:47,062][52658] Sum rewards: 63.680, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.076', 'weapon5': '0.152', 'AMMO3': '0.160', 'AMMO4': '0.169', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.240', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '52.000'} [2024-08-06 05:18:47,125][52666] DAMAGECOUNT value on done: 604090.0 [2024-08-06 05:18:47,125][52666] Sum rewards: 79.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.076', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.264', 'weapon4': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '65.000'} [2024-08-06 05:18:47,424][52663] DAMAGECOUNT value on done: 612000.0 [2024-08-06 05:18:47,427][52663] Sum rewards: 72.955, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.033', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.186', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 492953600. Throughput: 0: 4365.6. Samples: 123236240. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:18:47,794][52567] Avg episode reward: [(0, '73.015')] [2024-08-06 05:18:48,017][52670] DAMAGECOUNT value on done: 602266.0 [2024-08-06 05:18:48,018][52670] Sum rewards: 71.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.120', 'AMMO4': '0.175', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '57.000'} [2024-08-06 05:18:48,831][52671] DAMAGECOUNT value on done: 623215.0 [2024-08-06 05:18:48,833][52671] Sum rewards: 85.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.120', 'AMMO3': '0.157', 'AMMO4': '0.208', 'weapon5': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '69.000'} [2024-08-06 05:18:49,678][52669] DAMAGECOUNT value on done: 623502.0 [2024-08-06 05:18:49,679][52669] Sum rewards: 61.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.170', 'AMMO3': '0.173', 'weapon5': '0.198', 'AMMO4': '0.257', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.082', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '51.500'} [2024-08-06 05:18:49,911][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:18:50,089][52670] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:18:50,197][52658] DAMAGECOUNT value on done: 622251.0 [2024-08-06 05:18:50,197][52658] Sum rewards: 79.571, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.154', 'AMMO4': '0.180', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '67.000'} [2024-08-06 05:18:50,328][52666] DAMAGECOUNT value on done: 617909.0 [2024-08-06 05:18:50,331][52666] Sum rewards: 65.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.686', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.152', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon5': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '54.500'} [2024-08-06 05:18:50,386][52664] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:18:50,539][52663] DAMAGECOUNT value on done: 620327.0 [2024-08-06 05:18:50,543][52663] Sum rewards: 60.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.082', 'weapon5': '0.176', 'AMMO4': '0.242', 'AMMO3': '0.295', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.970', 'weapon3': '3.098', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '52.000'} [2024-08-06 05:18:50,567][52650] Updated weights for policy 0, policy_version 60181 (0.0018) [2024-08-06 05:18:51,151][52670] DAMAGECOUNT value on done: 611094.0 [2024-08-06 05:18:51,152][52670] Sum rewards: 76.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.332', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.060', 'AMMO4': '0.063', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:51,931][52671] DAMAGECOUNT value on done: 631700.0 [2024-08-06 05:18:51,933][52671] Sum rewards: 55.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.022', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.149', 'AMMO3': '0.225', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '2.800', 'weapon3': '3.518', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '49.000'} [2024-08-06 05:18:52,204][52669] DAMAGECOUNT value on done: 620363.0 [2024-08-06 05:18:52,205][52669] Sum rewards: 74.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.790', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.148', 'AMMO4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '62.000'} [2024-08-06 05:18:52,543][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:18:52,755][52658] DAMAGECOUNT value on done: 611030.0 [2024-08-06 05:18:52,755][52658] Sum rewards: 75.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '2.910', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '65.000'} [2024-08-06 05:18:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 493035520. Throughput: 0: 4370.4. Samples: 123262710. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:18:52,795][52567] Avg episode reward: [(0, '72.916')] [2024-08-06 05:18:52,916][52663] DAMAGECOUNT value on done: 621000.0 [2024-08-06 05:18:52,917][52663] Sum rewards: 73.345, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.122', 'weapon5': '0.128', 'AMMO4': '0.142', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.458', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '59.000'} [2024-08-06 05:18:53,586][52666] DAMAGECOUNT value on done: 611170.0 [2024-08-06 05:18:53,588][52666] Sum rewards: 77.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.039', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.034', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '65.000'} [2024-08-06 05:18:54,023][52649] DAMAGECOUNT value on done: 597183.0 [2024-08-06 05:18:54,023][52649] Sum rewards: 59.545, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.850', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.208', 'AMMO3': '0.244', 'AMMO4': '0.245', 'weapon5': '0.252', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '53.000'} [2024-08-06 05:18:54,208][52670] DAMAGECOUNT value on done: 618607.0 [2024-08-06 05:18:54,210][52670] Sum rewards: 56.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.622', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.187', 'AMMO4': '0.215', 'weapon5': '0.240', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '2.890', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '46.000'} [2024-08-06 05:18:54,930][52669] DAMAGECOUNT value on done: 619233.0 [2024-08-06 05:18:54,930][52669] Sum rewards: 65.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.128', 'weapon5': '0.144', 'AMMO4': '0.181', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.200', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '54.000'} [2024-08-06 05:18:55,242][52671] DAMAGECOUNT value on done: 624168.0 [2024-08-06 05:18:55,243][52671] Sum rewards: 85.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.651', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.162', 'weapon4': '0.218', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '70.000'} [2024-08-06 05:18:55,357][52650] Updated weights for policy 0, policy_version 60191 (0.0012) [2024-08-06 05:18:55,512][52658] DAMAGECOUNT value on done: 615890.0 [2024-08-06 05:18:55,512][52658] Sum rewards: 77.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.225', 'weapon2': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.542', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:55,910][52663] DAMAGECOUNT value on done: 612442.0 [2024-08-06 05:18:55,912][52663] Sum rewards: 74.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.122', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '61.000'} [2024-08-06 05:18:56,140][52666] DAMAGECOUNT value on done: 614497.0 [2024-08-06 05:18:56,142][52666] Sum rewards: 74.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 05:18:56,925][52649] DAMAGECOUNT value on done: 591345.0 [2024-08-06 05:18:56,927][52649] Sum rewards: 85.625, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.421', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.146', 'AMMO3': '0.166', 'weapon5': '0.178', 'AMMO4': '0.224', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '67.000'} [2024-08-06 05:18:56,938][52670] DAMAGECOUNT value on done: 614858.0 [2024-08-06 05:18:56,941][52670] Sum rewards: 76.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.098', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '64.000'} [2024-08-06 05:18:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 493117440. Throughput: 0: 4375.1. Samples: 123288910. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:18:57,794][52567] Avg episode reward: [(0, '72.737')] [2024-08-06 05:18:58,141][52669] DAMAGECOUNT value on done: 627483.0 [2024-08-06 05:18:58,142][52669] Sum rewards: 76.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.095', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon5': '0.220', 'AMMO3': '0.236', 'weapon4': '0.308', 'AMMO4': '0.312', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.770', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '63.000'} [2024-08-06 05:18:58,289][52671] DAMAGECOUNT value on done: 626517.0 [2024-08-06 05:18:58,290][52671] Sum rewards: 72.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.780', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.096', 'AMMO3': '0.259', 'AMMO4': '0.261', 'weapon5': '0.278', 'weapon2': '0.392', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '63.000'} [2024-08-06 05:18:58,538][52658] DAMAGECOUNT value on done: 623616.0 [2024-08-06 05:18:58,538][52658] Sum rewards: 69.787, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.730', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.171', 'AMMO4': '0.189', 'weapon5': '0.194', 'weapon4': '0.200', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.026', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '55.000'} [2024-08-06 05:18:59,319][52666] DAMAGECOUNT value on done: 607308.0 [2024-08-06 05:18:59,319][52666] Sum rewards: 71.697, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.466', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.038', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon2': '0.566', 'WEAPON3': '1.000', 'weapon3': '3.154', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '58.000'} [2024-08-06 05:18:59,941][52670] DAMAGECOUNT value on done: 598560.0 [2024-08-06 05:18:59,951][52670] Sum rewards: 66.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.756', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.072', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '55.000'} [2024-08-06 05:19:00,136][52649] DAMAGECOUNT value on done: 608968.0 [2024-08-06 05:19:00,138][52649] Sum rewards: 78.636, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.094', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO3': '0.128', 'AMMO4': '0.136', 'weapon4': '0.172', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.778', 'WEAPON3': '0.850', 'weapon3': '2.596', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:00,403][52650] Updated weights for policy 0, policy_version 60201 (0.0024) [2024-08-06 05:19:00,596][52669] DAMAGECOUNT value on done: 619236.0 [2024-08-06 05:19:00,598][52669] Sum rewards: 67.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.242', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'weapon4': '0.140', 'AMMO3': '0.260', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:01,395][52658] DAMAGECOUNT value on done: 613523.0 [2024-08-06 05:19:01,395][52658] Sum rewards: 77.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.141', 'AMMO3': '0.224', 'weapon2': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '65.000'} [2024-08-06 05:19:01,442][52671] DAMAGECOUNT value on done: 623420.0 [2024-08-06 05:19:01,443][52671] Sum rewards: 77.830, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.569', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.078', 'weapon5': '0.158', 'AMMO4': '0.228', 'AMMO3': '0.231', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '65.000'} [2024-08-06 05:19:01,926][52666] DAMAGECOUNT value on done: 613743.0 [2024-08-06 05:19:01,926][52666] Sum rewards: 73.291, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.368', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.182', 'AMMO4': '0.220', 'weapon2': '0.228', 'AMMO3': '0.267', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.992', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '63.000'} [2024-08-06 05:19:02,065][52662] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon5', 0.002)] [2024-08-06 05:19:02,754][52670] DAMAGECOUNT value on done: 610232.0 [2024-08-06 05:19:02,755][52670] Sum rewards: 74.495, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.395', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.222', 'AMMO3': '0.254', 'AMMO4': '0.259', 'weapon5': '0.270', 'weapon2': '0.460', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.724', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:02,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 493207552. Throughput: 0: 4365.8. Samples: 123301890. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:19:02,794][52567] Avg episode reward: [(0, '72.725')] [2024-08-06 05:19:03,148][52669] DAMAGECOUNT value on done: 624236.0 [2024-08-06 05:19:03,151][52669] Sum rewards: 70.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.118', 'AMMO4': '0.214', 'weapon5': '0.218', 'AMMO3': '0.226', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:03,242][52649] DAMAGECOUNT value on done: 605126.0 [2024-08-06 05:19:03,243][52649] Sum rewards: 62.873, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.029', 'HEALTH': '0.076', 'weapon4': '0.084', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '52.000'} [2024-08-06 05:19:03,849][52658] DAMAGECOUNT value on done: 632356.0 [2024-08-06 05:19:03,852][52658] Sum rewards: 72.144, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.932', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.178', 'AMMO4': '0.235', 'AMMO3': '0.282', 'weapon2': '0.314', 'weapon4': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.890', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '63.000'} [2024-08-06 05:19:03,937][52795] DAMAGECOUNT value on done: 574284.0 [2024-08-06 05:19:03,937][52795] Sum rewards: 73.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.030', 'AMMO4': '0.032', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '61.000'} [2024-08-06 05:19:04,282][52671] DAMAGECOUNT value on done: 614822.0 [2024-08-06 05:19:04,283][52671] Sum rewards: 71.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'AMMO2': '0.012', 'AMMO5': '0.017', 'weapon5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.242', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:04,764][52666] DAMAGECOUNT value on done: 621482.0 [2024-08-06 05:19:04,764][52666] Sum rewards: 81.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.738', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '65.000'} [2024-08-06 05:19:04,893][52650] Updated weights for policy 0, policy_version 60211 (0.0012) [2024-08-06 05:19:05,147][52662] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:19:05,369][52670] DAMAGECOUNT value on done: 618286.0 [2024-08-06 05:19:05,370][52670] Sum rewards: 69.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.027', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.144', 'AMMO3': '0.217', 'weapon2': '0.228', 'weapon4': '0.228', 'AMMO4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '57.500'} [2024-08-06 05:19:05,439][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:19:05,968][52649] DAMAGECOUNT value on done: 593297.0 [2024-08-06 05:19:05,970][52649] Sum rewards: 77.591, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.527', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.134', 'AMMO3': '0.152', 'weapon4': '0.202', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.058', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:06,478][52669] DAMAGECOUNT value on done: 625298.0 [2024-08-06 05:19:06,480][52669] Sum rewards: 77.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.848', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.116', 'AMMO4': '0.160', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '63.000'} [2024-08-06 05:19:06,976][52671] DAMAGECOUNT value on done: 621593.0 [2024-08-06 05:19:06,978][52671] Sum rewards: 65.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.127', 'weapon5': '0.144', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:06,996][52795] DAMAGECOUNT value on done: 563608.0 [2024-08-06 05:19:06,996][52795] Sum rewards: 64.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.823', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.118', 'weapon5': '0.222', 'AMMO3': '0.263', 'AMMO4': '0.267', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '3.020', 'weapon3': '3.106', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:06,998][52658] DAMAGECOUNT value on done: 618953.0 [2024-08-06 05:19:06,999][52658] Sum rewards: 74.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.145', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.206', 'weapon2': '0.220', 'AMMO4': '0.241', 'weapon5': '0.272', 'weapon4': '0.368', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '61.000'} [2024-08-06 05:19:07,334][52666] DAMAGECOUNT value on done: 602377.0 [2024-08-06 05:19:07,336][52666] Sum rewards: 69.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO3': '0.160', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.906', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:07,605][52668] DAMAGECOUNT value on done: 617691.0 [2024-08-06 05:19:07,606][52668] Sum rewards: 62.533, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.060', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.130', 'AMMO4': '0.133', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon7': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.752', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '51.000'} [2024-08-06 05:19:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 493297664. Throughput: 0: 4372.7. Samples: 123328210. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:19:07,794][52567] Avg episode reward: [(0, '72.558')] [2024-08-06 05:19:08,147][52670] DAMAGECOUNT value on done: 609121.0 [2024-08-06 05:19:08,148][52670] Sum rewards: 75.095, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.820', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.114', 'weapon2': '0.220', 'AMMO4': '0.240', 'AMMO3': '0.285', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.052', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '67.000'} [2024-08-06 05:19:09,085][52649] DAMAGECOUNT value on done: 607559.0 [2024-08-06 05:19:09,085][52649] Sum rewards: 74.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.858', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.146', 'weapon5': '0.172', 'AMMO4': '0.192', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:09,477][52650] Updated weights for policy 0, policy_version 60221 (0.0023) [2024-08-06 05:19:09,593][52671] DAMAGECOUNT value on done: 625268.0 [2024-08-06 05:19:09,593][52671] Sum rewards: 76.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.231', 'AMMO2': '0.017', 'AMMO4': '0.086', 'AMMO3': '0.210', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:09,845][52669] DAMAGECOUNT value on done: 613029.0 [2024-08-06 05:19:09,847][52669] Sum rewards: 78.450, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.814', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.174', 'AMMO4': '0.269', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '63.500'} [2024-08-06 05:19:10,163][52658] DAMAGECOUNT value on done: 631978.0 [2024-08-06 05:19:10,171][52658] Sum rewards: 78.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.116', 'weapon5': '0.128', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '65.000'} [2024-08-06 05:19:10,200][52795] DAMAGECOUNT value on done: 561941.0 [2024-08-06 05:19:10,200][52795] Sum rewards: 74.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.096', 'weapon4': '0.162', 'AMMO3': '0.190', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:10,242][52666] DAMAGECOUNT value on done: 612409.0 [2024-08-06 05:19:10,242][52666] Sum rewards: 76.385, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.630', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.080', 'weapon5': '0.126', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.313', 'weapon2': '0.384', 'WEAPON3': '1.850', 'weapon3': '3.128', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '68.000'} [2024-08-06 05:19:10,548][52668] DAMAGECOUNT value on done: 622093.0 [2024-08-06 05:19:10,550][52668] Sum rewards: 69.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.447', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.124', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.304', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.724', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:10,980][52670] DAMAGECOUNT value on done: 614826.0 [2024-08-06 05:19:10,980][52670] Sum rewards: 72.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.696', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.202', 'AMMO3': '0.218', 'weapon5': '0.230', 'AMMO4': '0.239', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:12,118][52669] DAMAGECOUNT value on done: 617747.0 [2024-08-06 05:19:12,119][52669] Sum rewards: 85.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '71.000'} [2024-08-06 05:19:12,287][52649] DAMAGECOUNT value on done: 600166.0 [2024-08-06 05:19:12,289][52649] Sum rewards: 75.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO2': '0.008', 'AMMO5': '0.013', 'weapon4': '0.018', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '64.000'} [2024-08-06 05:19:12,538][52671] DAMAGECOUNT value on done: 619265.0 [2024-08-06 05:19:12,538][52671] Sum rewards: 82.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.782', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.170', 'AMMO4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '68.000'} [2024-08-06 05:19:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 493387776. Throughput: 0: 4362.7. Samples: 123354270. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:19:12,794][52567] Avg episode reward: [(0, '72.856')] [2024-08-06 05:19:13,060][52658] DAMAGECOUNT value on done: 615870.0 [2024-08-06 05:19:13,062][52658] Sum rewards: 71.910, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.611', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.120', 'AMMO3': '0.143', 'AMMO4': '0.150', 'weapon5': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.826', 'WEAPON3': '0.900', 'weapon3': '2.630', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:13,404][52795] DAMAGECOUNT value on done: 569818.0 [2024-08-06 05:19:13,405][52795] Sum rewards: 67.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.346', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.600', 'weapon3': '3.124', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:13,722][52668] DAMAGECOUNT value on done: 621075.0 [2024-08-06 05:19:13,723][52668] Sum rewards: 66.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.708', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.166', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:14,515][52650] Updated weights for policy 0, policy_version 60231 (0.0022) [2024-08-06 05:19:14,921][52669] DAMAGECOUNT value on done: 621468.0 [2024-08-06 05:19:14,921][52669] Sum rewards: 69.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.232', 'AMMO5': '0.012', 'AMMO2': '0.062', 'weapon5': '0.124', 'AMMO3': '0.176', 'WEAPON5': '0.300', 'AMMO4': '0.311', 'weapon4': '0.384', 'weapon2': '0.446', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:14,949][52649] DAMAGECOUNT value on done: 604420.0 [2024-08-06 05:19:14,950][52649] Sum rewards: 61.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.087', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.178', 'weapon4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.724', 'WEAPON3': '1.250', 'weapon3': '2.696', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '50.000'} [2024-08-06 05:19:15,338][52658] DAMAGECOUNT value on done: 623692.0 [2024-08-06 05:19:15,346][52658] Sum rewards: 62.168, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.370', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.120', 'weapon5': '0.166', 'AMMO3': '0.232', 'AMMO4': '0.274', 'weapon2': '0.280', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.186', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '54.000'} [2024-08-06 05:19:15,556][52671] DAMAGECOUNT value on done: 625953.0 [2024-08-06 05:19:15,556][52671] Sum rewards: 67.898, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.916', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO4': '0.178', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:16,533][52795] DAMAGECOUNT value on done: 566920.0 [2024-08-06 05:19:16,533][52795] Sum rewards: 71.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.365', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.042', 'weapon5': '0.116', 'AMMO4': '0.189', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.328', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:17,064][52820] DAMAGECOUNT value on done: 571324.0 [2024-08-06 05:19:17,065][52820] Sum rewards: 88.234, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.276', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.384', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.387', 'FRAGCOUNT': '75.000'} [2024-08-06 05:19:17,317][52668] DAMAGECOUNT value on done: 623256.0 [2024-08-06 05:19:17,318][52668] Sum rewards: 73.046, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.976', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.132', 'AMMO4': '0.144', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:17,341][52649] DAMAGECOUNT value on done: 606206.0 [2024-08-06 05:19:17,342][52649] Sum rewards: 84.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.041', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.090', 'weapon4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.662', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '70.000'} [2024-08-06 05:19:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17522.6). Total num frames: 493469696. Throughput: 0: 4367.3. Samples: 123367230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:19:17,794][52567] Avg episode reward: [(0, '72.640')] [2024-08-06 05:19:18,073][52669] DAMAGECOUNT value on done: 639797.0 [2024-08-06 05:19:18,075][52669] Sum rewards: 88.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.754', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.160', 'AMMO4': '0.175', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.198', 'FRAGCOUNT': '70.000'} [2024-08-06 05:19:18,104][52658] DAMAGECOUNT value on done: 613266.0 [2024-08-06 05:19:18,104][52658] Sum rewards: 65.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.208', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.050', 'weapon2': '0.158', 'weapon5': '0.168', 'AMMO3': '0.205', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.464', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '53.000'} [2024-08-06 05:19:18,635][52650] Updated weights for policy 0, policy_version 60241 (0.0020) [2024-08-06 05:19:18,712][52671] DAMAGECOUNT value on done: 622538.0 [2024-08-06 05:19:18,714][52671] Sum rewards: 76.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.681', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.056', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.304', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '61.000'} [2024-08-06 05:19:19,173][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:19:19,655][52795] DAMAGECOUNT value on done: 577998.0 [2024-08-06 05:19:19,655][52795] Sum rewards: 81.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.154', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.122', 'weapon5': '0.188', 'AMMO3': '0.190', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '68.000'} [2024-08-06 05:19:19,929][52668] DAMAGECOUNT value on done: 609288.0 [2024-08-06 05:19:19,931][52668] Sum rewards: 74.143, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.213', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.108', 'AMMO4': '0.156', 'AMMO3': '0.169', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '2.862', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:20,139][52820] DAMAGECOUNT value on done: 573920.0 [2024-08-06 05:19:20,139][52820] Sum rewards: 76.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.014', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.136', 'weapon2': '0.196', 'AMMO3': '0.213', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '63.000'} [2024-08-06 05:19:20,439][52658] DAMAGECOUNT value on done: 620760.0 [2024-08-06 05:19:20,447][52658] Sum rewards: 66.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.130', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.177', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '53.000'} [2024-08-06 05:19:20,546][52649] DAMAGECOUNT value on done: 597931.0 [2024-08-06 05:19:20,548][52649] Sum rewards: 81.713, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '66.000'} [2024-08-06 05:19:21,075][52662] DAMAGECOUNT value on done: 623651.0 [2024-08-06 05:19:21,076][52662] Sum rewards: 78.752, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.826', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.189', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 05:19:21,092][52669] DAMAGECOUNT value on done: 626728.0 [2024-08-06 05:19:21,094][52669] Sum rewards: 67.048, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.214', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon4': '0.140', 'weapon5': '0.204', 'AMMO3': '0.217', 'AMMO4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:21,815][52671] DAMAGECOUNT value on done: 610141.0 [2024-08-06 05:19:21,815][52671] Sum rewards: 72.744, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.396', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.060', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.398', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '63.000'} [2024-08-06 05:19:22,782][52795] DAMAGECOUNT value on done: 581624.0 [2024-08-06 05:19:22,782][52795] Sum rewards: 71.811, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.770', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.068', 'weapon5': '0.186', 'AMMO4': '0.251', 'weapon2': '0.292', 'AMMO3': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.062', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '63.500'} [2024-08-06 05:19:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 493559808. Throughput: 0: 4368.2. Samples: 123393620. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:19:22,794][52567] Avg episode reward: [(0, '72.630')] [2024-08-06 05:19:22,852][52668] DAMAGECOUNT value on done: 626360.0 [2024-08-06 05:19:22,852][52668] Sum rewards: 79.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.335', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '67.000'} [2024-08-06 05:19:23,209][52658] DAMAGECOUNT value on done: 609399.0 [2024-08-06 05:19:23,212][52658] Sum rewards: 82.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.650', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon2': '0.180', 'AMMO3': '0.181', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '66.000'} [2024-08-06 05:19:23,232][52820] DAMAGECOUNT value on done: 575952.0 [2024-08-06 05:19:23,233][52820] Sum rewards: 74.468, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon4': '0.088', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'HEALTH': '0.286', 'weapon2': '0.586', 'WEAPON3': '0.950', 'weapon3': '2.998', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:23,598][52649] DAMAGECOUNT value on done: 609454.0 [2024-08-06 05:19:23,599][52649] Sum rewards: 65.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.177', 'weapon5': '0.192', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.506', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '53.000'} [2024-08-06 05:19:23,692][52650] Updated weights for policy 0, policy_version 60251 (0.0021) [2024-08-06 05:19:24,017][52662] DAMAGECOUNT value on done: 618235.0 [2024-08-06 05:19:24,018][52662] Sum rewards: 67.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.330', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:24,208][52669] DAMAGECOUNT value on done: 625532.0 [2024-08-06 05:19:24,208][52669] Sum rewards: 65.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.058', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.096', 'weapon5': '0.118', 'AMMO3': '0.197', 'AMMO4': '0.204', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '54.000'} [2024-08-06 05:19:24,731][52671] DAMAGECOUNT value on done: 629941.0 [2024-08-06 05:19:24,737][52671] Sum rewards: 70.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO3': '0.201', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:25,172][52647] DAMAGECOUNT value on done: 656286.0 [2024-08-06 05:19:25,172][52647] Sum rewards: 81.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.301', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.074', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.206', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.428', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '69.000'} [2024-08-06 05:19:25,634][52668] DAMAGECOUNT value on done: 622933.0 [2024-08-06 05:19:25,634][52668] Sum rewards: 78.556, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.605', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.130', 'weapon4': '0.174', 'AMMO4': '0.209', 'weapon2': '0.230', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '67.000'} [2024-08-06 05:19:25,800][52658] DAMAGECOUNT value on done: 623845.0 [2024-08-06 05:19:25,801][52658] Sum rewards: 70.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.212', 'WEAPON3': '1.300', 'weapon3': '3.500', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:25,930][52795] DAMAGECOUNT value on done: 571221.0 [2024-08-06 05:19:25,930][52795] Sum rewards: 72.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.109', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.154', 'AMMO3': '0.166', 'weapon2': '0.230', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.958', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:26,339][52649] DAMAGECOUNT value on done: 611169.0 [2024-08-06 05:19:26,340][52649] Sum rewards: 74.538, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.652', 'AMMO5': '0.022', 'AMMO2': '0.050', 'AMMO3': '0.143', 'weapon2': '0.186', 'weapon5': '0.222', 'AMMO4': '0.250', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.590', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:26,611][52820] DAMAGECOUNT value on done: 567849.0 [2024-08-06 05:19:26,612][52820] Sum rewards: 83.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.203', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.268', 'weapon2': '0.360', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '72.000'} [2024-08-06 05:19:26,658][52662] DAMAGECOUNT value on done: 628386.0 [2024-08-06 05:19:26,659][52662] Sum rewards: 79.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.188', 'weapon2': '0.196', 'weapon4': '0.228', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.100', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '67.000'} [2024-08-06 05:19:27,142][52669] DAMAGECOUNT value on done: 625989.0 [2024-08-06 05:19:27,144][52669] Sum rewards: 70.259, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.534', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.076', 'weapon4': '0.138', 'AMMO4': '0.175', 'AMMO3': '0.295', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.204', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '63.000'} [2024-08-06 05:19:27,355][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:19:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 493649920. Throughput: 0: 4373.8. Samples: 123420070. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:19:27,794][52567] Avg episode reward: [(0, '73.273')] [2024-08-06 05:19:27,879][52671] DAMAGECOUNT value on done: 625242.0 [2024-08-06 05:19:27,880][52671] Sum rewards: 76.401, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.062', 'weapon5': '0.088', 'AMMO4': '0.127', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:28,039][52650] Updated weights for policy 0, policy_version 60261 (0.0011) [2024-08-06 05:19:28,150][52647] DAMAGECOUNT value on done: 649758.0 [2024-08-06 05:19:28,152][52647] Sum rewards: 86.737, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.685', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.131', 'weapon4': '0.148', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.000', 'weapon3': '2.892', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.961', 'FRAGCOUNT': '68.000'} [2024-08-06 05:19:28,308][52668] DAMAGECOUNT value on done: 614133.0 [2024-08-06 05:19:28,308][52668] Sum rewards: 71.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.162', 'weapon4': '0.182', 'AMMO3': '0.228', 'AMMO4': '0.267', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:28,694][52658] DAMAGECOUNT value on done: 616691.0 [2024-08-06 05:19:28,696][52658] Sum rewards: 75.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.816', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.139', 'weapon5': '0.166', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:29,055][52795] DAMAGECOUNT value on done: 567160.0 [2024-08-06 05:19:29,056][52795] Sum rewards: 76.932, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.262', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.177', 'weapon2': '0.196', 'weapon4': '0.198', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.312', 'WEAPON3': '1.850', 'weapon3': '3.068', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.475', 'FRAGCOUNT': '66.000'} [2024-08-06 05:19:29,375][52649] DAMAGECOUNT value on done: 609928.0 [2024-08-06 05:19:29,376][52649] Sum rewards: 71.732, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.544', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.120', 'AMMO3': '0.173', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.222', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:29,504][52662] DAMAGECOUNT value on done: 613114.0 [2024-08-06 05:19:29,506][52662] Sum rewards: 60.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.168', 'weapon5': '0.176', 'AMMO4': '0.207', 'AMMO3': '0.226', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.138', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '49.000'} [2024-08-06 05:19:29,765][52669] DAMAGECOUNT value on done: 632971.0 [2024-08-06 05:19:29,767][52669] Sum rewards: 75.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon2': '0.186', 'AMMO3': '0.199', 'WEAPON3': '1.300', 'HITCOUNT': '3.510', 'weapon3': '3.688', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:29,784][52647] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:19:29,847][52820] DAMAGECOUNT value on done: 576098.0 [2024-08-06 05:19:29,848][52820] Sum rewards: 66.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.896', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.180', 'AMMO3': '0.231', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:30,531][52647] DAMAGECOUNT value on done: 652497.0 [2024-08-06 05:19:30,532][52647] Sum rewards: 65.245, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.351', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.104', 'weapon5': '0.134', 'AMMO3': '0.160', 'AMMO4': '0.237', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.244', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '53.000'} [2024-08-06 05:19:30,851][52671] DAMAGECOUNT value on done: 626299.0 [2024-08-06 05:19:30,852][52671] Sum rewards: 75.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.550', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.086', 'weapon5': '0.138', 'AMMO4': '0.141', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:31,088][52668] DAMAGECOUNT value on done: 614954.0 [2024-08-06 05:19:31,089][52668] Sum rewards: 82.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.142', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.188', 'weapon5': '0.192', 'AMMO3': '0.202', 'AMMO4': '0.208', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '69.000'} [2024-08-06 05:19:31,370][52658] DAMAGECOUNT value on done: 616771.0 [2024-08-06 05:19:31,370][52658] Sum rewards: 80.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.450', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.084', 'AMMO4': '0.104', 'AMMO3': '0.166', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.000', 'weapon3': '3.310', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '64.000'} [2024-08-06 05:19:32,173][52795] DAMAGECOUNT value on done: 577308.0 [2024-08-06 05:19:32,174][52795] Sum rewards: 87.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.490', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.423', 'FRAGCOUNT': '71.000'} [2024-08-06 05:19:32,377][52662] DAMAGECOUNT value on done: 630952.0 [2024-08-06 05:19:32,378][52662] Sum rewards: 76.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.062', 'weapon5': '0.112', 'AMMO4': '0.134', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.760', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.500'} [2024-08-06 05:19:32,510][52649] DAMAGECOUNT value on done: 608758.0 [2024-08-06 05:19:32,510][52649] Sum rewards: 56.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.090', 'AMMO3': '0.220', 'AMMO4': '0.229', 'weapon5': '0.232', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.162', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '49.000'} [2024-08-06 05:19:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 493731840. Throughput: 0: 4376.4. Samples: 123433180. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:19:32,794][52567] Avg episode reward: [(0, '73.640')] [2024-08-06 05:19:32,937][52820] DAMAGECOUNT value on done: 567329.0 [2024-08-06 05:19:32,937][52820] Sum rewards: 67.723, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.825', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.122', 'AMMO4': '0.184', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.650', 'weapon3': '3.074', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:33,002][52650] Updated weights for policy 0, policy_version 60271 (0.0011) [2024-08-06 05:19:33,199][52647] DAMAGECOUNT value on done: 655652.0 [2024-08-06 05:19:33,199][52647] Sum rewards: 72.852, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.270', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.778', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:33,569][52668] DAMAGECOUNT value on done: 623423.0 [2024-08-06 05:19:33,569][52668] Sum rewards: 69.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.687', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:33,818][52671] DAMAGECOUNT value on done: 625208.0 [2024-08-06 05:19:33,818][52671] Sum rewards: 84.385, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.812', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.173', 'weapon4': '0.242', 'AMMO4': '0.246', 'weapon5': '0.298', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 05:19:34,521][52658] DAMAGECOUNT value on done: 620251.0 [2024-08-06 05:19:34,523][52658] Sum rewards: 67.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.420', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:35,156][52662] DAMAGECOUNT value on done: 613280.0 [2024-08-06 05:19:35,156][52662] Sum rewards: 63.029, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.755', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.033', 'AMMO3': '0.149', 'weapon5': '0.160', 'AMMO4': '0.164', 'weapon2': '0.274', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.056', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '50.000'} [2024-08-06 05:19:35,301][52795] DAMAGECOUNT value on done: 573506.0 [2024-08-06 05:19:35,301][52795] Sum rewards: 74.838, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.670', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.224', 'weapon2': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.948', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:35,615][52647] DAMAGECOUNT value on done: 661725.0 [2024-08-06 05:19:35,615][52647] Sum rewards: 54.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.796', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.062', 'weapon4': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'weapon2': '0.208', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.840', 'weapon3': '3.196', 'DAMAGECOUNT': '14.352', 'FRAGCOUNT': '49.000'} [2024-08-06 05:19:35,681][52649] DAMAGECOUNT value on done: 598803.0 [2024-08-06 05:19:35,681][52649] Sum rewards: 82.025, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.982', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.130', 'AMMO4': '0.197', 'weapon2': '0.226', 'AMMO3': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '70.000'} [2024-08-06 05:19:35,965][52820] DAMAGECOUNT value on done: 574099.0 [2024-08-06 05:19:35,965][52820] Sum rewards: 80.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.158', 'weapon5': '0.192', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.600', 'weapon3': '3.006', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '67.000'} [2024-08-06 05:19:36,388][52668] DAMAGECOUNT value on done: 620439.0 [2024-08-06 05:19:36,389][52668] Sum rewards: 60.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.777', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.090', 'AMMO3': '0.171', 'AMMO4': '0.227', 'weapon5': '0.264', 'WEAPON4': '0.400', 'weapon2': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '48.500'} [2024-08-06 05:19:36,613][52671] DAMAGECOUNT value on done: 621406.0 [2024-08-06 05:19:36,613][52671] Sum rewards: 70.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.924', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.074', 'weapon4': '0.120', 'AMMO3': '0.141', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.646', 'WEAPON3': '0.900', 'weapon3': '2.980', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:37,624][52650] Updated weights for policy 0, policy_version 60281 (0.0017) [2024-08-06 05:19:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 493821952. Throughput: 0: 4373.6. Samples: 123459520. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:19:37,794][52567] Avg episode reward: [(0, '73.386')] [2024-08-06 05:19:38,004][52647] DAMAGECOUNT value on done: 658735.0 [2024-08-06 05:19:38,006][52647] Sum rewards: 85.952, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.080', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'HEALTH': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '69.000'} [2024-08-06 05:19:38,117][52662] DAMAGECOUNT value on done: 624978.0 [2024-08-06 05:19:38,117][52662] Sum rewards: 82.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.879', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.808', 'FRAGCOUNT': '68.000'} [2024-08-06 05:19:38,500][52795] DAMAGECOUNT value on done: 568843.0 [2024-08-06 05:19:38,502][52795] Sum rewards: 69.614, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO4': '0.247', 'AMMO3': '0.272', 'weapon5': '0.278', 'weapon2': '0.288', 'weapon4': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.718', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '61.000'} [2024-08-06 05:19:38,666][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:19:38,800][52660] DAMAGECOUNT value on done: 619118.0 [2024-08-06 05:19:38,800][52660] Sum rewards: 74.232, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.320', 'HEALTH': '0.482', 'WEAPON3': '0.850', 'weapon3': '3.424', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:38,882][52649] DAMAGECOUNT value on done: 605154.0 [2024-08-06 05:19:38,883][52649] Sum rewards: 70.480, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.004', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:38,992][52820] DAMAGECOUNT value on done: 577064.0 [2024-08-06 05:19:38,995][52820] Sum rewards: 62.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.023', 'AMMO2': '0.071', 'AMMO3': '0.197', 'weapon4': '0.202', 'weapon5': '0.296', 'AMMO4': '0.356', 'weapon2': '0.520', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '49.000'} [2024-08-06 05:19:39,189][52668] DAMAGECOUNT value on done: 610904.0 [2024-08-06 05:19:39,189][52668] Sum rewards: 68.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.142', 'AMMO3': '0.223', 'weapon4': '0.270', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '57.500'} [2024-08-06 05:19:40,431][52647] DAMAGECOUNT value on done: 653316.0 [2024-08-06 05:19:40,431][52647] Sum rewards: 73.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.104', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:41,086][52662] DAMAGECOUNT value on done: 628208.0 [2024-08-06 05:19:41,096][52662] Sum rewards: 76.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 05:19:41,423][52660] DAMAGECOUNT value on done: 609991.0 [2024-08-06 05:19:41,424][52660] Sum rewards: 65.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.995', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '55.000'} [2024-08-06 05:19:41,637][52795] DAMAGECOUNT value on done: 567801.0 [2024-08-06 05:19:41,637][52795] Sum rewards: 73.778, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.132', 'weapon5': '0.152', 'weapon4': '0.220', 'AMMO4': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon2': '0.644', 'WEAPON3': '0.800', 'weapon3': '2.784', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:41,685][52668] DAMAGECOUNT value on done: 603415.0 [2024-08-06 05:19:41,685][52668] Sum rewards: 72.776, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.715', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.147', 'weapon5': '0.152', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON3': '0.950', 'weapon3': '2.968', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:42,115][52649] DAMAGECOUNT value on done: 597087.0 [2024-08-06 05:19:42,116][52649] Sum rewards: 67.106, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.152', 'AMMO3': '0.174', 'weapon5': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.108', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '54.000'} [2024-08-06 05:19:42,148][52820] DAMAGECOUNT value on done: 571476.0 [2024-08-06 05:19:42,148][52820] Sum rewards: 82.500, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.136', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '64.000'} [2024-08-06 05:19:42,242][52650] Updated weights for policy 0, policy_version 60291 (0.0021) [2024-08-06 05:19:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 493912064. Throughput: 0: 4375.1. Samples: 123485790. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:19:42,795][52567] Avg episode reward: [(0, '73.440')] [2024-08-06 05:19:43,430][52647] DAMAGECOUNT value on done: 640426.0 [2024-08-06 05:19:43,431][52647] Sum rewards: 51.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.034', 'weapon4': '0.046', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.388', 'WEAPON3': '1.000', 'HITCOUNT': '2.760', 'weapon3': '3.410', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '43.000'} [2024-08-06 05:19:43,860][52662] DAMAGECOUNT value on done: 619071.0 [2024-08-06 05:19:43,860][52662] Sum rewards: 69.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.175', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.087', 'weapon5': '0.124', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.152', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:43,943][52660] DAMAGECOUNT value on done: 622950.0 [2024-08-06 05:19:43,946][52660] Sum rewards: 82.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.590', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.256', 'WEAPON3': '1.250', 'weapon3': '3.482', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '67.000'} [2024-08-06 05:19:44,239][52668] DAMAGECOUNT value on done: 605434.0 [2024-08-06 05:19:44,240][52668] Sum rewards: 60.603, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.102', 'AMMO3': '0.133', 'AMMO4': '0.158', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '0.850', 'HITCOUNT': '2.810', 'weapon3': '3.108', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '49.000'} [2024-08-06 05:19:44,828][52795] DAMAGECOUNT value on done: 574059.0 [2024-08-06 05:19:44,829][52795] Sum rewards: 73.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.193', 'weapon5': '0.206', 'weapon2': '0.248', 'AMMO4': '0.249', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '61.000'} [2024-08-06 05:19:45,068][52649] DAMAGECOUNT value on done: 608730.0 [2024-08-06 05:19:45,068][52649] Sum rewards: 71.061, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.517', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.172', 'AMMO3': '0.220', 'weapon4': '0.230', 'AMMO4': '0.293', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '59.000'} [2024-08-06 05:19:45,447][52820] DAMAGECOUNT value on done: 578493.0 [2024-08-06 05:19:45,448][52820] Sum rewards: 74.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.130', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:45,795][52659] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2024-08-06 05:19:45,968][52647] DAMAGECOUNT value on done: 654666.0 [2024-08-06 05:19:45,968][52647] Sum rewards: 65.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.535', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.130', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.340', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.162', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:46,202][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:19:46,462][52660] DAMAGECOUNT value on done: 627523.0 [2024-08-06 05:19:46,463][52660] Sum rewards: 61.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.434', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.248', 'AMMO3': '0.272', 'weapon2': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.098', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '54.000'} [2024-08-06 05:19:46,896][52668] DAMAGECOUNT value on done: 610069.0 [2024-08-06 05:19:46,900][52668] Sum rewards: 64.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.081', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '54.000'} [2024-08-06 05:19:46,949][52650] Updated weights for policy 0, policy_version 60301 (0.0012) [2024-08-06 05:19:47,099][52662] DAMAGECOUNT value on done: 629746.0 [2024-08-06 05:19:47,100][52662] Sum rewards: 73.048, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.122', 'HEALTH': '0.122', 'AMMO3': '0.134', 'weapon5': '0.144', 'AMMO4': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '0.750', 'weapon3': '3.122', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '58.500'} [2024-08-06 05:19:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 493993984. Throughput: 0: 4371.3. Samples: 123498600. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:19:47,795][52567] Avg episode reward: [(0, '73.047')] [2024-08-06 05:19:47,805][52811] DAMAGECOUNT value on done: 591189.0 [2024-08-06 05:19:47,807][52811] Sum rewards: 72.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.564', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.052', 'weapon5': '0.164', 'AMMO3': '0.198', 'AMMO4': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:47,888][52795] DAMAGECOUNT value on done: 562947.0 [2024-08-06 05:19:47,888][52795] Sum rewards: 70.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.245', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.092', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:48,227][52649] DAMAGECOUNT value on done: 608453.0 [2024-08-06 05:19:48,228][52649] Sum rewards: 69.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.159', 'weapon5': '0.172', 'weapon4': '0.212', 'AMMO4': '0.322', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:48,509][52820] DAMAGECOUNT value on done: 569875.0 [2024-08-06 05:19:48,511][52820] Sum rewards: 75.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.452', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.110', 'weapon4': '0.134', 'AMMO4': '0.178', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '65.000'} [2024-08-06 05:19:48,858][52647] DAMAGECOUNT value on done: 651952.0 [2024-08-06 05:19:48,858][52647] Sum rewards: 69.777, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.610', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.030', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'WEAPON5': '0.150', 'AMMO3': '0.308', 'weapon2': '0.404', 'WEAPON3': '1.900', 'weapon3': '3.268', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:49,567][52660] DAMAGECOUNT value on done: 615751.0 [2024-08-06 05:19:49,571][52660] Sum rewards: 71.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.478', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.209', 'AMMO4': '0.227', 'weapon5': '0.266', 'weapon4': '0.354', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.704', 'WEAPON3': '1.300', 'weapon3': '2.398', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:49,696][52662] DAMAGECOUNT value on done: 616082.0 [2024-08-06 05:19:49,699][52662] Sum rewards: 73.985, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.486', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.281', 'weapon2': '0.412', 'WEAPON3': '1.700', 'weapon3': '3.192', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '65.000'} [2024-08-06 05:19:49,970][52668] DAMAGECOUNT value on done: 618243.0 [2024-08-06 05:19:49,970][52668] Sum rewards: 80.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'weapon2': '0.236', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '67.000'} [2024-08-06 05:19:50,902][52811] DAMAGECOUNT value on done: 572217.0 [2024-08-06 05:19:50,903][52811] Sum rewards: 66.156, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.442', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.062', 'weapon5': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'AMMO3': '0.254', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:50,982][52795] DAMAGECOUNT value on done: 579304.0 [2024-08-06 05:19:50,986][52795] Sum rewards: 63.423, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.206', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.148', 'weapon5': '0.180', 'AMMO3': '0.270', 'AMMO4': '0.280', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '56.000'} [2024-08-06 05:19:51,348][52649] DAMAGECOUNT value on done: 604030.0 [2024-08-06 05:19:51,357][52649] Sum rewards: 70.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.114', 'AMMO3': '0.217', 'AMMO4': '0.223', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.350', 'weapon3': '2.730', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:51,418][52647] DAMAGECOUNT value on done: 650155.0 [2024-08-06 05:19:51,419][52647] Sum rewards: 76.206, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.106', 'AMMO4': '0.178', 'weapon5': '0.214', 'AMMO3': '0.220', 'weapon2': '0.242', 'HEALTH': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:51,559][52820] DAMAGECOUNT value on done: 574908.0 [2024-08-06 05:19:51,561][52820] Sum rewards: 75.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.428', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO4': '0.214', 'AMMO3': '0.224', 'weapon2': '0.242', 'weapon5': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '61.000'} [2024-08-06 05:19:51,767][52650] Updated weights for policy 0, policy_version 60311 (0.0011) [2024-08-06 05:19:52,655][52662] DAMAGECOUNT value on done: 619472.0 [2024-08-06 05:19:52,656][52662] Sum rewards: 74.164, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.235', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.166', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.358', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:52,682][52660] DAMAGECOUNT value on done: 613422.0 [2024-08-06 05:19:52,686][52660] Sum rewards: 69.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.055', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.173', 'AMMO3': '0.200', 'weapon2': '0.242', 'weapon5': '0.262', 'weapon4': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17522.5). Total num frames: 494092288. Throughput: 0: 4378.0. Samples: 123525220. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:19:52,794][52567] Avg episode reward: [(0, '72.910')] [2024-08-06 05:19:53,099][52668] DAMAGECOUNT value on done: 618418.0 [2024-08-06 05:19:53,099][52668] Sum rewards: 78.070, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.030', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.158', 'weapon2': '0.596', 'HEALTH': '0.666', 'WEAPON3': '0.900', 'weapon3': '3.194', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '61.000'} [2024-08-06 05:19:53,971][52811] DAMAGECOUNT value on done: 572386.0 [2024-08-06 05:19:53,972][52811] Sum rewards: 65.645, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.070', 'HEALTH': '0.094', 'AMMO4': '0.107', 'AMMO3': '0.118', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.530', 'WEAPON3': '0.700', 'weapon3': '3.040', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '50.000'} [2024-08-06 05:19:54,173][52795] DAMAGECOUNT value on done: 573667.0 [2024-08-06 05:19:54,173][52795] Sum rewards: 69.747, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.691', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:54,293][52647] DAMAGECOUNT value on done: 644948.0 [2024-08-06 05:19:54,294][52647] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.024', 'AMMO2': '0.063', 'AMMO3': '0.206', 'weapon4': '0.242', 'AMMO4': '0.316', 'weapon2': '0.322', 'weapon5': '0.380', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '53.000'} [2024-08-06 05:19:54,742][52820] DAMAGECOUNT value on done: 582500.0 [2024-08-06 05:19:54,742][52820] Sum rewards: 67.073, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.363', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.056', 'weapon5': '0.078', 'AMMO4': '0.088', 'AMMO3': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '0.900', 'HITCOUNT': '3.170', 'weapon3': '3.194', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '53.500'} [2024-08-06 05:19:55,194][52662] DAMAGECOUNT value on done: 616643.0 [2024-08-06 05:19:55,195][52662] Sum rewards: 81.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.080', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon4': '0.234', 'weapon2': '0.322', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '66.000'} [2024-08-06 05:19:55,750][52660] DAMAGECOUNT value on done: 614972.0 [2024-08-06 05:19:55,750][52660] Sum rewards: 72.710, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.570', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO4': '0.195', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:56,188][52668] DAMAGECOUNT value on done: 616822.0 [2024-08-06 05:19:56,191][52668] Sum rewards: 70.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.772', 'AMMO5': '0.016', 'WEAPON1': '0.030', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.199', 'weapon5': '0.262', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '58.000'} [2024-08-06 05:19:56,234][52667] Large shaping reward 2.657 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', 0.025, 5.0), ('weapon5', 0.002)] [2024-08-06 05:19:56,489][52650] Updated weights for policy 0, policy_version 60321 (0.0013) [2024-08-06 05:19:57,130][52811] DAMAGECOUNT value on done: 574363.0 [2024-08-06 05:19:57,130][52811] Sum rewards: 73.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.472', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.118', 'AMMO4': '0.142', 'weapon5': '0.182', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:57,436][52795] DAMAGECOUNT value on done: 565560.0 [2024-08-06 05:19:57,437][52795] Sum rewards: 62.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.090', 'AMMO4': '0.114', 'weapon5': '0.172', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.164', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '53.000'} [2024-08-06 05:19:57,555][52647] DAMAGECOUNT value on done: 659619.0 [2024-08-06 05:19:57,556][52647] Sum rewards: 75.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.672', 'AMMO5': '0.019', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.138', 'AMMO3': '0.189', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2024-08-06 05:19:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 494174208. Throughput: 0: 4377.1. Samples: 123551240. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:19:57,794][52567] Avg episode reward: [(0, '72.243')] [2024-08-06 05:19:57,984][52820] DAMAGECOUNT value on done: 578081.0 [2024-08-06 05:19:57,987][52820] Sum rewards: 73.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.176', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.112', 'weapon5': '0.126', 'AMMO3': '0.161', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '60.000'} [2024-08-06 05:19:58,194][52662] DAMAGECOUNT value on done: 625052.0 [2024-08-06 05:19:58,195][52662] Sum rewards: 63.269, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.225', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.140', 'weapon5': '0.150', 'AMMO4': '0.204', 'AMMO3': '0.244', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '57.000'} [2024-08-06 05:19:58,784][52660] DAMAGECOUNT value on done: 624059.0 [2024-08-06 05:19:58,786][52660] Sum rewards: 76.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon5': '0.054', 'weapon4': '0.072', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '64.000'} [2024-08-06 05:19:59,215][52668] DAMAGECOUNT value on done: 623144.0 [2024-08-06 05:19:59,216][52668] Sum rewards: 73.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.430', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.252', 'weapon4': '0.256', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:00,086][52811] DAMAGECOUNT value on done: 578791.0 [2024-08-06 05:20:00,087][52811] Sum rewards: 84.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon4': '0.180', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.266', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '69.000'} [2024-08-06 05:20:00,354][52794] Large shaping reward 2.535 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 05:20:00,560][52647] DAMAGECOUNT value on done: 650034.0 [2024-08-06 05:20:00,560][52647] Sum rewards: 63.154, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.394', 'AMMO5': '0.023', 'AMMO2': '0.073', 'AMMO3': '0.248', 'weapon4': '0.280', 'weapon5': '0.304', 'weapon2': '0.338', 'AMMO4': '0.363', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'WEAPON3': '1.500', 'weapon3': '2.702', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:00,619][52795] DAMAGECOUNT value on done: 572077.0 [2024-08-06 05:20:00,620][52795] Sum rewards: 63.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.116', 'weapon4': '0.122', 'AMMO3': '0.189', 'AMMO4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.000'} [2024-08-06 05:20:00,851][52650] Updated weights for policy 0, policy_version 60331 (0.0021) [2024-08-06 05:20:01,267][52662] DAMAGECOUNT value on done: 617371.0 [2024-08-06 05:20:01,268][52820] DAMAGECOUNT value on done: 581042.0 [2024-08-06 05:20:01,270][52662] Sum rewards: 69.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.453', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.080', 'weapon5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:01,272][52820] Sum rewards: 69.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.967', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.394', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '56.000'} [2024-08-06 05:20:01,716][52660] DAMAGECOUNT value on done: 614927.0 [2024-08-06 05:20:01,724][52660] Sum rewards: 67.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.195', 'weapon5': '0.250', 'weapon2': '0.274', 'AMMO4': '0.278', 'weapon4': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '55.000'} [2024-08-06 05:20:02,001][52668] DAMAGECOUNT value on done: 620334.0 [2024-08-06 05:20:02,003][52668] Sum rewards: 60.676, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.245', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.098', 'weapon4': '0.152', 'AMMO3': '0.188', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.126', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '50.000'} [2024-08-06 05:20:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 494264320. Throughput: 0: 4381.3. Samples: 123564390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:20:02,794][52567] Avg episode reward: [(0, '71.817')] [2024-08-06 05:20:03,242][52811] DAMAGECOUNT value on done: 586817.0 [2024-08-06 05:20:03,243][52811] Sum rewards: 81.631, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.126', 'AMMO3': '0.197', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '66.000'} [2024-08-06 05:20:03,472][52647] DAMAGECOUNT value on done: 657784.0 [2024-08-06 05:20:03,474][52647] Sum rewards: 70.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon4': '0.294', 'weapon2': '0.462', 'WEAPON3': '0.950', 'weapon3': '2.892', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:03,848][52795] DAMAGECOUNT value on done: 579308.0 [2024-08-06 05:20:03,848][52795] Sum rewards: 75.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.322', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.065', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:04,455][52662] DAMAGECOUNT value on done: 630942.0 [2024-08-06 05:20:04,455][52662] Sum rewards: 67.947, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.108', 'weapon5': '0.240', 'AMMO3': '0.256', 'AMMO4': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.924', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '59.000'} [2024-08-06 05:20:04,457][52820] DAMAGECOUNT value on done: 577446.0 [2024-08-06 05:20:04,457][52820] Sum rewards: 77.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon2': '0.166', 'weapon4': '0.226', 'AMMO3': '0.228', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:04,512][52660] DAMAGECOUNT value on done: 616647.0 [2024-08-06 05:20:04,512][52660] Sum rewards: 62.765, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.530', 'AMMO5': '0.011', 'weapon4': '0.048', 'AMMO2': '0.049', 'weapon5': '0.172', 'AMMO4': '0.244', 'weapon2': '0.244', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '3.230', 'weapon3': '3.232', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '56.000'} [2024-08-06 05:20:04,938][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:20:05,929][52650] Updated weights for policy 0, policy_version 60341 (0.0050) [2024-08-06 05:20:06,299][52811] DAMAGECOUNT value on done: 582939.0 [2024-08-06 05:20:06,302][52811] Sum rewards: 75.015, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.005', 'AMMO5': '0.028', 'AMMO2': '0.038', 'weapon4': '0.112', 'AMMO4': '0.190', 'weapon5': '0.274', 'AMMO3': '0.277', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.824', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '65.000'} [2024-08-06 05:20:06,354][52647] DAMAGECOUNT value on done: 658150.0 [2024-08-06 05:20:06,357][52647] Sum rewards: 68.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.884', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.164', 'weapon5': '0.214', 'AMMO3': '0.274', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.016', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '59.000'} [2024-08-06 05:20:07,426][52660] DAMAGECOUNT value on done: 624317.0 [2024-08-06 05:20:07,435][52660] Sum rewards: 67.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.189', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.070', 'AMMO4': '0.207', 'weapon5': '0.216', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:07,559][52662] DAMAGECOUNT value on done: 623446.0 [2024-08-06 05:20:07,559][52662] Sum rewards: 77.333, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.463', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'weapon4': '0.048', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.264', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '66.000'} [2024-08-06 05:20:07,631][52820] DAMAGECOUNT value on done: 577782.0 [2024-08-06 05:20:07,631][52820] Sum rewards: 80.151, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.008', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.260', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '68.000'} [2024-08-06 05:20:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 494346240. Throughput: 0: 4372.0. Samples: 123590360. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:20:07,795][52567] Avg episode reward: [(0, '71.610')] [2024-08-06 05:20:08,513][52647] DAMAGECOUNT value on done: 642560.0 [2024-08-06 05:20:08,516][52647] Sum rewards: 73.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.180', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.177', 'weapon5': '0.200', 'weapon2': '0.256', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:09,424][52811] DAMAGECOUNT value on done: 574303.0 [2024-08-06 05:20:09,426][52811] Sum rewards: 59.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.457', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.112', 'weapon5': '0.156', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.050', 'HITCOUNT': '2.730', 'weapon3': '2.974', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '48.000'} [2024-08-06 05:20:09,579][52614] Signal inference workers to stop experience collection... (10950 times) [2024-08-06 05:20:09,579][52614] Signal inference workers to resume experience collection... (10950 times) [2024-08-06 05:20:09,612][52650] InferenceWorker_p0-w0: stopping experience collection (10950 times) [2024-08-06 05:20:09,612][52650] InferenceWorker_p0-w0: resuming experience collection (10950 times) [2024-08-06 05:20:10,290][52650] Updated weights for policy 0, policy_version 60351 (0.0011) [2024-08-06 05:20:10,311][52660] DAMAGECOUNT value on done: 614441.0 [2024-08-06 05:20:10,315][52660] Sum rewards: 66.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.116', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '55.000'} [2024-08-06 05:20:10,691][52662] DAMAGECOUNT value on done: 611636.0 [2024-08-06 05:20:10,691][52662] Sum rewards: 64.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.158', 'weapon5': '0.172', 'AMMO3': '0.191', 'AMMO4': '0.200', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '54.000'} [2024-08-06 05:20:10,884][52820] DAMAGECOUNT value on done: 585666.0 [2024-08-06 05:20:10,886][52820] Sum rewards: 68.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.014', 'AMMO2': '0.068', 'weapon4': '0.078', 'weapon5': '0.236', 'AMMO3': '0.246', 'AMMO4': '0.341', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:11,150][52647] DAMAGECOUNT value on done: 649387.0 [2024-08-06 05:20:11,151][52647] Sum rewards: 84.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.139', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '71.000'} [2024-08-06 05:20:12,052][52659] DAMAGECOUNT value on done: 625618.0 [2024-08-06 05:20:12,052][52659] Sum rewards: 56.526, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.015', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.315', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.850', 'weapon3': '3.048', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '52.000'} [2024-08-06 05:20:12,476][52811] DAMAGECOUNT value on done: 586645.0 [2024-08-06 05:20:12,476][52811] Sum rewards: 74.216, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.016', 'AMMO2': '0.033', 'HEALTH': '0.086', 'AMMO4': '0.167', 'AMMO3': '0.169', 'weapon5': '0.210', 'weapon2': '0.258', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '59.000'} [2024-08-06 05:20:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 494436352. Throughput: 0: 4362.2. Samples: 123616370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:20:12,794][52567] Avg episode reward: [(0, '71.247')] [2024-08-06 05:20:13,086][52664] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2024-08-06 05:20:13,382][52660] DAMAGECOUNT value on done: 616645.0 [2024-08-06 05:20:13,383][52660] Sum rewards: 67.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.038', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.293', 'weapon2': '0.414', 'WEAPON3': '1.850', 'weapon3': '3.216', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2024-08-06 05:20:13,730][52662] DAMAGECOUNT value on done: 620316.0 [2024-08-06 05:20:13,732][52662] Sum rewards: 72.494, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.928', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'weapon4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.122', 'weapon2': '0.730', 'WEAPON3': '0.850', 'weapon3': '2.910', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '55.000'} [2024-08-06 05:20:13,911][52647] DAMAGECOUNT value on done: 639884.0 [2024-08-06 05:20:13,912][52647] Sum rewards: 69.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.262', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.158', 'AMMO4': '0.223', 'weapon5': '0.250', 'weapon2': '0.296', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.656', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 05:20:14,032][52820] DAMAGECOUNT value on done: 584085.0 [2024-08-06 05:20:14,032][52820] Sum rewards: 60.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.052', 'weapon4': '0.080', 'AMMO3': '0.178', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.220', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '50.500'} [2024-08-06 05:20:15,175][52650] Updated weights for policy 0, policy_version 60361 (0.0016) [2024-08-06 05:20:15,199][52659] DAMAGECOUNT value on done: 619466.0 [2024-08-06 05:20:15,201][52659] Sum rewards: 73.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.190', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon5': '0.080', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO4': '0.223', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '62.000'} [2024-08-06 05:20:15,542][52811] DAMAGECOUNT value on done: 578910.0 [2024-08-06 05:20:15,545][52811] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.448', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.070', 'AMMO4': '0.092', 'weapon5': '0.132', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.272', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '50.000'} [2024-08-06 05:20:16,190][52660] DAMAGECOUNT value on done: 628474.0 [2024-08-06 05:20:16,191][52660] Sum rewards: 68.344, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.300', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.076', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon4': '0.216', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '54.000'} [2024-08-06 05:20:16,559][52662] DAMAGECOUNT value on done: 613732.0 [2024-08-06 05:20:16,561][52662] Sum rewards: 65.447, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.135', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.102', 'weapon5': '0.126', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.822', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '51.000'} [2024-08-06 05:20:16,824][52647] DAMAGECOUNT value on done: 645327.0 [2024-08-06 05:20:16,825][52647] Sum rewards: 65.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.906', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.191', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '53.000'} [2024-08-06 05:20:17,218][52820] DAMAGECOUNT value on done: 572168.0 [2024-08-06 05:20:17,229][52820] Sum rewards: 81.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.052', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.263', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '70.000'} [2024-08-06 05:20:17,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 494510080. Throughput: 0: 4364.4. Samples: 123629580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:20:17,794][52567] Avg episode reward: [(0, '70.747')] [2024-08-06 05:20:18,515][52659] DAMAGECOUNT value on done: 624562.0 [2024-08-06 05:20:18,516][52659] Sum rewards: 67.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.748', 'AMMO5': '0.018', 'AMMO2': '0.062', 'AMMO3': '0.227', 'weapon2': '0.238', 'AMMO4': '0.309', 'weapon5': '0.324', 'weapon4': '0.470', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.590', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:18,649][52811] DAMAGECOUNT value on done: 582589.0 [2024-08-06 05:20:18,650][52811] Sum rewards: 49.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.176', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '42.000'} [2024-08-06 05:20:19,481][52660] DAMAGECOUNT value on done: 633069.0 [2024-08-06 05:20:19,482][52660] Sum rewards: 71.537, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.470', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.148', 'weapon5': '0.168', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:19,608][52650] Updated weights for policy 0, policy_version 60371 (0.0024) [2024-08-06 05:20:19,741][52665] DAMAGECOUNT value on done: 609067.0 [2024-08-06 05:20:19,741][52665] Sum rewards: 77.114, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.854', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '62.000'} [2024-08-06 05:20:20,146][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:20:20,854][52803] DAMAGECOUNT value on done: 578940.0 [2024-08-06 05:20:20,857][52803] Sum rewards: 78.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.080', 'weapon4': '0.112', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '62.000'} [2024-08-06 05:20:21,517][52659] DAMAGECOUNT value on done: 618924.0 [2024-08-06 05:20:21,517][52659] Sum rewards: 71.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.242', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.126', 'AMMO3': '0.158', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.528', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.478', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:21,930][52811] DAMAGECOUNT value on done: 587145.0 [2024-08-06 05:20:21,931][52811] Sum rewards: 77.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.970', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.208', 'AMMO3': '0.239', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 05:20:22,047][52660] DAMAGECOUNT value on done: 614706.0 [2024-08-06 05:20:22,048][52660] Sum rewards: 67.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.140', 'AMMO4': '0.173', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:22,637][52665] DAMAGECOUNT value on done: 622659.0 [2024-08-06 05:20:22,637][52665] Sum rewards: 60.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.388', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.076', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.226', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.452', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '50.500'} [2024-08-06 05:20:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 494608384. Throughput: 0: 4357.6. Samples: 123655610. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:20:22,794][52567] Avg episode reward: [(0, '70.591')] [2024-08-06 05:20:24,004][52803] DAMAGECOUNT value on done: 576029.0 [2024-08-06 05:20:24,004][52803] Sum rewards: 72.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:24,146][52659] DAMAGECOUNT value on done: 616659.0 [2024-08-06 05:20:24,146][52659] Sum rewards: 81.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.550', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.156', 'AMMO3': '0.215', 'weapon5': '0.270', 'AMMO4': '0.271', 'weapon2': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '68.000'} [2024-08-06 05:20:24,212][52650] Updated weights for policy 0, policy_version 60381 (0.0020) [2024-08-06 05:20:25,192][52811] DAMAGECOUNT value on done: 577404.0 [2024-08-06 05:20:25,193][52811] Sum rewards: 65.245, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.128', 'AMMO3': '0.129', 'AMMO4': '0.142', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '0.700', 'HEALTH': '1.034', 'HITCOUNT': '2.780', 'weapon3': '3.068', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '51.000'} [2024-08-06 05:20:25,207][52660] DAMAGECOUNT value on done: 623862.0 [2024-08-06 05:20:25,207][52660] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.504', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.164', 'weapon4': '0.186', 'AMMO3': '0.196', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:25,521][52665] DAMAGECOUNT value on done: 620346.0 [2024-08-06 05:20:25,522][52665] Sum rewards: 75.350, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.132', 'weapon5': '0.154', 'AMMO4': '0.205', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:27,199][52803] DAMAGECOUNT value on done: 582356.0 [2024-08-06 05:20:27,201][52803] Sum rewards: 80.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon2': '0.184', 'weapon5': '0.186', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '69.000'} [2024-08-06 05:20:27,514][52659] DAMAGECOUNT value on done: 623865.0 [2024-08-06 05:20:27,517][52659] Sum rewards: 74.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.162', 'weapon4': '0.184', 'AMMO3': '0.221', 'AMMO4': '0.270', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.948', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:27,728][52660] DAMAGECOUNT value on done: 617212.0 [2024-08-06 05:20:27,738][52660] Sum rewards: 76.238, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.300', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.084', 'AMMO4': '0.149', 'weapon5': '0.188', 'weapon2': '0.234', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:27,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 494698496. Throughput: 0: 4365.8. Samples: 123682250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:20:27,794][52567] Avg episode reward: [(0, '70.743')] [2024-08-06 05:20:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060388_494698496.pth... [2024-08-06 05:20:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000059875_490496000.pth [2024-08-06 05:20:28,323][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:20:28,342][52811] DAMAGECOUNT value on done: 573933.0 [2024-08-06 05:20:28,345][52811] Sum rewards: 81.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.576', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.092', 'AMMO4': '0.118', 'weapon5': '0.120', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '67.000'} [2024-08-06 05:20:28,472][52665] DAMAGECOUNT value on done: 612999.0 [2024-08-06 05:20:28,476][52665] Sum rewards: 64.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.033', 'AMMO2': '0.073', 'weapon4': '0.198', 'AMMO3': '0.207', 'weapon5': '0.342', 'AMMO4': '0.365', 'weapon2': '0.372', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '53.500'} [2024-08-06 05:20:29,317][52650] Updated weights for policy 0, policy_version 60391 (0.0015) [2024-08-06 05:20:29,678][52666] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon3', 0.002)] [2024-08-06 05:20:30,343][52660] DAMAGECOUNT value on done: 616217.0 [2024-08-06 05:20:30,343][52660] Sum rewards: 74.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.158', 'weapon4': '0.194', 'AMMO3': '0.197', 'weapon2': '0.260', 'WEAPON5': '0.300', 'AMMO4': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:30,523][52803] DAMAGECOUNT value on done: 586271.0 [2024-08-06 05:20:30,523][52803] Sum rewards: 69.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.745', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon5': '0.196', 'AMMO3': '0.200', 'weapon4': '0.250', 'AMMO4': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:30,816][52659] DAMAGECOUNT value on done: 618689.0 [2024-08-06 05:20:30,818][52659] Sum rewards: 65.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.832', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.127', 'AMMO3': '0.188', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.266', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '54.000'} [2024-08-06 05:20:31,445][52811] DAMAGECOUNT value on done: 579392.0 [2024-08-06 05:20:31,445][52811] Sum rewards: 71.884, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'HEALTH': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.388', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '59.500'} [2024-08-06 05:20:31,593][52665] DAMAGECOUNT value on done: 603413.0 [2024-08-06 05:20:31,595][52665] Sum rewards: 71.406, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.696', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.124', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '60.000'} [2024-08-06 05:20:32,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 494788608. Throughput: 0: 4361.3. Samples: 123694860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:20:32,795][52567] Avg episode reward: [(0, '70.836')] [2024-08-06 05:20:33,167][52660] DAMAGECOUNT value on done: 610374.0 [2024-08-06 05:20:33,168][52660] Sum rewards: 85.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.508', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.256', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '70.000'} [2024-08-06 05:20:33,511][52803] DAMAGECOUNT value on done: 580463.0 [2024-08-06 05:20:33,511][52803] Sum rewards: 77.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.599', 'AMMO5': '0.022', 'AMMO2': '0.061', 'AMMO3': '0.209', 'weapon2': '0.248', 'weapon4': '0.258', 'AMMO4': '0.307', 'weapon5': '0.358', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:33,725][52659] DAMAGECOUNT value on done: 616751.0 [2024-08-06 05:20:33,725][52659] Sum rewards: 76.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.695', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.148', 'weapon2': '0.164', 'AMMO3': '0.225', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:33,736][52794] DAMAGECOUNT value on done: 622800.0 [2024-08-06 05:20:33,736][52794] Sum rewards: 64.354, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.619', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.154', 'weapon5': '0.276', 'AMMO3': '0.281', 'AMMO4': '0.296', 'weapon2': '0.352', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.862', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:34,109][52650] Updated weights for policy 0, policy_version 60401 (0.0012) [2024-08-06 05:20:34,587][52811] DAMAGECOUNT value on done: 577869.0 [2024-08-06 05:20:34,587][52811] Sum rewards: 65.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.195', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.174', 'AMMO4': '0.175', 'AMMO3': '0.258', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.112', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '56.000'} [2024-08-06 05:20:34,590][52665] DAMAGECOUNT value on done: 609346.0 [2024-08-06 05:20:34,592][52665] Sum rewards: 83.213, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.104', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.086', 'AMMO4': '0.105', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '70.000'} [2024-08-06 05:20:36,825][52803] DAMAGECOUNT value on done: 573963.0 [2024-08-06 05:20:36,826][52803] Sum rewards: 76.513, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.454', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.044', 'AMMO4': '0.063', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '62.000'} [2024-08-06 05:20:36,852][52659] DAMAGECOUNT value on done: 624860.0 [2024-08-06 05:20:36,853][52659] Sum rewards: 67.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.646', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.136', 'AMMO4': '0.192', 'AMMO3': '0.221', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:36,985][52794] DAMAGECOUNT value on done: 628070.0 [2024-08-06 05:20:36,987][52794] Sum rewards: 75.071, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.170', 'AMMO4': '0.171', 'AMMO3': '0.178', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '0.950', 'HEALTH': '1.360', 'weapon3': '2.926', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.000'} [2024-08-06 05:20:37,731][52665] DAMAGECOUNT value on done: 614039.0 [2024-08-06 05:20:37,733][52665] Sum rewards: 67.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.116', 'weapon4': '0.124', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '55.000'} [2024-08-06 05:20:37,773][52811] DAMAGECOUNT value on done: 580704.0 [2024-08-06 05:20:37,773][52811] Sum rewards: 71.460, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-5.425', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.078', 'AMMO4': '0.201', 'weapon2': '0.268', 'weapon4': '0.286', 'WEAPON5': '0.300', 'AMMO3': '0.329', 'WEAPON4': '0.450', 'WEAPON3': '2.050', 'weapon3': '3.056', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '65.000'} [2024-08-06 05:20:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 494870528. Throughput: 0: 4355.1. Samples: 123721200. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 05:20:37,794][52567] Avg episode reward: [(0, '71.256')] [2024-08-06 05:20:38,531][52650] Updated weights for policy 0, policy_version 60411 (0.0014) [2024-08-06 05:20:39,958][52794] DAMAGECOUNT value on done: 627392.0 [2024-08-06 05:20:39,958][52794] Sum rewards: 81.128, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.642', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.080', 'weapon4': '0.108', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.212', 'WEAPON3': '1.450', 'weapon3': '3.400', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '69.000'} [2024-08-06 05:20:40,166][52803] DAMAGECOUNT value on done: 573508.0 [2024-08-06 05:20:40,167][52803] Sum rewards: 64.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.188', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.168', 'AMMO4': '0.213', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.496', 'weapon2': '0.658', 'WEAPON3': '1.350', 'weapon3': '2.328', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '55.500'} [2024-08-06 05:20:40,179][52659] DAMAGECOUNT value on done: 627115.0 [2024-08-06 05:20:40,181][52659] Sum rewards: 79.338, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.063', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.482', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '67.000'} [2024-08-06 05:20:40,373][52665] DAMAGECOUNT value on done: 611936.0 [2024-08-06 05:20:40,375][52665] Sum rewards: 73.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.072', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.428', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:41,036][52811] DAMAGECOUNT value on done: 584079.0 [2024-08-06 05:20:41,036][52811] Sum rewards: 64.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.164', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.105', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.262', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '52.000'} [2024-08-06 05:20:42,623][52794] DAMAGECOUNT value on done: 617978.0 [2024-08-06 05:20:42,625][52794] Sum rewards: 71.965, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.380', 'AMMO5': '0.004', 'weapon5': '0.022', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.128', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.305', 'WEAPON3': '1.900', 'weapon3': '3.478', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:42,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 494952448. Throughput: 0: 4362.0. Samples: 123747530. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 05:20:42,794][52567] Avg episode reward: [(0, '71.285')] [2024-08-06 05:20:42,927][52665] DAMAGECOUNT value on done: 622117.0 [2024-08-06 05:20:42,927][52665] Sum rewards: 67.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.130', 'AMMO4': '0.147', 'weapon2': '0.182', 'weapon5': '0.198', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.228', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:43,177][52659] DAMAGECOUNT value on done: 617352.0 [2024-08-06 05:20:43,179][52659] Sum rewards: 73.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.114', 'weapon2': '0.172', 'AMMO3': '0.178', 'AMMO4': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:43,327][52803] DAMAGECOUNT value on done: 570551.0 [2024-08-06 05:20:43,326][52650] Updated weights for policy 0, policy_version 60421 (0.0023) [2024-08-06 05:20:43,329][52803] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.973', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.098', 'AMMO4': '0.156', 'AMMO3': '0.231', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '60.500'} [2024-08-06 05:20:44,208][52811] DAMAGECOUNT value on done: 580720.0 [2024-08-06 05:20:44,209][52811] Sum rewards: 75.397, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.165', 'weapon5': '0.222', 'HEALTH': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.398', 'weapon2': '0.412', 'WEAPON3': '0.900', 'weapon3': '2.702', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '59.000'} [2024-08-06 05:20:45,165][52794] DAMAGECOUNT value on done: 618449.0 [2024-08-06 05:20:45,165][52794] Sum rewards: 80.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.135', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.132', 'AMMO4': '0.193', 'weapon4': '0.336', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.888', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:45,854][52659] DAMAGECOUNT value on done: 626412.0 [2024-08-06 05:20:45,855][52659] Sum rewards: 73.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.809', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.184', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '63.000'} [2024-08-06 05:20:45,877][52671] Large shaping reward 3.411 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.36, 120.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:20:46,037][52665] DAMAGECOUNT value on done: 611900.0 [2024-08-06 05:20:46,038][52665] Sum rewards: 70.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.195', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.126', 'AMMO3': '0.254', 'AMMO4': '0.282', 'weapon5': '0.302', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 05:20:46,498][52664] DAMAGECOUNT value on done: 644662.0 [2024-08-06 05:20:46,498][52664] Sum rewards: 74.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.193', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.220', 'weapon5': '0.254', 'weapon4': '0.260', 'AMMO4': '0.281', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.720', 'WEAPON3': '1.350', 'weapon3': '2.426', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '63.000'} [2024-08-06 05:20:46,510][52803] DAMAGECOUNT value on done: 577137.0 [2024-08-06 05:20:46,512][52803] Sum rewards: 76.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.169', 'weapon5': '0.226', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '60.000'} [2024-08-06 05:20:47,123][52667] DAMAGECOUNT value on done: 621452.0 [2024-08-06 05:20:47,123][52667] Sum rewards: 72.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.172', 'weapon4': '0.194', 'AMMO3': '0.199', 'AMMO4': '0.222', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:47,197][52811] DAMAGECOUNT value on done: 577722.0 [2024-08-06 05:20:47,198][52811] Sum rewards: 83.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.342', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.172', 'AMMO3': '0.202', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '68.000'} [2024-08-06 05:20:47,768][52794] DAMAGECOUNT value on done: 621689.0 [2024-08-06 05:20:47,778][52794] Sum rewards: 75.852, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.462', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.144', 'AMMO3': '0.176', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.224', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 495042560. Throughput: 0: 4359.6. Samples: 123760570. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 05:20:47,794][52567] Avg episode reward: [(0, '71.585')] [2024-08-06 05:20:48,106][52650] Updated weights for policy 0, policy_version 60431 (0.0010) [2024-08-06 05:20:48,939][52659] DAMAGECOUNT value on done: 618614.0 [2024-08-06 05:20:48,941][52659] Sum rewards: 93.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.614', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.270', 'weapon2': '0.344', 'WEAPON3': '1.750', 'weapon3': '3.218', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '23.577', 'FRAGCOUNT': '78.000'} [2024-08-06 05:20:48,941][52665] DAMAGECOUNT value on done: 622333.0 [2024-08-06 05:20:48,944][52665] Sum rewards: 67.318, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.172', 'weapon5': '0.188', 'AMMO4': '0.198', 'AMMO3': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.650', 'weapon3': '2.854', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:49,151][52664] DAMAGECOUNT value on done: 648173.0 [2024-08-06 05:20:49,151][52664] Sum rewards: 78.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.160', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '66.000'} [2024-08-06 05:20:49,604][52803] DAMAGECOUNT value on done: 571665.0 [2024-08-06 05:20:49,605][52803] Sum rewards: 72.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.805', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.133', 'weapon5': '0.220', 'AMMO3': '0.234', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '60.000'} [2024-08-06 05:20:50,063][52667] DAMAGECOUNT value on done: 629780.0 [2024-08-06 05:20:50,065][52667] Sum rewards: 77.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.294', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '64.000'} [2024-08-06 05:20:50,376][52794] DAMAGECOUNT value on done: 626391.0 [2024-08-06 05:20:50,376][52794] Sum rewards: 64.567, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.912', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.132', 'weapon5': '0.234', 'AMMO3': '0.262', 'AMMO4': '0.304', 'weapon2': '0.544', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.748', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:51,774][52666] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 05:20:51,944][52665] DAMAGECOUNT value on done: 618512.0 [2024-08-06 05:20:51,944][52665] Sum rewards: 66.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.110', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.650', 'weapon3': '3.288', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '56.000'} [2024-08-06 05:20:51,984][52664] DAMAGECOUNT value on done: 647119.0 [2024-08-06 05:20:51,984][52664] Sum rewards: 64.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.126', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.094', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '54.000'} [2024-08-06 05:20:52,019][52659] DAMAGECOUNT value on done: 618362.0 [2024-08-06 05:20:52,021][52659] Sum rewards: 74.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.967', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.122', 'AMMO4': '0.161', 'weapon5': '0.180', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '63.000'} [2024-08-06 05:20:52,383][52650] Updated weights for policy 0, policy_version 60441 (0.0012) [2024-08-06 05:20:52,654][52803] DAMAGECOUNT value on done: 589820.0 [2024-08-06 05:20:52,655][52803] Sum rewards: 71.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.183', 'AMMO4': '0.200', 'weapon5': '0.214', 'weapon2': '0.288', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '58.000'} [2024-08-06 05:20:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17522.6). Total num frames: 495132672. Throughput: 0: 4366.2. Samples: 123786840. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 05:20:52,794][52567] Avg episode reward: [(0, '71.848')] [2024-08-06 05:20:53,030][52794] DAMAGECOUNT value on done: 613821.0 [2024-08-06 05:20:53,032][52794] Sum rewards: 62.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.768', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.050', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '52.000'} [2024-08-06 05:20:53,064][52667] DAMAGECOUNT value on done: 624404.0 [2024-08-06 05:20:53,065][52667] Sum rewards: 67.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.735', 'AMMO5': '0.025', 'AMMO2': '0.071', 'weapon4': '0.154', 'AMMO3': '0.237', 'weapon5': '0.264', 'weapon2': '0.266', 'AMMO4': '0.356', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '57.000'} [2024-08-06 05:20:54,656][52664] DAMAGECOUNT value on done: 638729.0 [2024-08-06 05:20:54,656][52664] Sum rewards: 61.673, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'weapon5': '0.014', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'weapon2': '0.766', 'WEAPON3': '0.950', 'weapon3': '3.062', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '48.000'} [2024-08-06 05:20:54,731][52659] DAMAGECOUNT value on done: 632162.0 [2024-08-06 05:20:54,733][52659] Sum rewards: 74.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.177', 'weapon4': '0.210', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '62.000'} [2024-08-06 05:20:55,169][52665] DAMAGECOUNT value on done: 618307.0 [2024-08-06 05:20:55,171][52665] Sum rewards: 77.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.200', 'AMMO3': '0.208', 'weapon5': '0.228', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '62.000'} [2024-08-06 05:20:55,704][52803] DAMAGECOUNT value on done: 577010.0 [2024-08-06 05:20:55,704][52803] Sum rewards: 97.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.705', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.224', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.462', 'HITCOUNT': '4.400', 'DAMAGECOUNT': '22.107', 'FRAGCOUNT': '81.000'} [2024-08-06 05:20:55,819][52794] DAMAGECOUNT value on done: 625668.0 [2024-08-06 05:20:55,820][52794] Sum rewards: 68.545, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.585', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.140', 'AMMO4': '0.170', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '55.000'} [2024-08-06 05:20:55,943][52667] DAMAGECOUNT value on done: 625834.0 [2024-08-06 05:20:55,944][52667] Sum rewards: 82.950, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.805', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.290', 'weapon2': '0.402', 'WEAPON3': '1.650', 'weapon3': '3.206', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '72.000'} [2024-08-06 05:20:57,195][52664] DAMAGECOUNT value on done: 647414.0 [2024-08-06 05:20:57,196][52664] Sum rewards: 60.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.134', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.110', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '51.000'} [2024-08-06 05:20:57,350][52650] Updated weights for policy 0, policy_version 60451 (0.0016) [2024-08-06 05:20:57,577][52659] DAMAGECOUNT value on done: 623616.0 [2024-08-06 05:20:57,578][52659] Sum rewards: 61.035, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.992', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon5': '0.224', 'weapon2': '0.252', 'weapon4': '0.280', 'AMMO3': '0.293', 'AMMO4': '0.337', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.876', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '56.000'} [2024-08-06 05:20:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 495222784. Throughput: 0: 4362.2. Samples: 123812670. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 05:20:57,795][52567] Avg episode reward: [(0, '71.929')] [2024-08-06 05:20:58,434][52665] DAMAGECOUNT value on done: 615193.0 [2024-08-06 05:20:58,434][52665] Sum rewards: 76.041, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.044', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.062', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon2': '0.588', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:58,699][52667] DAMAGECOUNT value on done: 629115.0 [2024-08-06 05:20:58,699][52667] Sum rewards: 59.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.313', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.176', 'AMMO3': '0.192', 'AMMO4': '0.226', 'weapon5': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '49.000'} [2024-08-06 05:20:58,861][52794] DAMAGECOUNT value on done: 618846.0 [2024-08-06 05:20:58,862][52794] Sum rewards: 74.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.022', 'AMMO2': '0.076', 'weapon4': '0.078', 'AMMO3': '0.227', 'weapon5': '0.278', 'weapon2': '0.360', 'AMMO4': '0.378', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '61.000'} [2024-08-06 05:20:58,903][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:20:58,903][52803] DAMAGECOUNT value on done: 574159.0 [2024-08-06 05:20:58,904][52803] Sum rewards: 82.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.166', 'AMMO3': '0.197', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '67.000'} [2024-08-06 05:21:00,090][52659] DAMAGECOUNT value on done: 629783.0 [2024-08-06 05:21:00,092][52659] Sum rewards: 59.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.140', 'weapon4': '0.142', 'AMMO3': '0.199', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.650', 'weapon3': '3.090', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '50.000'} [2024-08-06 05:21:00,207][52664] DAMAGECOUNT value on done: 643571.0 [2024-08-06 05:21:00,208][52664] Sum rewards: 77.012, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.710', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.090', 'AMMO3': '0.163', 'weapon5': '0.172', 'AMMO4': '0.173', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.268', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:01,501][52665] DAMAGECOUNT value on done: 613695.0 [2024-08-06 05:21:01,501][52665] Sum rewards: 90.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.352', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.154', 'weapon4': '0.160', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.976', 'FRAGCOUNT': '74.000'} [2024-08-06 05:21:01,792][52667] DAMAGECOUNT value on done: 632017.0 [2024-08-06 05:21:01,794][52667] Sum rewards: 68.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.942', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.030', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon4': '0.242', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '58.000'} [2024-08-06 05:21:01,822][52794] DAMAGECOUNT value on done: 617017.0 [2024-08-06 05:21:01,822][52794] Sum rewards: 67.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.192', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.241', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.498', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.500'} [2024-08-06 05:21:02,082][52803] DAMAGECOUNT value on done: 590180.0 [2024-08-06 05:21:02,083][52803] Sum rewards: 72.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.048', 'weapon4': '0.080', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.368', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:02,312][52650] Updated weights for policy 0, policy_version 60461 (0.0018) [2024-08-06 05:21:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 495304704. Throughput: 0: 4362.4. Samples: 123825890. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 05:21:02,794][52567] Avg episode reward: [(0, '71.959')] [2024-08-06 05:21:02,985][52664] DAMAGECOUNT value on done: 642331.0 [2024-08-06 05:21:02,986][52664] Sum rewards: 84.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.915', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.308', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '71.000'} [2024-08-06 05:21:03,209][52659] DAMAGECOUNT value on done: 620638.0 [2024-08-06 05:21:03,211][52659] Sum rewards: 69.099, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.370', 'AMMO5': '0.021', 'AMMO2': '0.060', 'AMMO3': '0.256', 'weapon5': '0.256', 'weapon4': '0.290', 'AMMO4': '0.300', 'weapon2': '0.398', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.692', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:03,868][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:21:04,469][52665] DAMAGECOUNT value on done: 612540.0 [2024-08-06 05:21:04,471][52665] Sum rewards: 60.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.152', 'weapon4': '0.184', 'AMMO4': '0.225', 'AMMO3': '0.251', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '54.000'} [2024-08-06 05:21:04,537][52667] DAMAGECOUNT value on done: 624881.0 [2024-08-06 05:21:04,538][52667] Sum rewards: 63.390, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.832', 'AMMO5': '0.026', 'AMMO2': '0.064', 'weapon4': '0.146', 'AMMO3': '0.243', 'weapon5': '0.258', 'AMMO4': '0.319', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '2.860', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:04,631][52660] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:21:05,040][52794] DAMAGECOUNT value on done: 621416.0 [2024-08-06 05:21:05,040][52794] Sum rewards: 79.665, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.506', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.132', 'weapon4': '0.140', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.220', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '68.000'} [2024-08-06 05:21:05,175][52803] DAMAGECOUNT value on done: 578993.0 [2024-08-06 05:21:05,180][52803] Sum rewards: 78.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.665', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.074', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.298', 'WEAPON3': '1.000', 'HITCOUNT': '3.420', 'weapon3': '3.454', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '62.500'} [2024-08-06 05:21:06,120][52664] DAMAGECOUNT value on done: 636614.0 [2024-08-06 05:21:06,121][52664] Sum rewards: 64.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.110', 'AMMO3': '0.181', 'weapon5': '0.202', 'AMMO4': '0.217', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.134', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '52.500'} [2024-08-06 05:21:06,342][52650] Updated weights for policy 0, policy_version 60471 (0.0012) [2024-08-06 05:21:06,360][52659] DAMAGECOUNT value on done: 626366.0 [2024-08-06 05:21:06,361][52659] Sum rewards: 74.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.882', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.072', 'AMMO3': '0.137', 'AMMO4': '0.175', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '0.850', 'weapon3': '2.958', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:07,378][52665] DAMAGECOUNT value on done: 613482.0 [2024-08-06 05:21:07,379][52665] Sum rewards: 66.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.465', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.066', 'AMMO3': '0.185', 'weapon5': '0.198', 'weapon2': '0.200', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.358', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '54.000'} [2024-08-06 05:21:07,424][52667] DAMAGECOUNT value on done: 623468.0 [2024-08-06 05:21:07,426][52667] Sum rewards: 80.763, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.190', 'WEAPON3': '1.150', 'weapon3': '3.526', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 05:21:07,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.8, 300 sec: 17467.1). Total num frames: 495386624. Throughput: 0: 4368.0. Samples: 123852170. Policy #0 lag: (min: 1.0, avg: 3.8, max: 7.0) [2024-08-06 05:21:07,802][52567] Avg episode reward: [(0, '72.360')] [2024-08-06 05:21:08,047][52803] DAMAGECOUNT value on done: 577566.0 [2024-08-06 05:21:08,048][52803] Sum rewards: 77.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.146', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '64.000'} [2024-08-06 05:21:08,122][52794] DAMAGECOUNT value on done: 615223.0 [2024-08-06 05:21:08,122][52794] Sum rewards: 65.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.440', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.138', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '52.000'} [2024-08-06 05:21:08,442][52664] DAMAGECOUNT value on done: 649215.0 [2024-08-06 05:21:08,443][52664] Sum rewards: 81.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.062', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '66.000'} [2024-08-06 05:21:09,362][52659] DAMAGECOUNT value on done: 621020.0 [2024-08-06 05:21:09,362][52659] Sum rewards: 68.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.831', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.088', 'weapon5': '0.192', 'AMMO3': '0.197', 'AMMO4': '0.226', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:10,221][52667] DAMAGECOUNT value on done: 626355.0 [2024-08-06 05:21:10,224][52667] Sum rewards: 63.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.094', 'weapon4': '0.110', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.265', 'weapon2': '0.384', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.214', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '52.000'} [2024-08-06 05:21:10,581][52665] DAMAGECOUNT value on done: 608910.0 [2024-08-06 05:21:10,581][52665] Sum rewards: 82.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.926', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.176', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.556', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '70.000'} [2024-08-06 05:21:10,623][52794] DAMAGECOUNT value on done: 635686.0 [2024-08-06 05:21:10,626][52794] Sum rewards: 71.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.106', 'AMMO4': '0.169', 'weapon5': '0.176', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.228', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:11,208][52664] DAMAGECOUNT value on done: 641650.0 [2024-08-06 05:21:11,208][52664] Sum rewards: 70.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.545', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.076', 'AMMO3': '0.145', 'AMMO4': '0.162', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.788', 'WEAPON3': '0.900', 'weapon3': '2.740', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '55.000'} [2024-08-06 05:21:11,235][52803] DAMAGECOUNT value on done: 580921.0 [2024-08-06 05:21:11,236][52803] Sum rewards: 60.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.679', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.110', 'AMMO4': '0.175', 'weapon5': '0.176', 'AMMO3': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.000', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '53.000'} [2024-08-06 05:21:11,592][52650] Updated weights for policy 0, policy_version 60481 (0.0030) [2024-08-06 05:21:11,694][52663] DAMAGECOUNT value on done: 632495.0 [2024-08-06 05:21:11,694][52663] Sum rewards: 76.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '63.000'} [2024-08-06 05:21:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 495484928. Throughput: 0: 4358.7. Samples: 123878390. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:12,794][52567] Avg episode reward: [(0, '72.901')] [2024-08-06 05:21:13,283][52667] DAMAGECOUNT value on done: 631227.0 [2024-08-06 05:21:13,285][52667] Sum rewards: 79.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.114', 'AMMO4': '0.128', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '67.000'} [2024-08-06 05:21:13,637][52665] DAMAGECOUNT value on done: 613597.0 [2024-08-06 05:21:13,639][52665] Sum rewards: 72.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.122', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.116', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:13,672][52794] DAMAGECOUNT value on done: 616991.0 [2024-08-06 05:21:13,674][52794] Sum rewards: 85.144, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'HEALTH': '0.230', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.182', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '68.000'} [2024-08-06 05:21:13,823][52664] DAMAGECOUNT value on done: 649596.0 [2024-08-06 05:21:13,825][52664] Sum rewards: 65.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.134', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.184', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.350', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '52.500'} [2024-08-06 05:21:14,269][52803] DAMAGECOUNT value on done: 583916.0 [2024-08-06 05:21:14,271][52803] Sum rewards: 74.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.124', 'AMMO3': '0.235', 'weapon5': '0.268', 'AMMO4': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:14,500][52663] DAMAGECOUNT value on done: 622594.0 [2024-08-06 05:21:14,501][52663] Sum rewards: 80.432, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.795', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.142', 'AMMO3': '0.170', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '63.000'} [2024-08-06 05:21:15,805][52650] Updated weights for policy 0, policy_version 60491 (0.0011) [2024-08-06 05:21:16,448][52667] DAMAGECOUNT value on done: 618251.0 [2024-08-06 05:21:16,448][52667] Sum rewards: 68.654, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon4': '0.170', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.864', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:16,604][52664] DAMAGECOUNT value on done: 648890.0 [2024-08-06 05:21:16,604][52664] Sum rewards: 91.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.297', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.218', 'WEAPON3': '1.200', 'weapon3': '3.404', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.189', 'FRAGCOUNT': '73.000'} [2024-08-06 05:21:16,750][52794] DAMAGECOUNT value on done: 630770.0 [2024-08-06 05:21:16,750][52794] Sum rewards: 79.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.136', 'weapon5': '0.152', 'AMMO4': '0.157', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '64.000'} [2024-08-06 05:21:16,790][52665] DAMAGECOUNT value on done: 615845.0 [2024-08-06 05:21:16,790][52665] Sum rewards: 70.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.158', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:16,983][52663] DAMAGECOUNT value on done: 611037.0 [2024-08-06 05:21:16,985][52663] Sum rewards: 62.093, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.255', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.160', 'weapon4': '0.182', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '51.000'} [2024-08-06 05:21:17,445][52803] DAMAGECOUNT value on done: 586887.0 [2024-08-06 05:21:17,445][52803] Sum rewards: 64.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.702', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.086', 'weapon4': '0.094', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2024-08-06 05:21:17,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 495566848. Throughput: 0: 4366.9. Samples: 123891370. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:17,795][52567] Avg episode reward: [(0, '73.000')] [2024-08-06 05:21:19,276][52667] DAMAGECOUNT value on done: 621545.0 [2024-08-06 05:21:19,276][52667] Sum rewards: 84.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.624', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.082', 'weapon4': '0.130', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '69.000'} [2024-08-06 05:21:19,359][52664] DAMAGECOUNT value on done: 651888.0 [2024-08-06 05:21:19,359][52664] Sum rewards: 81.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.809', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.098', 'AMMO3': '0.171', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.050', 'weapon3': '3.258', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '65.000'} [2024-08-06 05:21:20,051][52663] DAMAGECOUNT value on done: 620762.0 [2024-08-06 05:21:20,052][52663] Sum rewards: 71.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.033', 'AMMO5': '0.024', 'AMMO2': '0.081', 'weapon4': '0.198', 'AMMO3': '0.235', 'weapon5': '0.254', 'weapon2': '0.304', 'AMMO4': '0.403', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:20,090][52794] DAMAGECOUNT value on done: 622969.0 [2024-08-06 05:21:20,090][52794] Sum rewards: 77.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.682', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.112', 'AMMO4': '0.174', 'AMMO3': '0.210', 'weapon4': '0.216', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '64.000'} [2024-08-06 05:21:20,646][52650] Updated weights for policy 0, policy_version 60501 (0.0018) [2024-08-06 05:21:20,746][52803] DAMAGECOUNT value on done: 576266.0 [2024-08-06 05:21:20,747][52803] Sum rewards: 78.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.481', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.086', 'weapon4': '0.098', 'AMMO3': '0.179', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '65.000'} [2024-08-06 05:21:22,338][52664] DAMAGECOUNT value on done: 652078.0 [2024-08-06 05:21:22,340][52664] Sum rewards: 71.046, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.340', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.214', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2024-08-06 05:21:22,440][52667] DAMAGECOUNT value on done: 627634.0 [2024-08-06 05:21:22,442][52667] Sum rewards: 74.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'AMMO5': '0.006', 'weapon4': '0.044', 'AMMO2': '0.045', 'weapon5': '0.082', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:22,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 495648768. Throughput: 0: 4364.4. Samples: 123917600. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:22,795][52567] Avg episode reward: [(0, '73.333')] [2024-08-06 05:21:23,007][52663] DAMAGECOUNT value on done: 624023.0 [2024-08-06 05:21:23,008][52663] Sum rewards: 77.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.066', 'AMMO4': '0.136', 'weapon5': '0.138', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.838', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:23,297][52794] DAMAGECOUNT value on done: 631079.0 [2024-08-06 05:21:23,299][52794] Sum rewards: 80.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.144', 'AMMO3': '0.197', 'AMMO4': '0.257', 'weapon5': '0.264', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '64.000'} [2024-08-06 05:21:24,639][52664] DAMAGECOUNT value on done: 654849.0 [2024-08-06 05:21:24,639][52664] Sum rewards: 71.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.960', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.174', 'AMMO3': '0.197', 'weapon4': '0.232', 'AMMO4': '0.266', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '58.000'} [2024-08-06 05:21:25,079][52666] DAMAGECOUNT value on done: 622248.0 [2024-08-06 05:21:25,080][52666] Sum rewards: 71.551, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.591', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.084', 'AMMO4': '0.134', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '58.000'} [2024-08-06 05:21:25,570][52667] DAMAGECOUNT value on done: 617692.0 [2024-08-06 05:21:25,571][52667] Sum rewards: 69.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.738', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.072', 'weapon5': '0.118', 'AMMO4': '0.213', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:25,577][52650] Updated weights for policy 0, policy_version 60511 (0.0013) [2024-08-06 05:21:25,693][52663] DAMAGECOUNT value on done: 631432.0 [2024-08-06 05:21:25,695][52663] Sum rewards: 76.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.021', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.130', 'weapon5': '0.216', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON3': '0.850', 'weapon3': '2.828', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:25,871][52670] DAMAGECOUNT value on done: 613413.0 [2024-08-06 05:21:25,877][52670] Sum rewards: 73.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.654', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.074', 'weapon5': '0.170', 'AMMO4': '0.214', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:26,208][52794] DAMAGECOUNT value on done: 630936.0 [2024-08-06 05:21:26,209][52794] Sum rewards: 70.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.286', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.232', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:27,520][52664] DAMAGECOUNT value on done: 644036.0 [2024-08-06 05:21:27,521][52664] Sum rewards: 80.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.904', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO3': '0.158', 'weapon5': '0.158', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.000', 'weapon3': '3.104', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 05:21:27,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 495738880. Throughput: 0: 4364.2. Samples: 123943920. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:27,802][52567] Avg episode reward: [(0, '73.329')] [2024-08-06 05:21:28,058][52666] DAMAGECOUNT value on done: 624219.0 [2024-08-06 05:21:28,058][52666] Sum rewards: 73.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.164', 'AMMO3': '0.220', 'AMMO4': '0.242', 'weapon5': '0.266', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '61.000'} [2024-08-06 05:21:28,464][52667] DAMAGECOUNT value on done: 627778.0 [2024-08-06 05:21:28,464][52667] Sum rewards: 63.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.992', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.056', 'weapon5': '0.180', 'AMMO4': '0.246', 'AMMO3': '0.279', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '2.970', 'weapon3': '3.156', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:28,499][52663] DAMAGECOUNT value on done: 622452.0 [2024-08-06 05:21:28,499][52663] Sum rewards: 70.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon5': '0.160', 'AMMO3': '0.161', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '57.000'} [2024-08-06 05:21:28,884][52670] DAMAGECOUNT value on done: 623817.0 [2024-08-06 05:21:28,884][52670] Sum rewards: 78.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.050', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.130', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.316', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '66.000'} [2024-08-06 05:21:29,442][52794] DAMAGECOUNT value on done: 622849.0 [2024-08-06 05:21:29,442][52794] Sum rewards: 86.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.135', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.163', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '3.372', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '69.000'} [2024-08-06 05:21:30,293][52650] Updated weights for policy 0, policy_version 60521 (0.0018) [2024-08-06 05:21:30,370][52664] DAMAGECOUNT value on done: 641458.0 [2024-08-06 05:21:30,370][52664] Sum rewards: 78.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.075', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.278', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '63.000'} [2024-08-06 05:21:30,632][52666] DAMAGECOUNT value on done: 624223.0 [2024-08-06 05:21:30,634][52666] Sum rewards: 58.484, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.318', 'AMMO5': '0.009', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.092', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.234', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '48.000'} [2024-08-06 05:21:31,028][52667] DAMAGECOUNT value on done: 632739.0 [2024-08-06 05:21:31,029][52667] Sum rewards: 61.998, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'AMMO2': '0.038', 'HEALTH': '0.064', 'weapon5': '0.130', 'AMMO3': '0.163', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '0.900', 'weapon3': '2.888', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '48.000'} [2024-08-06 05:21:31,124][52614] Signal inference workers to stop experience collection... (11000 times) [2024-08-06 05:21:31,125][52614] Signal inference workers to resume experience collection... (11000 times) [2024-08-06 05:21:31,154][52650] InferenceWorker_p0-w0: stopping experience collection (11000 times) [2024-08-06 05:21:31,154][52650] InferenceWorker_p0-w0: resuming experience collection (11000 times) [2024-08-06 05:21:31,333][52670] DAMAGECOUNT value on done: 614109.0 [2024-08-06 05:21:31,333][52670] Sum rewards: 78.719, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.203', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.260', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:31,534][52663] DAMAGECOUNT value on done: 615574.0 [2024-08-06 05:21:31,534][52663] Sum rewards: 66.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.863', 'AMMO5': '0.027', 'AMMO2': '0.069', 'AMMO3': '0.244', 'weapon2': '0.326', 'weapon4': '0.328', 'weapon5': '0.342', 'AMMO4': '0.343', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.604', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '57.000'} [2024-08-06 05:21:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 495828992. Throughput: 0: 4370.4. Samples: 123957240. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:32,795][52567] Avg episode reward: [(0, '73.331')] [2024-08-06 05:21:33,231][52664] DAMAGECOUNT value on done: 646117.0 [2024-08-06 05:21:33,232][52664] Sum rewards: 78.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.415', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon5': '0.212', 'AMMO3': '0.216', 'AMMO4': '0.247', 'weapon4': '0.284', 'weapon2': '0.292', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '64.000'} [2024-08-06 05:21:33,460][52666] DAMAGECOUNT value on done: 624544.0 [2024-08-06 05:21:33,460][52666] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.460', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.062', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.302', 'AMMO3': '0.321', 'WEAPON3': '1.950', 'weapon3': '3.350', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 05:21:33,701][52663] DAMAGECOUNT value on done: 613867.0 [2024-08-06 05:21:33,701][52663] Sum rewards: 67.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.221', 'weapon4': '0.320', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '57.000'} [2024-08-06 05:21:33,706][52667] DAMAGECOUNT value on done: 630948.0 [2024-08-06 05:21:33,707][52667] Sum rewards: 73.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.146', 'AMMO4': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:34,304][52670] DAMAGECOUNT value on done: 609866.0 [2024-08-06 05:21:34,304][52670] Sum rewards: 70.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.088', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:34,805][52650] Updated weights for policy 0, policy_version 60531 (0.0012) [2024-08-06 05:21:35,733][52664] DAMAGECOUNT value on done: 646327.0 [2024-08-06 05:21:35,733][52664] Sum rewards: 68.305, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.022', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.138', 'AMMO4': '0.193', 'weapon5': '0.266', 'AMMO3': '0.293', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.894', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '61.000'} [2024-08-06 05:21:36,547][52666] DAMAGECOUNT value on done: 617830.0 [2024-08-06 05:21:36,549][52666] Sum rewards: 67.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.385', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.186', 'AMMO3': '0.224', 'AMMO4': '0.263', 'weapon4': '0.270', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.828', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '57.000'} [2024-08-06 05:21:36,626][52667] DAMAGECOUNT value on done: 631172.0 [2024-08-06 05:21:36,627][52667] Sum rewards: 70.354, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'weapon4': '0.044', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO3': '0.158', 'AMMO4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'HEALTH': '0.360', 'weapon2': '0.764', 'WEAPON3': '0.850', 'weapon3': '2.866', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:36,854][52663] DAMAGECOUNT value on done: 621700.0 [2024-08-06 05:21:36,858][52663] Sum rewards: 70.875, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.105', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.217', 'AMMO3': '0.279', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.040', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:37,378][52670] DAMAGECOUNT value on done: 624663.0 [2024-08-06 05:21:37,379][52670] Sum rewards: 61.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.286', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.186', 'AMMO3': '0.223', 'AMMO4': '0.239', 'weapon2': '0.246', 'weapon4': '0.294', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '2.936', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '54.000'} [2024-08-06 05:21:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 495919104. Throughput: 0: 4368.7. Samples: 123983430. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:37,794][52567] Avg episode reward: [(0, '72.933')] [2024-08-06 05:21:38,743][52664] DAMAGECOUNT value on done: 645549.0 [2024-08-06 05:21:38,743][52664] Sum rewards: 68.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.408', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO3': '0.138', 'AMMO4': '0.161', 'weapon5': '0.296', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '0.850', 'weapon3': '2.714', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '53.500'} [2024-08-06 05:21:39,280][52666] DAMAGECOUNT value on done: 616319.0 [2024-08-06 05:21:39,280][52666] Sum rewards: 79.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.056', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.138', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '66.000'} [2024-08-06 05:21:39,570][52663] DAMAGECOUNT value on done: 629907.0 [2024-08-06 05:21:39,571][52663] Sum rewards: 66.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.913', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.236', 'weapon2': '0.302', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.446', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '57.000'} [2024-08-06 05:21:39,631][52667] DAMAGECOUNT value on done: 625828.0 [2024-08-06 05:21:39,632][52667] Sum rewards: 82.083, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.343', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.124', 'AMMO3': '0.147', 'AMMO4': '0.169', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.428', 'WEAPON3': '0.850', 'weapon3': '2.872', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '64.000'} [2024-08-06 05:21:39,695][52650] Updated weights for policy 0, policy_version 60541 (0.0022) [2024-08-06 05:21:40,086][52670] DAMAGECOUNT value on done: 619938.0 [2024-08-06 05:21:40,086][52670] Sum rewards: 73.111, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.272', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '2.942', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 05:21:41,789][52666] DAMAGECOUNT value on done: 619546.0 [2024-08-06 05:21:41,793][52666] Sum rewards: 68.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.060', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.376', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:42,497][52667] DAMAGECOUNT value on done: 631696.0 [2024-08-06 05:21:42,501][52667] Sum rewards: 66.508, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.134', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.218', 'weapon4': '0.240', 'AMMO4': '0.244', 'AMMO3': '0.265', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.954', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 05:21:42,707][52670] DAMAGECOUNT value on done: 610173.0 [2024-08-06 05:21:42,708][52670] Sum rewards: 77.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.708', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.154', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.270', 'weapon2': '0.318', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '63.000'} [2024-08-06 05:21:42,735][52663] DAMAGECOUNT value on done: 618011.0 [2024-08-06 05:21:42,735][52663] Sum rewards: 79.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.268', 'weapon2': '0.296', 'WEAPON3': '1.700', 'weapon3': '3.424', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '68.000'} [2024-08-06 05:21:42,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 496001024. Throughput: 0: 4381.5. Samples: 124009840. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:42,802][52567] Avg episode reward: [(0, '72.622')] [2024-08-06 05:21:43,853][52650] Updated weights for policy 0, policy_version 60551 (0.0023) [2024-08-06 05:21:44,136][52669] DAMAGECOUNT value on done: 626287.0 [2024-08-06 05:21:44,136][52669] Sum rewards: 89.743, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.378', 'HEALTH': '0.652', 'WEAPON3': '0.950', 'weapon3': '3.414', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '71.000'} [2024-08-06 05:21:44,584][52666] DAMAGECOUNT value on done: 617339.0 [2024-08-06 05:21:44,585][52666] Sum rewards: 78.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.235', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.190', 'weapon2': '0.204', 'AMMO3': '0.233', 'AMMO4': '0.259', 'weapon4': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.930', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '65.000'} [2024-08-06 05:21:45,307][52670] DAMAGECOUNT value on done: 618500.0 [2024-08-06 05:21:45,309][52670] Sum rewards: 69.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.411', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:45,694][52663] DAMAGECOUNT value on done: 612110.0 [2024-08-06 05:21:45,694][52663] Sum rewards: 74.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.172', 'weapon4': '0.176', 'AMMO3': '0.186', 'AMMO4': '0.210', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:46,995][52669] DAMAGECOUNT value on done: 615390.0 [2024-08-06 05:21:46,996][52669] Sum rewards: 72.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.102', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.126', 'AMMO4': '0.206', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2024-08-06 05:21:47,193][52666] DAMAGECOUNT value on done: 620607.0 [2024-08-06 05:21:47,193][52666] Sum rewards: 76.126, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.103', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'weapon4': '0.202', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.268', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:47,650][52658] DAMAGECOUNT value on done: 627151.0 [2024-08-06 05:21:47,651][52658] Sum rewards: 89.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.943', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.180', 'AMMO3': '0.190', 'weapon4': '0.274', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '73.000'} [2024-08-06 05:21:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 496091136. Throughput: 0: 4378.9. Samples: 124022940. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:21:47,794][52567] Avg episode reward: [(0, '73.494')] [2024-08-06 05:21:47,954][52670] DAMAGECOUNT value on done: 615672.0 [2024-08-06 05:21:47,954][52670] Sum rewards: 79.150, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.146', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.183', 'weapon4': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '63.000'} [2024-08-06 05:21:48,739][52663] DAMAGECOUNT value on done: 617699.0 [2024-08-06 05:21:48,739][52663] Sum rewards: 75.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.204', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.183', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 05:21:49,028][52650] Updated weights for policy 0, policy_version 60561 (0.0024) [2024-08-06 05:21:50,031][52669] DAMAGECOUNT value on done: 628566.0 [2024-08-06 05:21:50,032][52669] Sum rewards: 87.751, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.480', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.094', 'weapon5': '0.166', 'AMMO4': '0.228', 'AMMO3': '0.266', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.184', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '75.000'} [2024-08-06 05:21:50,048][52666] DAMAGECOUNT value on done: 613946.0 [2024-08-06 05:21:50,048][52666] Sum rewards: 59.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.672', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.095', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '49.000'} [2024-08-06 05:21:50,398][52658] DAMAGECOUNT value on done: 622940.0 [2024-08-06 05:21:50,400][52658] Sum rewards: 70.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.874', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.068', 'weapon5': '0.098', 'AMMO4': '0.133', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:50,931][52670] DAMAGECOUNT value on done: 613211.0 [2024-08-06 05:21:50,932][52670] Sum rewards: 67.475, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.164', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.028', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.283', 'weapon2': '0.554', 'WEAPON3': '1.650', 'weapon3': '3.122', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.000'} [2024-08-06 05:21:51,316][52663] DAMAGECOUNT value on done: 613981.0 [2024-08-06 05:21:51,317][52663] Sum rewards: 77.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.185', 'weapon5': '0.228', 'weapon4': '0.302', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:52,421][52669] DAMAGECOUNT value on done: 625709.0 [2024-08-06 05:21:52,421][52669] Sum rewards: 71.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.131', 'weapon5': '0.156', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:52,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 496173056. Throughput: 0: 4369.1. Samples: 124048780. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:21:52,794][52567] Avg episode reward: [(0, '73.553')] [2024-08-06 05:21:52,935][52658] DAMAGECOUNT value on done: 628753.0 [2024-08-06 05:21:52,937][52658] Sum rewards: 70.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'weapon4': '0.064', 'weapon5': '0.078', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.332', 'WEAPON3': '1.600', 'weapon3': '3.324', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '61.000'} [2024-08-06 05:21:53,158][52666] DAMAGECOUNT value on done: 616035.0 [2024-08-06 05:21:53,158][52666] Sum rewards: 72.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.890', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.138', 'AMMO3': '0.207', 'weapon5': '0.250', 'AMMO4': '0.283', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '60.000'} [2024-08-06 05:21:53,648][52650] Updated weights for policy 0, policy_version 60571 (0.0020) [2024-08-06 05:21:53,810][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:21:54,011][52670] DAMAGECOUNT value on done: 622616.0 [2024-08-06 05:21:54,014][52670] Sum rewards: 69.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.905', 'AMMO5': '0.021', 'AMMO2': '0.072', 'AMMO3': '0.170', 'weapon5': '0.294', 'AMMO4': '0.360', 'weapon4': '0.372', 'WEAPON5': '0.600', 'weapon2': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '57.000'} [2024-08-06 05:21:54,191][52663] DAMAGECOUNT value on done: 626054.0 [2024-08-06 05:21:54,193][52663] Sum rewards: 72.142, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO3': '0.167', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.704', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '58.000'} [2024-08-06 05:21:54,789][52671] DAMAGECOUNT value on done: 627260.0 [2024-08-06 05:21:54,790][52671] Sum rewards: 74.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO3': '0.149', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.372', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:54,978][52669] DAMAGECOUNT value on done: 624612.0 [2024-08-06 05:21:54,978][52669] Sum rewards: 93.169, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.189', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.711', 'FRAGCOUNT': '74.000'} [2024-08-06 05:21:56,107][52666] DAMAGECOUNT value on done: 609552.0 [2024-08-06 05:21:56,108][52666] Sum rewards: 62.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.955', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO4': '0.182', 'weapon4': '0.228', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '53.000'} [2024-08-06 05:21:56,382][52658] DAMAGECOUNT value on done: 627595.0 [2024-08-06 05:21:56,382][52658] Sum rewards: 70.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.141', 'weapon5': '0.162', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.734', 'WEAPON3': '1.150', 'weapon3': '2.792', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '58.000'} [2024-08-06 05:21:56,798][52663] DAMAGECOUNT value on done: 619015.0 [2024-08-06 05:21:56,800][52663] Sum rewards: 84.200, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.289', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.185', 'AMMO4': '0.196', 'weapon5': '0.216', 'weapon4': '0.224', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '65.000'} [2024-08-06 05:21:57,011][52670] DAMAGECOUNT value on done: 608764.0 [2024-08-06 05:21:57,013][52670] Sum rewards: 77.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.998', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.194', 'AMMO3': '0.235', 'weapon2': '0.250', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.688', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '65.000'} [2024-08-06 05:21:57,630][52671] DAMAGECOUNT value on done: 631459.0 [2024-08-06 05:21:57,630][52671] Sum rewards: 65.381, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.162', 'AMMO3': '0.245', 'weapon2': '0.246', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '57.000'} [2024-08-06 05:21:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 496263168. Throughput: 0: 4370.2. Samples: 124075050. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:21:57,795][52567] Avg episode reward: [(0, '73.602')] [2024-08-06 05:21:58,017][52669] DAMAGECOUNT value on done: 629360.0 [2024-08-06 05:21:58,019][52669] Sum rewards: 69.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.195', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.098', 'weapon5': '0.162', 'AMMO4': '0.187', 'weapon2': '0.212', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.250', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '58.500'} [2024-08-06 05:21:58,385][52650] Updated weights for policy 0, policy_version 60581 (0.0012) [2024-08-06 05:21:59,268][52666] DAMAGECOUNT value on done: 624430.0 [2024-08-06 05:21:59,270][52666] Sum rewards: 75.880, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.392', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.162', 'AMMO3': '0.203', 'AMMO4': '0.229', 'weapon4': '0.272', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '62.000'} [2024-08-06 05:21:59,722][52658] DAMAGECOUNT value on done: 617261.0 [2024-08-06 05:21:59,723][52658] Sum rewards: 73.865, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.208', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.276', 'AMMO3': '0.349', 'WEAPON3': '2.100', 'weapon3': '3.398', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '68.000'} [2024-08-06 05:21:59,942][52663] DAMAGECOUNT value on done: 625486.0 [2024-08-06 05:21:59,942][52663] Sum rewards: 63.483, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.418', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.334', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '51.000'} [2024-08-06 05:21:59,979][52670] DAMAGECOUNT value on done: 617621.0 [2024-08-06 05:21:59,980][52670] Sum rewards: 82.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.709', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.228', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '68.000'} [2024-08-06 05:22:00,125][52671] DAMAGECOUNT value on done: 627609.0 [2024-08-06 05:22:00,125][52671] Sum rewards: 73.150, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.626', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.220', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:01,145][52669] DAMAGECOUNT value on done: 627054.0 [2024-08-06 05:22:01,146][52669] Sum rewards: 80.906, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.642', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.086', 'AMMO3': '0.238', 'AMMO4': '0.239', 'weapon5': '0.252', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '68.000'} [2024-08-06 05:22:01,921][52666] DAMAGECOUNT value on done: 617304.0 [2024-08-06 05:22:01,921][52666] Sum rewards: 73.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.225', 'weapon2': '0.282', 'weapon4': '0.282', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:02,496][52658] DAMAGECOUNT value on done: 621355.0 [2024-08-06 05:22:02,497][52658] Sum rewards: 64.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'weapon5': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.606', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '53.000'} [2024-08-06 05:22:02,610][52670] DAMAGECOUNT value on done: 623986.0 [2024-08-06 05:22:02,610][52670] Sum rewards: 65.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.241', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.126', 'AMMO4': '0.180', 'weapon5': '0.180', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.600', 'HITCOUNT': '2.900', 'weapon3': '3.120', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:02,795][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 496353280. Throughput: 0: 4376.2. Samples: 124088300. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:22:02,795][52567] Avg episode reward: [(0, '73.508')] [2024-08-06 05:22:02,859][52650] Updated weights for policy 0, policy_version 60591 (0.0015) [2024-08-06 05:22:02,954][52663] DAMAGECOUNT value on done: 627181.0 [2024-08-06 05:22:02,956][52663] Sum rewards: 72.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.559', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.100', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '60.500'} [2024-08-06 05:22:03,309][52671] DAMAGECOUNT value on done: 629080.0 [2024-08-06 05:22:03,313][52671] Sum rewards: 73.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.166', 'AMMO3': '0.220', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:04,113][52669] DAMAGECOUNT value on done: 624993.0 [2024-08-06 05:22:04,114][52669] Sum rewards: 65.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.048', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.248', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '55.000'} [2024-08-06 05:22:04,640][52666] DAMAGECOUNT value on done: 620113.0 [2024-08-06 05:22:04,642][52666] Sum rewards: 64.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.821', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.100', 'AMMO4': '0.165', 'weapon5': '0.212', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:05,445][52670] DAMAGECOUNT value on done: 620722.0 [2024-08-06 05:22:05,446][52670] Sum rewards: 75.498, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.173', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.176', 'AMMO3': '0.202', 'weapon5': '0.212', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:05,450][52658] DAMAGECOUNT value on done: 629486.0 [2024-08-06 05:22:05,450][52658] Sum rewards: 71.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.082', 'weapon5': '0.140', 'AMMO3': '0.231', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:05,620][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:22:06,174][52663] DAMAGECOUNT value on done: 618055.0 [2024-08-06 05:22:06,174][52663] Sum rewards: 69.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.595', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.080', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.368', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:06,361][52671] DAMAGECOUNT value on done: 638253.0 [2024-08-06 05:22:06,363][52671] Sum rewards: 87.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.197', 'weapon4': '0.302', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '69.000'} [2024-08-06 05:22:06,834][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:22:07,343][52666] DAMAGECOUNT value on done: 612210.0 [2024-08-06 05:22:07,343][52666] Sum rewards: 62.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.240', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.168', 'weapon2': '0.192', 'weapon5': '0.238', 'weapon4': '0.256', 'AMMO4': '0.263', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '3.020', 'weapon3': '3.064', 'DAMAGECOUNT': '14.466', 'FRAGCOUNT': '51.000'} [2024-08-06 05:22:07,358][52669] DAMAGECOUNT value on done: 633690.0 [2024-08-06 05:22:07,358][52669] Sum rewards: 76.888, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.212', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.196', 'weapon5': '0.254', 'weapon2': '0.262', 'AMMO4': '0.276', 'weapon4': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.750', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:07,641][52650] Updated weights for policy 0, policy_version 60601 (0.0026) [2024-08-06 05:22:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 496443392. Throughput: 0: 4374.2. Samples: 124114440. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:22:07,794][52567] Avg episode reward: [(0, '73.378')] [2024-08-06 05:22:08,116][52670] DAMAGECOUNT value on done: 604828.0 [2024-08-06 05:22:08,117][52670] Sum rewards: 79.884, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.675', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.155', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.314', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:08,240][52658] DAMAGECOUNT value on done: 619444.0 [2024-08-06 05:22:08,242][52658] Sum rewards: 74.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.298', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.177', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:09,134][52647] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2024-08-06 05:22:09,335][52671] DAMAGECOUNT value on done: 630422.0 [2024-08-06 05:22:09,336][52671] Sum rewards: 78.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.469', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.120', 'weapon5': '0.124', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '64.000'} [2024-08-06 05:22:09,403][52649] DAMAGECOUNT value on done: 602651.0 [2024-08-06 05:22:09,404][52649] Sum rewards: 67.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.074', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.356', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.262', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:09,953][52666] DAMAGECOUNT value on done: 619532.0 [2024-08-06 05:22:09,955][52666] Sum rewards: 71.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.227', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.404', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:10,586][52670] DAMAGECOUNT value on done: 616047.0 [2024-08-06 05:22:10,587][52670] Sum rewards: 73.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.792', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.197', 'weapon5': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:10,630][52669] DAMAGECOUNT value on done: 625175.0 [2024-08-06 05:22:10,630][52669] Sum rewards: 76.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO5': '0.009', 'weapon5': '0.022', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.155', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:11,560][52658] DAMAGECOUNT value on done: 638515.0 [2024-08-06 05:22:11,562][52658] Sum rewards: 76.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.603', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.122', 'weapon4': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:12,215][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:22:12,240][52671] DAMAGECOUNT value on done: 632741.0 [2024-08-06 05:22:12,241][52671] Sum rewards: 73.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.980', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.138', 'weapon4': '0.160', 'AMMO4': '0.197', 'AMMO3': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:12,316][52649] DAMAGECOUNT value on done: 597197.0 [2024-08-06 05:22:12,317][52649] Sum rewards: 73.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.282', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.122', 'weapon5': '0.128', 'weapon2': '0.190', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:12,452][52650] Updated weights for policy 0, policy_version 60611 (0.0043) [2024-08-06 05:22:12,483][52666] DAMAGECOUNT value on done: 627512.0 [2024-08-06 05:22:12,484][52666] Sum rewards: 72.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.096', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:12,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 496525312. Throughput: 0: 4376.2. Samples: 124140850. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:22:12,794][52567] Avg episode reward: [(0, '73.296')] [2024-08-06 05:22:13,274][52670] DAMAGECOUNT value on done: 624016.0 [2024-08-06 05:22:13,274][52670] Sum rewards: 71.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.518', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.164', 'AMMO3': '0.192', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '2.538', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:13,808][52658] DAMAGECOUNT value on done: 625156.0 [2024-08-06 05:22:13,810][52658] Sum rewards: 71.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.700', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.064', 'weapon5': '0.118', 'AMMO3': '0.179', 'AMMO4': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '58.000'} [2024-08-06 05:22:13,872][52669] DAMAGECOUNT value on done: 630650.0 [2024-08-06 05:22:13,873][52669] Sum rewards: 80.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.138', 'weapon4': '0.166', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '67.000'} [2024-08-06 05:22:14,408][52668] DAMAGECOUNT value on done: 623106.0 [2024-08-06 05:22:14,409][52668] Sum rewards: 68.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.015', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.151', 'AMMO3': '0.191', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '58.000'} [2024-08-06 05:22:15,209][52666] DAMAGECOUNT value on done: 607716.0 [2024-08-06 05:22:15,211][52666] Sum rewards: 63.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.575', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.068', 'WEAPON5': '0.150', 'weapon2': '0.160', 'WEAPON4': '0.250', 'AMMO3': '0.268', 'weapon4': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.070', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '56.500'} [2024-08-06 05:22:15,360][52671] DAMAGECOUNT value on done: 629814.0 [2024-08-06 05:22:15,360][52671] Sum rewards: 76.512, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.735', 'AMMO5': '0.017', 'AMMO2': '0.070', 'weapon4': '0.100', 'weapon5': '0.136', 'weapon2': '0.214', 'AMMO3': '0.264', 'AMMO4': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '67.000'} [2024-08-06 05:22:15,467][52649] DAMAGECOUNT value on done: 614969.0 [2024-08-06 05:22:15,469][52649] Sum rewards: 71.988, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.589', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon4': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:15,995][52670] DAMAGECOUNT value on done: 614210.0 [2024-08-06 05:22:15,996][52670] Sum rewards: 62.917, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.574', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO3': '0.170', 'AMMO4': '0.173', 'weapon5': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.972', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '50.000'} [2024-08-06 05:22:16,571][52658] DAMAGECOUNT value on done: 637971.0 [2024-08-06 05:22:16,571][52658] Sum rewards: 70.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.662', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.232', 'AMMO4': '0.241', 'weapon5': '0.262', 'weapon2': '0.304', 'weapon4': '0.424', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.732', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:17,100][52669] DAMAGECOUNT value on done: 632047.0 [2024-08-06 05:22:17,103][52669] Sum rewards: 72.460, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.206', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.177', 'weapon4': '0.182', 'WEAPON5': '0.250', 'AMMO3': '0.334', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.850', 'weapon3': '2.866', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '65.000'} [2024-08-06 05:22:17,119][52650] Updated weights for policy 0, policy_version 60621 (0.0028) [2024-08-06 05:22:17,259][52668] DAMAGECOUNT value on done: 628264.0 [2024-08-06 05:22:17,260][52668] Sum rewards: 76.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.126', 'AMMO4': '0.131', 'weapon5': '0.188', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '65.000'} [2024-08-06 05:22:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 496615424. Throughput: 0: 4372.0. Samples: 124153980. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:22:17,802][52567] Avg episode reward: [(0, '72.960')] [2024-08-06 05:22:17,856][52666] DAMAGECOUNT value on done: 617849.0 [2024-08-06 05:22:17,856][52666] Sum rewards: 68.433, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.918', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.028', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.170', 'weapon2': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.324', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 05:22:18,378][52671] DAMAGECOUNT value on done: 620519.0 [2024-08-06 05:22:18,379][52671] Sum rewards: 68.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.805', 'AMMO5': '0.021', 'AMMO2': '0.067', 'AMMO3': '0.230', 'weapon5': '0.248', 'weapon2': '0.318', 'AMMO4': '0.334', 'weapon4': '0.476', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.500', 'weapon3': '2.566', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:18,788][52670] DAMAGECOUNT value on done: 620265.0 [2024-08-06 05:22:18,789][52670] Sum rewards: 62.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.825', 'AMMO5': '0.025', 'AMMO2': '0.085', 'AMMO3': '0.222', 'weapon2': '0.286', 'weapon5': '0.306', 'weapon4': '0.414', 'AMMO4': '0.426', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '53.500'} [2024-08-06 05:22:18,916][52649] DAMAGECOUNT value on done: 611369.0 [2024-08-06 05:22:18,918][52649] Sum rewards: 73.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.086', 'AMMO4': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:19,017][52658] DAMAGECOUNT value on done: 622408.0 [2024-08-06 05:22:19,017][52658] Sum rewards: 73.518, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.530', 'AMMO5': '0.016', 'weapon4': '0.050', 'AMMO2': '0.051', 'weapon5': '0.152', 'AMMO4': '0.257', 'AMMO3': '0.258', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:19,801][52668] DAMAGECOUNT value on done: 626843.0 [2024-08-06 05:22:19,801][52668] Sum rewards: 74.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.874', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '64.000'} [2024-08-06 05:22:20,072][52669] DAMAGECOUNT value on done: 618683.0 [2024-08-06 05:22:20,072][52669] Sum rewards: 65.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.865', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.142', 'weapon5': '0.184', 'AMMO3': '0.195', 'AMMO4': '0.254', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.060', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '55.000'} [2024-08-06 05:22:21,216][52671] DAMAGECOUNT value on done: 627090.0 [2024-08-06 05:22:21,217][52671] Sum rewards: 69.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.174', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.168', 'AMMO3': '0.223', 'AMMO4': '0.223', 'weapon4': '0.346', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:21,693][52650] Updated weights for policy 0, policy_version 60631 (0.0014) [2024-08-06 05:22:21,935][52647] Large shaping reward 2.609 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.558, 186.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:22:22,053][52649] DAMAGECOUNT value on done: 599033.0 [2024-08-06 05:22:22,054][52649] Sum rewards: 66.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.876', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.164', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.314', 'WEAPON3': '1.100', 'weapon3': '2.878', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '55.000'} [2024-08-06 05:22:22,089][52658] DAMAGECOUNT value on done: 628581.0 [2024-08-06 05:22:22,089][52658] Sum rewards: 60.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.825', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.131', 'weapon2': '0.146', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'AMMO3': '0.207', 'weapon7': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.718', 'WEAPON3': '1.300', 'weapon3': '2.374', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '51.000'} [2024-08-06 05:22:22,533][52668] DAMAGECOUNT value on done: 628881.0 [2024-08-06 05:22:22,534][52668] Sum rewards: 66.487, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.246', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.020', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon2': '0.230', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'HITCOUNT': '3.390', 'weapon3': '3.550', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 496705536. Throughput: 0: 4374.4. Samples: 124180280. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:22:22,794][52567] Avg episode reward: [(0, '72.488')] [2024-08-06 05:22:23,085][52669] DAMAGECOUNT value on done: 623445.0 [2024-08-06 05:22:23,086][52669] Sum rewards: 73.684, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.349', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO3': '0.141', 'weapon4': '0.142', 'AMMO4': '0.160', 'weapon5': '0.192', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'HITCOUNT': '3.040', 'weapon3': '3.172', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '58.000'} [2024-08-06 05:22:23,402][52647] DAMAGECOUNT value on done: 662900.0 [2024-08-06 05:22:23,403][52647] Sum rewards: 76.926, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.792', 'AMMO5': '0.020', 'AMMO2': '0.029', 'AMMO3': '0.138', 'weapon4': '0.140', 'AMMO4': '0.145', 'weapon5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.932', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:24,416][52671] DAMAGECOUNT value on done: 631435.0 [2024-08-06 05:22:24,416][52671] Sum rewards: 73.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.421', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.147', 'AMMO4': '0.178', 'weapon5': '0.180', 'weapon4': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.786', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:24,446][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:22:24,701][52658] DAMAGECOUNT value on done: 620306.0 [2024-08-06 05:22:24,701][52658] Sum rewards: 85.743, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.670', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.060', 'weapon4': '0.074', 'AMMO4': '0.163', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.120', 'FRAGCOUNT': '72.000'} [2024-08-06 05:22:25,187][52649] DAMAGECOUNT value on done: 613898.0 [2024-08-06 05:22:25,189][52649] Sum rewards: 75.937, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.230', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.218', 'AMMO4': '0.251', 'weapon2': '0.254', 'AMMO3': '0.267', 'weapon5': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '64.000'} [2024-08-06 05:22:25,737][52647] DAMAGECOUNT value on done: 656533.0 [2024-08-06 05:22:25,737][52647] Sum rewards: 85.347, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'weapon4': '0.118', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.894', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '67.000'} [2024-08-06 05:22:25,862][52669] DAMAGECOUNT value on done: 627751.0 [2024-08-06 05:22:25,862][52669] Sum rewards: 78.878, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.181', 'weapon5': '0.196', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.364', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:26,126][52668] DAMAGECOUNT value on done: 615253.0 [2024-08-06 05:22:26,128][52668] Sum rewards: 69.572, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.175', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.126', 'weapon5': '0.128', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.166', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:26,190][52650] Updated weights for policy 0, policy_version 60641 (0.0019) [2024-08-06 05:22:27,548][52671] DAMAGECOUNT value on done: 626127.0 [2024-08-06 05:22:27,549][52671] Sum rewards: 87.016, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.184', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.038', 'weapon5': '0.042', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.586', 'FRAGCOUNT': '72.000'} [2024-08-06 05:22:27,572][52658] DAMAGECOUNT value on done: 627134.0 [2024-08-06 05:22:27,572][52658] Sum rewards: 79.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.742', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.180', 'AMMO4': '0.206', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '65.000'} [2024-08-06 05:22:27,722][52649] DAMAGECOUNT value on done: 606036.0 [2024-08-06 05:22:27,724][52649] Sum rewards: 72.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '58.500'} [2024-08-06 05:22:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 496787456. Throughput: 0: 4372.7. Samples: 124206610. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:22:27,794][52567] Avg episode reward: [(0, '73.275')] [2024-08-06 05:22:27,868][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060644_496795648.pth... [2024-08-06 05:22:28,012][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060132_492601344.pth [2024-08-06 05:22:28,729][52647] DAMAGECOUNT value on done: 659683.0 [2024-08-06 05:22:28,731][52647] Sum rewards: 94.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.454', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.136', 'weapon4': '0.142', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.558', 'FRAGCOUNT': '74.000'} [2024-08-06 05:22:28,774][52669] DAMAGECOUNT value on done: 645340.0 [2024-08-06 05:22:28,775][52669] Sum rewards: 65.859, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.128', 'AMMO4': '0.149', 'AMMO3': '0.195', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:29,304][52668] DAMAGECOUNT value on done: 632495.0 [2024-08-06 05:22:29,306][52668] Sum rewards: 73.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.375', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:29,925][52795] DAMAGECOUNT value on done: 580689.0 [2024-08-06 05:22:29,925][52795] Sum rewards: 78.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.545', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.168', 'AMMO3': '0.215', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.786', 'WEAPON3': '1.400', 'weapon3': '2.760', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '67.000'} [2024-08-06 05:22:30,194][52649] DAMAGECOUNT value on done: 610663.0 [2024-08-06 05:22:30,194][52649] Sum rewards: 79.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '68.000'} [2024-08-06 05:22:30,225][52671] DAMAGECOUNT value on done: 632276.0 [2024-08-06 05:22:30,225][52671] Sum rewards: 74.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.948', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.088', 'AMMO3': '0.157', 'weapon5': '0.170', 'AMMO4': '0.190', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.154', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:30,974][52658] DAMAGECOUNT value on done: 613913.0 [2024-08-06 05:22:30,974][52658] Sum rewards: 56.208, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.161', 'weapon4': '0.176', 'weapon2': '0.522', 'WEAPON3': '0.950', 'HITCOUNT': '2.930', 'weapon3': '3.142', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '45.000'} [2024-08-06 05:22:31,088][52650] Updated weights for policy 0, policy_version 60651 (0.0012) [2024-08-06 05:22:31,844][52647] DAMAGECOUNT value on done: 660669.0 [2024-08-06 05:22:31,846][52647] Sum rewards: 64.928, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.755', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.127', 'weapon5': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.560', 'weapon2': '0.562', 'WEAPON3': '0.850', 'weapon3': '2.516', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '50.000'} [2024-08-06 05:22:31,981][52662] DAMAGECOUNT value on done: 629514.0 [2024-08-06 05:22:31,981][52662] Sum rewards: 71.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.182', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.684', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:32,128][52669] DAMAGECOUNT value on done: 632903.0 [2024-08-06 05:22:32,128][52669] Sum rewards: 73.445, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.072', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.090', 'weapon5': '0.224', 'AMMO4': '0.253', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '2.906', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:32,238][52668] DAMAGECOUNT value on done: 628497.0 [2024-08-06 05:22:32,238][52668] Sum rewards: 65.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon2': '0.162', 'AMMO4': '0.194', 'weapon5': '0.206', 'AMMO3': '0.217', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 496877568. Throughput: 0: 4368.2. Samples: 124219510. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:22:32,794][52567] Avg episode reward: [(0, '73.138')] [2024-08-06 05:22:32,913][52649] DAMAGECOUNT value on done: 612348.0 [2024-08-06 05:22:32,916][52649] Sum rewards: 77.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.789', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO4': '0.169', 'weapon4': '0.198', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '64.000'} [2024-08-06 05:22:33,015][52795] DAMAGECOUNT value on done: 569252.0 [2024-08-06 05:22:33,016][52795] Sum rewards: 68.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.178', 'weapon2': '0.220', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.000'} [2024-08-06 05:22:33,179][52671] DAMAGECOUNT value on done: 628636.0 [2024-08-06 05:22:33,181][52671] Sum rewards: 75.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.023', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.092', 'weapon5': '0.136', 'AMMO4': '0.159', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:33,986][52658] DAMAGECOUNT value on done: 629603.0 [2024-08-06 05:22:33,986][52658] Sum rewards: 73.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.216', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.230', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:34,583][52647] DAMAGECOUNT value on done: 667325.0 [2024-08-06 05:22:34,584][52647] Sum rewards: 66.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.595', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.200', 'AMMO4': '0.212', 'weapon2': '0.218', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.414', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '53.000'} [2024-08-06 05:22:34,906][52668] DAMAGECOUNT value on done: 620167.0 [2024-08-06 05:22:34,908][52668] Sum rewards: 75.635, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.082', 'weapon5': '0.116', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:34,944][52662] DAMAGECOUNT value on done: 623921.0 [2024-08-06 05:22:34,944][52662] Sum rewards: 67.949, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.900', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.157', 'weapon5': '0.164', 'AMMO4': '0.244', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:35,180][52669] DAMAGECOUNT value on done: 630725.0 [2024-08-06 05:22:35,181][52669] Sum rewards: 60.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.180', 'weapon5': '0.188', 'AMMO3': '0.246', 'AMMO4': '0.261', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '53.000'} [2024-08-06 05:22:36,015][52671] DAMAGECOUNT value on done: 615401.0 [2024-08-06 05:22:36,016][52671] Sum rewards: 61.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.886', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.158', 'AMMO3': '0.161', 'AMMO4': '0.225', 'WEAPON5': '0.400', 'weapon2': '0.404', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '50.000'} [2024-08-06 05:22:36,026][52650] Updated weights for policy 0, policy_version 60661 (0.0010) [2024-08-06 05:22:36,073][52649] DAMAGECOUNT value on done: 604233.0 [2024-08-06 05:22:36,074][52649] Sum rewards: 72.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.980', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.130', 'weapon4': '0.168', 'AMMO4': '0.184', 'WEAPON5': '0.250', 'AMMO3': '0.305', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.850', 'weapon3': '3.004', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:36,096][52795] DAMAGECOUNT value on done: 568603.0 [2024-08-06 05:22:36,097][52795] Sum rewards: 84.468, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.690', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.174', 'weapon4': '0.232', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '72.000'} [2024-08-06 05:22:36,324][52658] DAMAGECOUNT value on done: 622266.0 [2024-08-06 05:22:36,325][52658] Sum rewards: 71.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.225', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.070', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:37,208][52647] DAMAGECOUNT value on done: 664497.0 [2024-08-06 05:22:37,208][52647] Sum rewards: 65.184, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.542', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.122', 'AMMO4': '0.155', 'AMMO3': '0.228', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.300', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 05:22:37,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 496975872. Throughput: 0: 4380.9. Samples: 124245920. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:22:37,794][52567] Avg episode reward: [(0, '72.576')] [2024-08-06 05:22:37,865][52668] DAMAGECOUNT value on done: 621752.0 [2024-08-06 05:22:37,867][52668] Sum rewards: 84.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'weapon3': '3.466', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.394', 'FRAGCOUNT': '72.000'} [2024-08-06 05:22:37,910][52662] DAMAGECOUNT value on done: 634598.0 [2024-08-06 05:22:37,912][52662] Sum rewards: 71.311, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.562', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.160', 'AMMO3': '0.224', 'weapon4': '0.242', 'AMMO4': '0.285', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:38,227][52669] DAMAGECOUNT value on done: 631504.0 [2024-08-06 05:22:38,227][52669] Sum rewards: 73.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.207', 'weapon4': '0.248', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:38,823][52671] DAMAGECOUNT value on done: 634831.0 [2024-08-06 05:22:38,824][52671] Sum rewards: 63.879, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.454', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO3': '0.104', 'AMMO4': '0.124', 'weapon5': '0.198', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.358', 'WEAPON3': '0.700', 'HITCOUNT': '2.800', 'weapon3': '3.020', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '47.500'} [2024-08-06 05:22:38,991][52649] DAMAGECOUNT value on done: 614701.0 [2024-08-06 05:22:38,991][52649] Sum rewards: 64.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.202', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.504', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '53.000'} [2024-08-06 05:22:39,096][52658] DAMAGECOUNT value on done: 622448.0 [2024-08-06 05:22:39,097][52658] Sum rewards: 61.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.480', 'AMMO5': '0.028', 'AMMO2': '0.067', 'AMMO3': '0.240', 'weapon2': '0.292', 'weapon5': '0.332', 'AMMO4': '0.335', 'weapon4': '0.508', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.426', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '53.000'} [2024-08-06 05:22:39,221][52795] DAMAGECOUNT value on done: 575821.0 [2024-08-06 05:22:39,222][52795] Sum rewards: 75.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.270', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.225', 'weapon4': '0.230', 'weapon5': '0.240', 'AMMO4': '0.268', 'weapon2': '0.296', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '63.500'} [2024-08-06 05:22:39,620][52647] DAMAGECOUNT value on done: 659755.0 [2024-08-06 05:22:39,622][52647] Sum rewards: 81.104, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.706', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.022', 'weapon5': '0.048', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.316', 'WEAPON3': '1.650', 'weapon3': '3.442', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '69.000'} [2024-08-06 05:22:40,296][52650] Updated weights for policy 0, policy_version 60671 (0.0028) [2024-08-06 05:22:40,409][52662] DAMAGECOUNT value on done: 619799.0 [2024-08-06 05:22:40,411][52662] Sum rewards: 75.618, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.220', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.170', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.598', 'WEAPON3': '1.700', 'weapon3': '2.894', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '65.000'} [2024-08-06 05:22:40,947][52668] DAMAGECOUNT value on done: 629591.0 [2024-08-06 05:22:40,949][52668] Sum rewards: 79.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.752', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.196', 'AMMO3': '0.204', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '64.500'} [2024-08-06 05:22:41,492][52669] DAMAGECOUNT value on done: 638709.0 [2024-08-06 05:22:41,492][52669] Sum rewards: 75.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.373', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.126', 'weapon4': '0.170', 'weapon2': '0.198', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:41,889][52671] DAMAGECOUNT value on done: 631022.0 [2024-08-06 05:22:41,889][52671] Sum rewards: 69.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.788', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.248', 'weapon2': '0.250', 'AMMO4': '0.262', 'AMMO3': '0.266', 'weapon5': '0.376', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.668', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:42,076][52649] DAMAGECOUNT value on done: 617225.0 [2024-08-06 05:22:42,076][52649] Sum rewards: 74.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.003', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.059', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.212', 'weapon2': '0.234', 'weapon4': '0.384', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:42,184][52658] DAMAGECOUNT value on done: 626396.0 [2024-08-06 05:22:42,186][52658] Sum rewards: 69.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.058', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.176', 'weapon4': '0.220', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '56.000'} [2024-08-06 05:22:42,284][52795] DAMAGECOUNT value on done: 572350.0 [2024-08-06 05:22:42,287][52795] Sum rewards: 62.838, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.142', 'weapon5': '0.170', 'AMMO4': '0.182', 'weapon2': '0.238', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:42,312][52647] DAMAGECOUNT value on done: 645891.0 [2024-08-06 05:22:42,312][52647] Sum rewards: 71.339, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.614', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.117', 'weapon5': '0.246', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.650', 'WEAPON3': '0.750', 'weapon3': '2.510', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:42,699][52662] DAMAGECOUNT value on done: 636711.0 [2024-08-06 05:22:42,700][52662] Sum rewards: 70.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.078', 'AMMO3': '0.165', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.350', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.010', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 497049600. Throughput: 0: 4376.9. Samples: 124272010. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:22:42,794][52567] Avg episode reward: [(0, '72.322')] [2024-08-06 05:22:43,279][52820] DAMAGECOUNT value on done: 577112.0 [2024-08-06 05:22:43,280][52820] Sum rewards: 74.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.697', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.166', 'weapon4': '0.184', 'AMMO3': '0.187', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:43,916][52668] DAMAGECOUNT value on done: 626420.0 [2024-08-06 05:22:43,924][52668] Sum rewards: 68.632, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.475', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.159', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:44,849][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:22:45,113][52671] DAMAGECOUNT value on done: 632063.0 [2024-08-06 05:22:45,114][52671] Sum rewards: 74.814, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.152', 'weapon5': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.050', 'weapon3': '3.274', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:45,137][52647] DAMAGECOUNT value on done: 660471.0 [2024-08-06 05:22:45,138][52647] Sum rewards: 69.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.025', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.106', 'weapon5': '0.130', 'AMMO4': '0.205', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.000'} [2024-08-06 05:22:45,306][52650] Updated weights for policy 0, policy_version 60681 (0.0011) [2024-08-06 05:22:45,351][52649] DAMAGECOUNT value on done: 616089.0 [2024-08-06 05:22:45,353][52649] Sum rewards: 72.540, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.406', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.102', 'weapon5': '0.118', 'AMMO3': '0.267', 'AMMO4': '0.268', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:45,564][52795] DAMAGECOUNT value on done: 583652.0 [2024-08-06 05:22:45,566][52795] Sum rewards: 63.120, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.051', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.244', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.512', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '52.000'} [2024-08-06 05:22:45,642][52662] DAMAGECOUNT value on done: 619665.0 [2024-08-06 05:22:45,643][52662] Sum rewards: 74.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.232', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.180', 'weapon4': '0.220', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.652', 'WEAPON3': '1.650', 'weapon3': '2.630', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:46,469][52820] DAMAGECOUNT value on done: 580040.0 [2024-08-06 05:22:46,470][52820] Sum rewards: 79.688, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.048', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.814', 'WEAPON3': '1.050', 'weapon3': '2.922', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:46,669][52660] DAMAGECOUNT value on done: 625205.0 [2024-08-06 05:22:46,671][52660] Sum rewards: 68.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.280', 'AMMO5': '0.025', 'AMMO2': '0.055', 'weapon5': '0.226', 'AMMO4': '0.276', 'AMMO3': '0.278', 'weapon4': '0.342', 'weapon2': '0.378', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.712', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:46,868][52668] DAMAGECOUNT value on done: 616963.0 [2024-08-06 05:22:46,869][52668] Sum rewards: 75.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.090', 'weapon5': '0.160', 'AMMO3': '0.183', 'AMMO4': '0.189', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:47,620][52647] DAMAGECOUNT value on done: 658960.0 [2024-08-06 05:22:47,621][52647] Sum rewards: 85.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.228', 'weapon2': '0.244', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.024', 'FRAGCOUNT': '71.000'} [2024-08-06 05:22:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 497139712. Throughput: 0: 4375.4. Samples: 124285190. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:22:47,794][52567] Avg episode reward: [(0, '72.581')] [2024-08-06 05:22:48,015][52671] DAMAGECOUNT value on done: 630795.0 [2024-08-06 05:22:48,015][52671] Sum rewards: 68.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.098', 'AMMO3': '0.196', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.450', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '59.000'} [2024-08-06 05:22:48,442][52662] DAMAGECOUNT value on done: 630169.0 [2024-08-06 05:22:48,443][52662] Sum rewards: 54.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.376', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.168', 'AMMO4': '0.174', 'weapon5': '0.182', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '48.000'} [2024-08-06 05:22:48,464][52649] DAMAGECOUNT value on done: 615114.0 [2024-08-06 05:22:48,466][52649] Sum rewards: 76.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.450', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.207', 'weapon5': '0.218', 'weapon4': '0.316', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:48,668][52795] DAMAGECOUNT value on done: 587575.0 [2024-08-06 05:22:48,668][52795] Sum rewards: 72.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.244', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.229', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:49,196][52660] DAMAGECOUNT value on done: 615085.0 [2024-08-06 05:22:49,197][52660] Sum rewards: 59.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.957', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.106', 'AMMO4': '0.180', 'weapon5': '0.242', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '2.882', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '52.000'} [2024-08-06 05:22:49,391][52650] Updated weights for policy 0, policy_version 60691 (0.0029) [2024-08-06 05:22:49,556][52668] DAMAGECOUNT value on done: 609955.0 [2024-08-06 05:22:49,556][52668] Sum rewards: 81.782, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.046', 'weapon5': '0.060', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '69.000'} [2024-08-06 05:22:49,684][52820] DAMAGECOUNT value on done: 581201.0 [2024-08-06 05:22:49,684][52820] Sum rewards: 61.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.177', 'weapon2': '0.994', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '49.000'} [2024-08-06 05:22:50,364][52647] DAMAGECOUNT value on done: 656662.0 [2024-08-06 05:22:50,365][52647] Sum rewards: 84.447, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.097', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '70.000'} [2024-08-06 05:22:50,885][52662] DAMAGECOUNT value on done: 632380.0 [2024-08-06 05:22:50,887][52662] Sum rewards: 59.551, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.205', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.092', 'weapon4': '0.098', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.000', 'HITCOUNT': '2.520', 'weapon3': '3.390', 'DAMAGECOUNT': '12.516', 'FRAGCOUNT': '50.000'} [2024-08-06 05:22:50,926][52671] DAMAGECOUNT value on done: 627230.0 [2024-08-06 05:22:50,927][52671] Sum rewards: 67.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.136', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '54.000'} [2024-08-06 05:22:51,322][52649] DAMAGECOUNT value on done: 603094.0 [2024-08-06 05:22:51,322][52649] Sum rewards: 51.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.949', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon4': '0.096', 'AMMO3': '0.159', 'AMMO4': '0.206', 'weapon5': '0.302', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.220', 'weapon3': '3.054', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '41.000'} [2024-08-06 05:22:51,842][52795] DAMAGECOUNT value on done: 577562.0 [2024-08-06 05:22:51,843][52795] Sum rewards: 74.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.750', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.141', 'weapon4': '0.190', 'weapon2': '0.258', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.138', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '65.000'} [2024-08-06 05:22:51,858][52660] DAMAGECOUNT value on done: 628925.0 [2024-08-06 05:22:51,858][52660] Sum rewards: 67.269, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.814', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon4': '0.092', 'weapon5': '0.172', 'AMMO3': '0.240', 'AMMO4': '0.247', 'weapon2': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '58.500'} [2024-08-06 05:22:52,178][52668] DAMAGECOUNT value on done: 611747.0 [2024-08-06 05:22:52,178][52668] Sum rewards: 82.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.119', 'weapon5': '0.128', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '67.000'} [2024-08-06 05:22:52,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 497238016. Throughput: 0: 4377.1. Samples: 124311410. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:22:52,794][52567] Avg episode reward: [(0, '71.804')] [2024-08-06 05:22:52,904][52820] DAMAGECOUNT value on done: 572854.0 [2024-08-06 05:22:52,906][52820] Sum rewards: 60.341, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.362', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.122', 'weapon5': '0.146', 'AMMO3': '0.175', 'AMMO4': '0.175', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '50.000'} [2024-08-06 05:22:53,253][52647] DAMAGECOUNT value on done: 651883.0 [2024-08-06 05:22:53,254][52647] Sum rewards: 80.671, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.954', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.104', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '67.000'} [2024-08-06 05:22:54,019][52662] DAMAGECOUNT value on done: 626050.0 [2024-08-06 05:22:54,021][52662] Sum rewards: 88.741, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.578', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.032', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.937', 'FRAGCOUNT': '71.000'} [2024-08-06 05:22:54,456][52649] DAMAGECOUNT value on done: 610749.0 [2024-08-06 05:22:54,459][52649] Sum rewards: 68.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon2': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.220', 'weapon5': '0.262', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.864', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:54,488][52660] DAMAGECOUNT value on done: 633532.0 [2024-08-06 05:22:54,488][52660] Sum rewards: 71.314, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.422', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.090', 'AMMO4': '0.146', 'weapon5': '0.160', 'weapon2': '0.208', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '61.000'} [2024-08-06 05:22:54,699][52668] DAMAGECOUNT value on done: 615664.0 [2024-08-06 05:22:54,701][52668] Sum rewards: 71.775, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.100', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.168', 'weapon2': '0.178', 'WEAPON3': '1.000', 'HITCOUNT': '3.480', 'weapon3': '3.582', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:54,733][52650] Updated weights for policy 0, policy_version 60701 (0.0024) [2024-08-06 05:22:54,932][52795] DAMAGECOUNT value on done: 573543.0 [2024-08-06 05:22:54,934][52795] Sum rewards: 77.968, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.414', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.266', 'AMMO3': '0.299', 'WEAPON3': '1.700', 'weapon3': '3.132', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '69.000'} [2024-08-06 05:22:55,762][52647] DAMAGECOUNT value on done: 666085.0 [2024-08-06 05:22:55,764][52647] Sum rewards: 82.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.877', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO4': '0.157', 'weapon2': '0.162', 'weapon5': '0.168', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.340', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.000'} [2024-08-06 05:22:56,172][52820] DAMAGECOUNT value on done: 582050.0 [2024-08-06 05:22:56,173][52820] Sum rewards: 69.727, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.176', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.700', 'weapon3': '3.024', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.000'} [2024-08-06 05:22:56,977][52662] DAMAGECOUNT value on done: 635734.0 [2024-08-06 05:22:56,978][52662] Sum rewards: 70.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.672', 'WEAPON1': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.047', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO3': '0.230', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:57,143][52660] DAMAGECOUNT value on done: 621469.0 [2024-08-06 05:22:57,144][52660] Sum rewards: 67.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.307', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon4': '0.218', 'AMMO3': '0.223', 'weapon5': '0.248', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '56.000'} [2024-08-06 05:22:57,520][52668] DAMAGECOUNT value on done: 623061.0 [2024-08-06 05:22:57,520][52668] Sum rewards: 59.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.955', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.174', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.274', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '48.000'} [2024-08-06 05:22:57,534][52649] DAMAGECOUNT value on done: 603096.0 [2024-08-06 05:22:57,534][52649] Sum rewards: 73.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.117', 'AMMO3': '0.187', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '58.000'} [2024-08-06 05:22:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 497311744. Throughput: 0: 4366.0. Samples: 124337320. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:22:57,794][52567] Avg episode reward: [(0, '71.943')] [2024-08-06 05:22:58,104][52795] DAMAGECOUNT value on done: 582962.0 [2024-08-06 05:22:58,105][52795] Sum rewards: 69.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.146', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '57.000'} [2024-08-06 05:22:58,276][52647] DAMAGECOUNT value on done: 655558.0 [2024-08-06 05:22:58,276][52647] Sum rewards: 64.926, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.508', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.242', 'AMMO3': '0.345', 'WEAPON3': '2.050', 'HITCOUNT': '3.290', 'weapon3': '3.400', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '60.000'} [2024-08-06 05:22:58,874][52650] Updated weights for policy 0, policy_version 60711 (0.0027) [2024-08-06 05:22:59,392][52820] DAMAGECOUNT value on done: 573565.0 [2024-08-06 05:22:59,393][52820] Sum rewards: 75.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.868', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.227', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 05:22:59,780][52662] DAMAGECOUNT value on done: 622098.0 [2024-08-06 05:22:59,782][52662] Sum rewards: 72.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.136', 'weapon5': '0.212', 'AMMO3': '0.222', 'AMMO4': '0.258', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '58.500'} [2024-08-06 05:23:00,453][52660] DAMAGECOUNT value on done: 619246.0 [2024-08-06 05:23:00,453][52660] Sum rewards: 70.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.882', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.180', 'weapon5': '0.180', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:00,518][52647] DAMAGECOUNT value on done: 663528.0 [2024-08-06 05:23:00,519][52647] Sum rewards: 71.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.460', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.124', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:00,597][52668] DAMAGECOUNT value on done: 624759.0 [2024-08-06 05:23:00,600][52668] Sum rewards: 75.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.228', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '61.000'} [2024-08-06 05:23:00,759][52649] DAMAGECOUNT value on done: 615413.0 [2024-08-06 05:23:00,759][52649] Sum rewards: 85.422, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.194', 'AMMO3': '0.221', 'AMMO4': '0.237', 'weapon2': '0.286', 'weapon4': '0.326', 'HEALTH': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '69.000'} [2024-08-06 05:23:01,243][52795] DAMAGECOUNT value on done: 579352.0 [2024-08-06 05:23:01,244][52795] Sum rewards: 74.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.006', 'AMMO2': '0.047', 'weapon5': '0.070', 'weapon2': '0.156', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.430', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:02,464][52820] DAMAGECOUNT value on done: 580180.0 [2024-08-06 05:23:02,464][52820] Sum rewards: 74.044, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.322', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:02,787][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:23:02,794][52567] Fps is (10 sec: 15564.7, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 497393664. Throughput: 0: 4362.2. Samples: 124350280. Policy #0 lag: (min: 0.0, avg: 4.9, max: 10.0) [2024-08-06 05:23:02,794][52567] Avg episode reward: [(0, '72.469')] [2024-08-06 05:23:02,909][52647] DAMAGECOUNT value on done: 663675.0 [2024-08-06 05:23:02,909][52647] Sum rewards: 65.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.945', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'weapon4': '0.142', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:02,918][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:23:02,977][52662] DAMAGECOUNT value on done: 625093.0 [2024-08-06 05:23:02,980][52662] Sum rewards: 75.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.912', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.248', 'WEAPON3': '1.050', 'HITCOUNT': '3.330', 'weapon3': '3.490', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:03,128][52660] DAMAGECOUNT value on done: 619824.0 [2024-08-06 05:23:03,129][52660] Sum rewards: 60.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon7': '0.076', 'weapon5': '0.120', 'AMMO3': '0.151', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO4': '0.307', 'WEAPON5': '0.400', 'weapon2': '0.488', 'weapon4': '0.530', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.362', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.556', 'FRAGCOUNT': '48.000'} [2024-08-06 05:23:03,416][52668] DAMAGECOUNT value on done: 623085.0 [2024-08-06 05:23:03,416][52668] Sum rewards: 74.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.285', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.153', 'AMMO3': '0.235', 'weapon5': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.616', 'WEAPON3': '1.450', 'weapon3': '2.756', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:03,879][52650] Updated weights for policy 0, policy_version 60721 (0.0031) [2024-08-06 05:23:03,935][52649] DAMAGECOUNT value on done: 613793.0 [2024-08-06 05:23:03,937][52649] Sum rewards: 68.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.172', 'AMMO3': '0.190', 'AMMO4': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.496', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:04,391][52795] DAMAGECOUNT value on done: 574404.0 [2024-08-06 05:23:04,393][52795] Sum rewards: 68.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.150', 'AMMO4': '0.187', 'weapon4': '0.208', 'weapon5': '0.216', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:04,502][52665] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:23:05,531][52662] DAMAGECOUNT value on done: 622182.0 [2024-08-06 05:23:05,532][52662] Sum rewards: 70.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.198', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.154', 'weapon4': '0.168', 'AMMO4': '0.182', 'AMMO3': '0.220', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:05,649][52666] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.075, -25.0), ('weapon5', 0.002)] [2024-08-06 05:23:05,702][52820] DAMAGECOUNT value on done: 582729.0 [2024-08-06 05:23:05,703][52820] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.166', 'AMMO4': '0.172', 'AMMO3': '0.187', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '58.000'} [2024-08-06 05:23:05,861][52647] DAMAGECOUNT value on done: 646963.0 [2024-08-06 05:23:05,861][52647] Sum rewards: 55.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.571', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'weapon4': '0.262', 'weapon2': '0.480', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.932', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '46.000'} [2024-08-06 05:23:05,884][52660] DAMAGECOUNT value on done: 629787.0 [2024-08-06 05:23:05,884][52660] Sum rewards: 73.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.850', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO3': '0.165', 'AMMO4': '0.167', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'weapon4': '0.326', 'WEAPON3': '1.000', 'weapon3': '2.992', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:06,068][52668] DAMAGECOUNT value on done: 629589.0 [2024-08-06 05:23:06,068][52668] Sum rewards: 77.359, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.268', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.140', 'weapon5': '0.156', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '66.000'} [2024-08-06 05:23:07,264][52649] DAMAGECOUNT value on done: 610641.0 [2024-08-06 05:23:07,264][52649] Sum rewards: 84.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.644', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.448', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '72.000'} [2024-08-06 05:23:07,665][52795] DAMAGECOUNT value on done: 573165.0 [2024-08-06 05:23:07,665][52795] Sum rewards: 69.659, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.238', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.156', 'weapon2': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '3.070', 'weapon3': '3.196', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 497491968. Throughput: 0: 4358.2. Samples: 124376400. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 05:23:07,794][52567] Avg episode reward: [(0, '71.402')] [2024-08-06 05:23:07,955][52662] DAMAGECOUNT value on done: 631366.0 [2024-08-06 05:23:07,957][52662] Sum rewards: 78.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'AMMO5': '0.007', 'weapon5': '0.012', 'weapon4': '0.016', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.205', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:08,235][52660] DAMAGECOUNT value on done: 620396.0 [2024-08-06 05:23:08,235][52660] Sum rewards: 66.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.960', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon4': '0.180', 'weapon5': '0.204', 'weapon2': '0.210', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.098', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:08,354][52668] DAMAGECOUNT value on done: 625814.0 [2024-08-06 05:23:08,356][52668] Sum rewards: 70.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.016', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.130', 'AMMO4': '0.135', 'weapon5': '0.136', 'weapon2': '0.154', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.376', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2024-08-06 05:23:08,524][52650] Updated weights for policy 0, policy_version 60731 (0.0013) [2024-08-06 05:23:08,757][52820] DAMAGECOUNT value on done: 578182.0 [2024-08-06 05:23:08,760][52820] Sum rewards: 88.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon2': '0.156', 'AMMO4': '0.160', 'AMMO3': '0.175', 'weapon5': '0.230', 'weapon4': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '71.000'} [2024-08-06 05:23:08,764][52647] DAMAGECOUNT value on done: 655626.0 [2024-08-06 05:23:08,764][52647] Sum rewards: 79.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.182', 'weapon2': '0.196', 'AMMO3': '0.198', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:10,587][52660] DAMAGECOUNT value on done: 621964.0 [2024-08-06 05:23:10,592][52660] Sum rewards: 68.169, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.371', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.091', 'weapon5': '0.126', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.110', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:10,657][52662] DAMAGECOUNT value on done: 623004.0 [2024-08-06 05:23:10,658][52662] Sum rewards: 72.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.142', 'AMMO3': '0.197', 'weapon2': '0.830', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:10,848][52795] DAMAGECOUNT value on done: 580551.0 [2024-08-06 05:23:10,849][52795] Sum rewards: 81.509, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.638', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.112', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'weapon2': '0.322', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '2.944', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '71.000'} [2024-08-06 05:23:11,892][52820] DAMAGECOUNT value on done: 584984.0 [2024-08-06 05:23:11,893][52820] Sum rewards: 78.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.147', 'weapon2': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon4': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:11,954][52647] DAMAGECOUNT value on done: 646147.0 [2024-08-06 05:23:11,954][52647] Sum rewards: 81.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.114', 'weapon5': '0.130', 'AMMO4': '0.215', 'AMMO3': '0.241', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '69.000'} [2024-08-06 05:23:12,063][52811] DAMAGECOUNT value on done: 597038.0 [2024-08-06 05:23:12,064][52811] Sum rewards: 72.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.123', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.162', 'weapon5': '0.172', 'AMMO4': '0.188', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:12,794][52567] Fps is (10 sec: 18841.3, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 497582080. Throughput: 0: 4363.1. Samples: 124402950. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 05:23:12,795][52567] Avg episode reward: [(0, '71.931')] [2024-08-06 05:23:13,066][52662] DAMAGECOUNT value on done: 636568.0 [2024-08-06 05:23:13,067][52662] Sum rewards: 67.404, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.056', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.300', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '55.000'} [2024-08-06 05:23:13,300][52660] DAMAGECOUNT value on done: 627584.0 [2024-08-06 05:23:13,300][52660] Sum rewards: 41.276, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.395', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.142', 'weapon2': '0.164', 'weapon5': '0.172', 'AMMO4': '0.195', 'WEAPON7': '0.200', 'weapon7': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.850', 'weapon4': '1.106', 'HITCOUNT': '1.790', 'weapon3': '1.936', 'DAMAGECOUNT': '9.801', 'FRAGCOUNT': '34.000'} [2024-08-06 05:23:13,407][52650] Updated weights for policy 0, policy_version 60741 (0.0012) [2024-08-06 05:23:14,155][52795] DAMAGECOUNT value on done: 567479.0 [2024-08-06 05:23:14,155][52795] Sum rewards: 57.429, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.225', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.118', 'AMMO3': '0.153', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '0.950', 'HITCOUNT': '2.700', 'weapon3': '2.952', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '47.000'} [2024-08-06 05:23:14,328][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:23:14,987][52647] DAMAGECOUNT value on done: 651633.0 [2024-08-06 05:23:14,987][52647] Sum rewards: 78.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.148', 'weapon4': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '64.000'} [2024-08-06 05:23:15,111][52811] DAMAGECOUNT value on done: 579131.0 [2024-08-06 05:23:15,112][52811] Sum rewards: 87.175, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.538', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '74.500'} [2024-08-06 05:23:15,164][52820] DAMAGECOUNT value on done: 576128.0 [2024-08-06 05:23:15,167][52820] Sum rewards: 79.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.136', 'weapon4': '0.168', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '64.000'} [2024-08-06 05:23:15,647][52662] DAMAGECOUNT value on done: 629636.0 [2024-08-06 05:23:15,654][52662] Sum rewards: 79.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.116', 'weapon2': '0.194', 'AMMO4': '0.216', 'AMMO3': '0.220', 'weapon5': '0.230', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '66.000'} [2024-08-06 05:23:15,995][52660] DAMAGECOUNT value on done: 620504.0 [2024-08-06 05:23:15,996][52660] Sum rewards: 70.826, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '57.000'} [2024-08-06 05:23:17,416][52795] DAMAGECOUNT value on done: 585331.0 [2024-08-06 05:23:17,419][52795] Sum rewards: 77.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.310', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:17,578][52614] Signal inference workers to stop experience collection... (11050 times) [2024-08-06 05:23:17,584][52614] Signal inference workers to resume experience collection... (11050 times) [2024-08-06 05:23:17,629][52650] InferenceWorker_p0-w0: stopping experience collection (11050 times) [2024-08-06 05:23:17,629][52650] InferenceWorker_p0-w0: resuming experience collection (11050 times) [2024-08-06 05:23:17,674][52650] Updated weights for policy 0, policy_version 60751 (0.0013) [2024-08-06 05:23:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 497672192. Throughput: 0: 4364.0. Samples: 124415890. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 05:23:17,795][52567] Avg episode reward: [(0, '71.942')] [2024-08-06 05:23:18,263][52811] DAMAGECOUNT value on done: 578511.0 [2024-08-06 05:23:18,264][52811] Sum rewards: 77.618, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.495', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.146', 'weapon5': '0.178', 'AMMO4': '0.210', 'AMMO3': '0.268', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '69.000'} [2024-08-06 05:23:18,410][52820] DAMAGECOUNT value on done: 581841.0 [2024-08-06 05:23:18,412][52820] Sum rewards: 91.889, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.602', 'HEALTH': '0.805', 'WEAPON3': '0.900', 'weapon3': '3.156', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '73.000'} [2024-08-06 05:23:18,853][52662] DAMAGECOUNT value on done: 617847.0 [2024-08-06 05:23:18,853][52662] Sum rewards: 79.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.692', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '66.000'} [2024-08-06 05:23:19,068][52660] DAMAGECOUNT value on done: 622953.0 [2024-08-06 05:23:19,069][52660] Sum rewards: 81.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.060', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '68.000'} [2024-08-06 05:23:20,557][52795] DAMAGECOUNT value on done: 579488.0 [2024-08-06 05:23:20,558][52795] Sum rewards: 71.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.337', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'weapon4': '0.140', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.402', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:21,361][52811] DAMAGECOUNT value on done: 580224.0 [2024-08-06 05:23:21,364][52811] Sum rewards: 69.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.078', 'weapon2': '0.218', 'weapon5': '0.222', 'AMMO3': '0.225', 'AMMO4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.262', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:21,491][52820] DAMAGECOUNT value on done: 588912.0 [2024-08-06 05:23:21,492][52820] Sum rewards: 75.136, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.214', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.124', 'AMMO4': '0.184', 'weapon2': '0.232', 'AMMO3': '0.252', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:21,745][52662] DAMAGECOUNT value on done: 626189.0 [2024-08-06 05:23:21,745][52662] Sum rewards: 71.965, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.624', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.143', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.992', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 05:23:22,075][52660] DAMAGECOUNT value on done: 634333.0 [2024-08-06 05:23:22,076][52660] Sum rewards: 77.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.350', 'weapon4': '0.396', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.558', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '64.500'} [2024-08-06 05:23:22,779][52650] Updated weights for policy 0, policy_version 60761 (0.0037) [2024-08-06 05:23:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 497754112. Throughput: 0: 4364.2. Samples: 124442310. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 05:23:22,794][52567] Avg episode reward: [(0, '72.596')] [2024-08-06 05:23:23,727][52795] DAMAGECOUNT value on done: 571754.0 [2024-08-06 05:23:23,728][52795] Sum rewards: 70.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.838', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO3': '0.168', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:24,516][52811] DAMAGECOUNT value on done: 585515.0 [2024-08-06 05:23:24,518][52811] Sum rewards: 78.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.006', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.090', 'weapon4': '0.094', 'AMMO4': '0.188', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '65.500'} [2024-08-06 05:23:24,629][52820] DAMAGECOUNT value on done: 583840.0 [2024-08-06 05:23:24,630][52820] Sum rewards: 75.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.879', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.216', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '61.000'} [2024-08-06 05:23:24,650][52660] DAMAGECOUNT value on done: 639355.0 [2024-08-06 05:23:24,652][52660] Sum rewards: 75.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.481', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.205', 'weapon2': '0.208', 'AMMO4': '0.216', 'weapon4': '0.238', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '62.000'} [2024-08-06 05:23:24,905][52662] DAMAGECOUNT value on done: 619669.0 [2024-08-06 05:23:24,908][52662] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon4': '0.110', 'AMMO4': '0.197', 'AMMO3': '0.211', 'weapon5': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '52.000'} [2024-08-06 05:23:25,120][52659] DAMAGECOUNT value on done: 632342.0 [2024-08-06 05:23:25,121][52659] Sum rewards: 85.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.960', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.078', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.246', 'weapon4': '0.258', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '72.500'} [2024-08-06 05:23:27,011][52795] DAMAGECOUNT value on done: 578693.0 [2024-08-06 05:23:27,011][52795] Sum rewards: 81.031, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.130', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.168', 'AMMO3': '0.208', 'weapon5': '0.226', 'weapon2': '0.244', 'AMMO4': '0.285', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '68.000'} [2024-08-06 05:23:27,374][52650] Updated weights for policy 0, policy_version 60771 (0.0028) [2024-08-06 05:23:27,536][52811] DAMAGECOUNT value on done: 592062.0 [2024-08-06 05:23:27,536][52811] Sum rewards: 53.677, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.000', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.080', 'weapon5': '0.180', 'AMMO4': '0.238', 'AMMO3': '0.248', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.830', 'weapon3': '3.058', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '48.000'} [2024-08-06 05:23:27,559][52660] DAMAGECOUNT value on done: 620411.0 [2024-08-06 05:23:27,559][52660] Sum rewards: 65.972, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.770', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO4': '0.224', 'weapon5': '0.238', 'weapon2': '0.254', 'AMMO3': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.052', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '58.000'} [2024-08-06 05:23:27,666][52820] DAMAGECOUNT value on done: 587072.0 [2024-08-06 05:23:27,668][52820] Sum rewards: 71.188, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.188', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.140', 'AMMO4': '0.189', 'weapon5': '0.258', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '0.900', 'weapon3': '2.566', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 497836032. Throughput: 0: 4358.7. Samples: 124468150. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 05:23:27,795][52567] Avg episode reward: [(0, '72.519')] [2024-08-06 05:23:28,112][52659] DAMAGECOUNT value on done: 625191.0 [2024-08-06 05:23:28,114][52659] Sum rewards: 70.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.344', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.147', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.308', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.000'} [2024-08-06 05:23:30,274][52795] DAMAGECOUNT value on done: 585179.0 [2024-08-06 05:23:30,275][52795] Sum rewards: 71.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.305', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.201', 'weapon2': '0.232', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.632', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:30,608][52811] DAMAGECOUNT value on done: 588586.0 [2024-08-06 05:23:30,609][52811] Sum rewards: 64.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.180', 'AMMO4': '0.197', 'AMMO3': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.140', 'weapon3': '3.258', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '52.500'} [2024-08-06 05:23:30,677][52660] DAMAGECOUNT value on done: 630336.0 [2024-08-06 05:23:30,678][52660] Sum rewards: 72.042, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.602', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.100', 'weapon5': '0.176', 'AMMO3': '0.234', 'AMMO4': '0.294', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '61.500'} [2024-08-06 05:23:30,710][52659] DAMAGECOUNT value on done: 630944.0 [2024-08-06 05:23:30,710][52659] Sum rewards: 71.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.286', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.134', 'weapon4': '0.136', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:30,770][52820] DAMAGECOUNT value on done: 583364.0 [2024-08-06 05:23:30,771][52820] Sum rewards: 70.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.250', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.128', 'AMMO3': '0.239', 'weapon2': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:32,133][52650] Updated weights for policy 0, policy_version 60781 (0.0012) [2024-08-06 05:23:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 497926144. Throughput: 0: 4356.0. Samples: 124481210. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 05:23:32,794][52567] Avg episode reward: [(0, '72.486')] [2024-08-06 05:23:33,680][52660] DAMAGECOUNT value on done: 623126.0 [2024-08-06 05:23:33,680][52660] Sum rewards: 70.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.220', 'AMMO3': '0.237', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:33,689][52811] DAMAGECOUNT value on done: 579850.0 [2024-08-06 05:23:33,692][52811] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.130', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.217', 'weapon4': '0.268', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '61.000'} [2024-08-06 05:23:33,746][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:23:33,936][52659] DAMAGECOUNT value on done: 624648.0 [2024-08-06 05:23:33,938][52659] Sum rewards: 70.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:33,992][52820] DAMAGECOUNT value on done: 583250.0 [2024-08-06 05:23:33,996][52820] Sum rewards: 64.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.120', 'weapon4': '0.188', 'AMMO4': '0.196', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '54.000'} [2024-08-06 05:23:34,208][52665] DAMAGECOUNT value on done: 614803.0 [2024-08-06 05:23:34,209][52665] Sum rewards: 72.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.378', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.114', 'weapon5': '0.118', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:36,693][52660] DAMAGECOUNT value on done: 621581.0 [2024-08-06 05:23:36,694][52660] Sum rewards: 66.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.058', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.274', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '57.000'} [2024-08-06 05:23:36,770][52650] Updated weights for policy 0, policy_version 60791 (0.0035) [2024-08-06 05:23:36,880][52659] DAMAGECOUNT value on done: 622739.0 [2024-08-06 05:23:36,881][52659] Sum rewards: 68.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.428', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.114', 'weapon4': '0.172', 'AMMO3': '0.231', 'AMMO4': '0.268', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '61.000'} [2024-08-06 05:23:36,901][52811] DAMAGECOUNT value on done: 593264.0 [2024-08-06 05:23:36,901][52811] Sum rewards: 75.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.609', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon4': '0.202', 'AMMO3': '0.238', 'weapon5': '0.238', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '62.000'} [2024-08-06 05:23:37,469][52665] DAMAGECOUNT value on done: 628880.0 [2024-08-06 05:23:37,471][52665] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.218', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.217', 'AMMO4': '0.222', 'weapon2': '0.240', 'weapon5': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon4': '0.520', 'WEAPON3': '1.250', 'weapon3': '2.654', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '61.000'} [2024-08-06 05:23:37,580][52820] DAMAGECOUNT value on done: 593165.0 [2024-08-06 05:23:37,583][52820] Sum rewards: 88.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'weapon5': '0.036', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.266', 'FRAGCOUNT': '71.500'} [2024-08-06 05:23:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 498016256. Throughput: 0: 4355.3. Samples: 124507400. Policy #0 lag: (min: 1.0, avg: 4.1, max: 8.0) [2024-08-06 05:23:37,795][52567] Avg episode reward: [(0, '72.576')] [2024-08-06 05:23:39,635][52660] DAMAGECOUNT value on done: 615405.0 [2024-08-06 05:23:39,635][52660] Sum rewards: 59.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.052', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'AMMO4': '0.258', 'weapon2': '0.456', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.222', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '51.000'} [2024-08-06 05:23:39,828][52659] DAMAGECOUNT value on done: 630170.0 [2024-08-06 05:23:39,831][52659] Sum rewards: 78.283, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.005', 'weapon4': '0.006', 'AMMO2': '0.008', 'weapon5': '0.014', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.418', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '66.000'} [2024-08-06 05:23:40,070][52811] DAMAGECOUNT value on done: 584828.0 [2024-08-06 05:23:40,072][52811] Sum rewards: 74.721, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.398', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.130', 'AMMO3': '0.138', 'weapon4': '0.184', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.930', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:40,218][52665] DAMAGECOUNT value on done: 626497.0 [2024-08-06 05:23:40,219][52665] Sum rewards: 73.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.974', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.158', 'AMMO3': '0.174', 'weapon4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '57.000'} [2024-08-06 05:23:40,694][52820] DAMAGECOUNT value on done: 591116.0 [2024-08-06 05:23:40,696][52820] Sum rewards: 85.102, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.044', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon5': '0.144', 'weapon4': '0.234', 'AMMO3': '0.243', 'AMMO4': '0.322', 'weapon2': '0.344', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.093', 'FRAGCOUNT': '72.000'} [2024-08-06 05:23:41,458][52650] Updated weights for policy 0, policy_version 60801 (0.0011) [2024-08-06 05:23:42,227][52794] DAMAGECOUNT value on done: 628882.0 [2024-08-06 05:23:42,227][52794] Sum rewards: 73.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon5': '0.016', 'weapon4': '0.018', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 498098176. Throughput: 0: 4349.8. Samples: 124533060. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:23:42,794][52567] Avg episode reward: [(0, '72.960')] [2024-08-06 05:23:42,900][52659] DAMAGECOUNT value on done: 624421.0 [2024-08-06 05:23:42,901][52659] Sum rewards: 69.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.783', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.232', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.494', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '59.000'} [2024-08-06 05:23:42,979][52665] DAMAGECOUNT value on done: 618236.0 [2024-08-06 05:23:42,981][52665] Sum rewards: 59.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.218', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.072', 'weapon5': '0.160', 'AMMO4': '0.207', 'AMMO3': '0.260', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.850', 'weapon3': '3.230', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '52.000'} [2024-08-06 05:23:43,182][52811] DAMAGECOUNT value on done: 589183.0 [2024-08-06 05:23:43,183][52811] Sum rewards: 75.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.060', 'AMMO4': '0.159', 'weapon5': '0.188', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '60.000'} [2024-08-06 05:23:43,757][52820] DAMAGECOUNT value on done: 577469.0 [2024-08-06 05:23:43,760][52820] Sum rewards: 58.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.766', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.134', 'AMMO4': '0.172', 'weapon2': '0.262', 'AMMO3': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.070', 'weapon3': '3.230', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '52.000'} [2024-08-06 05:23:44,855][52794] DAMAGECOUNT value on done: 634446.0 [2024-08-06 05:23:44,856][52794] Sum rewards: 82.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.128', 'AMMO4': '0.196', 'AMMO3': '0.216', 'weapon2': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.386', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '68.000'} [2024-08-06 05:23:45,782][52659] DAMAGECOUNT value on done: 622994.0 [2024-08-06 05:23:45,784][52659] Sum rewards: 74.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.564', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.180', 'weapon4': '0.206', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:46,014][52803] DAMAGECOUNT value on done: 584572.0 [2024-08-06 05:23:46,014][52803] Sum rewards: 69.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.823', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.245', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '57.500'} [2024-08-06 05:23:46,043][52665] DAMAGECOUNT value on done: 609827.0 [2024-08-06 05:23:46,044][52665] Sum rewards: 73.183, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.354', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.128', 'weapon5': '0.194', 'AMMO4': '0.199', 'AMMO3': '0.241', 'weapon2': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.146', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '62.000'} [2024-08-06 05:23:46,318][52650] Updated weights for policy 0, policy_version 60811 (0.0019) [2024-08-06 05:23:46,399][52811] DAMAGECOUNT value on done: 593476.0 [2024-08-06 05:23:46,399][52811] Sum rewards: 79.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.880', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.094', 'AMMO3': '0.176', 'weapon5': '0.192', 'AMMO4': '0.201', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:47,491][52794] DAMAGECOUNT value on done: 633857.0 [2024-08-06 05:23:47,492][52794] Sum rewards: 76.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.302', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.088', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '64.000'} [2024-08-06 05:23:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 498188288. Throughput: 0: 4354.2. Samples: 124546220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:23:47,795][52567] Avg episode reward: [(0, '72.718')] [2024-08-06 05:23:48,382][52659] Large shaping reward -2.507 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.258, -86.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:23:48,826][52659] DAMAGECOUNT value on done: 630822.0 [2024-08-06 05:23:48,827][52659] Sum rewards: 78.300, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.110', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.096', 'AMMO3': '0.151', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.098', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:49,103][52664] DAMAGECOUNT value on done: 650782.0 [2024-08-06 05:23:49,103][52664] Sum rewards: 71.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.430', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.148', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.266', 'weapon2': '0.336', 'WEAPON3': '1.000', 'weapon3': '2.850', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '56.000'} [2024-08-06 05:23:49,211][52665] DAMAGECOUNT value on done: 615346.0 [2024-08-06 05:23:49,213][52665] Sum rewards: 72.999, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.808', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.180', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.700', 'weapon3': '3.136', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:49,285][52803] DAMAGECOUNT value on done: 581883.0 [2024-08-06 05:23:49,285][52803] Sum rewards: 71.233, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.094', 'weapon5': '0.132', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon2': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.220', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:49,605][52811] DAMAGECOUNT value on done: 583206.0 [2024-08-06 05:23:49,607][52811] Sum rewards: 72.399, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.120', 'AMMO4': '0.162', 'AMMO3': '0.168', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '57.000'} [2024-08-06 05:23:50,267][52794] DAMAGECOUNT value on done: 624768.0 [2024-08-06 05:23:50,267][52794] Sum rewards: 78.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.180', 'AMMO5': '0.009', 'AMMO2': '0.009', 'weapon4': '0.012', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.262', 'WEAPON3': '1.700', 'weapon3': '3.482', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:50,585][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:23:50,782][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:23:50,944][52650] Updated weights for policy 0, policy_version 60821 (0.0028) [2024-08-06 05:23:51,478][52659] DAMAGECOUNT value on done: 633825.0 [2024-08-06 05:23:51,479][52659] Sum rewards: 81.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.277', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.038', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.540', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '67.000'} [2024-08-06 05:23:51,569][52664] DAMAGECOUNT value on done: 654284.0 [2024-08-06 05:23:51,570][52664] Sum rewards: 75.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.235', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.089', 'weapon5': '0.090', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.398', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '61.000'} [2024-08-06 05:23:52,311][52803] DAMAGECOUNT value on done: 588643.0 [2024-08-06 05:23:52,313][52803] Sum rewards: 77.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.488', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.088', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:52,403][52665] DAMAGECOUNT value on done: 620182.0 [2024-08-06 05:23:52,403][52665] Sum rewards: 75.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.812', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.012', 'AMMO4': '0.018', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.452', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '63.000'} [2024-08-06 05:23:52,697][52811] DAMAGECOUNT value on done: 580209.0 [2024-08-06 05:23:52,701][52811] Sum rewards: 77.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.712', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.152', 'weapon5': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.252', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '66.000'} [2024-08-06 05:23:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 498278400. Throughput: 0: 4355.6. Samples: 124572400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:23:52,794][52567] Avg episode reward: [(0, '73.285')] [2024-08-06 05:23:52,932][52794] DAMAGECOUNT value on done: 624817.0 [2024-08-06 05:23:52,932][52794] Sum rewards: 78.444, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.874', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.101', 'weapon5': '0.112', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.370', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '68.000'} [2024-08-06 05:23:53,940][52664] DAMAGECOUNT value on done: 652386.0 [2024-08-06 05:23:53,940][52664] Sum rewards: 70.902, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.425', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.156', 'AMMO3': '0.165', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.360', 'weapon4': '0.380', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '58.000'} [2024-08-06 05:23:54,639][52659] DAMAGECOUNT value on done: 624023.0 [2024-08-06 05:23:54,640][52659] Sum rewards: 81.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.072', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.398', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:55,490][52803] DAMAGECOUNT value on done: 591182.0 [2024-08-06 05:23:55,492][52803] Sum rewards: 63.852, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.715', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon4': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.120', 'weapon3': '3.260', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '51.000'} [2024-08-06 05:23:55,563][52667] DAMAGECOUNT value on done: 628060.0 [2024-08-06 05:23:55,564][52667] Sum rewards: 77.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.910', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.124', 'AMMO4': '0.163', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.196', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '66.000'} [2024-08-06 05:23:55,578][52665] DAMAGECOUNT value on done: 617516.0 [2024-08-06 05:23:55,578][52665] Sum rewards: 64.356, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.236', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.152', 'AMMO3': '0.239', 'AMMO4': '0.268', 'weapon5': '0.334', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '55.500'} [2024-08-06 05:23:55,604][52650] Updated weights for policy 0, policy_version 60831 (0.0022) [2024-08-06 05:23:55,773][52811] DAMAGECOUNT value on done: 584370.0 [2024-08-06 05:23:55,776][52811] Sum rewards: 53.237, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.991', 'AMMO5': '0.023', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.210', 'weapon2': '0.248', 'weapon4': '0.264', 'AMMO3': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '2.780', 'weapon3': '2.936', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '49.000'} [2024-08-06 05:23:55,885][52794] DAMAGECOUNT value on done: 628054.0 [2024-08-06 05:23:55,885][52794] Sum rewards: 77.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.184', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.660', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '64.000'} [2024-08-06 05:23:56,577][52664] DAMAGECOUNT value on done: 645153.0 [2024-08-06 05:23:56,578][52664] Sum rewards: 82.076, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.245', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.247', 'weapon2': '0.460', 'WEAPON3': '1.550', 'weapon3': '3.214', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '71.000'} [2024-08-06 05:23:57,760][52659] DAMAGECOUNT value on done: 632409.0 [2024-08-06 05:23:57,760][52659] Sum rewards: 71.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.923', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.103', 'weapon5': '0.156', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.356', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '58.000'} [2024-08-06 05:23:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 498360320. Throughput: 0: 4348.2. Samples: 124598620. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:23:57,794][52567] Avg episode reward: [(0, '73.204')] [2024-08-06 05:23:58,514][52667] DAMAGECOUNT value on done: 634962.0 [2024-08-06 05:23:58,516][52667] Sum rewards: 60.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.212', 'AMMO3': '0.213', 'AMMO4': '0.221', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.146', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '49.500'} [2024-08-06 05:23:58,519][52665] DAMAGECOUNT value on done: 628349.0 [2024-08-06 05:23:58,522][52665] Sum rewards: 74.211, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.084', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.268', 'WEAPON3': '1.650', 'weapon3': '3.374', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '64.000'} [2024-08-06 05:23:58,592][52803] DAMAGECOUNT value on done: 587170.0 [2024-08-06 05:23:58,593][52803] Sum rewards: 79.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.712', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.116', 'weapon4': '0.130', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON3': '1.400', 'weapon3': '3.386', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '65.000'} [2024-08-06 05:23:58,806][52811] DAMAGECOUNT value on done: 583655.0 [2024-08-06 05:23:58,806][52811] Sum rewards: 72.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.537', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.160', 'AMMO4': '0.186', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon5': '0.322', 'WEAPON5': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.470', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '58.000'} [2024-08-06 05:23:58,970][52794] DAMAGECOUNT value on done: 632504.0 [2024-08-06 05:23:58,972][52794] Sum rewards: 77.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.435', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.261', 'weapon2': '0.360', 'WEAPON3': '1.600', 'weapon3': '3.454', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '66.000'} [2024-08-06 05:23:59,277][52664] DAMAGECOUNT value on done: 653499.0 [2024-08-06 05:23:59,277][52664] Sum rewards: 75.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.183', 'AMMO3': '0.193', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:00,325][52650] Updated weights for policy 0, policy_version 60841 (0.0012) [2024-08-06 05:24:00,862][52659] DAMAGECOUNT value on done: 623916.0 [2024-08-06 05:24:00,863][52659] Sum rewards: 66.432, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.931', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '54.000'} [2024-08-06 05:24:01,078][52667] DAMAGECOUNT value on done: 630190.0 [2024-08-06 05:24:01,080][52667] Sum rewards: 72.571, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.075', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.129', 'weapon5': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '0.900', 'weapon3': '2.728', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '56.000'} [2024-08-06 05:24:01,651][52803] DAMAGECOUNT value on done: 579471.0 [2024-08-06 05:24:01,652][52803] Sum rewards: 72.079, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.171', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:01,776][52794] DAMAGECOUNT value on done: 619861.0 [2024-08-06 05:24:01,776][52794] Sum rewards: 75.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.129', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.040', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.222', 'weapon5': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.302', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:01,778][52664] DAMAGECOUNT value on done: 648563.0 [2024-08-06 05:24:01,780][52664] Sum rewards: 65.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.124', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.191', 'AMMO4': '0.247', 'weapon5': '0.250', 'weapon4': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '2.860', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '55.000'} [2024-08-06 05:24:01,837][52811] DAMAGECOUNT value on done: 586786.0 [2024-08-06 05:24:01,837][52811] Sum rewards: 73.476, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.104', 'AMMO4': '0.119', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:01,969][52665] DAMAGECOUNT value on done: 618063.0 [2024-08-06 05:24:01,969][52665] Sum rewards: 71.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.160', 'AMMO3': '0.235', 'AMMO4': '0.238', 'weapon5': '0.256', 'weapon2': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '58.000'} [2024-08-06 05:24:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 498450432. Throughput: 0: 4346.7. Samples: 124611490. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:24:02,794][52567] Avg episode reward: [(0, '73.072')] [2024-08-06 05:24:03,861][52659] DAMAGECOUNT value on done: 624563.0 [2024-08-06 05:24:03,861][52659] Sum rewards: 81.458, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.020', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.130', 'AMMO3': '0.146', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.634', 'WEAPON3': '0.950', 'weapon3': '2.674', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '65.000'} [2024-08-06 05:24:04,308][52667] DAMAGECOUNT value on done: 630551.0 [2024-08-06 05:24:04,310][52667] Sum rewards: 61.949, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.886', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.131', 'AMMO4': '0.188', 'weapon5': '0.346', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.510', 'weapon2': '0.636', 'WEAPON3': '0.850', 'weapon3': '2.290', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.151', 'FRAGCOUNT': '48.000'} [2024-08-06 05:24:04,389][52664] DAMAGECOUNT value on done: 648919.0 [2024-08-06 05:24:04,390][52664] Sum rewards: 81.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.897', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '68.000'} [2024-08-06 05:24:04,542][52794] DAMAGECOUNT value on done: 631741.0 [2024-08-06 05:24:04,542][52794] Sum rewards: 74.027, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.129', 'weapon5': '0.198', 'weapon4': '0.224', 'AMMO4': '0.242', 'weapon2': '0.462', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.854', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '58.500'} [2024-08-06 05:24:04,689][52803] DAMAGECOUNT value on done: 579429.0 [2024-08-06 05:24:04,690][52803] Sum rewards: 70.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.152', 'AMMO4': '0.171', 'weapon2': '0.230', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.284', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:04,827][52811] DAMAGECOUNT value on done: 590900.0 [2024-08-06 05:24:04,830][52811] Sum rewards: 79.606, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.992', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon4': '0.220', 'weapon5': '0.226', 'AMMO3': '0.276', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.846', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.463', 'FRAGCOUNT': '69.000'} [2024-08-06 05:24:04,956][52650] Updated weights for policy 0, policy_version 60851 (0.0024) [2024-08-06 05:24:05,075][52665] DAMAGECOUNT value on done: 628236.0 [2024-08-06 05:24:05,077][52665] Sum rewards: 72.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.218', 'AMMO4': '0.219', 'weapon4': '0.224', 'AMMO3': '0.240', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.904', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:05,737][52820] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.033, -11.0), ('weapon5', 0.002)] [2024-08-06 05:24:06,675][52659] DAMAGECOUNT value on done: 638207.0 [2024-08-06 05:24:06,675][52659] Sum rewards: 72.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.920', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.088', 'AMMO4': '0.095', 'weapon5': '0.112', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '61.500'} [2024-08-06 05:24:06,795][52664] DAMAGECOUNT value on done: 642775.0 [2024-08-06 05:24:06,796][52664] Sum rewards: 73.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon5': '0.208', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:07,156][52667] DAMAGECOUNT value on done: 636064.0 [2024-08-06 05:24:07,157][52667] Sum rewards: 85.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon2': '0.174', 'weapon4': '0.190', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '70.000'} [2024-08-06 05:24:07,664][52794] DAMAGECOUNT value on done: 624610.0 [2024-08-06 05:24:07,665][52794] Sum rewards: 61.006, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.667', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.124', 'WEAPON4': '0.200', 'weapon5': '0.240', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.376', 'WEAPON3': '1.600', 'weapon3': '2.820', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '54.000'} [2024-08-06 05:24:07,749][52803] DAMAGECOUNT value on done: 576158.0 [2024-08-06 05:24:07,750][52803] Sum rewards: 77.598, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.978', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO3': '0.157', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.604', 'WEAPON3': '0.950', 'weapon3': '3.090', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 498540544. Throughput: 0: 4350.9. Samples: 124638100. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:24:07,802][52567] Avg episode reward: [(0, '73.334')] [2024-08-06 05:24:07,855][52811] DAMAGECOUNT value on done: 586389.0 [2024-08-06 05:24:07,857][52811] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.560', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.120', 'AMMO4': '0.147', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:08,056][52665] DAMAGECOUNT value on done: 624457.0 [2024-08-06 05:24:08,059][52665] Sum rewards: 76.650, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.610', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon5': '0.142', 'AMMO3': '0.151', 'AMMO4': '0.163', 'weapon4': '0.288', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.938', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:09,646][52650] Updated weights for policy 0, policy_version 60861 (0.0017) [2024-08-06 05:24:09,646][52664] DAMAGECOUNT value on done: 654440.0 [2024-08-06 05:24:09,647][52664] Sum rewards: 60.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon4': '0.102', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '51.000'} [2024-08-06 05:24:09,732][52659] DAMAGECOUNT value on done: 629755.0 [2024-08-06 05:24:09,734][52659] Sum rewards: 77.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.484', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.132', 'AMMO3': '0.155', 'weapon4': '0.166', 'AMMO4': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.986', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:09,939][52667] DAMAGECOUNT value on done: 637720.0 [2024-08-06 05:24:09,939][52667] Sum rewards: 73.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.815', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.078', 'AMMO4': '0.123', 'weapon5': '0.126', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.594', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 05:24:10,421][52794] DAMAGECOUNT value on done: 623270.0 [2024-08-06 05:24:10,422][52794] Sum rewards: 79.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon4': '0.094', 'AMMO3': '0.183', 'weapon5': '0.250', 'AMMO4': '0.327', 'weapon2': '0.328', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '64.000'} [2024-08-06 05:24:10,637][52665] DAMAGECOUNT value on done: 624216.0 [2024-08-06 05:24:10,639][52665] Sum rewards: 77.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.480', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '65.000'} [2024-08-06 05:24:10,762][52803] DAMAGECOUNT value on done: 582735.0 [2024-08-06 05:24:10,763][52803] Sum rewards: 73.584, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.050', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon4': '0.066', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.308', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.292', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:10,985][52811] DAMAGECOUNT value on done: 583450.0 [2024-08-06 05:24:10,989][52811] Sum rewards: 69.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.126', 'weapon4': '0.132', 'weapon2': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'AMMO4': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.370', 'weapon3': '3.372', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:12,392][52667] DAMAGECOUNT value on done: 630409.0 [2024-08-06 05:24:12,392][52667] Sum rewards: 71.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.836', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon4': '0.158', 'AMMO3': '0.218', 'weapon5': '0.218', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:12,687][52664] DAMAGECOUNT value on done: 647712.0 [2024-08-06 05:24:12,687][52664] Sum rewards: 71.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.113', 'weapon4': '0.126', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 498622464. Throughput: 0: 4363.3. Samples: 124664500. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:24:12,802][52567] Avg episode reward: [(0, '72.871')] [2024-08-06 05:24:12,832][52659] DAMAGECOUNT value on done: 635746.0 [2024-08-06 05:24:12,836][52659] Sum rewards: 73.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:13,175][52665] DAMAGECOUNT value on done: 620335.0 [2024-08-06 05:24:13,175][52665] Sum rewards: 64.073, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.820', 'AMMO2': '0.010', 'AMMO5': '0.010', 'AMMO4': '0.048', 'weapon5': '0.092', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.576', 'WEAPON3': '0.950', 'weapon3': '3.068', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '50.000'} [2024-08-06 05:24:13,554][52794] DAMAGECOUNT value on done: 627194.0 [2024-08-06 05:24:13,554][52794] Sum rewards: 72.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.100', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.144', 'weapon4': '0.198', 'AMMO3': '0.217', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:13,865][52803] DAMAGECOUNT value on done: 576945.0 [2024-08-06 05:24:13,866][52803] Sum rewards: 69.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.870', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.042', 'weapon5': '0.046', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:14,333][52650] Updated weights for policy 0, policy_version 60871 (0.0011) [2024-08-06 05:24:15,547][52667] DAMAGECOUNT value on done: 631019.0 [2024-08-06 05:24:15,549][52667] Sum rewards: 93.122, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.927', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.294', 'weapon4': '0.344', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '22.353', 'FRAGCOUNT': '75.000'} [2024-08-06 05:24:15,679][52665] DAMAGECOUNT value on done: 619711.0 [2024-08-06 05:24:15,680][52665] Sum rewards: 76.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.010', 'AMMO4': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.322', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:15,871][52664] DAMAGECOUNT value on done: 655631.0 [2024-08-06 05:24:15,871][52664] Sum rewards: 83.099, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.305', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.148', 'AMMO3': '0.153', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '3.244', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '67.000'} [2024-08-06 05:24:15,875][52811] Large shaping reward 2.557 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.075, -25.0), ('weapon5', 0.002)] [2024-08-06 05:24:15,991][52659] DAMAGECOUNT value on done: 626749.0 [2024-08-06 05:24:15,995][52659] Sum rewards: 79.090, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.108', 'AMMO4': '0.122', 'weapon5': '0.140', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '64.000'} [2024-08-06 05:24:16,408][52794] DAMAGECOUNT value on done: 621760.0 [2024-08-06 05:24:16,409][52794] Sum rewards: 77.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.138', 'AMMO4': '0.149', 'AMMO3': '0.197', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '64.000'} [2024-08-06 05:24:16,890][52803] DAMAGECOUNT value on done: 595736.0 [2024-08-06 05:24:16,890][52803] Sum rewards: 73.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.092', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 498712576. Throughput: 0: 4360.0. Samples: 124677410. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:24:17,794][52567] Avg episode reward: [(0, '73.213')] [2024-08-06 05:24:18,285][52665] DAMAGECOUNT value on done: 618719.0 [2024-08-06 05:24:18,287][52665] Sum rewards: 78.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.078', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.167', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:18,544][52664] DAMAGECOUNT value on done: 654793.0 [2024-08-06 05:24:18,545][52664] Sum rewards: 75.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.576', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:18,560][52667] DAMAGECOUNT value on done: 632819.0 [2024-08-06 05:24:18,561][52667] Sum rewards: 81.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.126', 'AMMO4': '0.156', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '68.000'} [2024-08-06 05:24:18,697][52794] DAMAGECOUNT value on done: 641696.0 [2024-08-06 05:24:18,699][52794] Sum rewards: 75.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.248', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.095', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:18,934][52650] Updated weights for policy 0, policy_version 60881 (0.0012) [2024-08-06 05:24:18,949][52659] DAMAGECOUNT value on done: 633643.0 [2024-08-06 05:24:18,953][52659] Sum rewards: 88.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.265', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.831', 'FRAGCOUNT': '73.000'} [2024-08-06 05:24:19,954][52803] DAMAGECOUNT value on done: 583070.0 [2024-08-06 05:24:19,955][52803] Sum rewards: 82.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.754', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.107', 'weapon5': '0.128', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '67.000'} [2024-08-06 05:24:20,875][52665] DAMAGECOUNT value on done: 619248.0 [2024-08-06 05:24:20,875][52665] Sum rewards: 75.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon2': '0.192', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'HITCOUNT': '3.480', 'weapon3': '3.588', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '66.000'} [2024-08-06 05:24:21,260][52667] DAMAGECOUNT value on done: 637651.0 [2024-08-06 05:24:21,263][52667] Sum rewards: 79.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.320', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '65.000'} [2024-08-06 05:24:21,308][52794] DAMAGECOUNT value on done: 622749.0 [2024-08-06 05:24:21,309][52794] Sum rewards: 73.726, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.775', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.117', 'weapon5': '0.136', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '0.950', 'HITCOUNT': '3.150', 'weapon3': '3.272', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:21,648][52664] DAMAGECOUNT value on done: 657800.0 [2024-08-06 05:24:21,648][52664] Sum rewards: 70.121, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.938', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.120', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.184', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:21,778][52659] DAMAGECOUNT value on done: 627445.0 [2024-08-06 05:24:21,779][52659] Sum rewards: 81.881, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.165', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '65.000'} [2024-08-06 05:24:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 498802688. Throughput: 0: 4370.9. Samples: 124704090. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:24:22,794][52567] Avg episode reward: [(0, '74.162')] [2024-08-06 05:24:23,129][52803] DAMAGECOUNT value on done: 579892.0 [2024-08-06 05:24:23,132][52803] Sum rewards: 74.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.430', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.072', 'weapon5': '0.114', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.230', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:23,730][52650] Updated weights for policy 0, policy_version 60891 (0.0013) [2024-08-06 05:24:23,963][52794] DAMAGECOUNT value on done: 636797.0 [2024-08-06 05:24:23,963][52794] Sum rewards: 74.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.104', 'AMMO3': '0.197', 'AMMO4': '0.198', 'weapon5': '0.206', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.216', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:23,994][52665] DAMAGECOUNT value on done: 615161.0 [2024-08-06 05:24:23,994][52665] Sum rewards: 76.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.154', 'AMMO3': '0.188', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:24,273][52667] DAMAGECOUNT value on done: 625429.0 [2024-08-06 05:24:24,274][52667] Sum rewards: 86.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.158', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.534', 'FRAGCOUNT': '71.000'} [2024-08-06 05:24:24,462][52664] DAMAGECOUNT value on done: 657316.0 [2024-08-06 05:24:24,465][52664] Sum rewards: 61.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.136', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon5': '0.192', 'weapon4': '0.194', 'AMMO3': '0.196', 'AMMO4': '0.317', 'weapon2': '0.464', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '53.000'} [2024-08-06 05:24:24,891][52663] DAMAGECOUNT value on done: 638022.0 [2024-08-06 05:24:24,895][52663] Sum rewards: 64.258, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.317', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.124', 'weapon5': '0.166', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.104', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '56.000'} [2024-08-06 05:24:26,284][52803] DAMAGECOUNT value on done: 595991.0 [2024-08-06 05:24:26,285][52803] Sum rewards: 72.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.083', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.304', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:26,864][52665] DAMAGECOUNT value on done: 619320.0 [2024-08-06 05:24:26,865][52665] Sum rewards: 70.231, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.857', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.176', 'weapon5': '0.206', 'AMMO4': '0.302', 'AMMO3': '0.313', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'weapon3': '2.846', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:27,096][52664] DAMAGECOUNT value on done: 660482.0 [2024-08-06 05:24:27,096][52664] Sum rewards: 70.490, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.685', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:27,107][52667] DAMAGECOUNT value on done: 627531.0 [2024-08-06 05:24:27,109][52667] Sum rewards: 72.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:27,108][52794] DAMAGECOUNT value on done: 629415.0 [2024-08-06 05:24:27,111][52794] Sum rewards: 79.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.188', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.151', 'AMMO4': '0.203', 'weapon5': '0.294', 'weapon4': '0.320', 'weapon2': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.768', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:27,796][52567] Fps is (10 sec: 17200.1, 60 sec: 17475.8, 300 sec: 17466.9). Total num frames: 498884608. Throughput: 0: 4374.9. Samples: 124729940. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:24:27,796][52567] Avg episode reward: [(0, '73.996')] [2024-08-06 05:24:27,796][52663] DAMAGECOUNT value on done: 629562.0 [2024-08-06 05:24:27,800][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060899_498884608.pth... [2024-08-06 05:24:27,798][52663] Sum rewards: 84.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.796', 'AMMO5': '0.021', 'AMMO2': '0.069', 'weapon5': '0.160', 'AMMO3': '0.175', 'weapon4': '0.192', 'weapon2': '0.304', 'AMMO4': '0.345', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '70.000'} [2024-08-06 05:24:27,945][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060388_494698496.pth [2024-08-06 05:24:28,295][52650] Updated weights for policy 0, policy_version 60901 (0.0014) [2024-08-06 05:24:29,455][52803] DAMAGECOUNT value on done: 584844.0 [2024-08-06 05:24:29,457][52803] Sum rewards: 69.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.180', 'weapon4': '0.202', 'AMMO4': '0.236', 'weapon5': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.570', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:30,078][52665] DAMAGECOUNT value on done: 622033.0 [2024-08-06 05:24:30,078][52665] Sum rewards: 81.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '69.000'} [2024-08-06 05:24:30,252][52664] DAMAGECOUNT value on done: 649612.0 [2024-08-06 05:24:30,254][52664] Sum rewards: 69.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.043', 'weapon5': '0.044', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.215', 'WEAPON3': '1.350', 'HITCOUNT': '3.440', 'weapon3': '3.508', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:30,256][52667] DAMAGECOUNT value on done: 633986.0 [2024-08-06 05:24:30,256][52667] Sum rewards: 83.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.628', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.077', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon4': '0.258', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '67.000'} [2024-08-06 05:24:30,414][52794] DAMAGECOUNT value on done: 637166.0 [2024-08-06 05:24:30,414][52794] Sum rewards: 77.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.124', 'weapon5': '0.180', 'AMMO4': '0.210', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '68.000'} [2024-08-06 05:24:31,080][52663] DAMAGECOUNT value on done: 617733.0 [2024-08-06 05:24:31,080][52663] Sum rewards: 82.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.147', 'weapon5': '0.184', 'AMMO3': '0.227', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '68.000'} [2024-08-06 05:24:31,148][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:24:32,534][52803] DAMAGECOUNT value on done: 583444.0 [2024-08-06 05:24:32,537][52803] Sum rewards: 73.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.485', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.078', 'weapon5': '0.116', 'AMMO4': '0.207', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 498974720. Throughput: 0: 4366.2. Samples: 124742700. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:24:32,794][52567] Avg episode reward: [(0, '74.603')] [2024-08-06 05:24:32,844][52667] DAMAGECOUNT value on done: 623365.0 [2024-08-06 05:24:32,845][52667] Sum rewards: 69.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.088', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.342', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '56.000'} [2024-08-06 05:24:32,956][52794] DAMAGECOUNT value on done: 637386.0 [2024-08-06 05:24:32,958][52794] Sum rewards: 75.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.074', 'AMMO4': '0.171', 'AMMO3': '0.173', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.370', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:33,045][52664] DAMAGECOUNT value on done: 647835.0 [2024-08-06 05:24:33,046][52664] Sum rewards: 76.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.072', 'AMMO4': '0.159', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '64.000'} [2024-08-06 05:24:33,212][52650] Updated weights for policy 0, policy_version 60911 (0.0021) [2024-08-06 05:24:34,292][52663] DAMAGECOUNT value on done: 626992.0 [2024-08-06 05:24:34,294][52663] Sum rewards: 78.305, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.148', 'AMMO3': '0.163', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '3.032', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:35,519][52803] DAMAGECOUNT value on done: 586915.0 [2024-08-06 05:24:35,519][52803] Sum rewards: 69.103, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.228', 'AMMO3': '0.234', 'weapon2': '0.296', 'weapon4': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '58.000'} [2024-08-06 05:24:35,825][52667] DAMAGECOUNT value on done: 634518.0 [2024-08-06 05:24:35,833][52667] Sum rewards: 83.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.233', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '69.000'} [2024-08-06 05:24:36,039][52794] DAMAGECOUNT value on done: 628954.0 [2024-08-06 05:24:36,039][52794] Sum rewards: 67.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon2': '0.194', 'AMMO3': '0.210', 'AMMO4': '0.243', 'weapon4': '0.248', 'weapon5': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '53.000'} [2024-08-06 05:24:36,231][52664] DAMAGECOUNT value on done: 651539.0 [2024-08-06 05:24:36,234][52664] Sum rewards: 69.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.173', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.150', 'weapon5': '0.208', 'weapon2': '0.216', 'AMMO4': '0.238', 'AMMO3': '0.252', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:36,880][52663] DAMAGECOUNT value on done: 629569.0 [2024-08-06 05:24:36,882][52663] Sum rewards: 73.018, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon2': '0.102', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.356', 'WEAPON3': '0.900', 'weapon3': '3.426', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:37,794][52567] Fps is (10 sec: 17206.4, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 499056640. Throughput: 0: 4369.6. Samples: 124769030. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:24:37,794][52567] Avg episode reward: [(0, '74.489')] [2024-08-06 05:24:37,947][52650] Updated weights for policy 0, policy_version 60921 (0.0013) [2024-08-06 05:24:38,143][52666] DAMAGECOUNT value on done: 628498.0 [2024-08-06 05:24:38,143][52666] Sum rewards: 72.163, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.418', 'AMMO5': '0.022', 'AMMO2': '0.070', 'weapon4': '0.114', 'weapon5': '0.252', 'AMMO3': '0.271', 'AMMO4': '0.351', 'weapon2': '0.458', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.772', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:38,566][52803] DAMAGECOUNT value on done: 589949.0 [2024-08-06 05:24:38,567][52803] Sum rewards: 71.930, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.790', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.168', 'AMMO4': '0.197', 'weapon5': '0.202', 'weapon2': '0.256', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.000', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:38,803][52670] DAMAGECOUNT value on done: 618529.0 [2024-08-06 05:24:38,804][52670] Sum rewards: 62.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.196', 'weapon2': '0.286', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.344', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '51.000'} [2024-08-06 05:24:38,877][52664] DAMAGECOUNT value on done: 652438.0 [2024-08-06 05:24:38,878][52664] Sum rewards: 76.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.188', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:39,091][52667] DAMAGECOUNT value on done: 638821.0 [2024-08-06 05:24:39,092][52667] Sum rewards: 77.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.138', 'weapon5': '0.138', 'AMMO3': '0.211', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '64.000'} [2024-08-06 05:24:39,639][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 05:24:40,096][52663] DAMAGECOUNT value on done: 637837.0 [2024-08-06 05:24:40,096][52663] Sum rewards: 72.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.527', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.198', 'AMMO4': '0.243', 'weapon4': '0.244', 'weapon2': '0.250', 'weapon5': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:41,237][52666] DAMAGECOUNT value on done: 629807.0 [2024-08-06 05:24:41,237][52666] Sum rewards: 71.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.700', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.130', 'weapon5': '0.152', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:41,597][52803] DAMAGECOUNT value on done: 593211.0 [2024-08-06 05:24:41,600][52803] Sum rewards: 73.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.082', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:41,842][52664] DAMAGECOUNT value on done: 650896.0 [2024-08-06 05:24:41,843][52664] Sum rewards: 66.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon4': '0.194', 'AMMO3': '0.201', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 05:24:41,880][52670] DAMAGECOUNT value on done: 630455.0 [2024-08-06 05:24:41,880][52670] Sum rewards: 76.445, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.094', 'AMMO4': '0.141', 'AMMO3': '0.245', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.314', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '65.000'} [2024-08-06 05:24:42,010][52667] DAMAGECOUNT value on done: 637271.0 [2024-08-06 05:24:42,012][52667] Sum rewards: 81.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.166', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.149', 'weapon4': '0.160', 'AMMO3': '0.207', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '66.000'} [2024-08-06 05:24:42,594][52650] Updated weights for policy 0, policy_version 60931 (0.0018) [2024-08-06 05:24:42,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 499146752. Throughput: 0: 4373.8. Samples: 124795440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:24:42,795][52567] Avg episode reward: [(0, '74.273')] [2024-08-06 05:24:43,150][52663] DAMAGECOUNT value on done: 627293.0 [2024-08-06 05:24:43,152][52663] Sum rewards: 64.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.144', 'weapon4': '0.144', 'AMMO3': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.114', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '54.000'} [2024-08-06 05:24:44,452][52666] DAMAGECOUNT value on done: 629313.0 [2024-08-06 05:24:44,453][52666] Sum rewards: 65.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.211', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.168', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.278', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '53.000'} [2024-08-06 05:24:44,804][52803] DAMAGECOUNT value on done: 582107.0 [2024-08-06 05:24:44,805][52803] Sum rewards: 76.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.885', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.232', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:45,163][52667] DAMAGECOUNT value on done: 636792.0 [2024-08-06 05:24:45,164][52667] Sum rewards: 71.487, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.039', 'HEALTH': '0.040', 'weapon4': '0.168', 'weapon5': '0.174', 'AMMO3': '0.180', 'AMMO4': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '2.924', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2024-08-06 05:24:45,185][52670] DAMAGECOUNT value on done: 620352.0 [2024-08-06 05:24:45,186][52670] Sum rewards: 73.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.156', 'AMMO4': '0.188', 'weapon2': '0.196', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:45,685][52663] DAMAGECOUNT value on done: 621300.0 [2024-08-06 05:24:45,685][52663] Sum rewards: 70.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:46,239][52820] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:24:47,056][52650] Updated weights for policy 0, policy_version 60941 (0.0033) [2024-08-06 05:24:47,647][52666] DAMAGECOUNT value on done: 630923.0 [2024-08-06 05:24:47,648][52666] Sum rewards: 81.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.130', 'weapon5': '0.138', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '66.000'} [2024-08-06 05:24:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 499236864. Throughput: 0: 4380.2. Samples: 124808600. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:24:47,794][52567] Avg episode reward: [(0, '74.336')] [2024-08-06 05:24:48,123][52667] DAMAGECOUNT value on done: 631686.0 [2024-08-06 05:24:48,123][52667] Sum rewards: 70.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '61.000'} [2024-08-06 05:24:48,339][52670] DAMAGECOUNT value on done: 615406.0 [2024-08-06 05:24:48,342][52670] Sum rewards: 64.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.238', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.482', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.000'} [2024-08-06 05:24:48,600][52663] DAMAGECOUNT value on done: 620076.0 [2024-08-06 05:24:48,601][52663] Sum rewards: 75.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.944', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.124', 'AMMO3': '0.198', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '62.000'} [2024-08-06 05:24:50,908][52666] DAMAGECOUNT value on done: 624305.0 [2024-08-06 05:24:50,909][52666] Sum rewards: 80.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.102', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.215', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '66.000'} [2024-08-06 05:24:51,128][52667] DAMAGECOUNT value on done: 637868.0 [2024-08-06 05:24:51,130][52667] Sum rewards: 74.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.025', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.144', 'AMMO4': '0.165', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '60.000'} [2024-08-06 05:24:51,422][52670] DAMAGECOUNT value on done: 630406.0 [2024-08-06 05:24:51,423][52670] Sum rewards: 67.565, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.574', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.202', 'AMMO3': '0.226', 'weapon2': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.556', 'WEAPON3': '1.350', 'weapon3': '2.738', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:51,690][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:24:51,735][52663] DAMAGECOUNT value on done: 626806.0 [2024-08-06 05:24:51,737][52663] Sum rewards: 60.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '50.000'} [2024-08-06 05:24:52,285][52650] Updated weights for policy 0, policy_version 60951 (0.0011) [2024-08-06 05:24:52,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 499318784. Throughput: 0: 4368.2. Samples: 124834670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:24:52,794][52567] Avg episode reward: [(0, '74.272')] [2024-08-06 05:24:53,533][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:24:53,985][52666] DAMAGECOUNT value on done: 622099.0 [2024-08-06 05:24:53,985][52666] Sum rewards: 64.174, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.603', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.098', 'weapon2': '0.186', 'weapon5': '0.188', 'AMMO4': '0.247', 'AMMO3': '0.321', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.236', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:54,088][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:24:54,304][52663] DAMAGECOUNT value on done: 635826.0 [2024-08-06 05:24:54,307][52663] Sum rewards: 72.278, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.555', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.600', 'weapon3': '2.948', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:54,568][52670] DAMAGECOUNT value on done: 625165.0 [2024-08-06 05:24:54,571][52670] Sum rewards: 62.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon5': '0.176', 'weapon4': '0.184', 'AMMO4': '0.226', 'AMMO3': '0.228', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.062', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '54.000'} [2024-08-06 05:24:56,569][52650] Updated weights for policy 0, policy_version 60961 (0.0017) [2024-08-06 05:24:56,821][52666] DAMAGECOUNT value on done: 624972.0 [2024-08-06 05:24:56,823][52666] Sum rewards: 58.057, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.320', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.289', 'weapon5': '0.302', 'AMMO4': '0.324', 'weapon2': '0.350', 'weapon4': '0.366', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.650', 'weapon3': '2.562', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '53.000'} [2024-08-06 05:24:57,173][52670] DAMAGECOUNT value on done: 615748.0 [2024-08-06 05:24:57,174][52670] Sum rewards: 66.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.092', 'weapon5': '0.172', 'AMMO4': '0.204', 'AMMO3': '0.240', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '57.000'} [2024-08-06 05:24:57,273][52658] DAMAGECOUNT value on done: 633076.0 [2024-08-06 05:24:57,276][52658] Sum rewards: 76.988, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2024-08-06 05:24:57,342][52663] DAMAGECOUNT value on done: 623842.0 [2024-08-06 05:24:57,342][52663] Sum rewards: 72.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.735', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO4': '0.136', 'AMMO3': '0.182', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '58.000'} [2024-08-06 05:24:57,553][52669] DAMAGECOUNT value on done: 633183.0 [2024-08-06 05:24:57,555][52669] Sum rewards: 85.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.104', 'weapon4': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.396', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '69.000'} [2024-08-06 05:24:57,683][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:24:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 499408896. Throughput: 0: 4360.0. Samples: 124860700. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:24:57,794][52567] Avg episode reward: [(0, '73.954')] [2024-08-06 05:24:59,466][52666] DAMAGECOUNT value on done: 623941.0 [2024-08-06 05:24:59,467][52666] Sum rewards: 82.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.704', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.098', 'weapon5': '0.116', 'AMMO4': '0.180', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '68.000'} [2024-08-06 05:24:59,786][52670] DAMAGECOUNT value on done: 624278.0 [2024-08-06 05:24:59,787][52670] Sum rewards: 76.630, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.205', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.126', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'weapon4': '0.324', 'WEAPON3': '0.800', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:59,838][52663] DAMAGECOUNT value on done: 618035.0 [2024-08-06 05:24:59,838][52663] Sum rewards: 71.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.052', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.206', 'WEAPON3': '1.250', 'HITCOUNT': '3.510', 'weapon3': '3.552', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '59.000'} [2024-08-06 05:24:59,919][52669] DAMAGECOUNT value on done: 621473.0 [2024-08-06 05:24:59,920][52669] Sum rewards: 74.572, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.126', 'AMMO4': '0.171', 'AMMO3': '0.203', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.354', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:00,260][52658] DAMAGECOUNT value on done: 629172.0 [2024-08-06 05:25:00,260][52658] Sum rewards: 76.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.210', 'weapon4': '0.254', 'weapon5': '0.260', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:01,429][52650] Updated weights for policy 0, policy_version 60971 (0.0020) [2024-08-06 05:25:02,299][52666] DAMAGECOUNT value on done: 627001.0 [2024-08-06 05:25:02,302][52666] Sum rewards: 77.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.226', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.168', 'weapon5': '0.180', 'AMMO3': '0.194', 'AMMO4': '0.256', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:02,765][52670] DAMAGECOUNT value on done: 622251.0 [2024-08-06 05:25:02,770][52670] Sum rewards: 78.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.103', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.279', 'weapon2': '0.416', 'WEAPON3': '1.650', 'weapon3': '3.288', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '67.000'} [2024-08-06 05:25:02,790][52663] DAMAGECOUNT value on done: 623304.0 [2024-08-06 05:25:02,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 499507200. Throughput: 0: 4366.4. Samples: 124873900. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:25:02,796][52567] Avg episode reward: [(0, '74.089')] [2024-08-06 05:25:02,792][52663] Sum rewards: 69.493, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.166', 'weapon4': '0.168', 'AMMO4': '0.172', 'AMMO3': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '57.000'} [2024-08-06 05:25:03,007][52669] DAMAGECOUNT value on done: 634135.0 [2024-08-06 05:25:03,007][52669] Sum rewards: 63.992, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.868', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.090', 'AMMO3': '0.233', 'AMMO4': '0.259', 'weapon5': '0.278', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.890', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '54.500'} [2024-08-06 05:25:03,106][52658] DAMAGECOUNT value on done: 634383.0 [2024-08-06 05:25:03,107][52658] Sum rewards: 64.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.080', 'AMMO4': '0.181', 'AMMO3': '0.224', 'weapon5': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '53.000'} [2024-08-06 05:25:04,719][52671] DAMAGECOUNT value on done: 633751.0 [2024-08-06 05:25:04,722][52671] Sum rewards: 77.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.218', 'weapon4': '0.244', 'weapon5': '0.270', 'AMMO4': '0.271', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.792', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:05,572][52650] Updated weights for policy 0, policy_version 60981 (0.0031) [2024-08-06 05:25:05,593][52666] DAMAGECOUNT value on done: 619811.0 [2024-08-06 05:25:05,593][52666] Sum rewards: 74.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.937', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.092', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.278', 'weapon2': '0.294', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:05,724][52658] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 05:25:06,048][52658] DAMAGECOUNT value on done: 632480.0 [2024-08-06 05:25:06,049][52658] Sum rewards: 60.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.559', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.184', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '51.000'} [2024-08-06 05:25:06,077][52670] DAMAGECOUNT value on done: 619729.0 [2024-08-06 05:25:06,078][52670] Sum rewards: 83.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.486', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.060', 'AMMO3': '0.159', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.270', 'weapon2': '0.320', 'WEAPON3': '0.950', 'weapon3': '3.104', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '67.000'} [2024-08-06 05:25:06,149][52663] DAMAGECOUNT value on done: 620531.0 [2024-08-06 05:25:06,149][52663] Sum rewards: 78.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.120', 'AMMO4': '0.237', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:06,228][52669] DAMAGECOUNT value on done: 631869.0 [2024-08-06 05:25:06,231][52669] Sum rewards: 79.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.125', 'weapon5': '0.134', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:07,201][52671] DAMAGECOUNT value on done: 636788.0 [2024-08-06 05:25:07,201][52671] Sum rewards: 66.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.714', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.096', 'weapon5': '0.212', 'AMMO3': '0.216', 'weapon2': '0.246', 'AMMO4': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 05:25:07,311][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:25:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 499580928. Throughput: 0: 4347.8. Samples: 124899740. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:25:07,794][52567] Avg episode reward: [(0, '73.996')] [2024-08-06 05:25:08,328][52666] DAMAGECOUNT value on done: 622303.0 [2024-08-06 05:25:08,328][52666] Sum rewards: 73.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.382', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.150', 'AMMO4': '0.174', 'weapon5': '0.178', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '59.500'} [2024-08-06 05:25:08,726][52670] DAMAGECOUNT value on done: 628230.0 [2024-08-06 05:25:08,727][52670] Sum rewards: 68.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.405', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.138', 'weapon5': '0.238', 'AMMO4': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.402', 'weapon2': '0.478', 'WEAPON3': '0.900', 'weapon3': '2.616', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '54.000'} [2024-08-06 05:25:08,924][52663] DAMAGECOUNT value on done: 632338.0 [2024-08-06 05:25:08,926][52663] Sum rewards: 75.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.221', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.198', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.502', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '65.000'} [2024-08-06 05:25:08,955][52669] DAMAGECOUNT value on done: 631049.0 [2024-08-06 05:25:08,957][52669] Sum rewards: 72.163, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.264', 'AMMO5': '0.019', 'AMMO2': '0.083', 'weapon4': '0.164', 'weapon2': '0.246', 'AMMO3': '0.278', 'weapon5': '0.296', 'AMMO4': '0.414', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.946', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:09,123][52658] DAMAGECOUNT value on done: 623440.0 [2024-08-06 05:25:09,123][52658] Sum rewards: 75.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.414', 'AMMO5': '0.021', 'AMMO2': '0.057', 'AMMO3': '0.195', 'weapon4': '0.210', 'weapon2': '0.240', 'AMMO4': '0.285', 'weapon5': '0.314', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:10,183][52671] DAMAGECOUNT value on done: 634701.0 [2024-08-06 05:25:10,184][52671] Sum rewards: 91.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.115', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.094', 'AMMO4': '0.109', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.123', 'FRAGCOUNT': '73.000'} [2024-08-06 05:25:10,746][52650] Updated weights for policy 0, policy_version 60991 (0.0012) [2024-08-06 05:25:10,901][52666] DAMAGECOUNT value on done: 615705.0 [2024-08-06 05:25:10,901][52666] Sum rewards: 79.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.224', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '65.000'} [2024-08-06 05:25:11,165][52670] DAMAGECOUNT value on done: 614536.0 [2024-08-06 05:25:11,166][52670] Sum rewards: 67.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.196', 'weapon2': '0.242', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.236', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '54.000'} [2024-08-06 05:25:11,773][52669] DAMAGECOUNT value on done: 635799.0 [2024-08-06 05:25:11,773][52669] Sum rewards: 81.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.166', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.298', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '66.000'} [2024-08-06 05:25:11,803][52663] DAMAGECOUNT value on done: 624620.0 [2024-08-06 05:25:11,807][52663] Sum rewards: 66.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.778', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.156', 'AMMO4': '0.173', 'weapon2': '0.182', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.330', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '57.000'} [2024-08-06 05:25:11,976][52658] DAMAGECOUNT value on done: 626349.0 [2024-08-06 05:25:11,979][52658] Sum rewards: 61.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.082', 'AMMO3': '0.234', 'AMMO4': '0.251', 'weapon5': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '54.000'} [2024-08-06 05:25:12,540][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:25:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 499671040. Throughput: 0: 4359.5. Samples: 124926110. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:25:12,794][52567] Avg episode reward: [(0, '73.789')] [2024-08-06 05:25:13,014][52671] DAMAGECOUNT value on done: 635752.0 [2024-08-06 05:25:13,015][52671] Sum rewards: 86.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.428', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.109', 'AMMO3': '0.208', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '71.000'} [2024-08-06 05:25:13,543][52666] DAMAGECOUNT value on done: 629908.0 [2024-08-06 05:25:13,543][52666] Sum rewards: 63.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.805', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.192', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '2.918', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '55.000'} [2024-08-06 05:25:13,859][52670] DAMAGECOUNT value on done: 624509.0 [2024-08-06 05:25:13,860][52670] Sum rewards: 84.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.117', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.661', 'FRAGCOUNT': '70.000'} [2024-08-06 05:25:14,602][52669] DAMAGECOUNT value on done: 632357.0 [2024-08-06 05:25:14,602][52669] Sum rewards: 67.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.727', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.167', 'AMMO3': '0.217', 'weapon4': '0.226', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.120', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:14,633][52663] DAMAGECOUNT value on done: 630916.0 [2024-08-06 05:25:14,634][52663] Sum rewards: 65.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.618', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.152', 'weapon4': '0.236', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.500', 'HITCOUNT': '2.810', 'weapon3': '2.898', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '57.000'} [2024-08-06 05:25:15,142][52658] DAMAGECOUNT value on done: 635960.0 [2024-08-06 05:25:15,145][52658] Sum rewards: 78.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.109', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.110', 'AMMO3': '0.202', 'weapon5': '0.232', 'AMMO4': '0.240', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '65.000'} [2024-08-06 05:25:15,384][52650] Updated weights for policy 0, policy_version 61001 (0.0013) [2024-08-06 05:25:15,650][52671] DAMAGECOUNT value on done: 644322.0 [2024-08-06 05:25:15,651][52671] Sum rewards: 72.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.645', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.171', 'weapon4': '0.204', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:16,768][52666] DAMAGECOUNT value on done: 623807.0 [2024-08-06 05:25:16,768][52666] Sum rewards: 80.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'AMMO3': '0.209', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:17,060][52670] DAMAGECOUNT value on done: 629222.0 [2024-08-06 05:25:17,061][52670] Sum rewards: 61.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.666', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.136', 'AMMO3': '0.242', 'weapon2': '0.264', 'AMMO4': '0.275', 'weapon5': '0.302', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.042', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '52.500'} [2024-08-06 05:25:17,281][52669] DAMAGECOUNT value on done: 630963.0 [2024-08-06 05:25:17,282][52669] Sum rewards: 71.472, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.691', 'AMMO5': '0.021', 'AMMO2': '0.074', 'weapon4': '0.262', 'AMMO3': '0.275', 'weapon5': '0.302', 'weapon2': '0.358', 'AMMO4': '0.372', 'ARMOR': '0.400', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.650', 'weapon3': '2.758', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:17,385][52663] DAMAGECOUNT value on done: 632875.0 [2024-08-06 05:25:17,385][52663] Sum rewards: 68.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.534', 'AMMO5': '0.004', 'weapon4': '0.008', 'AMMO2': '0.011', 'weapon5': '0.038', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.464', 'WEAPON3': '1.550', 'weapon3': '3.320', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 499761152. Throughput: 0: 4368.7. Samples: 124939290. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:25:17,802][52567] Avg episode reward: [(0, '73.171')] [2024-08-06 05:25:18,035][52666] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:25:18,185][52658] DAMAGECOUNT value on done: 626030.0 [2024-08-06 05:25:18,185][52658] Sum rewards: 85.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.560', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.134', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'weapon4': '0.382', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '68.000'} [2024-08-06 05:25:18,459][52671] DAMAGECOUNT value on done: 636047.0 [2024-08-06 05:25:18,459][52671] Sum rewards: 69.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.264', 'ARMOR': '0.009', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.204', 'weapon5': '0.232', 'AMMO3': '0.263', 'weapon2': '0.310', 'AMMO4': '0.315', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:19,397][52666] DAMAGECOUNT value on done: 627561.0 [2024-08-06 05:25:19,397][52666] Sum rewards: 95.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.110', 'AMMO4': '0.155', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.050', 'weapon3': '3.326', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '22.344', 'FRAGCOUNT': '76.000'} [2024-08-06 05:25:19,654][52670] DAMAGECOUNT value on done: 627448.0 [2024-08-06 05:25:19,655][52670] Sum rewards: 80.055, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.287', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.076', 'weapon4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.266', 'AMMO3': '0.297', 'WEAPON3': '1.700', 'weapon3': '3.272', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '68.000'} [2024-08-06 05:25:20,130][52650] Updated weights for policy 0, policy_version 61011 (0.0030) [2024-08-06 05:25:20,187][52669] DAMAGECOUNT value on done: 639974.0 [2024-08-06 05:25:20,187][52669] Sum rewards: 80.257, reward structure: {'DEATHCOUNT': '-10.500', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.094', 'AMMO4': '0.130', 'weapon5': '0.136', 'HEALTH': '0.152', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '0.950', 'weapon3': '3.214', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:20,353][52663] DAMAGECOUNT value on done: 623449.0 [2024-08-06 05:25:20,355][52663] Sum rewards: 65.028, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.114', 'AMMO3': '0.133', 'AMMO4': '0.213', 'weapon5': '0.216', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon3': '2.434', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '52.000'} [2024-08-06 05:25:20,915][52669] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 05:25:21,093][52658] DAMAGECOUNT value on done: 644472.0 [2024-08-06 05:25:21,093][52658] Sum rewards: 75.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.152', 'weapon5': '0.172', 'AMMO3': '0.213', 'AMMO4': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:21,632][52671] DAMAGECOUNT value on done: 638922.0 [2024-08-06 05:25:21,633][52671] Sum rewards: 72.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.303', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.186', 'AMMO3': '0.190', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.476', 'WEAPON3': '1.050', 'weapon3': '2.640', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '59.000'} [2024-08-06 05:25:22,316][52647] DAMAGECOUNT value on done: 668091.0 [2024-08-06 05:25:22,316][52647] Sum rewards: 63.135, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '51.000'} [2024-08-06 05:25:22,500][52666] DAMAGECOUNT value on done: 617994.0 [2024-08-06 05:25:22,502][52666] Sum rewards: 69.384, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.091', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.102', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.330', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:22,753][52670] DAMAGECOUNT value on done: 610954.0 [2024-08-06 05:25:22,753][52670] Sum rewards: 72.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.556', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.070', 'AMMO4': '0.196', 'AMMO3': '0.268', 'weapon5': '0.318', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.028', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 499843072. Throughput: 0: 4366.2. Samples: 124965510. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:25:22,794][52567] Avg episode reward: [(0, '73.440')] [2024-08-06 05:25:22,919][52669] DAMAGECOUNT value on done: 631276.0 [2024-08-06 05:25:22,921][52669] Sum rewards: 78.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.547', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.392', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '67.000'} [2024-08-06 05:25:23,587][52668] DAMAGECOUNT value on done: 629329.0 [2024-08-06 05:25:23,587][52668] Sum rewards: 77.134, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.484', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.136', 'AMMO3': '0.221', 'AMMO4': '0.294', 'weapon2': '0.318', 'weapon5': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '65.000'} [2024-08-06 05:25:24,162][52658] DAMAGECOUNT value on done: 631073.0 [2024-08-06 05:25:24,163][52658] Sum rewards: 70.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.306', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.416', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '56.000'} [2024-08-06 05:25:24,654][52650] Updated weights for policy 0, policy_version 61021 (0.0011) [2024-08-06 05:25:24,795][52671] DAMAGECOUNT value on done: 634803.0 [2024-08-06 05:25:24,795][52671] Sum rewards: 65.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.094', 'AMMO3': '0.189', 'weapon5': '0.298', 'AMMO4': '0.299', 'weapon2': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.046', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '54.000'} [2024-08-06 05:25:25,357][52666] DAMAGECOUNT value on done: 625681.0 [2024-08-06 05:25:25,357][52666] Sum rewards: 76.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.520', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.178', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:25,431][52647] DAMAGECOUNT value on done: 662033.0 [2024-08-06 05:25:25,432][52647] Sum rewards: 66.285, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.207', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.162', 'weapon4': '0.174', 'AMMO4': '0.186', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:25,636][52670] DAMAGECOUNT value on done: 622295.0 [2024-08-06 05:25:25,636][52670] Sum rewards: 73.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.094', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:25,825][52649] DAMAGECOUNT value on done: 609169.0 [2024-08-06 05:25:25,828][52649] Sum rewards: 81.613, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.882', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.125', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.303', 'WEAPON3': '1.750', 'weapon3': '3.356', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '72.000'} [2024-08-06 05:25:25,886][52669] DAMAGECOUNT value on done: 635965.0 [2024-08-06 05:25:25,887][52669] Sum rewards: 63.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.274', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.116', 'AMMO4': '0.187', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon5': '0.384', 'WEAPON5': '0.400', 'weapon2': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.460', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 05:25:26,817][52668] DAMAGECOUNT value on done: 634294.0 [2024-08-06 05:25:26,818][52668] Sum rewards: 71.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.979', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.102', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '59.000'} [2024-08-06 05:25:27,030][52658] DAMAGECOUNT value on done: 644450.0 [2024-08-06 05:25:27,031][52658] Sum rewards: 84.116, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.128', 'HEALTH': '0.135', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.324', 'weapon2': '0.484', 'WEAPON3': '0.900', 'weapon3': '2.872', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '65.000'} [2024-08-06 05:25:27,511][52671] DAMAGECOUNT value on done: 627418.0 [2024-08-06 05:25:27,511][52671] Sum rewards: 82.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.866', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.151', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.326', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '65.000'} [2024-08-06 05:25:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17613.4, 300 sec: 17467.0). Total num frames: 499941376. Throughput: 0: 4365.1. Samples: 124991870. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:25:27,794][52567] Avg episode reward: [(0, '73.121')] [2024-08-06 05:25:28,074][52666] DAMAGECOUNT value on done: 634108.0 [2024-08-06 05:25:28,075][52666] Sum rewards: 81.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.477', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.072', 'AMMO3': '0.165', 'AMMO4': '0.180', 'weapon5': '0.184', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.196', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:28,208][52647] DAMAGECOUNT value on done: 665692.0 [2024-08-06 05:25:28,209][52647] Sum rewards: 74.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.049', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.474', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:28,216][52670] DAMAGECOUNT value on done: 630244.0 [2024-08-06 05:25:28,216][52670] Sum rewards: 73.440, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.522', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon2': '0.188', 'weapon5': '0.210', 'AMMO3': '0.229', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:28,700][52669] DAMAGECOUNT value on done: 638014.0 [2024-08-06 05:25:28,702][52669] Sum rewards: 71.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.894', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.100', 'weapon5': '0.194', 'AMMO4': '0.209', 'AMMO3': '0.228', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:28,783][52649] DAMAGECOUNT value on done: 602631.0 [2024-08-06 05:25:28,783][52649] Sum rewards: 62.684, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.062', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.080', 'weapon5': '0.222', 'AMMO4': '0.241', 'AMMO3': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.600', 'weapon3': '2.842', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '56.000'} [2024-08-06 05:25:29,246][52668] DAMAGECOUNT value on done: 632906.0 [2024-08-06 05:25:29,246][52668] Sum rewards: 76.587, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.960', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '68.000'} [2024-08-06 05:25:29,624][52650] Updated weights for policy 0, policy_version 61031 (0.0030) [2024-08-06 05:25:30,029][52658] DAMAGECOUNT value on done: 627368.0 [2024-08-06 05:25:30,030][52658] Sum rewards: 60.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.556', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.145', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '50.000'} [2024-08-06 05:25:30,417][52671] DAMAGECOUNT value on done: 632953.0 [2024-08-06 05:25:30,418][52671] Sum rewards: 67.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.865', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.150', 'weapon5': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.226', 'AMMO3': '0.239', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '57.000'} [2024-08-06 05:25:31,060][52666] DAMAGECOUNT value on done: 614349.0 [2024-08-06 05:25:31,060][52666] Sum rewards: 80.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.086', 'AMMO3': '0.219', 'AMMO4': '0.248', 'weapon5': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '65.500'} [2024-08-06 05:25:31,273][52670] DAMAGECOUNT value on done: 620827.0 [2024-08-06 05:25:31,273][52670] Sum rewards: 73.458, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.145', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.106', 'AMMO4': '0.125', 'weapon5': '0.164', 'weapon2': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:31,330][52647] DAMAGECOUNT value on done: 666593.0 [2024-08-06 05:25:31,330][52647] Sum rewards: 77.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.092', 'AMMO4': '0.153', 'weapon5': '0.180', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:31,398][52649] DAMAGECOUNT value on done: 621098.0 [2024-08-06 05:25:31,399][52649] Sum rewards: 75.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.127', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:31,797][52668] DAMAGECOUNT value on done: 633941.0 [2024-08-06 05:25:31,799][52668] Sum rewards: 61.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.096', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON3': '1.500', 'HITCOUNT': '3.200', 'weapon3': '3.380', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '54.000'} [2024-08-06 05:25:31,832][52669] DAMAGECOUNT value on done: 625548.0 [2024-08-06 05:25:31,832][52669] Sum rewards: 85.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.409', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.200', 'weapon5': '0.264', 'weapon2': '0.274', 'weapon4': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.595', 'FRAGCOUNT': '68.000'} [2024-08-06 05:25:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 500023296. Throughput: 0: 4358.9. Samples: 125004750. Policy #0 lag: (min: 1.0, avg: 4.3, max: 10.0) [2024-08-06 05:25:32,794][52567] Avg episode reward: [(0, '73.174')] [2024-08-06 05:25:33,049][52658] DAMAGECOUNT value on done: 635720.0 [2024-08-06 05:25:33,053][52658] Sum rewards: 88.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.276', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.417', 'FRAGCOUNT': '72.000'} [2024-08-06 05:25:33,068][52671] DAMAGECOUNT value on done: 637799.0 [2024-08-06 05:25:33,068][52671] Sum rewards: 78.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.462', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.434', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:33,649][52666] DAMAGECOUNT value on done: 624021.0 [2024-08-06 05:25:33,650][52666] Sum rewards: 74.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.500', 'AMMO5': '0.016', 'AMMO2': '0.072', 'weapon4': '0.092', 'weapon5': '0.236', 'AMMO3': '0.262', 'weapon2': '0.268', 'AMMO4': '0.361', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.142', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:33,768][52670] DAMAGECOUNT value on done: 626242.0 [2024-08-06 05:25:33,770][52670] Sum rewards: 77.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.498', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.296', 'weapon4': '0.340', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '62.500'} [2024-08-06 05:25:34,069][52650] Updated weights for policy 0, policy_version 61041 (0.0012) [2024-08-06 05:25:34,320][52668] DAMAGECOUNT value on done: 621128.0 [2024-08-06 05:25:34,320][52668] Sum rewards: 67.399, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.638', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.200', 'weapon4': '0.210', 'AMMO4': '0.221', 'AMMO3': '0.284', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.900', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '59.000'} [2024-08-06 05:25:34,444][52647] DAMAGECOUNT value on done: 674253.0 [2024-08-06 05:25:34,444][52647] Sum rewards: 79.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:34,823][52649] DAMAGECOUNT value on done: 615955.0 [2024-08-06 05:25:34,823][52649] Sum rewards: 50.545, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.522', 'AMMO5': '0.027', 'AMMO2': '0.067', 'weapon4': '0.152', 'AMMO3': '0.230', 'weapon5': '0.282', 'AMMO4': '0.337', 'weapon2': '0.362', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '2.730', 'weapon3': '2.822', 'DAMAGECOUNT': '13.758', 'FRAGCOUNT': '48.500'} [2024-08-06 05:25:34,893][52669] DAMAGECOUNT value on done: 628634.0 [2024-08-06 05:25:34,893][52669] Sum rewards: 65.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon5': '0.210', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.500'} [2024-08-06 05:25:35,834][52671] DAMAGECOUNT value on done: 632327.0 [2024-08-06 05:25:35,834][52671] Sum rewards: 72.637, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.878', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.103', 'weapon4': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.313', 'WEAPON3': '1.950', 'weapon3': '3.380', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:35,885][52658] DAMAGECOUNT value on done: 626912.0 [2024-08-06 05:25:35,887][52658] Sum rewards: 79.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.435', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.139', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.110', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '67.000'} [2024-08-06 05:25:36,957][52668] DAMAGECOUNT value on done: 639767.0 [2024-08-06 05:25:36,959][52668] Sum rewards: 95.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.368', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.816', 'FRAGCOUNT': '80.000'} [2024-08-06 05:25:37,053][52647] DAMAGECOUNT value on done: 670395.0 [2024-08-06 05:25:37,053][52647] Sum rewards: 73.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.076', 'AMMO4': '0.121', 'weapon5': '0.134', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:37,568][52662] DAMAGECOUNT value on done: 635650.0 [2024-08-06 05:25:37,569][52662] Sum rewards: 75.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.743', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon5': '0.194', 'AMMO3': '0.221', 'weapon4': '0.270', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:37,795][52567] Fps is (10 sec: 16383.2, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 500105216. Throughput: 0: 4370.2. Samples: 125031330. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:25:37,802][52567] Avg episode reward: [(0, '73.551')] [2024-08-06 05:25:37,887][52614] Signal inference workers to stop experience collection... (11100 times) [2024-08-06 05:25:37,898][52614] Signal inference workers to resume experience collection... (11100 times) [2024-08-06 05:25:37,916][52649] DAMAGECOUNT value on done: 605510.0 [2024-08-06 05:25:37,917][52649] Sum rewards: 78.617, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.134', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'weapon4': '0.396', 'WEAPON3': '1.000', 'weapon3': '3.044', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:37,960][52650] InferenceWorker_p0-w0: stopping experience collection (11100 times) [2024-08-06 05:25:37,960][52650] InferenceWorker_p0-w0: resuming experience collection (11100 times) [2024-08-06 05:25:38,353][52669] DAMAGECOUNT value on done: 633613.0 [2024-08-06 05:25:38,353][52669] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon5': '0.088', 'weapon4': '0.128', 'AMMO4': '0.137', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.650', 'weapon3': '2.922', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.500'} [2024-08-06 05:25:38,475][52650] Updated weights for policy 0, policy_version 61051 (0.0018) [2024-08-06 05:25:38,629][52671] DAMAGECOUNT value on done: 637150.0 [2024-08-06 05:25:38,631][52671] Sum rewards: 59.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.142', 'AMMO3': '0.169', 'AMMO4': '0.208', 'weapon4': '0.274', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.710', 'weapon3': '3.044', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '51.000'} [2024-08-06 05:25:39,093][52658] DAMAGECOUNT value on done: 632587.0 [2024-08-06 05:25:39,095][52658] Sum rewards: 69.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.865', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.116', 'weapon5': '0.122', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.434', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '59.000'} [2024-08-06 05:25:39,361][52647] DAMAGECOUNT value on done: 665895.0 [2024-08-06 05:25:39,363][52647] Sum rewards: 68.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.665', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.204', 'weapon5': '0.224', 'AMMO3': '0.236', 'weapon4': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.746', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '56.000'} [2024-08-06 05:25:40,029][52668] DAMAGECOUNT value on done: 634371.0 [2024-08-06 05:25:40,030][52668] Sum rewards: 71.522, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.248', 'weapon4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:40,675][52662] DAMAGECOUNT value on done: 630616.0 [2024-08-06 05:25:40,675][52662] Sum rewards: 77.393, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.099', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.410', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '65.000'} [2024-08-06 05:25:40,909][52649] DAMAGECOUNT value on done: 619695.0 [2024-08-06 05:25:40,910][52649] Sum rewards: 70.664, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.157', 'weapon4': '0.168', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2024-08-06 05:25:41,272][52671] DAMAGECOUNT value on done: 634400.0 [2024-08-06 05:25:41,272][52671] Sum rewards: 70.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.595', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.099', 'weapon4': '0.194', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '59.000'} [2024-08-06 05:25:41,464][52669] DAMAGECOUNT value on done: 652345.0 [2024-08-06 05:25:41,465][52669] Sum rewards: 88.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.044', 'AMMO4': '0.158', 'weapon5': '0.178', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.015', 'FRAGCOUNT': '72.000'} [2024-08-06 05:25:42,171][52658] DAMAGECOUNT value on done: 619506.0 [2024-08-06 05:25:42,172][52658] Sum rewards: 65.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.879', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.132', 'AMMO4': '0.143', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.156', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '54.000'} [2024-08-06 05:25:42,641][52647] DAMAGECOUNT value on done: 652025.0 [2024-08-06 05:25:42,641][52647] Sum rewards: 79.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon4': '0.276', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:42,655][52668] DAMAGECOUNT value on done: 625240.0 [2024-08-06 05:25:42,656][52668] Sum rewards: 65.084, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.460', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon5': '0.362', 'weapon4': '0.412', 'WEAPON3': '0.950', 'weapon3': '2.626', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '52.000'} [2024-08-06 05:25:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 500195328. Throughput: 0: 4370.9. Samples: 125057390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:25:42,794][52567] Avg episode reward: [(0, '73.656')] [2024-08-06 05:25:43,338][52662] DAMAGECOUNT value on done: 640658.0 [2024-08-06 05:25:43,338][52662] Sum rewards: 62.329, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.191', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.148', 'AMMO4': '0.250', 'weapon2': '0.276', 'AMMO3': '0.320', 'weapon5': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.850', 'weapon3': '2.828', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '56.000'} [2024-08-06 05:25:43,526][52650] Updated weights for policy 0, policy_version 61061 (0.0010) [2024-08-06 05:25:44,047][52649] DAMAGECOUNT value on done: 611896.0 [2024-08-06 05:25:44,047][52649] Sum rewards: 72.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.657', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.243', 'weapon2': '0.262', 'WEAPON3': '1.450', 'HITCOUNT': '3.410', 'weapon3': '3.506', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:44,303][52671] DAMAGECOUNT value on done: 621240.0 [2024-08-06 05:25:44,303][52671] Sum rewards: 67.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.631', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO5': '0.027', 'AMMO2': '0.070', 'AMMO3': '0.189', 'weapon5': '0.338', 'AMMO4': '0.351', 'weapon2': '0.376', 'weapon4': '0.396', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.478', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '55.000'} [2024-08-06 05:25:44,546][52669] DAMAGECOUNT value on done: 639153.0 [2024-08-06 05:25:44,548][52669] Sum rewards: 73.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.022', 'weapon5': '0.084', 'AMMO4': '0.096', 'weapon2': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.500', 'weapon3': '3.530', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '61.000'} [2024-08-06 05:25:44,963][52658] DAMAGECOUNT value on done: 635897.0 [2024-08-06 05:25:44,964][52658] Sum rewards: 78.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.031', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.076', 'weapon5': '0.136', 'AMMO4': '0.141', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '64.000'} [2024-08-06 05:25:45,465][52647] DAMAGECOUNT value on done: 665664.0 [2024-08-06 05:25:45,466][52647] Sum rewards: 66.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.205', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.116', 'AMMO4': '0.173', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '56.000'} [2024-08-06 05:25:45,525][52668] DAMAGECOUNT value on done: 627656.0 [2024-08-06 05:25:45,527][52668] Sum rewards: 73.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.130', 'weapon5': '0.140', 'AMMO3': '0.159', 'AMMO4': '0.212', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.122', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:46,057][52662] DAMAGECOUNT value on done: 626245.0 [2024-08-06 05:25:46,058][52662] Sum rewards: 75.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.878', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.211', 'weapon5': '0.214', 'AMMO4': '0.220', 'weapon2': '0.264', 'weapon4': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:46,454][52649] DAMAGECOUNT value on done: 616504.0 [2024-08-06 05:25:46,454][52649] Sum rewards: 66.593, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.500', 'AMMO5': '0.025', 'AMMO2': '0.074', 'weapon4': '0.206', 'AMMO3': '0.272', 'weapon2': '0.308', 'AMMO4': '0.370', 'weapon5': '0.388', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.720', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:46,836][52671] DAMAGECOUNT value on done: 640686.0 [2024-08-06 05:25:46,836][52671] Sum rewards: 67.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.195', 'weapon4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '56.000'} [2024-08-06 05:25:47,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 500285440. Throughput: 0: 4376.0. Samples: 125070820. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:25:47,794][52567] Avg episode reward: [(0, '73.426')] [2024-08-06 05:25:47,803][52669] DAMAGECOUNT value on done: 636222.0 [2024-08-06 05:25:47,805][52669] Sum rewards: 68.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.432', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:47,957][52658] DAMAGECOUNT value on done: 628149.0 [2024-08-06 05:25:47,957][52658] Sum rewards: 64.430, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.160', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.162', 'AMMO4': '0.208', 'weapon4': '0.230', 'AMMO3': '0.274', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.014', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '57.000'} [2024-08-06 05:25:48,188][52647] DAMAGECOUNT value on done: 665235.0 [2024-08-06 05:25:48,188][52647] Sum rewards: 74.863, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.340', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.018', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.060', 'AMMO4': '0.061', 'AMMO3': '0.178', 'weapon2': '0.366', 'WEAPON3': '1.050', 'weapon3': '3.360', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:48,319][52668] DAMAGECOUNT value on done: 636100.0 [2024-08-06 05:25:48,320][52668] Sum rewards: 82.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.318', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.072', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '67.000'} [2024-08-06 05:25:48,371][52650] Updated weights for policy 0, policy_version 61071 (0.0020) [2024-08-06 05:25:48,888][52662] DAMAGECOUNT value on done: 643459.0 [2024-08-06 05:25:48,890][52662] Sum rewards: 72.414, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.490', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.100', 'AMMO4': '0.164', 'weapon4': '0.204', 'weapon2': '0.212', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.238', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:49,512][52671] DAMAGECOUNT value on done: 636502.0 [2024-08-06 05:25:49,512][52671] Sum rewards: 69.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.378', 'AMMO4': '-0.027', 'AMMO2': '-0.005', 'weapon5': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:49,711][52649] DAMAGECOUNT value on done: 618138.0 [2024-08-06 05:25:49,713][52649] Sum rewards: 67.846, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.950', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.206', 'weapon4': '0.214', 'AMMO4': '0.231', 'weapon2': '0.240', 'AMMO3': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.044', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:51,032][52669] DAMAGECOUNT value on done: 637165.0 [2024-08-06 05:25:51,032][52669] Sum rewards: 69.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.617', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.110', 'AMMO4': '0.163', 'AMMO3': '0.180', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.748', 'WEAPON3': '1.250', 'weapon3': '2.726', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '56.500'} [2024-08-06 05:25:51,049][52658] DAMAGECOUNT value on done: 628961.0 [2024-08-06 05:25:51,049][52658] Sum rewards: 83.583, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.978', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.162', 'weapon5': '0.210', 'weapon4': '0.308', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '66.000'} [2024-08-06 05:25:51,093][52647] DAMAGECOUNT value on done: 662205.0 [2024-08-06 05:25:51,093][52647] Sum rewards: 65.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.940', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.107', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '55.000'} [2024-08-06 05:25:51,110][52668] DAMAGECOUNT value on done: 632252.0 [2024-08-06 05:25:51,114][52668] Sum rewards: 69.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.332', 'AMMO5': '0.025', 'AMMO2': '0.068', 'AMMO3': '0.184', 'weapon5': '0.314', 'AMMO4': '0.341', 'weapon2': '0.394', 'weapon4': '0.438', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.496', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '57.000'} [2024-08-06 05:25:51,968][52662] DAMAGECOUNT value on done: 625290.0 [2024-08-06 05:25:51,970][52662] Sum rewards: 68.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.396', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.058', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:52,222][52649] DAMAGECOUNT value on done: 609581.0 [2024-08-06 05:25:52,223][52649] Sum rewards: 59.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.207', 'AMMO4': '0.214', 'weapon5': '0.218', 'weapon2': '0.242', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '51.000'} [2024-08-06 05:25:52,340][52671] DAMAGECOUNT value on done: 637657.0 [2024-08-06 05:25:52,341][52671] Sum rewards: 69.520, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.215', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon7': '0.086', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.178', 'AMMO4': '0.185', 'AMMO3': '0.238', 'weapon2': '0.284', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.804', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '59.000'} [2024-08-06 05:25:52,505][52650] Updated weights for policy 0, policy_version 61081 (0.0018) [2024-08-06 05:25:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 500375552. Throughput: 0: 4383.8. Samples: 125097010. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:25:52,794][52567] Avg episode reward: [(0, '72.738')] [2024-08-06 05:25:53,807][52658] DAMAGECOUNT value on done: 632210.0 [2024-08-06 05:25:53,808][52658] Sum rewards: 73.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.921', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.052', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.218', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:54,154][52669] DAMAGECOUNT value on done: 643770.0 [2024-08-06 05:25:54,154][52669] Sum rewards: 59.690, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.702', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.188', 'AMMO4': '0.298', 'weapon5': '0.312', 'weapon2': '0.318', 'weapon4': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '48.000'} [2024-08-06 05:25:54,209][52647] DAMAGECOUNT value on done: 657553.0 [2024-08-06 05:25:54,212][52647] Sum rewards: 68.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.064', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.062', 'weapon5': '0.180', 'AMMO4': '0.214', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.500', 'weapon3': '2.894', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:54,268][52668] DAMAGECOUNT value on done: 623711.0 [2024-08-06 05:25:54,268][52668] Sum rewards: 80.708, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.242', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.260', 'AMMO3': '0.261', 'WEAPON3': '1.600', 'weapon3': '3.472', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '68.000'} [2024-08-06 05:25:54,376][52660] DAMAGECOUNT value on done: 630469.0 [2024-08-06 05:25:54,377][52660] Sum rewards: 64.530, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.610', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.442', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.318', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '52.000'} [2024-08-06 05:25:54,815][52649] DAMAGECOUNT value on done: 620843.0 [2024-08-06 05:25:54,815][52649] Sum rewards: 77.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.686', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.132', 'AMMO4': '0.156', 'AMMO3': '0.199', 'weapon5': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:54,859][52662] DAMAGECOUNT value on done: 635942.0 [2024-08-06 05:25:54,862][52662] Sum rewards: 70.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.092', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 05:25:55,435][52671] DAMAGECOUNT value on done: 636982.0 [2024-08-06 05:25:55,436][52671] Sum rewards: 74.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.761', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.212', 'weapon5': '0.224', 'AMMO4': '0.265', 'weapon4': '0.270', 'weapon2': '0.306', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '63.000'} [2024-08-06 05:25:56,508][52795] DAMAGECOUNT value on done: 587379.0 [2024-08-06 05:25:56,508][52795] Sum rewards: 82.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.170', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '66.000'} [2024-08-06 05:25:56,922][52647] DAMAGECOUNT value on done: 670417.0 [2024-08-06 05:25:56,922][52647] Sum rewards: 50.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'weapon2': '0.724', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '3.002', 'DAMAGECOUNT': '12.996', 'FRAGCOUNT': '43.000'} [2024-08-06 05:25:57,207][52668] DAMAGECOUNT value on done: 616203.0 [2024-08-06 05:25:57,208][52668] Sum rewards: 76.749, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.330', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon4': '0.174', 'weapon5': '0.190', 'AMMO3': '0.263', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '66.000'} [2024-08-06 05:25:57,301][52660] DAMAGECOUNT value on done: 620798.0 [2024-08-06 05:25:57,301][52660] Sum rewards: 73.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.110', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.038', 'AMMO4': '0.046', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.262', 'WEAPON3': '1.100', 'weapon3': '3.440', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '60.000'} [2024-08-06 05:25:57,623][52649] DAMAGECOUNT value on done: 623681.0 [2024-08-06 05:25:57,628][52649] Sum rewards: 75.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.725', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.106', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '62.500'} [2024-08-06 05:25:57,694][52650] Updated weights for policy 0, policy_version 61091 (0.0020) [2024-08-06 05:25:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 500457472. Throughput: 0: 4375.3. Samples: 125123000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:25:57,794][52567] Avg episode reward: [(0, '72.741')] [2024-08-06 05:25:57,894][52662] DAMAGECOUNT value on done: 639080.0 [2024-08-06 05:25:57,894][52662] Sum rewards: 78.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.191', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:58,210][52671] DAMAGECOUNT value on done: 633172.0 [2024-08-06 05:25:58,213][52671] Sum rewards: 69.272, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.900', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.056', 'AMMO4': '0.138', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '58.000'} [2024-08-06 05:25:59,580][52795] DAMAGECOUNT value on done: 575130.0 [2024-08-06 05:25:59,582][52795] Sum rewards: 69.188, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.048', 'AMMO4': '0.136', 'weapon5': '0.178', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '55.000'} [2024-08-06 05:25:59,716][52668] DAMAGECOUNT value on done: 617377.0 [2024-08-06 05:25:59,717][52668] Sum rewards: 65.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.929', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.140', 'AMMO3': '0.231', 'AMMO4': '0.289', 'weapon5': '0.296', 'weapon2': '0.312', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '55.000'} [2024-08-06 05:25:59,852][52660] DAMAGECOUNT value on done: 634645.0 [2024-08-06 05:25:59,853][52660] Sum rewards: 70.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.142', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.123', 'weapon5': '0.146', 'weapon2': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.150', 'weapon3': '3.228', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '62.000'} [2024-08-06 05:25:59,954][52647] DAMAGECOUNT value on done: 661554.0 [2024-08-06 05:25:59,954][52647] Sum rewards: 71.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.298', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.146', 'weapon4': '0.168', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '57.000'} [2024-08-06 05:26:00,432][52662] DAMAGECOUNT value on done: 632874.0 [2024-08-06 05:26:00,432][52662] Sum rewards: 80.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.026', 'weapon4': '0.032', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.502', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '67.000'} [2024-08-06 05:26:00,518][52649] DAMAGECOUNT value on done: 622028.0 [2024-08-06 05:26:00,520][52649] Sum rewards: 67.057, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.904', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon4': '0.188', 'weapon5': '0.190', 'AMMO3': '0.247', 'AMMO4': '0.304', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.050', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:00,587][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:26:01,212][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:26:02,025][52650] Updated weights for policy 0, policy_version 61101 (0.0033) [2024-08-06 05:26:02,771][52795] DAMAGECOUNT value on done: 574891.0 [2024-08-06 05:26:02,771][52795] Sum rewards: 74.163, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.982', 'AMMO5': '0.022', 'AMMO2': '0.061', 'weapon5': '0.216', 'weapon4': '0.240', 'AMMO3': '0.258', 'AMMO4': '0.305', 'weapon2': '0.456', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.662', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 500547584. Throughput: 0: 4378.0. Samples: 125136300. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:26:02,802][52567] Avg episode reward: [(0, '72.229')] [2024-08-06 05:26:02,896][52668] DAMAGECOUNT value on done: 621094.0 [2024-08-06 05:26:02,897][52668] Sum rewards: 63.961, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.591', 'AMMO5': '0.027', 'AMMO2': '0.066', 'weapon4': '0.156', 'AMMO3': '0.224', 'weapon5': '0.326', 'AMMO4': '0.329', 'weapon2': '0.418', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '56.000'} [2024-08-06 05:26:02,954][52649] DAMAGECOUNT value on done: 621120.0 [2024-08-06 05:26:02,954][52649] Sum rewards: 73.397, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.995', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '63.000'} [2024-08-06 05:26:03,084][52647] DAMAGECOUNT value on done: 669302.0 [2024-08-06 05:26:03,084][52647] Sum rewards: 64.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.552', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.205', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.306', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '53.000'} [2024-08-06 05:26:03,124][52662] DAMAGECOUNT value on done: 642034.0 [2024-08-06 05:26:03,124][52662] Sum rewards: 78.403, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.149', 'weapon5': '0.184', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:03,129][52660] DAMAGECOUNT value on done: 639561.0 [2024-08-06 05:26:03,130][52660] Sum rewards: 85.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.499', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.034', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '71.000'} [2024-08-06 05:26:05,760][52662] DAMAGECOUNT value on done: 627999.0 [2024-08-06 05:26:05,762][52662] Sum rewards: 76.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:05,849][52668] DAMAGECOUNT value on done: 629127.0 [2024-08-06 05:26:05,850][52668] Sum rewards: 79.809, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.604', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.460', 'WEAPON3': '1.000', 'weapon3': '3.290', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:05,905][52795] DAMAGECOUNT value on done: 581558.0 [2024-08-06 05:26:05,906][52795] Sum rewards: 68.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.774', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.141', 'weapon5': '0.248', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:06,043][52647] DAMAGECOUNT value on done: 669642.0 [2024-08-06 05:26:06,045][52647] Sum rewards: 77.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.965', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.280', 'WEAPON3': '1.100', 'HITCOUNT': '3.530', 'weapon3': '3.570', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '63.000'} [2024-08-06 05:26:06,060][52649] DAMAGECOUNT value on done: 607714.0 [2024-08-06 05:26:06,061][52649] Sum rewards: 57.156, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.586', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.196', 'weapon2': '0.690', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.208', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '48.000'} [2024-08-06 05:26:06,079][52660] DAMAGECOUNT value on done: 627408.0 [2024-08-06 05:26:06,079][52660] Sum rewards: 73.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.334', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '59.000'} [2024-08-06 05:26:07,082][52650] Updated weights for policy 0, policy_version 61111 (0.0026) [2024-08-06 05:26:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 500637696. Throughput: 0: 4382.0. Samples: 125162700. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:26:07,802][52567] Avg episode reward: [(0, '72.372')] [2024-08-06 05:26:08,529][52668] DAMAGECOUNT value on done: 630388.0 [2024-08-06 05:26:08,530][52668] Sum rewards: 73.329, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.068', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon2': '0.640', 'WEAPON3': '0.850', 'weapon3': '3.044', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '57.000'} [2024-08-06 05:26:08,707][52660] DAMAGECOUNT value on done: 625479.0 [2024-08-06 05:26:08,707][52660] Sum rewards: 78.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.252', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.166', 'AMMO4': '0.173', 'AMMO3': '0.181', 'weapon4': '0.216', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.992', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '63.000'} [2024-08-06 05:26:08,712][52662] DAMAGECOUNT value on done: 631098.0 [2024-08-06 05:26:08,713][52662] Sum rewards: 67.561, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:08,745][52647] DAMAGECOUNT value on done: 652495.0 [2024-08-06 05:26:08,746][52647] Sum rewards: 69.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.140', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '57.000'} [2024-08-06 05:26:09,057][52795] DAMAGECOUNT value on done: 578202.0 [2024-08-06 05:26:09,060][52795] Sum rewards: 70.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.676', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.120', 'weapon4': '0.122', 'AMMO4': '0.155', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '59.000'} [2024-08-06 05:26:09,289][52649] DAMAGECOUNT value on done: 616090.0 [2024-08-06 05:26:09,289][52649] Sum rewards: 60.518, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.190', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.148', 'weapon4': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.100', 'weapon3': '3.236', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 05:26:09,576][52820] DAMAGECOUNT value on done: 584055.0 [2024-08-06 05:26:09,577][52820] Sum rewards: 79.888, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.086', 'WEAPON5': '0.150', 'weapon2': '0.228', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '68.000'} [2024-08-06 05:26:11,213][52662] DAMAGECOUNT value on done: 627505.0 [2024-08-06 05:26:11,215][52662] Sum rewards: 70.763, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.032', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.140', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.298', 'weapon2': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.838', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '55.000'} [2024-08-06 05:26:11,369][52668] DAMAGECOUNT value on done: 628833.0 [2024-08-06 05:26:11,370][52668] Sum rewards: 72.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.792', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.074', 'weapon4': '0.106', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.242', 'WEAPON3': '1.250', 'weapon3': '3.392', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '60.000'} [2024-08-06 05:26:11,552][52660] DAMAGECOUNT value on done: 626275.0 [2024-08-06 05:26:11,554][52660] Sum rewards: 75.735, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.762', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.270', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.208', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:11,711][52650] Updated weights for policy 0, policy_version 61121 (0.0012) [2024-08-06 05:26:11,786][52647] DAMAGECOUNT value on done: 662080.0 [2024-08-06 05:26:11,786][52647] Sum rewards: 77.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.196', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.190', 'AMMO3': '0.193', 'AMMO4': '0.206', 'weapon4': '0.282', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:11,794][52649] DAMAGECOUNT value on done: 608210.0 [2024-08-06 05:26:11,794][52649] Sum rewards: 64.083, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.972', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.126', 'AMMO3': '0.154', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '52.000'} [2024-08-06 05:26:12,217][52795] DAMAGECOUNT value on done: 590087.0 [2024-08-06 05:26:12,219][52795] Sum rewards: 78.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'weapon2': '0.152', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'weapon3': '3.544', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '68.000'} [2024-08-06 05:26:12,746][52820] DAMAGECOUNT value on done: 585449.0 [2024-08-06 05:26:12,749][52820] Sum rewards: 65.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'weapon4': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.404', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '54.000'} [2024-08-06 05:26:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 500719616. Throughput: 0: 4366.0. Samples: 125188340. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:12,794][52567] Avg episode reward: [(0, '72.047')] [2024-08-06 05:26:14,218][52668] DAMAGECOUNT value on done: 635108.0 [2024-08-06 05:26:14,218][52668] Sum rewards: 69.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.488', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.082', 'weapon2': '0.190', 'AMMO3': '0.216', 'weapon5': '0.222', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.276', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:14,240][52662] DAMAGECOUNT value on done: 636653.0 [2024-08-06 05:26:14,241][52662] Sum rewards: 67.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.997', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.130', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '59.000'} [2024-08-06 05:26:14,335][52660] DAMAGECOUNT value on done: 636028.0 [2024-08-06 05:26:14,336][52660] Sum rewards: 70.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.614', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon2': '0.200', 'weapon5': '0.230', 'AMMO3': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:14,608][52647] DAMAGECOUNT value on done: 652511.0 [2024-08-06 05:26:14,608][52647] Sum rewards: 80.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.056', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'weapon4': '0.180', 'AMMO3': '0.210', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '67.000'} [2024-08-06 05:26:14,944][52649] DAMAGECOUNT value on done: 621454.0 [2024-08-06 05:26:14,945][52649] Sum rewards: 72.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.139', 'weapon4': '0.194', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:15,415][52795] DAMAGECOUNT value on done: 592604.0 [2024-08-06 05:26:15,416][52795] Sum rewards: 61.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.173', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.153', 'AMMO4': '0.255', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '50.000'} [2024-08-06 05:26:15,881][52820] DAMAGECOUNT value on done: 586899.0 [2024-08-06 05:26:15,882][52820] Sum rewards: 67.539, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.015', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.112', 'weapon4': '0.120', 'AMMO4': '0.205', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:16,421][52650] Updated weights for policy 0, policy_version 61131 (0.0030) [2024-08-06 05:26:17,022][52668] DAMAGECOUNT value on done: 631179.0 [2024-08-06 05:26:17,023][52668] Sum rewards: 65.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.072', 'ARMOR': '0.008', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.226', 'AMMO4': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.808', 'WEAPON3': '1.250', 'weapon3': '2.592', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '56.000'} [2024-08-06 05:26:17,268][52660] DAMAGECOUNT value on done: 626058.0 [2024-08-06 05:26:17,277][52660] Sum rewards: 71.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.638', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.086', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:17,292][52662] DAMAGECOUNT value on done: 628335.0 [2024-08-06 05:26:17,292][52662] Sum rewards: 67.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon4': '0.248', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:17,739][52647] DAMAGECOUNT value on done: 657684.0 [2024-08-06 05:26:17,741][52647] Sum rewards: 78.299, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.118', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 500801536. Throughput: 0: 4370.9. Samples: 125201440. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:17,802][52567] Avg episode reward: [(0, '71.612')] [2024-08-06 05:26:17,807][52649] DAMAGECOUNT value on done: 621628.0 [2024-08-06 05:26:17,807][52649] Sum rewards: 95.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.755', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.128', 'AMMO4': '0.173', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '23.505', 'FRAGCOUNT': '76.000'} [2024-08-06 05:26:18,583][52795] DAMAGECOUNT value on done: 583501.0 [2024-08-06 05:26:18,585][52795] Sum rewards: 72.880, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.906', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO4': '0.170', 'AMMO3': '0.185', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '57.000'} [2024-08-06 05:26:19,111][52820] DAMAGECOUNT value on done: 578829.0 [2024-08-06 05:26:19,111][52820] Sum rewards: 81.498, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.670', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO3': '0.142', 'AMMO4': '0.148', 'weapon5': '0.176', 'weapon2': '0.194', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:20,337][52662] DAMAGECOUNT value on done: 641968.0 [2024-08-06 05:26:20,337][52662] Sum rewards: 64.728, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.312', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON3': '1.000', 'weapon2': '1.034', 'weapon3': '2.770', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '52.000'} [2024-08-06 05:26:20,371][52660] DAMAGECOUNT value on done: 628248.0 [2024-08-06 05:26:20,372][52660] Sum rewards: 80.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.164', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.140', 'AMMO3': '0.195', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '66.000'} [2024-08-06 05:26:20,586][52649] DAMAGECOUNT value on done: 615941.0 [2024-08-06 05:26:20,586][52649] Sum rewards: 65.795, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.416', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '54.000'} [2024-08-06 05:26:21,083][52650] Updated weights for policy 0, policy_version 61141 (0.0019) [2024-08-06 05:26:21,710][52795] DAMAGECOUNT value on done: 579683.0 [2024-08-06 05:26:21,711][52795] Sum rewards: 74.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.892', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.070', 'AMMO4': '0.178', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:22,145][52820] DAMAGECOUNT value on done: 588050.0 [2024-08-06 05:26:22,146][52820] Sum rewards: 80.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.191', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.458', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '66.000'} [2024-08-06 05:26:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 500899840. Throughput: 0: 4361.6. Samples: 125227600. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:22,795][52567] Avg episode reward: [(0, '71.864')] [2024-08-06 05:26:23,385][52660] DAMAGECOUNT value on done: 633068.0 [2024-08-06 05:26:23,385][52660] Sum rewards: 66.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.208', 'AMMO3': '0.226', 'AMMO4': '0.237', 'WEAPON5': '0.350', 'weapon4': '0.350', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.692', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:23,505][52662] DAMAGECOUNT value on done: 635837.0 [2024-08-06 05:26:23,505][52662] Sum rewards: 71.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.185', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '59.000'} [2024-08-06 05:26:24,298][52647] Large shaping reward 2.572 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('HEALTH', -0.03, -10.0)] [2024-08-06 05:26:24,998][52795] DAMAGECOUNT value on done: 588903.0 [2024-08-06 05:26:24,998][52795] Sum rewards: 69.392, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.894', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon5': '0.262', 'AMMO3': '0.278', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '2.634', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:25,192][52820] DAMAGECOUNT value on done: 579416.0 [2024-08-06 05:26:25,193][52820] Sum rewards: 73.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.201', 'weapon2': '0.666', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:25,586][52650] Updated weights for policy 0, policy_version 61151 (0.0025) [2024-08-06 05:26:26,415][52660] DAMAGECOUNT value on done: 626121.0 [2024-08-06 05:26:26,416][52660] Sum rewards: 68.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.216', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.130', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.736', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '55.000'} [2024-08-06 05:26:26,507][52662] DAMAGECOUNT value on done: 623081.0 [2024-08-06 05:26:26,511][52662] Sum rewards: 64.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.134', 'AMMO4': '0.142', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.028', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '55.000'} [2024-08-06 05:26:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 500981760. Throughput: 0: 4360.9. Samples: 125253630. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:27,794][52567] Avg episode reward: [(0, '71.727')] [2024-08-06 05:26:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061155_500981760.pth... [2024-08-06 05:26:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060644_496795648.pth [2024-08-06 05:26:28,143][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:26:28,194][52795] DAMAGECOUNT value on done: 585712.0 [2024-08-06 05:26:28,195][52795] Sum rewards: 73.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO4': '0.162', 'weapon4': '0.182', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:28,288][52820] DAMAGECOUNT value on done: 585687.0 [2024-08-06 05:26:28,288][52820] Sum rewards: 63.078, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.034', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.050', 'AMMO4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.258', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '49.000'} [2024-08-06 05:26:29,557][52662] DAMAGECOUNT value on done: 631776.0 [2024-08-06 05:26:29,557][52662] Sum rewards: 64.698, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.054', 'weapon5': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2024-08-06 05:26:29,887][52660] DAMAGECOUNT value on done: 628031.0 [2024-08-06 05:26:29,887][52660] Sum rewards: 59.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.164', 'AMMO3': '0.184', 'weapon5': '0.188', 'AMMO4': '0.209', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '51.000'} [2024-08-06 05:26:30,569][52650] Updated weights for policy 0, policy_version 61161 (0.0014) [2024-08-06 05:26:31,402][52820] DAMAGECOUNT value on done: 588657.0 [2024-08-06 05:26:31,404][52820] Sum rewards: 75.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon4': '0.290', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:31,482][52795] DAMAGECOUNT value on done: 580857.0 [2024-08-06 05:26:31,484][52795] Sum rewards: 71.741, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.110', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.334', 'weapon2': '0.468', 'WEAPON3': '2.050', 'weapon3': '3.170', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:32,664][52662] DAMAGECOUNT value on done: 626349.0 [2024-08-06 05:26:32,665][52662] Sum rewards: 77.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.585', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:32,789][52659] DAMAGECOUNT value on done: 638401.0 [2024-08-06 05:26:32,789][52659] Sum rewards: 74.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.912', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.124', 'weapon5': '0.144', 'AMMO4': '0.174', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:32,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 501063680. Throughput: 0: 4345.8. Samples: 125266380. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:32,794][52567] Avg episode reward: [(0, '71.579')] [2024-08-06 05:26:32,882][52660] DAMAGECOUNT value on done: 639769.0 [2024-08-06 05:26:32,884][52660] Sum rewards: 67.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.070', 'AMMO4': '0.101', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.162', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '55.000'} [2024-08-06 05:26:34,538][52820] DAMAGECOUNT value on done: 584305.0 [2024-08-06 05:26:34,539][52820] Sum rewards: 76.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO4': '0.101', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 05:26:34,669][52795] DAMAGECOUNT value on done: 578790.0 [2024-08-06 05:26:34,669][52795] Sum rewards: 70.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.486', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.132', 'weapon5': '0.178', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '57.500'} [2024-08-06 05:26:34,843][52811] DAMAGECOUNT value on done: 603099.0 [2024-08-06 05:26:34,844][52811] Sum rewards: 78.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.276', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.124', 'weapon5': '0.170', 'weapon2': '0.234', 'AMMO4': '0.240', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.156', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '67.000'} [2024-08-06 05:26:35,195][52650] Updated weights for policy 0, policy_version 61171 (0.0020) [2024-08-06 05:26:35,750][52659] DAMAGECOUNT value on done: 631100.0 [2024-08-06 05:26:35,751][52659] Sum rewards: 69.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.166', 'weapon5': '0.172', 'AMMO4': '0.237', 'weapon2': '0.248', 'weapon4': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '57.000'} [2024-08-06 05:26:35,932][52660] DAMAGECOUNT value on done: 645067.0 [2024-08-06 05:26:35,934][52660] Sum rewards: 68.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.114', 'weapon4': '0.148', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:37,593][52820] DAMAGECOUNT value on done: 590593.0 [2024-08-06 05:26:37,595][52820] Sum rewards: 71.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.136', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.112', 'AMMO4': '0.158', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '59.000'} [2024-08-06 05:26:37,751][52795] DAMAGECOUNT value on done: 587197.0 [2024-08-06 05:26:37,751][52795] Sum rewards: 80.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.096', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '66.000'} [2024-08-06 05:26:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 501153792. Throughput: 0: 4343.8. Samples: 125292480. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:37,794][52567] Avg episode reward: [(0, '71.622')] [2024-08-06 05:26:37,987][52811] DAMAGECOUNT value on done: 584136.0 [2024-08-06 05:26:37,989][52811] Sum rewards: 62.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.249', 'WEAPON1': '0.020', 'AMMO5': '0.024', 'AMMO2': '0.073', 'weapon4': '0.188', 'AMMO3': '0.208', 'weapon5': '0.210', 'weapon2': '0.316', 'AMMO4': '0.367', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '2.986', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '54.000'} [2024-08-06 05:26:38,029][52664] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.093, -31.0), ('weapon5', 0.002)] [2024-08-06 05:26:38,793][52659] DAMAGECOUNT value on done: 637642.0 [2024-08-06 05:26:38,797][52659] Sum rewards: 85.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.174', 'AMMO3': '0.198', 'weapon2': '0.290', 'weapon4': '0.382', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '68.000'} [2024-08-06 05:26:38,869][52660] DAMAGECOUNT value on done: 627324.0 [2024-08-06 05:26:38,872][52660] Sum rewards: 86.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.903', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO4': '0.181', 'AMMO3': '0.215', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.739', 'FRAGCOUNT': '70.000'} [2024-08-06 05:26:39,622][52650] Updated weights for policy 0, policy_version 61181 (0.0013) [2024-08-06 05:26:40,876][52795] DAMAGECOUNT value on done: 573319.0 [2024-08-06 05:26:40,877][52795] Sum rewards: 73.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.089', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:40,885][52820] DAMAGECOUNT value on done: 582403.0 [2024-08-06 05:26:40,885][52820] Sum rewards: 80.046, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.158', 'AMMO4': '0.159', 'AMMO3': '0.197', 'weapon5': '0.224', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:41,135][52660] DAMAGECOUNT value on done: 636702.0 [2024-08-06 05:26:41,135][52660] Sum rewards: 75.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO5': '0.011', 'ARMOR': '0.012', 'AMMO2': '0.045', 'weapon5': '0.168', 'weapon2': '0.216', 'AMMO4': '0.226', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:41,140][52811] DAMAGECOUNT value on done: 584269.0 [2024-08-06 05:26:41,140][52811] Sum rewards: 74.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.360', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.082', 'weapon5': '0.148', 'AMMO4': '0.217', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '63.000'} [2024-08-06 05:26:41,534][52659] DAMAGECOUNT value on done: 630949.0 [2024-08-06 05:26:41,535][52659] Sum rewards: 83.460, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.141', 'AMMO4': '0.160', 'weapon5': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.300', 'HEALTH': '0.309', 'weapon4': '0.372', 'WEAPON3': '0.850', 'weapon3': '2.818', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:42,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 501252096. Throughput: 0: 4348.0. Samples: 125318660. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:42,796][52567] Avg episode reward: [(0, '72.146')] [2024-08-06 05:26:43,309][52665] DAMAGECOUNT value on done: 620791.0 [2024-08-06 05:26:43,312][52665] Sum rewards: 69.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.068', 'weapon5': '0.212', 'AMMO3': '0.215', 'AMMO4': '0.244', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '56.000'} [2024-08-06 05:26:43,952][52660] DAMAGECOUNT value on done: 628610.0 [2024-08-06 05:26:43,952][52660] Sum rewards: 70.640, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.380', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.070', 'AMMO4': '0.136', 'weapon5': '0.168', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:44,087][52795] DAMAGECOUNT value on done: 590913.0 [2024-08-06 05:26:44,088][52795] Sum rewards: 70.107, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.129', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.174', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.230', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '56.000'} [2024-08-06 05:26:44,097][52820] DAMAGECOUNT value on done: 587938.0 [2024-08-06 05:26:44,101][52820] Sum rewards: 77.525, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.292', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.175', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.000'} [2024-08-06 05:26:44,211][52811] DAMAGECOUNT value on done: 585473.0 [2024-08-06 05:26:44,211][52811] Sum rewards: 66.141, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.500', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.134', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.526', 'WEAPON3': '0.750', 'weapon2': '0.754', 'weapon3': '2.346', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '52.000'} [2024-08-06 05:26:44,485][52659] DAMAGECOUNT value on done: 629099.0 [2024-08-06 05:26:44,487][52659] Sum rewards: 80.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.385', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.112', 'weapon5': '0.118', 'AMMO4': '0.127', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '3.126', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:44,797][52650] Updated weights for policy 0, policy_version 61191 (0.0033) [2024-08-06 05:26:45,964][52665] DAMAGECOUNT value on done: 635048.0 [2024-08-06 05:26:45,965][52665] Sum rewards: 67.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.250', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon4': '0.152', 'AMMO3': '0.229', 'weapon5': '0.258', 'weapon2': '0.266', 'AMMO4': '0.287', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '57.000'} [2024-08-06 05:26:46,607][52660] DAMAGECOUNT value on done: 626399.0 [2024-08-06 05:26:46,609][52660] Sum rewards: 58.586, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.426', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.130', 'weapon5': '0.186', 'AMMO3': '0.191', 'AMMO4': '0.294', 'weapon2': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.090', 'DAMAGECOUNT': '14.454', 'FRAGCOUNT': '49.000'} [2024-08-06 05:26:47,201][52795] DAMAGECOUNT value on done: 585010.0 [2024-08-06 05:26:47,203][52795] Sum rewards: 70.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.225', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.126', 'AMMO4': '0.167', 'AMMO3': '0.223', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '60.000'} [2024-08-06 05:26:47,292][52820] DAMAGECOUNT value on done: 595187.0 [2024-08-06 05:26:47,296][52820] Sum rewards: 77.421, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.134', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '61.000'} [2024-08-06 05:26:47,373][52811] DAMAGECOUNT value on done: 591743.0 [2024-08-06 05:26:47,374][52811] Sum rewards: 75.353, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.938', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.118', 'weapon5': '0.134', 'AMMO4': '0.255', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.800', 'weapon3': '3.126', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '66.000'} [2024-08-06 05:26:47,619][52659] DAMAGECOUNT value on done: 636572.0 [2024-08-06 05:26:47,619][52659] Sum rewards: 71.860, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.850', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.148', 'weapon4': '0.166', 'AMMO4': '0.256', 'weapon2': '0.278', 'AMMO3': '0.301', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.072', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '63.000'} [2024-08-06 05:26:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 501325824. Throughput: 0: 4342.9. Samples: 125331730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:26:47,794][52567] Avg episode reward: [(0, '72.338')] [2024-08-06 05:26:49,033][52665] DAMAGECOUNT value on done: 632791.0 [2024-08-06 05:26:49,054][52665] Sum rewards: 79.222, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.688', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.116', 'weapon5': '0.146', 'weapon2': '0.194', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '66.000'} [2024-08-06 05:26:49,435][52660] DAMAGECOUNT value on done: 620793.0 [2024-08-06 05:26:49,437][52660] Sum rewards: 65.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.722', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.430', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.222', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '55.000'} [2024-08-06 05:26:49,548][52650] Updated weights for policy 0, policy_version 61201 (0.0040) [2024-08-06 05:26:50,328][52795] DAMAGECOUNT value on done: 578652.0 [2024-08-06 05:26:50,329][52795] Sum rewards: 85.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.025', 'AMMO2': '0.054', 'AMMO3': '0.182', 'weapon4': '0.190', 'weapon5': '0.222', 'AMMO4': '0.271', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '70.000'} [2024-08-06 05:26:50,377][52820] DAMAGECOUNT value on done: 589820.0 [2024-08-06 05:26:50,377][52820] Sum rewards: 78.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:50,482][52811] DAMAGECOUNT value on done: 597731.0 [2024-08-06 05:26:50,482][52811] Sum rewards: 64.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.366', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.600', 'weapon3': '2.974', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '56.000'} [2024-08-06 05:26:50,649][52659] DAMAGECOUNT value on done: 630973.0 [2024-08-06 05:26:50,650][52659] Sum rewards: 71.217, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.450', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.206', 'weapon4': '0.214', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.550', 'weapon3': '2.790', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '60.500'} [2024-08-06 05:26:51,911][52665] DAMAGECOUNT value on done: 625407.0 [2024-08-06 05:26:51,913][52665] Sum rewards: 94.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.378', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.203', 'weapon4': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.513', 'FRAGCOUNT': '76.000'} [2024-08-06 05:26:52,026][52794] DAMAGECOUNT value on done: 635318.0 [2024-08-06 05:26:52,026][52794] Sum rewards: 79.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.157', 'weapon5': '0.158', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:52,028][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:26:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 501415936. Throughput: 0: 4340.4. Samples: 125358020. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:26:52,794][52567] Avg episode reward: [(0, '72.751')] [2024-08-06 05:26:53,421][52795] DAMAGECOUNT value on done: 585280.0 [2024-08-06 05:26:53,422][52795] Sum rewards: 82.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.064', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.410', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '68.000'} [2024-08-06 05:26:53,494][52820] DAMAGECOUNT value on done: 593488.0 [2024-08-06 05:26:53,496][52820] Sum rewards: 79.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:53,534][52811] DAMAGECOUNT value on done: 594914.0 [2024-08-06 05:26:53,537][52811] Sum rewards: 75.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.251', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '64.000'} [2024-08-06 05:26:53,820][52659] DAMAGECOUNT value on done: 629035.0 [2024-08-06 05:26:53,821][52659] Sum rewards: 76.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.292', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.094', 'AMMO4': '0.229', 'AMMO3': '0.253', 'weapon5': '0.262', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:54,131][52650] Updated weights for policy 0, policy_version 61211 (0.0021) [2024-08-06 05:26:54,434][52664] DAMAGECOUNT value on done: 656020.0 [2024-08-06 05:26:54,434][52664] Sum rewards: 64.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.402', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO3': '0.137', 'AMMO4': '0.147', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '0.950', 'HITCOUNT': '3.020', 'weapon3': '3.160', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '51.000'} [2024-08-06 05:26:54,617][52665] DAMAGECOUNT value on done: 615461.0 [2024-08-06 05:26:54,618][52665] Sum rewards: 69.442, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.654', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.130', 'weapon5': '0.158', 'AMMO3': '0.263', 'AMMO4': '0.265', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '59.000'} [2024-08-06 05:26:55,495][52794] DAMAGECOUNT value on done: 640551.0 [2024-08-06 05:26:55,496][52794] Sum rewards: 72.874, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.674', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.078', 'weapon5': '0.142', 'AMMO4': '0.227', 'AMMO3': '0.253', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 05:26:56,552][52795] DAMAGECOUNT value on done: 591681.0 [2024-08-06 05:26:56,552][52795] Sum rewards: 81.041, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.228', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.162', 'AMMO4': '0.173', 'AMMO3': '0.244', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '69.000'} [2024-08-06 05:26:56,635][52820] DAMAGECOUNT value on done: 587743.0 [2024-08-06 05:26:56,639][52820] Sum rewards: 54.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.552', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon7': '0.092', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.197', 'weapon5': '0.204', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.396', 'HITCOUNT': '2.600', 'DAMAGECOUNT': '12.957', 'FRAGCOUNT': '47.500'} [2024-08-06 05:26:56,661][52811] DAMAGECOUNT value on done: 585803.0 [2024-08-06 05:26:56,661][52811] Sum rewards: 66.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.618', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.108', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.214', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '58.000'} [2024-08-06 05:26:57,000][52659] DAMAGECOUNT value on done: 636240.0 [2024-08-06 05:26:57,008][52659] Sum rewards: 67.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.446', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.190', 'weapon4': '0.204', 'AMMO4': '0.205', 'weapon5': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2024-08-06 05:26:57,490][52665] DAMAGECOUNT value on done: 621984.0 [2024-08-06 05:26:57,492][52665] Sum rewards: 80.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.188', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.116', 'AMMO3': '0.236', 'weapon5': '0.274', 'AMMO4': '0.297', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '66.000'} [2024-08-06 05:26:57,636][52664] DAMAGECOUNT value on done: 659480.0 [2024-08-06 05:26:57,636][52664] Sum rewards: 65.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.060', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.608', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.132', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '54.000'} [2024-08-06 05:26:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 501506048. Throughput: 0: 4351.1. Samples: 125384140. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:26:57,794][52567] Avg episode reward: [(0, '72.587')] [2024-08-06 05:26:58,411][52794] DAMAGECOUNT value on done: 640306.0 [2024-08-06 05:26:58,411][52794] Sum rewards: 81.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '65.000'} [2024-08-06 05:26:58,820][52650] Updated weights for policy 0, policy_version 61221 (0.0029) [2024-08-06 05:26:59,456][52659] DAMAGECOUNT value on done: 639803.0 [2024-08-06 05:26:59,457][52659] Sum rewards: 71.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.662', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.096', 'AMMO3': '0.207', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '60.000'} [2024-08-06 05:26:59,746][52811] DAMAGECOUNT value on done: 599299.0 [2024-08-06 05:26:59,747][52811] Sum rewards: 76.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.910', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.151', 'weapon2': '0.732', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '60.000'} [2024-08-06 05:26:59,905][52665] DAMAGECOUNT value on done: 626024.0 [2024-08-06 05:26:59,907][52665] Sum rewards: 74.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.822', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.215', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '62.000'} [2024-08-06 05:26:59,910][52820] DAMAGECOUNT value on done: 589701.0 [2024-08-06 05:26:59,911][52820] Sum rewards: 83.230, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.115', 'weapon5': '0.140', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'HEALTH': '0.295', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '67.000'} [2024-08-06 05:27:00,023][52647] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:27:00,676][52664] DAMAGECOUNT value on done: 659082.0 [2024-08-06 05:27:00,676][52664] Sum rewards: 82.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.406', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '67.000'} [2024-08-06 05:27:01,382][52794] DAMAGECOUNT value on done: 629555.0 [2024-08-06 05:27:01,383][52794] Sum rewards: 60.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'ARMOR': '0.008', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon5': '0.182', 'AMMO3': '0.190', 'weapon4': '0.232', 'AMMO4': '0.324', 'weapon2': '0.374', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.670', 'weapon3': '2.952', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '53.000'} [2024-08-06 05:27:02,393][52665] DAMAGECOUNT value on done: 623400.0 [2024-08-06 05:27:02,401][52665] Sum rewards: 64.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.262', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.134', 'AMMO4': '0.223', 'weapon5': '0.230', 'AMMO3': '0.243', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.550', 'weapon3': '2.894', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '54.500'} [2024-08-06 05:27:02,680][52659] DAMAGECOUNT value on done: 629920.0 [2024-08-06 05:27:02,681][52659] Sum rewards: 65.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.626', 'AMMO2': '0.016', 'AMMO5': '0.017', 'weapon4': '0.048', 'weapon5': '0.060', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.362', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '57.000'} [2024-08-06 05:27:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 501587968. Throughput: 0: 4351.6. Samples: 125397260. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:27:02,794][52567] Avg episode reward: [(0, '72.829')] [2024-08-06 05:27:02,917][52820] DAMAGECOUNT value on done: 599736.0 [2024-08-06 05:27:02,919][52820] Sum rewards: 79.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.595', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.122', 'weapon5': '0.126', 'weapon2': '0.240', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.340', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:02,931][52811] DAMAGECOUNT value on done: 590539.0 [2024-08-06 05:27:02,923][52614] Signal inference workers to stop experience collection... (11150 times) [2024-08-06 05:27:02,933][52614] Signal inference workers to resume experience collection... (11150 times) [2024-08-06 05:27:02,932][52811] Sum rewards: 69.219, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.216', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.235', 'weapon2': '0.242', 'weapon5': '0.252', 'AMMO4': '0.274', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '59.000'} [2024-08-06 05:27:03,020][52650] InferenceWorker_p0-w0: stopping experience collection (11150 times) [2024-08-06 05:27:03,020][52650] InferenceWorker_p0-w0: resuming experience collection (11150 times) [2024-08-06 05:27:03,252][52650] Updated weights for policy 0, policy_version 61231 (0.0026) [2024-08-06 05:27:03,803][52664] DAMAGECOUNT value on done: 650547.0 [2024-08-06 05:27:03,803][52664] Sum rewards: 67.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.554', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.153', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.154', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '56.000'} [2024-08-06 05:27:04,022][52794] DAMAGECOUNT value on done: 630587.0 [2024-08-06 05:27:04,022][52794] Sum rewards: 73.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.492', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.338', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '63.000'} [2024-08-06 05:27:05,087][52665] DAMAGECOUNT value on done: 635391.0 [2024-08-06 05:27:05,087][52665] Sum rewards: 87.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.219', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '72.000'} [2024-08-06 05:27:05,881][52659] DAMAGECOUNT value on done: 638731.0 [2024-08-06 05:27:05,881][52820] DAMAGECOUNT value on done: 597548.0 [2024-08-06 05:27:05,883][52659] Sum rewards: 74.247, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.034', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.116', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.420', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '64.000'} [2024-08-06 05:27:05,883][52820] Sum rewards: 79.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.146', 'AMMO4': '0.199', 'AMMO3': '0.207', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '65.000'} [2024-08-06 05:27:06,183][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:27:06,185][52811] DAMAGECOUNT value on done: 595075.0 [2024-08-06 05:27:06,186][52811] Sum rewards: 70.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.175', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.098', 'AMMO3': '0.199', 'weapon5': '0.226', 'AMMO4': '0.259', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '57.000'} [2024-08-06 05:27:06,904][52794] DAMAGECOUNT value on done: 634269.0 [2024-08-06 05:27:06,907][52794] Sum rewards: 73.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.200', 'weapon3': '3.346', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '58.500'} [2024-08-06 05:27:06,924][52664] DAMAGECOUNT value on done: 659008.0 [2024-08-06 05:27:06,924][52664] Sum rewards: 73.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.712', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.184', 'weapon2': '0.230', 'weapon5': '0.240', 'AMMO4': '0.244', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:07,170][52671] Large shaping reward 2.602 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 05:27:07,280][52659] Large shaping reward 2.607 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon5', 0.002)] [2024-08-06 05:27:07,756][52665] DAMAGECOUNT value on done: 624654.0 [2024-08-06 05:27:07,758][52665] Sum rewards: 79.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.366', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '67.000'} [2024-08-06 05:27:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 501678080. Throughput: 0: 4350.0. Samples: 125423350. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:27:07,794][52567] Avg episode reward: [(0, '73.161')] [2024-08-06 05:27:08,210][52650] Updated weights for policy 0, policy_version 61241 (0.0027) [2024-08-06 05:27:08,536][52667] DAMAGECOUNT value on done: 633599.0 [2024-08-06 05:27:08,536][52667] Sum rewards: 67.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.604', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.159', 'weapon5': '0.202', 'weapon4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '54.000'} [2024-08-06 05:27:08,869][52659] DAMAGECOUNT value on done: 630622.0 [2024-08-06 05:27:08,871][52659] Sum rewards: 81.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.098', 'weapon5': '0.110', 'AMMO4': '0.116', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:09,033][52820] DAMAGECOUNT value on done: 583536.0 [2024-08-06 05:27:09,033][52820] Sum rewards: 76.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.300', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.181', 'AMMO3': '0.212', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:09,156][52803] DAMAGECOUNT value on done: 590909.0 [2024-08-06 05:27:09,158][52803] Sum rewards: 78.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.011', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.065', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.322', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '66.500'} [2024-08-06 05:27:09,209][52811] DAMAGECOUNT value on done: 599416.0 [2024-08-06 05:27:09,209][52811] Sum rewards: 73.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.892', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.162', 'AMMO3': '0.182', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.832', 'WEAPON3': '1.050', 'weapon3': '2.668', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:10,064][52794] DAMAGECOUNT value on done: 638202.0 [2024-08-06 05:27:10,065][52794] Sum rewards: 72.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.905', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.143', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.360', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:10,123][52664] DAMAGECOUNT value on done: 654064.0 [2024-08-06 05:27:10,124][52664] Sum rewards: 68.767, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.850', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.082', 'AMMO3': '0.130', 'AMMO4': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '0.850', 'weapon3': '3.228', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '54.000'} [2024-08-06 05:27:10,238][52665] DAMAGECOUNT value on done: 633698.0 [2024-08-06 05:27:10,238][52665] Sum rewards: 67.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.946', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.084', 'weapon4': '0.086', 'AMMO4': '0.123', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:11,287][52667] DAMAGECOUNT value on done: 640641.0 [2024-08-06 05:27:11,287][52667] Sum rewards: 64.379, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.235', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.316', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '52.000'} [2024-08-06 05:27:11,868][52659] DAMAGECOUNT value on done: 630612.0 [2024-08-06 05:27:11,869][52659] Sum rewards: 76.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '65.000'} [2024-08-06 05:27:12,173][52803] DAMAGECOUNT value on done: 587990.0 [2024-08-06 05:27:12,175][52803] Sum rewards: 75.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.916', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon2': '0.170', 'weapon5': '0.192', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:12,324][52811] DAMAGECOUNT value on done: 590167.0 [2024-08-06 05:27:12,326][52811] Sum rewards: 90.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.146', 'AMMO4': '0.151', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.883', 'FRAGCOUNT': '74.000'} [2024-08-06 05:27:12,756][52794] DAMAGECOUNT value on done: 625293.0 [2024-08-06 05:27:12,765][52794] Sum rewards: 67.331, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.240', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.132', 'AMMO3': '0.136', 'weapon2': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.490', 'WEAPON3': '0.900', 'HITCOUNT': '3.010', 'weapon3': '3.072', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '52.000'} [2024-08-06 05:27:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 501760000. Throughput: 0: 4357.6. Samples: 125449720. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:27:12,794][52567] Avg episode reward: [(0, '73.348')] [2024-08-06 05:27:12,929][52650] Updated weights for policy 0, policy_version 61251 (0.0030) [2024-08-06 05:27:13,151][52665] DAMAGECOUNT value on done: 629999.0 [2024-08-06 05:27:13,168][52665] Sum rewards: 61.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.074', 'weapon5': '0.158', 'AMMO3': '0.261', 'weapon2': '0.286', 'AMMO4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '3.090', 'weapon3': '3.174', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '53.000'} [2024-08-06 05:27:13,290][52664] DAMAGECOUNT value on done: 654958.0 [2024-08-06 05:27:13,291][52664] Sum rewards: 75.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.945', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.182', 'weapon5': '0.184', 'AMMO4': '0.238', 'weapon4': '0.254', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:14,380][52667] DAMAGECOUNT value on done: 635862.0 [2024-08-06 05:27:14,383][52667] Sum rewards: 68.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.122', 'weapon5': '0.152', 'WEAPON4': '0.250', 'weapon2': '0.256', 'AMMO3': '0.271', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.210', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:14,919][52659] DAMAGECOUNT value on done: 644991.0 [2024-08-06 05:27:14,919][52659] Sum rewards: 86.085, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.704', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.155', 'AMMO4': '0.157', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'weapon4': '0.430', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '67.000'} [2024-08-06 05:27:15,341][52803] DAMAGECOUNT value on done: 594498.0 [2024-08-06 05:27:15,342][52803] Sum rewards: 72.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.706', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.130', 'WEAPON4': '0.150', 'weapon2': '0.156', 'AMMO4': '0.172', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.470', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:15,404][52811] DAMAGECOUNT value on done: 586926.0 [2024-08-06 05:27:15,407][52811] Sum rewards: 79.930, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.800', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.146', 'AMMO4': '0.171', 'AMMO3': '0.267', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.258', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '68.000'} [2024-08-06 05:27:15,565][52794] DAMAGECOUNT value on done: 638489.0 [2024-08-06 05:27:15,569][52794] Sum rewards: 83.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.102', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '70.000'} [2024-08-06 05:27:15,908][52664] DAMAGECOUNT value on done: 648811.0 [2024-08-06 05:27:15,909][52664] Sum rewards: 80.060, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.117', 'weapon5': '0.140', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:15,983][52665] DAMAGECOUNT value on done: 629198.0 [2024-08-06 05:27:15,987][52665] Sum rewards: 61.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.172', 'AMMO4': '0.183', 'AMMO3': '0.231', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '2.732', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '52.000'} [2024-08-06 05:27:17,396][52667] DAMAGECOUNT value on done: 637100.0 [2024-08-06 05:27:17,398][52667] Sum rewards: 78.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon4': '0.066', 'weapon5': '0.114', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'AMMO4': '0.265', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:17,404][52650] Updated weights for policy 0, policy_version 61261 (0.0021) [2024-08-06 05:27:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 501858304. Throughput: 0: 4363.1. Samples: 125462720. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:27:17,794][52567] Avg episode reward: [(0, '73.682')] [2024-08-06 05:27:18,242][52659] DAMAGECOUNT value on done: 635621.0 [2024-08-06 05:27:18,244][52659] Sum rewards: 75.098, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.184', 'AMMO4': '0.215', 'AMMO3': '0.217', 'weapon5': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '61.000'} [2024-08-06 05:27:18,531][52803] DAMAGECOUNT value on done: 596500.0 [2024-08-06 05:27:18,531][52803] Sum rewards: 68.127, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.428', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.254', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '56.000'} [2024-08-06 05:27:18,551][52664] DAMAGECOUNT value on done: 661836.0 [2024-08-06 05:27:18,551][52664] Sum rewards: 85.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.682', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.180', 'weapon4': '0.198', 'weapon2': '0.234', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.130', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '22.188', 'FRAGCOUNT': '71.000'} [2024-08-06 05:27:18,573][52811] DAMAGECOUNT value on done: 590603.0 [2024-08-06 05:27:18,575][52811] Sum rewards: 70.159, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.142', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.142', 'AMMO4': '0.158', 'weapon5': '0.190', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.700', 'weapon3': '2.956', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '61.000'} [2024-08-06 05:27:18,624][52665] DAMAGECOUNT value on done: 626242.0 [2024-08-06 05:27:18,627][52665] Sum rewards: 73.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.080', 'AMMO4': '0.124', 'AMMO3': '0.174', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '59.000'} [2024-08-06 05:27:18,724][52794] DAMAGECOUNT value on done: 630706.0 [2024-08-06 05:27:18,724][52794] Sum rewards: 74.243, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.620', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.121', 'weapon5': '0.124', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.018', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:20,203][52667] DAMAGECOUNT value on done: 642791.0 [2024-08-06 05:27:20,204][52667] Sum rewards: 81.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.957', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.260', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '68.000'} [2024-08-06 05:27:21,120][52665] DAMAGECOUNT value on done: 625278.0 [2024-08-06 05:27:21,120][52665] Sum rewards: 69.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.820', 'AMMO5': '0.026', 'AMMO2': '0.064', 'weapon5': '0.182', 'AMMO3': '0.212', 'weapon4': '0.262', 'weapon2': '0.308', 'AMMO4': '0.322', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '59.000'} [2024-08-06 05:27:21,161][52659] DAMAGECOUNT value on done: 641181.0 [2024-08-06 05:27:21,163][52659] Sum rewards: 64.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.116', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.074', 'weapon5': '0.086', 'AMMO4': '0.122', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.460', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '52.500'} [2024-08-06 05:27:21,589][52803] DAMAGECOUNT value on done: 592931.0 [2024-08-06 05:27:21,589][52803] Sum rewards: 72.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.839', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.090', 'AMMO4': '0.203', 'weapon5': '0.214', 'AMMO3': '0.232', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '61.000'} [2024-08-06 05:27:21,682][52811] DAMAGECOUNT value on done: 589291.0 [2024-08-06 05:27:21,683][52811] Sum rewards: 70.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.552', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.276', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.468', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:21,866][52664] DAMAGECOUNT value on done: 653721.0 [2024-08-06 05:27:21,866][52664] Sum rewards: 74.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.682', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.096', 'weapon5': '0.164', 'AMMO4': '0.211', 'weapon2': '0.248', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '63.000'} [2024-08-06 05:27:21,881][52794] DAMAGECOUNT value on done: 629010.0 [2024-08-06 05:27:21,881][52794] Sum rewards: 68.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.225', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.108', 'AMMO4': '0.198', 'weapon5': '0.216', 'AMMO3': '0.228', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.158', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '57.000'} [2024-08-06 05:27:22,305][52650] Updated weights for policy 0, policy_version 61271 (0.0028) [2024-08-06 05:27:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 501940224. Throughput: 0: 4370.0. Samples: 125489130. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:27:22,802][52567] Avg episode reward: [(0, '73.936')] [2024-08-06 05:27:23,165][52667] DAMAGECOUNT value on done: 643818.0 [2024-08-06 05:27:23,167][52667] Sum rewards: 74.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.124', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.564', 'WEAPON3': '1.600', 'weapon3': '2.910', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '64.000'} [2024-08-06 05:27:23,580][52659] DAMAGECOUNT value on done: 632557.0 [2024-08-06 05:27:23,580][52659] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.596', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO4': '0.201', 'AMMO3': '0.245', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.210', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:23,863][52665] DAMAGECOUNT value on done: 625131.0 [2024-08-06 05:27:23,864][52665] Sum rewards: 76.080, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.192', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.212', 'weapon4': '0.278', 'AMMO4': '0.305', 'weapon5': '0.306', 'weapon2': '0.312', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '63.000'} [2024-08-06 05:27:24,676][52803] DAMAGECOUNT value on done: 584919.0 [2024-08-06 05:27:24,676][52803] Sum rewards: 67.299, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.660', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.118', 'AMMO4': '0.131', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.352', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 05:27:24,749][52811] DAMAGECOUNT value on done: 592904.0 [2024-08-06 05:27:24,750][52811] Sum rewards: 74.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.638', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.122', 'AMMO4': '0.205', 'weapon4': '0.208', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '64.000'} [2024-08-06 05:27:24,969][52664] DAMAGECOUNT value on done: 661575.0 [2024-08-06 05:27:24,970][52664] Sum rewards: 71.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.342', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.364', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:25,055][52794] DAMAGECOUNT value on done: 633501.0 [2024-08-06 05:27:25,056][52794] Sum rewards: 77.070, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.134', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.600', 'weapon3': '3.208', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:26,269][52667] DAMAGECOUNT value on done: 636382.0 [2024-08-06 05:27:26,271][52667] Sum rewards: 74.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.715', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO3': '0.166', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.952', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:26,301][52665] DAMAGECOUNT value on done: 625448.0 [2024-08-06 05:27:26,302][52665] Sum rewards: 72.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.646', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon2': '0.188', 'AMMO3': '0.194', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '57.000'} [2024-08-06 05:27:26,427][52659] DAMAGECOUNT value on done: 639190.0 [2024-08-06 05:27:26,427][52659] Sum rewards: 66.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon4': '0.052', 'weapon5': '0.094', 'AMMO3': '0.209', 'weapon2': '0.230', 'WEAPON5': '0.250', 'AMMO4': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.448', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 05:27:26,989][52650] Updated weights for policy 0, policy_version 61281 (0.0016) [2024-08-06 05:27:27,769][52803] DAMAGECOUNT value on done: 585350.0 [2024-08-06 05:27:27,770][52803] Sum rewards: 67.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.178', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.164', 'weapon4': '0.166', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 502022144. Throughput: 0: 4364.7. Samples: 125515070. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 05:27:27,794][52567] Avg episode reward: [(0, '73.616')] [2024-08-06 05:27:27,939][52794] DAMAGECOUNT value on done: 627608.0 [2024-08-06 05:27:27,941][52794] Sum rewards: 73.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.439', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon2': '0.170', 'AMMO3': '0.190', 'AMMO4': '0.191', 'weapon5': '0.192', 'weapon4': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:27,991][52811] DAMAGECOUNT value on done: 596509.0 [2024-08-06 05:27:27,991][52811] Sum rewards: 60.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.850', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.084', 'weapon5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.112', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '54.000'} [2024-08-06 05:27:28,146][52664] DAMAGECOUNT value on done: 660838.0 [2024-08-06 05:27:28,146][52664] Sum rewards: 73.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.898', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.062', 'AMMO4': '0.132', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:29,033][52665] DAMAGECOUNT value on done: 621284.0 [2024-08-06 05:27:29,033][52665] Sum rewards: 72.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.301', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.171', 'weapon5': '0.182', 'weapon2': '0.222', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:29,182][52659] DAMAGECOUNT value on done: 633035.0 [2024-08-06 05:27:29,184][52659] Sum rewards: 71.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.084', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.120', 'AMMO3': '0.177', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.394', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '2.668', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '59.000'} [2024-08-06 05:27:29,324][52667] DAMAGECOUNT value on done: 637207.0 [2024-08-06 05:27:29,325][52667] Sum rewards: 75.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon4': '0.136', 'AMMO3': '0.225', 'AMMO4': '0.285', 'weapon5': '0.328', 'weapon2': '0.394', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:30,879][52803] DAMAGECOUNT value on done: 582839.0 [2024-08-06 05:27:30,879][52803] Sum rewards: 84.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.146', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '69.000'} [2024-08-06 05:27:30,926][52811] DAMAGECOUNT value on done: 592312.0 [2024-08-06 05:27:30,926][52811] Sum rewards: 69.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.113', 'weapon4': '0.132', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '59.000'} [2024-08-06 05:27:30,933][52794] DAMAGECOUNT value on done: 648135.0 [2024-08-06 05:27:30,937][52794] Sum rewards: 72.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.456', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '59.000'} [2024-08-06 05:27:31,009][52664] DAMAGECOUNT value on done: 663082.0 [2024-08-06 05:27:31,010][52664] Sum rewards: 66.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.235', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO3': '0.151', 'AMMO4': '0.157', 'weapon4': '0.266', 'weapon5': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '53.000'} [2024-08-06 05:27:31,640][52650] Updated weights for policy 0, policy_version 61291 (0.0031) [2024-08-06 05:27:32,162][52665] DAMAGECOUNT value on done: 625010.0 [2024-08-06 05:27:32,162][52665] Sum rewards: 73.299, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.840', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.125', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.534', 'WEAPON3': '0.850', 'weapon3': '3.124', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '56.000'} [2024-08-06 05:27:32,347][52667] DAMAGECOUNT value on done: 639344.0 [2024-08-06 05:27:32,347][52667] Sum rewards: 78.490, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon5': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 502112256. Throughput: 0: 4368.4. Samples: 125528310. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:27:32,794][52567] Avg episode reward: [(0, '73.641')] [2024-08-06 05:27:33,711][52795] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:27:33,866][52664] DAMAGECOUNT value on done: 663311.0 [2024-08-06 05:27:33,866][52664] Sum rewards: 71.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.689', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.176', 'AMMO4': '0.215', 'weapon5': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.452', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.420', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:33,919][52811] DAMAGECOUNT value on done: 589088.0 [2024-08-06 05:27:33,919][52811] Sum rewards: 66.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.784', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.066', 'weapon5': '0.158', 'weapon2': '0.196', 'AMMO3': '0.228', 'AMMO4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.344', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '55.000'} [2024-08-06 05:27:33,955][52803] DAMAGECOUNT value on done: 589074.0 [2024-08-06 05:27:33,957][52803] Sum rewards: 81.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:34,113][52794] DAMAGECOUNT value on done: 628548.0 [2024-08-06 05:27:34,114][52794] Sum rewards: 71.258, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.208', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:35,031][52665] DAMAGECOUNT value on done: 628057.0 [2024-08-06 05:27:35,031][52665] Sum rewards: 70.846, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.548', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'weapon5': '0.078', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.452', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:35,547][52667] DAMAGECOUNT value on done: 643984.0 [2024-08-06 05:27:35,547][52667] Sum rewards: 79.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:36,298][52650] Updated weights for policy 0, policy_version 61301 (0.0015) [2024-08-06 05:27:36,831][52794] DAMAGECOUNT value on done: 642652.0 [2024-08-06 05:27:36,831][52794] Sum rewards: 69.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.178', 'AMMO3': '0.197', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:37,024][52664] DAMAGECOUNT value on done: 667121.0 [2024-08-06 05:27:37,024][52664] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.095', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.202', 'AMMO4': '0.202', 'weapon4': '0.210', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '2.850', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:37,349][52803] DAMAGECOUNT value on done: 582172.0 [2024-08-06 05:27:37,352][52803] Sum rewards: 62.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.514', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.176', 'weapon5': '0.188', 'AMMO4': '0.234', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.410', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '51.000'} [2024-08-06 05:27:37,376][52663] DAMAGECOUNT value on done: 643437.0 [2024-08-06 05:27:37,377][52663] Sum rewards: 68.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.063', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.186', 'weapon4': '0.194', 'weapon5': '0.218', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 05:27:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 502202368. Throughput: 0: 4360.7. Samples: 125554250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:27:37,794][52567] Avg episode reward: [(0, '73.003')] [2024-08-06 05:27:38,134][52667] DAMAGECOUNT value on done: 631644.0 [2024-08-06 05:27:38,137][52667] Sum rewards: 76.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.570', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:38,550][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:27:39,571][52664] DAMAGECOUNT value on done: 655513.0 [2024-08-06 05:27:39,572][52664] Sum rewards: 72.653, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.178', 'AMMO4': '0.184', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '59.000'} [2024-08-06 05:27:39,607][52794] DAMAGECOUNT value on done: 635785.0 [2024-08-06 05:27:39,608][52794] Sum rewards: 84.501, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.048', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'weapon2': '0.304', 'WEAPON3': '1.750', 'weapon3': '3.284', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '74.000'} [2024-08-06 05:27:40,425][52663] DAMAGECOUNT value on done: 635669.0 [2024-08-06 05:27:40,427][52663] Sum rewards: 76.072, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.835', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.042', 'AMMO4': '0.134', 'weapon2': '0.148', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.404', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 05:27:40,473][52803] DAMAGECOUNT value on done: 601705.0 [2024-08-06 05:27:40,475][52803] Sum rewards: 75.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO3': '0.202', 'AMMO4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.250', 'weapon3': '2.788', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:40,731][52667] DAMAGECOUNT value on done: 633090.0 [2024-08-06 05:27:40,731][52667] Sum rewards: 67.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.078', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.356', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '55.000'} [2024-08-06 05:27:41,021][52650] Updated weights for policy 0, policy_version 61311 (0.0017) [2024-08-06 05:27:42,061][52794] DAMAGECOUNT value on done: 642575.0 [2024-08-06 05:27:42,063][52794] Sum rewards: 68.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '57.500'} [2024-08-06 05:27:42,164][52664] DAMAGECOUNT value on done: 654431.0 [2024-08-06 05:27:42,165][52664] Sum rewards: 80.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.018', 'AMMO2': '0.072', 'AMMO3': '0.211', 'weapon2': '0.216', 'weapon5': '0.278', 'AMMO4': '0.362', 'weapon4': '0.380', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.864', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 502284288. Throughput: 0: 4366.0. Samples: 125580610. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:27:42,802][52567] Avg episode reward: [(0, '73.406')] [2024-08-06 05:27:43,482][52663] DAMAGECOUNT value on done: 625198.0 [2024-08-06 05:27:43,484][52663] Sum rewards: 83.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.905', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.222', 'weapon4': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '22.395', 'FRAGCOUNT': '67.000'} [2024-08-06 05:27:43,628][52803] DAMAGECOUNT value on done: 589500.0 [2024-08-06 05:27:43,629][52803] Sum rewards: 81.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.116', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '65.000'} [2024-08-06 05:27:43,631][52667] DAMAGECOUNT value on done: 640310.0 [2024-08-06 05:27:43,632][52667] Sum rewards: 74.850, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.158', 'AMMO5': '0.025', 'AMMO2': '0.050', 'weapon4': '0.138', 'AMMO3': '0.230', 'AMMO4': '0.249', 'weapon5': '0.276', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:44,866][52794] DAMAGECOUNT value on done: 644213.0 [2024-08-06 05:27:44,867][52794] Sum rewards: 81.612, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.026', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.194', 'weapon2': '0.204', 'AMMO4': '0.223', 'AMMO3': '0.242', 'weapon4': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:45,146][52664] DAMAGECOUNT value on done: 657840.0 [2024-08-06 05:27:45,146][52664] Sum rewards: 76.902, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'weapon4': '0.212', 'AMMO3': '0.257', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '65.000'} [2024-08-06 05:27:45,634][52650] Updated weights for policy 0, policy_version 61321 (0.0022) [2024-08-06 05:27:46,297][52663] DAMAGECOUNT value on done: 632998.0 [2024-08-06 05:27:46,299][52663] Sum rewards: 70.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.112', 'weapon5': '0.132', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.232', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '60.000'} [2024-08-06 05:27:46,302][52667] DAMAGECOUNT value on done: 629435.0 [2024-08-06 05:27:46,303][52667] Sum rewards: 74.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.120', 'weapon4': '0.148', 'AMMO4': '0.152', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '63.000'} [2024-08-06 05:27:46,632][52803] DAMAGECOUNT value on done: 587416.0 [2024-08-06 05:27:46,636][52803] Sum rewards: 90.557, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.496', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.046', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.500', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '22.572', 'FRAGCOUNT': '76.000'} [2024-08-06 05:27:46,835][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:27:47,669][52794] DAMAGECOUNT value on done: 635179.0 [2024-08-06 05:27:47,669][52794] Sum rewards: 76.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.235', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.416', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '64.000'} [2024-08-06 05:27:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 502374400. Throughput: 0: 4364.6. Samples: 125593670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:27:47,795][52567] Avg episode reward: [(0, '73.673')] [2024-08-06 05:27:48,200][52664] DAMAGECOUNT value on done: 659060.0 [2024-08-06 05:27:48,200][52664] Sum rewards: 87.071, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.299', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.244', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '70.000'} [2024-08-06 05:27:49,017][52663] DAMAGECOUNT value on done: 636702.0 [2024-08-06 05:27:49,017][52663] Sum rewards: 85.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.594', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.092', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.399', 'FRAGCOUNT': '70.000'} [2024-08-06 05:27:49,146][52667] DAMAGECOUNT value on done: 639854.0 [2024-08-06 05:27:49,148][52667] Sum rewards: 63.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.914', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.078', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '54.000'} [2024-08-06 05:27:49,650][52803] DAMAGECOUNT value on done: 602632.0 [2024-08-06 05:27:49,652][52803] Sum rewards: 80.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.724', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon5': '0.176', 'AMMO3': '0.182', 'AMMO4': '0.194', 'weapon2': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '65.500'} [2024-08-06 05:27:49,699][52670] DAMAGECOUNT value on done: 624864.0 [2024-08-06 05:27:49,703][52670] Sum rewards: 79.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.888', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon4': '0.248', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '65.000'} [2024-08-06 05:27:49,839][52666] DAMAGECOUNT value on done: 634175.0 [2024-08-06 05:27:49,841][52666] Sum rewards: 71.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon4': '0.352', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '61.000'} [2024-08-06 05:27:50,550][52650] Updated weights for policy 0, policy_version 61331 (0.0015) [2024-08-06 05:27:50,936][52664] DAMAGECOUNT value on done: 656187.0 [2024-08-06 05:27:50,939][52664] Sum rewards: 64.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.032', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.086', 'AMMO4': '0.178', 'AMMO3': '0.187', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.792', 'WEAPON3': '1.200', 'weapon3': '2.646', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '55.000'} [2024-08-06 05:27:51,536][52667] DAMAGECOUNT value on done: 645477.0 [2024-08-06 05:27:51,538][52667] Sum rewards: 79.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.273', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.166', 'AMMO3': '0.179', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:51,670][52663] DAMAGECOUNT value on done: 644644.0 [2024-08-06 05:27:51,670][52663] Sum rewards: 88.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.421', 'FRAGCOUNT': '73.000'} [2024-08-06 05:27:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 502464512. Throughput: 0: 4361.3. Samples: 125619610. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:27:52,802][52567] Avg episode reward: [(0, '74.259')] [2024-08-06 05:27:52,880][52803] DAMAGECOUNT value on done: 590325.0 [2024-08-06 05:27:52,883][52803] Sum rewards: 69.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.022', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.184', 'weapon4': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.194', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '57.000'} [2024-08-06 05:27:53,059][52670] DAMAGECOUNT value on done: 636346.0 [2024-08-06 05:27:53,059][52670] Sum rewards: 76.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.210', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.136', 'AMMO3': '0.207', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '62.000'} [2024-08-06 05:27:53,143][52666] DAMAGECOUNT value on done: 635577.0 [2024-08-06 05:27:53,144][52666] Sum rewards: 74.208, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.114', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.137', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.303', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.042', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '67.000'} [2024-08-06 05:27:54,377][52663] DAMAGECOUNT value on done: 632903.0 [2024-08-06 05:27:54,378][52663] Sum rewards: 66.217, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.776', 'AMMO5': '0.023', 'AMMO2': '0.068', 'weapon4': '0.146', 'AMMO3': '0.224', 'weapon5': '0.276', 'AMMO4': '0.341', 'weapon2': '0.414', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.846', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:54,556][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:27:54,598][52667] DAMAGECOUNT value on done: 642838.0 [2024-08-06 05:27:54,598][52667] Sum rewards: 65.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.975', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.094', 'AMMO4': '0.164', 'weapon5': '0.168', 'AMMO3': '0.226', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.158', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2024-08-06 05:27:55,078][52650] Updated weights for policy 0, policy_version 61341 (0.0014) [2024-08-06 05:27:55,986][52803] DAMAGECOUNT value on done: 589168.0 [2024-08-06 05:27:55,988][52803] Sum rewards: 73.658, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.099', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO3': '0.143', 'AMMO4': '0.176', 'weapon5': '0.252', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.484', 'WEAPON3': '0.950', 'weapon3': '2.600', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:56,044][52670] DAMAGECOUNT value on done: 625972.0 [2024-08-06 05:27:56,045][52670] Sum rewards: 66.368, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.278', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.202', 'AMMO4': '0.232', 'weapon5': '0.252', 'weapon4': '0.268', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '57.000'} [2024-08-06 05:27:56,268][52666] DAMAGECOUNT value on done: 635154.0 [2024-08-06 05:27:56,268][52666] Sum rewards: 72.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.026', 'weapon5': '0.058', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.390', 'weapon3': '3.464', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '61.000'} [2024-08-06 05:27:56,547][52669] Large shaping reward 2.583 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.039, -13.0), ('weapon5', 0.002)] [2024-08-06 05:27:56,755][52663] DAMAGECOUNT value on done: 626764.0 [2024-08-06 05:27:56,757][52663] Sum rewards: 64.175, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.360', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.310', 'weapon2': '0.368', 'WEAPON3': '1.850', 'weapon3': '3.124', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '58.000'} [2024-08-06 05:27:57,374][52667] DAMAGECOUNT value on done: 643289.0 [2024-08-06 05:27:57,374][52667] Sum rewards: 76.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.558', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.170', 'AMMO3': '0.191', 'weapon4': '0.196', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '61.000'} [2024-08-06 05:27:57,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 502554624. Throughput: 0: 4355.1. Samples: 125645700. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:27:57,802][52567] Avg episode reward: [(0, '73.763')] [2024-08-06 05:27:59,004][52803] DAMAGECOUNT value on done: 593540.0 [2024-08-06 05:27:59,004][52803] Sum rewards: 77.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.295', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.154', 'AMMO3': '0.213', 'AMMO4': '0.243', 'weapon5': '0.254', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '66.000'} [2024-08-06 05:27:59,258][52670] DAMAGECOUNT value on done: 622485.0 [2024-08-06 05:27:59,260][52670] Sum rewards: 81.120, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.110', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.120', 'weapon5': '0.232', 'AMMO3': '0.240', 'AMMO4': '0.278', 'weapon2': '0.380', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.928', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.237', 'FRAGCOUNT': '68.000'} [2024-08-06 05:27:59,376][52666] DAMAGECOUNT value on done: 637363.0 [2024-08-06 05:27:59,377][52666] Sum rewards: 82.815, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.269', 'weapon2': '0.296', 'WEAPON3': '1.650', 'weapon3': '3.478', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '72.000'} [2024-08-06 05:27:59,707][52663] DAMAGECOUNT value on done: 626404.0 [2024-08-06 05:27:59,708][52663] Sum rewards: 81.939, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.164', 'weapon2': '0.348', 'HEALTH': '0.899', 'WEAPON3': '0.900', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '64.000'} [2024-08-06 05:28:00,154][52650] Updated weights for policy 0, policy_version 61351 (0.0038) [2024-08-06 05:28:00,349][52667] DAMAGECOUNT value on done: 638279.0 [2024-08-06 05:28:00,350][52667] Sum rewards: 81.081, reward structure: {'DEATHCOUNT': '-17.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'HEALTH': '0.040', 'weapon4': '0.066', 'AMMO4': '0.076', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '69.000'} [2024-08-06 05:28:02,113][52803] DAMAGECOUNT value on done: 594906.0 [2024-08-06 05:28:02,113][52803] Sum rewards: 60.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.204', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.372', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '51.000'} [2024-08-06 05:28:02,144][52670] DAMAGECOUNT value on done: 636897.0 [2024-08-06 05:28:02,144][52670] Sum rewards: 79.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.164', 'AMMO4': '0.185', 'weapon4': '0.202', 'AMMO3': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:02,357][52666] DAMAGECOUNT value on done: 629969.0 [2024-08-06 05:28:02,357][52666] Sum rewards: 71.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.221', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:02,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 502628352. Throughput: 0: 4356.9. Samples: 125658780. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 05:28:02,795][52567] Avg episode reward: [(0, '74.098')] [2024-08-06 05:28:02,917][52667] DAMAGECOUNT value on done: 643508.0 [2024-08-06 05:28:02,919][52667] Sum rewards: 66.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.182', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.056', 'AMMO4': '0.158', 'weapon5': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.642', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '55.000'} [2024-08-06 05:28:02,954][52663] DAMAGECOUNT value on done: 632387.0 [2024-08-06 05:28:02,955][52663] Sum rewards: 64.244, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.018', 'AMMO2': '0.038', 'HEALTH': '0.051', 'weapon4': '0.098', 'AMMO3': '0.159', 'weapon5': '0.166', 'AMMO4': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.626', 'WEAPON3': '0.900', 'weapon3': '2.844', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '51.500'} [2024-08-06 05:28:04,180][52650] Updated weights for policy 0, policy_version 61361 (0.0026) [2024-08-06 05:28:05,151][52670] DAMAGECOUNT value on done: 632258.0 [2024-08-06 05:28:05,151][52670] Sum rewards: 77.462, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.495', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.170', 'weapon5': '0.196', 'AMMO4': '0.198', 'weapon2': '0.254', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.046', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:05,233][52803] DAMAGECOUNT value on done: 599214.0 [2024-08-06 05:28:05,234][52803] Sum rewards: 75.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.054', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.272', 'weapon4': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.088', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '60.000'} [2024-08-06 05:28:05,339][52666] DAMAGECOUNT value on done: 628908.0 [2024-08-06 05:28:05,340][52666] Sum rewards: 86.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.175', 'AMMO3': '0.214', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.427', 'FRAGCOUNT': '70.000'} [2024-08-06 05:28:05,711][52663] DAMAGECOUNT value on done: 641304.0 [2024-08-06 05:28:05,714][52663] Sum rewards: 62.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '52.000'} [2024-08-06 05:28:07,559][52670] DAMAGECOUNT value on done: 622036.0 [2024-08-06 05:28:07,560][52670] Sum rewards: 76.334, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.713', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.035', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO4': '0.173', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'weapon3': '3.498', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 502726656. Throughput: 0: 4353.8. Samples: 125685050. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:07,794][52567] Avg episode reward: [(0, '73.908')] [2024-08-06 05:28:07,797][52666] DAMAGECOUNT value on done: 630460.0 [2024-08-06 05:28:07,803][52666] Sum rewards: 63.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.325', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.098', 'AMMO4': '0.127', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '54.000'} [2024-08-06 05:28:08,123][52669] DAMAGECOUNT value on done: 638330.0 [2024-08-06 05:28:08,123][52669] Sum rewards: 66.122, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.623', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.090', 'weapon5': '0.132', 'AMMO3': '0.175', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.088', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '53.000'} [2024-08-06 05:28:08,615][52803] DAMAGECOUNT value on done: 588637.0 [2024-08-06 05:28:08,616][52803] Sum rewards: 82.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.092', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '67.000'} [2024-08-06 05:28:08,861][52663] DAMAGECOUNT value on done: 629655.0 [2024-08-06 05:28:08,862][52663] Sum rewards: 73.315, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.176', 'weapon5': '0.196', 'weapon4': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:09,039][52663] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:28:09,186][52658] DAMAGECOUNT value on done: 639086.0 [2024-08-06 05:28:09,188][52658] Sum rewards: 69.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.175', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.026', 'weapon4': '0.056', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.274', 'WEAPON3': '1.450', 'HITCOUNT': '3.360', 'weapon3': '3.428', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:09,321][52650] Updated weights for policy 0, policy_version 61371 (0.0034) [2024-08-06 05:28:10,575][52670] DAMAGECOUNT value on done: 629806.0 [2024-08-06 05:28:10,577][52670] Sum rewards: 62.365, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.930', 'AMMO5': '0.020', 'AMMO2': '0.073', 'weapon4': '0.230', 'weapon5': '0.256', 'AMMO3': '0.287', 'AMMO4': '0.365', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.738', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '55.000'} [2024-08-06 05:28:10,949][52666] DAMAGECOUNT value on done: 629715.0 [2024-08-06 05:28:10,951][52666] Sum rewards: 64.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.689', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.215', 'weapon4': '0.296', 'weapon5': '0.362', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.632', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '53.000'} [2024-08-06 05:28:11,357][52669] DAMAGECOUNT value on done: 627856.0 [2024-08-06 05:28:11,357][52669] Sum rewards: 80.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.407', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.172', 'AMMO3': '0.188', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:11,894][52671] DAMAGECOUNT value on done: 639673.0 [2024-08-06 05:28:11,895][52671] Sum rewards: 72.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.188', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:11,906][52663] DAMAGECOUNT value on done: 624163.0 [2024-08-06 05:28:11,907][52663] Sum rewards: 70.779, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.144', 'weapon5': '0.168', 'weapon2': '0.180', 'AMMO4': '0.221', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '60.000'} [2024-08-06 05:28:12,244][52658] DAMAGECOUNT value on done: 634820.0 [2024-08-06 05:28:12,245][52658] Sum rewards: 72.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.072', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.204', 'WEAPON3': '1.150', 'weapon3': '3.446', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:12,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 502808576. Throughput: 0: 4355.6. Samples: 125711070. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:12,794][52567] Avg episode reward: [(0, '73.534')] [2024-08-06 05:28:13,001][52820] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:28:13,523][52670] DAMAGECOUNT value on done: 627422.0 [2024-08-06 05:28:13,523][52670] Sum rewards: 63.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.598', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.194', 'AMMO4': '0.206', 'AMMO3': '0.212', 'weapon5': '0.242', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '53.000'} [2024-08-06 05:28:13,784][52650] Updated weights for policy 0, policy_version 61381 (0.0020) [2024-08-06 05:28:13,935][52666] DAMAGECOUNT value on done: 633295.0 [2024-08-06 05:28:13,937][52666] Sum rewards: 71.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.100', 'AMMO3': '0.203', 'weapon5': '0.210', 'AMMO4': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.864', 'WEAPON3': '1.250', 'weapon3': '2.534', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '58.000'} [2024-08-06 05:28:14,223][52669] DAMAGECOUNT value on done: 639698.0 [2024-08-06 05:28:14,224][52669] Sum rewards: 74.229, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.934', 'AMMO5': '0.024', 'AMMO2': '0.044', 'weapon4': '0.134', 'AMMO3': '0.156', 'weapon5': '0.202', 'AMMO4': '0.221', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.886', 'WEAPON3': '0.950', 'weapon3': '2.556', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:14,542][52671] DAMAGECOUNT value on done: 642412.0 [2024-08-06 05:28:14,542][52671] Sum rewards: 71.843, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.878', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.090', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.308', 'WEAPON3': '0.950', 'weapon3': '3.006', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '57.000'} [2024-08-06 05:28:14,813][52663] DAMAGECOUNT value on done: 629330.0 [2024-08-06 05:28:14,814][52663] Sum rewards: 73.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.098', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:15,182][52658] DAMAGECOUNT value on done: 640743.0 [2024-08-06 05:28:15,182][52658] Sum rewards: 81.032, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.082', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.282', 'WEAPON3': '1.750', 'weapon3': '3.300', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '70.000'} [2024-08-06 05:28:16,587][52670] DAMAGECOUNT value on done: 626087.0 [2024-08-06 05:28:16,587][52670] Sum rewards: 80.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.640', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.106', 'AMMO4': '0.137', 'weapon5': '0.184', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.112', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '68.000'} [2024-08-06 05:28:16,924][52666] DAMAGECOUNT value on done: 625831.0 [2024-08-06 05:28:16,927][52666] Sum rewards: 74.781, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.946', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.072', 'weapon4': '0.114', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.272', 'AMMO3': '0.273', 'WEAPON3': '1.550', 'weapon3': '3.282', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:17,000][52669] DAMAGECOUNT value on done: 638278.0 [2024-08-06 05:28:17,000][52669] Sum rewards: 83.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.238', 'WEAPON3': '1.250', 'weapon3': '3.526', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '68.000'} [2024-08-06 05:28:17,395][52663] DAMAGECOUNT value on done: 625207.0 [2024-08-06 05:28:17,395][52663] Sum rewards: 57.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.114', 'AMMO3': '0.188', 'weapon4': '0.190', 'AMMO4': '0.232', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.118', 'DAMAGECOUNT': '14.028', 'FRAGCOUNT': '48.000'} [2024-08-06 05:28:17,552][52671] DAMAGECOUNT value on done: 640048.0 [2024-08-06 05:28:17,554][52671] Sum rewards: 66.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.132', 'AMMO4': '0.143', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.220', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '54.000'} [2024-08-06 05:28:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 502898688. Throughput: 0: 4348.7. Samples: 125724000. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:17,795][52567] Avg episode reward: [(0, '73.669')] [2024-08-06 05:28:18,159][52658] DAMAGECOUNT value on done: 638536.0 [2024-08-06 05:28:18,163][52658] Sum rewards: 66.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.705', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.206', 'weapon2': '0.210', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.400', 'weapon3': '2.898', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '57.000'} [2024-08-06 05:28:18,690][52650] Updated weights for policy 0, policy_version 61391 (0.0014) [2024-08-06 05:28:19,703][52670] DAMAGECOUNT value on done: 634170.0 [2024-08-06 05:28:19,704][52670] Sum rewards: 77.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.096', 'weapon5': '0.206', 'AMMO4': '0.215', 'AMMO3': '0.220', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:19,888][52669] DAMAGECOUNT value on done: 637655.0 [2024-08-06 05:28:19,888][52669] Sum rewards: 79.590, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.650', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.154', 'weapon4': '0.224', 'AMMO3': '0.229', 'AMMO4': '0.229', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '67.000'} [2024-08-06 05:28:19,984][52666] DAMAGECOUNT value on done: 628965.0 [2024-08-06 05:28:19,987][52666] Sum rewards: 82.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.995', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.162', 'AMMO4': '0.169', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '67.000'} [2024-08-06 05:28:20,359][52671] DAMAGECOUNT value on done: 641535.0 [2024-08-06 05:28:20,359][52671] Sum rewards: 74.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.275', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.152', 'AMMO4': '0.231', 'AMMO3': '0.236', 'weapon4': '0.306', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.832', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:20,543][52663] DAMAGECOUNT value on done: 638900.0 [2024-08-06 05:28:20,543][52663] Sum rewards: 83.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '68.500'} [2024-08-06 05:28:21,283][52658] DAMAGECOUNT value on done: 628961.0 [2024-08-06 05:28:21,283][52658] Sum rewards: 64.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.579', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.194', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '56.000'} [2024-08-06 05:28:22,429][52670] DAMAGECOUNT value on done: 620869.0 [2024-08-06 05:28:22,431][52670] Sum rewards: 77.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.186', 'AMMO5': '0.015', 'AMMO2': '0.058', 'AMMO3': '0.160', 'weapon4': '0.260', 'weapon5': '0.264', 'AMMO4': '0.289', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:22,779][52666] DAMAGECOUNT value on done: 622636.0 [2024-08-06 05:28:22,779][52666] Sum rewards: 85.425, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.332', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.126', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.793', 'FRAGCOUNT': '72.000'} [2024-08-06 05:28:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 502988800. Throughput: 0: 4352.2. Samples: 125750100. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:22,802][52567] Avg episode reward: [(0, '74.077')] [2024-08-06 05:28:22,988][52669] DAMAGECOUNT value on done: 641004.0 [2024-08-06 05:28:22,988][52669] Sum rewards: 65.219, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.052', 'AMMO4': '0.075', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.124', 'WEAPON4': '0.150', 'HEALTH': '0.163', 'weapon2': '0.494', 'WEAPON3': '0.800', 'HITCOUNT': '3.060', 'weapon3': '3.240', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '51.000'} [2024-08-06 05:28:23,229][52650] Updated weights for policy 0, policy_version 61401 (0.0019) [2024-08-06 05:28:23,458][52671] DAMAGECOUNT value on done: 650710.0 [2024-08-06 05:28:23,458][52671] Sum rewards: 81.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.024', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.184', 'weapon5': '0.194', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:23,629][52663] DAMAGECOUNT value on done: 631096.0 [2024-08-06 05:28:23,629][52663] Sum rewards: 79.969, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.180', 'AMMO3': '0.190', 'AMMO4': '0.244', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:24,284][52658] DAMAGECOUNT value on done: 630530.0 [2024-08-06 05:28:24,284][52658] Sum rewards: 52.339, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.335', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.054', 'AMMO4': '0.153', 'weapon5': '0.170', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.186', 'DAMAGECOUNT': '12.543', 'FRAGCOUNT': '43.000'} [2024-08-06 05:28:25,586][52670] DAMAGECOUNT value on done: 630421.0 [2024-08-06 05:28:25,587][52670] Sum rewards: 68.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.984', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.132', 'weapon5': '0.216', 'AMMO3': '0.235', 'AMMO4': '0.266', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '57.000'} [2024-08-06 05:28:25,844][52669] DAMAGECOUNT value on done: 637872.0 [2024-08-06 05:28:25,845][52669] Sum rewards: 62.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.184', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.223', 'weapon2': '0.236', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '53.000'} [2024-08-06 05:28:25,935][52666] DAMAGECOUNT value on done: 636032.0 [2024-08-06 05:28:25,935][52666] Sum rewards: 70.898, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.058', 'weapon5': '0.140', 'weapon2': '0.178', 'AMMO4': '0.223', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.390', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:26,338][52671] DAMAGECOUNT value on done: 641815.0 [2024-08-06 05:28:26,339][52671] Sum rewards: 73.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.705', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.216', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.520', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:26,343][52663] DAMAGECOUNT value on done: 636457.0 [2024-08-06 05:28:26,343][52663] Sum rewards: 69.093, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.162', 'AMMO3': '0.165', 'AMMO4': '0.220', 'weapon2': '0.328', 'HEALTH': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon4': '0.420', 'WEAPON3': '0.950', 'weapon3': '2.830', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '54.000'} [2024-08-06 05:28:27,082][52658] DAMAGECOUNT value on done: 642709.0 [2024-08-06 05:28:27,082][52658] Sum rewards: 77.741, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.458', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.212', 'weapon2': '0.226', 'AMMO3': '0.319', 'WEAPON3': '1.850', 'weapon3': '3.244', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '68.000'} [2024-08-06 05:28:27,595][52647] DAMAGECOUNT value on done: 674299.0 [2024-08-06 05:28:27,595][52647] Sum rewards: 68.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.188', 'AMMO4': '0.218', 'weapon5': '0.252', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '2.628', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '54.000'} [2024-08-06 05:28:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 503070720. Throughput: 0: 4349.3. Samples: 125776330. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:27,794][52567] Avg episode reward: [(0, '73.781')] [2024-08-06 05:28:27,804][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061410_503070720.pth... [2024-08-06 05:28:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000060899_498884608.pth [2024-08-06 05:28:28,148][52650] Updated weights for policy 0, policy_version 61411 (0.0014) [2024-08-06 05:28:28,264][52670] DAMAGECOUNT value on done: 635019.0 [2024-08-06 05:28:28,264][52670] Sum rewards: 69.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.086', 'weapon4': '0.152', 'AMMO4': '0.157', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:28,276][52669] DAMAGECOUNT value on done: 636367.0 [2024-08-06 05:28:28,277][52669] Sum rewards: 58.569, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.561', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.286', 'weapon2': '0.388', 'WEAPON3': '1.700', 'HITCOUNT': '3.220', 'weapon3': '3.282', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '52.000'} [2024-08-06 05:28:28,604][52666] DAMAGECOUNT value on done: 629964.0 [2024-08-06 05:28:28,605][52666] Sum rewards: 75.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.971', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.190', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '63.000'} [2024-08-06 05:28:28,821][52663] DAMAGECOUNT value on done: 637701.0 [2024-08-06 05:28:28,822][52663] Sum rewards: 59.783, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.204', 'weapon5': '0.208', 'AMMO3': '0.221', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.312', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '52.000'} [2024-08-06 05:28:29,375][52671] DAMAGECOUNT value on done: 644678.0 [2024-08-06 05:28:29,376][52671] Sum rewards: 69.124, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.749', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.072', 'weapon5': '0.148', 'AMMO4': '0.235', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.600', 'weapon3': '3.060', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:30,023][52658] DAMAGECOUNT value on done: 632048.0 [2024-08-06 05:28:30,026][52658] Sum rewards: 72.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.177', 'weapon4': '0.178', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:30,804][52669] DAMAGECOUNT value on done: 645920.0 [2024-08-06 05:28:30,804][52669] Sum rewards: 70.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.297', 'AMMO5': '0.003', 'weapon5': '0.018', 'weapon4': '0.020', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.248', 'weapon2': '0.494', 'WEAPON3': '1.650', 'weapon3': '3.276', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.500'} [2024-08-06 05:28:30,806][52647] DAMAGECOUNT value on done: 668448.0 [2024-08-06 05:28:30,807][52647] Sum rewards: 85.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.080', 'AMMO4': '0.113', 'weapon5': '0.128', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '71.000'} [2024-08-06 05:28:30,813][52659] Large shaping reward 2.752 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:28:31,184][52670] DAMAGECOUNT value on done: 633761.0 [2024-08-06 05:28:31,187][52670] Sum rewards: 74.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.210', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.152', 'weapon5': '0.164', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '58.000'} [2024-08-06 05:28:31,282][52663] DAMAGECOUNT value on done: 629719.0 [2024-08-06 05:28:31,282][52663] Sum rewards: 72.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.044', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.110', 'weapon5': '0.192', 'AMMO3': '0.217', 'AMMO4': '0.254', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '60.000'} [2024-08-06 05:28:31,574][52666] DAMAGECOUNT value on done: 633695.0 [2024-08-06 05:28:31,574][52666] Sum rewards: 75.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.058', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.201', 'weapon2': '0.224', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.562', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '63.000'} [2024-08-06 05:28:32,529][52671] DAMAGECOUNT value on done: 641166.0 [2024-08-06 05:28:32,531][52671] Sum rewards: 79.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.024', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.098', 'weapon5': '0.148', 'AMMO4': '0.161', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:32,766][52650] Updated weights for policy 0, policy_version 61421 (0.0026) [2024-08-06 05:28:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 503160832. Throughput: 0: 4344.2. Samples: 125789160. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:32,794][52567] Avg episode reward: [(0, '73.580')] [2024-08-06 05:28:33,019][52658] DAMAGECOUNT value on done: 650220.0 [2024-08-06 05:28:33,020][52658] Sum rewards: 72.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.336', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.164', 'weapon4': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:33,472][52669] DAMAGECOUNT value on done: 637082.0 [2024-08-06 05:28:33,472][52669] Sum rewards: 70.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.103', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.199', 'weapon4': '0.212', 'AMMO4': '0.229', 'weapon2': '0.264', 'weapon5': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '57.000'} [2024-08-06 05:28:33,816][52647] DAMAGECOUNT value on done: 671907.0 [2024-08-06 05:28:33,817][52647] Sum rewards: 74.387, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.040', 'weapon5': '0.096', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:33,925][52668] DAMAGECOUNT value on done: 635321.0 [2024-08-06 05:28:33,929][52668] Sum rewards: 79.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.106', 'weapon4': '0.184', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:34,320][52670] DAMAGECOUNT value on done: 616712.0 [2024-08-06 05:28:34,322][52670] Sum rewards: 70.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.292', 'weapon2': '0.370', 'WEAPON3': '1.050', 'weapon3': '2.820', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '56.000'} [2024-08-06 05:28:34,642][52666] DAMAGECOUNT value on done: 623548.0 [2024-08-06 05:28:34,643][52666] Sum rewards: 66.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.229', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.236', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '56.000'} [2024-08-06 05:28:35,100][52649] DAMAGECOUNT value on done: 616084.0 [2024-08-06 05:28:35,102][52649] Sum rewards: 86.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.972', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.244', 'weapon2': '0.390', 'WEAPON3': '1.600', 'weapon3': '3.400', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '73.000'} [2024-08-06 05:28:35,415][52671] DAMAGECOUNT value on done: 633626.0 [2024-08-06 05:28:35,415][52671] Sum rewards: 78.416, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.146', 'AMMO3': '0.177', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '63.000'} [2024-08-06 05:28:35,958][52669] DAMAGECOUNT value on done: 641240.0 [2024-08-06 05:28:35,959][52669] Sum rewards: 64.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.160', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.094', 'AMMO3': '0.172', 'weapon5': '0.172', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '51.000'} [2024-08-06 05:28:36,204][52647] DAMAGECOUNT value on done: 672632.0 [2024-08-06 05:28:36,204][52647] Sum rewards: 79.986, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.045', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.062', 'weapon5': '0.122', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.568', 'WEAPON3': '0.850', 'weapon3': '3.104', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:36,449][52658] DAMAGECOUNT value on done: 636404.0 [2024-08-06 05:28:36,450][52658] Sum rewards: 65.535, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.450', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.152', 'weapon5': '0.178', 'AMMO4': '0.253', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.826', 'WEAPON3': '0.850', 'weapon3': '2.496', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '50.000'} [2024-08-06 05:28:36,832][52668] DAMAGECOUNT value on done: 640801.0 [2024-08-06 05:28:36,834][52668] Sum rewards: 80.730, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.486', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO3': '0.260', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '69.000'} [2024-08-06 05:28:36,844][52649] Large shaping reward 3.651 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:28:37,215][52670] DAMAGECOUNT value on done: 626973.0 [2024-08-06 05:28:37,215][52670] Sum rewards: 51.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.688', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon4': '0.086', 'weapon5': '0.152', 'AMMO3': '0.178', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.946', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.034', 'FRAGCOUNT': '43.000'} [2024-08-06 05:28:37,447][52666] DAMAGECOUNT value on done: 631359.0 [2024-08-06 05:28:37,449][52666] Sum rewards: 68.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.448', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.170', 'AMMO4': '0.187', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.322', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 05:28:37,600][52650] Updated weights for policy 0, policy_version 61431 (0.0030) [2024-08-06 05:28:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 503242752. Throughput: 0: 4350.0. Samples: 125815360. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:37,795][52567] Avg episode reward: [(0, '72.686')] [2024-08-06 05:28:38,327][52649] DAMAGECOUNT value on done: 608093.0 [2024-08-06 05:28:38,327][52649] Sum rewards: 65.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.248', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 05:28:38,666][52647] DAMAGECOUNT value on done: 680767.0 [2024-08-06 05:28:38,666][52647] Sum rewards: 79.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.123', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.122', 'AMMO4': '0.161', 'weapon5': '0.176', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:38,674][52671] DAMAGECOUNT value on done: 638959.0 [2024-08-06 05:28:38,674][52671] Sum rewards: 72.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.846', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.188', 'AMMO3': '0.204', 'weapon5': '0.220', 'weapon2': '0.272', 'weapon4': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:39,009][52669] DAMAGECOUNT value on done: 644223.0 [2024-08-06 05:28:39,011][52669] Sum rewards: 74.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.128', 'weapon4': '0.180', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:39,298][52668] DAMAGECOUNT value on done: 638765.0 [2024-08-06 05:28:39,298][52668] Sum rewards: 72.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.092', 'AMMO4': '0.176', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '60.000'} [2024-08-06 05:28:39,572][52658] DAMAGECOUNT value on done: 649935.0 [2024-08-06 05:28:39,573][52658] Sum rewards: 70.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.476', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.169', 'weapon4': '0.188', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '56.000'} [2024-08-06 05:28:40,326][52670] DAMAGECOUNT value on done: 635475.0 [2024-08-06 05:28:40,328][52670] Sum rewards: 64.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.465', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.348', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 05:28:40,545][52666] DAMAGECOUNT value on done: 640334.0 [2024-08-06 05:28:40,546][52666] Sum rewards: 81.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.138', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.168', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '67.000'} [2024-08-06 05:28:41,170][52671] DAMAGECOUNT value on done: 643981.0 [2024-08-06 05:28:41,170][52671] Sum rewards: 76.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.154', 'weapon4': '0.206', 'AMMO4': '0.232', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '2.888', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:41,379][52649] DAMAGECOUNT value on done: 627161.0 [2024-08-06 05:28:41,381][52649] Sum rewards: 78.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.665', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.158', 'AMMO4': '0.191', 'AMMO3': '0.215', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '64.000'} [2024-08-06 05:28:41,525][52647] DAMAGECOUNT value on done: 677198.0 [2024-08-06 05:28:41,525][52647] Sum rewards: 78.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.086', 'weapon5': '0.086', 'AMMO4': '0.230', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '67.000'} [2024-08-06 05:28:41,636][52669] DAMAGECOUNT value on done: 630994.0 [2024-08-06 05:28:41,638][52669] Sum rewards: 69.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.040', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:41,943][52650] Updated weights for policy 0, policy_version 61441 (0.0022) [2024-08-06 05:28:42,277][52668] DAMAGECOUNT value on done: 640148.0 [2024-08-06 05:28:42,277][52668] Sum rewards: 79.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon2': '0.246', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.430', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '68.000'} [2024-08-06 05:28:42,524][52658] DAMAGECOUNT value on done: 633444.0 [2024-08-06 05:28:42,525][52658] Sum rewards: 73.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.909', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.088', 'weapon4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.271', 'weapon2': '0.398', 'WEAPON3': '1.700', 'weapon3': '3.246', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '64.000'} [2024-08-06 05:28:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 503332864. Throughput: 0: 4355.1. Samples: 125841680. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:28:42,794][52567] Avg episode reward: [(0, '72.873')] [2024-08-06 05:28:43,058][52670] DAMAGECOUNT value on done: 627920.0 [2024-08-06 05:28:43,059][52670] Sum rewards: 81.420, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.696', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.044', 'weapon5': '0.048', 'AMMO4': '0.197', 'weapon2': '0.288', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.328', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '71.000'} [2024-08-06 05:28:43,275][52666] DAMAGECOUNT value on done: 621035.0 [2024-08-06 05:28:43,278][52666] Sum rewards: 78.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.248', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:43,347][52795] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:28:43,918][52647] DAMAGECOUNT value on done: 672451.0 [2024-08-06 05:28:43,926][52647] Sum rewards: 79.157, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.686', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.312', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '68.000'} [2024-08-06 05:28:44,119][52671] DAMAGECOUNT value on done: 638662.0 [2024-08-06 05:28:44,121][52671] Sum rewards: 78.798, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.219', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:44,287][52649] DAMAGECOUNT value on done: 622331.0 [2024-08-06 05:28:44,291][52649] Sum rewards: 81.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.153', 'weapon5': '0.168', 'weapon4': '0.298', 'AMMO4': '0.309', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.752', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:44,635][52669] DAMAGECOUNT value on done: 635567.0 [2024-08-06 05:28:44,636][52669] Sum rewards: 85.558, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.142', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.314', 'weapon2': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.142', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '73.000'} [2024-08-06 05:28:44,993][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:28:45,383][52668] DAMAGECOUNT value on done: 627197.0 [2024-08-06 05:28:45,384][52668] Sum rewards: 76.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.080', 'AMMO4': '0.081', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.210', 'WEAPON3': '1.200', 'HITCOUNT': '3.420', 'weapon3': '3.436', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 05:28:45,655][52658] DAMAGECOUNT value on done: 641692.0 [2024-08-06 05:28:45,655][52658] Sum rewards: 76.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.302', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.094', 'weapon5': '0.108', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:45,876][52670] DAMAGECOUNT value on done: 632015.0 [2024-08-06 05:28:45,877][52670] Sum rewards: 67.594, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.106', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.654', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '57.000'} [2024-08-06 05:28:46,150][52666] DAMAGECOUNT value on done: 629388.0 [2024-08-06 05:28:46,151][52666] Sum rewards: 66.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.607', 'AMMO5': '0.026', 'AMMO2': '0.043', 'AMMO3': '0.182', 'AMMO4': '0.214', 'weapon5': '0.284', 'weapon2': '0.286', 'weapon4': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '54.500'} [2024-08-06 05:28:46,465][52647] DAMAGECOUNT value on done: 658163.0 [2024-08-06 05:28:46,465][52647] Sum rewards: 73.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.585', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.588', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '60.000'} [2024-08-06 05:28:47,006][52650] Updated weights for policy 0, policy_version 61451 (0.0016) [2024-08-06 05:28:47,025][52671] DAMAGECOUNT value on done: 643537.0 [2024-08-06 05:28:47,027][52671] Sum rewards: 81.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.101', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '66.000'} [2024-08-06 05:28:47,344][52649] DAMAGECOUNT value on done: 612352.0 [2024-08-06 05:28:47,345][52649] Sum rewards: 84.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.758', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.207', 'weapon4': '0.244', 'weapon5': '0.294', 'AMMO4': '0.298', 'weapon2': '0.354', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '68.000'} [2024-08-06 05:28:47,709][52669] DAMAGECOUNT value on done: 639188.0 [2024-08-06 05:28:47,709][52669] Sum rewards: 70.080, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.235', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.634', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.084', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '55.000'} [2024-08-06 05:28:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 503422976. Throughput: 0: 4353.4. Samples: 125854680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:28:47,794][52567] Avg episode reward: [(0, '73.318')] [2024-08-06 05:28:47,801][52668] DAMAGECOUNT value on done: 644374.0 [2024-08-06 05:28:47,803][52668] Sum rewards: 59.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.143', 'weapon4': '0.214', 'weapon2': '0.674', 'WEAPON3': '0.950', 'weapon3': '2.960', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2024-08-06 05:28:48,696][52658] DAMAGECOUNT value on done: 632997.0 [2024-08-06 05:28:48,697][52658] Sum rewards: 77.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.380', 'weapon4': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:49,073][52647] DAMAGECOUNT value on done: 672099.0 [2024-08-06 05:28:49,081][52647] Sum rewards: 82.156, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.088', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:49,092][52662] DAMAGECOUNT value on done: 641684.0 [2024-08-06 05:28:49,093][52662] Sum rewards: 76.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.195', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.028', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '63.000'} [2024-08-06 05:28:50,067][52671] DAMAGECOUNT value on done: 640575.0 [2024-08-06 05:28:50,067][52671] Sum rewards: 74.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.273', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.090', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 05:28:50,255][52649] DAMAGECOUNT value on done: 625937.0 [2024-08-06 05:28:50,256][52649] Sum rewards: 76.963, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.006', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.154', 'AMMO3': '0.184', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:50,409][52669] DAMAGECOUNT value on done: 657822.0 [2024-08-06 05:28:50,413][52669] Sum rewards: 70.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.555', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.128', 'weapon4': '0.186', 'AMMO4': '0.204', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '60.000'} [2024-08-06 05:28:50,901][52668] DAMAGECOUNT value on done: 641862.0 [2024-08-06 05:28:50,901][52668] Sum rewards: 93.286, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.906', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.078', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.473', 'FRAGCOUNT': '76.000'} [2024-08-06 05:28:51,215][52650] Updated weights for policy 0, policy_version 61461 (0.0012) [2024-08-06 05:28:51,601][52658] DAMAGECOUNT value on done: 638582.0 [2024-08-06 05:28:51,602][52658] Sum rewards: 75.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.439', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.246', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.412', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:51,806][52647] DAMAGECOUNT value on done: 671649.0 [2024-08-06 05:28:51,807][52647] Sum rewards: 79.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.052', 'AMMO4': '0.166', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.820', 'WEAPON3': '1.100', 'weapon3': '2.862', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '65.000'} [2024-08-06 05:28:51,957][52662] DAMAGECOUNT value on done: 637538.0 [2024-08-06 05:28:51,959][52662] Sum rewards: 85.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.642', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '71.000'} [2024-08-06 05:28:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 503504896. Throughput: 0: 4359.6. Samples: 125881230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:28:52,794][52567] Avg episode reward: [(0, '74.015')] [2024-08-06 05:28:52,938][52671] DAMAGECOUNT value on done: 627611.0 [2024-08-06 05:28:52,938][52671] Sum rewards: 72.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.096', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.108', 'WEAPON5': '0.200', 'weapon5': '0.208', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.252', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:53,320][52649] DAMAGECOUNT value on done: 618115.0 [2024-08-06 05:28:53,326][52649] Sum rewards: 73.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.071', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.464', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:53,582][52669] DAMAGECOUNT value on done: 644725.0 [2024-08-06 05:28:53,587][52669] Sum rewards: 72.214, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.114', 'AMMO4': '0.174', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.336', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:53,636][52668] DAMAGECOUNT value on done: 632233.0 [2024-08-06 05:28:53,638][52668] Sum rewards: 80.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.974', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.186', 'weapon4': '0.206', 'AMMO3': '0.220', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.955', 'FRAGCOUNT': '64.000'} [2024-08-06 05:28:54,263][52647] DAMAGECOUNT value on done: 668125.0 [2024-08-06 05:28:54,264][52647] Sum rewards: 76.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.446', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.136', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO4': '0.213', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '64.000'} [2024-08-06 05:28:54,397][52658] DAMAGECOUNT value on done: 625377.0 [2024-08-06 05:28:54,399][52658] Sum rewards: 70.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.116', 'weapon5': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:55,130][52662] DAMAGECOUNT value on done: 646527.0 [2024-08-06 05:28:55,131][52662] Sum rewards: 68.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '56.500'} [2024-08-06 05:28:55,704][52671] DAMAGECOUNT value on done: 646313.0 [2024-08-06 05:28:55,705][52671] Sum rewards: 67.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.205', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.154', 'AMMO3': '0.208', 'AMMO4': '0.214', 'weapon5': '0.312', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '55.000'} [2024-08-06 05:28:56,153][52669] DAMAGECOUNT value on done: 643012.0 [2024-08-06 05:28:56,154][52669] Sum rewards: 81.309, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.972', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.100', 'weapon5': '0.140', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.390', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '69.000'} [2024-08-06 05:28:56,198][52650] Updated weights for policy 0, policy_version 61471 (0.0031) [2024-08-06 05:28:56,584][52649] DAMAGECOUNT value on done: 622857.0 [2024-08-06 05:28:56,586][52649] Sum rewards: 75.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.114', 'AMMO4': '0.169', 'weapon5': '0.170', 'weapon2': '0.182', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '63.000'} [2024-08-06 05:28:56,661][52647] DAMAGECOUNT value on done: 663421.0 [2024-08-06 05:28:56,661][52647] Sum rewards: 69.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.810', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.058', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO4': '0.234', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.102', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '60.000'} [2024-08-06 05:28:56,837][52668] DAMAGECOUNT value on done: 633701.0 [2024-08-06 05:28:56,837][52668] Sum rewards: 72.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.036', 'AMMO4': '0.134', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '59.000'} [2024-08-06 05:28:57,631][52658] DAMAGECOUNT value on done: 642089.0 [2024-08-06 05:28:57,631][52658] Sum rewards: 75.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.067', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.195', 'weapon5': '0.196', 'AMMO4': '0.199', 'weapon4': '0.316', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '61.000'} [2024-08-06 05:28:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 503595008. Throughput: 0: 4360.0. Samples: 125907270. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:28:57,794][52567] Avg episode reward: [(0, '73.880')] [2024-08-06 05:28:58,243][52662] DAMAGECOUNT value on done: 632525.0 [2024-08-06 05:28:58,243][52662] Sum rewards: 66.926, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.163', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon2': '0.202', 'weapon5': '0.208', 'AMMO3': '0.220', 'weapon4': '0.242', 'AMMO4': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '56.000'} [2024-08-06 05:28:58,716][52671] DAMAGECOUNT value on done: 642411.0 [2024-08-06 05:28:58,717][52671] Sum rewards: 78.709, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.054', 'HEALTH': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.478', 'WEAPON3': '0.950', 'weapon3': '3.228', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:58,747][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:28:58,921][52647] DAMAGECOUNT value on done: 675557.0 [2024-08-06 05:28:58,921][52647] Sum rewards: 67.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.178', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.197', 'weapon2': '0.232', 'AMMO4': '0.276', 'weapon5': '0.296', 'weapon4': '0.534', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.642', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '56.000'} [2024-08-06 05:28:59,275][52668] DAMAGECOUNT value on done: 642225.0 [2024-08-06 05:28:59,277][52668] Sum rewards: 79.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.022', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.332', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '67.000'} [2024-08-06 05:28:59,501][52669] DAMAGECOUNT value on done: 642834.0 [2024-08-06 05:28:59,502][52669] Sum rewards: 75.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.464', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.114', 'weapon4': '0.134', 'AMMO3': '0.191', 'AMMO4': '0.267', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '62.000'} [2024-08-06 05:28:59,766][52649] DAMAGECOUNT value on done: 623537.0 [2024-08-06 05:28:59,766][52649] Sum rewards: 64.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.176', 'weapon5': '0.280', 'AMMO4': '0.282', 'weapon2': '0.310', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '52.000'} [2024-08-06 05:29:00,301][52658] DAMAGECOUNT value on done: 634751.0 [2024-08-06 05:29:00,301][52658] Sum rewards: 83.930, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.095', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '66.000'} [2024-08-06 05:29:00,793][52650] Updated weights for policy 0, policy_version 61481 (0.0031) [2024-08-06 05:29:00,846][52662] DAMAGECOUNT value on done: 651084.0 [2024-08-06 05:29:00,847][52662] Sum rewards: 94.378, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.937', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.108', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.376', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '22.875', 'FRAGCOUNT': '74.000'} [2024-08-06 05:29:00,991][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:29:01,696][52647] DAMAGECOUNT value on done: 667839.0 [2024-08-06 05:29:01,697][52647] Sum rewards: 77.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.115', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '64.000'} [2024-08-06 05:29:01,860][52671] DAMAGECOUNT value on done: 643492.0 [2024-08-06 05:29:01,860][52671] Sum rewards: 77.295, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon4': '0.050', 'HEALTH': '0.090', 'AMMO4': '0.092', 'weapon5': '0.124', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.580', 'WEAPON3': '0.950', 'weapon3': '3.090', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '62.000'} [2024-08-06 05:29:02,344][52668] DAMAGECOUNT value on done: 637884.0 [2024-08-06 05:29:02,345][52668] Sum rewards: 71.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.704', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.137', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '57.000'} [2024-08-06 05:29:02,358][52649] DAMAGECOUNT value on done: 615093.0 [2024-08-06 05:29:02,358][52649] Sum rewards: 70.207, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.885', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.113', 'AMMO3': '0.147', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.884', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '55.000'} [2024-08-06 05:29:02,681][52669] DAMAGECOUNT value on done: 649360.0 [2024-08-06 05:29:02,681][52669] Sum rewards: 69.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon5': '0.036', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 503685120. Throughput: 0: 4364.0. Samples: 125920380. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:29:02,794][52567] Avg episode reward: [(0, '74.007')] [2024-08-06 05:29:03,210][52658] DAMAGECOUNT value on done: 634425.0 [2024-08-06 05:29:03,211][52658] Sum rewards: 69.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.109', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.060', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '59.000'} [2024-08-06 05:29:03,633][52662] DAMAGECOUNT value on done: 630772.0 [2024-08-06 05:29:03,633][52662] Sum rewards: 67.285, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.394', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.112', 'weapon5': '0.162', 'AMMO4': '0.197', 'AMMO3': '0.254', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.158', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '60.000'} [2024-08-06 05:29:04,650][52647] DAMAGECOUNT value on done: 675320.0 [2024-08-06 05:29:04,651][52647] Sum rewards: 74.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.952', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.265', 'weapon2': '0.282', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.496', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '64.000'} [2024-08-06 05:29:04,865][52671] DAMAGECOUNT value on done: 643706.0 [2024-08-06 05:29:04,866][52671] Sum rewards: 82.014, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.104', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '69.000'} [2024-08-06 05:29:05,172][52649] DAMAGECOUNT value on done: 627120.0 [2024-08-06 05:29:05,173][52649] Sum rewards: 76.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.729', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.228', 'weapon5': '0.248', 'AMMO4': '0.270', 'weapon4': '0.278', 'weapon2': '0.284', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '64.000'} [2024-08-06 05:29:05,472][52650] Updated weights for policy 0, policy_version 61491 (0.0022) [2024-08-06 05:29:05,477][52668] DAMAGECOUNT value on done: 629191.0 [2024-08-06 05:29:05,477][52668] Sum rewards: 64.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.094', 'AMMO4': '0.138', 'weapon5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:05,877][52660] DAMAGECOUNT value on done: 636922.0 [2024-08-06 05:29:05,877][52660] Sum rewards: 78.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.665', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.096', 'AMMO4': '0.162', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '65.000'} [2024-08-06 05:29:06,272][52658] DAMAGECOUNT value on done: 637965.0 [2024-08-06 05:29:06,272][52658] Sum rewards: 67.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.230', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon2': '0.208', 'AMMO3': '0.239', 'AMMO4': '0.259', 'weapon5': '0.304', 'weapon4': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:06,319][52662] DAMAGECOUNT value on done: 641960.0 [2024-08-06 05:29:06,319][52662] Sum rewards: 72.640, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.154', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:07,592][52647] DAMAGECOUNT value on done: 675973.0 [2024-08-06 05:29:07,592][52647] Sum rewards: 78.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.094', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '66.000'} [2024-08-06 05:29:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 503775232. Throughput: 0: 4365.4. Samples: 125946540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:29:07,794][52567] Avg episode reward: [(0, '74.395')] [2024-08-06 05:29:07,817][52649] DAMAGECOUNT value on done: 629763.0 [2024-08-06 05:29:07,818][52649] Sum rewards: 72.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.132', 'AMMO4': '0.214', 'AMMO3': '0.215', 'weapon5': '0.224', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 05:29:08,024][52671] DAMAGECOUNT value on done: 638959.0 [2024-08-06 05:29:08,025][52671] Sum rewards: 72.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.126', 'AMMO3': '0.173', 'weapon4': '0.204', 'weapon2': '0.232', 'AMMO4': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '60.000'} [2024-08-06 05:29:08,197][52668] DAMAGECOUNT value on done: 622389.0 [2024-08-06 05:29:08,197][52668] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.238', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:08,872][52660] DAMAGECOUNT value on done: 627184.0 [2024-08-06 05:29:08,872][52660] Sum rewards: 76.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.832', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.190', 'weapon5': '0.240', 'AMMO4': '0.251', 'weapon4': '0.292', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '62.000'} [2024-08-06 05:29:09,364][52662] DAMAGECOUNT value on done: 645551.0 [2024-08-06 05:29:09,372][52662] Sum rewards: 74.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.461', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.130', 'AMMO4': '0.140', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:10,303][52650] Updated weights for policy 0, policy_version 61501 (0.0047) [2024-08-06 05:29:10,443][52649] DAMAGECOUNT value on done: 628581.0 [2024-08-06 05:29:10,443][52649] Sum rewards: 86.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.422', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '72.000'} [2024-08-06 05:29:10,477][52614] Signal inference workers to stop experience collection... (11200 times) [2024-08-06 05:29:10,478][52614] Signal inference workers to resume experience collection... (11200 times) [2024-08-06 05:29:10,561][52650] InferenceWorker_p0-w0: stopping experience collection (11200 times) [2024-08-06 05:29:10,561][52650] InferenceWorker_p0-w0: resuming experience collection (11200 times) [2024-08-06 05:29:10,699][52647] DAMAGECOUNT value on done: 658640.0 [2024-08-06 05:29:10,702][52647] Sum rewards: 76.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.059', 'weapon5': '0.136', 'weapon4': '0.230', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '2.834', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '64.000'} [2024-08-06 05:29:10,922][52668] DAMAGECOUNT value on done: 623249.0 [2024-08-06 05:29:10,926][52668] Sum rewards: 68.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.610', 'AMMO5': '0.011', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.060', 'weapon5': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 05:29:11,049][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:29:11,533][52660] DAMAGECOUNT value on done: 640281.0 [2024-08-06 05:29:11,537][52660] Sum rewards: 69.458, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.430', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.148', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:12,096][52662] DAMAGECOUNT value on done: 638769.0 [2024-08-06 05:29:12,097][52662] Sum rewards: 67.936, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.205', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '59.000'} [2024-08-06 05:29:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 503857152. Throughput: 0: 4363.8. Samples: 125972700. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:29:12,794][52567] Avg episode reward: [(0, '74.660')] [2024-08-06 05:29:13,093][52649] DAMAGECOUNT value on done: 626566.0 [2024-08-06 05:29:13,093][52649] Sum rewards: 66.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.123', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.082', 'AMMO4': '0.119', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '57.000'} [2024-08-06 05:29:13,668][52668] DAMAGECOUNT value on done: 625634.0 [2024-08-06 05:29:13,669][52668] Sum rewards: 65.963, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.204', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.110', 'AMMO3': '0.118', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.388', 'weapon2': '0.646', 'WEAPON3': '0.900', 'weapon3': '2.700', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:13,856][52647] DAMAGECOUNT value on done: 668684.0 [2024-08-06 05:29:13,857][52647] Sum rewards: 81.708, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.455', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.132', 'weapon4': '0.144', 'AMMO4': '0.190', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '70.000'} [2024-08-06 05:29:14,130][52660] DAMAGECOUNT value on done: 645177.0 [2024-08-06 05:29:14,130][52660] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.149', 'AMMO4': '0.168', 'weapon5': '0.190', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.372', 'HEALTH': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.890', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:14,703][52650] Updated weights for policy 0, policy_version 61511 (0.0018) [2024-08-06 05:29:15,155][52662] DAMAGECOUNT value on done: 648398.0 [2024-08-06 05:29:15,155][52662] Sum rewards: 77.869, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.450', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.122', 'weapon5': '0.164', 'AMMO4': '0.174', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '62.000'} [2024-08-06 05:29:15,873][52649] DAMAGECOUNT value on done: 612968.0 [2024-08-06 05:29:15,874][52649] Sum rewards: 66.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.395', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.130', 'weapon5': '0.184', 'AMMO4': '0.234', 'weapon4': '0.254', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '0.850', 'weapon3': '2.778', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:16,513][52668] DAMAGECOUNT value on done: 635011.0 [2024-08-06 05:29:16,514][52668] Sum rewards: 71.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.360', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO4': '0.157', 'AMMO3': '0.169', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '58.000'} [2024-08-06 05:29:17,121][52647] DAMAGECOUNT value on done: 658573.0 [2024-08-06 05:29:17,122][52647] Sum rewards: 74.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.441', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon2': '0.186', 'AMMO3': '0.225', 'AMMO4': '0.230', 'weapon5': '0.266', 'WEAPON5': '0.400', 'weapon4': '0.496', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.738', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:17,186][52660] DAMAGECOUNT value on done: 633206.0 [2024-08-06 05:29:17,188][52660] Sum rewards: 69.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.762', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.224', 'AMMO3': '0.257', 'weapon2': '0.348', 'WEAPON3': '1.650', 'weapon3': '3.114', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 503939072. Throughput: 0: 4375.8. Samples: 125986070. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:29:17,795][52567] Avg episode reward: [(0, '74.319')] [2024-08-06 05:29:17,858][52662] DAMAGECOUNT value on done: 633163.0 [2024-08-06 05:29:17,858][52662] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.356', 'weapon2': '0.494', 'WEAPON3': '0.950', 'weapon3': '2.850', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '53.000'} [2024-08-06 05:29:18,245][52649] DAMAGECOUNT value on done: 621387.0 [2024-08-06 05:29:18,247][52649] Sum rewards: 62.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.148', 'AMMO4': '0.225', 'AMMO3': '0.227', 'weapon4': '0.254', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '53.000'} [2024-08-06 05:29:19,530][52650] Updated weights for policy 0, policy_version 61521 (0.0035) [2024-08-06 05:29:19,663][52668] DAMAGECOUNT value on done: 636243.0 [2024-08-06 05:29:19,665][52668] Sum rewards: 71.854, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.827', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.095', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon5': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.162', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '57.500'} [2024-08-06 05:29:20,115][52660] DAMAGECOUNT value on done: 631033.0 [2024-08-06 05:29:20,116][52660] Sum rewards: 70.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO4': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'weapon2': '0.286', 'WEAPON3': '1.200', 'HITCOUNT': '3.480', 'weapon3': '3.538', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '58.000'} [2024-08-06 05:29:20,303][52647] DAMAGECOUNT value on done: 663671.0 [2024-08-06 05:29:20,304][52647] Sum rewards: 74.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.063', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:20,758][52662] DAMAGECOUNT value on done: 636512.0 [2024-08-06 05:29:20,762][52662] Sum rewards: 68.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.930', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.404', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '58.000'} [2024-08-06 05:29:20,786][52649] DAMAGECOUNT value on done: 614998.0 [2024-08-06 05:29:20,786][52649] Sum rewards: 84.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.036', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.069', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.284', 'WEAPON3': '1.600', 'weapon3': '3.332', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '72.000'} [2024-08-06 05:29:22,443][52668] DAMAGECOUNT value on done: 635103.0 [2024-08-06 05:29:22,445][52668] Sum rewards: 77.003, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.554', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.093', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.4). Total num frames: 504029184. Throughput: 0: 4370.9. Samples: 126012050. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:22,795][52567] Avg episode reward: [(0, '74.569')] [2024-08-06 05:29:22,947][52660] DAMAGECOUNT value on done: 632594.0 [2024-08-06 05:29:22,948][52660] Sum rewards: 77.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.158', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon2': '0.142', 'AMMO3': '0.150', 'AMMO4': '0.257', 'weapon5': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.820', 'WEAPON3': '0.900', 'weapon3': '2.256', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '60.000'} [2024-08-06 05:29:23,231][52795] DAMAGECOUNT value on done: 592908.0 [2024-08-06 05:29:23,231][52795] Sum rewards: 67.389, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.072', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.032', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:23,755][52649] DAMAGECOUNT value on done: 627171.0 [2024-08-06 05:29:23,755][52649] Sum rewards: 68.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.144', 'AMMO4': '0.224', 'AMMO3': '0.229', 'weapon5': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:23,856][52662] DAMAGECOUNT value on done: 633705.0 [2024-08-06 05:29:23,858][52662] Sum rewards: 68.868, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.825', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.208', 'weapon2': '0.236', 'AMMO3': '0.331', 'weapon4': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '2.804', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '62.000'} [2024-08-06 05:29:24,361][52650] Updated weights for policy 0, policy_version 61531 (0.0012) [2024-08-06 05:29:25,216][52668] DAMAGECOUNT value on done: 641485.0 [2024-08-06 05:29:25,216][52668] Sum rewards: 74.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.082', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.074', 'weapon5': '0.180', 'AMMO4': '0.184', 'AMMO3': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.850', 'weapon3': '2.946', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '64.000'} [2024-08-06 05:29:25,777][52660] DAMAGECOUNT value on done: 641896.0 [2024-08-06 05:29:25,777][52660] Sum rewards: 72.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.110', 'AMMO4': '0.172', 'weapon2': '0.188', 'weapon5': '0.220', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.246', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '62.000'} [2024-08-06 05:29:26,248][52649] DAMAGECOUNT value on done: 627372.0 [2024-08-06 05:29:26,250][52649] Sum rewards: 67.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.068', 'weapon5': '0.116', 'AMMO4': '0.117', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:26,263][52662] DAMAGECOUNT value on done: 642152.0 [2024-08-06 05:29:26,265][52662] Sum rewards: 67.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.773', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon2': '0.174', 'AMMO3': '0.215', 'AMMO4': '0.250', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.538', 'WEAPON3': '1.250', 'weapon3': '2.658', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:26,483][52795] DAMAGECOUNT value on done: 581283.0 [2024-08-06 05:29:26,484][52795] Sum rewards: 79.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.605', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.114', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '65.000'} [2024-08-06 05:29:27,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 504119296. Throughput: 0: 4368.7. Samples: 126038270. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:27,794][52567] Avg episode reward: [(0, '74.236')] [2024-08-06 05:29:28,114][52668] DAMAGECOUNT value on done: 637492.0 [2024-08-06 05:29:28,115][52668] Sum rewards: 75.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.212', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.087', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:28,819][52660] DAMAGECOUNT value on done: 631770.0 [2024-08-06 05:29:28,819][52660] Sum rewards: 71.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.714', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO3': '0.171', 'weapon2': '0.184', 'AMMO4': '0.225', 'weapon5': '0.242', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '57.000'} [2024-08-06 05:29:28,831][52649] DAMAGECOUNT value on done: 621078.0 [2024-08-06 05:29:28,832][52649] Sum rewards: 61.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '51.000'} [2024-08-06 05:29:28,950][52650] Updated weights for policy 0, policy_version 61541 (0.0022) [2024-08-06 05:29:29,154][52662] DAMAGECOUNT value on done: 634018.0 [2024-08-06 05:29:29,154][52662] Sum rewards: 71.660, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.832', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.166', 'AMMO3': '0.182', 'AMMO4': '0.192', 'weapon2': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 05:29:29,574][52795] DAMAGECOUNT value on done: 581381.0 [2024-08-06 05:29:29,575][52795] Sum rewards: 77.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.659', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon2': '0.152', 'weapon5': '0.170', 'weapon4': '0.196', 'AMMO4': '0.217', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.228', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '64.000'} [2024-08-06 05:29:31,463][52662] DAMAGECOUNT value on done: 648171.0 [2024-08-06 05:29:31,463][52662] Sum rewards: 79.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.781', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.224', 'WEAPON3': '1.300', 'weapon3': '3.504', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '66.000'} [2024-08-06 05:29:31,761][52660] DAMAGECOUNT value on done: 634009.0 [2024-08-06 05:29:31,761][52660] Sum rewards: 66.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.573', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.072', 'weapon4': '0.098', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:32,737][52795] DAMAGECOUNT value on done: 587603.0 [2024-08-06 05:29:32,739][52795] Sum rewards: 79.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.894', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.154', 'AMMO3': '0.170', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.416', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '64.000'} [2024-08-06 05:29:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 504209408. Throughput: 0: 4371.3. Samples: 126051390. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:32,794][52567] Avg episode reward: [(0, '73.842')] [2024-08-06 05:29:33,427][52650] Updated weights for policy 0, policy_version 61551 (0.0011) [2024-08-06 05:29:34,194][52662] DAMAGECOUNT value on done: 641799.0 [2024-08-06 05:29:34,196][52662] Sum rewards: 72.759, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.841', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:34,416][52660] DAMAGECOUNT value on done: 639193.0 [2024-08-06 05:29:34,416][52660] Sum rewards: 75.050, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.267', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.146', 'AMMO4': '0.251', 'weapon5': '0.274', 'weapon2': '0.296', 'weapon4': '0.410', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.774', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '57.000'} [2024-08-06 05:29:34,419][52820] DAMAGECOUNT value on done: 590353.0 [2024-08-06 05:29:34,420][52820] Sum rewards: 83.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.143', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.088', 'AMMO4': '0.091', 'weapon5': '0.128', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '67.000'} [2024-08-06 05:29:35,971][52795] DAMAGECOUNT value on done: 583977.0 [2024-08-06 05:29:35,972][52795] Sum rewards: 75.787, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.140', 'AMMO3': '0.191', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:36,948][52662] DAMAGECOUNT value on done: 628627.0 [2024-08-06 05:29:36,956][52662] Sum rewards: 65.817, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.744', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.197', 'weapon2': '0.682', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:37,083][52660] DAMAGECOUNT value on done: 632272.0 [2024-08-06 05:29:37,083][52660] Sum rewards: 75.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.262', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:37,441][52820] DAMAGECOUNT value on done: 591293.0 [2024-08-06 05:29:37,441][52820] Sum rewards: 70.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.396', 'AMMO5': '0.023', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.178', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '59.000'} [2024-08-06 05:29:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 504291328. Throughput: 0: 4372.0. Samples: 126077970. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:37,794][52567] Avg episode reward: [(0, '73.753')] [2024-08-06 05:29:38,292][52650] Updated weights for policy 0, policy_version 61561 (0.0020) [2024-08-06 05:29:39,122][52795] DAMAGECOUNT value on done: 595309.0 [2024-08-06 05:29:39,122][52795] Sum rewards: 63.790, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon2': '0.170', 'AMMO3': '0.192', 'AMMO4': '0.257', 'weapon5': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.420', 'WEAPON3': '1.100', 'weapon3': '2.876', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '52.000'} [2024-08-06 05:29:39,530][52662] DAMAGECOUNT value on done: 637618.0 [2024-08-06 05:29:39,530][52662] Sum rewards: 72.616, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.202', 'AMMO3': '0.230', 'AMMO4': '0.258', 'weapon5': '0.294', 'weapon2': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 05:29:39,574][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:29:40,117][52660] DAMAGECOUNT value on done: 633500.0 [2024-08-06 05:29:40,118][52660] Sum rewards: 69.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.122', 'AMMO4': '0.183', 'AMMO3': '0.189', 'weapon5': '0.200', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '58.000'} [2024-08-06 05:29:40,254][52658] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:29:40,453][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:29:40,596][52820] DAMAGECOUNT value on done: 593035.0 [2024-08-06 05:29:40,596][52820] Sum rewards: 80.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.406', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '67.000'} [2024-08-06 05:29:40,780][52659] Large shaping reward 2.742 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:29:42,046][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:29:42,099][52662] DAMAGECOUNT value on done: 631793.0 [2024-08-06 05:29:42,100][52662] Sum rewards: 69.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.092', 'AMMO4': '0.112', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '58.000'} [2024-08-06 05:29:42,282][52795] DAMAGECOUNT value on done: 597144.0 [2024-08-06 05:29:42,284][52795] Sum rewards: 52.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.082', 'weapon5': '0.128', 'AMMO3': '0.165', 'AMMO4': '0.229', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.708', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '2.916', 'DAMAGECOUNT': '13.620', 'FRAGCOUNT': '42.000'} [2024-08-06 05:29:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 504381440. Throughput: 0: 4375.6. Samples: 126104170. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:42,794][52567] Avg episode reward: [(0, '73.319')] [2024-08-06 05:29:43,004][52650] Updated weights for policy 0, policy_version 61571 (0.0012) [2024-08-06 05:29:43,222][52660] DAMAGECOUNT value on done: 645473.0 [2024-08-06 05:29:43,223][52660] Sum rewards: 71.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.182', 'AMMO3': '0.209', 'weapon5': '0.230', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 05:29:43,724][52820] DAMAGECOUNT value on done: 584877.0 [2024-08-06 05:29:43,725][52820] Sum rewards: 72.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.085', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'AMMO3': '0.242', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:45,379][52795] DAMAGECOUNT value on done: 590243.0 [2024-08-06 05:29:45,382][52795] Sum rewards: 78.370, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.394', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.144', 'AMMO4': '0.192', 'weapon5': '0.226', 'AMMO3': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.906', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '66.000'} [2024-08-06 05:29:45,667][52660] DAMAGECOUNT value on done: 651236.0 [2024-08-06 05:29:45,667][52660] Sum rewards: 79.223, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.156', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.326', 'WEAPON3': '1.050', 'weapon3': '2.952', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:45,869][52659] DAMAGECOUNT value on done: 644274.0 [2024-08-06 05:29:45,869][52659] Sum rewards: 75.231, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.273', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.208', 'weapon5': '0.252', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.676', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:46,857][52820] DAMAGECOUNT value on done: 593438.0 [2024-08-06 05:29:46,859][52820] Sum rewards: 66.174, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.511', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.170', 'weapon2': '0.174', 'AMMO3': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.936', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '57.000'} [2024-08-06 05:29:47,665][52650] Updated weights for policy 0, policy_version 61581 (0.0012) [2024-08-06 05:29:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 504471552. Throughput: 0: 4372.9. Samples: 126117160. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:47,794][52567] Avg episode reward: [(0, '73.049')] [2024-08-06 05:29:48,522][52795] DAMAGECOUNT value on done: 585977.0 [2024-08-06 05:29:48,522][52795] Sum rewards: 79.014, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.716', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '67.000'} [2024-08-06 05:29:48,684][52660] DAMAGECOUNT value on done: 632112.0 [2024-08-06 05:29:48,685][52660] Sum rewards: 54.976, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.256', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.170', 'weapon2': '0.172', 'AMMO4': '0.198', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '2.680', 'weapon3': '3.288', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '51.000'} [2024-08-06 05:29:48,964][52659] DAMAGECOUNT value on done: 637825.0 [2024-08-06 05:29:48,966][52659] Sum rewards: 78.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '66.000'} [2024-08-06 05:29:50,080][52820] DAMAGECOUNT value on done: 585355.0 [2024-08-06 05:29:50,082][52820] Sum rewards: 69.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.854', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '57.500'} [2024-08-06 05:29:51,032][52668] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:29:51,713][52795] DAMAGECOUNT value on done: 594305.0 [2024-08-06 05:29:51,714][52795] Sum rewards: 67.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.168', 'AMMO4': '0.196', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.082', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:51,781][52660] DAMAGECOUNT value on done: 642080.0 [2024-08-06 05:29:51,783][52660] Sum rewards: 63.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.148', 'weapon5': '0.152', 'weapon2': '0.228', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.202', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:51,810][52665] DAMAGECOUNT value on done: 626822.0 [2024-08-06 05:29:51,812][52665] Sum rewards: 73.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.047', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon5': '0.206', 'AMMO4': '0.225', 'AMMO3': '0.235', 'weapon2': '0.248', 'weapon4': '0.320', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.916', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:52,007][52659] DAMAGECOUNT value on done: 643366.0 [2024-08-06 05:29:52,012][52659] Sum rewards: 72.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.178', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.026', 'weapon5': '0.056', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '62.000'} [2024-08-06 05:29:52,521][52650] Updated weights for policy 0, policy_version 61591 (0.0042) [2024-08-06 05:29:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 504553472. Throughput: 0: 4382.4. Samples: 126143750. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:52,795][52567] Avg episode reward: [(0, '72.627')] [2024-08-06 05:29:53,460][52820] DAMAGECOUNT value on done: 591187.0 [2024-08-06 05:29:53,460][52820] Sum rewards: 70.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.028', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.324', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '59.000'} [2024-08-06 05:29:54,468][52665] DAMAGECOUNT value on done: 641432.0 [2024-08-06 05:29:54,469][52665] Sum rewards: 75.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.920', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.116', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:54,769][52795] DAMAGECOUNT value on done: 591780.0 [2024-08-06 05:29:54,770][52795] Sum rewards: 78.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.098', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon5': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '66.000'} [2024-08-06 05:29:54,972][52660] DAMAGECOUNT value on done: 635307.0 [2024-08-06 05:29:54,974][52660] Sum rewards: 80.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.146', 'weapon5': '0.158', 'AMMO3': '0.196', 'AMMO4': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '65.000'} [2024-08-06 05:29:55,202][52659] DAMAGECOUNT value on done: 636805.0 [2024-08-06 05:29:55,207][52659] Sum rewards: 76.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.276', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.076', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.420', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '65.000'} [2024-08-06 05:29:56,772][52820] DAMAGECOUNT value on done: 594808.0 [2024-08-06 05:29:56,772][52820] Sum rewards: 75.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.295', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.166', 'AMMO3': '0.176', 'weapon5': '0.236', 'AMMO4': '0.245', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '60.000'} [2024-08-06 05:29:56,776][52650] Updated weights for policy 0, policy_version 61601 (0.0013) [2024-08-06 05:29:56,836][52665] DAMAGECOUNT value on done: 637913.0 [2024-08-06 05:29:56,838][52665] Sum rewards: 65.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.638', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.106', 'AMMO4': '0.130', 'weapon5': '0.182', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '54.000'} [2024-08-06 05:29:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 504643584. Throughput: 0: 4385.3. Samples: 126170040. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:29:57,802][52567] Avg episode reward: [(0, '72.751')] [2024-08-06 05:29:57,829][52811] DAMAGECOUNT value on done: 609950.0 [2024-08-06 05:29:57,830][52811] Sum rewards: 78.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.752', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.120', 'AMMO4': '0.143', 'AMMO3': '0.186', 'weapon5': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '63.000'} [2024-08-06 05:29:57,935][52795] DAMAGECOUNT value on done: 586243.0 [2024-08-06 05:29:57,935][52795] Sum rewards: 68.717, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.480', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.121', 'weapon4': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '0.800', 'HITCOUNT': '3.190', 'weapon3': '3.250', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '52.000'} [2024-08-06 05:29:58,059][52660] DAMAGECOUNT value on done: 632207.0 [2024-08-06 05:29:58,059][52660] Sum rewards: 66.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.195', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon2': '0.192', 'AMMO3': '0.251', 'weapon4': '0.266', 'AMMO4': '0.317', 'weapon5': '0.322', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '55.000'} [2024-08-06 05:29:58,291][52659] DAMAGECOUNT value on done: 634286.0 [2024-08-06 05:29:58,291][52659] Sum rewards: 68.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.080', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'weapon4': '0.472', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.582', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '56.000'} [2024-08-06 05:29:59,292][52664] DAMAGECOUNT value on done: 662065.0 [2024-08-06 05:29:59,294][52664] Sum rewards: 69.499, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.750', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.086', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'AMMO3': '0.279', 'weapon2': '0.362', 'WEAPON3': '1.750', 'weapon3': '3.084', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '61.000'} [2024-08-06 05:29:59,556][52665] DAMAGECOUNT value on done: 632045.0 [2024-08-06 05:29:59,556][52665] Sum rewards: 78.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.556', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.206', 'AMMO3': '0.216', 'weapon5': '0.218', 'weapon2': '0.228', 'AMMO4': '0.303', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '65.000'} [2024-08-06 05:29:59,918][52820] DAMAGECOUNT value on done: 590708.0 [2024-08-06 05:29:59,918][52820] Sum rewards: 79.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.752', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.149', 'weapon5': '0.152', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:00,923][52811] DAMAGECOUNT value on done: 590593.0 [2024-08-06 05:30:00,923][52811] Sum rewards: 79.146, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.136', 'AMMO3': '0.162', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.972', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:01,125][52795] DAMAGECOUNT value on done: 585549.0 [2024-08-06 05:30:01,126][52795] Sum rewards: 79.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.502', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.112', 'AMMO4': '0.169', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '67.000'} [2024-08-06 05:30:01,230][52660] DAMAGECOUNT value on done: 627050.0 [2024-08-06 05:30:01,231][52660] Sum rewards: 77.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.580', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.135', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:01,552][52659] DAMAGECOUNT value on done: 642750.0 [2024-08-06 05:30:01,553][52659] Sum rewards: 78.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.187', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.112', 'weapon4': '0.120', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.564', 'WEAPON3': '1.000', 'weapon3': '3.024', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:01,755][52650] Updated weights for policy 0, policy_version 61611 (0.0036) [2024-08-06 05:30:02,263][52665] DAMAGECOUNT value on done: 621139.0 [2024-08-06 05:30:02,263][52665] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.118', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon4': '0.066', 'weapon5': '0.156', 'AMMO3': '0.188', 'AMMO4': '0.324', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '56.000'} [2024-08-06 05:30:02,453][52664] DAMAGECOUNT value on done: 665649.0 [2024-08-06 05:30:02,454][52664] Sum rewards: 77.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.561', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.224', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:02,662][52794] DAMAGECOUNT value on done: 641469.0 [2024-08-06 05:30:02,663][52794] Sum rewards: 72.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.414', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.167', 'weapon2': '0.246', 'AMMO4': '0.264', 'weapon5': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.698', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 504733696. Throughput: 0: 4374.5. Samples: 126182920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:02,802][52567] Avg episode reward: [(0, '72.712')] [2024-08-06 05:30:02,976][52820] DAMAGECOUNT value on done: 597142.0 [2024-08-06 05:30:02,978][52820] Sum rewards: 79.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.160', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.410', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '67.000'} [2024-08-06 05:30:04,026][52811] DAMAGECOUNT value on done: 590005.0 [2024-08-06 05:30:04,027][52811] Sum rewards: 71.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.119', 'weapon5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.278', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:04,235][52659] DAMAGECOUNT value on done: 638231.0 [2024-08-06 05:30:04,235][52659] Sum rewards: 81.778, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.530', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.166', 'AMMO4': '0.183', 'weapon5': '0.214', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.624', 'FRAGCOUNT': '67.000'} [2024-08-06 05:30:04,255][52795] DAMAGECOUNT value on done: 591901.0 [2024-08-06 05:30:04,255][52795] Sum rewards: 58.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.156', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.160', 'AMMO4': '0.174', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.136', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '49.000'} [2024-08-06 05:30:05,060][52665] DAMAGECOUNT value on done: 628096.0 [2024-08-06 05:30:05,061][52665] Sum rewards: 78.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.404', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.084', 'weapon4': '0.118', 'AMMO4': '0.129', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.304', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:05,534][52664] DAMAGECOUNT value on done: 664405.0 [2024-08-06 05:30:05,534][52664] Sum rewards: 59.769, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.156', 'weapon5': '0.182', 'AMMO4': '0.258', 'AMMO3': '0.273', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.904', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '52.000'} [2024-08-06 05:30:05,807][52794] DAMAGECOUNT value on done: 645939.0 [2024-08-06 05:30:05,809][52794] Sum rewards: 66.693, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.688', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.156', 'AMMO3': '0.160', 'weapon5': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.094', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '53.000'} [2024-08-06 05:30:06,104][52820] DAMAGECOUNT value on done: 588879.0 [2024-08-06 05:30:06,106][52820] Sum rewards: 79.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.252', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '68.000'} [2024-08-06 05:30:06,227][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:30:06,231][52650] Updated weights for policy 0, policy_version 61621 (0.0030) [2024-08-06 05:30:06,995][52811] DAMAGECOUNT value on done: 592355.0 [2024-08-06 05:30:06,997][52811] Sum rewards: 82.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '66.000'} [2024-08-06 05:30:07,151][52659] DAMAGECOUNT value on done: 635377.0 [2024-08-06 05:30:07,151][52659] Sum rewards: 79.888, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.700', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.754', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:07,317][52795] DAMAGECOUNT value on done: 579425.0 [2024-08-06 05:30:07,318][52795] Sum rewards: 73.245, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.629', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.230', 'AMMO4': '0.245', 'weapon2': '0.254', 'AMMO3': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 504815616. Throughput: 0: 4381.8. Samples: 126209230. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:07,794][52567] Avg episode reward: [(0, '72.683')] [2024-08-06 05:30:07,796][52665] DAMAGECOUNT value on done: 632070.0 [2024-08-06 05:30:07,802][52665] Sum rewards: 76.237, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.169', 'weapon2': '0.274', 'HEALTH': '0.292', 'WEAPON3': '1.000', 'weapon3': '3.208', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:08,531][52664] DAMAGECOUNT value on done: 657355.0 [2024-08-06 05:30:08,532][52664] Sum rewards: 78.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.160', 'AMMO3': '0.197', 'AMMO4': '0.206', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.424', 'FRAGCOUNT': '62.500'} [2024-08-06 05:30:08,964][52794] DAMAGECOUNT value on done: 646996.0 [2024-08-06 05:30:08,965][52794] Sum rewards: 77.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.084', 'AMMO4': '0.141', 'weapon5': '0.152', 'AMMO3': '0.220', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:09,281][52820] DAMAGECOUNT value on done: 593872.0 [2024-08-06 05:30:09,283][52820] Sum rewards: 72.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.206', 'weapon2': '0.216', 'weapon5': '0.218', 'AMMO4': '0.233', 'weapon4': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '60.000'} [2024-08-06 05:30:10,245][52811] DAMAGECOUNT value on done: 598216.0 [2024-08-06 05:30:10,248][52811] Sum rewards: 85.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.006', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.210', 'weapon2': '0.268', 'WEAPON3': '1.200', 'weapon3': '3.512', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '71.000'} [2024-08-06 05:30:10,263][52659] DAMAGECOUNT value on done: 641837.0 [2024-08-06 05:30:10,265][52659] Sum rewards: 69.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.122', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.112', 'weapon2': '0.198', 'weapon5': '0.216', 'AMMO3': '0.221', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.246', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:10,479][52795] DAMAGECOUNT value on done: 596800.0 [2024-08-06 05:30:10,479][52795] Sum rewards: 76.208, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.282', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.048', 'weapon5': '0.080', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '3.084', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '60.000'} [2024-08-06 05:30:11,027][52650] Updated weights for policy 0, policy_version 61631 (0.0013) [2024-08-06 05:30:11,101][52664] DAMAGECOUNT value on done: 665341.0 [2024-08-06 05:30:11,102][52664] Sum rewards: 77.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.646', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon5': '0.020', 'weapon4': '0.024', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.274', 'WEAPON3': '1.450', 'weapon3': '3.496', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:11,110][52665] DAMAGECOUNT value on done: 629737.0 [2024-08-06 05:30:11,110][52665] Sum rewards: 76.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.785', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.080', 'weapon4': '0.100', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:11,858][52794] DAMAGECOUNT value on done: 635858.0 [2024-08-06 05:30:11,860][52794] Sum rewards: 80.435, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.850', 'WEAPON3': '1.200', 'weapon3': '2.668', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '66.000'} [2024-08-06 05:30:12,308][52820] DAMAGECOUNT value on done: 600716.0 [2024-08-06 05:30:12,308][52820] Sum rewards: 67.473, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.084', 'AMMO4': '0.143', 'weapon5': '0.188', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.156', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 504913920. Throughput: 0: 4381.8. Samples: 126235450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:12,794][52567] Avg episode reward: [(0, '73.028')] [2024-08-06 05:30:13,070][52659] DAMAGECOUNT value on done: 645569.0 [2024-08-06 05:30:13,070][52659] Sum rewards: 72.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.165', 'AMMO3': '0.214', 'weapon4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:13,389][52811] DAMAGECOUNT value on done: 603323.0 [2024-08-06 05:30:13,389][52811] Sum rewards: 72.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.272', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:13,783][52665] DAMAGECOUNT value on done: 641667.0 [2024-08-06 05:30:13,786][52665] Sum rewards: 79.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.101', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.029', 'weapon4': '0.032', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:13,921][52795] DAMAGECOUNT value on done: 591232.0 [2024-08-06 05:30:13,922][52795] Sum rewards: 67.882, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.802', 'AMMO5': '0.022', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.140', 'AMMO4': '0.222', 'AMMO3': '0.270', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '60.500'} [2024-08-06 05:30:14,380][52664] DAMAGECOUNT value on done: 660352.0 [2024-08-06 05:30:14,383][52664] Sum rewards: 78.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.048', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:14,821][52794] DAMAGECOUNT value on done: 635836.0 [2024-08-06 05:30:14,824][52794] Sum rewards: 66.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.466', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.378', 'weapon4': '0.412', 'WEAPON3': '1.000', 'weapon3': '2.946', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '52.000'} [2024-08-06 05:30:15,415][52820] DAMAGECOUNT value on done: 596063.0 [2024-08-06 05:30:15,415][52820] Sum rewards: 72.765, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.134', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.124', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:15,610][52659] DAMAGECOUNT value on done: 634143.0 [2024-08-06 05:30:15,610][52659] Sum rewards: 51.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.090', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.096', 'weapon4': '0.118', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.650', 'weapon3': '3.206', 'DAMAGECOUNT': '12.669', 'FRAGCOUNT': '48.500'} [2024-08-06 05:30:15,910][52650] Updated weights for policy 0, policy_version 61641 (0.0033) [2024-08-06 05:30:16,373][52811] DAMAGECOUNT value on done: 600941.0 [2024-08-06 05:30:16,378][52811] Sum rewards: 75.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.695', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon5': '0.186', 'AMMO3': '0.195', 'weapon4': '0.280', 'AMMO4': '0.326', 'weapon2': '0.326', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:16,756][52665] DAMAGECOUNT value on done: 632036.0 [2024-08-06 05:30:16,757][52665] Sum rewards: 93.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.949', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.138', 'AMMO3': '0.175', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '22.146', 'FRAGCOUNT': '75.000'} [2024-08-06 05:30:17,106][52795] DAMAGECOUNT value on done: 585041.0 [2024-08-06 05:30:17,106][52795] Sum rewards: 73.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.898', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.096', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.217', 'WEAPON3': '1.250', 'weapon3': '3.490', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '59.500'} [2024-08-06 05:30:17,289][52664] DAMAGECOUNT value on done: 660438.0 [2024-08-06 05:30:17,290][52664] Sum rewards: 67.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.096', 'weapon5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.276', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:17,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 504995840. Throughput: 0: 4380.4. Samples: 126248510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:17,803][52567] Avg episode reward: [(0, '73.165')] [2024-08-06 05:30:17,835][52794] DAMAGECOUNT value on done: 639278.0 [2024-08-06 05:30:17,836][52794] Sum rewards: 60.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.208', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.172', 'AMMO3': '0.189', 'weapon2': '0.528', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.020', 'DAMAGECOUNT': '15.027', 'FRAGCOUNT': '51.000'} [2024-08-06 05:30:18,580][52820] DAMAGECOUNT value on done: 599240.0 [2024-08-06 05:30:18,582][52820] Sum rewards: 64.477, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.688', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.136', 'AMMO4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.262', 'weapon5': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.000', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '55.000'} [2024-08-06 05:30:18,891][52667] DAMAGECOUNT value on done: 639177.0 [2024-08-06 05:30:18,892][52667] Sum rewards: 67.883, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.271', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.362', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '54.000'} [2024-08-06 05:30:18,921][52659] DAMAGECOUNT value on done: 644033.0 [2024-08-06 05:30:18,921][52659] Sum rewards: 59.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.720', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.292', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '49.000'} [2024-08-06 05:30:19,384][52811] DAMAGECOUNT value on done: 591641.0 [2024-08-06 05:30:19,386][52811] Sum rewards: 70.247, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.280', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon4': '0.126', 'weapon5': '0.252', 'AMMO3': '0.305', 'AMMO4': '0.339', 'weapon2': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.900', 'weapon3': '2.952', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:19,883][52664] DAMAGECOUNT value on done: 654726.0 [2024-08-06 05:30:19,886][52664] Sum rewards: 67.130, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.034', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.130', 'weapon5': '0.192', 'AMMO4': '0.199', 'weapon2': '0.264', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:19,993][52665] DAMAGECOUNT value on done: 640157.0 [2024-08-06 05:30:19,995][52665] Sum rewards: 82.902, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.302', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.086', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.288', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '65.500'} [2024-08-06 05:30:20,366][52795] DAMAGECOUNT value on done: 591512.0 [2024-08-06 05:30:20,367][52795] Sum rewards: 78.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.056', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.234', 'AMMO3': '0.255', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '66.000'} [2024-08-06 05:30:20,498][52650] Updated weights for policy 0, policy_version 61651 (0.0032) [2024-08-06 05:30:21,120][52794] DAMAGECOUNT value on done: 643566.0 [2024-08-06 05:30:21,120][52794] Sum rewards: 67.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.138', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '56.000'} [2024-08-06 05:30:21,850][52820] DAMAGECOUNT value on done: 594169.0 [2024-08-06 05:30:21,852][52820] Sum rewards: 83.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.612', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.092', 'weapon5': '0.214', 'AMMO3': '0.227', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '69.000'} [2024-08-06 05:30:21,935][52667] DAMAGECOUNT value on done: 646524.0 [2024-08-06 05:30:21,936][52667] Sum rewards: 78.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.118', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.074', 'weapon4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.182', 'AMMO3': '0.205', 'WEAPON3': '1.200', 'weapon3': '3.464', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:21,988][52659] DAMAGECOUNT value on done: 636738.0 [2024-08-06 05:30:21,989][52659] Sum rewards: 72.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.986', 'ARMOR': '0.009', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.084', 'weapon4': '0.090', 'AMMO3': '0.196', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:22,357][52664] DAMAGECOUNT value on done: 668894.0 [2024-08-06 05:30:22,358][52664] Sum rewards: 88.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.142', 'weapon5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '21.174', 'FRAGCOUNT': '74.000'} [2024-08-06 05:30:22,592][52811] DAMAGECOUNT value on done: 605030.0 [2024-08-06 05:30:22,595][52811] Sum rewards: 66.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.182', 'AMMO3': '0.188', 'weapon5': '0.202', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '52.000'} [2024-08-06 05:30:22,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 505077760. Throughput: 0: 4361.1. Samples: 126274220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:22,802][52567] Avg episode reward: [(0, '73.223')] [2024-08-06 05:30:23,155][52665] DAMAGECOUNT value on done: 635777.0 [2024-08-06 05:30:23,155][52665] Sum rewards: 64.188, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.618', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.076', 'weapon5': '0.126', 'AMMO4': '0.189', 'AMMO3': '0.321', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.112', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:23,290][52667] Large shaping reward 2.579 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:30:23,567][52795] DAMAGECOUNT value on done: 597912.0 [2024-08-06 05:30:23,567][52795] Sum rewards: 76.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.636', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.134', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:23,932][52794] DAMAGECOUNT value on done: 632164.0 [2024-08-06 05:30:23,933][52794] Sum rewards: 86.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.429', 'WEAPON1': '0.010', 'AMMO5': '0.031', 'AMMO2': '0.083', 'AMMO3': '0.214', 'weapon5': '0.248', 'weapon2': '0.266', 'weapon4': '0.342', 'AMMO4': '0.413', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '72.000'} [2024-08-06 05:30:24,959][52820] DAMAGECOUNT value on done: 595677.0 [2024-08-06 05:30:24,960][52820] Sum rewards: 72.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.160', 'weapon4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:24,969][52667] DAMAGECOUNT value on done: 640791.0 [2024-08-06 05:30:24,970][52667] Sum rewards: 60.839, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.540', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.144', 'weapon4': '0.162', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '54.000'} [2024-08-06 05:30:25,125][52659] DAMAGECOUNT value on done: 637198.0 [2024-08-06 05:30:25,125][52659] Sum rewards: 80.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.408', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon2': '0.218', 'AMMO3': '0.241', 'AMMO4': '0.311', 'weapon5': '0.314', 'weapon4': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:25,340][52664] DAMAGECOUNT value on done: 659173.0 [2024-08-06 05:30:25,340][52664] Sum rewards: 68.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.150', 'AMMO3': '0.208', 'AMMO4': '0.212', 'weapon5': '0.240', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:25,424][52650] Updated weights for policy 0, policy_version 61661 (0.0013) [2024-08-06 05:30:25,752][52811] DAMAGECOUNT value on done: 597009.0 [2024-08-06 05:30:25,754][52811] Sum rewards: 80.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.246', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '68.000'} [2024-08-06 05:30:26,359][52665] DAMAGECOUNT value on done: 635810.0 [2024-08-06 05:30:26,360][52665] Sum rewards: 81.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.732', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.054', 'AMMO4': '0.089', 'weapon5': '0.108', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '66.000'} [2024-08-06 05:30:26,891][52794] DAMAGECOUNT value on done: 644153.0 [2024-08-06 05:30:26,892][52794] Sum rewards: 77.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.351', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.108', 'AMMO3': '0.204', 'AMMO4': '0.224', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '66.000'} [2024-08-06 05:30:27,192][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:30:27,794][52567] Fps is (10 sec: 16384.7, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 505159680. Throughput: 0: 4361.5. Samples: 126300440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:27,794][52567] Avg episode reward: [(0, '73.202')] [2024-08-06 05:30:27,818][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061666_505167872.pth... [2024-08-06 05:30:27,968][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061155_500981760.pth [2024-08-06 05:30:28,144][52659] DAMAGECOUNT value on done: 650706.0 [2024-08-06 05:30:28,144][52659] Sum rewards: 75.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.058', 'weapon5': '0.170', 'AMMO3': '0.191', 'weapon2': '0.206', 'AMMO4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.344', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:28,200][52820] DAMAGECOUNT value on done: 605808.0 [2024-08-06 05:30:28,202][52820] Sum rewards: 73.519, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.136', 'AMMO4': '0.167', 'AMMO3': '0.199', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '59.000'} [2024-08-06 05:30:28,276][52667] DAMAGECOUNT value on done: 643137.0 [2024-08-06 05:30:28,276][52667] Sum rewards: 77.039, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.171', 'AMMO3': '0.173', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.164', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:28,278][52664] DAMAGECOUNT value on done: 667377.0 [2024-08-06 05:30:28,280][52664] Sum rewards: 71.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.180', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '60.000'} [2024-08-06 05:30:28,828][52665] DAMAGECOUNT value on done: 631498.0 [2024-08-06 05:30:28,831][52665] Sum rewards: 68.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.195', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.098', 'weapon5': '0.124', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.224', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:28,853][52811] DAMAGECOUNT value on done: 601070.0 [2024-08-06 05:30:28,854][52811] Sum rewards: 76.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.026', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:29,962][52650] Updated weights for policy 0, policy_version 61671 (0.0029) [2024-08-06 05:30:30,098][52794] DAMAGECOUNT value on done: 637152.0 [2024-08-06 05:30:30,099][52794] Sum rewards: 81.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.473', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.136', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '68.000'} [2024-08-06 05:30:31,123][52667] DAMAGECOUNT value on done: 647539.0 [2024-08-06 05:30:31,123][52667] Sum rewards: 61.279, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.109', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.560', 'WEAPON3': '0.750', 'weapon3': '2.594', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '48.000'} [2024-08-06 05:30:31,225][52659] DAMAGECOUNT value on done: 641784.0 [2024-08-06 05:30:31,227][52659] Sum rewards: 76.229, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.504', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.088', 'AMMO4': '0.122', 'weapon2': '0.230', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.378', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '66.000'} [2024-08-06 05:30:31,345][52820] DAMAGECOUNT value on done: 603680.0 [2024-08-06 05:30:31,346][52820] Sum rewards: 75.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.730', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.080', 'weapon5': '0.180', 'AMMO3': '0.261', 'weapon2': '0.286', 'AMMO4': '0.303', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:31,568][52664] DAMAGECOUNT value on done: 667537.0 [2024-08-06 05:30:31,568][52664] Sum rewards: 76.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.625', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.054', 'weapon5': '0.054', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '62.500'} [2024-08-06 05:30:31,744][52665] DAMAGECOUNT value on done: 630859.0 [2024-08-06 05:30:31,744][52665] Sum rewards: 72.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.651', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.174', 'weapon2': '0.174', 'AMMO4': '0.192', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '59.000'} [2024-08-06 05:30:31,906][52811] DAMAGECOUNT value on done: 605561.0 [2024-08-06 05:30:31,907][52811] Sum rewards: 76.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.939', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO3': '0.159', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.286', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 505257984. Throughput: 0: 4355.3. Samples: 126313150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:32,794][52567] Avg episode reward: [(0, '73.610')] [2024-08-06 05:30:32,825][52794] DAMAGECOUNT value on done: 635236.0 [2024-08-06 05:30:32,826][52794] Sum rewards: 79.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.815', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon4': '0.222', 'weapon5': '0.242', 'AMMO3': '0.244', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.996', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '67.000'} [2024-08-06 05:30:34,032][52803] DAMAGECOUNT value on done: 595790.0 [2024-08-06 05:30:34,032][52803] Sum rewards: 60.683, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.600', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.133', 'weapon4': '0.136', 'weapon2': '0.206', 'AMMO4': '0.242', 'weapon5': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'HITCOUNT': '2.600', 'weapon3': '3.022', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '47.000'} [2024-08-06 05:30:34,049][52667] DAMAGECOUNT value on done: 650280.0 [2024-08-06 05:30:34,051][52667] Sum rewards: 76.816, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.432', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.046', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.290', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'weapon3': '3.396', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '67.000'} [2024-08-06 05:30:34,136][52664] DAMAGECOUNT value on done: 668041.0 [2024-08-06 05:30:34,136][52664] Sum rewards: 60.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.242', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.134', 'weapon2': '0.166', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.116', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '50.000'} [2024-08-06 05:30:34,342][52659] DAMAGECOUNT value on done: 646727.0 [2024-08-06 05:30:34,343][52659] Sum rewards: 66.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.465', 'AMMO5': '0.024', 'AMMO2': '0.051', 'weapon4': '0.114', 'weapon5': '0.246', 'AMMO4': '0.253', 'AMMO3': '0.264', 'weapon2': '0.354', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:34,368][52820] DAMAGECOUNT value on done: 589737.0 [2024-08-06 05:30:34,370][52820] Sum rewards: 70.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.398', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon4': '0.114', 'AMMO3': '0.186', 'weapon5': '0.208', 'AMMO4': '0.302', 'weapon2': '0.572', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '58.500'} [2024-08-06 05:30:34,566][52650] Updated weights for policy 0, policy_version 61681 (0.0045) [2024-08-06 05:30:34,818][52665] DAMAGECOUNT value on done: 631032.0 [2024-08-06 05:30:34,821][52665] Sum rewards: 76.197, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.045', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.146', 'AMMO3': '0.190', 'weapon5': '0.216', 'AMMO4': '0.255', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:34,980][52811] DAMAGECOUNT value on done: 596885.0 [2024-08-06 05:30:34,981][52811] Sum rewards: 83.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.685', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.018', 'weapon4': '0.030', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '71.000'} [2024-08-06 05:30:35,437][52794] DAMAGECOUNT value on done: 640130.0 [2024-08-06 05:30:35,438][52794] Sum rewards: 77.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.114', 'weapon4': '0.158', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:36,926][52664] DAMAGECOUNT value on done: 669314.0 [2024-08-06 05:30:36,928][52664] Sum rewards: 74.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.610', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.168', 'AMMO4': '0.248', 'AMMO3': '0.274', 'weapon5': '0.276', 'weapon2': '0.528', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.726', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:37,025][52667] DAMAGECOUNT value on done: 642197.0 [2024-08-06 05:30:37,025][52667] Sum rewards: 76.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.068', 'weapon5': '0.094', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:37,063][52803] DAMAGECOUNT value on done: 594604.0 [2024-08-06 05:30:37,064][52803] Sum rewards: 87.449, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.088', 'weapon4': '0.100', 'AMMO4': '0.116', 'HEALTH': '0.160', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.212', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '71.000'} [2024-08-06 05:30:37,537][52659] DAMAGECOUNT value on done: 637671.0 [2024-08-06 05:30:37,538][52659] Sum rewards: 67.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.128', 'weapon4': '0.136', 'weapon2': '0.212', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.316', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '60.000'} [2024-08-06 05:30:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 505339904. Throughput: 0: 4349.1. Samples: 126339460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:30:37,795][52567] Avg episode reward: [(0, '73.783')] [2024-08-06 05:30:37,947][52665] DAMAGECOUNT value on done: 630786.0 [2024-08-06 05:30:37,949][52665] Sum rewards: 62.421, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.642', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '54.000'} [2024-08-06 05:30:38,084][52811] DAMAGECOUNT value on done: 592588.0 [2024-08-06 05:30:38,085][52811] Sum rewards: 77.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.186', 'AMMO3': '0.202', 'weapon4': '0.222', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:38,425][52794] DAMAGECOUNT value on done: 633377.0 [2024-08-06 05:30:38,426][52794] Sum rewards: 71.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.884', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 05:30:39,301][52650] Updated weights for policy 0, policy_version 61691 (0.0012) [2024-08-06 05:30:39,610][52664] DAMAGECOUNT value on done: 672899.0 [2024-08-06 05:30:39,610][52664] Sum rewards: 71.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO3': '0.164', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.406', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:39,832][52667] DAMAGECOUNT value on done: 643438.0 [2024-08-06 05:30:39,832][52667] Sum rewards: 71.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.358', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.258', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '59.000'} [2024-08-06 05:30:40,144][52803] DAMAGECOUNT value on done: 600893.0 [2024-08-06 05:30:40,145][52803] Sum rewards: 82.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.246', 'weapon2': '0.652', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '69.000'} [2024-08-06 05:30:40,495][52659] DAMAGECOUNT value on done: 645277.0 [2024-08-06 05:30:40,496][52659] Sum rewards: 71.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.468', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:40,919][52665] DAMAGECOUNT value on done: 626692.0 [2024-08-06 05:30:40,919][52665] Sum rewards: 61.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.224', 'weapon2': '0.568', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.266', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '51.000'} [2024-08-06 05:30:41,099][52794] DAMAGECOUNT value on done: 653647.0 [2024-08-06 05:30:41,099][52794] Sum rewards: 69.528, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.402', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.176', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:41,185][52811] DAMAGECOUNT value on done: 596041.0 [2024-08-06 05:30:41,187][52811] Sum rewards: 69.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:42,470][52664] DAMAGECOUNT value on done: 661916.0 [2024-08-06 05:30:42,470][52664] Sum rewards: 74.766, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.136', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.156', 'weapon5': '0.170', 'AMMO4': '0.173', 'weapon2': '0.280', 'WEAPON5': '0.300', 'AMMO3': '0.309', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.020', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:42,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 505430016. Throughput: 0: 4352.6. Samples: 126365910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:30:42,795][52567] Avg episode reward: [(0, '73.509')] [2024-08-06 05:30:42,904][52667] DAMAGECOUNT value on done: 646348.0 [2024-08-06 05:30:42,904][52667] Sum rewards: 84.752, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.509', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.251', 'weapon5': '0.280', 'AMMO4': '0.299', 'weapon4': '0.380', 'weapon2': '0.420', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.576', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '21.006', 'FRAGCOUNT': '69.500'} [2024-08-06 05:30:42,956][52659] DAMAGECOUNT value on done: 639174.0 [2024-08-06 05:30:42,957][52659] Sum rewards: 74.047, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon5': '0.090', 'weapon4': '0.106', 'AMMO4': '0.106', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.650', 'weapon3': '3.152', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '64.000'} [2024-08-06 05:30:43,196][52803] DAMAGECOUNT value on done: 602674.0 [2024-08-06 05:30:43,197][52803] Sum rewards: 74.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO4': '0.143', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:43,951][52650] Updated weights for policy 0, policy_version 61701 (0.0032) [2024-08-06 05:30:44,094][52665] DAMAGECOUNT value on done: 630640.0 [2024-08-06 05:30:44,095][52665] Sum rewards: 67.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'weapon4': '0.102', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '58.000'} [2024-08-06 05:30:44,302][52811] DAMAGECOUNT value on done: 595702.0 [2024-08-06 05:30:44,302][52811] Sum rewards: 81.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.148', 'AMMO4': '0.151', 'AMMO3': '0.224', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '68.000'} [2024-08-06 05:30:44,316][52794] DAMAGECOUNT value on done: 633970.0 [2024-08-06 05:30:44,318][52794] Sum rewards: 63.090, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.911', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO4': '0.208', 'AMMO3': '0.293', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.066', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '56.000'} [2024-08-06 05:30:45,179][52664] DAMAGECOUNT value on done: 660853.0 [2024-08-06 05:30:45,187][52664] Sum rewards: 78.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.174', 'weapon5': '0.186', 'AMMO4': '0.194', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:45,858][52795] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 05:30:45,936][52667] DAMAGECOUNT value on done: 649503.0 [2024-08-06 05:30:45,936][52667] Sum rewards: 64.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.227', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.102', 'weapon5': '0.184', 'AMMO3': '0.221', 'AMMO4': '0.280', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '53.000'} [2024-08-06 05:30:46,234][52803] DAMAGECOUNT value on done: 599001.0 [2024-08-06 05:30:46,235][52803] Sum rewards: 77.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.628', 'AMMO5': '0.009', 'weapon5': '0.040', 'AMMO2': '0.047', 'weapon4': '0.106', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO4': '0.235', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.460', 'weapon3': '3.484', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:46,548][52663] DAMAGECOUNT value on done: 649544.0 [2024-08-06 05:30:46,548][52663] Sum rewards: 77.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.488', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.102', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:47,029][52665] DAMAGECOUNT value on done: 635395.0 [2024-08-06 05:30:47,029][52665] Sum rewards: 89.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.102', 'WEAPON4': '0.150', 'weapon2': '0.164', 'AMMO3': '0.214', 'WEAPON3': '1.450', 'weapon3': '3.466', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '22.014', 'FRAGCOUNT': '74.000'} [2024-08-06 05:30:47,217][52794] DAMAGECOUNT value on done: 648655.0 [2024-08-06 05:30:47,218][52794] Sum rewards: 76.305, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.367', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.184', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:47,589][52811] DAMAGECOUNT value on done: 598582.0 [2024-08-06 05:30:47,591][52811] Sum rewards: 73.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.210', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.180', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.316', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '61.000'} [2024-08-06 05:30:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 505520128. Throughput: 0: 4354.2. Samples: 126378860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:30:47,794][52567] Avg episode reward: [(0, '73.856')] [2024-08-06 05:30:47,946][52664] DAMAGECOUNT value on done: 663869.0 [2024-08-06 05:30:47,946][52664] Sum rewards: 74.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.958', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.080', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:48,679][52650] Updated weights for policy 0, policy_version 61711 (0.0039) [2024-08-06 05:30:48,709][52667] DAMAGECOUNT value on done: 637316.0 [2024-08-06 05:30:48,709][52667] Sum rewards: 61.626, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.505', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.054', 'weapon4': '0.110', 'AMMO4': '0.161', 'WEAPON5': '0.300', 'AMMO3': '0.313', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.850', 'weapon3': '3.032', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:49,174][52663] DAMAGECOUNT value on done: 640861.0 [2024-08-06 05:30:49,174][52663] Sum rewards: 64.049, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.066', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.033', 'weapon4': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.194', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.722', 'WEAPON3': '1.250', 'weapon3': '2.710', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '52.000'} [2024-08-06 05:30:49,187][52803] DAMAGECOUNT value on done: 590723.0 [2024-08-06 05:30:49,187][52803] Sum rewards: 70.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.282', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 05:30:50,155][52794] DAMAGECOUNT value on done: 642516.0 [2024-08-06 05:30:50,157][52794] Sum rewards: 88.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.243', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.384', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '74.000'} [2024-08-06 05:30:50,705][52664] DAMAGECOUNT value on done: 665171.0 [2024-08-06 05:30:50,706][52664] Sum rewards: 75.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.102', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.156', 'weapon4': '0.184', 'AMMO4': '0.184', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.686', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:50,713][52811] DAMAGECOUNT value on done: 603553.0 [2024-08-06 05:30:50,715][52811] Sum rewards: 86.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.444', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.132', 'FRAGCOUNT': '70.000'} [2024-08-06 05:30:51,405][52667] DAMAGECOUNT value on done: 639633.0 [2024-08-06 05:30:51,406][52667] Sum rewards: 78.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:52,240][52663] DAMAGECOUNT value on done: 632170.0 [2024-08-06 05:30:52,240][52663] Sum rewards: 82.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.770', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.176', 'AMMO4': '0.211', 'weapon5': '0.232', 'AMMO3': '0.271', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.870', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.916', 'FRAGCOUNT': '69.000'} [2024-08-06 05:30:52,346][52803] DAMAGECOUNT value on done: 591446.0 [2024-08-06 05:30:52,347][52803] Sum rewards: 74.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.715', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon2': '0.206', 'AMMO3': '0.226', 'AMMO4': '0.271', 'weapon5': '0.302', 'weapon4': '0.330', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 505610240. Throughput: 0: 4353.3. Samples: 126405130. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:30:52,795][52567] Avg episode reward: [(0, '73.695')] [2024-08-06 05:30:52,869][52794] DAMAGECOUNT value on done: 647875.0 [2024-08-06 05:30:52,871][52794] Sum rewards: 62.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.629', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.176', 'AMMO3': '0.184', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.670', 'weapon4': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.186', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2024-08-06 05:30:53,449][52650] Updated weights for policy 0, policy_version 61721 (0.0010) [2024-08-06 05:30:53,465][52664] DAMAGECOUNT value on done: 662265.0 [2024-08-06 05:30:53,466][52664] Sum rewards: 76.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.093', 'weapon4': '0.144', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:53,977][52811] DAMAGECOUNT value on done: 598282.0 [2024-08-06 05:30:53,980][52811] Sum rewards: 75.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.086', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon2': '0.218', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:54,271][52667] DAMAGECOUNT value on done: 646925.0 [2024-08-06 05:30:54,272][52667] Sum rewards: 82.742, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon2': '0.132', 'AMMO3': '0.197', 'WEAPON3': '1.250', 'HITCOUNT': '3.560', 'weapon3': '3.668', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '67.000'} [2024-08-06 05:30:54,865][52663] DAMAGECOUNT value on done: 639062.0 [2024-08-06 05:30:54,867][52663] Sum rewards: 71.522, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.180', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.080', 'weapon5': '0.102', 'AMMO4': '0.137', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.222', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '63.000'} [2024-08-06 05:30:55,444][52803] DAMAGECOUNT value on done: 588895.0 [2024-08-06 05:30:55,446][52803] Sum rewards: 76.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.423', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.498', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '65.000'} [2024-08-06 05:30:55,824][52794] DAMAGECOUNT value on done: 650041.0 [2024-08-06 05:30:55,832][52794] Sum rewards: 72.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.074', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 05:30:57,134][52811] DAMAGECOUNT value on done: 595963.0 [2024-08-06 05:30:57,137][52811] Sum rewards: 83.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.916', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.096', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.336', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '69.000'} [2024-08-06 05:30:57,173][52663] DAMAGECOUNT value on done: 643545.0 [2024-08-06 05:30:57,175][52663] Sum rewards: 83.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.448', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '68.000'} [2024-08-06 05:30:57,390][52667] DAMAGECOUNT value on done: 635195.0 [2024-08-06 05:30:57,391][52667] Sum rewards: 70.473, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.610', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.112', 'weapon5': '0.158', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 05:30:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 505692160. Throughput: 0: 4350.9. Samples: 126431240. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:30:57,795][52567] Avg episode reward: [(0, '73.860')] [2024-08-06 05:30:57,878][52650] Updated weights for policy 0, policy_version 61731 (0.0022) [2024-08-06 05:30:58,520][52803] DAMAGECOUNT value on done: 594341.0 [2024-08-06 05:30:58,523][52803] Sum rewards: 66.893, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.104', 'weapon5': '0.110', 'AMMO4': '0.137', 'AMMO3': '0.163', 'weapon2': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.308', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '55.000'} [2024-08-06 05:30:58,775][52794] DAMAGECOUNT value on done: 641224.0 [2024-08-06 05:30:58,776][52794] Sum rewards: 73.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.145', 'AMMO5': '0.009', 'weapon5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '62.000'} [2024-08-06 05:30:59,001][52670] DAMAGECOUNT value on done: 632002.0 [2024-08-06 05:30:59,001][52670] Sum rewards: 85.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.612', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.094', 'weapon4': '0.144', 'AMMO4': '0.155', 'weapon2': '0.212', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.326', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '21.414', 'FRAGCOUNT': '71.000'} [2024-08-06 05:30:59,791][52666] DAMAGECOUNT value on done: 639999.0 [2024-08-06 05:30:59,792][52666] Sum rewards: 73.660, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '60.000'} [2024-08-06 05:31:00,251][52663] DAMAGECOUNT value on done: 650431.0 [2024-08-06 05:31:00,252][52663] Sum rewards: 69.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.330', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.212', 'AMMO3': '0.280', 'weapon4': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.740', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:00,291][52667] DAMAGECOUNT value on done: 646033.0 [2024-08-06 05:31:00,291][52667] Sum rewards: 71.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.585', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.130', 'AMMO4': '0.217', 'AMMO3': '0.230', 'weapon5': '0.254', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '60.000'} [2024-08-06 05:31:01,516][52803] DAMAGECOUNT value on done: 588603.0 [2024-08-06 05:31:01,524][52803] Sum rewards: 78.732, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.643', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.020', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:02,186][52670] DAMAGECOUNT value on done: 641870.0 [2024-08-06 05:31:02,188][52670] Sum rewards: 75.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.084', 'weapon5': '0.178', 'AMMO4': '0.184', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.816', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:02,778][52667] DAMAGECOUNT value on done: 651749.0 [2024-08-06 05:31:02,780][52667] Sum rewards: 74.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon2': '0.168', 'AMMO4': '0.232', 'weapon5': '0.234', 'AMMO3': '0.242', 'weapon4': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:02,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 505774080. Throughput: 0: 4349.8. Samples: 126444250. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:31:02,794][52567] Avg episode reward: [(0, '74.208')] [2024-08-06 05:31:02,967][52650] Updated weights for policy 0, policy_version 61741 (0.0023) [2024-08-06 05:31:02,994][52666] DAMAGECOUNT value on done: 641860.0 [2024-08-06 05:31:02,994][52666] Sum rewards: 73.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.090', 'weapon5': '0.140', 'AMMO4': '0.145', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:03,455][52663] DAMAGECOUNT value on done: 638116.0 [2024-08-06 05:31:03,457][52663] Sum rewards: 60.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.878', 'AMMO5': '0.024', 'AMMO2': '0.048', 'weapon4': '0.152', 'AMMO3': '0.204', 'weapon5': '0.240', 'AMMO4': '0.241', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '2.964', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '51.000'} [2024-08-06 05:31:04,665][52803] DAMAGECOUNT value on done: 607978.0 [2024-08-06 05:31:04,667][52803] Sum rewards: 77.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.568', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.258', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '65.000'} [2024-08-06 05:31:05,238][52670] DAMAGECOUNT value on done: 631964.0 [2024-08-06 05:31:05,238][52670] Sum rewards: 71.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.844', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.110', 'weapon2': '0.200', 'AMMO3': '0.214', 'weapon5': '0.228', 'AMMO4': '0.247', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.178', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 05:31:06,051][52666] DAMAGECOUNT value on done: 641479.0 [2024-08-06 05:31:06,054][52666] Sum rewards: 74.202, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.297', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.168', 'AMMO4': '0.174', 'weapon2': '0.264', 'AMMO3': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.248', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:06,084][52667] DAMAGECOUNT value on done: 648451.0 [2024-08-06 05:31:06,086][52667] Sum rewards: 69.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.084', 'AMMO4': '0.167', 'weapon5': '0.186', 'AMMO3': '0.190', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.164', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.000'} [2024-08-06 05:31:06,548][52663] DAMAGECOUNT value on done: 632624.0 [2024-08-06 05:31:06,549][52663] Sum rewards: 77.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.663', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.207', 'weapon2': '0.344', 'WEAPON3': '1.200', 'HITCOUNT': '3.440', 'weapon3': '3.456', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:07,428][52650] Updated weights for policy 0, policy_version 61751 (0.0020) [2024-08-06 05:31:07,756][52803] DAMAGECOUNT value on done: 596217.0 [2024-08-06 05:31:07,757][52803] Sum rewards: 79.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.855', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.094', 'AMMO4': '0.178', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '66.000'} [2024-08-06 05:31:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 505864192. Throughput: 0: 4363.1. Samples: 126470560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:31:07,794][52567] Avg episode reward: [(0, '74.241')] [2024-08-06 05:31:08,267][52670] DAMAGECOUNT value on done: 629168.0 [2024-08-06 05:31:08,267][52670] Sum rewards: 82.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.104', 'AMMO3': '0.205', 'AMMO4': '0.216', 'weapon5': '0.226', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '68.000'} [2024-08-06 05:31:08,710][52667] DAMAGECOUNT value on done: 649634.0 [2024-08-06 05:31:08,712][52667] Sum rewards: 75.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.118', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:09,112][52666] DAMAGECOUNT value on done: 642366.0 [2024-08-06 05:31:09,113][52666] Sum rewards: 60.245, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.436', 'HEALTH': '0.851', 'WEAPON3': '0.950', 'HITCOUNT': '3.000', 'weapon3': '3.048', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '48.000'} [2024-08-06 05:31:09,770][52663] DAMAGECOUNT value on done: 632459.0 [2024-08-06 05:31:09,770][52663] Sum rewards: 76.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.132', 'weapon5': '0.174', 'AMMO4': '0.226', 'AMMO3': '0.255', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.966', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '65.000'} [2024-08-06 05:31:10,884][52803] DAMAGECOUNT value on done: 593538.0 [2024-08-06 05:31:10,885][52803] Sum rewards: 78.790, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.750', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.137', 'weapon5': '0.182', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.418', 'weapon2': '0.528', 'WEAPON3': '0.850', 'weapon3': '2.614', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:11,130][52670] DAMAGECOUNT value on done: 642692.0 [2024-08-06 05:31:11,130][52670] Sum rewards: 65.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.050', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.086', 'weapon4': '0.144', 'AMMO4': '0.169', 'AMMO3': '0.248', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.220', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '58.000'} [2024-08-06 05:31:11,286][52667] DAMAGECOUNT value on done: 642395.0 [2024-08-06 05:31:11,288][52667] Sum rewards: 48.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.416', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.076', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '2.560', 'weapon3': '3.304', 'DAMAGECOUNT': '12.348', 'FRAGCOUNT': '41.000'} [2024-08-06 05:31:11,997][52666] DAMAGECOUNT value on done: 635146.0 [2024-08-06 05:31:12,006][52666] Sum rewards: 58.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.835', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.105', 'weapon5': '0.132', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '50.000'} [2024-08-06 05:31:12,120][52650] Updated weights for policy 0, policy_version 61761 (0.0020) [2024-08-06 05:31:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 505954304. Throughput: 0: 4365.1. Samples: 126496870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:31:12,794][52567] Avg episode reward: [(0, '73.814')] [2024-08-06 05:31:13,159][52663] DAMAGECOUNT value on done: 637823.0 [2024-08-06 05:31:13,163][52663] Sum rewards: 65.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.346', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.118', 'weapon5': '0.118', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.398', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.000'} [2024-08-06 05:31:13,674][52667] DAMAGECOUNT value on done: 649556.0 [2024-08-06 05:31:13,677][52667] Sum rewards: 75.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.027', 'AMMO2': '0.056', 'weapon4': '0.082', 'weapon5': '0.204', 'AMMO3': '0.229', 'AMMO4': '0.279', 'weapon2': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:13,970][52803] DAMAGECOUNT value on done: 608488.0 [2024-08-06 05:31:13,972][52803] Sum rewards: 77.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.032', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.045', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:14,541][52670] DAMAGECOUNT value on done: 638334.0 [2024-08-06 05:31:14,544][52670] Sum rewards: 71.880, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.850', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.145', 'weapon5': '0.146', 'AMMO3': '0.269', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '3.170', 'weapon3': '3.194', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:15,529][52666] DAMAGECOUNT value on done: 634411.0 [2024-08-06 05:31:15,531][52666] Sum rewards: 63.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.552', 'AMMO5': '0.023', 'AMMO2': '0.054', 'weapon4': '0.146', 'weapon5': '0.174', 'AMMO3': '0.232', 'AMMO4': '0.271', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '55.000'} [2024-08-06 05:31:15,861][52663] DAMAGECOUNT value on done: 646641.0 [2024-08-06 05:31:15,862][52663] Sum rewards: 72.401, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.360', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.086', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.386', 'weapon4': '0.480', 'WEAPON3': '0.750', 'weapon3': '2.872', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '55.000'} [2024-08-06 05:31:16,589][52650] Updated weights for policy 0, policy_version 61771 (0.0037) [2024-08-06 05:31:17,090][52669] DAMAGECOUNT value on done: 643666.0 [2024-08-06 05:31:17,098][52669] Sum rewards: 63.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.396', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.126', 'AMMO3': '0.193', 'AMMO4': '0.201', 'weapon2': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON5': '0.300', 'weapon7': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.664', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '52.000'} [2024-08-06 05:31:17,099][52803] DAMAGECOUNT value on done: 596230.0 [2024-08-06 05:31:17,099][52803] Sum rewards: 70.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.864', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.140', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'weapon2': '0.328', 'WEAPON3': '1.750', 'weapon3': '3.142', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17439.3). Total num frames: 506044416. Throughput: 0: 4375.6. Samples: 126510050. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:17,794][52567] Avg episode reward: [(0, '73.314')] [2024-08-06 05:31:17,870][52670] DAMAGECOUNT value on done: 628196.0 [2024-08-06 05:31:17,870][52670] Sum rewards: 79.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.545', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.220', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '65.000'} [2024-08-06 05:31:18,674][52666] DAMAGECOUNT value on done: 636810.0 [2024-08-06 05:31:18,676][52666] Sum rewards: 76.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.142', 'AMMO3': '0.182', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:18,915][52663] DAMAGECOUNT value on done: 634511.0 [2024-08-06 05:31:18,916][52663] Sum rewards: 63.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.160', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.722', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '2.894', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '54.000'} [2024-08-06 05:31:19,995][52803] DAMAGECOUNT value on done: 595510.0 [2024-08-06 05:31:19,997][52803] Sum rewards: 77.943, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.236', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'AMMO3': '0.311', 'WEAPON3': '1.750', 'weapon3': '3.202', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '69.000'} [2024-08-06 05:31:20,025][52658] DAMAGECOUNT value on done: 644378.0 [2024-08-06 05:31:20,028][52658] Sum rewards: 63.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.497', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO4': '0.173', 'weapon5': '0.178', 'AMMO3': '0.192', 'weapon2': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.346', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '51.000'} [2024-08-06 05:31:20,455][52669] DAMAGECOUNT value on done: 634016.0 [2024-08-06 05:31:20,458][52669] Sum rewards: 76.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.866', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '62.000'} [2024-08-06 05:31:20,589][52670] DAMAGECOUNT value on done: 635448.0 [2024-08-06 05:31:20,590][52670] Sum rewards: 69.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.501', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.189', 'weapon2': '0.248', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.588', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '58.000'} [2024-08-06 05:31:21,404][52666] DAMAGECOUNT value on done: 634486.0 [2024-08-06 05:31:21,405][52666] Sum rewards: 64.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.196', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.504', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.206', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '55.000'} [2024-08-06 05:31:21,504][52650] Updated weights for policy 0, policy_version 61781 (0.0029) [2024-08-06 05:31:21,849][52663] DAMAGECOUNT value on done: 630764.0 [2024-08-06 05:31:21,850][52663] Sum rewards: 78.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.566', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.178', 'AMMO4': '0.206', 'AMMO3': '0.247', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '2.790', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '67.000'} [2024-08-06 05:31:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 506126336. Throughput: 0: 4374.9. Samples: 126536330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:22,794][52567] Avg episode reward: [(0, '73.173')] [2024-08-06 05:31:22,986][52658] DAMAGECOUNT value on done: 640974.0 [2024-08-06 05:31:22,989][52658] Sum rewards: 76.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.099', 'weapon5': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:23,200][52803] DAMAGECOUNT value on done: 599480.0 [2024-08-06 05:31:23,202][52803] Sum rewards: 69.972, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.226', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon4': '0.072', 'weapon5': '0.162', 'AMMO3': '0.248', 'AMMO4': '0.305', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:23,368][52669] DAMAGECOUNT value on done: 646211.0 [2024-08-06 05:31:23,370][52669] Sum rewards: 76.243, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.891', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:23,721][52670] DAMAGECOUNT value on done: 633473.0 [2024-08-06 05:31:23,722][52670] Sum rewards: 70.671, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.678', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.171', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.312', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '55.000'} [2024-08-06 05:31:24,600][52663] DAMAGECOUNT value on done: 635869.0 [2024-08-06 05:31:24,600][52663] Sum rewards: 80.469, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.286', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'weapon4': '0.102', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon2': '0.228', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.374', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '66.000'} [2024-08-06 05:31:24,604][52666] DAMAGECOUNT value on done: 639071.0 [2024-08-06 05:31:24,605][52666] Sum rewards: 69.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.104', 'AMMO3': '0.194', 'weapon5': '0.230', 'AMMO4': '0.249', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.092', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '56.000'} [2024-08-06 05:31:25,207][52671] DAMAGECOUNT value on done: 646176.0 [2024-08-06 05:31:25,210][52671] Sum rewards: 82.865, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.436', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '69.000'} [2024-08-06 05:31:25,298][52663] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:31:26,003][52669] DAMAGECOUNT value on done: 643887.0 [2024-08-06 05:31:26,006][52669] Sum rewards: 70.704, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.650', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.163', 'weapon5': '0.216', 'AMMO4': '0.232', 'weapon4': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '0.950', 'weapon3': '2.774', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '54.000'} [2024-08-06 05:31:26,028][52650] Updated weights for policy 0, policy_version 61791 (0.0028) [2024-08-06 05:31:26,148][52658] DAMAGECOUNT value on done: 646049.0 [2024-08-06 05:31:26,148][52658] Sum rewards: 64.044, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.975', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.131', 'weapon5': '0.188', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.360', 'WEAPON3': '0.900', 'weapon3': '2.904', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '50.000'} [2024-08-06 05:31:26,365][52803] DAMAGECOUNT value on done: 601122.0 [2024-08-06 05:31:26,366][52803] Sum rewards: 68.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.070', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '57.000'} [2024-08-06 05:31:26,780][52670] DAMAGECOUNT value on done: 631665.0 [2024-08-06 05:31:26,780][52670] Sum rewards: 73.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.835', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.109', 'weapon4': '0.136', 'AMMO3': '0.158', 'weapon2': '0.496', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:27,475][52666] DAMAGECOUNT value on done: 631919.0 [2024-08-06 05:31:27,475][52666] Sum rewards: 72.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.413', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.151', 'weapon5': '0.156', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:27,731][52663] DAMAGECOUNT value on done: 631585.0 [2024-08-06 05:31:27,733][52663] Sum rewards: 80.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon2': '0.164', 'AMMO3': '0.220', 'WEAPON3': '1.450', 'weapon3': '3.658', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '67.000'} [2024-08-06 05:31:27,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 506216448. Throughput: 0: 4369.3. Samples: 126562530. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:27,795][52567] Avg episode reward: [(0, '73.078')] [2024-08-06 05:31:27,876][52671] DAMAGECOUNT value on done: 647488.0 [2024-08-06 05:31:27,878][52671] Sum rewards: 63.668, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.108', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '52.000'} [2024-08-06 05:31:28,884][52669] DAMAGECOUNT value on done: 643182.0 [2024-08-06 05:31:28,888][52669] Sum rewards: 66.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.044', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.092', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.226', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.424', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '58.000'} [2024-08-06 05:31:28,949][52658] DAMAGECOUNT value on done: 644594.0 [2024-08-06 05:31:28,950][52658] Sum rewards: 77.278, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.102', 'AMMO4': '0.187', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '66.000'} [2024-08-06 05:31:29,264][52670] DAMAGECOUNT value on done: 640828.0 [2024-08-06 05:31:29,265][52670] Sum rewards: 79.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.702', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.080', 'AMMO4': '0.123', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.234', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '67.000'} [2024-08-06 05:31:29,376][52803] DAMAGECOUNT value on done: 605364.0 [2024-08-06 05:31:29,376][52803] Sum rewards: 74.401, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.062', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '62.000'} [2024-08-06 05:31:30,008][52666] DAMAGECOUNT value on done: 635315.0 [2024-08-06 05:31:30,010][52666] Sum rewards: 81.488, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.094', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.292', 'weapon2': '0.414', 'WEAPON3': '0.900', 'weapon3': '3.036', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:30,575][52663] DAMAGECOUNT value on done: 645337.0 [2024-08-06 05:31:30,576][52663] Sum rewards: 82.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.100', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '67.000'} [2024-08-06 05:31:30,684][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:31:30,761][52671] DAMAGECOUNT value on done: 645598.0 [2024-08-06 05:31:30,762][52671] Sum rewards: 68.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon2': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.239', 'weapon4': '0.298', 'weapon5': '0.336', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '57.000'} [2024-08-06 05:31:30,898][52650] Updated weights for policy 0, policy_version 61801 (0.0030) [2024-08-06 05:31:31,023][52647] DAMAGECOUNT value on done: 680206.0 [2024-08-06 05:31:31,024][52647] Sum rewards: 65.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.213', 'AMMO5': '0.022', 'AMMO2': '0.065', 'AMMO3': '0.226', 'weapon2': '0.230', 'weapon4': '0.322', 'AMMO4': '0.323', 'weapon5': '0.352', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.776', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '55.000'} [2024-08-06 05:31:31,741][52669] DAMAGECOUNT value on done: 647421.0 [2024-08-06 05:31:31,744][52669] Sum rewards: 78.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.026', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.162', 'AMMO4': '0.226', 'weapon5': '0.248', 'AMMO3': '0.258', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '66.500'} [2024-08-06 05:31:31,964][52670] DAMAGECOUNT value on done: 626181.0 [2024-08-06 05:31:31,965][52670] Sum rewards: 67.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.795', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.184', 'AMMO3': '0.214', 'weapon4': '0.250', 'AMMO4': '0.279', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:32,017][52658] DAMAGECOUNT value on done: 635368.0 [2024-08-06 05:31:32,019][52658] Sum rewards: 75.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.928', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.156', 'AMMO4': '0.197', 'weapon5': '0.206', 'weapon2': '0.218', 'AMMO3': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '62.000'} [2024-08-06 05:31:32,404][52803] DAMAGECOUNT value on done: 594311.0 [2024-08-06 05:31:32,406][52803] Sum rewards: 65.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon4': '0.132', 'AMMO4': '0.142', 'weapon5': '0.160', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '54.000'} [2024-08-06 05:31:32,755][52666] DAMAGECOUNT value on done: 628821.0 [2024-08-06 05:31:32,756][52666] Sum rewards: 74.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.302', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.204', 'AMMO3': '0.208', 'AMMO4': '0.212', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '60.500'} [2024-08-06 05:31:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 506298368. Throughput: 0: 4375.3. Samples: 126575750. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:32,802][52567] Avg episode reward: [(0, '73.207')] [2024-08-06 05:31:33,266][52671] DAMAGECOUNT value on done: 647431.0 [2024-08-06 05:31:33,267][52671] Sum rewards: 67.746, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.930', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.170', 'AMMO4': '0.185', 'AMMO3': '0.202', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '57.000'} [2024-08-06 05:31:33,626][52663] DAMAGECOUNT value on done: 636530.0 [2024-08-06 05:31:33,627][52663] Sum rewards: 63.244, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.918', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO3': '0.181', 'AMMO4': '0.213', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '51.000'} [2024-08-06 05:31:33,682][52647] DAMAGECOUNT value on done: 674783.0 [2024-08-06 05:31:33,684][52647] Sum rewards: 77.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.164', 'weapon5': '0.196', 'AMMO3': '0.247', 'AMMO4': '0.258', 'weapon2': '0.278', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '65.000'} [2024-08-06 05:31:34,744][52658] DAMAGECOUNT value on done: 636302.0 [2024-08-06 05:31:34,744][52658] Sum rewards: 69.157, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.268', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.126', 'weapon4': '0.142', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.346', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '58.000'} [2024-08-06 05:31:34,974][52669] DAMAGECOUNT value on done: 643884.0 [2024-08-06 05:31:34,974][52669] Sum rewards: 75.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.491', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon5': '0.154', 'weapon4': '0.198', 'weapon2': '0.252', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:35,119][52670] DAMAGECOUNT value on done: 636197.0 [2024-08-06 05:31:35,119][52670] Sum rewards: 74.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.168', 'AMMO3': '0.184', 'weapon2': '0.242', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:35,375][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:31:35,457][52650] Updated weights for policy 0, policy_version 61811 (0.0012) [2024-08-06 05:31:35,902][52666] DAMAGECOUNT value on done: 642507.0 [2024-08-06 05:31:35,903][52666] Sum rewards: 79.382, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.072', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:36,140][52671] DAMAGECOUNT value on done: 655828.0 [2024-08-06 05:31:36,140][52671] Sum rewards: 58.291, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.103', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.116', 'weapon5': '0.244', 'AMMO3': '0.246', 'AMMO4': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.690', 'weapon3': '2.976', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '52.000'} [2024-08-06 05:31:36,468][52647] DAMAGECOUNT value on done: 677621.0 [2024-08-06 05:31:36,468][52647] Sum rewards: 74.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.436', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon5': '0.192', 'AMMO3': '0.213', 'weapon2': '0.216', 'AMMO4': '0.322', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:36,636][52663] DAMAGECOUNT value on done: 642403.0 [2024-08-06 05:31:36,636][52663] Sum rewards: 75.147, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO3': '0.194', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 05:31:37,520][52658] DAMAGECOUNT value on done: 649404.0 [2024-08-06 05:31:37,522][52658] Sum rewards: 79.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.700', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.156', 'AMMO4': '0.190', 'AMMO3': '0.195', 'weapon5': '0.202', 'weapon2': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:37,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 506388480. Throughput: 0: 4374.5. Samples: 126601980. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:37,802][52567] Avg episode reward: [(0, '72.904')] [2024-08-06 05:31:37,955][52670] DAMAGECOUNT value on done: 640666.0 [2024-08-06 05:31:37,955][52670] Sum rewards: 69.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.028', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.214', 'weapon5': '0.244', 'AMMO4': '0.249', 'weapon4': '0.282', 'weapon2': '0.490', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 05:31:37,959][52669] DAMAGECOUNT value on done: 642721.0 [2024-08-06 05:31:37,961][52669] Sum rewards: 79.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.152', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '65.000'} [2024-08-06 05:31:38,641][52666] DAMAGECOUNT value on done: 636183.0 [2024-08-06 05:31:38,642][52666] Sum rewards: 79.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.215', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:39,211][52671] DAMAGECOUNT value on done: 648254.0 [2024-08-06 05:31:39,212][52671] Sum rewards: 84.076, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.204', 'HEALTH': '0.353', 'weapon2': '0.406', 'WEAPON3': '0.950', 'weapon3': '3.102', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '66.000'} [2024-08-06 05:31:39,346][52663] DAMAGECOUNT value on done: 643094.0 [2024-08-06 05:31:39,346][52663] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.136', 'weapon2': '0.168', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '56.000'} [2024-08-06 05:31:39,518][52647] DAMAGECOUNT value on done: 677035.0 [2024-08-06 05:31:39,519][52647] Sum rewards: 56.701, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.736', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.199', 'weapon2': '0.228', 'AMMO4': '0.250', 'weapon5': '0.328', 'WEAPON5': '0.450', 'weapon4': '0.474', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.618', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '13.209', 'FRAGCOUNT': '48.000'} [2024-08-06 05:31:40,100][52650] Updated weights for policy 0, policy_version 61821 (0.0026) [2024-08-06 05:31:40,466][52658] DAMAGECOUNT value on done: 638055.0 [2024-08-06 05:31:40,467][52658] Sum rewards: 75.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.062', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '0.366', 'WEAPON3': '1.600', 'weapon3': '3.292', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:40,537][52669] DAMAGECOUNT value on done: 652241.0 [2024-08-06 05:31:40,537][52669] Sum rewards: 78.479, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon4': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:40,604][52670] DAMAGECOUNT value on done: 640427.0 [2024-08-06 05:31:40,605][52670] Sum rewards: 80.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.035', 'AMMO2': '0.067', 'weapon4': '0.138', 'AMMO3': '0.206', 'AMMO4': '0.337', 'weapon5': '0.386', 'weapon2': '0.398', 'WEAPON4': '0.550', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '66.500'} [2024-08-06 05:31:41,562][52666] DAMAGECOUNT value on done: 638953.0 [2024-08-06 05:31:41,562][52666] Sum rewards: 70.284, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.585', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.118', 'weapon4': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.794', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '56.000'} [2024-08-06 05:31:41,769][52614] Signal inference workers to stop experience collection... (11250 times) [2024-08-06 05:31:41,775][52668] DAMAGECOUNT value on done: 641238.0 [2024-08-06 05:31:41,769][52614] Signal inference workers to resume experience collection... (11250 times) [2024-08-06 05:31:41,776][52668] Sum rewards: 70.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.146', 'AMMO3': '0.218', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.500'} [2024-08-06 05:31:41,860][52650] InferenceWorker_p0-w0: stopping experience collection (11250 times) [2024-08-06 05:31:41,870][52650] InferenceWorker_p0-w0: resuming experience collection (11250 times) [2024-08-06 05:31:42,114][52663] DAMAGECOUNT value on done: 636554.0 [2024-08-06 05:31:42,114][52663] Sum rewards: 82.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.132', 'weapon4': '0.136', 'AMMO4': '0.155', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '67.000'} [2024-08-06 05:31:42,218][52647] DAMAGECOUNT value on done: 686974.0 [2024-08-06 05:31:42,218][52647] Sum rewards: 74.758, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.124', 'weapon5': '0.146', 'AMMO4': '0.168', 'AMMO3': '0.226', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:42,341][52671] DAMAGECOUNT value on done: 650678.0 [2024-08-06 05:31:42,341][52671] Sum rewards: 73.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.184', 'weapon2': '0.188', 'AMMO4': '0.198', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.338', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '60.000'} [2024-08-06 05:31:42,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 506486784. Throughput: 0: 4379.6. Samples: 126628320. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:42,794][52567] Avg episode reward: [(0, '72.766')] [2024-08-06 05:31:43,409][52658] DAMAGECOUNT value on done: 656111.0 [2024-08-06 05:31:43,410][52658] Sum rewards: 66.555, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.860', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.156', 'weapon5': '0.208', 'AMMO4': '0.268', 'weapon2': '0.274', 'AMMO3': '0.279', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.060', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:43,441][52669] DAMAGECOUNT value on done: 643081.0 [2024-08-06 05:31:43,442][52669] Sum rewards: 72.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.745', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.146', 'weapon4': '0.150', 'AMMO4': '0.171', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.162', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '62.000'} [2024-08-06 05:31:43,580][52670] DAMAGECOUNT value on done: 622693.0 [2024-08-06 05:31:43,582][52670] Sum rewards: 69.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.168', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.086', 'AMMO4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '56.000'} [2024-08-06 05:31:44,295][52668] DAMAGECOUNT value on done: 646411.0 [2024-08-06 05:31:44,297][52668] Sum rewards: 67.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.926', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.126', 'AMMO3': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.334', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '55.000'} [2024-08-06 05:31:44,458][52666] DAMAGECOUNT value on done: 629509.0 [2024-08-06 05:31:44,460][52666] Sum rewards: 73.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.574', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.200', 'AMMO3': '0.216', 'AMMO4': '0.221', 'weapon4': '0.242', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:44,587][52649] DAMAGECOUNT value on done: 620827.0 [2024-08-06 05:31:44,588][52649] Sum rewards: 58.546, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.140', 'weapon5': '0.144', 'AMMO3': '0.183', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.234', 'DAMAGECOUNT': '14.229', 'FRAGCOUNT': '48.000'} [2024-08-06 05:31:44,718][52650] Updated weights for policy 0, policy_version 61831 (0.0031) [2024-08-06 05:31:44,874][52647] DAMAGECOUNT value on done: 682391.0 [2024-08-06 05:31:44,874][52647] Sum rewards: 60.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.913', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.087', 'weapon5': '0.136', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.724', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '49.000'} [2024-08-06 05:31:45,648][52671] DAMAGECOUNT value on done: 647474.0 [2024-08-06 05:31:45,648][52671] Sum rewards: 75.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.084', 'AMMO4': '0.112', 'weapon5': '0.152', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:46,027][52658] DAMAGECOUNT value on done: 643617.0 [2024-08-06 05:31:46,028][52658] Sum rewards: 93.071, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.438', 'HITCOUNT': '4.270', 'DAMAGECOUNT': '21.639', 'FRAGCOUNT': '79.000'} [2024-08-06 05:31:46,442][52669] DAMAGECOUNT value on done: 648280.0 [2024-08-06 05:31:46,444][52669] Sum rewards: 85.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.202', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.120', 'FRAGCOUNT': '70.000'} [2024-08-06 05:31:46,535][52670] DAMAGECOUNT value on done: 633354.0 [2024-08-06 05:31:46,536][52670] Sum rewards: 75.463, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.776', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.152', 'weapon5': '0.174', 'AMMO4': '0.177', 'AMMO3': '0.269', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.650', 'weapon3': '2.944', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:46,832][52649] DAMAGECOUNT value on done: 613368.0 [2024-08-06 05:31:46,832][52649] Sum rewards: 69.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.506', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.134', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.265', 'weapon2': '0.314', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '57.000'} [2024-08-06 05:31:47,395][52666] DAMAGECOUNT value on done: 637280.0 [2024-08-06 05:31:47,395][52666] Sum rewards: 75.349, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.828', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'WEAPON5': '0.250', 'weapon5': '0.262', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 05:31:47,400][52668] DAMAGECOUNT value on done: 645189.0 [2024-08-06 05:31:47,402][52668] Sum rewards: 82.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.146', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.088', 'weapon5': '0.090', 'AMMO4': '0.110', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.000', 'weapon3': '3.214', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '66.000'} [2024-08-06 05:31:47,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 506568704. Throughput: 0: 4382.2. Samples: 126641450. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:47,802][52567] Avg episode reward: [(0, '72.495')] [2024-08-06 05:31:48,003][52647] DAMAGECOUNT value on done: 678474.0 [2024-08-06 05:31:48,005][52647] Sum rewards: 70.935, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.248', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.090', 'AMMO4': '0.149', 'weapon5': '0.158', 'weapon2': '0.210', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:48,676][52671] DAMAGECOUNT value on done: 640135.0 [2024-08-06 05:31:48,676][52671] Sum rewards: 83.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.094', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '69.000'} [2024-08-06 05:31:49,187][52669] DAMAGECOUNT value on done: 649922.0 [2024-08-06 05:31:49,187][52669] Sum rewards: 75.365, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.484', 'AMMO5': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.147', 'weapon5': '0.212', 'AMMO4': '0.213', 'weapon2': '0.264', 'weapon4': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.864', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:49,261][52658] DAMAGECOUNT value on done: 655926.0 [2024-08-06 05:31:49,263][52658] Sum rewards: 75.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.682', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.120', 'AMMO4': '0.161', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.332', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.924', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:49,558][52670] DAMAGECOUNT value on done: 641389.0 [2024-08-06 05:31:49,558][52670] Sum rewards: 67.905, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.380', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.122', 'weapon4': '0.168', 'AMMO4': '0.223', 'weapon2': '0.276', 'AMMO3': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.168', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '60.000'} [2024-08-06 05:31:49,738][52649] DAMAGECOUNT value on done: 633581.0 [2024-08-06 05:31:49,739][52649] Sum rewards: 81.205, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.094', 'weapon5': '0.134', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:49,832][52650] Updated weights for policy 0, policy_version 61841 (0.0012) [2024-08-06 05:31:50,254][52668] DAMAGECOUNT value on done: 646147.0 [2024-08-06 05:31:50,256][52668] Sum rewards: 74.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.371', 'AMMO5': '0.026', 'AMMO2': '0.049', 'AMMO3': '0.213', 'AMMO4': '0.247', 'weapon4': '0.380', 'weapon2': '0.404', 'weapon5': '0.414', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.484', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:50,310][52647] DAMAGECOUNT value on done: 663268.0 [2024-08-06 05:31:50,310][52647] Sum rewards: 61.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.653', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.210', 'weapon5': '0.214', 'AMMO3': '0.244', 'AMMO4': '0.277', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '3.000', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '52.500'} [2024-08-06 05:31:50,439][52666] DAMAGECOUNT value on done: 645759.0 [2024-08-06 05:31:50,439][52666] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.505', 'AMMO5': '0.003', 'weapon4': '0.020', 'weapon5': '0.026', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.144', 'weapon2': '0.452', 'WEAPON3': '0.900', 'HITCOUNT': '3.270', 'weapon3': '3.372', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '52.000'} [2024-08-06 05:31:51,003][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:31:51,675][52671] DAMAGECOUNT value on done: 645092.0 [2024-08-06 05:31:51,676][52671] Sum rewards: 79.086, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.805', 'AMMO2': '0.010', 'AMMO5': '0.017', 'weapon4': '0.024', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.141', 'WEAPON5': '0.250', 'weapon2': '0.720', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '63.000'} [2024-08-06 05:31:51,986][52658] DAMAGECOUNT value on done: 640002.0 [2024-08-06 05:31:51,987][52669] DAMAGECOUNT value on done: 636051.0 [2024-08-06 05:31:51,986][52658] Sum rewards: 86.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.191', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.046', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'weapon2': '0.518', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '70.000'} [2024-08-06 05:31:51,988][52669] Sum rewards: 62.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.266', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.158', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'weapon4': '0.352', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '2.936', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '52.000'} [2024-08-06 05:31:52,582][52647] DAMAGECOUNT value on done: 677684.0 [2024-08-06 05:31:52,583][52647] Sum rewards: 63.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.732', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.230', 'weapon4': '0.276', 'weapon2': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '52.500'} [2024-08-06 05:31:52,670][52670] DAMAGECOUNT value on done: 633055.0 [2024-08-06 05:31:52,671][52670] Sum rewards: 60.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.110', 'AMMO4': '0.186', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '51.000'} [2024-08-06 05:31:52,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 506650624. Throughput: 0: 4386.0. Samples: 126667930. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:31:52,803][52567] Avg episode reward: [(0, '72.268')] [2024-08-06 05:31:52,952][52649] DAMAGECOUNT value on done: 628034.0 [2024-08-06 05:31:52,953][52649] Sum rewards: 65.978, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.137', 'AMMO3': '0.145', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.000', 'weapon3': '3.184', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '52.500'} [2024-08-06 05:31:53,490][52668] DAMAGECOUNT value on done: 632908.0 [2024-08-06 05:31:53,491][52668] Sum rewards: 72.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.312', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.150', 'weapon5': '0.160', 'weapon2': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.234', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '62.000'} [2024-08-06 05:31:53,607][52666] DAMAGECOUNT value on done: 627425.0 [2024-08-06 05:31:53,608][52666] Sum rewards: 80.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.664', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.138', 'AMMO4': '0.139', 'weapon5': '0.152', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:53,853][52650] Updated weights for policy 0, policy_version 61851 (0.0028) [2024-08-06 05:31:54,348][52671] DAMAGECOUNT value on done: 649913.0 [2024-08-06 05:31:54,349][52671] Sum rewards: 79.629, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.010', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.153', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '64.000'} [2024-08-06 05:31:54,838][52669] DAMAGECOUNT value on done: 641582.0 [2024-08-06 05:31:54,839][52669] Sum rewards: 66.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.700', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.229', 'AMMO4': '0.233', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '57.000'} [2024-08-06 05:31:55,068][52658] DAMAGECOUNT value on done: 647398.0 [2024-08-06 05:31:55,070][52658] Sum rewards: 67.413, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.684', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.148', 'weapon2': '0.210', 'AMMO3': '0.244', 'weapon4': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:55,574][52647] DAMAGECOUNT value on done: 678575.0 [2024-08-06 05:31:55,574][52647] Sum rewards: 84.082, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon2': '0.210', 'AMMO3': '0.281', 'WEAPON3': '1.600', 'weapon3': '3.456', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.778', 'FRAGCOUNT': '71.000'} [2024-08-06 05:31:55,693][52649] DAMAGECOUNT value on done: 618534.0 [2024-08-06 05:31:55,695][52649] Sum rewards: 76.783, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.718', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.080', 'AMMO3': '0.183', 'AMMO4': '0.217', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '61.000'} [2024-08-06 05:31:55,899][52668] DAMAGECOUNT value on done: 649287.0 [2024-08-06 05:31:55,899][52668] Sum rewards: 58.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.207', 'weapon2': '0.426', 'WEAPON3': '1.250', 'HITCOUNT': '2.750', 'weapon3': '3.200', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '49.000'} [2024-08-06 05:31:55,942][52670] DAMAGECOUNT value on done: 638793.0 [2024-08-06 05:31:55,943][52670] Sum rewards: 84.023, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.286', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon4': '0.186', 'AMMO3': '0.259', 'weapon5': '0.262', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.958', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '71.000'} [2024-08-06 05:31:56,795][52666] DAMAGECOUNT value on done: 635373.0 [2024-08-06 05:31:56,795][52666] Sum rewards: 70.797, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.022', 'AMMO2': '0.076', 'AMMO3': '0.179', 'weapon5': '0.228', 'weapon4': '0.374', 'AMMO4': '0.379', 'weapon2': '0.432', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '59.000'} [2024-08-06 05:31:56,920][52671] DAMAGECOUNT value on done: 644534.0 [2024-08-06 05:31:56,921][52671] Sum rewards: 73.114, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.016', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.066', 'AMMO3': '0.171', 'AMMO4': '0.173', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '58.000'} [2024-08-06 05:31:57,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 506740736. Throughput: 0: 4389.3. Samples: 126694390. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:31:57,794][52567] Avg episode reward: [(0, '72.958')] [2024-08-06 05:31:57,880][52669] DAMAGECOUNT value on done: 644804.0 [2024-08-06 05:31:57,882][52669] Sum rewards: 71.358, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.458', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.162', 'AMMO3': '0.182', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '57.000'} [2024-08-06 05:31:57,991][52658] DAMAGECOUNT value on done: 639482.0 [2024-08-06 05:31:57,991][52658] Sum rewards: 84.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.214', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '70.000'} [2024-08-06 05:31:58,183][52662] DAMAGECOUNT value on done: 646485.0 [2024-08-06 05:31:58,183][52662] Sum rewards: 61.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.416', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.151', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON4': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '2.980', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '51.000'} [2024-08-06 05:31:58,536][52647] DAMAGECOUNT value on done: 674461.0 [2024-08-06 05:31:58,537][52647] Sum rewards: 68.668, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.755', 'AMMO5': '0.023', 'AMMO2': '0.067', 'weapon4': '0.150', 'AMMO3': '0.194', 'weapon5': '0.328', 'AMMO4': '0.335', 'weapon2': '0.558', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.670', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '57.500'} [2024-08-06 05:31:58,568][52668] DAMAGECOUNT value on done: 648318.0 [2024-08-06 05:31:58,568][52668] Sum rewards: 79.957, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.082', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '66.000'} [2024-08-06 05:31:58,762][52650] Updated weights for policy 0, policy_version 61861 (0.0010) [2024-08-06 05:31:58,798][52649] DAMAGECOUNT value on done: 632597.0 [2024-08-06 05:31:58,798][52649] Sum rewards: 85.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.672', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.100', 'weapon3': '3.288', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '68.000'} [2024-08-06 05:32:00,136][52671] DAMAGECOUNT value on done: 649884.0 [2024-08-06 05:32:00,136][52671] Sum rewards: 77.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.071', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '65.000'} [2024-08-06 05:32:00,678][52669] DAMAGECOUNT value on done: 663837.0 [2024-08-06 05:32:00,680][52669] Sum rewards: 77.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.222', 'WEAPON3': '1.200', 'HITCOUNT': '3.420', 'weapon3': '3.656', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:01,076][52658] DAMAGECOUNT value on done: 644312.0 [2024-08-06 05:32:01,079][52658] Sum rewards: 73.782, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.578', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.138', 'AMMO3': '0.195', 'weapon2': '0.214', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '60.000'} [2024-08-06 05:32:01,126][52662] DAMAGECOUNT value on done: 644473.0 [2024-08-06 05:32:01,128][52662] Sum rewards: 90.323, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.865', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.416', 'ARMOR': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '71.000'} [2024-08-06 05:32:01,435][52668] DAMAGECOUNT value on done: 639073.0 [2024-08-06 05:32:01,438][52668] Sum rewards: 81.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.292', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO4': '0.141', 'weapon5': '0.162', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '65.000'} [2024-08-06 05:32:01,448][52647] DAMAGECOUNT value on done: 669783.0 [2024-08-06 05:32:01,448][52647] Sum rewards: 82.460, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.990', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.178', 'AMMO3': '0.179', 'weapon2': '0.256', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '66.500'} [2024-08-06 05:32:02,188][52649] DAMAGECOUNT value on done: 623714.0 [2024-08-06 05:32:02,189][52649] Sum rewards: 68.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.218', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.060', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.204', 'WEAPON3': '1.250', 'HITCOUNT': '3.370', 'weapon3': '3.506', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '57.000'} [2024-08-06 05:32:02,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 506830848. Throughput: 0: 4384.7. Samples: 126707360. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:32:02,794][52567] Avg episode reward: [(0, '73.536')] [2024-08-06 05:32:02,970][52671] DAMAGECOUNT value on done: 645954.0 [2024-08-06 05:32:02,972][52671] Sum rewards: 64.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.084', 'AMMO4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '2.994', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '54.000'} [2024-08-06 05:32:03,198][52650] Updated weights for policy 0, policy_version 61871 (0.0014) [2024-08-06 05:32:03,290][52669] DAMAGECOUNT value on done: 650105.0 [2024-08-06 05:32:03,291][52669] Sum rewards: 64.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.920', 'AMMO5': '0.019', 'AMMO2': '0.036', 'AMMO3': '0.175', 'AMMO4': '0.181', 'weapon5': '0.278', 'weapon4': '0.376', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.588', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '52.000'} [2024-08-06 05:32:04,048][52658] DAMAGECOUNT value on done: 630891.0 [2024-08-06 05:32:04,049][52658] Sum rewards: 69.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.823', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.126', 'weapon5': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '56.000'} [2024-08-06 05:32:04,417][52662] DAMAGECOUNT value on done: 652821.0 [2024-08-06 05:32:04,420][52662] Sum rewards: 74.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.082', 'weapon5': '0.148', 'AMMO4': '0.197', 'AMMO3': '0.223', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '62.000'} [2024-08-06 05:32:04,509][52647] DAMAGECOUNT value on done: 682240.0 [2024-08-06 05:32:04,510][52647] Sum rewards: 90.223, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.011', 'HEALTH': '0.030', 'AMMO4': '0.052', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '0.366', 'WEAPON3': '1.000', 'weapon3': '3.426', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '73.000'} [2024-08-06 05:32:04,586][52668] DAMAGECOUNT value on done: 639661.0 [2024-08-06 05:32:04,587][52668] Sum rewards: 74.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.979', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.086', 'AMMO4': '0.224', 'weapon5': '0.226', 'weapon2': '0.242', 'AMMO3': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '63.000'} [2024-08-06 05:32:04,857][52649] DAMAGECOUNT value on done: 628528.0 [2024-08-06 05:32:04,857][52649] Sum rewards: 75.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.450', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.122', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.223', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.408', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:05,548][52671] DAMAGECOUNT value on done: 632978.0 [2024-08-06 05:32:05,548][52671] Sum rewards: 61.030, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.432', 'AMMO5': '0.025', 'AMMO2': '0.075', 'weapon4': '0.180', 'AMMO3': '0.278', 'weapon5': '0.290', 'weapon2': '0.304', 'AMMO4': '0.375', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.824', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '54.500'} [2024-08-06 05:32:06,438][52669] DAMAGECOUNT value on done: 647715.0 [2024-08-06 05:32:06,440][52669] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.475', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.120', 'AMMO4': '0.201', 'weapon5': '0.210', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.470', 'WEAPON3': '0.750', 'HITCOUNT': '2.710', 'weapon3': '2.750', 'DAMAGECOUNT': '14.109', 'FRAGCOUNT': '47.000'} [2024-08-06 05:32:06,889][52647] DAMAGECOUNT value on done: 671940.0 [2024-08-06 05:32:06,890][52647] Sum rewards: 51.169, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-1.015', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon7': '0.058', 'AMMO3': '0.083', 'AMMO4': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.154', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '0.600', 'weapon4': '1.476', 'weapon3': '1.912', 'HITCOUNT': '2.200', 'DAMAGECOUNT': '12.303', 'FRAGCOUNT': '38.000'} [2024-08-06 05:32:06,925][52668] DAMAGECOUNT value on done: 648381.0 [2024-08-06 05:32:06,926][52668] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.315', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.254', 'AMMO3': '0.294', 'weapon2': '0.346', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '61.000'} [2024-08-06 05:32:07,103][52662] DAMAGECOUNT value on done: 638830.0 [2024-08-06 05:32:07,104][52662] Sum rewards: 79.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.761', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.118', 'AMMO4': '0.173', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '66.000'} [2024-08-06 05:32:07,129][52658] DAMAGECOUNT value on done: 647309.0 [2024-08-06 05:32:07,129][52658] Sum rewards: 67.330, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.084', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.068', 'weapon5': '0.158', 'AMMO3': '0.168', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '54.000'} [2024-08-06 05:32:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 506920960. Throughput: 0: 4390.4. Samples: 126733900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:32:07,794][52567] Avg episode reward: [(0, '73.142')] [2024-08-06 05:32:07,963][52649] DAMAGECOUNT value on done: 628773.0 [2024-08-06 05:32:07,964][52649] Sum rewards: 61.296, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.885', 'AMMO5': '0.025', 'AMMO2': '0.062', 'AMMO3': '0.153', 'weapon5': '0.228', 'weapon4': '0.228', 'AMMO4': '0.312', 'WEAPON4': '0.550', 'weapon2': '0.556', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '51.000'} [2024-08-06 05:32:08,116][52650] Updated weights for policy 0, policy_version 61881 (0.0014) [2024-08-06 05:32:08,641][52671] DAMAGECOUNT value on done: 652526.0 [2024-08-06 05:32:08,642][52671] Sum rewards: 77.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.064', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.207', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.416', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '63.000'} [2024-08-06 05:32:09,056][52669] DAMAGECOUNT value on done: 648383.0 [2024-08-06 05:32:09,057][52669] Sum rewards: 65.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.000'} [2024-08-06 05:32:09,385][52647] DAMAGECOUNT value on done: 680997.0 [2024-08-06 05:32:09,387][52647] Sum rewards: 72.933, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.057', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '62.000'} [2024-08-06 05:32:09,953][52668] DAMAGECOUNT value on done: 643604.0 [2024-08-06 05:32:09,955][52668] Sum rewards: 68.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.122', 'weapon5': '0.140', 'AMMO4': '0.149', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.220', 'weapon3': '3.240', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.000'} [2024-08-06 05:32:10,171][52658] DAMAGECOUNT value on done: 639886.0 [2024-08-06 05:32:10,172][52658] Sum rewards: 66.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.796', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.076', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.378', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.326', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '55.000'} [2024-08-06 05:32:10,200][52662] DAMAGECOUNT value on done: 656827.0 [2024-08-06 05:32:10,200][52662] Sum rewards: 79.831, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.130', 'weapon5': '0.192', 'AMMO4': '0.198', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON5': '0.400', 'weapon4': '0.478', 'WEAPON3': '0.850', 'weapon3': '2.692', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '63.000'} [2024-08-06 05:32:11,173][52649] DAMAGECOUNT value on done: 620253.0 [2024-08-06 05:32:11,175][52649] Sum rewards: 68.394, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.060', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.141', 'WEAPON3': '0.850', 'weapon2': '0.872', 'weapon3': '3.056', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '54.000'} [2024-08-06 05:32:11,408][52669] DAMAGECOUNT value on done: 654209.0 [2024-08-06 05:32:11,410][52669] Sum rewards: 54.215, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.800', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.182', 'weapon5': '0.214', 'AMMO4': '0.274', 'AMMO3': '0.292', 'weapon2': '0.414', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.836', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.547', 'FRAGCOUNT': '49.000'} [2024-08-06 05:32:11,447][52671] DAMAGECOUNT value on done: 648495.0 [2024-08-06 05:32:11,447][52671] Sum rewards: 79.069, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.238', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.172', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.050', 'weapon3': '3.258', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '63.500'} [2024-08-06 05:32:11,803][52647] DAMAGECOUNT value on done: 682073.0 [2024-08-06 05:32:11,805][52647] Sum rewards: 76.418, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.095', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'WEAPON3': '1.100', 'weapon3': '3.464', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '61.000'} [2024-08-06 05:32:12,772][52650] Updated weights for policy 0, policy_version 61891 (0.0022) [2024-08-06 05:32:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 507011072. Throughput: 0: 4386.9. Samples: 126759940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:32:12,795][52567] Avg episode reward: [(0, '72.929')] [2024-08-06 05:32:12,901][52668] DAMAGECOUNT value on done: 635598.0 [2024-08-06 05:32:12,901][52668] Sum rewards: 70.562, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.074', 'AMMO5': '0.026', 'AMMO2': '0.065', 'weapon4': '0.110', 'weapon2': '0.216', 'AMMO3': '0.230', 'weapon5': '0.304', 'AMMO4': '0.324', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '58.000'} [2024-08-06 05:32:13,105][52662] DAMAGECOUNT value on done: 636523.0 [2024-08-06 05:32:13,106][52662] Sum rewards: 76.288, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.987', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.180', 'AMMO3': '0.198', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '62.000'} [2024-08-06 05:32:13,294][52658] DAMAGECOUNT value on done: 640707.0 [2024-08-06 05:32:13,294][52658] Sum rewards: 78.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.605', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.196', 'AMMO4': '0.198', 'weapon2': '0.204', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.236', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '67.000'} [2024-08-06 05:32:13,856][52660] DAMAGECOUNT value on done: 642586.0 [2024-08-06 05:32:13,858][52660] Sum rewards: 73.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.166', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.178', 'AMMO4': '0.205', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '60.000'} [2024-08-06 05:32:14,356][52671] DAMAGECOUNT value on done: 648779.0 [2024-08-06 05:32:14,356][52671] Sum rewards: 68.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.283', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.082', 'weapon5': '0.088', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.286', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.364', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '59.000'} [2024-08-06 05:32:14,367][52649] DAMAGECOUNT value on done: 633304.0 [2024-08-06 05:32:14,367][52649] Sum rewards: 79.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.722', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '66.000'} [2024-08-06 05:32:14,636][52647] DAMAGECOUNT value on done: 664023.0 [2024-08-06 05:32:14,639][52647] Sum rewards: 69.420, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.414', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.076', 'AMMO3': '0.190', 'AMMO4': '0.191', 'weapon5': '0.208', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '3.144', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '56.000'} [2024-08-06 05:32:14,803][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:32:16,042][52668] DAMAGECOUNT value on done: 628070.0 [2024-08-06 05:32:16,043][52668] Sum rewards: 71.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.134', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '61.000'} [2024-08-06 05:32:16,295][52658] DAMAGECOUNT value on done: 644922.0 [2024-08-06 05:32:16,299][52658] Sum rewards: 83.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.525', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.154', 'weapon5': '0.186', 'weapon2': '0.232', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.871', 'FRAGCOUNT': '69.000'} [2024-08-06 05:32:16,318][52662] DAMAGECOUNT value on done: 646615.0 [2024-08-06 05:32:16,319][52662] Sum rewards: 51.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.124', 'AMMO5': '0.021', 'AMMO2': '0.072', 'weapon4': '0.214', 'weapon5': '0.226', 'AMMO3': '0.256', 'AMMO4': '0.362', 'weapon2': '0.450', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '13.965', 'FRAGCOUNT': '44.000'} [2024-08-06 05:32:16,993][52660] DAMAGECOUNT value on done: 633446.0 [2024-08-06 05:32:16,998][52660] Sum rewards: 77.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.094', 'AMMO3': '0.184', 'weapon5': '0.202', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '62.000'} [2024-08-06 05:32:17,141][52647] DAMAGECOUNT value on done: 674133.0 [2024-08-06 05:32:17,142][52647] Sum rewards: 63.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.328', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.176', 'AMMO3': '0.196', 'AMMO4': '0.205', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '55.000'} [2024-08-06 05:32:17,234][52649] DAMAGECOUNT value on done: 636505.0 [2024-08-06 05:32:17,235][52649] Sum rewards: 83.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.180', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.102', 'AMMO3': '0.145', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '0.850', 'weapon3': '3.254', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:17,247][52671] DAMAGECOUNT value on done: 649058.0 [2024-08-06 05:32:17,250][52671] Sum rewards: 62.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.156', 'AMMO3': '0.167', 'AMMO4': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.452', 'weapon2': '0.734', 'WEAPON3': '0.950', 'weapon3': '2.414', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '51.000'} [2024-08-06 05:32:17,775][52650] Updated weights for policy 0, policy_version 61901 (0.0014) [2024-08-06 05:32:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 507092992. Throughput: 0: 4384.4. Samples: 126773050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:32:17,794][52567] Avg episode reward: [(0, '72.654')] [2024-08-06 05:32:19,017][52668] DAMAGECOUNT value on done: 629388.0 [2024-08-06 05:32:19,017][52668] Sum rewards: 72.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.132', 'AMMO3': '0.213', 'weapon2': '0.238', 'weapon5': '0.300', 'AMMO4': '0.321', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '59.500'} [2024-08-06 05:32:19,101][52662] DAMAGECOUNT value on done: 650620.0 [2024-08-06 05:32:19,101][52662] Sum rewards: 69.224, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.560', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '3.418', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '56.000'} [2024-08-06 05:32:19,790][52660] DAMAGECOUNT value on done: 646185.0 [2024-08-06 05:32:19,790][52660] Sum rewards: 78.435, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.098', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.104', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.342', 'WEAPON3': '0.950', 'weapon3': '3.212', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '62.000'} [2024-08-06 05:32:20,049][52671] DAMAGECOUNT value on done: 645176.0 [2024-08-06 05:32:20,049][52671] Sum rewards: 70.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.702', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.074', 'weapon5': '0.118', 'AMMO4': '0.161', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '59.000'} [2024-08-06 05:32:20,087][52647] DAMAGECOUNT value on done: 664637.0 [2024-08-06 05:32:20,090][52647] Sum rewards: 70.461, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.410', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.086', 'weapon4': '0.152', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.332', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '61.000'} [2024-08-06 05:32:20,496][52649] DAMAGECOUNT value on done: 634171.0 [2024-08-06 05:32:20,498][52649] Sum rewards: 73.622, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.654', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.175', 'weapon5': '0.188', 'weapon2': '0.226', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.172', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:21,774][52668] DAMAGECOUNT value on done: 630901.0 [2024-08-06 05:32:21,774][52668] Sum rewards: 61.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.068', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.164', 'AMMO3': '0.215', 'AMMO4': '0.254', 'weapon2': '0.256', 'weapon5': '0.260', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '53.000'} [2024-08-06 05:32:21,976][52662] DAMAGECOUNT value on done: 644712.0 [2024-08-06 05:32:22,003][52662] Sum rewards: 77.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.286', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.080', 'AMMO3': '0.212', 'weapon5': '0.216', 'AMMO4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '63.000'} [2024-08-06 05:32:22,067][52650] Updated weights for policy 0, policy_version 61911 (0.0020) [2024-08-06 05:32:22,598][52647] DAMAGECOUNT value on done: 669540.0 [2024-08-06 05:32:22,600][52647] Sum rewards: 74.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.219', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:22,731][52660] DAMAGECOUNT value on done: 652005.0 [2024-08-06 05:32:22,733][52660] Sum rewards: 81.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.658', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.100', 'AMMO3': '0.224', 'weapon5': '0.258', 'AMMO4': '0.269', 'weapon2': '0.478', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '67.000'} [2024-08-06 05:32:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 507183104. Throughput: 0: 4384.9. Samples: 126799300. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:32:22,795][52567] Avg episode reward: [(0, '72.655')] [2024-08-06 05:32:23,690][52649] DAMAGECOUNT value on done: 632506.0 [2024-08-06 05:32:23,691][52649] Sum rewards: 70.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.606', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.146', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.458', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '59.000'} [2024-08-06 05:32:24,638][52668] DAMAGECOUNT value on done: 641003.0 [2024-08-06 05:32:24,638][52668] Sum rewards: 75.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.058', 'weapon5': '0.142', 'AMMO3': '0.189', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '62.000'} [2024-08-06 05:32:25,010][52662] DAMAGECOUNT value on done: 654225.0 [2024-08-06 05:32:25,010][52662] Sum rewards: 71.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.149', 'AMMO5': '0.011', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.074', 'AMMO4': '0.082', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon5': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '57.000'} [2024-08-06 05:32:25,836][52660] DAMAGECOUNT value on done: 639086.0 [2024-08-06 05:32:25,837][52660] Sum rewards: 71.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.199', 'weapon4': '0.234', 'AMMO4': '0.240', 'weapon5': '0.246', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 05:32:26,281][52649] DAMAGECOUNT value on done: 618831.0 [2024-08-06 05:32:26,282][52649] Sum rewards: 67.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.445', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.074', 'weapon4': '0.138', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.238', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.338', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.000'} [2024-08-06 05:32:27,035][52650] Updated weights for policy 0, policy_version 61921 (0.0012) [2024-08-06 05:32:27,688][52668] DAMAGECOUNT value on done: 641414.0 [2024-08-06 05:32:27,688][52668] Sum rewards: 60.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.144', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.368', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '49.000'} [2024-08-06 05:32:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 507273216. Throughput: 0: 4385.1. Samples: 126825650. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:32:27,795][52567] Avg episode reward: [(0, '72.815')] [2024-08-06 05:32:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061923_507273216.pth... [2024-08-06 05:32:27,955][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061410_503070720.pth [2024-08-06 05:32:28,002][52662] DAMAGECOUNT value on done: 639886.0 [2024-08-06 05:32:28,003][52662] Sum rewards: 86.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.405', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.070', 'AMMO4': '0.106', 'AMMO3': '0.176', 'weapon4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '69.000'} [2024-08-06 05:32:28,804][52660] DAMAGECOUNT value on done: 637528.0 [2024-08-06 05:32:28,805][52660] Sum rewards: 77.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.679', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.227', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:29,023][52649] DAMAGECOUNT value on done: 628370.0 [2024-08-06 05:32:29,025][52649] Sum rewards: 84.058, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.350', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.096', 'AMMO4': '0.166', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.700', 'weapon3': '3.384', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '72.000'} [2024-08-06 05:32:30,938][52668] DAMAGECOUNT value on done: 640014.0 [2024-08-06 05:32:30,939][52668] Sum rewards: 61.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.148', 'AMMO5': '0.011', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon4': '0.118', 'weapon5': '0.168', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '52.500'} [2024-08-06 05:32:31,191][52662] DAMAGECOUNT value on done: 641993.0 [2024-08-06 05:32:31,193][52662] Sum rewards: 63.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon5': '0.132', 'AMMO3': '0.153', 'weapon4': '0.220', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '52.000'} [2024-08-06 05:32:31,426][52650] Updated weights for policy 0, policy_version 61931 (0.0022) [2024-08-06 05:32:31,622][52649] DAMAGECOUNT value on done: 619966.0 [2024-08-06 05:32:31,623][52649] Sum rewards: 59.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.445', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.186', 'weapon4': '0.200', 'AMMO4': '0.212', 'weapon2': '0.252', 'weapon5': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '3.018', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '49.000'} [2024-08-06 05:32:31,994][52660] DAMAGECOUNT value on done: 637992.0 [2024-08-06 05:32:31,996][52660] Sum rewards: 67.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon5': '0.052', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.814', 'WEAPON3': '1.150', 'weapon3': '2.802', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '55.000'} [2024-08-06 05:32:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 507355136. Throughput: 0: 4380.5. Samples: 126838570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:32:32,794][52567] Avg episode reward: [(0, '72.251')] [2024-08-06 05:32:34,091][52668] DAMAGECOUNT value on done: 646283.0 [2024-08-06 05:32:34,093][52668] Sum rewards: 60.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.901', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.072', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.278', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.406', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '51.000'} [2024-08-06 05:32:34,116][52662] DAMAGECOUNT value on done: 639765.0 [2024-08-06 05:32:34,117][52662] Sum rewards: 80.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.662', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.086', 'weapon2': '0.118', 'weapon4': '0.120', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.456', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '66.000'} [2024-08-06 05:32:34,816][52649] DAMAGECOUNT value on done: 633227.0 [2024-08-06 05:32:34,817][52649] Sum rewards: 63.590, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.870', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon5': '0.130', 'weapon4': '0.138', 'weapon2': '0.252', 'AMMO3': '0.287', 'AMMO4': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.188', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '56.000'} [2024-08-06 05:32:35,105][52660] DAMAGECOUNT value on done: 647702.0 [2024-08-06 05:32:35,105][52660] Sum rewards: 72.121, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.505', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.158', 'weapon5': '0.182', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 05:32:36,395][52650] Updated weights for policy 0, policy_version 61941 (0.0042) [2024-08-06 05:32:36,857][52662] DAMAGECOUNT value on done: 646923.0 [2024-08-06 05:32:36,857][52662] Sum rewards: 61.436, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.127', 'AMMO3': '0.176', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '50.000'} [2024-08-06 05:32:37,057][52668] DAMAGECOUNT value on done: 643178.0 [2024-08-06 05:32:37,057][52668] Sum rewards: 67.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.826', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.240', 'weapon5': '0.270', 'weapon2': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '57.000'} [2024-08-06 05:32:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 507445248. Throughput: 0: 4369.3. Samples: 126864550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:32:37,795][52567] Avg episode reward: [(0, '71.762')] [2024-08-06 05:32:37,863][52649] DAMAGECOUNT value on done: 633315.0 [2024-08-06 05:32:37,863][52649] Sum rewards: 66.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.944', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.298', 'weapon4': '0.386', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '55.000'} [2024-08-06 05:32:37,901][52660] DAMAGECOUNT value on done: 638080.0 [2024-08-06 05:32:37,901][52660] Sum rewards: 80.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.054', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.124', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '67.000'} [2024-08-06 05:32:39,416][52662] DAMAGECOUNT value on done: 639948.0 [2024-08-06 05:32:39,418][52662] Sum rewards: 71.570, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon4': '0.252', 'weapon2': '0.316', 'HEALTH': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 05:32:40,730][52660] DAMAGECOUNT value on done: 639344.0 [2024-08-06 05:32:40,732][52660] Sum rewards: 66.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.192', 'weapon5': '0.204', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'weapon4': '0.384', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.736', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '57.000'} [2024-08-06 05:32:40,901][52649] DAMAGECOUNT value on done: 626977.0 [2024-08-06 05:32:40,901][52649] Sum rewards: 70.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.832', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.138', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '58.000'} [2024-08-06 05:32:41,264][52650] Updated weights for policy 0, policy_version 61951 (0.0012) [2024-08-06 05:32:42,510][52662] DAMAGECOUNT value on done: 654426.0 [2024-08-06 05:32:42,513][52662] Sum rewards: 81.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.862', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.226', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '68.000'} [2024-08-06 05:32:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 507535360. Throughput: 0: 4359.8. Samples: 126890580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:32:42,794][52567] Avg episode reward: [(0, '71.820')] [2024-08-06 05:32:43,986][52660] DAMAGECOUNT value on done: 645319.0 [2024-08-06 05:32:43,988][52660] Sum rewards: 78.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.160', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon4': '0.470', 'WEAPON3': '0.950', 'weapon3': '2.912', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '62.000'} [2024-08-06 05:32:45,479][52662] DAMAGECOUNT value on done: 647703.0 [2024-08-06 05:32:45,487][52662] Sum rewards: 69.838, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.082', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 05:32:45,580][52650] Updated weights for policy 0, policy_version 61961 (0.0026) [2024-08-06 05:32:47,237][52660] DAMAGECOUNT value on done: 638746.0 [2024-08-06 05:32:47,238][52660] Sum rewards: 80.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.160', 'AMMO4': '0.186', 'weapon4': '0.192', 'AMMO3': '0.215', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '65.000'} [2024-08-06 05:32:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 507625472. Throughput: 0: 4366.2. Samples: 126903840. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:32:47,795][52567] Avg episode reward: [(0, '72.202')] [2024-08-06 05:32:48,208][52662] DAMAGECOUNT value on done: 634141.0 [2024-08-06 05:32:48,208][52662] Sum rewards: 67.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.354', 'AMMO5': '0.025', 'AMMO2': '0.063', 'AMMO3': '0.206', 'weapon5': '0.206', 'weapon4': '0.226', 'AMMO4': '0.314', 'weapon2': '0.386', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '59.000'} [2024-08-06 05:32:49,752][52795] DAMAGECOUNT value on done: 599225.0 [2024-08-06 05:32:49,753][52795] Sum rewards: 77.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.170', 'AMMO4': '0.194', 'AMMO3': '0.211', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:50,398][52660] DAMAGECOUNT value on done: 639877.0 [2024-08-06 05:32:50,399][52660] Sum rewards: 76.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.080', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.500', 'weapon3': '3.390', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '65.000'} [2024-08-06 05:32:50,428][52650] Updated weights for policy 0, policy_version 61971 (0.0012) [2024-08-06 05:32:50,625][52662] DAMAGECOUNT value on done: 643986.0 [2024-08-06 05:32:50,634][52662] Sum rewards: 78.247, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.963', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.068', 'AMMO3': '0.167', 'weapon5': '0.188', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '61.000'} [2024-08-06 05:32:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 507699200. Throughput: 0: 4363.8. Samples: 126930270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:32:52,794][52567] Avg episode reward: [(0, '72.216')] [2024-08-06 05:32:52,856][52795] DAMAGECOUNT value on done: 586333.0 [2024-08-06 05:32:52,858][52795] Sum rewards: 63.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.036', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.243', 'weapon2': '0.258', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.464', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '56.000'} [2024-08-06 05:32:53,023][52662] DAMAGECOUNT value on done: 637285.0 [2024-08-06 05:32:53,023][52662] Sum rewards: 71.978, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.125', 'weapon5': '0.132', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.936', 'WEAPON3': '1.050', 'weapon3': '2.700', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 05:32:53,428][52660] DAMAGECOUNT value on done: 651731.0 [2024-08-06 05:32:53,429][52660] Sum rewards: 80.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.279', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.194', 'weapon5': '0.226', 'weapon2': '0.290', 'weapon4': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '65.000'} [2024-08-06 05:32:55,401][52650] Updated weights for policy 0, policy_version 61981 (0.0011) [2024-08-06 05:32:56,127][52795] DAMAGECOUNT value on done: 587584.0 [2024-08-06 05:32:56,128][52795] Sum rewards: 74.695, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.215', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.282', 'WEAPON3': '1.800', 'weapon3': '3.518', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '65.000'} [2024-08-06 05:32:56,550][52660] DAMAGECOUNT value on done: 658469.0 [2024-08-06 05:32:56,551][52660] Sum rewards: 92.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.701', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.125', 'weapon5': '0.140', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON3': '1.400', 'weapon3': '3.426', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.699', 'FRAGCOUNT': '76.000'} [2024-08-06 05:32:57,372][52659] DAMAGECOUNT value on done: 650014.0 [2024-08-06 05:32:57,372][52659] Sum rewards: 65.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.680', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.254', 'AMMO3': '0.263', 'WEAPON3': '1.750', 'weapon3': '3.426', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '57.000'} [2024-08-06 05:32:57,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 507789312. Throughput: 0: 4372.2. Samples: 126956690. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:32:57,794][52567] Avg episode reward: [(0, '72.284')] [2024-08-06 05:32:59,327][52795] DAMAGECOUNT value on done: 594043.0 [2024-08-06 05:32:59,332][52795] Sum rewards: 76.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.218', 'weapon2': '0.224', 'weapon5': '0.226', 'AMMO4': '0.230', 'AMMO3': '0.243', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '65.000'} [2024-08-06 05:32:59,402][52650] Updated weights for policy 0, policy_version 61991 (0.0026) [2024-08-06 05:32:59,512][52820] DAMAGECOUNT value on done: 596612.0 [2024-08-06 05:32:59,513][52820] Sum rewards: 79.632, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.806', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.201', 'AMMO4': '0.210', 'weapon4': '0.258', 'weapon5': '0.266', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '64.000'} [2024-08-06 05:32:59,522][52660] DAMAGECOUNT value on done: 637425.0 [2024-08-06 05:32:59,524][52660] Sum rewards: 64.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.390', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.068', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '55.000'} [2024-08-06 05:33:00,474][52659] DAMAGECOUNT value on done: 644393.0 [2024-08-06 05:33:00,475][52659] Sum rewards: 80.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.634', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'weapon3': '3.486', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:01,618][52665] DAMAGECOUNT value on done: 632207.0 [2024-08-06 05:33:01,625][52665] Sum rewards: 69.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.577', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.100', 'AMMO4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '56.000'} [2024-08-06 05:33:02,394][52660] DAMAGECOUNT value on done: 648237.0 [2024-08-06 05:33:02,394][52660] Sum rewards: 80.936, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.787', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.066', 'AMMO4': '0.098', 'weapon5': '0.144', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON3': '1.050', 'weapon3': '3.370', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:02,471][52795] DAMAGECOUNT value on done: 590354.0 [2024-08-06 05:33:02,472][52795] Sum rewards: 72.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.702', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon2': '0.162', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'weapon3': '3.624', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:02,759][52820] DAMAGECOUNT value on done: 597091.0 [2024-08-06 05:33:02,760][52820] Sum rewards: 69.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.068', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.198', 'weapon5': '0.218', 'weapon2': '0.248', 'weapon4': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '57.000'} [2024-08-06 05:33:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 507887616. Throughput: 0: 4375.6. Samples: 126969950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:33:02,794][52567] Avg episode reward: [(0, '72.287')] [2024-08-06 05:33:03,359][52659] DAMAGECOUNT value on done: 649182.0 [2024-08-06 05:33:03,359][52659] Sum rewards: 72.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.845', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.152', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.346', 'WEAPON3': '1.000', 'weapon3': '3.056', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:03,531][52664] DAMAGECOUNT value on done: 667552.0 [2024-08-06 05:33:03,531][52664] Sum rewards: 73.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.927', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.068', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:04,611][52650] Updated weights for policy 0, policy_version 62001 (0.0027) [2024-08-06 05:33:04,688][52665] DAMAGECOUNT value on done: 647773.0 [2024-08-06 05:33:04,688][52665] Sum rewards: 76.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.669', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.192', 'AMMO3': '0.215', 'weapon5': '0.220', 'AMMO4': '0.255', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:05,022][52660] DAMAGECOUNT value on done: 642138.0 [2024-08-06 05:33:05,024][52660] Sum rewards: 83.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.278', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.020', 'weapon5': '0.028', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.746', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '68.000'} [2024-08-06 05:33:05,593][52795] DAMAGECOUNT value on done: 600838.0 [2024-08-06 05:33:05,593][52795] Sum rewards: 68.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.435', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.168', 'weapon5': '0.238', 'AMMO4': '0.257', 'weapon2': '0.346', 'weapon4': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2024-08-06 05:33:05,714][52820] DAMAGECOUNT value on done: 599057.0 [2024-08-06 05:33:05,715][52820] Sum rewards: 70.000, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.162', 'weapon4': '0.170', 'AMMO3': '0.266', 'AMMO4': '0.273', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon2': '0.556', 'WEAPON3': '1.550', 'weapon3': '2.796', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:06,317][52664] DAMAGECOUNT value on done: 671811.0 [2024-08-06 05:33:06,317][52664] Sum rewards: 73.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.137', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '61.500'} [2024-08-06 05:33:06,441][52659] DAMAGECOUNT value on done: 642055.0 [2024-08-06 05:33:06,441][52659] Sum rewards: 70.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.367', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:06,625][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:33:07,374][52649] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 05:33:07,380][52665] DAMAGECOUNT value on done: 644265.0 [2024-08-06 05:33:07,381][52665] Sum rewards: 71.236, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.116', 'weapon2': '0.176', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:07,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 507969536. Throughput: 0: 4369.3. Samples: 126995920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:33:07,795][52567] Avg episode reward: [(0, '72.091')] [2024-08-06 05:33:08,101][52660] DAMAGECOUNT value on done: 638677.0 [2024-08-06 05:33:08,102][52660] Sum rewards: 74.003, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon5': '0.202', 'AMMO3': '0.241', 'AMMO4': '0.260', 'weapon4': '0.392', 'weapon2': '0.432', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.634', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:08,694][52820] DAMAGECOUNT value on done: 590571.0 [2024-08-06 05:33:08,696][52820] Sum rewards: 70.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.233', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:08,706][52650] Updated weights for policy 0, policy_version 62011 (0.0032) [2024-08-06 05:33:08,768][52795] DAMAGECOUNT value on done: 603301.0 [2024-08-06 05:33:08,769][52795] Sum rewards: 73.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.994', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.102', 'weapon4': '0.114', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:09,571][52664] DAMAGECOUNT value on done: 670468.0 [2024-08-06 05:33:09,571][52664] Sum rewards: 71.470, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.352', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon5': '0.122', 'weapon4': '0.160', 'AMMO4': '0.174', 'AMMO3': '0.255', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:09,615][52659] DAMAGECOUNT value on done: 640352.0 [2024-08-06 05:33:09,619][52659] Sum rewards: 71.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.375', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'weapon4': '0.070', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.510', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:10,609][52665] DAMAGECOUNT value on done: 638742.0 [2024-08-06 05:33:10,609][52665] Sum rewards: 81.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.106', 'AMMO4': '0.140', 'weapon5': '0.144', 'AMMO3': '0.263', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '68.000'} [2024-08-06 05:33:10,946][52660] DAMAGECOUNT value on done: 632525.0 [2024-08-06 05:33:10,947][52660] Sum rewards: 62.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.217', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '53.000'} [2024-08-06 05:33:11,871][52820] DAMAGECOUNT value on done: 598959.0 [2024-08-06 05:33:11,873][52820] Sum rewards: 66.413, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.155', 'HEALTH': '0.162', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.400', 'weapon2': '0.598', 'WEAPON3': '0.900', 'weapon3': '2.850', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '51.000'} [2024-08-06 05:33:11,959][52795] DAMAGECOUNT value on done: 595415.0 [2024-08-06 05:33:11,959][52795] Sum rewards: 63.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.102', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.500'} [2024-08-06 05:33:12,755][52664] DAMAGECOUNT value on done: 662517.0 [2024-08-06 05:33:12,756][52664] Sum rewards: 68.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon2': '0.180', 'AMMO3': '0.215', 'weapon5': '0.224', 'AMMO4': '0.286', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.588', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:12,770][52659] DAMAGECOUNT value on done: 649039.0 [2024-08-06 05:33:12,770][52659] Sum rewards: 78.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.165', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.290', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 508051456. Throughput: 0: 4366.0. Samples: 127022120. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:12,794][52567] Avg episode reward: [(0, '72.054')] [2024-08-06 05:33:13,473][52794] DAMAGECOUNT value on done: 647803.0 [2024-08-06 05:33:13,475][52794] Sum rewards: 75.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.506', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.124', 'AMMO4': '0.132', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.490', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:13,499][52665] DAMAGECOUNT value on done: 626748.0 [2024-08-06 05:33:13,500][52665] Sum rewards: 71.219, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.285', 'weapon2': '0.562', 'WEAPON3': '1.550', 'weapon3': '3.180', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:13,725][52650] Updated weights for policy 0, policy_version 62021 (0.0012) [2024-08-06 05:33:14,910][52820] DAMAGECOUNT value on done: 590157.0 [2024-08-06 05:33:14,911][52820] Sum rewards: 62.248, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.030', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.139', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '3.408', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '52.000'} [2024-08-06 05:33:15,061][52795] DAMAGECOUNT value on done: 592376.0 [2024-08-06 05:33:15,062][52795] Sum rewards: 80.707, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.077', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.306', 'HEALTH': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.372', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:15,659][52659] DAMAGECOUNT value on done: 644725.0 [2024-08-06 05:33:15,660][52659] Sum rewards: 76.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.713', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.195', 'weapon5': '0.202', 'weapon4': '0.222', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:15,697][52664] DAMAGECOUNT value on done: 672024.0 [2024-08-06 05:33:15,697][52664] Sum rewards: 83.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.250', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '69.000'} [2024-08-06 05:33:16,578][52794] DAMAGECOUNT value on done: 652011.0 [2024-08-06 05:33:16,579][52794] Sum rewards: 76.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.505', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'weapon4': '0.168', 'AMMO3': '0.188', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:16,590][52665] DAMAGECOUNT value on done: 634288.0 [2024-08-06 05:33:16,594][52665] Sum rewards: 72.516, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.157', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.308', 'weapon2': '0.346', 'WEAPON3': '1.800', 'weapon3': '3.088', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:17,796][52567] Fps is (10 sec: 17200.7, 60 sec: 17475.7, 300 sec: 17466.9). Total num frames: 508141568. Throughput: 0: 4373.6. Samples: 127035390. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:17,796][52567] Avg episode reward: [(0, '72.668')] [2024-08-06 05:33:18,101][52820] DAMAGECOUNT value on done: 597331.0 [2024-08-06 05:33:18,102][52820] Sum rewards: 73.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.038', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.218', 'AMMO3': '0.223', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:18,198][52795] DAMAGECOUNT value on done: 600269.0 [2024-08-06 05:33:18,199][52795] Sum rewards: 76.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.277', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.164', 'weapon4': '0.180', 'AMMO3': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.630', 'WEAPON3': '1.400', 'weapon3': '2.794', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '65.000'} [2024-08-06 05:33:18,456][52650] Updated weights for policy 0, policy_version 62031 (0.0012) [2024-08-06 05:33:18,524][52664] DAMAGECOUNT value on done: 667094.0 [2024-08-06 05:33:18,524][52664] Sum rewards: 79.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.384', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.174', 'AMMO3': '0.183', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '61.500'} [2024-08-06 05:33:18,912][52659] DAMAGECOUNT value on done: 640974.0 [2024-08-06 05:33:18,913][52659] Sum rewards: 74.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.018', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:19,155][52665] DAMAGECOUNT value on done: 638138.0 [2024-08-06 05:33:19,155][52665] Sum rewards: 73.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.056', 'AMMO5': '0.025', 'AMMO2': '0.061', 'AMMO3': '0.189', 'weapon2': '0.238', 'AMMO4': '0.306', 'weapon5': '0.308', 'weapon4': '0.396', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:19,258][52669] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 05:33:19,795][52794] DAMAGECOUNT value on done: 652313.0 [2024-08-06 05:33:19,798][52794] Sum rewards: 66.340, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.712', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.151', 'weapon5': '0.160', 'weapon2': '0.202', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.366', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '57.000'} [2024-08-06 05:33:20,540][52811] DAMAGECOUNT value on done: 616213.0 [2024-08-06 05:33:20,541][52811] Sum rewards: 72.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.389', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.206', 'weapon5': '0.224', 'AMMO4': '0.225', 'weapon4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:21,213][52664] DAMAGECOUNT value on done: 666125.0 [2024-08-06 05:33:21,214][52664] Sum rewards: 69.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.222', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.602', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:21,225][52820] DAMAGECOUNT value on done: 600870.0 [2024-08-06 05:33:21,227][52820] Sum rewards: 72.267, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.292', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.162', 'AMMO4': '0.192', 'weapon5': '0.198', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:21,266][52795] DAMAGECOUNT value on done: 597017.0 [2024-08-06 05:33:21,269][52795] Sum rewards: 63.533, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.270', 'AMMO5': '0.022', 'AMMO2': '0.073', 'weapon4': '0.166', 'weapon5': '0.206', 'AMMO3': '0.260', 'weapon2': '0.346', 'AMMO4': '0.367', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.962', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '57.000'} [2024-08-06 05:33:22,070][52659] DAMAGECOUNT value on done: 648008.0 [2024-08-06 05:33:22,072][52659] Sum rewards: 79.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.905', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.096', 'AMMO4': '0.147', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:22,144][52666] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 05:33:22,243][52665] DAMAGECOUNT value on done: 635980.0 [2024-08-06 05:33:22,244][52665] Sum rewards: 77.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.136', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.140', 'weapon2': '0.178', 'AMMO3': '0.191', 'WEAPON3': '1.300', 'weapon3': '3.424', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:22,674][52794] DAMAGECOUNT value on done: 642312.0 [2024-08-06 05:33:22,677][52794] Sum rewards: 85.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.209', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.038', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.262', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '68.000'} [2024-08-06 05:33:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 508231680. Throughput: 0: 4380.2. Samples: 127061660. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:22,795][52567] Avg episode reward: [(0, '72.744')] [2024-08-06 05:33:23,296][52650] Updated weights for policy 0, policy_version 62041 (0.0022) [2024-08-06 05:33:23,687][52811] DAMAGECOUNT value on done: 595687.0 [2024-08-06 05:33:23,689][52811] Sum rewards: 62.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.792', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.066', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.282', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '51.000'} [2024-08-06 05:33:23,744][52664] DAMAGECOUNT value on done: 661171.0 [2024-08-06 05:33:23,744][52664] Sum rewards: 80.981, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.572', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.080', 'AMMO3': '0.156', 'weapon5': '0.166', 'AMMO4': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:24,405][52820] DAMAGECOUNT value on done: 596385.0 [2024-08-06 05:33:24,408][52820] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.013', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.210', 'AMMO3': '0.216', 'weapon5': '0.220', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '56.000'} [2024-08-06 05:33:24,479][52795] DAMAGECOUNT value on done: 591648.0 [2024-08-06 05:33:24,480][52795] Sum rewards: 69.267, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.118', 'AMMO4': '0.148', 'AMMO3': '0.220', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.370', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:25,031][52659] DAMAGECOUNT value on done: 652044.0 [2024-08-06 05:33:25,032][52659] Sum rewards: 83.355, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.467', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.194', 'weapon2': '0.208', 'AMMO4': '0.214', 'weapon4': '0.232', 'AMMO3': '0.262', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '72.000'} [2024-08-06 05:33:25,132][52665] DAMAGECOUNT value on done: 648731.0 [2024-08-06 05:33:25,133][52665] Sum rewards: 84.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.317', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.420', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '70.000'} [2024-08-06 05:33:25,217][52794] DAMAGECOUNT value on done: 641726.0 [2024-08-06 05:33:25,219][52794] Sum rewards: 73.758, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.240', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.181', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '65.000'} [2024-08-06 05:33:26,636][52667] DAMAGECOUNT value on done: 644722.0 [2024-08-06 05:33:26,637][52667] Sum rewards: 62.171, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.094', 'AMMO4': '0.186', 'AMMO3': '0.212', 'weapon5': '0.302', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.882', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '51.000'} [2024-08-06 05:33:26,761][52664] DAMAGECOUNT value on done: 675140.0 [2024-08-06 05:33:26,763][52664] Sum rewards: 77.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.838', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.076', 'weapon4': '0.078', 'AMMO4': '0.143', 'AMMO3': '0.174', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.468', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:26,799][52811] DAMAGECOUNT value on done: 596504.0 [2024-08-06 05:33:26,801][52811] Sum rewards: 81.630, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.675', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon2': '0.210', 'AMMO3': '0.265', 'WEAPON3': '1.500', 'weapon3': '3.510', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '69.000'} [2024-08-06 05:33:27,493][52820] DAMAGECOUNT value on done: 602906.0 [2024-08-06 05:33:27,494][52820] Sum rewards: 73.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.195', 'weapon5': '0.214', 'AMMO4': '0.270', 'weapon4': '0.272', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.794', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:27,635][52795] DAMAGECOUNT value on done: 590996.0 [2024-08-06 05:33:27,636][52795] Sum rewards: 64.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.056', 'AMMO4': '0.084', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.262', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '53.000'} [2024-08-06 05:33:27,771][52650] Updated weights for policy 0, policy_version 62051 (0.0023) [2024-08-06 05:33:27,794][52567] Fps is (10 sec: 18025.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 508321792. Throughput: 0: 4380.2. Samples: 127087690. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:27,794][52567] Avg episode reward: [(0, '72.993')] [2024-08-06 05:33:28,062][52665] DAMAGECOUNT value on done: 638413.0 [2024-08-06 05:33:28,064][52665] Sum rewards: 78.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.453', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.082', 'AMMO4': '0.123', 'weapon2': '0.192', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.490', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:28,116][52659] DAMAGECOUNT value on done: 640186.0 [2024-08-06 05:33:28,120][52659] Sum rewards: 75.289, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.125', 'weapon5': '0.130', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:28,222][52794] DAMAGECOUNT value on done: 645451.0 [2024-08-06 05:33:28,224][52794] Sum rewards: 77.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.168', 'AMMO3': '0.202', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:28,366][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:33:29,334][52664] DAMAGECOUNT value on done: 664382.0 [2024-08-06 05:33:29,334][52664] Sum rewards: 66.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.298', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.179', 'weapon5': '0.180', 'weapon4': '0.216', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.000', 'HITCOUNT': '3.080', 'weapon3': '3.082', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '53.000'} [2024-08-06 05:33:29,474][52667] DAMAGECOUNT value on done: 653175.0 [2024-08-06 05:33:29,477][52667] Sum rewards: 81.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.094', 'weapon4': '0.174', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:29,975][52811] DAMAGECOUNT value on done: 597735.0 [2024-08-06 05:33:29,977][52811] Sum rewards: 64.945, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.957', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.154', 'weapon5': '0.194', 'AMMO4': '0.231', 'AMMO3': '0.281', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.684', 'WEAPON3': '1.650', 'weapon3': '2.658', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '57.000'} [2024-08-06 05:33:30,608][52820] DAMAGECOUNT value on done: 593621.0 [2024-08-06 05:33:30,609][52820] Sum rewards: 57.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.136', 'AMMO4': '0.220', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.400', 'HITCOUNT': '2.780', 'weapon3': '3.044', 'DAMAGECOUNT': '14.226', 'FRAGCOUNT': '50.000'} [2024-08-06 05:33:30,927][52795] DAMAGECOUNT value on done: 598198.0 [2024-08-06 05:33:30,927][52795] Sum rewards: 76.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.296', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.226', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.258', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:31,177][52665] DAMAGECOUNT value on done: 646125.0 [2024-08-06 05:33:31,178][52665] Sum rewards: 78.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.436', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.068', 'AMMO4': '0.078', 'weapon5': '0.142', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:31,270][52659] DAMAGECOUNT value on done: 650756.0 [2024-08-06 05:33:31,271][52659] Sum rewards: 83.080, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.637', 'AMMO5': '0.014', 'AMMO2': '0.065', 'AMMO3': '0.176', 'weapon4': '0.176', 'weapon5': '0.248', 'weapon2': '0.276', 'AMMO4': '0.323', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:31,336][52794] DAMAGECOUNT value on done: 649279.0 [2024-08-06 05:33:31,336][52794] Sum rewards: 75.027, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.118', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.201', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:31,946][52664] DAMAGECOUNT value on done: 672653.0 [2024-08-06 05:33:31,947][52664] Sum rewards: 61.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.210', 'AMMO3': '0.217', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.582', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '51.000'} [2024-08-06 05:33:32,289][52667] DAMAGECOUNT value on done: 647121.0 [2024-08-06 05:33:32,291][52667] Sum rewards: 76.327, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.428', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.144', 'AMMO4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:32,353][52650] Updated weights for policy 0, policy_version 62061 (0.0014) [2024-08-06 05:33:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 508403712. Throughput: 0: 4376.9. Samples: 127100800. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:32,794][52567] Avg episode reward: [(0, '73.188')] [2024-08-06 05:33:33,187][52811] DAMAGECOUNT value on done: 604458.0 [2024-08-06 05:33:33,187][52811] Sum rewards: 73.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.745', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.376', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:33,652][52794] DAMAGECOUNT value on done: 637665.0 [2024-08-06 05:33:33,653][52794] Sum rewards: 64.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.466', 'AMMO5': '0.026', 'AMMO2': '0.058', 'weapon4': '0.144', 'AMMO3': '0.223', 'AMMO4': '0.293', 'weapon2': '0.352', 'weapon5': '0.406', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 05:33:33,782][52820] DAMAGECOUNT value on done: 600321.0 [2024-08-06 05:33:33,784][52820] Sum rewards: 75.729, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.432', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.062', 'weapon4': '0.104', 'AMMO4': '0.170', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:33,984][52665] DAMAGECOUNT value on done: 642652.0 [2024-08-06 05:33:33,985][52665] Sum rewards: 84.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.064', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.090', 'weapon5': '0.146', 'AMMO3': '0.193', 'AMMO4': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '70.000'} [2024-08-06 05:33:34,065][52795] DAMAGECOUNT value on done: 585449.0 [2024-08-06 05:33:34,067][52795] Sum rewards: 73.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.194', 'weapon5': '0.214', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:34,221][52659] DAMAGECOUNT value on done: 643077.0 [2024-08-06 05:33:34,224][52659] Sum rewards: 76.662, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.130', 'weapon4': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'HEALTH': '1.291', 'weapon3': '3.264', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:35,001][52664] DAMAGECOUNT value on done: 673439.0 [2024-08-06 05:33:35,001][52664] Sum rewards: 73.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.134', 'weapon5': '0.142', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:35,113][52667] DAMAGECOUNT value on done: 649708.0 [2024-08-06 05:33:35,114][52667] Sum rewards: 82.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.029', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.258', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.348', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '70.000'} [2024-08-06 05:33:36,290][52811] DAMAGECOUNT value on done: 610205.0 [2024-08-06 05:33:36,292][52811] Sum rewards: 80.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.064', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.164', 'weapon2': '0.206', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:36,585][52794] DAMAGECOUNT value on done: 650514.0 [2024-08-06 05:33:36,585][52794] Sum rewards: 79.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.615', 'AMMO5': '0.008', 'AMMO2': '0.059', 'weapon4': '0.084', 'weapon5': '0.122', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'AMMO4': '0.294', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:36,831][52665] DAMAGECOUNT value on done: 641322.0 [2024-08-06 05:33:36,832][52665] Sum rewards: 69.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.506', 'AMMO5': '0.013', 'weapon4': '0.058', 'AMMO2': '0.061', 'weapon5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO4': '0.306', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:36,913][52820] DAMAGECOUNT value on done: 606023.0 [2024-08-06 05:33:36,913][52820] Sum rewards: 68.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.240', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.169', 'weapon2': '0.396', 'WEAPON3': '1.050', 'HITCOUNT': '3.330', 'weapon3': '3.458', 'DAMAGECOUNT': '15.921', 'FRAGCOUNT': '55.000'} [2024-08-06 05:33:37,109][52659] DAMAGECOUNT value on done: 644423.0 [2024-08-06 05:33:37,110][52659] Sum rewards: 92.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.112', 'AMMO4': '0.174', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.404', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.675', 'FRAGCOUNT': '73.500'} [2024-08-06 05:33:37,149][52795] DAMAGECOUNT value on done: 602834.0 [2024-08-06 05:33:37,149][52795] Sum rewards: 71.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.299', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.137', 'weapon2': '0.140', 'AMMO4': '0.169', 'weapon5': '0.186', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon3': '3.116', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '56.000'} [2024-08-06 05:33:37,286][52650] Updated weights for policy 0, policy_version 62071 (0.0027) [2024-08-06 05:33:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 508493824. Throughput: 0: 4369.8. Samples: 127126910. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:37,794][52567] Avg episode reward: [(0, '73.996')] [2024-08-06 05:33:37,949][52664] DAMAGECOUNT value on done: 673441.0 [2024-08-06 05:33:37,951][52664] Sum rewards: 65.396, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.522', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.120', 'weapon2': '0.160', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.502', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2024-08-06 05:33:38,187][52667] DAMAGECOUNT value on done: 653035.0 [2024-08-06 05:33:38,187][52667] Sum rewards: 68.595, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO3': '0.181', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'HEALTH': '0.416', 'WEAPON3': '1.000', 'weapon3': '3.094', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '54.000'} [2024-08-06 05:33:39,291][52794] DAMAGECOUNT value on done: 642766.0 [2024-08-06 05:33:39,293][52794] Sum rewards: 72.720, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.077', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.438', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.750', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:39,420][52811] DAMAGECOUNT value on done: 606076.0 [2024-08-06 05:33:39,420][52811] Sum rewards: 64.858, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.685', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.096', 'weapon4': '0.146', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.070', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '53.000'} [2024-08-06 05:33:39,598][52665] DAMAGECOUNT value on done: 637341.0 [2024-08-06 05:33:39,598][52665] Sum rewards: 69.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.221', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.048', 'weapon4': '0.088', 'AMMO4': '0.120', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.368', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '57.000'} [2024-08-06 05:33:40,050][52659] DAMAGECOUNT value on done: 655697.0 [2024-08-06 05:33:40,052][52659] Sum rewards: 60.938, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.496', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.200', 'AMMO3': '0.236', 'weapon5': '0.278', 'AMMO4': '0.307', 'weapon2': '0.340', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '2.848', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '52.000'} [2024-08-06 05:33:40,133][52820] DAMAGECOUNT value on done: 601311.0 [2024-08-06 05:33:40,135][52820] Sum rewards: 65.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.767', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.197', 'AMMO4': '0.218', 'weapon5': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.500', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '2.372', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '55.000'} [2024-08-06 05:33:40,198][52795] DAMAGECOUNT value on done: 597191.0 [2024-08-06 05:33:40,203][52795] Sum rewards: 72.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.343', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.082', 'AMMO3': '0.185', 'AMMO4': '0.192', 'weapon5': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:40,575][52664] DAMAGECOUNT value on done: 675196.0 [2024-08-06 05:33:40,576][52664] Sum rewards: 69.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.102', 'AMMO4': '0.182', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:40,766][52659] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:33:40,878][52667] DAMAGECOUNT value on done: 655634.0 [2024-08-06 05:33:40,879][52667] Sum rewards: 66.844, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.266', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.102', 'AMMO4': '0.106', 'weapon2': '0.650', 'WEAPON3': '0.750', 'HITCOUNT': '2.950', 'weapon3': '3.150', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '51.500'} [2024-08-06 05:33:41,637][52650] Updated weights for policy 0, policy_version 62081 (0.0034) [2024-08-06 05:33:41,940][52794] DAMAGECOUNT value on done: 639863.0 [2024-08-06 05:33:41,940][52794] Sum rewards: 62.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.157', 'weapon2': '0.364', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.298', 'DAMAGECOUNT': '13.881', 'FRAGCOUNT': '51.000'} [2024-08-06 05:33:42,486][52811] DAMAGECOUNT value on done: 597729.0 [2024-08-06 05:33:42,490][52811] Sum rewards: 71.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.136', 'weapon2': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:42,719][52665] DAMAGECOUNT value on done: 637620.0 [2024-08-06 05:33:42,719][52665] Sum rewards: 83.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.116', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.221', 'weapon4': '0.228', 'weapon5': '0.236', 'weapon2': '0.270', 'AMMO4': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '68.000'} [2024-08-06 05:33:42,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 508575744. Throughput: 0: 4370.0. Samples: 127153340. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:42,795][52567] Avg episode reward: [(0, '73.185')] [2024-08-06 05:33:43,120][52664] DAMAGECOUNT value on done: 678698.0 [2024-08-06 05:33:43,120][52664] Sum rewards: 68.278, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.548', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.098', 'weapon5': '0.116', 'AMMO4': '0.170', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:43,282][52820] DAMAGECOUNT value on done: 604694.0 [2024-08-06 05:33:43,283][52820] Sum rewards: 63.302, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.684', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.072', 'weapon5': '0.160', 'AMMO4': '0.165', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.600', 'HITCOUNT': '2.960', 'weapon3': '3.072', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 05:33:43,351][52659] DAMAGECOUNT value on done: 648167.0 [2024-08-06 05:33:43,353][52659] Sum rewards: 71.382, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.798', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.128', 'weapon4': '0.152', 'AMMO4': '0.198', 'weapon2': '0.288', 'WEAPON5': '0.300', 'AMMO3': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.124', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:43,443][52795] DAMAGECOUNT value on done: 591638.0 [2024-08-06 05:33:43,444][52795] Sum rewards: 83.239, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.117', 'weapon5': '0.126', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:43,761][52667] DAMAGECOUNT value on done: 648394.0 [2024-08-06 05:33:43,764][52667] Sum rewards: 73.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.303', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.090', 'AMMO4': '0.177', 'weapon5': '0.182', 'AMMO3': '0.228', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '61.500'} [2024-08-06 05:33:44,956][52794] DAMAGECOUNT value on done: 645971.0 [2024-08-06 05:33:44,957][52794] Sum rewards: 69.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.439', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon2': '0.124', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'HITCOUNT': '3.520', 'weapon3': '3.714', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:45,616][52665] DAMAGECOUNT value on done: 637100.0 [2024-08-06 05:33:45,616][52665] Sum rewards: 75.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.132', 'weapon5': '0.174', 'AMMO4': '0.196', 'AMMO3': '0.219', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:45,646][52811] DAMAGECOUNT value on done: 611539.0 [2024-08-06 05:33:45,647][52811] Sum rewards: 78.046, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.096', 'weapon5': '0.096', 'AMMO4': '0.160', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:45,827][52664] DAMAGECOUNT value on done: 669206.0 [2024-08-06 05:33:45,828][52664] Sum rewards: 88.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.136', 'AMMO4': '0.144', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.870', 'FRAGCOUNT': '71.000'} [2024-08-06 05:33:45,937][52659] DAMAGECOUNT value on done: 652864.0 [2024-08-06 05:33:45,939][52659] Sum rewards: 73.003, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '61.000'} [2024-08-06 05:33:46,335][52820] DAMAGECOUNT value on done: 600323.0 [2024-08-06 05:33:46,335][52820] Sum rewards: 72.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon4': '0.242', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:46,460][52795] DAMAGECOUNT value on done: 598795.0 [2024-08-06 05:33:46,461][52795] Sum rewards: 87.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.200', 'weapon5': '0.244', 'weapon4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.825', 'FRAGCOUNT': '68.000'} [2024-08-06 05:33:46,751][52650] Updated weights for policy 0, policy_version 62091 (0.0010) [2024-08-06 05:33:46,934][52667] DAMAGECOUNT value on done: 649201.0 [2024-08-06 05:33:46,934][52667] Sum rewards: 68.511, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.950', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.216', 'AMMO3': '0.224', 'AMMO4': '0.239', 'weapon4': '0.320', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.710', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:47,442][52794] DAMAGECOUNT value on done: 639960.0 [2024-08-06 05:33:47,442][52794] Sum rewards: 82.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.385', 'AMMO5': '0.020', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:47,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 508674048. Throughput: 0: 4366.2. Samples: 127166430. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 05:33:47,795][52567] Avg episode reward: [(0, '73.357')] [2024-08-06 05:33:48,515][52659] DAMAGECOUNT value on done: 643538.0 [2024-08-06 05:33:48,516][52659] Sum rewards: 68.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.125', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.114', 'AMMO4': '0.166', 'weapon2': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.400', 'weapon4': '0.438', 'WEAPON3': '1.650', 'weapon3': '2.964', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:48,575][52665] DAMAGECOUNT value on done: 636658.0 [2024-08-06 05:33:48,577][52665] Sum rewards: 74.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.868', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO4': '0.177', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:48,703][52664] DAMAGECOUNT value on done: 666300.0 [2024-08-06 05:33:48,704][52664] Sum rewards: 69.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.481', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.193', 'weapon5': '0.210', 'AMMO4': '0.231', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.454', 'weapon4': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.302', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '56.000'} [2024-08-06 05:33:48,826][52811] DAMAGECOUNT value on done: 602950.0 [2024-08-06 05:33:48,828][52811] Sum rewards: 67.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.352', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.191', 'weapon5': '0.194', 'weapon4': '0.228', 'AMMO4': '0.284', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.894', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '56.500'} [2024-08-06 05:33:49,508][52820] DAMAGECOUNT value on done: 601113.0 [2024-08-06 05:33:49,509][52820] Sum rewards: 69.122, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.674', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.098', 'weapon5': '0.184', 'AMMO4': '0.206', 'AMMO3': '0.241', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:49,662][52795] DAMAGECOUNT value on done: 604294.0 [2024-08-06 05:33:49,662][52795] Sum rewards: 73.775, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.214', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'weapon4': '0.102', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'weapon2': '0.174', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.424', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:49,947][52667] DAMAGECOUNT value on done: 652120.0 [2024-08-06 05:33:49,947][52667] Sum rewards: 74.894, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:50,110][52794] DAMAGECOUNT value on done: 657529.0 [2024-08-06 05:33:50,110][52794] Sum rewards: 54.935, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.805', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.036', 'AMMO4': '0.060', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.107', 'WEAPON5': '0.150', 'weapon7': '0.164', 'weapon4': '0.202', 'WEAPON3': '0.700', 'weapon2': '0.986', 'weapon3': '2.440', 'HITCOUNT': '2.580', 'DAMAGECOUNT': '11.646', 'FRAGCOUNT': '43.000'} [2024-08-06 05:33:51,243][52650] Updated weights for policy 0, policy_version 62101 (0.0025) [2024-08-06 05:33:51,422][52659] DAMAGECOUNT value on done: 652118.0 [2024-08-06 05:33:51,423][52659] Sum rewards: 78.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.487', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.152', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:51,503][52665] DAMAGECOUNT value on done: 632015.0 [2024-08-06 05:33:51,503][52665] Sum rewards: 62.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon5': '0.216', 'AMMO3': '0.230', 'weapon2': '0.274', 'AMMO4': '0.312', 'weapon4': '0.344', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '55.000'} [2024-08-06 05:33:51,873][52811] DAMAGECOUNT value on done: 606649.0 [2024-08-06 05:33:51,873][52811] Sum rewards: 67.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.072', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.210', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.280', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '55.000'} [2024-08-06 05:33:51,911][52664] DAMAGECOUNT value on done: 669842.0 [2024-08-06 05:33:51,912][52664] Sum rewards: 74.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.248', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon4': '0.148', 'weapon5': '0.148', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.894', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:52,472][52667] DAMAGECOUNT value on done: 655653.0 [2024-08-06 05:33:52,472][52667] Sum rewards: 80.968, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO4': '0.118', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '65.000'} [2024-08-06 05:33:52,579][52794] DAMAGECOUNT value on done: 640653.0 [2024-08-06 05:33:52,580][52794] Sum rewards: 78.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'weapon5': '0.208', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.186', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '65.000'} [2024-08-06 05:33:52,683][52820] DAMAGECOUNT value on done: 611523.0 [2024-08-06 05:33:52,683][52820] Sum rewards: 67.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO4': '0.235', 'AMMO3': '0.248', 'weapon5': '0.278', 'weapon2': '0.288', 'weapon4': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.638', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2024-08-06 05:33:52,800][52567] Fps is (10 sec: 18012.4, 60 sec: 17611.1, 300 sec: 17494.4). Total num frames: 508755968. Throughput: 0: 4371.0. Samples: 127192640. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:33:52,800][52567] Avg episode reward: [(0, '73.306')] [2024-08-06 05:33:52,977][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:33:54,265][52665] DAMAGECOUNT value on done: 636653.0 [2024-08-06 05:33:54,266][52665] Sum rewards: 75.728, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.052', 'AMMO3': '0.174', 'weapon5': '0.180', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.870', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '60.000'} [2024-08-06 05:33:54,601][52664] DAMAGECOUNT value on done: 670872.0 [2024-08-06 05:33:54,602][52664] Sum rewards: 70.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.858', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.110', 'AMMO4': '0.166', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '59.000'} [2024-08-06 05:33:54,663][52659] DAMAGECOUNT value on done: 644470.0 [2024-08-06 05:33:54,663][52659] Sum rewards: 64.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.208', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.046', 'weapon5': '0.098', 'AMMO3': '0.199', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '53.000'} [2024-08-06 05:33:54,865][52667] DAMAGECOUNT value on done: 643908.0 [2024-08-06 05:33:54,865][52667] Sum rewards: 81.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.136', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:54,979][52811] DAMAGECOUNT value on done: 610680.0 [2024-08-06 05:33:54,979][52811] Sum rewards: 56.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.070', 'AMMO4': '0.111', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon4': '0.498', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '2.528', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '49.000'} [2024-08-06 05:33:55,307][52794] DAMAGECOUNT value on done: 654929.0 [2024-08-06 05:33:55,308][52794] Sum rewards: 72.038, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.575', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.108', 'weapon5': '0.136', 'AMMO4': '0.173', 'AMMO3': '0.270', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '63.000'} [2024-08-06 05:33:55,758][52650] Updated weights for policy 0, policy_version 62111 (0.0013) [2024-08-06 05:33:55,801][52820] DAMAGECOUNT value on done: 610167.0 [2024-08-06 05:33:55,801][52820] Sum rewards: 80.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.048', 'AMMO4': '0.136', 'weapon5': '0.142', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '66.000'} [2024-08-06 05:33:57,032][52663] DAMAGECOUNT value on done: 655545.0 [2024-08-06 05:33:57,040][52663] Sum rewards: 66.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.159', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon4': '0.120', 'weapon5': '0.226', 'AMMO3': '0.239', 'weapon2': '0.314', 'AMMO4': '0.325', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '55.000'} [2024-08-06 05:33:57,249][52803] DAMAGECOUNT value on done: 601592.0 [2024-08-06 05:33:57,250][52803] Sum rewards: 74.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.980', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.096', 'weapon4': '0.188', 'AMMO4': '0.207', 'AMMO3': '0.241', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '65.000'} [2024-08-06 05:33:57,291][52664] DAMAGECOUNT value on done: 668119.0 [2024-08-06 05:33:57,291][52664] Sum rewards: 71.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.085', 'AMMO5': '0.008', 'weapon5': '0.038', 'AMMO2': '0.048', 'WEAPON5': '0.200', 'AMMO4': '0.241', 'weapon4': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.550', 'weapon3': '3.138', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '62.000'} [2024-08-06 05:33:57,408][52665] DAMAGECOUNT value on done: 641497.0 [2024-08-06 05:33:57,409][52665] Sum rewards: 75.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.620', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.130', 'AMMO4': '0.132', 'weapon4': '0.172', 'weapon2': '0.182', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.306', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '64.000'} [2024-08-06 05:33:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 508846080. Throughput: 0: 4370.2. Samples: 127218780. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:33:57,795][52567] Avg episode reward: [(0, '72.905')] [2024-08-06 05:33:57,886][52667] DAMAGECOUNT value on done: 645159.0 [2024-08-06 05:33:57,888][52667] Sum rewards: 63.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.257', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.105', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.224', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '52.000'} [2024-08-06 05:33:58,008][52794] DAMAGECOUNT value on done: 648131.0 [2024-08-06 05:33:58,010][52794] Sum rewards: 64.728, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.356', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.106', 'weapon5': '0.144', 'AMMO4': '0.169', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.550', 'HITCOUNT': '3.060', 'weapon3': '3.076', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 05:33:58,068][52811] DAMAGECOUNT value on done: 602491.0 [2024-08-06 05:33:58,068][52811] Sum rewards: 66.247, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.469', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.136', 'AMMO4': '0.198', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.292', 'WEAPON3': '1.750', 'HITCOUNT': '3.210', 'weapon3': '3.334', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '58.000'} [2024-08-06 05:33:59,029][52614] Signal inference workers to stop experience collection... (11300 times) [2024-08-06 05:33:59,029][52614] Signal inference workers to resume experience collection... (11300 times) [2024-08-06 05:33:59,034][52820] DAMAGECOUNT value on done: 595702.0 [2024-08-06 05:33:59,035][52820] Sum rewards: 67.702, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.102', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'weapon2': '0.336', 'WEAPON3': '1.700', 'weapon3': '3.226', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '58.500'} [2024-08-06 05:33:59,062][52650] InferenceWorker_p0-w0: stopping experience collection (11300 times) [2024-08-06 05:33:59,062][52650] InferenceWorker_p0-w0: resuming experience collection (11300 times) [2024-08-06 05:34:00,102][52663] DAMAGECOUNT value on done: 647314.0 [2024-08-06 05:34:00,103][52663] Sum rewards: 80.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.351', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.187', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.324', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '64.500'} [2024-08-06 05:34:00,220][52667] DAMAGECOUNT value on done: 651944.0 [2024-08-06 05:34:00,222][52667] Sum rewards: 65.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.632', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '54.000'} [2024-08-06 05:34:00,439][52803] DAMAGECOUNT value on done: 600860.0 [2024-08-06 05:34:00,441][52803] Sum rewards: 77.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.248', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.446', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:00,539][52650] Updated weights for policy 0, policy_version 62121 (0.0025) [2024-08-06 05:34:00,703][52794] DAMAGECOUNT value on done: 653779.0 [2024-08-06 05:34:00,704][52794] Sum rewards: 73.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.248', 'AMMO2': '0.011', 'AMMO5': '0.013', 'AMMO4': '0.055', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'weapon4': '0.346', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:01,100][52811] DAMAGECOUNT value on done: 597857.0 [2024-08-06 05:34:01,102][52811] Sum rewards: 61.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.449', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.070', 'AMMO4': '0.184', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon5': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '51.000'} [2024-08-06 05:34:02,777][52667] DAMAGECOUNT value on done: 641755.0 [2024-08-06 05:34:02,777][52667] Sum rewards: 78.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.178', 'AMMO4': '0.199', 'AMMO3': '0.203', 'weapon4': '0.294', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:02,794][52567] Fps is (10 sec: 17213.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 508928000. Throughput: 0: 4367.3. Samples: 127231910. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:34:02,794][52567] Avg episode reward: [(0, '72.609')] [2024-08-06 05:34:02,853][52663] DAMAGECOUNT value on done: 638060.0 [2024-08-06 05:34:02,855][52663] Sum rewards: 75.857, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.582', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.156', 'weapon5': '0.172', 'AMMO4': '0.193', 'weapon4': '0.196', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:03,502][52803] DAMAGECOUNT value on done: 606832.0 [2024-08-06 05:34:03,504][52803] Sum rewards: 74.074, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.345', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.210', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.414', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:03,562][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:34:03,756][52794] DAMAGECOUNT value on done: 656419.0 [2024-08-06 05:34:03,757][52794] Sum rewards: 77.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.102', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:04,153][52811] DAMAGECOUNT value on done: 601165.0 [2024-08-06 05:34:04,153][52811] Sum rewards: 60.574, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.068', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.630', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '53.000'} [2024-08-06 05:34:05,116][52650] Updated weights for policy 0, policy_version 62131 (0.0020) [2024-08-06 05:34:05,220][52667] DAMAGECOUNT value on done: 652009.0 [2024-08-06 05:34:05,222][52667] Sum rewards: 71.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.884', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'weapon4': '0.190', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:05,477][52664] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:34:06,083][52663] DAMAGECOUNT value on done: 644903.0 [2024-08-06 05:34:06,085][52663] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.553', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.120', 'weapon5': '0.182', 'weapon2': '0.218', 'AMMO3': '0.240', 'AMMO4': '0.271', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:06,556][52803] DAMAGECOUNT value on done: 608367.0 [2024-08-06 05:34:06,556][52803] Sum rewards: 69.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.622', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.068', 'weapon5': '0.184', 'AMMO3': '0.241', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:06,687][52794] DAMAGECOUNT value on done: 647660.0 [2024-08-06 05:34:06,688][52794] Sum rewards: 82.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.202', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.248', 'weapon2': '0.304', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '66.000'} [2024-08-06 05:34:07,208][52811] DAMAGECOUNT value on done: 600665.0 [2024-08-06 05:34:07,209][52811] Sum rewards: 58.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.886', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.092', 'weapon5': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.208', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '50.000'} [2024-08-06 05:34:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 509018112. Throughput: 0: 4373.5. Samples: 127258470. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:34:07,794][52567] Avg episode reward: [(0, '72.260')] [2024-08-06 05:34:08,286][52667] DAMAGECOUNT value on done: 658090.0 [2024-08-06 05:34:08,286][52667] Sum rewards: 81.634, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.618', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.170', 'weapon4': '0.170', 'weapon5': '0.196', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:08,661][52663] DAMAGECOUNT value on done: 649025.0 [2024-08-06 05:34:08,662][52663] Sum rewards: 65.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.136', 'weapon5': '0.152', 'AMMO4': '0.189', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.194', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '53.000'} [2024-08-06 05:34:09,572][52803] DAMAGECOUNT value on done: 604910.0 [2024-08-06 05:34:09,572][52803] Sum rewards: 68.074, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.518', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.104', 'weapon5': '0.168', 'weapon2': '0.220', 'AMMO3': '0.251', 'AMMO4': '0.347', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:09,981][52650] Updated weights for policy 0, policy_version 62141 (0.0011) [2024-08-06 05:34:10,251][52811] DAMAGECOUNT value on done: 605003.0 [2024-08-06 05:34:10,253][52811] Sum rewards: 80.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'weapon2': '0.298', 'weapon4': '0.406', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '67.000'} [2024-08-06 05:34:11,053][52670] DAMAGECOUNT value on done: 637985.0 [2024-08-06 05:34:11,055][52670] Sum rewards: 76.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.579', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.102', 'AMMO4': '0.167', 'weapon5': '0.192', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:11,350][52667] DAMAGECOUNT value on done: 654711.0 [2024-08-06 05:34:11,351][52667] Sum rewards: 76.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.156', 'weapon5': '0.184', 'AMMO4': '0.221', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:11,552][52663] DAMAGECOUNT value on done: 655962.0 [2024-08-06 05:34:11,554][52663] Sum rewards: 68.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.359', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.220', 'weapon4': '0.286', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.898', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '57.000'} [2024-08-06 05:34:11,803][52666] DAMAGECOUNT value on done: 646294.0 [2024-08-06 05:34:11,804][52666] Sum rewards: 70.585, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.815', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon4': '0.164', 'weapon5': '0.166', 'weapon2': '0.188', 'AMMO3': '0.267', 'AMMO4': '0.307', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.204', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '60.000'} [2024-08-06 05:34:12,777][52803] DAMAGECOUNT value on done: 597250.0 [2024-08-06 05:34:12,780][52803] Sum rewards: 86.015, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.524', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.187', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.352', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '69.000'} [2024-08-06 05:34:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 509108224. Throughput: 0: 4381.3. Samples: 127284850. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:34:12,794][52567] Avg episode reward: [(0, '72.493')] [2024-08-06 05:34:13,348][52811] DAMAGECOUNT value on done: 610476.0 [2024-08-06 05:34:13,348][52811] Sum rewards: 87.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.365', 'AMMO5': '0.013', 'AMMO2': '0.066', 'weapon5': '0.134', 'AMMO3': '0.198', 'weapon4': '0.216', 'weapon2': '0.328', 'AMMO4': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.769', 'FRAGCOUNT': '72.000'} [2024-08-06 05:34:13,703][52670] DAMAGECOUNT value on done: 648925.0 [2024-08-06 05:34:13,705][52670] Sum rewards: 86.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.649', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.175', 'AMMO3': '0.220', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.406', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '71.000'} [2024-08-06 05:34:14,408][52663] DAMAGECOUNT value on done: 644166.0 [2024-08-06 05:34:14,410][52663] Sum rewards: 77.488, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.555', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.660', 'WEAPON3': '1.200', 'weapon3': '2.744', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:14,471][52666] DAMAGECOUNT value on done: 647498.0 [2024-08-06 05:34:14,471][52666] Sum rewards: 65.623, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.464', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.280', 'weapon4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:14,564][52650] Updated weights for policy 0, policy_version 62151 (0.0036) [2024-08-06 05:34:14,589][52667] DAMAGECOUNT value on done: 655636.0 [2024-08-06 05:34:14,591][52667] Sum rewards: 69.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.786', 'AMMO5': '0.009', 'weapon4': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '59.500'} [2024-08-06 05:34:15,835][52803] DAMAGECOUNT value on done: 597174.0 [2024-08-06 05:34:15,835][52803] Sum rewards: 74.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.191', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.390', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:16,435][52811] DAMAGECOUNT value on done: 604298.0 [2024-08-06 05:34:16,435][52811] Sum rewards: 72.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.268', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '60.000'} [2024-08-06 05:34:16,811][52670] DAMAGECOUNT value on done: 638412.0 [2024-08-06 05:34:16,812][52670] Sum rewards: 79.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.213', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.066', 'AMMO4': '0.072', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '66.000'} [2024-08-06 05:34:17,016][52667] DAMAGECOUNT value on done: 647970.0 [2024-08-06 05:34:17,016][52667] Sum rewards: 63.584, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.230', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.256', 'AMMO3': '0.298', 'WEAPON3': '1.700', 'HITCOUNT': '3.390', 'weapon3': '3.474', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2024-08-06 05:34:17,395][52663] DAMAGECOUNT value on done: 637774.0 [2024-08-06 05:34:17,398][52663] Sum rewards: 65.756, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.906', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.189', 'weapon2': '0.524', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.066', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:17,737][52666] DAMAGECOUNT value on done: 646808.0 [2024-08-06 05:34:17,737][52666] Sum rewards: 64.397, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.546', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.215', 'AMMO4': '0.227', 'weapon5': '0.294', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.808', 'WEAPON3': '1.250', 'weapon3': '2.228', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.8, 300 sec: 17494.8). Total num frames: 509190144. Throughput: 0: 4380.4. Samples: 127297920. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:34:17,802][52567] Avg episode reward: [(0, '72.432')] [2024-08-06 05:34:19,156][52650] Updated weights for policy 0, policy_version 62161 (0.0017) [2024-08-06 05:34:19,170][52803] DAMAGECOUNT value on done: 595844.0 [2024-08-06 05:34:19,171][52803] Sum rewards: 83.814, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.691', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon4': '0.114', 'weapon5': '0.124', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:19,478][52811] DAMAGECOUNT value on done: 602136.0 [2024-08-06 05:34:19,478][52811] Sum rewards: 74.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.138', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:19,638][52670] DAMAGECOUNT value on done: 635937.0 [2024-08-06 05:34:19,640][52670] Sum rewards: 79.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO4': '0.162', 'weapon5': '0.168', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:20,039][52667] DAMAGECOUNT value on done: 655813.0 [2024-08-06 05:34:20,039][52667] Sum rewards: 79.443, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.920', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.106', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:20,119][52663] DAMAGECOUNT value on done: 639288.0 [2024-08-06 05:34:20,120][52663] Sum rewards: 83.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.114', 'AMMO4': '0.172', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '69.000'} [2024-08-06 05:34:20,172][52666] DAMAGECOUNT value on done: 647612.0 [2024-08-06 05:34:20,172][52666] Sum rewards: 60.382, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.848', 'AMMO5': '0.022', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO4': '0.198', 'AMMO3': '0.264', 'weapon5': '0.358', 'WEAPON4': '0.400', 'weapon2': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.698', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '53.500'} [2024-08-06 05:34:22,346][52803] DAMAGECOUNT value on done: 600138.0 [2024-08-06 05:34:22,347][52803] Sum rewards: 68.175, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.972', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.124', 'AMMO3': '0.228', 'AMMO4': '0.292', 'weapon5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '2.948', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:22,613][52670] DAMAGECOUNT value on done: 648896.0 [2024-08-06 05:34:22,613][52670] Sum rewards: 70.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.464', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.188', 'weapon2': '0.226', 'weapon4': '0.226', 'AMMO4': '0.236', 'AMMO3': '0.263', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.054', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 509280256. Throughput: 0: 4383.6. Samples: 127324170. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:34:22,802][52567] Avg episode reward: [(0, '72.237')] [2024-08-06 05:34:23,070][52663] DAMAGECOUNT value on done: 643251.0 [2024-08-06 05:34:23,071][52663] Sum rewards: 65.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.025', 'AMMO2': '0.054', 'AMMO3': '0.204', 'AMMO4': '0.272', 'weapon2': '0.286', 'weapon5': '0.286', 'weapon4': '0.484', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.630', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:23,219][52666] DAMAGECOUNT value on done: 640538.0 [2024-08-06 05:34:23,219][52666] Sum rewards: 65.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.886', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.230', 'weapon2': '0.238', 'weapon5': '0.328', 'AMMO4': '0.329', 'weapon4': '0.378', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.756', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:23,984][52650] Updated weights for policy 0, policy_version 62171 (0.0029) [2024-08-06 05:34:25,395][52803] DAMAGECOUNT value on done: 594464.0 [2024-08-06 05:34:25,398][52803] Sum rewards: 69.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.156', 'weapon4': '0.162', 'AMMO4': '0.200', 'weapon2': '0.252', 'AMMO3': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.164', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:25,699][52794] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:34:25,836][52670] DAMAGECOUNT value on done: 643749.0 [2024-08-06 05:34:25,837][52670] Sum rewards: 67.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.098', 'weapon4': '0.136', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.296', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.000'} [2024-08-06 05:34:25,998][52663] DAMAGECOUNT value on done: 652958.0 [2024-08-06 05:34:25,999][52663] Sum rewards: 80.260, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.202', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '66.500'} [2024-08-06 05:34:26,408][52669] DAMAGECOUNT value on done: 650101.0 [2024-08-06 05:34:26,412][52669] Sum rewards: 73.530, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.844', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.042', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:26,554][52666] DAMAGECOUNT value on done: 641033.0 [2024-08-06 05:34:26,554][52666] Sum rewards: 80.436, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon4': '0.092', 'weapon5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.258', 'AMMO4': '0.298', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '68.000'} [2024-08-06 05:34:26,652][52658] DAMAGECOUNT value on done: 648302.0 [2024-08-06 05:34:26,652][52658] Sum rewards: 48.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.814', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.180', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON4': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.350', 'HITCOUNT': '2.670', 'weapon3': '2.716', 'DAMAGECOUNT': '11.772', 'FRAGCOUNT': '43.000'} [2024-08-06 05:34:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 509370368. Throughput: 0: 4381.6. Samples: 127350510. Policy #0 lag: (min: 1.0, avg: 3.5, max: 8.0) [2024-08-06 05:34:27,794][52567] Avg episode reward: [(0, '72.329')] [2024-08-06 05:34:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062179_509370368.pth... [2024-08-06 05:34:27,924][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061666_505167872.pth [2024-08-06 05:34:28,454][52803] DAMAGECOUNT value on done: 614216.0 [2024-08-06 05:34:28,456][52803] Sum rewards: 80.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.676', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon2': '0.158', 'weapon5': '0.160', 'AMMO3': '0.239', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '66.000'} [2024-08-06 05:34:28,638][52650] Updated weights for policy 0, policy_version 62181 (0.0020) [2024-08-06 05:34:28,847][52663] DAMAGECOUNT value on done: 640463.0 [2024-08-06 05:34:28,847][52663] Sum rewards: 77.940, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '3.104', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:29,090][52670] DAMAGECOUNT value on done: 634247.0 [2024-08-06 05:34:29,092][52670] Sum rewards: 79.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.193', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.224', 'WEAPON3': '1.300', 'weapon3': '3.426', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '66.000'} [2024-08-06 05:34:29,320][52669] DAMAGECOUNT value on done: 640305.0 [2024-08-06 05:34:29,320][52669] Sum rewards: 78.675, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.697', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.134', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON3': '1.250', 'weapon3': '3.426', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '64.000'} [2024-08-06 05:34:29,443][52666] DAMAGECOUNT value on done: 643081.0 [2024-08-06 05:34:29,444][52666] Sum rewards: 73.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.005', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.116', 'weapon2': '0.192', 'AMMO4': '0.203', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.386', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:29,863][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:34:29,902][52658] DAMAGECOUNT value on done: 647739.0 [2024-08-06 05:34:29,904][52658] Sum rewards: 83.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.772', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.295', 'FRAGCOUNT': '68.000'} [2024-08-06 05:34:31,707][52803] DAMAGECOUNT value on done: 602585.0 [2024-08-06 05:34:31,708][52803] Sum rewards: 77.297, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon2': '0.196', 'weapon5': '0.208', 'AMMO3': '0.209', 'AMMO4': '0.254', 'weapon4': '0.416', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:31,899][52670] DAMAGECOUNT value on done: 641125.0 [2024-08-06 05:34:31,901][52670] Sum rewards: 67.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.958', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.049', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.698', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.000'} [2024-08-06 05:34:31,926][52663] DAMAGECOUNT value on done: 636758.0 [2024-08-06 05:34:31,929][52663] Sum rewards: 72.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.334', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.098', 'AMMO4': '0.147', 'weapon2': '0.216', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:32,278][52647] DAMAGECOUNT value on done: 686603.0 [2024-08-06 05:34:32,279][52647] Sum rewards: 86.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.236', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '70.000'} [2024-08-06 05:34:32,328][52669] DAMAGECOUNT value on done: 652460.0 [2024-08-06 05:34:32,328][52669] Sum rewards: 74.571, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.900', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.097', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.310', 'WEAPON3': '1.850', 'weapon3': '3.398', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:32,395][52666] DAMAGECOUNT value on done: 640062.0 [2024-08-06 05:34:32,398][52666] Sum rewards: 67.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.353', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.172', 'AMMO3': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 05:34:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 509452288. Throughput: 0: 4374.0. Samples: 127363260. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:34:32,794][52567] Avg episode reward: [(0, '72.941')] [2024-08-06 05:34:33,082][52658] DAMAGECOUNT value on done: 652477.0 [2024-08-06 05:34:33,083][52658] Sum rewards: 83.957, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.798', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.138', 'AMMO3': '0.158', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '66.000'} [2024-08-06 05:34:33,395][52650] Updated weights for policy 0, policy_version 62191 (0.0022) [2024-08-06 05:34:33,435][52647] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:34:34,281][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:34:34,930][52803] DAMAGECOUNT value on done: 599289.0 [2024-08-06 05:34:34,932][52803] Sum rewards: 73.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.536', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.138', 'AMMO4': '0.163', 'AMMO3': '0.230', 'weapon5': '0.322', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:34,938][52647] DAMAGECOUNT value on done: 680398.0 [2024-08-06 05:34:34,938][52647] Sum rewards: 66.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.090', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.288', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.000'} [2024-08-06 05:34:35,011][52670] DAMAGECOUNT value on done: 638865.0 [2024-08-06 05:34:35,014][52670] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.237', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '53.500'} [2024-08-06 05:34:35,044][52663] DAMAGECOUNT value on done: 641910.0 [2024-08-06 05:34:35,046][52663] Sum rewards: 73.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.321', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.158', 'weapon2': '0.226', 'weapon5': '0.266', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '57.000'} [2024-08-06 05:34:35,238][52671] DAMAGECOUNT value on done: 651191.0 [2024-08-06 05:34:35,238][52671] Sum rewards: 65.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.145', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.088', 'weapon5': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.314', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '56.000'} [2024-08-06 05:34:35,441][52669] DAMAGECOUNT value on done: 649470.0 [2024-08-06 05:34:35,445][52669] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.405', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.056', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.175', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:35,587][52666] DAMAGECOUNT value on done: 644964.0 [2024-08-06 05:34:35,591][52666] Sum rewards: 72.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.703', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon4': '0.032', 'AMMO4': '0.065', 'weapon5': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:36,269][52658] DAMAGECOUNT value on done: 650143.0 [2024-08-06 05:34:36,277][52658] Sum rewards: 64.987, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.625', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon5': '0.202', 'AMMO3': '0.217', 'AMMO4': '0.300', 'weapon4': '0.316', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:37,443][52647] DAMAGECOUNT value on done: 684079.0 [2024-08-06 05:34:37,444][52647] Sum rewards: 79.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.024', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.187', 'weapon2': '0.666', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 509542400. Throughput: 0: 4378.1. Samples: 127389630. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:34:37,795][52567] Avg episode reward: [(0, '72.421')] [2024-08-06 05:34:37,932][52650] Updated weights for policy 0, policy_version 62201 (0.0016) [2024-08-06 05:34:38,038][52663] DAMAGECOUNT value on done: 637495.0 [2024-08-06 05:34:38,038][52663] Sum rewards: 77.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.698', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.114', 'weapon5': '0.124', 'AMMO4': '0.143', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:38,164][52803] DAMAGECOUNT value on done: 614287.0 [2024-08-06 05:34:38,164][52803] Sum rewards: 62.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.020', 'AMMO4': '0.085', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.268', 'weapon2': '0.486', 'WEAPON3': '1.700', 'weapon3': '3.166', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '53.000'} [2024-08-06 05:34:38,200][52670] DAMAGECOUNT value on done: 636993.0 [2024-08-06 05:34:38,202][52670] Sum rewards: 65.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon5': '0.178', 'AMMO4': '0.202', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.678', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:38,384][52669] DAMAGECOUNT value on done: 649380.0 [2024-08-06 05:34:38,385][52669] Sum rewards: 71.887, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.135', 'AMMO5': '0.023', 'AMMO2': '0.070', 'weapon4': '0.176', 'weapon5': '0.270', 'AMMO3': '0.290', 'AMMO4': '0.348', 'weapon2': '0.474', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.756', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:38,411][52671] DAMAGECOUNT value on done: 654564.0 [2024-08-06 05:34:38,411][52671] Sum rewards: 86.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.090', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '21.204', 'FRAGCOUNT': '70.000'} [2024-08-06 05:34:38,552][52666] DAMAGECOUNT value on done: 637667.0 [2024-08-06 05:34:38,555][52666] Sum rewards: 68.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.072', 'weapon4': '0.142', 'AMMO4': '0.185', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.000'} [2024-08-06 05:34:39,179][52658] DAMAGECOUNT value on done: 641459.0 [2024-08-06 05:34:39,179][52658] Sum rewards: 68.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.540', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.136', 'weapon5': '0.188', 'AMMO4': '0.206', 'AMMO3': '0.242', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:40,130][52795] Large shaping reward 2.548 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.084, -28.0), ('weapon5', 0.002)] [2024-08-06 05:34:40,464][52647] DAMAGECOUNT value on done: 682217.0 [2024-08-06 05:34:40,467][52647] Sum rewards: 65.204, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.830', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.244', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '52.000'} [2024-08-06 05:34:40,816][52663] DAMAGECOUNT value on done: 652131.0 [2024-08-06 05:34:40,818][52663] Sum rewards: 78.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.196', 'AMMO4': '0.234', 'AMMO3': '0.264', 'weapon4': '0.274', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.892', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:40,857][52670] DAMAGECOUNT value on done: 646002.0 [2024-08-06 05:34:40,859][52670] Sum rewards: 68.669, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.265', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.044', 'weapon4': '0.084', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '57.000'} [2024-08-06 05:34:41,176][52669] DAMAGECOUNT value on done: 653032.0 [2024-08-06 05:34:41,177][52669] Sum rewards: 72.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.302', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.086', 'AMMO4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:41,260][52666] DAMAGECOUNT value on done: 641221.0 [2024-08-06 05:34:41,262][52666] Sum rewards: 65.227, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.180', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.148', 'weapon5': '0.164', 'AMMO4': '0.184', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '57.000'} [2024-08-06 05:34:41,264][52803] DAMAGECOUNT value on done: 602045.0 [2024-08-06 05:34:41,264][52803] Sum rewards: 75.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.918', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.166', 'weapon4': '0.220', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.186', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:41,614][52671] DAMAGECOUNT value on done: 650988.0 [2024-08-06 05:34:41,614][52671] Sum rewards: 73.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.490', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.183', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.306', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '60.000'} [2024-08-06 05:34:41,716][52658] DAMAGECOUNT value on done: 642255.0 [2024-08-06 05:34:41,719][52658] Sum rewards: 72.701, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.143', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.398', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.658', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 509624320. Throughput: 0: 4383.6. Samples: 127416040. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:34:42,794][52567] Avg episode reward: [(0, '72.540')] [2024-08-06 05:34:42,947][52650] Updated weights for policy 0, policy_version 62211 (0.0020) [2024-08-06 05:34:43,017][52647] DAMAGECOUNT value on done: 693079.0 [2024-08-06 05:34:43,019][52647] Sum rewards: 74.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.818', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.163', 'AMMO3': '0.186', 'weapon4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:43,666][52663] DAMAGECOUNT value on done: 643029.0 [2024-08-06 05:34:43,666][52663] Sum rewards: 79.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.275', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:43,892][52669] DAMAGECOUNT value on done: 649306.0 [2024-08-06 05:34:43,894][52669] Sum rewards: 66.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.130', 'AMMO4': '0.158', 'weapon5': '0.164', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:44,001][52670] DAMAGECOUNT value on done: 631607.0 [2024-08-06 05:34:44,002][52670] Sum rewards: 70.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.278', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.128', 'weapon2': '0.224', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.388', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '60.000'} [2024-08-06 05:34:44,381][52666] DAMAGECOUNT value on done: 634591.0 [2024-08-06 05:34:44,382][52666] Sum rewards: 68.164, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.117', 'weapon5': '0.122', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.840', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '55.000'} [2024-08-06 05:34:44,410][52658] DAMAGECOUNT value on done: 655725.0 [2024-08-06 05:34:44,411][52658] Sum rewards: 73.095, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.250', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon4': '0.076', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.313', 'WEAPON3': '1.950', 'weapon3': '3.352', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '67.000'} [2024-08-06 05:34:44,504][52803] DAMAGECOUNT value on done: 601634.0 [2024-08-06 05:34:44,504][52803] Sum rewards: 79.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.130', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.386', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:44,674][52671] DAMAGECOUNT value on done: 653422.0 [2024-08-06 05:34:44,675][52671] Sum rewards: 68.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.971', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.184', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '55.500'} [2024-08-06 05:34:45,523][52647] DAMAGECOUNT value on done: 688824.0 [2024-08-06 05:34:45,523][52647] Sum rewards: 80.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.164', 'weapon5': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '64.000'} [2024-08-06 05:34:46,349][52649] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.546, 182.0), ('weapon5', 0.002)] [2024-08-06 05:34:46,595][52670] DAMAGECOUNT value on done: 642291.0 [2024-08-06 05:34:46,595][52670] Sum rewards: 75.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.094', 'AMMO4': '0.160', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:46,767][52663] DAMAGECOUNT value on done: 649584.0 [2024-08-06 05:34:46,767][52663] Sum rewards: 81.708, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.300', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.084', 'weapon5': '0.192', 'AMMO4': '0.241', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.650', 'weapon3': '3.076', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.528', 'FRAGCOUNT': '69.000'} [2024-08-06 05:34:47,042][52650] Updated weights for policy 0, policy_version 62221 (0.0020) [2024-08-06 05:34:47,083][52669] DAMAGECOUNT value on done: 648744.0 [2024-08-06 05:34:47,084][52669] Sum rewards: 71.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.224', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.458', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '60.000'} [2024-08-06 05:34:47,127][52666] DAMAGECOUNT value on done: 648385.0 [2024-08-06 05:34:47,127][52666] Sum rewards: 71.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.703', 'AMMO5': '0.023', 'AMMO2': '0.064', 'AMMO3': '0.175', 'weapon5': '0.226', 'weapon4': '0.312', 'AMMO4': '0.319', 'weapon2': '0.326', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:47,265][52671] DAMAGECOUNT value on done: 661953.0 [2024-08-06 05:34:47,268][52671] Sum rewards: 73.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.595', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO3': '0.195', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.402', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:47,294][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:34:47,444][52658] DAMAGECOUNT value on done: 644562.0 [2024-08-06 05:34:47,446][52658] Sum rewards: 81.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.336', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.122', 'AMMO3': '0.196', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:47,503][52803] DAMAGECOUNT value on done: 605003.0 [2024-08-06 05:34:47,504][52803] Sum rewards: 65.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.073', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.648', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '54.000'} [2024-08-06 05:34:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 509714432. Throughput: 0: 4387.6. Samples: 127429350. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:34:47,795][52567] Avg episode reward: [(0, '72.988')] [2024-08-06 05:34:48,375][52647] DAMAGECOUNT value on done: 684417.0 [2024-08-06 05:34:48,375][52647] Sum rewards: 73.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.828', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.076', 'weapon4': '0.098', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:49,381][52663] DAMAGECOUNT value on done: 649072.0 [2024-08-06 05:34:49,381][52663] Sum rewards: 71.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.390', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.178', 'AMMO4': '0.191', 'weapon4': '0.290', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:49,654][52669] DAMAGECOUNT value on done: 658173.0 [2024-08-06 05:34:49,656][52669] Sum rewards: 75.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.954', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.050', 'AMMO4': '0.067', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:49,688][52670] DAMAGECOUNT value on done: 646418.0 [2024-08-06 05:34:49,690][52670] Sum rewards: 77.502, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.890', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.100', 'HITCOUNT': '3.380', 'weapon3': '3.444', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:50,167][52671] DAMAGECOUNT value on done: 653571.0 [2024-08-06 05:34:50,170][52671] Sum rewards: 69.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.454', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.177', 'AMMO4': '0.189', 'weapon2': '0.218', 'weapon5': '0.288', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '56.000'} [2024-08-06 05:34:50,197][52666] DAMAGECOUNT value on done: 641578.0 [2024-08-06 05:34:50,199][52666] Sum rewards: 65.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.498', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.144', 'AMMO4': '0.145', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.816', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '53.000'} [2024-08-06 05:34:50,210][52658] DAMAGECOUNT value on done: 662656.0 [2024-08-06 05:34:50,214][52658] Sum rewards: 81.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.336', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.138', 'AMMO3': '0.214', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '66.000'} [2024-08-06 05:34:50,500][52803] DAMAGECOUNT value on done: 606123.0 [2024-08-06 05:34:50,502][52803] Sum rewards: 61.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.516', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.082', 'weapon5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.194', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '54.000'} [2024-08-06 05:34:50,977][52647] DAMAGECOUNT value on done: 669678.0 [2024-08-06 05:34:50,978][52647] Sum rewards: 81.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.127', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.105', 'weapon4': '0.118', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.460', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '68.000'} [2024-08-06 05:34:52,164][52650] Updated weights for policy 0, policy_version 62231 (0.0024) [2024-08-06 05:34:52,465][52663] DAMAGECOUNT value on done: 641597.0 [2024-08-06 05:34:52,465][52663] Sum rewards: 66.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.606', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.276', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:52,478][52670] DAMAGECOUNT value on done: 646178.0 [2024-08-06 05:34:52,479][52670] Sum rewards: 69.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.590', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.534', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '60.000'} [2024-08-06 05:34:52,794][52567] Fps is (10 sec: 18841.0, 60 sec: 17614.4, 300 sec: 17522.5). Total num frames: 509812736. Throughput: 0: 4381.5. Samples: 127455640. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:34:52,795][52567] Avg episode reward: [(0, '73.071')] [2024-08-06 05:34:52,818][52671] DAMAGECOUNT value on done: 656699.0 [2024-08-06 05:34:52,819][52671] Sum rewards: 62.360, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.748', 'AMMO5': '0.024', 'AMMO2': '0.055', 'weapon5': '0.220', 'weapon2': '0.256', 'AMMO4': '0.273', 'AMMO3': '0.275', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.806', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '56.000'} [2024-08-06 05:34:52,890][52669] DAMAGECOUNT value on done: 649617.0 [2024-08-06 05:34:52,891][52669] Sum rewards: 86.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.130', 'weapon4': '0.158', 'AMMO3': '0.207', 'AMMO4': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '71.000'} [2024-08-06 05:34:53,134][52666] DAMAGECOUNT value on done: 645385.0 [2024-08-06 05:34:53,136][52666] Sum rewards: 76.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.172', 'AMMO3': '0.184', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.798', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:53,186][52658] DAMAGECOUNT value on done: 649415.0 [2024-08-06 05:34:53,188][52658] Sum rewards: 66.288, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.551', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.184', 'weapon4': '0.234', 'weapon2': '0.244', 'AMMO3': '0.256', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.014', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:53,415][52647] DAMAGECOUNT value on done: 683181.0 [2024-08-06 05:34:53,420][52647] Sum rewards: 75.789, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.986', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.157', 'weapon4': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '0.950', 'weapon3': '3.082', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:53,615][52803] DAMAGECOUNT value on done: 612026.0 [2024-08-06 05:34:53,615][52803] Sum rewards: 72.431, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.914', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.108', 'weapon4': '0.118', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.293', 'weapon2': '0.420', 'WEAPON3': '1.750', 'weapon3': '3.052', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '63.000'} [2024-08-06 05:34:53,650][52668] DAMAGECOUNT value on done: 647011.0 [2024-08-06 05:34:53,651][52668] Sum rewards: 73.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.092', 'AMMO3': '0.177', 'weapon5': '0.210', 'AMMO4': '0.211', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '60.500'} [2024-08-06 05:34:55,637][52670] DAMAGECOUNT value on done: 628009.0 [2024-08-06 05:34:55,637][52670] Sum rewards: 62.043, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.875', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon5': '0.186', 'AMMO3': '0.205', 'weapon2': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.004', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '51.000'} [2024-08-06 05:34:55,905][52658] DAMAGECOUNT value on done: 660865.0 [2024-08-06 05:34:55,905][52658] Sum rewards: 57.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.688', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '48.000'} [2024-08-06 05:34:55,960][52671] DAMAGECOUNT value on done: 653253.0 [2024-08-06 05:34:55,960][52671] Sum rewards: 70.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.166', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.466', 'WEAPON3': '1.700', 'weapon3': '2.900', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '61.000'} [2024-08-06 05:34:56,015][52669] DAMAGECOUNT value on done: 653006.0 [2024-08-06 05:34:56,015][52669] Sum rewards: 66.282, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.141', 'HEALTH': '0.190', 'weapon2': '0.632', 'WEAPON3': '0.800', 'HITCOUNT': '3.030', 'weapon3': '3.282', 'DAMAGECOUNT': '14.178', 'FRAGCOUNT': '53.000'} [2024-08-06 05:34:56,314][52666] DAMAGECOUNT value on done: 634678.0 [2024-08-06 05:34:56,315][52666] Sum rewards: 66.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.130', 'AMMO4': '0.153', 'weapon5': '0.160', 'weapon2': '0.228', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.244', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:56,333][52647] DAMAGECOUNT value on done: 685194.0 [2024-08-06 05:34:56,334][52647] Sum rewards: 80.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.038', 'weapon5': '0.074', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:56,500][52668] DAMAGECOUNT value on done: 651498.0 [2024-08-06 05:34:56,501][52668] Sum rewards: 70.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.031', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.166', 'AMMO3': '0.185', 'weapon4': '0.196', 'AMMO4': '0.234', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '58.000'} [2024-08-06 05:34:56,649][52803] DAMAGECOUNT value on done: 601103.0 [2024-08-06 05:34:56,652][52803] Sum rewards: 88.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.010', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.542', 'WEAPON3': '1.050', 'weapon3': '2.820', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '70.000'} [2024-08-06 05:34:56,797][52650] Updated weights for policy 0, policy_version 62241 (0.0015) [2024-08-06 05:34:57,361][52649] DAMAGECOUNT value on done: 627093.0 [2024-08-06 05:34:57,371][52649] Sum rewards: 80.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.189', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.111', 'weapon5': '0.114', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '65.000'} [2024-08-06 05:34:57,605][52670] Large shaping reward -2.524 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.015, 5.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:34:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 509886464. Throughput: 0: 4376.0. Samples: 127481770. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:34:57,794][52567] Avg episode reward: [(0, '72.541')] [2024-08-06 05:34:58,574][52670] DAMAGECOUNT value on done: 639588.0 [2024-08-06 05:34:58,575][52670] Sum rewards: 74.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.504', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.106', 'AMMO4': '0.190', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.650', 'weapon3': '3.170', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:58,844][52658] DAMAGECOUNT value on done: 645222.0 [2024-08-06 05:34:58,844][52658] Sum rewards: 65.913, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.090', 'AMMO3': '0.129', 'weapon2': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.512', 'WEAPON3': '0.900', 'HITCOUNT': '3.050', 'weapon3': '3.114', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '51.000'} [2024-08-06 05:34:58,932][52671] DAMAGECOUNT value on done: 646329.0 [2024-08-06 05:34:58,933][52671] Sum rewards: 80.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.180', 'AMMO4': '0.185', 'AMMO3': '0.196', 'weapon2': '0.220', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.946', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '67.000'} [2024-08-06 05:34:59,103][52669] DAMAGECOUNT value on done: 656037.0 [2024-08-06 05:34:59,104][52669] Sum rewards: 76.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.069', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.130', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:59,123][52666] DAMAGECOUNT value on done: 642973.0 [2024-08-06 05:34:59,123][52666] Sum rewards: 69.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.173', 'weapon5': '0.184', 'weapon2': '0.254', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '59.000'} [2024-08-06 05:34:59,219][52647] DAMAGECOUNT value on done: 680755.0 [2024-08-06 05:34:59,221][52647] Sum rewards: 76.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.684', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.122', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '62.000'} [2024-08-06 05:34:59,639][52668] DAMAGECOUNT value on done: 651804.0 [2024-08-06 05:34:59,639][52668] Sum rewards: 86.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.205', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.072', 'AMMO3': '0.174', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '69.000'} [2024-08-06 05:35:00,091][52649] DAMAGECOUNT value on done: 619920.0 [2024-08-06 05:35:00,093][52649] Sum rewards: 88.509, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO3': '0.172', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.300', 'HEALTH': '0.734', 'weapon2': '0.750', 'WEAPON3': '0.950', 'weapon3': '2.708', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '69.000'} [2024-08-06 05:35:01,256][52670] DAMAGECOUNT value on done: 647835.0 [2024-08-06 05:35:01,257][52670] Sum rewards: 71.532, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.290', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.150', 'AMMO3': '0.275', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.856', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '63.500'} [2024-08-06 05:35:01,415][52650] Updated weights for policy 0, policy_version 62251 (0.0025) [2024-08-06 05:35:01,779][52666] DAMAGECOUNT value on done: 651226.0 [2024-08-06 05:35:01,779][52666] Sum rewards: 61.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.976', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.177', 'weapon5': '0.228', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.594', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '50.000'} [2024-08-06 05:35:01,807][52647] DAMAGECOUNT value on done: 675860.0 [2024-08-06 05:35:01,807][52647] Sum rewards: 74.804, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.706', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon2': '0.188', 'weapon5': '0.222', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON3': '1.600', 'weapon3': '2.884', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '65.000'} [2024-08-06 05:35:01,864][52658] DAMAGECOUNT value on done: 653143.0 [2024-08-06 05:35:01,867][52658] Sum rewards: 69.820, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.995', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.274', 'WEAPON3': '1.550', 'HITCOUNT': '3.360', 'weapon3': '3.380', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '60.000'} [2024-08-06 05:35:02,004][52669] DAMAGECOUNT value on done: 641347.0 [2024-08-06 05:35:02,004][52669] Sum rewards: 63.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.406', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.152', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.456', 'weapon4': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.592', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '54.000'} [2024-08-06 05:35:02,037][52671] DAMAGECOUNT value on done: 650654.0 [2024-08-06 05:35:02,037][52671] Sum rewards: 72.003, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.174', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.107', 'weapon5': '0.124', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 05:35:02,210][52668] DAMAGECOUNT value on done: 652227.0 [2024-08-06 05:35:02,213][52668] Sum rewards: 68.426, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon2': '0.194', 'AMMO3': '0.208', 'weapon5': '0.210', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '56.000'} [2024-08-06 05:35:02,797][52567] Fps is (10 sec: 17199.5, 60 sec: 17612.1, 300 sec: 17522.4). Total num frames: 509984768. Throughput: 0: 4370.0. Samples: 127494580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:35:02,800][52567] Avg episode reward: [(0, '72.807')] [2024-08-06 05:35:03,168][52649] DAMAGECOUNT value on done: 640019.0 [2024-08-06 05:35:03,169][52649] Sum rewards: 74.317, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.560', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.090', 'weapon5': '0.190', 'weapon2': '0.218', 'AMMO3': '0.253', 'AMMO4': '0.295', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.272', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '63.000'} [2024-08-06 05:35:04,130][52670] DAMAGECOUNT value on done: 639614.0 [2024-08-06 05:35:04,130][52670] Sum rewards: 79.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '66.000'} [2024-08-06 05:35:04,205][52658] DAMAGECOUNT value on done: 644934.0 [2024-08-06 05:35:04,206][52658] Sum rewards: 62.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.314', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '51.000'} [2024-08-06 05:35:04,778][52669] DAMAGECOUNT value on done: 647962.0 [2024-08-06 05:35:04,779][52669] Sum rewards: 78.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.369', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.118', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '65.000'} [2024-08-06 05:35:04,781][52666] DAMAGECOUNT value on done: 632908.0 [2024-08-06 05:35:04,783][52666] Sum rewards: 56.303, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.233', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.208', 'weapon4': '0.254', 'AMMO4': '0.267', 'weapon2': '0.284', 'AMMO3': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.850', 'weapon3': '2.916', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '51.000'} [2024-08-06 05:35:04,859][52647] DAMAGECOUNT value on done: 687413.0 [2024-08-06 05:35:04,860][52647] Sum rewards: 65.188, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.345', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 05:35:05,285][52668] DAMAGECOUNT value on done: 638694.0 [2024-08-06 05:35:05,286][52668] Sum rewards: 66.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.182', 'AMMO3': '0.235', 'weapon2': '0.246', 'AMMO4': '0.275', 'weapon5': '0.344', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '2.954', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '54.000'} [2024-08-06 05:35:05,322][52671] DAMAGECOUNT value on done: 655793.0 [2024-08-06 05:35:05,322][52671] Sum rewards: 75.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.628', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.042', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.215', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 05:35:05,648][52649] DAMAGECOUNT value on done: 633428.0 [2024-08-06 05:35:05,650][52649] Sum rewards: 71.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.325', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.087', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.248', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '57.000'} [2024-08-06 05:35:06,042][52662] DAMAGECOUNT value on done: 652442.0 [2024-08-06 05:35:06,042][52662] Sum rewards: 74.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.635', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.152', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.478', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '63.000'} [2024-08-06 05:35:06,132][52650] Updated weights for policy 0, policy_version 62261 (0.0037) [2024-08-06 05:35:07,198][52670] DAMAGECOUNT value on done: 644139.0 [2024-08-06 05:35:07,200][52670] Sum rewards: 69.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.112', 'weapon4': '0.174', 'AMMO3': '0.243', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '60.000'} [2024-08-06 05:35:07,242][52658] DAMAGECOUNT value on done: 650873.0 [2024-08-06 05:35:07,243][52658] Sum rewards: 81.305, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.171', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '64.000'} [2024-08-06 05:35:07,478][52647] DAMAGECOUNT value on done: 677744.0 [2024-08-06 05:35:07,478][52647] Sum rewards: 64.925, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.385', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.078', 'AMMO4': '0.185', 'AMMO3': '0.234', 'weapon5': '0.234', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '53.000'} [2024-08-06 05:35:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 510066688. Throughput: 0: 4374.7. Samples: 127521030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:07,794][52567] Avg episode reward: [(0, '72.313')] [2024-08-06 05:35:07,864][52669] DAMAGECOUNT value on done: 650078.0 [2024-08-06 05:35:07,874][52669] Sum rewards: 67.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.020', 'AMMO2': '0.068', 'AMMO3': '0.183', 'weapon5': '0.220', 'weapon2': '0.322', 'AMMO4': '0.341', 'weapon4': '0.522', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '57.000'} [2024-08-06 05:35:07,898][52666] DAMAGECOUNT value on done: 641424.0 [2024-08-06 05:35:07,898][52666] Sum rewards: 72.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.318', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.120', 'AMMO4': '0.152', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON3': '1.150', 'HITCOUNT': '3.350', 'weapon3': '3.382', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:08,185][52671] DAMAGECOUNT value on done: 650767.0 [2024-08-06 05:35:08,186][52671] Sum rewards: 78.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.375', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '62.000'} [2024-08-06 05:35:08,259][52668] DAMAGECOUNT value on done: 655482.0 [2024-08-06 05:35:08,264][52668] Sum rewards: 79.378, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.136', 'weapon2': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.462', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '62.000'} [2024-08-06 05:35:08,435][52649] DAMAGECOUNT value on done: 623369.0 [2024-08-06 05:35:08,435][52649] Sum rewards: 62.930, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.012', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.116', 'AMMO4': '0.182', 'AMMO3': '0.191', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.100', 'HITCOUNT': '2.840', 'weapon3': '3.062', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '52.000'} [2024-08-06 05:35:08,696][52662] DAMAGECOUNT value on done: 650966.0 [2024-08-06 05:35:08,698][52662] Sum rewards: 74.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.074', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.552', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '61.000'} [2024-08-06 05:35:10,405][52658] DAMAGECOUNT value on done: 636894.0 [2024-08-06 05:35:10,406][52658] Sum rewards: 71.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.804', 'AMMO5': '0.010', 'AMMO2': '0.056', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.180', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'AMMO4': '0.281', 'weapon2': '0.328', 'weapon4': '0.360', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:10,544][52647] DAMAGECOUNT value on done: 686760.0 [2024-08-06 05:35:10,545][52647] Sum rewards: 66.641, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.513', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.136', 'weapon5': '0.162', 'AMMO3': '0.251', 'AMMO4': '0.273', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '58.500'} [2024-08-06 05:35:10,763][52650] Updated weights for policy 0, policy_version 62271 (0.0012) [2024-08-06 05:35:10,940][52669] DAMAGECOUNT value on done: 669314.0 [2024-08-06 05:35:10,940][52669] Sum rewards: 64.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.114', 'AMMO4': '0.192', 'weapon5': '0.210', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.056', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '55.000'} [2024-08-06 05:35:11,184][52649] DAMAGECOUNT value on done: 638889.0 [2024-08-06 05:35:11,185][52649] Sum rewards: 77.364, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.874', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.165', 'AMMO3': '0.216', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 05:35:11,194][52668] DAMAGECOUNT value on done: 653994.0 [2024-08-06 05:35:11,194][52668] Sum rewards: 67.638, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.414', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.104', 'AMMO3': '0.239', 'weapon5': '0.242', 'AMMO4': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '58.000'} [2024-08-06 05:35:11,291][52662] DAMAGECOUNT value on done: 658700.0 [2024-08-06 05:35:11,291][52662] Sum rewards: 66.147, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.000', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.174', 'weapon2': '0.178', 'weapon5': '0.178', 'AMMO4': '0.320', 'AMMO3': '0.337', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '2.000', 'weapon3': '3.152', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '60.000'} [2024-08-06 05:35:11,342][52671] DAMAGECOUNT value on done: 655478.0 [2024-08-06 05:35:11,342][52671] Sum rewards: 73.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.689', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.122', 'AMMO3': '0.171', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.388', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:12,794][52567] Fps is (10 sec: 17207.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 510156800. Throughput: 0: 4372.2. Samples: 127547260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:12,794][52567] Avg episode reward: [(0, '72.238')] [2024-08-06 05:35:12,849][52647] DAMAGECOUNT value on done: 687553.0 [2024-08-06 05:35:12,851][52647] Sum rewards: 60.780, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.764', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.062', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.342', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.338', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '55.000'} [2024-08-06 05:35:13,542][52658] DAMAGECOUNT value on done: 653290.0 [2024-08-06 05:35:13,543][52658] Sum rewards: 75.619, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.941', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.040', 'weapon5': '0.124', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.326', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '66.000'} [2024-08-06 05:35:13,785][52669] DAMAGECOUNT value on done: 655952.0 [2024-08-06 05:35:13,786][52669] Sum rewards: 73.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.855', 'AMMO5': '0.021', 'AMMO2': '0.057', 'AMMO3': '0.213', 'weapon5': '0.260', 'weapon2': '0.276', 'AMMO4': '0.284', 'weapon4': '0.440', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '62.000'} [2024-08-06 05:35:13,832][52671] DAMAGECOUNT value on done: 651402.0 [2024-08-06 05:35:13,833][52671] Sum rewards: 66.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.926', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.064', 'weapon5': '0.176', 'AMMO3': '0.184', 'AMMO4': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.066', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 05:35:14,137][52662] DAMAGECOUNT value on done: 644651.0 [2024-08-06 05:35:14,138][52662] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.227', 'weapon2': '0.232', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.466', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:14,263][52649] DAMAGECOUNT value on done: 629491.0 [2024-08-06 05:35:14,264][52649] Sum rewards: 71.831, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO4': '0.209', 'AMMO3': '0.224', 'weapon4': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '61.000'} [2024-08-06 05:35:14,359][52668] DAMAGECOUNT value on done: 644993.0 [2024-08-06 05:35:14,359][52668] Sum rewards: 75.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon4': '0.226', 'weapon2': '0.258', 'WEAPON3': '1.050', 'weapon3': '3.292', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '60.000'} [2024-08-06 05:35:15,556][52647] DAMAGECOUNT value on done: 670653.0 [2024-08-06 05:35:15,556][52647] Sum rewards: 83.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.129', 'weapon5': '0.150', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '70.000'} [2024-08-06 05:35:15,728][52650] Updated weights for policy 0, policy_version 62281 (0.0013) [2024-08-06 05:35:16,358][52671] DAMAGECOUNT value on done: 638504.0 [2024-08-06 05:35:16,359][52671] Sum rewards: 66.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.070', 'AMMO4': '0.112', 'weapon5': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '57.000'} [2024-08-06 05:35:16,419][52658] DAMAGECOUNT value on done: 645690.0 [2024-08-06 05:35:16,420][52658] Sum rewards: 69.506, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.044', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.082', 'AMMO4': '0.201', 'AMMO3': '0.222', 'weapon5': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 05:35:16,536][52669] DAMAGECOUNT value on done: 653715.0 [2024-08-06 05:35:16,537][52669] Sum rewards: 68.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.292', 'weapon4': '0.310', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '57.000'} [2024-08-06 05:35:16,795][52662] DAMAGECOUNT value on done: 663810.0 [2024-08-06 05:35:16,797][52662] Sum rewards: 92.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.129', 'AMMO3': '0.220', 'weapon2': '0.226', 'weapon4': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '76.000'} [2024-08-06 05:35:17,260][52649] DAMAGECOUNT value on done: 633793.0 [2024-08-06 05:35:17,261][52649] Sum rewards: 64.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.170', 'AMMO4': '0.197', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '55.000'} [2024-08-06 05:35:17,358][52668] DAMAGECOUNT value on done: 645835.0 [2024-08-06 05:35:17,359][52668] Sum rewards: 76.901, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.074', 'weapon5': '0.142', 'AMMO4': '0.153', 'AMMO3': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '3.114', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '62.000'} [2024-08-06 05:35:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 510246912. Throughput: 0: 4380.2. Samples: 127560370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:17,794][52567] Avg episode reward: [(0, '72.317')] [2024-08-06 05:35:18,568][52647] DAMAGECOUNT value on done: 679591.0 [2024-08-06 05:35:18,576][52647] Sum rewards: 65.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.856', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.090', 'AMMO4': '0.118', 'weapon5': '0.118', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '52.000'} [2024-08-06 05:35:18,916][52658] DAMAGECOUNT value on done: 646623.0 [2024-08-06 05:35:18,917][52658] Sum rewards: 71.729, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.498', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.210', 'AMMO3': '0.251', 'WEAPON3': '1.400', 'weapon3': '3.444', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 05:35:19,266][52669] DAMAGECOUNT value on done: 654979.0 [2024-08-06 05:35:19,267][52669] Sum rewards: 86.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.194', 'AMMO3': '0.205', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '70.000'} [2024-08-06 05:35:19,346][52671] DAMAGECOUNT value on done: 659030.0 [2024-08-06 05:35:19,347][52671] Sum rewards: 85.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.804', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.148', 'AMMO4': '0.178', 'AMMO3': '0.200', 'weapon5': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 05:35:19,592][52662] DAMAGECOUNT value on done: 642488.0 [2024-08-06 05:35:19,592][52662] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.162', 'weapon4': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '65.000'} [2024-08-06 05:35:20,065][52650] Updated weights for policy 0, policy_version 62291 (0.0023) [2024-08-06 05:35:20,410][52649] DAMAGECOUNT value on done: 634569.0 [2024-08-06 05:35:20,412][52649] Sum rewards: 73.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.766', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.310', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.530', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:20,507][52668] DAMAGECOUNT value on done: 654065.0 [2024-08-06 05:35:20,507][52668] Sum rewards: 70.534, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.140', 'weapon5': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:21,055][52647] DAMAGECOUNT value on done: 670701.0 [2024-08-06 05:35:21,056][52647] Sum rewards: 70.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.773', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.136', 'AMMO4': '0.143', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:21,943][52658] DAMAGECOUNT value on done: 651351.0 [2024-08-06 05:35:21,943][52658] Sum rewards: 80.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.839', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.142', 'weapon2': '0.180', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '66.000'} [2024-08-06 05:35:22,257][52669] DAMAGECOUNT value on done: 659933.0 [2024-08-06 05:35:22,258][52669] Sum rewards: 63.687, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.326', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.148', 'AMMO4': '0.160', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '55.500'} [2024-08-06 05:35:22,273][52671] DAMAGECOUNT value on done: 654673.0 [2024-08-06 05:35:22,273][52671] Sum rewards: 75.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.127', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO4': '0.199', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon4': '0.314', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '63.000'} [2024-08-06 05:35:22,756][52662] DAMAGECOUNT value on done: 651541.0 [2024-08-06 05:35:22,757][52662] Sum rewards: 61.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.216', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.207', 'weapon2': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.230', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '52.000'} [2024-08-06 05:35:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 510328832. Throughput: 0: 4378.2. Samples: 127586650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:22,794][52567] Avg episode reward: [(0, '72.440')] [2024-08-06 05:35:22,986][52668] DAMAGECOUNT value on done: 648896.0 [2024-08-06 05:35:22,986][52668] Sum rewards: 68.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.687', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.050', 'AMMO3': '0.173', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '55.000'} [2024-08-06 05:35:23,722][52649] DAMAGECOUNT value on done: 625702.0 [2024-08-06 05:35:23,722][52649] Sum rewards: 55.563, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.785', 'AMMO5': '0.022', 'AMMO2': '0.070', 'weapon4': '0.132', 'weapon5': '0.212', 'AMMO3': '0.274', 'AMMO4': '0.349', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.746', 'WEAPON3': '1.650', 'weapon3': '2.576', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '49.000'} [2024-08-06 05:35:23,850][52647] DAMAGECOUNT value on done: 675405.0 [2024-08-06 05:35:23,850][52647] Sum rewards: 72.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.782', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.142', 'weapon4': '0.170', 'weapon2': '0.212', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '62.000'} [2024-08-06 05:35:24,757][52650] Updated weights for policy 0, policy_version 62301 (0.0028) [2024-08-06 05:35:24,926][52671] DAMAGECOUNT value on done: 654985.0 [2024-08-06 05:35:24,926][52671] Sum rewards: 80.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.932', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.205', 'weapon2': '0.262', 'weapon4': '0.278', 'WEAPON4': '0.300', 'weapon5': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '65.000'} [2024-08-06 05:35:25,826][52662] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:35:25,903][52662] DAMAGECOUNT value on done: 656795.0 [2024-08-06 05:35:25,904][52662] Sum rewards: 80.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.531', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.708', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '67.000'} [2024-08-06 05:35:26,105][52668] DAMAGECOUNT value on done: 641763.0 [2024-08-06 05:35:26,108][52668] Sum rewards: 74.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.140', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.175', 'weapon5': '0.182', 'AMMO4': '0.236', 'weapon4': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.000', 'weapon3': '2.816', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '58.500'} [2024-08-06 05:35:26,777][52649] DAMAGECOUNT value on done: 639291.0 [2024-08-06 05:35:26,780][52649] Sum rewards: 76.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.352', 'AMMO2': '0.010', 'AMMO5': '0.017', 'AMMO4': '0.050', 'weapon5': '0.084', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.248', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '60.000'} [2024-08-06 05:35:26,883][52794] Large shaping reward 2.682 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', 0.05, 10.0), ('weapon5', 0.002)] [2024-08-06 05:35:27,722][52671] DAMAGECOUNT value on done: 655497.0 [2024-08-06 05:35:27,725][52671] Sum rewards: 74.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO5': '0.018', 'AMMO2': '0.077', 'weapon4': '0.224', 'weapon5': '0.236', 'AMMO3': '0.248', 'weapon2': '0.266', 'AMMO4': '0.383', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.012', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '61.000'} [2024-08-06 05:35:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 510418944. Throughput: 0: 4371.6. Samples: 127612760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:27,794][52567] Avg episode reward: [(0, '72.203')] [2024-08-06 05:35:27,821][52660] DAMAGECOUNT value on done: 648835.0 [2024-08-06 05:35:27,821][52660] Sum rewards: 78.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.108', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '66.000'} [2024-08-06 05:35:28,634][52662] DAMAGECOUNT value on done: 650777.0 [2024-08-06 05:35:28,636][52662] Sum rewards: 78.260, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.152', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.042', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.290', 'weapon2': '0.346', 'WEAPON3': '1.700', 'weapon3': '3.302', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '68.000'} [2024-08-06 05:35:29,165][52668] DAMAGECOUNT value on done: 634203.0 [2024-08-06 05:35:29,173][52668] Sum rewards: 76.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.788', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon2': '0.150', 'weapon4': '0.166', 'AMMO3': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.448', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '64.000'} [2024-08-06 05:35:29,666][52650] Updated weights for policy 0, policy_version 62311 (0.0023) [2024-08-06 05:35:30,055][52649] DAMAGECOUNT value on done: 642748.0 [2024-08-06 05:35:30,059][52649] Sum rewards: 76.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.315', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.078', 'weapon4': '0.162', 'AMMO4': '0.195', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '64.000'} [2024-08-06 05:35:30,478][52660] DAMAGECOUNT value on done: 639467.0 [2024-08-06 05:35:30,478][52660] Sum rewards: 70.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.115', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.214', 'AMMO4': '0.227', 'AMMO3': '0.238', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 05:35:30,741][52671] DAMAGECOUNT value on done: 651285.0 [2024-08-06 05:35:30,741][52671] Sum rewards: 70.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.144', 'weapon2': '0.214', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '58.000'} [2024-08-06 05:35:31,665][52662] DAMAGECOUNT value on done: 659550.0 [2024-08-06 05:35:31,667][52662] Sum rewards: 65.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.789', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.203', 'weapon5': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 05:35:32,194][52668] DAMAGECOUNT value on done: 635578.0 [2024-08-06 05:35:32,197][52668] Sum rewards: 79.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.102', 'weapon5': '0.184', 'AMMO3': '0.201', 'AMMO4': '0.204', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '65.000'} [2024-08-06 05:35:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 510509056. Throughput: 0: 4368.2. Samples: 127625920. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:32,794][52567] Avg episode reward: [(0, '72.378')] [2024-08-06 05:35:33,156][52649] DAMAGECOUNT value on done: 639456.0 [2024-08-06 05:35:33,157][52649] Sum rewards: 64.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.120', 'weapon4': '0.158', 'AMMO4': '0.159', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.266', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '54.000'} [2024-08-06 05:35:33,689][52660] DAMAGECOUNT value on done: 651494.0 [2024-08-06 05:35:33,691][52660] Sum rewards: 63.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.211', 'AMMO4': '0.235', 'weapon5': '0.240', 'weapon4': '0.246', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '53.000'} [2024-08-06 05:35:33,955][52650] Updated weights for policy 0, policy_version 62321 (0.0010) [2024-08-06 05:35:34,628][52662] DAMAGECOUNT value on done: 646261.0 [2024-08-06 05:35:34,630][52662] Sum rewards: 75.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.760', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO3': '0.208', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '61.000'} [2024-08-06 05:35:35,435][52668] DAMAGECOUNT value on done: 636209.0 [2024-08-06 05:35:35,435][52668] Sum rewards: 63.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.174', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.132', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon5': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '53.000'} [2024-08-06 05:35:36,240][52649] DAMAGECOUNT value on done: 637738.0 [2024-08-06 05:35:36,241][52649] Sum rewards: 58.457, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.712', 'AMMO5': '0.003', 'weapon5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.179', 'weapon2': '0.228', 'AMMO3': '0.292', 'WEAPON3': '1.700', 'HITCOUNT': '3.090', 'weapon3': '3.578', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '52.000'} [2024-08-06 05:35:36,627][52660] DAMAGECOUNT value on done: 658685.0 [2024-08-06 05:35:36,629][52660] Sum rewards: 81.235, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.040', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.432', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '71.000'} [2024-08-06 05:35:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 510590976. Throughput: 0: 4369.4. Samples: 127652260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:37,795][52567] Avg episode reward: [(0, '72.110')] [2024-08-06 05:35:38,046][52662] DAMAGECOUNT value on done: 648420.0 [2024-08-06 05:35:38,046][52662] Sum rewards: 78.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.134', 'AMMO3': '0.224', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '65.000'} [2024-08-06 05:35:38,256][52668] DAMAGECOUNT value on done: 647698.0 [2024-08-06 05:35:38,260][52668] Sum rewards: 85.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO4': '0.137', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '70.000'} [2024-08-06 05:35:39,096][52650] Updated weights for policy 0, policy_version 62331 (0.0013) [2024-08-06 05:35:39,453][52649] DAMAGECOUNT value on done: 624476.0 [2024-08-06 05:35:39,453][52649] Sum rewards: 70.457, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.180', 'AMMO4': '0.189', 'weapon5': '0.204', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '57.000'} [2024-08-06 05:35:39,691][52660] DAMAGECOUNT value on done: 644969.0 [2024-08-06 05:35:39,701][52660] Sum rewards: 74.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.034', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '63.000'} [2024-08-06 05:35:41,159][52662] DAMAGECOUNT value on done: 645835.0 [2024-08-06 05:35:41,159][52662] Sum rewards: 75.907, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.042', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '64.000'} [2024-08-06 05:35:41,442][52668] DAMAGECOUNT value on done: 647244.0 [2024-08-06 05:35:41,443][52668] Sum rewards: 70.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.858', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.216', 'weapon4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.000'} [2024-08-06 05:35:42,119][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:35:42,571][52649] DAMAGECOUNT value on done: 634514.0 [2024-08-06 05:35:42,573][52649] Sum rewards: 74.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.188', 'AMMO5': '0.025', 'AMMO2': '0.076', 'weapon2': '0.214', 'AMMO3': '0.221', 'weapon5': '0.302', 'weapon4': '0.334', 'AMMO4': '0.380', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2024-08-06 05:35:42,741][52660] DAMAGECOUNT value on done: 643422.0 [2024-08-06 05:35:42,741][52660] Sum rewards: 67.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.459', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.224', 'AMMO3': '0.233', 'weapon4': '0.238', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '57.000'} [2024-08-06 05:35:42,795][52567] Fps is (10 sec: 17201.4, 60 sec: 17612.5, 300 sec: 17494.7). Total num frames: 510681088. Throughput: 0: 4367.5. Samples: 127678310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:35:42,796][52567] Avg episode reward: [(0, '72.611')] [2024-08-06 05:35:43,368][52650] Updated weights for policy 0, policy_version 62341 (0.0020) [2024-08-06 05:35:44,042][52668] DAMAGECOUNT value on done: 644543.0 [2024-08-06 05:35:44,043][52668] Sum rewards: 52.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.298', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '2.870', 'weapon3': '3.028', 'DAMAGECOUNT': '13.587', 'FRAGCOUNT': '45.000'} [2024-08-06 05:35:44,254][52662] DAMAGECOUNT value on done: 652672.0 [2024-08-06 05:35:44,255][52662] Sum rewards: 72.682, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.337', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.144', 'AMMO3': '0.160', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.412', 'weapon2': '0.488', 'WEAPON3': '1.000', 'weapon3': '2.666', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '58.000'} [2024-08-06 05:35:45,216][52660] DAMAGECOUNT value on done: 644937.0 [2024-08-06 05:35:45,226][52660] Sum rewards: 86.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.023', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.835', 'FRAGCOUNT': '70.000'} [2024-08-06 05:35:45,328][52649] DAMAGECOUNT value on done: 626071.0 [2024-08-06 05:35:45,328][52649] Sum rewards: 68.394, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.438', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.188', 'weapon2': '0.192', 'AMMO4': '0.223', 'AMMO3': '0.285', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.936', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:46,834][52668] DAMAGECOUNT value on done: 653372.0 [2024-08-06 05:35:46,836][52668] Sum rewards: 86.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.294', 'weapon4': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.034', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '21.237', 'FRAGCOUNT': '71.000'} [2024-08-06 05:35:47,364][52662] DAMAGECOUNT value on done: 645677.0 [2024-08-06 05:35:47,365][52662] Sum rewards: 70.905, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.025', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.063', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '58.000'} [2024-08-06 05:35:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 510763008. Throughput: 0: 4375.3. Samples: 127691460. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:35:47,794][52567] Avg episode reward: [(0, '72.386')] [2024-08-06 05:35:48,256][52650] Updated weights for policy 0, policy_version 62351 (0.0011) [2024-08-06 05:35:48,274][52660] DAMAGECOUNT value on done: 653957.0 [2024-08-06 05:35:48,275][52660] Sum rewards: 72.436, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.519', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.168', 'weapon5': '0.168', 'AMMO4': '0.192', 'AMMO3': '0.245', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '62.500'} [2024-08-06 05:35:48,536][52649] DAMAGECOUNT value on done: 639200.0 [2024-08-06 05:35:48,536][52649] Sum rewards: 78.359, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.060', 'AMMO3': '0.159', 'AMMO4': '0.190', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '63.000'} [2024-08-06 05:35:49,542][52647] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.528, 176.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:35:49,601][52668] DAMAGECOUNT value on done: 649613.0 [2024-08-06 05:35:49,605][52668] Sum rewards: 80.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.168', 'AMMO3': '0.190', 'weapon5': '0.198', 'AMMO4': '0.219', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '64.000'} [2024-08-06 05:35:50,620][52662] DAMAGECOUNT value on done: 659841.0 [2024-08-06 05:35:50,623][52662] Sum rewards: 63.113, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.526', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.156', 'weapon4': '0.184', 'AMMO4': '0.185', 'weapon2': '0.210', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.212', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '55.000'} [2024-08-06 05:35:50,969][52660] DAMAGECOUNT value on done: 643180.0 [2024-08-06 05:35:50,969][52660] Sum rewards: 61.866, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.118', 'AMMO3': '0.153', 'weapon4': '0.164', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.648', 'WEAPON3': '1.000', 'weapon3': '2.872', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '50.000'} [2024-08-06 05:35:51,641][52649] DAMAGECOUNT value on done: 639206.0 [2024-08-06 05:35:51,641][52649] Sum rewards: 82.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.062', 'AMMO3': '0.193', 'weapon5': '0.220', 'AMMO4': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '68.000'} [2024-08-06 05:35:52,794][52567] Fps is (10 sec: 17204.8, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 510853120. Throughput: 0: 4375.1. Samples: 127717910. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:35:52,794][52567] Avg episode reward: [(0, '72.092')] [2024-08-06 05:35:52,894][52650] Updated weights for policy 0, policy_version 62361 (0.0020) [2024-08-06 05:35:53,490][52662] DAMAGECOUNT value on done: 654211.0 [2024-08-06 05:35:53,491][52662] Sum rewards: 73.661, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.005', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.166', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.327', 'weapon2': '0.346', 'WEAPON3': '1.800', 'weapon3': '3.044', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '64.000'} [2024-08-06 05:35:53,520][52660] DAMAGECOUNT value on done: 645728.0 [2024-08-06 05:35:53,522][52660] Sum rewards: 72.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.476', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.138', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon5': '0.342', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:54,461][52649] DAMAGECOUNT value on done: 632681.0 [2024-08-06 05:35:54,462][52649] Sum rewards: 70.316, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.554', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.055', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:56,211][52662] DAMAGECOUNT value on done: 639702.0 [2024-08-06 05:35:56,220][52662] Sum rewards: 71.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.207', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.160', 'weapon5': '0.196', 'AMMO3': '0.216', 'AMMO4': '0.216', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '60.000'} [2024-08-06 05:35:56,572][52660] DAMAGECOUNT value on done: 651424.0 [2024-08-06 05:35:56,573][52660] Sum rewards: 69.785, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.890', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO4': '0.201', 'weapon5': '0.202', 'AMMO3': '0.244', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.000'} [2024-08-06 05:35:57,319][52650] Updated weights for policy 0, policy_version 62371 (0.0010) [2024-08-06 05:35:57,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.4, 300 sec: 17550.3). Total num frames: 510951424. Throughput: 0: 4377.3. Samples: 127744240. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:35:57,794][52567] Avg episode reward: [(0, '72.252')] [2024-08-06 05:35:58,554][52662] DAMAGECOUNT value on done: 649348.0 [2024-08-06 05:35:58,556][52662] Sum rewards: 65.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.218', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.168', 'AMMO3': '0.243', 'weapon5': '0.258', 'AMMO4': '0.302', 'weapon2': '0.346', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.908', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '55.500'} [2024-08-06 05:35:59,738][52660] DAMAGECOUNT value on done: 643824.0 [2024-08-06 05:35:59,741][52660] Sum rewards: 64.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.225', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.064', 'AMMO3': '0.157', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.190', 'WEAPON7': '0.200', 'AMMO4': '0.218', 'weapon7': '0.274', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.700', 'weapon3': '2.736', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '53.000'} [2024-08-06 05:36:01,186][52662] DAMAGECOUNT value on done: 643067.0 [2024-08-06 05:36:01,188][52662] Sum rewards: 72.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.374', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.072', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.444', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:01,779][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:36:02,220][52650] Updated weights for policy 0, policy_version 62381 (0.0014) [2024-08-06 05:36:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.9, 300 sec: 17522.5). Total num frames: 511033344. Throughput: 0: 4378.2. Samples: 127757390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:36:02,794][52567] Avg episode reward: [(0, '72.048')] [2024-08-06 05:36:03,027][52660] DAMAGECOUNT value on done: 646329.0 [2024-08-06 05:36:03,028][52660] Sum rewards: 71.849, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.731', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon4': '0.088', 'weapon2': '0.214', 'weapon5': '0.250', 'AMMO3': '0.305', 'AMMO4': '0.325', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.110', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '62.000'} [2024-08-06 05:36:05,769][52664] DAMAGECOUNT value on done: 673393.0 [2024-08-06 05:36:05,771][52664] Sum rewards: 71.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.352', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '58.000'} [2024-08-06 05:36:05,825][52660] DAMAGECOUNT value on done: 657670.0 [2024-08-06 05:36:05,828][52660] Sum rewards: 73.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.755', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.150', 'AMMO4': '0.214', 'AMMO3': '0.238', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2024-08-06 05:36:07,244][52650] Updated weights for policy 0, policy_version 62391 (0.0011) [2024-08-06 05:36:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 511115264. Throughput: 0: 4374.2. Samples: 127783490. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:36:07,794][52567] Avg episode reward: [(0, '72.246')] [2024-08-06 05:36:08,020][52659] DAMAGECOUNT value on done: 655423.0 [2024-08-06 05:36:08,020][52659] Sum rewards: 57.712, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.530', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.154', 'AMMO4': '0.226', 'AMMO3': '0.267', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '51.500'} [2024-08-06 05:36:08,871][52660] DAMAGECOUNT value on done: 664065.0 [2024-08-06 05:36:08,872][52660] Sum rewards: 65.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.244', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.112', 'AMMO3': '0.196', 'weapon5': '0.206', 'AMMO4': '0.211', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '54.000'} [2024-08-06 05:36:08,967][52664] DAMAGECOUNT value on done: 677961.0 [2024-08-06 05:36:08,969][52664] Sum rewards: 71.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '59.000'} [2024-08-06 05:36:10,531][52659] DAMAGECOUNT value on done: 649627.0 [2024-08-06 05:36:10,532][52659] Sum rewards: 65.849, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.662', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.104', 'weapon4': '0.122', 'AMMO4': '0.126', 'AMMO3': '0.221', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.272', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:11,391][52664] DAMAGECOUNT value on done: 676287.0 [2024-08-06 05:36:11,393][52664] Sum rewards: 71.931, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO4': '0.158', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.270', 'HEALTH': '0.476', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 05:36:11,594][52650] Updated weights for policy 0, policy_version 62401 (0.0020) [2024-08-06 05:36:11,773][52660] DAMAGECOUNT value on done: 644068.0 [2024-08-06 05:36:11,774][52660] Sum rewards: 81.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.481', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.010', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'weapon4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '68.000'} [2024-08-06 05:36:12,761][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:36:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 511205376. Throughput: 0: 4374.4. Samples: 127809610. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:36:12,794][52567] Avg episode reward: [(0, '72.158')] [2024-08-06 05:36:13,522][52659] DAMAGECOUNT value on done: 655511.0 [2024-08-06 05:36:13,523][52659] Sum rewards: 82.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.637', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.135', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '68.000'} [2024-08-06 05:36:13,952][52664] DAMAGECOUNT value on done: 667747.0 [2024-08-06 05:36:13,952][52664] Sum rewards: 54.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.222', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.064', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'weapon5': '0.210', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '46.500'} [2024-08-06 05:36:14,505][52665] DAMAGECOUNT value on done: 638866.0 [2024-08-06 05:36:14,507][52665] Sum rewards: 81.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.216', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '67.000'} [2024-08-06 05:36:14,688][52659] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:36:14,738][52660] DAMAGECOUNT value on done: 653946.0 [2024-08-06 05:36:14,739][52660] Sum rewards: 70.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.710', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.126', 'weapon5': '0.162', 'AMMO4': '0.221', 'AMMO3': '0.298', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.134', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '63.000'} [2024-08-06 05:36:15,771][52795] DAMAGECOUNT value on done: 604452.0 [2024-08-06 05:36:15,771][52795] Sum rewards: 69.324, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.130', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon2': '0.172', 'AMMO3': '0.190', 'AMMO4': '0.196', 'weapon5': '0.200', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.176', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:16,329][52650] Updated weights for policy 0, policy_version 62411 (0.0022) [2024-08-06 05:36:16,334][52659] DAMAGECOUNT value on done: 648030.0 [2024-08-06 05:36:16,337][52659] Sum rewards: 63.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.580', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.196', 'AMMO4': '0.231', 'AMMO3': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.460', 'weapon2': '0.796', 'WEAPON3': '1.500', 'weapon3': '2.270', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '51.000'} [2024-08-06 05:36:16,920][52664] DAMAGECOUNT value on done: 678149.0 [2024-08-06 05:36:16,922][52664] Sum rewards: 79.211, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.189', 'weapon5': '0.218', 'weapon2': '0.232', 'AMMO4': '0.242', 'weapon4': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:17,510][52665] DAMAGECOUNT value on done: 653784.0 [2024-08-06 05:36:17,512][52665] Sum rewards: 72.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.094', 'AMMO4': '0.136', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '58.000'} [2024-08-06 05:36:17,651][52660] DAMAGECOUNT value on done: 647427.0 [2024-08-06 05:36:17,652][52660] Sum rewards: 64.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.128', 'AMMO4': '0.174', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.240', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '53.500'} [2024-08-06 05:36:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 511295488. Throughput: 0: 4371.3. Samples: 127822630. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:36:17,794][52567] Avg episode reward: [(0, '72.028')] [2024-08-06 05:36:18,982][52795] DAMAGECOUNT value on done: 592373.0 [2024-08-06 05:36:18,983][52795] Sum rewards: 72.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.512', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.114', 'AMMO4': '0.117', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:19,162][52659] DAMAGECOUNT value on done: 646712.0 [2024-08-06 05:36:19,163][52659] Sum rewards: 77.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.228', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.154', 'weapon5': '0.184', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:19,481][52664] DAMAGECOUNT value on done: 674042.0 [2024-08-06 05:36:19,481][52664] Sum rewards: 82.226, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.100', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.126', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.348', 'WEAPON3': '1.650', 'weapon3': '3.244', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.844', 'FRAGCOUNT': '69.000'} [2024-08-06 05:36:20,542][52665] DAMAGECOUNT value on done: 651391.0 [2024-08-06 05:36:20,542][52665] Sum rewards: 91.544, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.765', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.378', 'FRAGCOUNT': '73.000'} [2024-08-06 05:36:20,860][52660] DAMAGECOUNT value on done: 644290.0 [2024-08-06 05:36:20,861][52660] Sum rewards: 69.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.092', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 05:36:20,922][52803] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:36:21,195][52650] Updated weights for policy 0, policy_version 62421 (0.0027) [2024-08-06 05:36:21,480][52794] DAMAGECOUNT value on done: 652991.0 [2024-08-06 05:36:21,481][52794] Sum rewards: 59.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.219', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.338', 'WEAPON3': '1.450', 'weapon3': '2.848', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '50.000'} [2024-08-06 05:36:21,727][52659] DAMAGECOUNT value on done: 654386.0 [2024-08-06 05:36:21,728][52659] Sum rewards: 62.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.108', 'AMMO4': '0.146', 'weapon4': '0.160', 'AMMO3': '0.248', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.184', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '54.000'} [2024-08-06 05:36:22,057][52664] DAMAGECOUNT value on done: 671874.0 [2024-08-06 05:36:22,057][52664] Sum rewards: 65.799, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.060', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.526', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:22,081][52795] DAMAGECOUNT value on done: 594200.0 [2024-08-06 05:36:22,082][52795] Sum rewards: 79.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.096', 'weapon5': '0.124', 'AMMO4': '0.158', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.674', 'WEAPON3': '1.600', 'weapon3': '2.826', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '67.000'} [2024-08-06 05:36:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 511385600. Throughput: 0: 4369.1. Samples: 127848870. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:36:22,794][52567] Avg episode reward: [(0, '72.369')] [2024-08-06 05:36:23,693][52665] DAMAGECOUNT value on done: 644914.0 [2024-08-06 05:36:23,693][52665] Sum rewards: 76.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.046', 'weapon5': '0.076', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '66.000'} [2024-08-06 05:36:24,009][52660] DAMAGECOUNT value on done: 638586.0 [2024-08-06 05:36:24,009][52660] Sum rewards: 72.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.601', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.163', 'weapon4': '0.282', 'weapon2': '0.300', 'weapon5': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.780', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '58.000'} [2024-08-06 05:36:24,605][52820] DAMAGECOUNT value on done: 604078.0 [2024-08-06 05:36:24,609][52820] Sum rewards: 95.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.174', 'AMMO4': '0.175', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '22.398', 'FRAGCOUNT': '77.000'} [2024-08-06 05:36:24,656][52794] DAMAGECOUNT value on done: 657721.0 [2024-08-06 05:36:24,656][52794] Sum rewards: 73.682, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.355', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.129', 'AMMO3': '0.148', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.918', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '58.000'} [2024-08-06 05:36:24,735][52659] DAMAGECOUNT value on done: 650641.0 [2024-08-06 05:36:24,735][52659] Sum rewards: 73.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:25,294][52795] DAMAGECOUNT value on done: 599856.0 [2024-08-06 05:36:25,296][52795] Sum rewards: 68.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'AMMO5': '0.020', 'AMMO2': '0.073', 'AMMO3': '0.243', 'weapon4': '0.282', 'weapon5': '0.320', 'weapon2': '0.356', 'AMMO4': '0.363', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.666', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '57.000'} [2024-08-06 05:36:25,308][52664] DAMAGECOUNT value on done: 667273.0 [2024-08-06 05:36:25,309][52664] Sum rewards: 76.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO4': '0.123', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '65.000'} [2024-08-06 05:36:25,626][52650] Updated weights for policy 0, policy_version 62431 (0.0013) [2024-08-06 05:36:26,478][52665] DAMAGECOUNT value on done: 632451.0 [2024-08-06 05:36:26,488][52665] Sum rewards: 65.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.472', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.162', 'AMMO4': '0.206', 'weapon5': '0.226', 'AMMO3': '0.240', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:27,372][52794] DAMAGECOUNT value on done: 658420.0 [2024-08-06 05:36:27,372][52794] Sum rewards: 71.574, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.988', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 511467520. Throughput: 0: 4369.2. Samples: 127874920. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:36:27,795][52567] Avg episode reward: [(0, '72.449')] [2024-08-06 05:36:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062435_511467520.pth... [2024-08-06 05:36:27,801][52820] DAMAGECOUNT value on done: 603458.0 [2024-08-06 05:36:27,802][52820] Sum rewards: 78.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.680', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.258', 'weapon5': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:27,861][52659] DAMAGECOUNT value on done: 647644.0 [2024-08-06 05:36:27,861][52659] Sum rewards: 79.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.130', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.022', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '3.344', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 05:36:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000061923_507273216.pth [2024-08-06 05:36:28,235][52660] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:36:28,369][52664] DAMAGECOUNT value on done: 680060.0 [2024-08-06 05:36:28,370][52664] Sum rewards: 57.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.096', 'AMMO3': '0.204', 'AMMO4': '0.227', 'weapon5': '0.228', 'WEAPON4': '0.450', 'weapon2': '0.458', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '49.000'} [2024-08-06 05:36:28,504][52795] DAMAGECOUNT value on done: 595814.0 [2024-08-06 05:36:28,505][52795] Sum rewards: 67.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.192', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.098', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:29,088][52665] DAMAGECOUNT value on done: 640447.0 [2024-08-06 05:36:29,088][52665] Sum rewards: 75.694, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.804', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.118', 'AMMO3': '0.169', 'AMMO4': '0.208', 'weapon5': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:30,325][52794] DAMAGECOUNT value on done: 648018.0 [2024-08-06 05:36:30,327][52794] Sum rewards: 75.385, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.235', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO3': '0.171', 'AMMO4': '0.195', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '2.862', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:30,537][52650] Updated weights for policy 0, policy_version 62441 (0.0024) [2024-08-06 05:36:31,038][52820] DAMAGECOUNT value on done: 605656.0 [2024-08-06 05:36:31,038][52820] Sum rewards: 86.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.440', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.088', 'weapon5': '0.148', 'AMMO3': '0.155', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '0.950', 'weapon3': '3.072', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '69.000'} [2024-08-06 05:36:31,066][52659] DAMAGECOUNT value on done: 653022.0 [2024-08-06 05:36:31,069][52659] Sum rewards: 64.354, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.866', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.155', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.318', 'weapon2': '0.322', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.096', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '53.000'} [2024-08-06 05:36:31,544][52664] DAMAGECOUNT value on done: 671015.0 [2024-08-06 05:36:31,547][52664] Sum rewards: 82.516, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO2': '0.017', 'AMMO5': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon5': '0.174', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '65.000'} [2024-08-06 05:36:31,637][52795] DAMAGECOUNT value on done: 607041.0 [2024-08-06 05:36:31,637][52795] Sum rewards: 75.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon2': '0.216', 'weapon5': '0.218', 'weapon4': '0.220', 'AMMO3': '0.233', 'AMMO4': '0.267', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:31,946][52665] DAMAGECOUNT value on done: 644906.0 [2024-08-06 05:36:31,947][52665] Sum rewards: 78.520, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.755', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.112', 'weapon5': '0.188', 'AMMO4': '0.235', 'weapon2': '0.250', 'AMMO3': '0.299', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.850', 'weapon3': '3.148', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '67.000'} [2024-08-06 05:36:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 511549440. Throughput: 0: 4363.3. Samples: 127887810. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:36:32,794][52567] Avg episode reward: [(0, '72.460')] [2024-08-06 05:36:33,497][52794] DAMAGECOUNT value on done: 648200.0 [2024-08-06 05:36:33,508][52794] Sum rewards: 78.647, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.224', 'weapon4': '0.244', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '66.000'} [2024-08-06 05:36:34,202][52820] DAMAGECOUNT value on done: 596592.0 [2024-08-06 05:36:34,203][52820] Sum rewards: 72.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.102', 'weapon5': '0.140', 'AMMO4': '0.208', 'weapon2': '0.222', 'AMMO3': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:34,256][52659] DAMAGECOUNT value on done: 658443.0 [2024-08-06 05:36:34,257][52659] Sum rewards: 83.690, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.134', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.348', 'WEAPON3': '0.950', 'weapon3': '3.082', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '65.000'} [2024-08-06 05:36:34,416][52664] DAMAGECOUNT value on done: 678559.0 [2024-08-06 05:36:34,416][52664] Sum rewards: 73.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.180', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.062', 'AMMO4': '0.157', 'weapon5': '0.180', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '63.000'} [2024-08-06 05:36:34,830][52795] DAMAGECOUNT value on done: 609344.0 [2024-08-06 05:36:34,832][52795] Sum rewards: 75.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.925', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.020', 'AMMO4': '0.051', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.208', 'AMMO3': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.488', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '63.000'} [2024-08-06 05:36:35,144][52665] DAMAGECOUNT value on done: 641475.0 [2024-08-06 05:36:35,145][52665] Sum rewards: 65.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.332', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.562', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:35,201][52667] DAMAGECOUNT value on done: 650874.0 [2024-08-06 05:36:35,201][52667] Sum rewards: 77.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.822', 'AMMO5': '0.012', 'AMMO2': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.206', 'AMMO3': '0.215', 'weapon5': '0.226', 'AMMO4': '0.259', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:35,219][52650] Updated weights for policy 0, policy_version 62451 (0.0019) [2024-08-06 05:36:36,662][52794] DAMAGECOUNT value on done: 651750.0 [2024-08-06 05:36:36,665][52794] Sum rewards: 86.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.210', 'AMMO3': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.540', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '73.000'} [2024-08-06 05:36:36,794][52664] DAMAGECOUNT value on done: 679972.0 [2024-08-06 05:36:36,794][52664] Sum rewards: 82.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.004', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.108', 'weapon5': '0.156', 'AMMO3': '0.196', 'AMMO4': '0.271', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '67.000'} [2024-08-06 05:36:37,127][52659] DAMAGECOUNT value on done: 645925.0 [2024-08-06 05:36:37,129][52659] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.311', 'weapon2': '0.348', 'WEAPON3': '1.800', 'weapon3': '3.334', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:37,346][52820] DAMAGECOUNT value on done: 604521.0 [2024-08-06 05:36:37,347][52820] Sum rewards: 72.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.356', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.164', 'AMMO3': '0.176', 'weapon4': '0.202', 'AMMO4': '0.252', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 511639552. Throughput: 0: 4357.3. Samples: 127913990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:36:37,794][52567] Avg episode reward: [(0, '72.957')] [2024-08-06 05:36:37,886][52667] DAMAGECOUNT value on done: 658727.0 [2024-08-06 05:36:37,888][52667] Sum rewards: 67.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.102', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.208', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '57.000'} [2024-08-06 05:36:38,003][52795] DAMAGECOUNT value on done: 601177.0 [2024-08-06 05:36:38,003][52795] Sum rewards: 71.589, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.142', 'AMMO3': '0.215', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.356', 'weapon4': '0.372', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 05:36:38,287][52665] DAMAGECOUNT value on done: 655232.0 [2024-08-06 05:36:38,288][52665] Sum rewards: 79.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.026', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.188', 'weapon2': '0.452', 'WEAPON3': '1.150', 'weapon3': '3.318', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:39,742][52664] DAMAGECOUNT value on done: 679529.0 [2024-08-06 05:36:39,742][52650] Updated weights for policy 0, policy_version 62461 (0.0013) [2024-08-06 05:36:39,743][52664] Sum rewards: 73.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.632', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.197', 'weapon5': '0.230', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:39,809][52670] Large shaping reward 2.586 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon5', 0.002)] [2024-08-06 05:36:39,853][52794] DAMAGECOUNT value on done: 654625.0 [2024-08-06 05:36:39,855][52794] Sum rewards: 64.359, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.554', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.220', 'AMMO3': '0.222', 'weapon5': '0.250', 'AMMO4': '0.293', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:40,359][52659] DAMAGECOUNT value on done: 656621.0 [2024-08-06 05:36:40,359][52659] Sum rewards: 75.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'weapon4': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '63.000'} [2024-08-06 05:36:40,593][52820] DAMAGECOUNT value on done: 595936.0 [2024-08-06 05:36:40,596][52820] Sum rewards: 72.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.119', 'weapon5': '0.162', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:40,849][52665] DAMAGECOUNT value on done: 644285.0 [2024-08-06 05:36:40,849][52665] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.948', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO4': '0.217', 'weapon2': '0.220', 'weapon4': '0.232', 'weapon5': '0.258', 'AMMO3': '0.269', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 05:36:40,859][52667] DAMAGECOUNT value on done: 652771.0 [2024-08-06 05:36:40,862][52667] Sum rewards: 67.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.473', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.042', 'weapon5': '0.122', 'AMMO4': '0.162', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '54.000'} [2024-08-06 05:36:41,177][52795] DAMAGECOUNT value on done: 597373.0 [2024-08-06 05:36:41,177][52795] Sum rewards: 61.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.152', 'AMMO3': '0.234', 'AMMO4': '0.300', 'weapon2': '0.302', 'weapon5': '0.306', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '53.000'} [2024-08-06 05:36:42,417][52664] DAMAGECOUNT value on done: 681035.0 [2024-08-06 05:36:42,417][52664] Sum rewards: 79.739, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.298', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.038', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:42,549][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:36:42,698][52811] DAMAGECOUNT value on done: 622454.0 [2024-08-06 05:36:42,699][52811] Sum rewards: 73.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.075', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.034', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '60.500'} [2024-08-06 05:36:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.6, 300 sec: 17494.8). Total num frames: 511729664. Throughput: 0: 4358.4. Samples: 127940370. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:36:42,794][52567] Avg episode reward: [(0, '72.899')] [2024-08-06 05:36:43,072][52794] DAMAGECOUNT value on done: 642577.0 [2024-08-06 05:36:43,073][52794] Sum rewards: 59.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.606', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO3': '0.163', 'AMMO4': '0.166', 'weapon4': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '2.982', 'DAMAGECOUNT': '14.646', 'FRAGCOUNT': '48.000'} [2024-08-06 05:36:43,346][52659] DAMAGECOUNT value on done: 648929.0 [2024-08-06 05:36:43,348][52659] Sum rewards: 76.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.090', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:43,646][52667] DAMAGECOUNT value on done: 655614.0 [2024-08-06 05:36:43,646][52667] Sum rewards: 70.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.142', 'AMMO5': '0.025', 'AMMO2': '0.046', 'weapon4': '0.116', 'AMMO4': '0.230', 'AMMO3': '0.237', 'weapon5': '0.274', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '57.000'} [2024-08-06 05:36:43,820][52820] DAMAGECOUNT value on done: 603335.0 [2024-08-06 05:36:43,822][52820] Sum rewards: 74.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.296', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon4': '0.098', 'weapon5': '0.240', 'AMMO3': '0.248', 'weapon2': '0.298', 'AMMO4': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '63.000'} [2024-08-06 05:36:43,965][52665] DAMAGECOUNT value on done: 653250.0 [2024-08-06 05:36:43,967][52665] Sum rewards: 86.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.406', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.142', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.194', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.375', 'FRAGCOUNT': '72.000'} [2024-08-06 05:36:44,310][52795] DAMAGECOUNT value on done: 605677.0 [2024-08-06 05:36:44,310][52795] Sum rewards: 69.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.236', 'AMMO5': '0.022', 'AMMO2': '0.064', 'AMMO3': '0.165', 'weapon4': '0.186', 'weapon5': '0.238', 'weapon2': '0.298', 'AMMO4': '0.322', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.040', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '57.000'} [2024-08-06 05:36:44,438][52650] Updated weights for policy 0, policy_version 62471 (0.0011) [2024-08-06 05:36:44,886][52664] DAMAGECOUNT value on done: 684923.0 [2024-08-06 05:36:44,887][52664] Sum rewards: 79.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.054', 'AMMO4': '0.175', 'AMMO3': '0.215', 'weapon5': '0.246', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '65.000'} [2024-08-06 05:36:45,701][52811] DAMAGECOUNT value on done: 602360.0 [2024-08-06 05:36:45,702][52811] Sum rewards: 86.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.378', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.056', 'AMMO4': '0.164', 'weapon5': '0.190', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '72.000'} [2024-08-06 05:36:46,180][52794] DAMAGECOUNT value on done: 655754.0 [2024-08-06 05:36:46,182][52794] Sum rewards: 65.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.121', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'weapon4': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '55.000'} [2024-08-06 05:36:46,430][52659] DAMAGECOUNT value on done: 650305.0 [2024-08-06 05:36:46,431][52659] Sum rewards: 74.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.188', 'AMMO3': '0.196', 'weapon2': '0.212', 'AMMO4': '0.239', 'WEAPON5': '0.350', 'weapon4': '0.390', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:46,730][52667] DAMAGECOUNT value on done: 658470.0 [2024-08-06 05:36:46,730][52667] Sum rewards: 65.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.912', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.088', 'weapon5': '0.136', 'AMMO4': '0.171', 'AMMO3': '0.235', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.244', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '57.000'} [2024-08-06 05:36:46,740][52665] DAMAGECOUNT value on done: 648874.0 [2024-08-06 05:36:46,741][52665] Sum rewards: 76.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.135', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.122', 'AMMO4': '0.149', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 05:36:46,914][52820] DAMAGECOUNT value on done: 606836.0 [2024-08-06 05:36:46,917][52820] Sum rewards: 76.159, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.126', 'AMMO3': '0.154', 'AMMO4': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.266', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:47,221][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:36:47,271][52614] Signal inference workers to stop experience collection... (11350 times) [2024-08-06 05:36:47,271][52614] Signal inference workers to resume experience collection... (11350 times) [2024-08-06 05:36:47,352][52650] InferenceWorker_p0-w0: stopping experience collection (11350 times) [2024-08-06 05:36:47,352][52650] InferenceWorker_p0-w0: resuming experience collection (11350 times) [2024-08-06 05:36:47,481][52795] DAMAGECOUNT value on done: 602035.0 [2024-08-06 05:36:47,481][52795] Sum rewards: 57.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.904', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon4': '0.232', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '49.000'} [2024-08-06 05:36:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 511819776. Throughput: 0: 4361.8. Samples: 127953670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:36:47,794][52567] Avg episode reward: [(0, '72.890')] [2024-08-06 05:36:47,855][52664] DAMAGECOUNT value on done: 675810.0 [2024-08-06 05:36:47,859][52664] Sum rewards: 83.239, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.142', 'AMMO4': '0.202', 'AMMO3': '0.249', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '70.000'} [2024-08-06 05:36:48,797][52811] DAMAGECOUNT value on done: 601861.0 [2024-08-06 05:36:48,799][52811] Sum rewards: 62.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.350', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon5': '0.178', 'AMMO4': '0.200', 'weapon4': '0.204', 'AMMO3': '0.213', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '54.000'} [2024-08-06 05:36:49,002][52650] Updated weights for policy 0, policy_version 62481 (0.0030) [2024-08-06 05:36:49,138][52659] DAMAGECOUNT value on done: 660959.0 [2024-08-06 05:36:49,139][52659] Sum rewards: 67.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.054', 'weapon5': '0.080', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.522', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '60.500'} [2024-08-06 05:36:49,139][52794] DAMAGECOUNT value on done: 648078.0 [2024-08-06 05:36:49,141][52794] Sum rewards: 63.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.711', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '52.000'} [2024-08-06 05:36:49,439][52667] DAMAGECOUNT value on done: 661065.0 [2024-08-06 05:36:49,440][52667] Sum rewards: 62.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.268', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon4': '0.194', 'weapon5': '0.204', 'AMMO3': '0.222', 'weapon2': '0.312', 'AMMO4': '0.333', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '53.000'} [2024-08-06 05:36:49,561][52665] DAMAGECOUNT value on done: 647059.0 [2024-08-06 05:36:49,562][52665] Sum rewards: 66.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.956', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.150', 'AMMO4': '0.168', 'weapon5': '0.224', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '55.500'} [2024-08-06 05:36:50,221][52820] DAMAGECOUNT value on done: 602048.0 [2024-08-06 05:36:50,234][52820] Sum rewards: 68.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.495', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon7': '0.064', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.164', 'AMMO3': '0.211', 'weapon2': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 05:36:50,654][52795] DAMAGECOUNT value on done: 596927.0 [2024-08-06 05:36:50,655][52795] Sum rewards: 57.332, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.708', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.046', 'weapon5': '0.056', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.252', 'AMMO3': '0.316', 'WEAPON3': '1.850', 'HITCOUNT': '3.160', 'weapon3': '3.380', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '53.000'} [2024-08-06 05:36:50,861][52664] DAMAGECOUNT value on done: 671810.0 [2024-08-06 05:36:50,863][52664] Sum rewards: 70.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.104', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.102', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2024-08-06 05:36:51,894][52811] DAMAGECOUNT value on done: 603695.0 [2024-08-06 05:36:51,895][52811] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.215', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.312', 'WEAPON3': '1.550', 'weapon3': '3.388', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:51,909][52794] DAMAGECOUNT value on done: 645524.0 [2024-08-06 05:36:51,912][52794] Sum rewards: 73.683, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.760', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.164', 'AMMO4': '0.184', 'AMMO3': '0.187', 'weapon5': '0.240', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '59.500'} [2024-08-06 05:36:52,113][52659] DAMAGECOUNT value on done: 654038.0 [2024-08-06 05:36:52,114][52659] Sum rewards: 74.963, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.138', 'weapon5': '0.140', 'AMMO4': '0.146', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON3': '0.850', 'weapon3': '2.996', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 05:36:52,349][52667] DAMAGECOUNT value on done: 654612.0 [2024-08-06 05:36:52,353][52667] Sum rewards: 76.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.629', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.104', 'AMMO4': '0.174', 'weapon2': '0.182', 'AMMO3': '0.194', 'weapon5': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.298', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:52,455][52665] DAMAGECOUNT value on done: 642913.0 [2024-08-06 05:36:52,478][52665] Sum rewards: 64.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.616', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.186', 'weapon4': '0.192', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.700', 'weapon3': '2.930', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:52,795][52567] Fps is (10 sec: 16382.2, 60 sec: 17339.4, 300 sec: 17466.9). Total num frames: 511893504. Throughput: 0: 4359.4. Samples: 127979670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:36:52,796][52567] Avg episode reward: [(0, '72.351')] [2024-08-06 05:36:53,454][52820] DAMAGECOUNT value on done: 608782.0 [2024-08-06 05:36:53,454][52820] Sum rewards: 73.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.246', 'weapon4': '0.258', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.000'} [2024-08-06 05:36:53,800][52664] DAMAGECOUNT value on done: 674979.0 [2024-08-06 05:36:53,801][52664] Sum rewards: 63.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.330', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.286', 'weapon5': '0.304', 'weapon4': '0.406', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '53.000'} [2024-08-06 05:36:53,922][52795] DAMAGECOUNT value on done: 597502.0 [2024-08-06 05:36:53,923][52795] Sum rewards: 79.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.322', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.127', 'weapon5': '0.172', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '65.000'} [2024-08-06 05:36:53,953][52650] Updated weights for policy 0, policy_version 62491 (0.0033) [2024-08-06 05:36:54,856][52794] DAMAGECOUNT value on done: 651838.0 [2024-08-06 05:36:54,856][52794] Sum rewards: 70.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.521', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.082', 'AMMO3': '0.217', 'weapon5': '0.242', 'AMMO4': '0.245', 'weapon2': '0.262', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.106', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '57.500'} [2024-08-06 05:36:54,921][52659] DAMAGECOUNT value on done: 659247.0 [2024-08-06 05:36:54,925][52659] Sum rewards: 77.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.032', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.046', 'weapon5': '0.098', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '63.000'} [2024-08-06 05:36:55,012][52811] DAMAGECOUNT value on done: 610990.0 [2024-08-06 05:36:55,012][52811] Sum rewards: 78.804, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.755', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:55,162][52667] DAMAGECOUNT value on done: 654602.0 [2024-08-06 05:36:55,164][52667] Sum rewards: 67.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.334', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.098', 'AMMO4': '0.145', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '54.000'} [2024-08-06 05:36:55,370][52665] DAMAGECOUNT value on done: 643918.0 [2024-08-06 05:36:55,371][52665] Sum rewards: 80.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.280', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.132', 'AMMO3': '0.180', 'weapon5': '0.260', 'AMMO4': '0.274', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '64.000'} [2024-08-06 05:36:56,633][52820] DAMAGECOUNT value on done: 599890.0 [2024-08-06 05:36:56,633][52820] Sum rewards: 75.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.708', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.262', 'WEAPON3': '1.300', 'HITCOUNT': '3.370', 'weapon3': '3.482', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '62.000'} [2024-08-06 05:36:56,752][52664] DAMAGECOUNT value on done: 676930.0 [2024-08-06 05:36:56,754][52664] Sum rewards: 78.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.832', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.154', 'weapon5': '0.182', 'weapon4': '0.222', 'AMMO4': '0.249', 'weapon2': '0.266', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '65.000'} [2024-08-06 05:36:57,032][52795] DAMAGECOUNT value on done: 604588.0 [2024-08-06 05:36:57,033][52795] Sum rewards: 80.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.016', 'weapon4': '0.018', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.510', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '65.000'} [2024-08-06 05:36:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 511991808. Throughput: 0: 4359.1. Samples: 128005770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:36:57,794][52567] Avg episode reward: [(0, '72.929')] [2024-08-06 05:36:57,825][52794] DAMAGECOUNT value on done: 646802.0 [2024-08-06 05:36:57,827][52794] Sum rewards: 84.637, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.000', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.032', 'AMMO4': '0.143', 'weapon5': '0.160', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '70.000'} [2024-08-06 05:36:58,044][52811] DAMAGECOUNT value on done: 616284.0 [2024-08-06 05:36:58,046][52811] Sum rewards: 75.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.332', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.152', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:58,137][52659] DAMAGECOUNT value on done: 648891.0 [2024-08-06 05:36:58,142][52659] Sum rewards: 65.073, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.735', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.124', 'weapon4': '0.144', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '58.000'} [2024-08-06 05:36:58,210][52667] DAMAGECOUNT value on done: 657463.0 [2024-08-06 05:36:58,212][52667] Sum rewards: 62.196, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.258', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.072', 'weapon5': '0.162', 'AMMO4': '0.191', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '54.000'} [2024-08-06 05:36:58,496][52665] DAMAGECOUNT value on done: 643054.0 [2024-08-06 05:36:58,496][52665] Sum rewards: 64.789, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.444', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.118', 'weapon5': '0.122', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.318', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '56.000'} [2024-08-06 05:36:58,734][52650] Updated weights for policy 0, policy_version 62501 (0.0026) [2024-08-06 05:36:59,492][52664] DAMAGECOUNT value on done: 674150.0 [2024-08-06 05:36:59,493][52664] Sum rewards: 75.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.187', 'AMMO4': '0.216', 'weapon2': '0.216', 'weapon5': '0.242', 'weapon4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.000'} [2024-08-06 05:36:59,825][52820] DAMAGECOUNT value on done: 606165.0 [2024-08-06 05:36:59,827][52820] Sum rewards: 72.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.335', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.078', 'AMMO3': '0.203', 'AMMO4': '0.234', 'weapon5': '0.234', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:00,310][52795] DAMAGECOUNT value on done: 592387.0 [2024-08-06 05:37:00,310][52795] Sum rewards: 79.078, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.152', 'weapon4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.278', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.050', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.814', 'FRAGCOUNT': '67.500'} [2024-08-06 05:37:00,576][52794] DAMAGECOUNT value on done: 663386.0 [2024-08-06 05:37:00,577][52794] Sum rewards: 70.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.972', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.100', 'weapon5': '0.174', 'AMMO3': '0.235', 'AMMO4': '0.238', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:00,932][52667] DAMAGECOUNT value on done: 662350.0 [2024-08-06 05:37:00,934][52667] Sum rewards: 81.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.112', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.181', 'AMMO4': '0.186', 'weapon5': '0.204', 'weapon4': '0.316', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:01,098][52659] DAMAGECOUNT value on done: 658211.0 [2024-08-06 05:37:01,100][52659] Sum rewards: 73.098, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.585', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.128', 'AMMO4': '0.211', 'weapon2': '0.240', 'weapon5': '0.252', 'AMMO3': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.984', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:01,146][52811] DAMAGECOUNT value on done: 612357.0 [2024-08-06 05:37:01,146][52811] Sum rewards: 79.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.038', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.242', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.382', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:01,777][52665] DAMAGECOUNT value on done: 642248.0 [2024-08-06 05:37:01,779][52665] Sum rewards: 67.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.162', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.304', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.324', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:02,794][52567] Fps is (10 sec: 18843.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 512081920. Throughput: 0: 4361.8. Samples: 128018910. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:02,794][52567] Avg episode reward: [(0, '72.808')] [2024-08-06 05:37:03,065][52820] DAMAGECOUNT value on done: 612385.0 [2024-08-06 05:37:03,065][52820] Sum rewards: 75.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.322', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.120', 'AMMO4': '0.201', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:03,183][52650] Updated weights for policy 0, policy_version 62511 (0.0014) [2024-08-06 05:37:03,211][52794] DAMAGECOUNT value on done: 647369.0 [2024-08-06 05:37:03,212][52794] Sum rewards: 85.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.086', 'AMMO4': '0.220', 'weapon5': '0.224', 'weapon2': '0.232', 'AMMO3': '0.241', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '71.000'} [2024-08-06 05:37:03,428][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:37:03,480][52795] DAMAGECOUNT value on done: 609065.0 [2024-08-06 05:37:03,480][52795] Sum rewards: 78.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon5': '0.148', 'AMMO3': '0.211', 'weapon2': '0.636', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:03,727][52659] DAMAGECOUNT value on done: 650899.0 [2024-08-06 05:37:03,727][52659] Sum rewards: 78.025, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.178', 'weapon2': '0.240', 'weapon4': '0.244', 'AMMO4': '0.253', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:04,103][52667] DAMAGECOUNT value on done: 649835.0 [2024-08-06 05:37:04,103][52667] Sum rewards: 73.682, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.185', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:04,147][52811] DAMAGECOUNT value on done: 604014.0 [2024-08-06 05:37:04,148][52811] Sum rewards: 80.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.420', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.092', 'AMMO4': '0.111', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:04,730][52665] DAMAGECOUNT value on done: 637638.0 [2024-08-06 05:37:04,730][52665] Sum rewards: 67.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.121', 'weapon4': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.276', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:06,128][52794] DAMAGECOUNT value on done: 661036.0 [2024-08-06 05:37:06,139][52794] Sum rewards: 74.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.823', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.148', 'weapon4': '0.156', 'AMMO3': '0.166', 'AMMO4': '0.192', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:06,294][52820] DAMAGECOUNT value on done: 606720.0 [2024-08-06 05:37:06,298][52820] Sum rewards: 67.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.161', 'weapon5': '0.168', 'weapon4': '0.190', 'AMMO4': '0.209', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '54.000'} [2024-08-06 05:37:06,385][52663] DAMAGECOUNT value on done: 661492.0 [2024-08-06 05:37:06,387][52663] Sum rewards: 74.173, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.694', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.114', 'weapon5': '0.156', 'AMMO3': '0.219', 'weapon2': '0.240', 'AMMO4': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.500'} [2024-08-06 05:37:06,655][52795] DAMAGECOUNT value on done: 603450.0 [2024-08-06 05:37:06,656][52795] Sum rewards: 77.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.625', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.052', 'AMMO4': '0.156', 'weapon4': '0.182', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:06,680][52667] DAMAGECOUNT value on done: 651405.0 [2024-08-06 05:37:06,680][52667] Sum rewards: 72.985, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.902', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.158', 'AMMO4': '0.174', 'weapon2': '0.228', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.258', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:07,267][52811] DAMAGECOUNT value on done: 617789.0 [2024-08-06 05:37:07,269][52811] Sum rewards: 74.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.022', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.064', 'AMMO4': '0.075', 'weapon5': '0.100', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:07,638][52665] DAMAGECOUNT value on done: 643151.0 [2024-08-06 05:37:07,639][52665] Sum rewards: 80.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.204', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 512163840. Throughput: 0: 4360.2. Samples: 128045080. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:07,794][52567] Avg episode reward: [(0, '73.331')] [2024-08-06 05:37:07,833][52650] Updated weights for policy 0, policy_version 62521 (0.0014) [2024-08-06 05:37:08,171][52665] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:37:08,937][52794] DAMAGECOUNT value on done: 654516.0 [2024-08-06 05:37:08,940][52794] Sum rewards: 72.968, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.147', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.110', 'AMMO4': '0.242', 'AMMO3': '0.276', 'weapon5': '0.284', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.964', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '63.000'} [2024-08-06 05:37:09,323][52663] DAMAGECOUNT value on done: 653445.0 [2024-08-06 05:37:09,323][52663] Sum rewards: 80.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:09,369][52820] DAMAGECOUNT value on done: 611169.0 [2024-08-06 05:37:09,371][52820] Sum rewards: 81.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon4': '0.074', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.378', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '68.000'} [2024-08-06 05:37:09,567][52667] DAMAGECOUNT value on done: 657725.0 [2024-08-06 05:37:09,567][52667] Sum rewards: 68.229, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.076', 'weapon5': '0.160', 'AMMO4': '0.165', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:09,734][52795] DAMAGECOUNT value on done: 597049.0 [2024-08-06 05:37:09,737][52795] Sum rewards: 67.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.100', 'weapon5': '0.122', 'AMMO4': '0.187', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:10,261][52811] DAMAGECOUNT value on done: 609311.0 [2024-08-06 05:37:10,262][52811] Sum rewards: 86.445, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO3': '0.142', 'AMMO4': '0.146', 'weapon4': '0.150', 'HEALTH': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '0.850', 'weapon3': '3.038', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:10,598][52665] DAMAGECOUNT value on done: 647683.0 [2024-08-06 05:37:10,599][52665] Sum rewards: 80.026, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.088', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.470', 'HEALTH': '0.590', 'WEAPON3': '1.000', 'weapon3': '3.222', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '63.000'} [2024-08-06 05:37:11,909][52794] DAMAGECOUNT value on done: 659514.0 [2024-08-06 05:37:11,912][52794] Sum rewards: 68.885, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.543', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.140', 'AMMO3': '0.175', 'AMMO4': '0.244', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '54.000'} [2024-08-06 05:37:12,405][52820] DAMAGECOUNT value on done: 605353.0 [2024-08-06 05:37:12,408][52820] Sum rewards: 65.046, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.270', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.134', 'AMMO4': '0.179', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '55.000'} [2024-08-06 05:37:12,520][52663] DAMAGECOUNT value on done: 644661.0 [2024-08-06 05:37:12,521][52663] Sum rewards: 80.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.154', 'AMMO4': '0.212', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:12,667][52667] DAMAGECOUNT value on done: 648295.0 [2024-08-06 05:37:12,669][52667] Sum rewards: 80.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.655', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 512245760. Throughput: 0: 4364.9. Samples: 128071340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:12,794][52567] Avg episode reward: [(0, '73.431')] [2024-08-06 05:37:12,799][52795] DAMAGECOUNT value on done: 604692.0 [2024-08-06 05:37:12,799][52795] Sum rewards: 71.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.202', 'weapon2': '0.218', 'weapon5': '0.220', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:12,905][52650] Updated weights for policy 0, policy_version 62531 (0.0012) [2024-08-06 05:37:13,286][52811] DAMAGECOUNT value on done: 613113.0 [2024-08-06 05:37:13,286][52811] Sum rewards: 80.410, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.735', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'weapon2': '0.188', 'AMMO3': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.440', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '69.000'} [2024-08-06 05:37:14,976][52794] DAMAGECOUNT value on done: 661716.0 [2024-08-06 05:37:14,978][52794] Sum rewards: 67.114, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon2': '0.188', 'weapon5': '0.198', 'AMMO4': '0.217', 'AMMO3': '0.218', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '55.000'} [2024-08-06 05:37:15,606][52663] DAMAGECOUNT value on done: 650417.0 [2024-08-06 05:37:15,607][52663] Sum rewards: 70.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.032', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:15,624][52667] DAMAGECOUNT value on done: 656541.0 [2024-08-06 05:37:15,625][52667] Sum rewards: 53.685, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.926', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.118', 'weapon4': '0.162', 'AMMO3': '0.168', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.000', 'HITCOUNT': '2.730', 'weapon3': '2.940', 'DAMAGECOUNT': '13.596', 'FRAGCOUNT': '43.000'} [2024-08-06 05:37:15,650][52820] DAMAGECOUNT value on done: 606777.0 [2024-08-06 05:37:15,650][52820] Sum rewards: 68.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.877', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.169', 'weapon5': '0.234', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '55.000'} [2024-08-06 05:37:15,940][52795] DAMAGECOUNT value on done: 610627.0 [2024-08-06 05:37:15,940][52795] Sum rewards: 76.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.378', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.128', 'weapon5': '0.140', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:16,415][52811] DAMAGECOUNT value on done: 616574.0 [2024-08-06 05:37:16,415][52811] Sum rewards: 67.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.405', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.242', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:17,217][52650] Updated weights for policy 0, policy_version 62541 (0.0042) [2024-08-06 05:37:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 512335872. Throughput: 0: 4368.2. Samples: 128084380. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:17,794][52567] Avg episode reward: [(0, '72.863')] [2024-08-06 05:37:18,009][52794] DAMAGECOUNT value on done: 653685.0 [2024-08-06 05:37:18,011][52794] Sum rewards: 70.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.960', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.143', 'weapon5': '0.180', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:18,142][52667] DAMAGECOUNT value on done: 664286.0 [2024-08-06 05:37:18,142][52667] Sum rewards: 76.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.135', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.134', 'weapon4': '0.134', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:18,618][52663] DAMAGECOUNT value on done: 654370.0 [2024-08-06 05:37:18,618][52663] Sum rewards: 63.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.428', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.190', 'AMMO3': '0.225', 'AMMO4': '0.276', 'weapon4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '55.000'} [2024-08-06 05:37:18,895][52820] DAMAGECOUNT value on done: 618306.0 [2024-08-06 05:37:18,895][52820] Sum rewards: 90.296, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.350', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.088', 'weapon2': '0.124', 'AMMO4': '0.142', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'weapon3': '3.576', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '72.000'} [2024-08-06 05:37:19,473][52811] DAMAGECOUNT value on done: 608767.0 [2024-08-06 05:37:19,475][52811] Sum rewards: 76.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.060', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.099', 'weapon5': '0.134', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'WEAPON3': '1.750', 'weapon3': '3.410', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:20,982][52803] DAMAGECOUNT value on done: 607394.0 [2024-08-06 05:37:20,983][52803] Sum rewards: 72.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.253', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.144', 'weapon2': '0.166', 'AMMO4': '0.173', 'weapon4': '0.176', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:21,012][52667] DAMAGECOUNT value on done: 660363.0 [2024-08-06 05:37:21,014][52667] Sum rewards: 70.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.086', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.212', 'weapon4': '0.220', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.320', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:21,742][52663] DAMAGECOUNT value on done: 661555.0 [2024-08-06 05:37:21,743][52663] Sum rewards: 68.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.584', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.162', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'weapon5': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:21,933][52650] Updated weights for policy 0, policy_version 62551 (0.0041) [2024-08-06 05:37:22,009][52820] DAMAGECOUNT value on done: 615707.0 [2024-08-06 05:37:22,015][52820] Sum rewards: 71.192, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.171', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '3.238', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:22,154][52670] DAMAGECOUNT value on done: 643920.0 [2024-08-06 05:37:22,156][52670] Sum rewards: 73.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.114', 'weapon5': '0.140', 'AMMO4': '0.201', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:22,444][52666] DAMAGECOUNT value on done: 652885.0 [2024-08-06 05:37:22,444][52666] Sum rewards: 79.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.782', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.220', 'AMMO3': '0.229', 'AMMO4': '0.245', 'weapon5': '0.382', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.688', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:22,618][52811] DAMAGECOUNT value on done: 604594.0 [2024-08-06 05:37:22,620][52811] Sum rewards: 79.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.700', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.700', 'weapon3': '3.392', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 512425984. Throughput: 0: 4368.0. Samples: 128110550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:22,794][52567] Avg episode reward: [(0, '73.162')] [2024-08-06 05:37:23,337][52667] DAMAGECOUNT value on done: 661645.0 [2024-08-06 05:37:23,339][52667] Sum rewards: 75.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.070', 'weapon5': '0.096', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.410', 'weapon3': '3.458', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:23,438][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:37:24,150][52803] DAMAGECOUNT value on done: 607368.0 [2024-08-06 05:37:24,152][52803] Sum rewards: 78.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.020', 'AMMO2': '0.070', 'weapon4': '0.152', 'AMMO3': '0.158', 'weapon5': '0.204', 'AMMO4': '0.348', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '3.018', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '62.500'} [2024-08-06 05:37:24,661][52670] DAMAGECOUNT value on done: 654637.0 [2024-08-06 05:37:24,662][52670] Sum rewards: 71.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.118', 'weapon4': '0.156', 'AMMO4': '0.171', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:24,966][52666] DAMAGECOUNT value on done: 652961.0 [2024-08-06 05:37:24,967][52666] Sum rewards: 70.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.865', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO4': '0.137', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.428', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:24,974][52663] DAMAGECOUNT value on done: 650047.0 [2024-08-06 05:37:24,974][52663] Sum rewards: 71.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.045', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.143', 'weapon5': '0.198', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:25,167][52820] DAMAGECOUNT value on done: 602237.0 [2024-08-06 05:37:25,170][52820] Sum rewards: 82.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.180', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.440', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '69.000'} [2024-08-06 05:37:25,824][52811] DAMAGECOUNT value on done: 607145.0 [2024-08-06 05:37:25,828][52811] Sum rewards: 74.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.714', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '63.500'} [2024-08-06 05:37:26,516][52667] DAMAGECOUNT value on done: 653010.0 [2024-08-06 05:37:26,516][52667] Sum rewards: 62.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.118', 'AMMO4': '0.159', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon5': '0.452', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.564', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '53.000'} [2024-08-06 05:37:26,819][52650] Updated weights for policy 0, policy_version 62561 (0.0032) [2024-08-06 05:37:26,972][52668] Large shaping reward 2.572 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.06, -20.0), ('weapon5', 0.002)] [2024-08-06 05:37:27,147][52662] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:37:27,373][52670] DAMAGECOUNT value on done: 644368.0 [2024-08-06 05:37:27,373][52670] Sum rewards: 74.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.455', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.156', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.370', 'WEAPON3': '1.400', 'weapon3': '2.954', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:27,469][52803] DAMAGECOUNT value on done: 613255.0 [2024-08-06 05:37:27,471][52803] Sum rewards: 73.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.286', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.122', 'AMMO3': '0.238', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:27,718][52663] DAMAGECOUNT value on done: 643604.0 [2024-08-06 05:37:27,719][52663] Sum rewards: 72.364, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.285', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.174', 'weapon2': '0.186', 'weapon4': '0.202', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:27,770][52666] DAMAGECOUNT value on done: 652994.0 [2024-08-06 05:37:27,771][52666] Sum rewards: 71.374, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 512516096. Throughput: 0: 4357.6. Samples: 128136460. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:27,794][52567] Avg episode reward: [(0, '73.056')] [2024-08-06 05:37:28,894][52811] DAMAGECOUNT value on done: 606912.0 [2024-08-06 05:37:28,894][52811] Sum rewards: 75.781, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.470', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.104', 'AMMO3': '0.161', 'AMMO4': '0.199', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '60.500'} [2024-08-06 05:37:29,303][52667] DAMAGECOUNT value on done: 661610.0 [2024-08-06 05:37:29,304][52667] Sum rewards: 69.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.840', 'AMMO5': '0.018', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.115', 'AMMO3': '0.207', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:29,870][52660] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:37:30,057][52670] DAMAGECOUNT value on done: 642247.0 [2024-08-06 05:37:30,057][52670] Sum rewards: 82.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.630', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.044', 'AMMO4': '0.103', 'weapon5': '0.128', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON3': '1.150', 'weapon3': '3.394', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:30,320][52666] DAMAGECOUNT value on done: 653793.0 [2024-08-06 05:37:30,320][52666] Sum rewards: 83.598, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.730', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.153', 'weapon2': '0.218', 'AMMO4': '0.226', 'weapon5': '0.284', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.768', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:30,709][52803] DAMAGECOUNT value on done: 614341.0 [2024-08-06 05:37:30,712][52803] Sum rewards: 73.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.140', 'weapon4': '0.182', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:30,884][52663] DAMAGECOUNT value on done: 646059.0 [2024-08-06 05:37:30,885][52663] Sum rewards: 84.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.136', 'AMMO3': '0.212', 'weapon4': '0.254', 'AMMO4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '70.000'} [2024-08-06 05:37:31,183][52647] DAMAGECOUNT value on done: 692112.0 [2024-08-06 05:37:31,183][52647] Sum rewards: 66.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.235', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.118', 'AMMO3': '0.151', 'weapon5': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '53.500'} [2024-08-06 05:37:31,350][52650] Updated weights for policy 0, policy_version 62571 (0.0023) [2024-08-06 05:37:32,164][52811] DAMAGECOUNT value on done: 611387.0 [2024-08-06 05:37:32,164][52811] Sum rewards: 86.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'weapon5': '0.018', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO4': '0.148', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON3': '1.350', 'weapon3': '3.550', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '72.000'} [2024-08-06 05:37:32,547][52670] DAMAGECOUNT value on done: 654594.0 [2024-08-06 05:37:32,549][52670] Sum rewards: 65.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.615', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.128', 'AMMO4': '0.204', 'weapon5': '0.208', 'AMMO3': '0.230', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:32,753][52666] DAMAGECOUNT value on done: 646024.0 [2024-08-06 05:37:32,754][52666] Sum rewards: 71.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.114', 'AMMO3': '0.203', 'weapon4': '0.220', 'AMMO4': '0.242', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 512598016. Throughput: 0: 4352.4. Samples: 128149530. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:32,794][52567] Avg episode reward: [(0, '73.723')] [2024-08-06 05:37:33,805][52663] DAMAGECOUNT value on done: 650148.0 [2024-08-06 05:37:33,805][52663] Sum rewards: 84.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.814', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.140', 'weapon5': '0.182', 'AMMO4': '0.223', 'weapon2': '0.224', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.691', 'FRAGCOUNT': '71.000'} [2024-08-06 05:37:33,921][52803] DAMAGECOUNT value on done: 611507.0 [2024-08-06 05:37:33,921][52803] Sum rewards: 76.997, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.082', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'weapon3': '3.406', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '63.000'} [2024-08-06 05:37:34,259][52647] DAMAGECOUNT value on done: 685932.0 [2024-08-06 05:37:34,260][52647] Sum rewards: 66.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.429', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.046', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:35,277][52811] DAMAGECOUNT value on done: 616959.0 [2024-08-06 05:37:35,277][52811] Sum rewards: 76.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.604', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:35,411][52670] DAMAGECOUNT value on done: 649333.0 [2024-08-06 05:37:35,414][52670] Sum rewards: 64.597, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.985', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.168', 'weapon4': '0.186', 'AMMO3': '0.240', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:35,686][52658] DAMAGECOUNT value on done: 654132.0 [2024-08-06 05:37:35,686][52658] Sum rewards: 78.521, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.293', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '70.000'} [2024-08-06 05:37:35,692][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:37:35,760][52666] DAMAGECOUNT value on done: 647118.0 [2024-08-06 05:37:35,767][52666] Sum rewards: 71.776, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.802', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.088', 'weapon5': '0.164', 'AMMO4': '0.182', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.182', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:35,909][52669] DAMAGECOUNT value on done: 655869.0 [2024-08-06 05:37:35,910][52669] Sum rewards: 73.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.628', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.062', 'AMMO4': '0.153', 'weapon5': '0.182', 'AMMO3': '0.226', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.260', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:36,093][52650] Updated weights for policy 0, policy_version 62581 (0.0028) [2024-08-06 05:37:36,483][52663] DAMAGECOUNT value on done: 659049.0 [2024-08-06 05:37:36,483][52663] Sum rewards: 73.370, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.188', 'weapon5': '0.214', 'weapon2': '0.238', 'AMMO3': '0.257', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.096', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:36,707][52647] DAMAGECOUNT value on done: 689564.0 [2024-08-06 05:37:36,709][52647] Sum rewards: 59.241, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.762', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon2': '0.238', 'AMMO4': '0.277', 'weapon4': '0.284', 'AMMO3': '0.288', 'weapon5': '0.342', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.742', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '51.000'} [2024-08-06 05:37:37,170][52803] DAMAGECOUNT value on done: 602848.0 [2024-08-06 05:37:37,176][52803] Sum rewards: 60.394, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.416', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.138', 'weapon4': '0.224', 'WEAPON4': '0.250', 'AMMO4': '0.274', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.800', 'weapon3': '2.972', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '53.500'} [2024-08-06 05:37:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 512688128. Throughput: 0: 4359.2. Samples: 128175830. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:37:37,794][52567] Avg episode reward: [(0, '74.050')] [2024-08-06 05:37:37,972][52670] DAMAGECOUNT value on done: 640862.0 [2024-08-06 05:37:37,974][52670] Sum rewards: 80.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.172', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.122', 'AMMO4': '0.177', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '68.000'} [2024-08-06 05:37:38,188][52666] DAMAGECOUNT value on done: 648348.0 [2024-08-06 05:37:38,188][52666] Sum rewards: 63.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.154', 'AMMO3': '0.168', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '52.000'} [2024-08-06 05:37:38,496][52811] DAMAGECOUNT value on done: 610802.0 [2024-08-06 05:37:38,498][52811] Sum rewards: 82.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.851', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.117', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:38,806][52669] DAMAGECOUNT value on done: 646421.0 [2024-08-06 05:37:38,808][52669] Sum rewards: 72.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.110', 'AMMO3': '0.219', 'AMMO4': '0.244', 'weapon5': '0.246', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:38,817][52658] DAMAGECOUNT value on done: 653880.0 [2024-08-06 05:37:38,817][52658] Sum rewards: 75.584, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.096', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.134', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.000', 'weapon3': '3.352', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:38,899][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:37:39,216][52663] DAMAGECOUNT value on done: 645985.0 [2024-08-06 05:37:39,216][52663] Sum rewards: 71.172, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.770', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'weapon4': '0.256', 'AMMO3': '0.280', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.032', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '63.000'} [2024-08-06 05:37:39,373][52647] DAMAGECOUNT value on done: 688521.0 [2024-08-06 05:37:39,375][52647] Sum rewards: 79.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.281', 'weapon2': '0.402', 'WEAPON3': '1.650', 'weapon3': '3.314', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '69.000'} [2024-08-06 05:37:40,278][52803] DAMAGECOUNT value on done: 602739.0 [2024-08-06 05:37:40,280][52803] Sum rewards: 72.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.026', 'weapon5': '0.046', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:40,699][52670] DAMAGECOUNT value on done: 646815.0 [2024-08-06 05:37:40,700][52670] Sum rewards: 72.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.803', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.068', 'weapon4': '0.108', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:40,946][52650] Updated weights for policy 0, policy_version 62591 (0.0019) [2024-08-06 05:37:41,063][52666] DAMAGECOUNT value on done: 646221.0 [2024-08-06 05:37:41,065][52666] Sum rewards: 75.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.450', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.241', 'weapon2': '0.466', 'WEAPON3': '1.600', 'weapon3': '3.330', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:41,617][52669] DAMAGECOUNT value on done: 658163.0 [2024-08-06 05:37:41,618][52669] Sum rewards: 69.375, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.105', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.846', 'WEAPON3': '0.900', 'weapon3': '2.898', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '54.000'} [2024-08-06 05:37:41,659][52811] DAMAGECOUNT value on done: 608298.0 [2024-08-06 05:37:41,660][52811] Sum rewards: 80.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.038', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:41,798][52647] DAMAGECOUNT value on done: 698330.0 [2024-08-06 05:37:41,799][52647] Sum rewards: 63.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.144', 'weapon5': '0.234', 'AMMO3': '0.250', 'AMMO4': '0.257', 'weapon2': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '3.018', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2024-08-06 05:37:41,980][52658] DAMAGECOUNT value on done: 657622.0 [2024-08-06 05:37:41,980][52658] Sum rewards: 66.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.364', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.139', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '54.000'} [2024-08-06 05:37:41,989][52663] DAMAGECOUNT value on done: 642975.0 [2024-08-06 05:37:41,990][52663] Sum rewards: 79.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.085', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.124', 'weapon5': '0.132', 'AMMO4': '0.147', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 512778240. Throughput: 0: 4362.7. Samples: 128202090. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:37:42,794][52567] Avg episode reward: [(0, '73.950')] [2024-08-06 05:37:43,368][52803] DAMAGECOUNT value on done: 601533.0 [2024-08-06 05:37:43,369][52803] Sum rewards: 71.447, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.187', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.230', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:44,152][52670] DAMAGECOUNT value on done: 645380.0 [2024-08-06 05:37:44,153][52670] Sum rewards: 78.608, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.792', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.128', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '61.500'} [2024-08-06 05:37:44,228][52647] DAMAGECOUNT value on done: 694305.0 [2024-08-06 05:37:44,229][52647] Sum rewards: 67.223, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.033', 'AMMO5': '0.029', 'AMMO2': '0.074', 'AMMO3': '0.165', 'weapon4': '0.306', 'weapon5': '0.316', 'weapon2': '0.344', 'AMMO4': '0.370', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.050', 'weapon3': '2.808', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '53.000'} [2024-08-06 05:37:44,252][52669] DAMAGECOUNT value on done: 655601.0 [2024-08-06 05:37:44,252][52669] Sum rewards: 75.105, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.125', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon4': '0.194', 'weapon2': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:44,500][52666] DAMAGECOUNT value on done: 651395.0 [2024-08-06 05:37:44,501][52666] Sum rewards: 84.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.020', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.166', 'AMMO3': '0.177', 'weapon4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:44,671][52663] DAMAGECOUNT value on done: 647740.0 [2024-08-06 05:37:44,673][52663] Sum rewards: 78.846, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '67.000'} [2024-08-06 05:37:44,932][52671] DAMAGECOUNT value on done: 657122.0 [2024-08-06 05:37:44,933][52671] Sum rewards: 72.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.136', 'AMMO4': '0.145', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:44,984][52658] DAMAGECOUNT value on done: 656749.0 [2024-08-06 05:37:44,984][52658] Sum rewards: 83.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.114', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.434', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '70.000'} [2024-08-06 05:37:45,300][52650] Updated weights for policy 0, policy_version 62601 (0.0024) [2024-08-06 05:37:45,758][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:37:46,409][52803] DAMAGECOUNT value on done: 606514.0 [2024-08-06 05:37:46,411][52803] Sum rewards: 81.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.464', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.178', 'AMMO4': '0.190', 'weapon2': '0.224', 'AMMO3': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '69.000'} [2024-08-06 05:37:46,701][52647] DAMAGECOUNT value on done: 691077.0 [2024-08-06 05:37:46,702][52647] Sum rewards: 78.245, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.151', 'weapon2': '0.202', 'weapon5': '0.218', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:47,056][52670] DAMAGECOUNT value on done: 642807.0 [2024-08-06 05:37:47,056][52670] Sum rewards: 68.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.146', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.232', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.192', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:47,294][52669] DAMAGECOUNT value on done: 654948.0 [2024-08-06 05:37:47,295][52669] Sum rewards: 67.053, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.162', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.151', 'AMMO4': '0.225', 'weapon5': '0.238', 'weapon2': '0.442', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.652', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '52.000'} [2024-08-06 05:37:47,324][52666] DAMAGECOUNT value on done: 643735.0 [2024-08-06 05:37:47,324][52666] Sum rewards: 81.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.064', 'AMMO4': '0.096', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '0.950', 'weapon3': '3.270', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:47,687][52671] DAMAGECOUNT value on done: 661161.0 [2024-08-06 05:37:47,689][52671] Sum rewards: 79.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.304', 'AMMO5': '0.022', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.145', 'weapon5': '0.240', 'WEAPON4': '0.350', 'weapon4': '0.370', 'weapon2': '0.404', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.724', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '63.000'} [2024-08-06 05:37:47,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 512860160. Throughput: 0: 4363.3. Samples: 128215260. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:37:47,795][52567] Avg episode reward: [(0, '74.006')] [2024-08-06 05:37:47,883][52663] DAMAGECOUNT value on done: 643376.0 [2024-08-06 05:37:47,884][52663] Sum rewards: 76.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:48,036][52658] DAMAGECOUNT value on done: 647464.0 [2024-08-06 05:37:48,036][52658] Sum rewards: 71.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.192', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:49,259][52670] DAMAGECOUNT value on done: 651603.0 [2024-08-06 05:37:49,266][52670] Sum rewards: 65.047, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.391', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.046', 'weapon5': '0.080', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.292', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:49,492][52666] DAMAGECOUNT value on done: 647388.0 [2024-08-06 05:37:49,495][52666] Sum rewards: 68.641, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.010', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.096', 'weapon5': '0.264', 'AMMO3': '0.285', 'AMMO4': '0.296', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.960', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:49,498][52803] DAMAGECOUNT value on done: 601545.0 [2024-08-06 05:37:49,498][52803] Sum rewards: 84.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.250', 'AMMO5': '0.004', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.538', 'WEAPON3': '1.600', 'weapon3': '3.208', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.243', 'FRAGCOUNT': '70.000'} [2024-08-06 05:37:49,792][52647] DAMAGECOUNT value on done: 675839.0 [2024-08-06 05:37:49,792][52647] Sum rewards: 70.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.458', 'AMMO5': '0.027', 'AMMO2': '0.071', 'weapon5': '0.192', 'AMMO3': '0.207', 'weapon4': '0.242', 'AMMO4': '0.356', 'weapon2': '0.372', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:50,231][52650] Updated weights for policy 0, policy_version 62611 (0.0023) [2024-08-06 05:37:50,243][52669] DAMAGECOUNT value on done: 658867.0 [2024-08-06 05:37:50,245][52669] Sum rewards: 69.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.087', 'weapon5': '0.092', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:50,560][52663] DAMAGECOUNT value on done: 658201.0 [2024-08-06 05:37:50,562][52663] Sum rewards: 75.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.836', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.072', 'AMMO4': '0.167', 'weapon5': '0.198', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:50,752][52658] DAMAGECOUNT value on done: 648102.0 [2024-08-06 05:37:50,752][52658] Sum rewards: 72.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.799', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.144', 'weapon5': '0.158', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:50,789][52671] DAMAGECOUNT value on done: 657225.0 [2024-08-06 05:37:50,790][52671] Sum rewards: 77.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.315', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.158', 'AMMO4': '0.196', 'weapon5': '0.196', 'AMMO3': '0.207', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:51,882][52670] DAMAGECOUNT value on done: 638206.0 [2024-08-06 05:37:51,883][52670] Sum rewards: 82.222, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.588', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.146', 'weapon5': '0.202', 'AMMO3': '0.224', 'AMMO4': '0.224', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '68.000'} [2024-08-06 05:37:52,160][52666] DAMAGECOUNT value on done: 639931.0 [2024-08-06 05:37:52,160][52666] Sum rewards: 65.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.242', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.166', 'AMMO3': '0.175', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '53.000'} [2024-08-06 05:37:52,640][52803] DAMAGECOUNT value on done: 619492.0 [2024-08-06 05:37:52,644][52803] Sum rewards: 66.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.118', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.280', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:52,740][52647] DAMAGECOUNT value on done: 689514.0 [2024-08-06 05:37:52,743][52647] Sum rewards: 72.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.299', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon2': '0.174', 'weapon4': '0.178', 'weapon5': '0.186', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.196', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:52,770][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:37:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17613.1, 300 sec: 17494.8). Total num frames: 512950272. Throughput: 0: 4367.3. Samples: 128241610. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:37:52,794][52567] Avg episode reward: [(0, '73.672')] [2024-08-06 05:37:53,047][52669] DAMAGECOUNT value on done: 655445.0 [2024-08-06 05:37:53,047][52669] Sum rewards: 70.202, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.455', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.062', 'weapon4': '0.124', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.306', 'weapon2': '0.464', 'WEAPON3': '1.900', 'weapon3': '3.072', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '62.500'} [2024-08-06 05:37:53,367][52663] DAMAGECOUNT value on done: 649297.0 [2024-08-06 05:37:53,368][52663] Sum rewards: 77.481, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon2': '0.168', 'weapon5': '0.174', 'weapon4': '0.186', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '66.000'} [2024-08-06 05:37:53,567][52658] DAMAGECOUNT value on done: 661113.0 [2024-08-06 05:37:53,567][52658] Sum rewards: 68.093, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.278', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.123', 'weapon5': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'weapon2': '0.468', 'WEAPON3': '0.900', 'weapon3': '2.766', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '52.000'} [2024-08-06 05:37:53,892][52671] DAMAGECOUNT value on done: 658774.0 [2024-08-06 05:37:53,893][52671] Sum rewards: 64.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.622', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.160', 'weapon2': '0.212', 'AMMO4': '0.223', 'AMMO3': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.210', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:54,801][52670] DAMAGECOUNT value on done: 648118.0 [2024-08-06 05:37:54,802][52670] Sum rewards: 73.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.146', 'AMMO4': '0.164', 'AMMO3': '0.205', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.260', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '61.000'} [2024-08-06 05:37:55,099][52666] DAMAGECOUNT value on done: 653989.0 [2024-08-06 05:37:55,100][52666] Sum rewards: 73.847, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.032', 'AMMO4': '0.035', 'WEAPON5': '0.050', 'HEALTH': '0.110', 'AMMO3': '0.175', 'weapon2': '0.484', 'WEAPON3': '1.000', 'HITCOUNT': '3.310', 'weapon3': '3.330', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '59.000'} [2024-08-06 05:37:55,103][52650] Updated weights for policy 0, policy_version 62621 (0.0023) [2024-08-06 05:37:55,646][52803] DAMAGECOUNT value on done: 608449.0 [2024-08-06 05:37:55,646][52803] Sum rewards: 68.457, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.062', 'AMMO5': '0.023', 'AMMO2': '0.067', 'weapon4': '0.142', 'AMMO3': '0.294', 'weapon5': '0.324', 'AMMO4': '0.333', 'weapon2': '0.352', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.800', 'weapon3': '2.822', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '60.000'} [2024-08-06 05:37:55,678][52647] DAMAGECOUNT value on done: 691126.0 [2024-08-06 05:37:55,679][52647] Sum rewards: 75.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.246', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.430', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:55,894][52669] DAMAGECOUNT value on done: 654027.0 [2024-08-06 05:37:55,895][52669] Sum rewards: 69.363, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.167', 'weapon5': '0.204', 'AMMO4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.670', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:56,297][52658] DAMAGECOUNT value on done: 650563.0 [2024-08-06 05:37:56,298][52658] Sum rewards: 69.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:56,528][52663] DAMAGECOUNT value on done: 654855.0 [2024-08-06 05:37:56,529][52663] Sum rewards: 69.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.502', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.066', 'weapon5': '0.190', 'AMMO4': '0.209', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '58.000'} [2024-08-06 05:37:56,638][52671] DAMAGECOUNT value on done: 668106.0 [2024-08-06 05:37:56,638][52671] Sum rewards: 73.135, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.880', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.090', 'weapon5': '0.170', 'AMMO4': '0.268', 'AMMO3': '0.298', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.050', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 05:37:57,136][52670] DAMAGECOUNT value on done: 653337.0 [2024-08-06 05:37:57,139][52670] Sum rewards: 78.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.715', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon4': '0.100', 'weapon5': '0.212', 'AMMO4': '0.232', 'AMMO3': '0.241', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.940', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '65.000'} [2024-08-06 05:37:57,362][52666] DAMAGECOUNT value on done: 648398.0 [2024-08-06 05:37:57,363][52666] Sum rewards: 86.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.157', 'weapon2': '0.226', 'AMMO4': '0.249', 'weapon5': '0.354', 'weapon4': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.646', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '68.000'} [2024-08-06 05:37:57,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 513040384. Throughput: 0: 4358.2. Samples: 128267460. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:37:57,794][52567] Avg episode reward: [(0, '73.802')] [2024-08-06 05:37:58,655][52647] DAMAGECOUNT value on done: 686735.0 [2024-08-06 05:37:58,656][52647] Sum rewards: 69.251, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.530', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.147', 'AMMO4': '0.212', 'weapon5': '0.252', 'weapon2': '0.352', 'weapon4': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '53.000'} [2024-08-06 05:37:58,839][52803] DAMAGECOUNT value on done: 604807.0 [2024-08-06 05:37:58,839][52803] Sum rewards: 66.147, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.914', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.152', 'AMMO3': '0.237', 'weapon2': '0.272', 'weapon4': '0.274', 'AMMO4': '0.275', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.010', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:59,270][52669] DAMAGECOUNT value on done: 663603.0 [2024-08-06 05:37:59,275][52669] Sum rewards: 63.881, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.184', 'AMMO4': '0.203', 'weapon2': '0.232', 'weapon5': '0.232', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '3.030', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '55.000'} [2024-08-06 05:37:59,357][52671] DAMAGECOUNT value on done: 659625.0 [2024-08-06 05:37:59,359][52671] Sum rewards: 72.162, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.748', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.156', 'AMMO4': '0.183', 'AMMO3': '0.297', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.174', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '62.000'} [2024-08-06 05:37:59,610][52658] DAMAGECOUNT value on done: 668757.0 [2024-08-06 05:37:59,610][52658] Sum rewards: 67.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.192', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.112', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '57.000'} [2024-08-06 05:37:59,649][52663] DAMAGECOUNT value on done: 655429.0 [2024-08-06 05:37:59,649][52663] Sum rewards: 85.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.505', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.230', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '68.000'} [2024-08-06 05:37:59,841][52670] DAMAGECOUNT value on done: 651727.0 [2024-08-06 05:37:59,841][52670] Sum rewards: 63.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.576', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.000'} [2024-08-06 05:37:59,929][52650] Updated weights for policy 0, policy_version 62631 (0.0016) [2024-08-06 05:38:00,076][52666] DAMAGECOUNT value on done: 651300.0 [2024-08-06 05:38:00,078][52666] Sum rewards: 74.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.234', 'weapon4': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:01,380][52647] DAMAGECOUNT value on done: 681356.0 [2024-08-06 05:38:01,381][52647] Sum rewards: 72.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.886', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.064', 'AMMO4': '0.204', 'AMMO3': '0.223', 'weapon5': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:01,959][52803] DAMAGECOUNT value on done: 621065.0 [2024-08-06 05:38:01,959][52803] Sum rewards: 80.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon4': '0.046', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.213', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '63.000'} [2024-08-06 05:38:02,302][52671] DAMAGECOUNT value on done: 663076.0 [2024-08-06 05:38:02,303][52671] Sum rewards: 78.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.588', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.096', 'AMMO4': '0.133', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:02,310][52658] DAMAGECOUNT value on done: 655630.0 [2024-08-06 05:38:02,311][52658] Sum rewards: 83.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.054', 'weapon5': '0.136', 'AMMO4': '0.189', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '71.000'} [2024-08-06 05:38:02,372][52669] DAMAGECOUNT value on done: 655844.0 [2024-08-06 05:38:02,373][52669] Sum rewards: 78.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:02,689][52670] DAMAGECOUNT value on done: 633966.0 [2024-08-06 05:38:02,692][52670] Sum rewards: 67.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.102', 'weapon2': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON3': '1.550', 'HITCOUNT': '3.330', 'weapon3': '3.560', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '57.000'} [2024-08-06 05:38:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 513122304. Throughput: 0: 4356.9. Samples: 128280440. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:38:02,794][52567] Avg episode reward: [(0, '73.621')] [2024-08-06 05:38:02,820][52663] DAMAGECOUNT value on done: 648516.0 [2024-08-06 05:38:02,822][52663] Sum rewards: 84.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.488', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon4': '0.232', 'weapon2': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '68.000'} [2024-08-06 05:38:02,962][52666] DAMAGECOUNT value on done: 640885.0 [2024-08-06 05:38:02,963][52666] Sum rewards: 80.336, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon2': '0.248', 'weapon4': '0.342', 'WEAPON3': '0.800', 'HEALTH': '0.811', 'weapon3': '2.914', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:04,136][52647] DAMAGECOUNT value on done: 694142.0 [2024-08-06 05:38:04,136][52647] Sum rewards: 77.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.183', 'weapon5': '0.212', 'AMMO4': '0.252', 'weapon4': '0.298', 'weapon2': '0.358', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.788', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:04,213][52650] Updated weights for policy 0, policy_version 62641 (0.0014) [2024-08-06 05:38:04,238][52663] Large shaping reward 2.542 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2024-08-06 05:38:04,955][52658] DAMAGECOUNT value on done: 667555.0 [2024-08-06 05:38:04,957][52658] Sum rewards: 84.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.908', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.130', 'AMMO3': '0.231', 'weapon2': '0.638', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '69.000'} [2024-08-06 05:38:04,963][52803] DAMAGECOUNT value on done: 607999.0 [2024-08-06 05:38:04,963][52803] Sum rewards: 67.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.179', 'weapon5': '0.224', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:05,128][52669] DAMAGECOUNT value on done: 658906.0 [2024-08-06 05:38:05,130][52669] Sum rewards: 74.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:05,232][52671] DAMAGECOUNT value on done: 659045.0 [2024-08-06 05:38:05,232][52671] Sum rewards: 70.549, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.250', 'ARMOR': '0.016', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.138', 'AMMO4': '0.211', 'weapon5': '0.212', 'weapon4': '0.358', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.632', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:05,847][52670] DAMAGECOUNT value on done: 645435.0 [2024-08-06 05:38:05,848][52670] Sum rewards: 73.967, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.760', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.177', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:05,997][52666] DAMAGECOUNT value on done: 649165.0 [2024-08-06 05:38:05,999][52666] Sum rewards: 77.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.044', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.390', 'weapon3': '3.486', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '63.000'} [2024-08-06 05:38:06,065][52668] DAMAGECOUNT value on done: 652979.0 [2024-08-06 05:38:06,066][52668] Sum rewards: 73.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.891', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.063', 'AMMO3': '0.168', 'weapon2': '0.216', 'AMMO4': '0.316', 'weapon4': '0.358', 'weapon5': '0.406', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.670', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '57.000'} [2024-08-06 05:38:06,764][52820] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:38:07,284][52647] DAMAGECOUNT value on done: 683538.0 [2024-08-06 05:38:07,286][52647] Sum rewards: 66.019, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.834', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.134', 'weapon5': '0.268', 'weapon2': '0.302', 'AMMO3': '0.303', 'AMMO4': '0.317', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.976', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 05:38:07,686][52658] DAMAGECOUNT value on done: 651338.0 [2024-08-06 05:38:07,686][52658] Sum rewards: 75.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.898', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '3.460', 'weapon3': '3.478', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '65.000'} [2024-08-06 05:38:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 513212416. Throughput: 0: 4366.6. Samples: 128307050. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:38:07,795][52567] Avg episode reward: [(0, '73.739')] [2024-08-06 05:38:08,027][52671] DAMAGECOUNT value on done: 651541.0 [2024-08-06 05:38:08,029][52671] Sum rewards: 63.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.088', 'AMMO4': '0.097', 'weapon5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '53.000'} [2024-08-06 05:38:08,079][52803] DAMAGECOUNT value on done: 606353.0 [2024-08-06 05:38:08,083][52803] Sum rewards: 64.230, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.088', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.032', 'AMMO4': '0.059', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.616', 'WEAPON3': '0.900', 'HITCOUNT': '2.880', 'weapon3': '2.994', 'DAMAGECOUNT': '14.157', 'FRAGCOUNT': '51.000'} [2024-08-06 05:38:08,324][52669] DAMAGECOUNT value on done: 662192.0 [2024-08-06 05:38:08,325][52669] Sum rewards: 79.984, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.725', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.062', 'AMMO3': '0.164', 'AMMO4': '0.205', 'weapon5': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 05:38:08,671][52670] DAMAGECOUNT value on done: 653086.0 [2024-08-06 05:38:08,671][52670] Sum rewards: 66.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.845', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.274', 'weapon4': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:08,845][52666] DAMAGECOUNT value on done: 657831.0 [2024-08-06 05:38:08,845][52666] Sum rewards: 83.341, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '68.000'} [2024-08-06 05:38:08,918][52668] DAMAGECOUNT value on done: 657449.0 [2024-08-06 05:38:08,920][52668] Sum rewards: 75.095, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO3': '0.146', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.248', 'HEALTH': '0.280', 'weapon2': '0.468', 'WEAPON3': '0.850', 'weapon3': '2.968', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '58.000'} [2024-08-06 05:38:09,188][52650] Updated weights for policy 0, policy_version 62651 (0.0020) [2024-08-06 05:38:10,153][52658] DAMAGECOUNT value on done: 659081.0 [2024-08-06 05:38:10,154][52658] Sum rewards: 75.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.045', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.186', 'weapon4': '0.198', 'AMMO4': '0.202', 'weapon5': '0.272', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:10,364][52647] DAMAGECOUNT value on done: 692610.0 [2024-08-06 05:38:10,365][52647] Sum rewards: 70.232, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'weapon4': '0.206', 'weapon2': '0.216', 'AMMO3': '0.240', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:11,190][52803] DAMAGECOUNT value on done: 610764.0 [2024-08-06 05:38:11,192][52803] Sum rewards: 60.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.166', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.056', 'AMMO4': '0.160', 'weapon5': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '50.500'} [2024-08-06 05:38:11,201][52669] DAMAGECOUNT value on done: 646972.0 [2024-08-06 05:38:11,206][52669] Sum rewards: 69.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.332', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.174', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.382', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.628', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 05:38:11,220][52671] DAMAGECOUNT value on done: 657699.0 [2024-08-06 05:38:11,223][52671] Sum rewards: 83.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.420', 'AMMO5': '0.026', 'AMMO2': '0.089', 'weapon4': '0.148', 'AMMO3': '0.215', 'weapon5': '0.280', 'weapon2': '0.314', 'AMMO4': '0.444', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '68.000'} [2024-08-06 05:38:11,715][52670] DAMAGECOUNT value on done: 645392.0 [2024-08-06 05:38:11,716][52670] Sum rewards: 70.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.004', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.078', 'weapon5': '0.178', 'AMMO3': '0.232', 'AMMO4': '0.305', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '59.000'} [2024-08-06 05:38:11,903][52666] DAMAGECOUNT value on done: 638399.0 [2024-08-06 05:38:11,904][52666] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.054', 'weapon4': '0.132', 'AMMO4': '0.137', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.238', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:12,000][52668] DAMAGECOUNT value on done: 657295.0 [2024-08-06 05:38:12,001][52668] Sum rewards: 64.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.689', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.152', 'AMMO4': '0.206', 'AMMO3': '0.263', 'weapon2': '0.376', 'weapon5': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.726', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:12,112][52649] DAMAGECOUNT value on done: 633618.0 [2024-08-06 05:38:12,115][52649] Sum rewards: 85.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.679', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.220', 'AMMO3': '0.221', 'AMMO4': '0.269', 'weapon5': '0.274', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '71.000'} [2024-08-06 05:38:12,512][52658] DAMAGECOUNT value on done: 650764.0 [2024-08-06 05:38:12,513][52658] Sum rewards: 73.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.215', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO4': '0.132', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.218', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.9). Total num frames: 513302528. Throughput: 0: 4365.1. Samples: 128332890. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:38:12,794][52567] Avg episode reward: [(0, '73.601')] [2024-08-06 05:38:13,254][52647] DAMAGECOUNT value on done: 693828.0 [2024-08-06 05:38:13,255][52647] Sum rewards: 76.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.118', 'AMMO4': '0.189', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '65.000'} [2024-08-06 05:38:13,497][52650] Updated weights for policy 0, policy_version 62661 (0.0011) [2024-08-06 05:38:13,824][52669] DAMAGECOUNT value on done: 654197.0 [2024-08-06 05:38:13,825][52669] Sum rewards: 71.877, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.321', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.192', 'weapon2': '0.218', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.364', 'WEAPON3': '1.600', 'weapon3': '2.938', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:14,064][52671] DAMAGECOUNT value on done: 661560.0 [2024-08-06 05:38:14,065][52671] Sum rewards: 71.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.866', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '59.000'} [2024-08-06 05:38:14,218][52795] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:38:14,378][52803] DAMAGECOUNT value on done: 612648.0 [2024-08-06 05:38:14,380][52803] Sum rewards: 70.698, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.037', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.172', 'weapon5': '0.172', 'AMMO3': '0.198', 'AMMO4': '0.253', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '58.500'} [2024-08-06 05:38:14,845][52670] DAMAGECOUNT value on done: 651262.0 [2024-08-06 05:38:14,848][52670] Sum rewards: 85.907, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.075', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.294', 'weapon2': '0.330', 'WEAPON3': '1.850', 'weapon3': '3.364', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.114', 'FRAGCOUNT': '75.000'} [2024-08-06 05:38:14,942][52666] DAMAGECOUNT value on done: 646892.0 [2024-08-06 05:38:14,944][52666] Sum rewards: 66.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.676', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.218', 'AMMO3': '0.221', 'weapon5': '0.224', 'AMMO4': '0.236', 'weapon2': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '56.500'} [2024-08-06 05:38:15,006][52668] DAMAGECOUNT value on done: 658839.0 [2024-08-06 05:38:15,007][52668] Sum rewards: 85.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.571', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.108', 'AMMO3': '0.170', 'weapon4': '0.178', 'weapon2': '0.222', 'AMMO4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.284', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '68.000'} [2024-08-06 05:38:15,279][52649] DAMAGECOUNT value on done: 626304.0 [2024-08-06 05:38:15,280][52649] Sum rewards: 84.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.940', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.086', 'AMMO4': '0.138', 'weapon5': '0.152', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '68.000'} [2024-08-06 05:38:15,846][52658] DAMAGECOUNT value on done: 657615.0 [2024-08-06 05:38:15,846][52658] Sum rewards: 81.674, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO4': '0.216', 'AMMO3': '0.234', 'weapon5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '67.000'} [2024-08-06 05:38:15,954][52647] DAMAGECOUNT value on done: 677149.0 [2024-08-06 05:38:15,956][52647] Sum rewards: 79.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.114', 'weapon4': '0.158', 'AMMO4': '0.171', 'weapon2': '0.218', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.308', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:16,751][52671] DAMAGECOUNT value on done: 656848.0 [2024-08-06 05:38:16,753][52671] Sum rewards: 80.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.597', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.174', 'AMMO3': '0.179', 'weapon5': '0.182', 'weapon4': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '65.000'} [2024-08-06 05:38:16,988][52669] DAMAGECOUNT value on done: 655383.0 [2024-08-06 05:38:16,989][52669] Sum rewards: 67.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.108', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.160', 'weapon4': '0.230', 'AMMO4': '0.280', 'weapon5': '0.304', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '54.000'} [2024-08-06 05:38:17,657][52668] DAMAGECOUNT value on done: 645411.0 [2024-08-06 05:38:17,659][52668] Sum rewards: 85.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.467', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.118', 'weapon5': '0.144', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '71.000'} [2024-08-06 05:38:17,715][52803] DAMAGECOUNT value on done: 618394.0 [2024-08-06 05:38:17,715][52803] Sum rewards: 77.687, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:17,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 513384448. Throughput: 0: 4368.0. Samples: 128346090. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 05:38:17,794][52567] Avg episode reward: [(0, '74.246')] [2024-08-06 05:38:18,267][52649] DAMAGECOUNT value on done: 645372.0 [2024-08-06 05:38:18,268][52649] Sum rewards: 67.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.934', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.069', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.450', 'HITCOUNT': '2.820', 'weapon3': '3.194', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '58.000'} [2024-08-06 05:38:18,405][52650] Updated weights for policy 0, policy_version 62671 (0.0025) [2024-08-06 05:38:18,517][52647] DAMAGECOUNT value on done: 685975.0 [2024-08-06 05:38:18,517][52647] Sum rewards: 79.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.160', 'weapon4': '0.172', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '65.000'} [2024-08-06 05:38:18,604][52662] DAMAGECOUNT value on done: 658748.0 [2024-08-06 05:38:18,605][52662] Sum rewards: 81.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.192', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.516', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '67.000'} [2024-08-06 05:38:19,116][52658] DAMAGECOUNT value on done: 643368.0 [2024-08-06 05:38:19,120][52658] Sum rewards: 79.340, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.018', 'weapon4': '0.030', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.496', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '67.000'} [2024-08-06 05:38:19,405][52671] DAMAGECOUNT value on done: 661630.0 [2024-08-06 05:38:19,408][52671] Sum rewards: 71.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.592', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.162', 'weapon4': '0.168', 'AMMO4': '0.197', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '58.000'} [2024-08-06 05:38:20,010][52669] DAMAGECOUNT value on done: 675504.0 [2024-08-06 05:38:20,010][52669] Sum rewards: 74.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.906', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon5': '0.196', 'AMMO3': '0.242', 'weapon4': '0.246', 'AMMO4': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '2.718', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '64.000'} [2024-08-06 05:38:20,621][52668] DAMAGECOUNT value on done: 661192.0 [2024-08-06 05:38:20,621][52668] Sum rewards: 67.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.803', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.020', 'AMMO4': '0.031', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.239', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '57.000'} [2024-08-06 05:38:20,669][52803] DAMAGECOUNT value on done: 607160.0 [2024-08-06 05:38:20,669][52803] Sum rewards: 72.339, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.018', 'AMMO2': '0.051', 'HEALTH': '0.102', 'weapon4': '0.112', 'AMMO3': '0.204', 'weapon5': '0.254', 'AMMO4': '0.255', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '59.000'} [2024-08-06 05:38:21,005][52662] DAMAGECOUNT value on done: 657519.0 [2024-08-06 05:38:21,008][52662] Sum rewards: 80.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.853', 'AMMO5': '0.009', 'weapon4': '0.022', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.390', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '65.000'} [2024-08-06 05:38:21,022][52647] DAMAGECOUNT value on done: 676939.0 [2024-08-06 05:38:21,024][52647] Sum rewards: 73.473, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.256', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.130', 'weapon5': '0.132', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.324', 'weapon2': '0.354', 'WEAPON3': '1.800', 'weapon3': '3.058', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:21,419][52649] DAMAGECOUNT value on done: 639251.0 [2024-08-06 05:38:21,421][52649] Sum rewards: 70.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.008', 'weapon5': '0.036', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.324', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.462', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2024-08-06 05:38:22,099][52658] DAMAGECOUNT value on done: 659531.0 [2024-08-06 05:38:22,100][52658] Sum rewards: 76.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.150', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.219', 'weapon2': '0.604', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:22,537][52671] DAMAGECOUNT value on done: 657109.0 [2024-08-06 05:38:22,539][52671] Sum rewards: 69.124, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.054', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.286', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.394', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '56.000'} [2024-08-06 05:38:22,545][52669] DAMAGECOUNT value on done: 662140.0 [2024-08-06 05:38:22,546][52669] Sum rewards: 77.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '65.000'} [2024-08-06 05:38:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 513474560. Throughput: 0: 4372.2. Samples: 128372580. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:22,794][52567] Avg episode reward: [(0, '74.138')] [2024-08-06 05:38:23,090][52650] Updated weights for policy 0, policy_version 62681 (0.0025) [2024-08-06 05:38:23,591][52668] DAMAGECOUNT value on done: 659767.0 [2024-08-06 05:38:23,591][52668] Sum rewards: 68.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 05:38:23,787][52662] DAMAGECOUNT value on done: 665501.0 [2024-08-06 05:38:23,789][52662] Sum rewards: 79.887, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.820', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.150', 'AMMO4': '0.183', 'weapon5': '0.222', 'weapon2': '0.248', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.054', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '68.000'} [2024-08-06 05:38:23,975][52647] DAMAGECOUNT value on done: 680973.0 [2024-08-06 05:38:23,975][52647] Sum rewards: 66.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.123', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:24,317][52658] DAMAGECOUNT value on done: 652046.0 [2024-08-06 05:38:24,319][52658] Sum rewards: 86.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.195', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO4': '0.028', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.232', 'weapon4': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '71.000'} [2024-08-06 05:38:24,678][52649] DAMAGECOUNT value on done: 627667.0 [2024-08-06 05:38:24,678][52649] Sum rewards: 54.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.675', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.113', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.154', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '0.900', 'HITCOUNT': '2.630', 'weapon3': '2.984', 'DAMAGECOUNT': '12.894', 'FRAGCOUNT': '44.000'} [2024-08-06 05:38:25,563][52669] DAMAGECOUNT value on done: 660398.0 [2024-08-06 05:38:25,564][52669] Sum rewards: 82.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.082', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.424', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '67.000'} [2024-08-06 05:38:25,608][52671] DAMAGECOUNT value on done: 643875.0 [2024-08-06 05:38:25,608][52671] Sum rewards: 67.402, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon4': '0.202', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '54.000'} [2024-08-06 05:38:26,534][52662] DAMAGECOUNT value on done: 650760.0 [2024-08-06 05:38:26,535][52662] Sum rewards: 79.431, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.648', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.086', 'weapon2': '0.166', 'AMMO3': '0.224', 'weapon5': '0.234', 'AMMO4': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:26,723][52658] DAMAGECOUNT value on done: 652363.0 [2024-08-06 05:38:26,725][52658] Sum rewards: 69.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.426', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.058', 'AMMO4': '0.147', 'AMMO3': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '56.000'} [2024-08-06 05:38:26,790][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:38:26,844][52668] DAMAGECOUNT value on done: 650706.0 [2024-08-06 05:38:26,845][52668] Sum rewards: 69.705, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.264', 'AMMO5': '0.017', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.097', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:27,405][52649] DAMAGECOUNT value on done: 645417.0 [2024-08-06 05:38:27,405][52649] Sum rewards: 81.517, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.167', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO4': '0.152', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '67.000'} [2024-08-06 05:38:27,639][52650] Updated weights for policy 0, policy_version 62691 (0.0010) [2024-08-06 05:38:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 513564672. Throughput: 0: 4374.9. Samples: 128398960. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:27,794][52567] Avg episode reward: [(0, '74.019')] [2024-08-06 05:38:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062691_513564672.pth... [2024-08-06 05:38:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062179_509370368.pth [2024-08-06 05:38:28,139][52669] DAMAGECOUNT value on done: 660620.0 [2024-08-06 05:38:28,142][52669] Sum rewards: 64.511, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.786', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.062', 'AMMO4': '0.203', 'weapon5': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '54.500'} [2024-08-06 05:38:28,786][52671] DAMAGECOUNT value on done: 665596.0 [2024-08-06 05:38:28,786][52671] Sum rewards: 83.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.302', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.754', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '70.000'} [2024-08-06 05:38:29,506][52658] DAMAGECOUNT value on done: 657934.0 [2024-08-06 05:38:29,506][52658] Sum rewards: 84.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.071', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.180', 'weapon2': '0.192', 'weapon4': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '69.000'} [2024-08-06 05:38:29,527][52668] DAMAGECOUNT value on done: 652073.0 [2024-08-06 05:38:29,527][52668] Sum rewards: 70.690, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.061', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.086', 'AMMO4': '0.170', 'weapon5': '0.178', 'weapon2': '0.240', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.194', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '61.500'} [2024-08-06 05:38:29,805][52662] DAMAGECOUNT value on done: 669573.0 [2024-08-06 05:38:29,806][52662] Sum rewards: 72.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.377', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.128', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '63.000'} [2024-08-06 05:38:30,155][52649] DAMAGECOUNT value on done: 635713.0 [2024-08-06 05:38:30,157][52649] Sum rewards: 75.323, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.270', 'AMMO5': '0.027', 'AMMO2': '0.069', 'weapon4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.264', 'weapon5': '0.274', 'AMMO4': '0.345', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:31,502][52669] DAMAGECOUNT value on done: 666292.0 [2024-08-06 05:38:31,502][52669] Sum rewards: 71.066, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.641', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.291', 'WEAPON3': '1.750', 'weapon3': '3.270', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:31,876][52671] DAMAGECOUNT value on done: 660930.0 [2024-08-06 05:38:31,877][52671] Sum rewards: 79.409, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.490', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon4': '0.222', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 05:38:32,267][52650] Updated weights for policy 0, policy_version 62701 (0.0017) [2024-08-06 05:38:32,348][52668] DAMAGECOUNT value on done: 659589.0 [2024-08-06 05:38:32,348][52668] Sum rewards: 65.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.186', 'AMMO3': '0.215', 'weapon2': '0.228', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 513646592. Throughput: 0: 4366.7. Samples: 128411760. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:32,795][52567] Avg episode reward: [(0, '74.251')] [2024-08-06 05:38:32,823][52662] DAMAGECOUNT value on done: 647765.0 [2024-08-06 05:38:32,825][52662] Sum rewards: 75.463, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.763', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.104', 'AMMO3': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.932', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:33,212][52649] DAMAGECOUNT value on done: 639244.0 [2024-08-06 05:38:33,214][52649] Sum rewards: 68.055, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon5': '0.210', 'weapon2': '0.438', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.180', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:34,703][52671] DAMAGECOUNT value on done: 661764.0 [2024-08-06 05:38:34,705][52671] Sum rewards: 81.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO4': '0.186', 'AMMO3': '0.220', 'weapon5': '0.262', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:35,517][52668] DAMAGECOUNT value on done: 654779.0 [2024-08-06 05:38:35,517][52668] Sum rewards: 69.816, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.770', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.062', 'weapon5': '0.104', 'weapon2': '0.236', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'AMMO4': '0.272', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.378', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:35,769][52649] DAMAGECOUNT value on done: 640370.0 [2024-08-06 05:38:35,769][52649] Sum rewards: 65.284, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.905', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.241', 'weapon4': '0.254', 'weapon5': '0.260', 'AMMO4': '0.270', 'weapon2': '0.294', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '56.500'} [2024-08-06 05:38:36,065][52662] DAMAGECOUNT value on done: 657577.0 [2024-08-06 05:38:36,065][52662] Sum rewards: 73.854, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon5': '0.234', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:37,284][52650] Updated weights for policy 0, policy_version 62711 (0.0028) [2024-08-06 05:38:37,737][52671] DAMAGECOUNT value on done: 661895.0 [2024-08-06 05:38:37,739][52671] Sum rewards: 78.099, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.570', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.140', 'weapon4': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.016', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '70.000'} [2024-08-06 05:38:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 513728512. Throughput: 0: 4363.8. Samples: 128437980. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:37,794][52567] Avg episode reward: [(0, '74.288')] [2024-08-06 05:38:38,031][52649] DAMAGECOUNT value on done: 632501.0 [2024-08-06 05:38:38,032][52649] Sum rewards: 83.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.102', 'weapon5': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '70.000'} [2024-08-06 05:38:38,548][52668] DAMAGECOUNT value on done: 647382.0 [2024-08-06 05:38:38,549][52668] Sum rewards: 69.469, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'weapon4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.332', 'HEALTH': '0.660', 'WEAPON3': '0.950', 'weapon3': '3.334', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 05:38:39,262][52662] DAMAGECOUNT value on done: 663854.0 [2024-08-06 05:38:39,263][52662] Sum rewards: 91.517, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.645', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.348', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.177', 'FRAGCOUNT': '78.000'} [2024-08-06 05:38:40,200][52660] DAMAGECOUNT value on done: 655267.0 [2024-08-06 05:38:40,201][52660] Sum rewards: 80.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.990', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '64.000'} [2024-08-06 05:38:40,770][52671] DAMAGECOUNT value on done: 657822.0 [2024-08-06 05:38:40,770][52671] Sum rewards: 84.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.567', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON4': '0.150', 'weapon2': '0.188', 'AMMO3': '0.228', 'weapon4': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.380', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '70.000'} [2024-08-06 05:38:41,146][52649] DAMAGECOUNT value on done: 646351.0 [2024-08-06 05:38:41,146][52649] Sum rewards: 85.026, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.560', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.161', 'weapon5': '0.212', 'AMMO3': '0.269', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.110', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '71.000'} [2024-08-06 05:38:41,424][52668] DAMAGECOUNT value on done: 640706.0 [2024-08-06 05:38:41,425][52668] Sum rewards: 78.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.335', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.096', 'AMMO4': '0.142', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '62.500'} [2024-08-06 05:38:41,581][52650] Updated weights for policy 0, policy_version 62721 (0.0020) [2024-08-06 05:38:41,738][52662] DAMAGECOUNT value on done: 656623.0 [2024-08-06 05:38:41,740][52662] Sum rewards: 76.092, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.028', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon5': '0.176', 'WEAPON5': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.050', 'weapon3': '3.064', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 513826816. Throughput: 0: 4378.4. Samples: 128464490. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:42,794][52567] Avg episode reward: [(0, '75.078')] [2024-08-06 05:38:42,795][52614] Saving new best policy, reward=75.078! [2024-08-06 05:38:43,243][52660] DAMAGECOUNT value on done: 644027.0 [2024-08-06 05:38:43,244][52660] Sum rewards: 55.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.638', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'weapon2': '0.618', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.186', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '47.000'} [2024-08-06 05:38:44,147][52649] DAMAGECOUNT value on done: 648094.0 [2024-08-06 05:38:44,148][52649] Sum rewards: 68.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.306', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO3': '0.149', 'weapon2': '0.170', 'AMMO4': '0.193', 'weapon5': '0.252', 'weapon4': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.986', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:44,600][52668] DAMAGECOUNT value on done: 641863.0 [2024-08-06 05:38:44,602][52668] Sum rewards: 74.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.310', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.044', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.212', 'WEAPON3': '1.400', 'weapon3': '3.456', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:44,704][52662] DAMAGECOUNT value on done: 666106.0 [2024-08-06 05:38:44,706][52662] Sum rewards: 74.083, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.918', 'AMMO5': '0.004', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'weapon2': '0.172', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.546', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '64.000'} [2024-08-06 05:38:46,250][52660] DAMAGECOUNT value on done: 657234.0 [2024-08-06 05:38:46,252][52660] Sum rewards: 72.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.162', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO4': '0.178', 'weapon4': '0.190', 'weapon2': '0.238', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.200', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:46,625][52669] Large shaping reward 2.731 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 05:38:46,822][52650] Updated weights for policy 0, policy_version 62731 (0.0034) [2024-08-06 05:38:47,240][52649] DAMAGECOUNT value on done: 645065.0 [2024-08-06 05:38:47,242][52649] Sum rewards: 67.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO3': '0.194', 'AMMO4': '0.201', 'weapon5': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '55.500'} [2024-08-06 05:38:47,471][52668] DAMAGECOUNT value on done: 641927.0 [2024-08-06 05:38:47,471][52668] Sum rewards: 70.605, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.082', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.125', 'weapon2': '0.232', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '61.000'} [2024-08-06 05:38:47,627][52662] DAMAGECOUNT value on done: 652154.0 [2024-08-06 05:38:47,628][52662] Sum rewards: 76.792, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.570', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO3': '0.118', 'AMMO4': '0.126', 'weapon5': '0.176', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '0.750', 'weapon3': '3.042', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '59.000'} [2024-08-06 05:38:47,795][52567] Fps is (10 sec: 18840.7, 60 sec: 17612.7, 300 sec: 17495.1). Total num frames: 513916928. Throughput: 0: 4371.5. Samples: 128477160. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:47,795][52567] Avg episode reward: [(0, '74.507')] [2024-08-06 05:38:49,088][52795] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 05:38:49,312][52660] DAMAGECOUNT value on done: 664625.0 [2024-08-06 05:38:49,313][52660] Sum rewards: 73.090, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:50,347][52668] DAMAGECOUNT value on done: 654732.0 [2024-08-06 05:38:50,347][52668] Sum rewards: 80.156, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.715', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.218', 'AMMO4': '0.223', 'AMMO3': '0.308', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.998', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.102', 'FRAGCOUNT': '69.500'} [2024-08-06 05:38:50,389][52649] DAMAGECOUNT value on done: 644060.0 [2024-08-06 05:38:50,390][52649] Sum rewards: 74.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.532', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.124', 'weapon4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.306', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.000'} [2024-08-06 05:38:50,633][52662] DAMAGECOUNT value on done: 654800.0 [2024-08-06 05:38:50,634][52662] Sum rewards: 75.628, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.524', 'AMMO5': '0.015', 'AMMO2': '0.064', 'AMMO3': '0.181', 'weapon5': '0.186', 'weapon4': '0.236', 'AMMO4': '0.320', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:51,243][52650] Updated weights for policy 0, policy_version 62741 (0.0013) [2024-08-06 05:38:51,356][52614] Signal inference workers to stop experience collection... (11400 times) [2024-08-06 05:38:51,356][52614] Signal inference workers to resume experience collection... (11400 times) [2024-08-06 05:38:51,399][52650] InferenceWorker_p0-w0: stopping experience collection (11400 times) [2024-08-06 05:38:51,409][52650] InferenceWorker_p0-w0: resuming experience collection (11400 times) [2024-08-06 05:38:51,759][52660] DAMAGECOUNT value on done: 650335.0 [2024-08-06 05:38:51,761][52660] Sum rewards: 64.361, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.770', 'AMMO5': '0.009', 'weapon4': '0.042', 'AMMO2': '0.052', 'weapon5': '0.144', 'AMMO4': '0.260', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '56.000'} [2024-08-06 05:38:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 513990656. Throughput: 0: 4366.9. Samples: 128503560. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:52,794][52567] Avg episode reward: [(0, '74.245')] [2024-08-06 05:38:53,124][52668] DAMAGECOUNT value on done: 653447.0 [2024-08-06 05:38:53,126][52668] Sum rewards: 81.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.610', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.092', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '66.000'} [2024-08-06 05:38:53,168][52649] DAMAGECOUNT value on done: 630240.0 [2024-08-06 05:38:53,170][52649] Sum rewards: 73.199, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.074', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 05:38:53,654][52662] DAMAGECOUNT value on done: 651543.0 [2024-08-06 05:38:53,656][52662] Sum rewards: 74.225, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.179', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.151', 'weapon2': '0.676', 'WEAPON3': '0.900', 'weapon3': '3.188', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '58.000'} [2024-08-06 05:38:54,677][52660] DAMAGECOUNT value on done: 649438.0 [2024-08-06 05:38:54,677][52660] Sum rewards: 71.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.827', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.142', 'AMMO3': '0.186', 'AMMO4': '0.189', 'weapon5': '0.238', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '57.000'} [2024-08-06 05:38:55,752][52668] DAMAGECOUNT value on done: 650546.0 [2024-08-06 05:38:55,752][52668] Sum rewards: 74.875, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.622', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '3.310', 'weapon3': '3.372', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 05:38:56,062][52649] DAMAGECOUNT value on done: 640883.0 [2024-08-06 05:38:56,062][52649] Sum rewards: 74.710, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.507', 'AMMO5': '0.016', 'AMMO2': '0.022', 'weapon4': '0.038', 'AMMO4': '0.110', 'weapon5': '0.152', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.700', 'weapon3': '3.178', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '64.000'} [2024-08-06 05:38:56,064][52650] Updated weights for policy 0, policy_version 62751 (0.0032) [2024-08-06 05:38:56,409][52662] DAMAGECOUNT value on done: 658879.0 [2024-08-06 05:38:56,410][52662] Sum rewards: 77.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.509', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.294', 'weapon4': '0.398', 'WEAPON3': '1.800', 'weapon3': '2.978', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '67.000'} [2024-08-06 05:38:57,682][52660] DAMAGECOUNT value on done: 650569.0 [2024-08-06 05:38:57,682][52660] Sum rewards: 67.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.698', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.138', 'weapon5': '0.194', 'AMMO4': '0.242', 'AMMO3': '0.276', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.016', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '58.000'} [2024-08-06 05:38:57,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 514088960. Throughput: 0: 4381.3. Samples: 128530050. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:38:57,794][52567] Avg episode reward: [(0, '74.396')] [2024-08-06 05:38:58,929][52668] DAMAGECOUNT value on done: 660207.0 [2024-08-06 05:38:58,929][52668] Sum rewards: 84.456, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.890', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon5': '0.184', 'AMMO3': '0.239', 'weapon4': '0.262', 'AMMO4': '0.293', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '72.000'} [2024-08-06 05:38:59,004][52662] DAMAGECOUNT value on done: 651671.0 [2024-08-06 05:38:59,005][52662] Sum rewards: 69.748, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.504', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.110', 'AMMO3': '0.194', 'AMMO4': '0.245', 'weapon5': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.718', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '55.000'} [2024-08-06 05:38:59,327][52649] DAMAGECOUNT value on done: 632946.0 [2024-08-06 05:38:59,327][52649] Sum rewards: 89.092, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.048', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '72.000'} [2024-08-06 05:39:00,252][52650] Updated weights for policy 0, policy_version 62761 (0.0012) [2024-08-06 05:39:00,766][52660] DAMAGECOUNT value on done: 661161.0 [2024-08-06 05:39:00,766][52660] Sum rewards: 88.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.255', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.132', 'weapon2': '0.206', 'AMMO4': '0.208', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.612', 'FRAGCOUNT': '73.000'} [2024-08-06 05:39:01,775][52668] DAMAGECOUNT value on done: 655715.0 [2024-08-06 05:39:01,775][52668] Sum rewards: 74.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.540', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.118', 'weapon5': '0.140', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '62.000'} [2024-08-06 05:39:02,143][52662] DAMAGECOUNT value on done: 665960.0 [2024-08-06 05:39:02,145][52662] Sum rewards: 68.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.406', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.266', 'AMMO3': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.266', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '60.000'} [2024-08-06 05:39:02,332][52649] DAMAGECOUNT value on done: 645248.0 [2024-08-06 05:39:02,334][52649] Sum rewards: 77.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.100', 'weapon5': '0.174', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '64.000'} [2024-08-06 05:39:02,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 514179072. Throughput: 0: 4377.8. Samples: 128543090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:39:02,794][52567] Avg episode reward: [(0, '74.848')] [2024-08-06 05:39:03,603][52660] DAMAGECOUNT value on done: 649672.0 [2024-08-06 05:39:03,605][52660] Sum rewards: 77.904, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.776', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.120', 'AMMO4': '0.122', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.394', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '67.000'} [2024-08-06 05:39:05,011][52649] DAMAGECOUNT value on done: 644471.0 [2024-08-06 05:39:05,020][52649] Sum rewards: 65.959, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.150', 'AMMO4': '0.213', 'weapon4': '0.222', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.906', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '58.000'} [2024-08-06 05:39:05,270][52650] Updated weights for policy 0, policy_version 62771 (0.0021) [2024-08-06 05:39:05,392][52662] DAMAGECOUNT value on done: 659981.0 [2024-08-06 05:39:05,393][52662] Sum rewards: 70.014, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.780', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.130', 'AMMO3': '0.164', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.256', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '56.000'} [2024-08-06 05:39:06,197][52660] DAMAGECOUNT value on done: 652152.0 [2024-08-06 05:39:06,199][52660] Sum rewards: 74.756, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.681', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon2': '0.248', 'weapon5': '0.256', 'AMMO3': '0.274', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.862', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '64.000'} [2024-08-06 05:39:07,524][52649] DAMAGECOUNT value on done: 639262.0 [2024-08-06 05:39:07,524][52649] Sum rewards: 79.157, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.025', 'HEALTH': '0.056', 'weapon4': '0.062', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon2': '0.184', 'AMMO3': '0.221', 'WEAPON3': '1.250', 'weapon3': '3.450', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '65.000'} [2024-08-06 05:39:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 514260992. Throughput: 0: 4374.7. Samples: 128569440. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:39:07,795][52567] Avg episode reward: [(0, '74.983')] [2024-08-06 05:39:07,834][52662] DAMAGECOUNT value on done: 645432.0 [2024-08-06 05:39:07,834][52662] Sum rewards: 65.550, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.132', 'AMMO4': '0.141', 'weapon5': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '2.910', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '56.000'} [2024-08-06 05:39:09,320][52660] DAMAGECOUNT value on done: 657827.0 [2024-08-06 05:39:09,322][52660] Sum rewards: 77.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.398', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.078', 'AMMO3': '0.178', 'AMMO4': '0.204', 'weapon5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.152', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '61.000'} [2024-08-06 05:39:10,044][52650] Updated weights for policy 0, policy_version 62781 (0.0028) [2024-08-06 05:39:10,679][52662] DAMAGECOUNT value on done: 654228.0 [2024-08-06 05:39:10,680][52662] Sum rewards: 64.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.994', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.282', 'weapon4': '0.344', 'weapon2': '0.476', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '53.000'} [2024-08-06 05:39:11,644][52664] DAMAGECOUNT value on done: 678292.0 [2024-08-06 05:39:11,646][52664] Sum rewards: 55.380, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.418', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON3': '0.850', 'weapon2': '0.980', 'weapon3': '2.772', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '42.000'} [2024-08-06 05:39:12,307][52660] DAMAGECOUNT value on done: 649691.0 [2024-08-06 05:39:12,308][52660] Sum rewards: 71.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.110', 'weapon5': '0.178', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '59.000'} [2024-08-06 05:39:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 514351104. Throughput: 0: 4373.3. Samples: 128595760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:39:12,794][52567] Avg episode reward: [(0, '74.581')] [2024-08-06 05:39:13,712][52662] DAMAGECOUNT value on done: 648566.0 [2024-08-06 05:39:13,714][52662] Sum rewards: 64.705, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.163', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.094', 'weapon5': '0.224', 'AMMO3': '0.233', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.090', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '53.000'} [2024-08-06 05:39:14,153][52664] DAMAGECOUNT value on done: 684849.0 [2024-08-06 05:39:14,153][52664] Sum rewards: 85.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.120', 'weapon4': '0.126', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.664', 'FRAGCOUNT': '70.000'} [2024-08-06 05:39:14,438][52650] Updated weights for policy 0, policy_version 62791 (0.0024) [2024-08-06 05:39:15,264][52660] DAMAGECOUNT value on done: 652529.0 [2024-08-06 05:39:15,265][52660] Sum rewards: 77.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.080', 'AMMO4': '0.199', 'weapon5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '64.000'} [2024-08-06 05:39:17,210][52664] DAMAGECOUNT value on done: 682447.0 [2024-08-06 05:39:17,211][52664] Sum rewards: 76.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.426', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO3': '0.189', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 05:39:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 514441216. Throughput: 0: 4380.7. Samples: 128608890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:39:17,795][52567] Avg episode reward: [(0, '74.631')] [2024-08-06 05:39:17,867][52660] DAMAGECOUNT value on done: 663355.0 [2024-08-06 05:39:17,869][52660] Sum rewards: 67.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.124', 'weapon5': '0.204', 'AMMO3': '0.218', 'AMMO4': '0.237', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '2.846', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '55.000'} [2024-08-06 05:39:18,796][52659] DAMAGECOUNT value on done: 661056.0 [2024-08-06 05:39:18,796][52659] Sum rewards: 74.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.038', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'AMMO4': '0.192', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.442', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '62.000'} [2024-08-06 05:39:19,297][52650] Updated weights for policy 0, policy_version 62801 (0.0012) [2024-08-06 05:39:20,203][52664] DAMAGECOUNT value on done: 674526.0 [2024-08-06 05:39:20,203][52664] Sum rewards: 83.051, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.605', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.291', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '71.000'} [2024-08-06 05:39:20,546][52660] DAMAGECOUNT value on done: 669574.0 [2024-08-06 05:39:20,548][52660] Sum rewards: 61.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.679', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.090', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.088', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '51.000'} [2024-08-06 05:39:21,826][52659] DAMAGECOUNT value on done: 655526.0 [2024-08-06 05:39:21,827][52659] Sum rewards: 76.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.835', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.132', 'AMMO3': '0.152', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '61.000'} [2024-08-06 05:39:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 514523136. Throughput: 0: 4380.2. Samples: 128635090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:39:22,795][52567] Avg episode reward: [(0, '74.281')] [2024-08-06 05:39:23,003][52664] DAMAGECOUNT value on done: 684751.0 [2024-08-06 05:39:23,005][52664] Sum rewards: 77.761, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.792', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.126', 'weapon2': '0.160', 'AMMO4': '0.199', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.428', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '66.000'} [2024-08-06 05:39:23,366][52660] DAMAGECOUNT value on done: 650668.0 [2024-08-06 05:39:23,366][52660] Sum rewards: 83.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.186', 'weapon4': '0.196', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '68.000'} [2024-08-06 05:39:24,247][52650] Updated weights for policy 0, policy_version 62811 (0.0019) [2024-08-06 05:39:24,955][52659] DAMAGECOUNT value on done: 661096.0 [2024-08-06 05:39:24,956][52659] Sum rewards: 61.899, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.392', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon4': '0.138', 'weapon5': '0.270', 'AMMO3': '0.299', 'AMMO4': '0.326', 'weapon2': '0.350', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.892', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '54.000'} [2024-08-06 05:39:25,245][52665] DAMAGECOUNT value on done: 643274.0 [2024-08-06 05:39:25,246][52665] Sum rewards: 55.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.223', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.054', 'AMMO4': '0.166', 'weapon5': '0.172', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.150', 'HITCOUNT': '2.490', 'weapon3': '3.028', 'DAMAGECOUNT': '13.224', 'FRAGCOUNT': '47.000'} [2024-08-06 05:39:25,637][52664] DAMAGECOUNT value on done: 679873.0 [2024-08-06 05:39:25,637][52664] Sum rewards: 71.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.315', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.196', 'AMMO4': '0.205', 'AMMO3': '0.208', 'weapon4': '0.252', 'weapon2': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '58.000'} [2024-08-06 05:39:26,411][52660] DAMAGECOUNT value on done: 659896.0 [2024-08-06 05:39:26,411][52660] Sum rewards: 79.666, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.295', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.142', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.692', 'WEAPON3': '1.050', 'weapon3': '2.886', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '65.000'} [2024-08-06 05:39:27,455][52659] DAMAGECOUNT value on done: 653986.0 [2024-08-06 05:39:27,457][52659] Sum rewards: 71.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.205', 'AMMO5': '0.027', 'AMMO2': '0.044', 'weapon4': '0.154', 'AMMO3': '0.182', 'AMMO4': '0.219', 'weapon5': '0.240', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '56.000'} [2024-08-06 05:39:27,602][52665] DAMAGECOUNT value on done: 659456.0 [2024-08-06 05:39:27,602][52665] Sum rewards: 66.020, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.124', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.060', 'AMMO4': '0.173', 'weapon5': '0.182', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.318', 'WEAPON3': '1.800', 'weapon3': '3.196', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '59.000'} [2024-08-06 05:39:27,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 514605056. Throughput: 0: 4378.9. Samples: 128661540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:39:27,794][52567] Avg episode reward: [(0, '73.754')] [2024-08-06 05:39:28,338][52650] Updated weights for policy 0, policy_version 62821 (0.0018) [2024-08-06 05:39:28,514][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:39:28,725][52664] DAMAGECOUNT value on done: 677858.0 [2024-08-06 05:39:28,726][52664] Sum rewards: 74.050, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.182', 'weapon5': '0.196', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 05:39:29,484][52660] DAMAGECOUNT value on done: 653577.0 [2024-08-06 05:39:29,486][52660] Sum rewards: 71.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.124', 'AMMO3': '0.202', 'AMMO4': '0.215', 'weapon4': '0.216', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '59.000'} [2024-08-06 05:39:30,278][52659] DAMAGECOUNT value on done: 652444.0 [2024-08-06 05:39:30,280][52659] Sum rewards: 67.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.149', 'AMMO3': '0.194', 'weapon5': '0.196', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.258', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '55.000'} [2024-08-06 05:39:30,508][52665] DAMAGECOUNT value on done: 656417.0 [2024-08-06 05:39:30,509][52665] Sum rewards: 61.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.361', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.136', 'AMMO4': '0.170', 'weapon5': '0.174', 'AMMO3': '0.201', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.064', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '52.000'} [2024-08-06 05:39:32,146][52664] DAMAGECOUNT value on done: 673155.0 [2024-08-06 05:39:32,147][52664] Sum rewards: 74.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.114', 'AMMO3': '0.221', 'AMMO4': '0.227', 'weapon5': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '62.000'} [2024-08-06 05:39:32,762][52660] DAMAGECOUNT value on done: 650523.0 [2024-08-06 05:39:32,767][52660] Sum rewards: 76.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.477', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.130', 'AMMO4': '0.202', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '63.000'} [2024-08-06 05:39:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 514695168. Throughput: 0: 4382.2. Samples: 128674360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:39:32,795][52567] Avg episode reward: [(0, '73.580')] [2024-08-06 05:39:33,139][52665] DAMAGECOUNT value on done: 650886.0 [2024-08-06 05:39:33,142][52665] Sum rewards: 69.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.272', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.180', 'weapon4': '0.214', 'AMMO4': '0.237', 'AMMO3': '0.250', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '58.000'} [2024-08-06 05:39:33,227][52650] Updated weights for policy 0, policy_version 62831 (0.0014) [2024-08-06 05:39:33,304][52659] DAMAGECOUNT value on done: 660817.0 [2024-08-06 05:39:33,306][52659] Sum rewards: 81.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.116', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'weapon4': '0.066', 'AMMO3': '0.239', 'weapon2': '0.292', 'WEAPON3': '1.600', 'weapon3': '3.492', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '69.000'} [2024-08-06 05:39:34,768][52794] DAMAGECOUNT value on done: 657586.0 [2024-08-06 05:39:34,769][52794] Sum rewards: 53.255, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.164', 'weapon5': '0.198', 'AMMO4': '0.204', 'weapon4': '0.364', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.746', 'DAMAGECOUNT': '13.545', 'FRAGCOUNT': '44.000'} [2024-08-06 05:39:35,043][52664] DAMAGECOUNT value on done: 686023.0 [2024-08-06 05:39:35,043][52664] Sum rewards: 73.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.668', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.116', 'AMMO4': '0.184', 'weapon2': '0.234', 'AMMO3': '0.246', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '63.000'} [2024-08-06 05:39:35,756][52660] DAMAGECOUNT value on done: 645253.0 [2024-08-06 05:39:35,763][52660] Sum rewards: 81.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.352', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.170', 'weapon5': '0.170', 'AMMO3': '0.213', 'AMMO4': '0.221', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '66.000'} [2024-08-06 05:39:36,273][52665] DAMAGECOUNT value on done: 638216.0 [2024-08-06 05:39:36,273][52665] Sum rewards: 73.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.042', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.388', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '61.000'} [2024-08-06 05:39:36,351][52659] DAMAGECOUNT value on done: 655818.0 [2024-08-06 05:39:36,355][52659] Sum rewards: 66.049, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.896', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.082', 'AMMO4': '0.152', 'AMMO3': '0.186', 'weapon5': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.158', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '53.000'} [2024-08-06 05:39:37,478][52794] DAMAGECOUNT value on done: 663889.0 [2024-08-06 05:39:37,478][52794] Sum rewards: 74.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.197', 'weapon2': '0.252', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '60.000'} [2024-08-06 05:39:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 514785280. Throughput: 0: 4378.2. Samples: 128700580. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:39:37,794][52567] Avg episode reward: [(0, '73.395')] [2024-08-06 05:39:37,854][52664] DAMAGECOUNT value on done: 677246.0 [2024-08-06 05:39:37,854][52664] Sum rewards: 76.298, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.146', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon5': '0.112', 'weapon4': '0.206', 'AMMO3': '0.207', 'AMMO4': '0.293', 'weapon2': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '66.000'} [2024-08-06 05:39:38,152][52650] Updated weights for policy 0, policy_version 62841 (0.0010) [2024-08-06 05:39:39,042][52665] DAMAGECOUNT value on done: 646192.0 [2024-08-06 05:39:39,043][52665] Sum rewards: 62.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.054', 'weapon4': '0.066', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '49.000'} [2024-08-06 05:39:39,129][52659] DAMAGECOUNT value on done: 652805.0 [2024-08-06 05:39:39,131][52659] Sum rewards: 64.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.122', 'AMMO4': '0.149', 'weapon2': '0.240', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '2.950', 'weapon3': '3.328', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '56.000'} [2024-08-06 05:39:40,077][52794] DAMAGECOUNT value on done: 664930.0 [2024-08-06 05:39:40,078][52794] Sum rewards: 80.773, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.508', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.072', 'AMMO4': '0.095', 'weapon5': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '69.000'} [2024-08-06 05:39:40,562][52664] DAMAGECOUNT value on done: 684439.0 [2024-08-06 05:39:40,563][52664] Sum rewards: 75.302, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.183', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 05:39:40,914][52795] DAMAGECOUNT value on done: 609895.0 [2024-08-06 05:39:40,914][52795] Sum rewards: 58.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.981', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '47.000'} [2024-08-06 05:39:41,080][52660] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 05:39:42,035][52659] DAMAGECOUNT value on done: 659557.0 [2024-08-06 05:39:42,039][52659] Sum rewards: 78.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.405', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.128', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.446', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '63.000'} [2024-08-06 05:39:42,133][52665] DAMAGECOUNT value on done: 650509.0 [2024-08-06 05:39:42,134][52665] Sum rewards: 68.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.465', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon5': '0.216', 'AMMO4': '0.230', 'weapon4': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.688', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '57.000'} [2024-08-06 05:39:42,564][52667] DAMAGECOUNT value on done: 658183.0 [2024-08-06 05:39:42,564][52667] Sum rewards: 91.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.689', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.160', 'AMMO4': '0.189', 'weapon5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.927', 'FRAGCOUNT': '76.000'} [2024-08-06 05:39:42,612][52650] Updated weights for policy 0, policy_version 62851 (0.0030) [2024-08-06 05:39:42,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 514875392. Throughput: 0: 4369.3. Samples: 128726670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:39:42,794][52567] Avg episode reward: [(0, '73.450')] [2024-08-06 05:39:42,855][52794] DAMAGECOUNT value on done: 654039.0 [2024-08-06 05:39:42,855][52794] Sum rewards: 77.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon5': '0.184', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '62.000'} [2024-08-06 05:39:43,343][52664] DAMAGECOUNT value on done: 684944.0 [2024-08-06 05:39:43,343][52664] Sum rewards: 59.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.875', 'AMMO5': '0.025', 'AMMO2': '0.063', 'AMMO3': '0.209', 'weapon5': '0.212', 'weapon4': '0.240', 'weapon2': '0.276', 'AMMO4': '0.315', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '52.000'} [2024-08-06 05:39:44,062][52795] DAMAGECOUNT value on done: 597709.0 [2024-08-06 05:39:44,063][52795] Sum rewards: 58.157, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.791', 'AMMO5': '0.011', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.058', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.286', 'weapon2': '0.462', 'WEAPON3': '1.700', 'weapon3': '3.118', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '53.000'} [2024-08-06 05:39:45,115][52659] DAMAGECOUNT value on done: 664109.0 [2024-08-06 05:39:45,115][52659] Sum rewards: 66.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.065', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.106', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.358', 'WEAPON3': '1.650', 'weapon3': '3.292', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 05:39:45,120][52667] DAMAGECOUNT value on done: 665079.0 [2024-08-06 05:39:45,124][52667] Sum rewards: 72.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.695', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.086', 'weapon5': '0.222', 'AMMO4': '0.240', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '59.000'} [2024-08-06 05:39:45,268][52665] DAMAGECOUNT value on done: 647284.0 [2024-08-06 05:39:45,268][52665] Sum rewards: 72.311, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.520', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.354', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '57.000'} [2024-08-06 05:39:45,702][52794] DAMAGECOUNT value on done: 654003.0 [2024-08-06 05:39:45,704][52794] Sum rewards: 75.094, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.042', 'AMMO5': '0.013', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.117', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '3.216', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '59.500'} [2024-08-06 05:39:45,739][52664] DAMAGECOUNT value on done: 686185.0 [2024-08-06 05:39:45,741][52664] Sum rewards: 83.347, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.012', 'AMMO2': '0.025', 'HEALTH': '0.047', 'weapon4': '0.118', 'AMMO4': '0.126', 'weapon5': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '70.000'} [2024-08-06 05:39:47,142][52650] Updated weights for policy 0, policy_version 62861 (0.0021) [2024-08-06 05:39:47,185][52795] DAMAGECOUNT value on done: 599608.0 [2024-08-06 05:39:47,185][52795] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.761', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.150', 'weapon2': '0.200', 'weapon4': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '58.000'} [2024-08-06 05:39:47,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 514965504. Throughput: 0: 4377.1. Samples: 128740060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:39:47,795][52567] Avg episode reward: [(0, '73.166')] [2024-08-06 05:39:47,811][52659] DAMAGECOUNT value on done: 652087.0 [2024-08-06 05:39:47,813][52659] Sum rewards: 74.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.142', 'weapon5': '0.146', 'AMMO4': '0.154', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '63.000'} [2024-08-06 05:39:48,234][52667] DAMAGECOUNT value on done: 658258.0 [2024-08-06 05:39:48,235][52667] Sum rewards: 70.634, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.113', 'AMMO3': '0.157', 'weapon4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '0.900', 'weapon3': '3.152', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '58.000'} [2024-08-06 05:39:48,527][52665] DAMAGECOUNT value on done: 660971.0 [2024-08-06 05:39:48,527][52665] Sum rewards: 70.154, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.168', 'AMMO3': '0.201', 'weapon4': '0.216', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '59.000'} [2024-08-06 05:39:48,640][52794] DAMAGECOUNT value on done: 658379.0 [2024-08-06 05:39:48,640][52794] Sum rewards: 82.170, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.565', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.478', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '71.000'} [2024-08-06 05:39:48,651][52664] DAMAGECOUNT value on done: 687720.0 [2024-08-06 05:39:48,653][52664] Sum rewards: 86.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.643', 'AMMO5': '0.006', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.028', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon4': '0.212', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '71.000'} [2024-08-06 05:39:49,475][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:39:49,941][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:39:50,188][52795] DAMAGECOUNT value on done: 606245.0 [2024-08-06 05:39:50,191][52795] Sum rewards: 75.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.186', 'AMMO3': '0.218', 'weapon2': '0.232', 'weapon4': '0.262', 'AMMO4': '0.301', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '62.000'} [2024-08-06 05:39:50,682][52820] DAMAGECOUNT value on done: 609611.0 [2024-08-06 05:39:50,684][52820] Sum rewards: 68.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon4': '0.148', 'weapon5': '0.188', 'AMMO3': '0.254', 'AMMO4': '0.288', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '59.000'} [2024-08-06 05:39:50,783][52659] DAMAGECOUNT value on done: 662395.0 [2024-08-06 05:39:50,784][52659] Sum rewards: 74.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO3': '0.215', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '62.000'} [2024-08-06 05:39:50,897][52667] DAMAGECOUNT value on done: 661525.0 [2024-08-06 05:39:50,897][52667] Sum rewards: 70.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.118', 'AMMO4': '0.177', 'weapon4': '0.186', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '57.000'} [2024-08-06 05:39:51,451][52794] DAMAGECOUNT value on done: 661015.0 [2024-08-06 05:39:51,451][52794] Sum rewards: 84.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.688', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.152', 'AMMO3': '0.158', 'weapon4': '0.162', 'AMMO4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.088', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '68.000'} [2024-08-06 05:39:51,511][52664] DAMAGECOUNT value on done: 690620.0 [2024-08-06 05:39:51,513][52664] Sum rewards: 70.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.384', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.096', 'AMMO4': '0.124', 'weapon5': '0.128', 'AMMO3': '0.233', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.282', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '60.000'} [2024-08-06 05:39:51,553][52665] DAMAGECOUNT value on done: 650382.0 [2024-08-06 05:39:51,557][52665] Sum rewards: 74.294, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.850', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.034', 'AMMO4': '0.108', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.304', 'weapon2': '0.436', 'WEAPON3': '0.950', 'weapon3': '2.972', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '58.500'} [2024-08-06 05:39:52,255][52650] Updated weights for policy 0, policy_version 62871 (0.0011) [2024-08-06 05:39:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17522.5). Total num frames: 515055616. Throughput: 0: 4374.9. Samples: 128766310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:39:52,795][52567] Avg episode reward: [(0, '72.783')] [2024-08-06 05:39:53,318][52659] DAMAGECOUNT value on done: 655450.0 [2024-08-06 05:39:53,319][52659] Sum rewards: 85.020, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.018', 'WEAPON4': '0.050', 'HEALTH': '0.057', 'AMMO4': '0.087', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon2': '0.468', 'WEAPON3': '0.850', 'weapon3': '3.160', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '66.000'} [2024-08-06 05:39:53,386][52795] DAMAGECOUNT value on done: 601188.0 [2024-08-06 05:39:53,386][52795] Sum rewards: 65.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'weapon4': '0.042', 'AMMO2': '0.046', 'weapon5': '0.122', 'AMMO4': '0.228', 'AMMO3': '0.229', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.320', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '55.000'} [2024-08-06 05:39:53,897][52820] DAMAGECOUNT value on done: 609358.0 [2024-08-06 05:39:53,897][52820] Sum rewards: 71.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.088', 'weapon5': '0.216', 'AMMO3': '0.230', 'AMMO4': '0.237', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 05:39:54,024][52667] DAMAGECOUNT value on done: 663942.0 [2024-08-06 05:39:54,024][52667] Sum rewards: 71.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.215', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.128', 'weapon5': '0.166', 'AMMO3': '0.223', 'AMMO4': '0.242', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '61.000'} [2024-08-06 05:39:54,398][52665] DAMAGECOUNT value on done: 657848.0 [2024-08-06 05:39:54,398][52665] Sum rewards: 57.966, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.156', 'weapon5': '0.228', 'AMMO4': '0.245', 'weapon2': '0.332', 'weapon4': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '2.800', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '47.000'} [2024-08-06 05:39:54,473][52664] DAMAGECOUNT value on done: 682987.0 [2024-08-06 05:39:54,473][52664] Sum rewards: 88.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.520', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.531', 'FRAGCOUNT': '73.000'} [2024-08-06 05:39:54,626][52794] DAMAGECOUNT value on done: 648565.0 [2024-08-06 05:39:54,626][52794] Sum rewards: 70.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.604', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.089', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.000'} [2024-08-06 05:39:55,668][52795] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:39:55,883][52659] DAMAGECOUNT value on done: 656233.0 [2024-08-06 05:39:55,883][52659] Sum rewards: 62.811, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.764', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.098', 'weapon5': '0.260', 'AMMO4': '0.295', 'AMMO3': '0.303', 'weapon2': '0.498', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.850', 'weapon3': '2.796', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '56.500'} [2024-08-06 05:39:56,468][52650] Updated weights for policy 0, policy_version 62881 (0.0013) [2024-08-06 05:39:56,556][52795] DAMAGECOUNT value on done: 612724.0 [2024-08-06 05:39:56,557][52795] Sum rewards: 67.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.242', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.182', 'weapon4': '0.184', 'AMMO4': '0.239', 'AMMO3': '0.260', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '58.000'} [2024-08-06 05:39:56,822][52665] DAMAGECOUNT value on done: 655059.0 [2024-08-06 05:39:56,823][52665] Sum rewards: 75.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.073', 'AMMO5': '0.021', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.156', 'AMMO4': '0.172', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 05:39:57,108][52820] DAMAGECOUNT value on done: 611149.0 [2024-08-06 05:39:57,109][52820] Sum rewards: 65.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.857', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO3': '0.193', 'AMMO4': '0.234', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '53.000'} [2024-08-06 05:39:57,191][52667] DAMAGECOUNT value on done: 666602.0 [2024-08-06 05:39:57,191][52667] Sum rewards: 64.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.180', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.188', 'AMMO4': '0.207', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.062', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '57.000'} [2024-08-06 05:39:57,389][52794] DAMAGECOUNT value on done: 661103.0 [2024-08-06 05:39:57,389][52794] Sum rewards: 70.706, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.062', 'AMMO3': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.362', 'weapon4': '0.492', 'WEAPON3': '0.850', 'weapon3': '2.938', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '55.000'} [2024-08-06 05:39:57,677][52664] DAMAGECOUNT value on done: 678279.0 [2024-08-06 05:39:57,681][52664] Sum rewards: 81.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.570', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.082', 'weapon4': '0.086', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.380', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '70.000'} [2024-08-06 05:39:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.2). Total num frames: 515137536. Throughput: 0: 4370.9. Samples: 128792450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:39:57,794][52567] Avg episode reward: [(0, '72.737')] [2024-08-06 05:39:58,609][52659] DAMAGECOUNT value on done: 667550.0 [2024-08-06 05:39:58,611][52659] Sum rewards: 80.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.730', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.102', 'AMMO4': '0.141', 'AMMO3': '0.235', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.360', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '68.000'} [2024-08-06 05:39:59,292][52665] DAMAGECOUNT value on done: 653673.0 [2024-08-06 05:39:59,292][52665] Sum rewards: 80.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.170', 'weapon4': '0.188', 'AMMO3': '0.201', 'AMMO4': '0.236', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '65.000'} [2024-08-06 05:39:59,683][52795] DAMAGECOUNT value on done: 614758.0 [2024-08-06 05:39:59,683][52795] Sum rewards: 69.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.055', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.270', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:00,147][52820] DAMAGECOUNT value on done: 602423.0 [2024-08-06 05:40:00,148][52820] Sum rewards: 68.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO2': '0.009', 'AMMO5': '0.013', 'weapon4': '0.030', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.188', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:00,167][52667] DAMAGECOUNT value on done: 661052.0 [2024-08-06 05:40:00,168][52667] Sum rewards: 71.494, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.705', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon2': '0.224', 'weapon5': '0.238', 'AMMO3': '0.312', 'weapon4': '0.338', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.800', 'weapon3': '2.832', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '61.500'} [2024-08-06 05:40:00,190][52794] DAMAGECOUNT value on done: 653168.0 [2024-08-06 05:40:00,192][52794] Sum rewards: 64.777, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.048', 'weapon4': '0.058', 'AMMO4': '0.166', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.434', 'weapon2': '0.552', 'WEAPON3': '0.950', 'weapon3': '3.178', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '52.000'} [2024-08-06 05:40:00,486][52664] DAMAGECOUNT value on done: 680218.0 [2024-08-06 05:40:00,488][52664] Sum rewards: 65.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.082', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.060', 'weapon4': '0.166', 'AMMO3': '0.217', 'AMMO4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:01,717][52650] Updated weights for policy 0, policy_version 62891 (0.0019) [2024-08-06 05:40:01,783][52659] DAMAGECOUNT value on done: 660194.0 [2024-08-06 05:40:01,783][52659] Sum rewards: 74.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.125', 'weapon5': '0.162', 'AMMO3': '0.181', 'weapon2': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.270', 'weapon3': '3.340', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:02,332][52665] DAMAGECOUNT value on done: 648922.0 [2024-08-06 05:40:02,334][52665] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.160', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.173', 'weapon5': '0.186', 'AMMO3': '0.258', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.206', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '64.000'} [2024-08-06 05:40:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 515227648. Throughput: 0: 4372.9. Samples: 128805670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:40:02,794][52567] Avg episode reward: [(0, '72.442')] [2024-08-06 05:40:02,858][52795] DAMAGECOUNT value on done: 607775.0 [2024-08-06 05:40:02,858][52795] Sum rewards: 77.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.080', 'weapon5': '0.128', 'AMMO3': '0.213', 'AMMO4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '63.000'} [2024-08-06 05:40:03,020][52664] DAMAGECOUNT value on done: 683118.0 [2024-08-06 05:40:03,021][52664] Sum rewards: 73.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.474', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.079', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.672', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:03,035][52667] DAMAGECOUNT value on done: 659982.0 [2024-08-06 05:40:03,037][52667] Sum rewards: 72.991, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.313', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.062', 'AMMO3': '0.177', 'weapon2': '0.342', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.430', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:03,044][52794] DAMAGECOUNT value on done: 651693.0 [2024-08-06 05:40:03,044][52794] Sum rewards: 77.858, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.189', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'AMMO4': '0.202', 'weapon4': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:03,169][52820] DAMAGECOUNT value on done: 609930.0 [2024-08-06 05:40:03,170][52820] Sum rewards: 70.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.818', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.149', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:04,622][52659] DAMAGECOUNT value on done: 665138.0 [2024-08-06 05:40:04,623][52659] Sum rewards: 71.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.813', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.160', 'weapon5': '0.190', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:05,215][52811] DAMAGECOUNT value on done: 628538.0 [2024-08-06 05:40:05,216][52811] Sum rewards: 77.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.221', 'weapon5': '0.224', 'weapon2': '0.312', 'WEAPON5': '0.450', 'weapon4': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.700', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '64.000'} [2024-08-06 05:40:05,458][52665] DAMAGECOUNT value on done: 649120.0 [2024-08-06 05:40:05,460][52665] Sum rewards: 63.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.408', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.128', 'weapon4': '0.188', 'weapon2': '0.204', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.282', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '54.000'} [2024-08-06 05:40:05,844][52667] DAMAGECOUNT value on done: 663851.0 [2024-08-06 05:40:05,848][52667] Sum rewards: 80.293, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.465', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.242', 'WEAPON3': '1.150', 'weapon3': '3.482', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:05,907][52650] Updated weights for policy 0, policy_version 62901 (0.0011) [2024-08-06 05:40:05,917][52664] DAMAGECOUNT value on done: 680340.0 [2024-08-06 05:40:05,918][52664] Sum rewards: 78.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '63.000'} [2024-08-06 05:40:06,103][52795] DAMAGECOUNT value on done: 603799.0 [2024-08-06 05:40:06,105][52795] Sum rewards: 79.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.072', 'AMMO4': '0.173', 'weapon5': '0.188', 'AMMO3': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:06,251][52820] DAMAGECOUNT value on done: 601011.0 [2024-08-06 05:40:06,252][52820] Sum rewards: 55.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.120', 'weapon5': '0.202', 'AMMO3': '0.214', 'AMMO4': '0.258', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.144', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '45.000'} [2024-08-06 05:40:06,392][52794] DAMAGECOUNT value on done: 658089.0 [2024-08-06 05:40:06,392][52794] Sum rewards: 79.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon5': '0.226', 'AMMO3': '0.230', 'weapon2': '0.244', 'weapon4': '0.244', 'AMMO4': '0.249', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:07,330][52659] DAMAGECOUNT value on done: 653882.0 [2024-08-06 05:40:07,330][52659] Sum rewards: 64.231, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.617', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '51.000'} [2024-08-06 05:40:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 515309568. Throughput: 0: 4376.0. Samples: 128832010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:40:07,795][52567] Avg episode reward: [(0, '72.229')] [2024-08-06 05:40:08,359][52811] DAMAGECOUNT value on done: 607417.0 [2024-08-06 05:40:08,367][52811] Sum rewards: 57.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.795', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.544', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.130', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '48.000'} [2024-08-06 05:40:08,528][52665] DAMAGECOUNT value on done: 649102.0 [2024-08-06 05:40:08,529][52665] Sum rewards: 64.548, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.246', 'AMMO3': '0.298', 'WEAPON3': '1.750', 'weapon3': '3.448', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:08,642][52667] DAMAGECOUNT value on done: 667822.0 [2024-08-06 05:40:08,646][52667] Sum rewards: 68.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.182', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.142', 'AMMO3': '0.219', 'weapon4': '0.244', 'weapon2': '0.270', 'AMMO4': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:09,231][52795] DAMAGECOUNT value on done: 611896.0 [2024-08-06 05:40:09,231][52795] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.594', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.074', 'AMMO3': '0.167', 'AMMO4': '0.179', 'weapon5': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:09,315][52820] DAMAGECOUNT value on done: 609640.0 [2024-08-06 05:40:09,315][52820] Sum rewards: 78.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.136', 'AMMO4': '0.185', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:09,328][52794] DAMAGECOUNT value on done: 653769.0 [2024-08-06 05:40:09,330][52794] Sum rewards: 83.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.128', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '68.000'} [2024-08-06 05:40:10,536][52659] DAMAGECOUNT value on done: 664301.0 [2024-08-06 05:40:10,536][52659] Sum rewards: 84.120, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.112', 'AMMO3': '0.129', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '0.900', 'weapon3': '3.126', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '66.000'} [2024-08-06 05:40:10,758][52650] Updated weights for policy 0, policy_version 62911 (0.0012) [2024-08-06 05:40:11,498][52811] DAMAGECOUNT value on done: 607828.0 [2024-08-06 05:40:11,502][52811] Sum rewards: 74.761, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.407', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.198', 'weapon2': '0.200', 'WEAPON3': '1.400', 'weapon3': '3.546', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:11,542][52665] DAMAGECOUNT value on done: 649328.0 [2024-08-06 05:40:11,542][52665] Sum rewards: 81.128, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.220', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon4': '0.202', 'weapon5': '0.226', 'AMMO3': '0.253', 'AMMO4': '0.310', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.778', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '68.000'} [2024-08-06 05:40:11,634][52667] DAMAGECOUNT value on done: 656268.0 [2024-08-06 05:40:11,634][52667] Sum rewards: 78.487, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.016', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.099', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.402', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:11,804][52794] DAMAGECOUNT value on done: 669023.0 [2024-08-06 05:40:11,806][52794] Sum rewards: 71.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.591', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon5': '0.182', 'AMMO3': '0.201', 'weapon2': '0.216', 'AMMO4': '0.241', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:12,348][52820] DAMAGECOUNT value on done: 613055.0 [2024-08-06 05:40:12,349][52820] Sum rewards: 70.128, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.288', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.230', 'AMMO3': '0.231', 'weapon5': '0.284', 'AMMO4': '0.300', 'weapon2': '0.434', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:12,372][52795] DAMAGECOUNT value on done: 608102.0 [2024-08-06 05:40:12,376][52795] Sum rewards: 73.311, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.610', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon4': '0.106', 'weapon5': '0.176', 'AMMO4': '0.223', 'weapon2': '0.258', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.184', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '64.000'} [2024-08-06 05:40:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 515399680. Throughput: 0: 4369.1. Samples: 128858150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 05:40:12,802][52567] Avg episode reward: [(0, '72.265')] [2024-08-06 05:40:13,662][52659] DAMAGECOUNT value on done: 656862.0 [2024-08-06 05:40:13,662][52659] Sum rewards: 74.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.190', 'weapon4': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.316', 'ARMOR': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:14,329][52794] DAMAGECOUNT value on done: 653041.0 [2024-08-06 05:40:14,331][52794] Sum rewards: 74.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.512', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.092', 'weapon5': '0.202', 'AMMO3': '0.228', 'AMMO4': '0.240', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '63.000'} [2024-08-06 05:40:14,457][52667] DAMAGECOUNT value on done: 657423.0 [2024-08-06 05:40:14,458][52667] Sum rewards: 75.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.106', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.180', 'AMMO3': '0.186', 'weapon4': '0.202', 'AMMO4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:14,491][52665] DAMAGECOUNT value on done: 644182.0 [2024-08-06 05:40:14,492][52665] Sum rewards: 70.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.475', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.123', 'weapon4': '0.210', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:14,593][52811] DAMAGECOUNT value on done: 609483.0 [2024-08-06 05:40:14,595][52811] Sum rewards: 71.778, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.045', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO3': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.342', 'WEAPON3': '0.550', 'weapon2': '0.692', 'weapon3': '2.792', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '52.000'} [2024-08-06 05:40:15,519][52650] Updated weights for policy 0, policy_version 62921 (0.0021) [2024-08-06 05:40:15,539][52820] DAMAGECOUNT value on done: 607834.0 [2024-08-06 05:40:15,540][52820] Sum rewards: 74.184, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.851', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.075', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:15,708][52795] DAMAGECOUNT value on done: 603431.0 [2024-08-06 05:40:15,708][52795] Sum rewards: 78.219, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.152', 'weapon5': '0.166', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'weapon3': '3.284', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:17,488][52794] DAMAGECOUNT value on done: 667061.0 [2024-08-06 05:40:17,492][52794] Sum rewards: 75.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.109', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO4': '0.176', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '61.500'} [2024-08-06 05:40:17,538][52667] DAMAGECOUNT value on done: 663162.0 [2024-08-06 05:40:17,539][52667] Sum rewards: 70.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.724', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.108', 'AMMO3': '0.190', 'weapon5': '0.246', 'AMMO4': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:17,705][52665] DAMAGECOUNT value on done: 649008.0 [2024-08-06 05:40:17,705][52665] Sum rewards: 67.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.505', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.127', 'weapon5': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.550', 'weapon3': '2.956', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:17,716][52811] DAMAGECOUNT value on done: 618020.0 [2024-08-06 05:40:17,720][52811] Sum rewards: 82.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.138', 'weapon5': '0.180', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '21.030', 'FRAGCOUNT': '65.500'} [2024-08-06 05:40:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 515489792. Throughput: 0: 4375.6. Samples: 128871260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:17,794][52567] Avg episode reward: [(0, '72.881')] [2024-08-06 05:40:18,219][52658] Large shaping reward 2.512 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0)] [2024-08-06 05:40:18,251][52663] DAMAGECOUNT value on done: 667157.0 [2024-08-06 05:40:18,253][52663] Sum rewards: 69.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.038', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.092', 'AMMO4': '0.099', 'weapon4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.366', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:18,635][52820] DAMAGECOUNT value on done: 615189.0 [2024-08-06 05:40:18,637][52820] Sum rewards: 82.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.089', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.142', 'AMMO3': '0.180', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '66.000'} [2024-08-06 05:40:18,959][52795] DAMAGECOUNT value on done: 602641.0 [2024-08-06 05:40:18,963][52795] Sum rewards: 63.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.362', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.110', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.000'} [2024-08-06 05:40:19,938][52650] Updated weights for policy 0, policy_version 62931 (0.0055) [2024-08-06 05:40:20,247][52667] DAMAGECOUNT value on done: 654587.0 [2024-08-06 05:40:20,249][52667] Sum rewards: 70.060, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-3.185', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.084', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'AMMO3': '0.368', 'WEAPON3': '2.100', 'weapon3': '3.178', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:20,707][52794] DAMAGECOUNT value on done: 660623.0 [2024-08-06 05:40:20,709][52794] Sum rewards: 69.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.048', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:20,872][52665] DAMAGECOUNT value on done: 653985.0 [2024-08-06 05:40:20,872][52665] Sum rewards: 86.291, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.880', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'weapon2': '0.442', 'weapon4': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '71.000'} [2024-08-06 05:40:20,890][52811] DAMAGECOUNT value on done: 622552.0 [2024-08-06 05:40:20,891][52811] Sum rewards: 75.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.881', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.076', 'AMMO4': '0.161', 'weapon5': '0.162', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '64.000'} [2024-08-06 05:40:21,403][52663] DAMAGECOUNT value on done: 659048.0 [2024-08-06 05:40:21,403][52663] Sum rewards: 70.165, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.140', 'weapon5': '0.186', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '57.000'} [2024-08-06 05:40:21,810][52820] DAMAGECOUNT value on done: 605018.0 [2024-08-06 05:40:21,810][52820] Sum rewards: 64.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.132', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.084', 'weapon4': '0.154', 'AMMO4': '0.158', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.210', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '53.500'} [2024-08-06 05:40:22,128][52795] DAMAGECOUNT value on done: 611181.0 [2024-08-06 05:40:22,128][52795] Sum rewards: 82.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.005', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.251', 'WEAPON3': '1.650', 'weapon3': '3.434', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '70.000'} [2024-08-06 05:40:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 515571712. Throughput: 0: 4374.0. Samples: 128897410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:22,802][52567] Avg episode reward: [(0, '72.963')] [2024-08-06 05:40:23,308][52667] DAMAGECOUNT value on done: 662156.0 [2024-08-06 05:40:23,313][52667] Sum rewards: 66.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.022', 'AMMO2': '0.054', 'AMMO3': '0.175', 'weapon5': '0.198', 'weapon4': '0.212', 'weapon2': '0.270', 'AMMO4': '0.271', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:23,674][52794] DAMAGECOUNT value on done: 665306.0 [2024-08-06 05:40:23,676][52794] Sum rewards: 72.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.132', 'AMMO4': '0.170', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.400', 'weapon4': '0.712', 'WEAPON3': '1.350', 'weapon3': '2.522', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:24,070][52811] DAMAGECOUNT value on done: 618721.0 [2024-08-06 05:40:24,071][52811] Sum rewards: 78.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.021', 'AMMO2': '0.069', 'weapon4': '0.130', 'AMMO3': '0.231', 'weapon5': '0.286', 'weapon2': '0.322', 'AMMO4': '0.345', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:24,474][52663] DAMAGECOUNT value on done: 650841.0 [2024-08-06 05:40:24,474][52663] Sum rewards: 73.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.979', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.622', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:24,892][52650] Updated weights for policy 0, policy_version 62941 (0.0013) [2024-08-06 05:40:25,044][52820] DAMAGECOUNT value on done: 612479.0 [2024-08-06 05:40:25,044][52820] Sum rewards: 70.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.315', 'AMMO5': '0.025', 'AMMO2': '0.076', 'AMMO3': '0.230', 'weapon2': '0.238', 'weapon4': '0.280', 'weapon5': '0.380', 'AMMO4': '0.382', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:25,350][52795] DAMAGECOUNT value on done: 597625.0 [2024-08-06 05:40:25,350][52795] Sum rewards: 62.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.807', 'AMMO5': '0.023', 'AMMO2': '0.060', 'AMMO3': '0.203', 'weapon2': '0.204', 'weapon5': '0.282', 'AMMO4': '0.302', 'weapon4': '0.534', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '52.000'} [2024-08-06 05:40:26,647][52794] DAMAGECOUNT value on done: 667085.0 [2024-08-06 05:40:26,649][52794] Sum rewards: 70.258, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.328', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:26,666][52667] DAMAGECOUNT value on done: 669647.0 [2024-08-06 05:40:26,667][52667] Sum rewards: 69.424, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.382', 'weapon4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:27,107][52811] DAMAGECOUNT value on done: 609785.0 [2024-08-06 05:40:27,108][52811] Sum rewards: 69.116, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.191', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.199', 'weapon5': '0.208', 'weapon4': '0.214', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.656', 'WEAPON3': '1.350', 'weapon3': '2.670', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 515661824. Throughput: 0: 4374.0. Samples: 128923500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:27,802][52567] Avg episode reward: [(0, '72.696')] [2024-08-06 05:40:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062947_515661824.pth... [2024-08-06 05:40:27,902][52663] DAMAGECOUNT value on done: 656372.0 [2024-08-06 05:40:27,904][52663] Sum rewards: 69.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.275', 'AMMO5': '0.027', 'AMMO2': '0.077', 'weapon4': '0.148', 'AMMO3': '0.237', 'weapon5': '0.376', 'AMMO4': '0.387', 'weapon2': '0.424', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.688', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:27,927][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062435_511467520.pth [2024-08-06 05:40:28,094][52820] DAMAGECOUNT value on done: 618791.0 [2024-08-06 05:40:28,094][52820] Sum rewards: 84.143, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.632', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '3.190', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:28,552][52795] DAMAGECOUNT value on done: 615450.0 [2024-08-06 05:40:28,552][52795] Sum rewards: 80.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.054', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '66.000'} [2024-08-06 05:40:29,333][52650] Updated weights for policy 0, policy_version 62951 (0.0027) [2024-08-06 05:40:29,659][52794] DAMAGECOUNT value on done: 659233.0 [2024-08-06 05:40:29,659][52794] Sum rewards: 71.737, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.026', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon2': '0.150', 'weapon5': '0.172', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'HEALTH': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.444', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:29,700][52667] DAMAGECOUNT value on done: 666270.0 [2024-08-06 05:40:29,702][52667] Sum rewards: 66.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.092', 'AMMO3': '0.206', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:30,334][52811] DAMAGECOUNT value on done: 623264.0 [2024-08-06 05:40:30,334][52811] Sum rewards: 68.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.988', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.124', 'weapon2': '0.186', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.252', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.236', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '55.000'} [2024-08-06 05:40:30,573][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:40:30,596][52663] DAMAGECOUNT value on done: 660156.0 [2024-08-06 05:40:30,600][52663] Sum rewards: 63.786, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.150', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.110', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'AMMO3': '0.306', 'WEAPON3': '1.850', 'HITCOUNT': '3.270', 'weapon3': '3.272', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '57.000'} [2024-08-06 05:40:30,992][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:40:31,270][52820] DAMAGECOUNT value on done: 612357.0 [2024-08-06 05:40:31,271][52820] Sum rewards: 71.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.286', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.240', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:31,666][52795] DAMAGECOUNT value on done: 609916.0 [2024-08-06 05:40:31,666][52795] Sum rewards: 75.639, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.382', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.110', 'AMMO4': '0.151', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'WEAPON3': '1.750', 'weapon3': '3.436', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:31,779][52647] DAMAGECOUNT value on done: 698216.0 [2024-08-06 05:40:31,779][52647] Sum rewards: 74.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.671', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.392', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:32,727][52670] DAMAGECOUNT value on done: 649906.0 [2024-08-06 05:40:32,727][52670] Sum rewards: 76.173, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO2': '0.013', 'AMMO5': '0.015', 'AMMO4': '0.067', 'weapon4': '0.082', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:32,759][52667] DAMAGECOUNT value on done: 666456.0 [2024-08-06 05:40:32,761][52667] Sum rewards: 62.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.658', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.192', 'weapon5': '0.202', 'AMMO3': '0.204', 'weapon2': '0.264', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '52.000'} [2024-08-06 05:40:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 515751936. Throughput: 0: 4368.7. Samples: 128936650. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:32,794][52567] Avg episode reward: [(0, '72.997')] [2024-08-06 05:40:32,937][52666] DAMAGECOUNT value on done: 658892.0 [2024-08-06 05:40:32,940][52666] Sum rewards: 73.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.542', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.110', 'AMMO3': '0.199', 'weapon2': '0.240', 'AMMO4': '0.242', 'weapon5': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:33,301][52663] DAMAGECOUNT value on done: 667707.0 [2024-08-06 05:40:33,302][52663] Sum rewards: 68.643, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.370', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon2': '0.184', 'AMMO3': '0.296', 'WEAPON3': '1.850', 'weapon3': '3.504', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:33,557][52811] DAMAGECOUNT value on done: 615194.0 [2024-08-06 05:40:33,560][52811] Sum rewards: 69.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.236', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:34,350][52650] Updated weights for policy 0, policy_version 62961 (0.0016) [2024-08-06 05:40:34,391][52647] DAMAGECOUNT value on done: 690956.0 [2024-08-06 05:40:34,392][52647] Sum rewards: 58.679, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.278', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.138', 'weapon5': '0.168', 'weapon2': '0.208', 'AMMO4': '0.247', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.690', 'weapon3': '3.246', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '53.000'} [2024-08-06 05:40:34,415][52820] DAMAGECOUNT value on done: 616459.0 [2024-08-06 05:40:34,417][52820] Sum rewards: 70.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.006', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.138', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.208', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:34,786][52795] DAMAGECOUNT value on done: 602614.0 [2024-08-06 05:40:34,787][52795] Sum rewards: 70.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.066', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.111', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.594', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:35,837][52667] DAMAGECOUNT value on done: 658904.0 [2024-08-06 05:40:35,837][52667] Sum rewards: 73.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.140', 'AMMO3': '0.162', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '3.098', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:36,028][52663] DAMAGECOUNT value on done: 654738.0 [2024-08-06 05:40:36,030][52663] Sum rewards: 59.099, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.528', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.126', 'AMMO4': '0.126', 'AMMO3': '0.142', 'WEAPON4': '0.300', 'weapon5': '0.320', 'WEAPON5': '0.400', 'weapon2': '0.672', 'WEAPON3': '0.950', 'weapon3': '2.690', 'HITCOUNT': '2.790', 'DAMAGECOUNT': '14.073', 'FRAGCOUNT': '47.000'} [2024-08-06 05:40:36,156][52670] DAMAGECOUNT value on done: 659957.0 [2024-08-06 05:40:36,157][52670] Sum rewards: 63.861, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.270', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.190', 'weapon5': '0.250', 'AMMO4': '0.258', 'AMMO3': '0.267', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.880', 'weapon3': '2.926', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '57.000'} [2024-08-06 05:40:36,366][52666] DAMAGECOUNT value on done: 658743.0 [2024-08-06 05:40:36,366][52666] Sum rewards: 76.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.884', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.104', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.183', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:36,666][52811] DAMAGECOUNT value on done: 618884.0 [2024-08-06 05:40:36,666][52811] Sum rewards: 66.258, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.602', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.110', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.376', 'WEAPON3': '1.700', 'weapon3': '3.190', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 05:40:36,995][52647] DAMAGECOUNT value on done: 695131.0 [2024-08-06 05:40:36,995][52647] Sum rewards: 72.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.381', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.136', 'AMMO4': '0.166', 'AMMO3': '0.197', 'weapon5': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:37,539][52820] DAMAGECOUNT value on done: 611572.0 [2024-08-06 05:40:37,539][52820] Sum rewards: 76.169, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.156', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.068', 'weapon5': '0.134', 'AMMO4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.324', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.1). Total num frames: 515833856. Throughput: 0: 4359.8. Samples: 128962500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:37,794][52567] Avg episode reward: [(0, '72.234')] [2024-08-06 05:40:37,910][52795] DAMAGECOUNT value on done: 610709.0 [2024-08-06 05:40:37,911][52795] Sum rewards: 74.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.118', 'AMMO4': '0.121', 'weapon5': '0.140', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '63.000'} [2024-08-06 05:40:38,612][52667] DAMAGECOUNT value on done: 668032.0 [2024-08-06 05:40:38,616][52667] Sum rewards: 76.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.814', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.190', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '61.500'} [2024-08-06 05:40:38,819][52670] DAMAGECOUNT value on done: 649677.0 [2024-08-06 05:40:38,821][52670] Sum rewards: 68.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.808', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.126', 'AMMO3': '0.155', 'AMMO4': '0.164', 'weapon5': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.060', 'weapon3': '3.076', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:38,874][52666] DAMAGECOUNT value on done: 658877.0 [2024-08-06 05:40:38,874][52666] Sum rewards: 74.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.377', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.135', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:38,962][52663] DAMAGECOUNT value on done: 649103.0 [2024-08-06 05:40:38,962][52663] Sum rewards: 66.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.154', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon4': '0.026', 'weapon5': '0.038', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.500', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '54.000'} [2024-08-06 05:40:39,406][52650] Updated weights for policy 0, policy_version 62971 (0.0036) [2024-08-06 05:40:39,674][52647] DAMAGECOUNT value on done: 694265.0 [2024-08-06 05:40:39,676][52647] Sum rewards: 69.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.713', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.132', 'weapon2': '0.210', 'AMMO3': '0.242', 'AMMO4': '0.270', 'weapon4': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:39,774][52811] DAMAGECOUNT value on done: 623122.0 [2024-08-06 05:40:39,775][52811] Sum rewards: 74.054, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.184', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.314', 'WEAPON3': '1.800', 'weapon3': '3.412', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '64.000'} [2024-08-06 05:40:40,702][52820] DAMAGECOUNT value on done: 612579.0 [2024-08-06 05:40:40,705][52820] Sum rewards: 71.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.258', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.154', 'AMMO3': '0.210', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.748', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:41,049][52795] DAMAGECOUNT value on done: 615621.0 [2024-08-06 05:40:41,051][52795] Sum rewards: 59.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.469', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon4': '0.146', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '2.900', 'weapon3': '3.132', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '49.000'} [2024-08-06 05:40:41,716][52670] DAMAGECOUNT value on done: 648172.0 [2024-08-06 05:40:41,717][52670] Sum rewards: 73.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.057', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.386', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:41,745][52663] DAMAGECOUNT value on done: 652424.0 [2024-08-06 05:40:41,745][52663] Sum rewards: 81.798, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon2': '0.158', 'HEALTH': '0.190', 'AMMO3': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.498', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '69.000'} [2024-08-06 05:40:41,786][52666] DAMAGECOUNT value on done: 659615.0 [2024-08-06 05:40:41,786][52666] Sum rewards: 70.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.276', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '59.500'} [2024-08-06 05:40:42,156][52647] DAMAGECOUNT value on done: 704307.0 [2024-08-06 05:40:42,157][52647] Sum rewards: 76.673, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon2': '0.154', 'AMMO3': '0.196', 'weapon5': '0.206', 'AMMO4': '0.310', 'weapon4': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 515915776. Throughput: 0: 4363.6. Samples: 128988810. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:42,794][52567] Avg episode reward: [(0, '72.146')] [2024-08-06 05:40:42,910][52811] DAMAGECOUNT value on done: 615005.0 [2024-08-06 05:40:42,912][52811] Sum rewards: 76.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.810', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon2': '0.206', 'weapon5': '0.212', 'AMMO4': '0.220', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:43,439][52650] Updated weights for policy 0, policy_version 62981 (0.0014) [2024-08-06 05:40:43,803][52820] DAMAGECOUNT value on done: 623467.0 [2024-08-06 05:40:43,805][52820] Sum rewards: 71.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.265', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon4': '0.344', 'weapon2': '0.462', 'WEAPON3': '0.950', 'weapon3': '2.900', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:44,548][52663] DAMAGECOUNT value on done: 655997.0 [2024-08-06 05:40:44,548][52663] Sum rewards: 63.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.745', 'AMMO5': '0.022', 'AMMO2': '0.085', 'weapon4': '0.094', 'AMMO3': '0.226', 'weapon5': '0.296', 'weapon2': '0.380', 'AMMO4': '0.423', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '54.000'} [2024-08-06 05:40:44,754][52670] DAMAGECOUNT value on done: 660016.0 [2024-08-06 05:40:44,754][52670] Sum rewards: 63.867, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.189', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.270', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.298', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '55.000'} [2024-08-06 05:40:44,764][52658] DAMAGECOUNT value on done: 660599.0 [2024-08-06 05:40:44,767][52658] Sum rewards: 80.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.470', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.122', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.316', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:44,800][52666] DAMAGECOUNT value on done: 651901.0 [2024-08-06 05:40:44,801][52666] Sum rewards: 76.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.220', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '64.000'} [2024-08-06 05:40:44,851][52647] DAMAGECOUNT value on done: 700398.0 [2024-08-06 05:40:44,851][52647] Sum rewards: 76.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.604', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.382', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '63.000'} [2024-08-06 05:40:44,880][52803] DAMAGECOUNT value on done: 613534.0 [2024-08-06 05:40:44,884][52803] Sum rewards: 74.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.914', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.148', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:46,095][52811] DAMAGECOUNT value on done: 611092.0 [2024-08-06 05:40:46,096][52811] Sum rewards: 82.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.462', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '69.000'} [2024-08-06 05:40:46,498][52669] DAMAGECOUNT value on done: 662448.0 [2024-08-06 05:40:46,499][52669] Sum rewards: 91.153, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.116', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'HEALTH': '0.269', 'weapon2': '0.342', 'WEAPON3': '1.050', 'weapon3': '3.178', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '74.000'} [2024-08-06 05:40:47,038][52820] DAMAGECOUNT value on done: 621301.0 [2024-08-06 05:40:47,042][52820] Sum rewards: 62.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.109', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.263', 'weapon2': '0.278', 'WEAPON3': '1.550', 'HITCOUNT': '3.180', 'weapon3': '3.474', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '55.000'} [2024-08-06 05:40:47,265][52670] DAMAGECOUNT value on done: 655038.0 [2024-08-06 05:40:47,266][52670] Sum rewards: 68.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.905', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.093', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.392', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:47,302][52647] DAMAGECOUNT value on done: 697804.0 [2024-08-06 05:40:47,303][52647] Sum rewards: 83.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.776', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.120', 'weapon5': '0.204', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:47,328][52666] DAMAGECOUNT value on done: 653611.0 [2024-08-06 05:40:47,328][52666] Sum rewards: 83.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.838', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon4': '0.176', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:47,701][52658] DAMAGECOUNT value on done: 659642.0 [2024-08-06 05:40:47,701][52658] Sum rewards: 77.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.960', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 516005888. Throughput: 0: 4355.1. Samples: 129001650. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:47,794][52567] Avg episode reward: [(0, '72.524')] [2024-08-06 05:40:47,851][52663] DAMAGECOUNT value on done: 665365.0 [2024-08-06 05:40:47,852][52663] Sum rewards: 69.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.535', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.244', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '58.500'} [2024-08-06 05:40:48,074][52803] DAMAGECOUNT value on done: 613455.0 [2024-08-06 05:40:48,074][52803] Sum rewards: 78.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.172', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '64.000'} [2024-08-06 05:40:48,511][52650] Updated weights for policy 0, policy_version 62991 (0.0014) [2024-08-06 05:40:49,342][52811] DAMAGECOUNT value on done: 612984.0 [2024-08-06 05:40:49,343][52811] Sum rewards: 73.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.966', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.060', 'AMMO3': '0.195', 'AMMO4': '0.228', 'weapon5': '0.228', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '59.000'} [2024-08-06 05:40:49,816][52669] DAMAGECOUNT value on done: 652778.0 [2024-08-06 05:40:49,816][52669] Sum rewards: 83.764, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.797', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:50,118][52647] DAMAGECOUNT value on done: 682110.0 [2024-08-06 05:40:50,123][52647] Sum rewards: 73.924, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.385', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.160', 'AMMO4': '0.168', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.800', 'weapon3': '3.208', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:50,127][52820] DAMAGECOUNT value on done: 609249.0 [2024-08-06 05:40:50,130][52820] Sum rewards: 85.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.202', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.036', 'FRAGCOUNT': '70.000'} [2024-08-06 05:40:50,167][52670] DAMAGECOUNT value on done: 645995.0 [2024-08-06 05:40:50,169][52670] Sum rewards: 59.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.086', 'AMMO4': '0.245', 'weapon2': '0.254', 'weapon5': '0.258', 'AMMO3': '0.269', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'HITCOUNT': '3.070', 'weapon3': '3.098', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '51.500'} [2024-08-06 05:40:50,226][52658] DAMAGECOUNT value on done: 663505.0 [2024-08-06 05:40:50,226][52658] Sum rewards: 75.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.162', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.156', 'AMMO3': '0.212', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '62.000'} [2024-08-06 05:40:50,232][52666] DAMAGECOUNT value on done: 653473.0 [2024-08-06 05:40:50,232][52666] Sum rewards: 64.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO3': '0.198', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '52.000'} [2024-08-06 05:40:51,173][52663] DAMAGECOUNT value on done: 652091.0 [2024-08-06 05:40:51,173][52663] Sum rewards: 74.650, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.010', 'AMMO5': '0.006', 'AMMO2': '0.046', 'weapon5': '0.076', 'weapon4': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.231', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.270', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:51,205][52803] DAMAGECOUNT value on done: 619992.0 [2024-08-06 05:40:51,208][52803] Sum rewards: 78.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.912', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:52,572][52811] DAMAGECOUNT value on done: 612067.0 [2024-08-06 05:40:52,574][52811] Sum rewards: 66.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.898', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.098', 'weapon5': '0.114', 'AMMO4': '0.157', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.214', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '55.000'} [2024-08-06 05:40:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 516096000. Throughput: 0: 4350.5. Samples: 129027780. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:40:52,794][52567] Avg episode reward: [(0, '72.726')] [2024-08-06 05:40:52,811][52669] DAMAGECOUNT value on done: 664400.0 [2024-08-06 05:40:52,812][52669] Sum rewards: 76.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.654', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.042', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.100', 'weapon3': '3.438', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:53,039][52670] DAMAGECOUNT value on done: 652722.0 [2024-08-06 05:40:53,040][52670] Sum rewards: 73.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.748', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.368', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:53,088][52666] DAMAGECOUNT value on done: 650506.0 [2024-08-06 05:40:53,090][52666] Sum rewards: 52.667, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.484', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon4': '0.312', 'weapon2': '0.822', 'WEAPON3': '1.050', 'weapon3': '2.714', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '12.855', 'FRAGCOUNT': '42.000'} [2024-08-06 05:40:53,131][52650] Updated weights for policy 0, policy_version 63001 (0.0014) [2024-08-06 05:40:53,180][52658] DAMAGECOUNT value on done: 663205.0 [2024-08-06 05:40:53,181][52658] Sum rewards: 80.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.076', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '66.000'} [2024-08-06 05:40:53,253][52647] DAMAGECOUNT value on done: 695563.0 [2024-08-06 05:40:53,253][52647] Sum rewards: 72.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.069', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.146', 'AMMO4': '0.171', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '60.000'} [2024-08-06 05:40:53,396][52671] DAMAGECOUNT value on done: 663230.0 [2024-08-06 05:40:53,399][52671] Sum rewards: 74.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.050', 'weapon5': '0.176', 'AMMO3': '0.211', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:54,064][52663] DAMAGECOUNT value on done: 648698.0 [2024-08-06 05:40:54,066][52663] Sum rewards: 73.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.021', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.235', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '63.000'} [2024-08-06 05:40:54,298][52803] DAMAGECOUNT value on done: 620084.0 [2024-08-06 05:40:54,298][52803] Sum rewards: 74.062, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.814', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '0.950', 'HITCOUNT': '3.310', 'weapon3': '3.394', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:55,580][52670] DAMAGECOUNT value on done: 651783.0 [2024-08-06 05:40:55,580][52670] Sum rewards: 79.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.082', 'weapon4': '0.086', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '67.000'} [2024-08-06 05:40:55,716][52811] DAMAGECOUNT value on done: 617009.0 [2024-08-06 05:40:55,719][52811] Sum rewards: 62.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.066', 'AMMO4': '0.184', 'weapon5': '0.238', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.700', 'weapon3': '3.024', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '55.000'} [2024-08-06 05:40:55,732][52666] DAMAGECOUNT value on done: 656942.0 [2024-08-06 05:40:55,732][52666] Sum rewards: 62.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.685', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.242', 'AMMO4': '0.252', 'AMMO3': '0.253', 'weapon4': '0.326', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.634', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '55.000'} [2024-08-06 05:40:55,987][52669] DAMAGECOUNT value on done: 661229.0 [2024-08-06 05:40:55,987][52669] Sum rewards: 70.305, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.187', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.336', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.390', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:56,099][52668] Large shaping reward 2.513 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.462, 154.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:40:56,160][52671] DAMAGECOUNT value on done: 666115.0 [2024-08-06 05:40:56,160][52671] Sum rewards: 63.169, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.225', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO4': '0.193', 'AMMO3': '0.216', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '53.000'} [2024-08-06 05:40:56,231][52658] DAMAGECOUNT value on done: 653380.0 [2024-08-06 05:40:56,231][52658] Sum rewards: 76.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.266', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.278', 'WEAPON3': '1.050', 'weapon3': '3.198', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:56,454][52647] DAMAGECOUNT value on done: 696626.0 [2024-08-06 05:40:56,455][52647] Sum rewards: 61.976, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.396', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.030', 'weapon5': '0.098', 'AMMO4': '0.151', 'weapon4': '0.160', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'AMMO3': '0.357', 'WEAPON3': '2.000', 'HITCOUNT': '3.010', 'weapon3': '3.202', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '57.000'} [2024-08-06 05:40:57,273][52663] DAMAGECOUNT value on done: 653248.0 [2024-08-06 05:40:57,275][52663] Sum rewards: 67.367, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.876', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.468', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.256', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:57,366][52803] DAMAGECOUNT value on done: 617868.0 [2024-08-06 05:40:57,367][52803] Sum rewards: 80.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.555', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO4': '0.179', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '65.000'} [2024-08-06 05:40:57,758][52650] Updated weights for policy 0, policy_version 63011 (0.0036) [2024-08-06 05:40:57,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 516186112. Throughput: 0: 4355.3. Samples: 129054140. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:40:57,795][52567] Avg episode reward: [(0, '72.159')] [2024-08-06 05:40:58,307][52670] DAMAGECOUNT value on done: 648784.0 [2024-08-06 05:40:58,307][52670] Sum rewards: 70.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.870', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO3': '0.226', 'AMMO4': '0.228', 'weapon5': '0.264', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.080', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:58,423][52666] DAMAGECOUNT value on done: 649396.0 [2024-08-06 05:40:58,424][52666] Sum rewards: 73.151, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'AMMO4': '0.162', 'weapon4': '0.188', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON3': '0.950', 'weapon3': '3.356', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '58.000'} [2024-08-06 05:40:58,797][52669] DAMAGECOUNT value on done: 660938.0 [2024-08-06 05:40:58,797][52669] Sum rewards: 74.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.086', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.274', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.500', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '61.000'} [2024-08-06 05:40:58,829][52811] DAMAGECOUNT value on done: 622297.0 [2024-08-06 05:40:58,830][52811] Sum rewards: 66.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.282', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.150', 'AMMO3': '0.202', 'AMMO4': '0.202', 'weapon5': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '56.000'} [2024-08-06 05:40:58,927][52647] DAMAGECOUNT value on done: 691981.0 [2024-08-06 05:40:58,927][52647] Sum rewards: 63.449, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.268', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.190', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon5': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.522', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '50.500'} [2024-08-06 05:40:59,251][52671] DAMAGECOUNT value on done: 663600.0 [2024-08-06 05:40:59,251][52671] Sum rewards: 78.860, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.266', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.190', 'AMMO4': '0.239', 'AMMO3': '0.251', 'weapon5': '0.254', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.996', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '66.000'} [2024-08-06 05:40:59,531][52658] DAMAGECOUNT value on done: 653567.0 [2024-08-06 05:40:59,533][52658] Sum rewards: 63.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.116', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.150', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2024-08-06 05:41:00,014][52663] DAMAGECOUNT value on done: 649151.0 [2024-08-06 05:41:00,015][52663] Sum rewards: 71.788, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.143', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.188', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:00,528][52803] DAMAGECOUNT value on done: 608691.0 [2024-08-06 05:41:00,529][52803] Sum rewards: 73.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.163', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:01,097][52670] DAMAGECOUNT value on done: 657750.0 [2024-08-06 05:41:01,107][52670] Sum rewards: 77.369, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.938', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.114', 'weapon5': '0.138', 'AMMO4': '0.147', 'AMMO3': '0.172', 'weapon2': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.356', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:01,160][52666] DAMAGECOUNT value on done: 654275.0 [2024-08-06 05:41:01,161][52666] Sum rewards: 79.316, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.062', 'AMMO4': '0.153', 'weapon5': '0.160', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.038', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.661', 'FRAGCOUNT': '66.000'} [2024-08-06 05:41:01,375][52669] DAMAGECOUNT value on done: 664901.0 [2024-08-06 05:41:01,376][52669] Sum rewards: 75.025, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.022', 'AMMO4': '0.062', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.752', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:01,779][52647] DAMAGECOUNT value on done: 686848.0 [2024-08-06 05:41:01,779][52647] Sum rewards: 69.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.162', 'AMMO4': '0.257', 'weapon5': '0.292', 'weapon2': '0.308', 'weapon4': '0.510', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:02,016][52811] DAMAGECOUNT value on done: 617129.0 [2024-08-06 05:41:02,017][52811] Sum rewards: 75.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.622', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.140', 'weapon4': '0.166', 'AMMO3': '0.191', 'AMMO4': '0.267', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:02,085][52658] DAMAGECOUNT value on done: 666553.0 [2024-08-06 05:41:02,087][52658] Sum rewards: 64.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.172', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.570', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:02,432][52650] Updated weights for policy 0, policy_version 63021 (0.0011) [2024-08-06 05:41:02,453][52671] DAMAGECOUNT value on done: 665244.0 [2024-08-06 05:41:02,454][52671] Sum rewards: 84.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.052', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '71.000'} [2024-08-06 05:41:02,579][52667] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:41:02,599][52663] DAMAGECOUNT value on done: 663947.0 [2024-08-06 05:41:02,599][52663] Sum rewards: 69.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:02,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 516268032. Throughput: 0: 4354.4. Samples: 129067210. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:41:02,796][52567] Avg episode reward: [(0, '72.203')] [2024-08-06 05:41:03,023][52614] Signal inference workers to stop experience collection... (11450 times) [2024-08-06 05:41:03,023][52614] Signal inference workers to resume experience collection... (11450 times) [2024-08-06 05:41:03,094][52650] InferenceWorker_p0-w0: stopping experience collection (11450 times) [2024-08-06 05:41:03,095][52650] InferenceWorker_p0-w0: resuming experience collection (11450 times) [2024-08-06 05:41:03,621][52803] DAMAGECOUNT value on done: 608554.0 [2024-08-06 05:41:03,622][52803] Sum rewards: 74.047, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.770', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.141', 'weapon4': '0.194', 'weapon5': '0.238', 'AMMO4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '0.900', 'weapon3': '2.764', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:04,077][52670] DAMAGECOUNT value on done: 644499.0 [2024-08-06 05:41:04,077][52670] Sum rewards: 81.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.818', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.054', 'weapon5': '0.174', 'AMMO3': '0.223', 'AMMO4': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '67.000'} [2024-08-06 05:41:04,161][52666] DAMAGECOUNT value on done: 645685.0 [2024-08-06 05:41:04,163][52666] Sum rewards: 70.784, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.092', 'AMMO4': '0.207', 'AMMO3': '0.227', 'weapon5': '0.282', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'HEALTH': '0.810', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '2.912', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:04,164][52669] DAMAGECOUNT value on done: 661392.0 [2024-08-06 05:41:04,183][52669] Sum rewards: 78.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.842', 'AMMO5': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'weapon5': '0.252', 'weapon2': '0.266', 'weapon4': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.558', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:04,477][52647] DAMAGECOUNT value on done: 700240.0 [2024-08-06 05:41:04,478][52647] Sum rewards: 75.306, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.126', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:04,855][52671] DAMAGECOUNT value on done: 673681.0 [2024-08-06 05:41:04,855][52671] Sum rewards: 72.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.192', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.312', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:05,046][52663] DAMAGECOUNT value on done: 655098.0 [2024-08-06 05:41:05,046][52663] Sum rewards: 71.295, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.162', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.244', 'WEAPON3': '1.450', 'HITCOUNT': '3.250', 'weapon3': '3.358', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '61.000'} [2024-08-06 05:41:05,297][52658] DAMAGECOUNT value on done: 656574.0 [2024-08-06 05:41:05,297][52658] Sum rewards: 74.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.109', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.104', 'AMMO4': '0.154', 'weapon5': '0.162', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:05,339][52811] DAMAGECOUNT value on done: 614719.0 [2024-08-06 05:41:05,340][52811] Sum rewards: 78.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.602', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.200', 'weapon5': '0.222', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '65.000'} [2024-08-06 05:41:06,170][52663] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:41:06,768][52669] DAMAGECOUNT value on done: 660972.0 [2024-08-06 05:41:06,768][52669] Sum rewards: 87.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.170', 'AMMO3': '0.258', 'WEAPON3': '1.700', 'weapon3': '3.580', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.835', 'FRAGCOUNT': '74.000'} [2024-08-06 05:41:06,771][52803] DAMAGECOUNT value on done: 608247.0 [2024-08-06 05:41:06,771][52803] Sum rewards: 80.285, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.031', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.104', 'AMMO4': '0.142', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '65.000'} [2024-08-06 05:41:06,809][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:41:06,900][52670] DAMAGECOUNT value on done: 654554.0 [2024-08-06 05:41:06,902][52670] Sum rewards: 80.485, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '3.284', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:07,000][52650] Updated weights for policy 0, policy_version 63031 (0.0015) [2024-08-06 05:41:07,010][52666] DAMAGECOUNT value on done: 659688.0 [2024-08-06 05:41:07,011][52666] Sum rewards: 77.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.048', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.134', 'weapon4': '0.166', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '65.000'} [2024-08-06 05:41:07,344][52647] DAMAGECOUNT value on done: 688929.0 [2024-08-06 05:41:07,345][52647] Sum rewards: 66.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.148', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:07,706][52663] DAMAGECOUNT value on done: 661023.0 [2024-08-06 05:41:07,709][52663] Sum rewards: 72.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.442', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.148', 'weapon2': '0.162', 'weapon5': '0.170', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.342', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:07,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 516349952. Throughput: 0: 4354.7. Samples: 129093370. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:41:07,794][52567] Avg episode reward: [(0, '72.860')] [2024-08-06 05:41:07,930][52671] DAMAGECOUNT value on done: 664751.0 [2024-08-06 05:41:07,930][52671] Sum rewards: 67.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.595', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.164', 'weapon4': '0.198', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:08,079][52658] DAMAGECOUNT value on done: 674487.0 [2024-08-06 05:41:08,081][52658] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.187', 'AMMO3': '0.199', 'weapon5': '0.216', 'weapon4': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '55.000'} [2024-08-06 05:41:09,534][52669] DAMAGECOUNT value on done: 669485.0 [2024-08-06 05:41:09,536][52669] Sum rewards: 75.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.994', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.133', 'weapon5': '0.166', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:09,904][52803] DAMAGECOUNT value on done: 611801.0 [2024-08-06 05:41:09,904][52803] Sum rewards: 63.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.094', 'AMMO4': '0.120', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.252', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '53.000'} [2024-08-06 05:41:10,127][52670] DAMAGECOUNT value on done: 658953.0 [2024-08-06 05:41:10,128][52670] Sum rewards: 70.959, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.130', 'AMMO2': '0.009', 'AMMO5': '0.013', 'weapon4': '0.016', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:10,240][52666] DAMAGECOUNT value on done: 654940.0 [2024-08-06 05:41:10,240][52666] Sum rewards: 76.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.666', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.138', 'AMMO4': '0.164', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:10,282][52647] DAMAGECOUNT value on done: 698215.0 [2024-08-06 05:41:10,282][52647] Sum rewards: 65.938, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.460', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.134', 'weapon5': '0.190', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'AMMO3': '0.304', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.048', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:10,391][52671] DAMAGECOUNT value on done: 668730.0 [2024-08-06 05:41:10,391][52671] Sum rewards: 68.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.355', 'AMMO5': '0.008', 'AMMO2': '0.057', 'weapon4': '0.132', 'weapon5': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'weapon2': '0.280', 'AMMO4': '0.286', 'WEAPON3': '1.650', 'weapon3': '3.222', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '58.500'} [2024-08-06 05:41:10,474][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:41:10,584][52663] DAMAGECOUNT value on done: 661374.0 [2024-08-06 05:41:10,584][52663] Sum rewards: 69.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.898', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.292', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '57.500'} [2024-08-06 05:41:11,164][52658] DAMAGECOUNT value on done: 661603.0 [2024-08-06 05:41:11,166][52658] Sum rewards: 71.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.358', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.164', 'weapon4': '0.174', 'AMMO4': '0.201', 'AMMO3': '0.215', 'weapon2': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:11,554][52650] Updated weights for policy 0, policy_version 63041 (0.0022) [2024-08-06 05:41:12,223][52669] DAMAGECOUNT value on done: 661371.0 [2024-08-06 05:41:12,223][52669] Sum rewards: 63.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.306', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON5': '0.100', 'weapon5': '0.168', 'AMMO3': '0.190', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '51.500'} [2024-08-06 05:41:12,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 516448256. Throughput: 0: 4359.8. Samples: 129119690. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:41:12,794][52567] Avg episode reward: [(0, '72.876')] [2024-08-06 05:41:12,956][52647] DAMAGECOUNT value on done: 699525.0 [2024-08-06 05:41:12,957][52647] Sum rewards: 64.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.136', 'AMMO3': '0.208', 'weapon4': '0.258', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '54.000'} [2024-08-06 05:41:12,982][52803] DAMAGECOUNT value on done: 607641.0 [2024-08-06 05:41:12,984][52803] Sum rewards: 76.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.243', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.122', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:13,000][52670] DAMAGECOUNT value on done: 656551.0 [2024-08-06 05:41:13,002][52670] Sum rewards: 59.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.187', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.146', 'weapon4': '0.172', 'AMMO3': '0.200', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.472', 'FRAGCOUNT': '51.000'} [2024-08-06 05:41:13,088][52666] DAMAGECOUNT value on done: 657616.0 [2024-08-06 05:41:13,088][52666] Sum rewards: 80.757, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.246', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '67.000'} [2024-08-06 05:41:13,095][52671] DAMAGECOUNT value on done: 664441.0 [2024-08-06 05:41:13,096][52671] Sum rewards: 64.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.786', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.126', 'AMMO3': '0.174', 'weapon2': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.208', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '52.000'} [2024-08-06 05:41:13,323][52663] DAMAGECOUNT value on done: 654306.0 [2024-08-06 05:41:13,325][52663] Sum rewards: 72.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.179', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.100', 'weapon5': '0.124', 'AMMO3': '0.182', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:14,347][52658] DAMAGECOUNT value on done: 671966.0 [2024-08-06 05:41:14,350][52658] Sum rewards: 55.425, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.028', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.129', 'AMMO4': '0.142', 'WEAPON7': '0.200', 'weapon7': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '0.750', 'weapon4': '0.870', 'weapon3': '2.210', 'HITCOUNT': '2.630', 'DAMAGECOUNT': '13.233', 'FRAGCOUNT': '43.000'} [2024-08-06 05:41:15,093][52669] DAMAGECOUNT value on done: 664857.0 [2024-08-06 05:41:15,093][52669] Sum rewards: 67.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.696', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.096', 'weapon5': '0.154', 'AMMO4': '0.181', 'AMMO3': '0.245', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:15,450][52647] DAMAGECOUNT value on done: 682686.0 [2024-08-06 05:41:15,450][52647] Sum rewards: 65.420, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.540', 'AMMO5': '0.019', 'AMMO2': '0.073', 'AMMO3': '0.192', 'weapon4': '0.204', 'weapon5': '0.226', 'weapon2': '0.294', 'AMMO4': '0.366', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '52.000'} [2024-08-06 05:41:15,620][52671] DAMAGECOUNT value on done: 656854.0 [2024-08-06 05:41:15,621][52671] Sum rewards: 63.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.114', 'weapon5': '0.166', 'AMMO4': '0.216', 'AMMO3': '0.232', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.166', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '53.000'} [2024-08-06 05:41:15,878][52670] DAMAGECOUNT value on done: 639513.0 [2024-08-06 05:41:15,878][52670] Sum rewards: 66.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.117', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.070', 'weapon5': '0.174', 'AMMO4': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '54.000'} [2024-08-06 05:41:16,013][52666] DAMAGECOUNT value on done: 647042.0 [2024-08-06 05:41:16,016][52666] Sum rewards: 76.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.238', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.005', 'WEAPON5': '0.050', 'weapon5': '0.080', 'AMMO3': '0.193', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:16,172][52803] DAMAGECOUNT value on done: 624937.0 [2024-08-06 05:41:16,172][52803] Sum rewards: 65.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.812', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.360', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.196', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:16,537][52650] Updated weights for policy 0, policy_version 63051 (0.0027) [2024-08-06 05:41:16,820][52668] DAMAGECOUNT value on done: 659122.0 [2024-08-06 05:41:16,821][52668] Sum rewards: 77.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.374', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:17,470][52658] DAMAGECOUNT value on done: 657764.0 [2024-08-06 05:41:17,472][52658] Sum rewards: 75.898, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.076', 'weapon5': '0.130', 'weapon2': '0.156', 'AMMO4': '0.164', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.402', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:17,781][52669] DAMAGECOUNT value on done: 668349.0 [2024-08-06 05:41:17,781][52669] Sum rewards: 73.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon4': '0.114', 'weapon2': '0.210', 'AMMO3': '0.217', 'weapon5': '0.276', 'AMMO4': '0.321', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.074', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:17,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 516538368. Throughput: 0: 4365.1. Samples: 129133080. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:41:17,794][52567] Avg episode reward: [(0, '72.354')] [2024-08-06 05:41:18,066][52671] DAMAGECOUNT value on done: 664692.0 [2024-08-06 05:41:18,066][52671] Sum rewards: 83.478, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.596', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.162', 'AMMO4': '0.183', 'weapon5': '0.222', 'weapon2': '0.266', 'AMMO3': '0.289', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.070', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.979', 'FRAGCOUNT': '71.000'} [2024-08-06 05:41:18,205][52647] DAMAGECOUNT value on done: 691964.0 [2024-08-06 05:41:18,207][52647] Sum rewards: 74.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.320', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.198', 'weapon5': '0.216', 'weapon4': '0.334', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.774', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:18,935][52670] DAMAGECOUNT value on done: 650432.0 [2024-08-06 05:41:18,938][52670] Sum rewards: 58.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.208', 'weapon2': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.440', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '48.000'} [2024-08-06 05:41:19,112][52666] DAMAGECOUNT value on done: 654992.0 [2024-08-06 05:41:19,112][52666] Sum rewards: 70.425, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.056', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.137', 'AMMO4': '0.185', 'weapon4': '0.238', 'weapon5': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '0.900', 'weapon3': '2.718', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '54.000'} [2024-08-06 05:41:19,229][52803] DAMAGECOUNT value on done: 615339.0 [2024-08-06 05:41:19,230][52803] Sum rewards: 79.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.019', 'AMMO2': '0.067', 'weapon4': '0.134', 'AMMO3': '0.203', 'weapon2': '0.222', 'weapon5': '0.238', 'AMMO4': '0.337', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '66.000'} [2024-08-06 05:41:19,252][52794] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:41:19,667][52668] DAMAGECOUNT value on done: 663389.0 [2024-08-06 05:41:19,667][52668] Sum rewards: 71.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.048', 'AMMO4': '0.153', 'AMMO3': '0.206', 'weapon5': '0.222', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.226', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:20,445][52658] DAMAGECOUNT value on done: 664659.0 [2024-08-06 05:41:20,446][52658] Sum rewards: 64.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.827', 'AMMO5': '0.013', 'weapon4': '0.054', 'AMMO2': '0.055', 'weapon5': '0.168', 'AMMO3': '0.218', 'weapon2': '0.224', 'AMMO4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.374', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '54.000'} [2024-08-06 05:41:20,694][52671] DAMAGECOUNT value on done: 667330.0 [2024-08-06 05:41:20,694][52671] Sum rewards: 69.506, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon4': '0.064', 'HEALTH': '0.070', 'AMMO4': '0.089', 'weapon5': '0.114', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '0.800', 'HITCOUNT': '3.090', 'weapon3': '3.226', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '53.500'} [2024-08-06 05:41:20,875][52669] DAMAGECOUNT value on done: 653002.0 [2024-08-06 05:41:20,877][52669] Sum rewards: 70.910, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.995', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.271', 'WEAPON3': '1.500', 'HITCOUNT': '3.430', 'weapon3': '3.462', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 05:41:20,881][52647] DAMAGECOUNT value on done: 683186.0 [2024-08-06 05:41:20,882][52647] Sum rewards: 83.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.158', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.124', 'weapon5': '0.128', 'weapon2': '0.134', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.400', 'weapon3': '3.506', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '68.000'} [2024-08-06 05:41:21,092][52650] Updated weights for policy 0, policy_version 63061 (0.0012) [2024-08-06 05:41:21,794][52670] DAMAGECOUNT value on done: 658713.0 [2024-08-06 05:41:21,803][52670] Sum rewards: 67.965, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.036', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:21,935][52666] DAMAGECOUNT value on done: 664312.0 [2024-08-06 05:41:21,951][52666] Sum rewards: 72.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.408', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.086', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:22,336][52803] DAMAGECOUNT value on done: 611524.0 [2024-08-06 05:41:22,337][52803] Sum rewards: 79.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.260', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.376', 'WEAPON3': '1.650', 'weapon3': '3.248', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '68.000'} [2024-08-06 05:41:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 516620288. Throughput: 0: 4371.6. Samples: 129159220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:41:22,794][52567] Avg episode reward: [(0, '72.032')] [2024-08-06 05:41:22,951][52668] DAMAGECOUNT value on done: 663866.0 [2024-08-06 05:41:22,952][52668] Sum rewards: 90.041, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'HEALTH': '0.090', 'weapon5': '0.140', 'AMMO4': '0.151', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.100', 'weapon3': '3.358', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '73.000'} [2024-08-06 05:41:23,062][52647] DAMAGECOUNT value on done: 687667.0 [2024-08-06 05:41:23,062][52647] Sum rewards: 85.400, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.610', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.110', 'AMMO4': '0.168', 'AMMO3': '0.210', 'weapon5': '0.222', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '69.000'} [2024-08-06 05:41:23,467][52658] DAMAGECOUNT value on done: 656366.0 [2024-08-06 05:41:23,467][52658] Sum rewards: 69.902, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.103', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.108', 'AMMO3': '0.172', 'weapon5': '0.184', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:23,516][52671] DAMAGECOUNT value on done: 662387.0 [2024-08-06 05:41:23,517][52671] Sum rewards: 66.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.216', 'weapon2': '0.654', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '55.000'} [2024-08-06 05:41:23,986][52669] DAMAGECOUNT value on done: 659744.0 [2024-08-06 05:41:23,987][52669] Sum rewards: 69.435, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.180', 'weapon5': '0.226', 'weapon4': '0.264', 'AMMO4': '0.277', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:24,528][52670] DAMAGECOUNT value on done: 650818.0 [2024-08-06 05:41:24,529][52670] Sum rewards: 68.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.032', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.180', 'AMMO3': '0.181', 'weapon5': '0.192', 'AMMO4': '0.299', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:24,752][52666] DAMAGECOUNT value on done: 643964.0 [2024-08-06 05:41:24,752][52666] Sum rewards: 66.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.146', 'weapon4': '0.160', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:25,386][52803] DAMAGECOUNT value on done: 626625.0 [2024-08-06 05:41:25,386][52803] Sum rewards: 67.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.186', 'AMMO4': '0.199', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:25,753][52668] DAMAGECOUNT value on done: 665021.0 [2024-08-06 05:41:25,754][52668] Sum rewards: 73.685, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.460', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.150', 'weapon5': '0.176', 'AMMO3': '0.244', 'AMMO4': '0.265', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.084', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:26,000][52649] DAMAGECOUNT value on done: 638531.0 [2024-08-06 05:41:26,003][52649] Sum rewards: 60.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.334', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO3': '0.187', 'AMMO4': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.422', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '49.000'} [2024-08-06 05:41:26,014][52650] Updated weights for policy 0, policy_version 63071 (0.0024) [2024-08-06 05:41:26,346][52671] DAMAGECOUNT value on done: 667702.0 [2024-08-06 05:41:26,346][52671] Sum rewards: 76.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon2': '0.176', 'weapon5': '0.188', 'AMMO4': '0.198', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:26,411][52658] DAMAGECOUNT value on done: 663361.0 [2024-08-06 05:41:26,412][52658] Sum rewards: 66.526, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.075', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.206', 'weapon5': '0.210', 'AMMO3': '0.248', 'AMMO4': '0.259', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.966', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:27,081][52669] DAMAGECOUNT value on done: 660846.0 [2024-08-06 05:41:27,092][52669] Sum rewards: 68.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.678', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.026', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.230', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.538', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:27,453][52670] DAMAGECOUNT value on done: 657447.0 [2024-08-06 05:41:27,455][52670] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.666', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.078', 'weapon5': '0.134', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.278', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '65.000'} [2024-08-06 05:41:27,714][52666] DAMAGECOUNT value on done: 652344.0 [2024-08-06 05:41:27,716][52666] Sum rewards: 54.532, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.860', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.122', 'weapon5': '0.164', 'AMMO4': '0.292', 'AMMO3': '0.305', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.034', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '49.500'} [2024-08-06 05:41:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 516710400. Throughput: 0: 4364.7. Samples: 129185220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:41:27,794][52567] Avg episode reward: [(0, '71.643')] [2024-08-06 05:41:28,525][52668] DAMAGECOUNT value on done: 651630.0 [2024-08-06 05:41:28,526][52668] Sum rewards: 77.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.400', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.030', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:28,561][52803] DAMAGECOUNT value on done: 614185.0 [2024-08-06 05:41:28,563][52803] Sum rewards: 73.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.689', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.240', 'AMMO3': '0.241', 'weapon2': '0.244', 'AMMO4': '0.247', 'weapon4': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:28,641][52662] DAMAGECOUNT value on done: 665018.0 [2024-08-06 05:41:28,642][52662] Sum rewards: 73.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO3': '0.182', 'AMMO4': '0.192', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:28,726][52649] DAMAGECOUNT value on done: 632392.0 [2024-08-06 05:41:28,728][52649] Sum rewards: 77.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.303', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.217', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.384', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:29,023][52671] DAMAGECOUNT value on done: 663591.0 [2024-08-06 05:41:29,023][52671] Sum rewards: 80.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.445', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.132', 'AMMO3': '0.190', 'AMMO4': '0.270', 'weapon5': '0.278', 'weapon2': '0.532', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '65.000'} [2024-08-06 05:41:29,559][52658] DAMAGECOUNT value on done: 649623.0 [2024-08-06 05:41:29,559][52658] Sum rewards: 73.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.946', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.158', 'weapon4': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '61.000'} [2024-08-06 05:41:30,252][52669] DAMAGECOUNT value on done: 681414.0 [2024-08-06 05:41:30,255][52669] Sum rewards: 65.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.660', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.138', 'weapon4': '0.150', 'AMMO4': '0.161', 'weapon2': '0.188', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.900', 'HITCOUNT': '3.220', 'weapon3': '3.246', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:30,271][52650] Updated weights for policy 0, policy_version 63081 (0.0014) [2024-08-06 05:41:31,379][52649] DAMAGECOUNT value on done: 651851.0 [2024-08-06 05:41:31,379][52649] Sum rewards: 82.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.361', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon4': '0.232', 'weapon2': '0.272', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '68.000'} [2024-08-06 05:41:31,534][52668] DAMAGECOUNT value on done: 667810.0 [2024-08-06 05:41:31,536][52668] Sum rewards: 76.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.228', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.176', 'weapon2': '0.196', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.318', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:31,598][52671] DAMAGECOUNT value on done: 649645.0 [2024-08-06 05:41:31,599][52671] Sum rewards: 67.803, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.065', 'weapon5': '0.124', 'WEAPON4': '0.150', 'HEALTH': '0.168', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.226', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '53.500'} [2024-08-06 05:41:31,624][52803] DAMAGECOUNT value on done: 613873.0 [2024-08-06 05:41:31,629][52803] Sum rewards: 93.206, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.063', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.121', 'weapon5': '0.184', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '22.560', 'FRAGCOUNT': '76.000'} [2024-08-06 05:41:32,013][52662] DAMAGECOUNT value on done: 665022.0 [2024-08-06 05:41:32,018][52662] Sum rewards: 92.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.575', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '22.509', 'FRAGCOUNT': '76.000'} [2024-08-06 05:41:32,476][52658] DAMAGECOUNT value on done: 664444.0 [2024-08-06 05:41:32,489][52658] Sum rewards: 58.443, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.242', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.101', 'weapon5': '0.126', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.300', 'WEAPON3': '0.800', 'HITCOUNT': '2.660', 'weapon3': '3.402', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '46.000'} [2024-08-06 05:41:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 516792320. Throughput: 0: 4370.2. Samples: 129198310. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:41:32,795][52567] Avg episode reward: [(0, '72.361')] [2024-08-06 05:41:33,523][52663] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('HEALTH', -0.021, -7.0), ('weapon5', 0.002)] [2024-08-06 05:41:33,525][52669] DAMAGECOUNT value on done: 668268.0 [2024-08-06 05:41:33,526][52669] Sum rewards: 70.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.346', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.117', 'weapon5': '0.118', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:34,003][52668] DAMAGECOUNT value on done: 666038.0 [2024-08-06 05:41:34,003][52668] Sum rewards: 80.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.417', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.058', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '66.000'} [2024-08-06 05:41:34,444][52662] DAMAGECOUNT value on done: 671585.0 [2024-08-06 05:41:34,445][52662] Sum rewards: 74.485, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.084', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.180', 'weapon2': '0.340', 'WEAPON3': '0.950', 'weapon3': '3.240', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:34,498][52649] DAMAGECOUNT value on done: 644056.0 [2024-08-06 05:41:34,499][52649] Sum rewards: 53.920, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.174', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.138', 'AMMO4': '0.158', 'AMMO3': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon5': '0.338', 'weapon2': '0.744', 'WEAPON3': '1.200', 'weapon3': '2.506', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '45.000'} [2024-08-06 05:41:34,528][52671] DAMAGECOUNT value on done: 671223.0 [2024-08-06 05:41:34,530][52671] Sum rewards: 68.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.506', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.164', 'AMMO3': '0.228', 'AMMO4': '0.235', 'weapon2': '0.238', 'weapon5': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.092', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:34,933][52803] DAMAGECOUNT value on done: 616876.0 [2024-08-06 05:41:34,933][52803] Sum rewards: 70.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.952', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.244', 'weapon4': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:35,120][52650] Updated weights for policy 0, policy_version 63091 (0.0013) [2024-08-06 05:41:35,623][52658] DAMAGECOUNT value on done: 657771.0 [2024-08-06 05:41:35,625][52658] Sum rewards: 72.993, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.150', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.086', 'AMMO3': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'weapon4': '0.472', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:36,676][52668] DAMAGECOUNT value on done: 656326.0 [2024-08-06 05:41:36,677][52668] Sum rewards: 69.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.191', 'weapon4': '0.246', 'AMMO4': '0.261', 'weapon5': '0.270', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:36,740][52669] DAMAGECOUNT value on done: 666489.0 [2024-08-06 05:41:36,740][52669] Sum rewards: 72.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.814', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.150', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.432', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:37,070][52662] DAMAGECOUNT value on done: 656659.0 [2024-08-06 05:41:37,070][52662] Sum rewards: 73.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:37,398][52649] DAMAGECOUNT value on done: 632944.0 [2024-08-06 05:41:37,399][52649] Sum rewards: 66.738, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.178', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.104', 'weapon4': '0.118', 'AMMO3': '0.166', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.116', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '54.000'} [2024-08-06 05:41:37,647][52671] DAMAGECOUNT value on done: 667466.0 [2024-08-06 05:41:37,655][52671] Sum rewards: 81.687, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.938', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.094', 'AMMO3': '0.143', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '3.044', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 516882432. Throughput: 0: 4374.2. Samples: 129224620. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:41:37,795][52567] Avg episode reward: [(0, '72.240')] [2024-08-06 05:41:38,043][52803] DAMAGECOUNT value on done: 619436.0 [2024-08-06 05:41:38,044][52803] Sum rewards: 80.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.162', 'weapon2': '0.200', 'weapon5': '0.208', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '66.000'} [2024-08-06 05:41:38,234][52658] DAMAGECOUNT value on done: 657952.0 [2024-08-06 05:41:38,235][52658] Sum rewards: 66.953, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.090', 'AMMO4': '0.195', 'AMMO3': '0.196', 'weapon5': '0.204', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.204', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:39,582][52668] DAMAGECOUNT value on done: 658451.0 [2024-08-06 05:41:39,582][52668] Sum rewards: 75.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.414', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.087', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:39,695][52669] DAMAGECOUNT value on done: 666945.0 [2024-08-06 05:41:39,695][52669] Sum rewards: 74.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.421', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.178', 'AMMO4': '0.227', 'weapon5': '0.258', 'weapon4': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:39,875][52650] Updated weights for policy 0, policy_version 63101 (0.0014) [2024-08-06 05:41:40,019][52662] DAMAGECOUNT value on done: 674955.0 [2024-08-06 05:41:40,021][52662] Sum rewards: 66.274, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.804', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.178', 'weapon5': '0.190', 'AMMO4': '0.206', 'weapon2': '0.256', 'weapon4': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '53.000'} [2024-08-06 05:41:40,137][52660] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:41:40,399][52649] DAMAGECOUNT value on done: 650660.0 [2024-08-06 05:41:40,399][52649] Sum rewards: 62.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.130', 'weapon2': '0.242', 'AMMO3': '0.258', 'AMMO4': '0.272', 'weapon5': '0.290', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '3.036', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '53.000'} [2024-08-06 05:41:40,695][52671] DAMAGECOUNT value on done: 667614.0 [2024-08-06 05:41:40,696][52671] Sum rewards: 74.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.066', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.232', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.392', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:40,960][52658] DAMAGECOUNT value on done: 663145.0 [2024-08-06 05:41:40,960][52658] Sum rewards: 59.533, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.308', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.170', 'AMMO4': '0.218', 'AMMO3': '0.236', 'weapon5': '0.260', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '51.000'} [2024-08-06 05:41:41,137][52803] DAMAGECOUNT value on done: 623983.0 [2024-08-06 05:41:41,138][52803] Sum rewards: 71.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:42,520][52668] DAMAGECOUNT value on done: 665790.0 [2024-08-06 05:41:42,521][52668] Sum rewards: 76.937, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.033', 'AMMO5': '0.023', 'AMMO2': '0.061', 'weapon4': '0.202', 'AMMO3': '0.261', 'AMMO4': '0.305', 'weapon2': '0.318', 'weapon5': '0.332', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.834', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '65.000'} [2024-08-06 05:41:42,566][52666] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:41:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 516972544. Throughput: 0: 4375.1. Samples: 129251020. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:41:42,802][52567] Avg episode reward: [(0, '71.891')] [2024-08-06 05:41:42,808][52669] DAMAGECOUNT value on done: 672466.0 [2024-08-06 05:41:42,810][52669] Sum rewards: 74.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.134', 'AMMO4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:42,847][52649] DAMAGECOUNT value on done: 642147.0 [2024-08-06 05:41:42,849][52649] Sum rewards: 76.079, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.088', 'weapon4': '0.122', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '64.000'} [2024-08-06 05:41:43,000][52662] DAMAGECOUNT value on done: 653624.0 [2024-08-06 05:41:43,002][52662] Sum rewards: 69.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.196', 'AMMO5': '0.023', 'AMMO2': '0.069', 'AMMO3': '0.233', 'weapon4': '0.256', 'weapon5': '0.274', 'weapon2': '0.314', 'AMMO4': '0.344', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.792', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:43,194][52671] DAMAGECOUNT value on done: 668279.0 [2024-08-06 05:41:43,195][52671] Sum rewards: 84.581, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.000', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.130', 'AMMO3': '0.137', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '66.000'} [2024-08-06 05:41:44,068][52669] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:41:44,285][52803] DAMAGECOUNT value on done: 614270.0 [2024-08-06 05:41:44,286][52803] Sum rewards: 84.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.105', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.166', 'weapon4': '0.174', 'AMMO4': '0.195', 'AMMO3': '0.247', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '21.315', 'FRAGCOUNT': '70.000'} [2024-08-06 05:41:44,464][52650] Updated weights for policy 0, policy_version 63111 (0.0020) [2024-08-06 05:41:45,415][52668] DAMAGECOUNT value on done: 660866.0 [2024-08-06 05:41:45,416][52668] Sum rewards: 65.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.260', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '52.000'} [2024-08-06 05:41:45,997][52671] DAMAGECOUNT value on done: 664096.0 [2024-08-06 05:41:45,997][52671] Sum rewards: 80.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.074', 'weapon5': '0.148', 'AMMO4': '0.153', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '67.000'} [2024-08-06 05:41:46,033][52649] DAMAGECOUNT value on done: 645675.0 [2024-08-06 05:41:46,035][52649] Sum rewards: 83.232, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.765', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.154', 'AMMO3': '0.181', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '67.000'} [2024-08-06 05:41:46,413][52662] DAMAGECOUNT value on done: 663323.0 [2024-08-06 05:41:46,413][52662] Sum rewards: 72.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.744', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.215', 'weapon2': '0.692', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:47,371][52668] Large shaping reward 2.742 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:41:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 517062656. Throughput: 0: 4384.7. Samples: 129264520. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:41:47,794][52567] Avg episode reward: [(0, '71.916')] [2024-08-06 05:41:48,546][52668] DAMAGECOUNT value on done: 653492.0 [2024-08-06 05:41:48,549][52668] Sum rewards: 73.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.124', 'weapon4': '0.140', 'AMMO3': '0.199', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:48,831][52649] DAMAGECOUNT value on done: 646384.0 [2024-08-06 05:41:48,833][52649] Sum rewards: 70.820, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.054', 'weapon5': '0.174', 'AMMO4': '0.217', 'weapon2': '0.238', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.228', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:49,226][52650] Updated weights for policy 0, policy_version 63121 (0.0039) [2024-08-06 05:41:49,228][52662] DAMAGECOUNT value on done: 669965.0 [2024-08-06 05:41:49,229][52662] Sum rewards: 75.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.283', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.221', 'weapon2': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:51,478][52660] DAMAGECOUNT value on done: 660874.0 [2024-08-06 05:41:51,482][52660] Sum rewards: 71.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.142', 'AMMO3': '0.178', 'AMMO4': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.064', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:51,775][52668] DAMAGECOUNT value on done: 646847.0 [2024-08-06 05:41:51,779][52668] Sum rewards: 75.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.202', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '62.000'} [2024-08-06 05:41:52,067][52649] DAMAGECOUNT value on done: 638333.0 [2024-08-06 05:41:52,071][52649] Sum rewards: 72.103, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.680', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.159', 'AMMO4': '0.187', 'weapon5': '0.224', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '56.000'} [2024-08-06 05:41:52,190][52662] DAMAGECOUNT value on done: 662611.0 [2024-08-06 05:41:52,192][52662] Sum rewards: 73.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.888', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.100', 'AMMO4': '0.130', 'weapon5': '0.162', 'AMMO3': '0.204', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 517152768. Throughput: 0: 4385.3. Samples: 129290710. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:41:52,794][52567] Avg episode reward: [(0, '72.109')] [2024-08-06 05:41:53,700][52650] Updated weights for policy 0, policy_version 63131 (0.0030) [2024-08-06 05:41:54,606][52660] DAMAGECOUNT value on done: 650110.0 [2024-08-06 05:41:54,606][52660] Sum rewards: 73.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO5': '0.017', 'AMMO2': '0.066', 'AMMO3': '0.210', 'weapon5': '0.254', 'weapon4': '0.266', 'AMMO4': '0.332', 'weapon2': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '59.000'} [2024-08-06 05:41:54,892][52668] DAMAGECOUNT value on done: 648379.0 [2024-08-06 05:41:54,894][52668] Sum rewards: 77.246, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.234', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '63.000'} [2024-08-06 05:41:54,934][52649] DAMAGECOUNT value on done: 652944.0 [2024-08-06 05:41:54,935][52649] Sum rewards: 79.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.201', 'weapon2': '0.740', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '65.000'} [2024-08-06 05:41:55,327][52662] DAMAGECOUNT value on done: 671806.0 [2024-08-06 05:41:55,327][52662] Sum rewards: 69.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.153', 'weapon5': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 05:41:57,460][52660] DAMAGECOUNT value on done: 663428.0 [2024-08-06 05:41:57,462][52660] Sum rewards: 72.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.098', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '61.000'} [2024-08-06 05:41:57,769][52668] DAMAGECOUNT value on done: 647857.0 [2024-08-06 05:41:57,769][52668] Sum rewards: 71.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.164', 'AMMO3': '0.221', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 05:41:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 517226496. Throughput: 0: 4381.8. Samples: 129316870. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:41:57,802][52567] Avg episode reward: [(0, '72.446')] [2024-08-06 05:41:58,088][52649] DAMAGECOUNT value on done: 654416.0 [2024-08-06 05:41:58,090][52649] Sum rewards: 75.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon4': '0.266', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '61.000'} [2024-08-06 05:41:58,126][52662] DAMAGECOUNT value on done: 657979.0 [2024-08-06 05:41:58,128][52662] Sum rewards: 70.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.875', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.118', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '57.000'} [2024-08-06 05:41:58,504][52650] Updated weights for policy 0, policy_version 63141 (0.0015) [2024-08-06 05:42:00,691][52660] DAMAGECOUNT value on done: 670457.0 [2024-08-06 05:42:00,691][52660] Sum rewards: 73.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.665', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'weapon4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '62.000'} [2024-08-06 05:42:00,752][52662] DAMAGECOUNT value on done: 660039.0 [2024-08-06 05:42:00,753][52662] Sum rewards: 63.296, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.452', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.356', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '52.000'} [2024-08-06 05:42:00,805][52649] DAMAGECOUNT value on done: 651550.0 [2024-08-06 05:42:00,811][52649] Sum rewards: 73.411, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.279', 'WEAPON3': '1.800', 'weapon3': '3.466', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '63.000'} [2024-08-06 05:42:01,118][52668] DAMAGECOUNT value on done: 660683.0 [2024-08-06 05:42:01,120][52668] Sum rewards: 80.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.135', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.246', 'weapon2': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.232', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '71.000'} [2024-08-06 05:42:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 517324800. Throughput: 0: 4375.3. Samples: 129329970. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:42:02,794][52567] Avg episode reward: [(0, '72.780')] [2024-08-06 05:42:03,474][52650] Updated weights for policy 0, policy_version 63151 (0.0013) [2024-08-06 05:42:03,560][52662] DAMAGECOUNT value on done: 657253.0 [2024-08-06 05:42:03,562][52662] Sum rewards: 76.057, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.178', 'weapon2': '0.178', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:03,702][52649] DAMAGECOUNT value on done: 650067.0 [2024-08-06 05:42:03,703][52649] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.335', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.128', 'AMMO3': '0.191', 'weapon2': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:03,791][52660] DAMAGECOUNT value on done: 656041.0 [2024-08-06 05:42:03,792][52660] Sum rewards: 75.279, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.039', 'weapon5': '0.050', 'HEALTH': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '0.950', 'weapon3': '3.156', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '62.000'} [2024-08-06 05:42:04,126][52668] DAMAGECOUNT value on done: 659114.0 [2024-08-06 05:42:04,126][52668] Sum rewards: 63.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.845', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.157', 'AMMO3': '0.212', 'weapon4': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2024-08-06 05:42:06,161][52662] DAMAGECOUNT value on done: 665575.0 [2024-08-06 05:42:06,162][52662] Sum rewards: 84.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO3': '0.184', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'weapon2': '0.336', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '68.000'} [2024-08-06 05:42:06,461][52649] DAMAGECOUNT value on done: 636074.0 [2024-08-06 05:42:06,462][52649] Sum rewards: 75.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.730', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.084', 'AMMO4': '0.129', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '64.000'} [2024-08-06 05:42:06,930][52660] DAMAGECOUNT value on done: 655442.0 [2024-08-06 05:42:06,933][52660] Sum rewards: 75.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.006', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.112', 'AMMO4': '0.171', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:07,303][52668] DAMAGECOUNT value on done: 656521.0 [2024-08-06 05:42:07,305][52668] Sum rewards: 75.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.216', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 05:42:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 517406720. Throughput: 0: 4371.1. Samples: 129355920. Policy #0 lag: (min: 0.0, avg: 4.3, max: 8.0) [2024-08-06 05:42:07,795][52567] Avg episode reward: [(0, '73.188')] [2024-08-06 05:42:07,903][52650] Updated weights for policy 0, policy_version 63161 (0.0046) [2024-08-06 05:42:08,613][52662] DAMAGECOUNT value on done: 657553.0 [2024-08-06 05:42:08,613][52662] Sum rewards: 65.052, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.270', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.072', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'AMMO3': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.800', 'weapon3': '3.062', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '58.000'} [2024-08-06 05:42:09,393][52649] DAMAGECOUNT value on done: 647016.0 [2024-08-06 05:42:09,395][52649] Sum rewards: 77.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'weapon2': '0.202', 'weapon5': '0.220', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '64.000'} [2024-08-06 05:42:10,165][52660] DAMAGECOUNT value on done: 656336.0 [2024-08-06 05:42:10,168][52660] Sum rewards: 71.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.808', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.104', 'weapon2': '0.204', 'AMMO3': '0.229', 'AMMO4': '0.268', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '62.500'} [2024-08-06 05:42:10,577][52668] DAMAGECOUNT value on done: 666475.0 [2024-08-06 05:42:10,578][52668] Sum rewards: 78.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.470', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '66.000'} [2024-08-06 05:42:10,812][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:42:11,743][52662] DAMAGECOUNT value on done: 672004.0 [2024-08-06 05:42:11,746][52662] Sum rewards: 73.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.293', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.352', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:12,298][52649] DAMAGECOUNT value on done: 638612.0 [2024-08-06 05:42:12,299][52649] Sum rewards: 70.420, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.328', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'weapon4': '0.168', 'AMMO3': '0.188', 'weapon2': '0.202', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.302', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 05:42:12,588][52650] Updated weights for policy 0, policy_version 63171 (0.0054) [2024-08-06 05:42:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 517496832. Throughput: 0: 4380.0. Samples: 129382320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:12,802][52567] Avg episode reward: [(0, '73.160')] [2024-08-06 05:42:13,003][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:42:13,325][52660] DAMAGECOUNT value on done: 667399.0 [2024-08-06 05:42:13,329][52660] Sum rewards: 79.026, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.088', 'weapon4': '0.132', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'AMMO4': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '66.000'} [2024-08-06 05:42:13,672][52664] DAMAGECOUNT value on done: 683973.0 [2024-08-06 05:42:13,672][52664] Sum rewards: 67.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.281', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.242', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.622', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '58.000'} [2024-08-06 05:42:13,741][52668] DAMAGECOUNT value on done: 662457.0 [2024-08-06 05:42:13,742][52668] Sum rewards: 80.013, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.304', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.136', 'weapon5': '0.140', 'AMMO3': '0.255', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.956', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '67.000'} [2024-08-06 05:42:14,474][52662] DAMAGECOUNT value on done: 666549.0 [2024-08-06 05:42:14,476][52662] Sum rewards: 85.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.593', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.232', 'weapon2': '0.234', 'weapon5': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '71.000'} [2024-08-06 05:42:15,239][52649] DAMAGECOUNT value on done: 650912.0 [2024-08-06 05:42:15,242][52649] Sum rewards: 68.352, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon5': '0.134', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO4': '0.240', 'AMMO3': '0.289', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:16,259][52664] DAMAGECOUNT value on done: 690444.0 [2024-08-06 05:42:16,259][52664] Sum rewards: 65.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.676', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.026', 'AMMO4': '0.120', 'weapon5': '0.130', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.212', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '54.500'} [2024-08-06 05:42:16,501][52660] DAMAGECOUNT value on done: 654894.0 [2024-08-06 05:42:16,501][52660] Sum rewards: 62.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.178', 'AMMO4': '0.206', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '52.000'} [2024-08-06 05:42:17,471][52650] Updated weights for policy 0, policy_version 63181 (0.0026) [2024-08-06 05:42:17,659][52662] DAMAGECOUNT value on done: 651395.0 [2024-08-06 05:42:17,663][52662] Sum rewards: 71.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.182', 'AMMO4': '0.186', 'weapon4': '0.220', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '2.780', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 517578752. Throughput: 0: 4383.1. Samples: 129395550. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:17,794][52567] Avg episode reward: [(0, '73.147')] [2024-08-06 05:42:18,299][52649] DAMAGECOUNT value on done: 651010.0 [2024-08-06 05:42:18,300][52649] Sum rewards: 77.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.902', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.116', 'AMMO4': '0.130', 'AMMO3': '0.197', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '62.000'} [2024-08-06 05:42:19,308][52664] DAMAGECOUNT value on done: 688428.0 [2024-08-06 05:42:19,310][52664] Sum rewards: 69.320, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.432', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.136', 'AMMO4': '0.189', 'weapon5': '0.226', 'AMMO3': '0.227', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '58.000'} [2024-08-06 05:42:19,534][52660] DAMAGECOUNT value on done: 658023.0 [2024-08-06 05:42:19,534][52660] Sum rewards: 71.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.345', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.226', 'WEAPON3': '1.500', 'HITCOUNT': '3.340', 'weapon3': '3.594', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:20,619][52662] DAMAGECOUNT value on done: 661117.0 [2024-08-06 05:42:20,621][52662] Sum rewards: 86.167, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.126', 'AMMO4': '0.164', 'weapon2': '0.188', 'weapon4': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '73.000'} [2024-08-06 05:42:21,226][52649] DAMAGECOUNT value on done: 644207.0 [2024-08-06 05:42:21,229][52649] Sum rewards: 60.907, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.726', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '3.030', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '49.000'} [2024-08-06 05:42:21,391][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:42:21,713][52664] DAMAGECOUNT value on done: 680441.0 [2024-08-06 05:42:21,715][52664] Sum rewards: 75.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.068', 'weapon4': '0.134', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '63.000'} [2024-08-06 05:42:21,833][52650] Updated weights for policy 0, policy_version 63191 (0.0011) [2024-08-06 05:42:22,165][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:42:22,238][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:42:22,290][52660] DAMAGECOUNT value on done: 664541.0 [2024-08-06 05:42:22,291][52660] Sum rewards: 82.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.074', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.050', 'AMMO4': '0.167', 'weapon5': '0.178', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '69.000'} [2024-08-06 05:42:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 517668864. Throughput: 0: 4379.3. Samples: 129421690. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:22,802][52567] Avg episode reward: [(0, '73.219')] [2024-08-06 05:42:23,520][52662] DAMAGECOUNT value on done: 654515.0 [2024-08-06 05:42:23,521][52662] Sum rewards: 77.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.898', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.216', 'AMMO3': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '65.000'} [2024-08-06 05:42:24,554][52664] DAMAGECOUNT value on done: 691421.0 [2024-08-06 05:42:24,555][52664] Sum rewards: 79.836, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.633', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.066', 'AMMO4': '0.196', 'weapon5': '0.204', 'weapon2': '0.216', 'AMMO3': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.246', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '69.000'} [2024-08-06 05:42:24,640][52659] DAMAGECOUNT value on done: 666596.0 [2024-08-06 05:42:24,641][52659] Sum rewards: 69.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.058', 'AMMO4': '0.145', 'weapon5': '0.176', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.310', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '58.000'} [2024-08-06 05:42:25,145][52660] DAMAGECOUNT value on done: 655122.0 [2024-08-06 05:42:25,145][52660] Sum rewards: 70.324, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.348', 'HEALTH': '0.440', 'WEAPON3': '0.950', 'HITCOUNT': '3.170', 'weapon3': '3.394', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '57.000'} [2024-08-06 05:42:25,970][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:42:26,848][52650] Updated weights for policy 0, policy_version 63201 (0.0031) [2024-08-06 05:42:27,212][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:42:27,697][52664] DAMAGECOUNT value on done: 685205.0 [2024-08-06 05:42:27,699][52664] Sum rewards: 63.793, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.700', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.139', 'AMMO4': '0.194', 'weapon5': '0.328', 'weapon2': '0.372', 'weapon4': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.690', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '50.000'} [2024-08-06 05:42:27,731][52659] DAMAGECOUNT value on done: 660990.0 [2024-08-06 05:42:27,731][52659] Sum rewards: 64.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.102', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.176', 'AMMO3': '0.266', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.600', 'weapon3': '2.808', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '55.000'} [2024-08-06 05:42:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 517758976. Throughput: 0: 4371.1. Samples: 129447720. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:27,802][52567] Avg episode reward: [(0, '73.336')] [2024-08-06 05:42:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063203_517758976.pth... [2024-08-06 05:42:27,937][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062691_513564672.pth [2024-08-06 05:42:27,947][52660] DAMAGECOUNT value on done: 658446.0 [2024-08-06 05:42:27,949][52660] Sum rewards: 72.070, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.341', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.109', 'weapon5': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '57.000'} [2024-08-06 05:42:30,921][52659] DAMAGECOUNT value on done: 666516.0 [2024-08-06 05:42:30,921][52659] Sum rewards: 69.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.442', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.042', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.290', 'weapon3': '3.426', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '59.000'} [2024-08-06 05:42:31,253][52660] DAMAGECOUNT value on done: 669484.0 [2024-08-06 05:42:31,256][52660] Sum rewards: 72.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO4': '0.209', 'AMMO3': '0.217', 'weapon5': '0.270', 'weapon4': '0.310', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.678', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '62.000'} [2024-08-06 05:42:31,279][52664] DAMAGECOUNT value on done: 683623.0 [2024-08-06 05:42:31,280][52664] Sum rewards: 68.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.833', 'AMMO5': '0.010', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO4': '0.074', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.266', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.332', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '58.500'} [2024-08-06 05:42:31,820][52650] Updated weights for policy 0, policy_version 63211 (0.0012) [2024-08-06 05:42:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 517840896. Throughput: 0: 4352.0. Samples: 129460360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:32,794][52567] Avg episode reward: [(0, '73.356')] [2024-08-06 05:42:33,946][52660] DAMAGECOUNT value on done: 676548.0 [2024-08-06 05:42:33,946][52660] Sum rewards: 82.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.270', 'ARMOR': '0.005', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.167', 'weapon5': '0.212', 'weapon2': '0.306', 'weapon4': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '66.000'} [2024-08-06 05:42:34,135][52659] DAMAGECOUNT value on done: 660166.0 [2024-08-06 05:42:34,136][52659] Sum rewards: 75.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.128', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.176', 'weapon4': '0.262', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:34,164][52664] DAMAGECOUNT value on done: 679583.0 [2024-08-06 05:42:34,164][52664] Sum rewards: 75.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.054', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.026', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.416', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '63.500'} [2024-08-06 05:42:36,170][52650] Updated weights for policy 0, policy_version 63221 (0.0012) [2024-08-06 05:42:36,419][52660] DAMAGECOUNT value on done: 656838.0 [2024-08-06 05:42:36,419][52660] Sum rewards: 72.447, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.078', 'weapon5': '0.228', 'AMMO3': '0.231', 'AMMO4': '0.260', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '59.000'} [2024-08-06 05:42:36,604][52659] DAMAGECOUNT value on done: 658851.0 [2024-08-06 05:42:36,604][52659] Sum rewards: 75.205, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.360', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO3': '0.135', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.846', 'WEAPON3': '0.850', 'weapon3': '2.890', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '55.500'} [2024-08-06 05:42:36,772][52665] DAMAGECOUNT value on done: 648800.0 [2024-08-06 05:42:36,772][52665] Sum rewards: 72.167, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.865', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.830', 'WEAPON3': '1.000', 'weapon3': '2.848', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '57.000'} [2024-08-06 05:42:37,468][52664] DAMAGECOUNT value on done: 692901.0 [2024-08-06 05:42:37,470][52664] Sum rewards: 86.255, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.722', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.266', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.380', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.589', 'FRAGCOUNT': '74.000'} [2024-08-06 05:42:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 517931008. Throughput: 0: 4345.8. Samples: 129486270. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:37,795][52567] Avg episode reward: [(0, '73.452')] [2024-08-06 05:42:39,046][52660] DAMAGECOUNT value on done: 665786.0 [2024-08-06 05:42:39,047][52660] Sum rewards: 75.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.528', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.174', 'weapon5': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon4': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:39,369][52659] DAMAGECOUNT value on done: 666600.0 [2024-08-06 05:42:39,369][52659] Sum rewards: 65.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.092', 'weapon5': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.326', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '54.000'} [2024-08-06 05:42:39,857][52665] DAMAGECOUNT value on done: 665109.0 [2024-08-06 05:42:39,858][52665] Sum rewards: 72.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.695', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:40,090][52664] DAMAGECOUNT value on done: 683077.0 [2024-08-06 05:42:40,090][52664] Sum rewards: 72.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.194', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.212', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '58.000'} [2024-08-06 05:42:40,576][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:42:41,157][52650] Updated weights for policy 0, policy_version 63231 (0.0012) [2024-08-06 05:42:41,377][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:42:42,012][52659] DAMAGECOUNT value on done: 662093.0 [2024-08-06 05:42:42,012][52659] Sum rewards: 77.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.860', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.103', 'weapon5': '0.186', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '64.000'} [2024-08-06 05:42:42,100][52660] DAMAGECOUNT value on done: 660196.0 [2024-08-06 05:42:42,101][52660] Sum rewards: 78.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.158', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon2': '0.184', 'AMMO3': '0.257', 'WEAPON3': '1.650', 'weapon3': '3.558', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '67.000'} [2024-08-06 05:42:42,795][52567] Fps is (10 sec: 18021.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 518021120. Throughput: 0: 4346.6. Samples: 129512470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:42,795][52567] Avg episode reward: [(0, '73.237')] [2024-08-06 05:42:42,834][52665] DAMAGECOUNT value on done: 662221.0 [2024-08-06 05:42:42,835][52665] Sum rewards: 74.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.345', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'AMMO4': '0.205', 'weapon4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.800', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:43,024][52664] DAMAGECOUNT value on done: 690895.0 [2024-08-06 05:42:43,025][52664] Sum rewards: 75.709, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.157', 'AMMO5': '0.025', 'AMMO2': '0.070', 'weapon4': '0.170', 'AMMO3': '0.225', 'AMMO4': '0.352', 'weapon2': '0.356', 'weapon5': '0.404', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.730', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '62.000'} [2024-08-06 05:42:44,805][52794] DAMAGECOUNT value on done: 663201.0 [2024-08-06 05:42:44,806][52794] Sum rewards: 72.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.120', 'AMMO3': '0.196', 'AMMO4': '0.251', 'weapon4': '0.252', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:44,933][52660] DAMAGECOUNT value on done: 656065.0 [2024-08-06 05:42:44,934][52660] Sum rewards: 63.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.108', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon4': '0.288', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '52.500'} [2024-08-06 05:42:44,959][52659] DAMAGECOUNT value on done: 659033.0 [2024-08-06 05:42:44,959][52659] Sum rewards: 71.112, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.305', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.170', 'AMMO4': '0.246', 'weapon5': '0.254', 'weapon2': '0.260', 'AMMO3': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.948', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '62.000'} [2024-08-06 05:42:45,426][52664] DAMAGECOUNT value on done: 692064.0 [2024-08-06 05:42:45,428][52664] Sum rewards: 88.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.040', 'AMMO4': '0.042', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.360', 'FRAGCOUNT': '73.000'} [2024-08-06 05:42:45,626][52650] Updated weights for policy 0, policy_version 63241 (0.0012) [2024-08-06 05:42:45,930][52665] DAMAGECOUNT value on done: 656405.0 [2024-08-06 05:42:45,931][52665] Sum rewards: 71.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.724', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.153', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO4': '0.230', 'weapon2': '0.242', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.188', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '58.000'} [2024-08-06 05:42:47,524][52660] DAMAGECOUNT value on done: 651544.0 [2024-08-06 05:42:47,524][52660] Sum rewards: 79.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.932', 'AMMO2': '0.005', 'AMMO5': '0.009', 'AMMO4': '0.027', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'weapon4': '0.280', 'ARMOR': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '63.000'} [2024-08-06 05:42:47,706][52659] DAMAGECOUNT value on done: 665864.0 [2024-08-06 05:42:47,707][52659] Sum rewards: 82.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.689', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon5': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '67.000'} [2024-08-06 05:42:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 518103040. Throughput: 0: 4351.3. Samples: 129525780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:47,795][52567] Avg episode reward: [(0, '73.797')] [2024-08-06 05:42:47,856][52794] DAMAGECOUNT value on done: 670457.0 [2024-08-06 05:42:47,859][52794] Sum rewards: 82.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.636', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.112', 'AMMO3': '0.230', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.472', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '69.000'} [2024-08-06 05:42:48,410][52664] DAMAGECOUNT value on done: 691973.0 [2024-08-06 05:42:48,412][52664] Sum rewards: 70.495, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.168', 'weapon4': '0.224', 'AMMO4': '0.239', 'weapon2': '0.246', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:48,609][52665] DAMAGECOUNT value on done: 644018.0 [2024-08-06 05:42:48,612][52665] Sum rewards: 67.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.641', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon2': '0.198', 'AMMO3': '0.204', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.334', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '55.000'} [2024-08-06 05:42:50,248][52650] Updated weights for policy 0, policy_version 63251 (0.0023) [2024-08-06 05:42:50,252][52794] DAMAGECOUNT value on done: 671190.0 [2024-08-06 05:42:50,253][52794] Sum rewards: 78.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.093', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.082', 'AMMO3': '0.223', 'weapon5': '0.260', 'weapon2': '0.264', 'AMMO4': '0.275', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '66.000'} [2024-08-06 05:42:50,571][52659] DAMAGECOUNT value on done: 669530.0 [2024-08-06 05:42:50,571][52659] Sum rewards: 59.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.026', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.454', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.134', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '49.500'} [2024-08-06 05:42:51,241][52664] DAMAGECOUNT value on done: 693395.0 [2024-08-06 05:42:51,241][52664] Sum rewards: 65.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.963', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.042', 'weapon4': '0.070', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 05:42:51,495][52665] DAMAGECOUNT value on done: 651140.0 [2024-08-06 05:42:51,495][52665] Sum rewards: 55.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.744', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '47.000'} [2024-08-06 05:42:52,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 518193152. Throughput: 0: 4353.1. Samples: 129551810. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:52,802][52567] Avg episode reward: [(0, '73.513')] [2024-08-06 05:42:52,940][52794] DAMAGECOUNT value on done: 659982.0 [2024-08-06 05:42:52,941][52794] Sum rewards: 69.622, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.670', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.096', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.336', 'WEAPON4': '0.400', 'weapon4': '0.488', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:53,770][52659] DAMAGECOUNT value on done: 658207.0 [2024-08-06 05:42:53,770][52659] Sum rewards: 72.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.532', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.194', 'AMMO4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:53,783][52667] DAMAGECOUNT value on done: 663437.0 [2024-08-06 05:42:53,783][52667] Sum rewards: 63.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.180', 'weapon4': '0.236', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '55.000'} [2024-08-06 05:42:54,033][52665] DAMAGECOUNT value on done: 656173.0 [2024-08-06 05:42:54,035][52665] Sum rewards: 69.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.076', 'weapon4': '0.084', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'AMMO4': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.320', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '59.000'} [2024-08-06 05:42:54,117][52647] Large shaping reward 2.583 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)] [2024-08-06 05:42:54,399][52664] DAMAGECOUNT value on done: 696778.0 [2024-08-06 05:42:54,400][52664] Sum rewards: 76.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.084', 'weapon5': '0.174', 'AMMO4': '0.206', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '64.000'} [2024-08-06 05:42:54,997][52650] Updated weights for policy 0, policy_version 63261 (0.0020) [2024-08-06 05:42:55,812][52794] DAMAGECOUNT value on done: 660707.0 [2024-08-06 05:42:55,813][52794] Sum rewards: 81.035, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.136', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO4': '0.178', 'AMMO3': '0.183', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '64.000'} [2024-08-06 05:42:56,302][52665] DAMAGECOUNT value on done: 654113.0 [2024-08-06 05:42:56,303][52665] Sum rewards: 85.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.072', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '71.000'} [2024-08-06 05:42:56,667][52659] DAMAGECOUNT value on done: 668422.0 [2024-08-06 05:42:56,669][52659] Sum rewards: 72.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.358', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.048', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:56,766][52667] DAMAGECOUNT value on done: 671025.0 [2024-08-06 05:42:56,767][52667] Sum rewards: 75.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'weapon4': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 05:42:57,588][52664] DAMAGECOUNT value on done: 688997.0 [2024-08-06 05:42:57,588][52664] Sum rewards: 76.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.199', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'weapon5': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.702', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 05:42:57,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 518275072. Throughput: 0: 4354.9. Samples: 129578290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:42:57,794][52567] Avg episode reward: [(0, '73.554')] [2024-08-06 05:42:58,555][52794] DAMAGECOUNT value on done: 664520.0 [2024-08-06 05:42:58,556][52794] Sum rewards: 79.721, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.102', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 05:42:59,245][52659] DAMAGECOUNT value on done: 661447.0 [2024-08-06 05:42:59,247][52659] Sum rewards: 76.098, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.106', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.418', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '66.000'} [2024-08-06 05:42:59,372][52665] DAMAGECOUNT value on done: 665726.0 [2024-08-06 05:42:59,372][52665] Sum rewards: 58.820, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.650', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.054', 'AMMO3': '0.132', 'weapon2': '0.156', 'weapon5': '0.178', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '3.418', 'DAMAGECOUNT': '14.265', 'FRAGCOUNT': '46.000'} [2024-08-06 05:42:59,527][52667] DAMAGECOUNT value on done: 664383.0 [2024-08-06 05:42:59,531][52667] Sum rewards: 77.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.065', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.128', 'AMMO4': '0.149', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '63.000'} [2024-08-06 05:42:59,578][52650] Updated weights for policy 0, policy_version 63271 (0.0019) [2024-08-06 05:43:00,424][52664] DAMAGECOUNT value on done: 684833.0 [2024-08-06 05:43:00,425][52664] Sum rewards: 83.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.192', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.158', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '70.000'} [2024-08-06 05:43:01,587][52794] DAMAGECOUNT value on done: 667517.0 [2024-08-06 05:43:01,587][52794] Sum rewards: 84.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.806', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.071', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '68.000'} [2024-08-06 05:43:01,700][52659] DAMAGECOUNT value on done: 662371.0 [2024-08-06 05:43:01,700][52659] Sum rewards: 79.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.208', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.528', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '66.000'} [2024-08-06 05:43:02,457][52667] DAMAGECOUNT value on done: 668134.0 [2024-08-06 05:43:02,457][52667] Sum rewards: 82.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.188', 'AMMO3': '0.208', 'AMMO4': '0.265', 'weapon2': '0.316', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '66.000'} [2024-08-06 05:43:02,549][52665] DAMAGECOUNT value on done: 656189.0 [2024-08-06 05:43:02,549][52665] Sum rewards: 70.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.226', 'weapon2': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 518365184. Throughput: 0: 4354.0. Samples: 129591480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:43:02,794][52567] Avg episode reward: [(0, '73.712')] [2024-08-06 05:43:03,146][52664] DAMAGECOUNT value on done: 686815.0 [2024-08-06 05:43:03,146][52664] Sum rewards: 76.713, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.692', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '63.000'} [2024-08-06 05:43:04,276][52650] Updated weights for policy 0, policy_version 63281 (0.0020) [2024-08-06 05:43:04,617][52659] DAMAGECOUNT value on done: 673594.0 [2024-08-06 05:43:04,618][52659] Sum rewards: 76.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.412', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.046', 'weapon4': '0.074', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '63.000'} [2024-08-06 05:43:04,753][52794] DAMAGECOUNT value on done: 655292.0 [2024-08-06 05:43:04,754][52794] Sum rewards: 81.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.062', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.714', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '68.000'} [2024-08-06 05:43:05,291][52665] DAMAGECOUNT value on done: 664008.0 [2024-08-06 05:43:05,291][52665] Sum rewards: 75.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.158', 'AMMO3': '0.182', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:05,354][52667] DAMAGECOUNT value on done: 669468.0 [2024-08-06 05:43:05,355][52667] Sum rewards: 63.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.336', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.310', 'WEAPON3': '1.650', 'weapon3': '3.134', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '56.000'} [2024-08-06 05:43:06,110][52664] DAMAGECOUNT value on done: 688269.0 [2024-08-06 05:43:06,114][52664] Sum rewards: 65.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.217', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon4': '0.216', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:07,155][52795] DAMAGECOUNT value on done: 616418.0 [2024-08-06 05:43:07,157][52795] Sum rewards: 74.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.277', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.194', 'weapon5': '0.202', 'AMMO3': '0.239', 'AMMO4': '0.257', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:07,631][52794] DAMAGECOUNT value on done: 667432.0 [2024-08-06 05:43:07,632][52794] Sum rewards: 84.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.782', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'AMMO3': '0.209', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.430', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '71.000'} [2024-08-06 05:43:07,643][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:43:07,676][52659] DAMAGECOUNT value on done: 665160.0 [2024-08-06 05:43:07,678][52659] Sum rewards: 64.594, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO3': '0.147', 'AMMO4': '0.168', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.645', 'weapon2': '0.680', 'WEAPON3': '0.800', 'weapon3': '2.754', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '51.000'} [2024-08-06 05:43:07,732][52665] DAMAGECOUNT value on done: 661831.0 [2024-08-06 05:43:07,733][52665] Sum rewards: 85.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.302', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '69.000'} [2024-08-06 05:43:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 518455296. Throughput: 0: 4353.6. Samples: 129617600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:43:07,794][52567] Avg episode reward: [(0, '73.724')] [2024-08-06 05:43:08,129][52667] DAMAGECOUNT value on done: 673009.0 [2024-08-06 05:43:08,129][52667] Sum rewards: 70.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.612', 'AMMO5': '0.029', 'AMMO2': '0.071', 'AMMO3': '0.208', 'weapon2': '0.270', 'weapon5': '0.354', 'AMMO4': '0.354', 'weapon4': '0.378', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.682', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:09,113][52650] Updated weights for policy 0, policy_version 63291 (0.0011) [2024-08-06 05:43:09,255][52664] DAMAGECOUNT value on done: 686762.0 [2024-08-06 05:43:09,257][52664] Sum rewards: 78.111, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.051', 'weapon4': '0.140', 'AMMO3': '0.238', 'AMMO4': '0.254', 'weapon5': '0.264', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '64.000'} [2024-08-06 05:43:09,609][52614] Signal inference workers to stop experience collection... (11500 times) [2024-08-06 05:43:09,609][52614] Signal inference workers to resume experience collection... (11500 times) [2024-08-06 05:43:09,695][52650] InferenceWorker_p0-w0: stopping experience collection (11500 times) [2024-08-06 05:43:09,702][52650] InferenceWorker_p0-w0: resuming experience collection (11500 times) [2024-08-06 05:43:09,843][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:43:10,402][52795] DAMAGECOUNT value on done: 603863.0 [2024-08-06 05:43:10,403][52795] Sum rewards: 74.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.110', 'AMMO4': '0.145', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '61.000'} [2024-08-06 05:43:10,674][52665] DAMAGECOUNT value on done: 658777.0 [2024-08-06 05:43:10,676][52665] Sum rewards: 66.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.980', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.213', 'weapon2': '0.216', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.534', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:10,811][52794] DAMAGECOUNT value on done: 658511.0 [2024-08-06 05:43:10,812][52794] Sum rewards: 72.085, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.555', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.142', 'AMMO4': '0.168', 'weapon5': '0.196', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '0.900', 'weapon3': '2.808', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '56.000'} [2024-08-06 05:43:10,822][52667] DAMAGECOUNT value on done: 666696.0 [2024-08-06 05:43:10,823][52667] Sum rewards: 67.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.264', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.136', 'AMMO3': '0.187', 'AMMO4': '0.208', 'weapon2': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:10,855][52659] DAMAGECOUNT value on done: 670313.0 [2024-08-06 05:43:10,856][52659] Sum rewards: 56.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.979', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.190', 'AMMO3': '0.228', 'weapon5': '0.252', 'AMMO4': '0.274', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '48.000'} [2024-08-06 05:43:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 518545408. Throughput: 0: 4354.0. Samples: 129643650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:43:12,802][52567] Avg episode reward: [(0, '73.639')] [2024-08-06 05:43:13,436][52667] DAMAGECOUNT value on done: 666110.0 [2024-08-06 05:43:13,436][52667] Sum rewards: 76.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.656', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon5': '0.078', 'weapon4': '0.080', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.228', 'WEAPON3': '1.200', 'weapon3': '3.456', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '62.500'} [2024-08-06 05:43:13,557][52659] DAMAGECOUNT value on done: 659239.0 [2024-08-06 05:43:13,558][52659] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.352', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.166', 'AMMO4': '0.177', 'weapon5': '0.188', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '2.936', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:13,600][52795] DAMAGECOUNT value on done: 606024.0 [2024-08-06 05:43:13,602][52795] Sum rewards: 78.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.945', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.206', 'weapon4': '0.256', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '63.000'} [2024-08-06 05:43:13,613][52794] DAMAGECOUNT value on done: 657082.0 [2024-08-06 05:43:13,613][52794] Sum rewards: 67.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.165', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.134', 'AMMO3': '0.164', 'weapon4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:13,782][52650] Updated weights for policy 0, policy_version 63301 (0.0011) [2024-08-06 05:43:13,851][52665] DAMAGECOUNT value on done: 654907.0 [2024-08-06 05:43:13,854][52665] Sum rewards: 70.905, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.936', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.196', 'AMMO3': '0.253', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '2.814', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '61.000'} [2024-08-06 05:43:15,493][52820] DAMAGECOUNT value on done: 615873.0 [2024-08-06 05:43:15,493][52820] Sum rewards: 74.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.952', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.197', 'weapon5': '0.246', 'AMMO4': '0.307', 'weapon4': '0.322', 'weapon2': '0.374', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.648', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:16,079][52659] DAMAGECOUNT value on done: 670960.0 [2024-08-06 05:43:16,082][52659] Sum rewards: 74.622, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.357', 'AMMO5': '0.022', 'AMMO2': '0.053', 'weapon4': '0.094', 'weapon5': '0.226', 'AMMO4': '0.264', 'AMMO3': '0.267', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '64.000'} [2024-08-06 05:43:16,351][52667] DAMAGECOUNT value on done: 669921.0 [2024-08-06 05:43:16,352][52667] Sum rewards: 72.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.020', 'AMMO2': '0.057', 'AMMO3': '0.203', 'weapon2': '0.206', 'weapon4': '0.212', 'AMMO4': '0.287', 'weapon5': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:16,570][52794] DAMAGECOUNT value on done: 664865.0 [2024-08-06 05:43:16,570][52794] Sum rewards: 78.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.550', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon2': '0.186', 'weapon5': '0.222', 'AMMO4': '0.233', 'weapon4': '0.308', 'AMMO3': '0.311', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '2.958', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '67.000'} [2024-08-06 05:43:16,759][52795] DAMAGECOUNT value on done: 612500.0 [2024-08-06 05:43:16,759][52795] Sum rewards: 67.212, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.901', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.222', 'weapon4': '0.224', 'AMMO4': '0.226', 'AMMO3': '0.268', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.776', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '58.500'} [2024-08-06 05:43:17,154][52665] DAMAGECOUNT value on done: 654520.0 [2024-08-06 05:43:17,154][52665] Sum rewards: 64.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.224', 'AMMO3': '0.235', 'weapon2': '0.302', 'weapon4': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '54.000'} [2024-08-06 05:43:17,800][52567] Fps is (10 sec: 18011.5, 60 sec: 17611.0, 300 sec: 17494.4). Total num frames: 518635520. Throughput: 0: 4367.2. Samples: 129656910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:43:17,808][52567] Avg episode reward: [(0, '73.296')] [2024-08-06 05:43:18,274][52650] Updated weights for policy 0, policy_version 63311 (0.0013) [2024-08-06 05:43:18,713][52820] DAMAGECOUNT value on done: 614739.0 [2024-08-06 05:43:18,714][52820] Sum rewards: 59.095, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.943', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.184', 'AMMO4': '0.260', 'weapon4': '0.284', 'AMMO3': '0.309', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.874', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '54.000'} [2024-08-06 05:43:18,749][52659] DAMAGECOUNT value on done: 663258.0 [2024-08-06 05:43:18,750][52659] Sum rewards: 77.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.545', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'weapon4': '0.116', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:19,360][52794] DAMAGECOUNT value on done: 660300.0 [2024-08-06 05:43:19,360][52794] Sum rewards: 77.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.156', 'weapon4': '0.206', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:19,539][52667] DAMAGECOUNT value on done: 673308.0 [2024-08-06 05:43:19,540][52667] Sum rewards: 70.873, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.150', 'HEALTH': '0.171', 'AMMO3': '0.186', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:19,877][52795] DAMAGECOUNT value on done: 607579.0 [2024-08-06 05:43:19,879][52795] Sum rewards: 81.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.680', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.442', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '67.000'} [2024-08-06 05:43:20,325][52665] DAMAGECOUNT value on done: 655027.0 [2024-08-06 05:43:20,327][52665] Sum rewards: 73.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.300', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.070', 'AMMO4': '0.186', 'weapon5': '0.188', 'AMMO3': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:21,897][52820] DAMAGECOUNT value on done: 616760.0 [2024-08-06 05:43:21,899][52820] Sum rewards: 73.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.284', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.132', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:22,366][52794] DAMAGECOUNT value on done: 675603.0 [2024-08-06 05:43:22,367][52794] Sum rewards: 81.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.216', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.486', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '68.000'} [2024-08-06 05:43:22,740][52667] DAMAGECOUNT value on done: 662344.0 [2024-08-06 05:43:22,741][52667] Sum rewards: 70.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 518717440. Throughput: 0: 4373.1. Samples: 129683060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:43:22,794][52567] Avg episode reward: [(0, '73.492')] [2024-08-06 05:43:22,983][52650] Updated weights for policy 0, policy_version 63321 (0.0014) [2024-08-06 05:43:23,212][52665] DAMAGECOUNT value on done: 655363.0 [2024-08-06 05:43:23,213][52665] Sum rewards: 73.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '64.000'} [2024-08-06 05:43:23,315][52795] DAMAGECOUNT value on done: 618399.0 [2024-08-06 05:43:23,315][52795] Sum rewards: 71.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.178', 'AMMO3': '0.186', 'AMMO4': '0.193', 'weapon5': '0.216', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:25,002][52820] DAMAGECOUNT value on done: 608842.0 [2024-08-06 05:43:25,003][52820] Sum rewards: 79.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.078', 'AMMO3': '0.211', 'weapon5': '0.218', 'AMMO4': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:25,515][52794] DAMAGECOUNT value on done: 657824.0 [2024-08-06 05:43:25,518][52794] Sum rewards: 55.304, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.708', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.474', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.218', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '45.000'} [2024-08-06 05:43:25,590][52665] DAMAGECOUNT value on done: 649820.0 [2024-08-06 05:43:25,592][52665] Sum rewards: 71.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.152', 'weapon4': '0.158', 'AMMO3': '0.171', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:25,926][52667] DAMAGECOUNT value on done: 663385.0 [2024-08-06 05:43:25,926][52667] Sum rewards: 72.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.130', 'weapon4': '0.154', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '58.000'} [2024-08-06 05:43:26,414][52795] DAMAGECOUNT value on done: 620393.0 [2024-08-06 05:43:26,415][52795] Sum rewards: 69.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.713', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO3': '0.192', 'AMMO4': '0.200', 'weapon5': '0.204', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:27,794][52567] Fps is (10 sec: 16393.9, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 518799360. Throughput: 0: 4375.4. Samples: 129709360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 05:43:27,794][52567] Avg episode reward: [(0, '73.092')] [2024-08-06 05:43:28,147][52650] Updated weights for policy 0, policy_version 63331 (0.0013) [2024-08-06 05:43:28,190][52820] DAMAGECOUNT value on done: 615846.0 [2024-08-06 05:43:28,192][52820] Sum rewards: 68.732, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.820', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.078', 'AMMO4': '0.196', 'AMMO3': '0.256', 'weapon5': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '2.888', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:28,238][52665] DAMAGECOUNT value on done: 653771.0 [2024-08-06 05:43:28,248][52665] Sum rewards: 56.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO4': '0.189', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.276', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '3.048', 'DAMAGECOUNT': '14.289', 'FRAGCOUNT': '48.000'} [2024-08-06 05:43:28,318][52794] DAMAGECOUNT value on done: 672113.0 [2024-08-06 05:43:28,320][52794] Sum rewards: 61.106, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.345', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.532', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.208', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '50.000'} [2024-08-06 05:43:28,695][52667] DAMAGECOUNT value on done: 669068.0 [2024-08-06 05:43:28,697][52667] Sum rewards: 71.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.396', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.186', 'AMMO3': '0.191', 'AMMO4': '0.224', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.182', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:29,627][52795] DAMAGECOUNT value on done: 614102.0 [2024-08-06 05:43:29,630][52795] Sum rewards: 71.757, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.834', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.146', 'AMMO4': '0.165', 'weapon5': '0.168', 'weapon2': '0.208', 'AMMO3': '0.311', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.168', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:29,795][52811] DAMAGECOUNT value on done: 634539.0 [2024-08-06 05:43:29,796][52811] Sum rewards: 74.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.158', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:30,955][52663] DAMAGECOUNT value on done: 673937.0 [2024-08-06 05:43:30,957][52663] Sum rewards: 85.555, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.012', 'AMMO2': '0.046', 'HEALTH': '0.127', 'AMMO3': '0.130', 'weapon5': '0.204', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.472', 'weapon2': '0.500', 'WEAPON3': '0.750', 'weapon3': '2.594', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:31,018][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:43:31,405][52820] DAMAGECOUNT value on done: 608468.0 [2024-08-06 05:43:31,407][52820] Sum rewards: 95.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.120', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '22.371', 'FRAGCOUNT': '77.000'} [2024-08-06 05:43:31,470][52665] DAMAGECOUNT value on done: 659517.0 [2024-08-06 05:43:31,470][52665] Sum rewards: 70.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.450', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.038', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.472', 'WEAPON3': '1.350', 'HITCOUNT': '3.190', 'weapon3': '3.298', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:31,521][52794] DAMAGECOUNT value on done: 666500.0 [2024-08-06 05:43:31,523][52794] Sum rewards: 69.381, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.032', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO3': '0.194', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:31,705][52667] DAMAGECOUNT value on done: 660689.0 [2024-08-06 05:43:31,706][52667] Sum rewards: 70.435, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.661', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.084', 'weapon5': '0.188', 'AMMO4': '0.297', 'AMMO3': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.750', 'weapon3': '2.858', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:32,412][52650] Updated weights for policy 0, policy_version 63341 (0.0019) [2024-08-06 05:43:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 518889472. Throughput: 0: 4366.3. Samples: 129722260. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:43:32,794][52567] Avg episode reward: [(0, '73.214')] [2024-08-06 05:43:32,854][52795] DAMAGECOUNT value on done: 609736.0 [2024-08-06 05:43:32,856][52795] Sum rewards: 69.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.120', 'weapon5': '0.136', 'AMMO3': '0.208', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '58.000'} [2024-08-06 05:43:32,872][52811] DAMAGECOUNT value on done: 612752.0 [2024-08-06 05:43:32,873][52811] Sum rewards: 71.514, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.122', 'AMMO3': '0.206', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.696', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:34,101][52663] DAMAGECOUNT value on done: 665468.0 [2024-08-06 05:43:34,104][52663] Sum rewards: 78.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.070', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.064', 'weapon5': '0.078', 'AMMO4': '0.125', 'weapon2': '0.162', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.488', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '66.000'} [2024-08-06 05:43:34,313][52667] DAMAGECOUNT value on done: 668905.0 [2024-08-06 05:43:34,315][52667] Sum rewards: 79.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.916', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.108', 'AMMO4': '0.130', 'weapon5': '0.178', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:34,529][52820] DAMAGECOUNT value on done: 616243.0 [2024-08-06 05:43:34,531][52820] Sum rewards: 84.699, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.138', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '68.000'} [2024-08-06 05:43:34,645][52794] DAMAGECOUNT value on done: 671412.0 [2024-08-06 05:43:34,646][52794] Sum rewards: 70.471, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.172', 'weapon5': '0.210', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.752', 'WEAPON3': '1.050', 'weapon3': '2.564', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:35,233][52647] DAMAGECOUNT value on done: 704359.0 [2024-08-06 05:43:35,234][52647] Sum rewards: 79.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.534', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.130', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:35,867][52811] DAMAGECOUNT value on done: 613600.0 [2024-08-06 05:43:35,868][52811] Sum rewards: 72.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.891', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.182', 'AMMO4': '0.198', 'weapon4': '0.244', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '2.712', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '63.000'} [2024-08-06 05:43:35,996][52795] DAMAGECOUNT value on done: 618445.0 [2024-08-06 05:43:35,996][52795] Sum rewards: 80.239, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.156', 'weapon4': '0.182', 'AMMO3': '0.238', 'AMMO4': '0.262', 'weapon2': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '68.000'} [2024-08-06 05:43:36,827][52667] DAMAGECOUNT value on done: 675531.0 [2024-08-06 05:43:36,827][52667] Sum rewards: 75.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.312', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.154', 'weapon5': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:37,046][52663] DAMAGECOUNT value on done: 657724.0 [2024-08-06 05:43:37,047][52663] Sum rewards: 81.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.316', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.112', 'AMMO3': '0.190', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.408', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:37,270][52650] Updated weights for policy 0, policy_version 63351 (0.0012) [2024-08-06 05:43:37,704][52820] DAMAGECOUNT value on done: 618720.0 [2024-08-06 05:43:37,704][52820] Sum rewards: 66.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.978', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.060', 'weapon5': '0.096', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.718', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 518979584. Throughput: 0: 4367.3. Samples: 129748340. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:43:37,795][52567] Avg episode reward: [(0, '73.351')] [2024-08-06 05:43:37,828][52794] DAMAGECOUNT value on done: 672652.0 [2024-08-06 05:43:37,829][52794] Sum rewards: 65.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.626', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.074', 'AMMO4': '0.224', 'weapon5': '0.224', 'weapon2': '0.234', 'AMMO3': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'HITCOUNT': '3.160', 'weapon3': '3.166', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '58.000'} [2024-08-06 05:43:38,521][52647] DAMAGECOUNT value on done: 696364.0 [2024-08-06 05:43:38,521][52647] Sum rewards: 64.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.084', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.460', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '54.000'} [2024-08-06 05:43:38,783][52811] DAMAGECOUNT value on done: 615488.0 [2024-08-06 05:43:38,784][52811] Sum rewards: 74.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.392', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '61.000'} [2024-08-06 05:43:39,207][52795] DAMAGECOUNT value on done: 613361.0 [2024-08-06 05:43:39,217][52795] Sum rewards: 59.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.392', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.180', 'AMMO4': '0.201', 'AMMO3': '0.233', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.108', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '50.000'} [2024-08-06 05:43:39,728][52663] DAMAGECOUNT value on done: 661588.0 [2024-08-06 05:43:39,728][52663] Sum rewards: 62.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.150', 'weapon5': '0.202', 'AMMO4': '0.216', 'AMMO3': '0.229', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.040', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '53.500'} [2024-08-06 05:43:39,739][52667] DAMAGECOUNT value on done: 672299.0 [2024-08-06 05:43:39,739][52667] Sum rewards: 69.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.218', 'weapon2': '0.222', 'WEAPON3': '1.350', 'HITCOUNT': '3.480', 'weapon3': '3.502', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:40,759][52647] DAMAGECOUNT value on done: 701116.0 [2024-08-06 05:43:40,762][52647] Sum rewards: 74.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.112', 'weapon5': '0.170', 'AMMO4': '0.189', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '61.000'} [2024-08-06 05:43:40,797][52794] DAMAGECOUNT value on done: 664976.0 [2024-08-06 05:43:40,799][52794] Sum rewards: 74.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.209', 'weapon5': '0.220', 'weapon4': '0.230', 'AMMO4': '0.248', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:40,872][52820] DAMAGECOUNT value on done: 614054.0 [2024-08-06 05:43:40,874][52820] Sum rewards: 73.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.184', 'AMMO3': '0.203', 'AMMO4': '0.205', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:41,948][52811] DAMAGECOUNT value on done: 624713.0 [2024-08-06 05:43:41,949][52811] Sum rewards: 86.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.430', 'WEAPON3': '1.600', 'weapon3': '3.310', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '73.000'} [2024-08-06 05:43:42,062][52650] Updated weights for policy 0, policy_version 63361 (0.0019) [2024-08-06 05:43:42,517][52795] DAMAGECOUNT value on done: 609226.0 [2024-08-06 05:43:42,517][52795] Sum rewards: 68.024, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.555', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon2': '0.208', 'AMMO3': '0.302', 'WEAPON3': '1.750', 'HITCOUNT': '3.470', 'weapon3': '3.510', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 05:43:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 519061504. Throughput: 0: 4358.2. Samples: 129774410. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:43:42,795][52567] Avg episode reward: [(0, '72.798')] [2024-08-06 05:43:42,874][52667] DAMAGECOUNT value on done: 672709.0 [2024-08-06 05:43:42,874][52667] Sum rewards: 72.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.926', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.146', 'weapon2': '0.188', 'weapon5': '0.220', 'AMMO4': '0.224', 'AMMO3': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:42,934][52663] DAMAGECOUNT value on done: 666193.0 [2024-08-06 05:43:42,934][52663] Sum rewards: 73.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:43,422][52647] DAMAGECOUNT value on done: 700612.0 [2024-08-06 05:43:43,423][52647] Sum rewards: 74.490, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.336', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.182', 'AMMO4': '0.200', 'weapon4': '0.206', 'weapon2': '0.234', 'AMMO3': '0.239', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 05:43:43,979][52820] DAMAGECOUNT value on done: 620592.0 [2024-08-06 05:43:43,981][52820] Sum rewards: 65.854, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.368', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.084', 'weapon5': '0.178', 'AMMO4': '0.251', 'AMMO3': '0.265', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.134', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '58.000'} [2024-08-06 05:43:44,088][52666] DAMAGECOUNT value on done: 664658.0 [2024-08-06 05:43:44,088][52666] Sum rewards: 70.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.219', 'AMMO4': '0.221', 'weapon5': '0.246', 'weapon4': '0.262', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:44,140][52670] DAMAGECOUNT value on done: 657186.0 [2024-08-06 05:43:44,140][52670] Sum rewards: 92.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.082', 'weapon4': '0.128', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.000', 'weapon3': '3.204', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.840', 'FRAGCOUNT': '73.000'} [2024-08-06 05:43:45,010][52811] DAMAGECOUNT value on done: 628829.0 [2024-08-06 05:43:45,010][52811] Sum rewards: 77.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'weapon3': '3.552', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:45,524][52795] DAMAGECOUNT value on done: 608822.0 [2024-08-06 05:43:45,524][52795] Sum rewards: 76.204, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.837', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.180', 'weapon5': '0.186', 'AMMO3': '0.223', 'AMMO4': '0.228', 'weapon2': '0.252', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '64.000'} [2024-08-06 05:43:45,742][52647] DAMAGECOUNT value on done: 710460.0 [2024-08-06 05:43:45,742][52647] Sum rewards: 75.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.796', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.102', 'AMMO4': '0.175', 'AMMO3': '0.197', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.380', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 05:43:46,037][52663] DAMAGECOUNT value on done: 673279.0 [2024-08-06 05:43:46,040][52663] Sum rewards: 64.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'weapon4': '0.070', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.232', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'HITCOUNT': '3.200', 'weapon3': '3.508', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:46,123][52667] DAMAGECOUNT value on done: 665560.0 [2024-08-06 05:43:46,123][52667] Sum rewards: 76.523, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.595', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.122', 'weapon5': '0.214', 'AMMO4': '0.246', 'AMMO3': '0.266', 'weapon2': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '66.500'} [2024-08-06 05:43:46,649][52650] Updated weights for policy 0, policy_version 63371 (0.0011) [2024-08-06 05:43:47,092][52666] DAMAGECOUNT value on done: 663918.0 [2024-08-06 05:43:47,092][52666] Sum rewards: 59.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.016', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.228', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.438', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '50.000'} [2024-08-06 05:43:47,124][52670] DAMAGECOUNT value on done: 666160.0 [2024-08-06 05:43:47,124][52670] Sum rewards: 75.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.276', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO3': '0.156', 'weapon5': '0.156', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.414', 'WEAPON3': '0.950', 'weapon3': '3.152', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:47,130][52820] DAMAGECOUNT value on done: 609997.0 [2024-08-06 05:43:47,130][52820] Sum rewards: 62.347, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.242', 'weapon4': '0.430', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '51.000'} [2024-08-06 05:43:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 519159808. Throughput: 0: 4361.8. Samples: 129787760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:43:47,794][52567] Avg episode reward: [(0, '72.951')] [2024-08-06 05:43:48,088][52811] DAMAGECOUNT value on done: 624689.0 [2024-08-06 05:43:48,089][52811] Sum rewards: 73.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.025', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.220', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:48,717][52663] DAMAGECOUNT value on done: 661416.0 [2024-08-06 05:43:48,720][52663] Sum rewards: 80.288, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.776', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.144', 'AMMO4': '0.187', 'weapon2': '0.190', 'WEAPON5': '0.250', 'weapon4': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.086', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '69.000'} [2024-08-06 05:43:48,777][52795] DAMAGECOUNT value on done: 617422.0 [2024-08-06 05:43:48,778][52795] Sum rewards: 80.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.245', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.142', 'weapon5': '0.204', 'AMMO4': '0.227', 'AMMO3': '0.265', 'weapon2': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.052', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '70.000'} [2024-08-06 05:43:48,794][52667] DAMAGECOUNT value on done: 674621.0 [2024-08-06 05:43:48,794][52667] Sum rewards: 84.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.794', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.146', 'AMMO4': '0.190', 'weapon5': '0.212', 'weapon4': '0.258', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.884', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '68.000'} [2024-08-06 05:43:48,795][52647] DAMAGECOUNT value on done: 706558.0 [2024-08-06 05:43:48,795][52647] Sum rewards: 73.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.285', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.273', 'weapon2': '0.326', 'WEAPON3': '1.750', 'weapon3': '2.970', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 05:43:49,918][52666] DAMAGECOUNT value on done: 664954.0 [2024-08-06 05:43:49,918][52666] Sum rewards: 69.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.496', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.024', 'weapon5': '0.046', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.472', 'WEAPON3': '1.650', 'weapon3': '3.226', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:49,992][52670] DAMAGECOUNT value on done: 655144.0 [2024-08-06 05:43:50,000][52670] Sum rewards: 72.935, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.249', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.128', 'weapon5': '0.138', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:50,062][52820] DAMAGECOUNT value on done: 617483.0 [2024-08-06 05:43:50,064][52820] Sum rewards: 66.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.128', 'AMMO3': '0.168', 'AMMO4': '0.168', 'weapon4': '0.178', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.296', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:50,857][52650] Updated weights for policy 0, policy_version 63381 (0.0021) [2024-08-06 05:43:51,150][52811] DAMAGECOUNT value on done: 615056.0 [2024-08-06 05:43:51,151][52811] Sum rewards: 59.307, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.211', 'AMMO5': '0.003', 'weapon7': '0.018', 'AMMO2': '0.033', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO4': '0.167', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.216', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.240', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '54.000'} [2024-08-06 05:43:51,714][52647] DAMAGECOUNT value on done: 703584.0 [2024-08-06 05:43:51,714][52647] Sum rewards: 70.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.234', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.210', 'weapon2': '0.248', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '58.000'} [2024-08-06 05:43:51,889][52795] DAMAGECOUNT value on done: 603135.0 [2024-08-06 05:43:51,889][52795] Sum rewards: 65.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.794', 'AMMO5': '0.005', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:51,890][52663] DAMAGECOUNT value on done: 655674.0 [2024-08-06 05:43:51,892][52663] Sum rewards: 83.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.142', 'AMMO3': '0.173', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '68.000'} [2024-08-06 05:43:52,649][52666] DAMAGECOUNT value on done: 665895.0 [2024-08-06 05:43:52,651][52666] Sum rewards: 76.458, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.189', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.128', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '65.000'} [2024-08-06 05:43:52,763][52670] DAMAGECOUNT value on done: 654207.0 [2024-08-06 05:43:52,763][52670] Sum rewards: 68.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.198', 'AMMO4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.320', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '55.500'} [2024-08-06 05:43:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 519233536. Throughput: 0: 4362.7. Samples: 129813920. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:43:52,795][52567] Avg episode reward: [(0, '72.676')] [2024-08-06 05:43:53,103][52820] DAMAGECOUNT value on done: 624632.0 [2024-08-06 05:43:53,103][52820] Sum rewards: 66.659, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.224', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon4': '0.110', 'weapon5': '0.214', 'AMMO3': '0.274', 'AMMO4': '0.290', 'weapon2': '0.340', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '3.022', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:54,144][52811] DAMAGECOUNT value on done: 628862.0 [2024-08-06 05:43:54,144][52811] Sum rewards: 64.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.174', 'AMMO3': '0.211', 'weapon2': '0.300', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '54.000'} [2024-08-06 05:43:54,456][52663] DAMAGECOUNT value on done: 658528.0 [2024-08-06 05:43:54,457][52663] Sum rewards: 77.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.623', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'weapon5': '0.132', 'weapon4': '0.198', 'AMMO3': '0.229', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '64.000'} [2024-08-06 05:43:54,703][52647] DAMAGECOUNT value on done: 687457.0 [2024-08-06 05:43:54,704][52647] Sum rewards: 66.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.343', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.068', 'AMMO4': '0.208', 'AMMO3': '0.221', 'weapon5': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '2.966', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '56.000'} [2024-08-06 05:43:55,115][52795] DAMAGECOUNT value on done: 621179.0 [2024-08-06 05:43:55,127][52795] Sum rewards: 72.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.139', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.173', 'weapon5': '0.208', 'weapon4': '0.236', 'AMMO4': '0.237', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:55,350][52658] DAMAGECOUNT value on done: 666480.0 [2024-08-06 05:43:55,350][52658] Sum rewards: 72.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '60.000'} [2024-08-06 05:43:55,726][52659] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.453, 151.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:43:55,863][52666] DAMAGECOUNT value on done: 656981.0 [2024-08-06 05:43:55,863][52666] Sum rewards: 69.478, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.950', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.155', 'AMMO4': '0.191', 'weapon5': '0.196', 'weapon2': '0.248', 'weapon4': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.968', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '56.000'} [2024-08-06 05:43:55,968][52650] Updated weights for policy 0, policy_version 63391 (0.0025) [2024-08-06 05:43:56,032][52670] DAMAGECOUNT value on done: 665233.0 [2024-08-06 05:43:56,033][52670] Sum rewards: 61.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO3': '0.168', 'AMMO4': '0.199', 'weapon2': '0.310', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '49.000'} [2024-08-06 05:43:56,260][52820] DAMAGECOUNT value on done: 617727.0 [2024-08-06 05:43:56,263][52820] Sum rewards: 69.712, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.095', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '59.000'} [2024-08-06 05:43:56,927][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:43:57,087][52663] DAMAGECOUNT value on done: 661353.0 [2024-08-06 05:43:57,089][52663] Sum rewards: 67.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.096', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.210', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.544', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '56.000'} [2024-08-06 05:43:57,336][52811] DAMAGECOUNT value on done: 622396.0 [2024-08-06 05:43:57,336][52811] Sum rewards: 87.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.873', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon2': '0.172', 'weapon5': '0.180', 'weapon4': '0.198', 'AMMO4': '0.231', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '72.000'} [2024-08-06 05:43:57,535][52647] DAMAGECOUNT value on done: 702232.0 [2024-08-06 05:43:57,535][52647] Sum rewards: 78.358, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.032', 'AMMO5': '0.027', 'AMMO2': '0.069', 'weapon4': '0.118', 'AMMO3': '0.240', 'weapon5': '0.304', 'weapon2': '0.314', 'AMMO4': '0.343', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '65.500'} [2024-08-06 05:43:57,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 519315456. Throughput: 0: 4361.8. Samples: 129839930. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:43:57,794][52567] Avg episode reward: [(0, '72.514')] [2024-08-06 05:43:58,080][52669] DAMAGECOUNT value on done: 667695.0 [2024-08-06 05:43:58,080][52669] Sum rewards: 59.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.205', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.103', 'weapon4': '0.112', 'WEAPON4': '0.150', 'weapon2': '0.194', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.424', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '51.000'} [2024-08-06 05:43:58,358][52795] DAMAGECOUNT value on done: 615760.0 [2024-08-06 05:43:58,358][52795] Sum rewards: 68.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.166', 'weapon5': '0.186', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '57.000'} [2024-08-06 05:43:58,440][52666] DAMAGECOUNT value on done: 659836.0 [2024-08-06 05:43:58,441][52666] Sum rewards: 80.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.231', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '66.000'} [2024-08-06 05:43:58,465][52658] DAMAGECOUNT value on done: 665021.0 [2024-08-06 05:43:58,466][52658] Sum rewards: 61.204, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.042', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.702', 'WEAPON3': '1.500', 'weapon3': '2.908', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '54.000'} [2024-08-06 05:43:58,473][52671] DAMAGECOUNT value on done: 668874.0 [2024-08-06 05:43:58,473][52671] Sum rewards: 62.366, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.284', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'weapon3': '3.356', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '55.000'} [2024-08-06 05:43:58,697][52670] DAMAGECOUNT value on done: 661338.0 [2024-08-06 05:43:58,697][52670] Sum rewards: 74.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.070', 'AMMO4': '0.200', 'AMMO3': '0.224', 'weapon5': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '61.000'} [2024-08-06 05:43:59,456][52820] DAMAGECOUNT value on done: 621716.0 [2024-08-06 05:43:59,456][52820] Sum rewards: 63.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.029', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.738', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '53.000'} [2024-08-06 05:43:59,678][52663] DAMAGECOUNT value on done: 671602.0 [2024-08-06 05:43:59,679][52663] Sum rewards: 75.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.082', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.432', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:00,251][52647] DAMAGECOUNT value on done: 702310.0 [2024-08-06 05:44:00,259][52647] Sum rewards: 67.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.805', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO4': '0.199', 'weapon5': '0.222', 'AMMO3': '0.232', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:00,375][52811] DAMAGECOUNT value on done: 624493.0 [2024-08-06 05:44:00,375][52811] Sum rewards: 65.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.253', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:00,900][52669] DAMAGECOUNT value on done: 658979.0 [2024-08-06 05:44:00,901][52669] Sum rewards: 77.621, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.038', 'weapon5': '0.146', 'AMMO4': '0.186', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:01,050][52650] Updated weights for policy 0, policy_version 63401 (0.0022) [2024-08-06 05:44:01,175][52658] DAMAGECOUNT value on done: 670756.0 [2024-08-06 05:44:01,186][52658] Sum rewards: 91.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.206', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.328', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '21.753', 'FRAGCOUNT': '75.000'} [2024-08-06 05:44:01,484][52671] DAMAGECOUNT value on done: 672209.0 [2024-08-06 05:44:01,485][52671] Sum rewards: 78.757, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:01,556][52795] DAMAGECOUNT value on done: 608459.0 [2024-08-06 05:44:01,558][52795] Sum rewards: 72.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.432', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.118', 'weapon5': '0.134', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:01,654][52666] DAMAGECOUNT value on done: 657878.0 [2024-08-06 05:44:01,654][52666] Sum rewards: 53.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.114', 'AMMO4': '0.167', 'weapon2': '0.238', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.500', 'weapon3': '3.354', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '47.000'} [2024-08-06 05:44:02,011][52670] DAMAGECOUNT value on done: 652479.0 [2024-08-06 05:44:02,013][52670] Sum rewards: 80.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.715', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.053', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:02,715][52820] DAMAGECOUNT value on done: 617712.0 [2024-08-06 05:44:02,717][52820] Sum rewards: 83.190, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.596', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.282', 'weapon4': '0.372', 'WEAPON3': '1.000', 'weapon3': '3.114', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:02,764][52663] DAMAGECOUNT value on done: 657835.0 [2024-08-06 05:44:02,768][52663] Sum rewards: 67.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.075', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.155', 'weapon5': '0.194', 'weapon2': '0.218', 'weapon4': '0.228', 'AMMO4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.102', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '54.500'} [2024-08-06 05:44:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 519413760. Throughput: 0: 4358.6. Samples: 129853020. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:02,794][52567] Avg episode reward: [(0, '72.364')] [2024-08-06 05:44:02,834][52647] DAMAGECOUNT value on done: 698185.0 [2024-08-06 05:44:02,834][52647] Sum rewards: 73.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'weapon2': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.418', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:03,707][52811] DAMAGECOUNT value on done: 628815.0 [2024-08-06 05:44:03,707][52811] Sum rewards: 69.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.162', 'AMMO4': '0.170', 'AMMO3': '0.199', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.332', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '57.000'} [2024-08-06 05:44:03,796][52669] DAMAGECOUNT value on done: 669561.0 [2024-08-06 05:44:03,796][52669] Sum rewards: 64.701, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.451', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.800', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '53.000'} [2024-08-06 05:44:04,019][52658] DAMAGECOUNT value on done: 668557.0 [2024-08-06 05:44:04,019][52658] Sum rewards: 64.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.118', 'AMMO3': '0.198', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'weapon4': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '53.000'} [2024-08-06 05:44:04,664][52666] DAMAGECOUNT value on done: 655544.0 [2024-08-06 05:44:04,666][52666] Sum rewards: 62.982, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.538', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.161', 'weapon4': '0.176', 'weapon5': '0.196', 'AMMO4': '0.270', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.134', 'DAMAGECOUNT': '14.859', 'FRAGCOUNT': '51.000'} [2024-08-06 05:44:04,677][52795] DAMAGECOUNT value on done: 616544.0 [2024-08-06 05:44:04,678][52795] Sum rewards: 75.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.080', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.416', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '63.000'} [2024-08-06 05:44:04,722][52671] DAMAGECOUNT value on done: 669046.0 [2024-08-06 05:44:04,726][52671] Sum rewards: 66.013, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.860', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.122', 'weapon5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.000'} [2024-08-06 05:44:05,037][52670] DAMAGECOUNT value on done: 659605.0 [2024-08-06 05:44:05,038][52670] Sum rewards: 80.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.515', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO3': '0.231', 'weapon5': '0.236', 'AMMO4': '0.236', 'weapon4': '0.274', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:05,248][52650] Updated weights for policy 0, policy_version 63411 (0.0022) [2024-08-06 05:44:05,378][52647] DAMAGECOUNT value on done: 692849.0 [2024-08-06 05:44:05,379][52647] Sum rewards: 77.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.542', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.186', 'AMMO4': '0.203', 'AMMO3': '0.210', 'weapon2': '0.282', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:05,776][52663] DAMAGECOUNT value on done: 654073.0 [2024-08-06 05:44:05,780][52663] Sum rewards: 64.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.772', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.208', 'AMMO3': '0.230', 'weapon5': '0.236', 'AMMO4': '0.246', 'weapon2': '0.270', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.028', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:05,954][52820] DAMAGECOUNT value on done: 619036.0 [2024-08-06 05:44:05,955][52820] Sum rewards: 82.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.425', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon2': '0.184', 'AMMO3': '0.238', 'weapon4': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:06,758][52811] DAMAGECOUNT value on done: 621031.0 [2024-08-06 05:44:06,758][52811] Sum rewards: 74.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.094', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.186', 'weapon5': '0.236', 'AMMO4': '0.243', 'weapon4': '0.328', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:06,847][52669] DAMAGECOUNT value on done: 667146.0 [2024-08-06 05:44:06,847][52669] Sum rewards: 72.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.882', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.078', 'AMMO4': '0.192', 'weapon5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:07,078][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:44:07,224][52658] DAMAGECOUNT value on done: 658924.0 [2024-08-06 05:44:07,225][52658] Sum rewards: 70.808, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.035', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.136', 'weapon5': '0.148', 'AMMO4': '0.183', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '0.900', 'weapon3': '2.958', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:07,330][52671] DAMAGECOUNT value on done: 671674.0 [2024-08-06 05:44:07,333][52671] Sum rewards: 74.470, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.295', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.182', 'AMMO4': '0.184', 'weapon4': '0.188', 'weapon2': '0.270', 'AMMO3': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.032', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:07,599][52666] DAMAGECOUNT value on done: 662774.0 [2024-08-06 05:44:07,600][52666] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.167', 'weapon2': '0.208', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.330', 'weapon3': '3.346', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:07,788][52670] DAMAGECOUNT value on done: 657095.0 [2024-08-06 05:44:07,789][52670] Sum rewards: 66.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.160', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.111', 'AMMO3': '0.153', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '0.900', 'HITCOUNT': '3.120', 'weapon3': '3.214', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '52.000'} [2024-08-06 05:44:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 519503872. Throughput: 0: 4353.8. Samples: 129878980. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:07,794][52567] Avg episode reward: [(0, '72.193')] [2024-08-06 05:44:07,828][52795] DAMAGECOUNT value on done: 622431.0 [2024-08-06 05:44:07,828][52795] Sum rewards: 80.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.320', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.374', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:08,152][52647] DAMAGECOUNT value on done: 706801.0 [2024-08-06 05:44:08,153][52647] Sum rewards: 86.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.309', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.096', 'weapon5': '0.124', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '71.000'} [2024-08-06 05:44:08,980][52820] DAMAGECOUNT value on done: 629879.0 [2024-08-06 05:44:08,981][52820] Sum rewards: 87.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.383', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.352', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '72.000'} [2024-08-06 05:44:09,012][52663] DAMAGECOUNT value on done: 659838.0 [2024-08-06 05:44:09,013][52663] Sum rewards: 71.718, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.304', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.164', 'AMMO3': '0.254', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '2.806', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:09,301][52803] DAMAGECOUNT value on done: 619485.0 [2024-08-06 05:44:09,301][52803] Sum rewards: 73.606, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.227', 'AMMO5': '0.013', 'AMMO2': '0.054', 'AMMO3': '0.204', 'weapon5': '0.208', 'weapon4': '0.218', 'AMMO4': '0.269', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:09,681][52658] DAMAGECOUNT value on done: 659186.0 [2024-08-06 05:44:09,681][52658] Sum rewards: 71.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.167', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '3.172', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '57.000'} [2024-08-06 05:44:09,926][52811] DAMAGECOUNT value on done: 618197.0 [2024-08-06 05:44:09,927][52811] Sum rewards: 88.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.180', 'AMMO3': '0.202', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.315', 'FRAGCOUNT': '72.000'} [2024-08-06 05:44:09,954][52669] DAMAGECOUNT value on done: 666650.0 [2024-08-06 05:44:09,956][52669] Sum rewards: 72.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon4': '0.102', 'weapon5': '0.118', 'AMMO3': '0.143', 'AMMO4': '0.301', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.628', 'WEAPON3': '0.900', 'weapon3': '2.930', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:10,274][52650] Updated weights for policy 0, policy_version 63421 (0.0019) [2024-08-06 05:44:10,329][52671] DAMAGECOUNT value on done: 679534.0 [2024-08-06 05:44:10,330][52671] Sum rewards: 69.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.258', 'weapon2': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:10,703][52666] DAMAGECOUNT value on done: 655915.0 [2024-08-06 05:44:10,704][52666] Sum rewards: 79.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.838', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon2': '0.202', 'AMMO3': '0.249', 'weapon5': '0.262', 'weapon4': '0.312', 'AMMO4': '0.333', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.884', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:10,901][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:44:10,940][52670] DAMAGECOUNT value on done: 654314.0 [2024-08-06 05:44:10,943][52670] Sum rewards: 67.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.753', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.052', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '58.000'} [2024-08-06 05:44:11,443][52647] DAMAGECOUNT value on done: 694674.0 [2024-08-06 05:44:11,444][52647] Sum rewards: 73.176, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.108', 'weapon4': '0.118', 'AMMO4': '0.147', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 05:44:11,620][52663] DAMAGECOUNT value on done: 655290.0 [2024-08-06 05:44:11,620][52663] Sum rewards: 74.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon2': '0.168', 'AMMO3': '0.199', 'weapon4': '0.208', 'AMMO4': '0.214', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:12,223][52820] DAMAGECOUNT value on done: 626135.0 [2024-08-06 05:44:12,226][52820] Sum rewards: 57.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '2.820', 'weapon3': '3.364', 'DAMAGECOUNT': '14.502', 'FRAGCOUNT': '49.000'} [2024-08-06 05:44:12,320][52669] DAMAGECOUNT value on done: 669567.0 [2024-08-06 05:44:12,320][52669] Sum rewards: 56.321, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.838', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.166', 'weapon5': '0.170', 'AMMO4': '0.189', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon4': '0.260', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon7': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.288', 'HITCOUNT': '2.330', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '46.000'} [2024-08-06 05:44:12,535][52803] DAMAGECOUNT value on done: 619635.0 [2024-08-06 05:44:12,535][52803] Sum rewards: 67.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon5': '0.182', 'weapon4': '0.184', 'AMMO3': '0.226', 'AMMO4': '0.325', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:12,715][52658] DAMAGECOUNT value on done: 671609.0 [2024-08-06 05:44:12,715][52658] Sum rewards: 62.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.163', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.096', 'weapon5': '0.150', 'AMMO3': '0.212', 'AMMO4': '0.261', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.142', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '54.000'} [2024-08-06 05:44:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 519585792. Throughput: 0: 4349.8. Samples: 129905100. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:12,794][52567] Avg episode reward: [(0, '72.020')] [2024-08-06 05:44:12,927][52811] DAMAGECOUNT value on done: 618638.0 [2024-08-06 05:44:12,928][52811] Sum rewards: 68.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.038', 'AMMO4': '0.143', 'weapon5': '0.232', 'weapon2': '0.236', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.258', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '57.000'} [2024-08-06 05:44:13,197][52671] DAMAGECOUNT value on done: 670895.0 [2024-08-06 05:44:13,201][52671] Sum rewards: 76.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.196', 'AMMO3': '0.201', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:13,527][52666] DAMAGECOUNT value on done: 661163.0 [2024-08-06 05:44:13,530][52666] Sum rewards: 88.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.831', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.102', 'weapon5': '0.126', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON3': '1.200', 'weapon3': '3.400', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.664', 'FRAGCOUNT': '71.000'} [2024-08-06 05:44:13,714][52670] DAMAGECOUNT value on done: 664548.0 [2024-08-06 05:44:13,714][52670] Sum rewards: 84.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.067', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.346', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.394', 'FRAGCOUNT': '70.000'} [2024-08-06 05:44:14,309][52663] DAMAGECOUNT value on done: 670115.0 [2024-08-06 05:44:14,309][52663] Sum rewards: 75.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.475', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.184', 'weapon2': '0.198', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:14,396][52647] DAMAGECOUNT value on done: 704653.0 [2024-08-06 05:44:14,397][52647] Sum rewards: 85.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.738', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.036', 'weapon4': '0.074', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '70.000'} [2024-08-06 05:44:15,155][52650] Updated weights for policy 0, policy_version 63431 (0.0023) [2024-08-06 05:44:15,293][52820] DAMAGECOUNT value on done: 615903.0 [2024-08-06 05:44:15,293][52820] Sum rewards: 84.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.274', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '70.000'} [2024-08-06 05:44:15,431][52669] DAMAGECOUNT value on done: 668346.0 [2024-08-06 05:44:15,443][52669] Sum rewards: 88.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.022', 'AMMO4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '71.000'} [2024-08-06 05:44:15,613][52803] DAMAGECOUNT value on done: 625240.0 [2024-08-06 05:44:15,614][52803] Sum rewards: 64.880, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.434', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.070', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.290', 'weapon2': '0.352', 'WEAPON3': '1.700', 'HITCOUNT': '3.210', 'weapon3': '3.242', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '58.000'} [2024-08-06 05:44:15,625][52658] DAMAGECOUNT value on done: 662037.0 [2024-08-06 05:44:15,626][52658] Sum rewards: 70.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.092', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:16,057][52811] DAMAGECOUNT value on done: 617997.0 [2024-08-06 05:44:16,058][52811] Sum rewards: 77.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.644', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.140', 'AMMO3': '0.181', 'AMMO4': '0.195', 'weapon5': '0.204', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '63.000'} [2024-08-06 05:44:16,091][52666] DAMAGECOUNT value on done: 651381.0 [2024-08-06 05:44:16,091][52666] Sum rewards: 70.293, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.156', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.175', 'weapon2': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.448', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '58.000'} [2024-08-06 05:44:16,109][52671] DAMAGECOUNT value on done: 674894.0 [2024-08-06 05:44:16,109][52671] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.420', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.108', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.295', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.240', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:16,181][52670] DAMAGECOUNT value on done: 649551.0 [2024-08-06 05:44:16,183][52670] Sum rewards: 64.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.080', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:17,229][52663] DAMAGECOUNT value on done: 661403.0 [2024-08-06 05:44:17,229][52663] Sum rewards: 78.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.335', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:17,415][52647] DAMAGECOUNT value on done: 705462.0 [2024-08-06 05:44:17,415][52647] Sum rewards: 74.197, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.138', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.340', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17204.9, 300 sec: 17439.2). Total num frames: 519667712. Throughput: 0: 4355.1. Samples: 129918240. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:17,794][52567] Avg episode reward: [(0, '72.546')] [2024-08-06 05:44:18,255][52658] DAMAGECOUNT value on done: 680632.0 [2024-08-06 05:44:18,257][52658] Sum rewards: 69.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.660', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.042', 'AMMO2': '0.043', 'weapon5': '0.162', 'AMMO4': '0.214', 'AMMO3': '0.269', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.130', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:18,352][52669] DAMAGECOUNT value on done: 667444.0 [2024-08-06 05:44:18,353][52669] Sum rewards: 77.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.078', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'weapon5': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '63.000'} [2024-08-06 05:44:18,610][52666] DAMAGECOUNT value on done: 665088.0 [2024-08-06 05:44:18,611][52666] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.445', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.046', 'AMMO4': '0.161', 'weapon5': '0.204', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.130', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:18,666][52670] DAMAGECOUNT value on done: 660223.0 [2024-08-06 05:44:18,667][52670] Sum rewards: 74.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.270', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.144', 'weapon5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.229', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '63.000'} [2024-08-06 05:44:18,798][52803] DAMAGECOUNT value on done: 625315.0 [2024-08-06 05:44:18,798][52803] Sum rewards: 65.319, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.995', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.086', 'AMMO4': '0.109', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.332', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 05:44:19,073][52811] DAMAGECOUNT value on done: 623541.0 [2024-08-06 05:44:19,073][52811] Sum rewards: 76.061, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.486', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.150', 'weapon5': '0.228', 'AMMO3': '0.237', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:19,079][52671] DAMAGECOUNT value on done: 670537.0 [2024-08-06 05:44:19,079][52671] Sum rewards: 76.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.654', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.138', 'weapon4': '0.164', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:19,336][52650] Updated weights for policy 0, policy_version 63441 (0.0019) [2024-08-06 05:44:20,149][52647] DAMAGECOUNT value on done: 689119.0 [2024-08-06 05:44:20,150][52647] Sum rewards: 80.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.025', 'AMMO2': '0.054', 'AMMO3': '0.212', 'weapon2': '0.232', 'weapon4': '0.240', 'AMMO4': '0.272', 'weapon5': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '67.000'} [2024-08-06 05:44:20,361][52663] DAMAGECOUNT value on done: 666819.0 [2024-08-06 05:44:20,362][52663] Sum rewards: 73.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.294', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.128', 'AMMO4': '0.149', 'AMMO3': '0.164', 'WEAPON3': '1.150', 'HITCOUNT': '3.380', 'weapon3': '3.694', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:20,803][52658] DAMAGECOUNT value on done: 667269.0 [2024-08-06 05:44:20,803][52658] Sum rewards: 75.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.814', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.282', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.404', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:21,035][52666] DAMAGECOUNT value on done: 659388.0 [2024-08-06 05:44:21,038][52666] Sum rewards: 49.271, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.115', 'AMMO5': '0.021', 'AMMO2': '0.092', 'AMMO3': '0.207', 'weapon5': '0.268', 'weapon4': '0.278', 'weapon2': '0.402', 'AMMO4': '0.460', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.410', 'weapon3': '2.754', 'DAMAGECOUNT': '13.344', 'FRAGCOUNT': '44.500'} [2024-08-06 05:44:21,053][52670] DAMAGECOUNT value on done: 665492.0 [2024-08-06 05:44:21,053][52670] Sum rewards: 82.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.397', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.170', 'AMMO3': '0.209', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '67.000'} [2024-08-06 05:44:21,530][52669] DAMAGECOUNT value on done: 675181.0 [2024-08-06 05:44:21,531][52669] Sum rewards: 69.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:21,902][52803] DAMAGECOUNT value on done: 624294.0 [2024-08-06 05:44:21,903][52803] Sum rewards: 74.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.072', 'AMMO4': '0.120', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.326', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:22,079][52671] DAMAGECOUNT value on done: 663426.0 [2024-08-06 05:44:22,081][52671] Sum rewards: 71.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.936', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon2': '0.208', 'AMMO3': '0.209', 'weapon5': '0.214', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'weapon4': '0.466', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:22,168][52811] DAMAGECOUNT value on done: 628126.0 [2024-08-06 05:44:22,170][52811] Sum rewards: 71.982, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.114', 'weapon5': '0.140', 'AMMO3': '0.190', 'AMMO4': '0.202', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 519766016. Throughput: 0: 4365.6. Samples: 129944790. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:22,794][52567] Avg episode reward: [(0, '72.624')] [2024-08-06 05:44:23,065][52663] DAMAGECOUNT value on done: 667133.0 [2024-08-06 05:44:23,067][52663] Sum rewards: 62.751, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.594', 'AMMO5': '0.023', 'AMMO2': '0.058', 'AMMO3': '0.285', 'AMMO4': '0.288', 'weapon4': '0.310', 'weapon5': '0.326', 'weapon2': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.608', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '54.500'} [2024-08-06 05:44:23,168][52647] DAMAGECOUNT value on done: 698711.0 [2024-08-06 05:44:23,168][52647] Sum rewards: 83.419, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.020', 'HEALTH': '0.057', 'AMMO4': '0.099', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.164', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:23,692][52658] DAMAGECOUNT value on done: 677963.0 [2024-08-06 05:44:23,695][52658] Sum rewards: 74.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.371', 'AMMO5': '0.010', 'weapon4': '0.010', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon2': '0.130', 'weapon5': '0.140', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.530', 'weapon3': '3.602', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:23,899][52669] DAMAGECOUNT value on done: 668093.0 [2024-08-06 05:44:23,902][52669] Sum rewards: 78.742, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.998', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.099', 'weapon5': '0.112', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '63.000'} [2024-08-06 05:44:24,162][52670] DAMAGECOUNT value on done: 663184.0 [2024-08-06 05:44:24,163][52670] Sum rewards: 79.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.152', 'AMMO5': '0.004', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'weapon2': '0.264', 'AMMO3': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.528', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '68.500'} [2024-08-06 05:44:24,165][52666] DAMAGECOUNT value on done: 663458.0 [2024-08-06 05:44:24,166][52666] Sum rewards: 69.189, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.414', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.078', 'weapon5': '0.194', 'AMMO3': '0.234', 'AMMO4': '0.265', 'weapon2': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:24,534][52650] Updated weights for policy 0, policy_version 63451 (0.0019) [2024-08-06 05:44:24,989][52671] DAMAGECOUNT value on done: 670290.0 [2024-08-06 05:44:24,993][52671] Sum rewards: 69.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.706', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.115', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.098', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:25,072][52803] DAMAGECOUNT value on done: 615245.0 [2024-08-06 05:44:25,072][52803] Sum rewards: 86.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.350', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.127', 'weapon5': '0.152', 'AMMO4': '0.197', 'weapon4': '0.226', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon3': '3.100', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '67.000'} [2024-08-06 05:44:25,078][52811] DAMAGECOUNT value on done: 623158.0 [2024-08-06 05:44:25,078][52811] Sum rewards: 70.049, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.696', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.064', 'weapon7': '0.086', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:25,086][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:44:25,639][52647] DAMAGECOUNT value on done: 689785.0 [2024-08-06 05:44:25,641][52647] Sum rewards: 87.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.584', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.167', 'AMMO4': '0.182', 'weapon5': '0.190', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '69.000'} [2024-08-06 05:44:25,657][52668] DAMAGECOUNT value on done: 663526.0 [2024-08-06 05:44:25,657][52668] Sum rewards: 49.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.184', 'AMMO4': '0.244', 'AMMO3': '0.255', 'weapon2': '0.292', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '2.860', 'DAMAGECOUNT': '13.212', 'FRAGCOUNT': '43.000'} [2024-08-06 05:44:25,893][52663] DAMAGECOUNT value on done: 659919.0 [2024-08-06 05:44:25,901][52663] Sum rewards: 65.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.175', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '53.000'} [2024-08-06 05:44:26,229][52658] DAMAGECOUNT value on done: 663830.0 [2024-08-06 05:44:26,229][52658] Sum rewards: 69.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon2': '0.182', 'AMMO4': '0.245', 'weapon5': '0.246', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.214', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:26,977][52669] DAMAGECOUNT value on done: 670208.0 [2024-08-06 05:44:26,978][52669] Sum rewards: 66.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.955', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:27,204][52670] DAMAGECOUNT value on done: 644766.0 [2024-08-06 05:44:27,205][52670] Sum rewards: 68.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.050', 'weapon5': '0.176', 'weapon2': '0.228', 'AMMO3': '0.232', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '3.328', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:27,206][52666] DAMAGECOUNT value on done: 653301.0 [2024-08-06 05:44:27,207][52666] Sum rewards: 71.668, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.084', 'weapon2': '0.228', 'weapon5': '0.236', 'AMMO4': '0.273', 'AMMO3': '0.299', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.130', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:27,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 519856128. Throughput: 0: 4365.1. Samples: 129970840. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:27,795][52567] Avg episode reward: [(0, '72.684')] [2024-08-06 05:44:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063459_519856128.pth... [2024-08-06 05:44:27,984][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000062947_515661824.pth [2024-08-06 05:44:28,141][52671] DAMAGECOUNT value on done: 673187.0 [2024-08-06 05:44:28,144][52671] Sum rewards: 75.785, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.009', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.126', 'weapon5': '0.130', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.000', 'weapon3': '3.336', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:28,189][52647] DAMAGECOUNT value on done: 693524.0 [2024-08-06 05:44:28,191][52647] Sum rewards: 74.675, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.200', 'AMMO4': '0.202', 'weapon5': '0.206', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:28,210][52811] DAMAGECOUNT value on done: 620311.0 [2024-08-06 05:44:28,211][52811] Sum rewards: 64.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.616', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.149', 'weapon5': '0.178', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:28,298][52803] DAMAGECOUNT value on done: 614729.0 [2024-08-06 05:44:28,299][52803] Sum rewards: 71.802, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.236', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon5': '0.194', 'AMMO4': '0.195', 'weapon2': '0.246', 'AMMO3': '0.283', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.946', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '62.500'} [2024-08-06 05:44:28,653][52668] DAMAGECOUNT value on done: 668932.0 [2024-08-06 05:44:28,653][52668] Sum rewards: 70.673, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.193', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.720', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '58.000'} [2024-08-06 05:44:28,763][52650] Updated weights for policy 0, policy_version 63461 (0.0010) [2024-08-06 05:44:29,421][52658] DAMAGECOUNT value on done: 669474.0 [2024-08-06 05:44:29,421][52658] Sum rewards: 64.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.124', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.080', 'weapon5': '0.132', 'AMMO4': '0.136', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '2.932', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '52.000'} [2024-08-06 05:44:29,629][52666] DAMAGECOUNT value on done: 660622.0 [2024-08-06 05:44:29,630][52666] Sum rewards: 69.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'weapon4': '0.024', 'AMMO2': '0.030', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'weapon2': '0.234', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'HITCOUNT': '3.400', 'weapon3': '3.472', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:29,650][52670] DAMAGECOUNT value on done: 657151.0 [2024-08-06 05:44:29,650][52670] Sum rewards: 77.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.364', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.242', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:29,766][52669] DAMAGECOUNT value on done: 675051.0 [2024-08-06 05:44:29,767][52669] Sum rewards: 86.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '70.000'} [2024-08-06 05:44:31,341][52671] DAMAGECOUNT value on done: 668706.0 [2024-08-06 05:44:31,342][52671] Sum rewards: 77.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.340', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.172', 'AMMO3': '0.195', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:31,465][52803] DAMAGECOUNT value on done: 613490.0 [2024-08-06 05:44:31,465][52803] Sum rewards: 73.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.640', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.145', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.348', 'WEAPON3': '0.950', 'weapon3': '2.980', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:31,660][52668] DAMAGECOUNT value on done: 669778.0 [2024-08-06 05:44:31,660][52668] Sum rewards: 76.005, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.160', 'AMMO4': '0.183', 'AMMO3': '0.192', 'weapon4': '0.276', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:32,241][52666] DAMAGECOUNT value on done: 670152.0 [2024-08-06 05:44:32,242][52666] Sum rewards: 71.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.023', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'weapon5': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 05:44:32,242][52670] DAMAGECOUNT value on done: 663704.0 [2024-08-06 05:44:32,244][52670] Sum rewards: 61.214, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.945', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.050', 'weapon5': '0.148', 'AMMO4': '0.208', 'AMMO3': '0.294', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '2.910', 'weapon3': '3.154', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:32,445][52669] DAMAGECOUNT value on done: 659901.0 [2024-08-06 05:44:32,446][52669] Sum rewards: 86.656, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.085', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.142', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'weapon4': '0.472', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.697', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:32,644][52658] DAMAGECOUNT value on done: 662636.0 [2024-08-06 05:44:32,645][52658] Sum rewards: 81.920, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.462', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.168', 'AMMO4': '0.173', 'weapon4': '0.242', 'weapon2': '0.252', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.936', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:32,766][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:44:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 519938048. Throughput: 0: 4352.0. Samples: 129983600. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:32,795][52567] Avg episode reward: [(0, '73.201')] [2024-08-06 05:44:33,881][52650] Updated weights for policy 0, policy_version 63471 (0.0012) [2024-08-06 05:44:34,220][52668] DAMAGECOUNT value on done: 670457.0 [2024-08-06 05:44:34,221][52668] Sum rewards: 69.652, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.246', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.110', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '57.000'} [2024-08-06 05:44:34,388][52671] DAMAGECOUNT value on done: 674409.0 [2024-08-06 05:44:34,389][52671] Sum rewards: 74.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.064', 'weapon5': '0.084', 'AMMO4': '0.107', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:34,588][52803] DAMAGECOUNT value on done: 618431.0 [2024-08-06 05:44:34,588][52803] Sum rewards: 77.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.225', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon5': '0.202', 'AMMO3': '0.246', 'AMMO4': '0.274', 'weapon4': '0.312', 'weapon2': '0.438', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.666', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:35,196][52658] DAMAGECOUNT value on done: 670717.0 [2024-08-06 05:44:35,197][52658] Sum rewards: 88.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon5': '0.060', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '22.068', 'FRAGCOUNT': '70.000'} [2024-08-06 05:44:35,384][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:44:35,568][52669] DAMAGECOUNT value on done: 665219.0 [2024-08-06 05:44:35,576][52669] Sum rewards: 69.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.598', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.148', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:35,580][52666] DAMAGECOUNT value on done: 650433.0 [2024-08-06 05:44:35,580][52666] Sum rewards: 87.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon2': '0.170', 'AMMO3': '0.245', 'WEAPON3': '1.450', 'weapon3': '3.644', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '74.000'} [2024-08-06 05:44:35,605][52670] DAMAGECOUNT value on done: 657411.0 [2024-08-06 05:44:35,606][52670] Sum rewards: 83.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.145', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:37,049][52668] DAMAGECOUNT value on done: 657440.0 [2024-08-06 05:44:37,051][52668] Sum rewards: 64.007, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.348', 'WEAPON1': '0.010', 'AMMO5': '0.023', 'AMMO2': '0.062', 'weapon4': '0.212', 'AMMO3': '0.221', 'weapon5': '0.260', 'AMMO4': '0.309', 'weapon2': '0.320', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:37,155][52671] DAMAGECOUNT value on done: 669413.0 [2024-08-06 05:44:37,156][52671] Sum rewards: 75.597, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.063', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.054', 'AMMO4': '0.138', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '3.078', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:37,487][52803] DAMAGECOUNT value on done: 613829.0 [2024-08-06 05:44:37,488][52803] Sum rewards: 71.568, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.011', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO4': '0.164', 'AMMO3': '0.218', 'weapon5': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.500'} [2024-08-06 05:44:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 520028160. Throughput: 0: 4355.6. Samples: 130009920. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:37,794][52567] Avg episode reward: [(0, '73.738')] [2024-08-06 05:44:37,845][52658] DAMAGECOUNT value on done: 655716.0 [2024-08-06 05:44:37,845][52658] Sum rewards: 77.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.330', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.146', 'AMMO3': '0.172', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.472', 'WEAPON3': '0.950', 'weapon3': '2.762', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:37,985][52649] DAMAGECOUNT value on done: 644334.0 [2024-08-06 05:44:37,986][52649] Sum rewards: 73.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.588', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.102', 'AMMO4': '0.167', 'weapon5': '0.186', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:38,118][52650] Updated weights for policy 0, policy_version 63481 (0.0018) [2024-08-06 05:44:38,483][52666] DAMAGECOUNT value on done: 658841.0 [2024-08-06 05:44:38,483][52666] Sum rewards: 74.510, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.512', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon4': '0.114', 'AMMO4': '0.207', 'weapon5': '0.250', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.862', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:38,527][52670] DAMAGECOUNT value on done: 662796.0 [2024-08-06 05:44:38,527][52670] Sum rewards: 67.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.110', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.842', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:38,825][52669] DAMAGECOUNT value on done: 666795.0 [2024-08-06 05:44:38,825][52669] Sum rewards: 79.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.144', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.137', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:39,383][52662] DAMAGECOUNT value on done: 671193.0 [2024-08-06 05:44:39,388][52662] Sum rewards: 75.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.826', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon2': '0.176', 'AMMO3': '0.195', 'AMMO4': '0.260', 'weapon5': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:39,578][52671] DAMAGECOUNT value on done: 656483.0 [2024-08-06 05:44:39,579][52671] Sum rewards: 90.004, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.094', 'weapon5': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.158', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'weapon3': '3.364', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '71.000'} [2024-08-06 05:44:40,181][52668] DAMAGECOUNT value on done: 673795.0 [2024-08-06 05:44:40,181][52668] Sum rewards: 68.576, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.698', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.110', 'AMMO4': '0.126', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.270', 'AMMO3': '0.294', 'WEAPON3': '1.650', 'weapon3': '3.138', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:40,468][52803] DAMAGECOUNT value on done: 631425.0 [2024-08-06 05:44:40,468][52803] Sum rewards: 77.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon5': '0.184', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:40,752][52658] DAMAGECOUNT value on done: 670809.0 [2024-08-06 05:44:40,753][52658] Sum rewards: 76.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.805', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.148', 'AMMO3': '0.155', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:41,008][52649] DAMAGECOUNT value on done: 637142.0 [2024-08-06 05:44:41,008][52649] Sum rewards: 60.890, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.142', 'AMMO4': '0.166', 'weapon4': '0.206', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.700', 'WEAPON3': '0.950', 'weapon3': '2.640', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '50.000'} [2024-08-06 05:44:41,514][52669] DAMAGECOUNT value on done: 687664.0 [2024-08-06 05:44:41,514][52669] Sum rewards: 69.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.184', 'weapon4': '0.274', 'weapon5': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.630', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:42,372][52671] DAMAGECOUNT value on done: 677541.0 [2024-08-06 05:44:42,373][52671] Sum rewards: 75.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.054', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.132', 'AMMO3': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.450', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:42,641][52662] DAMAGECOUNT value on done: 671066.0 [2024-08-06 05:44:42,642][52662] Sum rewards: 72.126, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.464', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:42,766][52668] DAMAGECOUNT value on done: 672161.0 [2024-08-06 05:44:42,767][52668] Sum rewards: 79.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.062', 'weapon5': '0.118', 'AMMO4': '0.120', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 520110080. Throughput: 0: 4361.6. Samples: 130036200. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:42,794][52567] Avg episode reward: [(0, '73.564')] [2024-08-06 05:44:43,070][52650] Updated weights for policy 0, policy_version 63491 (0.0012) [2024-08-06 05:44:43,471][52658] DAMAGECOUNT value on done: 663865.0 [2024-08-06 05:44:43,473][52658] Sum rewards: 75.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.044', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.092', 'weapon5': '0.158', 'AMMO3': '0.197', 'AMMO4': '0.274', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.184', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:43,552][52803] DAMAGECOUNT value on done: 620596.0 [2024-08-06 05:44:43,552][52803] Sum rewards: 67.892, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.038', 'AMMO2': '0.006', 'AMMO5': '0.011', 'weapon4': '0.016', 'AMMO4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.143', 'weapon5': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '2.952', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '54.000'} [2024-08-06 05:44:43,691][52649] DAMAGECOUNT value on done: 657584.0 [2024-08-06 05:44:43,691][52649] Sum rewards: 69.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.175', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.348', 'weapon4': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:44,679][52669] DAMAGECOUNT value on done: 673267.0 [2024-08-06 05:44:44,679][52669] Sum rewards: 62.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.035', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.136', 'weapon4': '0.192', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '55.000'} [2024-08-06 05:44:45,334][52662] DAMAGECOUNT value on done: 677192.0 [2024-08-06 05:44:45,336][52662] Sum rewards: 75.304, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.005', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.289', 'weapon2': '0.362', 'WEAPON3': '1.800', 'weapon3': '3.222', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '69.000'} [2024-08-06 05:44:45,388][52671] DAMAGECOUNT value on done: 674054.0 [2024-08-06 05:44:45,390][52671] Sum rewards: 79.716, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.630', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.134', 'weapon2': '0.176', 'weapon4': '0.254', 'AMMO3': '0.273', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.174', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '69.000'} [2024-08-06 05:44:45,972][52658] DAMAGECOUNT value on done: 664183.0 [2024-08-06 05:44:45,981][52658] Sum rewards: 80.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.290', 'WEAPON3': '1.200', 'weapon3': '3.510', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:46,048][52668] DAMAGECOUNT value on done: 662652.0 [2024-08-06 05:44:46,048][52668] Sum rewards: 72.626, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.191', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.096', 'weapon4': '0.122', 'weapon2': '0.178', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.310', 'WEAPON3': '1.850', 'weapon3': '3.356', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:46,154][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:44:46,495][52649] DAMAGECOUNT value on done: 650566.0 [2024-08-06 05:44:46,497][52649] Sum rewards: 80.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.177', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon4': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.164', 'weapon5': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:46,698][52803] DAMAGECOUNT value on done: 618306.0 [2024-08-06 05:44:46,701][52803] Sum rewards: 87.864, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.160', 'weapon4': '0.230', 'weapon2': '0.414', 'WEAPON3': '1.000', 'weapon3': '3.168', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '69.000'} [2024-08-06 05:44:47,779][52650] Updated weights for policy 0, policy_version 63501 (0.0020) [2024-08-06 05:44:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 520200192. Throughput: 0: 4364.7. Samples: 130049430. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:44:47,795][52567] Avg episode reward: [(0, '74.103')] [2024-08-06 05:44:47,893][52669] DAMAGECOUNT value on done: 671951.0 [2024-08-06 05:44:47,894][52669] Sum rewards: 66.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.526', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.089', 'weapon5': '0.136', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:48,268][52662] DAMAGECOUNT value on done: 663234.0 [2024-08-06 05:44:48,269][52662] Sum rewards: 82.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.106', 'weapon5': '0.112', 'AMMO4': '0.115', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:48,458][52658] DAMAGECOUNT value on done: 669485.0 [2024-08-06 05:44:48,458][52671] DAMAGECOUNT value on done: 673940.0 [2024-08-06 05:44:48,458][52658] Sum rewards: 71.253, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.396', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.142', 'weapon4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:48,458][52671] Sum rewards: 73.868, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.454', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon4': '0.108', 'weapon5': '0.136', 'AMMO3': '0.257', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.130', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:48,923][52668] DAMAGECOUNT value on done: 664635.0 [2024-08-06 05:44:48,923][52668] Sum rewards: 74.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.782', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon4': '0.090', 'AMMO3': '0.219', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:49,723][52803] DAMAGECOUNT value on done: 632726.0 [2024-08-06 05:44:49,727][52803] Sum rewards: 75.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.116', 'AMMO3': '0.165', 'AMMO4': '0.214', 'weapon5': '0.232', 'weapon2': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.072', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '61.000'} [2024-08-06 05:44:49,783][52649] DAMAGECOUNT value on done: 639927.0 [2024-08-06 05:44:49,783][52649] Sum rewards: 88.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO4': '0.102', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.422', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '71.000'} [2024-08-06 05:44:50,730][52662] DAMAGECOUNT value on done: 681676.0 [2024-08-06 05:44:50,730][52662] Sum rewards: 82.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon4': '0.066', 'weapon5': '0.076', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '70.000'} [2024-08-06 05:44:50,950][52669] DAMAGECOUNT value on done: 672764.0 [2024-08-06 05:44:50,951][52669] Sum rewards: 72.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.573', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.184', 'AMMO3': '0.212', 'AMMO4': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 05:44:51,552][52671] DAMAGECOUNT value on done: 674507.0 [2024-08-06 05:44:51,553][52671] Sum rewards: 79.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.474', 'weapon4': '0.024', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.212', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '66.000'} [2024-08-06 05:44:51,556][52668] DAMAGECOUNT value on done: 671287.0 [2024-08-06 05:44:51,556][52668] Sum rewards: 68.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.544', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.168', 'weapon4': '0.182', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.084', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '56.000'} [2024-08-06 05:44:52,350][52650] Updated weights for policy 0, policy_version 63511 (0.0013) [2024-08-06 05:44:52,736][52649] DAMAGECOUNT value on done: 656102.0 [2024-08-06 05:44:52,738][52649] Sum rewards: 70.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.216', 'weapon2': '0.404', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.320', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '60.000'} [2024-08-06 05:44:52,782][52803] DAMAGECOUNT value on done: 620377.0 [2024-08-06 05:44:52,783][52803] Sum rewards: 79.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.078', 'weapon5': '0.142', 'AMMO4': '0.147', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.722', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 520290304. Throughput: 0: 4371.1. Samples: 130075680. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:44:52,794][52567] Avg episode reward: [(0, '73.897')] [2024-08-06 05:44:53,553][52662] DAMAGECOUNT value on done: 660530.0 [2024-08-06 05:44:53,554][52662] Sum rewards: 86.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.123', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon2': '0.170', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'weapon3': '3.442', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.718', 'FRAGCOUNT': '72.000'} [2024-08-06 05:44:54,071][52668] DAMAGECOUNT value on done: 667301.0 [2024-08-06 05:44:54,074][52668] Sum rewards: 77.606, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.234', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.176', 'AMMO4': '0.212', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:54,104][52669] DAMAGECOUNT value on done: 678651.0 [2024-08-06 05:44:54,105][52669] Sum rewards: 74.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.016', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.158', 'AMMO4': '0.166', 'AMMO3': '0.247', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.238', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:54,524][52671] DAMAGECOUNT value on done: 670070.0 [2024-08-06 05:44:54,526][52671] Sum rewards: 76.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.190', 'AMMO3': '0.210', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '63.000'} [2024-08-06 05:44:55,866][52803] DAMAGECOUNT value on done: 618969.0 [2024-08-06 05:44:55,867][52803] Sum rewards: 63.442, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.895', 'AMMO5': '0.013', 'AMMO2': '0.048', 'AMMO3': '0.180', 'weapon5': '0.216', 'AMMO4': '0.238', 'weapon2': '0.302', 'weapon4': '0.338', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '51.000'} [2024-08-06 05:44:55,993][52649] DAMAGECOUNT value on done: 648218.0 [2024-08-06 05:44:55,993][52649] Sum rewards: 79.661, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.794', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.388', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '2.880', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '62.000'} [2024-08-06 05:44:56,429][52662] DAMAGECOUNT value on done: 668129.0 [2024-08-06 05:44:56,430][52662] Sum rewards: 63.952, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.584', 'AMMO5': '0.018', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.118', 'weapon5': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon4': '0.510', 'WEAPON3': '0.700', 'weapon2': '0.732', 'weapon3': '2.310', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '49.000'} [2024-08-06 05:44:56,865][52650] Updated weights for policy 0, policy_version 63521 (0.0017) [2024-08-06 05:44:56,933][52668] DAMAGECOUNT value on done: 658917.0 [2024-08-06 05:44:56,933][52668] Sum rewards: 67.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.012', 'weapon5': '0.052', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.374', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.398', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '57.000'} [2024-08-06 05:44:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 520372224. Throughput: 0: 4371.6. Samples: 130101820. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:44:57,802][52567] Avg episode reward: [(0, '74.104')] [2024-08-06 05:44:58,972][52803] DAMAGECOUNT value on done: 622789.0 [2024-08-06 05:44:58,973][52803] Sum rewards: 75.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.061', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.178', 'AMMO3': '0.227', 'weapon2': '0.232', 'weapon4': '0.242', 'AMMO4': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '64.000'} [2024-08-06 05:44:59,186][52649] DAMAGECOUNT value on done: 652341.0 [2024-08-06 05:44:59,186][52649] Sum rewards: 83.213, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.565', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.281', 'WEAPON3': '1.550', 'weapon3': '3.352', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '71.000'} [2024-08-06 05:44:59,404][52660] DAMAGECOUNT value on done: 667210.0 [2024-08-06 05:44:59,405][52660] Sum rewards: 76.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.650', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.118', 'AMMO4': '0.136', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.750', 'weapon3': '3.266', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '65.000'} [2024-08-06 05:44:59,522][52668] DAMAGECOUNT value on done: 653273.0 [2024-08-06 05:44:59,523][52668] Sum rewards: 82.532, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.522', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.114', 'weapon4': '0.124', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.698', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '68.000'} [2024-08-06 05:44:59,894][52662] DAMAGECOUNT value on done: 676241.0 [2024-08-06 05:44:59,895][52662] Sum rewards: 73.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.122', 'AMMO4': '0.142', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:01,699][52650] Updated weights for policy 0, policy_version 63531 (0.0011) [2024-08-06 05:45:01,919][52660] DAMAGECOUNT value on done: 655687.0 [2024-08-06 05:45:01,921][52660] Sum rewards: 68.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'AMMO5': '0.019', 'AMMO2': '0.068', 'weapon2': '0.198', 'weapon4': '0.226', 'AMMO3': '0.234', 'weapon5': '0.290', 'AMMO4': '0.339', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '2.968', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '58.000'} [2024-08-06 05:45:01,962][52668] DAMAGECOUNT value on done: 654017.0 [2024-08-06 05:45:01,963][52668] Sum rewards: 67.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.282', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.184', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '56.000'} [2024-08-06 05:45:02,080][52803] DAMAGECOUNT value on done: 626116.0 [2024-08-06 05:45:02,080][52803] Sum rewards: 80.127, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.619', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.124', 'weapon5': '0.124', 'weapon2': '0.162', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.442', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '67.000'} [2024-08-06 05:45:02,476][52649] DAMAGECOUNT value on done: 652648.0 [2024-08-06 05:45:02,477][52649] Sum rewards: 75.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.182', 'AMMO3': '0.183', 'weapon5': '0.188', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 520462336. Throughput: 0: 4371.3. Samples: 130114950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:45:02,815][52567] Avg episode reward: [(0, '74.443')] [2024-08-06 05:45:02,830][52662] DAMAGECOUNT value on done: 668489.0 [2024-08-06 05:45:02,830][52662] Sum rewards: 69.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.275', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.155', 'weapon5': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '57.000'} [2024-08-06 05:45:04,230][52660] DAMAGECOUNT value on done: 669612.0 [2024-08-06 05:45:04,231][52660] Sum rewards: 78.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.550', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.214', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '65.000'} [2024-08-06 05:45:04,276][52668] DAMAGECOUNT value on done: 653573.0 [2024-08-06 05:45:04,277][52668] Sum rewards: 70.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.557', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.082', 'weapon5': '0.140', 'AMMO3': '0.185', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '3.088', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '57.000'} [2024-08-06 05:45:04,770][52614] Signal inference workers to stop experience collection... (11550 times) [2024-08-06 05:45:04,771][52614] Signal inference workers to resume experience collection... (11550 times) [2024-08-06 05:45:04,860][52650] InferenceWorker_p0-w0: stopping experience collection (11550 times) [2024-08-06 05:45:04,861][52650] InferenceWorker_p0-w0: resuming experience collection (11550 times) [2024-08-06 05:45:05,141][52803] DAMAGECOUNT value on done: 629778.0 [2024-08-06 05:45:05,141][52803] Sum rewards: 71.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.125', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.145', 'weapon5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.260', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 05:45:05,178][52649] DAMAGECOUNT value on done: 644013.0 [2024-08-06 05:45:05,178][52649] Sum rewards: 67.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.525', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.170', 'AMMO4': '0.174', 'weapon2': '0.208', 'AMMO3': '0.234', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '57.000'} [2024-08-06 05:45:05,646][52662] DAMAGECOUNT value on done: 677922.0 [2024-08-06 05:45:05,649][52662] Sum rewards: 74.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.514', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.174', 'weapon4': '0.220', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '63.500'} [2024-08-06 05:45:06,311][52650] Updated weights for policy 0, policy_version 63541 (0.0015) [2024-08-06 05:45:06,941][52660] DAMAGECOUNT value on done: 676269.0 [2024-08-06 05:45:06,942][52660] Sum rewards: 70.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.533', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.172', 'AMMO3': '0.216', 'weapon5': '0.232', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:06,994][52668] DAMAGECOUNT value on done: 666798.0 [2024-08-06 05:45:06,994][52668] Sum rewards: 79.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.131', 'weapon5': '0.142', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '64.000'} [2024-08-06 05:45:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 520544256. Throughput: 0: 4364.2. Samples: 130141180. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:45:07,795][52567] Avg episode reward: [(0, '74.287')] [2024-08-06 05:45:08,204][52803] DAMAGECOUNT value on done: 620619.0 [2024-08-06 05:45:08,206][52803] Sum rewards: 80.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.785', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.152', 'AMMO3': '0.233', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '67.000'} [2024-08-06 05:45:08,229][52662] DAMAGECOUNT value on done: 663946.0 [2024-08-06 05:45:08,230][52662] Sum rewards: 75.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.070', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.516', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '62.000'} [2024-08-06 05:45:08,259][52649] DAMAGECOUNT value on done: 658354.0 [2024-08-06 05:45:08,259][52649] Sum rewards: 66.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.906', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.113', 'weapon5': '0.160', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.222', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '57.000'} [2024-08-06 05:45:09,630][52660] DAMAGECOUNT value on done: 661743.0 [2024-08-06 05:45:09,631][52660] Sum rewards: 75.525, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.520', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.080', 'AMMO4': '0.119', 'AMMO3': '0.139', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '3.210', 'weapon3': '3.420', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '60.000'} [2024-08-06 05:45:09,679][52668] DAMAGECOUNT value on done: 664311.0 [2024-08-06 05:45:09,681][52668] Sum rewards: 63.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon5': '0.082', 'weapon4': '0.102', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.294', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '53.000'} [2024-08-06 05:45:11,204][52650] Updated weights for policy 0, policy_version 63551 (0.0035) [2024-08-06 05:45:11,428][52662] DAMAGECOUNT value on done: 666457.0 [2024-08-06 05:45:11,429][52662] Sum rewards: 78.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.098', 'AMMO4': '0.202', 'AMMO3': '0.203', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.066', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '65.000'} [2024-08-06 05:45:11,447][52649] DAMAGECOUNT value on done: 660338.0 [2024-08-06 05:45:11,447][52649] Sum rewards: 73.077, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.128', 'AMMO3': '0.171', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:12,579][52660] DAMAGECOUNT value on done: 660993.0 [2024-08-06 05:45:12,579][52660] Sum rewards: 69.824, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.068', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.112', 'AMMO4': '0.152', 'AMMO3': '0.155', 'weapon5': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '3.060', 'weapon3': '3.154', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '55.000'} [2024-08-06 05:45:12,647][52668] DAMAGECOUNT value on done: 661969.0 [2024-08-06 05:45:12,649][52668] Sum rewards: 60.640, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.104', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.128', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.310', 'weapon2': '0.346', 'WEAPON3': '1.800', 'weapon3': '3.086', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.500'} [2024-08-06 05:45:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 520634368. Throughput: 0: 4374.2. Samples: 130167680. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:45:12,794][52567] Avg episode reward: [(0, '74.403')] [2024-08-06 05:45:14,489][52662] DAMAGECOUNT value on done: 663087.0 [2024-08-06 05:45:14,490][52662] Sum rewards: 69.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.009', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.051', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:14,573][52649] DAMAGECOUNT value on done: 657078.0 [2024-08-06 05:45:14,573][52649] Sum rewards: 67.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.728', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.172', 'weapon4': '0.198', 'AMMO3': '0.205', 'AMMO4': '0.268', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '57.000'} [2024-08-06 05:45:15,328][52660] DAMAGECOUNT value on done: 662073.0 [2024-08-06 05:45:15,329][52660] Sum rewards: 75.061, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.718', 'AMMO5': '0.010', 'AMMO2': '0.048', 'AMMO3': '0.150', 'weapon5': '0.216', 'AMMO4': '0.239', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON3': '0.950', 'weapon3': '3.022', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '58.500'} [2024-08-06 05:45:15,382][52668] DAMAGECOUNT value on done: 672368.0 [2024-08-06 05:45:15,383][52668] Sum rewards: 69.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.488', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon5': '0.182', 'weapon4': '0.212', 'AMMO3': '0.214', 'AMMO4': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '58.000'} [2024-08-06 05:45:15,907][52650] Updated weights for policy 0, policy_version 63561 (0.0034) [2024-08-06 05:45:17,761][52662] DAMAGECOUNT value on done: 671785.0 [2024-08-06 05:45:17,762][52662] Sum rewards: 74.900, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.015', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.108', 'AMMO4': '0.123', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.184', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '65.000'} [2024-08-06 05:45:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 520724480. Throughput: 0: 4380.7. Samples: 130180730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:45:17,803][52567] Avg episode reward: [(0, '74.310')] [2024-08-06 05:45:17,817][52649] DAMAGECOUNT value on done: 655395.0 [2024-08-06 05:45:17,817][52649] Sum rewards: 66.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.467', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'WEAPON4': '0.100', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon5': '0.270', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '58.000'} [2024-08-06 05:45:18,025][52660] DAMAGECOUNT value on done: 673622.0 [2024-08-06 05:45:18,025][52660] Sum rewards: 79.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.471', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.102', 'weapon4': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 05:45:18,104][52668] DAMAGECOUNT value on done: 668149.0 [2024-08-06 05:45:18,107][52668] Sum rewards: 71.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.788', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.166', 'AMMO3': '0.202', 'weapon5': '0.230', 'AMMO4': '0.247', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:20,251][52650] Updated weights for policy 0, policy_version 63571 (0.0023) [2024-08-06 05:45:20,669][52662] DAMAGECOUNT value on done: 664319.0 [2024-08-06 05:45:20,671][52662] Sum rewards: 81.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.244', 'weapon2': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.504', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '68.000'} [2024-08-06 05:45:20,704][52649] DAMAGECOUNT value on done: 642402.0 [2024-08-06 05:45:20,705][52649] Sum rewards: 78.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.746', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.094', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '64.000'} [2024-08-06 05:45:20,767][52664] DAMAGECOUNT value on done: 690228.0 [2024-08-06 05:45:20,767][52664] Sum rewards: 76.557, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.055', 'weapon4': '0.076', 'weapon2': '0.192', 'weapon5': '0.224', 'AMMO3': '0.239', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '64.000'} [2024-08-06 05:45:21,138][52660] DAMAGECOUNT value on done: 660592.0 [2024-08-06 05:45:21,139][52660] Sum rewards: 68.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.565', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.099', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'HITCOUNT': '3.340', 'weapon3': '3.538', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:22,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 520806400. Throughput: 0: 4377.1. Samples: 130206890. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:45:22,795][52567] Avg episode reward: [(0, '74.450')] [2024-08-06 05:45:23,540][52664] DAMAGECOUNT value on done: 697426.0 [2024-08-06 05:45:23,540][52664] Sum rewards: 83.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.204', 'AMMO3': '0.216', 'AMMO4': '0.219', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.946', 'FRAGCOUNT': '68.000'} [2024-08-06 05:45:23,877][52662] DAMAGECOUNT value on done: 677365.0 [2024-08-06 05:45:23,877][52662] Sum rewards: 65.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.716', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.334', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.314', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '55.000'} [2024-08-06 05:45:23,915][52649] DAMAGECOUNT value on done: 652453.0 [2024-08-06 05:45:23,915][52649] Sum rewards: 58.696, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.490', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.142', 'weapon4': '0.152', 'AMMO4': '0.176', 'AMMO3': '0.247', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.086', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '52.000'} [2024-08-06 05:45:24,033][52660] DAMAGECOUNT value on done: 663152.0 [2024-08-06 05:45:24,034][52660] Sum rewards: 67.823, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.426', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.149', 'AMMO4': '0.197', 'weapon5': '0.214', 'weapon4': '0.376', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.670', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '53.000'} [2024-08-06 05:45:25,183][52650] Updated weights for policy 0, policy_version 63581 (0.0030) [2024-08-06 05:45:26,155][52664] DAMAGECOUNT value on done: 694171.0 [2024-08-06 05:45:26,156][52664] Sum rewards: 69.260, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.136', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon5': '0.166', 'weapon2': '0.338', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.290', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '54.500'} [2024-08-06 05:45:26,556][52660] DAMAGECOUNT value on done: 670509.0 [2024-08-06 05:45:26,556][52660] Sum rewards: 70.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.028', 'AMMO5': '0.029', 'AMMO2': '0.065', 'weapon4': '0.102', 'AMMO3': '0.205', 'weapon5': '0.268', 'weapon2': '0.276', 'AMMO4': '0.324', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:26,890][52662] DAMAGECOUNT value on done: 672958.0 [2024-08-06 05:45:26,891][52662] Sum rewards: 77.614, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.826', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.196', 'weapon2': '0.218', 'AMMO4': '0.254', 'AMMO3': '0.267', 'weapon4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '66.000'} [2024-08-06 05:45:27,136][52649] DAMAGECOUNT value on done: 644287.0 [2024-08-06 05:45:27,136][52649] Sum rewards: 68.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon4': '0.288', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '58.000'} [2024-08-06 05:45:27,635][52666] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2024-08-06 05:45:27,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 520896512. Throughput: 0: 4374.7. Samples: 130233060. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:45:27,794][52567] Avg episode reward: [(0, '74.117')] [2024-08-06 05:45:28,939][52664] DAMAGECOUNT value on done: 686816.0 [2024-08-06 05:45:28,939][52664] Sum rewards: 77.787, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.370', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.086', 'weapon4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'weapon2': '0.184', 'AMMO3': '0.337', 'WEAPON3': '2.050', 'weapon3': '3.324', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '70.000'} [2024-08-06 05:45:29,216][52660] DAMAGECOUNT value on done: 661818.0 [2024-08-06 05:45:29,219][52660] Sum rewards: 83.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.065', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.088', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.192', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '67.000'} [2024-08-06 05:45:29,632][52662] DAMAGECOUNT value on done: 657757.0 [2024-08-06 05:45:29,633][52662] Sum rewards: 79.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.222', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.138', 'AMMO3': '0.149', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '0.900', 'weapon3': '3.242', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '62.000'} [2024-08-06 05:45:29,694][52649] DAMAGECOUNT value on done: 657041.0 [2024-08-06 05:45:29,695][52649] Sum rewards: 72.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.360', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.122', 'AMMO4': '0.212', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.362', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.818', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '61.000'} [2024-08-06 05:45:29,842][52650] Updated weights for policy 0, policy_version 63591 (0.0010) [2024-08-06 05:45:32,313][52664] DAMAGECOUNT value on done: 697607.0 [2024-08-06 05:45:32,315][52664] Sum rewards: 83.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.023', 'AMMO2': '0.035', 'weapon4': '0.132', 'AMMO4': '0.176', 'weapon5': '0.212', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '69.000'} [2024-08-06 05:45:32,406][52662] DAMAGECOUNT value on done: 667667.0 [2024-08-06 05:45:32,407][52662] Sum rewards: 75.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.123', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.342', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:32,535][52660] DAMAGECOUNT value on done: 663664.0 [2024-08-06 05:45:32,535][52660] Sum rewards: 53.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.880', 'AMMO5': '0.028', 'AMMO2': '0.084', 'AMMO3': '0.212', 'weapon4': '0.246', 'weapon5': '0.310', 'weapon2': '0.418', 'AMMO4': '0.419', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.300', 'HITCOUNT': '2.500', 'weapon3': '2.712', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '47.000'} [2024-08-06 05:45:32,740][52649] DAMAGECOUNT value on done: 656590.0 [2024-08-06 05:45:32,741][52649] Sum rewards: 69.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.065', 'weapon5': '0.110', 'AMMO3': '0.185', 'weapon4': '0.236', 'AMMO4': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '57.000'} [2024-08-06 05:45:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 520986624. Throughput: 0: 4369.1. Samples: 130246040. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 05:45:32,795][52567] Avg episode reward: [(0, '73.913')] [2024-08-06 05:45:34,495][52650] Updated weights for policy 0, policy_version 63601 (0.0048) [2024-08-06 05:45:35,257][52662] DAMAGECOUNT value on done: 661098.0 [2024-08-06 05:45:35,257][52662] Sum rewards: 73.220, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO4': '0.220', 'AMMO3': '0.237', 'weapon5': '0.254', 'weapon4': '0.320', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:35,407][52664] DAMAGECOUNT value on done: 691216.0 [2024-08-06 05:45:35,407][52664] Sum rewards: 71.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.956', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.164', 'AMMO4': '0.222', 'weapon5': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.642', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '58.000'} [2024-08-06 05:45:35,650][52660] DAMAGECOUNT value on done: 676036.0 [2024-08-06 05:45:35,652][52660] Sum rewards: 77.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.420', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.121', 'weapon5': '0.140', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.600', 'weapon3': '3.298', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '66.000'} [2024-08-06 05:45:35,865][52649] DAMAGECOUNT value on done: 650308.0 [2024-08-06 05:45:35,866][52649] Sum rewards: 74.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '60.000'} [2024-08-06 05:45:36,034][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:45:36,719][52659] DAMAGECOUNT value on done: 672174.0 [2024-08-06 05:45:36,744][52659] Sum rewards: 63.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.761', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.024', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.426', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '54.000'} [2024-08-06 05:45:37,789][52664] DAMAGECOUNT value on done: 688649.0 [2024-08-06 05:45:37,790][52664] Sum rewards: 59.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.223', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.580', 'WEAPON3': '1.000', 'HITCOUNT': '2.900', 'weapon3': '3.098', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '48.500'} [2024-08-06 05:45:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 521076736. Throughput: 0: 4358.0. Samples: 130271790. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 05:45:37,794][52567] Avg episode reward: [(0, '73.776')] [2024-08-06 05:45:38,723][52660] DAMAGECOUNT value on done: 681983.0 [2024-08-06 05:45:38,729][52660] Sum rewards: 71.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.219', 'weapon4': '0.278', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '60.000'} [2024-08-06 05:45:39,418][52650] Updated weights for policy 0, policy_version 63611 (0.0028) [2024-08-06 05:45:39,450][52659] DAMAGECOUNT value on done: 667385.0 [2024-08-06 05:45:39,451][52659] Sum rewards: 76.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:40,432][52664] DAMAGECOUNT value on done: 684713.0 [2024-08-06 05:45:40,435][52664] Sum rewards: 62.034, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.750', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.130', 'AMMO4': '0.158', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.600', 'weapon3': '3.018', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '55.000'} [2024-08-06 05:45:41,799][52660] DAMAGECOUNT value on done: 662256.0 [2024-08-06 05:45:41,800][52660] Sum rewards: 60.506, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.196', 'AMMO5': '0.014', 'AMMO2': '0.068', 'weapon5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.242', 'weapon2': '0.340', 'AMMO4': '0.341', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '52.500'} [2024-08-06 05:45:42,485][52659] DAMAGECOUNT value on done: 673257.0 [2024-08-06 05:45:42,486][52659] Sum rewards: 79.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.868', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '64.000'} [2024-08-06 05:45:42,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 521158656. Throughput: 0: 4359.6. Samples: 130298000. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 05:45:42,794][52567] Avg episode reward: [(0, '73.384')] [2024-08-06 05:45:42,983][52664] DAMAGECOUNT value on done: 698706.0 [2024-08-06 05:45:42,985][52664] Sum rewards: 80.655, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.952', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.098', 'AMMO3': '0.145', 'weapon5': '0.180', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '64.000'} [2024-08-06 05:45:44,013][52650] Updated weights for policy 0, policy_version 63621 (0.0043) [2024-08-06 05:45:44,591][52660] DAMAGECOUNT value on done: 672008.0 [2024-08-06 05:45:44,593][52660] Sum rewards: 77.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.144', 'weapon2': '0.146', 'AMMO3': '0.182', 'AMMO4': '0.183', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:45,358][52659] DAMAGECOUNT value on done: 666775.0 [2024-08-06 05:45:45,359][52659] Sum rewards: 78.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.116', 'weapon5': '0.132', 'AMMO3': '0.208', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:45,802][52664] DAMAGECOUNT value on done: 689724.0 [2024-08-06 05:45:45,804][52664] Sum rewards: 86.550, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.694', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.142', 'AMMO4': '0.217', 'weapon2': '0.248', 'weapon5': '0.254', 'weapon4': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.926', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '70.000'} [2024-08-06 05:45:47,489][52660] DAMAGECOUNT value on done: 665811.0 [2024-08-06 05:45:47,491][52660] Sum rewards: 70.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.050', 'weapon5': '0.152', 'AMMO3': '0.172', 'AMMO4': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.500'} [2024-08-06 05:45:47,654][52669] Large shaping reward 2.541 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0), ('weapon5', 0.002)] [2024-08-06 05:45:47,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 521248768. Throughput: 0: 4360.0. Samples: 130311150. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 05:45:47,795][52567] Avg episode reward: [(0, '73.605')] [2024-08-06 05:45:47,981][52659] DAMAGECOUNT value on done: 664256.0 [2024-08-06 05:45:47,982][52659] Sum rewards: 68.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.922', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.098', 'AMMO4': '0.227', 'weapon5': '0.238', 'AMMO3': '0.265', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '59.000'} [2024-08-06 05:45:48,678][52650] Updated weights for policy 0, policy_version 63631 (0.0018) [2024-08-06 05:45:48,905][52664] DAMAGECOUNT value on done: 697269.0 [2024-08-06 05:45:48,906][52664] Sum rewards: 78.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.884', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.138', 'AMMO4': '0.184', 'AMMO3': '0.216', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:50,319][52660] DAMAGECOUNT value on done: 662753.0 [2024-08-06 05:45:50,321][52660] Sum rewards: 85.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon2': '0.132', 'AMMO3': '0.287', 'WEAPON3': '1.750', 'weapon3': '3.672', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '74.000'} [2024-08-06 05:45:51,006][52659] DAMAGECOUNT value on done: 672068.0 [2024-08-06 05:45:51,008][52659] Sum rewards: 63.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon4': '0.196', 'AMMO3': '0.225', 'weapon5': '0.276', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '54.000'} [2024-08-06 05:45:51,045][52665] DAMAGECOUNT value on done: 654925.0 [2024-08-06 05:45:51,045][52665] Sum rewards: 77.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.996', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.141', 'weapon5': '0.182', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.226', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '67.000'} [2024-08-06 05:45:51,548][52664] DAMAGECOUNT value on done: 699725.0 [2024-08-06 05:45:51,549][52664] Sum rewards: 94.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '22.983', 'FRAGCOUNT': '77.000'} [2024-08-06 05:45:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 521338880. Throughput: 0: 4357.1. Samples: 130337250. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 05:45:52,794][52567] Avg episode reward: [(0, '73.910')] [2024-08-06 05:45:53,383][52650] Updated weights for policy 0, policy_version 63641 (0.0013) [2024-08-06 05:45:53,420][52660] DAMAGECOUNT value on done: 657934.0 [2024-08-06 05:45:53,421][52660] Sum rewards: 80.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.455', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.038', 'AMMO4': '0.120', 'weapon5': '0.184', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '66.000'} [2024-08-06 05:45:53,545][52659] DAMAGECOUNT value on done: 668386.0 [2024-08-06 05:45:53,546][52659] Sum rewards: 78.118, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.574', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.202', 'AMMO4': '0.221', 'weapon5': '0.246', 'weapon4': '0.302', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '66.000'} [2024-08-06 05:45:53,612][52669] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon5', 0.002)] [2024-08-06 05:45:53,860][52665] DAMAGECOUNT value on done: 671782.0 [2024-08-06 05:45:53,865][52665] Sum rewards: 74.038, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.132', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'weapon2': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.080', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:54,342][52664] DAMAGECOUNT value on done: 697227.0 [2024-08-06 05:45:54,346][52664] Sum rewards: 63.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.434', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.156', 'weapon5': '0.202', 'AMMO3': '0.207', 'AMMO4': '0.225', 'weapon2': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.180', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 05:45:56,121][52665] DAMAGECOUNT value on done: 668697.0 [2024-08-06 05:45:56,122][52665] Sum rewards: 83.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.836', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.174', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '68.000'} [2024-08-06 05:45:56,386][52659] DAMAGECOUNT value on done: 664150.0 [2024-08-06 05:45:56,387][52659] Sum rewards: 61.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO4': '0.217', 'AMMO3': '0.222', 'weapon5': '0.224', 'weapon2': '0.256', 'weapon4': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '51.000'} [2024-08-06 05:45:57,610][52664] DAMAGECOUNT value on done: 699171.0 [2024-08-06 05:45:57,611][52664] Sum rewards: 69.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.109', 'weapon5': '0.116', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.260', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '58.000'} [2024-08-06 05:45:57,678][52794] DAMAGECOUNT value on done: 669333.0 [2024-08-06 05:45:57,679][52794] Sum rewards: 68.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.148', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.181', 'AMMO4': '0.192', 'weapon5': '0.224', 'weapon4': '0.240', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '55.000'} [2024-08-06 05:45:57,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 521420800. Throughput: 0: 4352.0. Samples: 130363520. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 05:45:57,802][52567] Avg episode reward: [(0, '73.608')] [2024-08-06 05:45:57,934][52650] Updated weights for policy 0, policy_version 63651 (0.0011) [2024-08-06 05:45:58,582][52665] DAMAGECOUNT value on done: 662701.0 [2024-08-06 05:45:58,586][52665] Sum rewards: 78.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.128', 'AMMO4': '0.156', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '63.000'} [2024-08-06 05:45:59,227][52659] DAMAGECOUNT value on done: 670819.0 [2024-08-06 05:45:59,227][52659] Sum rewards: 63.885, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.294', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.076', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.576', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.156', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '53.000'} [2024-08-06 05:46:00,248][52664] DAMAGECOUNT value on done: 701988.0 [2024-08-06 05:46:00,249][52664] Sum rewards: 63.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.997', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.196', 'weapon5': '0.206', 'weapon2': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.868', 'WEAPON3': '1.100', 'weapon3': '2.392', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '51.000'} [2024-08-06 05:46:00,880][52794] DAMAGECOUNT value on done: 675682.0 [2024-08-06 05:46:00,883][52794] Sum rewards: 62.220, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.208', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.112', 'AMMO3': '0.199', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.066', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '51.000'} [2024-08-06 05:46:01,475][52665] DAMAGECOUNT value on done: 650309.0 [2024-08-06 05:46:01,477][52665] Sum rewards: 76.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.040', 'weapon4': '0.048', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '64.000'} [2024-08-06 05:46:01,850][52659] DAMAGECOUNT value on done: 675474.0 [2024-08-06 05:46:01,852][52659] Sum rewards: 71.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon5': '0.212', 'weapon2': '0.288', 'weapon4': '0.332', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '59.000'} [2024-08-06 05:46:01,913][52667] DAMAGECOUNT value on done: 669368.0 [2024-08-06 05:46:01,913][52667] Sum rewards: 73.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.256', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.138', 'AMMO3': '0.176', 'AMMO4': '0.220', 'weapon5': '0.224', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.050', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '59.000'} [2024-08-06 05:46:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 521502720. Throughput: 0: 4355.8. Samples: 130376740. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 05:46:02,794][52567] Avg episode reward: [(0, '73.129')] [2024-08-06 05:46:02,890][52650] Updated weights for policy 0, policy_version 63661 (0.0022) [2024-08-06 05:46:03,122][52664] DAMAGECOUNT value on done: 695513.0 [2024-08-06 05:46:03,122][52664] Sum rewards: 82.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.698', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.117', 'weapon4': '0.162', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:03,152][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:46:03,366][52795] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2024-08-06 05:46:04,050][52794] DAMAGECOUNT value on done: 677343.0 [2024-08-06 05:46:04,052][52794] Sum rewards: 78.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon4': '0.104', 'AMMO3': '0.215', 'weapon5': '0.312', 'AMMO4': '0.329', 'weapon2': '0.374', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.874', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 05:46:04,448][52667] DAMAGECOUNT value on done: 676706.0 [2024-08-06 05:46:04,450][52667] Sum rewards: 69.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.482', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.132', 'AMMO4': '0.175', 'AMMO3': '0.230', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:04,543][52665] DAMAGECOUNT value on done: 657295.0 [2024-08-06 05:46:04,543][52665] Sum rewards: 73.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.973', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.122', 'weapon4': '0.138', 'AMMO4': '0.194', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.700', 'weapon3': '3.066', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '63.000'} [2024-08-06 05:46:04,665][52659] DAMAGECOUNT value on done: 665269.0 [2024-08-06 05:46:04,665][52659] Sum rewards: 91.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.231', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon4': '0.158', 'weapon5': '0.170', 'AMMO3': '0.249', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '76.000'} [2024-08-06 05:46:05,992][52664] DAMAGECOUNT value on done: 690574.0 [2024-08-06 05:46:05,992][52664] Sum rewards: 71.229, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.475', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.256', 'weapon2': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.958', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '61.500'} [2024-08-06 05:46:06,819][52667] DAMAGECOUNT value on done: 671163.0 [2024-08-06 05:46:06,820][52667] Sum rewards: 89.065, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.191', 'weapon2': '0.386', 'HEALTH': '0.558', 'WEAPON3': '1.050', 'weapon3': '3.458', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '71.000'} [2024-08-06 05:46:06,929][52794] DAMAGECOUNT value on done: 666205.0 [2024-08-06 05:46:06,930][52794] Sum rewards: 81.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.829', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.486', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '67.000'} [2024-08-06 05:46:07,366][52650] Updated weights for policy 0, policy_version 63671 (0.0011) [2024-08-06 05:46:07,516][52658] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2024-08-06 05:46:07,779][52659] DAMAGECOUNT value on done: 674618.0 [2024-08-06 05:46:07,779][52659] Sum rewards: 80.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.306', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.122', 'AMMO3': '0.184', 'weapon2': '0.288', 'weapon5': '0.292', 'AMMO4': '0.294', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '67.000'} [2024-08-06 05:46:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 521601024. Throughput: 0: 4360.3. Samples: 130403100. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:07,794][52567] Avg episode reward: [(0, '73.481')] [2024-08-06 05:46:07,888][52665] DAMAGECOUNT value on done: 662234.0 [2024-08-06 05:46:07,888][52665] Sum rewards: 73.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.055', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.106', 'AMMO3': '0.199', 'weapon5': '0.210', 'AMMO4': '0.241', 'weapon2': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '60.000'} [2024-08-06 05:46:08,900][52664] DAMAGECOUNT value on done: 693675.0 [2024-08-06 05:46:08,901][52664] Sum rewards: 84.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.872', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.066', 'AMMO4': '0.169', 'weapon5': '0.218', 'AMMO3': '0.247', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.580', 'FRAGCOUNT': '70.500'} [2024-08-06 05:46:09,150][52667] DAMAGECOUNT value on done: 674430.0 [2024-08-06 05:46:09,151][52667] Sum rewards: 68.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO2': '0.014', 'AMMO5': '0.014', 'weapon4': '0.054', 'AMMO4': '0.072', 'weapon5': '0.142', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.854', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '55.000'} [2024-08-06 05:46:09,606][52794] DAMAGECOUNT value on done: 666994.0 [2024-08-06 05:46:09,607][52794] Sum rewards: 78.828, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.615', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.142', 'AMMO3': '0.172', 'AMMO4': '0.194', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.304', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '63.000'} [2024-08-06 05:46:10,880][52665] DAMAGECOUNT value on done: 659711.0 [2024-08-06 05:46:10,881][52665] Sum rewards: 69.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.518', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.208', 'weapon5': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '57.000'} [2024-08-06 05:46:11,191][52659] DAMAGECOUNT value on done: 668204.0 [2024-08-06 05:46:11,192][52659] Sum rewards: 82.416, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.022', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.056', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '70.000'} [2024-08-06 05:46:11,372][52664] DAMAGECOUNT value on done: 693809.0 [2024-08-06 05:46:11,374][52664] Sum rewards: 64.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon4': '0.094', 'AMMO3': '0.223', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.338', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '53.000'} [2024-08-06 05:46:12,022][52650] Updated weights for policy 0, policy_version 63681 (0.0013) [2024-08-06 05:46:12,264][52667] DAMAGECOUNT value on done: 675896.0 [2024-08-06 05:46:12,265][52667] Sum rewards: 79.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.225', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.038', 'weapon5': '0.084', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:12,609][52794] DAMAGECOUNT value on done: 669310.0 [2024-08-06 05:46:12,611][52794] Sum rewards: 55.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.044', 'weapon4': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '48.000'} [2024-08-06 05:46:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 521682944. Throughput: 0: 4366.4. Samples: 130429550. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:12,794][52567] Avg episode reward: [(0, '73.356')] [2024-08-06 05:46:13,606][52665] DAMAGECOUNT value on done: 671435.0 [2024-08-06 05:46:13,606][52665] Sum rewards: 67.679, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.203', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '54.000'} [2024-08-06 05:46:14,123][52664] DAMAGECOUNT value on done: 692807.0 [2024-08-06 05:46:14,123][52664] Sum rewards: 70.095, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.579', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:14,564][52659] DAMAGECOUNT value on done: 669715.0 [2024-08-06 05:46:14,564][52659] Sum rewards: 88.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.848', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.174', 'AMMO3': '0.189', 'AMMO4': '0.192', 'weapon4': '0.202', 'weapon2': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '22.032', 'FRAGCOUNT': '69.000'} [2024-08-06 05:46:15,262][52667] DAMAGECOUNT value on done: 679434.0 [2024-08-06 05:46:15,262][52667] Sum rewards: 79.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO3': '0.131', 'AMMO4': '0.168', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.628', 'WEAPON3': '0.800', 'weapon3': '2.768', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:15,622][52794] DAMAGECOUNT value on done: 674054.0 [2024-08-06 05:46:15,623][52794] Sum rewards: 80.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.100', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.084', 'weapon4': '0.118', 'weapon2': '0.214', 'AMMO4': '0.249', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '68.000'} [2024-08-06 05:46:16,192][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:46:16,317][52665] DAMAGECOUNT value on done: 661411.0 [2024-08-06 05:46:16,319][52665] Sum rewards: 63.008, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.160', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO3': '0.142', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.000', 'HITCOUNT': '2.770', 'weapon3': '3.432', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '50.000'} [2024-08-06 05:46:16,958][52650] Updated weights for policy 0, policy_version 63691 (0.0015) [2024-08-06 05:46:17,097][52659] DAMAGECOUNT value on done: 679654.0 [2024-08-06 05:46:17,098][52659] Sum rewards: 72.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'weapon5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.202', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.398', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '59.000'} [2024-08-06 05:46:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 521773056. Throughput: 0: 4370.9. Samples: 130442730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:17,802][52567] Avg episode reward: [(0, '73.538')] [2024-08-06 05:46:18,240][52667] DAMAGECOUNT value on done: 673330.0 [2024-08-06 05:46:18,240][52667] Sum rewards: 80.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.455', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.152', 'AMMO4': '0.210', 'weapon5': '0.218', 'AMMO3': '0.229', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '68.000'} [2024-08-06 05:46:18,714][52794] DAMAGECOUNT value on done: 661661.0 [2024-08-06 05:46:18,717][52794] Sum rewards: 78.232, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.068', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.504', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:18,844][52671] Large shaping reward 3.452 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.42, 140.0), ('weapon5', 0.002)] [2024-08-06 05:46:19,069][52665] DAMAGECOUNT value on done: 669630.0 [2024-08-06 05:46:19,072][52665] Sum rewards: 72.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'weapon4': '0.172', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 05:46:20,187][52659] DAMAGECOUNT value on done: 671858.0 [2024-08-06 05:46:20,188][52659] Sum rewards: 79.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.317', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.178', 'weapon2': '0.206', 'AMMO4': '0.223', 'AMMO3': '0.261', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.500', 'weapon3': '2.866', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '66.000'} [2024-08-06 05:46:21,510][52667] DAMAGECOUNT value on done: 671466.0 [2024-08-06 05:46:21,510][52667] Sum rewards: 61.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.140', 'weapon5': '0.144', 'AMMO3': '0.200', 'AMMO4': '0.318', 'weapon2': '0.484', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '50.500'} [2024-08-06 05:46:21,547][52650] Updated weights for policy 0, policy_version 63701 (0.0023) [2024-08-06 05:46:21,765][52794] DAMAGECOUNT value on done: 674247.0 [2024-08-06 05:46:21,768][52794] Sum rewards: 87.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.895', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.052', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.445', 'FRAGCOUNT': '72.000'} [2024-08-06 05:46:22,317][52665] DAMAGECOUNT value on done: 667034.0 [2024-08-06 05:46:22,317][52665] Sum rewards: 60.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.737', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.230', 'weapon4': '0.288', 'WEAPON3': '1.100', 'weapon3': '3.118', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '48.000'} [2024-08-06 05:46:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 521863168. Throughput: 0: 4377.3. Samples: 130468770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:22,794][52567] Avg episode reward: [(0, '73.531')] [2024-08-06 05:46:23,294][52659] DAMAGECOUNT value on done: 676102.0 [2024-08-06 05:46:23,295][52659] Sum rewards: 67.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.300', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '54.000'} [2024-08-06 05:46:24,222][52667] DAMAGECOUNT value on done: 676072.0 [2024-08-06 05:46:24,223][52667] Sum rewards: 73.188, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.156', 'weapon2': '0.186', 'AMMO3': '0.268', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.000'} [2024-08-06 05:46:24,825][52794] DAMAGECOUNT value on done: 664008.0 [2024-08-06 05:46:24,826][52794] Sum rewards: 68.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.116', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.219', 'weapon4': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '56.000'} [2024-08-06 05:46:24,897][52665] DAMAGECOUNT value on done: 665373.0 [2024-08-06 05:46:24,898][52665] Sum rewards: 78.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.125', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '63.000'} [2024-08-06 05:46:26,084][52650] Updated weights for policy 0, policy_version 63711 (0.0024) [2024-08-06 05:46:26,194][52659] DAMAGECOUNT value on done: 664737.0 [2024-08-06 05:46:26,205][52659] Sum rewards: 72.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.442', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.172', 'weapon4': '0.184', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.668', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '60.000'} [2024-08-06 05:46:26,988][52667] DAMAGECOUNT value on done: 679598.0 [2024-08-06 05:46:26,990][52667] Sum rewards: 81.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.276', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:27,504][52665] DAMAGECOUNT value on done: 660417.0 [2024-08-06 05:46:27,507][52665] Sum rewards: 74.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.884', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.148', 'AMMO4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.266', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '62.000'} [2024-08-06 05:46:27,784][52794] DAMAGECOUNT value on done: 663004.0 [2024-08-06 05:46:27,785][52794] Sum rewards: 64.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.432', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.598', 'WEAPON3': '1.650', 'weapon3': '3.112', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '54.000'} [2024-08-06 05:46:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 521945088. Throughput: 0: 4378.7. Samples: 130495040. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:27,802][52567] Avg episode reward: [(0, '73.838')] [2024-08-06 05:46:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063714_521945088.pth... [2024-08-06 05:46:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063203_517758976.pth [2024-08-06 05:46:29,307][52659] DAMAGECOUNT value on done: 676811.0 [2024-08-06 05:46:29,332][52667] DAMAGECOUNT value on done: 668240.0 [2024-08-06 05:46:29,332][52667] Sum rewards: 68.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.215', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'weapon4': '0.214', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:29,339][52659] Sum rewards: 71.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.145', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.096', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '62.000'} [2024-08-06 05:46:30,371][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:46:30,652][52665] DAMAGECOUNT value on done: 660709.0 [2024-08-06 05:46:30,652][52665] Sum rewards: 75.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.175', 'weapon5': '0.208', 'weapon4': '0.296', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '63.500'} [2024-08-06 05:46:30,868][52650] Updated weights for policy 0, policy_version 63721 (0.0025) [2024-08-06 05:46:31,311][52794] DAMAGECOUNT value on done: 671360.0 [2024-08-06 05:46:31,312][52794] Sum rewards: 76.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.129', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:31,844][52667] DAMAGECOUNT value on done: 669358.0 [2024-08-06 05:46:31,845][52667] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.144', 'AMMO3': '0.167', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:32,380][52659] DAMAGECOUNT value on done: 668819.0 [2024-08-06 05:46:32,380][52659] Sum rewards: 71.097, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.041', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.096', 'AMMO3': '0.160', 'AMMO4': '0.167', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 05:46:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 522035200. Throughput: 0: 4373.2. Samples: 130507940. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:32,794][52567] Avg episode reward: [(0, '73.572')] [2024-08-06 05:46:33,696][52665] DAMAGECOUNT value on done: 661326.0 [2024-08-06 05:46:33,696][52665] Sum rewards: 73.102, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.110', 'weapon2': '0.182', 'AMMO3': '0.278', 'AMMO4': '0.298', 'weapon5': '0.312', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '3.116', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:34,210][52794] DAMAGECOUNT value on done: 666216.0 [2024-08-06 05:46:34,211][52794] Sum rewards: 71.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.252', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon4': '0.178', 'AMMO3': '0.246', 'weapon2': '0.248', 'weapon5': '0.274', 'AMMO4': '0.323', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.948', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:34,240][52795] DAMAGECOUNT value on done: 622296.0 [2024-08-06 05:46:34,241][52795] Sum rewards: 74.003, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.128', 'AMMO4': '0.186', 'weapon4': '0.268', 'weapon5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.890', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '56.000'} [2024-08-06 05:46:34,701][52667] DAMAGECOUNT value on done: 675356.0 [2024-08-06 05:46:34,702][52667] Sum rewards: 69.712, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.908', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.074', 'AMMO4': '0.197', 'weapon5': '0.232', 'weapon2': '0.258', 'AMMO3': '0.297', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.066', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:35,208][52647] DAMAGECOUNT value on done: 710340.0 [2024-08-06 05:46:35,209][52647] Sum rewards: 71.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.588', 'AMMO5': '0.024', 'AMMO2': '0.046', 'AMMO3': '0.168', 'weapon5': '0.212', 'AMMO4': '0.232', 'weapon4': '0.286', 'weapon2': '0.312', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '57.000'} [2024-08-06 05:46:35,684][52650] Updated weights for policy 0, policy_version 63731 (0.0026) [2024-08-06 05:46:36,808][52665] DAMAGECOUNT value on done: 661354.0 [2024-08-06 05:46:36,812][52665] Sum rewards: 74.670, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.098', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.078', 'weapon5': '0.190', 'AMMO3': '0.235', 'AMMO4': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '62.000'} [2024-08-06 05:46:37,181][52794] DAMAGECOUNT value on done: 680843.0 [2024-08-06 05:46:37,182][52794] Sum rewards: 66.575, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.144', 'AMMO3': '0.166', 'AMMO4': '0.265', 'weapon5': '0.276', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '2.986', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 05:46:37,480][52795] DAMAGECOUNT value on done: 610224.0 [2024-08-06 05:46:37,480][52795] Sum rewards: 77.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.724', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.185', 'AMMO4': '0.218', 'weapon4': '0.266', 'weapon5': '0.278', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:37,512][52647] DAMAGECOUNT value on done: 702287.0 [2024-08-06 05:46:37,512][52647] Sum rewards: 73.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.974', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.064', 'weapon5': '0.136', 'AMMO3': '0.192', 'AMMO4': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '60.500'} [2024-08-06 05:46:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 522125312. Throughput: 0: 4372.0. Samples: 130533990. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:37,794][52567] Avg episode reward: [(0, '73.798')] [2024-08-06 05:46:37,848][52667] DAMAGECOUNT value on done: 667053.0 [2024-08-06 05:46:37,849][52667] Sum rewards: 78.181, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.225', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.074', 'weapon2': '0.146', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.626', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '68.000'} [2024-08-06 05:46:38,499][52662] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2024-08-06 05:46:39,508][52665] DAMAGECOUNT value on done: 655677.0 [2024-08-06 05:46:39,516][52665] Sum rewards: 72.366, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.590', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.095', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.820', 'WEAPON3': '1.050', 'weapon3': '2.952', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '57.000'} [2024-08-06 05:46:40,177][52794] DAMAGECOUNT value on done: 663464.0 [2024-08-06 05:46:40,177][52794] Sum rewards: 72.987, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.185', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.161', 'weapon5': '0.184', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.050', 'weapon3': '3.076', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:40,180][52650] Updated weights for policy 0, policy_version 63741 (0.0014) [2024-08-06 05:46:40,250][52663] DAMAGECOUNT value on done: 681010.0 [2024-08-06 05:46:40,254][52663] Sum rewards: 83.725, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.994', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon5': '0.194', 'AMMO3': '0.216', 'AMMO4': '0.283', 'weapon2': '0.324', 'weapon4': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.219', 'FRAGCOUNT': '69.000'} [2024-08-06 05:46:40,471][52647] DAMAGECOUNT value on done: 706647.0 [2024-08-06 05:46:40,472][52647] Sum rewards: 67.581, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.022', 'weapon5': '0.086', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '56.000'} [2024-08-06 05:46:40,580][52795] DAMAGECOUNT value on done: 612010.0 [2024-08-06 05:46:40,581][52795] Sum rewards: 76.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.241', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.155', 'weapon5': '0.156', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '62.000'} [2024-08-06 05:46:40,785][52667] DAMAGECOUNT value on done: 674666.0 [2024-08-06 05:46:40,786][52667] Sum rewards: 77.246, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '64.000'} [2024-08-06 05:46:41,133][52820] DAMAGECOUNT value on done: 621003.0 [2024-08-06 05:46:41,134][52820] Sum rewards: 64.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.013', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.196', 'AMMO4': '0.199', 'AMMO3': '0.199', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.256', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '53.000'} [2024-08-06 05:46:42,645][52665] DAMAGECOUNT value on done: 660204.0 [2024-08-06 05:46:42,646][52665] Sum rewards: 79.781, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.438', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.164', 'AMMO3': '0.245', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '68.000'} [2024-08-06 05:46:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 522207232. Throughput: 0: 4364.7. Samples: 130559930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 05:46:42,794][52567] Avg episode reward: [(0, '73.841')] [2024-08-06 05:46:42,941][52647] DAMAGECOUNT value on done: 707187.0 [2024-08-06 05:46:42,942][52647] Sum rewards: 76.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.207', 'weapon4': '0.270', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '62.000'} [2024-08-06 05:46:43,338][52794] DAMAGECOUNT value on done: 678218.0 [2024-08-06 05:46:43,340][52794] Sum rewards: 64.706, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.630', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.184', 'AMMO4': '0.282', 'AMMO3': '0.287', 'weapon5': '0.288', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.776', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '57.000'} [2024-08-06 05:46:43,510][52663] DAMAGECOUNT value on done: 669923.0 [2024-08-06 05:46:43,516][52663] Sum rewards: 59.745, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.970', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO3': '0.123', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.300', 'weapon2': '0.336', 'WEAPON3': '0.800', 'HITCOUNT': '2.780', 'weapon3': '3.204', 'DAMAGECOUNT': '13.365', 'FRAGCOUNT': '46.000'} [2024-08-06 05:46:43,809][52795] DAMAGECOUNT value on done: 619842.0 [2024-08-06 05:46:43,809][52795] Sum rewards: 92.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.217', 'WEAPON3': '1.450', 'weapon3': '3.516', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.996', 'FRAGCOUNT': '76.000'} [2024-08-06 05:46:43,950][52667] DAMAGECOUNT value on done: 680890.0 [2024-08-06 05:46:43,951][52667] Sum rewards: 65.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO4': '0.202', 'AMMO3': '0.224', 'weapon2': '0.340', 'weapon4': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '56.000'} [2024-08-06 05:46:44,276][52820] DAMAGECOUNT value on done: 620375.0 [2024-08-06 05:46:44,276][52820] Sum rewards: 72.996, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.814', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.054', 'weapon4': '0.072', 'AMMO3': '0.165', 'AMMO4': '0.179', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '61.500'} [2024-08-06 05:46:45,254][52650] Updated weights for policy 0, policy_version 63751 (0.0013) [2024-08-06 05:46:45,403][52811] Large shaping reward 2.596 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0)] [2024-08-06 05:46:45,597][52647] DAMAGECOUNT value on done: 715069.0 [2024-08-06 05:46:45,599][52647] Sum rewards: 48.107, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.104', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.196', 'weapon5': '0.206', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '2.876', 'DAMAGECOUNT': '13.827', 'FRAGCOUNT': '43.000'} [2024-08-06 05:46:45,782][52665] DAMAGECOUNT value on done: 664981.0 [2024-08-06 05:46:45,785][52665] Sum rewards: 72.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.160', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.264', 'WEAPON4': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:46,302][52794] DAMAGECOUNT value on done: 672392.0 [2024-08-06 05:46:46,303][52794] Sum rewards: 71.267, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.212', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '57.000'} [2024-08-06 05:46:46,509][52658] Large shaping reward 2.558 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.507, 169.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:46:46,646][52663] DAMAGECOUNT value on done: 663663.0 [2024-08-06 05:46:46,646][52663] Sum rewards: 67.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.076', 'weapon5': '0.128', 'AMMO3': '0.197', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '57.000'} [2024-08-06 05:46:46,681][52667] DAMAGECOUNT value on done: 677805.0 [2024-08-06 05:46:46,682][52667] Sum rewards: 67.029, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.849', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.086', 'AMMO4': '0.146', 'AMMO3': '0.168', 'weapon5': '0.212', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.222', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 05:46:47,084][52795] DAMAGECOUNT value on done: 613234.0 [2024-08-06 05:46:47,084][52795] Sum rewards: 69.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.510', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.016', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon2': '0.660', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '54.500'} [2024-08-06 05:46:47,380][52820] DAMAGECOUNT value on done: 622600.0 [2024-08-06 05:46:47,380][52820] Sum rewards: 69.583, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.562', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.540', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.9, 300 sec: 17411.5). Total num frames: 522289152. Throughput: 0: 4362.4. Samples: 130573050. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:46:47,794][52567] Avg episode reward: [(0, '73.488')] [2024-08-06 05:46:48,700][52647] DAMAGECOUNT value on done: 712773.0 [2024-08-06 05:46:48,702][52647] Sum rewards: 67.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.116', 'AMMO4': '0.137', 'AMMO3': '0.206', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '54.000'} [2024-08-06 05:46:49,292][52650] Updated weights for policy 0, policy_version 63761 (0.0012) [2024-08-06 05:46:49,412][52794] DAMAGECOUNT value on done: 676639.0 [2024-08-06 05:46:49,414][52794] Sum rewards: 64.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.926', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.228', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.502', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '55.000'} [2024-08-06 05:46:49,647][52667] DAMAGECOUNT value on done: 678685.0 [2024-08-06 05:46:49,647][52667] Sum rewards: 80.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.865', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.144', 'weapon4': '0.154', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.920', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:50,156][52663] DAMAGECOUNT value on done: 667927.0 [2024-08-06 05:46:50,156][52663] Sum rewards: 67.036, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-4.564', 'AMMO5': '0.023', 'AMMO2': '0.061', 'weapon4': '0.278', 'weapon2': '0.290', 'AMMO4': '0.303', 'AMMO3': '0.310', 'weapon5': '0.310', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.800', 'weapon3': '2.682', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '63.000'} [2024-08-06 05:46:50,258][52795] DAMAGECOUNT value on done: 624463.0 [2024-08-06 05:46:50,267][52795] Sum rewards: 76.831, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.972', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.116', 'AMMO3': '0.174', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:50,431][52820] DAMAGECOUNT value on done: 614764.0 [2024-08-06 05:46:50,431][52820] Sum rewards: 69.755, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.025', 'AMMO2': '0.074', 'weapon2': '0.218', 'AMMO3': '0.263', 'weapon4': '0.360', 'weapon5': '0.370', 'AMMO4': '0.372', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.606', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '60.000'} [2024-08-06 05:46:51,033][52647] DAMAGECOUNT value on done: 709499.0 [2024-08-06 05:46:51,034][52647] Sum rewards: 65.809, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.451', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.138', 'weapon5': '0.146', 'AMMO3': '0.264', 'AMMO4': '0.284', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:51,386][52811] DAMAGECOUNT value on done: 640135.0 [2024-08-06 05:46:51,387][52811] Sum rewards: 69.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.066', 'AMMO3': '0.166', 'weapon5': '0.166', 'AMMO4': '0.169', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.392', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:51,692][52614] Signal inference workers to stop experience collection... (11600 times) [2024-08-06 05:46:51,693][52614] Signal inference workers to resume experience collection... (11600 times) [2024-08-06 05:46:51,757][52650] InferenceWorker_p0-w0: stopping experience collection (11600 times) [2024-08-06 05:46:51,757][52650] InferenceWorker_p0-w0: resuming experience collection (11600 times) [2024-08-06 05:46:52,460][52794] DAMAGECOUNT value on done: 679506.0 [2024-08-06 05:46:52,462][52794] Sum rewards: 81.597, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.768', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'weapon3': '3.368', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '69.000'} [2024-08-06 05:46:52,492][52663] DAMAGECOUNT value on done: 672004.0 [2024-08-06 05:46:52,495][52663] Sum rewards: 70.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.816', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.108', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon4': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '59.000'} [2024-08-06 05:46:52,749][52667] DAMAGECOUNT value on done: 671496.0 [2024-08-06 05:46:52,750][52667] Sum rewards: 76.862, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.866', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.104', 'AMMO4': '0.157', 'AMMO3': '0.158', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 522379264. Throughput: 0: 4361.1. Samples: 130599350. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:46:52,794][52567] Avg episode reward: [(0, '72.818')] [2024-08-06 05:46:53,279][52647] DAMAGECOUNT value on done: 692742.0 [2024-08-06 05:46:53,280][52647] Sum rewards: 68.083, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.911', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.152', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '55.000'} [2024-08-06 05:46:53,465][52795] DAMAGECOUNT value on done: 625834.0 [2024-08-06 05:46:53,469][52795] Sum rewards: 68.017, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon2': '0.186', 'AMMO3': '0.197', 'AMMO4': '0.224', 'HEALTH': '0.290', 'weapon5': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.614', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '55.000'} [2024-08-06 05:46:53,590][52820] DAMAGECOUNT value on done: 623072.0 [2024-08-06 05:46:53,590][52820] Sum rewards: 92.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.826', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.392', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.678', 'FRAGCOUNT': '76.000'} [2024-08-06 05:46:54,335][52650] Updated weights for policy 0, policy_version 63771 (0.0033) [2024-08-06 05:46:54,476][52811] DAMAGECOUNT value on done: 618752.0 [2024-08-06 05:46:54,476][52811] Sum rewards: 68.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.536', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.266', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.394', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '60.000'} [2024-08-06 05:46:54,667][52670] DAMAGECOUNT value on done: 663465.0 [2024-08-06 05:46:54,667][52670] Sum rewards: 82.439, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'HEALTH': '0.145', 'AMMO3': '0.165', 'weapon4': '0.190', 'weapon2': '0.314', 'WEAPON3': '0.950', 'weapon3': '3.178', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:55,000][52666] DAMAGECOUNT value on done: 671208.0 [2024-08-06 05:46:55,002][52666] Sum rewards: 79.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.126', 'AMMO4': '0.176', 'weapon5': '0.178', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '65.000'} [2024-08-06 05:46:55,218][52663] DAMAGECOUNT value on done: 679385.0 [2024-08-06 05:46:55,221][52663] Sum rewards: 69.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.140', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.244', 'AMMO4': '0.252', 'weapon5': '0.258', 'weapon2': '0.310', 'weapon4': '0.326', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.792', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '59.000'} [2024-08-06 05:46:55,593][52794] DAMAGECOUNT value on done: 670777.0 [2024-08-06 05:46:55,594][52794] Sum rewards: 71.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.384', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.158', 'AMMO3': '0.199', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '59.000'} [2024-08-06 05:46:55,702][52647] DAMAGECOUNT value on done: 708626.0 [2024-08-06 05:46:55,703][52647] Sum rewards: 74.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.027', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.172', 'AMMO4': '0.180', 'AMMO3': '0.221', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '60.500'} [2024-08-06 05:46:55,995][52667] DAMAGECOUNT value on done: 680417.0 [2024-08-06 05:46:55,997][52667] Sum rewards: 70.444, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.094', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.030', 'AMMO4': '0.041', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.426', 'WEAPON3': '1.550', 'weapon3': '3.284', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '61.000'} [2024-08-06 05:46:56,727][52820] DAMAGECOUNT value on done: 613342.0 [2024-08-06 05:46:56,728][52820] Sum rewards: 57.980, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.446', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.878', 'WEAPON3': '1.050', 'weapon3': '2.628', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '46.000'} [2024-08-06 05:46:56,763][52795] DAMAGECOUNT value on done: 620836.0 [2024-08-06 05:46:56,765][52795] Sum rewards: 81.733, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.340', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.116', 'weapon4': '0.142', 'AMMO3': '0.226', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '70.000'} [2024-08-06 05:46:57,383][52670] DAMAGECOUNT value on done: 672395.0 [2024-08-06 05:46:57,384][52670] Sum rewards: 75.422, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.289', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '63.000'} [2024-08-06 05:46:57,645][52811] DAMAGECOUNT value on done: 620035.0 [2024-08-06 05:46:57,645][52811] Sum rewards: 83.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.696', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.182', 'AMMO3': '0.196', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.236', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '67.000'} [2024-08-06 05:46:57,780][52666] DAMAGECOUNT value on done: 670054.0 [2024-08-06 05:46:57,782][52666] Sum rewards: 76.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.403', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.094', 'AMMO4': '0.128', 'weapon5': '0.132', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON3': '1.200', 'weapon3': '3.388', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '62.000'} [2024-08-06 05:46:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 522469376. Throughput: 0: 4352.7. Samples: 130625420. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:46:57,794][52567] Avg episode reward: [(0, '73.304')] [2024-08-06 05:46:58,154][52647] DAMAGECOUNT value on done: 707342.0 [2024-08-06 05:46:58,154][52647] Sum rewards: 63.762, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.186', 'weapon2': '0.222', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.282', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '52.000'} [2024-08-06 05:46:58,397][52663] DAMAGECOUNT value on done: 667238.0 [2024-08-06 05:46:58,398][52663] Sum rewards: 69.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.447', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.084', 'AMMO4': '0.152', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.150', 'weapon3': '3.374', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '56.000'} [2024-08-06 05:46:58,528][52650] Updated weights for policy 0, policy_version 63781 (0.0013) [2024-08-06 05:46:58,895][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:46:59,902][52795] DAMAGECOUNT value on done: 615478.0 [2024-08-06 05:46:59,903][52795] Sum rewards: 73.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.452', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.155', 'weapon4': '0.174', 'weapon5': '0.196', 'AMMO4': '0.230', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.136', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '58.000'} [2024-08-06 05:46:59,920][52820] DAMAGECOUNT value on done: 622258.0 [2024-08-06 05:46:59,922][52820] Sum rewards: 73.568, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.038', 'AMMO4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:00,175][52670] DAMAGECOUNT value on done: 660129.0 [2024-08-06 05:47:00,177][52670] Sum rewards: 63.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.677', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.173', 'weapon4': '0.174', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.142', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '54.000'} [2024-08-06 05:47:00,541][52666] DAMAGECOUNT value on done: 671638.0 [2024-08-06 05:47:00,543][52666] Sum rewards: 85.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.617', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.243', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '71.000'} [2024-08-06 05:47:00,761][52811] DAMAGECOUNT value on done: 620862.0 [2024-08-06 05:47:00,770][52811] Sum rewards: 62.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.142', 'weapon4': '0.208', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:01,149][52663] DAMAGECOUNT value on done: 661785.0 [2024-08-06 05:47:01,149][52663] Sum rewards: 75.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.518', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.067', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.344', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:01,339][52647] DAMAGECOUNT value on done: 704250.0 [2024-08-06 05:47:01,340][52647] Sum rewards: 76.293, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.266', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.072', 'weapon5': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.141', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON3': '0.950', 'weapon3': '3.090', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:02,112][52658] DAMAGECOUNT value on done: 673628.0 [2024-08-06 05:47:02,112][52658] Sum rewards: 80.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.062', 'AMMO4': '0.115', 'weapon5': '0.206', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.444', 'FRAGCOUNT': '64.500'} [2024-08-06 05:47:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 522551296. Throughput: 0: 4348.9. Samples: 130638430. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:47:02,795][52567] Avg episode reward: [(0, '72.692')] [2024-08-06 05:47:02,975][52820] DAMAGECOUNT value on done: 625461.0 [2024-08-06 05:47:02,975][52820] Sum rewards: 86.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.677', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon4': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.000', 'weapon3': '3.240', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '69.000'} [2024-08-06 05:47:03,004][52670] DAMAGECOUNT value on done: 659654.0 [2024-08-06 05:47:03,006][52670] Sum rewards: 67.854, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.160', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.064', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.147', 'weapon2': '0.402', 'WEAPON3': '0.850', 'HITCOUNT': '2.960', 'weapon3': '3.308', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '53.000'} [2024-08-06 05:47:03,119][52795] DAMAGECOUNT value on done: 624562.0 [2024-08-06 05:47:03,119][52795] Sum rewards: 79.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.090', 'AMMO4': '0.104', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:03,413][52666] DAMAGECOUNT value on done: 671794.0 [2024-08-06 05:47:03,414][52666] Sum rewards: 69.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.174', 'AMMO3': '0.185', 'weapon2': '0.298', 'weapon4': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '56.000'} [2024-08-06 05:47:03,785][52650] Updated weights for policy 0, policy_version 63791 (0.0016) [2024-08-06 05:47:03,837][52811] DAMAGECOUNT value on done: 630992.0 [2024-08-06 05:47:03,838][52811] Sum rewards: 77.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.242', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.134', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:04,081][52663] DAMAGECOUNT value on done: 663453.0 [2024-08-06 05:47:04,083][52663] Sum rewards: 60.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.175', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.038', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.536', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.194', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '53.000'} [2024-08-06 05:47:04,704][52647] DAMAGECOUNT value on done: 699331.0 [2024-08-06 05:47:04,704][52647] Sum rewards: 79.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.175', 'weapon5': '0.204', 'AMMO4': '0.227', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.422', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:04,797][52658] DAMAGECOUNT value on done: 670938.0 [2024-08-06 05:47:04,798][52658] Sum rewards: 73.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.068', 'weapon5': '0.160', 'AMMO4': '0.230', 'AMMO3': '0.238', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.236', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:05,610][52670] DAMAGECOUNT value on done: 671269.0 [2024-08-06 05:47:05,610][52670] Sum rewards: 67.961, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.281', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.034', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO4': '0.170', 'weapon2': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.354', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:06,037][52820] DAMAGECOUNT value on done: 619745.0 [2024-08-06 05:47:06,047][52820] Sum rewards: 67.088, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.284', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:06,053][52666] DAMAGECOUNT value on done: 663094.0 [2024-08-06 05:47:06,053][52666] Sum rewards: 72.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.144', 'AMMO4': '0.198', 'weapon2': '0.202', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.422', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:06,320][52795] DAMAGECOUNT value on done: 618865.0 [2024-08-06 05:47:06,321][52795] Sum rewards: 67.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.132', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.110', 'weapon4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:06,503][52663] DAMAGECOUNT value on done: 666543.0 [2024-08-06 05:47:06,504][52663] Sum rewards: 65.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'weapon4': '0.002', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.181', 'weapon2': '0.840', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '54.000'} [2024-08-06 05:47:06,812][52811] DAMAGECOUNT value on done: 635095.0 [2024-08-06 05:47:06,814][52811] Sum rewards: 77.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.076', 'AMMO4': '0.089', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:07,186][52669] DAMAGECOUNT value on done: 673837.0 [2024-08-06 05:47:07,186][52669] Sum rewards: 74.228, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.275', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.058', 'AMMO3': '0.173', 'AMMO4': '0.186', 'weapon5': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.050', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '56.500'} [2024-08-06 05:47:07,602][52647] DAMAGECOUNT value on done: 712595.0 [2024-08-06 05:47:07,604][52647] Sum rewards: 66.787, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.976', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.078', 'weapon4': '0.126', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.348', 'AMMO3': '0.356', 'WEAPON3': '2.000', 'weapon3': '3.112', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:07,660][52658] DAMAGECOUNT value on done: 676181.0 [2024-08-06 05:47:07,662][52658] Sum rewards: 61.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.130', 'AMMO3': '0.195', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.186', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '50.000'} [2024-08-06 05:47:07,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 522641408. Throughput: 0: 4353.1. Samples: 130664660. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:47:07,796][52567] Avg episode reward: [(0, '72.399')] [2024-08-06 05:47:08,447][52650] Updated weights for policy 0, policy_version 63801 (0.0030) [2024-08-06 05:47:08,780][52670] DAMAGECOUNT value on done: 666650.0 [2024-08-06 05:47:08,780][52670] Sum rewards: 72.411, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.455', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon4': '0.160', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.158', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:09,163][52663] DAMAGECOUNT value on done: 677381.0 [2024-08-06 05:47:09,166][52663] Sum rewards: 65.189, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.776', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon4': '0.160', 'weapon5': '0.184', 'weapon2': '0.204', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:09,174][52666] DAMAGECOUNT value on done: 665725.0 [2024-08-06 05:47:09,175][52666] Sum rewards: 69.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.252', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.076', 'weapon5': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.253', 'weapon2': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:09,203][52820] DAMAGECOUNT value on done: 626354.0 [2024-08-06 05:47:09,203][52820] Sum rewards: 73.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.348', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.194', 'AMMO3': '0.219', 'weapon5': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.846', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:09,413][52795] DAMAGECOUNT value on done: 615891.0 [2024-08-06 05:47:09,417][52795] Sum rewards: 80.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.126', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '65.000'} [2024-08-06 05:47:09,735][52669] DAMAGECOUNT value on done: 665114.0 [2024-08-06 05:47:09,735][52669] Sum rewards: 88.825, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.030', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'weapon5': '0.130', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.050', 'weapon3': '3.356', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '72.000'} [2024-08-06 05:47:09,954][52811] DAMAGECOUNT value on done: 631134.0 [2024-08-06 05:47:09,956][52811] Sum rewards: 81.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.172', 'AMMO4': '0.179', 'AMMO3': '0.227', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '69.000'} [2024-08-06 05:47:10,044][52647] DAMAGECOUNT value on done: 700305.0 [2024-08-06 05:47:10,044][52647] Sum rewards: 61.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.090', 'AMMO4': '0.182', 'AMMO3': '0.216', 'weapon5': '0.304', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:10,544][52658] DAMAGECOUNT value on done: 674762.0 [2024-08-06 05:47:10,544][52658] Sum rewards: 73.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.172', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.068', 'AMMO4': '0.096', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'HITCOUNT': '3.510', 'weapon3': '3.514', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:11,073][52671] DAMAGECOUNT value on done: 674336.0 [2024-08-06 05:47:11,074][52671] Sum rewards: 70.669, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.144', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.101', 'weapon5': '0.108', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.336', 'WEAPON3': '0.900', 'HITCOUNT': '3.070', 'weapon3': '3.392', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:11,243][52671] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:47:11,797][52663] DAMAGECOUNT value on done: 662673.0 [2024-08-06 05:47:11,797][52663] Sum rewards: 58.750, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.066', 'weapon4': '0.120', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.328', 'DAMAGECOUNT': '14.514', 'FRAGCOUNT': '49.500'} [2024-08-06 05:47:11,928][52670] DAMAGECOUNT value on done: 657910.0 [2024-08-06 05:47:11,931][52670] Sum rewards: 63.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.336', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.185', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.050', 'weapon3': '2.790', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '50.000'} [2024-08-06 05:47:12,296][52669] DAMAGECOUNT value on done: 676047.0 [2024-08-06 05:47:12,297][52669] Sum rewards: 84.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.446', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.092', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.210', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '69.000'} [2024-08-06 05:47:12,315][52666] DAMAGECOUNT value on done: 664099.0 [2024-08-06 05:47:12,316][52666] Sum rewards: 73.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.785', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.098', 'AMMO4': '0.144', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:12,325][52820] DAMAGECOUNT value on done: 615056.0 [2024-08-06 05:47:12,325][52820] Sum rewards: 61.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.189', 'AMMO3': '0.199', 'weapon4': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '50.000'} [2024-08-06 05:47:12,570][52795] DAMAGECOUNT value on done: 614302.0 [2024-08-06 05:47:12,572][52795] Sum rewards: 61.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.036', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.061', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.332', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.260', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:12,745][52647] DAMAGECOUNT value on done: 709570.0 [2024-08-06 05:47:12,745][52647] Sum rewards: 59.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.092', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.144', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '49.000'} [2024-08-06 05:47:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 522731520. Throughput: 0: 4349.6. Samples: 130690770. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:47:12,794][52567] Avg episode reward: [(0, '72.010')] [2024-08-06 05:47:13,011][52650] Updated weights for policy 0, policy_version 63811 (0.0036) [2024-08-06 05:47:13,065][52811] DAMAGECOUNT value on done: 621420.0 [2024-08-06 05:47:13,068][52811] Sum rewards: 80.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.952', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO4': '0.198', 'weapon5': '0.216', 'weapon2': '0.220', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:13,776][52671] DAMAGECOUNT value on done: 677959.0 [2024-08-06 05:47:13,777][52671] Sum rewards: 69.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.204', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.146', 'AMMO4': '0.167', 'weapon5': '0.236', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '0.950', 'weapon3': '2.776', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:13,831][52658] DAMAGECOUNT value on done: 664324.0 [2024-08-06 05:47:13,833][52658] Sum rewards: 68.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:14,584][52663] DAMAGECOUNT value on done: 659276.0 [2024-08-06 05:47:14,584][52663] Sum rewards: 63.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.528', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO3': '0.153', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:15,016][52669] DAMAGECOUNT value on done: 673234.0 [2024-08-06 05:47:15,018][52669] Sum rewards: 75.953, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.541', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.148', 'AMMO3': '0.179', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.412', 'weapon4': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.664', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:15,143][52647] DAMAGECOUNT value on done: 710244.0 [2024-08-06 05:47:15,143][52647] Sum rewards: 56.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.426', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.185', 'weapon2': '0.270', 'weapon5': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.640', 'weapon3': '2.752', 'DAMAGECOUNT': '14.346', 'FRAGCOUNT': '47.000'} [2024-08-06 05:47:15,323][52670] DAMAGECOUNT value on done: 665489.0 [2024-08-06 05:47:15,323][52670] Sum rewards: 75.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.222', 'WEAPON3': '1.200', 'HITCOUNT': '3.440', 'weapon3': '3.628', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:15,705][52795] DAMAGECOUNT value on done: 623150.0 [2024-08-06 05:47:15,708][52795] Sum rewards: 69.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.191', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.193', 'AMMO4': '0.232', 'weapon2': '0.276', 'weapon4': '0.286', 'weapon5': '0.378', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.752', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:15,721][52666] DAMAGECOUNT value on done: 661535.0 [2024-08-06 05:47:15,723][52666] Sum rewards: 84.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.609', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.072', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.222', 'WEAPON3': '1.100', 'weapon3': '3.436', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '71.000'} [2024-08-06 05:47:15,770][52820] DAMAGECOUNT value on done: 623434.0 [2024-08-06 05:47:15,773][52820] Sum rewards: 69.127, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.198', 'AMMO3': '0.242', 'AMMO4': '0.280', 'weapon5': '0.284', 'weapon2': '0.424', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.748', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:16,113][52811] DAMAGECOUNT value on done: 634391.0 [2024-08-06 05:47:16,115][52811] Sum rewards: 66.874, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.597', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.104', 'AMMO4': '0.138', 'weapon5': '0.218', 'AMMO3': '0.236', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.146', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:16,345][52658] DAMAGECOUNT value on done: 665266.0 [2024-08-06 05:47:16,346][52658] Sum rewards: 67.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.908', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.640', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '56.000'} [2024-08-06 05:47:16,665][52671] DAMAGECOUNT value on done: 675086.0 [2024-08-06 05:47:16,665][52671] Sum rewards: 73.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.128', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon2': '0.192', 'weapon5': '0.222', 'AMMO3': '0.239', 'AMMO4': '0.280', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:16,709][52665] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 05:47:17,126][52663] DAMAGECOUNT value on done: 665266.0 [2024-08-06 05:47:17,126][52663] Sum rewards: 69.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.596', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.151', 'AMMO3': '0.183', 'weapon5': '0.192', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.300', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:17,664][52650] Updated weights for policy 0, policy_version 63821 (0.0014) [2024-08-06 05:47:17,695][52669] DAMAGECOUNT value on done: 672833.0 [2024-08-06 05:47:17,695][52669] Sum rewards: 77.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.526', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:17,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 522821632. Throughput: 0: 4355.8. Samples: 130703950. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:47:17,794][52567] Avg episode reward: [(0, '71.616')] [2024-08-06 05:47:17,917][52647] DAMAGECOUNT value on done: 694860.0 [2024-08-06 05:47:17,920][52647] Sum rewards: 70.395, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.786', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.070', 'AMMO4': '0.103', 'weapon5': '0.136', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:18,526][52670] DAMAGECOUNT value on done: 662126.0 [2024-08-06 05:47:18,527][52670] Sum rewards: 58.154, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.460', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.154', 'AMMO4': '0.224', 'weapon5': '0.238', 'AMMO3': '0.244', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.078', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '51.000'} [2024-08-06 05:47:18,772][52666] DAMAGECOUNT value on done: 668680.0 [2024-08-06 05:47:18,773][52666] Sum rewards: 71.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.360', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.226', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.434', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:18,809][52795] DAMAGECOUNT value on done: 609229.0 [2024-08-06 05:47:18,814][52795] Sum rewards: 76.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.488', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.032', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:18,895][52658] DAMAGECOUNT value on done: 676892.0 [2024-08-06 05:47:18,898][52658] Sum rewards: 59.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.138', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '50.000'} [2024-08-06 05:47:19,017][52820] DAMAGECOUNT value on done: 630516.0 [2024-08-06 05:47:19,019][52820] Sum rewards: 77.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.635', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon4': '0.224', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '65.000'} [2024-08-06 05:47:19,364][52811] DAMAGECOUNT value on done: 628616.0 [2024-08-06 05:47:19,365][52811] Sum rewards: 74.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:19,882][52671] DAMAGECOUNT value on done: 677396.0 [2024-08-06 05:47:19,882][52671] Sum rewards: 70.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.120', 'weapon5': '0.128', 'AMMO4': '0.175', 'weapon2': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.250', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:20,323][52663] DAMAGECOUNT value on done: 661172.0 [2024-08-06 05:47:20,324][52663] Sum rewards: 69.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.314', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.134', 'weapon5': '0.136', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.261', 'WEAPON3': '1.650', 'weapon3': '3.222', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:20,728][52669] DAMAGECOUNT value on done: 675356.0 [2024-08-06 05:47:20,728][52669] Sum rewards: 76.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.219', 'weapon2': '0.252', 'WEAPON3': '1.350', 'HITCOUNT': '3.580', 'weapon3': '3.606', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:20,968][52670] DAMAGECOUNT value on done: 659337.0 [2024-08-06 05:47:20,970][52670] Sum rewards: 54.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.280', 'AMMO5': '0.011', 'weapon4': '0.036', 'AMMO2': '0.041', 'weapon5': '0.182', 'AMMO4': '0.207', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.450', 'HITCOUNT': '2.760', 'weapon3': '3.068', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '44.500'} [2024-08-06 05:47:21,118][52647] DAMAGECOUNT value on done: 705274.0 [2024-08-06 05:47:21,126][52647] Sum rewards: 84.508, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.721', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.174', 'AMMO3': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.518', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '69.000'} [2024-08-06 05:47:21,256][52666] DAMAGECOUNT value on done: 661607.0 [2024-08-06 05:47:21,259][52666] Sum rewards: 72.518, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'HEALTH': '0.196', 'weapon4': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.860', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:21,814][52658] DAMAGECOUNT value on done: 668447.0 [2024-08-06 05:47:21,815][52658] Sum rewards: 77.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.243', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.332', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:22,035][52795] DAMAGECOUNT value on done: 627650.0 [2024-08-06 05:47:22,036][52795] Sum rewards: 83.531, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.543', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '68.000'} [2024-08-06 05:47:22,056][52820] DAMAGECOUNT value on done: 623293.0 [2024-08-06 05:47:22,057][52820] Sum rewards: 67.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-5.015', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.850', 'HITCOUNT': '3.360', 'weapon3': '3.372', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:22,391][52811] DAMAGECOUNT value on done: 630973.0 [2024-08-06 05:47:22,392][52811] Sum rewards: 79.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.050', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.076', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.366', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:22,423][52650] Updated weights for policy 0, policy_version 63831 (0.0019) [2024-08-06 05:47:22,639][52671] DAMAGECOUNT value on done: 685784.0 [2024-08-06 05:47:22,640][52671] Sum rewards: 70.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.192', 'AMMO3': '0.225', 'AMMO4': '0.233', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 522903552. Throughput: 0: 4362.9. Samples: 130730320. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 05:47:22,794][52567] Avg episode reward: [(0, '71.993')] [2024-08-06 05:47:23,121][52663] DAMAGECOUNT value on done: 676206.0 [2024-08-06 05:47:23,122][52663] Sum rewards: 70.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.485', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.222', 'weapon2': '0.232', 'weapon5': '0.390', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.100', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:23,355][52670] DAMAGECOUNT value on done: 670260.0 [2024-08-06 05:47:23,356][52670] Sum rewards: 67.339, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.632', 'AMMO2': '0.011', 'AMMO5': '0.013', 'AMMO4': '0.056', 'weapon4': '0.136', 'AMMO3': '0.155', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:23,575][52669] DAMAGECOUNT value on done: 673608.0 [2024-08-06 05:47:23,575][52669] Sum rewards: 58.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.092', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.304', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.290', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '49.000'} [2024-08-06 05:47:23,742][52666] DAMAGECOUNT value on done: 668480.0 [2024-08-06 05:47:23,743][52666] Sum rewards: 90.326, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.692', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.112', 'weapon2': '0.158', 'AMMO3': '0.255', 'WEAPON3': '1.650', 'weapon3': '3.442', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.951', 'FRAGCOUNT': '77.000'} [2024-08-06 05:47:24,231][52647] DAMAGECOUNT value on done: 694863.0 [2024-08-06 05:47:24,231][52647] Sum rewards: 56.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.732', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.136', 'weapon5': '0.212', 'AMMO3': '0.268', 'AMMO4': '0.271', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.860', 'weapon3': '2.928', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '48.000'} [2024-08-06 05:47:25,048][52820] DAMAGECOUNT value on done: 627819.0 [2024-08-06 05:47:25,048][52820] Sum rewards: 73.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.443', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.082', 'AMMO4': '0.129', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'weapon5': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '2.868', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:25,062][52658] DAMAGECOUNT value on done: 686315.0 [2024-08-06 05:47:25,062][52658] Sum rewards: 66.712, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.237', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.042', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon5': '0.172', 'AMMO3': '0.173', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:25,174][52795] DAMAGECOUNT value on done: 621469.0 [2024-08-06 05:47:25,177][52795] Sum rewards: 72.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.246', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.160', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:25,478][52811] DAMAGECOUNT value on done: 634521.0 [2024-08-06 05:47:25,480][52811] Sum rewards: 59.652, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.750', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.084', 'AMMO4': '0.125', 'WEAPON4': '0.250', 'weapon2': '0.274', 'AMMO3': '0.329', 'WEAPON5': '0.350', 'WEAPON3': '1.950', 'weapon3': '3.260', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:25,655][52663] DAMAGECOUNT value on done: 667687.0 [2024-08-06 05:47:25,655][52663] Sum rewards: 83.548, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.369', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.078', 'weapon5': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon2': '0.782', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:25,681][52671] DAMAGECOUNT value on done: 676482.0 [2024-08-06 05:47:25,682][52671] Sum rewards: 68.698, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.532', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.113', 'weapon5': '0.136', 'weapon2': '0.202', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.354', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:25,927][52669] DAMAGECOUNT value on done: 673369.0 [2024-08-06 05:47:25,927][52669] Sum rewards: 71.505, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.108', 'weapon5': '0.114', 'AMMO4': '0.205', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:26,274][52670] DAMAGECOUNT value on done: 654982.0 [2024-08-06 05:47:26,284][52670] Sum rewards: 66.362, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.056', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '56.000'} [2024-08-06 05:47:26,762][52666] DAMAGECOUNT value on done: 657527.0 [2024-08-06 05:47:26,762][52666] Sum rewards: 78.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.004', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.054', 'AMMO4': '0.149', 'weapon5': '0.158', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:27,249][52650] Updated weights for policy 0, policy_version 63841 (0.0025) [2024-08-06 05:47:27,325][52647] DAMAGECOUNT value on done: 701295.0 [2024-08-06 05:47:27,326][52647] Sum rewards: 96.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.054', 'AMMO4': '0.097', 'weapon2': '0.172', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.548', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '23.295', 'FRAGCOUNT': '77.000'} [2024-08-06 05:47:27,709][52658] DAMAGECOUNT value on done: 672275.0 [2024-08-06 05:47:27,710][52658] Sum rewards: 59.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.191', 'weapon5': '0.192', 'weapon4': '0.226', 'AMMO4': '0.264', 'weapon2': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '50.000'} [2024-08-06 05:47:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 522985472. Throughput: 0: 4366.4. Samples: 130756420. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:47:27,794][52567] Avg episode reward: [(0, '71.606')] [2024-08-06 05:47:28,247][52820] DAMAGECOUNT value on done: 623518.0 [2024-08-06 05:47:28,248][52820] Sum rewards: 71.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.453', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO3': '0.159', 'weapon5': '0.162', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:28,274][52663] DAMAGECOUNT value on done: 673178.0 [2024-08-06 05:47:28,276][52663] Sum rewards: 78.150, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.154', 'AMMO3': '0.158', 'AMMO4': '0.205', 'weapon2': '0.270', 'weapon4': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:28,326][52795] DAMAGECOUNT value on done: 614880.0 [2024-08-06 05:47:28,326][52795] Sum rewards: 77.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.696', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.178', 'AMMO4': '0.205', 'AMMO3': '0.265', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.144', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:28,481][52811] DAMAGECOUNT value on done: 626676.0 [2024-08-06 05:47:28,481][52811] Sum rewards: 66.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.689', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.080', 'weapon5': '0.174', 'AMMO4': '0.205', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 05:47:28,575][52669] DAMAGECOUNT value on done: 681816.0 [2024-08-06 05:47:28,576][52669] Sum rewards: 78.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.655', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.158', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:28,738][52671] DAMAGECOUNT value on done: 680308.0 [2024-08-06 05:47:28,739][52671] Sum rewards: 66.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.155', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.400', 'weapon4': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.674', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:29,105][52670] DAMAGECOUNT value on done: 665858.0 [2024-08-06 05:47:29,106][52670] Sum rewards: 63.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.637', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.118', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:29,583][52666] DAMAGECOUNT value on done: 670951.0 [2024-08-06 05:47:29,585][52666] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'HEALTH': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.189', 'weapon2': '0.386', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.390', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:30,723][52658] DAMAGECOUNT value on done: 684232.0 [2024-08-06 05:47:30,724][52658] Sum rewards: 78.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:31,197][52663] DAMAGECOUNT value on done: 673064.0 [2024-08-06 05:47:31,197][52663] Sum rewards: 71.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.709', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.424', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:31,373][52820] DAMAGECOUNT value on done: 624992.0 [2024-08-06 05:47:31,383][52820] Sum rewards: 76.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.200', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.125', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '65.000'} [2024-08-06 05:47:31,426][52669] DAMAGECOUNT value on done: 674264.0 [2024-08-06 05:47:31,428][52669] Sum rewards: 80.135, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.060', 'AMMO4': '0.148', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:31,447][52671] DAMAGECOUNT value on done: 676946.0 [2024-08-06 05:47:31,449][52671] Sum rewards: 78.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '65.000'} [2024-08-06 05:47:31,517][52795] DAMAGECOUNT value on done: 623213.0 [2024-08-06 05:47:31,517][52795] Sum rewards: 83.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.635', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.058', 'weapon5': '0.070', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '69.000'} [2024-08-06 05:47:31,655][52811] DAMAGECOUNT value on done: 625087.0 [2024-08-06 05:47:31,657][52811] Sum rewards: 91.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.980', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.120', 'weapon4': '0.138', 'weapon2': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.490', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '75.000'} [2024-08-06 05:47:31,778][52650] Updated weights for policy 0, policy_version 63851 (0.0014) [2024-08-06 05:47:32,174][52670] DAMAGECOUNT value on done: 670900.0 [2024-08-06 05:47:32,176][52670] Sum rewards: 71.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.320', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.108', 'weapon5': '0.176', 'AMMO4': '0.189', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 523075584. Throughput: 0: 4360.9. Samples: 130769290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:47:32,794][52567] Avg episode reward: [(0, '72.054')] [2024-08-06 05:47:32,798][52666] DAMAGECOUNT value on done: 665775.0 [2024-08-06 05:47:32,798][52666] Sum rewards: 74.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.354', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.170', 'AMMO4': '0.176', 'weapon5': '0.194', 'AMMO3': '0.220', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:33,028][52663] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:47:33,426][52803] DAMAGECOUNT value on done: 625123.0 [2024-08-06 05:47:33,427][52803] Sum rewards: 72.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.435', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.184', 'AMMO3': '0.207', 'weapon2': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:33,861][52658] DAMAGECOUNT value on done: 670214.0 [2024-08-06 05:47:33,861][52658] Sum rewards: 82.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.126', 'weapon5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.259', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.156', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '70.000'} [2024-08-06 05:47:34,206][52663] DAMAGECOUNT value on done: 665419.0 [2024-08-06 05:47:34,209][52663] Sum rewards: 66.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.144', 'AMMO3': '0.176', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon4': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:34,311][52671] DAMAGECOUNT value on done: 669121.0 [2024-08-06 05:47:34,312][52671] Sum rewards: 73.975, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.016', 'HEALTH': '0.023', 'AMMO2': '0.047', 'AMMO3': '0.174', 'weapon4': '0.216', 'AMMO4': '0.236', 'weapon5': '0.304', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:34,362][52820] DAMAGECOUNT value on done: 635718.0 [2024-08-06 05:47:34,363][52820] Sum rewards: 76.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.338', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.076', 'weapon5': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:34,461][52669] DAMAGECOUNT value on done: 676076.0 [2024-08-06 05:47:34,462][52669] Sum rewards: 71.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.065', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.180', 'weapon5': '0.204', 'AMMO3': '0.229', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:34,654][52795] DAMAGECOUNT value on done: 628532.0 [2024-08-06 05:47:34,654][52795] Sum rewards: 74.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.144', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.258', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:34,760][52811] DAMAGECOUNT value on done: 624262.0 [2024-08-06 05:47:34,761][52811] Sum rewards: 73.734, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'HEALTH': '0.166', 'AMMO3': '0.176', 'weapon2': '0.366', 'WEAPON3': '1.050', 'HITCOUNT': '3.410', 'weapon3': '3.468', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:34,852][52670] DAMAGECOUNT value on done: 669085.0 [2024-08-06 05:47:34,854][52670] Sum rewards: 70.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.727', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.142', 'weapon5': '0.168', 'AMMO3': '0.232', 'AMMO4': '0.233', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '61.500'} [2024-08-06 05:47:35,201][52666] DAMAGECOUNT value on done: 669052.0 [2024-08-06 05:47:35,202][52666] Sum rewards: 70.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.690', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:36,551][52803] DAMAGECOUNT value on done: 625478.0 [2024-08-06 05:47:36,559][52803] Sum rewards: 70.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.116', 'AMMO4': '0.207', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.390', 'weapon4': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.770', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:36,695][52650] Updated weights for policy 0, policy_version 63861 (0.0012) [2024-08-06 05:47:36,779][52671] DAMAGECOUNT value on done: 675942.0 [2024-08-06 05:47:36,781][52671] Sum rewards: 66.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.095', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.062', 'weapon5': '0.072', 'AMMO4': '0.107', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.650', 'HITCOUNT': '3.300', 'weapon3': '3.344', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '58.500'} [2024-08-06 05:47:36,897][52658] DAMAGECOUNT value on done: 675580.0 [2024-08-06 05:47:36,897][52658] Sum rewards: 72.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.112', 'weapon4': '0.166', 'weapon2': '0.182', 'AMMO3': '0.214', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:36,958][52668] DAMAGECOUNT value on done: 669612.0 [2024-08-06 05:47:36,958][52668] Sum rewards: 80.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.204', 'weapon2': '0.214', 'weapon4': '0.258', 'WEAPON3': '1.200', 'weapon3': '3.310', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '65.000'} [2024-08-06 05:47:37,515][52820] DAMAGECOUNT value on done: 633434.0 [2024-08-06 05:47:37,516][52820] Sum rewards: 85.696, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.525', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.128', 'AMMO4': '0.146', 'weapon5': '0.156', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.022', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.897', 'FRAGCOUNT': '72.000'} [2024-08-06 05:47:37,578][52670] DAMAGECOUNT value on done: 651309.0 [2024-08-06 05:47:37,578][52670] Sum rewards: 81.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO3': '0.185', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '3.130', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:37,791][52669] DAMAGECOUNT value on done: 680537.0 [2024-08-06 05:47:37,792][52669] Sum rewards: 68.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon4': '0.134', 'weapon5': '0.154', 'AMMO3': '0.209', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 523165696. Throughput: 0: 4363.8. Samples: 130795720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:47:37,794][52567] Avg episode reward: [(0, '72.365')] [2024-08-06 05:47:37,874][52666] DAMAGECOUNT value on done: 659596.0 [2024-08-06 05:47:37,877][52811] DAMAGECOUNT value on done: 624690.0 [2024-08-06 05:47:37,877][52811] Sum rewards: 83.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.128', 'weapon4': '0.140', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '69.000'} [2024-08-06 05:47:37,897][52666] Sum rewards: 78.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.146', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.246', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '65.000'} [2024-08-06 05:47:39,478][52671] DAMAGECOUNT value on done: 678426.0 [2024-08-06 05:47:39,478][52671] Sum rewards: 60.767, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.984', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.106', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.312', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '54.000'} [2024-08-06 05:47:39,677][52803] DAMAGECOUNT value on done: 630413.0 [2024-08-06 05:47:39,677][52803] Sum rewards: 61.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'weapon4': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.138', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:39,851][52668] DAMAGECOUNT value on done: 675288.0 [2024-08-06 05:47:39,851][52668] Sum rewards: 79.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.845', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.159', 'weapon2': '0.214', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:39,964][52658] DAMAGECOUNT value on done: 668578.0 [2024-08-06 05:47:39,964][52658] Sum rewards: 67.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.108', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.092', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.240', 'weapon2': '0.344', 'WEAPON3': '1.000', 'weapon3': '3.142', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '53.000'} [2024-08-06 05:47:40,374][52670] DAMAGECOUNT value on done: 663177.0 [2024-08-06 05:47:40,374][52670] Sum rewards: 74.431, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.068', 'AMMO3': '0.177', 'weapon5': '0.188', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:40,512][52820] DAMAGECOUNT value on done: 621613.0 [2024-08-06 05:47:40,512][52820] Sum rewards: 67.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.473', 'AMMO5': '0.015', 'AMMO2': '0.076', 'AMMO3': '0.226', 'weapon2': '0.244', 'weapon4': '0.276', 'weapon5': '0.278', 'AMMO4': '0.378', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '55.000'} [2024-08-06 05:47:40,684][52669] DAMAGECOUNT value on done: 666296.0 [2024-08-06 05:47:40,688][52669] Sum rewards: 74.842, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.036', 'AMMO5': '0.028', 'AMMO2': '0.071', 'AMMO3': '0.251', 'weapon2': '0.258', 'weapon4': '0.284', 'weapon5': '0.318', 'AMMO4': '0.357', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:40,851][52666] DAMAGECOUNT value on done: 665862.0 [2024-08-06 05:47:40,853][52666] Sum rewards: 63.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.186', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon4': '0.200', 'weapon5': '0.204', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 05:47:40,995][52811] DAMAGECOUNT value on done: 629490.0 [2024-08-06 05:47:40,996][52811] Sum rewards: 74.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:41,225][52650] Updated weights for policy 0, policy_version 63871 (0.0025) [2024-08-06 05:47:41,928][52671] DAMAGECOUNT value on done: 674817.0 [2024-08-06 05:47:41,936][52671] Sum rewards: 68.947, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.010', 'AMMO2': '0.030', 'HEALTH': '0.030', 'AMMO4': '0.149', 'weapon4': '0.188', 'weapon5': '0.190', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:42,494][52668] DAMAGECOUNT value on done: 676396.0 [2024-08-06 05:47:42,494][52668] Sum rewards: 75.155, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.927', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.118', 'weapon5': '0.148', 'AMMO3': '0.247', 'AMMO4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.600', 'weapon3': '3.022', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:42,789][52803] DAMAGECOUNT value on done: 631437.0 [2024-08-06 05:47:42,791][52803] Sum rewards: 73.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.255', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '58.000'} [2024-08-06 05:47:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 523255808. Throughput: 0: 4368.9. Samples: 130822020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:47:42,795][52567] Avg episode reward: [(0, '72.290')] [2024-08-06 05:47:43,090][52658] DAMAGECOUNT value on done: 677097.0 [2024-08-06 05:47:43,091][52658] Sum rewards: 76.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.166', 'AMMO3': '0.210', 'weapon5': '0.286', 'AMMO4': '0.316', 'weapon2': '0.324', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '61.500'} [2024-08-06 05:47:43,490][52670] DAMAGECOUNT value on done: 670599.0 [2024-08-06 05:47:43,490][52670] Sum rewards: 79.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.106', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '65.000'} [2024-08-06 05:47:43,778][52666] DAMAGECOUNT value on done: 676670.0 [2024-08-06 05:47:43,779][52666] Sum rewards: 78.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.140', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.144', 'AMMO3': '0.179', 'weapon4': '0.202', 'weapon2': '0.220', 'AMMO4': '0.283', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:43,802][52669] DAMAGECOUNT value on done: 670965.0 [2024-08-06 05:47:43,803][52669] Sum rewards: 66.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.723', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.118', 'weapon5': '0.132', 'AMMO4': '0.135', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 05:47:44,088][52811] DAMAGECOUNT value on done: 633965.0 [2024-08-06 05:47:44,090][52811] Sum rewards: 71.591, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.088', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.186', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:44,584][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:47:45,061][52671] DAMAGECOUNT value on done: 680901.0 [2024-08-06 05:47:45,061][52671] Sum rewards: 78.026, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.090', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.173', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.354', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '68.000'} [2024-08-06 05:47:45,405][52668] DAMAGECOUNT value on done: 676303.0 [2024-08-06 05:47:45,405][52668] Sum rewards: 72.651, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.498', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO3': '0.145', 'AMMO4': '0.199', 'weapon5': '0.314', 'weapon2': '0.434', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.552', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '57.500'} [2024-08-06 05:47:45,811][52650] Updated weights for policy 0, policy_version 63881 (0.0010) [2024-08-06 05:47:45,902][52803] DAMAGECOUNT value on done: 630129.0 [2024-08-06 05:47:45,906][52803] Sum rewards: 72.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.197', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.104', 'AMMO4': '0.141', 'AMMO3': '0.204', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.430', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:45,968][52670] DAMAGECOUNT value on done: 664363.0 [2024-08-06 05:47:45,969][52670] Sum rewards: 85.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.143', 'weapon2': '0.186', 'weapon5': '0.186', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.114', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.856', 'FRAGCOUNT': '66.000'} [2024-08-06 05:47:45,982][52658] DAMAGECOUNT value on done: 661842.0 [2024-08-06 05:47:45,982][52658] Sum rewards: 82.851, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.145', 'weapon5': '0.152', 'HEALTH': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.284', 'weapon4': '0.308', 'WEAPON3': '0.850', 'weapon3': '3.046', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:46,378][52666] DAMAGECOUNT value on done: 656504.0 [2024-08-06 05:47:46,379][52666] Sum rewards: 75.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:46,883][52669] DAMAGECOUNT value on done: 672712.0 [2024-08-06 05:47:46,886][52669] Sum rewards: 73.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.395', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.159', 'weapon4': '0.160', 'AMMO4': '0.180', 'weapon5': '0.230', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '59.500'} [2024-08-06 05:47:47,136][52811] DAMAGECOUNT value on done: 628959.0 [2024-08-06 05:47:47,139][52811] Sum rewards: 76.781, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.181', 'weapon2': '0.226', 'WEAPON3': '1.150', 'HITCOUNT': '3.430', 'weapon3': '3.456', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:47,746][52668] DAMAGECOUNT value on done: 663727.0 [2024-08-06 05:47:47,748][52668] Sum rewards: 83.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.875', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.164', 'weapon4': '0.172', 'weapon5': '0.198', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '67.000'} [2024-08-06 05:47:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 523345920. Throughput: 0: 4377.1. Samples: 130835400. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:47:47,794][52567] Avg episode reward: [(0, '73.392')] [2024-08-06 05:47:48,022][52671] DAMAGECOUNT value on done: 676113.0 [2024-08-06 05:47:48,022][52671] Sum rewards: 83.362, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'weapon4': '0.008', 'AMMO2': '0.017', 'weapon5': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'AMMO3': '0.283', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.374', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '72.500'} [2024-08-06 05:47:48,744][52670] DAMAGECOUNT value on done: 669330.0 [2024-08-06 05:47:48,745][52670] Sum rewards: 75.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.022', 'AMMO2': '0.077', 'AMMO3': '0.175', 'weapon4': '0.214', 'weapon5': '0.352', 'AMMO4': '0.387', 'weapon2': '0.474', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.638', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:48,841][52803] DAMAGECOUNT value on done: 621746.0 [2024-08-06 05:47:48,842][52803] Sum rewards: 86.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'weapon4': '0.094', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.284', 'WEAPON3': '1.200', 'weapon3': '3.392', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '72.000'} [2024-08-06 05:47:48,889][52658] DAMAGECOUNT value on done: 676101.0 [2024-08-06 05:47:48,893][52658] Sum rewards: 65.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon2': '0.148', 'AMMO3': '0.166', 'AMMO4': '0.182', 'weapon7': '0.186', 'WEAPON7': '0.200', 'weapon5': '0.200', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.870', 'WEAPON3': '1.000', 'weapon3': '2.348', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:49,061][52666] DAMAGECOUNT value on done: 665003.0 [2024-08-06 05:47:49,061][52666] Sum rewards: 72.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.140', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.096', 'AMMO4': '0.263', 'AMMO3': '0.264', 'weapon5': '0.308', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.850', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:49,813][52669] DAMAGECOUNT value on done: 693796.0 [2024-08-06 05:47:49,814][52669] Sum rewards: 78.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'AMMO3': '0.217', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.460', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '64.500'} [2024-08-06 05:47:50,192][52811] DAMAGECOUNT value on done: 626651.0 [2024-08-06 05:47:50,193][52811] Sum rewards: 81.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.182', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.154', 'weapon4': '0.160', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:50,484][52650] Updated weights for policy 0, policy_version 63891 (0.0011) [2024-08-06 05:47:50,625][52668] DAMAGECOUNT value on done: 679035.0 [2024-08-06 05:47:50,626][52668] Sum rewards: 59.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.149', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO4': '0.207', 'AMMO3': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.550', 'weapon3': '2.820', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:50,767][52671] DAMAGECOUNT value on done: 661759.0 [2024-08-06 05:47:50,768][52671] Sum rewards: 67.800, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon2': '0.154', 'weapon5': '0.176', 'weapon4': '0.232', 'AMMO4': '0.232', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.118', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:51,080][52649] DAMAGECOUNT value on done: 650621.0 [2024-08-06 05:47:51,080][52649] Sum rewards: 73.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.738', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.128', 'weapon5': '0.128', 'AMMO4': '0.224', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:51,766][52658] DAMAGECOUNT value on done: 670064.0 [2024-08-06 05:47:51,767][52658] Sum rewards: 76.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.096', 'AMMO4': '0.197', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:51,997][52803] DAMAGECOUNT value on done: 620013.0 [2024-08-06 05:47:51,999][52803] Sum rewards: 62.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.106', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.226', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:52,543][52669] DAMAGECOUNT value on done: 679163.0 [2024-08-06 05:47:52,545][52669] Sum rewards: 76.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.025', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.166', 'weapon4': '0.182', 'AMMO3': '0.189', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 523436032. Throughput: 0: 4379.2. Samples: 130861720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:47:52,794][52567] Avg episode reward: [(0, '73.828')] [2024-08-06 05:47:53,326][52662] DAMAGECOUNT value on done: 676644.0 [2024-08-06 05:47:53,326][52662] Sum rewards: 65.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.376', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.096', 'AMMO4': '0.106', 'weapon5': '0.196', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 05:47:53,514][52667] Large shaping reward -2.543 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.294, -98.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:47:53,690][52668] DAMAGECOUNT value on done: 678109.0 [2024-08-06 05:47:53,690][52668] Sum rewards: 75.403, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.589', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.164', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.642', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:53,776][52671] DAMAGECOUNT value on done: 683358.0 [2024-08-06 05:47:53,777][52671] Sum rewards: 71.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.752', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:54,371][52649] DAMAGECOUNT value on done: 643261.0 [2024-08-06 05:47:54,371][52649] Sum rewards: 77.206, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.098', 'weapon5': '0.102', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '62.000'} [2024-08-06 05:47:54,800][52658] DAMAGECOUNT value on done: 671368.0 [2024-08-06 05:47:54,800][52658] Sum rewards: 79.268, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.146', 'weapon5': '0.196', 'AMMO4': '0.202', 'weapon2': '0.292', 'AMMO3': '0.297', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.994', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.555', 'FRAGCOUNT': '68.000'} [2024-08-06 05:47:55,183][52650] Updated weights for policy 0, policy_version 63901 (0.0027) [2024-08-06 05:47:55,186][52669] DAMAGECOUNT value on done: 678087.0 [2024-08-06 05:47:55,186][52669] Sum rewards: 74.581, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.720', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.131', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '61.000'} [2024-08-06 05:47:55,263][52803] DAMAGECOUNT value on done: 619512.0 [2024-08-06 05:47:55,265][52803] Sum rewards: 78.868, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.054', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.142', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:56,084][52662] DAMAGECOUNT value on done: 676926.0 [2024-08-06 05:47:56,086][52662] Sum rewards: 68.856, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.174', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.260', 'AMMO4': '0.261', 'weapon5': '0.334', 'weapon4': '0.372', 'weapon2': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.586', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '60.000'} [2024-08-06 05:47:56,244][52668] DAMAGECOUNT value on done: 668964.0 [2024-08-06 05:47:56,245][52668] Sum rewards: 67.219, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.770', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.126', 'weapon2': '0.176', 'AMMO4': '0.223', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '57.000'} [2024-08-06 05:47:56,783][52671] DAMAGECOUNT value on done: 679962.0 [2024-08-06 05:47:56,783][52671] Sum rewards: 71.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.110', 'AMMO4': '0.117', 'AMMO3': '0.197', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:57,530][52658] DAMAGECOUNT value on done: 675434.0 [2024-08-06 05:47:57,532][52658] Sum rewards: 71.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO2': '0.009', 'AMMO5': '0.014', 'AMMO4': '0.044', 'weapon5': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.164', 'weapon2': '0.238', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '59.000'} [2024-08-06 05:47:57,587][52649] DAMAGECOUNT value on done: 664297.0 [2024-08-06 05:47:57,594][52649] Sum rewards: 85.710, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.214', 'weapon2': '0.308', 'HEALTH': '0.682', 'WEAPON3': '1.000', 'weapon3': '3.114', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '67.000'} [2024-08-06 05:47:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 523509760. Throughput: 0: 4378.9. Samples: 130887820. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:47:57,794][52567] Avg episode reward: [(0, '74.072')] [2024-08-06 05:47:58,206][52669] DAMAGECOUNT value on done: 678682.0 [2024-08-06 05:47:58,206][52669] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.088', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.228', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '63.000'} [2024-08-06 05:47:58,406][52803] DAMAGECOUNT value on done: 623526.0 [2024-08-06 05:47:58,408][52803] Sum rewards: 61.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.334', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.133', 'weapon5': '0.180', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.042', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '52.000'} [2024-08-06 05:47:58,828][52662] DAMAGECOUNT value on done: 683578.0 [2024-08-06 05:47:58,829][52662] Sum rewards: 71.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.422', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.184', 'AMMO3': '0.221', 'AMMO4': '0.231', 'weapon2': '0.330', 'weapon5': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.846', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '59.500'} [2024-08-06 05:47:59,047][52668] DAMAGECOUNT value on done: 671005.0 [2024-08-06 05:47:59,047][52668] Sum rewards: 80.015, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.102', 'HEALTH': '0.115', 'AMMO4': '0.132', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '0.950', 'weapon3': '2.984', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '64.000'} [2024-08-06 05:47:59,714][52671] DAMAGECOUNT value on done: 680402.0 [2024-08-06 05:47:59,715][52671] Sum rewards: 76.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'weapon3': '3.448', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:00,050][52650] Updated weights for policy 0, policy_version 63911 (0.0015) [2024-08-06 05:48:00,623][52649] DAMAGECOUNT value on done: 656644.0 [2024-08-06 05:48:00,624][52649] Sum rewards: 75.127, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.130', 'weapon5': '0.158', 'AMMO4': '0.174', 'weapon2': '0.234', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.212', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:00,643][52669] DAMAGECOUNT value on done: 684723.0 [2024-08-06 05:48:00,644][52669] Sum rewards: 73.353, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.230', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.175', 'weapon5': '0.192', 'AMMO4': '0.252', 'weapon4': '0.282', 'weapon2': '0.448', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.788', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '60.000'} [2024-08-06 05:48:01,505][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:48:01,652][52803] DAMAGECOUNT value on done: 620906.0 [2024-08-06 05:48:01,653][52803] Sum rewards: 89.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.997', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.117', 'weapon5': '0.164', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.231', 'FRAGCOUNT': '74.000'} [2024-08-06 05:48:01,951][52662] DAMAGECOUNT value on done: 669514.0 [2024-08-06 05:48:01,952][52662] Sum rewards: 78.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.055', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.330', 'WEAPON3': '1.000', 'weapon3': '3.186', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:02,153][52668] DAMAGECOUNT value on done: 676577.0 [2024-08-06 05:48:02,154][52668] Sum rewards: 62.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.076', 'AMMO4': '0.136', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.224', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon7': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 05:48:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 523599872. Throughput: 0: 4379.6. Samples: 130901030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 05:48:02,794][52567] Avg episode reward: [(0, '74.374')] [2024-08-06 05:48:02,795][52671] DAMAGECOUNT value on done: 680235.0 [2024-08-06 05:48:02,802][52671] Sum rewards: 75.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.156', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.194', 'weapon5': '0.196', 'AMMO4': '0.230', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.646', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '62.500'} [2024-08-06 05:48:03,707][52649] DAMAGECOUNT value on done: 646566.0 [2024-08-06 05:48:03,708][52649] Sum rewards: 78.301, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.420', 'AMMO5': '0.007', 'weapon4': '0.026', 'AMMO2': '0.029', 'weapon5': '0.078', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.329', 'WEAPON3': '2.050', 'weapon3': '3.454', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '69.000'} [2024-08-06 05:48:04,522][52650] Updated weights for policy 0, policy_version 63921 (0.0013) [2024-08-06 05:48:04,616][52803] DAMAGECOUNT value on done: 637261.0 [2024-08-06 05:48:04,618][52803] Sum rewards: 70.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.028', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '3.370', 'weapon3': '3.472', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '57.000'} [2024-08-06 05:48:04,838][52662] DAMAGECOUNT value on done: 687195.0 [2024-08-06 05:48:04,840][52662] Sum rewards: 72.825, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.026', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'AMMO3': '0.122', 'weapon5': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '0.750', 'weapon3': '2.956', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 05:48:04,887][52668] DAMAGECOUNT value on done: 674088.0 [2024-08-06 05:48:04,888][52668] Sum rewards: 82.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.210', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.334', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '66.000'} [2024-08-06 05:48:05,631][52671] DAMAGECOUNT value on done: 675845.0 [2024-08-06 05:48:05,632][52671] Sum rewards: 72.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.304', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.164', 'weapon5': '0.166', 'AMMO4': '0.225', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon4': '0.968', 'weapon3': '2.380', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 05:48:07,077][52662] DAMAGECOUNT value on done: 666712.0 [2024-08-06 05:48:07,077][52662] Sum rewards: 74.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.990', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.182', 'weapon5': '0.194', 'weapon2': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.836', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '60.500'} [2024-08-06 05:48:07,414][52649] DAMAGECOUNT value on done: 662166.0 [2024-08-06 05:48:07,416][52649] Sum rewards: 74.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.104', 'weapon5': '0.174', 'AMMO3': '0.192', 'AMMO4': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '60.000'} [2024-08-06 05:48:07,788][52803] DAMAGECOUNT value on done: 626454.0 [2024-08-06 05:48:07,788][52803] Sum rewards: 74.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.310', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.110', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '62.000'} [2024-08-06 05:48:07,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 523698176. Throughput: 0: 4372.4. Samples: 130927080. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:07,794][52567] Avg episode reward: [(0, '74.339')] [2024-08-06 05:48:08,019][52668] DAMAGECOUNT value on done: 665087.0 [2024-08-06 05:48:08,020][52668] Sum rewards: 72.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.406', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.060', 'weapon5': '0.150', 'AMMO4': '0.227', 'AMMO3': '0.244', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '62.000'} [2024-08-06 05:48:09,272][52650] Updated weights for policy 0, policy_version 63931 (0.0011) [2024-08-06 05:48:10,247][52649] DAMAGECOUNT value on done: 654335.0 [2024-08-06 05:48:10,247][52649] Sum rewards: 70.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.785', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.166', 'AMMO3': '0.240', 'AMMO4': '0.245', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:10,287][52662] DAMAGECOUNT value on done: 674110.0 [2024-08-06 05:48:10,287][52662] Sum rewards: 66.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.708', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.156', 'weapon5': '0.232', 'AMMO3': '0.238', 'AMMO4': '0.280', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '56.500'} [2024-08-06 05:48:10,888][52803] DAMAGECOUNT value on done: 624621.0 [2024-08-06 05:48:10,890][52803] Sum rewards: 80.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.184', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.162', 'AMMO3': '0.185', 'weapon5': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:11,179][52668] DAMAGECOUNT value on done: 659289.0 [2024-08-06 05:48:11,180][52668] Sum rewards: 71.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.277', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.171', 'weapon5': '0.172', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '57.000'} [2024-08-06 05:48:11,330][52660] DAMAGECOUNT value on done: 673593.0 [2024-08-06 05:48:11,331][52660] Sum rewards: 76.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.931', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.086', 'weapon5': '0.130', 'AMMO4': '0.161', 'weapon2': '0.214', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.280', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '65.000'} [2024-08-06 05:48:12,050][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:48:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.6). Total num frames: 523780096. Throughput: 0: 4376.4. Samples: 130953360. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:12,802][52567] Avg episode reward: [(0, '74.368')] [2024-08-06 05:48:13,216][52662] DAMAGECOUNT value on done: 682649.0 [2024-08-06 05:48:13,218][52662] Sum rewards: 74.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.378', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '62.000'} [2024-08-06 05:48:13,449][52649] DAMAGECOUNT value on done: 658900.0 [2024-08-06 05:48:13,450][52649] Sum rewards: 83.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.162', 'weapon4': '0.204', 'weapon2': '0.206', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '70.000'} [2024-08-06 05:48:13,902][52650] Updated weights for policy 0, policy_version 63941 (0.0028) [2024-08-06 05:48:13,989][52668] DAMAGECOUNT value on done: 660688.0 [2024-08-06 05:48:13,990][52668] Sum rewards: 76.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.535', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.308', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:14,073][52803] DAMAGECOUNT value on done: 638880.0 [2024-08-06 05:48:14,076][52803] Sum rewards: 76.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.215', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.052', 'AMMO4': '0.111', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.500'} [2024-08-06 05:48:14,135][52660] DAMAGECOUNT value on done: 661789.0 [2024-08-06 05:48:14,136][52660] Sum rewards: 69.911, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.352', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon5': '0.198', 'AMMO3': '0.237', 'weapon2': '0.250', 'weapon4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:14,313][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:48:16,356][52662] DAMAGECOUNT value on done: 675291.0 [2024-08-06 05:48:16,358][52662] Sum rewards: 88.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.757', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.122', 'weapon5': '0.134', 'AMMO4': '0.161', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '73.000'} [2024-08-06 05:48:16,822][52668] DAMAGECOUNT value on done: 659984.0 [2024-08-06 05:48:16,822][52668] Sum rewards: 75.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.161', 'weapon5': '0.192', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '62.000'} [2024-08-06 05:48:16,880][52660] DAMAGECOUNT value on done: 675942.0 [2024-08-06 05:48:16,882][52660] Sum rewards: 80.281, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.874', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'weapon2': '0.170', 'AMMO3': '0.229', 'WEAPON3': '1.450', 'weapon3': '3.632', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '67.000'} [2024-08-06 05:48:17,002][52649] DAMAGECOUNT value on done: 658205.0 [2024-08-06 05:48:17,002][52649] Sum rewards: 69.028, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.505', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.196', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '54.000'} [2024-08-06 05:48:17,074][52803] DAMAGECOUNT value on done: 625293.0 [2024-08-06 05:48:17,074][52803] Sum rewards: 57.077, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.993', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.120', 'AMMO3': '0.185', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.433', 'FRAGCOUNT': '46.000'} [2024-08-06 05:48:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 523870208. Throughput: 0: 4380.0. Samples: 130966390. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:17,794][52567] Avg episode reward: [(0, '74.152')] [2024-08-06 05:48:18,568][52650] Updated weights for policy 0, policy_version 63951 (0.0024) [2024-08-06 05:48:19,137][52662] DAMAGECOUNT value on done: 683301.0 [2024-08-06 05:48:19,138][52662] Sum rewards: 65.127, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.038', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.171', 'weapon5': '0.190', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '51.000'} [2024-08-06 05:48:19,622][52668] DAMAGECOUNT value on done: 672842.0 [2024-08-06 05:48:19,622][52668] Sum rewards: 70.347, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.283', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon2': '0.176', 'weapon5': '0.176', 'AMMO4': '0.196', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.200', 'weapon3': '3.326', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:19,656][52660] DAMAGECOUNT value on done: 682202.0 [2024-08-06 05:48:19,658][52660] Sum rewards: 74.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.995', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.072', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '62.000'} [2024-08-06 05:48:19,688][52649] DAMAGECOUNT value on done: 650552.0 [2024-08-06 05:48:19,689][52649] Sum rewards: 81.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '66.000'} [2024-08-06 05:48:20,207][52803] DAMAGECOUNT value on done: 624974.0 [2024-08-06 05:48:20,209][52803] Sum rewards: 75.805, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.354', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.161', 'weapon2': '0.726', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '60.000'} [2024-08-06 05:48:22,166][52662] DAMAGECOUNT value on done: 669580.0 [2024-08-06 05:48:22,166][52662] Sum rewards: 72.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.485', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.095', 'weapon5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:22,341][52662] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:48:22,597][52668] DAMAGECOUNT value on done: 670827.0 [2024-08-06 05:48:22,597][52668] Sum rewards: 81.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.325', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.086', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '67.000'} [2024-08-06 05:48:22,705][52660] DAMAGECOUNT value on done: 667280.0 [2024-08-06 05:48:22,705][52660] Sum rewards: 67.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon5': '0.142', 'AMMO3': '0.220', 'weapon4': '0.234', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.792', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '58.000'} [2024-08-06 05:48:22,790][52649] DAMAGECOUNT value on done: 664421.0 [2024-08-06 05:48:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 523960320. Throughput: 0: 4382.0. Samples: 130992910. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:22,800][52567] Avg episode reward: [(0, '74.321')] [2024-08-06 05:48:22,792][52649] Sum rewards: 74.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.596', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '61.000'} [2024-08-06 05:48:23,204][52803] DAMAGECOUNT value on done: 629483.0 [2024-08-06 05:48:23,206][52803] Sum rewards: 79.913, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.670', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.210', 'AMMO4': '0.212', 'weapon2': '0.324', 'AMMO3': '0.332', 'weapon4': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '2.000', 'weapon3': '2.618', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '73.000'} [2024-08-06 05:48:23,225][52664] DAMAGECOUNT value on done: 697055.0 [2024-08-06 05:48:23,225][52664] Sum rewards: 86.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.172', 'AMMO4': '0.226', 'weapon4': '0.268', 'weapon5': '0.268', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '69.000'} [2024-08-06 05:48:23,571][52650] Updated weights for policy 0, policy_version 63961 (0.0014) [2024-08-06 05:48:25,217][52662] DAMAGECOUNT value on done: 671846.0 [2024-08-06 05:48:25,217][52662] Sum rewards: 67.798, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.667', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.184', 'weapon2': '0.246', 'weapon4': '0.372', 'WEAPON3': '0.750', 'weapon3': '2.946', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '52.000'} [2024-08-06 05:48:25,719][52668] DAMAGECOUNT value on done: 668597.0 [2024-08-06 05:48:25,719][52668] Sum rewards: 83.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.859', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.077', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.200', 'weapon3': '3.496', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '67.000'} [2024-08-06 05:48:25,861][52649] DAMAGECOUNT value on done: 665704.0 [2024-08-06 05:48:25,861][52649] Sum rewards: 66.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.064', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.272', 'weapon2': '0.382', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '52.000'} [2024-08-06 05:48:25,908][52660] DAMAGECOUNT value on done: 666557.0 [2024-08-06 05:48:25,910][52660] Sum rewards: 68.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.249', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.242', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:25,973][52664] DAMAGECOUNT value on done: 704046.0 [2024-08-06 05:48:25,973][52664] Sum rewards: 81.355, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.980', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.192', 'AMMO4': '0.246', 'AMMO3': '0.259', 'weapon4': '0.290', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.786', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '68.000'} [2024-08-06 05:48:26,254][52803] DAMAGECOUNT value on done: 631846.0 [2024-08-06 05:48:26,254][52803] Sum rewards: 72.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.195', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.408', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 524042240. Throughput: 0: 4380.0. Samples: 131019120. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:27,802][52567] Avg episode reward: [(0, '74.345')] [2024-08-06 05:48:27,883][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063971_524050432.pth... [2024-08-06 05:48:27,898][52650] Updated weights for policy 0, policy_version 63971 (0.0010) [2024-08-06 05:48:28,010][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063459_519856128.pth [2024-08-06 05:48:28,292][52662] DAMAGECOUNT value on done: 669723.0 [2024-08-06 05:48:28,294][52662] Sum rewards: 87.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.897', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.155', 'AMMO4': '0.165', 'weapon5': '0.206', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.916', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '71.000'} [2024-08-06 05:48:28,875][52664] DAMAGECOUNT value on done: 700639.0 [2024-08-06 05:48:28,876][52664] Sum rewards: 77.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.928', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.038', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.382', 'WEAPON3': '1.700', 'weapon3': '3.258', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '67.000'} [2024-08-06 05:48:28,894][52668] DAMAGECOUNT value on done: 678521.0 [2024-08-06 05:48:28,894][52668] Sum rewards: 69.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.119', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.104', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '58.000'} [2024-08-06 05:48:29,071][52660] DAMAGECOUNT value on done: 668649.0 [2024-08-06 05:48:29,076][52660] Sum rewards: 77.808, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.555', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon2': '0.246', 'AMMO4': '0.249', 'weapon5': '0.260', 'AMMO3': '0.264', 'weapon4': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.862', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '66.000'} [2024-08-06 05:48:29,163][52649] DAMAGECOUNT value on done: 663318.0 [2024-08-06 05:48:29,163][52649] Sum rewards: 72.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.593', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.094', 'weapon5': '0.176', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '61.000'} [2024-08-06 05:48:29,489][52803] DAMAGECOUNT value on done: 635947.0 [2024-08-06 05:48:29,490][52803] Sum rewards: 77.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.745', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.134', 'AMMO3': '0.204', 'weapon5': '0.222', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '62.000'} [2024-08-06 05:48:30,466][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:48:31,311][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:48:31,327][52662] DAMAGECOUNT value on done: 678955.0 [2024-08-06 05:48:31,328][52662] Sum rewards: 83.923, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.264', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.207', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.510', 'FRAGCOUNT': '70.000'} [2024-08-06 05:48:31,740][52649] DAMAGECOUNT value on done: 661305.0 [2024-08-06 05:48:31,740][52649] Sum rewards: 69.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.203', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.222', 'weapon5': '0.238', 'AMMO3': '0.242', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '58.000'} [2024-08-06 05:48:32,077][52668] DAMAGECOUNT value on done: 673242.0 [2024-08-06 05:48:32,079][52668] Sum rewards: 66.860, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO4': '0.097', 'weapon5': '0.098', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.218', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '56.000'} [2024-08-06 05:48:32,125][52664] DAMAGECOUNT value on done: 693090.0 [2024-08-06 05:48:32,125][52664] Sum rewards: 80.978, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.525', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO3': '0.149', 'AMMO4': '0.154', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.000', 'weapon3': '2.976', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '63.000'} [2024-08-06 05:48:32,204][52660] DAMAGECOUNT value on done: 679887.0 [2024-08-06 05:48:32,204][52660] Sum rewards: 70.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.852', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.214', 'weapon5': '0.240', 'weapon2': '0.250', 'AMMO4': '0.272', 'AMMO3': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.982', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '59.500'} [2024-08-06 05:48:32,625][52803] DAMAGECOUNT value on done: 626406.0 [2024-08-06 05:48:32,628][52803] Sum rewards: 71.880, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.074', 'AMMO4': '0.189', 'AMMO3': '0.190', 'weapon5': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.136', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '58.000'} [2024-08-06 05:48:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 524132352. Throughput: 0: 4364.4. Samples: 131031800. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:32,794][52567] Avg episode reward: [(0, '74.657')] [2024-08-06 05:48:32,796][52650] Updated weights for policy 0, policy_version 63981 (0.0012) [2024-08-06 05:48:34,198][52662] DAMAGECOUNT value on done: 670810.0 [2024-08-06 05:48:34,199][52662] Sum rewards: 78.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.855', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.084', 'weapon5': '0.192', 'AMMO4': '0.261', 'AMMO3': '0.270', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.092', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '67.000'} [2024-08-06 05:48:34,536][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:48:34,674][52649] DAMAGECOUNT value on done: 648220.0 [2024-08-06 05:48:34,676][52649] Sum rewards: 67.353, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.377', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO4': '0.189', 'weapon2': '0.272', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.064', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:34,708][52664] DAMAGECOUNT value on done: 704330.0 [2024-08-06 05:48:34,709][52664] Sum rewards: 78.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.922', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.158', 'AMMO4': '0.164', 'weapon4': '0.188', 'weapon2': '0.190', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:35,297][52660] DAMAGECOUNT value on done: 665780.0 [2024-08-06 05:48:35,298][52660] Sum rewards: 66.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.498', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.052', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.130', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '56.000'} [2024-08-06 05:48:37,041][52666] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:48:37,357][52662] DAMAGECOUNT value on done: 683419.0 [2024-08-06 05:48:37,357][52662] Sum rewards: 80.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.545', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.580', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '65.000'} [2024-08-06 05:48:37,471][52664] DAMAGECOUNT value on done: 697342.0 [2024-08-06 05:48:37,471][52664] Sum rewards: 73.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO3': '0.191', 'AMMO4': '0.213', 'weapon4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '60.500'} [2024-08-06 05:48:37,512][52649] DAMAGECOUNT value on done: 659072.0 [2024-08-06 05:48:37,513][52649] Sum rewards: 84.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.270', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '70.000'} [2024-08-06 05:48:37,535][52650] Updated weights for policy 0, policy_version 63991 (0.0011) [2024-08-06 05:48:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 524214272. Throughput: 0: 4364.0. Samples: 131058100. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:37,794][52567] Avg episode reward: [(0, '74.642')] [2024-08-06 05:48:37,802][52660] DAMAGECOUNT value on done: 669468.0 [2024-08-06 05:48:37,803][52660] Sum rewards: 71.323, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.497', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon4': '0.122', 'AMMO3': '0.249', 'weapon5': '0.270', 'AMMO4': '0.299', 'weapon2': '0.430', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.862', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '60.000'} [2024-08-06 05:48:40,033][52662] DAMAGECOUNT value on done: 679178.0 [2024-08-06 05:48:40,035][52662] Sum rewards: 75.761, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.470', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.076', 'AMMO4': '0.226', 'weapon5': '0.230', 'weapon2': '0.254', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.130', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '66.000'} [2024-08-06 05:48:40,272][52660] DAMAGECOUNT value on done: 675960.0 [2024-08-06 05:48:40,273][52660] Sum rewards: 67.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.168', 'weapon4': '0.176', 'AMMO3': '0.210', 'weapon2': '0.264', 'AMMO4': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.134', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 05:48:40,529][52664] DAMAGECOUNT value on done: 694738.0 [2024-08-06 05:48:40,530][52664] Sum rewards: 74.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.151', 'weapon2': '0.190', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.414', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.000'} [2024-08-06 05:48:40,574][52649] DAMAGECOUNT value on done: 650145.0 [2024-08-06 05:48:40,574][52649] Sum rewards: 70.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.204', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:42,082][52650] Updated weights for policy 0, policy_version 64001 (0.0024) [2024-08-06 05:48:42,774][52660] DAMAGECOUNT value on done: 667788.0 [2024-08-06 05:48:42,776][52660] Sum rewards: 76.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.408', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.209', 'weapon5': '0.216', 'weapon2': '0.272', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 524312576. Throughput: 0: 4369.8. Samples: 131084460. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 05:48:42,794][52567] Avg episode reward: [(0, '74.321')] [2024-08-06 05:48:42,839][52662] DAMAGECOUNT value on done: 664204.0 [2024-08-06 05:48:42,841][52662] Sum rewards: 75.175, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.520', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon2': '0.196', 'AMMO4': '0.293', 'weapon5': '0.312', 'AMMO3': '0.336', 'weapon4': '0.474', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.900', 'weapon3': '2.574', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '65.000'} [2024-08-06 05:48:43,467][52664] DAMAGECOUNT value on done: 690981.0 [2024-08-06 05:48:43,468][52664] Sum rewards: 75.847, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.325', 'AMMO5': '0.032', 'AMMO2': '0.071', 'AMMO3': '0.214', 'weapon4': '0.226', 'weapon2': '0.252', 'weapon5': '0.308', 'AMMO4': '0.357', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:43,542][52649] DAMAGECOUNT value on done: 663290.0 [2024-08-06 05:48:43,543][52649] Sum rewards: 73.884, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.209', 'weapon4': '0.218', 'weapon5': '0.286', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '60.000'} [2024-08-06 05:48:43,579][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:48:45,403][52660] DAMAGECOUNT value on done: 669956.0 [2024-08-06 05:48:45,412][52660] Sum rewards: 79.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.156', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:45,794][52662] DAMAGECOUNT value on done: 673236.0 [2024-08-06 05:48:45,796][52662] Sum rewards: 70.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.024', 'AMMO2': '0.044', 'weapon4': '0.136', 'AMMO3': '0.206', 'AMMO4': '0.222', 'weapon5': '0.236', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:45,957][52664] DAMAGECOUNT value on done: 704398.0 [2024-08-06 05:48:45,960][52664] Sum rewards: 68.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.170', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.758', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '57.000'} [2024-08-06 05:48:46,587][52650] Updated weights for policy 0, policy_version 64011 (0.0020) [2024-08-06 05:48:46,654][52649] DAMAGECOUNT value on done: 662706.0 [2024-08-06 05:48:46,657][52649] Sum rewards: 77.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.083', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '64.000'} [2024-08-06 05:48:47,360][52659] DAMAGECOUNT value on done: 677388.0 [2024-08-06 05:48:47,361][52659] Sum rewards: 68.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.138', 'weapon4': '0.144', 'AMMO4': '0.191', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.160', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '57.000'} [2024-08-06 05:48:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 524394496. Throughput: 0: 4372.0. Samples: 131097770. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:48:47,794][52567] Avg episode reward: [(0, '74.351')] [2024-08-06 05:48:47,889][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:48:48,317][52660] DAMAGECOUNT value on done: 681024.0 [2024-08-06 05:48:48,317][52660] Sum rewards: 60.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.223', 'weapon2': '0.398', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.446', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '53.000'} [2024-08-06 05:48:48,843][52664] DAMAGECOUNT value on done: 695902.0 [2024-08-06 05:48:48,843][52664] Sum rewards: 72.368, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.610', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.186', 'weapon4': '0.202', 'AMMO3': '0.219', 'AMMO4': '0.260', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '60.000'} [2024-08-06 05:48:48,894][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:48:48,921][52662] DAMAGECOUNT value on done: 666901.0 [2024-08-06 05:48:48,921][52662] Sum rewards: 69.646, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.036', 'AMMO4': '0.153', 'weapon4': '0.176', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '61.000'} [2024-08-06 05:48:49,681][52649] DAMAGECOUNT value on done: 656726.0 [2024-08-06 05:48:49,681][52649] Sum rewards: 72.785, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.526', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.160', 'AMMO3': '0.198', 'AMMO4': '0.239', 'weapon4': '0.318', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '61.000'} [2024-08-06 05:48:50,164][52659] DAMAGECOUNT value on done: 673821.0 [2024-08-06 05:48:50,166][52659] Sum rewards: 75.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.155', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.172', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.710', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '62.000'} [2024-08-06 05:48:51,010][52660] DAMAGECOUNT value on done: 688525.0 [2024-08-06 05:48:51,019][52660] Sum rewards: 73.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.995', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '60.000'} [2024-08-06 05:48:51,122][52650] Updated weights for policy 0, policy_version 64021 (0.0010) [2024-08-06 05:48:51,547][52664] DAMAGECOUNT value on done: 703499.0 [2024-08-06 05:48:51,548][52664] Sum rewards: 73.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.055', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.168', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'HITCOUNT': '3.400', 'weapon3': '3.574', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '63.000'} [2024-08-06 05:48:52,734][52659] DAMAGECOUNT value on done: 678425.0 [2024-08-06 05:48:52,739][52659] Sum rewards: 61.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.898', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.150', 'AMMO3': '0.219', 'AMMO4': '0.221', 'weapon5': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.746', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '52.000'} [2024-08-06 05:48:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 524484608. Throughput: 0: 4378.7. Samples: 131124120. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:48:52,794][52567] Avg episode reward: [(0, '74.115')] [2024-08-06 05:48:54,115][52660] DAMAGECOUNT value on done: 668286.0 [2024-08-06 05:48:54,117][52660] Sum rewards: 69.489, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.956', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon2': '0.216', 'weapon4': '0.220', 'AMMO4': '0.226', 'weapon5': '0.256', 'AMMO3': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '59.000'} [2024-08-06 05:48:54,163][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:48:54,938][52664] DAMAGECOUNT value on done: 706051.0 [2024-08-06 05:48:54,939][52664] Sum rewards: 81.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.234', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.180', 'AMMO4': '0.203', 'AMMO3': '0.246', 'weapon4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '2.796', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '68.000'} [2024-08-06 05:48:55,822][52659] DAMAGECOUNT value on done: 673463.0 [2024-08-06 05:48:55,824][52659] Sum rewards: 80.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.523', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'AMMO4': '0.227', 'weapon2': '0.238', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '67.000'} [2024-08-06 05:48:56,037][52650] Updated weights for policy 0, policy_version 64031 (0.0011) [2024-08-06 05:48:56,776][52660] DAMAGECOUNT value on done: 678303.0 [2024-08-06 05:48:56,777][52660] Sum rewards: 79.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.315', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.152', 'weapon5': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.312', 'weapon2': '0.524', 'WEAPON3': '0.950', 'weapon3': '2.764', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '63.000'} [2024-08-06 05:48:57,681][52664] DAMAGECOUNT value on done: 703864.0 [2024-08-06 05:48:57,682][52664] Sum rewards: 78.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.908', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO4': '0.133', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '63.000'} [2024-08-06 05:48:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 524566528. Throughput: 0: 4382.4. Samples: 131150570. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:48:57,795][52567] Avg episode reward: [(0, '74.398')] [2024-08-06 05:48:58,511][52659] DAMAGECOUNT value on done: 671271.0 [2024-08-06 05:48:58,512][52659] Sum rewards: 88.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.443', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.170', 'AMMO3': '0.176', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '71.000'} [2024-08-06 05:48:59,685][52660] DAMAGECOUNT value on done: 671812.0 [2024-08-06 05:48:59,687][52660] Sum rewards: 75.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.088', 'weapon4': '0.120', 'AMMO4': '0.161', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '63.000'} [2024-08-06 05:49:00,453][52667] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:49:00,907][52664] DAMAGECOUNT value on done: 705218.0 [2024-08-06 05:49:00,907][52664] Sum rewards: 72.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.222', 'AMMO4': '0.231', 'weapon4': '0.246', 'weapon5': '0.252', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.732', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 05:49:00,949][52650] Updated weights for policy 0, policy_version 64041 (0.0035) [2024-08-06 05:49:01,183][52659] DAMAGECOUNT value on done: 678200.0 [2024-08-06 05:49:01,184][52659] Sum rewards: 76.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.124', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:02,486][52660] DAMAGECOUNT value on done: 668975.0 [2024-08-06 05:49:02,488][52660] Sum rewards: 77.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.765', 'AMMO2': '0.015', 'AMMO5': '0.017', 'weapon4': '0.038', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 05:49:02,748][52665] DAMAGECOUNT value on done: 660633.0 [2024-08-06 05:49:02,748][52665] Sum rewards: 71.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.806', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.134', 'weapon4': '0.154', 'AMMO4': '0.216', 'AMMO3': '0.236', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 524656640. Throughput: 0: 4387.3. Samples: 131163820. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:49:02,794][52567] Avg episode reward: [(0, '74.612')] [2024-08-06 05:49:03,447][52664] DAMAGECOUNT value on done: 708641.0 [2024-08-06 05:49:03,447][52664] Sum rewards: 78.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.915', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.028', 'AMMO4': '0.122', 'weapon5': '0.134', 'weapon2': '0.180', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '66.000'} [2024-08-06 05:49:04,012][52659] DAMAGECOUNT value on done: 674995.0 [2024-08-06 05:49:04,013][52659] Sum rewards: 74.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.746', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'weapon4': '0.142', 'AMMO3': '0.266', 'weapon2': '0.506', 'WEAPON3': '1.650', 'weapon3': '3.060', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '63.000'} [2024-08-06 05:49:04,974][52660] DAMAGECOUNT value on done: 663438.0 [2024-08-06 05:49:04,975][52660] Sum rewards: 72.138, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.650', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.148', 'weapon2': '0.388', 'WEAPON3': '0.950', 'HITCOUNT': '3.290', 'weapon3': '3.506', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '57.000'} [2024-08-06 05:49:05,218][52650] Updated weights for policy 0, policy_version 64051 (0.0019) [2024-08-06 05:49:05,612][52665] DAMAGECOUNT value on done: 677868.0 [2024-08-06 05:49:05,613][52665] Sum rewards: 78.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.763', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.116', 'weapon4': '0.160', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '64.000'} [2024-08-06 05:49:06,061][52664] DAMAGECOUNT value on done: 701573.0 [2024-08-06 05:49:06,062][52664] Sum rewards: 71.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.013', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.110', 'weapon4': '0.176', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.706', 'WEAPON3': '1.200', 'weapon3': '2.792', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '60.000'} [2024-08-06 05:49:07,007][52659] DAMAGECOUNT value on done: 670399.0 [2024-08-06 05:49:07,009][52659] Sum rewards: 82.001, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.106', 'AMMO4': '0.117', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '0.950', 'weapon3': '3.202', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '65.000'} [2024-08-06 05:49:07,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 524746752. Throughput: 0: 4374.9. Samples: 131189780. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:49:07,802][52567] Avg episode reward: [(0, '74.636')] [2024-08-06 05:49:08,702][52665] DAMAGECOUNT value on done: 673948.0 [2024-08-06 05:49:08,704][52665] Sum rewards: 63.044, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.258', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.148', 'weapon5': '0.158', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.130', 'weapon3': '3.198', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2024-08-06 05:49:08,937][52664] DAMAGECOUNT value on done: 696487.0 [2024-08-06 05:49:08,938][52664] Sum rewards: 74.949, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.076', 'AMMO3': '0.216', 'AMMO4': '0.219', 'weapon5': '0.232', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:10,133][52650] Updated weights for policy 0, policy_version 64061 (0.0015) [2024-08-06 05:49:10,286][52659] DAMAGECOUNT value on done: 677731.0 [2024-08-06 05:49:10,286][52659] Sum rewards: 86.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.263', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.023', 'WEAPON5': '0.050', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.294', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '72.000'} [2024-08-06 05:49:10,492][52794] DAMAGECOUNT value on done: 674573.0 [2024-08-06 05:49:10,493][52794] Sum rewards: 66.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.833', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'AMMO3': '0.211', 'weapon2': '0.248', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.648', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '55.000'} [2024-08-06 05:49:10,913][52667] DAMAGECOUNT value on done: 675581.0 [2024-08-06 05:49:10,914][52667] Sum rewards: 83.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.353', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.044', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.166', 'weapon2': '0.728', 'WEAPON3': '0.950', 'weapon3': '2.924', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '67.000'} [2024-08-06 05:49:11,726][52664] DAMAGECOUNT value on done: 700173.0 [2024-08-06 05:49:11,727][52664] Sum rewards: 77.925, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.158', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '60.000'} [2024-08-06 05:49:11,766][52665] DAMAGECOUNT value on done: 668595.0 [2024-08-06 05:49:11,767][52665] Sum rewards: 70.164, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.194', 'weapon4': '0.230', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '56.000'} [2024-08-06 05:49:12,358][52666] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:49:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 524828672. Throughput: 0: 4374.0. Samples: 131215950. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:49:12,794][52567] Avg episode reward: [(0, '74.584')] [2024-08-06 05:49:12,814][52794] DAMAGECOUNT value on done: 681823.0 [2024-08-06 05:49:12,814][52794] Sum rewards: 70.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.758', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.299', 'weapon2': '0.342', 'WEAPON3': '1.650', 'weapon3': '3.230', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 05:49:13,674][52659] DAMAGECOUNT value on done: 681744.0 [2024-08-06 05:49:13,674][52659] Sum rewards: 76.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.247', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 05:49:13,724][52667] DAMAGECOUNT value on done: 682787.0 [2024-08-06 05:49:13,725][52667] Sum rewards: 76.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.167', 'weapon5': '0.246', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON3': '1.100', 'weapon3': '2.798', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 05:49:14,347][52664] DAMAGECOUNT value on done: 699234.0 [2024-08-06 05:49:14,349][52664] Sum rewards: 64.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.910', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.184', 'weapon2': '0.196', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'WEAPON4': '0.350', 'WEAPON3': '1.900', 'HITCOUNT': '3.180', 'weapon3': '3.258', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '58.000'} [2024-08-06 05:49:14,448][52795] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:49:14,847][52650] Updated weights for policy 0, policy_version 64071 (0.0023) [2024-08-06 05:49:14,893][52665] DAMAGECOUNT value on done: 656474.0 [2024-08-06 05:49:14,896][52665] Sum rewards: 70.645, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.254', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.060', 'weapon4': '0.132', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.300', 'AMMO3': '0.315', 'WEAPON3': '1.800', 'weapon3': '3.180', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '64.000'} [2024-08-06 05:49:15,301][52794] DAMAGECOUNT value on done: 683561.0 [2024-08-06 05:49:15,302][52794] Sum rewards: 77.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.567', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '64.000'} [2024-08-06 05:49:16,615][52659] DAMAGECOUNT value on done: 670861.0 [2024-08-06 05:49:16,616][52659] Sum rewards: 66.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.095', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.036', 'AMMO4': '0.125', 'weapon5': '0.142', 'WEAPON4': '0.250', 'weapon2': '0.264', 'AMMO3': '0.295', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '3.110', 'weapon3': '3.300', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.500'} [2024-08-06 05:49:17,000][52667] DAMAGECOUNT value on done: 677587.0 [2024-08-06 05:49:17,001][52667] Sum rewards: 78.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.760', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.128', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon4': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.072', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '67.000'} [2024-08-06 05:49:17,013][52664] DAMAGECOUNT value on done: 698720.0 [2024-08-06 05:49:17,014][52664] Sum rewards: 78.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.208', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.168', 'AMMO3': '0.207', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '65.000'} [2024-08-06 05:49:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 524918784. Throughput: 0: 4383.8. Samples: 131229070. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:49:17,802][52567] Avg episode reward: [(0, '74.557')] [2024-08-06 05:49:17,836][52794] DAMAGECOUNT value on done: 672022.0 [2024-08-06 05:49:17,838][52794] Sum rewards: 68.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.737', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.195', 'weapon2': '0.206', 'AMMO4': '0.223', 'weapon5': '0.228', 'WEAPON5': '0.500', 'weapon4': '0.542', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.694', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '58.000'} [2024-08-06 05:49:18,151][52665] DAMAGECOUNT value on done: 663290.0 [2024-08-06 05:49:18,153][52665] Sum rewards: 74.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.925', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.153', 'weapon4': '0.158', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.000', 'weapon3': '3.038', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '59.000'} [2024-08-06 05:49:19,546][52650] Updated weights for policy 0, policy_version 64081 (0.0021) [2024-08-06 05:49:19,694][52659] DAMAGECOUNT value on done: 680418.0 [2024-08-06 05:49:19,697][52659] Sum rewards: 71.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.070', 'weapon4': '0.128', 'AMMO3': '0.142', 'AMMO4': '0.162', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '0.950', 'weapon3': '3.156', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '58.000'} [2024-08-06 05:49:19,789][52667] DAMAGECOUNT value on done: 680108.0 [2024-08-06 05:49:19,790][52667] Sum rewards: 65.766, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon4': '0.192', 'AMMO3': '0.218', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '56.000'} [2024-08-06 05:49:21,149][52794] DAMAGECOUNT value on done: 672849.0 [2024-08-06 05:49:21,149][52794] Sum rewards: 74.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.454', 'AMMO5': '0.004', 'weapon5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.232', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:21,523][52665] DAMAGECOUNT value on done: 668169.0 [2024-08-06 05:49:21,524][52665] Sum rewards: 74.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.140', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.084', 'weapon4': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:22,222][52667] DAMAGECOUNT value on done: 681096.0 [2024-08-06 05:49:22,223][52667] Sum rewards: 59.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.099', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.544', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.028', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '49.000'} [2024-08-06 05:49:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 525008896. Throughput: 0: 4374.7. Samples: 131254960. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 05:49:22,794][52567] Avg episode reward: [(0, '73.942')] [2024-08-06 05:49:22,799][52659] DAMAGECOUNT value on done: 673589.0 [2024-08-06 05:49:22,802][52659] Sum rewards: 63.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.531', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.450', 'weapon4': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.730', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '53.000'} [2024-08-06 05:49:24,311][52650] Updated weights for policy 0, policy_version 64091 (0.0028) [2024-08-06 05:49:24,446][52794] DAMAGECOUNT value on done: 675216.0 [2024-08-06 05:49:24,449][52794] Sum rewards: 72.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.092', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '61.000'} [2024-08-06 05:49:24,507][52665] DAMAGECOUNT value on done: 666087.0 [2024-08-06 05:49:24,509][52665] Sum rewards: 79.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.062', 'AMMO4': '0.089', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '68.000'} [2024-08-06 05:49:24,862][52667] DAMAGECOUNT value on done: 684676.0 [2024-08-06 05:49:24,862][52667] Sum rewards: 59.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.452', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.112', 'weapon4': '0.158', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '52.000'} [2024-08-06 05:49:25,793][52659] DAMAGECOUNT value on done: 675641.0 [2024-08-06 05:49:25,793][52659] Sum rewards: 74.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:27,219][52665] DAMAGECOUNT value on done: 676115.0 [2024-08-06 05:49:27,219][52665] Sum rewards: 57.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO4': '0.169', 'weapon5': '0.230', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.148', 'DAMAGECOUNT': '14.040', 'FRAGCOUNT': '50.000'} [2024-08-06 05:49:27,623][52794] DAMAGECOUNT value on done: 680904.0 [2024-08-06 05:49:27,623][52794] Sum rewards: 85.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.024', 'AMMO4': '0.068', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.346', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.550', 'FRAGCOUNT': '72.000'} [2024-08-06 05:49:27,661][52667] DAMAGECOUNT value on done: 679965.0 [2024-08-06 05:49:27,661][52667] Sum rewards: 79.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.185', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.134', 'AMMO4': '0.211', 'AMMO3': '0.221', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '66.000'} [2024-08-06 05:49:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 525090816. Throughput: 0: 4367.8. Samples: 131281010. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:49:27,794][52567] Avg episode reward: [(0, '74.020')] [2024-08-06 05:49:28,586][52659] DAMAGECOUNT value on done: 685738.0 [2024-08-06 05:49:28,587][52659] Sum rewards: 71.364, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.142', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '59.000'} [2024-08-06 05:49:29,003][52650] Updated weights for policy 0, policy_version 64101 (0.0042) [2024-08-06 05:49:30,213][52665] DAMAGECOUNT value on done: 667068.0 [2024-08-06 05:49:30,213][52665] Sum rewards: 67.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '57.500'} [2024-08-06 05:49:30,838][52667] DAMAGECOUNT value on done: 677378.0 [2024-08-06 05:49:30,838][52667] Sum rewards: 75.121, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.023', 'AMMO2': '0.036', 'weapon4': '0.100', 'AMMO3': '0.174', 'AMMO4': '0.179', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '60.000'} [2024-08-06 05:49:30,962][52794] DAMAGECOUNT value on done: 667908.0 [2024-08-06 05:49:30,963][52794] Sum rewards: 75.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.062', 'AMMO4': '0.086', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '60.000'} [2024-08-06 05:49:31,400][52659] DAMAGECOUNT value on done: 677235.0 [2024-08-06 05:49:31,400][52659] Sum rewards: 64.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.836', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.764', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '54.000'} [2024-08-06 05:49:32,584][52665] DAMAGECOUNT value on done: 675863.0 [2024-08-06 05:49:32,584][52665] Sum rewards: 74.963, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.183', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.236', 'weapon2': '0.258', 'AMMO3': '0.286', 'WEAPON3': '1.750', 'weapon3': '3.218', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '66.000'} [2024-08-06 05:49:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 525180928. Throughput: 0: 4358.7. Samples: 131293910. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:49:32,795][52567] Avg episode reward: [(0, '73.738')] [2024-08-06 05:49:33,226][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:49:33,589][52667] DAMAGECOUNT value on done: 682499.0 [2024-08-06 05:49:33,591][52667] Sum rewards: 80.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'weapon5': '0.002', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.352', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '66.000'} [2024-08-06 05:49:33,759][52659] DAMAGECOUNT value on done: 682364.0 [2024-08-06 05:49:33,759][52659] Sum rewards: 81.616, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.084', 'AMMO3': '0.170', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '65.000'} [2024-08-06 05:49:33,952][52650] Updated weights for policy 0, policy_version 64111 (0.0065) [2024-08-06 05:49:33,972][52794] DAMAGECOUNT value on done: 680880.0 [2024-08-06 05:49:33,973][52794] Sum rewards: 75.126, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.715', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.084', 'AMMO4': '0.138', 'AMMO3': '0.245', 'weapon2': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '66.000'} [2024-08-06 05:49:34,853][52614] Signal inference workers to stop experience collection... (11650 times) [2024-08-06 05:49:34,861][52614] Signal inference workers to resume experience collection... (11650 times) [2024-08-06 05:49:34,942][52650] InferenceWorker_p0-w0: stopping experience collection (11650 times) [2024-08-06 05:49:34,942][52650] InferenceWorker_p0-w0: resuming experience collection (11650 times) [2024-08-06 05:49:34,953][52665] DAMAGECOUNT value on done: 673155.0 [2024-08-06 05:49:34,954][52665] Sum rewards: 72.480, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.905', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.088', 'AMMO4': '0.158', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.700', 'weapon3': '3.100', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '63.000'} [2024-08-06 05:49:36,421][52660] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:49:36,439][52659] DAMAGECOUNT value on done: 671058.0 [2024-08-06 05:49:36,439][52659] Sum rewards: 81.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.116', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon4': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '66.000'} [2024-08-06 05:49:36,784][52667] DAMAGECOUNT value on done: 685814.0 [2024-08-06 05:49:36,788][52667] Sum rewards: 70.493, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.650', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.156', 'AMMO4': '0.175', 'weapon2': '0.218', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '58.000'} [2024-08-06 05:49:36,799][52794] DAMAGECOUNT value on done: 670668.0 [2024-08-06 05:49:36,802][52794] Sum rewards: 78.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.084', 'weapon4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '65.000'} [2024-08-06 05:49:36,833][52647] DAMAGECOUNT value on done: 716516.0 [2024-08-06 05:49:36,834][52647] Sum rewards: 80.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.210', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '3.510', 'weapon3': '3.512', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '67.000'} [2024-08-06 05:49:37,108][52658] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0)] [2024-08-06 05:49:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 525262848. Throughput: 0: 4360.9. Samples: 131320360. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:49:37,795][52567] Avg episode reward: [(0, '73.883')] [2024-08-06 05:49:37,884][52665] DAMAGECOUNT value on done: 671852.0 [2024-08-06 05:49:37,884][52665] Sum rewards: 76.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.008', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.182', 'AMMO3': '0.207', 'weapon4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.834', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '65.000'} [2024-08-06 05:49:38,279][52650] Updated weights for policy 0, policy_version 64121 (0.0013) [2024-08-06 05:49:39,124][52659] DAMAGECOUNT value on done: 683180.0 [2024-08-06 05:49:39,125][52659] Sum rewards: 75.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.815', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.192', 'AMMO3': '0.194', 'weapon4': '0.312', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '60.000'} [2024-08-06 05:49:39,612][52647] DAMAGECOUNT value on done: 708105.0 [2024-08-06 05:49:39,612][52647] Sum rewards: 72.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.204', 'weapon2': '0.208', 'AMMO4': '0.219', 'weapon4': '0.222', 'weapon5': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '59.000'} [2024-08-06 05:49:39,851][52667] DAMAGECOUNT value on done: 674750.0 [2024-08-06 05:49:39,851][52667] Sum rewards: 80.480, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.027', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.232', 'AMMO3': '0.299', 'WEAPON3': '1.800', 'weapon3': '3.452', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '71.000'} [2024-08-06 05:49:39,991][52794] DAMAGECOUNT value on done: 669318.0 [2024-08-06 05:49:39,994][52794] Sum rewards: 74.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.639', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.059', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:40,867][52665] DAMAGECOUNT value on done: 666782.0 [2024-08-06 05:49:40,871][52665] Sum rewards: 77.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.860', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.406', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '66.000'} [2024-08-06 05:49:41,567][52664] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:49:41,619][52659] DAMAGECOUNT value on done: 673984.0 [2024-08-06 05:49:41,621][52659] Sum rewards: 68.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.886', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon5': '0.090', 'AMMO3': '0.175', 'WEAPON5': '0.300', 'AMMO4': '0.312', 'weapon4': '0.316', 'WEAPON4': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '56.000'} [2024-08-06 05:49:42,538][52647] DAMAGECOUNT value on done: 714128.0 [2024-08-06 05:49:42,539][52647] Sum rewards: 96.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.861', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.334', 'WEAPON3': '1.050', 'weapon3': '3.296', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '22.443', 'FRAGCOUNT': '77.000'} [2024-08-06 05:49:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 525352960. Throughput: 0: 4356.9. Samples: 131346630. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:49:42,794][52567] Avg episode reward: [(0, '74.104')] [2024-08-06 05:49:42,916][52794] DAMAGECOUNT value on done: 678011.0 [2024-08-06 05:49:42,916][52794] Sum rewards: 77.810, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.504', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.104', 'weapon4': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.188', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'weapon3': '3.388', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '65.500'} [2024-08-06 05:49:42,947][52667] DAMAGECOUNT value on done: 675766.0 [2024-08-06 05:49:42,947][52667] Sum rewards: 80.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.160', 'AMMO3': '0.170', 'weapon5': '0.182', 'AMMO4': '0.188', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '64.000'} [2024-08-06 05:49:43,171][52650] Updated weights for policy 0, policy_version 64131 (0.0015) [2024-08-06 05:49:43,970][52665] DAMAGECOUNT value on done: 665952.0 [2024-08-06 05:49:43,970][52665] Sum rewards: 68.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'weapon5': '0.004', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.346', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.470', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '57.000'} [2024-08-06 05:49:44,784][52647] DAMAGECOUNT value on done: 714051.0 [2024-08-06 05:49:44,786][52647] Sum rewards: 85.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.090', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '70.000'} [2024-08-06 05:49:45,845][52794] DAMAGECOUNT value on done: 672283.0 [2024-08-06 05:49:45,846][52794] Sum rewards: 71.352, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.156', 'weapon2': '0.188', 'weapon4': '0.286', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.070', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:46,118][52667] DAMAGECOUNT value on done: 681537.0 [2024-08-06 05:49:46,119][52667] Sum rewards: 75.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.214', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon4': '0.290', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '61.000'} [2024-08-06 05:49:47,042][52665] DAMAGECOUNT value on done: 667137.0 [2024-08-06 05:49:47,042][52665] Sum rewards: 71.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.195', 'weapon5': '0.196', 'AMMO4': '0.232', 'weapon4': '0.320', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '59.500'} [2024-08-06 05:49:47,587][52647] DAMAGECOUNT value on done: 720504.0 [2024-08-06 05:49:47,588][52647] Sum rewards: 65.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO5': '0.016', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.111', 'weapon5': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'weapon2': '0.384', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.046', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '58.000'} [2024-08-06 05:49:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 525434880. Throughput: 0: 4356.0. Samples: 131359840. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:49:47,794][52567] Avg episode reward: [(0, '74.070')] [2024-08-06 05:49:48,039][52650] Updated weights for policy 0, policy_version 64141 (0.0025) [2024-08-06 05:49:48,883][52794] DAMAGECOUNT value on done: 686886.0 [2024-08-06 05:49:48,884][52794] Sum rewards: 79.386, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.038', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.590', 'WEAPON3': '1.050', 'weapon3': '3.248', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '63.000'} [2024-08-06 05:49:49,004][52667] DAMAGECOUNT value on done: 673135.0 [2024-08-06 05:49:49,005][52667] Sum rewards: 77.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.830', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.138', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.366', 'weapon2': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 05:49:49,779][52665] DAMAGECOUNT value on done: 667000.0 [2024-08-06 05:49:49,781][52665] Sum rewards: 63.428, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.133', 'weapon5': '0.138', 'AMMO3': '0.160', 'HEALTH': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.702', 'WEAPON3': '0.900', 'weapon3': '2.910', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '51.000'} [2024-08-06 05:49:50,079][52663] DAMAGECOUNT value on done: 687332.0 [2024-08-06 05:49:50,081][52663] Sum rewards: 77.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO4': '0.148', 'AMMO3': '0.218', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '64.000'} [2024-08-06 05:49:50,592][52647] DAMAGECOUNT value on done: 718505.0 [2024-08-06 05:49:50,592][52647] Sum rewards: 69.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.170', 'AMMO3': '0.179', 'weapon5': '0.210', 'AMMO4': '0.221', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 05:49:52,074][52794] DAMAGECOUNT value on done: 669440.0 [2024-08-06 05:49:52,074][52794] Sum rewards: 75.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.789', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.132', 'weapon5': '0.176', 'AMMO4': '0.185', 'AMMO3': '0.211', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:52,182][52650] Updated weights for policy 0, policy_version 64151 (0.0014) [2024-08-06 05:49:52,258][52667] DAMAGECOUNT value on done: 680690.0 [2024-08-06 05:49:52,260][52667] Sum rewards: 65.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.186', 'weapon5': '0.192', 'AMMO4': '0.222', 'weapon4': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.730', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '52.500'} [2024-08-06 05:49:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 525533184. Throughput: 0: 4363.3. Samples: 131386130. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:49:52,794][52567] Avg episode reward: [(0, '74.038')] [2024-08-06 05:49:52,953][52665] DAMAGECOUNT value on done: 662326.0 [2024-08-06 05:49:52,955][52665] Sum rewards: 78.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.340', 'weapon4': '0.384', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '64.000'} [2024-08-06 05:49:52,985][52647] DAMAGECOUNT value on done: 715571.0 [2024-08-06 05:49:52,986][52647] Sum rewards: 77.279, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.015', 'AMMO5': '0.026', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon5': '0.158', 'AMMO3': '0.163', 'AMMO4': '0.203', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '63.500'} [2024-08-06 05:49:53,136][52663] DAMAGECOUNT value on done: 675424.0 [2024-08-06 05:49:53,136][52663] Sum rewards: 71.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.116', 'AMMO3': '0.233', 'weapon5': '0.254', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '2.936', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '60.000'} [2024-08-06 05:49:54,781][52794] DAMAGECOUNT value on done: 683842.0 [2024-08-06 05:49:54,782][52794] Sum rewards: 67.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.082', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.080', 'weapon5': '0.142', 'AMMO3': '0.185', 'weapon2': '0.234', 'AMMO4': '0.252', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.282', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '57.000'} [2024-08-06 05:49:55,465][52667] DAMAGECOUNT value on done: 686455.0 [2024-08-06 05:49:55,466][52667] Sum rewards: 70.324, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.495', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'weapon5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.378', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '61.000'} [2024-08-06 05:49:55,639][52647] DAMAGECOUNT value on done: 698714.0 [2024-08-06 05:49:55,641][52647] Sum rewards: 74.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.022', 'AMMO4': '0.092', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '62.000'} [2024-08-06 05:49:55,986][52665] DAMAGECOUNT value on done: 665790.0 [2024-08-06 05:49:55,987][52665] Sum rewards: 64.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.199', 'AMMO3': '0.214', 'weapon5': '0.334', 'weapon2': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.300', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '53.000'} [2024-08-06 05:49:56,196][52663] DAMAGECOUNT value on done: 669565.0 [2024-08-06 05:49:56,197][52663] Sum rewards: 72.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.628', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.266', 'weapon4': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '59.500'} [2024-08-06 05:49:57,159][52650] Updated weights for policy 0, policy_version 64161 (0.0019) [2024-08-06 05:49:57,531][52794] DAMAGECOUNT value on done: 678037.0 [2024-08-06 05:49:57,534][52794] Sum rewards: 63.886, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO3': '0.256', 'AMMO4': '0.297', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 05:49:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 525615104. Throughput: 0: 4360.9. Samples: 131412190. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:49:57,794][52567] Avg episode reward: [(0, '73.968')] [2024-08-06 05:49:57,959][52647] DAMAGECOUNT value on done: 714951.0 [2024-08-06 05:49:57,959][52647] Sum rewards: 76.296, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.930', 'AMMO2': '0.004', 'AMMO4': '0.018', 'AMMO3': '0.303', 'weapon2': '0.462', 'WEAPON3': '1.750', 'weapon3': '3.324', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '67.000'} [2024-08-06 05:49:58,575][52667] DAMAGECOUNT value on done: 684041.0 [2024-08-06 05:49:58,577][52667] Sum rewards: 77.325, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.650', 'weapon3': '3.082', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '67.000'} [2024-08-06 05:49:59,105][52665] DAMAGECOUNT value on done: 670832.0 [2024-08-06 05:49:59,106][52665] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '61.000'} [2024-08-06 05:49:59,271][52663] DAMAGECOUNT value on done: 673711.0 [2024-08-06 05:49:59,271][52663] Sum rewards: 73.747, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.156', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.166', 'weapon5': '0.180', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '2.820', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '59.000'} [2024-08-06 05:49:59,874][52794] DAMAGECOUNT value on done: 683335.0 [2024-08-06 05:49:59,874][52794] Sum rewards: 80.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.812', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.161', 'AMMO3': '0.202', 'weapon5': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '65.000'} [2024-08-06 05:50:00,792][52647] DAMAGECOUNT value on done: 713320.0 [2024-08-06 05:50:00,792][52647] Sum rewards: 67.358, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.808', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.212', 'AMMO4': '0.221', 'weapon5': '0.256', 'weapon2': '0.260', 'AMMO3': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.940', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:01,345][52667] DAMAGECOUNT value on done: 684567.0 [2024-08-06 05:50:01,345][52667] Sum rewards: 77.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.108', 'AMMO4': '0.154', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '65.000'} [2024-08-06 05:50:01,394][52670] DAMAGECOUNT value on done: 668148.0 [2024-08-06 05:50:01,394][52670] Sum rewards: 57.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.240', 'weapon2': '0.370', 'weapon4': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '51.000'} [2024-08-06 05:50:01,654][52650] Updated weights for policy 0, policy_version 64171 (0.0038) [2024-08-06 05:50:02,004][52795] DAMAGECOUNT value on done: 628998.0 [2024-08-06 05:50:02,008][52795] Sum rewards: 80.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.547', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.169', 'AMMO3': '0.179', 'weapon4': '0.186', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '67.000'} [2024-08-06 05:50:02,288][52666] DAMAGECOUNT value on done: 676821.0 [2024-08-06 05:50:02,289][52666] Sum rewards: 73.866, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.988', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon2': '0.152', 'AMMO3': '0.181', 'weapon5': '0.272', 'AMMO4': '0.274', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:02,317][52663] DAMAGECOUNT value on done: 677825.0 [2024-08-06 05:50:02,318][52663] Sum rewards: 61.830, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.647', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.148', 'weapon5': '0.202', 'AMMO4': '0.270', 'AMMO3': '0.294', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.864', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 525705216. Throughput: 0: 4361.3. Samples: 131425330. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 05:50:02,794][52567] Avg episode reward: [(0, '73.806')] [2024-08-06 05:50:03,013][52794] DAMAGECOUNT value on done: 685685.0 [2024-08-06 05:50:03,013][52794] Sum rewards: 65.498, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.234', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.182', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.314', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:03,308][52647] DAMAGECOUNT value on done: 710214.0 [2024-08-06 05:50:03,308][52647] Sum rewards: 77.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.101', 'weapon4': '0.160', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:04,066][52670] DAMAGECOUNT value on done: 677999.0 [2024-08-06 05:50:04,067][52670] Sum rewards: 65.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.644', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.340', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '55.000'} [2024-08-06 05:50:04,529][52667] DAMAGECOUNT value on done: 676966.0 [2024-08-06 05:50:04,530][52667] Sum rewards: 66.919, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.585', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.128', 'AMMO4': '0.165', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.286', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:05,078][52666] DAMAGECOUNT value on done: 676079.0 [2024-08-06 05:50:05,082][52666] Sum rewards: 76.334, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:05,151][52795] DAMAGECOUNT value on done: 615806.0 [2024-08-06 05:50:05,153][52795] Sum rewards: 67.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.474', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.052', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.280', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.432', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:05,260][52663] DAMAGECOUNT value on done: 686607.0 [2024-08-06 05:50:05,262][52663] Sum rewards: 86.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.430', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.666', 'FRAGCOUNT': '71.000'} [2024-08-06 05:50:05,441][52794] DAMAGECOUNT value on done: 676906.0 [2024-08-06 05:50:05,441][52794] Sum rewards: 79.477, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.974', 'AMMO5': '0.003', 'AMMO2': '0.009', 'WEAPON1': '0.010', 'weapon5': '0.024', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '3.306', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:06,321][52647] DAMAGECOUNT value on done: 704294.0 [2024-08-06 05:50:06,323][52647] Sum rewards: 58.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.167', 'AMMO4': '0.206', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '48.000'} [2024-08-06 05:50:06,403][52650] Updated weights for policy 0, policy_version 64181 (0.0012) [2024-08-06 05:50:06,977][52820] DAMAGECOUNT value on done: 626467.0 [2024-08-06 05:50:06,977][52820] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO4': '0.167', 'AMMO3': '0.195', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:07,109][52670] DAMAGECOUNT value on done: 667521.0 [2024-08-06 05:50:07,111][52670] Sum rewards: 93.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.108', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '4.340', 'DAMAGECOUNT': '22.176', 'FRAGCOUNT': '76.000'} [2024-08-06 05:50:07,581][52667] DAMAGECOUNT value on done: 686418.0 [2024-08-06 05:50:07,581][52667] Sum rewards: 69.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.130', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.392', 'WEAPON3': '1.650', 'weapon3': '3.028', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 525787136. Throughput: 0: 4372.9. Samples: 131451740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:50:07,794][52567] Avg episode reward: [(0, '73.403')] [2024-08-06 05:50:07,803][52663] DAMAGECOUNT value on done: 672702.0 [2024-08-06 05:50:07,803][52663] Sum rewards: 69.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.111', 'weapon5': '0.166', 'AMMO4': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.414', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON3': '0.700', 'weapon3': '2.646', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:08,250][52666] DAMAGECOUNT value on done: 676468.0 [2024-08-06 05:50:08,250][52666] Sum rewards: 55.415, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.828', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.118', 'weapon5': '0.150', 'AMMO4': '0.187', 'AMMO3': '0.256', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.182', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '49.000'} [2024-08-06 05:50:08,381][52795] DAMAGECOUNT value on done: 617945.0 [2024-08-06 05:50:08,382][52795] Sum rewards: 75.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.811', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.168', 'weapon5': '0.186', 'AMMO4': '0.197', 'AMMO3': '0.203', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:09,405][52647] DAMAGECOUNT value on done: 718905.0 [2024-08-06 05:50:09,407][52647] Sum rewards: 73.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.580', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.512', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:10,155][52820] DAMAGECOUNT value on done: 626367.0 [2024-08-06 05:50:10,158][52820] Sum rewards: 71.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.705', 'AMMO5': '0.011', 'AMMO2': '0.022', 'ARMOR': '0.024', 'weapon4': '0.056', 'weapon5': '0.060', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:10,619][52670] DAMAGECOUNT value on done: 665402.0 [2024-08-06 05:50:10,619][52670] Sum rewards: 67.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.474', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.105', 'AMMO3': '0.212', 'weapon4': '0.338', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '55.000'} [2024-08-06 05:50:10,710][52663] DAMAGECOUNT value on done: 667887.0 [2024-08-06 05:50:10,710][52663] Sum rewards: 74.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.139', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.202', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:10,989][52650] Updated weights for policy 0, policy_version 64191 (0.0016) [2024-08-06 05:50:11,307][52666] DAMAGECOUNT value on done: 677883.0 [2024-08-06 05:50:11,308][52666] Sum rewards: 73.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.938', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.054', 'AMMO4': '0.219', 'weapon5': '0.228', 'AMMO3': '0.269', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:11,530][52795] DAMAGECOUNT value on done: 625400.0 [2024-08-06 05:50:11,533][52795] Sum rewards: 66.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.023', 'AMMO2': '0.058', 'weapon4': '0.064', 'AMMO3': '0.203', 'weapon5': '0.256', 'AMMO4': '0.289', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:11,650][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:50:12,001][52647] DAMAGECOUNT value on done: 706637.0 [2024-08-06 05:50:12,001][52647] Sum rewards: 82.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.088', 'weapon5': '0.164', 'AMMO4': '0.172', 'AMMO3': '0.208', 'weapon2': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '69.000'} [2024-08-06 05:50:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 525877248. Throughput: 0: 4382.0. Samples: 131478200. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:50:12,802][52567] Avg episode reward: [(0, '73.050')] [2024-08-06 05:50:13,230][52670] DAMAGECOUNT value on done: 676627.0 [2024-08-06 05:50:13,231][52670] Sum rewards: 65.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.173', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.175', 'weapon2': '0.526', 'WEAPON3': '1.100', 'HITCOUNT': '3.170', 'weapon3': '3.180', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '53.000'} [2024-08-06 05:50:13,378][52820] DAMAGECOUNT value on done: 628557.0 [2024-08-06 05:50:13,379][52820] Sum rewards: 70.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.312', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.108', 'AMMO4': '0.126', 'weapon5': '0.126', 'weapon2': '0.240', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:13,700][52658] DAMAGECOUNT value on done: 679223.0 [2024-08-06 05:50:13,700][52658] Sum rewards: 68.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.554', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.088', 'AMMO4': '0.114', 'weapon5': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.038', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:13,881][52666] DAMAGECOUNT value on done: 668776.0 [2024-08-06 05:50:13,883][52666] Sum rewards: 76.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.935', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.154', 'AMMO3': '0.176', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:13,991][52663] DAMAGECOUNT value on done: 668635.0 [2024-08-06 05:50:13,991][52663] Sum rewards: 64.501, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.040', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'HEALTH': '0.192', 'weapon2': '0.512', 'WEAPON3': '0.900', 'HITCOUNT': '3.060', 'weapon3': '3.328', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.000'} [2024-08-06 05:50:14,334][52811] DAMAGECOUNT value on done: 645726.0 [2024-08-06 05:50:14,334][52811] Sum rewards: 65.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.663', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.238', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.200', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '55.000'} [2024-08-06 05:50:14,547][52647] DAMAGECOUNT value on done: 715663.0 [2024-08-06 05:50:14,547][52647] Sum rewards: 72.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.009', 'AMMO2': '0.058', 'weapon5': '0.130', 'weapon2': '0.194', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'AMMO4': '0.287', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:14,624][52795] DAMAGECOUNT value on done: 618949.0 [2024-08-06 05:50:14,626][52795] Sum rewards: 70.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.696', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon4': '0.222', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:15,623][52670] DAMAGECOUNT value on done: 672577.0 [2024-08-06 05:50:15,623][52670] Sum rewards: 71.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.081', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.160', 'weapon5': '0.220', 'AMMO3': '0.240', 'AMMO4': '0.299', 'weapon2': '0.494', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.814', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:15,780][52650] Updated weights for policy 0, policy_version 64201 (0.0012) [2024-08-06 05:50:16,384][52669] DAMAGECOUNT value on done: 679597.0 [2024-08-06 05:50:16,384][52669] Sum rewards: 66.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.610', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.124', 'weapon4': '0.134', 'AMMO4': '0.172', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.130', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:16,423][52820] DAMAGECOUNT value on done: 619950.0 [2024-08-06 05:50:16,424][52820] Sum rewards: 64.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.782', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.189', 'weapon5': '0.204', 'weapon4': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '52.000'} [2024-08-06 05:50:16,486][52666] DAMAGECOUNT value on done: 671194.0 [2024-08-06 05:50:16,488][52666] Sum rewards: 66.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.155', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.122', 'AMMO4': '0.226', 'AMMO3': '0.246', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.356', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:16,666][52658] DAMAGECOUNT value on done: 677734.0 [2024-08-06 05:50:16,666][52658] Sum rewards: 77.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:16,867][52647] DAMAGECOUNT value on done: 716458.0 [2024-08-06 05:50:16,867][52647] Sum rewards: 78.431, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.006', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '68.000'} [2024-08-06 05:50:17,228][52663] DAMAGECOUNT value on done: 672119.0 [2024-08-06 05:50:17,230][52663] Sum rewards: 68.888, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.310', 'HEALTH': '0.332', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.306', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:17,488][52811] DAMAGECOUNT value on done: 625263.0 [2024-08-06 05:50:17,488][52811] Sum rewards: 80.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.856', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.018', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.378', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '65.000'} [2024-08-06 05:50:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 525967360. Throughput: 0: 4388.9. Samples: 131491410. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:50:17,794][52567] Avg episode reward: [(0, '72.936')] [2024-08-06 05:50:17,808][52795] DAMAGECOUNT value on done: 630661.0 [2024-08-06 05:50:17,808][52795] Sum rewards: 79.804, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.132', 'AMMO4': '0.160', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'HEALTH': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.334', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:18,444][52670] DAMAGECOUNT value on done: 664084.0 [2024-08-06 05:50:18,445][52670] Sum rewards: 81.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.094', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '69.000'} [2024-08-06 05:50:19,142][52671] DAMAGECOUNT value on done: 680567.0 [2024-08-06 05:50:19,142][52671] Sum rewards: 77.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.646', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.204', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.540', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:19,146][52669] DAMAGECOUNT value on done: 670836.0 [2024-08-06 05:50:19,146][52669] Sum rewards: 64.571, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.334', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.166', 'AMMO4': '0.169', 'WEAPON4': '0.300', 'weapon2': '0.308', 'AMMO3': '0.315', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.204', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:19,383][52658] DAMAGECOUNT value on done: 682355.0 [2024-08-06 05:50:19,383][52658] Sum rewards: 77.803, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.895', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.132', 'weapon5': '0.190', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.792', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:19,444][52666] DAMAGECOUNT value on done: 671032.0 [2024-08-06 05:50:19,445][52666] Sum rewards: 81.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.132', 'weapon4': '0.142', 'AMMO4': '0.192', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.600', 'weapon3': '2.960', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '67.000'} [2024-08-06 05:50:19,540][52820] DAMAGECOUNT value on done: 629863.0 [2024-08-06 05:50:19,541][52820] Sum rewards: 86.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.681', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.198', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '71.000'} [2024-08-06 05:50:19,721][52647] DAMAGECOUNT value on done: 700429.0 [2024-08-06 05:50:19,723][52647] Sum rewards: 69.877, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.124', 'AMMO3': '0.186', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:19,871][52663] DAMAGECOUNT value on done: 683498.0 [2024-08-06 05:50:19,874][52663] Sum rewards: 80.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO2': '0.005', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO4': '0.024', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '66.000'} [2024-08-06 05:50:19,881][52669] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 05:50:20,418][52650] Updated weights for policy 0, policy_version 64211 (0.0012) [2024-08-06 05:50:20,605][52811] DAMAGECOUNT value on done: 625664.0 [2024-08-06 05:50:20,608][52811] Sum rewards: 69.316, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.656', 'AMMO2': '0.005', 'weapon4': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.234', 'WEAPON3': '1.400', 'HITCOUNT': '3.400', 'weapon3': '3.536', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:21,018][52795] DAMAGECOUNT value on done: 632109.0 [2024-08-06 05:50:21,018][52795] Sum rewards: 75.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.678', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'weapon5': '0.210', 'weapon2': '0.238', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:21,208][52820] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:50:21,526][52670] DAMAGECOUNT value on done: 671103.0 [2024-08-06 05:50:21,526][52670] Sum rewards: 69.214, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.058', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.199', 'AMMO3': '0.222', 'weapon2': '0.360', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.306', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:21,878][52669] DAMAGECOUNT value on done: 682336.0 [2024-08-06 05:50:21,880][52669] Sum rewards: 72.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.102', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.212', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:21,918][52658] DAMAGECOUNT value on done: 680990.0 [2024-08-06 05:50:21,918][52658] Sum rewards: 73.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.696', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.274', 'AMMO3': '0.275', 'WEAPON3': '1.550', 'weapon3': '3.470', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:22,246][52671] DAMAGECOUNT value on done: 684537.0 [2024-08-06 05:50:22,247][52671] Sum rewards: 74.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.094', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.156', 'weapon5': '0.228', 'AMMO4': '0.234', 'weapon4': '0.298', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:22,496][52663] DAMAGECOUNT value on done: 668955.0 [2024-08-06 05:50:22,497][52663] Sum rewards: 77.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.778', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO3': '0.188', 'AMMO4': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:22,520][52647] DAMAGECOUNT value on done: 710638.0 [2024-08-06 05:50:22,520][52647] Sum rewards: 71.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.242', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:22,521][52666] DAMAGECOUNT value on done: 667048.0 [2024-08-06 05:50:22,524][52666] Sum rewards: 60.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.305', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.206', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '51.000'} [2024-08-06 05:50:22,618][52820] DAMAGECOUNT value on done: 619109.0 [2024-08-06 05:50:22,619][52820] Sum rewards: 70.026, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.452', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.144', 'weapon4': '0.164', 'AMMO4': '0.207', 'AMMO3': '0.262', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.062', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:22,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 526057472. Throughput: 0: 4380.6. Samples: 131517490. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:50:22,795][52567] Avg episode reward: [(0, '73.004')] [2024-08-06 05:50:23,809][52811] DAMAGECOUNT value on done: 626956.0 [2024-08-06 05:50:23,809][52811] Sum rewards: 70.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.528', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.080', 'AMMO4': '0.161', 'weapon5': '0.180', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:24,102][52795] DAMAGECOUNT value on done: 625771.0 [2024-08-06 05:50:24,103][52795] Sum rewards: 54.598, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.022', 'AMMO2': '0.046', 'AMMO4': '0.231', 'AMMO3': '0.234', 'weapon5': '0.256', 'weapon4': '0.274', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '47.000'} [2024-08-06 05:50:24,338][52670] DAMAGECOUNT value on done: 667642.0 [2024-08-06 05:50:24,338][52670] Sum rewards: 67.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.042', 'weapon5': '0.044', 'AMMO4': '0.098', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '3.224', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '54.000'} [2024-08-06 05:50:24,845][52669] DAMAGECOUNT value on done: 679265.0 [2024-08-06 05:50:24,846][52669] Sum rewards: 75.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.216', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.104', 'weapon5': '0.112', 'AMMO4': '0.126', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.500'} [2024-08-06 05:50:24,925][52658] DAMAGECOUNT value on done: 671263.0 [2024-08-06 05:50:24,925][52658] Sum rewards: 86.907, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.139', 'weapon4': '0.152', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.340', 'weapon2': '0.420', 'WEAPON3': '0.900', 'weapon3': '3.036', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '67.000'} [2024-08-06 05:50:25,090][52650] Updated weights for policy 0, policy_version 64221 (0.0011) [2024-08-06 05:50:25,191][52666] DAMAGECOUNT value on done: 674902.0 [2024-08-06 05:50:25,193][52666] Sum rewards: 79.327, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:25,447][52671] DAMAGECOUNT value on done: 681054.0 [2024-08-06 05:50:25,447][52671] Sum rewards: 75.174, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.945', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.114', 'AMMO3': '0.137', 'weapon2': '0.310', 'weapon5': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon4': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.334', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:25,565][52663] DAMAGECOUNT value on done: 664203.0 [2024-08-06 05:50:25,567][52663] Sum rewards: 62.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.508', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.146', 'AMMO4': '0.148', 'weapon2': '0.166', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.438', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '52.000'} [2024-08-06 05:50:25,685][52647] DAMAGECOUNT value on done: 701047.0 [2024-08-06 05:50:25,685][52647] Sum rewards: 73.352, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.451', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.150', 'weapon2': '0.160', 'AMMO4': '0.195', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '62.500'} [2024-08-06 05:50:25,712][52820] DAMAGECOUNT value on done: 628295.0 [2024-08-06 05:50:25,714][52820] Sum rewards: 70.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.039', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.320', 'weapon4': '0.360', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:26,969][52811] DAMAGECOUNT value on done: 637131.0 [2024-08-06 05:50:26,970][52811] Sum rewards: 71.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.895', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO4': '0.217', 'AMMO3': '0.222', 'weapon5': '0.242', 'weapon4': '0.324', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.708', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:27,042][52670] DAMAGECOUNT value on done: 664968.0 [2024-08-06 05:50:27,043][52670] Sum rewards: 69.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.238', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:27,202][52795] DAMAGECOUNT value on done: 622046.0 [2024-08-06 05:50:27,202][52795] Sum rewards: 81.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.074', 'weapon4': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'AMMO4': '0.224', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.442', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '66.000'} [2024-08-06 05:50:27,343][52658] DAMAGECOUNT value on done: 670472.0 [2024-08-06 05:50:27,344][52658] Sum rewards: 60.544, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.071', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.166', 'weapon2': '0.224', 'AMMO3': '0.236', 'AMMO4': '0.293', 'weapon5': '0.302', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '54.000'} [2024-08-06 05:50:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 526139392. Throughput: 0: 4380.4. Samples: 131543750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:50:27,795][52567] Avg episode reward: [(0, '72.178')] [2024-08-06 05:50:27,794][52666] DAMAGECOUNT value on done: 667805.0 [2024-08-06 05:50:27,799][52666] Sum rewards: 76.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.890', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.180', 'weapon5': '0.228', 'weapon2': '0.240', 'weapon4': '0.308', 'AMMO4': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:27,823][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064227_526147584.pth... [2024-08-06 05:50:27,982][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063714_521945088.pth [2024-08-06 05:50:28,306][52669] DAMAGECOUNT value on done: 678810.0 [2024-08-06 05:50:28,307][52669] Sum rewards: 70.269, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.640', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.134', 'weapon4': '0.152', 'AMMO4': '0.184', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:28,802][52820] DAMAGECOUNT value on done: 631068.0 [2024-08-06 05:50:28,804][52820] Sum rewards: 62.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.147', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.134', 'AMMO4': '0.173', 'weapon4': '0.246', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.986', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '54.000'} [2024-08-06 05:50:28,877][52671] DAMAGECOUNT value on done: 683290.0 [2024-08-06 05:50:28,878][52671] Sum rewards: 74.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.336', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.170', 'AMMO4': '0.170', 'weapon5': '0.214', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '0.950', 'weapon3': '2.892', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:28,904][52647] DAMAGECOUNT value on done: 707760.0 [2024-08-06 05:50:28,904][52647] Sum rewards: 79.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.086', 'weapon5': '0.088', 'AMMO4': '0.160', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '65.000'} [2024-08-06 05:50:28,915][52663] DAMAGECOUNT value on done: 670416.0 [2024-08-06 05:50:28,915][52663] Sum rewards: 63.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.751', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.215', 'AMMO4': '0.233', 'weapon5': '0.260', 'weapon4': '0.342', 'weapon2': '0.412', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.658', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '54.500'} [2024-08-06 05:50:29,189][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:50:29,723][52670] DAMAGECOUNT value on done: 676276.0 [2024-08-06 05:50:29,724][52670] Sum rewards: 73.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.123', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon5': '0.206', 'AMMO3': '0.228', 'AMMO4': '0.304', 'weapon4': '0.360', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.718', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:29,927][52650] Updated weights for policy 0, policy_version 64231 (0.0035) [2024-08-06 05:50:30,020][52658] DAMAGECOUNT value on done: 683178.0 [2024-08-06 05:50:30,020][52658] Sum rewards: 77.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.154', 'AMMO4': '0.157', 'AMMO3': '0.181', 'weapon5': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:30,469][52811] DAMAGECOUNT value on done: 641066.0 [2024-08-06 05:50:30,470][52811] Sum rewards: 79.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '68.000'} [2024-08-06 05:50:30,579][52795] DAMAGECOUNT value on done: 630557.0 [2024-08-06 05:50:30,581][52795] Sum rewards: 77.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.046', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.156', 'weapon5': '0.174', 'AMMO3': '0.185', 'weapon4': '0.190', 'AMMO4': '0.231', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:30,666][52666] DAMAGECOUNT value on done: 675707.0 [2024-08-06 05:50:30,667][52666] Sum rewards: 91.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.091', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.681', 'FRAGCOUNT': '73.000'} [2024-08-06 05:50:30,792][52669] DAMAGECOUNT value on done: 681352.0 [2024-08-06 05:50:30,792][52669] Sum rewards: 65.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.198', 'AMMO4': '0.238', 'weapon5': '0.252', 'weapon4': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.592', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '54.000'} [2024-08-06 05:50:31,561][52663] DAMAGECOUNT value on done: 667830.0 [2024-08-06 05:50:31,562][52663] Sum rewards: 83.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.260', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.120', 'AMMO4': '0.152', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.992', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '66.000'} [2024-08-06 05:50:31,963][52820] DAMAGECOUNT value on done: 625989.0 [2024-08-06 05:50:31,965][52820] Sum rewards: 74.380, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.118', 'AMMO3': '0.173', 'AMMO4': '0.194', 'weapon5': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:32,202][52671] DAMAGECOUNT value on done: 691656.0 [2024-08-06 05:50:32,202][52671] Sum rewards: 64.046, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.894', 'AMMO5': '0.023', 'AMMO2': '0.075', 'weapon4': '0.124', 'weapon2': '0.274', 'weapon5': '0.292', 'AMMO3': '0.315', 'AMMO4': '0.373', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.850', 'weapon3': '2.898', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:32,606][52658] DAMAGECOUNT value on done: 674120.0 [2024-08-06 05:50:32,606][52658] Sum rewards: 69.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.118', 'weapon4': '0.136', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:32,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 526229504. Throughput: 0: 4366.2. Samples: 131556320. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:50:32,796][52567] Avg episode reward: [(0, '72.502')] [2024-08-06 05:50:32,839][52670] DAMAGECOUNT value on done: 661002.0 [2024-08-06 05:50:32,839][52670] Sum rewards: 76.463, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.653', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.222', 'weapon4': '0.250', 'AMMO4': '0.253', 'weapon5': '0.306', 'weapon2': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:33,496][52811] DAMAGECOUNT value on done: 637306.0 [2024-08-06 05:50:33,498][52811] Sum rewards: 71.653, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.110', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.142', 'weapon4': '0.246', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '2.894', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:33,668][52669] DAMAGECOUNT value on done: 679688.0 [2024-08-06 05:50:33,669][52669] Sum rewards: 77.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.012', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.290', 'WEAPON3': '1.200', 'weapon3': '3.466', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:33,717][52795] DAMAGECOUNT value on done: 625457.0 [2024-08-06 05:50:33,717][52795] Sum rewards: 87.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO4': '0.184', 'weapon4': '0.202', 'AMMO3': '0.219', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '73.000'} [2024-08-06 05:50:33,717][52666] DAMAGECOUNT value on done: 664189.0 [2024-08-06 05:50:33,718][52666] Sum rewards: 87.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.808', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.126', 'weapon5': '0.154', 'AMMO3': '0.187', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.328', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '71.000'} [2024-08-06 05:50:34,270][52663] DAMAGECOUNT value on done: 682806.0 [2024-08-06 05:50:34,270][52663] Sum rewards: 86.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.972', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.180', 'weapon2': '0.216', 'WEAPON3': '1.150', 'weapon3': '3.666', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '70.000'} [2024-08-06 05:50:34,486][52650] Updated weights for policy 0, policy_version 64241 (0.0035) [2024-08-06 05:50:34,593][52803] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:50:34,920][52820] DAMAGECOUNT value on done: 632365.0 [2024-08-06 05:50:34,920][52820] Sum rewards: 67.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.222', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO4': '0.203', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'weapon4': '0.602', 'WEAPON3': '1.450', 'weapon3': '2.582', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:35,332][52671] DAMAGECOUNT value on done: 682237.0 [2024-08-06 05:50:35,332][52671] Sum rewards: 74.559, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.745', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.062', 'AMMO3': '0.168', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.364', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:35,401][52670] DAMAGECOUNT value on done: 671779.0 [2024-08-06 05:50:35,402][52670] Sum rewards: 65.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon5': '0.182', 'AMMO3': '0.206', 'weapon4': '0.220', 'AMMO4': '0.298', 'weapon2': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '53.000'} [2024-08-06 05:50:35,666][52658] DAMAGECOUNT value on done: 692058.0 [2024-08-06 05:50:35,667][52658] Sum rewards: 72.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.185', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.086', 'weapon4': '0.102', 'AMMO4': '0.121', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:36,298][52666] DAMAGECOUNT value on done: 676899.0 [2024-08-06 05:50:36,300][52666] Sum rewards: 66.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.076', 'AMMO3': '0.209', 'weapon2': '0.256', 'weapon5': '0.322', 'weapon4': '0.330', 'AMMO4': '0.382', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '53.000'} [2024-08-06 05:50:36,689][52669] DAMAGECOUNT value on done: 679585.0 [2024-08-06 05:50:36,691][52669] Sum rewards: 78.524, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.825', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.098', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:36,857][52795] DAMAGECOUNT value on done: 621313.0 [2024-08-06 05:50:36,860][52795] Sum rewards: 65.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.124', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.106', 'AMMO4': '0.164', 'AMMO3': '0.197', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '53.000'} [2024-08-06 05:50:36,862][52811] DAMAGECOUNT value on done: 627877.0 [2024-08-06 05:50:36,862][52811] Sum rewards: 82.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.109', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '68.000'} [2024-08-06 05:50:37,314][52663] DAMAGECOUNT value on done: 674415.0 [2024-08-06 05:50:37,314][52663] Sum rewards: 81.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.479', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.096', 'AMMO3': '0.150', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.000', 'weapon3': '3.176', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '65.000'} [2024-08-06 05:50:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 526319616. Throughput: 0: 4360.2. Samples: 131582340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:50:37,795][52567] Avg episode reward: [(0, '73.134')] [2024-08-06 05:50:38,056][52820] DAMAGECOUNT value on done: 621179.0 [2024-08-06 05:50:38,056][52820] Sum rewards: 77.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.132', 'weapon5': '0.160', 'AMMO4': '0.161', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:38,365][52671] DAMAGECOUNT value on done: 686541.0 [2024-08-06 05:50:38,366][52671] Sum rewards: 75.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.096', 'weapon5': '0.130', 'AMMO4': '0.179', 'AMMO3': '0.194', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:38,444][52658] DAMAGECOUNT value on done: 678015.0 [2024-08-06 05:50:38,444][52658] Sum rewards: 71.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.184', 'AMMO4': '0.201', 'AMMO3': '0.255', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.164', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:38,526][52670] DAMAGECOUNT value on done: 676936.0 [2024-08-06 05:50:38,526][52670] Sum rewards: 71.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.591', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.112', 'weapon2': '0.152', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:39,349][52650] Updated weights for policy 0, policy_version 64251 (0.0031) [2024-08-06 05:50:39,469][52666] DAMAGECOUNT value on done: 671889.0 [2024-08-06 05:50:39,473][52666] Sum rewards: 78.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.098', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.370', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '65.000'} [2024-08-06 05:50:39,784][52669] DAMAGECOUNT value on done: 687347.0 [2024-08-06 05:50:39,785][52669] Sum rewards: 61.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.116', 'AMMO4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '51.000'} [2024-08-06 05:50:39,919][52795] DAMAGECOUNT value on done: 620354.0 [2024-08-06 05:50:39,919][52795] Sum rewards: 72.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.860', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.180', 'AMMO4': '0.207', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.550', 'weapon3': '2.964', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:39,979][52811] DAMAGECOUNT value on done: 639997.0 [2024-08-06 05:50:39,980][52811] Sum rewards: 65.372, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.134', 'weapon5': '0.156', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:40,589][52663] DAMAGECOUNT value on done: 678874.0 [2024-08-06 05:50:40,589][52663] Sum rewards: 68.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.180', 'AMMO4': '0.212', 'weapon5': '0.234', 'weapon4': '0.248', 'weapon2': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '55.000'} [2024-08-06 05:50:41,140][52820] DAMAGECOUNT value on done: 629573.0 [2024-08-06 05:50:41,142][52820] Sum rewards: 81.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.934', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.118', 'weapon4': '0.134', 'AMMO3': '0.158', 'weapon2': '0.184', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.376', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '66.000'} [2024-08-06 05:50:41,186][52658] DAMAGECOUNT value on done: 689977.0 [2024-08-06 05:50:41,186][52658] Sum rewards: 73.260, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.122', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.108', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:41,348][52670] DAMAGECOUNT value on done: 674747.0 [2024-08-06 05:50:41,350][52670] Sum rewards: 69.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.240', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.522', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:41,362][52671] DAMAGECOUNT value on done: 683543.0 [2024-08-06 05:50:41,363][52671] Sum rewards: 78.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.123', 'weapon5': '0.162', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:42,237][52666] DAMAGECOUNT value on done: 675653.0 [2024-08-06 05:50:42,237][52666] Sum rewards: 80.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.903', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.145', 'AMMO3': '0.223', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.766', 'WEAPON3': '1.450', 'weapon3': '2.610', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '68.000'} [2024-08-06 05:50:42,708][52669] DAMAGECOUNT value on done: 680011.0 [2024-08-06 05:50:42,708][52669] Sum rewards: 69.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.784', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.206', 'weapon5': '0.248', 'AMMO4': '0.261', 'weapon4': '0.280', 'weapon2': '0.454', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 526401536. Throughput: 0: 4365.5. Samples: 131608640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:50:42,795][52567] Avg episode reward: [(0, '73.267')] [2024-08-06 05:50:43,035][52811] DAMAGECOUNT value on done: 634343.0 [2024-08-06 05:50:43,036][52811] Sum rewards: 69.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.718', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.186', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:43,038][52795] DAMAGECOUNT value on done: 629218.0 [2024-08-06 05:50:43,040][52795] Sum rewards: 68.081, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.660', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.128', 'AMMO4': '0.145', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.319', 'weapon2': '0.334', 'WEAPON3': '1.800', 'weapon3': '3.140', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:43,204][52663] DAMAGECOUNT value on done: 679312.0 [2024-08-06 05:50:43,205][52663] Sum rewards: 74.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.098', 'weapon5': '0.166', 'AMMO3': '0.233', 'AMMO4': '0.267', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '62.500'} [2024-08-06 05:50:43,947][52650] Updated weights for policy 0, policy_version 64261 (0.0018) [2024-08-06 05:50:44,053][52658] DAMAGECOUNT value on done: 676130.0 [2024-08-06 05:50:44,053][52658] Sum rewards: 65.088, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.860', 'AMMO5': '0.025', 'AMMO2': '0.066', 'weapon4': '0.148', 'AMMO3': '0.209', 'weapon5': '0.280', 'AMMO4': '0.331', 'weapon2': '0.492', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:44,096][52670] DAMAGECOUNT value on done: 656542.0 [2024-08-06 05:50:44,098][52670] Sum rewards: 65.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO4': '0.201', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '54.000'} [2024-08-06 05:50:44,289][52671] DAMAGECOUNT value on done: 674926.0 [2024-08-06 05:50:44,289][52671] Sum rewards: 74.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.182', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.136', 'AMMO3': '0.238', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:44,402][52820] DAMAGECOUNT value on done: 635984.0 [2024-08-06 05:50:44,402][52820] Sum rewards: 69.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.044', 'AMMO4': '0.161', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.204', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:44,928][52668] DAMAGECOUNT value on done: 675203.0 [2024-08-06 05:50:44,933][52668] Sum rewards: 66.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.569', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.108', 'AMMO3': '0.210', 'AMMO4': '0.214', 'weapon5': '0.276', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:44,962][52666] DAMAGECOUNT value on done: 665394.0 [2024-08-06 05:50:44,962][52666] Sum rewards: 71.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.430', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:45,170][52669] DAMAGECOUNT value on done: 681176.0 [2024-08-06 05:50:45,180][52669] Sum rewards: 62.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.440', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.062', 'weapon5': '0.124', 'AMMO3': '0.187', 'AMMO4': '0.264', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.350', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '52.000'} [2024-08-06 05:50:45,719][52663] DAMAGECOUNT value on done: 671719.0 [2024-08-06 05:50:45,720][52663] Sum rewards: 73.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.645', 'AMMO5': '0.008', 'weapon4': '0.026', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.416', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:46,085][52811] DAMAGECOUNT value on done: 637033.0 [2024-08-06 05:50:46,088][52811] Sum rewards: 77.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.858', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon4': '0.054', 'weapon5': '0.184', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.254', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:46,165][52795] DAMAGECOUNT value on done: 615249.0 [2024-08-06 05:50:46,165][52795] Sum rewards: 74.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.578', 'AMMO5': '0.022', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.174', 'AMMO3': '0.188', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:46,552][52670] DAMAGECOUNT value on done: 669589.0 [2024-08-06 05:50:46,553][52670] Sum rewards: 75.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.126', 'weapon5': '0.192', 'AMMO3': '0.234', 'AMMO4': '0.279', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:46,982][52658] DAMAGECOUNT value on done: 681484.0 [2024-08-06 05:50:46,983][52658] Sum rewards: 72.145, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.455', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.144', 'AMMO4': '0.175', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:47,353][52671] DAMAGECOUNT value on done: 682238.0 [2024-08-06 05:50:47,354][52671] Sum rewards: 70.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.178', 'weapon4': '0.180', 'AMMO4': '0.196', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:47,465][52666] DAMAGECOUNT value on done: 671985.0 [2024-08-06 05:50:47,465][52666] Sum rewards: 74.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.144', 'weapon5': '0.148', 'AMMO3': '0.228', 'weapon2': '0.244', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:47,630][52820] DAMAGECOUNT value on done: 629120.0 [2024-08-06 05:50:47,630][52820] Sum rewards: 69.079, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.695', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.182', 'weapon5': '0.242', 'AMMO4': '0.266', 'weapon2': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.630', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '55.000'} [2024-08-06 05:50:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 526491648. Throughput: 0: 4367.3. Samples: 131621860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:50:47,795][52567] Avg episode reward: [(0, '73.345')] [2024-08-06 05:50:48,095][52668] DAMAGECOUNT value on done: 681604.0 [2024-08-06 05:50:48,098][52668] Sum rewards: 75.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.128', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.600', 'weapon3': '2.888', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:48,416][52669] DAMAGECOUNT value on done: 687080.0 [2024-08-06 05:50:48,417][52669] Sum rewards: 74.652, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.700', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.114', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'AMMO3': '0.288', 'WEAPON3': '1.750', 'weapon3': '3.328', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '65.500'} [2024-08-06 05:50:48,932][52650] Updated weights for policy 0, policy_version 64271 (0.0022) [2024-08-06 05:50:49,083][52670] DAMAGECOUNT value on done: 676821.0 [2024-08-06 05:50:49,083][52670] Sum rewards: 74.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.158', 'weapon4': '0.158', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.332', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:49,124][52811] DAMAGECOUNT value on done: 640189.0 [2024-08-06 05:50:49,125][52811] Sum rewards: 64.955, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.410', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.092', 'AMMO4': '0.179', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.750', 'weapon3': '3.152', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '58.500'} [2024-08-06 05:50:49,332][52795] DAMAGECOUNT value on done: 634134.0 [2024-08-06 05:50:49,333][52795] Sum rewards: 76.683, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.107', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.052', 'weapon5': '0.064', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.388', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:50,054][52658] DAMAGECOUNT value on done: 674460.0 [2024-08-06 05:50:50,055][52658] Sum rewards: 70.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.180', 'AMMO3': '0.215', 'AMMO4': '0.219', 'weapon5': '0.268', 'weapon2': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '57.000'} [2024-08-06 05:50:50,153][52666] DAMAGECOUNT value on done: 682575.0 [2024-08-06 05:50:50,154][52666] Sum rewards: 68.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.110', 'AMMO4': '0.171', 'AMMO3': '0.240', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '58.000'} [2024-08-06 05:50:50,163][52671] DAMAGECOUNT value on done: 684950.0 [2024-08-06 05:50:50,164][52671] Sum rewards: 78.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.014', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '65.000'} [2024-08-06 05:50:50,729][52820] DAMAGECOUNT value on done: 634167.0 [2024-08-06 05:50:50,730][52820] Sum rewards: 79.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.868', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.054', 'AMMO4': '0.193', 'AMMO3': '0.200', 'weapon5': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '66.000'} [2024-08-06 05:50:50,955][52669] DAMAGECOUNT value on done: 672335.0 [2024-08-06 05:50:50,957][52669] Sum rewards: 64.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.520', 'AMMO5': '0.024', 'AMMO2': '0.047', 'AMMO3': '0.229', 'AMMO4': '0.236', 'weapon2': '0.252', 'weapon5': '0.288', 'weapon4': '0.346', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.794', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '53.000'} [2024-08-06 05:50:51,176][52668] DAMAGECOUNT value on done: 682631.0 [2024-08-06 05:50:51,176][52668] Sum rewards: 76.633, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.234', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.180', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '3.370', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:52,193][52811] DAMAGECOUNT value on done: 633531.0 [2024-08-06 05:50:52,196][52811] Sum rewards: 81.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.131', 'weapon4': '0.160', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '67.000'} [2024-08-06 05:50:52,304][52670] DAMAGECOUNT value on done: 670894.0 [2024-08-06 05:50:52,305][52670] Sum rewards: 71.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.210', 'AMMO4': '0.218', 'weapon4': '0.236', 'weapon5': '0.396', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.532', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:52,561][52795] DAMAGECOUNT value on done: 627537.0 [2024-08-06 05:50:52,561][52795] Sum rewards: 74.878, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.288', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.070', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:52,574][52658] DAMAGECOUNT value on done: 682880.0 [2024-08-06 05:50:52,576][52658] Sum rewards: 68.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.000', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.213', 'AMMO4': '0.255', 'weapon2': '0.280', 'weapon5': '0.344', 'weapon4': '0.440', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.600', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '57.500'} [2024-08-06 05:50:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 526573568. Throughput: 0: 4360.9. Samples: 131647980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:50:52,794][52567] Avg episode reward: [(0, '72.942')] [2024-08-06 05:50:52,855][52671] DAMAGECOUNT value on done: 681664.0 [2024-08-06 05:50:52,855][52671] Sum rewards: 83.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.072', 'weapon4': '0.080', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.541', 'FRAGCOUNT': '66.000'} [2024-08-06 05:50:53,289][52650] Updated weights for policy 0, policy_version 64281 (0.0012) [2024-08-06 05:50:53,365][52666] DAMAGECOUNT value on done: 662929.0 [2024-08-06 05:50:53,366][52666] Sum rewards: 79.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.670', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon4': '0.168', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:53,850][52669] DAMAGECOUNT value on done: 677164.0 [2024-08-06 05:50:53,852][52669] Sum rewards: 80.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.265', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '67.000'} [2024-08-06 05:50:53,910][52820] DAMAGECOUNT value on done: 630146.0 [2024-08-06 05:50:53,912][52820] Sum rewards: 77.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon4': '0.260', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '64.000'} [2024-08-06 05:50:54,041][52668] DAMAGECOUNT value on done: 682524.0 [2024-08-06 05:50:54,043][52668] Sum rewards: 82.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.064', 'AMMO3': '0.174', 'AMMO4': '0.178', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.012', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '67.000'} [2024-08-06 05:50:54,817][52670] DAMAGECOUNT value on done: 675717.0 [2024-08-06 05:50:54,817][52670] Sum rewards: 75.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.081', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.178', 'weapon2': '0.190', 'weapon4': '0.204', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:55,300][52811] DAMAGECOUNT value on done: 632150.0 [2024-08-06 05:50:55,302][52811] Sum rewards: 83.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.050', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.170', 'WEAPON5': '0.250', 'weapon4': '0.254', 'AMMO3': '0.255', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.012', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '21.189', 'FRAGCOUNT': '71.000'} [2024-08-06 05:50:55,304][52658] DAMAGECOUNT value on done: 668382.0 [2024-08-06 05:50:55,319][52658] Sum rewards: 75.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.208', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '61.000'} [2024-08-06 05:50:55,831][52795] DAMAGECOUNT value on done: 620842.0 [2024-08-06 05:50:55,841][52795] Sum rewards: 70.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.023', 'AMMO2': '0.053', 'AMMO3': '0.195', 'AMMO4': '0.267', 'weapon4': '0.292', 'weapon5': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.612', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '56.000'} [2024-08-06 05:50:56,096][52666] DAMAGECOUNT value on done: 670637.0 [2024-08-06 05:50:56,097][52666] Sum rewards: 72.574, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon4': '0.196', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '60.000'} [2024-08-06 05:50:56,330][52671] DAMAGECOUNT value on done: 687294.0 [2024-08-06 05:50:56,330][52671] Sum rewards: 80.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.889', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.128', 'AMMO4': '0.147', 'weapon5': '0.182', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '66.000'} [2024-08-06 05:50:56,759][52669] DAMAGECOUNT value on done: 678703.0 [2024-08-06 05:50:56,761][52669] Sum rewards: 71.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.030', 'AMMO5': '0.019', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.184', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '59.000'} [2024-08-06 05:50:56,911][52668] DAMAGECOUNT value on done: 670265.0 [2024-08-06 05:50:56,912][52668] Sum rewards: 75.775, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.293', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.120', 'AMMO4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.227', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:56,956][52820] DAMAGECOUNT value on done: 630968.0 [2024-08-06 05:50:56,957][52820] Sum rewards: 71.892, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.082', 'weapon4': '0.130', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.232', 'WEAPON5': '0.250', 'HEALTH': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '59.500'} [2024-08-06 05:50:57,004][52803] DAMAGECOUNT value on done: 630885.0 [2024-08-06 05:50:57,006][52803] Sum rewards: 76.670, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.012', 'HEALTH': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.055', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.168', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '3.154', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '62.000'} [2024-08-06 05:50:57,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 526655488. Throughput: 0: 4354.2. Samples: 131674140. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:50:57,794][52567] Avg episode reward: [(0, '73.784')] [2024-08-06 05:50:58,242][52650] Updated weights for policy 0, policy_version 64291 (0.0023) [2024-08-06 05:50:58,348][52658] DAMAGECOUNT value on done: 682262.0 [2024-08-06 05:50:58,350][52658] Sum rewards: 76.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.174', 'weapon4': '0.194', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '63.000'} [2024-08-06 05:50:58,482][52811] DAMAGECOUNT value on done: 629766.0 [2024-08-06 05:50:58,482][52811] Sum rewards: 63.736, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.950', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.084', 'weapon5': '0.134', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '50.000'} [2024-08-06 05:50:59,033][52795] DAMAGECOUNT value on done: 628468.0 [2024-08-06 05:50:59,034][52795] Sum rewards: 59.787, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.076', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.146', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '52.000'} [2024-08-06 05:50:59,215][52671] DAMAGECOUNT value on done: 682661.0 [2024-08-06 05:50:59,217][52671] Sum rewards: 77.406, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.086', 'AMMO3': '0.233', 'AMMO4': '0.248', 'weapon5': '0.264', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '64.500'} [2024-08-06 05:50:59,557][52669] DAMAGECOUNT value on done: 700074.0 [2024-08-06 05:50:59,557][52669] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.295', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon4': '0.290', 'weapon2': '0.292', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 05:50:59,694][52668] DAMAGECOUNT value on done: 685228.0 [2024-08-06 05:50:59,694][52668] Sum rewards: 77.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.876', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.020', 'AMMO4': '0.097', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.398', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:00,033][52820] DAMAGECOUNT value on done: 640991.0 [2024-08-06 05:51:00,035][52820] Sum rewards: 65.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.958', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.244', 'weapon4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '53.000'} [2024-08-06 05:51:00,182][52803] DAMAGECOUNT value on done: 632309.0 [2024-08-06 05:51:00,183][52803] Sum rewards: 87.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.191', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '71.000'} [2024-08-06 05:51:01,408][52658] DAMAGECOUNT value on done: 675529.0 [2024-08-06 05:51:01,417][52658] Sum rewards: 67.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.024', 'weapon5': '0.090', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'weapon2': '0.566', 'WEAPON3': '1.650', 'weapon3': '3.100', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '59.000'} [2024-08-06 05:51:01,535][52811] DAMAGECOUNT value on done: 630026.0 [2024-08-06 05:51:01,535][52811] Sum rewards: 65.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.448', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.180', 'weapon5': '0.180', 'AMMO4': '0.243', 'weapon2': '0.300', 'weapon4': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '53.000'} [2024-08-06 05:51:02,118][52795] DAMAGECOUNT value on done: 634968.0 [2024-08-06 05:51:02,118][52795] Sum rewards: 76.937, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.266', 'WEAPON4': '0.300', 'AMMO3': '0.302', 'weapon2': '0.698', 'WEAPON3': '1.650', 'weapon3': '2.786', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:02,171][52668] DAMAGECOUNT value on done: 683871.0 [2024-08-06 05:51:02,173][52668] Sum rewards: 67.651, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.082', 'AMMO4': '0.159', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'HEALTH': '0.320', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '56.000'} [2024-08-06 05:51:02,516][52671] DAMAGECOUNT value on done: 668453.0 [2024-08-06 05:51:02,519][52671] Sum rewards: 79.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.790', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.146', 'AMMO3': '0.242', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '64.000'} [2024-08-06 05:51:02,549][52669] DAMAGECOUNT value on done: 686205.0 [2024-08-06 05:51:02,551][52669] Sum rewards: 85.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.096', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.126', 'FRAGCOUNT': '68.000'} [2024-08-06 05:51:02,645][52650] Updated weights for policy 0, policy_version 64301 (0.0012) [2024-08-06 05:51:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 526753792. Throughput: 0: 4351.1. Samples: 131687210. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:51:02,795][52567] Avg episode reward: [(0, '74.065')] [2024-08-06 05:51:03,082][52820] DAMAGECOUNT value on done: 638943.0 [2024-08-06 05:51:03,084][52820] Sum rewards: 64.650, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.928', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.086', 'weapon5': '0.110', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.301', 'weapon2': '0.432', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '57.000'} [2024-08-06 05:51:03,246][52803] DAMAGECOUNT value on done: 636461.0 [2024-08-06 05:51:03,247][52803] Sum rewards: 79.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.238', 'AMMO5': '0.009', 'weapon4': '0.022', 'AMMO2': '0.032', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:04,182][52662] DAMAGECOUNT value on done: 683807.0 [2024-08-06 05:51:04,182][52662] Sum rewards: 90.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.885', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.032', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.256', 'WEAPON3': '1.200', 'weapon3': '3.478', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.489', 'FRAGCOUNT': '72.000'} [2024-08-06 05:51:04,389][52658] DAMAGECOUNT value on done: 677401.0 [2024-08-06 05:51:04,392][52658] Sum rewards: 78.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.050', 'AMMO4': '0.144', 'weapon5': '0.146', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '66.000'} [2024-08-06 05:51:04,659][52811] DAMAGECOUNT value on done: 635166.0 [2024-08-06 05:51:04,660][52811] Sum rewards: 69.944, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.370', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.346', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.378', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '59.000'} [2024-08-06 05:51:05,020][52668] DAMAGECOUNT value on done: 675484.0 [2024-08-06 05:51:05,021][52668] Sum rewards: 85.434, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.096', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.662', 'WEAPON3': '0.850', 'weapon3': '2.822', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '66.000'} [2024-08-06 05:51:05,487][52671] DAMAGECOUNT value on done: 688758.0 [2024-08-06 05:51:05,487][52671] Sum rewards: 66.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.004', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.326', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.460', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '54.000'} [2024-08-06 05:51:05,846][52669] DAMAGECOUNT value on done: 684381.0 [2024-08-06 05:51:05,848][52669] Sum rewards: 77.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon2': '0.218', 'AMMO3': '0.227', 'WEAPON3': '1.350', 'weapon3': '3.532', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '64.000'} [2024-08-06 05:51:05,972][52649] DAMAGECOUNT value on done: 656068.0 [2024-08-06 05:51:05,973][52649] Sum rewards: 59.031, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.030', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.156', 'weapon4': '0.210', 'weapon2': '0.248', 'AMMO3': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '2.900', 'weapon3': '3.110', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '52.000'} [2024-08-06 05:51:06,220][52820] DAMAGECOUNT value on done: 627725.0 [2024-08-06 05:51:06,224][52820] Sum rewards: 77.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.422', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.082', 'weapon4': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.244', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:06,437][52803] DAMAGECOUNT value on done: 637461.0 [2024-08-06 05:51:06,446][52803] Sum rewards: 74.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.102', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.146', 'AMMO4': '0.178', 'AMMO3': '0.189', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon5': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:06,593][52662] DAMAGECOUNT value on done: 683620.0 [2024-08-06 05:51:06,595][52662] Sum rewards: 77.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.160', 'AMMO4': '0.168', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '64.000'} [2024-08-06 05:51:07,427][52650] Updated weights for policy 0, policy_version 64311 (0.0024) [2024-08-06 05:51:07,530][52658] DAMAGECOUNT value on done: 681429.0 [2024-08-06 05:51:07,531][52658] Sum rewards: 76.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.336', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.102', 'AMMO4': '0.138', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '64.000'} [2024-08-06 05:51:07,746][52811] DAMAGECOUNT value on done: 639217.0 [2024-08-06 05:51:07,746][52811] Sum rewards: 65.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '55.000'} [2024-08-06 05:51:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 526835712. Throughput: 0: 4353.4. Samples: 131713390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:51:07,794][52567] Avg episode reward: [(0, '73.781')] [2024-08-06 05:51:08,020][52668] DAMAGECOUNT value on done: 676786.0 [2024-08-06 05:51:08,021][52668] Sum rewards: 71.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.518', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.150', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.254', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '59.000'} [2024-08-06 05:51:08,232][52671] DAMAGECOUNT value on done: 686291.0 [2024-08-06 05:51:08,233][52671] Sum rewards: 77.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.126', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:08,804][52649] DAMAGECOUNT value on done: 649146.0 [2024-08-06 05:51:08,805][52649] Sum rewards: 77.807, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.699', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO3': '0.245', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '67.000'} [2024-08-06 05:51:08,981][52669] DAMAGECOUNT value on done: 684410.0 [2024-08-06 05:51:08,982][52669] Sum rewards: 70.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.060', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '58.000'} [2024-08-06 05:51:09,524][52662] DAMAGECOUNT value on done: 689871.0 [2024-08-06 05:51:09,526][52662] Sum rewards: 74.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.293', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.143', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:09,543][52803] DAMAGECOUNT value on done: 635821.0 [2024-08-06 05:51:09,544][52803] Sum rewards: 70.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.120', 'AMMO4': '0.149', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 05:51:10,851][52671] DAMAGECOUNT value on done: 686248.0 [2024-08-06 05:51:10,852][52671] Sum rewards: 74.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.495', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.338', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '61.000'} [2024-08-06 05:51:10,921][52811] DAMAGECOUNT value on done: 635945.0 [2024-08-06 05:51:10,922][52811] Sum rewards: 89.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.594', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.171', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '73.000'} [2024-08-06 05:51:11,167][52668] DAMAGECOUNT value on done: 683411.0 [2024-08-06 05:51:11,167][52668] Sum rewards: 87.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.163', 'weapon5': '0.198', 'AMMO4': '0.238', 'weapon4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '69.000'} [2024-08-06 05:51:11,220][52649] DAMAGECOUNT value on done: 669835.0 [2024-08-06 05:51:11,220][52649] Sum rewards: 68.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.329', 'AMMO5': '0.009', 'weapon4': '0.042', 'AMMO2': '0.046', 'weapon5': '0.124', 'AMMO3': '0.191', 'AMMO4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '55.000'} [2024-08-06 05:51:12,041][52662] DAMAGECOUNT value on done: 675003.0 [2024-08-06 05:51:12,049][52662] Sum rewards: 72.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.022', 'weapon5': '0.072', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.370', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.350', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:12,095][52650] Updated weights for policy 0, policy_version 64321 (0.0025) [2024-08-06 05:51:12,130][52669] DAMAGECOUNT value on done: 690898.0 [2024-08-06 05:51:12,130][52669] Sum rewards: 68.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.217', 'AMMO4': '0.260', 'weapon5': '0.270', 'weapon4': '0.342', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.620', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '54.500'} [2024-08-06 05:51:12,540][52803] DAMAGECOUNT value on done: 628568.0 [2024-08-06 05:51:12,540][52803] Sum rewards: 79.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.408', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.144', 'AMMO4': '0.150', 'weapon2': '0.188', 'weapon5': '0.204', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 526925824. Throughput: 0: 4353.1. Samples: 131739640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:51:12,794][52567] Avg episode reward: [(0, '73.858')] [2024-08-06 05:51:13,851][52671] DAMAGECOUNT value on done: 685666.0 [2024-08-06 05:51:13,853][52671] Sum rewards: 70.646, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.114', 'AMMO3': '0.132', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.230', 'weapon2': '0.504', 'WEAPON3': '0.800', 'weapon3': '2.994', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '55.000'} [2024-08-06 05:51:14,017][52668] DAMAGECOUNT value on done: 680265.0 [2024-08-06 05:51:14,017][52668] Sum rewards: 77.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.078', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO3': '0.182', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.428', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '2.502', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:14,030][52811] DAMAGECOUNT value on done: 633422.0 [2024-08-06 05:51:14,030][52811] Sum rewards: 83.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.094', 'weapon2': '0.154', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '68.000'} [2024-08-06 05:51:14,196][52649] DAMAGECOUNT value on done: 663187.0 [2024-08-06 05:51:14,198][52649] Sum rewards: 76.965, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.092', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '64.000'} [2024-08-06 05:51:14,976][52662] DAMAGECOUNT value on done: 692736.0 [2024-08-06 05:51:14,976][52662] Sum rewards: 67.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.245', 'weapon2': '0.246', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.480', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '58.000'} [2024-08-06 05:51:15,787][52803] DAMAGECOUNT value on done: 625855.0 [2024-08-06 05:51:15,788][52803] Sum rewards: 72.900, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.334', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.150', 'weapon5': '0.150', 'weapon2': '0.172', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.296', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:16,838][52668] DAMAGECOUNT value on done: 671344.0 [2024-08-06 05:51:16,838][52668] Sum rewards: 72.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO2': '0.003', 'AMMO4': '0.017', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'weapon4': '0.222', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.380', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '59.000'} [2024-08-06 05:51:16,847][52671] DAMAGECOUNT value on done: 680916.0 [2024-08-06 05:51:16,850][52671] Sum rewards: 69.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.120', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO4': '0.195', 'weapon2': '0.218', 'AMMO3': '0.219', 'weapon4': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:16,936][52650] Updated weights for policy 0, policy_version 64331 (0.0017) [2024-08-06 05:51:16,977][52649] DAMAGECOUNT value on done: 653102.0 [2024-08-06 05:51:16,977][52649] Sum rewards: 79.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.200', 'weapon5': '0.204', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.730', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '66.000'} [2024-08-06 05:51:17,536][52662] DAMAGECOUNT value on done: 671722.0 [2024-08-06 05:51:17,567][52662] Sum rewards: 62.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.919', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.114', 'AMMO3': '0.144', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '0.850', 'weapon3': '2.854', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '51.000'} [2024-08-06 05:51:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 527015936. Throughput: 0: 4368.9. Samples: 131752920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 05:51:17,794][52567] Avg episode reward: [(0, '73.887')] [2024-08-06 05:51:18,838][52803] DAMAGECOUNT value on done: 625860.0 [2024-08-06 05:51:18,838][52803] Sum rewards: 72.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.018', 'AMMO2': '0.072', 'weapon4': '0.174', 'weapon5': '0.184', 'AMMO3': '0.243', 'weapon2': '0.324', 'AMMO4': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '61.500'} [2024-08-06 05:51:19,352][52668] DAMAGECOUNT value on done: 665826.0 [2024-08-06 05:51:19,353][52668] Sum rewards: 78.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.637', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.087', 'weapon5': '0.092', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:19,833][52660] DAMAGECOUNT value on done: 680517.0 [2024-08-06 05:51:19,833][52660] Sum rewards: 82.827, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.398', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.209', 'weapon5': '0.240', 'weapon4': '0.284', 'AMMO4': '0.285', 'weapon2': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '70.000'} [2024-08-06 05:51:20,119][52649] DAMAGECOUNT value on done: 667574.0 [2024-08-06 05:51:20,119][52649] Sum rewards: 58.954, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.190', 'AMMO5': '0.023', 'AMMO2': '0.066', 'weapon4': '0.226', 'weapon5': '0.258', 'AMMO3': '0.278', 'AMMO4': '0.331', 'weapon2': '0.446', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.652', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '52.500'} [2024-08-06 05:51:20,304][52662] DAMAGECOUNT value on done: 680183.0 [2024-08-06 05:51:20,304][52662] Sum rewards: 76.685, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.153', 'weapon4': '0.174', 'weapon5': '0.192', 'AMMO4': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:21,394][52650] Updated weights for policy 0, policy_version 64341 (0.0020) [2024-08-06 05:51:21,882][52803] DAMAGECOUNT value on done: 629205.0 [2024-08-06 05:51:21,883][52803] Sum rewards: 74.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.616', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.124', 'AMMO4': '0.159', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '61.000'} [2024-08-06 05:51:22,218][52668] DAMAGECOUNT value on done: 666406.0 [2024-08-06 05:51:22,220][52668] Sum rewards: 68.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '0.652', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '57.000'} [2024-08-06 05:51:22,719][52660] DAMAGECOUNT value on done: 668596.0 [2024-08-06 05:51:22,727][52660] Sum rewards: 84.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.621', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '67.000'} [2024-08-06 05:51:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 527097856. Throughput: 0: 4375.4. Samples: 131779230. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:22,794][52567] Avg episode reward: [(0, '74.290')] [2024-08-06 05:51:23,245][52662] DAMAGECOUNT value on done: 688948.0 [2024-08-06 05:51:23,246][52662] Sum rewards: 73.834, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.484', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.166', 'AMMO4': '0.185', 'weapon5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.118', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:23,348][52649] DAMAGECOUNT value on done: 660824.0 [2024-08-06 05:51:23,348][52649] Sum rewards: 74.189, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.334', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO4': '0.164', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '2.926', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:24,765][52668] DAMAGECOUNT value on done: 666355.0 [2024-08-06 05:51:24,766][52668] Sum rewards: 74.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.420', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.106', 'weapon2': '0.170', 'AMMO4': '0.172', 'weapon5': '0.192', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:24,969][52803] DAMAGECOUNT value on done: 627064.0 [2024-08-06 05:51:24,969][52803] Sum rewards: 83.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.655', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '69.000'} [2024-08-06 05:51:25,425][52660] DAMAGECOUNT value on done: 682693.0 [2024-08-06 05:51:25,427][52660] Sum rewards: 81.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.995', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.136', 'AMMO3': '0.187', 'weapon4': '0.196', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:26,163][52649] DAMAGECOUNT value on done: 664099.0 [2024-08-06 05:51:26,163][52649] Sum rewards: 61.003, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.150', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon4': '0.092', 'weapon5': '0.250', 'AMMO3': '0.265', 'AMMO4': '0.329', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '53.500'} [2024-08-06 05:51:26,330][52650] Updated weights for policy 0, policy_version 64351 (0.0038) [2024-08-06 05:51:26,417][52662] DAMAGECOUNT value on done: 681282.0 [2024-08-06 05:51:26,417][52662] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.030', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.066', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.294', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:26,420][52660] Large shaping reward 2.614 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('HEALTH', -0.003, -1.0), ('weapon5', 0.002)] [2024-08-06 05:51:27,250][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:51:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 527187968. Throughput: 0: 4369.8. Samples: 131805280. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:27,795][52567] Avg episode reward: [(0, '74.475')] [2024-08-06 05:51:27,806][52668] DAMAGECOUNT value on done: 678969.0 [2024-08-06 05:51:27,807][52668] Sum rewards: 75.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO2': '0.020', 'AMMO5': '0.020', 'AMMO4': '0.098', 'weapon4': '0.128', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.316', 'weapon5': '0.318', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:28,095][52803] DAMAGECOUNT value on done: 643205.0 [2024-08-06 05:51:28,096][52803] Sum rewards: 74.428, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.586', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.158', 'weapon5': '0.168', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.810', 'WEAPON3': '1.000', 'weapon3': '2.420', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:28,384][52660] DAMAGECOUNT value on done: 688814.0 [2024-08-06 05:51:28,384][52660] Sum rewards: 82.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.700', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.066', 'weapon5': '0.072', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '68.000'} [2024-08-06 05:51:28,460][52664] DAMAGECOUNT value on done: 702810.0 [2024-08-06 05:51:28,461][52664] Sum rewards: 67.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.210', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.128', 'AMMO3': '0.186', 'weapon4': '0.194', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '55.000'} [2024-08-06 05:51:29,050][52662] DAMAGECOUNT value on done: 688986.0 [2024-08-06 05:51:29,051][52662] Sum rewards: 73.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.150', 'weapon5': '0.178', 'AMMO4': '0.259', 'AMMO3': '0.264', 'weapon2': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:29,276][52649] DAMAGECOUNT value on done: 664391.0 [2024-08-06 05:51:29,276][52649] Sum rewards: 76.778, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.246', 'AMMO3': '0.269', 'WEAPON3': '1.500', 'weapon3': '3.410', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:30,647][52668] DAMAGECOUNT value on done: 677146.0 [2024-08-06 05:51:30,649][52668] Sum rewards: 83.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.144', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon4': '0.180', 'AMMO3': '0.207', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '67.000'} [2024-08-06 05:51:30,750][52650] Updated weights for policy 0, policy_version 64361 (0.0011) [2024-08-06 05:51:31,039][52664] DAMAGECOUNT value on done: 710819.0 [2024-08-06 05:51:31,040][52664] Sum rewards: 84.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.077', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.088', 'weapon5': '0.100', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '69.000'} [2024-08-06 05:51:31,144][52803] DAMAGECOUNT value on done: 631991.0 [2024-08-06 05:51:31,145][52803] Sum rewards: 61.650, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.425', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.130', 'AMMO3': '0.144', 'weapon5': '0.198', 'AMMO4': '0.242', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.512', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '2.966', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '48.000'} [2024-08-06 05:51:31,412][52660] DAMAGECOUNT value on done: 674357.0 [2024-08-06 05:51:31,415][52660] Sum rewards: 88.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.227', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.048', 'weapon4': '0.054', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.231', 'FRAGCOUNT': '70.000'} [2024-08-06 05:51:31,730][52662] DAMAGECOUNT value on done: 675679.0 [2024-08-06 05:51:31,731][52662] Sum rewards: 77.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO2': '0.005', 'AMMO4': '0.025', 'AMMO3': '0.153', 'weapon2': '0.560', 'WEAPON3': '1.050', 'weapon3': '3.320', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 05:51:32,355][52649] DAMAGECOUNT value on done: 656599.0 [2024-08-06 05:51:32,357][52649] Sum rewards: 77.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.441', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.336', 'weapon4': '0.454', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 527278080. Throughput: 0: 4369.6. Samples: 131818490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:32,802][52567] Avg episode reward: [(0, '75.012')] [2024-08-06 05:51:33,600][52664] DAMAGECOUNT value on done: 705730.0 [2024-08-06 05:51:33,603][52664] Sum rewards: 65.553, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.376', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.134', 'AMMO3': '0.143', 'AMMO4': '0.150', 'weapon5': '0.172', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.800', 'HITCOUNT': '3.070', 'weapon3': '3.168', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '52.000'} [2024-08-06 05:51:33,619][52668] DAMAGECOUNT value on done: 674220.0 [2024-08-06 05:51:33,620][52668] Sum rewards: 71.954, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.170', 'AMMO4': '0.178', 'AMMO3': '0.190', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HEALTH': '0.726', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.312', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '58.000'} [2024-08-06 05:51:34,199][52660] DAMAGECOUNT value on done: 671881.0 [2024-08-06 05:51:34,200][52660] Sum rewards: 65.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.465', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.166', 'weapon2': '0.272', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.388', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2024-08-06 05:51:34,216][52803] DAMAGECOUNT value on done: 630591.0 [2024-08-06 05:51:34,217][52803] Sum rewards: 68.133, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.132', 'AMMO4': '0.198', 'weapon5': '0.220', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 05:51:34,636][52662] DAMAGECOUNT value on done: 677122.0 [2024-08-06 05:51:34,638][52662] Sum rewards: 56.766, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.256', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.128', 'AMMO3': '0.210', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '50.000'} [2024-08-06 05:51:35,531][52649] DAMAGECOUNT value on done: 670364.0 [2024-08-06 05:51:35,533][52649] Sum rewards: 66.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.282', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.090', 'AMMO4': '0.159', 'weapon5': '0.178', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.056', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '56.000'} [2024-08-06 05:51:35,585][52650] Updated weights for policy 0, policy_version 64371 (0.0029) [2024-08-06 05:51:36,165][52668] DAMAGECOUNT value on done: 684600.0 [2024-08-06 05:51:36,166][52668] Sum rewards: 70.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.204', 'AMMO5': '0.013', 'AMMO2': '0.069', 'AMMO3': '0.214', 'weapon5': '0.226', 'weapon4': '0.272', 'weapon2': '0.282', 'AMMO4': '0.344', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '57.000'} [2024-08-06 05:51:36,800][52660] DAMAGECOUNT value on done: 675381.0 [2024-08-06 05:51:36,802][52660] Sum rewards: 81.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.998', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.072', 'weapon5': '0.142', 'AMMO4': '0.183', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '68.000'} [2024-08-06 05:51:36,987][52664] DAMAGECOUNT value on done: 699212.0 [2024-08-06 05:51:36,989][52664] Sum rewards: 71.159, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.956', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.118', 'AMMO4': '0.196', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '61.000'} [2024-08-06 05:51:37,269][52803] DAMAGECOUNT value on done: 644244.0 [2024-08-06 05:51:37,270][52803] Sum rewards: 63.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.597', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.160', 'weapon5': '0.188', 'AMMO3': '0.214', 'AMMO4': '0.250', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '52.000'} [2024-08-06 05:51:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 527368192. Throughput: 0: 4377.5. Samples: 131844970. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:37,794][52567] Avg episode reward: [(0, '74.215')] [2024-08-06 05:51:37,895][52662] DAMAGECOUNT value on done: 675656.0 [2024-08-06 05:51:37,897][52662] Sum rewards: 78.743, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.827', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.129', 'AMMO4': '0.159', 'weapon4': '0.164', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '0.850', 'weapon3': '2.892', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:38,283][52649] DAMAGECOUNT value on done: 670946.0 [2024-08-06 05:51:38,284][52649] Sum rewards: 62.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.105', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon4': '0.172', 'weapon5': '0.208', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '54.000'} [2024-08-06 05:51:38,649][52668] DAMAGECOUNT value on done: 679890.0 [2024-08-06 05:51:38,649][52668] Sum rewards: 83.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.680', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.115', 'weapon5': '0.140', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '69.000'} [2024-08-06 05:51:39,419][52660] DAMAGECOUNT value on done: 686019.0 [2024-08-06 05:51:39,420][52660] Sum rewards: 75.655, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.900', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.142', 'weapon4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '66.000'} [2024-08-06 05:51:39,970][52664] DAMAGECOUNT value on done: 711293.0 [2024-08-06 05:51:39,972][52664] Sum rewards: 84.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.190', 'weapon4': '0.214', 'weapon2': '0.234', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.889', 'FRAGCOUNT': '70.000'} [2024-08-06 05:51:40,192][52650] Updated weights for policy 0, policy_version 64381 (0.0013) [2024-08-06 05:51:40,316][52803] DAMAGECOUNT value on done: 631218.0 [2024-08-06 05:51:40,316][52803] Sum rewards: 71.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.167', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '61.000'} [2024-08-06 05:51:40,500][52662] DAMAGECOUNT value on done: 685028.0 [2024-08-06 05:51:40,503][52662] Sum rewards: 76.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.940', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.160', 'weapon4': '0.242', 'AMMO4': '0.254', 'weapon2': '0.328', 'weapon5': '0.344', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:41,250][52649] DAMAGECOUNT value on done: 669868.0 [2024-08-06 05:51:41,258][52649] Sum rewards: 81.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.234', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.476', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '67.000'} [2024-08-06 05:51:42,261][52660] DAMAGECOUNT value on done: 671956.0 [2024-08-06 05:51:42,263][52660] Sum rewards: 72.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.116', 'AMMO3': '0.179', 'AMMO4': '0.196', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.840', 'WEAPON3': '1.150', 'weapon3': '2.560', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 527450112. Throughput: 0: 4375.8. Samples: 131871050. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:42,802][52567] Avg episode reward: [(0, '74.212')] [2024-08-06 05:51:43,191][52664] DAMAGECOUNT value on done: 703439.0 [2024-08-06 05:51:43,191][52664] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.115', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO3': '0.185', 'AMMO4': '0.192', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:43,360][52803] DAMAGECOUNT value on done: 631960.0 [2024-08-06 05:51:43,360][52803] Sum rewards: 83.701, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.563', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.088', 'AMMO3': '0.209', 'weapon5': '0.212', 'AMMO4': '0.255', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '68.000'} [2024-08-06 05:51:43,564][52662] DAMAGECOUNT value on done: 676849.0 [2024-08-06 05:51:43,565][52662] Sum rewards: 69.323, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.279', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.104', 'weapon5': '0.192', 'weapon2': '0.228', 'AMMO3': '0.284', 'AMMO4': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.164', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:44,000][52649] DAMAGECOUNT value on done: 666490.0 [2024-08-06 05:51:44,001][52649] Sum rewards: 59.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.378', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.154', 'AMMO3': '0.193', 'weapon2': '0.270', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '49.000'} [2024-08-06 05:51:44,871][52660] DAMAGECOUNT value on done: 675633.0 [2024-08-06 05:51:44,872][52660] Sum rewards: 71.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.114', 'weapon5': '0.130', 'AMMO4': '0.132', 'weapon2': '0.210', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:45,149][52650] Updated weights for policy 0, policy_version 64391 (0.0012) [2024-08-06 05:51:46,152][52664] DAMAGECOUNT value on done: 700661.0 [2024-08-06 05:51:46,153][52664] Sum rewards: 62.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.140', 'weapon5': '0.178', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '53.000'} [2024-08-06 05:51:46,433][52803] DAMAGECOUNT value on done: 635807.0 [2024-08-06 05:51:46,435][52803] Sum rewards: 73.980, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.090', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.291', 'WEAPON3': '1.600', 'weapon3': '3.304', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:46,642][52649] DAMAGECOUNT value on done: 654318.0 [2024-08-06 05:51:46,643][52649] Sum rewards: 73.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.103', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.938', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:46,752][52662] DAMAGECOUNT value on done: 689035.0 [2024-08-06 05:51:46,753][52662] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.134', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO4': '0.232', 'weapon4': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '57.000'} [2024-08-06 05:51:47,251][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:51:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 527540224. Throughput: 0: 4375.3. Samples: 131884100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:47,802][52567] Avg episode reward: [(0, '74.021')] [2024-08-06 05:51:47,870][52660] DAMAGECOUNT value on done: 681572.0 [2024-08-06 05:51:47,871][52660] Sum rewards: 67.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.611', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.144', 'AMMO4': '0.164', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '57.000'} [2024-08-06 05:51:49,056][52664] DAMAGECOUNT value on done: 697588.0 [2024-08-06 05:51:49,058][52664] Sum rewards: 86.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.884', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.080', 'weapon4': '0.092', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '72.000'} [2024-08-06 05:51:49,188][52650] Updated weights for policy 0, policy_version 64401 (0.0015) [2024-08-06 05:51:49,546][52803] DAMAGECOUNT value on done: 637882.0 [2024-08-06 05:51:49,546][52803] Sum rewards: 79.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.011', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.216', 'WEAPON3': '1.200', 'weapon3': '3.440', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '65.000'} [2024-08-06 05:51:49,557][52649] DAMAGECOUNT value on done: 665771.0 [2024-08-06 05:51:49,558][52649] Sum rewards: 84.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.054', 'weapon5': '0.180', 'AMMO3': '0.235', 'AMMO4': '0.263', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '71.000'} [2024-08-06 05:51:49,913][52662] DAMAGECOUNT value on done: 685973.0 [2024-08-06 05:51:49,914][52662] Sum rewards: 86.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.418', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.254', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '3.306', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '73.000'} [2024-08-06 05:51:50,402][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:51:51,059][52660] DAMAGECOUNT value on done: 674042.0 [2024-08-06 05:51:51,062][52660] Sum rewards: 82.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.026', 'weapon5': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.458', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '69.000'} [2024-08-06 05:51:51,323][52664] DAMAGECOUNT value on done: 710539.0 [2024-08-06 05:51:51,324][52664] Sum rewards: 81.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.836', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.096', 'AMMO4': '0.166', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '67.000'} [2024-08-06 05:51:52,657][52649] DAMAGECOUNT value on done: 656551.0 [2024-08-06 05:51:52,658][52649] Sum rewards: 74.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.128', 'weapon5': '0.140', 'AMMO4': '0.172', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '62.000'} [2024-08-06 05:51:52,791][52803] DAMAGECOUNT value on done: 642515.0 [2024-08-06 05:51:52,792][52803] Sum rewards: 82.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.855', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.148', 'AMMO3': '0.181', 'weapon5': '0.184', 'weapon2': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '67.000'} [2024-08-06 05:51:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 527622144. Throughput: 0: 4378.2. Samples: 131910410. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:52,799][52567] Avg episode reward: [(0, '74.495')] [2024-08-06 05:51:52,849][52662] DAMAGECOUNT value on done: 670674.0 [2024-08-06 05:51:52,850][52662] Sum rewards: 74.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.058', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.214', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '60.000'} [2024-08-06 05:51:53,866][52664] DAMAGECOUNT value on done: 700818.0 [2024-08-06 05:51:53,867][52664] Sum rewards: 64.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO4': '0.168', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '2.982', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '54.000'} [2024-08-06 05:51:54,223][52660] DAMAGECOUNT value on done: 676766.0 [2024-08-06 05:51:54,227][52660] Sum rewards: 86.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.803', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '70.000'} [2024-08-06 05:51:54,361][52650] Updated weights for policy 0, policy_version 64411 (0.0013) [2024-08-06 05:51:55,811][52662] DAMAGECOUNT value on done: 679386.0 [2024-08-06 05:51:55,812][52662] Sum rewards: 71.224, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.900', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.120', 'weapon5': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.262', 'WEAPON5': '0.300', 'AMMO3': '0.318', 'WEAPON3': '1.800', 'HITCOUNT': '3.190', 'weapon3': '3.250', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '63.000'} [2024-08-06 05:51:55,839][52803] DAMAGECOUNT value on done: 632854.0 [2024-08-06 05:51:55,839][52803] Sum rewards: 82.410, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.255', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.125', 'weapon5': '0.172', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.184', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '68.000'} [2024-08-06 05:51:55,915][52649] DAMAGECOUNT value on done: 669311.0 [2024-08-06 05:51:55,916][52649] Sum rewards: 73.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.265', 'AMMO5': '0.015', 'AMMO2': '0.064', 'AMMO3': '0.162', 'weapon5': '0.248', 'AMMO4': '0.318', 'weapon4': '0.394', 'weapon2': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.658', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '59.500'} [2024-08-06 05:51:56,276][52660] Large shaping reward 2.697 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:51:56,372][52664] DAMAGECOUNT value on done: 710330.0 [2024-08-06 05:51:56,373][52664] Sum rewards: 85.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '68.000'} [2024-08-06 05:51:56,924][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:51:57,477][52660] DAMAGECOUNT value on done: 687687.0 [2024-08-06 05:51:57,477][52660] Sum rewards: 80.391, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.104', 'AMMO3': '0.195', 'weapon5': '0.236', 'AMMO4': '0.271', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '64.500'} [2024-08-06 05:51:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 527712256. Throughput: 0: 4377.3. Samples: 131936620. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 05:51:57,795][52567] Avg episode reward: [(0, '74.786')] [2024-08-06 05:51:58,939][52662] DAMAGECOUNT value on done: 672070.0 [2024-08-06 05:51:58,941][52662] Sum rewards: 61.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.241', 'weapon2': '0.242', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.290', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '52.000'} [2024-08-06 05:51:58,942][52650] Updated weights for policy 0, policy_version 64421 (0.0024) [2024-08-06 05:51:59,060][52649] DAMAGECOUNT value on done: 669301.0 [2024-08-06 05:51:59,061][52649] Sum rewards: 83.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.213', 'AMMO2': '0.003', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon5': '0.132', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.366', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '70.000'} [2024-08-06 05:51:59,271][52664] DAMAGECOUNT value on done: 712471.0 [2024-08-06 05:51:59,271][52664] Sum rewards: 78.173, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.054', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.269', 'WEAPON3': '1.550', 'weapon3': '3.478', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '66.000'} [2024-08-06 05:52:00,251][52659] DAMAGECOUNT value on done: 683607.0 [2024-08-06 05:52:00,252][52659] Sum rewards: 80.590, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.100', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.108', 'AMMO3': '0.179', 'weapon5': '0.214', 'AMMO4': '0.249', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 05:52:00,457][52660] DAMAGECOUNT value on done: 695195.0 [2024-08-06 05:52:00,459][52660] Sum rewards: 84.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.106', 'AMMO4': '0.150', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.232', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '70.000'} [2024-08-06 05:52:01,893][52664] DAMAGECOUNT value on done: 710017.0 [2024-08-06 05:52:01,893][52664] Sum rewards: 74.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.601', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.164', 'weapon4': '0.170', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 05:52:02,026][52649] DAMAGECOUNT value on done: 662369.0 [2024-08-06 05:52:02,027][52649] Sum rewards: 69.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO3': '0.153', 'AMMO4': '0.164', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'weapon4': '0.438', 'WEAPON3': '0.900', 'weapon3': '2.788', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 05:52:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 527802368. Throughput: 0: 4377.1. Samples: 131949890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:02,794][52567] Avg episode reward: [(0, '74.892')] [2024-08-06 05:52:03,300][52660] DAMAGECOUNT value on done: 674545.0 [2024-08-06 05:52:03,304][52660] Sum rewards: 78.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.255', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.113', 'weapon5': '0.120', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '68.000'} [2024-08-06 05:52:03,463][52659] DAMAGECOUNT value on done: 679665.0 [2024-08-06 05:52:03,465][52659] Sum rewards: 68.533, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.075', 'AMMO5': '0.022', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.156', 'AMMO4': '0.173', 'AMMO3': '0.266', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '59.000'} [2024-08-06 05:52:03,651][52650] Updated weights for policy 0, policy_version 64431 (0.0012) [2024-08-06 05:52:04,707][52664] DAMAGECOUNT value on done: 712009.0 [2024-08-06 05:52:04,709][52664] Sum rewards: 78.613, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.244', 'AMMO5': '0.025', 'AMMO2': '0.043', 'weapon4': '0.076', 'weapon5': '0.126', 'AMMO4': '0.216', 'AMMO3': '0.280', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.144', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '69.000'} [2024-08-06 05:52:04,839][52803] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 05:52:05,934][52660] DAMAGECOUNT value on done: 684432.0 [2024-08-06 05:52:05,934][52660] Sum rewards: 72.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.548', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.216', 'weapon4': '0.230', 'weapon5': '0.244', 'AMMO4': '0.262', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.706', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '58.500'} [2024-08-06 05:52:06,538][52659] DAMAGECOUNT value on done: 683314.0 [2024-08-06 05:52:06,538][52659] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.152', 'weapon4': '0.190', 'AMMO4': '0.195', 'AMMO3': '0.215', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.158', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '54.000'} [2024-08-06 05:52:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 527892480. Throughput: 0: 4377.8. Samples: 131976230. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:07,794][52567] Avg episode reward: [(0, '74.831')] [2024-08-06 05:52:07,916][52664] DAMAGECOUNT value on done: 715170.0 [2024-08-06 05:52:07,916][52664] Sum rewards: 81.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '67.000'} [2024-08-06 05:52:08,029][52650] Updated weights for policy 0, policy_version 64441 (0.0020) [2024-08-06 05:52:08,946][52660] DAMAGECOUNT value on done: 677682.0 [2024-08-06 05:52:08,946][52660] Sum rewards: 73.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.936', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.166', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.284', 'weapon2': '0.368', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2024-08-06 05:52:09,467][52659] DAMAGECOUNT value on done: 678528.0 [2024-08-06 05:52:09,468][52659] Sum rewards: 58.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.108', 'AMMO4': '0.149', 'weapon2': '0.178', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '3.462', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '49.500'} [2024-08-06 05:52:10,550][52664] DAMAGECOUNT value on done: 707605.0 [2024-08-06 05:52:10,551][52664] Sum rewards: 79.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.709', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '3.406', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '64.000'} [2024-08-06 05:52:11,523][52660] DAMAGECOUNT value on done: 675275.0 [2024-08-06 05:52:11,524][52660] Sum rewards: 81.536, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.545', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.302', 'weapon4': '0.398', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '64.000'} [2024-08-06 05:52:12,711][52659] DAMAGECOUNT value on done: 677378.0 [2024-08-06 05:52:12,712][52659] Sum rewards: 73.638, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.410', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.088', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '63.000'} [2024-08-06 05:52:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 527974400. Throughput: 0: 4387.1. Samples: 132002700. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:12,794][52567] Avg episode reward: [(0, '74.667')] [2024-08-06 05:52:12,879][52664] DAMAGECOUNT value on done: 702501.0 [2024-08-06 05:52:12,879][52664] Sum rewards: 68.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.288', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.068', 'AMMO4': '0.074', 'weapon4': '0.074', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.554', 'WEAPON3': '1.600', 'weapon3': '3.094', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:13,071][52650] Updated weights for policy 0, policy_version 64451 (0.0012) [2024-08-06 05:52:13,907][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:52:14,258][52665] DAMAGECOUNT value on done: 666013.0 [2024-08-06 05:52:14,261][52665] Sum rewards: 68.015, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.198', 'weapon2': '0.696', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '55.000'} [2024-08-06 05:52:14,388][52660] DAMAGECOUNT value on done: 669088.0 [2024-08-06 05:52:14,391][52660] Sum rewards: 68.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.150', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.472', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:15,540][52664] DAMAGECOUNT value on done: 706798.0 [2024-08-06 05:52:15,540][52664] Sum rewards: 80.608, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.290', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.162', 'weapon2': '0.194', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '66.000'} [2024-08-06 05:52:15,885][52659] DAMAGECOUNT value on done: 684153.0 [2024-08-06 05:52:15,886][52659] Sum rewards: 76.853, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.632', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.118', 'weapon4': '0.134', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '62.000'} [2024-08-06 05:52:17,355][52650] Updated weights for policy 0, policy_version 64461 (0.0025) [2024-08-06 05:52:17,455][52665] DAMAGECOUNT value on done: 683536.0 [2024-08-06 05:52:17,457][52665] Sum rewards: 66.019, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.173', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.166', 'AMMO3': '0.172', 'AMMO4': '0.209', 'weapon4': '0.212', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.088', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '52.000'} [2024-08-06 05:52:17,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 528064512. Throughput: 0: 4384.4. Samples: 132015790. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:17,802][52567] Avg episode reward: [(0, '74.471')] [2024-08-06 05:52:18,428][52664] DAMAGECOUNT value on done: 705891.0 [2024-08-06 05:52:18,429][52664] Sum rewards: 81.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.146', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.264', 'weapon2': '0.468', 'WEAPON3': '1.700', 'weapon3': '3.312', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '69.000'} [2024-08-06 05:52:18,968][52659] DAMAGECOUNT value on done: 681299.0 [2024-08-06 05:52:18,968][52659] Sum rewards: 80.490, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.491', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '3.262', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '63.000'} [2024-08-06 05:52:19,147][52667] DAMAGECOUNT value on done: 681129.0 [2024-08-06 05:52:19,148][52667] Sum rewards: 67.487, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.505', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.680', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '56.000'} [2024-08-06 05:52:20,182][52665] DAMAGECOUNT value on done: 680604.0 [2024-08-06 05:52:20,182][52665] Sum rewards: 79.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.860', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.058', 'AMMO4': '0.147', 'weapon5': '0.156', 'AMMO3': '0.195', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.270', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '64.000'} [2024-08-06 05:52:20,871][52794] DAMAGECOUNT value on done: 680798.0 [2024-08-06 05:52:20,872][52794] Sum rewards: 79.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.124', 'AMMO4': '0.161', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '65.000'} [2024-08-06 05:52:21,548][52664] DAMAGECOUNT value on done: 704548.0 [2024-08-06 05:52:21,548][52664] Sum rewards: 72.149, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.042', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.123', 'WEAPON5': '0.200', 'weapon2': '0.584', 'WEAPON3': '0.850', 'weapon3': '3.176', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '55.000'} [2024-08-06 05:52:21,556][52614] Signal inference workers to stop experience collection... (11700 times) [2024-08-06 05:52:21,557][52614] Signal inference workers to resume experience collection... (11700 times) [2024-08-06 05:52:21,629][52650] InferenceWorker_p0-w0: stopping experience collection (11700 times) [2024-08-06 05:52:21,629][52650] InferenceWorker_p0-w0: resuming experience collection (11700 times) [2024-08-06 05:52:21,760][52659] DAMAGECOUNT value on done: 677168.0 [2024-08-06 05:52:21,763][52659] Sum rewards: 77.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.725', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon2': '0.226', 'weapon5': '0.230', 'AMMO3': '0.260', 'weapon4': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.852', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '65.000'} [2024-08-06 05:52:21,998][52667] DAMAGECOUNT value on done: 688533.0 [2024-08-06 05:52:21,999][52667] Sum rewards: 71.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.258', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.157', 'AMMO4': '0.168', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.312', 'WEAPON5': '0.350', 'weapon5': '0.356', 'WEAPON3': '0.900', 'weapon3': '2.794', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:22,249][52650] Updated weights for policy 0, policy_version 64471 (0.0011) [2024-08-06 05:52:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 528146432. Throughput: 0: 4375.3. Samples: 132041860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:22,794][52567] Avg episode reward: [(0, '74.790')] [2024-08-06 05:52:23,019][52665] DAMAGECOUNT value on done: 674493.0 [2024-08-06 05:52:23,019][52665] Sum rewards: 72.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.586', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.064', 'weapon5': '0.106', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '60.000'} [2024-08-06 05:52:23,883][52794] DAMAGECOUNT value on done: 687465.0 [2024-08-06 05:52:23,883][52794] Sum rewards: 65.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.100', 'weapon5': '0.144', 'AMMO4': '0.227', 'AMMO3': '0.235', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '55.000'} [2024-08-06 05:52:24,204][52659] DAMAGECOUNT value on done: 683353.0 [2024-08-06 05:52:24,206][52659] Sum rewards: 71.760, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.163', 'AMMO2': '0.003', 'AMMO5': '0.006', 'AMMO4': '0.013', 'weapon4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.290', 'weapon3': '3.338', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '59.000'} [2024-08-06 05:52:25,076][52667] DAMAGECOUNT value on done: 683507.0 [2024-08-06 05:52:25,078][52667] Sum rewards: 76.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.065', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '62.000'} [2024-08-06 05:52:25,925][52665] DAMAGECOUNT value on done: 662583.0 [2024-08-06 05:52:25,928][52665] Sum rewards: 78.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.321', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'weapon2': '0.190', 'AMMO3': '0.195', 'WEAPON3': '1.300', 'weapon3': '3.592', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '65.000'} [2024-08-06 05:52:26,606][52794] DAMAGECOUNT value on done: 690037.0 [2024-08-06 05:52:26,606][52794] Sum rewards: 77.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.094', 'weapon4': '0.110', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '63.000'} [2024-08-06 05:52:26,832][52659] DAMAGECOUNT value on done: 688225.0 [2024-08-06 05:52:26,835][52659] Sum rewards: 81.881, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.075', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.107', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '0.950', 'weapon3': '3.092', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '64.000'} [2024-08-06 05:52:26,941][52650] Updated weights for policy 0, policy_version 64481 (0.0012) [2024-08-06 05:52:27,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 528244736. Throughput: 0: 4381.8. Samples: 132068230. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:27,802][52567] Avg episode reward: [(0, '74.773')] [2024-08-06 05:52:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064483_528244736.pth... [2024-08-06 05:52:27,924][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000063971_524050432.pth [2024-08-06 05:52:28,009][52667] DAMAGECOUNT value on done: 687147.0 [2024-08-06 05:52:28,009][52667] Sum rewards: 84.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.685', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon2': '0.212', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'weapon3': '3.626', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.117', 'FRAGCOUNT': '70.000'} [2024-08-06 05:52:28,161][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:52:28,335][52669] Large shaping reward 3.306 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.255, 85.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:52:29,103][52794] DAMAGECOUNT value on done: 677905.0 [2024-08-06 05:52:29,104][52794] Sum rewards: 68.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.366', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.164', 'weapon5': '0.252', 'AMMO4': '0.277', 'weapon4': '0.302', 'weapon2': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '56.000'} [2024-08-06 05:52:29,120][52665] DAMAGECOUNT value on done: 668802.0 [2024-08-06 05:52:29,120][52665] Sum rewards: 70.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.936', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.108', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:29,151][52659] DAMAGECOUNT value on done: 675881.0 [2024-08-06 05:52:29,151][52659] Sum rewards: 60.258, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.176', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.160', 'weapon5': '0.160', 'AMMO4': '0.189', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '53.000'} [2024-08-06 05:52:31,182][52667] DAMAGECOUNT value on done: 686701.0 [2024-08-06 05:52:31,185][52667] Sum rewards: 65.825, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.366', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.122', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.254', 'AMMO3': '0.307', 'WEAPON3': '1.700', 'weapon3': '3.294', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:31,490][52650] Updated weights for policy 0, policy_version 64491 (0.0012) [2024-08-06 05:52:31,705][52659] DAMAGECOUNT value on done: 687324.0 [2024-08-06 05:52:31,705][52659] Sum rewards: 85.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.442', 'HITCOUNT': '4.270', 'DAMAGECOUNT': '20.718', 'FRAGCOUNT': '71.000'} [2024-08-06 05:52:31,882][52794] DAMAGECOUNT value on done: 678577.0 [2024-08-06 05:52:31,884][52794] Sum rewards: 70.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.599', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.078', 'weapon5': '0.154', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '56.000'} [2024-08-06 05:52:32,034][52665] DAMAGECOUNT value on done: 674041.0 [2024-08-06 05:52:32,034][52665] Sum rewards: 64.129, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-4.140', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.138', 'weapon5': '0.160', 'AMMO4': '0.256', 'weapon2': '0.350', 'WEAPON5': '0.400', 'AMMO3': '0.404', 'WEAPON4': '0.500', 'WEAPON3': '2.300', 'weapon3': '2.930', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '60.000'} [2024-08-06 05:52:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 528326656. Throughput: 0: 4375.6. Samples: 132081000. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:32,795][52567] Avg episode reward: [(0, '74.497')] [2024-08-06 05:52:34,136][52667] DAMAGECOUNT value on done: 690913.0 [2024-08-06 05:52:34,136][52667] Sum rewards: 77.226, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.814', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.322', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '62.000'} [2024-08-06 05:52:34,569][52659] DAMAGECOUNT value on done: 678676.0 [2024-08-06 05:52:34,571][52659] Sum rewards: 60.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.230', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.125', 'weapon5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.294', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '52.000'} [2024-08-06 05:52:34,981][52794] DAMAGECOUNT value on done: 681064.0 [2024-08-06 05:52:34,983][52794] Sum rewards: 72.819, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.132', 'weapon4': '0.172', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.204', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:35,112][52665] DAMAGECOUNT value on done: 672320.0 [2024-08-06 05:52:35,112][52665] Sum rewards: 74.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.036', 'AMMO4': '0.115', 'weapon5': '0.166', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '61.000'} [2024-08-06 05:52:36,200][52650] Updated weights for policy 0, policy_version 64501 (0.0021) [2024-08-06 05:52:36,284][52665] Large shaping reward 2.752 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 05:52:37,189][52667] DAMAGECOUNT value on done: 685527.0 [2024-08-06 05:52:37,189][52667] Sum rewards: 64.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.992', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.136', 'weapon2': '0.184', 'weapon5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.230', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '55.000'} [2024-08-06 05:52:37,345][52659] DAMAGECOUNT value on done: 681873.0 [2024-08-06 05:52:37,346][52659] Sum rewards: 75.786, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.642', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.169', 'weapon4': '0.184', 'weapon5': '0.226', 'AMMO4': '0.229', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.844', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '61.000'} [2024-08-06 05:52:37,697][52647] DAMAGECOUNT value on done: 723175.0 [2024-08-06 05:52:37,700][52647] Sum rewards: 79.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.234', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.213', 'weapon2': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '65.000'} [2024-08-06 05:52:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 528416768. Throughput: 0: 4381.6. Samples: 132107580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:52:37,794][52567] Avg episode reward: [(0, '74.097')] [2024-08-06 05:52:38,038][52794] DAMAGECOUNT value on done: 686240.0 [2024-08-06 05:52:38,038][52794] Sum rewards: 67.204, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.008', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.394', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.404', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '57.000'} [2024-08-06 05:52:38,241][52665] DAMAGECOUNT value on done: 681768.0 [2024-08-06 05:52:38,241][52665] Sum rewards: 67.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.245', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.166', 'AMMO3': '0.184', 'weapon5': '0.230', 'AMMO4': '0.266', 'weapon2': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.922', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '54.500'} [2024-08-06 05:52:40,036][52647] DAMAGECOUNT value on done: 715020.0 [2024-08-06 05:52:40,036][52647] Sum rewards: 91.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.627', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.180', 'weapon4': '0.234', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.266', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '74.000'} [2024-08-06 05:52:40,156][52667] DAMAGECOUNT value on done: 683585.0 [2024-08-06 05:52:40,156][52667] Sum rewards: 74.252, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.684', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.157', 'weapon2': '0.196', 'AMMO4': '0.337', 'weapon5': '0.356', 'weapon4': '0.468', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '59.000'} [2024-08-06 05:52:40,186][52659] DAMAGECOUNT value on done: 691504.0 [2024-08-06 05:52:40,188][52659] Sum rewards: 67.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.004', 'weapon5': '0.024', 'AMMO2': '0.034', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.213', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.384', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 05:52:40,790][52794] DAMAGECOUNT value on done: 673933.0 [2024-08-06 05:52:40,791][52794] Sum rewards: 72.970, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon5': '0.114', 'weapon4': '0.160', 'AMMO3': '0.228', 'AMMO4': '0.260', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '62.000'} [2024-08-06 05:52:41,227][52665] DAMAGECOUNT value on done: 673061.0 [2024-08-06 05:52:41,229][52665] Sum rewards: 80.958, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.076', 'weapon4': '0.144', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '64.000'} [2024-08-06 05:52:41,361][52650] Updated weights for policy 0, policy_version 64511 (0.0009) [2024-08-06 05:52:42,685][52647] DAMAGECOUNT value on done: 720276.0 [2024-08-06 05:52:42,687][52647] Sum rewards: 78.430, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.368', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.114', 'AMMO4': '0.167', 'weapon5': '0.182', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '68.000'} [2024-08-06 05:52:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 528506880. Throughput: 0: 4380.2. Samples: 132133730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:52:42,794][52567] Avg episode reward: [(0, '74.670')] [2024-08-06 05:52:43,133][52664] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:52:43,173][52659] DAMAGECOUNT value on done: 684725.0 [2024-08-06 05:52:43,173][52659] Sum rewards: 93.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.161', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.081', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.155', 'FRAGCOUNT': '75.000'} [2024-08-06 05:52:43,195][52667] DAMAGECOUNT value on done: 688311.0 [2024-08-06 05:52:43,196][52667] Sum rewards: 65.709, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.048', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.072', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.285', 'weapon2': '0.366', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:43,430][52794] DAMAGECOUNT value on done: 686360.0 [2024-08-06 05:52:43,432][52794] Sum rewards: 62.186, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.935', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.127', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.279', 'WEAPON3': '1.600', 'HITCOUNT': '3.080', 'weapon3': '3.372', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '55.000'} [2024-08-06 05:52:44,407][52665] DAMAGECOUNT value on done: 682277.0 [2024-08-06 05:52:44,409][52665] Sum rewards: 78.694, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.384', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '65.000'} [2024-08-06 05:52:45,397][52647] DAMAGECOUNT value on done: 719516.0 [2024-08-06 05:52:45,407][52647] Sum rewards: 64.101, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.390', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon2': '0.234', 'AMMO4': '0.254', 'AMMO3': '0.257', 'weapon5': '0.258', 'weapon4': '0.338', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.836', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '56.000'} [2024-08-06 05:52:45,504][52650] Updated weights for policy 0, policy_version 64521 (0.0012) [2024-08-06 05:52:46,151][52659] DAMAGECOUNT value on done: 688303.0 [2024-08-06 05:52:46,152][52659] Sum rewards: 71.204, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.566', 'AMMO5': '0.010', 'weapon4': '0.022', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '57.000'} [2024-08-06 05:52:46,193][52794] DAMAGECOUNT value on done: 676993.0 [2024-08-06 05:52:46,195][52794] Sum rewards: 80.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.845', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.102', 'weapon2': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON3': '1.350', 'HITCOUNT': '3.640', 'weapon3': '3.642', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '66.000'} [2024-08-06 05:52:46,308][52667] DAMAGECOUNT value on done: 692101.0 [2024-08-06 05:52:46,308][52667] Sum rewards: 75.063, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.147', 'weapon5': '0.168', 'AMMO4': '0.208', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '0.900', 'weapon3': '2.896', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '58.000'} [2024-08-06 05:52:47,492][52665] DAMAGECOUNT value on done: 679183.0 [2024-08-06 05:52:47,492][52665] Sum rewards: 81.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.828', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.174', 'AMMO3': '0.175', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '66.000'} [2024-08-06 05:52:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 528588800. Throughput: 0: 4375.3. Samples: 132146780. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:52:47,794][52567] Avg episode reward: [(0, '74.658')] [2024-08-06 05:52:48,219][52647] DAMAGECOUNT value on done: 726862.0 [2024-08-06 05:52:48,219][52647] Sum rewards: 80.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.484', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '66.000'} [2024-08-06 05:52:48,790][52659] DAMAGECOUNT value on done: 676868.0 [2024-08-06 05:52:48,790][52659] Sum rewards: 72.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.053', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.608', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '59.000'} [2024-08-06 05:52:49,290][52667] DAMAGECOUNT value on done: 680484.0 [2024-08-06 05:52:49,293][52667] Sum rewards: 69.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.007', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.048', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '56.500'} [2024-08-06 05:52:49,377][52794] DAMAGECOUNT value on done: 675472.0 [2024-08-06 05:52:49,377][52794] Sum rewards: 73.686, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.230', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.124', 'weapon5': '0.156', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.000'} [2024-08-06 05:52:50,335][52650] Updated weights for policy 0, policy_version 64531 (0.0013) [2024-08-06 05:52:50,710][52665] DAMAGECOUNT value on done: 678534.0 [2024-08-06 05:52:50,712][52665] Sum rewards: 82.545, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.636', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '66.000'} [2024-08-06 05:52:50,908][52647] DAMAGECOUNT value on done: 723417.0 [2024-08-06 05:52:50,909][52647] Sum rewards: 57.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.401', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.136', 'AMMO4': '0.177', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.296', 'DAMAGECOUNT': '14.736', 'FRAGCOUNT': '47.000'} [2024-08-06 05:52:51,943][52659] DAMAGECOUNT value on done: 689750.0 [2024-08-06 05:52:51,946][52659] Sum rewards: 80.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.632', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.340', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '67.000'} [2024-08-06 05:52:52,050][52667] DAMAGECOUNT value on done: 681693.0 [2024-08-06 05:52:52,051][52667] Sum rewards: 75.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.120', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.086', 'AMMO4': '0.133', 'AMMO3': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.636', 'WEAPON3': '0.900', 'weapon3': '3.062', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 05:52:52,673][52794] DAMAGECOUNT value on done: 683009.0 [2024-08-06 05:52:52,674][52794] Sum rewards: 56.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.440', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.246', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '48.000'} [2024-08-06 05:52:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 528678912. Throughput: 0: 4369.8. Samples: 132172870. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:52:52,794][52567] Avg episode reward: [(0, '74.621')] [2024-08-06 05:52:53,345][52647] DAMAGECOUNT value on done: 721972.0 [2024-08-06 05:52:53,345][52647] Sum rewards: 78.032, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.337', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.142', 'weapon5': '0.212', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '67.000'} [2024-08-06 05:52:54,172][52665] DAMAGECOUNT value on done: 672780.0 [2024-08-06 05:52:54,173][52665] Sum rewards: 73.143, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.707', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.190', 'weapon5': '0.228', 'AMMO4': '0.229', 'weapon4': '0.284', 'weapon2': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '60.000'} [2024-08-06 05:52:54,497][52667] DAMAGECOUNT value on done: 688001.0 [2024-08-06 05:52:54,498][52667] Sum rewards: 78.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.183', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.126', 'weapon5': '0.130', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON3': '1.100', 'weapon3': '3.340', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '63.000'} [2024-08-06 05:52:55,016][52650] Updated weights for policy 0, policy_version 64541 (0.0010) [2024-08-06 05:52:55,084][52659] DAMAGECOUNT value on done: 679734.0 [2024-08-06 05:52:55,085][52659] Sum rewards: 68.730, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.290', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.110', 'AMMO3': '0.155', 'AMMO4': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '3.236', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '55.000'} [2024-08-06 05:52:55,168][52658] Large shaping reward 2.590 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon5', 0.002)] [2024-08-06 05:52:55,702][52794] DAMAGECOUNT value on done: 677808.0 [2024-08-06 05:52:55,702][52794] Sum rewards: 70.114, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.815', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.183', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '57.000'} [2024-08-06 05:52:56,493][52647] DAMAGECOUNT value on done: 705671.0 [2024-08-06 05:52:56,501][52647] Sum rewards: 79.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.929', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.066', 'AMMO4': '0.201', 'AMMO3': '0.221', 'weapon5': '0.252', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.871', 'FRAGCOUNT': '65.000'} [2024-08-06 05:52:56,646][52665] DAMAGECOUNT value on done: 672215.0 [2024-08-06 05:52:56,647][52665] Sum rewards: 72.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.012', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.186', 'AMMO3': '0.223', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '61.000'} [2024-08-06 05:52:57,480][52667] DAMAGECOUNT value on done: 678810.0 [2024-08-06 05:52:57,482][52667] Sum rewards: 63.248, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.512', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.032', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.234', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '52.000'} [2024-08-06 05:52:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 528760832. Throughput: 0: 4367.1. Samples: 132199220. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:52:57,794][52567] Avg episode reward: [(0, '74.224')] [2024-08-06 05:52:59,012][52794] DAMAGECOUNT value on done: 692714.0 [2024-08-06 05:52:59,013][52794] Sum rewards: 70.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.394', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.098', 'weapon4': '0.116', 'AMMO4': '0.119', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.050', 'weapon3': '2.978', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '56.000'} [2024-08-06 05:52:59,268][52803] Large shaping reward 2.524 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0)] [2024-08-06 05:52:59,433][52663] DAMAGECOUNT value on done: 694714.0 [2024-08-06 05:52:59,433][52663] Sum rewards: 89.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.801', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.512', 'HITCOUNT': '4.330', 'DAMAGECOUNT': '22.146', 'FRAGCOUNT': '73.000'} [2024-08-06 05:52:59,612][52647] DAMAGECOUNT value on done: 721619.0 [2024-08-06 05:52:59,613][52647] Sum rewards: 77.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.084', 'AMMO3': '0.247', 'weapon5': '0.250', 'AMMO4': '0.294', 'weapon2': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '65.000'} [2024-08-06 05:52:59,621][52665] DAMAGECOUNT value on done: 673667.0 [2024-08-06 05:52:59,621][52665] Sum rewards: 75.418, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.650', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.066', 'weapon4': '0.226', 'weapon5': '0.226', 'AMMO3': '0.264', 'weapon2': '0.328', 'AMMO4': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.882', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '64.000'} [2024-08-06 05:52:59,740][52650] Updated weights for policy 0, policy_version 64551 (0.0024) [2024-08-06 05:53:00,185][52667] DAMAGECOUNT value on done: 686596.0 [2024-08-06 05:53:00,185][52667] Sum rewards: 74.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.498', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.082', 'AMMO3': '0.183', 'weapon4': '0.210', 'AMMO4': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:02,147][52665] DAMAGECOUNT value on done: 672949.0 [2024-08-06 05:53:02,156][52665] Sum rewards: 79.176, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.698', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.104', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '69.000'} [2024-08-06 05:53:02,310][52794] DAMAGECOUNT value on done: 675261.0 [2024-08-06 05:53:02,311][52794] Sum rewards: 69.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.179', 'weapon5': '0.196', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'weapon4': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.606', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '56.000'} [2024-08-06 05:53:02,456][52663] DAMAGECOUNT value on done: 681984.0 [2024-08-06 05:53:02,458][52663] Sum rewards: 85.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.098', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.262', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'weapon3': '3.386', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '73.000'} [2024-08-06 05:53:02,742][52647] DAMAGECOUNT value on done: 719546.0 [2024-08-06 05:53:02,745][52647] Sum rewards: 81.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.691', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.166', 'AMMO3': '0.188', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:02,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 528842752. Throughput: 0: 4366.3. Samples: 132212270. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:53:02,795][52567] Avg episode reward: [(0, '74.269')] [2024-08-06 05:53:03,145][52667] DAMAGECOUNT value on done: 692872.0 [2024-08-06 05:53:03,147][52667] Sum rewards: 69.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.920', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.099', 'weapon5': '0.112', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.386', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:04,386][52650] Updated weights for policy 0, policy_version 64561 (0.0014) [2024-08-06 05:53:04,819][52665] DAMAGECOUNT value on done: 667323.0 [2024-08-06 05:53:04,819][52665] Sum rewards: 61.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.946', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.226', 'weapon2': '0.412', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.378', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '52.000'} [2024-08-06 05:53:05,192][52794] DAMAGECOUNT value on done: 689230.0 [2024-08-06 05:53:05,195][52794] Sum rewards: 69.645, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.755', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.141', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '0.900', 'HITCOUNT': '3.100', 'weapon3': '3.256', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '56.000'} [2024-08-06 05:53:05,235][52663] DAMAGECOUNT value on done: 675981.0 [2024-08-06 05:53:05,236][52663] Sum rewards: 74.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.106', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.116', 'weapon4': '0.120', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:05,320][52647] DAMAGECOUNT value on done: 717005.0 [2024-08-06 05:53:05,320][52647] Sum rewards: 82.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.092', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.239', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:05,381][52671] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2024-08-06 05:53:06,528][52667] DAMAGECOUNT value on done: 690169.0 [2024-08-06 05:53:06,529][52667] Sum rewards: 75.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.128', 'weapon4': '0.152', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:07,646][52663] DAMAGECOUNT value on done: 680247.0 [2024-08-06 05:53:07,654][52663] Sum rewards: 81.334, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.275', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '3.378', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '70.000'} [2024-08-06 05:53:07,700][52794] DAMAGECOUNT value on done: 683681.0 [2024-08-06 05:53:07,701][52794] Sum rewards: 72.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 528932864. Throughput: 0: 4370.4. Samples: 132238530. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:53:07,795][52567] Avg episode reward: [(0, '73.988')] [2024-08-06 05:53:07,836][52665] DAMAGECOUNT value on done: 672103.0 [2024-08-06 05:53:07,836][52665] Sum rewards: 84.119, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.564', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.072', 'weapon4': '0.080', 'AMMO4': '0.090', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.608', 'WEAPON3': '1.000', 'weapon3': '3.042', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:07,980][52647] DAMAGECOUNT value on done: 710395.0 [2024-08-06 05:53:07,983][52647] Sum rewards: 68.513, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.020', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'weapon2': '0.316', 'WEAPON3': '1.850', 'weapon3': '3.332', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:09,184][52650] Updated weights for policy 0, policy_version 64571 (0.0017) [2024-08-06 05:53:09,652][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:53:09,712][52667] DAMAGECOUNT value on done: 690232.0 [2024-08-06 05:53:09,712][52667] Sum rewards: 70.802, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.152', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.142', 'AMMO3': '0.167', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '56.000'} [2024-08-06 05:53:09,969][52670] DAMAGECOUNT value on done: 673893.0 [2024-08-06 05:53:09,971][52670] Sum rewards: 68.100, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.811', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.150', 'weapon5': '0.310', 'AMMO4': '0.314', 'WEAPON4': '0.350', 'weapon4': '0.394', 'WEAPON5': '0.500', 'weapon2': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.310', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '53.000'} [2024-08-06 05:53:10,110][52665] DAMAGECOUNT value on done: 676357.0 [2024-08-06 05:53:10,111][52665] Sum rewards: 71.093, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.456', 'HEALTH': '0.580', 'WEAPON3': '0.850', 'weapon3': '3.156', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '55.000'} [2024-08-06 05:53:10,139][52663] DAMAGECOUNT value on done: 684166.0 [2024-08-06 05:53:10,139][52663] Sum rewards: 71.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.024', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.184', 'AMMO4': '0.198', 'AMMO3': '0.235', 'weapon5': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.588', 'WEAPON3': '1.450', 'weapon3': '2.696', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:10,433][52794] DAMAGECOUNT value on done: 689266.0 [2024-08-06 05:53:10,433][52794] Sum rewards: 63.489, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.070', 'weapon5': '0.192', 'AMMO3': '0.228', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.886', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '54.000'} [2024-08-06 05:53:11,168][52647] DAMAGECOUNT value on done: 724503.0 [2024-08-06 05:53:11,168][52647] Sum rewards: 65.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.174', 'AMMO3': '0.195', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '55.000'} [2024-08-06 05:53:11,366][52666] DAMAGECOUNT value on done: 683849.0 [2024-08-06 05:53:11,368][52666] Sum rewards: 84.204, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.158', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.168', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.084', 'FRAGCOUNT': '68.000'} [2024-08-06 05:53:12,644][52663] DAMAGECOUNT value on done: 691844.0 [2024-08-06 05:53:12,652][52663] Sum rewards: 66.319, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.136', 'weapon5': '0.142', 'AMMO4': '0.160', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '56.500'} [2024-08-06 05:53:12,673][52667] DAMAGECOUNT value on done: 683232.0 [2024-08-06 05:53:12,674][52667] Sum rewards: 75.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.134', 'weapon5': '0.156', 'AMMO3': '0.220', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '64.000'} [2024-08-06 05:53:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 529022976. Throughput: 0: 4366.9. Samples: 132264740. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:53:12,794][52567] Avg episode reward: [(0, '73.789')] [2024-08-06 05:53:13,052][52794] DAMAGECOUNT value on done: 692884.0 [2024-08-06 05:53:13,054][52794] Sum rewards: 89.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.194', 'weapon4': '0.204', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.597', 'FRAGCOUNT': '71.000'} [2024-08-06 05:53:13,148][52670] DAMAGECOUNT value on done: 684839.0 [2024-08-06 05:53:13,148][52670] Sum rewards: 85.361, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.087', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.228', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'weapon3': '3.496', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '71.000'} [2024-08-06 05:53:13,926][52650] Updated weights for policy 0, policy_version 64581 (0.0013) [2024-08-06 05:53:14,160][52647] DAMAGECOUNT value on done: 712567.0 [2024-08-06 05:53:14,161][52647] Sum rewards: 70.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.148', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.484', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:14,469][52666] DAMAGECOUNT value on done: 681293.0 [2024-08-06 05:53:14,471][52666] Sum rewards: 62.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.554', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.058', 'AMMO3': '0.189', 'AMMO4': '0.194', 'weapon5': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.810', 'weapon3': '3.094', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '51.500'} [2024-08-06 05:53:15,351][52663] DAMAGECOUNT value on done: 679449.0 [2024-08-06 05:53:15,353][52663] Sum rewards: 82.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.395', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.044', 'AMMO4': '0.218', 'AMMO3': '0.257', 'weapon5': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '70.000'} [2024-08-06 05:53:15,739][52794] DAMAGECOUNT value on done: 684222.0 [2024-08-06 05:53:15,740][52794] Sum rewards: 92.351, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.624', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.080', 'AMMO4': '0.089', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.942', 'FRAGCOUNT': '77.000'} [2024-08-06 05:53:15,848][52667] DAMAGECOUNT value on done: 691110.0 [2024-08-06 05:53:15,850][52667] Sum rewards: 57.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.255', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon2': '0.156', 'weapon5': '0.178', 'AMMO4': '0.215', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.820', 'WEAPON3': '1.300', 'weapon3': '2.594', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.076', 'FRAGCOUNT': '48.000'} [2024-08-06 05:53:16,311][52670] DAMAGECOUNT value on done: 673577.0 [2024-08-06 05:53:16,312][52670] Sum rewards: 70.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.898', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.224', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon5': '0.316', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.640', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:17,355][52647] DAMAGECOUNT value on done: 721834.0 [2024-08-06 05:53:17,356][52647] Sum rewards: 72.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.405', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.146', 'weapon5': '0.146', 'AMMO3': '0.202', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '57.000'} [2024-08-06 05:53:17,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 529121280. Throughput: 0: 4376.0. Samples: 132277920. Policy #0 lag: (min: 0.0, avg: 3.1, max: 8.0) [2024-08-06 05:53:17,794][52567] Avg episode reward: [(0, '73.971')] [2024-08-06 05:53:17,820][52666] DAMAGECOUNT value on done: 682808.0 [2024-08-06 05:53:17,820][52666] Sum rewards: 81.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.025', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.101', 'weapon5': '0.120', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.484', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '69.000'} [2024-08-06 05:53:18,316][52663] DAMAGECOUNT value on done: 673783.0 [2024-08-06 05:53:18,318][52663] Sum rewards: 79.100, reward structure: {'DEATHCOUNT': '-6.750', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.101', 'AMMO4': '0.168', 'HEALTH': '0.195', 'weapon4': '0.208', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.650', 'weapon2': '0.654', 'weapon3': '2.672', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:18,906][52650] Updated weights for policy 0, policy_version 64591 (0.0037) [2024-08-06 05:53:19,515][52670] DAMAGECOUNT value on done: 671451.0 [2024-08-06 05:53:19,515][52670] Sum rewards: 75.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.134', 'weapon4': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.600', 'weapon3': '3.166', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '65.000'} [2024-08-06 05:53:20,615][52647] DAMAGECOUNT value on done: 722462.0 [2024-08-06 05:53:20,615][52647] Sum rewards: 71.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.046', 'weapon5': '0.074', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:20,655][52666] DAMAGECOUNT value on done: 683950.0 [2024-08-06 05:53:20,656][52666] Sum rewards: 76.056, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.160', 'AMMO3': '0.217', 'weapon2': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '64.000'} [2024-08-06 05:53:21,104][52663] DAMAGECOUNT value on done: 674318.0 [2024-08-06 05:53:21,105][52663] Sum rewards: 71.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.857', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.106', 'AMMO3': '0.209', 'weapon5': '0.214', 'AMMO4': '0.215', 'weapon2': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:22,050][52670] DAMAGECOUNT value on done: 682384.0 [2024-08-06 05:53:22,051][52670] Sum rewards: 67.703, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.304', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.538', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '55.000'} [2024-08-06 05:53:22,223][52669] DAMAGECOUNT value on done: 685389.0 [2024-08-06 05:53:22,225][52669] Sum rewards: 71.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.992', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.172', 'weapon5': '0.210', 'AMMO3': '0.245', 'AMMO4': '0.294', 'weapon2': '0.488', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 529203200. Throughput: 0: 4364.7. Samples: 132303990. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:22,802][52567] Avg episode reward: [(0, '73.912')] [2024-08-06 05:53:22,970][52647] DAMAGECOUNT value on done: 705951.0 [2024-08-06 05:53:22,972][52647] Sum rewards: 63.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.096', 'AMMO4': '0.136', 'AMMO3': '0.207', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '53.000'} [2024-08-06 05:53:23,130][52650] Updated weights for policy 0, policy_version 64601 (0.0035) [2024-08-06 05:53:23,184][52658] DAMAGECOUNT value on done: 684688.0 [2024-08-06 05:53:23,186][52658] Sum rewards: 64.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.790', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.179', 'AMMO4': '0.226', 'weapon4': '0.234', 'weapon5': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '51.000'} [2024-08-06 05:53:23,556][52666] DAMAGECOUNT value on done: 676218.0 [2024-08-06 05:53:23,557][52666] Sum rewards: 92.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.274', 'AMMO5': '0.007', 'weapon4': '0.034', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '22.326', 'FRAGCOUNT': '72.000'} [2024-08-06 05:53:23,995][52663] DAMAGECOUNT value on done: 678296.0 [2024-08-06 05:53:23,995][52663] Sum rewards: 72.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon5': '0.190', 'AMMO3': '0.229', 'weapon2': '0.248', 'AMMO4': '0.324', 'weapon4': '0.430', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:24,785][52669] DAMAGECOUNT value on done: 676637.0 [2024-08-06 05:53:24,787][52669] Sum rewards: 77.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.368', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.162', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '65.000'} [2024-08-06 05:53:25,266][52670] DAMAGECOUNT value on done: 678547.0 [2024-08-06 05:53:25,267][52670] Sum rewards: 68.142, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.146', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.158', 'AMMO4': '0.185', 'AMMO3': '0.230', 'weapon2': '0.254', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '58.500'} [2024-08-06 05:53:26,241][52658] DAMAGECOUNT value on done: 683446.0 [2024-08-06 05:53:26,241][52658] Sum rewards: 70.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:26,327][52647] DAMAGECOUNT value on done: 715854.0 [2024-08-06 05:53:26,328][52647] Sum rewards: 69.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.126', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'AMMO4': '0.226', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.154', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:26,758][52663] DAMAGECOUNT value on done: 689299.0 [2024-08-06 05:53:26,761][52663] Sum rewards: 63.558, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.852', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.116', 'AMMO4': '0.244', 'weapon2': '0.280', 'AMMO3': '0.284', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.956', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '55.000'} [2024-08-06 05:53:26,779][52666] DAMAGECOUNT value on done: 677261.0 [2024-08-06 05:53:26,779][52666] Sum rewards: 75.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.150', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.290', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '62.000'} [2024-08-06 05:53:27,476][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:53:27,750][52669] DAMAGECOUNT value on done: 688269.0 [2024-08-06 05:53:27,751][52669] Sum rewards: 71.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.887', 'AMMO5': '0.012', 'AMMO2': '0.068', 'weapon4': '0.166', 'weapon5': '0.166', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO4': '0.338', 'weapon2': '0.458', 'WEAPON3': '1.600', 'weapon3': '2.966', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:27,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 529285120. Throughput: 0: 4361.8. Samples: 132330010. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:27,795][52567] Avg episode reward: [(0, '73.789')] [2024-08-06 05:53:27,978][52650] Updated weights for policy 0, policy_version 64611 (0.0023) [2024-08-06 05:53:28,109][52670] DAMAGECOUNT value on done: 670109.0 [2024-08-06 05:53:28,109][52670] Sum rewards: 72.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.233', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.074', 'weapon5': '0.178', 'AMMO4': '0.187', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:28,613][52795] DAMAGECOUNT value on done: 634979.0 [2024-08-06 05:53:28,614][52795] Sum rewards: 68.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.270', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon2': '0.122', 'weapon5': '0.128', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.380', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '56.000'} [2024-08-06 05:53:29,041][52664] Large shaping reward 2.573 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:53:29,208][52658] DAMAGECOUNT value on done: 688942.0 [2024-08-06 05:53:29,210][52658] Sum rewards: 82.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.555', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.166', 'weapon2': '0.208', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '68.000'} [2024-08-06 05:53:29,226][52647] DAMAGECOUNT value on done: 707356.0 [2024-08-06 05:53:29,226][52647] Sum rewards: 73.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.996', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:29,325][52663] DAMAGECOUNT value on done: 674717.0 [2024-08-06 05:53:29,328][52663] Sum rewards: 70.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.281', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.114', 'AMMO3': '0.196', 'AMMO4': '0.205', 'weapon5': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:29,542][52666] DAMAGECOUNT value on done: 677492.0 [2024-08-06 05:53:29,548][52666] Sum rewards: 84.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.021', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '71.500'} [2024-08-06 05:53:30,603][52671] DAMAGECOUNT value on done: 686097.0 [2024-08-06 05:53:30,603][52671] Sum rewards: 70.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.787', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.205', 'AMMO4': '0.230', 'weapon5': '0.250', 'weapon2': '0.312', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:30,659][52669] DAMAGECOUNT value on done: 684622.0 [2024-08-06 05:53:30,659][52669] Sum rewards: 62.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'weapon4': '0.022', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'weapon2': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.400', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '53.000'} [2024-08-06 05:53:31,049][52670] DAMAGECOUNT value on done: 677175.0 [2024-08-06 05:53:31,051][52670] Sum rewards: 73.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.333', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.136', 'AMMO4': '0.173', 'AMMO3': '0.180', 'weapon5': '0.206', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:31,753][52647] DAMAGECOUNT value on done: 712667.0 [2024-08-06 05:53:31,753][52647] Sum rewards: 62.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.834', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.120', 'AMMO4': '0.204', 'AMMO3': '0.206', 'weapon5': '0.260', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.850', 'weapon3': '2.978', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '52.000'} [2024-08-06 05:53:31,977][52820] DAMAGECOUNT value on done: 631701.0 [2024-08-06 05:53:31,977][52820] Sum rewards: 64.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.364', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.136', 'weapon5': '0.176', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '56.000'} [2024-08-06 05:53:31,987][52795] DAMAGECOUNT value on done: 622396.0 [2024-08-06 05:53:31,987][52795] Sum rewards: 79.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.156', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.278', 'WEAPON3': '1.650', 'weapon3': '3.208', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:32,189][52666] DAMAGECOUNT value on done: 672675.0 [2024-08-06 05:53:32,193][52666] Sum rewards: 66.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.748', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.132', 'AMMO4': '0.134', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.992', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '57.000'} [2024-08-06 05:53:32,359][52658] DAMAGECOUNT value on done: 686885.0 [2024-08-06 05:53:32,359][52658] Sum rewards: 69.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.935', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.144', 'AMMO4': '0.148', 'AMMO3': '0.190', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.292', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '55.500'} [2024-08-06 05:53:32,458][52663] DAMAGECOUNT value on done: 670486.0 [2024-08-06 05:53:32,459][52663] Sum rewards: 83.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.022', 'AMMO4': '0.083', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '70.000'} [2024-08-06 05:53:32,651][52650] Updated weights for policy 0, policy_version 64621 (0.0012) [2024-08-06 05:53:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 529375232. Throughput: 0: 4360.9. Samples: 132343020. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:32,794][52567] Avg episode reward: [(0, '73.692')] [2024-08-06 05:53:33,650][52670] DAMAGECOUNT value on done: 672732.0 [2024-08-06 05:53:33,651][52670] Sum rewards: 59.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.014', 'AMMO5': '0.016', 'AMMO2': '0.055', 'AMMO3': '0.201', 'weapon5': '0.244', 'AMMO4': '0.276', 'WEAPON5': '0.400', 'weapon2': '0.414', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.636', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '51.000'} [2024-08-06 05:53:33,659][52671] DAMAGECOUNT value on done: 689837.0 [2024-08-06 05:53:33,660][52671] Sum rewards: 60.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.278', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.458', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '52.000'} [2024-08-06 05:53:33,867][52669] DAMAGECOUNT value on done: 685096.0 [2024-08-06 05:53:33,868][52669] Sum rewards: 77.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.922', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.082', 'weapon2': '0.174', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'weapon3': '3.494', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '66.000'} [2024-08-06 05:53:34,974][52658] DAMAGECOUNT value on done: 677754.0 [2024-08-06 05:53:34,975][52658] Sum rewards: 81.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.145', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.216', 'weapon4': '0.286', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:35,006][52666] DAMAGECOUNT value on done: 682186.0 [2024-08-06 05:53:35,006][52666] Sum rewards: 87.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.755', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon2': '0.178', 'weapon5': '0.202', 'AMMO3': '0.220', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.852', 'FRAGCOUNT': '71.000'} [2024-08-06 05:53:35,092][52663] DAMAGECOUNT value on done: 676951.0 [2024-08-06 05:53:35,092][52663] Sum rewards: 80.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.888', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.326', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '65.000'} [2024-08-06 05:53:35,132][52820] DAMAGECOUNT value on done: 631699.0 [2024-08-06 05:53:35,132][52820] Sum rewards: 63.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.399', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.028', 'AMMO4': '0.104', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '53.000'} [2024-08-06 05:53:35,206][52795] DAMAGECOUNT value on done: 623233.0 [2024-08-06 05:53:35,207][52795] Sum rewards: 66.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.388', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.153', 'weapon4': '0.222', 'weapon2': '0.252', 'AMMO4': '0.274', 'weapon5': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.962', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '54.000'} [2024-08-06 05:53:36,140][52669] DAMAGECOUNT value on done: 687971.0 [2024-08-06 05:53:36,141][52669] Sum rewards: 81.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.056', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon4': '0.262', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:36,427][52671] DAMAGECOUNT value on done: 687071.0 [2024-08-06 05:53:36,428][52671] Sum rewards: 75.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.698', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.136', 'AMMO3': '0.221', 'AMMO4': '0.225', 'weapon5': '0.274', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:36,518][52670] DAMAGECOUNT value on done: 671455.0 [2024-08-06 05:53:36,518][52670] Sum rewards: 76.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.147', 'weapon5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.222', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:37,150][52650] Updated weights for policy 0, policy_version 64631 (0.0025) [2024-08-06 05:53:37,757][52663] DAMAGECOUNT value on done: 673490.0 [2024-08-06 05:53:37,759][52663] Sum rewards: 66.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.179', 'weapon4': '0.242', 'AMMO4': '0.260', 'weapon5': '0.284', 'weapon2': '0.366', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.808', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '54.000'} [2024-08-06 05:53:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 529457152. Throughput: 0: 4353.6. Samples: 132368780. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:37,802][52567] Avg episode reward: [(0, '73.577')] [2024-08-06 05:53:37,965][52666] DAMAGECOUNT value on done: 674187.0 [2024-08-06 05:53:37,966][52666] Sum rewards: 80.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.420', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.098', 'AMMO4': '0.183', 'AMMO3': '0.243', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '66.000'} [2024-08-06 05:53:38,064][52658] DAMAGECOUNT value on done: 676012.0 [2024-08-06 05:53:38,066][52658] Sum rewards: 68.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.155', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.112', 'AMMO4': '0.128', 'weapon5': '0.154', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.228', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:38,129][52820] DAMAGECOUNT value on done: 634232.0 [2024-08-06 05:53:38,129][52820] Sum rewards: 72.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.877', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.084', 'weapon4': '0.098', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:38,378][52795] DAMAGECOUNT value on done: 631865.0 [2024-08-06 05:53:38,378][52795] Sum rewards: 77.244, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.994', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:38,447][52811] DAMAGECOUNT value on done: 651922.0 [2024-08-06 05:53:38,448][52811] Sum rewards: 78.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.634', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.072', 'weapon5': '0.124', 'AMMO4': '0.184', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '64.000'} [2024-08-06 05:53:38,816][52671] DAMAGECOUNT value on done: 690173.0 [2024-08-06 05:53:38,817][52671] Sum rewards: 80.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.114', 'AMMO4': '0.115', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '65.000'} [2024-08-06 05:53:39,271][52669] DAMAGECOUNT value on done: 686215.0 [2024-08-06 05:53:39,272][52669] Sum rewards: 80.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.425', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.104', 'AMMO4': '0.183', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '66.500'} [2024-08-06 05:53:39,767][52670] DAMAGECOUNT value on done: 682383.0 [2024-08-06 05:53:39,767][52670] Sum rewards: 70.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.154', 'AMMO5': '0.025', 'AMMO2': '0.061', 'AMMO3': '0.206', 'weapon2': '0.240', 'weapon5': '0.264', 'AMMO4': '0.305', 'weapon4': '0.560', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.610', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '59.500'} [2024-08-06 05:53:40,328][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:53:40,584][52663] DAMAGECOUNT value on done: 688498.0 [2024-08-06 05:53:40,585][52663] Sum rewards: 71.493, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.218', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.134', 'weapon2': '0.162', 'AMMO4': '0.177', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:40,834][52666] DAMAGECOUNT value on done: 682407.0 [2024-08-06 05:53:40,836][52666] Sum rewards: 80.165, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.230', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.134', 'AMMO4': '0.150', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'weapon3': '3.238', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '70.000'} [2024-08-06 05:53:41,072][52658] DAMAGECOUNT value on done: 689308.0 [2024-08-06 05:53:41,072][52658] Sum rewards: 75.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.232', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.116', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'AMMO4': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:41,289][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:53:41,454][52795] DAMAGECOUNT value on done: 624762.0 [2024-08-06 05:53:41,454][52795] Sum rewards: 71.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.098', 'weapon5': '0.142', 'AMMO4': '0.167', 'AMMO3': '0.218', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:41,477][52820] DAMAGECOUNT value on done: 626138.0 [2024-08-06 05:53:41,479][52820] Sum rewards: 75.045, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.210', 'weapon5': '0.226', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '62.000'} [2024-08-06 05:53:41,488][52811] DAMAGECOUNT value on done: 631377.0 [2024-08-06 05:53:41,493][52811] Sum rewards: 73.147, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.106', 'HEALTH': '0.134', 'AMMO4': '0.169', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:41,604][52671] DAMAGECOUNT value on done: 697946.0 [2024-08-06 05:53:41,604][52671] Sum rewards: 76.406, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.987', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.168', 'weapon5': '0.168', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:42,213][52650] Updated weights for policy 0, policy_version 64641 (0.0012) [2024-08-06 05:53:42,259][52669] DAMAGECOUNT value on done: 686744.0 [2024-08-06 05:53:42,262][52669] Sum rewards: 90.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.905', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.166', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.477', 'FRAGCOUNT': '76.000'} [2024-08-06 05:53:42,278][52670] DAMAGECOUNT value on done: 667372.0 [2024-08-06 05:53:42,279][52670] Sum rewards: 77.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.456', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 529555456. Throughput: 0: 4350.4. Samples: 132394990. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:42,795][52567] Avg episode reward: [(0, '74.112')] [2024-08-06 05:53:43,600][52666] DAMAGECOUNT value on done: 670489.0 [2024-08-06 05:53:43,602][52666] Sum rewards: 81.219, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.091', 'HEALTH': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon5': '0.256', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '65.000'} [2024-08-06 05:53:43,616][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:53:43,729][52663] DAMAGECOUNT value on done: 680910.0 [2024-08-06 05:53:43,729][52663] Sum rewards: 80.655, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'HEALTH': '0.170', 'weapon4': '0.188', 'AMMO3': '0.208', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '66.000'} [2024-08-06 05:53:44,051][52658] DAMAGECOUNT value on done: 680718.0 [2024-08-06 05:53:44,051][52658] Sum rewards: 85.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.774', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.162', 'AMMO3': '0.181', 'weapon4': '0.242', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '69.000'} [2024-08-06 05:53:44,503][52811] DAMAGECOUNT value on done: 631956.0 [2024-08-06 05:53:44,505][52811] Sum rewards: 79.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.403', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.113', 'weapon5': '0.126', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '66.000'} [2024-08-06 05:53:44,568][52795] DAMAGECOUNT value on done: 635693.0 [2024-08-06 05:53:44,570][52795] Sum rewards: 57.837, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.308', 'AMMO5': '0.024', 'AMMO2': '0.085', 'AMMO3': '0.223', 'weapon5': '0.300', 'weapon4': '0.324', 'AMMO4': '0.426', 'weapon2': '0.588', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.398', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '51.000'} [2024-08-06 05:53:44,669][52671] DAMAGECOUNT value on done: 688671.0 [2024-08-06 05:53:44,671][52671] Sum rewards: 75.635, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.196', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.157', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:44,791][52820] DAMAGECOUNT value on done: 635608.0 [2024-08-06 05:53:44,792][52820] Sum rewards: 71.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.172', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.180', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '62.000'} [2024-08-06 05:53:44,928][52670] DAMAGECOUNT value on done: 677320.0 [2024-08-06 05:53:44,929][52670] Sum rewards: 64.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.530', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.110', 'weapon5': '0.188', 'AMMO3': '0.245', 'weapon2': '0.258', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.144', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 05:53:45,338][52669] DAMAGECOUNT value on done: 693241.0 [2024-08-06 05:53:45,340][52669] Sum rewards: 78.390, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.238', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.156', 'weapon2': '0.622', 'WEAPON3': '1.000', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '62.000'} [2024-08-06 05:53:46,343][52666] DAMAGECOUNT value on done: 683459.0 [2024-08-06 05:53:46,344][52666] Sum rewards: 84.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.038', 'AMMO4': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '69.000'} [2024-08-06 05:53:46,552][52658] DAMAGECOUNT value on done: 698931.0 [2024-08-06 05:53:46,553][52658] Sum rewards: 81.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.186', 'weapon2': '0.214', 'AMMO3': '0.223', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '68.000'} [2024-08-06 05:53:46,767][52650] Updated weights for policy 0, policy_version 64651 (0.0022) [2024-08-06 05:53:46,862][52663] DAMAGECOUNT value on done: 684904.0 [2024-08-06 05:53:46,862][52663] Sum rewards: 73.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.955', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.146', 'AMMO4': '0.168', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:47,471][52670] DAMAGECOUNT value on done: 682975.0 [2024-08-06 05:53:47,473][52670] Sum rewards: 76.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.476', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.198', 'AMMO3': '0.217', 'AMMO4': '0.225', 'weapon5': '0.248', 'weapon2': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '64.000'} [2024-08-06 05:53:47,578][52811] DAMAGECOUNT value on done: 632834.0 [2024-08-06 05:53:47,578][52811] Sum rewards: 67.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.900', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.096', 'weapon5': '0.138', 'AMMO3': '0.199', 'AMMO4': '0.290', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '55.000'} [2024-08-06 05:53:47,680][52795] DAMAGECOUNT value on done: 639597.0 [2024-08-06 05:53:47,680][52795] Sum rewards: 92.641, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.387', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.198', 'AMMO3': '0.235', 'weapon4': '0.258', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '4.320', 'DAMAGECOUNT': '22.464', 'FRAGCOUNT': '78.000'} [2024-08-06 05:53:47,772][52671] DAMAGECOUNT value on done: 691960.0 [2024-08-06 05:53:47,773][52671] Sum rewards: 67.920, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.172', 'AMMO3': '0.220', 'weapon5': '0.222', 'AMMO4': '0.273', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2024-08-06 05:53:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 529629184. Throughput: 0: 4351.3. Samples: 132408080. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:47,802][52567] Avg episode reward: [(0, '74.251')] [2024-08-06 05:53:47,916][52820] DAMAGECOUNT value on done: 624750.0 [2024-08-06 05:53:47,920][52820] Sum rewards: 66.283, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.765', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.094', 'weapon4': '0.116', 'AMMO4': '0.226', 'AMMO3': '0.242', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:48,252][52669] DAMAGECOUNT value on done: 686615.0 [2024-08-06 05:53:48,253][52669] Sum rewards: 78.352, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.420', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.216', 'AMMO3': '0.233', 'AMMO4': '0.255', 'weapon2': '0.260', 'weapon5': '0.286', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '65.500'} [2024-08-06 05:53:49,001][52666] DAMAGECOUNT value on done: 677458.0 [2024-08-06 05:53:49,003][52666] Sum rewards: 70.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon5': '0.146', 'AMMO3': '0.188', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:49,668][52658] DAMAGECOUNT value on done: 684259.0 [2024-08-06 05:53:49,669][52658] Sum rewards: 74.644, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.158', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.140', 'weapon5': '0.176', 'AMMO4': '0.188', 'AMMO3': '0.224', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:49,831][52663] DAMAGECOUNT value on done: 684683.0 [2024-08-06 05:53:49,831][52663] Sum rewards: 69.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.092', 'AMMO3': '0.206', 'weapon5': '0.230', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:50,317][52670] DAMAGECOUNT value on done: 680487.0 [2024-08-06 05:53:50,318][52670] Sum rewards: 71.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.569', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:50,748][52811] DAMAGECOUNT value on done: 643619.0 [2024-08-06 05:53:50,749][52811] Sum rewards: 78.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'AMMO5': '0.006', 'weapon4': '0.024', 'AMMO2': '0.035', 'weapon5': '0.090', 'AMMO4': '0.174', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '65.000'} [2024-08-06 05:53:50,806][52795] DAMAGECOUNT value on done: 631602.0 [2024-08-06 05:53:50,807][52795] Sum rewards: 66.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.862', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.200', 'AMMO3': '0.219', 'weapon5': '0.254', 'weapon4': '0.276', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '56.000'} [2024-08-06 05:53:50,884][52671] DAMAGECOUNT value on done: 689745.0 [2024-08-06 05:53:50,884][52671] Sum rewards: 77.308, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.475', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.093', 'AMMO3': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.782', 'WEAPON3': '0.950', 'weapon3': '3.022', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '60.000'} [2024-08-06 05:53:51,166][52820] DAMAGECOUNT value on done: 633846.0 [2024-08-06 05:53:51,168][52820] Sum rewards: 71.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.667', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.102', 'AMMO4': '0.168', 'weapon5': '0.178', 'weapon2': '0.218', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:51,329][52669] DAMAGECOUNT value on done: 687007.0 [2024-08-06 05:53:51,329][52669] Sum rewards: 67.717, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.813', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.203', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '55.000'} [2024-08-06 05:53:51,497][52650] Updated weights for policy 0, policy_version 64661 (0.0012) [2024-08-06 05:53:51,514][52666] DAMAGECOUNT value on done: 681153.0 [2024-08-06 05:53:51,514][52666] Sum rewards: 69.384, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.078', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.186', 'weapon2': '0.222', 'AMMO3': '0.241', 'AMMO4': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:52,405][52658] DAMAGECOUNT value on done: 695995.0 [2024-08-06 05:53:52,405][52658] Sum rewards: 70.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.880', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.122', 'AMMO4': '0.168', 'AMMO3': '0.173', 'weapon5': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '57.000'} [2024-08-06 05:53:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 529727488. Throughput: 0: 4351.3. Samples: 132434340. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:52,794][52567] Avg episode reward: [(0, '73.938')] [2024-08-06 05:53:53,065][52647] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:53:53,130][52670] DAMAGECOUNT value on done: 661826.0 [2024-08-06 05:53:53,131][52670] Sum rewards: 69.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.208', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.201', 'AMMO4': '0.228', 'weapon5': '0.268', 'weapon2': '0.312', 'weapon4': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '58.000'} [2024-08-06 05:53:53,321][52663] DAMAGECOUNT value on done: 676351.0 [2024-08-06 05:53:53,321][52663] Sum rewards: 55.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.383', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.194', 'AMMO4': '0.197', 'WEAPON7': '0.200', 'AMMO3': '0.211', 'weapon2': '0.214', 'weapon7': '0.224', 'weapon4': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.620', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '46.000'} [2024-08-06 05:53:53,649][52671] DAMAGECOUNT value on done: 679865.0 [2024-08-06 05:53:53,650][52671] Sum rewards: 62.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.236', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.122', 'AMMO3': '0.183', 'weapon5': '0.242', 'AMMO4': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.817', 'FRAGCOUNT': '52.000'} [2024-08-06 05:53:53,836][52820] Large shaping reward 2.607 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.015, -5.0), ('weapon5', 0.002)] [2024-08-06 05:53:53,867][52811] DAMAGECOUNT value on done: 647937.0 [2024-08-06 05:53:53,867][52811] Sum rewards: 90.449, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.155', 'HEALTH': '0.191', 'weapon2': '0.404', 'WEAPON3': '0.950', 'weapon3': '3.336', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '71.000'} [2024-08-06 05:53:54,065][52795] DAMAGECOUNT value on done: 628072.0 [2024-08-06 05:53:54,066][52795] Sum rewards: 69.570, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.130', 'AMMO3': '0.223', 'weapon5': '0.246', 'AMMO4': '0.264', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:54,227][52820] DAMAGECOUNT value on done: 635809.0 [2024-08-06 05:53:54,229][52820] Sum rewards: 56.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.834', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.062', 'AMMO4': '0.167', 'weapon4': '0.222', 'weapon2': '0.236', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.304', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '49.000'} [2024-08-06 05:53:54,271][52666] DAMAGECOUNT value on done: 671836.0 [2024-08-06 05:53:54,272][52666] Sum rewards: 79.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.084', 'weapon5': '0.108', 'AMMO3': '0.160', 'weapon2': '0.210', 'AMMO4': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.334', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '64.000'} [2024-08-06 05:53:54,544][52669] DAMAGECOUNT value on done: 693565.0 [2024-08-06 05:53:54,544][52669] Sum rewards: 79.763, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.757', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:55,575][52658] DAMAGECOUNT value on done: 682268.0 [2024-08-06 05:53:55,576][52658] Sum rewards: 78.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.281', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.220', 'AMMO3': '0.230', 'AMMO4': '0.254', 'weapon5': '0.318', 'weapon2': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '66.000'} [2024-08-06 05:53:55,920][52670] DAMAGECOUNT value on done: 674994.0 [2024-08-06 05:53:55,923][52670] Sum rewards: 73.160, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.207', 'weapon2': '0.312', 'HEALTH': '0.596', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.368', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '61.000'} [2024-08-06 05:53:56,429][52671] DAMAGECOUNT value on done: 687755.0 [2024-08-06 05:53:56,429][52671] Sum rewards: 63.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.964', 'AMMO5': '0.023', 'AMMO2': '0.088', 'AMMO3': '0.182', 'weapon2': '0.290', 'weapon5': '0.396', 'AMMO4': '0.440', 'weapon4': '0.452', 'WEAPON5': '0.750', 'WEAPON4': '0.900', 'WEAPON3': '1.200', 'weapon3': '2.400', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '53.000'} [2024-08-06 05:53:56,551][52650] Updated weights for policy 0, policy_version 64671 (0.0014) [2024-08-06 05:53:56,777][52668] DAMAGECOUNT value on done: 681960.0 [2024-08-06 05:53:56,781][52668] Sum rewards: 79.838, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.386', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.084', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.332', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '67.000'} [2024-08-06 05:53:56,951][52669] DAMAGECOUNT value on done: 677859.0 [2024-08-06 05:53:56,951][52669] Sum rewards: 71.049, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.440', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.124', 'AMMO3': '0.142', 'AMMO4': '0.211', 'weapon5': '0.220', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon3': '3.000', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '55.000'} [2024-08-06 05:53:57,025][52811] DAMAGECOUNT value on done: 643321.0 [2024-08-06 05:53:57,028][52811] Sum rewards: 67.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.790', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.134', 'AMMO4': '0.146', 'weapon2': '0.242', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.326', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '57.000'} [2024-08-06 05:53:57,153][52795] DAMAGECOUNT value on done: 636430.0 [2024-08-06 05:53:57,154][52795] Sum rewards: 74.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.066', 'AMMO4': '0.154', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '62.000'} [2024-08-06 05:53:57,270][52666] DAMAGECOUNT value on done: 677226.0 [2024-08-06 05:53:57,270][52666] Sum rewards: 60.523, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.317', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.055', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'weapon2': '0.360', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.346', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '51.000'} [2024-08-06 05:53:57,466][52820] DAMAGECOUNT value on done: 632127.0 [2024-08-06 05:53:57,466][52820] Sum rewards: 69.318, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.306', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.156', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon4': '0.292', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '57.000'} [2024-08-06 05:53:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 529809408. Throughput: 0: 4345.1. Samples: 132460270. Policy #0 lag: (min: 0.0, avg: 4.7, max: 9.0) [2024-08-06 05:53:57,794][52567] Avg episode reward: [(0, '73.416')] [2024-08-06 05:53:58,342][52658] DAMAGECOUNT value on done: 688293.0 [2024-08-06 05:53:58,342][52658] Sum rewards: 79.588, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.294', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.014', 'AMMO4': '0.062', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.427', 'FRAGCOUNT': '65.000'} [2024-08-06 05:53:58,918][52670] DAMAGECOUNT value on done: 683043.0 [2024-08-06 05:53:58,920][52670] Sum rewards: 79.262, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.107', 'AMMO3': '0.169', 'weapon5': '0.200', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '63.000'} [2024-08-06 05:53:59,515][52669] DAMAGECOUNT value on done: 683312.0 [2024-08-06 05:53:59,516][52669] Sum rewards: 75.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.754', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.098', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.466', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 05:53:59,519][52671] DAMAGECOUNT value on done: 691111.0 [2024-08-06 05:53:59,519][52671] Sum rewards: 74.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.965', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO3': '0.190', 'weapon2': '0.226', 'WEAPON3': '1.150', 'weapon3': '3.434', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '59.000'} [2024-08-06 05:53:59,890][52668] DAMAGECOUNT value on done: 687256.0 [2024-08-06 05:53:59,891][52668] Sum rewards: 66.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.036', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.211', 'weapon2': '0.272', 'WEAPON3': '1.200', 'HITCOUNT': '3.430', 'weapon3': '3.440', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:00,093][52811] DAMAGECOUNT value on done: 634403.0 [2024-08-06 05:54:00,093][52811] Sum rewards: 79.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.333', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.154', 'weapon4': '0.220', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:00,317][52666] DAMAGECOUNT value on done: 688233.0 [2024-08-06 05:54:00,318][52666] Sum rewards: 67.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.079', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.178', 'weapon5': '0.180', 'AMMO4': '0.204', 'AMMO3': '0.223', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '56.000'} [2024-08-06 05:54:00,371][52795] DAMAGECOUNT value on done: 630939.0 [2024-08-06 05:54:00,373][52795] Sum rewards: 62.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.755', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.172', 'AMMO3': '0.183', 'weapon5': '0.196', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '50.000'} [2024-08-06 05:54:00,586][52820] DAMAGECOUNT value on done: 638494.0 [2024-08-06 05:54:00,587][52820] Sum rewards: 74.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.518', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.058', 'weapon5': '0.106', 'AMMO3': '0.180', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:00,840][52650] Updated weights for policy 0, policy_version 64681 (0.0014) [2024-08-06 05:54:01,155][52658] DAMAGECOUNT value on done: 679960.0 [2024-08-06 05:54:01,156][52658] Sum rewards: 67.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.392', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.151', 'weapon5': '0.180', 'AMMO3': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.208', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:01,830][52670] DAMAGECOUNT value on done: 676666.0 [2024-08-06 05:54:01,830][52670] Sum rewards: 70.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.224', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '58.000'} [2024-08-06 05:54:02,206][52669] DAMAGECOUNT value on done: 685113.0 [2024-08-06 05:54:02,208][52669] Sum rewards: 77.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.154', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.142', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:02,300][52671] DAMAGECOUNT value on done: 687211.0 [2024-08-06 05:54:02,301][52671] Sum rewards: 72.475, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '0.006', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.083', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.306', 'WEAPON3': '0.900', 'HITCOUNT': '3.260', 'weapon3': '3.446', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:02,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 529891328. Throughput: 0: 4342.9. Samples: 132473350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:02,794][52567] Avg episode reward: [(0, '73.384')] [2024-08-06 05:54:02,947][52668] DAMAGECOUNT value on done: 688423.0 [2024-08-06 05:54:02,949][52668] Sum rewards: 72.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.846', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.243', 'weapon5': '0.262', 'weapon2': '0.270', 'weapon4': '0.512', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.642', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:03,028][52666] DAMAGECOUNT value on done: 668543.0 [2024-08-06 05:54:03,030][52666] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.362', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.112', 'weapon5': '0.120', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.650', 'weapon3': '3.160', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '62.000'} [2024-08-06 05:54:03,252][52811] DAMAGECOUNT value on done: 645032.0 [2024-08-06 05:54:03,253][52811] Sum rewards: 55.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.115', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.188', 'AMMO4': '0.239', 'weapon4': '0.314', 'weapon5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.378', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '44.000'} [2024-08-06 05:54:03,626][52820] DAMAGECOUNT value on done: 627603.0 [2024-08-06 05:54:03,627][52820] Sum rewards: 80.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.807', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.074', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:03,686][52795] DAMAGECOUNT value on done: 627524.0 [2024-08-06 05:54:03,687][52795] Sum rewards: 71.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.131', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.058', 'weapon5': '0.208', 'AMMO3': '0.230', 'AMMO4': '0.235', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:04,074][52658] DAMAGECOUNT value on done: 688003.0 [2024-08-06 05:54:04,075][52658] Sum rewards: 65.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon5': '0.162', 'AMMO3': '0.197', 'AMMO4': '0.265', 'weapon4': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '55.000'} [2024-08-06 05:54:04,605][52670] DAMAGECOUNT value on done: 681445.0 [2024-08-06 05:54:04,606][52670] Sum rewards: 73.221, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.575', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.114', 'weapon5': '0.136', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:04,768][52669] DAMAGECOUNT value on done: 706350.0 [2024-08-06 05:54:04,768][52669] Sum rewards: 74.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.126', 'AMMO4': '0.147', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '63.000'} [2024-08-06 05:54:05,326][52671] DAMAGECOUNT value on done: 693951.0 [2024-08-06 05:54:05,328][52671] Sum rewards: 83.174, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.512', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.130', 'AMMO4': '0.163', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '70.000'} [2024-08-06 05:54:05,591][52650] Updated weights for policy 0, policy_version 64691 (0.0016) [2024-08-06 05:54:05,732][52666] DAMAGECOUNT value on done: 677018.0 [2024-08-06 05:54:05,733][52666] Sum rewards: 76.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.154', 'weapon5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:06,099][52668] DAMAGECOUNT value on done: 688801.0 [2024-08-06 05:54:06,099][52668] Sum rewards: 72.314, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.116', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.090', 'weapon5': '0.168', 'AMMO4': '0.223', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '62.000'} [2024-08-06 05:54:06,388][52811] DAMAGECOUNT value on done: 639861.0 [2024-08-06 05:54:06,388][52811] Sum rewards: 70.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.715', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.634', 'WEAPON3': '1.600', 'weapon3': '3.060', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:06,690][52658] DAMAGECOUNT value on done: 674736.0 [2024-08-06 05:54:06,691][52658] Sum rewards: 76.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.884', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.150', 'AMMO4': '0.172', 'weapon4': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:06,741][52820] DAMAGECOUNT value on done: 635526.0 [2024-08-06 05:54:06,741][52820] Sum rewards: 69.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.690', 'AMMO5': '0.023', 'AMMO2': '0.047', 'weapon4': '0.072', 'weapon5': '0.178', 'AMMO3': '0.214', 'AMMO4': '0.237', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:07,047][52795] DAMAGECOUNT value on done: 625593.0 [2024-08-06 05:54:07,049][52795] Sum rewards: 66.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.326', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.120', 'AMMO3': '0.197', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.110', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:07,440][52669] DAMAGECOUNT value on done: 692589.0 [2024-08-06 05:54:07,440][52669] Sum rewards: 77.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.525', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.148', 'AMMO4': '0.191', 'AMMO3': '0.193', 'weapon5': '0.268', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '61.500'} [2024-08-06 05:54:07,795][52567] Fps is (10 sec: 17201.9, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 529981440. Throughput: 0: 4350.4. Samples: 132499760. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:07,796][52567] Avg episode reward: [(0, '73.570')] [2024-08-06 05:54:08,442][52671] DAMAGECOUNT value on done: 688706.0 [2024-08-06 05:54:08,443][52671] Sum rewards: 70.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.253', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.170', 'weapon4': '0.188', 'AMMO3': '0.275', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.920', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:09,302][52668] DAMAGECOUNT value on done: 674578.0 [2024-08-06 05:54:09,304][52668] Sum rewards: 56.571, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO3': '0.173', 'weapon2': '0.674', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '3.150', 'DAMAGECOUNT': '12.939', 'FRAGCOUNT': '47.000'} [2024-08-06 05:54:09,417][52658] DAMAGECOUNT value on done: 688348.0 [2024-08-06 05:54:09,419][52658] Sum rewards: 69.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.634', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.094', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.228', 'weapon5': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:09,554][52811] DAMAGECOUNT value on done: 642982.0 [2024-08-06 05:54:09,554][52811] Sum rewards: 75.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.162', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.144', 'AMMO4': '0.163', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:10,001][52820] DAMAGECOUNT value on done: 642424.0 [2024-08-06 05:54:10,002][52820] Sum rewards: 82.636, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO3': '0.145', 'AMMO4': '0.173', 'HEALTH': '0.175', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '0.850', 'weapon3': '3.042', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '63.000'} [2024-08-06 05:54:10,100][52795] DAMAGECOUNT value on done: 635856.0 [2024-08-06 05:54:10,100][52795] Sum rewards: 88.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.178', 'weapon5': '0.180', 'weapon4': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '72.000'} [2024-08-06 05:54:10,171][52669] DAMAGECOUNT value on done: 690395.0 [2024-08-06 05:54:10,171][52669] Sum rewards: 72.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.148', 'weapon5': '0.156', 'AMMO4': '0.179', 'AMMO3': '0.246', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '62.000'} [2024-08-06 05:54:10,571][52650] Updated weights for policy 0, policy_version 64701 (0.0033) [2024-08-06 05:54:11,077][52671] DAMAGECOUNT value on done: 674555.0 [2024-08-06 05:54:11,077][52671] Sum rewards: 69.542, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.760', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.136', 'AMMO4': '0.173', 'weapon5': '0.178', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.317', 'WEAPON3': '1.800', 'weapon3': '3.128', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:12,408][52668] DAMAGECOUNT value on done: 690938.0 [2024-08-06 05:54:12,409][52668] Sum rewards: 60.619, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.054', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.281', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.734', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '50.000'} [2024-08-06 05:54:12,627][52658] DAMAGECOUNT value on done: 680425.0 [2024-08-06 05:54:12,630][52658] Sum rewards: 62.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.054', 'weapon5': '0.174', 'AMMO3': '0.197', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '2.992', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2024-08-06 05:54:12,665][52811] DAMAGECOUNT value on done: 645997.0 [2024-08-06 05:54:12,666][52811] Sum rewards: 69.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.077', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.506', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '59.000'} [2024-08-06 05:54:12,767][52662] DAMAGECOUNT value on done: 690046.0 [2024-08-06 05:54:12,767][52662] Sum rewards: 78.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.172', 'AMMO3': '0.224', 'AMMO4': '0.225', 'weapon4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 530071552. Throughput: 0: 4355.8. Samples: 132526020. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:12,795][52567] Avg episode reward: [(0, '73.168')] [2024-08-06 05:54:12,865][52669] DAMAGECOUNT value on done: 690595.0 [2024-08-06 05:54:12,875][52669] Sum rewards: 66.557, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.647', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.074', 'AMMO4': '0.221', 'weapon5': '0.244', 'weapon2': '0.266', 'AMMO3': '0.299', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.076', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:13,188][52820] DAMAGECOUNT value on done: 635223.0 [2024-08-06 05:54:13,189][52820] Sum rewards: 79.104, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'weapon5': '0.098', 'WEAPON5': '0.100', 'HEALTH': '0.175', 'AMMO3': '0.228', 'weapon4': '0.276', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:13,327][52795] DAMAGECOUNT value on done: 621284.0 [2024-08-06 05:54:13,328][52795] Sum rewards: 66.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.299', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.210', 'AMMO4': '0.270', 'weapon2': '0.284', 'weapon5': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.538', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '55.000'} [2024-08-06 05:54:13,625][52671] DAMAGECOUNT value on done: 694749.0 [2024-08-06 05:54:13,626][52671] Sum rewards: 72.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.108', 'AMMO4': '0.171', 'AMMO3': '0.234', 'weapon5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:13,908][52614] Signal inference workers to stop experience collection... (11750 times) [2024-08-06 05:54:13,909][52614] Signal inference workers to resume experience collection... (11750 times) [2024-08-06 05:54:13,960][52650] InferenceWorker_p0-w0: stopping experience collection (11750 times) [2024-08-06 05:54:13,962][52650] InferenceWorker_p0-w0: resuming experience collection (11750 times) [2024-08-06 05:54:14,783][52650] Updated weights for policy 0, policy_version 64711 (0.0028) [2024-08-06 05:54:15,370][52668] DAMAGECOUNT value on done: 689965.0 [2024-08-06 05:54:15,373][52668] Sum rewards: 69.476, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.190', 'AMMO3': '0.244', 'weapon5': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '2.892', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.000'} [2024-08-06 05:54:15,439][52662] DAMAGECOUNT value on done: 689694.0 [2024-08-06 05:54:15,441][52662] Sum rewards: 77.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO4': '0.078', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:15,659][52669] DAMAGECOUNT value on done: 695959.0 [2024-08-06 05:54:15,660][52669] Sum rewards: 66.118, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.447', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.664', 'WEAPON3': '0.850', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '51.000'} [2024-08-06 05:54:15,681][52811] DAMAGECOUNT value on done: 640395.0 [2024-08-06 05:54:15,681][52811] Sum rewards: 88.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.370', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.090', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '72.000'} [2024-08-06 05:54:15,700][52658] DAMAGECOUNT value on done: 683705.0 [2024-08-06 05:54:15,700][52658] Sum rewards: 80.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.172', 'weapon2': '0.216', 'AMMO4': '0.227', 'AMMO3': '0.242', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:16,453][52820] DAMAGECOUNT value on done: 640148.0 [2024-08-06 05:54:16,456][52820] Sum rewards: 72.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.610', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.186', 'weapon5': '0.224', 'AMMO4': '0.225', 'AMMO3': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.560', 'WEAPON3': '1.600', 'weapon3': '2.720', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:16,562][52671] DAMAGECOUNT value on done: 692549.0 [2024-08-06 05:54:16,564][52671] Sum rewards: 75.456, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.756', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.114', 'AMMO4': '0.162', 'weapon5': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.080', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:16,571][52795] DAMAGECOUNT value on done: 639531.0 [2024-08-06 05:54:16,572][52795] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.155', 'AMMO3': '0.157', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '0.950', 'HITCOUNT': '3.100', 'weapon3': '3.176', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '58.000'} [2024-08-06 05:54:17,794][52567] Fps is (10 sec: 18023.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 530161664. Throughput: 0: 4359.1. Samples: 132539180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:17,794][52567] Avg episode reward: [(0, '72.891')] [2024-08-06 05:54:18,101][52668] DAMAGECOUNT value on done: 681567.0 [2024-08-06 05:54:18,102][52668] Sum rewards: 67.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.913', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.221', 'weapon2': '0.222', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '54.500'} [2024-08-06 05:54:18,588][52658] DAMAGECOUNT value on done: 686643.0 [2024-08-06 05:54:18,589][52658] Sum rewards: 62.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.190', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.092', 'AMMO3': '0.189', 'AMMO4': '0.229', 'weapon5': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '51.000'} [2024-08-06 05:54:18,621][52662] DAMAGECOUNT value on done: 696678.0 [2024-08-06 05:54:18,622][52662] Sum rewards: 82.475, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.918', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.138', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.421', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:18,778][52811] DAMAGECOUNT value on done: 638411.0 [2024-08-06 05:54:18,781][52811] Sum rewards: 83.204, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.099', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.120', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:18,925][52649] DAMAGECOUNT value on done: 662078.0 [2024-08-06 05:54:18,928][52649] Sum rewards: 75.212, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.015', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.100', 'AMMO4': '0.163', 'weapon5': '0.230', 'weapon2': '0.252', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.178', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '67.000'} [2024-08-06 05:54:19,533][52820] DAMAGECOUNT value on done: 636136.0 [2024-08-06 05:54:19,534][52820] Sum rewards: 77.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.485', 'AMMO2': '0.029', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.192', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.430', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '63.000'} [2024-08-06 05:54:19,653][52795] DAMAGECOUNT value on done: 633569.0 [2024-08-06 05:54:19,654][52795] Sum rewards: 73.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.646', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.053', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:19,829][52671] DAMAGECOUNT value on done: 692398.0 [2024-08-06 05:54:19,829][52671] Sum rewards: 76.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.130', 'AMMO4': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '63.000'} [2024-08-06 05:54:19,877][52650] Updated weights for policy 0, policy_version 64721 (0.0022) [2024-08-06 05:54:20,108][52803] DAMAGECOUNT value on done: 636185.0 [2024-08-06 05:54:20,108][52803] Sum rewards: 61.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.281', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.164', 'AMMO3': '0.220', 'weapon4': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.704', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '50.000'} [2024-08-06 05:54:21,254][52668] DAMAGECOUNT value on done: 682243.0 [2024-08-06 05:54:21,256][52668] Sum rewards: 71.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.875', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.134', 'AMMO4': '0.154', 'weapon5': '0.162', 'AMMO3': '0.178', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.280', 'weapon3': '3.288', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '58.000'} [2024-08-06 05:54:21,521][52662] DAMAGECOUNT value on done: 681015.0 [2024-08-06 05:54:21,523][52662] Sum rewards: 77.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.742', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:21,960][52649] DAMAGECOUNT value on done: 655849.0 [2024-08-06 05:54:21,962][52649] Sum rewards: 84.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.034', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.182', 'AMMO3': '0.195', 'AMMO4': '0.199', 'weapon2': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '67.000'} [2024-08-06 05:54:21,979][52811] DAMAGECOUNT value on done: 635560.0 [2024-08-06 05:54:21,983][52811] Sum rewards: 70.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.461', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.434', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:22,635][52820] DAMAGECOUNT value on done: 636310.0 [2024-08-06 05:54:22,636][52820] Sum rewards: 66.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.121', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.210', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.372', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '56.000'} [2024-08-06 05:54:22,683][52671] DAMAGECOUNT value on done: 691674.0 [2024-08-06 05:54:22,683][52671] Sum rewards: 74.971, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.153', 'AMMO3': '0.201', 'weapon5': '0.232', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:22,790][52666] Large shaping reward 2.555 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.504, 168.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:54:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 530243584. Throughput: 0: 4369.3. Samples: 132565400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:22,794][52567] Avg episode reward: [(0, '72.441')] [2024-08-06 05:54:22,826][52795] DAMAGECOUNT value on done: 625936.0 [2024-08-06 05:54:22,826][52795] Sum rewards: 63.782, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.009', 'AMMO2': '0.038', 'WEAPON4': '0.100', 'HEALTH': '0.110', 'AMMO3': '0.136', 'weapon4': '0.182', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.284', 'weapon2': '0.410', 'WEAPON3': '0.800', 'weapon3': '2.988', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '49.000'} [2024-08-06 05:54:23,198][52803] DAMAGECOUNT value on done: 637279.0 [2024-08-06 05:54:23,206][52803] Sum rewards: 65.826, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.054', 'AMMO4': '0.161', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.374', 'weapon2': '0.382', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:24,292][52650] Updated weights for policy 0, policy_version 64731 (0.0011) [2024-08-06 05:54:24,379][52668] DAMAGECOUNT value on done: 689789.0 [2024-08-06 05:54:24,379][52668] Sum rewards: 73.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.969', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.185', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.388', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '58.000'} [2024-08-06 05:54:24,787][52662] DAMAGECOUNT value on done: 698965.0 [2024-08-06 05:54:24,789][52662] Sum rewards: 80.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.062', 'AMMO4': '0.119', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:25,061][52811] DAMAGECOUNT value on done: 635842.0 [2024-08-06 05:54:25,062][52811] Sum rewards: 78.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.195', 'weapon2': '0.700', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:25,181][52649] DAMAGECOUNT value on done: 675924.0 [2024-08-06 05:54:25,182][52649] Sum rewards: 73.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.308', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.094', 'AMMO4': '0.170', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:25,578][52671] DAMAGECOUNT value on done: 686442.0 [2024-08-06 05:54:25,578][52671] Sum rewards: 64.671, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.164', 'weapon2': '0.178', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.660', 'WEAPON3': '1.300', 'weapon3': '2.710', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:25,922][52820] DAMAGECOUNT value on done: 646944.0 [2024-08-06 05:54:25,923][52820] Sum rewards: 68.031, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon5': '0.152', 'AMMO4': '0.223', 'AMMO3': '0.237', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '58.000'} [2024-08-06 05:54:26,070][52795] DAMAGECOUNT value on done: 633630.0 [2024-08-06 05:54:26,072][52795] Sum rewards: 63.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.932', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon4': '0.154', 'weapon5': '0.182', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:26,291][52803] DAMAGECOUNT value on done: 642600.0 [2024-08-06 05:54:26,292][52803] Sum rewards: 80.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.163', 'weapon2': '0.216', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '67.000'} [2024-08-06 05:54:27,650][52668] DAMAGECOUNT value on done: 687207.0 [2024-08-06 05:54:27,650][52668] Sum rewards: 83.499, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.850', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.293', 'weapon2': '0.296', 'WEAPON3': '1.850', 'weapon3': '3.500', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '73.000'} [2024-08-06 05:54:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 530333696. Throughput: 0: 4371.1. Samples: 132591690. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:27,794][52567] Avg episode reward: [(0, '72.242')] [2024-08-06 05:54:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064738_530333696.pth... [2024-08-06 05:54:27,914][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064227_526147584.pth [2024-08-06 05:54:27,979][52662] DAMAGECOUNT value on done: 677640.0 [2024-08-06 05:54:27,981][52662] Sum rewards: 70.271, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.380', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.042', 'weapon5': '0.130', 'AMMO4': '0.199', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.600', 'HITCOUNT': '3.160', 'weapon3': '3.310', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '62.000'} [2024-08-06 05:54:28,166][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:54:28,286][52811] DAMAGECOUNT value on done: 640936.0 [2024-08-06 05:54:28,289][52811] Sum rewards: 70.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.591', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.095', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.246', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.354', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '58.000'} [2024-08-06 05:54:28,342][52649] DAMAGECOUNT value on done: 670277.0 [2024-08-06 05:54:28,345][52649] Sum rewards: 86.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.604', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.060', 'weapon5': '0.164', 'AMMO3': '0.197', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.270', 'FRAGCOUNT': '72.000'} [2024-08-06 05:54:29,155][52650] Updated weights for policy 0, policy_version 64741 (0.0012) [2024-08-06 05:54:29,286][52795] DAMAGECOUNT value on done: 641540.0 [2024-08-06 05:54:29,286][52795] Sum rewards: 82.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.292', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.104', 'AMMO4': '0.150', 'weapon5': '0.216', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '69.000'} [2024-08-06 05:54:29,384][52670] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:54:29,389][52820] DAMAGECOUNT value on done: 645515.0 [2024-08-06 05:54:29,389][52820] Sum rewards: 78.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.117', 'AMMO3': '0.217', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:29,616][52803] DAMAGECOUNT value on done: 642229.0 [2024-08-06 05:54:29,617][52803] Sum rewards: 62.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.084', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.192', 'AMMO4': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.050', 'HITCOUNT': '2.750', 'weapon3': '3.094', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '53.000'} [2024-08-06 05:54:30,180][52668] DAMAGECOUNT value on done: 677647.0 [2024-08-06 05:54:30,180][52668] Sum rewards: 79.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.104', 'weapon5': '0.116', 'AMMO4': '0.188', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:31,269][52662] DAMAGECOUNT value on done: 686190.0 [2024-08-06 05:54:31,269][52662] Sum rewards: 73.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.504', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.122', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:31,426][52811] DAMAGECOUNT value on done: 645342.0 [2024-08-06 05:54:31,426][52811] Sum rewards: 76.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.219', 'AMMO5': '0.024', 'AMMO2': '0.052', 'weapon4': '0.126', 'weapon5': '0.210', 'AMMO3': '0.224', 'AMMO4': '0.262', 'weapon2': '0.454', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.864', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '67.000'} [2024-08-06 05:54:31,545][52649] DAMAGECOUNT value on done: 659043.0 [2024-08-06 05:54:31,547][52649] Sum rewards: 67.883, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.934', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.136', 'weapon4': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON4': '0.300', 'AMMO3': '0.312', 'WEAPON3': '1.750', 'weapon3': '3.196', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:32,485][52820] DAMAGECOUNT value on done: 633425.0 [2024-08-06 05:54:32,488][52820] Sum rewards: 70.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.208', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '59.000'} [2024-08-06 05:54:32,700][52664] DAMAGECOUNT value on done: 709549.0 [2024-08-06 05:54:32,700][52664] Sum rewards: 77.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.753', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon4': '0.092', 'AMMO3': '0.215', 'AMMO4': '0.232', 'weapon5': '0.268', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '62.000'} [2024-08-06 05:54:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 530423808. Throughput: 0: 4360.9. Samples: 132604320. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:32,794][52567] Avg episode reward: [(0, '72.778')] [2024-08-06 05:54:32,829][52803] DAMAGECOUNT value on done: 640962.0 [2024-08-06 05:54:32,830][52803] Sum rewards: 66.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.035', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.167', 'weapon2': '0.684', 'WEAPON3': '0.950', 'HITCOUNT': '3.020', 'weapon3': '3.182', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:33,351][52668] DAMAGECOUNT value on done: 672514.0 [2024-08-06 05:54:33,352][52668] Sum rewards: 80.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.304', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.132', 'weapon5': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:33,659][52650] Updated weights for policy 0, policy_version 64751 (0.0014) [2024-08-06 05:54:34,276][52660] DAMAGECOUNT value on done: 686292.0 [2024-08-06 05:54:34,279][52660] Sum rewards: 66.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.146', 'AMMO3': '0.237', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.302', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '56.000'} [2024-08-06 05:54:34,514][52811] DAMAGECOUNT value on done: 642026.0 [2024-08-06 05:54:34,516][52811] Sum rewards: 74.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.327', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon5': '0.138', 'AMMO3': '0.172', 'weapon4': '0.224', 'AMMO4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.000', 'weapon3': '3.070', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:34,703][52649] DAMAGECOUNT value on done: 674677.0 [2024-08-06 05:54:34,703][52649] Sum rewards: 87.302, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.075', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.272', 'weapon2': '0.354', 'WEAPON3': '1.550', 'weapon3': '3.344', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.309', 'FRAGCOUNT': '73.000'} [2024-08-06 05:54:34,946][52662] DAMAGECOUNT value on done: 694968.0 [2024-08-06 05:54:34,947][52662] Sum rewards: 68.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.206', 'AMMO4': '0.218', 'AMMO3': '0.243', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '58.000'} [2024-08-06 05:54:35,259][52664] DAMAGECOUNT value on done: 715923.0 [2024-08-06 05:54:35,259][52664] Sum rewards: 65.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:35,929][52803] DAMAGECOUNT value on done: 634058.0 [2024-08-06 05:54:35,930][52803] Sum rewards: 69.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.195', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.080', 'AMMO3': '0.186', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:35,938][52668] DAMAGECOUNT value on done: 673433.0 [2024-08-06 05:54:35,940][52668] Sum rewards: 81.681, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.560', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.015', 'weapon5': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon2': '0.198', 'AMMO3': '0.314', 'WEAPON3': '1.950', 'weapon3': '3.526', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.081', 'FRAGCOUNT': '72.500'} [2024-08-06 05:54:36,967][52660] DAMAGECOUNT value on done: 674627.0 [2024-08-06 05:54:36,967][52660] Sum rewards: 67.271, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.199', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.196', 'weapon5': '0.222', 'weapon2': '0.224', 'AMMO3': '0.267', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.152', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2024-08-06 05:54:37,556][52811] DAMAGECOUNT value on done: 639000.0 [2024-08-06 05:54:37,558][52811] Sum rewards: 68.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.868', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.081', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.308', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 530505728. Throughput: 0: 4364.9. Samples: 132630760. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 05:54:37,795][52567] Avg episode reward: [(0, '72.790')] [2024-08-06 05:54:37,920][52649] DAMAGECOUNT value on done: 666874.0 [2024-08-06 05:54:37,921][52649] Sum rewards: 73.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO2': '0.006', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO4': '0.028', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:37,945][52662] DAMAGECOUNT value on done: 687527.0 [2024-08-06 05:54:37,948][52662] Sum rewards: 77.112, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.458', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.040', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon2': '0.152', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'weapon3': '3.560', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:38,142][52664] DAMAGECOUNT value on done: 711521.0 [2024-08-06 05:54:38,144][52664] Sum rewards: 70.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.428', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.052', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.237', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.398', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:38,453][52650] Updated weights for policy 0, policy_version 64761 (0.0018) [2024-08-06 05:54:39,033][52668] DAMAGECOUNT value on done: 672312.0 [2024-08-06 05:54:39,033][52668] Sum rewards: 75.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.292', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon2': '0.170', 'weapon5': '0.188', 'AMMO3': '0.196', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:39,102][52803] DAMAGECOUNT value on done: 632700.0 [2024-08-06 05:54:39,103][52803] Sum rewards: 79.740, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.163', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.076', 'AMMO4': '0.166', 'AMMO3': '0.173', 'weapon5': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.535', 'FRAGCOUNT': '62.000'} [2024-08-06 05:54:40,226][52660] DAMAGECOUNT value on done: 689049.0 [2024-08-06 05:54:40,227][52660] Sum rewards: 76.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.078', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.184', 'AMMO3': '0.229', 'AMMO4': '0.285', 'weapon4': '0.292', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:40,756][52649] DAMAGECOUNT value on done: 669815.0 [2024-08-06 05:54:40,757][52649] Sum rewards: 65.136, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.366', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.040', 'AMMO4': '0.087', 'AMMO3': '0.165', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '52.000'} [2024-08-06 05:54:40,901][52664] DAMAGECOUNT value on done: 705663.0 [2024-08-06 05:54:40,901][52664] Sum rewards: 79.725, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.007', 'HEALTH': '0.020', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.227', 'WEAPON3': '1.300', 'weapon3': '3.432', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:40,904][52662] DAMAGECOUNT value on done: 695912.0 [2024-08-06 05:54:40,904][52662] Sum rewards: 87.061, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.046', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.778', 'FRAGCOUNT': '74.000'} [2024-08-06 05:54:41,858][52668] DAMAGECOUNT value on done: 684865.0 [2024-08-06 05:54:41,859][52668] Sum rewards: 66.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.365', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.108', 'weapon4': '0.144', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.850', 'weapon3': '2.920', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 05:54:42,287][52803] DAMAGECOUNT value on done: 632481.0 [2024-08-06 05:54:42,288][52803] Sum rewards: 79.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.499', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.221', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 530595840. Throughput: 0: 4368.7. Samples: 132656860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:54:42,794][52567] Avg episode reward: [(0, '73.210')] [2024-08-06 05:54:42,826][52650] Updated weights for policy 0, policy_version 64771 (0.0027) [2024-08-06 05:54:43,090][52660] DAMAGECOUNT value on done: 695089.0 [2024-08-06 05:54:43,090][52660] Sum rewards: 77.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.162', 'AMMO3': '0.191', 'weapon4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '63.500'} [2024-08-06 05:54:43,327][52662] DAMAGECOUNT value on done: 681244.0 [2024-08-06 05:54:43,329][52662] Sum rewards: 67.657, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.769', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon5': '0.162', 'AMMO3': '0.185', 'AMMO4': '0.247', 'weapon2': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 05:54:43,413][52649] DAMAGECOUNT value on done: 670545.0 [2024-08-06 05:54:43,413][52649] Sum rewards: 72.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.130', 'AMMO3': '0.146', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '57.500'} [2024-08-06 05:54:43,739][52664] DAMAGECOUNT value on done: 716963.0 [2024-08-06 05:54:43,741][52664] Sum rewards: 74.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.025', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.072', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:45,039][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:54:45,097][52668] DAMAGECOUNT value on done: 683312.0 [2024-08-06 05:54:45,097][52668] Sum rewards: 75.052, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.538', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO3': '0.207', 'AMMO4': '0.214', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:45,292][52803] DAMAGECOUNT value on done: 634530.0 [2024-08-06 05:54:45,293][52803] Sum rewards: 66.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.393', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon5': '0.038', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.206', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '57.000'} [2024-08-06 05:54:46,066][52662] DAMAGECOUNT value on done: 683800.0 [2024-08-06 05:54:46,069][52662] Sum rewards: 88.439, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.145', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.008', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.173', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '71.000'} [2024-08-06 05:54:46,202][52660] DAMAGECOUNT value on done: 680752.0 [2024-08-06 05:54:46,202][52660] Sum rewards: 77.577, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.780', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.070', 'weapon5': '0.174', 'AMMO4': '0.219', 'weapon2': '0.252', 'AMMO3': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.204', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '68.000'} [2024-08-06 05:54:46,607][52649] DAMAGECOUNT value on done: 662153.0 [2024-08-06 05:54:46,607][52649] Sum rewards: 65.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.202', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon4': '0.116', 'weapon5': '0.224', 'AMMO3': '0.237', 'AMMO4': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.450', 'weapon3': '2.892', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '56.000'} [2024-08-06 05:54:46,656][52664] DAMAGECOUNT value on done: 709410.0 [2024-08-06 05:54:46,658][52664] Sum rewards: 70.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.578', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.176', 'AMMO3': '0.180', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '57.500'} [2024-08-06 05:54:47,669][52650] Updated weights for policy 0, policy_version 64781 (0.0014) [2024-08-06 05:54:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 530685952. Throughput: 0: 4371.1. Samples: 132670050. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:54:47,794][52567] Avg episode reward: [(0, '73.312')] [2024-08-06 05:54:48,235][52668] DAMAGECOUNT value on done: 680899.0 [2024-08-06 05:54:48,235][52668] Sum rewards: 75.114, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.012', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.106', 'weapon5': '0.218', 'AMMO3': '0.293', 'AMMO4': '0.299', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.038', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:48,370][52803] DAMAGECOUNT value on done: 633880.0 [2024-08-06 05:54:48,371][52803] Sum rewards: 87.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.032', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.188', 'AMMO4': '0.201', 'AMMO3': '0.213', 'weapon4': '0.252', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.448', 'FRAGCOUNT': '73.000'} [2024-08-06 05:54:48,625][52662] DAMAGECOUNT value on done: 681541.0 [2024-08-06 05:54:48,627][52662] Sum rewards: 77.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.396', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.226', 'weapon2': '0.628', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:48,935][52660] DAMAGECOUNT value on done: 677469.0 [2024-08-06 05:54:48,935][52660] Sum rewards: 70.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.502', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.174', 'weapon5': '0.186', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '58.500'} [2024-08-06 05:54:49,304][52664] DAMAGECOUNT value on done: 706861.0 [2024-08-06 05:54:49,305][52664] Sum rewards: 82.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.195', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '68.000'} [2024-08-06 05:54:49,900][52649] DAMAGECOUNT value on done: 676697.0 [2024-08-06 05:54:49,903][52649] Sum rewards: 81.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.142', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.155', 'weapon4': '0.186', 'AMMO4': '0.215', 'weapon5': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '65.000'} [2024-08-06 05:54:50,896][52668] DAMAGECOUNT value on done: 690410.0 [2024-08-06 05:54:50,896][52668] Sum rewards: 73.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.560', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:51,449][52662] DAMAGECOUNT value on done: 690251.0 [2024-08-06 05:54:51,451][52662] Sum rewards: 67.317, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.462', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.171', 'weapon2': '0.192', 'WEAPON3': '1.000', 'HITCOUNT': '3.180', 'weapon3': '3.298', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:51,508][52803] DAMAGECOUNT value on done: 649038.0 [2024-08-06 05:54:51,511][52803] Sum rewards: 77.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.995', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.132', 'AMMO4': '0.169', 'AMMO3': '0.172', 'weapon4': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '64.000'} [2024-08-06 05:54:51,902][52660] DAMAGECOUNT value on done: 681712.0 [2024-08-06 05:54:51,903][52660] Sum rewards: 84.891, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.183', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.490', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '70.000'} [2024-08-06 05:54:52,043][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:54:52,378][52664] DAMAGECOUNT value on done: 703026.0 [2024-08-06 05:54:52,378][52664] Sum rewards: 69.125, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.884', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.154', 'AMMO4': '0.154', 'AMMO3': '0.161', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 05:54:52,659][52650] Updated weights for policy 0, policy_version 64791 (0.0011) [2024-08-06 05:54:52,712][52649] DAMAGECOUNT value on done: 676763.0 [2024-08-06 05:54:52,714][52649] Sum rewards: 68.679, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.875', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO3': '0.166', 'AMMO4': '0.171', 'weapon2': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.356', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '54.500'} [2024-08-06 05:54:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 530767872. Throughput: 0: 4370.1. Samples: 132696410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:54:52,794][52567] Avg episode reward: [(0, '73.700')] [2024-08-06 05:54:53,971][52668] DAMAGECOUNT value on done: 686571.0 [2024-08-06 05:54:53,980][52668] Sum rewards: 79.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.168', 'AMMO4': '0.222', 'weapon2': '0.226', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '66.000'} [2024-08-06 05:54:54,155][52662] DAMAGECOUNT value on done: 681886.0 [2024-08-06 05:54:54,156][52662] Sum rewards: 62.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.726', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.174', 'AMMO3': '0.205', 'AMMO4': '0.223', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.144', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '54.000'} [2024-08-06 05:54:54,794][52803] DAMAGECOUNT value on done: 637878.0 [2024-08-06 05:54:54,796][52803] Sum rewards: 72.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.194', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:55,085][52660] DAMAGECOUNT value on done: 691634.0 [2024-08-06 05:54:55,086][52660] Sum rewards: 66.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.249', 'AMMO5': '0.017', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.162', 'weapon4': '0.184', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.720', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '55.000'} [2024-08-06 05:54:55,666][52649] DAMAGECOUNT value on done: 676022.0 [2024-08-06 05:54:55,669][52649] Sum rewards: 70.860, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.860', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.190', 'weapon4': '0.194', 'AMMO3': '0.218', 'AMMO4': '0.222', 'weapon2': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '60.000'} [2024-08-06 05:54:55,678][52664] DAMAGECOUNT value on done: 716641.0 [2024-08-06 05:54:55,678][52664] Sum rewards: 75.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.150', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.412', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '61.000'} [2024-08-06 05:54:56,977][52662] DAMAGECOUNT value on done: 695598.0 [2024-08-06 05:54:56,979][52662] Sum rewards: 76.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.584', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.148', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.558', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '63.000'} [2024-08-06 05:54:57,286][52650] Updated weights for policy 0, policy_version 64801 (0.0013) [2024-08-06 05:54:57,581][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:54:57,608][52660] DAMAGECOUNT value on done: 676959.0 [2024-08-06 05:54:57,610][52660] Sum rewards: 58.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.068', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.106', 'AMMO3': '0.184', 'weapon5': '0.266', 'AMMO4': '0.290', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '2.740', 'weapon3': '2.932', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '48.000'} [2024-08-06 05:54:57,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 530849792. Throughput: 0: 4370.0. Samples: 132722670. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:54:57,795][52567] Avg episode reward: [(0, '73.718')] [2024-08-06 05:54:57,862][52803] DAMAGECOUNT value on done: 636900.0 [2024-08-06 05:54:57,862][52803] Sum rewards: 79.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.145', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'weapon2': '0.202', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.526', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '67.000'} [2024-08-06 05:54:58,513][52664] DAMAGECOUNT value on done: 706635.0 [2024-08-06 05:54:58,513][52664] Sum rewards: 76.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.233', 'AMMO5': '0.004', 'weapon5': '0.028', 'AMMO2': '0.043', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'AMMO4': '0.217', 'weapon2': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '63.000'} [2024-08-06 05:54:58,748][52649] DAMAGECOUNT value on done: 672613.0 [2024-08-06 05:54:58,749][52649] Sum rewards: 73.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.971', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.106', 'AMMO3': '0.215', 'weapon5': '0.234', 'AMMO4': '0.253', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '61.500'} [2024-08-06 05:55:00,080][52660] DAMAGECOUNT value on done: 680949.0 [2024-08-06 05:55:00,082][52660] Sum rewards: 63.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.043', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.182', 'weapon5': '0.182', 'AMMO3': '0.189', 'weapon2': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 05:55:00,138][52662] DAMAGECOUNT value on done: 691699.0 [2024-08-06 05:55:00,138][52662] Sum rewards: 64.803, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.718', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'weapon4': '0.190', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '55.000'} [2024-08-06 05:55:01,209][52803] DAMAGECOUNT value on done: 650091.0 [2024-08-06 05:55:01,209][52803] Sum rewards: 74.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.685', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:01,241][52664] DAMAGECOUNT value on done: 717120.0 [2024-08-06 05:55:01,242][52664] Sum rewards: 84.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.514', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.128', 'weapon5': '0.184', 'AMMO4': '0.215', 'AMMO3': '0.240', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '69.000'} [2024-08-06 05:55:01,942][52650] Updated weights for policy 0, policy_version 64811 (0.0034) [2024-08-06 05:55:01,957][52649] DAMAGECOUNT value on done: 659445.0 [2024-08-06 05:55:01,958][52649] Sum rewards: 61.444, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.306', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.102', 'AMMO4': '0.144', 'weapon5': '0.160', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.696', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.832', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '50.000'} [2024-08-06 05:55:02,705][52660] DAMAGECOUNT value on done: 687010.0 [2024-08-06 05:55:02,706][52660] Sum rewards: 66.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.396', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.088', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.372', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.276', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 05:55:02,774][52795] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:55:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 530948096. Throughput: 0: 4369.1. Samples: 132735790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:55:02,795][52567] Avg episode reward: [(0, '73.467')] [2024-08-06 05:55:03,224][52662] DAMAGECOUNT value on done: 677831.0 [2024-08-06 05:55:03,224][52662] Sum rewards: 87.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.463', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.108', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.471', 'FRAGCOUNT': '69.000'} [2024-08-06 05:55:03,816][52664] DAMAGECOUNT value on done: 718076.0 [2024-08-06 05:55:03,817][52664] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.136', 'AMMO4': '0.193', 'AMMO3': '0.201', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.360', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '58.000'} [2024-08-06 05:55:04,319][52803] DAMAGECOUNT value on done: 637649.0 [2024-08-06 05:55:04,321][52803] Sum rewards: 75.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.114', 'weapon4': '0.154', 'AMMO3': '0.191', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '63.000'} [2024-08-06 05:55:05,251][52649] DAMAGECOUNT value on done: 671414.0 [2024-08-06 05:55:05,252][52649] Sum rewards: 70.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO3': '0.174', 'AMMO4': '0.174', 'weapon5': '0.190', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.254', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '57.000'} [2024-08-06 05:55:05,345][52660] DAMAGECOUNT value on done: 678649.0 [2024-08-06 05:55:05,346][52660] Sum rewards: 63.661, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.955', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.132', 'weapon2': '0.586', 'WEAPON3': '0.850', 'HITCOUNT': '2.940', 'weapon3': '3.290', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '51.000'} [2024-08-06 05:55:05,836][52662] DAMAGECOUNT value on done: 685510.0 [2024-08-06 05:55:05,838][52662] Sum rewards: 71.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.123', 'weapon2': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon4': '0.428', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:05,982][52668] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 05:55:06,107][52671] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:55:06,648][52664] DAMAGECOUNT value on done: 717383.0 [2024-08-06 05:55:06,649][52664] Sum rewards: 90.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.006', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'weapon2': '0.218', 'AMMO3': '0.237', 'weapon4': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '22.098', 'FRAGCOUNT': '74.000'} [2024-08-06 05:55:06,850][52650] Updated weights for policy 0, policy_version 64821 (0.0019) [2024-08-06 05:55:07,456][52649] DAMAGECOUNT value on done: 662097.0 [2024-08-06 05:55:07,457][52649] Sum rewards: 64.532, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.312', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '53.000'} [2024-08-06 05:55:07,500][52659] DAMAGECOUNT value on done: 689605.0 [2024-08-06 05:55:07,502][52659] Sum rewards: 78.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.856', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.188', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '65.000'} [2024-08-06 05:55:07,634][52660] DAMAGECOUNT value on done: 682742.0 [2024-08-06 05:55:07,637][52660] Sum rewards: 76.389, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon4': '0.186', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '64.000'} [2024-08-06 05:55:07,654][52803] DAMAGECOUNT value on done: 637797.0 [2024-08-06 05:55:07,654][52803] Sum rewards: 70.221, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.184', 'weapon2': '0.262', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.174', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '57.000'} [2024-08-06 05:55:07,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17613.0, 300 sec: 17494.8). Total num frames: 531038208. Throughput: 0: 4372.2. Samples: 132762150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:55:07,794][52567] Avg episode reward: [(0, '73.648')] [2024-08-06 05:55:08,743][52662] DAMAGECOUNT value on done: 677886.0 [2024-08-06 05:55:08,743][52662] Sum rewards: 75.690, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.952', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.050', 'weapon3': '3.304', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:09,845][52664] DAMAGECOUNT value on done: 718096.0 [2024-08-06 05:55:09,846][52664] Sum rewards: 73.025, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.196', 'weapon4': '0.266', 'weapon5': '0.290', 'AMMO4': '0.301', 'weapon2': '0.358', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 05:55:10,366][52649] DAMAGECOUNT value on done: 675286.0 [2024-08-06 05:55:10,366][52649] Sum rewards: 76.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.846', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.114', 'weapon5': '0.142', 'AMMO4': '0.142', 'AMMO3': '0.153', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.250', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 05:55:10,607][52659] DAMAGECOUNT value on done: 686404.0 [2024-08-06 05:55:10,609][52659] Sum rewards: 79.422, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.168', 'AMMO4': '0.207', 'weapon5': '0.238', 'weapon2': '0.250', 'AMMO3': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '69.000'} [2024-08-06 05:55:10,871][52803] DAMAGECOUNT value on done: 642108.0 [2024-08-06 05:55:10,876][52803] Sum rewards: 81.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.044', 'weapon5': '0.088', 'AMMO4': '0.102', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.368', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '66.000'} [2024-08-06 05:55:10,927][52650] Updated weights for policy 0, policy_version 64831 (0.0015) [2024-08-06 05:55:11,009][52660] DAMAGECOUNT value on done: 694071.0 [2024-08-06 05:55:11,011][52660] Sum rewards: 79.087, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.925', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.082', 'AMMO3': '0.209', 'weapon5': '0.240', 'AMMO4': '0.281', 'weapon2': '0.420', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '67.000'} [2024-08-06 05:55:12,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 531111936. Throughput: 0: 4374.9. Samples: 132788560. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:55:12,794][52567] Avg episode reward: [(0, '73.916')] [2024-08-06 05:55:12,936][52664] DAMAGECOUNT value on done: 720531.0 [2024-08-06 05:55:12,936][52664] Sum rewards: 68.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.655', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.152', 'weapon4': '0.168', 'AMMO4': '0.181', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '58.000'} [2024-08-06 05:55:13,088][52659] DAMAGECOUNT value on done: 688487.0 [2024-08-06 05:55:13,089][52659] Sum rewards: 64.173, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.016', 'AMMO2': '0.035', 'HEALTH': '0.038', 'weapon4': '0.102', 'AMMO4': '0.174', 'AMMO3': '0.228', 'weapon5': '0.238', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.126', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '54.500'} [2024-08-06 05:55:13,402][52649] DAMAGECOUNT value on done: 674532.0 [2024-08-06 05:55:13,404][52649] Sum rewards: 60.176, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.220', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon5': '0.172', 'AMMO3': '0.181', 'AMMO4': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '51.000'} [2024-08-06 05:55:13,585][52660] DAMAGECOUNT value on done: 701326.0 [2024-08-06 05:55:13,587][52660] Sum rewards: 75.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.631', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.438', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '63.000'} [2024-08-06 05:55:14,124][52803] DAMAGECOUNT value on done: 643232.0 [2024-08-06 05:55:14,125][52803] Sum rewards: 71.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.167', 'weapon4': '0.178', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '59.000'} [2024-08-06 05:55:15,469][52664] DAMAGECOUNT value on done: 714238.0 [2024-08-06 05:55:15,477][52664] Sum rewards: 84.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.110', 'AMMO5': '0.013', 'weapon4': '0.060', 'AMMO2': '0.065', 'weapon5': '0.152', 'weapon2': '0.214', 'AMMO3': '0.241', 'AMMO4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.348', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '71.000'} [2024-08-06 05:55:15,858][52659] DAMAGECOUNT value on done: 685902.0 [2024-08-06 05:55:15,860][52659] Sum rewards: 93.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.090', 'AMMO4': '0.110', 'weapon5': '0.132', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.978', 'FRAGCOUNT': '74.000'} [2024-08-06 05:55:16,080][52650] Updated weights for policy 0, policy_version 64841 (0.0013) [2024-08-06 05:55:16,528][52649] DAMAGECOUNT value on done: 668814.0 [2024-08-06 05:55:16,530][52649] Sum rewards: 76.586, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.284', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.078', 'weapon4': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.214', 'WEAPON3': '1.050', 'weapon3': '3.468', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:16,715][52660] DAMAGECOUNT value on done: 680471.0 [2024-08-06 05:55:16,715][52660] Sum rewards: 60.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.776', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.084', 'AMMO4': '0.188', 'AMMO3': '0.230', 'weapon5': '0.258', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '52.000'} [2024-08-06 05:55:17,282][52803] DAMAGECOUNT value on done: 648812.0 [2024-08-06 05:55:17,283][52803] Sum rewards: 83.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.182', 'AMMO3': '0.191', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '68.000'} [2024-08-06 05:55:17,300][52795] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 05:55:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 531210240. Throughput: 0: 4382.9. Samples: 132801550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 05:55:17,794][52567] Avg episode reward: [(0, '73.975')] [2024-08-06 05:55:18,293][52664] DAMAGECOUNT value on done: 708440.0 [2024-08-06 05:55:18,294][52664] Sum rewards: 73.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.898', 'AMMO5': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.116', 'weapon4': '0.134', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:19,023][52659] DAMAGECOUNT value on done: 683074.0 [2024-08-06 05:55:19,024][52659] Sum rewards: 60.569, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.707', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.162', 'weapon4': '0.208', 'AMMO4': '0.210', 'AMMO3': '0.294', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.014', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '53.000'} [2024-08-06 05:55:19,439][52660] DAMAGECOUNT value on done: 690672.0 [2024-08-06 05:55:19,441][52660] Sum rewards: 76.521, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.560', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.152', 'AMMO4': '0.169', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '66.000'} [2024-08-06 05:55:20,381][52803] DAMAGECOUNT value on done: 639721.0 [2024-08-06 05:55:20,381][52803] Sum rewards: 84.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon4': '0.128', 'AMMO3': '0.242', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '71.000'} [2024-08-06 05:55:20,549][52650] Updated weights for policy 0, policy_version 64851 (0.0045) [2024-08-06 05:55:20,954][52664] DAMAGECOUNT value on done: 712880.0 [2024-08-06 05:55:20,957][52664] Sum rewards: 70.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.088', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '59.000'} [2024-08-06 05:55:22,054][52659] DAMAGECOUNT value on done: 689112.0 [2024-08-06 05:55:22,054][52659] Sum rewards: 60.632, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.094', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.154', 'AMMO4': '0.227', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.682', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '54.000'} [2024-08-06 05:55:22,281][52660] DAMAGECOUNT value on done: 684310.0 [2024-08-06 05:55:22,282][52660] Sum rewards: 82.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.113', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.121', 'weapon5': '0.160', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '67.500'} [2024-08-06 05:55:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 531292160. Throughput: 0: 4374.9. Samples: 132827630. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:22,794][52567] Avg episode reward: [(0, '73.763')] [2024-08-06 05:55:23,065][52670] Large shaping reward 2.579 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.528, 176.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:55:24,019][52664] DAMAGECOUNT value on done: 711447.0 [2024-08-06 05:55:24,020][52664] Sum rewards: 68.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.996', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.151', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '58.000'} [2024-08-06 05:55:24,661][52659] DAMAGECOUNT value on done: 687214.0 [2024-08-06 05:55:24,664][52659] Sum rewards: 68.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.075', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO3': '0.195', 'weapon2': '0.212', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.426', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '55.000'} [2024-08-06 05:55:25,040][52650] Updated weights for policy 0, policy_version 64861 (0.0012) [2024-08-06 05:55:25,160][52660] DAMAGECOUNT value on done: 680740.0 [2024-08-06 05:55:25,162][52660] Sum rewards: 70.171, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.880', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.520', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.262', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '59.000'} [2024-08-06 05:55:25,691][52665] DAMAGECOUNT value on done: 672675.0 [2024-08-06 05:55:25,692][52665] Sum rewards: 83.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.108', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.086', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.328', 'WEAPON3': '0.900', 'weapon3': '3.288', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '65.000'} [2024-08-06 05:55:27,133][52664] DAMAGECOUNT value on done: 710695.0 [2024-08-06 05:55:27,134][52664] Sum rewards: 77.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.158', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '64.000'} [2024-08-06 05:55:27,511][52659] DAMAGECOUNT value on done: 682131.0 [2024-08-06 05:55:27,514][52659] Sum rewards: 63.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.993', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.130', 'AMMO4': '0.204', 'weapon5': '0.206', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.064', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '54.000'} [2024-08-06 05:55:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 531382272. Throughput: 0: 4381.5. Samples: 132854030. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:27,795][52567] Avg episode reward: [(0, '73.748')] [2024-08-06 05:55:28,065][52660] DAMAGECOUNT value on done: 674551.0 [2024-08-06 05:55:28,066][52660] Sum rewards: 68.519, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.908', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.154', 'weapon5': '0.170', 'AMMO3': '0.248', 'AMMO4': '0.254', 'weapon2': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.126', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:28,323][52665] DAMAGECOUNT value on done: 689311.0 [2024-08-06 05:55:28,323][52665] Sum rewards: 75.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.196', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.131', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '64.000'} [2024-08-06 05:55:29,963][52650] Updated weights for policy 0, policy_version 64871 (0.0035) [2024-08-06 05:55:30,679][52659] DAMAGECOUNT value on done: 688951.0 [2024-08-06 05:55:30,680][52659] Sum rewards: 69.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.640', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.182', 'weapon4': '0.190', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.004', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '58.000'} [2024-08-06 05:55:30,775][52667] DAMAGECOUNT value on done: 687481.0 [2024-08-06 05:55:30,777][52667] Sum rewards: 79.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.584', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '65.000'} [2024-08-06 05:55:31,394][52665] DAMAGECOUNT value on done: 687554.0 [2024-08-06 05:55:31,394][52665] Sum rewards: 82.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.062', 'AMMO3': '0.173', 'weapon5': '0.188', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '65.000'} [2024-08-06 05:55:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 531464192. Throughput: 0: 4376.0. Samples: 132866970. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:32,795][52567] Avg episode reward: [(0, '73.733')] [2024-08-06 05:55:32,934][52794] DAMAGECOUNT value on done: 686562.0 [2024-08-06 05:55:32,934][52794] Sum rewards: 71.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.255', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.020', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.360', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '62.000'} [2024-08-06 05:55:33,165][52667] DAMAGECOUNT value on done: 694247.0 [2024-08-06 05:55:33,166][52667] Sum rewards: 69.411, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.106', 'weapon5': '0.174', 'weapon2': '0.242', 'AMMO3': '0.247', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.194', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:33,751][52659] DAMAGECOUNT value on done: 694539.0 [2024-08-06 05:55:33,751][52659] Sum rewards: 76.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.801', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.049', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.464', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '63.000'} [2024-08-06 05:55:33,958][52665] DAMAGECOUNT value on done: 680445.0 [2024-08-06 05:55:33,958][52665] Sum rewards: 74.813, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.089', 'AMMO5': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.192', 'weapon5': '0.192', 'AMMO3': '0.199', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '61.000'} [2024-08-06 05:55:34,626][52650] Updated weights for policy 0, policy_version 64881 (0.0012) [2024-08-06 05:55:35,737][52667] DAMAGECOUNT value on done: 689282.0 [2024-08-06 05:55:35,740][52667] Sum rewards: 66.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.355', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.174', 'weapon4': '0.188', 'AMMO3': '0.214', 'AMMO4': '0.256', 'weapon2': '0.404', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '55.000'} [2024-08-06 05:55:35,797][52794] DAMAGECOUNT value on done: 693730.0 [2024-08-06 05:55:35,797][52794] Sum rewards: 78.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.499', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon5': '0.216', 'AMMO3': '0.231', 'weapon4': '0.264', 'AMMO4': '0.294', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '65.000'} [2024-08-06 05:55:36,804][52659] DAMAGECOUNT value on done: 681083.0 [2024-08-06 05:55:36,806][52659] Sum rewards: 65.567, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.480', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.066', 'AMMO3': '0.135', 'AMMO4': '0.135', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.706', 'WEAPON3': '0.850', 'weapon3': '2.898', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '51.000'} [2024-08-06 05:55:36,815][52665] DAMAGECOUNT value on done: 668471.0 [2024-08-06 05:55:36,815][52665] Sum rewards: 67.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.943', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.094', 'weapon4': '0.126', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '56.000'} [2024-08-06 05:55:37,795][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.6, 300 sec: 17494.8). Total num frames: 531562496. Throughput: 0: 4378.8. Samples: 132893460. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:37,804][52567] Avg episode reward: [(0, '73.699')] [2024-08-06 05:55:38,655][52794] DAMAGECOUNT value on done: 696007.0 [2024-08-06 05:55:38,656][52794] Sum rewards: 77.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.531', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.212', 'weapon4': '0.234', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '63.000'} [2024-08-06 05:55:38,910][52667] DAMAGECOUNT value on done: 693089.0 [2024-08-06 05:55:38,911][52667] Sum rewards: 73.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.436', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.162', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'weapon3': '3.294', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '62.000'} [2024-08-06 05:55:39,298][52650] Updated weights for policy 0, policy_version 64891 (0.0014) [2024-08-06 05:55:39,545][52665] DAMAGECOUNT value on done: 674643.0 [2024-08-06 05:55:39,545][52665] Sum rewards: 74.883, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.795', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.132', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '64.000'} [2024-08-06 05:55:39,739][52659] DAMAGECOUNT value on done: 693309.0 [2024-08-06 05:55:39,741][52659] Sum rewards: 71.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.285', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 05:55:40,608][52647] DAMAGECOUNT value on done: 728963.0 [2024-08-06 05:55:40,608][52647] Sum rewards: 67.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.923', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.096', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.134', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '58.500'} [2024-08-06 05:55:41,832][52794] DAMAGECOUNT value on done: 682863.0 [2024-08-06 05:55:41,832][52794] Sum rewards: 62.109, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.190', 'AMMO5': '0.022', 'AMMO2': '0.049', 'AMMO3': '0.131', 'AMMO4': '0.245', 'weapon5': '0.256', 'weapon2': '0.326', 'weapon4': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.784', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '50.000'} [2024-08-06 05:55:41,984][52667] DAMAGECOUNT value on done: 692665.0 [2024-08-06 05:55:41,988][52667] Sum rewards: 68.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.662', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.178', 'weapon2': '0.186', 'AMMO3': '0.233', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '58.000'} [2024-08-06 05:55:42,116][52665] DAMAGECOUNT value on done: 680575.0 [2024-08-06 05:55:42,118][52665] Sum rewards: 78.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.438', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.046', 'AMMO3': '0.165', 'AMMO4': '0.184', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '61.500'} [2024-08-06 05:55:42,264][52659] DAMAGECOUNT value on done: 685153.0 [2024-08-06 05:55:42,265][52659] Sum rewards: 71.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.071', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon2': '0.224', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.414', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 531644416. Throughput: 0: 4373.3. Samples: 132919470. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:42,802][52567] Avg episode reward: [(0, '73.297')] [2024-08-06 05:55:43,347][52647] DAMAGECOUNT value on done: 721004.0 [2024-08-06 05:55:43,348][52647] Sum rewards: 77.135, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.048', 'weapon5': '0.124', 'AMMO3': '0.164', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:43,604][52647] Large shaping reward 2.587 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon5', 0.002)] [2024-08-06 05:55:44,029][52650] Updated weights for policy 0, policy_version 64901 (0.0012) [2024-08-06 05:55:44,839][52667] DAMAGECOUNT value on done: 696771.0 [2024-08-06 05:55:44,840][52667] Sum rewards: 67.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.884', 'AMMO5': '0.017', 'AMMO2': '0.073', 'AMMO3': '0.220', 'weapon5': '0.258', 'weapon4': '0.272', 'AMMO4': '0.367', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.626', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '56.000'} [2024-08-06 05:55:44,843][52794] DAMAGECOUNT value on done: 684460.0 [2024-08-06 05:55:44,843][52794] Sum rewards: 73.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.346', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.132', 'AMMO3': '0.192', 'weapon2': '0.212', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.500'} [2024-08-06 05:55:45,037][52665] DAMAGECOUNT value on done: 678127.0 [2024-08-06 05:55:45,037][52665] Sum rewards: 72.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.114', 'AMMO4': '0.143', 'weapon5': '0.146', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '59.000'} [2024-08-06 05:55:45,419][52659] DAMAGECOUNT value on done: 688252.0 [2024-08-06 05:55:45,420][52659] Sum rewards: 77.338, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.994', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.202', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '62.000'} [2024-08-06 05:55:45,971][52647] DAMAGECOUNT value on done: 726302.0 [2024-08-06 05:55:45,971][52647] Sum rewards: 72.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.110', 'weapon2': '0.156', 'AMMO4': '0.182', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:47,396][52665] DAMAGECOUNT value on done: 687060.0 [2024-08-06 05:55:47,397][52665] Sum rewards: 67.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.790', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.102', 'AMMO4': '0.148', 'weapon5': '0.184', 'AMMO3': '0.240', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.124', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '58.000'} [2024-08-06 05:55:47,754][52794] DAMAGECOUNT value on done: 687915.0 [2024-08-06 05:55:47,757][52794] Sum rewards: 78.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.396', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.096', 'weapon4': '0.124', 'AMMO4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '64.000'} [2024-08-06 05:55:47,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 531734528. Throughput: 0: 4373.8. Samples: 132932610. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:47,802][52567] Avg episode reward: [(0, '73.147')] [2024-08-06 05:55:47,808][52667] DAMAGECOUNT value on done: 691321.0 [2024-08-06 05:55:47,809][52667] Sum rewards: 70.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.120', 'weapon2': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon4': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 05:55:48,070][52659] DAMAGECOUNT value on done: 697096.0 [2024-08-06 05:55:48,071][52659] Sum rewards: 69.425, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.176', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '56.000'} [2024-08-06 05:55:48,831][52650] Updated weights for policy 0, policy_version 64911 (0.0024) [2024-08-06 05:55:49,128][52647] DAMAGECOUNT value on done: 726623.0 [2024-08-06 05:55:49,129][52647] Sum rewards: 86.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.136', 'AMMO4': '0.147', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '21.321', 'FRAGCOUNT': '68.000'} [2024-08-06 05:55:49,815][52665] DAMAGECOUNT value on done: 679108.0 [2024-08-06 05:55:49,817][52665] Sum rewards: 74.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.247', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.162', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 05:55:50,638][52794] DAMAGECOUNT value on done: 692090.0 [2024-08-06 05:55:50,640][52794] Sum rewards: 69.476, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.583', 'AMMO5': '0.026', 'AMMO2': '0.066', 'weapon4': '0.216', 'AMMO3': '0.222', 'AMMO4': '0.330', 'weapon5': '0.336', 'weapon2': '0.342', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '62.000'} [2024-08-06 05:55:50,647][52667] DAMAGECOUNT value on done: 689695.0 [2024-08-06 05:55:50,647][52667] Sum rewards: 77.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.745', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '63.000'} [2024-08-06 05:55:50,656][52659] DAMAGECOUNT value on done: 690406.0 [2024-08-06 05:55:50,657][52659] Sum rewards: 72.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.923', 'weapon5': '0.004', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.214', 'weapon2': '0.296', 'WEAPON3': '1.400', 'HITCOUNT': '3.430', 'weapon3': '3.540', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '62.000'} [2024-08-06 05:55:52,084][52647] DAMAGECOUNT value on done: 732830.0 [2024-08-06 05:55:52,085][52647] Sum rewards: 81.480, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '67.000'} [2024-08-06 05:55:52,511][52665] DAMAGECOUNT value on done: 688272.0 [2024-08-06 05:55:52,512][52665] Sum rewards: 72.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.924', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.416', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '61.000'} [2024-08-06 05:55:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 531824640. Throughput: 0: 4373.1. Samples: 132958940. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:52,794][52567] Avg episode reward: [(0, '73.170')] [2024-08-06 05:55:53,196][52659] DAMAGECOUNT value on done: 695411.0 [2024-08-06 05:55:53,196][52659] Sum rewards: 82.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.041', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.392', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.324', 'FRAGCOUNT': '68.500'} [2024-08-06 05:55:53,344][52650] Updated weights for policy 0, policy_version 64921 (0.0013) [2024-08-06 05:55:53,605][52667] DAMAGECOUNT value on done: 694469.0 [2024-08-06 05:55:53,605][52667] Sum rewards: 77.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.114', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.758', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '65.000'} [2024-08-06 05:55:53,882][52794] DAMAGECOUNT value on done: 680848.0 [2024-08-06 05:55:53,882][52794] Sum rewards: 88.325, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'HEALTH': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.098', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '72.000'} [2024-08-06 05:55:55,080][52665] DAMAGECOUNT value on done: 685272.0 [2024-08-06 05:55:55,080][52665] Sum rewards: 70.420, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.307', 'weapon2': '0.588', 'WEAPON3': '1.650', 'weapon3': '2.990', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '62.000'} [2024-08-06 05:55:55,085][52647] DAMAGECOUNT value on done: 729892.0 [2024-08-06 05:55:55,085][52647] Sum rewards: 77.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.582', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.124', 'weapon5': '0.182', 'AMMO3': '0.201', 'AMMO4': '0.209', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '64.000'} [2024-08-06 05:55:56,032][52659] DAMAGECOUNT value on done: 683767.0 [2024-08-06 05:55:56,034][52659] Sum rewards: 88.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.072', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.228', 'WEAPON3': '1.400', 'weapon3': '3.406', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.697', 'FRAGCOUNT': '73.000'} [2024-08-06 05:55:56,595][52667] DAMAGECOUNT value on done: 698038.0 [2024-08-06 05:55:56,596][52667] Sum rewards: 73.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.506', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.174', 'AMMO3': '0.204', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2024-08-06 05:55:56,656][52794] DAMAGECOUNT value on done: 692681.0 [2024-08-06 05:55:56,657][52794] Sum rewards: 79.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.253', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '67.000'} [2024-08-06 05:55:57,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 531898368. Throughput: 0: 4370.9. Samples: 132985250. Policy #0 lag: (min: 0.0, avg: 4.3, max: 7.0) [2024-08-06 05:55:57,795][52567] Avg episode reward: [(0, '73.763')] [2024-08-06 05:55:57,806][52665] DAMAGECOUNT value on done: 684179.0 [2024-08-06 05:55:57,806][52665] Sum rewards: 70.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.419', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.132', 'AMMO3': '0.185', 'AMMO4': '0.230', 'weapon5': '0.268', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '57.000'} [2024-08-06 05:55:57,842][52647] DAMAGECOUNT value on done: 728126.0 [2024-08-06 05:55:57,842][52647] Sum rewards: 73.885, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.260', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '65.000'} [2024-08-06 05:55:58,208][52650] Updated weights for policy 0, policy_version 64931 (0.0029) [2024-08-06 05:55:58,613][52659] DAMAGECOUNT value on done: 694767.0 [2024-08-06 05:55:58,614][52659] Sum rewards: 59.576, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.175', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.096', 'weapon4': '0.124', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '3.148', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '54.000'} [2024-08-06 05:55:59,631][52667] DAMAGECOUNT value on done: 687150.0 [2024-08-06 05:55:59,633][52667] Sum rewards: 82.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.805', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.098', 'weapon4': '0.170', 'AMMO4': '0.243', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '71.000'} [2024-08-06 05:55:59,683][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:55:59,992][52794] DAMAGECOUNT value on done: 682237.0 [2024-08-06 05:55:59,994][52794] Sum rewards: 68.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.043', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.218', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:00,492][52647] DAMAGECOUNT value on done: 711334.0 [2024-08-06 05:56:00,494][52647] Sum rewards: 66.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.026', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.154', 'weapon5': '0.184', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.118', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:00,816][52665] DAMAGECOUNT value on done: 678527.0 [2024-08-06 05:56:00,816][52665] Sum rewards: 71.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.600', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.170', 'AMMO4': '0.194', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '60.000'} [2024-08-06 05:56:01,185][52659] DAMAGECOUNT value on done: 685182.0 [2024-08-06 05:56:01,185][52659] Sum rewards: 73.680, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.093', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.644', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '59.000'} [2024-08-06 05:56:02,443][52667] DAMAGECOUNT value on done: 687860.0 [2024-08-06 05:56:02,444][52667] Sum rewards: 76.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.138', 'AMMO3': '0.190', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:02,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 531988480. Throughput: 0: 4373.1. Samples: 132998340. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:02,795][52567] Avg episode reward: [(0, '73.817')] [2024-08-06 05:56:03,046][52794] DAMAGECOUNT value on done: 681234.0 [2024-08-06 05:56:03,046][52794] Sum rewards: 77.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.660', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.106', 'AMMO4': '0.146', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '65.000'} [2024-08-06 05:56:03,049][52650] Updated weights for policy 0, policy_version 64941 (0.0013) [2024-08-06 05:56:03,178][52647] DAMAGECOUNT value on done: 727805.0 [2024-08-06 05:56:03,186][52647] Sum rewards: 72.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.630', 'AMMO5': '0.030', 'AMMO2': '0.075', 'weapon4': '0.122', 'AMMO3': '0.170', 'weapon5': '0.262', 'AMMO4': '0.374', 'weapon2': '0.472', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '60.000'} [2024-08-06 05:56:03,854][52665] DAMAGECOUNT value on done: 677335.0 [2024-08-06 05:56:03,855][52665] Sum rewards: 65.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.266', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.536', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '53.000'} [2024-08-06 05:56:05,086][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 05:56:05,111][52667] DAMAGECOUNT value on done: 694223.0 [2024-08-06 05:56:05,113][52667] Sum rewards: 78.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.172', 'AMMO3': '0.207', 'weapon4': '0.218', 'weapon2': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:05,115][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:56:06,248][52794] DAMAGECOUNT value on done: 689029.0 [2024-08-06 05:56:06,250][52794] Sum rewards: 76.252, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.054', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.166', 'weapon5': '0.214', 'AMMO4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.450', 'weapon4': '0.472', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.722', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:06,403][52647] DAMAGECOUNT value on done: 725129.0 [2024-08-06 05:56:06,405][52647] Sum rewards: 64.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.098', 'weapon4': '0.114', 'AMMO4': '0.190', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '55.000'} [2024-08-06 05:56:06,492][52665] DAMAGECOUNT value on done: 679474.0 [2024-08-06 05:56:06,492][52665] Sum rewards: 73.887, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.104', 'weapon4': '0.168', 'AMMO4': '0.236', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:07,505][52650] Updated weights for policy 0, policy_version 64951 (0.0017) [2024-08-06 05:56:07,753][52667] DAMAGECOUNT value on done: 683512.0 [2024-08-06 05:56:07,754][52667] Sum rewards: 61.115, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.932', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO3': '0.120', 'AMMO4': '0.133', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.410', 'weapon2': '0.606', 'WEAPON3': '0.800', 'weapon3': '2.518', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '14.106', 'FRAGCOUNT': '46.000'} [2024-08-06 05:56:07,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 532086784. Throughput: 0: 4370.7. Samples: 133024310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:07,794][52567] Avg episode reward: [(0, '73.607')] [2024-08-06 05:56:08,683][52666] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:56:08,970][52663] DAMAGECOUNT value on done: 700648.0 [2024-08-06 05:56:08,970][52663] Sum rewards: 73.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.168', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.055', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.222', 'WEAPON3': '1.200', 'HITCOUNT': '3.300', 'weapon3': '3.492', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:09,037][52794] DAMAGECOUNT value on done: 684790.0 [2024-08-06 05:56:09,038][52794] Sum rewards: 84.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.104', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.124', 'weapon2': '0.184', 'AMMO3': '0.219', 'AMMO4': '0.290', 'weapon5': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.946', 'FRAGCOUNT': '68.000'} [2024-08-06 05:56:09,197][52647] DAMAGECOUNT value on done: 723352.0 [2024-08-06 05:56:09,197][52647] Sum rewards: 79.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.183', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.126', 'weapon5': '0.186', 'AMMO3': '0.199', 'AMMO4': '0.240', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:09,653][52665] DAMAGECOUNT value on done: 679374.0 [2024-08-06 05:56:09,654][52665] Sum rewards: 76.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.066', 'weapon5': '0.092', 'AMMO4': '0.118', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '65.000'} [2024-08-06 05:56:10,272][52667] DAMAGECOUNT value on done: 692691.0 [2024-08-06 05:56:10,275][52667] Sum rewards: 74.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.938', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO4': '0.140', 'AMMO3': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:10,464][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:56:11,689][52663] DAMAGECOUNT value on done: 687800.0 [2024-08-06 05:56:11,691][52663] Sum rewards: 68.186, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'AMMO5': '0.006', 'weapon4': '0.022', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.252', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '59.000'} [2024-08-06 05:56:12,013][52647] DAMAGECOUNT value on done: 715882.0 [2024-08-06 05:56:12,013][52647] Sum rewards: 65.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon2': '0.204', 'weapon5': '0.208', 'AMMO3': '0.215', 'AMMO4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2024-08-06 05:56:12,039][52794] DAMAGECOUNT value on done: 698992.0 [2024-08-06 05:56:12,039][52794] Sum rewards: 75.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.838', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.194', 'AMMO3': '0.231', 'weapon5': '0.232', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '62.000'} [2024-08-06 05:56:12,071][52650] Updated weights for policy 0, policy_version 64961 (0.0012) [2024-08-06 05:56:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 532168704. Throughput: 0: 4363.1. Samples: 133050370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:12,794][52567] Avg episode reward: [(0, '73.682')] [2024-08-06 05:56:12,828][52665] DAMAGECOUNT value on done: 673081.0 [2024-08-06 05:56:12,828][52665] Sum rewards: 72.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.287', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.026', 'weapon4': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '58.500'} [2024-08-06 05:56:13,179][52667] DAMAGECOUNT value on done: 699310.0 [2024-08-06 05:56:13,181][52667] Sum rewards: 80.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.185', 'weapon5': '0.188', 'weapon4': '0.208', 'AMMO4': '0.221', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '67.000'} [2024-08-06 05:56:14,503][52794] DAMAGECOUNT value on done: 681724.0 [2024-08-06 05:56:14,511][52794] Sum rewards: 72.582, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.256', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.210', 'weapon4': '0.224', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:14,594][52647] DAMAGECOUNT value on done: 731913.0 [2024-08-06 05:56:14,595][52647] Sum rewards: 95.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.225', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.434', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '22.230', 'FRAGCOUNT': '78.000'} [2024-08-06 05:56:14,875][52663] DAMAGECOUNT value on done: 682297.0 [2024-08-06 05:56:14,875][52663] Sum rewards: 77.348, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.315', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon2': '0.222', 'AMMO4': '0.233', 'weapon5': '0.244', 'AMMO3': '0.261', 'weapon4': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.902', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '67.000'} [2024-08-06 05:56:14,885][52614] Signal inference workers to stop experience collection... (11800 times) [2024-08-06 05:56:14,887][52614] Signal inference workers to resume experience collection... (11800 times) [2024-08-06 05:56:14,918][52650] InferenceWorker_p0-w0: stopping experience collection (11800 times) [2024-08-06 05:56:14,918][52650] InferenceWorker_p0-w0: resuming experience collection (11800 times) [2024-08-06 05:56:15,681][52665] DAMAGECOUNT value on done: 677834.0 [2024-08-06 05:56:15,682][52665] Sum rewards: 70.599, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.970', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.188', 'AMMO3': '0.239', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.988', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:16,459][52667] DAMAGECOUNT value on done: 696613.0 [2024-08-06 05:56:16,459][52667] Sum rewards: 83.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.027', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.198', 'weapon2': '0.238', 'WEAPON3': '1.100', 'weapon3': '3.476', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '67.000'} [2024-08-06 05:56:16,847][52650] Updated weights for policy 0, policy_version 64971 (0.0013) [2024-08-06 05:56:17,165][52794] DAMAGECOUNT value on done: 694810.0 [2024-08-06 05:56:17,168][52794] Sum rewards: 66.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.978', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.178', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.398', 'WEAPON3': '1.150', 'weapon3': '2.606', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:17,783][52647] DAMAGECOUNT value on done: 718423.0 [2024-08-06 05:56:17,783][52647] Sum rewards: 75.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 532250624. Throughput: 0: 4366.0. Samples: 133063440. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:17,794][52567] Avg episode reward: [(0, '74.047')] [2024-08-06 05:56:18,036][52663] DAMAGECOUNT value on done: 686614.0 [2024-08-06 05:56:18,037][52663] Sum rewards: 76.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.642', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.146', 'AMMO4': '0.148', 'weapon5': '0.182', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:18,258][52665] DAMAGECOUNT value on done: 682267.0 [2024-08-06 05:56:18,260][52665] Sum rewards: 70.174, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.345', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.182', 'weapon5': '0.236', 'AMMO3': '0.280', 'AMMO4': '0.297', 'weapon2': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.928', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:18,283][52669] Large shaping reward 2.522 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:56:19,562][52667] DAMAGECOUNT value on done: 695983.0 [2024-08-06 05:56:19,563][52667] Sum rewards: 81.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.583', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.102', 'weapon4': '0.126', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '69.000'} [2024-08-06 05:56:19,970][52794] DAMAGECOUNT value on done: 689433.0 [2024-08-06 05:56:19,971][52794] Sum rewards: 66.694, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.130', 'AMMO5': '0.023', 'AMMO2': '0.058', 'weapon4': '0.196', 'AMMO3': '0.277', 'AMMO4': '0.290', 'weapon2': '0.446', 'weapon5': '0.470', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.508', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '58.000'} [2024-08-06 05:56:20,335][52647] DAMAGECOUNT value on done: 727679.0 [2024-08-06 05:56:20,340][52647] Sum rewards: 72.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.564', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.070', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.558', 'WEAPON3': '1.700', 'weapon3': '3.064', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:21,167][52663] DAMAGECOUNT value on done: 690064.0 [2024-08-06 05:56:21,168][52663] Sum rewards: 71.958, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.222', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.154', 'AMMO4': '0.177', 'weapon5': '0.254', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '0.900', 'weapon3': '2.804', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:21,359][52650] Updated weights for policy 0, policy_version 64981 (0.0011) [2024-08-06 05:56:22,343][52667] DAMAGECOUNT value on done: 689538.0 [2024-08-06 05:56:22,344][52667] Sum rewards: 77.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.313', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon2': '0.214', 'AMMO4': '0.237', 'weapon5': '0.272', 'weapon4': '0.274', 'AMMO3': '0.275', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.948', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '65.000'} [2024-08-06 05:56:22,772][52794] DAMAGECOUNT value on done: 695274.0 [2024-08-06 05:56:22,773][52794] Sum rewards: 72.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.671', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.118', 'AMMO4': '0.143', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '60.500'} [2024-08-06 05:56:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 532340736. Throughput: 0: 4362.5. Samples: 133089770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:22,794][52567] Avg episode reward: [(0, '73.792')] [2024-08-06 05:56:22,989][52647] DAMAGECOUNT value on done: 729470.0 [2024-08-06 05:56:22,990][52647] Sum rewards: 88.954, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.106', 'AMMO4': '0.162', 'weapon5': '0.168', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.589', 'FRAGCOUNT': '71.000'} [2024-08-06 05:56:23,168][52670] DAMAGECOUNT value on done: 679459.0 [2024-08-06 05:56:23,169][52670] Sum rewards: 70.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.810', 'AMMO5': '0.018', 'AMMO2': '0.055', 'AMMO3': '0.167', 'weapon5': '0.260', 'AMMO4': '0.277', 'weapon4': '0.332', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON4': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.680', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:24,337][52663] DAMAGECOUNT value on done: 697759.0 [2024-08-06 05:56:24,337][52663] Sum rewards: 73.122, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.226', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.122', 'weapon4': '0.134', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.364', 'WEAPON3': '1.000', 'weapon3': '3.220', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:24,443][52666] DAMAGECOUNT value on done: 689832.0 [2024-08-06 05:56:24,443][52666] Sum rewards: 74.546, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.360', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.130', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.278', 'weapon2': '0.494', 'WEAPON3': '0.850', 'weapon3': '2.910', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '58.000'} [2024-08-06 05:56:25,135][52667] DAMAGECOUNT value on done: 698621.0 [2024-08-06 05:56:25,135][52667] Sum rewards: 84.748, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.225', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.118', 'AMMO4': '0.155', 'weapon5': '0.156', 'weapon2': '0.264', 'AMMO3': '0.303', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.140', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '22.533', 'FRAGCOUNT': '72.000'} [2024-08-06 05:56:25,726][52647] DAMAGECOUNT value on done: 712242.0 [2024-08-06 05:56:25,728][52647] Sum rewards: 76.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.130', 'AMMO4': '0.189', 'weapon4': '0.196', 'AMMO3': '0.197', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '62.000'} [2024-08-06 05:56:25,921][52794] DAMAGECOUNT value on done: 699278.0 [2024-08-06 05:56:25,924][52794] Sum rewards: 79.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.520', 'AMMO5': '0.022', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.138', 'weapon4': '0.144', 'AMMO3': '0.209', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '66.000'} [2024-08-06 05:56:25,973][52670] DAMAGECOUNT value on done: 691349.0 [2024-08-06 05:56:25,974][52670] Sum rewards: 79.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.824', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.080', 'AMMO4': '0.135', 'AMMO3': '0.148', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.180', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:26,092][52650] Updated weights for policy 0, policy_version 64991 (0.0011) [2024-08-06 05:56:26,311][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:56:27,243][52666] DAMAGECOUNT value on done: 687479.0 [2024-08-06 05:56:27,243][52666] Sum rewards: 78.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.722', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.114', 'AMMO4': '0.140', 'weapon5': '0.166', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:27,445][52663] DAMAGECOUNT value on done: 685453.0 [2024-08-06 05:56:27,445][52663] Sum rewards: 69.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.732', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.168', 'AMMO4': '0.181', 'AMMO3': '0.215', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '57.500'} [2024-08-06 05:56:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 532430848. Throughput: 0: 4371.5. Samples: 133116190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:27,795][52567] Avg episode reward: [(0, '74.241')] [2024-08-06 05:56:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064994_532430848.pth... [2024-08-06 05:56:27,918][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064483_528244736.pth [2024-08-06 05:56:28,748][52647] DAMAGECOUNT value on done: 722239.0 [2024-08-06 05:56:28,748][52647] Sum rewards: 83.054, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.115', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.080', 'weapon4': '0.130', 'AMMO3': '0.176', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.354', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '67.000'} [2024-08-06 05:56:28,752][52794] DAMAGECOUNT value on done: 689612.0 [2024-08-06 05:56:28,753][52794] Sum rewards: 66.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.076', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon5': '0.114', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.368', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:29,082][52670] DAMAGECOUNT value on done: 678787.0 [2024-08-06 05:56:29,082][52670] Sum rewards: 66.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.720', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '54.000'} [2024-08-06 05:56:30,128][52663] DAMAGECOUNT value on done: 679989.0 [2024-08-06 05:56:30,129][52663] Sum rewards: 81.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.528', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.164', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '2.538', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '68.000'} [2024-08-06 05:56:30,490][52666] DAMAGECOUNT value on done: 689242.0 [2024-08-06 05:56:30,491][52666] Sum rewards: 75.031, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.966', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.092', 'weapon5': '0.162', 'AMMO3': '0.254', 'AMMO4': '0.268', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '66.000'} [2024-08-06 05:56:31,067][52650] Updated weights for policy 0, policy_version 65001 (0.0010) [2024-08-06 05:56:31,896][52658] DAMAGECOUNT value on done: 690967.0 [2024-08-06 05:56:31,897][52658] Sum rewards: 77.999, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.755', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.080', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:31,969][52647] DAMAGECOUNT value on done: 712938.0 [2024-08-06 05:56:31,970][52647] Sum rewards: 67.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.778', 'ARMOR': '0.005', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.124', 'AMMO3': '0.222', 'AMMO4': '0.225', 'weapon5': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '2.746', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '58.000'} [2024-08-06 05:56:32,433][52670] DAMAGECOUNT value on done: 678143.0 [2024-08-06 05:56:32,434][52670] Sum rewards: 78.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.320', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon5': '0.166', 'AMMO4': '0.197', 'weapon2': '0.278', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.234', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '67.000'} [2024-08-06 05:56:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 532520960. Throughput: 0: 4361.6. Samples: 133128880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:32,794][52567] Avg episode reward: [(0, '74.417')] [2024-08-06 05:56:33,548][52663] DAMAGECOUNT value on done: 680071.0 [2024-08-06 05:56:33,549][52663] Sum rewards: 70.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.060', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:33,866][52666] DAMAGECOUNT value on done: 689602.0 [2024-08-06 05:56:33,867][52666] Sum rewards: 68.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.852', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.162', 'weapon5': '0.182', 'weapon4': '0.214', 'AMMO4': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:34,221][52669] DAMAGECOUNT value on done: 691490.0 [2024-08-06 05:56:34,222][52669] Sum rewards: 71.559, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.068', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon4': '0.260', 'AMMO3': '0.261', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.550', 'weapon3': '2.672', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '62.000'} [2024-08-06 05:56:34,438][52658] DAMAGECOUNT value on done: 689609.0 [2024-08-06 05:56:34,439][52658] Sum rewards: 75.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.535', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.142', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '62.000'} [2024-08-06 05:56:34,725][52647] DAMAGECOUNT value on done: 718417.0 [2024-08-06 05:56:34,725][52647] Sum rewards: 65.190, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.010', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.072', 'weapon5': '0.112', 'AMMO4': '0.161', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.700', 'weapon3': '3.006', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:35,502][52650] Updated weights for policy 0, policy_version 65011 (0.0027) [2024-08-06 05:56:35,808][52670] DAMAGECOUNT value on done: 688181.0 [2024-08-06 05:56:35,809][52670] Sum rewards: 75.387, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.700', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.148', 'weapon5': '0.160', 'AMMO3': '0.176', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.292', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:36,420][52663] DAMAGECOUNT value on done: 683660.0 [2024-08-06 05:56:36,422][52663] Sum rewards: 61.296, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.422', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.108', 'weapon4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2024-08-06 05:56:36,931][52669] DAMAGECOUNT value on done: 683140.0 [2024-08-06 05:56:36,932][52669] Sum rewards: 79.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon5': '0.236', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:37,105][52666] DAMAGECOUNT value on done: 682575.0 [2024-08-06 05:56:37,105][52666] Sum rewards: 80.523, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.715', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.174', 'AMMO4': '0.188', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '68.000'} [2024-08-06 05:56:37,447][52658] DAMAGECOUNT value on done: 695741.0 [2024-08-06 05:56:37,448][52658] Sum rewards: 76.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.024', 'AMMO2': '0.050', 'weapon4': '0.164', 'weapon5': '0.184', 'AMMO3': '0.204', 'AMMO4': '0.252', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '62.000'} [2024-08-06 05:56:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.9, 300 sec: 17467.0). Total num frames: 532602880. Throughput: 0: 4361.8. Samples: 133155220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 05:56:37,795][52567] Avg episode reward: [(0, '74.387')] [2024-08-06 05:56:37,964][52671] DAMAGECOUNT value on done: 691666.0 [2024-08-06 05:56:37,965][52671] Sum rewards: 67.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.048', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.020', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.752', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '54.000'} [2024-08-06 05:56:38,683][52670] DAMAGECOUNT value on done: 684051.0 [2024-08-06 05:56:38,685][52670] Sum rewards: 68.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.176', 'weapon5': '0.182', 'AMMO4': '0.201', 'weapon2': '0.234', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.142', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '58.000'} [2024-08-06 05:56:39,114][52663] DAMAGECOUNT value on done: 695196.0 [2024-08-06 05:56:39,115][52663] Sum rewards: 70.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.451', 'AMMO5': '0.024', 'ARMOR': '0.032', 'AMMO2': '0.050', 'AMMO3': '0.200', 'weapon2': '0.216', 'AMMO4': '0.250', 'weapon4': '0.308', 'weapon5': '0.354', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:39,531][52669] DAMAGECOUNT value on done: 694629.0 [2024-08-06 05:56:39,532][52669] Sum rewards: 79.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.450', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '65.000'} [2024-08-06 05:56:39,914][52666] DAMAGECOUNT value on done: 683365.0 [2024-08-06 05:56:39,915][52666] Sum rewards: 75.495, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.284', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.261', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.374', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:40,134][52658] DAMAGECOUNT value on done: 692629.0 [2024-08-06 05:56:40,134][52658] Sum rewards: 70.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.733', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.190', 'AMMO3': '0.211', 'AMMO4': '0.242', 'weapon2': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '58.000'} [2024-08-06 05:56:40,419][52650] Updated weights for policy 0, policy_version 65021 (0.0011) [2024-08-06 05:56:40,976][52671] DAMAGECOUNT value on done: 695513.0 [2024-08-06 05:56:40,977][52671] Sum rewards: 73.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.942', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.178', 'AMMO3': '0.196', 'AMMO4': '0.284', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '60.500'} [2024-08-06 05:56:41,580][52670] DAMAGECOUNT value on done: 676172.0 [2024-08-06 05:56:41,581][52670] Sum rewards: 77.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.328', 'weapon4': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:41,620][52663] DAMAGECOUNT value on done: 680924.0 [2024-08-06 05:56:41,623][52663] Sum rewards: 76.793, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.931', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO4': '0.197', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon4': '0.338', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:42,024][52669] DAMAGECOUNT value on done: 690217.0 [2024-08-06 05:56:42,025][52669] Sum rewards: 70.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.100', 'HITCOUNT': '3.340', 'weapon3': '3.354', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '58.000'} [2024-08-06 05:56:42,625][52666] DAMAGECOUNT value on done: 684083.0 [2024-08-06 05:56:42,626][52666] Sum rewards: 82.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.120', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.261', 'WEAPON3': '1.600', 'weapon3': '3.368', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '71.000'} [2024-08-06 05:56:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 532692992. Throughput: 0: 4351.3. Samples: 133181060. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:56:42,794][52567] Avg episode reward: [(0, '74.623')] [2024-08-06 05:56:43,001][52658] DAMAGECOUNT value on done: 683747.0 [2024-08-06 05:56:43,002][52658] Sum rewards: 77.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.706', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.252', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '62.000'} [2024-08-06 05:56:44,012][52671] DAMAGECOUNT value on done: 692653.0 [2024-08-06 05:56:44,020][52671] Sum rewards: 61.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.227', 'AMMO4': '0.266', 'weapon4': '0.286', 'weapon5': '0.296', 'weapon2': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '51.000'} [2024-08-06 05:56:44,108][52670] DAMAGECOUNT value on done: 683215.0 [2024-08-06 05:56:44,108][52670] Sum rewards: 68.459, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.761', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.068', 'AMMO4': '0.141', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.486', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:44,503][52663] DAMAGECOUNT value on done: 675968.0 [2024-08-06 05:56:44,503][52663] Sum rewards: 66.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.112', 'AMMO4': '0.190', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:44,992][52650] Updated weights for policy 0, policy_version 65031 (0.0020) [2024-08-06 05:56:45,073][52666] DAMAGECOUNT value on done: 677910.0 [2024-08-06 05:56:45,074][52666] Sum rewards: 72.074, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.178', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.048', 'weapon5': '0.080', 'AMMO4': '0.110', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.000', 'weapon3': '3.288', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '59.000'} [2024-08-06 05:56:45,095][52669] DAMAGECOUNT value on done: 691118.0 [2024-08-06 05:56:45,097][52669] Sum rewards: 76.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.178', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '62.000'} [2024-08-06 05:56:45,870][52658] DAMAGECOUNT value on done: 681448.0 [2024-08-06 05:56:45,870][52658] Sum rewards: 68.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.327', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.084', 'weapon5': '0.140', 'AMMO3': '0.201', 'weapon2': '0.258', 'AMMO4': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.284', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:46,866][52670] DAMAGECOUNT value on done: 679094.0 [2024-08-06 05:56:46,867][52670] Sum rewards: 82.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.229', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.554', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '70.000'} [2024-08-06 05:56:47,192][52671] DAMAGECOUNT value on done: 696257.0 [2024-08-06 05:56:47,195][52671] Sum rewards: 74.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.416', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.168', 'weapon2': '0.258', 'AMMO3': '0.278', 'WEAPON3': '1.650', 'weapon3': '3.264', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '65.000'} [2024-08-06 05:56:47,385][52663] DAMAGECOUNT value on done: 683562.0 [2024-08-06 05:56:47,385][52663] Sum rewards: 77.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.168', 'weapon4': '0.174', 'AMMO3': '0.206', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '63.500'} [2024-08-06 05:56:47,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 532774912. Throughput: 0: 4352.6. Samples: 133194210. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:56:47,795][52567] Avg episode reward: [(0, '74.398')] [2024-08-06 05:56:48,006][52666] DAMAGECOUNT value on done: 687861.0 [2024-08-06 05:56:48,009][52666] Sum rewards: 68.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.677', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.176', 'weapon2': '0.210', 'AMMO3': '0.216', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.332', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:48,016][52669] DAMAGECOUNT value on done: 694660.0 [2024-08-06 05:56:48,020][52669] Sum rewards: 86.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.543', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'weapon4': '0.100', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '71.000'} [2024-08-06 05:56:48,682][52658] DAMAGECOUNT value on done: 695520.0 [2024-08-06 05:56:48,682][52658] Sum rewards: 81.025, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.196', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '67.000'} [2024-08-06 05:56:49,722][52650] Updated weights for policy 0, policy_version 65041 (0.0011) [2024-08-06 05:56:50,042][52670] DAMAGECOUNT value on done: 677686.0 [2024-08-06 05:56:50,042][52670] Sum rewards: 73.693, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.062', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.088', 'AMMO4': '0.192', 'weapon5': '0.240', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.600', 'weapon3': '2.914', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:50,395][52671] DAMAGECOUNT value on done: 703294.0 [2024-08-06 05:56:50,395][52671] Sum rewards: 65.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.852', 'AMMO5': '0.022', 'AMMO2': '0.071', 'weapon4': '0.156', 'AMMO3': '0.181', 'weapon5': '0.266', 'AMMO4': '0.356', 'weapon2': '0.382', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '54.000'} [2024-08-06 05:56:50,507][52663] DAMAGECOUNT value on done: 679486.0 [2024-08-06 05:56:50,507][52663] Sum rewards: 72.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.000'} [2024-08-06 05:56:51,134][52669] DAMAGECOUNT value on done: 691329.0 [2024-08-06 05:56:51,134][52669] Sum rewards: 62.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.029', 'AMMO2': '0.073', 'AMMO3': '0.243', 'weapon4': '0.290', 'weapon5': '0.330', 'AMMO4': '0.364', 'weapon2': '0.380', 'WEAPON4': '0.700', 'WEAPON5': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.658', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '53.000'} [2024-08-06 05:56:51,210][52666] DAMAGECOUNT value on done: 680844.0 [2024-08-06 05:56:51,211][52666] Sum rewards: 73.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.126', 'AMMO4': '0.129', 'weapon2': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.360', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:51,588][52658] DAMAGECOUNT value on done: 687155.0 [2024-08-06 05:56:51,588][52658] Sum rewards: 87.399, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.082', 'HEALTH': '0.119', 'AMMO4': '0.121', 'weapon5': '0.166', 'AMMO3': '0.169', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.000', 'weapon3': '3.292', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '69.000'} [2024-08-06 05:56:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 532865024. Throughput: 0: 4355.1. Samples: 133220290. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:56:52,794][52567] Avg episode reward: [(0, '73.983')] [2024-08-06 05:56:52,911][52670] DAMAGECOUNT value on done: 687890.0 [2024-08-06 05:56:52,911][52670] Sum rewards: 64.761, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.718', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.122', 'AMMO4': '0.145', 'weapon2': '0.202', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.368', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:53,178][52671] DAMAGECOUNT value on done: 694444.0 [2024-08-06 05:56:53,178][52671] Sum rewards: 71.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.111', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.057', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.720', 'WEAPON3': '1.000', 'weapon3': '2.984', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '57.000'} [2024-08-06 05:56:53,562][52663] DAMAGECOUNT value on done: 694336.0 [2024-08-06 05:56:53,562][52663] Sum rewards: 74.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.822', 'AMMO5': '0.004', 'weapon5': '0.016', 'weapon4': '0.024', 'AMMO2': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.222', 'weapon2': '0.778', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:54,001][52669] DAMAGECOUNT value on done: 693061.0 [2024-08-06 05:56:54,002][52669] Sum rewards: 76.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.088', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.106', 'weapon5': '0.206', 'AMMO3': '0.213', 'AMMO4': '0.214', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '63.000'} [2024-08-06 05:56:54,070][52658] DAMAGECOUNT value on done: 706048.0 [2024-08-06 05:56:54,072][52658] Sum rewards: 82.126, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.305', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon4': '0.194', 'weapon5': '0.210', 'weapon2': '0.290', 'AMMO3': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.958', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '21.351', 'FRAGCOUNT': '71.000'} [2024-08-06 05:56:54,088][52666] DAMAGECOUNT value on done: 688437.0 [2024-08-06 05:56:54,089][52666] Sum rewards: 80.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.141', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.082', 'AMMO4': '0.092', 'weapon5': '0.096', 'AMMO3': '0.168', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '3.440', 'weapon3': '3.462', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '65.000'} [2024-08-06 05:56:54,551][52650] Updated weights for policy 0, policy_version 65051 (0.0014) [2024-08-06 05:56:55,884][52795] DAMAGECOUNT value on done: 641281.0 [2024-08-06 05:56:55,884][52795] Sum rewards: 79.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.181', 'AMMO4': '0.206', 'weapon5': '0.240', 'weapon2': '0.246', 'weapon4': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:56,042][52670] DAMAGECOUNT value on done: 673608.0 [2024-08-06 05:56:56,043][52670] Sum rewards: 75.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.118', 'AMMO4': '0.176', 'weapon5': '0.192', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:56,190][52663] DAMAGECOUNT value on done: 687632.0 [2024-08-06 05:56:56,191][52663] Sum rewards: 75.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.839', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.174', 'weapon4': '0.206', 'AMMO3': '0.256', 'weapon2': '0.260', 'AMMO4': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.064', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '64.000'} [2024-08-06 05:56:56,222][52671] DAMAGECOUNT value on done: 697860.0 [2024-08-06 05:56:56,222][52671] Sum rewards: 70.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.168', 'weapon5': '0.172', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '2.908', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:56,539][52669] DAMAGECOUNT value on done: 698509.0 [2024-08-06 05:56:56,541][52669] Sum rewards: 63.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.082', 'AMMO4': '0.116', 'weapon2': '0.164', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.334', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '51.000'} [2024-08-06 05:56:57,090][52658] DAMAGECOUNT value on done: 689249.0 [2024-08-06 05:56:57,091][52658] Sum rewards: 60.006, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.132', 'AMMO4': '0.152', 'AMMO3': '0.203', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.004', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '49.000'} [2024-08-06 05:56:57,338][52666] DAMAGECOUNT value on done: 676458.0 [2024-08-06 05:56:57,338][52666] Sum rewards: 75.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.568', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.005', 'weapon4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.500'} [2024-08-06 05:56:57,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 532946944. Throughput: 0: 4360.4. Samples: 133246590. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:56:57,794][52567] Avg episode reward: [(0, '74.119')] [2024-08-06 05:56:58,892][52650] Updated weights for policy 0, policy_version 65061 (0.0013) [2024-08-06 05:56:59,110][52670] DAMAGECOUNT value on done: 684020.0 [2024-08-06 05:56:59,110][52670] Sum rewards: 79.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.975', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.162', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.292', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '65.000'} [2024-08-06 05:56:59,131][52795] DAMAGECOUNT value on done: 628301.0 [2024-08-06 05:56:59,132][52795] Sum rewards: 65.611, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.214', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.078', 'weapon5': '0.192', 'weapon2': '0.256', 'AMMO4': '0.273', 'AMMO3': '0.277', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '56.000'} [2024-08-06 05:56:59,151][52663] DAMAGECOUNT value on done: 691590.0 [2024-08-06 05:56:59,151][52663] Sum rewards: 79.498, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.570', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.084', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.241', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '67.000'} [2024-08-06 05:56:59,206][52671] DAMAGECOUNT value on done: 695383.0 [2024-08-06 05:56:59,207][52671] Sum rewards: 75.026, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.635', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.076', 'AMMO4': '0.158', 'weapon5': '0.166', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:59,467][52820] DAMAGECOUNT value on done: 638542.0 [2024-08-06 05:56:59,469][52820] Sum rewards: 85.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.758', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.148', 'weapon2': '0.192', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.448', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '69.000'} [2024-08-06 05:56:59,594][52658] DAMAGECOUNT value on done: 701910.0 [2024-08-06 05:56:59,596][52658] Sum rewards: 69.690, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.362', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.076', 'weapon5': '0.120', 'weapon2': '0.206', 'AMMO4': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.354', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.000'} [2024-08-06 05:56:59,621][52669] DAMAGECOUNT value on done: 693796.0 [2024-08-06 05:56:59,622][52669] Sum rewards: 90.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.236', 'WEAPON3': '1.500', 'weapon3': '3.472', 'HITCOUNT': '4.420', 'DAMAGECOUNT': '21.543', 'FRAGCOUNT': '75.000'} [2024-08-06 05:57:00,402][52666] DAMAGECOUNT value on done: 690454.0 [2024-08-06 05:57:00,402][52666] Sum rewards: 88.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.141', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.153', 'weapon5': '0.172', 'AMMO3': '0.195', 'weapon2': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.985', 'FRAGCOUNT': '71.000'} [2024-08-06 05:57:01,917][52663] DAMAGECOUNT value on done: 691066.0 [2024-08-06 05:57:01,918][52663] Sum rewards: 84.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.332', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.408', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:02,077][52670] DAMAGECOUNT value on done: 689355.0 [2024-08-06 05:57:02,078][52670] Sum rewards: 76.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.186', 'AMMO3': '0.217', 'weapon5': '0.256', 'AMMO4': '0.321', 'weapon2': '0.426', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:02,117][52658] DAMAGECOUNT value on done: 688342.0 [2024-08-06 05:57:02,120][52658] Sum rewards: 72.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.016', 'AMMO2': '0.058', 'AMMO3': '0.182', 'weapon2': '0.220', 'AMMO4': '0.292', 'weapon5': '0.302', 'weapon4': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.800', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '59.000'} [2024-08-06 05:57:02,229][52811] DAMAGECOUNT value on done: 657854.0 [2024-08-06 05:57:02,229][52811] Sum rewards: 69.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.888', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon4': '0.200', 'weapon5': '0.226', 'AMMO3': '0.253', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.978', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:02,291][52795] DAMAGECOUNT value on done: 629020.0 [2024-08-06 05:57:02,291][52795] Sum rewards: 68.059, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.858', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon4': '0.120', 'weapon5': '0.236', 'AMMO3': '0.241', 'AMMO4': '0.302', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:02,358][52671] DAMAGECOUNT value on done: 685133.0 [2024-08-06 05:57:02,358][52671] Sum rewards: 62.400, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.866', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.200', 'weapon5': '0.240', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '2.570', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '52.000'} [2024-08-06 05:57:02,399][52669] DAMAGECOUNT value on done: 694324.0 [2024-08-06 05:57:02,400][52669] Sum rewards: 87.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.412', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '21.951', 'FRAGCOUNT': '70.000'} [2024-08-06 05:57:02,627][52820] DAMAGECOUNT value on done: 638756.0 [2024-08-06 05:57:02,628][52820] Sum rewards: 87.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.102', 'AMMO4': '0.190', 'weapon5': '0.196', 'AMMO3': '0.212', 'weapon2': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.171', 'FRAGCOUNT': '71.000'} [2024-08-06 05:57:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 533037056. Throughput: 0: 4360.9. Samples: 133259680. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:57:02,794][52567] Avg episode reward: [(0, '74.604')] [2024-08-06 05:57:03,341][52666] DAMAGECOUNT value on done: 683438.0 [2024-08-06 05:57:03,344][52666] Sum rewards: 71.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.905', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.004', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '59.000'} [2024-08-06 05:57:04,074][52650] Updated weights for policy 0, policy_version 65071 (0.0021) [2024-08-06 05:57:04,163][52668] DAMAGECOUNT value on done: 687978.0 [2024-08-06 05:57:04,166][52668] Sum rewards: 72.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.120', 'AMMO4': '0.195', 'AMMO3': '0.211', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '61.500'} [2024-08-06 05:57:04,621][52663] DAMAGECOUNT value on done: 682650.0 [2024-08-06 05:57:04,621][52663] Sum rewards: 74.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.857', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.140', 'AMMO4': '0.205', 'AMMO3': '0.236', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.768', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:05,136][52658] DAMAGECOUNT value on done: 694312.0 [2024-08-06 05:57:05,137][52658] Sum rewards: 77.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon2': '0.146', 'AMMO3': '0.193', 'weapon4': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:05,192][52669] DAMAGECOUNT value on done: 699575.0 [2024-08-06 05:57:05,193][52669] Sum rewards: 75.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.168', 'weapon5': '0.172', 'weapon2': '0.218', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:05,213][52670] DAMAGECOUNT value on done: 685960.0 [2024-08-06 05:57:05,214][52670] Sum rewards: 67.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.465', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon4': '0.092', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:05,275][52811] DAMAGECOUNT value on done: 636840.0 [2024-08-06 05:57:05,278][52811] Sum rewards: 63.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.084', 'AMMO3': '0.173', 'AMMO4': '0.188', 'weapon5': '0.198', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '52.500'} [2024-08-06 05:57:05,302][52671] DAMAGECOUNT value on done: 693834.0 [2024-08-06 05:57:05,303][52671] Sum rewards: 71.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO4': '0.141', 'weapon5': '0.152', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:05,438][52795] DAMAGECOUNT value on done: 638784.0 [2024-08-06 05:57:05,439][52795] Sum rewards: 88.172, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.183', 'weapon2': '0.674', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '72.000'} [2024-08-06 05:57:05,567][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:57:05,791][52820] DAMAGECOUNT value on done: 639880.0 [2024-08-06 05:57:05,792][52820] Sum rewards: 67.941, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.725', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon4': '0.122', 'weapon2': '0.238', 'AMMO3': '0.276', 'AMMO4': '0.347', 'weapon5': '0.356', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.896', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:06,535][52666] DAMAGECOUNT value on done: 687134.0 [2024-08-06 05:57:06,536][52666] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '59.000'} [2024-08-06 05:57:07,108][52668] DAMAGECOUNT value on done: 694038.0 [2024-08-06 05:57:07,116][52668] Sum rewards: 83.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.084', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.082', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '69.000'} [2024-08-06 05:57:07,752][52669] DAMAGECOUNT value on done: 683750.0 [2024-08-06 05:57:07,755][52669] Sum rewards: 68.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.242', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon2': '0.216', 'AMMO4': '0.229', 'AMMO3': '0.233', 'weapon5': '0.270', 'weapon4': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:07,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 533127168. Throughput: 0: 4352.6. Samples: 133285640. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:57:07,795][52567] Avg episode reward: [(0, '74.569')] [2024-08-06 05:57:07,864][52658] DAMAGECOUNT value on done: 685192.0 [2024-08-06 05:57:07,865][52658] Sum rewards: 63.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.919', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'WEAPON7': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.284', 'weapon7': '0.314', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:08,303][52650] Updated weights for policy 0, policy_version 65081 (0.0037) [2024-08-06 05:57:08,410][52671] DAMAGECOUNT value on done: 695924.0 [2024-08-06 05:57:08,410][52671] Sum rewards: 62.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'AMMO2': '0.002', 'AMMO5': '0.004', 'AMMO4': '0.011', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.392', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.352', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:08,420][52670] DAMAGECOUNT value on done: 667410.0 [2024-08-06 05:57:08,421][52670] Sum rewards: 67.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '56.000'} [2024-08-06 05:57:08,427][52811] DAMAGECOUNT value on done: 638092.0 [2024-08-06 05:57:08,429][52811] Sum rewards: 71.029, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.821', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon5': '0.114', 'weapon2': '0.212', 'AMMO3': '0.250', 'AMMO4': '0.299', 'weapon4': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.966', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:08,635][52795] DAMAGECOUNT value on done: 631158.0 [2024-08-06 05:57:08,635][52795] Sum rewards: 80.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.698', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.168', 'AMMO4': '0.170', 'AMMO3': '0.231', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:08,964][52820] DAMAGECOUNT value on done: 631457.0 [2024-08-06 05:57:08,966][52820] Sum rewards: 67.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.607', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon4': '0.142', 'AMMO3': '0.201', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:09,594][52666] DAMAGECOUNT value on done: 678079.0 [2024-08-06 05:57:09,597][52666] Sum rewards: 75.517, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:10,236][52668] DAMAGECOUNT value on done: 694974.0 [2024-08-06 05:57:10,237][52668] Sum rewards: 74.717, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.047', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.250', 'weapon2': '0.272', 'AMMO4': '0.277', 'AMMO3': '0.304', 'weapon4': '0.406', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.676', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:10,786][52671] DAMAGECOUNT value on done: 692988.0 [2024-08-06 05:57:10,786][52671] Sum rewards: 71.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.766', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.120', 'weapon2': '0.172', 'AMMO3': '0.189', 'AMMO4': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.402', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:11,071][52658] DAMAGECOUNT value on done: 694368.0 [2024-08-06 05:57:11,071][52658] Sum rewards: 79.044, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.031', 'HEALTH': '0.122', 'weapon4': '0.128', 'weapon5': '0.144', 'AMMO4': '0.157', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:11,114][52669] DAMAGECOUNT value on done: 689349.0 [2024-08-06 05:57:11,115][52669] Sum rewards: 74.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.679', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.082', 'weapon4': '0.112', 'AMMO4': '0.152', 'weapon2': '0.216', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:11,413][52670] DAMAGECOUNT value on done: 680093.0 [2024-08-06 05:57:11,413][52670] Sum rewards: 58.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.745', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.148', 'weapon5': '0.168', 'AMMO4': '0.181', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.012', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '49.000'} [2024-08-06 05:57:11,622][52811] DAMAGECOUNT value on done: 639171.0 [2024-08-06 05:57:11,624][52811] Sum rewards: 80.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.463', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon2': '0.170', 'weapon4': '0.174', 'AMMO3': '0.176', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:11,869][52795] DAMAGECOUNT value on done: 641787.0 [2024-08-06 05:57:11,870][52795] Sum rewards: 73.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.982', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.116', 'weapon4': '0.168', 'AMMO3': '0.172', 'AMMO4': '0.178', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:12,223][52820] DAMAGECOUNT value on done: 643340.0 [2024-08-06 05:57:12,233][52820] Sum rewards: 93.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.055', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.156', 'AMMO4': '0.179', 'AMMO3': '0.219', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '23.091', 'FRAGCOUNT': '75.000'} [2024-08-06 05:57:12,534][52666] DAMAGECOUNT value on done: 682270.0 [2024-08-06 05:57:12,534][52666] Sum rewards: 56.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.126', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.044', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '49.000'} [2024-08-06 05:57:12,793][52668] DAMAGECOUNT value on done: 694179.0 [2024-08-06 05:57:12,793][52668] Sum rewards: 65.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.086', 'weapon4': '0.134', 'AMMO3': '0.173', 'AMMO4': '0.203', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.272', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '55.000'} [2024-08-06 05:57:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 533217280. Throughput: 0: 4348.2. Samples: 133311860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:57:12,794][52567] Avg episode reward: [(0, '73.765')] [2024-08-06 05:57:13,079][52650] Updated weights for policy 0, policy_version 65091 (0.0013) [2024-08-06 05:57:13,439][52658] DAMAGECOUNT value on done: 680528.0 [2024-08-06 05:57:13,440][52658] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO2': '0.011', 'AMMO5': '0.020', 'weapon4': '0.036', 'AMMO4': '0.057', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.700', 'weapon3': '3.254', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:13,952][52671] DAMAGECOUNT value on done: 699097.0 [2024-08-06 05:57:13,953][52671] Sum rewards: 55.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.156', 'AMMO3': '0.193', 'AMMO4': '0.225', 'weapon2': '0.270', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.630', 'weapon3': '2.916', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '46.000'} [2024-08-06 05:57:14,063][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:57:14,088][52669] DAMAGECOUNT value on done: 690565.0 [2024-08-06 05:57:14,088][52669] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.525', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.106', 'AMMO3': '0.158', 'AMMO4': '0.264', 'weapon5': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.720', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '53.500'} [2024-08-06 05:57:14,610][52670] DAMAGECOUNT value on done: 688375.0 [2024-08-06 05:57:14,611][52670] Sum rewards: 64.624, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.254', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.238', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.536', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:14,632][52811] DAMAGECOUNT value on done: 648916.0 [2024-08-06 05:57:14,634][52811] Sum rewards: 66.286, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.865', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.058', 'weapon4': '0.058', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.182', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:15,021][52795] DAMAGECOUNT value on done: 644926.0 [2024-08-06 05:57:15,024][52795] Sum rewards: 68.725, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:15,355][52668] DAMAGECOUNT value on done: 680346.0 [2024-08-06 05:57:15,355][52668] Sum rewards: 74.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.056', 'weapon4': '0.070', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:15,369][52820] DAMAGECOUNT value on done: 629804.0 [2024-08-06 05:57:15,369][52820] Sum rewards: 66.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:15,703][52666] DAMAGECOUNT value on done: 694042.0 [2024-08-06 05:57:15,704][52666] Sum rewards: 71.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.251', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:16,218][52658] DAMAGECOUNT value on done: 694732.0 [2024-08-06 05:57:16,220][52658] Sum rewards: 77.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.586', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.166', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.180', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:17,050][52671] DAMAGECOUNT value on done: 695242.0 [2024-08-06 05:57:17,052][52671] Sum rewards: 76.037, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.045', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.116', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.750', 'weapon3': '3.322', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:17,253][52669] DAMAGECOUNT value on done: 712688.0 [2024-08-06 05:57:17,255][52669] Sum rewards: 77.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:17,404][52670] DAMAGECOUNT value on done: 682800.0 [2024-08-06 05:57:17,405][52670] Sum rewards: 75.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.242', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.138', 'AMMO4': '0.174', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:17,789][52811] DAMAGECOUNT value on done: 653760.0 [2024-08-06 05:57:17,791][52811] Sum rewards: 68.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.914', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.208', 'weapon2': '0.234', 'AMMO3': '0.242', 'weapon4': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.940', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:17,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 533299200. Throughput: 0: 4360.7. Samples: 133325110. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 05:57:17,794][52567] Avg episode reward: [(0, '73.486')] [2024-08-06 05:57:18,025][52668] DAMAGECOUNT value on done: 696883.0 [2024-08-06 05:57:18,025][52668] Sum rewards: 74.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.112', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.238', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:18,158][52795] DAMAGECOUNT value on done: 637254.0 [2024-08-06 05:57:18,162][52795] Sum rewards: 69.757, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.889', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.158', 'weapon5': '0.184', 'AMMO4': '0.293', 'weapon4': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.656', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:18,179][52650] Updated weights for policy 0, policy_version 65101 (0.0010) [2024-08-06 05:57:18,401][52820] DAMAGECOUNT value on done: 639277.0 [2024-08-06 05:57:18,401][52820] Sum rewards: 65.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.146', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '55.000'} [2024-08-06 05:57:18,546][52666] DAMAGECOUNT value on done: 674857.0 [2024-08-06 05:57:18,547][52666] Sum rewards: 76.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.637', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.132', 'AMMO3': '0.157', 'AMMO4': '0.172', 'weapon4': '0.188', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.242', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:19,222][52658] DAMAGECOUNT value on done: 686502.0 [2024-08-06 05:57:19,223][52658] Sum rewards: 81.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.088', 'weapon5': '0.128', 'AMMO4': '0.133', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:19,652][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:57:19,723][52671] DAMAGECOUNT value on done: 680899.0 [2024-08-06 05:57:19,725][52671] Sum rewards: 77.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.596', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.028', 'AMMO4': '0.121', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '63.500'} [2024-08-06 05:57:20,261][52670] DAMAGECOUNT value on done: 687939.0 [2024-08-06 05:57:20,261][52670] Sum rewards: 77.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.528', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.074', 'AMMO4': '0.180', 'AMMO3': '0.230', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '65.500'} [2024-08-06 05:57:20,646][52669] DAMAGECOUNT value on done: 699116.0 [2024-08-06 05:57:20,647][52669] Sum rewards: 84.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.102', 'AMMO4': '0.117', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.100', 'weapon3': '3.252', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:20,739][52668] DAMAGECOUNT value on done: 696346.0 [2024-08-06 05:57:20,741][52668] Sum rewards: 80.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.807', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon4': '0.176', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:21,172][52811] DAMAGECOUNT value on done: 649209.0 [2024-08-06 05:57:21,173][52811] Sum rewards: 66.868, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.335', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO4': '0.179', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON3': '1.750', 'HITCOUNT': '3.270', 'weapon3': '3.318', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '58.500'} [2024-08-06 05:57:21,293][52647] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:57:21,337][52795] DAMAGECOUNT value on done: 634727.0 [2024-08-06 05:57:21,339][52795] Sum rewards: 80.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.195', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.172', 'AMMO4': '0.191', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '65.000'} [2024-08-06 05:57:21,596][52820] DAMAGECOUNT value on done: 641460.0 [2024-08-06 05:57:21,597][52820] Sum rewards: 61.467, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.710', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.118', 'weapon2': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.254', 'AMMO3': '0.278', 'WEAPON3': '1.700', 'weapon3': '3.244', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '55.000'} [2024-08-06 05:57:21,606][52666] DAMAGECOUNT value on done: 682590.0 [2024-08-06 05:57:21,608][52666] Sum rewards: 68.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.652', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.115', 'weapon5': '0.182', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.202', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.500'} [2024-08-06 05:57:21,859][52658] DAMAGECOUNT value on done: 690897.0 [2024-08-06 05:57:21,860][52658] Sum rewards: 85.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.177', 'weapon5': '0.178', 'AMMO4': '0.240', 'weapon4': '0.270', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.576', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:22,310][52650] Updated weights for policy 0, policy_version 65111 (0.0024) [2024-08-06 05:57:22,770][52671] DAMAGECOUNT value on done: 700193.0 [2024-08-06 05:57:22,773][52671] Sum rewards: 74.532, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon4': '0.294', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.800', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 533389312. Throughput: 0: 4363.8. Samples: 133351590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:22,795][52567] Avg episode reward: [(0, '73.675')] [2024-08-06 05:57:23,167][52668] DAMAGECOUNT value on done: 687580.0 [2024-08-06 05:57:23,169][52668] Sum rewards: 71.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.110', 'weapon4': '0.174', 'AMMO4': '0.185', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:23,797][52669] DAMAGECOUNT value on done: 696811.0 [2024-08-06 05:57:23,797][52669] Sum rewards: 80.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.405', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:24,113][52662] DAMAGECOUNT value on done: 694943.0 [2024-08-06 05:57:24,113][52662] Sum rewards: 64.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.164', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'weapon4': '0.376', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:24,198][52811] DAMAGECOUNT value on done: 639923.0 [2024-08-06 05:57:24,199][52811] Sum rewards: 70.496, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.918', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.136', 'AMMO3': '0.163', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.368', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '56.000'} [2024-08-06 05:57:24,526][52795] DAMAGECOUNT value on done: 641740.0 [2024-08-06 05:57:24,528][52795] Sum rewards: 62.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.432', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.114', 'weapon4': '0.126', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:24,761][52820] DAMAGECOUNT value on done: 638645.0 [2024-08-06 05:57:24,765][52820] Sum rewards: 75.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.302', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.070', 'weapon2': '0.162', 'weapon5': '0.196', 'AMMO4': '0.247', 'AMMO3': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:24,798][52658] DAMAGECOUNT value on done: 691927.0 [2024-08-06 05:57:24,799][52658] Sum rewards: 65.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.226', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.120', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.178', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:25,452][52671] DAMAGECOUNT value on done: 698383.0 [2024-08-06 05:57:25,454][52671] Sum rewards: 70.700, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.395', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '3.320', 'weapon3': '3.502', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:26,151][52668] DAMAGECOUNT value on done: 688354.0 [2024-08-06 05:57:26,152][52668] Sum rewards: 74.208, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.600', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.291', 'weapon2': '0.440', 'WEAPON3': '1.800', 'weapon3': '3.176', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:26,605][52669] DAMAGECOUNT value on done: 696327.0 [2024-08-06 05:57:26,605][52669] Sum rewards: 74.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.130', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO3': '0.190', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:26,678][52662] DAMAGECOUNT value on done: 696644.0 [2024-08-06 05:57:26,681][52662] Sum rewards: 79.651, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.983', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.162', 'weapon2': '0.236', 'weapon4': '0.246', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.850', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:26,936][52650] Updated weights for policy 0, policy_version 65121 (0.0012) [2024-08-06 05:57:27,407][52811] DAMAGECOUNT value on done: 651590.0 [2024-08-06 05:57:27,408][52811] Sum rewards: 79.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.116', 'AMMO4': '0.117', 'weapon4': '0.134', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '65.000'} [2024-08-06 05:57:27,749][52795] DAMAGECOUNT value on done: 635620.0 [2024-08-06 05:57:27,749][52795] Sum rewards: 51.531, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.954', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.166', 'weapon2': '0.214', 'AMMO4': '0.221', 'weapon5': '0.270', 'AMMO3': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.900', 'HITCOUNT': '2.660', 'weapon3': '3.026', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '49.000'} [2024-08-06 05:57:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 533479424. Throughput: 0: 4375.8. Samples: 133377970. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:27,795][52567] Avg episode reward: [(0, '73.235')] [2024-08-06 05:57:28,049][52820] DAMAGECOUNT value on done: 644783.0 [2024-08-06 05:57:28,049][52820] Sum rewards: 79.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.969', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:28,113][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:57:28,188][52671] DAMAGECOUNT value on done: 697615.0 [2024-08-06 05:57:28,190][52671] Sum rewards: 59.330, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.290', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.346', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '53.000'} [2024-08-06 05:57:29,082][52668] DAMAGECOUNT value on done: 696104.0 [2024-08-06 05:57:29,083][52668] Sum rewards: 74.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:29,313][52669] DAMAGECOUNT value on done: 701688.0 [2024-08-06 05:57:29,314][52669] Sum rewards: 68.400, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.155', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '56.000'} [2024-08-06 05:57:29,748][52662] DAMAGECOUNT value on done: 702311.0 [2024-08-06 05:57:29,748][52662] Sum rewards: 65.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.211', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '53.000'} [2024-08-06 05:57:30,504][52811] DAMAGECOUNT value on done: 646382.0 [2024-08-06 05:57:30,506][52811] Sum rewards: 80.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.090', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:30,906][52795] DAMAGECOUNT value on done: 633499.0 [2024-08-06 05:57:30,909][52795] Sum rewards: 71.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.316', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.124', 'weapon4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.188', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:30,960][52671] DAMAGECOUNT value on done: 697206.0 [2024-08-06 05:57:30,960][52671] Sum rewards: 65.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.337', 'AMMO5': '0.025', 'AMMO2': '0.056', 'AMMO3': '0.178', 'weapon2': '0.270', 'AMMO4': '0.278', 'weapon5': '0.344', 'weapon4': '0.418', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.700', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '52.000'} [2024-08-06 05:57:31,172][52820] DAMAGECOUNT value on done: 633522.0 [2024-08-06 05:57:31,172][52820] Sum rewards: 68.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.246', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.310', 'weapon4': '0.394', 'WEAPON3': '1.550', 'weapon3': '2.956', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:31,208][52649] DAMAGECOUNT value on done: 668491.0 [2024-08-06 05:57:31,208][52649] Sum rewards: 77.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.046', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.242', 'AMMO3': '0.250', 'weapon4': '0.278', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.736', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '65.000'} [2024-08-06 05:57:31,977][52650] Updated weights for policy 0, policy_version 65131 (0.0018) [2024-08-06 05:57:32,196][52668] DAMAGECOUNT value on done: 693075.0 [2024-08-06 05:57:32,198][52668] Sum rewards: 76.832, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.512', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.131', 'weapon4': '0.132', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '0.950', 'HITCOUNT': '3.180', 'weapon3': '3.196', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:32,575][52662] DAMAGECOUNT value on done: 686395.0 [2024-08-06 05:57:32,576][52662] Sum rewards: 67.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.136', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.189', 'weapon4': '0.210', 'AMMO4': '0.272', 'weapon5': '0.296', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '56.000'} [2024-08-06 05:57:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 533561344. Throughput: 0: 4374.0. Samples: 133391040. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:32,795][52567] Avg episode reward: [(0, '72.910')] [2024-08-06 05:57:33,598][52811] DAMAGECOUNT value on done: 649201.0 [2024-08-06 05:57:33,599][52811] Sum rewards: 73.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.642', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.068', 'weapon5': '0.158', 'weapon2': '0.210', 'AMMO4': '0.247', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:33,626][52649] DAMAGECOUNT value on done: 662409.0 [2024-08-06 05:57:33,626][52649] Sum rewards: 86.500, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.025', 'AMMO2': '0.069', 'AMMO3': '0.184', 'weapon4': '0.234', 'AMMO4': '0.346', 'weapon2': '0.360', 'weapon5': '0.402', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.724', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '70.500'} [2024-08-06 05:57:34,037][52795] DAMAGECOUNT value on done: 632190.0 [2024-08-06 05:57:34,039][52795] Sum rewards: 82.540, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.124', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.082', 'weapon5': '0.098', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '70.000'} [2024-08-06 05:57:34,093][52671] DAMAGECOUNT value on done: 691973.0 [2024-08-06 05:57:34,094][52671] Sum rewards: 65.125, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.474', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.170', 'weapon5': '0.184', 'weapon2': '0.212', 'weapon4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '52.000'} [2024-08-06 05:57:34,138][52820] DAMAGECOUNT value on done: 640393.0 [2024-08-06 05:57:34,138][52820] Sum rewards: 62.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.424', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.052', 'weapon4': '0.078', 'AMMO3': '0.189', 'AMMO4': '0.261', 'weapon5': '0.280', 'WEAPON4': '0.500', 'weapon2': '0.544', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.710', 'weapon3': '2.860', 'DAMAGECOUNT': '14.601', 'FRAGCOUNT': '51.000'} [2024-08-06 05:57:35,309][52668] DAMAGECOUNT value on done: 683951.0 [2024-08-06 05:57:35,310][52668] Sum rewards: 82.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.048', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.141', 'weapon4': '0.188', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:35,374][52662] DAMAGECOUNT value on done: 704560.0 [2024-08-06 05:57:35,375][52662] Sum rewards: 66.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.817', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.106', 'AMMO4': '0.119', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '55.000'} [2024-08-06 05:57:36,213][52650] Updated weights for policy 0, policy_version 65141 (0.0016) [2024-08-06 05:57:36,481][52649] DAMAGECOUNT value on done: 681764.0 [2024-08-06 05:57:36,482][52649] Sum rewards: 73.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.128', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.360', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:36,802][52811] DAMAGECOUNT value on done: 650914.0 [2024-08-06 05:57:36,802][52811] Sum rewards: 62.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.028', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon4': '0.104', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '3.170', 'DAMAGECOUNT': '14.751', 'FRAGCOUNT': '51.000'} [2024-08-06 05:57:37,151][52795] DAMAGECOUNT value on done: 642404.0 [2024-08-06 05:57:37,152][52795] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.240', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.092', 'AMMO4': '0.188', 'AMMO3': '0.207', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:37,221][52820] DAMAGECOUNT value on done: 648418.0 [2024-08-06 05:57:37,221][52820] Sum rewards: 73.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.765', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.142', 'AMMO3': '0.202', 'weapon5': '0.244', 'AMMO4': '0.266', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '60.500'} [2024-08-06 05:57:37,517][52664] DAMAGECOUNT value on done: 715775.0 [2024-08-06 05:57:37,517][52664] Sum rewards: 83.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.684', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.076', 'AMMO4': '0.134', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.270', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 533651456. Throughput: 0: 4381.6. Samples: 133417460. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:37,802][52567] Avg episode reward: [(0, '72.402')] [2024-08-06 05:57:38,368][52662] DAMAGECOUNT value on done: 684452.0 [2024-08-06 05:57:38,369][52662] Sum rewards: 81.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.182', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'AMMO4': '0.234', 'weapon4': '0.268', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:38,414][52659] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2024-08-06 05:57:38,504][52668] DAMAGECOUNT value on done: 678205.0 [2024-08-06 05:57:38,506][52668] Sum rewards: 72.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.058', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.094', 'AMMO4': '0.143', 'weapon5': '0.190', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:39,389][52649] DAMAGECOUNT value on done: 676429.0 [2024-08-06 05:57:39,390][52649] Sum rewards: 74.446, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.789', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.536', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:40,025][52811] DAMAGECOUNT value on done: 646201.0 [2024-08-06 05:57:40,026][52811] Sum rewards: 68.629, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.740', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.086', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:40,077][52660] DAMAGECOUNT value on done: 693132.0 [2024-08-06 05:57:40,077][52660] Sum rewards: 82.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.126', 'AMMO3': '0.247', 'weapon5': '0.266', 'AMMO4': '0.272', 'weapon2': '0.348', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:40,137][52664] DAMAGECOUNT value on done: 722653.0 [2024-08-06 05:57:40,137][52664] Sum rewards: 79.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.120', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.230', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:40,231][52795] DAMAGECOUNT value on done: 627605.0 [2024-08-06 05:57:40,233][52795] Sum rewards: 83.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.655', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.060', 'weapon4': '0.112', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '69.000'} [2024-08-06 05:57:40,316][52820] DAMAGECOUNT value on done: 642119.0 [2024-08-06 05:57:40,317][52820] Sum rewards: 87.024, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.395', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.102', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '75.000'} [2024-08-06 05:57:41,268][52662] DAMAGECOUNT value on done: 693252.0 [2024-08-06 05:57:41,269][52662] Sum rewards: 88.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.486', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '72.000'} [2024-08-06 05:57:41,350][52668] DAMAGECOUNT value on done: 678691.0 [2024-08-06 05:57:41,351][52668] Sum rewards: 60.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.027', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.114', 'weapon5': '0.164', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.146', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '52.000'} [2024-08-06 05:57:41,413][52650] Updated weights for policy 0, policy_version 65151 (0.0011) [2024-08-06 05:57:41,537][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 05:57:42,381][52649] DAMAGECOUNT value on done: 664978.0 [2024-08-06 05:57:42,382][52649] Sum rewards: 73.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.086', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.104', 'weapon5': '0.210', 'AMMO3': '0.249', 'AMMO4': '0.255', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:42,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 533749760. Throughput: 0: 4372.4. Samples: 133443350. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:42,794][52567] Avg episode reward: [(0, '72.828')] [2024-08-06 05:57:42,974][52660] DAMAGECOUNT value on done: 680431.0 [2024-08-06 05:57:42,975][52660] Sum rewards: 65.683, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.066', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon4': '0.240', 'weapon5': '0.246', 'AMMO3': '0.266', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.828', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:43,083][52811] DAMAGECOUNT value on done: 644980.0 [2024-08-06 05:57:43,083][52811] Sum rewards: 78.471, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.412', 'AMMO5': '0.015', 'weapon4': '0.034', 'AMMO2': '0.049', 'weapon5': '0.180', 'AMMO4': '0.245', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.208', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:43,117][52664] DAMAGECOUNT value on done: 717512.0 [2024-08-06 05:57:43,117][52664] Sum rewards: 74.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.926', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.136', 'weapon5': '0.136', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.290', 'weapon3': '3.334', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:43,351][52795] DAMAGECOUNT value on done: 645972.0 [2024-08-06 05:57:43,352][52795] Sum rewards: 82.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.556', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.076', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:43,551][52820] DAMAGECOUNT value on done: 645808.0 [2024-08-06 05:57:43,552][52820] Sum rewards: 66.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon4': '0.104', 'AMMO3': '0.218', 'weapon5': '0.218', 'AMMO4': '0.262', 'weapon2': '0.334', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 05:57:44,200][52803] DAMAGECOUNT value on done: 642197.0 [2024-08-06 05:57:44,203][52803] Sum rewards: 74.948, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.139', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.080', 'weapon5': '0.220', 'AMMO4': '0.229', 'AMMO3': '0.274', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.064', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:44,348][52668] DAMAGECOUNT value on done: 677679.0 [2024-08-06 05:57:44,349][52668] Sum rewards: 58.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.493', 'AMMO5': '0.023', 'AMMO2': '0.044', 'weapon4': '0.098', 'AMMO3': '0.196', 'AMMO4': '0.221', 'weapon2': '0.312', 'weapon5': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.690', 'weapon3': '2.918', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '47.000'} [2024-08-06 05:57:44,573][52662] DAMAGECOUNT value on done: 701348.0 [2024-08-06 05:57:44,573][52662] Sum rewards: 76.019, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.600', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.162', 'weapon5': '0.222', 'weapon2': '0.240', 'AMMO3': '0.244', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:45,526][52650] Updated weights for policy 0, policy_version 65161 (0.0029) [2024-08-06 05:57:45,590][52649] DAMAGECOUNT value on done: 680298.0 [2024-08-06 05:57:45,591][52649] Sum rewards: 68.146, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.366', 'AMMO5': '0.022', 'AMMO2': '0.070', 'weapon4': '0.104', 'weapon5': '0.240', 'AMMO3': '0.263', 'weapon2': '0.316', 'AMMO4': '0.348', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '2.956', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:45,638][52660] DAMAGECOUNT value on done: 695042.0 [2024-08-06 05:57:45,639][52660] Sum rewards: 70.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.974', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.320', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:45,678][52664] DAMAGECOUNT value on done: 711861.0 [2024-08-06 05:57:45,680][52664] Sum rewards: 73.100, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.540', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.072', 'weapon5': '0.142', 'AMMO4': '0.214', 'AMMO3': '0.291', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.162', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '65.000'} [2024-08-06 05:57:46,228][52811] DAMAGECOUNT value on done: 642282.0 [2024-08-06 05:57:46,230][52811] Sum rewards: 78.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.700', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.119', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.259', 'WEAPON3': '1.750', 'weapon3': '3.372', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:46,552][52795] DAMAGECOUNT value on done: 639692.0 [2024-08-06 05:57:46,552][52795] Sum rewards: 75.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.198', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.158', 'weapon5': '0.186', 'AMMO3': '0.209', 'AMMO4': '0.292', 'weapon2': '0.386', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:46,683][52820] DAMAGECOUNT value on done: 641966.0 [2024-08-06 05:57:46,684][52820] Sum rewards: 68.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.072', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.072', 'weapon5': '0.216', 'AMMO4': '0.240', 'AMMO3': '0.268', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:46,719][52668] DAMAGECOUNT value on done: 690520.0 [2024-08-06 05:57:46,722][52668] Sum rewards: 74.866, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.970', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.141', 'weapon5': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.266', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.000', 'weapon3': '2.986', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:47,319][52662] DAMAGECOUNT value on done: 693502.0 [2024-08-06 05:57:47,320][52662] Sum rewards: 73.945, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.316', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.260', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:47,419][52803] DAMAGECOUNT value on done: 643029.0 [2024-08-06 05:57:47,419][52803] Sum rewards: 69.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.243', 'AMMO5': '0.004', 'weapon4': '0.022', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.286', 'weapon2': '0.454', 'WEAPON3': '1.650', 'weapon3': '3.264', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '60.000'} [2024-08-06 05:57:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17613.0, 300 sec: 17467.0). Total num frames: 533831680. Throughput: 0: 4375.6. Samples: 133456580. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:47,802][52567] Avg episode reward: [(0, '72.726')] [2024-08-06 05:57:48,134][52664] DAMAGECOUNT value on done: 722637.0 [2024-08-06 05:57:48,134][52664] Sum rewards: 63.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.513', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.140', 'AMMO3': '0.210', 'AMMO4': '0.287', 'weapon5': '0.394', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '55.000'} [2024-08-06 05:57:48,432][52660] DAMAGECOUNT value on done: 701210.0 [2024-08-06 05:57:48,433][52660] Sum rewards: 75.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.256', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.088', 'AMMO4': '0.167', 'weapon5': '0.172', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:48,651][52649] DAMAGECOUNT value on done: 672796.0 [2024-08-06 05:57:48,651][52649] Sum rewards: 74.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.812', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.142', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:49,255][52811] DAMAGECOUNT value on done: 642701.0 [2024-08-06 05:57:49,256][52811] Sum rewards: 80.422, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.132', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:49,548][52668] DAMAGECOUNT value on done: 688808.0 [2024-08-06 05:57:49,548][52668] Sum rewards: 71.828, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.348', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '59.500'} [2024-08-06 05:57:49,690][52795] DAMAGECOUNT value on done: 632126.0 [2024-08-06 05:57:49,690][52795] Sum rewards: 72.772, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.556', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.101', 'weapon5': '0.124', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.260', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '59.000'} [2024-08-06 05:57:49,811][52820] DAMAGECOUNT value on done: 643013.0 [2024-08-06 05:57:49,813][52820] Sum rewards: 81.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.158', 'AMMO3': '0.161', 'AMMO4': '0.240', 'weapon2': '0.334', 'WEAPON5': '0.500', 'weapon4': '0.532', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '64.000'} [2024-08-06 05:57:50,459][52650] Updated weights for policy 0, policy_version 65171 (0.0026) [2024-08-06 05:57:50,486][52803] DAMAGECOUNT value on done: 648053.0 [2024-08-06 05:57:50,488][52803] Sum rewards: 65.938, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.772', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.084', 'AMMO4': '0.227', 'weapon5': '0.238', 'AMMO3': '0.254', 'weapon2': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.132', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2024-08-06 05:57:50,515][52662] DAMAGECOUNT value on done: 701592.0 [2024-08-06 05:57:50,516][52662] Sum rewards: 73.537, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.260', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.122', 'AMMO3': '0.213', 'weapon5': '0.220', 'AMMO4': '0.246', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:51,114][52664] DAMAGECOUNT value on done: 715887.0 [2024-08-06 05:57:51,115][52664] Sum rewards: 78.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.183', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.412', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.598', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '65.000'} [2024-08-06 05:57:51,145][52660] DAMAGECOUNT value on done: 686492.0 [2024-08-06 05:57:51,145][52660] Sum rewards: 69.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.791', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.194', 'weapon4': '0.196', 'AMMO3': '0.241', 'AMMO4': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:51,661][52649] DAMAGECOUNT value on done: 675853.0 [2024-08-06 05:57:51,661][52649] Sum rewards: 73.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.454', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.157', 'AMMO4': '0.256', 'weapon4': '0.294', 'weapon5': '0.304', 'weapon2': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.736', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:52,292][52811] DAMAGECOUNT value on done: 647163.0 [2024-08-06 05:57:52,295][52811] Sum rewards: 76.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.168', 'weapon2': '0.528', 'WEAPON3': '1.050', 'weapon3': '2.980', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:52,472][52668] DAMAGECOUNT value on done: 687337.0 [2024-08-06 05:57:52,474][52668] Sum rewards: 81.860, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.987', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:52,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 533913600. Throughput: 0: 4381.1. Samples: 133482790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:52,802][52567] Avg episode reward: [(0, '73.502')] [2024-08-06 05:57:52,799][52795] DAMAGECOUNT value on done: 640076.0 [2024-08-06 05:57:52,803][52795] Sum rewards: 84.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.949', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.140', 'AMMO4': '0.169', 'AMMO3': '0.176', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.328', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '68.000'} [2024-08-06 05:57:53,088][52820] DAMAGECOUNT value on done: 652790.0 [2024-08-06 05:57:53,089][52820] Sum rewards: 71.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.848', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.168', 'weapon4': '0.172', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '59.500'} [2024-08-06 05:57:53,590][52803] DAMAGECOUNT value on done: 648463.0 [2024-08-06 05:57:53,590][52803] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.432', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.123', 'weapon5': '0.128', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:53,605][52662] DAMAGECOUNT value on done: 687578.0 [2024-08-06 05:57:53,605][52662] Sum rewards: 78.149, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.768', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.092', 'weapon5': '0.124', 'weapon2': '0.236', 'AMMO4': '0.239', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:53,686][52664] DAMAGECOUNT value on done: 712438.0 [2024-08-06 05:57:53,686][52664] Sum rewards: 67.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.694', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.188', 'weapon5': '0.210', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:53,722][52660] DAMAGECOUNT value on done: 683447.0 [2024-08-06 05:57:53,723][52660] Sum rewards: 78.327, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.985', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.186', 'weapon2': '0.194', 'AMMO4': '0.280', 'weapon5': '0.342', 'weapon4': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '63.000'} [2024-08-06 05:57:54,792][52668] DAMAGECOUNT value on done: 695962.0 [2024-08-06 05:57:54,795][52668] Sum rewards: 68.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.065', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.054', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.526', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '59.000'} [2024-08-06 05:57:54,876][52649] DAMAGECOUNT value on done: 676118.0 [2024-08-06 05:57:54,876][52649] Sum rewards: 67.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.184', 'weapon4': '0.244', 'AMMO3': '0.246', 'AMMO4': '0.246', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '57.000'} [2024-08-06 05:57:55,275][52650] Updated weights for policy 0, policy_version 65181 (0.0012) [2024-08-06 05:57:55,317][52811] DAMAGECOUNT value on done: 651476.0 [2024-08-06 05:57:55,319][52811] Sum rewards: 79.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.434', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.110', 'AMMO3': '0.174', 'weapon5': '0.184', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:56,029][52795] DAMAGECOUNT value on done: 647387.0 [2024-08-06 05:57:56,030][52795] Sum rewards: 74.584, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.642', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.073', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.296', 'WEAPON3': '0.950', 'HITCOUNT': '3.310', 'weapon3': '3.468', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:56,193][52664] DAMAGECOUNT value on done: 709313.0 [2024-08-06 05:57:56,195][52664] Sum rewards: 77.146, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.025', 'AMMO2': '0.040', 'AMMO3': '0.171', 'weapon5': '0.202', 'AMMO4': '0.202', 'weapon2': '0.292', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '62.000'} [2024-08-06 05:57:56,474][52820] DAMAGECOUNT value on done: 651015.0 [2024-08-06 05:57:56,474][52820] Sum rewards: 67.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.041', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.042', 'AMMO4': '0.083', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '58.000'} [2024-08-06 05:57:56,534][52660] DAMAGECOUNT value on done: 688479.0 [2024-08-06 05:57:56,538][52660] Sum rewards: 83.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.436', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.066', 'AMMO3': '0.198', 'weapon5': '0.204', 'AMMO4': '0.232', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:56,770][52803] DAMAGECOUNT value on done: 647423.0 [2024-08-06 05:57:56,771][52803] Sum rewards: 76.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.030', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.098', 'AMMO4': '0.197', 'weapon5': '0.206', 'AMMO3': '0.246', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '66.000'} [2024-08-06 05:57:57,023][52662] DAMAGECOUNT value on done: 690036.0 [2024-08-06 05:57:57,024][52662] Sum rewards: 79.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.148', 'weapon5': '0.184', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '67.000'} [2024-08-06 05:57:57,720][52668] DAMAGECOUNT value on done: 692906.0 [2024-08-06 05:57:57,722][52668] Sum rewards: 84.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.900', 'AMMO5': '0.025', 'AMMO2': '0.074', 'weapon5': '0.170', 'AMMO3': '0.173', 'weapon2': '0.262', 'AMMO4': '0.372', 'weapon4': '0.386', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.892', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '70.000'} [2024-08-06 05:57:57,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 533995520. Throughput: 0: 4387.3. Samples: 133509290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 05:57:57,795][52567] Avg episode reward: [(0, '73.437')] [2024-08-06 05:57:58,110][52649] DAMAGECOUNT value on done: 668183.0 [2024-08-06 05:57:58,114][52649] Sum rewards: 72.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.539', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.052', 'weapon4': '0.122', 'AMMO3': '0.220', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:58,341][52811] DAMAGECOUNT value on done: 647786.0 [2024-08-06 05:57:58,341][52811] Sum rewards: 66.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.021', 'AMMO2': '0.049', 'AMMO3': '0.183', 'weapon5': '0.244', 'AMMO4': '0.247', 'weapon4': '0.358', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.656', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '54.000'} [2024-08-06 05:57:59,037][52664] DAMAGECOUNT value on done: 723082.0 [2024-08-06 05:57:59,038][52664] Sum rewards: 77.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon2': '0.192', 'weapon5': '0.216', 'AMMO3': '0.255', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '65.000'} [2024-08-06 05:57:59,556][52660] DAMAGECOUNT value on done: 697945.0 [2024-08-06 05:57:59,558][52660] Sum rewards: 73.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.522', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:59,619][52820] DAMAGECOUNT value on done: 640073.0 [2024-08-06 05:57:59,621][52820] Sum rewards: 83.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.603', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.128', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '69.000'} [2024-08-06 05:57:59,877][52650] Updated weights for policy 0, policy_version 65191 (0.0021) [2024-08-06 05:57:59,898][52662] DAMAGECOUNT value on done: 687300.0 [2024-08-06 05:57:59,898][52662] Sum rewards: 76.095, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.124', 'AMMO4': '0.144', 'AMMO3': '0.157', 'HEALTH': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.642', 'WEAPON3': '0.900', 'weapon3': '2.994', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '61.000'} [2024-08-06 05:57:59,946][52803] DAMAGECOUNT value on done: 640858.0 [2024-08-06 05:57:59,947][52803] Sum rewards: 87.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.180', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.086', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.382', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '74.000'} [2024-08-06 05:58:01,011][52649] DAMAGECOUNT value on done: 682461.0 [2024-08-06 05:58:01,012][52649] Sum rewards: 66.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.988', 'AMMO5': '0.017', 'AMMO2': '0.060', 'AMMO3': '0.223', 'weapon4': '0.242', 'weapon5': '0.284', 'AMMO4': '0.298', 'weapon2': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 05:58:01,461][52811] DAMAGECOUNT value on done: 644042.0 [2024-08-06 05:58:01,462][52811] Sum rewards: 59.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.319', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.094', 'AMMO4': '0.150', 'AMMO3': '0.163', 'weapon5': '0.242', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '3.162', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '49.000'} [2024-08-06 05:58:01,955][52664] DAMAGECOUNT value on done: 711966.0 [2024-08-06 05:58:01,956][52664] Sum rewards: 66.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.688', 'AMMO5': '0.019', 'AMMO2': '0.029', 'weapon4': '0.076', 'AMMO4': '0.145', 'weapon5': '0.154', 'AMMO3': '0.173', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.234', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '54.500'} [2024-08-06 05:58:02,439][52662] DAMAGECOUNT value on done: 696492.0 [2024-08-06 05:58:02,443][52662] Sum rewards: 74.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.216', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.140', 'AMMO4': '0.188', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:02,448][52660] DAMAGECOUNT value on done: 682565.0 [2024-08-06 05:58:02,448][52660] Sum rewards: 74.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.607', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO3': '0.183', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 534093824. Throughput: 0: 4384.0. Samples: 133522390. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:02,794][52567] Avg episode reward: [(0, '73.828')] [2024-08-06 05:58:02,979][52803] DAMAGECOUNT value on done: 639031.0 [2024-08-06 05:58:02,981][52803] Sum rewards: 76.565, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.558', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.136', 'weapon2': '0.192', 'weapon4': '0.208', 'AMMO3': '0.213', 'AMMO4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '63.000'} [2024-08-06 05:58:03,422][52649] DAMAGECOUNT value on done: 682639.0 [2024-08-06 05:58:03,422][52649] Sum rewards: 70.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.230', 'WEAPON3': '1.450', 'HITCOUNT': '3.300', 'weapon3': '3.518', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:04,579][52650] Updated weights for policy 0, policy_version 65201 (0.0032) [2024-08-06 05:58:05,189][52664] DAMAGECOUNT value on done: 723272.0 [2024-08-06 05:58:05,191][52664] Sum rewards: 69.307, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.530', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.059', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.285', 'weapon2': '0.502', 'WEAPON3': '1.750', 'weapon3': '3.170', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '60.500'} [2024-08-06 05:58:05,207][52662] DAMAGECOUNT value on done: 687181.0 [2024-08-06 05:58:05,208][52662] Sum rewards: 64.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.510', 'AMMO5': '0.022', 'AMMO2': '0.046', 'AMMO3': '0.183', 'weapon2': '0.208', 'weapon5': '0.226', 'AMMO4': '0.232', 'weapon4': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '53.000'} [2024-08-06 05:58:05,877][52660] DAMAGECOUNT value on done: 686850.0 [2024-08-06 05:58:05,877][52660] Sum rewards: 73.625, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.025', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.109', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.292', 'weapon2': '0.342', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:05,988][52803] DAMAGECOUNT value on done: 637289.0 [2024-08-06 05:58:05,988][52803] Sum rewards: 58.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.724', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.100', 'AMMO3': '0.170', 'AMMO4': '0.173', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.862', 'WEAPON3': '0.950', 'weapon3': '2.492', 'HITCOUNT': '2.700', 'DAMAGECOUNT': '14.424', 'FRAGCOUNT': '48.000'} [2024-08-06 05:58:06,281][52649] DAMAGECOUNT value on done: 682480.0 [2024-08-06 05:58:06,281][52649] Sum rewards: 86.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.705', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.154', 'AMMO4': '0.196', 'AMMO3': '0.206', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '71.000'} [2024-08-06 05:58:07,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 534183936. Throughput: 0: 4375.8. Samples: 133548500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:07,802][52567] Avg episode reward: [(0, '73.724')] [2024-08-06 05:58:08,193][52662] DAMAGECOUNT value on done: 702257.0 [2024-08-06 05:58:08,193][52662] Sum rewards: 83.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.040', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '68.000'} [2024-08-06 05:58:08,336][52664] DAMAGECOUNT value on done: 723084.0 [2024-08-06 05:58:08,336][52664] Sum rewards: 60.802, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.589', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.098', 'AMMO3': '0.161', 'weapon5': '0.260', 'AMMO4': '0.319', 'weapon2': '0.484', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '2.954', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '48.000'} [2024-08-06 05:58:08,633][52660] DAMAGECOUNT value on done: 692667.0 [2024-08-06 05:58:08,634][52660] Sum rewards: 74.539, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.430', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO3': '0.177', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '3.312', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '60.000'} [2024-08-06 05:58:08,989][52649] DAMAGECOUNT value on done: 678931.0 [2024-08-06 05:58:08,991][52649] Sum rewards: 75.672, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.782', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.227', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:09,136][52803] DAMAGECOUNT value on done: 640840.0 [2024-08-06 05:58:09,137][52803] Sum rewards: 84.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.252', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.044', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.474', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '73.000'} [2024-08-06 05:58:09,530][52650] Updated weights for policy 0, policy_version 65211 (0.0025) [2024-08-06 05:58:10,634][52662] DAMAGECOUNT value on done: 698227.0 [2024-08-06 05:58:10,635][52662] Sum rewards: 84.087, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.894', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.166', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '66.000'} [2024-08-06 05:58:11,458][52649] DAMAGECOUNT value on done: 666304.0 [2024-08-06 05:58:11,459][52649] Sum rewards: 88.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.821', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.180', 'weapon4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.220', 'AMMO4': '0.235', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '73.000'} [2024-08-06 05:58:11,552][52664] DAMAGECOUNT value on done: 722609.0 [2024-08-06 05:58:11,552][52664] Sum rewards: 67.463, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.459', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.170', 'AMMO3': '0.188', 'AMMO4': '0.249', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 05:58:11,892][52660] DAMAGECOUNT value on done: 685186.0 [2024-08-06 05:58:11,892][52660] Sum rewards: 80.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.802', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.042', 'weapon5': '0.064', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.308', 'WEAPON3': '1.700', 'weapon3': '3.324', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '70.000'} [2024-08-06 05:58:12,332][52803] DAMAGECOUNT value on done: 641305.0 [2024-08-06 05:58:12,333][52803] Sum rewards: 92.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.193', 'AMMO3': '0.208', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '22.275', 'FRAGCOUNT': '74.000'} [2024-08-06 05:58:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 534257664. Throughput: 0: 4376.7. Samples: 133574920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:12,802][52567] Avg episode reward: [(0, '74.587')] [2024-08-06 05:58:13,527][52662] DAMAGECOUNT value on done: 682638.0 [2024-08-06 05:58:13,530][52662] Sum rewards: 60.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.995', 'AMMO2': '0.004', 'AMMO5': '0.020', 'AMMO4': '0.020', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.154', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '52.000'} [2024-08-06 05:58:13,744][52650] Updated weights for policy 0, policy_version 65221 (0.0041) [2024-08-06 05:58:14,302][52649] DAMAGECOUNT value on done: 677842.0 [2024-08-06 05:58:14,302][52649] Sum rewards: 74.581, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.660', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.064', 'weapon5': '0.108', 'AMMO4': '0.124', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.198', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '64.500'} [2024-08-06 05:58:14,703][52664] DAMAGECOUNT value on done: 724894.0 [2024-08-06 05:58:14,704][52664] Sum rewards: 85.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.615', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.192', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.394', 'FRAGCOUNT': '69.000'} [2024-08-06 05:58:14,725][52660] DAMAGECOUNT value on done: 689116.0 [2024-08-06 05:58:14,725][52660] Sum rewards: 77.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.459', 'AMMO5': '0.019', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.138', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '63.000'} [2024-08-06 05:58:15,496][52803] DAMAGECOUNT value on done: 655395.0 [2024-08-06 05:58:15,498][52803] Sum rewards: 76.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.806', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:16,112][52662] DAMAGECOUNT value on done: 691909.0 [2024-08-06 05:58:16,114][52662] Sum rewards: 76.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.082', 'weapon2': '0.182', 'AMMO4': '0.198', 'AMMO3': '0.212', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '63.000'} [2024-08-06 05:58:16,459][52664] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 05:58:16,585][52647] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 05:58:16,633][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:58:17,029][52649] DAMAGECOUNT value on done: 667506.0 [2024-08-06 05:58:17,029][52649] Sum rewards: 56.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.805', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.184', 'AMMO4': '0.210', 'weapon2': '0.260', 'AMMO3': '0.269', 'weapon5': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.882', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '49.000'} [2024-08-06 05:58:17,364][52664] DAMAGECOUNT value on done: 727643.0 [2024-08-06 05:58:17,366][52664] Sum rewards: 87.998, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.186', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.143', 'weapon5': '0.182', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '21.216', 'FRAGCOUNT': '74.000'} [2024-08-06 05:58:17,484][52660] DAMAGECOUNT value on done: 700250.0 [2024-08-06 05:58:17,484][52660] Sum rewards: 78.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.110', 'AMMO4': '0.168', 'AMMO3': '0.192', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.428', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 534347776. Throughput: 0: 4376.5. Samples: 133587980. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:17,802][52567] Avg episode reward: [(0, '74.733')] [2024-08-06 05:58:18,194][52659] DAMAGECOUNT value on done: 695744.0 [2024-08-06 05:58:18,197][52659] Sum rewards: 73.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.256', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.121', 'weapon5': '0.166', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '59.000'} [2024-08-06 05:58:18,590][52803] DAMAGECOUNT value on done: 644537.0 [2024-08-06 05:58:18,590][52803] Sum rewards: 82.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.234', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.322', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '69.000'} [2024-08-06 05:58:18,720][52650] Updated weights for policy 0, policy_version 65231 (0.0028) [2024-08-06 05:58:18,893][52662] DAMAGECOUNT value on done: 683821.0 [2024-08-06 05:58:18,893][52662] Sum rewards: 71.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.465', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO4': '0.173', 'AMMO3': '0.181', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.094', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.000'} [2024-08-06 05:58:19,781][52649] DAMAGECOUNT value on done: 681455.0 [2024-08-06 05:58:19,782][52649] Sum rewards: 75.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.876', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.046', 'AMMO4': '0.095', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:20,160][52664] DAMAGECOUNT value on done: 720640.0 [2024-08-06 05:58:20,161][52664] Sum rewards: 79.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.112', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.616', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '67.000'} [2024-08-06 05:58:20,426][52660] DAMAGECOUNT value on done: 707538.0 [2024-08-06 05:58:20,426][52660] Sum rewards: 71.454, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.343', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.170', 'weapon5': '0.198', 'weapon2': '0.266', 'AMMO3': '0.270', 'AMMO4': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.014', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:20,908][52659] DAMAGECOUNT value on done: 692957.0 [2024-08-06 05:58:20,908][52659] Sum rewards: 80.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.759', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:21,630][52803] DAMAGECOUNT value on done: 643436.0 [2024-08-06 05:58:21,631][52803] Sum rewards: 78.062, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.775', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.138', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.295', 'WEAPON3': '1.800', 'weapon3': '3.276', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '67.000'} [2024-08-06 05:58:22,657][52664] DAMAGECOUNT value on done: 714432.0 [2024-08-06 05:58:22,658][52664] Sum rewards: 73.272, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.322', 'weapon4': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 05:58:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 534446080. Throughput: 0: 4371.3. Samples: 133614170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:22,794][52567] Avg episode reward: [(0, '74.869')] [2024-08-06 05:58:22,897][52660] DAMAGECOUNT value on done: 687111.0 [2024-08-06 05:58:22,898][52660] Sum rewards: 83.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.094', 'weapon5': '0.134', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '68.000'} [2024-08-06 05:58:22,899][52649] DAMAGECOUNT value on done: 680324.0 [2024-08-06 05:58:22,900][52649] Sum rewards: 72.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.585', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.096', 'weapon5': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.410', 'WEAPON3': '0.900', 'weapon3': '3.222', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '56.000'} [2024-08-06 05:58:23,587][52650] Updated weights for policy 0, policy_version 65241 (0.0013) [2024-08-06 05:58:23,686][52659] DAMAGECOUNT value on done: 695044.0 [2024-08-06 05:58:23,688][52659] Sum rewards: 85.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.951', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.132', 'AMMO4': '0.134', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '71.000'} [2024-08-06 05:58:24,750][52803] DAMAGECOUNT value on done: 656180.0 [2024-08-06 05:58:24,750][52803] Sum rewards: 75.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.822', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.136', 'AMMO4': '0.184', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '60.000'} [2024-08-06 05:58:25,009][52614] Signal inference workers to stop experience collection... (11850 times) [2024-08-06 05:58:25,011][52614] Signal inference workers to resume experience collection... (11850 times) [2024-08-06 05:58:25,062][52650] InferenceWorker_p0-w0: stopping experience collection (11850 times) [2024-08-06 05:58:25,065][52650] InferenceWorker_p0-w0: resuming experience collection (11850 times) [2024-08-06 05:58:25,121][52664] DAMAGECOUNT value on done: 718278.0 [2024-08-06 05:58:25,121][52664] Sum rewards: 64.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.144', 'weapon4': '0.160', 'AMMO4': '0.178', 'weapon2': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.240', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '54.000'} [2024-08-06 05:58:25,928][52649] DAMAGECOUNT value on done: 674650.0 [2024-08-06 05:58:25,928][52649] Sum rewards: 70.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.082', 'AMMO3': '0.183', 'weapon5': '0.184', 'AMMO4': '0.189', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '57.000'} [2024-08-06 05:58:25,960][52660] DAMAGECOUNT value on done: 696209.0 [2024-08-06 05:58:25,961][52660] Sum rewards: 69.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.130', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '58.000'} [2024-08-06 05:58:26,892][52659] DAMAGECOUNT value on done: 692944.0 [2024-08-06 05:58:26,894][52659] Sum rewards: 91.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.344', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.126', 'FRAGCOUNT': '73.000'} [2024-08-06 05:58:27,623][52664] DAMAGECOUNT value on done: 716558.0 [2024-08-06 05:58:27,625][52664] Sum rewards: 67.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.586', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.238', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '56.000'} [2024-08-06 05:58:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 534528000. Throughput: 0: 4378.0. Samples: 133640360. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:27,794][52567] Avg episode reward: [(0, '74.771')] [2024-08-06 05:58:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000065250_534528000.pth... [2024-08-06 05:58:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064738_530333696.pth [2024-08-06 05:58:28,026][52650] Updated weights for policy 0, policy_version 65251 (0.0010) [2024-08-06 05:58:28,101][52803] DAMAGECOUNT value on done: 643500.0 [2024-08-06 05:58:28,102][52803] Sum rewards: 75.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.935', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.106', 'AMMO4': '0.167', 'weapon2': '0.188', 'AMMO3': '0.195', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:28,816][52666] Large shaping reward 2.572 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 05:58:29,174][52660] DAMAGECOUNT value on done: 691179.0 [2024-08-06 05:58:29,175][52660] Sum rewards: 82.214, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.564', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.102', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.307', 'WEAPON3': '1.650', 'weapon3': '3.208', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '70.000'} [2024-08-06 05:58:29,728][52659] DAMAGECOUNT value on done: 689663.0 [2024-08-06 05:58:29,728][52659] Sum rewards: 84.080, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.504', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.112', 'weapon5': '0.156', 'AMMO4': '0.219', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '71.000'} [2024-08-06 05:58:30,270][52664] DAMAGECOUNT value on done: 716396.0 [2024-08-06 05:58:30,271][52664] Sum rewards: 72.667, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.114', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon4': '0.106', 'AMMO3': '0.227', 'weapon5': '0.308', 'weapon2': '0.312', 'AMMO4': '0.322', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:31,126][52820] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 05:58:31,317][52803] DAMAGECOUNT value on done: 644429.0 [2024-08-06 05:58:31,318][52803] Sum rewards: 81.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.295', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.115', 'weapon5': '0.186', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '67.000'} [2024-08-06 05:58:31,893][52660] DAMAGECOUNT value on done: 686750.0 [2024-08-06 05:58:31,895][52660] Sum rewards: 77.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.760', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.246', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.456', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '67.000'} [2024-08-06 05:58:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 534609920. Throughput: 0: 4371.1. Samples: 133653280. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:32,794][52567] Avg episode reward: [(0, '75.229')] [2024-08-06 05:58:32,819][52614] Saving new best policy, reward=75.229! [2024-08-06 05:58:32,823][52650] Updated weights for policy 0, policy_version 65261 (0.0020) [2024-08-06 05:58:32,863][52659] DAMAGECOUNT value on done: 695576.0 [2024-08-06 05:58:32,863][52659] Sum rewards: 81.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.994', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.020', 'AMMO4': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.772', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '65.000'} [2024-08-06 05:58:33,655][52665] DAMAGECOUNT value on done: 678195.0 [2024-08-06 05:58:33,655][52665] Sum rewards: 73.741, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.026', 'AMMO2': '0.056', 'weapon4': '0.204', 'AMMO3': '0.223', 'AMMO4': '0.278', 'weapon5': '0.308', 'weapon2': '0.316', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:34,439][52803] DAMAGECOUNT value on done: 648431.0 [2024-08-06 05:58:34,442][52803] Sum rewards: 72.906, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.138', 'weapon4': '0.140', 'AMMO4': '0.176', 'AMMO3': '0.228', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:34,721][52660] DAMAGECOUNT value on done: 681559.0 [2024-08-06 05:58:34,723][52660] Sum rewards: 84.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.105', 'weapon4': '0.128', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.024', 'FRAGCOUNT': '66.500'} [2024-08-06 05:58:35,808][52659] DAMAGECOUNT value on done: 693470.0 [2024-08-06 05:58:35,808][52659] Sum rewards: 75.860, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.499', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.190', 'AMMO4': '0.193', 'weapon5': '0.202', 'AMMO3': '0.257', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '66.000'} [2024-08-06 05:58:36,307][52665] DAMAGECOUNT value on done: 695406.0 [2024-08-06 05:58:36,308][52665] Sum rewards: 71.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.103', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:37,274][52650] Updated weights for policy 0, policy_version 65271 (0.0030) [2024-08-06 05:58:37,563][52803] DAMAGECOUNT value on done: 650319.0 [2024-08-06 05:58:37,566][52803] Sum rewards: 78.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.721', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.096', 'FRAGCOUNT': '63.000'} [2024-08-06 05:58:37,618][52667] DAMAGECOUNT value on done: 693585.0 [2024-08-06 05:58:37,618][52667] Sum rewards: 73.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.513', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO4': '0.182', 'AMMO3': '0.198', 'weapon5': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '60.000'} [2024-08-06 05:58:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 534700032. Throughput: 0: 4364.7. Samples: 133679200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 05:58:37,794][52567] Avg episode reward: [(0, '75.495')] [2024-08-06 05:58:37,797][52614] Saving new best policy, reward=75.495! [2024-08-06 05:58:38,851][52659] DAMAGECOUNT value on done: 688970.0 [2024-08-06 05:58:38,852][52659] Sum rewards: 77.646, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.130', 'AMMO4': '0.148', 'weapon5': '0.172', 'weapon2': '0.174', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '64.000'} [2024-08-06 05:58:39,410][52665] DAMAGECOUNT value on done: 693701.0 [2024-08-06 05:58:39,410][52665] Sum rewards: 73.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.216', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.072', 'weapon5': '0.168', 'AMMO3': '0.240', 'weapon2': '0.280', 'AMMO4': '0.289', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:40,113][52667] DAMAGECOUNT value on done: 700330.0 [2024-08-06 05:58:40,116][52667] Sum rewards: 73.839, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.660', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.056', 'weapon4': '0.124', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.258', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '65.000'} [2024-08-06 05:58:40,696][52803] DAMAGECOUNT value on done: 654645.0 [2024-08-06 05:58:40,698][52803] Sum rewards: 68.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.021', 'AMMO2': '0.032', 'weapon4': '0.092', 'AMMO4': '0.158', 'AMMO3': '0.214', 'weapon5': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '56.500'} [2024-08-06 05:58:40,945][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:58:41,439][52647] DAMAGECOUNT value on done: 734504.0 [2024-08-06 05:58:41,439][52647] Sum rewards: 63.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.326', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.122', 'weapon5': '0.158', 'AMMO4': '0.168', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '53.000'} [2024-08-06 05:58:42,156][52659] DAMAGECOUNT value on done: 695442.0 [2024-08-06 05:58:42,158][52659] Sum rewards: 78.810, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.756', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.173', 'weapon5': '0.206', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:42,455][52650] Updated weights for policy 0, policy_version 65281 (0.0012) [2024-08-06 05:58:42,460][52665] DAMAGECOUNT value on done: 686533.0 [2024-08-06 05:58:42,463][52665] Sum rewards: 73.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.667', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.044', 'weapon5': '0.186', 'AMMO4': '0.197', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:42,472][52794] DAMAGECOUNT value on done: 691972.0 [2024-08-06 05:58:42,472][52794] Sum rewards: 66.218, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.048', 'AMMO4': '0.065', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon2': '0.320', 'WEAPON3': '0.950', 'HITCOUNT': '2.830', 'weapon3': '3.240', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '52.500'} [2024-08-06 05:58:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 534790144. Throughput: 0: 4347.8. Samples: 133704940. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:58:42,794][52567] Avg episode reward: [(0, '75.387')] [2024-08-06 05:58:43,031][52667] DAMAGECOUNT value on done: 694746.0 [2024-08-06 05:58:43,039][52667] Sum rewards: 65.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.282', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.178', 'AMMO3': '0.198', 'AMMO4': '0.214', 'weapon2': '0.288', 'weapon5': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '55.000'} [2024-08-06 05:58:43,871][52803] DAMAGECOUNT value on done: 645956.0 [2024-08-06 05:58:43,872][52803] Sum rewards: 80.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.388', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '66.000'} [2024-08-06 05:58:43,953][52647] DAMAGECOUNT value on done: 726046.0 [2024-08-06 05:58:43,954][52647] Sum rewards: 58.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.872', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.054', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.650', 'HITCOUNT': '2.800', 'weapon3': '3.500', 'DAMAGECOUNT': '15.126', 'FRAGCOUNT': '52.000'} [2024-08-06 05:58:45,190][52794] DAMAGECOUNT value on done: 699592.0 [2024-08-06 05:58:45,191][52794] Sum rewards: 70.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.249', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.310', 'WEAPON3': '1.600', 'weapon3': '3.346', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:45,371][52659] DAMAGECOUNT value on done: 700930.0 [2024-08-06 05:58:45,372][52659] Sum rewards: 74.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.991', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.174', 'weapon4': '0.216', 'AMMO3': '0.247', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.050', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '63.000'} [2024-08-06 05:58:45,403][52667] DAMAGECOUNT value on done: 698707.0 [2024-08-06 05:58:45,404][52667] Sum rewards: 66.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO4': '0.139', 'AMMO3': '0.160', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.896', 'WEAPON3': '0.950', 'weapon3': '2.668', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '52.000'} [2024-08-06 05:58:45,554][52665] DAMAGECOUNT value on done: 675194.0 [2024-08-06 05:58:45,554][52665] Sum rewards: 83.607, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.480', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '70.000'} [2024-08-06 05:58:46,589][52647] DAMAGECOUNT value on done: 732658.0 [2024-08-06 05:58:46,590][52647] Sum rewards: 80.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.326', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.215', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '67.000'} [2024-08-06 05:58:47,055][52650] Updated weights for policy 0, policy_version 65291 (0.0013) [2024-08-06 05:58:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 534872064. Throughput: 0: 4348.4. Samples: 133718070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:58:47,794][52567] Avg episode reward: [(0, '75.106')] [2024-08-06 05:58:47,972][52794] DAMAGECOUNT value on done: 702476.0 [2024-08-06 05:58:47,972][52794] Sum rewards: 71.166, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.179', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.089', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '60.000'} [2024-08-06 05:58:48,194][52659] DAMAGECOUNT value on done: 687346.0 [2024-08-06 05:58:48,204][52659] Sum rewards: 75.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.635', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.077', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.222', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.496', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:48,422][52667] DAMAGECOUNT value on done: 698650.0 [2024-08-06 05:58:48,423][52667] Sum rewards: 75.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.912', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.086', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.568', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:48,455][52665] DAMAGECOUNT value on done: 680309.0 [2024-08-06 05:58:48,455][52665] Sum rewards: 70.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.746', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.122', 'weapon4': '0.154', 'AMMO4': '0.160', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '59.000'} [2024-08-06 05:58:49,753][52647] DAMAGECOUNT value on done: 732409.0 [2024-08-06 05:58:49,753][52647] Sum rewards: 73.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.923', 'AMMO5': '0.023', 'AMMO2': '0.069', 'weapon4': '0.176', 'AMMO3': '0.227', 'weapon5': '0.328', 'AMMO4': '0.347', 'weapon2': '0.432', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.778', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:50,677][52794] DAMAGECOUNT value on done: 687718.0 [2024-08-06 05:58:50,677][52794] Sum rewards: 59.833, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.428', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.058', 'AMMO3': '0.130', 'AMMO4': '0.191', 'weapon5': '0.302', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'HITCOUNT': '2.730', 'weapon3': '2.980', 'DAMAGECOUNT': '14.565', 'FRAGCOUNT': '47.000'} [2024-08-06 05:58:50,973][52667] DAMAGECOUNT value on done: 701671.0 [2024-08-06 05:58:50,974][52667] Sum rewards: 63.185, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.850', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO3': '0.159', 'AMMO4': '0.169', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.466', 'WEAPON3': '1.000', 'weapon3': '2.872', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '50.000'} [2024-08-06 05:58:51,303][52659] DAMAGECOUNT value on done: 699470.0 [2024-08-06 05:58:51,303][52659] Sum rewards: 74.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.102', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:51,452][52665] DAMAGECOUNT value on done: 686577.0 [2024-08-06 05:58:51,453][52665] Sum rewards: 76.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.763', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.068', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '62.000'} [2024-08-06 05:58:51,700][52650] Updated weights for policy 0, policy_version 65301 (0.0020) [2024-08-06 05:58:52,706][52647] DAMAGECOUNT value on done: 739238.0 [2024-08-06 05:58:52,707][52647] Sum rewards: 78.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.252', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon2': '0.188', 'weapon5': '0.202', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.448', 'WEAPON3': '1.550', 'weapon3': '2.876', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '66.000'} [2024-08-06 05:58:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 534962176. Throughput: 0: 4351.6. Samples: 133744320. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:58:52,794][52567] Avg episode reward: [(0, '74.969')] [2024-08-06 05:58:53,588][52794] DAMAGECOUNT value on done: 689887.0 [2024-08-06 05:58:53,590][52794] Sum rewards: 65.938, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.191', 'weapon5': '0.198', 'weapon2': '0.210', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.136', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '54.000'} [2024-08-06 05:58:53,831][52667] DAMAGECOUNT value on done: 697535.0 [2024-08-06 05:58:53,832][52667] Sum rewards: 75.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.298', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.252', 'WEAPON3': '1.600', 'weapon3': '3.502', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '65.000'} [2024-08-06 05:58:54,073][52665] DAMAGECOUNT value on done: 683841.0 [2024-08-06 05:58:54,075][52665] Sum rewards: 63.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.258', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.152', 'AMMO4': '0.157', 'weapon5': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '56.000'} [2024-08-06 05:58:54,432][52659] DAMAGECOUNT value on done: 690597.0 [2024-08-06 05:58:54,433][52659] Sum rewards: 66.058, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.375', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.096', 'weapon5': '0.124', 'AMMO3': '0.226', 'AMMO4': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2024-08-06 05:58:55,885][52647] DAMAGECOUNT value on done: 735391.0 [2024-08-06 05:58:55,887][52647] Sum rewards: 59.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.495', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.120', 'AMMO3': '0.166', 'AMMO4': '0.181', 'weapon5': '0.248', 'weapon2': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.114', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '49.000'} [2024-08-06 05:58:56,259][52794] DAMAGECOUNT value on done: 693644.0 [2024-08-06 05:58:56,260][52794] Sum rewards: 74.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.921', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.150', 'weapon2': '0.158', 'AMMO4': '0.173', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.400', 'weapon3': '3.428', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '61.000'} [2024-08-06 05:58:56,451][52650] Updated weights for policy 0, policy_version 65311 (0.0016) [2024-08-06 05:58:56,789][52665] DAMAGECOUNT value on done: 693364.0 [2024-08-06 05:58:56,790][52665] Sum rewards: 80.796, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '69.000'} [2024-08-06 05:58:56,902][52667] DAMAGECOUNT value on done: 695487.0 [2024-08-06 05:58:56,902][52667] Sum rewards: 75.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon4': '0.144', 'weapon5': '0.204', 'AMMO3': '0.207', 'AMMO4': '0.337', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '63.000'} [2024-08-06 05:58:57,500][52659] DAMAGECOUNT value on done: 694366.0 [2024-08-06 05:58:57,500][52659] Sum rewards: 77.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.206', 'AMMO3': '0.209', 'weapon4': '0.254', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '65.000'} [2024-08-06 05:58:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 535052288. Throughput: 0: 4343.8. Samples: 133770390. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:58:57,794][52567] Avg episode reward: [(0, '74.369')] [2024-08-06 05:58:58,620][52647] DAMAGECOUNT value on done: 735071.0 [2024-08-06 05:58:58,628][52647] Sum rewards: 82.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.402', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.148', 'AMMO4': '0.181', 'AMMO3': '0.209', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.835', 'FRAGCOUNT': '66.000'} [2024-08-06 05:58:58,944][52794] DAMAGECOUNT value on done: 698228.0 [2024-08-06 05:58:58,944][52794] Sum rewards: 74.824, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.418', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.072', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.205', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 05:58:59,725][52667] DAMAGECOUNT value on done: 700573.0 [2024-08-06 05:58:59,725][52667] Sum rewards: 73.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.142', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.192', 'AMMO3': '0.203', 'weapon2': '0.268', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '59.000'} [2024-08-06 05:59:00,131][52665] DAMAGECOUNT value on done: 685623.0 [2024-08-06 05:59:00,132][52665] Sum rewards: 83.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.580', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.048', 'weapon4': '0.106', 'AMMO4': '0.124', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '3.212', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '69.000'} [2024-08-06 05:59:00,254][52663] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:59:00,294][52659] DAMAGECOUNT value on done: 702617.0 [2024-08-06 05:59:00,295][52659] Sum rewards: 61.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.723', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.078', 'weapon5': '0.176', 'weapon2': '0.222', 'AMMO3': '0.228', 'AMMO4': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.224', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '53.000'} [2024-08-06 05:59:01,098][52650] Updated weights for policy 0, policy_version 65321 (0.0017) [2024-08-06 05:59:01,743][52794] DAMAGECOUNT value on done: 686638.0 [2024-08-06 05:59:01,743][52794] Sum rewards: 69.285, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '57.000'} [2024-08-06 05:59:01,793][52647] DAMAGECOUNT value on done: 717761.0 [2024-08-06 05:59:01,793][52647] Sum rewards: 79.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.539', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.110', 'weapon4': '0.114', 'AMMO3': '0.225', 'AMMO4': '0.256', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '66.500'} [2024-08-06 05:59:02,313][52667] DAMAGECOUNT value on done: 703802.0 [2024-08-06 05:59:02,315][52667] Sum rewards: 69.588, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.898', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.160', 'weapon2': '0.178', 'AMMO4': '0.225', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.332', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 535134208. Throughput: 0: 4351.6. Samples: 133783800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:59:02,794][52567] Avg episode reward: [(0, '74.497')] [2024-08-06 05:59:03,159][52665] DAMAGECOUNT value on done: 694508.0 [2024-08-06 05:59:03,164][52665] Sum rewards: 77.300, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.565', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.132', 'AMMO3': '0.235', 'weapon5': '0.320', 'AMMO4': '0.327', 'weapon2': '0.346', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '65.000'} [2024-08-06 05:59:03,167][52659] DAMAGECOUNT value on done: 697410.0 [2024-08-06 05:59:03,171][52659] Sum rewards: 76.821, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.072', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.134', 'weapon5': '0.208', 'weapon2': '0.226', 'AMMO4': '0.240', 'AMMO3': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '2.000', 'weapon3': '3.104', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '21.012', 'FRAGCOUNT': '68.000'} [2024-08-06 05:59:03,975][52647] DAMAGECOUNT value on done: 733341.0 [2024-08-06 05:59:03,983][52647] Sum rewards: 63.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.165', 'weapon4': '0.166', 'AMMO4': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '50.500'} [2024-08-06 05:59:04,749][52794] DAMAGECOUNT value on done: 697867.0 [2024-08-06 05:59:04,750][52794] Sum rewards: 59.762, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.178', 'weapon4': '0.198', 'AMMO3': '0.220', 'AMMO4': '0.235', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '51.000'} [2024-08-06 05:59:05,547][52650] Updated weights for policy 0, policy_version 65331 (0.0014) [2024-08-06 05:59:05,746][52667] DAMAGECOUNT value on done: 694046.0 [2024-08-06 05:59:05,747][52667] Sum rewards: 78.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.757', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.098', 'AMMO4': '0.151', 'weapon2': '0.214', 'weapon5': '0.264', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '66.000'} [2024-08-06 05:59:06,224][52659] DAMAGECOUNT value on done: 701030.0 [2024-08-06 05:59:06,225][52659] Sum rewards: 70.130, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.485', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.126', 'AMMO3': '0.128', 'weapon5': '0.132', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '3.220', 'weapon3': '3.324', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:06,315][52665] DAMAGECOUNT value on done: 690572.0 [2024-08-06 05:59:06,316][52665] Sum rewards: 63.549, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.086', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.314', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.326', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '56.000'} [2024-08-06 05:59:06,729][52647] DAMAGECOUNT value on done: 731204.0 [2024-08-06 05:59:06,732][52647] Sum rewards: 71.414, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.094', 'AMMO4': '0.159', 'weapon5': '0.190', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:07,578][52794] DAMAGECOUNT value on done: 687547.0 [2024-08-06 05:59:07,579][52794] Sum rewards: 69.288, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.084', 'weapon4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.498', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 535224320. Throughput: 0: 4354.0. Samples: 133810100. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:59:07,794][52567] Avg episode reward: [(0, '74.381')] [2024-08-06 05:59:08,875][52667] DAMAGECOUNT value on done: 693838.0 [2024-08-06 05:59:08,875][52667] Sum rewards: 68.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.019', 'AMMO5': '0.026', 'AMMO2': '0.069', 'weapon2': '0.248', 'AMMO3': '0.279', 'weapon5': '0.310', 'AMMO4': '0.347', 'weapon4': '0.396', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.704', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:09,165][52659] DAMAGECOUNT value on done: 690092.0 [2024-08-06 05:59:09,168][52659] Sum rewards: 76.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.446', 'AMMO5': '0.005', 'weapon4': '0.038', 'AMMO2': '0.044', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.220', 'AMMO3': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.414', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '65.000'} [2024-08-06 05:59:09,320][52647] DAMAGECOUNT value on done: 729351.0 [2024-08-06 05:59:09,321][52647] Sum rewards: 74.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.082', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:09,393][52665] DAMAGECOUNT value on done: 689621.0 [2024-08-06 05:59:09,394][52665] Sum rewards: 68.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.413', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.182', 'AMMO3': '0.197', 'weapon2': '0.280', 'weapon4': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '57.000'} [2024-08-06 05:59:10,582][52650] Updated weights for policy 0, policy_version 65341 (0.0024) [2024-08-06 05:59:10,704][52794] DAMAGECOUNT value on done: 686905.0 [2024-08-06 05:59:10,704][52794] Sum rewards: 72.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.655', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.242', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.418', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '61.000'} [2024-08-06 05:59:11,729][52667] DAMAGECOUNT value on done: 699859.0 [2024-08-06 05:59:11,730][52667] Sum rewards: 70.474, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.770', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '3.176', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:12,201][52659] DAMAGECOUNT value on done: 701172.0 [2024-08-06 05:59:12,203][52659] Sum rewards: 75.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.022', 'AMMO2': '0.061', 'weapon4': '0.102', 'weapon5': '0.218', 'AMMO3': '0.266', 'AMMO4': '0.305', 'weapon2': '0.442', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.940', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '64.000'} [2024-08-06 05:59:12,264][52647] DAMAGECOUNT value on done: 721938.0 [2024-08-06 05:59:12,265][52647] Sum rewards: 74.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.232', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:12,697][52665] DAMAGECOUNT value on done: 684979.0 [2024-08-06 05:59:12,697][52665] Sum rewards: 85.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.602', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.098', 'AMMO3': '0.212', 'weapon5': '0.236', 'weapon2': '0.246', 'AMMO4': '0.274', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '69.000'} [2024-08-06 05:59:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 535306240. Throughput: 0: 4351.1. Samples: 133836160. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:59:12,795][52567] Avg episode reward: [(0, '73.956')] [2024-08-06 05:59:13,811][52794] DAMAGECOUNT value on done: 694387.0 [2024-08-06 05:59:13,811][52794] Sum rewards: 66.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.488', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.134', 'AMMO4': '0.148', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.124', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '54.000'} [2024-08-06 05:59:14,580][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:59:14,877][52659] DAMAGECOUNT value on done: 691263.0 [2024-08-06 05:59:14,878][52659] Sum rewards: 71.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.212', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.146', 'weapon2': '0.234', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon5': '0.348', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 05:59:14,979][52667] DAMAGECOUNT value on done: 690006.0 [2024-08-06 05:59:14,981][52667] Sum rewards: 78.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.152', 'AMMO4': '0.158', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '66.000'} [2024-08-06 05:59:15,102][52650] Updated weights for policy 0, policy_version 65351 (0.0026) [2024-08-06 05:59:15,289][52647] DAMAGECOUNT value on done: 737782.0 [2024-08-06 05:59:15,289][52647] Sum rewards: 77.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.052', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.258', 'weapon4': '0.272', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '65.000'} [2024-08-06 05:59:15,348][52665] DAMAGECOUNT value on done: 682508.0 [2024-08-06 05:59:15,349][52665] Sum rewards: 63.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.197', 'AMMO4': '0.197', 'weapon4': '0.224', 'weapon2': '0.232', 'weapon5': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.036', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 05:59:16,945][52794] DAMAGECOUNT value on done: 691302.0 [2024-08-06 05:59:16,946][52794] Sum rewards: 79.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.175', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.121', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '67.000'} [2024-08-06 05:59:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 535404544. Throughput: 0: 4356.0. Samples: 133849300. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 05:59:17,794][52567] Avg episode reward: [(0, '73.717')] [2024-08-06 05:59:18,098][52647] DAMAGECOUNT value on done: 724302.0 [2024-08-06 05:59:18,099][52647] Sum rewards: 68.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.056', 'weapon4': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '56.000'} [2024-08-06 05:59:18,171][52667] DAMAGECOUNT value on done: 698251.0 [2024-08-06 05:59:18,171][52667] Sum rewards: 67.167, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.045', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon2': '0.154', 'AMMO3': '0.164', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.378', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '53.000'} [2024-08-06 05:59:18,204][52665] DAMAGECOUNT value on done: 685411.0 [2024-08-06 05:59:18,205][52665] Sum rewards: 74.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.025', 'AMMO2': '0.054', 'AMMO3': '0.181', 'AMMO4': '0.271', 'weapon4': '0.280', 'weapon5': '0.366', 'weapon2': '0.522', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.536', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:19,685][52650] Updated weights for policy 0, policy_version 65361 (0.0013) [2024-08-06 05:59:19,921][52794] DAMAGECOUNT value on done: 705770.0 [2024-08-06 05:59:19,922][52794] Sum rewards: 86.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.420', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '70.000'} [2024-08-06 05:59:20,866][52667] DAMAGECOUNT value on done: 704253.0 [2024-08-06 05:59:20,866][52667] Sum rewards: 63.127, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.645', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.096', 'AMMO4': '0.128', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.194', 'DAMAGECOUNT': '14.829', 'FRAGCOUNT': '53.000'} [2024-08-06 05:59:20,969][52647] DAMAGECOUNT value on done: 733895.0 [2024-08-06 05:59:20,969][52647] Sum rewards: 80.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.991', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.158', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '68.000'} [2024-08-06 05:59:21,279][52665] DAMAGECOUNT value on done: 686555.0 [2024-08-06 05:59:21,279][52665] Sum rewards: 90.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.278', 'WEAPON3': '1.700', 'weapon3': '3.478', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.543', 'FRAGCOUNT': '77.000'} [2024-08-06 05:59:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 535486464. Throughput: 0: 4361.6. Samples: 133875470. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:22,794][52567] Avg episode reward: [(0, '73.705')] [2024-08-06 05:59:23,037][52794] DAMAGECOUNT value on done: 687772.0 [2024-08-06 05:59:23,039][52794] Sum rewards: 72.125, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.952', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.086', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'AMMO3': '0.271', 'WEAPON3': '1.550', 'HITCOUNT': '3.290', 'weapon3': '3.336', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:23,399][52667] DAMAGECOUNT value on done: 702718.0 [2024-08-06 05:59:23,401][52667] Sum rewards: 68.136, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.970', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.110', 'AMMO3': '0.283', 'weapon2': '0.284', 'AMMO4': '0.295', 'weapon5': '0.328', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.918', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.500'} [2024-08-06 05:59:23,903][52647] DAMAGECOUNT value on done: 735521.0 [2024-08-06 05:59:23,904][52647] Sum rewards: 79.214, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.465', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.386', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '64.000'} [2024-08-06 05:59:24,137][52665] DAMAGECOUNT value on done: 678958.0 [2024-08-06 05:59:24,141][52665] Sum rewards: 70.465, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.162', 'AMMO3': '0.234', 'weapon4': '0.236', 'AMMO4': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '60.500'} [2024-08-06 05:59:24,535][52663] DAMAGECOUNT value on done: 706300.0 [2024-08-06 05:59:24,537][52663] Sum rewards: 63.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO3': '0.161', 'AMMO4': '0.164', 'weapon4': '0.176', 'weapon2': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.740', 'weapon3': '3.266', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '50.000'} [2024-08-06 05:59:24,678][52650] Updated weights for policy 0, policy_version 65371 (0.0017) [2024-08-06 05:59:25,979][52667] DAMAGECOUNT value on done: 702417.0 [2024-08-06 05:59:25,979][52667] Sum rewards: 78.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.222', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.240', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '64.000'} [2024-08-06 05:59:26,079][52794] DAMAGECOUNT value on done: 700966.0 [2024-08-06 05:59:26,080][52794] Sum rewards: 77.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.838', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.140', 'weapon5': '0.148', 'AMMO4': '0.186', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '65.000'} [2024-08-06 05:59:26,374][52647] DAMAGECOUNT value on done: 719063.0 [2024-08-06 05:59:26,375][52647] Sum rewards: 85.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.354', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.112', 'weapon5': '0.132', 'AMMO4': '0.151', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.463', 'FRAGCOUNT': '67.000'} [2024-08-06 05:59:27,153][52665] DAMAGECOUNT value on done: 683631.0 [2024-08-06 05:59:27,154][52665] Sum rewards: 67.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.124', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon2': '0.224', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.272', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 05:59:27,685][52663] DAMAGECOUNT value on done: 693616.0 [2024-08-06 05:59:27,686][52663] Sum rewards: 77.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.196', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.130', 'weapon4': '0.198', 'weapon2': '0.226', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '66.000'} [2024-08-06 05:59:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 535568384. Throughput: 0: 4368.9. Samples: 133901540. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:27,794][52567] Avg episode reward: [(0, '73.575')] [2024-08-06 05:59:28,881][52667] DAMAGECOUNT value on done: 696185.0 [2024-08-06 05:59:28,882][52667] Sum rewards: 79.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.610', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.072', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.420', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '66.000'} [2024-08-06 05:59:29,145][52794] DAMAGECOUNT value on done: 695535.0 [2024-08-06 05:59:29,146][52794] Sum rewards: 66.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.170', 'AMMO3': '0.225', 'weapon4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.660', 'WEAPON3': '1.400', 'weapon3': '2.680', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:29,176][52650] Updated weights for policy 0, policy_version 65381 (0.0029) [2024-08-06 05:59:29,331][52647] DAMAGECOUNT value on done: 728085.0 [2024-08-06 05:59:29,331][52647] Sum rewards: 70.550, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.795', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.136', 'AMMO3': '0.180', 'AMMO4': '0.183', 'weapon5': '0.186', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.000'} [2024-08-06 05:59:30,330][52665] DAMAGECOUNT value on done: 687459.0 [2024-08-06 05:59:30,331][52665] Sum rewards: 71.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.080', 'AMMO4': '0.161', 'weapon5': '0.192', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.094', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:30,347][52663] DAMAGECOUNT value on done: 688256.0 [2024-08-06 05:59:30,347][52663] Sum rewards: 73.564, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.233', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.082', 'weapon5': '0.184', 'AMMO4': '0.251', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:31,585][52667] DAMAGECOUNT value on done: 704435.0 [2024-08-06 05:59:31,585][52667] Sum rewards: 77.000, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.075', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.126', 'weapon5': '0.204', 'weapon2': '0.232', 'AMMO3': '0.244', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '67.000'} [2024-08-06 05:59:31,694][52647] DAMAGECOUNT value on done: 718508.0 [2024-08-06 05:59:31,694][52647] Sum rewards: 70.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.848', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.130', 'weapon4': '0.134', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '58.000'} [2024-08-06 05:59:31,930][52794] DAMAGECOUNT value on done: 701059.0 [2024-08-06 05:59:31,930][52794] Sum rewards: 70.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.553', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.215', 'weapon2': '0.244', 'weapon5': '0.252', 'AMMO4': '0.262', 'weapon4': '0.288', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '59.000'} [2024-08-06 05:59:32,795][52567] Fps is (10 sec: 17202.2, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 535658496. Throughput: 0: 4368.8. Samples: 133914670. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:32,795][52567] Avg episode reward: [(0, '73.051')] [2024-08-06 05:59:32,910][52663] DAMAGECOUNT value on done: 693097.0 [2024-08-06 05:59:32,910][52663] Sum rewards: 78.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.893', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.158', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:33,874][52650] Updated weights for policy 0, policy_version 65391 (0.0012) [2024-08-06 05:59:34,423][52647] DAMAGECOUNT value on done: 724339.0 [2024-08-06 05:59:34,423][52647] Sum rewards: 74.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.648', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.106', 'weapon4': '0.166', 'AMMO4': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '61.000'} [2024-08-06 05:59:34,618][52794] DAMAGECOUNT value on done: 705640.0 [2024-08-06 05:59:34,618][52794] Sum rewards: 77.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.289', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.092', 'weapon2': '0.158', 'AMMO3': '0.213', 'AMMO4': '0.223', 'weapon5': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:35,857][52663] DAMAGECOUNT value on done: 696798.0 [2024-08-06 05:59:35,865][52663] Sum rewards: 84.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.130', 'weapon5': '0.154', 'AMMO3': '0.195', 'weapon2': '0.218', 'AMMO4': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '70.000'} [2024-08-06 05:59:36,406][52670] DAMAGECOUNT value on done: 685850.0 [2024-08-06 05:59:36,406][52670] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.352', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO4': '0.201', 'weapon2': '0.260', 'weapon5': '0.260', 'AMMO3': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.068', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '64.000'} [2024-08-06 05:59:37,245][52666] DAMAGECOUNT value on done: 696283.0 [2024-08-06 05:59:37,246][52666] Sum rewards: 79.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.315', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.174', 'weapon4': '0.196', 'AMMO3': '0.233', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '65.000'} [2024-08-06 05:59:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 535748608. Throughput: 0: 4369.6. Samples: 133940950. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:37,794][52567] Avg episode reward: [(0, '73.150')] [2024-08-06 05:59:37,879][52794] DAMAGECOUNT value on done: 696227.0 [2024-08-06 05:59:37,880][52794] Sum rewards: 79.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.182', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.078', 'weapon5': '0.172', 'AMMO3': '0.205', 'weapon2': '0.250', 'AMMO4': '0.275', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '65.500'} [2024-08-06 05:59:38,267][52650] Updated weights for policy 0, policy_version 65401 (0.0024) [2024-08-06 05:59:38,487][52663] DAMAGECOUNT value on done: 703301.0 [2024-08-06 05:59:38,489][52663] Sum rewards: 61.028, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.870', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.134', 'AMMO4': '0.213', 'weapon5': '0.214', 'AMMO3': '0.306', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'HITCOUNT': '2.900', 'weapon3': '2.960', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '55.500'} [2024-08-06 05:59:38,676][52658] DAMAGECOUNT value on done: 697127.0 [2024-08-06 05:59:38,676][52658] Sum rewards: 77.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.713', 'AMMO2': '0.023', 'AMMO5': '0.025', 'AMMO4': '0.114', 'weapon4': '0.176', 'AMMO3': '0.187', 'weapon5': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:39,119][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:59:39,233][52670] DAMAGECOUNT value on done: 696726.0 [2024-08-06 05:59:39,236][52670] Sum rewards: 66.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.088', 'weapon5': '0.130', 'AMMO3': '0.216', 'AMMO4': '0.276', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '57.000'} [2024-08-06 05:59:40,124][52666] DAMAGECOUNT value on done: 693942.0 [2024-08-06 05:59:40,124][52666] Sum rewards: 80.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.181', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.098', 'AMMO4': '0.107', 'weapon5': '0.174', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '65.000'} [2024-08-06 05:59:41,519][52663] DAMAGECOUNT value on done: 691249.0 [2024-08-06 05:59:41,520][52663] Sum rewards: 67.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.064', 'weapon4': '0.086', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:41,749][52658] DAMAGECOUNT value on done: 695544.0 [2024-08-06 05:59:41,750][52658] Sum rewards: 72.731, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.164', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.642', 'WEAPON3': '1.450', 'weapon3': '2.548', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '61.000'} [2024-08-06 05:59:42,080][52670] DAMAGECOUNT value on done: 684699.0 [2024-08-06 05:59:42,081][52670] Sum rewards: 71.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'weapon4': '0.234', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.174', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:42,794][52567] Fps is (10 sec: 18023.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 535838720. Throughput: 0: 4373.3. Samples: 133967190. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:42,794][52567] Avg episode reward: [(0, '73.043')] [2024-08-06 05:59:42,818][52666] DAMAGECOUNT value on done: 694818.0 [2024-08-06 05:59:42,818][52666] Sum rewards: 68.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.955', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.064', 'AMMO4': '0.186', 'AMMO3': '0.198', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.062', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:43,288][52650] Updated weights for policy 0, policy_version 65411 (0.0065) [2024-08-06 05:59:44,304][52663] DAMAGECOUNT value on done: 686337.0 [2024-08-06 05:59:44,330][52663] Sum rewards: 80.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.302', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.229', 'weapon4': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '67.000'} [2024-08-06 05:59:44,597][52670] DAMAGECOUNT value on done: 684377.0 [2024-08-06 05:59:44,600][52670] Sum rewards: 78.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.438', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.186', 'AMMO3': '0.188', 'weapon2': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.510', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:44,658][52658] DAMAGECOUNT value on done: 701619.0 [2024-08-06 05:59:44,661][52658] Sum rewards: 72.962, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.661', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon2': '0.180', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'HITCOUNT': '3.610', 'weapon3': '3.650', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:45,529][52666] DAMAGECOUNT value on done: 695930.0 [2024-08-06 05:59:45,530][52666] Sum rewards: 80.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.946', 'AMMO5': '0.013', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon4': '0.156', 'weapon5': '0.160', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '64.000'} [2024-08-06 05:59:46,372][52669] DAMAGECOUNT value on done: 697362.0 [2024-08-06 05:59:46,372][52669] Sum rewards: 69.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon5': '0.172', 'AMMO4': '0.262', 'AMMO3': '0.270', 'weapon4': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.842', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '58.000'} [2024-08-06 05:59:46,730][52663] DAMAGECOUNT value on done: 686999.0 [2024-08-06 05:59:46,739][52663] Sum rewards: 84.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.186', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.090', 'weapon4': '0.150', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '69.000'} [2024-08-06 05:59:47,508][52670] DAMAGECOUNT value on done: 694592.0 [2024-08-06 05:59:47,508][52670] Sum rewards: 77.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.559', 'AMMO5': '0.027', 'AMMO2': '0.072', 'AMMO3': '0.185', 'weapon2': '0.196', 'weapon5': '0.332', 'AMMO4': '0.361', 'weapon4': '0.422', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.758', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '64.500'} [2024-08-06 05:59:47,646][52658] DAMAGECOUNT value on done: 698933.0 [2024-08-06 05:59:47,646][52658] Sum rewards: 81.623, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.519', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.096', 'AMMO3': '0.179', 'AMMO4': '0.263', 'weapon5': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '64.000'} [2024-08-06 05:59:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 535920640. Throughput: 0: 4367.1. Samples: 133980320. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:47,794][52567] Avg episode reward: [(0, '73.573')] [2024-08-06 05:59:47,898][52650] Updated weights for policy 0, policy_version 65421 (0.0026) [2024-08-06 05:59:48,213][52666] DAMAGECOUNT value on done: 688048.0 [2024-08-06 05:59:48,213][52666] Sum rewards: 69.952, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.833', 'AMMO5': '0.014', 'ARMOR': '0.024', 'AMMO2': '0.030', 'weapon4': '0.136', 'AMMO4': '0.149', 'weapon5': '0.214', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.828', 'WEAPON3': '1.400', 'weapon3': '2.526', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:48,942][52669] DAMAGECOUNT value on done: 688329.0 [2024-08-06 05:59:48,942][52669] Sum rewards: 67.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.805', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO3': '0.183', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '56.000'} [2024-08-06 05:59:49,544][52663] DAMAGECOUNT value on done: 689184.0 [2024-08-06 05:59:49,545][52663] Sum rewards: 61.732, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.510', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.098', 'weapon2': '0.188', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.326', 'WEAPON3': '1.900', 'HITCOUNT': '3.150', 'weapon3': '3.370', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '58.000'} [2024-08-06 05:59:49,876][52670] DAMAGECOUNT value on done: 689742.0 [2024-08-06 05:59:49,876][52670] Sum rewards: 73.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.342', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.137', 'weapon5': '0.142', 'AMMO3': '0.179', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.484', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:50,089][52671] DAMAGECOUNT value on done: 697616.0 [2024-08-06 05:59:50,089][52671] Sum rewards: 71.382, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.680', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.140', 'AMMO4': '0.173', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:50,259][52658] DAMAGECOUNT value on done: 689227.0 [2024-08-06 05:59:50,260][52658] Sum rewards: 72.117, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.124', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '64.000'} [2024-08-06 05:59:50,722][52666] DAMAGECOUNT value on done: 689416.0 [2024-08-06 05:59:50,724][52666] Sum rewards: 73.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.884', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:52,222][52669] DAMAGECOUNT value on done: 700515.0 [2024-08-06 05:59:52,230][52669] Sum rewards: 79.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.016', 'AMMO4': '0.017', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.183', 'weapon2': '0.262', 'WEAPON3': '1.150', 'weapon3': '3.502', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '66.000'} [2024-08-06 05:59:52,514][52650] Updated weights for policy 0, policy_version 65431 (0.0045) [2024-08-06 05:59:52,528][52670] DAMAGECOUNT value on done: 682209.0 [2024-08-06 05:59:52,530][52670] Sum rewards: 70.248, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.072', 'weapon4': '0.102', 'AMMO4': '0.166', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:52,664][52663] DAMAGECOUNT value on done: 700536.0 [2024-08-06 05:59:52,666][52663] Sum rewards: 65.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.050', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.200', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.702', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '56.000'} [2024-08-06 05:59:52,789][52671] DAMAGECOUNT value on done: 701458.0 [2024-08-06 05:59:52,789][52671] Sum rewards: 76.950, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.014', 'AMMO2': '0.037', 'HEALTH': '0.122', 'weapon4': '0.172', 'AMMO3': '0.184', 'AMMO4': '0.187', 'weapon5': '0.198', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 536010752. Throughput: 0: 4360.7. Samples: 134006330. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:52,794][52567] Avg episode reward: [(0, '73.423')] [2024-08-06 05:59:53,148][52666] DAMAGECOUNT value on done: 690268.0 [2024-08-06 05:59:53,148][52666] Sum rewards: 77.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.524', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.160', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'weapon2': '0.376', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.500'} [2024-08-06 05:59:53,498][52658] DAMAGECOUNT value on done: 687705.0 [2024-08-06 05:59:53,500][52658] Sum rewards: 73.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.112', 'AMMO3': '0.209', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.498', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '60.000'} [2024-08-06 05:59:53,546][52794] Large shaping reward 2.506 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 05:59:55,253][52670] DAMAGECOUNT value on done: 689212.0 [2024-08-06 05:59:55,254][52670] Sum rewards: 73.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.106', 'WEAPON5': '0.150', 'weapon2': '0.184', 'weapon4': '0.214', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:55,353][52669] DAMAGECOUNT value on done: 696221.0 [2024-08-06 05:59:55,353][52669] Sum rewards: 66.097, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.702', 'AMMO5': '0.016', 'AMMO2': '0.070', 'weapon5': '0.188', 'weapon4': '0.296', 'AMMO3': '0.305', 'AMMO4': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.818', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '57.000'} [2024-08-06 05:59:55,574][52671] DAMAGECOUNT value on done: 698009.0 [2024-08-06 05:59:55,575][52671] Sum rewards: 67.196, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:55,739][52666] DAMAGECOUNT value on done: 684061.0 [2024-08-06 05:59:55,739][52666] Sum rewards: 73.515, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.605', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.182', 'AMMO4': '0.199', 'AMMO3': '0.233', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:55,937][52663] DAMAGECOUNT value on done: 686086.0 [2024-08-06 05:59:55,937][52663] Sum rewards: 67.939, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon2': '0.420', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.402', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '54.000'} [2024-08-06 05:59:56,207][52658] DAMAGECOUNT value on done: 701756.0 [2024-08-06 05:59:56,208][52658] Sum rewards: 73.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.492', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.130', 'weapon4': '0.132', 'AMMO4': '0.180', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.134', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 05:59:57,245][52650] Updated weights for policy 0, policy_version 65441 (0.0010) [2024-08-06 05:59:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 536100864. Throughput: 0: 4368.7. Samples: 134032750. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 05:59:57,795][52567] Avg episode reward: [(0, '73.521')] [2024-08-06 05:59:57,878][52670] DAMAGECOUNT value on done: 685126.0 [2024-08-06 05:59:57,886][52670] Sum rewards: 72.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon2': '0.180', 'weapon5': '0.216', 'AMMO3': '0.223', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '59.500'} [2024-08-06 05:59:58,398][52669] DAMAGECOUNT value on done: 697002.0 [2024-08-06 05:59:58,400][52669] Sum rewards: 75.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.014', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.126', 'weapon5': '0.154', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 05:59:58,736][52666] DAMAGECOUNT value on done: 693234.0 [2024-08-06 05:59:58,737][52666] Sum rewards: 66.323, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'weapon2': '0.928', 'WEAPON3': '1.050', 'weapon3': '2.404', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '53.000'} [2024-08-06 05:59:58,749][52671] DAMAGECOUNT value on done: 701598.0 [2024-08-06 05:59:58,750][52671] Sum rewards: 65.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon5': '0.142', 'AMMO3': '0.193', 'weapon4': '0.296', 'AMMO4': '0.320', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '55.000'} [2024-08-06 05:59:58,938][52658] DAMAGECOUNT value on done: 693040.0 [2024-08-06 05:59:58,938][52658] Sum rewards: 70.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.951', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.176', 'AMMO3': '0.181', 'weapon5': '0.184', 'AMMO4': '0.226', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '57.000'} [2024-08-06 05:59:59,000][52663] DAMAGECOUNT value on done: 681991.0 [2024-08-06 05:59:59,000][52663] Sum rewards: 71.161, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.020', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.148', 'weapon5': '0.202', 'weapon2': '0.286', 'AMMO3': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.114', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:01,033][52670] DAMAGECOUNT value on done: 683338.0 [2024-08-06 06:00:01,034][52670] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.252', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.488', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:01,662][52669] DAMAGECOUNT value on done: 700942.0 [2024-08-06 06:00:01,662][52669] Sum rewards: 76.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.308', 'WEAPON3': '1.200', 'weapon3': '3.348', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:01,683][52658] DAMAGECOUNT value on done: 711772.0 [2024-08-06 06:00:01,684][52658] Sum rewards: 64.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.102', 'AMMO4': '0.168', 'AMMO3': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '53.000'} [2024-08-06 06:00:01,729][52666] DAMAGECOUNT value on done: 686808.0 [2024-08-06 06:00:01,730][52666] Sum rewards: 79.254, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.244', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:02,072][52671] DAMAGECOUNT value on done: 708734.0 [2024-08-06 06:00:02,072][52671] Sum rewards: 72.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.336', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:02,095][52650] Updated weights for policy 0, policy_version 65451 (0.0011) [2024-08-06 06:00:02,327][52663] DAMAGECOUNT value on done: 690984.0 [2024-08-06 06:00:02,328][52663] Sum rewards: 92.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon5': '0.176', 'AMMO3': '0.199', 'AMMO4': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.266', 'FRAGCOUNT': '74.000'} [2024-08-06 06:00:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 536182784. Throughput: 0: 4367.8. Samples: 134045850. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:00:02,794][52567] Avg episode reward: [(0, '73.431')] [2024-08-06 06:00:04,071][52670] DAMAGECOUNT value on done: 694028.0 [2024-08-06 06:00:04,074][52670] Sum rewards: 77.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.138', 'AMMO3': '0.202', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.314', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:04,441][52658] DAMAGECOUNT value on done: 694957.0 [2024-08-06 06:00:04,443][52658] Sum rewards: 67.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.158', 'AMMO3': '0.171', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'weapon4': '0.324', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '55.000'} [2024-08-06 06:00:04,852][52666] DAMAGECOUNT value on done: 694848.0 [2024-08-06 06:00:04,852][52666] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.895', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.243', 'weapon2': '0.474', 'WEAPON3': '1.550', 'weapon3': '3.164', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:04,862][52669] DAMAGECOUNT value on done: 697077.0 [2024-08-06 06:00:04,862][52669] Sum rewards: 67.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.098', 'AMMO4': '0.163', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.636', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '57.000'} [2024-08-06 06:00:04,865][52671] DAMAGECOUNT value on done: 700273.0 [2024-08-06 06:00:04,865][52671] Sum rewards: 77.345, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.072', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.108', 'weapon4': '0.140', 'AMMO4': '0.165', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:05,484][52663] DAMAGECOUNT value on done: 686010.0 [2024-08-06 06:00:05,484][52663] Sum rewards: 78.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO4': '0.078', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:06,806][52650] Updated weights for policy 0, policy_version 65461 (0.0030) [2024-08-06 06:00:07,253][52658] DAMAGECOUNT value on done: 708822.0 [2024-08-06 06:00:07,256][52658] Sum rewards: 84.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.146', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.118', 'weapon5': '0.152', 'weapon2': '0.174', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '70.000'} [2024-08-06 06:00:07,258][52670] DAMAGECOUNT value on done: 679973.0 [2024-08-06 06:00:07,258][52670] Sum rewards: 78.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.369', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.182', 'AMMO3': '0.195', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:07,531][52671] DAMAGECOUNT value on done: 703455.0 [2024-08-06 06:00:07,532][52671] Sum rewards: 69.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.165', 'AMMO3': '0.192', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 06:00:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 536272896. Throughput: 0: 4367.1. Samples: 134071990. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:07,794][52567] Avg episode reward: [(0, '73.864')] [2024-08-06 06:00:07,868][52666] DAMAGECOUNT value on done: 683149.0 [2024-08-06 06:00:07,869][52666] Sum rewards: 81.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:08,181][52669] DAMAGECOUNT value on done: 698875.0 [2024-08-06 06:00:08,182][52669] Sum rewards: 75.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.017', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'weapon4': '0.168', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:08,884][52663] DAMAGECOUNT value on done: 700351.0 [2024-08-06 06:00:08,885][52663] Sum rewards: 74.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.227', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.059', 'weapon4': '0.080', 'weapon5': '0.148', 'AMMO3': '0.207', 'AMMO4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:09,708][52670] DAMAGECOUNT value on done: 690503.0 [2024-08-06 06:00:09,709][52670] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.432', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon4': '0.126', 'AMMO3': '0.243', 'weapon5': '0.252', 'AMMO4': '0.331', 'weapon2': '0.514', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.780', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:10,200][52658] DAMAGECOUNT value on done: 693803.0 [2024-08-06 06:00:10,200][52658] Sum rewards: 62.721, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.446', 'AMMO5': '0.031', 'AMMO2': '0.075', 'AMMO3': '0.247', 'weapon2': '0.260', 'weapon4': '0.326', 'weapon5': '0.338', 'AMMO4': '0.373', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '53.500'} [2024-08-06 06:00:10,365][52668] DAMAGECOUNT value on done: 693289.0 [2024-08-06 06:00:10,365][52668] Sum rewards: 69.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.375', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.054', 'weapon5': '0.132', 'AMMO4': '0.209', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '58.000'} [2024-08-06 06:00:10,393][52671] DAMAGECOUNT value on done: 701563.0 [2024-08-06 06:00:10,394][52671] Sum rewards: 80.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.304', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.170', 'weapon5': '0.184', 'AMMO3': '0.203', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:10,519][52666] DAMAGECOUNT value on done: 696152.0 [2024-08-06 06:00:10,522][52666] Sum rewards: 73.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.903', 'ARMOR': '0.012', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.194', 'AMMO3': '0.206', 'weapon5': '0.280', 'AMMO4': '0.287', 'weapon2': '0.310', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:11,244][52669] DAMAGECOUNT value on done: 705101.0 [2024-08-06 06:00:11,244][52669] Sum rewards: 86.365, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.054', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '73.000'} [2024-08-06 06:00:11,401][52650] Updated weights for policy 0, policy_version 65471 (0.0013) [2024-08-06 06:00:11,433][52647] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:00:11,965][52663] DAMAGECOUNT value on done: 694100.0 [2024-08-06 06:00:11,967][52663] Sum rewards: 75.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.103', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.056', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:12,574][52670] DAMAGECOUNT value on done: 695700.0 [2024-08-06 06:00:12,574][52670] Sum rewards: 80.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.903', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.160', 'AMMO4': '0.219', 'AMMO3': '0.239', 'weapon2': '0.262', 'weapon4': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '68.000'} [2024-08-06 06:00:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 536363008. Throughput: 0: 4370.7. Samples: 134098220. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:12,794][52567] Avg episode reward: [(0, '74.151')] [2024-08-06 06:00:12,887][52658] DAMAGECOUNT value on done: 699582.0 [2024-08-06 06:00:12,888][52658] Sum rewards: 64.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon2': '0.136', 'AMMO3': '0.194', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'weapon4': '0.612', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '52.500'} [2024-08-06 06:00:13,239][52668] DAMAGECOUNT value on done: 700200.0 [2024-08-06 06:00:13,239][52668] Sum rewards: 73.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.126', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:13,420][52671] DAMAGECOUNT value on done: 691527.0 [2024-08-06 06:00:13,423][52671] Sum rewards: 78.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.110', 'weapon4': '0.170', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:13,453][52666] DAMAGECOUNT value on done: 690317.0 [2024-08-06 06:00:13,455][52666] Sum rewards: 82.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.112', 'AMMO3': '0.194', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:14,223][52669] DAMAGECOUNT value on done: 699874.0 [2024-08-06 06:00:14,226][52669] Sum rewards: 73.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'weapon5': '0.042', 'AMMO2': '0.045', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:14,759][52663] DAMAGECOUNT value on done: 697224.0 [2024-08-06 06:00:14,759][52663] Sum rewards: 70.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.150', 'AMMO4': '0.220', 'AMMO3': '0.249', 'weapon2': '0.270', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'ARMOR': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '58.000'} [2024-08-06 06:00:15,079][52658] DAMAGECOUNT value on done: 690663.0 [2024-08-06 06:00:15,079][52658] Sum rewards: 66.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.193', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.146', 'weapon2': '0.154', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.476', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 06:00:15,685][52670] DAMAGECOUNT value on done: 691676.0 [2024-08-06 06:00:15,709][52670] Sum rewards: 70.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.070', 'weapon5': '0.082', 'AMMO4': '0.136', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.274', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:15,978][52650] Updated weights for policy 0, policy_version 65481 (0.0034) [2024-08-06 06:00:16,380][52668] DAMAGECOUNT value on done: 700888.0 [2024-08-06 06:00:16,382][52668] Sum rewards: 72.046, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.092', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon4': '0.244', 'weapon2': '0.760', 'WEAPON3': '1.200', 'weapon3': '2.734', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '57.000'} [2024-08-06 06:00:16,424][52671] DAMAGECOUNT value on done: 699367.0 [2024-08-06 06:00:16,425][52671] Sum rewards: 67.641, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.207', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '58.000'} [2024-08-06 06:00:16,498][52666] DAMAGECOUNT value on done: 692674.0 [2024-08-06 06:00:16,502][52666] Sum rewards: 66.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.066', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '54.500'} [2024-08-06 06:00:16,808][52669] DAMAGECOUNT value on done: 699912.0 [2024-08-06 06:00:16,809][52669] Sum rewards: 70.659, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.201', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.096', 'AMMO3': '0.142', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.686', 'WEAPON3': '0.950', 'weapon3': '2.926', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '55.000'} [2024-08-06 06:00:17,397][52663] DAMAGECOUNT value on done: 697302.0 [2024-08-06 06:00:17,398][52663] Sum rewards: 80.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.479', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon4': '0.252', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:17,405][52658] DAMAGECOUNT value on done: 700720.0 [2024-08-06 06:00:17,405][52658] Sum rewards: 77.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.438', 'AMMO5': '0.019', 'AMMO2': '0.070', 'weapon4': '0.140', 'AMMO3': '0.201', 'weapon5': '0.332', 'weapon2': '0.348', 'AMMO4': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 536453120. Throughput: 0: 4375.4. Samples: 134111560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:17,794][52567] Avg episode reward: [(0, '73.864')] [2024-08-06 06:00:18,661][52670] DAMAGECOUNT value on done: 674412.0 [2024-08-06 06:00:18,661][52670] Sum rewards: 80.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.858', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.080', 'AMMO4': '0.116', 'weapon5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:19,138][52668] DAMAGECOUNT value on done: 700100.0 [2024-08-06 06:00:19,140][52668] Sum rewards: 74.674, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.802', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.174', 'weapon2': '0.206', 'AMMO4': '0.228', 'weapon4': '0.274', 'AMMO3': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.032', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '67.000'} [2024-08-06 06:00:19,616][52666] DAMAGECOUNT value on done: 683806.0 [2024-08-06 06:00:19,617][52666] Sum rewards: 72.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.454', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.074', 'AMMO4': '0.145', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:19,758][52671] DAMAGECOUNT value on done: 701691.0 [2024-08-06 06:00:19,759][52671] Sum rewards: 62.388, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.330', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.128', 'weapon5': '0.222', 'AMMO4': '0.259', 'weapon2': '0.260', 'AMMO3': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.044', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '56.000'} [2024-08-06 06:00:19,802][52669] DAMAGECOUNT value on done: 705332.0 [2024-08-06 06:00:19,811][52669] Sum rewards: 73.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.434', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.488', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:20,357][52658] DAMAGECOUNT value on done: 686656.0 [2024-08-06 06:00:20,358][52658] Sum rewards: 78.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.006', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.108', 'AMMO3': '0.157', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:20,429][52663] DAMAGECOUNT value on done: 689627.0 [2024-08-06 06:00:20,429][52663] Sum rewards: 84.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.655', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.112', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'weapon5': '0.180', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.931', 'FRAGCOUNT': '68.000'} [2024-08-06 06:00:20,753][52650] Updated weights for policy 0, policy_version 65491 (0.0034) [2024-08-06 06:00:21,526][52668] DAMAGECOUNT value on done: 686566.0 [2024-08-06 06:00:21,526][52668] Sum rewards: 79.834, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO2': '0.004', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.171', 'weapon2': '0.354', 'WEAPON3': '1.100', 'weapon3': '3.440', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:21,757][52670] DAMAGECOUNT value on done: 686338.0 [2024-08-06 06:00:21,759][52670] Sum rewards: 76.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.201', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:22,145][52795] DAMAGECOUNT value on done: 647108.0 [2024-08-06 06:00:22,145][52795] Sum rewards: 75.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.976', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.192', 'AMMO4': '0.230', 'AMMO3': '0.236', 'weapon4': '0.258', 'weapon2': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:22,606][52671] DAMAGECOUNT value on done: 699503.0 [2024-08-06 06:00:22,606][52671] Sum rewards: 79.631, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.140', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon4': '0.368', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:22,764][52666] DAMAGECOUNT value on done: 687995.0 [2024-08-06 06:00:22,765][52666] Sum rewards: 69.936, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.885', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.176', 'AMMO4': '0.185', 'weapon4': '0.228', 'AMMO3': '0.261', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 536535040. Throughput: 0: 4378.0. Samples: 134137960. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:22,794][52567] Avg episode reward: [(0, '74.084')] [2024-08-06 06:00:23,083][52669] DAMAGECOUNT value on done: 690498.0 [2024-08-06 06:00:23,083][52669] Sum rewards: 78.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.486', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.181', 'weapon4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:23,412][52658] DAMAGECOUNT value on done: 700563.0 [2024-08-06 06:00:23,414][52658] Sum rewards: 68.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.173', 'weapon5': '0.174', 'weapon4': '0.218', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '55.000'} [2024-08-06 06:00:24,748][52670] DAMAGECOUNT value on done: 693427.0 [2024-08-06 06:00:24,749][52670] Sum rewards: 66.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.870', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.294', 'weapon4': '0.368', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '56.000'} [2024-08-06 06:00:24,851][52668] DAMAGECOUNT value on done: 703105.0 [2024-08-06 06:00:24,854][52668] Sum rewards: 74.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.148', 'weapon5': '0.180', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:25,140][52671] DAMAGECOUNT value on done: 705058.0 [2024-08-06 06:00:25,140][52671] Sum rewards: 71.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.078', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.129', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon4': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:25,269][52811] DAMAGECOUNT value on done: 664913.0 [2024-08-06 06:00:25,271][52811] Sum rewards: 86.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.495', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.248', 'weapon2': '0.294', 'WEAPON3': '1.650', 'weapon3': '3.530', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.177', 'FRAGCOUNT': '72.000'} [2024-08-06 06:00:25,398][52795] DAMAGECOUNT value on done: 634620.0 [2024-08-06 06:00:25,399][52795] Sum rewards: 73.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.041', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.116', 'AMMO4': '0.198', 'AMMO3': '0.206', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:25,420][52650] Updated weights for policy 0, policy_version 65501 (0.0032) [2024-08-06 06:00:25,473][52666] DAMAGECOUNT value on done: 700463.0 [2024-08-06 06:00:25,474][52666] Sum rewards: 74.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.442', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.130', 'AMMO3': '0.174', 'AMMO4': '0.232', 'weapon5': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:25,975][52820] DAMAGECOUNT value on done: 644595.0 [2024-08-06 06:00:25,979][52820] Sum rewards: 77.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.174', 'AMMO5': '0.006', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.098', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:26,096][52658] DAMAGECOUNT value on done: 692835.0 [2024-08-06 06:00:26,097][52658] Sum rewards: 72.997, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.222', 'AMMO3': '0.245', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '2.962', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:26,347][52669] DAMAGECOUNT value on done: 694998.0 [2024-08-06 06:00:26,347][52669] Sum rewards: 75.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.415', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.078', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.880', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:26,445][52614] Signal inference workers to stop experience collection... (11900 times) [2024-08-06 06:00:26,457][52614] Signal inference workers to resume experience collection... (11900 times) [2024-08-06 06:00:26,501][52650] InferenceWorker_p0-w0: stopping experience collection (11900 times) [2024-08-06 06:00:26,501][52650] InferenceWorker_p0-w0: resuming experience collection (11900 times) [2024-08-06 06:00:26,993][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:00:27,309][52670] DAMAGECOUNT value on done: 688971.0 [2024-08-06 06:00:27,309][52670] Sum rewards: 76.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.688', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:27,395][52659] Large shaping reward 2.742 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 06:00:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 536625152. Throughput: 0: 4379.1. Samples: 134164250. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:27,794][52567] Avg episode reward: [(0, '74.014')] [2024-08-06 06:00:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000065506_536625152.pth... [2024-08-06 06:00:27,918][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000064994_532430848.pth [2024-08-06 06:00:28,017][52668] DAMAGECOUNT value on done: 701639.0 [2024-08-06 06:00:28,017][52668] Sum rewards: 63.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.611', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.162', 'AMMO3': '0.212', 'AMMO4': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '53.000'} [2024-08-06 06:00:28,312][52666] DAMAGECOUNT value on done: 680560.0 [2024-08-06 06:00:28,313][52666] Sum rewards: 68.792, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '54.000'} [2024-08-06 06:00:28,320][52671] DAMAGECOUNT value on done: 699915.0 [2024-08-06 06:00:28,321][52671] Sum rewards: 59.682, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.130', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.161', 'weapon2': '0.336', 'WEAPON3': '1.000', 'HITCOUNT': '2.730', 'weapon3': '3.548', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '48.000'} [2024-08-06 06:00:28,453][52795] DAMAGECOUNT value on done: 634935.0 [2024-08-06 06:00:28,454][52795] Sum rewards: 61.986, reward structure: {'DEATHCOUNT': '-21.000', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.101', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.348', 'WEAPON3': '1.950', 'weapon3': '3.286', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '58.000'} [2024-08-06 06:00:28,505][52811] DAMAGECOUNT value on done: 643488.0 [2024-08-06 06:00:28,508][52811] Sum rewards: 82.288, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.424', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.090', 'AMMO3': '0.189', 'weapon5': '0.226', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:28,546][52658] DAMAGECOUNT value on done: 696533.0 [2024-08-06 06:00:28,547][52658] Sum rewards: 69.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.132', 'weapon5': '0.192', 'AMMO4': '0.197', 'AMMO3': '0.211', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:28,773][52669] DAMAGECOUNT value on done: 696832.0 [2024-08-06 06:00:28,775][52669] Sum rewards: 79.546, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.287', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.124', 'weapon4': '0.138', 'AMMO4': '0.176', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:29,351][52820] DAMAGECOUNT value on done: 644546.0 [2024-08-06 06:00:29,351][52820] Sum rewards: 69.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.144', 'weapon4': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.241', 'weapon2': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:29,957][52650] Updated weights for policy 0, policy_version 65511 (0.0011) [2024-08-06 06:00:30,148][52670] DAMAGECOUNT value on done: 693393.0 [2024-08-06 06:00:30,150][52670] Sum rewards: 72.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.410', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.118', 'AMMO4': '0.153', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:30,762][52666] DAMAGECOUNT value on done: 688113.0 [2024-08-06 06:00:30,763][52666] Sum rewards: 67.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.622', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.060', 'weapon5': '0.088', 'AMMO4': '0.116', 'weapon2': '0.146', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.506', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '55.000'} [2024-08-06 06:00:31,040][52668] DAMAGECOUNT value on done: 693079.0 [2024-08-06 06:00:31,042][52668] Sum rewards: 66.792, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.398', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.124', 'weapon5': '0.188', 'AMMO3': '0.236', 'AMMO4': '0.296', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '57.000'} [2024-08-06 06:00:31,046][52658] DAMAGECOUNT value on done: 697903.0 [2024-08-06 06:00:31,046][52658] Sum rewards: 72.122, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.127', 'weapon5': '0.182', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.286', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:31,232][52671] DAMAGECOUNT value on done: 687131.0 [2024-08-06 06:00:31,232][52671] Sum rewards: 72.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon2': '0.196', 'AMMO3': '0.210', 'weapon5': '0.230', 'AMMO4': '0.262', 'weapon4': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:31,607][52795] DAMAGECOUNT value on done: 644069.0 [2024-08-06 06:00:31,607][52795] Sum rewards: 62.551, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.022', 'AMMO2': '0.046', 'HEALTH': '0.063', 'AMMO3': '0.188', 'weapon5': '0.192', 'AMMO4': '0.232', 'weapon4': '0.240', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '51.000'} [2024-08-06 06:00:31,633][52811] DAMAGECOUNT value on done: 643769.0 [2024-08-06 06:00:31,633][52811] Sum rewards: 68.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.978', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.264', 'WEAPON3': '1.350', 'HITCOUNT': '3.390', 'weapon3': '3.536', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '58.000'} [2024-08-06 06:00:31,850][52669] DAMAGECOUNT value on done: 718403.0 [2024-08-06 06:00:31,852][52669] Sum rewards: 70.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.358', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:31,957][52663] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:00:32,493][52820] DAMAGECOUNT value on done: 645632.0 [2024-08-06 06:00:32,494][52820] Sum rewards: 62.970, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.763', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.250', 'AMMO4': '0.263', 'weapon4': '0.290', 'weapon5': '0.296', 'weapon2': '0.334', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.700', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '54.000'} [2024-08-06 06:00:32,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 536715264. Throughput: 0: 4375.8. Samples: 134177230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:32,795][52567] Avg episode reward: [(0, '73.200')] [2024-08-06 06:00:33,474][52668] DAMAGECOUNT value on done: 694120.0 [2024-08-06 06:00:33,482][52668] Sum rewards: 76.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.895', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.130', 'AMMO3': '0.167', 'AMMO4': '0.177', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:34,384][52671] DAMAGECOUNT value on done: 706354.0 [2024-08-06 06:00:34,384][52671] Sum rewards: 73.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.162', 'AMMO3': '0.196', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon5': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:34,697][52650] Updated weights for policy 0, policy_version 65521 (0.0027) [2024-08-06 06:00:34,726][52795] DAMAGECOUNT value on done: 637876.0 [2024-08-06 06:00:34,728][52795] Sum rewards: 82.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.407', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.198', 'AMMO4': '0.204', 'AMMO3': '0.205', 'weapon5': '0.374', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.708', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:34,774][52811] DAMAGECOUNT value on done: 645148.0 [2024-08-06 06:00:34,778][52811] Sum rewards: 75.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.193', 'weapon2': '0.756', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:34,991][52669] DAMAGECOUNT value on done: 706352.0 [2024-08-06 06:00:34,991][52669] Sum rewards: 84.214, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.784', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.068', 'weapon5': '0.182', 'AMMO4': '0.253', 'AMMO3': '0.256', 'weapon2': '0.288', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.708', 'FRAGCOUNT': '69.000'} [2024-08-06 06:00:35,010][52662] DAMAGECOUNT value on done: 700689.0 [2024-08-06 06:00:35,011][52662] Sum rewards: 74.433, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.812', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '3.398', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:35,524][52820] DAMAGECOUNT value on done: 637867.0 [2024-08-06 06:00:35,525][52820] Sum rewards: 81.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.656', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.156', 'AMMO4': '0.215', 'AMMO3': '0.241', 'weapon2': '0.248', 'weapon4': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '68.000'} [2024-08-06 06:00:36,355][52668] DAMAGECOUNT value on done: 702097.0 [2024-08-06 06:00:36,355][52668] Sum rewards: 72.487, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.610', 'AMMO5': '0.028', 'AMMO2': '0.069', 'weapon4': '0.120', 'weapon5': '0.202', 'weapon2': '0.246', 'AMMO3': '0.271', 'AMMO4': '0.345', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.650', 'weapon3': '3.138', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:37,318][52671] DAMAGECOUNT value on done: 704158.0 [2024-08-06 06:00:37,318][52671] Sum rewards: 73.652, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:37,694][52662] DAMAGECOUNT value on done: 702882.0 [2024-08-06 06:00:37,694][52662] Sum rewards: 75.777, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.649', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.444', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 536797184. Throughput: 0: 4381.3. Samples: 134203490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:37,796][52567] Avg episode reward: [(0, '73.656')] [2024-08-06 06:00:37,888][52811] DAMAGECOUNT value on done: 655738.0 [2024-08-06 06:00:37,889][52811] Sum rewards: 85.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.454', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '71.000'} [2024-08-06 06:00:37,958][52795] DAMAGECOUNT value on done: 648091.0 [2024-08-06 06:00:37,958][52795] Sum rewards: 81.608, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'HEALTH': '0.321', 'weapon2': '0.354', 'WEAPON3': '0.900', 'weapon3': '3.388', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:38,167][52669] DAMAGECOUNT value on done: 702817.0 [2024-08-06 06:00:38,168][52669] Sum rewards: 69.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.526', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.058', 'weapon5': '0.174', 'AMMO4': '0.234', 'AMMO3': '0.271', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.164', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:38,684][52820] DAMAGECOUNT value on done: 649214.0 [2024-08-06 06:00:38,692][52820] Sum rewards: 66.640, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.040', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO4': '0.215', 'weapon5': '0.244', 'weapon2': '0.290', 'AMMO3': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '2.000', 'weapon3': '3.044', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:39,564][52650] Updated weights for policy 0, policy_version 65531 (0.0025) [2024-08-06 06:00:39,598][52668] DAMAGECOUNT value on done: 698214.0 [2024-08-06 06:00:39,598][52668] Sum rewards: 60.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.126', 'weapon5': '0.126', 'AMMO4': '0.186', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '3.202', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '51.000'} [2024-08-06 06:00:40,141][52671] DAMAGECOUNT value on done: 703625.0 [2024-08-06 06:00:40,142][52671] Sum rewards: 69.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.078', 'weapon5': '0.198', 'AMMO3': '0.257', 'AMMO4': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.600', 'weapon3': '3.002', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '58.000'} [2024-08-06 06:00:40,474][52664] DAMAGECOUNT value on done: 722203.0 [2024-08-06 06:00:40,474][52664] Sum rewards: 86.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.098', 'weapon5': '0.134', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '71.000'} [2024-08-06 06:00:40,707][52662] DAMAGECOUNT value on done: 708156.0 [2024-08-06 06:00:40,710][52662] Sum rewards: 68.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.805', 'AMMO5': '0.008', 'weapon4': '0.042', 'AMMO2': '0.043', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.235', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '57.000'} [2024-08-06 06:00:40,838][52669] DAMAGECOUNT value on done: 702506.0 [2024-08-06 06:00:40,840][52669] Sum rewards: 73.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.096', 'weapon5': '0.134', 'AMMO3': '0.228', 'AMMO4': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:41,029][52811] DAMAGECOUNT value on done: 659306.0 [2024-08-06 06:00:41,030][52811] Sum rewards: 70.310, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.973', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon5': '0.148', 'AMMO3': '0.162', 'weapon2': '0.494', 'WEAPON3': '0.950', 'HITCOUNT': '3.090', 'weapon3': '3.128', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '56.000'} [2024-08-06 06:00:41,182][52795] DAMAGECOUNT value on done: 651069.0 [2024-08-06 06:00:41,182][52795] Sum rewards: 72.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.366', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.168', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '61.000'} [2024-08-06 06:00:41,820][52820] DAMAGECOUNT value on done: 635550.0 [2024-08-06 06:00:41,820][52820] Sum rewards: 66.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon4': '0.072', 'weapon5': '0.102', 'AMMO3': '0.200', 'AMMO4': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '56.000'} [2024-08-06 06:00:42,749][52664] DAMAGECOUNT value on done: 727784.0 [2024-08-06 06:00:42,750][52664] Sum rewards: 59.635, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.070', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'weapon2': '0.366', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.304', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '53.000'} [2024-08-06 06:00:42,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 536879104. Throughput: 0: 4377.8. Samples: 134229750. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:42,794][52567] Avg episode reward: [(0, '73.638')] [2024-08-06 06:00:42,815][52668] DAMAGECOUNT value on done: 689271.0 [2024-08-06 06:00:42,815][52668] Sum rewards: 66.400, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.955', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.144', 'AMMO3': '0.215', 'weapon5': '0.220', 'AMMO4': '0.226', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '2.996', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '55.000'} [2024-08-06 06:00:43,358][52658] Large shaping reward 2.536 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 06:00:43,381][52671] DAMAGECOUNT value on done: 703011.0 [2024-08-06 06:00:43,381][52671] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.962', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.234', 'weapon2': '0.244', 'weapon5': '0.292', 'weapon4': '0.304', 'AMMO4': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.824', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 06:00:43,500][52662] DAMAGECOUNT value on done: 692405.0 [2024-08-06 06:00:43,502][52662] Sum rewards: 73.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.201', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.064', 'weapon5': '0.178', 'AMMO3': '0.238', 'AMMO4': '0.267', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:43,974][52669] DAMAGECOUNT value on done: 707608.0 [2024-08-06 06:00:43,982][52669] Sum rewards: 66.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.112', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '54.000'} [2024-08-06 06:00:44,085][52811] DAMAGECOUNT value on done: 655279.0 [2024-08-06 06:00:44,086][52811] Sum rewards: 72.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.995', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.094', 'AMMO4': '0.222', 'AMMO3': '0.258', 'weapon2': '0.260', 'weapon5': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:44,219][52650] Updated weights for policy 0, policy_version 65541 (0.0017) [2024-08-06 06:00:44,283][52795] DAMAGECOUNT value on done: 643302.0 [2024-08-06 06:00:44,283][52795] Sum rewards: 77.256, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon5': '0.124', 'weapon4': '0.136', 'AMMO3': '0.162', 'AMMO4': '0.241', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:44,926][52820] DAMAGECOUNT value on done: 645137.0 [2024-08-06 06:00:44,926][52820] Sum rewards: 70.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.023', 'AMMO2': '0.055', 'AMMO3': '0.171', 'weapon4': '0.236', 'weapon5': '0.244', 'AMMO4': '0.277', 'weapon2': '0.512', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.752', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '54.500'} [2024-08-06 06:00:45,004][52794] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon3', 0.002)] [2024-08-06 06:00:45,448][52649] DAMAGECOUNT value on done: 675062.0 [2024-08-06 06:00:45,449][52649] Sum rewards: 79.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon2': '0.178', 'AMMO3': '0.187', 'weapon5': '0.200', 'AMMO4': '0.221', 'weapon4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:45,666][52664] DAMAGECOUNT value on done: 723640.0 [2024-08-06 06:00:45,667][52664] Sum rewards: 75.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.130', 'weapon5': '0.204', 'AMMO4': '0.221', 'AMMO3': '0.258', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.916', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:45,993][52668] DAMAGECOUNT value on done: 683483.0 [2024-08-06 06:00:45,995][52668] Sum rewards: 67.942, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.875', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon4': '0.060', 'weapon5': '0.158', 'weapon2': '0.164', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.274', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.432', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '56.000'} [2024-08-06 06:00:46,292][52662] DAMAGECOUNT value on done: 709645.0 [2024-08-06 06:00:46,294][52662] Sum rewards: 56.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.584', 'AMMO5': '0.028', 'AMMO2': '0.073', 'AMMO3': '0.260', 'weapon5': '0.356', 'weapon2': '0.366', 'AMMO4': '0.367', 'weapon4': '0.510', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.436', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '46.000'} [2024-08-06 06:00:46,436][52671] DAMAGECOUNT value on done: 697177.0 [2024-08-06 06:00:46,437][52671] Sum rewards: 64.399, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.726', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.376', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.858', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '50.000'} [2024-08-06 06:00:47,184][52811] DAMAGECOUNT value on done: 645852.0 [2024-08-06 06:00:47,185][52811] Sum rewards: 68.410, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.811', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.161', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:47,433][52795] DAMAGECOUNT value on done: 640546.0 [2024-08-06 06:00:47,433][52795] Sum rewards: 70.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.868', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.678', 'WEAPON3': '1.150', 'weapon3': '2.962', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '57.000'} [2024-08-06 06:00:47,603][52660] DAMAGECOUNT value on done: 698320.0 [2024-08-06 06:00:47,603][52660] Sum rewards: 57.413, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.188', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.121', 'weapon5': '0.142', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.182', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '50.000'} [2024-08-06 06:00:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 536977408. Throughput: 0: 4374.7. Samples: 134242710. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:47,794][52567] Avg episode reward: [(0, '72.506')] [2024-08-06 06:00:48,004][52820] DAMAGECOUNT value on done: 648168.0 [2024-08-06 06:00:48,008][52820] Sum rewards: 86.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.112', 'AMMO4': '0.142', 'weapon5': '0.146', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '70.000'} [2024-08-06 06:00:48,384][52668] DAMAGECOUNT value on done: 683281.0 [2024-08-06 06:00:48,385][52668] Sum rewards: 62.114, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.174', 'AMMO3': '0.192', 'weapon2': '0.210', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.460', 'weapon3': '3.138', 'DAMAGECOUNT': '13.770', 'FRAGCOUNT': '52.000'} [2024-08-06 06:00:48,399][52649] DAMAGECOUNT value on done: 669175.0 [2024-08-06 06:00:48,399][52649] Sum rewards: 80.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.758', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.132', 'AMMO4': '0.226', 'weapon5': '0.230', 'AMMO3': '0.238', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.886', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '67.000'} [2024-08-06 06:00:48,671][52664] DAMAGECOUNT value on done: 718247.0 [2024-08-06 06:00:48,672][52664] Sum rewards: 80.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.048', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '67.000'} [2024-08-06 06:00:48,729][52670] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:00:48,748][52650] Updated weights for policy 0, policy_version 65551 (0.0064) [2024-08-06 06:00:49,472][52662] DAMAGECOUNT value on done: 690809.0 [2024-08-06 06:00:49,480][52662] Sum rewards: 74.506, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.064', 'weapon4': '0.104', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.275', 'WEAPON3': '1.550', 'weapon3': '3.282', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:50,136][52811] DAMAGECOUNT value on done: 658062.0 [2024-08-06 06:00:50,136][52811] Sum rewards: 76.971, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.662', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO4': '0.218', 'weapon4': '0.220', 'AMMO3': '0.225', 'weapon5': '0.248', 'weapon2': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:50,181][52660] DAMAGECOUNT value on done: 686529.0 [2024-08-06 06:00:50,182][52660] Sum rewards: 80.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.022', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.270', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.512', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:50,539][52795] DAMAGECOUNT value on done: 648110.0 [2024-08-06 06:00:50,540][52795] Sum rewards: 81.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.815', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.173', 'weapon2': '0.266', 'weapon5': '0.266', 'AMMO4': '0.288', 'weapon4': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:51,092][52820] DAMAGECOUNT value on done: 644784.0 [2024-08-06 06:00:51,095][52820] Sum rewards: 73.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.108', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:51,225][52649] DAMAGECOUNT value on done: 687818.0 [2024-08-06 06:00:51,226][52649] Sum rewards: 71.717, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.846', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon4': '0.106', 'weapon5': '0.214', 'weapon2': '0.230', 'AMMO3': '0.239', 'AMMO4': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '62.000'} [2024-08-06 06:00:51,362][52668] DAMAGECOUNT value on done: 684310.0 [2024-08-06 06:00:51,365][52668] Sum rewards: 83.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.084', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '69.000'} [2024-08-06 06:00:51,437][52664] DAMAGECOUNT value on done: 729231.0 [2024-08-06 06:00:51,439][52664] Sum rewards: 84.834, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.148', 'AMMO3': '0.153', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'HEALTH': '0.425', 'WEAPON3': '0.900', 'weapon3': '3.066', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:52,175][52662] DAMAGECOUNT value on done: 699035.0 [2024-08-06 06:00:52,175][52662] Sum rewards: 70.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.056', 'AMMO4': '0.094', 'weapon4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 537059328. Throughput: 0: 4375.8. Samples: 134268900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:52,795][52567] Avg episode reward: [(0, '72.875')] [2024-08-06 06:00:53,339][52811] DAMAGECOUNT value on done: 652897.0 [2024-08-06 06:00:53,340][52811] Sum rewards: 74.706, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.108', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.116', 'weapon5': '0.188', 'AMMO3': '0.247', 'weapon2': '0.260', 'AMMO4': '0.290', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '66.000'} [2024-08-06 06:00:53,476][52650] Updated weights for policy 0, policy_version 65561 (0.0015) [2024-08-06 06:00:53,484][52660] DAMAGECOUNT value on done: 700492.0 [2024-08-06 06:00:53,486][52660] Sum rewards: 66.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.168', 'weapon5': '0.216', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '56.000'} [2024-08-06 06:00:53,726][52795] DAMAGECOUNT value on done: 642040.0 [2024-08-06 06:00:53,726][52795] Sum rewards: 78.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.545', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.124', 'AMMO4': '0.125', 'weapon5': '0.166', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 06:00:53,845][52664] DAMAGECOUNT value on done: 722054.0 [2024-08-06 06:00:53,845][52664] Sum rewards: 80.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.030', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.706', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:54,262][52820] DAMAGECOUNT value on done: 652273.0 [2024-08-06 06:00:54,262][52820] Sum rewards: 90.963, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.074', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.273', 'WEAPON3': '1.550', 'weapon3': '3.442', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.470', 'FRAGCOUNT': '76.000'} [2024-08-06 06:00:54,358][52662] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:00:54,423][52649] DAMAGECOUNT value on done: 682034.0 [2024-08-06 06:00:54,424][52649] Sum rewards: 68.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.140', 'AMMO3': '0.160', 'weapon5': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '55.000'} [2024-08-06 06:00:54,519][52668] DAMAGECOUNT value on done: 696272.0 [2024-08-06 06:00:54,527][52668] Sum rewards: 72.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.064', 'AMMO3': '0.212', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '59.000'} [2024-08-06 06:00:54,836][52662] DAMAGECOUNT value on done: 708077.0 [2024-08-06 06:00:54,837][52662] Sum rewards: 83.085, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.699', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.098', 'AMMO4': '0.133', 'AMMO3': '0.163', 'weapon5': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.934', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '64.000'} [2024-08-06 06:00:55,667][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:00:56,337][52811] DAMAGECOUNT value on done: 655678.0 [2024-08-06 06:00:56,338][52811] Sum rewards: 82.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.655', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.113', 'weapon5': '0.122', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '69.000'} [2024-08-06 06:00:56,454][52660] DAMAGECOUNT value on done: 707513.0 [2024-08-06 06:00:56,455][52660] Sum rewards: 73.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.041', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.134', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:56,572][52664] DAMAGECOUNT value on done: 718448.0 [2024-08-06 06:00:56,573][52664] Sum rewards: 70.439, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.359', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '56.000'} [2024-08-06 06:00:56,884][52795] DAMAGECOUNT value on done: 638858.0 [2024-08-06 06:00:56,884][52795] Sum rewards: 64.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon2': '0.190', 'AMMO3': '0.205', 'weapon5': '0.284', 'AMMO4': '0.307', 'weapon4': '0.314', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.700', 'weapon3': '2.912', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '53.000'} [2024-08-06 06:00:57,244][52668] DAMAGECOUNT value on done: 695397.0 [2024-08-06 06:00:57,245][52668] Sum rewards: 83.559, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.321', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.038', 'AMMO4': '0.097', 'weapon5': '0.158', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '67.000'} [2024-08-06 06:00:57,470][52820] DAMAGECOUNT value on done: 640346.0 [2024-08-06 06:00:57,471][52820] Sum rewards: 82.502, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.450', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.199', 'weapon4': '0.200', 'weapon5': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '66.500'} [2024-08-06 06:00:57,735][52649] DAMAGECOUNT value on done: 670568.0 [2024-08-06 06:00:57,735][52649] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.029', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.204', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.386', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '60.000'} [2024-08-06 06:00:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 537149440. Throughput: 0: 4373.6. Samples: 134295030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:00:57,794][52567] Avg episode reward: [(0, '73.310')] [2024-08-06 06:00:57,900][52662] DAMAGECOUNT value on done: 699339.0 [2024-08-06 06:00:57,901][52662] Sum rewards: 75.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.445', 'AMMO5': '0.009', 'weapon4': '0.044', 'AMMO2': '0.048', 'weapon5': '0.136', 'AMMO4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '65.000'} [2024-08-06 06:00:58,080][52650] Updated weights for policy 0, policy_version 65571 (0.0024) [2024-08-06 06:00:58,951][52660] DAMAGECOUNT value on done: 692023.0 [2024-08-06 06:00:58,953][52660] Sum rewards: 68.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.245', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.159', 'weapon5': '0.196', 'weapon2': '0.226', 'AMMO4': '0.251', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '57.000'} [2024-08-06 06:00:59,354][52664] DAMAGECOUNT value on done: 714747.0 [2024-08-06 06:00:59,354][52664] Sum rewards: 66.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO3': '0.183', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.306', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '55.000'} [2024-08-06 06:00:59,394][52811] DAMAGECOUNT value on done: 657732.0 [2024-08-06 06:00:59,394][52811] Sum rewards: 80.852, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.842', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.082', 'weapon4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.316', 'WEAPON3': '1.650', 'weapon3': '3.294', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '68.000'} [2024-08-06 06:00:59,616][52668] DAMAGECOUNT value on done: 693165.0 [2024-08-06 06:00:59,618][52668] Sum rewards: 68.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.314', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.020', 'AMMO4': '0.058', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.244', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.424', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '55.000'} [2024-08-06 06:01:00,012][52795] DAMAGECOUNT value on done: 637619.0 [2024-08-06 06:01:00,012][52795] Sum rewards: 63.527, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.692', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon4': '0.098', 'weapon5': '0.134', 'AMMO3': '0.210', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.240', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '51.000'} [2024-08-06 06:01:00,507][52820] DAMAGECOUNT value on done: 645951.0 [2024-08-06 06:01:00,507][52820] Sum rewards: 62.438, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.094', 'weapon5': '0.100', 'AMMO4': '0.193', 'weapon2': '0.232', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.308', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '54.000'} [2024-08-06 06:01:00,680][52662] DAMAGECOUNT value on done: 707842.0 [2024-08-06 06:01:00,682][52662] Sum rewards: 72.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.112', 'AMMO3': '0.200', 'weapon4': '0.212', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:01,171][52649] DAMAGECOUNT value on done: 686515.0 [2024-08-06 06:01:01,172][52649] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.180', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:01,692][52660] DAMAGECOUNT value on done: 688935.0 [2024-08-06 06:01:01,695][52660] Sum rewards: 63.520, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.230', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.126', 'weapon4': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.204', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:02,239][52664] DAMAGECOUNT value on done: 729286.0 [2024-08-06 06:01:02,239][52664] Sum rewards: 82.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.888', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.108', 'weapon5': '0.130', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.600', 'weapon3': '3.060', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '70.000'} [2024-08-06 06:01:02,346][52811] DAMAGECOUNT value on done: 652488.0 [2024-08-06 06:01:02,346][52811] Sum rewards: 76.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.945', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.162', 'weapon5': '0.162', 'AMMO3': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:02,453][52668] DAMAGECOUNT value on done: 701007.0 [2024-08-06 06:01:02,454][52668] Sum rewards: 68.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.266', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.062', 'AMMO4': '0.085', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.308', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 537231360. Throughput: 0: 4370.2. Samples: 134308220. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:01:02,794][52567] Avg episode reward: [(0, '72.763')] [2024-08-06 06:01:03,050][52650] Updated weights for policy 0, policy_version 65581 (0.0012) [2024-08-06 06:01:03,248][52795] DAMAGECOUNT value on done: 649187.0 [2024-08-06 06:01:03,252][52795] Sum rewards: 89.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.859', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.136', 'weapon5': '0.154', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '0.950', 'weapon3': '3.086', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '70.000'} [2024-08-06 06:01:03,479][52662] DAMAGECOUNT value on done: 693535.0 [2024-08-06 06:01:03,480][52662] Sum rewards: 77.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.329', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.112', 'AMMO4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:03,796][52820] DAMAGECOUNT value on done: 654923.0 [2024-08-06 06:01:03,797][52820] Sum rewards: 80.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.365', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:04,209][52660] DAMAGECOUNT value on done: 694375.0 [2024-08-06 06:01:04,209][52660] Sum rewards: 74.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.844', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.084', 'AMMO3': '0.174', 'AMMO4': '0.200', 'weapon2': '0.212', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.246', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.500'} [2024-08-06 06:01:04,223][52649] DAMAGECOUNT value on done: 679010.0 [2024-08-06 06:01:04,223][52649] Sum rewards: 70.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.625', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.127', 'weapon5': '0.130', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '57.500'} [2024-08-06 06:01:04,857][52664] DAMAGECOUNT value on done: 717520.0 [2024-08-06 06:01:04,865][52664] Sum rewards: 63.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.105', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.151', 'weapon5': '0.176', 'AMMO3': '0.257', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '2.970', 'weapon3': '3.196', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '54.000'} [2024-08-06 06:01:05,069][52668] DAMAGECOUNT value on done: 699150.0 [2024-08-06 06:01:05,069][52668] Sum rewards: 72.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO4': '0.211', 'weapon2': '0.214', 'weapon5': '0.228', 'AMMO3': '0.261', 'weapon4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '61.000'} [2024-08-06 06:01:05,483][52811] DAMAGECOUNT value on done: 650893.0 [2024-08-06 06:01:05,483][52811] Sum rewards: 76.814, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.429', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.041', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:05,757][52662] DAMAGECOUNT value on done: 695811.0 [2024-08-06 06:01:05,758][52662] Sum rewards: 66.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.770', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.108', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:06,292][52795] DAMAGECOUNT value on done: 633973.0 [2024-08-06 06:01:06,292][52795] Sum rewards: 86.675, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.000', 'weapon3': '3.158', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '69.000'} [2024-08-06 06:01:07,130][52820] DAMAGECOUNT value on done: 648795.0 [2024-08-06 06:01:07,134][52820] Sum rewards: 77.585, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.949', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.130', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO4': '0.274', 'AMMO3': '0.284', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '68.000'} [2024-08-06 06:01:07,208][52649] DAMAGECOUNT value on done: 681067.0 [2024-08-06 06:01:07,209][52649] Sum rewards: 58.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.854', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.245', 'weapon2': '0.406', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.108', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '51.000'} [2024-08-06 06:01:07,226][52660] DAMAGECOUNT value on done: 704278.0 [2024-08-06 06:01:07,227][52660] Sum rewards: 77.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.404', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:07,458][52650] Updated weights for policy 0, policy_version 65591 (0.0010) [2024-08-06 06:01:07,633][52664] DAMAGECOUNT value on done: 729503.0 [2024-08-06 06:01:07,634][52664] Sum rewards: 76.480, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon2': '0.348', 'WEAPON3': '0.950', 'weapon3': '3.466', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.000'} [2024-08-06 06:01:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 537329664. Throughput: 0: 4367.3. Samples: 134334490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:01:07,794][52567] Avg episode reward: [(0, '73.280')] [2024-08-06 06:01:08,356][52662] DAMAGECOUNT value on done: 693568.0 [2024-08-06 06:01:08,357][52662] Sum rewards: 75.951, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.162', 'AMMO3': '0.200', 'weapon4': '0.212', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'HEALTH': '0.307', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '61.000'} [2024-08-06 06:01:08,428][52803] DAMAGECOUNT value on done: 648664.0 [2024-08-06 06:01:08,428][52803] Sum rewards: 72.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.283', 'AMMO5': '0.018', 'AMMO2': '0.075', 'weapon4': '0.210', 'AMMO3': '0.228', 'weapon2': '0.260', 'weapon5': '0.290', 'AMMO4': '0.374', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.926', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:08,507][52811] DAMAGECOUNT value on done: 648972.0 [2024-08-06 06:01:08,508][52811] Sum rewards: 84.920, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.856', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO3': '0.143', 'AMMO4': '0.157', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:09,497][52795] DAMAGECOUNT value on done: 652502.0 [2024-08-06 06:01:09,497][52795] Sum rewards: 81.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:09,812][52649] DAMAGECOUNT value on done: 681969.0 [2024-08-06 06:01:09,815][52649] Sum rewards: 67.464, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.416', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.147', 'weapon5': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.305', 'weapon2': '0.362', 'WEAPON3': '1.750', 'weapon3': '3.084', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:10,110][52660] DAMAGECOUNT value on done: 688758.0 [2024-08-06 06:01:10,110][52660] Sum rewards: 73.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.410', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.114', 'weapon5': '0.146', 'AMMO3': '0.198', 'AMMO4': '0.218', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:10,422][52820] DAMAGECOUNT value on done: 651224.0 [2024-08-06 06:01:10,423][52820] Sum rewards: 66.015, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.054', 'weapon5': '0.166', 'AMMO3': '0.263', 'AMMO4': '0.270', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.970', 'weapon3': '3.248', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:10,653][52664] DAMAGECOUNT value on done: 728593.0 [2024-08-06 06:01:10,653][52664] Sum rewards: 66.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.700', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.056', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.000', 'HITCOUNT': '3.110', 'weapon3': '3.370', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '53.000'} [2024-08-06 06:01:10,693][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:01:11,212][52662] DAMAGECOUNT value on done: 702516.0 [2024-08-06 06:01:11,212][52662] Sum rewards: 70.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.148', 'weapon5': '0.156', 'AMMO4': '0.159', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:11,423][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:01:11,524][52803] DAMAGECOUNT value on done: 647796.0 [2024-08-06 06:01:11,524][52803] Sum rewards: 60.302, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.031', 'AMMO2': '0.060', 'weapon4': '0.142', 'HEALTH': '0.192', 'AMMO3': '0.208', 'weapon2': '0.248', 'weapon5': '0.292', 'AMMO4': '0.300', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'HITCOUNT': '2.680', 'weapon3': '2.998', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '53.000'} [2024-08-06 06:01:11,668][52811] DAMAGECOUNT value on done: 649706.0 [2024-08-06 06:01:11,669][52811] Sum rewards: 86.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.166', 'weapon2': '0.190', 'weapon5': '0.202', 'AMMO3': '0.248', 'AMMO4': '0.267', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '21.015', 'FRAGCOUNT': '72.000'} [2024-08-06 06:01:12,072][52650] Updated weights for policy 0, policy_version 65601 (0.0016) [2024-08-06 06:01:12,255][52649] DAMAGECOUNT value on done: 673866.0 [2024-08-06 06:01:12,257][52649] Sum rewards: 71.832, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.258', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.168', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.362', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:12,355][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:01:12,703][52795] DAMAGECOUNT value on done: 645416.0 [2024-08-06 06:01:12,703][52795] Sum rewards: 70.609, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.319', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.102', 'AMMO4': '0.129', 'weapon5': '0.180', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:12,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 537411584. Throughput: 0: 4371.1. Samples: 134360950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:01:12,795][52567] Avg episode reward: [(0, '73.347')] [2024-08-06 06:01:13,090][52660] DAMAGECOUNT value on done: 692629.0 [2024-08-06 06:01:13,090][52660] Sum rewards: 67.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.477', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.374', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '56.000'} [2024-08-06 06:01:13,637][52820] DAMAGECOUNT value on done: 647255.0 [2024-08-06 06:01:13,637][52820] Sum rewards: 63.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.422', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.096', 'weapon4': '0.136', 'AMMO3': '0.208', 'AMMO4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '53.000'} [2024-08-06 06:01:13,750][52664] DAMAGECOUNT value on done: 727997.0 [2024-08-06 06:01:13,751][52664] Sum rewards: 63.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.006', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon2': '0.188', 'weapon5': '0.210', 'AMMO4': '0.229', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.854', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '55.000'} [2024-08-06 06:01:14,181][52662] DAMAGECOUNT value on done: 692937.0 [2024-08-06 06:01:14,183][52662] Sum rewards: 76.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.494', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.096', 'AMMO4': '0.138', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '63.000'} [2024-08-06 06:01:14,623][52803] DAMAGECOUNT value on done: 654107.0 [2024-08-06 06:01:14,623][52803] Sum rewards: 76.741, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.147', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.141', 'weapon5': '0.224', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:14,790][52811] DAMAGECOUNT value on done: 653799.0 [2024-08-06 06:01:14,790][52811] Sum rewards: 82.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.464', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.462', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '67.000'} [2024-08-06 06:01:14,950][52649] DAMAGECOUNT value on done: 688152.0 [2024-08-06 06:01:14,954][52649] Sum rewards: 72.177, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.170', 'weapon2': '0.588', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:15,726][52795] DAMAGECOUNT value on done: 637648.0 [2024-08-06 06:01:15,726][52795] Sum rewards: 65.307, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.276', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon5': '0.184', 'AMMO4': '0.224', 'weapon4': '0.238', 'AMMO3': '0.272', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:16,234][52660] DAMAGECOUNT value on done: 698531.0 [2024-08-06 06:01:16,235][52660] Sum rewards: 67.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.876', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '3.410', 'weapon3': '3.444', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '55.000'} [2024-08-06 06:01:16,441][52664] DAMAGECOUNT value on done: 731885.0 [2024-08-06 06:01:16,442][52664] Sum rewards: 76.288, reward structure: {'DEATHCOUNT': '-22.500', 'HEALTH': '-2.064', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.086', 'weapon5': '0.222', 'weapon2': '0.242', 'AMMO4': '0.299', 'AMMO3': '0.349', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.950', 'weapon3': '3.066', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '69.000'} [2024-08-06 06:01:16,773][52820] DAMAGECOUNT value on done: 649086.0 [2024-08-06 06:01:16,776][52820] Sum rewards: 78.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.465', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.144', 'weapon4': '0.196', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:16,986][52650] Updated weights for policy 0, policy_version 65611 (0.0017) [2024-08-06 06:01:17,201][52662] DAMAGECOUNT value on done: 707511.0 [2024-08-06 06:01:17,206][52662] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.985', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO3': '0.192', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:17,788][52803] DAMAGECOUNT value on done: 654655.0 [2024-08-06 06:01:17,789][52803] Sum rewards: 75.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.082', 'weapon5': '0.090', 'AMMO4': '0.135', 'AMMO3': '0.151', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.000', 'weapon3': '3.308', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 537501696. Throughput: 0: 4376.0. Samples: 134374150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:01:17,794][52567] Avg episode reward: [(0, '73.012')] [2024-08-06 06:01:17,887][52811] DAMAGECOUNT value on done: 657179.0 [2024-08-06 06:01:17,888][52811] Sum rewards: 71.584, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.207', 'HEALTH': '0.330', 'weapon2': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.254', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:18,074][52649] DAMAGECOUNT value on done: 688947.0 [2024-08-06 06:01:18,074][52649] Sum rewards: 71.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.645', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.100', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '60.000'} [2024-08-06 06:01:18,877][52795] DAMAGECOUNT value on done: 645583.0 [2024-08-06 06:01:18,880][52795] Sum rewards: 64.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.490', 'AMMO5': '0.007', 'weapon4': '0.008', 'AMMO2': '0.012', 'weapon5': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.348', 'WEAPON3': '1.700', 'weapon3': '3.432', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '56.000'} [2024-08-06 06:01:19,044][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:01:19,332][52660] DAMAGECOUNT value on done: 690718.0 [2024-08-06 06:01:19,332][52660] Sum rewards: 66.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.473', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.071', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.262', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.496', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '55.000'} [2024-08-06 06:01:19,353][52664] DAMAGECOUNT value on done: 733185.0 [2024-08-06 06:01:19,354][52664] Sum rewards: 65.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.108', 'AMMO3': '0.227', 'AMMO4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '54.000'} [2024-08-06 06:01:20,043][52820] DAMAGECOUNT value on done: 659420.0 [2024-08-06 06:01:20,047][52820] Sum rewards: 80.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.865', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.160', 'weapon2': '0.210', 'AMMO4': '0.219', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:20,431][52662] DAMAGECOUNT value on done: 703791.0 [2024-08-06 06:01:20,431][52662] Sum rewards: 69.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.965', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.220', 'AMMO3': '0.224', 'weapon5': '0.224', 'AMMO4': '0.275', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:20,910][52803] DAMAGECOUNT value on done: 652716.0 [2024-08-06 06:01:20,919][52803] Sum rewards: 65.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.184', 'AMMO4': '0.201', 'weapon5': '0.208', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '52.000'} [2024-08-06 06:01:21,000][52811] DAMAGECOUNT value on done: 653677.0 [2024-08-06 06:01:21,002][52811] Sum rewards: 66.489, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.678', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.211', 'weapon4': '0.228', 'weapon2': '0.238', 'AMMO3': '0.303', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.190', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:21,312][52649] DAMAGECOUNT value on done: 688750.0 [2024-08-06 06:01:21,313][52649] Sum rewards: 74.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.112', 'AMMO5': '0.029', 'AMMO2': '0.078', 'weapon4': '0.166', 'AMMO3': '0.199', 'weapon5': '0.250', 'weapon2': '0.256', 'AMMO4': '0.388', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '61.000'} [2024-08-06 06:01:21,462][52650] Updated weights for policy 0, policy_version 65621 (0.0013) [2024-08-06 06:01:21,975][52795] DAMAGECOUNT value on done: 653227.0 [2024-08-06 06:01:21,976][52795] Sum rewards: 68.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.716', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.158', 'AMMO3': '0.227', 'AMMO4': '0.242', 'weapon5': '0.262', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '55.000'} [2024-08-06 06:01:22,179][52664] DAMAGECOUNT value on done: 727010.0 [2024-08-06 06:01:22,179][52664] Sum rewards: 78.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.141', 'weapon4': '0.184', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:22,253][52660] DAMAGECOUNT value on done: 695043.0 [2024-08-06 06:01:22,254][52660] Sum rewards: 73.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.184', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.302', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 537583616. Throughput: 0: 4376.0. Samples: 134400410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:01:22,795][52567] Avg episode reward: [(0, '73.026')] [2024-08-06 06:01:23,275][52820] DAMAGECOUNT value on done: 657029.0 [2024-08-06 06:01:23,277][52820] Sum rewards: 73.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.774', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:23,686][52649] DAMAGECOUNT value on done: 686043.0 [2024-08-06 06:01:23,686][52649] Sum rewards: 88.763, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.276', 'weapon4': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.336', 'FRAGCOUNT': '71.000'} [2024-08-06 06:01:23,712][52662] DAMAGECOUNT value on done: 688522.0 [2024-08-06 06:01:23,712][52662] Sum rewards: 74.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.060', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:23,932][52649] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:01:24,038][52803] DAMAGECOUNT value on done: 646923.0 [2024-08-06 06:01:24,040][52803] Sum rewards: 79.674, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.572', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon5': '0.232', 'weapon2': '0.464', 'WEAPON3': '1.000', 'weapon3': '3.072', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '64.000'} [2024-08-06 06:01:24,077][52811] DAMAGECOUNT value on done: 649802.0 [2024-08-06 06:01:24,077][52811] Sum rewards: 69.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.005', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.137', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.266', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.184', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:25,155][52660] DAMAGECOUNT value on done: 706498.0 [2024-08-06 06:01:25,157][52660] Sum rewards: 71.469, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.205', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:25,215][52664] DAMAGECOUNT value on done: 720061.0 [2024-08-06 06:01:25,216][52664] Sum rewards: 67.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.992', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.202', 'weapon5': '0.204', 'weapon2': '0.246', 'AMMO4': '0.285', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '2.986', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.500'} [2024-08-06 06:01:26,241][52650] Updated weights for policy 0, policy_version 65631 (0.0018) [2024-08-06 06:01:26,401][52820] DAMAGECOUNT value on done: 645580.0 [2024-08-06 06:01:26,403][52820] Sum rewards: 65.738, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.180', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'weapon4': '0.430', 'WEAPON3': '0.950', 'weapon3': '3.024', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '50.000'} [2024-08-06 06:01:26,564][52649] DAMAGECOUNT value on done: 672193.0 [2024-08-06 06:01:26,566][52649] Sum rewards: 74.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.146', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.220', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.458', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '63.000'} [2024-08-06 06:01:26,668][52662] DAMAGECOUNT value on done: 698223.0 [2024-08-06 06:01:26,669][52662] Sum rewards: 79.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.145', 'weapon4': '0.210', 'weapon5': '0.232', 'AMMO4': '0.268', 'weapon2': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.980', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '63.000'} [2024-08-06 06:01:27,174][52803] DAMAGECOUNT value on done: 644370.0 [2024-08-06 06:01:27,174][52803] Sum rewards: 59.592, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.865', 'AMMO5': '0.019', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.132', 'AMMO3': '0.202', 'weapon4': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.696', 'WEAPON3': '1.350', 'weapon3': '2.566', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '50.000'} [2024-08-06 06:01:27,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 537665536. Throughput: 0: 4376.6. Samples: 134426700. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:01:27,795][52567] Avg episode reward: [(0, '73.378')] [2024-08-06 06:01:28,037][52664] DAMAGECOUNT value on done: 723580.0 [2024-08-06 06:01:28,037][52664] Sum rewards: 71.797, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.784', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon2': '0.138', 'weapon5': '0.176', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:28,198][52660] DAMAGECOUNT value on done: 714345.0 [2024-08-06 06:01:28,200][52660] Sum rewards: 83.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.374', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.207', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.421', 'FRAGCOUNT': '67.000'} [2024-08-06 06:01:29,213][52649] DAMAGECOUNT value on done: 683054.0 [2024-08-06 06:01:29,214][52649] Sum rewards: 65.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.386', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '54.000'} [2024-08-06 06:01:29,349][52662] DAMAGECOUNT value on done: 690194.0 [2024-08-06 06:01:29,350][52662] Sum rewards: 73.874, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.754', 'AMMO5': '0.018', 'AMMO2': '0.070', 'weapon4': '0.202', 'AMMO3': '0.266', 'weapon2': '0.290', 'weapon5': '0.302', 'AMMO4': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.910', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:30,431][52803] DAMAGECOUNT value on done: 642133.0 [2024-08-06 06:01:30,431][52803] Sum rewards: 61.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.660', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.344', 'WEAPON3': '1.550', 'HITCOUNT': '2.890', 'weapon3': '3.458', 'DAMAGECOUNT': '14.532', 'FRAGCOUNT': '54.000'} [2024-08-06 06:01:30,501][52664] DAMAGECOUNT value on done: 722536.0 [2024-08-06 06:01:30,501][52664] Sum rewards: 68.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon2': '0.186', 'AMMO3': '0.200', 'AMMO4': '0.214', 'weapon5': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '56.000'} [2024-08-06 06:01:30,895][52650] Updated weights for policy 0, policy_version 65641 (0.0024) [2024-08-06 06:01:31,300][52659] DAMAGECOUNT value on done: 700993.0 [2024-08-06 06:01:31,310][52659] Sum rewards: 74.394, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.655', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO3': '0.119', 'AMMO4': '0.122', 'weapon4': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '0.900', 'weapon3': '3.150', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:31,393][52660] DAMAGECOUNT value on done: 693232.0 [2024-08-06 06:01:31,394][52660] Sum rewards: 78.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.610', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.221', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:32,054][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:01:32,404][52649] DAMAGECOUNT value on done: 672811.0 [2024-08-06 06:01:32,406][52649] Sum rewards: 63.537, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.551', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.082', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.556', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.108', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '51.000'} [2024-08-06 06:01:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 537763840. Throughput: 0: 4377.3. Samples: 134439690. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:01:32,794][52567] Avg episode reward: [(0, '72.805')] [2024-08-06 06:01:33,398][52664] DAMAGECOUNT value on done: 723116.0 [2024-08-06 06:01:33,398][52664] Sum rewards: 76.786, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.830', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.074', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.302', 'WEAPON3': '1.850', 'weapon3': '3.300', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:33,586][52803] DAMAGECOUNT value on done: 647125.0 [2024-08-06 06:01:33,587][52803] Sum rewards: 78.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.194', 'AMMO3': '0.222', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:34,458][52659] DAMAGECOUNT value on done: 699573.0 [2024-08-06 06:01:34,460][52659] Sum rewards: 81.635, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.024', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.110', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.694', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:34,529][52660] DAMAGECOUNT value on done: 701320.0 [2024-08-06 06:01:34,530][52660] Sum rewards: 66.150, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.402', 'AMMO5': '0.008', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.079', 'weapon5': '0.126', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.216', 'weapon4': '0.274', 'WEAPON3': '0.950', 'HITCOUNT': '3.050', 'weapon3': '3.234', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '52.000'} [2024-08-06 06:01:35,293][52649] DAMAGECOUNT value on done: 687656.0 [2024-08-06 06:01:35,294][52649] Sum rewards: 78.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.042', 'AMMO4': '0.175', 'weapon5': '0.178', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:35,721][52650] Updated weights for policy 0, policy_version 65651 (0.0024) [2024-08-06 06:01:36,770][52803] DAMAGECOUNT value on done: 646653.0 [2024-08-06 06:01:36,774][52803] Sum rewards: 63.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.394', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.124', 'weapon2': '0.148', 'AMMO4': '0.156', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.294', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 06:01:37,478][52660] DAMAGECOUNT value on done: 697537.0 [2024-08-06 06:01:37,478][52660] Sum rewards: 83.576, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.866', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.054', 'weapon5': '0.160', 'AMMO3': '0.191', 'AMMO4': '0.223', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '69.000'} [2024-08-06 06:01:37,571][52659] DAMAGECOUNT value on done: 700958.0 [2024-08-06 06:01:37,573][52659] Sum rewards: 72.348, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.797', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.149', 'weapon5': '0.172', 'weapon2': '0.174', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.346', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '61.000'} [2024-08-06 06:01:37,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 537853952. Throughput: 0: 4374.5. Samples: 134465750. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:01:37,795][52567] Avg episode reward: [(0, '72.582')] [2024-08-06 06:01:38,428][52649] DAMAGECOUNT value on done: 687433.0 [2024-08-06 06:01:38,430][52649] Sum rewards: 91.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.124', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.215', 'WEAPON3': '1.350', 'weapon3': '3.388', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.327', 'FRAGCOUNT': '75.000'} [2024-08-06 06:01:39,840][52803] DAMAGECOUNT value on done: 660618.0 [2024-08-06 06:01:39,840][52803] Sum rewards: 72.429, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.098', 'HEALTH': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.506', 'WEAPON3': '0.900', 'weapon3': '3.272', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:40,186][52660] DAMAGECOUNT value on done: 691924.0 [2024-08-06 06:01:40,188][52660] Sum rewards: 62.764, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.030', 'AMMO4': '0.031', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.538', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.160', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '51.000'} [2024-08-06 06:01:40,297][52650] Updated weights for policy 0, policy_version 65661 (0.0013) [2024-08-06 06:01:40,523][52659] DAMAGECOUNT value on done: 699332.0 [2024-08-06 06:01:40,524][52659] Sum rewards: 75.151, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.769', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.144', 'weapon5': '0.160', 'AMMO4': '0.258', 'AMMO3': '0.282', 'weapon2': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.030', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '67.000'} [2024-08-06 06:01:41,419][52647] DAMAGECOUNT value on done: 739931.0 [2024-08-06 06:01:41,419][52647] Sum rewards: 71.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.036', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon2': '0.148', 'weapon5': '0.148', 'AMMO4': '0.172', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.514', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '59.000'} [2024-08-06 06:01:41,578][52649] DAMAGECOUNT value on done: 681282.0 [2024-08-06 06:01:41,579][52649] Sum rewards: 79.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.438', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.132', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'weapon4': '0.268', 'WEAPON3': '1.100', 'weapon3': '3.168', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '63.000'} [2024-08-06 06:01:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 537935872. Throughput: 0: 4381.1. Samples: 134492180. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:01:42,794][52567] Avg episode reward: [(0, '72.655')] [2024-08-06 06:01:42,933][52803] DAMAGECOUNT value on done: 650774.0 [2024-08-06 06:01:42,934][52803] Sum rewards: 77.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.968', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.044', 'weapon5': '0.124', 'AMMO3': '0.208', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '63.000'} [2024-08-06 06:01:43,182][52659] DAMAGECOUNT value on done: 696156.0 [2024-08-06 06:01:43,182][52659] Sum rewards: 80.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.035', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO4': '0.176', 'weapon5': '0.186', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '68.500'} [2024-08-06 06:01:43,378][52660] DAMAGECOUNT value on done: 687314.0 [2024-08-06 06:01:43,378][52660] Sum rewards: 64.597, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.495', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.166', 'AMMO4': '0.170', 'weapon5': '0.206', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.878', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:43,403][52667] DAMAGECOUNT value on done: 699522.0 [2024-08-06 06:01:43,406][52667] Sum rewards: 75.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.138', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.172', 'AMMO3': '0.187', 'weapon2': '0.228', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.080', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:44,235][52647] DAMAGECOUNT value on done: 731400.0 [2024-08-06 06:01:44,236][52647] Sum rewards: 68.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.069', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.210', 'weapon5': '0.258', 'weapon2': '0.278', 'AMMO4': '0.286', 'weapon4': '0.504', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.632', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:45,097][52650] Updated weights for policy 0, policy_version 65671 (0.0011) [2024-08-06 06:01:45,989][52803] DAMAGECOUNT value on done: 649174.0 [2024-08-06 06:01:45,989][52803] Sum rewards: 69.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.392', 'weapon5': '0.522', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '55.000'} [2024-08-06 06:01:46,003][52659] DAMAGECOUNT value on done: 701496.0 [2024-08-06 06:01:46,004][52659] Sum rewards: 77.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.150', 'AMMO5': '0.009', 'weapon4': '0.046', 'AMMO2': '0.054', 'weapon5': '0.122', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.271', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.384', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '64.000'} [2024-08-06 06:01:46,105][52667] DAMAGECOUNT value on done: 706123.0 [2024-08-06 06:01:46,106][52667] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.679', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.216', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '61.000'} [2024-08-06 06:01:46,842][52647] DAMAGECOUNT value on done: 738611.0 [2024-08-06 06:01:46,843][52647] Sum rewards: 77.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.654', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '63.000'} [2024-08-06 06:01:47,801][52567] Fps is (10 sec: 16373.4, 60 sec: 17337.9, 300 sec: 17466.6). Total num frames: 538017792. Throughput: 0: 4372.9. Samples: 134505030. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:01:47,811][52567] Avg episode reward: [(0, '73.005')] [2024-08-06 06:01:48,157][52665] DAMAGECOUNT value on done: 683918.0 [2024-08-06 06:01:48,158][52665] Sum rewards: 73.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.145', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.179', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.370', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:49,093][52659] DAMAGECOUNT value on done: 699681.0 [2024-08-06 06:01:49,096][52659] Sum rewards: 76.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.065', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '64.000'} [2024-08-06 06:01:49,211][52667] DAMAGECOUNT value on done: 701180.0 [2024-08-06 06:01:49,213][52667] Sum rewards: 78.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.360', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.050', 'weapon3': '3.136', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '63.000'} [2024-08-06 06:01:49,270][52803] DAMAGECOUNT value on done: 661830.0 [2024-08-06 06:01:49,271][52803] Sum rewards: 65.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.244', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.084', 'weapon4': '0.116', 'AMMO4': '0.160', 'AMMO3': '0.188', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '54.500'} [2024-08-06 06:01:49,399][52647] DAMAGECOUNT value on done: 738799.0 [2024-08-06 06:01:49,399][52647] Sum rewards: 81.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.985', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.120', 'AMMO3': '0.185', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '67.000'} [2024-08-06 06:01:49,748][52650] Updated weights for policy 0, policy_version 65681 (0.0026) [2024-08-06 06:01:51,468][52665] DAMAGECOUNT value on done: 700662.0 [2024-08-06 06:01:51,468][52665] Sum rewards: 71.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.256', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.150', 'AMMO4': '0.228', 'AMMO3': '0.241', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '61.000'} [2024-08-06 06:01:51,765][52667] DAMAGECOUNT value on done: 705804.0 [2024-08-06 06:01:51,767][52667] Sum rewards: 91.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.304', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon4': '0.060', 'weapon2': '0.130', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'weapon3': '3.660', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.291', 'FRAGCOUNT': '75.000'} [2024-08-06 06:01:52,013][52647] DAMAGECOUNT value on done: 745021.0 [2024-08-06 06:01:52,013][52647] Sum rewards: 70.105, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.463', 'AMMO5': '0.021', 'AMMO2': '0.030', 'AMMO3': '0.117', 'AMMO4': '0.148', 'weapon4': '0.168', 'weapon5': '0.274', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '0.750', 'weapon3': '3.058', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '54.000'} [2024-08-06 06:01:52,082][52659] DAMAGECOUNT value on done: 695696.0 [2024-08-06 06:01:52,083][52659] Sum rewards: 81.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.476', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.138', 'AMMO4': '0.149', 'weapon2': '0.154', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.444', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '68.000'} [2024-08-06 06:01:52,225][52803] DAMAGECOUNT value on done: 648640.0 [2024-08-06 06:01:52,226][52803] Sum rewards: 62.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.190', 'AMMO3': '0.230', 'AMMO4': '0.245', 'weapon5': '0.268', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.890', 'weapon3': '2.914', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '54.000'} [2024-08-06 06:01:52,777][52794] DAMAGECOUNT value on done: 697916.0 [2024-08-06 06:01:52,777][52794] Sum rewards: 76.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.846', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon5': '0.202', 'AMMO3': '0.218', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '64.000'} [2024-08-06 06:01:52,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 538099712. Throughput: 0: 4368.7. Samples: 134531080. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:01:52,795][52567] Avg episode reward: [(0, '73.060')] [2024-08-06 06:01:54,264][52650] Updated weights for policy 0, policy_version 65691 (0.0013) [2024-08-06 06:01:54,286][52667] DAMAGECOUNT value on done: 704980.0 [2024-08-06 06:01:54,287][52667] Sum rewards: 78.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.930', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.136', 'AMMO4': '0.169', 'AMMO3': '0.190', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '65.000'} [2024-08-06 06:01:54,684][52665] DAMAGECOUNT value on done: 699592.0 [2024-08-06 06:01:54,684][52665] Sum rewards: 65.685, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.803', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.252', 'AMMO3': '0.276', 'weapon2': '0.390', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '58.000'} [2024-08-06 06:01:54,808][52647] DAMAGECOUNT value on done: 742349.0 [2024-08-06 06:01:54,808][52647] Sum rewards: 81.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.902', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.264', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.394', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:55,146][52659] DAMAGECOUNT value on done: 700884.0 [2024-08-06 06:01:55,149][52659] Sum rewards: 65.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.835', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.310', 'WEAPON3': '1.000', 'weapon3': '3.156', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '53.000'} [2024-08-06 06:01:55,296][52803] DAMAGECOUNT value on done: 650558.0 [2024-08-06 06:01:55,296][52803] Sum rewards: 79.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.428', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.272', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '64.000'} [2024-08-06 06:01:55,804][52794] DAMAGECOUNT value on done: 705288.0 [2024-08-06 06:01:55,806][52794] Sum rewards: 70.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.128', 'AMMO3': '0.241', 'AMMO4': '0.294', 'weapon2': '0.294', 'weapon5': '0.300', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '60.000'} [2024-08-06 06:01:57,299][52667] DAMAGECOUNT value on done: 707695.0 [2024-08-06 06:01:57,301][52667] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.835', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.096', 'weapon5': '0.102', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:57,408][52647] DAMAGECOUNT value on done: 741630.0 [2024-08-06 06:01:57,411][52647] Sum rewards: 75.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.422', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.144', 'AMMO4': '0.214', 'AMMO3': '0.225', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '62.000'} [2024-08-06 06:01:57,533][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:01:57,770][52665] DAMAGECOUNT value on done: 692948.0 [2024-08-06 06:01:57,770][52665] Sum rewards: 80.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'weapon4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.384', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '67.000'} [2024-08-06 06:01:57,794][52567] Fps is (10 sec: 18853.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 538206208. Throughput: 0: 4363.1. Samples: 134557290. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:01:57,794][52567] Avg episode reward: [(0, '73.049')] [2024-08-06 06:01:57,968][52659] DAMAGECOUNT value on done: 706348.0 [2024-08-06 06:01:57,976][52659] Sum rewards: 60.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.070', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.134', 'weapon5': '0.184', 'AMMO3': '0.253', 'AMMO4': '0.288', 'weapon2': '0.524', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.890', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '52.000'} [2024-08-06 06:01:58,426][52803] DAMAGECOUNT value on done: 654057.0 [2024-08-06 06:01:58,426][52803] Sum rewards: 68.943, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.108', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '57.000'} [2024-08-06 06:01:58,691][52794] DAMAGECOUNT value on done: 708789.0 [2024-08-06 06:01:58,691][52794] Sum rewards: 77.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.684', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO4': '0.195', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '66.000'} [2024-08-06 06:01:59,165][52650] Updated weights for policy 0, policy_version 65701 (0.0029) [2024-08-06 06:01:59,889][52665] DAMAGECOUNT value on done: 681051.0 [2024-08-06 06:01:59,890][52665] Sum rewards: 73.420, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.062', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:00,225][52667] DAMAGECOUNT value on done: 703929.0 [2024-08-06 06:02:00,226][52667] Sum rewards: 79.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.805', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.158', 'weapon4': '0.162', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '66.000'} [2024-08-06 06:02:00,492][52647] DAMAGECOUNT value on done: 724423.0 [2024-08-06 06:02:00,494][52647] Sum rewards: 82.088, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.024', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.070', 'AMMO4': '0.105', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '67.000'} [2024-08-06 06:02:00,719][52659] DAMAGECOUNT value on done: 693581.0 [2024-08-06 06:02:00,719][52659] Sum rewards: 75.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.488', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.090', 'weapon5': '0.178', 'weapon2': '0.184', 'AMMO3': '0.265', 'AMMO4': '0.269', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.290', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '64.000'} [2024-08-06 06:02:01,539][52803] DAMAGECOUNT value on done: 655711.0 [2024-08-06 06:02:01,539][52803] Sum rewards: 68.886, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.220', 'AMMO5': '0.021', 'AMMO2': '0.037', 'weapon4': '0.076', 'AMMO3': '0.168', 'weapon5': '0.186', 'AMMO4': '0.188', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.156', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2024-08-06 06:02:01,544][52794] DAMAGECOUNT value on done: 693647.0 [2024-08-06 06:02:01,544][52794] Sum rewards: 72.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.213', 'AMMO3': '0.232', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '62.000'} [2024-08-06 06:02:02,730][52665] DAMAGECOUNT value on done: 686646.0 [2024-08-06 06:02:02,730][52665] Sum rewards: 82.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.388', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.120', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.350', 'weapon4': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '67.000'} [2024-08-06 06:02:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 538279936. Throughput: 0: 4369.3. Samples: 134570770. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:02:02,795][52567] Avg episode reward: [(0, '73.146')] [2024-08-06 06:02:03,119][52649] Large shaping reward -2.530 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28200000000000003, -94.0), ('weapon5', 0.002)] [2024-08-06 06:02:03,268][52667] DAMAGECOUNT value on done: 701827.0 [2024-08-06 06:02:03,268][52667] Sum rewards: 70.866, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.705', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.088', 'AMMO4': '0.140', 'weapon5': '0.182', 'weapon2': '0.252', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.174', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:03,278][52659] DAMAGECOUNT value on done: 705048.0 [2024-08-06 06:02:03,280][52659] Sum rewards: 70.675, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon4': '0.194', 'AMMO3': '0.209', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '59.000'} [2024-08-06 06:02:03,517][52647] DAMAGECOUNT value on done: 739586.0 [2024-08-06 06:02:03,517][52647] Sum rewards: 77.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.859', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.090', 'weapon5': '0.174', 'AMMO4': '0.192', 'AMMO3': '0.230', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.000'} [2024-08-06 06:02:03,940][52650] Updated weights for policy 0, policy_version 65711 (0.0011) [2024-08-06 06:02:04,382][52794] DAMAGECOUNT value on done: 695591.0 [2024-08-06 06:02:04,384][52794] Sum rewards: 70.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.862', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon5': '0.214', 'AMMO3': '0.246', 'weapon4': '0.262', 'AMMO4': '0.274', 'weapon2': '0.428', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:04,631][52803] DAMAGECOUNT value on done: 660281.0 [2024-08-06 06:02:04,632][52803] Sum rewards: 69.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon4': '0.134', 'AMMO3': '0.197', 'weapon2': '0.318', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.342', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '58.000'} [2024-08-06 06:02:05,651][52665] DAMAGECOUNT value on done: 691588.0 [2024-08-06 06:02:05,653][52665] Sum rewards: 66.578, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.562', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.100', 'AMMO3': '0.115', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.146', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'weapon4': '0.542', 'WEAPON3': '0.800', 'weapon3': '2.650', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '52.000'} [2024-08-06 06:02:06,045][52659] DAMAGECOUNT value on done: 696280.0 [2024-08-06 06:02:06,046][52659] Sum rewards: 72.858, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.675', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.122', 'AMMO3': '0.148', 'weapon5': '0.170', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.618', 'WEAPON3': '0.950', 'weapon3': '2.858', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 06:02:06,208][52647] DAMAGECOUNT value on done: 736963.0 [2024-08-06 06:02:06,209][52647] Sum rewards: 74.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.122', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.256', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '62.000'} [2024-08-06 06:02:06,234][52667] DAMAGECOUNT value on done: 706533.0 [2024-08-06 06:02:06,234][52667] Sum rewards: 71.434, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.790', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.261', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.324', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '63.000'} [2024-08-06 06:02:07,357][52794] DAMAGECOUNT value on done: 699470.0 [2024-08-06 06:02:07,360][52794] Sum rewards: 69.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.215', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.179', 'weapon5': '0.184', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '55.000'} [2024-08-06 06:02:07,629][52803] DAMAGECOUNT value on done: 652703.0 [2024-08-06 06:02:07,632][52803] Sum rewards: 79.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.595', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'weapon4': '0.054', 'AMMO4': '0.069', 'weapon2': '0.202', 'AMMO3': '0.267', 'WEAPON3': '1.700', 'weapon3': '3.586', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '67.000'} [2024-08-06 06:02:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 538378240. Throughput: 0: 4369.6. Samples: 134597040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:07,795][52567] Avg episode reward: [(0, '73.380')] [2024-08-06 06:02:08,318][52650] Updated weights for policy 0, policy_version 65721 (0.0013) [2024-08-06 06:02:08,723][52647] DAMAGECOUNT value on done: 735215.0 [2024-08-06 06:02:08,723][52647] Sum rewards: 69.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.241', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.400', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '58.000'} [2024-08-06 06:02:08,740][52665] DAMAGECOUNT value on done: 690000.0 [2024-08-06 06:02:08,743][52665] Sum rewards: 73.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.260', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.290', 'weapon2': '0.456', 'WEAPON3': '1.800', 'weapon3': '3.298', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 06:02:08,793][52659] DAMAGECOUNT value on done: 700305.0 [2024-08-06 06:02:08,793][52659] Sum rewards: 71.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.164', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.240', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '59.000'} [2024-08-06 06:02:08,954][52667] DAMAGECOUNT value on done: 710103.0 [2024-08-06 06:02:08,956][52667] Sum rewards: 76.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '63.000'} [2024-08-06 06:02:10,427][52794] DAMAGECOUNT value on done: 703993.0 [2024-08-06 06:02:10,430][52794] Sum rewards: 67.664, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.708', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.126', 'AMMO3': '0.148', 'weapon2': '0.204', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'weapon3': '3.272', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '52.000'} [2024-08-06 06:02:11,079][52647] DAMAGECOUNT value on done: 728244.0 [2024-08-06 06:02:11,079][52647] Sum rewards: 76.356, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.632', 'AMMO5': '0.006', 'AMMO2': '0.041', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO4': '0.203', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '62.000'} [2024-08-06 06:02:11,749][52659] DAMAGECOUNT value on done: 708150.0 [2024-08-06 06:02:11,749][52659] Sum rewards: 71.749, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.171', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.164', 'weapon5': '0.184', 'AMMO4': '0.190', 'weapon2': '0.196', 'weapon4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.154', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '57.000'} [2024-08-06 06:02:11,785][52665] DAMAGECOUNT value on done: 698945.0 [2024-08-06 06:02:11,786][52665] Sum rewards: 72.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.630', 'AMMO5': '0.011', 'weapon4': '0.030', 'AMMO2': '0.043', 'weapon5': '0.098', 'WEAPON4': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.272', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.390', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '64.000'} [2024-08-06 06:02:11,817][52667] DAMAGECOUNT value on done: 700043.0 [2024-08-06 06:02:11,817][52667] Sum rewards: 64.950, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.990', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO4': '0.205', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.174', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '53.500'} [2024-08-06 06:02:12,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 538451968. Throughput: 0: 4377.5. Samples: 134623690. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:12,796][52567] Avg episode reward: [(0, '73.380')] [2024-08-06 06:02:13,056][52650] Updated weights for policy 0, policy_version 65731 (0.0012) [2024-08-06 06:02:13,494][52794] DAMAGECOUNT value on done: 691810.0 [2024-08-06 06:02:13,496][52794] Sum rewards: 63.383, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.525', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.168', 'AMMO4': '0.171', 'weapon5': '0.194', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 06:02:13,765][52647] DAMAGECOUNT value on done: 743436.0 [2024-08-06 06:02:13,773][52647] Sum rewards: 72.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon5': '0.052', 'weapon4': '0.056', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.126', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:14,419][52667] DAMAGECOUNT value on done: 700280.0 [2024-08-06 06:02:14,420][52667] Sum rewards: 82.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.158', 'AMMO3': '0.197', 'AMMO4': '0.198', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '67.000'} [2024-08-06 06:02:14,482][52665] DAMAGECOUNT value on done: 692574.0 [2024-08-06 06:02:14,483][52665] Sum rewards: 89.352, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.070', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon2': '0.242', 'AMMO3': '0.324', 'WEAPON3': '1.900', 'weapon3': '3.556', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.853', 'FRAGCOUNT': '79.000'} [2024-08-06 06:02:14,727][52659] DAMAGECOUNT value on done: 703099.0 [2024-08-06 06:02:14,728][52659] Sum rewards: 71.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.196', 'weapon4': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:16,600][52647] DAMAGECOUNT value on done: 728423.0 [2024-08-06 06:02:16,600][52647] Sum rewards: 54.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon7': '0.174', 'AMMO3': '0.187', 'WEAPON7': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.384', 'weapon4': '0.724', 'WEAPON3': '1.100', 'weapon3': '2.282', 'HITCOUNT': '2.510', 'DAMAGECOUNT': '12.363', 'FRAGCOUNT': '47.000'} [2024-08-06 06:02:16,705][52794] DAMAGECOUNT value on done: 702840.0 [2024-08-06 06:02:16,707][52794] Sum rewards: 66.316, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.742', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.131', 'AMMO4': '0.154', 'weapon4': '0.222', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '0.800', 'HITCOUNT': '2.850', 'weapon3': '2.938', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2024-08-06 06:02:17,031][52667] DAMAGECOUNT value on done: 706577.0 [2024-08-06 06:02:17,032][52667] Sum rewards: 82.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.095', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.068', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '70.000'} [2024-08-06 06:02:17,713][52665] DAMAGECOUNT value on done: 701438.0 [2024-08-06 06:02:17,718][52665] Sum rewards: 85.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.024', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '69.000'} [2024-08-06 06:02:17,770][52650] Updated weights for policy 0, policy_version 65741 (0.0012) [2024-08-06 06:02:17,784][52659] DAMAGECOUNT value on done: 707672.0 [2024-08-06 06:02:17,784][52659] Sum rewards: 78.369, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.648', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.162', 'weapon2': '0.250', 'AMMO3': '0.287', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '2.928', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '68.000'} [2024-08-06 06:02:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 538550272. Throughput: 0: 4378.0. Samples: 134636700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:17,794][52567] Avg episode reward: [(0, '73.491')] [2024-08-06 06:02:19,513][52647] DAMAGECOUNT value on done: 740220.0 [2024-08-06 06:02:19,521][52647] Sum rewards: 73.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.049', 'AMMO5': '0.025', 'AMMO2': '0.109', 'weapon4': '0.124', 'weapon2': '0.206', 'AMMO3': '0.243', 'weapon5': '0.276', 'AMMO4': '0.544', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:19,681][52667] DAMAGECOUNT value on done: 695359.0 [2024-08-06 06:02:19,681][52667] Sum rewards: 61.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '51.000'} [2024-08-06 06:02:19,964][52794] DAMAGECOUNT value on done: 693378.0 [2024-08-06 06:02:19,964][52794] Sum rewards: 67.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.163', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.182', 'weapon2': '0.252', 'AMMO4': '0.262', 'AMMO3': '0.263', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.504', 'WEAPON3': '1.550', 'weapon3': '2.758', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '57.000'} [2024-08-06 06:02:20,621][52665] DAMAGECOUNT value on done: 697476.0 [2024-08-06 06:02:20,621][52665] Sum rewards: 81.484, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.280', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.124', 'weapon5': '0.224', 'weapon2': '0.268', 'AMMO4': '0.273', 'AMMO3': '0.286', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.052', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '72.000'} [2024-08-06 06:02:20,913][52820] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:02:20,947][52659] DAMAGECOUNT value on done: 695961.0 [2024-08-06 06:02:20,949][52659] Sum rewards: 74.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.598', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:22,255][52647] DAMAGECOUNT value on done: 742361.0 [2024-08-06 06:02:22,256][52647] Sum rewards: 79.216, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.811', 'AMMO5': '0.024', 'AMMO2': '0.076', 'AMMO3': '0.249', 'weapon2': '0.262', 'weapon5': '0.344', 'AMMO4': '0.378', 'weapon4': '0.412', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.522', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '68.000'} [2024-08-06 06:02:22,260][52650] Updated weights for policy 0, policy_version 65751 (0.0011) [2024-08-06 06:02:22,794][52567] Fps is (10 sec: 18842.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 538640384. Throughput: 0: 4381.3. Samples: 134662910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:22,794][52567] Avg episode reward: [(0, '73.614')] [2024-08-06 06:02:22,855][52667] DAMAGECOUNT value on done: 703674.0 [2024-08-06 06:02:22,856][52667] Sum rewards: 65.553, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.629', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.116', 'AMMO4': '0.126', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '52.000'} [2024-08-06 06:02:22,879][52794] DAMAGECOUNT value on done: 692488.0 [2024-08-06 06:02:22,880][52794] Sum rewards: 66.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.064', 'weapon5': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '55.000'} [2024-08-06 06:02:23,740][52665] DAMAGECOUNT value on done: 695378.0 [2024-08-06 06:02:23,741][52665] Sum rewards: 72.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.144', 'weapon4': '0.168', 'AMMO3': '0.171', 'AMMO4': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '59.000'} [2024-08-06 06:02:23,907][52659] DAMAGECOUNT value on done: 707508.0 [2024-08-06 06:02:23,908][52659] Sum rewards: 81.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.745', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.186', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.378', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '66.000'} [2024-08-06 06:02:24,486][52647] DAMAGECOUNT value on done: 726201.0 [2024-08-06 06:02:24,487][52647] Sum rewards: 86.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.835', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.114', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.414', 'FRAGCOUNT': '69.000'} [2024-08-06 06:02:25,704][52667] DAMAGECOUNT value on done: 710687.0 [2024-08-06 06:02:25,705][52667] Sum rewards: 81.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.418', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO4': '0.203', 'AMMO3': '0.224', 'weapon4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '69.000'} [2024-08-06 06:02:25,792][52794] DAMAGECOUNT value on done: 700586.0 [2024-08-06 06:02:25,794][52794] Sum rewards: 78.641, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.103', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '67.000'} [2024-08-06 06:02:26,613][52659] DAMAGECOUNT value on done: 696194.0 [2024-08-06 06:02:26,615][52659] Sum rewards: 56.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.114', 'weapon5': '0.138', 'AMMO4': '0.191', 'AMMO3': '0.242', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.730', 'weapon3': '3.224', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '50.000'} [2024-08-06 06:02:26,942][52647] DAMAGECOUNT value on done: 733306.0 [2024-08-06 06:02:26,944][52647] Sum rewards: 59.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.025', 'AMMO2': '0.066', 'weapon4': '0.182', 'weapon5': '0.186', 'AMMO3': '0.215', 'weapon2': '0.244', 'AMMO4': '0.330', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.910', 'weapon3': '3.128', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '50.000'} [2024-08-06 06:02:26,974][52650] Updated weights for policy 0, policy_version 65761 (0.0023) [2024-08-06 06:02:27,010][52665] DAMAGECOUNT value on done: 690672.0 [2024-08-06 06:02:27,010][52665] Sum rewards: 68.439, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.312', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'weapon5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 06:02:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 538722304. Throughput: 0: 4372.4. Samples: 134688940. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:27,794][52567] Avg episode reward: [(0, '73.612')] [2024-08-06 06:02:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000065762_538722304.pth... [2024-08-06 06:02:27,918][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000065250_534528000.pth [2024-08-06 06:02:28,731][52667] DAMAGECOUNT value on done: 708629.0 [2024-08-06 06:02:28,732][52667] Sum rewards: 71.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.124', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:28,971][52794] DAMAGECOUNT value on done: 696773.0 [2024-08-06 06:02:28,971][52794] Sum rewards: 62.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.070', 'AMMO4': '0.195', 'weapon5': '0.256', 'AMMO3': '0.268', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.920', 'weapon3': '3.044', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '54.000'} [2024-08-06 06:02:29,251][52614] Signal inference workers to stop experience collection... (11950 times) [2024-08-06 06:02:29,251][52614] Signal inference workers to resume experience collection... (11950 times) [2024-08-06 06:02:29,334][52650] InferenceWorker_p0-w0: stopping experience collection (11950 times) [2024-08-06 06:02:29,335][52650] InferenceWorker_p0-w0: resuming experience collection (11950 times) [2024-08-06 06:02:29,552][52647] DAMAGECOUNT value on done: 723868.0 [2024-08-06 06:02:29,554][52647] Sum rewards: 66.895, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.518', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.125', 'weapon2': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.456', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '58.000'} [2024-08-06 06:02:30,010][52665] DAMAGECOUNT value on done: 688777.0 [2024-08-06 06:02:30,011][52665] Sum rewards: 75.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.175', 'weapon5': '0.192', 'AMMO4': '0.207', 'weapon4': '0.218', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.980', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:31,169][52667] DAMAGECOUNT value on done: 707475.0 [2024-08-06 06:02:31,169][52667] Sum rewards: 63.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.098', 'weapon5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.838', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '53.000'} [2024-08-06 06:02:31,724][52794] DAMAGECOUNT value on done: 712085.0 [2024-08-06 06:02:31,728][52794] Sum rewards: 84.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.800', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.318', 'weapon4': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.878', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '68.000'} [2024-08-06 06:02:31,945][52650] Updated weights for policy 0, policy_version 65771 (0.0021) [2024-08-06 06:02:32,296][52647] DAMAGECOUNT value on done: 731020.0 [2024-08-06 06:02:32,297][52647] Sum rewards: 79.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.325', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.125', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '66.000'} [2024-08-06 06:02:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 538804224. Throughput: 0: 4375.7. Samples: 134701910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:32,794][52567] Avg episode reward: [(0, '73.572')] [2024-08-06 06:02:32,903][52665] DAMAGECOUNT value on done: 691799.0 [2024-08-06 06:02:32,904][52665] Sum rewards: 78.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.215', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.131', 'weapon5': '0.182', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '65.000'} [2024-08-06 06:02:34,209][52667] DAMAGECOUNT value on done: 702434.0 [2024-08-06 06:02:34,210][52667] Sum rewards: 80.082, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.098', 'AMMO4': '0.119', 'AMMO3': '0.154', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '64.000'} [2024-08-06 06:02:34,663][52794] DAMAGECOUNT value on done: 693700.0 [2024-08-06 06:02:34,664][52794] Sum rewards: 69.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.360', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.650', 'weapon3': '3.302', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:35,328][52663] DAMAGECOUNT value on done: 713387.0 [2024-08-06 06:02:35,332][52663] Sum rewards: 84.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.174', 'AMMO3': '0.212', 'weapon5': '0.230', 'AMMO4': '0.245', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '21.261', 'FRAGCOUNT': '69.000'} [2024-08-06 06:02:36,086][52665] DAMAGECOUNT value on done: 693100.0 [2024-08-06 06:02:36,089][52665] Sum rewards: 82.552, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.200', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.026', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.202', 'AMMO3': '0.280', 'WEAPON3': '1.850', 'weapon3': '3.568', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '72.000'} [2024-08-06 06:02:36,659][52650] Updated weights for policy 0, policy_version 65781 (0.0011) [2024-08-06 06:02:37,243][52794] DAMAGECOUNT value on done: 706728.0 [2024-08-06 06:02:37,245][52794] Sum rewards: 74.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.713', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.068', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.276', 'WEAPON3': '1.150', 'weapon3': '3.484', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:37,368][52667] DAMAGECOUNT value on done: 710874.0 [2024-08-06 06:02:37,369][52667] Sum rewards: 83.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '67.000'} [2024-08-06 06:02:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 538894336. Throughput: 0: 4382.7. Samples: 134728300. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:37,794][52567] Avg episode reward: [(0, '73.816')] [2024-08-06 06:02:38,514][52663] DAMAGECOUNT value on done: 700181.0 [2024-08-06 06:02:38,515][52663] Sum rewards: 75.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.676', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.080', 'weapon4': '0.098', 'AMMO3': '0.209', 'AMMO4': '0.225', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '63.000'} [2024-08-06 06:02:39,231][52665] DAMAGECOUNT value on done: 684909.0 [2024-08-06 06:02:39,231][52665] Sum rewards: 71.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.680', 'AMMO5': '0.024', 'AMMO2': '0.048', 'AMMO3': '0.190', 'weapon5': '0.210', 'weapon2': '0.236', 'AMMO4': '0.241', 'weapon4': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.984', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:40,327][52794] DAMAGECOUNT value on done: 702446.0 [2024-08-06 06:02:40,328][52794] Sum rewards: 82.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.014', 'AMMO2': '0.066', 'weapon4': '0.070', 'weapon5': '0.120', 'AMMO3': '0.249', 'weapon2': '0.280', 'AMMO4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.312', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.733', 'FRAGCOUNT': '68.000'} [2024-08-06 06:02:41,348][52663] DAMAGECOUNT value on done: 694284.0 [2024-08-06 06:02:41,349][52663] Sum rewards: 74.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.765', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.116', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.214', 'WEAPON3': '1.400', 'weapon3': '3.404', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '62.000'} [2024-08-06 06:02:41,366][52650] Updated weights for policy 0, policy_version 65791 (0.0012) [2024-08-06 06:02:42,239][52665] DAMAGECOUNT value on done: 690042.0 [2024-08-06 06:02:42,240][52665] Sum rewards: 83.801, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.215', 'AMMO5': '0.007', 'AMMO2': '0.033', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon5': '0.166', 'AMMO4': '0.167', 'weapon2': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.366', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '66.000'} [2024-08-06 06:02:42,796][52567] Fps is (10 sec: 18019.0, 60 sec: 17475.7, 300 sec: 17466.9). Total num frames: 538984448. Throughput: 0: 4384.5. Samples: 134754600. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:02:42,796][52567] Avg episode reward: [(0, '73.920')] [2024-08-06 06:02:43,139][52794] DAMAGECOUNT value on done: 706547.0 [2024-08-06 06:02:43,140][52794] Sum rewards: 72.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.512', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.099', 'weapon5': '0.118', 'weapon2': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.410', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:43,682][52658] DAMAGECOUNT value on done: 703201.0 [2024-08-06 06:02:43,683][52658] Sum rewards: 75.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.098', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon2': '0.184', 'AMMO4': '0.188', 'AMMO3': '0.201', 'weapon5': '0.206', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 06:02:43,808][52663] DAMAGECOUNT value on done: 699348.0 [2024-08-06 06:02:43,810][52663] Sum rewards: 75.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.596', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.092', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.494', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '62.000'} [2024-08-06 06:02:44,804][52670] DAMAGECOUNT value on done: 691497.0 [2024-08-06 06:02:44,805][52670] Sum rewards: 69.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.367', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO3': '0.120', 'AMMO4': '0.146', 'weapon5': '0.154', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '0.750', 'HITCOUNT': '2.990', 'weapon3': '3.272', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '53.000'} [2024-08-06 06:02:45,299][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:02:45,619][52665] DAMAGECOUNT value on done: 692991.0 [2024-08-06 06:02:45,623][52665] Sum rewards: 63.186, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.111', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.076', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.370', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '54.000'} [2024-08-06 06:02:45,942][52666] DAMAGECOUNT value on done: 701823.0 [2024-08-06 06:02:45,945][52666] Sum rewards: 74.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.323', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon2': '0.138', 'weapon5': '0.138', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:46,006][52650] Updated weights for policy 0, policy_version 65801 (0.0018) [2024-08-06 06:02:46,391][52794] DAMAGECOUNT value on done: 711207.0 [2024-08-06 06:02:46,392][52794] Sum rewards: 70.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.162', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.206', 'weapon5': '0.212', 'weapon4': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '58.000'} [2024-08-06 06:02:46,507][52658] DAMAGECOUNT value on done: 701521.0 [2024-08-06 06:02:46,509][52658] Sum rewards: 76.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.258', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.038', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '62.000'} [2024-08-06 06:02:46,692][52663] DAMAGECOUNT value on done: 702605.0 [2024-08-06 06:02:46,692][52663] Sum rewards: 66.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.276', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '54.500'} [2024-08-06 06:02:47,450][52670] DAMAGECOUNT value on done: 702875.0 [2024-08-06 06:02:47,452][52670] Sum rewards: 69.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.876', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.060', 'weapon5': '0.136', 'AMMO4': '0.214', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '59.500'} [2024-08-06 06:02:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17614.7, 300 sec: 17494.8). Total num frames: 539074560. Throughput: 0: 4378.2. Samples: 134767790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:02:47,794][52567] Avg episode reward: [(0, '73.628')] [2024-08-06 06:02:48,638][52666] DAMAGECOUNT value on done: 699513.0 [2024-08-06 06:02:48,639][52666] Sum rewards: 58.264, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.520', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.130', 'AMMO4': '0.172', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.354', 'WEAPON3': '2.100', 'HITCOUNT': '3.220', 'weapon3': '3.320', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '54.000'} [2024-08-06 06:02:49,128][52658] DAMAGECOUNT value on done: 707866.0 [2024-08-06 06:02:49,128][52658] Sum rewards: 74.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.850', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.090', 'weapon5': '0.206', 'weapon2': '0.234', 'AMMO3': '0.265', 'AMMO4': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.184', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '65.000'} [2024-08-06 06:02:49,138][52794] DAMAGECOUNT value on done: 702701.0 [2024-08-06 06:02:49,139][52794] Sum rewards: 75.340, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.038', 'weapon5': '0.064', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.234', 'AMMO3': '0.288', 'WEAPON3': '1.650', 'weapon3': '3.436', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '65.000'} [2024-08-06 06:02:49,197][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:02:49,302][52663] DAMAGECOUNT value on done: 709069.0 [2024-08-06 06:02:49,303][52663] Sum rewards: 68.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.007', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.120', 'weapon5': '0.128', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'HITCOUNT': '3.130', 'weapon3': '3.368', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '59.000'} [2024-08-06 06:02:50,599][52650] Updated weights for policy 0, policy_version 65811 (0.0013) [2024-08-06 06:02:50,599][52670] DAMAGECOUNT value on done: 690404.0 [2024-08-06 06:02:50,600][52670] Sum rewards: 64.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.901', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon2': '0.216', 'AMMO3': '0.266', 'weapon5': '0.278', 'AMMO4': '0.317', 'weapon4': '0.400', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.768', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '54.000'} [2024-08-06 06:02:51,576][52666] DAMAGECOUNT value on done: 700095.0 [2024-08-06 06:02:51,576][52666] Sum rewards: 61.024, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.024', 'AMMO2': '0.088', 'AMMO3': '0.219', 'weapon5': '0.252', 'weapon2': '0.368', 'AMMO4': '0.438', 'weapon4': '0.470', 'WEAPON5': '0.650', 'WEAPON4': '0.900', 'WEAPON3': '1.350', 'weapon3': '2.544', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '53.500'} [2024-08-06 06:02:51,796][52658] DAMAGECOUNT value on done: 704941.0 [2024-08-06 06:02:51,800][52658] Sum rewards: 76.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.754', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.144', 'AMMO3': '0.161', 'weapon4': '0.170', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '61.500'} [2024-08-06 06:02:52,205][52663] DAMAGECOUNT value on done: 696284.0 [2024-08-06 06:02:52,207][52663] Sum rewards: 67.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.258', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.136', 'weapon5': '0.182', 'weapon2': '0.194', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.206', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '59.000'} [2024-08-06 06:02:52,794][52567] Fps is (10 sec: 16386.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 539148288. Throughput: 0: 4370.2. Samples: 134793700. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:02:52,795][52567] Avg episode reward: [(0, '73.123')] [2024-08-06 06:02:53,024][52670] DAMAGECOUNT value on done: 690415.0 [2024-08-06 06:02:53,025][52670] Sum rewards: 70.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.118', 'weapon4': '0.130', 'weapon2': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'AMMO4': '0.263', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:54,202][52666] DAMAGECOUNT value on done: 700393.0 [2024-08-06 06:02:54,206][52666] Sum rewards: 50.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon4': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '3.192', 'DAMAGECOUNT': '13.389', 'FRAGCOUNT': '46.000'} [2024-08-06 06:02:54,850][52658] DAMAGECOUNT value on done: 694548.0 [2024-08-06 06:02:54,850][52658] Sum rewards: 63.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.188', 'AMMO3': '0.196', 'weapon4': '0.228', 'weapon2': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.112', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '53.000'} [2024-08-06 06:02:55,325][52663] DAMAGECOUNT value on done: 692702.0 [2024-08-06 06:02:55,326][52663] Sum rewards: 82.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.396', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.102', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.210', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '68.000'} [2024-08-06 06:02:55,804][52650] Updated weights for policy 0, policy_version 65821 (0.0014) [2024-08-06 06:02:55,860][52669] DAMAGECOUNT value on done: 703098.0 [2024-08-06 06:02:55,861][52669] Sum rewards: 71.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.030', 'AMMO4': '0.038', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 06:02:55,903][52670] DAMAGECOUNT value on done: 700301.0 [2024-08-06 06:02:55,904][52670] Sum rewards: 70.320, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.095', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'HEALTH': '0.214', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 06:02:57,290][52666] DAMAGECOUNT value on done: 694370.0 [2024-08-06 06:02:57,292][52666] Sum rewards: 77.838, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.404', 'AMMO5': '0.007', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon2': '0.194', 'weapon5': '0.226', 'AMMO3': '0.239', 'weapon4': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '65.000'} [2024-08-06 06:02:57,664][52658] DAMAGECOUNT value on done: 693797.0 [2024-08-06 06:02:57,667][52658] Sum rewards: 74.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.192', 'AMMO5': '0.025', 'AMMO2': '0.082', 'weapon4': '0.128', 'AMMO3': '0.191', 'weapon5': '0.282', 'weapon2': '0.338', 'AMMO4': '0.410', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '61.000'} [2024-08-06 06:02:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 539246592. Throughput: 0: 4355.4. Samples: 134819680. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:02:57,794][52567] Avg episode reward: [(0, '72.856')] [2024-08-06 06:02:58,471][52663] DAMAGECOUNT value on done: 693995.0 [2024-08-06 06:02:58,472][52663] Sum rewards: 88.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.006', 'weapon4': '0.026', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.400', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '72.000'} [2024-08-06 06:02:59,167][52669] DAMAGECOUNT value on done: 694867.0 [2024-08-06 06:02:59,168][52669] Sum rewards: 77.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.395', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.035', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.263', 'weapon2': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '65.000'} [2024-08-06 06:02:59,227][52670] DAMAGECOUNT value on done: 695260.0 [2024-08-06 06:02:59,227][52670] Sum rewards: 71.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.416', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.086', 'weapon5': '0.154', 'AMMO4': '0.210', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 06:02:59,780][52650] Updated weights for policy 0, policy_version 65831 (0.0015) [2024-08-06 06:03:00,275][52658] DAMAGECOUNT value on done: 707170.0 [2024-08-06 06:03:00,276][52658] Sum rewards: 67.749, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.670', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.136', 'weapon2': '0.146', 'AMMO4': '0.164', 'weapon5': '0.250', 'weapon4': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.934', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '53.000'} [2024-08-06 06:03:00,533][52666] DAMAGECOUNT value on done: 696125.0 [2024-08-06 06:03:00,533][52666] Sum rewards: 79.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.118', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.162', 'AMMO4': '0.194', 'AMMO3': '0.228', 'weapon5': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:01,216][52663] DAMAGECOUNT value on done: 695882.0 [2024-08-06 06:03:01,226][52663] Sum rewards: 79.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.282', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '67.000'} [2024-08-06 06:03:01,954][52669] DAMAGECOUNT value on done: 706336.0 [2024-08-06 06:03:01,956][52669] Sum rewards: 72.420, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.198', 'AMMO4': '0.224', 'weapon2': '0.236', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:02,113][52671] DAMAGECOUNT value on done: 704417.0 [2024-08-06 06:03:02,113][52671] Sum rewards: 81.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.706', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.084', 'AMMO3': '0.215', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '68.000'} [2024-08-06 06:03:02,247][52670] DAMAGECOUNT value on done: 689083.0 [2024-08-06 06:03:02,247][52670] Sum rewards: 88.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'weapon4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '72.000'} [2024-08-06 06:03:02,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 539336704. Throughput: 0: 4360.9. Samples: 134832940. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:03:02,794][52567] Avg episode reward: [(0, '73.112')] [2024-08-06 06:03:03,158][52658] DAMAGECOUNT value on done: 698813.0 [2024-08-06 06:03:03,159][52658] Sum rewards: 72.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.465', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.092', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '58.000'} [2024-08-06 06:03:03,350][52666] DAMAGECOUNT value on done: 695214.0 [2024-08-06 06:03:03,351][52666] Sum rewards: 63.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'weapon4': '0.050', 'AMMO2': '0.052', 'weapon5': '0.142', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.252', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '53.000'} [2024-08-06 06:03:04,572][52670] DAMAGECOUNT value on done: 694956.0 [2024-08-06 06:03:04,573][52670] Sum rewards: 72.626, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.581', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.026', 'AMMO4': '0.060', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'weapon5': '0.166', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '0.900', 'weapon3': '3.174', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '58.000'} [2024-08-06 06:03:04,588][52663] DAMAGECOUNT value on done: 707144.0 [2024-08-06 06:03:04,589][52663] Sum rewards: 83.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.124', 'AMMO4': '0.207', 'AMMO3': '0.233', 'weapon5': '0.242', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '69.000'} [2024-08-06 06:03:04,694][52650] Updated weights for policy 0, policy_version 65841 (0.0014) [2024-08-06 06:03:04,870][52671] DAMAGECOUNT value on done: 707547.0 [2024-08-06 06:03:04,870][52671] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.345', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.114', 'AMMO3': '0.250', 'weapon5': '0.278', 'AMMO4': '0.295', 'weapon2': '0.336', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.980', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:05,253][52669] DAMAGECOUNT value on done: 701905.0 [2024-08-06 06:03:05,255][52669] Sum rewards: 73.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.376', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.098', 'AMMO4': '0.139', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 06:03:05,982][52666] DAMAGECOUNT value on done: 690366.0 [2024-08-06 06:03:05,984][52666] Sum rewards: 74.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.172', 'AMMO4': '0.177', 'AMMO3': '0.209', 'weapon5': '0.226', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '60.000'} [2024-08-06 06:03:06,112][52658] DAMAGECOUNT value on done: 718457.0 [2024-08-06 06:03:06,114][52658] Sum rewards: 78.319, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.701', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.056', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.594', 'WEAPON3': '1.550', 'weapon3': '3.110', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:07,266][52663] DAMAGECOUNT value on done: 691820.0 [2024-08-06 06:03:07,269][52663] Sum rewards: 65.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.578', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.156', 'AMMO4': '0.206', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:07,688][52671] DAMAGECOUNT value on done: 703569.0 [2024-08-06 06:03:07,689][52670] DAMAGECOUNT value on done: 691869.0 [2024-08-06 06:03:07,690][52671] Sum rewards: 66.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon2': '0.184', 'weapon4': '0.212', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '56.000'} [2024-08-06 06:03:07,692][52670] Sum rewards: 86.043, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.984', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.152', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.442', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '72.000'} [2024-08-06 06:03:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 539418624. Throughput: 0: 4357.3. Samples: 134858990. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:03:07,794][52567] Avg episode reward: [(0, '73.266')] [2024-08-06 06:03:07,897][52669] DAMAGECOUNT value on done: 702914.0 [2024-08-06 06:03:07,897][52669] Sum rewards: 66.908, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.572', 'AMMO5': '0.025', 'AMMO2': '0.075', 'weapon4': '0.142', 'AMMO3': '0.297', 'weapon5': '0.304', 'weapon2': '0.322', 'AMMO4': '0.373', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.836', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:08,914][52666] DAMAGECOUNT value on done: 699280.0 [2024-08-06 06:03:08,915][52666] Sum rewards: 76.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.596', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.154', 'AMMO4': '0.237', 'AMMO3': '0.239', 'weapon5': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:09,107][52658] DAMAGECOUNT value on done: 700764.0 [2024-08-06 06:03:09,110][52658] Sum rewards: 66.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.666', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon2': '0.800', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '53.000'} [2024-08-06 06:03:09,317][52650] Updated weights for policy 0, policy_version 65851 (0.0024) [2024-08-06 06:03:10,230][52671] DAMAGECOUNT value on done: 708089.0 [2024-08-06 06:03:10,231][52671] Sum rewards: 82.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.508', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon4': '0.074', 'weapon5': '0.184', 'AMMO3': '0.241', 'AMMO4': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '69.000'} [2024-08-06 06:03:10,442][52670] DAMAGECOUNT value on done: 688634.0 [2024-08-06 06:03:10,443][52670] Sum rewards: 67.060, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.707', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.174', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.448', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:10,476][52663] DAMAGECOUNT value on done: 688633.0 [2024-08-06 06:03:10,476][52663] Sum rewards: 84.795, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.354', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.163', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.338', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '67.000'} [2024-08-06 06:03:11,023][52669] DAMAGECOUNT value on done: 705269.0 [2024-08-06 06:03:11,027][52669] Sum rewards: 54.287, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.113', 'weapon5': '0.118', 'AMMO3': '0.130', 'WEAPON5': '0.150', 'weapon7': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.310', 'WEAPON3': '0.700', 'HEALTH': '0.730', 'weapon4': '1.024', 'weapon3': '2.108', 'HITCOUNT': '2.270', 'DAMAGECOUNT': '12.942', 'FRAGCOUNT': '42.000'} [2024-08-06 06:03:11,916][52658] DAMAGECOUNT value on done: 714550.0 [2024-08-06 06:03:11,916][52658] Sum rewards: 74.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.104', 'AMMO4': '0.166', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '60.000'} [2024-08-06 06:03:12,022][52666] DAMAGECOUNT value on done: 693459.0 [2024-08-06 06:03:12,022][52666] Sum rewards: 86.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.076', 'weapon5': '0.174', 'AMMO3': '0.185', 'AMMO4': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '69.000'} [2024-08-06 06:03:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17613.0, 300 sec: 17494.8). Total num frames: 539508736. Throughput: 0: 4359.8. Samples: 134885130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:03:12,794][52567] Avg episode reward: [(0, '73.421')] [2024-08-06 06:03:13,350][52671] DAMAGECOUNT value on done: 713917.0 [2024-08-06 06:03:13,351][52671] Sum rewards: 61.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.715', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.428', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.082', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '52.000'} [2024-08-06 06:03:13,451][52663] DAMAGECOUNT value on done: 696801.0 [2024-08-06 06:03:13,454][52663] Sum rewards: 73.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.023', 'AMMO2': '0.049', 'weapon4': '0.132', 'AMMO3': '0.199', 'AMMO4': '0.248', 'weapon2': '0.258', 'weapon5': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '60.000'} [2024-08-06 06:03:13,495][52670] DAMAGECOUNT value on done: 700459.0 [2024-08-06 06:03:13,498][52670] Sum rewards: 81.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.163', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:13,869][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:03:13,950][52669] DAMAGECOUNT value on done: 702787.0 [2024-08-06 06:03:13,951][52669] Sum rewards: 60.114, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.710', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO4': '0.149', 'weapon2': '0.166', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.400', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '51.000'} [2024-08-06 06:03:13,967][52650] Updated weights for policy 0, policy_version 65861 (0.0013) [2024-08-06 06:03:14,968][52666] DAMAGECOUNT value on done: 701407.0 [2024-08-06 06:03:14,969][52666] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.937', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.116', 'AMMO4': '0.199', 'weapon5': '0.224', 'AMMO3': '0.315', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '2.974', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:15,136][52658] DAMAGECOUNT value on done: 698349.0 [2024-08-06 06:03:15,137][52658] Sum rewards: 56.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.615', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.126', 'AMMO4': '0.138', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '3.246', 'DAMAGECOUNT': '13.638', 'FRAGCOUNT': '47.000'} [2024-08-06 06:03:16,373][52663] DAMAGECOUNT value on done: 692875.0 [2024-08-06 06:03:16,375][52663] Sum rewards: 78.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.666', 'AMMO5': '0.011', 'AMMO2': '0.063', 'weapon4': '0.144', 'weapon5': '0.182', 'AMMO3': '0.252', 'AMMO4': '0.315', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:16,389][52671] DAMAGECOUNT value on done: 706618.0 [2024-08-06 06:03:16,389][52671] Sum rewards: 78.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.768', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:16,686][52670] DAMAGECOUNT value on done: 686158.0 [2024-08-06 06:03:16,686][52670] Sum rewards: 79.185, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.196', 'weapon2': '0.264', 'WEAPON4': '0.300', 'weapon4': '0.420', 'WEAPON3': '0.950', 'weapon3': '3.004', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:16,754][52669] DAMAGECOUNT value on done: 705723.0 [2024-08-06 06:03:16,754][52669] Sum rewards: 83.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '70.000'} [2024-08-06 06:03:17,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 539590656. Throughput: 0: 4365.1. Samples: 134898340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:03:17,795][52567] Avg episode reward: [(0, '73.245')] [2024-08-06 06:03:17,826][52658] DAMAGECOUNT value on done: 705578.0 [2024-08-06 06:03:17,828][52658] Sum rewards: 71.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.220', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.036', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.220', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '58.000'} [2024-08-06 06:03:18,144][52666] DAMAGECOUNT value on done: 689116.0 [2024-08-06 06:03:18,147][52666] Sum rewards: 78.187, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.710', 'AMMO5': '0.006', 'weapon4': '0.022', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:18,525][52650] Updated weights for policy 0, policy_version 65871 (0.0026) [2024-08-06 06:03:19,262][52671] DAMAGECOUNT value on done: 709718.0 [2024-08-06 06:03:19,262][52671] Sum rewards: 71.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.056', 'AMMO4': '0.172', 'AMMO3': '0.196', 'weapon5': '0.218', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.240', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '57.000'} [2024-08-06 06:03:19,389][52663] DAMAGECOUNT value on done: 706647.0 [2024-08-06 06:03:19,391][52663] Sum rewards: 82.125, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'weapon4': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:19,681][52670] DAMAGECOUNT value on done: 696092.0 [2024-08-06 06:03:19,682][52670] Sum rewards: 74.114, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.740', 'AMMO2': '0.006', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.132', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '60.000'} [2024-08-06 06:03:19,742][52669] DAMAGECOUNT value on done: 711826.0 [2024-08-06 06:03:19,743][52669] Sum rewards: 79.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.024', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.208', 'weapon5': '0.212', 'weapon2': '0.218', 'weapon4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:20,888][52658] DAMAGECOUNT value on done: 696897.0 [2024-08-06 06:03:20,888][52658] Sum rewards: 74.595, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.944', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.130', 'weapon5': '0.162', 'AMMO4': '0.170', 'AMMO3': '0.271', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:21,063][52666] DAMAGECOUNT value on done: 702335.0 [2024-08-06 06:03:21,065][52666] Sum rewards: 74.371, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.593', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.068', 'weapon5': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.548', 'WEAPON3': '0.900', 'weapon3': '3.054', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '57.500'} [2024-08-06 06:03:21,152][52668] DAMAGECOUNT value on done: 700429.0 [2024-08-06 06:03:21,152][52668] Sum rewards: 82.468, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.544', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.145', 'weapon5': '0.190', 'weapon2': '0.238', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.202', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.420', 'FRAGCOUNT': '69.000'} [2024-08-06 06:03:22,415][52671] DAMAGECOUNT value on done: 706872.0 [2024-08-06 06:03:22,415][52671] Sum rewards: 63.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.855', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.140', 'weapon5': '0.180', 'AMMO3': '0.246', 'AMMO4': '0.254', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.164', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:22,445][52663] DAMAGECOUNT value on done: 699765.0 [2024-08-06 06:03:22,446][52663] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.873', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.120', 'weapon5': '0.156', 'AMMO3': '0.189', 'AMMO4': '0.293', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '60.000'} [2024-08-06 06:03:22,721][52669] DAMAGECOUNT value on done: 705165.0 [2024-08-06 06:03:22,722][52669] Sum rewards: 64.783, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.306', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.352', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 539680768. Throughput: 0: 4364.2. Samples: 134924690. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:03:22,794][52567] Avg episode reward: [(0, '73.388')] [2024-08-06 06:03:22,802][52670] DAMAGECOUNT value on done: 702384.0 [2024-08-06 06:03:22,803][52670] Sum rewards: 78.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.800', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:23,533][52650] Updated weights for policy 0, policy_version 65881 (0.0023) [2024-08-06 06:03:23,841][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 06:03:24,062][52668] DAMAGECOUNT value on done: 706517.0 [2024-08-06 06:03:24,063][52668] Sum rewards: 71.661, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.042', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.492', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '60.000'} [2024-08-06 06:03:24,123][52658] DAMAGECOUNT value on done: 706541.0 [2024-08-06 06:03:24,123][52658] Sum rewards: 73.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.184', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.140', 'AMMO3': '0.183', 'weapon4': '0.202', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '59.000'} [2024-08-06 06:03:24,138][52666] DAMAGECOUNT value on done: 696446.0 [2024-08-06 06:03:24,138][52666] Sum rewards: 80.157, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.338', 'HEALTH': '0.506', 'WEAPON3': '0.950', 'weapon3': '3.396', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:24,759][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0)] [2024-08-06 06:03:25,220][52671] DAMAGECOUNT value on done: 697922.0 [2024-08-06 06:03:25,222][52671] Sum rewards: 72.280, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.428', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.122', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.298', 'WEAPON3': '1.650', 'weapon3': '3.178', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '62.000'} [2024-08-06 06:03:25,408][52663] DAMAGECOUNT value on done: 703567.0 [2024-08-06 06:03:25,408][52663] Sum rewards: 79.515, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.164', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'weapon4': '0.346', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:25,580][52669] DAMAGECOUNT value on done: 704912.0 [2024-08-06 06:03:25,580][52669] Sum rewards: 63.542, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.090', 'AMMO3': '0.143', 'weapon2': '0.226', 'AMMO4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '0.950', 'weapon3': '2.892', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '52.000'} [2024-08-06 06:03:25,883][52670] DAMAGECOUNT value on done: 697895.0 [2024-08-06 06:03:25,883][52670] Sum rewards: 77.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.550', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.110', 'weapon4': '0.112', 'AMMO4': '0.162', 'AMMO3': '0.208', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:26,877][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:03:27,042][52668] DAMAGECOUNT value on done: 707650.0 [2024-08-06 06:03:27,043][52668] Sum rewards: 82.319, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.083', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.130', 'AMMO3': '0.190', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '67.000'} [2024-08-06 06:03:27,101][52658] DAMAGECOUNT value on done: 692350.0 [2024-08-06 06:03:27,103][52658] Sum rewards: 70.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.350', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.196', 'weapon2': '0.210', 'AMMO3': '0.236', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.306', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '59.000'} [2024-08-06 06:03:27,428][52666] DAMAGECOUNT value on done: 697635.0 [2024-08-06 06:03:27,429][52666] Sum rewards: 65.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.458', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.172', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '57.000'} [2024-08-06 06:03:27,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 539770880. Throughput: 0: 4359.3. Samples: 134950760. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:03:27,802][52567] Avg episode reward: [(0, '73.686')] [2024-08-06 06:03:27,946][52650] Updated weights for policy 0, policy_version 65891 (0.0012) [2024-08-06 06:03:28,031][52671] DAMAGECOUNT value on done: 705215.0 [2024-08-06 06:03:28,032][52671] Sum rewards: 75.187, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.025', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.156', 'AMMO3': '0.172', 'weapon2': '0.282', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:28,150][52663] DAMAGECOUNT value on done: 702812.0 [2024-08-06 06:03:28,151][52663] Sum rewards: 63.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.076', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon2': '0.194', 'weapon4': '0.222', 'AMMO3': '0.242', 'AMMO4': '0.246', 'weapon5': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '2.982', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '52.500'} [2024-08-06 06:03:28,559][52669] DAMAGECOUNT value on done: 711049.0 [2024-08-06 06:03:28,560][52669] Sum rewards: 70.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.582', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO4': '0.160', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2024-08-06 06:03:28,708][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:03:28,778][52670] DAMAGECOUNT value on done: 680525.0 [2024-08-06 06:03:28,779][52670] Sum rewards: 81.331, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.106', 'weapon4': '0.138', 'AMMO3': '0.164', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.356', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:29,929][52658] DAMAGECOUNT value on done: 706648.0 [2024-08-06 06:03:29,930][52658] Sum rewards: 70.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.064', 'weapon5': '0.196', 'AMMO3': '0.228', 'AMMO4': '0.247', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '60.000'} [2024-08-06 06:03:30,063][52668] DAMAGECOUNT value on done: 707442.0 [2024-08-06 06:03:30,065][52668] Sum rewards: 86.020, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.786', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.208', 'AMMO4': '0.218', 'AMMO3': '0.273', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '74.000'} [2024-08-06 06:03:30,200][52666] DAMAGECOUNT value on done: 688342.0 [2024-08-06 06:03:30,202][52666] Sum rewards: 60.771, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon2': '0.096', 'AMMO4': '0.100', 'AMMO3': '0.135', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.286', 'weapon4': '0.420', 'WEAPON3': '0.800', 'HITCOUNT': '2.810', 'weapon3': '3.064', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '47.000'} [2024-08-06 06:03:30,966][52663] DAMAGECOUNT value on done: 695492.0 [2024-08-06 06:03:30,968][52663] Sum rewards: 75.733, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.587', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.199', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.466', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:31,077][52671] DAMAGECOUNT value on done: 707759.0 [2024-08-06 06:03:31,078][52671] Sum rewards: 78.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'AMMO3': '0.192', 'weapon2': '0.576', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:31,167][52669] DAMAGECOUNT value on done: 697300.0 [2024-08-06 06:03:31,167][52669] Sum rewards: 82.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.176', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.488', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '70.000'} [2024-08-06 06:03:31,899][52670] DAMAGECOUNT value on done: 692479.0 [2024-08-06 06:03:31,900][52670] Sum rewards: 73.852, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.808', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.170', 'weapon2': '0.228', 'AMMO4': '0.249', 'AMMO3': '0.289', 'weapon4': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.988', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:32,690][52650] Updated weights for policy 0, policy_version 65901 (0.0011) [2024-08-06 06:03:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 539860992. Throughput: 0: 4359.3. Samples: 134963960. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:03:32,794][52567] Avg episode reward: [(0, '73.287')] [2024-08-06 06:03:32,800][52658] DAMAGECOUNT value on done: 698986.0 [2024-08-06 06:03:32,802][52658] Sum rewards: 79.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.173', 'weapon4': '0.222', 'weapon5': '0.272', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:33,122][52666] DAMAGECOUNT value on done: 693904.0 [2024-08-06 06:03:33,122][52666] Sum rewards: 78.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.669', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO4': '0.212', 'weapon2': '0.222', 'AMMO3': '0.224', 'weapon5': '0.270', 'weapon4': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:33,274][52668] DAMAGECOUNT value on done: 693340.0 [2024-08-06 06:03:33,274][52668] Sum rewards: 81.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.994', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.164', 'weapon5': '0.198', 'weapon2': '0.204', 'AMMO3': '0.222', 'AMMO4': '0.235', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '67.000'} [2024-08-06 06:03:33,940][52669] DAMAGECOUNT value on done: 701062.0 [2024-08-06 06:03:33,941][52669] Sum rewards: 72.978, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.724', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.174', 'AMMO4': '0.236', 'AMMO3': '0.257', 'weapon4': '0.264', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:34,081][52671] DAMAGECOUNT value on done: 705669.0 [2024-08-06 06:03:34,081][52671] Sum rewards: 81.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.058', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'weapon2': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'WEAPON3': '1.400', 'HITCOUNT': '3.520', 'weapon3': '3.546', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '68.000'} [2024-08-06 06:03:34,921][52670] DAMAGECOUNT value on done: 698538.0 [2024-08-06 06:03:34,922][52670] Sum rewards: 63.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.032', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.254', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '3.392', 'DAMAGECOUNT': '15.333', 'FRAGCOUNT': '54.000'} [2024-08-06 06:03:35,928][52658] DAMAGECOUNT value on done: 701937.0 [2024-08-06 06:03:35,928][52658] Sum rewards: 63.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.057', 'weapon5': '0.146', 'weapon4': '0.182', 'AMMO3': '0.252', 'AMMO4': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '2.854', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '54.000'} [2024-08-06 06:03:36,231][52668] DAMAGECOUNT value on done: 708703.0 [2024-08-06 06:03:36,231][52668] Sum rewards: 66.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.102', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.122', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:36,271][52666] DAMAGECOUNT value on done: 706198.0 [2024-08-06 06:03:36,272][52666] Sum rewards: 73.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.621', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.054', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.232', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.360', 'weapon3': '3.554', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:36,750][52671] DAMAGECOUNT value on done: 711540.0 [2024-08-06 06:03:36,752][52671] Sum rewards: 81.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO4': '0.181', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:37,020][52669] DAMAGECOUNT value on done: 703539.0 [2024-08-06 06:03:37,021][52669] Sum rewards: 79.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'weapon5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.030', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '3.324', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:37,434][52650] Updated weights for policy 0, policy_version 65911 (0.0071) [2024-08-06 06:03:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 539942912. Throughput: 0: 4362.0. Samples: 134989990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:03:37,802][52567] Avg episode reward: [(0, '73.542')] [2024-08-06 06:03:38,191][52670] DAMAGECOUNT value on done: 695641.0 [2024-08-06 06:03:38,191][52670] Sum rewards: 75.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.019', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.145', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:38,934][52658] DAMAGECOUNT value on done: 704854.0 [2024-08-06 06:03:38,935][52658] Sum rewards: 87.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.138', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.384', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.853', 'FRAGCOUNT': '73.000'} [2024-08-06 06:03:38,999][52668] DAMAGECOUNT value on done: 708258.0 [2024-08-06 06:03:39,001][52668] Sum rewards: 83.174, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.166', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.578', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '70.000'} [2024-08-06 06:03:39,239][52671] DAMAGECOUNT value on done: 706547.0 [2024-08-06 06:03:39,239][52671] Sum rewards: 85.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.188', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.358', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '69.000'} [2024-08-06 06:03:39,492][52666] DAMAGECOUNT value on done: 686007.0 [2024-08-06 06:03:39,492][52666] Sum rewards: 64.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.840', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.172', 'AMMO4': '0.194', 'AMMO3': '0.199', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.322', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '53.000'} [2024-08-06 06:03:39,840][52669] DAMAGECOUNT value on done: 723921.0 [2024-08-06 06:03:39,840][52669] Sum rewards: 62.960, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.188', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.096', 'weapon5': '0.158', 'AMMO4': '0.166', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.138', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '56.000'} [2024-08-06 06:03:40,434][52664] DAMAGECOUNT value on done: 727874.0 [2024-08-06 06:03:40,436][52664] Sum rewards: 76.920, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.126', 'AMMO3': '0.145', 'weapon4': '0.180', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '3.176', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:41,138][52670] DAMAGECOUNT value on done: 699011.0 [2024-08-06 06:03:41,140][52670] Sum rewards: 67.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.056', 'AMMO4': '0.145', 'weapon5': '0.146', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.936', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:42,042][52650] Updated weights for policy 0, policy_version 65921 (0.0014) [2024-08-06 06:03:42,075][52671] DAMAGECOUNT value on done: 693785.0 [2024-08-06 06:03:42,075][52671] Sum rewards: 82.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.044', 'weapon5': '0.076', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.205', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:42,140][52668] DAMAGECOUNT value on done: 699659.0 [2024-08-06 06:03:42,142][52668] Sum rewards: 80.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.068', 'AMMO4': '0.195', 'AMMO3': '0.220', 'weapon5': '0.226', 'weapon2': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:42,270][52669] DAMAGECOUNT value on done: 712627.0 [2024-08-06 06:03:42,272][52669] Sum rewards: 78.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.429', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.164', 'weapon5': '0.208', 'AMMO3': '0.213', 'AMMO4': '0.227', 'weapon2': '0.262', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '64.500'} [2024-08-06 06:03:42,332][52666] DAMAGECOUNT value on done: 694467.0 [2024-08-06 06:03:42,333][52666] Sum rewards: 86.930, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.015', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.090', 'weapon5': '0.164', 'AMMO3': '0.171', 'AMMO4': '0.177', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.216', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '70.000'} [2024-08-06 06:03:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.8, 300 sec: 17494.8). Total num frames: 540033024. Throughput: 0: 4371.6. Samples: 135016400. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:03:42,794][52567] Avg episode reward: [(0, '74.716')] [2024-08-06 06:03:43,056][52664] DAMAGECOUNT value on done: 733533.0 [2024-08-06 06:03:43,056][52664] Sum rewards: 66.088, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.528', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.148', 'weapon4': '0.160', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:44,787][52662] DAMAGECOUNT value on done: 706483.0 [2024-08-06 06:03:44,788][52662] Sum rewards: 69.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.818', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.084', 'weapon5': '0.120', 'AMMO4': '0.184', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 06:03:44,818][52668] DAMAGECOUNT value on done: 700235.0 [2024-08-06 06:03:44,818][52668] Sum rewards: 77.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.162', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.151', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.322', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:45,072][52666] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:03:45,126][52669] DAMAGECOUNT value on done: 708648.0 [2024-08-06 06:03:45,126][52669] Sum rewards: 75.462, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.295', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.078', 'weapon5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.280', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:45,180][52671] DAMAGECOUNT value on done: 712254.0 [2024-08-06 06:03:45,180][52671] Sum rewards: 68.765, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.488', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.102', 'weapon4': '0.154', 'AMMO4': '0.175', 'AMMO3': '0.248', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '59.000'} [2024-08-06 06:03:46,465][52664] DAMAGECOUNT value on done: 729276.0 [2024-08-06 06:03:46,466][52664] Sum rewards: 69.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.080', 'AMMO4': '0.158', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '57.000'} [2024-08-06 06:03:46,914][52650] Updated weights for policy 0, policy_version 65931 (0.0021) [2024-08-06 06:03:47,644][52671] DAMAGECOUNT value on done: 710178.0 [2024-08-06 06:03:47,645][52671] Sum rewards: 66.874, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.593', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.106', 'weapon5': '0.180', 'AMMO4': '0.227', 'AMMO3': '0.254', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '58.500'} [2024-08-06 06:03:47,728][52662] DAMAGECOUNT value on done: 708757.0 [2024-08-06 06:03:47,730][52662] Sum rewards: 73.355, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.024', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.134', 'weapon2': '0.186', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.430', 'WEAPON3': '0.900', 'weapon3': '2.914', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '58.000'} [2024-08-06 06:03:47,773][52811] DAMAGECOUNT value on done: 668869.0 [2024-08-06 06:03:47,774][52811] Sum rewards: 49.902, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.286', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.158', 'weapon5': '0.182', 'WEAPON7': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.350', 'weapon7': '0.376', 'WEAPON3': '0.950', 'weapon4': '1.004', 'weapon3': '1.860', 'HITCOUNT': '2.030', 'DAMAGECOUNT': '11.868', 'FRAGCOUNT': '41.000'} [2024-08-06 06:03:47,777][52668] DAMAGECOUNT value on done: 708149.0 [2024-08-06 06:03:47,777][52668] Sum rewards: 69.448, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.470', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.090', 'weapon5': '0.192', 'AMMO4': '0.272', 'weapon2': '0.314', 'AMMO3': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'weapon3': '3.054', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 540123136. Throughput: 0: 4372.2. Samples: 135029690. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:03:47,802][52567] Avg episode reward: [(0, '74.398')] [2024-08-06 06:03:47,848][52669] DAMAGECOUNT value on done: 709573.0 [2024-08-06 06:03:47,849][52669] Sum rewards: 93.542, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon2': '0.230', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.384', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.201', 'FRAGCOUNT': '79.000'} [2024-08-06 06:03:48,222][52795] DAMAGECOUNT value on done: 652699.0 [2024-08-06 06:03:48,222][52795] Sum rewards: 65.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.753', 'weapon4': '0.010', 'AMMO2': '0.010', 'AMMO5': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.490', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '57.000'} [2024-08-06 06:03:49,177][52664] DAMAGECOUNT value on done: 723427.0 [2024-08-06 06:03:49,177][52664] Sum rewards: 65.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.033', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.201', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.366', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '55.000'} [2024-08-06 06:03:50,608][52669] DAMAGECOUNT value on done: 714019.0 [2024-08-06 06:03:50,610][52669] Sum rewards: 77.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.780', 'AMMO5': '0.028', 'AMMO2': '0.070', 'weapon4': '0.228', 'AMMO3': '0.231', 'weapon5': '0.246', 'weapon2': '0.286', 'AMMO4': '0.350', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:50,660][52671] DAMAGECOUNT value on done: 709664.0 [2024-08-06 06:03:50,661][52671] Sum rewards: 77.339, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.241', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon5': '0.186', 'AMMO4': '0.226', 'AMMO3': '0.254', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:50,792][52662] DAMAGECOUNT value on done: 713864.0 [2024-08-06 06:03:50,792][52662] Sum rewards: 71.713, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.198', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.176', 'AMMO4': '0.177', 'weapon5': '0.212', 'weapon4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '57.000'} [2024-08-06 06:03:50,794][52811] DAMAGECOUNT value on done: 650077.0 [2024-08-06 06:03:50,794][52811] Sum rewards: 82.340, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.224', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '68.000'} [2024-08-06 06:03:50,816][52668] DAMAGECOUNT value on done: 704470.0 [2024-08-06 06:03:50,817][52668] Sum rewards: 72.882, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.828', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.099', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'WEAPON3': '1.750', 'HITCOUNT': '3.400', 'weapon3': '3.424', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:51,459][52650] Updated weights for policy 0, policy_version 65941 (0.0011) [2024-08-06 06:03:51,491][52795] DAMAGECOUNT value on done: 640381.0 [2024-08-06 06:03:51,496][52795] Sum rewards: 66.612, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.980', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.250', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.190', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '59.500'} [2024-08-06 06:03:51,605][52664] DAMAGECOUNT value on done: 735484.0 [2024-08-06 06:03:51,607][52664] Sum rewards: 76.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.106', 'weapon4': '0.110', 'weapon2': '0.164', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.390', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:52,404][52820] DAMAGECOUNT value on done: 651424.0 [2024-08-06 06:03:52,407][52820] Sum rewards: 78.532, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.024', 'AMMO2': '0.056', 'weapon4': '0.140', 'AMMO3': '0.207', 'weapon5': '0.244', 'AMMO4': '0.280', 'WEAPON4': '0.550', 'weapon2': '0.578', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 540205056. Throughput: 0: 4373.3. Samples: 135055790. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:03:52,802][52567] Avg episode reward: [(0, '73.939')] [2024-08-06 06:03:53,174][52671] DAMAGECOUNT value on done: 709811.0 [2024-08-06 06:03:53,176][52671] Sum rewards: 80.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.770', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon4': '0.348', 'weapon2': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.816', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '68.000'} [2024-08-06 06:03:53,377][52669] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:03:53,635][52668] DAMAGECOUNT value on done: 695562.0 [2024-08-06 06:03:53,636][52668] Sum rewards: 75.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.025', 'AMMO2': '0.066', 'weapon2': '0.218', 'AMMO3': '0.227', 'weapon4': '0.264', 'weapon5': '0.296', 'AMMO4': '0.332', 'WEAPON5': '0.650', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:53,873][52811] DAMAGECOUNT value on done: 649925.0 [2024-08-06 06:03:53,875][52811] Sum rewards: 76.408, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.242', 'weapon2': '0.412', 'WEAPON3': '1.600', 'weapon3': '3.354', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:53,941][52662] DAMAGECOUNT value on done: 698737.0 [2024-08-06 06:03:53,941][52662] Sum rewards: 75.775, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.872', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.311', 'weapon2': '0.382', 'WEAPON3': '1.700', 'weapon3': '3.202', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '66.000'} [2024-08-06 06:03:54,557][52664] DAMAGECOUNT value on done: 728133.0 [2024-08-06 06:03:54,557][52664] Sum rewards: 76.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.168', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.334', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:54,856][52795] DAMAGECOUNT value on done: 641484.0 [2024-08-06 06:03:54,859][52795] Sum rewards: 85.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.335', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.233', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '72.000'} [2024-08-06 06:03:55,490][52820] DAMAGECOUNT value on done: 650921.0 [2024-08-06 06:03:55,491][52820] Sum rewards: 77.565, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.799', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.185', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:56,052][52650] Updated weights for policy 0, policy_version 65951 (0.0027) [2024-08-06 06:03:56,088][52671] DAMAGECOUNT value on done: 703273.0 [2024-08-06 06:03:56,088][52671] Sum rewards: 77.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.343', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.122', 'AMMO4': '0.174', 'weapon2': '0.174', 'weapon5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '65.000'} [2024-08-06 06:03:56,507][52668] DAMAGECOUNT value on done: 689658.0 [2024-08-06 06:03:56,509][52668] Sum rewards: 77.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.755', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.082', 'weapon5': '0.164', 'AMMO4': '0.183', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 06:03:56,714][52662] DAMAGECOUNT value on done: 715895.0 [2024-08-06 06:03:56,715][52662] Sum rewards: 79.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.647', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.104', 'weapon2': '0.166', 'AMMO3': '0.231', 'WEAPON3': '1.400', 'weapon3': '3.488', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '67.000'} [2024-08-06 06:03:57,054][52811] DAMAGECOUNT value on done: 652270.0 [2024-08-06 06:03:57,055][52811] Sum rewards: 93.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.160', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.342', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.366', 'FRAGCOUNT': '74.000'} [2024-08-06 06:03:57,474][52664] DAMAGECOUNT value on done: 724504.0 [2024-08-06 06:03:57,474][52664] Sum rewards: 78.945, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.099', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.160', 'AMMO3': '0.173', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '64.000'} [2024-08-06 06:03:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 540295168. Throughput: 0: 4381.1. Samples: 135082280. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:03:57,794][52567] Avg episode reward: [(0, '74.724')] [2024-08-06 06:03:57,917][52795] DAMAGECOUNT value on done: 650519.0 [2024-08-06 06:03:57,917][52795] Sum rewards: 85.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.042', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.169', 'AMMO3': '0.209', 'weapon5': '0.224', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '71.000'} [2024-08-06 06:03:58,531][52820] DAMAGECOUNT value on done: 651566.0 [2024-08-06 06:03:58,533][52820] Sum rewards: 66.175, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.210', 'AMMO5': '0.033', 'AMMO2': '0.080', 'weapon4': '0.138', 'AMMO3': '0.249', 'weapon5': '0.344', 'AMMO4': '0.399', 'weapon2': '0.486', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.654', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '56.000'} [2024-08-06 06:03:59,468][52662] DAMAGECOUNT value on done: 696745.0 [2024-08-06 06:03:59,469][52662] Sum rewards: 78.266, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'HEALTH': '0.285', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '0.850', 'weapon3': '3.170', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '61.000'} [2024-08-06 06:03:59,490][52660] DAMAGECOUNT value on done: 703783.0 [2024-08-06 06:03:59,491][52660] Sum rewards: 67.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.132', 'weapon5': '0.132', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.550', 'weapon3': '3.106', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '59.000'} [2024-08-06 06:03:59,716][52668] DAMAGECOUNT value on done: 690121.0 [2024-08-06 06:03:59,720][52668] Sum rewards: 83.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.599', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.194', 'weapon4': '0.206', 'weapon5': '0.206', 'AMMO4': '0.248', 'weapon2': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '67.000'} [2024-08-06 06:03:59,938][52664] DAMAGECOUNT value on done: 719889.0 [2024-08-06 06:03:59,940][52664] Sum rewards: 65.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.143', 'weapon2': '0.182', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.146', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:00,178][52811] DAMAGECOUNT value on done: 661139.0 [2024-08-06 06:04:00,181][52811] Sum rewards: 64.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.734', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.141', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:00,996][52650] Updated weights for policy 0, policy_version 65961 (0.0011) [2024-08-06 06:04:01,048][52795] DAMAGECOUNT value on done: 643307.0 [2024-08-06 06:04:01,048][52795] Sum rewards: 67.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.281', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.082', 'weapon5': '0.122', 'AMMO4': '0.148', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.214', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '58.000'} [2024-08-06 06:04:01,635][52820] DAMAGECOUNT value on done: 643472.0 [2024-08-06 06:04:01,637][52820] Sum rewards: 66.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.232', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon5': '0.170', 'AMMO3': '0.205', 'AMMO4': '0.274', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '2.844', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:02,273][52664] DAMAGECOUNT value on done: 734388.0 [2024-08-06 06:04:02,276][52664] Sum rewards: 58.136, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.250', 'AMMO5': '0.024', 'AMMO2': '0.080', 'weapon4': '0.206', 'weapon5': '0.262', 'AMMO3': '0.271', 'weapon2': '0.382', 'AMMO4': '0.402', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.752', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '52.000'} [2024-08-06 06:04:02,279][52649] DAMAGECOUNT value on done: 681663.0 [2024-08-06 06:04:02,279][52649] Sum rewards: 81.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.168', 'AMMO3': '0.194', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:02,469][52662] DAMAGECOUNT value on done: 704149.0 [2024-08-06 06:04:02,471][52662] Sum rewards: 66.534, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.999', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO3': '0.152', 'AMMO4': '0.154', 'weapon4': '0.164', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '53.000'} [2024-08-06 06:04:02,764][52660] DAMAGECOUNT value on done: 693091.0 [2024-08-06 06:04:02,765][52660] Sum rewards: 75.934, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.872', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.105', 'weapon5': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.396', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 540385280. Throughput: 0: 4376.7. Samples: 135095290. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 06:04:02,795][52567] Avg episode reward: [(0, '74.441')] [2024-08-06 06:04:02,888][52668] DAMAGECOUNT value on done: 690253.0 [2024-08-06 06:04:02,889][52668] Sum rewards: 71.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO3': '0.206', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '58.000'} [2024-08-06 06:04:03,301][52811] DAMAGECOUNT value on done: 664701.0 [2024-08-06 06:04:03,301][52811] Sum rewards: 67.282, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.645', 'AMMO5': '0.014', 'AMMO2': '0.067', 'weapon5': '0.196', 'AMMO3': '0.214', 'weapon4': '0.256', 'weapon2': '0.308', 'AMMO4': '0.333', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:04,127][52795] DAMAGECOUNT value on done: 652876.0 [2024-08-06 06:04:04,130][52795] Sum rewards: 60.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.120', 'weapon5': '0.138', 'AMMO3': '0.168', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '49.000'} [2024-08-06 06:04:04,800][52664] DAMAGECOUNT value on done: 723164.0 [2024-08-06 06:04:04,802][52664] Sum rewards: 71.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.070', 'weapon5': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:04,942][52820] DAMAGECOUNT value on done: 655314.0 [2024-08-06 06:04:04,943][52820] Sum rewards: 75.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon4': '0.032', 'AMMO2': '0.038', 'weapon5': '0.076', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:05,365][52650] Updated weights for policy 0, policy_version 65971 (0.0038) [2024-08-06 06:04:05,408][52662] DAMAGECOUNT value on done: 714330.0 [2024-08-06 06:04:05,409][52662] Sum rewards: 78.994, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.010', 'weapon4': '0.012', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.256', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.376', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '68.000'} [2024-08-06 06:04:05,415][52649] DAMAGECOUNT value on done: 674259.0 [2024-08-06 06:04:05,416][52649] Sum rewards: 60.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.052', 'AMMO5': '0.006', 'ARMOR': '0.024', 'AMMO2': '0.033', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.243', 'weapon2': '0.302', 'WEAPON3': '1.550', 'HITCOUNT': '2.950', 'weapon3': '3.170', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '54.500'} [2024-08-06 06:04:05,590][52660] DAMAGECOUNT value on done: 706471.0 [2024-08-06 06:04:05,592][52660] Sum rewards: 72.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.115', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.078', 'AMMO4': '0.097', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:05,727][52668] DAMAGECOUNT value on done: 702716.0 [2024-08-06 06:04:05,728][52668] Sum rewards: 79.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.896', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.199', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:06,246][52811] DAMAGECOUNT value on done: 661466.0 [2024-08-06 06:04:06,246][52811] Sum rewards: 74.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon2': '0.208', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'weapon3': '3.436', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:07,348][52795] DAMAGECOUNT value on done: 657752.0 [2024-08-06 06:04:07,349][52795] Sum rewards: 81.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.781', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.186', 'weapon2': '0.218', 'weapon5': '0.228', 'AMMO3': '0.230', 'AMMO4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:07,414][52664] DAMAGECOUNT value on done: 736231.0 [2024-08-06 06:04:07,414][52664] Sum rewards: 88.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.870', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.420', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '75.000'} [2024-08-06 06:04:07,666][52662] DAMAGECOUNT value on done: 706067.0 [2024-08-06 06:04:07,667][52662] Sum rewards: 85.548, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.060', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.322', 'WEAPON3': '1.950', 'weapon3': '3.258', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '76.000'} [2024-08-06 06:04:07,804][52567] Fps is (10 sec: 17186.4, 60 sec: 17473.4, 300 sec: 17494.2). Total num frames: 540467200. Throughput: 0: 4373.0. Samples: 135121520. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:07,812][52567] Avg episode reward: [(0, '74.481')] [2024-08-06 06:04:07,999][52820] DAMAGECOUNT value on done: 640930.0 [2024-08-06 06:04:07,999][52820] Sum rewards: 61.628, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.130', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.104', 'AMMO4': '0.243', 'AMMO3': '0.269', 'weapon5': '0.292', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.752', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '56.000'} [2024-08-06 06:04:08,597][52649] DAMAGECOUNT value on done: 693284.0 [2024-08-06 06:04:08,598][52649] Sum rewards: 63.486, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.926', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.146', 'weapon4': '0.266', 'weapon5': '0.266', 'AMMO4': '0.320', 'weapon2': '0.382', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '53.000'} [2024-08-06 06:04:08,779][52660] DAMAGECOUNT value on done: 713744.0 [2024-08-06 06:04:08,779][52660] Sum rewards: 77.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.018', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.190', 'AMMO3': '0.213', 'weapon2': '0.840', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:08,943][52668] DAMAGECOUNT value on done: 700795.0 [2024-08-06 06:04:08,944][52668] Sum rewards: 63.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.116', 'AMMO5': '0.013', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.130', 'weapon4': '0.148', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.896', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:09,412][52811] DAMAGECOUNT value on done: 651271.0 [2024-08-06 06:04:09,414][52811] Sum rewards: 63.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.025', 'AMMO2': '0.059', 'AMMO3': '0.191', 'weapon5': '0.198', 'AMMO4': '0.294', 'weapon2': '0.396', 'weapon4': '0.444', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.578', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:10,321][52650] Updated weights for policy 0, policy_version 65981 (0.0010) [2024-08-06 06:04:10,492][52662] DAMAGECOUNT value on done: 713034.0 [2024-08-06 06:04:10,493][52662] Sum rewards: 58.041, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.818', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon5': '0.192', 'weapon4': '0.224', 'AMMO4': '0.236', 'AMMO3': '0.258', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '51.000'} [2024-08-06 06:04:10,600][52664] DAMAGECOUNT value on done: 734755.0 [2024-08-06 06:04:10,600][52664] Sum rewards: 76.748, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO3': '0.168', 'AMMO4': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:10,638][52795] DAMAGECOUNT value on done: 649373.0 [2024-08-06 06:04:10,639][52795] Sum rewards: 75.836, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.116', 'AMMO4': '0.196', 'AMMO3': '0.201', 'weapon2': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:11,185][52820] DAMAGECOUNT value on done: 651376.0 [2024-08-06 06:04:11,185][52820] Sum rewards: 72.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.070', 'AMMO4': '0.163', 'AMMO3': '0.175', 'weapon5': '0.204', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '56.000'} [2024-08-06 06:04:11,741][52660] DAMAGECOUNT value on done: 698843.0 [2024-08-06 06:04:11,743][52660] Sum rewards: 82.189, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO4': '0.160', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:11,827][52649] DAMAGECOUNT value on done: 687964.0 [2024-08-06 06:04:11,827][52649] Sum rewards: 64.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.120', 'weapon4': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '54.500'} [2024-08-06 06:04:11,854][52668] DAMAGECOUNT value on done: 699193.0 [2024-08-06 06:04:11,855][52668] Sum rewards: 74.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.128', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'weapon5': '0.104', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:12,414][52811] DAMAGECOUNT value on done: 664343.0 [2024-08-06 06:04:12,414][52811] Sum rewards: 74.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.363', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.132', 'AMMO4': '0.141', 'AMMO3': '0.178', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '59.500'} [2024-08-06 06:04:12,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 540565504. Throughput: 0: 4376.7. Samples: 135147710. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:12,794][52567] Avg episode reward: [(0, '74.001')] [2024-08-06 06:04:13,709][52664] DAMAGECOUNT value on done: 734904.0 [2024-08-06 06:04:13,710][52664] Sum rewards: 82.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.771', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.184', 'weapon5': '0.242', 'weapon4': '0.262', 'weapon2': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:13,738][52662] DAMAGECOUNT value on done: 699704.0 [2024-08-06 06:04:13,738][52662] Sum rewards: 79.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.276', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.148', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.438', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:13,767][52795] DAMAGECOUNT value on done: 646825.0 [2024-08-06 06:04:13,767][52795] Sum rewards: 78.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.180', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.158', 'weapon2': '0.168', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON3': '0.950', 'weapon3': '3.076', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:14,293][52660] DAMAGECOUNT value on done: 694169.0 [2024-08-06 06:04:14,293][52660] Sum rewards: 65.996, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.130', 'AMMO3': '0.170', 'AMMO4': '0.170', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.424', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '54.000'} [2024-08-06 06:04:14,356][52820] DAMAGECOUNT value on done: 654037.0 [2024-08-06 06:04:14,356][52820] Sum rewards: 66.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.650', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.088', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon4': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:14,456][52668] DAMAGECOUNT value on done: 706845.0 [2024-08-06 06:04:14,456][52668] Sum rewards: 76.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.760', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:14,615][52649] DAMAGECOUNT value on done: 676364.0 [2024-08-06 06:04:14,616][52649] Sum rewards: 74.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.135', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO3': '0.177', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.400', 'weapon4': '0.534', 'WEAPON3': '1.150', 'weapon3': '2.836', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '61.500'} [2024-08-06 06:04:14,859][52650] Updated weights for policy 0, policy_version 65991 (0.0011) [2024-08-06 06:04:15,416][52811] DAMAGECOUNT value on done: 659392.0 [2024-08-06 06:04:15,416][52811] Sum rewards: 83.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.838', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.186', 'weapon4': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '68.000'} [2024-08-06 06:04:16,239][52662] DAMAGECOUNT value on done: 701449.0 [2024-08-06 06:04:16,242][52662] Sum rewards: 71.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.456', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '59.000'} [2024-08-06 06:04:16,805][52664] DAMAGECOUNT value on done: 737908.0 [2024-08-06 06:04:16,806][52664] Sum rewards: 72.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.120', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.139', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '59.000'} [2024-08-06 06:04:16,892][52795] DAMAGECOUNT value on done: 654166.0 [2024-08-06 06:04:16,893][52795] Sum rewards: 74.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.189', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:17,188][52660] DAMAGECOUNT value on done: 699696.0 [2024-08-06 06:04:17,193][52660] Sum rewards: 70.307, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.142', 'AMMO3': '0.237', 'weapon5': '0.240', 'weapon2': '0.250', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:17,265][52649] DAMAGECOUNT value on done: 692614.0 [2024-08-06 06:04:17,267][52649] Sum rewards: 73.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.857', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.168', 'weapon4': '0.178', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:17,317][52668] DAMAGECOUNT value on done: 704375.0 [2024-08-06 06:04:17,317][52668] Sum rewards: 69.391, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.146', 'weapon2': '0.182', 'AMMO4': '0.184', 'weapon5': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.522', 'WEAPON3': '0.800', 'HEALTH': '0.996', 'weapon3': '2.874', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '53.000'} [2024-08-06 06:04:17,504][52820] DAMAGECOUNT value on done: 650558.0 [2024-08-06 06:04:17,505][52820] Sum rewards: 72.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.016', 'AMMO2': '0.066', 'AMMO3': '0.183', 'weapon2': '0.198', 'weapon5': '0.228', 'weapon4': '0.236', 'AMMO4': '0.330', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.100', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:17,795][52567] Fps is (10 sec: 17219.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 540639232. Throughput: 0: 4373.3. Samples: 135160760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:17,795][52567] Avg episode reward: [(0, '74.000')] [2024-08-06 06:04:18,500][52811] DAMAGECOUNT value on done: 662032.0 [2024-08-06 06:04:18,500][52811] Sum rewards: 79.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.030', 'weapon4': '0.036', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:18,524][52614] Signal inference workers to stop experience collection... (12000 times) [2024-08-06 06:04:18,525][52614] Signal inference workers to resume experience collection... (12000 times) [2024-08-06 06:04:18,618][52650] InferenceWorker_p0-w0: stopping experience collection (12000 times) [2024-08-06 06:04:18,622][52650] InferenceWorker_p0-w0: resuming experience collection (12000 times) [2024-08-06 06:04:19,110][52662] DAMAGECOUNT value on done: 699555.0 [2024-08-06 06:04:19,119][52662] Sum rewards: 72.013, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.070', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.064', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.281', 'weapon2': '0.416', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:19,665][52650] Updated weights for policy 0, policy_version 66001 (0.0012) [2024-08-06 06:04:20,008][52664] DAMAGECOUNT value on done: 739044.0 [2024-08-06 06:04:20,010][52664] Sum rewards: 68.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.174', 'AMMO4': '0.226', 'weapon2': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2024-08-06 06:04:20,030][52795] DAMAGECOUNT value on done: 648607.0 [2024-08-06 06:04:20,031][52795] Sum rewards: 79.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.501', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.243', 'WEAPON3': '1.550', 'weapon3': '3.408', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '67.000'} [2024-08-06 06:04:20,365][52649] DAMAGECOUNT value on done: 685482.0 [2024-08-06 06:04:20,369][52649] Sum rewards: 77.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.338', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.038', 'weapon5': '0.074', 'AMMO3': '0.182', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.190', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:20,465][52660] DAMAGECOUNT value on done: 711268.0 [2024-08-06 06:04:20,467][52660] Sum rewards: 81.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.697', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon2': '0.200', 'AMMO3': '0.231', 'WEAPON3': '1.400', 'weapon3': '3.546', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.970', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:20,518][52820] DAMAGECOUNT value on done: 659275.0 [2024-08-06 06:04:20,519][52820] Sum rewards: 83.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.602', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'AMMO3': '0.202', 'weapon5': '0.256', 'weapon2': '0.280', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.006', 'FRAGCOUNT': '67.000'} [2024-08-06 06:04:21,194][52670] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:04:21,601][52811] DAMAGECOUNT value on done: 663817.0 [2024-08-06 06:04:21,602][52811] Sum rewards: 73.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.004', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO2': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.202', 'AMMO3': '0.203', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.408', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2024-08-06 06:04:22,148][52662] DAMAGECOUNT value on done: 708956.0 [2024-08-06 06:04:22,149][52662] Sum rewards: 75.681, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.248', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.138', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.294', 'weapon2': '0.564', 'WEAPON3': '1.700', 'weapon3': '2.832', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:22,781][52664] DAMAGECOUNT value on done: 733481.0 [2024-08-06 06:04:22,781][52664] Sum rewards: 75.376, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.310', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.130', 'weapon5': '0.198', 'weapon2': '0.228', 'AMMO4': '0.236', 'AMMO3': '0.257', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 06:04:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 540729344. Throughput: 0: 4379.8. Samples: 135187080. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:22,794][52567] Avg episode reward: [(0, '74.079')] [2024-08-06 06:04:23,134][52795] DAMAGECOUNT value on done: 644886.0 [2024-08-06 06:04:23,135][52795] Sum rewards: 72.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'AMMO5': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.238', 'weapon5': '0.258', 'AMMO4': '0.303', 'weapon2': '0.494', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.314', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:23,302][52660] DAMAGECOUNT value on done: 694571.0 [2024-08-06 06:04:23,302][52660] Sum rewards: 74.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.335', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.115', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.231', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:23,588][52649] DAMAGECOUNT value on done: 687545.0 [2024-08-06 06:04:23,588][52649] Sum rewards: 78.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.154', 'weapon5': '0.182', 'AMMO3': '0.230', 'AMMO4': '0.291', 'weapon2': '0.374', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:23,630][52820] DAMAGECOUNT value on done: 646395.0 [2024-08-06 06:04:23,630][52820] Sum rewards: 78.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.232', 'weapon4': '0.242', 'WEAPON3': '1.050', 'weapon3': '3.318', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:24,146][52650] Updated weights for policy 0, policy_version 66011 (0.0011) [2024-08-06 06:04:24,499][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:04:24,635][52662] DAMAGECOUNT value on done: 697909.0 [2024-08-06 06:04:24,636][52662] Sum rewards: 57.208, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '3.154', 'DAMAGECOUNT': '14.916', 'FRAGCOUNT': '50.000'} [2024-08-06 06:04:24,907][52811] DAMAGECOUNT value on done: 658551.0 [2024-08-06 06:04:24,908][52811] Sum rewards: 71.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.578', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.192', 'weapon2': '0.198', 'weapon5': '0.266', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:25,491][52664] DAMAGECOUNT value on done: 726291.0 [2024-08-06 06:04:25,492][52664] Sum rewards: 75.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:26,241][52649] DAMAGECOUNT value on done: 687470.0 [2024-08-06 06:04:26,242][52649] Sum rewards: 66.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.718', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.154', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO4': '0.301', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:26,312][52795] DAMAGECOUNT value on done: 644122.0 [2024-08-06 06:04:26,313][52795] Sum rewards: 83.589, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.156', 'weapon4': '0.164', 'AMMO3': '0.165', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.821', 'WEAPON3': '0.850', 'weapon3': '3.188', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '67.000'} [2024-08-06 06:04:26,513][52660] DAMAGECOUNT value on done: 699216.0 [2024-08-06 06:04:26,514][52660] Sum rewards: 80.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.124', 'AMMO3': '0.210', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:26,782][52820] DAMAGECOUNT value on done: 652072.0 [2024-08-06 06:04:26,782][52820] Sum rewards: 75.616, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.354', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.114', 'weapon5': '0.116', 'AMMO4': '0.207', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:27,473][52662] DAMAGECOUNT value on done: 713271.0 [2024-08-06 06:04:27,473][52662] Sum rewards: 73.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.930', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.348', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:27,794][52567] Fps is (10 sec: 18023.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 540819456. Throughput: 0: 4375.8. Samples: 135213310. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:27,794][52567] Avg episode reward: [(0, '74.260')] [2024-08-06 06:04:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066018_540819456.pth... [2024-08-06 06:04:27,919][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000065506_536625152.pth [2024-08-06 06:04:27,993][52811] DAMAGECOUNT value on done: 657113.0 [2024-08-06 06:04:27,994][52811] Sum rewards: 67.867, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.964', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.160', 'weapon5': '0.224', 'AMMO3': '0.258', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '57.500'} [2024-08-06 06:04:28,229][52664] DAMAGECOUNT value on done: 729090.0 [2024-08-06 06:04:28,231][52664] Sum rewards: 72.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.110', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.248', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.386', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '61.500'} [2024-08-06 06:04:28,509][52820] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:04:29,022][52650] Updated weights for policy 0, policy_version 66021 (0.0019) [2024-08-06 06:04:29,296][52649] DAMAGECOUNT value on done: 680248.0 [2024-08-06 06:04:29,296][52649] Sum rewards: 82.794, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.277', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.238', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '71.000'} [2024-08-06 06:04:29,322][52660] DAMAGECOUNT value on done: 704610.0 [2024-08-06 06:04:29,324][52660] Sum rewards: 74.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.616', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.150', 'weapon5': '0.206', 'AMMO3': '0.227', 'AMMO4': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:29,523][52795] DAMAGECOUNT value on done: 655309.0 [2024-08-06 06:04:29,525][52795] Sum rewards: 79.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.361', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon4': '0.196', 'weapon2': '0.204', 'weapon5': '0.218', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:29,971][52820] DAMAGECOUNT value on done: 661746.0 [2024-08-06 06:04:29,971][52820] Sum rewards: 81.249, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.610', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.279', 'weapon2': '0.294', 'WEAPON3': '1.800', 'weapon3': '3.386', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '70.000'} [2024-08-06 06:04:30,521][52662] DAMAGECOUNT value on done: 708722.0 [2024-08-06 06:04:30,523][52662] Sum rewards: 58.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.160', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.220', 'weapon4': '0.228', 'AMMO3': '0.236', 'weapon2': '0.266', 'AMMO4': '0.279', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.750', 'weapon3': '3.052', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '51.000'} [2024-08-06 06:04:31,096][52664] DAMAGECOUNT value on done: 728951.0 [2024-08-06 06:04:31,097][52664] Sum rewards: 81.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.626', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.176', 'weapon2': '0.292', 'WEAPON3': '1.100', 'weapon3': '3.516', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:31,394][52811] DAMAGECOUNT value on done: 655488.0 [2024-08-06 06:04:31,396][52811] Sum rewards: 79.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.516', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.098', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '64.000'} [2024-08-06 06:04:31,946][52803] DAMAGECOUNT value on done: 653769.0 [2024-08-06 06:04:31,948][52803] Sum rewards: 58.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.915', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.172', 'AMMO4': '0.188', 'weapon4': '0.198', 'AMMO3': '0.252', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.955', 'FRAGCOUNT': '51.000'} [2024-08-06 06:04:32,421][52649] DAMAGECOUNT value on done: 693891.0 [2024-08-06 06:04:32,421][52649] Sum rewards: 69.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.076', 'weapon5': '0.082', 'AMMO4': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.602', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:32,485][52660] DAMAGECOUNT value on done: 697069.0 [2024-08-06 06:04:32,485][52660] Sum rewards: 77.049, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.400', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.094', 'weapon4': '0.168', 'AMMO4': '0.203', 'AMMO3': '0.280', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.108', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '68.000'} [2024-08-06 06:04:32,706][52795] DAMAGECOUNT value on done: 640196.0 [2024-08-06 06:04:32,706][52795] Sum rewards: 75.187, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.370', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.142', 'weapon5': '0.216', 'AMMO4': '0.232', 'AMMO3': '0.255', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 06:04:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 540909568. Throughput: 0: 4360.9. Samples: 135225930. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:32,794][52567] Avg episode reward: [(0, '74.060')] [2024-08-06 06:04:33,129][52820] DAMAGECOUNT value on done: 655290.0 [2024-08-06 06:04:33,131][52820] Sum rewards: 81.753, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:33,500][52662] DAMAGECOUNT value on done: 695069.0 [2024-08-06 06:04:33,501][52662] Sum rewards: 83.789, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.022', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.196', 'weapon5': '0.236', 'AMMO3': '0.267', 'AMMO4': '0.281', 'weapon2': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.934', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '72.000'} [2024-08-06 06:04:33,778][52650] Updated weights for policy 0, policy_version 66031 (0.0036) [2024-08-06 06:04:33,857][52664] DAMAGECOUNT value on done: 728653.0 [2024-08-06 06:04:33,859][52664] Sum rewards: 68.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.031', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.233', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.468', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:34,554][52811] DAMAGECOUNT value on done: 655532.0 [2024-08-06 06:04:34,557][52811] Sum rewards: 73.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.686', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.112', 'weapon4': '0.128', 'AMMO4': '0.146', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:35,058][52803] DAMAGECOUNT value on done: 653846.0 [2024-08-06 06:04:35,058][52803] Sum rewards: 74.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.752', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.104', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.368', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:35,450][52649] DAMAGECOUNT value on done: 694594.0 [2024-08-06 06:04:35,453][52649] Sum rewards: 66.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.092', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'weapon2': '0.316', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:35,596][52660] DAMAGECOUNT value on done: 701866.0 [2024-08-06 06:04:35,606][52660] Sum rewards: 82.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.661', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.468', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '69.000'} [2024-08-06 06:04:35,879][52795] DAMAGECOUNT value on done: 657945.0 [2024-08-06 06:04:35,879][52795] Sum rewards: 70.315, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.088', 'weapon5': '0.204', 'AMMO3': '0.211', 'AMMO4': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '59.000'} [2024-08-06 06:04:36,283][52820] DAMAGECOUNT value on done: 657436.0 [2024-08-06 06:04:36,286][52820] Sum rewards: 75.343, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.070', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.098', 'AMMO4': '0.197', 'weapon2': '0.246', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.358', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '67.000'} [2024-08-06 06:04:36,670][52662] DAMAGECOUNT value on done: 704218.0 [2024-08-06 06:04:36,671][52662] Sum rewards: 68.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.304', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.136', 'AMMO4': '0.144', 'weapon2': '0.224', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.294', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '58.000'} [2024-08-06 06:04:37,622][52811] DAMAGECOUNT value on done: 660028.0 [2024-08-06 06:04:37,625][52811] Sum rewards: 73.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.994', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.202', 'weapon5': '0.228', 'weapon4': '0.260', 'AMMO4': '0.282', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '58.000'} [2024-08-06 06:04:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 540991488. Throughput: 0: 4367.1. Samples: 135252310. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:37,794][52567] Avg episode reward: [(0, '73.500')] [2024-08-06 06:04:37,823][52649] DAMAGECOUNT value on done: 694089.0 [2024-08-06 06:04:37,823][52649] Sum rewards: 65.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.069', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.120', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.316', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '2.824', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '56.000'} [2024-08-06 06:04:38,182][52650] Updated weights for policy 0, policy_version 66041 (0.0025) [2024-08-06 06:04:38,279][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:04:38,323][52803] DAMAGECOUNT value on done: 659782.0 [2024-08-06 06:04:38,326][52803] Sum rewards: 66.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.704', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.182', 'AMMO3': '0.188', 'weapon5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:38,559][52660] DAMAGECOUNT value on done: 711503.0 [2024-08-06 06:04:38,559][52660] Sum rewards: 59.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.074', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '51.000'} [2024-08-06 06:04:38,961][52795] DAMAGECOUNT value on done: 651494.0 [2024-08-06 06:04:38,962][52795] Sum rewards: 71.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.742', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.362', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '56.000'} [2024-08-06 06:04:39,125][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:04:39,348][52820] DAMAGECOUNT value on done: 653627.0 [2024-08-06 06:04:39,348][52820] Sum rewards: 86.436, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.031', 'HEALTH': '0.060', 'weapon4': '0.070', 'AMMO4': '0.157', 'AMMO3': '0.176', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.000', 'weapon3': '3.166', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '70.000'} [2024-08-06 06:04:39,748][52662] DAMAGECOUNT value on done: 695872.0 [2024-08-06 06:04:39,748][52662] Sum rewards: 70.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'weapon4': '0.204', 'AMMO3': '0.205', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.344', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:39,831][52647] DAMAGECOUNT value on done: 746382.0 [2024-08-06 06:04:39,831][52647] Sum rewards: 76.089, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.934', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'weapon3': '3.282', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '67.000'} [2024-08-06 06:04:40,634][52649] DAMAGECOUNT value on done: 692901.0 [2024-08-06 06:04:40,635][52649] Sum rewards: 85.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.887', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.084', 'AMMO4': '0.116', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.574', 'FRAGCOUNT': '68.000'} [2024-08-06 06:04:40,901][52811] DAMAGECOUNT value on done: 663091.0 [2024-08-06 06:04:40,904][52811] Sum rewards: 75.621, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.013', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.078', 'weapon4': '0.114', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.252', 'WEAPON3': '1.050', 'weapon3': '3.388', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:41,089][52659] DAMAGECOUNT value on done: 706688.0 [2024-08-06 06:04:41,090][52659] Sum rewards: 62.377, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.326', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon5': '0.156', 'weapon4': '0.244', 'AMMO3': '0.267', 'AMMO4': '0.323', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.970', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:41,428][52660] DAMAGECOUNT value on done: 721377.0 [2024-08-06 06:04:41,430][52660] Sum rewards: 92.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.662', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.147', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.096', 'FRAGCOUNT': '76.000'} [2024-08-06 06:04:41,542][52803] DAMAGECOUNT value on done: 660345.0 [2024-08-06 06:04:41,543][52803] Sum rewards: 76.723, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.199', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.132', 'AMMO3': '0.140', 'weapon5': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.132', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:42,393][52795] DAMAGECOUNT value on done: 643716.0 [2024-08-06 06:04:42,393][52795] Sum rewards: 72.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.942', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.126', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.257', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:42,560][52820] DAMAGECOUNT value on done: 655705.0 [2024-08-06 06:04:42,563][52820] Sum rewards: 80.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.512', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.092', 'AMMO4': '0.187', 'weapon5': '0.202', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 541081600. Throughput: 0: 4355.3. Samples: 135278270. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:04:42,794][52567] Avg episode reward: [(0, '73.935')] [2024-08-06 06:04:43,217][52647] DAMAGECOUNT value on done: 737275.0 [2024-08-06 06:04:43,217][52647] Sum rewards: 77.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.157', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON3': '1.200', 'HITCOUNT': '3.420', 'weapon3': '3.422', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:43,361][52649] DAMAGECOUNT value on done: 678117.0 [2024-08-06 06:04:43,363][52649] Sum rewards: 66.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.845', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.068', 'AMMO3': '0.179', 'AMMO4': '0.183', 'weapon5': '0.194', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '54.000'} [2024-08-06 06:04:43,638][52650] Updated weights for policy 0, policy_version 66051 (0.0023) [2024-08-06 06:04:43,747][52659] DAMAGECOUNT value on done: 705763.0 [2024-08-06 06:04:43,748][52659] Sum rewards: 75.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:43,936][52811] DAMAGECOUNT value on done: 659738.0 [2024-08-06 06:04:43,938][52811] Sum rewards: 76.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.033', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:44,343][52660] DAMAGECOUNT value on done: 700003.0 [2024-08-06 06:04:44,345][52660] Sum rewards: 86.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.162', 'weapon5': '0.174', 'AMMO3': '0.214', 'AMMO4': '0.218', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '70.000'} [2024-08-06 06:04:44,616][52803] DAMAGECOUNT value on done: 658535.0 [2024-08-06 06:04:44,616][52803] Sum rewards: 74.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.132', 'weapon5': '0.154', 'AMMO4': '0.179', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:45,652][52820] DAMAGECOUNT value on done: 665519.0 [2024-08-06 06:04:45,660][52820] Sum rewards: 73.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.102', 'AMMO4': '0.146', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:45,667][52795] DAMAGECOUNT value on done: 651514.0 [2024-08-06 06:04:45,668][52795] Sum rewards: 71.150, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.833', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.164', 'weapon4': '0.184', 'weapon2': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.310', 'WEAPON3': '1.800', 'weapon3': '3.154', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:46,040][52649] DAMAGECOUNT value on done: 689835.0 [2024-08-06 06:04:46,041][52649] Sum rewards: 88.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.022', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.137', 'AMMO3': '0.215', 'weapon5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '73.000'} [2024-08-06 06:04:46,147][52659] DAMAGECOUNT value on done: 707730.0 [2024-08-06 06:04:46,148][52659] Sum rewards: 82.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.464', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '68.000'} [2024-08-06 06:04:46,159][52647] DAMAGECOUNT value on done: 744691.0 [2024-08-06 06:04:46,159][52647] Sum rewards: 80.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.089', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.154', 'weapon2': '0.198', 'AMMO4': '0.210', 'weapon5': '0.250', 'weapon4': '0.406', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.896', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '65.000'} [2024-08-06 06:04:47,166][52811] DAMAGECOUNT value on done: 656778.0 [2024-08-06 06:04:47,168][52811] Sum rewards: 80.895, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.192', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.242', 'AMMO3': '0.258', 'WEAPON3': '1.650', 'weapon3': '3.392', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.928', 'FRAGCOUNT': '69.000'} [2024-08-06 06:04:47,479][52650] Updated weights for policy 0, policy_version 66061 (0.0013) [2024-08-06 06:04:47,489][52660] DAMAGECOUNT value on done: 707212.0 [2024-08-06 06:04:47,491][52660] Sum rewards: 71.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.142', 'weapon2': '0.230', 'AMMO3': '0.250', 'weapon5': '0.290', 'AMMO4': '0.299', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 541171712. Throughput: 0: 4357.1. Samples: 135291360. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:04:47,794][52567] Avg episode reward: [(0, '74.385')] [2024-08-06 06:04:47,880][52803] DAMAGECOUNT value on done: 652901.0 [2024-08-06 06:04:47,880][52803] Sum rewards: 69.766, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.810', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.170', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon2': '0.280', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '54.000'} [2024-08-06 06:04:48,668][52647] DAMAGECOUNT value on done: 744270.0 [2024-08-06 06:04:48,668][52647] Sum rewards: 70.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.865', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.056', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '58.000'} [2024-08-06 06:04:48,779][52795] DAMAGECOUNT value on done: 659980.0 [2024-08-06 06:04:48,780][52795] Sum rewards: 79.783, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.084', 'AMMO4': '0.127', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.291', 'WEAPON3': '1.650', 'weapon3': '3.356', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '68.000'} [2024-08-06 06:04:48,922][52820] DAMAGECOUNT value on done: 663596.0 [2024-08-06 06:04:48,923][52820] Sum rewards: 79.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.678', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.148', 'weapon5': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.245', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '66.000'} [2024-08-06 06:04:49,053][52649] DAMAGECOUNT value on done: 678417.0 [2024-08-06 06:04:49,055][52649] Sum rewards: 68.953, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.143', 'AMMO3': '0.170', 'weapon4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '54.000'} [2024-08-06 06:04:49,682][52659] DAMAGECOUNT value on done: 705816.0 [2024-08-06 06:04:49,683][52659] Sum rewards: 75.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.910', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.148', 'weapon5': '0.196', 'AMMO3': '0.231', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '63.500'} [2024-08-06 06:04:50,118][52660] DAMAGECOUNT value on done: 703582.0 [2024-08-06 06:04:50,121][52660] Sum rewards: 71.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-4.125', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.054', 'AMMO4': '0.135', 'weapon5': '0.136', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '59.000'} [2024-08-06 06:04:50,655][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:04:50,850][52667] DAMAGECOUNT value on done: 704865.0 [2024-08-06 06:04:50,850][52667] Sum rewards: 61.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.303', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.344', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '50.000'} [2024-08-06 06:04:51,001][52803] DAMAGECOUNT value on done: 649782.0 [2024-08-06 06:04:51,001][52803] Sum rewards: 71.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:51,649][52647] DAMAGECOUNT value on done: 750728.0 [2024-08-06 06:04:51,649][52647] Sum rewards: 66.589, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.708', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon4': '0.128', 'AMMO3': '0.190', 'weapon5': '0.242', 'AMMO4': '0.321', 'weapon2': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.026', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:52,175][52649] DAMAGECOUNT value on done: 693667.0 [2024-08-06 06:04:52,175][52649] Sum rewards: 68.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.190', 'AMMO4': '0.204', 'weapon5': '0.204', 'weapon4': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.798', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '54.000'} [2024-08-06 06:04:52,227][52820] DAMAGECOUNT value on done: 651099.0 [2024-08-06 06:04:52,229][52820] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.512', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.196', 'AMMO3': '0.280', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.220', 'weapon3': '3.236', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '64.000'} [2024-08-06 06:04:52,615][52650] Updated weights for policy 0, policy_version 66071 (0.0018) [2024-08-06 06:04:52,725][52659] DAMAGECOUNT value on done: 703090.0 [2024-08-06 06:04:52,726][52659] Sum rewards: 82.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.765', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.064', 'AMMO4': '0.176', 'weapon5': '0.196', 'weapon2': '0.198', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.802', 'FRAGCOUNT': '68.000'} [2024-08-06 06:04:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 541253632. Throughput: 0: 4357.2. Samples: 135317550. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:04:52,795][52567] Avg episode reward: [(0, '74.452')] [2024-08-06 06:04:53,184][52660] DAMAGECOUNT value on done: 697908.0 [2024-08-06 06:04:53,185][52660] Sum rewards: 70.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.080', 'AMMO4': '0.151', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '58.000'} [2024-08-06 06:04:53,776][52667] DAMAGECOUNT value on done: 712001.0 [2024-08-06 06:04:53,777][52667] Sum rewards: 70.560, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.940', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.134', 'weapon2': '0.222', 'AMMO4': '0.224', 'weapon5': '0.230', 'AMMO3': '0.275', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '63.000'} [2024-08-06 06:04:54,116][52803] DAMAGECOUNT value on done: 647851.0 [2024-08-06 06:04:54,116][52803] Sum rewards: 71.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.078', 'weapon5': '0.128', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.428', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '62.000'} [2024-08-06 06:04:54,498][52647] DAMAGECOUNT value on done: 749509.0 [2024-08-06 06:04:54,499][52647] Sum rewards: 94.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.500', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.072', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '21.480', 'FRAGCOUNT': '79.000'} [2024-08-06 06:04:54,963][52649] DAMAGECOUNT value on done: 693302.0 [2024-08-06 06:04:54,965][52649] Sum rewards: 71.309, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.930', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '57.000'} [2024-08-06 06:04:55,810][52659] DAMAGECOUNT value on done: 707848.0 [2024-08-06 06:04:55,811][52659] Sum rewards: 76.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon4': '0.230', 'weapon5': '0.256', 'AMMO3': '0.267', 'AMMO4': '0.287', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.674', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '64.000'} [2024-08-06 06:04:55,963][52660] DAMAGECOUNT value on done: 693251.0 [2024-08-06 06:04:55,965][52660] Sum rewards: 69.467, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.818', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon5': '0.138', 'weapon4': '0.162', 'AMMO4': '0.164', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 06:04:56,876][52667] DAMAGECOUNT value on done: 707018.0 [2024-08-06 06:04:56,876][52667] Sum rewards: 73.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.800', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.152', 'AMMO3': '0.179', 'weapon2': '0.188', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:57,143][52647] DAMAGECOUNT value on done: 746880.0 [2024-08-06 06:04:57,144][52647] Sum rewards: 67.142, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.124', 'weapon5': '0.128', 'AMMO4': '0.159', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.494', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '55.000'} [2024-08-06 06:04:57,240][52803] DAMAGECOUNT value on done: 653235.0 [2024-08-06 06:04:57,241][52803] Sum rewards: 69.006, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.690', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.108', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.262', 'AMMO3': '0.287', 'WEAPON3': '1.800', 'weapon3': '3.272', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '60.500'} [2024-08-06 06:04:57,521][52650] Updated weights for policy 0, policy_version 66081 (0.0023) [2024-08-06 06:04:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 541343744. Throughput: 0: 4347.5. Samples: 135343350. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:04:57,795][52567] Avg episode reward: [(0, '74.345')] [2024-08-06 06:04:57,973][52649] DAMAGECOUNT value on done: 687084.0 [2024-08-06 06:04:57,976][52649] Sum rewards: 76.115, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.055', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.054', 'weapon5': '0.098', 'AMMO4': '0.108', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.340', 'WEAPON3': '1.100', 'weapon3': '3.364', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '61.000'} [2024-08-06 06:04:58,987][52659] DAMAGECOUNT value on done: 706276.0 [2024-08-06 06:04:58,987][52659] Sum rewards: 80.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.598', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.074', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.248', 'AMMO3': '0.253', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '67.000'} [2024-08-06 06:04:59,483][52667] DAMAGECOUNT value on done: 711522.0 [2024-08-06 06:04:59,483][52667] Sum rewards: 70.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.963', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.180', 'AMMO4': '0.191', 'weapon4': '0.220', 'AMMO3': '0.248', 'weapon2': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '60.000'} [2024-08-06 06:04:59,762][52647] DAMAGECOUNT value on done: 730085.0 [2024-08-06 06:04:59,763][52647] Sum rewards: 74.247, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.770', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '59.500'} [2024-08-06 06:05:00,448][52803] DAMAGECOUNT value on done: 651780.0 [2024-08-06 06:05:00,449][52803] Sum rewards: 60.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.455', 'AMMO5': '0.021', 'AMMO2': '0.044', 'AMMO4': '0.222', 'weapon4': '0.224', 'weapon2': '0.240', 'AMMO3': '0.247', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '52.000'} [2024-08-06 06:05:01,816][52650] Updated weights for policy 0, policy_version 66091 (0.0032) [2024-08-06 06:05:01,978][52659] DAMAGECOUNT value on done: 702185.0 [2024-08-06 06:05:01,978][52659] Sum rewards: 82.814, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.977', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.380', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '66.000'} [2024-08-06 06:05:02,295][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:05:02,389][52667] DAMAGECOUNT value on done: 710995.0 [2024-08-06 06:05:02,390][52667] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.352', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.052', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.260', 'AMMO3': '0.264', 'weapon2': '0.442', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '63.000'} [2024-08-06 06:05:02,391][52665] DAMAGECOUNT value on done: 690278.0 [2024-08-06 06:05:02,391][52665] Sum rewards: 82.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.052', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.056', 'AMMO4': '0.120', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.378', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '69.000'} [2024-08-06 06:05:02,570][52794] DAMAGECOUNT value on done: 704014.0 [2024-08-06 06:05:02,571][52794] Sum rewards: 77.351, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.372', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.082', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '66.000'} [2024-08-06 06:05:02,760][52647] DAMAGECOUNT value on done: 745962.0 [2024-08-06 06:05:02,760][52647] Sum rewards: 78.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.110', 'weapon5': '0.128', 'AMMO3': '0.206', 'AMMO4': '0.253', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '65.000'} [2024-08-06 06:05:02,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 541425664. Throughput: 0: 4347.1. Samples: 135356380. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:05:02,795][52567] Avg episode reward: [(0, '74.501')] [2024-08-06 06:05:03,697][52803] DAMAGECOUNT value on done: 665947.0 [2024-08-06 06:05:03,700][52803] Sum rewards: 70.966, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.385', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.640', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.168', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '57.500'} [2024-08-06 06:05:04,749][52659] DAMAGECOUNT value on done: 706931.0 [2024-08-06 06:05:04,750][52659] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.993', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.386', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '58.500'} [2024-08-06 06:05:05,547][52667] DAMAGECOUNT value on done: 714097.0 [2024-08-06 06:05:05,551][52667] Sum rewards: 73.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.984', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.190', 'weapon5': '0.260', 'AMMO4': '0.272', 'weapon4': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.498', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '58.500'} [2024-08-06 06:05:05,596][52665] DAMAGECOUNT value on done: 707250.0 [2024-08-06 06:05:05,598][52665] Sum rewards: 77.299, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.448', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.241', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '67.000'} [2024-08-06 06:05:05,646][52647] DAMAGECOUNT value on done: 743122.0 [2024-08-06 06:05:05,646][52647] Sum rewards: 73.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.985', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.142', 'weapon2': '0.164', 'weapon5': '0.180', 'AMMO4': '0.249', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.194', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:05,809][52794] DAMAGECOUNT value on done: 710214.0 [2024-08-06 06:05:05,811][52794] Sum rewards: 61.479, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'ARMOR': '0.016', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.202', 'HEALTH': '0.510', 'weapon2': '0.574', 'WEAPON3': '1.050', 'HITCOUNT': '2.830', 'weapon3': '3.018', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '50.000'} [2024-08-06 06:05:06,758][52650] Updated weights for policy 0, policy_version 66101 (0.0014) [2024-08-06 06:05:06,782][52803] DAMAGECOUNT value on done: 656701.0 [2024-08-06 06:05:06,784][52803] Sum rewards: 70.885, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.140', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.104', 'weapon5': '0.118', 'AMMO4': '0.133', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:07,310][52659] DAMAGECOUNT value on done: 712200.0 [2024-08-06 06:05:07,312][52659] Sum rewards: 73.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.448', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon2': '0.188', 'weapon5': '0.192', 'weapon4': '0.224', 'AMMO4': '0.252', 'AMMO3': '0.255', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:07,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17342.5, 300 sec: 17439.2). Total num frames: 541507584. Throughput: 0: 4342.9. Samples: 135382510. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:05:07,795][52567] Avg episode reward: [(0, '74.065')] [2024-08-06 06:05:08,469][52667] DAMAGECOUNT value on done: 709966.0 [2024-08-06 06:05:08,471][52667] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.698', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.098', 'AMMO3': '0.212', 'weapon4': '0.212', 'weapon2': '0.218', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:08,698][52647] DAMAGECOUNT value on done: 742586.0 [2024-08-06 06:05:08,698][52647] Sum rewards: 90.400, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.221', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.548', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.798', 'FRAGCOUNT': '73.000'} [2024-08-06 06:05:08,704][52794] DAMAGECOUNT value on done: 714202.0 [2024-08-06 06:05:08,706][52794] Sum rewards: 67.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.050', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.486', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:09,058][52665] DAMAGECOUNT value on done: 706770.0 [2024-08-06 06:05:09,058][52665] Sum rewards: 87.828, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.916', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.124', 'AMMO4': '0.179', 'AMMO3': '0.254', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.234', 'FRAGCOUNT': '74.000'} [2024-08-06 06:05:09,736][52803] DAMAGECOUNT value on done: 655947.0 [2024-08-06 06:05:09,737][52803] Sum rewards: 81.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.482', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.132', 'weapon4': '0.142', 'weapon2': '0.144', 'AMMO4': '0.176', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '67.000'} [2024-08-06 06:05:09,989][52659] DAMAGECOUNT value on done: 699102.0 [2024-08-06 06:05:09,996][52659] Sum rewards: 72.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.019', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.191', 'weapon2': '0.232', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.572', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:10,418][52669] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:05:11,029][52647] DAMAGECOUNT value on done: 734622.0 [2024-08-06 06:05:11,030][52647] Sum rewards: 75.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.169', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.140', 'AMMO3': '0.235', 'WEAPON3': '1.350', 'HITCOUNT': '3.460', 'weapon3': '3.622', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:11,400][52667] DAMAGECOUNT value on done: 708392.0 [2024-08-06 06:05:11,402][52667] Sum rewards: 74.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.359', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.166', 'weapon2': '0.184', 'AMMO3': '0.195', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:11,653][52650] Updated weights for policy 0, policy_version 66111 (0.0018) [2024-08-06 06:05:11,937][52794] DAMAGECOUNT value on done: 699800.0 [2024-08-06 06:05:11,939][52794] Sum rewards: 68.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.140', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.334', 'WEAPON3': '1.800', 'weapon3': '3.284', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '59.000'} [2024-08-06 06:05:12,220][52665] DAMAGECOUNT value on done: 699516.0 [2024-08-06 06:05:12,221][52665] Sum rewards: 82.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.067', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '69.000'} [2024-08-06 06:05:12,683][52803] DAMAGECOUNT value on done: 668676.0 [2024-08-06 06:05:12,683][52803] Sum rewards: 83.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.421', 'AMMO5': '0.004', 'weapon5': '0.026', 'AMMO2': '0.027', 'weapon4': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.231', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '68.000'} [2024-08-06 06:05:12,723][52659] DAMAGECOUNT value on done: 710752.0 [2024-08-06 06:05:12,723][52659] Sum rewards: 66.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'HITCOUNT': '3.160', 'weapon3': '3.398', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '58.000'} [2024-08-06 06:05:12,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 541605888. Throughput: 0: 4344.9. Samples: 135408830. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:05:12,794][52567] Avg episode reward: [(0, '74.469')] [2024-08-06 06:05:13,669][52647] DAMAGECOUNT value on done: 748831.0 [2024-08-06 06:05:13,671][52647] Sum rewards: 62.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.256', 'AMMO5': '0.009', 'weapon4': '0.036', 'AMMO2': '0.046', 'weapon5': '0.064', 'AMMO3': '0.201', 'AMMO4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.236', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '51.500'} [2024-08-06 06:05:14,553][52667] DAMAGECOUNT value on done: 712789.0 [2024-08-06 06:05:14,554][52667] Sum rewards: 68.395, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.100', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.230', 'AMMO4': '0.230', 'AMMO3': '0.267', 'weapon4': '0.322', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.728', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '58.000'} [2024-08-06 06:05:14,559][52794] DAMAGECOUNT value on done: 701728.0 [2024-08-06 06:05:14,559][52794] Sum rewards: 73.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.100', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:15,281][52665] DAMAGECOUNT value on done: 686197.0 [2024-08-06 06:05:15,282][52665] Sum rewards: 64.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.414', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.310', 'weapon4': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.438', 'FRAGCOUNT': '54.000'} [2024-08-06 06:05:15,331][52659] DAMAGECOUNT value on done: 703497.0 [2024-08-06 06:05:15,331][52659] Sum rewards: 88.211, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.598', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.070', 'weapon5': '0.192', 'AMMO4': '0.220', 'AMMO3': '0.244', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.651', 'FRAGCOUNT': '75.000'} [2024-08-06 06:05:15,733][52803] DAMAGECOUNT value on done: 654336.0 [2024-08-06 06:05:15,733][52803] Sum rewards: 75.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.286', 'AMMO2': '0.033', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO4': '0.167', 'weapon2': '0.198', 'AMMO3': '0.218', 'WEAPON3': '1.500', 'HITCOUNT': '3.510', 'weapon3': '3.602', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:15,944][52650] Updated weights for policy 0, policy_version 66121 (0.0026) [2024-08-06 06:05:15,975][52649] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:05:16,148][52803] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:05:16,533][52647] DAMAGECOUNT value on done: 735390.0 [2024-08-06 06:05:16,534][52647] Sum rewards: 85.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.146', 'AMMO4': '0.185', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '73.000'} [2024-08-06 06:05:17,579][52794] DAMAGECOUNT value on done: 704943.0 [2024-08-06 06:05:17,579][52794] Sum rewards: 71.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.977', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.114', 'AMMO3': '0.184', 'weapon4': '0.194', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '59.000'} [2024-08-06 06:05:17,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 541687808. Throughput: 0: 4357.3. Samples: 135422010. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:05:17,794][52567] Avg episode reward: [(0, '74.514')] [2024-08-06 06:05:17,799][52667] DAMAGECOUNT value on done: 716210.0 [2024-08-06 06:05:17,800][52667] Sum rewards: 70.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.810', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.174', 'weapon2': '0.242', 'AMMO3': '0.253', 'AMMO4': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.616', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '59.000'} [2024-08-06 06:05:18,105][52665] DAMAGECOUNT value on done: 693062.0 [2024-08-06 06:05:18,106][52665] Sum rewards: 76.174, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.860', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.076', 'AMMO3': '0.149', 'AMMO4': '0.172', 'weapon5': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.064', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:18,215][52659] DAMAGECOUNT value on done: 706234.0 [2024-08-06 06:05:18,215][52659] Sum rewards: 72.926, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon5': '0.160', 'weapon2': '0.184', 'AMMO3': '0.225', 'AMMO4': '0.243', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.336', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:19,025][52803] DAMAGECOUNT value on done: 656365.0 [2024-08-06 06:05:19,025][52803] Sum rewards: 77.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.054', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.046', 'weapon4': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '3.380', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:19,917][52647] DAMAGECOUNT value on done: 745955.0 [2024-08-06 06:05:19,917][52647] Sum rewards: 69.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.570', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon2': '0.228', 'AMMO3': '0.250', 'weapon5': '0.284', 'AMMO4': '0.318', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.724', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 06:05:20,257][52794] DAMAGECOUNT value on done: 710447.0 [2024-08-06 06:05:20,259][52794] Sum rewards: 77.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '63.000'} [2024-08-06 06:05:20,723][52667] DAMAGECOUNT value on done: 705867.0 [2024-08-06 06:05:20,725][52667] Sum rewards: 72.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.398', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.166', 'AMMO4': '0.187', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.440', 'weapon2': '0.574', 'WEAPON3': '0.950', 'weapon3': '2.530', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '58.500'} [2024-08-06 06:05:20,741][52659] DAMAGECOUNT value on done: 715009.0 [2024-08-06 06:05:20,741][52659] Sum rewards: 81.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.398', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.074', 'AMMO3': '0.217', 'AMMO4': '0.272', 'weapon5': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '67.000'} [2024-08-06 06:05:20,812][52650] Updated weights for policy 0, policy_version 66131 (0.0014) [2024-08-06 06:05:21,127][52665] DAMAGECOUNT value on done: 697899.0 [2024-08-06 06:05:21,128][52665] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.960', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.170', 'weapon2': '0.174', 'AMMO4': '0.175', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.296', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '64.500'} [2024-08-06 06:05:21,424][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:05:22,252][52803] DAMAGECOUNT value on done: 659330.0 [2024-08-06 06:05:22,256][52803] Sum rewards: 63.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.052', 'AMMO3': '0.193', 'AMMO4': '0.198', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '50.500'} [2024-08-06 06:05:22,679][52647] DAMAGECOUNT value on done: 748143.0 [2024-08-06 06:05:22,679][52647] Sum rewards: 69.528, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.265', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.136', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'AMMO3': '0.292', 'WEAPON3': '1.800', 'weapon3': '3.206', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '63.000'} [2024-08-06 06:05:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 541777920. Throughput: 0: 4351.1. Samples: 135448110. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 06:05:22,794][52567] Avg episode reward: [(0, '74.368')] [2024-08-06 06:05:23,369][52794] DAMAGECOUNT value on done: 698589.0 [2024-08-06 06:05:23,370][52794] Sum rewards: 85.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.708', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon4': '0.136', 'AMMO4': '0.195', 'AMMO3': '0.221', 'weapon5': '0.292', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '69.000'} [2024-08-06 06:05:23,537][52667] DAMAGECOUNT value on done: 707263.0 [2024-08-06 06:05:23,537][52667] Sum rewards: 84.221, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.337', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.038', 'AMMO4': '0.069', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '69.000'} [2024-08-06 06:05:23,778][52659] DAMAGECOUNT value on done: 709149.0 [2024-08-06 06:05:23,779][52659] Sum rewards: 72.952, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.082', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '58.000'} [2024-08-06 06:05:23,966][52665] DAMAGECOUNT value on done: 696186.0 [2024-08-06 06:05:23,966][52665] Sum rewards: 80.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.656', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.082', 'weapon4': '0.114', 'AMMO3': '0.180', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.378', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '65.000'} [2024-08-06 06:05:25,188][52803] DAMAGECOUNT value on done: 660455.0 [2024-08-06 06:05:25,189][52803] Sum rewards: 62.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.232', 'FRAGCOUNT': '52.000'} [2024-08-06 06:05:25,290][52647] DAMAGECOUNT value on done: 733325.0 [2024-08-06 06:05:25,291][52647] Sum rewards: 91.500, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.326', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.080', 'weapon4': '0.088', 'AMMO4': '0.104', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '73.000'} [2024-08-06 06:05:25,454][52650] Updated weights for policy 0, policy_version 66141 (0.0031) [2024-08-06 06:05:26,265][52794] DAMAGECOUNT value on done: 709007.0 [2024-08-06 06:05:26,273][52794] Sum rewards: 77.168, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.724', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.124', 'AMMO4': '0.165', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:26,379][52667] DAMAGECOUNT value on done: 712756.0 [2024-08-06 06:05:26,381][52667] Sum rewards: 76.805, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.013', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.112', 'WEAPON5': '0.200', 'weapon4': '0.252', 'AMMO3': '0.255', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '65.000'} [2024-08-06 06:05:26,646][52665] DAMAGECOUNT value on done: 705568.0 [2024-08-06 06:05:26,646][52665] Sum rewards: 83.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.948', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.228', 'weapon4': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '69.000'} [2024-08-06 06:05:26,728][52659] DAMAGECOUNT value on done: 713217.0 [2024-08-06 06:05:26,728][52659] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.106', 'weapon5': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.648', 'WEAPON3': '1.300', 'weapon3': '2.954', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '58.000'} [2024-08-06 06:05:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 541868032. Throughput: 0: 4353.6. Samples: 135474180. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:05:27,794][52567] Avg episode reward: [(0, '74.895')] [2024-08-06 06:05:28,225][52647] DAMAGECOUNT value on done: 739577.0 [2024-08-06 06:05:28,225][52647] Sum rewards: 75.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.988', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.172', 'weapon4': '0.218', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.664', 'WEAPON3': '1.550', 'weapon3': '2.652', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:28,339][52803] DAMAGECOUNT value on done: 666513.0 [2024-08-06 06:05:28,339][52803] Sum rewards: 75.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.934', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.220', 'weapon4': '0.248', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:28,897][52667] DAMAGECOUNT value on done: 701137.0 [2024-08-06 06:05:28,899][52667] Sum rewards: 77.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.396', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.118', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '0.900', 'weapon3': '3.134', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:29,392][52794] DAMAGECOUNT value on done: 699685.0 [2024-08-06 06:05:29,393][52794] Sum rewards: 82.503, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.006', 'HEALTH': '0.014', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.268', 'WEAPON3': '1.200', 'weapon3': '3.438', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '67.000'} [2024-08-06 06:05:29,651][52665] DAMAGECOUNT value on done: 698417.0 [2024-08-06 06:05:29,651][52665] Sum rewards: 73.236, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.231', 'weapon5': '0.232', 'weapon2': '0.284', 'AMMO4': '0.329', 'weapon4': '0.352', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '63.000'} [2024-08-06 06:05:29,814][52659] DAMAGECOUNT value on done: 701969.0 [2024-08-06 06:05:29,816][52659] Sum rewards: 77.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.386', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.050', 'weapon5': '0.158', 'AMMO3': '0.206', 'AMMO4': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:30,267][52650] Updated weights for policy 0, policy_version 66151 (0.0012) [2024-08-06 06:05:31,246][52647] DAMAGECOUNT value on done: 729938.0 [2024-08-06 06:05:31,246][52647] Sum rewards: 71.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.822', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO4': '0.188', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.550', 'weapon3': '2.966', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:31,372][52803] DAMAGECOUNT value on done: 659175.0 [2024-08-06 06:05:31,373][52803] Sum rewards: 86.532, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon2': '0.216', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '73.000'} [2024-08-06 06:05:31,704][52667] DAMAGECOUNT value on done: 709469.0 [2024-08-06 06:05:31,705][52667] Sum rewards: 69.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.066', 'AMMO4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.262', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '3.150', 'weapon3': '3.190', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '59.000'} [2024-08-06 06:05:32,056][52794] DAMAGECOUNT value on done: 698156.0 [2024-08-06 06:05:32,057][52794] Sum rewards: 73.622, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.152', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.112', 'weapon4': '0.178', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '63.000'} [2024-08-06 06:05:32,597][52659] DAMAGECOUNT value on done: 713776.0 [2024-08-06 06:05:32,597][52659] Sum rewards: 76.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.130', 'AMMO3': '0.180', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.100', 'weapon3': '2.650', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:32,675][52665] DAMAGECOUNT value on done: 707688.0 [2024-08-06 06:05:32,677][52665] Sum rewards: 69.791, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.730', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.188', 'weapon5': '0.204', 'AMMO4': '0.228', 'AMMO3': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.644', 'WEAPON3': '1.750', 'weapon3': '2.662', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 541949952. Throughput: 0: 4359.3. Samples: 135487530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:05:32,794][52567] Avg episode reward: [(0, '74.846')] [2024-08-06 06:05:34,276][52647] DAMAGECOUNT value on done: 736487.0 [2024-08-06 06:05:34,277][52647] Sum rewards: 66.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.160', 'AMMO5': '0.027', 'AMMO2': '0.041', 'AMMO3': '0.173', 'weapon2': '0.194', 'AMMO4': '0.207', 'weapon4': '0.218', 'weapon5': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.038', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '53.000'} [2024-08-06 06:05:34,308][52667] DAMAGECOUNT value on done: 716617.0 [2024-08-06 06:05:34,308][52667] Sum rewards: 75.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.225', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.208', 'weapon4': '0.280', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:34,578][52794] DAMAGECOUNT value on done: 706246.0 [2024-08-06 06:05:34,581][52794] Sum rewards: 69.788, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.305', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.162', 'weapon2': '0.170', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.650', 'weapon3': '2.996', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:34,833][52650] Updated weights for policy 0, policy_version 66161 (0.0024) [2024-08-06 06:05:35,449][52659] DAMAGECOUNT value on done: 702585.0 [2024-08-06 06:05:35,453][52659] Sum rewards: 74.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.120', 'weapon4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:35,720][52665] DAMAGECOUNT value on done: 704352.0 [2024-08-06 06:05:35,721][52665] Sum rewards: 82.238, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.694', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO4': '0.085', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.309', 'weapon2': '0.386', 'WEAPON3': '1.800', 'weapon3': '3.214', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '71.000'} [2024-08-06 06:05:36,873][52667] DAMAGECOUNT value on done: 715704.0 [2024-08-06 06:05:36,875][52667] Sum rewards: 84.833, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.316', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.078', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon5': '0.172', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.225', 'FRAGCOUNT': '66.000'} [2024-08-06 06:05:37,480][52794] DAMAGECOUNT value on done: 703092.0 [2024-08-06 06:05:37,482][52794] Sum rewards: 80.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.008', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.132', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.278', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '68.000'} [2024-08-06 06:05:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 542040064. Throughput: 0: 4360.7. Samples: 135513780. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:05:37,794][52567] Avg episode reward: [(0, '74.729')] [2024-08-06 06:05:38,841][52665] DAMAGECOUNT value on done: 700759.0 [2024-08-06 06:05:38,842][52665] Sum rewards: 62.782, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.160', 'weapon4': '0.202', 'AMMO3': '0.243', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '54.000'} [2024-08-06 06:05:39,571][52667] DAMAGECOUNT value on done: 713782.0 [2024-08-06 06:05:39,573][52667] Sum rewards: 78.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:39,700][52650] Updated weights for policy 0, policy_version 66171 (0.0012) [2024-08-06 06:05:40,596][52794] DAMAGECOUNT value on done: 717904.0 [2024-08-06 06:05:40,596][52794] Sum rewards: 76.293, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.492', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.076', 'weapon2': '0.124', 'AMMO3': '0.212', 'WEAPON3': '1.400', 'HITCOUNT': '3.450', 'weapon3': '3.612', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '65.000'} [2024-08-06 06:05:41,665][52665] DAMAGECOUNT value on done: 696411.0 [2024-08-06 06:05:41,666][52665] Sum rewards: 67.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.404', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '57.000'} [2024-08-06 06:05:42,318][52667] DAMAGECOUNT value on done: 708522.0 [2024-08-06 06:05:42,326][52667] Sum rewards: 77.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.476', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.144', 'weapon5': '0.168', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 06:05:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 542121984. Throughput: 0: 4375.4. Samples: 135540240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:05:42,794][52567] Avg episode reward: [(0, '74.611')] [2024-08-06 06:05:43,476][52794] DAMAGECOUNT value on done: 698586.0 [2024-08-06 06:05:43,476][52794] Sum rewards: 63.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.222', 'weapon2': '0.316', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.228', 'DAMAGECOUNT': '14.658', 'FRAGCOUNT': '53.000'} [2024-08-06 06:05:44,103][52650] Updated weights for policy 0, policy_version 66181 (0.0014) [2024-08-06 06:05:44,702][52665] DAMAGECOUNT value on done: 695740.0 [2024-08-06 06:05:44,703][52665] Sum rewards: 89.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.245', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.024', 'weapon5': '0.052', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.604', 'FRAGCOUNT': '75.000'} [2024-08-06 06:05:44,839][52663] DAMAGECOUNT value on done: 719178.0 [2024-08-06 06:05:44,839][52663] Sum rewards: 66.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.106', 'weapon4': '0.122', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.272', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '56.000'} [2024-08-06 06:05:45,486][52667] DAMAGECOUNT value on done: 717131.0 [2024-08-06 06:05:45,487][52667] Sum rewards: 79.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.026', 'AMMO4': '0.124', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 06:05:46,638][52794] DAMAGECOUNT value on done: 713069.0 [2024-08-06 06:05:46,642][52794] Sum rewards: 71.212, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.363', 'AMMO5': '0.023', 'AMMO2': '0.070', 'weapon4': '0.160', 'weapon2': '0.250', 'AMMO3': '0.277', 'weapon5': '0.328', 'AMMO4': '0.348', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.866', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:47,729][52663] DAMAGECOUNT value on done: 705841.0 [2024-08-06 06:05:47,729][52663] Sum rewards: 66.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.560', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon2': '0.210', 'weapon5': '0.228', 'AMMO3': '0.230', 'weapon4': '0.302', 'AMMO4': '0.315', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.500'} [2024-08-06 06:05:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 542220288. Throughput: 0: 4377.4. Samples: 135553360. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:05:47,794][52567] Avg episode reward: [(0, '74.876')] [2024-08-06 06:05:47,881][52665] DAMAGECOUNT value on done: 698004.0 [2024-08-06 06:05:47,883][52665] Sum rewards: 74.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO3': '0.220', 'weapon4': '0.232', 'AMMO4': '0.233', 'weapon5': '0.234', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '61.500'} [2024-08-06 06:05:48,913][52794] DAMAGECOUNT value on done: 708928.0 [2024-08-06 06:05:48,915][52794] Sum rewards: 73.342, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.824', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.120', 'AMMO4': '0.141', 'weapon5': '0.174', 'weapon2': '0.178', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.182', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '63.000'} [2024-08-06 06:05:48,990][52650] Updated weights for policy 0, policy_version 66191 (0.0012) [2024-08-06 06:05:50,619][52663] DAMAGECOUNT value on done: 700551.0 [2024-08-06 06:05:50,620][52663] Sum rewards: 74.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.632', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.142', 'weapon5': '0.164', 'AMMO3': '0.188', 'AMMO4': '0.205', 'weapon2': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '61.000'} [2024-08-06 06:05:51,030][52665] DAMAGECOUNT value on done: 699189.0 [2024-08-06 06:05:51,030][52665] Sum rewards: 74.938, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.952', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'AMMO4': '0.179', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '59.000'} [2024-08-06 06:05:51,968][52794] DAMAGECOUNT value on done: 712418.0 [2024-08-06 06:05:51,970][52794] Sum rewards: 73.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.357', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.072', 'AMMO4': '0.174', 'weapon5': '0.206', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 542302208. Throughput: 0: 4383.3. Samples: 135579760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:05:52,794][52567] Avg episode reward: [(0, '74.683')] [2024-08-06 06:05:53,347][52663] DAMAGECOUNT value on done: 704657.0 [2024-08-06 06:05:53,349][52663] Sum rewards: 69.575, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'weapon2': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.260', 'weapon3': '3.484', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '56.000'} [2024-08-06 06:05:53,447][52650] Updated weights for policy 0, policy_version 66201 (0.0024) [2024-08-06 06:05:53,790][52665] DAMAGECOUNT value on done: 691097.0 [2024-08-06 06:05:53,790][52665] Sum rewards: 76.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.008', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO4': '0.174', 'weapon5': '0.176', 'weapon2': '0.252', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '65.000'} [2024-08-06 06:05:54,037][52658] DAMAGECOUNT value on done: 709282.0 [2024-08-06 06:05:54,037][52658] Sum rewards: 74.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.327', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.106', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:54,381][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:05:55,023][52794] DAMAGECOUNT value on done: 717674.0 [2024-08-06 06:05:55,023][52794] Sum rewards: 83.140, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.830', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.165', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 06:05:56,010][52668] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:05:56,314][52670] DAMAGECOUNT value on done: 697602.0 [2024-08-06 06:05:56,317][52670] Sum rewards: 83.530, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.415', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.374', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '68.000'} [2024-08-06 06:05:56,439][52663] DAMAGECOUNT value on done: 708875.0 [2024-08-06 06:05:56,440][52663] Sum rewards: 77.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.995', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.176', 'weapon2': '0.182', 'AMMO3': '0.226', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 06:05:56,535][52665] DAMAGECOUNT value on done: 695961.0 [2024-08-06 06:05:56,536][52665] Sum rewards: 73.161, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'HEALTH': '0.018', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.136', 'AMMO4': '0.151', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:56,833][52658] DAMAGECOUNT value on done: 707645.0 [2024-08-06 06:05:56,834][52658] Sum rewards: 75.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.445', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.126', 'AMMO4': '0.165', 'AMMO3': '0.199', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '60.000'} [2024-08-06 06:05:57,365][52664] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 06:05:57,734][52666] DAMAGECOUNT value on done: 708206.0 [2024-08-06 06:05:57,735][52666] Sum rewards: 81.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.864', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.082', 'weapon4': '0.112', 'AMMO4': '0.133', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '65.000'} [2024-08-06 06:05:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 542392320. Throughput: 0: 4381.1. Samples: 135605980. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:05:57,802][52567] Avg episode reward: [(0, '75.097')] [2024-08-06 06:05:58,076][52794] DAMAGECOUNT value on done: 708886.0 [2024-08-06 06:05:58,078][52794] Sum rewards: 69.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.583', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.088', 'weapon5': '0.160', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '58.000'} [2024-08-06 06:05:58,439][52650] Updated weights for policy 0, policy_version 66211 (0.0037) [2024-08-06 06:05:59,240][52670] DAMAGECOUNT value on done: 708776.0 [2024-08-06 06:05:59,242][52670] Sum rewards: 71.323, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.172', 'AMMO3': '0.224', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '58.000'} [2024-08-06 06:05:59,254][52665] DAMAGECOUNT value on done: 698651.0 [2024-08-06 06:05:59,255][52665] Sum rewards: 72.181, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'weapon4': '0.070', 'AMMO3': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:59,384][52663] DAMAGECOUNT value on done: 715327.0 [2024-08-06 06:05:59,386][52663] Sum rewards: 76.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.138', 'weapon2': '0.176', 'AMMO3': '0.210', 'WEAPON3': '1.300', 'weapon3': '3.454', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '62.000'} [2024-08-06 06:05:59,686][52658] DAMAGECOUNT value on done: 713900.0 [2024-08-06 06:05:59,686][52658] Sum rewards: 70.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO4': '0.171', 'weapon5': '0.216', 'AMMO3': '0.244', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:00,691][52666] DAMAGECOUNT value on done: 705771.0 [2024-08-06 06:06:00,692][52666] Sum rewards: 78.615, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.037', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '66.500'} [2024-08-06 06:06:02,354][52663] DAMAGECOUNT value on done: 701251.0 [2024-08-06 06:06:02,354][52663] Sum rewards: 57.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.056', 'weapon5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.166', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '50.000'} [2024-08-06 06:06:02,403][52670] DAMAGECOUNT value on done: 696648.0 [2024-08-06 06:06:02,406][52670] Sum rewards: 75.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO4': '0.165', 'weapon4': '0.174', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:02,725][52650] Updated weights for policy 0, policy_version 66221 (0.0030) [2024-08-06 06:06:02,757][52658] DAMAGECOUNT value on done: 711338.0 [2024-08-06 06:06:02,757][52658] Sum rewards: 79.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.295', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.138', 'AMMO4': '0.169', 'weapon2': '0.206', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.408', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '65.000'} [2024-08-06 06:06:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 542482432. Throughput: 0: 4382.0. Samples: 135619200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:06:02,794][52567] Avg episode reward: [(0, '74.815')] [2024-08-06 06:06:03,650][52666] DAMAGECOUNT value on done: 705662.0 [2024-08-06 06:06:03,650][52666] Sum rewards: 65.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.730', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.178', 'AMMO4': '0.223', 'AMMO3': '0.256', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:04,412][52795] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 06:06:04,632][52669] DAMAGECOUNT value on done: 709052.0 [2024-08-06 06:06:04,634][52669] Sum rewards: 78.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.072', 'weapon5': '0.196', 'AMMO4': '0.204', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '66.000'} [2024-08-06 06:06:05,121][52663] DAMAGECOUNT value on done: 698042.0 [2024-08-06 06:06:05,125][52663] Sum rewards: 72.230, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.142', 'AMMO3': '0.147', 'weapon4': '0.168', 'HEALTH': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '0.900', 'weapon3': '3.196', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '58.500'} [2024-08-06 06:06:05,137][52670] DAMAGECOUNT value on done: 694991.0 [2024-08-06 06:06:05,137][52670] Sum rewards: 61.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.153', 'weapon2': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon5': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '3.098', 'DAMAGECOUNT': '13.488', 'FRAGCOUNT': '50.000'} [2024-08-06 06:06:05,749][52658] DAMAGECOUNT value on done: 700338.0 [2024-08-06 06:06:05,750][52658] Sum rewards: 67.739, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.260', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.088', 'weapon5': '0.184', 'AMMO4': '0.200', 'weapon2': '0.250', 'AMMO3': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.172', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 06:06:06,537][52666] DAMAGECOUNT value on done: 706423.0 [2024-08-06 06:06:06,539][52666] Sum rewards: 72.542, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.676', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.064', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.342', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:07,279][52669] DAMAGECOUNT value on done: 701741.0 [2024-08-06 06:06:07,280][52669] Sum rewards: 86.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.188', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.578', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '72.000'} [2024-08-06 06:06:07,650][52664] Large shaping reward 2.592 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 06:06:07,726][52650] Updated weights for policy 0, policy_version 66231 (0.0024) [2024-08-06 06:06:07,760][52670] DAMAGECOUNT value on done: 706113.0 [2024-08-06 06:06:07,761][52670] Sum rewards: 69.976, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.588', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.110', 'AMMO4': '0.245', 'AMMO3': '0.250', 'weapon5': '0.282', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.834', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '61.000'} [2024-08-06 06:06:07,762][52663] DAMAGECOUNT value on done: 698933.0 [2024-08-06 06:06:07,762][52663] Sum rewards: 65.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.142', 'AMMO3': '0.189', 'weapon4': '0.270', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.744', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '55.000'} [2024-08-06 06:06:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 542564352. Throughput: 0: 4374.9. Samples: 135644980. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:07,794][52567] Avg episode reward: [(0, '74.912')] [2024-08-06 06:06:08,562][52614] Signal inference workers to stop experience collection... (12050 times) [2024-08-06 06:06:08,564][52614] Signal inference workers to resume experience collection... (12050 times) [2024-08-06 06:06:08,645][52650] InferenceWorker_p0-w0: stopping experience collection (12050 times) [2024-08-06 06:06:08,645][52650] InferenceWorker_p0-w0: resuming experience collection (12050 times) [2024-08-06 06:06:08,887][52658] DAMAGECOUNT value on done: 700460.0 [2024-08-06 06:06:08,887][52658] Sum rewards: 82.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.650', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.119', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.346', 'WEAPON3': '1.700', 'weapon3': '3.220', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '70.000'} [2024-08-06 06:06:09,257][52666] DAMAGECOUNT value on done: 701199.0 [2024-08-06 06:06:09,257][52666] Sum rewards: 82.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.108', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.137', 'weapon5': '0.184', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '66.000'} [2024-08-06 06:06:09,456][52671] DAMAGECOUNT value on done: 710484.0 [2024-08-06 06:06:09,457][52671] Sum rewards: 75.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.789', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.102', 'AMMO4': '0.168', 'AMMO3': '0.198', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:09,944][52669] DAMAGECOUNT value on done: 712522.0 [2024-08-06 06:06:09,944][52669] Sum rewards: 78.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.274', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.036', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:10,445][52663] DAMAGECOUNT value on done: 702107.0 [2024-08-06 06:06:10,447][52663] Sum rewards: 72.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon2': '0.160', 'AMMO4': '0.173', 'weapon5': '0.180', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.402', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:10,821][52670] DAMAGECOUNT value on done: 701510.0 [2024-08-06 06:06:10,823][52670] Sum rewards: 78.861, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.964', 'AMMO5': '0.007', 'weapon4': '0.032', 'AMMO2': '0.039', 'weapon5': '0.046', 'AMMO3': '0.171', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.050', 'weapon3': '3.444', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:11,606][52658] DAMAGECOUNT value on done: 713642.0 [2024-08-06 06:06:11,608][52658] Sum rewards: 76.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.012', 'AMMO2': '0.037', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.183', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'weapon4': '0.318', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '60.000'} [2024-08-06 06:06:11,845][52650] Updated weights for policy 0, policy_version 66241 (0.0017) [2024-08-06 06:06:12,240][52666] DAMAGECOUNT value on done: 701622.0 [2024-08-06 06:06:12,241][52666] Sum rewards: 65.535, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.062', 'weapon5': '0.158', 'AMMO3': '0.281', 'weapon2': '0.290', 'AMMO4': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.990', 'weapon3': '3.226', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '57.000'} [2024-08-06 06:06:12,500][52671] DAMAGECOUNT value on done: 713513.0 [2024-08-06 06:06:12,501][52671] Sum rewards: 74.455, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.183', 'AMMO4': '0.247', 'weapon5': '0.288', 'weapon4': '0.298', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 542654464. Throughput: 0: 4381.6. Samples: 135671350. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:12,794][52567] Avg episode reward: [(0, '74.632')] [2024-08-06 06:06:13,105][52669] DAMAGECOUNT value on done: 709052.0 [2024-08-06 06:06:13,108][52669] Sum rewards: 82.092, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.817', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.106', 'weapon5': '0.224', 'weapon2': '0.228', 'AMMO3': '0.239', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '21.441', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:13,678][52663] DAMAGECOUNT value on done: 713105.0 [2024-08-06 06:06:13,681][52663] Sum rewards: 71.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.362', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.180', 'weapon4': '0.192', 'AMMO3': '0.204', 'AMMO4': '0.249', 'weapon2': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '58.500'} [2024-08-06 06:06:13,922][52670] DAMAGECOUNT value on done: 695054.0 [2024-08-06 06:06:13,923][52670] Sum rewards: 75.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.869', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.156', 'AMMO4': '0.190', 'weapon5': '0.202', 'AMMO3': '0.206', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:14,316][52658] DAMAGECOUNT value on done: 704311.0 [2024-08-06 06:06:14,317][52658] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.095', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon4': '0.288', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '57.000'} [2024-08-06 06:06:15,074][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:06:15,140][52671] DAMAGECOUNT value on done: 710136.0 [2024-08-06 06:06:15,141][52671] Sum rewards: 76.415, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.425', 'AMMO5': '0.027', 'AMMO2': '0.070', 'weapon4': '0.152', 'weapon2': '0.216', 'AMMO3': '0.254', 'weapon5': '0.326', 'AMMO4': '0.348', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.986', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 06:06:15,511][52666] DAMAGECOUNT value on done: 701077.0 [2024-08-06 06:06:15,512][52666] Sum rewards: 72.333, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon2': '0.156', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.650', 'weapon3': '3.666', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:15,655][52666] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:06:16,111][52669] DAMAGECOUNT value on done: 709384.0 [2024-08-06 06:06:16,111][52669] Sum rewards: 77.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.038', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.244', 'weapon5': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '64.500'} [2024-08-06 06:06:16,551][52663] DAMAGECOUNT value on done: 698348.0 [2024-08-06 06:06:16,552][52663] Sum rewards: 84.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.204', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '70.000'} [2024-08-06 06:06:16,882][52670] DAMAGECOUNT value on done: 700744.0 [2024-08-06 06:06:16,883][52670] Sum rewards: 67.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.433', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.229', 'AMMO4': '0.301', 'weapon2': '0.310', 'weapon5': '0.314', 'weapon4': '0.338', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '55.000'} [2024-08-06 06:06:17,039][52650] Updated weights for policy 0, policy_version 66251 (0.0011) [2024-08-06 06:06:17,252][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:06:17,323][52658] DAMAGECOUNT value on done: 724988.0 [2024-08-06 06:06:17,323][52658] Sum rewards: 73.529, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.695', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.123', 'weapon5': '0.178', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.172', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '61.000'} [2024-08-06 06:06:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 542744576. Throughput: 0: 4380.4. Samples: 135684650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:17,802][52567] Avg episode reward: [(0, '74.772')] [2024-08-06 06:06:17,927][52671] DAMAGECOUNT value on done: 713901.0 [2024-08-06 06:06:17,928][52671] Sum rewards: 72.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.011', 'AMMO5': '0.016', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'weapon5': '0.230', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:18,369][52666] DAMAGECOUNT value on done: 696400.0 [2024-08-06 06:06:18,369][52666] Sum rewards: 75.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.798', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.130', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:18,713][52669] DAMAGECOUNT value on done: 711484.0 [2024-08-06 06:06:18,713][52669] Sum rewards: 78.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.175', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.054', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.396', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '66.000'} [2024-08-06 06:06:19,038][52663] DAMAGECOUNT value on done: 694530.0 [2024-08-06 06:06:19,039][52663] Sum rewards: 69.090, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.190', 'AMMO5': '0.009', 'weapon4': '0.044', 'AMMO2': '0.045', 'weapon5': '0.106', 'AMMO4': '0.225', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '59.500'} [2024-08-06 06:06:20,054][52670] DAMAGECOUNT value on done: 698123.0 [2024-08-06 06:06:20,054][52670] Sum rewards: 79.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.038', 'weapon4': '0.076', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.390', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '66.000'} [2024-08-06 06:06:20,983][52658] DAMAGECOUNT value on done: 707151.0 [2024-08-06 06:06:20,984][52658] Sum rewards: 73.447, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.188', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.120', 'weapon4': '0.146', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.128', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:21,114][52671] DAMAGECOUNT value on done: 720113.0 [2024-08-06 06:06:21,118][52671] Sum rewards: 69.438, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.236', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '57.000'} [2024-08-06 06:06:21,354][52650] Updated weights for policy 0, policy_version 66261 (0.0014) [2024-08-06 06:06:21,409][52666] DAMAGECOUNT value on done: 704868.0 [2024-08-06 06:06:21,409][52666] Sum rewards: 67.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.160', 'AMMO4': '0.189', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '57.000'} [2024-08-06 06:06:21,481][52669] DAMAGECOUNT value on done: 708736.0 [2024-08-06 06:06:21,481][52669] Sum rewards: 69.776, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.837', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.276', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:21,810][52663] DAMAGECOUNT value on done: 702257.0 [2024-08-06 06:06:21,812][52663] Sum rewards: 66.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.674', 'AMMO2': '0.017', 'AMMO5': '0.017', 'weapon4': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon5': '0.224', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '55.000'} [2024-08-06 06:06:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 542818304. Throughput: 0: 4371.6. Samples: 135710500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:22,794][52567] Avg episode reward: [(0, '74.549')] [2024-08-06 06:06:23,183][52670] DAMAGECOUNT value on done: 694511.0 [2024-08-06 06:06:23,184][52670] Sum rewards: 67.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.134', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.172', 'AMMO4': '0.208', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:24,034][52671] DAMAGECOUNT value on done: 713423.0 [2024-08-06 06:06:24,036][52671] Sum rewards: 88.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.092', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.044', 'weapon5': '0.066', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.415', 'FRAGCOUNT': '74.000'} [2024-08-06 06:06:24,059][52658] DAMAGECOUNT value on done: 720123.0 [2024-08-06 06:06:24,059][52658] Sum rewards: 69.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.160', 'AMMO3': '0.186', 'AMMO4': '0.214', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:24,117][52669] DAMAGECOUNT value on done: 712213.0 [2024-08-06 06:06:24,118][52669] Sum rewards: 84.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.124', 'AMMO3': '0.193', 'AMMO4': '0.208', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:24,452][52663] DAMAGECOUNT value on done: 698903.0 [2024-08-06 06:06:24,452][52663] Sum rewards: 73.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.463', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'weapon4': '0.246', 'AMMO3': '0.276', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:24,754][52666] DAMAGECOUNT value on done: 699701.0 [2024-08-06 06:06:24,755][52666] Sum rewards: 73.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.038', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.076', 'weapon5': '0.178', 'AMMO3': '0.230', 'weapon2': '0.270', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '61.000'} [2024-08-06 06:06:26,252][52650] Updated weights for policy 0, policy_version 66271 (0.0028) [2024-08-06 06:06:26,261][52670] DAMAGECOUNT value on done: 706692.0 [2024-08-06 06:06:26,262][52670] Sum rewards: 76.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.025', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon4': '0.140', 'weapon5': '0.190', 'AMMO4': '0.204', 'AMMO3': '0.224', 'weapon2': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:26,736][52669] DAMAGECOUNT value on done: 717826.0 [2024-08-06 06:06:26,736][52669] Sum rewards: 69.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.622', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.302', 'weapon4': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:26,924][52671] DAMAGECOUNT value on done: 715564.0 [2024-08-06 06:06:26,924][52671] Sum rewards: 70.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.184', 'AMMO4': '0.191', 'weapon5': '0.212', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.600', 'weapon3': '2.894', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '60.000'} [2024-08-06 06:06:27,084][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:06:27,106][52658] DAMAGECOUNT value on done: 704313.0 [2024-08-06 06:06:27,107][52658] Sum rewards: 72.568, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.009', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.153', 'weapon5': '0.156', 'AMMO3': '0.253', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.264', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '60.500'} [2024-08-06 06:06:27,255][52663] DAMAGECOUNT value on done: 712829.0 [2024-08-06 06:06:27,257][52663] Sum rewards: 71.355, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.690', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.022', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.355', 'WEAPON3': '2.200', 'weapon3': '3.448', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '66.000'} [2024-08-06 06:06:27,548][52666] DAMAGECOUNT value on done: 707897.0 [2024-08-06 06:06:27,550][52666] Sum rewards: 75.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.162', 'weapon4': '0.168', 'AMMO3': '0.194', 'AMMO4': '0.216', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 542908416. Throughput: 0: 4367.1. Samples: 135736760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:27,795][52567] Avg episode reward: [(0, '74.231')] [2024-08-06 06:06:27,816][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066274_542916608.pth... [2024-08-06 06:06:27,983][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000065762_538722304.pth [2024-08-06 06:06:28,779][52670] DAMAGECOUNT value on done: 693367.0 [2024-08-06 06:06:28,779][52670] Sum rewards: 87.546, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.362', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.248', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.627', 'FRAGCOUNT': '75.000'} [2024-08-06 06:06:29,791][52669] DAMAGECOUNT value on done: 711186.0 [2024-08-06 06:06:29,791][52669] Sum rewards: 78.051, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.370', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.110', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.322', 'weapon4': '0.352', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2024-08-06 06:06:29,881][52671] DAMAGECOUNT value on done: 712137.0 [2024-08-06 06:06:29,883][52671] Sum rewards: 64.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.086', 'weapon5': '0.198', 'AMMO3': '0.224', 'weapon2': '0.274', 'AMMO4': '0.301', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.188', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:30,008][52658] DAMAGECOUNT value on done: 712486.0 [2024-08-06 06:06:30,010][52658] Sum rewards: 85.915, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.090', 'weapon4': '0.134', 'AMMO4': '0.248', 'AMMO3': '0.274', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.724', 'FRAGCOUNT': '73.000'} [2024-08-06 06:06:30,276][52666] DAMAGECOUNT value on done: 695651.0 [2024-08-06 06:06:30,277][52666] Sum rewards: 81.699, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.324', 'AMMO5': '0.003', 'AMMO2': '0.038', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.190', 'weapon2': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.456', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:30,459][52663] DAMAGECOUNT value on done: 706277.0 [2024-08-06 06:06:30,460][52663] Sum rewards: 76.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.502', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:30,626][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:06:31,450][52650] Updated weights for policy 0, policy_version 66281 (0.0020) [2024-08-06 06:06:31,965][52670] DAMAGECOUNT value on done: 702539.0 [2024-08-06 06:06:31,968][52670] Sum rewards: 77.885, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.626', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.198', 'weapon5': '0.216', 'AMMO4': '0.231', 'AMMO3': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.602', 'WEAPON3': '1.600', 'weapon3': '2.644', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.500'} [2024-08-06 06:06:32,533][52658] DAMAGECOUNT value on done: 703780.0 [2024-08-06 06:06:32,535][52658] Sum rewards: 79.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.520', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.143', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 542998528. Throughput: 0: 4356.2. Samples: 135749390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:32,794][52567] Avg episode reward: [(0, '74.434')] [2024-08-06 06:06:32,986][52671] DAMAGECOUNT value on done: 704228.0 [2024-08-06 06:06:32,987][52671] Sum rewards: 75.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.219', 'weapon2': '0.236', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:33,016][52669] DAMAGECOUNT value on done: 710742.0 [2024-08-06 06:06:33,016][52669] Sum rewards: 71.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.074', 'AMMO4': '0.171', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.550', 'weapon3': '2.814', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:33,569][52666] DAMAGECOUNT value on done: 708261.0 [2024-08-06 06:06:33,571][52666] Sum rewards: 69.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.939', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.176', 'weapon4': '0.212', 'AMMO3': '0.263', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.006', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:33,606][52663] DAMAGECOUNT value on done: 709718.0 [2024-08-06 06:06:33,608][52663] Sum rewards: 76.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.893', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.172', 'weapon2': '0.184', 'weapon5': '0.188', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:34,562][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:06:34,813][52668] DAMAGECOUNT value on done: 706467.0 [2024-08-06 06:06:34,813][52668] Sum rewards: 73.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.160', 'weapon4': '0.164', 'AMMO4': '0.242', 'weapon5': '0.310', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:35,284][52670] DAMAGECOUNT value on done: 707908.0 [2024-08-06 06:06:35,287][52670] Sum rewards: 70.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.713', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.742', 'WEAPON3': '1.000', 'weapon3': '2.710', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:35,501][52671] DAMAGECOUNT value on done: 711490.0 [2024-08-06 06:06:35,501][52671] Sum rewards: 74.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.848', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.268', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.398', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:35,516][52658] DAMAGECOUNT value on done: 712241.0 [2024-08-06 06:06:35,516][52658] Sum rewards: 64.869, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.106', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.286', 'AMMO3': '0.304', 'WEAPON3': '1.700', 'HITCOUNT': '3.130', 'weapon3': '3.334', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:36,040][52650] Updated weights for policy 0, policy_version 66291 (0.0025) [2024-08-06 06:06:36,070][52660] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 06:06:36,175][52669] DAMAGECOUNT value on done: 717520.0 [2024-08-06 06:06:36,180][52669] Sum rewards: 78.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.785', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.140', 'AMMO4': '0.173', 'weapon5': '0.176', 'AMMO3': '0.208', 'weapon2': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:36,782][52663] DAMAGECOUNT value on done: 709029.0 [2024-08-06 06:06:36,782][52663] Sum rewards: 78.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.146', 'AMMO3': '0.194', 'weapon4': '0.222', 'WEAPON3': '1.150', 'weapon3': '3.350', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:36,819][52666] DAMAGECOUNT value on done: 702078.0 [2024-08-06 06:06:36,820][52666] Sum rewards: 66.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.128', 'weapon5': '0.148', 'AMMO4': '0.227', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '58.000'} [2024-08-06 06:06:37,320][52811] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.561, 187.0)] [2024-08-06 06:06:37,656][52668] DAMAGECOUNT value on done: 713035.0 [2024-08-06 06:06:37,656][52668] Sum rewards: 75.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.692', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.108', 'weapon5': '0.128', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '60.000'} [2024-08-06 06:06:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 543088640. Throughput: 0: 4353.3. Samples: 135775660. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:37,794][52567] Avg episode reward: [(0, '74.310')] [2024-08-06 06:06:38,220][52670] DAMAGECOUNT value on done: 703430.0 [2024-08-06 06:06:38,224][52670] Sum rewards: 73.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.225', 'weapon5': '0.248', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:38,468][52671] DAMAGECOUNT value on done: 713946.0 [2024-08-06 06:06:38,469][52671] Sum rewards: 74.546, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.427', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'weapon2': '0.202', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.650', 'weapon3': '3.096', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '65.000'} [2024-08-06 06:06:38,483][52658] DAMAGECOUNT value on done: 697926.0 [2024-08-06 06:06:38,483][52658] Sum rewards: 68.357, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.243', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:39,386][52669] DAMAGECOUNT value on done: 703862.0 [2024-08-06 06:06:39,387][52669] Sum rewards: 82.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.400', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:39,462][52666] DAMAGECOUNT value on done: 703945.0 [2024-08-06 06:06:39,462][52666] Sum rewards: 77.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.358', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '62.500'} [2024-08-06 06:06:40,051][52663] DAMAGECOUNT value on done: 701322.0 [2024-08-06 06:06:40,051][52663] Sum rewards: 74.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.065', 'weapon4': '0.094', 'weapon5': '0.116', 'weapon2': '0.158', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO4': '0.324', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.392', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:40,566][52650] Updated weights for policy 0, policy_version 66301 (0.0011) [2024-08-06 06:06:40,589][52668] DAMAGECOUNT value on done: 713926.0 [2024-08-06 06:06:40,591][52668] Sum rewards: 82.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.663', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon2': '0.110', 'weapon5': '0.158', 'AMMO3': '0.200', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '67.000'} [2024-08-06 06:06:40,722][52670] DAMAGECOUNT value on done: 686079.0 [2024-08-06 06:06:40,723][52670] Sum rewards: 70.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.018', 'AMMO4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.223', 'WEAPON3': '1.450', 'HITCOUNT': '3.380', 'weapon3': '3.572', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:40,889][52671] DAMAGECOUNT value on done: 711885.0 [2024-08-06 06:06:40,891][52671] Sum rewards: 72.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.993', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.058', 'AMMO4': '0.159', 'weapon5': '0.182', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '58.500'} [2024-08-06 06:06:41,414][52658] DAMAGECOUNT value on done: 712156.0 [2024-08-06 06:06:41,414][52658] Sum rewards: 67.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.030', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon5': '0.208', 'weapon2': '0.234', 'AMMO3': '0.238', 'weapon4': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.910', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '58.000'} [2024-08-06 06:06:42,223][52666] DAMAGECOUNT value on done: 695602.0 [2024-08-06 06:06:42,224][52666] Sum rewards: 91.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.591', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.176', 'weapon2': '0.184', 'AMMO4': '0.184', 'weapon5': '0.232', 'WEAPON4': '0.400', 'weapon4': '0.444', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.780', 'FRAGCOUNT': '72.000'} [2024-08-06 06:06:42,334][52669] DAMAGECOUNT value on done: 706909.0 [2024-08-06 06:06:42,336][52669] Sum rewards: 73.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.128', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.340', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '61.000'} [2024-08-06 06:06:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.4). Total num frames: 543170560. Throughput: 0: 4354.6. Samples: 135801940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:06:42,795][52567] Avg episode reward: [(0, '74.547')] [2024-08-06 06:06:43,317][52671] DAMAGECOUNT value on done: 718217.0 [2024-08-06 06:06:43,318][52671] Sum rewards: 84.973, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.160', 'AMMO3': '0.165', 'weapon2': '0.484', 'WEAPON3': '1.000', 'weapon3': '3.192', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '67.000'} [2024-08-06 06:06:43,626][52670] DAMAGECOUNT value on done: 697614.0 [2024-08-06 06:06:43,626][52670] Sum rewards: 66.220, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.785', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.772', 'WEAPON3': '1.050', 'weapon3': '2.980', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '53.000'} [2024-08-06 06:06:43,677][52668] DAMAGECOUNT value on done: 713674.0 [2024-08-06 06:06:43,679][52668] Sum rewards: 71.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.173', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.100', 'AMMO4': '0.213', 'weapon5': '0.236', 'AMMO3': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.550', 'weapon3': '2.842', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:44,489][52658] DAMAGECOUNT value on done: 704802.0 [2024-08-06 06:06:44,497][52658] Sum rewards: 67.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.605', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.100', 'weapon5': '0.238', 'AMMO3': '0.244', 'AMMO4': '0.278', 'weapon2': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.070', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '55.000'} [2024-08-06 06:06:44,597][52664] DAMAGECOUNT value on done: 733887.0 [2024-08-06 06:06:44,597][52664] Sum rewards: 74.679, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.987', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:45,027][52666] DAMAGECOUNT value on done: 699948.0 [2024-08-06 06:06:45,027][52666] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.166', 'AMMO3': '0.219', 'AMMO4': '0.220', 'weapon5': '0.258', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:45,156][52650] Updated weights for policy 0, policy_version 66311 (0.0011) [2024-08-06 06:06:45,457][52669] DAMAGECOUNT value on done: 709910.0 [2024-08-06 06:06:45,457][52669] Sum rewards: 70.096, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.270', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.176', 'weapon4': '0.200', 'AMMO4': '0.206', 'weapon2': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.006', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '61.500'} [2024-08-06 06:06:46,131][52671] DAMAGECOUNT value on done: 713120.0 [2024-08-06 06:06:46,131][52671] Sum rewards: 80.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.980', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.135', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:46,395][52670] DAMAGECOUNT value on done: 704951.0 [2024-08-06 06:06:46,395][52670] Sum rewards: 74.049, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.070', 'AMMO4': '0.125', 'weapon5': '0.170', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.293', 'WEAPON3': '1.700', 'weapon3': '3.276', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:46,888][52668] DAMAGECOUNT value on done: 699404.0 [2024-08-06 06:06:46,888][52668] Sum rewards: 75.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.154', 'weapon4': '0.170', 'AMMO3': '0.193', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:47,722][52666] DAMAGECOUNT value on done: 712590.0 [2024-08-06 06:06:47,722][52666] Sum rewards: 78.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.130', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:47,726][52658] DAMAGECOUNT value on done: 707219.0 [2024-08-06 06:06:47,726][52658] Sum rewards: 62.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.837', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.180', 'AMMO4': '0.181', 'weapon2': '0.222', 'weapon4': '0.244', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '54.000'} [2024-08-06 06:06:47,752][52664] DAMAGECOUNT value on done: 739891.0 [2024-08-06 06:06:47,753][52664] Sum rewards: 78.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.662', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.114', 'AMMO4': '0.164', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 543260672. Throughput: 0: 4346.2. Samples: 135814780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:06:47,794][52567] Avg episode reward: [(0, '74.260')] [2024-08-06 06:06:47,865][52669] DAMAGECOUNT value on done: 730120.0 [2024-08-06 06:06:47,866][52669] Sum rewards: 75.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.456', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.102', 'AMMO4': '0.166', 'AMMO3': '0.228', 'weapon5': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:48,827][52671] DAMAGECOUNT value on done: 700563.0 [2024-08-06 06:06:48,827][52671] Sum rewards: 79.149, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.620', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.121', 'weapon5': '0.178', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.184', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:48,911][52670] DAMAGECOUNT value on done: 702254.0 [2024-08-06 06:06:48,911][52670] Sum rewards: 83.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.076', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '70.000'} [2024-08-06 06:06:49,122][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:06:49,716][52650] Updated weights for policy 0, policy_version 66321 (0.0031) [2024-08-06 06:06:50,015][52666] DAMAGECOUNT value on done: 690863.0 [2024-08-06 06:06:50,015][52666] Sum rewards: 52.589, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.540', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.080', 'weapon5': '0.198', 'AMMO4': '0.215', 'AMMO3': '0.267', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '3.078', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '48.000'} [2024-08-06 06:06:50,326][52668] DAMAGECOUNT value on done: 714216.0 [2024-08-06 06:06:50,326][52668] Sum rewards: 65.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.769', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.197', 'weapon5': '0.248', 'AMMO4': '0.272', 'weapon4': '0.348', 'weapon2': '0.382', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '54.000'} [2024-08-06 06:06:50,411][52658] DAMAGECOUNT value on done: 710045.0 [2024-08-06 06:06:50,412][52658] Sum rewards: 59.661, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO5': '0.027', 'AMMO2': '0.072', 'weapon4': '0.216', 'weapon5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.356', 'AMMO4': '0.361', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.800', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '53.000'} [2024-08-06 06:06:50,816][52664] DAMAGECOUNT value on done: 734993.0 [2024-08-06 06:06:50,817][52664] Sum rewards: 69.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.163', 'AMMO3': '0.225', 'weapon4': '0.228', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 06:06:50,976][52669] DAMAGECOUNT value on done: 718655.0 [2024-08-06 06:06:50,976][52669] Sum rewards: 74.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.691', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.024', 'weapon4': '0.034', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '60.000'} [2024-08-06 06:06:51,378][52670] DAMAGECOUNT value on done: 705780.0 [2024-08-06 06:06:51,379][52670] Sum rewards: 89.855, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.213', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.490', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '75.000'} [2024-08-06 06:06:51,538][52671] DAMAGECOUNT value on done: 717617.0 [2024-08-06 06:06:51,540][52671] Sum rewards: 62.015, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.870', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.170', 'weapon3': '3.238', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '54.000'} [2024-08-06 06:06:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 543350784. Throughput: 0: 4361.5. Samples: 135841250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:06:52,795][52567] Avg episode reward: [(0, '74.307')] [2024-08-06 06:06:52,891][52662] DAMAGECOUNT value on done: 712731.0 [2024-08-06 06:06:52,892][52662] Sum rewards: 77.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.675', 'AMMO5': '0.014', 'weapon4': '0.030', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.205', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.712', 'WEAPON3': '1.350', 'weapon3': '2.802', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:53,063][52666] DAMAGECOUNT value on done: 700682.0 [2024-08-06 06:06:53,063][52666] Sum rewards: 78.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon5': '0.052', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '65.000'} [2024-08-06 06:06:53,343][52668] DAMAGECOUNT value on done: 713805.0 [2024-08-06 06:06:53,345][52668] Sum rewards: 69.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.200', 'weapon5': '0.216', 'AMMO3': '0.225', 'weapon2': '0.740', 'WEAPON3': '1.350', 'weapon3': '2.710', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '58.000'} [2024-08-06 06:06:53,708][52664] DAMAGECOUNT value on done: 730228.0 [2024-08-06 06:06:53,711][52664] Sum rewards: 86.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.265', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.207', 'WEAPON3': '1.200', 'weapon3': '3.636', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '70.000'} [2024-08-06 06:06:53,949][52669] DAMAGECOUNT value on done: 714497.0 [2024-08-06 06:06:53,950][52669] Sum rewards: 72.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.201', 'weapon5': '0.214', 'weapon2': '0.248', 'weapon4': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:53,999][52671] DAMAGECOUNT value on done: 716235.0 [2024-08-06 06:06:54,000][52671] Sum rewards: 72.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.040', 'weapon4': '0.056', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '61.000'} [2024-08-06 06:06:54,602][52650] Updated weights for policy 0, policy_version 66331 (0.0023) [2024-08-06 06:06:56,010][52662] DAMAGECOUNT value on done: 715525.0 [2024-08-06 06:06:56,011][52662] Sum rewards: 80.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.540', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '68.000'} [2024-08-06 06:06:56,402][52668] DAMAGECOUNT value on done: 705699.0 [2024-08-06 06:06:56,404][52668] Sum rewards: 76.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.434', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '64.000'} [2024-08-06 06:06:56,746][52669] DAMAGECOUNT value on done: 715637.0 [2024-08-06 06:06:56,747][52669] Sum rewards: 74.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.260', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.208', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '3.112', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '62.000'} [2024-08-06 06:06:56,773][52664] DAMAGECOUNT value on done: 741872.0 [2024-08-06 06:06:56,773][52664] Sum rewards: 74.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.704', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'weapon2': '0.398', 'WEAPON3': '1.800', 'weapon3': '3.152', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 06:06:56,843][52671] DAMAGECOUNT value on done: 715527.0 [2024-08-06 06:06:56,843][52671] Sum rewards: 66.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.235', 'AMMO4': '0.279', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '56.000'} [2024-08-06 06:06:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 543432704. Throughput: 0: 4362.7. Samples: 135867670. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:06:57,794][52567] Avg episode reward: [(0, '74.219')] [2024-08-06 06:06:59,018][52662] DAMAGECOUNT value on done: 719395.0 [2024-08-06 06:06:59,018][52662] Sum rewards: 69.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.027', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.422', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '57.000'} [2024-08-06 06:06:59,182][52650] Updated weights for policy 0, policy_version 66341 (0.0025) [2024-08-06 06:06:59,492][52668] DAMAGECOUNT value on done: 706237.0 [2024-08-06 06:06:59,493][52668] Sum rewards: 73.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.172', 'weapon5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '63.000'} [2024-08-06 06:06:59,631][52669] DAMAGECOUNT value on done: 718888.0 [2024-08-06 06:06:59,631][52669] Sum rewards: 66.509, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.130', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.104', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.265', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.244', 'DAMAGECOUNT': '14.607', 'FRAGCOUNT': '59.000'} [2024-08-06 06:06:59,730][52671] DAMAGECOUNT value on done: 716132.0 [2024-08-06 06:06:59,730][52671] Sum rewards: 78.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.115', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:00,044][52664] DAMAGECOUNT value on done: 734411.0 [2024-08-06 06:07:00,045][52664] Sum rewards: 75.182, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.088', 'AMMO5': '0.022', 'AMMO2': '0.068', 'weapon4': '0.202', 'weapon5': '0.252', 'weapon2': '0.274', 'AMMO3': '0.305', 'AMMO4': '0.340', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.912', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:01,957][52662] DAMAGECOUNT value on done: 703797.0 [2024-08-06 06:07:01,960][52662] Sum rewards: 63.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.958', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon5': '0.174', 'AMMO3': '0.195', 'AMMO4': '0.292', 'weapon2': '0.396', 'weapon4': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.686', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:02,054][52668] DAMAGECOUNT value on done: 714404.0 [2024-08-06 06:07:02,056][52668] Sum rewards: 75.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.706', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:02,723][52671] DAMAGECOUNT value on done: 709370.0 [2024-08-06 06:07:02,724][52671] Sum rewards: 73.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.636', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.163', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.750', 'weapon3': '3.134', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:02,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 543522816. Throughput: 0: 4360.2. Samples: 135880860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:02,794][52567] Avg episode reward: [(0, '74.106')] [2024-08-06 06:07:03,196][52664] DAMAGECOUNT value on done: 730924.0 [2024-08-06 06:07:03,196][52664] Sum rewards: 79.256, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.270', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.114', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:03,918][52650] Updated weights for policy 0, policy_version 66351 (0.0014) [2024-08-06 06:07:04,665][52662] DAMAGECOUNT value on done: 721067.0 [2024-08-06 06:07:04,667][52662] Sum rewards: 69.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.668', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.130', 'AMMO3': '0.153', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.286', 'weapon2': '0.288', 'WEAPON3': '0.950', 'weapon3': '3.120', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '55.000'} [2024-08-06 06:07:05,188][52668] DAMAGECOUNT value on done: 710151.0 [2024-08-06 06:07:05,189][52668] Sum rewards: 71.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.084', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.480', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:06,230][52664] DAMAGECOUNT value on done: 725079.0 [2024-08-06 06:07:06,231][52664] Sum rewards: 67.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.520', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.090', 'weapon5': '0.186', 'AMMO4': '0.216', 'AMMO3': '0.238', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.158', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:07,331][52662] DAMAGECOUNT value on done: 703423.0 [2024-08-06 06:07:07,332][52662] Sum rewards: 84.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.486', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.078', 'weapon5': '0.150', 'AMMO4': '0.212', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '69.000'} [2024-08-06 06:07:07,755][52665] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 543612928. Throughput: 0: 4362.0. Samples: 135906790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:07,794][52567] Avg episode reward: [(0, '74.070')] [2024-08-06 06:07:08,179][52668] DAMAGECOUNT value on done: 701840.0 [2024-08-06 06:07:08,179][52668] Sum rewards: 75.754, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.710', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.156', 'weapon2': '0.220', 'AMMO4': '0.225', 'AMMO3': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '2.100', 'weapon3': '3.254', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '69.000'} [2024-08-06 06:07:08,754][52650] Updated weights for policy 0, policy_version 66361 (0.0034) [2024-08-06 06:07:09,176][52668] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:09,509][52664] DAMAGECOUNT value on done: 740670.0 [2024-08-06 06:07:09,510][52664] Sum rewards: 78.096, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.462', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon5': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '3.062', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '60.500'} [2024-08-06 06:07:10,511][52662] DAMAGECOUNT value on done: 709666.0 [2024-08-06 06:07:10,514][52662] Sum rewards: 71.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon5': '0.122', 'weapon4': '0.140', 'AMMO3': '0.195', 'AMMO4': '0.297', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:10,957][52668] DAMAGECOUNT value on done: 696273.0 [2024-08-06 06:07:10,959][52668] Sum rewards: 82.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.104', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:11,661][52811] DAMAGECOUNT value on done: 675366.0 [2024-08-06 06:07:11,661][52811] Sum rewards: 78.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.127', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:11,922][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:12,673][52664] DAMAGECOUNT value on done: 729544.0 [2024-08-06 06:07:12,674][52664] Sum rewards: 76.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.373', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.090', 'AMMO4': '0.185', 'AMMO3': '0.190', 'weapon5': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 543703040. Throughput: 0: 4366.2. Samples: 135933240. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:12,794][52567] Avg episode reward: [(0, '74.252')] [2024-08-06 06:07:13,142][52650] Updated weights for policy 0, policy_version 66371 (0.0023) [2024-08-06 06:07:13,651][52662] DAMAGECOUNT value on done: 720169.0 [2024-08-06 06:07:13,653][52662] Sum rewards: 73.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.610', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.060', 'AMMO4': '0.185', 'weapon5': '0.194', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:13,931][52668] DAMAGECOUNT value on done: 696865.0 [2024-08-06 06:07:13,934][52668] Sum rewards: 75.832, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.508', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.108', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.330', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.232', 'FRAGCOUNT': '65.000'} [2024-08-06 06:07:14,034][52660] DAMAGECOUNT value on done: 709965.0 [2024-08-06 06:07:14,036][52660] Sum rewards: 69.352, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.376', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.169', 'weapon5': '0.202', 'weapon2': '0.246', 'AMMO3': '0.293', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.110', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '60.500'} [2024-08-06 06:07:14,244][52649] DAMAGECOUNT value on done: 688019.0 [2024-08-06 06:07:14,247][52649] Sum rewards: 78.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.228', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.132', 'weapon5': '0.220', 'AMMO3': '0.245', 'AMMO4': '0.253', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '65.000'} [2024-08-06 06:07:14,671][52795] DAMAGECOUNT value on done: 659070.0 [2024-08-06 06:07:14,672][52795] Sum rewards: 80.667, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '65.000'} [2024-08-06 06:07:14,976][52811] DAMAGECOUNT value on done: 657311.0 [2024-08-06 06:07:14,977][52811] Sum rewards: 86.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'weapon5': '0.204', 'weapon2': '0.232', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.702', 'FRAGCOUNT': '70.500'} [2024-08-06 06:07:15,176][52664] DAMAGECOUNT value on done: 742270.0 [2024-08-06 06:07:15,176][52664] Sum rewards: 68.548, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.155', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon5': '0.160', 'AMMO4': '0.223', 'AMMO3': '0.281', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.164', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '59.000'} [2024-08-06 06:07:16,201][52820] DAMAGECOUNT value on done: 656344.0 [2024-08-06 06:07:16,201][52820] Sum rewards: 60.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.052', 'weapon7': '0.088', 'weapon5': '0.104', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.194', 'WEAPON7': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.838', 'WEAPON3': '1.200', 'weapon3': '2.524', 'HITCOUNT': '2.590', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '51.000'} [2024-08-06 06:07:16,361][52662] DAMAGECOUNT value on done: 710866.0 [2024-08-06 06:07:16,364][52662] Sum rewards: 62.120, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.575', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.308', 'weapon4': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '50.000'} [2024-08-06 06:07:16,880][52668] DAMAGECOUNT value on done: 696609.0 [2024-08-06 06:07:16,881][52668] Sum rewards: 76.316, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.162', 'weapon4': '0.210', 'weapon2': '0.218', 'AMMO3': '0.279', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '65.500'} [2024-08-06 06:07:17,049][52660] DAMAGECOUNT value on done: 699597.0 [2024-08-06 06:07:17,049][52660] Sum rewards: 86.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.056', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.206', 'WEAPON3': '1.300', 'weapon3': '3.498', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '72.000'} [2024-08-06 06:07:17,386][52649] DAMAGECOUNT value on done: 680193.0 [2024-08-06 06:07:17,388][52649] Sum rewards: 73.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon5': '0.204', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.320', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 543784960. Throughput: 0: 4372.4. Samples: 135946150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:17,794][52567] Avg episode reward: [(0, '74.378')] [2024-08-06 06:07:17,832][52795] DAMAGECOUNT value on done: 645790.0 [2024-08-06 06:07:17,832][52795] Sum rewards: 67.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.142', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.042', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.788', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '53.500'} [2024-08-06 06:07:17,952][52664] DAMAGECOUNT value on done: 740923.0 [2024-08-06 06:07:17,953][52664] Sum rewards: 78.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.715', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon5': '0.224', 'AMMO3': '0.234', 'weapon2': '0.246', 'weapon4': '0.296', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '65.000'} [2024-08-06 06:07:18,043][52811] DAMAGECOUNT value on done: 656220.0 [2024-08-06 06:07:18,044][52811] Sum rewards: 80.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.836', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.098', 'weapon4': '0.114', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.338', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '65.000'} [2024-08-06 06:07:18,453][52650] Updated weights for policy 0, policy_version 66381 (0.0011) [2024-08-06 06:07:19,498][52820] DAMAGECOUNT value on done: 657081.0 [2024-08-06 06:07:19,498][52820] Sum rewards: 75.817, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.567', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.140', 'weapon2': '0.174', 'weapon5': '0.194', 'AMMO3': '0.226', 'AMMO4': '0.263', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:19,617][52668] DAMAGECOUNT value on done: 708377.0 [2024-08-06 06:07:19,619][52668] Sum rewards: 63.589, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.134', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.232', 'weapon2': '0.258', 'AMMO3': '0.275', 'AMMO4': '0.279', 'weapon4': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.878', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:19,681][52662] DAMAGECOUNT value on done: 719286.0 [2024-08-06 06:07:19,681][52662] Sum rewards: 73.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.186', 'weapon4': '0.192', 'weapon5': '0.214', 'AMMO4': '0.292', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.728', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:19,710][52660] DAMAGECOUNT value on done: 712373.0 [2024-08-06 06:07:19,710][52660] Sum rewards: 69.670, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.670', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.118', 'weapon5': '0.170', 'AMMO3': '0.212', 'AMMO4': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '59.000'} [2024-08-06 06:07:20,581][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:07:20,777][52664] DAMAGECOUNT value on done: 741044.0 [2024-08-06 06:07:20,777][52664] Sum rewards: 74.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.936', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'weapon4': '0.248', 'AMMO3': '0.252', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:20,822][52649] DAMAGECOUNT value on done: 699168.0 [2024-08-06 06:07:20,822][52649] Sum rewards: 73.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.241', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.146', 'weapon5': '0.152', 'AMMO3': '0.209', 'AMMO4': '0.211', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:21,117][52795] DAMAGECOUNT value on done: 648131.0 [2024-08-06 06:07:21,118][52795] Sum rewards: 81.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.176', 'weapon4': '0.236', 'AMMO4': '0.253', 'AMMO3': '0.273', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.956', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '70.000'} [2024-08-06 06:07:21,190][52811] DAMAGECOUNT value on done: 658999.0 [2024-08-06 06:07:21,192][52811] Sum rewards: 81.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.803', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.228', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:22,358][52662] DAMAGECOUNT value on done: 706344.0 [2024-08-06 06:07:22,366][52662] Sum rewards: 77.907, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.413', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.063', 'WEAPON5': '0.150', 'AMMO3': '0.281', 'weapon2': '0.380', 'WEAPON3': '1.800', 'weapon3': '3.350', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '68.000'} [2024-08-06 06:07:22,491][52650] Updated weights for policy 0, policy_version 66391 (0.0034) [2024-08-06 06:07:22,537][52668] DAMAGECOUNT value on done: 706013.0 [2024-08-06 06:07:22,539][52668] Sum rewards: 61.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.066', 'weapon5': '0.110', 'AMMO4': '0.136', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.802', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '50.000'} [2024-08-06 06:07:22,697][52820] DAMAGECOUNT value on done: 658233.0 [2024-08-06 06:07:22,697][52820] Sum rewards: 79.924, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.144', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.084', 'weapon4': '0.108', 'AMMO4': '0.166', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.190', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '71.000'} [2024-08-06 06:07:22,697][52660] DAMAGECOUNT value on done: 720300.0 [2024-08-06 06:07:22,701][52660] Sum rewards: 84.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.258', 'WEAPON3': '1.300', 'weapon3': '3.416', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '70.000'} [2024-08-06 06:07:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 543875072. Throughput: 0: 4374.0. Samples: 135972490. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:22,795][52567] Avg episode reward: [(0, '74.169')] [2024-08-06 06:07:23,354][52664] DAMAGECOUNT value on done: 744487.0 [2024-08-06 06:07:23,355][52664] Sum rewards: 78.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.022', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon2': '0.194', 'AMMO3': '0.202', 'weapon5': '0.262', 'AMMO4': '0.290', 'weapon4': '0.320', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:23,983][52649] DAMAGECOUNT value on done: 694781.0 [2024-08-06 06:07:23,987][52649] Sum rewards: 86.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.354', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.296', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.421', 'FRAGCOUNT': '72.000'} [2024-08-06 06:07:24,258][52795] DAMAGECOUNT value on done: 657524.0 [2024-08-06 06:07:24,258][52795] Sum rewards: 84.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.729', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.438', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.015', 'FRAGCOUNT': '69.000'} [2024-08-06 06:07:24,259][52811] DAMAGECOUNT value on done: 666013.0 [2024-08-06 06:07:24,263][52811] Sum rewards: 59.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.135', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon2': '0.174', 'weapon4': '0.202', 'weapon5': '0.220', 'AMMO4': '0.223', 'AMMO3': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.144', 'DAMAGECOUNT': '14.592', 'FRAGCOUNT': '52.000'} [2024-08-06 06:07:24,992][52662] DAMAGECOUNT value on done: 707782.0 [2024-08-06 06:07:24,994][52662] Sum rewards: 76.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.062', 'AMMO4': '0.165', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.194', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:25,451][52668] DAMAGECOUNT value on done: 705777.0 [2024-08-06 06:07:25,452][52668] Sum rewards: 86.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.127', 'weapon5': '0.152', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '70.000'} [2024-08-06 06:07:25,656][52660] DAMAGECOUNT value on done: 704853.0 [2024-08-06 06:07:25,658][52660] Sum rewards: 74.670, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.343', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.148', 'AMMO3': '0.208', 'AMMO4': '0.208', 'weapon4': '0.230', 'weapon2': '0.262', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:25,789][52820] DAMAGECOUNT value on done: 648846.0 [2024-08-06 06:07:25,790][52820] Sum rewards: 65.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.102', 'weapon5': '0.144', 'AMMO4': '0.162', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:25,994][52664] DAMAGECOUNT value on done: 745659.0 [2024-08-06 06:07:25,996][52664] Sum rewards: 81.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.990', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.134', 'weapon4': '0.146', 'AMMO3': '0.227', 'weapon2': '0.256', 'AMMO4': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '68.000'} [2024-08-06 06:07:27,196][52649] DAMAGECOUNT value on done: 682651.0 [2024-08-06 06:07:27,196][52649] Sum rewards: 75.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.040', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.204', 'AMMO3': '0.233', 'AMMO4': '0.243', 'weapon2': '0.258', 'weapon4': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:27,309][52811] DAMAGECOUNT value on done: 670609.0 [2024-08-06 06:07:27,309][52811] Sum rewards: 80.174, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.498', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.140', 'weapon4': '0.144', 'AMMO3': '0.166', 'AMMO4': '0.191', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.230', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:27,450][52795] DAMAGECOUNT value on done: 649077.0 [2024-08-06 06:07:27,451][52795] Sum rewards: 73.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.046', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.098', 'WEAPON4': '0.100', 'weapon2': '0.120', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon4': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:27,665][52650] Updated weights for policy 0, policy_version 66401 (0.0044) [2024-08-06 06:07:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 543956992. Throughput: 0: 4370.9. Samples: 135998630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:27,795][52567] Avg episode reward: [(0, '74.568')] [2024-08-06 06:07:28,077][52662] DAMAGECOUNT value on done: 705359.0 [2024-08-06 06:07:28,077][52662] Sum rewards: 64.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.025', 'AMMO2': '0.060', 'weapon4': '0.090', 'weapon5': '0.214', 'AMMO3': '0.229', 'weapon2': '0.242', 'AMMO4': '0.299', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.172', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '54.000'} [2024-08-06 06:07:28,166][52668] DAMAGECOUNT value on done: 712584.0 [2024-08-06 06:07:28,166][52668] Sum rewards: 74.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.941', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:28,255][52663] Large shaping reward 2.752 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 06:07:28,500][52660] DAMAGECOUNT value on done: 700625.0 [2024-08-06 06:07:28,500][52660] Sum rewards: 80.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.635', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.180', 'weapon5': '0.194', 'AMMO4': '0.196', 'weapon4': '0.334', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.838', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:28,864][52820] DAMAGECOUNT value on done: 662125.0 [2024-08-06 06:07:28,869][52820] Sum rewards: 79.404, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.174', 'AMMO5': '0.019', 'AMMO2': '0.066', 'AMMO3': '0.282', 'weapon4': '0.302', 'weapon5': '0.318', 'AMMO4': '0.331', 'weapon2': '0.350', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.750', 'weapon3': '2.632', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.427', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:29,017][52664] DAMAGECOUNT value on done: 739805.0 [2024-08-06 06:07:29,017][52664] Sum rewards: 75.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.398', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.102', 'AMMO4': '0.113', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:30,320][52649] DAMAGECOUNT value on done: 698579.0 [2024-08-06 06:07:30,324][52649] Sum rewards: 71.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.018', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.271', 'WEAPON3': '1.700', 'weapon3': '3.276', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:30,428][52811] DAMAGECOUNT value on done: 667647.0 [2024-08-06 06:07:30,430][52811] Sum rewards: 75.307, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.062', 'weapon4': '0.138', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '66.000'} [2024-08-06 06:07:30,603][52795] DAMAGECOUNT value on done: 658504.0 [2024-08-06 06:07:30,603][52795] Sum rewards: 66.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.188', 'AMMO3': '0.192', 'weapon4': '0.290', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '54.000'} [2024-08-06 06:07:30,752][52668] Large shaping reward 2.751 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:07:30,860][52662] DAMAGECOUNT value on done: 714626.0 [2024-08-06 06:07:30,862][52662] Sum rewards: 65.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.074', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO4': '0.136', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:31,096][52668] DAMAGECOUNT value on done: 711094.0 [2024-08-06 06:07:31,097][52668] Sum rewards: 85.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.158', 'AMMO4': '0.180', 'AMMO3': '0.218', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '70.000'} [2024-08-06 06:07:31,456][52660] DAMAGECOUNT value on done: 705937.0 [2024-08-06 06:07:31,457][52660] Sum rewards: 74.439, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO3': '0.112', 'AMMO4': '0.147', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.314', 'weapon2': '0.714', 'WEAPON3': '0.850', 'weapon3': '2.570', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '57.000'} [2024-08-06 06:07:31,479][52664] DAMAGECOUNT value on done: 732336.0 [2024-08-06 06:07:31,480][52664] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.137', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.119', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.100', 'weapon3': '3.298', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '60.500'} [2024-08-06 06:07:31,935][52650] Updated weights for policy 0, policy_version 66411 (0.0011) [2024-08-06 06:07:31,953][52820] DAMAGECOUNT value on done: 646750.0 [2024-08-06 06:07:31,953][52820] Sum rewards: 69.279, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.162', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.132', 'weapon2': '0.164', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.274', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '59.000'} [2024-08-06 06:07:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 544047104. Throughput: 0: 4373.1. Samples: 136011570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:32,802][52567] Avg episode reward: [(0, '74.409')] [2024-08-06 06:07:33,520][52649] DAMAGECOUNT value on done: 691842.0 [2024-08-06 06:07:33,522][52649] Sum rewards: 76.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.056', 'AMMO4': '0.170', 'weapon5': '0.202', 'weapon2': '0.246', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.280', 'weapon3': '3.286', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:33,576][52811] DAMAGECOUNT value on done: 658077.0 [2024-08-06 06:07:33,576][52811] Sum rewards: 95.158, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.666', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'AMMO3': '0.151', 'weapon4': '0.174', 'weapon2': '0.386', 'WEAPON3': '1.000', 'weapon3': '3.260', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '76.000'} [2024-08-06 06:07:33,764][52795] DAMAGECOUNT value on done: 663643.0 [2024-08-06 06:07:33,765][52795] Sum rewards: 66.601, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.910', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.100', 'weapon5': '0.134', 'weapon2': '0.220', 'AMMO3': '0.251', 'AMMO4': '0.325', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.294', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '59.000'} [2024-08-06 06:07:33,853][52662] DAMAGECOUNT value on done: 704243.0 [2024-08-06 06:07:33,853][52662] Sum rewards: 75.716, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.328', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.168', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '65.000'} [2024-08-06 06:07:34,088][52664] DAMAGECOUNT value on done: 734816.0 [2024-08-06 06:07:34,089][52664] Sum rewards: 74.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.292', 'weapon4': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:34,428][52660] DAMAGECOUNT value on done: 716534.0 [2024-08-06 06:07:34,430][52660] Sum rewards: 64.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.120', 'AMMO3': '0.206', 'AMMO4': '0.223', 'weapon2': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.382', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '54.000'} [2024-08-06 06:07:34,963][52820] DAMAGECOUNT value on done: 657101.0 [2024-08-06 06:07:34,963][52820] Sum rewards: 72.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.070', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.386', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.298', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:36,293][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:36,488][52662] DAMAGECOUNT value on done: 718774.0 [2024-08-06 06:07:36,491][52662] Sum rewards: 66.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.239', 'weapon2': '0.584', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:36,562][52650] Updated weights for policy 0, policy_version 66421 (0.0029) [2024-08-06 06:07:36,601][52811] DAMAGECOUNT value on done: 670523.0 [2024-08-06 06:07:36,603][52811] Sum rewards: 75.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.124', 'AMMO4': '0.125', 'weapon2': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'HITCOUNT': '3.440', 'weapon3': '3.458', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:36,685][52649] DAMAGECOUNT value on done: 693277.0 [2024-08-06 06:07:36,686][52649] Sum rewards: 69.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.933', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.192', 'AMMO3': '0.228', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 06:07:36,911][52795] DAMAGECOUNT value on done: 655308.0 [2024-08-06 06:07:36,912][52795] Sum rewards: 69.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.780', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.076', 'weapon5': '0.178', 'AMMO3': '0.272', 'AMMO4': '0.313', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.146', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:37,278][52664] DAMAGECOUNT value on done: 735614.0 [2024-08-06 06:07:37,279][52664] Sum rewards: 82.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.222', 'WEAPON3': '1.300', 'weapon3': '3.442', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:37,436][52660] DAMAGECOUNT value on done: 701639.0 [2024-08-06 06:07:37,437][52660] Sum rewards: 84.432, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.060', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.172', 'weapon2': '0.222', 'AMMO3': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.270', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.204', 'FRAGCOUNT': '73.500'} [2024-08-06 06:07:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 544129024. Throughput: 0: 4366.9. Samples: 136037760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:37,795][52567] Avg episode reward: [(0, '74.670')] [2024-08-06 06:07:37,979][52820] DAMAGECOUNT value on done: 659775.0 [2024-08-06 06:07:37,981][52820] Sum rewards: 70.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.346', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.153', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '57.000'} [2024-08-06 06:07:38,035][52614] Signal inference workers to stop experience collection... (12100 times) [2024-08-06 06:07:38,036][52614] Signal inference workers to resume experience collection... (12100 times) [2024-08-06 06:07:38,116][52650] InferenceWorker_p0-w0: stopping experience collection (12100 times) [2024-08-06 06:07:38,116][52650] InferenceWorker_p0-w0: resuming experience collection (12100 times) [2024-08-06 06:07:39,442][52662] DAMAGECOUNT value on done: 714780.0 [2024-08-06 06:07:39,444][52662] Sum rewards: 72.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.078', 'weapon2': '0.138', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'HITCOUNT': '3.390', 'weapon3': '3.550', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:39,593][52811] DAMAGECOUNT value on done: 665743.0 [2024-08-06 06:07:39,593][52811] Sum rewards: 73.242, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.745', 'AMMO5': '0.031', 'AMMO2': '0.097', 'weapon4': '0.200', 'AMMO3': '0.318', 'weapon5': '0.400', 'weapon2': '0.438', 'AMMO4': '0.485', 'WEAPON4': '0.950', 'WEAPON5': '0.950', 'WEAPON3': '1.850', 'weapon3': '2.574', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:39,871][52649] DAMAGECOUNT value on done: 693671.0 [2024-08-06 06:07:39,872][52649] Sum rewards: 76.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.119', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:40,021][52664] DAMAGECOUNT value on done: 734674.0 [2024-08-06 06:07:40,021][52664] Sum rewards: 72.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.826', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '59.000'} [2024-08-06 06:07:40,100][52795] DAMAGECOUNT value on done: 653141.0 [2024-08-06 06:07:40,101][52795] Sum rewards: 81.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.144', 'AMMO3': '0.182', 'weapon4': '0.182', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:40,521][52660] DAMAGECOUNT value on done: 705634.0 [2024-08-06 06:07:40,523][52660] Sum rewards: 78.107, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.616', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.267', 'WEAPON3': '1.500', 'weapon3': '3.428', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:41,162][52820] DAMAGECOUNT value on done: 658317.0 [2024-08-06 06:07:41,163][52820] Sum rewards: 95.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.331', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.246', 'weapon2': '0.426', 'WEAPON3': '1.650', 'weapon3': '3.404', 'HITCOUNT': '4.390', 'DAMAGECOUNT': '23.277', 'FRAGCOUNT': '79.000'} [2024-08-06 06:07:41,303][52650] Updated weights for policy 0, policy_version 66431 (0.0012) [2024-08-06 06:07:42,413][52662] DAMAGECOUNT value on done: 700642.0 [2024-08-06 06:07:42,415][52662] Sum rewards: 67.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.830', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.102', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'weapon4': '0.302', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '54.000'} [2024-08-06 06:07:42,462][52647] DAMAGECOUNT value on done: 751774.0 [2024-08-06 06:07:42,464][52647] Sum rewards: 67.497, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.433', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.426', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.392', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 06:07:42,472][52820] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:07:42,638][52811] DAMAGECOUNT value on done: 668996.0 [2024-08-06 06:07:42,638][52811] Sum rewards: 83.796, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.365', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.072', 'weapon5': '0.092', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.322', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.892', 'FRAGCOUNT': '71.500'} [2024-08-06 06:07:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 544219136. Throughput: 0: 4370.4. Samples: 136064340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:42,802][52567] Avg episode reward: [(0, '74.933')] [2024-08-06 06:07:42,913][52649] DAMAGECOUNT value on done: 686026.0 [2024-08-06 06:07:42,916][52649] Sum rewards: 73.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.837', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.110', 'weapon5': '0.166', 'AMMO4': '0.205', 'AMMO3': '0.206', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:43,205][52795] DAMAGECOUNT value on done: 660001.0 [2024-08-06 06:07:43,209][52795] Sum rewards: 70.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.051', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.178', 'AMMO3': '0.235', 'weapon5': '0.246', 'AMMO4': '0.268', 'weapon2': '0.288', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 06:07:43,256][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:43,503][52660] DAMAGECOUNT value on done: 710450.0 [2024-08-06 06:07:43,503][52660] Sum rewards: 68.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.214', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.104', 'AMMO4': '0.151', 'weapon5': '0.206', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.674', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '57.000'} [2024-08-06 06:07:44,477][52820] DAMAGECOUNT value on done: 666380.0 [2024-08-06 06:07:44,479][52820] Sum rewards: 85.923, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'AMMO5': '0.015', 'AMMO2': '0.066', 'weapon4': '0.108', 'weapon5': '0.202', 'AMMO3': '0.245', 'AMMO4': '0.330', 'weapon2': '0.380', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.315', 'FRAGCOUNT': '71.000'} [2024-08-06 06:07:45,246][52647] DAMAGECOUNT value on done: 743231.0 [2024-08-06 06:07:45,246][52647] Sum rewards: 66.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.453', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.186', 'AMMO4': '0.205', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:45,538][52662] DAMAGECOUNT value on done: 709905.0 [2024-08-06 06:07:45,543][52662] Sum rewards: 65.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.144', 'AMMO4': '0.179', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2024-08-06 06:07:45,613][52649] DAMAGECOUNT value on done: 699439.0 [2024-08-06 06:07:45,614][52649] Sum rewards: 70.530, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.555', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.046', 'weapon5': '0.132', 'AMMO3': '0.172', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:45,779][52811] DAMAGECOUNT value on done: 670719.0 [2024-08-06 06:07:45,781][52811] Sum rewards: 89.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.082', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '72.000'} [2024-08-06 06:07:46,391][52795] DAMAGECOUNT value on done: 654608.0 [2024-08-06 06:07:46,392][52795] Sum rewards: 77.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon5': '0.140', 'weapon4': '0.144', 'AMMO3': '0.174', 'weapon2': '0.260', 'AMMO4': '0.267', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.202', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:46,564][52660] DAMAGECOUNT value on done: 702705.0 [2024-08-06 06:07:46,565][52660] Sum rewards: 69.587, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.621', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.174', 'AMMO4': '0.180', 'weapon5': '0.242', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.696', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '55.000'} [2024-08-06 06:07:46,575][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:46,611][52650] Updated weights for policy 0, policy_version 66441 (0.0024) [2024-08-06 06:07:47,589][52820] DAMAGECOUNT value on done: 652332.0 [2024-08-06 06:07:47,590][52820] Sum rewards: 71.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.578', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.104', 'weapon5': '0.120', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.320', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.210', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:47,648][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:47,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 544317440. Throughput: 0: 4361.6. Samples: 136077130. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:47,794][52567] Avg episode reward: [(0, '74.990')] [2024-08-06 06:07:48,205][52649] DAMAGECOUNT value on done: 701219.0 [2024-08-06 06:07:48,206][52649] Sum rewards: 81.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.974', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.510', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '68.000'} [2024-08-06 06:07:48,384][52647] DAMAGECOUNT value on done: 751472.0 [2024-08-06 06:07:48,385][52647] Sum rewards: 82.731, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.034', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.236', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '68.000'} [2024-08-06 06:07:48,662][52662] DAMAGECOUNT value on done: 701787.0 [2024-08-06 06:07:48,664][52662] Sum rewards: 70.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.590', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '2.930', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '56.000'} [2024-08-06 06:07:48,704][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:07:48,778][52659] DAMAGECOUNT value on done: 712777.0 [2024-08-06 06:07:48,780][52659] Sum rewards: 74.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.365', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.237', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:48,859][52811] DAMAGECOUNT value on done: 665026.0 [2024-08-06 06:07:48,859][52811] Sum rewards: 80.713, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.538', 'AMMO5': '0.029', 'AMMO2': '0.059', 'weapon4': '0.124', 'weapon5': '0.264', 'AMMO3': '0.268', 'AMMO4': '0.293', 'weapon2': '0.298', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '69.000'} [2024-08-06 06:07:49,548][52795] DAMAGECOUNT value on done: 651178.0 [2024-08-06 06:07:49,548][52795] Sum rewards: 78.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.259', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.264', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '66.000'} [2024-08-06 06:07:49,815][52660] DAMAGECOUNT value on done: 707743.0 [2024-08-06 06:07:49,816][52660] Sum rewards: 71.757, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.038', 'HEALTH': '0.120', 'AMMO3': '0.142', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.216', 'weapon4': '0.252', 'weapon2': '0.546', 'WEAPON3': '0.850', 'weapon3': '2.764', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '55.000'} [2024-08-06 06:07:50,519][52650] Updated weights for policy 0, policy_version 66451 (0.0018) [2024-08-06 06:07:50,643][52820] DAMAGECOUNT value on done: 658059.0 [2024-08-06 06:07:50,645][52820] Sum rewards: 72.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.150', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.412', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:51,170][52647] DAMAGECOUNT value on done: 750962.0 [2024-08-06 06:07:51,170][52647] Sum rewards: 78.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.229', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '65.000'} [2024-08-06 06:07:51,432][52649] DAMAGECOUNT value on done: 699639.0 [2024-08-06 06:07:51,432][52649] Sum rewards: 71.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.461', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon2': '0.170', 'weapon5': '0.178', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '58.000'} [2024-08-06 06:07:51,875][52811] DAMAGECOUNT value on done: 662755.0 [2024-08-06 06:07:51,879][52811] Sum rewards: 72.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.694', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.524', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.120', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:51,977][52659] DAMAGECOUNT value on done: 711628.0 [2024-08-06 06:07:51,979][52659] Sum rewards: 76.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.362', 'WEAPON3': '1.100', 'HITCOUNT': '3.370', 'weapon3': '3.416', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:52,267][52660] DAMAGECOUNT value on done: 716792.0 [2024-08-06 06:07:52,271][52660] Sum rewards: 63.188, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.871', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon5': '0.014', 'weapon4': '0.018', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON3': '0.950', 'HITCOUNT': '3.100', 'weapon3': '3.414', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '50.000'} [2024-08-06 06:07:52,775][52795] DAMAGECOUNT value on done: 650446.0 [2024-08-06 06:07:52,777][52795] Sum rewards: 74.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.936', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.176', 'AMMO4': '0.205', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:52,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 544399360. Throughput: 0: 4375.1. Samples: 136103670. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:52,795][52567] Avg episode reward: [(0, '74.889')] [2024-08-06 06:07:53,564][52647] DAMAGECOUNT value on done: 757013.0 [2024-08-06 06:07:53,565][52647] Sum rewards: 81.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '1.250', 'weapon3': '3.492', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '67.000'} [2024-08-06 06:07:53,641][52820] DAMAGECOUNT value on done: 667702.0 [2024-08-06 06:07:53,642][52820] Sum rewards: 74.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.177', 'weapon5': '0.182', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.400', 'weapon3': '2.846', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:54,459][52649] DAMAGECOUNT value on done: 699021.0 [2024-08-06 06:07:54,460][52649] Sum rewards: 79.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.815', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.088', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '64.000'} [2024-08-06 06:07:54,837][52659] DAMAGECOUNT value on done: 713901.0 [2024-08-06 06:07:54,838][52659] Sum rewards: 73.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.124', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:55,013][52660] DAMAGECOUNT value on done: 727527.0 [2024-08-06 06:07:55,014][52660] Sum rewards: 73.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.196', 'weapon2': '0.206', 'AMMO4': '0.220', 'AMMO3': '0.258', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '60.500'} [2024-08-06 06:07:55,048][52811] DAMAGECOUNT value on done: 661001.0 [2024-08-06 06:07:55,049][52811] Sum rewards: 70.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.009', 'AMMO2': '0.053', 'weapon4': '0.106', 'weapon5': '0.118', 'weapon2': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.446', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '58.000'} [2024-08-06 06:07:55,412][52803] DAMAGECOUNT value on done: 659920.0 [2024-08-06 06:07:55,414][52803] Sum rewards: 75.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon4': '0.212', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:55,520][52650] Updated weights for policy 0, policy_version 66461 (0.0022) [2024-08-06 06:07:55,882][52795] DAMAGECOUNT value on done: 661380.0 [2024-08-06 06:07:55,882][52795] Sum rewards: 71.268, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.736', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO4': '0.157', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '61.000'} [2024-08-06 06:07:56,232][52647] DAMAGECOUNT value on done: 754746.0 [2024-08-06 06:07:56,232][52647] Sum rewards: 60.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.124', 'AMMO4': '0.182', 'AMMO3': '0.207', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '53.000'} [2024-08-06 06:07:56,829][52820] DAMAGECOUNT value on done: 661403.0 [2024-08-06 06:07:56,830][52820] Sum rewards: 70.924, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.078', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.076', 'AMMO4': '0.084', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.288', 'weapon2': '0.430', 'WEAPON3': '1.750', 'weapon3': '3.146', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:57,557][52649] DAMAGECOUNT value on done: 685008.0 [2024-08-06 06:07:57,558][52649] Sum rewards: 88.469, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.078', 'HEALTH': '0.147', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.514', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '71.000'} [2024-08-06 06:07:57,658][52659] DAMAGECOUNT value on done: 712313.0 [2024-08-06 06:07:57,658][52659] Sum rewards: 77.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.014', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.026', 'weapon5': '0.048', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.570', 'WEAPON3': '1.550', 'weapon3': '3.164', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '65.500'} [2024-08-06 06:07:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 544489472. Throughput: 0: 4370.2. Samples: 136129900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:07:57,794][52567] Avg episode reward: [(0, '75.012')] [2024-08-06 06:07:58,026][52660] DAMAGECOUNT value on done: 705845.0 [2024-08-06 06:07:58,028][52660] Sum rewards: 75.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.112', 'AMMO4': '0.202', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.258', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 06:07:58,194][52811] DAMAGECOUNT value on done: 661783.0 [2024-08-06 06:07:58,194][52811] Sum rewards: 74.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.140', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.600', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '63.000'} [2024-08-06 06:07:58,685][52803] DAMAGECOUNT value on done: 659755.0 [2024-08-06 06:07:58,687][52803] Sum rewards: 70.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.824', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.226', 'AMMO4': '0.254', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '58.500'} [2024-08-06 06:07:59,145][52647] DAMAGECOUNT value on done: 754336.0 [2024-08-06 06:07:59,146][52647] Sum rewards: 89.201, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.974', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon4': '0.118', 'AMMO4': '0.220', 'AMMO3': '0.224', 'weapon5': '0.234', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '22.368', 'FRAGCOUNT': '75.000'} [2024-08-06 06:07:59,149][52795] DAMAGECOUNT value on done: 646652.0 [2024-08-06 06:07:59,150][52795] Sum rewards: 77.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.295', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.096', 'AMMO4': '0.112', 'AMMO3': '0.145', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.752', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '60.000'} [2024-08-06 06:07:59,992][52820] DAMAGECOUNT value on done: 663574.0 [2024-08-06 06:07:59,993][52820] Sum rewards: 72.855, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.074', 'weapon5': '0.198', 'AMMO3': '0.275', 'AMMO4': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.562', 'WEAPON3': '1.650', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:00,058][52650] Updated weights for policy 0, policy_version 66471 (0.0013) [2024-08-06 06:08:00,483][52649] DAMAGECOUNT value on done: 696416.0 [2024-08-06 06:08:00,484][52649] Sum rewards: 74.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.292', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.038', 'weapon5': '0.168', 'AMMO4': '0.183', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:00,718][52659] DAMAGECOUNT value on done: 709282.0 [2024-08-06 06:08:00,718][52659] Sum rewards: 76.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.170', 'AMMO5': '0.027', 'AMMO2': '0.074', 'AMMO3': '0.201', 'weapon4': '0.234', 'weapon5': '0.278', 'AMMO4': '0.368', 'weapon2': '0.530', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.604', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:01,081][52660] DAMAGECOUNT value on done: 713667.0 [2024-08-06 06:08:01,081][52660] Sum rewards: 84.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon4': '0.308', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '70.000'} [2024-08-06 06:08:01,248][52811] DAMAGECOUNT value on done: 665864.0 [2024-08-06 06:08:01,248][52811] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.015', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.080', 'AMMO4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.184', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.326', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:01,871][52803] DAMAGECOUNT value on done: 665854.0 [2024-08-06 06:08:01,874][52803] Sum rewards: 74.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.863', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.176', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:02,085][52647] DAMAGECOUNT value on done: 736360.0 [2024-08-06 06:08:02,086][52647] Sum rewards: 74.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.080', 'AMMO3': '0.209', 'AMMO4': '0.210', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:02,482][52795] DAMAGECOUNT value on done: 664247.0 [2024-08-06 06:08:02,482][52795] Sum rewards: 81.738, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.460', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.007', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.654', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 544571392. Throughput: 0: 4372.7. Samples: 136142920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:08:02,794][52567] Avg episode reward: [(0, '75.310')] [2024-08-06 06:08:03,060][52667] DAMAGECOUNT value on done: 710785.0 [2024-08-06 06:08:03,061][52667] Sum rewards: 76.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.014', 'weapon4': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'weapon5': '0.196', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '62.000'} [2024-08-06 06:08:03,073][52820] DAMAGECOUNT value on done: 659359.0 [2024-08-06 06:08:03,076][52820] Sum rewards: 65.230, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.400', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.148', 'AMMO3': '0.259', 'AMMO4': '0.261', 'weapon5': '0.304', 'weapon2': '0.444', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.788', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:03,326][52659] DAMAGECOUNT value on done: 714941.0 [2024-08-06 06:08:03,327][52659] Sum rewards: 88.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.040', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.468', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '72.000'} [2024-08-06 06:08:03,662][52649] DAMAGECOUNT value on done: 683697.0 [2024-08-06 06:08:03,664][52649] Sum rewards: 60.883, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.818', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.148', 'weapon5': '0.260', 'AMMO4': '0.287', 'AMMO3': '0.311', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.822', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '56.000'} [2024-08-06 06:08:03,840][52660] DAMAGECOUNT value on done: 710156.0 [2024-08-06 06:08:03,842][52660] Sum rewards: 73.759, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.854', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.092', 'AMMO4': '0.147', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'weapon2': '0.316', 'WEAPON3': '1.700', 'weapon3': '3.054', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '64.000'} [2024-08-06 06:08:04,311][52811] DAMAGECOUNT value on done: 669624.0 [2024-08-06 06:08:04,311][52811] Sum rewards: 81.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.096', 'weapon5': '0.136', 'AMMO3': '0.179', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:04,721][52650] Updated weights for policy 0, policy_version 66481 (0.0036) [2024-08-06 06:08:05,031][52803] DAMAGECOUNT value on done: 665700.0 [2024-08-06 06:08:05,031][52803] Sum rewards: 70.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.361', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.246', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:05,164][52647] DAMAGECOUNT value on done: 751627.0 [2024-08-06 06:08:05,164][52647] Sum rewards: 64.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.848', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.221', 'weapon4': '0.244', 'AMMO4': '0.258', 'weapon5': '0.270', 'weapon2': '0.354', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.802', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '54.000'} [2024-08-06 06:08:05,618][52795] DAMAGECOUNT value on done: 657825.0 [2024-08-06 06:08:05,620][52795] Sum rewards: 78.288, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.080', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO3': '0.144', 'weapon4': '0.162', 'AMMO4': '0.166', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.612', 'WEAPON3': '0.900', 'weapon3': '2.790', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:06,087][52659] DAMAGECOUNT value on done: 712022.0 [2024-08-06 06:08:06,088][52659] Sum rewards: 66.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.834', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.076', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 06:08:06,185][52667] DAMAGECOUNT value on done: 715777.0 [2024-08-06 06:08:06,185][52667] Sum rewards: 41.749, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.755', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon2': '0.168', 'AMMO3': '0.169', 'weapon4': '0.364', 'weapon7': '0.938', 'WEAPON3': '1.000', 'HITCOUNT': '2.180', 'weapon3': '2.240', 'DAMAGECOUNT': '10.998', 'FRAGCOUNT': '34.000'} [2024-08-06 06:08:06,306][52820] DAMAGECOUNT value on done: 661614.0 [2024-08-06 06:08:06,307][52820] Sum rewards: 73.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.129', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.068', 'AMMO4': '0.118', 'weapon5': '0.132', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:06,703][52649] DAMAGECOUNT value on done: 699068.0 [2024-08-06 06:08:06,703][52649] Sum rewards: 66.646, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.080', 'AMMO4': '0.168', 'weapon5': '0.210', 'AMMO3': '0.245', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.116', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:06,708][52660] DAMAGECOUNT value on done: 704825.0 [2024-08-06 06:08:06,709][52660] Sum rewards: 89.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.777', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.132', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.228', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '73.000'} [2024-08-06 06:08:07,214][52811] DAMAGECOUNT value on done: 665512.0 [2024-08-06 06:08:07,218][52811] Sum rewards: 71.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.193', 'AMMO4': '0.199', 'weapon4': '0.218', 'weapon5': '0.284', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 544661504. Throughput: 0: 4374.0. Samples: 136169320. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:08:07,794][52567] Avg episode reward: [(0, '74.539')] [2024-08-06 06:08:07,925][52647] DAMAGECOUNT value on done: 749848.0 [2024-08-06 06:08:07,927][52647] Sum rewards: 84.736, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.303', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.130', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.260', 'WEAPON3': '1.650', 'weapon3': '3.104', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '72.000'} [2024-08-06 06:08:08,322][52803] DAMAGECOUNT value on done: 665406.0 [2024-08-06 06:08:08,324][52803] Sum rewards: 86.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'AMMO5': '0.013', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.204', 'weapon5': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '68.500'} [2024-08-06 06:08:08,752][52795] DAMAGECOUNT value on done: 649801.0 [2024-08-06 06:08:08,755][52795] Sum rewards: 76.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.128', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.330', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:08,848][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:08:08,865][52667] DAMAGECOUNT value on done: 713413.0 [2024-08-06 06:08:08,866][52667] Sum rewards: 79.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.154', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.252', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.454', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:09,370][52659] DAMAGECOUNT value on done: 708260.0 [2024-08-06 06:08:09,371][52659] Sum rewards: 73.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.455', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.076', 'AMMO4': '0.183', 'AMMO3': '0.196', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '59.000'} [2024-08-06 06:08:09,465][52820] DAMAGECOUNT value on done: 672230.0 [2024-08-06 06:08:09,467][52820] Sum rewards: 79.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.136', 'weapon5': '0.178', 'AMMO4': '0.218', 'AMMO3': '0.220', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.824', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:09,551][52650] Updated weights for policy 0, policy_version 66491 (0.0012) [2024-08-06 06:08:09,625][52660] DAMAGECOUNT value on done: 699776.0 [2024-08-06 06:08:09,626][52660] Sum rewards: 81.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.155', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:09,944][52649] DAMAGECOUNT value on done: 700066.0 [2024-08-06 06:08:09,944][52649] Sum rewards: 82.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.207', 'weapon5': '0.224', 'AMMO4': '0.255', 'weapon2': '0.296', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:10,297][52811] DAMAGECOUNT value on done: 663771.0 [2024-08-06 06:08:10,297][52811] Sum rewards: 83.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.973', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.126', 'weapon4': '0.210', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.943', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:10,993][52647] DAMAGECOUNT value on done: 747013.0 [2024-08-06 06:08:10,993][52647] Sum rewards: 58.817, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.890', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.124', 'weapon5': '0.168', 'AMMO3': '0.178', 'AMMO4': '0.231', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.188', 'DAMAGECOUNT': '13.281', 'FRAGCOUNT': '49.000'} [2024-08-06 06:08:11,347][52667] DAMAGECOUNT value on done: 717780.0 [2024-08-06 06:08:11,347][52667] Sum rewards: 76.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:11,699][52803] DAMAGECOUNT value on done: 660155.0 [2024-08-06 06:08:11,699][52803] Sum rewards: 86.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.762', 'FRAGCOUNT': '70.000'} [2024-08-06 06:08:11,878][52795] DAMAGECOUNT value on done: 657767.0 [2024-08-06 06:08:11,879][52795] Sum rewards: 78.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '64.000'} [2024-08-06 06:08:12,005][52794] DAMAGECOUNT value on done: 709808.0 [2024-08-06 06:08:12,005][52794] Sum rewards: 66.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.085', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.201', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '54.000'} [2024-08-06 06:08:12,322][52659] DAMAGECOUNT value on done: 713048.0 [2024-08-06 06:08:12,322][52659] Sum rewards: 73.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.096', 'AMMO3': '0.214', 'AMMO4': '0.215', 'weapon4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:12,510][52820] DAMAGECOUNT value on done: 669974.0 [2024-08-06 06:08:12,510][52820] Sum rewards: 73.788, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.283', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.140', 'weapon4': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 544743424. Throughput: 0: 4378.0. Samples: 136195640. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:12,795][52567] Avg episode reward: [(0, '74.884')] [2024-08-06 06:08:13,126][52649] DAMAGECOUNT value on done: 692756.0 [2024-08-06 06:08:13,126][52649] Sum rewards: 67.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.152', 'AMMO5': '0.018', 'AMMO2': '0.063', 'AMMO3': '0.228', 'weapon4': '0.240', 'weapon5': '0.240', 'AMMO4': '0.315', 'weapon2': '0.470', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.726', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '56.000'} [2024-08-06 06:08:13,686][52647] DAMAGECOUNT value on done: 740784.0 [2024-08-06 06:08:13,687][52647] Sum rewards: 81.515, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'AMMO2': '0.005', 'HEALTH': '0.025', 'AMMO4': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'weapon2': '0.114', 'AMMO3': '0.206', 'WEAPON3': '1.150', 'HITCOUNT': '3.430', 'weapon3': '3.636', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:14,364][52650] Updated weights for policy 0, policy_version 66501 (0.0012) [2024-08-06 06:08:14,464][52794] DAMAGECOUNT value on done: 716676.0 [2024-08-06 06:08:14,467][52794] Sum rewards: 81.687, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.603', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'weapon2': '0.224', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.346', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '71.000'} [2024-08-06 06:08:14,602][52667] DAMAGECOUNT value on done: 717711.0 [2024-08-06 06:08:14,606][52667] Sum rewards: 84.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.055', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.164', 'AMMO4': '0.190', 'weapon2': '0.192', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:14,814][52803] DAMAGECOUNT value on done: 655448.0 [2024-08-06 06:08:14,814][52803] Sum rewards: 64.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.554', 'AMMO5': '0.024', 'AMMO2': '0.051', 'weapon5': '0.144', 'weapon4': '0.184', 'AMMO3': '0.226', 'AMMO4': '0.256', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.830', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '55.000'} [2024-08-06 06:08:15,073][52795] DAMAGECOUNT value on done: 665926.0 [2024-08-06 06:08:15,073][52795] Sum rewards: 78.008, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.212', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.180', 'AMMO3': '0.182', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.644', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:15,505][52659] DAMAGECOUNT value on done: 717798.0 [2024-08-06 06:08:15,505][52659] Sum rewards: 66.950, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.157', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.280', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '54.000'} [2024-08-06 06:08:15,692][52665] DAMAGECOUNT value on done: 696632.0 [2024-08-06 06:08:15,692][52665] Sum rewards: 74.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.465', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon4': '0.094', 'AMMO3': '0.233', 'AMMO4': '0.262', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '62.000'} [2024-08-06 06:08:15,713][52820] DAMAGECOUNT value on done: 655684.0 [2024-08-06 06:08:15,714][52820] Sum rewards: 55.794, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.230', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.127', 'weapon5': '0.166', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '46.000'} [2024-08-06 06:08:16,171][52647] DAMAGECOUNT value on done: 755093.0 [2024-08-06 06:08:16,172][52647] Sum rewards: 78.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.070', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.118', 'AMMO4': '0.175', 'weapon4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:16,951][52794] DAMAGECOUNT value on done: 720114.0 [2024-08-06 06:08:16,952][52794] Sum rewards: 74.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.046', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '62.000'} [2024-08-06 06:08:17,742][52667] DAMAGECOUNT value on done: 720660.0 [2024-08-06 06:08:17,745][52667] Sum rewards: 76.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.535', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.140', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.268', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.084', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 544833536. Throughput: 0: 4378.7. Samples: 136208610. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:17,794][52567] Avg episode reward: [(0, '74.951')] [2024-08-06 06:08:17,968][52803] DAMAGECOUNT value on done: 655057.0 [2024-08-06 06:08:17,969][52803] Sum rewards: 82.590, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.754', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.172', 'AMMO4': '0.236', 'weapon5': '0.236', 'AMMO3': '0.280', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '21.618', 'FRAGCOUNT': '69.000'} [2024-08-06 06:08:18,224][52659] DAMAGECOUNT value on done: 705587.0 [2024-08-06 06:08:18,227][52659] Sum rewards: 81.931, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.005', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.065', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.244', 'WEAPON3': '1.150', 'weapon3': '3.468', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:18,591][52647] DAMAGECOUNT value on done: 740998.0 [2024-08-06 06:08:18,591][52647] Sum rewards: 67.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.298', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.126', 'weapon2': '0.152', 'AMMO4': '0.165', 'weapon4': '0.194', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.354', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:18,797][52665] DAMAGECOUNT value on done: 713551.0 [2024-08-06 06:08:18,797][52665] Sum rewards: 76.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon2': '0.204', 'weapon5': '0.226', 'AMMO3': '0.239', 'weapon4': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '64.000'} [2024-08-06 06:08:18,988][52650] Updated weights for policy 0, policy_version 66511 (0.0012) [2024-08-06 06:08:20,329][52794] DAMAGECOUNT value on done: 706503.0 [2024-08-06 06:08:20,330][52794] Sum rewards: 82.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.048', 'weapon4': '0.106', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:20,763][52659] DAMAGECOUNT value on done: 716652.0 [2024-08-06 06:08:20,763][52659] Sum rewards: 74.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.871', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon5': '0.084', 'weapon4': '0.086', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '59.000'} [2024-08-06 06:08:20,832][52667] DAMAGECOUNT value on done: 716073.0 [2024-08-06 06:08:20,832][52667] Sum rewards: 79.066, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.078', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.140', 'AMMO3': '0.158', 'weapon5': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '64.000'} [2024-08-06 06:08:20,971][52803] DAMAGECOUNT value on done: 658725.0 [2024-08-06 06:08:20,972][52803] Sum rewards: 66.969, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.048', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.094', 'weapon5': '0.186', 'AMMO4': '0.232', 'AMMO3': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:21,571][52647] DAMAGECOUNT value on done: 751989.0 [2024-08-06 06:08:21,572][52647] Sum rewards: 72.209, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.627', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.156', 'AMMO4': '0.171', 'AMMO3': '0.239', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '62.000'} [2024-08-06 06:08:21,938][52665] DAMAGECOUNT value on done: 712725.0 [2024-08-06 06:08:21,943][52665] Sum rewards: 70.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.230', 'weapon2': '0.644', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '59.000'} [2024-08-06 06:08:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 544923648. Throughput: 0: 4380.4. Samples: 136234880. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:22,794][52567] Avg episode reward: [(0, '74.912')] [2024-08-06 06:08:23,304][52794] DAMAGECOUNT value on done: 707815.0 [2024-08-06 06:08:23,305][52794] Sum rewards: 77.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.270', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.508', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:23,378][52667] DAMAGECOUNT value on done: 713841.0 [2024-08-06 06:08:23,379][52667] Sum rewards: 69.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.597', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '59.000'} [2024-08-06 06:08:23,441][52650] Updated weights for policy 0, policy_version 66521 (0.0011) [2024-08-06 06:08:23,672][52659] DAMAGECOUNT value on done: 709927.0 [2024-08-06 06:08:23,674][52659] Sum rewards: 71.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.322', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.067', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '58.500'} [2024-08-06 06:08:24,184][52803] DAMAGECOUNT value on done: 658779.0 [2024-08-06 06:08:24,184][52803] Sum rewards: 86.982, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.128', 'AMMO4': '0.158', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '69.000'} [2024-08-06 06:08:24,212][52647] DAMAGECOUNT value on done: 753544.0 [2024-08-06 06:08:24,212][52647] Sum rewards: 67.410, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.380', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.122', 'AMMO4': '0.264', 'AMMO3': '0.266', 'weapon5': '0.314', 'weapon2': '0.448', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.822', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '58.000'} [2024-08-06 06:08:25,147][52665] DAMAGECOUNT value on done: 705793.0 [2024-08-06 06:08:25,149][52665] Sum rewards: 81.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'weapon4': '0.072', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:26,248][52659] DAMAGECOUNT value on done: 712101.0 [2024-08-06 06:08:26,248][52659] Sum rewards: 70.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.505', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon2': '0.188', 'AMMO3': '0.238', 'weapon5': '0.252', 'AMMO4': '0.276', 'weapon4': '0.354', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.918', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 06:08:26,458][52667] DAMAGECOUNT value on done: 716466.0 [2024-08-06 06:08:26,458][52667] Sum rewards: 47.334, reward structure: {'DEATHCOUNT': '-6.000', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.206', 'weapon7': '0.436', 'WEAPON3': '0.650', 'weapon4': '1.006', 'weapon3': '1.968', 'HITCOUNT': '2.240', 'DAMAGECOUNT': '11.031', 'FRAGCOUNT': '35.000'} [2024-08-06 06:08:26,543][52794] DAMAGECOUNT value on done: 712044.0 [2024-08-06 06:08:26,547][52794] Sum rewards: 84.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.055', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon2': '0.228', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.428', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.303', 'FRAGCOUNT': '70.000'} [2024-08-06 06:08:27,292][52647] DAMAGECOUNT value on done: 739494.0 [2024-08-06 06:08:27,293][52647] Sum rewards: 72.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.149', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.444', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:27,328][52803] DAMAGECOUNT value on done: 672608.0 [2024-08-06 06:08:27,329][52803] Sum rewards: 80.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon5': '0.152', 'weapon4': '0.160', 'AMMO3': '0.206', 'weapon2': '0.240', 'AMMO4': '0.260', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:27,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 545013760. Throughput: 0: 4374.4. Samples: 136261190. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:27,795][52567] Avg episode reward: [(0, '74.718')] [2024-08-06 06:08:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066530_545013760.pth... [2024-08-06 06:08:27,858][52665] DAMAGECOUNT value on done: 691702.0 [2024-08-06 06:08:27,859][52665] Sum rewards: 69.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.800', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.131', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '58.000'} [2024-08-06 06:08:27,929][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066018_540819456.pth [2024-08-06 06:08:28,215][52650] Updated weights for policy 0, policy_version 66531 (0.0022) [2024-08-06 06:08:29,372][52659] DAMAGECOUNT value on done: 719192.0 [2024-08-06 06:08:29,374][52659] Sum rewards: 51.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.935', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.450', 'HITCOUNT': '2.420', 'weapon3': '3.246', 'DAMAGECOUNT': '12.549', 'FRAGCOUNT': '45.000'} [2024-08-06 06:08:29,548][52667] DAMAGECOUNT value on done: 722575.0 [2024-08-06 06:08:29,548][52667] Sum rewards: 80.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.174', 'AMMO4': '0.183', 'weapon4': '0.186', 'weapon5': '0.204', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:29,575][52794] DAMAGECOUNT value on done: 717093.0 [2024-08-06 06:08:29,576][52794] Sum rewards: 80.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.218', 'AMMO3': '0.226', 'weapon2': '0.236', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:30,195][52647] DAMAGECOUNT value on done: 745258.0 [2024-08-06 06:08:30,197][52647] Sum rewards: 66.048, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.226', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.414', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '58.000'} [2024-08-06 06:08:30,571][52803] DAMAGECOUNT value on done: 662644.0 [2024-08-06 06:08:30,574][52803] Sum rewards: 67.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.384', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.102', 'weapon4': '0.112', 'AMMO4': '0.144', 'AMMO3': '0.224', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '56.000'} [2024-08-06 06:08:30,855][52665] DAMAGECOUNT value on done: 699400.0 [2024-08-06 06:08:30,856][52665] Sum rewards: 80.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.775', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon2': '0.186', 'weapon5': '0.238', 'AMMO3': '0.246', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.584', 'WEAPON3': '1.500', 'weapon3': '2.650', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '68.000'} [2024-08-06 06:08:32,020][52667] DAMAGECOUNT value on done: 713253.0 [2024-08-06 06:08:32,020][52667] Sum rewards: 85.697, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.660', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.306', 'weapon2': '0.372', 'WEAPON3': '1.900', 'weapon3': '3.168', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '22.158', 'FRAGCOUNT': '73.000'} [2024-08-06 06:08:32,666][52659] DAMAGECOUNT value on done: 714408.0 [2024-08-06 06:08:32,666][52659] Sum rewards: 69.332, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.952', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.122', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.316', 'WEAPON3': '0.900', 'weapon3': '3.082', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '54.000'} [2024-08-06 06:08:32,710][52794] DAMAGECOUNT value on done: 703557.0 [2024-08-06 06:08:32,710][52794] Sum rewards: 63.637, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.093', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.630', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.096', 'DAMAGECOUNT': '14.904', 'FRAGCOUNT': '51.000'} [2024-08-06 06:08:32,765][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:08:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 545095680. Throughput: 0: 4379.7. Samples: 136274220. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:32,795][52567] Avg episode reward: [(0, '74.467')] [2024-08-06 06:08:32,874][52650] Updated weights for policy 0, policy_version 66541 (0.0013) [2024-08-06 06:08:33,157][52647] DAMAGECOUNT value on done: 735894.0 [2024-08-06 06:08:33,160][52647] Sum rewards: 78.109, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'HEALTH': '0.040', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.186', 'weapon2': '0.444', 'WEAPON3': '0.950', 'weapon3': '3.164', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:33,697][52803] DAMAGECOUNT value on done: 662296.0 [2024-08-06 06:08:33,698][52803] Sum rewards: 78.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.016', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.169', 'weapon5': '0.196', 'AMMO3': '0.231', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:34,042][52665] DAMAGECOUNT value on done: 704922.0 [2024-08-06 06:08:34,042][52665] Sum rewards: 88.240, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.200', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon2': '0.164', 'weapon5': '0.170', 'weapon4': '0.234', 'AMMO3': '0.244', 'AMMO4': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.054', 'FRAGCOUNT': '74.000'} [2024-08-06 06:08:34,109][52820] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2024-08-06 06:08:34,690][52667] DAMAGECOUNT value on done: 713229.0 [2024-08-06 06:08:34,691][52667] Sum rewards: 68.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.994', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.144', 'weapon5': '0.208', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '58.000'} [2024-08-06 06:08:35,463][52647] DAMAGECOUNT value on done: 741954.0 [2024-08-06 06:08:35,463][52647] Sum rewards: 67.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.153', 'AMMO3': '0.231', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.446', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:35,771][52659] DAMAGECOUNT value on done: 719504.0 [2024-08-06 06:08:35,771][52659] Sum rewards: 76.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.068', 'AMMO4': '0.166', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '62.000'} [2024-08-06 06:08:35,860][52794] DAMAGECOUNT value on done: 714734.0 [2024-08-06 06:08:35,861][52794] Sum rewards: 69.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.184', 'AMMO3': '0.203', 'weapon2': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:36,715][52803] DAMAGECOUNT value on done: 674962.0 [2024-08-06 06:08:36,715][52803] Sum rewards: 77.725, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.130', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.244', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:37,224][52667] DAMAGECOUNT value on done: 719600.0 [2024-08-06 06:08:37,228][52667] Sum rewards: 86.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.084', 'weapon4': '0.132', 'AMMO4': '0.136', 'weapon2': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '72.000'} [2024-08-06 06:08:37,270][52650] Updated weights for policy 0, policy_version 66551 (0.0011) [2024-08-06 06:08:37,277][52665] DAMAGECOUNT value on done: 702507.0 [2024-08-06 06:08:37,278][52665] Sum rewards: 77.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.104', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.133', 'weapon5': '0.190', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 06:08:37,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 545185792. Throughput: 0: 4372.2. Samples: 136300420. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:37,794][52567] Avg episode reward: [(0, '74.813')] [2024-08-06 06:08:38,561][52794] DAMAGECOUNT value on done: 704989.0 [2024-08-06 06:08:38,561][52794] Sum rewards: 61.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.585', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO3': '0.260', 'WEAPON3': '1.700', 'HITCOUNT': '3.120', 'weapon3': '3.586', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '54.000'} [2024-08-06 06:08:38,830][52659] DAMAGECOUNT value on done: 708278.0 [2024-08-06 06:08:38,830][52659] Sum rewards: 74.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.964', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.032', 'weapon4': '0.102', 'AMMO4': '0.161', 'weapon5': '0.162', 'AMMO3': '0.220', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:39,753][52803] DAMAGECOUNT value on done: 660184.0 [2024-08-06 06:08:39,755][52803] Sum rewards: 76.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.098', 'AMMO3': '0.194', 'weapon5': '0.200', 'AMMO4': '0.244', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.760', 'WEAPON3': '1.250', 'weapon3': '2.686', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:40,138][52665] DAMAGECOUNT value on done: 711774.0 [2024-08-06 06:08:40,140][52665] Sum rewards: 78.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.450', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.108', 'AMMO3': '0.203', 'AMMO4': '0.227', 'weapon5': '0.228', 'weapon2': '0.494', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '64.000'} [2024-08-06 06:08:40,219][52667] DAMAGECOUNT value on done: 707730.0 [2024-08-06 06:08:40,220][52667] Sum rewards: 79.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.050', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.243', 'weapon5': '0.244', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON3': '1.400', 'weapon3': '2.756', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:41,482][52794] DAMAGECOUNT value on done: 703769.0 [2024-08-06 06:08:41,482][52794] Sum rewards: 75.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.061', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'weapon5': '0.128', 'weapon4': '0.136', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '62.000'} [2024-08-06 06:08:41,691][52659] DAMAGECOUNT value on done: 720253.0 [2024-08-06 06:08:41,694][52659] Sum rewards: 79.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.994', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.014', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:42,010][52650] Updated weights for policy 0, policy_version 66561 (0.0022) [2024-08-06 06:08:42,303][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:08:42,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 545275904. Throughput: 0: 4376.4. Samples: 136326840. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:42,794][52567] Avg episode reward: [(0, '74.724')] [2024-08-06 06:08:42,855][52803] DAMAGECOUNT value on done: 662889.0 [2024-08-06 06:08:42,855][52803] Sum rewards: 82.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.852', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.386', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '71.000'} [2024-08-06 06:08:42,925][52665] DAMAGECOUNT value on done: 704644.0 [2024-08-06 06:08:42,925][52665] Sum rewards: 68.726, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.110', 'AMMO5': '0.023', 'AMMO2': '0.065', 'weapon4': '0.114', 'weapon5': '0.202', 'AMMO3': '0.274', 'AMMO4': '0.326', 'weapon2': '0.360', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.960', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '60.000'} [2024-08-06 06:08:42,936][52667] DAMAGECOUNT value on done: 716331.0 [2024-08-06 06:08:42,940][52667] Sum rewards: 84.754, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.124', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'HEALTH': '0.220', 'AMMO3': '0.240', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.586', 'FRAGCOUNT': '70.000'} [2024-08-06 06:08:44,500][52659] DAMAGECOUNT value on done: 708368.0 [2024-08-06 06:08:44,503][52659] Sum rewards: 71.999, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.894', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.179', 'weapon4': '0.244', 'WEAPON3': '1.100', 'HITCOUNT': '3.300', 'weapon3': '3.342', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '58.000'} [2024-08-06 06:08:44,514][52794] DAMAGECOUNT value on done: 713219.0 [2024-08-06 06:08:44,514][52794] Sum rewards: 91.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.176', 'AMMO3': '0.234', 'weapon4': '0.246', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '76.000'} [2024-08-06 06:08:45,361][52665] DAMAGECOUNT value on done: 713103.0 [2024-08-06 06:08:45,362][52665] Sum rewards: 67.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.355', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon2': '0.212', 'AMMO3': '0.228', 'AMMO4': '0.239', 'weapon4': '0.300', 'weapon5': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.000'} [2024-08-06 06:08:45,418][52667] DAMAGECOUNT value on done: 722660.0 [2024-08-06 06:08:45,421][52667] Sum rewards: 76.382, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.990', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.058', 'weapon5': '0.062', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.428', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:45,917][52803] DAMAGECOUNT value on done: 665221.0 [2024-08-06 06:08:45,917][52803] Sum rewards: 74.152, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon4': '0.150', 'AMMO3': '0.163', 'weapon5': '0.170', 'HEALTH': '0.190', 'AMMO4': '0.326', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.040', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '59.000'} [2024-08-06 06:08:47,095][52794] DAMAGECOUNT value on done: 710354.0 [2024-08-06 06:08:47,096][52794] Sum rewards: 88.868, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.312', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.090', 'AMMO3': '0.197', 'weapon5': '0.234', 'AMMO4': '0.241', 'weapon2': '0.392', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.786', 'FRAGCOUNT': '71.000'} [2024-08-06 06:08:47,325][52650] Updated weights for policy 0, policy_version 66571 (0.0012) [2024-08-06 06:08:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 545357824. Throughput: 0: 4381.6. Samples: 136340090. Policy #0 lag: (min: 1.0, avg: 3.6, max: 7.0) [2024-08-06 06:08:47,794][52567] Avg episode reward: [(0, '74.757')] [2024-08-06 06:08:48,283][52667] DAMAGECOUNT value on done: 721346.0 [2024-08-06 06:08:48,285][52667] Sum rewards: 67.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.586', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.200', 'weapon2': '0.768', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '57.000'} [2024-08-06 06:08:48,484][52665] DAMAGECOUNT value on done: 710274.0 [2024-08-06 06:08:48,486][52665] Sum rewards: 73.149, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.286', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO4': '0.182', 'weapon5': '0.182', 'AMMO3': '0.243', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '62.000'} [2024-08-06 06:08:48,942][52803] DAMAGECOUNT value on done: 666686.0 [2024-08-06 06:08:48,944][52803] Sum rewards: 79.011, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'weapon5': '0.020', 'AMMO2': '0.026', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.222', 'WEAPON3': '1.300', 'weapon3': '3.482', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:49,709][52794] DAMAGECOUNT value on done: 723705.0 [2024-08-06 06:08:49,719][52794] Sum rewards: 70.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.537', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.110', 'AMMO4': '0.143', 'weapon2': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'HITCOUNT': '3.410', 'weapon3': '3.412', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:51,262][52667] DAMAGECOUNT value on done: 719368.0 [2024-08-06 06:08:51,262][52667] Sum rewards: 74.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.036', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.120', 'weapon7': '0.154', 'AMMO4': '0.156', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon4': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:51,279][52650] Updated weights for policy 0, policy_version 66581 (0.0012) [2024-08-06 06:08:51,450][52665] DAMAGECOUNT value on done: 706297.0 [2024-08-06 06:08:51,451][52665] Sum rewards: 69.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.144', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.132', 'weapon2': '0.144', 'AMMO4': '0.174', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.430', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2024-08-06 06:08:51,953][52803] DAMAGECOUNT value on done: 672725.0 [2024-08-06 06:08:51,954][52803] Sum rewards: 73.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.480', 'AMMO5': '0.012', 'weapon4': '0.036', 'AMMO2': '0.045', 'AMMO3': '0.216', 'weapon5': '0.226', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.500', 'weapon3': '2.998', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '61.000'} [2024-08-06 06:08:52,349][52667] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.03, -10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:08:52,683][52794] DAMAGECOUNT value on done: 704685.0 [2024-08-06 06:08:52,684][52794] Sum rewards: 73.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.280', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.084', 'weapon4': '0.114', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.318', 'WEAPON3': '1.700', 'weapon3': '3.230', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '63.000'} [2024-08-06 06:08:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 545447936. Throughput: 0: 4374.2. Samples: 136366160. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:08:52,794][52567] Avg episode reward: [(0, '74.750')] [2024-08-06 06:08:53,971][52667] DAMAGECOUNT value on done: 715398.0 [2024-08-06 06:08:53,973][52667] Sum rewards: 82.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.317', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.070', 'AMMO4': '0.127', 'weapon5': '0.188', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '66.000'} [2024-08-06 06:08:54,130][52665] DAMAGECOUNT value on done: 701619.0 [2024-08-06 06:08:54,130][52665] Sum rewards: 64.938, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.575', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon4': '0.100', 'AMMO3': '0.184', 'weapon5': '0.236', 'AMMO4': '0.305', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.676', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '51.000'} [2024-08-06 06:08:54,906][52663] DAMAGECOUNT value on done: 726197.0 [2024-08-06 06:08:54,907][52663] Sum rewards: 88.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.205', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '71.500'} [2024-08-06 06:08:55,111][52803] DAMAGECOUNT value on done: 665345.0 [2024-08-06 06:08:55,111][52803] Sum rewards: 76.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.115', 'weapon4': '0.116', 'weapon2': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '65.000'} [2024-08-06 06:08:55,383][52794] DAMAGECOUNT value on done: 718141.0 [2024-08-06 06:08:55,385][52794] Sum rewards: 67.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.070', 'weapon4': '0.124', 'AMMO3': '0.150', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '0.950', 'HITCOUNT': '2.960', 'weapon3': '3.236', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '54.000'} [2024-08-06 06:08:56,521][52650] Updated weights for policy 0, policy_version 66591 (0.0027) [2024-08-06 06:08:57,122][52667] DAMAGECOUNT value on done: 722797.0 [2024-08-06 06:08:57,123][52667] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.111', 'weapon5': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '56.500'} [2024-08-06 06:08:57,224][52665] DAMAGECOUNT value on done: 701177.0 [2024-08-06 06:08:57,224][52665] Sum rewards: 66.544, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.555', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.100', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.233', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.330', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '56.000'} [2024-08-06 06:08:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 545538048. Throughput: 0: 4374.4. Samples: 136392490. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:08:57,794][52567] Avg episode reward: [(0, '75.010')] [2024-08-06 06:08:57,795][52663] DAMAGECOUNT value on done: 712186.0 [2024-08-06 06:08:57,795][52663] Sum rewards: 85.200, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.415', 'AMMO5': '0.009', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.106', 'AMMO3': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.294', 'WEAPON3': '0.950', 'weapon3': '3.212', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '67.000'} [2024-08-06 06:08:58,205][52794] DAMAGECOUNT value on done: 714648.0 [2024-08-06 06:08:58,206][52794] Sum rewards: 73.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.494', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.050', 'AMMO4': '0.136', 'weapon5': '0.148', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '60.000'} [2024-08-06 06:09:00,234][52663] DAMAGECOUNT value on done: 706362.0 [2024-08-06 06:09:00,243][52663] Sum rewards: 73.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.551', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.106', 'weapon5': '0.134', 'AMMO4': '0.175', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:00,251][52665] DAMAGECOUNT value on done: 705145.0 [2024-08-06 06:09:00,254][52665] Sum rewards: 89.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.648', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO2': '0.024', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.414', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.423', 'FRAGCOUNT': '74.000'} [2024-08-06 06:09:00,947][52650] Updated weights for policy 0, policy_version 66601 (0.0014) [2024-08-06 06:09:01,344][52794] DAMAGECOUNT value on done: 717837.0 [2024-08-06 06:09:01,344][52794] Sum rewards: 64.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.565', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon5': '0.222', 'weapon4': '0.256', 'weapon2': '0.262', 'AMMO3': '0.272', 'AMMO4': '0.304', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'HITCOUNT': '2.960', 'weapon3': '2.970', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17495.4). Total num frames: 545628160. Throughput: 0: 4379.3. Samples: 136405680. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:09:02,794][52567] Avg episode reward: [(0, '74.868')] [2024-08-06 06:09:03,258][52663] DAMAGECOUNT value on done: 709862.0 [2024-08-06 06:09:03,260][52663] Sum rewards: 63.724, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.727', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.124', 'weapon5': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.178', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2024-08-06 06:09:03,474][52665] DAMAGECOUNT value on done: 705782.0 [2024-08-06 06:09:03,474][52665] Sum rewards: 80.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.176', 'weapon4': '0.210', 'AMMO3': '0.229', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:04,303][52794] DAMAGECOUNT value on done: 723975.0 [2024-08-06 06:09:04,304][52794] Sum rewards: 77.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:04,544][52670] DAMAGECOUNT value on done: 703905.0 [2024-08-06 06:09:04,545][52670] Sum rewards: 74.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.032', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:04,928][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:09:05,193][52658] DAMAGECOUNT value on done: 715659.0 [2024-08-06 06:09:05,195][52658] Sum rewards: 74.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.540', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.556', 'WEAPON3': '1.650', 'weapon3': '3.050', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:05,333][52650] Updated weights for policy 0, policy_version 66611 (0.0016) [2024-08-06 06:09:06,192][52663] DAMAGECOUNT value on done: 714879.0 [2024-08-06 06:09:06,192][52663] Sum rewards: 69.664, reward structure: {'DEATHCOUNT': '-15.750', 'ARMOR': '0.005', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.064', 'HEALTH': '0.084', 'weapon5': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '58.000'} [2024-08-06 06:09:06,285][52666] DAMAGECOUNT value on done: 715218.0 [2024-08-06 06:09:06,287][52666] Sum rewards: 86.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'weapon5': '0.002', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.211', 'WEAPON3': '1.450', 'weapon3': '3.630', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.036', 'FRAGCOUNT': '72.000'} [2024-08-06 06:09:06,430][52665] DAMAGECOUNT value on done: 697354.0 [2024-08-06 06:09:06,431][52665] Sum rewards: 70.170, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.300', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon4': '0.080', 'weapon5': '0.186', 'weapon2': '0.256', 'AMMO3': '0.288', 'AMMO4': '0.303', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.176', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:06,898][52794] DAMAGECOUNT value on done: 715473.0 [2024-08-06 06:09:06,899][52794] Sum rewards: 77.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.915', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon2': '0.186', 'weapon5': '0.218', 'AMMO4': '0.222', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '65.000'} [2024-08-06 06:09:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 545710080. Throughput: 0: 4375.6. Samples: 136431780. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:09:07,794][52567] Avg episode reward: [(0, '74.687')] [2024-08-06 06:09:07,832][52670] DAMAGECOUNT value on done: 715424.0 [2024-08-06 06:09:07,834][52670] Sum rewards: 83.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.499', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.080', 'AMMO4': '0.202', 'weapon5': '0.202', 'AMMO3': '0.239', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:07,920][52658] DAMAGECOUNT value on done: 714116.0 [2024-08-06 06:09:07,921][52658] Sum rewards: 85.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.398', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '71.000'} [2024-08-06 06:09:08,887][52665] DAMAGECOUNT value on done: 701899.0 [2024-08-06 06:09:08,888][52665] Sum rewards: 71.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.219', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.118', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON7': '0.200', 'weapon2': '0.318', 'weapon7': '0.338', 'WEAPON4': '0.350', 'weapon4': '0.542', 'WEAPON3': '0.900', 'weapon3': '2.492', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:09,270][52668] Large shaping reward 3.336 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.28500000000000003, 95.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:09:09,321][52663] DAMAGECOUNT value on done: 721420.0 [2024-08-06 06:09:09,323][52663] Sum rewards: 76.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.055', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.181', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:09,449][52666] DAMAGECOUNT value on done: 711435.0 [2024-08-06 06:09:09,450][52666] Sum rewards: 70.099, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.866', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon7': '0.062', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.124', 'AMMO4': '0.134', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '59.000'} [2024-08-06 06:09:10,285][52658] DAMAGECOUNT value on done: 719793.0 [2024-08-06 06:09:10,285][52658] Sum rewards: 76.403, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.611', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.094', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.238', 'WEAPON3': '1.200', 'HITCOUNT': '3.440', 'weapon3': '3.452', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:10,411][52650] Updated weights for policy 0, policy_version 66621 (0.0052) [2024-08-06 06:09:10,873][52670] DAMAGECOUNT value on done: 701985.0 [2024-08-06 06:09:10,877][52670] Sum rewards: 61.903, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.392', 'AMMO5': '0.024', 'AMMO2': '0.053', 'weapon4': '0.178', 'AMMO3': '0.251', 'AMMO4': '0.264', 'weapon5': '0.324', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.694', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '55.000'} [2024-08-06 06:09:11,903][52665] DAMAGECOUNT value on done: 705117.0 [2024-08-06 06:09:11,904][52665] Sum rewards: 75.836, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.314', 'AMMO5': '0.023', 'AMMO2': '0.058', 'weapon4': '0.194', 'AMMO3': '0.249', 'weapon5': '0.260', 'AMMO4': '0.290', 'weapon2': '0.446', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.772', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '64.000'} [2024-08-06 06:09:12,084][52663] DAMAGECOUNT value on done: 707805.0 [2024-08-06 06:09:12,085][52663] Sum rewards: 82.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.232', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.146', 'weapon5': '0.206', 'AMMO3': '0.222', 'AMMO4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '71.000'} [2024-08-06 06:09:12,419][52666] DAMAGECOUNT value on done: 712101.0 [2024-08-06 06:09:12,419][52666] Sum rewards: 86.368, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.868', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.116', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'weapon4': '0.510', 'WEAPON3': '1.050', 'weapon3': '2.870', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:12,715][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:09:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 545800192. Throughput: 0: 4375.4. Samples: 136458080. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:09:12,794][52567] Avg episode reward: [(0, '74.912')] [2024-08-06 06:09:12,908][52658] DAMAGECOUNT value on done: 717590.0 [2024-08-06 06:09:12,908][52658] Sum rewards: 76.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.040', 'weapon5': '0.074', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:13,395][52669] DAMAGECOUNT value on done: 715725.0 [2024-08-06 06:09:13,397][52669] Sum rewards: 78.633, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.225', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.086', 'weapon5': '0.192', 'AMMO4': '0.249', 'weapon2': '0.256', 'AMMO3': '0.283', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.138', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:14,054][52670] DAMAGECOUNT value on done: 700250.0 [2024-08-06 06:09:14,055][52670] Sum rewards: 66.387, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.054', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.166', 'weapon2': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON3': '1.000', 'weapon3': '3.238', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '54.000'} [2024-08-06 06:09:15,056][52663] DAMAGECOUNT value on done: 703798.0 [2024-08-06 06:09:15,056][52663] Sum rewards: 67.060, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.490', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.174', 'AMMO4': '0.240', 'weapon5': '0.248', 'weapon4': '0.250', 'weapon2': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '53.000'} [2024-08-06 06:09:15,179][52650] Updated weights for policy 0, policy_version 66631 (0.0019) [2024-08-06 06:09:15,579][52666] DAMAGECOUNT value on done: 712314.0 [2024-08-06 06:09:15,579][52666] Sum rewards: 68.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.857', 'AMMO5': '0.027', 'AMMO2': '0.060', 'AMMO3': '0.212', 'weapon2': '0.218', 'weapon4': '0.236', 'weapon5': '0.246', 'AMMO4': '0.300', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '59.000'} [2024-08-06 06:09:15,771][52658] DAMAGECOUNT value on done: 707424.0 [2024-08-06 06:09:15,771][52658] Sum rewards: 83.222, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.122', 'weapon5': '0.126', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'weapon3': '3.300', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.258', 'FRAGCOUNT': '69.000'} [2024-08-06 06:09:16,138][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:09:16,213][52669] DAMAGECOUNT value on done: 708093.0 [2024-08-06 06:09:16,213][52669] Sum rewards: 78.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.046', 'AMMO4': '0.168', 'weapon5': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:17,285][52671] DAMAGECOUNT value on done: 715676.0 [2024-08-06 06:09:17,295][52671] Sum rewards: 67.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.263', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.162', 'weapon4': '0.168', 'weapon5': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '2.922', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '55.000'} [2024-08-06 06:09:17,540][52670] DAMAGECOUNT value on done: 712169.0 [2024-08-06 06:09:17,542][52670] Sum rewards: 75.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.074', 'AMMO4': '0.148', 'AMMO3': '0.209', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.418', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 545882112. Throughput: 0: 4374.7. Samples: 136471080. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:09:17,794][52567] Avg episode reward: [(0, '74.760')] [2024-08-06 06:09:17,923][52663] DAMAGECOUNT value on done: 704305.0 [2024-08-06 06:09:17,926][52663] Sum rewards: 65.574, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.784', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.076', 'WEAPON4': '0.150', 'AMMO4': '0.164', 'weapon2': '0.212', 'AMMO3': '0.289', 'WEAPON3': '1.700', 'HITCOUNT': '3.050', 'weapon3': '3.480', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '58.000'} [2024-08-06 06:09:18,664][52658] DAMAGECOUNT value on done: 706409.0 [2024-08-06 06:09:18,666][52658] Sum rewards: 71.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.265', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.082', 'AMMO4': '0.149', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.416', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:18,964][52666] DAMAGECOUNT value on done: 706677.0 [2024-08-06 06:09:18,966][52666] Sum rewards: 73.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.588', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.094', 'AMMO3': '0.163', 'AMMO4': '0.205', 'weapon5': '0.224', 'weapon2': '0.256', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.228', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '59.000'} [2024-08-06 06:09:19,371][52669] DAMAGECOUNT value on done: 718972.0 [2024-08-06 06:09:19,372][52669] Sum rewards: 74.338, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.599', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'weapon2': '0.234', 'AMMO3': '0.320', 'WEAPON3': '1.950', 'weapon3': '3.434', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:19,456][52650] Updated weights for policy 0, policy_version 66641 (0.0018) [2024-08-06 06:09:19,857][52671] DAMAGECOUNT value on done: 719690.0 [2024-08-06 06:09:19,857][52671] Sum rewards: 81.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.050', 'weapon3': '3.382', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '67.000'} [2024-08-06 06:09:20,279][52670] DAMAGECOUNT value on done: 707425.0 [2024-08-06 06:09:20,279][52670] Sum rewards: 71.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.108', 'weapon4': '0.190', 'AMMO3': '0.239', 'AMMO4': '0.283', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:20,703][52662] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:09:20,866][52663] DAMAGECOUNT value on done: 708854.0 [2024-08-06 06:09:20,867][52663] Sum rewards: 86.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '71.000'} [2024-08-06 06:09:21,581][52658] DAMAGECOUNT value on done: 720087.0 [2024-08-06 06:09:21,581][52658] Sum rewards: 76.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.687', 'AMMO5': '0.019', 'AMMO2': '0.059', 'AMMO3': '0.179', 'weapon5': '0.266', 'weapon2': '0.272', 'weapon4': '0.282', 'AMMO4': '0.293', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.908', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:21,652][52666] DAMAGECOUNT value on done: 708417.0 [2024-08-06 06:09:21,654][52666] Sum rewards: 83.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.150', 'AMMO3': '0.180', 'weapon5': '0.206', 'AMMO4': '0.227', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:22,058][52669] DAMAGECOUNT value on done: 715052.0 [2024-08-06 06:09:22,059][52669] Sum rewards: 74.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.664', 'AMMO5': '0.010', 'weapon4': '0.048', 'AMMO2': '0.049', 'weapon5': '0.098', 'weapon2': '0.190', 'AMMO3': '0.212', 'AMMO4': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.456', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 545980416. Throughput: 0: 4378.4. Samples: 136497450. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:09:22,794][52567] Avg episode reward: [(0, '74.990')] [2024-08-06 06:09:23,099][52670] DAMAGECOUNT value on done: 700453.0 [2024-08-06 06:09:23,099][52670] Sum rewards: 67.988, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.518', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.128', 'AMMO4': '0.187', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:23,138][52671] DAMAGECOUNT value on done: 716260.0 [2024-08-06 06:09:23,140][52671] Sum rewards: 74.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.210', 'WEAPON3': '1.300', 'weapon3': '3.646', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '60.000'} [2024-08-06 06:09:23,678][52663] DAMAGECOUNT value on done: 718930.0 [2024-08-06 06:09:23,681][52663] Sum rewards: 72.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.124', 'AMMO4': '0.173', 'AMMO3': '0.236', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:24,630][52650] Updated weights for policy 0, policy_version 66651 (0.0011) [2024-08-06 06:09:24,769][52666] DAMAGECOUNT value on done: 708107.0 [2024-08-06 06:09:24,770][52666] Sum rewards: 83.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.293', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.078', 'weapon4': '0.138', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.090', 'FRAGCOUNT': '67.000'} [2024-08-06 06:09:24,828][52658] DAMAGECOUNT value on done: 709890.0 [2024-08-06 06:09:24,829][52658] Sum rewards: 69.434, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.460', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.088', 'AMMO4': '0.096', 'weapon5': '0.152', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '55.000'} [2024-08-06 06:09:25,144][52669] DAMAGECOUNT value on done: 715612.0 [2024-08-06 06:09:25,147][52669] Sum rewards: 77.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.202', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '65.000'} [2024-08-06 06:09:25,883][52671] DAMAGECOUNT value on done: 720438.0 [2024-08-06 06:09:25,886][52671] Sum rewards: 77.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.634', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.074', 'weapon5': '0.114', 'AMMO4': '0.159', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '62.500'} [2024-08-06 06:09:26,330][52670] DAMAGECOUNT value on done: 706640.0 [2024-08-06 06:09:26,331][52670] Sum rewards: 75.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.084', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.664', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:26,820][52663] DAMAGECOUNT value on done: 704373.0 [2024-08-06 06:09:26,820][52663] Sum rewards: 68.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.114', 'AMMO3': '0.196', 'AMMO4': '0.218', 'weapon5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '55.500'} [2024-08-06 06:09:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 546062336. Throughput: 0: 4379.8. Samples: 136523930. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 06:09:27,802][52567] Avg episode reward: [(0, '75.261')] [2024-08-06 06:09:27,832][52666] DAMAGECOUNT value on done: 702153.0 [2024-08-06 06:09:27,834][52666] Sum rewards: 67.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.595', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.120', 'weapon5': '0.120', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '58.000'} [2024-08-06 06:09:27,899][52614] Signal inference workers to stop experience collection... (12150 times) [2024-08-06 06:09:27,902][52614] Signal inference workers to resume experience collection... (12150 times) [2024-08-06 06:09:27,947][52658] DAMAGECOUNT value on done: 731564.0 [2024-08-06 06:09:27,948][52658] Sum rewards: 79.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.378', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.174', 'AMMO4': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:27,983][52650] InferenceWorker_p0-w0: stopping experience collection (12150 times) [2024-08-06 06:09:27,983][52650] InferenceWorker_p0-w0: resuming experience collection (12150 times) [2024-08-06 06:09:28,235][52669] DAMAGECOUNT value on done: 717194.0 [2024-08-06 06:09:28,236][52669] Sum rewards: 69.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.465', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.068', 'weapon5': '0.178', 'AMMO4': '0.211', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '57.000'} [2024-08-06 06:09:28,394][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:09:28,493][52671] DAMAGECOUNT value on done: 726660.0 [2024-08-06 06:09:28,494][52671] Sum rewards: 79.059, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.436', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'weapon4': '0.104', 'weapon2': '0.174', 'AMMO3': '0.290', 'WEAPON3': '1.800', 'weapon3': '3.532', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:28,699][52650] Updated weights for policy 0, policy_version 66661 (0.0012) [2024-08-06 06:09:29,171][52670] DAMAGECOUNT value on done: 704163.0 [2024-08-06 06:09:29,173][52670] Sum rewards: 74.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.398', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.120', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '60.000'} [2024-08-06 06:09:29,480][52663] DAMAGECOUNT value on done: 700028.0 [2024-08-06 06:09:29,480][52663] Sum rewards: 67.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon5': '0.214', 'AMMO4': '0.218', 'weapon2': '0.228', 'AMMO3': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '57.000'} [2024-08-06 06:09:30,441][52658] DAMAGECOUNT value on done: 714360.0 [2024-08-06 06:09:30,442][52658] Sum rewards: 95.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.235', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.556', 'HITCOUNT': '4.490', 'DAMAGECOUNT': '21.627', 'FRAGCOUNT': '80.000'} [2024-08-06 06:09:30,740][52669] DAMAGECOUNT value on done: 714412.0 [2024-08-06 06:09:30,740][52669] Sum rewards: 67.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.978', 'AMMO5': '0.019', 'AMMO2': '0.043', 'AMMO3': '0.188', 'AMMO4': '0.213', 'weapon5': '0.292', 'weapon2': '0.384', 'weapon4': '0.446', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.466', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '54.000'} [2024-08-06 06:09:30,748][52666] DAMAGECOUNT value on done: 711384.0 [2024-08-06 06:09:30,756][52666] Sum rewards: 78.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.734', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.230', 'WEAPON3': '1.350', 'HITCOUNT': '3.500', 'weapon3': '3.516', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '64.000'} [2024-08-06 06:09:31,540][52671] DAMAGECOUNT value on done: 720011.0 [2024-08-06 06:09:31,541][52671] Sum rewards: 88.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'AMMO4': '0.153', 'weapon2': '0.210', 'weapon4': '0.210', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'weapon3': '3.396', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '75.000'} [2024-08-06 06:09:32,260][52670] DAMAGECOUNT value on done: 700221.0 [2024-08-06 06:09:32,260][52670] Sum rewards: 72.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.372', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.096', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '59.000'} [2024-08-06 06:09:32,461][52663] DAMAGECOUNT value on done: 708630.0 [2024-08-06 06:09:32,464][52663] Sum rewards: 79.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.112', 'AMMO3': '0.201', 'weapon5': '0.224', 'AMMO4': '0.283', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 546144256. Throughput: 0: 4371.8. Samples: 136536820. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:09:32,795][52567] Avg episode reward: [(0, '75.507')] [2024-08-06 06:09:32,795][52614] Saving new best policy, reward=75.507! [2024-08-06 06:09:33,802][52650] Updated weights for policy 0, policy_version 66671 (0.0023) [2024-08-06 06:09:33,823][52658] DAMAGECOUNT value on done: 726833.0 [2024-08-06 06:09:33,823][52658] Sum rewards: 85.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.140', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.206', 'weapon2': '0.224', 'WEAPON3': '1.150', 'weapon3': '3.422', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:33,879][52669] DAMAGECOUNT value on done: 718680.0 [2024-08-06 06:09:33,881][52669] Sum rewards: 84.674, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.108', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.372', 'WEAPON3': '0.900', 'weapon3': '3.344', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:33,952][52666] DAMAGECOUNT value on done: 705150.0 [2024-08-06 06:09:33,952][52666] Sum rewards: 66.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.028', 'AMMO4': '0.124', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.030', 'weapon3': '3.278', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '57.000'} [2024-08-06 06:09:34,005][52671] DAMAGECOUNT value on done: 722401.0 [2024-08-06 06:09:34,006][52671] Sum rewards: 80.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.764', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.186', 'weapon5': '0.236', 'AMMO3': '0.249', 'AMMO4': '0.293', 'weapon2': '0.344', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:35,125][52670] DAMAGECOUNT value on done: 713030.0 [2024-08-06 06:09:35,125][52670] Sum rewards: 80.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.886', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.126', 'weapon4': '0.140', 'AMMO3': '0.143', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.648', 'WEAPON3': '0.900', 'weapon3': '2.970', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:35,564][52663] DAMAGECOUNT value on done: 705729.0 [2024-08-06 06:09:35,564][52663] Sum rewards: 87.799, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.028', 'HEALTH': '0.055', 'weapon4': '0.060', 'AMMO4': '0.140', 'weapon5': '0.186', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.050', 'weapon3': '3.164', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '69.000'} [2024-08-06 06:09:36,577][52666] DAMAGECOUNT value on done: 714663.0 [2024-08-06 06:09:36,578][52666] Sum rewards: 77.380, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.840', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.122', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '65.000'} [2024-08-06 06:09:36,581][52658] DAMAGECOUNT value on done: 709947.0 [2024-08-06 06:09:36,581][52658] Sum rewards: 67.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.124', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.070', 'AMMO4': '0.139', 'weapon5': '0.156', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '57.000'} [2024-08-06 06:09:36,724][52669] DAMAGECOUNT value on done: 724715.0 [2024-08-06 06:09:36,724][52669] Sum rewards: 83.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '70.000'} [2024-08-06 06:09:37,079][52671] DAMAGECOUNT value on done: 717591.0 [2024-08-06 06:09:37,081][52671] Sum rewards: 67.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.193', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.610', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '54.000'} [2024-08-06 06:09:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 546242560. Throughput: 0: 4375.3. Samples: 136563050. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:09:37,794][52567] Avg episode reward: [(0, '75.727')] [2024-08-06 06:09:37,798][52614] Saving new best policy, reward=75.727! [2024-08-06 06:09:38,099][52670] DAMAGECOUNT value on done: 698729.0 [2024-08-06 06:09:38,099][52670] Sum rewards: 60.252, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.914', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.098', 'weapon5': '0.122', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '2.780', 'weapon3': '3.378', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '53.000'} [2024-08-06 06:09:38,607][52663] DAMAGECOUNT value on done: 718909.0 [2024-08-06 06:09:38,609][52663] Sum rewards: 71.889, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.720', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.090', 'weapon5': '0.190', 'AMMO4': '0.265', 'AMMO3': '0.293', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.092', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '64.000'} [2024-08-06 06:09:38,851][52650] Updated weights for policy 0, policy_version 66681 (0.0011) [2024-08-06 06:09:39,340][52658] DAMAGECOUNT value on done: 718579.0 [2024-08-06 06:09:39,341][52658] Sum rewards: 72.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.175', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.176', 'weapon4': '0.178', 'AMMO3': '0.179', 'AMMO4': '0.212', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.992', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '58.000'} [2024-08-06 06:09:39,711][52666] DAMAGECOUNT value on done: 700872.0 [2024-08-06 06:09:39,711][52666] Sum rewards: 65.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.244', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.102', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '55.000'} [2024-08-06 06:09:40,108][52671] DAMAGECOUNT value on done: 710768.0 [2024-08-06 06:09:40,109][52671] Sum rewards: 77.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.116', 'weapon4': '0.138', 'AMMO4': '0.155', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:40,169][52669] DAMAGECOUNT value on done: 717252.0 [2024-08-06 06:09:40,170][52669] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.924', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO2': '0.042', 'weapon5': '0.138', 'AMMO4': '0.209', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:41,073][52670] DAMAGECOUNT value on done: 707538.0 [2024-08-06 06:09:41,073][52670] Sum rewards: 58.411, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'HEALTH': '0.030', 'AMMO2': '0.035', 'weapon4': '0.118', 'weapon5': '0.156', 'AMMO3': '0.176', 'AMMO4': '0.176', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '3.006', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '48.000'} [2024-08-06 06:09:41,664][52663] DAMAGECOUNT value on done: 712749.0 [2024-08-06 06:09:41,664][52663] Sum rewards: 76.145, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.646', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'AMMO4': '0.111', 'weapon4': '0.184', 'weapon2': '0.234', 'AMMO3': '0.326', 'WEAPON3': '1.950', 'weapon3': '3.200', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:42,405][52658] DAMAGECOUNT value on done: 709718.0 [2024-08-06 06:09:42,407][52658] Sum rewards: 65.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.088', 'weapon5': '0.168', 'AMMO3': '0.191', 'AMMO4': '0.289', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '52.000'} [2024-08-06 06:09:42,659][52666] DAMAGECOUNT value on done: 714802.0 [2024-08-06 06:09:42,661][52666] Sum rewards: 78.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.100', 'AMMO4': '0.150', 'weapon2': '0.176', 'weapon5': '0.192', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '64.000'} [2024-08-06 06:09:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 546324480. Throughput: 0: 4359.6. Samples: 136588670. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:09:42,794][52567] Avg episode reward: [(0, '74.998')] [2024-08-06 06:09:42,799][52669] DAMAGECOUNT value on done: 716559.0 [2024-08-06 06:09:42,801][52669] Sum rewards: 72.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.008', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.118', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.244', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:42,964][52650] Updated weights for policy 0, policy_version 66691 (0.0016) [2024-08-06 06:09:42,979][52671] DAMAGECOUNT value on done: 717634.0 [2024-08-06 06:09:42,980][52671] Sum rewards: 74.499, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.140', 'AMMO3': '0.148', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.000', 'weapon3': '3.046', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '59.000'} [2024-08-06 06:09:43,991][52670] DAMAGECOUNT value on done: 714270.0 [2024-08-06 06:09:43,991][52670] Sum rewards: 84.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.051', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.180', 'AMMO4': '0.181', 'AMMO3': '0.190', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.584', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '69.000'} [2024-08-06 06:09:44,294][52663] DAMAGECOUNT value on done: 714608.0 [2024-08-06 06:09:44,296][52663] Sum rewards: 58.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.168', 'AMMO3': '0.209', 'weapon2': '0.224', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO4': '0.301', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.890', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '50.000'} [2024-08-06 06:09:45,409][52669] DAMAGECOUNT value on done: 723326.0 [2024-08-06 06:09:45,410][52669] Sum rewards: 73.634, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.052', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.067', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:45,489][52666] DAMAGECOUNT value on done: 707257.0 [2024-08-06 06:09:45,490][52666] Sum rewards: 63.288, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.645', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.112', 'AMMO3': '0.267', 'AMMO4': '0.295', 'weapon5': '0.298', 'weapon2': '0.526', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.746', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:45,532][52658] DAMAGECOUNT value on done: 718084.0 [2024-08-06 06:09:45,533][52658] Sum rewards: 72.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.024', 'AMMO2': '0.052', 'weapon4': '0.112', 'AMMO3': '0.178', 'weapon5': '0.220', 'AMMO4': '0.258', 'weapon2': '0.384', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '60.000'} [2024-08-06 06:09:45,824][52671] DAMAGECOUNT value on done: 719511.0 [2024-08-06 06:09:45,824][52671] Sum rewards: 68.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.438', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon4': '0.198', 'weapon2': '0.444', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.134', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 06:09:46,470][52668] DAMAGECOUNT value on done: 712554.0 [2024-08-06 06:09:46,472][52668] Sum rewards: 72.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.701', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.116', 'weapon2': '0.236', 'weapon5': '0.244', 'AMMO3': '0.253', 'AMMO4': '0.271', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:47,038][52670] DAMAGECOUNT value on done: 709100.0 [2024-08-06 06:09:47,038][52670] Sum rewards: 72.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.392', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:47,134][52663] DAMAGECOUNT value on done: 715578.0 [2024-08-06 06:09:47,136][52663] Sum rewards: 87.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '74.000'} [2024-08-06 06:09:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 546406400. Throughput: 0: 4362.9. Samples: 136602010. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:09:47,794][52567] Avg episode reward: [(0, '74.829')] [2024-08-06 06:09:48,007][52794] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:09:48,034][52650] Updated weights for policy 0, policy_version 66701 (0.0011) [2024-08-06 06:09:48,493][52669] DAMAGECOUNT value on done: 709504.0 [2024-08-06 06:09:48,493][52669] Sum rewards: 71.454, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.080', 'AMMO4': '0.132', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.244', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '61.000'} [2024-08-06 06:09:48,517][52658] DAMAGECOUNT value on done: 704089.0 [2024-08-06 06:09:48,517][52658] Sum rewards: 74.868, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.484', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.074', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '65.000'} [2024-08-06 06:09:48,621][52666] DAMAGECOUNT value on done: 709928.0 [2024-08-06 06:09:48,624][52666] Sum rewards: 75.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.700', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.088', 'weapon2': '0.198', 'weapon5': '0.202', 'AMMO4': '0.203', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:48,829][52671] DAMAGECOUNT value on done: 717517.0 [2024-08-06 06:09:48,829][52671] Sum rewards: 71.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.100', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.194', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '58.000'} [2024-08-06 06:09:49,005][52668] DAMAGECOUNT value on done: 718641.0 [2024-08-06 06:09:49,013][52668] Sum rewards: 69.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.458', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '59.000'} [2024-08-06 06:09:49,188][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:09:50,162][52670] DAMAGECOUNT value on done: 692042.0 [2024-08-06 06:09:50,163][52670] Sum rewards: 78.084, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.652', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.146', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'weapon4': '0.694', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:50,245][52663] DAMAGECOUNT value on done: 706649.0 [2024-08-06 06:09:50,248][52663] Sum rewards: 63.064, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.022', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.180', 'weapon2': '0.190', 'AMMO4': '0.223', 'AMMO3': '0.283', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.930', 'weapon3': '3.302', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:51,114][52671] DAMAGECOUNT value on done: 724679.0 [2024-08-06 06:09:51,114][52671] Sum rewards: 85.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.018', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.196', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.498', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '71.000'} [2024-08-06 06:09:51,318][52664] DAMAGECOUNT value on done: 739934.0 [2024-08-06 06:09:51,319][52664] Sum rewards: 75.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.726', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.138', 'AMMO3': '0.231', 'weapon5': '0.290', 'weapon2': '0.296', 'AMMO4': '0.309', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:51,436][52658] DAMAGECOUNT value on done: 719068.0 [2024-08-06 06:09:51,436][52658] Sum rewards: 84.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.995', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.152', 'weapon2': '0.206', 'AMMO4': '0.222', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '72.000'} [2024-08-06 06:09:51,544][52669] DAMAGECOUNT value on done: 713219.0 [2024-08-06 06:09:51,546][52669] Sum rewards: 81.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.188', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.201', 'weapon4': '0.256', 'WEAPON3': '1.150', 'weapon3': '3.300', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 06:09:51,856][52666] DAMAGECOUNT value on done: 702668.0 [2024-08-06 06:09:51,858][52666] Sum rewards: 87.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.218', 'AMMO3': '0.239', 'weapon2': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.198', 'FRAGCOUNT': '72.000'} [2024-08-06 06:09:52,298][52668] DAMAGECOUNT value on done: 720602.0 [2024-08-06 06:09:52,298][52668] Sum rewards: 80.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '67.000'} [2024-08-06 06:09:52,559][52650] Updated weights for policy 0, policy_version 66711 (0.0027) [2024-08-06 06:09:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 546496512. Throughput: 0: 4364.9. Samples: 136628200. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:09:52,794][52567] Avg episode reward: [(0, '75.080')] [2024-08-06 06:09:53,250][52670] DAMAGECOUNT value on done: 703049.0 [2024-08-06 06:09:53,251][52670] Sum rewards: 59.644, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.908', 'AMMO5': '0.027', 'AMMO2': '0.061', 'weapon2': '0.216', 'AMMO3': '0.222', 'weapon4': '0.254', 'weapon5': '0.256', 'AMMO4': '0.307', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '51.000'} [2024-08-06 06:09:53,784][52664] DAMAGECOUNT value on done: 745848.0 [2024-08-06 06:09:53,784][52664] Sum rewards: 72.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.196', 'weapon2': '0.286', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.554', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '59.000'} [2024-08-06 06:09:54,089][52669] DAMAGECOUNT value on done: 715955.0 [2024-08-06 06:09:54,089][52669] Sum rewards: 71.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.348', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO4': '0.151', 'weapon2': '0.216', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.414', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '60.000'} [2024-08-06 06:09:54,168][52794] Large shaping reward 2.573 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('HEALTH', -0.018000000000000002, -6.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:09:54,170][52671] DAMAGECOUNT value on done: 719525.0 [2024-08-06 06:09:54,170][52671] Sum rewards: 79.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.096', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.251', 'WEAPON3': '1.600', 'weapon3': '3.318', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:54,413][52658] DAMAGECOUNT value on done: 710477.0 [2024-08-06 06:09:54,414][52658] Sum rewards: 72.669, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.112', 'AMMO4': '0.130', 'AMMO3': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '0.750', 'HEALTH': '0.976', 'HITCOUNT': '3.040', 'weapon3': '3.416', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:54,824][52666] DAMAGECOUNT value on done: 706039.0 [2024-08-06 06:09:54,827][52666] Sum rewards: 78.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.959', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.153', 'weapon5': '0.172', 'AMMO4': '0.201', 'weapon2': '0.306', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.914', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '63.000'} [2024-08-06 06:09:55,218][52668] DAMAGECOUNT value on done: 721740.0 [2024-08-06 06:09:55,219][52668] Sum rewards: 95.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.916', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon4': '0.078', 'weapon5': '0.112', 'AMMO3': '0.248', 'AMMO4': '0.290', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '4.290', 'DAMAGECOUNT': '24.198', 'FRAGCOUNT': '79.500'} [2024-08-06 06:09:56,420][52670] DAMAGECOUNT value on done: 710602.0 [2024-08-06 06:09:56,420][52670] Sum rewards: 68.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.405', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.206', 'AMMO3': '0.234', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:56,649][52669] DAMAGECOUNT value on done: 735564.0 [2024-08-06 06:09:56,650][52669] Sum rewards: 65.248, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.074', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.430', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2024-08-06 06:09:56,779][52664] DAMAGECOUNT value on done: 741921.0 [2024-08-06 06:09:56,780][52664] Sum rewards: 82.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.138', 'AMMO4': '0.221', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '68.000'} [2024-08-06 06:09:56,963][52658] DAMAGECOUNT value on done: 713802.0 [2024-08-06 06:09:56,963][52658] Sum rewards: 88.094, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.428', 'AMMO5': '0.003', 'weapon5': '0.020', 'AMMO2': '0.021', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '72.000'} [2024-08-06 06:09:57,123][52671] DAMAGECOUNT value on done: 706490.0 [2024-08-06 06:09:57,124][52671] Sum rewards: 77.425, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'weapon5': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.246', 'WEAPON3': '1.250', 'HITCOUNT': '3.480', 'weapon3': '3.498', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '64.000'} [2024-08-06 06:09:57,253][52650] Updated weights for policy 0, policy_version 66721 (0.0016) [2024-08-06 06:09:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 546586624. Throughput: 0: 4359.6. Samples: 136654260. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:09:57,794][52567] Avg episode reward: [(0, '75.032')] [2024-08-06 06:09:58,083][52666] DAMAGECOUNT value on done: 719165.0 [2024-08-06 06:09:58,084][52666] Sum rewards: 81.592, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.425', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.121', 'weapon4': '0.128', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.550', 'weapon3': '3.302', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '70.000'} [2024-08-06 06:09:58,353][52668] DAMAGECOUNT value on done: 705800.0 [2024-08-06 06:09:58,361][52668] Sum rewards: 77.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.397', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.170', 'AMMO4': '0.191', 'AMMO3': '0.198', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:59,163][52664] DAMAGECOUNT value on done: 735947.0 [2024-08-06 06:09:59,165][52664] Sum rewards: 75.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.024', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '64.000'} [2024-08-06 06:09:59,320][52669] DAMAGECOUNT value on done: 725179.0 [2024-08-06 06:09:59,321][52669] Sum rewards: 79.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.498', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.062', 'weapon5': '0.092', 'AMMO4': '0.118', 'weapon2': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'weapon3': '3.534', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '67.000'} [2024-08-06 06:09:59,569][52670] DAMAGECOUNT value on done: 708658.0 [2024-08-06 06:09:59,571][52670] Sum rewards: 76.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.064', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon2': '0.176', 'AMMO3': '0.189', 'weapon5': '0.192', 'AMMO4': '0.193', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '62.000'} [2024-08-06 06:09:59,848][52671] DAMAGECOUNT value on done: 724931.0 [2024-08-06 06:09:59,848][52671] Sum rewards: 92.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.644', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.098', 'AMMO4': '0.165', 'weapon5': '0.192', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.942', 'FRAGCOUNT': '76.000'} [2024-08-06 06:10:00,071][52658] DAMAGECOUNT value on done: 716377.0 [2024-08-06 06:10:00,071][52658] Sum rewards: 74.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.613', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.138', 'weapon5': '0.176', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '59.000'} [2024-08-06 06:10:00,779][52662] DAMAGECOUNT value on done: 717343.0 [2024-08-06 06:10:00,779][52662] Sum rewards: 52.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.144', 'weapon5': '0.148', 'AMMO4': '0.202', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '2.950', 'DAMAGECOUNT': '13.836', 'FRAGCOUNT': '46.000'} [2024-08-06 06:10:00,948][52666] DAMAGECOUNT value on done: 695307.0 [2024-08-06 06:10:00,949][52666] Sum rewards: 60.333, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.610', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.058', 'AMMO4': '0.083', 'AMMO3': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.294', 'weapon4': '0.350', 'WEAPON3': '0.750', 'HITCOUNT': '2.850', 'weapon3': '2.938', 'DAMAGECOUNT': '13.332', 'FRAGCOUNT': '48.000'} [2024-08-06 06:10:01,487][52668] DAMAGECOUNT value on done: 720496.0 [2024-08-06 06:10:01,487][52668] Sum rewards: 76.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.220', 'weapon2': '0.268', 'weapon5': '0.268', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:01,903][52664] DAMAGECOUNT value on done: 748941.0 [2024-08-06 06:10:01,905][52664] Sum rewards: 86.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.213', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.486', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.207', 'FRAGCOUNT': '72.000'} [2024-08-06 06:10:02,020][52650] Updated weights for policy 0, policy_version 66731 (0.0031) [2024-08-06 06:10:02,034][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:10:02,215][52669] DAMAGECOUNT value on done: 720054.0 [2024-08-06 06:10:02,221][52669] Sum rewards: 67.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.255', 'weapon2': '0.374', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.400', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '58.000'} [2024-08-06 06:10:02,465][52670] DAMAGECOUNT value on done: 711146.0 [2024-08-06 06:10:02,467][52670] Sum rewards: 63.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.282', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.224', 'weapon4': '0.226', 'weapon5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '2.928', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '53.000'} [2024-08-06 06:10:02,520][52671] DAMAGECOUNT value on done: 722371.0 [2024-08-06 06:10:02,520][52671] Sum rewards: 81.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.219', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.132', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '67.000'} [2024-08-06 06:10:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 546668544. Throughput: 0: 4364.2. Samples: 136667470. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:10:02,794][52567] Avg episode reward: [(0, '75.150')] [2024-08-06 06:10:03,769][52662] DAMAGECOUNT value on done: 721260.0 [2024-08-06 06:10:03,769][52662] Sum rewards: 70.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon2': '0.206', 'weapon5': '0.214', 'AMMO4': '0.219', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '60.000'} [2024-08-06 06:10:03,788][52666] DAMAGECOUNT value on done: 706690.0 [2024-08-06 06:10:03,789][52666] Sum rewards: 78.135, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.081', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '68.000'} [2024-08-06 06:10:04,120][52668] DAMAGECOUNT value on done: 719059.0 [2024-08-06 06:10:04,122][52668] Sum rewards: 67.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.006', 'weapon7': '0.012', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.212', 'weapon2': '0.240', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '57.000'} [2024-08-06 06:10:04,662][52664] DAMAGECOUNT value on done: 739950.0 [2024-08-06 06:10:04,662][52664] Sum rewards: 65.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.375', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.638', 'WEAPON3': '1.650', 'weapon3': '3.018', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '56.000'} [2024-08-06 06:10:05,254][52669] DAMAGECOUNT value on done: 722651.0 [2024-08-06 06:10:05,257][52669] Sum rewards: 80.873, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.256', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.130', 'AMMO4': '0.171', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.042', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:05,393][52671] DAMAGECOUNT value on done: 721580.0 [2024-08-06 06:10:05,393][52671] Sum rewards: 71.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.120', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '59.000'} [2024-08-06 06:10:06,509][52650] Updated weights for policy 0, policy_version 66741 (0.0013) [2024-08-06 06:10:06,717][52662] DAMAGECOUNT value on done: 725202.0 [2024-08-06 06:10:06,718][52662] Sum rewards: 77.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.086', 'weapon5': '0.120', 'AMMO4': '0.142', 'AMMO3': '0.188', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.348', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:06,879][52668] DAMAGECOUNT value on done: 711958.0 [2024-08-06 06:10:06,880][52668] Sum rewards: 78.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.180', 'AMMO2': '0.010', 'AMMO4': '0.052', 'AMMO3': '0.222', 'weapon2': '0.608', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '66.000'} [2024-08-06 06:10:07,579][52664] DAMAGECOUNT value on done: 737209.0 [2024-08-06 06:10:07,579][52664] Sum rewards: 84.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.074', 'AMMO4': '0.094', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.300', 'weapon3': '3.392', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '70.000'} [2024-08-06 06:10:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 546758656. Throughput: 0: 4362.0. Samples: 136693740. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:10:07,795][52567] Avg episode reward: [(0, '74.961')] [2024-08-06 06:10:07,950][52669] DAMAGECOUNT value on done: 724051.0 [2024-08-06 06:10:07,951][52669] Sum rewards: 60.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.194', 'AMMO3': '0.202', 'weapon5': '0.238', 'weapon4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.830', 'weapon3': '3.028', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '50.000'} [2024-08-06 06:10:08,002][52671] DAMAGECOUNT value on done: 723743.0 [2024-08-06 06:10:08,004][52671] Sum rewards: 97.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.052', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'AMMO4': '0.260', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '4.290', 'DAMAGECOUNT': '22.833', 'FRAGCOUNT': '79.000'} [2024-08-06 06:10:09,415][52662] DAMAGECOUNT value on done: 709645.0 [2024-08-06 06:10:09,416][52662] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.072', 'weapon4': '0.086', 'AMMO4': '0.141', 'weapon2': '0.188', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.418', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '60.000'} [2024-08-06 06:10:10,072][52668] DAMAGECOUNT value on done: 711366.0 [2024-08-06 06:10:10,074][52668] Sum rewards: 64.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.210', 'AMMO3': '0.211', 'weapon5': '0.230', 'AMMO4': '0.265', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '54.000'} [2024-08-06 06:10:10,183][52664] DAMAGECOUNT value on done: 730641.0 [2024-08-06 06:10:10,185][52664] Sum rewards: 62.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.204', 'AMMO4': '0.225', 'AMMO3': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '2.896', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '53.000'} [2024-08-06 06:10:10,776][52671] DAMAGECOUNT value on done: 714952.0 [2024-08-06 06:10:10,777][52671] Sum rewards: 64.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.016', 'AMMO4': '0.041', 'WEAPON5': '0.050', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '54.000'} [2024-08-06 06:10:11,211][52650] Updated weights for policy 0, policy_version 66751 (0.0023) [2024-08-06 06:10:11,998][52662] DAMAGECOUNT value on done: 726453.0 [2024-08-06 06:10:11,999][52662] Sum rewards: 70.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.158', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '61.000'} [2024-08-06 06:10:12,668][52668] DAMAGECOUNT value on done: 720315.0 [2024-08-06 06:10:12,670][52668] Sum rewards: 73.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.040', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.510', 'weapon3': '3.552', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 546848768. Throughput: 0: 4359.6. Samples: 136720110. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:12,794][52567] Avg episode reward: [(0, '74.633')] [2024-08-06 06:10:12,912][52664] DAMAGECOUNT value on done: 746183.0 [2024-08-06 06:10:12,912][52664] Sum rewards: 66.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.188', 'AMMO4': '0.210', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.040', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '56.000'} [2024-08-06 06:10:14,944][52662] DAMAGECOUNT value on done: 709793.0 [2024-08-06 06:10:14,953][52662] Sum rewards: 78.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.155', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:15,278][52668] DAMAGECOUNT value on done: 715305.0 [2024-08-06 06:10:15,278][52668] Sum rewards: 66.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.136', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.060', 'AMMO3': '0.220', 'weapon5': '0.242', 'AMMO4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '57.000'} [2024-08-06 06:10:15,652][52664] DAMAGECOUNT value on done: 735976.0 [2024-08-06 06:10:15,652][52664] Sum rewards: 78.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.144', 'weapon2': '0.200', 'AMMO3': '0.263', 'AMMO4': '0.298', 'weapon5': '0.316', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '3.040', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '66.000'} [2024-08-06 06:10:16,221][52650] Updated weights for policy 0, policy_version 66761 (0.0034) [2024-08-06 06:10:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 546938880. Throughput: 0: 4368.9. Samples: 136733420. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:17,794][52567] Avg episode reward: [(0, '74.684')] [2024-08-06 06:10:17,855][52668] DAMAGECOUNT value on done: 708343.0 [2024-08-06 06:10:17,856][52668] Sum rewards: 80.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.999', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.242', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '68.000'} [2024-08-06 06:10:17,899][52662] DAMAGECOUNT value on done: 716088.0 [2024-08-06 06:10:17,899][52662] Sum rewards: 76.557, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.890', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'weapon5': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:18,788][52664] DAMAGECOUNT value on done: 747826.0 [2024-08-06 06:10:18,790][52664] Sum rewards: 70.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.199', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '58.000'} [2024-08-06 06:10:20,522][52650] Updated weights for policy 0, policy_version 66771 (0.0028) [2024-08-06 06:10:20,594][52668] DAMAGECOUNT value on done: 701594.0 [2024-08-06 06:10:20,596][52668] Sum rewards: 64.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.032', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.074', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.278', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '52.000'} [2024-08-06 06:10:20,649][52662] DAMAGECOUNT value on done: 727276.0 [2024-08-06 06:10:20,649][52662] Sum rewards: 88.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.158', 'weapon2': '0.232', 'AMMO3': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '21.321', 'FRAGCOUNT': '74.000'} [2024-08-06 06:10:21,971][52664] DAMAGECOUNT value on done: 747139.0 [2024-08-06 06:10:21,972][52664] Sum rewards: 72.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.576', 'AMMO5': '0.004', 'weapon4': '0.014', 'weapon5': '0.030', 'AMMO2': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.272', 'weapon2': '0.404', 'WEAPON3': '1.550', 'weapon3': '3.338', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '61.000'} [2024-08-06 06:10:22,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 547020800. Throughput: 0: 4364.4. Samples: 136759450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:22,795][52567] Avg episode reward: [(0, '74.611')] [2024-08-06 06:10:23,008][52668] DAMAGECOUNT value on done: 703346.0 [2024-08-06 06:10:23,010][52668] Sum rewards: 81.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.421', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.094', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.216', 'WEAPON3': '1.400', 'weapon3': '3.510', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '67.000'} [2024-08-06 06:10:23,332][52660] DAMAGECOUNT value on done: 716459.0 [2024-08-06 06:10:23,333][52660] Sum rewards: 82.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.202', 'weapon5': '0.228', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.432', 'WEAPON3': '1.400', 'weapon3': '2.856', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '68.000'} [2024-08-06 06:10:23,399][52662] DAMAGECOUNT value on done: 717240.0 [2024-08-06 06:10:23,399][52662] Sum rewards: 79.997, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.963', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.116', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.304', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '69.000'} [2024-08-06 06:10:25,095][52650] Updated weights for policy 0, policy_version 66781 (0.0043) [2024-08-06 06:10:25,167][52664] DAMAGECOUNT value on done: 747208.0 [2024-08-06 06:10:25,168][52664] Sum rewards: 76.584, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.366', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon4': '0.086', 'weapon5': '0.152', 'AMMO3': '0.190', 'AMMO4': '0.229', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '61.000'} [2024-08-06 06:10:25,887][52668] DAMAGECOUNT value on done: 703272.0 [2024-08-06 06:10:25,895][52668] Sum rewards: 77.704, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.965', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.142', 'AMMO4': '0.174', 'weapon2': '0.184', 'WEAPON4': '0.300', 'AMMO3': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.384', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '67.000'} [2024-08-06 06:10:26,254][52660] DAMAGECOUNT value on done: 705400.0 [2024-08-06 06:10:26,255][52660] Sum rewards: 71.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.490', 'AMMO5': '0.020', 'AMMO2': '0.071', 'AMMO3': '0.165', 'weapon4': '0.242', 'weapon5': '0.252', 'weapon2': '0.322', 'AMMO4': '0.355', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.898', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '58.000'} [2024-08-06 06:10:26,762][52662] DAMAGECOUNT value on done: 724971.0 [2024-08-06 06:10:26,763][52662] Sum rewards: 70.163, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.050', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon2': '0.230', 'weapon5': '0.282', 'weapon4': '0.284', 'AMMO3': '0.296', 'AMMO4': '0.312', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.870', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 547110912. Throughput: 0: 4376.9. Samples: 136785630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:27,795][52567] Avg episode reward: [(0, '74.443')] [2024-08-06 06:10:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066786_547110912.pth... [2024-08-06 06:10:27,928][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066274_542916608.pth [2024-08-06 06:10:28,631][52664] DAMAGECOUNT value on done: 750837.0 [2024-08-06 06:10:28,639][52664] Sum rewards: 79.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.796', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'weapon2': '0.208', 'AMMO3': '0.212', 'WEAPON3': '1.300', 'HITCOUNT': '3.410', 'weapon3': '3.466', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '65.000'} [2024-08-06 06:10:29,032][52668] DAMAGECOUNT value on done: 714709.0 [2024-08-06 06:10:29,033][52668] Sum rewards: 78.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.072', 'AMMO4': '0.105', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:29,213][52660] DAMAGECOUNT value on done: 718310.0 [2024-08-06 06:10:29,214][52660] Sum rewards: 71.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.930', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.169', 'weapon4': '0.246', 'AMMO3': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.824', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:29,875][52662] DAMAGECOUNT value on done: 712649.0 [2024-08-06 06:10:29,876][52662] Sum rewards: 82.969, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'HEALTH': '0.086', 'AMMO3': '0.132', 'WEAPON3': '0.800', 'weapon2': '0.818', 'weapon3': '3.006', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 06:10:29,956][52650] Updated weights for policy 0, policy_version 66791 (0.0036) [2024-08-06 06:10:30,396][52649] DAMAGECOUNT value on done: 694391.0 [2024-08-06 06:10:30,398][52649] Sum rewards: 78.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.271', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:31,134][52664] DAMAGECOUNT value on done: 752085.0 [2024-08-06 06:10:31,134][52664] Sum rewards: 78.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.467', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:31,681][52668] DAMAGECOUNT value on done: 711506.0 [2024-08-06 06:10:31,682][52668] Sum rewards: 65.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.402', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.170', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '53.500'} [2024-08-06 06:10:31,873][52660] DAMAGECOUNT value on done: 726436.0 [2024-08-06 06:10:31,875][52660] Sum rewards: 75.534, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.378', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.136', 'weapon5': '0.156', 'AMMO4': '0.176', 'weapon2': '0.266', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.154', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '66.000'} [2024-08-06 06:10:32,674][52662] DAMAGECOUNT value on done: 714202.0 [2024-08-06 06:10:32,674][52662] Sum rewards: 78.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.090', 'AMMO4': '0.092', 'weapon5': '0.172', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 547192832. Throughput: 0: 4367.1. Samples: 136798530. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:32,795][52567] Avg episode reward: [(0, '74.640')] [2024-08-06 06:10:33,263][52649] DAMAGECOUNT value on done: 686975.0 [2024-08-06 06:10:33,263][52649] Sum rewards: 84.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.810', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.118', 'weapon5': '0.128', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '71.000'} [2024-08-06 06:10:33,327][52811] DAMAGECOUNT value on done: 680706.0 [2024-08-06 06:10:33,328][52811] Sum rewards: 59.261, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.395', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.134', 'AMMO4': '0.163', 'weapon5': '0.196', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.650', 'weapon3': '3.002', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '52.000'} [2024-08-06 06:10:34,132][52668] DAMAGECOUNT value on done: 713371.0 [2024-08-06 06:10:34,133][52668] Sum rewards: 89.335, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.078', 'weapon5': '0.216', 'AMMO4': '0.248', 'AMMO3': '0.265', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.782', 'FRAGCOUNT': '75.000'} [2024-08-06 06:10:34,252][52664] DAMAGECOUNT value on done: 746113.0 [2024-08-06 06:10:34,252][52664] Sum rewards: 78.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.119', 'weapon2': '0.140', 'AMMO3': '0.189', 'weapon4': '0.206', 'WEAPON3': '1.200', 'weapon3': '3.536', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:34,394][52660] DAMAGECOUNT value on done: 710455.0 [2024-08-06 06:10:34,395][52660] Sum rewards: 70.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.136', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.073', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.376', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '57.000'} [2024-08-06 06:10:34,565][52650] Updated weights for policy 0, policy_version 66801 (0.0012) [2024-08-06 06:10:35,249][52662] DAMAGECOUNT value on done: 711293.0 [2024-08-06 06:10:35,252][52662] Sum rewards: 73.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.402', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.148', 'weapon2': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.150', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:36,130][52649] DAMAGECOUNT value on done: 705002.0 [2024-08-06 06:10:36,132][52649] Sum rewards: 75.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.300', 'AMMO5': '0.009', 'weapon4': '0.026', 'AMMO2': '0.048', 'weapon5': '0.116', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.222', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:36,405][52811] DAMAGECOUNT value on done: 662989.0 [2024-08-06 06:10:36,407][52811] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.178', 'AMMO3': '0.223', 'weapon5': '0.248', 'AMMO4': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.716', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 06:10:36,923][52664] DAMAGECOUNT value on done: 739067.0 [2024-08-06 06:10:36,925][52664] Sum rewards: 81.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.825', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.122', 'AMMO4': '0.199', 'weapon2': '0.244', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '70.000'} [2024-08-06 06:10:37,216][52668] DAMAGECOUNT value on done: 718069.0 [2024-08-06 06:10:37,217][52668] Sum rewards: 67.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.027', 'AMMO2': '0.046', 'weapon4': '0.132', 'AMMO3': '0.167', 'AMMO4': '0.230', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.728', 'WEAPON3': '1.000', 'weapon3': '2.572', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.500'} [2024-08-06 06:10:37,475][52660] DAMAGECOUNT value on done: 705907.0 [2024-08-06 06:10:37,477][52660] Sum rewards: 64.310, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.263', 'weapon2': '0.266', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.370', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '57.000'} [2024-08-06 06:10:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 547282944. Throughput: 0: 4370.9. Samples: 136824890. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:37,794][52567] Avg episode reward: [(0, '74.961')] [2024-08-06 06:10:37,865][52662] DAMAGECOUNT value on done: 720311.0 [2024-08-06 06:10:37,866][52662] Sum rewards: 68.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO4': '0.183', 'AMMO3': '0.209', 'weapon4': '0.260', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '56.000'} [2024-08-06 06:10:39,077][52649] DAMAGECOUNT value on done: 700398.0 [2024-08-06 06:10:39,077][52649] Sum rewards: 69.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.006', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.099', 'weapon5': '0.122', 'weapon2': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'HITCOUNT': '3.370', 'weapon3': '3.474', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '59.000'} [2024-08-06 06:10:39,347][52650] Updated weights for policy 0, policy_version 66811 (0.0031) [2024-08-06 06:10:39,593][52811] DAMAGECOUNT value on done: 662059.0 [2024-08-06 06:10:39,594][52811] Sum rewards: 72.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.904', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon4': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '61.000'} [2024-08-06 06:10:39,605][52664] DAMAGECOUNT value on done: 740109.0 [2024-08-06 06:10:39,607][52664] Sum rewards: 63.409, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.019', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'weapon5': '0.212', 'AMMO3': '0.254', 'WEAPON5': '0.450', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '55.000'} [2024-08-06 06:10:40,184][52668] DAMAGECOUNT value on done: 716796.0 [2024-08-06 06:10:40,184][52668] Sum rewards: 62.632, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.535', 'AMMO5': '0.021', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.124', 'AMMO4': '0.182', 'AMMO3': '0.234', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '54.000'} [2024-08-06 06:10:40,445][52660] DAMAGECOUNT value on done: 712703.0 [2024-08-06 06:10:40,445][52660] Sum rewards: 85.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.775', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.422', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '71.000'} [2024-08-06 06:10:40,562][52662] DAMAGECOUNT value on done: 710292.0 [2024-08-06 06:10:40,564][52662] Sum rewards: 74.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.685', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.106', 'AMMO3': '0.167', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '60.000'} [2024-08-06 06:10:41,868][52820] DAMAGECOUNT value on done: 661989.0 [2024-08-06 06:10:41,870][52820] Sum rewards: 70.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.954', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.052', 'weapon5': '0.098', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.227', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '57.000'} [2024-08-06 06:10:42,088][52795] DAMAGECOUNT value on done: 666065.0 [2024-08-06 06:10:42,089][52795] Sum rewards: 79.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.973', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.188', 'AMMO3': '0.194', 'AMMO4': '0.252', 'weapon4': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.985', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:42,149][52649] DAMAGECOUNT value on done: 688562.0 [2024-08-06 06:10:42,155][52649] Sum rewards: 75.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.116', 'AMMO3': '0.199', 'weapon5': '0.230', 'AMMO4': '0.284', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:42,237][52664] DAMAGECOUNT value on done: 742251.0 [2024-08-06 06:10:42,239][52664] Sum rewards: 81.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.050', 'weapon5': '0.128', 'weapon2': '0.180', 'AMMO4': '0.222', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.424', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '68.000'} [2024-08-06 06:10:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 547373056. Throughput: 0: 4375.8. Samples: 136851170. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:42,794][52567] Avg episode reward: [(0, '74.967')] [2024-08-06 06:10:42,797][52811] DAMAGECOUNT value on done: 664559.0 [2024-08-06 06:10:42,798][52811] Sum rewards: 74.635, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.190', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.134', 'weapon5': '0.142', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '3.018', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '60.000'} [2024-08-06 06:10:43,511][52662] DAMAGECOUNT value on done: 724752.0 [2024-08-06 06:10:43,511][52662] Sum rewards: 74.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.273', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '61.000'} [2024-08-06 06:10:43,632][52660] DAMAGECOUNT value on done: 721980.0 [2024-08-06 06:10:43,640][52660] Sum rewards: 66.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.110', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '55.000'} [2024-08-06 06:10:44,447][52650] Updated weights for policy 0, policy_version 66821 (0.0022) [2024-08-06 06:10:44,479][52649] DAMAGECOUNT value on done: 704586.0 [2024-08-06 06:10:44,481][52649] Sum rewards: 71.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.058', 'AMMO4': '0.151', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '59.000'} [2024-08-06 06:10:45,009][52820] DAMAGECOUNT value on done: 663498.0 [2024-08-06 06:10:45,010][52820] Sum rewards: 80.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.938', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.264', 'weapon5': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '67.000'} [2024-08-06 06:10:45,251][52795] DAMAGECOUNT value on done: 652572.0 [2024-08-06 06:10:45,251][52795] Sum rewards: 77.908, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.637', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.156', 'weapon2': '0.252', 'AMMO3': '0.259', 'AMMO4': '0.274', 'weapon5': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:45,337][52647] DAMAGECOUNT value on done: 757879.0 [2024-08-06 06:10:45,340][52647] Sum rewards: 73.518, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.744', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.112', 'weapon2': '0.186', 'AMMO4': '0.194', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.410', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:45,453][52664] DAMAGECOUNT value on done: 740089.0 [2024-08-06 06:10:45,453][52664] Sum rewards: 68.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.120', 'weapon2': '0.132', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.550', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '59.000'} [2024-08-06 06:10:45,575][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:10:45,989][52811] DAMAGECOUNT value on done: 672494.0 [2024-08-06 06:10:45,989][52811] Sum rewards: 83.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.124', 'AMMO4': '0.165', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '68.000'} [2024-08-06 06:10:46,022][52662] DAMAGECOUNT value on done: 720543.0 [2024-08-06 06:10:46,023][52662] Sum rewards: 70.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.431', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO4': '0.203', 'AMMO3': '0.214', 'weapon4': '0.222', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '58.000'} [2024-08-06 06:10:46,737][52660] DAMAGECOUNT value on done: 708839.0 [2024-08-06 06:10:46,738][52660] Sum rewards: 84.934, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.463', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.160', 'AMMO4': '0.201', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'weapon3': '3.248', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.600', 'FRAGCOUNT': '72.000'} [2024-08-06 06:10:47,476][52649] DAMAGECOUNT value on done: 697645.0 [2024-08-06 06:10:47,478][52649] Sum rewards: 75.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.138', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.056', 'AMMO4': '0.162', 'weapon5': '0.172', 'AMMO3': '0.183', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 547454976. Throughput: 0: 4368.9. Samples: 136864070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:47,794][52567] Avg episode reward: [(0, '74.898')] [2024-08-06 06:10:48,107][52647] DAMAGECOUNT value on done: 749191.0 [2024-08-06 06:10:48,107][52647] Sum rewards: 76.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.662', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.228', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:48,167][52820] DAMAGECOUNT value on done: 663321.0 [2024-08-06 06:10:48,167][52820] Sum rewards: 60.991, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.933', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.108', 'AMMO4': '0.115', 'AMMO3': '0.173', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '2.948', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '50.000'} [2024-08-06 06:10:48,440][52795] DAMAGECOUNT value on done: 654542.0 [2024-08-06 06:10:48,442][52795] Sum rewards: 79.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO3': '0.241', 'weapon4': '0.252', 'AMMO4': '0.263', 'weapon5': '0.274', 'weapon2': '0.294', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '66.000'} [2024-08-06 06:10:48,497][52803] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:10:48,674][52650] Updated weights for policy 0, policy_version 66831 (0.0022) [2024-08-06 06:10:49,103][52662] DAMAGECOUNT value on done: 706860.0 [2024-08-06 06:10:49,105][52662] Sum rewards: 77.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.122', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.140', 'weapon2': '0.146', 'weapon4': '0.168', 'AMMO4': '0.174', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.326', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '65.000'} [2024-08-06 06:10:49,294][52811] DAMAGECOUNT value on done: 676476.0 [2024-08-06 06:10:49,294][52811] Sum rewards: 78.721, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.085', 'weapon5': '0.090', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.384', 'WEAPON3': '1.000', 'weapon3': '3.348', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:49,646][52660] DAMAGECOUNT value on done: 711072.0 [2024-08-06 06:10:49,646][52660] Sum rewards: 65.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.818', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.174', 'AMMO4': '0.176', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '3.148', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 06:10:50,584][52647] DAMAGECOUNT value on done: 758113.0 [2024-08-06 06:10:50,586][52647] Sum rewards: 81.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '67.000'} [2024-08-06 06:10:50,721][52649] DAMAGECOUNT value on done: 699626.0 [2024-08-06 06:10:50,721][52649] Sum rewards: 81.928, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.410', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon4': '0.056', 'weapon5': '0.142', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:51,302][52820] DAMAGECOUNT value on done: 654782.0 [2024-08-06 06:10:51,302][52820] Sum rewards: 62.823, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.808', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.068', 'weapon5': '0.096', 'AMMO4': '0.224', 'weapon2': '0.228', 'AMMO3': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.302', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2024-08-06 06:10:51,528][52662] DAMAGECOUNT value on done: 716621.0 [2024-08-06 06:10:51,530][52662] Sum rewards: 85.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.525', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.072', 'weapon5': '0.144', 'AMMO4': '0.188', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '71.000'} [2024-08-06 06:10:51,749][52795] DAMAGECOUNT value on done: 663018.0 [2024-08-06 06:10:51,749][52795] Sum rewards: 66.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.238', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '55.000'} [2024-08-06 06:10:52,364][52660] DAMAGECOUNT value on done: 715655.0 [2024-08-06 06:10:52,364][52660] Sum rewards: 64.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.424', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '54.000'} [2024-08-06 06:10:52,653][52811] DAMAGECOUNT value on done: 674074.0 [2024-08-06 06:10:52,656][52811] Sum rewards: 79.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.600', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.124', 'weapon4': '0.158', 'AMMO3': '0.216', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '66.000'} [2024-08-06 06:10:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 547545088. Throughput: 0: 4376.7. Samples: 136890690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:10:52,794][52567] Avg episode reward: [(0, '74.297')] [2024-08-06 06:10:53,331][52647] DAMAGECOUNT value on done: 755904.0 [2024-08-06 06:10:53,332][52647] Sum rewards: 63.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.079', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.308', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '56.000'} [2024-08-06 06:10:53,352][52650] Updated weights for policy 0, policy_version 66841 (0.0021) [2024-08-06 06:10:53,446][52649] DAMAGECOUNT value on done: 700800.0 [2024-08-06 06:10:53,447][52649] Sum rewards: 89.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon2': '0.138', 'AMMO4': '0.154', 'weapon5': '0.190', 'AMMO3': '0.206', 'weapon4': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.387', 'FRAGCOUNT': '73.000'} [2024-08-06 06:10:54,587][52820] DAMAGECOUNT value on done: 668025.0 [2024-08-06 06:10:54,587][52820] Sum rewards: 73.544, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.082', 'weapon4': '0.084', 'AMMO4': '0.195', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:54,785][52662] DAMAGECOUNT value on done: 707004.0 [2024-08-06 06:10:54,785][52662] Sum rewards: 61.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.828', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.144', 'AMMO3': '0.218', 'AMMO4': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.702', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '54.000'} [2024-08-06 06:10:54,907][52795] DAMAGECOUNT value on done: 654533.0 [2024-08-06 06:10:54,908][52795] Sum rewards: 69.968, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.487', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.134', 'weapon5': '0.206', 'AMMO4': '0.228', 'AMMO3': '0.249', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:55,459][52660] DAMAGECOUNT value on done: 707632.0 [2024-08-06 06:10:55,463][52660] Sum rewards: 48.837, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.834', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.212', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '44.000'} [2024-08-06 06:10:55,880][52811] DAMAGECOUNT value on done: 664180.0 [2024-08-06 06:10:55,882][52811] Sum rewards: 76.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.199', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:55,883][52647] DAMAGECOUNT value on done: 762256.0 [2024-08-06 06:10:55,886][52647] Sum rewards: 59.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.048', 'ARMOR': '0.008', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.132', 'AMMO3': '0.199', 'weapon2': '0.216', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.940', 'weapon3': '3.094', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '50.000'} [2024-08-06 06:10:56,571][52649] DAMAGECOUNT value on done: 692519.0 [2024-08-06 06:10:56,575][52649] Sum rewards: 78.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.530', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.195', 'AMMO3': '0.248', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '67.000'} [2024-08-06 06:10:57,713][52820] DAMAGECOUNT value on done: 652456.0 [2024-08-06 06:10:57,713][52820] Sum rewards: 63.660, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.698', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.394', 'WEAPON3': '1.650', 'weapon3': '3.344', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '54.000'} [2024-08-06 06:10:57,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 547635200. Throughput: 0: 4365.7. Samples: 136916570. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:10:57,795][52567] Avg episode reward: [(0, '73.832')] [2024-08-06 06:10:57,828][52659] DAMAGECOUNT value on done: 718381.0 [2024-08-06 06:10:57,829][52659] Sum rewards: 77.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.345', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.157', 'weapon2': '0.608', 'WEAPON3': '0.950', 'HITCOUNT': '3.260', 'weapon3': '3.304', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '63.000'} [2024-08-06 06:10:57,963][52650] Updated weights for policy 0, policy_version 66851 (0.0029) [2024-08-06 06:10:58,056][52795] DAMAGECOUNT value on done: 664238.0 [2024-08-06 06:10:58,056][52795] Sum rewards: 75.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.864', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.026', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.398', 'WEAPON3': '1.200', 'HITCOUNT': '3.350', 'weapon3': '3.410', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '62.000'} [2024-08-06 06:10:58,482][52647] DAMAGECOUNT value on done: 760945.0 [2024-08-06 06:10:58,482][52647] Sum rewards: 77.290, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.790', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.139', 'weapon2': '0.230', 'AMMO4': '0.253', 'weapon5': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.502', 'WEAPON3': '0.800', 'weapon3': '2.776', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '60.000'} [2024-08-06 06:10:58,641][52660] DAMAGECOUNT value on done: 713945.0 [2024-08-06 06:10:58,641][52660] Sum rewards: 76.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.485', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.126', 'weapon5': '0.128', 'AMMO4': '0.182', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '65.000'} [2024-08-06 06:10:59,061][52811] DAMAGECOUNT value on done: 676982.0 [2024-08-06 06:10:59,062][52811] Sum rewards: 75.837, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.880', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.118', 'weapon4': '0.224', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.600', 'weapon3': '3.038', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '64.000'} [2024-08-06 06:10:59,790][52649] DAMAGECOUNT value on done: 704365.0 [2024-08-06 06:10:59,790][52649] Sum rewards: 62.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.575', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.140', 'AMMO4': '0.159', 'AMMO3': '0.180', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '2.996', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '53.000'} [2024-08-06 06:11:00,440][52670] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0)] [2024-08-06 06:11:00,876][52820] DAMAGECOUNT value on done: 663569.0 [2024-08-06 06:11:00,877][52820] Sum rewards: 74.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.227', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:01,052][52659] DAMAGECOUNT value on done: 717216.0 [2024-08-06 06:11:01,052][52659] Sum rewards: 73.173, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.804', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.136', 'weapon5': '0.182', 'AMMO4': '0.208', 'AMMO3': '0.241', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:01,140][52647] DAMAGECOUNT value on done: 760475.0 [2024-08-06 06:11:01,141][52647] Sum rewards: 75.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.637', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.096', 'weapon5': '0.146', 'AMMO3': '0.166', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.500'} [2024-08-06 06:11:01,232][52795] DAMAGECOUNT value on done: 670488.0 [2024-08-06 06:11:01,233][52795] Sum rewards: 86.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO2': '0.009', 'AMMO5': '0.011', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon5': '0.160', 'AMMO3': '0.171', 'weapon4': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.535', 'FRAGCOUNT': '69.000'} [2024-08-06 06:11:01,460][52660] DAMAGECOUNT value on done: 723677.0 [2024-08-06 06:11:01,461][52660] Sum rewards: 80.175, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO4': '0.194', 'AMMO3': '0.238', 'weapon4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:01,670][52671] Large shaping reward 2.545 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0)] [2024-08-06 06:11:02,315][52811] DAMAGECOUNT value on done: 672187.0 [2024-08-06 06:11:02,317][52811] Sum rewards: 82.494, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.350', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 547717120. Throughput: 0: 4364.0. Samples: 136929800. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:11:02,794][52567] Avg episode reward: [(0, '73.969')] [2024-08-06 06:11:02,938][52650] Updated weights for policy 0, policy_version 66861 (0.0011) [2024-08-06 06:11:02,982][52649] DAMAGECOUNT value on done: 705732.0 [2024-08-06 06:11:02,983][52649] Sum rewards: 56.077, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.430', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO3': '0.113', 'AMMO4': '0.121', 'weapon5': '0.154', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.438', 'ARMOR': '0.465', 'WEAPON3': '0.700', 'HITCOUNT': '2.750', 'weapon3': '2.884', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '42.500'} [2024-08-06 06:11:03,589][52647] DAMAGECOUNT value on done: 742047.0 [2024-08-06 06:11:03,589][52647] Sum rewards: 70.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.344', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.160', 'AMMO3': '0.174', 'weapon4': '0.200', 'AMMO4': '0.244', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.100', 'weapon3': '3.126', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:03,914][52820] DAMAGECOUNT value on done: 665907.0 [2024-08-06 06:11:03,916][52820] Sum rewards: 77.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.434', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.196', 'weapon2': '0.210', 'weapon5': '0.254', 'AMMO4': '0.273', 'weapon4': '0.306', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:04,176][52660] DAMAGECOUNT value on done: 733002.0 [2024-08-06 06:11:04,176][52660] Sum rewards: 68.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.118', 'AMMO5': '0.013', 'weapon5': '0.040', 'AMMO2': '0.051', 'AMMO3': '0.218', 'weapon4': '0.222', 'AMMO4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '59.000'} [2024-08-06 06:11:04,240][52659] DAMAGECOUNT value on done: 720680.0 [2024-08-06 06:11:04,241][52659] Sum rewards: 83.428, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.836', 'AMMO5': '0.006', 'weapon4': '0.038', 'AMMO2': '0.039', 'weapon5': '0.096', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'weapon3': '3.430', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '70.000'} [2024-08-06 06:11:04,353][52795] DAMAGECOUNT value on done: 662206.0 [2024-08-06 06:11:04,353][52795] Sum rewards: 84.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.986', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon4': '0.072', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:04,902][52794] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:11:05,491][52811] DAMAGECOUNT value on done: 675217.0 [2024-08-06 06:11:05,492][52811] Sum rewards: 77.654, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.126', 'weapon5': '0.166', 'AMMO3': '0.175', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.100', 'weapon3': '3.184', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:06,042][52649] DAMAGECOUNT value on done: 705761.0 [2024-08-06 06:11:06,044][52649] Sum rewards: 68.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.005', 'AMMO5': '0.007', 'weapon4': '0.034', 'AMMO2': '0.040', 'weapon5': '0.064', 'weapon2': '0.138', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.296', 'WEAPON3': '1.800', 'HITCOUNT': '3.420', 'weapon3': '3.554', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:06,591][52647] DAMAGECOUNT value on done: 757058.0 [2024-08-06 06:11:06,594][52647] Sum rewards: 66.962, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.140', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.138', 'AMMO3': '0.233', 'AMMO4': '0.279', 'weapon2': '0.320', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:06,859][52660] DAMAGECOUNT value on done: 712013.0 [2024-08-06 06:11:06,861][52660] Sum rewards: 73.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.892', 'AMMO5': '0.025', 'AMMO2': '0.076', 'AMMO3': '0.220', 'weapon4': '0.264', 'weapon5': '0.314', 'AMMO4': '0.381', 'weapon2': '0.486', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.572', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:07,090][52820] DAMAGECOUNT value on done: 665302.0 [2024-08-06 06:11:07,090][52820] Sum rewards: 80.379, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.896', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.082', 'weapon5': '0.146', 'AMMO4': '0.208', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.218', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.955', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:07,427][52795] DAMAGECOUNT value on done: 660206.0 [2024-08-06 06:11:07,428][52795] Sum rewards: 79.364, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.737', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.149', 'weapon2': '0.214', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.402', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.859', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:07,466][52650] Updated weights for policy 0, policy_version 66871 (0.0011) [2024-08-06 06:11:07,487][52659] DAMAGECOUNT value on done: 718275.0 [2024-08-06 06:11:07,488][52659] Sum rewards: 71.278, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.470', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '59.000'} [2024-08-06 06:11:07,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 547815424. Throughput: 0: 4370.0. Samples: 136956100. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:11:07,794][52567] Avg episode reward: [(0, '74.367')] [2024-08-06 06:11:08,504][52811] DAMAGECOUNT value on done: 676818.0 [2024-08-06 06:11:08,506][52811] Sum rewards: 73.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.384', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.088', 'weapon5': '0.170', 'AMMO4': '0.235', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '63.500'} [2024-08-06 06:11:08,992][52647] DAMAGECOUNT value on done: 755781.0 [2024-08-06 06:11:08,993][52647] Sum rewards: 75.984, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.172', 'AMMO4': '0.176', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:09,069][52649] DAMAGECOUNT value on done: 704690.0 [2024-08-06 06:11:09,070][52649] Sum rewards: 67.049, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.040', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'weapon2': '0.188', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'HITCOUNT': '3.320', 'weapon3': '3.386', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '59.000'} [2024-08-06 06:11:10,072][52660] DAMAGECOUNT value on done: 720052.0 [2024-08-06 06:11:10,072][52660] Sum rewards: 79.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.520', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.468', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '68.000'} [2024-08-06 06:11:10,129][52820] DAMAGECOUNT value on done: 671653.0 [2024-08-06 06:11:10,130][52820] Sum rewards: 62.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.865', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.190', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.750', 'HITCOUNT': '3.210', 'weapon3': '3.278', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '56.000'} [2024-08-06 06:11:10,547][52795] DAMAGECOUNT value on done: 665995.0 [2024-08-06 06:11:10,553][52795] Sum rewards: 66.031, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.369', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon4': '0.188', 'weapon5': '0.262', 'AMMO3': '0.268', 'AMMO4': '0.323', 'weapon2': '0.456', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.736', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:10,632][52659] DAMAGECOUNT value on done: 715376.0 [2024-08-06 06:11:10,633][52659] Sum rewards: 70.265, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.455', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.222', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:11,569][52667] DAMAGECOUNT value on done: 717022.0 [2024-08-06 06:11:11,570][52667] Sum rewards: 78.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.040', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon5': '0.160', 'AMMO4': '0.224', 'AMMO3': '0.225', 'weapon2': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '66.000'} [2024-08-06 06:11:11,572][52647] DAMAGECOUNT value on done: 753066.0 [2024-08-06 06:11:11,573][52647] Sum rewards: 73.624, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.366', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.206', 'weapon2': '0.222', 'AMMO3': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:11,652][52811] DAMAGECOUNT value on done: 671735.0 [2024-08-06 06:11:11,652][52811] Sum rewards: 83.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.084', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.092', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.320', 'WEAPON3': '1.550', 'weapon3': '3.236', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:11,891][52650] Updated weights for policy 0, policy_version 66881 (0.0012) [2024-08-06 06:11:12,242][52649] DAMAGECOUNT value on done: 691087.0 [2024-08-06 06:11:12,242][52649] Sum rewards: 77.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.742', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.018', 'WEAPON5': '0.050', 'weapon2': '0.184', 'AMMO3': '0.191', 'WEAPON3': '1.250', 'HITCOUNT': '3.440', 'weapon3': '3.692', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 547897344. Throughput: 0: 4374.2. Samples: 136982470. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:11:12,795][52567] Avg episode reward: [(0, '73.850')] [2024-08-06 06:11:13,125][52660] DAMAGECOUNT value on done: 714951.0 [2024-08-06 06:11:13,128][52660] Sum rewards: 60.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.360', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.198', 'AMMO4': '0.256', 'weapon4': '0.308', 'weapon2': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.906', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.385', 'FRAGCOUNT': '52.000'} [2024-08-06 06:11:13,203][52820] DAMAGECOUNT value on done: 658492.0 [2024-08-06 06:11:13,205][52820] Sum rewards: 70.680, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.695', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.082', 'weapon2': '0.166', 'weapon5': '0.180', 'AMMO3': '0.239', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:13,745][52659] DAMAGECOUNT value on done: 720920.0 [2024-08-06 06:11:13,747][52659] Sum rewards: 78.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '65.000'} [2024-08-06 06:11:13,772][52795] DAMAGECOUNT value on done: 659349.0 [2024-08-06 06:11:13,774][52795] Sum rewards: 53.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.444', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.209', 'weapon4': '0.226', 'AMMO4': '0.249', 'weapon5': '0.312', 'weapon2': '0.370', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.350', 'weapon3': '2.740', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '43.000'} [2024-08-06 06:11:13,930][52667] DAMAGECOUNT value on done: 721736.0 [2024-08-06 06:11:13,930][52667] Sum rewards: 73.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'weapon2': '0.376', 'WEAPON3': '1.700', 'weapon3': '3.188', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '64.000'} [2024-08-06 06:11:14,103][52647] DAMAGECOUNT value on done: 747329.0 [2024-08-06 06:11:14,103][52647] Sum rewards: 81.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO4': '0.212', 'weapon2': '0.232', 'weapon4': '0.232', 'weapon5': '0.236', 'AMMO3': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.992', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:14,868][52811] DAMAGECOUNT value on done: 668619.0 [2024-08-06 06:11:14,870][52811] Sum rewards: 66.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.225', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.062', 'weapon5': '0.068', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '54.000'} [2024-08-06 06:11:15,370][52649] DAMAGECOUNT value on done: 702479.0 [2024-08-06 06:11:15,379][52649] Sum rewards: 73.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.667', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:15,770][52660] DAMAGECOUNT value on done: 710291.0 [2024-08-06 06:11:15,771][52660] Sum rewards: 71.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.626', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.422', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:16,417][52820] DAMAGECOUNT value on done: 663597.0 [2024-08-06 06:11:16,418][52820] Sum rewards: 70.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.801', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.078', 'AMMO3': '0.164', 'AMMO4': '0.203', 'weapon5': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.856', 'WEAPON3': '1.050', 'weapon3': '2.522', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:16,718][52659] DAMAGECOUNT value on done: 717596.0 [2024-08-06 06:11:16,719][52659] Sum rewards: 61.594, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.177', 'AMMO5': '0.004', 'weapon4': '0.014', 'weapon5': '0.024', 'AMMO2': '0.032', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.297', 'weapon2': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.276', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '54.000'} [2024-08-06 06:11:16,740][52650] Updated weights for policy 0, policy_version 66891 (0.0024) [2024-08-06 06:11:16,747][52647] DAMAGECOUNT value on done: 760771.0 [2024-08-06 06:11:16,747][52647] Sum rewards: 60.642, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.658', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.104', 'AMMO4': '0.167', 'weapon5': '0.208', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.550', 'weapon3': '2.828', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '53.500'} [2024-08-06 06:11:16,871][52667] DAMAGECOUNT value on done: 718552.0 [2024-08-06 06:11:16,872][52667] Sum rewards: 60.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-4.560', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '52.000'} [2024-08-06 06:11:16,885][52795] DAMAGECOUNT value on done: 656543.0 [2024-08-06 06:11:16,885][52795] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.176', 'AMMO3': '0.182', 'weapon4': '0.236', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.000'} [2024-08-06 06:11:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 547987456. Throughput: 0: 4381.3. Samples: 136995690. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:11:17,794][52567] Avg episode reward: [(0, '72.739')] [2024-08-06 06:11:17,924][52811] DAMAGECOUNT value on done: 666933.0 [2024-08-06 06:11:17,927][52811] Sum rewards: 67.372, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.666', 'AMMO5': '0.027', 'AMMO2': '0.076', 'weapon4': '0.152', 'AMMO3': '0.284', 'AMMO4': '0.380', 'weapon2': '0.388', 'weapon5': '0.408', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.666', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 06:11:18,507][52649] DAMAGECOUNT value on done: 691025.0 [2024-08-06 06:11:18,509][52649] Sum rewards: 86.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.752', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.232', 'AMMO3': '0.240', 'WEAPON3': '1.650', 'weapon3': '3.576', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.984', 'FRAGCOUNT': '72.000'} [2024-08-06 06:11:18,797][52660] DAMAGECOUNT value on done: 705016.0 [2024-08-06 06:11:18,798][52660] Sum rewards: 61.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.479', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO3': '0.213', 'weapon2': '0.276', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.572', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '52.000'} [2024-08-06 06:11:19,392][52647] DAMAGECOUNT value on done: 746329.0 [2024-08-06 06:11:19,395][52647] Sum rewards: 65.860, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.245', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.190', 'AMMO3': '0.197', 'AMMO4': '0.221', 'weapon5': '0.226', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '53.000'} [2024-08-06 06:11:19,581][52820] DAMAGECOUNT value on done: 674306.0 [2024-08-06 06:11:19,582][52820] Sum rewards: 88.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.104', 'AMMO4': '0.134', 'AMMO3': '0.171', 'weapon5': '0.182', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.316', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:19,654][52794] DAMAGECOUNT value on done: 716343.0 [2024-08-06 06:11:19,655][52794] Sum rewards: 84.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.036', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '68.000'} [2024-08-06 06:11:19,659][52659] DAMAGECOUNT value on done: 714024.0 [2024-08-06 06:11:19,659][52659] Sum rewards: 69.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.128', 'weapon2': '0.182', 'weapon4': '0.206', 'AMMO4': '0.215', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '58.000'} [2024-08-06 06:11:19,715][52667] DAMAGECOUNT value on done: 723925.0 [2024-08-06 06:11:19,717][52667] Sum rewards: 74.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.176', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.102', 'weapon4': '0.108', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:19,950][52803] DAMAGECOUNT value on done: 666405.0 [2024-08-06 06:11:19,953][52803] Sum rewards: 81.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.740', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.145', 'weapon2': '0.184', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.416', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '69.000'} [2024-08-06 06:11:20,053][52795] DAMAGECOUNT value on done: 657110.0 [2024-08-06 06:11:20,056][52795] Sum rewards: 81.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO4': '0.178', 'AMMO3': '0.223', 'weapon4': '0.240', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '68.000'} [2024-08-06 06:11:21,165][52811] DAMAGECOUNT value on done: 667924.0 [2024-08-06 06:11:21,166][52811] Sum rewards: 76.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.176', 'weapon2': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.400', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:21,169][52649] DAMAGECOUNT value on done: 705095.0 [2024-08-06 06:11:21,171][52649] Sum rewards: 72.025, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.996', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.102', 'AMMO4': '0.227', 'AMMO3': '0.242', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.322', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:21,635][52650] Updated weights for policy 0, policy_version 66901 (0.0026) [2024-08-06 06:11:22,345][52794] DAMAGECOUNT value on done: 723198.0 [2024-08-06 06:11:22,345][52794] Sum rewards: 78.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.796', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.219', 'weapon4': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '64.000'} [2024-08-06 06:11:22,545][52647] DAMAGECOUNT value on done: 758221.0 [2024-08-06 06:11:22,548][52647] Sum rewards: 75.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.669', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.217', 'WEAPON3': '1.350', 'weapon3': '3.416', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:22,601][52820] DAMAGECOUNT value on done: 667012.0 [2024-08-06 06:11:22,602][52820] Sum rewards: 71.090, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.114', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO3': '0.166', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.472', 'weapon4': '0.502', 'WEAPON3': '0.950', 'weapon3': '2.614', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '56.000'} [2024-08-06 06:11:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 548069376. Throughput: 0: 4380.2. Samples: 137022000. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:11:22,794][52567] Avg episode reward: [(0, '73.180')] [2024-08-06 06:11:22,812][52659] DAMAGECOUNT value on done: 719014.0 [2024-08-06 06:11:22,813][52659] Sum rewards: 77.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.410', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.105', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.216', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.458', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:22,944][52667] DAMAGECOUNT value on done: 724025.0 [2024-08-06 06:11:22,944][52667] Sum rewards: 72.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.640', 'AMMO5': '0.024', 'AMMO2': '0.078', 'weapon4': '0.116', 'weapon5': '0.184', 'AMMO3': '0.235', 'weapon2': '0.386', 'AMMO4': '0.392', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '61.500'} [2024-08-06 06:11:23,017][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:11:23,052][52803] DAMAGECOUNT value on done: 665783.0 [2024-08-06 06:11:23,052][52803] Sum rewards: 76.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:23,184][52795] DAMAGECOUNT value on done: 666691.0 [2024-08-06 06:11:23,185][52795] Sum rewards: 61.533, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.896', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.116', 'AMMO4': '0.247', 'weapon5': '0.248', 'AMMO3': '0.280', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.900', 'weapon3': '2.992', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '55.000'} [2024-08-06 06:11:24,143][52649] DAMAGECOUNT value on done: 705847.0 [2024-08-06 06:11:24,146][52649] Sum rewards: 72.476, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.977', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.076', 'weapon5': '0.184', 'AMMO3': '0.275', 'AMMO4': '0.305', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.700', 'weapon3': '2.930', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:24,250][52811] DAMAGECOUNT value on done: 673044.0 [2024-08-06 06:11:24,253][52811] Sum rewards: 87.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.092', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.540', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:25,300][52794] DAMAGECOUNT value on done: 726044.0 [2024-08-06 06:11:25,302][52794] Sum rewards: 79.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.162', 'AMMO3': '0.202', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '64.000'} [2024-08-06 06:11:25,325][52647] DAMAGECOUNT value on done: 760149.0 [2024-08-06 06:11:25,325][52647] Sum rewards: 81.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.965', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.070', 'AMMO4': '0.123', 'weapon5': '0.148', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'weapon3': '3.288', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '69.000'} [2024-08-06 06:11:25,506][52667] DAMAGECOUNT value on done: 726202.0 [2024-08-06 06:11:25,506][52667] Sum rewards: 70.945, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.092', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon4': '0.174', 'weapon5': '0.222', 'AMMO3': '0.262', 'weapon2': '0.304', 'AMMO4': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:25,747][52820] DAMAGECOUNT value on done: 670057.0 [2024-08-06 06:11:25,748][52820] Sum rewards: 82.896, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.354', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:25,853][52659] DAMAGECOUNT value on done: 724306.0 [2024-08-06 06:11:25,855][52659] Sum rewards: 81.820, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.985', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.097', 'weapon5': '0.112', 'WEAPON4': '0.150', 'weapon2': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.291', 'WEAPON3': '1.750', 'weapon3': '3.396', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:26,149][52803] DAMAGECOUNT value on done: 672002.0 [2024-08-06 06:11:26,151][52803] Sum rewards: 72.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.102', 'AMMO4': '0.192', 'weapon5': '0.212', 'AMMO3': '0.275', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.030', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:26,290][52795] DAMAGECOUNT value on done: 652126.0 [2024-08-06 06:11:26,301][52795] Sum rewards: 68.167, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.087', 'AMMO5': '0.023', 'AMMO2': '0.057', 'AMMO3': '0.139', 'AMMO4': '0.283', 'weapon5': '0.332', 'weapon2': '0.340', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon4': '0.792', 'WEAPON3': '0.850', 'weapon3': '2.276', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '53.000'} [2024-08-06 06:11:26,303][52650] Updated weights for policy 0, policy_version 66911 (0.0030) [2024-08-06 06:11:27,111][52649] DAMAGECOUNT value on done: 697756.0 [2024-08-06 06:11:27,115][52649] Sum rewards: 61.112, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO2': '0.023', 'weapon5': '0.038', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.165', 'weapon2': '0.548', 'WEAPON3': '1.000', 'HITCOUNT': '2.950', 'weapon3': '3.214', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '49.000'} [2024-08-06 06:11:27,406][52811] DAMAGECOUNT value on done: 675125.0 [2024-08-06 06:11:27,408][52811] Sum rewards: 67.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.184', 'weapon5': '0.214', 'AMMO3': '0.215', 'AMMO4': '0.245', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:27,684][52647] DAMAGECOUNT value on done: 745508.0 [2024-08-06 06:11:27,685][52647] Sum rewards: 65.293, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.140', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.096', 'AMMO4': '0.200', 'weapon5': '0.226', 'AMMO3': '0.275', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.070', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:27,781][52614] Signal inference workers to stop experience collection... (12200 times) [2024-08-06 06:11:27,783][52614] Signal inference workers to resume experience collection... (12200 times) [2024-08-06 06:11:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 548159488. Throughput: 0: 4377.3. Samples: 137048150. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:11:27,795][52567] Avg episode reward: [(0, '72.983')] [2024-08-06 06:11:27,824][52650] InferenceWorker_p0-w0: stopping experience collection (12200 times) [2024-08-06 06:11:27,824][52650] InferenceWorker_p0-w0: resuming experience collection (12200 times) [2024-08-06 06:11:27,844][52667] DAMAGECOUNT value on done: 721327.0 [2024-08-06 06:11:27,844][52667] Sum rewards: 66.047, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.865', 'AMMO2': '0.004', 'AMMO4': '0.019', 'AMMO3': '0.183', 'weapon2': '0.728', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '54.000'} [2024-08-06 06:11:28,231][52820] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0)] [2024-08-06 06:11:28,286][52794] DAMAGECOUNT value on done: 712160.0 [2024-08-06 06:11:28,286][52794] Sum rewards: 72.348, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.082', 'weapon4': '0.124', 'AMMO4': '0.205', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '61.500'} [2024-08-06 06:11:28,627][52665] DAMAGECOUNT value on done: 702839.0 [2024-08-06 06:11:28,627][52665] Sum rewards: 77.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.515', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.122', 'AMMO4': '0.130', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:28,832][52820] DAMAGECOUNT value on done: 666036.0 [2024-08-06 06:11:28,833][52820] Sum rewards: 87.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.134', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '72.000'} [2024-08-06 06:11:28,956][52659] DAMAGECOUNT value on done: 712574.0 [2024-08-06 06:11:28,957][52659] Sum rewards: 85.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.140', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '70.000'} [2024-08-06 06:11:29,252][52803] DAMAGECOUNT value on done: 671237.0 [2024-08-06 06:11:29,252][52803] Sum rewards: 74.473, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.830', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.138', 'AMMO3': '0.174', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:29,507][52795] DAMAGECOUNT value on done: 670142.0 [2024-08-06 06:11:29,509][52795] Sum rewards: 69.611, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.825', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.058', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:30,575][52811] DAMAGECOUNT value on done: 671225.0 [2024-08-06 06:11:30,577][52811] Sum rewards: 74.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.227', 'weapon4': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '64.000'} [2024-08-06 06:11:30,644][52667] DAMAGECOUNT value on done: 719179.0 [2024-08-06 06:11:30,646][52667] Sum rewards: 68.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.533', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO3': '0.186', 'AMMO4': '0.221', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.390', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:30,740][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:11:30,754][52650] Updated weights for policy 0, policy_version 66921 (0.0029) [2024-08-06 06:11:30,789][52647] DAMAGECOUNT value on done: 751517.0 [2024-08-06 06:11:30,791][52647] Sum rewards: 74.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.929', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.076', 'weapon5': '0.122', 'AMMO4': '0.188', 'AMMO3': '0.243', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:31,000][52794] DAMAGECOUNT value on done: 713365.0 [2024-08-06 06:11:31,001][52794] Sum rewards: 70.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.682', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.030', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.228', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.520', 'weapon3': '3.550', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:31,134][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:11:31,543][52659] DAMAGECOUNT value on done: 722643.0 [2024-08-06 06:11:31,544][52659] Sum rewards: 72.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.660', 'AMMO5': '0.023', 'AMMO2': '0.050', 'weapon4': '0.196', 'AMMO3': '0.241', 'AMMO4': '0.248', 'weapon2': '0.260', 'weapon5': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:31,590][52665] DAMAGECOUNT value on done: 718817.0 [2024-08-06 06:11:31,591][52665] Sum rewards: 71.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.636', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.068', 'weapon4': '0.076', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.204', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.476', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:31,926][52820] DAMAGECOUNT value on done: 668375.0 [2024-08-06 06:11:31,926][52820] Sum rewards: 88.873, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.328', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.181', 'weapon2': '0.206', 'WEAPON3': '1.050', 'weapon3': '3.458', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:32,343][52803] DAMAGECOUNT value on done: 671752.0 [2024-08-06 06:11:32,345][52803] Sum rewards: 72.414, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.110', 'AMMO4': '0.170', 'weapon5': '0.182', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.216', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:32,679][52795] DAMAGECOUNT value on done: 663720.0 [2024-08-06 06:11:32,679][52795] Sum rewards: 74.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon2': '0.210', 'AMMO3': '0.243', 'weapon4': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 548249600. Throughput: 0: 4379.3. Samples: 137061140. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 06:11:32,794][52567] Avg episode reward: [(0, '73.669')] [2024-08-06 06:11:33,241][52647] DAMAGECOUNT value on done: 741983.0 [2024-08-06 06:11:33,243][52647] Sum rewards: 76.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.184', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:33,786][52667] DAMAGECOUNT value on done: 722050.0 [2024-08-06 06:11:33,787][52667] Sum rewards: 68.345, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.574', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.040', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.276', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.394', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:33,842][52811] DAMAGECOUNT value on done: 670174.0 [2024-08-06 06:11:33,842][52811] Sum rewards: 83.931, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.418', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '71.000'} [2024-08-06 06:11:33,864][52794] DAMAGECOUNT value on done: 718362.0 [2024-08-06 06:11:33,865][52794] Sum rewards: 77.109, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.853', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.188', 'AMMO4': '0.209', 'AMMO3': '0.219', 'weapon4': '0.302', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:34,285][52659] DAMAGECOUNT value on done: 715786.0 [2024-08-06 06:11:34,287][52659] Sum rewards: 74.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.146', 'AMMO3': '0.198', 'weapon5': '0.216', 'weapon2': '0.226', 'AMMO4': '0.244', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:34,816][52665] DAMAGECOUNT value on done: 718854.0 [2024-08-06 06:11:34,817][52665] Sum rewards: 81.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.120', 'weapon4': '0.122', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.282', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '66.000'} [2024-08-06 06:11:35,021][52820] DAMAGECOUNT value on done: 678411.0 [2024-08-06 06:11:35,023][52820] Sum rewards: 73.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.982', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.191', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '60.500'} [2024-08-06 06:11:35,546][52650] Updated weights for policy 0, policy_version 66931 (0.0016) [2024-08-06 06:11:35,606][52647] DAMAGECOUNT value on done: 747160.0 [2024-08-06 06:11:35,607][52647] Sum rewards: 62.150, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.770', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.090', 'weapon5': '0.212', 'AMMO4': '0.264', 'AMMO3': '0.319', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.800', 'weapon3': '2.818', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:35,620][52803] DAMAGECOUNT value on done: 666168.0 [2024-08-06 06:11:35,620][52803] Sum rewards: 75.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.144', 'AMMO3': '0.203', 'AMMO4': '0.258', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:35,849][52795] DAMAGECOUNT value on done: 655174.0 [2024-08-06 06:11:35,850][52795] Sum rewards: 65.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.036', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.220', 'AMMO3': '0.221', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.510', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '55.000'} [2024-08-06 06:11:36,891][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:11:36,926][52794] DAMAGECOUNT value on done: 723495.0 [2024-08-06 06:11:36,928][52794] Sum rewards: 82.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.278', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.110', 'weapon4': '0.138', 'weapon2': '0.202', 'AMMO4': '0.206', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '68.000'} [2024-08-06 06:11:36,985][52667] DAMAGECOUNT value on done: 729235.0 [2024-08-06 06:11:36,987][52667] Sum rewards: 82.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.605', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.157', 'weapon2': '0.170', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:37,499][52659] DAMAGECOUNT value on done: 717729.0 [2024-08-06 06:11:37,501][52659] Sum rewards: 73.234, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO4': '0.207', 'AMMO3': '0.248', 'weapon2': '0.254', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '64.000'} [2024-08-06 06:11:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 548331520. Throughput: 0: 4366.4. Samples: 137087180. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:11:37,794][52567] Avg episode reward: [(0, '73.695')] [2024-08-06 06:11:37,851][52665] DAMAGECOUNT value on done: 711659.0 [2024-08-06 06:11:37,852][52665] Sum rewards: 77.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.082', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.118', 'weapon5': '0.132', 'AMMO4': '0.146', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:37,881][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:11:38,119][52820] DAMAGECOUNT value on done: 675655.0 [2024-08-06 06:11:38,119][52820] Sum rewards: 71.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.210', 'weapon4': '0.228', 'AMMO3': '0.236', 'weapon2': '0.244', 'AMMO4': '0.278', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:38,714][52803] DAMAGECOUNT value on done: 661806.0 [2024-08-06 06:11:38,717][52803] Sum rewards: 79.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.200', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.264', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.386', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:38,852][52795] DAMAGECOUNT value on done: 662767.0 [2024-08-06 06:11:38,852][52795] Sum rewards: 63.305, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.465', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.632', 'WEAPON3': '0.800', 'HITCOUNT': '3.010', 'weapon3': '3.046', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '49.000'} [2024-08-06 06:11:39,799][52659] DAMAGECOUNT value on done: 724561.0 [2024-08-06 06:11:39,799][52659] Sum rewards: 65.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.104', 'weapon5': '0.160', 'AMMO3': '0.179', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.662', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '55.000'} [2024-08-06 06:11:39,885][52650] Updated weights for policy 0, policy_version 66941 (0.0027) [2024-08-06 06:11:40,067][52794] DAMAGECOUNT value on done: 709582.0 [2024-08-06 06:11:40,068][52794] Sum rewards: 72.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.204', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.140', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:40,313][52667] DAMAGECOUNT value on done: 720057.0 [2024-08-06 06:11:40,313][52667] Sum rewards: 83.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.412', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.080', 'WEAPON5': '0.200', 'weapon2': '0.210', 'weapon4': '0.226', 'AMMO3': '0.249', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '70.000'} [2024-08-06 06:11:40,674][52665] DAMAGECOUNT value on done: 698214.0 [2024-08-06 06:11:40,674][52665] Sum rewards: 78.758, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.960', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.166', 'weapon4': '0.216', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '66.000'} [2024-08-06 06:11:41,185][52811] Large shaping reward 2.553 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2024-08-06 06:11:41,367][52820] DAMAGECOUNT value on done: 661632.0 [2024-08-06 06:11:41,370][52820] Sum rewards: 68.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.183', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.214', 'AMMO3': '0.224', 'AMMO4': '0.228', 'weapon5': '0.242', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '57.500'} [2024-08-06 06:11:41,958][52795] DAMAGECOUNT value on done: 670597.0 [2024-08-06 06:11:41,966][52795] Sum rewards: 59.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon4': '0.090', 'weapon5': '0.180', 'AMMO3': '0.257', 'AMMO4': '0.297', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '2.970', 'DAMAGECOUNT': '14.013', 'FRAGCOUNT': '53.000'} [2024-08-06 06:11:41,980][52803] DAMAGECOUNT value on done: 660982.0 [2024-08-06 06:11:41,981][52803] Sum rewards: 66.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon5': '0.214', 'AMMO3': '0.217', 'AMMO4': '0.286', 'weapon2': '0.340', 'weapon4': '0.454', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.718', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '53.500'} [2024-08-06 06:11:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 548421632. Throughput: 0: 4380.7. Samples: 137113700. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:11:42,794][52567] Avg episode reward: [(0, '73.396')] [2024-08-06 06:11:43,054][52660] Large shaping reward 2.623 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon5', 0.002)] [2024-08-06 06:11:43,055][52659] DAMAGECOUNT value on done: 720376.0 [2024-08-06 06:11:43,059][52659] Sum rewards: 72.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.357', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.142', 'AMMO4': '0.166', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '60.000'} [2024-08-06 06:11:43,076][52667] DAMAGECOUNT value on done: 718552.0 [2024-08-06 06:11:43,076][52667] Sum rewards: 64.589, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.125', 'AMMO5': '0.024', 'AMMO2': '0.081', 'AMMO3': '0.238', 'weapon4': '0.246', 'weapon5': '0.292', 'AMMO4': '0.405', 'weapon2': '0.410', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.708', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '56.000'} [2024-08-06 06:11:43,196][52794] DAMAGECOUNT value on done: 720965.0 [2024-08-06 06:11:43,197][52794] Sum rewards: 75.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.045', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:43,405][52665] DAMAGECOUNT value on done: 704845.0 [2024-08-06 06:11:43,405][52665] Sum rewards: 66.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.046', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.104', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.376', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.270', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 06:11:44,853][52650] Updated weights for policy 0, policy_version 66951 (0.0013) [2024-08-06 06:11:45,196][52803] DAMAGECOUNT value on done: 665112.0 [2024-08-06 06:11:45,197][52803] Sum rewards: 80.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.870', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.131', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.324', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '64.000'} [2024-08-06 06:11:45,562][52667] DAMAGECOUNT value on done: 725869.0 [2024-08-06 06:11:45,562][52667] Sum rewards: 77.873, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.516', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '66.000'} [2024-08-06 06:11:45,889][52665] DAMAGECOUNT value on done: 711676.0 [2024-08-06 06:11:45,889][52665] Sum rewards: 82.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.615', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.059', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.396', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '69.000'} [2024-08-06 06:11:46,204][52659] DAMAGECOUNT value on done: 726120.0 [2024-08-06 06:11:46,205][52659] Sum rewards: 85.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.293', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.330', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '69.000'} [2024-08-06 06:11:46,360][52794] DAMAGECOUNT value on done: 711441.0 [2024-08-06 06:11:46,362][52794] Sum rewards: 72.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.092', 'weapon5': '0.150', 'AMMO4': '0.231', 'AMMO3': '0.235', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '59.500'} [2024-08-06 06:11:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 548511744. Throughput: 0: 4381.8. Samples: 137126980. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:11:47,794][52567] Avg episode reward: [(0, '73.546')] [2024-08-06 06:11:48,288][52803] DAMAGECOUNT value on done: 664071.0 [2024-08-06 06:11:48,288][52803] Sum rewards: 68.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '58.000'} [2024-08-06 06:11:48,487][52667] DAMAGECOUNT value on done: 714707.0 [2024-08-06 06:11:48,488][52667] Sum rewards: 83.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.381', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'weapon4': '0.108', 'AMMO3': '0.221', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.931', 'FRAGCOUNT': '68.000'} [2024-08-06 06:11:48,526][52665] DAMAGECOUNT value on done: 707882.0 [2024-08-06 06:11:48,526][52665] Sum rewards: 64.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.672', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.140', 'AMMO3': '0.177', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '53.000'} [2024-08-06 06:11:49,069][52659] DAMAGECOUNT value on done: 714803.0 [2024-08-06 06:11:49,069][52659] Sum rewards: 85.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.554', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.182', 'AMMO3': '0.194', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '69.000'} [2024-08-06 06:11:49,510][52650] Updated weights for policy 0, policy_version 66961 (0.0024) [2024-08-06 06:11:49,750][52794] DAMAGECOUNT value on done: 709608.0 [2024-08-06 06:11:49,752][52794] Sum rewards: 67.559, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.577', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.084', 'weapon5': '0.098', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '56.000'} [2024-08-06 06:11:51,268][52665] DAMAGECOUNT value on done: 716778.0 [2024-08-06 06:11:51,269][52665] Sum rewards: 56.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.027', 'AMMO2': '0.045', 'weapon5': '0.168', 'AMMO3': '0.204', 'AMMO4': '0.224', 'weapon4': '0.420', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.610', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '47.000'} [2024-08-06 06:11:51,353][52803] DAMAGECOUNT value on done: 678333.0 [2024-08-06 06:11:51,353][52803] Sum rewards: 72.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.406', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '3.136', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 06:11:51,522][52667] DAMAGECOUNT value on done: 721850.0 [2024-08-06 06:11:51,528][52667] Sum rewards: 66.404, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.057', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.167', 'weapon5': '0.232', 'AMMO4': '0.241', 'weapon4': '0.270', 'weapon2': '0.288', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '53.000'} [2024-08-06 06:11:51,648][52659] DAMAGECOUNT value on done: 726736.0 [2024-08-06 06:11:51,648][52659] Sum rewards: 74.336, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.405', 'AMMO5': '0.021', 'AMMO2': '0.073', 'weapon4': '0.160', 'AMMO3': '0.258', 'weapon5': '0.284', 'AMMO4': '0.367', 'weapon2': '0.452', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.776', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '63.000'} [2024-08-06 06:11:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 548601856. Throughput: 0: 4377.8. Samples: 137153100. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:11:52,794][52567] Avg episode reward: [(0, '73.356')] [2024-08-06 06:11:52,814][52794] DAMAGECOUNT value on done: 719525.0 [2024-08-06 06:11:52,814][52794] Sum rewards: 80.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.048', 'weapon5': '0.062', 'AMMO4': '0.232', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '67.000'} [2024-08-06 06:11:54,004][52665] DAMAGECOUNT value on done: 710661.0 [2024-08-06 06:11:54,004][52665] Sum rewards: 73.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.598', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.132', 'AMMO4': '0.136', 'weapon5': '0.146', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '61.000'} [2024-08-06 06:11:54,237][52659] DAMAGECOUNT value on done: 714373.0 [2024-08-06 06:11:54,237][52659] Sum rewards: 67.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.114', 'AMMO3': '0.197', 'weapon5': '0.232', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '54.000'} [2024-08-06 06:11:54,387][52650] Updated weights for policy 0, policy_version 66971 (0.0013) [2024-08-06 06:11:54,551][52803] DAMAGECOUNT value on done: 668515.0 [2024-08-06 06:11:54,552][52803] Sum rewards: 71.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.204', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.044', 'AMMO4': '0.057', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 06:11:54,561][52667] DAMAGECOUNT value on done: 728492.0 [2024-08-06 06:11:54,561][52667] Sum rewards: 71.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.551', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.104', 'AMMO4': '0.184', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '62.000'} [2024-08-06 06:11:56,244][52794] DAMAGECOUNT value on done: 716253.0 [2024-08-06 06:11:56,246][52794] Sum rewards: 66.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.495', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.066', 'weapon5': '0.084', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.251', 'weapon2': '0.722', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '57.000'} [2024-08-06 06:11:56,502][52665] DAMAGECOUNT value on done: 719949.0 [2024-08-06 06:11:56,504][52665] Sum rewards: 85.990, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.842', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.180', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.448', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '68.000'} [2024-08-06 06:11:57,268][52667] DAMAGECOUNT value on done: 726920.0 [2024-08-06 06:11:57,271][52667] Sum rewards: 72.714, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.225', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.070', 'AMMO4': '0.104', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.804', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '59.000'} [2024-08-06 06:11:57,788][52803] DAMAGECOUNT value on done: 667600.0 [2024-08-06 06:11:57,789][52803] Sum rewards: 67.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.175', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.168', 'weapon4': '0.194', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '2.892', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '56.000'} [2024-08-06 06:11:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 548683776. Throughput: 0: 4367.3. Samples: 137179000. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:11:57,794][52567] Avg episode reward: [(0, '73.727')] [2024-08-06 06:11:58,983][52794] DAMAGECOUNT value on done: 730570.0 [2024-08-06 06:11:58,986][52794] Sum rewards: 78.607, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.116', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.156', 'weapon4': '0.160', 'weapon2': '0.174', 'AMMO4': '0.177', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.242', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.595', 'FRAGCOUNT': '68.000'} [2024-08-06 06:11:59,067][52650] Updated weights for policy 0, policy_version 66981 (0.0016) [2024-08-06 06:11:59,355][52665] DAMAGECOUNT value on done: 716775.0 [2024-08-06 06:11:59,355][52665] Sum rewards: 82.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '66.000'} [2024-08-06 06:12:00,201][52667] DAMAGECOUNT value on done: 724596.0 [2024-08-06 06:12:00,201][52667] Sum rewards: 64.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.197', 'weapon4': '0.210', 'weapon2': '0.292', 'AMMO4': '0.293', 'weapon5': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '53.000'} [2024-08-06 06:12:00,870][52803] DAMAGECOUNT value on done: 680725.0 [2024-08-06 06:12:00,873][52803] Sum rewards: 68.390, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.068', 'weapon5': '0.134', 'AMMO3': '0.223', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.234', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:01,879][52794] DAMAGECOUNT value on done: 710901.0 [2024-08-06 06:12:01,880][52794] Sum rewards: 80.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.386', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.076', 'weapon5': '0.152', 'AMMO4': '0.176', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '65.000'} [2024-08-06 06:12:02,388][52665] DAMAGECOUNT value on done: 712340.0 [2024-08-06 06:12:02,390][52665] Sum rewards: 72.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:02,479][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:12:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 548765696. Throughput: 0: 4362.2. Samples: 137191990. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:12:02,794][52567] Avg episode reward: [(0, '74.169')] [2024-08-06 06:12:03,109][52663] DAMAGECOUNT value on done: 732384.0 [2024-08-06 06:12:03,110][52663] Sum rewards: 69.869, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.975', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.098', 'AMMO4': '0.117', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.334', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:03,245][52667] DAMAGECOUNT value on done: 722362.0 [2024-08-06 06:12:03,249][52667] Sum rewards: 85.935, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.114', 'AMMO4': '0.156', 'AMMO3': '0.215', 'weapon2': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.892', 'FRAGCOUNT': '70.000'} [2024-08-06 06:12:03,847][52803] DAMAGECOUNT value on done: 666283.0 [2024-08-06 06:12:03,848][52803] Sum rewards: 77.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.749', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.186', 'weapon4': '0.190', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:03,907][52650] Updated weights for policy 0, policy_version 66991 (0.0011) [2024-08-06 06:12:04,095][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:12:04,811][52794] DAMAGECOUNT value on done: 724178.0 [2024-08-06 06:12:04,812][52794] Sum rewards: 68.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.554', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.071', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:05,597][52665] DAMAGECOUNT value on done: 707317.0 [2024-08-06 06:12:05,598][52665] Sum rewards: 73.845, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.190', 'AMMO3': '0.206', 'HEALTH': '0.328', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:06,081][52667] DAMAGECOUNT value on done: 729095.0 [2024-08-06 06:12:06,081][52667] Sum rewards: 77.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.886', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO3': '0.188', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:06,370][52663] DAMAGECOUNT value on done: 718054.0 [2024-08-06 06:12:06,370][52663] Sum rewards: 75.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.112', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '60.500'} [2024-08-06 06:12:07,059][52803] DAMAGECOUNT value on done: 669194.0 [2024-08-06 06:12:07,059][52803] Sum rewards: 77.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.032', 'AMMO5': '0.007', 'AMMO2': '0.028', 'ARMOR': '0.034', 'weapon4': '0.128', 'weapon5': '0.140', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:07,323][52794] DAMAGECOUNT value on done: 720300.0 [2024-08-06 06:12:07,323][52794] Sum rewards: 64.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.148', 'weapon4': '0.172', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '52.000'} [2024-08-06 06:12:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 548864000. Throughput: 0: 4364.2. Samples: 137218390. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:12:07,794][52567] Avg episode reward: [(0, '73.815')] [2024-08-06 06:12:08,321][52650] Updated weights for policy 0, policy_version 67001 (0.0022) [2024-08-06 06:12:08,789][52665] DAMAGECOUNT value on done: 706410.0 [2024-08-06 06:12:08,792][52665] Sum rewards: 60.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.937', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.070', 'weapon5': '0.170', 'AMMO4': '0.208', 'AMMO3': '0.231', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.598', 'WEAPON3': '1.450', 'HITCOUNT': '2.850', 'weapon3': '2.960', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '52.000'} [2024-08-06 06:12:09,377][52663] DAMAGECOUNT value on done: 712423.0 [2024-08-06 06:12:09,377][52663] Sum rewards: 67.914, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.795', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.132', 'AMMO4': '0.210', 'weapon2': '0.226', 'weapon4': '0.254', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.078', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:10,183][52803] DAMAGECOUNT value on done: 671352.0 [2024-08-06 06:12:10,184][52803] Sum rewards: 72.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.084', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon5': '0.184', 'AMMO4': '0.209', 'AMMO3': '0.238', 'weapon2': '0.290', 'weapon4': '0.490', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.686', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:10,511][52794] DAMAGECOUNT value on done: 724013.0 [2024-08-06 06:12:10,513][52794] Sum rewards: 77.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.952', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.102', 'AMMO4': '0.123', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '63.000'} [2024-08-06 06:12:11,676][52665] DAMAGECOUNT value on done: 712121.0 [2024-08-06 06:12:11,678][52665] Sum rewards: 88.900, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.315', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.102', 'weapon5': '0.188', 'AMMO3': '0.280', 'weapon2': '0.312', 'AMMO4': '0.345', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.072', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '76.000'} [2024-08-06 06:12:12,469][52663] DAMAGECOUNT value on done: 715551.0 [2024-08-06 06:12:12,471][52663] Sum rewards: 71.500, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.764', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.098', 'AMMO4': '0.172', 'weapon5': '0.244', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '2.874', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 548945920. Throughput: 0: 4359.8. Samples: 137244340. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:12:12,794][52567] Avg episode reward: [(0, '73.852')] [2024-08-06 06:12:13,136][52650] Updated weights for policy 0, policy_version 67011 (0.0031) [2024-08-06 06:12:13,216][52794] DAMAGECOUNT value on done: 730105.0 [2024-08-06 06:12:13,218][52794] Sum rewards: 69.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.335', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.026', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.264', 'weapon2': '0.410', 'WEAPON3': '1.600', 'weapon3': '3.308', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '58.500'} [2024-08-06 06:12:13,234][52803] DAMAGECOUNT value on done: 673323.0 [2024-08-06 06:12:13,234][52803] Sum rewards: 79.896, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.620', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'weapon2': '0.306', 'WEAPON3': '1.850', 'weapon3': '3.260', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '70.000'} [2024-08-06 06:12:14,252][52658] DAMAGECOUNT value on done: 722442.0 [2024-08-06 06:12:14,252][52658] Sum rewards: 83.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.572', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.214', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.326', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '69.000'} [2024-08-06 06:12:14,632][52665] DAMAGECOUNT value on done: 712898.0 [2024-08-06 06:12:14,636][52665] Sum rewards: 82.036, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.245', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.122', 'weapon4': '0.204', 'AMMO4': '0.238', 'AMMO3': '0.268', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.800', 'weapon3': '3.042', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '71.000'} [2024-08-06 06:12:15,306][52663] DAMAGECOUNT value on done: 720158.0 [2024-08-06 06:12:15,308][52663] Sum rewards: 64.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.404', 'AMMO5': '0.004', 'weapon5': '0.028', 'weapon4': '0.032', 'AMMO2': '0.039', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.221', 'weapon2': '0.658', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '55.000'} [2024-08-06 06:12:15,927][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:12:16,046][52794] DAMAGECOUNT value on done: 721792.0 [2024-08-06 06:12:16,047][52794] Sum rewards: 76.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.918', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.019', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.448', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:16,366][52803] DAMAGECOUNT value on done: 678165.0 [2024-08-06 06:12:16,370][52803] Sum rewards: 70.583, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.340', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.078', 'AMMO4': '0.134', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:17,510][52658] DAMAGECOUNT value on done: 719610.0 [2024-08-06 06:12:17,510][52658] Sum rewards: 70.130, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.078', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.242', 'HEALTH': '0.452', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.432', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '58.500'} [2024-08-06 06:12:17,766][52665] DAMAGECOUNT value on done: 704337.0 [2024-08-06 06:12:17,769][52665] Sum rewards: 87.070, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.130', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon2': '0.232', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.554', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '75.000'} [2024-08-06 06:12:17,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 549027840. Throughput: 0: 4361.5. Samples: 137257410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:17,795][52567] Avg episode reward: [(0, '73.538')] [2024-08-06 06:12:17,848][52650] Updated weights for policy 0, policy_version 67021 (0.0010) [2024-08-06 06:12:18,470][52663] DAMAGECOUNT value on done: 727235.0 [2024-08-06 06:12:18,471][52663] Sum rewards: 72.138, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.387', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.170', 'weapon4': '0.186', 'weapon2': '0.216', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:19,334][52670] DAMAGECOUNT value on done: 708938.0 [2024-08-06 06:12:19,334][52670] Sum rewards: 60.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.438', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon2': '0.146', 'AMMO4': '0.169', 'weapon5': '0.214', 'AMMO3': '0.220', 'weapon4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.192', 'DAMAGECOUNT': '15.099', 'FRAGCOUNT': '51.000'} [2024-08-06 06:12:19,465][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:12:19,529][52803] DAMAGECOUNT value on done: 672259.0 [2024-08-06 06:12:19,531][52803] Sum rewards: 82.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.087', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '67.000'} [2024-08-06 06:12:20,571][52658] DAMAGECOUNT value on done: 725609.0 [2024-08-06 06:12:20,571][52658] Sum rewards: 71.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.869', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.074', 'weapon4': '0.092', 'AMMO4': '0.206', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:20,784][52666] DAMAGECOUNT value on done: 720865.0 [2024-08-06 06:12:20,785][52666] Sum rewards: 65.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.124', 'AMMO3': '0.220', 'weapon5': '0.260', 'AMMO4': '0.290', 'weapon2': '0.404', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '54.500'} [2024-08-06 06:12:20,968][52665] DAMAGECOUNT value on done: 708068.0 [2024-08-06 06:12:20,968][52665] Sum rewards: 77.120, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.888', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.098', 'AMMO4': '0.145', 'weapon2': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.400', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '68.000'} [2024-08-06 06:12:21,315][52663] DAMAGECOUNT value on done: 714531.0 [2024-08-06 06:12:21,315][52663] Sum rewards: 81.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.243', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '65.000'} [2024-08-06 06:12:21,682][52669] DAMAGECOUNT value on done: 720647.0 [2024-08-06 06:12:21,684][52669] Sum rewards: 58.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.180', 'AMMO4': '0.188', 'AMMO3': '0.201', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.800', 'weapon3': '3.222', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '49.000'} [2024-08-06 06:12:22,274][52670] DAMAGECOUNT value on done: 721351.0 [2024-08-06 06:12:22,275][52670] Sum rewards: 64.715, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.634', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.252', 'AMMO4': '0.315', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '56.000'} [2024-08-06 06:12:22,646][52650] Updated weights for policy 0, policy_version 67031 (0.0013) [2024-08-06 06:12:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 549117952. Throughput: 0: 4367.3. Samples: 137283710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:22,802][52567] Avg episode reward: [(0, '73.484')] [2024-08-06 06:12:23,140][52658] DAMAGECOUNT value on done: 723358.0 [2024-08-06 06:12:23,142][52658] Sum rewards: 69.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.618', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.036', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.218', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '57.000'} [2024-08-06 06:12:23,678][52666] DAMAGECOUNT value on done: 717456.0 [2024-08-06 06:12:23,680][52666] Sum rewards: 74.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.103', 'AMMO5': '0.023', 'AMMO2': '0.061', 'weapon4': '0.090', 'AMMO3': '0.235', 'weapon2': '0.264', 'AMMO4': '0.303', 'weapon5': '0.328', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:23,720][52663] DAMAGECOUNT value on done: 709537.0 [2024-08-06 06:12:23,721][52663] Sum rewards: 79.060, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.764', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.042', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'HITCOUNT': '3.440', 'weapon3': '3.552', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '70.000'} [2024-08-06 06:12:23,745][52665] DAMAGECOUNT value on done: 711811.0 [2024-08-06 06:12:23,746][52665] Sum rewards: 81.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.061', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '65.000'} [2024-08-06 06:12:24,268][52669] DAMAGECOUNT value on done: 712907.0 [2024-08-06 06:12:24,271][52669] Sum rewards: 60.422, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.601', 'AMMO5': '0.010', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.058', 'AMMO4': '0.089', 'weapon5': '0.094', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.000', 'HITCOUNT': '2.880', 'weapon3': '3.298', 'DAMAGECOUNT': '14.442', 'FRAGCOUNT': '49.000'} [2024-08-06 06:12:24,794][52670] DAMAGECOUNT value on done: 708897.0 [2024-08-06 06:12:24,796][52670] Sum rewards: 84.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.283', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.222', 'AMMO3': '0.227', 'WEAPON3': '1.450', 'weapon3': '3.520', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '70.000'} [2024-08-06 06:12:25,935][52658] DAMAGECOUNT value on done: 713741.0 [2024-08-06 06:12:25,936][52658] Sum rewards: 75.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.088', 'AMMO4': '0.157', 'weapon5': '0.192', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:26,485][52663] DAMAGECOUNT value on done: 710099.0 [2024-08-06 06:12:26,487][52663] Sum rewards: 67.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.980', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.694', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '55.000'} [2024-08-06 06:12:26,676][52666] DAMAGECOUNT value on done: 718640.0 [2024-08-06 06:12:26,677][52666] Sum rewards: 76.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.739', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.476', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:26,954][52650] Updated weights for policy 0, policy_version 67041 (0.0030) [2024-08-06 06:12:27,044][52669] DAMAGECOUNT value on done: 724912.0 [2024-08-06 06:12:27,046][52669] Sum rewards: 72.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.585', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.054', 'weapon4': '0.154', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.266', 'WEAPON4': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '63.000'} [2024-08-06 06:12:27,272][52671] DAMAGECOUNT value on done: 721669.0 [2024-08-06 06:12:27,272][52671] Sum rewards: 77.873, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.096', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.096', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 06:12:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 549208064. Throughput: 0: 4362.7. Samples: 137310020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:27,794][52567] Avg episode reward: [(0, '73.552')] [2024-08-06 06:12:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067042_549208064.pth... [2024-08-06 06:12:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066530_545013760.pth [2024-08-06 06:12:28,028][52670] DAMAGECOUNT value on done: 706839.0 [2024-08-06 06:12:28,029][52670] Sum rewards: 81.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.795', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.422', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '68.000'} [2024-08-06 06:12:29,048][52658] DAMAGECOUNT value on done: 711973.0 [2024-08-06 06:12:29,048][52658] Sum rewards: 67.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.098', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.220', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.442', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '56.000'} [2024-08-06 06:12:29,382][52663] DAMAGECOUNT value on done: 715059.0 [2024-08-06 06:12:29,383][52663] Sum rewards: 77.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.992', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO3': '0.230', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '65.000'} [2024-08-06 06:12:29,926][52666] DAMAGECOUNT value on done: 718105.0 [2024-08-06 06:12:29,926][52666] Sum rewards: 72.131, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.654', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.148', 'AMMO3': '0.170', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:29,934][52669] DAMAGECOUNT value on done: 720924.0 [2024-08-06 06:12:29,937][52669] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.130', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.145', 'AMMO3': '0.146', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.000', 'weapon3': '2.904', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:30,182][52671] DAMAGECOUNT value on done: 726354.0 [2024-08-06 06:12:30,184][52671] Sum rewards: 73.479, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.080', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.198', 'AMMO4': '0.246', 'weapon2': '0.246', 'AMMO3': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.152', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:30,373][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:12:30,919][52670] DAMAGECOUNT value on done: 717817.0 [2024-08-06 06:12:30,923][52670] Sum rewards: 68.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.230', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.480', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '57.000'} [2024-08-06 06:12:31,874][52658] DAMAGECOUNT value on done: 725876.0 [2024-08-06 06:12:31,875][52658] Sum rewards: 68.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.938', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.876', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '55.000'} [2024-08-06 06:12:32,363][52650] Updated weights for policy 0, policy_version 67051 (0.0050) [2024-08-06 06:12:32,403][52663] DAMAGECOUNT value on done: 724738.0 [2024-08-06 06:12:32,404][52663] Sum rewards: 73.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.428', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.080', 'AMMO4': '0.183', 'weapon5': '0.190', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:32,642][52666] DAMAGECOUNT value on done: 712237.0 [2024-08-06 06:12:32,642][52666] Sum rewards: 71.144, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.806', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon4': '0.204', 'weapon2': '0.364', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '57.000'} [2024-08-06 06:12:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 549289984. Throughput: 0: 4347.6. Samples: 137322620. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:32,795][52567] Avg episode reward: [(0, '73.376')] [2024-08-06 06:12:33,039][52669] DAMAGECOUNT value on done: 721345.0 [2024-08-06 06:12:33,040][52669] Sum rewards: 64.400, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.281', 'weapon2': '0.370', 'WEAPON3': '1.700', 'weapon3': '3.248', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '56.000'} [2024-08-06 06:12:33,412][52671] DAMAGECOUNT value on done: 722420.0 [2024-08-06 06:12:33,421][52671] Sum rewards: 76.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.769', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.212', 'weapon5': '0.214', 'AMMO3': '0.242', 'weapon2': '0.266', 'AMMO4': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 06:12:33,966][52670] DAMAGECOUNT value on done: 713596.0 [2024-08-06 06:12:33,969][52670] Sum rewards: 74.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.626', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.112', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:34,462][52658] DAMAGECOUNT value on done: 715145.0 [2024-08-06 06:12:34,463][52658] Sum rewards: 63.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.108', 'AMMO3': '0.197', 'weapon5': '0.202', 'AMMO4': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '52.000'} [2024-08-06 06:12:35,030][52663] DAMAGECOUNT value on done: 710887.0 [2024-08-06 06:12:35,031][52663] Sum rewards: 81.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.171', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.190', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '67.000'} [2024-08-06 06:12:35,641][52669] DAMAGECOUNT value on done: 723024.0 [2024-08-06 06:12:35,643][52669] Sum rewards: 68.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.485', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.106', 'AMMO4': '0.130', 'weapon5': '0.134', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '57.500'} [2024-08-06 06:12:35,899][52666] DAMAGECOUNT value on done: 715501.0 [2024-08-06 06:12:35,899][52666] Sum rewards: 86.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.608', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.149', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.454', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '21.252', 'FRAGCOUNT': '72.000'} [2024-08-06 06:12:36,248][52671] DAMAGECOUNT value on done: 727111.0 [2024-08-06 06:12:36,249][52671] Sum rewards: 84.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.180', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.092', 'weapon5': '0.148', 'AMMO4': '0.208', 'AMMO3': '0.225', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '70.000'} [2024-08-06 06:12:36,600][52650] Updated weights for policy 0, policy_version 67061 (0.0014) [2024-08-06 06:12:37,105][52658] DAMAGECOUNT value on done: 737726.0 [2024-08-06 06:12:37,107][52658] Sum rewards: 72.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.875', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.162', 'weapon5': '0.204', 'weapon2': '0.244', 'AMMO3': '0.264', 'AMMO4': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '63.000'} [2024-08-06 06:12:37,459][52670] DAMAGECOUNT value on done: 705874.0 [2024-08-06 06:12:37,461][52670] Sum rewards: 61.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.095', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.694', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '50.000'} [2024-08-06 06:12:37,695][52663] DAMAGECOUNT value on done: 706928.0 [2024-08-06 06:12:37,696][52663] Sum rewards: 82.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.602', 'AMMO5': '0.030', 'AMMO2': '0.074', 'weapon4': '0.150', 'AMMO3': '0.262', 'weapon5': '0.306', 'weapon2': '0.336', 'AMMO4': '0.368', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.860', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '69.000'} [2024-08-06 06:12:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 549380096. Throughput: 0: 4345.3. Samples: 137348640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:37,794][52567] Avg episode reward: [(0, '73.369')] [2024-08-06 06:12:38,208][52669] DAMAGECOUNT value on done: 721176.0 [2024-08-06 06:12:38,209][52669] Sum rewards: 86.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.164', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon2': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.198', 'weapon4': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '70.000'} [2024-08-06 06:12:39,032][52671] DAMAGECOUNT value on done: 733393.0 [2024-08-06 06:12:39,040][52671] Sum rewards: 82.465, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.232', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon5': '0.206', 'AMMO3': '0.229', 'weapon4': '0.262', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '68.000'} [2024-08-06 06:12:39,267][52666] DAMAGECOUNT value on done: 713738.0 [2024-08-06 06:12:39,268][52666] Sum rewards: 68.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.084', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '56.000'} [2024-08-06 06:12:40,189][52658] DAMAGECOUNT value on done: 720660.0 [2024-08-06 06:12:40,192][52658] Sum rewards: 77.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.145', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.038', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.468', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '66.000'} [2024-08-06 06:12:40,354][52663] DAMAGECOUNT value on done: 714698.0 [2024-08-06 06:12:40,354][52663] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.245', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.056', 'AMMO4': '0.149', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.538', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:40,580][52670] DAMAGECOUNT value on done: 712162.0 [2024-08-06 06:12:40,580][52670] Sum rewards: 69.099, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.232', 'AMMO5': '0.008', 'weapon4': '0.038', 'AMMO2': '0.045', 'weapon5': '0.132', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.284', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '56.000'} [2024-08-06 06:12:40,983][52669] DAMAGECOUNT value on done: 725143.0 [2024-08-06 06:12:40,985][52669] Sum rewards: 80.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.082', 'AMMO4': '0.101', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.600', 'weapon3': '3.136', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '68.000'} [2024-08-06 06:12:41,354][52650] Updated weights for policy 0, policy_version 67071 (0.0011) [2024-08-06 06:12:41,860][52671] DAMAGECOUNT value on done: 726662.0 [2024-08-06 06:12:41,861][52671] Sum rewards: 80.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.102', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.112', 'AMMO4': '0.127', 'weapon2': '0.164', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.486', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '65.000'} [2024-08-06 06:12:42,239][52666] DAMAGECOUNT value on done: 708239.0 [2024-08-06 06:12:42,239][52666] Sum rewards: 74.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.238', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:42,262][52665] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:12:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 549470208. Throughput: 0: 4354.4. Samples: 137374950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:42,794][52567] Avg episode reward: [(0, '73.856')] [2024-08-06 06:12:43,310][52670] DAMAGECOUNT value on done: 710728.0 [2024-08-06 06:12:43,310][52670] Sum rewards: 80.808, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.835', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.088', 'weapon2': '0.188', 'weapon5': '0.216', 'AMMO4': '0.268', 'AMMO3': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.196', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '69.000'} [2024-08-06 06:12:43,395][52658] DAMAGECOUNT value on done: 732272.0 [2024-08-06 06:12:43,396][52658] Sum rewards: 67.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.576', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.213', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.408', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 06:12:43,436][52663] DAMAGECOUNT value on done: 712560.0 [2024-08-06 06:12:43,436][52663] Sum rewards: 83.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.388', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '67.000'} [2024-08-06 06:12:43,835][52669] DAMAGECOUNT value on done: 730604.0 [2024-08-06 06:12:43,837][52669] Sum rewards: 70.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.172', 'AMMO4': '0.180', 'weapon5': '0.186', 'AMMO3': '0.189', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:44,572][52671] DAMAGECOUNT value on done: 727956.0 [2024-08-06 06:12:44,573][52671] Sum rewards: 68.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.699', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.191', 'weapon2': '0.294', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.516', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '55.000'} [2024-08-06 06:12:45,209][52666] DAMAGECOUNT value on done: 717624.0 [2024-08-06 06:12:45,210][52666] Sum rewards: 74.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.806', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.086', 'AMMO3': '0.244', 'AMMO4': '0.266', 'weapon5': '0.282', 'weapon2': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:45,868][52650] Updated weights for policy 0, policy_version 67081 (0.0037) [2024-08-06 06:12:46,325][52663] DAMAGECOUNT value on done: 725594.0 [2024-08-06 06:12:46,327][52663] Sum rewards: 82.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.106', 'weapon5': '0.154', 'AMMO3': '0.180', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '66.000'} [2024-08-06 06:12:46,356][52670] DAMAGECOUNT value on done: 706466.0 [2024-08-06 06:12:46,356][52670] Sum rewards: 74.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.555', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.136', 'weapon5': '0.138', 'AMMO4': '0.167', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '62.500'} [2024-08-06 06:12:46,454][52658] DAMAGECOUNT value on done: 715841.0 [2024-08-06 06:12:46,454][52658] Sum rewards: 73.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.170', 'AMMO4': '0.198', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:46,697][52669] DAMAGECOUNT value on done: 723449.0 [2024-08-06 06:12:46,697][52669] Sum rewards: 70.087, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.414', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.168', 'AMMO4': '0.230', 'weapon5': '0.238', 'AMMO3': '0.283', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.906', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:46,761][52671] DAMAGECOUNT value on done: 723823.0 [2024-08-06 06:12:46,761][52671] Sum rewards: 74.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.998', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.104', 'AMMO4': '0.201', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 549560320. Throughput: 0: 4358.7. Samples: 137388130. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:47,795][52567] Avg episode reward: [(0, '74.079')] [2024-08-06 06:12:48,134][52665] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 06:12:48,161][52666] DAMAGECOUNT value on done: 711062.0 [2024-08-06 06:12:48,162][52666] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.450', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.088', 'AMMO3': '0.217', 'weapon5': '0.266', 'AMMO4': '0.272', 'weapon2': '0.344', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:48,831][52663] DAMAGECOUNT value on done: 719077.0 [2024-08-06 06:12:48,832][52663] Sum rewards: 77.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.180', 'AMMO3': '0.229', 'WEAPON3': '1.400', 'HITCOUNT': '3.500', 'weapon3': '3.504', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:49,234][52670] DAMAGECOUNT value on done: 718874.0 [2024-08-06 06:12:49,234][52670] Sum rewards: 71.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.030', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.243', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '3.476', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '62.000'} [2024-08-06 06:12:49,421][52669] DAMAGECOUNT value on done: 723637.0 [2024-08-06 06:12:49,421][52669] Sum rewards: 87.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.225', 'AMMO2': '0.022', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.245', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.460', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.234', 'FRAGCOUNT': '73.000'} [2024-08-06 06:12:49,580][52658] DAMAGECOUNT value on done: 724253.0 [2024-08-06 06:12:49,580][52658] Sum rewards: 69.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.072', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:49,630][52671] DAMAGECOUNT value on done: 715868.0 [2024-08-06 06:12:49,631][52671] Sum rewards: 61.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.012', 'AMMO5': '0.022', 'AMMO2': '0.071', 'AMMO3': '0.211', 'weapon5': '0.280', 'weapon4': '0.324', 'AMMO4': '0.356', 'weapon2': '0.426', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.608', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '52.000'} [2024-08-06 06:12:50,556][52650] Updated weights for policy 0, policy_version 67091 (0.0020) [2024-08-06 06:12:50,909][52666] DAMAGECOUNT value on done: 720119.0 [2024-08-06 06:12:50,910][52666] Sum rewards: 73.205, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.074', 'AMMO4': '0.118', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.460', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:51,958][52663] DAMAGECOUNT value on done: 720984.0 [2024-08-06 06:12:51,959][52663] Sum rewards: 77.923, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.235', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.152', 'weapon5': '0.152', 'AMMO4': '0.254', 'AMMO3': '0.262', 'weapon2': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '68.000'} [2024-08-06 06:12:52,117][52670] DAMAGECOUNT value on done: 705349.0 [2024-08-06 06:12:52,118][52670] Sum rewards: 82.710, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.243', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.464', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '69.000'} [2024-08-06 06:12:52,373][52669] DAMAGECOUNT value on done: 729418.0 [2024-08-06 06:12:52,373][52669] Sum rewards: 70.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.464', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.116', 'AMMO3': '0.231', 'AMMO4': '0.239', 'weapon5': '0.274', 'weapon2': '0.352', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.924', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '58.000'} [2024-08-06 06:12:52,453][52671] DAMAGECOUNT value on done: 724093.0 [2024-08-06 06:12:52,454][52671] Sum rewards: 85.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.649', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO4': '0.134', 'weapon4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '71.000'} [2024-08-06 06:12:52,526][52658] DAMAGECOUNT value on done: 715739.0 [2024-08-06 06:12:52,526][52658] Sum rewards: 72.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.140', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:52,795][52567] Fps is (10 sec: 16383.0, 60 sec: 17203.0, 300 sec: 17439.2). Total num frames: 549634048. Throughput: 0: 4353.3. Samples: 137414290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:12:52,796][52567] Avg episode reward: [(0, '74.271')] [2024-08-06 06:12:53,578][52666] DAMAGECOUNT value on done: 706606.0 [2024-08-06 06:12:53,578][52666] Sum rewards: 71.617, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.168', 'AMMO5': '0.026', 'AMMO2': '0.063', 'weapon4': '0.110', 'weapon5': '0.204', 'AMMO3': '0.248', 'AMMO4': '0.317', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.036', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '63.000'} [2024-08-06 06:12:54,244][52664] DAMAGECOUNT value on done: 745609.0 [2024-08-06 06:12:54,245][52664] Sum rewards: 74.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.502', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '63.000'} [2024-08-06 06:12:54,828][52658] DAMAGECOUNT value on done: 724591.0 [2024-08-06 06:12:54,831][52658] Sum rewards: 77.842, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.090', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '0.950', 'HEALTH': '1.241', 'weapon3': '3.198', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '60.000'} [2024-08-06 06:12:54,983][52670] DAMAGECOUNT value on done: 713758.0 [2024-08-06 06:12:54,983][52670] Sum rewards: 77.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.428', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.152', 'weapon4': '0.204', 'AMMO4': '0.215', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:55,354][52650] Updated weights for policy 0, policy_version 67101 (0.0026) [2024-08-06 06:12:55,358][52663] DAMAGECOUNT value on done: 722342.0 [2024-08-06 06:12:55,363][52663] Sum rewards: 84.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.220', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.424', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '69.000'} [2024-08-06 06:12:55,455][52671] DAMAGECOUNT value on done: 725793.0 [2024-08-06 06:12:55,455][52671] Sum rewards: 75.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.050', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.086', 'AMMO4': '0.165', 'weapon4': '0.180', 'weapon2': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.342', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:55,806][52669] DAMAGECOUNT value on done: 716048.0 [2024-08-06 06:12:55,808][52669] Sum rewards: 76.433, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.056', 'weapon4': '0.076', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '64.000'} [2024-08-06 06:12:56,635][52666] DAMAGECOUNT value on done: 720639.0 [2024-08-06 06:12:56,635][52666] Sum rewards: 71.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon2': '0.206', 'AMMO3': '0.240', 'weapon5': '0.266', 'weapon4': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:57,419][52664] DAMAGECOUNT value on done: 752834.0 [2024-08-06 06:12:57,420][52664] Sum rewards: 85.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.549', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.278', 'weapon2': '0.606', 'WEAPON3': '1.800', 'weapon3': '3.070', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '73.000'} [2024-08-06 06:12:57,590][52671] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:12:57,655][52668] DAMAGECOUNT value on done: 719844.0 [2024-08-06 06:12:57,656][52668] Sum rewards: 87.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.672', 'AMMO5': '0.004', 'weapon4': '0.010', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.257', 'weapon2': '0.268', 'WEAPON3': '1.650', 'weapon3': '3.502', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.870', 'FRAGCOUNT': '72.000'} [2024-08-06 06:12:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 549724160. Throughput: 0: 4365.6. Samples: 137440790. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:12:57,794][52567] Avg episode reward: [(0, '74.587')] [2024-08-06 06:12:57,812][52671] DAMAGECOUNT value on done: 723638.0 [2024-08-06 06:12:57,813][52671] Sum rewards: 80.828, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.806', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.193', 'weapon4': '0.260', 'WEAPON3': '1.150', 'weapon3': '3.278', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '65.000'} [2024-08-06 06:12:57,946][52658] DAMAGECOUNT value on done: 709601.0 [2024-08-06 06:12:57,951][52658] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.170', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.096', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.332', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.318', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '59.000'} [2024-08-06 06:12:58,056][52670] DAMAGECOUNT value on done: 720271.0 [2024-08-06 06:12:58,056][52670] Sum rewards: 65.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon5': '0.188', 'weapon4': '0.204', 'AMMO3': '0.230', 'AMMO4': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '2.884', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '56.000'} [2024-08-06 06:12:58,298][52663] DAMAGECOUNT value on done: 712781.0 [2024-08-06 06:12:58,298][52663] Sum rewards: 76.477, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.894', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.156', 'AMMO3': '0.173', 'weapon4': '0.180', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '61.000'} [2024-08-06 06:12:58,763][52669] DAMAGECOUNT value on done: 718362.0 [2024-08-06 06:12:58,765][52669] Sum rewards: 65.121, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.920', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.068', 'weapon5': '0.082', 'AMMO3': '0.091', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.600', 'weapon2': '1.130', 'weapon3': '2.608', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2024-08-06 06:12:59,828][52666] DAMAGECOUNT value on done: 712923.0 [2024-08-06 06:12:59,828][52666] Sum rewards: 67.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.354', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.108', 'weapon5': '0.180', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:00,422][52650] Updated weights for policy 0, policy_version 67111 (0.0016) [2024-08-06 06:13:00,638][52658] DAMAGECOUNT value on done: 725148.0 [2024-08-06 06:13:00,640][52658] Sum rewards: 66.617, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.794', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.216', 'weapon5': '0.222', 'AMMO3': '0.258', 'AMMO4': '0.278', 'weapon2': '0.292', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.922', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '58.000'} [2024-08-06 06:13:00,652][52664] DAMAGECOUNT value on done: 748417.0 [2024-08-06 06:13:00,652][52664] Sum rewards: 77.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.526', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.172', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.388', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '65.000'} [2024-08-06 06:13:00,697][52671] DAMAGECOUNT value on done: 731304.0 [2024-08-06 06:13:00,697][52671] Sum rewards: 80.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.199', 'weapon5': '0.208', 'AMMO4': '0.234', 'weapon2': '0.272', 'weapon4': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:00,893][52668] DAMAGECOUNT value on done: 724809.0 [2024-08-06 06:13:00,894][52668] Sum rewards: 71.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.675', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.156', 'AMMO3': '0.197', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '58.000'} [2024-08-06 06:13:01,066][52669] DAMAGECOUNT value on done: 721949.0 [2024-08-06 06:13:01,067][52669] Sum rewards: 75.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.150', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon4': '0.328', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '63.000'} [2024-08-06 06:13:01,336][52670] DAMAGECOUNT value on done: 715327.0 [2024-08-06 06:13:01,337][52670] Sum rewards: 80.421, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO4': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.664', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:02,794][52567] Fps is (10 sec: 18842.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 549822464. Throughput: 0: 4362.9. Samples: 137453740. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:02,794][52567] Avg episode reward: [(0, '74.409')] [2024-08-06 06:13:03,009][52666] DAMAGECOUNT value on done: 715063.0 [2024-08-06 06:13:03,011][52666] Sum rewards: 64.214, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.254', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.200', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '51.000'} [2024-08-06 06:13:03,114][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:13:03,193][52671] DAMAGECOUNT value on done: 725160.0 [2024-08-06 06:13:03,194][52671] Sum rewards: 70.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.122', 'AMMO4': '0.128', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:03,428][52668] DAMAGECOUNT value on done: 726427.0 [2024-08-06 06:13:03,428][52668] Sum rewards: 68.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.555', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.176', 'AMMO4': '0.185', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:03,562][52664] DAMAGECOUNT value on done: 742387.0 [2024-08-06 06:13:03,563][52664] Sum rewards: 81.682, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '3.156', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '69.000'} [2024-08-06 06:13:03,718][52658] DAMAGECOUNT value on done: 716747.0 [2024-08-06 06:13:03,720][52658] Sum rewards: 75.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.316', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO4': '0.144', 'weapon2': '0.198', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:04,224][52669] DAMAGECOUNT value on done: 742021.0 [2024-08-06 06:13:04,224][52669] Sum rewards: 82.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '67.000'} [2024-08-06 06:13:04,561][52670] DAMAGECOUNT value on done: 698389.0 [2024-08-06 06:13:04,565][52670] Sum rewards: 77.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.645', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.090', 'AMMO4': '0.191', 'AMMO3': '0.206', 'weapon5': '0.226', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:04,599][52650] Updated weights for policy 0, policy_version 67121 (0.0026) [2024-08-06 06:13:05,749][52671] DAMAGECOUNT value on done: 712308.0 [2024-08-06 06:13:05,760][52671] Sum rewards: 73.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.312', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.186', 'AMMO3': '0.209', 'weapon4': '0.316', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '62.000'} [2024-08-06 06:13:06,100][52666] DAMAGECOUNT value on done: 708571.0 [2024-08-06 06:13:06,101][52666] Sum rewards: 63.001, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.010', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon4': '0.128', 'weapon5': '0.150', 'AMMO3': '0.303', 'AMMO4': '0.321', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.554', 'WEAPON3': '1.750', 'weapon3': '2.776', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:06,211][52664] DAMAGECOUNT value on done: 754197.0 [2024-08-06 06:13:06,211][52664] Sum rewards: 59.535, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.098', 'AMMO4': '0.123', 'weapon4': '0.188', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.600', 'HITCOUNT': '3.080', 'weapon3': '3.084', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '53.000'} [2024-08-06 06:13:06,527][52658] DAMAGECOUNT value on done: 719062.0 [2024-08-06 06:13:06,527][52658] Sum rewards: 63.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.098', 'AMMO4': '0.161', 'weapon5': '0.166', 'weapon2': '0.232', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.188', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '55.000'} [2024-08-06 06:13:06,576][52668] DAMAGECOUNT value on done: 728088.0 [2024-08-06 06:13:06,578][52668] Sum rewards: 77.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.104', 'AMMO4': '0.144', 'weapon4': '0.146', 'AMMO3': '0.171', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '62.000'} [2024-08-06 06:13:06,755][52669] DAMAGECOUNT value on done: 732293.0 [2024-08-06 06:13:06,756][52669] Sum rewards: 85.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.768', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.054', 'AMMO4': '0.147', 'weapon5': '0.164', 'weapon2': '0.202', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.344', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.342', 'FRAGCOUNT': '70.000'} [2024-08-06 06:13:07,214][52670] DAMAGECOUNT value on done: 708978.0 [2024-08-06 06:13:07,215][52670] Sum rewards: 73.153, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.038', 'HEALTH': '0.092', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.201', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.202', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:07,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 549912576. Throughput: 0: 4365.4. Samples: 137480150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:07,794][52567] Avg episode reward: [(0, '74.522')] [2024-08-06 06:13:08,517][52666] DAMAGECOUNT value on done: 711606.0 [2024-08-06 06:13:08,518][52666] Sum rewards: 61.523, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.803', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.090', 'weapon5': '0.222', 'AMMO4': '0.261', 'AMMO3': '0.297', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.806', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '54.000'} [2024-08-06 06:13:08,812][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:13:08,901][52671] DAMAGECOUNT value on done: 730722.0 [2024-08-06 06:13:08,901][52671] Sum rewards: 70.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.996', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'AMMO3': '0.186', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:09,009][52664] DAMAGECOUNT value on done: 746310.0 [2024-08-06 06:13:09,009][52664] Sum rewards: 73.991, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.684', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.194', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '2.898', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '62.000'} [2024-08-06 06:13:09,457][52669] DAMAGECOUNT value on done: 725186.0 [2024-08-06 06:13:09,459][52669] Sum rewards: 68.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.482', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon2': '0.196', 'weapon4': '0.196', 'AMMO3': '0.218', 'weapon5': '0.264', 'AMMO4': '0.321', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '2.998', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:09,581][52658] DAMAGECOUNT value on done: 722887.0 [2024-08-06 06:13:09,581][52658] Sum rewards: 85.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.210', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.160', 'AMMO3': '0.176', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '67.000'} [2024-08-06 06:13:09,643][52668] DAMAGECOUNT value on done: 711821.0 [2024-08-06 06:13:09,646][52668] Sum rewards: 76.391, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.164', 'AMMO4': '0.167', 'weapon2': '0.174', 'weapon4': '0.190', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '66.000'} [2024-08-06 06:13:09,709][52670] DAMAGECOUNT value on done: 717474.0 [2024-08-06 06:13:09,713][52670] Sum rewards: 82.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.486', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.078', 'weapon5': '0.210', 'AMMO3': '0.240', 'AMMO4': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '67.500'} [2024-08-06 06:13:09,763][52650] Updated weights for policy 0, policy_version 67131 (0.0024) [2024-08-06 06:13:11,306][52662] DAMAGECOUNT value on done: 723323.0 [2024-08-06 06:13:11,306][52662] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO5': '0.010', 'weapon4': '0.022', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 06:13:11,306][52666] DAMAGECOUNT value on done: 725637.0 [2024-08-06 06:13:11,315][52666] Sum rewards: 90.679, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.158', 'weapon4': '0.160', 'AMMO3': '0.185', 'AMMO4': '0.253', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.126', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '73.000'} [2024-08-06 06:13:11,409][52671] DAMAGECOUNT value on done: 728860.0 [2024-08-06 06:13:11,411][52671] Sum rewards: 80.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.444', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.140', 'AMMO3': '0.194', 'AMMO4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:11,743][52664] DAMAGECOUNT value on done: 742719.0 [2024-08-06 06:13:11,743][52664] Sum rewards: 67.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.080', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON3': '1.600', 'HITCOUNT': '3.360', 'weapon3': '3.506', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '58.000'} [2024-08-06 06:13:12,044][52669] DAMAGECOUNT value on done: 728021.0 [2024-08-06 06:13:12,045][52669] Sum rewards: 68.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.795', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.056', 'weapon5': '0.086', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.476', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.130', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '56.000'} [2024-08-06 06:13:12,595][52670] DAMAGECOUNT value on done: 714261.0 [2024-08-06 06:13:12,598][52670] Sum rewards: 75.150, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO2': '0.004', 'weapon7': '0.012', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.176', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '62.000'} [2024-08-06 06:13:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 549986304. Throughput: 0: 4360.0. Samples: 137506220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:12,794][52567] Avg episode reward: [(0, '74.552')] [2024-08-06 06:13:12,800][52668] DAMAGECOUNT value on done: 726535.0 [2024-08-06 06:13:12,802][52668] Sum rewards: 76.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.148', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon2': '0.166', 'AMMO3': '0.198', 'weapon5': '0.220', 'weapon4': '0.258', 'AMMO4': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:13,922][52650] Updated weights for policy 0, policy_version 67141 (0.0020) [2024-08-06 06:13:14,257][52671] DAMAGECOUNT value on done: 727585.0 [2024-08-06 06:13:14,260][52671] Sum rewards: 69.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '58.000'} [2024-08-06 06:13:14,299][52664] DAMAGECOUNT value on done: 736379.0 [2024-08-06 06:13:14,299][52664] Sum rewards: 67.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.332', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.184', 'AMMO3': '0.187', 'weapon2': '0.296', 'AMMO4': '0.317', 'weapon5': '0.334', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.790', 'weapon3': '2.886', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '55.000'} [2024-08-06 06:13:14,393][52666] DAMAGECOUNT value on done: 700701.0 [2024-08-06 06:13:14,393][52666] Sum rewards: 68.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.176', 'AMMO3': '0.187', 'weapon5': '0.192', 'AMMO4': '0.195', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:14,494][52662] DAMAGECOUNT value on done: 727716.0 [2024-08-06 06:13:14,495][52662] Sum rewards: 74.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.427', 'AMMO5': '0.004', 'weapon5': '0.036', 'AMMO2': '0.047', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'AMMO4': '0.234', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '60.000'} [2024-08-06 06:13:14,800][52669] DAMAGECOUNT value on done: 730471.0 [2024-08-06 06:13:14,801][52669] Sum rewards: 70.768, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.610', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.102', 'weapon5': '0.110', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.314', 'weapon2': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.072', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '63.000'} [2024-08-06 06:13:15,402][52670] DAMAGECOUNT value on done: 717001.0 [2024-08-06 06:13:15,403][52670] Sum rewards: 66.017, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.638', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.100', 'AMMO4': '0.225', 'AMMO3': '0.273', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.180', 'weapon3': '3.262', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:15,514][52668] DAMAGECOUNT value on done: 725721.0 [2024-08-06 06:13:15,514][52668] Sum rewards: 79.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.152', 'AMMO4': '0.196', 'weapon5': '0.220', 'weapon2': '0.224', 'AMMO3': '0.275', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.098', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '67.000'} [2024-08-06 06:13:17,066][52666] DAMAGECOUNT value on done: 713035.0 [2024-08-06 06:13:17,068][52666] Sum rewards: 82.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.201', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '67.000'} [2024-08-06 06:13:17,129][52671] DAMAGECOUNT value on done: 728953.0 [2024-08-06 06:13:17,130][52671] Sum rewards: 61.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.180', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '52.000'} [2024-08-06 06:13:17,400][52662] DAMAGECOUNT value on done: 730930.0 [2024-08-06 06:13:17,400][52662] Sum rewards: 72.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.072', 'weapon5': '0.098', 'AMMO4': '0.136', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.362', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '60.000'} [2024-08-06 06:13:17,414][52664] DAMAGECOUNT value on done: 752264.0 [2024-08-06 06:13:17,416][52664] Sum rewards: 77.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.181', 'AMMO3': '0.198', 'weapon2': '0.274', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 550076416. Throughput: 0: 4374.5. Samples: 137519470. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:17,794][52567] Avg episode reward: [(0, '74.662')] [2024-08-06 06:13:18,213][52668] DAMAGECOUNT value on done: 717851.0 [2024-08-06 06:13:18,213][52668] Sum rewards: 72.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.074', 'AMMO4': '0.194', 'AMMO3': '0.201', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:19,014][52650] Updated weights for policy 0, policy_version 67151 (0.0011) [2024-08-06 06:13:19,999][52662] DAMAGECOUNT value on done: 715578.0 [2024-08-06 06:13:20,003][52662] Sum rewards: 72.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.612', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.176', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.282', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '58.000'} [2024-08-06 06:13:20,392][52664] DAMAGECOUNT value on done: 742620.0 [2024-08-06 06:13:20,393][52664] Sum rewards: 79.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.983', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.080', 'AMMO4': '0.081', 'weapon5': '0.120', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '65.000'} [2024-08-06 06:13:20,404][52671] DAMAGECOUNT value on done: 721029.0 [2024-08-06 06:13:20,405][52671] Sum rewards: 65.844, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.050', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.092', 'weapon5': '0.172', 'AMMO4': '0.224', 'weapon2': '0.226', 'AMMO3': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.950', 'weapon3': '3.200', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:21,095][52668] DAMAGECOUNT value on done: 717108.0 [2024-08-06 06:13:21,095][52668] Sum rewards: 71.291, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.708', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.132', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '62.000'} [2024-08-06 06:13:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 550174720. Throughput: 0: 4380.4. Samples: 137545760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:22,794][52567] Avg episode reward: [(0, '74.345')] [2024-08-06 06:13:22,872][52664] DAMAGECOUNT value on done: 754413.0 [2024-08-06 06:13:22,872][52664] Sum rewards: 76.328, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.594', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.650', 'weapon3': '3.336', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:23,212][52662] DAMAGECOUNT value on done: 732540.0 [2024-08-06 06:13:23,214][52662] Sum rewards: 75.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.777', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'weapon4': '0.044', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.000'} [2024-08-06 06:13:23,457][52650] Updated weights for policy 0, policy_version 67161 (0.0011) [2024-08-06 06:13:24,237][52614] Signal inference workers to stop experience collection... (12250 times) [2024-08-06 06:13:24,237][52614] Signal inference workers to resume experience collection... (12250 times) [2024-08-06 06:13:24,285][52650] InferenceWorker_p0-w0: stopping experience collection (12250 times) [2024-08-06 06:13:24,297][52650] InferenceWorker_p0-w0: resuming experience collection (12250 times) [2024-08-06 06:13:24,321][52668] DAMAGECOUNT value on done: 725782.0 [2024-08-06 06:13:24,324][52668] Sum rewards: 71.459, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.250', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.158', 'AMMO4': '0.159', 'weapon5': '0.186', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '0.950', 'weapon3': '2.818', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:25,283][52664] DAMAGECOUNT value on done: 753382.0 [2024-08-06 06:13:25,283][52664] Sum rewards: 71.512, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.335', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.216', 'AMMO3': '0.264', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '61.000'} [2024-08-06 06:13:26,245][52662] DAMAGECOUNT value on done: 715339.0 [2024-08-06 06:13:26,248][52662] Sum rewards: 62.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.021', 'AMMO2': '0.065', 'AMMO3': '0.197', 'weapon5': '0.232', 'weapon4': '0.256', 'weapon2': '0.326', 'AMMO4': '0.327', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '50.000'} [2024-08-06 06:13:27,523][52668] DAMAGECOUNT value on done: 721694.0 [2024-08-06 06:13:27,523][52668] Sum rewards: 69.620, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO4': '0.176', 'weapon4': '0.236', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '58.500'} [2024-08-06 06:13:27,758][52664] DAMAGECOUNT value on done: 752768.0 [2024-08-06 06:13:27,758][52664] Sum rewards: 64.596, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.322', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '56.000'} [2024-08-06 06:13:27,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 550256640. Throughput: 0: 4382.2. Samples: 137572150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:27,795][52567] Avg episode reward: [(0, '73.897')] [2024-08-06 06:13:28,169][52650] Updated weights for policy 0, policy_version 67171 (0.0011) [2024-08-06 06:13:28,626][52662] DAMAGECOUNT value on done: 721273.0 [2024-08-06 06:13:28,630][52662] Sum rewards: 61.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.019', 'AMMO2': '0.063', 'AMMO3': '0.166', 'weapon4': '0.196', 'weapon5': '0.196', 'AMMO4': '0.314', 'weapon2': '0.486', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.868', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '51.000'} [2024-08-06 06:13:30,318][52664] DAMAGECOUNT value on done: 757492.0 [2024-08-06 06:13:30,320][52664] Sum rewards: 84.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.383', 'AMMO5': '0.021', 'AMMO2': '0.073', 'AMMO3': '0.138', 'weapon5': '0.310', 'AMMO4': '0.366', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.564', 'WEAPON3': '0.850', 'weapon3': '2.388', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '66.000'} [2024-08-06 06:13:30,582][52668] DAMAGECOUNT value on done: 714442.0 [2024-08-06 06:13:30,583][52668] Sum rewards: 76.258, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.197', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.110', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '3.120', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 06:13:31,580][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:13:31,834][52662] DAMAGECOUNT value on done: 734210.0 [2024-08-06 06:13:31,834][52662] Sum rewards: 86.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.060', 'weapon4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.802', 'FRAGCOUNT': '73.000'} [2024-08-06 06:13:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 550338560. Throughput: 0: 4380.5. Samples: 137585250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:32,802][52567] Avg episode reward: [(0, '73.935')] [2024-08-06 06:13:32,946][52650] Updated weights for policy 0, policy_version 67181 (0.0014) [2024-08-06 06:13:32,980][52664] DAMAGECOUNT value on done: 758761.0 [2024-08-06 06:13:32,980][52664] Sum rewards: 82.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.196', 'WEAPON3': '1.250', 'weapon3': '3.456', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '67.000'} [2024-08-06 06:13:33,882][52668] DAMAGECOUNT value on done: 707591.0 [2024-08-06 06:13:33,883][52668] Sum rewards: 73.384, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.668', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.088', 'weapon2': '0.154', 'AMMO3': '0.172', 'AMMO4': '0.200', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.324', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:34,097][52662] DAMAGECOUNT value on done: 723418.0 [2024-08-06 06:13:34,098][52662] Sum rewards: 76.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.096', 'weapon5': '0.122', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON3': '1.500', 'HITCOUNT': '3.380', 'weapon3': '3.408', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '66.000'} [2024-08-06 06:13:35,419][52664] DAMAGECOUNT value on done: 752737.0 [2024-08-06 06:13:35,419][52664] Sum rewards: 79.096, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.144', 'AMMO4': '0.165', 'weapon5': '0.184', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '2.908', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '67.000'} [2024-08-06 06:13:37,188][52668] DAMAGECOUNT value on done: 709668.0 [2024-08-06 06:13:37,189][52668] Sum rewards: 75.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.134', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.190', 'AMMO3': '0.231', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '62.000'} [2024-08-06 06:13:37,211][52662] DAMAGECOUNT value on done: 730495.0 [2024-08-06 06:13:37,212][52662] Sum rewards: 68.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.232', 'AMMO3': '0.234', 'weapon4': '0.240', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:37,255][52650] Updated weights for policy 0, policy_version 67191 (0.0014) [2024-08-06 06:13:37,410][52660] DAMAGECOUNT value on done: 721926.0 [2024-08-06 06:13:37,410][52660] Sum rewards: 66.900, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.822', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.097', 'weapon2': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'weapon4': '0.238', 'WEAPON3': '0.950', 'HITCOUNT': '3.410', 'weapon3': '3.474', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '53.000'} [2024-08-06 06:13:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 550428672. Throughput: 0: 4380.5. Samples: 137611410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:13:37,794][52567] Avg episode reward: [(0, '73.873')] [2024-08-06 06:13:37,820][52664] DAMAGECOUNT value on done: 744507.0 [2024-08-06 06:13:37,820][52664] Sum rewards: 61.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon5': '0.200', 'AMMO3': '0.281', 'AMMO4': '0.292', 'weapon4': '0.322', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.786', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '53.000'} [2024-08-06 06:13:38,207][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:13:38,227][52811] Large shaping reward 2.558 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.084, -28.0), ('weapon5', 0.002)] [2024-08-06 06:13:39,718][52668] DAMAGECOUNT value on done: 708835.0 [2024-08-06 06:13:39,718][52668] Sum rewards: 69.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.038', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:39,960][52660] DAMAGECOUNT value on done: 711558.0 [2024-08-06 06:13:39,961][52660] Sum rewards: 78.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.064', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '65.000'} [2024-08-06 06:13:40,084][52662] DAMAGECOUNT value on done: 718823.0 [2024-08-06 06:13:40,084][52662] Sum rewards: 74.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon5': '0.160', 'weapon2': '0.190', 'AMMO4': '0.224', 'AMMO3': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.386', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '62.000'} [2024-08-06 06:13:40,570][52664] DAMAGECOUNT value on done: 745694.0 [2024-08-06 06:13:40,570][52664] Sum rewards: 63.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.213', 'AMMO4': '0.248', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '2.858', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '54.000'} [2024-08-06 06:13:42,170][52650] Updated weights for policy 0, policy_version 67201 (0.0012) [2024-08-06 06:13:42,248][52668] DAMAGECOUNT value on done: 719953.0 [2024-08-06 06:13:42,249][52668] Sum rewards: 61.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.584', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.068', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.172', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '51.000'} [2024-08-06 06:13:42,430][52660] DAMAGECOUNT value on done: 724186.0 [2024-08-06 06:13:42,431][52660] Sum rewards: 73.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.174', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.620', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '63.000'} [2024-08-06 06:13:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 550518784. Throughput: 0: 4374.2. Samples: 137637630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:13:42,802][52567] Avg episode reward: [(0, '73.579')] [2024-08-06 06:13:42,970][52662] DAMAGECOUNT value on done: 719560.0 [2024-08-06 06:13:42,970][52662] Sum rewards: 64.936, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.105', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO3': '0.166', 'AMMO4': '0.168', 'weapon4': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.000', 'weapon3': '2.908', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '50.000'} [2024-08-06 06:13:43,288][52647] DAMAGECOUNT value on done: 764040.0 [2024-08-06 06:13:43,288][52647] Sum rewards: 77.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.044', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '63.000'} [2024-08-06 06:13:43,331][52664] DAMAGECOUNT value on done: 748064.0 [2024-08-06 06:13:43,332][52664] Sum rewards: 76.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.128', 'AMMO4': '0.165', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:43,705][52649] DAMAGECOUNT value on done: 700690.0 [2024-08-06 06:13:43,705][52649] Sum rewards: 76.697, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.138', 'weapon5': '0.146', 'AMMO4': '0.155', 'weapon2': '0.176', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '66.000'} [2024-08-06 06:13:45,080][52668] DAMAGECOUNT value on done: 717487.0 [2024-08-06 06:13:45,081][52668] Sum rewards: 69.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.150', 'weapon4': '0.212', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '58.000'} [2024-08-06 06:13:45,248][52660] DAMAGECOUNT value on done: 732653.0 [2024-08-06 06:13:45,248][52660] Sum rewards: 74.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.042', 'weapon4': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '61.000'} [2024-08-06 06:13:45,704][52662] DAMAGECOUNT value on done: 717387.0 [2024-08-06 06:13:45,704][52662] Sum rewards: 71.322, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.280', 'AMMO5': '0.022', 'weapon4': '0.058', 'weapon5': '0.058', 'AMMO2': '0.058', 'AMMO3': '0.266', 'AMMO4': '0.291', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:45,865][52647] DAMAGECOUNT value on done: 755151.0 [2024-08-06 06:13:45,865][52647] Sum rewards: 72.758, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.118', 'weapon4': '0.154', 'AMMO3': '0.240', 'AMMO4': '0.255', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '61.000'} [2024-08-06 06:13:45,975][52664] DAMAGECOUNT value on done: 746275.0 [2024-08-06 06:13:45,975][52664] Sum rewards: 75.574, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.500', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.096', 'weapon4': '0.128', 'AMMO4': '0.175', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.650', 'weapon3': '3.178', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '66.000'} [2024-08-06 06:13:46,684][52649] DAMAGECOUNT value on done: 692559.0 [2024-08-06 06:13:46,685][52649] Sum rewards: 67.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.396', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.090', 'weapon5': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:46,911][52650] Updated weights for policy 0, policy_version 67211 (0.0021) [2024-08-06 06:13:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 550608896. Throughput: 0: 4373.3. Samples: 137650540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:13:47,802][52567] Avg episode reward: [(0, '73.321')] [2024-08-06 06:13:48,499][52668] DAMAGECOUNT value on done: 720087.0 [2024-08-06 06:13:48,500][52668] Sum rewards: 78.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.037', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.246', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.364', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '65.000'} [2024-08-06 06:13:48,655][52660] DAMAGECOUNT value on done: 716340.0 [2024-08-06 06:13:48,657][52660] Sum rewards: 72.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.575', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.105', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '60.000'} [2024-08-06 06:13:48,828][52662] DAMAGECOUNT value on done: 726043.0 [2024-08-06 06:13:48,829][52662] Sum rewards: 73.041, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.313', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.296', 'weapon2': '0.334', 'WEAPON3': '0.900', 'weapon3': '3.036', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:48,945][52647] DAMAGECOUNT value on done: 763557.0 [2024-08-06 06:13:48,945][52647] Sum rewards: 63.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.744', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.116', 'weapon5': '0.162', 'AMMO4': '0.188', 'weapon2': '0.234', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.206', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '54.000'} [2024-08-06 06:13:49,368][52649] DAMAGECOUNT value on done: 711422.0 [2024-08-06 06:13:49,369][52649] Sum rewards: 74.034, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.800', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.068', 'weapon5': '0.146', 'weapon2': '0.232', 'AMMO4': '0.245', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.304', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '63.000'} [2024-08-06 06:13:49,425][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:13:50,424][52663] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:13:51,315][52650] Updated weights for policy 0, policy_version 67221 (0.0024) [2024-08-06 06:13:51,366][52668] DAMAGECOUNT value on done: 724458.0 [2024-08-06 06:13:51,369][52668] Sum rewards: 87.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.541', 'AMMO5': '0.010', 'ARMOR': '0.012', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.384', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '73.000'} [2024-08-06 06:13:51,468][52660] DAMAGECOUNT value on done: 712676.0 [2024-08-06 06:13:51,469][52660] Sum rewards: 82.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.748', 'AMMO5': '0.019', 'AMMO2': '0.078', 'weapon4': '0.088', 'weapon5': '0.214', 'AMMO3': '0.222', 'weapon2': '0.342', 'AMMO4': '0.392', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '69.000'} [2024-08-06 06:13:51,481][52662] DAMAGECOUNT value on done: 717058.0 [2024-08-06 06:13:51,481][52662] Sum rewards: 82.357, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.058', 'AMMO4': '0.192', 'AMMO3': '0.231', 'weapon5': '0.232', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '68.000'} [2024-08-06 06:13:51,940][52647] DAMAGECOUNT value on done: 762369.0 [2024-08-06 06:13:51,942][52647] Sum rewards: 80.014, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.124', 'AMMO4': '0.150', 'weapon5': '0.206', 'weapon2': '0.222', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '67.000'} [2024-08-06 06:13:52,441][52649] DAMAGECOUNT value on done: 706127.0 [2024-08-06 06:13:52,441][52649] Sum rewards: 66.435, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.790', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.140', 'weapon5': '0.172', 'AMMO3': '0.268', 'AMMO4': '0.307', 'WEAPON5': '0.450', 'weapon2': '0.508', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.866', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:52,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 550690816. Throughput: 0: 4372.4. Samples: 137676910. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:13:52,803][52567] Avg episode reward: [(0, '73.023')] [2024-08-06 06:13:54,345][52662] DAMAGECOUNT value on done: 730816.0 [2024-08-06 06:13:54,347][52662] Sum rewards: 70.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.176', 'AMMO4': '0.197', 'AMMO3': '0.209', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '57.000'} [2024-08-06 06:13:54,566][52647] DAMAGECOUNT value on done: 768218.0 [2024-08-06 06:13:54,567][52647] Sum rewards: 66.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.165', 'weapon5': '0.174', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.206', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '55.000'} [2024-08-06 06:13:54,622][52668] DAMAGECOUNT value on done: 724176.0 [2024-08-06 06:13:54,622][52668] Sum rewards: 93.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.178', 'AMMO3': '0.258', 'WEAPON3': '1.450', 'weapon3': '3.546', 'HITCOUNT': '4.300', 'DAMAGECOUNT': '22.140', 'FRAGCOUNT': '78.000'} [2024-08-06 06:13:54,805][52660] DAMAGECOUNT value on done: 719263.0 [2024-08-06 06:13:54,806][52660] Sum rewards: 75.739, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.095', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.154', 'weapon5': '0.214', 'AMMO4': '0.245', 'AMMO3': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '2.976', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '66.000'} [2024-08-06 06:13:55,625][52649] DAMAGECOUNT value on done: 695132.0 [2024-08-06 06:13:55,625][52649] Sum rewards: 80.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.175', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.111', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '65.000'} [2024-08-06 06:13:56,247][52650] Updated weights for policy 0, policy_version 67231 (0.0018) [2024-08-06 06:13:56,983][52662] DAMAGECOUNT value on done: 726071.0 [2024-08-06 06:13:56,985][52662] Sum rewards: 67.424, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.150', 'AMMO5': '0.018', 'AMMO2': '0.033', 'AMMO3': '0.154', 'AMMO4': '0.167', 'weapon4': '0.216', 'weapon5': '0.274', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.928', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '52.500'} [2024-08-06 06:13:57,177][52647] DAMAGECOUNT value on done: 767005.0 [2024-08-06 06:13:57,179][52647] Sum rewards: 76.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.078', 'weapon5': '0.208', 'AMMO3': '0.239', 'AMMO4': '0.255', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '64.000'} [2024-08-06 06:13:57,571][52660] DAMAGECOUNT value on done: 727854.0 [2024-08-06 06:13:57,572][52660] Sum rewards: 70.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.166', 'AMMO4': '0.192', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '58.000'} [2024-08-06 06:13:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 550780928. Throughput: 0: 4372.0. Samples: 137702960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:13:57,794][52567] Avg episode reward: [(0, '73.364')] [2024-08-06 06:13:57,844][52811] DAMAGECOUNT value on done: 687055.0 [2024-08-06 06:13:57,846][52811] Sum rewards: 76.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.601', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.172', 'AMMO3': '0.218', 'weapon2': '0.516', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '63.000'} [2024-08-06 06:13:58,805][52649] DAMAGECOUNT value on done: 710178.0 [2024-08-06 06:13:58,805][52649] Sum rewards: 71.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.801', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.140', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.200', 'HITCOUNT': '3.300', 'weapon3': '3.324', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '59.000'} [2024-08-06 06:13:59,489][52647] DAMAGECOUNT value on done: 766074.0 [2024-08-06 06:13:59,489][52647] Sum rewards: 71.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon2': '0.132', 'AMMO4': '0.194', 'weapon5': '0.234', 'AMMO3': '0.244', 'weapon4': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '60.000'} [2024-08-06 06:13:59,855][52662] DAMAGECOUNT value on done: 713211.0 [2024-08-06 06:13:59,856][52662] Sum rewards: 72.684, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.394', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.118', 'weapon5': '0.226', 'AMMO3': '0.229', 'AMMO4': '0.247', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '61.000'} [2024-08-06 06:14:00,629][52660] DAMAGECOUNT value on done: 714534.0 [2024-08-06 06:14:00,630][52660] Sum rewards: 70.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.792', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.082', 'AMMO3': '0.185', 'AMMO4': '0.189', 'weapon5': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.628', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:00,731][52650] Updated weights for policy 0, policy_version 67241 (0.0012) [2024-08-06 06:14:00,960][52811] DAMAGECOUNT value on done: 669046.0 [2024-08-06 06:14:00,960][52811] Sum rewards: 73.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.436', 'AMMO5': '0.020', 'AMMO2': '0.062', 'AMMO3': '0.194', 'weapon2': '0.204', 'weapon4': '0.278', 'weapon5': '0.288', 'AMMO4': '0.310', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:01,798][52649] DAMAGECOUNT value on done: 704315.0 [2024-08-06 06:14:01,798][52649] Sum rewards: 79.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.232', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 06:14:02,007][52647] DAMAGECOUNT value on done: 747979.0 [2024-08-06 06:14:02,009][52647] Sum rewards: 69.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.772', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.198', 'weapon5': '0.204', 'AMMO3': '0.223', 'AMMO4': '0.227', 'weapon2': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 06:14:02,554][52662] DAMAGECOUNT value on done: 723326.0 [2024-08-06 06:14:02,556][52662] Sum rewards: 78.451, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.802', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.210', 'weapon5': '0.218', 'AMMO4': '0.221', 'weapon4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.782', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:02,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 550871040. Throughput: 0: 4371.1. Samples: 137716170. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:14:02,794][52567] Avg episode reward: [(0, '73.290')] [2024-08-06 06:14:03,667][52660] DAMAGECOUNT value on done: 716660.0 [2024-08-06 06:14:03,667][52660] Sum rewards: 70.731, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.026', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.101', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:04,075][52811] DAMAGECOUNT value on done: 668325.0 [2024-08-06 06:14:04,075][52811] Sum rewards: 74.236, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.386', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.249', 'weapon5': '0.256', 'AMMO4': '0.262', 'weapon4': '0.360', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:04,365][52647] DAMAGECOUNT value on done: 763016.0 [2024-08-06 06:14:04,368][52647] Sum rewards: 74.602, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.056', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.060', 'AMMO3': '0.155', 'weapon5': '0.210', 'AMMO4': '0.215', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.230', 'weapon3': '3.254', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:04,962][52649] DAMAGECOUNT value on done: 705829.0 [2024-08-06 06:14:04,963][52649] Sum rewards: 73.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.065', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.624', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:05,438][52650] Updated weights for policy 0, policy_version 67251 (0.0015) [2024-08-06 06:14:05,671][52662] DAMAGECOUNT value on done: 712066.0 [2024-08-06 06:14:05,672][52662] Sum rewards: 53.102, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.390', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon2': '0.216', 'weapon4': '0.224', 'AMMO4': '0.234', 'weapon5': '0.236', 'AMMO3': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '2.840', 'weapon3': '3.006', 'DAMAGECOUNT': '15.186', 'FRAGCOUNT': '48.000'} [2024-08-06 06:14:06,114][52660] DAMAGECOUNT value on done: 722332.0 [2024-08-06 06:14:06,115][52660] Sum rewards: 78.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.023', 'AMMO2': '0.071', 'weapon4': '0.104', 'AMMO3': '0.207', 'weapon5': '0.220', 'weapon2': '0.266', 'AMMO4': '0.352', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '65.500'} [2024-08-06 06:14:06,696][52659] DAMAGECOUNT value on done: 724553.0 [2024-08-06 06:14:06,697][52659] Sum rewards: 76.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.094', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.134', 'weapon5': '0.156', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:07,163][52811] DAMAGECOUNT value on done: 670465.0 [2024-08-06 06:14:07,165][52811] Sum rewards: 65.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.920', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.173', 'weapon5': '0.176', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '54.000'} [2024-08-06 06:14:07,195][52647] DAMAGECOUNT value on done: 761766.0 [2024-08-06 06:14:07,196][52647] Sum rewards: 70.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.118', 'weapon4': '0.122', 'weapon2': '0.168', 'AMMO3': '0.218', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 550952960. Throughput: 0: 4376.9. Samples: 137742720. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:14:07,794][52567] Avg episode reward: [(0, '73.315')] [2024-08-06 06:14:08,044][52820] DAMAGECOUNT value on done: 668256.0 [2024-08-06 06:14:08,048][52820] Sum rewards: 76.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.068', 'AMMO4': '0.104', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:08,114][52649] DAMAGECOUNT value on done: 706351.0 [2024-08-06 06:14:08,116][52649] Sum rewards: 73.313, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.366', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.160', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'AMMO3': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.252', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:08,228][52795] DAMAGECOUNT value on done: 672425.0 [2024-08-06 06:14:08,229][52795] Sum rewards: 78.922, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.298', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.194', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '69.000'} [2024-08-06 06:14:09,519][52660] DAMAGECOUNT value on done: 713925.0 [2024-08-06 06:14:09,519][52660] Sum rewards: 77.132, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.592', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.234', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.444', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:09,644][52647] DAMAGECOUNT value on done: 759424.0 [2024-08-06 06:14:09,644][52647] Sum rewards: 80.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'weapon2': '0.216', 'AMMO3': '0.220', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '67.000'} [2024-08-06 06:14:09,653][52659] DAMAGECOUNT value on done: 722654.0 [2024-08-06 06:14:09,653][52659] Sum rewards: 66.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.168', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.090', 'weapon5': '0.176', 'AMMO4': '0.186', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.098', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '54.000'} [2024-08-06 06:14:10,354][52811] DAMAGECOUNT value on done: 678864.0 [2024-08-06 06:14:10,355][52811] Sum rewards: 84.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.245', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.205', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.498', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '69.000'} [2024-08-06 06:14:10,539][52650] Updated weights for policy 0, policy_version 67261 (0.0012) [2024-08-06 06:14:11,002][52649] DAMAGECOUNT value on done: 698261.0 [2024-08-06 06:14:11,004][52649] Sum rewards: 71.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.093', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.148', 'AMMO3': '0.181', 'weapon5': '0.192', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:11,093][52820] DAMAGECOUNT value on done: 670068.0 [2024-08-06 06:14:11,096][52820] Sum rewards: 82.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.155', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.231', 'weapon2': '0.380', 'WEAPON3': '1.600', 'weapon3': '3.482', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '69.000'} [2024-08-06 06:14:11,344][52795] DAMAGECOUNT value on done: 659624.0 [2024-08-06 06:14:11,347][52795] Sum rewards: 82.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.138', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'AMMO3': '0.279', 'WEAPON3': '1.750', 'weapon3': '3.192', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '21.156', 'FRAGCOUNT': '69.000'} [2024-08-06 06:14:12,007][52660] DAMAGECOUNT value on done: 720174.0 [2024-08-06 06:14:12,008][52660] Sum rewards: 84.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.197', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.586', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '71.000'} [2024-08-06 06:14:12,296][52647] DAMAGECOUNT value on done: 753019.0 [2024-08-06 06:14:12,296][52647] Sum rewards: 67.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.745', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.080', 'weapon5': '0.220', 'AMMO4': '0.275', 'AMMO3': '0.311', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.850', 'weapon3': '2.894', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:12,367][52659] DAMAGECOUNT value on done: 726299.0 [2024-08-06 06:14:12,367][52659] Sum rewards: 72.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.025', 'AMMO2': '0.047', 'AMMO3': '0.209', 'AMMO4': '0.237', 'weapon4': '0.250', 'weapon2': '0.266', 'weapon5': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '61.000'} [2024-08-06 06:14:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 551043072. Throughput: 0: 4377.1. Samples: 137769120. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:14:12,794][52567] Avg episode reward: [(0, '73.422')] [2024-08-06 06:14:13,525][52811] DAMAGECOUNT value on done: 683012.0 [2024-08-06 06:14:13,525][52811] Sum rewards: 80.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.953', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.128', 'weapon4': '0.138', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:14,149][52649] DAMAGECOUNT value on done: 711229.0 [2024-08-06 06:14:14,149][52649] Sum rewards: 82.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.319', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.200', 'AMMO3': '0.254', 'AMMO4': '0.256', 'weapon2': '0.276', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.868', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:14,246][52820] DAMAGECOUNT value on done: 669620.0 [2024-08-06 06:14:14,248][52820] Sum rewards: 77.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.400', 'AMMO5': '0.014', 'AMMO2': '0.069', 'weapon4': '0.180', 'weapon5': '0.206', 'AMMO3': '0.279', 'weapon2': '0.294', 'AMMO4': '0.346', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.986', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:14,491][52795] DAMAGECOUNT value on done: 660905.0 [2024-08-06 06:14:14,493][52795] Sum rewards: 76.329, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.374', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '66.000'} [2024-08-06 06:14:14,769][52660] DAMAGECOUNT value on done: 729359.0 [2024-08-06 06:14:14,770][52660] Sum rewards: 68.848, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.716', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.268', 'weapon2': '0.342', 'WEAPON3': '1.650', 'weapon3': '3.256', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:14,803][52650] Updated weights for policy 0, policy_version 67271 (0.0012) [2024-08-06 06:14:14,861][52647] DAMAGECOUNT value on done: 767044.0 [2024-08-06 06:14:14,862][52647] Sum rewards: 80.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.870', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.081', 'AMMO3': '0.179', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.376', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:14,983][52659] DAMAGECOUNT value on done: 724140.0 [2024-08-06 06:14:14,985][52659] Sum rewards: 75.684, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.488', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO3': '0.160', 'weapon5': '0.164', 'weapon2': '0.176', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.470', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:16,674][52811] DAMAGECOUNT value on done: 679811.0 [2024-08-06 06:14:16,676][52811] Sum rewards: 74.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.883', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.044', 'AMMO4': '0.064', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:16,777][52803] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:14:17,347][52660] DAMAGECOUNT value on done: 739367.0 [2024-08-06 06:14:17,347][52660] Sum rewards: 75.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.035', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.263', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '3.318', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:17,371][52649] DAMAGECOUNT value on done: 712031.0 [2024-08-06 06:14:17,375][52649] Sum rewards: 71.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.082', 'weapon5': '0.140', 'AMMO3': '0.218', 'AMMO4': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:17,447][52820] DAMAGECOUNT value on done: 661319.0 [2024-08-06 06:14:17,448][52820] Sum rewards: 84.189, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.534', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.154', 'weapon4': '0.186', 'AMMO3': '0.213', 'weapon2': '0.272', 'AMMO4': '0.275', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '71.000'} [2024-08-06 06:14:17,555][52647] DAMAGECOUNT value on done: 751426.0 [2024-08-06 06:14:17,556][52647] Sum rewards: 64.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.689', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.094', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '2.920', 'weapon3': '3.236', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '56.000'} [2024-08-06 06:14:17,678][52795] DAMAGECOUNT value on done: 669528.0 [2024-08-06 06:14:17,681][52795] Sum rewards: 78.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.154', 'weapon4': '0.178', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 551133184. Throughput: 0: 4380.2. Samples: 137782360. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:14:17,794][52567] Avg episode reward: [(0, '73.969')] [2024-08-06 06:14:18,129][52659] DAMAGECOUNT value on done: 722203.0 [2024-08-06 06:14:18,129][52659] Sum rewards: 81.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.020', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.176', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.454', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:19,528][52650] Updated weights for policy 0, policy_version 67281 (0.0036) [2024-08-06 06:14:19,736][52811] DAMAGECOUNT value on done: 670523.0 [2024-08-06 06:14:19,738][52811] Sum rewards: 81.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.986', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.147', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.418', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:20,245][52647] DAMAGECOUNT value on done: 764000.0 [2024-08-06 06:14:20,245][52647] Sum rewards: 70.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.552', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.122', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.784', 'WEAPON3': '1.200', 'weapon3': '2.806', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:20,247][52649] DAMAGECOUNT value on done: 712143.0 [2024-08-06 06:14:20,247][52649] Sum rewards: 79.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.979', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.074', 'weapon5': '0.078', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.446', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:20,396][52660] DAMAGECOUNT value on done: 717937.0 [2024-08-06 06:14:20,397][52660] Sum rewards: 73.735, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.200', 'weapon2': '0.204', 'weapon5': '0.218', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.980', 'weapon3': '3.224', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:20,612][52820] DAMAGECOUNT value on done: 675194.0 [2024-08-06 06:14:20,613][52820] Sum rewards: 87.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.025', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon4': '0.190', 'AMMO3': '0.226', 'AMMO4': '0.301', 'weapon5': '0.304', 'weapon2': '0.382', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.507', 'FRAGCOUNT': '72.000'} [2024-08-06 06:14:20,893][52795] DAMAGECOUNT value on done: 660786.0 [2024-08-06 06:14:20,893][52795] Sum rewards: 80.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.239', 'AMMO2': '0.005', 'AMMO4': '0.028', 'AMMO3': '0.243', 'weapon2': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.526', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '69.000'} [2024-08-06 06:14:21,304][52659] DAMAGECOUNT value on done: 726141.0 [2024-08-06 06:14:21,307][52659] Sum rewards: 64.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.460', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.262', 'AMMO3': '0.265', 'AMMO4': '0.316', 'weapon5': '0.344', 'weapon2': '0.456', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.596', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '56.000'} [2024-08-06 06:14:21,377][52667] DAMAGECOUNT value on done: 722097.0 [2024-08-06 06:14:21,377][52667] Sum rewards: 56.850, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.025', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.132', 'weapon4': '0.152', 'AMMO3': '0.230', 'AMMO4': '0.259', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.162', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '50.000'} [2024-08-06 06:14:22,736][52811] DAMAGECOUNT value on done: 682368.0 [2024-08-06 06:14:22,737][52811] Sum rewards: 64.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.194', 'AMMO4': '0.222', 'weapon2': '0.228', 'AMMO3': '0.259', 'weapon5': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '54.000'} [2024-08-06 06:14:22,782][52647] DAMAGECOUNT value on done: 765458.0 [2024-08-06 06:14:22,784][52647] Sum rewards: 69.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.005', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.226', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 551215104. Throughput: 0: 4377.8. Samples: 137808410. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:22,802][52567] Avg episode reward: [(0, '74.305')] [2024-08-06 06:14:22,942][52660] DAMAGECOUNT value on done: 725661.0 [2024-08-06 06:14:22,943][52660] Sum rewards: 70.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.098', 'AMMO4': '0.103', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.236', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:23,336][52649] DAMAGECOUNT value on done: 711111.0 [2024-08-06 06:14:23,337][52649] Sum rewards: 84.887, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.885', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon4': '0.226', 'weapon2': '0.314', 'WEAPON3': '1.100', 'weapon3': '3.242', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:23,773][52820] DAMAGECOUNT value on done: 657631.0 [2024-08-06 06:14:23,773][52820] Sum rewards: 63.745, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.906', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.070', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.050', 'HITCOUNT': '3.210', 'weapon3': '3.238', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '50.000'} [2024-08-06 06:14:24,044][52659] DAMAGECOUNT value on done: 723923.0 [2024-08-06 06:14:24,045][52659] Sum rewards: 77.054, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.861', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'weapon2': '0.352', 'WEAPON3': '1.700', 'weapon3': '3.340', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '67.000'} [2024-08-06 06:14:24,083][52795] DAMAGECOUNT value on done: 670835.0 [2024-08-06 06:14:24,084][52795] Sum rewards: 74.781, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.505', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.206', 'AMMO4': '0.242', 'AMMO3': '0.294', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.002', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '66.000'} [2024-08-06 06:14:24,223][52650] Updated weights for policy 0, policy_version 67291 (0.0036) [2024-08-06 06:14:24,509][52667] DAMAGECOUNT value on done: 727142.0 [2024-08-06 06:14:24,511][52667] Sum rewards: 69.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.396', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.168', 'weapon2': '0.196', 'AMMO4': '0.200', 'AMMO3': '0.203', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.160', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '58.000'} [2024-08-06 06:14:25,457][52660] DAMAGECOUNT value on done: 721390.0 [2024-08-06 06:14:25,457][52660] Sum rewards: 81.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.798', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:25,726][52647] DAMAGECOUNT value on done: 750771.0 [2024-08-06 06:14:25,727][52647] Sum rewards: 62.754, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.160', 'weapon5': '0.166', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.350', 'HEALTH': '0.374', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.016', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '52.000'} [2024-08-06 06:14:25,845][52811] DAMAGECOUNT value on done: 678409.0 [2024-08-06 06:14:25,845][52811] Sum rewards: 80.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.604', 'AMMO2': '0.006', 'AMMO5': '0.009', 'weapon4': '0.012', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.130', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '67.000'} [2024-08-06 06:14:26,462][52649] DAMAGECOUNT value on done: 697166.0 [2024-08-06 06:14:26,463][52649] Sum rewards: 77.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.048', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.084', 'AMMO4': '0.207', 'weapon5': '0.220', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '66.000'} [2024-08-06 06:14:26,745][52820] DAMAGECOUNT value on done: 670277.0 [2024-08-06 06:14:26,747][52820] Sum rewards: 86.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.486', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.077', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.516', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '70.000'} [2024-08-06 06:14:26,965][52659] DAMAGECOUNT value on done: 720782.0 [2024-08-06 06:14:26,967][52659] Sum rewards: 70.600, reward structure: {'DEATHCOUNT': '-21.750', 'HEALTH': '-3.138', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.092', 'AMMO4': '0.174', 'weapon5': '0.262', 'weapon2': '0.268', 'WEAPON4': '0.350', 'AMMO3': '0.353', 'WEAPON5': '0.400', 'WEAPON3': '2.050', 'weapon3': '2.926', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:27,282][52795] DAMAGECOUNT value on done: 676126.0 [2024-08-06 06:14:27,284][52795] Sum rewards: 73.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.082', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:27,407][52667] DAMAGECOUNT value on done: 724624.0 [2024-08-06 06:14:27,407][52667] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.066', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon2': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.414', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 551305216. Throughput: 0: 4378.9. Samples: 137834680. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:27,794][52567] Avg episode reward: [(0, '74.354')] [2024-08-06 06:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067298_551305216.pth... [2024-08-06 06:14:27,944][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000066786_547110912.pth [2024-08-06 06:14:28,125][52660] DAMAGECOUNT value on done: 714712.0 [2024-08-06 06:14:28,126][52660] Sum rewards: 59.356, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.311', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.093', 'weapon5': '0.142', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.050', 'HITCOUNT': '2.590', 'weapon3': '3.398', 'DAMAGECOUNT': '13.263', 'FRAGCOUNT': '49.000'} [2024-08-06 06:14:28,804][52647] DAMAGECOUNT value on done: 758175.0 [2024-08-06 06:14:28,808][52647] Sum rewards: 87.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.951', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.126', 'AMMO3': '0.191', 'weapon5': '0.232', 'AMMO4': '0.271', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '71.000'} [2024-08-06 06:14:28,906][52811] DAMAGECOUNT value on done: 681146.0 [2024-08-06 06:14:28,907][52811] Sum rewards: 71.125, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.184', 'AMMO4': '0.205', 'weapon2': '0.274', 'weapon5': '0.276', 'weapon4': '0.354', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.826', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:29,257][52650] Updated weights for policy 0, policy_version 67301 (0.0017) [2024-08-06 06:14:29,485][52649] DAMAGECOUNT value on done: 708139.0 [2024-08-06 06:14:29,487][52649] Sum rewards: 62.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.094', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.084', 'AMMO4': '0.158', 'weapon5': '0.166', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '54.000'} [2024-08-06 06:14:29,817][52820] DAMAGECOUNT value on done: 672161.0 [2024-08-06 06:14:29,817][52820] Sum rewards: 75.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.094', 'AMMO4': '0.146', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:29,999][52659] DAMAGECOUNT value on done: 725220.0 [2024-08-06 06:14:30,001][52659] Sum rewards: 74.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.078', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.142', 'AMMO4': '0.167', 'AMMO3': '0.209', 'weapon4': '0.214', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '61.000'} [2024-08-06 06:14:30,573][52795] DAMAGECOUNT value on done: 668048.0 [2024-08-06 06:14:30,575][52795] Sum rewards: 73.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.228', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon4': '0.052', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.231', 'WEAPON3': '1.450', 'HITCOUNT': '3.470', 'weapon3': '3.512', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:30,700][52794] DAMAGECOUNT value on done: 720946.0 [2024-08-06 06:14:30,701][52794] Sum rewards: 53.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon4': '0.188', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.060', 'DAMAGECOUNT': '13.809', 'FRAGCOUNT': '47.000'} [2024-08-06 06:14:30,715][52667] DAMAGECOUNT value on done: 730623.0 [2024-08-06 06:14:30,716][52667] Sum rewards: 81.053, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.280', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO4': '0.218', 'weapon2': '0.224', 'AMMO3': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.258', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '71.000'} [2024-08-06 06:14:31,046][52660] DAMAGECOUNT value on done: 710629.0 [2024-08-06 06:14:31,047][52660] Sum rewards: 70.282, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.815', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.131', 'AMMO4': '0.186', 'weapon2': '0.218', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.520', 'WEAPON3': '0.850', 'weapon3': '2.830', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '53.500'} [2024-08-06 06:14:31,399][52647] DAMAGECOUNT value on done: 747231.0 [2024-08-06 06:14:31,400][52647] Sum rewards: 61.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.784', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.200', 'AMMO3': '0.243', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.410', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '52.000'} [2024-08-06 06:14:32,114][52811] DAMAGECOUNT value on done: 683442.0 [2024-08-06 06:14:32,114][52811] Sum rewards: 78.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.850', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.130', 'weapon5': '0.130', 'AMMO4': '0.194', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:32,657][52649] DAMAGECOUNT value on done: 695999.0 [2024-08-06 06:14:32,657][52649] Sum rewards: 62.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.679', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.126', 'AMMO4': '0.201', 'AMMO3': '0.227', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.302', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '53.000'} [2024-08-06 06:14:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 551395328. Throughput: 0: 4373.3. Samples: 137847340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:32,794][52567] Avg episode reward: [(0, '74.205')] [2024-08-06 06:14:33,004][52820] DAMAGECOUNT value on done: 671584.0 [2024-08-06 06:14:33,005][52820] Sum rewards: 72.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.945', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.180', 'weapon5': '0.202', 'AMMO3': '0.218', 'AMMO4': '0.238', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.656', 'WEAPON3': '1.250', 'weapon3': '2.642', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:33,175][52659] DAMAGECOUNT value on done: 731500.0 [2024-08-06 06:14:33,179][52659] Sum rewards: 88.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon4': '0.072', 'weapon5': '0.178', 'AMMO3': '0.259', 'AMMO4': '0.287', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.582', 'FRAGCOUNT': '72.000'} [2024-08-06 06:14:33,182][52667] DAMAGECOUNT value on done: 730753.0 [2024-08-06 06:14:33,183][52667] Sum rewards: 79.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.405', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.262', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.404', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '66.000'} [2024-08-06 06:14:33,361][52794] DAMAGECOUNT value on done: 729285.0 [2024-08-06 06:14:33,363][52794] Sum rewards: 76.311, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.947', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.022', 'weapon4': '0.078', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.434', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '66.000'} [2024-08-06 06:14:33,446][52650] Updated weights for policy 0, policy_version 67311 (0.0014) [2024-08-06 06:14:33,779][52795] DAMAGECOUNT value on done: 666917.0 [2024-08-06 06:14:33,779][52795] Sum rewards: 82.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.470', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.142', 'weapon2': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.800', 'weapon3': '3.414', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '71.000'} [2024-08-06 06:14:34,204][52647] DAMAGECOUNT value on done: 752491.0 [2024-08-06 06:14:34,205][52647] Sum rewards: 66.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.472', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.121', 'weapon5': '0.122', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.466', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '55.000'} [2024-08-06 06:14:35,106][52811] DAMAGECOUNT value on done: 677461.0 [2024-08-06 06:14:35,110][52811] Sum rewards: 74.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.367', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon4': '0.130', 'AMMO3': '0.182', 'weapon5': '0.222', 'AMMO4': '0.305', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:35,590][52649] DAMAGECOUNT value on done: 711004.0 [2024-08-06 06:14:35,608][52649] Sum rewards: 73.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.910', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.170', 'AMMO3': '0.202', 'AMMO4': '0.217', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:35,946][52667] DAMAGECOUNT value on done: 732444.0 [2024-08-06 06:14:35,946][52667] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.820', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.130', 'weapon5': '0.134', 'WEAPON4': '0.250', 'weapon2': '0.268', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.306', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:35,957][52794] DAMAGECOUNT value on done: 733057.0 [2024-08-06 06:14:35,958][52794] Sum rewards: 83.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.209', 'weapon4': '0.220', 'AMMO4': '0.284', 'weapon2': '0.312', 'weapon5': '0.332', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '21.039', 'FRAGCOUNT': '67.000'} [2024-08-06 06:14:36,053][52820] DAMAGECOUNT value on done: 677902.0 [2024-08-06 06:14:36,056][52820] Sum rewards: 70.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.149', 'weapon5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.270', 'weapon3': '3.336', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:36,203][52659] DAMAGECOUNT value on done: 718670.0 [2024-08-06 06:14:36,205][52659] Sum rewards: 72.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.116', 'AMMO3': '0.157', 'AMMO4': '0.223', 'weapon2': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '58.500'} [2024-08-06 06:14:36,884][52795] DAMAGECOUNT value on done: 671517.0 [2024-08-06 06:14:36,888][52795] Sum rewards: 69.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.354', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.032', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.187', 'weapon2': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.180', 'weapon3': '3.350', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '58.000'} [2024-08-06 06:14:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 551477248. Throughput: 0: 4376.5. Samples: 137873850. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:37,794][52567] Avg episode reward: [(0, '74.119')] [2024-08-06 06:14:38,216][52811] DAMAGECOUNT value on done: 674101.0 [2024-08-06 06:14:38,218][52811] Sum rewards: 68.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.759', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.058', 'weapon5': '0.174', 'weapon2': '0.186', 'AMMO3': '0.209', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.332', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '56.000'} [2024-08-06 06:14:38,319][52650] Updated weights for policy 0, policy_version 67321 (0.0018) [2024-08-06 06:14:38,662][52667] DAMAGECOUNT value on done: 728297.0 [2024-08-06 06:14:38,665][52667] Sum rewards: 80.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.998', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon4': '0.100', 'weapon5': '0.248', 'AMMO3': '0.273', 'AMMO4': '0.312', 'weapon2': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.988', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '20.910', 'FRAGCOUNT': '67.000'} [2024-08-06 06:14:38,704][52649] DAMAGECOUNT value on done: 713166.0 [2024-08-06 06:14:38,704][52649] Sum rewards: 87.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.939', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.094', 'AMMO3': '0.188', 'weapon5': '0.188', 'AMMO4': '0.242', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.957', 'FRAGCOUNT': '70.500'} [2024-08-06 06:14:38,798][52794] DAMAGECOUNT value on done: 717941.0 [2024-08-06 06:14:38,798][52794] Sum rewards: 76.490, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.116', 'weapon5': '0.134', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:39,052][52820] DAMAGECOUNT value on done: 664578.0 [2024-08-06 06:14:39,053][52820] Sum rewards: 74.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.558', 'AMMO5': '0.018', 'AMMO2': '0.070', 'weapon4': '0.090', 'weapon2': '0.224', 'AMMO3': '0.251', 'weapon5': '0.262', 'AMMO4': '0.349', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:39,074][52659] DAMAGECOUNT value on done: 727997.0 [2024-08-06 06:14:39,074][52659] Sum rewards: 61.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.361', 'AMMO5': '0.014', 'AMMO2': '0.055', 'AMMO3': '0.191', 'weapon5': '0.206', 'weapon4': '0.268', 'AMMO4': '0.275', 'weapon2': '0.458', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '50.500'} [2024-08-06 06:14:40,034][52795] DAMAGECOUNT value on done: 665466.0 [2024-08-06 06:14:40,036][52795] Sum rewards: 77.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.943', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.164', 'AMMO4': '0.174', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '66.000'} [2024-08-06 06:14:41,376][52665] DAMAGECOUNT value on done: 708522.0 [2024-08-06 06:14:41,385][52665] Sum rewards: 68.792, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.136', 'AMMO4': '0.169', 'AMMO3': '0.170', 'weapon5': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '56.000'} [2024-08-06 06:14:41,415][52811] DAMAGECOUNT value on done: 672705.0 [2024-08-06 06:14:41,418][52811] Sum rewards: 71.836, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.029', 'HEALTH': '0.038', 'weapon4': '0.072', 'AMMO4': '0.144', 'weapon5': '0.148', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:41,443][52794] DAMAGECOUNT value on done: 719379.0 [2024-08-06 06:14:41,443][52794] Sum rewards: 81.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.142', 'AMMO3': '0.204', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:41,539][52649] DAMAGECOUNT value on done: 702961.0 [2024-08-06 06:14:41,539][52649] Sum rewards: 59.580, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.464', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.064', 'AMMO4': '0.182', 'weapon5': '0.194', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.990', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '52.000'} [2024-08-06 06:14:41,555][52659] DAMAGECOUNT value on done: 723130.0 [2024-08-06 06:14:41,555][52659] Sum rewards: 91.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.889', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.218', 'WEAPON3': '1.400', 'weapon3': '3.532', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '22.032', 'FRAGCOUNT': '74.000'} [2024-08-06 06:14:41,966][52667] DAMAGECOUNT value on done: 725069.0 [2024-08-06 06:14:41,967][52667] Sum rewards: 62.856, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.790', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon5': '0.212', 'AMMO4': '0.246', 'AMMO3': '0.272', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '55.000'} [2024-08-06 06:14:42,348][52820] DAMAGECOUNT value on done: 670581.0 [2024-08-06 06:14:42,350][52820] Sum rewards: 87.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.872', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.112', 'weapon2': '0.202', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '71.000'} [2024-08-06 06:14:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 551567360. Throughput: 0: 4382.7. Samples: 137900180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:42,794][52567] Avg episode reward: [(0, '74.272')] [2024-08-06 06:14:43,148][52795] DAMAGECOUNT value on done: 662888.0 [2024-08-06 06:14:43,151][52795] Sum rewards: 77.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.070', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:43,285][52650] Updated weights for policy 0, policy_version 67331 (0.0016) [2024-08-06 06:14:43,735][52794] DAMAGECOUNT value on done: 724429.0 [2024-08-06 06:14:43,739][52794] Sum rewards: 73.307, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.302', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:44,015][52803] DAMAGECOUNT value on done: 671776.0 [2024-08-06 06:14:44,017][52803] Sum rewards: 60.895, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'AMMO2': '0.039', 'HEALTH': '0.060', 'weapon5': '0.132', 'AMMO4': '0.194', 'weapon4': '0.198', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.158', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '49.000'} [2024-08-06 06:14:44,259][52659] DAMAGECOUNT value on done: 724298.0 [2024-08-06 06:14:44,260][52659] Sum rewards: 81.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.060', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.666', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:44,307][52665] DAMAGECOUNT value on done: 724603.0 [2024-08-06 06:14:44,307][52665] Sum rewards: 78.087, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.442', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.128', 'weapon5': '0.138', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '0.950', 'weapon3': '3.240', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:44,676][52811] DAMAGECOUNT value on done: 673826.0 [2024-08-06 06:14:44,677][52811] Sum rewards: 77.150, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.376', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:45,001][52667] DAMAGECOUNT value on done: 727522.0 [2024-08-06 06:14:45,001][52667] Sum rewards: 67.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.078', 'weapon5': '0.106', 'AMMO4': '0.125', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.220', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:45,459][52820] DAMAGECOUNT value on done: 679473.0 [2024-08-06 06:14:45,460][52820] Sum rewards: 66.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.184', 'AMMO4': '0.208', 'AMMO3': '0.216', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.228', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '55.000'} [2024-08-06 06:14:46,333][52795] DAMAGECOUNT value on done: 663888.0 [2024-08-06 06:14:46,333][52795] Sum rewards: 82.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.256', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.136', 'weapon2': '0.192', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.402', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '70.000'} [2024-08-06 06:14:46,620][52794] DAMAGECOUNT value on done: 728659.0 [2024-08-06 06:14:46,624][52794] Sum rewards: 66.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.020', 'AMMO2': '0.034', 'AMMO3': '0.167', 'AMMO4': '0.172', 'weapon4': '0.202', 'weapon5': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.890', 'weapon3': '2.950', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '54.000'} [2024-08-06 06:14:47,161][52803] DAMAGECOUNT value on done: 671849.0 [2024-08-06 06:14:47,164][52803] Sum rewards: 72.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.504', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.184', 'AMMO4': '0.198', 'weapon2': '0.246', 'weapon5': '0.248', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.994', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 06:14:47,429][52659] DAMAGECOUNT value on done: 730883.0 [2024-08-06 06:14:47,431][52659] Sum rewards: 71.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.022', 'AMMO5': '0.014', 'AMMO2': '0.054', 'AMMO3': '0.182', 'weapon2': '0.214', 'weapon5': '0.236', 'AMMO4': '0.268', 'weapon4': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '56.000'} [2024-08-06 06:14:47,499][52665] DAMAGECOUNT value on done: 724238.0 [2024-08-06 06:14:47,502][52665] Sum rewards: 66.669, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.050', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.167', 'AMMO3': '0.178', 'weapon4': '0.204', 'WEAPON4': '0.300', 'weapon5': '0.322', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '53.000'} [2024-08-06 06:14:47,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 551657472. Throughput: 0: 4380.0. Samples: 137913270. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:47,795][52567] Avg episode reward: [(0, '74.263')] [2024-08-06 06:14:47,798][52650] Updated weights for policy 0, policy_version 67341 (0.0026) [2024-08-06 06:14:47,837][52811] DAMAGECOUNT value on done: 679302.0 [2024-08-06 06:14:47,838][52811] Sum rewards: 68.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.457', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.154', 'AMMO4': '0.157', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '56.000'} [2024-08-06 06:14:48,223][52667] DAMAGECOUNT value on done: 734644.0 [2024-08-06 06:14:48,225][52667] Sum rewards: 68.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.984', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.180', 'AMMO3': '0.210', 'weapon4': '0.280', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '58.000'} [2024-08-06 06:14:48,563][52820] DAMAGECOUNT value on done: 673189.0 [2024-08-06 06:14:48,565][52820] Sum rewards: 75.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.315', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.168', 'AMMO3': '0.264', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.282', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:49,439][52794] DAMAGECOUNT value on done: 715208.0 [2024-08-06 06:14:49,441][52794] Sum rewards: 66.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.221', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon2': '0.194', 'AMMO3': '0.195', 'AMMO4': '0.286', 'weapon5': '0.304', 'weapon4': '0.442', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '54.000'} [2024-08-06 06:14:49,613][52795] DAMAGECOUNT value on done: 672971.0 [2024-08-06 06:14:49,615][52795] Sum rewards: 75.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.350', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.170', 'AMMO3': '0.188', 'weapon4': '0.210', 'weapon2': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:50,420][52803] DAMAGECOUNT value on done: 678450.0 [2024-08-06 06:14:50,420][52803] Sum rewards: 78.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.218', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:50,689][52665] DAMAGECOUNT value on done: 717627.0 [2024-08-06 06:14:50,692][52665] Sum rewards: 76.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.284', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '64.000'} [2024-08-06 06:14:50,793][52659] DAMAGECOUNT value on done: 725705.0 [2024-08-06 06:14:50,795][52659] Sum rewards: 57.899, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.457', 'AMMO2': '0.016', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.034', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.274', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '51.000'} [2024-08-06 06:14:50,836][52667] DAMAGECOUNT value on done: 725450.0 [2024-08-06 06:14:50,836][52667] Sum rewards: 67.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.196', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.176', 'weapon4': '0.194', 'AMMO3': '0.207', 'AMMO4': '0.241', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:50,900][52811] DAMAGECOUNT value on done: 681395.0 [2024-08-06 06:14:50,900][52811] Sum rewards: 68.675, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.090', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon5': '0.104', 'weapon4': '0.170', 'AMMO4': '0.231', 'AMMO3': '0.311', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.900', 'weapon3': '3.050', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:51,736][52820] DAMAGECOUNT value on done: 675609.0 [2024-08-06 06:14:51,745][52820] Sum rewards: 63.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.092', 'weapon5': '0.134', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.282', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '55.000'} [2024-08-06 06:14:51,927][52650] Updated weights for policy 0, policy_version 67351 (0.0013) [2024-08-06 06:14:52,040][52794] DAMAGECOUNT value on done: 727018.0 [2024-08-06 06:14:52,041][52794] Sum rewards: 70.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.951', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.118', 'weapon4': '0.136', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '57.000'} [2024-08-06 06:14:52,793][52795] DAMAGECOUNT value on done: 657517.0 [2024-08-06 06:14:52,794][52795] Sum rewards: 69.293, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.768', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.112', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon5': '0.306', 'weapon2': '0.458', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.078', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '56.000'} [2024-08-06 06:14:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 551739392. Throughput: 0: 4370.2. Samples: 137939380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:52,797][52567] Avg episode reward: [(0, '73.313')] [2024-08-06 06:14:53,446][52665] DAMAGECOUNT value on done: 704591.0 [2024-08-06 06:14:53,449][52665] Sum rewards: 75.339, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.856', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon5': '0.212', 'AMMO4': '0.248', 'weapon2': '0.254', 'AMMO3': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:53,524][52803] DAMAGECOUNT value on done: 676755.0 [2024-08-06 06:14:53,526][52803] Sum rewards: 70.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.443', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.076', 'weapon5': '0.182', 'AMMO3': '0.238', 'AMMO4': '0.260', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '61.000'} [2024-08-06 06:14:53,751][52659] DAMAGECOUNT value on done: 732446.0 [2024-08-06 06:14:53,751][52659] Sum rewards: 74.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.138', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '60.000'} [2024-08-06 06:14:53,883][52667] DAMAGECOUNT value on done: 723844.0 [2024-08-06 06:14:53,883][52667] Sum rewards: 64.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.134', 'weapon5': '0.166', 'AMMO4': '0.207', 'AMMO3': '0.247', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '55.000'} [2024-08-06 06:14:54,023][52811] DAMAGECOUNT value on done: 677519.0 [2024-08-06 06:14:54,023][52811] Sum rewards: 77.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.842', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.147', 'AMMO3': '0.171', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.000', 'weapon3': '3.164', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '61.000'} [2024-08-06 06:14:54,920][52794] DAMAGECOUNT value on done: 718621.0 [2024-08-06 06:14:54,921][52794] Sum rewards: 93.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.176', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.540', 'FRAGCOUNT': '75.000'} [2024-08-06 06:14:54,984][52820] DAMAGECOUNT value on done: 672437.0 [2024-08-06 06:14:54,985][52820] Sum rewards: 82.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon4': '0.098', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '68.000'} [2024-08-06 06:14:55,887][52795] DAMAGECOUNT value on done: 675401.0 [2024-08-06 06:14:55,888][52795] Sum rewards: 68.294, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.559', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.154', 'weapon4': '0.182', 'AMMO3': '0.205', 'AMMO4': '0.305', 'weapon2': '0.392', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '58.000'} [2024-08-06 06:14:56,216][52665] DAMAGECOUNT value on done: 710319.0 [2024-08-06 06:14:56,217][52665] Sum rewards: 72.627, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.141', 'WEAPON3': '0.900', 'weapon2': '1.010', 'weapon3': '2.924', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '58.000'} [2024-08-06 06:14:56,605][52803] DAMAGECOUNT value on done: 677663.0 [2024-08-06 06:14:56,605][52803] Sum rewards: 77.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.104', 'AMMO3': '0.179', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:56,824][52659] DAMAGECOUNT value on done: 721369.0 [2024-08-06 06:14:56,826][52659] Sum rewards: 84.917, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.164', 'HEALTH': '0.168', 'AMMO3': '0.184', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '67.000'} [2024-08-06 06:14:56,833][52667] DAMAGECOUNT value on done: 732087.0 [2024-08-06 06:14:56,834][52667] Sum rewards: 76.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.546', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.098', 'AMMO4': '0.099', 'weapon5': '0.130', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.344', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '63.000'} [2024-08-06 06:14:57,035][52811] DAMAGECOUNT value on done: 675788.0 [2024-08-06 06:14:57,037][52811] Sum rewards: 72.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.058', 'weapon4': '0.112', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '59.000'} [2024-08-06 06:14:57,230][52650] Updated weights for policy 0, policy_version 67361 (0.0014) [2024-08-06 06:14:57,640][52794] DAMAGECOUNT value on done: 715894.0 [2024-08-06 06:14:57,640][52794] Sum rewards: 83.119, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.106', 'AMMO4': '0.126', 'weapon5': '0.136', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.666', 'WEAPON3': '1.000', 'weapon3': '2.922', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '67.000'} [2024-08-06 06:14:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 551829504. Throughput: 0: 4365.8. Samples: 137965580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:14:57,795][52567] Avg episode reward: [(0, '73.364')] [2024-08-06 06:14:58,007][52820] DAMAGECOUNT value on done: 673564.0 [2024-08-06 06:14:58,007][52820] Sum rewards: 59.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.255', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.446', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.264', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '52.000'} [2024-08-06 06:14:58,779][52665] DAMAGECOUNT value on done: 717917.0 [2024-08-06 06:14:58,787][52665] Sum rewards: 77.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.212', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.126', 'AMMO4': '0.167', 'weapon2': '0.168', 'weapon5': '0.214', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '65.000'} [2024-08-06 06:14:59,037][52795] DAMAGECOUNT value on done: 670759.0 [2024-08-06 06:14:59,038][52795] Sum rewards: 84.055, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.305', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.123', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.650', 'weapon3': '3.396', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.069', 'FRAGCOUNT': '71.000'} [2024-08-06 06:14:59,552][52659] DAMAGECOUNT value on done: 732002.0 [2024-08-06 06:14:59,552][52659] Sum rewards: 63.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.098', 'AMMO3': '0.230', 'AMMO4': '0.261', 'weapon5': '0.292', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '53.000'} [2024-08-06 06:14:59,712][52803] DAMAGECOUNT value on done: 672851.0 [2024-08-06 06:14:59,713][52803] Sum rewards: 87.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.125', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.135', 'weapon4': '0.164', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '72.000'} [2024-08-06 06:14:59,931][52667] DAMAGECOUNT value on done: 720122.0 [2024-08-06 06:14:59,932][52667] Sum rewards: 69.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.776', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO4': '0.167', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.238', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '58.000'} [2024-08-06 06:15:00,418][52794] DAMAGECOUNT value on done: 724680.0 [2024-08-06 06:15:00,422][52794] Sum rewards: 64.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.032', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'weapon4': '0.148', 'weapon2': '0.180', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.448', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '55.000'} [2024-08-06 06:15:01,064][52820] DAMAGECOUNT value on done: 684302.0 [2024-08-06 06:15:01,064][52820] Sum rewards: 68.290, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.058', 'weapon4': '0.068', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:01,767][52650] Updated weights for policy 0, policy_version 67371 (0.0011) [2024-08-06 06:15:01,859][52665] DAMAGECOUNT value on done: 713680.0 [2024-08-06 06:15:01,861][52665] Sum rewards: 69.605, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.918', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.281', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.054', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:02,176][52659] DAMAGECOUNT value on done: 720547.0 [2024-08-06 06:15:02,179][52659] Sum rewards: 66.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.166', 'AMMO4': '0.181', 'weapon5': '0.184', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '56.000'} [2024-08-06 06:15:02,181][52795] DAMAGECOUNT value on done: 661931.0 [2024-08-06 06:15:02,181][52795] Sum rewards: 80.990, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.241', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.508', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '67.000'} [2024-08-06 06:15:02,696][52803] DAMAGECOUNT value on done: 667897.0 [2024-08-06 06:15:02,700][52803] Sum rewards: 76.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.120', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.112', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.736', 'WEAPON3': '0.850', 'weapon3': '2.794', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 551911424. Throughput: 0: 4359.6. Samples: 137978540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:02,794][52567] Avg episode reward: [(0, '73.410')] [2024-08-06 06:15:02,885][52667] DAMAGECOUNT value on done: 728035.0 [2024-08-06 06:15:02,887][52667] Sum rewards: 81.757, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.189', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.200', 'weapon3': '3.354', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '66.000'} [2024-08-06 06:15:03,447][52794] DAMAGECOUNT value on done: 721855.0 [2024-08-06 06:15:03,448][52794] Sum rewards: 74.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.708', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.166', 'AMMO4': '0.176', 'weapon2': '0.176', 'AMMO3': '0.201', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:04,127][52820] DAMAGECOUNT value on done: 681414.0 [2024-08-06 06:15:04,135][52820] Sum rewards: 69.865, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.796', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.170', 'weapon5': '0.174', 'AMMO4': '0.183', 'weapon2': '0.238', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.154', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '60.000'} [2024-08-06 06:15:04,924][52665] DAMAGECOUNT value on done: 722372.0 [2024-08-06 06:15:04,924][52665] Sum rewards: 65.095, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.646', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.030', 'weapon5': '0.056', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '52.000'} [2024-08-06 06:15:05,244][52795] DAMAGECOUNT value on done: 668969.0 [2024-08-06 06:15:05,245][52795] Sum rewards: 77.118, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.239', 'weapon2': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.540', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:05,852][52803] DAMAGECOUNT value on done: 666789.0 [2024-08-06 06:15:05,855][52803] Sum rewards: 75.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.502', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.248', 'weapon4': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:05,957][52667] DAMAGECOUNT value on done: 734568.0 [2024-08-06 06:15:05,959][52667] Sum rewards: 77.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.568', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.034', 'weapon4': '0.088', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.262', 'WEAPON3': '1.350', 'HITCOUNT': '3.370', 'weapon3': '3.392', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '66.000'} [2024-08-06 06:15:06,187][52650] Updated weights for policy 0, policy_version 67381 (0.0022) [2024-08-06 06:15:06,539][52794] DAMAGECOUNT value on done: 737364.0 [2024-08-06 06:15:06,541][52794] Sum rewards: 83.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.985', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO3': '0.238', 'AMMO4': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '69.000'} [2024-08-06 06:15:07,108][52820] DAMAGECOUNT value on done: 667341.0 [2024-08-06 06:15:07,110][52820] Sum rewards: 68.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.074', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'HITCOUNT': '3.230', 'weapon3': '3.442', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.000'} [2024-08-06 06:15:07,788][52665] DAMAGECOUNT value on done: 717251.0 [2024-08-06 06:15:07,789][52665] Sum rewards: 74.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.067', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.124', 'weapon5': '0.216', 'weapon2': '0.236', 'AMMO3': '0.252', 'AMMO4': '0.266', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 552001536. Throughput: 0: 4369.3. Samples: 138005030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:07,794][52567] Avg episode reward: [(0, '73.464')] [2024-08-06 06:15:08,334][52795] DAMAGECOUNT value on done: 676770.0 [2024-08-06 06:15:08,336][52795] Sum rewards: 75.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.144', 'weapon5': '0.166', 'AMMO3': '0.190', 'AMMO4': '0.243', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:08,870][52667] DAMAGECOUNT value on done: 732928.0 [2024-08-06 06:15:08,871][52667] Sum rewards: 69.561, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.464', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.074', 'weapon5': '0.136', 'AMMO4': '0.211', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.750', 'weapon3': '3.116', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:09,047][52803] DAMAGECOUNT value on done: 670805.0 [2024-08-06 06:15:09,052][52803] Sum rewards: 64.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon4': '0.092', 'weapon5': '0.106', 'AMMO4': '0.145', 'AMMO3': '0.204', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.296', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '53.000'} [2024-08-06 06:15:09,357][52794] DAMAGECOUNT value on done: 716948.0 [2024-08-06 06:15:09,365][52794] Sum rewards: 72.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.186', 'weapon2': '0.210', 'AMMO3': '0.212', 'AMMO4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '60.000'} [2024-08-06 06:15:10,604][52665] DAMAGECOUNT value on done: 725437.0 [2024-08-06 06:15:10,605][52665] Sum rewards: 68.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.464', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.186', 'AMMO4': '0.190', 'AMMO3': '0.239', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.084', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:10,698][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:15:11,175][52650] Updated weights for policy 0, policy_version 67391 (0.0011) [2024-08-06 06:15:11,891][52667] DAMAGECOUNT value on done: 731054.0 [2024-08-06 06:15:11,893][52667] Sum rewards: 82.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.230', 'weapon4': '0.256', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:12,106][52803] DAMAGECOUNT value on done: 670544.0 [2024-08-06 06:15:12,107][52803] Sum rewards: 82.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.006', 'AMMO2': '0.042', 'weapon5': '0.084', 'weapon4': '0.098', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'weapon2': '0.216', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.404', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '69.000'} [2024-08-06 06:15:12,546][52794] DAMAGECOUNT value on done: 730842.0 [2024-08-06 06:15:12,548][52794] Sum rewards: 81.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '66.000'} [2024-08-06 06:15:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 552091648. Throughput: 0: 4374.4. Samples: 138031530. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:12,794][52567] Avg episode reward: [(0, '73.663')] [2024-08-06 06:15:13,393][52665] DAMAGECOUNT value on done: 722375.0 [2024-08-06 06:15:13,393][52665] Sum rewards: 66.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.648', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.066', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:13,622][52663] DAMAGECOUNT value on done: 737876.0 [2024-08-06 06:15:13,622][52663] Sum rewards: 70.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.332', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '60.000'} [2024-08-06 06:15:14,977][52667] DAMAGECOUNT value on done: 729012.0 [2024-08-06 06:15:14,987][52667] Sum rewards: 81.321, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.375', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.132', 'AMMO3': '0.201', 'weapon2': '0.232', 'AMMO4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:15,231][52803] DAMAGECOUNT value on done: 684398.0 [2024-08-06 06:15:15,232][52803] Sum rewards: 68.181, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.467', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.140', 'weapon4': '0.196', 'AMMO4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '56.500'} [2024-08-06 06:15:15,550][52794] DAMAGECOUNT value on done: 726592.0 [2024-08-06 06:15:15,550][52794] Sum rewards: 74.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.184', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.152', 'weapon5': '0.208', 'weapon2': '0.226', 'AMMO3': '0.239', 'AMMO4': '0.274', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:15,904][52650] Updated weights for policy 0, policy_version 67401 (0.0013) [2024-08-06 06:15:15,913][52665] DAMAGECOUNT value on done: 718183.0 [2024-08-06 06:15:15,913][52665] Sum rewards: 76.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.046', 'weapon4': '0.116', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '64.000'} [2024-08-06 06:15:16,762][52663] DAMAGECOUNT value on done: 724185.0 [2024-08-06 06:15:16,765][52663] Sum rewards: 72.897, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.025', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.158', 'AMMO4': '0.216', 'weapon2': '0.220', 'AMMO3': '0.221', 'weapon5': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 552181760. Throughput: 0: 4389.3. Samples: 138044860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:17,794][52567] Avg episode reward: [(0, '73.568')] [2024-08-06 06:15:18,084][52667] DAMAGECOUNT value on done: 735767.0 [2024-08-06 06:15:18,085][52667] Sum rewards: 84.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.282', 'AMMO4': '0.291', 'weapon5': '0.308', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '69.000'} [2024-08-06 06:15:18,256][52803] DAMAGECOUNT value on done: 675076.0 [2024-08-06 06:15:18,256][52803] Sum rewards: 80.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.082', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.096', 'AMMO4': '0.144', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.100', 'weapon3': '3.416', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:18,440][52794] DAMAGECOUNT value on done: 729207.0 [2024-08-06 06:15:18,440][52794] Sum rewards: 62.115, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.058', 'weapon5': '0.212', 'AMMO3': '0.255', 'AMMO4': '0.289', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '3.104', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '53.000'} [2024-08-06 06:15:19,169][52665] DAMAGECOUNT value on done: 714216.0 [2024-08-06 06:15:19,169][52665] Sum rewards: 80.519, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.612', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.078', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.325', 'WEAPON3': '1.950', 'weapon3': '3.332', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.697', 'FRAGCOUNT': '71.000'} [2024-08-06 06:15:19,465][52663] DAMAGECOUNT value on done: 718460.0 [2024-08-06 06:15:19,466][52663] Sum rewards: 71.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.132', 'AMMO4': '0.137', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '2.798', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:20,355][52650] Updated weights for policy 0, policy_version 67411 (0.0013) [2024-08-06 06:15:21,115][52794] DAMAGECOUNT value on done: 736542.0 [2024-08-06 06:15:21,117][52794] Sum rewards: 77.077, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'HEALTH': '0.085', 'weapon5': '0.118', 'weapon4': '0.124', 'AMMO4': '0.176', 'AMMO3': '0.219', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '64.000'} [2024-08-06 06:15:21,471][52803] DAMAGECOUNT value on done: 674201.0 [2024-08-06 06:15:21,471][52803] Sum rewards: 82.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.631', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.173', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '66.000'} [2024-08-06 06:15:22,171][52665] DAMAGECOUNT value on done: 712281.0 [2024-08-06 06:15:22,172][52665] Sum rewards: 69.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.096', 'weapon4': '0.124', 'AMMO4': '0.184', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '57.500'} [2024-08-06 06:15:22,232][52663] DAMAGECOUNT value on done: 722678.0 [2024-08-06 06:15:22,234][52663] Sum rewards: 89.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.425', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.381', 'FRAGCOUNT': '73.000'} [2024-08-06 06:15:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 552263680. Throughput: 0: 4385.3. Samples: 138071190. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:22,794][52567] Avg episode reward: [(0, '73.886')] [2024-08-06 06:15:24,240][52794] DAMAGECOUNT value on done: 727607.0 [2024-08-06 06:15:24,241][52794] Sum rewards: 72.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.388', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.058', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:24,524][52803] DAMAGECOUNT value on done: 686598.0 [2024-08-06 06:15:24,526][52803] Sum rewards: 68.210, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.728', 'AMMO5': '0.012', 'ARMOR': '0.016', 'AMMO2': '0.033', 'weapon4': '0.090', 'weapon5': '0.136', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.324', 'weapon2': '0.374', 'WEAPON3': '1.900', 'weapon3': '3.046', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:25,279][52663] DAMAGECOUNT value on done: 725941.0 [2024-08-06 06:15:25,281][52663] Sum rewards: 68.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.912', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon4': '0.164', 'weapon5': '0.260', 'AMMO3': '0.291', 'AMMO4': '0.330', 'weapon2': '0.370', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.750', 'weapon3': '2.838', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:25,343][52650] Updated weights for policy 0, policy_version 67421 (0.0022) [2024-08-06 06:15:25,519][52665] DAMAGECOUNT value on done: 718280.0 [2024-08-06 06:15:25,521][52665] Sum rewards: 76.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.058', 'weapon5': '0.144', 'AMMO3': '0.236', 'AMMO4': '0.247', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:26,403][52658] DAMAGECOUNT value on done: 728453.0 [2024-08-06 06:15:26,415][52658] Sum rewards: 78.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.059', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.080', 'weapon4': '0.084', 'AMMO4': '0.168', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:27,631][52803] DAMAGECOUNT value on done: 672335.0 [2024-08-06 06:15:27,635][52803] Sum rewards: 80.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.574', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.196', 'weapon2': '0.702', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '67.000'} [2024-08-06 06:15:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 552353792. Throughput: 0: 4380.9. Samples: 138097320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:27,794][52567] Avg episode reward: [(0, '73.855')] [2024-08-06 06:15:27,896][52663] DAMAGECOUNT value on done: 733379.0 [2024-08-06 06:15:27,897][52663] Sum rewards: 79.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.184', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '3.294', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:27,922][52665] DAMAGECOUNT value on done: 719102.0 [2024-08-06 06:15:27,924][52665] Sum rewards: 72.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.340', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.182', 'AMMO3': '0.270', 'WEAPON3': '1.800', 'HITCOUNT': '3.550', 'weapon3': '3.576', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:29,308][52650] Updated weights for policy 0, policy_version 67431 (0.0014) [2024-08-06 06:15:29,604][52658] DAMAGECOUNT value on done: 726552.0 [2024-08-06 06:15:29,607][52658] Sum rewards: 87.543, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.175', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '73.000'} [2024-08-06 06:15:29,847][52669] DAMAGECOUNT value on done: 726710.0 [2024-08-06 06:15:29,849][52669] Sum rewards: 71.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon4': '0.064', 'weapon5': '0.116', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:30,631][52671] Large shaping reward 2.503 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.129, -43.0), ('weapon5', 0.002)] [2024-08-06 06:15:30,682][52663] DAMAGECOUNT value on done: 721345.0 [2024-08-06 06:15:30,682][52663] Sum rewards: 85.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.160', 'AMMO4': '0.181', 'AMMO3': '0.216', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '70.000'} [2024-08-06 06:15:30,736][52803] DAMAGECOUNT value on done: 675688.0 [2024-08-06 06:15:30,737][52803] Sum rewards: 76.618, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:30,840][52665] DAMAGECOUNT value on done: 710375.0 [2024-08-06 06:15:30,840][52665] Sum rewards: 74.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.050', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:31,255][52670] DAMAGECOUNT value on done: 715118.0 [2024-08-06 06:15:31,256][52670] Sum rewards: 73.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.247', 'WEAPON3': '1.550', 'HITCOUNT': '3.400', 'weapon3': '3.416', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:32,131][52614] Signal inference workers to stop experience collection... (12300 times) [2024-08-06 06:15:32,131][52614] Signal inference workers to resume experience collection... (12300 times) [2024-08-06 06:15:32,215][52650] InferenceWorker_p0-w0: stopping experience collection (12300 times) [2024-08-06 06:15:32,216][52650] InferenceWorker_p0-w0: resuming experience collection (12300 times) [2024-08-06 06:15:32,597][52671] DAMAGECOUNT value on done: 727142.0 [2024-08-06 06:15:32,598][52671] Sum rewards: 68.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.467', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.152', 'weapon5': '0.164', 'AMMO3': '0.175', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.344', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '54.000'} [2024-08-06 06:15:32,711][52658] DAMAGECOUNT value on done: 731672.0 [2024-08-06 06:15:32,711][52658] Sum rewards: 70.094, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.857', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.174', 'AMMO4': '0.205', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:32,732][52669] DAMAGECOUNT value on done: 718712.0 [2024-08-06 06:15:32,732][52669] Sum rewards: 75.160, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.755', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.098', 'weapon5': '0.130', 'AMMO4': '0.158', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 552443904. Throughput: 0: 4384.0. Samples: 138110550. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:32,794][52567] Avg episode reward: [(0, '74.077')] [2024-08-06 06:15:33,353][52663] DAMAGECOUNT value on done: 715898.0 [2024-08-06 06:15:33,356][52663] Sum rewards: 75.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.247', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.067', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.278', 'WEAPON3': '1.500', 'weapon3': '3.382', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:33,366][52666] DAMAGECOUNT value on done: 726394.0 [2024-08-06 06:15:33,366][52666] Sum rewards: 66.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.012', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.269', 'weapon2': '0.330', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.358', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:33,880][52803] DAMAGECOUNT value on done: 677547.0 [2024-08-06 06:15:33,880][52803] Sum rewards: 76.643, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.080', 'AMMO4': '0.126', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '67.000'} [2024-08-06 06:15:34,094][52665] DAMAGECOUNT value on done: 713664.0 [2024-08-06 06:15:34,096][52665] Sum rewards: 72.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.128', 'weapon5': '0.188', 'AMMO3': '0.208', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.226', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '60.000'} [2024-08-06 06:15:34,296][52670] DAMAGECOUNT value on done: 727447.0 [2024-08-06 06:15:34,297][52670] Sum rewards: 78.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.044', 'weapon4': '0.058', 'AMMO3': '0.169', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.336', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:34,625][52650] Updated weights for policy 0, policy_version 67441 (0.0016) [2024-08-06 06:15:35,251][52669] DAMAGECOUNT value on done: 731070.0 [2024-08-06 06:15:35,251][52669] Sum rewards: 68.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.462', 'AMMO5': '0.021', 'AMMO2': '0.030', 'weapon4': '0.142', 'AMMO4': '0.148', 'AMMO3': '0.242', 'weapon5': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.838', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '57.500'} [2024-08-06 06:15:35,521][52671] DAMAGECOUNT value on done: 733697.0 [2024-08-06 06:15:35,523][52671] Sum rewards: 89.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.117', 'AMMO3': '0.174', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.981', 'FRAGCOUNT': '71.000'} [2024-08-06 06:15:35,692][52658] DAMAGECOUNT value on done: 729386.0 [2024-08-06 06:15:35,694][52658] Sum rewards: 73.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.120', 'AMMO4': '0.144', 'weapon5': '0.172', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:35,818][52663] DAMAGECOUNT value on done: 716577.0 [2024-08-06 06:15:35,818][52663] Sum rewards: 81.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.234', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.188', 'AMMO3': '0.231', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '68.000'} [2024-08-06 06:15:36,243][52666] DAMAGECOUNT value on done: 723682.0 [2024-08-06 06:15:36,244][52666] Sum rewards: 79.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.144', 'AMMO3': '0.147', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.050', 'weapon3': '2.992', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '64.000'} [2024-08-06 06:15:37,040][52665] DAMAGECOUNT value on done: 716818.0 [2024-08-06 06:15:37,042][52665] Sum rewards: 66.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.756', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.132', 'weapon5': '0.176', 'AMMO3': '0.204', 'AMMO4': '0.242', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.021', 'FRAGCOUNT': '56.000'} [2024-08-06 06:15:37,177][52670] DAMAGECOUNT value on done: 715415.0 [2024-08-06 06:15:37,183][52803] DAMAGECOUNT value on done: 679984.0 [2024-08-06 06:15:37,187][52670] Sum rewards: 80.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon5': '0.190', 'weapon2': '0.210', 'AMMO3': '0.231', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '67.000'} [2024-08-06 06:15:37,187][52803] Sum rewards: 76.399, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.095', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.317', 'WEAPON3': '1.850', 'weapon3': '3.204', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '68.000'} [2024-08-06 06:15:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 552525824. Throughput: 0: 4384.4. Samples: 138136680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:15:37,794][52567] Avg episode reward: [(0, '74.506')] [2024-08-06 06:15:38,144][52669] DAMAGECOUNT value on done: 726991.0 [2024-08-06 06:15:38,145][52669] Sum rewards: 74.125, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.168', 'weapon4': '0.216', 'HEALTH': '0.230', 'AMMO4': '0.278', 'weapon5': '0.322', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.796', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:38,449][52671] DAMAGECOUNT value on done: 728198.0 [2024-08-06 06:15:38,451][52671] Sum rewards: 68.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon4': '0.174', 'weapon2': '0.228', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.368', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '54.000'} [2024-08-06 06:15:38,829][52658] DAMAGECOUNT value on done: 720244.0 [2024-08-06 06:15:38,829][52658] Sum rewards: 84.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.170', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon4': '0.052', 'weapon5': '0.096', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '69.000'} [2024-08-06 06:15:38,943][52663] DAMAGECOUNT value on done: 721174.0 [2024-08-06 06:15:38,943][52663] Sum rewards: 71.813, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.338', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.144', 'weapon5': '0.174', 'AMMO4': '0.201', 'weapon2': '0.224', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.198', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:39,099][52666] DAMAGECOUNT value on done: 723605.0 [2024-08-06 06:15:39,101][52666] Sum rewards: 59.560, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.742', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.068', 'AMMO3': '0.180', 'AMMO4': '0.186', 'weapon5': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '48.000'} [2024-08-06 06:15:39,334][52650] Updated weights for policy 0, policy_version 67451 (0.0018) [2024-08-06 06:15:39,480][52659] Large shaping reward 2.577 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0), ('weapon5', 0.002)] [2024-08-06 06:15:40,226][52670] DAMAGECOUNT value on done: 713538.0 [2024-08-06 06:15:40,228][52670] Sum rewards: 85.432, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.082', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '72.000'} [2024-08-06 06:15:40,251][52803] DAMAGECOUNT value on done: 684371.0 [2024-08-06 06:15:40,254][52803] Sum rewards: 75.062, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.153', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:41,283][52669] DAMAGECOUNT value on done: 728137.0 [2024-08-06 06:15:41,285][52669] Sum rewards: 82.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.345', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '68.000'} [2024-08-06 06:15:41,430][52671] DAMAGECOUNT value on done: 732078.0 [2024-08-06 06:15:41,430][52671] Sum rewards: 55.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.062', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.378', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.256', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '49.000'} [2024-08-06 06:15:41,486][52658] DAMAGECOUNT value on done: 717835.0 [2024-08-06 06:15:41,489][52658] Sum rewards: 67.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.126', 'AMMO5': '0.021', 'AMMO2': '0.072', 'AMMO3': '0.222', 'weapon5': '0.246', 'weapon2': '0.312', 'AMMO4': '0.359', 'weapon4': '0.410', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.770', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '56.000'} [2024-08-06 06:15:42,028][52666] DAMAGECOUNT value on done: 723894.0 [2024-08-06 06:15:42,029][52666] Sum rewards: 69.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.110', 'AMMO5': '0.014', 'ARMOR': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon2': '0.188', 'AMMO3': '0.222', 'weapon5': '0.230', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:42,029][52663] DAMAGECOUNT value on done: 731557.0 [2024-08-06 06:15:42,048][52663] Sum rewards: 84.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.818', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon4': '0.222', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.457', 'FRAGCOUNT': '70.000'} [2024-08-06 06:15:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 552615936. Throughput: 0: 4388.9. Samples: 138163080. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:15:42,794][52567] Avg episode reward: [(0, '74.887')] [2024-08-06 06:15:42,821][52670] DAMAGECOUNT value on done: 724974.0 [2024-08-06 06:15:42,823][52670] Sum rewards: 87.139, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.965', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.230', 'AMMO3': '0.294', 'WEAPON3': '1.800', 'weapon3': '3.442', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.471', 'FRAGCOUNT': '75.000'} [2024-08-06 06:15:43,315][52803] DAMAGECOUNT value on done: 678372.0 [2024-08-06 06:15:43,316][52803] Sum rewards: 72.564, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.836', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.072', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.269', 'weapon2': '0.316', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:43,667][52650] Updated weights for policy 0, policy_version 67461 (0.0035) [2024-08-06 06:15:43,990][52669] DAMAGECOUNT value on done: 728528.0 [2024-08-06 06:15:43,991][52669] Sum rewards: 71.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.204', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.064', 'AMMO4': '0.175', 'weapon5': '0.182', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:44,210][52671] DAMAGECOUNT value on done: 738850.0 [2024-08-06 06:15:44,212][52671] Sum rewards: 65.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.268', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.180', 'AMMO4': '0.195', 'AMMO3': '0.232', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.114', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:44,468][52658] DAMAGECOUNT value on done: 731847.0 [2024-08-06 06:15:44,469][52658] Sum rewards: 72.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.752', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.178', 'AMMO4': '0.204', 'weapon5': '0.224', 'AMMO3': '0.231', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:44,725][52666] DAMAGECOUNT value on done: 717699.0 [2024-08-06 06:15:44,726][52666] Sum rewards: 72.937, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.469', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:44,855][52663] DAMAGECOUNT value on done: 716454.0 [2024-08-06 06:15:44,856][52663] Sum rewards: 69.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.576', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.182', 'AMMO3': '0.218', 'weapon2': '0.220', 'AMMO4': '0.222', 'weapon4': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '59.500'} [2024-08-06 06:15:45,451][52670] DAMAGECOUNT value on done: 719909.0 [2024-08-06 06:15:45,453][52670] Sum rewards: 74.531, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.124', 'weapon2': '0.194', 'AMMO4': '0.201', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.376', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 06:15:46,836][52658] DAMAGECOUNT value on done: 722060.0 [2024-08-06 06:15:46,837][52658] Sum rewards: 84.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.380', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'weapon2': '0.202', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'weapon3': '3.560', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '73.000'} [2024-08-06 06:15:47,019][52669] DAMAGECOUNT value on done: 727147.0 [2024-08-06 06:15:47,020][52669] Sum rewards: 71.097, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.884', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.084', 'AMMO4': '0.195', 'weapon5': '0.210', 'AMMO3': '0.287', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.044', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:47,324][52666] DAMAGECOUNT value on done: 722400.0 [2024-08-06 06:15:47,325][52666] Sum rewards: 89.822, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'weapon4': '0.178', 'weapon2': '0.186', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'weapon3': '3.322', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.697', 'FRAGCOUNT': '77.000'} [2024-08-06 06:15:47,444][52671] DAMAGECOUNT value on done: 732399.0 [2024-08-06 06:15:47,444][52671] Sum rewards: 77.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.020', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.160', 'weapon2': '0.620', 'WEAPON3': '1.000', 'weapon3': '3.210', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:47,766][52663] DAMAGECOUNT value on done: 712777.0 [2024-08-06 06:15:47,766][52663] Sum rewards: 64.839, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.130', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.122', 'AMMO4': '0.198', 'weapon2': '0.222', 'weapon5': '0.256', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '56.000'} [2024-08-06 06:15:47,796][52567] Fps is (10 sec: 18019.6, 60 sec: 17475.9, 300 sec: 17494.7). Total num frames: 552706048. Throughput: 0: 4389.8. Samples: 138176090. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:15:47,803][52567] Avg episode reward: [(0, '74.770')] [2024-08-06 06:15:48,144][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:15:48,237][52670] DAMAGECOUNT value on done: 712388.0 [2024-08-06 06:15:48,238][52670] Sum rewards: 74.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'weapon4': '0.036', 'AMMO2': '0.045', 'weapon5': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:48,688][52650] Updated weights for policy 0, policy_version 67471 (0.0014) [2024-08-06 06:15:49,265][52660] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:15:49,831][52658] DAMAGECOUNT value on done: 743177.0 [2024-08-06 06:15:49,833][52658] Sum rewards: 65.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.084', 'weapon4': '0.118', 'AMMO3': '0.190', 'weapon2': '0.246', 'AMMO4': '0.281', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.320', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 06:15:49,928][52669] DAMAGECOUNT value on done: 731086.0 [2024-08-06 06:15:49,931][52669] Sum rewards: 74.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.474', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.094', 'weapon5': '0.156', 'AMMO4': '0.205', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:50,014][52671] DAMAGECOUNT value on done: 733596.0 [2024-08-06 06:15:50,014][52671] Sum rewards: 72.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.766', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon2': '0.174', 'weapon5': '0.176', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '60.000'} [2024-08-06 06:15:50,163][52666] DAMAGECOUNT value on done: 720049.0 [2024-08-06 06:15:50,165][52666] Sum rewards: 80.173, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.152', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '68.000'} [2024-08-06 06:15:50,650][52663] DAMAGECOUNT value on done: 720697.0 [2024-08-06 06:15:50,651][52663] Sum rewards: 82.706, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.465', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO3': '0.112', 'AMMO4': '0.126', 'weapon5': '0.136', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.360', 'WEAPON3': '0.850', 'weapon3': '2.990', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '64.000'} [2024-08-06 06:15:51,372][52670] DAMAGECOUNT value on done: 718126.0 [2024-08-06 06:15:51,373][52670] Sum rewards: 72.016, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.886', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.080', 'weapon5': '0.196', 'weapon2': '0.206', 'AMMO4': '0.224', 'AMMO3': '0.287', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.228', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:52,528][52671] DAMAGECOUNT value on done: 730245.0 [2024-08-06 06:15:52,529][52671] Sum rewards: 81.447, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.064', 'AMMO4': '0.138', 'weapon5': '0.144', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:52,733][52658] DAMAGECOUNT value on done: 726588.0 [2024-08-06 06:15:52,734][52658] Sum rewards: 71.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO4': '0.204', 'weapon4': '0.210', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 06:15:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 552796160. Throughput: 0: 4389.5. Samples: 138202560. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:15:52,795][52567] Avg episode reward: [(0, '74.970')] [2024-08-06 06:15:53,160][52650] Updated weights for policy 0, policy_version 67481 (0.0014) [2024-08-06 06:15:53,256][52669] DAMAGECOUNT value on done: 736630.0 [2024-08-06 06:15:53,257][52669] Sum rewards: 73.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.015', 'ARMOR': '0.020', 'AMMO4': '0.076', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.213', 'weapon4': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2024-08-06 06:15:53,453][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:15:53,516][52666] DAMAGECOUNT value on done: 714179.0 [2024-08-06 06:15:53,517][52666] Sum rewards: 74.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.742', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.101', 'weapon5': '0.160', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.362', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:53,734][52794] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 06:15:54,056][52664] DAMAGECOUNT value on done: 750935.0 [2024-08-06 06:15:54,057][52664] Sum rewards: 68.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.752', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.328', 'WEAPON3': '1.150', 'HITCOUNT': '3.220', 'weapon3': '3.306', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:54,100][52663] DAMAGECOUNT value on done: 718088.0 [2024-08-06 06:15:54,101][52663] Sum rewards: 64.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.004', 'weapon4': '0.012', 'weapon5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.248', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.558', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '53.000'} [2024-08-06 06:15:54,509][52670] DAMAGECOUNT value on done: 716409.0 [2024-08-06 06:15:54,509][52670] Sum rewards: 64.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.452', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.082', 'AMMO3': '0.226', 'weapon2': '0.232', 'AMMO4': '0.277', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.098', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '53.000'} [2024-08-06 06:15:55,150][52671] DAMAGECOUNT value on done: 722221.0 [2024-08-06 06:15:55,151][52671] Sum rewards: 77.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.589', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.158', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.280', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '63.000'} [2024-08-06 06:15:55,621][52658] DAMAGECOUNT value on done: 738045.0 [2024-08-06 06:15:55,622][52658] Sum rewards: 69.142, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.088', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.254', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '59.000'} [2024-08-06 06:15:56,144][52669] DAMAGECOUNT value on done: 729334.0 [2024-08-06 06:15:56,144][52669] Sum rewards: 61.052, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.190', 'weapon4': '0.192', 'AMMO3': '0.199', 'AMMO4': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '50.500'} [2024-08-06 06:15:56,782][52663] DAMAGECOUNT value on done: 731798.0 [2024-08-06 06:15:56,784][52663] Sum rewards: 72.848, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.630', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.600', 'weapon3': '3.194', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:56,856][52666] DAMAGECOUNT value on done: 723779.0 [2024-08-06 06:15:56,856][52666] Sum rewards: 78.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.079', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.396', 'WEAPON3': '1.100', 'weapon3': '3.314', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:56,972][52664] DAMAGECOUNT value on done: 758668.0 [2024-08-06 06:15:56,973][52664] Sum rewards: 66.227, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.134', 'AMMO4': '0.274', 'AMMO3': '0.285', 'weapon5': '0.296', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.810', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '57.000'} [2024-08-06 06:15:57,794][52567] Fps is (10 sec: 17205.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 552878080. Throughput: 0: 4383.8. Samples: 138228800. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:15:57,795][52567] Avg episode reward: [(0, '74.405')] [2024-08-06 06:15:57,832][52650] Updated weights for policy 0, policy_version 67491 (0.0013) [2024-08-06 06:15:57,930][52670] DAMAGECOUNT value on done: 712020.0 [2024-08-06 06:15:57,931][52670] Sum rewards: 64.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '54.000'} [2024-08-06 06:15:58,170][52671] DAMAGECOUNT value on done: 730801.0 [2024-08-06 06:15:58,180][52671] Sum rewards: 78.207, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.020', 'AMMO2': '0.069', 'weapon4': '0.158', 'AMMO3': '0.175', 'weapon2': '0.314', 'weapon5': '0.336', 'AMMO4': '0.347', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '62.000'} [2024-08-06 06:15:58,252][52658] DAMAGECOUNT value on done: 722373.0 [2024-08-06 06:15:58,252][52658] Sum rewards: 78.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.868', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.148', 'AMMO4': '0.184', 'weapon4': '0.212', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '65.000'} [2024-08-06 06:15:58,833][52669] DAMAGECOUNT value on done: 729765.0 [2024-08-06 06:15:58,834][52669] Sum rewards: 79.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.270', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.138', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '66.000'} [2024-08-06 06:15:59,473][52664] DAMAGECOUNT value on done: 754023.0 [2024-08-06 06:15:59,475][52664] Sum rewards: 63.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.301', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.238', 'weapon4': '0.248', 'AMMO3': '0.258', 'AMMO4': '0.314', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.834', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '54.000'} [2024-08-06 06:15:59,529][52663] DAMAGECOUNT value on done: 725232.0 [2024-08-06 06:15:59,531][52663] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.114', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'AMMO3': '0.303', 'WEAPON3': '1.800', 'weapon3': '3.202', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:00,134][52666] DAMAGECOUNT value on done: 716614.0 [2024-08-06 06:16:00,137][52666] Sum rewards: 65.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.094', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.414', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.326', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '53.000'} [2024-08-06 06:16:00,684][52671] DAMAGECOUNT value on done: 731950.0 [2024-08-06 06:16:00,684][52671] Sum rewards: 74.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.311', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.185', 'weapon2': '0.356', 'WEAPON3': '1.100', 'weapon3': '3.442', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '60.000'} [2024-08-06 06:16:01,177][52670] DAMAGECOUNT value on done: 725729.0 [2024-08-06 06:16:01,177][52670] Sum rewards: 79.155, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.976', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.242', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.490', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '69.000'} [2024-08-06 06:16:01,347][52658] DAMAGECOUNT value on done: 730600.0 [2024-08-06 06:16:01,349][52658] Sum rewards: 82.475, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'ARMOR': '0.036', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.182', 'AMMO4': '0.202', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:01,480][52669] DAMAGECOUNT value on done: 735714.0 [2024-08-06 06:16:01,482][52669] Sum rewards: 70.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.652', 'AMMO5': '0.028', 'AMMO2': '0.073', 'AMMO3': '0.208', 'weapon2': '0.260', 'weapon5': '0.320', 'AMMO4': '0.364', 'weapon4': '0.398', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.612', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '59.000'} [2024-08-06 06:16:01,958][52664] DAMAGECOUNT value on done: 749173.0 [2024-08-06 06:16:01,960][52664] Sum rewards: 85.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.473', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.070', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '69.000'} [2024-08-06 06:16:02,297][52663] DAMAGECOUNT value on done: 726862.0 [2024-08-06 06:16:02,300][52663] Sum rewards: 67.876, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.346', 'AMMO5': '0.022', 'AMMO2': '0.077', 'weapon5': '0.132', 'weapon4': '0.146', 'weapon2': '0.260', 'AMMO3': '0.303', 'AMMO4': '0.387', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.900', 'weapon3': '3.110', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:02,645][52650] Updated weights for policy 0, policy_version 67501 (0.0024) [2024-08-06 06:16:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 552968192. Throughput: 0: 4376.7. Samples: 138241810. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:16:02,794][52567] Avg episode reward: [(0, '74.507')] [2024-08-06 06:16:03,354][52666] DAMAGECOUNT value on done: 725870.0 [2024-08-06 06:16:03,362][52666] Sum rewards: 68.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO2': '0.016', 'weapon4': '0.072', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.390', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 06:16:03,712][52671] DAMAGECOUNT value on done: 728737.0 [2024-08-06 06:16:03,714][52671] Sum rewards: 61.114, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.952', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.086', 'weapon5': '0.234', 'AMMO4': '0.253', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '2.986', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '54.000'} [2024-08-06 06:16:04,103][52670] DAMAGECOUNT value on done: 711750.0 [2024-08-06 06:16:04,104][52670] Sum rewards: 75.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.214', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.172', 'AMMO3': '0.201', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:04,263][52669] DAMAGECOUNT value on done: 721358.0 [2024-08-06 06:16:04,264][52669] Sum rewards: 60.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.269', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon4': '0.106', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.136', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '49.000'} [2024-08-06 06:16:04,309][52658] DAMAGECOUNT value on done: 721006.0 [2024-08-06 06:16:04,309][52658] Sum rewards: 66.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.376', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO4': '0.148', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.344', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '57.000'} [2024-08-06 06:16:04,799][52664] DAMAGECOUNT value on done: 759814.0 [2024-08-06 06:16:04,799][52664] Sum rewards: 65.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.158', 'weapon4': '0.168', 'AMMO3': '0.219', 'weapon2': '0.264', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '55.000'} [2024-08-06 06:16:05,299][52663] DAMAGECOUNT value on done: 729197.0 [2024-08-06 06:16:05,301][52663] Sum rewards: 85.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.406', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '71.000'} [2024-08-06 06:16:05,684][52666] DAMAGECOUNT value on done: 712203.0 [2024-08-06 06:16:05,684][52666] Sum rewards: 66.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.897', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.120', 'AMMO4': '0.168', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '56.000'} [2024-08-06 06:16:06,427][52670] DAMAGECOUNT value on done: 720665.0 [2024-08-06 06:16:06,427][52670] Sum rewards: 83.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.618', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.052', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.434', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '69.000'} [2024-08-06 06:16:06,577][52671] DAMAGECOUNT value on done: 736888.0 [2024-08-06 06:16:06,578][52671] Sum rewards: 72.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.094', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '59.000'} [2024-08-06 06:16:06,990][52669] DAMAGECOUNT value on done: 723838.0 [2024-08-06 06:16:06,990][52669] Sum rewards: 65.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.042', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.082', 'AMMO4': '0.111', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '55.000'} [2024-08-06 06:16:07,107][52658] DAMAGECOUNT value on done: 730595.0 [2024-08-06 06:16:07,107][52658] Sum rewards: 72.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.148', 'weapon2': '0.176', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.432', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:07,335][52650] Updated weights for policy 0, policy_version 67511 (0.0025) [2024-08-06 06:16:07,601][52664] DAMAGECOUNT value on done: 751981.0 [2024-08-06 06:16:07,602][52664] Sum rewards: 71.205, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.008', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO3': '0.176', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '57.000'} [2024-08-06 06:16:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 553058304. Throughput: 0: 4375.8. Samples: 138268100. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:16:07,795][52567] Avg episode reward: [(0, '73.717')] [2024-08-06 06:16:08,142][52663] DAMAGECOUNT value on done: 719186.0 [2024-08-06 06:16:08,142][52663] Sum rewards: 75.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.102', 'AMMO4': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '63.000'} [2024-08-06 06:16:08,526][52666] DAMAGECOUNT value on done: 726235.0 [2024-08-06 06:16:08,536][52666] Sum rewards: 64.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.915', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.040', 'weapon4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'AMMO3': '0.254', 'weapon2': '0.372', 'WEAPON3': '1.600', 'HITCOUNT': '3.250', 'weapon3': '3.324', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 06:16:09,333][52671] DAMAGECOUNT value on done: 730195.0 [2024-08-06 06:16:09,337][52671] Sum rewards: 63.828, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO3': '0.175', 'AMMO4': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.236', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '52.000'} [2024-08-06 06:16:09,446][52668] DAMAGECOUNT value on done: 725012.0 [2024-08-06 06:16:09,447][52668] Sum rewards: 63.120, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.543', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.110', 'weapon5': '0.132', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.402', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '50.000'} [2024-08-06 06:16:09,493][52670] DAMAGECOUNT value on done: 727000.0 [2024-08-06 06:16:09,494][52670] Sum rewards: 90.753, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.125', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.164', 'weapon5': '0.164', 'weapon4': '0.226', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '72.000'} [2024-08-06 06:16:09,745][52658] DAMAGECOUNT value on done: 715819.0 [2024-08-06 06:16:09,746][52658] Sum rewards: 79.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.110', 'weapon5': '0.132', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '64.000'} [2024-08-06 06:16:10,214][52669] DAMAGECOUNT value on done: 727870.0 [2024-08-06 06:16:10,215][52669] Sum rewards: 75.851, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.696', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.130', 'weapon5': '0.132', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'AMMO3': '0.265', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:10,551][52664] DAMAGECOUNT value on done: 749333.0 [2024-08-06 06:16:10,552][52664] Sum rewards: 76.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.154', 'AMMO3': '0.201', 'AMMO4': '0.238', 'weapon2': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '62.000'} [2024-08-06 06:16:11,689][52666] DAMAGECOUNT value on done: 719223.0 [2024-08-06 06:16:11,691][52666] Sum rewards: 73.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.278', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.182', 'AMMO4': '0.190', 'AMMO3': '0.208', 'weapon5': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:11,772][52650] Updated weights for policy 0, policy_version 67521 (0.0020) [2024-08-06 06:16:12,285][52671] DAMAGECOUNT value on done: 718733.0 [2024-08-06 06:16:12,285][52671] Sum rewards: 77.512, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.494', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.116', 'weapon2': '0.182', 'AMMO4': '0.201', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.384', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '67.000'} [2024-08-06 06:16:12,417][52668] DAMAGECOUNT value on done: 731939.0 [2024-08-06 06:16:12,417][52668] Sum rewards: 90.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.933', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '72.000'} [2024-08-06 06:16:12,558][52658] DAMAGECOUNT value on done: 731105.0 [2024-08-06 06:16:12,563][52658] Sum rewards: 77.531, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.076', 'weapon5': '0.216', 'AMMO4': '0.242', 'AMMO3': '0.283', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.104', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '67.000'} [2024-08-06 06:16:12,737][52670] DAMAGECOUNT value on done: 720728.0 [2024-08-06 06:16:12,738][52670] Sum rewards: 70.108, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.991', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.172', 'weapon2': '0.206', 'WEAPON3': '1.050', 'HITCOUNT': '3.210', 'weapon3': '3.618', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 06:16:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 553148416. Throughput: 0: 4375.8. Samples: 138294230. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:16:12,794][52567] Avg episode reward: [(0, '73.577')] [2024-08-06 06:16:13,028][52669] DAMAGECOUNT value on done: 748247.0 [2024-08-06 06:16:13,029][52669] Sum rewards: 76.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.905', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.182', 'AMMO3': '0.224', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '63.000'} [2024-08-06 06:16:13,467][52664] DAMAGECOUNT value on done: 742552.0 [2024-08-06 06:16:13,467][52664] Sum rewards: 78.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.506', 'AMMO5': '0.004', 'AMMO2': '0.028', 'weapon5': '0.040', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:14,709][52666] DAMAGECOUNT value on done: 719987.0 [2024-08-06 06:16:14,711][52666] Sum rewards: 60.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '51.000'} [2024-08-06 06:16:14,867][52671] DAMAGECOUNT value on done: 737135.0 [2024-08-06 06:16:14,867][52671] Sum rewards: 79.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.212', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:15,363][52658] DAMAGECOUNT value on done: 722609.0 [2024-08-06 06:16:15,363][52658] Sum rewards: 66.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.241', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.085', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.604', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '56.000'} [2024-08-06 06:16:15,400][52668] DAMAGECOUNT value on done: 731745.0 [2024-08-06 06:16:15,400][52668] Sum rewards: 66.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.115', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'weapon4': '0.330', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '53.000'} [2024-08-06 06:16:15,584][52670] DAMAGECOUNT value on done: 704644.0 [2024-08-06 06:16:15,584][52670] Sum rewards: 68.251, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.715', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.150', 'weapon2': '0.168', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.334', 'WEAPON3': '1.950', 'weapon3': '3.320', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:15,739][52669] DAMAGECOUNT value on done: 738248.0 [2024-08-06 06:16:15,739][52669] Sum rewards: 72.187, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.566', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '62.000'} [2024-08-06 06:16:16,590][52664] DAMAGECOUNT value on done: 757637.0 [2024-08-06 06:16:16,590][52664] Sum rewards: 65.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.102', 'AMMO4': '0.169', 'weapon2': '0.188', 'AMMO3': '0.201', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.232', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '54.000'} [2024-08-06 06:16:16,636][52650] Updated weights for policy 0, policy_version 67531 (0.0013) [2024-08-06 06:16:17,155][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:16:17,611][52671] DAMAGECOUNT value on done: 734957.0 [2024-08-06 06:16:17,613][52671] Sum rewards: 74.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.158', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.107', 'weapon5': '0.124', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.364', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '60.000'} [2024-08-06 06:16:17,631][52666] DAMAGECOUNT value on done: 714269.0 [2024-08-06 06:16:17,632][52666] Sum rewards: 69.253, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.074', 'AMMO4': '0.118', 'weapon4': '0.118', 'WEAPON5': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.286', 'WEAPON3': '1.750', 'weapon3': '3.278', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:17,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 553230336. Throughput: 0: 4378.4. Samples: 138307580. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:16:17,794][52567] Avg episode reward: [(0, '73.196')] [2024-08-06 06:16:17,922][52668] DAMAGECOUNT value on done: 734287.0 [2024-08-06 06:16:17,923][52668] Sum rewards: 75.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.390', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.162', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'weapon4': '0.316', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '60.000'} [2024-08-06 06:16:18,311][52658] DAMAGECOUNT value on done: 724298.0 [2024-08-06 06:16:18,313][52658] Sum rewards: 62.270, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.574', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.172', 'AMMO3': '0.240', 'weapon5': '0.250', 'AMMO4': '0.283', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.816', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '53.000'} [2024-08-06 06:16:18,557][52670] DAMAGECOUNT value on done: 714195.0 [2024-08-06 06:16:18,558][52670] Sum rewards: 63.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.000', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.254', 'weapon2': '0.572', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '55.000'} [2024-08-06 06:16:18,908][52662] DAMAGECOUNT value on done: 728470.0 [2024-08-06 06:16:18,908][52662] Sum rewards: 62.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.298', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.100', 'weapon4': '0.156', 'AMMO4': '0.179', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.166', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '54.500'} [2024-08-06 06:16:18,977][52669] DAMAGECOUNT value on done: 732077.0 [2024-08-06 06:16:18,978][52669] Sum rewards: 84.549, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.235', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'weapon5': '0.142', 'weapon2': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.300', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '72.000'} [2024-08-06 06:16:19,737][52664] DAMAGECOUNT value on done: 748427.0 [2024-08-06 06:16:19,745][52664] Sum rewards: 74.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.493', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '62.000'} [2024-08-06 06:16:20,094][52671] DAMAGECOUNT value on done: 732583.0 [2024-08-06 06:16:20,096][52671] Sum rewards: 59.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.026', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.188', 'AMMO3': '0.195', 'weapon4': '0.212', 'AMMO4': '0.228', 'weapon2': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '3.078', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '50.500'} [2024-08-06 06:16:20,500][52668] DAMAGECOUNT value on done: 718713.0 [2024-08-06 06:16:20,500][52668] Sum rewards: 79.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '64.000'} [2024-08-06 06:16:20,697][52666] DAMAGECOUNT value on done: 717848.0 [2024-08-06 06:16:20,699][52666] Sum rewards: 79.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.390', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '64.000'} [2024-08-06 06:16:21,068][52650] Updated weights for policy 0, policy_version 67541 (0.0017) [2024-08-06 06:16:21,198][52658] DAMAGECOUNT value on done: 728466.0 [2024-08-06 06:16:21,198][52658] Sum rewards: 70.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.102', 'AMMO3': '0.187', 'weapon5': '0.204', 'AMMO4': '0.245', 'weapon2': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '59.000'} [2024-08-06 06:16:21,705][52669] DAMAGECOUNT value on done: 734682.0 [2024-08-06 06:16:21,705][52669] Sum rewards: 81.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.841', 'AMMO5': '0.019', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon4': '0.206', 'AMMO3': '0.248', 'weapon5': '0.314', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.784', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '69.000'} [2024-08-06 06:16:21,764][52670] DAMAGECOUNT value on done: 724063.0 [2024-08-06 06:16:21,764][52670] Sum rewards: 79.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.634', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.178', 'weapon2': '0.220', 'AMMO3': '0.231', 'AMMO4': '0.254', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:21,890][52662] DAMAGECOUNT value on done: 734115.0 [2024-08-06 06:16:21,890][52662] Sum rewards: 77.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon2': '0.206', 'weapon5': '0.230', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.012', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:22,156][52667] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2024-08-06 06:16:22,681][52671] DAMAGECOUNT value on done: 735336.0 [2024-08-06 06:16:22,683][52671] Sum rewards: 83.065, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.110', 'AMMO3': '0.191', 'AMMO4': '0.193', 'weapon5': '0.216', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '67.000'} [2024-08-06 06:16:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 553320448. Throughput: 0: 4385.5. Samples: 138334030. Policy #0 lag: (min: 0.0, avg: 4.4, max: 9.0) [2024-08-06 06:16:22,794][52567] Avg episode reward: [(0, '73.130')] [2024-08-06 06:16:22,906][52664] DAMAGECOUNT value on done: 760737.0 [2024-08-06 06:16:22,906][52664] Sum rewards: 70.489, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.042', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.292', 'AMMO3': '0.297', 'WEAPON3': '1.750', 'weapon3': '3.392', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:23,523][52668] DAMAGECOUNT value on done: 733439.0 [2024-08-06 06:16:23,526][52668] Sum rewards: 84.415, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.412', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.098', 'weapon5': '0.114', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.333', 'WEAPON3': '1.950', 'weapon3': '3.368', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '74.500'} [2024-08-06 06:16:23,813][52666] DAMAGECOUNT value on done: 730349.0 [2024-08-06 06:16:23,813][52666] Sum rewards: 53.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.166', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.100', 'weapon5': '0.202', 'AMMO3': '0.238', 'AMMO4': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.892', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '46.000'} [2024-08-06 06:16:24,567][52670] DAMAGECOUNT value on done: 719892.0 [2024-08-06 06:16:24,568][52670] Sum rewards: 71.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.632', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.106', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:24,754][52669] DAMAGECOUNT value on done: 736170.0 [2024-08-06 06:16:24,762][52669] Sum rewards: 69.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.048', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.140', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.398', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '59.000'} [2024-08-06 06:16:24,944][52662] DAMAGECOUNT value on done: 736975.0 [2024-08-06 06:16:24,944][52662] Sum rewards: 72.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.020', 'AMMO2': '0.070', 'AMMO3': '0.183', 'weapon4': '0.242', 'weapon5': '0.324', 'AMMO4': '0.350', 'weapon2': '0.426', 'WEAPON5': '0.550', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '60.000'} [2024-08-06 06:16:25,180][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:16:25,333][52671] DAMAGECOUNT value on done: 727108.0 [2024-08-06 06:16:25,334][52671] Sum rewards: 73.084, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.680', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.288', 'weapon2': '0.312', 'WEAPON3': '1.750', 'weapon3': '3.398', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:25,716][52664] DAMAGECOUNT value on done: 759153.0 [2024-08-06 06:16:25,716][52664] Sum rewards: 75.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.631', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.225', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.472', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '64.000'} [2024-08-06 06:16:25,795][52650] Updated weights for policy 0, policy_version 67551 (0.0027) [2024-08-06 06:16:26,148][52666] DAMAGECOUNT value on done: 706396.0 [2024-08-06 06:16:26,150][52666] Sum rewards: 76.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.645', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.115', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '64.000'} [2024-08-06 06:16:26,670][52668] DAMAGECOUNT value on done: 732437.0 [2024-08-06 06:16:26,670][52668] Sum rewards: 87.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.193', 'weapon4': '0.284', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '71.000'} [2024-08-06 06:16:27,061][52670] DAMAGECOUNT value on done: 723742.0 [2024-08-06 06:16:27,062][52670] Sum rewards: 80.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.074', 'weapon5': '0.146', 'AMMO3': '0.171', 'AMMO4': '0.232', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '64.000'} [2024-08-06 06:16:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 553410560. Throughput: 0: 4381.8. Samples: 138360260. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:16:27,794][52567] Avg episode reward: [(0, '73.195')] [2024-08-06 06:16:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067555_553410560.pth... [2024-08-06 06:16:27,970][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067042_549208064.pth [2024-08-06 06:16:28,098][52662] DAMAGECOUNT value on done: 721093.0 [2024-08-06 06:16:28,099][52662] Sum rewards: 71.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.170', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.144', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon2': '0.266', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '59.000'} [2024-08-06 06:16:28,293][52664] DAMAGECOUNT value on done: 758563.0 [2024-08-06 06:16:28,295][52664] Sum rewards: 73.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.954', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.170', 'AMMO3': '0.183', 'weapon2': '0.218', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.312', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:29,367][52666] DAMAGECOUNT value on done: 718772.0 [2024-08-06 06:16:29,368][52666] Sum rewards: 70.324, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.414', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:29,698][52668] DAMAGECOUNT value on done: 724505.0 [2024-08-06 06:16:29,703][52668] Sum rewards: 83.510, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.104', 'AMMO5': '0.011', 'weapon4': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '67.000'} [2024-08-06 06:16:30,592][52650] Updated weights for policy 0, policy_version 67561 (0.0016) [2024-08-06 06:16:30,985][52664] DAMAGECOUNT value on done: 763050.0 [2024-08-06 06:16:30,987][52664] Sum rewards: 66.665, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.445', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.119', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.376', 'weapon5': '0.430', 'WEAPON3': '1.000', 'weapon3': '2.924', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '52.000'} [2024-08-06 06:16:31,325][52662] DAMAGECOUNT value on done: 738413.0 [2024-08-06 06:16:31,327][52662] Sum rewards: 63.381, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.740', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.092', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.330', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.900', 'weapon3': '3.006', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '58.000'} [2024-08-06 06:16:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 553492480. Throughput: 0: 4376.4. Samples: 138373020. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:16:32,794][52567] Avg episode reward: [(0, '72.869')] [2024-08-06 06:16:32,943][52668] DAMAGECOUNT value on done: 723751.0 [2024-08-06 06:16:32,943][52668] Sum rewards: 79.980, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.555', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.132', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:33,856][52662] DAMAGECOUNT value on done: 721099.0 [2024-08-06 06:16:33,856][52662] Sum rewards: 71.932, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.152', 'weapon4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.252', 'HEALTH': '0.487', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '59.000'} [2024-08-06 06:16:33,992][52664] DAMAGECOUNT value on done: 764793.0 [2024-08-06 06:16:33,993][52664] Sum rewards: 77.173, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.088', 'AMMO4': '0.088', 'weapon5': '0.134', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:35,091][52650] Updated weights for policy 0, policy_version 67571 (0.0011) [2024-08-06 06:16:36,015][52668] DAMAGECOUNT value on done: 732174.0 [2024-08-06 06:16:36,017][52668] Sum rewards: 74.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.110', 'weapon5': '0.120', 'weapon2': '0.144', 'AMMO4': '0.184', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.392', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.000'} [2024-08-06 06:16:36,700][52664] DAMAGECOUNT value on done: 759602.0 [2024-08-06 06:16:36,701][52664] Sum rewards: 76.035, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.678', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.074', 'AMMO4': '0.187', 'weapon5': '0.192', 'AMMO3': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.800', 'weapon3': '3.046', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.595', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:36,902][52662] DAMAGECOUNT value on done: 727921.0 [2024-08-06 06:16:36,903][52662] Sum rewards: 83.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.078', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.126', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon4': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '69.000'} [2024-08-06 06:16:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 553582592. Throughput: 0: 4374.0. Samples: 138399390. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:16:37,794][52567] Avg episode reward: [(0, '73.019')] [2024-08-06 06:16:39,063][52664] DAMAGECOUNT value on done: 750377.0 [2024-08-06 06:16:39,071][52664] Sum rewards: 74.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.105', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:39,147][52668] DAMAGECOUNT value on done: 728165.0 [2024-08-06 06:16:39,149][52668] Sum rewards: 82.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.136', 'AMMO3': '0.210', 'AMMO4': '0.240', 'weapon2': '0.300', 'weapon5': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '68.000'} [2024-08-06 06:16:39,956][52662] DAMAGECOUNT value on done: 741025.0 [2024-08-06 06:16:39,958][52662] Sum rewards: 86.898, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.477', 'AMMO5': '0.013', 'AMMO2': '0.071', 'weapon4': '0.120', 'weapon5': '0.136', 'AMMO3': '0.290', 'weapon2': '0.304', 'AMMO4': '0.353', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.158', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '75.000'} [2024-08-06 06:16:40,167][52650] Updated weights for policy 0, policy_version 67581 (0.0035) [2024-08-06 06:16:41,559][52647] DAMAGECOUNT value on done: 770908.0 [2024-08-06 06:16:41,559][52647] Sum rewards: 84.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.032', 'AMMO4': '0.111', 'AMMO3': '0.141', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.604', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:41,566][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:16:41,757][52664] DAMAGECOUNT value on done: 751733.0 [2024-08-06 06:16:41,757][52664] Sum rewards: 70.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.902', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.512', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '59.000'} [2024-08-06 06:16:41,889][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:16:42,175][52668] DAMAGECOUNT value on done: 720174.0 [2024-08-06 06:16:42,175][52668] Sum rewards: 75.548, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.128', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.334', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 553664512. Throughput: 0: 4381.6. Samples: 138425970. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:16:42,794][52567] Avg episode reward: [(0, '73.442')] [2024-08-06 06:16:43,132][52662] DAMAGECOUNT value on done: 730199.0 [2024-08-06 06:16:43,133][52662] Sum rewards: 85.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.056', 'AMMO4': '0.177', 'weapon5': '0.216', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '70.000'} [2024-08-06 06:16:44,330][52650] Updated weights for policy 0, policy_version 67591 (0.0010) [2024-08-06 06:16:44,506][52647] DAMAGECOUNT value on done: 761251.0 [2024-08-06 06:16:44,508][52647] Sum rewards: 72.371, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '58.000'} [2024-08-06 06:16:44,648][52664] DAMAGECOUNT value on done: 754461.0 [2024-08-06 06:16:44,650][52664] Sum rewards: 77.380, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.177', 'weapon2': '0.274', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.306', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '67.000'} [2024-08-06 06:16:45,215][52668] DAMAGECOUNT value on done: 714615.0 [2024-08-06 06:16:45,217][52668] Sum rewards: 88.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.584', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.178', 'weapon4': '0.194', 'weapon2': '0.204', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.072', 'FRAGCOUNT': '72.000'} [2024-08-06 06:16:45,891][52662] DAMAGECOUNT value on done: 736962.0 [2024-08-06 06:16:45,891][52662] Sum rewards: 80.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.250', 'AMMO5': '0.004', 'AMMO2': '0.027', 'weapon5': '0.028', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.440', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '67.000'} [2024-08-06 06:16:46,796][52647] DAMAGECOUNT value on done: 769360.0 [2024-08-06 06:16:46,798][52647] Sum rewards: 69.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.704', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.202', 'weapon4': '0.208', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '56.000'} [2024-08-06 06:16:47,087][52664] DAMAGECOUNT value on done: 752287.0 [2024-08-06 06:16:47,088][52664] Sum rewards: 71.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.366', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.078', 'AMMO4': '0.201', 'AMMO3': '0.203', 'weapon2': '0.236', 'weapon5': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '58.000'} [2024-08-06 06:16:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.7, 300 sec: 17467.0). Total num frames: 553754624. Throughput: 0: 4388.0. Samples: 138439270. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:16:47,794][52567] Avg episode reward: [(0, '73.986')] [2024-08-06 06:16:48,219][52668] DAMAGECOUNT value on done: 715893.0 [2024-08-06 06:16:48,222][52668] Sum rewards: 78.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.750', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.430', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '63.000'} [2024-08-06 06:16:48,424][52660] DAMAGECOUNT value on done: 727616.0 [2024-08-06 06:16:48,424][52660] Sum rewards: 69.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.621', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.080', 'AMMO3': '0.179', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.238', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '57.000'} [2024-08-06 06:16:48,904][52662] DAMAGECOUNT value on done: 725232.0 [2024-08-06 06:16:48,904][52662] Sum rewards: 78.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.126', 'AMMO4': '0.161', 'weapon5': '0.256', 'AMMO3': '0.264', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:49,312][52650] Updated weights for policy 0, policy_version 67601 (0.0012) [2024-08-06 06:16:49,469][52647] DAMAGECOUNT value on done: 767671.0 [2024-08-06 06:16:49,470][52647] Sum rewards: 55.368, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.930', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon4': '0.138', 'weapon5': '0.194', 'AMMO4': '0.314', 'AMMO3': '0.318', 'weapon2': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.850', 'HITCOUNT': '2.920', 'weapon3': '2.960', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '52.000'} [2024-08-06 06:16:51,353][52668] DAMAGECOUNT value on done: 714306.0 [2024-08-06 06:16:51,356][52668] Sum rewards: 67.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.851', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.101', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.322', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '56.000'} [2024-08-06 06:16:51,485][52660] DAMAGECOUNT value on done: 718204.0 [2024-08-06 06:16:51,485][52660] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.125', 'weapon5': '0.132', 'weapon2': '0.148', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.516', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:51,787][52662] DAMAGECOUNT value on done: 725839.0 [2024-08-06 06:16:51,788][52662] Sum rewards: 75.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.339', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon4': '0.182', 'weapon5': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '61.000'} [2024-08-06 06:16:52,356][52647] DAMAGECOUNT value on done: 773098.0 [2024-08-06 06:16:52,356][52647] Sum rewards: 55.603, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'AMMO5': '0.029', 'AMMO2': '0.079', 'weapon4': '0.238', 'AMMO3': '0.266', 'weapon2': '0.296', 'weapon5': '0.360', 'AMMO4': '0.394', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.600', 'weapon3': '2.490', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '14.640', 'FRAGCOUNT': '50.000'} [2024-08-06 06:16:52,579][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:16:52,794][52567] Fps is (10 sec: 18840.8, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 553852928. Throughput: 0: 4386.2. Samples: 138465480. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:16:52,795][52567] Avg episode reward: [(0, '73.786')] [2024-08-06 06:16:53,807][52668] DAMAGECOUNT value on done: 726522.0 [2024-08-06 06:16:53,807][52668] Sum rewards: 77.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.094', 'weapon5': '0.198', 'AMMO3': '0.203', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '64.000'} [2024-08-06 06:16:53,964][52660] DAMAGECOUNT value on done: 730633.0 [2024-08-06 06:16:53,965][52660] Sum rewards: 83.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.117', 'weapon5': '0.142', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '68.000'} [2024-08-06 06:16:54,302][52650] Updated weights for policy 0, policy_version 67611 (0.0017) [2024-08-06 06:16:54,558][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:16:54,662][52662] DAMAGECOUNT value on done: 723268.0 [2024-08-06 06:16:54,662][52662] Sum rewards: 76.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.065', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.126', 'AMMO3': '0.170', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '63.000'} [2024-08-06 06:16:55,489][52647] DAMAGECOUNT value on done: 773925.0 [2024-08-06 06:16:55,489][52647] Sum rewards: 85.255, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.185', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon5': '0.228', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.760', 'FRAGCOUNT': '67.000'} [2024-08-06 06:16:56,558][52668] DAMAGECOUNT value on done: 724844.0 [2024-08-06 06:16:56,566][52668] Sum rewards: 87.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.940', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.122', 'AMMO4': '0.219', 'weapon5': '0.230', 'AMMO3': '0.239', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '22.071', 'FRAGCOUNT': '73.000'} [2024-08-06 06:16:56,806][52649] DAMAGECOUNT value on done: 705812.0 [2024-08-06 06:16:56,806][52649] Sum rewards: 65.499, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.304', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.149', 'weapon5': '0.166', 'AMMO4': '0.177', 'weapon2': '0.310', 'weapon4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.010', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '52.000'} [2024-08-06 06:16:56,858][52660] DAMAGECOUNT value on done: 738190.0 [2024-08-06 06:16:56,858][52660] Sum rewards: 69.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.150', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.127', 'weapon5': '0.134', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.232', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '56.000'} [2024-08-06 06:16:57,711][52662] DAMAGECOUNT value on done: 733195.0 [2024-08-06 06:16:57,712][52662] Sum rewards: 88.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.546', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.158', 'AMMO4': '0.167', 'AMMO3': '0.203', 'weapon5': '0.222', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.456', 'FRAGCOUNT': '71.000'} [2024-08-06 06:16:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 553934848. Throughput: 0: 4388.7. Samples: 138491720. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:16:57,795][52567] Avg episode reward: [(0, '74.213')] [2024-08-06 06:16:58,508][52650] Updated weights for policy 0, policy_version 67621 (0.0022) [2024-08-06 06:16:58,609][52647] DAMAGECOUNT value on done: 772633.0 [2024-08-06 06:16:58,610][52647] Sum rewards: 77.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.282', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.253', 'weapon2': '0.292', 'weapon4': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '65.000'} [2024-08-06 06:16:59,282][52649] DAMAGECOUNT value on done: 699415.0 [2024-08-06 06:16:59,282][52649] Sum rewards: 79.490, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.098', 'AMMO3': '0.243', 'weapon5': '0.262', 'weapon2': '0.282', 'AMMO4': '0.292', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '66.000'} [2024-08-06 06:16:59,542][52668] DAMAGECOUNT value on done: 724857.0 [2024-08-06 06:16:59,544][52668] Sum rewards: 59.754, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.062', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.141', 'weapon5': '0.194', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.796', 'WEAPON3': '1.200', 'weapon3': '2.748', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.310', 'FRAGCOUNT': '49.000'} [2024-08-06 06:16:59,723][52660] DAMAGECOUNT value on done: 722275.0 [2024-08-06 06:16:59,724][52660] Sum rewards: 77.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.554', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '66.000'} [2024-08-06 06:17:00,843][52662] DAMAGECOUNT value on done: 723128.0 [2024-08-06 06:17:00,843][52662] Sum rewards: 73.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.744', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.252', 'AMMO3': '0.276', 'WEAPON3': '1.650', 'weapon3': '3.406', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:01,650][52647] DAMAGECOUNT value on done: 753464.0 [2024-08-06 06:17:01,658][52647] Sum rewards: 72.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.506', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.074', 'weapon5': '0.184', 'AMMO3': '0.209', 'AMMO4': '0.213', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '61.000'} [2024-08-06 06:17:02,169][52668] DAMAGECOUNT value on done: 730750.0 [2024-08-06 06:17:02,169][52668] Sum rewards: 74.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.907', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.172', 'AMMO3': '0.198', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '61.000'} [2024-08-06 06:17:02,569][52660] DAMAGECOUNT value on done: 718027.0 [2024-08-06 06:17:02,571][52660] Sum rewards: 68.216, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.957', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.070', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.450', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '55.000'} [2024-08-06 06:17:02,617][52649] DAMAGECOUNT value on done: 717044.0 [2024-08-06 06:17:02,617][52649] Sum rewards: 71.054, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.148', 'weapon5': '0.164', 'weapon2': '0.184', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.418', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:02,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 554016768. Throughput: 0: 4382.9. Samples: 138504810. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 06:17:02,795][52567] Avg episode reward: [(0, '74.366')] [2024-08-06 06:17:03,238][52650] Updated weights for policy 0, policy_version 67631 (0.0040) [2024-08-06 06:17:03,529][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:17:03,896][52662] DAMAGECOUNT value on done: 736810.0 [2024-08-06 06:17:03,897][52662] Sum rewards: 73.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.356', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:03,927][52647] DAMAGECOUNT value on done: 769233.0 [2024-08-06 06:17:03,928][52647] Sum rewards: 73.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.235', 'AMMO5': '0.009', 'AMMO2': '0.052', 'weapon4': '0.110', 'weapon5': '0.144', 'AMMO3': '0.245', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '61.000'} [2024-08-06 06:17:05,053][52668] DAMAGECOUNT value on done: 730086.0 [2024-08-06 06:17:05,055][52668] Sum rewards: 73.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.652', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.380', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '61.000'} [2024-08-06 06:17:05,273][52660] DAMAGECOUNT value on done: 725427.0 [2024-08-06 06:17:05,273][52660] Sum rewards: 74.052, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon5': '0.132', 'AMMO3': '0.169', 'weapon2': '0.226', 'AMMO4': '0.295', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:05,719][52649] DAMAGECOUNT value on done: 712228.0 [2024-08-06 06:17:05,719][52649] Sum rewards: 72.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.121', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.400', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:06,558][52647] DAMAGECOUNT value on done: 767870.0 [2024-08-06 06:17:06,558][52647] Sum rewards: 76.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.284', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.191', 'weapon5': '0.224', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:06,679][52803] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2024-08-06 06:17:07,364][52662] DAMAGECOUNT value on done: 732084.0 [2024-08-06 06:17:07,364][52662] Sum rewards: 68.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.918', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.281', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.314', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:07,728][52667] Large shaping reward 2.522 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('HEALTH', -0.054, -18.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:17:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 554106880. Throughput: 0: 4381.1. Samples: 138531180. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:07,795][52567] Avg episode reward: [(0, '74.402')] [2024-08-06 06:17:08,097][52650] Updated weights for policy 0, policy_version 67641 (0.0011) [2024-08-06 06:17:08,126][52649] DAMAGECOUNT value on done: 701122.0 [2024-08-06 06:17:08,128][52649] Sum rewards: 77.006, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.060', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.602', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:08,294][52660] DAMAGECOUNT value on done: 733231.0 [2024-08-06 06:17:08,299][52660] Sum rewards: 70.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.945', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.122', 'weapon5': '0.136', 'weapon4': '0.258', 'AMMO4': '0.269', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.920', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '56.000'} [2024-08-06 06:17:09,646][52647] DAMAGECOUNT value on done: 765549.0 [2024-08-06 06:17:09,646][52647] Sum rewards: 72.779, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.825', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.144', 'weapon4': '0.164', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '1.004', 'WEAPON3': '1.300', 'weapon3': '2.502', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:10,705][52662] DAMAGECOUNT value on done: 719686.0 [2024-08-06 06:17:10,707][52662] Sum rewards: 74.875, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.672', 'AMMO5': '0.023', 'AMMO2': '0.066', 'AMMO3': '0.290', 'weapon4': '0.306', 'weapon5': '0.320', 'AMMO4': '0.329', 'weapon2': '0.428', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.550', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:10,856][52660] DAMAGECOUNT value on done: 720521.0 [2024-08-06 06:17:10,856][52660] Sum rewards: 69.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.574', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.094', 'weapon5': '0.220', 'weapon2': '0.242', 'AMMO3': '0.256', 'AMMO4': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '57.000'} [2024-08-06 06:17:10,918][52649] DAMAGECOUNT value on done: 715830.0 [2024-08-06 06:17:10,919][52649] Sum rewards: 72.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:11,943][52647] DAMAGECOUNT value on done: 759482.0 [2024-08-06 06:17:11,952][52647] Sum rewards: 73.252, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.055', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.149', 'weapon5': '0.156', 'weapon2': '0.206', 'WEAPON4': '0.300', 'AMMO3': '0.327', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.238', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '66.000'} [2024-08-06 06:17:12,102][52659] DAMAGECOUNT value on done: 730697.0 [2024-08-06 06:17:12,103][52659] Sum rewards: 79.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.434', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.154', 'AMMO3': '0.179', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:12,704][52650] Updated weights for policy 0, policy_version 67651 (0.0013) [2024-08-06 06:17:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 554196992. Throughput: 0: 4380.2. Samples: 138557370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:12,794][52567] Avg episode reward: [(0, '74.113')] [2024-08-06 06:17:13,472][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:17:13,487][52662] DAMAGECOUNT value on done: 728741.0 [2024-08-06 06:17:13,488][52662] Sum rewards: 66.194, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.521', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.153', 'weapon5': '0.180', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '2.986', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '54.000'} [2024-08-06 06:17:13,950][52660] DAMAGECOUNT value on done: 722536.0 [2024-08-06 06:17:13,950][52660] Sum rewards: 63.719, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.146', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'HITCOUNT': '3.370', 'weapon3': '3.382', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '55.000'} [2024-08-06 06:17:14,106][52649] DAMAGECOUNT value on done: 710625.0 [2024-08-06 06:17:14,106][52649] Sum rewards: 78.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.038', 'weapon5': '0.038', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.166', 'AMMO3': '0.223', 'WEAPON3': '1.300', 'weapon3': '3.560', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:14,638][52647] DAMAGECOUNT value on done: 773159.0 [2024-08-06 06:17:14,639][52647] Sum rewards: 75.757, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.146', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:15,337][52659] DAMAGECOUNT value on done: 728927.0 [2024-08-06 06:17:15,338][52659] Sum rewards: 72.045, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.176', 'AMMO4': '0.189', 'AMMO3': '0.235', 'weapon5': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:16,248][52662] DAMAGECOUNT value on done: 718186.0 [2024-08-06 06:17:16,248][52662] Sum rewards: 74.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.684', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.083', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 06:17:16,648][52649] DAMAGECOUNT value on done: 713054.0 [2024-08-06 06:17:16,649][52649] Sum rewards: 84.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.066', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.144', 'AMMO3': '0.191', 'weapon2': '0.240', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.675', 'FRAGCOUNT': '66.000'} [2024-08-06 06:17:16,750][52660] DAMAGECOUNT value on done: 727446.0 [2024-08-06 06:17:16,752][52660] Sum rewards: 58.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.052', 'weapon4': '0.086', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.348', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.310', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '50.000'} [2024-08-06 06:17:17,281][52650] Updated weights for policy 0, policy_version 67661 (0.0019) [2024-08-06 06:17:17,479][52647] DAMAGECOUNT value on done: 757532.0 [2024-08-06 06:17:17,481][52647] Sum rewards: 76.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.066', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon2': '0.196', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.572', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:17,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 554287104. Throughput: 0: 4387.3. Samples: 138570450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:17,794][52567] Avg episode reward: [(0, '74.295')] [2024-08-06 06:17:18,211][52665] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2024-08-06 06:17:18,483][52659] DAMAGECOUNT value on done: 732505.0 [2024-08-06 06:17:18,486][52659] Sum rewards: 76.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.622', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.150', 'AMMO4': '0.205', 'weapon5': '0.206', 'AMMO3': '0.232', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:19,270][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:17:19,660][52649] DAMAGECOUNT value on done: 712558.0 [2024-08-06 06:17:19,662][52649] Sum rewards: 77.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'weapon4': '0.116', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.386', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.238', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:19,845][52660] DAMAGECOUNT value on done: 718953.0 [2024-08-06 06:17:19,845][52660] Sum rewards: 54.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.702', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon5': '0.174', 'weapon2': '0.248', 'AMMO3': '0.257', 'AMMO4': '0.325', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.668', 'WEAPON3': '1.550', 'weapon3': '2.566', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '48.000'} [2024-08-06 06:17:19,906][52647] DAMAGECOUNT value on done: 769936.0 [2024-08-06 06:17:19,907][52647] Sum rewards: 74.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.225', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.252', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:20,304][52811] DAMAGECOUNT value on done: 693540.0 [2024-08-06 06:17:20,304][52811] Sum rewards: 77.966, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'ARMOR': '0.008', 'AMMO5': '0.020', 'AMMO2': '0.067', 'weapon4': '0.188', 'weapon5': '0.240', 'AMMO3': '0.250', 'weapon2': '0.262', 'AMMO4': '0.337', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '66.000'} [2024-08-06 06:17:21,259][52659] DAMAGECOUNT value on done: 730995.0 [2024-08-06 06:17:21,259][52659] Sum rewards: 84.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.066', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '70.000'} [2024-08-06 06:17:21,997][52650] Updated weights for policy 0, policy_version 67671 (0.0012) [2024-08-06 06:17:22,547][52647] DAMAGECOUNT value on done: 771087.0 [2024-08-06 06:17:22,547][52647] Sum rewards: 67.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.662', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.112', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '56.000'} [2024-08-06 06:17:22,582][52649] DAMAGECOUNT value on done: 704928.0 [2024-08-06 06:17:22,582][52649] Sum rewards: 79.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.106', 'weapon5': '0.154', 'AMMO4': '0.173', 'AMMO3': '0.211', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '68.000'} [2024-08-06 06:17:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 554369024. Throughput: 0: 4382.2. Samples: 138596590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:22,794][52567] Avg episode reward: [(0, '74.705')] [2024-08-06 06:17:23,023][52660] DAMAGECOUNT value on done: 726529.0 [2024-08-06 06:17:23,024][52660] Sum rewards: 79.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.417', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.102', 'AMMO3': '0.184', 'AMMO4': '0.218', 'weapon2': '0.240', 'weapon5': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:23,577][52811] DAMAGECOUNT value on done: 675651.0 [2024-08-06 06:17:23,582][52811] Sum rewards: 78.061, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.921', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.156', 'AMMO4': '0.221', 'weapon4': '0.230', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.988', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '67.000'} [2024-08-06 06:17:23,952][52659] DAMAGECOUNT value on done: 727983.0 [2024-08-06 06:17:23,952][52659] Sum rewards: 69.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.078', 'weapon5': '0.170', 'AMMO4': '0.202', 'AMMO3': '0.220', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:25,420][52649] DAMAGECOUNT value on done: 717465.0 [2024-08-06 06:17:25,421][52649] Sum rewards: 78.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.197', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.098', 'weapon4': '0.136', 'AMMO3': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '65.000'} [2024-08-06 06:17:25,474][52647] DAMAGECOUNT value on done: 757893.0 [2024-08-06 06:17:25,475][52647] Sum rewards: 91.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon5': '0.038', 'AMMO4': '0.086', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.366', 'FRAGCOUNT': '76.000'} [2024-08-06 06:17:26,268][52660] DAMAGECOUNT value on done: 736184.0 [2024-08-06 06:17:26,271][52660] Sum rewards: 85.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.258', 'AMMO5': '0.018', 'AMMO2': '0.073', 'weapon4': '0.134', 'AMMO3': '0.220', 'weapon2': '0.310', 'weapon5': '0.324', 'AMMO4': '0.365', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '71.000'} [2024-08-06 06:17:26,663][52659] DAMAGECOUNT value on done: 731730.0 [2024-08-06 06:17:26,663][52659] Sum rewards: 69.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.138', 'AMMO3': '0.208', 'weapon5': '0.236', 'AMMO4': '0.247', 'weapon2': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '58.000'} [2024-08-06 06:17:26,742][52811] DAMAGECOUNT value on done: 675046.0 [2024-08-06 06:17:26,746][52811] Sum rewards: 83.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.248', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '70.000'} [2024-08-06 06:17:26,841][52650] Updated weights for policy 0, policy_version 67681 (0.0027) [2024-08-06 06:17:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.3). Total num frames: 554467328. Throughput: 0: 4371.6. Samples: 138622690. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:27,794][52567] Avg episode reward: [(0, '74.839')] [2024-08-06 06:17:28,226][52649] DAMAGECOUNT value on done: 717982.0 [2024-08-06 06:17:28,228][52649] Sum rewards: 75.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.466', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:28,247][52647] DAMAGECOUNT value on done: 763757.0 [2024-08-06 06:17:28,247][52647] Sum rewards: 66.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.828', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.146', 'AMMO4': '0.160', 'AMMO3': '0.195', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.000'} [2024-08-06 06:17:29,443][52660] DAMAGECOUNT value on done: 745030.0 [2024-08-06 06:17:29,444][52660] Sum rewards: 70.951, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.144', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON4': '0.400', 'weapon4': '0.682', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 06:17:29,651][52659] DAMAGECOUNT value on done: 730364.0 [2024-08-06 06:17:29,653][52659] Sum rewards: 73.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.081', 'AMMO5': '0.024', 'AMMO2': '0.055', 'AMMO3': '0.255', 'weapon2': '0.256', 'AMMO4': '0.275', 'weapon4': '0.346', 'weapon5': '0.354', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.678', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:30,066][52811] DAMAGECOUNT value on done: 676275.0 [2024-08-06 06:17:30,066][52811] Sum rewards: 74.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon5': '0.118', 'weapon2': '0.198', 'weapon4': '0.212', 'AMMO4': '0.250', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:30,799][52667] DAMAGECOUNT value on done: 728686.0 [2024-08-06 06:17:30,799][52667] Sum rewards: 75.069, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.423', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.152', 'weapon4': '0.164', 'AMMO4': '0.191', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:30,868][52647] DAMAGECOUNT value on done: 753190.0 [2024-08-06 06:17:30,869][52647] Sum rewards: 71.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.039', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.380', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:30,959][52649] DAMAGECOUNT value on done: 718480.0 [2024-08-06 06:17:30,962][52649] Sum rewards: 74.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.743', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:31,529][52650] Updated weights for policy 0, policy_version 67691 (0.0036) [2024-08-06 06:17:32,561][52660] DAMAGECOUNT value on done: 724138.0 [2024-08-06 06:17:32,563][52660] Sum rewards: 79.982, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.952', 'AMMO5': '0.024', 'AMMO2': '0.073', 'AMMO3': '0.163', 'weapon2': '0.214', 'weapon5': '0.332', 'AMMO4': '0.366', 'weapon4': '0.416', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.772', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 554541056. Throughput: 0: 4364.2. Samples: 138635660. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:32,795][52567] Avg episode reward: [(0, '74.809')] [2024-08-06 06:17:32,878][52659] DAMAGECOUNT value on done: 727556.0 [2024-08-06 06:17:32,879][52659] Sum rewards: 79.519, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.130', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.112', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '67.000'} [2024-08-06 06:17:33,312][52811] DAMAGECOUNT value on done: 684447.0 [2024-08-06 06:17:33,312][52811] Sum rewards: 68.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.016', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.158', 'weapon2': '0.162', 'AMMO4': '0.175', 'AMMO3': '0.185', 'weapon4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '3.180', 'weapon3': '3.226', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '54.500'} [2024-08-06 06:17:33,414][52647] DAMAGECOUNT value on done: 758603.0 [2024-08-06 06:17:33,414][52647] Sum rewards: 70.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.653', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:33,582][52820] DAMAGECOUNT value on done: 674774.0 [2024-08-06 06:17:33,583][52820] Sum rewards: 82.660, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.150', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.184', 'weapon5': '0.218', 'AMMO3': '0.274', 'AMMO4': '0.278', 'weapon2': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '71.000'} [2024-08-06 06:17:33,639][52795] DAMAGECOUNT value on done: 678440.0 [2024-08-06 06:17:33,639][52795] Sum rewards: 76.699, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.764', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO3': '0.163', 'weapon5': '0.172', 'AMMO4': '0.198', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:33,768][52667] DAMAGECOUNT value on done: 732962.0 [2024-08-06 06:17:33,769][52667] Sum rewards: 68.804, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.088', 'AMMO4': '0.186', 'weapon5': '0.192', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '57.000'} [2024-08-06 06:17:34,260][52649] DAMAGECOUNT value on done: 717378.0 [2024-08-06 06:17:34,261][52649] Sum rewards: 79.375, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'weapon5': '0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon2': '0.440', 'WEAPON3': '0.950', 'weapon3': '3.410', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:35,258][52660] DAMAGECOUNT value on done: 731716.0 [2024-08-06 06:17:35,259][52660] Sum rewards: 73.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.038', 'AMMO4': '0.112', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 06:17:35,869][52659] DAMAGECOUNT value on done: 731511.0 [2024-08-06 06:17:35,869][52659] Sum rewards: 78.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.008', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.094', 'AMMO4': '0.151', 'AMMO3': '0.272', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.282', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '68.000'} [2024-08-06 06:17:36,192][52650] Updated weights for policy 0, policy_version 67701 (0.0011) [2024-08-06 06:17:36,341][52811] DAMAGECOUNT value on done: 688556.0 [2024-08-06 06:17:36,343][52811] Sum rewards: 72.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.026', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.364', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.326', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:36,701][52820] DAMAGECOUNT value on done: 675880.0 [2024-08-06 06:17:36,703][52820] Sum rewards: 72.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.096', 'AMMO4': '0.196', 'AMMO3': '0.220', 'weapon5': '0.228', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:36,714][52795] DAMAGECOUNT value on done: 665420.0 [2024-08-06 06:17:36,716][52795] Sum rewards: 77.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.849', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.268', 'WEAPON3': '1.150', 'HITCOUNT': '3.430', 'weapon3': '3.504', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:37,063][52667] DAMAGECOUNT value on done: 730581.0 [2024-08-06 06:17:37,065][52667] Sum rewards: 75.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.648', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.192', 'weapon2': '0.196', 'AMMO4': '0.220', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.266', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:37,510][52649] DAMAGECOUNT value on done: 703199.0 [2024-08-06 06:17:37,510][52649] Sum rewards: 73.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.103', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.024', 'weapon5': '0.036', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.486', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 554631168. Throughput: 0: 4373.6. Samples: 138662290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:37,794][52567] Avg episode reward: [(0, '74.798')] [2024-08-06 06:17:37,995][52660] DAMAGECOUNT value on done: 727256.0 [2024-08-06 06:17:37,997][52660] Sum rewards: 70.300, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.394', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.158', 'weapon4': '0.216', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:38,668][52659] DAMAGECOUNT value on done: 737229.0 [2024-08-06 06:17:38,671][52659] Sum rewards: 75.062, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.454', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon2': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.276', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '67.000'} [2024-08-06 06:17:39,336][52811] DAMAGECOUNT value on done: 685629.0 [2024-08-06 06:17:39,336][52811] Sum rewards: 67.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.599', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.060', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '58.000'} [2024-08-06 06:17:39,746][52795] DAMAGECOUNT value on done: 666475.0 [2024-08-06 06:17:39,747][52795] Sum rewards: 66.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.143', 'weapon5': '0.144', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '56.000'} [2024-08-06 06:17:39,836][52820] DAMAGECOUNT value on done: 676630.0 [2024-08-06 06:17:39,838][52820] Sum rewards: 83.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.519', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.164', 'AMMO4': '0.170', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '21.030', 'FRAGCOUNT': '68.000'} [2024-08-06 06:17:39,925][52667] DAMAGECOUNT value on done: 738256.0 [2024-08-06 06:17:39,925][52667] Sum rewards: 93.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.896', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.050', 'weapon5': '0.140', 'AMMO3': '0.207', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '22.899', 'FRAGCOUNT': '76.000'} [2024-08-06 06:17:40,268][52649] DAMAGECOUNT value on done: 713740.0 [2024-08-06 06:17:40,268][52649] Sum rewards: 71.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.072', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.280', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:40,594][52660] DAMAGECOUNT value on done: 720636.0 [2024-08-06 06:17:40,595][52660] Sum rewards: 76.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon2': '0.194', 'weapon5': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.227', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:40,636][52650] Updated weights for policy 0, policy_version 67711 (0.0012) [2024-08-06 06:17:41,620][52659] DAMAGECOUNT value on done: 724997.0 [2024-08-06 06:17:41,620][52659] Sum rewards: 80.095, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.394', 'AMMO5': '0.021', 'AMMO2': '0.067', 'weapon5': '0.172', 'weapon4': '0.226', 'AMMO3': '0.244', 'weapon2': '0.332', 'AMMO4': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '68.000'} [2024-08-06 06:17:42,402][52794] DAMAGECOUNT value on done: 726928.0 [2024-08-06 06:17:42,402][52794] Sum rewards: 74.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.395', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.136', 'weapon4': '0.206', 'AMMO4': '0.243', 'AMMO3': '0.251', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:42,440][52811] DAMAGECOUNT value on done: 675179.0 [2024-08-06 06:17:42,441][52811] Sum rewards: 59.274, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.116', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.086', 'AMMO3': '0.183', 'AMMO4': '0.239', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.892', 'DAMAGECOUNT': '13.968', 'FRAGCOUNT': '50.000'} [2024-08-06 06:17:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 554721280. Throughput: 0: 4379.1. Samples: 138688780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:17:42,794][52567] Avg episode reward: [(0, '74.247')] [2024-08-06 06:17:42,898][52795] DAMAGECOUNT value on done: 674460.0 [2024-08-06 06:17:42,901][52795] Sum rewards: 66.753, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.372', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.084', 'weapon4': '0.092', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.796', 'FRAGCOUNT': '55.000'} [2024-08-06 06:17:43,094][52820] DAMAGECOUNT value on done: 667142.0 [2024-08-06 06:17:43,094][52820] Sum rewards: 71.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.667', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon4': '0.228', 'AMMO3': '0.257', 'weapon5': '0.276', 'AMMO4': '0.284', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.828', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '61.000'} [2024-08-06 06:17:43,126][52667] DAMAGECOUNT value on done: 737728.0 [2024-08-06 06:17:43,129][52667] Sum rewards: 84.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.344', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '69.000'} [2024-08-06 06:17:43,284][52660] DAMAGECOUNT value on done: 717134.0 [2024-08-06 06:17:43,285][52660] Sum rewards: 74.337, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.662', 'AMMO5': '0.011', 'weapon4': '0.028', 'AMMO2': '0.042', 'weapon5': '0.062', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.262', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:43,491][52649] DAMAGECOUNT value on done: 701911.0 [2024-08-06 06:17:43,494][52649] Sum rewards: 66.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.785', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'weapon4': '0.094', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '57.000'} [2024-08-06 06:17:44,576][52659] DAMAGECOUNT value on done: 733660.0 [2024-08-06 06:17:44,578][52659] Sum rewards: 67.339, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.180', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.048', 'AMMO4': '0.153', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.420', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:45,157][52794] DAMAGECOUNT value on done: 735837.0 [2024-08-06 06:17:45,159][52794] Sum rewards: 77.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.858', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.100', 'AMMO3': '0.241', 'weapon2': '0.266', 'AMMO4': '0.270', 'weapon5': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.110', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '65.000'} [2024-08-06 06:17:45,453][52650] Updated weights for policy 0, policy_version 67721 (0.0010) [2024-08-06 06:17:45,637][52811] DAMAGECOUNT value on done: 687806.0 [2024-08-06 06:17:45,639][52811] Sum rewards: 64.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.920', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.202', 'AMMO4': '0.240', 'weapon5': '0.248', 'AMMO3': '0.280', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.832', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '55.000'} [2024-08-06 06:17:46,020][52795] DAMAGECOUNT value on done: 667389.0 [2024-08-06 06:17:46,021][52795] Sum rewards: 81.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.070', 'weapon5': '0.118', 'AMMO4': '0.167', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '66.000'} [2024-08-06 06:17:46,027][52667] DAMAGECOUNT value on done: 738384.0 [2024-08-06 06:17:46,028][52667] Sum rewards: 73.163, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.088', 'weapon2': '0.166', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'WEAPON3': '1.600', 'HITCOUNT': '3.280', 'weapon3': '3.440', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '65.000'} [2024-08-06 06:17:46,258][52820] DAMAGECOUNT value on done: 681849.0 [2024-08-06 06:17:46,258][52820] Sum rewards: 82.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon4': '0.208', 'AMMO3': '0.216', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '68.000'} [2024-08-06 06:17:46,462][52649] DAMAGECOUNT value on done: 717165.0 [2024-08-06 06:17:46,465][52649] Sum rewards: 79.017, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.106', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '67.000'} [2024-08-06 06:17:47,287][52659] DAMAGECOUNT value on done: 729879.0 [2024-08-06 06:17:47,288][52659] Sum rewards: 86.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.454', 'AMMO5': '0.008', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.151', 'weapon2': '0.202', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.448', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '71.000'} [2024-08-06 06:17:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17550.4). Total num frames: 554811392. Throughput: 0: 4379.3. Samples: 138701880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:17:47,794][52567] Avg episode reward: [(0, '74.455')] [2024-08-06 06:17:48,115][52794] DAMAGECOUNT value on done: 739466.0 [2024-08-06 06:17:48,116][52794] Sum rewards: 79.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.914', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.178', 'AMMO4': '0.192', 'AMMO3': '0.209', 'weapon2': '0.240', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '65.000'} [2024-08-06 06:17:48,782][52811] DAMAGECOUNT value on done: 684245.0 [2024-08-06 06:17:48,783][52811] Sum rewards: 71.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.256', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon2': '0.192', 'weapon5': '0.220', 'AMMO4': '0.226', 'AMMO3': '0.227', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '60.500'} [2024-08-06 06:17:49,156][52795] DAMAGECOUNT value on done: 676573.0 [2024-08-06 06:17:49,157][52795] Sum rewards: 72.943, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.815', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.126', 'AMMO4': '0.131', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.346', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:49,314][52667] DAMAGECOUNT value on done: 733927.0 [2024-08-06 06:17:49,317][52667] Sum rewards: 69.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '56.000'} [2024-08-06 06:17:49,323][52820] DAMAGECOUNT value on done: 663770.0 [2024-08-06 06:17:49,326][52820] Sum rewards: 76.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.080', 'AMMO4': '0.174', 'weapon2': '0.186', 'weapon5': '0.190', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:49,424][52649] DAMAGECOUNT value on done: 719878.0 [2024-08-06 06:17:49,424][52649] Sum rewards: 76.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.903', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.094', 'weapon5': '0.228', 'AMMO3': '0.243', 'AMMO4': '0.256', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:49,888][52650] Updated weights for policy 0, policy_version 67731 (0.0012) [2024-08-06 06:17:50,200][52659] DAMAGECOUNT value on done: 730734.0 [2024-08-06 06:17:50,203][52659] Sum rewards: 80.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.846', 'AMMO5': '0.018', 'AMMO2': '0.046', 'AMMO3': '0.184', 'weapon4': '0.188', 'weapon2': '0.212', 'AMMO4': '0.231', 'weapon5': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:50,909][52665] DAMAGECOUNT value on done: 715302.0 [2024-08-06 06:17:50,912][52665] Sum rewards: 84.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.017', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.230', 'AMMO3': '0.231', 'weapon4': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.788', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '70.000'} [2024-08-06 06:17:50,952][52794] DAMAGECOUNT value on done: 724338.0 [2024-08-06 06:17:50,955][52794] Sum rewards: 80.713, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.187', 'AMMO3': '0.201', 'weapon4': '0.288', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '65.000'} [2024-08-06 06:17:51,976][52811] DAMAGECOUNT value on done: 686822.0 [2024-08-06 06:17:51,977][52811] Sum rewards: 71.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.609', 'AMMO5': '0.005', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon2': '0.204', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '60.000'} [2024-08-06 06:17:52,266][52795] DAMAGECOUNT value on done: 682826.0 [2024-08-06 06:17:52,267][52795] Sum rewards: 82.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.101', 'weapon5': '0.124', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON3': '1.250', 'weapon3': '3.426', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '68.000'} [2024-08-06 06:17:52,457][52667] DAMAGECOUNT value on done: 730671.0 [2024-08-06 06:17:52,458][52667] Sum rewards: 69.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 06:17:52,477][52649] DAMAGECOUNT value on done: 709390.0 [2024-08-06 06:17:52,478][52649] Sum rewards: 72.254, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.140', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.096', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'AMMO3': '0.326', 'WEAPON3': '1.950', 'weapon3': '3.214', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '66.000'} [2024-08-06 06:17:52,569][52820] DAMAGECOUNT value on done: 675348.0 [2024-08-06 06:17:52,571][52820] Sum rewards: 62.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.908', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon5': '0.164', 'AMMO3': '0.204', 'weapon4': '0.206', 'AMMO4': '0.287', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.213', 'FRAGCOUNT': '53.000'} [2024-08-06 06:17:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17550.3). Total num frames: 554901504. Throughput: 0: 4376.9. Samples: 138728140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:17:52,795][52567] Avg episode reward: [(0, '74.551')] [2024-08-06 06:17:52,883][52659] DAMAGECOUNT value on done: 736118.0 [2024-08-06 06:17:52,884][52659] Sum rewards: 62.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.090', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon4': '0.090', 'weapon5': '0.204', 'weapon2': '0.280', 'AMMO3': '0.292', 'AMMO4': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.110', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.705', 'FRAGCOUNT': '56.000'} [2024-08-06 06:17:53,995][52665] DAMAGECOUNT value on done: 730829.0 [2024-08-06 06:17:53,996][52665] Sum rewards: 75.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.540', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.119', 'weapon5': '0.148', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '65.000'} [2024-08-06 06:17:54,040][52794] DAMAGECOUNT value on done: 725158.0 [2024-08-06 06:17:54,041][52794] Sum rewards: 69.677, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.131', 'weapon5': '0.170', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '54.000'} [2024-08-06 06:17:54,682][52650] Updated weights for policy 0, policy_version 67741 (0.0027) [2024-08-06 06:17:55,157][52811] DAMAGECOUNT value on done: 690763.0 [2024-08-06 06:17:55,157][52811] Sum rewards: 89.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.864', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.178', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'weapon3': '3.228', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.963', 'FRAGCOUNT': '75.000'} [2024-08-06 06:17:55,443][52795] DAMAGECOUNT value on done: 673775.0 [2024-08-06 06:17:55,444][52795] Sum rewards: 67.439, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.430', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.090', 'weapon5': '0.154', 'AMMO3': '0.270', 'weapon2': '0.298', 'AMMO4': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:55,629][52667] DAMAGECOUNT value on done: 732929.0 [2024-08-06 06:17:55,630][52667] Sum rewards: 70.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '59.000'} [2024-08-06 06:17:55,667][52820] DAMAGECOUNT value on done: 677636.0 [2024-08-06 06:17:55,667][52820] Sum rewards: 68.632, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.013', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.086', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.866', 'WEAPON3': '0.950', 'weapon3': '2.632', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '54.000'} [2024-08-06 06:17:55,930][52659] DAMAGECOUNT value on done: 732272.0 [2024-08-06 06:17:55,931][52659] Sum rewards: 73.218, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.517', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon4': '0.142', 'weapon5': '0.290', 'AMMO3': '0.292', 'AMMO4': '0.303', 'weapon2': '0.376', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.866', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '62.000'} [2024-08-06 06:17:56,910][52794] DAMAGECOUNT value on done: 731317.0 [2024-08-06 06:17:56,910][52794] Sum rewards: 86.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.751', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.056', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.664', 'FRAGCOUNT': '70.000'} [2024-08-06 06:17:57,072][52665] DAMAGECOUNT value on done: 730401.0 [2024-08-06 06:17:57,074][52665] Sum rewards: 76.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.134', 'weapon4': '0.218', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 554983424. Throughput: 0: 4374.0. Samples: 138754200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:17:57,794][52567] Avg episode reward: [(0, '74.607')] [2024-08-06 06:17:58,146][52811] DAMAGECOUNT value on done: 683873.0 [2024-08-06 06:17:58,148][52811] Sum rewards: 72.775, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.084', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.114', 'weapon4': '0.136', 'AMMO4': '0.140', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.750', 'weapon3': '3.152', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '63.000'} [2024-08-06 06:17:58,513][52667] DAMAGECOUNT value on done: 741277.0 [2024-08-06 06:17:58,514][52667] Sum rewards: 73.734, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.800', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.317', 'weapon2': '0.346', 'WEAPON3': '1.950', 'weapon3': '3.398', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '64.000'} [2024-08-06 06:17:58,600][52795] DAMAGECOUNT value on done: 673177.0 [2024-08-06 06:17:58,603][52795] Sum rewards: 80.842, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'ARMOR': '0.036', 'weapon5': '0.084', 'weapon4': '0.114', 'AMMO4': '0.137', 'HEALTH': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '66.000'} [2024-08-06 06:17:58,750][52820] DAMAGECOUNT value on done: 676158.0 [2024-08-06 06:17:58,752][52820] Sum rewards: 55.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.574', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.350', 'HITCOUNT': '2.660', 'weapon3': '3.118', 'DAMAGECOUNT': '13.722', 'FRAGCOUNT': '48.000'} [2024-08-06 06:17:59,059][52659] DAMAGECOUNT value on done: 738556.0 [2024-08-06 06:17:59,062][52659] Sum rewards: 71.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.263', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.082', 'AMMO4': '0.093', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '58.000'} [2024-08-06 06:17:59,423][52650] Updated weights for policy 0, policy_version 67751 (0.0027) [2024-08-06 06:18:00,033][52794] DAMAGECOUNT value on done: 733922.0 [2024-08-06 06:18:00,033][52794] Sum rewards: 70.995, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.104', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'weapon2': '0.464', 'WEAPON3': '0.950', 'HITCOUNT': '3.180', 'weapon3': '3.400', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '57.000'} [2024-08-06 06:18:00,270][52665] DAMAGECOUNT value on done: 723885.0 [2024-08-06 06:18:00,270][52665] Sum rewards: 80.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.891', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '3.264', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:01,282][52667] DAMAGECOUNT value on done: 731281.0 [2024-08-06 06:18:01,283][52667] Sum rewards: 67.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.056', 'weapon4': '0.112', 'AMMO4': '0.122', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.676', 'WEAPON3': '1.500', 'weapon3': '2.952', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '57.000'} [2024-08-06 06:18:01,334][52811] DAMAGECOUNT value on done: 679654.0 [2024-08-06 06:18:01,334][52811] Sum rewards: 65.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.836', 'AMMO5': '0.024', 'AMMO2': '0.068', 'weapon4': '0.158', 'AMMO3': '0.208', 'AMMO4': '0.339', 'weapon5': '0.374', 'weapon2': '0.664', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.476', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '53.000'} [2024-08-06 06:18:01,808][52795] DAMAGECOUNT value on done: 676794.0 [2024-08-06 06:18:01,818][52795] Sum rewards: 67.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon5': '0.140', 'AMMO3': '0.210', 'AMMO4': '0.302', 'weapon4': '0.342', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '57.000'} [2024-08-06 06:18:01,860][52820] DAMAGECOUNT value on done: 683444.0 [2024-08-06 06:18:01,860][52820] Sum rewards: 73.697, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.132', 'HEALTH': '0.140', 'AMMO3': '0.172', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON3': '1.000', 'weapon3': '3.220', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:02,243][52659] DAMAGECOUNT value on done: 727259.0 [2024-08-06 06:18:02,245][52659] Sum rewards: 78.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.165', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.400', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 555065344. Throughput: 0: 4378.2. Samples: 138767470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:18:02,794][52567] Avg episode reward: [(0, '74.522')] [2024-08-06 06:18:03,105][52794] DAMAGECOUNT value on done: 721038.0 [2024-08-06 06:18:03,106][52794] Sum rewards: 71.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon4': '0.188', 'AMMO3': '0.202', 'weapon5': '0.212', 'AMMO4': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.570', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:03,438][52665] DAMAGECOUNT value on done: 711006.0 [2024-08-06 06:18:03,438][52665] Sum rewards: 82.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.642', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon2': '0.180', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '67.000'} [2024-08-06 06:18:04,062][52650] Updated weights for policy 0, policy_version 67761 (0.0023) [2024-08-06 06:18:04,070][52667] DAMAGECOUNT value on done: 729985.0 [2024-08-06 06:18:04,070][52667] Sum rewards: 74.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.098', 'weapon5': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:04,404][52811] DAMAGECOUNT value on done: 678442.0 [2024-08-06 06:18:04,405][52811] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.338', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.211', 'weapon2': '0.532', 'WEAPON3': '1.000', 'weapon3': '3.110', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '55.000'} [2024-08-06 06:18:05,050][52795] DAMAGECOUNT value on done: 671365.0 [2024-08-06 06:18:05,051][52795] Sum rewards: 73.029, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.169', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.293', 'weapon2': '0.446', 'WEAPON3': '1.650', 'weapon3': '3.118', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '65.000'} [2024-08-06 06:18:05,051][52820] DAMAGECOUNT value on done: 669909.0 [2024-08-06 06:18:05,051][52820] Sum rewards: 62.064, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.937', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon4': '0.122', 'weapon5': '0.194', 'AMMO4': '0.238', 'AMMO3': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '54.000'} [2024-08-06 06:18:05,184][52659] DAMAGECOUNT value on done: 737051.0 [2024-08-06 06:18:05,184][52659] Sum rewards: 62.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.515', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.158', 'weapon7': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.290', 'weapon4': '0.712', 'WEAPON3': '0.900', 'weapon3': '2.398', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '50.000'} [2024-08-06 06:18:05,956][52794] DAMAGECOUNT value on done: 733031.0 [2024-08-06 06:18:05,957][52794] Sum rewards: 71.894, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.029', 'AMMO2': '0.064', 'AMMO3': '0.204', 'weapon2': '0.208', 'weapon5': '0.224', 'AMMO4': '0.320', 'weapon4': '0.372', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:06,345][52614] Signal inference workers to stop experience collection... (12350 times) [2024-08-06 06:18:06,353][52614] Signal inference workers to resume experience collection... (12350 times) [2024-08-06 06:18:06,428][52650] InferenceWorker_p0-w0: stopping experience collection (12350 times) [2024-08-06 06:18:06,429][52650] InferenceWorker_p0-w0: resuming experience collection (12350 times) [2024-08-06 06:18:06,878][52665] DAMAGECOUNT value on done: 717102.0 [2024-08-06 06:18:06,888][52665] Sum rewards: 84.637, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.116', 'AMMO4': '0.159', 'weapon5': '0.170', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '70.000'} [2024-08-06 06:18:07,224][52667] DAMAGECOUNT value on done: 738686.0 [2024-08-06 06:18:07,225][52667] Sum rewards: 78.876, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.057', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.276', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.342', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '67.000'} [2024-08-06 06:18:07,554][52803] DAMAGECOUNT value on done: 678300.0 [2024-08-06 06:18:07,555][52803] Sum rewards: 73.028, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.140', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.141', 'weapon4': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.322', 'weapon2': '0.384', 'WEAPON3': '1.900', 'weapon3': '3.018', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '65.000'} [2024-08-06 06:18:07,622][52811] DAMAGECOUNT value on done: 679757.0 [2024-08-06 06:18:07,622][52811] Sum rewards: 71.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.917', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.126', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.255', 'WEAPON3': '1.650', 'weapon3': '3.418', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17550.3). Total num frames: 555163648. Throughput: 0: 4376.7. Samples: 138793540. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:18:07,794][52567] Avg episode reward: [(0, '74.334')] [2024-08-06 06:18:07,912][52659] DAMAGECOUNT value on done: 726538.0 [2024-08-06 06:18:07,913][52659] Sum rewards: 70.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.035', 'ARMOR': '0.004', 'AMMO5': '0.025', 'AMMO2': '0.062', 'AMMO3': '0.210', 'weapon5': '0.242', 'weapon2': '0.276', 'AMMO4': '0.309', 'weapon4': '0.346', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.776', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:08,128][52795] DAMAGECOUNT value on done: 669164.0 [2024-08-06 06:18:08,128][52795] Sum rewards: 76.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.039', 'weapon5': '0.080', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:08,147][52820] DAMAGECOUNT value on done: 677307.0 [2024-08-06 06:18:08,147][52820] Sum rewards: 79.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.786', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.080', 'AMMO4': '0.203', 'weapon5': '0.216', 'AMMO3': '0.254', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 06:18:08,647][52794] DAMAGECOUNT value on done: 725325.0 [2024-08-06 06:18:08,648][52794] Sum rewards: 81.044, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.362', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.122', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.280', 'weapon2': '0.348', 'WEAPON3': '1.650', 'weapon3': '3.214', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '69.000'} [2024-08-06 06:18:08,907][52650] Updated weights for policy 0, policy_version 67771 (0.0024) [2024-08-06 06:18:09,892][52665] DAMAGECOUNT value on done: 723518.0 [2024-08-06 06:18:09,892][52665] Sum rewards: 70.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.276', 'weapon2': '0.648', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '60.000'} [2024-08-06 06:18:09,974][52664] Large shaping reward 2.534 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('HEALTH', -0.012, -4.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:18:10,262][52667] DAMAGECOUNT value on done: 726370.0 [2024-08-06 06:18:10,263][52667] Sum rewards: 77.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.855', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon5': '0.174', 'AMMO3': '0.195', 'weapon2': '0.226', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:10,622][52803] DAMAGECOUNT value on done: 677369.0 [2024-08-06 06:18:10,623][52803] Sum rewards: 68.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.146', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:10,792][52811] DAMAGECOUNT value on done: 685091.0 [2024-08-06 06:18:10,793][52811] Sum rewards: 74.148, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.004', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.124', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '60.000'} [2024-08-06 06:18:11,170][52795] DAMAGECOUNT value on done: 669904.0 [2024-08-06 06:18:11,171][52795] Sum rewards: 78.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.127', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.175', 'weapon5': '0.178', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:11,196][52820] DAMAGECOUNT value on done: 685610.0 [2024-08-06 06:18:11,198][52820] Sum rewards: 72.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.128', 'weapon2': '0.244', 'weapon5': '0.248', 'AMMO3': '0.253', 'AMMO4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:11,572][52658] Large shaping reward 2.570 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.519, 173.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:18:11,895][52794] DAMAGECOUNT value on done: 721756.0 [2024-08-06 06:18:11,897][52794] Sum rewards: 74.399, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.524', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.103', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 555245568. Throughput: 0: 4377.5. Samples: 138819680. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:18:12,795][52567] Avg episode reward: [(0, '74.137')] [2024-08-06 06:18:12,938][52665] DAMAGECOUNT value on done: 720010.0 [2024-08-06 06:18:12,938][52665] Sum rewards: 85.757, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.036', 'weapon4': '0.072', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'HEALTH': '0.474', 'weapon2': '0.622', 'WEAPON3': '1.000', 'weapon3': '3.076', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '69.000'} [2024-08-06 06:18:13,253][52667] DAMAGECOUNT value on done: 734557.0 [2024-08-06 06:18:13,254][52667] Sum rewards: 80.851, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.040', 'AMMO4': '0.123', 'weapon5': '0.130', 'weapon2': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'weapon3': '3.406', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '70.000'} [2024-08-06 06:18:13,547][52650] Updated weights for policy 0, policy_version 67781 (0.0031) [2024-08-06 06:18:13,663][52803] DAMAGECOUNT value on done: 684862.0 [2024-08-06 06:18:13,664][52803] Sum rewards: 82.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.036', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.220', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '68.000'} [2024-08-06 06:18:13,956][52811] DAMAGECOUNT value on done: 687193.0 [2024-08-06 06:18:13,957][52811] Sum rewards: 69.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.111', 'weapon5': '0.122', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '57.000'} [2024-08-06 06:18:14,271][52795] DAMAGECOUNT value on done: 678094.0 [2024-08-06 06:18:14,271][52795] Sum rewards: 65.308, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO3': '0.191', 'AMMO4': '0.205', 'weapon5': '0.232', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.474', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '53.000'} [2024-08-06 06:18:14,406][52820] DAMAGECOUNT value on done: 678293.0 [2024-08-06 06:18:14,406][52820] Sum rewards: 60.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.123', 'weapon4': '0.154', 'AMMO3': '0.206', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.290', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '50.000'} [2024-08-06 06:18:15,110][52794] DAMAGECOUNT value on done: 730581.0 [2024-08-06 06:18:15,111][52794] Sum rewards: 67.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.815', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.058', 'AMMO3': '0.167', 'weapon5': '0.188', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.790', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '55.000'} [2024-08-06 06:18:15,502][52665] DAMAGECOUNT value on done: 728957.0 [2024-08-06 06:18:15,505][52665] Sum rewards: 77.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.210', 'weapon5': '0.224', 'AMMO4': '0.227', 'weapon2': '0.306', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:15,985][52667] DAMAGECOUNT value on done: 740735.0 [2024-08-06 06:18:15,985][52667] Sum rewards: 75.222, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.140', 'weapon5': '0.178', 'AMMO3': '0.186', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HEALTH': '0.355', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '59.500'} [2024-08-06 06:18:16,784][52803] DAMAGECOUNT value on done: 683303.0 [2024-08-06 06:18:16,784][52803] Sum rewards: 80.185, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.306', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.068', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.360', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '68.000'} [2024-08-06 06:18:17,208][52811] DAMAGECOUNT value on done: 683238.0 [2024-08-06 06:18:17,208][52811] Sum rewards: 71.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.642', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.272', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.398', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '58.000'} [2024-08-06 06:18:17,422][52795] DAMAGECOUNT value on done: 663260.0 [2024-08-06 06:18:17,423][52795] Sum rewards: 77.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.191', 'weapon2': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.460', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '65.000'} [2024-08-06 06:18:17,505][52820] DAMAGECOUNT value on done: 680876.0 [2024-08-06 06:18:17,507][52820] Sum rewards: 63.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.478', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.198', 'AMMO3': '0.232', 'weapon5': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '54.000'} [2024-08-06 06:18:17,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 555327488. Throughput: 0: 4381.8. Samples: 138832840. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:18:17,795][52567] Avg episode reward: [(0, '73.964')] [2024-08-06 06:18:17,817][52794] DAMAGECOUNT value on done: 727506.0 [2024-08-06 06:18:17,819][52794] Sum rewards: 68.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.813', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.125', 'weapon2': '0.146', 'weapon5': '0.176', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.400', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '57.000'} [2024-08-06 06:18:18,148][52650] Updated weights for policy 0, policy_version 67791 (0.0013) [2024-08-06 06:18:18,672][52667] DAMAGECOUNT value on done: 738263.0 [2024-08-06 06:18:18,672][52667] Sum rewards: 59.294, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.082', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.168', 'weapon5': '0.192', 'AMMO4': '0.251', 'weapon2': '0.264', 'AMMO3': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.004', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.000'} [2024-08-06 06:18:18,722][52665] DAMAGECOUNT value on done: 721555.0 [2024-08-06 06:18:18,723][52665] Sum rewards: 55.123, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.362', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon7': '0.054', 'weapon5': '0.094', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.716', 'WEAPON3': '1.050', 'weapon3': '2.368', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '12.912', 'FRAGCOUNT': '45.000'} [2024-08-06 06:18:19,840][52803] DAMAGECOUNT value on done: 683253.0 [2024-08-06 06:18:19,842][52803] Sum rewards: 65.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.439', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.374', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.342', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '55.000'} [2024-08-06 06:18:20,396][52811] DAMAGECOUNT value on done: 681524.0 [2024-08-06 06:18:20,398][52811] Sum rewards: 69.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.083', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.114', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 06:18:20,569][52795] DAMAGECOUNT value on done: 681781.0 [2024-08-06 06:18:20,569][52795] Sum rewards: 76.447, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.885', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.254', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:20,607][52794] DAMAGECOUNT value on done: 743543.0 [2024-08-06 06:18:20,609][52794] Sum rewards: 77.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.438', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.162', 'AMMO3': '0.178', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.000', 'weapon3': '3.008', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:20,772][52820] DAMAGECOUNT value on done: 677233.0 [2024-08-06 06:18:20,773][52820] Sum rewards: 61.290, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.194', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.100', 'weapon2': '0.162', 'AMMO3': '0.219', 'AMMO4': '0.223', 'weapon5': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '3.278', 'DAMAGECOUNT': '14.388', 'FRAGCOUNT': '51.000'} [2024-08-06 06:18:21,625][52667] DAMAGECOUNT value on done: 737856.0 [2024-08-06 06:18:21,628][52667] Sum rewards: 84.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.538', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '70.000'} [2024-08-06 06:18:21,753][52665] DAMAGECOUNT value on done: 730722.0 [2024-08-06 06:18:21,754][52665] Sum rewards: 60.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.645', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.066', 'AMMO4': '0.174', 'weapon5': '0.178', 'AMMO3': '0.251', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.232', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '54.000'} [2024-08-06 06:18:22,786][52650] Updated weights for policy 0, policy_version 67801 (0.0011) [2024-08-06 06:18:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 555425792. Throughput: 0: 4374.2. Samples: 138859130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:18:22,794][52567] Avg episode reward: [(0, '73.215')] [2024-08-06 06:18:23,043][52803] DAMAGECOUNT value on done: 679155.0 [2024-08-06 06:18:23,045][52803] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.664', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.112', 'weapon5': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '60.500'} [2024-08-06 06:18:23,286][52794] DAMAGECOUNT value on done: 723255.0 [2024-08-06 06:18:23,288][52794] Sum rewards: 73.622, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.665', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.054', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'weapon2': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.220', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:23,673][52795] DAMAGECOUNT value on done: 676593.0 [2024-08-06 06:18:23,673][52795] Sum rewards: 67.089, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.390', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.122', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.310', 'weapon2': '0.316', 'WEAPON3': '1.800', 'weapon3': '3.196', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:23,910][52820] DAMAGECOUNT value on done: 680264.0 [2024-08-06 06:18:23,911][52820] Sum rewards: 85.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.275', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.131', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '71.000'} [2024-08-06 06:18:24,950][52665] DAMAGECOUNT value on done: 727901.0 [2024-08-06 06:18:24,951][52665] Sum rewards: 64.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.320', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.108', 'weapon5': '0.140', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '53.000'} [2024-08-06 06:18:24,952][52667] DAMAGECOUNT value on done: 735545.0 [2024-08-06 06:18:24,952][52667] Sum rewards: 84.428, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.384', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.233', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '71.000'} [2024-08-06 06:18:25,427][52663] DAMAGECOUNT value on done: 743443.0 [2024-08-06 06:18:25,429][52663] Sum rewards: 68.732, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.520', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.100', 'weapon5': '0.172', 'AMMO3': '0.248', 'AMMO4': '0.258', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:26,049][52803] DAMAGECOUNT value on done: 674145.0 [2024-08-06 06:18:26,051][52803] Sum rewards: 76.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.133', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.204', 'weapon4': '0.216', 'AMMO4': '0.245', 'weapon2': '0.314', 'weapon5': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:26,529][52794] DAMAGECOUNT value on done: 737581.0 [2024-08-06 06:18:26,529][52794] Sum rewards: 82.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.152', 'weapon5': '0.176', 'AMMO4': '0.195', 'AMMO3': '0.222', 'weapon2': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '68.000'} [2024-08-06 06:18:26,840][52795] DAMAGECOUNT value on done: 668022.0 [2024-08-06 06:18:26,840][52795] Sum rewards: 75.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.038', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.192', 'weapon4': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:27,008][52820] DAMAGECOUNT value on done: 689612.0 [2024-08-06 06:18:27,008][52820] Sum rewards: 73.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.085', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.204', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.484', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:27,552][52650] Updated weights for policy 0, policy_version 67811 (0.0049) [2024-08-06 06:18:27,697][52667] DAMAGECOUNT value on done: 741657.0 [2024-08-06 06:18:27,698][52667] Sum rewards: 76.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.275', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17522.5). Total num frames: 555507712. Throughput: 0: 4370.0. Samples: 138885430. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:18:27,794][52567] Avg episode reward: [(0, '73.501')] [2024-08-06 06:18:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067811_555507712.pth... [2024-08-06 06:18:27,932][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067298_551305216.pth [2024-08-06 06:18:28,149][52665] DAMAGECOUNT value on done: 724738.0 [2024-08-06 06:18:28,150][52665] Sum rewards: 81.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.102', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.129', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON5': '0.300', 'weapon5': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:28,442][52663] DAMAGECOUNT value on done: 729940.0 [2024-08-06 06:18:28,444][52663] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.841', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.092', 'weapon4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:29,195][52803] DAMAGECOUNT value on done: 673093.0 [2024-08-06 06:18:29,196][52803] Sum rewards: 76.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.436', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.186', 'weapon4': '0.198', 'weapon5': '0.228', 'AMMO4': '0.313', 'weapon2': '0.510', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.794', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '63.500'} [2024-08-06 06:18:29,365][52794] DAMAGECOUNT value on done: 733421.0 [2024-08-06 06:18:29,365][52794] Sum rewards: 89.497, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.161', 'weapon2': '0.286', 'WEAPON3': '1.100', 'weapon3': '3.430', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '71.000'} [2024-08-06 06:18:29,945][52795] DAMAGECOUNT value on done: 674808.0 [2024-08-06 06:18:29,946][52795] Sum rewards: 77.890, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.119', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.285', 'weapon2': '0.520', 'WEAPON3': '0.850', 'weapon3': '3.248', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:30,132][52820] DAMAGECOUNT value on done: 688186.0 [2024-08-06 06:18:30,135][52820] Sum rewards: 82.073, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.633', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.126', 'AMMO3': '0.157', 'weapon4': '0.184', 'AMMO4': '0.199', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:30,850][52665] DAMAGECOUNT value on done: 721489.0 [2024-08-06 06:18:30,851][52665] Sum rewards: 90.878, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.893', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.136', 'weapon4': '0.156', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'weapon3': '3.202', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '21.819', 'FRAGCOUNT': '77.000'} [2024-08-06 06:18:31,600][52663] DAMAGECOUNT value on done: 724583.0 [2024-08-06 06:18:31,602][52663] Sum rewards: 76.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.410', 'AMMO5': '0.011', 'weapon4': '0.038', 'AMMO2': '0.047', 'weapon5': '0.156', 'AMMO3': '0.223', 'AMMO4': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.500'} [2024-08-06 06:18:31,732][52794] DAMAGECOUNT value on done: 735447.0 [2024-08-06 06:18:31,733][52794] Sum rewards: 73.506, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.090', 'weapon4': '0.150', 'AMMO4': '0.205', 'weapon2': '0.226', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:32,280][52803] DAMAGECOUNT value on done: 676024.0 [2024-08-06 06:18:32,281][52803] Sum rewards: 64.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.140', 'weapon5': '0.186', 'AMMO4': '0.220', 'AMMO3': '0.231', 'weapon2': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '2.960', 'weapon3': '3.146', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '56.000'} [2024-08-06 06:18:32,413][52650] Updated weights for policy 0, policy_version 67821 (0.0019) [2024-08-06 06:18:32,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 555589632. Throughput: 0: 4365.8. Samples: 138898340. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:18:32,795][52567] Avg episode reward: [(0, '73.713')] [2024-08-06 06:18:33,296][52820] DAMAGECOUNT value on done: 672625.0 [2024-08-06 06:18:33,298][52820] Sum rewards: 59.337, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.056', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.132', 'AMMO3': '0.221', 'weapon5': '0.274', 'AMMO4': '0.284', 'weapon2': '0.382', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '2.908', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '51.000'} [2024-08-06 06:18:33,331][52795] DAMAGECOUNT value on done: 682855.0 [2024-08-06 06:18:33,333][52795] Sum rewards: 66.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon5': '0.072', 'weapon4': '0.098', 'AMMO4': '0.158', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '53.000'} [2024-08-06 06:18:33,948][52665] DAMAGECOUNT value on done: 717920.0 [2024-08-06 06:18:33,956][52665] Sum rewards: 71.823, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.108', 'AMMO5': '0.024', 'AMMO2': '0.069', 'AMMO3': '0.211', 'weapon5': '0.212', 'weapon4': '0.234', 'weapon2': '0.240', 'AMMO4': '0.344', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:34,771][52794] DAMAGECOUNT value on done: 743396.0 [2024-08-06 06:18:34,773][52794] Sum rewards: 79.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.147', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.082', 'weapon5': '0.102', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '65.000'} [2024-08-06 06:18:34,783][52663] DAMAGECOUNT value on done: 728798.0 [2024-08-06 06:18:34,785][52663] Sum rewards: 84.547, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.031', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon5': '0.154', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.310', 'weapon4': '0.370', 'HEALTH': '0.816', 'WEAPON3': '0.900', 'weapon3': '2.902', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '67.000'} [2024-08-06 06:18:35,413][52803] DAMAGECOUNT value on done: 676927.0 [2024-08-06 06:18:35,414][52803] Sum rewards: 82.115, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.402', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.110', 'AMMO4': '0.127', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '68.000'} [2024-08-06 06:18:36,427][52658] DAMAGECOUNT value on done: 733766.0 [2024-08-06 06:18:36,427][52658] Sum rewards: 64.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.740', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.136', 'weapon5': '0.176', 'AMMO4': '0.242', 'AMMO3': '0.272', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.008', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '56.000'} [2024-08-06 06:18:36,643][52665] DAMAGECOUNT value on done: 724657.0 [2024-08-06 06:18:36,644][52665] Sum rewards: 82.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon2': '0.188', 'AMMO4': '0.255', 'AMMO3': '0.264', 'weapon5': '0.266', 'weapon4': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.940', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '69.000'} [2024-08-06 06:18:36,929][52650] Updated weights for policy 0, policy_version 67831 (0.0017) [2024-08-06 06:18:37,747][52663] DAMAGECOUNT value on done: 731378.0 [2024-08-06 06:18:37,747][52663] Sum rewards: 69.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.156', 'AMMO4': '0.168', 'weapon5': '0.240', 'AMMO3': '0.248', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.946', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '60.000'} [2024-08-06 06:18:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 555687936. Throughput: 0: 4368.7. Samples: 138924730. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:18:37,795][52567] Avg episode reward: [(0, '73.448')] [2024-08-06 06:18:37,869][52794] DAMAGECOUNT value on done: 733104.0 [2024-08-06 06:18:37,869][52794] Sum rewards: 73.361, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.038', 'weapon5': '0.064', 'AMMO4': '0.071', 'HEALTH': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.186', 'WEAPON3': '1.050', 'HITCOUNT': '3.370', 'weapon3': '3.564', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '60.000'} [2024-08-06 06:18:38,536][52803] DAMAGECOUNT value on done: 690794.0 [2024-08-06 06:18:38,537][52803] Sum rewards: 81.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.126', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.072', 'AMMO4': '0.200', 'AMMO3': '0.205', 'weapon5': '0.224', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '67.000'} [2024-08-06 06:18:39,214][52671] DAMAGECOUNT value on done: 733460.0 [2024-08-06 06:18:39,214][52671] Sum rewards: 73.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.359', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.143', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:39,315][52658] DAMAGECOUNT value on done: 733034.0 [2024-08-06 06:18:39,315][52658] Sum rewards: 77.561, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.074', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.112', 'AMMO4': '0.113', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '67.000'} [2024-08-06 06:18:39,362][52665] DAMAGECOUNT value on done: 723976.0 [2024-08-06 06:18:39,362][52665] Sum rewards: 63.914, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO4': '0.157', 'AMMO3': '0.163', 'HEALTH': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '0.900', 'HITCOUNT': '2.850', 'weapon3': '3.390', 'DAMAGECOUNT': '14.622', 'FRAGCOUNT': '52.000'} [2024-08-06 06:18:40,059][52663] DAMAGECOUNT value on done: 739064.0 [2024-08-06 06:18:40,060][52663] Sum rewards: 65.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.788', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '56.000'} [2024-08-06 06:18:41,115][52669] DAMAGECOUNT value on done: 732309.0 [2024-08-06 06:18:41,115][52669] Sum rewards: 67.932, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.522', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.142', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:41,616][52664] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:18:41,661][52650] Updated weights for policy 0, policy_version 67841 (0.0011) [2024-08-06 06:18:41,777][52803] DAMAGECOUNT value on done: 680762.0 [2024-08-06 06:18:41,779][52803] Sum rewards: 68.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.074', 'AMMO4': '0.195', 'weapon5': '0.196', 'AMMO3': '0.284', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:41,826][52670] DAMAGECOUNT value on done: 720831.0 [2024-08-06 06:18:41,830][52670] Sum rewards: 67.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.632', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.100', 'AMMO4': '0.170', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '58.000'} [2024-08-06 06:18:41,931][52658] DAMAGECOUNT value on done: 737218.0 [2024-08-06 06:18:41,931][52658] Sum rewards: 67.567, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.094', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon5': '0.186', 'weapon4': '0.198', 'AMMO3': '0.237', 'AMMO4': '0.295', 'weapon2': '0.380', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:42,400][52671] DAMAGECOUNT value on done: 740116.0 [2024-08-06 06:18:42,402][52665] DAMAGECOUNT value on done: 716629.0 [2024-08-06 06:18:42,402][52671] Sum rewards: 81.873, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.512', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.009', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.166', 'AMMO3': '0.170', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 06:18:42,406][52665] Sum rewards: 83.269, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.174', 'AMMO4': '0.175', 'weapon2': '0.196', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '70.000'} [2024-08-06 06:18:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 555778048. Throughput: 0: 4371.5. Samples: 138950920. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:18:42,795][52567] Avg episode reward: [(0, '73.425')] [2024-08-06 06:18:43,495][52663] DAMAGECOUNT value on done: 727462.0 [2024-08-06 06:18:43,498][52663] Sum rewards: 75.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.245', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon4': '0.116', 'AMMO4': '0.209', 'AMMO3': '0.230', 'weapon5': '0.284', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '61.500'} [2024-08-06 06:18:43,952][52666] DAMAGECOUNT value on done: 732465.0 [2024-08-06 06:18:43,952][52666] Sum rewards: 76.653, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.170', 'AMMO3': '0.185', 'AMMO4': '0.220', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:44,254][52669] DAMAGECOUNT value on done: 724373.0 [2024-08-06 06:18:44,254][52669] Sum rewards: 68.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.625', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.128', 'AMMO4': '0.195', 'AMMO3': '0.199', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.356', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '58.000'} [2024-08-06 06:18:44,641][52658] DAMAGECOUNT value on done: 735128.0 [2024-08-06 06:18:44,641][52658] Sum rewards: 73.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.266', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon2': '0.160', 'weapon5': '0.172', 'AMMO4': '0.176', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:44,765][52803] DAMAGECOUNT value on done: 680803.0 [2024-08-06 06:18:44,766][52803] Sum rewards: 80.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.797', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.168', 'AMMO4': '0.192', 'AMMO3': '0.195', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '66.000'} [2024-08-06 06:18:44,835][52670] DAMAGECOUNT value on done: 733253.0 [2024-08-06 06:18:44,839][52670] Sum rewards: 66.410, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.640', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.146', 'AMMO3': '0.272', 'weapon2': '0.272', 'AMMO4': '0.312', 'weapon5': '0.314', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.884', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '57.000'} [2024-08-06 06:18:45,139][52671] DAMAGECOUNT value on done: 734312.0 [2024-08-06 06:18:45,139][52671] Sum rewards: 77.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.951', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.161', 'weapon4': '0.166', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:45,593][52665] DAMAGECOUNT value on done: 719760.0 [2024-08-06 06:18:45,593][52665] Sum rewards: 75.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.178', 'AMMO3': '0.183', 'AMMO4': '0.249', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:46,111][52663] DAMAGECOUNT value on done: 721035.0 [2024-08-06 06:18:46,112][52663] Sum rewards: 62.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.865', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.076', 'AMMO4': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.286', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.318', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '51.000'} [2024-08-06 06:18:46,548][52650] Updated weights for policy 0, policy_version 67851 (0.0013) [2024-08-06 06:18:46,699][52669] DAMAGECOUNT value on done: 737250.0 [2024-08-06 06:18:46,699][52669] Sum rewards: 77.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.676', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.120', 'AMMO3': '0.208', 'AMMO4': '0.254', 'weapon5': '0.288', 'WEAPON4': '0.450', 'weapon2': '0.514', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:47,007][52666] DAMAGECOUNT value on done: 729826.0 [2024-08-06 06:18:47,011][52666] Sum rewards: 75.991, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.090', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon4': '0.144', 'weapon2': '0.232', 'AMMO3': '0.241', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.500'} [2024-08-06 06:18:47,543][52658] DAMAGECOUNT value on done: 726477.0 [2024-08-06 06:18:47,543][52658] Sum rewards: 75.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.994', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.116', 'AMMO4': '0.157', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 555859968. Throughput: 0: 4366.9. Samples: 138963980. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:18:47,795][52567] Avg episode reward: [(0, '73.716')] [2024-08-06 06:18:47,826][52803] DAMAGECOUNT value on done: 693301.0 [2024-08-06 06:18:47,826][52803] Sum rewards: 80.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.910', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.090', 'weapon2': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.800', 'weapon3': '3.374', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '69.000'} [2024-08-06 06:18:47,916][52671] DAMAGECOUNT value on done: 737498.0 [2024-08-06 06:18:47,918][52671] Sum rewards: 69.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.085', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.060', 'AMMO3': '0.179', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:47,978][52670] DAMAGECOUNT value on done: 720990.0 [2024-08-06 06:18:47,980][52670] Sum rewards: 69.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.224', 'weapon4': '0.230', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.288', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '58.000'} [2024-08-06 06:18:48,674][52663] DAMAGECOUNT value on done: 722695.0 [2024-08-06 06:18:48,676][52663] Sum rewards: 77.430, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.080', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.108', 'AMMO4': '0.150', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:48,751][52665] DAMAGECOUNT value on done: 723629.0 [2024-08-06 06:18:48,751][52665] Sum rewards: 91.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon4': '0.334', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '74.000'} [2024-08-06 06:18:49,111][52669] DAMAGECOUNT value on done: 732206.0 [2024-08-06 06:18:49,112][52669] Sum rewards: 65.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'weapon4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.514', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.212', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '53.000'} [2024-08-06 06:18:50,138][52658] DAMAGECOUNT value on done: 723692.0 [2024-08-06 06:18:50,138][52658] Sum rewards: 74.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.905', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.174', 'AMMO3': '0.178', 'weapon4': '0.222', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '59.500'} [2024-08-06 06:18:50,177][52666] DAMAGECOUNT value on done: 729330.0 [2024-08-06 06:18:50,180][52666] Sum rewards: 73.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.616', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.186', 'AMMO4': '0.199', 'weapon4': '0.208', 'weapon5': '0.234', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:50,918][52650] Updated weights for policy 0, policy_version 67861 (0.0014) [2024-08-06 06:18:51,050][52803] DAMAGECOUNT value on done: 678164.0 [2024-08-06 06:18:51,052][52803] Sum rewards: 78.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.876', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '65.000'} [2024-08-06 06:18:51,088][52671] DAMAGECOUNT value on done: 744815.0 [2024-08-06 06:18:51,091][52671] Sum rewards: 76.619, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.040', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.080', 'weapon4': '0.104', 'AMMO4': '0.136', 'weapon2': '0.196', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '66.000'} [2024-08-06 06:18:51,136][52670] DAMAGECOUNT value on done: 718670.0 [2024-08-06 06:18:51,136][52670] Sum rewards: 55.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'AMMO5': '0.024', 'AMMO2': '0.046', 'weapon4': '0.130', 'AMMO3': '0.192', 'weapon5': '0.200', 'AMMO4': '0.230', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.840', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '44.000'} [2024-08-06 06:18:51,146][52663] DAMAGECOUNT value on done: 727120.0 [2024-08-06 06:18:51,148][52663] Sum rewards: 74.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.101', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:51,469][52662] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:18:51,655][52820] Large shaping reward 3.651 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:18:51,859][52669] DAMAGECOUNT value on done: 735175.0 [2024-08-06 06:18:51,859][52669] Sum rewards: 84.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.245', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.108', 'AMMO4': '0.187', 'weapon2': '0.208', 'weapon5': '0.214', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.160', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.114', 'FRAGCOUNT': '72.000'} [2024-08-06 06:18:52,435][52658] DAMAGECOUNT value on done: 737528.0 [2024-08-06 06:18:52,436][52658] Sum rewards: 68.727, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.255', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.818', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '56.000'} [2024-08-06 06:18:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 555950080. Throughput: 0: 4370.7. Samples: 138990220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:18:52,795][52567] Avg episode reward: [(0, '73.783')] [2024-08-06 06:18:53,323][52666] DAMAGECOUNT value on done: 729578.0 [2024-08-06 06:18:53,325][52666] Sum rewards: 71.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.063', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.128', 'weapon5': '0.130', 'weapon2': '0.188', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.424', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:53,560][52664] DAMAGECOUNT value on done: 756690.0 [2024-08-06 06:18:53,560][52664] Sum rewards: 67.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.836', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.156', 'weapon5': '0.160', 'AMMO4': '0.163', 'AMMO3': '0.209', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '57.000'} [2024-08-06 06:18:54,146][52803] DAMAGECOUNT value on done: 682308.0 [2024-08-06 06:18:54,152][52803] Sum rewards: 81.316, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.763', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.126', 'weapon5': '0.130', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.234', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '70.000'} [2024-08-06 06:18:54,185][52663] DAMAGECOUNT value on done: 738410.0 [2024-08-06 06:18:54,186][52663] Sum rewards: 79.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.392', 'AMMO5': '0.020', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.078', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.268', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:54,207][52671] DAMAGECOUNT value on done: 738526.0 [2024-08-06 06:18:54,207][52671] Sum rewards: 75.430, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.967', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '65.000'} [2024-08-06 06:18:54,231][52670] DAMAGECOUNT value on done: 731636.0 [2024-08-06 06:18:54,233][52670] Sum rewards: 75.397, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.070', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.080', 'AMMO4': '0.198', 'weapon5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.303', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.124', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:54,964][52669] DAMAGECOUNT value on done: 734443.0 [2024-08-06 06:18:54,966][52669] Sum rewards: 75.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.394', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.187', 'weapon2': '0.352', 'WEAPON3': '1.200', 'HITCOUNT': '3.400', 'weapon3': '3.502', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:55,708][52650] Updated weights for policy 0, policy_version 67871 (0.0021) [2024-08-06 06:18:56,052][52658] DAMAGECOUNT value on done: 728081.0 [2024-08-06 06:18:56,053][52658] Sum rewards: 74.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.208', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.254', 'weapon2': '0.256', 'WEAPON3': '1.600', 'HITCOUNT': '3.410', 'weapon3': '3.444', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:56,116][52664] DAMAGECOUNT value on done: 764874.0 [2024-08-06 06:18:56,117][52664] Sum rewards: 70.510, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.754', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.150', 'AMMO4': '0.200', 'weapon2': '0.238', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.298', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '60.000'} [2024-08-06 06:18:56,510][52666] DAMAGECOUNT value on done: 724078.0 [2024-08-06 06:18:56,512][52666] Sum rewards: 81.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.164', 'AMMO4': '0.208', 'weapon2': '0.212', 'weapon5': '0.238', 'AMMO3': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '68.000'} [2024-08-06 06:18:57,320][52803] DAMAGECOUNT value on done: 684055.0 [2024-08-06 06:18:57,321][52803] Sum rewards: 76.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon2': '0.190', 'weapon5': '0.218', 'AMMO4': '0.224', 'AMMO3': '0.227', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '63.000'} [2024-08-06 06:18:57,337][52663] DAMAGECOUNT value on done: 722657.0 [2024-08-06 06:18:57,339][52663] Sum rewards: 74.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.255', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.430', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '62.000'} [2024-08-06 06:18:57,370][52671] DAMAGECOUNT value on done: 739443.0 [2024-08-06 06:18:57,373][52671] Sum rewards: 69.020, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.346', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.107', 'weapon5': '0.158', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '61.000'} [2024-08-06 06:18:57,429][52670] DAMAGECOUNT value on done: 725427.0 [2024-08-06 06:18:57,430][52670] Sum rewards: 65.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.023', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.114', 'AMMO4': '0.167', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '56.000'} [2024-08-06 06:18:57,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 556032000. Throughput: 0: 4367.5. Samples: 139016220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:18:57,795][52567] Avg episode reward: [(0, '73.745')] [2024-08-06 06:18:58,001][52669] DAMAGECOUNT value on done: 733454.0 [2024-08-06 06:18:58,001][52669] Sum rewards: 73.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.772', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.060', 'weapon5': '0.184', 'AMMO3': '0.197', 'AMMO4': '0.235', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '59.000'} [2024-08-06 06:18:58,695][52664] DAMAGECOUNT value on done: 760418.0 [2024-08-06 06:18:58,695][52664] Sum rewards: 73.772, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.290', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.157', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.312', 'weapon2': '0.364', 'WEAPON3': '1.800', 'weapon3': '3.078', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '64.000'} [2024-08-06 06:18:58,760][52658] DAMAGECOUNT value on done: 749877.0 [2024-08-06 06:18:58,760][52658] Sum rewards: 84.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.127', 'weapon4': '0.184', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '69.000'} [2024-08-06 06:18:59,770][52666] DAMAGECOUNT value on done: 728195.0 [2024-08-06 06:18:59,771][52666] Sum rewards: 68.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.756', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.108', 'weapon5': '0.166', 'AMMO3': '0.192', 'AMMO4': '0.229', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:00,136][52663] DAMAGECOUNT value on done: 718909.0 [2024-08-06 06:19:00,136][52663] Sum rewards: 73.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.705', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.114', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:00,341][52670] DAMAGECOUNT value on done: 718653.0 [2024-08-06 06:19:00,343][52670] Sum rewards: 79.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.719', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '65.000'} [2024-08-06 06:19:00,372][52671] DAMAGECOUNT value on done: 735989.0 [2024-08-06 06:19:00,376][52671] Sum rewards: 67.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.522', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon4': '0.158', 'weapon5': '0.208', 'AMMO3': '0.216', 'AMMO4': '0.298', 'weapon2': '0.336', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:00,527][52803] DAMAGECOUNT value on done: 685803.0 [2024-08-06 06:19:00,529][52803] Sum rewards: 70.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.118', 'AMMO3': '0.206', 'weapon4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '57.500'} [2024-08-06 06:19:00,565][52650] Updated weights for policy 0, policy_version 67881 (0.0018) [2024-08-06 06:19:00,626][52669] DAMAGECOUNT value on done: 738078.0 [2024-08-06 06:19:00,628][52669] Sum rewards: 84.581, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.990', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.096', 'weapon5': '0.118', 'AMMO4': '0.209', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.976', 'FRAGCOUNT': '70.000'} [2024-08-06 06:19:01,507][52664] DAMAGECOUNT value on done: 755380.0 [2024-08-06 06:19:01,507][52664] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.212', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.123', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON3': '1.200', 'weapon3': '3.330', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '58.500'} [2024-08-06 06:19:01,757][52658] DAMAGECOUNT value on done: 732350.0 [2024-08-06 06:19:01,758][52658] Sum rewards: 73.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.885', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon5': '0.196', 'AMMO3': '0.205', 'weapon4': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:02,520][52666] DAMAGECOUNT value on done: 726164.0 [2024-08-06 06:19:02,520][52666] Sum rewards: 76.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.066', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:02,712][52663] DAMAGECOUNT value on done: 725886.0 [2024-08-06 06:19:02,712][52663] Sum rewards: 61.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.088', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.070', 'AMMO4': '0.112', 'weapon5': '0.188', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.092', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '50.000'} [2024-08-06 06:19:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 556122112. Throughput: 0: 4369.8. Samples: 139029480. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:19:02,794][52567] Avg episode reward: [(0, '74.270')] [2024-08-06 06:19:02,907][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:19:03,186][52671] DAMAGECOUNT value on done: 728136.0 [2024-08-06 06:19:03,186][52671] Sum rewards: 72.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 06:19:03,373][52669] DAMAGECOUNT value on done: 743043.0 [2024-08-06 06:19:03,373][52669] Sum rewards: 76.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.640', 'AMMO5': '0.029', 'AMMO2': '0.074', 'weapon4': '0.202', 'weapon2': '0.248', 'AMMO3': '0.250', 'weapon5': '0.308', 'AMMO4': '0.369', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:03,552][52803] DAMAGECOUNT value on done: 689907.0 [2024-08-06 06:19:03,554][52803] Sum rewards: 67.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.915', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.086', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:03,743][52670] DAMAGECOUNT value on done: 723519.0 [2024-08-06 06:19:03,745][52670] Sum rewards: 64.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.040', 'AMMO4': '0.088', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.484', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.224', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.000'} [2024-08-06 06:19:04,432][52664] DAMAGECOUNT value on done: 766000.0 [2024-08-06 06:19:04,433][52664] Sum rewards: 70.385, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.990', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.108', 'weapon5': '0.216', 'AMMO3': '0.226', 'AMMO4': '0.243', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:04,693][52658] DAMAGECOUNT value on done: 744080.0 [2024-08-06 06:19:04,694][52658] Sum rewards: 73.813, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.335', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.146', 'weapon4': '0.152', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:05,003][52650] Updated weights for policy 0, policy_version 67891 (0.0018) [2024-08-06 06:19:05,430][52666] DAMAGECOUNT value on done: 720398.0 [2024-08-06 06:19:05,431][52666] Sum rewards: 76.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.700', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.064', 'AMMO3': '0.200', 'AMMO4': '0.224', 'weapon5': '0.224', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:06,014][52663] DAMAGECOUNT value on done: 724177.0 [2024-08-06 06:19:06,015][52663] Sum rewards: 73.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.741', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon5': '0.196', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:06,029][52671] DAMAGECOUNT value on done: 737175.0 [2024-08-06 06:19:06,029][52671] Sum rewards: 70.658, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.508', 'AMMO5': '0.022', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon5': '0.194', 'weapon4': '0.222', 'AMMO3': '0.251', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:06,266][52670] DAMAGECOUNT value on done: 722660.0 [2024-08-06 06:19:06,267][52670] Sum rewards: 80.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.025', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'weapon4': '0.218', 'AMMO3': '0.231', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '68.000'} [2024-08-06 06:19:06,568][52803] DAMAGECOUNT value on done: 684512.0 [2024-08-06 06:19:06,570][52803] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.783', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.104', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '3.152', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:06,694][52669] DAMAGECOUNT value on done: 735290.0 [2024-08-06 06:19:06,695][52669] Sum rewards: 73.316, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.723', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.270', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.266', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:07,140][52664] DAMAGECOUNT value on done: 758616.0 [2024-08-06 06:19:07,141][52664] Sum rewards: 82.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.084', 'weapon4': '0.174', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '67.500'} [2024-08-06 06:19:07,561][52658] DAMAGECOUNT value on done: 728695.0 [2024-08-06 06:19:07,563][52658] Sum rewards: 74.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.898', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 556204032. Throughput: 0: 4368.7. Samples: 139055720. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:19:07,795][52567] Avg episode reward: [(0, '74.233')] [2024-08-06 06:19:08,458][52666] DAMAGECOUNT value on done: 730074.0 [2024-08-06 06:19:08,462][52666] Sum rewards: 79.327, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.248', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:08,869][52671] DAMAGECOUNT value on done: 737076.0 [2024-08-06 06:19:08,872][52671] Sum rewards: 66.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.202', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.040', 'weapon4': '0.078', 'AMMO3': '0.191', 'AMMO4': '0.200', 'weapon5': '0.238', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.990', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '55.000'} [2024-08-06 06:19:09,163][52663] DAMAGECOUNT value on done: 737605.0 [2024-08-06 06:19:09,164][52663] Sum rewards: 73.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.305', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.079', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:09,404][52670] DAMAGECOUNT value on done: 717520.0 [2024-08-06 06:19:09,405][52670] Sum rewards: 68.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon2': '0.218', 'weapon5': '0.220', 'AMMO3': '0.245', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.940', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '58.000'} [2024-08-06 06:19:09,800][52669] DAMAGECOUNT value on done: 736472.0 [2024-08-06 06:19:09,800][52669] Sum rewards: 79.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.905', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.162', 'AMMO4': '0.186', 'AMMO3': '0.224', 'weapon4': '0.274', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.978', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '65.000'} [2024-08-06 06:19:09,839][52650] Updated weights for policy 0, policy_version 67901 (0.0013) [2024-08-06 06:19:10,468][52664] DAMAGECOUNT value on done: 754885.0 [2024-08-06 06:19:10,468][52664] Sum rewards: 73.006, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.161', 'weapon2': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.284', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '58.000'} [2024-08-06 06:19:10,648][52658] DAMAGECOUNT value on done: 737323.0 [2024-08-06 06:19:10,651][52658] Sum rewards: 82.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '67.000'} [2024-08-06 06:19:11,375][52671] DAMAGECOUNT value on done: 735420.0 [2024-08-06 06:19:11,376][52671] Sum rewards: 84.498, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.146', 'AMMO3': '0.154', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.286', 'weapon2': '0.334', 'WEAPON3': '0.900', 'weapon3': '3.042', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '67.000'} [2024-08-06 06:19:11,685][52666] DAMAGECOUNT value on done: 723257.0 [2024-08-06 06:19:11,688][52666] Sum rewards: 81.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.620', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.096', 'weapon4': '0.132', 'AMMO4': '0.140', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.650', 'weapon3': '3.146', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '69.000'} [2024-08-06 06:19:11,962][52663] DAMAGECOUNT value on done: 730973.0 [2024-08-06 06:19:11,962][52663] Sum rewards: 77.032, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.583', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.146', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.100', 'HITCOUNT': '3.430', 'weapon3': '3.434', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '62.000'} [2024-08-06 06:19:12,409][52669] DAMAGECOUNT value on done: 742721.0 [2024-08-06 06:19:12,411][52669] Sum rewards: 82.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.014', 'AMMO2': '0.058', 'AMMO3': '0.204', 'weapon5': '0.212', 'weapon4': '0.238', 'AMMO4': '0.292', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.967', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:12,673][52670] DAMAGECOUNT value on done: 731779.0 [2024-08-06 06:19:12,674][52670] Sum rewards: 75.178, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.172', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.064', 'weapon4': '0.112', 'weapon2': '0.172', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.422', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 556294144. Throughput: 0: 4360.7. Samples: 139081660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:12,794][52567] Avg episode reward: [(0, '74.103')] [2024-08-06 06:19:13,013][52664] DAMAGECOUNT value on done: 748169.0 [2024-08-06 06:19:13,013][52664] Sum rewards: 66.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.946', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.142', 'AMMO4': '0.189', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.242', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:13,752][52658] DAMAGECOUNT value on done: 727257.0 [2024-08-06 06:19:13,752][52658] Sum rewards: 71.492, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.400', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.184', 'weapon5': '0.244', 'AMMO3': '0.273', 'weapon4': '0.312', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.666', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:14,203][52671] DAMAGECOUNT value on done: 742787.0 [2024-08-06 06:19:14,203][52671] Sum rewards: 76.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.178', 'weapon5': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '62.000'} [2024-08-06 06:19:14,425][52663] DAMAGECOUNT value on done: 733445.0 [2024-08-06 06:19:14,426][52663] Sum rewards: 79.073, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.650', 'AMMO5': '0.008', 'weapon4': '0.032', 'weapon5': '0.034', 'AMMO2': '0.045', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'weapon2': '0.294', 'AMMO3': '0.298', 'WEAPON3': '1.650', 'weapon3': '3.330', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '70.000'} [2024-08-06 06:19:14,460][52650] Updated weights for policy 0, policy_version 67911 (0.0031) [2024-08-06 06:19:14,584][52666] DAMAGECOUNT value on done: 732541.0 [2024-08-06 06:19:14,585][52666] Sum rewards: 83.327, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.502', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.144', 'AMMO4': '0.172', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '69.000'} [2024-08-06 06:19:15,071][52669] DAMAGECOUNT value on done: 727812.0 [2024-08-06 06:19:15,079][52669] Sum rewards: 87.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.170', 'AMMO3': '0.178', 'AMMO4': '0.180', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '70.000'} [2024-08-06 06:19:15,213][52670] DAMAGECOUNT value on done: 718108.0 [2024-08-06 06:19:15,215][52670] Sum rewards: 72.159, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.117', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.119', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.303', 'WEAPON3': '1.750', 'weapon3': '3.244', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:15,709][52664] DAMAGECOUNT value on done: 763324.0 [2024-08-06 06:19:15,710][52664] Sum rewards: 70.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.138', 'AMMO4': '0.167', 'weapon5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 06:19:16,583][52658] DAMAGECOUNT value on done: 737299.0 [2024-08-06 06:19:16,586][52658] Sum rewards: 83.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.565', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.122', 'weapon5': '0.148', 'weapon2': '0.186', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.404', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '69.000'} [2024-08-06 06:19:17,149][52666] DAMAGECOUNT value on done: 718940.0 [2024-08-06 06:19:17,150][52666] Sum rewards: 73.843, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.440', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.182', 'AMMO3': '0.245', 'weapon5': '0.258', 'AMMO4': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:17,269][52671] DAMAGECOUNT value on done: 736861.0 [2024-08-06 06:19:17,269][52671] Sum rewards: 84.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.098', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.084', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '69.000'} [2024-08-06 06:19:17,479][52663] DAMAGECOUNT value on done: 736695.0 [2024-08-06 06:19:17,481][52663] Sum rewards: 89.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.807', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.082', 'AMMO4': '0.203', 'weapon2': '0.210', 'weapon5': '0.212', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '22.224', 'FRAGCOUNT': '72.000'} [2024-08-06 06:19:17,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 556384256. Throughput: 0: 4362.0. Samples: 139094630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:17,795][52567] Avg episode reward: [(0, '74.603')] [2024-08-06 06:19:17,886][52668] DAMAGECOUNT value on done: 731363.0 [2024-08-06 06:19:17,888][52668] Sum rewards: 75.333, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.176', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.110', 'weapon2': '0.156', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'weapon3': '3.462', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:17,994][52670] DAMAGECOUNT value on done: 726638.0 [2024-08-06 06:19:17,995][52670] Sum rewards: 74.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon5': '0.188', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:18,195][52669] DAMAGECOUNT value on done: 730334.0 [2024-08-06 06:19:18,196][52669] Sum rewards: 82.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.176', 'AMMO3': '0.218', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '68.000'} [2024-08-06 06:19:18,617][52664] DAMAGECOUNT value on done: 755137.0 [2024-08-06 06:19:18,619][52664] Sum rewards: 76.250, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.700', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:19,318][52650] Updated weights for policy 0, policy_version 67921 (0.0028) [2024-08-06 06:19:19,357][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:19:19,499][52658] DAMAGECOUNT value on done: 721642.0 [2024-08-06 06:19:19,501][52658] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.786', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.144', 'weapon5': '0.240', 'AMMO3': '0.242', 'weapon2': '0.246', 'AMMO4': '0.321', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:19,596][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:19:19,747][52666] DAMAGECOUNT value on done: 732313.0 [2024-08-06 06:19:19,749][52666] Sum rewards: 68.480, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.886', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.154', 'weapon5': '0.168', 'AMMO3': '0.216', 'AMMO4': '0.229', 'weapon2': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:20,251][52671] DAMAGECOUNT value on done: 725134.0 [2024-08-06 06:19:20,260][52671] Sum rewards: 79.276, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.509', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.302', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '62.000'} [2024-08-06 06:19:20,760][52668] DAMAGECOUNT value on done: 737987.0 [2024-08-06 06:19:20,763][52668] Sum rewards: 78.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.946', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.155', 'weapon5': '0.184', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:20,780][52663] DAMAGECOUNT value on done: 725266.0 [2024-08-06 06:19:20,782][52663] Sum rewards: 76.142, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.238', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.152', 'weapon2': '0.156', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:20,809][52670] DAMAGECOUNT value on done: 733142.0 [2024-08-06 06:19:20,810][52670] Sum rewards: 73.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.435', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.146', 'weapon5': '0.180', 'AMMO3': '0.204', 'AMMO4': '0.286', 'weapon2': '0.314', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:21,200][52669] DAMAGECOUNT value on done: 734277.0 [2024-08-06 06:19:21,201][52669] Sum rewards: 75.456, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.360', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.154', 'weapon5': '0.210', 'AMMO3': '0.252', 'AMMO4': '0.257', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:21,209][52664] DAMAGECOUNT value on done: 767456.0 [2024-08-06 06:19:21,209][52664] Sum rewards: 82.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.064', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.092', 'weapon2': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:22,510][52658] DAMAGECOUNT value on done: 737676.0 [2024-08-06 06:19:22,512][52658] Sum rewards: 68.970, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.144', 'weapon4': '0.156', 'AMMO4': '0.160', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:22,671][52666] DAMAGECOUNT value on done: 724879.0 [2024-08-06 06:19:22,672][52666] Sum rewards: 71.485, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.313', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'weapon2': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.028', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 556466176. Throughput: 0: 4362.7. Samples: 139121050. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:22,794][52567] Avg episode reward: [(0, '74.902')] [2024-08-06 06:19:23,085][52671] DAMAGECOUNT value on done: 742849.0 [2024-08-06 06:19:23,086][52671] Sum rewards: 68.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.516', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.014', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.219', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.328', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:23,468][52670] DAMAGECOUNT value on done: 727318.0 [2024-08-06 06:19:23,470][52670] Sum rewards: 81.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:23,506][52647] Large shaping reward 2.596 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0)] [2024-08-06 06:19:23,743][52650] Updated weights for policy 0, policy_version 67931 (0.0012) [2024-08-06 06:19:23,806][52669] DAMAGECOUNT value on done: 753880.0 [2024-08-06 06:19:23,806][52669] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.025', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.136', 'AMMO4': '0.180', 'AMMO3': '0.186', 'weapon5': '0.202', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '56.000'} [2024-08-06 06:19:23,889][52668] DAMAGECOUNT value on done: 737595.0 [2024-08-06 06:19:23,891][52668] Sum rewards: 70.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.186', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.138', 'weapon4': '0.140', 'AMMO4': '0.217', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:23,905][52664] DAMAGECOUNT value on done: 765545.0 [2024-08-06 06:19:23,906][52664] Sum rewards: 75.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.225', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.094', 'weapon5': '0.114', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.257', 'WEAPON3': '1.650', 'weapon3': '3.350', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '65.000'} [2024-08-06 06:19:25,617][52666] DAMAGECOUNT value on done: 725279.0 [2024-08-06 06:19:25,619][52666] Sum rewards: 67.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon4': '0.128', 'AMMO3': '0.161', 'weapon5': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '0.950', 'weapon3': '3.050', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '55.000'} [2024-08-06 06:19:25,643][52671] DAMAGECOUNT value on done: 740149.0 [2024-08-06 06:19:25,645][52671] Sum rewards: 58.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.154', 'AMMO3': '0.159', 'weapon5': '0.200', 'weapon2': '0.236', 'AMMO4': '0.296', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.000', 'HITCOUNT': '2.610', 'weapon3': '3.196', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '47.000'} [2024-08-06 06:19:25,746][52658] DAMAGECOUNT value on done: 729858.0 [2024-08-06 06:19:25,747][52658] Sum rewards: 84.811, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.290', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.120', 'weapon2': '0.218', 'weapon5': '0.222', 'AMMO3': '0.228', 'AMMO4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.747', 'FRAGCOUNT': '70.000'} [2024-08-06 06:19:26,270][52669] DAMAGECOUNT value on done: 743477.0 [2024-08-06 06:19:26,271][52669] Sum rewards: 71.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.169', 'weapon2': '0.332', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.236', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:26,430][52664] DAMAGECOUNT value on done: 764886.0 [2024-08-06 06:19:26,431][52664] Sum rewards: 80.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.410', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.158', 'AMMO4': '0.196', 'weapon2': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '69.000'} [2024-08-06 06:19:26,506][52670] DAMAGECOUNT value on done: 710288.0 [2024-08-06 06:19:26,506][52670] Sum rewards: 66.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.583', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon4': '0.094', 'AMMO3': '0.235', 'weapon5': '0.250', 'AMMO4': '0.301', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.906', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.000'} [2024-08-06 06:19:26,966][52668] DAMAGECOUNT value on done: 740697.0 [2024-08-06 06:19:26,966][52668] Sum rewards: 84.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.066', 'AMMO4': '0.079', 'weapon4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.209', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '70.000'} [2024-08-06 06:19:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 556556288. Throughput: 0: 4364.0. Samples: 139147300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:27,794][52567] Avg episode reward: [(0, '74.687')] [2024-08-06 06:19:28,327][52658] DAMAGECOUNT value on done: 729842.0 [2024-08-06 06:19:28,327][52658] Sum rewards: 67.561, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.274', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.056', 'weapon4': '0.064', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.920', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2024-08-06 06:19:28,568][52666] DAMAGECOUNT value on done: 720596.0 [2024-08-06 06:19:28,570][52666] Sum rewards: 77.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.074', 'AMMO4': '0.155', 'weapon5': '0.168', 'weapon2': '0.282', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.206', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:28,800][52671] DAMAGECOUNT value on done: 738682.0 [2024-08-06 06:19:28,800][52671] Sum rewards: 76.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.284', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.112', 'weapon5': '0.112', 'AMMO4': '0.190', 'AMMO3': '0.197', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:28,812][52650] Updated weights for policy 0, policy_version 67941 (0.0022) [2024-08-06 06:19:28,908][52664] DAMAGECOUNT value on done: 769010.0 [2024-08-06 06:19:28,909][52664] Sum rewards: 73.551, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.844', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon2': '0.186', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'HITCOUNT': '3.530', 'weapon3': '3.580', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:29,456][52669] DAMAGECOUNT value on done: 737101.0 [2024-08-06 06:19:29,456][52669] Sum rewards: 65.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.572', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.112', 'AMMO4': '0.155', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon5': '0.364', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '54.000'} [2024-08-06 06:19:29,489][52670] DAMAGECOUNT value on done: 721442.0 [2024-08-06 06:19:29,489][52670] Sum rewards: 89.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.656', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.076', 'AMMO3': '0.212', 'weapon5': '0.212', 'AMMO4': '0.275', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.741', 'FRAGCOUNT': '71.500'} [2024-08-06 06:19:29,650][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:19:30,004][52662] DAMAGECOUNT value on done: 734346.0 [2024-08-06 06:19:30,005][52662] Sum rewards: 75.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.739', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.136', 'AMMO3': '0.177', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.410', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:30,669][52668] DAMAGECOUNT value on done: 725099.0 [2024-08-06 06:19:30,669][52668] Sum rewards: 80.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.122', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:31,155][52658] DAMAGECOUNT value on done: 735045.0 [2024-08-06 06:19:31,155][52658] Sum rewards: 80.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.646', 'AMMO5': '0.016', 'AMMO2': '0.067', 'weapon2': '0.150', 'weapon5': '0.168', 'AMMO3': '0.214', 'weapon4': '0.282', 'AMMO4': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:31,541][52664] DAMAGECOUNT value on done: 771068.0 [2024-08-06 06:19:31,541][52664] Sum rewards: 84.602, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.107', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.131', 'weapon5': '0.204', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.450', 'weapon4': '0.530', 'WEAPON3': '0.900', 'weapon3': '2.608', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:31,579][52666] DAMAGECOUNT value on done: 724163.0 [2024-08-06 06:19:31,582][52666] Sum rewards: 79.823, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.070', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon2': '0.248', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.558', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '69.000'} [2024-08-06 06:19:31,840][52671] DAMAGECOUNT value on done: 741982.0 [2024-08-06 06:19:31,840][52671] Sum rewards: 82.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'weapon2': '0.142', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.464', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '70.000'} [2024-08-06 06:19:32,501][52670] DAMAGECOUNT value on done: 730236.0 [2024-08-06 06:19:32,501][52670] Sum rewards: 82.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.375', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '68.000'} [2024-08-06 06:19:32,542][52669] DAMAGECOUNT value on done: 740933.0 [2024-08-06 06:19:32,543][52669] Sum rewards: 76.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.160', 'AMMO4': '0.177', 'AMMO3': '0.231', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 556646400. Throughput: 0: 4365.3. Samples: 139160420. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:32,794][52567] Avg episode reward: [(0, '75.357')] [2024-08-06 06:19:32,934][52650] Updated weights for policy 0, policy_version 67951 (0.0011) [2024-08-06 06:19:33,027][52662] DAMAGECOUNT value on done: 740401.0 [2024-08-06 06:19:33,027][52662] Sum rewards: 77.480, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.129', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:33,372][52668] DAMAGECOUNT value on done: 739157.0 [2024-08-06 06:19:33,372][52668] Sum rewards: 75.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.444', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.114', 'AMMO4': '0.172', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.396', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:34,231][52668] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2024-08-06 06:19:34,280][52666] DAMAGECOUNT value on done: 737107.0 [2024-08-06 06:19:34,282][52666] Sum rewards: 82.834, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.185', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon2': '0.162', 'AMMO4': '0.163', 'AMMO3': '0.181', 'weapon5': '0.190', 'weapon4': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:34,538][52664] DAMAGECOUNT value on done: 765714.0 [2024-08-06 06:19:34,538][52664] Sum rewards: 79.596, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon4': '0.216', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '68.000'} [2024-08-06 06:19:34,651][52671] DAMAGECOUNT value on done: 733607.0 [2024-08-06 06:19:34,651][52671] Sum rewards: 71.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.130', 'weapon5': '0.170', 'AMMO4': '0.224', 'AMMO3': '0.235', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:35,198][52670] DAMAGECOUNT value on done: 725853.0 [2024-08-06 06:19:35,200][52670] Sum rewards: 72.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.834', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.094', 'weapon5': '0.108', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:35,335][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:19:35,528][52669] DAMAGECOUNT value on done: 742516.0 [2024-08-06 06:19:35,529][52669] Sum rewards: 78.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'weapon2': '0.140', 'weapon4': '0.148', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.444', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '65.000'} [2024-08-06 06:19:35,782][52662] DAMAGECOUNT value on done: 743081.0 [2024-08-06 06:19:35,789][52662] Sum rewards: 72.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.116', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.038', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.380', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:35,949][52668] DAMAGECOUNT value on done: 737943.0 [2024-08-06 06:19:35,951][52668] Sum rewards: 62.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.092', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.116', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '52.000'} [2024-08-06 06:19:36,749][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:19:37,293][52666] DAMAGECOUNT value on done: 712241.0 [2024-08-06 06:19:37,293][52666] Sum rewards: 74.900, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.753', 'weapon4': '0.014', 'AMMO5': '0.015', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.416', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:37,568][52647] DAMAGECOUNT value on done: 777535.0 [2024-08-06 06:19:37,570][52647] Sum rewards: 85.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'weapon4': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.480', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '72.000'} [2024-08-06 06:19:37,622][52664] DAMAGECOUNT value on done: 756142.0 [2024-08-06 06:19:37,623][52664] Sum rewards: 71.572, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.586', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.126', 'weapon4': '0.150', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 556728320. Throughput: 0: 4368.7. Samples: 139186810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:37,794][52567] Avg episode reward: [(0, '75.443')] [2024-08-06 06:19:38,019][52650] Updated weights for policy 0, policy_version 67961 (0.0014) [2024-08-06 06:19:38,223][52670] DAMAGECOUNT value on done: 729416.0 [2024-08-06 06:19:38,223][52670] Sum rewards: 63.000, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.683', 'AMMO5': '0.022', 'AMMO2': '0.045', 'AMMO3': '0.180', 'weapon4': '0.188', 'AMMO4': '0.227', 'weapon5': '0.236', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '52.000'} [2024-08-06 06:19:38,790][52668] DAMAGECOUNT value on done: 731101.0 [2024-08-06 06:19:38,791][52668] Sum rewards: 81.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.255', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon4': '0.276', 'weapon2': '0.306', 'WEAPON3': '1.050', 'weapon3': '3.154', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:38,825][52662] DAMAGECOUNT value on done: 727059.0 [2024-08-06 06:19:38,825][52662] Sum rewards: 74.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.525', 'AMMO5': '0.022', 'AMMO2': '0.072', 'AMMO3': '0.261', 'weapon2': '0.272', 'weapon4': '0.284', 'AMMO4': '0.362', 'weapon5': '0.362', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.712', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:39,911][52647] DAMAGECOUNT value on done: 768270.0 [2024-08-06 06:19:39,912][52647] Sum rewards: 86.093, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.198', 'AMMO3': '0.254', 'WEAPON3': '1.650', 'weapon3': '3.516', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.057', 'FRAGCOUNT': '73.000'} [2024-08-06 06:19:39,986][52664] DAMAGECOUNT value on done: 757271.0 [2024-08-06 06:19:39,987][52664] Sum rewards: 69.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.128', 'weapon5': '0.130', 'weapon2': '0.194', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.432', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2024-08-06 06:19:40,517][52666] DAMAGECOUNT value on done: 725642.0 [2024-08-06 06:19:40,518][52666] Sum rewards: 78.083, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.251', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.120', 'AMMO4': '0.170', 'weapon2': '0.244', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.252', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:41,475][52662] DAMAGECOUNT value on done: 744642.0 [2024-08-06 06:19:41,484][52662] Sum rewards: 76.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.104', 'AMMO5': '0.019', 'AMMO2': '0.069', 'AMMO3': '0.154', 'weapon5': '0.198', 'weapon4': '0.210', 'AMMO4': '0.347', 'weapon2': '0.466', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.748', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:41,498][52668] DAMAGECOUNT value on done: 729326.0 [2024-08-06 06:19:41,498][52668] Sum rewards: 69.054, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon4': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:42,377][52647] DAMAGECOUNT value on done: 775936.0 [2024-08-06 06:19:42,377][52647] Sum rewards: 83.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.094', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '69.000'} [2024-08-06 06:19:42,443][52664] DAMAGECOUNT value on done: 760089.0 [2024-08-06 06:19:42,445][52664] Sum rewards: 69.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.715', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.069', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.276', 'weapon2': '0.344', 'WEAPON3': '1.750', 'weapon3': '3.312', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:42,634][52650] Updated weights for policy 0, policy_version 67971 (0.0039) [2024-08-06 06:19:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 556818432. Throughput: 0: 4378.0. Samples: 139213230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:42,795][52567] Avg episode reward: [(0, '75.685')] [2024-08-06 06:19:44,087][52662] DAMAGECOUNT value on done: 727231.0 [2024-08-06 06:19:44,087][52662] Sum rewards: 75.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.736', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.135', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '61.000'} [2024-08-06 06:19:44,605][52668] DAMAGECOUNT value on done: 737723.0 [2024-08-06 06:19:44,605][52668] Sum rewards: 64.685, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.296', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.072', 'weapon5': '0.140', 'weapon2': '0.262', 'AMMO4': '0.275', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.270', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:44,896][52647] DAMAGECOUNT value on done: 774766.0 [2024-08-06 06:19:44,897][52647] Sum rewards: 84.535, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon2': '0.228', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'weapon3': '3.590', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.285', 'FRAGCOUNT': '71.000'} [2024-08-06 06:19:45,068][52664] DAMAGECOUNT value on done: 757826.0 [2024-08-06 06:19:45,069][52664] Sum rewards: 71.672, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.860', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.098', 'AMMO4': '0.108', 'AMMO3': '0.175', 'weapon2': '0.430', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.300', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:46,963][52662] DAMAGECOUNT value on done: 734310.0 [2024-08-06 06:19:46,971][52662] Sum rewards: 80.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.516', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.122', 'weapon4': '0.156', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:47,434][52650] Updated weights for policy 0, policy_version 67981 (0.0011) [2024-08-06 06:19:47,569][52647] DAMAGECOUNT value on done: 779503.0 [2024-08-06 06:19:47,570][52647] Sum rewards: 77.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.148', 'AMMO3': '0.196', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.810', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:47,622][52668] DAMAGECOUNT value on done: 733780.0 [2024-08-06 06:19:47,623][52668] Sum rewards: 63.809, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.431', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.042', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.510', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '56.500'} [2024-08-06 06:19:47,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 556908544. Throughput: 0: 4374.0. Samples: 139226310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:19:47,795][52567] Avg episode reward: [(0, '75.852')] [2024-08-06 06:19:47,798][52614] Saving new best policy, reward=75.852! [2024-08-06 06:19:49,930][52662] DAMAGECOUNT value on done: 746965.0 [2024-08-06 06:19:49,934][52662] Sum rewards: 72.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon4': '0.086', 'AMMO3': '0.201', 'weapon5': '0.204', 'AMMO4': '0.310', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.170', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:50,696][52647] DAMAGECOUNT value on done: 779938.0 [2024-08-06 06:19:50,698][52647] Sum rewards: 68.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.537', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon4': '0.136', 'AMMO3': '0.219', 'weapon5': '0.290', 'AMMO4': '0.318', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.702', 'WEAPON3': '1.250', 'weapon3': '2.462', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '57.000'} [2024-08-06 06:19:50,711][52668] DAMAGECOUNT value on done: 725971.0 [2024-08-06 06:19:50,711][52668] Sum rewards: 67.924, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.860', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.267', 'weapon2': '0.282', 'WEAPON3': '1.500', 'HITCOUNT': '3.520', 'weapon3': '3.534', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 06:19:51,726][52650] Updated weights for policy 0, policy_version 67991 (0.0034) [2024-08-06 06:19:52,581][52662] DAMAGECOUNT value on done: 736531.0 [2024-08-06 06:19:52,582][52662] Sum rewards: 82.542, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.142', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.050', 'weapon3': '3.352', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '65.000'} [2024-08-06 06:19:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 556990464. Throughput: 0: 4372.0. Samples: 139252460. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:19:52,794][52567] Avg episode reward: [(0, '75.787')] [2024-08-06 06:19:53,508][52668] DAMAGECOUNT value on done: 721033.0 [2024-08-06 06:19:53,509][52668] Sum rewards: 74.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.190', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon4': '0.174', 'weapon5': '0.218', 'weapon2': '0.234', 'AMMO3': '0.274', 'AMMO4': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.058', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '64.000'} [2024-08-06 06:19:53,819][52647] DAMAGECOUNT value on done: 779139.0 [2024-08-06 06:19:53,820][52647] Sum rewards: 82.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.017', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.093', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '66.000'} [2024-08-06 06:19:55,063][52662] DAMAGECOUNT value on done: 742818.0 [2024-08-06 06:19:55,064][52662] Sum rewards: 77.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.090', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.112', 'AMMO4': '0.154', 'AMMO3': '0.212', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.344', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '63.000'} [2024-08-06 06:19:55,181][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:19:56,173][52668] DAMAGECOUNT value on done: 722189.0 [2024-08-06 06:19:56,174][52668] Sum rewards: 76.882, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.664', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.016', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.256', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.438', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '65.000'} [2024-08-06 06:19:56,646][52647] DAMAGECOUNT value on done: 759809.0 [2024-08-06 06:19:56,646][52647] Sum rewards: 78.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO3': '0.186', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.500'} [2024-08-06 06:19:56,796][52650] Updated weights for policy 0, policy_version 68001 (0.0013) [2024-08-06 06:19:56,800][52660] DAMAGECOUNT value on done: 734286.0 [2024-08-06 06:19:56,800][52660] Sum rewards: 84.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.822', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.067', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '71.000'} [2024-08-06 06:19:57,646][52662] DAMAGECOUNT value on done: 730989.0 [2024-08-06 06:19:57,646][52662] Sum rewards: 67.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.702', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.226', 'weapon2': '0.238', 'weapon4': '0.294', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '2.922', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '59.000'} [2024-08-06 06:19:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 557080576. Throughput: 0: 4378.9. Samples: 139278710. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:19:57,795][52567] Avg episode reward: [(0, '76.027')] [2024-08-06 06:19:57,797][52614] Saving new best policy, reward=76.027! [2024-08-06 06:19:58,794][52668] DAMAGECOUNT value on done: 720572.0 [2024-08-06 06:19:58,794][52668] Sum rewards: 73.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.256', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.183', 'AMMO4': '0.208', 'weapon5': '0.218', 'weapon4': '0.282', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '60.000'} [2024-08-06 06:19:59,623][52660] DAMAGECOUNT value on done: 723916.0 [2024-08-06 06:19:59,623][52660] Sum rewards: 67.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.805', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.138', 'weapon2': '0.208', 'AMMO4': '0.209', 'AMMO3': '0.213', 'weapon5': '0.230', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '56.000'} [2024-08-06 06:19:59,690][52647] DAMAGECOUNT value on done: 775075.0 [2024-08-06 06:19:59,690][52647] Sum rewards: 64.657, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.613', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.122', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.309', 'WEAPON3': '1.800', 'weapon3': '3.226', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '58.000'} [2024-08-06 06:20:00,145][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:20:00,470][52662] DAMAGECOUNT value on done: 732131.0 [2024-08-06 06:20:00,471][52662] Sum rewards: 76.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.345', 'AMMO5': '0.012', 'AMMO2': '0.060', 'weapon4': '0.068', 'weapon5': '0.178', 'weapon2': '0.190', 'AMMO3': '0.263', 'AMMO4': '0.299', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.308', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 06:20:01,018][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:20:01,386][52650] Updated weights for policy 0, policy_version 68011 (0.0020) [2024-08-06 06:20:02,048][52668] DAMAGECOUNT value on done: 733637.0 [2024-08-06 06:20:02,051][52668] Sum rewards: 85.801, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.035', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.345', 'FRAGCOUNT': '69.000'} [2024-08-06 06:20:02,243][52647] DAMAGECOUNT value on done: 773863.0 [2024-08-06 06:20:02,243][52647] Sum rewards: 76.341, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.182', 'weapon5': '0.190', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.742', 'WEAPON3': '1.150', 'weapon3': '2.574', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:02,767][52660] DAMAGECOUNT value on done: 736870.0 [2024-08-06 06:20:02,770][52660] Sum rewards: 77.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.126', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.142', 'AMMO4': '0.182', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '63.000'} [2024-08-06 06:20:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 557170688. Throughput: 0: 4372.9. Samples: 139291410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:20:02,794][52567] Avg episode reward: [(0, '75.639')] [2024-08-06 06:20:03,323][52662] DAMAGECOUNT value on done: 728231.0 [2024-08-06 06:20:03,323][52662] Sum rewards: 63.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.146', 'weapon5': '0.204', 'AMMO4': '0.225', 'AMMO3': '0.234', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.450', 'weapon3': '2.846', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '54.000'} [2024-08-06 06:20:04,210][52662] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 06:20:04,640][52647] DAMAGECOUNT value on done: 771074.0 [2024-08-06 06:20:04,641][52647] Sum rewards: 68.568, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.054', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.344', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.356', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '58.000'} [2024-08-06 06:20:04,813][52668] DAMAGECOUNT value on done: 731615.0 [2024-08-06 06:20:04,816][52668] Sum rewards: 85.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.190', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.124', 'weapon5': '0.184', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '70.000'} [2024-08-06 06:20:05,567][52660] DAMAGECOUNT value on done: 744972.0 [2024-08-06 06:20:05,568][52660] Sum rewards: 84.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.562', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.175', 'weapon4': '0.192', 'weapon2': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '67.000'} [2024-08-06 06:20:05,643][52662] DAMAGECOUNT value on done: 740154.0 [2024-08-06 06:20:05,645][52662] Sum rewards: 96.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.450', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.090', 'AMMO3': '0.185', 'AMMO4': '0.201', 'weapon5': '0.206', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.877', 'FRAGCOUNT': '78.000'} [2024-08-06 06:20:06,101][52650] Updated weights for policy 0, policy_version 68021 (0.0025) [2024-08-06 06:20:07,215][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:20:07,401][52668] DAMAGECOUNT value on done: 731710.0 [2024-08-06 06:20:07,401][52668] Sum rewards: 86.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.016', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.442', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '72.000'} [2024-08-06 06:20:07,641][52663] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:20:07,661][52614] Signal inference workers to stop experience collection... (12400 times) [2024-08-06 06:20:07,668][52614] Signal inference workers to resume experience collection... (12400 times) [2024-08-06 06:20:07,748][52650] InferenceWorker_p0-w0: stopping experience collection (12400 times) [2024-08-06 06:20:07,757][52650] InferenceWorker_p0-w0: resuming experience collection (12400 times) [2024-08-06 06:20:07,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.9, 300 sec: 17522.6). Total num frames: 557260800. Throughput: 0: 4368.7. Samples: 139317640. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:20:07,794][52567] Avg episode reward: [(0, '75.973')] [2024-08-06 06:20:07,980][52647] DAMAGECOUNT value on done: 765806.0 [2024-08-06 06:20:07,981][52647] Sum rewards: 76.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.806', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.278', 'weapon2': '0.348', 'WEAPON3': '1.700', 'weapon3': '3.336', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '66.000'} [2024-08-06 06:20:08,228][52660] DAMAGECOUNT value on done: 729006.0 [2024-08-06 06:20:08,230][52660] Sum rewards: 80.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.161', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.120', 'weapon5': '0.142', 'AMMO4': '0.222', 'AMMO3': '0.236', 'weapon2': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '68.000'} [2024-08-06 06:20:08,440][52662] DAMAGECOUNT value on done: 728974.0 [2024-08-06 06:20:08,441][52662] Sum rewards: 74.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.134', 'AMMO3': '0.199', 'weapon5': '0.214', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '61.000'} [2024-08-06 06:20:10,590][52668] DAMAGECOUNT value on done: 737230.0 [2024-08-06 06:20:10,591][52668] Sum rewards: 81.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.698', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.128', 'weapon2': '0.170', 'weapon5': '0.192', 'AMMO4': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '68.000'} [2024-08-06 06:20:10,760][52650] Updated weights for policy 0, policy_version 68031 (0.0012) [2024-08-06 06:20:10,973][52647] DAMAGECOUNT value on done: 779058.0 [2024-08-06 06:20:10,973][52647] Sum rewards: 68.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.995', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.022', 'weapon5': '0.028', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.690', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '57.000'} [2024-08-06 06:20:10,980][52662] DAMAGECOUNT value on done: 742268.0 [2024-08-06 06:20:10,982][52662] Sum rewards: 68.980, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.171', 'AMMO3': '0.176', 'weapon4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.708', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '56.000'} [2024-08-06 06:20:11,621][52660] DAMAGECOUNT value on done: 723332.0 [2024-08-06 06:20:11,621][52660] Sum rewards: 64.984, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO3': '0.181', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.290', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '52.000'} [2024-08-06 06:20:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 557342720. Throughput: 0: 4370.0. Samples: 139343950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:20:12,794][52567] Avg episode reward: [(0, '75.521')] [2024-08-06 06:20:13,719][52668] DAMAGECOUNT value on done: 735999.0 [2024-08-06 06:20:13,720][52668] Sum rewards: 74.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.524', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.086', 'AMMO4': '0.158', 'AMMO3': '0.168', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '60.000'} [2024-08-06 06:20:13,851][52647] DAMAGECOUNT value on done: 763231.0 [2024-08-06 06:20:13,852][52647] Sum rewards: 67.998, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.892', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.110', 'AMMO4': '0.167', 'weapon5': '0.210', 'AMMO3': '0.263', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '59.000'} [2024-08-06 06:20:14,193][52649] DAMAGECOUNT value on done: 711517.0 [2024-08-06 06:20:14,195][52649] Sum rewards: 78.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.610', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.158', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.000', 'weapon3': '3.160', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '63.000'} [2024-08-06 06:20:14,262][52662] DAMAGECOUNT value on done: 738608.0 [2024-08-06 06:20:14,262][52662] Sum rewards: 77.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.132', 'AMMO4': '0.210', 'weapon5': '0.216', 'AMMO3': '0.223', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:14,489][52660] DAMAGECOUNT value on done: 731042.0 [2024-08-06 06:20:14,489][52660] Sum rewards: 73.166, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.280', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.144', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '3.280', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '58.000'} [2024-08-06 06:20:15,699][52650] Updated weights for policy 0, policy_version 68041 (0.0013) [2024-08-06 06:20:16,225][52647] DAMAGECOUNT value on done: 776760.0 [2024-08-06 06:20:16,226][52647] Sum rewards: 86.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.368', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon2': '0.160', 'AMMO3': '0.206', 'weapon5': '0.218', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '70.000'} [2024-08-06 06:20:17,075][52660] DAMAGECOUNT value on done: 740116.0 [2024-08-06 06:20:17,076][52660] Sum rewards: 80.851, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.316', 'AMMO2': '0.000', 'AMMO4': '0.000', 'weapon2': '0.116', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.706', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '68.000'} [2024-08-06 06:20:17,315][52649] DAMAGECOUNT value on done: 704997.0 [2024-08-06 06:20:17,316][52649] Sum rewards: 66.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.814', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO4': '0.215', 'AMMO3': '0.220', 'weapon5': '0.254', 'weapon2': '0.328', 'WEAPON5': '0.400', 'weapon4': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.646', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.500'} [2024-08-06 06:20:17,528][52662] DAMAGECOUNT value on done: 725689.0 [2024-08-06 06:20:17,530][52662] Sum rewards: 74.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.649', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon2': '0.190', 'weapon4': '0.202', 'AMMO3': '0.207', 'weapon5': '0.240', 'AMMO4': '0.256', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 557432832. Throughput: 0: 4371.8. Samples: 139357150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:20:17,794][52567] Avg episode reward: [(0, '75.552')] [2024-08-06 06:20:18,833][52647] DAMAGECOUNT value on done: 776537.0 [2024-08-06 06:20:18,836][52647] Sum rewards: 67.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO3': '0.240', 'AMMO4': '0.244', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.226', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 06:20:19,810][52658] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:20:19,894][52650] Updated weights for policy 0, policy_version 68051 (0.0016) [2024-08-06 06:20:19,939][52660] DAMAGECOUNT value on done: 725700.0 [2024-08-06 06:20:19,942][52660] Sum rewards: 63.852, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.124', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.880', 'weapon3': '3.388', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '52.000'} [2024-08-06 06:20:20,152][52649] DAMAGECOUNT value on done: 723702.0 [2024-08-06 06:20:20,152][52649] Sum rewards: 76.636, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.521', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.126', 'weapon5': '0.146', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON3': '1.650', 'weapon3': '3.292', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '66.000'} [2024-08-06 06:20:20,575][52662] DAMAGECOUNT value on done: 734666.0 [2024-08-06 06:20:20,577][52662] Sum rewards: 78.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.970', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.220', 'AMMO3': '0.229', 'weapon4': '0.246', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '66.000'} [2024-08-06 06:20:21,914][52647] DAMAGECOUNT value on done: 763195.0 [2024-08-06 06:20:21,914][52647] Sum rewards: 62.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.534', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon2': '0.196', 'AMMO4': '0.210', 'AMMO3': '0.212', 'weapon5': '0.256', 'weapon4': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.016', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '50.500'} [2024-08-06 06:20:22,679][52660] DAMAGECOUNT value on done: 728409.0 [2024-08-06 06:20:22,683][52660] Sum rewards: 73.306, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.795', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '3.260', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '57.000'} [2024-08-06 06:20:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 557522944. Throughput: 0: 4372.2. Samples: 139383560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:20:22,794][52567] Avg episode reward: [(0, '75.382')] [2024-08-06 06:20:22,937][52649] DAMAGECOUNT value on done: 717119.0 [2024-08-06 06:20:22,939][52649] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.094', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.424', 'weapon2': '0.612', 'WEAPON3': '0.850', 'HITCOUNT': '3.090', 'weapon3': '3.096', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '52.000'} [2024-08-06 06:20:23,144][52659] DAMAGECOUNT value on done: 737086.0 [2024-08-06 06:20:23,144][52659] Sum rewards: 73.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.328', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon4': '0.092', 'weapon5': '0.186', 'AMMO3': '0.241', 'weapon2': '0.300', 'AMMO4': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:23,728][52662] DAMAGECOUNT value on done: 724876.0 [2024-08-06 06:20:23,730][52662] Sum rewards: 83.537, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.174', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.218', 'HEALTH': '0.651', 'WEAPON3': '0.950', 'weapon3': '3.164', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '65.000'} [2024-08-06 06:20:24,652][52647] DAMAGECOUNT value on done: 770147.0 [2024-08-06 06:20:24,653][52647] Sum rewards: 80.155, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.152', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.100', 'AMMO4': '0.160', 'AMMO3': '0.176', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '64.000'} [2024-08-06 06:20:24,848][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:20:24,987][52650] Updated weights for policy 0, policy_version 68061 (0.0028) [2024-08-06 06:20:25,495][52659] DAMAGECOUNT value on done: 735517.0 [2024-08-06 06:20:25,496][52659] Sum rewards: 80.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'weapon5': '0.050', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.212', 'AMMO3': '0.229', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '67.000'} [2024-08-06 06:20:25,539][52660] DAMAGECOUNT value on done: 733539.0 [2024-08-06 06:20:25,540][52660] Sum rewards: 79.162, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.525', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.128', 'weapon4': '0.154', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '63.000'} [2024-08-06 06:20:25,978][52649] DAMAGECOUNT value on done: 706276.0 [2024-08-06 06:20:25,979][52649] Sum rewards: 61.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.943', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.152', 'AMMO4': '0.196', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.880', 'weapon3': '3.190', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '52.000'} [2024-08-06 06:20:27,624][52647] DAMAGECOUNT value on done: 759518.0 [2024-08-06 06:20:27,624][52647] Sum rewards: 71.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'AMMO3': '0.249', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '59.000'} [2024-08-06 06:20:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 557596672. Throughput: 0: 4368.0. Samples: 139409790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:20:27,794][52567] Avg episode reward: [(0, '75.561')] [2024-08-06 06:20:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068066_557596672.pth... [2024-08-06 06:20:27,953][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067555_553410560.pth [2024-08-06 06:20:28,324][52670] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:20:28,413][52660] DAMAGECOUNT value on done: 725087.0 [2024-08-06 06:20:28,414][52660] Sum rewards: 73.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.142', 'AMMO3': '0.155', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '59.000'} [2024-08-06 06:20:28,546][52649] DAMAGECOUNT value on done: 722134.0 [2024-08-06 06:20:28,546][52649] Sum rewards: 84.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.339', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.210', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '70.000'} [2024-08-06 06:20:28,565][52659] DAMAGECOUNT value on done: 737684.0 [2024-08-06 06:20:28,565][52659] Sum rewards: 64.070, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.052', 'weapon4': '0.118', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.180', 'weapon3': '3.280', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '52.500'} [2024-08-06 06:20:29,524][52650] Updated weights for policy 0, policy_version 68071 (0.0012) [2024-08-06 06:20:30,983][52647] DAMAGECOUNT value on done: 764871.0 [2024-08-06 06:20:30,983][52647] Sum rewards: 75.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.454', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.080', 'AMMO4': '0.081', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '60.000'} [2024-08-06 06:20:31,053][52660] DAMAGECOUNT value on done: 733190.0 [2024-08-06 06:20:31,054][52660] Sum rewards: 85.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.110', 'AMMO4': '0.170', 'weapon4': '0.172', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '71.000'} [2024-08-06 06:20:31,296][52649] DAMAGECOUNT value on done: 716655.0 [2024-08-06 06:20:31,297][52649] Sum rewards: 70.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.647', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.160', 'AMMO3': '0.212', 'AMMO4': '0.240', 'weapon5': '0.306', 'weapon2': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '56.000'} [2024-08-06 06:20:32,018][52659] DAMAGECOUNT value on done: 737216.0 [2024-08-06 06:20:32,019][52659] Sum rewards: 81.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.207', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '67.000'} [2024-08-06 06:20:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 557694976. Throughput: 0: 4353.2. Samples: 139422200. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:20:32,794][52567] Avg episode reward: [(0, '75.649')] [2024-08-06 06:20:34,125][52660] DAMAGECOUNT value on done: 742500.0 [2024-08-06 06:20:34,126][52660] Sum rewards: 74.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.996', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:34,144][52649] DAMAGECOUNT value on done: 719189.0 [2024-08-06 06:20:34,146][52649] Sum rewards: 75.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.148', 'AMMO3': '0.207', 'AMMO4': '0.216', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:34,346][52650] Updated weights for policy 0, policy_version 68081 (0.0011) [2024-08-06 06:20:34,745][52659] DAMAGECOUNT value on done: 734324.0 [2024-08-06 06:20:34,747][52659] Sum rewards: 78.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.715', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.248', 'weapon2': '0.364', 'WEAPON3': '1.600', 'weapon3': '3.466', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '67.000'} [2024-08-06 06:20:36,872][52649] DAMAGECOUNT value on done: 718527.0 [2024-08-06 06:20:36,876][52649] Sum rewards: 73.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.147', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.308', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '59.000'} [2024-08-06 06:20:37,153][52660] DAMAGECOUNT value on done: 751798.0 [2024-08-06 06:20:37,155][52660] Sum rewards: 85.935, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.446', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.046', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.380', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '70.000'} [2024-08-06 06:20:37,186][52659] DAMAGECOUNT value on done: 736914.0 [2024-08-06 06:20:37,189][52659] Sum rewards: 67.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.404', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.108', 'weapon4': '0.134', 'AMMO4': '0.208', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.204', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '58.000'} [2024-08-06 06:20:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 557776896. Throughput: 0: 4357.3. Samples: 139448540. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:20:37,794][52567] Avg episode reward: [(0, '75.445')] [2024-08-06 06:20:38,954][52650] Updated weights for policy 0, policy_version 68091 (0.0039) [2024-08-06 06:20:39,864][52649] DAMAGECOUNT value on done: 711223.0 [2024-08-06 06:20:39,866][52649] Sum rewards: 79.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.003', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.168', 'weapon5': '0.212', 'AMMO3': '0.220', 'AMMO4': '0.263', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '67.000'} [2024-08-06 06:20:40,317][52660] DAMAGECOUNT value on done: 729366.0 [2024-08-06 06:20:40,319][52660] Sum rewards: 61.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.126', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.614', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.008', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '51.000'} [2024-08-06 06:20:40,362][52659] DAMAGECOUNT value on done: 736064.0 [2024-08-06 06:20:40,363][52659] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.255', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.185', 'weapon5': '0.230', 'weapon4': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '2.514', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '56.000'} [2024-08-06 06:20:41,351][52667] DAMAGECOUNT value on done: 735074.0 [2024-08-06 06:20:41,351][52667] Sum rewards: 80.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.038', 'weapon5': '0.058', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.660', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '68.000'} [2024-08-06 06:20:42,719][52649] DAMAGECOUNT value on done: 723218.0 [2024-08-06 06:20:42,719][52649] Sum rewards: 75.211, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.145', 'AMMO3': '0.202', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.9). Total num frames: 557867008. Throughput: 0: 4346.9. Samples: 139474320. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:20:42,794][52567] Avg episode reward: [(0, '75.129')] [2024-08-06 06:20:43,422][52659] DAMAGECOUNT value on done: 733612.0 [2024-08-06 06:20:43,422][52659] Sum rewards: 75.754, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.092', 'AMMO5': '0.024', 'AMMO2': '0.046', 'weapon4': '0.092', 'AMMO3': '0.154', 'AMMO4': '0.228', 'weapon5': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.704', 'WEAPON3': '0.950', 'weapon3': '2.650', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '59.500'} [2024-08-06 06:20:43,531][52650] Updated weights for policy 0, policy_version 68101 (0.0022) [2024-08-06 06:20:43,596][52660] DAMAGECOUNT value on done: 738352.0 [2024-08-06 06:20:43,597][52660] Sum rewards: 89.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.812', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.078', 'AMMO4': '0.156', 'weapon5': '0.174', 'AMMO3': '0.199', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '73.000'} [2024-08-06 06:20:43,710][52811] DAMAGECOUNT value on done: 700171.0 [2024-08-06 06:20:43,710][52811] Sum rewards: 77.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.161', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.222', 'AMMO3': '0.224', 'AMMO4': '0.230', 'weapon4': '0.298', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '63.000'} [2024-08-06 06:20:44,394][52667] DAMAGECOUNT value on done: 739153.0 [2024-08-06 06:20:44,396][52667] Sum rewards: 67.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.310', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.022', 'weapon5': '0.028', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.290', 'weapon2': '0.298', 'WEAPON3': '1.850', 'weapon3': '3.426', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '60.000'} [2024-08-06 06:20:45,637][52649] DAMAGECOUNT value on done: 724368.0 [2024-08-06 06:20:45,637][52649] Sum rewards: 77.530, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.509', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.048', 'AMMO4': '0.056', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.260', 'AMMO3': '0.273', 'WEAPON3': '1.600', 'weapon3': '3.400', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '66.000'} [2024-08-06 06:20:46,387][52659] DAMAGECOUNT value on done: 738202.0 [2024-08-06 06:20:46,388][52659] Sum rewards: 85.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.212', 'weapon2': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.596', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '70.000'} [2024-08-06 06:20:46,819][52660] DAMAGECOUNT value on done: 733907.0 [2024-08-06 06:20:46,821][52660] Sum rewards: 82.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.751', 'AMMO5': '0.021', 'AMMO2': '0.034', 'weapon4': '0.170', 'AMMO4': '0.171', 'AMMO3': '0.229', 'weapon5': '0.230', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '68.000'} [2024-08-06 06:20:46,947][52667] DAMAGECOUNT value on done: 736887.0 [2024-08-06 06:20:46,947][52667] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.016', 'HEALTH': '0.035', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'weapon2': '0.760', 'WEAPON3': '0.850', 'weapon3': '3.002', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '61.000'} [2024-08-06 06:20:46,958][52811] DAMAGECOUNT value on done: 682145.0 [2024-08-06 06:20:46,958][52811] Sum rewards: 82.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.764', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '67.000'} [2024-08-06 06:20:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 557957120. Throughput: 0: 4359.8. Samples: 139487600. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:20:47,794][52567] Avg episode reward: [(0, '75.613')] [2024-08-06 06:20:47,799][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:20:48,468][52650] Updated weights for policy 0, policy_version 68111 (0.0024) [2024-08-06 06:20:48,602][52649] DAMAGECOUNT value on done: 724027.0 [2024-08-06 06:20:48,603][52649] Sum rewards: 70.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.038', 'weapon5': '0.048', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '59.000'} [2024-08-06 06:20:49,066][52659] DAMAGECOUNT value on done: 743241.0 [2024-08-06 06:20:49,067][52659] Sum rewards: 72.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.746', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.036', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 06:20:49,327][52660] DAMAGECOUNT value on done: 727018.0 [2024-08-06 06:20:49,328][52660] Sum rewards: 74.447, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.374', 'AMMO5': '0.024', 'AMMO2': '0.061', 'weapon4': '0.124', 'weapon5': '0.148', 'AMMO3': '0.222', 'AMMO4': '0.304', 'weapon2': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '63.000'} [2024-08-06 06:20:49,621][52794] DAMAGECOUNT value on done: 732026.0 [2024-08-06 06:20:49,622][52794] Sum rewards: 60.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.034', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.210', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.694', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '50.000'} [2024-08-06 06:20:49,818][52667] DAMAGECOUNT value on done: 744857.0 [2024-08-06 06:20:49,820][52667] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.625', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.122', 'weapon5': '0.214', 'weapon2': '0.250', 'AMMO3': '0.253', 'AMMO4': '0.289', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '63.000'} [2024-08-06 06:20:50,152][52811] DAMAGECOUNT value on done: 682116.0 [2024-08-06 06:20:50,155][52811] Sum rewards: 84.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.246', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.210', 'FRAGCOUNT': '69.000'} [2024-08-06 06:20:51,637][52649] DAMAGECOUNT value on done: 724014.0 [2024-08-06 06:20:51,637][52649] Sum rewards: 76.407, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.855', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.088', 'weapon5': '0.130', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.290', 'weapon2': '0.416', 'WEAPON3': '1.750', 'weapon3': '3.054', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '65.000'} [2024-08-06 06:20:52,006][52659] DAMAGECOUNT value on done: 731015.0 [2024-08-06 06:20:52,007][52659] Sum rewards: 72.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.222', 'AMMO5': '0.006', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.076', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.236', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:52,375][52660] DAMAGECOUNT value on done: 724671.0 [2024-08-06 06:20:52,377][52660] Sum rewards: 91.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.222', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.060', 'AMMO4': '0.110', 'weapon5': '0.136', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.611', 'FRAGCOUNT': '74.000'} [2024-08-06 06:20:52,519][52794] DAMAGECOUNT value on done: 741353.0 [2024-08-06 06:20:52,520][52794] Sum rewards: 72.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.377', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 558039040. Throughput: 0: 4356.9. Samples: 139513700. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:20:52,802][52567] Avg episode reward: [(0, '75.562')] [2024-08-06 06:20:53,039][52647] Large shaping reward 2.511 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2024-08-06 06:20:53,055][52667] DAMAGECOUNT value on done: 743694.0 [2024-08-06 06:20:53,060][52667] Sum rewards: 73.999, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.178', 'AMMO4': '0.216', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '63.000'} [2024-08-06 06:20:53,173][52650] Updated weights for policy 0, policy_version 68121 (0.0012) [2024-08-06 06:20:53,426][52811] DAMAGECOUNT value on done: 682095.0 [2024-08-06 06:20:53,427][52811] Sum rewards: 71.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.735', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.154', 'weapon5': '0.272', 'AMMO3': '0.277', 'weapon2': '0.308', 'AMMO4': '0.322', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.968', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '61.000'} [2024-08-06 06:20:54,418][52659] DAMAGECOUNT value on done: 739903.0 [2024-08-06 06:20:54,418][52659] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.506', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.080', 'AMMO4': '0.191', 'weapon5': '0.206', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '62.000'} [2024-08-06 06:20:54,631][52649] DAMAGECOUNT value on done: 709689.0 [2024-08-06 06:20:54,635][52649] Sum rewards: 82.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.507', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.190', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.436', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '67.000'} [2024-08-06 06:20:55,440][52794] DAMAGECOUNT value on done: 745786.0 [2024-08-06 06:20:55,442][52794] Sum rewards: 72.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.118', 'AMMO4': '0.189', 'AMMO3': '0.239', 'weapon5': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '2.860', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '59.000'} [2024-08-06 06:20:55,948][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:20:56,487][52667] DAMAGECOUNT value on done: 744702.0 [2024-08-06 06:20:56,487][52667] Sum rewards: 73.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.122', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.684', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '61.000'} [2024-08-06 06:20:56,712][52811] DAMAGECOUNT value on done: 690794.0 [2024-08-06 06:20:56,712][52811] Sum rewards: 78.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.753', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.312', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '65.000'} [2024-08-06 06:20:57,360][52659] DAMAGECOUNT value on done: 736178.0 [2024-08-06 06:20:57,360][52659] Sum rewards: 76.158, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.420', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '64.500'} [2024-08-06 06:20:57,656][52650] Updated weights for policy 0, policy_version 68131 (0.0026) [2024-08-06 06:20:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 558129152. Throughput: 0: 4349.5. Samples: 139539680. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:20:57,794][52567] Avg episode reward: [(0, '75.524')] [2024-08-06 06:20:57,805][52649] DAMAGECOUNT value on done: 720656.0 [2024-08-06 06:20:57,805][52649] Sum rewards: 85.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.138', 'AMMO3': '0.191', 'weapon5': '0.214', 'AMMO4': '0.229', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.748', 'FRAGCOUNT': '68.000'} [2024-08-06 06:20:58,453][52794] DAMAGECOUNT value on done: 729878.0 [2024-08-06 06:20:58,457][52794] Sum rewards: 69.634, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.145', 'weapon5': '0.174', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '58.000'} [2024-08-06 06:20:59,070][52667] DAMAGECOUNT value on done: 740037.0 [2024-08-06 06:20:59,071][52667] Sum rewards: 71.435, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.909', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.096', 'weapon4': '0.132', 'AMMO4': '0.182', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '62.500'} [2024-08-06 06:20:59,328][52820] DAMAGECOUNT value on done: 681448.0 [2024-08-06 06:20:59,330][52820] Sum rewards: 84.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.542', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.240', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '68.000'} [2024-08-06 06:20:59,901][52811] DAMAGECOUNT value on done: 694439.0 [2024-08-06 06:20:59,903][52811] Sum rewards: 76.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.214', 'weapon4': '0.238', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:00,289][52659] DAMAGECOUNT value on done: 737190.0 [2024-08-06 06:21:00,291][52659] Sum rewards: 82.952, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'weapon5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'weapon2': '0.240', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.426', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '71.000'} [2024-08-06 06:21:00,549][52649] DAMAGECOUNT value on done: 708045.0 [2024-08-06 06:21:00,549][52649] Sum rewards: 81.232, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.138', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '66.000'} [2024-08-06 06:21:00,636][52795] DAMAGECOUNT value on done: 684118.0 [2024-08-06 06:21:00,636][52795] Sum rewards: 74.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.080', 'AMMO4': '0.141', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:01,723][52794] DAMAGECOUNT value on done: 731642.0 [2024-08-06 06:21:01,724][52794] Sum rewards: 79.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.769', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.070', 'AMMO4': '0.130', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.318', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '65.000'} [2024-08-06 06:21:02,092][52667] DAMAGECOUNT value on done: 736897.0 [2024-08-06 06:21:02,093][52667] Sum rewards: 82.723, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.252', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.176', 'AMMO3': '0.178', 'AMMO4': '0.250', 'weapon4': '0.256', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:02,495][52820] DAMAGECOUNT value on done: 681890.0 [2024-08-06 06:21:02,499][52820] Sum rewards: 74.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.990', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.162', 'weapon5': '0.226', 'weapon2': '0.238', 'AMMO3': '0.260', 'AMMO4': '0.273', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.066', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:02,749][52650] Updated weights for policy 0, policy_version 68141 (0.0013) [2024-08-06 06:21:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 558211072. Throughput: 0: 4346.9. Samples: 139552760. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:02,794][52567] Avg episode reward: [(0, '75.860')] [2024-08-06 06:21:02,893][52649] DAMAGECOUNT value on done: 724256.0 [2024-08-06 06:21:02,893][52649] Sum rewards: 82.806, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.275', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.132', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.246', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.273', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:02,972][52811] DAMAGECOUNT value on done: 691610.0 [2024-08-06 06:21:02,977][52811] Sum rewards: 72.794, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.706', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.094', 'AMMO4': '0.145', 'weapon5': '0.162', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.622', 'WEAPON3': '1.000', 'weapon3': '2.886', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:03,011][52659] DAMAGECOUNT value on done: 741186.0 [2024-08-06 06:21:03,011][52659] Sum rewards: 62.687, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.323', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.155', 'AMMO4': '0.201', 'weapon2': '0.242', 'weapon5': '0.248', 'weapon4': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.690', 'weapon3': '2.850', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '49.000'} [2024-08-06 06:21:03,781][52795] DAMAGECOUNT value on done: 672306.0 [2024-08-06 06:21:03,784][52795] Sum rewards: 82.154, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'weapon4': '0.118', 'WEAPON4': '0.150', 'weapon2': '0.238', 'AMMO3': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '69.000'} [2024-08-06 06:21:04,775][52667] DAMAGECOUNT value on done: 738918.0 [2024-08-06 06:21:04,775][52667] Sum rewards: 71.352, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.178', 'AMMO3': '0.184', 'weapon4': '0.210', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:04,882][52794] DAMAGECOUNT value on done: 736978.0 [2024-08-06 06:21:04,886][52794] Sum rewards: 67.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.134', 'AMMO3': '0.167', 'AMMO4': '0.223', 'weapon2': '0.232', 'weapon4': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.154', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '56.000'} [2024-08-06 06:21:05,711][52820] DAMAGECOUNT value on done: 682813.0 [2024-08-06 06:21:05,711][52820] Sum rewards: 80.541, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.055', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.182', 'weapon4': '0.214', 'AMMO3': '0.233', 'AMMO4': '0.244', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:05,937][52665] DAMAGECOUNT value on done: 722060.0 [2024-08-06 06:21:05,937][52665] Sum rewards: 85.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '72.000'} [2024-08-06 06:21:06,281][52659] DAMAGECOUNT value on done: 738054.0 [2024-08-06 06:21:06,289][52659] Sum rewards: 68.867, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.585', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.140', 'weapon5': '0.180', 'AMMO4': '0.210', 'weapon2': '0.260', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:06,301][52811] DAMAGECOUNT value on done: 681274.0 [2024-08-06 06:21:06,302][52811] Sum rewards: 75.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.737', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.114', 'weapon4': '0.172', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:06,372][52649] DAMAGECOUNT value on done: 726575.0 [2024-08-06 06:21:06,374][52649] Sum rewards: 81.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.004', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.090', 'weapon5': '0.234', 'AMMO4': '0.239', 'AMMO3': '0.247', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:06,915][52795] DAMAGECOUNT value on done: 673028.0 [2024-08-06 06:21:06,915][52795] Sum rewards: 85.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.004', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.246', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '69.000'} [2024-08-06 06:21:06,979][52650] Updated weights for policy 0, policy_version 68151 (0.0015) [2024-08-06 06:21:07,668][52667] DAMAGECOUNT value on done: 746778.0 [2024-08-06 06:21:07,668][52667] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.930', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '58.000'} [2024-08-06 06:21:07,756][52794] DAMAGECOUNT value on done: 740445.0 [2024-08-06 06:21:07,758][52794] Sum rewards: 77.798, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.550', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.171', 'weapon5': '0.174', 'weapon2': '0.220', 'AMMO3': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.282', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 558301184. Throughput: 0: 4339.6. Samples: 139578840. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:07,794][52567] Avg episode reward: [(0, '75.871')] [2024-08-06 06:21:07,813][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:21:08,504][52665] DAMAGECOUNT value on done: 737188.0 [2024-08-06 06:21:08,505][52665] Sum rewards: 76.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.112', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:08,710][52649] DAMAGECOUNT value on done: 715097.0 [2024-08-06 06:21:08,714][52649] Sum rewards: 75.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.069', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.362', 'WEAPON3': '1.300', 'HITCOUNT': '3.350', 'weapon3': '3.366', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '63.000'} [2024-08-06 06:21:08,848][52659] DAMAGECOUNT value on done: 744562.0 [2024-08-06 06:21:08,850][52659] Sum rewards: 78.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.407', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.064', 'AMMO3': '0.196', 'weapon5': '0.210', 'AMMO4': '0.248', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '63.000'} [2024-08-06 06:21:08,989][52820] DAMAGECOUNT value on done: 673540.0 [2024-08-06 06:21:08,989][52820] Sum rewards: 77.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.142', 'weapon5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.176', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '64.500'} [2024-08-06 06:21:09,464][52811] DAMAGECOUNT value on done: 694771.0 [2024-08-06 06:21:09,464][52811] Sum rewards: 90.950, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.203', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.562', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '75.000'} [2024-08-06 06:21:10,040][52795] DAMAGECOUNT value on done: 680866.0 [2024-08-06 06:21:10,041][52795] Sum rewards: 86.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.534', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.186', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'AMMO4': '0.273', 'weapon2': '0.296', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '70.000'} [2024-08-06 06:21:10,443][52667] DAMAGECOUNT value on done: 737543.0 [2024-08-06 06:21:10,443][52667] Sum rewards: 80.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.366', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.034', 'AMMO4': '0.041', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.326', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:10,938][52794] DAMAGECOUNT value on done: 727231.0 [2024-08-06 06:21:10,939][52794] Sum rewards: 69.838, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.059', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.150', 'weapon5': '0.162', 'weapon2': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.326', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:11,415][52665] DAMAGECOUNT value on done: 735999.0 [2024-08-06 06:21:11,416][52665] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:11,670][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:21:11,911][52659] DAMAGECOUNT value on done: 733524.0 [2024-08-06 06:21:11,912][52659] Sum rewards: 74.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'AMMO2': '0.001', 'AMMO4': '0.007', 'weapon2': '0.214', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.618', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '63.000'} [2024-08-06 06:21:12,078][52650] Updated weights for policy 0, policy_version 68161 (0.0020) [2024-08-06 06:21:12,286][52820] DAMAGECOUNT value on done: 687441.0 [2024-08-06 06:21:12,286][52820] Sum rewards: 67.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.986', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO3': '0.262', 'weapon5': '0.304', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:12,536][52811] DAMAGECOUNT value on done: 690190.0 [2024-08-06 06:21:12,537][52811] Sum rewards: 73.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.675', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.098', 'weapon4': '0.174', 'AMMO3': '0.179', 'AMMO4': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.836', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 558391296. Throughput: 0: 4334.7. Samples: 139604850. Policy #0 lag: (min: 1.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:12,794][52567] Avg episode reward: [(0, '76.140')] [2024-08-06 06:21:12,795][52614] Saving new best policy, reward=76.140! [2024-08-06 06:21:13,001][52667] DAMAGECOUNT value on done: 736484.0 [2024-08-06 06:21:13,004][52667] Sum rewards: 80.943, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.164', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.060', 'weapon5': '0.076', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:13,242][52795] DAMAGECOUNT value on done: 674195.0 [2024-08-06 06:21:13,243][52795] Sum rewards: 91.331, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.526', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.132', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'weapon2': '0.498', 'WEAPON3': '0.950', 'weapon3': '3.006', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '72.000'} [2024-08-06 06:21:13,732][52794] DAMAGECOUNT value on done: 738989.0 [2024-08-06 06:21:13,733][52794] Sum rewards: 65.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.942', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.136', 'weapon5': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '52.500'} [2024-08-06 06:21:14,276][52665] DAMAGECOUNT value on done: 729806.0 [2024-08-06 06:21:14,278][52665] Sum rewards: 72.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.456', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.218', 'weapon5': '0.228', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '2.942', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:15,051][52659] DAMAGECOUNT value on done: 743391.0 [2024-08-06 06:21:15,051][52659] Sum rewards: 80.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.171', 'weapon2': '0.216', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 06:21:15,521][52820] DAMAGECOUNT value on done: 670419.0 [2024-08-06 06:21:15,522][52820] Sum rewards: 80.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.055', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.090', 'weapon5': '0.180', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:15,770][52811] DAMAGECOUNT value on done: 692498.0 [2024-08-06 06:21:15,770][52811] Sum rewards: 72.242, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.168', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.134', 'AMMO3': '0.176', 'weapon5': '0.178', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.146', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:16,043][52667] DAMAGECOUNT value on done: 744521.0 [2024-08-06 06:21:16,045][52667] Sum rewards: 67.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.985', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon5': '0.040', 'AMMO4': '0.071', 'weapon4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.265', 'WEAPON3': '1.700', 'weapon3': '3.476', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 06:21:16,308][52669] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:21:16,360][52794] DAMAGECOUNT value on done: 731365.0 [2024-08-06 06:21:16,360][52794] Sum rewards: 68.026, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.204', 'AMMO4': '0.225', 'AMMO3': '0.245', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:16,392][52795] DAMAGECOUNT value on done: 682006.0 [2024-08-06 06:21:16,394][52795] Sum rewards: 69.436, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.636', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.114', 'WEAPON4': '0.150', 'weapon5': '0.186', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:16,583][52650] Updated weights for policy 0, policy_version 68171 (0.0029) [2024-08-06 06:21:16,915][52665] DAMAGECOUNT value on done: 717002.0 [2024-08-06 06:21:16,917][52665] Sum rewards: 71.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.462', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 558473216. Throughput: 0: 4345.3. Samples: 139617740. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:17,794][52567] Avg episode reward: [(0, '76.369')] [2024-08-06 06:21:17,798][52614] Saving new best policy, reward=76.369! [2024-08-06 06:21:17,968][52659] DAMAGECOUNT value on done: 733416.0 [2024-08-06 06:21:17,969][52659] Sum rewards: 83.629, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.198', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '20.634', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:18,563][52820] DAMAGECOUNT value on done: 680487.0 [2024-08-06 06:21:18,564][52820] Sum rewards: 65.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.134', 'AMMO3': '0.188', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '54.000'} [2024-08-06 06:21:18,713][52667] DAMAGECOUNT value on done: 732964.0 [2024-08-06 06:21:18,715][52667] Sum rewards: 77.112, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.402', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.239', 'WEAPON3': '1.500', 'weapon3': '3.438', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '66.000'} [2024-08-06 06:21:18,947][52811] DAMAGECOUNT value on done: 697030.0 [2024-08-06 06:21:18,947][52811] Sum rewards: 85.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.778', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.186', 'AMMO3': '0.217', 'AMMO4': '0.230', 'weapon4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '70.000'} [2024-08-06 06:21:19,504][52794] DAMAGECOUNT value on done: 727523.0 [2024-08-06 06:21:19,505][52794] Sum rewards: 70.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon2': '0.162', 'AMMO4': '0.200', 'weapon5': '0.224', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.296', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:19,704][52795] DAMAGECOUNT value on done: 688499.0 [2024-08-06 06:21:19,706][52795] Sum rewards: 72.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.969', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'weapon4': '0.120', 'AMMO4': '0.129', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:19,917][52665] DAMAGECOUNT value on done: 723367.0 [2024-08-06 06:21:19,917][52665] Sum rewards: 77.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.209', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon4': '0.196', 'AMMO3': '0.227', 'AMMO4': '0.289', 'weapon5': '0.324', 'weapon2': '0.432', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.698', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:21,331][52650] Updated weights for policy 0, policy_version 68181 (0.0033) [2024-08-06 06:21:21,607][52820] DAMAGECOUNT value on done: 683156.0 [2024-08-06 06:21:21,610][52820] Sum rewards: 63.118, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.210', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.304', 'weapon2': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.146', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:21,772][52667] DAMAGECOUNT value on done: 740697.0 [2024-08-06 06:21:21,773][52667] Sum rewards: 75.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.222', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.152', 'AMMO3': '0.174', 'AMMO4': '0.202', 'weapon5': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:21,953][52811] DAMAGECOUNT value on done: 689256.0 [2024-08-06 06:21:21,953][52811] Sum rewards: 63.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.139', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '52.000'} [2024-08-06 06:21:22,571][52794] DAMAGECOUNT value on done: 735979.0 [2024-08-06 06:21:22,573][52794] Sum rewards: 66.064, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.621', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO3': '0.169', 'AMMO4': '0.174', 'weapon4': '0.294', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '52.000'} [2024-08-06 06:21:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 558555136. Throughput: 0: 4335.6. Samples: 139643640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:22,794][52567] Avg episode reward: [(0, '76.084')] [2024-08-06 06:21:22,952][52795] DAMAGECOUNT value on done: 679846.0 [2024-08-06 06:21:22,953][52795] Sum rewards: 68.562, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.148', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.116', 'weapon5': '0.124', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon2': '0.344', 'WEAPON3': '1.800', 'weapon3': '3.104', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:23,030][52665] DAMAGECOUNT value on done: 729336.0 [2024-08-06 06:21:23,043][52665] Sum rewards: 70.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.775', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.332', 'weapon4': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:23,229][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:21:24,735][52820] DAMAGECOUNT value on done: 681701.0 [2024-08-06 06:21:24,736][52820] Sum rewards: 67.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.545', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.266', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '53.000'} [2024-08-06 06:21:24,749][52667] DAMAGECOUNT value on done: 746044.0 [2024-08-06 06:21:24,749][52667] Sum rewards: 67.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.388', 'weapon4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.688', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '56.000'} [2024-08-06 06:21:24,981][52811] DAMAGECOUNT value on done: 685152.0 [2024-08-06 06:21:24,982][52811] Sum rewards: 65.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.248', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.178', 'AMMO4': '0.192', 'AMMO3': '0.203', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '54.000'} [2024-08-06 06:21:25,325][52668] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:21:25,530][52794] DAMAGECOUNT value on done: 733898.0 [2024-08-06 06:21:25,530][52794] Sum rewards: 77.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.389', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.160', 'weapon4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '65.000'} [2024-08-06 06:21:26,130][52795] DAMAGECOUNT value on done: 679458.0 [2024-08-06 06:21:26,131][52795] Sum rewards: 73.936, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.364', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.212', 'AMMO3': '0.224', 'weapon5': '0.274', 'AMMO4': '0.288', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:26,134][52650] Updated weights for policy 0, policy_version 68191 (0.0033) [2024-08-06 06:21:26,234][52665] DAMAGECOUNT value on done: 725818.0 [2024-08-06 06:21:26,234][52665] Sum rewards: 64.203, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.599', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.212', 'AMMO4': '0.226', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '54.000'} [2024-08-06 06:21:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 558653440. Throughput: 0: 4351.1. Samples: 139670120. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:27,794][52567] Avg episode reward: [(0, '75.373')] [2024-08-06 06:21:27,812][52667] DAMAGECOUNT value on done: 744275.0 [2024-08-06 06:21:27,815][52667] Sum rewards: 72.488, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.080', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:27,885][52820] DAMAGECOUNT value on done: 689648.0 [2024-08-06 06:21:27,885][52820] Sum rewards: 74.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.910', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.105', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.354', 'WEAPON3': '1.700', 'weapon3': '3.210', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:28,116][52811] DAMAGECOUNT value on done: 684892.0 [2024-08-06 06:21:28,124][52811] Sum rewards: 77.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.132', 'weapon5': '0.146', 'AMMO4': '0.153', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '62.500'} [2024-08-06 06:21:28,691][52794] DAMAGECOUNT value on done: 750246.0 [2024-08-06 06:21:28,695][52794] Sum rewards: 84.723, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.727', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.176', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.352', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '69.000'} [2024-08-06 06:21:29,376][52795] DAMAGECOUNT value on done: 683274.0 [2024-08-06 06:21:29,376][52795] Sum rewards: 74.354, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.995', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.038', 'AMMO4': '0.117', 'weapon5': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:29,401][52665] DAMAGECOUNT value on done: 735382.0 [2024-08-06 06:21:29,402][52665] Sum rewards: 81.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.104', 'weapon4': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.208', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:30,640][52650] Updated weights for policy 0, policy_version 68201 (0.0025) [2024-08-06 06:21:30,846][52667] DAMAGECOUNT value on done: 742945.0 [2024-08-06 06:21:30,847][52667] Sum rewards: 68.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.815', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.088', 'weapon4': '0.096', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.158', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:31,063][52803] DAMAGECOUNT value on done: 683952.0 [2024-08-06 06:21:31,063][52803] Sum rewards: 62.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.130', 'weapon5': '0.158', 'AMMO3': '0.180', 'AMMO4': '0.219', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.754', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '51.000'} [2024-08-06 06:21:31,086][52820] DAMAGECOUNT value on done: 675636.0 [2024-08-06 06:21:31,090][52820] Sum rewards: 75.703, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.352', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.146', 'weapon5': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.320', 'weapon2': '0.410', 'WEAPON3': '0.900', 'weapon3': '2.942', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:31,329][52811] DAMAGECOUNT value on done: 686119.0 [2024-08-06 06:21:31,330][52811] Sum rewards: 82.329, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.346', 'weapon4': '0.368', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:31,988][52794] DAMAGECOUNT value on done: 729806.0 [2024-08-06 06:21:31,992][52794] Sum rewards: 84.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.756', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:32,320][52665] DAMAGECOUNT value on done: 727924.0 [2024-08-06 06:21:32,321][52665] Sum rewards: 77.098, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.205', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:32,520][52795] DAMAGECOUNT value on done: 677542.0 [2024-08-06 06:21:32,524][52795] Sum rewards: 75.107, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.845', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.052', 'WEAPON5': '0.150', 'weapon2': '0.154', 'weapon4': '0.174', 'AMMO3': '0.186', 'WEAPON3': '1.200', 'weapon3': '3.440', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 558735360. Throughput: 0: 4342.4. Samples: 139683010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:32,794][52567] Avg episode reward: [(0, '75.352')] [2024-08-06 06:21:33,645][52667] DAMAGECOUNT value on done: 741649.0 [2024-08-06 06:21:33,646][52667] Sum rewards: 74.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.276', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.064', 'AMMO3': '0.210', 'AMMO4': '0.211', 'weapon5': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:34,052][52803] DAMAGECOUNT value on done: 683763.0 [2024-08-06 06:21:34,053][52803] Sum rewards: 79.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.098', 'weapon4': '0.154', 'AMMO4': '0.210', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:34,317][52820] DAMAGECOUNT value on done: 683224.0 [2024-08-06 06:21:34,323][52820] Sum rewards: 68.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon2': '0.154', 'weapon5': '0.166', 'AMMO3': '0.270', 'AMMO4': '0.274', 'WEAPON5': '0.400', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.814', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '58.000'} [2024-08-06 06:21:34,443][52811] DAMAGECOUNT value on done: 691707.0 [2024-08-06 06:21:34,443][52811] Sum rewards: 77.554, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.764', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.134', 'AMMO3': '0.171', 'weapon4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:34,671][52794] DAMAGECOUNT value on done: 744661.0 [2024-08-06 06:21:34,671][52794] Sum rewards: 86.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.388', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.306', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '69.000'} [2024-08-06 06:21:35,124][52665] DAMAGECOUNT value on done: 737265.0 [2024-08-06 06:21:35,126][52665] Sum rewards: 77.559, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.220', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.154', 'AMMO3': '0.167', 'weapon5': '0.182', 'AMMO4': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:35,552][52650] Updated weights for policy 0, policy_version 68211 (0.0012) [2024-08-06 06:21:35,788][52795] DAMAGECOUNT value on done: 675850.0 [2024-08-06 06:21:35,790][52795] Sum rewards: 85.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.124', 'weapon5': '0.180', 'AMMO4': '0.212', 'AMMO3': '0.221', 'weapon2': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '71.000'} [2024-08-06 06:21:36,026][52667] DAMAGECOUNT value on done: 747368.0 [2024-08-06 06:21:36,028][52667] Sum rewards: 70.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.326', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.452', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.000'} [2024-08-06 06:21:36,252][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:21:37,160][52803] DAMAGECOUNT value on done: 691715.0 [2024-08-06 06:21:37,160][52803] Sum rewards: 83.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.731', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.224', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:37,170][52667] Large shaping reward 2.583 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)] [2024-08-06 06:21:37,501][52794] DAMAGECOUNT value on done: 739625.0 [2024-08-06 06:21:37,501][52794] Sum rewards: 78.401, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.604', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:37,528][52811] DAMAGECOUNT value on done: 694173.0 [2024-08-06 06:21:37,528][52811] Sum rewards: 90.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.088', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.162', 'weapon5': '0.178', 'AMMO4': '0.181', 'AMMO3': '0.209', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.940', 'FRAGCOUNT': '74.000'} [2024-08-06 06:21:37,541][52820] DAMAGECOUNT value on done: 691196.0 [2024-08-06 06:21:37,542][52820] Sum rewards: 63.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '51.000'} [2024-08-06 06:21:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 558825472. Throughput: 0: 4347.6. Samples: 139709340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:37,794][52567] Avg episode reward: [(0, '75.604')] [2024-08-06 06:21:37,900][52665] DAMAGECOUNT value on done: 735074.0 [2024-08-06 06:21:37,902][52665] Sum rewards: 88.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.744', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.084', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.519', 'FRAGCOUNT': '71.000'} [2024-08-06 06:21:38,035][52663] DAMAGECOUNT value on done: 749391.0 [2024-08-06 06:21:38,035][52663] Sum rewards: 70.952, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.415', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.236', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:38,658][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:21:38,942][52795] DAMAGECOUNT value on done: 675944.0 [2024-08-06 06:21:38,942][52795] Sum rewards: 76.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.918', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.062', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:39,843][52669] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:21:40,094][52803] DAMAGECOUNT value on done: 689013.0 [2024-08-06 06:21:40,100][52803] Sum rewards: 66.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.603', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.110', 'AMMO4': '0.185', 'weapon5': '0.194', 'AMMO3': '0.232', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '55.000'} [2024-08-06 06:21:40,170][52650] Updated weights for policy 0, policy_version 68221 (0.0021) [2024-08-06 06:21:40,396][52794] DAMAGECOUNT value on done: 741237.0 [2024-08-06 06:21:40,399][52794] Sum rewards: 77.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.686', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:40,579][52820] DAMAGECOUNT value on done: 684069.0 [2024-08-06 06:21:40,580][52820] Sum rewards: 75.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.616', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.092', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:40,775][52811] DAMAGECOUNT value on done: 689358.0 [2024-08-06 06:21:40,776][52811] Sum rewards: 78.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.086', 'weapon5': '0.128', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '63.000'} [2024-08-06 06:21:40,785][52665] DAMAGECOUNT value on done: 730934.0 [2024-08-06 06:21:40,785][52665] Sum rewards: 79.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.216', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.212', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '66.000'} [2024-08-06 06:21:40,801][52663] DAMAGECOUNT value on done: 735564.0 [2024-08-06 06:21:40,801][52663] Sum rewards: 71.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.145', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.146', 'weapon5': '0.160', 'AMMO3': '0.202', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:41,982][52795] DAMAGECOUNT value on done: 684512.0 [2024-08-06 06:21:41,983][52795] Sum rewards: 80.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.120', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 558907392. Throughput: 0: 4354.7. Samples: 139735640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:42,794][52567] Avg episode reward: [(0, '75.677')] [2024-08-06 06:21:43,249][52803] DAMAGECOUNT value on done: 689152.0 [2024-08-06 06:21:43,252][52803] Sum rewards: 67.751, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.626', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.140', 'weapon4': '0.174', 'weapon2': '0.216', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:43,368][52794] DAMAGECOUNT value on done: 749441.0 [2024-08-06 06:21:43,368][52794] Sum rewards: 78.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.124', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:43,668][52820] DAMAGECOUNT value on done: 686937.0 [2024-08-06 06:21:43,676][52820] Sum rewards: 72.169, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.415', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.142', 'weapon4': '0.240', 'AMMO3': '0.256', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:43,874][52663] DAMAGECOUNT value on done: 731145.0 [2024-08-06 06:21:43,874][52663] Sum rewards: 78.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.982', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon2': '0.196', 'AMMO3': '0.208', 'AMMO4': '0.229', 'weapon5': '0.262', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '63.000'} [2024-08-06 06:21:43,945][52665] DAMAGECOUNT value on done: 727913.0 [2024-08-06 06:21:43,945][52665] Sum rewards: 84.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.097', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '69.000'} [2024-08-06 06:21:43,965][52811] DAMAGECOUNT value on done: 687988.0 [2024-08-06 06:21:43,965][52811] Sum rewards: 81.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.432', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.176', 'AMMO4': '0.209', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '67.000'} [2024-08-06 06:21:44,859][52650] Updated weights for policy 0, policy_version 68231 (0.0019) [2024-08-06 06:21:45,260][52795] DAMAGECOUNT value on done: 669156.0 [2024-08-06 06:21:45,260][52795] Sum rewards: 73.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.114', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.148', 'weapon5': '0.156', 'AMMO4': '0.190', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:45,283][52658] DAMAGECOUNT value on done: 739129.0 [2024-08-06 06:21:45,283][52658] Sum rewards: 64.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.456', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.221', 'weapon5': '0.266', 'AMMO4': '0.272', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.556', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 06:21:45,853][52794] DAMAGECOUNT value on done: 739219.0 [2024-08-06 06:21:45,853][52794] Sum rewards: 71.743, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.712', 'WEAPON3': '1.350', 'weapon3': '2.806', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:46,340][52803] DAMAGECOUNT value on done: 685351.0 [2024-08-06 06:21:46,341][52803] Sum rewards: 71.936, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.214', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.136', 'AMMO4': '0.155', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.700', 'weapon3': '3.178', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '63.500'} [2024-08-06 06:21:46,437][52663] DAMAGECOUNT value on done: 734734.0 [2024-08-06 06:21:46,438][52663] Sum rewards: 77.559, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.557', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.116', 'weapon5': '0.120', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:46,774][52820] DAMAGECOUNT value on done: 682998.0 [2024-08-06 06:21:46,774][52820] Sum rewards: 72.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.148', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon4': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:46,829][52665] DAMAGECOUNT value on done: 724120.0 [2024-08-06 06:21:46,830][52665] Sum rewards: 71.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.736', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.148', 'weapon5': '0.168', 'weapon2': '0.180', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.320', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 558997504. Throughput: 0: 4357.1. Samples: 139748830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:47,795][52567] Avg episode reward: [(0, '75.263')] [2024-08-06 06:21:48,444][52795] DAMAGECOUNT value on done: 687394.0 [2024-08-06 06:21:48,444][52795] Sum rewards: 65.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.775', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.082', 'weapon5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '56.000'} [2024-08-06 06:21:48,486][52658] DAMAGECOUNT value on done: 739827.0 [2024-08-06 06:21:48,486][52658] Sum rewards: 83.660, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.109', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon4': '0.194', 'weapon5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.262', 'AMMO4': '0.287', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '69.000'} [2024-08-06 06:21:49,243][52671] DAMAGECOUNT value on done: 739446.0 [2024-08-06 06:21:49,243][52671] Sum rewards: 67.687, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.100', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon7': '0.042', 'weapon5': '0.094', 'AMMO4': '0.165', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.650', 'weapon3': '3.046', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '59.000'} [2024-08-06 06:21:49,511][52803] DAMAGECOUNT value on done: 680408.0 [2024-08-06 06:21:49,513][52803] Sum rewards: 81.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.080', 'AMMO4': '0.202', 'weapon5': '0.210', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '68.000'} [2024-08-06 06:21:49,599][52663] DAMAGECOUNT value on done: 737746.0 [2024-08-06 06:21:49,600][52663] Sum rewards: 81.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.523', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.082', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '66.000'} [2024-08-06 06:21:49,636][52650] Updated weights for policy 0, policy_version 68241 (0.0036) [2024-08-06 06:21:49,843][52820] DAMAGECOUNT value on done: 685678.0 [2024-08-06 06:21:49,843][52820] Sum rewards: 65.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.697', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.110', 'AMMO4': '0.223', 'AMMO3': '0.246', 'weapon5': '0.280', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '56.000'} [2024-08-06 06:21:50,128][52665] DAMAGECOUNT value on done: 730194.0 [2024-08-06 06:21:50,131][52665] Sum rewards: 66.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.466', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.206', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '56.000'} [2024-08-06 06:21:51,633][52658] DAMAGECOUNT value on done: 742997.0 [2024-08-06 06:21:51,635][52658] Sum rewards: 68.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.048', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.222', 'WEAPON3': '1.350', 'HITCOUNT': '3.470', 'weapon3': '3.520', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:51,699][52795] DAMAGECOUNT value on done: 682945.0 [2024-08-06 06:21:51,699][52795] Sum rewards: 75.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.044', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.126', 'weapon5': '0.164', 'AMMO4': '0.220', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:52,305][52669] DAMAGECOUNT value on done: 739257.0 [2024-08-06 06:21:52,306][52669] Sum rewards: 87.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.190', 'AMMO3': '0.196', 'AMMO4': '0.200', 'weapon2': '0.226', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.844', 'FRAGCOUNT': '70.500'} [2024-08-06 06:21:52,454][52671] DAMAGECOUNT value on done: 745991.0 [2024-08-06 06:21:52,455][52671] Sum rewards: 68.237, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.425', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.168', 'AMMO3': '0.232', 'weapon4': '0.276', 'AMMO4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '2.630', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.000'} [2024-08-06 06:21:52,476][52663] DAMAGECOUNT value on done: 745045.0 [2024-08-06 06:21:52,476][52663] Sum rewards: 80.504, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.020', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon5': '0.104', 'HEALTH': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '66.000'} [2024-08-06 06:21:52,753][52803] DAMAGECOUNT value on done: 679320.0 [2024-08-06 06:21:52,754][52803] Sum rewards: 72.242, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.169', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '61.000'} [2024-08-06 06:21:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 559079424. Throughput: 0: 4349.5. Samples: 139774570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:21:52,795][52567] Avg episode reward: [(0, '74.968')] [2024-08-06 06:21:53,030][52820] DAMAGECOUNT value on done: 695740.0 [2024-08-06 06:21:53,032][52820] Sum rewards: 70.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.623', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.050', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.338', 'WEAPON3': '1.550', 'weapon3': '3.336', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:53,081][52665] DAMAGECOUNT value on done: 730317.0 [2024-08-06 06:21:53,081][52665] Sum rewards: 75.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.115', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.064', 'AMMO4': '0.099', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '62.500'} [2024-08-06 06:21:54,082][52670] DAMAGECOUNT value on done: 728541.0 [2024-08-06 06:21:54,084][52670] Sum rewards: 94.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.346', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.132', 'AMMO4': '0.223', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.550', 'weapon3': '3.072', 'HITCOUNT': '4.290', 'DAMAGECOUNT': '23.130', 'FRAGCOUNT': '78.000'} [2024-08-06 06:21:54,250][52650] Updated weights for policy 0, policy_version 68251 (0.0020) [2024-08-06 06:21:54,384][52658] DAMAGECOUNT value on done: 740876.0 [2024-08-06 06:21:54,386][52658] Sum rewards: 67.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.742', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon4': '0.064', 'weapon5': '0.144', 'AMMO3': '0.213', 'AMMO4': '0.230', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '56.500'} [2024-08-06 06:21:54,930][52795] DAMAGECOUNT value on done: 673890.0 [2024-08-06 06:21:54,930][52795] Sum rewards: 69.224, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.715', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.085', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon4': '0.534', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '58.000'} [2024-08-06 06:21:55,100][52669] DAMAGECOUNT value on done: 730372.0 [2024-08-06 06:21:55,100][52669] Sum rewards: 72.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.141', 'weapon5': '0.172', 'AMMO3': '0.215', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.000'} [2024-08-06 06:21:55,230][52671] DAMAGECOUNT value on done: 739696.0 [2024-08-06 06:21:55,230][52671] Sum rewards: 63.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.880', 'weapon5': '0.012', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.490', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '51.000'} [2024-08-06 06:21:55,286][52663] DAMAGECOUNT value on done: 733756.0 [2024-08-06 06:21:55,287][52663] Sum rewards: 78.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.127', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:55,707][52803] DAMAGECOUNT value on done: 682022.0 [2024-08-06 06:21:55,708][52803] Sum rewards: 77.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.082', 'AMMO3': '0.181', 'weapon4': '0.258', 'AMMO4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '65.000'} [2024-08-06 06:21:55,998][52666] DAMAGECOUNT value on done: 738359.0 [2024-08-06 06:21:55,998][52666] Sum rewards: 72.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.194', 'weapon5': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.398', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.674', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '58.000'} [2024-08-06 06:21:56,055][52820] DAMAGECOUNT value on done: 694582.0 [2024-08-06 06:21:56,056][52820] Sum rewards: 72.151, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.033', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.172', 'weapon5': '0.182', 'weapon2': '0.240', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '60.500'} [2024-08-06 06:21:56,214][52665] DAMAGECOUNT value on done: 722522.0 [2024-08-06 06:21:56,215][52665] Sum rewards: 73.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.120', 'AMMO3': '0.242', 'weapon2': '0.246', 'AMMO4': '0.296', 'weapon5': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:56,868][52670] DAMAGECOUNT value on done: 739222.0 [2024-08-06 06:21:56,868][52670] Sum rewards: 69.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.051', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '3.380', 'weapon3': '3.438', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '57.000'} [2024-08-06 06:21:57,455][52658] DAMAGECOUNT value on done: 732734.0 [2024-08-06 06:21:57,456][52658] Sum rewards: 82.084, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.126', 'weapon4': '0.136', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.246', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '66.000'} [2024-08-06 06:21:57,472][52669] DAMAGECOUNT value on done: 743429.0 [2024-08-06 06:21:57,473][52669] Sum rewards: 76.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.075', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.138', 'AMMO3': '0.200', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '62.000'} [2024-08-06 06:21:57,723][52663] DAMAGECOUNT value on done: 726773.0 [2024-08-06 06:21:57,726][52663] Sum rewards: 73.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.145', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.103', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.276', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '64.000'} [2024-08-06 06:21:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 559169536. Throughput: 0: 4356.9. Samples: 139800910. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:21:57,794][52567] Avg episode reward: [(0, '74.435')] [2024-08-06 06:21:58,102][52795] DAMAGECOUNT value on done: 681853.0 [2024-08-06 06:21:58,102][52795] Sum rewards: 82.714, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.308', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.132', 'weapon2': '0.170', 'AMMO4': '0.217', 'AMMO3': '0.238', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '69.000'} [2024-08-06 06:21:58,307][52664] DAMAGECOUNT value on done: 764058.0 [2024-08-06 06:21:58,308][52664] Sum rewards: 91.758, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.095', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.078', 'weapon4': '0.080', 'AMMO4': '0.169', 'weapon2': '0.196', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '22.104', 'FRAGCOUNT': '76.000'} [2024-08-06 06:21:58,426][52671] DAMAGECOUNT value on done: 743365.0 [2024-08-06 06:21:58,428][52671] Sum rewards: 67.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.018', 'ARMOR': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.190', 'weapon5': '0.196', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '55.000'} [2024-08-06 06:21:58,623][52666] DAMAGECOUNT value on done: 734694.0 [2024-08-06 06:21:58,623][52666] Sum rewards: 59.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.072', 'weapon5': '0.078', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.356', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.276', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '52.000'} [2024-08-06 06:21:58,763][52803] DAMAGECOUNT value on done: 682864.0 [2024-08-06 06:21:58,764][52803] Sum rewards: 66.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.931', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO4': '0.216', 'weapon5': '0.222', 'AMMO3': '0.259', 'weapon4': '0.314', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.792', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '55.000'} [2024-08-06 06:21:58,876][52650] Updated weights for policy 0, policy_version 68261 (0.0017) [2024-08-06 06:21:59,188][52820] DAMAGECOUNT value on done: 678762.0 [2024-08-06 06:21:59,189][52820] Sum rewards: 68.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.146', 'AMMO4': '0.190', 'AMMO3': '0.216', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '56.000'} [2024-08-06 06:21:59,276][52665] DAMAGECOUNT value on done: 726712.0 [2024-08-06 06:21:59,284][52665] Sum rewards: 91.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon4': '0.150', 'weapon2': '0.206', 'AMMO3': '0.213', 'WEAPON3': '1.250', 'weapon3': '3.436', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.856', 'FRAGCOUNT': '74.000'} [2024-08-06 06:21:59,360][52670] DAMAGECOUNT value on done: 726697.0 [2024-08-06 06:21:59,361][52670] Sum rewards: 70.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.124', 'AMMO4': '0.194', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:00,317][52658] DAMAGECOUNT value on done: 730296.0 [2024-08-06 06:22:00,317][52658] Sum rewards: 82.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.456', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon2': '0.114', 'weapon5': '0.146', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon4': '0.216', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:00,334][52669] DAMAGECOUNT value on done: 739424.0 [2024-08-06 06:22:00,336][52669] Sum rewards: 87.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.140', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.654', 'FRAGCOUNT': '72.000'} [2024-08-06 06:22:00,490][52663] DAMAGECOUNT value on done: 728826.0 [2024-08-06 06:22:00,491][52663] Sum rewards: 75.488, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.181', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '3.372', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:00,957][52664] DAMAGECOUNT value on done: 770573.0 [2024-08-06 06:22:00,958][52664] Sum rewards: 66.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'weapon4': '0.006', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.078', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.386', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '56.000'} [2024-08-06 06:22:00,963][52671] DAMAGECOUNT value on done: 751406.0 [2024-08-06 06:22:00,965][52671] Sum rewards: 86.539, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon4': '0.134', 'weapon5': '0.142', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.000', 'weapon3': '2.970', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '68.000'} [2024-08-06 06:22:01,082][52795] DAMAGECOUNT value on done: 688852.0 [2024-08-06 06:22:01,082][52795] Sum rewards: 73.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.044', 'weapon4': '0.118', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:01,534][52666] DAMAGECOUNT value on done: 735457.0 [2024-08-06 06:22:01,537][52666] Sum rewards: 76.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.025', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.096', 'AMMO4': '0.117', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '63.000'} [2024-08-06 06:22:01,886][52803] DAMAGECOUNT value on done: 696164.0 [2024-08-06 06:22:01,889][52803] Sum rewards: 70.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.568', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.149', 'AMMO3': '0.177', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:02,395][52665] DAMAGECOUNT value on done: 729469.0 [2024-08-06 06:22:02,397][52665] Sum rewards: 65.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.100', 'AMMO4': '0.199', 'AMMO3': '0.216', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.408', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '54.000'} [2024-08-06 06:22:02,492][52670] DAMAGECOUNT value on done: 725166.0 [2024-08-06 06:22:02,492][52670] Sum rewards: 81.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.303', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.240', 'weapon4': '0.306', 'weapon5': '0.306', 'AMMO4': '0.308', 'weapon2': '0.322', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.704', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 559259648. Throughput: 0: 4358.2. Samples: 139813860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:02,794][52567] Avg episode reward: [(0, '75.234')] [2024-08-06 06:22:03,384][52658] DAMAGECOUNT value on done: 742781.0 [2024-08-06 06:22:03,385][52658] Sum rewards: 65.073, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.693', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.066', 'weapon5': '0.122', 'AMMO3': '0.169', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.064', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '52.000'} [2024-08-06 06:22:03,402][52669] DAMAGECOUNT value on done: 741143.0 [2024-08-06 06:22:03,406][52669] Sum rewards: 72.078, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.471', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.056', 'AMMO4': '0.174', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'weapon2': '0.724', 'WEAPON3': '1.600', 'weapon3': '2.802', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '63.000'} [2024-08-06 06:22:03,510][52664] DAMAGECOUNT value on done: 765554.0 [2024-08-06 06:22:03,510][52664] Sum rewards: 58.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.678', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon2': '0.234', 'weapon4': '0.250', 'AMMO3': '0.258', 'weapon5': '0.280', 'AMMO4': '0.320', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.890', 'weapon3': '2.926', 'DAMAGECOUNT': '15.402', 'FRAGCOUNT': '51.000'} [2024-08-06 06:22:03,575][52650] Updated weights for policy 0, policy_version 68271 (0.0024) [2024-08-06 06:22:03,739][52663] DAMAGECOUNT value on done: 733325.0 [2024-08-06 06:22:03,740][52663] Sum rewards: 72.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.150', 'weapon2': '0.168', 'weapon5': '0.182', 'AMMO3': '0.217', 'AMMO4': '0.242', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '58.500'} [2024-08-06 06:22:03,802][52671] DAMAGECOUNT value on done: 745122.0 [2024-08-06 06:22:03,804][52671] Sum rewards: 82.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon4': '0.040', 'AMMO4': '0.111', 'weapon5': '0.182', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:04,282][52666] DAMAGECOUNT value on done: 735534.0 [2024-08-06 06:22:04,283][52666] Sum rewards: 73.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.185', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.188', 'AMMO4': '0.193', 'weapon4': '0.236', 'weapon5': '0.260', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:04,793][52803] DAMAGECOUNT value on done: 687185.0 [2024-08-06 06:22:04,795][52803] Sum rewards: 74.560, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.118', 'AMMO4': '0.191', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'AMMO3': '0.310', 'WEAPON3': '1.700', 'weapon3': '3.198', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:05,105][52670] DAMAGECOUNT value on done: 737394.0 [2024-08-06 06:22:05,106][52670] Sum rewards: 64.379, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.744', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.028', 'weapon4': '0.034', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.246', 'AMMO3': '0.324', 'WEAPON3': '1.900', 'HITCOUNT': '3.310', 'weapon3': '3.440', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:05,979][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:22:06,024][52668] Large shaping reward 2.585 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.555, 185.0)] [2024-08-06 06:22:06,098][52669] DAMAGECOUNT value on done: 740276.0 [2024-08-06 06:22:06,099][52669] Sum rewards: 74.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.172', 'weapon2': '0.192', 'AMMO3': '0.194', 'AMMO4': '0.241', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:06,154][52658] DAMAGECOUNT value on done: 733201.0 [2024-08-06 06:22:06,154][52658] Sum rewards: 61.756, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.658', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.050', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.236', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '55.000'} [2024-08-06 06:22:06,264][52664] DAMAGECOUNT value on done: 760392.0 [2024-08-06 06:22:06,264][52664] Sum rewards: 62.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO4': '0.207', 'AMMO3': '0.208', 'weapon4': '0.320', 'weapon5': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.488', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.036', 'FRAGCOUNT': '52.000'} [2024-08-06 06:22:06,309][52663] DAMAGECOUNT value on done: 744537.0 [2024-08-06 06:22:06,310][52663] Sum rewards: 68.081, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.980', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.048', 'AMMO4': '0.136', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.358', 'weapon2': '0.432', 'WEAPON3': '1.950', 'weapon3': '3.018', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:06,563][52671] DAMAGECOUNT value on done: 745801.0 [2024-08-06 06:22:06,565][52671] Sum rewards: 79.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.835', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.040', 'weapon4': '0.044', 'AMMO4': '0.109', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.100', 'weapon3': '3.454', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:07,285][52666] DAMAGECOUNT value on done: 729700.0 [2024-08-06 06:22:07,286][52666] Sum rewards: 69.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.029', 'AMMO2': '0.085', 'AMMO3': '0.210', 'weapon5': '0.308', 'weapon2': '0.344', 'AMMO4': '0.424', 'weapon4': '0.498', 'WEAPON5': '0.800', 'WEAPON4': '0.950', 'WEAPON3': '1.250', 'weapon3': '2.484', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:07,795][52567] Fps is (10 sec: 17202.1, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 559341568. Throughput: 0: 4365.5. Samples: 139840090. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:07,795][52567] Avg episode reward: [(0, '74.830')] [2024-08-06 06:22:07,874][52803] DAMAGECOUNT value on done: 687658.0 [2024-08-06 06:22:07,877][52803] Sum rewards: 78.224, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.347', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.170', 'AMMO3': '0.325', 'WEAPON3': '1.900', 'weapon3': '3.546', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '68.000'} [2024-08-06 06:22:07,969][52670] DAMAGECOUNT value on done: 731840.0 [2024-08-06 06:22:07,972][52670] Sum rewards: 70.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.504', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.160', 'weapon4': '0.168', 'AMMO4': '0.199', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:08,177][52649] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2024-08-06 06:22:08,255][52650] Updated weights for policy 0, policy_version 68281 (0.0028) [2024-08-06 06:22:08,736][52669] DAMAGECOUNT value on done: 740162.0 [2024-08-06 06:22:08,736][52669] Sum rewards: 82.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.054', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:08,808][52664] DAMAGECOUNT value on done: 772541.0 [2024-08-06 06:22:08,808][52664] Sum rewards: 83.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.197', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:08,964][52663] DAMAGECOUNT value on done: 728657.0 [2024-08-06 06:22:08,967][52663] Sum rewards: 78.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.185', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.400', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:09,298][52658] DAMAGECOUNT value on done: 755335.0 [2024-08-06 06:22:09,298][52658] Sum rewards: 56.938, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.266', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.158', 'weapon5': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.343', 'weapon2': '0.360', 'WEAPON3': '1.900', 'HITCOUNT': '2.880', 'weapon3': '3.068', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '53.000'} [2024-08-06 06:22:09,915][52671] DAMAGECOUNT value on done: 742712.0 [2024-08-06 06:22:09,917][52671] Sum rewards: 87.407, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.246', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.105', 'weapon5': '0.136', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '70.000'} [2024-08-06 06:22:10,200][52666] DAMAGECOUNT value on done: 734287.0 [2024-08-06 06:22:10,201][52666] Sum rewards: 69.374, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.150', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.050', 'AMMO4': '0.161', 'weapon5': '0.192', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.850', 'weapon3': '3.080', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:10,963][52803] DAMAGECOUNT value on done: 698774.0 [2024-08-06 06:22:10,963][52803] Sum rewards: 66.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'AMMO5': '0.020', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.314', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.328', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '56.000'} [2024-08-06 06:22:11,031][52664] DAMAGECOUNT value on done: 765499.0 [2024-08-06 06:22:11,033][52664] Sum rewards: 82.683, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.934', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.038', 'weapon5': '0.046', 'AMMO4': '0.191', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.390', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '68.000'} [2024-08-06 06:22:11,238][52670] DAMAGECOUNT value on done: 724974.0 [2024-08-06 06:22:11,238][52670] Sum rewards: 72.504, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.842', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.100', 'weapon5': '0.140', 'AMMO4': '0.256', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '62.000'} [2024-08-06 06:22:11,732][52669] DAMAGECOUNT value on done: 743407.0 [2024-08-06 06:22:11,734][52669] Sum rewards: 65.931, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.102', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.142', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.166', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:12,117][52663] DAMAGECOUNT value on done: 723375.0 [2024-08-06 06:22:12,120][52663] Sum rewards: 52.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.013', 'AMMO2': '0.059', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.102', 'weapon5': '0.148', 'AMMO3': '0.191', 'weapon2': '0.280', 'AMMO4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.538', 'WEAPON3': '1.150', 'HITCOUNT': '2.660', 'weapon3': '2.738', 'DAMAGECOUNT': '13.158', 'FRAGCOUNT': '44.000'} [2024-08-06 06:22:12,377][52658] DAMAGECOUNT value on done: 738271.0 [2024-08-06 06:22:12,377][52658] Sum rewards: 72.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.346', 'WEAPON3': '1.200', 'HITCOUNT': '3.410', 'weapon3': '3.452', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:12,623][52671] DAMAGECOUNT value on done: 733565.0 [2024-08-06 06:22:12,625][52671] Sum rewards: 66.091, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.010', 'AMMO2': '0.032', 'HEALTH': '0.034', 'weapon4': '0.096', 'weapon5': '0.106', 'AMMO4': '0.162', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '56.000'} [2024-08-06 06:22:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 559431680. Throughput: 0: 4360.9. Samples: 139866360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:12,794][52567] Avg episode reward: [(0, '74.012')] [2024-08-06 06:22:13,007][52650] Updated weights for policy 0, policy_version 68291 (0.0012) [2024-08-06 06:22:13,593][52666] DAMAGECOUNT value on done: 732662.0 [2024-08-06 06:22:13,595][52666] Sum rewards: 78.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.164', 'AMMO4': '0.218', 'AMMO3': '0.239', 'weapon4': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.500', 'weapon3': '2.744', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:13,711][52664] DAMAGECOUNT value on done: 760905.0 [2024-08-06 06:22:13,711][52664] Sum rewards: 77.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.022', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.231', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.442', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:14,086][52803] DAMAGECOUNT value on done: 683846.0 [2024-08-06 06:22:14,087][52803] Sum rewards: 68.204, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.066', 'weapon5': '0.176', 'AMMO3': '0.208', 'AMMO4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:14,433][52670] DAMAGECOUNT value on done: 729351.0 [2024-08-06 06:22:14,434][52670] Sum rewards: 68.260, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.762', 'AMMO5': '0.025', 'AMMO2': '0.070', 'weapon4': '0.128', 'AMMO3': '0.195', 'weapon5': '0.312', 'AMMO4': '0.353', 'weapon2': '0.420', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '55.500'} [2024-08-06 06:22:15,020][52669] DAMAGECOUNT value on done: 749823.0 [2024-08-06 06:22:15,020][52669] Sum rewards: 87.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.630', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.084', 'weapon4': '0.118', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'weapon2': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON3': '1.300', 'weapon3': '3.422', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '71.000'} [2024-08-06 06:22:15,097][52671] DAMAGECOUNT value on done: 743109.0 [2024-08-06 06:22:15,099][52671] Sum rewards: 76.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.076', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'weapon2': '0.186', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.398', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '64.000'} [2024-08-06 06:22:15,249][52658] DAMAGECOUNT value on done: 750225.0 [2024-08-06 06:22:15,251][52658] Sum rewards: 75.407, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.946', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:15,374][52663] DAMAGECOUNT value on done: 732053.0 [2024-08-06 06:22:15,374][52663] Sum rewards: 74.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon5': '0.242', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:16,109][52664] DAMAGECOUNT value on done: 753751.0 [2024-08-06 06:22:16,110][52664] Sum rewards: 69.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.108', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:16,644][52614] Signal inference workers to stop experience collection... (12450 times) [2024-08-06 06:22:16,654][52614] Signal inference workers to resume experience collection... (12450 times) [2024-08-06 06:22:16,732][52650] InferenceWorker_p0-w0: stopping experience collection (12450 times) [2024-08-06 06:22:16,732][52650] InferenceWorker_p0-w0: resuming experience collection (12450 times) [2024-08-06 06:22:16,793][52666] DAMAGECOUNT value on done: 726344.0 [2024-08-06 06:22:16,793][52666] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.780', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.172', 'AMMO4': '0.183', 'weapon4': '0.184', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:17,201][52803] DAMAGECOUNT value on done: 688237.0 [2024-08-06 06:22:17,201][52803] Sum rewards: 74.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.680', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'AMMO4': '0.098', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.488', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:17,500][52670] DAMAGECOUNT value on done: 728318.0 [2024-08-06 06:22:17,501][52670] Sum rewards: 69.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.210', 'weapon5': '0.218', 'weapon2': '0.240', 'AMMO4': '0.300', 'weapon4': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:17,626][52650] Updated weights for policy 0, policy_version 68301 (0.0022) [2024-08-06 06:22:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 559521792. Throughput: 0: 4363.5. Samples: 139879370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:17,795][52567] Avg episode reward: [(0, '73.691')] [2024-08-06 06:22:18,064][52671] DAMAGECOUNT value on done: 743679.0 [2024-08-06 06:22:18,064][52671] Sum rewards: 84.310, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.079', 'weapon4': '0.128', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:18,132][52669] DAMAGECOUNT value on done: 741906.0 [2024-08-06 06:22:18,135][52669] Sum rewards: 79.202, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.355', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon4': '0.082', 'weapon5': '0.160', 'AMMO3': '0.183', 'AMMO4': '0.245', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:18,148][52658] DAMAGECOUNT value on done: 734659.0 [2024-08-06 06:22:18,148][52658] Sum rewards: 73.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.424', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.130', 'weapon5': '0.136', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:18,356][52663] DAMAGECOUNT value on done: 730602.0 [2024-08-06 06:22:18,358][52663] Sum rewards: 74.050, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.577', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.152', 'weapon5': '0.158', 'AMMO4': '0.169', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '63.000'} [2024-08-06 06:22:19,001][52664] DAMAGECOUNT value on done: 769354.0 [2024-08-06 06:22:19,003][52664] Sum rewards: 74.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.307', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.170', 'weapon5': '0.190', 'AMMO3': '0.224', 'weapon2': '0.224', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:19,620][52666] DAMAGECOUNT value on done: 735593.0 [2024-08-06 06:22:19,628][52666] Sum rewards: 71.352, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.088', 'weapon5': '0.152', 'AMMO4': '0.188', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:20,193][52820] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:22:20,278][52803] DAMAGECOUNT value on done: 690516.0 [2024-08-06 06:22:20,280][52803] Sum rewards: 81.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.816', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.044', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.414', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:20,456][52670] DAMAGECOUNT value on done: 722804.0 [2024-08-06 06:22:20,459][52670] Sum rewards: 53.592, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.292', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.116', 'weapon5': '0.176', 'AMMO4': '0.246', 'AMMO3': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.600', 'weapon3': '2.760', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '48.500'} [2024-08-06 06:22:20,606][52671] DAMAGECOUNT value on done: 741249.0 [2024-08-06 06:22:20,606][52671] Sum rewards: 72.271, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.916', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.220', 'AMMO3': '0.228', 'AMMO4': '0.238', 'weapon5': '0.254', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.884', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:20,848][52658] DAMAGECOUNT value on done: 744351.0 [2024-08-06 06:22:20,849][52658] Sum rewards: 84.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.183', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.288', 'weapon2': '0.318', 'WEAPON3': '1.800', 'weapon3': '3.456', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.084', 'FRAGCOUNT': '72.000'} [2024-08-06 06:22:21,088][52669] DAMAGECOUNT value on done: 743576.0 [2024-08-06 06:22:21,094][52669] Sum rewards: 85.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.431', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.126', 'weapon2': '0.198', 'AMMO3': '0.209', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:21,438][52663] DAMAGECOUNT value on done: 743626.0 [2024-08-06 06:22:21,438][52663] Sum rewards: 69.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.205', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.098', 'weapon5': '0.202', 'AMMO3': '0.272', 'AMMO4': '0.273', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:22,108][52664] DAMAGECOUNT value on done: 761361.0 [2024-08-06 06:22:22,109][52664] Sum rewards: 73.890, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.208', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.281', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.700', 'weapon3': '3.032', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:22,183][52650] Updated weights for policy 0, policy_version 68311 (0.0025) [2024-08-06 06:22:22,753][52666] DAMAGECOUNT value on done: 728769.0 [2024-08-06 06:22:22,755][52666] Sum rewards: 75.691, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.740', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.123', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.458', 'weapon2': '0.602', 'WEAPON3': '0.800', 'weapon3': '2.576', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 559603712. Throughput: 0: 4363.8. Samples: 139905710. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:22,795][52567] Avg episode reward: [(0, '73.812')] [2024-08-06 06:22:23,280][52803] DAMAGECOUNT value on done: 691933.0 [2024-08-06 06:22:23,280][52803] Sum rewards: 77.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.110', 'weapon4': '0.126', 'AMMO4': '0.212', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:23,496][52658] DAMAGECOUNT value on done: 733862.0 [2024-08-06 06:22:23,496][52658] Sum rewards: 79.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.241', 'weapon2': '0.670', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '66.000'} [2024-08-06 06:22:23,558][52670] DAMAGECOUNT value on done: 737910.0 [2024-08-06 06:22:23,558][52670] Sum rewards: 71.843, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.427', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'AMMO3': '0.275', 'weapon2': '0.338', 'weapon4': '0.376', 'WEAPON3': '1.650', 'weapon3': '2.920', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '62.000'} [2024-08-06 06:22:23,710][52671] DAMAGECOUNT value on done: 748825.0 [2024-08-06 06:22:23,712][52671] Sum rewards: 78.848, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.156', 'AMMO3': '0.186', 'AMMO4': '0.202', 'weapon2': '0.206', 'WEAPON5': '0.250', 'HEALTH': '0.280', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.092', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '64.000'} [2024-08-06 06:22:24,087][52669] DAMAGECOUNT value on done: 749004.0 [2024-08-06 06:22:24,089][52669] Sum rewards: 71.074, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.542', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'AMMO3': '0.313', 'WEAPON3': '1.750', 'weapon3': '3.142', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '62.500'} [2024-08-06 06:22:24,469][52663] DAMAGECOUNT value on done: 736592.0 [2024-08-06 06:22:24,471][52663] Sum rewards: 72.713, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.090', 'AMMO4': '0.154', 'AMMO3': '0.166', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.676', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:24,684][52664] DAMAGECOUNT value on done: 772629.0 [2024-08-06 06:22:24,692][52664] Sum rewards: 60.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.076', 'weapon4': '0.102', 'AMMO4': '0.182', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '2.946', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '49.000'} [2024-08-06 06:22:25,652][52666] DAMAGECOUNT value on done: 738607.0 [2024-08-06 06:22:25,653][52666] Sum rewards: 75.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.690', 'AMMO5': '0.025', 'AMMO2': '0.058', 'weapon5': '0.224', 'weapon4': '0.230', 'weapon2': '0.234', 'AMMO3': '0.251', 'AMMO4': '0.290', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:26,336][52671] DAMAGECOUNT value on done: 743020.0 [2024-08-06 06:22:26,336][52671] Sum rewards: 72.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.837', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.186', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '62.000'} [2024-08-06 06:22:26,398][52803] DAMAGECOUNT value on done: 695710.0 [2024-08-06 06:22:26,401][52803] Sum rewards: 72.368, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.544', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.126', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon4': '0.268', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '63.000'} [2024-08-06 06:22:26,412][52670] DAMAGECOUNT value on done: 724281.0 [2024-08-06 06:22:26,415][52670] Sum rewards: 71.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.422', 'AMMO5': '0.022', 'AMMO2': '0.067', 'weapon4': '0.188', 'AMMO3': '0.233', 'weapon2': '0.244', 'weapon5': '0.320', 'AMMO4': '0.337', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:26,644][52658] DAMAGECOUNT value on done: 743104.0 [2024-08-06 06:22:26,644][52658] Sum rewards: 69.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.909', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.022', 'weapon5': '0.054', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.372', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.370', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:27,174][52650] Updated weights for policy 0, policy_version 68321 (0.0019) [2024-08-06 06:22:27,178][52664] DAMAGECOUNT value on done: 771482.0 [2024-08-06 06:22:27,178][52664] Sum rewards: 71.449, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.812', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.076', 'weapon5': '0.148', 'AMMO3': '0.283', 'AMMO4': '0.306', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.156', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '63.000'} [2024-08-06 06:22:27,330][52669] DAMAGECOUNT value on done: 733763.0 [2024-08-06 06:22:27,331][52669] Sum rewards: 77.268, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.987', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon5': '0.110', 'AMMO3': '0.147', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '0.950', 'weapon3': '3.214', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:27,675][52663] DAMAGECOUNT value on done: 740326.0 [2024-08-06 06:22:27,675][52663] Sum rewards: 85.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.177', 'weapon2': '0.236', 'weapon4': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 559693824. Throughput: 0: 4365.8. Samples: 139932100. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:27,794][52567] Avg episode reward: [(0, '73.593')] [2024-08-06 06:22:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068322_559693824.pth... [2024-08-06 06:22:27,960][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000067811_555507712.pth [2024-08-06 06:22:28,816][52666] DAMAGECOUNT value on done: 724370.0 [2024-08-06 06:22:28,819][52666] Sum rewards: 63.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.485', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.116', 'AMMO4': '0.190', 'weapon5': '0.198', 'AMMO3': '0.205', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.112', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '54.000'} [2024-08-06 06:22:28,896][52668] DAMAGECOUNT value on done: 737442.0 [2024-08-06 06:22:28,899][52668] Sum rewards: 77.557, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.510', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.164', 'AMMO4': '0.225', 'weapon5': '0.230', 'weapon2': '0.356', 'weapon4': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.750', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:29,459][52671] DAMAGECOUNT value on done: 730633.0 [2024-08-06 06:22:29,459][52671] Sum rewards: 67.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:29,657][52670] DAMAGECOUNT value on done: 732782.0 [2024-08-06 06:22:29,657][52670] Sum rewards: 75.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.044', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.968', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:29,677][52803] DAMAGECOUNT value on done: 690452.0 [2024-08-06 06:22:29,678][52658] DAMAGECOUNT value on done: 727539.0 [2024-08-06 06:22:29,680][52658] Sum rewards: 67.711, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.120', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.283', 'weapon2': '0.392', 'WEAPON3': '1.600', 'weapon3': '3.236', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:29,679][52803] Sum rewards: 66.391, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.296', 'AMMO5': '0.007', 'weapon5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'weapon2': '0.384', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:29,681][52664] DAMAGECOUNT value on done: 770482.0 [2024-08-06 06:22:29,681][52664] Sum rewards: 71.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.918', 'AMMO5': '0.005', 'weapon4': '0.010', 'AMMO2': '0.011', 'weapon5': '0.046', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.270', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:29,912][52669] DAMAGECOUNT value on done: 736088.0 [2024-08-06 06:22:29,914][52669] Sum rewards: 75.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.065', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.090', 'weapon5': '0.180', 'AMMO4': '0.191', 'AMMO3': '0.222', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '66.000'} [2024-08-06 06:22:30,377][52663] DAMAGECOUNT value on done: 742715.0 [2024-08-06 06:22:30,379][52663] Sum rewards: 74.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.094', 'weapon5': '0.116', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.782', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '61.000'} [2024-08-06 06:22:31,515][52650] Updated weights for policy 0, policy_version 68331 (0.0017) [2024-08-06 06:22:31,936][52666] DAMAGECOUNT value on done: 737405.0 [2024-08-06 06:22:31,937][52666] Sum rewards: 61.851, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.789', 'AMMO2': '0.011', 'AMMO5': '0.015', 'weapon4': '0.016', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.136', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.766', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '50.000'} [2024-08-06 06:22:32,066][52668] DAMAGECOUNT value on done: 743739.0 [2024-08-06 06:22:32,067][52668] Sum rewards: 67.891, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.478', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.132', 'weapon5': '0.202', 'AMMO3': '0.220', 'AMMO4': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '56.500'} [2024-08-06 06:22:32,137][52671] DAMAGECOUNT value on done: 749378.0 [2024-08-06 06:22:32,138][52671] Sum rewards: 78.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.845', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.271', 'weapon2': '0.422', 'WEAPON3': '1.650', 'weapon3': '3.354', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '66.000'} [2024-08-06 06:22:32,391][52664] DAMAGECOUNT value on done: 775833.0 [2024-08-06 06:22:32,393][52664] Sum rewards: 86.241, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.110', 'weapon5': '0.142', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '73.000'} [2024-08-06 06:22:32,438][52658] DAMAGECOUNT value on done: 744193.0 [2024-08-06 06:22:32,438][52658] Sum rewards: 81.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.730', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.136', 'AMMO4': '0.153', 'weapon5': '0.178', 'weapon2': '0.214', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:32,558][52670] DAMAGECOUNT value on done: 740541.0 [2024-08-06 06:22:32,561][52670] Sum rewards: 82.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.114', 'AMMO5': '0.023', 'AMMO2': '0.032', 'weapon4': '0.068', 'weapon5': '0.148', 'AMMO4': '0.161', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.160', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.765', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:32,668][52669] DAMAGECOUNT value on done: 741003.0 [2024-08-06 06:22:32,669][52669] Sum rewards: 85.756, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.095', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.143', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.270', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'weapon3': '3.124', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '74.000'} [2024-08-06 06:22:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 559775744. Throughput: 0: 4355.1. Samples: 139944810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:32,794][52567] Avg episode reward: [(0, '73.601')] [2024-08-06 06:22:33,184][52663] DAMAGECOUNT value on done: 730515.0 [2024-08-06 06:22:33,193][52663] Sum rewards: 59.542, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.670', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon4': '0.094', 'weapon5': '0.204', 'AMMO4': '0.210', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '53.000'} [2024-08-06 06:22:34,825][52671] DAMAGECOUNT value on done: 746142.0 [2024-08-06 06:22:34,826][52671] Sum rewards: 70.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.952', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '56.500'} [2024-08-06 06:22:34,920][52666] DAMAGECOUNT value on done: 730813.0 [2024-08-06 06:22:34,921][52666] Sum rewards: 77.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.062', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.239', 'WEAPON3': '1.450', 'weapon3': '3.342', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '66.000'} [2024-08-06 06:22:35,028][52668] DAMAGECOUNT value on done: 743685.0 [2024-08-06 06:22:35,029][52668] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.056', 'weapon5': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:35,246][52658] DAMAGECOUNT value on done: 736222.0 [2024-08-06 06:22:35,247][52658] Sum rewards: 76.969, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.556', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.096', 'weapon5': '0.174', 'AMMO4': '0.185', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '64.000'} [2024-08-06 06:22:35,287][52664] DAMAGECOUNT value on done: 776969.0 [2024-08-06 06:22:35,289][52664] Sum rewards: 73.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.068', 'weapon5': '0.122', 'AMMO3': '0.170', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.000', 'HITCOUNT': '3.250', 'weapon3': '3.368', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:35,516][52670] DAMAGECOUNT value on done: 733233.0 [2024-08-06 06:22:35,517][52670] Sum rewards: 71.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.703', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:35,653][52669] DAMAGECOUNT value on done: 760135.0 [2024-08-06 06:22:35,657][52669] Sum rewards: 78.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.086', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '64.000'} [2024-08-06 06:22:36,434][52650] Updated weights for policy 0, policy_version 68341 (0.0020) [2024-08-06 06:22:37,698][52666] DAMAGECOUNT value on done: 730882.0 [2024-08-06 06:22:37,698][52666] Sum rewards: 63.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.650', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon4': '0.080', 'weapon5': '0.130', 'AMMO3': '0.183', 'AMMO4': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '51.000'} [2024-08-06 06:22:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 559865856. Throughput: 0: 4365.1. Samples: 139971000. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:22:37,794][52567] Avg episode reward: [(0, '73.108')] [2024-08-06 06:22:37,875][52671] DAMAGECOUNT value on done: 744375.0 [2024-08-06 06:22:37,879][52671] Sum rewards: 66.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.772', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.218', 'weapon5': '0.220', 'weapon4': '0.244', 'AMMO4': '0.272', 'weapon2': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '56.000'} [2024-08-06 06:22:37,893][52658] DAMAGECOUNT value on done: 735512.0 [2024-08-06 06:22:37,894][52658] Sum rewards: 74.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.676', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'weapon2': '0.516', 'WEAPON3': '0.950', 'weapon3': '3.298', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:37,902][52664] DAMAGECOUNT value on done: 772106.0 [2024-08-06 06:22:37,902][52664] Sum rewards: 83.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.576', 'AMMO5': '0.018', 'AMMO2': '0.066', 'AMMO3': '0.184', 'weapon2': '0.200', 'weapon4': '0.208', 'weapon5': '0.314', 'AMMO4': '0.329', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:37,953][52668] DAMAGECOUNT value on done: 746198.0 [2024-08-06 06:22:37,954][52668] Sum rewards: 69.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.895', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon2': '0.172', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon4': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:38,113][52647] DAMAGECOUNT value on done: 784508.0 [2024-08-06 06:22:38,114][52647] Sum rewards: 91.900, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.822', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '73.000'} [2024-08-06 06:22:38,245][52670] DAMAGECOUNT value on done: 716890.0 [2024-08-06 06:22:38,254][52670] Sum rewards: 82.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO2': '0.003', 'AMMO5': '0.011', 'AMMO4': '0.013', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon4': '0.254', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:38,457][52669] DAMAGECOUNT value on done: 748828.0 [2024-08-06 06:22:38,457][52669] Sum rewards: 68.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.295', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.388', 'WEAPON3': '1.250', 'HITCOUNT': '3.380', 'weapon3': '3.426', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '56.000'} [2024-08-06 06:22:39,298][52662] DAMAGECOUNT value on done: 741346.0 [2024-08-06 06:22:39,300][52662] Sum rewards: 92.620, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.040', 'AMMO4': '0.104', 'weapon5': '0.152', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.304', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '74.000'} [2024-08-06 06:22:39,346][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:22:40,097][52664] DAMAGECOUNT value on done: 762026.0 [2024-08-06 06:22:40,098][52664] Sum rewards: 67.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.098', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.062', 'weapon5': '0.246', 'AMMO4': '0.247', 'AMMO3': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.778', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '59.000'} [2024-08-06 06:22:40,374][52647] DAMAGECOUNT value on done: 775056.0 [2024-08-06 06:22:40,374][52647] Sum rewards: 79.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.072', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '66.000'} [2024-08-06 06:22:40,554][52668] DAMAGECOUNT value on done: 730948.0 [2024-08-06 06:22:40,558][52668] Sum rewards: 67.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.202', 'weapon2': '0.262', 'weapon5': '0.264', 'AMMO3': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:40,651][52666] DAMAGECOUNT value on done: 726830.0 [2024-08-06 06:22:40,652][52666] Sum rewards: 76.511, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.063', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.454', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '63.000'} [2024-08-06 06:22:40,781][52658] DAMAGECOUNT value on done: 741163.0 [2024-08-06 06:22:40,781][52658] Sum rewards: 77.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.416', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.114', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.198', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:41,008][52671] DAMAGECOUNT value on done: 747387.0 [2024-08-06 06:22:41,008][52671] Sum rewards: 64.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.659', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.108', 'AMMO4': '0.164', 'weapon5': '0.202', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 06:22:41,125][52670] DAMAGECOUNT value on done: 727695.0 [2024-08-06 06:22:41,127][52670] Sum rewards: 79.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.184', 'AMMO3': '0.186', 'weapon5': '0.244', 'AMMO4': '0.317', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:41,452][52650] Updated weights for policy 0, policy_version 68351 (0.0018) [2024-08-06 06:22:41,509][52669] DAMAGECOUNT value on done: 742940.0 [2024-08-06 06:22:41,509][52669] Sum rewards: 80.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.070', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.144', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'weapon4': '0.398', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '65.000'} [2024-08-06 06:22:42,533][52662] DAMAGECOUNT value on done: 746753.0 [2024-08-06 06:22:42,535][52662] Sum rewards: 83.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.714', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.206', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.466', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '70.000'} [2024-08-06 06:22:42,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 559964160. Throughput: 0: 4361.1. Samples: 139997160. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:22:42,795][52567] Avg episode reward: [(0, '74.228')] [2024-08-06 06:22:43,220][52664] DAMAGECOUNT value on done: 763567.0 [2024-08-06 06:22:43,220][52664] Sum rewards: 81.313, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.047', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.128', 'AMMO4': '0.140', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.050', 'weapon3': '3.220', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '64.000'} [2024-08-06 06:22:43,383][52668] DAMAGECOUNT value on done: 744857.0 [2024-08-06 06:22:43,391][52668] Sum rewards: 64.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.249', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.080', 'weapon5': '0.230', 'AMMO4': '0.231', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.040', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '55.000'} [2024-08-06 06:22:43,511][52666] DAMAGECOUNT value on done: 730148.0 [2024-08-06 06:22:43,512][52666] Sum rewards: 74.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.410', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.070', 'weapon5': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.602', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 06:22:43,544][52647] DAMAGECOUNT value on done: 779948.0 [2024-08-06 06:22:43,544][52647] Sum rewards: 48.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.388', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.152', 'AMMO4': '0.178', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon7': '0.366', 'weapon4': '0.640', 'WEAPON3': '1.450', 'weapon3': '2.104', 'HITCOUNT': '2.340', 'DAMAGECOUNT': '12.036', 'FRAGCOUNT': '44.000'} [2024-08-06 06:22:43,651][52671] DAMAGECOUNT value on done: 739557.0 [2024-08-06 06:22:43,652][52671] Sum rewards: 75.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.210', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '62.000'} [2024-08-06 06:22:43,907][52669] DAMAGECOUNT value on done: 746214.0 [2024-08-06 06:22:43,907][52669] Sum rewards: 63.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.681', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.444', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.258', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '54.000'} [2024-08-06 06:22:44,349][52670] DAMAGECOUNT value on done: 736861.0 [2024-08-06 06:22:44,349][52670] Sum rewards: 81.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.623', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.195', 'weapon5': '0.230', 'AMMO4': '0.258', 'weapon4': '0.296', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:45,389][52662] DAMAGECOUNT value on done: 749375.0 [2024-08-06 06:22:45,389][52662] Sum rewards: 83.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '70.000'} [2024-08-06 06:22:45,483][52650] Updated weights for policy 0, policy_version 68361 (0.0013) [2024-08-06 06:22:45,982][52664] DAMAGECOUNT value on done: 765735.0 [2024-08-06 06:22:45,983][52664] Sum rewards: 65.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.585', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.172', 'AMMO3': '0.194', 'weapon5': '0.198', 'AMMO4': '0.309', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '52.000'} [2024-08-06 06:22:46,099][52647] DAMAGECOUNT value on done: 779913.0 [2024-08-06 06:22:46,099][52647] Sum rewards: 67.932, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.785', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon5': '0.078', 'AMMO4': '0.079', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.220', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '56.000'} [2024-08-06 06:22:46,345][52668] DAMAGECOUNT value on done: 744399.0 [2024-08-06 06:22:46,347][52668] Sum rewards: 73.452, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.849', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO4': '0.194', 'weapon5': '0.198', 'AMMO3': '0.256', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '62.000'} [2024-08-06 06:22:46,561][52666] DAMAGECOUNT value on done: 743935.0 [2024-08-06 06:22:46,562][52666] Sum rewards: 85.548, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.388', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.166', 'AMMO4': '0.219', 'AMMO3': '0.247', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '71.000'} [2024-08-06 06:22:47,113][52669] DAMAGECOUNT value on done: 749596.0 [2024-08-06 06:22:47,113][52669] Sum rewards: 88.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.627', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.168', 'AMMO3': '0.186', 'AMMO4': '0.273', 'weapon5': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '69.000'} [2024-08-06 06:22:47,379][52670] DAMAGECOUNT value on done: 731621.0 [2024-08-06 06:22:47,380][52670] Sum rewards: 69.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.344', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'weapon2': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'HITCOUNT': '3.350', 'weapon3': '3.410', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 560046080. Throughput: 0: 4373.8. Samples: 140010680. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:22:47,794][52567] Avg episode reward: [(0, '74.016')] [2024-08-06 06:22:48,122][52662] DAMAGECOUNT value on done: 732144.0 [2024-08-06 06:22:48,124][52662] Sum rewards: 61.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.066', 'AMMO4': '0.162', 'weapon5': '0.166', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.130', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '50.000'} [2024-08-06 06:22:48,729][52664] DAMAGECOUNT value on done: 764404.0 [2024-08-06 06:22:48,730][52664] Sum rewards: 81.284, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '0.001', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.130', 'weapon5': '0.180', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '67.000'} [2024-08-06 06:22:48,733][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:22:48,835][52647] DAMAGECOUNT value on done: 785213.0 [2024-08-06 06:22:48,835][52647] Sum rewards: 69.738, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.052', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon4': '0.146', 'AMMO3': '0.179', 'AMMO4': '0.258', 'weapon5': '0.378', 'weapon2': '0.474', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '55.000'} [2024-08-06 06:22:49,461][52668] DAMAGECOUNT value on done: 737231.0 [2024-08-06 06:22:49,461][52668] Sum rewards: 76.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.470', 'AMMO5': '0.021', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.156', 'weapon2': '0.176', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'weapon4': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 06:22:49,681][52666] DAMAGECOUNT value on done: 718638.0 [2024-08-06 06:22:49,681][52666] Sum rewards: 75.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.918', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.111', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:50,515][52670] DAMAGECOUNT value on done: 735500.0 [2024-08-06 06:22:50,519][52670] Sum rewards: 72.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon2': '0.144', 'weapon5': '0.178', 'AMMO3': '0.220', 'weapon4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2024-08-06 06:22:50,574][52650] Updated weights for policy 0, policy_version 68371 (0.0013) [2024-08-06 06:22:50,963][52662] DAMAGECOUNT value on done: 750619.0 [2024-08-06 06:22:50,963][52662] Sum rewards: 72.615, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.081', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.119', 'weapon5': '0.168', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '57.000'} [2024-08-06 06:22:51,708][52647] DAMAGECOUNT value on done: 785468.0 [2024-08-06 06:22:51,711][52647] Sum rewards: 63.916, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.097', 'AMMO5': '0.026', 'AMMO2': '0.066', 'weapon4': '0.152', 'weapon5': '0.182', 'AMMO3': '0.241', 'AMMO4': '0.328', 'weapon2': '0.358', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '55.000'} [2024-08-06 06:22:52,453][52668] DAMAGECOUNT value on done: 735320.0 [2024-08-06 06:22:52,454][52668] Sum rewards: 77.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.759', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.092', 'weapon5': '0.168', 'AMMO3': '0.202', 'AMMO4': '0.249', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '64.000'} [2024-08-06 06:22:52,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 560128000. Throughput: 0: 4367.2. Samples: 140036610. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:22:52,794][52567] Avg episode reward: [(0, '74.050')] [2024-08-06 06:22:52,799][52666] DAMAGECOUNT value on done: 731237.0 [2024-08-06 06:22:52,799][52666] Sum rewards: 64.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.045', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.122', 'weapon5': '0.216', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.060', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '55.000'} [2024-08-06 06:22:53,937][52662] DAMAGECOUNT value on done: 732637.0 [2024-08-06 06:22:53,945][52662] Sum rewards: 62.434, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.902', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.184', 'weapon4': '0.202', 'AMMO4': '0.240', 'AMMO3': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '53.000'} [2024-08-06 06:22:54,695][52647] DAMAGECOUNT value on done: 785434.0 [2024-08-06 06:22:54,696][52647] Sum rewards: 82.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.907', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '66.000'} [2024-08-06 06:22:54,854][52668] DAMAGECOUNT value on done: 743376.0 [2024-08-06 06:22:54,856][52668] Sum rewards: 66.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.508', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.150', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.848', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '54.000'} [2024-08-06 06:22:55,198][52650] Updated weights for policy 0, policy_version 68381 (0.0019) [2024-08-06 06:22:56,759][52662] DAMAGECOUNT value on done: 741263.0 [2024-08-06 06:22:56,760][52662] Sum rewards: 85.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.108', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.178', 'AMMO4': '0.201', 'AMMO3': '0.238', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.859', 'FRAGCOUNT': '70.000'} [2024-08-06 06:22:57,448][52647] DAMAGECOUNT value on done: 766096.0 [2024-08-06 06:22:57,450][52647] Sum rewards: 79.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.827', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.432', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '66.000'} [2024-08-06 06:22:57,631][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:22:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 560218112. Throughput: 0: 4371.1. Samples: 140063060. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:22:57,794][52567] Avg episode reward: [(0, '74.095')] [2024-08-06 06:22:57,840][52668] DAMAGECOUNT value on done: 739532.0 [2024-08-06 06:22:57,841][52668] Sum rewards: 73.131, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.035', 'HEALTH': '0.060', 'weapon5': '0.120', 'AMMO3': '0.166', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '0.900', 'weapon3': '2.984', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '58.000'} [2024-08-06 06:22:59,791][52650] Updated weights for policy 0, policy_version 68391 (0.0011) [2024-08-06 06:22:59,902][52662] DAMAGECOUNT value on done: 754456.0 [2024-08-06 06:22:59,903][52662] Sum rewards: 94.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.174', 'weapon2': '0.178', 'AMMO3': '0.216', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.473', 'FRAGCOUNT': '77.000'} [2024-08-06 06:23:00,301][52668] DAMAGECOUNT value on done: 732544.0 [2024-08-06 06:23:00,303][52668] Sum rewards: 81.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.074', 'weapon4': '0.152', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.364', 'WEAPON3': '1.600', 'weapon3': '3.082', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '69.000'} [2024-08-06 06:23:00,344][52647] DAMAGECOUNT value on done: 781096.0 [2024-08-06 06:23:00,345][52647] Sum rewards: 75.878, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.372', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.070', 'weapon4': '0.102', 'AMMO4': '0.117', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.438', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '62.000'} [2024-08-06 06:23:00,495][52647] Large shaping reward 2.712 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.594, 198.0), ('HEALTH', -0.024, -8.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 06:23:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 560308224. Throughput: 0: 4373.6. Samples: 140076180. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:23:02,794][52567] Avg episode reward: [(0, '74.235')] [2024-08-06 06:23:03,042][52668] DAMAGECOUNT value on done: 726815.0 [2024-08-06 06:23:03,043][52668] Sum rewards: 68.104, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.218', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.178', 'AMMO4': '0.202', 'AMMO3': '0.279', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.038', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '58.000'} [2024-08-06 06:23:03,153][52647] DAMAGECOUNT value on done: 779733.0 [2024-08-06 06:23:03,154][52647] Sum rewards: 64.351, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.518', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO4': '0.241', 'AMMO3': '0.251', 'weapon5': '0.282', 'weapon4': '0.328', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.684', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '56.000'} [2024-08-06 06:23:03,381][52662] DAMAGECOUNT value on done: 741773.0 [2024-08-06 06:23:03,382][52662] Sum rewards: 57.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.719', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.158', 'AMMO3': '0.212', 'AMMO4': '0.231', 'weapon5': '0.242', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '46.000'} [2024-08-06 06:23:04,496][52650] Updated weights for policy 0, policy_version 68401 (0.0017) [2024-08-06 06:23:05,399][52668] DAMAGECOUNT value on done: 727344.0 [2024-08-06 06:23:05,399][52668] Sum rewards: 56.367, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.441', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.090', 'weapon5': '0.166', 'AMMO4': '0.173', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.148', 'DAMAGECOUNT': '15.465', 'FRAGCOUNT': '48.000'} [2024-08-06 06:23:05,872][52647] DAMAGECOUNT value on done: 776865.0 [2024-08-06 06:23:05,875][52647] Sum rewards: 69.305, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.174', 'AMMO3': '0.177', 'weapon4': '0.184', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '55.000'} [2024-08-06 06:23:06,555][52662] DAMAGECOUNT value on done: 749008.0 [2024-08-06 06:23:06,556][52662] Sum rewards: 78.026, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.280', 'WEAPON3': '1.150', 'HITCOUNT': '3.430', 'weapon3': '3.444', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:06,644][52660] DAMAGECOUNT value on done: 739582.0 [2024-08-06 06:23:06,644][52660] Sum rewards: 65.066, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.912', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.104', 'AMMO4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.640', 'WEAPON3': '1.300', 'weapon3': '2.862', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '54.000'} [2024-08-06 06:23:07,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 560398336. Throughput: 0: 4362.9. Samples: 140102040. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:23:07,795][52567] Avg episode reward: [(0, '73.599')] [2024-08-06 06:23:08,212][52668] DAMAGECOUNT value on done: 726908.0 [2024-08-06 06:23:08,213][52668] Sum rewards: 83.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.544', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.167', 'AMMO3': '0.178', 'weapon2': '0.236', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '67.000'} [2024-08-06 06:23:08,341][52647] DAMAGECOUNT value on done: 770932.0 [2024-08-06 06:23:08,341][52647] Sum rewards: 60.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.146', 'weapon5': '0.146', 'AMMO4': '0.163', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.130', 'DAMAGECOUNT': '15.378', 'FRAGCOUNT': '51.500'} [2024-08-06 06:23:09,174][52662] DAMAGECOUNT value on done: 737844.0 [2024-08-06 06:23:09,176][52662] Sum rewards: 85.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.786', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.244', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '3.238', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '71.000'} [2024-08-06 06:23:09,390][52650] Updated weights for policy 0, policy_version 68411 (0.0012) [2024-08-06 06:23:09,705][52660] DAMAGECOUNT value on done: 730007.0 [2024-08-06 06:23:09,705][52660] Sum rewards: 77.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.230', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon4': '0.284', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:10,984][52668] DAMAGECOUNT value on done: 739622.0 [2024-08-06 06:23:10,986][52668] Sum rewards: 75.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.066', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 06:23:11,156][52647] DAMAGECOUNT value on done: 785628.0 [2024-08-06 06:23:11,157][52647] Sum rewards: 86.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.835', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.199', 'AMMO4': '0.206', 'weapon5': '0.218', 'weapon4': '0.220', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '69.000'} [2024-08-06 06:23:12,380][52662] DAMAGECOUNT value on done: 738580.0 [2024-08-06 06:23:12,382][52662] Sum rewards: 80.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.604', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.074', 'weapon5': '0.162', 'AMMO3': '0.195', 'AMMO4': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '66.000'} [2024-08-06 06:23:12,457][52660] DAMAGECOUNT value on done: 742279.0 [2024-08-06 06:23:12,458][52660] Sum rewards: 72.054, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.000', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.156', 'AMMO3': '0.169', 'weapon4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '58.000'} [2024-08-06 06:23:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 560480256. Throughput: 0: 4356.0. Samples: 140128120. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:23:12,795][52567] Avg episode reward: [(0, '73.847')] [2024-08-06 06:23:13,918][52647] DAMAGECOUNT value on done: 770112.0 [2024-08-06 06:23:13,920][52647] Sum rewards: 80.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.154', 'AMMO3': '0.186', 'AMMO4': '0.206', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '65.000'} [2024-08-06 06:23:14,022][52668] DAMAGECOUNT value on done: 738668.0 [2024-08-06 06:23:14,024][52668] Sum rewards: 84.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.517', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.086', 'weapon5': '0.140', 'AMMO4': '0.209', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '67.000'} [2024-08-06 06:23:14,310][52650] Updated weights for policy 0, policy_version 68421 (0.0016) [2024-08-06 06:23:15,135][52662] DAMAGECOUNT value on done: 733531.0 [2024-08-06 06:23:15,137][52662] Sum rewards: 68.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.672', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon2': '0.202', 'AMMO3': '0.214', 'AMMO4': '0.227', 'weapon4': '0.254', 'weapon5': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '58.000'} [2024-08-06 06:23:15,433][52660] DAMAGECOUNT value on done: 751590.0 [2024-08-06 06:23:15,434][52660] Sum rewards: 83.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.668', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.106', 'AMMO4': '0.213', 'AMMO3': '0.245', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '2.826', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '69.000'} [2024-08-06 06:23:16,145][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:23:16,740][52647] DAMAGECOUNT value on done: 782374.0 [2024-08-06 06:23:16,740][52647] Sum rewards: 73.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.808', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.132', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.692', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '61.000'} [2024-08-06 06:23:17,019][52668] DAMAGECOUNT value on done: 737047.0 [2024-08-06 06:23:17,019][52668] Sum rewards: 69.020, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.521', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.156', 'weapon5': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '0.950', 'weapon3': '2.892', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '54.000'} [2024-08-06 06:23:17,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 560562176. Throughput: 0: 4368.4. Samples: 140141390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:23:17,794][52567] Avg episode reward: [(0, '74.180')] [2024-08-06 06:23:18,127][52662] DAMAGECOUNT value on done: 745992.0 [2024-08-06 06:23:18,129][52662] Sum rewards: 74.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '62.000'} [2024-08-06 06:23:18,468][52660] DAMAGECOUNT value on done: 734889.0 [2024-08-06 06:23:18,469][52660] Sum rewards: 77.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.525', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.042', 'AMMO3': '0.181', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.208', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:18,602][52650] Updated weights for policy 0, policy_version 68431 (0.0018) [2024-08-06 06:23:19,533][52647] DAMAGECOUNT value on done: 782609.0 [2024-08-06 06:23:19,534][52647] Sum rewards: 70.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.330', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.134', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '58.000'} [2024-08-06 06:23:20,190][52668] DAMAGECOUNT value on done: 743286.0 [2024-08-06 06:23:20,191][52668] Sum rewards: 78.095, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.610', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.137', 'AMMO4': '0.151', 'weapon5': '0.158', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '62.000'} [2024-08-06 06:23:20,955][52662] DAMAGECOUNT value on done: 734176.0 [2024-08-06 06:23:20,957][52662] Sum rewards: 64.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.717', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.092', 'weapon4': '0.116', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '53.000'} [2024-08-06 06:23:21,222][52660] DAMAGECOUNT value on done: 729583.0 [2024-08-06 06:23:21,222][52660] Sum rewards: 76.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.075', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:21,975][52647] DAMAGECOUNT value on done: 770138.0 [2024-08-06 06:23:21,978][52647] Sum rewards: 81.764, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.248', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '70.000'} [2024-08-06 06:23:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 560652288. Throughput: 0: 4367.8. Samples: 140167550. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:22,795][52567] Avg episode reward: [(0, '74.286')] [2024-08-06 06:23:23,252][52668] DAMAGECOUNT value on done: 743064.0 [2024-08-06 06:23:23,253][52668] Sum rewards: 83.948, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.021', 'AMMO2': '0.042', 'HEALTH': '0.113', 'AMMO3': '0.147', 'weapon4': '0.200', 'AMMO4': '0.210', 'weapon5': '0.338', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.774', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '21.081', 'FRAGCOUNT': '64.000'} [2024-08-06 06:23:23,486][52650] Updated weights for policy 0, policy_version 68441 (0.0012) [2024-08-06 06:23:23,597][52662] DAMAGECOUNT value on done: 748947.0 [2024-08-06 06:23:23,597][52662] Sum rewards: 80.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.147', 'weapon5': '0.180', 'AMMO3': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.178', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '66.000'} [2024-08-06 06:23:24,334][52647] DAMAGECOUNT value on done: 776180.0 [2024-08-06 06:23:24,334][52647] Sum rewards: 77.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.360', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.146', 'weapon5': '0.160', 'AMMO4': '0.164', 'AMMO3': '0.190', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '62.000'} [2024-08-06 06:23:24,619][52660] DAMAGECOUNT value on done: 738144.0 [2024-08-06 06:23:24,620][52660] Sum rewards: 93.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.362', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.088', 'AMMO4': '0.183', 'weapon5': '0.184', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.306', 'FRAGCOUNT': '75.000'} [2024-08-06 06:23:26,664][52662] DAMAGECOUNT value on done: 745467.0 [2024-08-06 06:23:26,666][52662] Sum rewards: 87.355, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.847', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.127', 'weapon5': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '70.000'} [2024-08-06 06:23:27,029][52647] DAMAGECOUNT value on done: 765837.0 [2024-08-06 06:23:27,029][52647] Sum rewards: 77.962, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.344', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '67.000'} [2024-08-06 06:23:27,359][52660] DAMAGECOUNT value on done: 746265.0 [2024-08-06 06:23:27,359][52660] Sum rewards: 72.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.118', 'weapon2': '0.202', 'AMMO4': '0.216', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '60.000'} [2024-08-06 06:23:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 560742400. Throughput: 0: 4369.1. Samples: 140193770. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:27,794][52567] Avg episode reward: [(0, '75.099')] [2024-08-06 06:23:27,863][52650] Updated weights for policy 0, policy_version 68451 (0.0022) [2024-08-06 06:23:29,622][52647] DAMAGECOUNT value on done: 770703.0 [2024-08-06 06:23:29,622][52647] Sum rewards: 65.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.165', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.217', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '54.500'} [2024-08-06 06:23:29,696][52649] DAMAGECOUNT value on done: 717926.0 [2024-08-06 06:23:29,698][52649] Sum rewards: 74.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.900', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon5': '0.164', 'weapon4': '0.206', 'AMMO3': '0.226', 'AMMO4': '0.257', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:29,700][52662] DAMAGECOUNT value on done: 731792.0 [2024-08-06 06:23:29,702][52662] Sum rewards: 76.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.152', 'AMMO4': '0.219', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.208', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '65.000'} [2024-08-06 06:23:30,413][52660] DAMAGECOUNT value on done: 731582.0 [2024-08-06 06:23:30,415][52660] Sum rewards: 69.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.545', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.148', 'weapon2': '0.194', 'weapon5': '0.196', 'AMMO3': '0.240', 'AMMO4': '0.289', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '58.000'} [2024-08-06 06:23:31,618][52659] DAMAGECOUNT value on done: 742896.0 [2024-08-06 06:23:31,621][52659] Sum rewards: 69.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.245', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.166', 'AMMO3': '0.274', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.264', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '59.000'} [2024-08-06 06:23:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 560824320. Throughput: 0: 4360.2. Samples: 140206890. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:32,794][52567] Avg episode reward: [(0, '74.697')] [2024-08-06 06:23:32,858][52650] Updated weights for policy 0, policy_version 68461 (0.0019) [2024-08-06 06:23:32,942][52649] DAMAGECOUNT value on done: 709447.0 [2024-08-06 06:23:32,945][52649] Sum rewards: 58.287, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.114', 'weapon5': '0.116', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.150', 'HITCOUNT': '2.730', 'weapon3': '3.200', 'DAMAGECOUNT': '13.260', 'FRAGCOUNT': '48.000'} [2024-08-06 06:23:32,979][52662] DAMAGECOUNT value on done: 740775.0 [2024-08-06 06:23:32,980][52662] Sum rewards: 73.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.624', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.140', 'weapon4': '0.184', 'AMMO4': '0.198', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '60.000'} [2024-08-06 06:23:33,522][52660] DAMAGECOUNT value on done: 733630.0 [2024-08-06 06:23:33,523][52660] Sum rewards: 63.090, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.909', 'AMMO2': '0.011', 'AMMO5': '0.015', 'AMMO4': '0.053', 'weapon4': '0.058', 'weapon5': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'weapon2': '0.788', 'WEAPON3': '0.900', 'weapon3': '2.894', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '49.000'} [2024-08-06 06:23:34,634][52659] DAMAGECOUNT value on done: 741694.0 [2024-08-06 06:23:34,635][52659] Sum rewards: 73.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.633', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon5': '0.204', 'weapon2': '0.270', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '59.500'} [2024-08-06 06:23:35,766][52662] DAMAGECOUNT value on done: 730766.0 [2024-08-06 06:23:35,768][52662] Sum rewards: 73.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.191', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.076', 'AMMO4': '0.179', 'weapon5': '0.192', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '61.000'} [2024-08-06 06:23:35,790][52649] DAMAGECOUNT value on done: 729986.0 [2024-08-06 06:23:35,791][52649] Sum rewards: 84.229, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.754', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.116', 'AMMO3': '0.151', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.266', 'WEAPON3': '0.950', 'weapon3': '3.266', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '66.000'} [2024-08-06 06:23:36,329][52660] DAMAGECOUNT value on done: 739797.0 [2024-08-06 06:23:36,331][52660] Sum rewards: 74.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.060', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.117', 'weapon5': '0.130', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.354', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '62.000'} [2024-08-06 06:23:37,563][52659] DAMAGECOUNT value on done: 743489.0 [2024-08-06 06:23:37,563][52659] Sum rewards: 73.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.677', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.198', 'weapon2': '0.258', 'weapon5': '0.330', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.640', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '59.500'} [2024-08-06 06:23:37,630][52650] Updated weights for policy 0, policy_version 68471 (0.0014) [2024-08-06 06:23:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 560914432. Throughput: 0: 4363.3. Samples: 140232960. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:37,794][52567] Avg episode reward: [(0, '74.543')] [2024-08-06 06:23:38,966][52649] DAMAGECOUNT value on done: 722870.0 [2024-08-06 06:23:38,968][52649] Sum rewards: 61.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.184', 'weapon5': '0.190', 'AMMO3': '0.199', 'AMMO4': '0.255', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.032', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '51.000'} [2024-08-06 06:23:39,644][52660] DAMAGECOUNT value on done: 731366.0 [2024-08-06 06:23:39,645][52660] Sum rewards: 77.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.190', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '64.000'} [2024-08-06 06:23:40,496][52659] DAMAGECOUNT value on done: 743883.0 [2024-08-06 06:23:40,497][52659] Sum rewards: 81.518, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.049', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '65.000'} [2024-08-06 06:23:42,184][52649] DAMAGECOUNT value on done: 712795.0 [2024-08-06 06:23:42,184][52649] Sum rewards: 84.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.110', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '70.000'} [2024-08-06 06:23:42,308][52650] Updated weights for policy 0, policy_version 68481 (0.0018) [2024-08-06 06:23:42,352][52660] DAMAGECOUNT value on done: 739578.0 [2024-08-06 06:23:42,352][52660] Sum rewards: 81.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.168', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.046', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 06:23:42,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 561004544. Throughput: 0: 4355.1. Samples: 140259040. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:42,802][52567] Avg episode reward: [(0, '74.739')] [2024-08-06 06:23:43,188][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:23:43,251][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:23:43,537][52659] DAMAGECOUNT value on done: 741063.0 [2024-08-06 06:23:43,537][52659] Sum rewards: 85.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.715', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.194', 'weapon5': '0.200', 'AMMO4': '0.247', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '69.000'} [2024-08-06 06:23:45,037][52660] DAMAGECOUNT value on done: 748363.0 [2024-08-06 06:23:45,038][52660] Sum rewards: 75.499, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.631', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.078', 'AMMO3': '0.177', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '61.000'} [2024-08-06 06:23:45,421][52649] DAMAGECOUNT value on done: 728366.0 [2024-08-06 06:23:45,422][52649] Sum rewards: 73.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.002', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.178', 'AMMO3': '0.226', 'weapon2': '0.246', 'weapon4': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '61.500'} [2024-08-06 06:23:46,459][52659] DAMAGECOUNT value on done: 742850.0 [2024-08-06 06:23:46,460][52659] Sum rewards: 68.999, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.371', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.192', 'weapon2': '0.206', 'AMMO3': '0.224', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '56.000'} [2024-08-06 06:23:46,963][52650] Updated weights for policy 0, policy_version 68491 (0.0030) [2024-08-06 06:23:47,426][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:23:47,645][52660] DAMAGECOUNT value on done: 757703.0 [2024-08-06 06:23:47,645][52660] Sum rewards: 74.436, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon4': '0.274', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 06:23:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 561086464. Throughput: 0: 4356.2. Samples: 140272210. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:47,795][52567] Avg episode reward: [(0, '74.461')] [2024-08-06 06:23:47,961][52649] DAMAGECOUNT value on done: 723065.0 [2024-08-06 06:23:47,961][52649] Sum rewards: 78.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.872', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO4': '0.201', 'weapon5': '0.226', 'AMMO3': '0.227', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '65.000'} [2024-08-06 06:23:49,600][52659] DAMAGECOUNT value on done: 742382.0 [2024-08-06 06:23:49,602][52659] Sum rewards: 77.514, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.882', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon5': '0.222', 'AMMO3': '0.260', 'AMMO4': '0.269', 'weapon4': '0.324', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.794', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '66.000'} [2024-08-06 06:23:50,212][52667] DAMAGECOUNT value on done: 740516.0 [2024-08-06 06:23:50,213][52667] Sum rewards: 69.694, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.132', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.632', 'WEAPON3': '0.850', 'weapon3': '2.916', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '54.000'} [2024-08-06 06:23:50,271][52660] DAMAGECOUNT value on done: 734771.0 [2024-08-06 06:23:50,273][52660] Sum rewards: 71.034, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.123', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.149', 'AMMO4': '0.176', 'weapon5': '0.210', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.716', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 06:23:50,644][52649] DAMAGECOUNT value on done: 725114.0 [2024-08-06 06:23:50,644][52649] Sum rewards: 75.208, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.804', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO3': '0.109', 'AMMO4': '0.125', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon4': '0.344', 'weapon2': '0.662', 'WEAPON3': '0.750', 'weapon3': '2.498', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '57.000'} [2024-08-06 06:23:51,070][52669] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:23:51,589][52650] Updated weights for policy 0, policy_version 68501 (0.0014) [2024-08-06 06:23:52,218][52659] DAMAGECOUNT value on done: 738998.0 [2024-08-06 06:23:52,221][52659] Sum rewards: 69.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.260', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.110', 'AMMO4': '0.139', 'AMMO3': '0.189', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '59.000'} [2024-08-06 06:23:52,728][52660] DAMAGECOUNT value on done: 743375.0 [2024-08-06 06:23:52,731][52660] Sum rewards: 56.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.170', 'AMMO4': '0.188', 'weapon5': '0.194', 'weapon4': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '2.944', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '45.000'} [2024-08-06 06:23:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 561176576. Throughput: 0: 4357.6. Samples: 140298130. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:52,794][52567] Avg episode reward: [(0, '74.319')] [2024-08-06 06:23:53,270][52667] DAMAGECOUNT value on done: 746135.0 [2024-08-06 06:23:53,273][52667] Sum rewards: 82.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.566', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.072', 'weapon5': '0.158', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.946', 'FRAGCOUNT': '66.000'} [2024-08-06 06:23:53,527][52649] DAMAGECOUNT value on done: 725120.0 [2024-08-06 06:23:53,529][52649] Sum rewards: 75.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.362', 'AMMO5': '0.028', 'AMMO2': '0.054', 'weapon4': '0.128', 'AMMO3': '0.211', 'AMMO4': '0.270', 'weapon5': '0.278', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:54,895][52659] DAMAGECOUNT value on done: 744730.0 [2024-08-06 06:23:54,897][52659] Sum rewards: 75.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.431', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.140', 'AMMO4': '0.142', 'weapon5': '0.152', 'weapon2': '0.184', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.296', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '63.500'} [2024-08-06 06:23:55,736][52660] DAMAGECOUNT value on done: 740062.0 [2024-08-06 06:23:55,736][52660] Sum rewards: 81.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.782', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.104', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'weapon3': '3.382', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '68.000'} [2024-08-06 06:23:56,258][52650] Updated weights for policy 0, policy_version 68511 (0.0015) [2024-08-06 06:23:56,387][52649] DAMAGECOUNT value on done: 717097.0 [2024-08-06 06:23:56,388][52649] Sum rewards: 72.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.529', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.124', 'weapon4': '0.158', 'AMMO4': '0.174', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '58.000'} [2024-08-06 06:23:56,409][52667] DAMAGECOUNT value on done: 743229.0 [2024-08-06 06:23:56,410][52667] Sum rewards: 77.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.984', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO4': '0.202', 'weapon5': '0.214', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.614', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:57,398][52659] DAMAGECOUNT value on done: 748616.0 [2024-08-06 06:23:57,400][52659] Sum rewards: 64.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.106', 'weapon5': '0.138', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.216', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '55.000'} [2024-08-06 06:23:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 561266688. Throughput: 0: 4360.9. Samples: 140324360. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:23:57,794][52567] Avg episode reward: [(0, '74.526')] [2024-08-06 06:23:58,827][52660] DAMAGECOUNT value on done: 732196.0 [2024-08-06 06:23:58,828][52660] Sum rewards: 66.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.356', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.058', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '55.000'} [2024-08-06 06:23:59,109][52649] DAMAGECOUNT value on done: 729467.0 [2024-08-06 06:23:59,110][52649] Sum rewards: 78.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.274', 'weapon4': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '63.000'} [2024-08-06 06:23:59,561][52667] DAMAGECOUNT value on done: 750464.0 [2024-08-06 06:23:59,561][52667] Sum rewards: 70.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.090', 'weapon5': '0.184', 'AMMO3': '0.185', 'AMMO4': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:00,126][52659] DAMAGECOUNT value on done: 736841.0 [2024-08-06 06:24:00,127][52659] Sum rewards: 72.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.198', 'weapon5': '0.206', 'AMMO3': '0.208', 'AMMO4': '0.315', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'weapon2': '0.752', 'WEAPON3': '1.300', 'weapon3': '2.580', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:01,257][52650] Updated weights for policy 0, policy_version 68521 (0.0011) [2024-08-06 06:24:02,160][52649] DAMAGECOUNT value on done: 730734.0 [2024-08-06 06:24:02,161][52649] Sum rewards: 73.148, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.094', 'AMMO4': '0.180', 'weapon4': '0.232', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '60.000'} [2024-08-06 06:24:02,591][52660] DAMAGECOUNT value on done: 730918.0 [2024-08-06 06:24:02,591][52660] Sum rewards: 82.481, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.009', 'AMMO2': '0.021', 'HEALTH': '0.087', 'AMMO4': '0.105', 'weapon5': '0.118', 'AMMO3': '0.147', 'weapon4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '0.900', 'weapon3': '3.178', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '65.000'} [2024-08-06 06:24:02,593][52659] DAMAGECOUNT value on done: 745807.0 [2024-08-06 06:24:02,593][52659] Sum rewards: 77.547, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.480', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.127', 'weapon5': '0.272', 'weapon2': '0.274', 'AMMO4': '0.282', 'weapon4': '0.608', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.584', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:02,620][52667] DAMAGECOUNT value on done: 750725.0 [2024-08-06 06:24:02,620][52667] Sum rewards: 83.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.169', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.108', 'weapon5': '0.114', 'AMMO3': '0.216', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.093', 'FRAGCOUNT': '69.000'} [2024-08-06 06:24:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 561348608. Throughput: 0: 4357.6. Samples: 140337480. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:02,794][52567] Avg episode reward: [(0, '74.484')] [2024-08-06 06:24:04,021][52794] DAMAGECOUNT value on done: 737421.0 [2024-08-06 06:24:04,022][52794] Sum rewards: 71.615, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.072', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '3.092', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:05,314][52649] DAMAGECOUNT value on done: 730103.0 [2024-08-06 06:24:05,315][52649] Sum rewards: 72.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.155', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'weapon4': '0.238', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'weapon3': '3.338', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:05,479][52659] DAMAGECOUNT value on done: 741758.0 [2024-08-06 06:24:05,481][52659] Sum rewards: 67.352, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.521', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.072', 'AMMO3': '0.160', 'weapon5': '0.172', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '54.000'} [2024-08-06 06:24:05,785][52667] DAMAGECOUNT value on done: 750413.0 [2024-08-06 06:24:05,785][52667] Sum rewards: 78.550, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.698', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.138', 'weapon4': '0.156', 'weapon2': '0.382', 'WEAPON3': '0.900', 'weapon3': '3.230', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:05,788][52650] Updated weights for policy 0, policy_version 68531 (0.0018) [2024-08-06 06:24:06,376][52794] DAMAGECOUNT value on done: 747685.0 [2024-08-06 06:24:06,377][52794] Sum rewards: 78.326, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.204', 'weapon5': '0.248', 'AMMO4': '0.268', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'HEALTH': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.788', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '61.000'} [2024-08-06 06:24:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 561438720. Throughput: 0: 4347.8. Samples: 140363200. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:07,802][52567] Avg episode reward: [(0, '74.578')] [2024-08-06 06:24:08,296][52659] DAMAGECOUNT value on done: 743074.0 [2024-08-06 06:24:08,297][52659] Sum rewards: 74.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.132', 'weapon4': '0.146', 'AMMO4': '0.180', 'weapon2': '0.198', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.296', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:08,513][52649] DAMAGECOUNT value on done: 730563.0 [2024-08-06 06:24:08,513][52649] Sum rewards: 82.442, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.974', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.234', 'weapon4': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '66.000'} [2024-08-06 06:24:08,919][52667] DAMAGECOUNT value on done: 744856.0 [2024-08-06 06:24:08,920][52667] Sum rewards: 58.781, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.121', 'AMMO3': '0.144', 'weapon5': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon2': '0.986', 'weapon3': '2.660', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.457', 'FRAGCOUNT': '46.000'} [2024-08-06 06:24:09,362][52794] DAMAGECOUNT value on done: 751628.0 [2024-08-06 06:24:09,364][52794] Sum rewards: 66.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.122', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.122', 'weapon5': '0.124', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '56.000'} [2024-08-06 06:24:10,140][52811] DAMAGECOUNT value on done: 706423.0 [2024-08-06 06:24:10,142][52811] Sum rewards: 71.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.394', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.124', 'AMMO4': '0.165', 'weapon2': '0.192', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:10,491][52650] Updated weights for policy 0, policy_version 68541 (0.0016) [2024-08-06 06:24:11,361][52659] DAMAGECOUNT value on done: 746729.0 [2024-08-06 06:24:11,361][52659] Sum rewards: 65.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.004', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '54.000'} [2024-08-06 06:24:11,382][52667] DAMAGECOUNT value on done: 742203.0 [2024-08-06 06:24:11,383][52667] Sum rewards: 67.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.812', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.172', 'AMMO3': '0.175', 'weapon5': '0.206', 'AMMO4': '0.224', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '55.500'} [2024-08-06 06:24:11,636][52649] DAMAGECOUNT value on done: 715534.0 [2024-08-06 06:24:11,638][52649] Sum rewards: 72.884, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.866', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.098', 'AMMO4': '0.144', 'weapon5': '0.154', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.264', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:12,535][52794] DAMAGECOUNT value on done: 735534.0 [2024-08-06 06:24:12,538][52794] Sum rewards: 75.454, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.681', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.132', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'weapon4': '0.264', 'WEAPON3': '1.000', 'weapon3': '3.166', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '60.000'} [2024-08-06 06:24:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 561528832. Throughput: 0: 4356.4. Samples: 140389810. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:12,794][52567] Avg episode reward: [(0, '74.565')] [2024-08-06 06:24:13,272][52811] DAMAGECOUNT value on done: 688262.0 [2024-08-06 06:24:13,274][52811] Sum rewards: 77.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.004', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.210', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.368', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '64.000'} [2024-08-06 06:24:14,140][52667] DAMAGECOUNT value on done: 744242.0 [2024-08-06 06:24:14,141][52667] Sum rewards: 65.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon2': '0.202', 'AMMO3': '0.220', 'AMMO4': '0.247', 'weapon4': '0.282', 'weapon5': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '53.000'} [2024-08-06 06:24:14,510][52649] DAMAGECOUNT value on done: 726912.0 [2024-08-06 06:24:14,511][52649] Sum rewards: 78.086, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '67.000'} [2024-08-06 06:24:14,519][52659] DAMAGECOUNT value on done: 744009.0 [2024-08-06 06:24:14,520][52659] Sum rewards: 71.851, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.752', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.208', 'AMMO4': '0.210', 'AMMO3': '0.242', 'weapon2': '0.350', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.726', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '60.000'} [2024-08-06 06:24:15,063][52650] Updated weights for policy 0, policy_version 68551 (0.0032) [2024-08-06 06:24:15,110][52794] DAMAGECOUNT value on done: 738138.0 [2024-08-06 06:24:15,111][52794] Sum rewards: 83.086, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.217', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.031', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'weapon2': '0.252', 'WEAPON3': '0.900', 'weapon3': '3.614', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '64.000'} [2024-08-06 06:24:16,348][52811] DAMAGECOUNT value on done: 687559.0 [2024-08-06 06:24:16,350][52811] Sum rewards: 67.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.060', 'weapon4': '0.064', 'AMMO3': '0.168', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.232', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '55.000'} [2024-08-06 06:24:16,728][52667] DAMAGECOUNT value on done: 752414.0 [2024-08-06 06:24:16,734][52667] Sum rewards: 63.616, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.750', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.144', 'weapon4': '0.148', 'AMMO4': '0.212', 'AMMO3': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '53.000'} [2024-08-06 06:24:17,367][52659] DAMAGECOUNT value on done: 751148.0 [2024-08-06 06:24:17,367][52659] Sum rewards: 81.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.410', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.226', 'weapon4': '0.230', 'weapon5': '0.234', 'AMMO4': '0.270', 'weapon2': '0.406', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.876', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '66.000'} [2024-08-06 06:24:17,687][52649] DAMAGECOUNT value on done: 712801.0 [2024-08-06 06:24:17,689][52649] Sum rewards: 58.768, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.752', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.102', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'weapon2': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.850', 'weapon3': '3.504', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '46.000'} [2024-08-06 06:24:17,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 561610752. Throughput: 0: 4357.8. Samples: 140402990. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:17,794][52567] Avg episode reward: [(0, '74.235')] [2024-08-06 06:24:18,042][52794] DAMAGECOUNT value on done: 742722.0 [2024-08-06 06:24:18,044][52794] Sum rewards: 76.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.844', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '66.000'} [2024-08-06 06:24:19,376][52811] DAMAGECOUNT value on done: 688570.0 [2024-08-06 06:24:19,376][52811] Sum rewards: 85.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.526', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '70.000'} [2024-08-06 06:24:19,569][52667] DAMAGECOUNT value on done: 743026.0 [2024-08-06 06:24:19,570][52667] Sum rewards: 67.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.134', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.138', 'AMMO4': '0.187', 'AMMO3': '0.188', 'weapon5': '0.206', 'weapon2': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.112', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:19,642][52650] Updated weights for policy 0, policy_version 68561 (0.0014) [2024-08-06 06:24:20,691][52659] DAMAGECOUNT value on done: 738892.0 [2024-08-06 06:24:20,692][52659] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.034', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '54.000'} [2024-08-06 06:24:20,870][52649] DAMAGECOUNT value on done: 730235.0 [2024-08-06 06:24:20,871][52649] Sum rewards: 70.467, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.880', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.054', 'AMMO4': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:21,012][52794] DAMAGECOUNT value on done: 746735.0 [2024-08-06 06:24:21,015][52794] Sum rewards: 77.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.094', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:21,951][52665] DAMAGECOUNT value on done: 728619.0 [2024-08-06 06:24:21,952][52665] Sum rewards: 77.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.082', 'AMMO4': '0.131', 'weapon5': '0.178', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.906', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:22,189][52667] DAMAGECOUNT value on done: 743672.0 [2024-08-06 06:24:22,189][52667] Sum rewards: 88.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.682', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.096', 'AMMO4': '0.138', 'weapon5': '0.156', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.564', 'FRAGCOUNT': '71.000'} [2024-08-06 06:24:22,651][52811] DAMAGECOUNT value on done: 695503.0 [2024-08-06 06:24:22,653][52811] Sum rewards: 54.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon5': '0.228', 'weapon2': '0.268', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.178', 'DAMAGECOUNT': '14.127', 'FRAGCOUNT': '45.000'} [2024-08-06 06:24:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 561700864. Throughput: 0: 4362.0. Samples: 140429250. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:22,802][52567] Avg episode reward: [(0, '74.338')] [2024-08-06 06:24:23,535][52659] DAMAGECOUNT value on done: 748125.0 [2024-08-06 06:24:23,537][52659] Sum rewards: 57.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.039', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.872', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.202', 'FRAGCOUNT': '50.000'} [2024-08-06 06:24:23,597][52649] DAMAGECOUNT value on done: 732226.0 [2024-08-06 06:24:23,597][52649] Sum rewards: 76.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.846', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.168', 'AMMO3': '0.193', 'AMMO4': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:24,259][52794] DAMAGECOUNT value on done: 733100.0 [2024-08-06 06:24:24,261][52794] Sum rewards: 75.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.098', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.438', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '66.000'} [2024-08-06 06:24:24,528][52650] Updated weights for policy 0, policy_version 68571 (0.0022) [2024-08-06 06:24:24,570][52665] DAMAGECOUNT value on done: 743676.0 [2024-08-06 06:24:24,570][52665] Sum rewards: 76.156, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.752', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.150', 'weapon2': '0.180', 'weapon4': '0.180', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:24,931][52667] DAMAGECOUNT value on done: 750579.0 [2024-08-06 06:24:24,931][52667] Sum rewards: 71.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.778', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.118', 'AMMO4': '0.166', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 06:24:25,150][52820] DAMAGECOUNT value on done: 687264.0 [2024-08-06 06:24:25,151][52820] Sum rewards: 66.584, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.281', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.062', 'AMMO4': '0.155', 'weapon5': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '56.500'} [2024-08-06 06:24:25,816][52811] DAMAGECOUNT value on done: 701017.0 [2024-08-06 06:24:25,818][52811] Sum rewards: 80.897, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.018', 'AMMO2': '0.029', 'AMMO3': '0.142', 'AMMO4': '0.147', 'weapon2': '0.248', 'weapon5': '0.258', 'HEALTH': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.438', 'WEAPON3': '0.850', 'weapon3': '2.804', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '60.500'} [2024-08-06 06:24:26,691][52795] DAMAGECOUNT value on done: 690256.0 [2024-08-06 06:24:26,691][52795] Sum rewards: 74.690, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.092', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:26,757][52649] DAMAGECOUNT value on done: 721508.0 [2024-08-06 06:24:26,759][52649] Sum rewards: 75.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.129', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.078', 'AMMO4': '0.157', 'weapon5': '0.226', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 06:24:26,853][52659] DAMAGECOUNT value on done: 739591.0 [2024-08-06 06:24:26,855][52659] Sum rewards: 76.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.108', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.384', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '2.852', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:27,471][52667] DAMAGECOUNT value on done: 739185.0 [2024-08-06 06:24:27,471][52667] Sum rewards: 78.548, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.289', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'weapon4': '0.106', 'AMMO4': '0.113', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.302', 'WEAPON3': '0.950', 'weapon3': '3.322', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:27,642][52794] DAMAGECOUNT value on done: 744509.0 [2024-08-06 06:24:27,646][52794] Sum rewards: 67.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.558', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.238', 'weapon5': '0.238', 'AMMO4': '0.238', 'AMMO3': '0.242', 'weapon2': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:27,786][52665] DAMAGECOUNT value on done: 741625.0 [2024-08-06 06:24:27,786][52665] Sum rewards: 69.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.164', 'weapon4': '0.170', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '55.000'} [2024-08-06 06:24:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 561782784. Throughput: 0: 4364.0. Samples: 140455420. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:27,795][52567] Avg episode reward: [(0, '73.905')] [2024-08-06 06:24:27,859][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068578_561790976.pth... [2024-08-06 06:24:28,017][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068066_557596672.pth [2024-08-06 06:24:28,342][52820] DAMAGECOUNT value on done: 688182.0 [2024-08-06 06:24:28,344][52820] Sum rewards: 79.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '65.000'} [2024-08-06 06:24:28,916][52811] DAMAGECOUNT value on done: 697270.0 [2024-08-06 06:24:28,916][52811] Sum rewards: 71.029, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.134', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.144', 'AMMO3': '0.204', 'AMMO4': '0.236', 'weapon5': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 06:24:29,312][52650] Updated weights for policy 0, policy_version 68581 (0.0014) [2024-08-06 06:24:29,944][52795] DAMAGECOUNT value on done: 678023.0 [2024-08-06 06:24:29,947][52795] Sum rewards: 69.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon4': '0.156', 'weapon2': '0.200', 'AMMO3': '0.235', 'AMMO4': '0.290', 'weapon5': '0.306', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 06:24:30,291][52665] DAMAGECOUNT value on done: 736901.0 [2024-08-06 06:24:30,292][52665] Sum rewards: 87.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.260', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.241', 'weapon2': '0.328', 'WEAPON3': '1.650', 'weapon3': '3.464', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.285', 'FRAGCOUNT': '74.000'} [2024-08-06 06:24:30,391][52667] DAMAGECOUNT value on done: 747509.0 [2024-08-06 06:24:30,393][52667] Sum rewards: 85.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.092', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.074', 'AMMO3': '0.199', 'weapon5': '0.202', 'AMMO4': '0.273', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '69.000'} [2024-08-06 06:24:30,571][52794] DAMAGECOUNT value on done: 737732.0 [2024-08-06 06:24:30,573][52794] Sum rewards: 74.846, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.640', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.344', 'WEAPON3': '2.000', 'weapon3': '3.444', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '68.000'} [2024-08-06 06:24:31,499][52820] DAMAGECOUNT value on done: 688916.0 [2024-08-06 06:24:31,501][52820] Sum rewards: 76.109, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.112', 'AMMO4': '0.179', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:32,208][52811] DAMAGECOUNT value on done: 687570.0 [2024-08-06 06:24:32,211][52811] Sum rewards: 79.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.914', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.132', 'AMMO4': '0.181', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '64.000'} [2024-08-06 06:24:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 561872896. Throughput: 0: 4351.1. Samples: 140468010. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:32,794][52567] Avg episode reward: [(0, '73.600')] [2024-08-06 06:24:33,034][52667] DAMAGECOUNT value on done: 752573.0 [2024-08-06 06:24:33,036][52667] Sum rewards: 79.040, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.834', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.206', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '65.500'} [2024-08-06 06:24:33,113][52795] DAMAGECOUNT value on done: 679555.0 [2024-08-06 06:24:33,115][52795] Sum rewards: 82.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.432', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '67.000'} [2024-08-06 06:24:33,317][52665] DAMAGECOUNT value on done: 722868.0 [2024-08-06 06:24:33,319][52665] Sum rewards: 75.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.257', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.104', 'AMMO4': '0.140', 'weapon5': '0.184', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:33,416][52614] Signal inference workers to stop experience collection... (12500 times) [2024-08-06 06:24:33,432][52614] Signal inference workers to resume experience collection... (12500 times) [2024-08-06 06:24:33,490][52650] InferenceWorker_p0-w0: stopping experience collection (12500 times) [2024-08-06 06:24:33,490][52650] InferenceWorker_p0-w0: resuming experience collection (12500 times) [2024-08-06 06:24:33,571][52794] DAMAGECOUNT value on done: 733681.0 [2024-08-06 06:24:33,574][52794] Sum rewards: 73.348, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.696', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.090', 'weapon5': '0.204', 'AMMO4': '0.223', 'weapon2': '0.224', 'AMMO3': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.204', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '65.000'} [2024-08-06 06:24:33,777][52650] Updated weights for policy 0, policy_version 68591 (0.0027) [2024-08-06 06:24:34,618][52820] DAMAGECOUNT value on done: 680016.0 [2024-08-06 06:24:34,620][52820] Sum rewards: 83.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.044', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'AMMO3': '0.261', 'weapon2': '0.360', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '71.000'} [2024-08-06 06:24:35,312][52811] DAMAGECOUNT value on done: 700399.0 [2024-08-06 06:24:35,313][52811] Sum rewards: 66.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.436', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.030', 'AMMO4': '0.109', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '55.000'} [2024-08-06 06:24:35,930][52667] DAMAGECOUNT value on done: 749756.0 [2024-08-06 06:24:35,940][52667] Sum rewards: 73.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.702', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.114', 'AMMO4': '0.158', 'AMMO3': '0.184', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.304', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '61.000'} [2024-08-06 06:24:36,178][52795] DAMAGECOUNT value on done: 687565.0 [2024-08-06 06:24:36,178][52795] Sum rewards: 82.081, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.710', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '64.000'} [2024-08-06 06:24:36,513][52665] DAMAGECOUNT value on done: 729316.0 [2024-08-06 06:24:36,515][52665] Sum rewards: 73.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.232', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.102', 'AMMO4': '0.211', 'AMMO3': '0.224', 'weapon5': '0.264', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:36,551][52794] DAMAGECOUNT value on done: 741520.0 [2024-08-06 06:24:36,551][52794] Sum rewards: 68.936, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.164', 'AMMO3': '0.177', 'AMMO4': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.798', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '54.000'} [2024-08-06 06:24:37,763][52820] DAMAGECOUNT value on done: 693265.0 [2024-08-06 06:24:37,764][52820] Sum rewards: 64.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.894', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.328', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '54.000'} [2024-08-06 06:24:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 561963008. Throughput: 0: 4355.3. Samples: 140494120. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:37,794][52567] Avg episode reward: [(0, '74.167')] [2024-08-06 06:24:38,432][52811] DAMAGECOUNT value on done: 696028.0 [2024-08-06 06:24:38,444][52811] Sum rewards: 71.791, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.185', 'AMMO4': '0.192', 'weapon5': '0.296', 'weapon2': '0.320', 'weapon4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'HEALTH': '0.447', 'WEAPON3': '1.000', 'weapon3': '2.780', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '56.000'} [2024-08-06 06:24:38,687][52650] Updated weights for policy 0, policy_version 68601 (0.0015) [2024-08-06 06:24:38,831][52665] DAMAGECOUNT value on done: 734851.0 [2024-08-06 06:24:38,833][52665] Sum rewards: 64.083, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.031', 'AMMO2': '0.078', 'weapon4': '0.154', 'AMMO3': '0.257', 'weapon5': '0.312', 'AMMO4': '0.388', 'weapon2': '0.456', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.500', 'weapon3': '2.732', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '55.000'} [2024-08-06 06:24:39,019][52667] DAMAGECOUNT value on done: 749099.0 [2024-08-06 06:24:39,019][52667] Sum rewards: 74.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.356', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.219', 'AMMO4': '0.227', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.884', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '61.500'} [2024-08-06 06:24:39,383][52795] DAMAGECOUNT value on done: 680604.0 [2024-08-06 06:24:39,384][52795] Sum rewards: 77.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.072', 'AMMO4': '0.130', 'weapon5': '0.134', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '64.000'} [2024-08-06 06:24:39,650][52794] DAMAGECOUNT value on done: 740961.0 [2024-08-06 06:24:39,651][52794] Sum rewards: 86.884, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.040', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon5': '0.182', 'weapon2': '0.200', 'AMMO3': '0.219', 'AMMO4': '0.246', 'weapon4': '0.448', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.872', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.189', 'FRAGCOUNT': '71.000'} [2024-08-06 06:24:40,226][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:24:40,898][52820] DAMAGECOUNT value on done: 675703.0 [2024-08-06 06:24:40,898][52820] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.320', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.158', 'AMMO4': '0.169', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.092', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:41,628][52665] DAMAGECOUNT value on done: 732766.0 [2024-08-06 06:24:41,631][52665] Sum rewards: 83.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.035', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.146', 'AMMO3': '0.171', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON4': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.892', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.844', 'FRAGCOUNT': '66.000'} [2024-08-06 06:24:41,704][52667] DAMAGECOUNT value on done: 746163.0 [2024-08-06 06:24:41,704][52667] Sum rewards: 52.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.436', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.248', 'DAMAGECOUNT': '13.542', 'FRAGCOUNT': '45.000'} [2024-08-06 06:24:41,719][52811] DAMAGECOUNT value on done: 698223.0 [2024-08-06 06:24:41,721][52811] Sum rewards: 75.861, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon2': '0.152', 'weapon5': '0.168', 'AMMO4': '0.174', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.410', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '65.000'} [2024-08-06 06:24:41,965][52794] DAMAGECOUNT value on done: 756968.0 [2024-08-06 06:24:41,965][52794] Sum rewards: 83.726, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.060', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.188', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.650', 'weapon3': '2.994', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '72.000'} [2024-08-06 06:24:42,476][52795] DAMAGECOUNT value on done: 687395.0 [2024-08-06 06:24:42,477][52795] Sum rewards: 65.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.001', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.101', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '54.000'} [2024-08-06 06:24:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 562053120. Throughput: 0: 4358.0. Samples: 140520470. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:24:42,794][52567] Avg episode reward: [(0, '73.586')] [2024-08-06 06:24:43,069][52650] Updated weights for policy 0, policy_version 68611 (0.0026) [2024-08-06 06:24:44,042][52820] DAMAGECOUNT value on done: 686992.0 [2024-08-06 06:24:44,043][52820] Sum rewards: 81.693, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.144', 'AMMO4': '0.149', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '66.000'} [2024-08-06 06:24:44,223][52665] DAMAGECOUNT value on done: 740742.0 [2024-08-06 06:24:44,223][52665] Sum rewards: 67.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.187', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.328', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '56.000'} [2024-08-06 06:24:44,449][52794] DAMAGECOUNT value on done: 735340.0 [2024-08-06 06:24:44,450][52794] Sum rewards: 67.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.846', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.080', 'weapon5': '0.210', 'AMMO3': '0.214', 'AMMO4': '0.224', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.184', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:44,561][52667] DAMAGECOUNT value on done: 753259.0 [2024-08-06 06:24:44,561][52667] Sum rewards: 67.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.815', 'AMMO5': '0.030', 'AMMO2': '0.097', 'AMMO3': '0.286', 'weapon2': '0.306', 'weapon4': '0.356', 'weapon5': '0.428', 'AMMO4': '0.483', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.650', 'weapon3': '2.460', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:44,996][52811] DAMAGECOUNT value on done: 702891.0 [2024-08-06 06:24:45,000][52811] Sum rewards: 82.152, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.107', 'weapon5': '0.142', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'HEALTH': '0.649', 'WEAPON3': '0.850', 'weapon3': '3.302', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '65.000'} [2024-08-06 06:24:45,557][52795] DAMAGECOUNT value on done: 695296.0 [2024-08-06 06:24:45,558][52795] Sum rewards: 90.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.979', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.082', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.391', 'FRAGCOUNT': '73.000'} [2024-08-06 06:24:46,723][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:24:46,832][52665] DAMAGECOUNT value on done: 733803.0 [2024-08-06 06:24:46,833][52665] Sum rewards: 72.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.896', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.144', 'AMMO3': '0.156', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:46,982][52794] DAMAGECOUNT value on done: 750482.0 [2024-08-06 06:24:46,983][52794] Sum rewards: 71.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon5': '0.112', 'AMMO3': '0.210', 'weapon2': '0.220', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.378', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 06:24:47,208][52820] DAMAGECOUNT value on done: 688409.0 [2024-08-06 06:24:47,208][52820] Sum rewards: 68.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.501', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO3': '0.211', 'AMMO4': '0.224', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.270', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 562135040. Throughput: 0: 4362.4. Samples: 140533790. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:24:47,795][52567] Avg episode reward: [(0, '73.706')] [2024-08-06 06:24:47,960][52650] Updated weights for policy 0, policy_version 68621 (0.0026) [2024-08-06 06:24:48,079][52811] DAMAGECOUNT value on done: 696736.0 [2024-08-06 06:24:48,080][52811] Sum rewards: 91.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.528', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.170', 'AMMO3': '0.209', 'weapon4': '0.222', 'AMMO4': '0.275', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.440', 'FRAGCOUNT': '77.000'} [2024-08-06 06:24:48,772][52795] DAMAGECOUNT value on done: 685478.0 [2024-08-06 06:24:48,774][52795] Sum rewards: 70.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.593', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.164', 'weapon2': '0.198', 'AMMO4': '0.217', 'AMMO3': '0.220', 'weapon5': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.080', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '59.000'} [2024-08-06 06:24:49,775][52665] DAMAGECOUNT value on done: 742686.0 [2024-08-06 06:24:49,777][52665] Sum rewards: 60.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.398', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.216', 'AMMO4': '0.230', 'AMMO3': '0.239', 'weapon5': '0.260', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '49.000'} [2024-08-06 06:24:50,111][52794] DAMAGECOUNT value on done: 746275.0 [2024-08-06 06:24:50,114][52794] Sum rewards: 79.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.348', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.542', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '65.000'} [2024-08-06 06:24:50,544][52820] DAMAGECOUNT value on done: 687641.0 [2024-08-06 06:24:50,545][52820] Sum rewards: 70.355, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.110', 'AMMO4': '0.193', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HEALTH': '0.368', 'weapon2': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:51,221][52811] DAMAGECOUNT value on done: 691506.0 [2024-08-06 06:24:51,222][52811] Sum rewards: 75.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.138', 'AMMO4': '0.196', 'AMMO3': '0.203', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:51,872][52795] DAMAGECOUNT value on done: 685011.0 [2024-08-06 06:24:51,880][52795] Sum rewards: 68.302, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.850', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.172', 'weapon4': '0.188', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '56.000'} [2024-08-06 06:24:51,941][52663] DAMAGECOUNT value on done: 756270.0 [2024-08-06 06:24:51,942][52663] Sum rewards: 84.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.628', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.174', 'AMMO4': '0.222', 'AMMO3': '0.226', 'weapon5': '0.260', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '68.000'} [2024-08-06 06:24:52,574][52665] DAMAGECOUNT value on done: 740979.0 [2024-08-06 06:24:52,574][52665] Sum rewards: 75.294, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'weapon5': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '61.000'} [2024-08-06 06:24:52,735][52794] DAMAGECOUNT value on done: 747162.0 [2024-08-06 06:24:52,735][52794] Sum rewards: 76.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.164', 'AMMO4': '0.183', 'AMMO3': '0.194', 'weapon4': '0.214', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:52,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.6, 300 sec: 17411.5). Total num frames: 562216960. Throughput: 0: 4366.6. Samples: 140559700. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:24:52,795][52567] Avg episode reward: [(0, '73.935')] [2024-08-06 06:24:52,907][52650] Updated weights for policy 0, policy_version 68631 (0.0014) [2024-08-06 06:24:53,778][52820] DAMAGECOUNT value on done: 696459.0 [2024-08-06 06:24:53,779][52820] Sum rewards: 83.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.548', 'AMMO5': '0.016', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'AMMO3': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '3.166', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '69.000'} [2024-08-06 06:24:54,092][52658] DAMAGECOUNT value on done: 745066.0 [2024-08-06 06:24:54,094][52658] Sum rewards: 74.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.294', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.116', 'weapon5': '0.126', 'AMMO4': '0.164', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '64.000'} [2024-08-06 06:24:54,157][52665] Large shaping reward 2.555 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.525, 175.0)] [2024-08-06 06:24:54,240][52803] DAMAGECOUNT value on done: 689492.0 [2024-08-06 06:24:54,241][52803] Sum rewards: 62.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.881', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.122', 'AMMO3': '0.207', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon4': '0.380', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.688', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '50.000'} [2024-08-06 06:24:54,390][52811] DAMAGECOUNT value on done: 690738.0 [2024-08-06 06:24:54,390][52811] Sum rewards: 74.723, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.433', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.141', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.354', 'WEAPON3': '0.850', 'weapon3': '3.006', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '57.000'} [2024-08-06 06:24:54,761][52663] DAMAGECOUNT value on done: 741804.0 [2024-08-06 06:24:54,762][52663] Sum rewards: 74.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.104', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.104', 'weapon5': '0.218', 'AMMO3': '0.221', 'AMMO4': '0.234', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.300', 'weapon3': '2.728', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '61.000'} [2024-08-06 06:24:55,006][52795] DAMAGECOUNT value on done: 689488.0 [2024-08-06 06:24:55,007][52795] Sum rewards: 79.365, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.174', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.141', 'weapon5': '0.180', 'weapon4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '0.900', 'weapon3': '2.836', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '61.000'} [2024-08-06 06:24:55,281][52665] DAMAGECOUNT value on done: 737224.0 [2024-08-06 06:24:55,281][52665] Sum rewards: 74.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.036', 'AMMO4': '0.040', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.660', 'WEAPON3': '1.450', 'weapon3': '3.006', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:55,995][52794] DAMAGECOUNT value on done: 755449.0 [2024-08-06 06:24:55,995][52794] Sum rewards: 75.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.405', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO3': '0.221', 'AMMO4': '0.255', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 06:24:56,443][52671] DAMAGECOUNT value on done: 746341.0 [2024-08-06 06:24:56,444][52671] Sum rewards: 92.443, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.045', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.076', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.284', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '74.000'} [2024-08-06 06:24:56,937][52820] DAMAGECOUNT value on done: 681623.0 [2024-08-06 06:24:56,940][52820] Sum rewards: 75.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.285', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon5': '0.286', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '62.000'} [2024-08-06 06:24:57,070][52658] DAMAGECOUNT value on done: 746586.0 [2024-08-06 06:24:57,073][52658] Sum rewards: 84.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.174', 'weapon5': '0.190', 'weapon2': '0.246', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.200', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '71.000'} [2024-08-06 06:24:57,245][52663] DAMAGECOUNT value on done: 738060.0 [2024-08-06 06:24:57,245][52663] Sum rewards: 88.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.257', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '71.000'} [2024-08-06 06:24:57,520][52803] DAMAGECOUNT value on done: 687029.0 [2024-08-06 06:24:57,520][52803] Sum rewards: 40.612, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.158', 'weapon5': '0.168', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'weapon4': '0.872', 'WEAPON3': '0.950', 'weapon3': '1.768', 'HITCOUNT': '1.820', 'DAMAGECOUNT': '9.798', 'FRAGCOUNT': '34.000'} [2024-08-06 06:24:57,556][52811] DAMAGECOUNT value on done: 691878.0 [2024-08-06 06:24:57,556][52811] Sum rewards: 71.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.178', 'AMMO4': '0.197', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '60.000'} [2024-08-06 06:24:57,769][52650] Updated weights for policy 0, policy_version 68641 (0.0010) [2024-08-06 06:24:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 562307072. Throughput: 0: 4362.5. Samples: 140586120. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:24:57,794][52567] Avg episode reward: [(0, '74.010')] [2024-08-06 06:24:57,868][52665] DAMAGECOUNT value on done: 733968.0 [2024-08-06 06:24:57,868][52665] Sum rewards: 79.931, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.152', 'weapon5': '0.156', 'AMMO4': '0.165', 'AMMO3': '0.226', 'HEALTH': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '67.000'} [2024-08-06 06:24:58,100][52795] DAMAGECOUNT value on done: 683126.0 [2024-08-06 06:24:58,100][52795] Sum rewards: 63.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.142', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.086', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '56.000'} [2024-08-06 06:24:58,646][52794] DAMAGECOUNT value on done: 744499.0 [2024-08-06 06:24:58,649][52794] Sum rewards: 65.819, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.032', 'AMMO3': '0.121', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.800', 'WEAPON3': '0.850', 'weapon3': '2.780', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '50.000'} [2024-08-06 06:24:59,546][52794] Large shaping reward 3.166 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.135, 45.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:24:59,666][52671] DAMAGECOUNT value on done: 752663.0 [2024-08-06 06:24:59,666][52671] Sum rewards: 88.115, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'HEALTH': '0.035', 'AMMO2': '0.037', 'weapon4': '0.090', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '72.000'} [2024-08-06 06:24:59,856][52664] DAMAGECOUNT value on done: 769523.0 [2024-08-06 06:24:59,857][52664] Sum rewards: 62.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.543', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.120', 'AMMO4': '0.226', 'weapon2': '0.234', 'weapon5': '0.246', 'AMMO3': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '54.000'} [2024-08-06 06:24:59,930][52658] DAMAGECOUNT value on done: 747785.0 [2024-08-06 06:24:59,933][52658] Sum rewards: 52.437, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.020', 'AMMO2': '0.068', 'weapon4': '0.092', 'AMMO3': '0.156', 'weapon5': '0.186', 'AMMO4': '0.340', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.588', 'WEAPON3': '0.900', 'HITCOUNT': '2.690', 'weapon3': '2.902', 'DAMAGECOUNT': '14.364', 'FRAGCOUNT': '42.000'} [2024-08-06 06:25:00,034][52663] DAMAGECOUNT value on done: 741321.0 [2024-08-06 06:25:00,036][52663] Sum rewards: 81.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.763', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.082', 'weapon4': '0.088', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:00,099][52820] DAMAGECOUNT value on done: 689808.0 [2024-08-06 06:25:00,099][52820] Sum rewards: 83.446, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.126', 'weapon4': '0.132', 'AMMO4': '0.137', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:00,566][52803] DAMAGECOUNT value on done: 696879.0 [2024-08-06 06:25:00,567][52803] Sum rewards: 63.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.754', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.126', 'weapon2': '0.164', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.232', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '51.000'} [2024-08-06 06:25:00,640][52665] DAMAGECOUNT value on done: 730602.0 [2024-08-06 06:25:00,640][52665] Sum rewards: 80.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.293', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.130', 'AMMO4': '0.165', 'weapon5': '0.180', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.964', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:00,682][52811] DAMAGECOUNT value on done: 697593.0 [2024-08-06 06:25:00,682][52811] Sum rewards: 75.576, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.036', 'weapon5': '0.080', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.384', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:01,204][52795] DAMAGECOUNT value on done: 681057.0 [2024-08-06 06:25:01,205][52795] Sum rewards: 67.051, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.355', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO3': '0.113', 'weapon5': '0.150', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '0.700', 'weapon2': '0.722', 'weapon3': '2.764', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '50.000'} [2024-08-06 06:25:01,758][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:25:01,962][52650] Updated weights for policy 0, policy_version 68651 (0.0018) [2024-08-06 06:25:02,339][52671] DAMAGECOUNT value on done: 746439.0 [2024-08-06 06:25:02,339][52671] Sum rewards: 84.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.009', 'weapon4': '0.052', 'AMMO2': '0.054', 'weapon5': '0.120', 'AMMO3': '0.201', 'AMMO4': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:02,785][52658] DAMAGECOUNT value on done: 746588.0 [2024-08-06 06:25:02,787][52658] Sum rewards: 74.074, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.040', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon5': '0.134', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.956', 'WEAPON3': '1.050', 'weapon3': '2.702', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:02,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 562397184. Throughput: 0: 4360.2. Samples: 140599200. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:25:02,794][52567] Avg episode reward: [(0, '74.241')] [2024-08-06 06:25:02,829][52664] DAMAGECOUNT value on done: 776401.0 [2024-08-06 06:25:02,829][52664] Sum rewards: 73.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.195', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.168', 'AMMO4': '0.169', 'weapon5': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.328', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.882', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '58.500'} [2024-08-06 06:25:02,964][52663] DAMAGECOUNT value on done: 743831.0 [2024-08-06 06:25:02,965][52663] Sum rewards: 72.204, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.618', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.080', 'weapon4': '0.172', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:03,183][52820] DAMAGECOUNT value on done: 697316.0 [2024-08-06 06:25:03,183][52820] Sum rewards: 79.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.015', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.217', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '66.000'} [2024-08-06 06:25:03,609][52803] DAMAGECOUNT value on done: 695541.0 [2024-08-06 06:25:03,610][52803] Sum rewards: 80.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.174', 'AMMO3': '0.219', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:03,664][52665] DAMAGECOUNT value on done: 736356.0 [2024-08-06 06:25:03,664][52665] Sum rewards: 78.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.595', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.036', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.706', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:03,895][52811] DAMAGECOUNT value on done: 699786.0 [2024-08-06 06:25:03,897][52811] Sum rewards: 76.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.876', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.108', 'AMMO4': '0.170', 'weapon5': '0.194', 'weapon2': '0.228', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.252', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:04,093][52669] DAMAGECOUNT value on done: 745204.0 [2024-08-06 06:25:04,094][52669] Sum rewards: 73.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.918', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.217', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:04,290][52670] DAMAGECOUNT value on done: 733518.0 [2024-08-06 06:25:04,290][52670] Sum rewards: 61.808, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.108', 'weapon5': '0.144', 'AMMO3': '0.179', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '2.888', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '50.000'} [2024-08-06 06:25:04,293][52795] DAMAGECOUNT value on done: 681806.0 [2024-08-06 06:25:04,293][52795] Sum rewards: 65.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.160', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'weapon4': '0.176', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.928', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '54.000'} [2024-08-06 06:25:04,839][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:25:05,432][52664] DAMAGECOUNT value on done: 771714.0 [2024-08-06 06:25:05,441][52664] Sum rewards: 79.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.287', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.056', 'AMMO4': '0.088', 'weapon4': '0.182', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:05,634][52671] DAMAGECOUNT value on done: 749421.0 [2024-08-06 06:25:05,635][52671] Sum rewards: 80.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.038', 'weapon5': '0.120', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.370', 'weapon3': '3.404', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:05,637][52663] DAMAGECOUNT value on done: 751012.0 [2024-08-06 06:25:05,638][52663] Sum rewards: 74.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.165', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO4': '0.156', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:05,865][52658] DAMAGECOUNT value on done: 738921.0 [2024-08-06 06:25:05,865][52658] Sum rewards: 70.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon4': '0.318', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:06,353][52820] DAMAGECOUNT value on done: 689873.0 [2024-08-06 06:25:06,354][52820] Sum rewards: 76.129, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.904', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.110', 'AMMO3': '0.181', 'weapon5': '0.182', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:06,403][52666] DAMAGECOUNT value on done: 744657.0 [2024-08-06 06:25:06,404][52666] Sum rewards: 80.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.160', 'AMMO3': '0.208', 'weapon5': '0.230', 'AMMO4': '0.317', 'weapon2': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:06,506][52669] DAMAGECOUNT value on done: 736759.0 [2024-08-06 06:25:06,507][52669] Sum rewards: 76.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.714', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:06,640][52803] DAMAGECOUNT value on done: 694587.0 [2024-08-06 06:25:06,640][52803] Sum rewards: 67.393, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.844', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.072', 'weapon5': '0.134', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '2.786', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '53.000'} [2024-08-06 06:25:06,723][52650] Updated weights for policy 0, policy_version 68661 (0.0025) [2024-08-06 06:25:06,848][52665] DAMAGECOUNT value on done: 736576.0 [2024-08-06 06:25:06,849][52665] Sum rewards: 74.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.007', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.142', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon4': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.924', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:06,973][52811] DAMAGECOUNT value on done: 695102.0 [2024-08-06 06:25:06,975][52811] Sum rewards: 67.567, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.432', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.277', 'weapon2': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.410', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:07,384][52670] DAMAGECOUNT value on done: 744300.0 [2024-08-06 06:25:07,385][52670] Sum rewards: 63.593, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.948', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO3': '0.176', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'weapon4': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.840', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '51.000'} [2024-08-06 06:25:07,575][52795] DAMAGECOUNT value on done: 690185.0 [2024-08-06 06:25:07,575][52795] Sum rewards: 71.837, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.035', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.088', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.352', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 562487296. Throughput: 0: 4358.4. Samples: 140625380. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:25:07,794][52567] Avg episode reward: [(0, '74.301')] [2024-08-06 06:25:08,010][52663] DAMAGECOUNT value on done: 739495.0 [2024-08-06 06:25:08,011][52663] Sum rewards: 77.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.183', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.042', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:08,395][52671] DAMAGECOUNT value on done: 757167.0 [2024-08-06 06:25:08,395][52671] Sum rewards: 68.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.129', 'AMMO3': '0.176', 'weapon4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '57.500'} [2024-08-06 06:25:08,525][52664] DAMAGECOUNT value on done: 766797.0 [2024-08-06 06:25:08,525][52664] Sum rewards: 81.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.179', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.436', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '66.000'} [2024-08-06 06:25:08,582][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:25:08,799][52658] DAMAGECOUNT value on done: 735536.0 [2024-08-06 06:25:08,806][52658] Sum rewards: 65.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.108', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'weapon4': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:09,223][52669] DAMAGECOUNT value on done: 749553.0 [2024-08-06 06:25:09,223][52669] Sum rewards: 81.930, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.273', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.045', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:09,324][52666] DAMAGECOUNT value on done: 741003.0 [2024-08-06 06:25:09,324][52666] Sum rewards: 79.474, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.868', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.194', 'weapon2': '0.840', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:09,528][52820] DAMAGECOUNT value on done: 694611.0 [2024-08-06 06:25:09,531][52820] Sum rewards: 97.087, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.246', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.078', 'AMMO4': '0.090', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '23.022', 'FRAGCOUNT': '80.000'} [2024-08-06 06:25:09,562][52665] DAMAGECOUNT value on done: 728687.0 [2024-08-06 06:25:09,564][52665] Sum rewards: 73.087, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.919', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.114', 'AMMO3': '0.266', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'weapon4': '0.372', 'weapon2': '0.478', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.738', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:09,788][52803] DAMAGECOUNT value on done: 691171.0 [2024-08-06 06:25:09,789][52803] Sum rewards: 75.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.906', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'weapon2': '0.256', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'HITCOUNT': '3.440', 'weapon3': '3.472', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '66.000'} [2024-08-06 06:25:10,152][52811] DAMAGECOUNT value on done: 694458.0 [2024-08-06 06:25:10,152][52811] Sum rewards: 79.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.294', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.175', 'weapon4': '0.194', 'AMMO3': '0.236', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '2.688', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '66.500'} [2024-08-06 06:25:10,418][52670] DAMAGECOUNT value on done: 733301.0 [2024-08-06 06:25:10,419][52670] Sum rewards: 77.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.096', 'AMMO4': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:10,735][52795] DAMAGECOUNT value on done: 674994.0 [2024-08-06 06:25:10,743][52795] Sum rewards: 72.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.872', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.812', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:11,013][52663] DAMAGECOUNT value on done: 732567.0 [2024-08-06 06:25:11,014][52663] Sum rewards: 68.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.128', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.340', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 06:25:11,340][52650] Updated weights for policy 0, policy_version 68671 (0.0026) [2024-08-06 06:25:11,379][52671] DAMAGECOUNT value on done: 750692.0 [2024-08-06 06:25:11,380][52671] Sum rewards: 64.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.650', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.260', 'weapon3': '3.362', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:11,450][52664] DAMAGECOUNT value on done: 779005.0 [2024-08-06 06:25:11,452][52664] Sum rewards: 80.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.082', 'weapon4': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '66.000'} [2024-08-06 06:25:11,859][52658] DAMAGECOUNT value on done: 748606.0 [2024-08-06 06:25:11,862][52658] Sum rewards: 71.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.334', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon2': '0.224', 'AMMO3': '0.229', 'weapon4': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.278', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:11,945][52669] DAMAGECOUNT value on done: 744862.0 [2024-08-06 06:25:11,946][52669] Sum rewards: 68.678, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:12,394][52665] DAMAGECOUNT value on done: 731975.0 [2024-08-06 06:25:12,394][52665] Sum rewards: 63.555, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.309', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.098', 'weapon4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.382', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.140', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.500'} [2024-08-06 06:25:12,572][52666] DAMAGECOUNT value on done: 742082.0 [2024-08-06 06:25:12,573][52666] Sum rewards: 82.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.224', 'AMMO3': '0.228', 'weapon2': '0.264', 'weapon5': '0.274', 'AMMO4': '0.302', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:12,602][52820] DAMAGECOUNT value on done: 689644.0 [2024-08-06 06:25:12,603][52820] Sum rewards: 77.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.144', 'AMMO4': '0.187', 'weapon5': '0.188', 'AMMO3': '0.231', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 562577408. Throughput: 0: 4364.5. Samples: 140651820. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:25:12,794][52567] Avg episode reward: [(0, '74.181')] [2024-08-06 06:25:12,897][52803] DAMAGECOUNT value on done: 687432.0 [2024-08-06 06:25:12,898][52803] Sum rewards: 80.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.996', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.128', 'AMMO4': '0.153', 'weapon5': '0.156', 'AMMO3': '0.215', 'weapon2': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.072', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:13,326][52663] DAMAGECOUNT value on done: 734614.0 [2024-08-06 06:25:13,328][52663] Sum rewards: 72.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.048', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.094', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:13,716][52670] DAMAGECOUNT value on done: 731398.0 [2024-08-06 06:25:13,717][52670] Sum rewards: 74.395, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.020', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.382', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:13,809][52795] DAMAGECOUNT value on done: 693137.0 [2024-08-06 06:25:13,812][52795] Sum rewards: 73.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.908', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:14,147][52664] DAMAGECOUNT value on done: 771425.0 [2024-08-06 06:25:14,148][52664] Sum rewards: 69.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.806', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.164', 'weapon5': '0.216', 'AMMO3': '0.226', 'AMMO4': '0.252', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '58.000'} [2024-08-06 06:25:14,184][52669] DAMAGECOUNT value on done: 747376.0 [2024-08-06 06:25:14,184][52669] Sum rewards: 74.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.868', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.096', 'weapon5': '0.126', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:14,368][52671] DAMAGECOUNT value on done: 751481.0 [2024-08-06 06:25:14,369][52671] Sum rewards: 74.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.064', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.232', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:14,943][52658] DAMAGECOUNT value on done: 738518.0 [2024-08-06 06:25:14,943][52658] Sum rewards: 69.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.066', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.128', 'AMMO4': '0.141', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:15,415][52665] DAMAGECOUNT value on done: 735032.0 [2024-08-06 06:25:15,417][52665] Sum rewards: 61.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.896', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.078', 'AMMO4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.219', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '3.182', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '52.000'} [2024-08-06 06:25:15,709][52820] DAMAGECOUNT value on done: 691506.0 [2024-08-06 06:25:15,709][52820] Sum rewards: 71.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.115', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.111', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:15,825][52663] DAMAGECOUNT value on done: 739224.0 [2024-08-06 06:25:15,826][52663] Sum rewards: 81.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.178', 'AMMO3': '0.223', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.318', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:15,862][52666] DAMAGECOUNT value on done: 740976.0 [2024-08-06 06:25:15,863][52666] Sum rewards: 63.802, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.150', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.132', 'AMMO4': '0.194', 'weapon5': '0.204', 'weapon2': '0.242', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.130', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:15,957][52803] DAMAGECOUNT value on done: 684825.0 [2024-08-06 06:25:15,957][52803] Sum rewards: 67.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.138', 'AMMO5': '0.021', 'AMMO2': '0.069', 'AMMO3': '0.173', 'weapon4': '0.228', 'AMMO4': '0.346', 'weapon5': '0.346', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'weapon2': '0.724', 'WEAPON3': '1.050', 'weapon3': '2.442', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '54.000'} [2024-08-06 06:25:16,250][52650] Updated weights for policy 0, policy_version 68681 (0.0032) [2024-08-06 06:25:16,679][52671] DAMAGECOUNT value on done: 749152.0 [2024-08-06 06:25:16,680][52671] Sum rewards: 77.058, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.655', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.112', 'AMMO3': '0.173', 'AMMO4': '0.301', 'weapon5': '0.304', 'weapon2': '0.356', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:16,858][52670] DAMAGECOUNT value on done: 743313.0 [2024-08-06 06:25:16,860][52670] Sum rewards: 74.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.367', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO2': '0.063', 'weapon4': '0.144', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'AMMO4': '0.315', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:16,909][52795] DAMAGECOUNT value on done: 688490.0 [2024-08-06 06:25:16,909][52795] Sum rewards: 65.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.088', 'weapon5': '0.154', 'AMMO3': '0.220', 'AMMO4': '0.251', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.760', 'WEAPON3': '1.350', 'weapon3': '2.740', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:17,038][52669] DAMAGECOUNT value on done: 746636.0 [2024-08-06 06:25:17,040][52669] Sum rewards: 81.271, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO3': '0.168', 'AMMO4': '0.178', 'weapon5': '0.204', 'weapon2': '0.294', 'HEALTH': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:17,109][52664] DAMAGECOUNT value on done: 767160.0 [2024-08-06 06:25:17,112][52664] Sum rewards: 78.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.088', 'weapon5': '0.170', 'AMMO4': '0.180', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 562667520. Throughput: 0: 4374.7. Samples: 140664870. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:25:17,794][52567] Avg episode reward: [(0, '74.022')] [2024-08-06 06:25:18,123][52658] DAMAGECOUNT value on done: 761345.0 [2024-08-06 06:25:18,123][52658] Sum rewards: 78.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.634', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.113', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:18,768][52666] DAMAGECOUNT value on done: 735213.0 [2024-08-06 06:25:18,769][52666] Sum rewards: 67.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '57.000'} [2024-08-06 06:25:18,867][52820] DAMAGECOUNT value on done: 702205.0 [2024-08-06 06:25:18,869][52820] Sum rewards: 84.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.231', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.272', 'WEAPON3': '1.100', 'weapon3': '3.468', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:19,065][52663] DAMAGECOUNT value on done: 750401.0 [2024-08-06 06:25:19,065][52663] Sum rewards: 64.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.128', 'AMMO4': '0.146', 'AMMO3': '0.248', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.268', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:19,126][52803] DAMAGECOUNT value on done: 688273.0 [2024-08-06 06:25:19,128][52803] Sum rewards: 77.468, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.194', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.054', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.266', 'AMMO3': '0.267', 'WEAPON3': '1.700', 'weapon3': '3.396', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:19,582][52664] DAMAGECOUNT value on done: 760007.0 [2024-08-06 06:25:19,582][52664] Sum rewards: 75.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.386', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:20,026][52671] DAMAGECOUNT value on done: 739024.0 [2024-08-06 06:25:20,028][52671] Sum rewards: 63.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.637', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.052', 'AMMO4': '0.134', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.272', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '52.000'} [2024-08-06 06:25:20,031][52795] DAMAGECOUNT value on done: 679608.0 [2024-08-06 06:25:20,031][52795] Sum rewards: 71.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.070', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.512', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.214', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:20,050][52670] DAMAGECOUNT value on done: 737478.0 [2024-08-06 06:25:20,050][52670] Sum rewards: 68.277, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.279', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.118', 'weapon5': '0.194', 'AMMO4': '0.219', 'AMMO3': '0.246', 'weapon2': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '58.500'} [2024-08-06 06:25:20,325][52669] DAMAGECOUNT value on done: 745952.0 [2024-08-06 06:25:20,327][52669] Sum rewards: 76.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.116', 'weapon4': '0.126', 'AMMO4': '0.183', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:20,663][52650] Updated weights for policy 0, policy_version 68691 (0.0011) [2024-08-06 06:25:21,089][52658] DAMAGECOUNT value on done: 745284.0 [2024-08-06 06:25:21,097][52658] Sum rewards: 80.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.480', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.086', 'AMMO4': '0.160', 'weapon5': '0.192', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.039', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:21,289][52668] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:25:21,867][52663] DAMAGECOUNT value on done: 735098.0 [2024-08-06 06:25:21,868][52663] Sum rewards: 82.192, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.155', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.158', 'weapon2': '0.508', 'WEAPON3': '0.900', 'weapon3': '3.392', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:21,916][52666] DAMAGECOUNT value on done: 740339.0 [2024-08-06 06:25:21,916][52666] Sum rewards: 80.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.042', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.462', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:22,032][52803] DAMAGECOUNT value on done: 688388.0 [2024-08-06 06:25:22,032][52803] Sum rewards: 69.557, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.374', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO4': '0.160', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.664', 'WEAPON3': '0.950', 'weapon3': '2.972', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:22,067][52820] DAMAGECOUNT value on done: 700157.0 [2024-08-06 06:25:22,068][52820] Sum rewards: 69.978, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.917', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO3': '0.152', 'AMMO4': '0.156', 'weapon5': '0.216', 'weapon4': '0.264', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.010', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:22,234][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:25:22,640][52671] DAMAGECOUNT value on done: 749150.0 [2024-08-06 06:25:22,643][52671] Sum rewards: 73.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.086', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:22,786][52664] DAMAGECOUNT value on done: 775077.0 [2024-08-06 06:25:22,787][52664] Sum rewards: 74.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.625', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:22,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 562749440. Throughput: 0: 4379.5. Samples: 140691200. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 06:25:22,795][52567] Avg episode reward: [(0, '73.987')] [2024-08-06 06:25:22,919][52670] DAMAGECOUNT value on done: 731540.0 [2024-08-06 06:25:22,919][52670] Sum rewards: 76.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.086', 'AMMO4': '0.121', 'AMMO3': '0.226', 'weapon2': '0.226', 'weapon5': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:22,962][52669] DAMAGECOUNT value on done: 749219.0 [2024-08-06 06:25:22,963][52669] Sum rewards: 71.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.060', 'weapon5': '0.174', 'weapon2': '0.180', 'AMMO3': '0.213', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.402', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:23,203][52795] DAMAGECOUNT value on done: 688137.0 [2024-08-06 06:25:23,203][52795] Sum rewards: 82.735, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.142', 'weapon5': '0.208', 'AMMO4': '0.210', 'AMMO3': '0.250', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '71.000'} [2024-08-06 06:25:23,696][52658] DAMAGECOUNT value on done: 755938.0 [2024-08-06 06:25:23,698][52658] Sum rewards: 66.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.168', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.122', 'weapon5': '0.180', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:24,291][52666] DAMAGECOUNT value on done: 737870.0 [2024-08-06 06:25:24,293][52666] Sum rewards: 64.628, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.696', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.108', 'AMMO3': '0.196', 'AMMO4': '0.232', 'weapon5': '0.266', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '54.000'} [2024-08-06 06:25:24,956][52663] DAMAGECOUNT value on done: 730162.0 [2024-08-06 06:25:24,958][52663] Sum rewards: 87.270, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.038', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.316', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:25,147][52803] DAMAGECOUNT value on done: 702914.0 [2024-08-06 06:25:25,148][52803] Sum rewards: 82.274, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.222', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.089', 'weapon4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:25,323][52820] DAMAGECOUNT value on done: 684920.0 [2024-08-06 06:25:25,324][52820] Sum rewards: 73.741, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.566', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.094', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:25,378][52664] DAMAGECOUNT value on done: 767160.0 [2024-08-06 06:25:25,380][52664] Sum rewards: 70.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.942', 'AMMO5': '0.023', 'AMMO2': '0.070', 'weapon4': '0.220', 'weapon2': '0.250', 'AMMO3': '0.260', 'weapon5': '0.268', 'AMMO4': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:25,511][52650] Updated weights for policy 0, policy_version 68701 (0.0013) [2024-08-06 06:25:25,524][52670] DAMAGECOUNT value on done: 734747.0 [2024-08-06 06:25:25,525][52670] Sum rewards: 65.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.094', 'AMMO4': '0.154', 'weapon5': '0.180', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '53.000'} [2024-08-06 06:25:25,814][52671] DAMAGECOUNT value on done: 749414.0 [2024-08-06 06:25:25,816][52671] Sum rewards: 75.266, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.470', 'AMMO2': '0.018', 'AMMO5': '0.021', 'weapon4': '0.046', 'AMMO4': '0.089', 'weapon5': '0.138', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.316', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:26,039][52669] DAMAGECOUNT value on done: 756417.0 [2024-08-06 06:25:26,039][52669] Sum rewards: 78.753, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.333', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.052', 'weapon5': '0.178', 'AMMO3': '0.183', 'AMMO4': '0.218', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:26,364][52795] DAMAGECOUNT value on done: 694779.0 [2024-08-06 06:25:26,367][52795] Sum rewards: 71.844, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.168', 'AMMO3': '0.201', 'weapon4': '0.252', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.964', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.000'} [2024-08-06 06:25:26,553][52658] DAMAGECOUNT value on done: 740788.0 [2024-08-06 06:25:26,557][52658] Sum rewards: 72.708, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.140', 'weapon4': '0.174', 'AMMO3': '0.223', 'AMMO4': '0.236', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:27,093][52666] DAMAGECOUNT value on done: 732188.0 [2024-08-06 06:25:27,093][52666] Sum rewards: 70.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.042', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.044', 'AMMO4': '0.202', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon5': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.854', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '57.000'} [2024-08-06 06:25:27,795][52567] Fps is (10 sec: 16383.2, 60 sec: 17476.2, 300 sec: 17411.4). Total num frames: 562831360. Throughput: 0: 4379.5. Samples: 140717550. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:25:27,796][52567] Avg episode reward: [(0, '73.933')] [2024-08-06 06:25:27,939][52663] DAMAGECOUNT value on done: 737599.0 [2024-08-06 06:25:27,941][52663] Sum rewards: 66.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.084', 'weapon5': '0.176', 'AMMO3': '0.214', 'AMMO4': '0.316', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:28,184][52803] DAMAGECOUNT value on done: 693051.0 [2024-08-06 06:25:28,186][52803] Sum rewards: 76.922, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.332', 'AMMO5': '0.021', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon5': '0.254', 'weapon4': '0.312', 'weapon2': '0.426', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon3': '2.768', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:28,460][52664] DAMAGECOUNT value on done: 778656.0 [2024-08-06 06:25:28,460][52664] Sum rewards: 69.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.122', 'AMMO3': '0.239', 'AMMO4': '0.265', 'weapon2': '0.298', 'weapon5': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.012', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '58.000'} [2024-08-06 06:25:28,467][52670] DAMAGECOUNT value on done: 734957.0 [2024-08-06 06:25:28,467][52670] Sum rewards: 89.922, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.128', 'HEALTH': '0.143', 'AMMO3': '0.150', 'weapon5': '0.268', 'AMMO4': '0.272', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.850', 'weapon3': '3.012', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '70.000'} [2024-08-06 06:25:28,851][52671] DAMAGECOUNT value on done: 747089.0 [2024-08-06 06:25:28,852][52671] Sum rewards: 68.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.890', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.610', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 06:25:29,083][52669] DAMAGECOUNT value on done: 747650.0 [2024-08-06 06:25:29,086][52669] Sum rewards: 68.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.078', 'weapon5': '0.230', 'AMMO4': '0.261', 'AMMO3': '0.277', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'HITCOUNT': '2.900', 'weapon3': '2.956', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:29,548][52658] DAMAGECOUNT value on done: 751090.0 [2024-08-06 06:25:29,549][52658] Sum rewards: 81.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.108', 'weapon5': '0.140', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:29,933][52650] Updated weights for policy 0, policy_version 68711 (0.0026) [2024-08-06 06:25:30,248][52666] DAMAGECOUNT value on done: 742286.0 [2024-08-06 06:25:30,250][52666] Sum rewards: 89.216, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.075', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.116', 'weapon4': '0.166', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '71.000'} [2024-08-06 06:25:30,901][52663] DAMAGECOUNT value on done: 736617.0 [2024-08-06 06:25:30,903][52663] Sum rewards: 72.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.094', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:31,069][52659] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:25:31,285][52803] DAMAGECOUNT value on done: 694424.0 [2024-08-06 06:25:31,285][52803] Sum rewards: 83.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.466', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:31,501][52670] DAMAGECOUNT value on done: 728928.0 [2024-08-06 06:25:31,503][52670] Sum rewards: 67.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.466', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.056', 'AMMO4': '0.201', 'weapon5': '0.220', 'AMMO3': '0.258', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.130', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:31,588][52664] DAMAGECOUNT value on done: 776662.0 [2024-08-06 06:25:31,589][52664] Sum rewards: 59.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.200', 'AMMO3': '0.253', 'AMMO4': '0.272', 'weapon4': '0.300', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '51.000'} [2024-08-06 06:25:31,932][52669] DAMAGECOUNT value on done: 749015.0 [2024-08-06 06:25:31,933][52669] Sum rewards: 69.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.991', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.180', 'AMMO3': '0.236', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:32,021][52671] DAMAGECOUNT value on done: 754894.0 [2024-08-06 06:25:32,021][52671] Sum rewards: 69.500, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.942', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.136', 'AMMO4': '0.199', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:32,743][52658] DAMAGECOUNT value on done: 739987.0 [2024-08-06 06:25:32,744][52658] Sum rewards: 72.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.112', 'weapon5': '0.144', 'AMMO4': '0.186', 'AMMO3': '0.210', 'weapon2': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:32,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 562929664. Throughput: 0: 4375.1. Samples: 140730670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:25:32,794][52567] Avg episode reward: [(0, '73.784')] [2024-08-06 06:25:33,127][52666] DAMAGECOUNT value on done: 735058.0 [2024-08-06 06:25:33,127][52666] Sum rewards: 73.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:33,480][52663] DAMAGECOUNT value on done: 749940.0 [2024-08-06 06:25:33,480][52663] Sum rewards: 78.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.708', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.334', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:34,099][52670] DAMAGECOUNT value on done: 744308.0 [2024-08-06 06:25:34,101][52670] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.867', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.080', 'weapon5': '0.168', 'AMMO3': '0.190', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:34,319][52669] DAMAGECOUNT value on done: 754716.0 [2024-08-06 06:25:34,321][52669] Sum rewards: 67.832, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.434', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.032', 'weapon4': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon2': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'HITCOUNT': '3.450', 'weapon3': '3.586', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:34,356][52803] DAMAGECOUNT value on done: 705506.0 [2024-08-06 06:25:34,356][52803] Sum rewards: 86.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.915', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.168', 'AMMO4': '0.176', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '71.000'} [2024-08-06 06:25:34,672][52650] Updated weights for policy 0, policy_version 68721 (0.0020) [2024-08-06 06:25:34,756][52664] DAMAGECOUNT value on done: 776143.0 [2024-08-06 06:25:34,757][52664] Sum rewards: 74.146, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.395', 'AMMO5': '0.014', 'AMMO2': '0.064', 'AMMO3': '0.191', 'weapon2': '0.200', 'weapon5': '0.246', 'AMMO4': '0.321', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:35,161][52671] DAMAGECOUNT value on done: 748759.0 [2024-08-06 06:25:35,161][52671] Sum rewards: 63.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.132', 'AMMO4': '0.148', 'weapon2': '0.154', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.466', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '53.000'} [2024-08-06 06:25:35,325][52803] Large shaping reward 2.672 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', 0.05, 10.0), ('weapon5', 0.002)] [2024-08-06 06:25:35,641][52666] DAMAGECOUNT value on done: 743966.0 [2024-08-06 06:25:35,643][52666] Sum rewards: 62.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '52.000'} [2024-08-06 06:25:35,904][52658] DAMAGECOUNT value on done: 749984.0 [2024-08-06 06:25:35,906][52658] Sum rewards: 86.822, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.435', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.038', 'AMMO4': '0.067', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'weapon2': '0.694', 'WEAPON3': '1.000', 'weapon3': '3.028', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:36,184][52663] DAMAGECOUNT value on done: 741927.0 [2024-08-06 06:25:36,185][52663] Sum rewards: 59.636, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.224', 'AMMO3': '0.282', 'WEAPON3': '1.750', 'HITCOUNT': '3.160', 'weapon3': '3.460', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '54.000'} [2024-08-06 06:25:37,013][52670] DAMAGECOUNT value on done: 729835.0 [2024-08-06 06:25:37,021][52670] Sum rewards: 67.691, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.122', 'AMMO4': '0.148', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.256', 'AMMO3': '0.265', 'WEAPON3': '1.700', 'HITCOUNT': '3.070', 'weapon3': '3.204', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:37,284][52669] DAMAGECOUNT value on done: 739766.0 [2024-08-06 06:25:37,287][52669] Sum rewards: 75.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.329', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.210', 'AMMO3': '0.231', 'weapon4': '0.262', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:37,369][52803] DAMAGECOUNT value on done: 690238.0 [2024-08-06 06:25:37,371][52803] Sum rewards: 81.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon5': '0.110', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.344', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '66.000'} [2024-08-06 06:25:37,732][52664] DAMAGECOUNT value on done: 782839.0 [2024-08-06 06:25:37,733][52664] Sum rewards: 85.126, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.027', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.360', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '71.000'} [2024-08-06 06:25:37,794][52567] Fps is (10 sec: 18023.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 563011584. Throughput: 0: 4382.7. Samples: 140756920. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:25:37,794][52567] Avg episode reward: [(0, '74.062')] [2024-08-06 06:25:38,583][52666] DAMAGECOUNT value on done: 730234.0 [2024-08-06 06:25:38,583][52666] Sum rewards: 70.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.086', 'weapon4': '0.090', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.794', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:38,601][52671] DAMAGECOUNT value on done: 737240.0 [2024-08-06 06:25:38,603][52671] Sum rewards: 83.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO3': '0.185', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.274', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:38,692][52658] DAMAGECOUNT value on done: 732979.0 [2024-08-06 06:25:38,692][52658] Sum rewards: 63.794, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.884', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.124', 'weapon5': '0.208', 'AMMO3': '0.209', 'AMMO4': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.000'} [2024-08-06 06:25:38,929][52668] DAMAGECOUNT value on done: 744889.0 [2024-08-06 06:25:38,929][52668] Sum rewards: 91.683, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.839', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.154', 'AMMO3': '0.235', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '22.296', 'FRAGCOUNT': '76.000'} [2024-08-06 06:25:39,375][52663] DAMAGECOUNT value on done: 745839.0 [2024-08-06 06:25:39,375][52663] Sum rewards: 67.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.206', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.424', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:39,612][52650] Updated weights for policy 0, policy_version 68731 (0.0013) [2024-08-06 06:25:39,904][52670] DAMAGECOUNT value on done: 737985.0 [2024-08-06 06:25:39,905][52670] Sum rewards: 69.261, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.078', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.160', 'weapon2': '0.818', 'WEAPON3': '0.950', 'weapon3': '2.806', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:40,309][52664] DAMAGECOUNT value on done: 783442.0 [2024-08-06 06:25:40,310][52664] Sum rewards: 75.903, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.140', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.108', 'weapon4': '0.128', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:40,312][52670] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:25:40,447][52647] DAMAGECOUNT value on done: 790807.0 [2024-08-06 06:25:40,447][52647] Sum rewards: 75.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.435', 'AMMO5': '0.026', 'AMMO2': '0.071', 'weapon4': '0.142', 'AMMO3': '0.214', 'weapon5': '0.282', 'AMMO4': '0.356', 'weapon2': '0.404', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:40,503][52803] DAMAGECOUNT value on done: 693404.0 [2024-08-06 06:25:40,507][52803] Sum rewards: 66.292, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.156', 'AMMO3': '0.173', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '54.000'} [2024-08-06 06:25:40,582][52669] DAMAGECOUNT value on done: 741751.0 [2024-08-06 06:25:40,583][52669] Sum rewards: 74.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.191', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.226', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.416', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:41,413][52671] DAMAGECOUNT value on done: 754930.0 [2024-08-06 06:25:41,415][52671] Sum rewards: 74.697, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.329', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon5': '0.160', 'AMMO3': '0.200', 'AMMO4': '0.200', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:41,466][52668] DAMAGECOUNT value on done: 750414.0 [2024-08-06 06:25:41,466][52668] Sum rewards: 83.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.318', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.062', 'AMMO4': '0.103', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:41,535][52666] DAMAGECOUNT value on done: 743054.0 [2024-08-06 06:25:41,536][52666] Sum rewards: 73.393, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.080', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.260', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:41,730][52658] DAMAGECOUNT value on done: 750881.0 [2024-08-06 06:25:41,730][52658] Sum rewards: 84.256, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.083', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:42,597][52670] DAMAGECOUNT value on done: 745631.0 [2024-08-06 06:25:42,598][52670] Sum rewards: 63.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.535', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.132', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '53.000'} [2024-08-06 06:25:42,616][52663] DAMAGECOUNT value on done: 748580.0 [2024-08-06 06:25:42,616][52663] Sum rewards: 70.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.736', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.145', 'AMMO3': '0.248', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.360', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:42,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.6, 300 sec: 17411.4). Total num frames: 563093504. Throughput: 0: 4377.3. Samples: 140783100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:25:42,795][52567] Avg episode reward: [(0, '73.779')] [2024-08-06 06:25:43,633][52664] DAMAGECOUNT value on done: 778788.0 [2024-08-06 06:25:43,634][52664] Sum rewards: 83.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.532', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.170', 'AMMO3': '0.193', 'AMMO4': '0.205', 'weapon5': '0.246', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.842', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:43,637][52803] DAMAGECOUNT value on done: 696762.0 [2024-08-06 06:25:43,637][52803] Sum rewards: 79.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:43,683][52647] DAMAGECOUNT value on done: 780447.0 [2024-08-06 06:25:43,683][52647] Sum rewards: 59.379, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.231', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.110', 'weapon5': '0.134', 'AMMO4': '0.242', 'weapon2': '0.260', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '3.130', 'weapon3': '3.246', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '53.000'} [2024-08-06 06:25:43,699][52669] DAMAGECOUNT value on done: 747680.0 [2024-08-06 06:25:43,701][52669] Sum rewards: 88.213, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.965', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.022', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.142', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '72.000'} [2024-08-06 06:25:43,978][52650] Updated weights for policy 0, policy_version 68741 (0.0012) [2024-08-06 06:25:44,367][52668] DAMAGECOUNT value on done: 749299.0 [2024-08-06 06:25:44,369][52668] Sum rewards: 69.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.598', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.178', 'AMMO4': '0.227', 'AMMO3': '0.229', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.240', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '58.000'} [2024-08-06 06:25:44,380][52666] DAMAGECOUNT value on done: 737922.0 [2024-08-06 06:25:44,381][52666] Sum rewards: 91.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.080', 'weapon5': '0.138', 'AMMO3': '0.189', 'AMMO4': '0.219', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.327', 'FRAGCOUNT': '74.000'} [2024-08-06 06:25:44,466][52671] DAMAGECOUNT value on done: 752618.0 [2024-08-06 06:25:44,469][52671] Sum rewards: 84.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.086', 'weapon5': '0.136', 'AMMO3': '0.175', 'AMMO4': '0.239', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:44,603][52658] DAMAGECOUNT value on done: 742352.0 [2024-08-06 06:25:44,603][52658] Sum rewards: 78.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.617', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.065', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.474', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:45,411][52663] DAMAGECOUNT value on done: 737048.0 [2024-08-06 06:25:45,412][52663] Sum rewards: 80.306, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.093', 'weapon4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.558', 'WEAPON3': '1.650', 'weapon3': '2.972', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:45,734][52670] DAMAGECOUNT value on done: 738488.0 [2024-08-06 06:25:45,734][52670] Sum rewards: 62.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.022', 'AMMO2': '0.065', 'weapon4': '0.120', 'weapon5': '0.172', 'AMMO3': '0.224', 'weapon2': '0.270', 'AMMO4': '0.325', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.176', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '53.000'} [2024-08-06 06:25:46,526][52669] DAMAGECOUNT value on done: 765821.0 [2024-08-06 06:25:46,527][52669] Sum rewards: 69.091, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'weapon2': '0.370', 'WEAPON3': '1.000', 'HITCOUNT': '3.240', 'weapon3': '3.440', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '54.000'} [2024-08-06 06:25:46,684][52668] DAMAGECOUNT value on done: 752390.0 [2024-08-06 06:25:46,684][52668] Sum rewards: 79.025, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.145', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.230', 'weapon2': '0.560', 'WEAPON3': '0.850', 'weapon3': '3.086', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:46,829][52647] DAMAGECOUNT value on done: 785850.0 [2024-08-06 06:25:46,830][52647] Sum rewards: 75.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.645', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.160', 'AMMO3': '0.208', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:46,832][52803] DAMAGECOUNT value on done: 698615.0 [2024-08-06 06:25:46,832][52803] Sum rewards: 79.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.094', 'AMMO4': '0.180', 'AMMO3': '0.209', 'weapon5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:46,858][52664] DAMAGECOUNT value on done: 768870.0 [2024-08-06 06:25:46,859][52664] Sum rewards: 88.455, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO2': '-0.000', 'AMMO4': '0.000', 'AMMO5': '0.005', 'AMMO3': '0.276', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '3.394', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '76.000'} [2024-08-06 06:25:47,480][52658] DAMAGECOUNT value on done: 740672.0 [2024-08-06 06:25:47,482][52658] Sum rewards: 67.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.549', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.062', 'AMMO4': '0.085', 'weapon5': '0.140', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.206', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:47,667][52666] DAMAGECOUNT value on done: 737111.0 [2024-08-06 06:25:47,672][52666] Sum rewards: 72.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.248', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.468', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:47,711][52671] DAMAGECOUNT value on done: 749977.0 [2024-08-06 06:25:47,713][52671] Sum rewards: 69.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.138', 'AMMO4': '0.167', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 563183616. Throughput: 0: 4376.2. Samples: 140796130. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:25:47,794][52567] Avg episode reward: [(0, '74.579')] [2024-08-06 06:25:48,789][52670] DAMAGECOUNT value on done: 722176.0 [2024-08-06 06:25:48,789][52670] Sum rewards: 63.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.869', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon2': '0.168', 'weapon4': '0.200', 'weapon5': '0.206', 'AMMO3': '0.217', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.168', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '52.000'} [2024-08-06 06:25:48,941][52650] Updated weights for policy 0, policy_version 68751 (0.0014) [2024-08-06 06:25:49,596][52668] DAMAGECOUNT value on done: 738321.0 [2024-08-06 06:25:49,599][52668] Sum rewards: 89.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.988', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO4': '0.201', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '22.119', 'FRAGCOUNT': '72.000'} [2024-08-06 06:25:49,652][52662] DAMAGECOUNT value on done: 747551.0 [2024-08-06 06:25:49,653][52662] Sum rewards: 75.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.038', 'weapon4': '0.054', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.272', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.484', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:49,667][52669] DAMAGECOUNT value on done: 754977.0 [2024-08-06 06:25:49,667][52669] Sum rewards: 72.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.659', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.034', 'AMMO4': '0.078', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:49,853][52647] DAMAGECOUNT value on done: 785746.0 [2024-08-06 06:25:49,853][52647] Sum rewards: 69.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.437', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.126', 'AMMO3': '0.163', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:49,891][52803] DAMAGECOUNT value on done: 702256.0 [2024-08-06 06:25:49,894][52803] Sum rewards: 74.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.976', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO4': '0.216', 'weapon5': '0.226', 'AMMO3': '0.229', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:49,920][52664] DAMAGECOUNT value on done: 770610.0 [2024-08-06 06:25:49,920][52664] Sum rewards: 85.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.954', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.034', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon5': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.129', 'FRAGCOUNT': '69.000'} [2024-08-06 06:25:50,261][52666] DAMAGECOUNT value on done: 732803.0 [2024-08-06 06:25:50,263][52666] Sum rewards: 68.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.794', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.048', 'weapon5': '0.060', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '57.000'} [2024-08-06 06:25:50,313][52658] DAMAGECOUNT value on done: 747941.0 [2024-08-06 06:25:50,313][52658] Sum rewards: 80.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.904', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO3': '0.277', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.378', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '68.000'} [2024-08-06 06:25:50,367][52671] DAMAGECOUNT value on done: 754081.0 [2024-08-06 06:25:50,369][52671] Sum rewards: 88.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.320', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.068', 'weapon5': '0.118', 'AMMO4': '0.233', 'AMMO3': '0.245', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '74.000'} [2024-08-06 06:25:51,211][52670] DAMAGECOUNT value on done: 734320.0 [2024-08-06 06:25:51,213][52670] Sum rewards: 83.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.872', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.050', 'weapon4': '0.118', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '71.000'} [2024-08-06 06:25:51,635][52670] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:25:52,699][52647] DAMAGECOUNT value on done: 791402.0 [2024-08-06 06:25:52,699][52647] Sum rewards: 76.284, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.156', 'weapon2': '0.164', 'weapon4': '0.246', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '66.000'} [2024-08-06 06:25:52,759][52671] DAMAGECOUNT value on done: 744303.0 [2024-08-06 06:25:52,759][52671] Sum rewards: 52.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.798', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon4': '0.166', 'AMMO3': '0.222', 'weapon2': '0.242', 'weapon5': '0.264', 'AMMO4': '0.314', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.530', 'weapon3': '3.012', 'DAMAGECOUNT': '14.238', 'FRAGCOUNT': '47.000'} [2024-08-06 06:25:52,768][52664] DAMAGECOUNT value on done: 771888.0 [2024-08-06 06:25:52,770][52664] Sum rewards: 75.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.040', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.068', 'weapon5': '0.178', 'AMMO3': '0.241', 'weapon2': '0.280', 'AMMO4': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:52,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 563273728. Throughput: 0: 4372.0. Samples: 140822120. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:25:52,795][52567] Avg episode reward: [(0, '75.019')] [2024-08-06 06:25:52,844][52669] DAMAGECOUNT value on done: 749473.0 [2024-08-06 06:25:52,846][52669] Sum rewards: 72.871, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.176', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.348', 'WEAPON3': '1.950', 'weapon3': '3.348', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '65.000'} [2024-08-06 06:25:52,945][52668] DAMAGECOUNT value on done: 750536.0 [2024-08-06 06:25:52,946][52668] Sum rewards: 69.044, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.503', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.126', 'AMMO3': '0.165', 'weapon5': '0.178', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.954', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:52,947][52662] DAMAGECOUNT value on done: 753665.0 [2024-08-06 06:25:52,948][52662] Sum rewards: 83.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.727', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.040', 'weapon5': '0.058', 'weapon2': '0.160', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON3': '1.450', 'weapon3': '3.610', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:52,954][52666] DAMAGECOUNT value on done: 735947.0 [2024-08-06 06:25:52,954][52666] Sum rewards: 72.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.848', 'AMMO5': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.215', 'weapon5': '0.292', 'weapon4': '0.298', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '60.000'} [2024-08-06 06:25:52,996][52803] DAMAGECOUNT value on done: 696221.0 [2024-08-06 06:25:52,996][52803] Sum rewards: 62.777, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.056', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.100', 'AMMO4': '0.207', 'weapon5': '0.236', 'AMMO3': '0.285', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.070', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '54.500'} [2024-08-06 06:25:53,535][52650] Updated weights for policy 0, policy_version 68761 (0.0011) [2024-08-06 06:25:54,301][52670] DAMAGECOUNT value on done: 742794.0 [2024-08-06 06:25:54,302][52670] Sum rewards: 72.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.402', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:55,186][52647] DAMAGECOUNT value on done: 792142.0 [2024-08-06 06:25:55,186][52647] Sum rewards: 83.557, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.156', 'AMMO4': '0.183', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '3.036', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '71.000'} [2024-08-06 06:25:55,238][52664] DAMAGECOUNT value on done: 770709.0 [2024-08-06 06:25:55,239][52664] Sum rewards: 77.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.137', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.163', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '3.210', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:55,530][52662] DAMAGECOUNT value on done: 755567.0 [2024-08-06 06:25:55,530][52662] Sum rewards: 71.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.229', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.102', 'AMMO3': '0.210', 'AMMO4': '0.226', 'weapon5': '0.290', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '58.500'} [2024-08-06 06:25:55,818][52668] DAMAGECOUNT value on done: 750179.0 [2024-08-06 06:25:55,819][52668] Sum rewards: 65.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.218', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '55.000'} [2024-08-06 06:25:55,961][52666] DAMAGECOUNT value on done: 750440.0 [2024-08-06 06:25:55,962][52666] Sum rewards: 72.249, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.390', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.136', 'weapon5': '0.238', 'AMMO4': '0.267', 'AMMO3': '0.303', 'weapon2': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.964', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '61.000'} [2024-08-06 06:25:55,979][52669] DAMAGECOUNT value on done: 752420.0 [2024-08-06 06:25:55,979][52669] Sum rewards: 75.205, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.114', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.082', 'weapon4': '0.144', 'AMMO3': '0.209', 'AMMO4': '0.216', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '63.000'} [2024-08-06 06:25:56,929][52670] DAMAGECOUNT value on done: 737776.0 [2024-08-06 06:25:56,929][52670] Sum rewards: 74.275, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.390', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.088', 'weapon5': '0.108', 'weapon2': '0.222', 'AMMO3': '0.245', 'AMMO4': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.348', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 06:25:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 563355648. Throughput: 0: 4368.0. Samples: 140848380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:25:57,794][52567] Avg episode reward: [(0, '74.698')] [2024-08-06 06:25:57,944][52647] DAMAGECOUNT value on done: 792317.0 [2024-08-06 06:25:57,944][52647] Sum rewards: 82.483, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.707', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '67.000'} [2024-08-06 06:25:58,160][52662] DAMAGECOUNT value on done: 738236.0 [2024-08-06 06:25:58,160][52662] Sum rewards: 73.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.814', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO4': '0.137', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '59.000'} [2024-08-06 06:25:58,275][52650] Updated weights for policy 0, policy_version 68771 (0.0011) [2024-08-06 06:25:58,694][52666] DAMAGECOUNT value on done: 724491.0 [2024-08-06 06:25:58,695][52666] Sum rewards: 71.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO3': '0.173', 'AMMO4': '0.176', 'weapon4': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.642', 'WEAPON3': '1.150', 'weapon3': '2.746', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '58.000'} [2024-08-06 06:25:58,858][52669] DAMAGECOUNT value on done: 755372.0 [2024-08-06 06:25:58,860][52669] Sum rewards: 71.326, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.832', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.068', 'AMMO3': '0.175', 'weapon5': '0.186', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '56.000'} [2024-08-06 06:25:59,138][52668] DAMAGECOUNT value on done: 743220.0 [2024-08-06 06:25:59,141][52668] Sum rewards: 76.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.923', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.086', 'AMMO3': '0.181', 'weapon5': '0.218', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '62.000'} [2024-08-06 06:25:59,824][52670] DAMAGECOUNT value on done: 741517.0 [2024-08-06 06:25:59,825][52670] Sum rewards: 74.918, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.745', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.094', 'AMMO4': '0.150', 'weapon2': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.348', 'WEAPON3': '2.050', 'weapon3': '3.258', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '69.000'} [2024-08-06 06:26:01,060][52647] DAMAGECOUNT value on done: 772532.0 [2024-08-06 06:26:01,061][52647] Sum rewards: 78.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.822', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.145', 'weapon5': '0.206', 'weapon4': '0.248', 'AMMO4': '0.323', 'weapon2': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.862', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '61.000'} [2024-08-06 06:26:01,186][52666] DAMAGECOUNT value on done: 736881.0 [2024-08-06 06:26:01,187][52666] Sum rewards: 68.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.387', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.162', 'weapon4': '0.174', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '57.000'} [2024-08-06 06:26:01,218][52662] DAMAGECOUNT value on done: 756686.0 [2024-08-06 06:26:01,219][52662] Sum rewards: 72.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.294', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.128', 'AMMO3': '0.183', 'AMMO4': '0.227', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '59.000'} [2024-08-06 06:26:02,029][52668] DAMAGECOUNT value on done: 741061.0 [2024-08-06 06:26:02,030][52668] Sum rewards: 65.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.098', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.114', 'AMMO3': '0.155', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.240', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '51.500'} [2024-08-06 06:26:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 563445760. Throughput: 0: 4365.1. Samples: 140861300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:26:02,795][52567] Avg episode reward: [(0, '74.557')] [2024-08-06 06:26:03,271][52650] Updated weights for policy 0, policy_version 68781 (0.0015) [2024-08-06 06:26:03,280][52663] Large shaping reward 2.549 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.519, 173.0)] [2024-08-06 06:26:03,883][52662] DAMAGECOUNT value on done: 738798.0 [2024-08-06 06:26:03,885][52662] Sum rewards: 73.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.192', 'weapon5': '0.214', 'weapon4': '0.276', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '59.000'} [2024-08-06 06:26:04,175][52647] DAMAGECOUNT value on done: 787544.0 [2024-08-06 06:26:04,178][52647] Sum rewards: 77.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.804', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.092', 'weapon5': '0.218', 'AMMO3': '0.223', 'AMMO4': '0.228', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '63.000'} [2024-08-06 06:26:04,258][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:26:05,170][52668] DAMAGECOUNT value on done: 749590.0 [2024-08-06 06:26:05,172][52668] Sum rewards: 72.849, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.454', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.092', 'AMMO3': '0.248', 'weapon5': '0.268', 'AMMO4': '0.282', 'weapon2': '0.396', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '61.000'} [2024-08-06 06:26:06,933][52662] DAMAGECOUNT value on done: 747656.0 [2024-08-06 06:26:06,934][52662] Sum rewards: 78.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.198', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.144', 'weapon2': '0.196', 'AMMO4': '0.198', 'AMMO3': '0.253', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '67.000'} [2024-08-06 06:26:07,404][52650] Updated weights for policy 0, policy_version 68791 (0.0018) [2024-08-06 06:26:07,406][52647] DAMAGECOUNT value on done: 785549.0 [2024-08-06 06:26:07,406][52647] Sum rewards: 70.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '58.000'} [2024-08-06 06:26:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 563535872. Throughput: 0: 4361.8. Samples: 140887480. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:26:07,794][52567] Avg episode reward: [(0, '74.563')] [2024-08-06 06:26:08,041][52668] DAMAGECOUNT value on done: 745173.0 [2024-08-06 06:26:08,041][52668] Sum rewards: 76.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.226', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon5': '0.062', 'AMMO4': '0.077', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.304', 'WEAPON3': '0.950', 'HITCOUNT': '3.310', 'weapon3': '3.376', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:09,566][52662] DAMAGECOUNT value on done: 760064.0 [2024-08-06 06:26:09,567][52662] Sum rewards: 74.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.081', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '63.000'} [2024-08-06 06:26:10,477][52647] DAMAGECOUNT value on done: 782945.0 [2024-08-06 06:26:10,480][52647] Sum rewards: 73.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.373', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.088', 'AMMO4': '0.154', 'weapon5': '0.194', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '2.854', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:11,052][52668] DAMAGECOUNT value on done: 738134.0 [2024-08-06 06:26:11,052][52668] Sum rewards: 69.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.785', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.087', 'weapon4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '58.000'} [2024-08-06 06:26:12,370][52650] Updated weights for policy 0, policy_version 68801 (0.0031) [2024-08-06 06:26:12,526][52662] DAMAGECOUNT value on done: 747424.0 [2024-08-06 06:26:12,527][52662] Sum rewards: 72.931, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.195', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.100', 'AMMO4': '0.129', 'weapon5': '0.136', 'AMMO3': '0.156', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.262', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '58.000'} [2024-08-06 06:26:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 563617792. Throughput: 0: 4359.6. Samples: 140913730. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:12,794][52567] Avg episode reward: [(0, '74.262')] [2024-08-06 06:26:13,231][52647] DAMAGECOUNT value on done: 776385.0 [2024-08-06 06:26:13,233][52647] Sum rewards: 65.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.130', 'AMMO4': '0.158', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.112', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '52.000'} [2024-08-06 06:26:14,149][52668] DAMAGECOUNT value on done: 733104.0 [2024-08-06 06:26:14,150][52668] Sum rewards: 78.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.150', 'weapon2': '0.172', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '64.000'} [2024-08-06 06:26:15,246][52662] DAMAGECOUNT value on done: 755460.0 [2024-08-06 06:26:15,247][52662] Sum rewards: 83.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.540', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '69.000'} [2024-08-06 06:26:15,847][52647] DAMAGECOUNT value on done: 792211.0 [2024-08-06 06:26:15,848][52647] Sum rewards: 72.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.124', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '60.000'} [2024-08-06 06:26:16,902][52650] Updated weights for policy 0, policy_version 68811 (0.0012) [2024-08-06 06:26:17,157][52668] DAMAGECOUNT value on done: 732916.0 [2024-08-06 06:26:17,159][52668] Sum rewards: 74.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.674', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.098', 'weapon2': '0.166', 'weapon4': '0.180', 'AMMO4': '0.181', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.302', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 563707904. Throughput: 0: 4358.4. Samples: 140926800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:17,794][52567] Avg episode reward: [(0, '74.639')] [2024-08-06 06:26:17,814][52662] DAMAGECOUNT value on done: 742976.0 [2024-08-06 06:26:17,816][52662] Sum rewards: 63.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.100', 'AMMO3': '0.159', 'weapon4': '0.172', 'AMMO4': '0.197', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '3.262', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '52.000'} [2024-08-06 06:26:17,940][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:26:18,317][52660] DAMAGECOUNT value on done: 745190.0 [2024-08-06 06:26:18,319][52660] Sum rewards: 67.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.094', 'AMMO4': '0.182', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.146', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.500'} [2024-08-06 06:26:18,811][52647] DAMAGECOUNT value on done: 776268.0 [2024-08-06 06:26:18,812][52647] Sum rewards: 69.522, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.594', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.044', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.256', 'AMMO3': '0.326', 'WEAPON3': '2.000', 'weapon3': '3.428', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:19,978][52668] DAMAGECOUNT value on done: 733385.0 [2024-08-06 06:26:19,981][52668] Sum rewards: 79.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.131', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.150', 'weapon5': '0.182', 'AMMO4': '0.220', 'AMMO3': '0.234', 'weapon2': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '66.000'} [2024-08-06 06:26:20,891][52662] DAMAGECOUNT value on done: 746025.0 [2024-08-06 06:26:20,893][52662] Sum rewards: 91.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.736', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.158', 'AMMO3': '0.260', 'WEAPON3': '1.700', 'weapon3': '3.570', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '22.335', 'FRAGCOUNT': '77.000'} [2024-08-06 06:26:21,293][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:26:21,353][52647] DAMAGECOUNT value on done: 787353.0 [2024-08-06 06:26:21,354][52647] Sum rewards: 63.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.184', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.052', 'AMMO4': '0.080', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '54.000'} [2024-08-06 06:26:21,377][52660] DAMAGECOUNT value on done: 736217.0 [2024-08-06 06:26:21,379][52660] Sum rewards: 74.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO3': '0.201', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '61.000'} [2024-08-06 06:26:21,720][52650] Updated weights for policy 0, policy_version 68821 (0.0027) [2024-08-06 06:26:22,748][52668] DAMAGECOUNT value on done: 744663.0 [2024-08-06 06:26:22,748][52668] Sum rewards: 61.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.124', 'weapon5': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.118', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '52.000'} [2024-08-06 06:26:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 563798016. Throughput: 0: 4361.1. Samples: 140953170. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:22,794][52567] Avg episode reward: [(0, '74.483')] [2024-08-06 06:26:23,727][52662] DAMAGECOUNT value on done: 739154.0 [2024-08-06 06:26:23,730][52662] Sum rewards: 67.942, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.248', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO3': '0.137', 'weapon5': '0.148', 'AMMO4': '0.148', 'weapon2': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.638', 'WEAPON3': '0.850', 'weapon3': '2.790', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '51.500'} [2024-08-06 06:26:23,831][52660] DAMAGECOUNT value on done: 747255.0 [2024-08-06 06:26:23,831][52660] Sum rewards: 61.256, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.530', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.098', 'weapon4': '0.116', 'AMMO4': '0.165', 'AMMO3': '0.179', 'weapon2': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.400', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '51.000'} [2024-08-06 06:26:24,474][52647] DAMAGECOUNT value on done: 788523.0 [2024-08-06 06:26:24,475][52647] Sum rewards: 75.108, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.489', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.048', 'AMMO3': '0.150', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO4': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.000', 'HITCOUNT': '3.120', 'weapon3': '3.292', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '59.000'} [2024-08-06 06:26:25,596][52668] DAMAGECOUNT value on done: 745201.0 [2024-08-06 06:26:25,598][52668] Sum rewards: 75.789, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.295', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon2': '0.232', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'weapon3': '3.576', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '64.000'} [2024-08-06 06:26:26,512][52650] Updated weights for policy 0, policy_version 68831 (0.0011) [2024-08-06 06:26:26,770][52662] DAMAGECOUNT value on done: 752242.0 [2024-08-06 06:26:26,771][52662] Sum rewards: 75.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.835', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon4': '0.070', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'AMMO4': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '61.000'} [2024-08-06 06:26:27,005][52660] DAMAGECOUNT value on done: 756633.0 [2024-08-06 06:26:27,005][52660] Sum rewards: 61.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.528', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.082', 'weapon5': '0.166', 'AMMO4': '0.184', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'HITCOUNT': '3.020', 'weapon3': '3.022', 'DAMAGECOUNT': '15.129', 'FRAGCOUNT': '52.000'} [2024-08-06 06:26:27,324][52647] DAMAGECOUNT value on done: 776523.0 [2024-08-06 06:26:27,324][52647] Sum rewards: 77.842, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.774', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.104', 'AMMO4': '0.171', 'weapon5': '0.204', 'AMMO3': '0.229', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '64.000'} [2024-08-06 06:26:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 563879936. Throughput: 0: 4361.1. Samples: 140979350. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:27,795][52567] Avg episode reward: [(0, '74.165')] [2024-08-06 06:26:27,858][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068834_563888128.pth... [2024-08-06 06:26:28,004][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068322_559693824.pth [2024-08-06 06:26:28,811][52668] DAMAGECOUNT value on done: 742968.0 [2024-08-06 06:26:28,811][52668] Sum rewards: 72.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.576', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.122', 'weapon2': '0.188', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.466', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 06:26:30,110][52662] DAMAGECOUNT value on done: 739372.0 [2024-08-06 06:26:30,112][52662] Sum rewards: 65.548, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.483', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.122', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'weapon2': '0.894', 'weapon3': '2.790', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '50.000'} [2024-08-06 06:26:30,141][52660] DAMAGECOUNT value on done: 741297.0 [2024-08-06 06:26:30,141][52660] Sum rewards: 80.142, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.526', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO3': '0.182', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '63.000'} [2024-08-06 06:26:30,385][52647] DAMAGECOUNT value on done: 781883.0 [2024-08-06 06:26:30,386][52647] Sum rewards: 71.167, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.025', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.212', 'weapon2': '0.226', 'AMMO3': '0.291', 'weapon5': '0.292', 'AMMO4': '0.327', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.888', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '63.000'} [2024-08-06 06:26:31,161][52650] Updated weights for policy 0, policy_version 68841 (0.0023) [2024-08-06 06:26:31,936][52668] DAMAGECOUNT value on done: 748571.0 [2024-08-06 06:26:31,938][52668] Sum rewards: 63.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.870', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.118', 'weapon5': '0.152', 'AMMO3': '0.247', 'AMMO4': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '53.000'} [2024-08-06 06:26:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 563970048. Throughput: 0: 4353.8. Samples: 140992050. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:32,794][52567] Avg episode reward: [(0, '73.938')] [2024-08-06 06:26:33,080][52662] DAMAGECOUNT value on done: 754861.0 [2024-08-06 06:26:33,089][52662] Sum rewards: 75.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.072', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon4': '0.318', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '63.000'} [2024-08-06 06:26:33,102][52660] DAMAGECOUNT value on done: 734959.0 [2024-08-06 06:26:33,102][52660] Sum rewards: 63.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.494', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.149', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.328', 'weapon2': '0.858', 'WEAPON3': '1.200', 'weapon3': '2.466', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '52.000'} [2024-08-06 06:26:33,451][52647] DAMAGECOUNT value on done: 772012.0 [2024-08-06 06:26:33,452][52647] Sum rewards: 81.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon4': '0.046', 'weapon5': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '68.000'} [2024-08-06 06:26:34,688][52668] DAMAGECOUNT value on done: 750155.0 [2024-08-06 06:26:34,689][52668] Sum rewards: 90.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.456', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.053', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.273', 'FRAGCOUNT': '75.000'} [2024-08-06 06:26:35,396][52667] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:26:35,744][52660] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:26:35,830][52660] DAMAGECOUNT value on done: 744536.0 [2024-08-06 06:26:35,830][52660] Sum rewards: 79.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.084', 'AMMO4': '0.174', 'AMMO3': '0.187', 'weapon5': '0.208', 'weapon2': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '66.500'} [2024-08-06 06:26:35,876][52662] DAMAGECOUNT value on done: 750634.0 [2024-08-06 06:26:35,877][52662] Sum rewards: 60.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.080', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.318', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '3.350', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '52.000'} [2024-08-06 06:26:35,962][52650] Updated weights for policy 0, policy_version 68851 (0.0013) [2024-08-06 06:26:36,633][52647] DAMAGECOUNT value on done: 777734.0 [2024-08-06 06:26:36,633][52647] Sum rewards: 86.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.804', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.154', 'AMMO4': '0.167', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.036', 'FRAGCOUNT': '72.500'} [2024-08-06 06:26:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 564060160. Throughput: 0: 4361.1. Samples: 141018370. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:37,794][52567] Avg episode reward: [(0, '74.084')] [2024-08-06 06:26:38,087][52649] DAMAGECOUNT value on done: 723943.0 [2024-08-06 06:26:38,096][52649] Sum rewards: 74.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.167', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.164', 'weapon4': '0.196', 'AMMO3': '0.217', 'AMMO4': '0.235', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '61.000'} [2024-08-06 06:26:38,523][52662] DAMAGECOUNT value on done: 736986.0 [2024-08-06 06:26:38,526][52662] Sum rewards: 70.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.318', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.236', 'weapon4': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.168', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.582', 'FRAGCOUNT': '57.000'} [2024-08-06 06:26:38,766][52660] DAMAGECOUNT value on done: 752609.0 [2024-08-06 06:26:38,766][52660] Sum rewards: 72.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.646', 'AMMO5': '0.024', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.180', 'AMMO4': '0.208', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '60.000'} [2024-08-06 06:26:40,324][52650] Updated weights for policy 0, policy_version 68861 (0.0013) [2024-08-06 06:26:40,885][52649] DAMAGECOUNT value on done: 715275.0 [2024-08-06 06:26:40,887][52649] Sum rewards: 69.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.135', 'weapon5': '0.144', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '56.500'} [2024-08-06 06:26:41,529][52662] DAMAGECOUNT value on done: 746368.0 [2024-08-06 06:26:41,529][52662] Sum rewards: 70.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.034', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.704', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '57.000'} [2024-08-06 06:26:41,632][52660] DAMAGECOUNT value on done: 737772.0 [2024-08-06 06:26:41,634][52660] Sum rewards: 73.886, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.017', 'AMMO2': '0.044', 'AMMO3': '0.186', 'weapon4': '0.188', 'weapon5': '0.218', 'AMMO4': '0.219', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '58.000'} [2024-08-06 06:26:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 564142080. Throughput: 0: 4356.2. Samples: 141044410. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:42,794][52567] Avg episode reward: [(0, '74.002')] [2024-08-06 06:26:43,213][52659] DAMAGECOUNT value on done: 749032.0 [2024-08-06 06:26:43,221][52659] Sum rewards: 70.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.995', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.178', 'weapon4': '0.198', 'AMMO4': '0.233', 'AMMO3': '0.272', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.032', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:43,898][52649] DAMAGECOUNT value on done: 736156.0 [2024-08-06 06:26:43,899][52649] Sum rewards: 73.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.208', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.224', 'AMMO3': '0.257', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:44,483][52660] DAMAGECOUNT value on done: 739551.0 [2024-08-06 06:26:44,485][52660] Sum rewards: 68.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.072', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.094', 'AMMO4': '0.117', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '57.000'} [2024-08-06 06:26:44,602][52662] DAMAGECOUNT value on done: 737516.0 [2024-08-06 06:26:44,602][52662] Sum rewards: 85.813, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.836', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.094', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '71.000'} [2024-08-06 06:26:45,133][52650] Updated weights for policy 0, policy_version 68871 (0.0012) [2024-08-06 06:26:45,584][52659] DAMAGECOUNT value on done: 747617.0 [2024-08-06 06:26:45,584][52659] Sum rewards: 78.105, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.452', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.152', 'weapon5': '0.294', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.746', 'WEAPON3': '1.100', 'weapon3': '2.378', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:47,317][52649] DAMAGECOUNT value on done: 729247.0 [2024-08-06 06:26:47,317][52649] Sum rewards: 80.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.084', 'AMMO4': '0.143', 'weapon5': '0.198', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '67.000'} [2024-08-06 06:26:47,639][52660] DAMAGECOUNT value on done: 745766.0 [2024-08-06 06:26:47,640][52660] Sum rewards: 68.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.188', 'weapon4': '0.208', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '58.000'} [2024-08-06 06:26:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 564240384. Throughput: 0: 4365.6. Samples: 141057750. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 06:26:47,794][52567] Avg episode reward: [(0, '73.715')] [2024-08-06 06:26:48,342][52659] DAMAGECOUNT value on done: 750134.0 [2024-08-06 06:26:48,343][52659] Sum rewards: 82.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.380', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '68.000'} [2024-08-06 06:26:49,897][52650] Updated weights for policy 0, policy_version 68881 (0.0010) [2024-08-06 06:26:49,998][52649] DAMAGECOUNT value on done: 718880.0 [2024-08-06 06:26:50,000][52649] Sum rewards: 77.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.215', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.203', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.466', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '64.000'} [2024-08-06 06:26:50,775][52660] DAMAGECOUNT value on done: 736636.0 [2024-08-06 06:26:50,775][52660] Sum rewards: 61.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.097', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.138', 'weapon5': '0.148', 'AMMO4': '0.224', 'AMMO3': '0.265', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '3.020', 'weapon3': '3.076', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '55.000'} [2024-08-06 06:26:51,457][52659] DAMAGECOUNT value on done: 749605.0 [2024-08-06 06:26:51,459][52659] Sum rewards: 65.022, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.130', 'AMMO4': '0.206', 'AMMO3': '0.211', 'weapon5': '0.228', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '54.500'} [2024-08-06 06:26:52,788][52649] DAMAGECOUNT value on done: 734746.0 [2024-08-06 06:26:52,791][52649] Sum rewards: 78.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.012', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.028', 'weapon5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.358', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '67.000'} [2024-08-06 06:26:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 564314112. Throughput: 0: 4368.7. Samples: 141084070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:26:52,794][52567] Avg episode reward: [(0, '73.546')] [2024-08-06 06:26:53,611][52660] DAMAGECOUNT value on done: 745416.0 [2024-08-06 06:26:53,619][52660] Sum rewards: 67.206, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.098', 'HEALTH': '0.132', 'weapon5': '0.144', 'AMMO4': '0.146', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '0.900', 'weapon3': '3.180', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '52.000'} [2024-08-06 06:26:54,089][52659] DAMAGECOUNT value on done: 747295.0 [2024-08-06 06:26:54,091][52659] Sum rewards: 75.557, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.566', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.036', 'weapon4': '0.064', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.374', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '65.000'} [2024-08-06 06:26:54,795][52650] Updated weights for policy 0, policy_version 68891 (0.0018) [2024-08-06 06:26:55,324][52649] DAMAGECOUNT value on done: 729262.0 [2024-08-06 06:26:55,326][52649] Sum rewards: 81.852, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.211', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'weapon5': '0.002', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.516', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '66.000'} [2024-08-06 06:26:56,019][52614] Signal inference workers to stop experience collection... (12550 times) [2024-08-06 06:26:56,020][52614] Signal inference workers to resume experience collection... (12550 times) [2024-08-06 06:26:56,100][52650] InferenceWorker_p0-w0: stopping experience collection (12550 times) [2024-08-06 06:26:56,101][52650] InferenceWorker_p0-w0: resuming experience collection (12550 times) [2024-08-06 06:26:56,664][52660] DAMAGECOUNT value on done: 753730.0 [2024-08-06 06:26:56,664][52660] Sum rewards: 65.069, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.072', 'AMMO4': '0.202', 'AMMO3': '0.204', 'weapon5': '0.204', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.780', 'WEAPON3': '1.300', 'weapon3': '2.720', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '53.000'} [2024-08-06 06:26:56,782][52659] DAMAGECOUNT value on done: 748946.0 [2024-08-06 06:26:56,782][52659] Sum rewards: 75.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.368', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.066', 'weapon4': '0.068', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.230', 'WEAPON3': '1.200', 'weapon3': '3.468', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '62.000'} [2024-08-06 06:26:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 564404224. Throughput: 0: 4363.8. Samples: 141110100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:26:57,794][52567] Avg episode reward: [(0, '73.482')] [2024-08-06 06:26:58,293][52649] DAMAGECOUNT value on done: 731031.0 [2024-08-06 06:26:58,297][52649] Sum rewards: 76.550, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.752', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.050', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO3': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.488', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '66.000'} [2024-08-06 06:26:59,250][52650] Updated weights for policy 0, policy_version 68901 (0.0012) [2024-08-06 06:26:59,504][52660] DAMAGECOUNT value on done: 762787.0 [2024-08-06 06:26:59,504][52660] Sum rewards: 68.989, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.679', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.144', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '57.000'} [2024-08-06 06:26:59,955][52659] DAMAGECOUNT value on done: 748610.0 [2024-08-06 06:26:59,955][52659] Sum rewards: 75.627, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.630', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.078', 'weapon4': '0.120', 'AMMO4': '0.275', 'AMMO3': '0.285', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.598', 'WEAPON3': '1.550', 'weapon3': '2.880', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '67.000'} [2024-08-06 06:27:00,168][52667] DAMAGECOUNT value on done: 746550.0 [2024-08-06 06:27:00,168][52667] Sum rewards: 76.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO4': '0.186', 'AMMO3': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.270', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '65.500'} [2024-08-06 06:27:01,431][52649] DAMAGECOUNT value on done: 731135.0 [2024-08-06 06:27:01,433][52649] Sum rewards: 70.016, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.583', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.078', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.614', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:02,435][52660] DAMAGECOUNT value on done: 741058.0 [2024-08-06 06:27:02,436][52660] Sum rewards: 69.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.354', 'AMMO5': '0.033', 'AMMO2': '0.079', 'weapon4': '0.112', 'weapon5': '0.220', 'weapon2': '0.266', 'AMMO3': '0.277', 'AMMO4': '0.396', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.600', 'weapon3': '3.010', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '59.000'} [2024-08-06 06:27:02,794][52567] Fps is (10 sec: 18841.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 564502528. Throughput: 0: 4366.9. Samples: 141123310. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:27:02,795][52567] Avg episode reward: [(0, '73.393')] [2024-08-06 06:27:02,878][52667] DAMAGECOUNT value on done: 752610.0 [2024-08-06 06:27:02,879][52667] Sum rewards: 79.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.120', 'weapon5': '0.218', 'AMMO4': '0.218', 'AMMO3': '0.220', 'weapon2': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '65.000'} [2024-08-06 06:27:03,067][52659] DAMAGECOUNT value on done: 744945.0 [2024-08-06 06:27:03,068][52659] Sum rewards: 75.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.766', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.172', 'AMMO4': '0.180', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.200', 'weapon3': '3.336', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:04,034][52649] DAMAGECOUNT value on done: 723662.0 [2024-08-06 06:27:04,036][52649] Sum rewards: 82.250, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.006', 'weapon4': '0.022', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '68.000'} [2024-08-06 06:27:04,234][52650] Updated weights for policy 0, policy_version 68911 (0.0013) [2024-08-06 06:27:05,064][52660] DAMAGECOUNT value on done: 749665.0 [2024-08-06 06:27:05,074][52660] Sum rewards: 76.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.142', 'AMMO4': '0.220', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:05,182][52667] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:27:05,747][52659] DAMAGECOUNT value on done: 750398.0 [2024-08-06 06:27:05,749][52659] Sum rewards: 70.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'weapon5': '0.014', 'weapon4': '0.020', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.239', 'weapon2': '0.542', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '60.000'} [2024-08-06 06:27:06,258][52667] DAMAGECOUNT value on done: 749759.0 [2024-08-06 06:27:06,259][52667] Sum rewards: 83.103, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.166', 'weapon2': '0.524', 'WEAPON3': '1.000', 'weapon3': '3.264', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '65.000'} [2024-08-06 06:27:06,732][52649] DAMAGECOUNT value on done: 734998.0 [2024-08-06 06:27:06,733][52649] Sum rewards: 70.917, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.068', 'AMMO3': '0.186', 'weapon2': '0.378', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.394', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 564576256. Throughput: 0: 4360.4. Samples: 141149390. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:27:07,795][52567] Avg episode reward: [(0, '73.486')] [2024-08-06 06:27:08,142][52660] DAMAGECOUNT value on done: 745290.0 [2024-08-06 06:27:08,145][52660] Sum rewards: 65.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.008', 'AMMO5': '0.005', 'weapon5': '0.024', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.306', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.456', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '53.000'} [2024-08-06 06:27:08,442][52650] Updated weights for policy 0, policy_version 68921 (0.0012) [2024-08-06 06:27:08,963][52659] DAMAGECOUNT value on done: 754775.0 [2024-08-06 06:27:08,965][52659] Sum rewards: 70.654, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.050', 'HEALTH': '0.060', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.188', 'weapon2': '0.646', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '55.000'} [2024-08-06 06:27:09,055][52667] DAMAGECOUNT value on done: 756158.0 [2024-08-06 06:27:09,055][52667] Sum rewards: 70.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.086', 'AMMO4': '0.119', 'weapon5': '0.174', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '1.104', 'WEAPON3': '1.150', 'weapon3': '2.380', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '57.000'} [2024-08-06 06:27:09,451][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:27:10,112][52649] DAMAGECOUNT value on done: 737334.0 [2024-08-06 06:27:10,121][52649] Sum rewards: 80.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.784', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.078', 'AMMO4': '0.167', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '65.000'} [2024-08-06 06:27:11,123][52794] DAMAGECOUNT value on done: 743247.0 [2024-08-06 06:27:11,123][52794] Sum rewards: 67.136, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.350', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.232', 'weapon2': '0.238', 'weapon5': '0.264', 'AMMO4': '0.269', 'AMMO3': '0.307', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'weapon3': '2.918', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '59.000'} [2024-08-06 06:27:11,236][52660] DAMAGECOUNT value on done: 738875.0 [2024-08-06 06:27:11,237][52660] Sum rewards: 81.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.443', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.131', 'weapon4': '0.146', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '3.028', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '64.000'} [2024-08-06 06:27:11,767][52659] DAMAGECOUNT value on done: 742755.0 [2024-08-06 06:27:11,769][52659] Sum rewards: 73.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.028', 'AMMO4': '0.111', 'weapon5': '0.146', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.500'} [2024-08-06 06:27:12,008][52667] DAMAGECOUNT value on done: 757113.0 [2024-08-06 06:27:12,010][52667] Sum rewards: 78.964, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.084', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.090', 'weapon5': '0.196', 'AMMO3': '0.211', 'AMMO4': '0.233', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '64.500'} [2024-08-06 06:27:12,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 564666368. Throughput: 0: 4359.1. Samples: 141175510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:27:12,794][52567] Avg episode reward: [(0, '73.454')] [2024-08-06 06:27:13,378][52649] DAMAGECOUNT value on done: 736238.0 [2024-08-06 06:27:13,379][52649] Sum rewards: 76.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.756', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.151', 'AMMO3': '0.198', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '63.000'} [2024-08-06 06:27:13,640][52650] Updated weights for policy 0, policy_version 68931 (0.0021) [2024-08-06 06:27:14,070][52660] DAMAGECOUNT value on done: 737185.0 [2024-08-06 06:27:14,071][52660] Sum rewards: 71.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.074', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.066', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '57.500'} [2024-08-06 06:27:14,173][52794] DAMAGECOUNT value on done: 753325.0 [2024-08-06 06:27:14,174][52794] Sum rewards: 69.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.158', 'AMMO4': '0.164', 'AMMO3': '0.208', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '57.000'} [2024-08-06 06:27:14,533][52659] DAMAGECOUNT value on done: 751604.0 [2024-08-06 06:27:14,536][52659] Sum rewards: 63.334, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.315', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.168', 'AMMO3': '0.229', 'AMMO4': '0.277', 'weapon5': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.680', 'WEAPON3': '1.400', 'weapon3': '2.498', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '54.000'} [2024-08-06 06:27:15,034][52667] DAMAGECOUNT value on done: 756120.0 [2024-08-06 06:27:15,037][52667] Sum rewards: 65.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.054', 'weapon4': '0.144', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 06:27:16,316][52649] DAMAGECOUNT value on done: 737238.0 [2024-08-06 06:27:16,318][52649] Sum rewards: 80.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '66.000'} [2024-08-06 06:27:16,850][52794] DAMAGECOUNT value on done: 757807.0 [2024-08-06 06:27:16,851][52794] Sum rewards: 69.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.142', 'AMMO2': '0.007', 'weapon4': '0.008', 'AMMO5': '0.011', 'AMMO4': '0.032', 'weapon5': '0.042', 'WEAPON4': '0.100', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '57.000'} [2024-08-06 06:27:17,489][52659] DAMAGECOUNT value on done: 748040.0 [2024-08-06 06:27:17,490][52659] Sum rewards: 71.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 564756480. Throughput: 0: 4365.6. Samples: 141188500. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:27:17,794][52567] Avg episode reward: [(0, '73.268')] [2024-08-06 06:27:18,007][52650] Updated weights for policy 0, policy_version 68941 (0.0033) [2024-08-06 06:27:18,180][52667] DAMAGECOUNT value on done: 750442.0 [2024-08-06 06:27:18,180][52667] Sum rewards: 74.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.132', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.062', 'weapon4': '0.120', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.428', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '63.000'} [2024-08-06 06:27:19,694][52649] DAMAGECOUNT value on done: 721612.0 [2024-08-06 06:27:19,698][52649] Sum rewards: 80.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.235', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.080', 'AMMO3': '0.187', 'AMMO4': '0.196', 'weapon5': '0.218', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '65.000'} [2024-08-06 06:27:19,901][52794] DAMAGECOUNT value on done: 741181.0 [2024-08-06 06:27:19,901][52794] Sum rewards: 74.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.222', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.096', 'AMMO3': '0.206', 'weapon4': '0.224', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:20,054][52660] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:27:20,186][52659] DAMAGECOUNT value on done: 748646.0 [2024-08-06 06:27:20,187][52659] Sum rewards: 70.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.915', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.036', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.456', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '59.000'} [2024-08-06 06:27:21,224][52667] DAMAGECOUNT value on done: 748054.0 [2024-08-06 06:27:21,232][52667] Sum rewards: 73.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.160', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '61.000'} [2024-08-06 06:27:22,717][52794] DAMAGECOUNT value on done: 743625.0 [2024-08-06 06:27:22,719][52794] Sum rewards: 66.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.098', 'AMMO4': '0.105', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '55.000'} [2024-08-06 06:27:22,754][52649] DAMAGECOUNT value on done: 733180.0 [2024-08-06 06:27:22,754][52649] Sum rewards: 72.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.069', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.148', 'weapon5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.214', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 564838400. Throughput: 0: 4359.8. Samples: 141214560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:27:22,794][52567] Avg episode reward: [(0, '73.308')] [2024-08-06 06:27:22,870][52650] Updated weights for policy 0, policy_version 68951 (0.0018) [2024-08-06 06:27:23,161][52659] DAMAGECOUNT value on done: 752846.0 [2024-08-06 06:27:23,162][52659] Sum rewards: 77.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.242', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.068', 'weapon5': '0.074', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.662', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:23,403][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:27:24,050][52667] DAMAGECOUNT value on done: 750442.0 [2024-08-06 06:27:24,052][52667] Sum rewards: 75.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.011', 'weapon4': '0.030', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.202', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '60.000'} [2024-08-06 06:27:25,222][52794] DAMAGECOUNT value on done: 748534.0 [2024-08-06 06:27:25,222][52794] Sum rewards: 68.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.248', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.148', 'AMMO3': '0.233', 'weapon2': '0.302', 'AMMO4': '0.321', 'weapon5': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '57.000'} [2024-08-06 06:27:25,901][52649] DAMAGECOUNT value on done: 718736.0 [2024-08-06 06:27:25,904][52649] Sum rewards: 69.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.114', 'AMMO4': '0.140', 'weapon5': '0.164', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '2.898', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:26,244][52659] DAMAGECOUNT value on done: 750745.0 [2024-08-06 06:27:26,255][52659] Sum rewards: 90.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.031', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.084', 'weapon5': '0.084', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.208', 'FRAGCOUNT': '74.000'} [2024-08-06 06:27:26,851][52667] DAMAGECOUNT value on done: 758333.0 [2024-08-06 06:27:26,851][52667] Sum rewards: 75.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.082', 'AMMO4': '0.226', 'AMMO3': '0.234', 'weapon2': '0.268', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '63.000'} [2024-08-06 06:27:27,553][52650] Updated weights for policy 0, policy_version 68961 (0.0014) [2024-08-06 06:27:27,709][52665] DAMAGECOUNT value on done: 734693.0 [2024-08-06 06:27:27,709][52665] Sum rewards: 76.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.199', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.496', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 564928512. Throughput: 0: 4364.2. Samples: 141240800. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:27:27,794][52567] Avg episode reward: [(0, '73.400')] [2024-08-06 06:27:28,273][52794] DAMAGECOUNT value on done: 752250.0 [2024-08-06 06:27:28,273][52794] Sum rewards: 69.202, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO3': '0.137', 'AMMO4': '0.170', 'weapon5': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.944', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '54.000'} [2024-08-06 06:27:28,540][52649] DAMAGECOUNT value on done: 736490.0 [2024-08-06 06:27:28,542][52649] Sum rewards: 82.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.022', 'weapon5': '0.082', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '67.000'} [2024-08-06 06:27:29,331][52659] DAMAGECOUNT value on done: 757488.0 [2024-08-06 06:27:29,331][52659] Sum rewards: 73.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.358', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.108', 'weapon5': '0.176', 'weapon2': '0.198', 'AMMO3': '0.266', 'AMMO4': '0.297', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.164', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:29,452][52667] DAMAGECOUNT value on done: 748431.0 [2024-08-06 06:27:29,452][52667] Sum rewards: 69.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.006', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.259', 'weapon2': '0.294', 'WEAPON3': '1.550', 'HITCOUNT': '3.430', 'weapon3': '3.550', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '61.000'} [2024-08-06 06:27:30,157][52665] DAMAGECOUNT value on done: 749591.0 [2024-08-06 06:27:30,158][52665] Sum rewards: 73.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.744', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'weapon5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:30,877][52794] DAMAGECOUNT value on done: 738115.0 [2024-08-06 06:27:30,877][52794] Sum rewards: 59.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.174', 'AMMO3': '0.188', 'weapon4': '0.228', 'WEAPON5': '0.250', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'weapon2': '0.714', 'WEAPON3': '1.050', 'weapon3': '2.672', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '48.000'} [2024-08-06 06:27:31,219][52649] DAMAGECOUNT value on done: 738132.0 [2024-08-06 06:27:31,221][52649] Sum rewards: 72.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.135', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.268', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:32,039][52659] DAMAGECOUNT value on done: 745432.0 [2024-08-06 06:27:32,040][52659] Sum rewards: 83.312, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.140', 'AMMO3': '0.157', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '0.950', 'weapon3': '3.162', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '64.000'} [2024-08-06 06:27:32,246][52667] DAMAGECOUNT value on done: 750158.0 [2024-08-06 06:27:32,249][52667] Sum rewards: 80.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.485', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.166', 'AMMO4': '0.194', 'weapon4': '0.198', 'AMMO3': '0.211', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '65.000'} [2024-08-06 06:27:32,380][52650] Updated weights for policy 0, policy_version 68971 (0.0024) [2024-08-06 06:27:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 565018624. Throughput: 0: 4362.4. Samples: 141254060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:27:32,797][52567] Avg episode reward: [(0, '73.546')] [2024-08-06 06:27:32,794][52663] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:27:33,170][52665] DAMAGECOUNT value on done: 746616.0 [2024-08-06 06:27:33,170][52665] Sum rewards: 68.244, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.896', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.125', 'WEAPON4': '0.200', 'weapon5': '0.226', 'weapon4': '0.244', 'WEAPON5': '0.300', 'weapon2': '0.626', 'WEAPON3': '0.800', 'weapon3': '2.698', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '54.000'} [2024-08-06 06:27:33,450][52794] DAMAGECOUNT value on done: 750671.0 [2024-08-06 06:27:33,450][52794] Sum rewards: 78.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.654', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '63.000'} [2024-08-06 06:27:34,265][52649] DAMAGECOUNT value on done: 727123.0 [2024-08-06 06:27:34,266][52649] Sum rewards: 74.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'AMMO3': '0.219', 'weapon2': '0.260', 'weapon4': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:34,837][52811] DAMAGECOUNT value on done: 712618.0 [2024-08-06 06:27:34,838][52811] Sum rewards: 76.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.116', 'AMMO3': '0.182', 'weapon5': '0.218', 'weapon2': '0.226', 'AMMO4': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '63.000'} [2024-08-06 06:27:35,036][52667] DAMAGECOUNT value on done: 757028.0 [2024-08-06 06:27:35,036][52667] Sum rewards: 84.772, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '70.000'} [2024-08-06 06:27:35,140][52659] DAMAGECOUNT value on done: 753866.0 [2024-08-06 06:27:35,141][52659] Sum rewards: 69.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.238', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.168', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.660', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '56.000'} [2024-08-06 06:27:36,012][52665] DAMAGECOUNT value on done: 742853.0 [2024-08-06 06:27:36,014][52665] Sum rewards: 76.898, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.577', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.135', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.150', 'HITCOUNT': '3.260', 'weapon3': '3.318', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:36,296][52794] DAMAGECOUNT value on done: 743844.0 [2024-08-06 06:27:36,296][52794] Sum rewards: 72.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.295', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.142', 'AMMO3': '0.154', 'weapon5': '0.188', 'AMMO4': '0.294', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon2': '0.858', 'WEAPON3': '1.000', 'weapon3': '2.492', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '60.000'} [2024-08-06 06:27:36,871][52650] Updated weights for policy 0, policy_version 68981 (0.0015) [2024-08-06 06:27:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 565108736. Throughput: 0: 4355.3. Samples: 141280060. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:27:37,794][52567] Avg episode reward: [(0, '73.859')] [2024-08-06 06:27:37,805][52667] DAMAGECOUNT value on done: 744836.0 [2024-08-06 06:27:37,805][52667] Sum rewards: 73.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.608', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.104', 'AMMO4': '0.175', 'weapon5': '0.210', 'weapon2': '0.212', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.258', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:38,048][52659] DAMAGECOUNT value on done: 746223.0 [2024-08-06 06:27:38,050][52659] Sum rewards: 83.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.377', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.108', 'weapon2': '0.186', 'AMMO4': '0.199', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.440', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '69.000'} [2024-08-06 06:27:38,061][52811] DAMAGECOUNT value on done: 694381.0 [2024-08-06 06:27:38,063][52811] Sum rewards: 78.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.762', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '64.000'} [2024-08-06 06:27:38,887][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:27:39,168][52665] DAMAGECOUNT value on done: 729386.0 [2024-08-06 06:27:39,169][52665] Sum rewards: 78.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.154', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.318', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '64.000'} [2024-08-06 06:27:39,235][52794] DAMAGECOUNT value on done: 739850.0 [2024-08-06 06:27:39,235][52794] Sum rewards: 82.777, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.317', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.180', 'weapon5': '0.264', 'AMMO4': '0.266', 'weapon2': '0.296', 'weapon4': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '67.000'} [2024-08-06 06:27:39,324][52803] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:27:40,526][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:27:40,627][52667] DAMAGECOUNT value on done: 752837.0 [2024-08-06 06:27:40,627][52667] Sum rewards: 61.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.598', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.107', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.316', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.278', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '52.000'} [2024-08-06 06:27:41,048][52811] DAMAGECOUNT value on done: 693730.0 [2024-08-06 06:27:41,052][52811] Sum rewards: 79.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.220', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 06:27:41,487][52650] Updated weights for policy 0, policy_version 68991 (0.0014) [2024-08-06 06:27:41,670][52670] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:27:42,001][52794] DAMAGECOUNT value on done: 747996.0 [2024-08-06 06:27:42,004][52794] Sum rewards: 77.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.156', 'AMMO4': '0.175', 'weapon4': '0.208', 'AMMO3': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.500', 'weapon3': '2.800', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '65.000'} [2024-08-06 06:27:42,187][52665] DAMAGECOUNT value on done: 734769.0 [2024-08-06 06:27:42,189][52665] Sum rewards: 69.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.106', 'AMMO4': '0.204', 'AMMO3': '0.213', 'weapon5': '0.240', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.094', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 565190656. Throughput: 0: 4362.9. Samples: 141306430. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:27:42,794][52567] Avg episode reward: [(0, '74.137')] [2024-08-06 06:27:43,559][52667] DAMAGECOUNT value on done: 757982.0 [2024-08-06 06:27:43,560][52667] Sum rewards: 68.490, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.017', 'AMMO3': '0.181', 'weapon2': '0.650', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '56.000'} [2024-08-06 06:27:44,015][52811] DAMAGECOUNT value on done: 694782.0 [2024-08-06 06:27:44,018][52811] Sum rewards: 73.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.218', 'AMMO5': '0.023', 'AMMO2': '0.075', 'weapon4': '0.164', 'AMMO3': '0.232', 'weapon5': '0.292', 'AMMO4': '0.373', 'weapon2': '0.566', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.580', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '59.000'} [2024-08-06 06:27:45,197][52794] DAMAGECOUNT value on done: 746835.0 [2024-08-06 06:27:45,200][52794] Sum rewards: 70.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.924', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon2': '0.168', 'weapon5': '0.180', 'AMMO4': '0.198', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.350', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 06:27:45,308][52665] DAMAGECOUNT value on done: 741446.0 [2024-08-06 06:27:45,311][52665] Sum rewards: 79.170, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.170', 'weapon2': '0.196', 'weapon5': '0.206', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '67.000'} [2024-08-06 06:27:46,086][52667] DAMAGECOUNT value on done: 756085.0 [2024-08-06 06:27:46,087][52667] Sum rewards: 74.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.412', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:46,198][52650] Updated weights for policy 0, policy_version 69001 (0.0025) [2024-08-06 06:27:47,166][52811] DAMAGECOUNT value on done: 702078.0 [2024-08-06 06:27:47,166][52811] Sum rewards: 75.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.310', 'AMMO5': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.196', 'weapon4': '0.220', 'AMMO3': '0.263', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.020', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '64.000'} [2024-08-06 06:27:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 565280768. Throughput: 0: 4363.6. Samples: 141319670. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:27:47,795][52567] Avg episode reward: [(0, '74.014')] [2024-08-06 06:27:47,961][52794] DAMAGECOUNT value on done: 762883.0 [2024-08-06 06:27:47,964][52794] Sum rewards: 70.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.237', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.106', 'AMMO4': '0.147', 'weapon4': '0.176', 'AMMO3': '0.201', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '60.000'} [2024-08-06 06:27:48,351][52665] DAMAGECOUNT value on done: 739891.0 [2024-08-06 06:27:48,351][52665] Sum rewards: 89.662, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.060', 'AMMO3': '0.169', 'weapon5': '0.184', 'AMMO4': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.375', 'FRAGCOUNT': '70.000'} [2024-08-06 06:27:48,731][52667] DAMAGECOUNT value on done: 755536.0 [2024-08-06 06:27:48,731][52667] Sum rewards: 80.418, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.088', 'AMMO3': '0.155', 'weapon5': '0.196', 'AMMO4': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'HEALTH': '0.530', 'WEAPON3': '0.900', 'weapon3': '3.096', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:50,328][52811] DAMAGECOUNT value on done: 707383.0 [2024-08-06 06:27:50,328][52811] Sum rewards: 77.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.534', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.130', 'weapon5': '0.174', 'AMMO3': '0.223', 'AMMO4': '0.317', 'WEAPON5': '0.500', 'weapon2': '0.584', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '64.000'} [2024-08-06 06:27:50,573][52794] DAMAGECOUNT value on done: 741130.0 [2024-08-06 06:27:50,573][52794] Sum rewards: 72.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.388', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.084', 'AMMO4': '0.195', 'weapon5': '0.214', 'AMMO3': '0.252', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:50,888][52650] Updated weights for policy 0, policy_version 69011 (0.0054) [2024-08-06 06:27:51,497][52820] DAMAGECOUNT value on done: 693186.0 [2024-08-06 06:27:51,497][52820] Sum rewards: 70.778, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.183', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.190', 'AMMO4': '0.238', 'AMMO3': '0.287', 'weapon2': '0.290', 'weapon5': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.850', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '61.500'} [2024-08-06 06:27:51,534][52667] DAMAGECOUNT value on done: 751774.0 [2024-08-06 06:27:51,534][52667] Sum rewards: 70.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.028', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.058', 'AMMO4': '0.157', 'weapon5': '0.174', 'AMMO3': '0.223', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '58.000'} [2024-08-06 06:27:51,679][52665] DAMAGECOUNT value on done: 746934.0 [2024-08-06 06:27:51,679][52665] Sum rewards: 77.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.594', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon2': '0.198', 'weapon4': '0.208', 'AMMO3': '0.239', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '65.000'} [2024-08-06 06:27:52,625][52795] DAMAGECOUNT value on done: 696934.0 [2024-08-06 06:27:52,628][52795] Sum rewards: 85.294, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.828', 'AMMO5': '0.008', 'weapon4': '0.012', 'weapon5': '0.038', 'AMMO2': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'AMMO4': '0.192', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '68.000'} [2024-08-06 06:27:52,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 565370880. Throughput: 0: 4365.8. Samples: 141345850. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:27:52,795][52567] Avg episode reward: [(0, '74.465')] [2024-08-06 06:27:53,248][52794] DAMAGECOUNT value on done: 756158.0 [2024-08-06 06:27:53,249][52794] Sum rewards: 68.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO5': '0.009', 'AMMO2': '0.055', 'weapon4': '0.070', 'weapon5': '0.132', 'AMMO3': '0.252', 'AMMO4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.550', 'weapon3': '3.138', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '59.000'} [2024-08-06 06:27:53,443][52811] DAMAGECOUNT value on done: 703054.0 [2024-08-06 06:27:53,444][52811] Sum rewards: 69.348, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.910', 'AMMO5': '0.027', 'AMMO2': '0.074', 'AMMO3': '0.235', 'weapon2': '0.270', 'weapon4': '0.292', 'weapon5': '0.330', 'AMMO4': '0.369', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.698', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '58.500'} [2024-08-06 06:27:54,385][52667] DAMAGECOUNT value on done: 758525.0 [2024-08-06 06:27:54,386][52667] Sum rewards: 63.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.080', 'weapon5': '0.156', 'AMMO4': '0.235', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.168', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '54.000'} [2024-08-06 06:27:54,602][52665] DAMAGECOUNT value on done: 739025.0 [2024-08-06 06:27:54,602][52665] Sum rewards: 65.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.897', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.156', 'AMMO4': '0.170', 'AMMO3': '0.186', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '2.862', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '54.000'} [2024-08-06 06:27:54,690][52820] DAMAGECOUNT value on done: 693896.0 [2024-08-06 06:27:54,691][52820] Sum rewards: 65.236, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.122', 'weapon4': '0.152', 'AMMO4': '0.251', 'weapon2': '0.262', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.180', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 06:27:55,612][52650] Updated weights for policy 0, policy_version 69021 (0.0020) [2024-08-06 06:27:55,780][52795] DAMAGECOUNT value on done: 683058.0 [2024-08-06 06:27:55,782][52795] Sum rewards: 62.621, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.695', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.078', 'weapon5': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.250', 'HITCOUNT': '2.670', 'weapon3': '2.848', 'DAMAGECOUNT': '15.105', 'FRAGCOUNT': '52.000'} [2024-08-06 06:27:56,100][52794] DAMAGECOUNT value on done: 753191.0 [2024-08-06 06:27:56,101][52794] Sum rewards: 87.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.748', 'FRAGCOUNT': '70.000'} [2024-08-06 06:27:56,562][52811] DAMAGECOUNT value on done: 694550.0 [2024-08-06 06:27:56,565][52811] Sum rewards: 82.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.076', 'weapon5': '0.198', 'weapon2': '0.232', 'AMMO3': '0.234', 'AMMO4': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.940', 'FRAGCOUNT': '67.000'} [2024-08-06 06:27:57,691][52665] DAMAGECOUNT value on done: 748799.0 [2024-08-06 06:27:57,693][52665] Sum rewards: 73.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.168', 'AMMO3': '0.201', 'AMMO4': '0.211', 'weapon5': '0.232', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '62.000'} [2024-08-06 06:27:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 565452800. Throughput: 0: 4366.9. Samples: 141372020. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:27:57,802][52567] Avg episode reward: [(0, '74.078')] [2024-08-06 06:27:57,822][52820] DAMAGECOUNT value on done: 695312.0 [2024-08-06 06:27:57,822][52820] Sum rewards: 78.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.060', 'weapon5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.203', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '64.000'} [2024-08-06 06:27:58,977][52795] DAMAGECOUNT value on done: 685204.0 [2024-08-06 06:27:58,978][52795] Sum rewards: 73.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.664', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '61.000'} [2024-08-06 06:27:58,986][52794] DAMAGECOUNT value on done: 753450.0 [2024-08-06 06:27:58,988][52794] Sum rewards: 77.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.348', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.152', 'AMMO3': '0.186', 'AMMO4': '0.247', 'weapon4': '0.276', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '63.000'} [2024-08-06 06:27:59,399][52666] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 06:27:59,680][52811] DAMAGECOUNT value on done: 705887.0 [2024-08-06 06:27:59,680][52811] Sum rewards: 72.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.548', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.220', 'AMMO3': '0.228', 'AMMO4': '0.245', 'weapon4': '0.256', 'weapon2': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:00,716][52650] Updated weights for policy 0, policy_version 69031 (0.0020) [2024-08-06 06:28:00,827][52665] DAMAGECOUNT value on done: 746425.0 [2024-08-06 06:28:00,828][52665] Sum rewards: 65.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.537', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon2': '0.152', 'AMMO4': '0.172', 'AMMO3': '0.195', 'weapon4': '0.260', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '52.000'} [2024-08-06 06:28:00,972][52820] DAMAGECOUNT value on done: 686182.0 [2024-08-06 06:28:00,972][52820] Sum rewards: 71.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.126', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.116', 'weapon2': '0.216', 'AMMO3': '0.247', 'AMMO4': '0.273', 'weapon5': '0.278', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:02,039][52668] Large shaping reward 2.588 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:28:02,083][52794] DAMAGECOUNT value on done: 761214.0 [2024-08-06 06:28:02,084][52794] Sum rewards: 69.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.757', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.184', 'AMMO4': '0.226', 'AMMO3': '0.242', 'weapon5': '0.244', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.888', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:02,213][52795] DAMAGECOUNT value on done: 694158.0 [2024-08-06 06:28:02,213][52795] Sum rewards: 80.264, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.382', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:02,611][52663] DAMAGECOUNT value on done: 762730.0 [2024-08-06 06:28:02,613][52663] Sum rewards: 79.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.868', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.080', 'AMMO4': '0.173', 'AMMO3': '0.188', 'weapon5': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.606', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:02,721][52811] DAMAGECOUNT value on done: 702534.0 [2024-08-06 06:28:02,725][52811] Sum rewards: 81.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.174', 'AMMO3': '0.212', 'weapon5': '0.212', 'AMMO4': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 565542912. Throughput: 0: 4370.0. Samples: 141385150. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:28:02,802][52567] Avg episode reward: [(0, '74.197')] [2024-08-06 06:28:03,701][52665] DAMAGECOUNT value on done: 742320.0 [2024-08-06 06:28:03,702][52665] Sum rewards: 64.586, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.080', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.032', 'weapon5': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.136', 'weapon2': '0.758', 'WEAPON3': '0.950', 'weapon3': '3.046', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.288', 'FRAGCOUNT': '52.000'} [2024-08-06 06:28:03,748][52658] DAMAGECOUNT value on done: 750841.0 [2024-08-06 06:28:03,749][52658] Sum rewards: 74.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.666', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.214', 'AMMO3': '0.225', 'AMMO4': '0.229', 'weapon2': '0.268', 'WEAPON5': '0.300', 'weapon4': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:04,119][52820] DAMAGECOUNT value on done: 699242.0 [2024-08-06 06:28:04,121][52820] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:04,758][52794] DAMAGECOUNT value on done: 750647.0 [2024-08-06 06:28:04,760][52794] Sum rewards: 76.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.564', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.135', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:04,949][52650] Updated weights for policy 0, policy_version 69041 (0.0012) [2024-08-06 06:28:05,253][52795] DAMAGECOUNT value on done: 686674.0 [2024-08-06 06:28:05,257][52795] Sum rewards: 74.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.185', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.100', 'weapon5': '0.182', 'AMMO3': '0.196', 'AMMO4': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:05,624][52663] DAMAGECOUNT value on done: 748045.0 [2024-08-06 06:28:05,624][52663] Sum rewards: 72.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.337', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.129', 'weapon4': '0.130', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:05,731][52811] DAMAGECOUNT value on done: 704343.0 [2024-08-06 06:28:05,732][52811] Sum rewards: 75.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.147', 'weapon2': '0.184', 'AMMO4': '0.222', 'weapon5': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.470', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:06,690][52665] DAMAGECOUNT value on done: 740550.0 [2024-08-06 06:28:06,691][52665] Sum rewards: 79.720, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.152', 'AMMO4': '0.176', 'AMMO3': '0.239', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.184', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:06,821][52664] DAMAGECOUNT value on done: 775236.0 [2024-08-06 06:28:06,822][52664] Sum rewards: 68.275, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.815', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.058', 'weapon5': '0.176', 'AMMO4': '0.215', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:06,969][52658] DAMAGECOUNT value on done: 752512.0 [2024-08-06 06:28:06,970][52658] Sum rewards: 73.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.400', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.166', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'weapon4': '0.470', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:07,335][52820] DAMAGECOUNT value on done: 681903.0 [2024-08-06 06:28:07,337][52820] Sum rewards: 74.171, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.310', 'weapon2': '0.310', 'WEAPON3': '1.750', 'weapon3': '3.300', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 565633024. Throughput: 0: 4374.7. Samples: 141411420. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:28:07,794][52567] Avg episode reward: [(0, '74.120')] [2024-08-06 06:28:08,376][52795] DAMAGECOUNT value on done: 692741.0 [2024-08-06 06:28:08,377][52795] Sum rewards: 60.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.703', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.130', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.586', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '51.000'} [2024-08-06 06:28:08,469][52663] DAMAGECOUNT value on done: 743109.0 [2024-08-06 06:28:08,469][52663] Sum rewards: 60.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.208', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.188', 'weapon2': '0.202', 'AMMO4': '0.226', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.320', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '51.000'} [2024-08-06 06:28:08,798][52811] DAMAGECOUNT value on done: 708936.0 [2024-08-06 06:28:08,799][52811] Sum rewards: 73.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.258', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.116', 'weapon5': '0.176', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.722', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:08,896][52671] DAMAGECOUNT value on done: 753248.0 [2024-08-06 06:28:08,896][52671] Sum rewards: 83.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.852', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.090', 'AMMO4': '0.139', 'weapon5': '0.214', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:09,231][52665] DAMAGECOUNT value on done: 736974.0 [2024-08-06 06:28:09,231][52665] Sum rewards: 83.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.373', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.048', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'AMMO4': '0.209', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '69.000'} [2024-08-06 06:28:09,576][52650] Updated weights for policy 0, policy_version 69051 (0.0011) [2024-08-06 06:28:09,883][52658] DAMAGECOUNT value on done: 754839.0 [2024-08-06 06:28:09,883][52658] Sum rewards: 88.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.428', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.120', 'AMMO4': '0.196', 'weapon5': '0.204', 'AMMO3': '0.235', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.162', 'FRAGCOUNT': '73.000'} [2024-08-06 06:28:09,966][52664] DAMAGECOUNT value on done: 782014.0 [2024-08-06 06:28:09,967][52664] Sum rewards: 68.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '1.008', 'WEAPON3': '1.200', 'weapon3': '2.638', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '55.000'} [2024-08-06 06:28:10,472][52820] DAMAGECOUNT value on done: 692707.0 [2024-08-06 06:28:10,478][52820] Sum rewards: 73.168, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.030', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.038', 'weapon4': '0.080', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '3.330', 'weapon3': '3.344', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:11,222][52663] DAMAGECOUNT value on done: 747288.0 [2024-08-06 06:28:11,224][52663] Sum rewards: 74.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.332', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.101', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.676', 'WEAPON3': '0.900', 'weapon3': '2.900', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:11,387][52671] DAMAGECOUNT value on done: 758239.0 [2024-08-06 06:28:11,387][52671] Sum rewards: 70.101, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.835', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.092', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:11,614][52795] DAMAGECOUNT value on done: 700970.0 [2024-08-06 06:28:11,615][52795] Sum rewards: 73.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.452', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.194', 'AMMO3': '0.201', 'weapon2': '0.228', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.078', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:11,832][52811] DAMAGECOUNT value on done: 703099.0 [2024-08-06 06:28:11,832][52811] Sum rewards: 81.371, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.040', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:12,331][52665] DAMAGECOUNT value on done: 741356.0 [2024-08-06 06:28:12,331][52665] Sum rewards: 56.536, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.240', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.160', 'weapon5': '0.234', 'weapon4': '0.236', 'AMMO4': '0.277', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON4': '0.600', 'WEAPON3': '0.900', 'weapon3': '2.744', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '43.000'} [2024-08-06 06:28:12,645][52658] DAMAGECOUNT value on done: 752975.0 [2024-08-06 06:28:12,647][52658] Sum rewards: 83.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.925', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.092', 'weapon4': '0.172', 'AMMO3': '0.212', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '70.000'} [2024-08-06 06:28:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 565714944. Throughput: 0: 4374.2. Samples: 141437640. Policy #0 lag: (min: 1.0, avg: 3.8, max: 8.0) [2024-08-06 06:28:12,802][52567] Avg episode reward: [(0, '74.237')] [2024-08-06 06:28:13,063][52664] DAMAGECOUNT value on done: 778066.0 [2024-08-06 06:28:13,066][52664] Sum rewards: 82.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.196', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:13,499][52663] DAMAGECOUNT value on done: 749050.0 [2024-08-06 06:28:13,499][52663] Sum rewards: 66.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.142', 'AMMO3': '0.200', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'weapon4': '0.320', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:13,617][52820] DAMAGECOUNT value on done: 693969.0 [2024-08-06 06:28:13,619][52820] Sum rewards: 65.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'AMMO5': '0.030', 'AMMO2': '0.082', 'AMMO3': '0.207', 'weapon4': '0.286', 'weapon5': '0.336', 'weapon2': '0.384', 'AMMO4': '0.408', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.584', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '55.500'} [2024-08-06 06:28:13,738][52669] DAMAGECOUNT value on done: 750966.0 [2024-08-06 06:28:13,739][52669] Sum rewards: 67.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.362', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.086', 'AMMO4': '0.189', 'weapon5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:14,295][52650] Updated weights for policy 0, policy_version 69061 (0.0014) [2024-08-06 06:28:14,723][52671] DAMAGECOUNT value on done: 752229.0 [2024-08-06 06:28:14,723][52671] Sum rewards: 76.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.964', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.166', 'weapon2': '0.186', 'AMMO4': '0.206', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.432', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:14,901][52795] DAMAGECOUNT value on done: 691376.0 [2024-08-06 06:28:14,905][52795] Sum rewards: 69.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.758', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO3': '0.178', 'AMMO4': '0.196', 'weapon5': '0.204', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '55.000'} [2024-08-06 06:28:14,911][52811] DAMAGECOUNT value on done: 698392.0 [2024-08-06 06:28:14,913][52811] Sum rewards: 89.125, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.138', 'AMMO3': '0.149', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '69.000'} [2024-08-06 06:28:15,439][52658] DAMAGECOUNT value on done: 745019.0 [2024-08-06 06:28:15,439][52658] Sum rewards: 69.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:15,551][52665] DAMAGECOUNT value on done: 742065.0 [2024-08-06 06:28:15,552][52665] Sum rewards: 69.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:15,833][52663] DAMAGECOUNT value on done: 757480.0 [2024-08-06 06:28:15,833][52663] Sum rewards: 75.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.660', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.110', 'weapon5': '0.116', 'AMMO4': '0.192', 'weapon2': '0.234', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.254', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:15,863][52664] DAMAGECOUNT value on done: 772689.0 [2024-08-06 06:28:15,864][52664] Sum rewards: 74.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.040', 'AMMO4': '0.123', 'weapon5': '0.134', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:16,198][52669] DAMAGECOUNT value on done: 741839.0 [2024-08-06 06:28:16,198][52669] Sum rewards: 60.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.116', 'AMMO4': '0.164', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.240', 'FRAGCOUNT': '53.000'} [2024-08-06 06:28:16,768][52820] DAMAGECOUNT value on done: 693966.0 [2024-08-06 06:28:16,770][52820] Sum rewards: 73.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.649', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon4': '0.174', 'AMMO3': '0.183', 'weapon5': '0.228', 'AMMO4': '0.286', 'weapon2': '0.418', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '58.500'} [2024-08-06 06:28:17,296][52803] DAMAGECOUNT value on done: 694752.0 [2024-08-06 06:28:17,299][52803] Sum rewards: 65.502, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.959', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.195', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:17,529][52670] DAMAGECOUNT value on done: 739288.0 [2024-08-06 06:28:17,529][52670] Sum rewards: 66.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.190', 'weapon2': '0.200', 'AMMO4': '0.234', 'weapon4': '0.276', 'AMMO3': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.054', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 565805056. Throughput: 0: 4368.9. Samples: 141450660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:17,802][52567] Avg episode reward: [(0, '73.790')] [2024-08-06 06:28:17,949][52795] DAMAGECOUNT value on done: 692526.0 [2024-08-06 06:28:17,949][52795] Sum rewards: 86.072, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.017', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.041', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'AMMO3': '0.220', 'weapon2': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.476', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '22.407', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:18,008][52811] DAMAGECOUNT value on done: 697531.0 [2024-08-06 06:28:18,008][52811] Sum rewards: 77.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.839', 'AMMO5': '0.015', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.137', 'weapon5': '0.174', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:18,101][52665] DAMAGECOUNT value on done: 734842.0 [2024-08-06 06:28:18,102][52665] Sum rewards: 70.745, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.213', 'AMMO4': '0.260', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:18,174][52671] DAMAGECOUNT value on done: 755099.0 [2024-08-06 06:28:18,174][52671] Sum rewards: 71.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.945', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.152', 'AMMO4': '0.205', 'AMMO3': '0.218', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.246', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:18,504][52663] DAMAGECOUNT value on done: 745676.0 [2024-08-06 06:28:18,505][52663] Sum rewards: 77.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.865', 'AMMO5': '0.003', 'weapon7': '0.006', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon4': '0.220', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:18,569][52658] DAMAGECOUNT value on done: 741664.0 [2024-08-06 06:28:18,569][52658] Sum rewards: 74.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.822', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.128', 'weapon5': '0.160', 'AMMO4': '0.175', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:18,585][52664] DAMAGECOUNT value on done: 784828.0 [2024-08-06 06:28:18,585][52664] Sum rewards: 74.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.490', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.192', 'weapon2': '0.366', 'WEAPON3': '1.300', 'HITCOUNT': '3.430', 'weapon3': '3.456', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:18,663][52669] DAMAGECOUNT value on done: 755569.0 [2024-08-06 06:28:18,665][52669] Sum rewards: 75.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:18,911][52666] DAMAGECOUNT value on done: 749602.0 [2024-08-06 06:28:18,912][52666] Sum rewards: 61.284, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.164', 'AMMO3': '0.233', 'AMMO4': '0.246', 'weapon4': '0.252', 'weapon2': '0.258', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '54.000'} [2024-08-06 06:28:19,097][52650] Updated weights for policy 0, policy_version 69071 (0.0026) [2024-08-06 06:28:19,972][52820] DAMAGECOUNT value on done: 703056.0 [2024-08-06 06:28:19,974][52820] Sum rewards: 78.777, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.768', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.182', 'weapon2': '0.192', 'AMMO4': '0.210', 'AMMO3': '0.237', 'weapon5': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:20,405][52803] DAMAGECOUNT value on done: 693423.0 [2024-08-06 06:28:20,405][52803] Sum rewards: 72.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.074', 'AMMO4': '0.196', 'AMMO3': '0.223', 'weapon5': '0.238', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '58.500'} [2024-08-06 06:28:20,409][52670] DAMAGECOUNT value on done: 750714.0 [2024-08-06 06:28:20,409][52670] Sum rewards: 81.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.300', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.137', 'weapon5': '0.142', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:20,862][52665] DAMAGECOUNT value on done: 738317.0 [2024-08-06 06:28:20,862][52665] Sum rewards: 72.748, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.040', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'weapon4': '0.058', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.289', 'weapon2': '0.374', 'WEAPON3': '1.800', 'weapon3': '3.278', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:21,043][52811] DAMAGECOUNT value on done: 697967.0 [2024-08-06 06:28:21,045][52795] DAMAGECOUNT value on done: 695230.0 [2024-08-06 06:28:21,045][52811] Sum rewards: 72.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.878', 'weapon4': '0.002', 'AMMO5': '0.004', 'AMMO2': '0.021', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.278', 'weapon2': '0.316', 'WEAPON3': '1.650', 'HITCOUNT': '3.410', 'weapon3': '3.426', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:21,049][52795] Sum rewards: 75.132, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.165', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.104', 'weapon5': '0.146', 'AMMO3': '0.162', 'AMMO4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:21,254][52671] DAMAGECOUNT value on done: 762502.0 [2024-08-06 06:28:21,255][52671] Sum rewards: 66.806, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.682', 'AMMO5': '0.023', 'AMMO2': '0.067', 'weapon4': '0.128', 'weapon5': '0.198', 'AMMO3': '0.205', 'AMMO4': '0.333', 'weapon2': '0.528', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:21,305][52658] DAMAGECOUNT value on done: 754336.0 [2024-08-06 06:28:21,305][52658] Sum rewards: 69.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.130', 'weapon2': '0.160', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:21,348][52664] DAMAGECOUNT value on done: 777985.0 [2024-08-06 06:28:21,349][52664] Sum rewards: 83.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.245', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.394', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '70.000'} [2024-08-06 06:28:21,539][52663] DAMAGECOUNT value on done: 737854.0 [2024-08-06 06:28:21,540][52663] Sum rewards: 62.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.785', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.079', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.312', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '52.500'} [2024-08-06 06:28:21,826][52669] DAMAGECOUNT value on done: 750910.0 [2024-08-06 06:28:21,828][52669] Sum rewards: 72.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.265', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon5': '0.086', 'AMMO3': '0.209', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.470', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:22,026][52666] DAMAGECOUNT value on done: 746766.0 [2024-08-06 06:28:22,026][52666] Sum rewards: 69.250, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.509', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.094', 'weapon5': '0.170', 'AMMO4': '0.204', 'AMMO3': '0.235', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 565895168. Throughput: 0: 4380.9. Samples: 141477200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:22,794][52567] Avg episode reward: [(0, '73.472')] [2024-08-06 06:28:22,943][52820] DAMAGECOUNT value on done: 687884.0 [2024-08-06 06:28:22,943][52820] Sum rewards: 84.384, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '70.000'} [2024-08-06 06:28:23,154][52670] DAMAGECOUNT value on done: 740254.0 [2024-08-06 06:28:23,154][52670] Sum rewards: 87.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.807', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.029', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.468', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.859', 'FRAGCOUNT': '72.000'} [2024-08-06 06:28:23,464][52803] DAMAGECOUNT value on done: 703196.0 [2024-08-06 06:28:23,465][52803] Sum rewards: 73.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.288', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.166', 'AMMO4': '0.207', 'weapon5': '0.210', 'AMMO3': '0.272', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:23,596][52665] DAMAGECOUNT value on done: 741203.0 [2024-08-06 06:28:23,597][52665] Sum rewards: 67.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.116', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.198', 'AMMO4': '0.227', 'AMMO3': '0.264', 'weapon4': '0.324', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.820', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:23,697][52650] Updated weights for policy 0, policy_version 69081 (0.0012) [2024-08-06 06:28:23,863][52658] DAMAGECOUNT value on done: 743879.0 [2024-08-06 06:28:23,863][52658] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.935', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.114', 'AMMO4': '0.149', 'weapon2': '0.154', 'AMMO3': '0.166', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.362', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '51.000'} [2024-08-06 06:28:24,084][52795] DAMAGECOUNT value on done: 689715.0 [2024-08-06 06:28:24,085][52795] Sum rewards: 87.323, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.250', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.074', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '73.000'} [2024-08-06 06:28:24,160][52811] DAMAGECOUNT value on done: 704201.0 [2024-08-06 06:28:24,161][52811] Sum rewards: 86.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon2': '0.144', 'weapon5': '0.156', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '70.000'} [2024-08-06 06:28:24,234][52664] DAMAGECOUNT value on done: 772941.0 [2024-08-06 06:28:24,234][52664] Sum rewards: 75.346, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.341', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'weapon2': '0.536', 'WEAPON3': '0.850', 'weapon3': '3.320', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:24,367][52671] DAMAGECOUNT value on done: 755313.0 [2024-08-06 06:28:24,369][52671] Sum rewards: 61.597, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.395', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.118', 'AMMO3': '0.133', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '3.044', 'DAMAGECOUNT': '13.863', 'FRAGCOUNT': '49.000'} [2024-08-06 06:28:24,564][52663] DAMAGECOUNT value on done: 741208.0 [2024-08-06 06:28:24,566][52663] Sum rewards: 82.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.164', 'AMMO4': '0.177', 'AMMO3': '0.220', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '67.000'} [2024-08-06 06:28:24,692][52669] DAMAGECOUNT value on done: 753411.0 [2024-08-06 06:28:24,693][52669] Sum rewards: 75.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.432', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.114', 'weapon5': '0.156', 'AMMO3': '0.175', 'AMMO4': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.946', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:24,761][52666] DAMAGECOUNT value on done: 747424.0 [2024-08-06 06:28:24,761][52666] Sum rewards: 63.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon2': '0.188', 'AMMO3': '0.199', 'weapon5': '0.214', 'AMMO4': '0.242', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '52.000'} [2024-08-06 06:28:26,035][52670] DAMAGECOUNT value on done: 737874.0 [2024-08-06 06:28:26,035][52670] Sum rewards: 76.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.182', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon4': '0.082', 'weapon5': '0.166', 'weapon2': '0.234', 'AMMO4': '0.294', 'AMMO3': '0.297', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.216', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:26,086][52820] DAMAGECOUNT value on done: 696227.0 [2024-08-06 06:28:26,090][52820] Sum rewards: 79.970, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.386', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.126', 'weapon4': '0.154', 'AMMO4': '0.178', 'AMMO3': '0.200', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:26,518][52658] DAMAGECOUNT value on done: 767845.0 [2024-08-06 06:28:26,520][52658] Sum rewards: 78.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.170', 'AMMO4': '0.192', 'AMMO3': '0.218', 'weapon4': '0.282', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:26,560][52803] DAMAGECOUNT value on done: 701257.0 [2024-08-06 06:28:26,561][52803] Sum rewards: 70.119, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.596', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.158', 'AMMO4': '0.201', 'weapon2': '0.218', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.290', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:27,020][52663] DAMAGECOUNT value on done: 744496.0 [2024-08-06 06:28:27,020][52663] Sum rewards: 60.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.335', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.074', 'weapon5': '0.134', 'AMMO4': '0.157', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.118', 'DAMAGECOUNT': '15.816', 'FRAGCOUNT': '53.000'} [2024-08-06 06:28:27,033][52659] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:28:27,150][52664] DAMAGECOUNT value on done: 767131.0 [2024-08-06 06:28:27,152][52664] Sum rewards: 84.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.576', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.124', 'AMMO4': '0.167', 'AMMO3': '0.218', 'weapon4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:27,175][52811] DAMAGECOUNT value on done: 706162.0 [2024-08-06 06:28:27,177][52811] Sum rewards: 78.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.678', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.212', 'AMMO4': '0.218', 'AMMO3': '0.248', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:27,178][52669] DAMAGECOUNT value on done: 752879.0 [2024-08-06 06:28:27,179][52669] Sum rewards: 73.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.933', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.098', 'AMMO3': '0.197', 'weapon5': '0.258', 'AMMO4': '0.279', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:27,249][52795] DAMAGECOUNT value on done: 686695.0 [2024-08-06 06:28:27,250][52795] Sum rewards: 73.444, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.082', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'HEALTH': '0.390', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:27,469][52671] DAMAGECOUNT value on done: 757212.0 [2024-08-06 06:28:27,471][52671] Sum rewards: 70.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.167', 'AMMO4': '0.203', 'weapon5': '0.208', 'weapon4': '0.232', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 565977088. Throughput: 0: 4373.8. Samples: 141503250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:27,802][52567] Avg episode reward: [(0, '73.588')] [2024-08-06 06:28:27,890][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069090_565985280.pth... [2024-08-06 06:28:27,917][52666] DAMAGECOUNT value on done: 747652.0 [2024-08-06 06:28:27,917][52666] Sum rewards: 78.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.712', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.106', 'AMMO4': '0.165', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:28,027][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068578_561790976.pth [2024-08-06 06:28:28,563][52650] Updated weights for policy 0, policy_version 69091 (0.0025) [2024-08-06 06:28:29,253][52670] DAMAGECOUNT value on done: 748580.0 [2024-08-06 06:28:29,254][52820] DAMAGECOUNT value on done: 704231.0 [2024-08-06 06:28:29,255][52820] Sum rewards: 85.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'AMMO5': '0.014', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.083', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:29,255][52670] Sum rewards: 64.931, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.300', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.132', 'weapon5': '0.172', 'AMMO4': '0.194', 'AMMO3': '0.252', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.600', 'weapon3': '2.894', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:29,318][52658] DAMAGECOUNT value on done: 751902.0 [2024-08-06 06:28:29,318][52658] Sum rewards: 79.683, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.440', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:29,749][52803] DAMAGECOUNT value on done: 700494.0 [2024-08-06 06:28:29,751][52803] Sum rewards: 71.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.455', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.158', 'AMMO3': '0.193', 'AMMO4': '0.205', 'weapon5': '0.242', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:29,912][52664] DAMAGECOUNT value on done: 780971.0 [2024-08-06 06:28:29,913][52664] Sum rewards: 68.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.025', 'AMMO2': '0.064', 'AMMO3': '0.215', 'weapon5': '0.292', 'weapon2': '0.296', 'weapon4': '0.316', 'AMMO4': '0.319', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:30,050][52663] DAMAGECOUNT value on done: 755647.0 [2024-08-06 06:28:30,052][52663] Sum rewards: 71.144, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.644', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.546', 'WEAPON3': '1.050', 'weapon3': '3.178', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:30,178][52669] DAMAGECOUNT value on done: 751802.0 [2024-08-06 06:28:30,180][52669] Sum rewards: 66.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.495', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO4': '0.179', 'weapon2': '0.206', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.450', 'weapon3': '2.932', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:30,301][52795] DAMAGECOUNT value on done: 686892.0 [2024-08-06 06:28:30,301][52795] Sum rewards: 66.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.250', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.154', 'AMMO3': '0.169', 'weapon2': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.950', 'weapon3': '2.972', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '53.000'} [2024-08-06 06:28:30,333][52671] DAMAGECOUNT value on done: 755540.0 [2024-08-06 06:28:30,334][52671] Sum rewards: 79.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.457', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.138', 'weapon5': '0.180', 'AMMO3': '0.187', 'AMMO4': '0.252', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:30,340][52811] DAMAGECOUNT value on done: 701005.0 [2024-08-06 06:28:30,341][52811] Sum rewards: 68.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.697', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:30,935][52666] DAMAGECOUNT value on done: 741099.0 [2024-08-06 06:28:30,939][52666] Sum rewards: 73.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.098', 'AMMO5': '0.022', 'AMMO2': '0.033', 'weapon4': '0.080', 'AMMO4': '0.165', 'AMMO3': '0.190', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:31,739][52662] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:28:32,266][52658] DAMAGECOUNT value on done: 761715.0 [2024-08-06 06:28:32,267][52658] Sum rewards: 68.320, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.072', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.087', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'weapon2': '0.334', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:32,349][52670] DAMAGECOUNT value on done: 744197.0 [2024-08-06 06:28:32,349][52670] Sum rewards: 89.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '76.000'} [2024-08-06 06:28:32,367][52820] DAMAGECOUNT value on done: 695413.0 [2024-08-06 06:28:32,367][52820] Sum rewards: 64.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.974', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.204', 'weapon5': '0.212', 'AMMO3': '0.240', 'AMMO4': '0.264', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.648', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.500'} [2024-08-06 06:28:32,559][52663] DAMAGECOUNT value on done: 739379.0 [2024-08-06 06:28:32,560][52663] Sum rewards: 52.564, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.045', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.102', 'AMMO3': '0.115', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '0.800', 'HITCOUNT': '2.810', 'weapon3': '3.018', 'DAMAGECOUNT': '12.843', 'FRAGCOUNT': '43.000'} [2024-08-06 06:28:32,580][52664] DAMAGECOUNT value on done: 773656.0 [2024-08-06 06:28:32,581][52664] Sum rewards: 80.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.623', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.068', 'WEAPON4': '0.100', 'weapon2': '0.228', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'weapon3': '3.524', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '67.000'} [2024-08-06 06:28:32,707][52669] DAMAGECOUNT value on done: 755133.0 [2024-08-06 06:28:32,708][52669] Sum rewards: 73.126, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.094', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.316', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 566067200. Throughput: 0: 4368.0. Samples: 141516230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:32,794][52567] Avg episode reward: [(0, '73.409')] [2024-08-06 06:28:32,904][52650] Updated weights for policy 0, policy_version 69101 (0.0024) [2024-08-06 06:28:32,914][52803] DAMAGECOUNT value on done: 697978.0 [2024-08-06 06:28:32,914][52803] Sum rewards: 83.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.826', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'weapon2': '0.186', 'AMMO3': '0.218', 'weapon4': '0.258', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '69.000'} [2024-08-06 06:28:33,336][52811] DAMAGECOUNT value on done: 700503.0 [2024-08-06 06:28:33,345][52811] Sum rewards: 76.492, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:33,475][52795] DAMAGECOUNT value on done: 696260.0 [2024-08-06 06:28:33,475][52795] Sum rewards: 74.277, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.060', 'weapon5': '0.104', 'AMMO4': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.164', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:33,478][52671] DAMAGECOUNT value on done: 744744.0 [2024-08-06 06:28:33,479][52671] Sum rewards: 72.534, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.098', 'weapon5': '0.102', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:34,135][52666] DAMAGECOUNT value on done: 746044.0 [2024-08-06 06:28:34,137][52666] Sum rewards: 71.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:34,993][52663] DAMAGECOUNT value on done: 735966.0 [2024-08-06 06:28:34,995][52663] Sum rewards: 69.259, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.844', 'AMMO5': '0.011', 'ARMOR': '0.020', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.166', 'AMMO3': '0.232', 'weapon4': '0.256', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:35,086][52669] DAMAGECOUNT value on done: 762643.0 [2024-08-06 06:28:35,086][52669] Sum rewards: 76.315, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.128', 'AMMO4': '0.174', 'AMMO3': '0.213', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.358', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:35,219][52658] DAMAGECOUNT value on done: 747629.0 [2024-08-06 06:28:35,220][52658] Sum rewards: 85.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.006', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.058', 'AMMO3': '0.143', 'weapon5': '0.162', 'AMMO4': '0.193', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.318', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:35,290][52670] DAMAGECOUNT value on done: 737998.0 [2024-08-06 06:28:35,291][52670] Sum rewards: 80.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:35,437][52820] DAMAGECOUNT value on done: 700650.0 [2024-08-06 06:28:35,439][52820] Sum rewards: 77.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.128', 'AMMO4': '0.188', 'AMMO3': '0.198', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:35,735][52664] DAMAGECOUNT value on done: 784827.0 [2024-08-06 06:28:35,735][52664] Sum rewards: 75.536, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.058', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.126', 'weapon5': '0.128', 'AMMO3': '0.189', 'AMMO4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:35,985][52803] DAMAGECOUNT value on done: 693084.0 [2024-08-06 06:28:35,987][52803] Sum rewards: 75.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.072', 'AMMO3': '0.193', 'weapon5': '0.200', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:36,331][52671] DAMAGECOUNT value on done: 755122.0 [2024-08-06 06:28:36,333][52671] Sum rewards: 79.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.444', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.176', 'AMMO3': '0.181', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:36,577][52795] DAMAGECOUNT value on done: 680814.0 [2024-08-06 06:28:36,577][52795] Sum rewards: 70.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon4': '0.122', 'AMMO4': '0.200', 'AMMO3': '0.213', 'weapon5': '0.272', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.784', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:36,935][52666] DAMAGECOUNT value on done: 743023.0 [2024-08-06 06:28:36,936][52666] Sum rewards: 62.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.098', 'weapon5': '0.104', 'AMMO4': '0.128', 'weapon2': '0.224', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.320', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '53.000'} [2024-08-06 06:28:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 566149120. Throughput: 0: 4363.1. Samples: 141542190. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:37,794][52567] Avg episode reward: [(0, '73.758')] [2024-08-06 06:28:37,896][52670] DAMAGECOUNT value on done: 741022.0 [2024-08-06 06:28:37,896][52670] Sum rewards: 85.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.407', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.179', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.422', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:37,968][52663] DAMAGECOUNT value on done: 743343.0 [2024-08-06 06:28:37,969][52663] Sum rewards: 71.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.260', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.148', 'AMMO3': '0.176', 'weapon5': '0.192', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:38,070][52669] DAMAGECOUNT value on done: 753136.0 [2024-08-06 06:28:38,071][52669] Sum rewards: 67.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.487', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.138', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.384', 'WEAPON3': '1.500', 'HITCOUNT': '3.040', 'weapon3': '3.126', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:38,086][52650] Updated weights for policy 0, policy_version 69111 (0.0017) [2024-08-06 06:28:38,200][52658] DAMAGECOUNT value on done: 756853.0 [2024-08-06 06:28:38,201][52658] Sum rewards: 68.632, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.102', 'weapon5': '0.128', 'AMMO4': '0.148', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.168', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:38,464][52664] DAMAGECOUNT value on done: 782928.0 [2024-08-06 06:28:38,472][52664] Sum rewards: 77.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.815', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.182', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:38,586][52820] DAMAGECOUNT value on done: 695872.0 [2024-08-06 06:28:38,588][52820] Sum rewards: 81.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '67.000'} [2024-08-06 06:28:39,201][52803] DAMAGECOUNT value on done: 691347.0 [2024-08-06 06:28:39,202][52803] Sum rewards: 82.369, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.974', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon5': '0.236', 'weapon2': '0.258', 'weapon4': '0.364', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:39,412][52666] DAMAGECOUNT value on done: 738350.0 [2024-08-06 06:28:39,413][52666] Sum rewards: 74.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.076', 'weapon5': '0.180', 'weapon2': '0.218', 'AMMO3': '0.219', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:39,711][52671] DAMAGECOUNT value on done: 755727.0 [2024-08-06 06:28:39,712][52671] Sum rewards: 78.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.068', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.234', 'AMMO4': '0.283', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.556', 'WEAPON3': '1.600', 'weapon3': '2.892', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:39,880][52795] DAMAGECOUNT value on done: 699312.0 [2024-08-06 06:28:39,885][52795] Sum rewards: 72.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.534', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.084', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.440', 'WEAPON3': '1.600', 'weapon3': '3.196', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:40,662][52670] DAMAGECOUNT value on done: 740932.0 [2024-08-06 06:28:40,662][52670] Sum rewards: 75.601, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.174', 'AMMO3': '0.185', 'AMMO4': '0.230', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:40,679][52658] DAMAGECOUNT value on done: 746083.0 [2024-08-06 06:28:40,679][52658] Sum rewards: 73.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.078', 'AMMO4': '0.193', 'AMMO3': '0.216', 'weapon5': '0.258', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:40,695][52663] DAMAGECOUNT value on done: 743320.0 [2024-08-06 06:28:40,697][52663] Sum rewards: 83.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.020', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '69.000'} [2024-08-06 06:28:40,702][52669] DAMAGECOUNT value on done: 754900.0 [2024-08-06 06:28:40,703][52669] Sum rewards: 67.728, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.720', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.150', 'weapon5': '0.174', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.313', 'WEAPON3': '1.800', 'weapon3': '3.240', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:41,628][52820] DAMAGECOUNT value on done: 697592.0 [2024-08-06 06:28:41,630][52820] Sum rewards: 74.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.076', 'weapon5': '0.162', 'AMMO4': '0.167', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:41,745][52664] DAMAGECOUNT value on done: 781908.0 [2024-08-06 06:28:41,749][52664] Sum rewards: 71.060, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.296', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.116', 'AMMO3': '0.137', 'AMMO4': '0.139', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.674', 'WEAPON3': '0.950', 'weapon3': '2.828', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '55.000'} [2024-08-06 06:28:42,217][52803] DAMAGECOUNT value on done: 694627.0 [2024-08-06 06:28:42,218][52803] Sum rewards: 81.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.147', 'weapon5': '0.188', 'weapon2': '0.202', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '69.000'} [2024-08-06 06:28:42,258][52666] DAMAGECOUNT value on done: 748084.0 [2024-08-06 06:28:42,261][52666] Sum rewards: 68.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.140', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:42,490][52650] Updated weights for policy 0, policy_version 69121 (0.0015) [2024-08-06 06:28:42,713][52671] DAMAGECOUNT value on done: 753617.0 [2024-08-06 06:28:42,714][52671] Sum rewards: 76.174, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'weapon5': '0.040', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO4': '0.225', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:42,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 566239232. Throughput: 0: 4375.1. Samples: 141568900. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:42,796][52567] Avg episode reward: [(0, '74.057')] [2024-08-06 06:28:43,103][52795] DAMAGECOUNT value on done: 695017.0 [2024-08-06 06:28:43,104][52795] Sum rewards: 83.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.126', 'AMMO3': '0.210', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '67.000'} [2024-08-06 06:28:43,350][52663] DAMAGECOUNT value on done: 755814.0 [2024-08-06 06:28:43,351][52663] Sum rewards: 76.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.082', 'AMMO4': '0.166', 'AMMO3': '0.179', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.392', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:43,362][52669] DAMAGECOUNT value on done: 761534.0 [2024-08-06 06:28:43,362][52669] Sum rewards: 85.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.221', 'AMMO5': '0.021', 'AMMO2': '0.074', 'weapon2': '0.176', 'AMMO3': '0.204', 'weapon5': '0.270', 'weapon4': '0.282', 'AMMO4': '0.372', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '69.000'} [2024-08-06 06:28:43,449][52658] DAMAGECOUNT value on done: 756462.0 [2024-08-06 06:28:43,450][52658] Sum rewards: 80.107, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.400', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.151', 'weapon5': '0.180', 'AMMO3': '0.249', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '68.000'} [2024-08-06 06:28:43,608][52670] DAMAGECOUNT value on done: 735101.0 [2024-08-06 06:28:43,616][52670] Sum rewards: 80.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.038', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.153', 'weapon2': '0.278', 'WEAPON3': '1.150', 'weapon3': '3.458', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:44,471][52664] DAMAGECOUNT value on done: 788983.0 [2024-08-06 06:28:44,472][52664] Sum rewards: 77.855, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.036', 'weapon5': '0.104', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:44,617][52647] DAMAGECOUNT value on done: 797029.0 [2024-08-06 06:28:44,617][52647] Sum rewards: 84.022, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO3': '0.140', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'HEALTH': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '0.850', 'weapon3': '3.126', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '65.000'} [2024-08-06 06:28:44,758][52820] DAMAGECOUNT value on done: 708518.0 [2024-08-06 06:28:44,759][52820] Sum rewards: 76.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.214', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.142', 'weapon5': '0.158', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:45,109][52666] DAMAGECOUNT value on done: 740679.0 [2024-08-06 06:28:45,109][52666] Sum rewards: 72.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.664', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.146', 'AMMO3': '0.165', 'weapon5': '0.184', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.674', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:45,260][52803] DAMAGECOUNT value on done: 693924.0 [2024-08-06 06:28:45,262][52803] Sum rewards: 70.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.475', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:45,671][52671] DAMAGECOUNT value on done: 760470.0 [2024-08-06 06:28:45,673][52671] Sum rewards: 67.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO3': '0.217', 'AMMO4': '0.227', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:46,186][52663] DAMAGECOUNT value on done: 747687.0 [2024-08-06 06:28:46,189][52663] Sum rewards: 68.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.744', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.144', 'AMMO4': '0.172', 'AMMO3': '0.232', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.222', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:46,200][52669] DAMAGECOUNT value on done: 745461.0 [2024-08-06 06:28:46,205][52669] Sum rewards: 75.598, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.280', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO3': '0.135', 'weapon5': '0.136', 'AMMO4': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '0.800', 'weapon3': '3.140', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:46,252][52795] DAMAGECOUNT value on done: 685439.0 [2024-08-06 06:28:46,253][52795] Sum rewards: 72.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.403', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.118', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.270', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.354', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:46,367][52670] DAMAGECOUNT value on done: 750383.0 [2024-08-06 06:28:46,367][52670] Sum rewards: 75.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.124', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.066', 'weapon4': '0.150', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:46,704][52658] DAMAGECOUNT value on done: 738617.0 [2024-08-06 06:28:46,704][52658] Sum rewards: 70.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.247', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:47,261][52664] DAMAGECOUNT value on done: 789599.0 [2024-08-06 06:28:47,261][52664] Sum rewards: 78.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.329', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.038', 'weapon5': '0.048', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.190', 'weapon2': '0.234', 'WEAPON3': '1.100', 'weapon3': '3.466', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:47,396][52650] Updated weights for policy 0, policy_version 69131 (0.0012) [2024-08-06 06:28:47,470][52647] DAMAGECOUNT value on done: 786354.0 [2024-08-06 06:28:47,470][52647] Sum rewards: 72.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.125', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.068', 'weapon5': '0.098', 'AMMO4': '0.115', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 566329344. Throughput: 0: 4373.6. Samples: 141581960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:47,794][52567] Avg episode reward: [(0, '74.593')] [2024-08-06 06:28:47,913][52820] DAMAGECOUNT value on done: 706468.0 [2024-08-06 06:28:47,917][52820] Sum rewards: 83.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.894', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.153', 'weapon5': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '69.000'} [2024-08-06 06:28:47,992][52666] DAMAGECOUNT value on done: 749648.0 [2024-08-06 06:28:47,992][52666] Sum rewards: 69.014, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.363', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.172', 'weapon2': '0.200', 'AMMO3': '0.266', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:48,400][52671] DAMAGECOUNT value on done: 754756.0 [2024-08-06 06:28:48,400][52671] Sum rewards: 75.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.195', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.076', 'weapon5': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '63.500'} [2024-08-06 06:28:48,440][52803] DAMAGECOUNT value on done: 708384.0 [2024-08-06 06:28:48,441][52803] Sum rewards: 68.029, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.710', 'AMMO5': '0.016', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.143', 'weapon2': '0.170', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon5': '0.318', 'WEAPON3': '0.900', 'HITCOUNT': '3.050', 'weapon3': '3.064', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '52.000'} [2024-08-06 06:28:49,138][52669] DAMAGECOUNT value on done: 747782.0 [2024-08-06 06:28:49,138][52669] Sum rewards: 70.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.098', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.102', 'AMMO4': '0.183', 'weapon5': '0.216', 'AMMO3': '0.319', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '2.954', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:49,168][52663] DAMAGECOUNT value on done: 751120.0 [2024-08-06 06:28:49,169][52663] Sum rewards: 65.366, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.024', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.102', 'weapon5': '0.114', 'AMMO3': '0.134', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '0.850', 'weapon3': '3.068', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '52.000'} [2024-08-06 06:28:49,257][52670] DAMAGECOUNT value on done: 735688.0 [2024-08-06 06:28:49,260][52670] Sum rewards: 73.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.182', 'AMMO3': '0.200', 'AMMO4': '0.235', 'weapon2': '0.280', 'WEAPON5': '0.450', 'weapon4': '0.460', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:49,345][52795] DAMAGECOUNT value on done: 694293.0 [2024-08-06 06:28:49,345][52795] Sum rewards: 73.097, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.098', 'weapon2': '0.180', 'weapon5': '0.216', 'AMMO3': '0.247', 'AMMO4': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:49,617][52668] DAMAGECOUNT value on done: 752742.0 [2024-08-06 06:28:49,618][52668] Sum rewards: 100.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.086', 'weapon5': '0.092', 'AMMO4': '0.113', 'AMMO3': '0.217', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '23.559', 'FRAGCOUNT': '82.000'} [2024-08-06 06:28:49,695][52658] DAMAGECOUNT value on done: 756235.0 [2024-08-06 06:28:49,695][52658] Sum rewards: 69.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.111', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.102', 'weapon2': '0.172', 'AMMO4': '0.174', 'AMMO3': '0.176', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.322', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:49,786][52664] DAMAGECOUNT value on done: 784884.0 [2024-08-06 06:28:49,788][52664] Sum rewards: 80.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.332', 'AMMO2': '0.007', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon5': '0.108', 'weapon2': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.416', 'WEAPON3': '1.000', 'weapon3': '3.096', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '64.000'} [2024-08-06 06:28:49,915][52647] DAMAGECOUNT value on done: 791945.0 [2024-08-06 06:28:49,917][52647] Sum rewards: 73.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.159', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.194', 'AMMO3': '0.207', 'weapon5': '0.238', 'AMMO4': '0.326', 'weapon2': '0.386', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '60.000'} [2024-08-06 06:28:50,607][52666] DAMAGECOUNT value on done: 735806.0 [2024-08-06 06:28:50,610][52666] Sum rewards: 68.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.215', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.126', 'weapon4': '0.136', 'AMMO4': '0.177', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:50,887][52671] DAMAGECOUNT value on done: 743082.0 [2024-08-06 06:28:50,888][52671] Sum rewards: 67.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.862', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.122', 'weapon4': '0.158', 'AMMO3': '0.198', 'AMMO4': '0.289', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:51,080][52820] DAMAGECOUNT value on done: 692015.0 [2024-08-06 06:28:51,080][52820] Sum rewards: 84.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.136', 'AMMO5': '0.008', 'AMMO2': '0.053', 'weapon5': '0.124', 'weapon4': '0.170', 'AMMO3': '0.189', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.249', 'FRAGCOUNT': '67.500'} [2024-08-06 06:28:51,726][52803] DAMAGECOUNT value on done: 698566.0 [2024-08-06 06:28:51,726][52803] Sum rewards: 66.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon5': '0.198', 'AMMO3': '0.208', 'AMMO4': '0.318', 'weapon4': '0.394', 'weapon2': '0.398', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.684', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:51,761][52650] Updated weights for policy 0, policy_version 69141 (0.0049) [2024-08-06 06:28:52,056][52670] DAMAGECOUNT value on done: 744001.0 [2024-08-06 06:28:52,056][52670] Sum rewards: 74.052, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.728', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.158', 'AMMO4': '0.201', 'AMMO3': '0.227', 'weapon4': '0.284', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:52,413][52669] DAMAGECOUNT value on done: 753099.0 [2024-08-06 06:28:52,414][52669] Sum rewards: 68.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.288', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '54.000'} [2024-08-06 06:28:52,433][52663] DAMAGECOUNT value on done: 755233.0 [2024-08-06 06:28:52,433][52663] Sum rewards: 85.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.013', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.118', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '70.000'} [2024-08-06 06:28:52,545][52795] DAMAGECOUNT value on done: 701308.0 [2024-08-06 06:28:52,546][52795] Sum rewards: 77.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.479', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.132', 'weapon5': '0.166', 'AMMO3': '0.194', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:52,704][52664] DAMAGECOUNT value on done: 774319.0 [2024-08-06 06:28:52,704][52664] Sum rewards: 60.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.125', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.141', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '50.500'} [2024-08-06 06:28:52,737][52658] DAMAGECOUNT value on done: 747981.0 [2024-08-06 06:28:52,739][52658] Sum rewards: 71.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.628', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.203', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:52,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 566411264. Throughput: 0: 4370.4. Samples: 141608090. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:52,794][52567] Avg episode reward: [(0, '74.571')] [2024-08-06 06:28:52,873][52668] DAMAGECOUNT value on done: 757407.0 [2024-08-06 06:28:52,874][52668] Sum rewards: 84.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.265', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.100', 'AMMO3': '0.176', 'AMMO4': '0.273', 'weapon2': '0.278', 'weapon5': '0.306', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.964', 'FRAGCOUNT': '66.000'} [2024-08-06 06:28:53,001][52647] DAMAGECOUNT value on done: 792234.0 [2024-08-06 06:28:53,002][52647] Sum rewards: 79.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.758', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.118', 'weapon5': '0.134', 'weapon2': '0.144', 'AMMO4': '0.180', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.352', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:53,429][52671] DAMAGECOUNT value on done: 761220.0 [2024-08-06 06:28:53,430][52671] Sum rewards: 83.302, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '67.000'} [2024-08-06 06:28:53,757][52666] DAMAGECOUNT value on done: 749425.0 [2024-08-06 06:28:53,757][52666] Sum rewards: 72.757, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.743', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.102', 'weapon5': '0.248', 'AMMO3': '0.259', 'AMMO4': '0.272', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:54,765][52803] DAMAGECOUNT value on done: 700295.0 [2024-08-06 06:28:54,768][52803] Sum rewards: 69.164, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.138', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:55,205][52670] DAMAGECOUNT value on done: 751842.0 [2024-08-06 06:28:55,205][52670] Sum rewards: 73.335, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.903', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.072', 'weapon5': '0.204', 'AMMO3': '0.235', 'AMMO4': '0.269', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:55,256][52664] DAMAGECOUNT value on done: 776580.0 [2024-08-06 06:28:55,257][52664] Sum rewards: 80.133, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.483', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.166', 'AMMO4': '0.220', 'weapon5': '0.222', 'weapon4': '0.262', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '64.500'} [2024-08-06 06:28:55,444][52647] DAMAGECOUNT value on done: 797384.0 [2024-08-06 06:28:55,445][52647] Sum rewards: 72.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.100', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.342', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:55,619][52669] DAMAGECOUNT value on done: 772167.0 [2024-08-06 06:28:55,619][52669] Sum rewards: 84.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.552', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.066', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '71.000'} [2024-08-06 06:28:55,644][52663] DAMAGECOUNT value on done: 743307.0 [2024-08-06 06:28:55,646][52663] Sum rewards: 70.886, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.025', 'AMMO2': '0.073', 'AMMO3': '0.210', 'weapon5': '0.360', 'AMMO4': '0.363', 'weapon2': '0.372', 'weapon4': '0.392', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.200', 'weapon3': '2.464', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '58.000'} [2024-08-06 06:28:55,705][52658] DAMAGECOUNT value on done: 744891.0 [2024-08-06 06:28:55,706][52658] Sum rewards: 51.546, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.152', 'AMMO3': '0.158', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.308', 'weapon2': '0.592', 'WEAPON3': '1.050', 'weapon3': '2.648', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '12.657', 'FRAGCOUNT': '41.000'} [2024-08-06 06:28:55,833][52668] DAMAGECOUNT value on done: 754531.0 [2024-08-06 06:28:55,835][52668] Sum rewards: 61.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.114', 'AMMO4': '0.170', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '53.000'} [2024-08-06 06:28:56,260][52671] DAMAGECOUNT value on done: 758427.0 [2024-08-06 06:28:56,261][52671] Sum rewards: 76.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.026', 'AMMO4': '0.089', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.348', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:56,681][52650] Updated weights for policy 0, policy_version 69151 (0.0022) [2024-08-06 06:28:56,799][52666] DAMAGECOUNT value on done: 744133.0 [2024-08-06 06:28:56,801][52666] Sum rewards: 75.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.084', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon4': '0.116', 'AMMO3': '0.230', 'weapon2': '0.272', 'AMMO4': '0.301', 'weapon5': '0.380', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:57,126][52662] DAMAGECOUNT value on done: 753557.0 [2024-08-06 06:28:57,127][52662] Sum rewards: 70.648, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.154', 'AMMO3': '0.208', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.646', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 566509568. Throughput: 0: 4370.0. Samples: 141634290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:28:57,794][52567] Avg episode reward: [(0, '74.474')] [2024-08-06 06:28:57,919][52803] DAMAGECOUNT value on done: 711647.0 [2024-08-06 06:28:57,919][52803] Sum rewards: 73.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.720', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.088', 'AMMO3': '0.161', 'weapon5': '0.222', 'AMMO4': '0.272', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.046', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '57.000'} [2024-08-06 06:28:57,993][52664] DAMAGECOUNT value on done: 777886.0 [2024-08-06 06:28:57,993][52664] Sum rewards: 72.340, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.954', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.125', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.332', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:58,116][52670] DAMAGECOUNT value on done: 744582.0 [2024-08-06 06:28:58,118][52670] Sum rewards: 79.528, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.578', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.155', 'weapon2': '0.364', 'WEAPON3': '1.050', 'weapon3': '3.204', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '63.000'} [2024-08-06 06:28:58,136][52647] DAMAGECOUNT value on done: 798267.0 [2024-08-06 06:28:58,137][52647] Sum rewards: 72.209, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.123', 'weapon5': '0.132', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.650', 'weapon3': '3.268', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '62.000'} [2024-08-06 06:28:58,439][52658] DAMAGECOUNT value on done: 753481.0 [2024-08-06 06:28:58,439][52658] Sum rewards: 68.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.442', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.080', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.364', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2024-08-06 06:28:58,556][52668] DAMAGECOUNT value on done: 758609.0 [2024-08-06 06:28:58,558][52668] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.082', 'AMMO4': '0.130', 'weapon5': '0.222', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '2.890', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '61.000'} [2024-08-06 06:28:58,951][52669] DAMAGECOUNT value on done: 761933.0 [2024-08-06 06:28:58,951][52669] Sum rewards: 87.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.533', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.098', 'AMMO4': '0.117', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.150', 'weapon3': '3.402', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.868', 'FRAGCOUNT': '71.000'} [2024-08-06 06:28:59,226][52671] DAMAGECOUNT value on done: 756141.0 [2024-08-06 06:28:59,227][52671] Sum rewards: 70.586, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.616', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '59.000'} [2024-08-06 06:28:59,650][52666] DAMAGECOUNT value on done: 742488.0 [2024-08-06 06:28:59,650][52666] Sum rewards: 65.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.372', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.352', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '54.000'} [2024-08-06 06:28:59,782][52662] DAMAGECOUNT value on done: 759830.0 [2024-08-06 06:28:59,783][52662] Sum rewards: 77.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.197', 'weapon2': '0.618', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:00,855][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:29:00,945][52670] DAMAGECOUNT value on done: 727966.0 [2024-08-06 06:29:00,947][52670] Sum rewards: 73.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.957', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon2': '0.198', 'AMMO3': '0.202', 'weapon5': '0.220', 'weapon4': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:01,030][52803] DAMAGECOUNT value on done: 697396.0 [2024-08-06 06:29:01,031][52803] Sum rewards: 91.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.428', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.240', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.492', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.474', 'FRAGCOUNT': '76.000'} [2024-08-06 06:29:01,072][52664] DAMAGECOUNT value on done: 776653.0 [2024-08-06 06:29:01,072][52664] Sum rewards: 67.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.120', 'AMMO4': '0.174', 'weapon2': '0.194', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.330', 'weapon3': '3.380', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '58.000'} [2024-08-06 06:29:01,175][52647] DAMAGECOUNT value on done: 799187.0 [2024-08-06 06:29:01,178][52647] Sum rewards: 94.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.052', 'AMMO4': '0.058', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.268', 'WEAPON3': '1.100', 'weapon3': '3.454', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '76.000'} [2024-08-06 06:29:01,384][52650] Updated weights for policy 0, policy_version 69161 (0.0013) [2024-08-06 06:29:01,517][52668] DAMAGECOUNT value on done: 743351.0 [2024-08-06 06:29:01,517][52668] Sum rewards: 60.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.126', 'weapon4': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '50.000'} [2024-08-06 06:29:02,221][52669] DAMAGECOUNT value on done: 755595.0 [2024-08-06 06:29:02,222][52669] Sum rewards: 77.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.266', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon4': '0.178', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '64.000'} [2024-08-06 06:29:02,407][52666] DAMAGECOUNT value on done: 739619.0 [2024-08-06 06:29:02,407][52666] Sum rewards: 82.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.256', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.074', 'AMMO4': '0.091', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.445', 'FRAGCOUNT': '67.000'} [2024-08-06 06:29:02,712][52671] DAMAGECOUNT value on done: 759904.0 [2024-08-06 06:29:02,713][52671] Sum rewards: 71.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.037', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.237', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '61.000'} [2024-08-06 06:29:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 566591488. Throughput: 0: 4363.6. Samples: 141647020. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:02,794][52567] Avg episode reward: [(0, '74.983')] [2024-08-06 06:29:02,818][52662] DAMAGECOUNT value on done: 761937.0 [2024-08-06 06:29:02,821][52662] Sum rewards: 78.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.815', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.211', 'weapon2': '0.630', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '65.000'} [2024-08-06 06:29:03,677][52670] DAMAGECOUNT value on done: 740439.0 [2024-08-06 06:29:03,678][52670] Sum rewards: 68.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.548', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.056', 'AMMO4': '0.086', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '57.000'} [2024-08-06 06:29:04,025][52668] DAMAGECOUNT value on done: 755144.0 [2024-08-06 06:29:04,027][52668] Sum rewards: 55.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.022', 'AMMO2': '0.053', 'weapon4': '0.098', 'AMMO3': '0.181', 'weapon5': '0.222', 'AMMO4': '0.264', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.550', 'weapon3': '3.026', 'DAMAGECOUNT': '13.824', 'FRAGCOUNT': '46.000'} [2024-08-06 06:29:04,106][52803] DAMAGECOUNT value on done: 699229.0 [2024-08-06 06:29:04,109][52803] Sum rewards: 72.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.837', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.072', 'weapon5': '0.190', 'AMMO3': '0.250', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '62.000'} [2024-08-06 06:29:04,349][52647] DAMAGECOUNT value on done: 777919.0 [2024-08-06 06:29:04,351][52647] Sum rewards: 63.331, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.208', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.078', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon5': '0.210', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '51.000'} [2024-08-06 06:29:05,235][52669] DAMAGECOUNT value on done: 757710.0 [2024-08-06 06:29:05,236][52669] Sum rewards: 64.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.903', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon5': '0.186', 'weapon2': '0.238', 'AMMO3': '0.252', 'AMMO4': '0.294', 'WEAPON5': '0.400', 'weapon4': '0.538', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '56.000'} [2024-08-06 06:29:05,262][52662] DAMAGECOUNT value on done: 744039.0 [2024-08-06 06:29:05,262][52662] Sum rewards: 72.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.744', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.026', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.208', 'weapon2': '0.270', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 06:29:05,551][52666] DAMAGECOUNT value on done: 741313.0 [2024-08-06 06:29:05,552][52666] Sum rewards: 68.009, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.463', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.152', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '57.000'} [2024-08-06 06:29:05,565][52671] DAMAGECOUNT value on done: 750118.0 [2024-08-06 06:29:05,566][52671] Sum rewards: 68.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.160', 'weapon5': '0.196', 'weapon2': '0.240', 'AMMO3': '0.243', 'AMMO4': '0.257', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.116', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:05,961][52650] Updated weights for policy 0, policy_version 69171 (0.0020) [2024-08-06 06:29:06,838][52670] DAMAGECOUNT value on done: 749209.0 [2024-08-06 06:29:06,838][52670] Sum rewards: 77.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.913', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:07,051][52668] DAMAGECOUNT value on done: 756516.0 [2024-08-06 06:29:07,054][52668] Sum rewards: 77.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.002', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.075', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '62.000'} [2024-08-06 06:29:07,292][52803] DAMAGECOUNT value on done: 703222.0 [2024-08-06 06:29:07,293][52803] Sum rewards: 78.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.116', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.736', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '64.000'} [2024-08-06 06:29:07,608][52647] DAMAGECOUNT value on done: 793375.0 [2024-08-06 06:29:07,608][52647] Sum rewards: 73.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.111', 'weapon5': '0.124', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '3.186', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 566681600. Throughput: 0: 4359.8. Samples: 141673390. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:07,794][52567] Avg episode reward: [(0, '74.423')] [2024-08-06 06:29:08,218][52669] DAMAGECOUNT value on done: 761839.0 [2024-08-06 06:29:08,219][52669] Sum rewards: 83.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '68.000'} [2024-08-06 06:29:08,395][52666] DAMAGECOUNT value on done: 757297.0 [2024-08-06 06:29:08,395][52662] DAMAGECOUNT value on done: 762617.0 [2024-08-06 06:29:08,395][52666] Sum rewards: 80.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.056', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '67.000'} [2024-08-06 06:29:08,395][52662] Sum rewards: 69.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.165', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.128', 'weapon5': '0.164', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.264', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '58.000'} [2024-08-06 06:29:09,193][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:29:09,518][52670] DAMAGECOUNT value on done: 744004.0 [2024-08-06 06:29:09,519][52670] Sum rewards: 73.516, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.402', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'weapon2': '0.242', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.314', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 06:29:10,230][52668] DAMAGECOUNT value on done: 748728.0 [2024-08-06 06:29:10,231][52668] Sum rewards: 63.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.207', 'weapon5': '0.232', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.754', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '52.000'} [2024-08-06 06:29:10,329][52803] DAMAGECOUNT value on done: 704532.0 [2024-08-06 06:29:10,337][52803] Sum rewards: 74.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.202', 'AMMO4': '0.210', 'weapon5': '0.210', 'weapon2': '0.290', 'weapon4': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '61.000'} [2024-08-06 06:29:10,360][52647] DAMAGECOUNT value on done: 791014.0 [2024-08-06 06:29:10,364][52647] Sum rewards: 62.237, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.106', 'AMMO4': '0.137', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'weapon4': '0.200', 'WEAPON3': '1.050', 'weapon3': '3.318', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '48.000'} [2024-08-06 06:29:10,547][52650] Updated weights for policy 0, policy_version 69181 (0.0014) [2024-08-06 06:29:11,062][52666] DAMAGECOUNT value on done: 730655.0 [2024-08-06 06:29:11,064][52666] Sum rewards: 70.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.210', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.096', 'weapon5': '0.120', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON3': '1.650', 'weapon3': '3.418', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '60.000'} [2024-08-06 06:29:11,328][52662] DAMAGECOUNT value on done: 744369.0 [2024-08-06 06:29:11,328][52662] Sum rewards: 65.189, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.118', 'AMMO4': '0.129', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.370', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '55.000'} [2024-08-06 06:29:12,259][52670] DAMAGECOUNT value on done: 747233.0 [2024-08-06 06:29:12,260][52670] Sum rewards: 70.781, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.506', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.124', 'weapon5': '0.128', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.726', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '57.000'} [2024-08-06 06:29:12,800][52567] Fps is (10 sec: 17193.2, 60 sec: 17474.6, 300 sec: 17466.7). Total num frames: 566763520. Throughput: 0: 4367.4. Samples: 141699810. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:12,800][52567] Avg episode reward: [(0, '73.916')] [2024-08-06 06:29:13,131][52668] DAMAGECOUNT value on done: 747048.0 [2024-08-06 06:29:13,132][52668] Sum rewards: 65.038, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.657', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.157', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.600', 'weapon3': '3.134', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '55.000'} [2024-08-06 06:29:13,475][52803] DAMAGECOUNT value on done: 708191.0 [2024-08-06 06:29:13,477][52803] Sum rewards: 72.327, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.921', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.033', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '58.000'} [2024-08-06 06:29:13,510][52647] DAMAGECOUNT value on done: 789516.0 [2024-08-06 06:29:13,510][52647] Sum rewards: 74.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.038', 'AMMO4': '0.129', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:13,877][52662] DAMAGECOUNT value on done: 754170.0 [2024-08-06 06:29:13,877][52662] Sum rewards: 77.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.357', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.145', 'AMMO3': '0.211', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '64.000'} [2024-08-06 06:29:14,039][52666] DAMAGECOUNT value on done: 743361.0 [2024-08-06 06:29:14,039][52666] Sum rewards: 84.494, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.017', 'HEALTH': '0.032', 'AMMO2': '0.050', 'weapon4': '0.130', 'AMMO3': '0.185', 'AMMO4': '0.251', 'weapon5': '0.356', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.816', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '68.000'} [2024-08-06 06:29:15,334][52650] Updated weights for policy 0, policy_version 69191 (0.0012) [2024-08-06 06:29:15,787][52668] DAMAGECOUNT value on done: 754840.0 [2024-08-06 06:29:15,787][52668] Sum rewards: 57.446, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.160', 'weapon4': '0.178', 'AMMO3': '0.260', 'AMMO4': '0.274', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '50.000'} [2024-08-06 06:29:16,320][52647] DAMAGECOUNT value on done: 782118.0 [2024-08-06 06:29:16,320][52647] Sum rewards: 71.772, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.143', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.792', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '58.000'} [2024-08-06 06:29:16,620][52803] DAMAGECOUNT value on done: 702647.0 [2024-08-06 06:29:16,620][52803] Sum rewards: 76.135, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.146', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon2': '0.190', 'AMMO3': '0.331', 'WEAPON3': '1.900', 'weapon3': '3.538', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '68.000'} [2024-08-06 06:29:16,663][52662] DAMAGECOUNT value on done: 766601.0 [2024-08-06 06:29:16,663][52662] Sum rewards: 79.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.018', 'AMMO2': '0.064', 'AMMO3': '0.195', 'weapon4': '0.226', 'weapon5': '0.306', 'AMMO4': '0.322', 'weapon2': '0.340', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.850', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 566853632. Throughput: 0: 4373.3. Samples: 141713030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:17,794][52567] Avg episode reward: [(0, '73.482')] [2024-08-06 06:29:19,009][52647] DAMAGECOUNT value on done: 798529.0 [2024-08-06 06:29:19,009][52647] Sum rewards: 76.619, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.376', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.108', 'weapon5': '0.130', 'AMMO4': '0.144', 'WEAPON5': '0.250', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.850', 'weapon3': '3.130', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '68.000'} [2024-08-06 06:29:19,077][52668] DAMAGECOUNT value on done: 750652.0 [2024-08-06 06:29:19,078][52668] Sum rewards: 69.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.054', 'weapon5': '0.114', 'AMMO4': '0.116', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.206', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:19,670][52650] Updated weights for policy 0, policy_version 69201 (0.0013) [2024-08-06 06:29:19,957][52662] DAMAGECOUNT value on done: 753764.0 [2024-08-06 06:29:19,958][52662] Sum rewards: 85.085, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.474', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'AMMO4': '0.179', 'weapon2': '0.200', 'weapon4': '0.342', 'WEAPON3': '1.000', 'weapon3': '3.218', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '67.000'} [2024-08-06 06:29:21,521][52647] DAMAGECOUNT value on done: 782763.0 [2024-08-06 06:29:21,521][52647] Sum rewards: 82.575, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.721', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.181', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.544', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '66.000'} [2024-08-06 06:29:22,125][52668] DAMAGECOUNT value on done: 743917.0 [2024-08-06 06:29:22,127][52668] Sum rewards: 69.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.447', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO4': '0.216', 'weapon5': '0.224', 'AMMO3': '0.225', 'weapon4': '0.228', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.722', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '58.000'} [2024-08-06 06:29:22,794][52567] Fps is (10 sec: 18032.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 566943744. Throughput: 0: 4381.3. Samples: 141739350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:22,795][52567] Avg episode reward: [(0, '73.498')] [2024-08-06 06:29:22,856][52662] DAMAGECOUNT value on done: 762076.0 [2024-08-06 06:29:22,857][52662] Sum rewards: 79.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.621', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.096', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '64.000'} [2024-08-06 06:29:24,322][52647] DAMAGECOUNT value on done: 793161.0 [2024-08-06 06:29:24,323][52647] Sum rewards: 75.358, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.663', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.086', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '62.000'} [2024-08-06 06:29:24,754][52650] Updated weights for policy 0, policy_version 69211 (0.0036) [2024-08-06 06:29:24,838][52614] Signal inference workers to stop experience collection... (12600 times) [2024-08-06 06:29:24,838][52614] Signal inference workers to resume experience collection... (12600 times) [2024-08-06 06:29:24,868][52650] InferenceWorker_p0-w0: stopping experience collection (12600 times) [2024-08-06 06:29:24,868][52650] InferenceWorker_p0-w0: resuming experience collection (12600 times) [2024-08-06 06:29:25,285][52668] DAMAGECOUNT value on done: 739216.0 [2024-08-06 06:29:25,285][52668] Sum rewards: 74.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:25,753][52662] DAMAGECOUNT value on done: 749118.0 [2024-08-06 06:29:25,753][52662] Sum rewards: 73.348, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.552', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.204', 'weapon4': '0.214', 'AMMO4': '0.254', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '61.000'} [2024-08-06 06:29:27,465][52647] DAMAGECOUNT value on done: 793950.0 [2024-08-06 06:29:27,465][52647] Sum rewards: 56.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.884', 'AMMO5': '0.028', 'AMMO2': '0.085', 'AMMO3': '0.204', 'weapon4': '0.256', 'weapon2': '0.282', 'weapon5': '0.364', 'AMMO4': '0.425', 'WEAPON5': '0.750', 'WEAPON4': '0.850', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '47.500'} [2024-08-06 06:29:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 567025664. Throughput: 0: 4367.4. Samples: 141765430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:27,794][52567] Avg episode reward: [(0, '73.503')] [2024-08-06 06:29:27,991][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:29:28,099][52668] DAMAGECOUNT value on done: 739304.0 [2024-08-06 06:29:28,100][52668] Sum rewards: 71.630, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.787', 'AMMO5': '0.022', 'AMMO2': '0.043', 'weapon4': '0.078', 'AMMO3': '0.203', 'AMMO4': '0.214', 'weapon5': '0.230', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:28,491][52662] DAMAGECOUNT value on done: 751576.0 [2024-08-06 06:29:28,495][52662] Sum rewards: 67.255, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.022', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.062', 'weapon4': '0.088', 'AMMO4': '0.145', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.366', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.000'} [2024-08-06 06:29:28,672][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:29:29,276][52650] Updated weights for policy 0, policy_version 69221 (0.0014) [2024-08-06 06:29:29,885][52660] DAMAGECOUNT value on done: 751528.0 [2024-08-06 06:29:29,887][52660] Sum rewards: 78.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.143', 'weapon5': '0.168', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '65.000'} [2024-08-06 06:29:30,400][52647] DAMAGECOUNT value on done: 781736.0 [2024-08-06 06:29:30,401][52647] Sum rewards: 66.843, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.445', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.088', 'AMMO3': '0.195', 'weapon5': '0.210', 'AMMO4': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.150', 'HITCOUNT': '2.790', 'weapon3': '2.992', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '54.000'} [2024-08-06 06:29:31,204][52668] DAMAGECOUNT value on done: 739177.0 [2024-08-06 06:29:31,205][52668] Sum rewards: 73.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.098', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.610', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '60.000'} [2024-08-06 06:29:31,457][52662] DAMAGECOUNT value on done: 746393.0 [2024-08-06 06:29:31,458][52662] Sum rewards: 82.781, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.307', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon4': '0.140', 'weapon5': '0.174', 'weapon2': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.456', 'FRAGCOUNT': '69.000'} [2024-08-06 06:29:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 567115776. Throughput: 0: 4370.7. Samples: 141778640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:32,794][52567] Avg episode reward: [(0, '73.400')] [2024-08-06 06:29:33,048][52660] DAMAGECOUNT value on done: 741877.0 [2024-08-06 06:29:33,048][52660] Sum rewards: 68.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.313', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.175', 'AMMO3': '0.197', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '56.000'} [2024-08-06 06:29:33,532][52647] DAMAGECOUNT value on done: 788435.0 [2024-08-06 06:29:33,533][52647] Sum rewards: 83.399, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.198', 'AMMO4': '-0.022', 'AMMO2': '-0.004', 'AMMO3': '0.189', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.330', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '67.000'} [2024-08-06 06:29:34,113][52650] Updated weights for policy 0, policy_version 69231 (0.0021) [2024-08-06 06:29:34,263][52668] DAMAGECOUNT value on done: 750407.0 [2024-08-06 06:29:34,264][52668] Sum rewards: 72.732, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.707', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon4': '0.068', 'AMMO4': '0.159', 'AMMO3': '0.179', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:34,407][52662] DAMAGECOUNT value on done: 757695.0 [2024-08-06 06:29:34,409][52662] Sum rewards: 74.120, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.020', 'HEALTH': '0.025', 'AMMO4': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.151', 'weapon2': '0.420', 'WEAPON3': '0.900', 'weapon3': '3.386', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '59.000'} [2024-08-06 06:29:35,772][52794] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:29:36,006][52660] DAMAGECOUNT value on done: 753085.0 [2024-08-06 06:29:36,007][52660] Sum rewards: 72.803, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.252', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.170', 'weapon5': '0.172', 'AMMO3': '0.238', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '62.000'} [2024-08-06 06:29:36,718][52647] DAMAGECOUNT value on done: 777295.0 [2024-08-06 06:29:36,719][52647] Sum rewards: 60.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.114', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.074', 'AMMO3': '0.223', 'AMMO4': '0.271', 'weapon5': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.730', 'weapon3': '2.788', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '52.000'} [2024-08-06 06:29:37,087][52668] DAMAGECOUNT value on done: 751962.0 [2024-08-06 06:29:37,091][52668] Sum rewards: 90.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.891', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.108', 'AMMO4': '0.151', 'weapon5': '0.178', 'AMMO3': '0.217', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '74.000'} [2024-08-06 06:29:37,293][52662] DAMAGECOUNT value on done: 745140.0 [2024-08-06 06:29:37,294][52662] Sum rewards: 76.149, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.766', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.123', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '61.000'} [2024-08-06 06:29:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 567205888. Throughput: 0: 4376.4. Samples: 141805030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 06:29:37,795][52567] Avg episode reward: [(0, '73.377')] [2024-08-06 06:29:38,392][52650] Updated weights for policy 0, policy_version 69241 (0.0024) [2024-08-06 06:29:38,857][52660] DAMAGECOUNT value on done: 761607.0 [2024-08-06 06:29:38,857][52660] Sum rewards: 60.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.032', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.196', 'AMMO3': '0.197', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '51.000'} [2024-08-06 06:29:39,792][52662] DAMAGECOUNT value on done: 760787.0 [2024-08-06 06:29:39,793][52662] Sum rewards: 70.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.084', 'AMMO4': '0.175', 'weapon2': '0.238', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '60.000'} [2024-08-06 06:29:39,857][52647] DAMAGECOUNT value on done: 784097.0 [2024-08-06 06:29:39,857][52647] Sum rewards: 77.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.762', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.080', 'AMMO4': '0.197', 'weapon5': '0.212', 'AMMO3': '0.255', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '65.000'} [2024-08-06 06:29:40,160][52668] DAMAGECOUNT value on done: 748585.0 [2024-08-06 06:29:40,162][52668] Sum rewards: 76.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.170', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'weapon4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:41,500][52667] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.10200000000000001, -34.0), ('weapon5', 0.002)] [2024-08-06 06:29:41,586][52660] DAMAGECOUNT value on done: 747659.0 [2024-08-06 06:29:41,586][52660] Sum rewards: 82.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.586', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.027', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.187', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.426', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '68.000'} [2024-08-06 06:29:42,763][52662] DAMAGECOUNT value on done: 756550.0 [2024-08-06 06:29:42,766][52662] Sum rewards: 66.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.112', 'weapon5': '0.144', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.600', 'weapon3': '2.830', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '56.000'} [2024-08-06 06:29:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 567287808. Throughput: 0: 4380.0. Samples: 141831390. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:29:42,795][52567] Avg episode reward: [(0, '73.437')] [2024-08-06 06:29:42,907][52668] DAMAGECOUNT value on done: 754698.0 [2024-08-06 06:29:42,907][52668] Sum rewards: 80.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.018', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '66.000'} [2024-08-06 06:29:43,046][52662] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:29:43,075][52794] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:29:43,261][52650] Updated weights for policy 0, policy_version 69251 (0.0014) [2024-08-06 06:29:44,635][52660] DAMAGECOUNT value on done: 740839.0 [2024-08-06 06:29:44,635][52660] Sum rewards: 75.642, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.082', 'weapon5': '0.082', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 06:29:45,967][52668] DAMAGECOUNT value on done: 755113.0 [2024-08-06 06:29:45,968][52668] Sum rewards: 61.049, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.030', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.108', 'AMMO3': '0.180', 'AMMO4': '0.216', 'weapon4': '0.226', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '3.134', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '51.000'} [2024-08-06 06:29:46,368][52662] DAMAGECOUNT value on done: 742675.0 [2024-08-06 06:29:46,368][52662] Sum rewards: 76.203, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.130', 'weapon5': '0.160', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'HEALTH': '0.299', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '0.950', 'weapon3': '3.204', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '61.000'} [2024-08-06 06:29:46,625][52664] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:29:47,557][52660] DAMAGECOUNT value on done: 751146.0 [2024-08-06 06:29:47,557][52660] Sum rewards: 82.006, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.820', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.124', 'AMMO4': '0.157', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '69.000'} [2024-08-06 06:29:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 567377920. Throughput: 0: 4387.1. Samples: 141844440. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:29:47,795][52567] Avg episode reward: [(0, '73.472')] [2024-08-06 06:29:48,234][52650] Updated weights for policy 0, policy_version 69261 (0.0012) [2024-08-06 06:29:49,498][52662] DAMAGECOUNT value on done: 752901.0 [2024-08-06 06:29:49,500][52662] Sum rewards: 79.864, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.957', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO3': '0.164', 'weapon2': '0.186', 'AMMO4': '0.198', 'weapon5': '0.202', 'weapon4': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:50,525][52660] DAMAGECOUNT value on done: 759238.0 [2024-08-06 06:29:50,526][52660] Sum rewards: 83.524, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.899', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.172', 'AMMO3': '0.177', 'weapon2': '0.192', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '67.000'} [2024-08-06 06:29:52,082][52649] DAMAGECOUNT value on done: 730060.0 [2024-08-06 06:29:52,083][52649] Sum rewards: 74.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.366', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.256', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.394', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:52,338][52662] DAMAGECOUNT value on done: 743515.0 [2024-08-06 06:29:52,338][52662] Sum rewards: 72.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.188', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '61.000'} [2024-08-06 06:29:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 567459840. Throughput: 0: 4383.3. Samples: 141870640. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:29:52,794][52567] Avg episode reward: [(0, '73.373')] [2024-08-06 06:29:52,951][52650] Updated weights for policy 0, policy_version 69271 (0.0013) [2024-08-06 06:29:53,719][52660] DAMAGECOUNT value on done: 743479.0 [2024-08-06 06:29:53,719][52660] Sum rewards: 70.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.241', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.380', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '60.000'} [2024-08-06 06:29:54,126][52659] DAMAGECOUNT value on done: 753913.0 [2024-08-06 06:29:54,127][52659] Sum rewards: 62.483, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.000', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.084', 'AMMO3': '0.144', 'weapon5': '0.164', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.778', 'WEAPON3': '0.950', 'weapon3': '2.788', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '49.000'} [2024-08-06 06:29:55,394][52649] DAMAGECOUNT value on done: 721094.0 [2024-08-06 06:29:55,397][52649] Sum rewards: 78.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.109', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '64.000'} [2024-08-06 06:29:56,848][52660] DAMAGECOUNT value on done: 745648.0 [2024-08-06 06:29:56,849][52660] Sum rewards: 80.221, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.161', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.218', 'weapon5': '0.270', 'HEALTH': '0.288', 'WEAPON4': '0.300', 'weapon4': '0.526', 'WEAPON3': '0.900', 'weapon3': '2.458', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '63.000'} [2024-08-06 06:29:56,941][52820] Large shaping reward 3.426 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.375, 125.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:29:57,081][52659] DAMAGECOUNT value on done: 753831.0 [2024-08-06 06:29:57,082][52659] Sum rewards: 77.181, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.637', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.219', 'AMMO4': '0.237', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '66.000'} [2024-08-06 06:29:57,483][52650] Updated weights for policy 0, policy_version 69281 (0.0012) [2024-08-06 06:29:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 567549952. Throughput: 0: 4376.1. Samples: 141896710. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:29:57,794][52567] Avg episode reward: [(0, '73.256')] [2024-08-06 06:29:58,240][52649] DAMAGECOUNT value on done: 741453.0 [2024-08-06 06:29:58,241][52649] Sum rewards: 66.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.140', 'weapon4': '0.178', 'AMMO3': '0.232', 'AMMO4': '0.247', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '56.000'} [2024-08-06 06:29:59,766][52660] DAMAGECOUNT value on done: 751740.0 [2024-08-06 06:29:59,768][52660] Sum rewards: 74.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.794', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.134', 'AMMO4': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:00,193][52659] DAMAGECOUNT value on done: 755983.0 [2024-08-06 06:30:00,193][52659] Sum rewards: 75.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.044', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '63.000'} [2024-08-06 06:30:01,012][52649] DAMAGECOUNT value on done: 735104.0 [2024-08-06 06:30:01,014][52649] Sum rewards: 67.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.615', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.000'} [2024-08-06 06:30:01,890][52650] Updated weights for policy 0, policy_version 69291 (0.0012) [2024-08-06 06:30:02,272][52660] DAMAGECOUNT value on done: 742915.0 [2024-08-06 06:30:02,272][52660] Sum rewards: 72.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.996', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.076', 'AMMO4': '0.146', 'weapon5': '0.174', 'AMMO3': '0.212', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '59.000'} [2024-08-06 06:30:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 567640064. Throughput: 0: 4375.1. Samples: 141909910. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:30:02,795][52567] Avg episode reward: [(0, '73.465')] [2024-08-06 06:30:03,557][52659] DAMAGECOUNT value on done: 756093.0 [2024-08-06 06:30:03,559][52659] Sum rewards: 91.385, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.820', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.091', 'weapon5': '0.142', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.588', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '73.000'} [2024-08-06 06:30:04,243][52649] DAMAGECOUNT value on done: 725850.0 [2024-08-06 06:30:04,245][52649] Sum rewards: 87.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.092', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.132', 'AMMO3': '0.177', 'weapon4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.910', 'FRAGCOUNT': '70.000'} [2024-08-06 06:30:05,326][52660] DAMAGECOUNT value on done: 751436.0 [2024-08-06 06:30:05,326][52660] Sum rewards: 73.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.068', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.234', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.280', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '63.000'} [2024-08-06 06:30:06,145][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:30:06,409][52659] DAMAGECOUNT value on done: 753259.0 [2024-08-06 06:30:06,409][52659] Sum rewards: 77.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.475', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO3': '0.199', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '65.000'} [2024-08-06 06:30:06,939][52650] Updated weights for policy 0, policy_version 69301 (0.0025) [2024-08-06 06:30:07,277][52649] DAMAGECOUNT value on done: 739749.0 [2024-08-06 06:30:07,277][52649] Sum rewards: 60.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.215', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '50.000'} [2024-08-06 06:30:07,308][52667] DAMAGECOUNT value on done: 752789.0 [2024-08-06 06:30:07,308][52667] Sum rewards: 72.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.135', 'weapon5': '0.168', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.652', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '60.000'} [2024-08-06 06:30:07,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 567730176. Throughput: 0: 4374.0. Samples: 141936180. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:30:07,795][52567] Avg episode reward: [(0, '73.725')] [2024-08-06 06:30:08,450][52660] DAMAGECOUNT value on done: 761035.0 [2024-08-06 06:30:08,450][52660] Sum rewards: 87.471, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.480', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.100', 'AMMO4': '0.177', 'weapon5': '0.192', 'AMMO3': '0.246', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.915', 'FRAGCOUNT': '74.000'} [2024-08-06 06:30:09,351][52659] DAMAGECOUNT value on done: 754907.0 [2024-08-06 06:30:09,353][52659] Sum rewards: 73.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.076', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.590', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 06:30:10,430][52667] DAMAGECOUNT value on done: 758730.0 [2024-08-06 06:30:10,474][52667] Sum rewards: 68.125, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.130', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.152', 'weapon5': '0.156', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '60.000'} [2024-08-06 06:30:10,620][52649] DAMAGECOUNT value on done: 734962.0 [2024-08-06 06:30:10,622][52649] Sum rewards: 70.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.605', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.167', 'AMMO4': '0.183', 'weapon5': '0.232', 'weapon4': '0.248', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '57.000'} [2024-08-06 06:30:10,924][52660] DAMAGECOUNT value on done: 768609.0 [2024-08-06 06:30:10,927][52660] Sum rewards: 67.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.875', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.047', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '54.000'} [2024-08-06 06:30:11,288][52650] Updated weights for policy 0, policy_version 69311 (0.0025) [2024-08-06 06:30:12,256][52659] DAMAGECOUNT value on done: 754612.0 [2024-08-06 06:30:12,256][52659] Sum rewards: 70.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.576', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.110', 'weapon4': '0.152', 'AMMO4': '0.169', 'AMMO3': '0.205', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '58.000'} [2024-08-06 06:30:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17614.5, 300 sec: 17467.0). Total num frames: 567820288. Throughput: 0: 4374.2. Samples: 141962270. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:30:12,795][52567] Avg episode reward: [(0, '73.628')] [2024-08-06 06:30:13,268][52649] DAMAGECOUNT value on done: 736742.0 [2024-08-06 06:30:13,269][52649] Sum rewards: 74.519, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.175', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.072', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '3.222', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 06:30:13,367][52667] DAMAGECOUNT value on done: 756204.0 [2024-08-06 06:30:13,369][52667] Sum rewards: 79.997, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '67.000'} [2024-08-06 06:30:13,939][52660] DAMAGECOUNT value on done: 747153.0 [2024-08-06 06:30:13,940][52660] Sum rewards: 73.100, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.150', 'weapon5': '0.158', 'weapon2': '0.226', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '63.000'} [2024-08-06 06:30:15,108][52659] DAMAGECOUNT value on done: 751533.0 [2024-08-06 06:30:15,140][52659] Sum rewards: 84.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.480', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.251', 'weapon2': '0.374', 'WEAPON3': '1.600', 'weapon3': '3.380', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '72.500'} [2024-08-06 06:30:15,810][52650] Updated weights for policy 0, policy_version 69321 (0.0014) [2024-08-06 06:30:15,815][52649] DAMAGECOUNT value on done: 737014.0 [2024-08-06 06:30:15,818][52649] Sum rewards: 72.380, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.432', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.102', 'weapon5': '0.156', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '59.000'} [2024-08-06 06:30:16,574][52667] DAMAGECOUNT value on done: 761866.0 [2024-08-06 06:30:16,577][52667] Sum rewards: 66.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.067', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '55.000'} [2024-08-06 06:30:17,112][52660] DAMAGECOUNT value on done: 755658.0 [2024-08-06 06:30:17,112][52660] Sum rewards: 73.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.186', 'AMMO3': '0.191', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.000'} [2024-08-06 06:30:17,673][52659] DAMAGECOUNT value on done: 756371.0 [2024-08-06 06:30:17,674][52659] Sum rewards: 77.944, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.102', 'AMMO3': '0.139', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.668', 'WEAPON3': '0.950', 'weapon3': '2.684', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '61.000'} [2024-08-06 06:30:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 567902208. Throughput: 0: 4370.7. Samples: 141975320. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:30:17,794][52567] Avg episode reward: [(0, '73.418')] [2024-08-06 06:30:18,208][52649] DAMAGECOUNT value on done: 729582.0 [2024-08-06 06:30:18,211][52649] Sum rewards: 72.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.398', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '63.000'} [2024-08-06 06:30:18,567][52794] DAMAGECOUNT value on done: 749521.0 [2024-08-06 06:30:18,567][52794] Sum rewards: 76.622, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.180', 'AMMO3': '0.186', 'AMMO4': '0.198', 'HEALTH': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '61.000'} [2024-08-06 06:30:19,699][52667] DAMAGECOUNT value on done: 762937.0 [2024-08-06 06:30:19,703][52667] Sum rewards: 74.655, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.970', 'AMMO5': '0.006', 'weapon4': '0.024', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'AMMO3': '0.303', 'WEAPON3': '1.850', 'weapon3': '3.362', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '67.000'} [2024-08-06 06:30:20,182][52659] DAMAGECOUNT value on done: 760193.0 [2024-08-06 06:30:20,183][52659] Sum rewards: 63.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.196', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.584', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '54.000'} [2024-08-06 06:30:20,223][52670] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2024-08-06 06:30:20,362][52660] DAMAGECOUNT value on done: 751428.0 [2024-08-06 06:30:20,364][52660] Sum rewards: 76.761, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.157', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.064', 'AMMO4': '0.142', 'weapon5': '0.164', 'AMMO3': '0.197', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '62.000'} [2024-08-06 06:30:20,812][52650] Updated weights for policy 0, policy_version 69331 (0.0014) [2024-08-06 06:30:21,402][52649] DAMAGECOUNT value on done: 742035.0 [2024-08-06 06:30:21,402][52649] Sum rewards: 88.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.486', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.098', 'weapon5': '0.214', 'AMMO3': '0.216', 'AMMO4': '0.223', 'weapon2': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.111', 'FRAGCOUNT': '72.000'} [2024-08-06 06:30:21,831][52794] DAMAGECOUNT value on done: 758926.0 [2024-08-06 06:30:21,832][52794] Sum rewards: 69.920, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.611', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.174', 'weapon4': '0.218', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '55.000'} [2024-08-06 06:30:22,397][52667] DAMAGECOUNT value on done: 762232.0 [2024-08-06 06:30:22,397][52667] Sum rewards: 80.572, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.152', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.442', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '69.000'} [2024-08-06 06:30:22,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 567984128. Throughput: 0: 4366.9. Samples: 142001540. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:30:22,794][52567] Avg episode reward: [(0, '74.105')] [2024-08-06 06:30:23,080][52659] DAMAGECOUNT value on done: 749074.0 [2024-08-06 06:30:23,082][52659] Sum rewards: 73.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.123', 'weapon5': '0.126', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.790', 'WEAPON3': '1.100', 'weapon3': '2.678', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '58.000'} [2024-08-06 06:30:23,292][52660] DAMAGECOUNT value on done: 744025.0 [2024-08-06 06:30:23,293][52660] Sum rewards: 65.333, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.193', 'weapon2': '0.396', 'HEALTH': '0.590', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.392', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '53.000'} [2024-08-06 06:30:24,546][52794] DAMAGECOUNT value on done: 763349.0 [2024-08-06 06:30:24,548][52794] Sum rewards: 64.708, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.843', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.175', 'weapon5': '0.176', 'weapon2': '0.182', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.326', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 06:30:24,938][52649] DAMAGECOUNT value on done: 744446.0 [2024-08-06 06:30:24,939][52649] Sum rewards: 87.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.207', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.044', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.336', 'FRAGCOUNT': '73.000'} [2024-08-06 06:30:25,325][52667] DAMAGECOUNT value on done: 756869.0 [2024-08-06 06:30:25,327][52667] Sum rewards: 74.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.068', 'AMMO4': '0.202', 'AMMO3': '0.206', 'weapon5': '0.210', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '61.000'} [2024-08-06 06:30:25,479][52650] Updated weights for policy 0, policy_version 69341 (0.0012) [2024-08-06 06:30:25,628][52660] DAMAGECOUNT value on done: 743581.0 [2024-08-06 06:30:25,629][52660] Sum rewards: 81.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.191', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.092', 'AMMO4': '0.203', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon4': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '68.000'} [2024-08-06 06:30:26,125][52659] DAMAGECOUNT value on done: 757886.0 [2024-08-06 06:30:26,125][52659] Sum rewards: 72.481, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO2': '0.015', 'AMMO5': '0.015', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.075', 'weapon2': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'weapon3': '3.544', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '61.500'} [2024-08-06 06:30:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 568082432. Throughput: 0: 4363.8. Samples: 142027760. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:30:27,794][52567] Avg episode reward: [(0, '73.899')] [2024-08-06 06:30:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069346_568082432.pth... [2024-08-06 06:30:27,914][52794] DAMAGECOUNT value on done: 747272.0 [2024-08-06 06:30:27,915][52794] Sum rewards: 72.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.811', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'AMMO3': '0.171', 'weapon5': '0.190', 'WEAPON5': '0.200', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.050', 'weapon3': '2.978', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '57.000'} [2024-08-06 06:30:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000068834_563888128.pth [2024-08-06 06:30:28,083][52649] DAMAGECOUNT value on done: 741357.0 [2024-08-06 06:30:28,084][52649] Sum rewards: 63.185, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.868', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.080', 'weapon5': '0.096', 'AMMO3': '0.125', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon2': '1.040', 'weapon3': '2.602', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '50.000'} [2024-08-06 06:30:28,447][52667] DAMAGECOUNT value on done: 754069.0 [2024-08-06 06:30:28,450][52667] Sum rewards: 71.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.140', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.122', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.340', 'weapon3': '3.362', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '58.000'} [2024-08-06 06:30:28,896][52659] DAMAGECOUNT value on done: 754067.0 [2024-08-06 06:30:28,897][52659] Sum rewards: 78.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO3': '0.257', 'weapon2': '0.290', 'WEAPON3': '1.550', 'weapon3': '3.550', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '67.000'} [2024-08-06 06:30:29,203][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:30:30,440][52650] Updated weights for policy 0, policy_version 69351 (0.0038) [2024-08-06 06:30:31,422][52794] DAMAGECOUNT value on done: 749206.0 [2024-08-06 06:30:31,426][52794] Sum rewards: 66.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.376', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '57.000'} [2024-08-06 06:30:31,472][52649] DAMAGECOUNT value on done: 743133.0 [2024-08-06 06:30:31,474][52649] Sum rewards: 69.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '57.000'} [2024-08-06 06:30:31,622][52667] DAMAGECOUNT value on done: 757024.0 [2024-08-06 06:30:31,622][52667] Sum rewards: 83.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.102', 'weapon5': '0.162', 'AMMO4': '0.225', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '70.000'} [2024-08-06 06:30:32,087][52659] DAMAGECOUNT value on done: 753768.0 [2024-08-06 06:30:32,088][52659] Sum rewards: 61.472, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.340', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.332', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '48.000'} [2024-08-06 06:30:32,751][52649] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2024-08-06 06:30:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 568164352. Throughput: 0: 4359.3. Samples: 142040610. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:30:32,794][52567] Avg episode reward: [(0, '74.121')] [2024-08-06 06:30:34,527][52794] DAMAGECOUNT value on done: 754825.0 [2024-08-06 06:30:34,532][52794] Sum rewards: 83.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.710', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '68.000'} [2024-08-06 06:30:34,572][52649] DAMAGECOUNT value on done: 728432.0 [2024-08-06 06:30:34,573][52649] Sum rewards: 83.820, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.481', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.084', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.306', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '65.000'} [2024-08-06 06:30:34,663][52667] DAMAGECOUNT value on done: 764374.0 [2024-08-06 06:30:34,664][52667] Sum rewards: 74.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.096', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.095', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '62.000'} [2024-08-06 06:30:34,872][52650] Updated weights for policy 0, policy_version 69361 (0.0023) [2024-08-06 06:30:34,910][52659] DAMAGECOUNT value on done: 759009.0 [2024-08-06 06:30:34,912][52659] Sum rewards: 79.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.762', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.136', 'AMMO3': '0.206', 'weapon5': '0.248', 'AMMO4': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:37,610][52794] DAMAGECOUNT value on done: 758525.0 [2024-08-06 06:30:37,610][52794] Sum rewards: 72.647, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '61.000'} [2024-08-06 06:30:37,781][52667] DAMAGECOUNT value on done: 754162.0 [2024-08-06 06:30:37,781][52667] Sum rewards: 71.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.405', 'AMMO2': '0.002', 'AMMO4': '0.011', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.247', 'weapon2': '0.424', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '62.000'} [2024-08-06 06:30:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 568254464. Throughput: 0: 4356.9. Samples: 142066700. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:30:37,794][52567] Avg episode reward: [(0, '74.397')] [2024-08-06 06:30:38,018][52659] DAMAGECOUNT value on done: 756797.0 [2024-08-06 06:30:38,018][52659] Sum rewards: 78.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.132', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:38,073][52649] DAMAGECOUNT value on done: 738643.0 [2024-08-06 06:30:38,073][52649] Sum rewards: 70.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.270', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.088', 'AMMO3': '0.161', 'weapon4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.000', 'HITCOUNT': '3.130', 'weapon3': '3.132', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '56.000'} [2024-08-06 06:30:40,039][52650] Updated weights for policy 0, policy_version 69371 (0.0012) [2024-08-06 06:30:40,894][52659] DAMAGECOUNT value on done: 763202.0 [2024-08-06 06:30:40,894][52659] Sum rewards: 64.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.152', 'AMMO4': '0.179', 'AMMO3': '0.191', 'weapon5': '0.236', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '52.000'} [2024-08-06 06:30:40,916][52667] DAMAGECOUNT value on done: 756066.0 [2024-08-06 06:30:40,918][52667] Sum rewards: 69.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.029', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.210', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '56.000'} [2024-08-06 06:30:41,020][52794] DAMAGECOUNT value on done: 744851.0 [2024-08-06 06:30:41,021][52794] Sum rewards: 83.317, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.163', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'AMMO3': '0.195', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.208', 'FRAGCOUNT': '67.000'} [2024-08-06 06:30:41,230][52665] DAMAGECOUNT value on done: 740942.0 [2024-08-06 06:30:41,230][52665] Sum rewards: 79.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.013', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.086', 'AMMO4': '0.117', 'weapon5': '0.186', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:41,569][52649] DAMAGECOUNT value on done: 724766.0 [2024-08-06 06:30:41,570][52649] Sum rewards: 72.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.444', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.124', 'weapon4': '0.152', 'weapon2': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '62.000'} [2024-08-06 06:30:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 568336384. Throughput: 0: 4343.5. Samples: 142092170. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:30:42,794][52567] Avg episode reward: [(0, '74.191')] [2024-08-06 06:30:43,612][52659] DAMAGECOUNT value on done: 751852.0 [2024-08-06 06:30:43,614][52659] Sum rewards: 79.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.447', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.104', 'weapon5': '0.118', 'AMMO4': '0.120', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.352', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:43,794][52667] DAMAGECOUNT value on done: 762768.0 [2024-08-06 06:30:43,794][52667] Sum rewards: 73.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.058', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '62.000'} [2024-08-06 06:30:44,039][52794] DAMAGECOUNT value on done: 756668.0 [2024-08-06 06:30:44,039][52794] Sum rewards: 76.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.219', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.440', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:44,351][52665] DAMAGECOUNT value on done: 755551.0 [2024-08-06 06:30:44,351][52665] Sum rewards: 68.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.586', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.024', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon5': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.642', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '55.000'} [2024-08-06 06:30:44,514][52650] Updated weights for policy 0, policy_version 69381 (0.0015) [2024-08-06 06:30:44,724][52649] DAMAGECOUNT value on done: 743063.0 [2024-08-06 06:30:44,725][52649] Sum rewards: 82.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.908', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.176', 'AMMO3': '0.184', 'weapon4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '66.000'} [2024-08-06 06:30:45,444][52668] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:30:46,422][52659] DAMAGECOUNT value on done: 760609.0 [2024-08-06 06:30:46,422][52659] Sum rewards: 87.717, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.445', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.474', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '71.000'} [2024-08-06 06:30:46,711][52667] DAMAGECOUNT value on done: 751583.0 [2024-08-06 06:30:46,712][52667] Sum rewards: 87.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.273', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.059', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '74.000'} [2024-08-06 06:30:46,899][52794] DAMAGECOUNT value on done: 749711.0 [2024-08-06 06:30:46,902][52794] Sum rewards: 72.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.215', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.158', 'AMMO4': '0.227', 'AMMO3': '0.286', 'weapon5': '0.336', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.790', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '62.000'} [2024-08-06 06:30:46,982][52665] DAMAGECOUNT value on done: 752118.0 [2024-08-06 06:30:46,983][52665] Sum rewards: 65.763, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon2': '0.194', 'weapon4': '0.232', 'AMMO4': '0.262', 'AMMO3': '0.276', 'weapon5': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.998', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '58.000'} [2024-08-06 06:30:47,370][52649] DAMAGECOUNT value on done: 743749.0 [2024-08-06 06:30:47,370][52649] Sum rewards: 70.256, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.136', 'weapon4': '0.140', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.596', 'WEAPON3': '0.950', 'weapon3': '2.962', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '55.000'} [2024-08-06 06:30:47,796][52567] Fps is (10 sec: 16380.6, 60 sec: 17339.1, 300 sec: 17439.1). Total num frames: 568418304. Throughput: 0: 4337.2. Samples: 142105090. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:30:47,797][52567] Avg episode reward: [(0, '74.658')] [2024-08-06 06:30:48,937][52659] DAMAGECOUNT value on done: 752607.0 [2024-08-06 06:30:48,940][52659] Sum rewards: 78.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '63.000'} [2024-08-06 06:30:49,437][52650] Updated weights for policy 0, policy_version 69391 (0.0018) [2024-08-06 06:30:49,668][52794] DAMAGECOUNT value on done: 746561.0 [2024-08-06 06:30:49,668][52794] Sum rewards: 85.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.414', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.080', 'AMMO4': '0.133', 'weapon5': '0.134', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '69.000'} [2024-08-06 06:30:49,778][52667] DAMAGECOUNT value on done: 758714.0 [2024-08-06 06:30:49,778][52667] Sum rewards: 68.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon5': '0.196', 'weapon4': '0.204', 'AMMO3': '0.207', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '56.000'} [2024-08-06 06:30:49,852][52665] DAMAGECOUNT value on done: 748693.0 [2024-08-06 06:30:49,854][52665] Sum rewards: 69.269, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.254', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.208', 'AMMO3': '0.215', 'weapon4': '0.248', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '58.000'} [2024-08-06 06:30:50,065][52658] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:30:50,203][52649] DAMAGECOUNT value on done: 732878.0 [2024-08-06 06:30:50,204][52649] Sum rewards: 67.599, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.206', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.054', 'AMMO4': '0.172', 'AMMO3': '0.209', 'weapon5': '0.240', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '55.000'} [2024-08-06 06:30:52,451][52794] DAMAGECOUNT value on done: 754828.0 [2024-08-06 06:30:52,454][52794] Sum rewards: 83.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.104', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '69.000'} [2024-08-06 06:30:52,478][52665] DAMAGECOUNT value on done: 735038.0 [2024-08-06 06:30:52,479][52665] Sum rewards: 74.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.533', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.062', 'AMMO4': '0.091', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '62.000'} [2024-08-06 06:30:52,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 568508416. Throughput: 0: 4338.9. Samples: 142131430. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:30:52,795][52567] Avg episode reward: [(0, '74.788')] [2024-08-06 06:30:52,908][52667] DAMAGECOUNT value on done: 764949.0 [2024-08-06 06:30:52,909][52667] Sum rewards: 83.332, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.543', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.134', 'AMMO3': '0.150', 'AMMO4': '0.175', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '3.056', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:54,192][52650] Updated weights for policy 0, policy_version 69401 (0.0018) [2024-08-06 06:30:55,592][52667] DAMAGECOUNT value on done: 761783.0 [2024-08-06 06:30:55,594][52665] DAMAGECOUNT value on done: 740836.0 [2024-08-06 06:30:55,614][52665] Sum rewards: 77.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.384', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.054', 'weapon5': '0.138', 'AMMO3': '0.205', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '64.000'} [2024-08-06 06:30:55,608][52667] Sum rewards: 71.362, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.095', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.122', 'AMMO3': '0.160', 'AMMO4': '0.171', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.380', 'weapon3': '3.454', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '57.000'} [2024-08-06 06:30:55,615][52794] DAMAGECOUNT value on done: 752124.0 [2024-08-06 06:30:55,615][52794] Sum rewards: 66.445, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.174', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO3': '0.166', 'AMMO4': '0.171', 'weapon5': '0.208', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.076', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '53.500'} [2024-08-06 06:30:57,185][52811] DAMAGECOUNT value on done: 718005.0 [2024-08-06 06:30:57,186][52811] Sum rewards: 64.144, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.201', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.194', 'weapon4': '0.200', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '52.000'} [2024-08-06 06:30:57,794][52567] Fps is (10 sec: 18026.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 568598528. Throughput: 0: 4338.9. Samples: 142157520. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:30:57,794][52567] Avg episode reward: [(0, '74.664')] [2024-08-06 06:30:58,564][52650] Updated weights for policy 0, policy_version 69411 (0.0012) [2024-08-06 06:30:58,593][52665] DAMAGECOUNT value on done: 747070.0 [2024-08-06 06:30:58,593][52665] Sum rewards: 68.725, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.612', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '56.000'} [2024-08-06 06:30:58,665][52667] DAMAGECOUNT value on done: 761828.0 [2024-08-06 06:30:58,665][52667] Sum rewards: 79.643, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.938', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.468', 'WEAPON3': '1.600', 'weapon3': '3.216', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '68.000'} [2024-08-06 06:30:58,692][52794] DAMAGECOUNT value on done: 768419.0 [2024-08-06 06:30:58,692][52794] Sum rewards: 63.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.517', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.112', 'AMMO3': '0.182', 'AMMO4': '0.230', 'weapon5': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.718', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '50.500'} [2024-08-06 06:31:00,365][52811] DAMAGECOUNT value on done: 700515.0 [2024-08-06 06:31:00,368][52811] Sum rewards: 75.604, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.320', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.163', 'AMMO4': '0.226', 'weapon5': '0.226', 'weapon2': '0.286', 'weapon4': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:01,695][52667] DAMAGECOUNT value on done: 758352.0 [2024-08-06 06:31:01,696][52667] Sum rewards: 83.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.732', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '70.000'} [2024-08-06 06:31:01,733][52665] DAMAGECOUNT value on done: 745107.0 [2024-08-06 06:31:01,733][52665] Sum rewards: 65.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.216', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon5': '0.168', 'AMMO4': '0.247', 'AMMO3': '0.248', 'weapon2': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.178', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '56.500'} [2024-08-06 06:31:01,736][52660] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:31:01,878][52794] DAMAGECOUNT value on done: 748177.0 [2024-08-06 06:31:01,879][52794] Sum rewards: 85.176, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.236', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.090', 'weapon5': '0.096', 'AMMO4': '0.140', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.141', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:02,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 568680448. Throughput: 0: 4341.6. Samples: 142170690. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 06:31:02,794][52567] Avg episode reward: [(0, '74.704')] [2024-08-06 06:31:03,331][52650] Updated weights for policy 0, policy_version 69421 (0.0013) [2024-08-06 06:31:03,472][52811] DAMAGECOUNT value on done: 699251.0 [2024-08-06 06:31:03,472][52811] Sum rewards: 60.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.695', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO4': '0.166', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.194', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '50.000'} [2024-08-06 06:31:04,204][52667] DAMAGECOUNT value on done: 764852.0 [2024-08-06 06:31:04,224][52667] Sum rewards: 81.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.010', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.050', 'AMMO4': '0.157', 'weapon5': '0.162', 'AMMO3': '0.216', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:04,620][52665] DAMAGECOUNT value on done: 752961.0 [2024-08-06 06:31:04,621][52665] Sum rewards: 74.884, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.080', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:04,633][52662] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2024-08-06 06:31:04,899][52794] DAMAGECOUNT value on done: 762686.0 [2024-08-06 06:31:04,899][52794] Sum rewards: 79.750, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.076', 'weapon4': '0.116', 'AMMO4': '0.192', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:06,535][52811] DAMAGECOUNT value on done: 700635.0 [2024-08-06 06:31:06,539][52811] Sum rewards: 73.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.972', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:07,047][52665] DAMAGECOUNT value on done: 745061.0 [2024-08-06 06:31:07,049][52665] Sum rewards: 76.441, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.172', 'AMMO4': '0.182', 'AMMO3': '0.209', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.316', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '63.000'} [2024-08-06 06:31:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 568770560. Throughput: 0: 4336.7. Samples: 142196690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:07,794][52567] Avg episode reward: [(0, '74.544')] [2024-08-06 06:31:08,003][52794] DAMAGECOUNT value on done: 758380.0 [2024-08-06 06:31:08,005][52794] Sum rewards: 64.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.654', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.249', 'weapon4': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '55.000'} [2024-08-06 06:31:08,075][52650] Updated weights for policy 0, policy_version 69431 (0.0012) [2024-08-06 06:31:09,636][52811] DAMAGECOUNT value on done: 707472.0 [2024-08-06 06:31:09,640][52811] Sum rewards: 66.993, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.392', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.126', 'AMMO4': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.303', 'weapon2': '0.510', 'WEAPON3': '1.800', 'weapon3': '3.036', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:09,649][52665] DAMAGECOUNT value on done: 754520.0 [2024-08-06 06:31:09,649][52665] Sum rewards: 75.863, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.078', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.216', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:10,691][52794] DAMAGECOUNT value on done: 758376.0 [2024-08-06 06:31:10,691][52794] Sum rewards: 56.532, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.250', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.148', 'AMMO3': '0.153', 'AMMO4': '0.232', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.638', 'WEAPON3': '0.950', 'weapon3': '2.596', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '14.415', 'FRAGCOUNT': '45.000'} [2024-08-06 06:31:11,028][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:31:11,292][52663] DAMAGECOUNT value on done: 768849.0 [2024-08-06 06:31:11,292][52663] Sum rewards: 80.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'weapon4': '0.184', 'AMMO3': '0.225', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:12,268][52665] DAMAGECOUNT value on done: 752486.0 [2024-08-06 06:31:12,280][52665] Sum rewards: 72.261, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.124', 'AMMO4': '0.136', 'weapon5': '0.142', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.284', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:12,710][52811] DAMAGECOUNT value on done: 714253.0 [2024-08-06 06:31:12,711][52650] Updated weights for policy 0, policy_version 69441 (0.0017) [2024-08-06 06:31:12,714][52811] Sum rewards: 87.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.352', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 568860672. Throughput: 0: 4336.0. Samples: 142222880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:12,794][52567] Avg episode reward: [(0, '74.435')] [2024-08-06 06:31:13,137][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:31:13,281][52794] DAMAGECOUNT value on done: 768078.0 [2024-08-06 06:31:13,282][52794] Sum rewards: 88.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.192', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.384', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:13,315][52664] DAMAGECOUNT value on done: 780399.0 [2024-08-06 06:31:13,316][52664] Sum rewards: 59.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.914', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.094', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.496', 'WEAPON3': '1.200', 'HITCOUNT': '3.040', 'weapon3': '3.156', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2024-08-06 06:31:13,872][52663] DAMAGECOUNT value on done: 754729.0 [2024-08-06 06:31:13,872][52663] Sum rewards: 81.258, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.971', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'weapon5': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.358', 'WEAPON3': '1.700', 'weapon3': '3.232', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '69.000'} [2024-08-06 06:31:14,871][52658] DAMAGECOUNT value on done: 756737.0 [2024-08-06 06:31:14,879][52658] Sum rewards: 77.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO5': '0.014', 'AMMO2': '0.058', 'AMMO3': '0.189', 'weapon5': '0.200', 'AMMO4': '0.289', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:15,456][52665] DAMAGECOUNT value on done: 748169.0 [2024-08-06 06:31:15,457][52665] Sum rewards: 79.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.116', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '65.000'} [2024-08-06 06:31:15,777][52664] DAMAGECOUNT value on done: 787541.0 [2024-08-06 06:31:15,778][52664] Sum rewards: 70.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.113', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.704', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:15,797][52811] DAMAGECOUNT value on done: 708709.0 [2024-08-06 06:31:15,797][52811] Sum rewards: 68.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.878', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.190', 'AMMO4': '0.219', 'AMMO3': '0.227', 'weapon4': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '2.634', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '57.000'} [2024-08-06 06:31:16,343][52794] DAMAGECOUNT value on done: 756280.0 [2024-08-06 06:31:16,344][52794] Sum rewards: 76.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.174', 'weapon2': '0.194', 'AMMO3': '0.215', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:16,501][52671] DAMAGECOUNT value on done: 759635.0 [2024-08-06 06:31:16,502][52671] Sum rewards: 79.267, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.072', 'HEALTH': '0.100', 'weapon5': '0.184', 'AMMO4': '0.203', 'AMMO3': '0.221', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '65.000'} [2024-08-06 06:31:16,790][52663] DAMAGECOUNT value on done: 749422.0 [2024-08-06 06:31:16,792][52663] Sum rewards: 77.705, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO5': '0.008', 'weapon4': '0.044', 'AMMO2': '0.045', 'weapon5': '0.126', 'AMMO4': '0.223', 'AMMO3': '0.235', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '63.000'} [2024-08-06 06:31:17,251][52820] DAMAGECOUNT value on done: 699467.0 [2024-08-06 06:31:17,252][52820] Sum rewards: 72.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.907', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.170', 'weapon5': '0.198', 'AMMO3': '0.229', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '59.500'} [2024-08-06 06:31:17,636][52650] Updated weights for policy 0, policy_version 69451 (0.0014) [2024-08-06 06:31:17,754][52658] DAMAGECOUNT value on done: 758946.0 [2024-08-06 06:31:17,756][52658] Sum rewards: 77.206, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.553', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.207', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '64.500'} [2024-08-06 06:31:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 568942592. Throughput: 0: 4338.9. Samples: 142235860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:17,794][52567] Avg episode reward: [(0, '74.495')] [2024-08-06 06:31:18,557][52665] DAMAGECOUNT value on done: 746484.0 [2024-08-06 06:31:18,559][52665] Sum rewards: 71.845, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.053', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.129', 'weapon2': '0.190', 'AMMO3': '0.198', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '58.000'} [2024-08-06 06:31:18,564][52664] DAMAGECOUNT value on done: 784152.0 [2024-08-06 06:31:18,564][52664] Sum rewards: 81.780, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.565', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.143', 'weapon5': '0.154', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.394', 'weapon2': '0.588', 'WEAPON3': '0.900', 'weapon3': '2.496', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:18,767][52811] DAMAGECOUNT value on done: 700811.0 [2024-08-06 06:31:18,768][52811] Sum rewards: 69.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.128', 'weapon4': '0.186', 'weapon2': '0.188', 'AMMO4': '0.226', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.238', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:19,315][52671] DAMAGECOUNT value on done: 764711.0 [2024-08-06 06:31:19,316][52671] Sum rewards: 87.026, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.755', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.137', 'weapon2': '0.188', 'AMMO4': '0.202', 'weapon5': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.596', 'WEAPON3': '0.850', 'weapon3': '2.746', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '69.000'} [2024-08-06 06:31:19,801][52795] DAMAGECOUNT value on done: 703686.0 [2024-08-06 06:31:19,802][52795] Sum rewards: 79.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.161', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon4': '0.154', 'AMMO3': '0.226', 'weapon5': '0.300', 'AMMO4': '0.327', 'weapon2': '0.556', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.630', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:19,834][52663] DAMAGECOUNT value on done: 754197.0 [2024-08-06 06:31:19,836][52663] Sum rewards: 87.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.065', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '70.000'} [2024-08-06 06:31:20,240][52820] DAMAGECOUNT value on done: 700115.0 [2024-08-06 06:31:20,248][52820] Sum rewards: 74.480, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.190', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.140', 'AMMO4': '0.201', 'weapon2': '0.240', 'AMMO3': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '65.000'} [2024-08-06 06:31:20,529][52658] DAMAGECOUNT value on done: 760154.0 [2024-08-06 06:31:20,530][52658] Sum rewards: 64.126, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.021', 'HEALTH': '0.080', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:21,396][52665] DAMAGECOUNT value on done: 743283.0 [2024-08-06 06:31:21,396][52665] Sum rewards: 82.255, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.044', 'AMMO4': '0.114', 'weapon4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:21,445][52664] DAMAGECOUNT value on done: 777847.0 [2024-08-06 06:31:21,445][52664] Sum rewards: 69.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO3': '0.197', 'AMMO4': '0.214', 'weapon5': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:22,040][52811] DAMAGECOUNT value on done: 711459.0 [2024-08-06 06:31:22,040][52811] Sum rewards: 62.279, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.630', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.118', 'AMMO3': '0.258', 'weapon2': '0.260', 'weapon5': '0.280', 'AMMO4': '0.297', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'HITCOUNT': '2.930', 'weapon3': '3.020', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '53.000'} [2024-08-06 06:31:22,232][52669] DAMAGECOUNT value on done: 757082.0 [2024-08-06 06:31:22,233][52669] Sum rewards: 69.757, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.470', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.094', 'weapon5': '0.142', 'AMMO3': '0.259', 'AMMO4': '0.270', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:22,279][52650] Updated weights for policy 0, policy_version 69461 (0.0012) [2024-08-06 06:31:22,510][52671] DAMAGECOUNT value on done: 759020.0 [2024-08-06 06:31:22,511][52671] Sum rewards: 78.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.116', 'AMMO4': '0.216', 'AMMO3': '0.237', 'weapon4': '0.290', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.998', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:22,573][52663] DAMAGECOUNT value on done: 756127.0 [2024-08-06 06:31:22,575][52663] Sum rewards: 90.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.098', 'AMMO4': '0.195', 'weapon5': '0.210', 'AMMO3': '0.238', 'weapon2': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.231', 'FRAGCOUNT': '75.000'} [2024-08-06 06:31:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 569032704. Throughput: 0: 4342.4. Samples: 142262110. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:22,794][52567] Avg episode reward: [(0, '74.906')] [2024-08-06 06:31:22,972][52795] DAMAGECOUNT value on done: 688445.0 [2024-08-06 06:31:22,973][52795] Sum rewards: 66.503, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.134', 'weapon4': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.618', 'WEAPON3': '0.950', 'weapon3': '3.044', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:23,440][52820] DAMAGECOUNT value on done: 701619.0 [2024-08-06 06:31:23,441][52820] Sum rewards: 84.252, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.167', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:23,642][52658] DAMAGECOUNT value on done: 758611.0 [2024-08-06 06:31:23,644][52658] Sum rewards: 68.384, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.003', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.184', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '56.000'} [2024-08-06 06:31:23,948][52665] DAMAGECOUNT value on done: 748012.0 [2024-08-06 06:31:23,949][52665] Sum rewards: 86.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.727', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:24,616][52664] DAMAGECOUNT value on done: 790954.0 [2024-08-06 06:31:24,618][52664] Sum rewards: 74.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.541', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.080', 'AMMO4': '0.146', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '0.950', 'weapon3': '3.130', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:24,968][52669] DAMAGECOUNT value on done: 747515.0 [2024-08-06 06:31:24,969][52669] Sum rewards: 67.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.144', 'AMMO4': '0.191', 'AMMO3': '0.201', 'weapon5': '0.220', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:25,151][52811] DAMAGECOUNT value on done: 708550.0 [2024-08-06 06:31:25,151][52811] Sum rewards: 76.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.027', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.115', 'weapon5': '0.138', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.200', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:25,257][52663] DAMAGECOUNT value on done: 763791.0 [2024-08-06 06:31:25,267][52663] Sum rewards: 76.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.150', 'weapon2': '0.156', 'AMMO4': '0.175', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:25,645][52671] DAMAGECOUNT value on done: 761232.0 [2024-08-06 06:31:25,649][52671] Sum rewards: 78.777, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.205', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.142', 'AMMO4': '0.145', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '63.000'} [2024-08-06 06:31:26,172][52795] DAMAGECOUNT value on done: 691536.0 [2024-08-06 06:31:26,172][52795] Sum rewards: 77.752, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon4': '0.096', 'weapon5': '0.114', 'weapon2': '0.162', 'AMMO3': '0.259', 'AMMO4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.416', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:26,478][52665] DAMAGECOUNT value on done: 748358.0 [2024-08-06 06:31:26,480][52665] Sum rewards: 76.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.602', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.138', 'weapon4': '0.170', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '2.952', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:26,545][52820] DAMAGECOUNT value on done: 691875.0 [2024-08-06 06:31:26,545][52820] Sum rewards: 71.197, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO2': '0.022', 'weapon4': '0.024', 'WEAPON4': '0.050', 'AMMO4': '0.109', 'AMMO3': '0.234', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.380', 'weapon3': '3.464', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:26,722][52658] DAMAGECOUNT value on done: 750155.0 [2024-08-06 06:31:26,724][52658] Sum rewards: 62.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.018', 'weapon4': '0.028', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.698', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '50.000'} [2024-08-06 06:31:26,788][52650] Updated weights for policy 0, policy_version 69471 (0.0013) [2024-08-06 06:31:27,287][52669] DAMAGECOUNT value on done: 761552.0 [2024-08-06 06:31:27,288][52669] Sum rewards: 69.783, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.331', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.078', 'AMMO3': '0.193', 'weapon4': '0.200', 'AMMO4': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.642', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '58.000'} [2024-08-06 06:31:27,590][52663] DAMAGECOUNT value on done: 752082.0 [2024-08-06 06:31:27,592][52663] Sum rewards: 71.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.862', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.158', 'AMMO4': '0.176', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.550', 'weapon3': '3.110', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 569122816. Throughput: 0: 4352.2. Samples: 142288020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:27,794][52567] Avg episode reward: [(0, '74.781')] [2024-08-06 06:31:27,903][52664] DAMAGECOUNT value on done: 784632.0 [2024-08-06 06:31:27,904][52664] Sum rewards: 79.624, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.950', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon4': '0.016', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.416', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '63.000'} [2024-08-06 06:31:28,220][52670] DAMAGECOUNT value on done: 745034.0 [2024-08-06 06:31:28,220][52670] Sum rewards: 66.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.110', 'weapon5': '0.132', 'AMMO3': '0.143', 'AMMO4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:28,300][52811] DAMAGECOUNT value on done: 710065.0 [2024-08-06 06:31:28,300][52811] Sum rewards: 75.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.118', 'weapon4': '0.130', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:28,680][52671] DAMAGECOUNT value on done: 768458.0 [2024-08-06 06:31:28,682][52671] Sum rewards: 72.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.746', 'AMMO5': '0.020', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.190', 'weapon5': '0.204', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.622', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:29,423][52795] DAMAGECOUNT value on done: 700709.0 [2024-08-06 06:31:29,423][52795] Sum rewards: 85.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon4': '0.236', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.184', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '69.000'} [2024-08-06 06:31:29,596][52665] DAMAGECOUNT value on done: 739133.0 [2024-08-06 06:31:29,596][52665] Sum rewards: 51.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.286', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon4': '0.082', 'weapon5': '0.166', 'AMMO3': '0.227', 'AMMO4': '0.230', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '3.178', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '44.500'} [2024-08-06 06:31:29,662][52820] DAMAGECOUNT value on done: 704790.0 [2024-08-06 06:31:29,663][52820] Sum rewards: 68.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.214', 'weapon4': '0.222', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '56.000'} [2024-08-06 06:31:29,747][52666] DAMAGECOUNT value on done: 755224.0 [2024-08-06 06:31:29,748][52666] Sum rewards: 68.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon5': '0.216', 'AMMO3': '0.220', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '56.000'} [2024-08-06 06:31:29,775][52669] DAMAGECOUNT value on done: 756861.0 [2024-08-06 06:31:29,776][52669] Sum rewards: 79.403, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'HEALTH': '0.074', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.194', 'WEAPON3': '0.800', 'weapon2': '0.848', 'weapon3': '2.692', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:29,811][52658] DAMAGECOUNT value on done: 748553.0 [2024-08-06 06:31:29,811][52658] Sum rewards: 81.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.003', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.162', 'AMMO3': '0.199', 'weapon2': '0.222', 'weapon5': '0.240', 'AMMO4': '0.270', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.667', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:30,148][52663] DAMAGECOUNT value on done: 742868.0 [2024-08-06 06:31:30,148][52663] Sum rewards: 64.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon4': '0.108', 'weapon5': '0.130', 'AMMO3': '0.242', 'AMMO4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.102', 'DAMAGECOUNT': '15.042', 'FRAGCOUNT': '55.000'} [2024-08-06 06:31:30,949][52671] DAMAGECOUNT value on done: 760194.0 [2024-08-06 06:31:30,949][52671] Sum rewards: 59.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.731', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.204', 'AMMO3': '0.207', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.176', 'DAMAGECOUNT': '14.643', 'FRAGCOUNT': '51.000'} [2024-08-06 06:31:31,012][52664] DAMAGECOUNT value on done: 778258.0 [2024-08-06 06:31:31,014][52664] Sum rewards: 66.518, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.064', 'AMMO3': '0.132', 'weapon5': '0.136', 'AMMO4': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.602', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:31,219][52670] DAMAGECOUNT value on done: 757277.0 [2024-08-06 06:31:31,221][52670] Sum rewards: 87.734, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.711', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.058', 'weapon5': '0.144', 'AMMO4': '0.166', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:31,364][52811] DAMAGECOUNT value on done: 715450.0 [2024-08-06 06:31:31,365][52811] Sum rewards: 78.602, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.048', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.167', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:31,498][52650] Updated weights for policy 0, policy_version 69481 (0.0031) [2024-08-06 06:31:32,505][52795] DAMAGECOUNT value on done: 692419.0 [2024-08-06 06:31:32,505][52795] Sum rewards: 74.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.896', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.136', 'weapon5': '0.190', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:32,597][52658] DAMAGECOUNT value on done: 761512.0 [2024-08-06 06:31:32,597][52658] Sum rewards: 88.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.196', 'AMMO3': '0.212', 'weapon4': '0.248', 'AMMO4': '0.262', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.489', 'FRAGCOUNT': '73.000'} [2024-08-06 06:31:32,679][52669] DAMAGECOUNT value on done: 759960.0 [2024-08-06 06:31:32,683][52669] Sum rewards: 77.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.142', 'weapon5': '0.176', 'AMMO3': '0.188', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:32,699][52665] DAMAGECOUNT value on done: 744009.0 [2024-08-06 06:31:32,700][52665] Sum rewards: 69.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.167', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.113', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.358', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:32,713][52666] DAMAGECOUNT value on done: 752971.0 [2024-08-06 06:31:32,716][52666] Sum rewards: 75.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.605', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.173', 'weapon2': '0.392', 'WEAPON3': '1.050', 'weapon3': '3.360', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:32,737][52820] DAMAGECOUNT value on done: 687266.0 [2024-08-06 06:31:32,738][52820] Sum rewards: 64.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.962', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.050', 'weapon4': '0.088', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.260', 'weapon3': '3.336', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '53.000'} [2024-08-06 06:31:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 569204736. Throughput: 0: 4356.9. Samples: 142301140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:32,794][52567] Avg episode reward: [(0, '74.507')] [2024-08-06 06:31:33,151][52663] DAMAGECOUNT value on done: 746741.0 [2024-08-06 06:31:33,155][52663] Sum rewards: 61.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.232', 'weapon2': '0.256', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.388', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:33,452][52664] DAMAGECOUNT value on done: 772965.0 [2024-08-06 06:31:33,452][52664] Sum rewards: 78.264, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.317', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.141', 'AMMO4': '0.189', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '0.900', 'weapon3': '2.900', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:33,967][52671] DAMAGECOUNT value on done: 764037.0 [2024-08-06 06:31:33,967][52671] Sum rewards: 83.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.405', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.257', 'weapon2': '0.352', 'WEAPON3': '1.650', 'weapon3': '3.408', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '71.000'} [2024-08-06 06:31:34,478][52670] DAMAGECOUNT value on done: 746745.0 [2024-08-06 06:31:34,479][52670] Sum rewards: 80.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.656', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.106', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:34,495][52811] DAMAGECOUNT value on done: 709173.0 [2024-08-06 06:31:34,495][52811] Sum rewards: 77.893, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.424', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon5': '0.172', 'weapon4': '0.212', 'AMMO3': '0.213', 'AMMO4': '0.215', 'weapon2': '0.370', 'ARMOR': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:35,631][52658] DAMAGECOUNT value on done: 750149.0 [2024-08-06 06:31:35,632][52658] Sum rewards: 76.694, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.466', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.072', 'weapon5': '0.122', 'AMMO4': '0.187', 'AMMO3': '0.261', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '68.000'} [2024-08-06 06:31:35,644][52795] DAMAGECOUNT value on done: 698655.0 [2024-08-06 06:31:35,649][52795] Sum rewards: 69.128, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.250', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.130', 'AMMO4': '0.130', 'AMMO3': '0.162', 'weapon4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:35,787][52669] DAMAGECOUNT value on done: 758338.0 [2024-08-06 06:31:35,787][52669] Sum rewards: 66.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.502', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.092', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '55.000'} [2024-08-06 06:31:35,883][52665] DAMAGECOUNT value on done: 747166.0 [2024-08-06 06:31:35,884][52665] Sum rewards: 75.899, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.266', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.168', 'weapon2': '0.306', 'WEAPON3': '1.000', 'HITCOUNT': '3.370', 'weapon3': '3.432', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:35,941][52820] DAMAGECOUNT value on done: 697837.0 [2024-08-06 06:31:35,943][52820] Sum rewards: 63.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.312', 'AMMO5': '0.039', 'AMMO2': '0.081', 'AMMO3': '0.163', 'weapon5': '0.344', 'weapon4': '0.358', 'AMMO4': '0.403', 'weapon2': '0.482', 'WEAPON4': '0.750', 'WEAPON5': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.432', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:36,011][52666] DAMAGECOUNT value on done: 753778.0 [2024-08-06 06:31:36,014][52666] Sum rewards: 79.557, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.729', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon2': '0.174', 'weapon5': '0.180', 'AMMO4': '0.213', 'weapon4': '0.226', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:36,059][52664] DAMAGECOUNT value on done: 788128.0 [2024-08-06 06:31:36,059][52664] Sum rewards: 86.337, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.038', 'AMMO4': '0.040', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.471', 'FRAGCOUNT': '71.000'} [2024-08-06 06:31:36,266][52663] DAMAGECOUNT value on done: 750733.0 [2024-08-06 06:31:36,268][52663] Sum rewards: 73.317, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.982', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '58.000'} [2024-08-06 06:31:36,393][52650] Updated weights for policy 0, policy_version 69491 (0.0013) [2024-08-06 06:31:36,998][52671] DAMAGECOUNT value on done: 761527.0 [2024-08-06 06:31:36,999][52671] Sum rewards: 73.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.718', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.088', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:37,606][52811] DAMAGECOUNT value on done: 705032.0 [2024-08-06 06:31:37,607][52811] Sum rewards: 85.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.015', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon5': '0.042', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.160', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.576', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '70.000'} [2024-08-06 06:31:37,677][52670] DAMAGECOUNT value on done: 743722.0 [2024-08-06 06:31:37,679][52670] Sum rewards: 75.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.362', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 569294848. Throughput: 0: 4355.2. Samples: 142327410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:37,794][52567] Avg episode reward: [(0, '74.369')] [2024-08-06 06:31:38,033][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:31:38,530][52658] DAMAGECOUNT value on done: 773860.0 [2024-08-06 06:31:38,531][52658] Sum rewards: 72.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.055', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.088', 'weapon4': '0.168', 'AMMO4': '0.187', 'AMMO3': '0.213', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:38,548][52669] DAMAGECOUNT value on done: 758264.0 [2024-08-06 06:31:38,549][52669] Sum rewards: 83.183, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.712', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '68.000'} [2024-08-06 06:31:38,924][52663] DAMAGECOUNT value on done: 761953.0 [2024-08-06 06:31:38,925][52663] Sum rewards: 71.995, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.964', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.122', 'AMMO4': '0.151', 'weapon5': '0.208', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.650', 'weapon3': '2.934', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:38,948][52664] DAMAGECOUNT value on done: 780209.0 [2024-08-06 06:31:38,948][52664] Sum rewards: 85.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.508', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.408', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '70.000'} [2024-08-06 06:31:38,996][52795] DAMAGECOUNT value on done: 707710.0 [2024-08-06 06:31:38,996][52795] Sum rewards: 83.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.174', 'AMMO3': '0.231', 'weapon4': '0.258', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '68.000'} [2024-08-06 06:31:39,036][52820] DAMAGECOUNT value on done: 699644.0 [2024-08-06 06:31:39,037][52820] Sum rewards: 71.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.466', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.060', 'weapon5': '0.156', 'AMMO3': '0.185', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:39,153][52666] DAMAGECOUNT value on done: 753553.0 [2024-08-06 06:31:39,153][52666] Sum rewards: 73.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.440', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.114', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.318', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:40,163][52671] DAMAGECOUNT value on done: 750729.0 [2024-08-06 06:31:40,165][52671] Sum rewards: 80.883, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.149', 'WEAPON3': '0.800', 'weapon2': '0.920', 'HEALTH': '0.930', 'weapon3': '2.910', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '63.000'} [2024-08-06 06:31:40,563][52670] DAMAGECOUNT value on done: 754830.0 [2024-08-06 06:31:40,565][52670] Sum rewards: 75.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'weapon4': '0.014', 'weapon5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:40,653][52811] DAMAGECOUNT value on done: 702837.0 [2024-08-06 06:31:40,661][52811] Sum rewards: 61.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.052', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.590', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '51.000'} [2024-08-06 06:31:40,749][52650] Updated weights for policy 0, policy_version 69501 (0.0022) [2024-08-06 06:31:41,063][52658] DAMAGECOUNT value on done: 758275.0 [2024-08-06 06:31:41,064][52658] Sum rewards: 75.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.678', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.038', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.267', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '65.000'} [2024-08-06 06:31:41,470][52669] DAMAGECOUNT value on done: 760192.0 [2024-08-06 06:31:41,472][52669] Sum rewards: 63.309, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.980', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon2': '0.268', 'AMMO3': '0.276', 'weapon5': '0.322', 'weapon4': '0.324', 'AMMO4': '0.332', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.742', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '56.000'} [2024-08-06 06:31:41,533][52664] DAMAGECOUNT value on done: 791179.0 [2024-08-06 06:31:41,534][52664] Sum rewards: 86.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.296', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.042', 'weapon5': '0.126', 'AMMO4': '0.196', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '73.000'} [2024-08-06 06:31:42,060][52663] DAMAGECOUNT value on done: 745779.0 [2024-08-06 06:31:42,060][52663] Sum rewards: 81.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.408', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '69.000'} [2024-08-06 06:31:42,070][52666] DAMAGECOUNT value on done: 746587.0 [2024-08-06 06:31:42,071][52666] Sum rewards: 64.484, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.040', 'weapon5': '0.098', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.346', 'WEAPON3': '1.700', 'weapon3': '3.246', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '57.000'} [2024-08-06 06:31:42,147][52820] DAMAGECOUNT value on done: 700670.0 [2024-08-06 06:31:42,148][52820] Sum rewards: 84.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.104', 'weapon4': '0.138', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '68.000'} [2024-08-06 06:31:42,154][52795] DAMAGECOUNT value on done: 696613.0 [2024-08-06 06:31:42,155][52795] Sum rewards: 64.254, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.541', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.068', 'weapon4': '0.082', 'AMMO4': '0.098', 'AMMO3': '0.119', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.508', 'WEAPON3': '0.800', 'HITCOUNT': '2.950', 'weapon3': '3.082', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '50.000'} [2024-08-06 06:31:42,305][52803] DAMAGECOUNT value on done: 701032.0 [2024-08-06 06:31:42,305][52803] Sum rewards: 76.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.814', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.542', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:42,767][52614] Signal inference workers to stop experience collection... (12650 times) [2024-08-06 06:31:42,774][52614] Signal inference workers to resume experience collection... (12650 times) [2024-08-06 06:31:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 569376768. Throughput: 0: 4359.8. Samples: 142353710. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:42,795][52567] Avg episode reward: [(0, '74.816')] [2024-08-06 06:31:42,853][52650] InferenceWorker_p0-w0: stopping experience collection (12650 times) [2024-08-06 06:31:42,853][52650] InferenceWorker_p0-w0: resuming experience collection (12650 times) [2024-08-06 06:31:43,278][52671] DAMAGECOUNT value on done: 760031.0 [2024-08-06 06:31:43,278][52671] Sum rewards: 65.540, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.043', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.133', 'AMMO3': '0.152', 'weapon4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.000', 'HITCOUNT': '3.200', 'weapon3': '3.242', 'DAMAGECOUNT': '14.727', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:43,694][52670] DAMAGECOUNT value on done: 750102.0 [2024-08-06 06:31:43,694][52670] Sum rewards: 74.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.169', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:43,717][52811] DAMAGECOUNT value on done: 703582.0 [2024-08-06 06:31:43,718][52811] Sum rewards: 69.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.720', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon5': '0.006', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.432', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:43,742][52658] DAMAGECOUNT value on done: 767458.0 [2024-08-06 06:31:43,743][52658] Sum rewards: 74.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.285', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.074', 'weapon5': '0.174', 'AMMO3': '0.197', 'AMMO4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:44,137][52664] DAMAGECOUNT value on done: 788101.0 [2024-08-06 06:31:44,139][52664] Sum rewards: 67.786, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon2': '0.604', 'WEAPON3': '0.800', 'weapon3': '3.130', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:44,590][52669] DAMAGECOUNT value on done: 768833.0 [2024-08-06 06:31:44,593][52669] Sum rewards: 83.451, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.126', 'HEALTH': '0.196', 'weapon2': '0.594', 'WEAPON3': '0.750', 'weapon3': '3.178', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:45,131][52663] DAMAGECOUNT value on done: 741837.0 [2024-08-06 06:31:45,133][52663] Sum rewards: 78.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.292', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.122', 'weapon4': '0.138', 'AMMO4': '0.171', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:45,165][52666] DAMAGECOUNT value on done: 752376.0 [2024-08-06 06:31:45,166][52666] Sum rewards: 75.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.644', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.094', 'AMMO3': '0.160', 'weapon5': '0.194', 'AMMO4': '0.280', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:45,270][52820] DAMAGECOUNT value on done: 709290.0 [2024-08-06 06:31:45,272][52820] Sum rewards: 84.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.640', 'AMMO2': '0.003', 'AMMO5': '0.004', 'AMMO4': '0.017', 'weapon5': '0.036', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '70.000'} [2024-08-06 06:31:45,287][52795] DAMAGECOUNT value on done: 698746.0 [2024-08-06 06:31:45,287][52795] Sum rewards: 79.204, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.082', 'AMMO4': '0.102', 'weapon5': '0.146', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '63.000'} [2024-08-06 06:31:45,474][52803] DAMAGECOUNT value on done: 699101.0 [2024-08-06 06:31:45,475][52803] Sum rewards: 72.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.332', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:45,687][52650] Updated weights for policy 0, policy_version 69511 (0.0020) [2024-08-06 06:31:46,300][52671] DAMAGECOUNT value on done: 761382.0 [2024-08-06 06:31:46,301][52671] Sum rewards: 64.861, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.614', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.160', 'weapon2': '0.174', 'AMMO3': '0.233', 'weapon5': '0.250', 'AMMO4': '0.321', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.180', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:46,688][52658] DAMAGECOUNT value on done: 754692.0 [2024-08-06 06:31:46,689][52658] Sum rewards: 90.514, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'HEALTH': '0.020', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO4': '0.133', 'AMMO3': '0.194', 'weapon5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '71.000'} [2024-08-06 06:31:46,789][52670] DAMAGECOUNT value on done: 742886.0 [2024-08-06 06:31:46,789][52670] Sum rewards: 55.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.169', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.068', 'weapon4': '0.108', 'AMMO4': '0.130', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.632', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.040', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '46.000'} [2024-08-06 06:31:46,829][52811] DAMAGECOUNT value on done: 711084.0 [2024-08-06 06:31:46,829][52811] Sum rewards: 86.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.044', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.150', 'weapon4': '0.218', 'AMMO4': '0.239', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.918', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:47,116][52664] DAMAGECOUNT value on done: 788641.0 [2024-08-06 06:31:47,116][52664] Sum rewards: 80.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.493', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO4': '0.221', 'weapon5': '0.228', 'AMMO3': '0.242', 'weapon2': '0.244', 'weapon4': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.774', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:47,465][52647] DAMAGECOUNT value on done: 803458.0 [2024-08-06 06:31:47,465][52647] Sum rewards: 74.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.160', 'weapon4': '0.182', 'AMMO4': '0.199', 'AMMO3': '0.215', 'weapon2': '0.216', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:47,750][52669] DAMAGECOUNT value on done: 759864.0 [2024-08-06 06:31:47,752][52669] Sum rewards: 82.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.288', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.164', 'weapon5': '0.184', 'AMMO3': '0.206', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.8, 300 sec: 17467.0). Total num frames: 569466880. Throughput: 0: 4357.8. Samples: 142366790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 06:31:47,795][52567] Avg episode reward: [(0, '74.735')] [2024-08-06 06:31:48,025][52666] DAMAGECOUNT value on done: 748868.0 [2024-08-06 06:31:48,025][52666] Sum rewards: 70.884, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.616', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.038', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '56.000'} [2024-08-06 06:31:48,368][52820] DAMAGECOUNT value on done: 693786.0 [2024-08-06 06:31:48,369][52820] Sum rewards: 72.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.003', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO4': '0.155', 'AMMO3': '0.178', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.000'} [2024-08-06 06:31:48,383][52663] DAMAGECOUNT value on done: 749339.0 [2024-08-06 06:31:48,384][52663] Sum rewards: 68.248, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.156', 'weapon5': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '57.000'} [2024-08-06 06:31:48,438][52795] DAMAGECOUNT value on done: 702329.0 [2024-08-06 06:31:48,439][52795] Sum rewards: 95.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.297', 'FRAGCOUNT': '76.000'} [2024-08-06 06:31:48,549][52803] DAMAGECOUNT value on done: 708653.0 [2024-08-06 06:31:48,552][52803] Sum rewards: 62.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.094', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.636', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '52.000'} [2024-08-06 06:31:49,060][52671] DAMAGECOUNT value on done: 759125.0 [2024-08-06 06:31:49,060][52671] Sum rewards: 69.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.050', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'weapon5': '0.182', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.000'} [2024-08-06 06:31:49,748][52670] DAMAGECOUNT value on done: 746829.0 [2024-08-06 06:31:49,748][52670] Sum rewards: 74.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.815', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.124', 'weapon5': '0.160', 'AMMO4': '0.206', 'AMMO3': '0.210', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:49,896][52658] DAMAGECOUNT value on done: 762206.0 [2024-08-06 06:31:49,896][52658] Sum rewards: 66.668, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.034', 'AMMO5': '0.005', 'ARMOR': '0.016', 'AMMO2': '0.032', 'weapon5': '0.094', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.193', 'weapon2': '0.296', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.354', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '53.000'} [2024-08-06 06:31:49,954][52811] DAMAGECOUNT value on done: 711034.0 [2024-08-06 06:31:49,954][52811] Sum rewards: 53.423, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.197', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.128', 'AMMO4': '0.218', 'weapon5': '0.256', 'AMMO3': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.600', 'HITCOUNT': '2.520', 'weapon3': '2.834', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '49.000'} [2024-08-06 06:31:49,972][52650] Updated weights for policy 0, policy_version 69521 (0.0012) [2024-08-06 06:31:50,292][52664] DAMAGECOUNT value on done: 795878.0 [2024-08-06 06:31:50,293][52664] Sum rewards: 90.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.468', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.350', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:50,476][52669] DAMAGECOUNT value on done: 761109.0 [2024-08-06 06:31:50,479][52669] Sum rewards: 73.210, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.340', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.086', 'weapon4': '0.134', 'AMMO4': '0.154', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.202', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:50,509][52647] DAMAGECOUNT value on done: 792497.0 [2024-08-06 06:31:50,510][52647] Sum rewards: 75.498, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon4': '0.192', 'weapon5': '0.276', 'AMMO3': '0.301', 'AMMO4': '0.336', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.740', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '65.000'} [2024-08-06 06:31:50,975][52663] DAMAGECOUNT value on done: 749614.0 [2024-08-06 06:31:50,977][52663] Sum rewards: 78.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.684', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO3': '0.197', 'AMMO4': '0.210', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:51,000][52666] DAMAGECOUNT value on done: 743568.0 [2024-08-06 06:31:51,002][52666] Sum rewards: 68.033, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.698', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.075', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.180', 'WEAPON3': '1.050', 'HITCOUNT': '3.150', 'weapon3': '3.458', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '55.000'} [2024-08-06 06:31:51,543][52820] DAMAGECOUNT value on done: 701917.0 [2024-08-06 06:31:51,553][52820] Sum rewards: 67.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.885', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.148', 'weapon5': '0.202', 'AMMO3': '0.220', 'AMMO4': '0.279', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '57.000'} [2024-08-06 06:31:51,635][52795] DAMAGECOUNT value on done: 696189.0 [2024-08-06 06:31:51,635][52795] Sum rewards: 73.918, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.253', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.134', 'weapon5': '0.196', 'AMMO4': '0.226', 'AMMO3': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.700', 'weapon3': '2.928', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:51,647][52803] DAMAGECOUNT value on done: 707943.0 [2024-08-06 06:31:51,647][52803] Sum rewards: 87.654, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.864', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.111', 'weapon5': '0.134', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.040', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '69.000'} [2024-08-06 06:31:52,284][52670] DAMAGECOUNT value on done: 748430.0 [2024-08-06 06:31:52,285][52670] Sum rewards: 90.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.100', 'AMMO4': '0.174', 'weapon2': '0.192', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '4.300', 'DAMAGECOUNT': '22.494', 'FRAGCOUNT': '72.000'} [2024-08-06 06:31:52,386][52671] DAMAGECOUNT value on done: 766430.0 [2024-08-06 06:31:52,386][52671] Sum rewards: 70.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.718', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.093', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '58.000'} [2024-08-06 06:31:52,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 569565184. Throughput: 0: 4363.3. Samples: 142393040. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:31:52,795][52567] Avg episode reward: [(0, '74.538')] [2024-08-06 06:31:52,905][52658] DAMAGECOUNT value on done: 752133.0 [2024-08-06 06:31:52,905][52658] Sum rewards: 73.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.966', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.146', 'weapon4': '0.154', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:52,923][52820] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:31:53,030][52811] DAMAGECOUNT value on done: 706253.0 [2024-08-06 06:31:53,033][52811] Sum rewards: 71.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.144', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.164', 'AMMO4': '0.202', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:53,062][52664] DAMAGECOUNT value on done: 796430.0 [2024-08-06 06:31:53,062][52664] Sum rewards: 86.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.086', 'weapon5': '0.140', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.230', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '71.000'} [2024-08-06 06:31:53,190][52669] DAMAGECOUNT value on done: 767291.0 [2024-08-06 06:31:53,191][52669] Sum rewards: 70.433, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.254', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.095', 'weapon4': '0.154', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.152', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '55.000'} [2024-08-06 06:31:53,372][52647] DAMAGECOUNT value on done: 797619.0 [2024-08-06 06:31:53,373][52647] Sum rewards: 67.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.150', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.196', 'weapon2': '0.246', 'weapon5': '0.246', 'AMMO4': '0.258', 'weapon4': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:53,564][52666] DAMAGECOUNT value on done: 754147.0 [2024-08-06 06:31:53,565][52666] Sum rewards: 75.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.709', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.066', 'AMMO4': '0.159', 'weapon5': '0.210', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:53,760][52663] DAMAGECOUNT value on done: 761414.0 [2024-08-06 06:31:53,760][52663] Sum rewards: 69.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.962', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.240', 'weapon2': '0.328', 'WEAPON3': '1.550', 'HITCOUNT': '3.250', 'weapon3': '3.296', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:54,669][52820] DAMAGECOUNT value on done: 710986.0 [2024-08-06 06:31:54,669][52820] Sum rewards: 80.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.006', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.118', 'weapon2': '0.172', 'weapon5': '0.202', 'AMMO3': '0.223', 'AMMO4': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '65.000'} [2024-08-06 06:31:54,812][52795] DAMAGECOUNT value on done: 692417.0 [2024-08-06 06:31:54,814][52795] Sum rewards: 72.927, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO3': '0.154', 'weapon2': '0.234', 'weapon4': '0.234', 'WEAPON3': '1.050', 'HITCOUNT': '3.340', 'weapon3': '3.358', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '58.000'} [2024-08-06 06:31:54,890][52803] DAMAGECOUNT value on done: 706585.0 [2024-08-06 06:31:54,890][52803] Sum rewards: 71.264, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.092', 'AMMO3': '0.153', 'AMMO4': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.286', 'HEALTH': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '55.500'} [2024-08-06 06:31:54,946][52670] DAMAGECOUNT value on done: 741398.0 [2024-08-06 06:31:54,947][52670] Sum rewards: 75.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.955', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon4': '0.072', 'weapon5': '0.202', 'AMMO3': '0.237', 'AMMO4': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '2.894', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2024-08-06 06:31:54,968][52671] DAMAGECOUNT value on done: 760762.0 [2024-08-06 06:31:54,968][52671] Sum rewards: 70.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.356', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon5': '0.192', 'weapon4': '0.224', 'weapon2': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.006', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:55,092][52650] Updated weights for policy 0, policy_version 69531 (0.0015) [2024-08-06 06:31:55,887][52669] DAMAGECOUNT value on done: 752383.0 [2024-08-06 06:31:55,888][52669] Sum rewards: 78.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.092', 'weapon5': '0.176', 'AMMO3': '0.238', 'AMMO4': '0.261', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.766', 'FRAGCOUNT': '65.500'} [2024-08-06 06:31:56,082][52811] DAMAGECOUNT value on done: 706328.0 [2024-08-06 06:31:56,082][52811] Sum rewards: 76.075, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.038', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.182', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:56,261][52666] DAMAGECOUNT value on done: 746286.0 [2024-08-06 06:31:56,263][52666] Sum rewards: 68.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.622', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.223', 'weapon5': '0.242', 'weapon2': '0.274', 'AMMO4': '0.280', 'weapon4': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '57.000'} [2024-08-06 06:31:56,286][52664] DAMAGECOUNT value on done: 791284.0 [2024-08-06 06:31:56,290][52664] Sum rewards: 81.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.895', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.098', 'AMMO4': '0.139', 'weapon5': '0.176', 'AMMO3': '0.226', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '67.000'} [2024-08-06 06:31:56,378][52658] DAMAGECOUNT value on done: 761597.0 [2024-08-06 06:31:56,379][52658] Sum rewards: 65.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'weapon4': '0.138', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '3.000', 'weapon3': '3.232', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '55.000'} [2024-08-06 06:31:56,519][52663] DAMAGECOUNT value on done: 752977.0 [2024-08-06 06:31:56,519][52663] Sum rewards: 62.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.635', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.120', 'weapon5': '0.124', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.396', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:56,547][52647] DAMAGECOUNT value on done: 797846.0 [2024-08-06 06:31:56,555][52647] Sum rewards: 62.101, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.088', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.160', 'weapon5': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.314', 'weapon2': '0.492', 'WEAPON3': '1.850', 'weapon3': '3.014', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '55.000'} [2024-08-06 06:31:57,380][52670] DAMAGECOUNT value on done: 756100.0 [2024-08-06 06:31:57,383][52670] Sum rewards: 68.221, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.112', 'weapon4': '0.126', 'weapon2': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'HITCOUNT': '3.230', 'weapon3': '3.338', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '59.000'} [2024-08-06 06:31:57,689][52671] DAMAGECOUNT value on done: 748202.0 [2024-08-06 06:31:57,691][52671] Sum rewards: 60.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.446', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.110', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.366', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.270', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '50.000'} [2024-08-06 06:31:57,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 569647104. Throughput: 0: 4358.2. Samples: 142419000. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:31:57,794][52567] Avg episode reward: [(0, '74.565')] [2024-08-06 06:31:57,860][52820] DAMAGECOUNT value on done: 701538.0 [2024-08-06 06:31:57,860][52820] Sum rewards: 72.271, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.716', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.280', 'weapon2': '0.332', 'WEAPON3': '1.700', 'weapon3': '3.290', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '62.000'} [2024-08-06 06:31:57,946][52795] DAMAGECOUNT value on done: 692867.0 [2024-08-06 06:31:57,948][52795] Sum rewards: 67.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.691', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO3': '0.172', 'AMMO4': '0.192', 'weapon5': '0.238', 'weapon2': '0.264', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '53.000'} [2024-08-06 06:31:58,161][52803] DAMAGECOUNT value on done: 704303.0 [2024-08-06 06:31:58,161][52803] Sum rewards: 73.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.080', 'weapon5': '0.182', 'AMMO3': '0.214', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '60.000'} [2024-08-06 06:31:58,902][52669] DAMAGECOUNT value on done: 753045.0 [2024-08-06 06:31:58,906][52669] Sum rewards: 59.506, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.570', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.141', 'weapon4': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.300', 'AMMO3': '0.319', 'WEAPON3': '1.800', 'HITCOUNT': '3.050', 'weapon3': '3.174', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:58,908][52666] DAMAGECOUNT value on done: 754887.0 [2024-08-06 06:31:58,909][52666] Sum rewards: 64.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.132', 'AMMO4': '0.162', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.250', 'HITCOUNT': '2.880', 'weapon3': '3.312', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '54.000'} [2024-08-06 06:31:59,324][52664] DAMAGECOUNT value on done: 780213.0 [2024-08-06 06:31:59,325][52664] Sum rewards: 70.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.752', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.078', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '3.310', 'weapon3': '3.346', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '61.000'} [2024-08-06 06:31:59,448][52658] DAMAGECOUNT value on done: 744543.0 [2024-08-06 06:31:59,449][52658] Sum rewards: 79.757, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.345', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.128', 'weapon5': '0.146', 'AMMO4': '0.184', 'AMMO3': '0.188', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '66.000'} [2024-08-06 06:31:59,604][52647] DAMAGECOUNT value on done: 804087.0 [2024-08-06 06:31:59,604][52647] Sum rewards: 81.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.248', 'AMMO3': '0.251', 'weapon4': '0.252', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '4.290', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '68.000'} [2024-08-06 06:31:59,671][52663] DAMAGECOUNT value on done: 756864.0 [2024-08-06 06:31:59,676][52663] Sum rewards: 73.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.070', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.246', 'WEAPON3': '1.500', 'HITCOUNT': '3.330', 'weapon3': '3.448', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '63.000'} [2024-08-06 06:31:59,743][52650] Updated weights for policy 0, policy_version 69541 (0.0026) [2024-08-06 06:32:00,108][52671] DAMAGECOUNT value on done: 767138.0 [2024-08-06 06:32:00,110][52671] Sum rewards: 75.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:00,398][52670] DAMAGECOUNT value on done: 741059.0 [2024-08-06 06:32:00,400][52670] Sum rewards: 64.084, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.006', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.102', 'weapon5': '0.214', 'AMMO3': '0.242', 'AMMO4': '0.286', 'weapon2': '0.448', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '56.000'} [2024-08-06 06:32:00,516][52668] DAMAGECOUNT value on done: 759186.0 [2024-08-06 06:32:00,519][52668] Sum rewards: 80.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.372', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.047', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.350', 'weapon3': '3.482', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '66.000'} [2024-08-06 06:32:01,060][52795] DAMAGECOUNT value on done: 703015.0 [2024-08-06 06:32:01,061][52795] Sum rewards: 81.142, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.078', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '63.000'} [2024-08-06 06:32:01,074][52820] DAMAGECOUNT value on done: 706507.0 [2024-08-06 06:32:01,075][52820] Sum rewards: 69.310, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.630', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.185', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.700', 'weapon3': '3.066', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:01,250][52803] DAMAGECOUNT value on done: 698262.0 [2024-08-06 06:32:01,252][52803] Sum rewards: 67.583, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.010', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.110', 'weapon5': '0.134', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '0.800', 'HITCOUNT': '2.980', 'weapon3': '3.350', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '52.000'} [2024-08-06 06:32:01,800][52666] DAMAGECOUNT value on done: 742084.0 [2024-08-06 06:32:01,809][52666] Sum rewards: 80.572, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.535', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.128', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:01,865][52669] DAMAGECOUNT value on done: 759331.0 [2024-08-06 06:32:01,865][52669] Sum rewards: 77.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.882', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon5': '0.094', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:02,121][52664] DAMAGECOUNT value on done: 782384.0 [2024-08-06 06:32:02,123][52664] Sum rewards: 77.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.370', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:02,268][52647] DAMAGECOUNT value on done: 804147.0 [2024-08-06 06:32:02,268][52647] Sum rewards: 70.119, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.328', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.176', 'AMMO4': '0.186', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:02,513][52658] DAMAGECOUNT value on done: 762636.0 [2024-08-06 06:32:02,517][52658] Sum rewards: 69.939, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.175', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.126', 'weapon5': '0.256', 'AMMO4': '0.272', 'AMMO3': '0.279', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.984', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:02,636][52663] DAMAGECOUNT value on done: 761063.0 [2024-08-06 06:32:02,637][52663] Sum rewards: 70.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.781', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.080', 'weapon5': '0.084', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.000'} [2024-08-06 06:32:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 569729024. Throughput: 0: 4360.4. Samples: 142432080. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:32:02,794][52567] Avg episode reward: [(0, '73.955')] [2024-08-06 06:32:03,054][52671] DAMAGECOUNT value on done: 765282.0 [2024-08-06 06:32:03,056][52671] Sum rewards: 86.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.176', 'AMMO3': '0.208', 'weapon4': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '71.000'} [2024-08-06 06:32:03,244][52668] DAMAGECOUNT value on done: 763328.0 [2024-08-06 06:32:03,245][52668] Sum rewards: 71.892, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.265', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.158', 'weapon5': '0.190', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.100', 'weapon3': '2.666', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '57.000'} [2024-08-06 06:32:03,368][52670] DAMAGECOUNT value on done: 750298.0 [2024-08-06 06:32:03,368][52670] Sum rewards: 76.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.215', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.045', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.468', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:04,205][52820] DAMAGECOUNT value on done: 702525.0 [2024-08-06 06:32:04,209][52820] Sum rewards: 80.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.101', 'weapon5': '0.146', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '66.000'} [2024-08-06 06:32:04,278][52795] DAMAGECOUNT value on done: 686524.0 [2024-08-06 06:32:04,279][52795] Sum rewards: 67.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.283', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.197', 'weapon2': '0.224', 'AMMO4': '0.268', 'weapon5': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '53.000'} [2024-08-06 06:32:04,355][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:32:04,374][52803] DAMAGECOUNT value on done: 697629.0 [2024-08-06 06:32:04,374][52803] Sum rewards: 74.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.691', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.132', 'AMMO4': '0.157', 'AMMO3': '0.243', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:04,402][52650] Updated weights for policy 0, policy_version 69551 (0.0019) [2024-08-06 06:32:04,502][52664] DAMAGECOUNT value on done: 783718.0 [2024-08-06 06:32:04,502][52664] Sum rewards: 74.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.124', 'weapon5': '0.128', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:04,623][52647] DAMAGECOUNT value on done: 805944.0 [2024-08-06 06:32:04,625][52647] Sum rewards: 77.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.281', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.150', 'weapon4': '0.190', 'AMMO4': '0.207', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.006', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:04,692][52669] DAMAGECOUNT value on done: 778198.0 [2024-08-06 06:32:04,692][52669] Sum rewards: 75.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon4': '0.254', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:05,144][52666] DAMAGECOUNT value on done: 754880.0 [2024-08-06 06:32:05,144][52666] Sum rewards: 68.581, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.016', 'AMMO2': '0.054', 'HEALTH': '0.128', 'AMMO3': '0.170', 'weapon5': '0.262', 'AMMO4': '0.270', 'weapon4': '0.390', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.566', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2024-08-06 06:32:05,212][52663] DAMAGECOUNT value on done: 749953.0 [2024-08-06 06:32:05,212][52663] Sum rewards: 81.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.928', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '66.000'} [2024-08-06 06:32:05,432][52658] DAMAGECOUNT value on done: 752996.0 [2024-08-06 06:32:05,432][52658] Sum rewards: 60.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.058', 'weapon5': '0.150', 'AMMO3': '0.223', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '2.810', 'weapon3': '3.088', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '51.000'} [2024-08-06 06:32:05,906][52668] DAMAGECOUNT value on done: 759560.0 [2024-08-06 06:32:05,908][52668] Sum rewards: 59.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.755', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.102', 'AMMO3': '0.161', 'AMMO4': '0.238', 'weapon5': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '2.868', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.087', 'FRAGCOUNT': '46.500'} [2024-08-06 06:32:06,048][52671] DAMAGECOUNT value on done: 762864.0 [2024-08-06 06:32:06,048][52671] Sum rewards: 77.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.385', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.090', 'weapon5': '0.194', 'AMMO4': '0.196', 'weapon2': '0.260', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '65.500'} [2024-08-06 06:32:06,179][52662] DAMAGECOUNT value on done: 758750.0 [2024-08-06 06:32:06,180][52662] Sum rewards: 60.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.023', 'AMMO2': '0.046', 'weapon4': '0.124', 'AMMO3': '0.195', 'AMMO4': '0.232', 'weapon5': '0.272', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '49.500'} [2024-08-06 06:32:06,527][52670] DAMAGECOUNT value on done: 757431.0 [2024-08-06 06:32:06,528][52670] Sum rewards: 65.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.449', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.174', 'weapon5': '0.184', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '54.000'} [2024-08-06 06:32:07,268][52664] DAMAGECOUNT value on done: 782193.0 [2024-08-06 06:32:07,268][52664] Sum rewards: 68.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.917', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.214', 'weapon4': '0.238', 'AMMO4': '0.264', 'weapon5': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '2.594', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 06:32:07,333][52820] DAMAGECOUNT value on done: 702972.0 [2024-08-06 06:32:07,334][52820] Sum rewards: 71.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.566', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.376', 'WEAPON3': '1.250', 'HITCOUNT': '3.390', 'weapon3': '3.404', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:07,348][52803] DAMAGECOUNT value on done: 700243.0 [2024-08-06 06:32:07,348][52803] Sum rewards: 69.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.862', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.072', 'AMMO4': '0.182', 'weapon5': '0.206', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 06:32:07,367][52795] DAMAGECOUNT value on done: 705133.0 [2024-08-06 06:32:07,370][52795] Sum rewards: 62.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.080', 'AMMO3': '0.192', 'weapon5': '0.210', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '51.000'} [2024-08-06 06:32:07,600][52647] DAMAGECOUNT value on done: 783535.0 [2024-08-06 06:32:07,601][52647] Sum rewards: 68.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'AMMO5': '0.026', 'AMMO2': '0.063', 'AMMO3': '0.252', 'AMMO4': '0.317', 'weapon5': '0.342', 'weapon4': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.556', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 06:32:07,731][52666] DAMAGECOUNT value on done: 750535.0 [2024-08-06 06:32:07,733][52666] Sum rewards: 84.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.445', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon5': '0.212', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '68.500'} [2024-08-06 06:32:07,761][52669] DAMAGECOUNT value on done: 768314.0 [2024-08-06 06:32:07,762][52669] Sum rewards: 77.814, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.930', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.084', 'weapon5': '0.210', 'AMMO4': '0.212', 'AMMO3': '0.262', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.056', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '67.000'} [2024-08-06 06:32:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 569819136. Throughput: 0: 4358.0. Samples: 142458220. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:32:07,794][52567] Avg episode reward: [(0, '73.227')] [2024-08-06 06:32:08,235][52658] DAMAGECOUNT value on done: 750119.0 [2024-08-06 06:32:08,238][52658] Sum rewards: 62.828, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.425', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.032', 'WEAPON4': '0.100', 'AMMO3': '0.134', 'weapon4': '0.134', 'weapon5': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '0.950', 'weapon3': '2.894', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '48.500'} [2024-08-06 06:32:08,599][52671] DAMAGECOUNT value on done: 765904.0 [2024-08-06 06:32:08,600][52671] Sum rewards: 75.276, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.980', 'AMMO5': '0.009', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.132', 'AMMO3': '0.162', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.578', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:08,646][52668] DAMAGECOUNT value on done: 765890.0 [2024-08-06 06:32:08,647][52668] Sum rewards: 93.008, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.188', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.159', 'weapon4': '0.168', 'weapon5': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.928', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.843', 'FRAGCOUNT': '72.500'} [2024-08-06 06:32:09,051][52650] Updated weights for policy 0, policy_version 69561 (0.0023) [2024-08-06 06:32:09,093][52670] DAMAGECOUNT value on done: 750645.0 [2024-08-06 06:32:09,095][52670] Sum rewards: 79.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '66.000'} [2024-08-06 06:32:09,372][52662] DAMAGECOUNT value on done: 766024.0 [2024-08-06 06:32:09,374][52662] Sum rewards: 77.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.880', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.084', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.266', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:09,963][52647] DAMAGECOUNT value on done: 800068.0 [2024-08-06 06:32:09,963][52647] Sum rewards: 85.008, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.096', 'weapon5': '0.132', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.215', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '70.000'} [2024-08-06 06:32:10,502][52803] DAMAGECOUNT value on done: 700490.0 [2024-08-06 06:32:10,505][52803] Sum rewards: 79.215, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.956', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.099', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.268', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:10,522][52820] DAMAGECOUNT value on done: 715116.0 [2024-08-06 06:32:10,522][52820] Sum rewards: 81.272, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.030', 'AMMO5': '0.023', 'AMMO2': '0.044', 'weapon4': '0.144', 'weapon5': '0.188', 'AMMO4': '0.218', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '68.000'} [2024-08-06 06:32:10,534][52795] DAMAGECOUNT value on done: 701073.0 [2024-08-06 06:32:10,534][52666] DAMAGECOUNT value on done: 748685.0 [2024-08-06 06:32:10,534][52795] Sum rewards: 73.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.265', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon4': '0.234', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.140', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '63.000'} [2024-08-06 06:32:10,534][52666] Sum rewards: 70.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.198', 'AMMO4': '0.201', 'weapon2': '0.206', 'AMMO3': '0.236', 'weapon4': '0.496', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.780', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '58.000'} [2024-08-06 06:32:10,667][52669] DAMAGECOUNT value on done: 761737.0 [2024-08-06 06:32:10,667][52669] Sum rewards: 72.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.136', 'AMMO4': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon5': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '58.000'} [2024-08-06 06:32:11,273][52658] DAMAGECOUNT value on done: 759799.0 [2024-08-06 06:32:11,273][52658] Sum rewards: 76.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.373', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.267', 'weapon2': '0.596', 'WEAPON3': '1.600', 'weapon3': '3.142', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:11,663][52671] DAMAGECOUNT value on done: 755778.0 [2024-08-06 06:32:11,664][52671] Sum rewards: 68.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.845', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.144', 'weapon2': '0.212', 'AMMO3': '0.217', 'weapon5': '0.244', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.140', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 06:32:11,709][52668] DAMAGECOUNT value on done: 749435.0 [2024-08-06 06:32:11,710][52668] Sum rewards: 75.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon2': '0.172', 'AMMO3': '0.178', 'weapon5': '0.220', 'AMMO4': '0.316', 'weapon4': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:11,837][52670] DAMAGECOUNT value on done: 734006.0 [2024-08-06 06:32:11,841][52670] Sum rewards: 67.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.332', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon2': '0.186', 'weapon5': '0.186', 'AMMO4': '0.198', 'AMMO3': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '55.000'} [2024-08-06 06:32:12,448][52662] DAMAGECOUNT value on done: 766985.0 [2024-08-06 06:32:12,456][52662] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.100', 'weapon5': '0.114', 'AMMO4': '0.133', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.144', 'FRAGCOUNT': '57.000'} [2024-08-06 06:32:12,574][52647] DAMAGECOUNT value on done: 795917.0 [2024-08-06 06:32:12,576][52647] Sum rewards: 64.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.998', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.144', 'AMMO3': '0.184', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.678', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '53.000'} [2024-08-06 06:32:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 569909248. Throughput: 0: 4363.8. Samples: 142484390. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:32:12,794][52567] Avg episode reward: [(0, '73.036')] [2024-08-06 06:32:13,167][52669] DAMAGECOUNT value on done: 763762.0 [2024-08-06 06:32:13,168][52669] Sum rewards: 74.109, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.708', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.067', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO3': '0.269', 'AMMO4': '0.333', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.550', 'weapon3': '2.924', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '65.000'} [2024-08-06 06:32:13,343][52666] DAMAGECOUNT value on done: 745438.0 [2024-08-06 06:32:13,346][52666] Sum rewards: 72.078, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.116', 'weapon5': '0.124', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '58.000'} [2024-08-06 06:32:13,659][52803] DAMAGECOUNT value on done: 714806.0 [2024-08-06 06:32:13,661][52803] Sum rewards: 83.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.060', 'AMMO3': '0.171', 'weapon5': '0.210', 'AMMO4': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '68.000'} [2024-08-06 06:32:13,773][52650] Updated weights for policy 0, policy_version 69571 (0.0021) [2024-08-06 06:32:13,804][52820] DAMAGECOUNT value on done: 712469.0 [2024-08-06 06:32:13,805][52820] Sum rewards: 70.129, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.360', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.120', 'AMMO4': '0.196', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON4': '0.350', 'weapon2': '0.368', 'ARMOR': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.500'} [2024-08-06 06:32:13,876][52795] DAMAGECOUNT value on done: 691787.0 [2024-08-06 06:32:13,879][52795] Sum rewards: 76.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:14,705][52670] DAMAGECOUNT value on done: 746301.0 [2024-08-06 06:32:14,709][52670] Sum rewards: 69.551, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.384', 'AMMO5': '0.013', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.144', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.216', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '54.000'} [2024-08-06 06:32:14,742][52668] DAMAGECOUNT value on done: 762285.0 [2024-08-06 06:32:14,743][52668] Sum rewards: 87.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.060', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.229', 'WEAPON3': '1.450', 'weapon3': '3.554', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.423', 'FRAGCOUNT': '71.000'} [2024-08-06 06:32:14,883][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:32:14,998][52647] DAMAGECOUNT value on done: 795750.0 [2024-08-06 06:32:15,001][52647] Sum rewards: 73.806, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.332', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.484', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '63.000'} [2024-08-06 06:32:15,380][52662] DAMAGECOUNT value on done: 750330.0 [2024-08-06 06:32:15,383][52662] Sum rewards: 77.337, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.107', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '65.000'} [2024-08-06 06:32:16,119][52666] DAMAGECOUNT value on done: 747588.0 [2024-08-06 06:32:16,121][52666] Sum rewards: 73.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.590', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.084', 'weapon4': '0.110', 'AMMO4': '0.170', 'AMMO3': '0.277', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.194', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:16,133][52669] DAMAGECOUNT value on done: 768211.0 [2024-08-06 06:32:16,133][52669] Sum rewards: 78.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.780', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.132', 'weapon2': '0.254', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.006', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '66.000'} [2024-08-06 06:32:16,659][52803] DAMAGECOUNT value on done: 704989.0 [2024-08-06 06:32:16,661][52803] Sum rewards: 84.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.646', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '70.000'} [2024-08-06 06:32:16,861][52795] DAMAGECOUNT value on done: 699391.0 [2024-08-06 06:32:16,862][52795] Sum rewards: 58.545, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.215', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.265', 'weapon5': '0.274', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '48.000'} [2024-08-06 06:32:16,871][52820] DAMAGECOUNT value on done: 696941.0 [2024-08-06 06:32:16,873][52820] Sum rewards: 61.830, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.148', 'AMMO4': '0.167', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.256', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '51.000'} [2024-08-06 06:32:17,531][52670] DAMAGECOUNT value on done: 755676.0 [2024-08-06 06:32:17,532][52670] Sum rewards: 73.344, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.212', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.072', 'weapon5': '0.160', 'AMMO4': '0.263', 'AMMO3': '0.307', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.850', 'weapon3': '3.048', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 06:32:17,628][52647] DAMAGECOUNT value on done: 787561.0 [2024-08-06 06:32:17,629][52647] Sum rewards: 70.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.951', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon4': '0.206', 'weapon2': '0.238', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 569991168. Throughput: 0: 4367.3. Samples: 142497670. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:32:17,794][52567] Avg episode reward: [(0, '73.121')] [2024-08-06 06:32:17,842][52668] DAMAGECOUNT value on done: 762462.0 [2024-08-06 06:32:17,842][52668] Sum rewards: 78.551, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.122', 'HEALTH': '0.154', 'weapon5': '0.166', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.292', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:18,113][52662] DAMAGECOUNT value on done: 767702.0 [2024-08-06 06:32:18,114][52662] Sum rewards: 58.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.042', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.236', 'weapon4': '0.268', 'AMMO4': '0.313', 'weapon2': '0.404', 'weapon5': '0.418', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.584', 'HITCOUNT': '2.690', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '49.000'} [2024-08-06 06:32:18,313][52650] Updated weights for policy 0, policy_version 69581 (0.0010) [2024-08-06 06:32:18,765][52667] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:32:19,058][52666] DAMAGECOUNT value on done: 762169.0 [2024-08-06 06:32:19,059][52666] Sum rewards: 62.055, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.742', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO4': '0.044', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.330', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.374', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '52.000'} [2024-08-06 06:32:19,724][52803] DAMAGECOUNT value on done: 706047.0 [2024-08-06 06:32:19,727][52803] Sum rewards: 77.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.260', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.108', 'weapon4': '0.140', 'AMMO3': '0.143', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '0.850', 'weapon3': '3.140', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:20,151][52795] DAMAGECOUNT value on done: 706921.0 [2024-08-06 06:32:20,153][52795] Sum rewards: 72.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.126', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.180', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:20,333][52647] DAMAGECOUNT value on done: 804730.0 [2024-08-06 06:32:20,334][52647] Sum rewards: 74.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.116', 'weapon5': '0.170', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:20,885][52670] DAMAGECOUNT value on done: 751302.0 [2024-08-06 06:32:20,896][52670] Sum rewards: 87.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.315', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.140', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.894', 'FRAGCOUNT': '70.000'} [2024-08-06 06:32:21,078][52668] DAMAGECOUNT value on done: 753181.0 [2024-08-06 06:32:21,079][52668] Sum rewards: 56.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.683', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.138', 'AMMO4': '0.171', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.308', 'weapon2': '0.528', 'WEAPON3': '1.050', 'HITCOUNT': '2.760', 'weapon3': '2.812', 'DAMAGECOUNT': '13.359', 'FRAGCOUNT': '47.000'} [2024-08-06 06:32:21,174][52662] DAMAGECOUNT value on done: 749858.0 [2024-08-06 06:32:21,177][52662] Sum rewards: 68.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.882', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.162', 'weapon5': '0.180', 'AMMO4': '0.226', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.734', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '53.000'} [2024-08-06 06:32:22,340][52666] DAMAGECOUNT value on done: 737032.0 [2024-08-06 06:32:22,342][52666] Sum rewards: 81.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.240', 'weapon2': '0.252', 'WEAPON3': '1.550', 'weapon3': '3.484', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '69.000'} [2024-08-06 06:32:22,779][52803] DAMAGECOUNT value on done: 717502.0 [2024-08-06 06:32:22,787][52803] Sum rewards: 69.528, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.138', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.295', 'weapon2': '0.296', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 570081280. Throughput: 0: 4364.7. Samples: 142523820. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:32:22,794][52567] Avg episode reward: [(0, '72.740')] [2024-08-06 06:32:22,962][52650] Updated weights for policy 0, policy_version 69591 (0.0016) [2024-08-06 06:32:23,077][52647] DAMAGECOUNT value on done: 788695.0 [2024-08-06 06:32:23,078][52647] Sum rewards: 78.550, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.926', 'AMMO4': '-0.034', 'AMMO2': '-0.007', 'AMMO3': '0.148', 'weapon2': '0.720', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '63.000'} [2024-08-06 06:32:23,416][52670] DAMAGECOUNT value on done: 753428.0 [2024-08-06 06:32:23,417][52670] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.190', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.090', 'weapon5': '0.248', 'AMMO4': '0.269', 'weapon2': '0.298', 'AMMO3': '0.299', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.046', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:24,239][52668] DAMAGECOUNT value on done: 752450.0 [2024-08-06 06:32:24,241][52668] Sum rewards: 69.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.154', 'AMMO3': '0.171', 'weapon4': '0.274', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '57.000'} [2024-08-06 06:32:24,336][52662] DAMAGECOUNT value on done: 759239.0 [2024-08-06 06:32:24,337][52662] Sum rewards: 57.914, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.996', 'AMMO5': '0.023', 'AMMO2': '0.049', 'AMMO3': '0.205', 'weapon5': '0.212', 'AMMO4': '0.247', 'weapon2': '0.332', 'weapon4': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '51.000'} [2024-08-06 06:32:24,957][52666] DAMAGECOUNT value on done: 749610.0 [2024-08-06 06:32:24,959][52666] Sum rewards: 80.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.818', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.726', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '65.000'} [2024-08-06 06:32:25,815][52647] DAMAGECOUNT value on done: 799146.0 [2024-08-06 06:32:25,815][52647] Sum rewards: 73.062, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.675', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.170', 'weapon4': '0.204', 'weapon2': '0.224', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '63.000'} [2024-08-06 06:32:25,925][52803] DAMAGECOUNT value on done: 703353.0 [2024-08-06 06:32:25,925][52803] Sum rewards: 76.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.220', 'weapon4': '0.242', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '63.000'} [2024-08-06 06:32:26,825][52668] DAMAGECOUNT value on done: 760184.0 [2024-08-06 06:32:26,827][52668] Sum rewards: 59.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.038', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '51.000'} [2024-08-06 06:32:27,278][52662] DAMAGECOUNT value on done: 773208.0 [2024-08-06 06:32:27,279][52662] Sum rewards: 85.137, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.239', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.452', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '72.000'} [2024-08-06 06:32:27,719][52650] Updated weights for policy 0, policy_version 69601 (0.0013) [2024-08-06 06:32:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 570171392. Throughput: 0: 4361.8. Samples: 142549990. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 06:32:27,802][52567] Avg episode reward: [(0, '72.737')] [2024-08-06 06:32:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069601_570171392.pth... [2024-08-06 06:32:27,943][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069090_565985280.pth [2024-08-06 06:32:29,013][52803] DAMAGECOUNT value on done: 705568.0 [2024-08-06 06:32:29,017][52803] Sum rewards: 78.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.495', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon2': '0.134', 'AMMO3': '0.166', 'AMMO4': '0.169', 'weapon4': '0.204', 'weapon5': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:29,070][52647] DAMAGECOUNT value on done: 800611.0 [2024-08-06 06:32:29,070][52647] Sum rewards: 79.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.012', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.250', 'AMMO3': '0.266', 'weapon4': '0.288', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '67.000'} [2024-08-06 06:32:29,447][52668] DAMAGECOUNT value on done: 757072.0 [2024-08-06 06:32:29,449][52668] Sum rewards: 76.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.179', 'weapon4': '0.184', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:30,049][52662] DAMAGECOUNT value on done: 759634.0 [2024-08-06 06:32:30,050][52662] Sum rewards: 71.438, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.995', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.206', 'weapon2': '0.260', 'WEAPON3': '1.400', 'HITCOUNT': '3.560', 'weapon3': '3.588', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:31,912][52647] DAMAGECOUNT value on done: 787895.0 [2024-08-06 06:32:31,913][52647] Sum rewards: 74.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.130', 'AMMO4': '0.160', 'weapon4': '0.174', 'AMMO3': '0.201', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:32,117][52803] DAMAGECOUNT value on done: 708899.0 [2024-08-06 06:32:32,117][52803] Sum rewards: 75.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.680', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.173', 'weapon5': '0.204', 'weapon2': '0.210', 'AMMO4': '0.283', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.982', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:32,497][52668] DAMAGECOUNT value on done: 749707.0 [2024-08-06 06:32:32,499][52668] Sum rewards: 63.720, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.990', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.136', 'weapon4': '0.160', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.369', 'WEAPON3': '2.150', 'weapon3': '3.164', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 570245120. Throughput: 0: 4356.7. Samples: 142562840. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:32:32,794][52567] Avg episode reward: [(0, '73.250')] [2024-08-06 06:32:32,903][52650] Updated weights for policy 0, policy_version 69611 (0.0030) [2024-08-06 06:32:33,288][52662] DAMAGECOUNT value on done: 767840.0 [2024-08-06 06:32:33,289][52662] Sum rewards: 68.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.382', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.342', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '56.000'} [2024-08-06 06:32:34,483][52647] DAMAGECOUNT value on done: 793795.0 [2024-08-06 06:32:34,483][52647] Sum rewards: 58.810, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.684', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.138', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.228', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.296', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '53.000'} [2024-08-06 06:32:35,132][52668] DAMAGECOUNT value on done: 745049.0 [2024-08-06 06:32:35,133][52668] Sum rewards: 70.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.595', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.128', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'weapon4': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:35,287][52803] DAMAGECOUNT value on done: 711592.0 [2024-08-06 06:32:35,288][52803] Sum rewards: 80.699, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.306', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.126', 'weapon5': '0.132', 'weapon2': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'WEAPON3': '1.750', 'weapon3': '3.382', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.174', 'FRAGCOUNT': '68.000'} [2024-08-06 06:32:36,050][52662] DAMAGECOUNT value on done: 754731.0 [2024-08-06 06:32:36,052][52662] Sum rewards: 75.686, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.006', 'HEALTH': '0.011', 'AMMO4': '0.030', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.158', 'weapon2': '0.656', 'WEAPON3': '0.950', 'weapon3': '3.154', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:36,970][52647] DAMAGECOUNT value on done: 783434.0 [2024-08-06 06:32:36,971][52647] Sum rewards: 80.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.105', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.179', 'weapon2': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.502', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '65.000'} [2024-08-06 06:32:37,258][52650] Updated weights for policy 0, policy_version 69621 (0.0022) [2024-08-06 06:32:37,673][52668] DAMAGECOUNT value on done: 745823.0 [2024-08-06 06:32:37,674][52668] Sum rewards: 79.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.206', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 570343424. Throughput: 0: 4356.2. Samples: 142589070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:32:37,794][52567] Avg episode reward: [(0, '73.338')] [2024-08-06 06:32:38,338][52803] DAMAGECOUNT value on done: 714309.0 [2024-08-06 06:32:38,347][52803] Sum rewards: 71.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.918', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.080', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.408', 'WEAPON3': '1.700', 'weapon3': '3.212', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '62.500'} [2024-08-06 06:32:39,129][52662] DAMAGECOUNT value on done: 757409.0 [2024-08-06 06:32:39,129][52662] Sum rewards: 65.923, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.375', 'AMMO5': '0.024', 'AMMO2': '0.054', 'weapon4': '0.104', 'AMMO3': '0.229', 'AMMO4': '0.272', 'weapon5': '0.280', 'weapon2': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '55.000'} [2024-08-06 06:32:39,388][52647] DAMAGECOUNT value on done: 790649.0 [2024-08-06 06:32:39,389][52647] Sum rewards: 76.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.160', 'weapon4': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '63.000'} [2024-08-06 06:32:39,422][52820] Large shaping reward 2.750 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 06:32:40,085][52660] DAMAGECOUNT value on done: 757467.0 [2024-08-06 06:32:40,086][52660] Sum rewards: 77.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.620', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.102', 'weapon5': '0.132', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:40,567][52668] DAMAGECOUNT value on done: 744748.0 [2024-08-06 06:32:40,568][52668] Sum rewards: 70.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.072', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.712', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '58.000'} [2024-08-06 06:32:41,534][52803] DAMAGECOUNT value on done: 708987.0 [2024-08-06 06:32:41,537][52803] Sum rewards: 74.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.966', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.126', 'AMMO4': '0.165', 'AMMO3': '0.197', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '61.000'} [2024-08-06 06:32:41,931][52650] Updated weights for policy 0, policy_version 69631 (0.0021) [2024-08-06 06:32:42,145][52662] DAMAGECOUNT value on done: 752005.0 [2024-08-06 06:32:42,147][52662] Sum rewards: 73.756, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.028', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.152', 'AMMO4': '0.169', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.398', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:42,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 570425344. Throughput: 0: 4371.8. Samples: 142615730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:32:42,795][52567] Avg episode reward: [(0, '73.113')] [2024-08-06 06:32:43,135][52660] DAMAGECOUNT value on done: 747333.0 [2024-08-06 06:32:43,136][52660] Sum rewards: 67.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.518', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.432', 'WEAPON3': '1.500', 'HITCOUNT': '3.340', 'weapon3': '3.360', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:43,590][52668] DAMAGECOUNT value on done: 756263.0 [2024-08-06 06:32:43,591][52668] Sum rewards: 71.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.638', 'WEAPON1': '0.020', 'AMMO5': '0.021', 'AMMO2': '0.034', 'weapon4': '0.106', 'weapon5': '0.148', 'AMMO4': '0.172', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '59.500'} [2024-08-06 06:32:44,564][52811] Large shaping reward -2.536 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:32:44,811][52662] DAMAGECOUNT value on done: 763671.0 [2024-08-06 06:32:44,815][52662] Sum rewards: 74.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.995', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.062', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon4': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:46,312][52660] DAMAGECOUNT value on done: 759236.0 [2024-08-06 06:32:46,312][52660] Sum rewards: 78.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.055', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'AMMO3': '0.186', 'weapon2': '0.272', 'WEAPON3': '1.100', 'weapon3': '3.618', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '62.000'} [2024-08-06 06:32:46,608][52650] Updated weights for policy 0, policy_version 69641 (0.0009) [2024-08-06 06:32:46,825][52668] DAMAGECOUNT value on done: 758432.0 [2024-08-06 06:32:46,827][52668] Sum rewards: 72.802, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.162', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.124', 'AMMO3': '0.206', 'weapon5': '0.206', 'AMMO4': '0.215', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:47,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 570515456. Throughput: 0: 4370.6. Samples: 142628760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:32:47,795][52567] Avg episode reward: [(0, '73.059')] [2024-08-06 06:32:47,825][52662] DAMAGECOUNT value on done: 750537.0 [2024-08-06 06:32:47,826][52662] Sum rewards: 63.324, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.522', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.254', 'AMMO3': '0.281', 'WEAPON3': '1.600', 'HITCOUNT': '3.290', 'weapon3': '3.396', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '55.000'} [2024-08-06 06:32:49,486][52660] DAMAGECOUNT value on done: 768246.0 [2024-08-06 06:32:49,490][52660] Sum rewards: 82.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO3': '0.203', 'weapon2': '0.218', 'AMMO4': '0.228', 'weapon5': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '67.000'} [2024-08-06 06:32:49,920][52668] DAMAGECOUNT value on done: 754441.0 [2024-08-06 06:32:49,921][52668] Sum rewards: 69.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.928', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.100', 'AMMO3': '0.206', 'AMMO4': '0.250', 'weapon5': '0.282', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '56.000'} [2024-08-06 06:32:50,381][52662] DAMAGECOUNT value on done: 766813.0 [2024-08-06 06:32:50,381][52662] Sum rewards: 71.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.036', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.134', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:51,263][52650] Updated weights for policy 0, policy_version 69651 (0.0016) [2024-08-06 06:32:51,862][52660] DAMAGECOUNT value on done: 753069.0 [2024-08-06 06:32:51,863][52660] Sum rewards: 69.533, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.215', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.058', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.137', 'weapon2': '0.254', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.520', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '55.000'} [2024-08-06 06:32:52,259][52668] DAMAGECOUNT value on done: 760702.0 [2024-08-06 06:32:52,259][52668] Sum rewards: 81.122, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.022', 'weapon5': '0.032', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '68.000'} [2024-08-06 06:32:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 570605568. Throughput: 0: 4376.2. Samples: 142655150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:32:52,794][52567] Avg episode reward: [(0, '72.930')] [2024-08-06 06:32:53,570][52662] DAMAGECOUNT value on done: 761664.0 [2024-08-06 06:32:53,572][52662] Sum rewards: 64.428, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.448', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.170', 'weapon5': '0.174', 'AMMO4': '0.190', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '53.000'} [2024-08-06 06:32:54,567][52660] DAMAGECOUNT value on done: 746734.0 [2024-08-06 06:32:54,577][52660] Sum rewards: 67.570, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.972', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.166', 'weapon2': '0.254', 'AMMO4': '0.257', 'weapon4': '0.272', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.016', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '59.000'} [2024-08-06 06:32:54,884][52668] DAMAGECOUNT value on done: 760815.0 [2024-08-06 06:32:54,885][52668] Sum rewards: 72.905, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.410', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.117', 'AMMO3': '0.178', 'weapon5': '0.194', 'weapon2': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:55,786][52650] Updated weights for policy 0, policy_version 69661 (0.0032) [2024-08-06 06:32:56,794][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:32:57,050][52662] DAMAGECOUNT value on done: 748473.0 [2024-08-06 06:32:57,051][52662] Sum rewards: 70.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.109', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.806', 'WEAPON3': '1.450', 'weapon3': '2.732', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '60.000'} [2024-08-06 06:32:57,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 570687488. Throughput: 0: 4376.4. Samples: 142681330. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:32:57,795][52567] Avg episode reward: [(0, '72.829')] [2024-08-06 06:32:57,830][52660] DAMAGECOUNT value on done: 757306.0 [2024-08-06 06:32:57,830][52660] Sum rewards: 79.683, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.689', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.078', 'AMMO4': '0.088', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.852', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '64.000'} [2024-08-06 06:32:59,887][52662] DAMAGECOUNT value on done: 758715.0 [2024-08-06 06:32:59,887][52662] Sum rewards: 74.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.518', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.130', 'weapon5': '0.136', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '64.000'} [2024-08-06 06:33:00,295][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:00,852][52650] Updated weights for policy 0, policy_version 69671 (0.0012) [2024-08-06 06:33:00,982][52660] DAMAGECOUNT value on done: 764160.0 [2024-08-06 06:33:00,984][52660] Sum rewards: 60.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.018', 'AMMO2': '0.073', 'weapon4': '0.222', 'AMMO3': '0.228', 'weapon5': '0.252', 'AMMO4': '0.365', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.822', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '51.000'} [2024-08-06 06:33:01,647][52659] DAMAGECOUNT value on done: 759498.0 [2024-08-06 06:33:01,649][52659] Sum rewards: 68.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.332', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.244', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 570777600. Throughput: 0: 4371.6. Samples: 142694390. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:33:02,794][52567] Avg episode reward: [(0, '73.030')] [2024-08-06 06:33:02,927][52662] DAMAGECOUNT value on done: 748930.0 [2024-08-06 06:33:02,927][52662] Sum rewards: 67.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.074', 'weapon5': '0.160', 'AMMO4': '0.209', 'AMMO3': '0.235', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.170', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:03,606][52660] DAMAGECOUNT value on done: 750182.0 [2024-08-06 06:33:03,607][52660] Sum rewards: 84.803, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.569', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.107', 'AMMO3': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.358', 'WEAPON3': '0.900', 'weapon3': '3.334', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '65.000'} [2024-08-06 06:33:04,879][52659] DAMAGECOUNT value on done: 759513.0 [2024-08-06 06:33:04,880][52659] Sum rewards: 66.133, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.008', 'ARMOR': '0.008', 'weapon4': '0.014', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '53.000'} [2024-08-06 06:33:05,370][52650] Updated weights for policy 0, policy_version 69681 (0.0034) [2024-08-06 06:33:06,249][52660] DAMAGECOUNT value on done: 751507.0 [2024-08-06 06:33:06,249][52660] Sum rewards: 75.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.576', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon4': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '61.000'} [2024-08-06 06:33:07,191][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:07,283][52659] DAMAGECOUNT value on done: 762752.0 [2024-08-06 06:33:07,283][52659] Sum rewards: 84.663, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.844', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.108', 'weapon4': '0.118', 'weapon2': '0.160', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.386', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '73.000'} [2024-08-06 06:33:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 570867712. Throughput: 0: 4374.5. Samples: 142720670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:33:07,794][52567] Avg episode reward: [(0, '73.417')] [2024-08-06 06:33:09,204][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:09,298][52649] DAMAGECOUNT value on done: 736424.0 [2024-08-06 06:33:09,299][52649] Sum rewards: 83.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.035', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.136', 'AMMO4': '0.176', 'AMMO3': '0.229', 'WEAPON3': '1.400', 'weapon3': '3.640', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '70.000'} [2024-08-06 06:33:09,411][52660] DAMAGECOUNT value on done: 757590.0 [2024-08-06 06:33:09,412][52660] Sum rewards: 71.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.706', 'AMMO5': '0.013', 'AMMO2': '0.057', 'AMMO3': '0.191', 'weapon4': '0.238', 'weapon5': '0.264', 'AMMO4': '0.283', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.736', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.500'} [2024-08-06 06:33:09,903][52659] DAMAGECOUNT value on done: 761225.0 [2024-08-06 06:33:09,903][52659] Sum rewards: 65.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.762', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.206', 'AMMO3': '0.225', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.300', 'weapon3': '2.714', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:10,193][52650] Updated weights for policy 0, policy_version 69691 (0.0014) [2024-08-06 06:33:12,124][52811] Large shaping reward 2.570 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.519, 173.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:12,233][52649] DAMAGECOUNT value on done: 726813.0 [2024-08-06 06:33:12,235][52649] Sum rewards: 71.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.685', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.000', 'HITCOUNT': '3.370', 'weapon3': '3.390', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:12,421][52659] DAMAGECOUNT value on done: 759765.0 [2024-08-06 06:33:12,422][52659] Sum rewards: 87.091, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'HEALTH': '0.024', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO3': '0.182', 'weapon5': '0.190', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '70.000'} [2024-08-06 06:33:12,585][52660] DAMAGECOUNT value on done: 748571.0 [2024-08-06 06:33:12,586][52660] Sum rewards: 67.806, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.696', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.102', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.762', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '55.000'} [2024-08-06 06:33:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 570949632. Throughput: 0: 4378.0. Samples: 142747000. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:33:12,795][52567] Avg episode reward: [(0, '73.152')] [2024-08-06 06:33:13,203][52659] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:14,506][52650] Updated weights for policy 0, policy_version 69701 (0.0023) [2024-08-06 06:33:15,147][52649] DAMAGECOUNT value on done: 748315.0 [2024-08-06 06:33:15,149][52649] Sum rewards: 81.919, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon2': '0.144', 'AMMO3': '0.217', 'WEAPON3': '1.500', 'weapon3': '3.638', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.586', 'FRAGCOUNT': '68.000'} [2024-08-06 06:33:15,460][52659] DAMAGECOUNT value on done: 760354.0 [2024-08-06 06:33:15,461][52659] Sum rewards: 72.866, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.335', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.103', 'AMMO3': '0.148', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.000', 'HITCOUNT': '3.310', 'weapon3': '3.380', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '58.000'} [2024-08-06 06:33:15,522][52660] DAMAGECOUNT value on done: 757286.0 [2024-08-06 06:33:15,524][52660] Sum rewards: 69.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.526', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.190', 'weapon5': '0.196', 'AMMO3': '0.220', 'AMMO4': '0.231', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '59.000'} [2024-08-06 06:33:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 571039744. Throughput: 0: 4382.2. Samples: 142760040. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:17,794][52567] Avg episode reward: [(0, '73.062')] [2024-08-06 06:33:17,805][52649] DAMAGECOUNT value on done: 742519.0 [2024-08-06 06:33:17,806][52649] Sum rewards: 89.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.145', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.092', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.372', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '22.245', 'FRAGCOUNT': '75.000'} [2024-08-06 06:33:18,312][52660] DAMAGECOUNT value on done: 767405.0 [2024-08-06 06:33:18,313][52660] Sum rewards: 71.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.718', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '60.000'} [2024-08-06 06:33:18,701][52659] DAMAGECOUNT value on done: 761306.0 [2024-08-06 06:33:18,702][52659] Sum rewards: 80.491, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.800', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO3': '0.221', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '66.500'} [2024-08-06 06:33:18,913][52667] DAMAGECOUNT value on done: 758145.0 [2024-08-06 06:33:18,913][52667] Sum rewards: 65.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.152', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.054', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.432', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '56.000'} [2024-08-06 06:33:19,333][52650] Updated weights for policy 0, policy_version 69711 (0.0021) [2024-08-06 06:33:20,446][52649] DAMAGECOUNT value on done: 732059.0 [2024-08-06 06:33:20,454][52649] Sum rewards: 78.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.949', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.273', 'weapon2': '0.326', 'WEAPON3': '1.700', 'weapon3': '3.342', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '68.000'} [2024-08-06 06:33:21,455][52659] DAMAGECOUNT value on done: 757737.0 [2024-08-06 06:33:21,457][52659] Sum rewards: 77.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.238', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '65.000'} [2024-08-06 06:33:21,502][52660] DAMAGECOUNT value on done: 775041.0 [2024-08-06 06:33:21,503][52660] Sum rewards: 80.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.330', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '65.000'} [2024-08-06 06:33:21,710][52667] DAMAGECOUNT value on done: 764947.0 [2024-08-06 06:33:21,712][52667] Sum rewards: 80.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.105', 'weapon5': '0.172', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '66.000'} [2024-08-06 06:33:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 571129856. Throughput: 0: 4378.0. Samples: 142786080. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:22,794][52567] Avg episode reward: [(0, '73.366')] [2024-08-06 06:33:23,173][52649] DAMAGECOUNT value on done: 745826.0 [2024-08-06 06:33:23,174][52649] Sum rewards: 74.281, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.233', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.118', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.279', 'weapon2': '0.356', 'WEAPON3': '1.700', 'weapon3': '3.166', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '65.000'} [2024-08-06 06:33:24,313][52650] Updated weights for policy 0, policy_version 69721 (0.0041) [2024-08-06 06:33:24,426][52659] DAMAGECOUNT value on done: 763422.0 [2024-08-06 06:33:24,429][52659] Sum rewards: 82.617, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.510', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.092', 'weapon5': '0.094', 'AMMO4': '0.114', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'WEAPON3': '1.900', 'weapon3': '3.356', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.153', 'FRAGCOUNT': '71.000'} [2024-08-06 06:33:24,686][52660] DAMAGECOUNT value on done: 751979.0 [2024-08-06 06:33:24,686][52660] Sum rewards: 63.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.083', 'weapon5': '0.096', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.282', 'DAMAGECOUNT': '14.478', 'FRAGCOUNT': '55.000'} [2024-08-06 06:33:24,885][52667] DAMAGECOUNT value on done: 762501.0 [2024-08-06 06:33:24,886][52667] Sum rewards: 79.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon5': '0.194', 'AMMO3': '0.227', 'weapon4': '0.230', 'AMMO4': '0.297', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '67.000'} [2024-08-06 06:33:25,755][52649] DAMAGECOUNT value on done: 740713.0 [2024-08-06 06:33:25,756][52649] Sum rewards: 73.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon4': '0.170', 'weapon5': '0.206', 'AMMO3': '0.240', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '62.000'} [2024-08-06 06:33:27,069][52667] DAMAGECOUNT value on done: 768438.0 [2024-08-06 06:33:27,071][52667] Sum rewards: 76.689, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.725', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon2': '0.220', 'AMMO4': '0.224', 'AMMO3': '0.234', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '62.000'} [2024-08-06 06:33:27,385][52660] DAMAGECOUNT value on done: 761839.0 [2024-08-06 06:33:27,385][52660] Sum rewards: 76.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.207', 'weapon5': '0.212', 'weapon4': '0.292', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '64.000'} [2024-08-06 06:33:27,586][52659] DAMAGECOUNT value on done: 766977.0 [2024-08-06 06:33:27,587][52659] Sum rewards: 84.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.083', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.140', 'weapon5': '0.146', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '67.000'} [2024-08-06 06:33:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 571219968. Throughput: 0: 4365.8. Samples: 142812190. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:27,794][52567] Avg episode reward: [(0, '73.512')] [2024-08-06 06:33:28,436][52649] DAMAGECOUNT value on done: 741966.0 [2024-08-06 06:33:28,438][52649] Sum rewards: 60.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon2': '0.192', 'AMMO4': '0.202', 'weapon5': '0.234', 'AMMO3': '0.238', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.876', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '52.000'} [2024-08-06 06:33:28,647][52650] Updated weights for policy 0, policy_version 69731 (0.0012) [2024-08-06 06:33:29,773][52667] DAMAGECOUNT value on done: 769266.0 [2024-08-06 06:33:29,774][52667] Sum rewards: 77.242, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.190', 'AMMO5': '0.019', 'AMMO2': '0.072', 'weapon4': '0.196', 'weapon5': '0.278', 'AMMO3': '0.292', 'AMMO4': '0.359', 'weapon2': '0.372', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.776', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '67.500'} [2024-08-06 06:33:30,590][52660] DAMAGECOUNT value on done: 757314.0 [2024-08-06 06:33:30,591][52660] Sum rewards: 70.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.081', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:30,802][52659] DAMAGECOUNT value on done: 754965.0 [2024-08-06 06:33:30,805][52659] Sum rewards: 73.271, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.732', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.102', 'weapon2': '0.124', 'AMMO4': '0.124', 'AMMO3': '0.180', 'weapon4': '0.246', 'WEAPON3': '1.150', 'weapon3': '3.274', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '58.000'} [2024-08-06 06:33:31,316][52649] DAMAGECOUNT value on done: 743380.0 [2024-08-06 06:33:31,316][52649] Sum rewards: 82.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.179', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.348', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '67.000'} [2024-08-06 06:33:32,241][52667] DAMAGECOUNT value on done: 769287.0 [2024-08-06 06:33:32,242][52667] Sum rewards: 90.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.772', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.256', 'WEAPON3': '1.150', 'weapon3': '3.506', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '72.000'} [2024-08-06 06:33:32,721][52794] DAMAGECOUNT value on done: 756546.0 [2024-08-06 06:33:32,722][52794] Sum rewards: 84.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.146', 'AMMO3': '0.201', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.075', 'FRAGCOUNT': '67.000'} [2024-08-06 06:33:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 571301888. Throughput: 0: 4368.0. Samples: 142825320. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:32,794][52567] Avg episode reward: [(0, '73.754')] [2024-08-06 06:33:33,404][52650] Updated weights for policy 0, policy_version 69741 (0.0019) [2024-08-06 06:33:33,476][52660] DAMAGECOUNT value on done: 750646.0 [2024-08-06 06:33:33,477][52660] Sum rewards: 84.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '69.000'} [2024-08-06 06:33:33,912][52659] DAMAGECOUNT value on done: 763857.0 [2024-08-06 06:33:33,912][52659] Sum rewards: 70.914, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.006', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.065', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.306', 'weapon2': '0.344', 'WEAPON3': '1.900', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '63.000'} [2024-08-06 06:33:34,683][52649] DAMAGECOUNT value on done: 735203.0 [2024-08-06 06:33:34,683][52649] Sum rewards: 67.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.776', 'AMMO5': '0.024', 'AMMO2': '0.067', 'AMMO3': '0.206', 'weapon5': '0.274', 'weapon4': '0.286', 'AMMO4': '0.337', 'weapon2': '0.618', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.526', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '54.000'} [2024-08-06 06:33:34,796][52667] DAMAGECOUNT value on done: 762752.0 [2024-08-06 06:33:34,797][52667] Sum rewards: 77.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.046', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.180', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '63.000'} [2024-08-06 06:33:35,849][52794] DAMAGECOUNT value on done: 763481.0 [2024-08-06 06:33:35,857][52794] Sum rewards: 51.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.054', 'weapon4': '0.056', 'AMMO3': '0.162', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '3.074', 'DAMAGECOUNT': '13.665', 'FRAGCOUNT': '42.000'} [2024-08-06 06:33:36,426][52660] DAMAGECOUNT value on done: 749721.0 [2024-08-06 06:33:36,427][52660] Sum rewards: 74.631, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.194', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.488', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.000'} [2024-08-06 06:33:37,057][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:37,069][52614] Signal inference workers to stop experience collection... (12700 times) [2024-08-06 06:33:37,075][52614] Signal inference workers to resume experience collection... (12700 times) [2024-08-06 06:33:37,133][52650] InferenceWorker_p0-w0: stopping experience collection (12700 times) [2024-08-06 06:33:37,133][52650] InferenceWorker_p0-w0: resuming experience collection (12700 times) [2024-08-06 06:33:37,145][52659] DAMAGECOUNT value on done: 760227.0 [2024-08-06 06:33:37,145][52659] Sum rewards: 80.886, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.184', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.191', 'weapon2': '0.342', 'WEAPON3': '1.050', 'weapon3': '3.354', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '65.000'} [2024-08-06 06:33:37,416][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:33:37,633][52649] DAMAGECOUNT value on done: 748333.0 [2024-08-06 06:33:37,635][52649] Sum rewards: 74.650, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.355', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.194', 'weapon5': '0.256', 'AMMO3': '0.267', 'weapon2': '0.270', 'AMMO4': '0.323', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.898', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2024-08-06 06:33:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 571392000. Throughput: 0: 4369.3. Samples: 142851770. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:37,794][52567] Avg episode reward: [(0, '74.030')] [2024-08-06 06:33:37,837][52667] DAMAGECOUNT value on done: 759913.0 [2024-08-06 06:33:37,838][52667] Sum rewards: 68.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.146', 'AMMO4': '0.184', 'weapon5': '0.184', 'AMMO3': '0.208', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:38,299][52650] Updated weights for policy 0, policy_version 69751 (0.0012) [2024-08-06 06:33:38,965][52794] DAMAGECOUNT value on done: 769421.0 [2024-08-06 06:33:38,966][52794] Sum rewards: 80.970, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.348', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '66.000'} [2024-08-06 06:33:39,942][52659] DAMAGECOUNT value on done: 761503.0 [2024-08-06 06:33:39,945][52659] Sum rewards: 96.746, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.645', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.142', 'weapon4': '0.196', 'AMMO3': '0.216', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '4.330', 'DAMAGECOUNT': '23.190', 'FRAGCOUNT': '78.000'} [2024-08-06 06:33:40,264][52649] DAMAGECOUNT value on done: 750352.0 [2024-08-06 06:33:40,264][52649] Sum rewards: 72.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.228', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.228', 'weapon5': '0.228', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '59.000'} [2024-08-06 06:33:40,790][52667] DAMAGECOUNT value on done: 763529.0 [2024-08-06 06:33:40,792][52667] Sum rewards: 81.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.192', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.245', 'AMMO3': '0.252', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.286', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '71.000'} [2024-08-06 06:33:42,053][52794] DAMAGECOUNT value on done: 753362.0 [2024-08-06 06:33:42,054][52794] Sum rewards: 73.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.545', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.137', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '59.000'} [2024-08-06 06:33:42,651][52650] Updated weights for policy 0, policy_version 69761 (0.0011) [2024-08-06 06:33:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 571482112. Throughput: 0: 4368.7. Samples: 142877920. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:42,794][52567] Avg episode reward: [(0, '74.389')] [2024-08-06 06:33:42,813][52659] DAMAGECOUNT value on done: 764579.0 [2024-08-06 06:33:42,813][52659] Sum rewards: 71.718, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.010', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.149', 'weapon5': '0.162', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'weapon4': '0.390', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:43,140][52649] DAMAGECOUNT value on done: 748128.0 [2024-08-06 06:33:43,142][52649] Sum rewards: 83.221, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.089', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.046', 'weapon5': '0.136', 'AMMO4': '0.179', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '67.000'} [2024-08-06 06:33:43,750][52667] DAMAGECOUNT value on done: 769814.0 [2024-08-06 06:33:43,750][52667] Sum rewards: 66.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.136', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.194', 'weapon5': '0.208', 'weapon4': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.814', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 06:33:44,697][52794] DAMAGECOUNT value on done: 754784.0 [2024-08-06 06:33:44,699][52794] Sum rewards: 71.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.155', 'weapon4': '0.164', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '61.000'} [2024-08-06 06:33:45,905][52659] DAMAGECOUNT value on done: 763057.0 [2024-08-06 06:33:45,906][52659] Sum rewards: 77.387, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.326', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.131', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '66.000'} [2024-08-06 06:33:46,036][52667] DAMAGECOUNT value on done: 759866.0 [2024-08-06 06:33:46,037][52667] Sum rewards: 70.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.698', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.102', 'AMMO4': '0.190', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '61.000'} [2024-08-06 06:33:46,301][52649] DAMAGECOUNT value on done: 748885.0 [2024-08-06 06:33:46,301][52649] Sum rewards: 70.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.290', 'weapon4': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '58.000'} [2024-08-06 06:33:47,664][52650] Updated weights for policy 0, policy_version 69771 (0.0011) [2024-08-06 06:33:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 571564032. Throughput: 0: 4373.6. Samples: 142891200. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:47,794][52567] Avg episode reward: [(0, '74.434')] [2024-08-06 06:33:47,969][52794] DAMAGECOUNT value on done: 761302.0 [2024-08-06 06:33:47,969][52794] Sum rewards: 78.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.534', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.072', 'weapon5': '0.100', 'AMMO3': '0.225', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '65.000'} [2024-08-06 06:33:48,548][52667] DAMAGECOUNT value on done: 762125.0 [2024-08-06 06:33:48,549][52667] Sum rewards: 72.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.106', 'AMMO4': '0.122', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.262', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.306', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '58.000'} [2024-08-06 06:33:48,917][52659] DAMAGECOUNT value on done: 769392.0 [2024-08-06 06:33:48,917][52659] Sum rewards: 79.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.399', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'weapon4': '0.202', 'weapon5': '0.220', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '66.500'} [2024-08-06 06:33:49,136][52667] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:49,281][52649] DAMAGECOUNT value on done: 734833.0 [2024-08-06 06:33:49,282][52649] Sum rewards: 78.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.220', 'weapon2': '0.232', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '63.000'} [2024-08-06 06:33:51,342][52667] DAMAGECOUNT value on done: 769476.0 [2024-08-06 06:33:51,342][52667] Sum rewards: 79.661, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.326', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.192', 'AMMO3': '0.254', 'weapon5': '0.276', 'weapon2': '0.290', 'AMMO4': '0.321', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.840', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '68.000'} [2024-08-06 06:33:51,346][52794] DAMAGECOUNT value on done: 764876.0 [2024-08-06 06:33:51,346][52794] Sum rewards: 72.261, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.024', 'AMMO2': '0.075', 'weapon4': '0.164', 'AMMO3': '0.262', 'weapon5': '0.268', 'AMMO4': '0.377', 'weapon2': '0.390', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.838', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '60.000'} [2024-08-06 06:33:51,689][52659] DAMAGECOUNT value on done: 757909.0 [2024-08-06 06:33:51,690][52659] Sum rewards: 73.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.736', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.249', 'WEAPON3': '1.550', 'HITCOUNT': '3.470', 'weapon3': '3.474', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '62.000'} [2024-08-06 06:33:51,691][52650] Updated weights for policy 0, policy_version 69781 (0.0036) [2024-08-06 06:33:52,650][52649] DAMAGECOUNT value on done: 745046.0 [2024-08-06 06:33:52,658][52649] Sum rewards: 76.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.152', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '63.000'} [2024-08-06 06:33:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 571645952. Throughput: 0: 4367.6. Samples: 142917210. Policy #0 lag: (min: 1.0, avg: 2.7, max: 7.0) [2024-08-06 06:33:52,794][52567] Avg episode reward: [(0, '74.521')] [2024-08-06 06:33:53,001][52665] DAMAGECOUNT value on done: 747451.0 [2024-08-06 06:33:53,003][52665] Sum rewards: 79.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.183', 'weapon4': '0.268', 'weapon5': '0.274', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '63.000'} [2024-08-06 06:33:54,135][52794] DAMAGECOUNT value on done: 751694.0 [2024-08-06 06:33:54,135][52794] Sum rewards: 89.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.400', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.152', 'AMMO3': '0.167', 'weapon5': '0.236', 'AMMO4': '0.253', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.646', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '71.000'} [2024-08-06 06:33:54,356][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:33:54,443][52667] DAMAGECOUNT value on done: 757362.0 [2024-08-06 06:33:54,445][52667] Sum rewards: 71.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.680', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.078', 'AMMO3': '0.174', 'AMMO4': '0.175', 'weapon5': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.144', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '57.000'} [2024-08-06 06:33:54,659][52659] DAMAGECOUNT value on done: 766469.0 [2024-08-06 06:33:54,659][52659] Sum rewards: 74.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.218', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '61.000'} [2024-08-06 06:33:55,819][52649] DAMAGECOUNT value on done: 731467.0 [2024-08-06 06:33:55,822][52649] Sum rewards: 80.144, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.262', 'weapon2': '0.288', 'WEAPON3': '1.650', 'weapon3': '3.512', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.103', 'FRAGCOUNT': '68.000'} [2024-08-06 06:33:56,201][52665] DAMAGECOUNT value on done: 762090.0 [2024-08-06 06:33:56,201][52665] Sum rewards: 78.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.074', 'weapon5': '0.166', 'AMMO4': '0.190', 'AMMO3': '0.214', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '64.000'} [2024-08-06 06:33:56,810][52794] DAMAGECOUNT value on done: 763224.0 [2024-08-06 06:33:56,813][52794] Sum rewards: 78.750, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.796', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.088', 'AMMO4': '0.166', 'weapon5': '0.186', 'weapon2': '0.290', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.118', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '68.000'} [2024-08-06 06:33:56,877][52650] Updated weights for policy 0, policy_version 69791 (0.0023) [2024-08-06 06:33:57,358][52667] DAMAGECOUNT value on done: 764149.0 [2024-08-06 06:33:57,359][52667] Sum rewards: 69.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.127', 'weapon4': '0.138', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2024-08-06 06:33:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 571744256. Throughput: 0: 4353.1. Samples: 142942890. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:33:57,795][52567] Avg episode reward: [(0, '74.964')] [2024-08-06 06:33:57,838][52659] DAMAGECOUNT value on done: 759056.0 [2024-08-06 06:33:57,838][52659] Sum rewards: 79.048, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.760', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.149', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'WEAPON3': '1.750', 'weapon3': '3.416', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '68.000'} [2024-08-06 06:33:58,957][52649] DAMAGECOUNT value on done: 748659.0 [2024-08-06 06:33:58,958][52649] Sum rewards: 68.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.186', 'weapon4': '0.192', 'AMMO3': '0.219', 'AMMO4': '0.220', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 06:33:59,249][52665] DAMAGECOUNT value on done: 758095.0 [2024-08-06 06:33:59,249][52665] Sum rewards: 78.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.675', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.047', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.184', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'HITCOUNT': '3.330', 'weapon3': '3.504', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '68.000'} [2024-08-06 06:33:59,852][52667] DAMAGECOUNT value on done: 770376.0 [2024-08-06 06:33:59,853][52667] Sum rewards: 72.697, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.966', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.124', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.242', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '59.000'} [2024-08-06 06:33:59,997][52794] DAMAGECOUNT value on done: 756405.0 [2024-08-06 06:33:59,998][52794] Sum rewards: 79.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.905', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:02,019][52650] Updated weights for policy 0, policy_version 69801 (0.0024) [2024-08-06 06:34:02,069][52649] DAMAGECOUNT value on done: 749651.0 [2024-08-06 06:34:02,070][52649] Sum rewards: 80.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.207', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.474', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:02,294][52665] DAMAGECOUNT value on done: 755135.0 [2024-08-06 06:34:02,295][52665] Sum rewards: 77.094, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.621', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.297', 'weapon2': '0.410', 'WEAPON3': '1.850', 'weapon3': '3.278', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:02,455][52667] DAMAGECOUNT value on done: 767764.0 [2024-08-06 06:34:02,456][52667] Sum rewards: 68.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.810', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.122', 'weapon4': '0.162', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '58.000'} [2024-08-06 06:34:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 571826176. Throughput: 0: 4359.1. Samples: 142956200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:02,794][52567] Avg episode reward: [(0, '75.222')] [2024-08-06 06:34:03,043][52794] DAMAGECOUNT value on done: 752710.0 [2024-08-06 06:34:03,045][52794] Sum rewards: 78.039, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.233', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.154', 'weapon5': '0.182', 'weapon2': '0.246', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:04,261][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:34:05,227][52649] DAMAGECOUNT value on done: 739191.0 [2024-08-06 06:34:05,228][52649] Sum rewards: 80.756, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.072', 'weapon5': '0.174', 'AMMO3': '0.184', 'HEALTH': '0.185', 'AMMO4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.158', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 06:34:05,242][52794] DAMAGECOUNT value on done: 761533.0 [2024-08-06 06:34:05,246][52794] Sum rewards: 82.320, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.080', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.294', 'HEALTH': '0.742', 'WEAPON3': '1.150', 'weapon3': '3.340', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:05,484][52665] DAMAGECOUNT value on done: 740858.0 [2024-08-06 06:34:05,486][52665] Sum rewards: 72.045, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.968', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.086', 'AMMO4': '0.190', 'AMMO3': '0.263', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:06,014][52667] DAMAGECOUNT value on done: 767432.0 [2024-08-06 06:34:06,016][52667] Sum rewards: 75.448, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.515', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.159', 'weapon4': '0.168', 'weapon5': '0.178', 'AMMO4': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:06,139][52650] Updated weights for policy 0, policy_version 69811 (0.0043) [2024-08-06 06:34:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.6). Total num frames: 571908096. Throughput: 0: 4363.3. Samples: 142982430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:07,794][52567] Avg episode reward: [(0, '75.510')] [2024-08-06 06:34:08,272][52665] DAMAGECOUNT value on done: 747047.0 [2024-08-06 06:34:08,272][52665] Sum rewards: 71.867, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-1.646', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.118', 'AMMO4': '0.173', 'weapon5': '0.220', 'weapon2': '0.236', 'AMMO3': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.078', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:08,600][52794] DAMAGECOUNT value on done: 758124.0 [2024-08-06 06:34:08,600][52794] Sum rewards: 74.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.748', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.133', 'weapon4': '0.188', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '63.000'} [2024-08-06 06:34:09,217][52667] DAMAGECOUNT value on done: 764268.0 [2024-08-06 06:34:09,219][52667] Sum rewards: 74.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.645', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.062', 'weapon7': '0.072', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon2': '0.170', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.205', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.322', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:11,271][52665] DAMAGECOUNT value on done: 753030.0 [2024-08-06 06:34:11,272][52665] Sum rewards: 70.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.055', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.102', 'weapon5': '0.140', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.230', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:11,513][52650] Updated weights for policy 0, policy_version 69821 (0.0030) [2024-08-06 06:34:11,785][52794] DAMAGECOUNT value on done: 774261.0 [2024-08-06 06:34:11,787][52794] Sum rewards: 72.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.198', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '59.000'} [2024-08-06 06:34:11,988][52667] DAMAGECOUNT value on done: 770640.0 [2024-08-06 06:34:11,988][52667] Sum rewards: 74.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.134', 'AMMO3': '0.198', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 572006400. Throughput: 0: 4358.2. Samples: 143008310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:12,794][52567] Avg episode reward: [(0, '75.507')] [2024-08-06 06:34:13,713][52664] DAMAGECOUNT value on done: 785100.0 [2024-08-06 06:34:13,713][52664] Sum rewards: 57.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.007', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon4': '0.306', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '2.742', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '51.000'} [2024-08-06 06:34:14,375][52794] DAMAGECOUNT value on done: 753663.0 [2024-08-06 06:34:14,375][52794] Sum rewards: 68.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.991', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.040', 'weapon4': '0.098', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.430', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '57.000'} [2024-08-06 06:34:14,402][52665] DAMAGECOUNT value on done: 751371.0 [2024-08-06 06:34:14,402][52665] Sum rewards: 74.895, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.146', 'AMMO4': '0.201', 'weapon5': '0.222', 'weapon2': '0.238', 'AMMO3': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.100', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '64.000'} [2024-08-06 06:34:15,477][52650] Updated weights for policy 0, policy_version 69831 (0.0018) [2024-08-06 06:34:16,518][52664] DAMAGECOUNT value on done: 792600.0 [2024-08-06 06:34:16,521][52664] Sum rewards: 63.081, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.518', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.164', 'weapon2': '0.206', 'AMMO3': '0.245', 'weapon4': '0.246', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.114', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '55.000'} [2024-08-06 06:34:16,900][52794] DAMAGECOUNT value on done: 768426.0 [2024-08-06 06:34:16,903][52794] Sum rewards: 67.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.068', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.064', 'AMMO4': '0.094', 'weapon5': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.242', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.342', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '56.000'} [2024-08-06 06:34:17,425][52665] DAMAGECOUNT value on done: 759451.0 [2024-08-06 06:34:17,425][52665] Sum rewards: 82.209, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.224', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.178', 'AMMO3': '0.185', 'weapon2': '0.408', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '66.000'} [2024-08-06 06:34:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 572088320. Throughput: 0: 4356.7. Samples: 143021370. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:17,802][52567] Avg episode reward: [(0, '75.388')] [2024-08-06 06:34:19,397][52663] DAMAGECOUNT value on done: 775365.0 [2024-08-06 06:34:19,397][52663] Sum rewards: 79.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.756', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.118', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon4': '0.244', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '66.000'} [2024-08-06 06:34:19,557][52794] DAMAGECOUNT value on done: 765077.0 [2024-08-06 06:34:19,557][52794] Sum rewards: 82.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.925', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:19,989][52664] DAMAGECOUNT value on done: 790806.0 [2024-08-06 06:34:19,990][52664] Sum rewards: 81.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.124', 'weapon2': '0.198', 'AMMO3': '0.223', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:20,055][52811] DAMAGECOUNT value on done: 724083.0 [2024-08-06 06:34:20,055][52811] Sum rewards: 77.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.078', 'weapon5': '0.164', 'AMMO4': '0.249', 'AMMO3': '0.256', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:20,480][52650] Updated weights for policy 0, policy_version 69841 (0.0042) [2024-08-06 06:34:20,575][52665] DAMAGECOUNT value on done: 751225.0 [2024-08-06 06:34:20,575][52665] Sum rewards: 77.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.110', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'AMMO3': '0.220', 'weapon2': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.534', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '66.000'} [2024-08-06 06:34:20,941][52666] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 06:34:21,192][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:34:21,898][52658] DAMAGECOUNT value on done: 762303.0 [2024-08-06 06:34:21,900][52658] Sum rewards: 71.496, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.525', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.138', 'weapon4': '0.146', 'AMMO3': '0.154', 'AMMO4': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '3.038', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '57.000'} [2024-08-06 06:34:22,148][52663] DAMAGECOUNT value on done: 760260.0 [2024-08-06 06:34:22,150][52663] Sum rewards: 70.388, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.522', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.034', 'weapon5': '0.086', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.294', 'weapon2': '0.594', 'WEAPON3': '0.800', 'weapon3': '2.890', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '54.000'} [2024-08-06 06:34:22,574][52794] DAMAGECOUNT value on done: 764605.0 [2024-08-06 06:34:22,574][52794] Sum rewards: 77.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.675', 'AMMO5': '0.016', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.176', 'weapon4': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:22,702][52664] DAMAGECOUNT value on done: 783212.0 [2024-08-06 06:34:22,702][52664] Sum rewards: 61.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.042', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO4': '0.180', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.000', 'weapon3': '2.814', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '51.000'} [2024-08-06 06:34:22,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 572170240. Throughput: 0: 4354.4. Samples: 143047720. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:22,794][52567] Avg episode reward: [(0, '75.496')] [2024-08-06 06:34:23,046][52811] DAMAGECOUNT value on done: 707248.0 [2024-08-06 06:34:23,046][52811] Sum rewards: 83.409, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.392', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO3': '0.251', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '70.000'} [2024-08-06 06:34:23,829][52665] DAMAGECOUNT value on done: 760406.0 [2024-08-06 06:34:23,829][52665] Sum rewards: 67.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.330', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.190', 'AMMO4': '0.206', 'AMMO3': '0.232', 'weapon4': '0.328', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.796', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '57.000'} [2024-08-06 06:34:24,903][52658] DAMAGECOUNT value on done: 764814.0 [2024-08-06 06:34:24,905][52658] Sum rewards: 73.501, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.128', 'AMMO4': '0.201', 'weapon2': '0.240', 'AMMO3': '0.245', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:25,007][52650] Updated weights for policy 0, policy_version 69851 (0.0033) [2024-08-06 06:34:25,096][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:34:25,261][52663] DAMAGECOUNT value on done: 756051.0 [2024-08-06 06:34:25,261][52663] Sum rewards: 73.643, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.026', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.171', 'weapon4': '0.174', 'AMMO3': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.700', 'weapon3': '2.922', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '63.000'} [2024-08-06 06:34:25,556][52794] DAMAGECOUNT value on done: 773506.0 [2024-08-06 06:34:25,556][52794] Sum rewards: 68.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.110', 'AMMO3': '0.179', 'weapon5': '0.188', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '56.000'} [2024-08-06 06:34:26,001][52664] DAMAGECOUNT value on done: 796729.0 [2024-08-06 06:34:26,002][52664] Sum rewards: 72.987, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.655', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO4': '0.145', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'WEAPON3': '1.050', 'HITCOUNT': '3.190', 'weapon3': '3.438', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 06:34:26,057][52811] DAMAGECOUNT value on done: 704911.0 [2024-08-06 06:34:26,057][52811] Sum rewards: 65.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.740', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.100', 'weapon5': '0.162', 'AMMO3': '0.193', 'AMMO4': '0.327', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '55.000'} [2024-08-06 06:34:26,503][52665] DAMAGECOUNT value on done: 758691.0 [2024-08-06 06:34:26,504][52665] Sum rewards: 73.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.263', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:26,791][52671] DAMAGECOUNT value on done: 765952.0 [2024-08-06 06:34:26,791][52671] Sum rewards: 83.978, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.050', 'HEALTH': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.175', 'weapon2': '0.506', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 572268544. Throughput: 0: 4356.9. Samples: 143073980. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:27,802][52567] Avg episode reward: [(0, '75.203')] [2024-08-06 06:34:27,808][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069857_572268544.pth... [2024-08-06 06:34:27,961][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069346_568082432.pth [2024-08-06 06:34:28,123][52658] DAMAGECOUNT value on done: 767745.0 [2024-08-06 06:34:28,124][52658] Sum rewards: 88.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.097', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'weapon3': '3.414', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '22.773', 'FRAGCOUNT': '71.000'} [2024-08-06 06:34:28,266][52663] DAMAGECOUNT value on done: 760291.0 [2024-08-06 06:34:28,268][52663] Sum rewards: 69.678, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.700', 'AMMO5': '0.012', 'AMMO2': '0.068', 'weapon5': '0.148', 'weapon4': '0.220', 'weapon2': '0.252', 'AMMO3': '0.335', 'AMMO4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.900', 'weapon3': '3.082', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '63.000'} [2024-08-06 06:34:28,541][52794] DAMAGECOUNT value on done: 763448.0 [2024-08-06 06:34:28,541][52794] Sum rewards: 80.383, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.586', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.145', 'weapon5': '0.148', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.291', 'WEAPON3': '1.750', 'weapon3': '3.226', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.504', 'FRAGCOUNT': '69.000'} [2024-08-06 06:34:28,701][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:34:28,855][52664] DAMAGECOUNT value on done: 790394.0 [2024-08-06 06:34:28,855][52664] Sum rewards: 66.733, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.498', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.142', 'AMMO4': '0.205', 'AMMO3': '0.257', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.236', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2024-08-06 06:34:29,354][52811] DAMAGECOUNT value on done: 707028.0 [2024-08-06 06:34:29,355][52811] Sum rewards: 79.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.596', 'weapon4': '0.012', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:29,432][52669] DAMAGECOUNT value on done: 762927.0 [2024-08-06 06:34:29,435][52669] Sum rewards: 64.729, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.340', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.319', 'weapon2': '0.362', 'WEAPON3': '1.900', 'weapon3': '3.194', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '58.000'} [2024-08-06 06:34:29,639][52671] DAMAGECOUNT value on done: 770681.0 [2024-08-06 06:34:29,641][52671] Sum rewards: 65.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.769', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.098', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.253', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '55.000'} [2024-08-06 06:34:29,790][52650] Updated weights for policy 0, policy_version 69861 (0.0025) [2024-08-06 06:34:29,907][52665] DAMAGECOUNT value on done: 753403.0 [2024-08-06 06:34:29,908][52665] Sum rewards: 62.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.795', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.098', 'AMMO4': '0.121', 'weapon5': '0.184', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.268', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '52.000'} [2024-08-06 06:34:31,033][52663] DAMAGECOUNT value on done: 761051.0 [2024-08-06 06:34:31,036][52663] Sum rewards: 56.281, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.873', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.168', 'AMMO3': '0.178', 'WEAPON5': '0.300', 'weapon4': '0.392', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '2.678', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '45.000'} [2024-08-06 06:34:31,181][52658] DAMAGECOUNT value on done: 763507.0 [2024-08-06 06:34:31,183][52658] Sum rewards: 60.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.254', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.169', 'weapon5': '0.176', 'AMMO4': '0.207', 'weapon2': '0.276', 'weapon4': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.900', 'weapon3': '3.052', 'DAMAGECOUNT': '14.688', 'FRAGCOUNT': '51.000'} [2024-08-06 06:34:31,419][52664] DAMAGECOUNT value on done: 784294.0 [2024-08-06 06:34:31,421][52664] Sum rewards: 76.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.672', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.116', 'weapon5': '0.138', 'AMMO3': '0.187', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:32,513][52811] DAMAGECOUNT value on done: 713086.0 [2024-08-06 06:34:32,516][52811] Sum rewards: 72.335, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.082', 'AMMO5': '0.021', 'AMMO2': '0.039', 'AMMO3': '0.150', 'AMMO4': '0.193', 'weapon5': '0.222', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.626', 'WEAPON3': '0.950', 'weapon3': '2.668', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '58.000'} [2024-08-06 06:34:32,581][52669] DAMAGECOUNT value on done: 754040.0 [2024-08-06 06:34:32,581][52669] Sum rewards: 74.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.144', 'AMMO3': '0.271', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:32,616][52671] DAMAGECOUNT value on done: 764285.0 [2024-08-06 06:34:32,617][52671] Sum rewards: 69.400, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.118', 'weapon4': '0.122', 'AMMO4': '0.165', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '59.000'} [2024-08-06 06:34:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 572350464. Throughput: 0: 4347.6. Samples: 143086840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:32,794][52567] Avg episode reward: [(0, '74.532')] [2024-08-06 06:34:33,038][52665] DAMAGECOUNT value on done: 752696.0 [2024-08-06 06:34:33,038][52665] Sum rewards: 79.292, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.510', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon4': '0.236', 'weapon2': '0.276', 'WEAPON3': '1.000', 'weapon3': '3.210', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:33,856][52664] DAMAGECOUNT value on done: 779037.0 [2024-08-06 06:34:33,856][52664] Sum rewards: 72.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.014', 'weapon4': '0.052', 'AMMO2': '0.062', 'weapon5': '0.140', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'AMMO4': '0.311', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '59.000'} [2024-08-06 06:34:34,149][52658] DAMAGECOUNT value on done: 756269.0 [2024-08-06 06:34:34,151][52658] Sum rewards: 74.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.010', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon5': '0.110', 'weapon4': '0.148', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.222', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:34,316][52663] DAMAGECOUNT value on done: 769390.0 [2024-08-06 06:34:34,317][52663] Sum rewards: 71.952, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.116', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO3': '0.153', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '0.900', 'weapon3': '3.258', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '57.000'} [2024-08-06 06:34:34,606][52650] Updated weights for policy 0, policy_version 69871 (0.0014) [2024-08-06 06:34:35,565][52811] DAMAGECOUNT value on done: 720538.0 [2024-08-06 06:34:35,565][52811] Sum rewards: 81.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.223', 'weapon2': '0.230', 'WEAPON3': '1.450', 'weapon3': '3.568', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '68.000'} [2024-08-06 06:34:35,658][52671] DAMAGECOUNT value on done: 768010.0 [2024-08-06 06:34:35,666][52671] Sum rewards: 77.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.115', 'AMMO5': '0.024', 'AMMO2': '0.076', 'weapon4': '0.184', 'weapon2': '0.220', 'AMMO3': '0.272', 'weapon5': '0.336', 'AMMO4': '0.379', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.650', 'weapon3': '2.960', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:35,702][52669] DAMAGECOUNT value on done: 768098.0 [2024-08-06 06:34:35,702][52669] Sum rewards: 83.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.120', 'weapon5': '0.190', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:35,955][52665] DAMAGECOUNT value on done: 749311.0 [2024-08-06 06:34:35,955][52665] Sum rewards: 74.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.634', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:36,476][52664] DAMAGECOUNT value on done: 793289.0 [2024-08-06 06:34:36,478][52664] Sum rewards: 64.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.082', 'weapon5': '0.140', 'AMMO3': '0.220', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '54.000'} [2024-08-06 06:34:37,248][52658] DAMAGECOUNT value on done: 754193.0 [2024-08-06 06:34:37,250][52658] Sum rewards: 59.163, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.884', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.084', 'weapon5': '0.204', 'AMMO4': '0.205', 'weapon2': '0.306', 'AMMO3': '0.323', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.090', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '53.000'} [2024-08-06 06:34:37,309][52663] DAMAGECOUNT value on done: 758147.0 [2024-08-06 06:34:37,313][52663] Sum rewards: 72.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon2': '0.156', 'weapon5': '0.182', 'AMMO4': '0.201', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.364', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:37,436][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 06:34:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 572440576. Throughput: 0: 4349.1. Samples: 143112920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:34:37,795][52567] Avg episode reward: [(0, '74.327')] [2024-08-06 06:34:38,280][52671] DAMAGECOUNT value on done: 774476.0 [2024-08-06 06:34:38,280][52671] Sum rewards: 69.097, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.085', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '3.112', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '59.000'} [2024-08-06 06:34:38,805][52811] DAMAGECOUNT value on done: 715165.0 [2024-08-06 06:34:38,807][52811] Sum rewards: 84.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.777', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon4': '0.086', 'AMMO3': '0.205', 'weapon5': '0.214', 'AMMO4': '0.306', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '69.000'} [2024-08-06 06:34:38,913][52669] DAMAGECOUNT value on done: 762281.0 [2024-08-06 06:34:38,914][52669] Sum rewards: 70.386, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.345', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon4': '0.186', 'weapon2': '0.394', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '56.000'} [2024-08-06 06:34:39,054][52665] DAMAGECOUNT value on done: 753941.0 [2024-08-06 06:34:39,054][52665] Sum rewards: 72.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.220', 'weapon5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:39,125][52664] DAMAGECOUNT value on done: 785972.0 [2024-08-06 06:34:39,125][52664] Sum rewards: 71.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.059', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.142', 'AMMO4': '0.196', 'AMMO3': '0.215', 'weapon4': '0.250', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:39,602][52650] Updated weights for policy 0, policy_version 69881 (0.0021) [2024-08-06 06:34:39,657][52670] DAMAGECOUNT value on done: 750764.0 [2024-08-06 06:34:39,658][52670] Sum rewards: 68.221, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.040', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'HEALTH': '0.548', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '55.500'} [2024-08-06 06:34:39,739][52795] Large shaping reward 2.518 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0)] [2024-08-06 06:34:40,545][52658] DAMAGECOUNT value on done: 768224.0 [2024-08-06 06:34:40,545][52658] Sum rewards: 80.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.046', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'AMMO3': '0.266', 'weapon2': '0.512', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:40,560][52663] DAMAGECOUNT value on done: 749126.0 [2024-08-06 06:34:40,560][52663] Sum rewards: 73.613, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.154', 'AMMO3': '0.236', 'weapon5': '0.260', 'AMMO4': '0.265', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.980', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:40,865][52671] DAMAGECOUNT value on done: 765724.0 [2024-08-06 06:34:40,873][52671] Sum rewards: 70.981, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.050', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'HEALTH': '0.378', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '57.000'} [2024-08-06 06:34:41,030][52666] DAMAGECOUNT value on done: 761470.0 [2024-08-06 06:34:41,030][52666] Sum rewards: 75.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon4': '0.078', 'weapon5': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:41,475][52647] Large shaping reward 2.599 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.45, 150.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:34:41,752][52665] DAMAGECOUNT value on done: 754129.0 [2024-08-06 06:34:41,753][52665] Sum rewards: 72.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.076', 'AMMO4': '0.158', 'weapon5': '0.210', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:41,881][52811] DAMAGECOUNT value on done: 707507.0 [2024-08-06 06:34:41,882][52811] Sum rewards: 85.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon4': '0.098', 'AMMO3': '0.199', 'AMMO4': '0.213', 'weapon5': '0.236', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '72.000'} [2024-08-06 06:34:41,909][52664] DAMAGECOUNT value on done: 797778.0 [2024-08-06 06:34:41,910][52664] Sum rewards: 80.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.862', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.028', 'AMMO4': '0.033', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.460', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '68.000'} [2024-08-06 06:34:42,209][52669] DAMAGECOUNT value on done: 765865.0 [2024-08-06 06:34:42,211][52669] Sum rewards: 68.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '1.026', 'WEAPON3': '1.300', 'weapon3': '2.664', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '55.000'} [2024-08-06 06:34:42,270][52670] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:34:42,373][52670] DAMAGECOUNT value on done: 763439.0 [2024-08-06 06:34:42,373][52670] Sum rewards: 64.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.482', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.100', 'AMMO4': '0.119', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '54.500'} [2024-08-06 06:34:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 572514304. Throughput: 0: 4358.2. Samples: 143139010. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:34:42,794][52567] Avg episode reward: [(0, '73.966')] [2024-08-06 06:34:43,767][52650] Updated weights for policy 0, policy_version 69891 (0.0019) [2024-08-06 06:34:43,831][52666] DAMAGECOUNT value on done: 758269.0 [2024-08-06 06:34:43,834][52666] Sum rewards: 60.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.960', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.145', 'weapon2': '0.254', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.030', 'weapon3': '3.260', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '53.000'} [2024-08-06 06:34:43,835][52658] DAMAGECOUNT value on done: 756069.0 [2024-08-06 06:34:43,836][52658] Sum rewards: 71.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.045', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.110', 'weapon4': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '59.000'} [2024-08-06 06:34:43,865][52663] DAMAGECOUNT value on done: 753284.0 [2024-08-06 06:34:43,867][52663] Sum rewards: 80.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.048', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.212', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:43,902][52671] DAMAGECOUNT value on done: 770190.0 [2024-08-06 06:34:43,902][52671] Sum rewards: 76.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.252', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.388', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:44,141][52820] DAMAGECOUNT value on done: 705015.0 [2024-08-06 06:34:44,141][52820] Sum rewards: 64.533, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.828', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.155', 'weapon4': '0.212', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.800', 'weapon3': '2.906', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '57.500'} [2024-08-06 06:34:44,532][52664] DAMAGECOUNT value on done: 794584.0 [2024-08-06 06:34:44,532][52664] Sum rewards: 67.453, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.175', 'AMMO5': '0.026', 'AMMO2': '0.073', 'weapon4': '0.126', 'weapon5': '0.222', 'AMMO3': '0.265', 'AMMO4': '0.363', 'weapon2': '0.396', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.884', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '58.000'} [2024-08-06 06:34:44,816][52665] DAMAGECOUNT value on done: 745838.0 [2024-08-06 06:34:44,818][52665] Sum rewards: 81.953, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.406', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.114', 'weapon4': '0.142', 'AMMO4': '0.152', 'weapon2': '0.176', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.322', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '69.000'} [2024-08-06 06:34:45,037][52647] DAMAGECOUNT value on done: 809977.0 [2024-08-06 06:34:45,038][52647] Sum rewards: 81.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.505', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.078', 'weapon5': '0.148', 'AMMO4': '0.165', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '69.000'} [2024-08-06 06:34:45,047][52811] DAMAGECOUNT value on done: 717236.0 [2024-08-06 06:34:45,047][52811] Sum rewards: 73.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.656', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.178', 'AMMO3': '0.220', 'WEAPON3': '1.500', 'weapon3': '3.588', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:45,071][52669] DAMAGECOUNT value on done: 764136.0 [2024-08-06 06:34:45,072][52669] Sum rewards: 66.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.220', 'weapon5': '0.256', 'weapon2': '0.376', 'weapon4': '0.386', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.690', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '54.500'} [2024-08-06 06:34:45,334][52670] DAMAGECOUNT value on done: 752966.0 [2024-08-06 06:34:45,334][52670] Sum rewards: 69.503, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.118', 'AMMO4': '0.219', 'weapon5': '0.242', 'AMMO3': '0.280', 'weapon2': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.046', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:46,392][52663] DAMAGECOUNT value on done: 756892.0 [2024-08-06 06:34:46,402][52663] Sum rewards: 71.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.784', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '59.000'} [2024-08-06 06:34:46,786][52666] DAMAGECOUNT value on done: 759562.0 [2024-08-06 06:34:46,787][52666] Sum rewards: 63.496, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.563', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.176', 'AMMO4': '0.227', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.130', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '52.500'} [2024-08-06 06:34:46,996][52658] DAMAGECOUNT value on done: 779999.0 [2024-08-06 06:34:46,998][52658] Sum rewards: 84.559, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.132', 'AMMO4': '0.156', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'HEALTH': '0.501', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '70.000'} [2024-08-06 06:34:47,096][52671] DAMAGECOUNT value on done: 766553.0 [2024-08-06 06:34:47,097][52671] Sum rewards: 59.359, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.675', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.186', 'weapon2': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '48.000'} [2024-08-06 06:34:47,307][52820] DAMAGECOUNT value on done: 706521.0 [2024-08-06 06:34:47,307][52820] Sum rewards: 76.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.388', 'AMMO5': '0.028', 'AMMO2': '0.083', 'weapon4': '0.190', 'AMMO3': '0.237', 'weapon5': '0.320', 'weapon2': '0.414', 'AMMO4': '0.416', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.694', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:47,311][52664] DAMAGECOUNT value on done: 795261.0 [2024-08-06 06:34:47,313][52664] Sum rewards: 83.203, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.082', 'AMMO4': '0.169', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.330', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:47,343][52795] DAMAGECOUNT value on done: 708699.0 [2024-08-06 06:34:47,343][52795] Sum rewards: 65.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.697', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO3': '0.142', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.340', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.008', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '53.000'} [2024-08-06 06:34:47,716][52647] DAMAGECOUNT value on done: 799911.0 [2024-08-06 06:34:47,716][52647] Sum rewards: 90.060, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.230', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon2': '0.190', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.618', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '21.957', 'FRAGCOUNT': '76.000'} [2024-08-06 06:34:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 572612608. Throughput: 0: 4349.3. Samples: 143151920. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:34:47,794][52567] Avg episode reward: [(0, '73.357')] [2024-08-06 06:34:47,897][52665] DAMAGECOUNT value on done: 750154.0 [2024-08-06 06:34:47,898][52665] Sum rewards: 74.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.669', 'AMMO5': '0.011', 'weapon4': '0.048', 'AMMO2': '0.048', 'weapon5': '0.132', 'AMMO4': '0.242', 'AMMO3': '0.243', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:47,900][52669] DAMAGECOUNT value on done: 764240.0 [2024-08-06 06:34:47,904][52669] Sum rewards: 69.055, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.928', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.092', 'AMMO4': '0.158', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.496', 'WEAPON3': '1.750', 'weapon3': '2.936', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:48,081][52811] DAMAGECOUNT value on done: 715235.0 [2024-08-06 06:34:48,082][52811] Sum rewards: 79.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.740', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.464', 'WEAPON3': '1.700', 'weapon3': '3.156', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '68.000'} [2024-08-06 06:34:48,519][52670] DAMAGECOUNT value on done: 750038.0 [2024-08-06 06:34:48,519][52670] Sum rewards: 76.770, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.225', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon5': '0.172', 'AMMO3': '0.226', 'AMMO4': '0.249', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:48,861][52650] Updated weights for policy 0, policy_version 69901 (0.0015) [2024-08-06 06:34:49,014][52647] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:34:49,510][52663] DAMAGECOUNT value on done: 768462.0 [2024-08-06 06:34:49,510][52663] Sum rewards: 79.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.801', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.080', 'weapon5': '0.108', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.224', 'WEAPON3': '1.450', 'weapon3': '3.390', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:49,529][52671] DAMAGECOUNT value on done: 756397.0 [2024-08-06 06:34:49,531][52671] Sum rewards: 65.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.114', 'weapon5': '0.164', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '54.000'} [2024-08-06 06:34:49,983][52666] DAMAGECOUNT value on done: 759142.0 [2024-08-06 06:34:49,982][52664] DAMAGECOUNT value on done: 801953.0 [2024-08-06 06:34:49,985][52664] Sum rewards: 76.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.197', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.139', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:49,985][52666] Sum rewards: 68.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.742', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon4': '0.146', 'AMMO3': '0.165', 'weapon5': '0.194', 'AMMO4': '0.284', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.050', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '55.000'} [2024-08-06 06:34:50,219][52658] DAMAGECOUNT value on done: 764827.0 [2024-08-06 06:34:50,219][52658] Sum rewards: 80.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.140', 'weapon5': '0.148', 'AMMO3': '0.214', 'weapon2': '0.242', 'AMMO4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:50,454][52795] DAMAGECOUNT value on done: 695382.0 [2024-08-06 06:34:50,457][52795] Sum rewards: 81.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.700', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.056', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.286', 'weapon2': '0.528', 'WEAPON3': '1.750', 'weapon3': '3.012', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '20.811', 'FRAGCOUNT': '68.000'} [2024-08-06 06:34:50,481][52647] DAMAGECOUNT value on done: 804359.0 [2024-08-06 06:34:50,481][52647] Sum rewards: 77.119, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.215', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.182', 'AMMO3': '0.301', 'WEAPON3': '1.800', 'weapon3': '3.560', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '68.000'} [2024-08-06 06:34:50,502][52820] DAMAGECOUNT value on done: 707243.0 [2024-08-06 06:34:50,504][52820] Sum rewards: 72.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.572', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.086', 'AMMO3': '0.190', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.336', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:50,799][52669] DAMAGECOUNT value on done: 766098.0 [2024-08-06 06:34:50,801][52669] Sum rewards: 71.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.140', 'AMMO4': '0.182', 'AMMO3': '0.197', 'weapon5': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '59.000'} [2024-08-06 06:34:51,124][52665] DAMAGECOUNT value on done: 753650.0 [2024-08-06 06:34:51,125][52665] Sum rewards: 83.500, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.086', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.356', 'HEALTH': '0.554', 'WEAPON3': '0.950', 'weapon3': '3.402', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:51,140][52811] DAMAGECOUNT value on done: 715770.0 [2024-08-06 06:34:51,141][52811] Sum rewards: 66.755, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.695', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.196', 'weapon5': '0.212', 'weapon2': '0.232', 'AMMO4': '0.243', 'AMMO3': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.054', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:51,393][52670] DAMAGECOUNT value on done: 761153.0 [2024-08-06 06:34:51,404][52670] Sum rewards: 77.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.056', 'AMMO3': '0.213', 'AMMO4': '0.240', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '64.000'} [2024-08-06 06:34:51,818][52671] DAMAGECOUNT value on done: 766116.0 [2024-08-06 06:34:51,820][52671] Sum rewards: 71.564, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.496', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.053', 'weapon5': '0.148', 'weapon4': '0.248', 'AMMO3': '0.264', 'AMMO4': '0.264', 'weapon2': '0.284', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.912', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:52,343][52663] DAMAGECOUNT value on done: 751583.0 [2024-08-06 06:34:52,343][52663] Sum rewards: 69.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.520', 'AMMO5': '0.023', 'AMMO2': '0.050', 'weapon4': '0.074', 'AMMO4': '0.249', 'AMMO3': '0.264', 'weapon5': '0.362', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.828', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:52,733][52614] Signal inference workers to stop experience collection... (12750 times) [2024-08-06 06:34:52,733][52614] Signal inference workers to resume experience collection... (12750 times) [2024-08-06 06:34:52,771][52650] InferenceWorker_p0-w0: stopping experience collection (12750 times) [2024-08-06 06:34:52,771][52650] InferenceWorker_p0-w0: resuming experience collection (12750 times) [2024-08-06 06:34:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 572694528. Throughput: 0: 4344.0. Samples: 143177910. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:34:52,795][52567] Avg episode reward: [(0, '73.366')] [2024-08-06 06:34:52,972][52664] DAMAGECOUNT value on done: 802941.0 [2024-08-06 06:34:52,975][52664] Sum rewards: 77.125, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.679', 'AMMO5': '0.003', 'weapon5': '0.006', 'weapon4': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.199', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '63.000'} [2024-08-06 06:34:53,027][52666] DAMAGECOUNT value on done: 753138.0 [2024-08-06 06:34:53,030][52666] Sum rewards: 80.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.742', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.158', 'weapon4': '0.162', 'AMMO4': '0.179', 'AMMO3': '0.246', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '69.000'} [2024-08-06 06:34:53,302][52650] Updated weights for policy 0, policy_version 69911 (0.0013) [2024-08-06 06:34:53,373][52658] DAMAGECOUNT value on done: 773641.0 [2024-08-06 06:34:53,373][52658] Sum rewards: 79.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.106', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.698', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:53,375][52647] DAMAGECOUNT value on done: 803987.0 [2024-08-06 06:34:53,378][52647] Sum rewards: 79.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.823', 'AMMO5': '0.019', 'AMMO2': '0.070', 'weapon4': '0.126', 'AMMO3': '0.234', 'weapon2': '0.252', 'weapon5': '0.300', 'AMMO4': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '66.000'} [2024-08-06 06:34:53,571][52820] DAMAGECOUNT value on done: 698472.0 [2024-08-06 06:34:53,571][52820] Sum rewards: 83.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.794', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.110', 'AMMO4': '0.128', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.050', 'weapon3': '3.344', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:53,607][52669] DAMAGECOUNT value on done: 774923.0 [2024-08-06 06:34:53,609][52669] Sum rewards: 72.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.037', 'weapon5': '0.070', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:53,700][52795] DAMAGECOUNT value on done: 697478.0 [2024-08-06 06:34:53,704][52795] Sum rewards: 74.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'weapon4': '0.042', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.236', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:54,204][52811] DAMAGECOUNT value on done: 721227.0 [2024-08-06 06:34:54,207][52811] Sum rewards: 66.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.122', 'weapon5': '0.156', 'AMMO3': '0.189', 'AMMO4': '0.256', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '54.000'} [2024-08-06 06:34:54,535][52670] DAMAGECOUNT value on done: 756679.0 [2024-08-06 06:34:54,535][52670] Sum rewards: 84.569, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.154', 'AMMO3': '0.174', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '68.000'} [2024-08-06 06:34:54,597][52671] DAMAGECOUNT value on done: 766461.0 [2024-08-06 06:34:54,597][52671] Sum rewards: 62.403, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.755', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.122', 'AMMO4': '0.153', 'AMMO3': '0.195', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.306', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '52.000'} [2024-08-06 06:34:55,124][52663] DAMAGECOUNT value on done: 748553.0 [2024-08-06 06:34:55,126][52663] Sum rewards: 80.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.932', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.130', 'weapon5': '0.168', 'AMMO4': '0.175', 'AMMO3': '0.210', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '66.500'} [2024-08-06 06:34:55,579][52664] DAMAGECOUNT value on done: 796171.0 [2024-08-06 06:34:55,579][52664] Sum rewards: 61.917, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.976', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.141', 'AMMO3': '0.198', 'weapon5': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.700', 'weapon3': '3.194', 'DAMAGECOUNT': '14.661', 'FRAGCOUNT': '51.000'} [2024-08-06 06:34:56,049][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:34:56,120][52647] DAMAGECOUNT value on done: 810377.0 [2024-08-06 06:34:56,120][52647] Sum rewards: 77.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.755', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.030', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 06:34:56,173][52658] DAMAGECOUNT value on done: 760979.0 [2024-08-06 06:34:56,174][52658] Sum rewards: 78.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.155', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.100', 'weapon5': '0.214', 'AMMO3': '0.269', 'AMMO4': '0.279', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.012', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '68.000'} [2024-08-06 06:34:56,303][52666] DAMAGECOUNT value on done: 758049.0 [2024-08-06 06:34:56,305][52666] Sum rewards: 70.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.790', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.086', 'weapon5': '0.122', 'AMMO4': '0.155', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:56,339][52669] DAMAGECOUNT value on done: 766394.0 [2024-08-06 06:34:56,340][52669] Sum rewards: 81.240, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.870', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.252', 'weapon4': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.076', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '63.000'} [2024-08-06 06:34:56,820][52820] DAMAGECOUNT value on done: 710672.0 [2024-08-06 06:34:56,820][52820] Sum rewards: 75.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'weapon4': '0.100', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '62.000'} [2024-08-06 06:34:56,912][52795] DAMAGECOUNT value on done: 707165.0 [2024-08-06 06:34:56,913][52795] Sum rewards: 80.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.133', 'weapon5': '0.190', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '66.000'} [2024-08-06 06:34:57,431][52670] DAMAGECOUNT value on done: 749512.0 [2024-08-06 06:34:57,433][52670] Sum rewards: 80.730, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.094', 'weapon4': '0.114', 'weapon2': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.650', 'weapon3': '3.420', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '69.000'} [2024-08-06 06:34:57,442][52811] DAMAGECOUNT value on done: 714481.0 [2024-08-06 06:34:57,443][52811] Sum rewards: 68.474, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.595', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.068', 'AMMO3': '0.164', 'weapon5': '0.172', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.730', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '55.000'} [2024-08-06 06:34:57,483][52671] DAMAGECOUNT value on done: 765562.0 [2024-08-06 06:34:57,484][52671] Sum rewards: 74.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.424', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.182', 'AMMO3': '0.213', 'weapon5': '0.218', 'AMMO4': '0.225', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:57,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 572776448. Throughput: 0: 4351.3. Samples: 143204120. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:34:57,795][52567] Avg episode reward: [(0, '73.867')] [2024-08-06 06:34:58,214][52650] Updated weights for policy 0, policy_version 69921 (0.0035) [2024-08-06 06:34:58,283][52663] DAMAGECOUNT value on done: 755325.0 [2024-08-06 06:34:58,284][52663] Sum rewards: 75.395, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.272', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.102', 'AMMO4': '0.166', 'AMMO3': '0.176', 'weapon5': '0.188', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '60.000'} [2024-08-06 06:34:58,525][52658] DAMAGECOUNT value on done: 768306.0 [2024-08-06 06:34:58,527][52658] Sum rewards: 66.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.652', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon4': '0.158', 'AMMO3': '0.210', 'weapon2': '0.210', 'AMMO4': '0.216', 'weapon5': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.034', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '53.500'} [2024-08-06 06:34:58,700][52664] DAMAGECOUNT value on done: 787484.0 [2024-08-06 06:34:58,700][52664] Sum rewards: 94.325, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.126', 'AMMO3': '0.148', 'AMMO4': '0.170', 'weapon5': '0.338', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.880', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.813', 'FRAGCOUNT': '73.000'} [2024-08-06 06:34:58,913][52666] DAMAGECOUNT value on done: 755301.0 [2024-08-06 06:34:58,921][52666] Sum rewards: 79.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.596', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.102', 'weapon5': '0.118', 'AMMO4': '0.127', 'weapon2': '0.198', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.404', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '65.000'} [2024-08-06 06:34:59,160][52647] DAMAGECOUNT value on done: 809715.0 [2024-08-06 06:34:59,161][52647] Sum rewards: 66.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.502', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.178', 'AMMO3': '0.211', 'weapon2': '0.212', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '56.000'} [2024-08-06 06:34:59,461][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:34:59,552][52669] DAMAGECOUNT value on done: 767873.0 [2024-08-06 06:34:59,553][52669] Sum rewards: 80.421, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.522', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '67.000'} [2024-08-06 06:34:59,969][52820] DAMAGECOUNT value on done: 693595.0 [2024-08-06 06:34:59,971][52820] Sum rewards: 73.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.106', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.168', 'AMMO3': '0.225', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '61.000'} [2024-08-06 06:34:59,996][52795] DAMAGECOUNT value on done: 698338.0 [2024-08-06 06:35:00,000][52795] Sum rewards: 76.048, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.014', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.068', 'weapon5': '0.086', 'AMMO4': '0.160', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '63.000'} [2024-08-06 06:35:00,238][52670] DAMAGECOUNT value on done: 753100.0 [2024-08-06 06:35:00,238][52670] Sum rewards: 80.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.396', 'AMMO5': '0.026', 'AMMO2': '0.056', 'AMMO3': '0.161', 'weapon5': '0.260', 'AMMO4': '0.281', 'weapon2': '0.332', 'weapon4': '0.392', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.702', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:00,380][52671] DAMAGECOUNT value on done: 773194.0 [2024-08-06 06:35:00,381][52671] Sum rewards: 81.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.269', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO4': '0.184', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:00,642][52811] DAMAGECOUNT value on done: 711316.0 [2024-08-06 06:35:00,644][52811] Sum rewards: 73.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.223', 'weapon2': '0.234', 'weapon4': '0.320', 'weapon5': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.804', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:01,244][52663] DAMAGECOUNT value on done: 755112.0 [2024-08-06 06:35:01,247][52663] Sum rewards: 65.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.130', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '55.000'} [2024-08-06 06:35:01,352][52658] DAMAGECOUNT value on done: 758827.0 [2024-08-06 06:35:01,352][52658] Sum rewards: 78.739, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.590', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'weapon2': '0.278', 'AMMO3': '0.279', 'WEAPON3': '1.800', 'weapon3': '3.302', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:01,471][52664] DAMAGECOUNT value on done: 788820.0 [2024-08-06 06:35:01,471][52664] Sum rewards: 81.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.666', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO4': '0.201', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:01,687][52647] DAMAGECOUNT value on done: 811534.0 [2024-08-06 06:35:01,687][52647] Sum rewards: 64.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.286', 'AMMO5': '0.021', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.156', 'AMMO3': '0.203', 'AMMO4': '0.205', 'WEAPON4': '0.400', 'weapon2': '0.440', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '53.000'} [2024-08-06 06:35:01,784][52666] DAMAGECOUNT value on done: 749578.0 [2024-08-06 06:35:01,787][52666] Sum rewards: 73.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon4': '0.148', 'weapon5': '0.174', 'AMMO3': '0.234', 'AMMO4': '0.281', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.944', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:02,569][52669] DAMAGECOUNT value on done: 773726.0 [2024-08-06 06:35:02,572][52669] Sum rewards: 80.806, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.231', 'weapon4': '0.238', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '66.000'} [2024-08-06 06:35:02,742][52650] Updated weights for policy 0, policy_version 69931 (0.0015) [2024-08-06 06:35:02,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 572874752. Throughput: 0: 4345.5. Samples: 143216920. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:35:02,795][52567] Avg episode reward: [(0, '74.554')] [2024-08-06 06:35:03,098][52670] DAMAGECOUNT value on done: 754278.0 [2024-08-06 06:35:03,099][52670] Sum rewards: 72.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.977', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.174', 'weapon4': '0.186', 'AMMO3': '0.206', 'AMMO4': '0.234', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:03,107][52795] DAMAGECOUNT value on done: 704411.0 [2024-08-06 06:35:03,107][52795] Sum rewards: 66.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.050', 'weapon4': '0.054', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:03,140][52820] DAMAGECOUNT value on done: 703011.0 [2024-08-06 06:35:03,140][52820] Sum rewards: 63.481, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.067', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.155', 'weapon5': '0.174', 'weapon4': '0.206', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.168', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '50.000'} [2024-08-06 06:35:03,587][52671] DAMAGECOUNT value on done: 766228.0 [2024-08-06 06:35:03,589][52671] Sum rewards: 69.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.411', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.020', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.368', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:03,825][52664] DAMAGECOUNT value on done: 790238.0 [2024-08-06 06:35:03,834][52664] Sum rewards: 85.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.097', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.146', 'AMMO4': '0.198', 'weapon2': '0.232', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.292', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '72.000'} [2024-08-06 06:35:03,979][52811] DAMAGECOUNT value on done: 708306.0 [2024-08-06 06:35:03,989][52811] Sum rewards: 68.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.034', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:04,092][52658] DAMAGECOUNT value on done: 767331.0 [2024-08-06 06:35:04,092][52658] Sum rewards: 70.777, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.017', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.160', 'weapon2': '0.826', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:04,105][52647] DAMAGECOUNT value on done: 789611.0 [2024-08-06 06:35:04,106][52647] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.153', 'weapon2': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:04,411][52663] DAMAGECOUNT value on done: 767099.0 [2024-08-06 06:35:04,412][52663] Sum rewards: 67.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.086', 'AMMO3': '0.217', 'weapon2': '0.224', 'weapon5': '0.230', 'AMMO4': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.184', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:04,563][52666] DAMAGECOUNT value on done: 760138.0 [2024-08-06 06:35:04,563][52666] Sum rewards: 81.702, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.145', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon2': '0.724', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '66.000'} [2024-08-06 06:35:05,752][52669] DAMAGECOUNT value on done: 758445.0 [2024-08-06 06:35:05,753][52669] Sum rewards: 79.331, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'AMMO2': '0.026', 'HEALTH': '0.082', 'AMMO4': '0.130', 'weapon5': '0.138', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:06,032][52670] DAMAGECOUNT value on done: 747266.0 [2024-08-06 06:35:06,034][52670] Sum rewards: 66.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.695', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.044', 'AMMO4': '0.104', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.386', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '56.500'} [2024-08-06 06:35:06,306][52795] DAMAGECOUNT value on done: 714113.0 [2024-08-06 06:35:06,309][52795] Sum rewards: 77.125, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.166', 'AMMO3': '0.195', 'weapon5': '0.218', 'AMMO4': '0.220', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:06,312][52664] DAMAGECOUNT value on done: 788012.0 [2024-08-06 06:35:06,312][52664] Sum rewards: 66.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.476', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:06,384][52820] DAMAGECOUNT value on done: 705907.0 [2024-08-06 06:35:06,386][52820] Sum rewards: 78.202, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.804', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.100', 'AMMO4': '0.112', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'weapon2': '0.544', 'WEAPON3': '1.700', 'weapon3': '2.978', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:06,420][52647] DAMAGECOUNT value on done: 807063.0 [2024-08-06 06:35:06,421][52647] Sum rewards: 87.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.456', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.134', 'AMMO3': '0.197', 'AMMO4': '0.199', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.985', 'FRAGCOUNT': '71.000'} [2024-08-06 06:35:06,469][52662] Large shaping reward 2.579 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.528, 176.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:35:06,687][52671] DAMAGECOUNT value on done: 753449.0 [2024-08-06 06:35:06,690][52671] Sum rewards: 68.051, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO3': '0.157', 'AMMO4': '0.172', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.166', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '54.000'} [2024-08-06 06:35:06,719][52803] DAMAGECOUNT value on done: 707236.0 [2024-08-06 06:35:06,719][52803] Sum rewards: 78.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'weapon2': '0.168', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.466', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:06,733][52658] DAMAGECOUNT value on done: 751381.0 [2024-08-06 06:35:06,735][52658] Sum rewards: 83.961, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.460', 'AMMO5': '0.006', 'weapon4': '0.024', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.307', 'WEAPON3': '1.900', 'weapon3': '3.380', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '73.000'} [2024-08-06 06:35:07,055][52811] DAMAGECOUNT value on done: 710774.0 [2024-08-06 06:35:07,055][52811] Sum rewards: 89.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.298', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon4': '0.074', 'AMMO4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.576', 'FRAGCOUNT': '71.000'} [2024-08-06 06:35:07,441][52650] Updated weights for policy 0, policy_version 69941 (0.0024) [2024-08-06 06:35:07,454][52663] DAMAGECOUNT value on done: 759471.0 [2024-08-06 06:35:07,455][52663] Sum rewards: 84.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.360', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.072', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.236', 'WEAPON3': '1.050', 'weapon3': '3.458', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:07,654][52666] DAMAGECOUNT value on done: 752549.0 [2024-08-06 06:35:07,655][52666] Sum rewards: 73.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.432', 'AMMO5': '0.026', 'AMMO2': '0.060', 'weapon2': '0.192', 'AMMO3': '0.235', 'weapon5': '0.262', 'weapon4': '0.274', 'AMMO4': '0.297', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '60.000'} [2024-08-06 06:35:07,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 572956672. Throughput: 0: 4338.0. Samples: 143242930. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:35:07,794][52567] Avg episode reward: [(0, '74.888')] [2024-08-06 06:35:08,728][52669] DAMAGECOUNT value on done: 759796.0 [2024-08-06 06:35:08,729][52669] Sum rewards: 85.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.180', 'AMMO4': '0.200', 'weapon5': '0.236', 'AMMO3': '0.249', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '70.000'} [2024-08-06 06:35:09,172][52647] DAMAGECOUNT value on done: 802122.0 [2024-08-06 06:35:09,172][52647] Sum rewards: 77.217, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.206', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:09,174][52670] DAMAGECOUNT value on done: 762323.0 [2024-08-06 06:35:09,180][52670] Sum rewards: 75.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.252', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.050', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.286', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.200', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:09,461][52795] DAMAGECOUNT value on done: 702265.0 [2024-08-06 06:35:09,463][52795] Sum rewards: 71.905, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.376', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.152', 'weapon2': '0.182', 'AMMO3': '0.223', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:09,544][52820] DAMAGECOUNT value on done: 706818.0 [2024-08-06 06:35:09,544][52820] Sum rewards: 75.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.374', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '63.000'} [2024-08-06 06:35:09,802][52658] DAMAGECOUNT value on done: 768651.0 [2024-08-06 06:35:09,803][52658] Sum rewards: 74.388, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.168', 'AMMO5': '0.025', 'AMMO2': '0.067', 'weapon4': '0.180', 'AMMO3': '0.199', 'weapon5': '0.284', 'weapon2': '0.298', 'AMMO4': '0.335', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.906', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:09,812][52671] DAMAGECOUNT value on done: 772804.0 [2024-08-06 06:35:09,813][52671] Sum rewards: 69.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.315', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.158', 'weapon2': '0.168', 'weapon5': '0.184', 'AMMO4': '0.248', 'AMMO3': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.148', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '60.000'} [2024-08-06 06:35:09,853][52803] DAMAGECOUNT value on done: 705621.0 [2024-08-06 06:35:09,857][52803] Sum rewards: 85.618, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.739', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.168', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'weapon4': '0.370', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '69.000'} [2024-08-06 06:35:10,112][52811] DAMAGECOUNT value on done: 716589.0 [2024-08-06 06:35:10,116][52811] Sum rewards: 69.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.342', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:10,334][52663] DAMAGECOUNT value on done: 763394.0 [2024-08-06 06:35:10,335][52663] Sum rewards: 80.673, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.148', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.190', 'AMMO4': '0.193', 'weapon5': '0.212', 'weapon4': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:10,846][52666] DAMAGECOUNT value on done: 760353.0 [2024-08-06 06:35:10,846][52666] Sum rewards: 68.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:10,944][52668] DAMAGECOUNT value on done: 765014.0 [2024-08-06 06:35:10,944][52668] Sum rewards: 71.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:11,338][52669] DAMAGECOUNT value on done: 765132.0 [2024-08-06 06:35:11,338][52669] Sum rewards: 71.103, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.448', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.072', 'AMMO4': '0.173', 'weapon2': '0.230', 'weapon5': '0.262', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.086', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:11,518][52647] DAMAGECOUNT value on done: 801380.0 [2024-08-06 06:35:11,523][52647] Sum rewards: 67.348, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.618', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO4': '0.158', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:12,393][52650] Updated weights for policy 0, policy_version 69951 (0.0018) [2024-08-06 06:35:12,416][52670] DAMAGECOUNT value on done: 746021.0 [2024-08-06 06:35:12,416][52670] Sum rewards: 62.984, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.106', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon4': '0.234', 'weapon2': '0.344', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.120', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '51.000'} [2024-08-06 06:35:12,571][52658] DAMAGECOUNT value on done: 758980.0 [2024-08-06 06:35:12,576][52795] DAMAGECOUNT value on done: 704768.0 [2024-08-06 06:35:12,573][52658] Sum rewards: 72.168, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.421', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon5': '0.122', 'AMMO4': '0.220', 'AMMO3': '0.240', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.262', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:12,576][52795] Sum rewards: 77.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:12,733][52820] DAMAGECOUNT value on done: 715846.0 [2024-08-06 06:35:12,735][52820] Sum rewards: 79.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon2': '0.158', 'weapon5': '0.222', 'AMMO3': '0.236', 'AMMO4': '0.280', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:12,772][52663] DAMAGECOUNT value on done: 767471.0 [2024-08-06 06:35:12,773][52663] Sum rewards: 75.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.168', 'AMMO4': '0.171', 'weapon5': '0.174', 'weapon4': '0.224', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:12,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 573046784. Throughput: 0: 4340.9. Samples: 143269320. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:35:12,794][52567] Avg episode reward: [(0, '75.320')] [2024-08-06 06:35:12,838][52671] DAMAGECOUNT value on done: 771081.0 [2024-08-06 06:35:12,839][52671] Sum rewards: 67.120, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.482', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.148', 'AMMO3': '0.213', 'weapon4': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:12,926][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:35:12,944][52803] DAMAGECOUNT value on done: 714077.0 [2024-08-06 06:35:12,945][52803] Sum rewards: 66.782, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.478', 'AMMO5': '0.013', 'AMMO2': '0.049', 'AMMO3': '0.169', 'weapon4': '0.196', 'weapon5': '0.208', 'AMMO4': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '52.000'} [2024-08-06 06:35:13,188][52811] DAMAGECOUNT value on done: 718040.0 [2024-08-06 06:35:13,188][52811] Sum rewards: 86.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.235', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.170', 'weapon5': '0.194', 'AMMO3': '0.228', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '71.000'} [2024-08-06 06:35:13,652][52666] DAMAGECOUNT value on done: 747639.0 [2024-08-06 06:35:13,653][52666] Sum rewards: 63.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.036', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2024-08-06 06:35:13,921][52669] DAMAGECOUNT value on done: 784230.0 [2024-08-06 06:35:13,921][52669] Sum rewards: 77.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.988', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.162', 'AMMO4': '0.215', 'AMMO3': '0.217', 'weapon4': '0.230', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:14,076][52668] DAMAGECOUNT value on done: 768682.0 [2024-08-06 06:35:14,076][52668] Sum rewards: 66.311, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.738', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.122', 'WEAPON4': '0.150', 'weapon2': '0.756', 'WEAPON3': '0.800', 'weapon3': '3.058', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.062', 'FRAGCOUNT': '51.000'} [2024-08-06 06:35:14,596][52647] DAMAGECOUNT value on done: 793482.0 [2024-08-06 06:35:14,596][52647] Sum rewards: 78.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.028', 'weapon4': '0.030', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:15,002][52670] DAMAGECOUNT value on done: 755951.0 [2024-08-06 06:35:15,002][52670] Sum rewards: 72.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.008', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.102', 'weapon5': '0.118', 'AMMO4': '0.125', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:15,345][52663] DAMAGECOUNT value on done: 755815.0 [2024-08-06 06:35:15,347][52663] Sum rewards: 71.970, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.741', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.308', 'weapon2': '0.332', 'WEAPON3': '1.750', 'weapon3': '3.132', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:15,612][52658] DAMAGECOUNT value on done: 757164.0 [2024-08-06 06:35:15,613][52658] Sum rewards: 88.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.151', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.094', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.442', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '72.000'} [2024-08-06 06:35:15,652][52671] DAMAGECOUNT value on done: 768280.0 [2024-08-06 06:35:15,653][52671] Sum rewards: 64.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.564', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.080', 'weapon5': '0.090', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.262', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '53.000'} [2024-08-06 06:35:15,752][52795] DAMAGECOUNT value on done: 708199.0 [2024-08-06 06:35:15,752][52795] Sum rewards: 68.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.100', 'AMMO4': '0.170', 'weapon5': '0.184', 'AMMO3': '0.210', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:15,794][52820] DAMAGECOUNT value on done: 699598.0 [2024-08-06 06:35:15,794][52820] Sum rewards: 75.309, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.650', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'AMMO3': '0.296', 'WEAPON3': '1.800', 'weapon3': '3.304', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:16,084][52803] DAMAGECOUNT value on done: 713799.0 [2024-08-06 06:35:16,084][52803] Sum rewards: 74.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.118', 'weapon5': '0.122', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:16,307][52811] DAMAGECOUNT value on done: 711550.0 [2024-08-06 06:35:16,308][52811] Sum rewards: 68.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.884', 'AMMO5': '0.019', 'AMMO2': '0.074', 'AMMO3': '0.186', 'weapon4': '0.216', 'weapon5': '0.236', 'weapon2': '0.242', 'AMMO4': '0.368', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.070', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:16,385][52666] DAMAGECOUNT value on done: 760914.0 [2024-08-06 06:35:16,386][52666] Sum rewards: 77.488, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.296', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.068', 'AMMO3': '0.162', 'weapon5': '0.184', 'AMMO4': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:16,492][52669] DAMAGECOUNT value on done: 773944.0 [2024-08-06 06:35:16,492][52669] Sum rewards: 65.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.914', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.192', 'AMMO4': '0.202', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '55.000'} [2024-08-06 06:35:17,102][52650] Updated weights for policy 0, policy_version 69961 (0.0013) [2024-08-06 06:35:17,139][52668] DAMAGECOUNT value on done: 765540.0 [2024-08-06 06:35:17,141][52668] Sum rewards: 74.290, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'HEALTH': '0.150', 'weapon4': '0.152', 'weapon2': '0.386', 'WEAPON3': '0.850', 'weapon3': '3.164', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:17,717][52647] DAMAGECOUNT value on done: 810482.0 [2024-08-06 06:35:17,718][52647] Sum rewards: 71.679, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.795', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.121', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.296', 'WEAPON3': '1.850', 'weapon3': '3.260', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:17,719][52670] DAMAGECOUNT value on done: 763447.0 [2024-08-06 06:35:17,721][52670] Sum rewards: 71.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.060', 'AMMO4': '0.183', 'weapon5': '0.194', 'AMMO3': '0.199', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '60.000'} [2024-08-06 06:35:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 573128704. Throughput: 0: 4343.8. Samples: 143282310. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 06:35:17,794][52567] Avg episode reward: [(0, '74.716')] [2024-08-06 06:35:18,036][52658] DAMAGECOUNT value on done: 765624.0 [2024-08-06 06:35:18,040][52658] Sum rewards: 73.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.092', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.280', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '63.000'} [2024-08-06 06:35:18,529][52671] DAMAGECOUNT value on done: 771301.0 [2024-08-06 06:35:18,531][52671] Sum rewards: 68.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.333', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.170', 'weapon5': '0.208', 'AMMO4': '0.227', 'AMMO3': '0.244', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '2.774', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:18,922][52820] DAMAGECOUNT value on done: 708135.0 [2024-08-06 06:35:18,922][52820] Sum rewards: 79.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.215', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.084', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'WEAPON3': '1.000', 'weapon2': '1.040', 'weapon3': '2.656', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '63.000'} [2024-08-06 06:35:19,008][52795] DAMAGECOUNT value on done: 703016.0 [2024-08-06 06:35:19,010][52795] Sum rewards: 84.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.184', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.088', 'weapon5': '0.188', 'AMMO3': '0.238', 'weapon2': '0.286', 'AMMO4': '0.305', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '71.000'} [2024-08-06 06:35:19,062][52666] DAMAGECOUNT value on done: 756102.0 [2024-08-06 06:35:19,063][52666] Sum rewards: 68.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.266', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:19,229][52803] DAMAGECOUNT value on done: 712703.0 [2024-08-06 06:35:19,229][52803] Sum rewards: 75.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.746', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.294', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:19,493][52669] DAMAGECOUNT value on done: 767780.0 [2024-08-06 06:35:19,494][52669] Sum rewards: 69.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.128', 'AMMO4': '0.181', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '55.500'} [2024-08-06 06:35:19,500][52811] DAMAGECOUNT value on done: 712687.0 [2024-08-06 06:35:19,503][52811] Sum rewards: 80.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.216', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.090', 'weapon2': '0.146', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON3': '1.450', 'weapon3': '3.498', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:20,052][52662] DAMAGECOUNT value on done: 764042.0 [2024-08-06 06:35:20,052][52662] Sum rewards: 65.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.867', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.182', 'AMMO3': '0.204', 'AMMO4': '0.220', 'weapon2': '0.256', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '55.000'} [2024-08-06 06:35:20,179][52668] DAMAGECOUNT value on done: 772355.0 [2024-08-06 06:35:20,180][52668] Sum rewards: 76.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.152', 'AMMO4': '0.197', 'AMMO3': '0.215', 'weapon5': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:20,471][52670] DAMAGECOUNT value on done: 757330.0 [2024-08-06 06:35:20,472][52670] Sum rewards: 82.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO3': '0.198', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.174', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '66.000'} [2024-08-06 06:35:20,856][52647] DAMAGECOUNT value on done: 794812.0 [2024-08-06 06:35:20,856][52647] Sum rewards: 75.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.162', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.352', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:21,047][52671] DAMAGECOUNT value on done: 761888.0 [2024-08-06 06:35:21,049][52671] Sum rewards: 85.545, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.627', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.086', 'AMMO4': '0.121', 'weapon5': '0.178', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.050', 'weapon3': '2.984', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '70.000'} [2024-08-06 06:35:21,551][52650] Updated weights for policy 0, policy_version 69971 (0.0011) [2024-08-06 06:35:21,977][52820] DAMAGECOUNT value on done: 716643.0 [2024-08-06 06:35:21,977][52820] Sum rewards: 67.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.882', 'AMMO5': '0.024', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.208', 'weapon4': '0.230', 'weapon5': '0.242', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:22,048][52666] DAMAGECOUNT value on done: 754869.0 [2024-08-06 06:35:22,050][52666] Sum rewards: 72.861, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.190', 'weapon2': '0.230', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.350', 'weapon3': '2.920', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:22,126][52795] DAMAGECOUNT value on done: 698977.0 [2024-08-06 06:35:22,126][52795] Sum rewards: 80.767, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.268', 'weapon2': '0.274', 'WEAPON3': '1.650', 'weapon3': '3.468', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '69.000'} [2024-08-06 06:35:22,360][52803] DAMAGECOUNT value on done: 711180.0 [2024-08-06 06:35:22,360][52803] Sum rewards: 85.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.890', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.185', 'AMMO4': '0.234', 'weapon4': '0.236', 'weapon5': '0.240', 'weapon2': '0.260', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '69.000'} [2024-08-06 06:35:22,514][52669] DAMAGECOUNT value on done: 770448.0 [2024-08-06 06:35:22,514][52669] Sum rewards: 86.595, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.340', 'WEAPON3': '1.150', 'weapon3': '3.442', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '69.000'} [2024-08-06 06:35:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 573218816. Throughput: 0: 4342.7. Samples: 143308340. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:22,794][52567] Avg episode reward: [(0, '74.954')] [2024-08-06 06:35:22,795][52668] DAMAGECOUNT value on done: 754519.0 [2024-08-06 06:35:22,797][52668] Sum rewards: 63.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.576', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.138', 'weapon5': '0.166', 'AMMO3': '0.200', 'weapon2': '0.218', 'AMMO4': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.266', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '51.000'} [2024-08-06 06:35:23,002][52662] DAMAGECOUNT value on done: 772367.0 [2024-08-06 06:35:23,003][52662] Sum rewards: 80.045, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.535', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.060', 'weapon4': '0.082', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.328', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '66.000'} [2024-08-06 06:35:23,647][52647] DAMAGECOUNT value on done: 805138.0 [2024-08-06 06:35:23,648][52647] Sum rewards: 78.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.034', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.382', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:23,709][52670] DAMAGECOUNT value on done: 740028.0 [2024-08-06 06:35:23,709][52670] Sum rewards: 70.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.096', 'weapon5': '0.182', 'AMMO4': '0.195', 'AMMO3': '0.209', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.568', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:25,034][52666] DAMAGECOUNT value on done: 750907.0 [2024-08-06 06:35:25,035][52666] Sum rewards: 70.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.022', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.104', 'weapon4': '0.162', 'AMMO3': '0.238', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:25,172][52820] DAMAGECOUNT value on done: 707847.0 [2024-08-06 06:35:25,173][52820] Sum rewards: 82.682, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.168', 'weapon2': '0.766', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '66.000'} [2024-08-06 06:35:25,193][52795] DAMAGECOUNT value on done: 699382.0 [2024-08-06 06:35:25,194][52795] Sum rewards: 74.589, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.100', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.418', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:25,355][52803] DAMAGECOUNT value on done: 704066.0 [2024-08-06 06:35:25,357][52803] Sum rewards: 73.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.872', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.221', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:25,564][52669] DAMAGECOUNT value on done: 774868.0 [2024-08-06 06:35:25,565][52669] Sum rewards: 79.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.807', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.165', 'weapon5': '0.176', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '66.000'} [2024-08-06 06:35:25,728][52668] DAMAGECOUNT value on done: 767390.0 [2024-08-06 06:35:25,730][52668] Sum rewards: 62.961, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.704', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon4': '0.108', 'AMMO4': '0.110', 'AMMO3': '0.118', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon7': '0.574', 'weapon2': '0.716', 'WEAPON3': '0.800', 'weapon3': '2.184', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '48.000'} [2024-08-06 06:35:25,796][52662] DAMAGECOUNT value on done: 772812.0 [2024-08-06 06:35:25,796][52662] Sum rewards: 68.426, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.116', 'AMMO4': '0.191', 'weapon4': '0.194', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '60.000'} [2024-08-06 06:35:26,381][52650] Updated weights for policy 0, policy_version 69981 (0.0018) [2024-08-06 06:35:26,507][52647] DAMAGECOUNT value on done: 806255.0 [2024-08-06 06:35:26,507][52647] Sum rewards: 66.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.166', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.135', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:26,812][52670] DAMAGECOUNT value on done: 752255.0 [2024-08-06 06:35:26,813][52670] Sum rewards: 71.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.955', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.100', 'weapon4': '0.170', 'AMMO4': '0.207', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.264', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 573308928. Throughput: 0: 4347.3. Samples: 143334640. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:27,795][52567] Avg episode reward: [(0, '74.431')] [2024-08-06 06:35:28,124][52666] DAMAGECOUNT value on done: 753523.0 [2024-08-06 06:35:28,125][52666] Sum rewards: 75.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.076', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.168', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:28,342][52668] DAMAGECOUNT value on done: 768995.0 [2024-08-06 06:35:28,342][52668] Sum rewards: 77.036, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.614', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.026', 'weapon4': '0.050', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.312', 'WEAPON3': '1.750', 'weapon3': '3.344', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:28,353][52820] DAMAGECOUNT value on done: 712236.0 [2024-08-06 06:35:28,353][52820] Sum rewards: 65.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.210', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.142', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.700', 'weapon3': '3.144', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:28,371][52795] DAMAGECOUNT value on done: 708754.0 [2024-08-06 06:35:28,372][52795] Sum rewards: 73.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.036', 'AMMO4': '0.132', 'weapon5': '0.138', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '63.000'} [2024-08-06 06:35:28,457][52803] DAMAGECOUNT value on done: 703088.0 [2024-08-06 06:35:28,459][52803] Sum rewards: 68.759, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.405', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.082', 'AMMO4': '0.123', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.502', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '55.000'} [2024-08-06 06:35:28,992][52662] DAMAGECOUNT value on done: 756460.0 [2024-08-06 06:35:28,992][52662] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.082', 'AMMO4': '0.195', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:29,283][52647] DAMAGECOUNT value on done: 793332.0 [2024-08-06 06:35:29,285][52647] Sum rewards: 66.176, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.100', 'weapon5': '0.126', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.220', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '54.000'} [2024-08-06 06:35:29,544][52670] DAMAGECOUNT value on done: 761444.0 [2024-08-06 06:35:29,546][52670] Sum rewards: 72.274, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.016', 'AMMO2': '0.034', 'HEALTH': '0.122', 'weapon5': '0.154', 'AMMO4': '0.170', 'AMMO3': '0.173', 'weapon4': '0.220', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:30,741][52650] Updated weights for policy 0, policy_version 69991 (0.0031) [2024-08-06 06:35:30,919][52666] DAMAGECOUNT value on done: 768802.0 [2024-08-06 06:35:30,921][52666] Sum rewards: 81.533, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'HEALTH': '0.028', 'AMMO2': '0.034', 'weapon4': '0.124', 'AMMO4': '0.169', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon5': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '65.500'} [2024-08-06 06:35:31,316][52668] DAMAGECOUNT value on done: 759410.0 [2024-08-06 06:35:31,318][52668] Sum rewards: 69.661, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.200', 'weapon4': '0.228', 'AMMO3': '0.244', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.844', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '59.500'} [2024-08-06 06:35:31,451][52820] DAMAGECOUNT value on done: 707862.0 [2024-08-06 06:35:31,452][52820] Sum rewards: 63.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.974', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.152', 'weapon5': '0.178', 'AMMO4': '0.181', 'WEAPON5': '0.300', 'weapon2': '0.324', 'weapon4': '0.432', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.800', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '51.000'} [2024-08-06 06:35:31,496][52795] DAMAGECOUNT value on done: 693227.0 [2024-08-06 06:35:31,498][52795] Sum rewards: 83.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.405', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.116', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '70.000'} [2024-08-06 06:35:31,827][52803] DAMAGECOUNT value on done: 706140.0 [2024-08-06 06:35:31,827][52803] Sum rewards: 73.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.654', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.208', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.500', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '60.000'} [2024-08-06 06:35:31,890][52662] DAMAGECOUNT value on done: 774179.0 [2024-08-06 06:35:31,890][52662] Sum rewards: 80.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.910', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'AMMO3': '0.240', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.392', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:32,132][52647] DAMAGECOUNT value on done: 800506.0 [2024-08-06 06:35:32,132][52647] Sum rewards: 81.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.194', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.183', 'weapon2': '0.204', 'AMMO4': '0.216', 'weapon5': '0.250', 'weapon4': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:32,268][52670] DAMAGECOUNT value on done: 757372.0 [2024-08-06 06:35:32,272][52670] Sum rewards: 79.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.283', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.044', 'weapon5': '0.128', 'AMMO4': '0.189', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 573390848. Throughput: 0: 4349.1. Samples: 143347630. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:32,794][52567] Avg episode reward: [(0, '74.527')] [2024-08-06 06:35:33,797][52666] DAMAGECOUNT value on done: 743478.0 [2024-08-06 06:35:33,797][52666] Sum rewards: 75.768, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.238', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:34,279][52668] DAMAGECOUNT value on done: 758441.0 [2024-08-06 06:35:34,279][52668] Sum rewards: 80.494, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.979', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'AMMO3': '0.145', 'weapon5': '0.158', 'AMMO4': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.772', 'WEAPON3': '0.950', 'weapon3': '2.866', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '63.000'} [2024-08-06 06:35:34,464][52820] DAMAGECOUNT value on done: 709617.0 [2024-08-06 06:35:34,465][52820] Sum rewards: 85.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '70.000'} [2024-08-06 06:35:34,655][52795] DAMAGECOUNT value on done: 710311.0 [2024-08-06 06:35:34,656][52795] Sum rewards: 65.048, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.644', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.122', 'AMMO3': '0.175', 'weapon4': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.144', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '52.000'} [2024-08-06 06:35:34,765][52647] DAMAGECOUNT value on done: 789212.0 [2024-08-06 06:35:34,766][52647] Sum rewards: 68.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.755', 'AMMO5': '0.022', 'AMMO2': '0.071', 'weapon4': '0.108', 'AMMO3': '0.234', 'weapon5': '0.336', 'AMMO4': '0.357', 'weapon2': '0.408', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.806', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:34,811][52662] DAMAGECOUNT value on done: 755974.0 [2024-08-06 06:35:34,812][52662] Sum rewards: 78.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.127', 'weapon5': '0.136', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:34,906][52803] DAMAGECOUNT value on done: 706918.0 [2024-08-06 06:35:34,906][52803] Sum rewards: 78.834, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.086', 'AMMO4': '0.170', 'weapon5': '0.176', 'weapon2': '0.234', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.196', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:35,260][52670] DAMAGECOUNT value on done: 759417.0 [2024-08-06 06:35:35,260][52670] Sum rewards: 68.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.255', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.081', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '57.000'} [2024-08-06 06:35:35,854][52650] Updated weights for policy 0, policy_version 70001 (0.0025) [2024-08-06 06:35:36,850][52668] DAMAGECOUNT value on done: 766193.0 [2024-08-06 06:35:36,850][52668] Sum rewards: 81.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.298', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.136', 'AMMO4': '0.163', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:36,876][52666] DAMAGECOUNT value on done: 755026.0 [2024-08-06 06:35:36,878][52666] Sum rewards: 66.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.132', 'AMMO3': '0.203', 'AMMO4': '0.221', 'weapon4': '0.222', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.420', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '55.000'} [2024-08-06 06:35:37,185][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:35:37,571][52820] DAMAGECOUNT value on done: 721304.0 [2024-08-06 06:35:37,571][52820] Sum rewards: 80.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.314', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.210', 'weapon2': '0.220', 'AMMO3': '0.225', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '66.000'} [2024-08-06 06:35:37,603][52662] DAMAGECOUNT value on done: 765059.0 [2024-08-06 06:35:37,603][52662] Sum rewards: 69.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.090', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.252', 'WEAPON3': '1.150', 'weapon3': '3.364', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '56.000'} [2024-08-06 06:35:37,705][52647] DAMAGECOUNT value on done: 797134.0 [2024-08-06 06:35:37,706][52647] Sum rewards: 79.887, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.810', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.106', 'AMMO4': '0.155', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.268', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 573480960. Throughput: 0: 4363.3. Samples: 143374260. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:37,794][52567] Avg episode reward: [(0, '74.211')] [2024-08-06 06:35:37,851][52803] DAMAGECOUNT value on done: 720418.0 [2024-08-06 06:35:37,853][52803] Sum rewards: 70.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.201', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.155', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.386', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:37,891][52795] DAMAGECOUNT value on done: 707227.0 [2024-08-06 06:35:37,892][52795] Sum rewards: 71.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.242', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'weapon2': '0.212', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'HITCOUNT': '3.370', 'weapon3': '3.382', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:40,011][52668] DAMAGECOUNT value on done: 763311.0 [2024-08-06 06:35:40,012][52668] Sum rewards: 73.776, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.066', 'HEALTH': '0.075', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.000', 'weapon3': '3.214', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:40,170][52650] Updated weights for policy 0, policy_version 70011 (0.0027) [2024-08-06 06:35:40,527][52662] DAMAGECOUNT value on done: 779590.0 [2024-08-06 06:35:40,528][52662] Sum rewards: 77.259, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.076', 'weapon4': '0.104', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:40,732][52820] DAMAGECOUNT value on done: 718195.0 [2024-08-06 06:35:40,733][52820] Sum rewards: 76.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.044', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.122', 'AMMO4': '0.150', 'AMMO3': '0.156', 'weapon5': '0.166', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.096', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:40,955][52795] DAMAGECOUNT value on done: 698571.0 [2024-08-06 06:35:40,957][52795] Sum rewards: 86.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.022', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.228', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.406', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '71.000'} [2024-08-06 06:35:41,057][52803] DAMAGECOUNT value on done: 711591.0 [2024-08-06 06:35:41,057][52803] Sum rewards: 79.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.176', 'AMMO3': '0.193', 'weapon5': '0.196', 'AMMO4': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '63.000'} [2024-08-06 06:35:41,806][52665] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:35:42,469][52647] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 06:35:42,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17467.1). Total num frames: 573571072. Throughput: 0: 4368.2. Samples: 143400690. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:42,795][52567] Avg episode reward: [(0, '74.226')] [2024-08-06 06:35:42,826][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:35:43,141][52668] DAMAGECOUNT value on done: 756307.0 [2024-08-06 06:35:43,144][52668] Sum rewards: 77.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.614', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.040', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.472', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '64.000'} [2024-08-06 06:35:43,292][52662] DAMAGECOUNT value on done: 765737.0 [2024-08-06 06:35:43,292][52662] Sum rewards: 81.877, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.100', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO3': '0.145', 'weapon4': '0.150', 'weapon5': '0.160', 'AMMO4': '0.171', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '0.950', 'weapon3': '3.024', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:43,772][52820] DAMAGECOUNT value on done: 702843.0 [2024-08-06 06:35:43,772][52820] Sum rewards: 70.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.364', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.069', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:44,009][52795] DAMAGECOUNT value on done: 705526.0 [2024-08-06 06:35:44,012][52795] Sum rewards: 82.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.426', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.166', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '67.000'} [2024-08-06 06:35:44,156][52803] DAMAGECOUNT value on done: 712360.0 [2024-08-06 06:35:44,160][52803] Sum rewards: 76.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.269', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.366', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:45,080][52650] Updated weights for policy 0, policy_version 70021 (0.0013) [2024-08-06 06:35:45,699][52668] DAMAGECOUNT value on done: 750634.0 [2024-08-06 06:35:45,700][52668] Sum rewards: 67.488, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.114', 'AMMO3': '0.155', 'HEALTH': '0.178', 'AMMO4': '0.183', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '0.900', 'weapon3': '2.922', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '53.000'} [2024-08-06 06:35:46,295][52662] DAMAGECOUNT value on done: 772619.0 [2024-08-06 06:35:46,295][52662] Sum rewards: 65.022, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.985', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.038', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.590', 'WEAPON3': '1.000', 'HITCOUNT': '3.140', 'weapon3': '3.152', 'DAMAGECOUNT': '14.337', 'FRAGCOUNT': '53.000'} [2024-08-06 06:35:47,043][52795] DAMAGECOUNT value on done: 712381.0 [2024-08-06 06:35:47,043][52795] Sum rewards: 67.462, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.137', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.410', 'weapon2': '0.430', 'HEALTH': '0.682', 'WEAPON3': '0.850', 'weapon3': '2.848', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '53.000'} [2024-08-06 06:35:47,170][52803] DAMAGECOUNT value on done: 724194.0 [2024-08-06 06:35:47,170][52803] Sum rewards: 90.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.016', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.282', 'WEAPON3': '1.000', 'weapon3': '3.494', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '72.000'} [2024-08-06 06:35:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 573652992. Throughput: 0: 4375.1. Samples: 143413800. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:47,802][52567] Avg episode reward: [(0, '74.547')] [2024-08-06 06:35:48,198][52668] DAMAGECOUNT value on done: 751145.0 [2024-08-06 06:35:48,198][52668] Sum rewards: 66.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.812', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.184', 'weapon2': '0.418', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.264', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '55.000'} [2024-08-06 06:35:49,253][52662] DAMAGECOUNT value on done: 761513.0 [2024-08-06 06:35:49,254][52662] Sum rewards: 81.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.212', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '68.000'} [2024-08-06 06:35:49,564][52650] Updated weights for policy 0, policy_version 70031 (0.0029) [2024-08-06 06:35:50,167][52803] DAMAGECOUNT value on done: 709065.0 [2024-08-06 06:35:50,167][52803] Sum rewards: 63.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.167', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.066', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '51.500'} [2024-08-06 06:35:50,502][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:35:51,594][52660] DAMAGECOUNT value on done: 763197.0 [2024-08-06 06:35:51,595][52660] Sum rewards: 72.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:51,774][52660] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:35:51,834][52668] DAMAGECOUNT value on done: 750731.0 [2024-08-06 06:35:51,834][52668] Sum rewards: 68.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'weapon5': '0.024', 'AMMO2': '0.038', 'weapon4': '0.112', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:52,287][52662] DAMAGECOUNT value on done: 763697.0 [2024-08-06 06:35:52,287][52662] Sum rewards: 75.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.082', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:52,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 573743104. Throughput: 0: 4382.7. Samples: 143440150. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:52,802][52567] Avg episode reward: [(0, '74.444')] [2024-08-06 06:35:53,310][52803] DAMAGECOUNT value on done: 711594.0 [2024-08-06 06:35:53,311][52803] Sum rewards: 77.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.889', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.140', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:54,459][52650] Updated weights for policy 0, policy_version 70041 (0.0013) [2024-08-06 06:35:54,472][52660] DAMAGECOUNT value on done: 753116.0 [2024-08-06 06:35:54,473][52660] Sum rewards: 72.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO2': '0.033', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '59.000'} [2024-08-06 06:35:54,721][52668] DAMAGECOUNT value on done: 761735.0 [2024-08-06 06:35:54,723][52668] Sum rewards: 65.089, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.100', 'AMMO3': '0.201', 'AMMO4': '0.223', 'weapon2': '0.238', 'weapon5': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.158', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '53.000'} [2024-08-06 06:35:55,155][52662] DAMAGECOUNT value on done: 757725.0 [2024-08-06 06:35:55,158][52662] Sum rewards: 75.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.815', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.210', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '62.000'} [2024-08-06 06:35:56,452][52803] DAMAGECOUNT value on done: 714633.0 [2024-08-06 06:35:56,453][52803] Sum rewards: 70.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.192', 'AMMO5': '0.027', 'AMMO2': '0.071', 'weapon4': '0.166', 'AMMO3': '0.216', 'AMMO4': '0.354', 'weapon5': '0.366', 'weapon2': '0.538', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.596', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '58.000'} [2024-08-06 06:35:56,967][52660] DAMAGECOUNT value on done: 765563.0 [2024-08-06 06:35:56,968][52660] Sum rewards: 77.299, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.325', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon5': '0.046', 'weapon4': '0.056', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '65.000'} [2024-08-06 06:35:57,105][52668] DAMAGECOUNT value on done: 764066.0 [2024-08-06 06:35:57,106][52668] Sum rewards: 66.539, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO3': '0.165', 'weapon5': '0.166', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '53.000'} [2024-08-06 06:35:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 573833216. Throughput: 0: 4374.2. Samples: 143466160. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:35:57,795][52567] Avg episode reward: [(0, '74.325')] [2024-08-06 06:35:58,395][52662] DAMAGECOUNT value on done: 769519.0 [2024-08-06 06:35:58,396][52662] Sum rewards: 69.266, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.105', 'AMMO5': '0.021', 'AMMO2': '0.075', 'weapon4': '0.120', 'weapon5': '0.274', 'AMMO3': '0.276', 'AMMO4': '0.373', 'weapon2': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.820', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 06:35:58,860][52650] Updated weights for policy 0, policy_version 70051 (0.0022) [2024-08-06 06:35:59,441][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:35:59,651][52803] DAMAGECOUNT value on done: 717686.0 [2024-08-06 06:35:59,652][52803] Sum rewards: 73.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.875', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon2': '0.140', 'AMMO3': '0.189', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.210', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.418', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.500'} [2024-08-06 06:35:59,953][52660] DAMAGECOUNT value on done: 774857.0 [2024-08-06 06:35:59,953][52660] Sum rewards: 84.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.658', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.156', 'weapon5': '0.164', 'AMMO4': '0.190', 'weapon4': '0.296', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '2.930', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '67.000'} [2024-08-06 06:36:00,077][52668] DAMAGECOUNT value on done: 760850.0 [2024-08-06 06:36:00,078][52668] Sum rewards: 72.294, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.640', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon2': '0.208', 'weapon5': '0.214', 'AMMO4': '0.284', 'AMMO3': '0.299', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.798', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '62.500'} [2024-08-06 06:36:00,569][52667] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:36:01,599][52662] DAMAGECOUNT value on done: 755944.0 [2024-08-06 06:36:01,600][52662] Sum rewards: 66.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.414', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.410', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.234', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '55.000'} [2024-08-06 06:36:02,572][52660] DAMAGECOUNT value on done: 758951.0 [2024-08-06 06:36:02,573][52660] Sum rewards: 74.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon4': '0.170', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.524', 'WEAPON3': '1.550', 'weapon3': '2.900', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '63.000'} [2024-08-06 06:36:02,705][52668] DAMAGECOUNT value on done: 767581.0 [2024-08-06 06:36:02,706][52668] Sum rewards: 83.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.825', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.148', 'AMMO3': '0.193', 'weapon5': '0.274', 'AMMO4': '0.285', 'weapon2': '0.306', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '69.000'} [2024-08-06 06:36:02,745][52803] DAMAGECOUNT value on done: 719616.0 [2024-08-06 06:36:02,749][52803] Sum rewards: 62.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.596', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon4': '0.182', 'weapon5': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '2.728', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '53.000'} [2024-08-06 06:36:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 573915136. Throughput: 0: 4374.9. Samples: 143479180. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 06:36:02,794][52567] Avg episode reward: [(0, '74.391')] [2024-08-06 06:36:03,618][52650] Updated weights for policy 0, policy_version 70061 (0.0011) [2024-08-06 06:36:03,848][52663] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:36:04,400][52663] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:36:04,768][52662] DAMAGECOUNT value on done: 773323.0 [2024-08-06 06:36:04,769][52662] Sum rewards: 85.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.713', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.169', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '68.000'} [2024-08-06 06:36:04,971][52660] DAMAGECOUNT value on done: 752949.0 [2024-08-06 06:36:04,973][52660] Sum rewards: 81.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.712', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.090', 'weapon5': '0.110', 'AMMO4': '0.160', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '68.000'} [2024-08-06 06:36:05,168][52668] DAMAGECOUNT value on done: 766660.0 [2024-08-06 06:36:05,170][52668] Sum rewards: 72.556, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.022', 'AMMO2': '0.023', 'weapon5': '0.072', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.462', 'HEALTH': '0.630', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '60.000'} [2024-08-06 06:36:05,384][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:36:05,887][52803] DAMAGECOUNT value on done: 714377.0 [2024-08-06 06:36:05,887][52803] Sum rewards: 64.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.275', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.418', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.294', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '55.000'} [2024-08-06 06:36:07,745][52662] DAMAGECOUNT value on done: 766710.0 [2024-08-06 06:36:07,745][52662] Sum rewards: 65.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.090', 'weapon4': '0.124', 'AMMO3': '0.175', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.282', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '54.000'} [2024-08-06 06:36:07,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 574005248. Throughput: 0: 4379.8. Samples: 143505430. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:07,794][52567] Avg episode reward: [(0, '74.452')] [2024-08-06 06:36:08,049][52660] DAMAGECOUNT value on done: 763990.0 [2024-08-06 06:36:08,049][52660] Sum rewards: 80.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.222', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.207', 'AMMO4': '0.216', 'weapon5': '0.236', 'weapon4': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.786', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '66.000'} [2024-08-06 06:36:08,512][52650] Updated weights for policy 0, policy_version 70071 (0.0024) [2024-08-06 06:36:10,129][52662] DAMAGECOUNT value on done: 754148.0 [2024-08-06 06:36:10,131][52662] Sum rewards: 64.724, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.186', 'weapon5': '0.192', 'AMMO4': '0.241', 'AMMO3': '0.265', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.864', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:10,936][52660] DAMAGECOUNT value on done: 769597.0 [2024-08-06 06:36:10,937][52660] Sum rewards: 66.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.598', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.050', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '3.264', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '58.000'} [2024-08-06 06:36:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 574095360. Throughput: 0: 4385.1. Samples: 143531970. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:12,802][52567] Avg episode reward: [(0, '74.240')] [2024-08-06 06:36:12,956][52662] DAMAGECOUNT value on done: 765568.0 [2024-08-06 06:36:12,957][52662] Sum rewards: 85.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '71.000'} [2024-08-06 06:36:13,375][52650] Updated weights for policy 0, policy_version 70081 (0.0013) [2024-08-06 06:36:13,848][52660] DAMAGECOUNT value on done: 755343.0 [2024-08-06 06:36:13,849][52660] Sum rewards: 61.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.052', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.190', 'AMMO3': '0.245', 'AMMO4': '0.292', 'weapon5': '0.318', 'weapon2': '0.384', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.768', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '52.000'} [2024-08-06 06:36:14,070][52659] DAMAGECOUNT value on done: 765873.0 [2024-08-06 06:36:14,073][52659] Sum rewards: 81.487, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.806', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.294', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '68.000'} [2024-08-06 06:36:15,529][52662] DAMAGECOUNT value on done: 755356.0 [2024-08-06 06:36:15,534][52662] Sum rewards: 81.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.604', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.112', 'weapon4': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.034', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '67.000'} [2024-08-06 06:36:16,735][52659] DAMAGECOUNT value on done: 765831.0 [2024-08-06 06:36:16,735][52659] Sum rewards: 76.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.096', 'weapon5': '0.106', 'AMMO4': '0.177', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '63.500'} [2024-08-06 06:36:17,034][52660] DAMAGECOUNT value on done: 758258.0 [2024-08-06 06:36:17,036][52660] Sum rewards: 77.466, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.520', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.044', 'AMMO4': '0.139', 'weapon2': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.303', 'WEAPON3': '1.900', 'weapon3': '3.358', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '68.000'} [2024-08-06 06:36:17,528][52650] Updated weights for policy 0, policy_version 70091 (0.0021) [2024-08-06 06:36:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 574185472. Throughput: 0: 4390.4. Samples: 143545200. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:17,794][52567] Avg episode reward: [(0, '74.379')] [2024-08-06 06:36:19,532][52659] DAMAGECOUNT value on done: 769174.0 [2024-08-06 06:36:19,532][52659] Sum rewards: 76.432, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.532', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '65.000'} [2024-08-06 06:36:20,166][52660] DAMAGECOUNT value on done: 764130.0 [2024-08-06 06:36:20,168][52660] Sum rewards: 77.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.789', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.380', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '64.000'} [2024-08-06 06:36:22,371][52659] DAMAGECOUNT value on done: 766300.0 [2024-08-06 06:36:22,372][52659] Sum rewards: 61.913, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.075', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.130', 'weapon2': '0.148', 'AMMO4': '0.174', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.500', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '53.000'} [2024-08-06 06:36:22,596][52650] Updated weights for policy 0, policy_version 70101 (0.0027) [2024-08-06 06:36:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 574267392. Throughput: 0: 4374.4. Samples: 143571110. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:22,794][52567] Avg episode reward: [(0, '74.254')] [2024-08-06 06:36:22,800][52660] DAMAGECOUNT value on done: 754838.0 [2024-08-06 06:36:22,802][52660] Sum rewards: 67.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.744', 'AMMO5': '0.016', 'AMMO2': '0.067', 'weapon4': '0.140', 'weapon5': '0.264', 'AMMO3': '0.269', 'AMMO4': '0.337', 'weapon2': '0.382', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.900', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:23,149][52665] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:36:24,882][52649] DAMAGECOUNT value on done: 740960.0 [2024-08-06 06:36:24,891][52649] Sum rewards: 58.826, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.405', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.464', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '3.296', 'DAMAGECOUNT': '13.608', 'FRAGCOUNT': '49.000'} [2024-08-06 06:36:25,526][52659] DAMAGECOUNT value on done: 765383.0 [2024-08-06 06:36:25,526][52659] Sum rewards: 71.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.556', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'weapon5': '0.028', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.170', 'weapon2': '0.562', 'WEAPON3': '1.000', 'weapon3': '3.156', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '59.000'} [2024-08-06 06:36:25,779][52660] DAMAGECOUNT value on done: 763043.0 [2024-08-06 06:36:25,779][52660] Sum rewards: 68.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.092', 'weapon5': '0.152', 'AMMO4': '0.229', 'AMMO3': '0.238', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.262', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '57.000'} [2024-08-06 06:36:25,808][52667] DAMAGECOUNT value on done: 763941.0 [2024-08-06 06:36:25,809][52667] Sum rewards: 68.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.273', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.094', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '58.000'} [2024-08-06 06:36:27,236][52650] Updated weights for policy 0, policy_version 70111 (0.0019) [2024-08-06 06:36:27,731][52649] DAMAGECOUNT value on done: 733352.0 [2024-08-06 06:36:27,732][52649] Sum rewards: 81.179, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.862', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'weapon3': '3.278', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '71.000'} [2024-08-06 06:36:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 574357504. Throughput: 0: 4352.7. Samples: 143596560. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:27,794][52567] Avg episode reward: [(0, '73.718')] [2024-08-06 06:36:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070112_574357504.pth... [2024-08-06 06:36:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069601_570171392.pth [2024-08-06 06:36:28,550][52660] DAMAGECOUNT value on done: 773572.0 [2024-08-06 06:36:28,550][52660] Sum rewards: 76.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.726', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.167', 'weapon2': '0.190', 'weapon4': '0.198', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '65.000'} [2024-08-06 06:36:28,587][52659] DAMAGECOUNT value on done: 766347.0 [2024-08-06 06:36:28,587][52659] Sum rewards: 74.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.132', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.500'} [2024-08-06 06:36:28,604][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:36:28,813][52667] DAMAGECOUNT value on done: 771119.0 [2024-08-06 06:36:28,813][52667] Sum rewards: 73.592, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO4': '0.213', 'weapon5': '0.236', 'AMMO3': '0.265', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.952', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 06:36:30,754][52649] DAMAGECOUNT value on done: 754193.0 [2024-08-06 06:36:30,754][52649] Sum rewards: 71.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.635', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.124', 'AMMO4': '0.162', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.550', 'weapon3': '3.164', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '61.000'} [2024-08-06 06:36:31,268][52660] DAMAGECOUNT value on done: 781146.0 [2024-08-06 06:36:31,269][52660] Sum rewards: 70.154, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.279', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.134', 'weapon4': '0.180', 'AMMO4': '0.236', 'AMMO3': '0.243', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '2.898', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.000'} [2024-08-06 06:36:31,616][52667] DAMAGECOUNT value on done: 769405.0 [2024-08-06 06:36:31,616][52667] Sum rewards: 88.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.649', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.144', 'weapon5': '0.168', 'AMMO3': '0.240', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '74.000'} [2024-08-06 06:36:31,667][52659] DAMAGECOUNT value on done: 767815.0 [2024-08-06 06:36:31,667][52659] Sum rewards: 81.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.113', 'weapon5': '0.140', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '65.000'} [2024-08-06 06:36:32,050][52650] Updated weights for policy 0, policy_version 70121 (0.0021) [2024-08-06 06:36:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 574439424. Throughput: 0: 4348.0. Samples: 143609460. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:32,794][52567] Avg episode reward: [(0, '73.774')] [2024-08-06 06:36:33,756][52649] DAMAGECOUNT value on done: 748633.0 [2024-08-06 06:36:33,756][52649] Sum rewards: 75.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.006', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.214', 'weapon5': '0.218', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '61.000'} [2024-08-06 06:36:33,957][52660] DAMAGECOUNT value on done: 758980.0 [2024-08-06 06:36:33,958][52660] Sum rewards: 79.967, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.658', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.150', 'weapon4': '0.202', 'AMMO3': '0.228', 'AMMO4': '0.233', 'weapon2': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '67.000'} [2024-08-06 06:36:34,416][52659] DAMAGECOUNT value on done: 763895.0 [2024-08-06 06:36:34,418][52659] Sum rewards: 74.840, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.305', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.076', 'AMMO3': '0.186', 'weapon5': '0.210', 'AMMO4': '0.298', 'weapon2': '0.314', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '59.000'} [2024-08-06 06:36:34,430][52667] DAMAGECOUNT value on done: 773946.0 [2024-08-06 06:36:34,431][52667] Sum rewards: 66.643, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.646', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.161', 'weapon4': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.080', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:34,877][52660] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon5', 0.002)] [2024-08-06 06:36:36,655][52660] DAMAGECOUNT value on done: 767379.0 [2024-08-06 06:36:36,657][52660] Sum rewards: 70.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.162', 'weapon5': '0.166', 'weapon4': '0.178', 'AMMO4': '0.181', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:36,748][52650] Updated weights for policy 0, policy_version 70131 (0.0015) [2024-08-06 06:36:36,805][52649] DAMAGECOUNT value on done: 737256.0 [2024-08-06 06:36:36,805][52649] Sum rewards: 63.012, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.566', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.070', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.311', 'weapon2': '0.358', 'WEAPON3': '1.800', 'HITCOUNT': '3.020', 'weapon3': '3.256', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '58.000'} [2024-08-06 06:36:36,886][52659] DAMAGECOUNT value on done: 769327.0 [2024-08-06 06:36:36,886][52659] Sum rewards: 70.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.289', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.090', 'weapon2': '0.196', 'AMMO4': '0.198', 'weapon5': '0.226', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.146', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '60.000'} [2024-08-06 06:36:37,330][52667] DAMAGECOUNT value on done: 775144.0 [2024-08-06 06:36:37,330][52667] Sum rewards: 69.721, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.502', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.182', 'weapon5': '0.210', 'AMMO4': '0.262', 'AMMO3': '0.278', 'weapon2': '0.306', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.994', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '61.000'} [2024-08-06 06:36:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 574529536. Throughput: 0: 4353.5. Samples: 143636060. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:37,795][52567] Avg episode reward: [(0, '73.855')] [2024-08-06 06:36:39,512][52659] DAMAGECOUNT value on done: 772982.0 [2024-08-06 06:36:39,520][52659] Sum rewards: 71.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '58.500'} [2024-08-06 06:36:39,912][52649] DAMAGECOUNT value on done: 752037.0 [2024-08-06 06:36:39,916][52649] Sum rewards: 77.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.644', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.130', 'AMMO4': '0.194', 'AMMO3': '0.248', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '67.000'} [2024-08-06 06:36:39,918][52660] DAMAGECOUNT value on done: 763425.0 [2024-08-06 06:36:39,920][52660] Sum rewards: 74.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.767', 'AMMO5': '0.023', 'AMMO2': '0.058', 'AMMO3': '0.164', 'weapon4': '0.210', 'weapon5': '0.262', 'AMMO4': '0.290', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.806', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '61.000'} [2024-08-06 06:36:40,383][52667] DAMAGECOUNT value on done: 775713.0 [2024-08-06 06:36:40,384][52667] Sum rewards: 81.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.441', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.144', 'AMMO3': '0.162', 'weapon5': '0.184', 'AMMO4': '0.199', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.210', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '64.000'} [2024-08-06 06:36:41,464][52650] Updated weights for policy 0, policy_version 70141 (0.0018) [2024-08-06 06:36:42,152][52659] DAMAGECOUNT value on done: 761224.0 [2024-08-06 06:36:42,155][52659] Sum rewards: 68.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.860', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.054', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.218', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '58.000'} [2024-08-06 06:36:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 574619648. Throughput: 0: 4354.0. Samples: 143662090. Policy #0 lag: (min: 0.0, avg: 4.1, max: 7.0) [2024-08-06 06:36:42,794][52567] Avg episode reward: [(0, '74.011')] [2024-08-06 06:36:43,150][52660] DAMAGECOUNT value on done: 756425.0 [2024-08-06 06:36:43,150][52660] Sum rewards: 70.957, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.888', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.104', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.402', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '57.000'} [2024-08-06 06:36:43,269][52667] DAMAGECOUNT value on done: 769485.0 [2024-08-06 06:36:43,270][52667] Sum rewards: 86.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.088', 'AMMO4': '0.160', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.354', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '69.000'} [2024-08-06 06:36:43,389][52649] DAMAGECOUNT value on done: 746911.0 [2024-08-06 06:36:43,391][52649] Sum rewards: 71.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.204', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '59.000'} [2024-08-06 06:36:45,447][52659] DAMAGECOUNT value on done: 771123.0 [2024-08-06 06:36:45,455][52659] Sum rewards: 91.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.789', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.080', 'AMMO3': '0.197', 'AMMO4': '0.230', 'weapon2': '0.254', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.798', 'FRAGCOUNT': '72.500'} [2024-08-06 06:36:45,743][52794] DAMAGECOUNT value on done: 762267.0 [2024-08-06 06:36:45,743][52794] Sum rewards: 69.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.845', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.034', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon2': '0.204', 'AMMO3': '0.247', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.516', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '59.000'} [2024-08-06 06:36:45,754][52660] DAMAGECOUNT value on done: 755845.0 [2024-08-06 06:36:45,756][52660] Sum rewards: 72.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.054', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '61.000'} [2024-08-06 06:36:46,011][52650] Updated weights for policy 0, policy_version 70151 (0.0030) [2024-08-06 06:36:46,045][52667] DAMAGECOUNT value on done: 766341.0 [2024-08-06 06:36:46,047][52667] Sum rewards: 80.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.755', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.118', 'weapon5': '0.186', 'AMMO4': '0.229', 'AMMO3': '0.234', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '67.000'} [2024-08-06 06:36:46,117][52649] DAMAGECOUNT value on done: 747916.0 [2024-08-06 06:36:46,119][52649] Sum rewards: 72.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.164', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO3': '0.176', 'AMMO4': '0.182', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.308', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '59.000'} [2024-08-06 06:36:46,700][52668] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:36:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 574709760. Throughput: 0: 4356.4. Samples: 143675220. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:36:47,794][52567] Avg episode reward: [(0, '74.096')] [2024-08-06 06:36:48,255][52659] DAMAGECOUNT value on done: 765305.0 [2024-08-06 06:36:48,256][52659] Sum rewards: 65.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon7': '0.094', 'weapon5': '0.112', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.760', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.234', 'FRAGCOUNT': '55.000'} [2024-08-06 06:36:48,602][52794] DAMAGECOUNT value on done: 769007.0 [2024-08-06 06:36:48,604][52794] Sum rewards: 61.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.445', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.134', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '53.000'} [2024-08-06 06:36:48,857][52667] DAMAGECOUNT value on done: 769801.0 [2024-08-06 06:36:48,858][52667] Sum rewards: 79.150, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.260', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.054', 'AMMO4': '0.125', 'AMMO3': '0.160', 'weapon4': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '63.000'} [2024-08-06 06:36:49,695][52649] DAMAGECOUNT value on done: 748861.0 [2024-08-06 06:36:49,695][52649] Sum rewards: 66.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.839', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.090', 'weapon5': '0.136', 'AMMO4': '0.180', 'AMMO3': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:50,623][52650] Updated weights for policy 0, policy_version 70161 (0.0012) [2024-08-06 06:36:51,335][52794] DAMAGECOUNT value on done: 775526.0 [2024-08-06 06:36:51,338][52794] Sum rewards: 71.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.042', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.036', 'AMMO4': '0.146', 'weapon5': '0.158', 'weapon2': '0.188', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.260', 'weapon3': '3.418', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '60.000'} [2024-08-06 06:36:51,358][52667] DAMAGECOUNT value on done: 775391.0 [2024-08-06 06:36:51,358][52667] Sum rewards: 68.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.004', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:51,423][52659] DAMAGECOUNT value on done: 766934.0 [2024-08-06 06:36:51,424][52659] Sum rewards: 69.890, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.978', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.022', 'weapon5': '0.082', 'AMMO4': '0.093', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.416', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '57.000'} [2024-08-06 06:36:52,640][52649] DAMAGECOUNT value on done: 741533.0 [2024-08-06 06:36:52,640][52649] Sum rewards: 78.595, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.173', 'weapon2': '0.178', 'weapon4': '0.192', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '66.000'} [2024-08-06 06:36:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 574791680. Throughput: 0: 4353.6. Samples: 143701340. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:36:52,794][52567] Avg episode reward: [(0, '73.646')] [2024-08-06 06:36:53,954][52794] DAMAGECOUNT value on done: 759148.0 [2024-08-06 06:36:53,956][52794] Sum rewards: 68.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.691', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.256', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'HITCOUNT': '3.390', 'weapon3': '3.412', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '59.000'} [2024-08-06 06:36:54,182][52667] DAMAGECOUNT value on done: 765715.0 [2024-08-06 06:36:54,184][52667] Sum rewards: 75.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.144', 'weapon5': '0.148', 'AMMO3': '0.219', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '63.000'} [2024-08-06 06:36:54,464][52659] DAMAGECOUNT value on done: 770035.0 [2024-08-06 06:36:54,465][52659] Sum rewards: 64.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.850', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.024', 'weapon4': '0.028', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:55,420][52650] Updated weights for policy 0, policy_version 70171 (0.0025) [2024-08-06 06:36:55,714][52649] DAMAGECOUNT value on done: 753836.0 [2024-08-06 06:36:55,715][52649] Sum rewards: 65.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.024', 'weapon5': '0.080', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.432', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.168', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:56,999][52659] DAMAGECOUNT value on done: 768510.0 [2024-08-06 06:36:57,007][52659] Sum rewards: 68.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.055', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.140', 'weapon4': '0.156', 'AMMO3': '0.194', 'AMMO4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '56.000'} [2024-08-06 06:36:57,231][52794] DAMAGECOUNT value on done: 759933.0 [2024-08-06 06:36:57,231][52794] Sum rewards: 62.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.355', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.228', 'AMMO3': '0.239', 'AMMO4': '0.256', 'weapon5': '0.318', 'weapon2': '0.406', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '54.000'} [2024-08-06 06:36:57,304][52667] DAMAGECOUNT value on done: 767832.0 [2024-08-06 06:36:57,304][52667] Sum rewards: 71.519, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.574', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.090', 'AMMO4': '0.177', 'AMMO3': '0.207', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.772', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.000'} [2024-08-06 06:36:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 574873600. Throughput: 0: 4353.3. Samples: 143727870. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:36:57,794][52567] Avg episode reward: [(0, '73.308')] [2024-08-06 06:36:58,614][52649] DAMAGECOUNT value on done: 756332.0 [2024-08-06 06:36:58,615][52649] Sum rewards: 70.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.408', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.084', 'weapon5': '0.132', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '57.500'} [2024-08-06 06:36:59,964][52650] Updated weights for policy 0, policy_version 70181 (0.0020) [2024-08-06 06:37:00,035][52659] DAMAGECOUNT value on done: 775985.0 [2024-08-06 06:37:00,038][52659] Sum rewards: 76.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.643', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.076', 'weapon5': '0.104', 'AMMO4': '0.135', 'weapon2': '0.250', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.306', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '64.000'} [2024-08-06 06:37:00,165][52667] DAMAGECOUNT value on done: 776197.0 [2024-08-06 06:37:00,166][52667] Sum rewards: 79.483, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.049', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.130', 'weapon4': '0.134', 'AMMO4': '0.192', 'weapon2': '0.288', 'AMMO3': '0.299', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.140', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '68.000'} [2024-08-06 06:37:00,187][52794] DAMAGECOUNT value on done: 767145.0 [2024-08-06 06:37:00,188][52794] Sum rewards: 71.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.366', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon5': '0.202', 'AMMO3': '0.236', 'weapon2': '0.282', 'AMMO4': '0.290', 'weapon4': '0.402', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.766', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:01,997][52649] DAMAGECOUNT value on done: 753521.0 [2024-08-06 06:37:02,000][52649] Sum rewards: 65.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.028', 'AMMO2': '0.077', 'AMMO3': '0.175', 'weapon5': '0.266', 'weapon4': '0.338', 'AMMO4': '0.387', 'weapon2': '0.394', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.686', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '53.000'} [2024-08-06 06:37:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 574963712. Throughput: 0: 4348.0. Samples: 143740860. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:37:02,795][52567] Avg episode reward: [(0, '72.963')] [2024-08-06 06:37:02,974][52659] DAMAGECOUNT value on done: 763254.0 [2024-08-06 06:37:02,976][52659] Sum rewards: 62.334, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.592', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon2': '0.140', 'weapon5': '0.204', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '2.956', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2024-08-06 06:37:03,035][52667] DAMAGECOUNT value on done: 763062.0 [2024-08-06 06:37:03,036][52667] Sum rewards: 69.764, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.286', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.279', 'weapon2': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.320', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:03,261][52794] DAMAGECOUNT value on done: 771096.0 [2024-08-06 06:37:03,262][52794] Sum rewards: 84.408, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.061', 'weapon4': '0.070', 'weapon5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.758', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '70.000'} [2024-08-06 06:37:03,777][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:37:04,750][52650] Updated weights for policy 0, policy_version 70191 (0.0023) [2024-08-06 06:37:05,200][52649] DAMAGECOUNT value on done: 754395.0 [2024-08-06 06:37:05,202][52649] Sum rewards: 68.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.025', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.242', 'weapon2': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.532', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:05,508][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:37:05,572][52659] DAMAGECOUNT value on done: 771341.0 [2024-08-06 06:37:05,576][52659] Sum rewards: 57.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.530', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon2': '0.162', 'weapon5': '0.188', 'weapon4': '0.208', 'AMMO4': '0.237', 'AMMO3': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.630', 'weapon3': '3.204', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '51.000'} [2024-08-06 06:37:05,850][52667] DAMAGECOUNT value on done: 770494.0 [2024-08-06 06:37:05,851][52667] Sum rewards: 82.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.092', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.076', 'weapon4': '0.114', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.338', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '69.000'} [2024-08-06 06:37:06,412][52794] DAMAGECOUNT value on done: 757353.0 [2024-08-06 06:37:06,412][52794] Sum rewards: 72.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.835', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.018', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.330', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 575053824. Throughput: 0: 4354.9. Samples: 143767080. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:37:07,794][52567] Avg episode reward: [(0, '72.826')] [2024-08-06 06:37:08,251][52649] DAMAGECOUNT value on done: 741492.0 [2024-08-06 06:37:08,253][52649] Sum rewards: 84.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.422', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.173', 'AMMO4': '0.194', 'weapon4': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '67.000'} [2024-08-06 06:37:08,316][52667] DAMAGECOUNT value on done: 777226.0 [2024-08-06 06:37:08,317][52667] Sum rewards: 84.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.550', 'FRAGCOUNT': '68.000'} [2024-08-06 06:37:08,762][52659] DAMAGECOUNT value on done: 764946.0 [2024-08-06 06:37:08,765][52659] Sum rewards: 67.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.765', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.050', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:09,454][52650] Updated weights for policy 0, policy_version 70201 (0.0035) [2024-08-06 06:37:09,725][52794] DAMAGECOUNT value on done: 769925.0 [2024-08-06 06:37:09,725][52794] Sum rewards: 78.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.104', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.103', 'FRAGCOUNT': '64.000'} [2024-08-06 06:37:09,730][52665] DAMAGECOUNT value on done: 753642.0 [2024-08-06 06:37:09,732][52665] Sum rewards: 78.936, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.879', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '3.284', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:11,136][52667] DAMAGECOUNT value on done: 774338.0 [2024-08-06 06:37:11,137][52667] Sum rewards: 82.747, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.942', 'AMMO5': '0.006', 'weapon4': '0.020', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '66.000'} [2024-08-06 06:37:11,228][52649] DAMAGECOUNT value on done: 752011.0 [2024-08-06 06:37:11,228][52649] Sum rewards: 94.258, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.075', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.069', 'weapon4': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.050', 'weapon3': '3.200', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '75.000'} [2024-08-06 06:37:12,542][52794] DAMAGECOUNT value on done: 762447.0 [2024-08-06 06:37:12,542][52794] Sum rewards: 74.077, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.988', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'AMMO3': '0.167', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.648', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '58.500'} [2024-08-06 06:37:12,544][52665] DAMAGECOUNT value on done: 768234.0 [2024-08-06 06:37:12,546][52665] Sum rewards: 76.893, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.192', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.199', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 575135744. Throughput: 0: 4374.9. Samples: 143793430. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:37:12,803][52567] Avg episode reward: [(0, '73.354')] [2024-08-06 06:37:13,954][52649] DAMAGECOUNT value on done: 737021.0 [2024-08-06 06:37:13,958][52649] Sum rewards: 69.252, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.901', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO3': '0.146', 'weapon4': '0.166', 'AMMO4': '0.190', 'weapon5': '0.214', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'HITCOUNT': '3.070', 'weapon3': '3.086', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '53.000'} [2024-08-06 06:37:14,063][52650] Updated weights for policy 0, policy_version 70211 (0.0011) [2024-08-06 06:37:14,332][52667] DAMAGECOUNT value on done: 773069.0 [2024-08-06 06:37:14,332][52667] Sum rewards: 67.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.428', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon2': '0.166', 'weapon5': '0.176', 'weapon4': '0.186', 'AMMO4': '0.235', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.206', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.000'} [2024-08-06 06:37:15,464][52665] DAMAGECOUNT value on done: 764312.0 [2024-08-06 06:37:15,466][52665] Sum rewards: 72.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.701', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.114', 'AMMO4': '0.197', 'weapon5': '0.230', 'AMMO3': '0.246', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.982', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:15,559][52664] DAMAGECOUNT value on done: 791905.0 [2024-08-06 06:37:15,559][52664] Sum rewards: 81.262, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.094', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.009', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '20.415', 'FRAGCOUNT': '63.000'} [2024-08-06 06:37:15,591][52794] DAMAGECOUNT value on done: 758513.0 [2024-08-06 06:37:15,592][52794] Sum rewards: 72.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.050', 'AMMO4': '0.221', 'AMMO3': '0.236', 'weapon5': '0.244', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.238', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:17,041][52667] DAMAGECOUNT value on done: 770668.0 [2024-08-06 06:37:17,043][52667] Sum rewards: 77.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO3': '0.191', 'weapon5': '0.222', 'weapon2': '0.224', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:17,100][52649] DAMAGECOUNT value on done: 754471.0 [2024-08-06 06:37:17,101][52649] Sum rewards: 69.282, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.112', 'AMMO4': '0.172', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.000'} [2024-08-06 06:37:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 575225856. Throughput: 0: 4380.0. Samples: 143806560. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:37:17,795][52567] Avg episode reward: [(0, '73.475')] [2024-08-06 06:37:18,297][52794] DAMAGECOUNT value on done: 768299.0 [2024-08-06 06:37:18,297][52794] Sum rewards: 87.152, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.280', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.127', 'weapon5': '0.134', 'AMMO4': '0.172', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '0.850', 'weapon3': '2.982', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '66.000'} [2024-08-06 06:37:18,450][52664] DAMAGECOUNT value on done: 798524.0 [2024-08-06 06:37:18,450][52664] Sum rewards: 77.739, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.581', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.131', 'AMMO4': '0.162', 'weapon5': '0.180', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON3': '0.900', 'weapon3': '2.972', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 06:37:18,665][52665] DAMAGECOUNT value on done: 761197.0 [2024-08-06 06:37:18,667][52665] Sum rewards: 67.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.630', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.142', 'weapon5': '0.158', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '54.000'} [2024-08-06 06:37:18,827][52650] Updated weights for policy 0, policy_version 70221 (0.0033) [2024-08-06 06:37:19,880][52667] DAMAGECOUNT value on done: 776927.0 [2024-08-06 06:37:19,881][52667] Sum rewards: 85.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.456', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '71.000'} [2024-08-06 06:37:20,406][52649] DAMAGECOUNT value on done: 756014.0 [2024-08-06 06:37:20,407][52649] Sum rewards: 73.209, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.473', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.086', 'weapon4': '0.198', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '63.000'} [2024-08-06 06:37:21,225][52664] DAMAGECOUNT value on done: 796537.0 [2024-08-06 06:37:21,225][52664] Sum rewards: 70.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.524', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.340', 'weapon4': '0.404', 'WEAPON3': '1.450', 'weapon3': '2.854', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:21,304][52794] DAMAGECOUNT value on done: 765136.0 [2024-08-06 06:37:21,306][52794] Sum rewards: 82.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.064', 'weapon5': '0.128', 'weapon2': '0.164', 'AMMO3': '0.249', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.036', 'FRAGCOUNT': '69.000'} [2024-08-06 06:37:21,850][52665] DAMAGECOUNT value on done: 746198.0 [2024-08-06 06:37:21,851][52665] Sum rewards: 64.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.869', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO4': '0.176', 'AMMO3': '0.237', 'weapon2': '0.238', 'weapon5': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.212', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '55.000'} [2024-08-06 06:37:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 575315968. Throughput: 0: 4368.9. Samples: 143832660. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:37:22,794][52567] Avg episode reward: [(0, '73.451')] [2024-08-06 06:37:23,442][52649] DAMAGECOUNT value on done: 744834.0 [2024-08-06 06:37:23,443][52649] Sum rewards: 67.273, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.017', 'AMMO2': '0.043', 'HEALTH': '0.068', 'weapon4': '0.090', 'AMMO3': '0.160', 'AMMO4': '0.213', 'weapon5': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '0.950', 'weapon3': '2.986', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '54.000'} [2024-08-06 06:37:23,622][52650] Updated weights for policy 0, policy_version 70231 (0.0025) [2024-08-06 06:37:24,139][52664] DAMAGECOUNT value on done: 789506.0 [2024-08-06 06:37:24,141][52664] Sum rewards: 73.067, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.240', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon4': '0.076', 'weapon5': '0.190', 'AMMO4': '0.307', 'AMMO3': '0.311', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.800', 'weapon3': '2.978', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '64.000'} [2024-08-06 06:37:24,335][52794] DAMAGECOUNT value on done: 780657.0 [2024-08-06 06:37:24,336][52794] Sum rewards: 77.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.223', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.066', 'AMMO4': '0.137', 'weapon5': '0.146', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '64.000'} [2024-08-06 06:37:24,689][52665] DAMAGECOUNT value on done: 752856.0 [2024-08-06 06:37:24,691][52665] Sum rewards: 74.053, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.064', 'AMMO3': '0.165', 'weapon5': '0.180', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:27,108][52664] DAMAGECOUNT value on done: 803234.0 [2024-08-06 06:37:27,109][52664] Sum rewards: 82.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.004', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.155', 'weapon4': '0.172', 'AMMO3': '0.232', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '69.000'} [2024-08-06 06:37:27,265][52794] DAMAGECOUNT value on done: 760033.0 [2024-08-06 06:37:27,265][52794] Sum rewards: 77.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.144', 'weapon5': '0.196', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:27,546][52665] DAMAGECOUNT value on done: 759003.0 [2024-08-06 06:37:27,551][52665] Sum rewards: 69.616, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.120', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.058', 'AMMO4': '0.181', 'weapon5': '0.186', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 575397888. Throughput: 0: 4366.2. Samples: 143858570. Policy #0 lag: (min: 1.0, avg: 4.1, max: 9.0) [2024-08-06 06:37:27,795][52567] Avg episode reward: [(0, '73.673')] [2024-08-06 06:37:28,433][52650] Updated weights for policy 0, policy_version 70241 (0.0018) [2024-08-06 06:37:29,598][52664] DAMAGECOUNT value on done: 795761.0 [2024-08-06 06:37:29,599][52664] Sum rewards: 61.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.107', 'weapon4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.118', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '53.000'} [2024-08-06 06:37:30,399][52658] DAMAGECOUNT value on done: 767858.0 [2024-08-06 06:37:30,399][52658] Sum rewards: 68.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.046', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.272', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.394', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 06:37:30,427][52794] DAMAGECOUNT value on done: 774048.0 [2024-08-06 06:37:30,429][52794] Sum rewards: 72.595, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.095', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '0.950', 'weapon3': '3.202', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '57.000'} [2024-08-06 06:37:30,723][52665] DAMAGECOUNT value on done: 757860.0 [2024-08-06 06:37:30,727][52665] Sum rewards: 79.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.310', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.082', 'weapon5': '0.180', 'AMMO3': '0.202', 'AMMO4': '0.208', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '65.000'} [2024-08-06 06:37:32,115][52663] DAMAGECOUNT value on done: 781886.0 [2024-08-06 06:37:32,116][52663] Sum rewards: 85.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.180', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '68.000'} [2024-08-06 06:37:32,726][52664] DAMAGECOUNT value on done: 790663.0 [2024-08-06 06:37:32,726][52664] Sum rewards: 77.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.126', 'AMMO3': '0.232', 'weapon4': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '65.000'} [2024-08-06 06:37:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 575488000. Throughput: 0: 4356.2. Samples: 143871250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:37:32,794][52567] Avg episode reward: [(0, '73.558')] [2024-08-06 06:37:32,996][52794] DAMAGECOUNT value on done: 770807.0 [2024-08-06 06:37:32,999][52794] Sum rewards: 72.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.280', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.540', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:33,260][52658] DAMAGECOUNT value on done: 770719.0 [2024-08-06 06:37:33,260][52658] Sum rewards: 69.106, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.818', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.172', 'weapon5': '0.174', 'AMMO4': '0.178', 'AMMO3': '0.254', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:33,298][52650] Updated weights for policy 0, policy_version 70251 (0.0022) [2024-08-06 06:37:34,108][52665] DAMAGECOUNT value on done: 765295.0 [2024-08-06 06:37:34,109][52665] Sum rewards: 75.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.918', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.178', 'AMMO4': '0.197', 'AMMO3': '0.223', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.250', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '63.000'} [2024-08-06 06:37:34,257][52614] Signal inference workers to stop experience collection... (12800 times) [2024-08-06 06:37:34,257][52614] Signal inference workers to resume experience collection... (12800 times) [2024-08-06 06:37:34,340][52650] InferenceWorker_p0-w0: stopping experience collection (12800 times) [2024-08-06 06:37:34,340][52650] InferenceWorker_p0-w0: resuming experience collection (12800 times) [2024-08-06 06:37:34,353][52811] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:37:35,518][52663] DAMAGECOUNT value on done: 766634.0 [2024-08-06 06:37:35,518][52663] Sum rewards: 82.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.127', 'weapon4': '0.142', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.050', 'weapon3': '3.240', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '69.000'} [2024-08-06 06:37:35,522][52664] DAMAGECOUNT value on done: 784558.0 [2024-08-06 06:37:35,522][52664] Sum rewards: 64.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.036', 'weapon4': '0.040', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.382', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '55.000'} [2024-08-06 06:37:36,137][52658] DAMAGECOUNT value on done: 773482.0 [2024-08-06 06:37:36,138][52794] DAMAGECOUNT value on done: 770814.0 [2024-08-06 06:37:36,138][52794] Sum rewards: 74.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.450', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO4': '0.165', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.676', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:36,138][52658] Sum rewards: 71.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.759', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.184', 'AMMO4': '0.195', 'AMMO3': '0.232', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '60.500'} [2024-08-06 06:37:36,153][52671] DAMAGECOUNT value on done: 772377.0 [2024-08-06 06:37:36,153][52671] Sum rewards: 77.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.956', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:36,844][52665] DAMAGECOUNT value on done: 756203.0 [2024-08-06 06:37:36,844][52665] Sum rewards: 62.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.410', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.324', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.278', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '53.000'} [2024-08-06 06:37:37,782][52650] Updated weights for policy 0, policy_version 70261 (0.0012) [2024-08-06 06:37:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 575578112. Throughput: 0: 4356.9. Samples: 143897400. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:37:37,794][52567] Avg episode reward: [(0, '73.740')] [2024-08-06 06:37:37,978][52664] DAMAGECOUNT value on done: 798408.0 [2024-08-06 06:37:37,979][52664] Sum rewards: 65.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.905', 'AMMO5': '0.020', 'AMMO2': '0.062', 'AMMO3': '0.168', 'weapon5': '0.200', 'AMMO4': '0.310', 'weapon4': '0.338', 'weapon2': '0.400', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '54.000'} [2024-08-06 06:37:38,155][52663] DAMAGECOUNT value on done: 761921.0 [2024-08-06 06:37:38,157][52663] Sum rewards: 72.975, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon4': '0.382', 'weapon2': '0.430', 'WEAPON3': '0.900', 'HEALTH': '0.903', 'weapon3': '2.848', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '56.000'} [2024-08-06 06:37:38,759][52658] DAMAGECOUNT value on done: 769057.0 [2024-08-06 06:37:38,759][52658] Sum rewards: 71.856, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.236', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.162', 'AMMO3': '0.171', 'weapon4': '0.222', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '57.000'} [2024-08-06 06:37:39,297][52794] DAMAGECOUNT value on done: 780547.0 [2024-08-06 06:37:39,297][52794] Sum rewards: 83.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.817', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.139', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'weapon5': '0.304', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '67.000'} [2024-08-06 06:37:39,313][52671] DAMAGECOUNT value on done: 775588.0 [2024-08-06 06:37:39,314][52671] Sum rewards: 65.283, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.114', 'AMMO4': '0.199', 'weapon2': '0.204', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.362', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '57.000'} [2024-08-06 06:37:39,520][52665] DAMAGECOUNT value on done: 766055.0 [2024-08-06 06:37:39,521][52665] Sum rewards: 67.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO4': '0.208', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '57.000'} [2024-08-06 06:37:41,003][52664] DAMAGECOUNT value on done: 792081.0 [2024-08-06 06:37:41,003][52664] Sum rewards: 75.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.513', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.206', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:41,088][52663] DAMAGECOUNT value on done: 766544.0 [2024-08-06 06:37:41,089][52663] Sum rewards: 75.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.233', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.388', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '63.000'} [2024-08-06 06:37:41,267][52658] DAMAGECOUNT value on done: 763087.0 [2024-08-06 06:37:41,269][52658] Sum rewards: 86.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.906', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.162', 'AMMO3': '0.204', 'weapon2': '0.260', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '70.000'} [2024-08-06 06:37:41,623][52669] DAMAGECOUNT value on done: 769331.0 [2024-08-06 06:37:41,624][52669] Sum rewards: 74.196, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.385', 'AMMO5': '0.025', 'AMMO2': '0.065', 'weapon4': '0.102', 'AMMO3': '0.243', 'weapon5': '0.266', 'AMMO4': '0.327', 'weapon2': '0.398', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.762', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:42,201][52794] DAMAGECOUNT value on done: 770644.0 [2024-08-06 06:37:42,202][52794] Sum rewards: 87.487, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.650', 'weapon3': '3.236', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.588', 'FRAGCOUNT': '74.000'} [2024-08-06 06:37:42,404][52671] DAMAGECOUNT value on done: 770799.0 [2024-08-06 06:37:42,405][52671] Sum rewards: 80.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.404', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.228', 'weapon2': '0.248', 'AMMO3': '0.249', 'AMMO4': '0.270', 'weapon5': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.852', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '67.000'} [2024-08-06 06:37:42,463][52665] DAMAGECOUNT value on done: 764549.0 [2024-08-06 06:37:42,463][52665] Sum rewards: 71.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.156', 'weapon4': '0.216', 'weapon2': '0.226', 'AMMO4': '0.230', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '60.000'} [2024-08-06 06:37:42,501][52650] Updated weights for policy 0, policy_version 70271 (0.0011) [2024-08-06 06:37:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 575660032. Throughput: 0: 4347.8. Samples: 143923520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:37:42,795][52567] Avg episode reward: [(0, '73.922')] [2024-08-06 06:37:43,824][52811] DAMAGECOUNT value on done: 729841.0 [2024-08-06 06:37:43,824][52811] Sum rewards: 73.661, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.162', 'AMMO4': '0.176', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.858', 'WEAPON3': '1.100', 'weapon3': '2.592', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:43,842][52658] DAMAGECOUNT value on done: 759936.0 [2024-08-06 06:37:43,843][52658] Sum rewards: 73.037, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.305', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.189', 'weapon4': '0.198', 'weapon5': '0.210', 'weapon2': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:44,009][52664] DAMAGECOUNT value on done: 803804.0 [2024-08-06 06:37:44,010][52664] Sum rewards: 69.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.232', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '57.000'} [2024-08-06 06:37:44,105][52663] DAMAGECOUNT value on done: 766715.0 [2024-08-06 06:37:44,107][52663] Sum rewards: 69.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.746', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '58.000'} [2024-08-06 06:37:44,165][52647] DAMAGECOUNT value on done: 815823.0 [2024-08-06 06:37:44,165][52647] Sum rewards: 73.044, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.560', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'AMMO5': '0.006', 'AMMO3': '0.109', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.466', 'weapon4': '0.500', 'WEAPON3': '0.850', 'weapon3': '2.688', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '55.000'} [2024-08-06 06:37:44,499][52669] DAMAGECOUNT value on done: 760184.0 [2024-08-06 06:37:44,501][52669] Sum rewards: 84.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.422', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.220', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '71.000'} [2024-08-06 06:37:45,457][52671] DAMAGECOUNT value on done: 773427.0 [2024-08-06 06:37:45,457][52671] Sum rewards: 68.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.855', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.054', 'weapon5': '0.082', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.324', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.346', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '58.000'} [2024-08-06 06:37:45,591][52665] DAMAGECOUNT value on done: 759423.0 [2024-08-06 06:37:45,592][52665] Sum rewards: 82.037, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.800', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.048', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon2': '0.396', 'WEAPON3': '1.000', 'weapon3': '3.378', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '65.000'} [2024-08-06 06:37:46,633][52663] DAMAGECOUNT value on done: 776815.0 [2024-08-06 06:37:46,635][52663] Sum rewards: 93.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.234', 'weapon2': '0.498', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '22.275', 'FRAGCOUNT': '77.000'} [2024-08-06 06:37:46,657][52658] DAMAGECOUNT value on done: 773672.0 [2024-08-06 06:37:46,658][52658] Sum rewards: 68.814, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.960', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.242', 'weapon4': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 06:37:46,907][52811] DAMAGECOUNT value on done: 712983.0 [2024-08-06 06:37:46,907][52811] Sum rewards: 67.833, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.300', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.112', 'weapon4': '0.118', 'weapon2': '0.228', 'WEAPON4': '0.250', 'AMMO4': '0.278', 'AMMO3': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.244', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:47,039][52650] Updated weights for policy 0, policy_version 70281 (0.0020) [2024-08-06 06:37:47,186][52794] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:37:47,200][52669] DAMAGECOUNT value on done: 774031.0 [2024-08-06 06:37:47,201][52669] Sum rewards: 74.045, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.906', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:47,309][52664] DAMAGECOUNT value on done: 800623.0 [2024-08-06 06:37:47,309][52664] Sum rewards: 75.080, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.364', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.118', 'weapon4': '0.180', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:47,444][52647] DAMAGECOUNT value on done: 806075.0 [2024-08-06 06:37:47,444][52647] Sum rewards: 74.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.119', 'AMMO3': '0.209', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 575750144. Throughput: 0: 4356.9. Samples: 143936920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:37:47,802][52567] Avg episode reward: [(0, '73.800')] [2024-08-06 06:37:48,097][52671] DAMAGECOUNT value on done: 781157.0 [2024-08-06 06:37:48,099][52671] Sum rewards: 79.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.299', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.060', 'AMMO4': '0.061', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.296', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '66.000'} [2024-08-06 06:37:48,559][52665] DAMAGECOUNT value on done: 759127.0 [2024-08-06 06:37:48,561][52665] Sum rewards: 72.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.570', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.120', 'weapon4': '0.234', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '59.000'} [2024-08-06 06:37:48,788][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:37:49,662][52658] DAMAGECOUNT value on done: 762665.0 [2024-08-06 06:37:49,663][52658] Sum rewards: 81.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '66.000'} [2024-08-06 06:37:49,678][52663] DAMAGECOUNT value on done: 764020.0 [2024-08-06 06:37:49,681][52663] Sum rewards: 72.653, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.043', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.080', 'AMMO4': '0.135', 'weapon5': '0.166', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:49,988][52664] DAMAGECOUNT value on done: 801938.0 [2024-08-06 06:37:49,990][52664] Sum rewards: 78.548, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.091', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '66.000'} [2024-08-06 06:37:49,991][52811] DAMAGECOUNT value on done: 710389.0 [2024-08-06 06:37:49,994][52811] Sum rewards: 63.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.380', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.174', 'weapon5': '0.256', 'AMMO3': '0.272', 'AMMO4': '0.317', 'weapon2': '0.400', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.838', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '56.000'} [2024-08-06 06:37:50,126][52647] DAMAGECOUNT value on done: 811202.0 [2024-08-06 06:37:50,127][52647] Sum rewards: 85.349, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.132', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.170', 'AMMO3': '0.174', 'weapon5': '0.214', 'AMMO4': '0.292', 'weapon2': '0.530', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.826', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '67.000'} [2024-08-06 06:37:50,232][52669] DAMAGECOUNT value on done: 767542.0 [2024-08-06 06:37:50,233][52669] Sum rewards: 62.847, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.545', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.126', 'weapon5': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.438', 'WEAPON3': '1.650', 'HITCOUNT': '3.000', 'weapon3': '3.120', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '56.000'} [2024-08-06 06:37:51,375][52671] DAMAGECOUNT value on done: 772497.0 [2024-08-06 06:37:51,377][52671] Sum rewards: 90.040, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.226', 'weapon2': '0.234', 'weapon4': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '74.000'} [2024-08-06 06:37:51,500][52670] DAMAGECOUNT value on done: 757801.0 [2024-08-06 06:37:51,501][52670] Sum rewards: 81.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.577', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.134', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.081', 'FRAGCOUNT': '66.000'} [2024-08-06 06:37:51,808][52665] DAMAGECOUNT value on done: 755554.0 [2024-08-06 06:37:51,809][52665] Sum rewards: 81.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.122', 'AMMO4': '0.219', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '69.000'} [2024-08-06 06:37:52,089][52650] Updated weights for policy 0, policy_version 70291 (0.0012) [2024-08-06 06:37:52,524][52658] DAMAGECOUNT value on done: 786080.0 [2024-08-06 06:37:52,527][52658] Sum rewards: 78.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.702', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.086', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '64.000'} [2024-08-06 06:37:52,731][52663] DAMAGECOUNT value on done: 754966.0 [2024-08-06 06:37:52,731][52663] Sum rewards: 73.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.209', 'weapon5': '0.216', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.796', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:52,795][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 575832064. Throughput: 0: 4351.5. Samples: 143962900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:37:52,795][52567] Avg episode reward: [(0, '74.759')] [2024-08-06 06:37:52,855][52664] DAMAGECOUNT value on done: 807882.0 [2024-08-06 06:37:52,856][52664] Sum rewards: 77.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.092', 'weapon4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.246', 'WEAPON3': '1.450', 'weapon3': '3.366', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '65.000'} [2024-08-06 06:37:52,905][52647] DAMAGECOUNT value on done: 810285.0 [2024-08-06 06:37:52,906][52647] Sum rewards: 76.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.215', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.172', 'weapon5': '0.188', 'AMMO3': '0.212', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:53,032][52811] DAMAGECOUNT value on done: 712289.0 [2024-08-06 06:37:53,032][52811] Sum rewards: 64.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.102', 'AMMO4': '0.228', 'weapon2': '0.228', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.416', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '54.000'} [2024-08-06 06:37:53,276][52669] DAMAGECOUNT value on done: 772566.0 [2024-08-06 06:37:53,277][52669] Sum rewards: 84.094, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.297', 'weapon2': '0.458', 'WEAPON3': '1.800', 'weapon3': '3.340', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.103', 'FRAGCOUNT': '73.000'} [2024-08-06 06:37:53,649][52666] DAMAGECOUNT value on done: 766914.0 [2024-08-06 06:37:53,650][52666] Sum rewards: 72.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.394', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.084', 'AMMO3': '0.159', 'weapon5': '0.166', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '0.950', 'weapon3': '3.106', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '58.000'} [2024-08-06 06:37:54,327][52671] DAMAGECOUNT value on done: 776233.0 [2024-08-06 06:37:54,327][52671] Sum rewards: 75.633, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.215', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.116', 'weapon5': '0.122', 'AMMO4': '0.172', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '60.000'} [2024-08-06 06:37:54,559][52670] DAMAGECOUNT value on done: 768649.0 [2024-08-06 06:37:54,563][52670] Sum rewards: 68.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.082', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '56.000'} [2024-08-06 06:37:55,094][52665] DAMAGECOUNT value on done: 759500.0 [2024-08-06 06:37:55,095][52665] Sum rewards: 66.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.902', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 06:37:55,497][52647] DAMAGECOUNT value on done: 817030.0 [2024-08-06 06:37:55,498][52647] Sum rewards: 80.679, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.330', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.024', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.186', 'AMMO3': '0.299', 'WEAPON3': '1.800', 'weapon3': '3.542', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '70.000'} [2024-08-06 06:37:55,504][52664] DAMAGECOUNT value on done: 809429.0 [2024-08-06 06:37:55,504][52664] Sum rewards: 72.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.472', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon5': '0.192', 'AMMO4': '0.242', 'AMMO3': '0.269', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '60.000'} [2024-08-06 06:37:55,526][52663] DAMAGECOUNT value on done: 758773.0 [2024-08-06 06:37:55,527][52663] Sum rewards: 72.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO3': '0.134', 'weapon5': '0.138', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '0.850', 'weapon3': '3.098', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 06:37:55,641][52658] DAMAGECOUNT value on done: 771553.0 [2024-08-06 06:37:55,642][52658] Sum rewards: 86.891, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.946', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.442', 'weapon4': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '68.000'} [2024-08-06 06:37:56,007][52811] DAMAGECOUNT value on done: 718613.0 [2024-08-06 06:37:56,008][52811] Sum rewards: 68.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.895', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.072', 'weapon5': '0.132', 'AMMO4': '0.136', 'AMMO3': '0.210', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.390', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '57.000'} [2024-08-06 06:37:56,187][52669] DAMAGECOUNT value on done: 770553.0 [2024-08-06 06:37:56,188][52669] Sum rewards: 76.678, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.112', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.136', 'AMMO3': '0.215', 'weapon5': '0.218', 'AMMO4': '0.238', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '62.000'} [2024-08-06 06:37:56,484][52650] Updated weights for policy 0, policy_version 70301 (0.0022) [2024-08-06 06:37:57,039][52671] DAMAGECOUNT value on done: 773213.0 [2024-08-06 06:37:57,039][52671] Sum rewards: 82.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '67.000'} [2024-08-06 06:37:57,052][52666] DAMAGECOUNT value on done: 764388.0 [2024-08-06 06:37:57,052][52666] Sum rewards: 70.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.086', 'AMMO5': '0.018', 'AMMO2': '0.025', 'weapon5': '0.098', 'weapon4': '0.108', 'AMMO4': '0.125', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '60.000'} [2024-08-06 06:37:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 575922176. Throughput: 0: 4344.9. Samples: 143988950. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:37:57,795][52567] Avg episode reward: [(0, '75.111')] [2024-08-06 06:37:57,837][52670] DAMAGECOUNT value on done: 758512.0 [2024-08-06 06:37:57,838][52670] Sum rewards: 64.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.204', 'AMMO4': '0.207', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.612', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '53.000'} [2024-08-06 06:37:58,084][52647] DAMAGECOUNT value on done: 815039.0 [2024-08-06 06:37:58,085][52647] Sum rewards: 60.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.351', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'HITCOUNT': '2.910', 'weapon3': '3.460', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '53.000'} [2024-08-06 06:37:58,098][52664] DAMAGECOUNT value on done: 802365.0 [2024-08-06 06:37:58,099][52664] Sum rewards: 75.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.887', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.086', 'weapon5': '0.126', 'AMMO4': '0.143', 'weapon2': '0.192', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.386', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '61.000'} [2024-08-06 06:37:58,249][52663] DAMAGECOUNT value on done: 764399.0 [2024-08-06 06:37:58,250][52663] Sum rewards: 91.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.428', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.194', 'AMMO3': '0.212', 'weapon4': '0.230', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.848', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '22.461', 'FRAGCOUNT': '73.000'} [2024-08-06 06:37:58,306][52665] DAMAGECOUNT value on done: 760327.0 [2024-08-06 06:37:58,308][52665] Sum rewards: 77.403, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.124', 'AMMO4': '0.160', 'weapon4': '0.160', 'AMMO3': '0.202', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '63.000'} [2024-08-06 06:37:58,517][52658] DAMAGECOUNT value on done: 780028.0 [2024-08-06 06:37:58,517][52658] Sum rewards: 80.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.080', 'AMMO3': '0.180', 'weapon5': '0.264', 'AMMO4': '0.275', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '65.000'} [2024-08-06 06:37:58,893][52669] DAMAGECOUNT value on done: 770883.0 [2024-08-06 06:37:58,894][52669] Sum rewards: 84.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.146', 'weapon4': '0.158', 'AMMO3': '0.179', 'AMMO4': '0.229', 'weapon2': '0.246', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '70.000'} [2024-08-06 06:37:59,026][52811] DAMAGECOUNT value on done: 727028.0 [2024-08-06 06:37:59,026][52811] Sum rewards: 76.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.753', 'AMMO5': '0.013', 'ARMOR': '0.028', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.208', 'weapon4': '0.216', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '2.922', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '63.000'} [2024-08-06 06:37:59,850][52671] DAMAGECOUNT value on done: 762205.0 [2024-08-06 06:37:59,850][52671] Sum rewards: 75.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.145', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon2': '0.228', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.340', 'weapon3': '3.352', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:00,220][52666] DAMAGECOUNT value on done: 766692.0 [2024-08-06 06:38:00,220][52666] Sum rewards: 85.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.765', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.098', 'AMMO4': '0.171', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '71.000'} [2024-08-06 06:38:00,658][52647] DAMAGECOUNT value on done: 817943.0 [2024-08-06 06:38:00,659][52647] Sum rewards: 76.422, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.281', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon4': '0.162', 'AMMO3': '0.208', 'weapon5': '0.210', 'AMMO4': '0.306', 'weapon2': '0.334', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:00,692][52663] DAMAGECOUNT value on done: 774727.0 [2024-08-06 06:38:00,694][52663] Sum rewards: 72.304, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-4.145', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.146', 'AMMO4': '0.169', 'weapon2': '0.184', 'AMMO3': '0.237', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.948', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:00,721][52664] DAMAGECOUNT value on done: 793434.0 [2024-08-06 06:38:00,722][52664] Sum rewards: 73.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon2': '0.244', 'AMMO3': '0.292', 'WEAPON3': '1.800', 'HITCOUNT': '3.440', 'weapon3': '3.492', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '65.000'} [2024-08-06 06:38:00,848][52665] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:38:01,142][52670] DAMAGECOUNT value on done: 755923.0 [2024-08-06 06:38:01,143][52670] Sum rewards: 71.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.435', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.122', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.202', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '58.000'} [2024-08-06 06:38:01,196][52669] DAMAGECOUNT value on done: 772017.0 [2024-08-06 06:38:01,197][52669] Sum rewards: 72.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.538', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.196', 'AMMO4': '0.213', 'weapon2': '0.234', 'weapon5': '0.234', 'weapon4': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:01,495][52665] DAMAGECOUNT value on done: 752058.0 [2024-08-06 06:38:01,496][52665] Sum rewards: 81.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.231', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.296', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '68.000'} [2024-08-06 06:38:01,505][52650] Updated weights for policy 0, policy_version 70311 (0.0032) [2024-08-06 06:38:01,585][52658] DAMAGECOUNT value on done: 767250.0 [2024-08-06 06:38:01,585][52658] Sum rewards: 76.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.118', 'weapon4': '0.124', 'AMMO3': '0.201', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.726', 'WEAPON3': '1.200', 'weapon3': '2.772', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:01,699][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:38:02,057][52811] DAMAGECOUNT value on done: 721982.0 [2024-08-06 06:38:02,057][52811] Sum rewards: 89.241, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.165', 'AMMO3': '0.175', 'weapon5': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.234', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '72.000'} [2024-08-06 06:38:02,536][52671] DAMAGECOUNT value on done: 772112.0 [2024-08-06 06:38:02,538][52671] Sum rewards: 72.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.080', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:02,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 576012288. Throughput: 0: 4347.4. Samples: 144002190. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:02,794][52567] Avg episode reward: [(0, '75.174')] [2024-08-06 06:38:03,308][52666] DAMAGECOUNT value on done: 764459.0 [2024-08-06 06:38:03,309][52666] Sum rewards: 64.488, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.436', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.090', 'weapon5': '0.112', 'AMMO3': '0.227', 'AMMO4': '0.283', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.250', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '55.000'} [2024-08-06 06:38:03,392][52663] DAMAGECOUNT value on done: 758090.0 [2024-08-06 06:38:03,394][52663] Sum rewards: 78.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.997', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.132', 'AMMO3': '0.205', 'weapon5': '0.210', 'AMMO4': '0.244', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '65.000'} [2024-08-06 06:38:03,541][52647] DAMAGECOUNT value on done: 795708.0 [2024-08-06 06:38:03,541][52647] Sum rewards: 73.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.098', 'AMMO4': '0.120', 'AMMO3': '0.227', 'weapon5': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.688', 'WEAPON3': '1.400', 'weapon3': '2.620', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:03,636][52664] DAMAGECOUNT value on done: 795222.0 [2024-08-06 06:38:03,637][52664] Sum rewards: 79.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.935', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.046', 'AMMO4': '0.149', 'AMMO3': '0.157', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:03,700][52669] DAMAGECOUNT value on done: 780921.0 [2024-08-06 06:38:03,700][52669] Sum rewards: 71.711, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.584', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:04,100][52665] DAMAGECOUNT value on done: 757146.0 [2024-08-06 06:38:04,101][52665] Sum rewards: 84.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon4': '0.070', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.976', 'FRAGCOUNT': '68.000'} [2024-08-06 06:38:04,144][52670] DAMAGECOUNT value on done: 767004.0 [2024-08-06 06:38:04,144][52670] Sum rewards: 71.656, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.032', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.175', 'weapon2': '0.484', 'WEAPON3': '1.100', 'HITCOUNT': '3.270', 'weapon3': '3.336', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:05,008][52658] DAMAGECOUNT value on done: 774731.0 [2024-08-06 06:38:05,010][52658] Sum rewards: 81.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.997', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.180', 'weapon5': '0.190', 'AMMO3': '0.202', 'AMMO4': '0.202', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '66.000'} [2024-08-06 06:38:05,327][52811] DAMAGECOUNT value on done: 713794.0 [2024-08-06 06:38:05,327][52811] Sum rewards: 81.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.860', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.154', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:05,398][52671] DAMAGECOUNT value on done: 773188.0 [2024-08-06 06:38:05,398][52671] Sum rewards: 83.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.162', 'AMMO3': '0.215', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '68.000'} [2024-08-06 06:38:05,977][52650] Updated weights for policy 0, policy_version 70321 (0.0014) [2024-08-06 06:38:06,077][52666] DAMAGECOUNT value on done: 759228.0 [2024-08-06 06:38:06,079][52666] Sum rewards: 79.909, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.244', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.175', 'weapon5': '0.226', 'AMMO4': '0.248', 'weapon2': '0.288', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:06,179][52663] DAMAGECOUNT value on done: 754399.0 [2024-08-06 06:38:06,179][52663] Sum rewards: 76.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.874', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.178', 'weapon4': '0.192', 'AMMO4': '0.195', 'AMMO3': '0.210', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:06,537][52669] DAMAGECOUNT value on done: 772262.0 [2024-08-06 06:38:06,538][52669] Sum rewards: 71.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.160', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.252', 'WEAPON3': '1.600', 'weapon3': '3.434', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:06,696][52670] DAMAGECOUNT value on done: 761537.0 [2024-08-06 06:38:06,697][52670] Sum rewards: 58.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.167', 'AMMO4': '0.218', 'weapon5': '0.280', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.404', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '48.500'} [2024-08-06 06:38:06,785][52647] DAMAGECOUNT value on done: 811354.0 [2024-08-06 06:38:06,785][52647] Sum rewards: 57.531, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.801', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.146', 'AMMO3': '0.168', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.150', 'HITCOUNT': '2.800', 'weapon3': '2.958', 'DAMAGECOUNT': '12.873', 'FRAGCOUNT': '47.000'} [2024-08-06 06:38:06,982][52664] DAMAGECOUNT value on done: 796660.0 [2024-08-06 06:38:06,982][52664] Sum rewards: 73.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.219', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:07,250][52665] DAMAGECOUNT value on done: 760093.0 [2024-08-06 06:38:07,252][52665] Sum rewards: 83.585, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.092', 'weapon4': '0.166', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 576094208. Throughput: 0: 4347.1. Samples: 144028280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:07,794][52567] Avg episode reward: [(0, '75.345')] [2024-08-06 06:38:07,906][52658] DAMAGECOUNT value on done: 764317.0 [2024-08-06 06:38:07,906][52658] Sum rewards: 72.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.198', 'AMMO3': '0.207', 'AMMO4': '0.224', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.220', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:07,980][52671] DAMAGECOUNT value on done: 770875.0 [2024-08-06 06:38:07,981][52671] Sum rewards: 66.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.716', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '54.000'} [2024-08-06 06:38:08,378][52811] DAMAGECOUNT value on done: 722986.0 [2024-08-06 06:38:08,378][52811] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.957', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.038', 'AMMO4': '0.063', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '58.000'} [2024-08-06 06:38:08,853][52666] DAMAGECOUNT value on done: 763176.0 [2024-08-06 06:38:08,854][52666] Sum rewards: 58.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.750', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.238', 'AMMO3': '0.255', 'AMMO4': '0.263', 'weapon5': '0.322', 'weapon2': '0.384', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.668', 'HITCOUNT': '2.740', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '51.000'} [2024-08-06 06:38:09,010][52663] DAMAGECOUNT value on done: 761141.0 [2024-08-06 06:38:09,010][52663] Sum rewards: 67.495, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.139', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.090', 'weapon5': '0.144', 'AMMO3': '0.210', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.934', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '56.000'} [2024-08-06 06:38:09,333][52647] DAMAGECOUNT value on done: 808649.0 [2024-08-06 06:38:09,333][52647] Sum rewards: 73.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.150', 'AMMO4': '0.202', 'weapon2': '0.236', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:09,362][52669] DAMAGECOUNT value on done: 773718.0 [2024-08-06 06:38:09,363][52669] Sum rewards: 73.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.128', 'AMMO4': '0.169', 'weapon5': '0.180', 'AMMO3': '0.232', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.206', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:09,454][52664] DAMAGECOUNT value on done: 793827.0 [2024-08-06 06:38:09,454][52664] Sum rewards: 79.009, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.638', 'AMMO5': '0.013', 'AMMO2': '0.053', 'AMMO3': '0.166', 'weapon5': '0.184', 'weapon4': '0.222', 'weapon2': '0.226', 'AMMO4': '0.265', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:09,628][52670] DAMAGECOUNT value on done: 754899.0 [2024-08-06 06:38:09,628][52670] Sum rewards: 64.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.958', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.240', 'weapon3': '3.252', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '54.000'} [2024-08-06 06:38:10,511][52820] DAMAGECOUNT value on done: 710523.0 [2024-08-06 06:38:10,513][52820] Sum rewards: 61.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.310', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.112', 'weapon4': '0.144', 'AMMO3': '0.212', 'AMMO4': '0.233', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '52.500'} [2024-08-06 06:38:10,593][52658] DAMAGECOUNT value on done: 774236.0 [2024-08-06 06:38:10,595][52658] Sum rewards: 82.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.986', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.082', 'AMMO4': '0.106', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '3.210', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '65.000'} [2024-08-06 06:38:10,632][52671] DAMAGECOUNT value on done: 778940.0 [2024-08-06 06:38:10,633][52671] Sum rewards: 65.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.436', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '55.000'} [2024-08-06 06:38:10,718][52650] Updated weights for policy 0, policy_version 70331 (0.0014) [2024-08-06 06:38:11,727][52811] DAMAGECOUNT value on done: 721774.0 [2024-08-06 06:38:11,731][52811] Sum rewards: 81.842, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.165', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.078', 'AMMO4': '0.100', 'weapon2': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.296', 'WEAPON3': '1.800', 'weapon3': '3.508', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '71.000'} [2024-08-06 06:38:11,743][52647] DAMAGECOUNT value on done: 806248.0 [2024-08-06 06:38:11,744][52647] Sum rewards: 60.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.955', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.096', 'weapon5': '0.144', 'AMMO3': '0.189', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.646', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '50.000'} [2024-08-06 06:38:11,847][52666] DAMAGECOUNT value on done: 760628.0 [2024-08-06 06:38:11,848][52666] Sum rewards: 70.685, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.235', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO4': '0.145', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON3': '0.950', 'HITCOUNT': '3.150', 'weapon3': '3.174', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '56.000'} [2024-08-06 06:38:12,051][52663] DAMAGECOUNT value on done: 761225.0 [2024-08-06 06:38:12,051][52663] Sum rewards: 79.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.396', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.068', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:12,358][52669] DAMAGECOUNT value on done: 780036.0 [2024-08-06 06:38:12,360][52669] Sum rewards: 76.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.154', 'AMMO3': '0.171', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'weapon4': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:12,541][52670] DAMAGECOUNT value on done: 758927.0 [2024-08-06 06:38:12,541][52670] Sum rewards: 74.070, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.811', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.086', 'AMMO4': '0.108', 'weapon5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.324', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 576192512. Throughput: 0: 4349.3. Samples: 144054290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:12,802][52567] Avg episode reward: [(0, '74.983')] [2024-08-06 06:38:13,486][52658] DAMAGECOUNT value on done: 756574.0 [2024-08-06 06:38:13,486][52658] Sum rewards: 60.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.832', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon4': '0.134', 'weapon5': '0.192', 'AMMO3': '0.256', 'AMMO4': '0.282', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.910', 'weapon3': '3.090', 'DAMAGECOUNT': '15.579', 'FRAGCOUNT': '52.000'} [2024-08-06 06:38:13,669][52671] DAMAGECOUNT value on done: 772984.0 [2024-08-06 06:38:13,670][52671] Sum rewards: 75.989, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.080', 'weapon5': '0.204', 'AMMO4': '0.217', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.550', 'weapon3': '2.986', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:13,742][52820] DAMAGECOUNT value on done: 712597.0 [2024-08-06 06:38:13,745][52820] Sum rewards: 76.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.645', 'AMMO2': '0.026', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'weapon4': '0.242', 'AMMO3': '0.246', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:13,971][52795] DAMAGECOUNT value on done: 715274.0 [2024-08-06 06:38:13,972][52795] Sum rewards: 79.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.082', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO4': '0.148', 'weapon5': '0.176', 'AMMO3': '0.219', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '65.000'} [2024-08-06 06:38:14,384][52647] DAMAGECOUNT value on done: 798991.0 [2024-08-06 06:38:14,384][52647] Sum rewards: 67.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.982', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.183', 'AMMO4': '0.199', 'weapon5': '0.228', 'weapon4': '0.288', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '54.000'} [2024-08-06 06:38:14,818][52666] DAMAGECOUNT value on done: 755570.0 [2024-08-06 06:38:14,819][52666] Sum rewards: 75.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.180', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.238', 'AMMO4': '0.272', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '65.000'} [2024-08-06 06:38:14,819][52811] DAMAGECOUNT value on done: 722587.0 [2024-08-06 06:38:14,821][52811] Sum rewards: 83.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'AMMO5': '0.009', 'weapon4': '0.034', 'weapon5': '0.040', 'AMMO2': '0.045', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'weapon2': '0.232', 'AMMO3': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.480', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '70.000'} [2024-08-06 06:38:15,143][52663] DAMAGECOUNT value on done: 773278.0 [2024-08-06 06:38:15,143][52663] Sum rewards: 77.205, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.310', 'HEALTH': '0.530', 'WEAPON3': '0.850', 'weapon3': '3.204', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:15,272][52650] Updated weights for policy 0, policy_version 70341 (0.0027) [2024-08-06 06:38:15,392][52670] DAMAGECOUNT value on done: 759710.0 [2024-08-06 06:38:15,392][52670] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.105', 'AMMO2': '0.009', 'AMMO4': '0.047', 'AMMO3': '0.166', 'weapon2': '0.446', 'WEAPON3': '1.050', 'HITCOUNT': '3.180', 'weapon3': '3.482', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:15,445][52669] DAMAGECOUNT value on done: 764311.0 [2024-08-06 06:38:15,445][52669] Sum rewards: 75.234, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.146', 'AMMO3': '0.165', 'AMMO4': '0.179', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.210', 'weapon3': '3.372', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:16,467][52671] DAMAGECOUNT value on done: 759211.0 [2024-08-06 06:38:16,467][52671] Sum rewards: 78.071, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.450', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'AMMO4': '0.160', 'weapon2': '0.398', 'WEAPON3': '1.000', 'weapon3': '3.196', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:16,535][52658] DAMAGECOUNT value on done: 775281.0 [2024-08-06 06:38:16,536][52658] Sum rewards: 79.365, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.970', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.132', 'weapon4': '0.200', 'weapon2': '0.206', 'WEAPON5': '0.250', 'AMMO4': '0.262', 'AMMO3': '0.274', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.156', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '69.000'} [2024-08-06 06:38:16,833][52647] DAMAGECOUNT value on done: 816899.0 [2024-08-06 06:38:16,835][52647] Sum rewards: 79.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.972', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.153', 'weapon5': '0.172', 'AMMO3': '0.239', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '66.000'} [2024-08-06 06:38:16,898][52820] DAMAGECOUNT value on done: 713082.0 [2024-08-06 06:38:16,900][52820] Sum rewards: 72.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.026', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.219', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.444', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:17,059][52795] DAMAGECOUNT value on done: 701785.0 [2024-08-06 06:38:17,060][52795] Sum rewards: 83.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.524', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.101', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'weapon2': '0.706', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '69.000'} [2024-08-06 06:38:17,453][52666] DAMAGECOUNT value on done: 765128.0 [2024-08-06 06:38:17,454][52666] Sum rewards: 59.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.704', 'AMMO5': '0.024', 'AMMO2': '0.042', 'AMMO3': '0.139', 'AMMO4': '0.212', 'weapon4': '0.260', 'weapon5': '0.314', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.728', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.745', 'FRAGCOUNT': '48.500'} [2024-08-06 06:38:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 576266240. Throughput: 0: 4360.7. Samples: 144067480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:17,794][52567] Avg episode reward: [(0, '74.814')] [2024-08-06 06:38:17,873][52811] DAMAGECOUNT value on done: 727556.0 [2024-08-06 06:38:17,873][52811] Sum rewards: 80.983, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.166', 'AMMO3': '0.190', 'weapon5': '0.210', 'weapon4': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:18,083][52668] DAMAGECOUNT value on done: 770842.0 [2024-08-06 06:38:18,083][52668] Sum rewards: 75.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon5': '0.014', 'weapon4': '0.014', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.430', 'weapon3': '3.566', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '66.000'} [2024-08-06 06:38:18,097][52670] DAMAGECOUNT value on done: 753839.0 [2024-08-06 06:38:18,097][52670] Sum rewards: 84.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.893', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.096', 'weapon5': '0.158', 'AMMO4': '0.189', 'AMMO3': '0.205', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '69.000'} [2024-08-06 06:38:18,265][52663] DAMAGECOUNT value on done: 765534.0 [2024-08-06 06:38:18,265][52663] Sum rewards: 80.630, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.595', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.092', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.618', 'WEAPON3': '0.950', 'weapon3': '3.082', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:18,453][52669] DAMAGECOUNT value on done: 765282.0 [2024-08-06 06:38:18,456][52669] Sum rewards: 76.915, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.134', 'weapon5': '0.146', 'AMMO4': '0.152', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:19,089][52658] DAMAGECOUNT value on done: 765069.0 [2024-08-06 06:38:19,090][52658] Sum rewards: 71.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:19,722][52671] DAMAGECOUNT value on done: 778965.0 [2024-08-06 06:38:19,723][52671] Sum rewards: 72.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.208', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.156', 'AMMO3': '0.226', 'AMMO4': '0.229', 'weapon5': '0.304', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.780', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:19,814][52647] DAMAGECOUNT value on done: 800469.0 [2024-08-06 06:38:19,815][52647] Sum rewards: 68.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.775', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:19,986][52666] DAMAGECOUNT value on done: 758498.0 [2024-08-06 06:38:19,986][52666] Sum rewards: 75.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.046', 'weapon4': '0.052', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.400', 'weapon3': '3.458', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:20,079][52820] DAMAGECOUNT value on done: 704078.0 [2024-08-06 06:38:20,081][52820] Sum rewards: 67.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.236', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon2': '0.212', 'weapon5': '0.216', 'AMMO3': '0.225', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 06:38:20,194][52795] DAMAGECOUNT value on done: 703302.0 [2024-08-06 06:38:20,196][52795] Sum rewards: 71.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.179', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.235', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:20,435][52670] DAMAGECOUNT value on done: 768527.0 [2024-08-06 06:38:20,436][52670] Sum rewards: 75.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.038', 'weapon5': '0.128', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:20,449][52650] Updated weights for policy 0, policy_version 70351 (0.0022) [2024-08-06 06:38:20,932][52663] DAMAGECOUNT value on done: 769059.0 [2024-08-06 06:38:20,934][52663] Sum rewards: 72.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.501', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.198', 'weapon2': '0.198', 'weapon5': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.208', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:20,951][52811] DAMAGECOUNT value on done: 720581.0 [2024-08-06 06:38:20,953][52811] Sum rewards: 74.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.254', 'WEAPON3': '1.100', 'HITCOUNT': '3.460', 'weapon3': '3.578', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:21,114][52668] DAMAGECOUNT value on done: 775457.0 [2024-08-06 06:38:21,115][52668] Sum rewards: 79.940, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.930', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.114', 'AMMO4': '0.180', 'AMMO3': '0.241', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:21,285][52669] DAMAGECOUNT value on done: 770931.0 [2024-08-06 06:38:21,287][52669] Sum rewards: 72.828, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.774', 'ARMOR': '0.008', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.177', 'weapon4': '0.218', 'weapon5': '0.252', 'AMMO3': '0.266', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '62.500'} [2024-08-06 06:38:22,059][52671] DAMAGECOUNT value on done: 777332.0 [2024-08-06 06:38:22,059][52671] Sum rewards: 76.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.402', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:22,079][52658] DAMAGECOUNT value on done: 764227.0 [2024-08-06 06:38:22,079][52658] Sum rewards: 90.242, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.582', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.046', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.238', 'WEAPON3': '1.150', 'weapon3': '3.450', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.189', 'FRAGCOUNT': '73.000'} [2024-08-06 06:38:22,553][52647] DAMAGECOUNT value on done: 811328.0 [2024-08-06 06:38:22,554][52647] Sum rewards: 74.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.136', 'AMMO4': '0.175', 'weapon5': '0.186', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:22,794][52567] Fps is (10 sec: 15564.9, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 576348160. Throughput: 0: 4366.4. Samples: 144093890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:22,794][52567] Avg episode reward: [(0, '74.711')] [2024-08-06 06:38:22,889][52666] DAMAGECOUNT value on done: 766695.0 [2024-08-06 06:38:22,889][52666] Sum rewards: 72.927, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.485', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.168', 'AMMO4': '0.170', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.128', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:23,276][52795] DAMAGECOUNT value on done: 712719.0 [2024-08-06 06:38:23,277][52795] Sum rewards: 77.935, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.890', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.136', 'weapon4': '0.154', 'AMMO4': '0.172', 'weapon5': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:23,314][52820] DAMAGECOUNT value on done: 716388.0 [2024-08-06 06:38:23,314][52820] Sum rewards: 78.897, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.506', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.159', 'AMMO4': '0.238', 'weapon5': '0.282', 'weapon2': '0.456', 'weapon4': '0.498', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.428', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:23,449][52670] DAMAGECOUNT value on done: 751698.0 [2024-08-06 06:38:23,450][52670] Sum rewards: 67.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.192', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.090', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '55.000'} [2024-08-06 06:38:23,930][52668] DAMAGECOUNT value on done: 771119.0 [2024-08-06 06:38:23,930][52668] Sum rewards: 70.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.070', 'AMMO4': '0.202', 'weapon5': '0.204', 'AMMO3': '0.215', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:24,073][52811] DAMAGECOUNT value on done: 717855.0 [2024-08-06 06:38:24,075][52811] Sum rewards: 83.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.425', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.223', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.320', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '69.000'} [2024-08-06 06:38:24,303][52663] DAMAGECOUNT value on done: 774144.0 [2024-08-06 06:38:24,305][52663] Sum rewards: 80.339, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.314', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.121', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:24,328][52650] Updated weights for policy 0, policy_version 70361 (0.0011) [2024-08-06 06:38:24,443][52671] DAMAGECOUNT value on done: 774065.0 [2024-08-06 06:38:24,443][52671] Sum rewards: 67.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.352', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.206', 'weapon2': '0.210', 'AMMO3': '0.243', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:24,590][52669] DAMAGECOUNT value on done: 791093.0 [2024-08-06 06:38:24,590][52669] Sum rewards: 79.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.090', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.169', 'weapon5': '0.182', 'AMMO3': '0.233', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '66.000'} [2024-08-06 06:38:25,173][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:38:25,218][52658] DAMAGECOUNT value on done: 772259.0 [2024-08-06 06:38:25,219][52658] Sum rewards: 81.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.935', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.154', 'AMMO4': '0.194', 'weapon4': '0.194', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '65.500'} [2024-08-06 06:38:25,480][52666] DAMAGECOUNT value on done: 753805.0 [2024-08-06 06:38:25,481][52666] Sum rewards: 69.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.980', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.072', 'AMMO4': '0.168', 'weapon2': '0.266', 'AMMO3': '0.276', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.982', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '58.500'} [2024-08-06 06:38:25,512][52647] DAMAGECOUNT value on done: 813701.0 [2024-08-06 06:38:25,512][52647] Sum rewards: 87.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.255', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.061', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.332', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '22.338', 'FRAGCOUNT': '70.000'} [2024-08-06 06:38:26,043][52670] DAMAGECOUNT value on done: 763011.0 [2024-08-06 06:38:26,044][52670] Sum rewards: 89.599, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.380', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.134', 'AMMO3': '0.160', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '70.000'} [2024-08-06 06:38:26,577][52795] DAMAGECOUNT value on done: 703963.0 [2024-08-06 06:38:26,578][52795] Sum rewards: 66.734, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.118', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.158', 'AMMO4': '0.195', 'weapon5': '0.232', 'AMMO3': '0.255', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.956', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:26,651][52820] DAMAGECOUNT value on done: 698852.0 [2024-08-06 06:38:26,652][52820] Sum rewards: 64.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.554', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '55.000'} [2024-08-06 06:38:27,217][52811] DAMAGECOUNT value on done: 714663.0 [2024-08-06 06:38:27,220][52811] Sum rewards: 77.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.303', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.148', 'AMMO3': '0.191', 'AMMO4': '0.224', 'weapon4': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:27,278][52671] DAMAGECOUNT value on done: 777322.0 [2024-08-06 06:38:27,281][52671] Sum rewards: 74.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.109', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO4': '0.195', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.234', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '60.500'} [2024-08-06 06:38:27,309][52668] DAMAGECOUNT value on done: 778417.0 [2024-08-06 06:38:27,309][52668] Sum rewards: 77.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.148', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:27,340][52663] DAMAGECOUNT value on done: 761579.0 [2024-08-06 06:38:27,340][52663] Sum rewards: 67.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.183', 'weapon2': '0.212', 'weapon5': '0.226', 'AMMO4': '0.293', 'weapon4': '0.482', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '56.000'} [2024-08-06 06:38:27,534][52669] DAMAGECOUNT value on done: 779123.0 [2024-08-06 06:38:27,535][52669] Sum rewards: 70.667, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.146', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.038', 'weapon5': '0.096', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.262', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.454', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 576446464. Throughput: 0: 4368.5. Samples: 144120100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:27,794][52567] Avg episode reward: [(0, '74.666')] [2024-08-06 06:38:27,804][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070367_576446464.pth... [2024-08-06 06:38:27,938][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000069857_572268544.pth [2024-08-06 06:38:28,192][52647] DAMAGECOUNT value on done: 799769.0 [2024-08-06 06:38:28,193][52647] Sum rewards: 74.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon2': '0.170', 'AMMO3': '0.230', 'weapon5': '0.232', 'AMMO4': '0.249', 'weapon4': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '60.500'} [2024-08-06 06:38:28,335][52666] DAMAGECOUNT value on done: 767190.0 [2024-08-06 06:38:28,337][52666] Sum rewards: 76.886, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.036', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.264', 'weapon2': '0.542', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '65.000'} [2024-08-06 06:38:28,805][52670] DAMAGECOUNT value on done: 769225.0 [2024-08-06 06:38:28,806][52670] Sum rewards: 73.546, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.199', 'weapon5': '0.202', 'AMMO4': '0.202', 'weapon4': '0.232', 'weapon2': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:29,509][52650] Updated weights for policy 0, policy_version 70371 (0.0020) [2024-08-06 06:38:29,797][52795] DAMAGECOUNT value on done: 710688.0 [2024-08-06 06:38:29,798][52795] Sum rewards: 69.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.018', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.106', 'weapon5': '0.178', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '56.000'} [2024-08-06 06:38:30,053][52820] DAMAGECOUNT value on done: 708354.0 [2024-08-06 06:38:30,055][52820] Sum rewards: 66.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.114', 'AMMO4': '0.124', 'weapon5': '0.172', 'weapon2': '0.198', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.290', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '56.000'} [2024-08-06 06:38:30,113][52669] DAMAGECOUNT value on done: 773542.0 [2024-08-06 06:38:30,115][52669] Sum rewards: 73.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.181', 'weapon2': '0.342', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.528', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:30,196][52803] DAMAGECOUNT value on done: 714031.0 [2024-08-06 06:38:30,198][52803] Sum rewards: 77.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.224', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.122', 'AMMO4': '0.152', 'weapon5': '0.158', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:30,345][52671] DAMAGECOUNT value on done: 768052.0 [2024-08-06 06:38:30,346][52671] Sum rewards: 80.120, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.790', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.084', 'AMMO4': '0.115', 'AMMO3': '0.128', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'WEAPON3': '0.850', 'weapon2': '1.100', 'weapon3': '2.524', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:30,390][52811] DAMAGECOUNT value on done: 717276.0 [2024-08-06 06:38:30,392][52811] Sum rewards: 78.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.604', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.101', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.318', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '65.000'} [2024-08-06 06:38:30,450][52668] DAMAGECOUNT value on done: 760715.0 [2024-08-06 06:38:30,451][52668] Sum rewards: 78.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.081', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.192', 'AMMO3': '0.202', 'weapon5': '0.212', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:30,624][52794] Large shaping reward 2.618 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0)] [2024-08-06 06:38:30,828][52647] DAMAGECOUNT value on done: 805274.0 [2024-08-06 06:38:30,829][52647] Sum rewards: 60.566, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.013', 'AMMO2': '0.047', 'HEALTH': '0.125', 'AMMO3': '0.167', 'weapon5': '0.208', 'AMMO4': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'weapon4': '0.372', 'WEAPON3': '0.950', 'HITCOUNT': '2.820', 'weapon3': '2.870', 'DAMAGECOUNT': '14.304', 'FRAGCOUNT': '48.000'} [2024-08-06 06:38:31,202][52666] DAMAGECOUNT value on done: 761854.0 [2024-08-06 06:38:31,202][52666] Sum rewards: 76.824, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.788', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.127', 'weapon5': '0.128', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.308', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:31,802][52670] DAMAGECOUNT value on done: 763198.0 [2024-08-06 06:38:31,806][52670] Sum rewards: 74.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.185', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:32,475][52662] DAMAGECOUNT value on done: 769973.0 [2024-08-06 06:38:32,475][52662] Sum rewards: 72.575, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.045', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.086', 'weapon5': '0.162', 'AMMO4': '0.231', 'AMMO3': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.664', 'WEAPON3': '1.500', 'weapon3': '2.820', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 576528384. Throughput: 0: 4355.4. Samples: 144132910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:32,794][52567] Avg episode reward: [(0, '74.303')] [2024-08-06 06:38:32,902][52795] DAMAGECOUNT value on done: 718871.0 [2024-08-06 06:38:32,902][52795] Sum rewards: 55.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.740', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.136', 'weapon5': '0.230', 'weapon2': '0.234', 'AMMO3': '0.245', 'AMMO4': '0.275', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.580', 'weapon3': '3.104', 'DAMAGECOUNT': '14.274', 'FRAGCOUNT': '48.000'} [2024-08-06 06:38:33,005][52669] DAMAGECOUNT value on done: 776557.0 [2024-08-06 06:38:33,007][52669] Sum rewards: 71.344, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.005', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.068', 'AMMO4': '0.078', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.532', 'WEAPON3': '0.850', 'weapon3': '2.940', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '55.000'} [2024-08-06 06:38:33,057][52668] DAMAGECOUNT value on done: 772895.0 [2024-08-06 06:38:33,058][52668] Sum rewards: 68.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.226', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.223', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.478', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '58.000'} [2024-08-06 06:38:33,153][52820] DAMAGECOUNT value on done: 711452.0 [2024-08-06 06:38:33,154][52820] Sum rewards: 73.746, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.157', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO3': '0.169', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.490', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:33,369][52803] DAMAGECOUNT value on done: 712381.0 [2024-08-06 06:38:33,369][52803] Sum rewards: 73.236, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.870', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.228', 'AMMO4': '0.271', 'AMMO3': '0.279', 'weapon2': '0.286', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.800', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:33,603][52811] DAMAGECOUNT value on done: 723648.0 [2024-08-06 06:38:33,605][52811] Sum rewards: 85.861, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.048', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.144', 'AMMO3': '0.241', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.177', 'FRAGCOUNT': '72.000'} [2024-08-06 06:38:34,002][52647] DAMAGECOUNT value on done: 795009.0 [2024-08-06 06:38:34,002][52647] Sum rewards: 75.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.173', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:34,084][52650] Updated weights for policy 0, policy_version 70381 (0.0025) [2024-08-06 06:38:34,393][52666] DAMAGECOUNT value on done: 761440.0 [2024-08-06 06:38:34,397][52666] Sum rewards: 77.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.714', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.092', 'weapon5': '0.182', 'AMMO3': '0.208', 'AMMO4': '0.222', 'weapon2': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '65.500'} [2024-08-06 06:38:35,051][52670] DAMAGECOUNT value on done: 745462.0 [2024-08-06 06:38:35,051][52670] Sum rewards: 62.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.604', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon4': '0.136', 'AMMO4': '0.141', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon5': '0.376', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '52.500'} [2024-08-06 06:38:35,290][52662] DAMAGECOUNT value on done: 777994.0 [2024-08-06 06:38:35,292][52662] Sum rewards: 70.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:35,519][52669] DAMAGECOUNT value on done: 781208.0 [2024-08-06 06:38:35,519][52669] Sum rewards: 73.221, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.160', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.104', 'AMMO4': '0.190', 'weapon5': '0.190', 'AMMO3': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '60.500'} [2024-08-06 06:38:35,729][52670] Large shaping reward -2.507 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.258, -86.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:38:36,145][52795] DAMAGECOUNT value on done: 708609.0 [2024-08-06 06:38:36,146][52795] Sum rewards: 78.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.274', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.090', 'weapon5': '0.094', 'AMMO4': '0.131', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:36,152][52820] DAMAGECOUNT value on done: 712489.0 [2024-08-06 06:38:36,153][52820] Sum rewards: 70.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.165', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.066', 'weapon4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.248', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.394', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '58.000'} [2024-08-06 06:38:36,273][52668] DAMAGECOUNT value on done: 775276.0 [2024-08-06 06:38:36,273][52668] Sum rewards: 79.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.094', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.148', 'AMMO3': '0.168', 'AMMO4': '0.206', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:36,548][52803] DAMAGECOUNT value on done: 719650.0 [2024-08-06 06:38:36,548][52803] Sum rewards: 69.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon2': '0.178', 'AMMO3': '0.193', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.536', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:36,679][52811] DAMAGECOUNT value on done: 724145.0 [2024-08-06 06:38:36,680][52811] Sum rewards: 71.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.680', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.148', 'weapon4': '0.174', 'AMMO3': '0.237', 'AMMO4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:36,702][52647] DAMAGECOUNT value on done: 802057.0 [2024-08-06 06:38:36,702][52647] Sum rewards: 45.121, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.744', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.110', 'weapon5': '0.208', 'AMMO4': '0.211', 'AMMO3': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.850', 'HITCOUNT': '2.620', 'weapon3': '2.856', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '44.000'} [2024-08-06 06:38:37,373][52666] DAMAGECOUNT value on done: 755669.0 [2024-08-06 06:38:37,373][52666] Sum rewards: 55.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.118', 'AMMO4': '0.179', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.100', 'HITCOUNT': '2.790', 'weapon3': '2.942', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '47.000'} [2024-08-06 06:38:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 576626688. Throughput: 0: 4360.5. Samples: 144159120. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:37,794][52567] Avg episode reward: [(0, '73.770')] [2024-08-06 06:38:38,068][52670] DAMAGECOUNT value on done: 758101.0 [2024-08-06 06:38:38,079][52670] Sum rewards: 67.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.058', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.102', 'weapon5': '0.106', 'AMMO4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '56.500'} [2024-08-06 06:38:38,100][52662] DAMAGECOUNT value on done: 779538.0 [2024-08-06 06:38:38,100][52662] Sum rewards: 81.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.692', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.104', 'AMMO4': '0.151', 'weapon2': '0.206', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.428', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '66.000'} [2024-08-06 06:38:39,016][52650] Updated weights for policy 0, policy_version 70391 (0.0013) [2024-08-06 06:38:39,073][52668] DAMAGECOUNT value on done: 764586.0 [2024-08-06 06:38:39,074][52668] Sum rewards: 62.174, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.118', 'AMMO4': '0.158', 'AMMO3': '0.205', 'weapon2': '0.212', 'weapon4': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.216', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '54.000'} [2024-08-06 06:38:39,249][52795] DAMAGECOUNT value on done: 710350.0 [2024-08-06 06:38:39,250][52795] Sum rewards: 66.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '56.000'} [2024-08-06 06:38:39,270][52820] DAMAGECOUNT value on done: 721552.0 [2024-08-06 06:38:39,270][52820] Sum rewards: 71.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.766', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.187', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '58.000'} [2024-08-06 06:38:39,648][52803] DAMAGECOUNT value on done: 720030.0 [2024-08-06 06:38:39,652][52803] Sum rewards: 77.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.087', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:39,763][52811] DAMAGECOUNT value on done: 717035.0 [2024-08-06 06:38:39,766][52811] Sum rewards: 68.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.032', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.183', 'weapon2': '0.288', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.568', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '55.000'} [2024-08-06 06:38:40,499][52666] DAMAGECOUNT value on done: 759696.0 [2024-08-06 06:38:40,501][52666] Sum rewards: 77.554, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.369', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.169', 'AMMO4': '0.170', 'weapon5': '0.200', 'weapon4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:41,143][52670] DAMAGECOUNT value on done: 767553.0 [2024-08-06 06:38:41,145][52670] Sum rewards: 79.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.046', 'AMMO4': '0.064', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.484', 'WEAPON3': '0.950', 'weapon3': '3.212', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:41,355][52662] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('weapon3', 0.002)] [2024-08-06 06:38:41,470][52662] DAMAGECOUNT value on done: 763248.0 [2024-08-06 06:38:41,471][52662] Sum rewards: 83.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '68.000'} [2024-08-06 06:38:41,626][52668] DAMAGECOUNT value on done: 764482.0 [2024-08-06 06:38:41,627][52668] Sum rewards: 75.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.270', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.184', 'AMMO3': '0.185', 'AMMO4': '0.209', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.634', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:42,315][52795] DAMAGECOUNT value on done: 714269.0 [2024-08-06 06:38:42,315][52795] Sum rewards: 71.755, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.992', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.058', 'weapon5': '0.122', 'AMMO4': '0.165', 'AMMO3': '0.229', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:42,331][52820] DAMAGECOUNT value on done: 705718.0 [2024-08-06 06:38:42,333][52820] Sum rewards: 70.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.278', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.088', 'weapon5': '0.132', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:42,699][52803] DAMAGECOUNT value on done: 718278.0 [2024-08-06 06:38:42,699][52803] Sum rewards: 69.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.020', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.160', 'weapon5': '0.186', 'AMMO3': '0.192', 'AMMO4': '0.220', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '59.000'} [2024-08-06 06:38:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 576708608. Throughput: 0: 4363.1. Samples: 144185290. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:42,794][52567] Avg episode reward: [(0, '73.949')] [2024-08-06 06:38:42,916][52811] DAMAGECOUNT value on done: 718712.0 [2024-08-06 06:38:42,917][52811] Sum rewards: 78.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.901', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.235', 'weapon2': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.210', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:43,459][52666] DAMAGECOUNT value on done: 774746.0 [2024-08-06 06:38:43,467][52666] Sum rewards: 76.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.358', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.152', 'AMMO4': '0.179', 'weapon5': '0.182', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:43,477][52650] Updated weights for policy 0, policy_version 70401 (0.0016) [2024-08-06 06:38:44,136][52670] DAMAGECOUNT value on done: 762746.0 [2024-08-06 06:38:44,138][52670] Sum rewards: 74.415, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.040', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.084', 'AMMO3': '0.136', 'AMMO4': '0.141', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.792', 'WEAPON3': '0.950', 'weapon3': '2.836', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:44,320][52668] DAMAGECOUNT value on done: 772563.0 [2024-08-06 06:38:44,320][52668] Sum rewards: 79.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.514', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:44,337][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:38:44,544][52662] DAMAGECOUNT value on done: 780597.0 [2024-08-06 06:38:44,546][52662] Sum rewards: 78.701, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.078', 'weapon4': '0.080', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:45,436][52820] DAMAGECOUNT value on done: 714165.0 [2024-08-06 06:38:45,436][52820] Sum rewards: 80.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.154', 'weapon5': '0.188', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '66.000'} [2024-08-06 06:38:45,552][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:38:45,619][52795] DAMAGECOUNT value on done: 709068.0 [2024-08-06 06:38:45,619][52795] Sum rewards: 78.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.124', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.140', 'AMMO3': '0.167', 'AMMO4': '0.195', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '63.000'} [2024-08-06 06:38:45,902][52803] DAMAGECOUNT value on done: 717602.0 [2024-08-06 06:38:45,904][52803] Sum rewards: 74.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.813', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.064', 'AMMO4': '0.087', 'weapon5': '0.142', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:46,762][52666] DAMAGECOUNT value on done: 749754.0 [2024-08-06 06:38:46,763][52666] Sum rewards: 79.717, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.760', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.230', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:46,792][52668] DAMAGECOUNT value on done: 768105.0 [2024-08-06 06:38:46,797][52668] Sum rewards: 57.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.279', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO4': '0.176', 'weapon5': '0.196', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '2.820', 'weapon3': '3.094', 'DAMAGECOUNT': '14.382', 'FRAGCOUNT': '46.500'} [2024-08-06 06:38:47,244][52670] DAMAGECOUNT value on done: 765203.0 [2024-08-06 06:38:47,245][52670] Sum rewards: 68.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.039', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.149', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.370', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '56.500'} [2024-08-06 06:38:47,679][52662] DAMAGECOUNT value on done: 762728.0 [2024-08-06 06:38:47,682][52662] Sum rewards: 83.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.084', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 576790528. Throughput: 0: 4363.3. Samples: 144198540. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:47,794][52567] Avg episode reward: [(0, '73.855')] [2024-08-06 06:38:48,341][52650] Updated weights for policy 0, policy_version 70411 (0.0030) [2024-08-06 06:38:48,578][52820] DAMAGECOUNT value on done: 721658.0 [2024-08-06 06:38:48,581][52820] Sum rewards: 64.418, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.795', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.130', 'weapon2': '0.162', 'AMMO3': '0.172', 'AMMO4': '0.173', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.338', 'DAMAGECOUNT': '15.045', 'FRAGCOUNT': '52.000'} [2024-08-06 06:38:48,737][52795] DAMAGECOUNT value on done: 704612.0 [2024-08-06 06:38:48,737][52795] Sum rewards: 63.702, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.410', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.440', 'WEAPON3': '1.600', 'weapon3': '3.298', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '55.000'} [2024-08-06 06:38:48,874][52803] DAMAGECOUNT value on done: 709914.0 [2024-08-06 06:38:48,875][52803] Sum rewards: 67.969, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.810', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon5': '0.222', 'weapon4': '0.226', 'AMMO3': '0.302', 'AMMO4': '0.316', 'weapon2': '0.372', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.850', 'weapon3': '2.894', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:49,190][52666] DAMAGECOUNT value on done: 761097.0 [2024-08-06 06:38:49,192][52666] Sum rewards: 68.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.012', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.112', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:49,767][52668] DAMAGECOUNT value on done: 763027.0 [2024-08-06 06:38:49,768][52668] Sum rewards: 82.285, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.139', 'weapon5': '0.156', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '68.000'} [2024-08-06 06:38:50,596][52662] DAMAGECOUNT value on done: 771060.0 [2024-08-06 06:38:50,598][52662] Sum rewards: 76.193, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.068', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.104', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:51,758][52820] DAMAGECOUNT value on done: 714664.0 [2024-08-06 06:38:51,759][52820] Sum rewards: 79.317, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.960', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.097', 'weapon5': '0.182', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.610', 'WEAPON3': '1.450', 'weapon3': '2.882', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.415', 'FRAGCOUNT': '66.000'} [2024-08-06 06:38:51,889][52795] DAMAGECOUNT value on done: 706242.0 [2024-08-06 06:38:51,889][52795] Sum rewards: 73.180, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.780', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon5': '0.228', 'weapon4': '0.244', 'AMMO4': '0.270', 'AMMO3': '0.282', 'weapon2': '0.358', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.790', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '62.000'} [2024-08-06 06:38:52,026][52803] DAMAGECOUNT value on done: 708758.0 [2024-08-06 06:38:52,028][52803] Sum rewards: 75.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.122', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.090', 'weapon5': '0.092', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '61.000'} [2024-08-06 06:38:52,439][52668] DAMAGECOUNT value on done: 757100.0 [2024-08-06 06:38:52,439][52668] Sum rewards: 79.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.333', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.078', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.500'} [2024-08-06 06:38:52,720][52650] Updated weights for policy 0, policy_version 70421 (0.0022) [2024-08-06 06:38:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 576888832. Throughput: 0: 4364.9. Samples: 144224700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:52,795][52567] Avg episode reward: [(0, '73.583')] [2024-08-06 06:38:53,135][52662] DAMAGECOUNT value on done: 785348.0 [2024-08-06 06:38:53,135][52662] Sum rewards: 73.406, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO3': '0.173', 'AMMO4': '0.180', 'weapon4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '60.000'} [2024-08-06 06:38:53,902][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:38:54,291][52669] Large shaping reward 2.565 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.066, -22.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:38:55,025][52820] DAMAGECOUNT value on done: 717800.0 [2024-08-06 06:38:55,026][52820] Sum rewards: 66.259, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.500', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.112', 'AMMO4': '0.135', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:55,072][52795] DAMAGECOUNT value on done: 715521.0 [2024-08-06 06:38:55,072][52795] Sum rewards: 90.486, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.670', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.126', 'weapon2': '0.142', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.306', 'WEAPON3': '1.000', 'weapon3': '3.274', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '71.000'} [2024-08-06 06:38:55,162][52803] DAMAGECOUNT value on done: 712953.0 [2024-08-06 06:38:55,162][52803] Sum rewards: 88.194, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.683', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.164', 'AMMO3': '0.170', 'weapon5': '0.192', 'AMMO4': '0.247', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '70.000'} [2024-08-06 06:38:55,680][52668] DAMAGECOUNT value on done: 757084.0 [2024-08-06 06:38:55,681][52668] Sum rewards: 75.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.313', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.241', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '64.000'} [2024-08-06 06:38:55,921][52662] DAMAGECOUNT value on done: 770889.0 [2024-08-06 06:38:55,923][52662] Sum rewards: 63.439, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.939', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.106', 'weapon5': '0.116', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.152', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:57,726][52650] Updated weights for policy 0, policy_version 70431 (0.0016) [2024-08-06 06:38:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 576970752. Throughput: 0: 4368.9. Samples: 144250890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:38:57,794][52567] Avg episode reward: [(0, '73.854')] [2024-08-06 06:38:58,187][52795] DAMAGECOUNT value on done: 700097.0 [2024-08-06 06:38:58,187][52795] Sum rewards: 84.337, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '67.000'} [2024-08-06 06:38:58,260][52820] DAMAGECOUNT value on done: 713231.0 [2024-08-06 06:38:58,262][52820] Sum rewards: 66.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.332', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon2': '0.228', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.554', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '57.000'} [2024-08-06 06:38:58,269][52803] DAMAGECOUNT value on done: 713336.0 [2024-08-06 06:38:58,271][52803] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.770', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.096', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.328', 'WEAPON3': '2.000', 'weapon3': '3.412', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '68.000'} [2024-08-06 06:38:58,708][52668] DAMAGECOUNT value on done: 756162.0 [2024-08-06 06:38:58,711][52668] Sum rewards: 63.945, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.160', 'AMMO4': '0.242', 'weapon5': '0.250', 'WEAPON5': '0.400', 'weapon4': '0.428', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.506', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '51.000'} [2024-08-06 06:38:59,099][52662] DAMAGECOUNT value on done: 778339.0 [2024-08-06 06:38:59,108][52662] Sum rewards: 72.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.756', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.172', 'weapon5': '0.174', 'weapon2': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.422', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '58.000'} [2024-08-06 06:38:59,346][52660] DAMAGECOUNT value on done: 769766.0 [2024-08-06 06:38:59,346][52660] Sum rewards: 80.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.186', 'AMMO4': '0.266', 'weapon5': '0.270', 'weapon4': '0.286', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '63.000'} [2024-08-06 06:39:01,357][52803] DAMAGECOUNT value on done: 727166.0 [2024-08-06 06:39:01,358][52803] Sum rewards: 81.246, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.160', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon2': '0.196', 'weapon4': '0.226', 'weapon5': '0.232', 'AMMO4': '0.259', 'AMMO3': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.002', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '71.000'} [2024-08-06 06:39:01,364][52820] DAMAGECOUNT value on done: 715570.0 [2024-08-06 06:39:01,364][52820] Sum rewards: 73.940, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.339', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon2': '0.242', 'AMMO3': '0.307', 'WEAPON3': '1.850', 'weapon3': '3.448', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '66.000'} [2024-08-06 06:39:01,375][52795] DAMAGECOUNT value on done: 716499.0 [2024-08-06 06:39:01,377][52795] Sum rewards: 79.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.331', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.410', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '66.000'} [2024-08-06 06:39:01,696][52668] DAMAGECOUNT value on done: 766979.0 [2024-08-06 06:39:01,697][52668] Sum rewards: 67.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.462', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '56.000'} [2024-08-06 06:39:02,054][52662] DAMAGECOUNT value on done: 767610.0 [2024-08-06 06:39:02,054][52662] Sum rewards: 76.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.266', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.000'} [2024-08-06 06:39:02,147][52650] Updated weights for policy 0, policy_version 70441 (0.0031) [2024-08-06 06:39:02,339][52660] DAMAGECOUNT value on done: 759203.0 [2024-08-06 06:39:02,341][52660] Sum rewards: 78.871, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.529', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'AMMO3': '0.153', 'weapon5': '0.180', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '62.000'} [2024-08-06 06:39:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 577060864. Throughput: 0: 4366.9. Samples: 144263990. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:02,794][52567] Avg episode reward: [(0, '73.682')] [2024-08-06 06:39:04,258][52668] DAMAGECOUNT value on done: 770204.0 [2024-08-06 06:39:04,264][52668] Sum rewards: 75.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.904', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.035', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'weapon2': '0.180', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'weapon3': '3.446', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:04,268][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:39:04,506][52803] DAMAGECOUNT value on done: 717736.0 [2024-08-06 06:39:04,506][52803] Sum rewards: 78.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.774', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.106', 'AMMO3': '0.202', 'weapon2': '0.262', 'WEAPON3': '1.300', 'weapon3': '3.422', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:04,558][52662] DAMAGECOUNT value on done: 770105.0 [2024-08-06 06:39:04,559][52662] Sum rewards: 78.338, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.929', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.196', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:04,584][52795] DAMAGECOUNT value on done: 713980.0 [2024-08-06 06:39:04,584][52795] Sum rewards: 88.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.101', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '72.000'} [2024-08-06 06:39:04,602][52820] DAMAGECOUNT value on done: 727829.0 [2024-08-06 06:39:04,605][52820] Sum rewards: 78.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.231', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.504', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '65.000'} [2024-08-06 06:39:05,041][52660] DAMAGECOUNT value on done: 771762.0 [2024-08-06 06:39:05,041][52660] Sum rewards: 78.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.153', 'weapon5': '0.190', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '65.000'} [2024-08-06 06:39:07,232][52650] Updated weights for policy 0, policy_version 70451 (0.0014) [2024-08-06 06:39:07,260][52662] DAMAGECOUNT value on done: 763769.0 [2024-08-06 06:39:07,262][52662] Sum rewards: 80.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.349', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.050', 'weapon3': '3.412', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:07,396][52668] DAMAGECOUNT value on done: 766641.0 [2024-08-06 06:39:07,396][52668] Sum rewards: 76.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.711', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.330', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:07,757][52820] DAMAGECOUNT value on done: 723856.0 [2024-08-06 06:39:07,759][52820] Sum rewards: 63.154, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.886', 'AMMO5': '0.033', 'AMMO2': '0.089', 'weapon4': '0.206', 'weapon5': '0.208', 'AMMO3': '0.248', 'weapon2': '0.314', 'AMMO4': '0.446', 'WEAPON5': '0.750', 'WEAPON4': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.852', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '56.500'} [2024-08-06 06:39:07,774][52803] DAMAGECOUNT value on done: 718141.0 [2024-08-06 06:39:07,777][52803] Sum rewards: 77.491, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.179', 'weapon4': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.470', 'HEALTH': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '61.500'} [2024-08-06 06:39:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 577142784. Throughput: 0: 4355.6. Samples: 144289890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:07,794][52567] Avg episode reward: [(0, '73.802')] [2024-08-06 06:39:07,891][52795] DAMAGECOUNT value on done: 704809.0 [2024-08-06 06:39:07,892][52795] Sum rewards: 79.902, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.108', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO4': '0.179', 'AMMO3': '0.192', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '2.892', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:08,123][52660] DAMAGECOUNT value on done: 781005.0 [2024-08-06 06:39:08,127][52660] Sum rewards: 80.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.171', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.210', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '66.000'} [2024-08-06 06:39:10,205][52662] DAMAGECOUNT value on done: 775045.0 [2024-08-06 06:39:10,205][52662] Sum rewards: 71.917, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.688', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.231', 'weapon2': '0.442', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.180', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '61.000'} [2024-08-06 06:39:10,654][52668] DAMAGECOUNT value on done: 773761.0 [2024-08-06 06:39:10,655][52668] Sum rewards: 80.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.146', 'AMMO3': '0.193', 'AMMO4': '0.201', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '65.000'} [2024-08-06 06:39:10,866][52803] DAMAGECOUNT value on done: 730290.0 [2024-08-06 06:39:10,866][52803] Sum rewards: 75.166, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.486', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.150', 'AMMO4': '0.200', 'weapon5': '0.228', 'AMMO3': '0.237', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '63.500'} [2024-08-06 06:39:10,921][52820] DAMAGECOUNT value on done: 709713.0 [2024-08-06 06:39:10,922][52820] Sum rewards: 83.395, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.095', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.074', 'weapon5': '0.142', 'weapon2': '0.230', 'AMMO4': '0.246', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.290', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '70.000'} [2024-08-06 06:39:11,026][52795] DAMAGECOUNT value on done: 711653.0 [2024-08-06 06:39:11,026][52795] Sum rewards: 75.670, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.456', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.096', 'AMMO4': '0.101', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '62.000'} [2024-08-06 06:39:11,307][52660] DAMAGECOUNT value on done: 764720.0 [2024-08-06 06:39:11,309][52660] Sum rewards: 72.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.335', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 06:39:11,461][52650] Updated weights for policy 0, policy_version 70461 (0.0034) [2024-08-06 06:39:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 577224704. Throughput: 0: 4358.7. Samples: 144316240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:12,795][52567] Avg episode reward: [(0, '74.146')] [2024-08-06 06:39:13,435][52662] DAMAGECOUNT value on done: 761710.0 [2024-08-06 06:39:13,435][52662] Sum rewards: 66.674, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.785', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO3': '0.134', 'AMMO4': '0.148', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.456', 'WEAPON3': '0.900', 'weapon3': '2.906', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '49.500'} [2024-08-06 06:39:13,460][52668] DAMAGECOUNT value on done: 772258.0 [2024-08-06 06:39:13,463][52668] Sum rewards: 66.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.268', 'weapon2': '0.664', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '57.000'} [2024-08-06 06:39:14,042][52803] DAMAGECOUNT value on done: 715230.0 [2024-08-06 06:39:14,045][52803] Sum rewards: 68.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.694', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.148', 'weapon5': '0.170', 'AMMO4': '0.213', 'AMMO3': '0.250', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '58.000'} [2024-08-06 06:39:14,211][52795] DAMAGECOUNT value on done: 718203.0 [2024-08-06 06:39:14,211][52795] Sum rewards: 71.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.817', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.222', 'AMMO3': '0.222', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '60.000'} [2024-08-06 06:39:14,303][52660] DAMAGECOUNT value on done: 758515.0 [2024-08-06 06:39:14,303][52660] Sum rewards: 69.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.146', 'weapon5': '0.174', 'AMMO4': '0.199', 'weapon4': '0.210', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon3': '3.066', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 06:39:16,467][52650] Updated weights for policy 0, policy_version 70471 (0.0054) [2024-08-06 06:39:16,566][52662] DAMAGECOUNT value on done: 779280.0 [2024-08-06 06:39:16,566][52662] Sum rewards: 76.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.781', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO4': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '63.000'} [2024-08-06 06:39:17,049][52803] DAMAGECOUNT value on done: 717830.0 [2024-08-06 06:39:17,049][52803] Sum rewards: 79.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.505', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '66.000'} [2024-08-06 06:39:17,152][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 06:39:17,330][52660] DAMAGECOUNT value on done: 769017.0 [2024-08-06 06:39:17,330][52660] Sum rewards: 57.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.128', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.072', 'weapon5': '0.112', 'AMMO4': '0.132', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.338', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '47.000'} [2024-08-06 06:39:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 577323008. Throughput: 0: 4366.4. Samples: 144329400. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:17,802][52567] Avg episode reward: [(0, '73.791')] [2024-08-06 06:39:18,089][52665] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:39:19,507][52662] DAMAGECOUNT value on done: 772594.0 [2024-08-06 06:39:19,508][52662] Sum rewards: 68.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.766', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.114', 'weapon4': '0.164', 'AMMO4': '0.194', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '58.000'} [2024-08-06 06:39:19,994][52614] Signal inference workers to stop experience collection... (12850 times) [2024-08-06 06:39:19,999][52614] Signal inference workers to resume experience collection... (12850 times) [2024-08-06 06:39:20,075][52650] InferenceWorker_p0-w0: stopping experience collection (12850 times) [2024-08-06 06:39:20,075][52650] InferenceWorker_p0-w0: resuming experience collection (12850 times) [2024-08-06 06:39:20,106][52660] DAMAGECOUNT value on done: 775481.0 [2024-08-06 06:39:20,108][52660] Sum rewards: 76.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon2': '0.194', 'AMMO4': '0.197', 'AMMO3': '0.217', 'weapon5': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:20,416][52803] DAMAGECOUNT value on done: 721009.0 [2024-08-06 06:39:20,419][52803] Sum rewards: 82.733, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.165', 'HEALTH': '0.190', 'weapon2': '0.306', 'WEAPON3': '0.950', 'HITCOUNT': '3.380', 'weapon3': '3.404', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '66.000'} [2024-08-06 06:39:21,467][52650] Updated weights for policy 0, policy_version 70481 (0.0026) [2024-08-06 06:39:22,583][52662] DAMAGECOUNT value on done: 760863.0 [2024-08-06 06:39:22,584][52662] Sum rewards: 84.747, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.400', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.162', 'weapon4': '0.182', 'AMMO4': '0.212', 'AMMO3': '0.251', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '70.000'} [2024-08-06 06:39:22,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17411.5). Total num frames: 577404928. Throughput: 0: 4352.6. Samples: 144354990. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:22,795][52567] Avg episode reward: [(0, '74.175')] [2024-08-06 06:39:22,997][52660] DAMAGECOUNT value on done: 761159.0 [2024-08-06 06:39:22,998][52660] Sum rewards: 74.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.197', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.131', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.438', 'weapon2': '0.546', 'WEAPON3': '0.900', 'weapon3': '2.684', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '58.000'} [2024-08-06 06:39:23,332][52659] DAMAGECOUNT value on done: 772898.0 [2024-08-06 06:39:23,332][52659] Sum rewards: 83.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.409', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.075', 'FRAGCOUNT': '70.000'} [2024-08-06 06:39:23,591][52803] DAMAGECOUNT value on done: 723868.0 [2024-08-06 06:39:23,594][52803] Sum rewards: 80.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.790', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.210', 'WEAPON3': '1.250', 'weapon3': '3.564', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '67.000'} [2024-08-06 06:39:25,729][52660] DAMAGECOUNT value on done: 763845.0 [2024-08-06 06:39:25,729][52660] Sum rewards: 73.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.863', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.078', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.248', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.358', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '63.500'} [2024-08-06 06:39:25,748][52650] Updated weights for policy 0, policy_version 70491 (0.0022) [2024-08-06 06:39:25,768][52662] DAMAGECOUNT value on done: 770418.0 [2024-08-06 06:39:25,770][52662] Sum rewards: 57.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.246', 'weapon2': '0.288', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.426', 'DAMAGECOUNT': '14.541', 'FRAGCOUNT': '50.000'} [2024-08-06 06:39:26,529][52659] DAMAGECOUNT value on done: 771981.0 [2024-08-06 06:39:26,531][52659] Sum rewards: 83.175, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.715', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO4': '0.015', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON3': '0.850', 'weapon2': '0.934', 'weapon3': '2.898', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '65.000'} [2024-08-06 06:39:26,731][52803] DAMAGECOUNT value on done: 725505.0 [2024-08-06 06:39:26,733][52803] Sum rewards: 70.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.900', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon4': '0.140', 'weapon5': '0.154', 'AMMO4': '0.218', 'AMMO3': '0.258', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '60.000'} [2024-08-06 06:39:27,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 577486848. Throughput: 0: 4338.0. Samples: 144380500. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:27,794][52567] Avg episode reward: [(0, '74.250')] [2024-08-06 06:39:28,651][52660] DAMAGECOUNT value on done: 770048.0 [2024-08-06 06:39:28,652][52660] Sum rewards: 64.101, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.964', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.060', 'AMMO4': '0.174', 'weapon5': '0.184', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '54.500'} [2024-08-06 06:39:28,748][52662] DAMAGECOUNT value on done: 760784.0 [2024-08-06 06:39:28,748][52662] Sum rewards: 68.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.582', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.022', 'AMMO4': '0.083', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '56.000'} [2024-08-06 06:39:29,297][52659] DAMAGECOUNT value on done: 774875.0 [2024-08-06 06:39:29,301][52659] Sum rewards: 64.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.030', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.160', 'AMMO4': '0.190', 'weapon4': '0.206', 'AMMO3': '0.243', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.094', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '56.000'} [2024-08-06 06:39:29,823][52803] DAMAGECOUNT value on done: 719679.0 [2024-08-06 06:39:29,825][52803] Sum rewards: 62.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.167', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'AMMO4': '0.206', 'AMMO3': '0.212', 'weapon5': '0.242', 'weapon4': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '51.000'} [2024-08-06 06:39:30,744][52650] Updated weights for policy 0, policy_version 70501 (0.0016) [2024-08-06 06:39:31,764][52660] DAMAGECOUNT value on done: 761116.0 [2024-08-06 06:39:31,764][52660] Sum rewards: 81.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.122', 'weapon2': '0.174', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.592', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 06:39:32,408][52659] DAMAGECOUNT value on done: 772267.0 [2024-08-06 06:39:32,410][52659] Sum rewards: 71.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.708', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.130', 'AMMO4': '0.137', 'weapon5': '0.148', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '2.940', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '60.000'} [2024-08-06 06:39:32,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 577576960. Throughput: 0: 4332.9. Samples: 144393520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:32,794][52567] Avg episode reward: [(0, '73.947')] [2024-08-06 06:39:34,301][52667] DAMAGECOUNT value on done: 770316.0 [2024-08-06 06:39:34,304][52667] Sum rewards: 82.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.255', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.120', 'AMMO4': '0.166', 'weapon2': '0.208', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.352', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '70.000'} [2024-08-06 06:39:34,637][52660] DAMAGECOUNT value on done: 768900.0 [2024-08-06 06:39:34,637][52660] Sum rewards: 75.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.650', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.122', 'AMMO4': '0.156', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '65.000'} [2024-08-06 06:39:35,483][52659] DAMAGECOUNT value on done: 771228.0 [2024-08-06 06:39:35,483][52659] Sum rewards: 70.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.102', 'AMMO4': '0.130', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '57.000'} [2024-08-06 06:39:35,516][52650] Updated weights for policy 0, policy_version 70511 (0.0029) [2024-08-06 06:39:36,588][52667] DAMAGECOUNT value on done: 776978.0 [2024-08-06 06:39:36,589][52667] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.026', 'AMMO2': '0.082', 'weapon4': '0.160', 'AMMO3': '0.195', 'weapon5': '0.296', 'weapon2': '0.318', 'AMMO4': '0.411', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '58.000'} [2024-08-06 06:39:37,552][52660] DAMAGECOUNT value on done: 779572.0 [2024-08-06 06:39:37,553][52660] Sum rewards: 78.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.170', 'weapon4': '0.182', 'AMMO3': '0.211', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 577658880. Throughput: 0: 4339.1. Samples: 144419960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:39:37,794][52567] Avg episode reward: [(0, '74.495')] [2024-08-06 06:39:38,720][52659] DAMAGECOUNT value on done: 772519.0 [2024-08-06 06:39:38,722][52659] Sum rewards: 78.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO2': '0.008', 'AMMO5': '0.014', 'weapon4': '0.016', 'AMMO4': '0.041', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:39,323][52667] DAMAGECOUNT value on done: 775137.0 [2024-08-06 06:39:39,324][52667] Sum rewards: 73.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.694', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.078', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.314', 'WEAPON3': '1.150', 'weapon3': '3.418', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '59.000'} [2024-08-06 06:39:40,161][52650] Updated weights for policy 0, policy_version 70521 (0.0015) [2024-08-06 06:39:40,690][52668] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:39:40,758][52660] DAMAGECOUNT value on done: 787485.0 [2024-08-06 06:39:40,759][52660] Sum rewards: 86.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.885', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.187', 'AMMO3': '0.205', 'weapon4': '0.210', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '71.000'} [2024-08-06 06:39:41,264][52659] DAMAGECOUNT value on done: 773458.0 [2024-08-06 06:39:41,266][52659] Sum rewards: 72.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.144', 'weapon5': '0.196', 'AMMO3': '0.202', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.192', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '60.000'} [2024-08-06 06:39:41,275][52669] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:39:42,387][52667] DAMAGECOUNT value on done: 780050.0 [2024-08-06 06:39:42,388][52667] Sum rewards: 78.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.470', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.104', 'AMMO3': '0.183', 'weapon4': '0.248', 'AMMO4': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:42,444][52649] DAMAGECOUNT value on done: 747146.0 [2024-08-06 06:39:42,444][52649] Sum rewards: 74.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.776', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.084', 'weapon5': '0.130', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '62.000'} [2024-08-06 06:39:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 577748992. Throughput: 0: 4336.2. Samples: 144446020. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:39:42,794][52567] Avg episode reward: [(0, '74.897')] [2024-08-06 06:39:43,920][52660] DAMAGECOUNT value on done: 764948.0 [2024-08-06 06:39:43,921][52660] Sum rewards: 74.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.248', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.566', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '63.000'} [2024-08-06 06:39:44,288][52659] DAMAGECOUNT value on done: 770491.0 [2024-08-06 06:39:44,288][52659] Sum rewards: 84.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.112', 'AMMO4': '0.177', 'weapon5': '0.188', 'weapon2': '0.220', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '69.000'} [2024-08-06 06:39:44,684][52649] DAMAGECOUNT value on done: 739533.0 [2024-08-06 06:39:44,686][52649] Sum rewards: 73.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.134', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.112', 'AMMO3': '0.204', 'weapon5': '0.208', 'AMMO4': '0.303', 'weapon2': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '60.000'} [2024-08-06 06:39:44,834][52650] Updated weights for policy 0, policy_version 70531 (0.0013) [2024-08-06 06:39:45,210][52667] DAMAGECOUNT value on done: 781669.0 [2024-08-06 06:39:45,210][52667] Sum rewards: 73.644, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.120', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.142', 'AMMO4': '0.173', 'weapon5': '0.206', 'AMMO3': '0.243', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '61.500'} [2024-08-06 06:39:46,456][52660] DAMAGECOUNT value on done: 773543.0 [2024-08-06 06:39:46,457][52660] Sum rewards: 80.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.106', 'weapon5': '0.132', 'AMMO3': '0.176', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '66.000'} [2024-08-06 06:39:47,353][52659] DAMAGECOUNT value on done: 775796.0 [2024-08-06 06:39:47,353][52659] Sum rewards: 78.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.076', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.070', 'AMMO3': '0.193', 'weapon5': '0.198', 'AMMO4': '0.216', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:47,696][52649] DAMAGECOUNT value on done: 759906.0 [2024-08-06 06:39:47,697][52649] Sum rewards: 72.616, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.552', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.157', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '3.400', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '59.000'} [2024-08-06 06:39:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 577839104. Throughput: 0: 4336.9. Samples: 144459150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:39:47,794][52567] Avg episode reward: [(0, '74.980')] [2024-08-06 06:39:48,256][52667] DAMAGECOUNT value on done: 779091.0 [2024-08-06 06:39:48,257][52667] Sum rewards: 50.225, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.575', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.136', 'AMMO3': '0.141', 'AMMO4': '0.175', 'WEAPON7': '0.200', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon7': '0.496', 'WEAPON3': '0.800', 'weapon4': '0.846', 'weapon3': '1.932', 'HITCOUNT': '2.060', 'DAMAGECOUNT': '10.134', 'FRAGCOUNT': '41.000'} [2024-08-06 06:39:48,901][52666] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:39:49,412][52660] DAMAGECOUNT value on done: 770147.0 [2024-08-06 06:39:49,412][52660] Sum rewards: 75.984, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.702', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.090', 'AMMO4': '0.144', 'AMMO3': '0.225', 'weapon5': '0.262', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '62.000'} [2024-08-06 06:39:49,513][52650] Updated weights for policy 0, policy_version 70541 (0.0016) [2024-08-06 06:39:49,695][52647] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 06:39:50,439][52659] DAMAGECOUNT value on done: 779005.0 [2024-08-06 06:39:50,441][52659] Sum rewards: 73.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.090', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.142', 'AMMO4': '0.147', 'weapon2': '0.240', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.304', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:50,834][52667] DAMAGECOUNT value on done: 776531.0 [2024-08-06 06:39:50,834][52667] Sum rewards: 82.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.410', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO4': '0.208', 'AMMO3': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.138', 'FRAGCOUNT': '68.500'} [2024-08-06 06:39:50,941][52649] DAMAGECOUNT value on done: 753858.0 [2024-08-06 06:39:50,942][52649] Sum rewards: 65.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.342', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.070', 'weapon5': '0.100', 'AMMO3': '0.205', 'AMMO4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.122', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '55.000'} [2024-08-06 06:39:52,518][52660] DAMAGECOUNT value on done: 761973.0 [2024-08-06 06:39:52,518][52660] Sum rewards: 75.065, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'weapon4': '0.310', 'weapon2': '0.474', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '60.000'} [2024-08-06 06:39:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 577929216. Throughput: 0: 4343.8. Samples: 144485360. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:39:52,802][52567] Avg episode reward: [(0, '74.540')] [2024-08-06 06:39:53,208][52667] DAMAGECOUNT value on done: 772983.0 [2024-08-06 06:39:53,210][52667] Sum rewards: 83.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.135', 'AMMO3': '0.208', 'weapon4': '0.210', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '69.000'} [2024-08-06 06:39:53,660][52659] DAMAGECOUNT value on done: 767365.0 [2024-08-06 06:39:53,661][52659] Sum rewards: 77.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.416', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '63.000'} [2024-08-06 06:39:54,084][52650] Updated weights for policy 0, policy_version 70551 (0.0024) [2024-08-06 06:39:54,174][52649] DAMAGECOUNT value on done: 743187.0 [2024-08-06 06:39:54,176][52649] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.936', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.204', 'AMMO3': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.508', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '61.000'} [2024-08-06 06:39:55,262][52660] DAMAGECOUNT value on done: 762036.0 [2024-08-06 06:39:55,263][52660] Sum rewards: 79.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO2': '0.027', 'weapon4': '0.114', 'AMMO4': '0.135', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.376', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '66.000'} [2024-08-06 06:39:55,763][52667] DAMAGECOUNT value on done: 775518.0 [2024-08-06 06:39:55,763][52667] Sum rewards: 71.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.495', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.074', 'weapon5': '0.116', 'AMMO3': '0.186', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.050', 'weapon3': '3.188', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 06:39:56,707][52659] DAMAGECOUNT value on done: 777728.0 [2024-08-06 06:39:56,709][52659] Sum rewards: 84.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.048', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '69.000'} [2024-08-06 06:39:57,349][52649] DAMAGECOUNT value on done: 758247.0 [2024-08-06 06:39:57,349][52649] Sum rewards: 77.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.991', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.160', 'weapon5': '0.194', 'AMMO4': '0.239', 'weapon4': '0.304', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 578011136. Throughput: 0: 4331.6. Samples: 144511160. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:39:57,794][52567] Avg episode reward: [(0, '75.075')] [2024-08-06 06:39:58,824][52667] DAMAGECOUNT value on done: 781204.0 [2024-08-06 06:39:58,824][52667] Sum rewards: 73.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO3': '0.178', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.334', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '61.000'} [2024-08-06 06:39:59,061][52650] Updated weights for policy 0, policy_version 70561 (0.0011) [2024-08-06 06:39:59,593][52649] DAMAGECOUNT value on done: 753059.0 [2024-08-06 06:39:59,595][52649] Sum rewards: 78.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.871', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.234', 'WEAPON3': '1.150', 'weapon3': '3.366', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '64.000'} [2024-08-06 06:39:59,956][52659] DAMAGECOUNT value on done: 771245.0 [2024-08-06 06:39:59,957][52659] Sum rewards: 68.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.504', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.158', 'AMMO4': '0.195', 'weapon2': '0.214', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.302', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:00,793][52794] DAMAGECOUNT value on done: 768096.0 [2024-08-06 06:40:00,793][52794] Sum rewards: 69.918, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.470', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.122', 'weapon5': '0.182', 'AMMO4': '0.229', 'AMMO3': '0.265', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:01,502][52667] DAMAGECOUNT value on done: 771274.0 [2024-08-06 06:40:01,502][52667] Sum rewards: 68.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.078', 'AMMO3': '0.197', 'weapon2': '0.204', 'weapon5': '0.208', 'AMMO4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.284', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 06:40:02,558][52649] DAMAGECOUNT value on done: 753669.0 [2024-08-06 06:40:02,560][52649] Sum rewards: 77.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.746', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.136', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.212', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:02,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 578093056. Throughput: 0: 4323.8. Samples: 144523970. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:40:02,795][52567] Avg episode reward: [(0, '74.970')] [2024-08-06 06:40:03,097][52659] DAMAGECOUNT value on done: 773015.0 [2024-08-06 06:40:03,098][52659] Sum rewards: 76.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.611', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.140', 'weapon4': '0.146', 'AMMO4': '0.157', 'weapon2': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:03,358][52650] Updated weights for policy 0, policy_version 70571 (0.0012) [2024-08-06 06:40:03,388][52794] DAMAGECOUNT value on done: 774895.0 [2024-08-06 06:40:03,389][52794] Sum rewards: 71.051, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.666', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.104', 'weapon5': '0.164', 'AMMO3': '0.214', 'AMMO4': '0.283', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.916', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '58.000'} [2024-08-06 06:40:04,248][52667] DAMAGECOUNT value on done: 773841.0 [2024-08-06 06:40:04,249][52667] Sum rewards: 69.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.935', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.179', 'weapon4': '0.236', 'AMMO4': '0.288', 'weapon5': '0.330', 'weapon2': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.672', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '55.000'} [2024-08-06 06:40:05,101][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:40:05,570][52649] DAMAGECOUNT value on done: 754334.0 [2024-08-06 06:40:05,572][52649] Sum rewards: 62.225, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.080', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.285', 'WEAPON3': '1.750', 'HITCOUNT': '3.400', 'weapon3': '3.488', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '55.000'} [2024-08-06 06:40:06,172][52659] DAMAGECOUNT value on done: 775250.0 [2024-08-06 06:40:06,173][52659] Sum rewards: 62.104, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.339', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.124', 'AMMO4': '0.175', 'AMMO3': '0.197', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.200', 'HITCOUNT': '2.920', 'weapon3': '2.978', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '50.000'} [2024-08-06 06:40:06,184][52794] DAMAGECOUNT value on done: 781811.0 [2024-08-06 06:40:06,186][52794] Sum rewards: 75.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.818', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.111', 'weapon5': '0.126', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:06,619][52820] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:40:07,611][52667] DAMAGECOUNT value on done: 781884.0 [2024-08-06 06:40:07,612][52667] Sum rewards: 68.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.857', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.070', 'weapon7': '0.092', 'AMMO4': '0.105', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON7': '0.200', 'weapon2': '0.894', 'WEAPON3': '1.150', 'weapon3': '2.650', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '56.000'} [2024-08-06 06:40:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 578183168. Throughput: 0: 4341.1. Samples: 144550340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:40:07,794][52567] Avg episode reward: [(0, '74.334')] [2024-08-06 06:40:08,501][52650] Updated weights for policy 0, policy_version 70581 (0.0023) [2024-08-06 06:40:08,735][52649] DAMAGECOUNT value on done: 747983.0 [2024-08-06 06:40:08,735][52649] Sum rewards: 76.323, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.236', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.293', 'WEAPON3': '1.800', 'weapon3': '3.376', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '66.000'} [2024-08-06 06:40:09,031][52659] DAMAGECOUNT value on done: 774544.0 [2024-08-06 06:40:09,032][52659] Sum rewards: 66.184, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.160', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.190', 'weapon5': '0.228', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.834', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '58.000'} [2024-08-06 06:40:09,141][52794] DAMAGECOUNT value on done: 765218.0 [2024-08-06 06:40:09,143][52794] Sum rewards: 80.617, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.564', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '68.000'} [2024-08-06 06:40:10,525][52667] DAMAGECOUNT value on done: 769423.0 [2024-08-06 06:40:10,525][52667] Sum rewards: 75.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'weapon4': '0.230', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:11,737][52659] DAMAGECOUNT value on done: 781881.0 [2024-08-06 06:40:11,739][52659] Sum rewards: 73.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.097', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.314', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:11,774][52649] DAMAGECOUNT value on done: 758827.0 [2024-08-06 06:40:11,774][52649] Sum rewards: 64.578, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.159', 'HEALTH': '0.190', 'weapon5': '0.280', 'weapon2': '0.490', 'WEAPON3': '0.900', 'HITCOUNT': '2.920', 'weapon3': '2.998', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '51.000'} [2024-08-06 06:40:12,086][52794] DAMAGECOUNT value on done: 766167.0 [2024-08-06 06:40:12,086][52794] Sum rewards: 73.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.251', 'weapon2': '0.530', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:12,763][52650] Updated weights for policy 0, policy_version 70591 (0.0022) [2024-08-06 06:40:12,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 578281472. Throughput: 0: 4356.2. Samples: 144576530. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:40:12,794][52567] Avg episode reward: [(0, '74.343')] [2024-08-06 06:40:13,425][52667] DAMAGECOUNT value on done: 776061.0 [2024-08-06 06:40:13,426][52667] Sum rewards: 66.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.833', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '57.000'} [2024-08-06 06:40:14,770][52649] DAMAGECOUNT value on done: 762836.0 [2024-08-06 06:40:14,770][52649] Sum rewards: 88.786, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.903', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.138', 'weapon4': '0.162', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '71.000'} [2024-08-06 06:40:14,844][52659] DAMAGECOUNT value on done: 769273.0 [2024-08-06 06:40:14,845][52659] Sum rewards: 80.178, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.195', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.088', 'AMMO3': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.312', 'weapon2': '0.364', 'WEAPON3': '0.750', 'weapon3': '3.122', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:15,152][52794] DAMAGECOUNT value on done: 772287.0 [2024-08-06 06:40:15,154][52794] Sum rewards: 62.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.190', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.074', 'AMMO4': '0.180', 'weapon5': '0.206', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.568', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2024-08-06 06:40:16,348][52667] DAMAGECOUNT value on done: 782713.0 [2024-08-06 06:40:16,348][52667] Sum rewards: 64.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.518', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.084', 'AMMO4': '0.207', 'weapon5': '0.224', 'AMMO3': '0.230', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.850', 'weapon3': '3.076', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2024-08-06 06:40:17,472][52659] DAMAGECOUNT value on done: 777930.0 [2024-08-06 06:40:17,473][52659] Sum rewards: 82.123, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '66.500'} [2024-08-06 06:40:17,757][52650] Updated weights for policy 0, policy_version 70601 (0.0020) [2024-08-06 06:40:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 578363392. Throughput: 0: 4357.6. Samples: 144589610. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:40:17,794][52567] Avg episode reward: [(0, '74.224')] [2024-08-06 06:40:17,926][52794] DAMAGECOUNT value on done: 776921.0 [2024-08-06 06:40:17,928][52794] Sum rewards: 68.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.440', 'AMMO2': '0.012', 'AMMO5': '0.017', 'weapon5': '0.024', 'weapon4': '0.034', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.718', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '58.000'} [2024-08-06 06:40:18,012][52649] DAMAGECOUNT value on done: 759662.0 [2024-08-06 06:40:18,012][52649] Sum rewards: 77.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'weapon5': '0.136', 'weapon4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:19,378][52667] DAMAGECOUNT value on done: 781220.0 [2024-08-06 06:40:19,378][52667] Sum rewards: 79.410, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.096', 'weapon5': '0.216', 'AMMO4': '0.227', 'AMMO3': '0.242', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:19,552][52811] Large shaping reward 2.624 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:40:20,506][52659] DAMAGECOUNT value on done: 770720.0 [2024-08-06 06:40:20,506][52659] Sum rewards: 68.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO4': '0.152', 'weapon5': '0.182', 'AMMO3': '0.239', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '57.000'} [2024-08-06 06:40:20,587][52649] DAMAGECOUNT value on done: 760557.0 [2024-08-06 06:40:20,588][52649] Sum rewards: 78.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.207', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:20,638][52794] DAMAGECOUNT value on done: 763451.0 [2024-08-06 06:40:20,639][52794] Sum rewards: 69.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.804', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.066', 'AMMO4': '0.195', 'AMMO3': '0.216', 'weapon5': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '58.000'} [2024-08-06 06:40:20,891][52664] DAMAGECOUNT value on done: 797785.0 [2024-08-06 06:40:20,891][52664] Sum rewards: 74.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.090', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:22,110][52667] DAMAGECOUNT value on done: 779467.0 [2024-08-06 06:40:22,112][52667] Sum rewards: 78.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.666', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.158', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '64.000'} [2024-08-06 06:40:22,305][52650] Updated weights for policy 0, policy_version 70611 (0.0036) [2024-08-06 06:40:22,660][52665] DAMAGECOUNT value on done: 759953.0 [2024-08-06 06:40:22,661][52665] Sum rewards: 75.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.048', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.156', 'AMMO4': '0.224', 'weapon5': '0.234', 'AMMO3': '0.260', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '62.000'} [2024-08-06 06:40:22,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 578445312. Throughput: 0: 4353.5. Samples: 144615870. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 06:40:22,795][52567] Avg episode reward: [(0, '73.809')] [2024-08-06 06:40:23,093][52649] DAMAGECOUNT value on done: 747255.0 [2024-08-06 06:40:23,095][52649] Sum rewards: 72.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.017', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.162', 'weapon4': '0.180', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.766', 'WEAPON3': '1.350', 'weapon3': '2.624', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:23,642][52794] DAMAGECOUNT value on done: 775023.0 [2024-08-06 06:40:23,642][52794] Sum rewards: 58.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.204', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.042', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '48.000'} [2024-08-06 06:40:24,154][52664] DAMAGECOUNT value on done: 804712.0 [2024-08-06 06:40:24,155][52664] Sum rewards: 81.194, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.014', 'HEALTH': '0.040', 'AMMO2': '0.042', 'AMMO3': '0.165', 'weapon4': '0.168', 'weapon5': '0.200', 'AMMO4': '0.209', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.024', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '64.000'} [2024-08-06 06:40:24,706][52667] DAMAGECOUNT value on done: 777074.0 [2024-08-06 06:40:24,707][52667] Sum rewards: 76.221, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.945', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.072', 'weapon2': '0.160', 'weapon5': '0.172', 'AMMO3': '0.239', 'AMMO4': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.396', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:25,971][52665] DAMAGECOUNT value on done: 774592.0 [2024-08-06 06:40:25,973][52665] Sum rewards: 78.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.819', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.118', 'AMMO4': '0.206', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '66.000'} [2024-08-06 06:40:26,411][52649] DAMAGECOUNT value on done: 757682.0 [2024-08-06 06:40:26,413][52649] Sum rewards: 69.394, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.282', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO3': '0.134', 'weapon4': '0.136', 'AMMO4': '0.142', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '0.900', 'weapon3': '3.026', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '54.000'} [2024-08-06 06:40:26,464][52794] DAMAGECOUNT value on done: 767973.0 [2024-08-06 06:40:26,464][52794] Sum rewards: 68.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.104', 'weapon2': '0.222', 'AMMO3': '0.240', 'weapon5': '0.250', 'AMMO4': '0.297', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.152', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '58.000'} [2024-08-06 06:40:26,929][52664] DAMAGECOUNT value on done: 802762.0 [2024-08-06 06:40:26,948][52664] Sum rewards: 79.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.579', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.126', 'AMMO3': '0.222', 'weapon5': '0.228', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.696', 'WEAPON3': '1.300', 'weapon3': '2.662', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:27,190][52650] Updated weights for policy 0, policy_version 70621 (0.0013) [2024-08-06 06:40:27,532][52667] DAMAGECOUNT value on done: 783158.0 [2024-08-06 06:40:27,534][52667] Sum rewards: 75.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.061', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon4': '0.168', 'WEAPON4': '0.250', 'weapon2': '0.400', 'ARMOR': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 578535424. Throughput: 0: 4360.7. Samples: 144642250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:40:27,794][52567] Avg episode reward: [(0, '73.596')] [2024-08-06 06:40:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070622_578535424.pth... [2024-08-06 06:40:27,943][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070112_574357504.pth [2024-08-06 06:40:28,907][52665] DAMAGECOUNT value on done: 771107.0 [2024-08-06 06:40:28,910][52665] Sum rewards: 83.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.180', 'WEAPON5': '0.200', 'weapon5': '0.210', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '68.000'} [2024-08-06 06:40:29,463][52649] DAMAGECOUNT value on done: 742545.0 [2024-08-06 06:40:29,463][52649] Sum rewards: 68.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO3': '0.157', 'AMMO4': '0.188', 'weapon5': '0.286', 'weapon2': '0.320', 'weapon4': '0.442', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.586', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '56.000'} [2024-08-06 06:40:29,683][52664] DAMAGECOUNT value on done: 795854.0 [2024-08-06 06:40:29,684][52664] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.651', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.183', 'weapon5': '0.188', 'weapon4': '0.200', 'AMMO3': '0.271', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.028', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:29,784][52794] DAMAGECOUNT value on done: 763550.0 [2024-08-06 06:40:29,785][52794] Sum rewards: 60.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.455', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.422', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '50.000'} [2024-08-06 06:40:31,739][52650] Updated weights for policy 0, policy_version 70631 (0.0023) [2024-08-06 06:40:31,796][52665] DAMAGECOUNT value on done: 767536.0 [2024-08-06 06:40:31,796][52665] Sum rewards: 78.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.933', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.168', 'AMMO3': '0.169', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:32,216][52649] DAMAGECOUNT value on done: 761074.0 [2024-08-06 06:40:32,217][52649] Sum rewards: 77.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.545', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon2': '0.184', 'AMMO4': '0.186', 'weapon5': '0.202', 'weapon4': '0.240', 'AMMO3': '0.269', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 578625536. Throughput: 0: 4353.3. Samples: 144655050. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:40:32,794][52567] Avg episode reward: [(0, '73.793')] [2024-08-06 06:40:32,804][52664] DAMAGECOUNT value on done: 809177.0 [2024-08-06 06:40:32,805][52664] Sum rewards: 73.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.316', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.264', 'weapon5': '0.268', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '2.688', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:32,861][52794] DAMAGECOUNT value on done: 774199.0 [2024-08-06 06:40:32,864][52794] Sum rewards: 75.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.287', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.117', 'weapon5': '0.132', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.100', 'weapon3': '3.336', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:34,595][52665] DAMAGECOUNT value on done: 752758.0 [2024-08-06 06:40:34,597][52665] Sum rewards: 81.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon5': '0.130', 'AMMO4': '0.161', 'weapon2': '0.164', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.392', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '68.000'} [2024-08-06 06:40:35,259][52649] DAMAGECOUNT value on done: 762319.0 [2024-08-06 06:40:35,260][52649] Sum rewards: 80.892, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'AMMO3': '0.179', 'weapon2': '0.908', 'WEAPON3': '1.050', 'weapon3': '2.892', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:35,726][52794] DAMAGECOUNT value on done: 771515.0 [2024-08-06 06:40:35,726][52794] Sum rewards: 82.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.230', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.390', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '68.000'} [2024-08-06 06:40:35,741][52664] DAMAGECOUNT value on done: 801904.0 [2024-08-06 06:40:35,742][52664] Sum rewards: 82.938, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.432', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.092', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '67.000'} [2024-08-06 06:40:36,646][52650] Updated weights for policy 0, policy_version 70641 (0.0011) [2024-08-06 06:40:37,700][52665] DAMAGECOUNT value on done: 758828.0 [2024-08-06 06:40:37,702][52665] Sum rewards: 83.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.206', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '69.000'} [2024-08-06 06:40:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17439.3). Total num frames: 578715648. Throughput: 0: 4356.4. Samples: 144681400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:40:37,795][52567] Avg episode reward: [(0, '74.143')] [2024-08-06 06:40:38,234][52664] DAMAGECOUNT value on done: 796821.0 [2024-08-06 06:40:38,236][52664] Sum rewards: 78.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.120', 'weapon2': '0.206', 'AMMO4': '0.221', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.364', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '67.000'} [2024-08-06 06:40:38,375][52649] DAMAGECOUNT value on done: 749948.0 [2024-08-06 06:40:38,376][52649] Sum rewards: 66.952, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.801', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.056', 'AMMO3': '0.169', 'AMMO4': '0.175', 'weapon5': '0.178', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.308', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '54.000'} [2024-08-06 06:40:38,453][52658] DAMAGECOUNT value on done: 773570.0 [2024-08-06 06:40:38,454][52658] Sum rewards: 72.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.945', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.084', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:38,794][52794] DAMAGECOUNT value on done: 786886.0 [2024-08-06 06:40:38,795][52794] Sum rewards: 74.473, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.710', 'weapon4': '0.006', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.325', 'weapon2': '0.344', 'WEAPON3': '1.900', 'weapon3': '3.356', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '68.000'} [2024-08-06 06:40:40,736][52663] DAMAGECOUNT value on done: 788075.0 [2024-08-06 06:40:40,736][52663] Sum rewards: 68.637, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.656', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon2': '0.196', 'weapon4': '0.250', 'weapon5': '0.270', 'AMMO3': '0.303', 'AMMO4': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.974', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:40,809][52665] DAMAGECOUNT value on done: 764606.0 [2024-08-06 06:40:40,809][52665] Sum rewards: 64.387, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.556', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.156', 'weapon4': '0.166', 'AMMO3': '0.174', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '51.000'} [2024-08-06 06:40:40,921][52664] DAMAGECOUNT value on done: 789796.0 [2024-08-06 06:40:40,921][52664] Sum rewards: 66.333, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.334', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.214', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.424', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '55.000'} [2024-08-06 06:40:41,009][52658] DAMAGECOUNT value on done: 777155.0 [2024-08-06 06:40:41,009][52658] Sum rewards: 83.986, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.744', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.072', 'weapon5': '0.134', 'AMMO3': '0.209', 'AMMO4': '0.246', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '70.000'} [2024-08-06 06:40:41,205][52650] Updated weights for policy 0, policy_version 70651 (0.0011) [2024-08-06 06:40:41,883][52794] DAMAGECOUNT value on done: 766331.0 [2024-08-06 06:40:41,885][52794] Sum rewards: 72.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.771', 'AMMO5': '0.025', 'AMMO2': '0.074', 'weapon2': '0.226', 'AMMO3': '0.227', 'weapon4': '0.232', 'AMMO4': '0.371', 'weapon5': '0.384', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 578805760. Throughput: 0: 4370.4. Samples: 144707830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:40:42,794][52567] Avg episode reward: [(0, '74.168')] [2024-08-06 06:40:43,255][52664] DAMAGECOUNT value on done: 804938.0 [2024-08-06 06:40:43,256][52664] Sum rewards: 83.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.086', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.374', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '70.000'} [2024-08-06 06:40:43,450][52663] DAMAGECOUNT value on done: 773462.0 [2024-08-06 06:40:43,451][52663] Sum rewards: 76.728, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.054', 'AMMO5': '0.026', 'AMMO2': '0.069', 'weapon4': '0.130', 'AMMO3': '0.253', 'weapon2': '0.280', 'AMMO4': '0.344', 'weapon5': '0.378', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.868', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:43,928][52665] DAMAGECOUNT value on done: 764574.0 [2024-08-06 06:40:43,930][52665] Sum rewards: 84.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.186', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.252', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.060', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '68.000'} [2024-08-06 06:40:44,345][52658] DAMAGECOUNT value on done: 779572.0 [2024-08-06 06:40:44,345][52658] Sum rewards: 74.957, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.250', 'AMMO3': '0.282', 'weapon2': '0.452', 'WEAPON3': '1.600', 'weapon3': '3.064', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:45,013][52794] DAMAGECOUNT value on done: 779662.0 [2024-08-06 06:40:45,014][52794] Sum rewards: 71.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.129', 'weapon5': '0.152', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '58.000'} [2024-08-06 06:40:45,655][52650] Updated weights for policy 0, policy_version 70661 (0.0014) [2024-08-06 06:40:45,686][52664] DAMAGECOUNT value on done: 798459.0 [2024-08-06 06:40:45,687][52664] Sum rewards: 83.918, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.669', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.160', 'AMMO4': '0.169', 'weapon2': '0.190', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '66.000'} [2024-08-06 06:40:45,705][52647] DAMAGECOUNT value on done: 821883.0 [2024-08-06 06:40:45,706][52647] Sum rewards: 80.816, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.161', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.346', 'weapon2': '0.354', 'HEALTH': '0.395', 'WEAPON3': '0.900', 'weapon3': '2.922', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:46,413][52663] DAMAGECOUNT value on done: 768969.0 [2024-08-06 06:40:46,416][52663] Sum rewards: 89.676, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '21.144', 'FRAGCOUNT': '72.000'} [2024-08-06 06:40:46,986][52665] DAMAGECOUNT value on done: 771366.0 [2024-08-06 06:40:46,987][52665] Sum rewards: 71.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.999', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.175', 'weapon5': '0.178', 'weapon2': '0.320', 'weapon4': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '56.000'} [2024-08-06 06:40:47,241][52671] DAMAGECOUNT value on done: 778550.0 [2024-08-06 06:40:47,242][52671] Sum rewards: 76.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.174', 'AMMO3': '0.186', 'WEAPON3': '1.250', 'HITCOUNT': '3.440', 'weapon3': '3.562', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 06:40:47,498][52658] DAMAGECOUNT value on done: 775850.0 [2024-08-06 06:40:47,498][52658] Sum rewards: 84.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.855', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.131', 'weapon4': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '71.000'} [2024-08-06 06:40:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 578887680. Throughput: 0: 4375.3. Samples: 144720860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:40:47,794][52567] Avg episode reward: [(0, '74.649')] [2024-08-06 06:40:47,954][52794] DAMAGECOUNT value on done: 775726.0 [2024-08-06 06:40:47,955][52794] Sum rewards: 61.204, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.685', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'weapon2': '0.166', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '50.000'} [2024-08-06 06:40:48,431][52664] DAMAGECOUNT value on done: 810392.0 [2024-08-06 06:40:48,431][52664] Sum rewards: 80.065, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.658', 'AMMO5': '0.023', 'AMMO2': '0.047', 'weapon4': '0.096', 'AMMO3': '0.220', 'AMMO4': '0.237', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '66.000'} [2024-08-06 06:40:48,503][52647] DAMAGECOUNT value on done: 811466.0 [2024-08-06 06:40:48,503][52647] Sum rewards: 64.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.125', 'AMMO3': '0.157', 'WEAPON7': '0.200', 'WEAPON5': '0.200', 'weapon7': '0.206', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '53.000'} [2024-08-06 06:40:49,165][52669] DAMAGECOUNT value on done: 775823.0 [2024-08-06 06:40:49,166][52669] Sum rewards: 80.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.122', 'weapon4': '0.130', 'AMMO3': '0.172', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:49,307][52663] DAMAGECOUNT value on done: 773131.0 [2024-08-06 06:40:49,308][52663] Sum rewards: 85.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.174', 'weapon2': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.468', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '69.000'} [2024-08-06 06:40:49,957][52665] DAMAGECOUNT value on done: 762353.0 [2024-08-06 06:40:49,959][52665] Sum rewards: 73.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.191', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.148', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.140', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:50,191][52671] DAMAGECOUNT value on done: 781146.0 [2024-08-06 06:40:50,192][52671] Sum rewards: 71.568, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.136', 'AMMO3': '0.165', 'AMMO4': '0.175', 'weapon4': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:50,299][52658] DAMAGECOUNT value on done: 768302.0 [2024-08-06 06:40:50,300][52658] Sum rewards: 64.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.096', 'weapon5': '0.108', 'AMMO4': '0.115', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.258', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '55.000'} [2024-08-06 06:40:50,466][52650] Updated weights for policy 0, policy_version 70671 (0.0023) [2024-08-06 06:40:51,165][52794] DAMAGECOUNT value on done: 776933.0 [2024-08-06 06:40:51,166][52794] Sum rewards: 76.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.182', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:51,279][52664] DAMAGECOUNT value on done: 806536.0 [2024-08-06 06:40:51,279][52664] Sum rewards: 71.848, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.668', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.176', 'AMMO4': '0.191', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:51,397][52647] DAMAGECOUNT value on done: 817260.0 [2024-08-06 06:40:51,399][52647] Sum rewards: 73.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.906', 'AMMO5': '0.003', 'AMMO2': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.112', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:52,020][52669] DAMAGECOUNT value on done: 766258.0 [2024-08-06 06:40:52,028][52669] Sum rewards: 72.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.115', 'weapon5': '0.130', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '3.006', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:52,289][52663] DAMAGECOUNT value on done: 772864.0 [2024-08-06 06:40:52,290][52663] Sum rewards: 75.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.089', 'weapon5': '0.092', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:52,404][52665] DAMAGECOUNT value on done: 772197.0 [2024-08-06 06:40:52,404][52665] Sum rewards: 74.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.966', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.072', 'weapon5': '0.124', 'AMMO4': '0.139', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 578969600. Throughput: 0: 4376.7. Samples: 144747290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:40:52,794][52567] Avg episode reward: [(0, '74.472')] [2024-08-06 06:40:53,273][52658] DAMAGECOUNT value on done: 765432.0 [2024-08-06 06:40:53,273][52658] Sum rewards: 67.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.785', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon2': '0.210', 'AMMO3': '0.221', 'AMMO4': '0.225', 'weapon4': '0.234', 'weapon5': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '56.000'} [2024-08-06 06:40:53,306][52671] DAMAGECOUNT value on done: 776703.0 [2024-08-06 06:40:53,306][52671] Sum rewards: 72.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.076', 'AMMO4': '0.081', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:53,762][52794] DAMAGECOUNT value on done: 786675.0 [2024-08-06 06:40:53,763][52794] Sum rewards: 71.836, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.639', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.152', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:54,482][52664] DAMAGECOUNT value on done: 808254.0 [2024-08-06 06:40:54,483][52664] Sum rewards: 79.093, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.600', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO3': '0.153', 'AMMO4': '0.161', 'weapon5': '0.218', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.610', 'WEAPON3': '0.900', 'weapon3': '2.602', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:54,512][52647] DAMAGECOUNT value on done: 817063.0 [2024-08-06 06:40:54,514][52647] Sum rewards: 82.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.502', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.186', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'weapon3': '3.474', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '68.000'} [2024-08-06 06:40:54,928][52669] DAMAGECOUNT value on done: 780456.0 [2024-08-06 06:40:54,928][52669] Sum rewards: 78.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.718', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.100', 'weapon4': '0.152', 'AMMO3': '0.191', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.308', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '64.000'} [2024-08-06 06:40:55,103][52663] DAMAGECOUNT value on done: 782389.0 [2024-08-06 06:40:55,107][52663] Sum rewards: 67.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.090', 'weapon5': '0.090', 'AMMO4': '0.155', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '55.000'} [2024-08-06 06:40:55,431][52650] Updated weights for policy 0, policy_version 70681 (0.0013) [2024-08-06 06:40:55,594][52665] DAMAGECOUNT value on done: 770400.0 [2024-08-06 06:40:55,594][52665] Sum rewards: 73.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.022', 'weapon5': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.276', 'WEAPON3': '1.100', 'HITCOUNT': '3.440', 'weapon3': '3.444', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.000'} [2024-08-06 06:40:55,961][52658] DAMAGECOUNT value on done: 779604.0 [2024-08-06 06:40:55,961][52658] Sum rewards: 69.497, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.404', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.148', 'AMMO4': '0.174', 'weapon4': '0.212', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.056', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '61.000'} [2024-08-06 06:40:56,285][52671] DAMAGECOUNT value on done: 779995.0 [2024-08-06 06:40:56,286][52671] Sum rewards: 80.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.122', 'AMMO3': '0.206', 'weapon2': '0.218', 'weapon5': '0.218', 'AMMO4': '0.248', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '66.000'} [2024-08-06 06:40:56,403][52794] DAMAGECOUNT value on done: 776574.0 [2024-08-06 06:40:56,404][52794] Sum rewards: 74.337, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.802', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.556', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:57,626][52664] DAMAGECOUNT value on done: 813997.0 [2024-08-06 06:40:57,626][52664] Sum rewards: 80.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.195', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '65.000'} [2024-08-06 06:40:57,655][52647] DAMAGECOUNT value on done: 822909.0 [2024-08-06 06:40:57,655][52647] Sum rewards: 72.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.098', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.086', 'weapon5': '0.090', 'AMMO3': '0.180', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '59.000'} [2024-08-06 06:40:57,715][52669] DAMAGECOUNT value on done: 773781.0 [2024-08-06 06:40:57,715][52669] Sum rewards: 76.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.438', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.149', 'weapon5': '0.204', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '63.000'} [2024-08-06 06:40:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 579059712. Throughput: 0: 4372.0. Samples: 144773270. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:40:57,794][52567] Avg episode reward: [(0, '74.488')] [2024-08-06 06:40:57,945][52663] DAMAGECOUNT value on done: 769132.0 [2024-08-06 06:40:57,945][52663] Sum rewards: 63.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.578', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.106', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.290', 'WEAPON3': '1.400', 'HITCOUNT': '3.020', 'weapon3': '3.384', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '55.000'} [2024-08-06 06:40:57,983][52665] DAMAGECOUNT value on done: 765359.0 [2024-08-06 06:40:57,985][52665] Sum rewards: 69.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.394', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '57.000'} [2024-08-06 06:40:59,103][52658] DAMAGECOUNT value on done: 767338.0 [2024-08-06 06:40:59,103][52658] Sum rewards: 59.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.753', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon4': '0.260', 'weapon2': '0.424', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '3.028', 'DAMAGECOUNT': '14.019', 'FRAGCOUNT': '49.000'} [2024-08-06 06:40:59,479][52671] DAMAGECOUNT value on done: 787357.0 [2024-08-06 06:40:59,479][52671] Sum rewards: 75.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.139', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.106', 'AMMO4': '0.151', 'AMMO3': '0.186', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.290', 'weapon3': '3.392', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '62.000'} [2024-08-06 06:40:59,768][52650] Updated weights for policy 0, policy_version 70691 (0.0021) [2024-08-06 06:41:00,312][52647] DAMAGECOUNT value on done: 820970.0 [2024-08-06 06:41:00,313][52647] Sum rewards: 69.440, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.581', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon4': '0.104', 'weapon5': '0.168', 'AMMO3': '0.265', 'AMMO4': '0.331', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:00,318][52664] DAMAGECOUNT value on done: 814948.0 [2024-08-06 06:41:00,318][52664] Sum rewards: 67.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.845', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.058', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.456', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.500'} [2024-08-06 06:41:00,689][52669] DAMAGECOUNT value on done: 778293.0 [2024-08-06 06:41:00,690][52669] Sum rewards: 71.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.435', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.191', 'weapon4': '0.198', 'weapon5': '0.318', 'AMMO4': '0.327', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.852', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:01,035][52665] DAMAGECOUNT value on done: 765739.0 [2024-08-06 06:41:01,037][52665] Sum rewards: 84.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.020', 'AMMO2': '0.007', 'AMMO5': '0.015', 'weapon4': '0.016', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon5': '0.160', 'AMMO3': '0.173', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:01,052][52663] DAMAGECOUNT value on done: 761090.0 [2024-08-06 06:41:01,052][52663] Sum rewards: 77.484, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.478', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.127', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '0.850', 'weapon3': '3.116', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:01,729][52670] DAMAGECOUNT value on done: 764407.0 [2024-08-06 06:41:01,733][52670] Sum rewards: 77.151, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.286', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.090', 'AMMO4': '0.201', 'weapon5': '0.224', 'AMMO3': '0.266', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:02,275][52658] DAMAGECOUNT value on done: 792488.0 [2024-08-06 06:41:02,277][52658] Sum rewards: 81.714, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.985', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.168', 'AMMO4': '0.244', 'weapon2': '0.286', 'weapon5': '0.298', 'weapon4': '0.418', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.720', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '65.000'} [2024-08-06 06:41:02,560][52671] DAMAGECOUNT value on done: 778973.0 [2024-08-06 06:41:02,562][52671] Sum rewards: 79.731, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.150', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.125', 'weapon5': '0.130', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'WEAPON3': '1.650', 'weapon3': '3.358', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '69.000'} [2024-08-06 06:41:02,607][52647] DAMAGECOUNT value on done: 823510.0 [2024-08-06 06:41:02,607][52647] Sum rewards: 69.364, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.257', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.198', 'weapon5': '0.210', 'AMMO3': '0.223', 'weapon2': '0.256', 'AMMO4': '0.263', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:02,611][52664] DAMAGECOUNT value on done: 809242.0 [2024-08-06 06:41:02,611][52664] Sum rewards: 87.179, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'AMMO3': '0.237', 'weapon2': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.578', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '72.000'} [2024-08-06 06:41:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 579149824. Throughput: 0: 4371.1. Samples: 144786310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:41:02,794][52567] Avg episode reward: [(0, '74.825')] [2024-08-06 06:41:03,350][52669] DAMAGECOUNT value on done: 776169.0 [2024-08-06 06:41:03,352][52669] Sum rewards: 70.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.942', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.128', 'weapon5': '0.128', 'AMMO4': '0.163', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:03,521][52663] DAMAGECOUNT value on done: 764724.0 [2024-08-06 06:41:03,521][52663] Sum rewards: 75.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.070', 'weapon2': '0.220', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'HITCOUNT': '3.540', 'weapon3': '3.576', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:03,846][52665] DAMAGECOUNT value on done: 761884.0 [2024-08-06 06:41:03,849][52665] Sum rewards: 76.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.976', 'AMMO5': '0.014', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.164', 'weapon4': '0.170', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:04,396][52666] DAMAGECOUNT value on done: 773023.0 [2024-08-06 06:41:04,397][52666] Sum rewards: 73.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.140', 'weapon2': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:04,681][52650] Updated weights for policy 0, policy_version 70701 (0.0014) [2024-08-06 06:41:04,743][52670] DAMAGECOUNT value on done: 775658.0 [2024-08-06 06:41:04,743][52670] Sum rewards: 88.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.602', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.088', 'weapon4': '0.098', 'AMMO4': '0.170', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.027', 'FRAGCOUNT': '73.500'} [2024-08-06 06:41:05,159][52647] DAMAGECOUNT value on done: 801901.0 [2024-08-06 06:41:05,161][52647] Sum rewards: 74.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.427', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.122', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:05,225][52664] DAMAGECOUNT value on done: 799196.0 [2024-08-06 06:41:05,225][52664] Sum rewards: 69.068, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.457', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.088', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:05,376][52658] DAMAGECOUNT value on done: 777624.0 [2024-08-06 06:41:05,377][52658] Sum rewards: 76.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.120', 'weapon5': '0.132', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.392', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '65.000'} [2024-08-06 06:41:05,653][52671] DAMAGECOUNT value on done: 782844.0 [2024-08-06 06:41:05,653][52671] Sum rewards: 79.633, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.285', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO4': '0.177', 'weapon4': '0.216', 'weapon2': '0.240', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.152', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '70.000'} [2024-08-06 06:41:06,004][52669] DAMAGECOUNT value on done: 777070.0 [2024-08-06 06:41:06,007][52669] Sum rewards: 76.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.045', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO4': '0.142', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:06,415][52663] DAMAGECOUNT value on done: 769686.0 [2024-08-06 06:41:06,418][52663] Sum rewards: 61.575, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.892', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.104', 'AMMO4': '0.164', 'AMMO3': '0.179', 'weapon5': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '2.860', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '50.000'} [2024-08-06 06:41:07,001][52665] DAMAGECOUNT value on done: 766265.0 [2024-08-06 06:41:07,002][52665] Sum rewards: 89.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon2': '0.150', 'AMMO3': '0.210', 'weapon5': '0.218', 'AMMO4': '0.253', 'weapon4': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.295', 'FRAGCOUNT': '73.000'} [2024-08-06 06:41:07,244][52811] DAMAGECOUNT value on done: 736711.0 [2024-08-06 06:41:07,244][52811] Sum rewards: 79.776, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.399', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.104', 'weapon2': '0.258', 'weapon5': '0.262', 'AMMO4': '0.273', 'AMMO3': '0.288', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.038', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:07,387][52666] DAMAGECOUNT value on done: 769902.0 [2024-08-06 06:41:07,388][52666] Sum rewards: 69.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon7': '0.060', 'AMMO4': '0.080', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'AMMO3': '0.210', 'weapon4': '0.326', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:07,678][52670] DAMAGECOUNT value on done: 764503.0 [2024-08-06 06:41:07,678][52670] Sum rewards: 70.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.385', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.192', 'AMMO4': '0.198', 'AMMO3': '0.229', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.276', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 579231744. Throughput: 0: 4370.4. Samples: 144812540. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:07,802][52567] Avg episode reward: [(0, '75.027')] [2024-08-06 06:41:07,882][52647] DAMAGECOUNT value on done: 817758.0 [2024-08-06 06:41:07,888][52647] Sum rewards: 68.394, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.380', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.122', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.342', 'weapon2': '0.432', 'WEAPON3': '2.050', 'weapon3': '3.022', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:07,998][52664] DAMAGECOUNT value on done: 801508.0 [2024-08-06 06:41:07,998][52664] Sum rewards: 80.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'weapon4': '0.176', 'weapon2': '0.210', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:08,595][52658] DAMAGECOUNT value on done: 785589.0 [2024-08-06 06:41:08,597][52658] Sum rewards: 72.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.065', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.145', 'weapon4': '0.272', 'weapon2': '0.352', 'WEAPON3': '1.000', 'weapon3': '3.210', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 06:41:08,701][52671] DAMAGECOUNT value on done: 779581.0 [2024-08-06 06:41:08,701][52671] Sum rewards: 74.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.082', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO4': '0.170', 'weapon5': '0.180', 'AMMO3': '0.243', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:08,909][52669] DAMAGECOUNT value on done: 778186.0 [2024-08-06 06:41:08,910][52669] Sum rewards: 75.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon2': '0.182', 'AMMO4': '0.197', 'weapon5': '0.210', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.500', 'weapon3': '2.850', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:09,220][52663] DAMAGECOUNT value on done: 780462.0 [2024-08-06 06:41:09,223][52663] Sum rewards: 78.445, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.585', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.140', 'AMMO3': '0.185', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:09,361][52650] Updated weights for policy 0, policy_version 70711 (0.0011) [2024-08-06 06:41:09,518][52665] DAMAGECOUNT value on done: 767011.0 [2024-08-06 06:41:09,520][52665] Sum rewards: 81.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.090', 'AMMO4': '0.224', 'AMMO3': '0.228', 'weapon5': '0.248', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:10,355][52647] DAMAGECOUNT value on done: 814661.0 [2024-08-06 06:41:10,357][52647] Sum rewards: 75.439, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.301', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.090', 'AMMO3': '0.158', 'weapon5': '0.232', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:10,424][52811] DAMAGECOUNT value on done: 719235.0 [2024-08-06 06:41:10,426][52811] Sum rewards: 73.167, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.770', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.126', 'AMMO4': '0.143', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.750', 'weapon3': '3.192', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:10,467][52666] DAMAGECOUNT value on done: 773347.0 [2024-08-06 06:41:10,468][52666] Sum rewards: 83.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.116', 'weapon5': '0.172', 'AMMO4': '0.206', 'AMMO3': '0.208', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:10,483][52664] DAMAGECOUNT value on done: 803463.0 [2024-08-06 06:41:10,484][52664] Sum rewards: 85.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.492', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.240', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '69.000'} [2024-08-06 06:41:10,743][52670] DAMAGECOUNT value on done: 761952.0 [2024-08-06 06:41:10,744][52670] Sum rewards: 71.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.356', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO4': '0.201', 'weapon5': '0.204', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.654', 'WEAPON3': '1.300', 'weapon3': '2.762', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:11,266][52658] DAMAGECOUNT value on done: 773294.0 [2024-08-06 06:41:11,266][52658] Sum rewards: 74.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.925', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO3': '0.168', 'AMMO4': '0.170', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:11,519][52671] DAMAGECOUNT value on done: 768368.0 [2024-08-06 06:41:11,521][52671] Sum rewards: 73.640, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.941', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.086', 'AMMO3': '0.223', 'weapon5': '0.232', 'AMMO4': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:11,827][52669] DAMAGECOUNT value on done: 787710.0 [2024-08-06 06:41:11,829][52669] Sum rewards: 85.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.114', 'weapon5': '0.154', 'weapon2': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '70.000'} [2024-08-06 06:41:12,033][52663] DAMAGECOUNT value on done: 764182.0 [2024-08-06 06:41:12,033][52663] Sum rewards: 75.192, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.605', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.239', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.376', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '63.500'} [2024-08-06 06:41:12,644][52665] DAMAGECOUNT value on done: 758729.0 [2024-08-06 06:41:12,646][52665] Sum rewards: 90.582, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.803', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.089', 'weapon5': '0.136', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '72.000'} [2024-08-06 06:41:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 579321856. Throughput: 0: 4365.8. Samples: 144838710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:12,802][52567] Avg episode reward: [(0, '75.732')] [2024-08-06 06:41:12,921][52647] DAMAGECOUNT value on done: 812668.0 [2024-08-06 06:41:12,923][52647] Sum rewards: 75.923, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.113', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.112', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.267', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:13,123][52664] DAMAGECOUNT value on done: 800846.0 [2024-08-06 06:41:13,125][52664] Sum rewards: 82.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.372', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.134', 'weapon5': '0.186', 'weapon2': '0.218', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.057', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:13,475][52666] DAMAGECOUNT value on done: 771016.0 [2024-08-06 06:41:13,476][52666] Sum rewards: 78.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.098', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.082', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.222', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '65.000'} [2024-08-06 06:41:13,525][52811] DAMAGECOUNT value on done: 716959.0 [2024-08-06 06:41:13,529][52811] Sum rewards: 84.902, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.982', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.048', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.436', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '71.000'} [2024-08-06 06:41:13,675][52670] DAMAGECOUNT value on done: 774331.0 [2024-08-06 06:41:13,677][52670] Sum rewards: 87.002, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.237', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.108', 'weapon5': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.981', 'FRAGCOUNT': '72.000'} [2024-08-06 06:41:14,160][52669] DAMAGECOUNT value on done: 777962.0 [2024-08-06 06:41:14,161][52669] Sum rewards: 71.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.056', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.238', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:14,197][52650] Updated weights for policy 0, policy_version 70721 (0.0013) [2024-08-06 06:41:14,232][52658] DAMAGECOUNT value on done: 780030.0 [2024-08-06 06:41:14,232][52658] Sum rewards: 63.717, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.213', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO4': '0.239', 'weapon2': '0.252', 'AMMO3': '0.274', 'weapon5': '0.274', 'weapon4': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.826', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:14,445][52663] DAMAGECOUNT value on done: 759764.0 [2024-08-06 06:41:14,447][52663] Sum rewards: 67.977, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.956', 'AMMO5': '0.007', 'AMMO2': '0.041', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO4': '0.204', 'weapon2': '0.204', 'weapon4': '0.292', 'WEAPON3': '1.050', 'weapon3': '3.150', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '54.000'} [2024-08-06 06:41:14,589][52671] DAMAGECOUNT value on done: 777825.0 [2024-08-06 06:41:14,591][52671] Sum rewards: 69.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.088', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '56.000'} [2024-08-06 06:41:15,155][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:41:15,240][52647] DAMAGECOUNT value on done: 805147.0 [2024-08-06 06:41:15,242][52647] Sum rewards: 73.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.104', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.190', 'AMMO4': '0.216', 'AMMO3': '0.221', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.538', 'WEAPON3': '1.350', 'weapon3': '2.680', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:15,819][52665] DAMAGECOUNT value on done: 762768.0 [2024-08-06 06:41:15,822][52665] Sum rewards: 70.978, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.740', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'weapon4': '0.100', 'AMMO3': '0.134', 'weapon5': '0.228', 'AMMO4': '0.242', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.166', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:16,578][52811] DAMAGECOUNT value on done: 717845.0 [2024-08-06 06:41:16,578][52811] Sum rewards: 68.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.622', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.170', 'weapon4': '0.172', 'AMMO4': '0.209', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2024-08-06 06:41:16,671][52666] DAMAGECOUNT value on done: 764863.0 [2024-08-06 06:41:16,673][52666] Sum rewards: 64.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.205', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.024', 'AMMO4': '0.058', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.460', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:16,888][52670] DAMAGECOUNT value on done: 768078.0 [2024-08-06 06:41:16,889][52670] Sum rewards: 79.713, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.802', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.072', 'weapon5': '0.132', 'AMMO4': '0.208', 'AMMO3': '0.252', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.236', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '68.000'} [2024-08-06 06:41:17,096][52658] DAMAGECOUNT value on done: 769941.0 [2024-08-06 06:41:17,097][52658] Sum rewards: 67.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.088', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '57.000'} [2024-08-06 06:41:17,180][52669] DAMAGECOUNT value on done: 780791.0 [2024-08-06 06:41:17,181][52669] Sum rewards: 84.757, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.966', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.092', 'weapon5': '0.166', 'AMMO4': '0.168', 'weapon2': '0.232', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '21.219', 'FRAGCOUNT': '69.000'} [2024-08-06 06:41:17,383][52671] DAMAGECOUNT value on done: 779223.0 [2024-08-06 06:41:17,385][52671] Sum rewards: 75.000, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.765', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.140', 'weapon5': '0.176', 'AMMO4': '0.180', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:17,582][52663] DAMAGECOUNT value on done: 766979.0 [2024-08-06 06:41:17,583][52663] Sum rewards: 68.419, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.300', 'AMMO5': '0.024', 'AMMO2': '0.041', 'weapon4': '0.132', 'weapon5': '0.166', 'AMMO4': '0.206', 'AMMO3': '0.234', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 579411968. Throughput: 0: 4369.3. Samples: 144851670. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:17,802][52567] Avg episode reward: [(0, '75.298')] [2024-08-06 06:41:18,043][52647] DAMAGECOUNT value on done: 822011.0 [2024-08-06 06:41:18,044][52647] Sum rewards: 61.740, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.496', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.057', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.602', 'WEAPON3': '1.550', 'weapon3': '3.072', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '54.000'} [2024-08-06 06:41:18,585][52650] Updated weights for policy 0, policy_version 70731 (0.0025) [2024-08-06 06:41:18,689][52665] DAMAGECOUNT value on done: 766604.0 [2024-08-06 06:41:18,689][52665] Sum rewards: 75.939, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.341', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.142', 'weapon5': '0.162', 'AMMO4': '0.218', 'AMMO3': '0.278', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.990', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '65.000'} [2024-08-06 06:41:19,513][52669] DAMAGECOUNT value on done: 786809.0 [2024-08-06 06:41:19,514][52669] Sum rewards: 81.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.215', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.126', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:19,654][52811] DAMAGECOUNT value on done: 724657.0 [2024-08-06 06:41:19,655][52811] Sum rewards: 74.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:19,863][52663] DAMAGECOUNT value on done: 767053.0 [2024-08-06 06:41:19,863][52663] Sum rewards: 75.278, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.928', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.158', 'AMMO3': '0.169', 'AMMO4': '0.228', 'weapon2': '0.282', 'weapon4': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.908', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:19,869][52666] DAMAGECOUNT value on done: 769993.0 [2024-08-06 06:41:19,871][52666] Sum rewards: 78.161, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.836', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon4': '0.222', 'weapon5': '0.224', 'AMMO3': '0.229', 'AMMO4': '0.263', 'weapon2': '0.482', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.784', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:20,070][52671] DAMAGECOUNT value on done: 777333.0 [2024-08-06 06:41:20,070][52671] Sum rewards: 83.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.812', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.194', 'weapon2': '0.200', 'weapon4': '0.206', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '69.000'} [2024-08-06 06:41:20,136][52670] DAMAGECOUNT value on done: 761313.0 [2024-08-06 06:41:20,138][52670] Sum rewards: 78.843, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.496', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.100', 'AMMO3': '0.175', 'weapon5': '0.178', 'AMMO4': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:20,142][52658] DAMAGECOUNT value on done: 779759.0 [2024-08-06 06:41:20,144][52658] Sum rewards: 67.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.454', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.096', 'AMMO4': '0.132', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '56.000'} [2024-08-06 06:41:20,519][52647] DAMAGECOUNT value on done: 807458.0 [2024-08-06 06:41:20,522][52647] Sum rewards: 92.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.993', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.462', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '77.000'} [2024-08-06 06:41:22,616][52811] DAMAGECOUNT value on done: 733652.0 [2024-08-06 06:41:22,616][52811] Sum rewards: 78.882, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.826', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.080', 'AMMO4': '0.179', 'weapon5': '0.188', 'AMMO3': '0.196', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:22,718][52669] DAMAGECOUNT value on done: 770306.0 [2024-08-06 06:41:22,720][52669] Sum rewards: 73.564, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.955', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.194', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.274', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:22,746][52666] DAMAGECOUNT value on done: 766208.0 [2024-08-06 06:41:22,747][52666] Sum rewards: 72.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.676', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:22,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 579502080. Throughput: 0: 4371.1. Samples: 144878100. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:22,795][52567] Avg episode reward: [(0, '75.324')] [2024-08-06 06:41:22,891][52647] DAMAGECOUNT value on done: 817134.0 [2024-08-06 06:41:22,892][52647] Sum rewards: 70.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.734', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.098', 'weapon4': '0.114', 'AMMO4': '0.151', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.224', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:22,898][52671] DAMAGECOUNT value on done: 785579.0 [2024-08-06 06:41:22,899][52671] Sum rewards: 82.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.138', 'weapon4': '0.158', 'AMMO4': '0.199', 'AMMO3': '0.214', 'weapon2': '0.260', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '69.000'} [2024-08-06 06:41:22,993][52658] DAMAGECOUNT value on done: 761925.0 [2024-08-06 06:41:22,994][52658] Sum rewards: 64.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.881', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.199', 'weapon5': '0.226', 'AMMO4': '0.265', 'weapon4': '0.360', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '54.000'} [2024-08-06 06:41:23,109][52670] DAMAGECOUNT value on done: 764528.0 [2024-08-06 06:41:23,109][52670] Sum rewards: 67.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.172', 'AMMO3': '0.190', 'weapon2': '0.192', 'weapon4': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.130', 'weapon3': '3.136', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '54.000'} [2024-08-06 06:41:23,170][52663] DAMAGECOUNT value on done: 779754.0 [2024-08-06 06:41:23,171][52663] Sum rewards: 77.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.107', 'AMMO3': '0.223', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:23,318][52650] Updated weights for policy 0, policy_version 70741 (0.0021) [2024-08-06 06:41:25,448][52647] DAMAGECOUNT value on done: 819228.0 [2024-08-06 06:41:25,448][52647] Sum rewards: 70.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'weapon4': '0.038', 'AMMO2': '0.044', 'weapon5': '0.092', 'AMMO3': '0.214', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:25,838][52811] DAMAGECOUNT value on done: 728587.0 [2024-08-06 06:41:25,841][52811] Sum rewards: 81.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.505', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.130', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'weapon4': '0.536', 'WEAPON3': '1.150', 'weapon3': '2.642', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:25,888][52666] DAMAGECOUNT value on done: 761786.0 [2024-08-06 06:41:25,888][52666] Sum rewards: 82.787, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.176', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.406', 'WEAPON3': '0.950', 'weapon3': '3.380', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '65.000'} [2024-08-06 06:41:25,931][52658] DAMAGECOUNT value on done: 781363.0 [2024-08-06 06:41:25,931][52658] Sum rewards: 76.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.148', 'AMMO3': '0.193', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:25,933][52669] DAMAGECOUNT value on done: 771839.0 [2024-08-06 06:41:25,934][52669] Sum rewards: 83.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.116', 'weapon5': '0.130', 'weapon2': '0.164', 'AMMO4': '0.224', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.390', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '70.000'} [2024-08-06 06:41:25,975][52671] DAMAGECOUNT value on done: 778357.0 [2024-08-06 06:41:25,976][52671] Sum rewards: 67.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.076', 'AMMO3': '0.160', 'AMMO4': '0.218', 'weapon5': '0.224', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '3.268', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:26,272][52670] DAMAGECOUNT value on done: 765868.0 [2024-08-06 06:41:26,274][52670] Sum rewards: 79.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.128', 'weapon5': '0.128', 'AMMO3': '0.156', 'AMMO4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.000', 'weapon3': '3.170', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:26,635][52663] DAMAGECOUNT value on done: 770869.0 [2024-08-06 06:41:26,643][52663] Sum rewards: 65.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.555', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.098', 'AMMO4': '0.147', 'AMMO3': '0.198', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.314', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 579584000. Throughput: 0: 4352.4. Samples: 144903690. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:27,794][52567] Avg episode reward: [(0, '75.431')] [2024-08-06 06:41:28,196][52650] Updated weights for policy 0, policy_version 70751 (0.0021) [2024-08-06 06:41:28,653][52647] DAMAGECOUNT value on done: 805838.0 [2024-08-06 06:41:28,654][52647] Sum rewards: 78.133, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.119', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:28,669][52670] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0)] [2024-08-06 06:41:28,833][52671] DAMAGECOUNT value on done: 765267.0 [2024-08-06 06:41:28,834][52671] Sum rewards: 74.351, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.085', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:29,064][52666] DAMAGECOUNT value on done: 770750.0 [2024-08-06 06:41:29,066][52666] Sum rewards: 69.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.392', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.125', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'HITCOUNT': '3.320', 'weapon3': '3.484', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:29,077][52669] DAMAGECOUNT value on done: 777960.0 [2024-08-06 06:41:29,078][52669] Sum rewards: 87.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.558', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.136', 'AMMO3': '0.164', 'weapon2': '0.226', 'AMMO4': '0.243', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '21.087', 'FRAGCOUNT': '68.000'} [2024-08-06 06:41:29,089][52658] DAMAGECOUNT value on done: 770453.0 [2024-08-06 06:41:29,089][52658] Sum rewards: 65.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.178', 'weapon5': '0.210', 'weapon2': '0.268', 'AMMO4': '0.284', 'weapon4': '0.290', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '52.500'} [2024-08-06 06:41:29,377][52663] DAMAGECOUNT value on done: 774765.0 [2024-08-06 06:41:29,378][52663] Sum rewards: 71.999, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.106', 'weapon5': '0.142', 'AMMO3': '0.191', 'AMMO4': '0.197', 'weapon2': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.314', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:29,432][52668] DAMAGECOUNT value on done: 777460.0 [2024-08-06 06:41:29,433][52668] Sum rewards: 81.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.201', 'AMMO3': '0.225', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:29,442][52811] DAMAGECOUNT value on done: 720267.0 [2024-08-06 06:41:29,442][52811] Sum rewards: 85.024, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.142', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.062', 'AMMO3': '0.162', 'weapon5': '0.188', 'AMMO4': '0.196', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.304', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:29,454][52670] DAMAGECOUNT value on done: 760852.0 [2024-08-06 06:41:29,455][52670] Sum rewards: 84.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.181', 'weapon5': '0.228', 'AMMO4': '0.269', 'weapon2': '0.288', 'WEAPON5': '0.450', 'weapon4': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:31,362][52647] DAMAGECOUNT value on done: 810200.0 [2024-08-06 06:41:31,362][52647] Sum rewards: 61.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.112', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon4': '0.074', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '2.956', 'DAMAGECOUNT': '14.778', 'FRAGCOUNT': '51.000'} [2024-08-06 06:41:31,434][52671] DAMAGECOUNT value on done: 785693.0 [2024-08-06 06:41:31,437][52671] Sum rewards: 86.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.618', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.158', 'AMMO4': '0.190', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '73.000'} [2024-08-06 06:41:31,882][52669] DAMAGECOUNT value on done: 798048.0 [2024-08-06 06:41:31,885][52669] Sum rewards: 91.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.852', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.164', 'weapon5': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.680', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '75.000'} [2024-08-06 06:41:31,950][52658] DAMAGECOUNT value on done: 770419.0 [2024-08-06 06:41:31,950][52658] Sum rewards: 75.537, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.122', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.155', 'weapon2': '0.674', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:32,103][52668] DAMAGECOUNT value on done: 782319.0 [2024-08-06 06:41:32,103][52668] Sum rewards: 82.706, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.059', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.102', 'AMMO4': '0.157', 'weapon5': '0.164', 'AMMO3': '0.168', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:32,235][52666] DAMAGECOUNT value on done: 765168.0 [2024-08-06 06:41:32,236][52666] Sum rewards: 86.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.420', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '70.000'} [2024-08-06 06:41:32,320][52663] DAMAGECOUNT value on done: 779718.0 [2024-08-06 06:41:32,321][52663] Sum rewards: 71.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.540', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.082', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:32,513][52670] DAMAGECOUNT value on done: 773932.0 [2024-08-06 06:41:32,514][52670] Sum rewards: 68.195, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.244', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.098', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.318', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.266', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:32,677][52811] DAMAGECOUNT value on done: 729426.0 [2024-08-06 06:41:32,680][52811] Sum rewards: 82.962, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.612', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '65.000'} [2024-08-06 06:41:32,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17203.1, 300 sec: 17383.7). Total num frames: 579657728. Throughput: 0: 4353.5. Samples: 144916770. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:32,795][52567] Avg episode reward: [(0, '76.291')] [2024-08-06 06:41:33,199][52650] Updated weights for policy 0, policy_version 70761 (0.0012) [2024-08-06 06:41:33,351][52614] Signal inference workers to stop experience collection... (12900 times) [2024-08-06 06:41:33,365][52614] Signal inference workers to resume experience collection... (12900 times) [2024-08-06 06:41:33,439][52650] InferenceWorker_p0-w0: stopping experience collection (12900 times) [2024-08-06 06:41:33,439][52650] InferenceWorker_p0-w0: resuming experience collection (12900 times) [2024-08-06 06:41:34,459][52647] DAMAGECOUNT value on done: 800516.0 [2024-08-06 06:41:34,464][52647] Sum rewards: 68.750, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.390', 'ARMOR': '0.008', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.092', 'AMMO3': '0.175', 'weapon4': '0.180', 'WEAPON5': '0.200', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.000', 'HITCOUNT': '3.180', 'weapon3': '3.198', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:34,563][52671] DAMAGECOUNT value on done: 783705.0 [2024-08-06 06:41:34,563][52671] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.458', 'AMMO5': '0.024', 'AMMO2': '0.077', 'weapon4': '0.152', 'AMMO3': '0.210', 'weapon5': '0.314', 'AMMO4': '0.387', 'weapon2': '0.422', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '57.000'} [2024-08-06 06:41:34,955][52666] DAMAGECOUNT value on done: 772508.0 [2024-08-06 06:41:34,956][52666] Sum rewards: 70.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.243', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'weapon2': '0.364', 'WEAPON3': '1.700', 'weapon3': '3.294', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:34,997][52669] DAMAGECOUNT value on done: 785274.0 [2024-08-06 06:41:34,997][52669] Sum rewards: 83.250, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.090', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'weapon2': '0.884', 'WEAPON3': '1.000', 'weapon3': '2.726', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:35,018][52658] DAMAGECOUNT value on done: 778167.0 [2024-08-06 06:41:35,018][52658] Sum rewards: 70.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.854', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.122', 'AMMO3': '0.198', 'AMMO4': '0.224', 'weapon5': '0.236', 'weapon2': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '56.000'} [2024-08-06 06:41:35,055][52668] DAMAGECOUNT value on done: 777602.0 [2024-08-06 06:41:35,058][52668] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.241', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.084', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:35,236][52670] DAMAGECOUNT value on done: 758262.0 [2024-08-06 06:41:35,238][52670] Sum rewards: 81.706, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.089', 'weapon5': '0.090', 'HEALTH': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:35,442][52663] DAMAGECOUNT value on done: 767515.0 [2024-08-06 06:41:35,443][52663] Sum rewards: 71.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.882', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.090', 'AMMO4': '0.138', 'weapon5': '0.184', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:35,774][52811] DAMAGECOUNT value on done: 725929.0 [2024-08-06 06:41:35,774][52811] Sum rewards: 51.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.164', 'AMMO3': '0.205', 'AMMO4': '0.214', 'weapon4': '0.402', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '12.465', 'FRAGCOUNT': '43.000'} [2024-08-06 06:41:36,807][52647] DAMAGECOUNT value on done: 807574.0 [2024-08-06 06:41:36,808][52647] Sum rewards: 70.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.326', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.154', 'AMMO3': '0.167', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '57.000'} [2024-08-06 06:41:37,339][52650] Updated weights for policy 0, policy_version 70771 (0.0012) [2024-08-06 06:41:37,481][52671] DAMAGECOUNT value on done: 779983.0 [2024-08-06 06:41:37,483][52671] Sum rewards: 76.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 579764224. Throughput: 0: 4340.0. Samples: 144942590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:37,794][52567] Avg episode reward: [(0, '75.580')] [2024-08-06 06:41:37,845][52820] DAMAGECOUNT value on done: 717489.0 [2024-08-06 06:41:37,845][52820] Sum rewards: 86.621, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.020', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.025', 'weapon5': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon2': '0.234', 'AMMO3': '0.288', 'WEAPON3': '1.750', 'weapon3': '3.484', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.898', 'FRAGCOUNT': '75.000'} [2024-08-06 06:41:37,864][52668] DAMAGECOUNT value on done: 784588.0 [2024-08-06 06:41:37,864][52668] Sum rewards: 74.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.469', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.090', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:37,997][52669] DAMAGECOUNT value on done: 779366.0 [2024-08-06 06:41:37,997][52669] Sum rewards: 74.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.544', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.093', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:38,344][52666] DAMAGECOUNT value on done: 759785.0 [2024-08-06 06:41:38,344][52666] Sum rewards: 72.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.198', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.456', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:38,545][52670] DAMAGECOUNT value on done: 768480.0 [2024-08-06 06:41:38,546][52670] Sum rewards: 67.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '55.000'} [2024-08-06 06:41:38,944][52811] DAMAGECOUNT value on done: 728639.0 [2024-08-06 06:41:38,945][52811] Sum rewards: 70.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.175', 'AMMO3': '0.212', 'weapon4': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '59.500'} [2024-08-06 06:41:39,994][52671] DAMAGECOUNT value on done: 784198.0 [2024-08-06 06:41:39,995][52671] Sum rewards: 88.845, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.762', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon4': '0.134', 'AMMO4': '0.136', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.300', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '72.000'} [2024-08-06 06:41:40,263][52668] DAMAGECOUNT value on done: 766320.0 [2024-08-06 06:41:40,264][52668] Sum rewards: 69.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.996', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.102', 'AMMO3': '0.234', 'weapon5': '0.280', 'AMMO4': '0.292', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.942', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:40,845][52795] DAMAGECOUNT value on done: 721761.0 [2024-08-06 06:41:40,853][52795] Sum rewards: 74.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.016', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.158', 'weapon5': '0.192', 'AMMO3': '0.223', 'weapon2': '0.268', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:40,959][52666] DAMAGECOUNT value on done: 773388.0 [2024-08-06 06:41:40,961][52666] Sum rewards: 73.913, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.645', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.202', 'weapon2': '0.250', 'AMMO4': '0.253', 'AMMO3': '0.280', 'weapon5': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.914', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:41,035][52669] DAMAGECOUNT value on done: 783052.0 [2024-08-06 06:41:41,038][52669] Sum rewards: 77.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.395', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.122', 'weapon5': '0.122', 'AMMO4': '0.184', 'AMMO3': '0.187', 'weapon2': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.328', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:41,058][52820] DAMAGECOUNT value on done: 719175.0 [2024-08-06 06:41:41,058][52820] Sum rewards: 83.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.343', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.203', 'weapon2': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.360', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '68.000'} [2024-08-06 06:41:41,222][52670] DAMAGECOUNT value on done: 775782.0 [2024-08-06 06:41:41,222][52670] Sum rewards: 79.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO4': '0.213', 'AMMO3': '0.236', 'weapon4': '0.262', 'weapon5': '0.264', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '65.000'} [2024-08-06 06:41:41,981][52811] DAMAGECOUNT value on done: 734758.0 [2024-08-06 06:41:41,983][52811] Sum rewards: 92.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.464', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '76.000'} [2024-08-06 06:41:42,527][52650] Updated weights for policy 0, policy_version 70781 (0.0020) [2024-08-06 06:41:42,561][52668] DAMAGECOUNT value on done: 779997.0 [2024-08-06 06:41:42,563][52668] Sum rewards: 85.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.786', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.093', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.246', 'WEAPON3': '1.400', 'weapon3': '3.356', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '21.306', 'FRAGCOUNT': '70.000'} [2024-08-06 06:41:42,794][52567] Fps is (10 sec: 18842.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 579846144. Throughput: 0: 4347.1. Samples: 144968890. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:42,794][52567] Avg episode reward: [(0, '76.111')] [2024-08-06 06:41:43,084][52671] DAMAGECOUNT value on done: 774212.0 [2024-08-06 06:41:43,085][52671] Sum rewards: 71.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.098', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:43,997][52669] DAMAGECOUNT value on done: 787714.0 [2024-08-06 06:41:43,997][52669] Sum rewards: 80.202, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.540', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.152', 'AMMO4': '0.171', 'weapon5': '0.182', 'weapon4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '0.900', 'weapon3': '2.980', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:44,001][52795] DAMAGECOUNT value on done: 707529.0 [2024-08-06 06:41:44,002][52795] Sum rewards: 74.144, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.264', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.066', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.260', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:44,178][52666] DAMAGECOUNT value on done: 767705.0 [2024-08-06 06:41:44,179][52666] Sum rewards: 73.402, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.030', 'HEALTH': '0.043', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.314', 'weapon4': '0.402', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:44,329][52820] DAMAGECOUNT value on done: 718715.0 [2024-08-06 06:41:44,329][52820] Sum rewards: 69.927, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.156', 'AMMO4': '0.185', 'AMMO3': '0.238', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:44,361][52670] DAMAGECOUNT value on done: 769028.0 [2024-08-06 06:41:44,361][52670] Sum rewards: 69.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.082', 'weapon5': '0.098', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:45,112][52811] DAMAGECOUNT value on done: 726738.0 [2024-08-06 06:41:45,113][52811] Sum rewards: 78.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.572', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.090', 'AMMO4': '0.162', 'weapon5': '0.174', 'AMMO3': '0.221', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:45,497][52662] DAMAGECOUNT value on done: 775657.0 [2024-08-06 06:41:45,499][52662] Sum rewards: 66.637, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.065', 'ARMOR': '0.012', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.164', 'weapon5': '0.226', 'AMMO4': '0.255', 'AMMO3': '0.265', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.936', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '57.000'} [2024-08-06 06:41:45,751][52668] DAMAGECOUNT value on done: 781127.0 [2024-08-06 06:41:45,752][52668] Sum rewards: 78.306, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.684', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.160', 'AMMO4': '0.164', 'AMMO3': '0.166', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.110', 'weapon3': '3.212', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:46,122][52662] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:41:46,719][52650] Updated weights for policy 0, policy_version 70791 (0.0029) [2024-08-06 06:41:46,993][52666] DAMAGECOUNT value on done: 767740.0 [2024-08-06 06:41:46,995][52666] Sum rewards: 71.181, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.347', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.140', 'weapon4': '0.186', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.650', 'weapon3': '3.000', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:47,094][52670] DAMAGECOUNT value on done: 752327.0 [2024-08-06 06:41:47,094][52670] Sum rewards: 76.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.148', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.078', 'AMMO4': '0.205', 'weapon5': '0.214', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:47,113][52795] DAMAGECOUNT value on done: 709802.0 [2024-08-06 06:41:47,113][52795] Sum rewards: 83.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.742', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.178', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:47,414][52820] DAMAGECOUNT value on done: 710306.0 [2024-08-06 06:41:47,414][52820] Sum rewards: 80.552, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.586', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.138', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'weapon4': '0.472', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 579928064. Throughput: 0: 4354.9. Samples: 144982280. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:41:47,794][52567] Avg episode reward: [(0, '75.615')] [2024-08-06 06:41:48,174][52668] DAMAGECOUNT value on done: 771596.0 [2024-08-06 06:41:48,176][52668] Sum rewards: 85.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.255', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.070', 'weapon4': '0.078', 'AMMO4': '0.088', 'weapon2': '0.188', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.456', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '70.500'} [2024-08-06 06:41:48,275][52811] DAMAGECOUNT value on done: 723890.0 [2024-08-06 06:41:48,276][52811] Sum rewards: 75.988, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.624', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.046', 'AMMO4': '0.052', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '61.500'} [2024-08-06 06:41:48,530][52662] DAMAGECOUNT value on done: 784201.0 [2024-08-06 06:41:48,532][52662] Sum rewards: 78.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.164', 'AMMO3': '0.206', 'weapon2': '0.218', 'WEAPON4': '0.300', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:49,658][52666] DAMAGECOUNT value on done: 762055.0 [2024-08-06 06:41:49,659][52666] Sum rewards: 83.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.172', 'AMMO3': '0.192', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '68.000'} [2024-08-06 06:41:49,741][52670] DAMAGECOUNT value on done: 764966.0 [2024-08-06 06:41:49,741][52670] Sum rewards: 84.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.024', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.062', 'AMMO4': '0.165', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.595', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:50,347][52795] DAMAGECOUNT value on done: 718274.0 [2024-08-06 06:41:50,348][52795] Sum rewards: 65.239, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.171', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.326', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '57.500'} [2024-08-06 06:41:50,631][52820] DAMAGECOUNT value on done: 721827.0 [2024-08-06 06:41:50,631][52820] Sum rewards: 64.955, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.325', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.108', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.328', 'weapon4': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '51.000'} [2024-08-06 06:41:51,237][52668] DAMAGECOUNT value on done: 771163.0 [2024-08-06 06:41:51,240][52668] Sum rewards: 82.777, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.440', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:51,310][52811] DAMAGECOUNT value on done: 721564.0 [2024-08-06 06:41:51,310][52811] Sum rewards: 85.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.363', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.073', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.380', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.703', 'FRAGCOUNT': '69.000'} [2024-08-06 06:41:51,488][52662] DAMAGECOUNT value on done: 785894.0 [2024-08-06 06:41:51,489][52662] Sum rewards: 76.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:51,984][52650] Updated weights for policy 0, policy_version 70801 (0.0035) [2024-08-06 06:41:52,191][52666] DAMAGECOUNT value on done: 765698.0 [2024-08-06 06:41:52,192][52666] Sum rewards: 73.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.599', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.214', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:52,303][52670] DAMAGECOUNT value on done: 773421.0 [2024-08-06 06:41:52,303][52670] Sum rewards: 73.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.096', 'AMMO3': '0.179', 'AMMO4': '0.246', 'weapon5': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.710', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '60.000'} [2024-08-06 06:41:52,636][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:41:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 580018176. Throughput: 0: 4354.0. Samples: 145008470. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:41:52,794][52567] Avg episode reward: [(0, '76.087')] [2024-08-06 06:41:53,625][52795] DAMAGECOUNT value on done: 710064.0 [2024-08-06 06:41:53,628][52795] Sum rewards: 71.060, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.168', 'AMMO3': '0.267', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.218', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:53,770][52820] DAMAGECOUNT value on done: 704911.0 [2024-08-06 06:41:53,770][52820] Sum rewards: 72.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.428', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.048', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.272', 'WEAPON3': '1.250', 'HITCOUNT': '3.380', 'weapon3': '3.404', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '58.000'} [2024-08-06 06:41:53,814][52668] DAMAGECOUNT value on done: 779233.0 [2024-08-06 06:41:53,816][52668] Sum rewards: 81.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.120', 'weapon4': '0.136', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.386', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:54,386][52803] DAMAGECOUNT value on done: 720398.0 [2024-08-06 06:41:54,387][52803] Sum rewards: 80.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.065', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon2': '0.184', 'weapon5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.218', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '67.000'} [2024-08-06 06:41:54,424][52811] DAMAGECOUNT value on done: 723502.0 [2024-08-06 06:41:54,427][52811] Sum rewards: 81.010, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.285', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'weapon2': '0.150', 'AMMO3': '0.178', 'weapon4': '0.202', 'WEAPON3': '1.250', 'weapon3': '3.404', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:54,692][52662] DAMAGECOUNT value on done: 769787.0 [2024-08-06 06:41:54,694][52662] Sum rewards: 75.990, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.116', 'weapon4': '0.174', 'AMMO4': '0.194', 'weapon2': '0.244', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.148', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '66.000'} [2024-08-06 06:41:55,213][52666] DAMAGECOUNT value on done: 780331.0 [2024-08-06 06:41:55,214][52666] Sum rewards: 75.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.134', 'weapon5': '0.144', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:55,265][52670] DAMAGECOUNT value on done: 768884.0 [2024-08-06 06:41:55,265][52670] Sum rewards: 73.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.178', 'AMMO3': '0.226', 'weapon4': '0.244', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '61.000'} [2024-08-06 06:41:56,440][52650] Updated weights for policy 0, policy_version 70811 (0.0018) [2024-08-06 06:41:56,806][52795] DAMAGECOUNT value on done: 717255.0 [2024-08-06 06:41:56,807][52795] Sum rewards: 80.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.308', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.142', 'AMMO4': '0.148', 'AMMO3': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '64.000'} [2024-08-06 06:41:56,880][52668] DAMAGECOUNT value on done: 773884.0 [2024-08-06 06:41:56,881][52668] Sum rewards: 67.522, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.039', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.086', 'weapon4': '0.118', 'AMMO4': '0.179', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '59.000'} [2024-08-06 06:41:56,933][52820] DAMAGECOUNT value on done: 714009.0 [2024-08-06 06:41:56,934][52820] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.028', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.241', 'weapon2': '0.316', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.466', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '56.000'} [2024-08-06 06:41:57,297][52662] DAMAGECOUNT value on done: 786065.0 [2024-08-06 06:41:57,297][52662] Sum rewards: 66.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.248', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.260', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '57.000'} [2024-08-06 06:41:57,552][52811] DAMAGECOUNT value on done: 729833.0 [2024-08-06 06:41:57,552][52811] Sum rewards: 71.992, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.300', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon2': '0.198', 'weapon5': '0.284', 'AMMO3': '0.294', 'AMMO4': '0.323', 'weapon4': '0.416', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.650', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 06:41:57,628][52803] DAMAGECOUNT value on done: 718182.0 [2024-08-06 06:41:57,631][52803] Sum rewards: 74.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.654', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.040', 'weapon4': '0.068', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.404', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '63.000'} [2024-08-06 06:41:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 580100096. Throughput: 0: 4346.2. Samples: 145034290. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:41:57,794][52567] Avg episode reward: [(0, '75.952')] [2024-08-06 06:41:58,083][52660] Large shaping reward 2.542 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.09, -30.0), ('weapon5', 0.002)] [2024-08-06 06:41:58,404][52670] DAMAGECOUNT value on done: 772738.0 [2024-08-06 06:41:58,405][52670] Sum rewards: 96.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.614', 'HITCOUNT': '4.380', 'DAMAGECOUNT': '22.605', 'FRAGCOUNT': '79.000'} [2024-08-06 06:41:58,495][52666] DAMAGECOUNT value on done: 756758.0 [2024-08-06 06:41:58,495][52666] Sum rewards: 86.516, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.012', 'FRAGCOUNT': '70.000'} [2024-08-06 06:41:59,685][52668] DAMAGECOUNT value on done: 768596.0 [2024-08-06 06:41:59,686][52668] Sum rewards: 63.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.684', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.068', 'weapon4': '0.076', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.274', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.388', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2024-08-06 06:41:59,971][52795] DAMAGECOUNT value on done: 724955.0 [2024-08-06 06:41:59,971][52795] Sum rewards: 73.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.695', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon2': '0.156', 'weapon5': '0.184', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.080', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '62.000'} [2024-08-06 06:42:00,196][52820] DAMAGECOUNT value on done: 718094.0 [2024-08-06 06:42:00,196][52820] Sum rewards: 86.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '70.000'} [2024-08-06 06:42:00,478][52662] DAMAGECOUNT value on done: 769578.0 [2024-08-06 06:42:00,479][52662] Sum rewards: 82.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.465', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.219', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '67.000'} [2024-08-06 06:42:00,620][52811] DAMAGECOUNT value on done: 731509.0 [2024-08-06 06:42:00,620][52811] Sum rewards: 90.740, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.830', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.090', 'weapon5': '0.188', 'AMMO3': '0.232', 'AMMO4': '0.268', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '22.092', 'FRAGCOUNT': '76.000'} [2024-08-06 06:42:00,689][52803] DAMAGECOUNT value on done: 725936.0 [2024-08-06 06:42:00,692][52803] Sum rewards: 73.845, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.039', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.136', 'weapon4': '0.144', 'AMMO4': '0.173', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.158', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '62.000'} [2024-08-06 06:42:00,768][52666] DAMAGECOUNT value on done: 767568.0 [2024-08-06 06:42:00,769][52666] Sum rewards: 79.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.579', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.282', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:01,133][52650] Updated weights for policy 0, policy_version 70821 (0.0011) [2024-08-06 06:42:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 580198400. Throughput: 0: 4350.9. Samples: 145047460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:42:02,794][52567] Avg episode reward: [(0, '76.462')] [2024-08-06 06:42:02,795][52614] Saving new best policy, reward=76.462! [2024-08-06 06:42:02,830][52668] DAMAGECOUNT value on done: 763224.0 [2024-08-06 06:42:02,830][52668] Sum rewards: 79.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.658', 'WEAPON3': '1.200', 'weapon3': '3.066', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '65.000'} [2024-08-06 06:42:03,166][52795] DAMAGECOUNT value on done: 714687.0 [2024-08-06 06:42:03,168][52795] Sum rewards: 82.480, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.038', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '68.000'} [2024-08-06 06:42:03,222][52662] DAMAGECOUNT value on done: 776127.0 [2024-08-06 06:42:03,224][52662] Sum rewards: 62.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.226', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.104', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.378', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '51.000'} [2024-08-06 06:42:03,282][52820] DAMAGECOUNT value on done: 718604.0 [2024-08-06 06:42:03,282][52820] Sum rewards: 77.746, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.628', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.158', 'AMMO3': '0.182', 'weapon4': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '62.000'} [2024-08-06 06:42:03,661][52811] DAMAGECOUNT value on done: 722829.0 [2024-08-06 06:42:03,663][52811] Sum rewards: 70.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.601', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.088', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 06:42:03,862][52803] DAMAGECOUNT value on done: 726398.0 [2024-08-06 06:42:03,863][52803] Sum rewards: 77.516, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.178', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '61.000'} [2024-08-06 06:42:05,581][52662] DAMAGECOUNT value on done: 791525.0 [2024-08-06 06:42:05,582][52662] Sum rewards: 71.816, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.362', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.144', 'weapon5': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.296', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.076', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:05,790][52650] Updated weights for policy 0, policy_version 70831 (0.0011) [2024-08-06 06:42:05,907][52668] DAMAGECOUNT value on done: 763272.0 [2024-08-06 06:42:05,911][52668] Sum rewards: 74.847, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.715', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.112', 'weapon4': '0.184', 'AMMO3': '0.189', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '62.000'} [2024-08-06 06:42:06,426][52795] DAMAGECOUNT value on done: 717297.0 [2024-08-06 06:42:06,428][52795] Sum rewards: 87.791, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.850', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.122', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'AMMO3': '0.291', 'WEAPON3': '1.900', 'weapon3': '3.300', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.841', 'FRAGCOUNT': '76.000'} [2024-08-06 06:42:06,602][52820] DAMAGECOUNT value on done: 728094.0 [2024-08-06 06:42:06,603][52820] Sum rewards: 78.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.704', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.072', 'weapon4': '0.114', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.246', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '65.000'} [2024-08-06 06:42:06,738][52811] DAMAGECOUNT value on done: 725024.0 [2024-08-06 06:42:06,738][52811] Sum rewards: 82.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.560', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.266', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '70.000'} [2024-08-06 06:42:06,899][52803] DAMAGECOUNT value on done: 723514.0 [2024-08-06 06:42:06,900][52803] Sum rewards: 61.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.589', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.254', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '52.000'} [2024-08-06 06:42:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 580280320. Throughput: 0: 4345.8. Samples: 145073660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:42:07,794][52567] Avg episode reward: [(0, '76.370')] [2024-08-06 06:42:07,948][52662] DAMAGECOUNT value on done: 777207.0 [2024-08-06 06:42:07,949][52662] Sum rewards: 77.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.033', 'AMMO2': '0.076', 'AMMO3': '0.193', 'weapon2': '0.232', 'weapon4': '0.264', 'weapon5': '0.272', 'AMMO4': '0.378', 'WEAPON4': '0.750', 'WEAPON5': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.868', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:08,687][52666] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:42:08,852][52668] DAMAGECOUNT value on done: 761710.0 [2024-08-06 06:42:08,852][52668] Sum rewards: 71.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.514', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.166', 'AMMO4': '0.193', 'AMMO3': '0.228', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '62.000'} [2024-08-06 06:42:09,611][52795] DAMAGECOUNT value on done: 720515.0 [2024-08-06 06:42:09,611][52795] Sum rewards: 79.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.011', 'weapon4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.258', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '66.000'} [2024-08-06 06:42:09,790][52820] DAMAGECOUNT value on done: 711750.0 [2024-08-06 06:42:09,791][52820] Sum rewards: 76.331, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.158', 'weapon2': '0.180', 'weapon5': '0.184', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '65.000'} [2024-08-06 06:42:09,929][52660] DAMAGECOUNT value on done: 775380.0 [2024-08-06 06:42:09,931][52660] Sum rewards: 66.904, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.892', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.128', 'weapon5': '0.136', 'AMMO4': '0.144', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '54.000'} [2024-08-06 06:42:10,045][52803] DAMAGECOUNT value on done: 723440.0 [2024-08-06 06:42:10,046][52803] Sum rewards: 67.474, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon2': '0.182', 'AMMO3': '0.298', 'WEAPON3': '1.700', 'HITCOUNT': '3.270', 'weapon3': '3.500', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '60.000'} [2024-08-06 06:42:10,757][52650] Updated weights for policy 0, policy_version 70841 (0.0011) [2024-08-06 06:42:10,860][52662] DAMAGECOUNT value on done: 783219.0 [2024-08-06 06:42:10,860][52662] Sum rewards: 55.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.102', 'AMMO4': '0.216', 'weapon5': '0.252', 'AMMO3': '0.271', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.620', 'weapon3': '2.956', 'DAMAGECOUNT': '14.568', 'FRAGCOUNT': '48.000'} [2024-08-06 06:42:11,559][52668] DAMAGECOUNT value on done: 773654.0 [2024-08-06 06:42:11,560][52668] Sum rewards: 82.075, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.340', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.167', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.562', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '66.000'} [2024-08-06 06:42:12,666][52795] DAMAGECOUNT value on done: 715605.0 [2024-08-06 06:42:12,669][52795] Sum rewards: 85.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.155', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.226', 'AMMO3': '0.228', 'WEAPON3': '1.450', 'weapon3': '3.560', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '72.000'} [2024-08-06 06:42:12,686][52660] DAMAGECOUNT value on done: 765159.0 [2024-08-06 06:42:12,687][52660] Sum rewards: 69.414, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.470', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.074', 'weapon5': '0.176', 'AMMO4': '0.209', 'AMMO3': '0.248', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '59.000'} [2024-08-06 06:42:12,763][52820] DAMAGECOUNT value on done: 720931.0 [2024-08-06 06:42:12,767][52820] Sum rewards: 90.353, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.124', 'AMMO4': '0.131', 'HEALTH': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.296', 'WEAPON3': '1.150', 'weapon3': '3.302', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '73.000'} [2024-08-06 06:42:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 580362240. Throughput: 0: 4355.8. Samples: 145099700. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:42:12,795][52567] Avg episode reward: [(0, '75.833')] [2024-08-06 06:42:13,165][52803] DAMAGECOUNT value on done: 715643.0 [2024-08-06 06:42:13,173][52803] Sum rewards: 70.476, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.472', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.104', 'weapon5': '0.174', 'AMMO3': '0.186', 'AMMO4': '0.205', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.254', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '56.000'} [2024-08-06 06:42:13,300][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:42:13,631][52662] DAMAGECOUNT value on done: 773358.0 [2024-08-06 06:42:13,631][52662] Sum rewards: 69.284, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.370', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.042', 'weapon5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '60.500'} [2024-08-06 06:42:13,963][52668] DAMAGECOUNT value on done: 776428.0 [2024-08-06 06:42:13,963][52668] Sum rewards: 69.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.759', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO4': '0.171', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '56.000'} [2024-08-06 06:42:14,484][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:42:14,917][52650] Updated weights for policy 0, policy_version 70851 (0.0012) [2024-08-06 06:42:15,778][52795] DAMAGECOUNT value on done: 710145.0 [2024-08-06 06:42:15,780][52795] Sum rewards: 73.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'weapon4': '0.122', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '62.000'} [2024-08-06 06:42:15,808][52820] DAMAGECOUNT value on done: 727637.0 [2024-08-06 06:42:15,811][52820] Sum rewards: 75.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.655', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.090', 'AMMO4': '0.174', 'weapon5': '0.176', 'weapon2': '0.190', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:15,815][52660] DAMAGECOUNT value on done: 778464.0 [2024-08-06 06:42:15,815][52660] Sum rewards: 76.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.344', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.146', 'weapon5': '0.166', 'weapon2': '0.222', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.270', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '65.000'} [2024-08-06 06:42:16,267][52662] DAMAGECOUNT value on done: 776507.0 [2024-08-06 06:42:16,268][52662] Sum rewards: 71.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.554', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.192', 'AMMO3': '0.217', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'weapon4': '0.414', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '58.000'} [2024-08-06 06:42:16,355][52803] DAMAGECOUNT value on done: 714725.0 [2024-08-06 06:42:16,358][52803] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.132', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.002', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '60.000'} [2024-08-06 06:42:17,350][52668] DAMAGECOUNT value on done: 773055.0 [2024-08-06 06:42:17,351][52668] Sum rewards: 79.037, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO3': '0.150', 'AMMO4': '0.171', 'weapon4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 580460544. Throughput: 0: 4357.3. Samples: 145112850. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:42:17,795][52567] Avg episode reward: [(0, '75.849')] [2024-08-06 06:42:18,512][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:42:18,865][52795] DAMAGECOUNT value on done: 712297.0 [2024-08-06 06:42:18,866][52795] Sum rewards: 80.413, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.325', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.158', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'weapon4': '0.424', 'WEAPON3': '1.000', 'weapon3': '2.940', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:18,877][52820] DAMAGECOUNT value on done: 720476.0 [2024-08-06 06:42:18,877][52820] Sum rewards: 68.658, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.117', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.054', 'weapon5': '0.136', 'AMMO4': '0.191', 'AMMO3': '0.193', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.366', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '55.000'} [2024-08-06 06:42:18,904][52660] DAMAGECOUNT value on done: 787270.0 [2024-08-06 06:42:18,906][52660] Sum rewards: 80.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO3': '0.169', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.300', 'weapon4': '0.380', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:19,076][52662] DAMAGECOUNT value on done: 769939.0 [2024-08-06 06:42:19,077][52662] Sum rewards: 81.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.012', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.116', 'AMMO3': '0.220', 'weapon5': '0.246', 'AMMO4': '0.267', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '67.000'} [2024-08-06 06:42:19,375][52803] DAMAGECOUNT value on done: 720104.0 [2024-08-06 06:42:19,375][52803] Sum rewards: 84.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.100', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.600', 'weapon3': '3.468', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.453', 'FRAGCOUNT': '70.000'} [2024-08-06 06:42:20,075][52650] Updated weights for policy 0, policy_version 70861 (0.0012) [2024-08-06 06:42:20,537][52668] DAMAGECOUNT value on done: 780104.0 [2024-08-06 06:42:20,538][52668] Sum rewards: 79.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.798', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'weapon4': '0.222', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:22,024][52795] DAMAGECOUNT value on done: 721274.0 [2024-08-06 06:42:22,026][52795] Sum rewards: 66.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.395', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.174', 'weapon5': '0.188', 'AMMO3': '0.237', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '56.000'} [2024-08-06 06:42:22,114][52820] DAMAGECOUNT value on done: 723531.0 [2024-08-06 06:42:22,116][52820] Sum rewards: 72.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.380', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.106', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.050', 'weapon3': '3.330', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '59.000'} [2024-08-06 06:42:22,136][52662] DAMAGECOUNT value on done: 781458.0 [2024-08-06 06:42:22,138][52662] Sum rewards: 77.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.875', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon5': '0.194', 'weapon4': '0.224', 'AMMO3': '0.234', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '66.000'} [2024-08-06 06:42:22,151][52660] DAMAGECOUNT value on done: 770070.0 [2024-08-06 06:42:22,152][52660] Sum rewards: 65.605, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.352', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.112', 'weapon5': '0.112', 'AMMO3': '0.157', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.816', 'WEAPON3': '0.900', 'weapon3': '2.782', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '51.000'} [2024-08-06 06:42:22,462][52803] DAMAGECOUNT value on done: 719461.0 [2024-08-06 06:42:22,463][52803] Sum rewards: 73.671, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.440', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.078', 'weapon5': '0.196', 'weapon2': '0.218', 'AMMO3': '0.221', 'AMMO4': '0.248', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17203.3, 300 sec: 17411.5). Total num frames: 580534272. Throughput: 0: 4365.8. Samples: 145139050. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:42:22,796][52567] Avg episode reward: [(0, '76.192')] [2024-08-06 06:42:23,600][52668] DAMAGECOUNT value on done: 778310.0 [2024-08-06 06:42:23,608][52668] Sum rewards: 71.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.728', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.082', 'weapon4': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '59.000'} [2024-08-06 06:42:24,742][52650] Updated weights for policy 0, policy_version 70871 (0.0012) [2024-08-06 06:42:25,079][52662] DAMAGECOUNT value on done: 767874.0 [2024-08-06 06:42:25,081][52662] Sum rewards: 70.006, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.463', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.122', 'weapon5': '0.158', 'AMMO4': '0.188', 'weapon2': '0.202', 'AMMO3': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.218', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '62.000'} [2024-08-06 06:42:25,254][52660] DAMAGECOUNT value on done: 764554.0 [2024-08-06 06:42:25,254][52660] Sum rewards: 68.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'weapon4': '0.112', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.242', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '59.000'} [2024-08-06 06:42:25,298][52820] DAMAGECOUNT value on done: 719392.0 [2024-08-06 06:42:25,298][52820] Sum rewards: 78.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.072', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.226', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:25,387][52795] DAMAGECOUNT value on done: 705204.0 [2024-08-06 06:42:25,388][52795] Sum rewards: 66.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.125', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.112', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '54.000'} [2024-08-06 06:42:25,533][52803] DAMAGECOUNT value on done: 732626.0 [2024-08-06 06:42:25,535][52803] Sum rewards: 63.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.265', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.064', 'AMMO4': '0.194', 'weapon4': '0.216', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '55.000'} [2024-08-06 06:42:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 580624384. Throughput: 0: 4363.8. Samples: 145165260. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:42:27,794][52567] Avg episode reward: [(0, '75.690')] [2024-08-06 06:42:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070877_580624384.pth... [2024-08-06 06:42:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070367_576446464.pth [2024-08-06 06:42:28,049][52662] DAMAGECOUNT value on done: 785074.0 [2024-08-06 06:42:28,052][52662] Sum rewards: 68.183, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon2': '0.198', 'weapon5': '0.198', 'weapon4': '0.228', 'AMMO3': '0.229', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.000'} [2024-08-06 06:42:28,107][52660] DAMAGECOUNT value on done: 775149.0 [2024-08-06 06:42:28,108][52660] Sum rewards: 79.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.096', 'AMMO3': '0.170', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.050', 'weapon3': '3.288', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:28,343][52667] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 06:42:28,473][52820] DAMAGECOUNT value on done: 721187.0 [2024-08-06 06:42:28,474][52820] Sum rewards: 64.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.106', 'AMMO4': '0.123', 'weapon5': '0.128', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '53.000'} [2024-08-06 06:42:28,626][52795] DAMAGECOUNT value on done: 723293.0 [2024-08-06 06:42:28,627][52795] Sum rewards: 86.751, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'weapon2': '0.210', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.450', 'weapon3': '3.402', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '74.000'} [2024-08-06 06:42:28,777][52803] DAMAGECOUNT value on done: 723465.0 [2024-08-06 06:42:28,779][52803] Sum rewards: 72.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.182', 'weapon5': '0.190', 'AMMO3': '0.211', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '2.590', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '60.000'} [2024-08-06 06:42:29,367][52650] Updated weights for policy 0, policy_version 70881 (0.0012) [2024-08-06 06:42:30,542][52662] DAMAGECOUNT value on done: 778360.0 [2024-08-06 06:42:30,545][52662] Sum rewards: 73.271, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.925', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.022', 'AMMO4': '0.073', 'weapon5': '0.092', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.378', 'WEAPON3': '0.950', 'weapon3': '3.256', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '58.000'} [2024-08-06 06:42:31,043][52660] DAMAGECOUNT value on done: 781566.0 [2024-08-06 06:42:31,046][52660] Sum rewards: 74.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.090', 'weapon4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:31,627][52820] DAMAGECOUNT value on done: 733755.0 [2024-08-06 06:42:31,628][52820] Sum rewards: 73.412, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO5': '0.010', 'weapon4': '0.034', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO3': '0.149', 'AMMO4': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '0.900', 'HITCOUNT': '3.180', 'weapon3': '3.338', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '57.000'} [2024-08-06 06:42:31,839][52795] DAMAGECOUNT value on done: 718920.0 [2024-08-06 06:42:31,843][52795] Sum rewards: 65.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.090', 'AMMO4': '0.179', 'AMMO3': '0.182', 'weapon5': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '54.000'} [2024-08-06 06:42:31,928][52803] DAMAGECOUNT value on done: 724530.0 [2024-08-06 06:42:31,931][52803] Sum rewards: 78.038, reward structure: {'DEATHCOUNT': '-14.250', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.585', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:32,149][52658] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)] [2024-08-06 06:42:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17411.5). Total num frames: 580714496. Throughput: 0: 4350.2. Samples: 145178040. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:42:32,794][52567] Avg episode reward: [(0, '75.292')] [2024-08-06 06:42:33,589][52662] DAMAGECOUNT value on done: 764902.0 [2024-08-06 06:42:33,591][52662] Sum rewards: 43.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.490', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon5': '0.162', 'AMMO3': '0.273', 'weapon2': '0.288', 'AMMO4': '0.317', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon4': '0.610', 'WEAPON3': '1.550', 'weapon3': '2.420', 'HITCOUNT': '2.620', 'DAMAGECOUNT': '12.117', 'FRAGCOUNT': '42.000'} [2024-08-06 06:42:34,033][52803] Large shaping reward 2.530 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0)] [2024-08-06 06:42:34,142][52650] Updated weights for policy 0, policy_version 70891 (0.0014) [2024-08-06 06:42:34,151][52660] DAMAGECOUNT value on done: 767314.0 [2024-08-06 06:42:34,155][52660] Sum rewards: 74.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.062', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.386', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:34,734][52820] DAMAGECOUNT value on done: 729342.0 [2024-08-06 06:42:34,736][52820] Sum rewards: 69.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.431', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.110', 'weapon4': '0.124', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '59.000'} [2024-08-06 06:42:34,845][52803] DAMAGECOUNT value on done: 735915.0 [2024-08-06 06:42:34,846][52803] Sum rewards: 70.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.526', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '60.000'} [2024-08-06 06:42:34,931][52795] DAMAGECOUNT value on done: 711208.0 [2024-08-06 06:42:34,932][52795] Sum rewards: 78.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.896', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'AMMO3': '0.194', 'weapon2': '0.194', 'WEAPON3': '1.250', 'HITCOUNT': '3.360', 'weapon3': '3.608', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:35,292][52669] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:42:36,297][52662] DAMAGECOUNT value on done: 776799.0 [2024-08-06 06:42:36,297][52662] Sum rewards: 74.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.800', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.162', 'weapon2': '0.186', 'AMMO3': '0.262', 'weapon4': '0.268', 'AMMO4': '0.281', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.092', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:37,078][52660] DAMAGECOUNT value on done: 769459.0 [2024-08-06 06:42:37,079][52660] Sum rewards: 66.670, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'weapon4': '0.034', 'AMMO2': '0.050', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'AMMO3': '0.275', 'weapon2': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '58.000'} [2024-08-06 06:42:37,220][52659] DAMAGECOUNT value on done: 778514.0 [2024-08-06 06:42:37,221][52659] Sum rewards: 70.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.015', 'AMMO2': '0.018', 'weapon4': '0.068', 'AMMO4': '0.089', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '60.000'} [2024-08-06 06:42:37,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 580804608. Throughput: 0: 4352.9. Samples: 145204350. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:42:37,795][52567] Avg episode reward: [(0, '74.597')] [2024-08-06 06:42:37,991][52820] DAMAGECOUNT value on done: 715485.0 [2024-08-06 06:42:37,992][52820] Sum rewards: 72.628, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.667', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.102', 'weapon5': '0.180', 'AMMO4': '0.189', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '2.850', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '61.000'} [2024-08-06 06:42:38,112][52795] DAMAGECOUNT value on done: 717831.0 [2024-08-06 06:42:38,112][52795] Sum rewards: 77.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.569', 'AMMO5': '0.013', 'weapon4': '0.044', 'AMMO2': '0.049', 'weapon5': '0.138', 'weapon2': '0.198', 'AMMO3': '0.209', 'AMMO4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:38,118][52803] DAMAGECOUNT value on done: 721091.0 [2024-08-06 06:42:38,120][52803] Sum rewards: 70.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.361', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.112', 'AMMO4': '0.193', 'weapon5': '0.206', 'AMMO3': '0.225', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '58.000'} [2024-08-06 06:42:38,695][52650] Updated weights for policy 0, policy_version 70901 (0.0011) [2024-08-06 06:42:39,112][52662] DAMAGECOUNT value on done: 766894.0 [2024-08-06 06:42:39,114][52662] Sum rewards: 75.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.452', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.084', 'weapon5': '0.102', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.196', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:40,396][52659] DAMAGECOUNT value on done: 777608.0 [2024-08-06 06:42:40,398][52659] Sum rewards: 72.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.605', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.084', 'weapon5': '0.092', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '61.000'} [2024-08-06 06:42:40,547][52660] DAMAGECOUNT value on done: 775272.0 [2024-08-06 06:42:40,548][52660] Sum rewards: 67.224, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.435', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon2': '0.146', 'AMMO3': '0.195', 'AMMO4': '0.199', 'weapon5': '0.216', 'weapon4': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '55.000'} [2024-08-06 06:42:40,566][52667] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:42:41,142][52803] DAMAGECOUNT value on done: 723858.0 [2024-08-06 06:42:41,146][52803] Sum rewards: 78.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.829', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.458', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:41,184][52795] DAMAGECOUNT value on done: 724570.0 [2024-08-06 06:42:41,185][52795] Sum rewards: 77.873, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.172', 'weapon2': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.239', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.016', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '66.000'} [2024-08-06 06:42:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 580894720. Throughput: 0: 4358.0. Samples: 145230400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:42:42,794][52567] Avg episode reward: [(0, '74.303')] [2024-08-06 06:42:42,918][52664] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:42:42,979][52667] DAMAGECOUNT value on done: 775856.0 [2024-08-06 06:42:42,981][52667] Sum rewards: 67.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.164', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO3': '0.201', 'weapon2': '0.202', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.532', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.000'} [2024-08-06 06:42:43,206][52650] Updated weights for policy 0, policy_version 70911 (0.0017) [2024-08-06 06:42:43,510][52659] DAMAGECOUNT value on done: 781693.0 [2024-08-06 06:42:43,510][52659] Sum rewards: 84.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.092', 'AMMO3': '0.210', 'AMMO4': '0.230', 'weapon2': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '69.000'} [2024-08-06 06:42:43,653][52660] DAMAGECOUNT value on done: 767080.0 [2024-08-06 06:42:43,655][52660] Sum rewards: 71.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.578', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.152', 'AMMO3': '0.216', 'AMMO4': '0.220', 'weapon4': '0.284', 'weapon2': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '60.000'} [2024-08-06 06:42:44,278][52803] DAMAGECOUNT value on done: 726453.0 [2024-08-06 06:42:44,286][52803] Sum rewards: 74.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.805', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.114', 'AMMO4': '0.172', 'weapon5': '0.182', 'AMMO3': '0.184', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.288', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '61.000'} [2024-08-06 06:42:45,862][52667] DAMAGECOUNT value on done: 783129.0 [2024-08-06 06:42:45,863][52667] Sum rewards: 69.715, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.259', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.124', 'weapon4': '0.132', 'AMMO4': '0.185', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '59.500'} [2024-08-06 06:42:46,540][52659] DAMAGECOUNT value on done: 778270.0 [2024-08-06 06:42:46,541][52659] Sum rewards: 76.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.594', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.190', 'AMMO3': '0.194', 'weapon2': '0.212', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.280', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:46,670][52660] DAMAGECOUNT value on done: 775033.0 [2024-08-06 06:42:46,670][52660] Sum rewards: 75.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.156', 'weapon4': '0.220', 'AMMO3': '0.230', 'AMMO4': '0.270', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '63.000'} [2024-08-06 06:42:47,388][52803] DAMAGECOUNT value on done: 730144.0 [2024-08-06 06:42:47,388][52803] Sum rewards: 76.158, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.086', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon2': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.255', 'WEAPON3': '1.500', 'weapon3': '3.426', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '66.000'} [2024-08-06 06:42:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 580976640. Throughput: 0: 4363.8. Samples: 145243830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:42:47,794][52567] Avg episode reward: [(0, '74.162')] [2024-08-06 06:42:48,099][52650] Updated weights for policy 0, policy_version 70921 (0.0013) [2024-08-06 06:42:48,855][52667] DAMAGECOUNT value on done: 781460.0 [2024-08-06 06:42:48,857][52667] Sum rewards: 73.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.142', 'weapon4': '0.174', 'AMMO4': '0.204', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '61.000'} [2024-08-06 06:42:48,889][52659] DAMAGECOUNT value on done: 776882.0 [2024-08-06 06:42:48,889][52659] Sum rewards: 73.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.126', 'AMMO3': '0.213', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '61.000'} [2024-08-06 06:42:49,731][52660] DAMAGECOUNT value on done: 784911.0 [2024-08-06 06:42:49,735][52660] Sum rewards: 69.083, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.088', 'weapon5': '0.106', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.346', 'HEALTH': '0.880', 'WEAPON3': '0.900', 'weapon3': '3.164', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '55.000'} [2024-08-06 06:42:50,542][52803] DAMAGECOUNT value on done: 730953.0 [2024-08-06 06:42:50,544][52803] Sum rewards: 70.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.626', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '59.000'} [2024-08-06 06:42:51,721][52659] DAMAGECOUNT value on done: 778697.0 [2024-08-06 06:42:51,722][52659] Sum rewards: 79.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.134', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.124', 'weapon4': '0.168', 'AMMO3': '0.196', 'AMMO4': '0.197', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:51,985][52667] DAMAGECOUNT value on done: 786639.0 [2024-08-06 06:42:51,985][52667] Sum rewards: 83.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.632', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.190', 'weapon2': '0.202', 'AMMO3': '0.232', 'AMMO4': '0.239', 'weapon4': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '70.000'} [2024-08-06 06:42:52,465][52660] DAMAGECOUNT value on done: 793647.0 [2024-08-06 06:42:52,465][52660] Sum rewards: 77.172, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.159', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.082', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.192', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '66.000'} [2024-08-06 06:42:52,691][52650] Updated weights for policy 0, policy_version 70931 (0.0016) [2024-08-06 06:42:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 581066752. Throughput: 0: 4364.4. Samples: 145270060. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:42:52,794][52567] Avg episode reward: [(0, '74.393')] [2024-08-06 06:42:53,557][52803] DAMAGECOUNT value on done: 726294.0 [2024-08-06 06:42:53,557][52803] Sum rewards: 84.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.007', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.210', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.548', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '70.000'} [2024-08-06 06:42:54,705][52659] DAMAGECOUNT value on done: 779027.0 [2024-08-06 06:42:54,706][52659] Sum rewards: 66.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.094', 'AMMO4': '0.144', 'weapon4': '0.154', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.304', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '55.000'} [2024-08-06 06:42:55,084][52667] DAMAGECOUNT value on done: 788197.0 [2024-08-06 06:42:55,085][52667] Sum rewards: 78.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.073', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '62.500'} [2024-08-06 06:42:55,424][52660] DAMAGECOUNT value on done: 771013.0 [2024-08-06 06:42:55,424][52660] Sum rewards: 75.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.719', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.171', 'AMMO4': '0.287', 'weapon5': '0.306', 'weapon4': '0.490', 'weapon2': '0.492', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.250', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '59.000'} [2024-08-06 06:42:55,792][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:42:55,933][52649] DAMAGECOUNT value on done: 753374.0 [2024-08-06 06:42:55,934][52649] Sum rewards: 85.146, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.569', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.140', 'weapon5': '0.180', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '0.850', 'weapon3': '2.956', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '67.000'} [2024-08-06 06:42:57,071][52659] DAMAGECOUNT value on done: 776264.0 [2024-08-06 06:42:57,073][52659] Sum rewards: 65.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.023', 'AMMO2': '0.063', 'weapon4': '0.114', 'AMMO3': '0.216', 'weapon5': '0.266', 'AMMO4': '0.317', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon2': '0.712', 'WEAPON3': '1.350', 'weapon3': '2.614', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '53.000'} [2024-08-06 06:42:57,425][52650] Updated weights for policy 0, policy_version 70941 (0.0026) [2024-08-06 06:42:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 581148672. Throughput: 0: 4366.7. Samples: 145296200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:42:57,795][52567] Avg episode reward: [(0, '74.151')] [2024-08-06 06:42:57,993][52660] DAMAGECOUNT value on done: 779883.0 [2024-08-06 06:42:57,995][52660] Sum rewards: 82.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.194', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 06:42:58,448][52667] DAMAGECOUNT value on done: 785259.0 [2024-08-06 06:42:58,448][52667] Sum rewards: 77.050, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.124', 'weapon5': '0.160', 'AMMO4': '0.187', 'AMMO3': '0.211', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '64.000'} [2024-08-06 06:42:58,510][52649] DAMAGECOUNT value on done: 745818.0 [2024-08-06 06:42:58,510][52649] Sum rewards: 83.484, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.118', 'weapon5': '0.128', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.464', 'WEAPON3': '0.950', 'weapon3': '3.194', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '66.000'} [2024-08-06 06:43:00,174][52659] DAMAGECOUNT value on done: 781404.0 [2024-08-06 06:43:00,182][52659] Sum rewards: 69.603, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.195', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon2': '0.112', 'weapon5': '0.138', 'AMMO4': '0.149', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:00,901][52660] DAMAGECOUNT value on done: 777701.0 [2024-08-06 06:43:00,901][52660] Sum rewards: 90.341, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.035', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.076', 'weapon5': '0.120', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.302', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '22.662', 'FRAGCOUNT': '76.000'} [2024-08-06 06:43:01,062][52667] DAMAGECOUNT value on done: 782601.0 [2024-08-06 06:43:01,064][52667] Sum rewards: 67.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.265', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon2': '0.202', 'AMMO3': '0.216', 'weapon4': '0.218', 'weapon5': '0.284', 'AMMO4': '0.322', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:01,739][52649] DAMAGECOUNT value on done: 764513.0 [2024-08-06 06:43:01,740][52649] Sum rewards: 56.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon4': '0.050', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '3.070', 'DAMAGECOUNT': '13.821', 'FRAGCOUNT': '48.000'} [2024-08-06 06:43:02,297][52650] Updated weights for policy 0, policy_version 70951 (0.0013) [2024-08-06 06:43:02,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 581238784. Throughput: 0: 4365.5. Samples: 145309300. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:43:02,795][52567] Avg episode reward: [(0, '73.913')] [2024-08-06 06:43:03,263][52659] DAMAGECOUNT value on done: 785388.0 [2024-08-06 06:43:03,264][52659] Sum rewards: 73.440, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.934', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.202', 'AMMO3': '0.206', 'weapon4': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '2.656', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '60.000'} [2024-08-06 06:43:03,434][52660] DAMAGECOUNT value on done: 767504.0 [2024-08-06 06:43:03,435][52660] Sum rewards: 73.309, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.796', 'AMMO2': '0.018', 'AMMO4': '0.088', 'AMMO3': '0.142', 'weapon2': '0.322', 'WEAPON3': '0.950', 'HITCOUNT': '3.390', 'weapon3': '3.602', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '58.000'} [2024-08-06 06:43:03,696][52667] DAMAGECOUNT value on done: 779144.0 [2024-08-06 06:43:03,697][52667] Sum rewards: 70.816, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.069', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.174', 'AMMO4': '0.206', 'weapon2': '0.214', 'weapon5': '0.242', 'AMMO3': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.900', 'weapon3': '2.992', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:04,894][52649] DAMAGECOUNT value on done: 759433.0 [2024-08-06 06:43:04,895][52649] Sum rewards: 66.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.215', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:05,999][52667] DAMAGECOUNT value on done: 780960.0 [2024-08-06 06:43:05,999][52667] Sum rewards: 66.103, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '53.500'} [2024-08-06 06:43:06,403][52660] DAMAGECOUNT value on done: 767648.0 [2024-08-06 06:43:06,404][52660] Sum rewards: 64.461, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.113', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.240', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '54.000'} [2024-08-06 06:43:06,511][52659] DAMAGECOUNT value on done: 773865.0 [2024-08-06 06:43:06,511][52659] Sum rewards: 80.690, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.475', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.284', 'WEAPON3': '1.250', 'weapon3': '3.574', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '66.000'} [2024-08-06 06:43:06,821][52650] Updated weights for policy 0, policy_version 70961 (0.0027) [2024-08-06 06:43:07,252][52670] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:43:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 581328896. Throughput: 0: 4367.3. Samples: 145335580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:43:07,794][52567] Avg episode reward: [(0, '73.474')] [2024-08-06 06:43:08,031][52649] DAMAGECOUNT value on done: 748231.0 [2024-08-06 06:43:08,034][52649] Sum rewards: 60.157, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.068', 'AMMO5': '0.025', 'AMMO2': '0.046', 'AMMO4': '0.232', 'weapon5': '0.244', 'AMMO3': '0.263', 'weapon2': '0.276', 'weapon4': '0.380', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.706', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.132', 'FRAGCOUNT': '53.000'} [2024-08-06 06:43:08,324][52667] DAMAGECOUNT value on done: 786662.0 [2024-08-06 06:43:08,326][52667] Sum rewards: 63.176, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.115', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.320', 'weapon2': '0.444', 'WEAPON3': '1.850', 'weapon3': '3.098', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:09,635][52659] DAMAGECOUNT value on done: 783224.0 [2024-08-06 06:43:09,636][52659] Sum rewards: 70.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.218', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.126', 'AMMO3': '0.148', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.000', 'HITCOUNT': '3.240', 'weapon3': '3.300', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:10,363][52794] DAMAGECOUNT value on done: 773973.0 [2024-08-06 06:43:10,365][52794] Sum rewards: 77.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.004', 'AMMO2': '0.035', 'weapon5': '0.038', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:11,220][52667] DAMAGECOUNT value on done: 777606.0 [2024-08-06 06:43:11,220][52667] Sum rewards: 76.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.140', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.396', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:11,249][52649] DAMAGECOUNT value on done: 763196.0 [2024-08-06 06:43:11,252][52649] Sum rewards: 63.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.430', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.142', 'AMMO3': '0.205', 'weapon5': '0.238', 'AMMO4': '0.261', 'weapon2': '0.358', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '2.998', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '53.000'} [2024-08-06 06:43:11,251][52650] Updated weights for policy 0, policy_version 70971 (0.0026) [2024-08-06 06:43:12,748][52659] DAMAGECOUNT value on done: 777030.0 [2024-08-06 06:43:12,748][52659] Sum rewards: 71.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.108', 'weapon5': '0.120', 'AMMO4': '0.147', 'AMMO3': '0.211', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '58.000'} [2024-08-06 06:43:12,766][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:43:12,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 581410816. Throughput: 0: 4365.8. Samples: 145361720. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:43:12,794][52567] Avg episode reward: [(0, '73.152')] [2024-08-06 06:43:13,471][52794] DAMAGECOUNT value on done: 781682.0 [2024-08-06 06:43:13,473][52794] Sum rewards: 94.525, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.535', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.161', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '3.424', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '76.000'} [2024-08-06 06:43:14,211][52649] DAMAGECOUNT value on done: 759249.0 [2024-08-06 06:43:14,212][52649] Sum rewards: 75.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.144', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.174', 'AMMO3': '0.218', 'AMMO4': '0.220', 'weapon2': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:14,245][52667] DAMAGECOUNT value on done: 779111.0 [2024-08-06 06:43:14,245][52667] Sum rewards: 62.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.186', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.176', 'AMMO4': '0.210', 'weapon5': '0.224', 'AMMO3': '0.227', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.536', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '54.000'} [2024-08-06 06:43:15,769][52659] DAMAGECOUNT value on done: 778964.0 [2024-08-06 06:43:15,770][52659] Sum rewards: 69.933, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.321', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.084', 'weapon5': '0.210', 'AMMO3': '0.247', 'AMMO4': '0.286', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:16,459][52650] Updated weights for policy 0, policy_version 70981 (0.0024) [2024-08-06 06:43:16,585][52794] DAMAGECOUNT value on done: 786542.0 [2024-08-06 06:43:16,586][52794] Sum rewards: 55.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.590', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.249', 'weapon2': '0.286', 'WEAPON3': '1.550', 'HITCOUNT': '2.760', 'weapon3': '3.282', 'DAMAGECOUNT': '14.193', 'FRAGCOUNT': '50.000'} [2024-08-06 06:43:16,916][52667] DAMAGECOUNT value on done: 787377.0 [2024-08-06 06:43:16,917][52667] Sum rewards: 68.909, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.168', 'AMMO4': '0.184', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.600', 'HITCOUNT': '3.140', 'weapon3': '3.158', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '60.000'} [2024-08-06 06:43:17,328][52649] DAMAGECOUNT value on done: 760512.0 [2024-08-06 06:43:17,328][52649] Sum rewards: 83.752, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.118', 'weapon5': '0.134', 'weapon2': '0.192', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:17,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 581500928. Throughput: 0: 4374.8. Samples: 145374910. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 06:43:17,795][52567] Avg episode reward: [(0, '73.055')] [2024-08-06 06:43:18,819][52663] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.117, -39.0), ('weapon5', 0.002)] [2024-08-06 06:43:19,007][52659] DAMAGECOUNT value on done: 780766.0 [2024-08-06 06:43:19,007][52659] Sum rewards: 73.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.865', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.054', 'weapon4': '0.074', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.334', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '59.000'} [2024-08-06 06:43:19,773][52794] DAMAGECOUNT value on done: 771881.0 [2024-08-06 06:43:19,774][52794] Sum rewards: 83.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.126', 'weapon5': '0.138', 'AMMO4': '0.161', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '69.000'} [2024-08-06 06:43:19,861][52667] DAMAGECOUNT value on done: 775634.0 [2024-08-06 06:43:19,869][52667] Sum rewards: 75.743, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.730', 'AMMO5': '0.006', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.212', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '59.000'} [2024-08-06 06:43:19,978][52614] Signal inference workers to stop experience collection... (12950 times) [2024-08-06 06:43:19,978][52614] Signal inference workers to resume experience collection... (12950 times) [2024-08-06 06:43:20,009][52650] InferenceWorker_p0-w0: stopping experience collection (12950 times) [2024-08-06 06:43:20,013][52650] InferenceWorker_p0-w0: resuming experience collection (12950 times) [2024-08-06 06:43:20,224][52649] DAMAGECOUNT value on done: 760255.0 [2024-08-06 06:43:20,225][52649] Sum rewards: 76.286, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.325', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.046', 'weapon4': '0.096', 'WEAPON4': '0.150', 'AMMO4': '0.173', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'WEAPON3': '1.750', 'HITCOUNT': '3.450', 'weapon3': '3.458', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:20,816][52650] Updated weights for policy 0, policy_version 70991 (0.0022) [2024-08-06 06:43:22,102][52659] DAMAGECOUNT value on done: 780388.0 [2024-08-06 06:43:22,103][52659] Sum rewards: 65.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.575', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.114', 'AMMO4': '0.124', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'HITCOUNT': '3.140', 'weapon3': '3.450', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:22,359][52667] DAMAGECOUNT value on done: 782199.0 [2024-08-06 06:43:22,361][52667] Sum rewards: 72.673, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.751', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon5': '0.132', 'weapon4': '0.162', 'weapon2': '0.228', 'WEAPON5': '0.250', 'AMMO4': '0.256', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.226', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:22,705][52664] DAMAGECOUNT value on done: 804284.0 [2024-08-06 06:43:22,706][52664] Sum rewards: 78.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon4': '0.178', 'AMMO3': '0.196', 'weapon2': '0.242', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17439.2). Total num frames: 581591040. Throughput: 0: 4377.8. Samples: 145401350. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:22,795][52567] Avg episode reward: [(0, '73.239')] [2024-08-06 06:43:22,903][52794] DAMAGECOUNT value on done: 771299.0 [2024-08-06 06:43:22,903][52794] Sum rewards: 60.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.072', 'AMMO4': '0.148', 'weapon4': '0.150', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.178', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '53.000'} [2024-08-06 06:43:23,292][52649] DAMAGECOUNT value on done: 753731.0 [2024-08-06 06:43:23,293][52649] Sum rewards: 64.375, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.522', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.134', 'AMMO4': '0.185', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '52.000'} [2024-08-06 06:43:25,080][52667] DAMAGECOUNT value on done: 788329.0 [2024-08-06 06:43:25,081][52667] Sum rewards: 65.679, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.122', 'weapon5': '0.134', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '54.000'} [2024-08-06 06:43:25,175][52794] DAMAGECOUNT value on done: 778557.0 [2024-08-06 06:43:25,176][52794] Sum rewards: 75.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.348', 'WEAPON3': '1.600', 'weapon3': '3.312', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 06:43:25,203][52659] DAMAGECOUNT value on done: 788094.0 [2024-08-06 06:43:25,204][52659] Sum rewards: 76.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.074', 'AMMO4': '0.156', 'weapon5': '0.172', 'AMMO3': '0.216', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:25,419][52650] Updated weights for policy 0, policy_version 71001 (0.0014) [2024-08-06 06:43:25,571][52664] DAMAGECOUNT value on done: 810894.0 [2024-08-06 06:43:25,571][52664] Sum rewards: 76.371, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.596', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.102', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '61.000'} [2024-08-06 06:43:26,431][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:43:26,970][52649] DAMAGECOUNT value on done: 764597.0 [2024-08-06 06:43:26,970][52649] Sum rewards: 69.369, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.372', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.106', 'AMMO4': '0.198', 'weapon5': '0.204', 'AMMO3': '0.284', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.046', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '61.000'} [2024-08-06 06:43:27,248][52667] DAMAGECOUNT value on done: 786504.0 [2024-08-06 06:43:27,256][52667] Sum rewards: 62.117, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.308', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO3': '0.116', 'AMMO4': '0.136', 'weapon5': '0.192', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '0.800', 'weapon3': '2.828', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '48.000'} [2024-08-06 06:43:27,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 581672960. Throughput: 0: 4382.4. Samples: 145427610. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:27,794][52567] Avg episode reward: [(0, '72.527')] [2024-08-06 06:43:27,817][52794] DAMAGECOUNT value on done: 782690.0 [2024-08-06 06:43:27,817][52794] Sum rewards: 74.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.426', 'AMMO5': '0.022', 'AMMO2': '0.050', 'weapon4': '0.154', 'AMMO3': '0.207', 'AMMO4': '0.251', 'weapon5': '0.268', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:28,230][52659] DAMAGECOUNT value on done: 775683.0 [2024-08-06 06:43:28,232][52659] Sum rewards: 82.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.244', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.084', 'weapon5': '0.202', 'AMMO3': '0.228', 'AMMO4': '0.259', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:28,767][52664] DAMAGECOUNT value on done: 808820.0 [2024-08-06 06:43:28,769][52664] Sum rewards: 78.227, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.720', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.100', 'AMMO3': '0.202', 'weapon5': '0.220', 'AMMO4': '0.254', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:29,663][52794] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:43:29,903][52667] DAMAGECOUNT value on done: 785839.0 [2024-08-06 06:43:29,906][52667] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon2': '0.162', 'weapon5': '0.164', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '61.000'} [2024-08-06 06:43:30,157][52649] DAMAGECOUNT value on done: 769664.0 [2024-08-06 06:43:30,157][52649] Sum rewards: 82.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.838', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.124', 'weapon5': '0.144', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:30,377][52650] Updated weights for policy 0, policy_version 71011 (0.0026) [2024-08-06 06:43:30,805][52794] DAMAGECOUNT value on done: 769710.0 [2024-08-06 06:43:30,806][52794] Sum rewards: 77.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.276', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.124', 'weapon5': '0.170', 'weapon2': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.314', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '65.000'} [2024-08-06 06:43:31,311][52659] DAMAGECOUNT value on done: 784600.0 [2024-08-06 06:43:31,311][52659] Sum rewards: 80.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.469', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.136', 'weapon5': '0.176', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:31,353][52664] DAMAGECOUNT value on done: 802222.0 [2024-08-06 06:43:31,353][52664] Sum rewards: 76.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.536', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '60.500'} [2024-08-06 06:43:32,763][52667] DAMAGECOUNT value on done: 783117.0 [2024-08-06 06:43:32,764][52667] Sum rewards: 77.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.181', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.164', 'weapon2': '0.178', 'AMMO4': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.384', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '64.000'} [2024-08-06 06:43:32,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 581763072. Throughput: 0: 4373.6. Samples: 145440640. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:32,794][52567] Avg episode reward: [(0, '73.024')] [2024-08-06 06:43:33,342][52649] DAMAGECOUNT value on done: 765591.0 [2024-08-06 06:43:33,343][52649] Sum rewards: 66.178, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.932', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.080', 'AMMO3': '0.208', 'AMMO4': '0.223', 'weapon2': '0.240', 'weapon5': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.162', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:33,722][52794] DAMAGECOUNT value on done: 781560.0 [2024-08-06 06:43:33,724][52794] Sum rewards: 80.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:34,138][52659] DAMAGECOUNT value on done: 776465.0 [2024-08-06 06:43:34,141][52659] Sum rewards: 74.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.015', 'AMMO3': '0.188', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '61.000'} [2024-08-06 06:43:34,485][52664] DAMAGECOUNT value on done: 815634.0 [2024-08-06 06:43:34,485][52664] Sum rewards: 87.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.273', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'AMMO3': '0.165', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.340', 'weapon4': '0.340', 'WEAPON3': '1.000', 'weapon3': '2.766', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '70.000'} [2024-08-06 06:43:34,914][52650] Updated weights for policy 0, policy_version 71021 (0.0026) [2024-08-06 06:43:35,620][52667] DAMAGECOUNT value on done: 789356.0 [2024-08-06 06:43:35,622][52667] Sum rewards: 75.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.395', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.118', 'weapon5': '0.134', 'AMMO4': '0.184', 'weapon2': '0.192', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'HITCOUNT': '3.320', 'weapon3': '3.328', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '65.000'} [2024-08-06 06:43:36,280][52649] DAMAGECOUNT value on done: 766806.0 [2024-08-06 06:43:36,281][52649] Sum rewards: 76.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.023', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.096', 'weapon5': '0.098', 'AMMO4': '0.179', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:36,404][52665] DAMAGECOUNT value on done: 766651.0 [2024-08-06 06:43:36,404][52665] Sum rewards: 80.452, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.723', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.480', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '65.000'} [2024-08-06 06:43:36,653][52794] DAMAGECOUNT value on done: 774240.0 [2024-08-06 06:43:36,653][52794] Sum rewards: 76.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.008', 'AMMO2': '0.058', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO3': '0.249', 'AMMO4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 06:43:37,615][52664] DAMAGECOUNT value on done: 807767.0 [2024-08-06 06:43:37,615][52664] Sum rewards: 68.054, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.701', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.096', 'weapon5': '0.134', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 581853184. Throughput: 0: 4375.5. Samples: 145466960. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:37,795][52567] Avg episode reward: [(0, '73.430')] [2024-08-06 06:43:38,758][52649] DAMAGECOUNT value on done: 754694.0 [2024-08-06 06:43:38,760][52649] Sum rewards: 95.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.770', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon2': '0.160', 'AMMO3': '0.195', 'AMMO4': '0.195', 'weapon5': '0.212', 'weapon4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '22.317', 'FRAGCOUNT': '77.000'} [2024-08-06 06:43:38,848][52665] DAMAGECOUNT value on done: 781588.0 [2024-08-06 06:43:38,852][52665] Sum rewards: 86.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.042', 'weapon5': '0.042', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.494', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '70.000'} [2024-08-06 06:43:39,159][52794] DAMAGECOUNT value on done: 769990.0 [2024-08-06 06:43:39,163][52794] Sum rewards: 79.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.311', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.050', 'weapon5': '0.084', 'AMMO4': '0.095', 'weapon2': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'weapon3': '3.484', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '66.000'} [2024-08-06 06:43:39,738][52650] Updated weights for policy 0, policy_version 71031 (0.0024) [2024-08-06 06:43:40,116][52794] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:43:40,785][52664] DAMAGECOUNT value on done: 803450.0 [2024-08-06 06:43:40,787][52664] Sum rewards: 79.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.562', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.253', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.430', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '66.000'} [2024-08-06 06:43:41,503][52649] DAMAGECOUNT value on done: 763344.0 [2024-08-06 06:43:41,506][52649] Sum rewards: 72.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.175', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO3': '0.160', 'AMMO4': '0.160', 'weapon4': '0.234', 'weapon5': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.744', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:41,642][52665] DAMAGECOUNT value on done: 776525.0 [2024-08-06 06:43:41,644][52665] Sum rewards: 68.422, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.114', 'HEALTH': '0.120', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.298', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:42,342][52794] DAMAGECOUNT value on done: 781433.0 [2024-08-06 06:43:42,342][52794] Sum rewards: 88.064, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.020', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.204', 'weapon5': '0.216', 'weapon2': '0.218', 'AMMO4': '0.219', 'AMMO3': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.018', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.702', 'FRAGCOUNT': '77.000'} [2024-08-06 06:43:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 581935104. Throughput: 0: 4381.1. Samples: 145493350. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:42,802][52567] Avg episode reward: [(0, '74.325')] [2024-08-06 06:43:43,274][52664] DAMAGECOUNT value on done: 796559.0 [2024-08-06 06:43:43,275][52664] Sum rewards: 83.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.230', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.154', 'AMMO4': '0.193', 'AMMO3': '0.201', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '68.000'} [2024-08-06 06:43:43,807][52650] Updated weights for policy 0, policy_version 71041 (0.0014) [2024-08-06 06:43:44,659][52649] DAMAGECOUNT value on done: 748717.0 [2024-08-06 06:43:44,661][52649] Sum rewards: 78.896, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.828', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.095', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.050', 'weapon3': '2.902', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:44,715][52665] DAMAGECOUNT value on done: 773189.0 [2024-08-06 06:43:44,715][52665] Sum rewards: 67.408, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.356', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.086', 'weapon5': '0.126', 'AMMO4': '0.137', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.106', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:45,282][52794] DAMAGECOUNT value on done: 776664.0 [2024-08-06 06:43:45,282][52794] Sum rewards: 59.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.384', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.176', 'weapon2': '0.268', 'AMMO4': '0.302', 'weapon5': '0.346', 'weapon4': '0.430', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.594', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '50.000'} [2024-08-06 06:43:46,604][52664] DAMAGECOUNT value on done: 811934.0 [2024-08-06 06:43:46,604][52664] Sum rewards: 84.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.225', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '69.000'} [2024-08-06 06:43:46,709][52647] DAMAGECOUNT value on done: 828278.0 [2024-08-06 06:43:46,709][52647] Sum rewards: 78.242, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.014', 'weapon4': '0.054', 'AMMO2': '0.058', 'weapon5': '0.152', 'AMMO3': '0.256', 'AMMO4': '0.289', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:47,285][52658] DAMAGECOUNT value on done: 779514.0 [2024-08-06 06:43:47,287][52658] Sum rewards: 68.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.454', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.127', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:47,533][52665] DAMAGECOUNT value on done: 758939.0 [2024-08-06 06:43:47,533][52665] Sum rewards: 80.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.450', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon2': '0.216', 'AMMO3': '0.220', 'weapon5': '0.260', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '65.000'} [2024-08-06 06:43:47,542][52649] DAMAGECOUNT value on done: 766799.0 [2024-08-06 06:43:47,545][52649] Sum rewards: 67.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.568', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon4': '0.112', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.350', 'HITCOUNT': '3.010', 'weapon3': '3.210', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 582025216. Throughput: 0: 4379.6. Samples: 145506380. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:47,794][52567] Avg episode reward: [(0, '74.529')] [2024-08-06 06:43:48,507][52794] DAMAGECOUNT value on done: 792563.0 [2024-08-06 06:43:48,507][52794] Sum rewards: 68.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.084', 'AMMO4': '0.120', 'weapon2': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'HITCOUNT': '3.270', 'weapon3': '3.498', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '60.000'} [2024-08-06 06:43:48,657][52663] DAMAGECOUNT value on done: 793670.0 [2024-08-06 06:43:48,657][52663] Sum rewards: 68.411, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.178', 'AMMO3': '0.223', 'AMMO4': '0.278', 'weapon5': '0.406', 'weapon2': '0.462', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.640', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:48,907][52650] Updated weights for policy 0, policy_version 71051 (0.0017) [2024-08-06 06:43:49,112][52664] DAMAGECOUNT value on done: 805147.0 [2024-08-06 06:43:49,113][52664] Sum rewards: 83.191, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.376', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '70.000'} [2024-08-06 06:43:49,129][52647] DAMAGECOUNT value on done: 818446.0 [2024-08-06 06:43:49,130][52647] Sum rewards: 83.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.082', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.940', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:50,223][52658] DAMAGECOUNT value on done: 782553.0 [2024-08-06 06:43:50,225][52658] Sum rewards: 68.908, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO5': '0.008', 'AMMO2': '0.037', 'AMMO3': '0.156', 'weapon5': '0.158', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.376', 'weapon4': '0.406', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.000'} [2024-08-06 06:43:50,888][52665] DAMAGECOUNT value on done: 764903.0 [2024-08-06 06:43:50,888][52665] Sum rewards: 65.789, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.702', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.154', 'AMMO4': '0.191', 'weapon4': '0.266', 'AMMO3': '0.295', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.938', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '59.000'} [2024-08-06 06:43:50,912][52649] DAMAGECOUNT value on done: 766959.0 [2024-08-06 06:43:50,914][52649] Sum rewards: 58.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.526', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.220', 'DAMAGECOUNT': '13.920', 'FRAGCOUNT': '50.500'} [2024-08-06 06:43:51,088][52794] DAMAGECOUNT value on done: 772025.0 [2024-08-06 06:43:51,090][52794] Sum rewards: 69.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.198', 'weapon5': '0.212', 'AMMO4': '0.224', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'weapon4': '0.768', 'WEAPON3': '1.250', 'weapon3': '2.292', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:51,778][52663] DAMAGECOUNT value on done: 779985.0 [2024-08-06 06:43:51,779][52663] Sum rewards: 85.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.865', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.175', 'AMMO4': '0.276', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '70.000'} [2024-08-06 06:43:51,812][52664] DAMAGECOUNT value on done: 816935.0 [2024-08-06 06:43:51,814][52664] Sum rewards: 79.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.188', 'AMMO4': '0.198', 'weapon5': '0.226', 'weapon4': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:51,909][52647] DAMAGECOUNT value on done: 823678.0 [2024-08-06 06:43:51,911][52647] Sum rewards: 76.376, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.068', 'weapon4': '0.084', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '65.000'} [2024-08-06 06:43:52,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 582123520. Throughput: 0: 4377.6. Samples: 145532570. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:52,794][52567] Avg episode reward: [(0, '74.354')] [2024-08-06 06:43:53,054][52658] DAMAGECOUNT value on done: 785879.0 [2024-08-06 06:43:53,056][52658] Sum rewards: 76.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.142', 'AMMO3': '0.199', 'AMMO4': '0.206', 'weapon5': '0.274', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:53,607][52665] DAMAGECOUNT value on done: 770120.0 [2024-08-06 06:43:53,611][52665] Sum rewards: 66.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.090', 'weapon5': '0.092', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.364', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:53,720][52649] DAMAGECOUNT value on done: 757099.0 [2024-08-06 06:43:53,721][52649] Sum rewards: 80.197, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.120', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.082', 'AMMO4': '0.192', 'weapon5': '0.216', 'AMMO3': '0.280', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.980', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.453', 'FRAGCOUNT': '67.000'} [2024-08-06 06:43:53,724][52650] Updated weights for policy 0, policy_version 71061 (0.0024) [2024-08-06 06:43:53,945][52794] DAMAGECOUNT value on done: 786560.0 [2024-08-06 06:43:53,945][52794] Sum rewards: 83.747, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.595', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.114', 'weapon5': '0.156', 'AMMO4': '0.172', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '66.000'} [2024-08-06 06:43:54,403][52663] DAMAGECOUNT value on done: 774732.0 [2024-08-06 06:43:54,405][52663] Sum rewards: 77.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.758', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.151', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.184', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '66.000'} [2024-08-06 06:43:54,576][52664] DAMAGECOUNT value on done: 812205.0 [2024-08-06 06:43:54,577][52664] Sum rewards: 73.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-4.196', 'AMMO2': '0.013', 'AMMO5': '0.016', 'weapon4': '0.026', 'AMMO4': '0.065', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.380', 'weapon3': '3.418', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:54,633][52647] DAMAGECOUNT value on done: 822329.0 [2024-08-06 06:43:54,633][52647] Sum rewards: 66.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.082', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.184', 'AMMO3': '0.223', 'AMMO4': '0.263', 'weapon5': '0.264', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '2.870', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '57.000'} [2024-08-06 06:43:55,560][52658] DAMAGECOUNT value on done: 782044.0 [2024-08-06 06:43:55,561][52658] Sum rewards: 73.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO4': '0.192', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '62.000'} [2024-08-06 06:43:55,953][52669] DAMAGECOUNT value on done: 782169.0 [2024-08-06 06:43:55,953][52669] Sum rewards: 79.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.284', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'AMMO3': '0.177', 'weapon5': '0.180', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '65.000'} [2024-08-06 06:43:56,700][52665] DAMAGECOUNT value on done: 769099.0 [2024-08-06 06:43:56,700][52665] Sum rewards: 61.788, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.860', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.130', 'AMMO3': '0.176', 'weapon4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.216', 'DAMAGECOUNT': '13.575', 'FRAGCOUNT': '51.000'} [2024-08-06 06:43:56,904][52664] DAMAGECOUNT value on done: 812814.0 [2024-08-06 06:43:56,904][52664] Sum rewards: 53.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.207', 'AMMO5': '0.012', 'AMMO2': '0.045', 'AMMO3': '0.204', 'weapon2': '0.222', 'AMMO4': '0.226', 'weapon5': '0.226', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '2.970', 'DAMAGECOUNT': '13.680', 'FRAGCOUNT': '44.000'} [2024-08-06 06:43:56,911][52663] DAMAGECOUNT value on done: 778671.0 [2024-08-06 06:43:56,911][52663] Sum rewards: 66.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.070', 'weapon5': '0.196', 'AMMO3': '0.214', 'AMMO4': '0.266', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.222', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '56.000'} [2024-08-06 06:43:56,973][52647] DAMAGECOUNT value on done: 828664.0 [2024-08-06 06:43:56,973][52647] Sum rewards: 70.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.148', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.326', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.388', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.000'} [2024-08-06 06:43:57,208][52794] DAMAGECOUNT value on done: 782417.0 [2024-08-06 06:43:57,208][52794] Sum rewards: 84.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.672', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.074', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '69.000'} [2024-08-06 06:43:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 582197248. Throughput: 0: 4380.2. Samples: 145558830. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 06:43:57,795][52567] Avg episode reward: [(0, '73.818')] [2024-08-06 06:43:58,272][52650] Updated weights for policy 0, policy_version 71071 (0.0029) [2024-08-06 06:43:58,360][52658] DAMAGECOUNT value on done: 774146.0 [2024-08-06 06:43:58,362][52658] Sum rewards: 73.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.536', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.174', 'AMMO3': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '59.000'} [2024-08-06 06:43:58,429][52669] DAMAGECOUNT value on done: 772213.0 [2024-08-06 06:43:58,431][52669] Sum rewards: 71.383, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.971', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.144', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'AMMO3': '0.296', 'WEAPON3': '1.750', 'weapon3': '3.178', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '63.000'} [2024-08-06 06:43:59,432][52671] DAMAGECOUNT value on done: 784701.0 [2024-08-06 06:43:59,432][52671] Sum rewards: 79.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.685', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.028', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.264', 'WEAPON3': '1.250', 'HITCOUNT': '3.480', 'weapon3': '3.510', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '66.000'} [2024-08-06 06:43:59,592][52665] DAMAGECOUNT value on done: 777512.0 [2024-08-06 06:43:59,594][52665] Sum rewards: 76.452, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.092', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.328', 'weapon4': '0.392', 'WEAPON3': '0.900', 'weapon3': '3.058', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '59.000'} [2024-08-06 06:43:59,607][52664] DAMAGECOUNT value on done: 820053.0 [2024-08-06 06:43:59,607][52664] Sum rewards: 74.606, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.854', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.191', 'weapon4': '0.204', 'AMMO3': '0.267', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.500', 'weapon3': '2.734', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '64.000'} [2024-08-06 06:43:59,682][52647] DAMAGECOUNT value on done: 826141.0 [2024-08-06 06:43:59,682][52647] Sum rewards: 65.303, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO3': '0.150', 'AMMO4': '0.160', 'weapon5': '0.208', 'weapon2': '0.308', 'ARMOR': '0.434', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.566', 'WEAPON3': '0.950', 'weapon3': '2.574', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '54.500'} [2024-08-06 06:43:59,868][52663] DAMAGECOUNT value on done: 779677.0 [2024-08-06 06:43:59,871][52663] Sum rewards: 77.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.454', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.584', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:00,084][52794] DAMAGECOUNT value on done: 783438.0 [2024-08-06 06:44:00,086][52794] Sum rewards: 80.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.044', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.116', 'AMMO4': '0.143', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '67.000'} [2024-08-06 06:44:01,376][52658] DAMAGECOUNT value on done: 772015.0 [2024-08-06 06:44:01,378][52658] Sum rewards: 84.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.167', 'weapon5': '0.170', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '68.000'} [2024-08-06 06:44:01,642][52669] DAMAGECOUNT value on done: 787198.0 [2024-08-06 06:44:01,642][52669] Sum rewards: 83.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.138', 'AMMO4': '0.149', 'weapon5': '0.184', 'weapon2': '0.198', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '69.000'} [2024-08-06 06:44:02,289][52671] DAMAGECOUNT value on done: 787511.0 [2024-08-06 06:44:02,290][52671] Sum rewards: 74.127, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.316', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.130', 'AMMO4': '0.153', 'weapon4': '0.160', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:02,462][52664] DAMAGECOUNT value on done: 821391.0 [2024-08-06 06:44:02,462][52664] Sum rewards: 85.275, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.064', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.700', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '68.000'} [2024-08-06 06:44:02,507][52665] DAMAGECOUNT value on done: 769533.0 [2024-08-06 06:44:02,508][52665] Sum rewards: 83.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.144', 'weapon5': '0.188', 'AMMO4': '0.247', 'AMMO3': '0.251', 'weapon2': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.086', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.540', 'FRAGCOUNT': '69.000'} [2024-08-06 06:44:02,527][52647] DAMAGECOUNT value on done: 830254.0 [2024-08-06 06:44:02,527][52647] Sum rewards: 88.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.198', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.478', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.232', 'FRAGCOUNT': '73.000'} [2024-08-06 06:44:02,779][52650] Updated weights for policy 0, policy_version 71081 (0.0012) [2024-08-06 06:44:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 582295552. Throughput: 0: 4377.2. Samples: 145571880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:02,794][52567] Avg episode reward: [(0, '74.944')] [2024-08-06 06:44:02,967][52663] DAMAGECOUNT value on done: 788257.0 [2024-08-06 06:44:02,968][52663] Sum rewards: 75.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.228', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.042', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:03,443][52794] DAMAGECOUNT value on done: 792708.0 [2024-08-06 06:44:03,443][52794] Sum rewards: 76.426, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.970', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.122', 'weapon5': '0.132', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.432', 'WEAPON3': '0.850', 'weapon3': '3.082', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:04,424][52669] DAMAGECOUNT value on done: 779266.0 [2024-08-06 06:44:04,425][52669] Sum rewards: 69.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.622', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.072', 'weapon5': '0.136', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.328', 'WEAPON3': '1.700', 'HITCOUNT': '3.190', 'weapon3': '3.202', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:04,855][52658] DAMAGECOUNT value on done: 785310.0 [2024-08-06 06:44:04,857][52658] Sum rewards: 70.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon5': '0.176', 'AMMO3': '0.227', 'AMMO4': '0.280', 'weapon2': '0.334', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:04,977][52664] DAMAGECOUNT value on done: 814830.0 [2024-08-06 06:44:04,978][52664] Sum rewards: 75.004, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.640', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:04,999][52647] DAMAGECOUNT value on done: 808002.0 [2024-08-06 06:44:04,999][52647] Sum rewards: 70.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.848', 'AMMO5': '0.024', 'AMMO2': '0.063', 'AMMO3': '0.210', 'weapon2': '0.260', 'weapon4': '0.280', 'AMMO4': '0.313', 'weapon5': '0.320', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.794', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:05,023][52671] DAMAGECOUNT value on done: 783071.0 [2024-08-06 06:44:05,023][52671] Sum rewards: 85.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.655', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.152', 'weapon4': '0.156', 'AMMO3': '0.165', 'AMMO4': '0.194', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '68.000'} [2024-08-06 06:44:05,455][52665] DAMAGECOUNT value on done: 778460.0 [2024-08-06 06:44:05,456][52665] Sum rewards: 77.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.398', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.212', 'weapon4': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:05,738][52663] DAMAGECOUNT value on done: 775615.0 [2024-08-06 06:44:05,740][52663] Sum rewards: 76.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.854', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.064', 'weapon5': '0.180', 'AMMO4': '0.229', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.650', 'weapon3': '2.906', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:06,466][52794] DAMAGECOUNT value on done: 782466.0 [2024-08-06 06:44:06,468][52794] Sum rewards: 72.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.043', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.174', 'AMMO3': '0.204', 'weapon5': '0.206', 'AMMO4': '0.245', 'weapon2': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:07,221][52669] DAMAGECOUNT value on done: 784062.0 [2024-08-06 06:44:07,222][52669] Sum rewards: 70.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.218', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.098', 'weapon2': '0.208', 'AMMO4': '0.251', 'AMMO3': '0.262', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.130', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:07,642][52650] Updated weights for policy 0, policy_version 71091 (0.0020) [2024-08-06 06:44:07,648][52658] DAMAGECOUNT value on done: 772581.0 [2024-08-06 06:44:07,648][52658] Sum rewards: 68.343, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.152', 'weapon4': '0.164', 'weapon5': '0.254', 'AMMO4': '0.305', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.868', 'WEAPON3': '0.950', 'weapon3': '2.500', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.729', 'FRAGCOUNT': '54.000'} [2024-08-06 06:44:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 582377472. Throughput: 0: 4376.2. Samples: 145598280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:07,802][52567] Avg episode reward: [(0, '75.123')] [2024-08-06 06:44:07,844][52664] DAMAGECOUNT value on done: 804711.0 [2024-08-06 06:44:07,845][52664] Sum rewards: 67.276, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'AMMO5': '0.021', 'AMMO2': '0.028', 'weapon5': '0.112', 'AMMO4': '0.140', 'AMMO3': '0.156', 'weapon2': '0.270', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.980', 'weapon3': '3.048', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '54.000'} [2024-08-06 06:44:07,846][52647] DAMAGECOUNT value on done: 823891.0 [2024-08-06 06:44:07,847][52647] Sum rewards: 70.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.495', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'weapon5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.380', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:07,915][52669] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:44:08,047][52671] DAMAGECOUNT value on done: 786969.0 [2024-08-06 06:44:08,048][52671] Sum rewards: 84.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.158', 'weapon5': '0.166', 'AMMO4': '0.174', 'AMMO3': '0.181', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '3.002', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.916', 'FRAGCOUNT': '66.000'} [2024-08-06 06:44:08,705][52663] DAMAGECOUNT value on done: 767862.0 [2024-08-06 06:44:08,705][52663] Sum rewards: 86.239, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'ARMOR': '0.004', 'AMMO5': '0.026', 'AMMO2': '0.059', 'weapon4': '0.182', 'weapon5': '0.216', 'AMMO3': '0.260', 'weapon2': '0.278', 'AMMO4': '0.297', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '74.000'} [2024-08-06 06:44:08,914][52665] DAMAGECOUNT value on done: 776494.0 [2024-08-06 06:44:08,914][52665] Sum rewards: 73.013, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.140', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.174', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'weapon2': '0.308', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:10,340][52669] DAMAGECOUNT value on done: 782770.0 [2024-08-06 06:44:10,341][52669] Sum rewards: 76.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.391', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.044', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:10,397][52658] DAMAGECOUNT value on done: 798303.0 [2024-08-06 06:44:10,401][52658] Sum rewards: 72.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.696', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.236', 'weapon5': '0.240', 'AMMO4': '0.296', 'weapon2': '0.352', 'weapon4': '0.378', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:10,871][52647] DAMAGECOUNT value on done: 820600.0 [2024-08-06 06:44:10,871][52647] Sum rewards: 71.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.157', 'AMMO4': '0.237', 'weapon5': '0.252', 'weapon4': '0.368', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.582', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:10,912][52664] DAMAGECOUNT value on done: 807997.0 [2024-08-06 06:44:10,913][52664] Sum rewards: 82.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.418', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '69.000'} [2024-08-06 06:44:10,917][52671] DAMAGECOUNT value on done: 793958.0 [2024-08-06 06:44:10,918][52671] Sum rewards: 81.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.644', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.099', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '70.000'} [2024-08-06 06:44:11,600][52665] DAMAGECOUNT value on done: 771520.0 [2024-08-06 06:44:11,601][52665] Sum rewards: 73.992, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.180', 'AMMO5': '0.022', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.114', 'AMMO4': '0.154', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '3.034', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:11,762][52663] DAMAGECOUNT value on done: 771547.0 [2024-08-06 06:44:11,762][52663] Sum rewards: 85.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.266', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.114', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.270', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '70.000'} [2024-08-06 06:44:12,354][52650] Updated weights for policy 0, policy_version 71101 (0.0025) [2024-08-06 06:44:12,400][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:44:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 582459392. Throughput: 0: 4374.4. Samples: 145624460. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:12,794][52567] Avg episode reward: [(0, '75.710')] [2024-08-06 06:44:12,825][52669] DAMAGECOUNT value on done: 783383.0 [2024-08-06 06:44:12,826][52669] Sum rewards: 85.394, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon2': '0.248', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.506', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '74.000'} [2024-08-06 06:44:13,144][52658] DAMAGECOUNT value on done: 784625.0 [2024-08-06 06:44:13,144][52658] Sum rewards: 84.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.918', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon5': '0.116', 'AMMO4': '0.166', 'AMMO3': '0.209', 'weapon2': '0.256', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.003', 'FRAGCOUNT': '70.000'} [2024-08-06 06:44:13,809][52647] DAMAGECOUNT value on done: 819544.0 [2024-08-06 06:44:13,811][52647] Sum rewards: 87.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.184', 'AMMO3': '0.206', 'weapon2': '0.220', 'AMMO4': '0.231', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '72.000'} [2024-08-06 06:44:13,890][52664] DAMAGECOUNT value on done: 809962.0 [2024-08-06 06:44:13,894][52664] Sum rewards: 84.488, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.137', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.144', 'weapon5': '0.152', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '71.000'} [2024-08-06 06:44:13,912][52671] DAMAGECOUNT value on done: 784772.0 [2024-08-06 06:44:13,913][52671] Sum rewards: 68.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.694', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.182', 'AMMO4': '0.190', 'AMMO3': '0.216', 'weapon2': '0.218', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:14,376][52665] DAMAGECOUNT value on done: 772543.0 [2024-08-06 06:44:14,376][52665] Sum rewards: 80.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.368', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon4': '0.334', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:14,387][52663] DAMAGECOUNT value on done: 775834.0 [2024-08-06 06:44:14,387][52663] Sum rewards: 79.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'weapon2': '0.334', 'weapon4': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:15,183][52670] DAMAGECOUNT value on done: 769855.0 [2024-08-06 06:44:15,183][52670] Sum rewards: 62.665, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.748', 'AMMO5': '0.023', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO4': '0.172', 'weapon5': '0.228', 'AMMO3': '0.248', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.084', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '54.500'} [2024-08-06 06:44:15,598][52669] DAMAGECOUNT value on done: 784108.0 [2024-08-06 06:44:15,599][52669] Sum rewards: 74.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.235', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.133', 'weapon5': '0.140', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.314', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:16,103][52671] DAMAGECOUNT value on done: 789253.0 [2024-08-06 06:44:16,106][52671] Sum rewards: 78.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.937', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.148', 'AMMO3': '0.219', 'weapon5': '0.228', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:16,318][52658] DAMAGECOUNT value on done: 791023.0 [2024-08-06 06:44:16,319][52658] Sum rewards: 66.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.502', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.138', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.188', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '54.000'} [2024-08-06 06:44:16,341][52647] DAMAGECOUNT value on done: 810568.0 [2024-08-06 06:44:16,341][52647] Sum rewards: 69.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.637', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.126', 'weapon5': '0.128', 'AMMO4': '0.156', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:16,570][52664] DAMAGECOUNT value on done: 806775.0 [2024-08-06 06:44:16,570][52664] Sum rewards: 72.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO4': '0.115', 'weapon5': '0.120', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:16,734][52650] Updated weights for policy 0, policy_version 71111 (0.0011) [2024-08-06 06:44:17,328][52665] DAMAGECOUNT value on done: 768122.0 [2024-08-06 06:44:17,330][52665] Sum rewards: 76.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.518', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon2': '0.180', 'AMMO3': '0.239', 'weapon5': '0.290', 'AMMO4': '0.292', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.774', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:17,334][52663] DAMAGECOUNT value on done: 786118.0 [2024-08-06 06:44:17,334][52663] Sum rewards: 71.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.030', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.198', 'weapon4': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17439.3). Total num frames: 582549504. Throughput: 0: 4382.0. Samples: 145637830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:17,794][52567] Avg episode reward: [(0, '75.811')] [2024-08-06 06:44:17,938][52666] DAMAGECOUNT value on done: 779899.0 [2024-08-06 06:44:17,938][52666] Sum rewards: 84.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.002', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.136', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.312', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '70.000'} [2024-08-06 06:44:18,146][52670] DAMAGECOUNT value on done: 781755.0 [2024-08-06 06:44:18,147][52670] Sum rewards: 72.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.170', 'weapon5': '0.186', 'weapon4': '0.212', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:18,698][52669] DAMAGECOUNT value on done: 793145.0 [2024-08-06 06:44:18,699][52669] Sum rewards: 68.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.990', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.082', 'weapon5': '0.100', 'AMMO4': '0.193', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.208', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:18,930][52658] DAMAGECOUNT value on done: 780337.0 [2024-08-06 06:44:18,930][52658] Sum rewards: 88.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.676', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'weapon2': '0.202', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.388', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.129', 'FRAGCOUNT': '74.000'} [2024-08-06 06:44:18,936][52671] DAMAGECOUNT value on done: 785484.0 [2024-08-06 06:44:18,937][52671] Sum rewards: 69.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.141', 'AMMO5': '0.018', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon5': '0.214', 'AMMO3': '0.218', 'weapon2': '0.290', 'weapon4': '0.400', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:19,405][52647] DAMAGECOUNT value on done: 827838.0 [2024-08-06 06:44:19,406][52647] Sum rewards: 71.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.756', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.102', 'weapon5': '0.106', 'AMMO4': '0.107', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:20,242][52663] DAMAGECOUNT value on done: 770578.0 [2024-08-06 06:44:20,242][52663] Sum rewards: 83.682, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'weapon4': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon2': '0.496', 'WEAPON3': '0.950', 'weapon3': '3.274', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:20,668][52665] DAMAGECOUNT value on done: 771682.0 [2024-08-06 06:44:20,668][52665] Sum rewards: 68.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.352', 'AMMO5': '0.022', 'AMMO2': '0.039', 'weapon4': '0.076', 'AMMO4': '0.197', 'AMMO3': '0.218', 'weapon5': '0.252', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.144', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:21,082][52666] DAMAGECOUNT value on done: 775382.0 [2024-08-06 06:44:21,083][52666] Sum rewards: 71.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.122', 'weapon4': '0.148', 'AMMO4': '0.164', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.772', 'WEAPON3': '1.050', 'weapon3': '2.738', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:21,190][52670] DAMAGECOUNT value on done: 769853.0 [2024-08-06 06:44:21,192][52670] Sum rewards: 59.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.206', 'weapon2': '0.218', 'weapon5': '0.256', 'AMMO3': '0.258', 'AMMO4': '0.299', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.820', 'weapon3': '3.024', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '51.000'} [2024-08-06 06:44:21,655][52669] DAMAGECOUNT value on done: 785266.0 [2024-08-06 06:44:21,657][52669] Sum rewards: 87.729, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.060', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.132', 'weapon2': '0.208', 'AMMO4': '0.251', 'AMMO3': '0.257', 'weapon4': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.912', 'FRAGCOUNT': '73.000'} [2024-08-06 06:44:21,713][52658] DAMAGECOUNT value on done: 784711.0 [2024-08-06 06:44:21,713][52658] Sum rewards: 50.758, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.938', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO4': '0.186', 'weapon5': '0.226', 'AMMO3': '0.291', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.800', 'HITCOUNT': '2.570', 'weapon3': '2.928', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '47.000'} [2024-08-06 06:44:21,762][52671] DAMAGECOUNT value on done: 774620.0 [2024-08-06 06:44:21,764][52671] Sum rewards: 81.578, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.650', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.138', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '68.000'} [2024-08-06 06:44:21,936][52647] DAMAGECOUNT value on done: 813635.0 [2024-08-06 06:44:21,937][52647] Sum rewards: 75.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.134', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.090', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:22,068][52650] Updated weights for policy 0, policy_version 71121 (0.0034) [2024-08-06 06:44:22,795][52567] Fps is (10 sec: 18840.7, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 582647808. Throughput: 0: 4374.9. Samples: 145663830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:22,802][52567] Avg episode reward: [(0, '74.958')] [2024-08-06 06:44:23,391][52663] DAMAGECOUNT value on done: 765687.0 [2024-08-06 06:44:23,391][52663] Sum rewards: 70.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.685', 'AMMO5': '0.017', 'AMMO2': '0.072', 'weapon2': '0.168', 'AMMO3': '0.171', 'weapon5': '0.204', 'weapon4': '0.208', 'AMMO4': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.138', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:23,658][52666] DAMAGECOUNT value on done: 779052.0 [2024-08-06 06:44:23,659][52666] Sum rewards: 71.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.109', 'weapon5': '0.134', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:23,763][52665] DAMAGECOUNT value on done: 772488.0 [2024-08-06 06:44:23,764][52665] Sum rewards: 59.850, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.080', 'weapon4': '0.156', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.274', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '50.000'} [2024-08-06 06:44:23,913][52670] DAMAGECOUNT value on done: 768574.0 [2024-08-06 06:44:23,914][52670] Sum rewards: 83.581, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.244', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.178', 'weapon2': '0.194', 'weapon4': '0.240', 'AMMO4': '0.242', 'weapon5': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:24,593][52669] DAMAGECOUNT value on done: 787082.0 [2024-08-06 06:44:24,594][52669] Sum rewards: 82.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.622', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.201', 'weapon2': '0.244', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '67.000'} [2024-08-06 06:44:24,687][52658] DAMAGECOUNT value on done: 776764.0 [2024-08-06 06:44:24,689][52658] Sum rewards: 86.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.995', 'AMMO5': '0.003', 'weapon4': '0.006', 'AMMO2': '0.011', 'weapon5': '0.052', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.230', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.532', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '72.000'} [2024-08-06 06:44:24,748][52671] DAMAGECOUNT value on done: 784496.0 [2024-08-06 06:44:24,749][52671] Sum rewards: 79.355, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.022', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.134', 'weapon2': '0.156', 'AMMO4': '0.191', 'weapon5': '0.192', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '65.500'} [2024-08-06 06:44:24,820][52647] DAMAGECOUNT value on done: 823505.0 [2024-08-06 06:44:24,821][52647] Sum rewards: 72.537, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.020', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.280', 'weapon2': '0.396', 'WEAPON3': '1.700', 'weapon3': '3.256', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '63.000'} [2024-08-06 06:44:26,267][52650] Updated weights for policy 0, policy_version 71131 (0.0029) [2024-08-06 06:44:26,321][52663] DAMAGECOUNT value on done: 773758.0 [2024-08-06 06:44:26,322][52663] Sum rewards: 86.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.958', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.060', 'AMMO4': '0.197', 'weapon5': '0.210', 'weapon2': '0.248', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '73.000'} [2024-08-06 06:44:26,436][52665] DAMAGECOUNT value on done: 764753.0 [2024-08-06 06:44:26,437][52665] Sum rewards: 78.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.489', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.104', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '63.500'} [2024-08-06 06:44:26,772][52666] DAMAGECOUNT value on done: 777596.0 [2024-08-06 06:44:26,772][52666] Sum rewards: 75.597, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.305', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.186', 'AMMO4': '0.196', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '63.000'} [2024-08-06 06:44:26,889][52670] DAMAGECOUNT value on done: 780732.0 [2024-08-06 06:44:26,889][52670] Sum rewards: 73.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.114', 'AMMO4': '0.177', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:27,184][52671] DAMAGECOUNT value on done: 785887.0 [2024-08-06 06:44:27,186][52671] Sum rewards: 84.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.197', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.420', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '69.000'} [2024-08-06 06:44:27,576][52658] DAMAGECOUNT value on done: 785960.0 [2024-08-06 06:44:27,576][52658] Sum rewards: 72.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.539', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.138', 'weapon4': '0.184', 'AMMO3': '0.199', 'AMMO4': '0.228', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:27,704][52669] DAMAGECOUNT value on done: 792779.0 [2024-08-06 06:44:27,705][52669] Sum rewards: 73.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.146', 'weapon2': '0.206', 'AMMO4': '0.212', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon4': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 582721536. Throughput: 0: 4371.6. Samples: 145690070. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:27,794][52567] Avg episode reward: [(0, '75.655')] [2024-08-06 06:44:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071133_582721536.pth... [2024-08-06 06:44:27,835][52647] DAMAGECOUNT value on done: 825536.0 [2024-08-06 06:44:27,837][52647] Sum rewards: 77.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.650', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO4': '0.142', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:27,959][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070622_578535424.pth [2024-08-06 06:44:29,272][52663] DAMAGECOUNT value on done: 773290.0 [2024-08-06 06:44:29,272][52663] Sum rewards: 77.735, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.282', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.356', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '68.000'} [2024-08-06 06:44:29,542][52665] DAMAGECOUNT value on done: 768799.0 [2024-08-06 06:44:29,542][52665] Sum rewards: 78.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.216', 'weapon4': '0.252', 'weapon5': '0.258', 'AMMO4': '0.296', 'weapon2': '0.510', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.742', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:29,741][52666] DAMAGECOUNT value on done: 771542.0 [2024-08-06 06:44:29,743][52666] Sum rewards: 81.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.472', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.080', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '66.000'} [2024-08-06 06:44:29,914][52670] DAMAGECOUNT value on done: 774017.0 [2024-08-06 06:44:29,914][52670] Sum rewards: 77.079, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO2': '0.009', 'AMMO5': '0.012', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.155', 'weapon4': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:30,143][52671] DAMAGECOUNT value on done: 782037.0 [2024-08-06 06:44:30,145][52671] Sum rewards: 57.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.111', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.126', 'WEAPON4': '0.150', 'weapon2': '0.172', 'AMMO4': '0.172', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.448', 'DAMAGECOUNT': '14.112', 'FRAGCOUNT': '50.000'} [2024-08-06 06:44:30,146][52658] DAMAGECOUNT value on done: 768000.0 [2024-08-06 06:44:30,146][52658] Sum rewards: 74.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.982', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.157', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:30,205][52811] DAMAGECOUNT value on done: 743149.0 [2024-08-06 06:44:30,206][52811] Sum rewards: 67.124, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.617', 'AMMO5': '0.022', 'AMMO2': '0.068', 'weapon4': '0.140', 'weapon5': '0.168', 'AMMO3': '0.246', 'weapon2': '0.290', 'AMMO4': '0.342', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.050', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:30,379][52669] DAMAGECOUNT value on done: 776545.0 [2024-08-06 06:44:30,380][52669] Sum rewards: 71.601, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.082', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:30,940][52647] DAMAGECOUNT value on done: 811421.0 [2024-08-06 06:44:30,941][52647] Sum rewards: 67.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO4': '0.227', 'weapon5': '0.238', 'weapon4': '0.240', 'AMMO3': '0.257', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '56.000'} [2024-08-06 06:44:31,180][52650] Updated weights for policy 0, policy_version 71141 (0.0022) [2024-08-06 06:44:31,813][52663] DAMAGECOUNT value on done: 786625.0 [2024-08-06 06:44:31,815][52663] Sum rewards: 86.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.048', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '69.000'} [2024-08-06 06:44:32,504][52665] DAMAGECOUNT value on done: 774034.0 [2024-08-06 06:44:32,505][52665] Sum rewards: 89.464, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.787', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.138', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.274', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '22.290', 'FRAGCOUNT': '74.000'} [2024-08-06 06:44:32,794][52567] Fps is (10 sec: 16384.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 582811648. Throughput: 0: 4363.1. Samples: 145702720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:32,794][52567] Avg episode reward: [(0, '75.613')] [2024-08-06 06:44:32,909][52671] DAMAGECOUNT value on done: 792380.0 [2024-08-06 06:44:32,911][52671] Sum rewards: 81.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.882', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.182', 'AMMO4': '0.198', 'weapon2': '0.218', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '67.000'} [2024-08-06 06:44:32,940][52669] DAMAGECOUNT value on done: 777417.0 [2024-08-06 06:44:32,941][52669] Sum rewards: 70.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.662', 'AMMO5': '0.005', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.052', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.210', 'weapon2': '0.704', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:33,084][52666] DAMAGECOUNT value on done: 776186.0 [2024-08-06 06:44:33,087][52666] Sum rewards: 71.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon4': '0.180', 'AMMO3': '0.217', 'weapon5': '0.222', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:33,109][52658] DAMAGECOUNT value on done: 786791.0 [2024-08-06 06:44:33,109][52658] Sum rewards: 66.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.214', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.184', 'AMMO4': '0.195', 'weapon5': '0.200', 'weapon2': '0.244', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon4': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.726', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '54.000'} [2024-08-06 06:44:33,185][52670] DAMAGECOUNT value on done: 767136.0 [2024-08-06 06:44:33,187][52670] Sum rewards: 60.152, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.980', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.128', 'weapon4': '0.178', 'AMMO3': '0.262', 'AMMO4': '0.271', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.056', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '53.000'} [2024-08-06 06:44:33,242][52811] DAMAGECOUNT value on done: 725591.0 [2024-08-06 06:44:33,243][52811] Sum rewards: 78.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.046', 'AMMO4': '0.061', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.388', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:33,429][52647] DAMAGECOUNT value on done: 816274.0 [2024-08-06 06:44:33,430][52647] Sum rewards: 72.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.300', 'AMMO5': '0.026', 'AMMO2': '0.046', 'AMMO3': '0.189', 'weapon4': '0.216', 'AMMO4': '0.232', 'weapon5': '0.386', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.714', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:34,531][52663] DAMAGECOUNT value on done: 777194.0 [2024-08-06 06:44:34,531][52663] Sum rewards: 73.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.897', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.178', 'weapon4': '0.232', 'weapon5': '0.254', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '58.500'} [2024-08-06 06:44:35,560][52669] DAMAGECOUNT value on done: 783428.0 [2024-08-06 06:44:35,560][52669] Sum rewards: 70.261, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.885', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.084', 'AMMO3': '0.173', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.282', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:35,763][52658] DAMAGECOUNT value on done: 775617.0 [2024-08-06 06:44:35,771][52658] Sum rewards: 55.339, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.518', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.472', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.262', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '44.500'} [2024-08-06 06:44:36,128][52650] Updated weights for policy 0, policy_version 71151 (0.0015) [2024-08-06 06:44:36,157][52671] DAMAGECOUNT value on done: 784179.0 [2024-08-06 06:44:36,158][52671] Sum rewards: 71.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.431', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.158', 'weapon5': '0.168', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:36,382][52811] DAMAGECOUNT value on done: 722211.0 [2024-08-06 06:44:36,384][52811] Sum rewards: 65.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.164', 'weapon4': '0.190', 'AMMO3': '0.219', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.860', 'weapon3': '3.130', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '55.000'} [2024-08-06 06:44:36,437][52647] DAMAGECOUNT value on done: 806113.0 [2024-08-06 06:44:36,438][52647] Sum rewards: 74.835, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.034', 'AMMO5': '0.009', 'weapon4': '0.018', 'weapon5': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.394', 'WEAPON3': '1.050', 'HITCOUNT': '3.360', 'weapon3': '3.452', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:36,522][52666] DAMAGECOUNT value on done: 773457.0 [2024-08-06 06:44:36,524][52666] Sum rewards: 91.915, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.066', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.747', 'FRAGCOUNT': '76.000'} [2024-08-06 06:44:36,641][52670] DAMAGECOUNT value on done: 771018.0 [2024-08-06 06:44:36,643][52670] Sum rewards: 82.547, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '67.000'} [2024-08-06 06:44:37,128][52663] DAMAGECOUNT value on done: 781232.0 [2024-08-06 06:44:37,128][52663] Sum rewards: 80.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon5': '0.014', 'AMMO4': '0.015', 'WEAPON5': '0.050', 'AMMO3': '0.232', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.404', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 06:44:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 582901760. Throughput: 0: 4354.4. Samples: 145728520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:37,794][52567] Avg episode reward: [(0, '75.437')] [2024-08-06 06:44:38,260][52658] DAMAGECOUNT value on done: 776160.0 [2024-08-06 06:44:38,261][52658] Sum rewards: 73.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.044', 'weapon4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.384', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:38,439][52669] DAMAGECOUNT value on done: 804318.0 [2024-08-06 06:44:38,439][52669] Sum rewards: 73.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.080', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.093', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.244', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:38,937][52668] DAMAGECOUNT value on done: 783712.0 [2024-08-06 06:44:38,937][52668] Sum rewards: 79.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.010', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.400', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '67.000'} [2024-08-06 06:44:39,218][52671] DAMAGECOUNT value on done: 772258.0 [2024-08-06 06:44:39,219][52671] Sum rewards: 82.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.198', 'weapon2': '0.200', 'AMMO4': '0.222', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '67.000'} [2024-08-06 06:44:39,309][52666] DAMAGECOUNT value on done: 766619.0 [2024-08-06 06:44:39,310][52666] Sum rewards: 62.198, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.058', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.290', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.492', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '51.000'} [2024-08-06 06:44:39,385][52670] DAMAGECOUNT value on done: 772210.0 [2024-08-06 06:44:39,397][52670] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.245', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.372', 'WEAPON3': '1.600', 'weapon3': '3.294', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '71.000'} [2024-08-06 06:44:39,423][52811] DAMAGECOUNT value on done: 722901.0 [2024-08-06 06:44:39,424][52811] Sum rewards: 64.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.128', 'AMMO3': '0.185', 'weapon2': '0.236', 'weapon5': '0.246', 'AMMO4': '0.247', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'HITCOUNT': '2.720', 'weapon3': '3.150', 'DAMAGECOUNT': '15.168', 'FRAGCOUNT': '55.000'} [2024-08-06 06:44:39,772][52647] DAMAGECOUNT value on done: 812562.0 [2024-08-06 06:44:39,773][52647] Sum rewards: 56.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.700', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.078', 'weapon4': '0.130', 'AMMO3': '0.210', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.094', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '50.000'} [2024-08-06 06:44:39,889][52663] DAMAGECOUNT value on done: 786533.0 [2024-08-06 06:44:39,889][52663] Sum rewards: 79.657, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.134', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO4': '0.180', 'weapon4': '0.244', 'AMMO3': '0.287', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '2.996', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.445', 'FRAGCOUNT': '69.000'} [2024-08-06 06:44:40,351][52650] Updated weights for policy 0, policy_version 71161 (0.0020) [2024-08-06 06:44:40,948][52658] DAMAGECOUNT value on done: 782950.0 [2024-08-06 06:44:40,958][52658] Sum rewards: 56.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.050', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.121', 'weapon5': '0.136', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '2.660', 'weapon3': '3.384', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '46.000'} [2024-08-06 06:44:41,161][52669] DAMAGECOUNT value on done: 792344.0 [2024-08-06 06:44:41,161][52669] Sum rewards: 75.850, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.224', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.100', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.328', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '21.210', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:41,778][52668] DAMAGECOUNT value on done: 788507.0 [2024-08-06 06:44:41,781][52668] Sum rewards: 75.499, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.954', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.097', 'weapon2': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.206', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.318', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '66.000'} [2024-08-06 06:44:41,999][52666] DAMAGECOUNT value on done: 776066.0 [2024-08-06 06:44:42,001][52666] Sum rewards: 64.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.064', 'AMMO4': '0.114', 'AMMO3': '0.234', 'weapon5': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.104', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '55.000'} [2024-08-06 06:44:42,055][52670] DAMAGECOUNT value on done: 766900.0 [2024-08-06 06:44:42,056][52670] Sum rewards: 73.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.090', 'AMMO4': '0.170', 'weapon5': '0.190', 'AMMO3': '0.213', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:42,298][52671] DAMAGECOUNT value on done: 791496.0 [2024-08-06 06:44:42,300][52671] Sum rewards: 68.334, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.418', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.144', 'weapon5': '0.174', 'AMMO4': '0.226', 'weapon2': '0.260', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.124', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:42,564][52811] DAMAGECOUNT value on done: 729696.0 [2024-08-06 06:44:42,565][52811] Sum rewards: 62.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.102', 'AMMO3': '0.229', 'weapon5': '0.232', 'AMMO4': '0.260', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '2.948', 'DAMAGECOUNT': '15.117', 'FRAGCOUNT': '52.000'} [2024-08-06 06:44:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 582983680. Throughput: 0: 4361.6. Samples: 145755100. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 06:44:42,794][52567] Avg episode reward: [(0, '74.551')] [2024-08-06 06:44:42,854][52663] DAMAGECOUNT value on done: 773637.0 [2024-08-06 06:44:42,855][52663] Sum rewards: 75.176, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.185', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.168', 'AMMO3': '0.172', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:44,011][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:44:44,090][52669] DAMAGECOUNT value on done: 785705.0 [2024-08-06 06:44:44,090][52669] Sum rewards: 76.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.023', 'AMMO2': '0.046', 'weapon4': '0.126', 'AMMO3': '0.178', 'weapon5': '0.216', 'AMMO4': '0.233', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.902', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '62.500'} [2024-08-06 06:44:44,307][52668] DAMAGECOUNT value on done: 784125.0 [2024-08-06 06:44:44,308][52668] Sum rewards: 83.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.028', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.189', 'weapon2': '0.230', 'weapon4': '0.238', 'weapon5': '0.262', 'AMMO4': '0.271', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '66.000'} [2024-08-06 06:44:45,128][52650] Updated weights for policy 0, policy_version 71171 (0.0012) [2024-08-06 06:44:45,196][52666] DAMAGECOUNT value on done: 770718.0 [2024-08-06 06:44:45,197][52666] Sum rewards: 63.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.082', 'weapon4': '0.084', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.626', 'WEAPON3': '1.550', 'weapon3': '2.910', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '54.000'} [2024-08-06 06:44:45,248][52671] DAMAGECOUNT value on done: 789193.0 [2024-08-06 06:44:45,249][52671] Sum rewards: 71.244, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.194', 'AMMO3': '0.201', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:45,304][52670] DAMAGECOUNT value on done: 779811.0 [2024-08-06 06:44:45,305][52670] Sum rewards: 66.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.641', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.146', 'AMMO3': '0.184', 'weapon5': '0.238', 'weapon2': '0.274', 'AMMO4': '0.310', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.072', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '56.500'} [2024-08-06 06:44:45,583][52811] DAMAGECOUNT value on done: 739865.0 [2024-08-06 06:44:45,583][52811] Sum rewards: 74.107, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.250', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.104', 'AMMO4': '0.193', 'weapon2': '0.246', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.900', 'weapon3': '3.352', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '66.000'} [2024-08-06 06:44:46,843][52669] DAMAGECOUNT value on done: 790038.0 [2024-08-06 06:44:46,845][52669] Sum rewards: 84.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.413', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.170', 'AMMO4': '0.178', 'AMMO3': '0.262', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.130', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '71.000'} [2024-08-06 06:44:47,178][52668] DAMAGECOUNT value on done: 790888.0 [2024-08-06 06:44:47,180][52668] Sum rewards: 71.049, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.928', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.179', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 583073792. Throughput: 0: 4361.6. Samples: 145768150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:44:47,794][52567] Avg episode reward: [(0, '74.379')] [2024-08-06 06:44:47,839][52671] DAMAGECOUNT value on done: 786443.0 [2024-08-06 06:44:47,839][52671] Sum rewards: 81.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.191', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:48,352][52666] DAMAGECOUNT value on done: 777889.0 [2024-08-06 06:44:48,354][52666] Sum rewards: 67.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.444', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.128', 'weapon4': '0.142', 'AMMO4': '0.143', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '57.000'} [2024-08-06 06:44:48,404][52670] DAMAGECOUNT value on done: 763983.0 [2024-08-06 06:44:48,406][52670] Sum rewards: 75.876, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.068', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.118', 'AMMO3': '0.177', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:48,681][52811] DAMAGECOUNT value on done: 734642.0 [2024-08-06 06:44:48,683][52811] Sum rewards: 75.651, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.335', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.073', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 06:44:49,930][52669] DAMAGECOUNT value on done: 794111.0 [2024-08-06 06:44:49,932][52669] Sum rewards: 70.240, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.105', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.176', 'weapon4': '0.204', 'AMMO4': '0.239', 'AMMO3': '0.268', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:49,938][52668] DAMAGECOUNT value on done: 773320.0 [2024-08-06 06:44:49,939][52668] Sum rewards: 88.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.845', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '72.000'} [2024-08-06 06:44:50,291][52650] Updated weights for policy 0, policy_version 71181 (0.0023) [2024-08-06 06:44:50,996][52671] DAMAGECOUNT value on done: 791152.0 [2024-08-06 06:44:50,996][52671] Sum rewards: 90.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.510', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.136', 'weapon5': '0.156', 'AMMO3': '0.169', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '73.000'} [2024-08-06 06:44:51,311][52666] DAMAGECOUNT value on done: 764834.0 [2024-08-06 06:44:51,315][52666] Sum rewards: 55.273, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.122', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.296', 'WEAPON3': '1.600', 'HITCOUNT': '2.800', 'weapon3': '3.298', 'DAMAGECOUNT': '15.147', 'FRAGCOUNT': '48.000'} [2024-08-06 06:44:51,396][52670] DAMAGECOUNT value on done: 774322.0 [2024-08-06 06:44:51,398][52670] Sum rewards: 70.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.164', 'AMMO5': '0.006', 'AMMO2': '0.015', 'ARMOR': '0.020', 'weapon5': '0.064', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon4': '0.210', 'weapon2': '0.252', 'WEAPON3': '0.950', 'HITCOUNT': '3.190', 'weapon3': '3.320', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '56.000'} [2024-08-06 06:44:51,859][52811] DAMAGECOUNT value on done: 726144.0 [2024-08-06 06:44:51,861][52811] Sum rewards: 76.410, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.217', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.122', 'AMMO3': '0.133', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '0.900', 'weapon3': '3.118', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '60.000'} [2024-08-06 06:44:52,626][52668] DAMAGECOUNT value on done: 785982.0 [2024-08-06 06:44:52,628][52668] Sum rewards: 75.849, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.106', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.148', 'AMMO3': '0.204', 'weapon4': '0.206', 'AMMO4': '0.248', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 583163904. Throughput: 0: 4355.1. Samples: 145794260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:44:52,795][52567] Avg episode reward: [(0, '73.912')] [2024-08-06 06:44:53,890][52671] DAMAGECOUNT value on done: 780319.0 [2024-08-06 06:44:53,894][52671] Sum rewards: 72.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.745', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.150', 'AMMO3': '0.206', 'AMMO4': '0.224', 'weapon5': '0.246', 'weapon2': '0.260', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '59.000'} [2024-08-06 06:44:54,497][52650] Updated weights for policy 0, policy_version 71191 (0.0034) [2024-08-06 06:44:54,683][52666] DAMAGECOUNT value on done: 779363.0 [2024-08-06 06:44:54,684][52666] Sum rewards: 70.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon2': '0.194', 'AMMO4': '0.213', 'weapon5': '0.220', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.508', 'WEAPON3': '1.500', 'weapon3': '2.692', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '58.000'} [2024-08-06 06:44:54,707][52670] DAMAGECOUNT value on done: 782609.0 [2024-08-06 06:44:54,708][52670] Sum rewards: 84.091, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.662', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon4': '0.128', 'AMMO3': '0.179', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '67.000'} [2024-08-06 06:44:54,915][52811] DAMAGECOUNT value on done: 735323.0 [2024-08-06 06:44:54,915][52811] Sum rewards: 74.637, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.040', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.258', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.390', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '65.000'} [2024-08-06 06:44:55,059][52668] DAMAGECOUNT value on done: 786499.0 [2024-08-06 06:44:55,062][52668] Sum rewards: 65.052, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.670', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO3': '0.119', 'weapon5': '0.122', 'AMMO4': '0.138', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.104', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '52.000'} [2024-08-06 06:44:55,593][52662] DAMAGECOUNT value on done: 780617.0 [2024-08-06 06:44:55,596][52662] Sum rewards: 63.244, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.032', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.149', 'weapon5': '0.164', 'AMMO4': '0.192', 'weapon2': '0.338', 'WEAPON5': '0.350', 'weapon4': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.782', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '51.000'} [2024-08-06 06:44:56,971][52666] DAMAGECOUNT value on done: 773568.0 [2024-08-06 06:44:56,973][52666] Sum rewards: 76.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.248', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon2': '0.190', 'AMMO3': '0.204', 'WEAPON3': '1.350', 'HITCOUNT': '3.420', 'weapon3': '3.658', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '64.000'} [2024-08-06 06:44:56,986][52670] DAMAGECOUNT value on done: 775791.0 [2024-08-06 06:44:56,987][52670] Sum rewards: 89.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.100', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.084', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '3.150', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '70.000'} [2024-08-06 06:44:57,240][52614] Signal inference workers to stop experience collection... (13000 times) [2024-08-06 06:44:57,240][52614] Signal inference workers to resume experience collection... (13000 times) [2024-08-06 06:44:57,342][52650] InferenceWorker_p0-w0: stopping experience collection (13000 times) [2024-08-06 06:44:57,349][52650] InferenceWorker_p0-w0: resuming experience collection (13000 times) [2024-08-06 06:44:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 583254016. Throughput: 0: 4356.2. Samples: 145820490. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:44:57,794][52567] Avg episode reward: [(0, '73.918')] [2024-08-06 06:44:57,979][52811] DAMAGECOUNT value on done: 731004.0 [2024-08-06 06:44:57,984][52811] Sum rewards: 62.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.753', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.160', 'weapon4': '0.174', 'AMMO3': '0.207', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '2.940', 'weapon3': '3.170', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '53.000'} [2024-08-06 06:44:58,118][52668] DAMAGECOUNT value on done: 777184.0 [2024-08-06 06:44:58,120][52668] Sum rewards: 65.655, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.162', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.378', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '52.000'} [2024-08-06 06:44:58,553][52662] DAMAGECOUNT value on done: 790405.0 [2024-08-06 06:44:58,554][52662] Sum rewards: 74.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.029', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.233', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.490', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '62.000'} [2024-08-06 06:44:59,227][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:44:59,669][52650] Updated weights for policy 0, policy_version 71201 (0.0010) [2024-08-06 06:45:00,129][52666] DAMAGECOUNT value on done: 774392.0 [2024-08-06 06:45:00,131][52666] Sum rewards: 91.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.240', 'weapon2': '0.542', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '77.000'} [2024-08-06 06:45:00,177][52670] DAMAGECOUNT value on done: 757340.0 [2024-08-06 06:45:00,180][52670] Sum rewards: 53.190, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.540', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.094', 'AMMO4': '0.149', 'weapon5': '0.210', 'weapon2': '0.230', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '2.830', 'weapon3': '3.164', 'DAMAGECOUNT': '15.039', 'FRAGCOUNT': '48.000'} [2024-08-06 06:45:00,562][52668] DAMAGECOUNT value on done: 777470.0 [2024-08-06 06:45:00,562][52668] Sum rewards: 83.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.282', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.156', 'AMMO3': '0.189', 'AMMO4': '0.228', 'weapon5': '0.288', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:01,070][52811] DAMAGECOUNT value on done: 734447.0 [2024-08-06 06:45:01,071][52811] Sum rewards: 73.338, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.197', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.155', 'weapon5': '0.180', 'weapon4': '0.182', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:01,326][52662] DAMAGECOUNT value on done: 792038.0 [2024-08-06 06:45:01,326][52662] Sum rewards: 73.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.565', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.148', 'AMMO4': '0.173', 'weapon5': '0.178', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 583327744. Throughput: 0: 4350.7. Samples: 145833610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:45:02,794][52567] Avg episode reward: [(0, '73.759')] [2024-08-06 06:45:02,798][52668] DAMAGECOUNT value on done: 785191.0 [2024-08-06 06:45:02,798][52668] Sum rewards: 70.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.110', 'weapon2': '0.164', 'AMMO4': '0.167', 'weapon4': '0.172', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.346', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '60.000'} [2024-08-06 06:45:02,945][52666] DAMAGECOUNT value on done: 768867.0 [2024-08-06 06:45:02,945][52666] Sum rewards: 81.303, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.472', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.136', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.228', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.421', 'FRAGCOUNT': '68.500'} [2024-08-06 06:45:02,965][52670] DAMAGECOUNT value on done: 771013.0 [2024-08-06 06:45:02,965][52670] Sum rewards: 66.304, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.608', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.159', 'AMMO4': '0.191', 'weapon5': '0.210', 'weapon2': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '53.000'} [2024-08-06 06:45:03,638][52650] Updated weights for policy 0, policy_version 71211 (0.0014) [2024-08-06 06:45:04,181][52820] DAMAGECOUNT value on done: 723072.0 [2024-08-06 06:45:04,183][52820] Sum rewards: 72.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.634', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.106', 'AMMO3': '0.166', 'AMMO4': '0.174', 'weapon5': '0.220', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:04,310][52811] DAMAGECOUNT value on done: 740046.0 [2024-08-06 06:45:04,319][52811] Sum rewards: 58.572, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.095', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.560', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.864', 'FRAGCOUNT': '51.000'} [2024-08-06 06:45:04,357][52662] DAMAGECOUNT value on done: 776359.0 [2024-08-06 06:45:04,357][52662] Sum rewards: 77.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.797', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.031', 'WEAPON5': '0.050', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'weapon2': '0.162', 'AMMO3': '0.237', 'WEAPON3': '1.500', 'weapon3': '3.536', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '66.000'} [2024-08-06 06:45:04,395][52666] Large shaping reward 2.552 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.531, 177.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:45:05,749][52668] DAMAGECOUNT value on done: 779931.0 [2024-08-06 06:45:05,752][52668] Sum rewards: 73.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.282', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.146', 'weapon5': '0.226', 'AMMO4': '0.243', 'AMMO3': '0.251', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.022', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:05,995][52666] DAMAGECOUNT value on done: 771916.0 [2024-08-06 06:45:05,996][52666] Sum rewards: 72.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.200', 'AMMO3': '0.267', 'weapon5': '0.286', 'weapon4': '0.336', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.704', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '61.000'} [2024-08-06 06:45:06,025][52670] DAMAGECOUNT value on done: 778870.0 [2024-08-06 06:45:06,027][52670] Sum rewards: 68.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO2': '0.001', 'AMMO4': '0.005', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.235', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.178', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:07,300][52820] DAMAGECOUNT value on done: 725470.0 [2024-08-06 06:45:07,300][52820] Sum rewards: 82.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.193', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:07,327][52662] DAMAGECOUNT value on done: 792689.0 [2024-08-06 06:45:07,327][52662] Sum rewards: 84.751, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.096', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon2': '0.212', 'weapon5': '0.218', 'weapon4': '0.222', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '70.000'} [2024-08-06 06:45:07,440][52795] DAMAGECOUNT value on done: 727617.0 [2024-08-06 06:45:07,443][52795] Sum rewards: 70.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.166', 'AMMO4': '0.222', 'AMMO3': '0.242', 'weapon5': '0.244', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.922', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '60.000'} [2024-08-06 06:45:07,442][52811] DAMAGECOUNT value on done: 733578.0 [2024-08-06 06:45:07,445][52811] Sum rewards: 80.625, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.410', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.100', 'AMMO3': '0.246', 'weapon5': '0.248', 'AMMO4': '0.266', 'weapon2': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 583426048. Throughput: 0: 4357.8. Samples: 145859930. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:45:07,794][52567] Avg episode reward: [(0, '73.761')] [2024-08-06 06:45:08,834][52668] DAMAGECOUNT value on done: 774873.0 [2024-08-06 06:45:08,834][52668] Sum rewards: 77.333, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'weapon4': '0.092', 'AMMO3': '0.183', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.380', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '62.000'} [2024-08-06 06:45:08,932][52650] Updated weights for policy 0, policy_version 71221 (0.0026) [2024-08-06 06:45:08,964][52666] DAMAGECOUNT value on done: 785936.0 [2024-08-06 06:45:08,965][52666] Sum rewards: 66.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.114', 'weapon4': '0.122', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '58.000'} [2024-08-06 06:45:08,992][52670] DAMAGECOUNT value on done: 774979.0 [2024-08-06 06:45:08,992][52670] Sum rewards: 71.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.155', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '3.180', 'weapon3': '3.256', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.000'} [2024-08-06 06:45:10,512][52811] DAMAGECOUNT value on done: 729473.0 [2024-08-06 06:45:10,514][52811] Sum rewards: 66.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.468', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.222', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '2.982', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '56.000'} [2024-08-06 06:45:10,608][52820] DAMAGECOUNT value on done: 724748.0 [2024-08-06 06:45:10,610][52820] Sum rewards: 76.448, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.135', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.120', 'weapon5': '0.128', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.078', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '60.000'} [2024-08-06 06:45:10,616][52662] DAMAGECOUNT value on done: 776218.0 [2024-08-06 06:45:10,618][52662] Sum rewards: 79.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.806', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO4': '0.210', 'weapon4': '0.212', 'AMMO3': '0.220', 'weapon5': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:10,620][52795] DAMAGECOUNT value on done: 714274.0 [2024-08-06 06:45:10,620][52795] Sum rewards: 83.695, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.114', 'weapon5': '0.196', 'AMMO4': '0.217', 'AMMO3': '0.246', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '69.000'} [2024-08-06 06:45:11,644][52668] DAMAGECOUNT value on done: 769557.0 [2024-08-06 06:45:11,644][52668] Sum rewards: 78.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.122', 'weapon5': '0.168', 'weapon2': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '65.000'} [2024-08-06 06:45:12,065][52666] DAMAGECOUNT value on done: 763296.0 [2024-08-06 06:45:12,065][52666] Sum rewards: 82.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.003', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.234', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:12,120][52670] DAMAGECOUNT value on done: 778242.0 [2024-08-06 06:45:12,120][52670] Sum rewards: 66.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.230', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.062', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '55.000'} [2024-08-06 06:45:12,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 583516160. Throughput: 0: 4359.1. Samples: 145886230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:45:12,794][52567] Avg episode reward: [(0, '73.461')] [2024-08-06 06:45:13,135][52650] Updated weights for policy 0, policy_version 71231 (0.0038) [2024-08-06 06:45:13,542][52662] DAMAGECOUNT value on done: 781428.0 [2024-08-06 06:45:13,543][52662] Sum rewards: 66.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.746', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.166', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.254', 'WEAPON4': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:13,587][52811] DAMAGECOUNT value on done: 728655.0 [2024-08-06 06:45:13,590][52811] Sum rewards: 90.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.828', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon5': '0.242', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.273', 'FRAGCOUNT': '73.000'} [2024-08-06 06:45:13,692][52795] DAMAGECOUNT value on done: 715947.0 [2024-08-06 06:45:13,692][52795] Sum rewards: 71.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.098', 'AMMO4': '0.134', 'weapon5': '0.162', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:13,783][52820] DAMAGECOUNT value on done: 716170.0 [2024-08-06 06:45:13,785][52820] Sum rewards: 67.931, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.162', 'AMMO3': '0.196', 'weapon5': '0.202', 'AMMO4': '0.261', 'weapon2': '0.390', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '56.500'} [2024-08-06 06:45:14,494][52666] DAMAGECOUNT value on done: 773541.0 [2024-08-06 06:45:14,495][52666] Sum rewards: 71.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.416', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.094', 'weapon5': '0.134', 'AMMO4': '0.142', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2024-08-06 06:45:14,698][52668] DAMAGECOUNT value on done: 769852.0 [2024-08-06 06:45:14,698][52668] Sum rewards: 86.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.169', 'weapon2': '0.742', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '69.000'} [2024-08-06 06:45:16,685][52811] DAMAGECOUNT value on done: 729691.0 [2024-08-06 06:45:16,688][52811] Sum rewards: 74.041, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.066', 'weapon5': '0.088', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.284', 'weapon2': '0.396', 'WEAPON3': '1.650', 'weapon3': '3.146', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:16,826][52795] DAMAGECOUNT value on done: 724716.0 [2024-08-06 06:45:16,830][52795] Sum rewards: 77.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.573', 'AMMO5': '0.013', 'AMMO2': '0.060', 'AMMO3': '0.179', 'weapon4': '0.192', 'weapon5': '0.212', 'AMMO4': '0.299', 'weapon2': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.874', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '61.000'} [2024-08-06 06:45:16,881][52662] DAMAGECOUNT value on done: 797586.0 [2024-08-06 06:45:16,882][52662] Sum rewards: 75.765, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:17,173][52820] DAMAGECOUNT value on done: 728187.0 [2024-08-06 06:45:17,173][52820] Sum rewards: 79.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.161', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '66.500'} [2024-08-06 06:45:17,275][52803] DAMAGECOUNT value on done: 726864.0 [2024-08-06 06:45:17,276][52803] Sum rewards: 73.222, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.330', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.148', 'weapon4': '0.192', 'weapon2': '0.216', 'AMMO4': '0.255', 'AMMO3': '0.291', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.156', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:17,333][52668] DAMAGECOUNT value on done: 767529.0 [2024-08-06 06:45:17,333][52668] Sum rewards: 67.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.892', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.144', 'weapon4': '0.154', 'AMMO3': '0.235', 'weapon2': '0.258', 'AMMO4': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 583598080. Throughput: 0: 4371.6. Samples: 145899440. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:45:17,794][52567] Avg episode reward: [(0, '73.545')] [2024-08-06 06:45:18,058][52650] Updated weights for policy 0, policy_version 71241 (0.0012) [2024-08-06 06:45:18,914][52660] DAMAGECOUNT value on done: 780987.0 [2024-08-06 06:45:18,914][52660] Sum rewards: 69.219, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.392', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.206', 'AMMO3': '0.232', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '58.000'} [2024-08-06 06:45:19,847][52811] DAMAGECOUNT value on done: 736210.0 [2024-08-06 06:45:19,849][52811] Sum rewards: 73.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.333', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon5': '0.190', 'weapon4': '0.194', 'AMMO3': '0.239', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.522', 'WEAPON3': '1.600', 'weapon3': '2.834', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '61.000'} [2024-08-06 06:45:20,009][52795] DAMAGECOUNT value on done: 715746.0 [2024-08-06 06:45:20,011][52795] Sum rewards: 69.689, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.094', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.262', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.354', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:20,142][52662] DAMAGECOUNT value on done: 783728.0 [2024-08-06 06:45:20,142][52662] Sum rewards: 77.757, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.006', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.072', 'AMMO4': '0.204', 'AMMO3': '0.224', 'weapon5': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '62.000'} [2024-08-06 06:45:20,380][52820] DAMAGECOUNT value on done: 711280.0 [2024-08-06 06:45:20,385][52668] DAMAGECOUNT value on done: 780131.0 [2024-08-06 06:45:20,382][52820] Sum rewards: 75.536, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.605', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.074', 'weapon4': '0.080', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:20,385][52668] Sum rewards: 80.729, reward structure: {'DEATHCOUNT': '-12.000', 'ARMOR': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.030', 'HEALTH': '0.063', 'AMMO4': '0.148', 'AMMO3': '0.182', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.426', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '2.618', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:20,407][52803] DAMAGECOUNT value on done: 724627.0 [2024-08-06 06:45:20,408][52803] Sum rewards: 80.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.158', 'weapon5': '0.206', 'AMMO3': '0.240', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:21,007][52820] Large shaping reward 3.411 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.36, 120.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:45:22,088][52660] DAMAGECOUNT value on done: 771609.0 [2024-08-06 06:45:22,098][52660] Sum rewards: 83.945, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.365', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO3': '0.153', 'weapon4': '0.348', 'weapon2': '0.516', 'WEAPON3': '0.900', 'weapon3': '2.848', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '65.000'} [2024-08-06 06:45:22,561][52650] Updated weights for policy 0, policy_version 71251 (0.0017) [2024-08-06 06:45:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 583688192. Throughput: 0: 4388.2. Samples: 145925990. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:45:22,795][52567] Avg episode reward: [(0, '74.162')] [2024-08-06 06:45:22,883][52811] DAMAGECOUNT value on done: 738763.0 [2024-08-06 06:45:22,883][52811] Sum rewards: 88.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.168', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.384', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.762', 'FRAGCOUNT': '72.000'} [2024-08-06 06:45:23,077][52795] DAMAGECOUNT value on done: 723284.0 [2024-08-06 06:45:23,078][52795] Sum rewards: 79.576, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.142', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.159', 'weapon5': '0.204', 'weapon4': '0.228', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:23,355][52662] DAMAGECOUNT value on done: 788669.0 [2024-08-06 06:45:23,355][52662] Sum rewards: 66.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.135', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.278', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.392', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '55.000'} [2024-08-06 06:45:23,424][52803] DAMAGECOUNT value on done: 731675.0 [2024-08-06 06:45:23,425][52803] Sum rewards: 68.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.115', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.214', 'weapon2': '0.228', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '56.000'} [2024-08-06 06:45:23,613][52820] DAMAGECOUNT value on done: 719474.0 [2024-08-06 06:45:23,615][52820] Sum rewards: 60.884, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.174', 'AMMO3': '0.191', 'AMMO4': '0.212', 'weapon2': '0.254', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.058', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '49.000'} [2024-08-06 06:45:23,700][52668] DAMAGECOUNT value on done: 781810.0 [2024-08-06 06:45:23,700][52668] Sum rewards: 62.381, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.995', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.143', 'weapon5': '0.192', 'AMMO4': '0.270', 'weapon4': '0.304', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.666', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '48.000'} [2024-08-06 06:45:24,805][52660] DAMAGECOUNT value on done: 784308.0 [2024-08-06 06:45:24,807][52660] Sum rewards: 71.794, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.620', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.187', 'weapon5': '0.224', 'AMMO4': '0.233', 'weapon2': '0.370', 'WEAPON4': '0.400', 'weapon4': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:25,984][52811] DAMAGECOUNT value on done: 729033.0 [2024-08-06 06:45:25,984][52811] Sum rewards: 77.517, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.130', 'AMMO3': '0.155', 'HEALTH': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.582', 'WEAPON3': '0.900', 'weapon3': '2.962', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '61.000'} [2024-08-06 06:45:26,166][52668] DAMAGECOUNT value on done: 779964.0 [2024-08-06 06:45:26,168][52668] Sum rewards: 81.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.269', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.243', 'AMMO4': '0.244', 'weapon4': '0.262', 'weapon5': '0.344', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.674', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.727', 'FRAGCOUNT': '66.000'} [2024-08-06 06:45:26,269][52795] DAMAGECOUNT value on done: 731246.0 [2024-08-06 06:45:26,269][52795] Sum rewards: 76.403, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.766', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.194', 'AMMO4': '0.224', 'weapon2': '0.260', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '65.000'} [2024-08-06 06:45:26,568][52803] DAMAGECOUNT value on done: 731763.0 [2024-08-06 06:45:26,571][52803] Sum rewards: 66.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.092', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.186', 'weapon4': '0.190', 'AMMO3': '0.225', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.040', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:26,610][52662] DAMAGECOUNT value on done: 778897.0 [2024-08-06 06:45:26,611][52662] Sum rewards: 68.817, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.876', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.074', 'weapon5': '0.090', 'weapon2': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.590', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:26,875][52820] DAMAGECOUNT value on done: 723903.0 [2024-08-06 06:45:26,877][52820] Sum rewards: 64.452, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.325', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.116', 'weapon5': '0.126', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.291', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.230', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '56.000'} [2024-08-06 06:45:27,477][52650] Updated weights for policy 0, policy_version 71261 (0.0024) [2024-08-06 06:45:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 583770112. Throughput: 0: 4382.0. Samples: 145952290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:45:27,795][52567] Avg episode reward: [(0, '73.802')] [2024-08-06 06:45:27,851][52660] DAMAGECOUNT value on done: 794014.0 [2024-08-06 06:45:27,851][52660] Sum rewards: 87.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'weapon2': '0.210', 'AMMO3': '0.214', 'WEAPON3': '1.350', 'weapon3': '3.590', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.232', 'FRAGCOUNT': '72.000'} [2024-08-06 06:45:29,147][52811] DAMAGECOUNT value on done: 730383.0 [2024-08-06 06:45:29,147][52811] Sum rewards: 67.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.645', 'AMMO5': '0.023', 'AMMO2': '0.053', 'weapon4': '0.130', 'AMMO3': '0.201', 'AMMO4': '0.267', 'weapon5': '0.316', 'weapon2': '0.512', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:29,397][52668] DAMAGECOUNT value on done: 786515.0 [2024-08-06 06:45:29,398][52668] Sum rewards: 77.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.933', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.182', 'AMMO3': '0.184', 'weapon5': '0.190', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '62.000'} [2024-08-06 06:45:29,412][52795] DAMAGECOUNT value on done: 720670.0 [2024-08-06 06:45:29,415][52795] Sum rewards: 74.486, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.989', 'AMMO2': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.257', 'weapon2': '0.508', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:29,642][52803] DAMAGECOUNT value on done: 728822.0 [2024-08-06 06:45:29,642][52803] Sum rewards: 67.013, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.573', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.054', 'AMMO4': '0.068', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.810', 'WEAPON3': '0.950', 'weapon3': '2.782', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '53.000'} [2024-08-06 06:45:29,666][52662] DAMAGECOUNT value on done: 783355.0 [2024-08-06 06:45:29,670][52662] Sum rewards: 81.166, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.050', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.199', 'weapon5': '0.208', 'weapon4': '0.330', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.800', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:30,039][52820] DAMAGECOUNT value on done: 724781.0 [2024-08-06 06:45:30,041][52820] Sum rewards: 77.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.350', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon2': '0.168', 'AMMO4': '0.201', 'AMMO3': '0.206', 'weapon4': '0.206', 'weapon5': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:30,957][52660] DAMAGECOUNT value on done: 776316.0 [2024-08-06 06:45:30,958][52660] Sum rewards: 78.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.097', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 06:45:31,871][52650] Updated weights for policy 0, policy_version 71271 (0.0027) [2024-08-06 06:45:32,448][52668] DAMAGECOUNT value on done: 784253.0 [2024-08-06 06:45:32,449][52668] Sum rewards: 79.430, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.372', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.137', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.472', 'WEAPON3': '0.950', 'weapon3': '2.788', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:32,520][52795] DAMAGECOUNT value on done: 723856.0 [2024-08-06 06:45:32,520][52795] Sum rewards: 81.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.040', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.231', 'WEAPON3': '1.450', 'weapon3': '3.582', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '68.000'} [2024-08-06 06:45:32,741][52662] DAMAGECOUNT value on done: 775142.0 [2024-08-06 06:45:32,741][52662] Sum rewards: 64.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.557', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.190', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.450', 'weapon3': '2.752', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 583860224. Throughput: 0: 4386.0. Samples: 145965520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:45:32,794][52803] DAMAGECOUNT value on done: 730502.0 [2024-08-06 06:45:32,802][52567] Avg episode reward: [(0, '74.248')] [2024-08-06 06:45:32,802][52803] Sum rewards: 91.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.883', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.180', 'AMMO3': '0.214', 'weapon2': '0.216', 'weapon4': '0.222', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '74.000'} [2024-08-06 06:45:33,103][52820] DAMAGECOUNT value on done: 734275.0 [2024-08-06 06:45:33,103][52820] Sum rewards: 77.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.425', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.192', 'weapon2': '0.206', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.276', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '66.000'} [2024-08-06 06:45:34,339][52660] DAMAGECOUNT value on done: 770657.0 [2024-08-06 06:45:34,340][52660] Sum rewards: 73.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.107', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.151', 'weapon2': '0.182', 'AMMO3': '0.198', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '60.000'} [2024-08-06 06:45:35,544][52662] DAMAGECOUNT value on done: 786958.0 [2024-08-06 06:45:35,545][52662] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.144', 'AMMO4': '0.151', 'weapon5': '0.186', 'AMMO3': '0.207', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 06:45:35,626][52795] DAMAGECOUNT value on done: 726490.0 [2024-08-06 06:45:35,627][52795] Sum rewards: 66.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.873', 'AMMO5': '0.016', 'AMMO2': '0.057', 'AMMO3': '0.199', 'weapon2': '0.234', 'AMMO4': '0.286', 'weapon5': '0.350', 'weapon4': '0.546', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.480', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '55.000'} [2024-08-06 06:45:35,845][52803] DAMAGECOUNT value on done: 721257.0 [2024-08-06 06:45:35,845][52803] Sum rewards: 63.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.115', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.150', 'weapon2': '0.180', 'weapon4': '0.180', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.280', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '55.000'} [2024-08-06 06:45:36,194][52820] DAMAGECOUNT value on done: 718097.0 [2024-08-06 06:45:36,194][52820] Sum rewards: 77.640, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.093', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.152', 'weapon2': '0.212', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.292', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:36,635][52650] Updated weights for policy 0, policy_version 71281 (0.0018) [2024-08-06 06:45:36,974][52660] DAMAGECOUNT value on done: 781013.0 [2024-08-06 06:45:36,974][52660] Sum rewards: 66.034, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.448', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.180', 'AMMO4': '0.197', 'AMMO3': '0.224', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '56.000'} [2024-08-06 06:45:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 583950336. Throughput: 0: 4386.9. Samples: 145991670. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:45:37,802][52567] Avg episode reward: [(0, '74.300')] [2024-08-06 06:45:38,000][52662] DAMAGECOUNT value on done: 774089.0 [2024-08-06 06:45:38,001][52662] Sum rewards: 75.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.418', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.239', 'WEAPON3': '1.350', 'HITCOUNT': '3.420', 'weapon3': '3.456', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '62.000'} [2024-08-06 06:45:38,770][52795] DAMAGECOUNT value on done: 722358.0 [2024-08-06 06:45:38,770][52795] Sum rewards: 91.316, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO2': '0.011', 'AMMO5': '0.012', 'weapon4': '0.016', 'weapon5': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.344', 'HEALTH': '0.888', 'WEAPON3': '1.000', 'weapon3': '3.422', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '73.000'} [2024-08-06 06:45:38,990][52803] DAMAGECOUNT value on done: 720887.0 [2024-08-06 06:45:38,991][52803] Sum rewards: 76.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.565', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.164', 'weapon4': '0.180', 'weapon2': '0.220', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:39,410][52820] DAMAGECOUNT value on done: 726639.0 [2024-08-06 06:45:39,412][52820] Sum rewards: 75.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.465', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.100', 'weapon5': '0.118', 'AMMO4': '0.140', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '60.000'} [2024-08-06 06:45:39,499][52660] DAMAGECOUNT value on done: 787468.0 [2024-08-06 06:45:39,499][52660] Sum rewards: 70.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.021', 'AMMO2': '0.039', 'AMMO3': '0.177', 'weapon5': '0.182', 'AMMO4': '0.194', 'weapon2': '0.222', 'weapon4': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.500'} [2024-08-06 06:45:41,070][52662] DAMAGECOUNT value on done: 791270.0 [2024-08-06 06:45:41,072][52662] Sum rewards: 81.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.352', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:41,209][52650] Updated weights for policy 0, policy_version 71291 (0.0039) [2024-08-06 06:45:41,863][52795] DAMAGECOUNT value on done: 716383.0 [2024-08-06 06:45:41,864][52795] Sum rewards: 74.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.357', 'AMMO5': '0.031', 'AMMO2': '0.065', 'AMMO3': '0.169', 'weapon5': '0.292', 'weapon4': '0.312', 'AMMO4': '0.326', 'weapon2': '0.344', 'WEAPON4': '0.700', 'WEAPON5': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '60.500'} [2024-08-06 06:45:42,085][52803] DAMAGECOUNT value on done: 726286.0 [2024-08-06 06:45:42,085][52803] Sum rewards: 76.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.484', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO3': '0.185', 'AMMO4': '0.191', 'weapon4': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '62.000'} [2024-08-06 06:45:42,421][52820] DAMAGECOUNT value on done: 734143.0 [2024-08-06 06:45:42,422][52820] Sum rewards: 83.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.163', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.211', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '68.000'} [2024-08-06 06:45:42,687][52660] DAMAGECOUNT value on done: 772520.0 [2024-08-06 06:45:42,688][52660] Sum rewards: 72.132, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.136', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'WEAPON4': '0.250', 'weapon2': '0.500', 'WEAPON3': '0.900', 'weapon3': '3.090', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 584040448. Throughput: 0: 4389.3. Samples: 146018010. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:45:42,802][52567] Avg episode reward: [(0, '74.549')] [2024-08-06 06:45:43,585][52662] DAMAGECOUNT value on done: 784744.0 [2024-08-06 06:45:43,586][52662] Sum rewards: 81.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.176', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.126', 'AMMO4': '0.163', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '65.000'} [2024-08-06 06:45:45,005][52795] DAMAGECOUNT value on done: 718173.0 [2024-08-06 06:45:45,006][52795] Sum rewards: 73.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.325', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.015', 'weapon4': '0.044', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.380', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:45,267][52803] DAMAGECOUNT value on done: 725906.0 [2024-08-06 06:45:45,267][52803] Sum rewards: 77.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.462', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '65.000'} [2024-08-06 06:45:45,550][52660] DAMAGECOUNT value on done: 775853.0 [2024-08-06 06:45:45,552][52660] Sum rewards: 74.566, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.989', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.175', 'weapon4': '0.216', 'weapon5': '0.224', 'AMMO4': '0.260', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:45,758][52820] DAMAGECOUNT value on done: 726977.0 [2024-08-06 06:45:45,759][52820] Sum rewards: 88.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.865', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.118', 'AMMO3': '0.177', 'weapon5': '0.216', 'AMMO4': '0.243', 'weapon2': '0.282', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.102', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '73.000'} [2024-08-06 06:45:46,071][52650] Updated weights for policy 0, policy_version 71301 (0.0019) [2024-08-06 06:45:46,486][52662] DAMAGECOUNT value on done: 770813.0 [2024-08-06 06:45:46,488][52662] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO4': '0.140', 'weapon4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:47,404][52659] DAMAGECOUNT value on done: 784670.0 [2024-08-06 06:45:47,405][52659] Sum rewards: 78.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.935', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.022', 'weapon5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.592', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '66.000'} [2024-08-06 06:45:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 584130560. Throughput: 0: 4392.6. Samples: 146031280. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:45:47,795][52567] Avg episode reward: [(0, '74.818')] [2024-08-06 06:45:47,967][52660] DAMAGECOUNT value on done: 781527.0 [2024-08-06 06:45:47,969][52660] Sum rewards: 81.546, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.615', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.148', 'weapon2': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.478', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '66.000'} [2024-08-06 06:45:48,218][52795] DAMAGECOUNT value on done: 727297.0 [2024-08-06 06:45:48,221][52795] Sum rewards: 75.765, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.454', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.120', 'AMMO3': '0.208', 'weapon4': '0.220', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:48,279][52667] DAMAGECOUNT value on done: 781561.0 [2024-08-06 06:45:48,281][52667] Sum rewards: 75.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.516', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.082', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '3.056', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '62.000'} [2024-08-06 06:45:48,317][52803] DAMAGECOUNT value on done: 738792.0 [2024-08-06 06:45:48,318][52803] Sum rewards: 71.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.404', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.146', 'weapon5': '0.190', 'AMMO3': '0.229', 'AMMO4': '0.255', 'weapon2': '0.494', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.872', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:48,924][52820] DAMAGECOUNT value on done: 729306.0 [2024-08-06 06:45:48,926][52820] Sum rewards: 69.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon5': '0.156', 'weapon4': '0.228', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:49,360][52662] DAMAGECOUNT value on done: 782602.0 [2024-08-06 06:45:49,363][52662] Sum rewards: 73.968, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.140', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.178', 'AMMO4': '0.205', 'weapon4': '0.218', 'weapon5': '0.358', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.720', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '58.000'} [2024-08-06 06:45:50,119][52659] DAMAGECOUNT value on done: 783837.0 [2024-08-06 06:45:50,119][52659] Sum rewards: 77.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.205', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.202', 'weapon4': '0.262', 'AMMO4': '0.294', 'weapon5': '0.344', 'weapon2': '0.458', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.618', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '64.000'} [2024-08-06 06:45:50,435][52650] Updated weights for policy 0, policy_version 71311 (0.0012) [2024-08-06 06:45:51,166][52660] DAMAGECOUNT value on done: 774124.0 [2024-08-06 06:45:51,166][52660] Sum rewards: 86.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.882', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.088', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.306', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.132', 'FRAGCOUNT': '74.000'} [2024-08-06 06:45:51,345][52795] DAMAGECOUNT value on done: 712202.0 [2024-08-06 06:45:51,345][52795] Sum rewards: 78.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.171', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.197', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:51,507][52803] DAMAGECOUNT value on done: 729829.0 [2024-08-06 06:45:51,508][52803] Sum rewards: 75.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.007', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'weapon4': '0.052', 'AMMO4': '0.070', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '62.000'} [2024-08-06 06:45:51,746][52667] DAMAGECOUNT value on done: 789600.0 [2024-08-06 06:45:51,747][52667] Sum rewards: 75.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.136', 'weapon4': '0.148', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:51,794][52662] DAMAGECOUNT value on done: 773270.0 [2024-08-06 06:45:51,796][52662] Sum rewards: 77.346, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.595', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon2': '0.462', 'WEAPON3': '1.650', 'weapon3': '3.184', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '66.000'} [2024-08-06 06:45:52,042][52820] DAMAGECOUNT value on done: 725353.0 [2024-08-06 06:45:52,042][52820] Sum rewards: 70.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.566', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.166', 'AMMO3': '0.198', 'weapon5': '0.214', 'AMMO4': '0.223', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '57.000'} [2024-08-06 06:45:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 584212480. Throughput: 0: 4390.2. Samples: 146057490. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:45:52,795][52567] Avg episode reward: [(0, '75.444')] [2024-08-06 06:45:53,191][52659] DAMAGECOUNT value on done: 787059.0 [2024-08-06 06:45:53,194][52659] Sum rewards: 58.629, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.620', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.326', 'weapon2': '0.456', 'WEAPON3': '1.900', 'HITCOUNT': '2.970', 'weapon3': '3.022', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '56.000'} [2024-08-06 06:45:54,240][52667] DAMAGECOUNT value on done: 787072.0 [2024-08-06 06:45:54,241][52667] Sum rewards: 72.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.584', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.140', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.304', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '59.000'} [2024-08-06 06:45:54,351][52660] DAMAGECOUNT value on done: 780215.0 [2024-08-06 06:45:54,352][52660] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO3': '0.166', 'AMMO4': '0.186', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '2.962', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '54.000'} [2024-08-06 06:45:54,492][52795] DAMAGECOUNT value on done: 728974.0 [2024-08-06 06:45:54,492][52795] Sum rewards: 71.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.972', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.230', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 06:45:54,606][52803] DAMAGECOUNT value on done: 728390.0 [2024-08-06 06:45:54,606][52803] Sum rewards: 51.116, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon2': '0.114', 'weapon5': '0.116', 'weapon7': '0.116', 'AMMO4': '0.140', 'AMMO3': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '0.900', 'weapon4': '1.198', 'weapon3': '2.262', 'HITCOUNT': '2.300', 'DAMAGECOUNT': '11.580', 'FRAGCOUNT': '41.000'} [2024-08-06 06:45:55,171][52820] DAMAGECOUNT value on done: 727279.0 [2024-08-06 06:45:55,172][52820] Sum rewards: 69.080, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.396', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.170', 'weapon4': '0.178', 'AMMO4': '0.196', 'weapon2': '0.254', 'AMMO3': '0.265', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '58.000'} [2024-08-06 06:45:55,297][52650] Updated weights for policy 0, policy_version 71321 (0.0026) [2024-08-06 06:45:56,403][52659] DAMAGECOUNT value on done: 783706.0 [2024-08-06 06:45:56,404][52659] Sum rewards: 65.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.178', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.080', 'weapon5': '0.172', 'AMMO3': '0.225', 'AMMO4': '0.242', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.000'} [2024-08-06 06:45:57,002][52667] DAMAGECOUNT value on done: 792420.0 [2024-08-06 06:45:57,002][52667] Sum rewards: 70.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.153', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.372', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '58.000'} [2024-08-06 06:45:57,674][52660] DAMAGECOUNT value on done: 790525.0 [2024-08-06 06:45:57,676][52660] Sum rewards: 72.643, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.395', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.112', 'AMMO4': '0.115', 'weapon5': '0.148', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '0.900', 'weapon3': '3.094', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '58.000'} [2024-08-06 06:45:57,686][52795] DAMAGECOUNT value on done: 725355.0 [2024-08-06 06:45:57,687][52795] Sum rewards: 76.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.518', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.094', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.424', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '63.000'} [2024-08-06 06:45:57,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 584294400. Throughput: 0: 4386.9. Samples: 146083640. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:45:57,802][52567] Avg episode reward: [(0, '74.648')] [2024-08-06 06:45:57,921][52803] DAMAGECOUNT value on done: 740788.0 [2024-08-06 06:45:57,923][52803] Sum rewards: 59.859, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.084', 'weapon5': '0.098', 'AMMO3': '0.178', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.188', 'DAMAGECOUNT': '14.619', 'FRAGCOUNT': '50.000'} [2024-08-06 06:45:58,398][52820] DAMAGECOUNT value on done: 738652.0 [2024-08-06 06:45:58,400][52820] Sum rewards: 62.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.686', 'WEAPON3': '0.950', 'weapon3': '2.914', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '51.000'} [2024-08-06 06:45:59,070][52659] DAMAGECOUNT value on done: 783526.0 [2024-08-06 06:45:59,071][52659] Sum rewards: 80.313, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.636', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.078', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'weapon3': '3.376', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '67.000'} [2024-08-06 06:45:59,939][52667] DAMAGECOUNT value on done: 793831.0 [2024-08-06 06:45:59,941][52667] Sum rewards: 69.303, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.408', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.174', 'weapon2': '0.190', 'AMMO4': '0.198', 'AMMO3': '0.212', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 06:46:00,296][52650] Updated weights for policy 0, policy_version 71331 (0.0014) [2024-08-06 06:46:00,913][52795] DAMAGECOUNT value on done: 716837.0 [2024-08-06 06:46:00,914][52795] Sum rewards: 75.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.140', 'AMMO4': '0.149', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:00,989][52803] DAMAGECOUNT value on done: 726670.0 [2024-08-06 06:46:00,991][52803] Sum rewards: 70.735, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.975', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.112', 'AMMO4': '0.166', 'AMMO3': '0.167', 'weapon5': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.918', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:01,006][52660] DAMAGECOUNT value on done: 799271.0 [2024-08-06 06:46:01,006][52660] Sum rewards: 67.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.505', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.134', 'AMMO4': '0.141', 'AMMO3': '0.224', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.308', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '56.000'} [2024-08-06 06:46:01,500][52820] DAMAGECOUNT value on done: 736320.0 [2024-08-06 06:46:01,500][52820] Sum rewards: 81.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.168', 'weapon5': '0.222', 'AMMO4': '0.225', 'weapon2': '0.230', 'AMMO3': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.850', 'FRAGCOUNT': '68.000'} [2024-08-06 06:46:01,725][52659] DAMAGECOUNT value on done: 784055.0 [2024-08-06 06:46:01,727][52659] Sum rewards: 65.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.902', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.062', 'weapon5': '0.180', 'weapon4': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.309', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.618', 'WEAPON3': '1.350', 'weapon3': '2.724', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:02,530][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:46:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 584384512. Throughput: 0: 4381.3. Samples: 146096600. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:02,794][52567] Avg episode reward: [(0, '74.259')] [2024-08-06 06:46:03,089][52667] DAMAGECOUNT value on done: 791151.0 [2024-08-06 06:46:03,091][52667] Sum rewards: 72.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.846', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.066', 'weapon5': '0.084', 'AMMO4': '0.130', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.602', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '58.000'} [2024-08-06 06:46:04,086][52795] DAMAGECOUNT value on done: 723382.0 [2024-08-06 06:46:04,086][52795] Sum rewards: 64.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.172', 'AMMO3': '0.203', 'weapon5': '0.246', 'AMMO4': '0.289', 'weapon2': '0.410', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.000'} [2024-08-06 06:46:04,180][52660] DAMAGECOUNT value on done: 778133.0 [2024-08-06 06:46:04,180][52660] Sum rewards: 94.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.305', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.038', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.232', 'WEAPON3': '1.250', 'weapon3': '3.484', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.360', 'FRAGCOUNT': '77.000'} [2024-08-06 06:46:04,192][52803] DAMAGECOUNT value on done: 730256.0 [2024-08-06 06:46:04,193][52803] Sum rewards: 85.021, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.138', 'AMMO4': '0.172', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.428', 'weapon4': '0.434', 'HEALTH': '0.477', 'WEAPON3': '0.800', 'weapon3': '2.694', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '66.000'} [2024-08-06 06:46:04,499][52650] Updated weights for policy 0, policy_version 71341 (0.0015) [2024-08-06 06:46:04,658][52820] DAMAGECOUNT value on done: 721243.0 [2024-08-06 06:46:04,659][52820] Sum rewards: 75.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.895', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.104', 'AMMO3': '0.184', 'AMMO4': '0.235', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '62.000'} [2024-08-06 06:46:04,840][52659] DAMAGECOUNT value on done: 785119.0 [2024-08-06 06:46:04,841][52659] Sum rewards: 70.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon5': '0.186', 'AMMO3': '0.211', 'weapon4': '0.214', 'AMMO4': '0.235', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '58.000'} [2024-08-06 06:46:06,120][52667] DAMAGECOUNT value on done: 788131.0 [2024-08-06 06:46:06,120][52667] Sum rewards: 62.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.124', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.162', 'AMMO4': '0.172', 'weapon2': '0.198', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.312', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '52.000'} [2024-08-06 06:46:07,169][52803] DAMAGECOUNT value on done: 732988.0 [2024-08-06 06:46:07,172][52803] Sum rewards: 80.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.190', 'weapon5': '0.256', 'weapon2': '0.262', 'AMMO4': '0.269', 'weapon4': '0.334', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '67.000'} [2024-08-06 06:46:07,217][52795] DAMAGECOUNT value on done: 731988.0 [2024-08-06 06:46:07,217][52795] Sum rewards: 89.763, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.863', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.142', 'AMMO4': '0.154', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.312', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '4.380', 'DAMAGECOUNT': '21.750', 'FRAGCOUNT': '71.000'} [2024-08-06 06:46:07,365][52660] DAMAGECOUNT value on done: 785625.0 [2024-08-06 06:46:07,365][52660] Sum rewards: 73.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.032', 'weapon4': '0.074', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.404', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:07,734][52659] DAMAGECOUNT value on done: 782513.0 [2024-08-06 06:46:07,736][52659] Sum rewards: 76.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.800', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.040', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon5': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 584474624. Throughput: 0: 4369.1. Samples: 146122600. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:07,794][52567] Avg episode reward: [(0, '74.245')] [2024-08-06 06:46:08,699][52649] DAMAGECOUNT value on done: 759533.0 [2024-08-06 06:46:08,700][52649] Sum rewards: 79.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.491', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.114', 'AMMO3': '0.167', 'weapon5': '0.180', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.000', 'weapon3': '3.156', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 06:46:08,758][52667] DAMAGECOUNT value on done: 784659.0 [2024-08-06 06:46:08,760][52667] Sum rewards: 72.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.162', 'AMMO3': '0.167', 'weapon5': '0.184', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:09,534][52650] Updated weights for policy 0, policy_version 71351 (0.0029) [2024-08-06 06:46:10,314][52803] DAMAGECOUNT value on done: 735869.0 [2024-08-06 06:46:10,315][52803] Sum rewards: 74.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.392', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '3.234', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '61.000'} [2024-08-06 06:46:10,338][52660] DAMAGECOUNT value on done: 784467.0 [2024-08-06 06:46:10,338][52660] Sum rewards: 82.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.100', 'AMMO3': '0.181', 'AMMO4': '0.249', 'weapon5': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '67.000'} [2024-08-06 06:46:10,525][52659] DAMAGECOUNT value on done: 786000.0 [2024-08-06 06:46:10,526][52659] Sum rewards: 55.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.812', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.118', 'weapon5': '0.224', 'AMMO3': '0.244', 'AMMO4': '0.268', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.710', 'weapon3': '3.098', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '47.000'} [2024-08-06 06:46:11,531][52667] DAMAGECOUNT value on done: 787223.0 [2024-08-06 06:46:11,532][52667] Sum rewards: 81.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.054', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.130', 'AMMO4': '0.146', 'AMMO3': '0.188', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.456', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '67.000'} [2024-08-06 06:46:12,170][52649] DAMAGECOUNT value on done: 752023.0 [2024-08-06 06:46:12,171][52649] Sum rewards: 77.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.368', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.209', 'AMMO4': '0.223', 'weapon4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '64.000'} [2024-08-06 06:46:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 584564736. Throughput: 0: 4370.5. Samples: 146148960. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:12,794][52567] Avg episode reward: [(0, '74.331')] [2024-08-06 06:46:12,901][52660] DAMAGECOUNT value on done: 773435.0 [2024-08-06 06:46:12,901][52660] Sum rewards: 73.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.088', 'weapon5': '0.088', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.326', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:13,407][52803] DAMAGECOUNT value on done: 737810.0 [2024-08-06 06:46:13,409][52803] Sum rewards: 81.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.095', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.076', 'AMMO4': '0.159', 'weapon5': '0.218', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '68.000'} [2024-08-06 06:46:13,636][52659] DAMAGECOUNT value on done: 791415.0 [2024-08-06 06:46:13,638][52659] Sum rewards: 71.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.088', 'AMMO4': '0.132', 'weapon5': '0.166', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:14,096][52650] Updated weights for policy 0, policy_version 71361 (0.0015) [2024-08-06 06:46:14,286][52667] DAMAGECOUNT value on done: 792731.0 [2024-08-06 06:46:14,286][52667] Sum rewards: 74.255, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '62.000'} [2024-08-06 06:46:14,904][52649] DAMAGECOUNT value on done: 770612.0 [2024-08-06 06:46:14,904][52649] Sum rewards: 72.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.356', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.112', 'AMMO4': '0.161', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:16,021][52660] DAMAGECOUNT value on done: 773569.0 [2024-08-06 06:46:16,021][52660] Sum rewards: 74.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.426', 'AMMO2': '0.004', 'WEAPON1': '0.010', 'AMMO4': '0.018', 'AMMO3': '0.244', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:16,434][52659] DAMAGECOUNT value on done: 779752.0 [2024-08-06 06:46:16,435][52659] Sum rewards: 76.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.184', 'AMMO3': '0.193', 'weapon2': '0.268', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:16,527][52803] DAMAGECOUNT value on done: 732948.0 [2024-08-06 06:46:16,527][52803] Sum rewards: 83.412, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.790', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.130', 'AMMO4': '0.173', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.284', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '66.000'} [2024-08-06 06:46:17,343][52667] DAMAGECOUNT value on done: 783238.0 [2024-08-06 06:46:17,343][52667] Sum rewards: 66.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon4': '0.126', 'weapon5': '0.190', 'AMMO3': '0.209', 'AMMO4': '0.224', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '56.000'} [2024-08-06 06:46:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 584646656. Throughput: 0: 4366.4. Samples: 146162010. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:17,802][52567] Avg episode reward: [(0, '74.486')] [2024-08-06 06:46:17,868][52649] DAMAGECOUNT value on done: 764844.0 [2024-08-06 06:46:17,870][52649] Sum rewards: 66.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.618', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.106', 'AMMO3': '0.177', 'weapon5': '0.188', 'AMMO4': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '54.000'} [2024-08-06 06:46:18,615][52650] Updated weights for policy 0, policy_version 71371 (0.0012) [2024-08-06 06:46:19,537][52659] DAMAGECOUNT value on done: 789792.0 [2024-08-06 06:46:19,537][52659] Sum rewards: 84.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.762', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '69.000'} [2024-08-06 06:46:19,895][52667] DAMAGECOUNT value on done: 785517.0 [2024-08-06 06:46:19,895][52667] Sum rewards: 79.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.328', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.188', 'weapon4': '0.248', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.286', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '68.000'} [2024-08-06 06:46:21,008][52649] DAMAGECOUNT value on done: 754853.0 [2024-08-06 06:46:21,014][52649] Sum rewards: 76.543, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.114', 'weapon5': '0.162', 'weapon2': '0.174', 'AMMO4': '0.271', 'AMMO3': '0.301', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.258', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '65.000'} [2024-08-06 06:46:22,193][52659] DAMAGECOUNT value on done: 783131.0 [2024-08-06 06:46:22,193][52659] Sum rewards: 77.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.094', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '64.000'} [2024-08-06 06:46:22,587][52667] DAMAGECOUNT value on done: 793166.0 [2024-08-06 06:46:22,588][52667] Sum rewards: 72.340, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.172', 'weapon4': '0.176', 'AMMO3': '0.253', 'AMMO4': '0.303', 'weapon2': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '61.000'} [2024-08-06 06:46:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 584736768. Throughput: 0: 4368.0. Samples: 146188230. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:22,802][52567] Avg episode reward: [(0, '74.603')] [2024-08-06 06:46:23,116][52794] DAMAGECOUNT value on done: 780010.0 [2024-08-06 06:46:23,127][52794] Sum rewards: 65.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.416', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO4': '0.272', 'weapon4': '0.276', 'AMMO3': '0.281', 'weapon5': '0.318', 'weapon2': '0.320', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.704', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '55.500'} [2024-08-06 06:46:23,325][52649] DAMAGECOUNT value on done: 768850.0 [2024-08-06 06:46:23,326][52649] Sum rewards: 67.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.062', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.120', 'AMMO4': '0.193', 'weapon5': '0.248', 'AMMO3': '0.263', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.822', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:23,631][52650] Updated weights for policy 0, policy_version 71381 (0.0043) [2024-08-06 06:46:25,182][52667] DAMAGECOUNT value on done: 781860.0 [2024-08-06 06:46:25,184][52667] Sum rewards: 76.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.112', 'AMMO5': '0.021', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO4': '0.172', 'weapon5': '0.192', 'AMMO3': '0.203', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.110', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '62.500'} [2024-08-06 06:46:25,198][52659] DAMAGECOUNT value on done: 784896.0 [2024-08-06 06:46:25,199][52659] Sum rewards: 73.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.150', 'AMMO3': '0.211', 'weapon5': '0.240', 'AMMO4': '0.264', 'weapon2': '0.268', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '62.000'} [2024-08-06 06:46:26,220][52649] DAMAGECOUNT value on done: 764816.0 [2024-08-06 06:46:26,222][52649] Sum rewards: 72.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.522', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '61.000'} [2024-08-06 06:46:26,280][52794] DAMAGECOUNT value on done: 788502.0 [2024-08-06 06:46:26,281][52794] Sum rewards: 78.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.238', 'weapon4': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '65.000'} [2024-08-06 06:46:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 584826880. Throughput: 0: 4364.0. Samples: 146214390. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:27,794][52567] Avg episode reward: [(0, '74.484')] [2024-08-06 06:46:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071390_584826880.pth... [2024-08-06 06:46:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000070877_580624384.pth [2024-08-06 06:46:28,014][52667] DAMAGECOUNT value on done: 788451.0 [2024-08-06 06:46:28,015][52667] Sum rewards: 75.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.650', 'weapon4': '0.006', 'AMMO2': '0.035', 'WEAPON4': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.279', 'weapon2': '0.290', 'WEAPON3': '1.550', 'weapon3': '3.516', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '66.000'} [2024-08-06 06:46:28,112][52659] DAMAGECOUNT value on done: 786453.0 [2024-08-06 06:46:28,112][52659] Sum rewards: 67.968, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.110', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.172', 'weapon4': '0.252', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '55.000'} [2024-08-06 06:46:28,412][52650] Updated weights for policy 0, policy_version 71391 (0.0028) [2024-08-06 06:46:28,710][52664] DAMAGECOUNT value on done: 810825.0 [2024-08-06 06:46:28,714][52664] Sum rewards: 76.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.139', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '61.000'} [2024-08-06 06:46:29,247][52649] DAMAGECOUNT value on done: 767242.0 [2024-08-06 06:46:29,247][52649] Sum rewards: 87.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.797', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.068', 'AMMO3': '0.172', 'AMMO4': '0.198', 'weapon2': '0.272', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '70.000'} [2024-08-06 06:46:29,822][52794] DAMAGECOUNT value on done: 791928.0 [2024-08-06 06:46:29,822][52794] Sum rewards: 66.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.224', 'AMMO5': '0.023', 'AMMO2': '0.079', 'AMMO3': '0.205', 'weapon2': '0.232', 'AMMO4': '0.394', 'weapon5': '0.394', 'weapon4': '0.420', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.554', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '54.000'} [2024-08-06 06:46:30,726][52667] DAMAGECOUNT value on done: 794086.0 [2024-08-06 06:46:30,726][52667] Sum rewards: 67.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.724', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.168', 'AMMO3': '0.189', 'weapon2': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '54.000'} [2024-08-06 06:46:31,082][52659] DAMAGECOUNT value on done: 785865.0 [2024-08-06 06:46:31,083][52659] Sum rewards: 66.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.384', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.192', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '53.000'} [2024-08-06 06:46:31,954][52664] DAMAGECOUNT value on done: 817327.0 [2024-08-06 06:46:31,954][52664] Sum rewards: 78.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.085', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '65.000'} [2024-08-06 06:46:32,048][52649] DAMAGECOUNT value on done: 765320.0 [2024-08-06 06:46:32,049][52649] Sum rewards: 59.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.103', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.100', 'AMMO3': '0.185', 'weapon2': '0.510', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.174', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '49.000'} [2024-08-06 06:46:32,632][52794] DAMAGECOUNT value on done: 778771.0 [2024-08-06 06:46:32,633][52794] Sum rewards: 88.615, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.483', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'weapon3': '3.482', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '77.000'} [2024-08-06 06:46:32,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.1, 300 sec: 17439.2). Total num frames: 584908800. Throughput: 0: 4358.7. Samples: 146227420. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:32,795][52567] Avg episode reward: [(0, '74.377')] [2024-08-06 06:46:32,850][52650] Updated weights for policy 0, policy_version 71401 (0.0023) [2024-08-06 06:46:33,284][52667] DAMAGECOUNT value on done: 792525.0 [2024-08-06 06:46:33,284][52667] Sum rewards: 74.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.489', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.097', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '62.500'} [2024-08-06 06:46:34,058][52659] DAMAGECOUNT value on done: 794252.0 [2024-08-06 06:46:34,061][52659] Sum rewards: 76.750, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.348', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.214', 'AMMO4': '0.218', 'weapon2': '0.232', 'AMMO3': '0.242', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '65.000'} [2024-08-06 06:46:34,771][52664] DAMAGECOUNT value on done: 814551.0 [2024-08-06 06:46:34,772][52664] Sum rewards: 68.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.442', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.228', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '56.000'} [2024-08-06 06:46:35,169][52649] DAMAGECOUNT value on done: 760152.0 [2024-08-06 06:46:35,169][52649] Sum rewards: 81.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.108', 'AMMO4': '0.164', 'weapon2': '0.190', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '66.000'} [2024-08-06 06:46:35,577][52794] DAMAGECOUNT value on done: 776643.0 [2024-08-06 06:46:35,577][52794] Sum rewards: 68.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.975', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.087', 'weapon5': '0.148', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.154', 'DAMAGECOUNT': '16.032', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:36,053][52667] DAMAGECOUNT value on done: 791960.0 [2024-08-06 06:46:36,053][52667] Sum rewards: 74.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.070', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.154', 'weapon4': '0.210', 'AMMO4': '0.215', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.664', 'WEAPON3': '1.500', 'weapon3': '2.734', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '61.000'} [2024-08-06 06:46:36,699][52659] DAMAGECOUNT value on done: 781885.0 [2024-08-06 06:46:36,699][52659] Sum rewards: 75.480, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.184', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon4': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.508', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '61.000'} [2024-08-06 06:46:37,123][52664] DAMAGECOUNT value on done: 808121.0 [2024-08-06 06:46:37,124][52664] Sum rewards: 66.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.297', 'weapon2': '0.326', 'WEAPON3': '1.750', 'HITCOUNT': '3.300', 'weapon3': '3.322', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '58.000'} [2024-08-06 06:46:37,660][52650] Updated weights for policy 0, policy_version 71411 (0.0012) [2024-08-06 06:46:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 584998912. Throughput: 0: 4361.8. Samples: 146253770. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:37,794][52567] Avg episode reward: [(0, '74.096')] [2024-08-06 06:46:38,403][52649] DAMAGECOUNT value on done: 770705.0 [2024-08-06 06:46:38,407][52649] Sum rewards: 74.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.132', 'weapon5': '0.132', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:38,552][52666] Large shaping reward 2.543 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.492, 164.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:46:38,769][52794] DAMAGECOUNT value on done: 783894.0 [2024-08-06 06:46:38,770][52794] Sum rewards: 60.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.367', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.082', 'weapon5': '0.160', 'AMMO3': '0.229', 'AMMO4': '0.240', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.140', 'weapon3': '3.242', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '52.000'} [2024-08-06 06:46:38,940][52667] DAMAGECOUNT value on done: 789456.0 [2024-08-06 06:46:38,944][52667] Sum rewards: 68.518, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.261', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.194', 'weapon5': '0.240', 'AMMO3': '0.288', 'weapon2': '0.294', 'AMMO4': '0.347', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.968', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '59.000'} [2024-08-06 06:46:39,523][52664] DAMAGECOUNT value on done: 821065.0 [2024-08-06 06:46:39,524][52664] Sum rewards: 62.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.492', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.168', 'weapon2': '0.184', 'AMMO3': '0.229', 'AMMO4': '0.274', 'weapon5': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '52.000'} [2024-08-06 06:46:40,219][52659] DAMAGECOUNT value on done: 790946.0 [2024-08-06 06:46:40,219][52659] Sum rewards: 75.067, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.546', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.062', 'AMMO3': '0.219', 'weapon5': '0.266', 'weapon4': '0.300', 'AMMO4': '0.311', 'weapon2': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:41,578][52649] DAMAGECOUNT value on done: 776297.0 [2024-08-06 06:46:41,579][52649] Sum rewards: 77.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.175', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.221', 'weapon5': '0.236', 'AMMO4': '0.267', 'weapon4': '0.276', 'weapon2': '0.286', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '62.000'} [2024-08-06 06:46:41,799][52794] DAMAGECOUNT value on done: 788706.0 [2024-08-06 06:46:41,800][52794] Sum rewards: 72.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.502', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.212', 'weapon5': '0.218', 'AMMO3': '0.260', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.926', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '62.000'} [2024-08-06 06:46:42,061][52664] DAMAGECOUNT value on done: 813633.0 [2024-08-06 06:46:42,062][52664] Sum rewards: 69.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.042', 'weapon4': '0.050', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.242', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:42,143][52650] Updated weights for policy 0, policy_version 71421 (0.0012) [2024-08-06 06:46:42,183][52667] DAMAGECOUNT value on done: 795321.0 [2024-08-06 06:46:42,184][52667] Sum rewards: 64.919, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.610', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.134', 'weapon5': '0.210', 'weapon2': '0.280', 'AMMO3': '0.284', 'AMMO4': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.078', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '55.000'} [2024-08-06 06:46:42,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 585080832. Throughput: 0: 4364.4. Samples: 146280040. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:42,794][52567] Avg episode reward: [(0, '73.323')] [2024-08-06 06:46:42,936][52659] DAMAGECOUNT value on done: 782057.0 [2024-08-06 06:46:42,938][52659] Sum rewards: 72.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO4': '0.145', 'weapon5': '0.188', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:44,608][52664] DAMAGECOUNT value on done: 809765.0 [2024-08-06 06:46:44,609][52664] Sum rewards: 80.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.965', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.174', 'weapon5': '0.200', 'AMMO4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '66.000'} [2024-08-06 06:46:44,664][52649] DAMAGECOUNT value on done: 771359.0 [2024-08-06 06:46:44,665][52649] Sum rewards: 71.840, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon4': '0.144', 'weapon5': '0.184', 'weapon2': '0.234', 'AMMO3': '0.235', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.210', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:45,275][52794] DAMAGECOUNT value on done: 775710.0 [2024-08-06 06:46:45,277][52794] Sum rewards: 77.966, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.126', 'weapon2': '0.166', 'AMMO3': '0.190', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:46,307][52665] DAMAGECOUNT value on done: 772974.0 [2024-08-06 06:46:46,311][52665] Sum rewards: 71.097, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.940', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.012', 'AMMO4': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.242', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'weapon3': '3.478', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '61.000'} [2024-08-06 06:46:46,984][52650] Updated weights for policy 0, policy_version 71431 (0.0011) [2024-08-06 06:46:47,180][52664] DAMAGECOUNT value on done: 802649.0 [2024-08-06 06:46:47,181][52664] Sum rewards: 78.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.690', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.252', 'weapon4': '0.288', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.938', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:47,362][52647] DAMAGECOUNT value on done: 834297.0 [2024-08-06 06:46:47,363][52647] Sum rewards: 71.038, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.328', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.233', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 585170944. Throughput: 0: 4371.1. Samples: 146293300. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:47,795][52567] Avg episode reward: [(0, '73.282')] [2024-08-06 06:46:48,043][52649] DAMAGECOUNT value on done: 773123.0 [2024-08-06 06:46:48,044][52649] Sum rewards: 85.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO3': '0.162', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '69.000'} [2024-08-06 06:46:48,454][52794] DAMAGECOUNT value on done: 786972.0 [2024-08-06 06:46:48,454][52794] Sum rewards: 66.397, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.166', 'weapon2': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.230', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon4': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '58.000'} [2024-08-06 06:46:49,350][52665] DAMAGECOUNT value on done: 787406.0 [2024-08-06 06:46:49,352][52665] Sum rewards: 74.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.052', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.156', 'AMMO3': '0.174', 'AMMO4': '0.215', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.892', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '60.000'} [2024-08-06 06:46:50,153][52664] DAMAGECOUNT value on done: 817385.0 [2024-08-06 06:46:50,154][52664] Sum rewards: 62.923, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.214', 'AMMO3': '0.224', 'weapon4': '0.250', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '52.000'} [2024-08-06 06:46:50,356][52647] DAMAGECOUNT value on done: 824530.0 [2024-08-06 06:46:50,358][52647] Sum rewards: 72.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.709', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.199', 'AMMO4': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '57.000'} [2024-08-06 06:46:50,786][52649] DAMAGECOUNT value on done: 762071.0 [2024-08-06 06:46:50,787][52649] Sum rewards: 84.320, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.765', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.092', 'AMMO4': '0.247', 'weapon2': '0.254', 'weapon5': '0.270', 'AMMO3': '0.281', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.034', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '22.131', 'FRAGCOUNT': '69.000'} [2024-08-06 06:46:51,388][52794] DAMAGECOUNT value on done: 780234.0 [2024-08-06 06:46:51,388][52794] Sum rewards: 72.995, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.756', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.121', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'HITCOUNT': '3.200', 'weapon3': '3.256', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '64.000'} [2024-08-06 06:46:51,507][52650] Updated weights for policy 0, policy_version 71441 (0.0020) [2024-08-06 06:46:51,951][52665] DAMAGECOUNT value on done: 781769.0 [2024-08-06 06:46:51,952][52665] Sum rewards: 64.095, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.995', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.074', 'AMMO3': '0.151', 'weapon5': '0.196', 'AMMO4': '0.232', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.038', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '50.000'} [2024-08-06 06:46:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 585261056. Throughput: 0: 4372.0. Samples: 146319340. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 06:46:52,795][52567] Avg episode reward: [(0, '72.955')] [2024-08-06 06:46:52,996][52658] DAMAGECOUNT value on done: 785197.0 [2024-08-06 06:46:52,997][52658] Sum rewards: 71.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.128', 'AMMO4': '0.171', 'AMMO3': '0.197', 'weapon5': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.764', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 06:46:53,267][52664] DAMAGECOUNT value on done: 810935.0 [2024-08-06 06:46:53,268][52664] Sum rewards: 75.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.784', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.078', 'weapon5': '0.148', 'weapon2': '0.184', 'AMMO3': '0.231', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '64.000'} [2024-08-06 06:46:53,525][52647] DAMAGECOUNT value on done: 828571.0 [2024-08-06 06:46:53,525][52647] Sum rewards: 59.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.191', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.168', 'weapon5': '0.176', 'AMMO3': '0.246', 'AMMO4': '0.295', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.032', 'DAMAGECOUNT': '14.679', 'FRAGCOUNT': '52.000'} [2024-08-06 06:46:53,647][52649] DAMAGECOUNT value on done: 769682.0 [2024-08-06 06:46:53,648][52649] Sum rewards: 78.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.627', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.162', 'AMMO4': '0.182', 'weapon4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:54,360][52794] DAMAGECOUNT value on done: 775882.0 [2024-08-06 06:46:54,360][52794] Sum rewards: 70.795, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.230', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.178', 'AMMO3': '0.295', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.252', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:54,865][52665] DAMAGECOUNT value on done: 779951.0 [2024-08-06 06:46:54,866][52665] Sum rewards: 88.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.991', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO4': '0.199', 'AMMO3': '0.201', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '74.000'} [2024-08-06 06:46:56,091][52658] DAMAGECOUNT value on done: 788023.0 [2024-08-06 06:46:56,091][52658] Sum rewards: 63.145, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.076', 'AMMO5': '0.026', 'AMMO2': '0.065', 'weapon4': '0.222', 'weapon5': '0.236', 'AMMO3': '0.279', 'AMMO4': '0.326', 'weapon2': '0.336', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.850', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.000'} [2024-08-06 06:46:56,338][52650] Updated weights for policy 0, policy_version 71451 (0.0019) [2024-08-06 06:46:56,476][52649] DAMAGECOUNT value on done: 754282.0 [2024-08-06 06:46:56,478][52649] Sum rewards: 63.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.395', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.179', 'weapon5': '0.226', 'AMMO4': '0.278', 'weapon4': '0.372', 'weapon2': '0.592', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.502', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '52.500'} [2024-08-06 06:46:56,511][52664] DAMAGECOUNT value on done: 823726.0 [2024-08-06 06:46:56,511][52664] Sum rewards: 83.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.120', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'WEAPON3': '1.300', 'weapon3': '3.446', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '67.000'} [2024-08-06 06:46:56,642][52647] DAMAGECOUNT value on done: 828955.0 [2024-08-06 06:46:56,644][52794] DAMAGECOUNT value on done: 786690.0 [2024-08-06 06:46:56,645][52794] Sum rewards: 59.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.605', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.148', 'weapon5': '0.170', 'weapon2': '0.226', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'HITCOUNT': '3.010', 'weapon3': '3.274', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '53.000'} [2024-08-06 06:46:56,644][52647] Sum rewards: 82.890, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '67.000'} [2024-08-06 06:46:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 585351168. Throughput: 0: 4362.2. Samples: 146345260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:46:57,794][52567] Avg episode reward: [(0, '73.569')] [2024-08-06 06:46:57,823][52665] DAMAGECOUNT value on done: 765434.0 [2024-08-06 06:46:57,823][52665] Sum rewards: 85.687, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.728', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.194', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.558', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '70.000'} [2024-08-06 06:46:58,695][52658] DAMAGECOUNT value on done: 791111.0 [2024-08-06 06:46:58,696][52658] Sum rewards: 65.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.088', 'AMMO4': '0.143', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.210', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '54.000'} [2024-08-06 06:46:59,419][52794] DAMAGECOUNT value on done: 783054.0 [2024-08-06 06:46:59,422][52794] Sum rewards: 77.736, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.679', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.104', 'weapon5': '0.216', 'AMMO4': '0.222', 'weapon2': '0.224', 'AMMO3': '0.239', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '66.000'} [2024-08-06 06:46:59,516][52664] DAMAGECOUNT value on done: 818846.0 [2024-08-06 06:46:59,517][52664] Sum rewards: 88.340, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.100', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.254', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '72.000'} [2024-08-06 06:46:59,661][52649] DAMAGECOUNT value on done: 772793.0 [2024-08-06 06:46:59,661][52649] Sum rewards: 76.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.736', 'AMMO5': '0.009', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.165', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '63.000'} [2024-08-06 06:46:59,716][52647] DAMAGECOUNT value on done: 835555.0 [2024-08-06 06:46:59,716][52647] Sum rewards: 79.289, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.360', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.088', 'AMMO4': '0.180', 'weapon5': '0.208', 'AMMO3': '0.278', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:00,052][52663] DAMAGECOUNT value on done: 799812.0 [2024-08-06 06:47:00,053][52663] Sum rewards: 84.267, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.106', 'HEALTH': '0.174', 'AMMO3': '0.180', 'AMMO4': '0.203', 'weapon5': '0.214', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:01,043][52665] DAMAGECOUNT value on done: 771038.0 [2024-08-06 06:47:01,044][52665] Sum rewards: 80.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.284', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '67.000'} [2024-08-06 06:47:01,114][52650] Updated weights for policy 0, policy_version 71461 (0.0022) [2024-08-06 06:47:01,571][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:47:01,626][52658] DAMAGECOUNT value on done: 787554.0 [2024-08-06 06:47:01,626][52658] Sum rewards: 64.803, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon4': '0.254', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '55.000'} [2024-08-06 06:47:01,966][52794] DAMAGECOUNT value on done: 798563.0 [2024-08-06 06:47:01,968][52794] Sum rewards: 72.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.138', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.163', 'weapon4': '0.198', 'weapon5': '0.226', 'AMMO4': '0.227', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '57.000'} [2024-08-06 06:47:02,483][52664] DAMAGECOUNT value on done: 818710.0 [2024-08-06 06:47:02,483][52664] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.551', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.096', 'AMMO3': '0.151', 'AMMO4': '0.178', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '0.950', 'weapon3': '2.938', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:02,541][52647] DAMAGECOUNT value on done: 831898.0 [2024-08-06 06:47:02,542][52647] Sum rewards: 62.375, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.920', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.186', 'weapon4': '0.220', 'AMMO4': '0.270', 'AMMO3': '0.294', 'weapon2': '0.298', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.986', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '55.000'} [2024-08-06 06:47:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 585433088. Throughput: 0: 4362.9. Samples: 146358340. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:02,794][52567] Avg episode reward: [(0, '73.791')] [2024-08-06 06:47:02,999][52649] DAMAGECOUNT value on done: 773251.0 [2024-08-06 06:47:03,000][52649] Sum rewards: 75.963, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.302', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.049', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 06:47:03,077][52663] DAMAGECOUNT value on done: 786654.0 [2024-08-06 06:47:03,079][52663] Sum rewards: 90.732, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.161', 'HEALTH': '0.289', 'weapon2': '0.340', 'WEAPON3': '0.950', 'weapon3': '3.254', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '71.000'} [2024-08-06 06:47:04,241][52665] DAMAGECOUNT value on done: 775651.0 [2024-08-06 06:47:04,241][52665] Sum rewards: 73.459, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.125', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.138', 'AMMO4': '0.162', 'weapon5': '0.186', 'weapon4': '0.206', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.178', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '57.000'} [2024-08-06 06:47:04,456][52794] DAMAGECOUNT value on done: 777107.0 [2024-08-06 06:47:04,457][52794] Sum rewards: 65.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.440', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '57.000'} [2024-08-06 06:47:04,522][52658] DAMAGECOUNT value on done: 780689.0 [2024-08-06 06:47:04,523][52658] Sum rewards: 78.742, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.063', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:05,484][52664] DAMAGECOUNT value on done: 826628.0 [2024-08-06 06:47:05,485][52664] Sum rewards: 80.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.734', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.072', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:05,499][52647] DAMAGECOUNT value on done: 835952.0 [2024-08-06 06:47:05,499][52647] Sum rewards: 73.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.022', 'AMMO2': '0.032', 'weapon4': '0.116', 'AMMO4': '0.159', 'AMMO3': '0.176', 'weapon5': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:05,916][52650] Updated weights for policy 0, policy_version 71471 (0.0017) [2024-08-06 06:47:06,143][52649] DAMAGECOUNT value on done: 763190.0 [2024-08-06 06:47:06,146][52649] Sum rewards: 78.795, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.414', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'weapon2': '0.780', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:06,199][52663] DAMAGECOUNT value on done: 780827.0 [2024-08-06 06:47:06,207][52663] Sum rewards: 75.202, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.408', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.024', 'AMMO4': '0.062', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.426', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '64.000'} [2024-08-06 06:47:06,467][52669] DAMAGECOUNT value on done: 788347.0 [2024-08-06 06:47:06,467][52669] Sum rewards: 78.713, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.476', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.726', 'WEAPON3': '1.100', 'weapon3': '2.784', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:07,171][52794] DAMAGECOUNT value on done: 792737.0 [2024-08-06 06:47:07,172][52794] Sum rewards: 77.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO4': '0.094', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.364', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '64.000'} [2024-08-06 06:47:07,334][52665] DAMAGECOUNT value on done: 775075.0 [2024-08-06 06:47:07,336][52665] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.138', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.249', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.342', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:07,401][52658] DAMAGECOUNT value on done: 776988.0 [2024-08-06 06:47:07,402][52658] Sum rewards: 61.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.058', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.210', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.550', 'HITCOUNT': '2.910', 'weapon3': '2.922', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '53.000'} [2024-08-06 06:47:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 585523200. Throughput: 0: 4356.4. Samples: 146384270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:07,795][52567] Avg episode reward: [(0, '73.823')] [2024-08-06 06:47:08,104][52647] DAMAGECOUNT value on done: 813396.0 [2024-08-06 06:47:08,104][52647] Sum rewards: 68.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.205', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.036', 'AMMO4': '0.124', 'weapon5': '0.136', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '0.900', 'HITCOUNT': '3.020', 'weapon3': '3.258', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '54.000'} [2024-08-06 06:47:08,144][52664] DAMAGECOUNT value on done: 827827.0 [2024-08-06 06:47:08,146][52664] Sum rewards: 82.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.028', 'weapon5': '0.038', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '68.000'} [2024-08-06 06:47:09,136][52671] DAMAGECOUNT value on done: 790102.0 [2024-08-06 06:47:09,136][52671] Sum rewards: 65.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.974', 'AMMO5': '0.025', 'AMMO2': '0.070', 'weapon4': '0.148', 'AMMO3': '0.260', 'weapon5': '0.278', 'weapon2': '0.290', 'AMMO4': '0.350', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.990', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '57.500'} [2024-08-06 06:47:09,305][52663] DAMAGECOUNT value on done: 784326.0 [2024-08-06 06:47:09,307][52663] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.388', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.054', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.410', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:09,541][52669] DAMAGECOUNT value on done: 778712.0 [2024-08-06 06:47:09,543][52669] Sum rewards: 81.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.424', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:09,978][52794] DAMAGECOUNT value on done: 788436.0 [2024-08-06 06:47:09,980][52794] Sum rewards: 73.206, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.340', 'HEALTH': '0.410', 'WEAPON3': '0.900', 'HITCOUNT': '3.170', 'weapon3': '3.400', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '56.000'} [2024-08-06 06:47:10,209][52650] Updated weights for policy 0, policy_version 71481 (0.0019) [2024-08-06 06:47:10,362][52658] DAMAGECOUNT value on done: 791064.0 [2024-08-06 06:47:10,362][52658] Sum rewards: 73.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon2': '0.178', 'AMMO3': '0.187', 'weapon5': '0.226', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:10,496][52665] DAMAGECOUNT value on done: 783082.0 [2024-08-06 06:47:10,498][52665] Sum rewards: 71.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.455', 'weapon5': '0.002', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'WEAPON4': '0.100', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.634', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:10,710][52647] DAMAGECOUNT value on done: 830510.0 [2024-08-06 06:47:10,710][52647] Sum rewards: 85.092, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.122', 'weapon4': '0.166', 'AMMO4': '0.166', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '70.000'} [2024-08-06 06:47:10,728][52664] DAMAGECOUNT value on done: 820246.0 [2024-08-06 06:47:10,728][52664] Sum rewards: 62.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.492', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.076', 'AMMO3': '0.211', 'weapon5': '0.212', 'AMMO4': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.814', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '51.000'} [2024-08-06 06:47:11,586][52671] DAMAGECOUNT value on done: 793988.0 [2024-08-06 06:47:11,586][52671] Sum rewards: 80.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.117', 'weapon5': '0.118', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.412', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:11,847][52614] Signal inference workers to stop experience collection... (13050 times) [2024-08-06 06:47:11,848][52614] Signal inference workers to resume experience collection... (13050 times) [2024-08-06 06:47:11,939][52650] InferenceWorker_p0-w0: stopping experience collection (13050 times) [2024-08-06 06:47:11,940][52650] InferenceWorker_p0-w0: resuming experience collection (13050 times) [2024-08-06 06:47:12,185][52663] DAMAGECOUNT value on done: 785963.0 [2024-08-06 06:47:12,185][52663] Sum rewards: 78.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.082', 'AMMO4': '0.121', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:12,422][52669] DAMAGECOUNT value on done: 792582.0 [2024-08-06 06:47:12,424][52669] Sum rewards: 62.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.390', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.176', 'AMMO4': '0.194', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.700', 'weapon3': '2.992', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '54.000'} [2024-08-06 06:47:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 585613312. Throughput: 0: 4360.7. Samples: 146410620. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:12,794][52567] Avg episode reward: [(0, '73.544')] [2024-08-06 06:47:13,049][52794] DAMAGECOUNT value on done: 789741.0 [2024-08-06 06:47:13,051][52794] Sum rewards: 74.421, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.120', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.128', 'AMMO3': '0.170', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.284', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:13,302][52658] DAMAGECOUNT value on done: 778938.0 [2024-08-06 06:47:13,303][52658] Sum rewards: 83.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.290', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.158', 'AMMO4': '0.164', 'AMMO3': '0.238', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '71.000'} [2024-08-06 06:47:13,353][52647] DAMAGECOUNT value on done: 825950.0 [2024-08-06 06:47:13,354][52647] Sum rewards: 70.825, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.076', 'weapon5': '0.092', 'AMMO4': '0.093', 'weapon2': '0.188', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.450', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:13,421][52664] DAMAGECOUNT value on done: 810703.0 [2024-08-06 06:47:13,422][52664] Sum rewards: 75.010, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.200', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.141', 'weapon2': '0.158', 'AMMO4': '0.216', 'weapon5': '0.232', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.732', 'WEAPON3': '0.850', 'weapon3': '2.536', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:13,580][52665] DAMAGECOUNT value on done: 773884.0 [2024-08-06 06:47:13,581][52665] Sum rewards: 60.083, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.157', 'weapon5': '0.182', 'AMMO4': '0.196', 'weapon4': '0.238', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '2.740', 'weapon3': '3.018', 'DAMAGECOUNT': '13.053', 'FRAGCOUNT': '48.000'} [2024-08-06 06:47:14,704][52671] DAMAGECOUNT value on done: 789176.0 [2024-08-06 06:47:14,704][52671] Sum rewards: 77.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.962', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '64.000'} [2024-08-06 06:47:15,010][52650] Updated weights for policy 0, policy_version 71491 (0.0014) [2024-08-06 06:47:15,318][52663] DAMAGECOUNT value on done: 793324.0 [2024-08-06 06:47:15,318][52663] Sum rewards: 68.371, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.627', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.108', 'AMMO3': '0.151', 'AMMO4': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.366', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '2.694', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '54.000'} [2024-08-06 06:47:15,471][52669] DAMAGECOUNT value on done: 786259.0 [2024-08-06 06:47:15,473][52669] Sum rewards: 91.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.759', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO3': '0.140', 'AMMO4': '0.164', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '0.900', 'weapon3': '3.028', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '73.000'} [2024-08-06 06:47:15,735][52647] DAMAGECOUNT value on done: 825693.0 [2024-08-06 06:47:15,736][52647] Sum rewards: 70.856, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.908', 'weapon5': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.536', 'WEAPON3': '1.700', 'weapon3': '3.082', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:15,763][52658] DAMAGECOUNT value on done: 804321.0 [2024-08-06 06:47:15,763][52658] Sum rewards: 76.535, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon2': '0.612', 'WEAPON3': '1.000', 'weapon3': '3.174', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:15,840][52664] DAMAGECOUNT value on done: 813719.0 [2024-08-06 06:47:15,840][52664] Sum rewards: 70.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.052', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon2': '0.208', 'AMMO3': '0.220', 'AMMO4': '0.233', 'weapon5': '0.294', 'weapon4': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.680', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '56.000'} [2024-08-06 06:47:16,380][52794] DAMAGECOUNT value on done: 798401.0 [2024-08-06 06:47:16,380][52794] Sum rewards: 70.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:16,627][52665] DAMAGECOUNT value on done: 784354.0 [2024-08-06 06:47:16,627][52665] Sum rewards: 77.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.084', 'weapon5': '0.214', 'AMMO3': '0.234', 'weapon2': '0.250', 'AMMO4': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:17,632][52671] DAMAGECOUNT value on done: 793271.0 [2024-08-06 06:47:17,633][52671] Sum rewards: 83.258, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.943', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.090', 'AMMO3': '0.138', 'weapon4': '0.150', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.814', 'WEAPON3': '0.900', 'weapon3': '2.760', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:17,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 585695232. Throughput: 0: 4360.5. Samples: 146423640. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:17,794][52567] Avg episode reward: [(0, '73.703')] [2024-08-06 06:47:17,796][52663] DAMAGECOUNT value on done: 781968.0 [2024-08-06 06:47:17,799][52663] Sum rewards: 78.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.048', 'weapon5': '0.146', 'AMMO4': '0.201', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:18,048][52669] DAMAGECOUNT value on done: 790324.0 [2024-08-06 06:47:18,049][52669] Sum rewards: 79.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:18,464][52647] DAMAGECOUNT value on done: 817270.0 [2024-08-06 06:47:18,466][52647] Sum rewards: 80.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.140', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.076', 'weapon4': '0.106', 'AMMO4': '0.156', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:18,620][52664] DAMAGECOUNT value on done: 816324.0 [2024-08-06 06:47:18,622][52664] Sum rewards: 78.348, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.014', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon4': '0.164', 'weapon5': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.312', 'weapon2': '0.356', 'WEAPON3': '1.800', 'weapon3': '2.966', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:19,037][52658] DAMAGECOUNT value on done: 789403.0 [2024-08-06 06:47:19,038][52658] Sum rewards: 61.795, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.136', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.048', 'AMMO4': '0.168', 'weapon5': '0.168', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.370', 'DAMAGECOUNT': '14.334', 'FRAGCOUNT': '51.000'} [2024-08-06 06:47:19,268][52794] DAMAGECOUNT value on done: 789068.0 [2024-08-06 06:47:19,269][52794] Sum rewards: 79.190, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.366', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.046', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.186', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '67.000'} [2024-08-06 06:47:19,784][52665] DAMAGECOUNT value on done: 782292.0 [2024-08-06 06:47:19,786][52665] Sum rewards: 70.291, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.191', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.088', 'AMMO4': '0.164', 'weapon5': '0.186', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '57.000'} [2024-08-06 06:47:19,950][52650] Updated weights for policy 0, policy_version 71501 (0.0017) [2024-08-06 06:47:20,244][52671] DAMAGECOUNT value on done: 800330.0 [2024-08-06 06:47:20,246][52671] Sum rewards: 81.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.082', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.173', 'weapon5': '0.214', 'AMMO4': '0.255', 'weapon4': '0.260', 'weapon2': '0.364', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.926', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:20,558][52663] DAMAGECOUNT value on done: 774219.0 [2024-08-06 06:47:20,558][52663] Sum rewards: 78.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.250', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.182', 'weapon2': '0.210', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '63.000'} [2024-08-06 06:47:20,669][52669] DAMAGECOUNT value on done: 788944.0 [2024-08-06 06:47:20,672][52669] Sum rewards: 78.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.062', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.156', 'AMMO4': '0.199', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:21,583][52647] DAMAGECOUNT value on done: 833451.0 [2024-08-06 06:47:21,587][52647] Sum rewards: 73.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.876', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO4': '0.120', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:21,790][52664] DAMAGECOUNT value on done: 813110.0 [2024-08-06 06:47:21,795][52658] DAMAGECOUNT value on done: 797462.0 [2024-08-06 06:47:21,799][52664] Sum rewards: 74.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.105', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.088', 'weapon5': '0.122', 'AMMO4': '0.139', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:21,799][52658] Sum rewards: 83.714, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.865', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.070', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.456', 'WEAPON3': '0.950', 'weapon3': '3.292', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:22,192][52665] DAMAGECOUNT value on done: 777170.0 [2024-08-06 06:47:22,192][52665] Sum rewards: 67.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO4': '0.197', 'AMMO3': '0.248', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.280', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:22,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 585777152. Throughput: 0: 4355.5. Samples: 146449770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:22,796][52567] Avg episode reward: [(0, '74.164')] [2024-08-06 06:47:23,293][52671] DAMAGECOUNT value on done: 791686.0 [2024-08-06 06:47:23,293][52671] Sum rewards: 86.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.174', 'AMMO4': '0.191', 'AMMO3': '0.234', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '71.000'} [2024-08-06 06:47:23,895][52663] DAMAGECOUNT value on done: 778578.0 [2024-08-06 06:47:23,899][52663] Sum rewards: 83.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.340', 'AMMO5': '0.017', 'AMMO2': '0.074', 'weapon4': '0.184', 'weapon2': '0.256', 'AMMO3': '0.267', 'weapon5': '0.278', 'AMMO4': '0.370', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.952', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '21.093', 'FRAGCOUNT': '70.000'} [2024-08-06 06:47:23,993][52669] DAMAGECOUNT value on done: 789508.0 [2024-08-06 06:47:23,995][52669] Sum rewards: 76.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.772', 'AMMO5': '0.006', 'weapon4': '0.036', 'AMMO2': '0.037', 'weapon5': '0.082', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '63.000'} [2024-08-06 06:47:24,235][52658] DAMAGECOUNT value on done: 786568.0 [2024-08-06 06:47:24,237][52658] Sum rewards: 73.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.915', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.124', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.542', 'WEAPON3': '1.600', 'weapon3': '3.056', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.000'} [2024-08-06 06:47:24,349][52647] DAMAGECOUNT value on done: 820591.0 [2024-08-06 06:47:24,350][52647] Sum rewards: 83.603, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.014', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON3': '1.300', 'weapon3': '3.548', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.868', 'FRAGCOUNT': '67.000'} [2024-08-06 06:47:24,484][52650] Updated weights for policy 0, policy_version 71511 (0.0035) [2024-08-06 06:47:25,091][52665] DAMAGECOUNT value on done: 778710.0 [2024-08-06 06:47:25,093][52665] Sum rewards: 78.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.146', 'weapon5': '0.170', 'AMMO3': '0.171', 'AMMO4': '0.190', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:25,589][52671] DAMAGECOUNT value on done: 794026.0 [2024-08-06 06:47:25,589][52671] Sum rewards: 52.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.200', 'AMMO5': '0.022', 'AMMO2': '0.030', 'weapon5': '0.096', 'weapon4': '0.108', 'AMMO4': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '13.839', 'FRAGCOUNT': '46.000'} [2024-08-06 06:47:26,993][52663] DAMAGECOUNT value on done: 781995.0 [2024-08-06 06:47:26,996][52663] Sum rewards: 78.512, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.575', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.266', 'weapon2': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.366', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '68.000'} [2024-08-06 06:47:27,177][52669] DAMAGECOUNT value on done: 789641.0 [2024-08-06 06:47:27,177][52669] Sum rewards: 71.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.106', 'weapon4': '0.128', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.050', 'weapon3': '3.350', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '57.000'} [2024-08-06 06:47:27,391][52647] DAMAGECOUNT value on done: 829400.0 [2024-08-06 06:47:27,391][52647] Sum rewards: 69.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:27,409][52658] DAMAGECOUNT value on done: 791866.0 [2024-08-06 06:47:27,411][52658] Sum rewards: 87.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.182', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.154', 'AMMO4': '0.157', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.050', 'weapon3': '3.254', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.465', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 585867264. Throughput: 0: 4352.2. Samples: 146475890. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:27,794][52567] Avg episode reward: [(0, '74.818')] [2024-08-06 06:47:28,038][52670] DAMAGECOUNT value on done: 776319.0 [2024-08-06 06:47:28,038][52670] Sum rewards: 81.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.882', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.173', 'weapon5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:28,169][52665] DAMAGECOUNT value on done: 774398.0 [2024-08-06 06:47:28,171][52665] Sum rewards: 76.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.188', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.051', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.260', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.396', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:28,926][52671] DAMAGECOUNT value on done: 792212.0 [2024-08-06 06:47:28,927][52671] Sum rewards: 81.643, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.233', 'WEAPON3': '1.500', 'weapon3': '3.504', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '67.000'} [2024-08-06 06:47:29,191][52650] Updated weights for policy 0, policy_version 71521 (0.0019) [2024-08-06 06:47:29,864][52647] DAMAGECOUNT value on done: 830641.0 [2024-08-06 06:47:29,865][52647] Sum rewards: 60.627, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.010', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.306', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '50.000'} [2024-08-06 06:47:30,088][52658] DAMAGECOUNT value on done: 782930.0 [2024-08-06 06:47:30,088][52658] Sum rewards: 77.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.058', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.400', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:30,090][52663] DAMAGECOUNT value on done: 792601.0 [2024-08-06 06:47:30,090][52663] Sum rewards: 74.190, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.078', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.126', 'weapon4': '0.172', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:30,146][52669] DAMAGECOUNT value on done: 799489.0 [2024-08-06 06:47:30,147][52669] Sum rewards: 79.499, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.028', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:31,352][52670] DAMAGECOUNT value on done: 788261.0 [2024-08-06 06:47:31,352][52670] Sum rewards: 72.877, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.916', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.212', 'weapon4': '0.226', 'weapon2': '0.260', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.002', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '61.000'} [2024-08-06 06:47:31,401][52665] DAMAGECOUNT value on done: 778217.0 [2024-08-06 06:47:31,401][52665] Sum rewards: 80.240, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '68.000'} [2024-08-06 06:47:31,718][52666] DAMAGECOUNT value on done: 785898.0 [2024-08-06 06:47:31,722][52666] Sum rewards: 71.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.727', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.106', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:31,885][52671] DAMAGECOUNT value on done: 780856.0 [2024-08-06 06:47:31,886][52671] Sum rewards: 76.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.968', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.386', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 06:47:32,260][52647] DAMAGECOUNT value on done: 817713.0 [2024-08-06 06:47:32,269][52647] Sum rewards: 78.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.196', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '63.000'} [2024-08-06 06:47:32,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 585957376. Throughput: 0: 4339.6. Samples: 146488580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:32,795][52567] Avg episode reward: [(0, '75.113')] [2024-08-06 06:47:32,893][52663] DAMAGECOUNT value on done: 776676.0 [2024-08-06 06:47:32,893][52663] Sum rewards: 75.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.091', 'weapon4': '0.164', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.812', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:32,984][52669] DAMAGECOUNT value on done: 791441.0 [2024-08-06 06:47:32,985][52669] Sum rewards: 82.181, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.288', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.130', 'weapon5': '0.136', 'AMMO3': '0.146', 'AMMO4': '0.151', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '0.950', 'weapon3': '2.994', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '64.000'} [2024-08-06 06:47:33,150][52658] DAMAGECOUNT value on done: 792057.0 [2024-08-06 06:47:33,151][52658] Sum rewards: 76.951, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '3.138', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:34,369][52650] Updated weights for policy 0, policy_version 71531 (0.0026) [2024-08-06 06:47:34,537][52665] DAMAGECOUNT value on done: 779348.0 [2024-08-06 06:47:34,538][52665] Sum rewards: 84.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon4': '0.068', 'weapon5': '0.084', 'AMMO4': '0.139', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.580', 'FRAGCOUNT': '70.000'} [2024-08-06 06:47:34,563][52647] DAMAGECOUNT value on done: 822163.0 [2024-08-06 06:47:34,563][52647] Sum rewards: 78.915, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.094', 'AMMO3': '0.146', 'weapon4': '0.242', 'weapon2': '0.448', 'WEAPON3': '0.950', 'weapon3': '3.100', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:34,634][52670] DAMAGECOUNT value on done: 775020.0 [2024-08-06 06:47:34,636][52670] Sum rewards: 68.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.488', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.150', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '3.052', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '56.000'} [2024-08-06 06:47:34,662][52671] DAMAGECOUNT value on done: 790888.0 [2024-08-06 06:47:34,662][52671] Sum rewards: 86.178, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.872', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.172', 'AMMO4': '0.197', 'weapon4': '0.204', 'weapon5': '0.212', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '68.000'} [2024-08-06 06:47:35,024][52666] DAMAGECOUNT value on done: 781693.0 [2024-08-06 06:47:35,024][52666] Sum rewards: 81.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.256', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.061', 'AMMO3': '0.215', 'weapon2': '0.606', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '67.000'} [2024-08-06 06:47:36,084][52663] DAMAGECOUNT value on done: 771172.0 [2024-08-06 06:47:36,084][52663] Sum rewards: 74.705, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.404', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.128', 'AMMO3': '0.136', 'weapon4': '0.192', 'AMMO4': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '0.850', 'weapon3': '2.960', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:36,128][52669] DAMAGECOUNT value on done: 793202.0 [2024-08-06 06:47:36,129][52669] Sum rewards: 74.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.480', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.134', 'AMMO3': '0.189', 'weapon4': '0.190', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '60.500'} [2024-08-06 06:47:36,168][52658] DAMAGECOUNT value on done: 773321.0 [2024-08-06 06:47:36,168][52658] Sum rewards: 67.617, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.708', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.102', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.794', 'WEAPON3': '0.950', 'weapon3': '2.886', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 06:47:37,314][52665] DAMAGECOUNT value on done: 771025.0 [2024-08-06 06:47:37,315][52665] Sum rewards: 79.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.135', 'weapon5': '0.146', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:37,558][52647] DAMAGECOUNT value on done: 812549.0 [2024-08-06 06:47:37,558][52647] Sum rewards: 78.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.646', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.172', 'AMMO3': '0.186', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.468', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.354', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '64.000'} [2024-08-06 06:47:37,567][52671] DAMAGECOUNT value on done: 790367.0 [2024-08-06 06:47:37,567][52671] Sum rewards: 54.551, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.331', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.008', 'AMMO3': '0.187', 'weapon2': '0.492', 'WEAPON3': '1.100', 'HITCOUNT': '2.730', 'weapon3': '3.420', 'DAMAGECOUNT': '13.440', 'FRAGCOUNT': '45.000'} [2024-08-06 06:47:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 586047488. Throughput: 0: 4343.6. Samples: 146514800. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 06:47:37,795][52567] Avg episode reward: [(0, '75.478')] [2024-08-06 06:47:37,899][52670] DAMAGECOUNT value on done: 775217.0 [2024-08-06 06:47:37,900][52670] Sum rewards: 83.646, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.034', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.096', 'AMMO4': '0.114', 'weapon5': '0.116', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '70.000'} [2024-08-06 06:47:38,374][52666] DAMAGECOUNT value on done: 784332.0 [2024-08-06 06:47:38,374][52666] Sum rewards: 65.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.114', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'weapon4': '0.636', 'WEAPON3': '1.350', 'weapon3': '2.676', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '55.000'} [2024-08-06 06:47:38,548][52669] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:47:38,741][52650] Updated weights for policy 0, policy_version 71541 (0.0012) [2024-08-06 06:47:38,950][52663] DAMAGECOUNT value on done: 780356.0 [2024-08-06 06:47:38,951][52663] Sum rewards: 79.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon4': '0.086', 'weapon5': '0.122', 'AMMO3': '0.179', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:38,984][52669] DAMAGECOUNT value on done: 798766.0 [2024-08-06 06:47:38,985][52669] Sum rewards: 73.958, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.207', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '61.000'} [2024-08-06 06:47:39,435][52658] DAMAGECOUNT value on done: 792632.0 [2024-08-06 06:47:39,435][52658] Sum rewards: 68.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.020', 'AMMO2': '0.056', 'AMMO3': '0.249', 'AMMO4': '0.279', 'weapon4': '0.350', 'weapon5': '0.374', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.440', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '57.000'} [2024-08-06 06:47:39,741][52665] DAMAGECOUNT value on done: 774489.0 [2024-08-06 06:47:39,744][52665] Sum rewards: 70.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.575', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.120', 'AMMO4': '0.143', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:40,366][52671] DAMAGECOUNT value on done: 787743.0 [2024-08-06 06:47:40,367][52671] Sum rewards: 71.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:40,469][52670] DAMAGECOUNT value on done: 787409.0 [2024-08-06 06:47:40,472][52670] Sum rewards: 80.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.397', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:40,674][52647] DAMAGECOUNT value on done: 819254.0 [2024-08-06 06:47:40,676][52647] Sum rewards: 85.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.102', 'weapon4': '0.188', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:40,914][52666] DAMAGECOUNT value on done: 784107.0 [2024-08-06 06:47:40,915][52666] Sum rewards: 71.951, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.076', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon2': '0.186', 'AMMO4': '0.208', 'weapon5': '0.228', 'AMMO3': '0.279', 'weapon4': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.880', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '61.000'} [2024-08-06 06:47:41,803][52663] DAMAGECOUNT value on done: 779115.0 [2024-08-06 06:47:41,804][52663] Sum rewards: 73.549, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.460', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.148', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.322', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:41,808][52669] DAMAGECOUNT value on done: 782103.0 [2024-08-06 06:47:41,810][52669] Sum rewards: 70.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.275', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.166', 'weapon4': '0.250', 'weapon2': '0.544', 'WEAPON3': '0.950', 'weapon3': '3.016', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '56.000'} [2024-08-06 06:47:42,157][52658] DAMAGECOUNT value on done: 782447.0 [2024-08-06 06:47:42,158][52658] Sum rewards: 86.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.118', 'AMMO4': '0.167', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON3': '1.350', 'weapon3': '3.364', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '71.000'} [2024-08-06 06:47:42,567][52665] DAMAGECOUNT value on done: 780097.0 [2024-08-06 06:47:42,569][52665] Sum rewards: 72.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.022', 'AMMO2': '0.053', 'AMMO3': '0.162', 'AMMO4': '0.266', 'weapon5': '0.300', 'weapon2': '0.344', 'weapon4': '0.368', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.672', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '58.500'} [2024-08-06 06:47:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 586129408. Throughput: 0: 4351.1. Samples: 146541060. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:47:42,794][52567] Avg episode reward: [(0, '75.354')] [2024-08-06 06:47:43,059][52671] DAMAGECOUNT value on done: 797813.0 [2024-08-06 06:47:43,059][52671] Sum rewards: 68.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.497', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.142', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '56.000'} [2024-08-06 06:47:43,542][52650] Updated weights for policy 0, policy_version 71551 (0.0026) [2024-08-06 06:47:43,703][52670] DAMAGECOUNT value on done: 779329.0 [2024-08-06 06:47:43,703][52670] Sum rewards: 65.118, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.180', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon7': '0.394', 'weapon4': '0.558', 'WEAPON3': '0.850', 'weapon3': '2.358', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '52.000'} [2024-08-06 06:47:44,139][52666] DAMAGECOUNT value on done: 777888.0 [2024-08-06 06:47:44,141][52666] Sum rewards: 77.202, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon4': '0.288', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:44,875][52669] DAMAGECOUNT value on done: 783248.0 [2024-08-06 06:47:44,875][52669] Sum rewards: 73.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.148', 'weapon5': '0.212', 'weapon2': '0.248', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '63.000'} [2024-08-06 06:47:44,906][52663] DAMAGECOUNT value on done: 791984.0 [2024-08-06 06:47:44,908][52663] Sum rewards: 68.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.188', 'weapon4': '0.232', 'AMMO3': '0.234', 'AMMO4': '0.238', 'weapon2': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.056', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:45,031][52658] DAMAGECOUNT value on done: 781180.0 [2024-08-06 06:47:45,032][52658] Sum rewards: 65.353, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.502', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.142', 'weapon2': '0.148', 'AMMO3': '0.160', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.334', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.212', 'DAMAGECOUNT': '15.060', 'FRAGCOUNT': '52.000'} [2024-08-06 06:47:45,723][52671] DAMAGECOUNT value on done: 791236.0 [2024-08-06 06:47:45,724][52671] Sum rewards: 80.779, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.710', 'AMMO5': '0.009', 'weapon5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon2': '0.184', 'WEAPON5': '0.200', 'weapon4': '0.230', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.364', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.171', 'FRAGCOUNT': '70.000'} [2024-08-06 06:47:46,890][52670] DAMAGECOUNT value on done: 772903.0 [2024-08-06 06:47:46,891][52670] Sum rewards: 72.687, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.354', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.320', 'WEAPON3': '1.600', 'weapon3': '3.254', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:47,187][52666] DAMAGECOUNT value on done: 782484.0 [2024-08-06 06:47:47,188][52666] Sum rewards: 76.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.082', 'weapon4': '0.098', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '63.000'} [2024-08-06 06:47:47,418][52668] DAMAGECOUNT value on done: 790318.0 [2024-08-06 06:47:47,419][52668] Sum rewards: 76.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.223', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.164', 'weapon5': '0.174', 'AMMO4': '0.188', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 586219520. Throughput: 0: 4348.9. Samples: 146554040. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:47:47,794][52567] Avg episode reward: [(0, '75.141')] [2024-08-06 06:47:47,940][52669] DAMAGECOUNT value on done: 789780.0 [2024-08-06 06:47:47,940][52669] Sum rewards: 82.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.076', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon2': '0.166', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.440', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '70.000'} [2024-08-06 06:47:47,950][52650] Updated weights for policy 0, policy_version 71561 (0.0014) [2024-08-06 06:47:47,972][52663] DAMAGECOUNT value on done: 782882.0 [2024-08-06 06:47:47,972][52663] Sum rewards: 67.945, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.409', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.108', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:48,142][52658] DAMAGECOUNT value on done: 788982.0 [2024-08-06 06:47:48,144][52658] Sum rewards: 74.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.052', 'weapon5': '0.106', 'AMMO3': '0.226', 'AMMO4': '0.230', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '61.500'} [2024-08-06 06:47:48,467][52671] DAMAGECOUNT value on done: 778362.0 [2024-08-06 06:47:48,467][52671] Sum rewards: 81.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.207', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:49,471][52670] DAMAGECOUNT value on done: 776710.0 [2024-08-06 06:47:49,472][52670] Sum rewards: 67.047, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.123', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.078', 'AMMO4': '0.093', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.254', 'AMMO3': '0.288', 'WEAPON3': '1.800', 'weapon3': '3.276', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:49,808][52666] DAMAGECOUNT value on done: 779360.0 [2024-08-06 06:47:49,809][52666] Sum rewards: 70.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.908', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'weapon4': '0.188', 'AMMO3': '0.237', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '58.000'} [2024-08-06 06:47:50,426][52668] DAMAGECOUNT value on done: 794943.0 [2024-08-06 06:47:50,427][52668] Sum rewards: 80.436, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.005', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.131', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '0.900', 'weapon3': '3.226', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '61.000'} [2024-08-06 06:47:51,110][52669] DAMAGECOUNT value on done: 810574.0 [2024-08-06 06:47:51,111][52669] Sum rewards: 82.130, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.126', 'AMMO3': '0.183', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.546', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '66.000'} [2024-08-06 06:47:51,186][52663] DAMAGECOUNT value on done: 787397.0 [2024-08-06 06:47:51,187][52663] Sum rewards: 71.744, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon4': '0.060', 'weapon5': '0.120', 'AMMO3': '0.179', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:51,262][52671] DAMAGECOUNT value on done: 798081.0 [2024-08-06 06:47:51,262][52671] Sum rewards: 78.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon2': '0.178', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:52,015][52670] DAMAGECOUNT value on done: 778577.0 [2024-08-06 06:47:52,017][52670] Sum rewards: 75.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.544', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.181', 'weapon4': '0.204', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '2.938', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '59.000'} [2024-08-06 06:47:52,244][52666] DAMAGECOUNT value on done: 773247.0 [2024-08-06 06:47:52,244][52666] Sum rewards: 88.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.176', 'weapon4': '0.498', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 586301440. Throughput: 0: 4362.5. Samples: 146580580. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:47:52,795][52567] Avg episode reward: [(0, '75.556')] [2024-08-06 06:47:52,895][52650] Updated weights for policy 0, policy_version 71571 (0.0016) [2024-08-06 06:47:53,532][52811] DAMAGECOUNT value on done: 748874.0 [2024-08-06 06:47:53,534][52811] Sum rewards: 69.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.516', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.120', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.334', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.500'} [2024-08-06 06:47:53,768][52668] DAMAGECOUNT value on done: 790926.0 [2024-08-06 06:47:53,768][52668] Sum rewards: 85.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.696', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.158', 'weapon2': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:53,935][52669] DAMAGECOUNT value on done: 797515.0 [2024-08-06 06:47:53,937][52669] Sum rewards: 63.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.009', 'weapon4': '0.018', 'AMMO2': '0.031', 'weapon5': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.157', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.291', 'WEAPON3': '1.750', 'HITCOUNT': '3.140', 'weapon3': '3.484', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '57.000'} [2024-08-06 06:47:54,021][52663] DAMAGECOUNT value on done: 792911.0 [2024-08-06 06:47:54,022][52663] Sum rewards: 77.140, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.110', 'weapon5': '0.120', 'AMMO4': '0.134', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '61.000'} [2024-08-06 06:47:54,356][52671] DAMAGECOUNT value on done: 795617.0 [2024-08-06 06:47:54,359][52671] Sum rewards: 79.887, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.391', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.170', 'AMMO4': '0.203', 'AMMO3': '0.233', 'weapon5': '0.256', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.896', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '69.000'} [2024-08-06 06:47:54,727][52670] DAMAGECOUNT value on done: 773006.0 [2024-08-06 06:47:54,729][52670] Sum rewards: 77.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.655', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO4': '0.158', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.318', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '62.000'} [2024-08-06 06:47:54,972][52666] DAMAGECOUNT value on done: 782133.0 [2024-08-06 06:47:54,973][52666] Sum rewards: 80.498, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.170', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.378', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:56,546][52811] DAMAGECOUNT value on done: 732542.0 [2024-08-06 06:47:56,546][52811] Sum rewards: 81.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.114', 'AMMO3': '0.193', 'AMMO4': '0.201', 'weapon5': '0.222', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.853', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:56,633][52668] DAMAGECOUNT value on done: 796847.0 [2024-08-06 06:47:56,634][52668] Sum rewards: 75.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.084', 'AMMO2': '0.006', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.173', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.100', 'HITCOUNT': '3.440', 'weapon3': '3.500', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '60.000'} [2024-08-06 06:47:56,791][52669] DAMAGECOUNT value on done: 791926.0 [2024-08-06 06:47:56,791][52669] Sum rewards: 80.667, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.726', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.160', 'weapon2': '0.162', 'AMMO3': '0.182', 'AMMO4': '0.201', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '67.000'} [2024-08-06 06:47:56,880][52663] DAMAGECOUNT value on done: 778695.0 [2024-08-06 06:47:56,880][52663] Sum rewards: 61.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.188', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.870', 'weapon3': '3.044', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '51.000'} [2024-08-06 06:47:57,351][52650] Updated weights for policy 0, policy_version 71581 (0.0044) [2024-08-06 06:47:57,574][52671] DAMAGECOUNT value on done: 792583.0 [2024-08-06 06:47:57,575][52671] Sum rewards: 76.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.043', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.632', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '64.000'} [2024-08-06 06:47:57,671][52670] DAMAGECOUNT value on done: 785918.0 [2024-08-06 06:47:57,674][52670] Sum rewards: 77.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.398', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '65.000'} [2024-08-06 06:47:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 586391552. Throughput: 0: 4354.2. Samples: 146606560. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:47:57,794][52567] Avg episode reward: [(0, '75.656')] [2024-08-06 06:47:58,182][52666] DAMAGECOUNT value on done: 776579.0 [2024-08-06 06:47:58,182][52666] Sum rewards: 65.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.420', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '55.000'} [2024-08-06 06:47:59,173][52668] DAMAGECOUNT value on done: 779288.0 [2024-08-06 06:47:59,174][52668] Sum rewards: 79.819, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.206', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.135', 'weapon4': '0.180', 'weapon5': '0.232', 'AMMO4': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.562', 'WEAPON3': '0.900', 'weapon3': '2.756', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '63.000'} [2024-08-06 06:47:59,593][52811] DAMAGECOUNT value on done: 727661.0 [2024-08-06 06:47:59,598][52811] Sum rewards: 64.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.145', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.130', 'weapon5': '0.196', 'AMMO3': '0.198', 'AMMO4': '0.222', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '54.000'} [2024-08-06 06:47:59,731][52669] DAMAGECOUNT value on done: 795605.0 [2024-08-06 06:47:59,731][52669] Sum rewards: 69.996, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.044', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.245', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.272', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:00,029][52671] DAMAGECOUNT value on done: 797112.0 [2024-08-06 06:48:00,029][52671] Sum rewards: 73.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.134', 'AMMO4': '0.170', 'weapon5': '0.172', 'AMMO3': '0.209', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '60.000'} [2024-08-06 06:48:00,460][52670] DAMAGECOUNT value on done: 769599.0 [2024-08-06 06:48:00,462][52670] Sum rewards: 67.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.222', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.234', 'weapon2': '0.246', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.388', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '56.000'} [2024-08-06 06:48:00,904][52666] DAMAGECOUNT value on done: 783489.0 [2024-08-06 06:48:00,905][52666] Sum rewards: 70.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.229', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.038', 'weapon5': '0.136', 'AMMO4': '0.179', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.300', 'weapon3': '2.946', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:02,035][52668] DAMAGECOUNT value on done: 791605.0 [2024-08-06 06:48:02,035][52668] Sum rewards: 73.990, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.690', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'weapon2': '0.510', 'WEAPON3': '0.950', 'weapon3': '3.260', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:02,035][52650] Updated weights for policy 0, policy_version 71591 (0.0027) [2024-08-06 06:48:02,743][52811] DAMAGECOUNT value on done: 729162.0 [2024-08-06 06:48:02,743][52811] Sum rewards: 81.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.763', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.090', 'weapon5': '0.152', 'AMMO4': '0.192', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '68.000'} [2024-08-06 06:48:02,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 586481664. Throughput: 0: 4361.3. Samples: 146619900. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:48:02,794][52567] Avg episode reward: [(0, '75.234')] [2024-08-06 06:48:02,828][52671] DAMAGECOUNT value on done: 785622.0 [2024-08-06 06:48:02,828][52671] Sum rewards: 63.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.267', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon2': '0.196', 'AMMO3': '0.199', 'weapon5': '0.288', 'AMMO4': '0.288', 'weapon4': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '2.660', 'weapon3': '2.868', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '53.000'} [2024-08-06 06:48:03,011][52669] DAMAGECOUNT value on done: 800664.0 [2024-08-06 06:48:03,011][52669] Sum rewards: 77.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.435', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.076', 'weapon4': '0.108', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.214', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.436', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '64.000'} [2024-08-06 06:48:03,570][52670] DAMAGECOUNT value on done: 780702.0 [2024-08-06 06:48:03,571][52670] Sum rewards: 79.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.050', 'AMMO4': '0.059', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.440', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '65.000'} [2024-08-06 06:48:04,026][52666] DAMAGECOUNT value on done: 770540.0 [2024-08-06 06:48:04,026][52666] Sum rewards: 68.267, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.388', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.161', 'AMMO3': '0.206', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.000'} [2024-08-06 06:48:04,613][52663] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.534, 178.0), ('weapon3', 0.002)] [2024-08-06 06:48:05,126][52668] DAMAGECOUNT value on done: 792264.0 [2024-08-06 06:48:05,127][52668] Sum rewards: 70.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.179', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon2': '0.208', 'AMMO3': '0.235', 'weapon4': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:05,830][52811] DAMAGECOUNT value on done: 735028.0 [2024-08-06 06:48:05,830][52811] Sum rewards: 66.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.184', 'AMMO4': '0.206', 'weapon5': '0.236', 'weapon4': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '54.000'} [2024-08-06 06:48:06,412][52670] DAMAGECOUNT value on done: 788616.0 [2024-08-06 06:48:06,412][52670] Sum rewards: 82.200, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.080', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.248', 'weapon2': '0.408', 'WEAPON3': '1.000', 'weapon3': '2.950', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '66.000'} [2024-08-06 06:48:06,710][52662] DAMAGECOUNT value on done: 787288.0 [2024-08-06 06:48:06,710][52662] Sum rewards: 80.389, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.120', 'weapon4': '0.134', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '64.000'} [2024-08-06 06:48:06,889][52650] Updated weights for policy 0, policy_version 71601 (0.0033) [2024-08-06 06:48:06,910][52666] DAMAGECOUNT value on done: 784917.0 [2024-08-06 06:48:06,913][52666] Sum rewards: 65.497, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.120', 'weapon5': '0.202', 'AMMO3': '0.213', 'AMMO4': '0.213', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '2.830', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2024-08-06 06:48:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 586571776. Throughput: 0: 4357.8. Samples: 146645870. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:48:07,794][52567] Avg episode reward: [(0, '74.783')] [2024-08-06 06:48:08,292][52668] DAMAGECOUNT value on done: 783213.0 [2024-08-06 06:48:08,294][52668] Sum rewards: 81.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.121', 'weapon5': '0.160', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '67.000'} [2024-08-06 06:48:08,959][52811] DAMAGECOUNT value on done: 745022.0 [2024-08-06 06:48:08,961][52811] Sum rewards: 56.534, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.400', 'AMMO5': '0.022', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon5': '0.178', 'AMMO4': '0.224', 'AMMO3': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.566', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '51.000'} [2024-08-06 06:48:09,246][52670] DAMAGECOUNT value on done: 781163.0 [2024-08-06 06:48:09,247][52670] Sum rewards: 71.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.602', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:09,607][52666] DAMAGECOUNT value on done: 779183.0 [2024-08-06 06:48:09,608][52666] Sum rewards: 66.125, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.675', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.104', 'weapon2': '0.144', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'HITCOUNT': '3.360', 'weapon3': '3.462', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:09,933][52662] DAMAGECOUNT value on done: 796029.0 [2024-08-06 06:48:09,934][52662] Sum rewards: 73.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.232', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.118', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:11,016][52668] DAMAGECOUNT value on done: 783048.0 [2024-08-06 06:48:11,016][52668] Sum rewards: 67.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.370', 'AMMO5': '0.009', 'weapon4': '0.040', 'AMMO2': '0.049', 'weapon5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.242', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.420', 'weapon3': '3.428', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '59.000'} [2024-08-06 06:48:11,839][52670] DAMAGECOUNT value on done: 763364.0 [2024-08-06 06:48:11,841][52670] Sum rewards: 77.440, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.643', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.120', 'weapon5': '0.154', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.100', 'weapon3': '3.328', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '62.000'} [2024-08-06 06:48:11,950][52650] Updated weights for policy 0, policy_version 71611 (0.0013) [2024-08-06 06:48:12,186][52811] DAMAGECOUNT value on done: 740436.0 [2024-08-06 06:48:12,186][52811] Sum rewards: 67.967, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.095', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.040', 'weapon5': '0.144', 'AMMO4': '0.175', 'weapon2': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'HITCOUNT': '3.310', 'weapon3': '3.406', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:12,287][52666] DAMAGECOUNT value on done: 779671.0 [2024-08-06 06:48:12,287][52666] Sum rewards: 61.338, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.106', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.376', 'WEAPON3': '1.500', 'HITCOUNT': '3.020', 'weapon3': '3.240', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '52.000'} [2024-08-06 06:48:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 586653696. Throughput: 0: 4360.9. Samples: 146672130. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:48:12,802][52567] Avg episode reward: [(0, '74.220')] [2024-08-06 06:48:13,265][52662] DAMAGECOUNT value on done: 798987.0 [2024-08-06 06:48:13,265][52662] Sum rewards: 87.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.934', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon4': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.228', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '72.000'} [2024-08-06 06:48:13,798][52668] DAMAGECOUNT value on done: 791985.0 [2024-08-06 06:48:13,798][52668] Sum rewards: 85.436, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.843', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '72.000'} [2024-08-06 06:48:14,372][52670] DAMAGECOUNT value on done: 777338.0 [2024-08-06 06:48:14,373][52670] Sum rewards: 75.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.013', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.090', 'weapon5': '0.096', 'AMMO4': '0.124', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '62.000'} [2024-08-06 06:48:14,959][52666] DAMAGECOUNT value on done: 775312.0 [2024-08-06 06:48:14,961][52666] Sum rewards: 80.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '67.000'} [2024-08-06 06:48:15,272][52811] DAMAGECOUNT value on done: 732019.0 [2024-08-06 06:48:15,274][52811] Sum rewards: 71.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.535', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.084', 'AMMO4': '0.111', 'weapon5': '0.134', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.500'} [2024-08-06 06:48:16,031][52650] Updated weights for policy 0, policy_version 71621 (0.0021) [2024-08-06 06:48:16,079][52662] DAMAGECOUNT value on done: 781593.0 [2024-08-06 06:48:16,082][52662] Sum rewards: 60.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.215', 'weapon4': '0.234', 'AMMO4': '0.282', 'weapon5': '0.286', 'weapon2': '0.390', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '50.000'} [2024-08-06 06:48:16,767][52668] DAMAGECOUNT value on done: 785927.0 [2024-08-06 06:48:16,768][52668] Sum rewards: 79.566, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.602', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.060', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '68.000'} [2024-08-06 06:48:17,246][52670] DAMAGECOUNT value on done: 784929.0 [2024-08-06 06:48:17,247][52670] Sum rewards: 73.834, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.600', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.468', 'WEAPON3': '1.650', 'weapon3': '3.196', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '63.000'} [2024-08-06 06:48:17,548][52666] DAMAGECOUNT value on done: 776957.0 [2024-08-06 06:48:17,550][52666] Sum rewards: 64.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.965', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.168', 'AMMO3': '0.175', 'AMMO4': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.066', 'DAMAGECOUNT': '15.123', 'FRAGCOUNT': '53.000'} [2024-08-06 06:48:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 586743808. Throughput: 0: 4371.8. Samples: 146685310. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:48:17,802][52567] Avg episode reward: [(0, '74.256')] [2024-08-06 06:48:18,408][52811] DAMAGECOUNT value on done: 741506.0 [2024-08-06 06:48:18,410][52811] Sum rewards: 78.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO4': '0.149', 'AMMO3': '0.157', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.308', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '64.000'} [2024-08-06 06:48:19,092][52668] DAMAGECOUNT value on done: 780930.0 [2024-08-06 06:48:19,093][52668] Sum rewards: 70.673, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.783', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.068', 'AMMO4': '0.212', 'weapon5': '0.274', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.600', 'weapon3': '2.854', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:19,247][52662] DAMAGECOUNT value on done: 799199.0 [2024-08-06 06:48:19,247][52662] Sum rewards: 80.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.272', 'AMMO5': '0.010', 'AMMO2': '0.044', 'AMMO3': '0.176', 'weapon5': '0.176', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.380', 'weapon2': '0.414', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '66.000'} [2024-08-06 06:48:19,959][52670] DAMAGECOUNT value on done: 781859.0 [2024-08-06 06:48:19,960][52670] Sum rewards: 78.515, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.946', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.070', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.317', 'WEAPON3': '1.800', 'weapon3': '3.388', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '67.000'} [2024-08-06 06:48:20,301][52666] DAMAGECOUNT value on done: 792374.0 [2024-08-06 06:48:20,303][52666] Sum rewards: 85.561, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.160', 'AMMO3': '0.211', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'HEALTH': '0.393', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '69.000'} [2024-08-06 06:48:20,993][52650] Updated weights for policy 0, policy_version 71631 (0.0029) [2024-08-06 06:48:21,470][52811] DAMAGECOUNT value on done: 736528.0 [2024-08-06 06:48:21,470][52811] Sum rewards: 62.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.136', 'AMMO3': '0.194', 'AMMO4': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.158', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '51.500'} [2024-08-06 06:48:21,594][52668] DAMAGECOUNT value on done: 776142.0 [2024-08-06 06:48:21,594][52668] Sum rewards: 80.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.618', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.175', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.236', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '65.000'} [2024-08-06 06:48:22,359][52662] DAMAGECOUNT value on done: 781691.0 [2024-08-06 06:48:22,359][52662] Sum rewards: 67.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.174', 'AMMO3': '0.193', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.704', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '57.000'} [2024-08-06 06:48:22,746][52670] DAMAGECOUNT value on done: 783846.0 [2024-08-06 06:48:22,747][52670] Sum rewards: 68.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.535', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.714', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '57.500'} [2024-08-06 06:48:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 586833920. Throughput: 0: 4373.3. Samples: 146711600. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 06:48:22,802][52567] Avg episode reward: [(0, '73.861')] [2024-08-06 06:48:23,005][52666] DAMAGECOUNT value on done: 769130.0 [2024-08-06 06:48:23,006][52666] Sum rewards: 64.001, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.538', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.098', 'AMMO3': '0.206', 'AMMO4': '0.242', 'weapon5': '0.244', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '54.500'} [2024-08-06 06:48:24,526][52811] DAMAGECOUNT value on done: 741096.0 [2024-08-06 06:48:24,527][52811] Sum rewards: 83.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.089', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '69.000'} [2024-08-06 06:48:24,672][52668] DAMAGECOUNT value on done: 777042.0 [2024-08-06 06:48:24,675][52668] Sum rewards: 91.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.691', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.570', 'FRAGCOUNT': '75.000'} [2024-08-06 06:48:25,075][52662] DAMAGECOUNT value on done: 787115.0 [2024-08-06 06:48:25,076][52662] Sum rewards: 65.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.076', 'weapon5': '0.138', 'AMMO3': '0.231', 'AMMO4': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '56.000'} [2024-08-06 06:48:25,684][52650] Updated weights for policy 0, policy_version 71641 (0.0017) [2024-08-06 06:48:26,225][52666] DAMAGECOUNT value on done: 779076.0 [2024-08-06 06:48:26,226][52666] Sum rewards: 68.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.074', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.368', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '60.000'} [2024-08-06 06:48:27,674][52811] DAMAGECOUNT value on done: 746283.0 [2024-08-06 06:48:27,674][52811] Sum rewards: 75.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.924', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '63.000'} [2024-08-06 06:48:27,709][52668] DAMAGECOUNT value on done: 773470.0 [2024-08-06 06:48:27,709][52668] Sum rewards: 71.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.178', 'weapon2': '0.198', 'AMMO4': '0.212', 'AMMO3': '0.239', 'weapon4': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '59.000'} [2024-08-06 06:48:27,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 586924032. Throughput: 0: 4365.5. Samples: 146737510. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:48:27,802][52567] Avg episode reward: [(0, '73.929')] [2024-08-06 06:48:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071646_586924032.pth... [2024-08-06 06:48:27,862][52662] DAMAGECOUNT value on done: 803202.0 [2024-08-06 06:48:27,864][52662] Sum rewards: 64.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.148', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.122', 'AMMO3': '0.193', 'AMMO4': '0.213', 'weapon5': '0.226', 'weapon2': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.170', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '51.500'} [2024-08-06 06:48:27,961][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071133_582721536.pth [2024-08-06 06:48:29,334][52660] DAMAGECOUNT value on done: 787075.0 [2024-08-06 06:48:29,334][52660] Sum rewards: 77.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.095', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.186', 'AMMO3': '0.200', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'weapon4': '0.380', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 06:48:30,272][52650] Updated weights for policy 0, policy_version 71651 (0.0022) [2024-08-06 06:48:30,638][52668] DAMAGECOUNT value on done: 786308.0 [2024-08-06 06:48:30,639][52668] Sum rewards: 73.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.030', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.328', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '62.000'} [2024-08-06 06:48:30,701][52811] DAMAGECOUNT value on done: 738870.0 [2024-08-06 06:48:30,706][52811] Sum rewards: 66.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.092', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon4': '0.294', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '54.000'} [2024-08-06 06:48:31,155][52662] DAMAGECOUNT value on done: 789455.0 [2024-08-06 06:48:31,155][52662] Sum rewards: 69.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.076', 'AMMO4': '0.134', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '56.500'} [2024-08-06 06:48:31,669][52820] DAMAGECOUNT value on done: 729444.0 [2024-08-06 06:48:31,671][52820] Sum rewards: 76.829, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.658', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.158', 'WEAPON5': '0.250', 'AMMO3': '0.304', 'weapon2': '0.310', 'WEAPON3': '1.900', 'weapon3': '3.170', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '68.000'} [2024-08-06 06:48:32,678][52660] DAMAGECOUNT value on done: 777032.0 [2024-08-06 06:48:32,678][52660] Sum rewards: 71.852, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.860', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.089', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.744', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 587005952. Throughput: 0: 4370.9. Samples: 146750730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:48:32,795][52567] Avg episode reward: [(0, '73.814')] [2024-08-06 06:48:33,003][52667] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:48:33,777][52811] DAMAGECOUNT value on done: 736395.0 [2024-08-06 06:48:33,778][52811] Sum rewards: 83.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.530', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.086', 'AMMO4': '0.122', 'weapon5': '0.170', 'weapon2': '0.220', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.766', 'FRAGCOUNT': '68.000'} [2024-08-06 06:48:33,779][52668] DAMAGECOUNT value on done: 788700.0 [2024-08-06 06:48:33,784][52668] Sum rewards: 76.071, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.774', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.198', 'weapon2': '0.204', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.850', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '62.000'} [2024-08-06 06:48:33,921][52795] DAMAGECOUNT value on done: 733476.0 [2024-08-06 06:48:33,922][52795] Sum rewards: 72.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.950', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.136', 'weapon4': '0.212', 'AMMO4': '0.218', 'AMMO3': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '62.000'} [2024-08-06 06:48:34,384][52662] DAMAGECOUNT value on done: 794732.0 [2024-08-06 06:48:34,385][52662] Sum rewards: 79.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '65.000'} [2024-08-06 06:48:34,941][52820] DAMAGECOUNT value on done: 731497.0 [2024-08-06 06:48:34,943][52820] Sum rewards: 75.050, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.012', 'weapon5': '0.038', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.614', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 06:48:35,162][52650] Updated weights for policy 0, policy_version 71661 (0.0013) [2024-08-06 06:48:35,574][52660] DAMAGECOUNT value on done: 790746.0 [2024-08-06 06:48:35,575][52660] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.350', 'AMMO5': '0.021', 'AMMO2': '0.069', 'weapon4': '0.086', 'weapon5': '0.138', 'AMMO3': '0.211', 'AMMO4': '0.347', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '63.000'} [2024-08-06 06:48:36,799][52668] DAMAGECOUNT value on done: 785166.0 [2024-08-06 06:48:36,800][52668] Sum rewards: 60.048, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.236', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO4': '0.182', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.032', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '51.000'} [2024-08-06 06:48:36,865][52811] DAMAGECOUNT value on done: 734154.0 [2024-08-06 06:48:36,865][52811] Sum rewards: 64.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO4': '0.190', 'AMMO3': '0.222', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.300', 'weapon3': '2.702', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '52.000'} [2024-08-06 06:48:37,140][52795] DAMAGECOUNT value on done: 720037.0 [2024-08-06 06:48:37,140][52795] Sum rewards: 69.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.706', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.104', 'AMMO3': '0.177', 'weapon5': '0.196', 'AMMO4': '0.276', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '56.000'} [2024-08-06 06:48:37,450][52662] DAMAGECOUNT value on done: 785365.0 [2024-08-06 06:48:37,453][52662] Sum rewards: 80.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '67.000'} [2024-08-06 06:48:37,800][52567] Fps is (10 sec: 16374.8, 60 sec: 17338.1, 300 sec: 17466.7). Total num frames: 587087872. Throughput: 0: 4353.2. Samples: 146776500. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:48:37,800][52567] Avg episode reward: [(0, '73.718')] [2024-08-06 06:48:38,181][52820] DAMAGECOUNT value on done: 730739.0 [2024-08-06 06:48:38,182][52820] Sum rewards: 72.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.722', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.388', 'weapon2': '0.514', 'WEAPON3': '1.450', 'weapon3': '2.674', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:38,544][52660] DAMAGECOUNT value on done: 800180.0 [2024-08-06 06:48:38,544][52660] Sum rewards: 72.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.288', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.222', 'weapon5': '0.222', 'weapon2': '0.294', 'weapon4': '0.300', 'AMMO4': '0.301', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '58.500'} [2024-08-06 06:48:39,831][52811] DAMAGECOUNT value on done: 736124.0 [2024-08-06 06:48:39,835][52811] Sum rewards: 78.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.160', 'weapon4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '65.000'} [2024-08-06 06:48:39,858][52668] DAMAGECOUNT value on done: 792487.0 [2024-08-06 06:48:39,859][52668] Sum rewards: 68.043, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.625', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '57.000'} [2024-08-06 06:48:39,954][52650] Updated weights for policy 0, policy_version 71671 (0.0023) [2024-08-06 06:48:40,149][52662] DAMAGECOUNT value on done: 789863.0 [2024-08-06 06:48:40,150][52662] Sum rewards: 79.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.142', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '64.000'} [2024-08-06 06:48:40,263][52795] DAMAGECOUNT value on done: 722931.0 [2024-08-06 06:48:40,263][52795] Sum rewards: 86.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.154', 'weapon2': '0.162', 'AMMO3': '0.231', 'WEAPON3': '1.400', 'weapon3': '3.374', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '72.000'} [2024-08-06 06:48:40,525][52803] DAMAGECOUNT value on done: 731916.0 [2024-08-06 06:48:40,525][52803] Sum rewards: 56.340, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.184', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.102', 'AMMO3': '0.210', 'AMMO4': '0.211', 'WEAPON5': '0.300', 'weapon4': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.638', 'WEAPON3': '1.200', 'weapon3': '2.630', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.156', 'FRAGCOUNT': '49.000'} [2024-08-06 06:48:41,546][52660] DAMAGECOUNT value on done: 782329.0 [2024-08-06 06:48:41,550][52660] Sum rewards: 76.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.174', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.308', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '62.000'} [2024-08-06 06:48:41,571][52820] DAMAGECOUNT value on done: 721434.0 [2024-08-06 06:48:41,571][52820] Sum rewards: 64.469, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.682', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.172', 'AMMO4': '0.207', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.550', 'weapon3': '2.996', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:42,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 587169792. Throughput: 0: 4364.9. Samples: 146802980. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:48:42,794][52567] Avg episode reward: [(0, '73.596')] [2024-08-06 06:48:42,937][52811] DAMAGECOUNT value on done: 741622.0 [2024-08-06 06:48:42,939][52811] Sum rewards: 72.940, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.394', 'AMMO5': '0.020', 'AMMO2': '0.042', 'AMMO3': '0.131', 'weapon2': '0.178', 'AMMO4': '0.212', 'weapon5': '0.284', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '0.850', 'weapon4': '1.004', 'weapon3': '2.276', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '59.000'} [2024-08-06 06:48:42,956][52668] DAMAGECOUNT value on done: 789883.0 [2024-08-06 06:48:42,956][52668] Sum rewards: 72.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.722', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.007', 'weapon5': '0.012', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.412', 'WEAPON3': '1.000', 'HITCOUNT': '3.450', 'weapon3': '3.462', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '58.500'} [2024-08-06 06:48:43,139][52662] DAMAGECOUNT value on done: 780660.0 [2024-08-06 06:48:43,143][52662] Sum rewards: 71.567, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon4': '0.144', 'weapon5': '0.214', 'AMMO3': '0.218', 'AMMO4': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '2.680', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '59.000'} [2024-08-06 06:48:43,593][52795] DAMAGECOUNT value on done: 731956.0 [2024-08-06 06:48:43,594][52795] Sum rewards: 88.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.974', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'weapon2': '0.232', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'weapon3': '3.452', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.720', 'FRAGCOUNT': '75.000'} [2024-08-06 06:48:43,654][52803] DAMAGECOUNT value on done: 731320.0 [2024-08-06 06:48:43,656][52803] Sum rewards: 84.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.793', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.086', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.243', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '70.000'} [2024-08-06 06:48:44,093][52650] Updated weights for policy 0, policy_version 71681 (0.0031) [2024-08-06 06:48:44,719][52660] DAMAGECOUNT value on done: 776690.0 [2024-08-06 06:48:44,720][52660] Sum rewards: 76.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.332', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon2': '0.508', 'WEAPON3': '0.950', 'weapon3': '3.232', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:44,775][52820] DAMAGECOUNT value on done: 734200.0 [2024-08-06 06:48:44,776][52820] Sum rewards: 73.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.098', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.216', 'weapon5': '0.232', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '60.000'} [2024-08-06 06:48:46,032][52811] DAMAGECOUNT value on done: 744591.0 [2024-08-06 06:48:46,036][52811] Sum rewards: 78.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.118', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '65.000'} [2024-08-06 06:48:46,357][52662] DAMAGECOUNT value on done: 793470.0 [2024-08-06 06:48:46,360][52662] Sum rewards: 80.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.938', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '67.000'} [2024-08-06 06:48:46,526][52803] DAMAGECOUNT value on done: 737603.0 [2024-08-06 06:48:46,526][52803] Sum rewards: 69.597, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.328', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.154', 'AMMO4': '0.182', 'weapon5': '0.228', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.550', 'weapon3': '2.808', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '61.500'} [2024-08-06 06:48:46,808][52795] DAMAGECOUNT value on done: 721489.0 [2024-08-06 06:48:46,808][52795] Sum rewards: 68.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.405', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.138', 'AMMO4': '0.164', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.282', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '57.000'} [2024-08-06 06:48:47,358][52660] DAMAGECOUNT value on done: 786730.0 [2024-08-06 06:48:47,358][52660] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '55.500'} [2024-08-06 06:48:47,794][52567] Fps is (10 sec: 18032.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 587268096. Throughput: 0: 4364.4. Samples: 146816300. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:48:47,794][52567] Avg episode reward: [(0, '73.527')] [2024-08-06 06:48:47,849][52820] DAMAGECOUNT value on done: 718462.0 [2024-08-06 06:48:47,849][52820] Sum rewards: 82.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.320', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.126', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.284', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.546', 'FRAGCOUNT': '69.000'} [2024-08-06 06:48:49,090][52811] DAMAGECOUNT value on done: 735494.0 [2024-08-06 06:48:49,101][52811] Sum rewards: 86.691, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.294', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.128', 'weapon5': '0.172', 'AMMO4': '0.203', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '75.000'} [2024-08-06 06:48:49,417][52650] Updated weights for policy 0, policy_version 71691 (0.0027) [2024-08-06 06:48:49,569][52803] DAMAGECOUNT value on done: 736785.0 [2024-08-06 06:48:49,570][52803] Sum rewards: 62.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.115', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.082', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.366', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '53.000'} [2024-08-06 06:48:49,579][52662] DAMAGECOUNT value on done: 780500.0 [2024-08-06 06:48:49,583][52662] Sum rewards: 77.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.580', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.078', 'weapon5': '0.084', 'AMMO4': '0.242', 'AMMO3': '0.244', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '67.000'} [2024-08-06 06:48:50,146][52795] DAMAGECOUNT value on done: 728726.0 [2024-08-06 06:48:50,146][52795] Sum rewards: 63.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.148', 'weapon5': '0.164', 'AMMO3': '0.229', 'AMMO4': '0.261', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '54.000'} [2024-08-06 06:48:50,371][52660] DAMAGECOUNT value on done: 793380.0 [2024-08-06 06:48:50,372][52660] Sum rewards: 64.289, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.945', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.138', 'weapon4': '0.152', 'AMMO4': '0.231', 'weapon2': '0.248', 'WEAPON5': '0.300', 'AMMO3': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.120', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:51,071][52820] DAMAGECOUNT value on done: 726311.0 [2024-08-06 06:48:51,075][52820] Sum rewards: 81.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.531', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.162', 'AMMO4': '0.168', 'AMMO3': '0.275', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.202', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '69.000'} [2024-08-06 06:48:52,162][52662] DAMAGECOUNT value on done: 798025.0 [2024-08-06 06:48:52,163][52662] Sum rewards: 83.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.202', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.158', 'AMMO4': '0.239', 'AMMO3': '0.242', 'weapon5': '0.286', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.762', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '70.000'} [2024-08-06 06:48:52,294][52811] DAMAGECOUNT value on done: 736968.0 [2024-08-06 06:48:52,295][52811] Sum rewards: 81.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.050', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '68.000'} [2024-08-06 06:48:52,673][52803] DAMAGECOUNT value on done: 735198.0 [2024-08-06 06:48:52,673][52803] Sum rewards: 72.322, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.194', 'AMMO4': '0.198', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.668', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:52,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 587358208. Throughput: 0: 4363.6. Samples: 146842230. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:48:52,794][52567] Avg episode reward: [(0, '73.405')] [2024-08-06 06:48:53,329][52795] DAMAGECOUNT value on done: 737268.0 [2024-08-06 06:48:53,329][52795] Sum rewards: 70.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon4': '0.098', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '59.000'} [2024-08-06 06:48:53,481][52660] DAMAGECOUNT value on done: 778451.0 [2024-08-06 06:48:53,481][52660] Sum rewards: 71.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.184', 'AMMO4': '0.184', 'weapon5': '0.186', 'weapon2': '0.212', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '58.000'} [2024-08-06 06:48:53,937][52650] Updated weights for policy 0, policy_version 71701 (0.0022) [2024-08-06 06:48:54,319][52820] DAMAGECOUNT value on done: 729980.0 [2024-08-06 06:48:54,322][52820] Sum rewards: 75.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.956', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.195', 'weapon4': '0.222', 'weapon5': '0.232', 'AMMO4': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.816', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:54,732][52667] DAMAGECOUNT value on done: 788387.0 [2024-08-06 06:48:54,733][52667] Sum rewards: 80.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.742', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.108', 'AMMO4': '0.112', 'weapon5': '0.168', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '65.000'} [2024-08-06 06:48:55,386][52662] DAMAGECOUNT value on done: 790303.0 [2024-08-06 06:48:55,386][52662] Sum rewards: 64.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.179', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.188', 'weapon5': '0.188', 'weapon2': '0.218', 'AMMO4': '0.221', 'AMMO3': '0.279', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 06:48:55,676][52803] DAMAGECOUNT value on done: 736251.0 [2024-08-06 06:48:55,676][52803] Sum rewards: 71.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.712', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.072', 'weapon4': '0.076', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.418', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '60.000'} [2024-08-06 06:48:56,410][52795] DAMAGECOUNT value on done: 726551.0 [2024-08-06 06:48:56,410][52795] Sum rewards: 65.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.134', 'AMMO4': '0.206', 'AMMO3': '0.237', 'weapon5': '0.342', 'WEAPON4': '0.450', 'weapon2': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.648', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '55.000'} [2024-08-06 06:48:56,600][52660] DAMAGECOUNT value on done: 781337.0 [2024-08-06 06:48:56,602][52660] Sum rewards: 62.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.720', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO3': '0.199', 'weapon5': '0.200', 'AMMO4': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '50.500'} [2024-08-06 06:48:57,161][52667] DAMAGECOUNT value on done: 795632.0 [2024-08-06 06:48:57,162][52667] Sum rewards: 77.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.112', 'weapon5': '0.128', 'AMMO3': '0.193', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.298', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '62.000'} [2024-08-06 06:48:57,301][52659] DAMAGECOUNT value on done: 790855.0 [2024-08-06 06:48:57,301][52659] Sum rewards: 84.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.081', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.168', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '68.000'} [2024-08-06 06:48:57,397][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:48:57,440][52820] DAMAGECOUNT value on done: 731801.0 [2024-08-06 06:48:57,441][52820] Sum rewards: 87.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.218', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.170', 'weapon5': '0.188', 'weapon2': '0.218', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.060', 'FRAGCOUNT': '70.000'} [2024-08-06 06:48:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 587431936. Throughput: 0: 4362.0. Samples: 146868420. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:48:57,794][52567] Avg episode reward: [(0, '73.637')] [2024-08-06 06:48:58,336][52662] DAMAGECOUNT value on done: 776535.0 [2024-08-06 06:48:58,338][52662] Sum rewards: 72.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.412', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.197', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '61.000'} [2024-08-06 06:48:58,678][52650] Updated weights for policy 0, policy_version 71711 (0.0012) [2024-08-06 06:48:58,758][52614] Signal inference workers to stop experience collection... (13100 times) [2024-08-06 06:48:58,759][52614] Signal inference workers to resume experience collection... (13100 times) [2024-08-06 06:48:58,799][52650] InferenceWorker_p0-w0: stopping experience collection (13100 times) [2024-08-06 06:48:58,800][52650] InferenceWorker_p0-w0: resuming experience collection (13100 times) [2024-08-06 06:48:58,864][52803] DAMAGECOUNT value on done: 727736.0 [2024-08-06 06:48:58,866][52803] Sum rewards: 77.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.812', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'weapon2': '0.196', 'AMMO3': '0.224', 'WEAPON3': '1.300', 'weapon3': '3.380', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '64.000'} [2024-08-06 06:48:59,274][52660] DAMAGECOUNT value on done: 787688.0 [2024-08-06 06:48:59,275][52660] Sum rewards: 78.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.915', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO4': '0.181', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '64.000'} [2024-08-06 06:48:59,605][52795] DAMAGECOUNT value on done: 731202.0 [2024-08-06 06:48:59,605][52795] Sum rewards: 93.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.076', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.203', 'WEAPON3': '1.300', 'weapon3': '3.402', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.008', 'FRAGCOUNT': '75.000'} [2024-08-06 06:48:59,842][52667] DAMAGECOUNT value on done: 792807.0 [2024-08-06 06:48:59,844][52667] Sum rewards: 60.990, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.732', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.128', 'weapon5': '0.164', 'AMMO4': '0.243', 'AMMO3': '0.271', 'weapon2': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '55.000'} [2024-08-06 06:49:00,221][52659] DAMAGECOUNT value on done: 789571.0 [2024-08-06 06:49:00,221][52659] Sum rewards: 72.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.058', 'weapon4': '0.070', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:00,617][52820] DAMAGECOUNT value on done: 740294.0 [2024-08-06 06:49:00,618][52820] Sum rewards: 74.652, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.126', 'AMMO4': '0.186', 'weapon5': '0.228', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '64.000'} [2024-08-06 06:49:01,708][52662] DAMAGECOUNT value on done: 789029.0 [2024-08-06 06:49:01,709][52662] Sum rewards: 80.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.546', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon5': '0.076', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.254', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.230', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '68.000'} [2024-08-06 06:49:01,895][52803] DAMAGECOUNT value on done: 727462.0 [2024-08-06 06:49:01,895][52803] Sum rewards: 78.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.038', 'AMMO4': '0.139', 'weapon5': '0.146', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.224', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '67.000'} [2024-08-06 06:49:02,434][52660] DAMAGECOUNT value on done: 780364.0 [2024-08-06 06:49:02,435][52660] Sum rewards: 74.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.767', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.322', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:02,676][52667] DAMAGECOUNT value on done: 798219.0 [2024-08-06 06:49:02,676][52667] Sum rewards: 70.459, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.545', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.134', 'weapon4': '0.196', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 587530240. Throughput: 0: 4351.3. Samples: 146881120. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 06:49:02,794][52567] Avg episode reward: [(0, '74.106')] [2024-08-06 06:49:02,829][52795] DAMAGECOUNT value on done: 732475.0 [2024-08-06 06:49:02,830][52795] Sum rewards: 68.845, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'weapon5': '0.028', 'AMMO2': '0.030', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.182', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:02,962][52659] DAMAGECOUNT value on done: 793482.0 [2024-08-06 06:49:02,964][52659] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.310', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.088', 'weapon4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:03,483][52650] Updated weights for policy 0, policy_version 71721 (0.0012) [2024-08-06 06:49:03,800][52820] DAMAGECOUNT value on done: 723199.0 [2024-08-06 06:49:03,802][52820] Sum rewards: 61.624, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.985', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.160', 'weapon5': '0.176', 'AMMO4': '0.266', 'AMMO3': '0.280', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.964', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '55.000'} [2024-08-06 06:49:04,515][52662] DAMAGECOUNT value on done: 779623.0 [2024-08-06 06:49:04,515][52662] Sum rewards: 71.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.170', 'AMMO3': '0.213', 'AMMO4': '0.245', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '57.000'} [2024-08-06 06:49:04,933][52660] DAMAGECOUNT value on done: 786470.0 [2024-08-06 06:49:04,941][52660] Sum rewards: 75.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.139', 'AMMO3': '0.178', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:05,197][52803] DAMAGECOUNT value on done: 732462.0 [2024-08-06 06:49:05,200][52803] Sum rewards: 72.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.845', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon4': '0.092', 'AMMO3': '0.224', 'AMMO4': '0.230', 'weapon5': '0.254', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'weapon2': '0.626', 'WEAPON3': '1.400', 'weapon3': '2.722', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:05,346][52659] DAMAGECOUNT value on done: 789702.0 [2024-08-06 06:49:05,346][52659] Sum rewards: 81.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.196', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.053', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.352', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '68.000'} [2024-08-06 06:49:05,783][52667] DAMAGECOUNT value on done: 800917.0 [2024-08-06 06:49:05,783][52667] Sum rewards: 84.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.751', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.074', 'weapon5': '0.168', 'AMMO4': '0.198', 'AMMO3': '0.233', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.258', 'FRAGCOUNT': '70.000'} [2024-08-06 06:49:06,041][52795] DAMAGECOUNT value on done: 728193.0 [2024-08-06 06:49:06,041][52795] Sum rewards: 68.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.856', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon5': '0.124', 'weapon4': '0.160', 'AMMO3': '0.220', 'AMMO4': '0.239', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.120', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:06,865][52820] DAMAGECOUNT value on done: 732510.0 [2024-08-06 06:49:06,865][52820] Sum rewards: 69.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.104', 'AMMO4': '0.124', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.180', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:07,730][52659] DAMAGECOUNT value on done: 789221.0 [2024-08-06 06:49:07,732][52659] Sum rewards: 59.326, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.331', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.178', 'weapon4': '0.192', 'AMMO4': '0.274', 'AMMO3': '0.285', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.962', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '53.000'} [2024-08-06 06:49:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 587612160. Throughput: 0: 4347.1. Samples: 146907220. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:07,794][52567] Avg episode reward: [(0, '73.892')] [2024-08-06 06:49:07,977][52660] DAMAGECOUNT value on done: 796850.0 [2024-08-06 06:49:07,977][52660] Sum rewards: 84.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.320', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.060', 'weapon4': '0.086', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '72.000'} [2024-08-06 06:49:08,203][52650] Updated weights for policy 0, policy_version 71731 (0.0013) [2024-08-06 06:49:08,342][52803] DAMAGECOUNT value on done: 732344.0 [2024-08-06 06:49:08,343][52803] Sum rewards: 76.380, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.048', 'weapon5': '0.100', 'weapon2': '0.198', 'AMMO4': '0.200', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.410', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:08,983][52667] DAMAGECOUNT value on done: 797320.0 [2024-08-06 06:49:08,986][52667] Sum rewards: 77.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.049', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.418', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:09,216][52795] DAMAGECOUNT value on done: 722594.0 [2024-08-06 06:49:09,217][52795] Sum rewards: 79.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.518', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '69.000'} [2024-08-06 06:49:10,044][52820] DAMAGECOUNT value on done: 740809.0 [2024-08-06 06:49:10,052][52820] Sum rewards: 78.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.046', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon5': '0.190', 'AMMO4': '0.198', 'weapon4': '0.216', 'AMMO3': '0.229', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '64.000'} [2024-08-06 06:49:10,328][52659] DAMAGECOUNT value on done: 790726.0 [2024-08-06 06:49:10,329][52659] Sum rewards: 81.952, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.810', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.288', 'weapon2': '0.326', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '70.000'} [2024-08-06 06:49:10,854][52660] DAMAGECOUNT value on done: 805242.0 [2024-08-06 06:49:10,854][52660] Sum rewards: 77.465, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.142', 'WEAPON4': '0.150', 'weapon2': '0.160', 'AMMO3': '0.175', 'WEAPON3': '1.000', 'weapon3': '3.504', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:11,238][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:49:11,481][52803] DAMAGECOUNT value on done: 745170.0 [2024-08-06 06:49:11,482][52803] Sum rewards: 76.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.826', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon5': '0.168', 'weapon4': '0.208', 'AMMO3': '0.239', 'weapon2': '0.248', 'AMMO4': '0.342', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '64.000'} [2024-08-06 06:49:12,098][52667] DAMAGECOUNT value on done: 794503.0 [2024-08-06 06:49:12,098][52667] Sum rewards: 77.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.398', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.090', 'AMMO4': '0.126', 'weapon5': '0.142', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:12,327][52795] DAMAGECOUNT value on done: 724151.0 [2024-08-06 06:49:12,327][52795] Sum rewards: 67.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.015', 'weapon4': '0.042', 'AMMO2': '0.043', 'weapon5': '0.104', 'AMMO3': '0.198', 'AMMO4': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '55.000'} [2024-08-06 06:49:12,789][52650] Updated weights for policy 0, policy_version 71741 (0.0027) [2024-08-06 06:49:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 587702272. Throughput: 0: 4361.1. Samples: 146933760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:12,794][52567] Avg episode reward: [(0, '74.132')] [2024-08-06 06:49:13,010][52659] DAMAGECOUNT value on done: 790792.0 [2024-08-06 06:49:13,011][52659] Sum rewards: 65.519, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.544', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.070', 'AMMO4': '0.188', 'AMMO3': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '53.000'} [2024-08-06 06:49:13,182][52820] DAMAGECOUNT value on done: 733780.0 [2024-08-06 06:49:13,182][52820] Sum rewards: 83.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.264', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.026', 'AMMO4': '0.058', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '68.000'} [2024-08-06 06:49:13,297][52660] DAMAGECOUNT value on done: 784113.0 [2024-08-06 06:49:13,298][52660] Sum rewards: 74.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.732', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.260', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:14,733][52803] DAMAGECOUNT value on done: 735209.0 [2024-08-06 06:49:14,734][52803] Sum rewards: 58.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.390', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.132', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.762', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '48.000'} [2024-08-06 06:49:15,212][52667] DAMAGECOUNT value on done: 790423.0 [2024-08-06 06:49:15,212][52667] Sum rewards: 72.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.972', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.172', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:15,410][52795] DAMAGECOUNT value on done: 733364.0 [2024-08-06 06:49:15,413][52795] Sum rewards: 69.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.688', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon5': '0.194', 'AMMO3': '0.216', 'weapon2': '0.276', 'AMMO4': '0.291', 'weapon4': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:15,912][52659] DAMAGECOUNT value on done: 788714.0 [2024-08-06 06:49:15,914][52659] Sum rewards: 73.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.371', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.106', 'AMMO4': '0.175', 'weapon5': '0.212', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:15,913][52660] DAMAGECOUNT value on done: 791479.0 [2024-08-06 06:49:15,917][52660] Sum rewards: 73.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.135', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.064', 'AMMO4': '0.069', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '63.000'} [2024-08-06 06:49:16,324][52820] DAMAGECOUNT value on done: 735079.0 [2024-08-06 06:49:16,327][52820] Sum rewards: 69.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.805', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.096', 'weapon5': '0.156', 'AMMO3': '0.174', 'AMMO4': '0.237', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:17,259][52650] Updated weights for policy 0, policy_version 71751 (0.0027) [2024-08-06 06:49:17,671][52667] DAMAGECOUNT value on done: 793198.0 [2024-08-06 06:49:17,672][52667] Sum rewards: 72.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.300', 'AMMO5': '0.008', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.040', 'AMMO4': '0.150', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.530', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 587792384. Throughput: 0: 4353.1. Samples: 146946620. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:17,794][52567] Avg episode reward: [(0, '74.064')] [2024-08-06 06:49:17,870][52803] DAMAGECOUNT value on done: 733573.0 [2024-08-06 06:49:17,871][52803] Sum rewards: 62.245, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.254', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.836', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '50.000'} [2024-08-06 06:49:18,620][52795] DAMAGECOUNT value on done: 717824.0 [2024-08-06 06:49:18,620][52795] Sum rewards: 72.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.592', 'AMMO5': '0.013', 'AMMO2': '0.061', 'weapon5': '0.224', 'AMMO3': '0.233', 'weapon2': '0.242', 'AMMO4': '0.306', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.838', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:18,648][52660] DAMAGECOUNT value on done: 790804.0 [2024-08-06 06:49:18,649][52660] Sum rewards: 79.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '64.000'} [2024-08-06 06:49:19,171][52659] DAMAGECOUNT value on done: 793070.0 [2024-08-06 06:49:19,171][52659] Sum rewards: 85.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.126', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.210', 'FRAGCOUNT': '68.000'} [2024-08-06 06:49:19,444][52820] DAMAGECOUNT value on done: 731969.0 [2024-08-06 06:49:19,445][52820] Sum rewards: 80.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.292', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.072', 'AMMO4': '0.182', 'weapon5': '0.210', 'AMMO3': '0.221', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:20,509][52667] DAMAGECOUNT value on done: 799214.0 [2024-08-06 06:49:20,509][52667] Sum rewards: 81.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.567', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.132', 'AMMO4': '0.148', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:21,029][52803] DAMAGECOUNT value on done: 746669.0 [2024-08-06 06:49:21,031][52803] Sum rewards: 75.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:21,474][52660] DAMAGECOUNT value on done: 778823.0 [2024-08-06 06:49:21,476][52660] Sum rewards: 71.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.084', 'AMMO3': '0.168', 'AMMO4': '0.183', 'weapon5': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:21,707][52649] DAMAGECOUNT value on done: 765894.0 [2024-08-06 06:49:21,708][52649] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.527', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.046', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.248', 'WEAPON3': '1.150', 'weapon3': '3.452', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '64.000'} [2024-08-06 06:49:21,735][52795] DAMAGECOUNT value on done: 735163.0 [2024-08-06 06:49:21,736][52795] Sum rewards: 81.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.921', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '69.000'} [2024-08-06 06:49:21,897][52659] DAMAGECOUNT value on done: 797483.0 [2024-08-06 06:49:21,897][52659] Sum rewards: 74.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.476', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.102', 'AMMO3': '0.220', 'weapon5': '0.230', 'weapon2': '0.274', 'AMMO4': '0.297', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.106', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:22,365][52650] Updated weights for policy 0, policy_version 71761 (0.0013) [2024-08-06 06:49:22,523][52820] DAMAGECOUNT value on done: 734750.0 [2024-08-06 06:49:22,523][52820] Sum rewards: 89.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.268', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon4': '0.176', 'weapon5': '0.204', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '22.413', 'FRAGCOUNT': '72.000'} [2024-08-06 06:49:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 587874304. Throughput: 0: 4369.0. Samples: 146973080. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:22,794][52567] Avg episode reward: [(0, '74.449')] [2024-08-06 06:49:23,478][52667] DAMAGECOUNT value on done: 788360.0 [2024-08-06 06:49:23,479][52667] Sum rewards: 62.323, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.390', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.111', 'weapon5': '0.126', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.296', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2024-08-06 06:49:24,229][52803] DAMAGECOUNT value on done: 732994.0 [2024-08-06 06:49:24,231][52803] Sum rewards: 77.312, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.160', 'AMMO4': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:24,603][52660] DAMAGECOUNT value on done: 780509.0 [2024-08-06 06:49:24,606][52660] Sum rewards: 83.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'weapon4': '0.096', 'AMMO4': '0.120', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.820', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:24,728][52659] DAMAGECOUNT value on done: 786810.0 [2024-08-06 06:49:24,728][52659] Sum rewards: 87.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.172', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.038', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.480', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.174', 'FRAGCOUNT': '71.000'} [2024-08-06 06:49:24,877][52649] DAMAGECOUNT value on done: 757711.0 [2024-08-06 06:49:24,878][52649] Sum rewards: 64.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.136', 'weapon4': '0.158', 'AMMO3': '0.215', 'AMMO4': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '55.000'} [2024-08-06 06:49:24,893][52795] DAMAGECOUNT value on done: 732172.0 [2024-08-06 06:49:24,893][52795] Sum rewards: 88.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.499', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.097', 'weapon5': '0.132', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '73.000'} [2024-08-06 06:49:25,179][52794] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:49:25,675][52820] DAMAGECOUNT value on done: 745628.0 [2024-08-06 06:49:25,677][52820] Sum rewards: 90.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.928', 'FRAGCOUNT': '73.000'} [2024-08-06 06:49:26,310][52667] DAMAGECOUNT value on done: 791393.0 [2024-08-06 06:49:26,311][52667] Sum rewards: 73.761, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO3': '0.154', 'AMMO4': '0.157', 'weapon5': '0.174', 'HEALTH': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.326', 'weapon2': '0.584', 'WEAPON3': '0.900', 'weapon3': '2.706', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:26,450][52650] Updated weights for policy 0, policy_version 71771 (0.0016) [2024-08-06 06:49:27,325][52803] DAMAGECOUNT value on done: 735717.0 [2024-08-06 06:49:27,325][52803] Sum rewards: 70.119, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.445', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.072', 'weapon4': '0.076', 'AMMO4': '0.147', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.240', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '57.000'} [2024-08-06 06:49:27,588][52659] DAMAGECOUNT value on done: 795690.0 [2024-08-06 06:49:27,590][52659] Sum rewards: 71.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.240', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.058', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.516', 'WEAPON3': '1.650', 'weapon3': '3.118', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.3, 300 sec: 17439.2). Total num frames: 587956224. Throughput: 0: 4357.8. Samples: 146999080. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:27,794][52567] Avg episode reward: [(0, '74.839')] [2024-08-06 06:49:27,827][52649] DAMAGECOUNT value on done: 776655.0 [2024-08-06 06:49:27,827][52649] Sum rewards: 80.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.096', 'weapon5': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.180', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '69.000'} [2024-08-06 06:49:28,069][52795] DAMAGECOUNT value on done: 722991.0 [2024-08-06 06:49:28,071][52795] Sum rewards: 73.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.196', 'AMMO3': '0.212', 'weapon5': '0.214', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:28,828][52820] DAMAGECOUNT value on done: 743190.0 [2024-08-06 06:49:28,828][52820] Sum rewards: 87.022, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.252', 'weapon4': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '70.000'} [2024-08-06 06:49:29,270][52667] DAMAGECOUNT value on done: 799134.0 [2024-08-06 06:49:29,272][52667] Sum rewards: 77.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.156', 'AMMO4': '0.178', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '66.000'} [2024-08-06 06:49:30,432][52803] DAMAGECOUNT value on done: 738751.0 [2024-08-06 06:49:30,432][52803] Sum rewards: 75.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.138', 'AMMO4': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.350', 'HITCOUNT': '3.550', 'weapon3': '3.662', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '63.000'} [2024-08-06 06:49:30,724][52659] DAMAGECOUNT value on done: 789248.0 [2024-08-06 06:49:30,724][52659] Sum rewards: 76.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.423', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.180', 'weapon5': '0.180', 'AMMO3': '0.196', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '63.000'} [2024-08-06 06:49:31,055][52649] DAMAGECOUNT value on done: 771257.0 [2024-08-06 06:49:31,057][52649] Sum rewards: 77.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.786', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.173', 'weapon5': '0.224', 'AMMO4': '0.228', 'weapon2': '0.244', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:31,314][52795] DAMAGECOUNT value on done: 729972.0 [2024-08-06 06:49:31,317][52795] Sum rewards: 76.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.074', 'AMMO3': '0.192', 'AMMO4': '0.204', 'weapon5': '0.208', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.194', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:31,621][52650] Updated weights for policy 0, policy_version 71781 (0.0012) [2024-08-06 06:49:31,874][52820] DAMAGECOUNT value on done: 726114.0 [2024-08-06 06:49:31,878][52820] Sum rewards: 60.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.455', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.092', 'weapon5': '0.108', 'AMMO4': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '2.962', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '52.000'} [2024-08-06 06:49:32,007][52667] DAMAGECOUNT value on done: 787755.0 [2024-08-06 06:49:32,008][52667] Sum rewards: 75.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.170', 'weapon4': '0.182', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '63.000'} [2024-08-06 06:49:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 588054528. Throughput: 0: 4354.2. Samples: 147012240. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:32,794][52567] Avg episode reward: [(0, '75.074')] [2024-08-06 06:49:33,613][52803] DAMAGECOUNT value on done: 743127.0 [2024-08-06 06:49:33,614][52803] Sum rewards: 90.993, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.264', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.774', 'FRAGCOUNT': '73.000'} [2024-08-06 06:49:33,824][52649] DAMAGECOUNT value on done: 761233.0 [2024-08-06 06:49:33,824][52649] Sum rewards: 79.622, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO2': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon2': '0.182', 'AMMO4': '0.199', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'weapon3': '3.582', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '67.000'} [2024-08-06 06:49:33,903][52659] DAMAGECOUNT value on done: 790285.0 [2024-08-06 06:49:33,905][52659] Sum rewards: 60.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.126', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon4': '0.296', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '50.000'} [2024-08-06 06:49:34,431][52664] DAMAGECOUNT value on done: 816686.0 [2024-08-06 06:49:34,431][52664] Sum rewards: 73.007, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.082', 'AMMO4': '0.092', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '3.174', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '57.000'} [2024-08-06 06:49:34,574][52795] DAMAGECOUNT value on done: 737558.0 [2024-08-06 06:49:34,575][52795] Sum rewards: 68.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.976', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.096', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.250', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.282', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:34,833][52667] DAMAGECOUNT value on done: 794901.0 [2024-08-06 06:49:34,835][52667] Sum rewards: 77.102, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.065', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.896', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '59.000'} [2024-08-06 06:49:36,277][52665] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:49:36,314][52650] Updated weights for policy 0, policy_version 71791 (0.0013) [2024-08-06 06:49:36,602][52803] DAMAGECOUNT value on done: 743511.0 [2024-08-06 06:49:36,604][52803] Sum rewards: 68.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon4': '0.100', 'AMMO3': '0.165', 'weapon5': '0.258', 'AMMO4': '0.319', 'weapon2': '0.336', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '55.000'} [2024-08-06 06:49:36,806][52659] DAMAGECOUNT value on done: 791723.0 [2024-08-06 06:49:36,808][52659] Sum rewards: 68.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.214', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO4': '0.168', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.242', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:36,940][52794] DAMAGECOUNT value on done: 785822.0 [2024-08-06 06:49:36,942][52649] DAMAGECOUNT value on done: 773606.0 [2024-08-06 06:49:36,943][52649] Sum rewards: 52.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.282', 'AMMO5': '0.022', 'AMMO2': '0.078', 'weapon4': '0.228', 'AMMO3': '0.248', 'weapon5': '0.318', 'AMMO4': '0.390', 'weapon2': '0.556', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.400', 'weapon3': '2.606', 'HITCOUNT': '2.660', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '44.000'} [2024-08-06 06:49:36,943][52794] Sum rewards: 66.733, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.864', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.170', 'weapon5': '0.170', 'AMMO3': '0.217', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '55.000'} [2024-08-06 06:49:37,112][52664] DAMAGECOUNT value on done: 822980.0 [2024-08-06 06:49:37,113][52664] Sum rewards: 66.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '57.000'} [2024-08-06 06:49:37,575][52667] DAMAGECOUNT value on done: 800941.0 [2024-08-06 06:49:37,576][52667] Sum rewards: 87.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.377', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.117', 'weapon5': '0.134', 'AMMO3': '0.177', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '69.000'} [2024-08-06 06:49:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17478.0, 300 sec: 17467.0). Total num frames: 588136448. Throughput: 0: 4355.3. Samples: 147038220. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:37,794][52567] Avg episode reward: [(0, '74.862')] [2024-08-06 06:49:39,621][52803] DAMAGECOUNT value on done: 738840.0 [2024-08-06 06:49:39,623][52803] Sum rewards: 70.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.058', 'AMMO4': '0.093', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.000'} [2024-08-06 06:49:39,652][52794] DAMAGECOUNT value on done: 794202.0 [2024-08-06 06:49:39,653][52794] Sum rewards: 71.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.326', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.060', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.500'} [2024-08-06 06:49:39,884][52659] DAMAGECOUNT value on done: 792308.0 [2024-08-06 06:49:39,884][52659] Sum rewards: 78.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.174', 'weapon4': '0.184', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '64.000'} [2024-08-06 06:49:40,018][52649] DAMAGECOUNT value on done: 770661.0 [2024-08-06 06:49:40,020][52649] Sum rewards: 69.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.152', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.044', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.253', 'weapon2': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.474', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '59.000'} [2024-08-06 06:49:40,211][52664] DAMAGECOUNT value on done: 820961.0 [2024-08-06 06:49:40,213][52664] Sum rewards: 83.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.799', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.044', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '70.000'} [2024-08-06 06:49:40,347][52667] DAMAGECOUNT value on done: 798642.0 [2024-08-06 06:49:40,348][52667] Sum rewards: 79.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.174', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.088', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '66.000'} [2024-08-06 06:49:40,897][52650] Updated weights for policy 0, policy_version 71801 (0.0013) [2024-08-06 06:49:42,190][52671] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:49:42,447][52794] DAMAGECOUNT value on done: 797592.0 [2024-08-06 06:49:42,448][52794] Sum rewards: 74.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.012', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 588226560. Throughput: 0: 4349.5. Samples: 147064150. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:42,795][52567] Avg episode reward: [(0, '74.785')] [2024-08-06 06:49:42,917][52659] DAMAGECOUNT value on done: 800165.0 [2024-08-06 06:49:42,917][52659] Sum rewards: 78.750, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.970', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.092', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '3.202', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:42,941][52667] DAMAGECOUNT value on done: 797986.0 [2024-08-06 06:49:42,941][52667] Sum rewards: 70.805, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.380', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.118', 'weapon5': '0.186', 'AMMO3': '0.266', 'AMMO4': '0.283', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.058', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:42,945][52649] DAMAGECOUNT value on done: 773378.0 [2024-08-06 06:49:42,945][52649] Sum rewards: 75.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.905', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.100', 'weapon4': '0.126', 'AMMO4': '0.158', 'AMMO3': '0.197', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '64.500'} [2024-08-06 06:49:43,310][52664] DAMAGECOUNT value on done: 812963.0 [2024-08-06 06:49:43,312][52664] Sum rewards: 63.639, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.150', 'weapon4': '0.166', 'AMMO3': '0.170', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'weapon2': '0.702', 'WEAPON3': '1.000', 'weapon3': '2.906', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.526', 'FRAGCOUNT': '52.000'} [2024-08-06 06:49:45,312][52650] Updated weights for policy 0, policy_version 71811 (0.0038) [2024-08-06 06:49:45,325][52794] DAMAGECOUNT value on done: 784900.0 [2024-08-06 06:49:45,327][52794] Sum rewards: 70.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.968', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.124', 'weapon5': '0.174', 'AMMO3': '0.181', 'AMMO4': '0.195', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '56.000'} [2024-08-06 06:49:45,778][52667] DAMAGECOUNT value on done: 794999.0 [2024-08-06 06:49:45,778][52667] Sum rewards: 74.471, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.682', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.186', 'weapon5': '0.204', 'AMMO4': '0.212', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.846', 'WEAPON3': '1.050', 'weapon3': '2.460', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:45,856][52659] DAMAGECOUNT value on done: 787160.0 [2024-08-06 06:49:45,856][52659] Sum rewards: 65.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.716', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.058', 'AMMO3': '0.197', 'AMMO4': '0.214', 'weapon5': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '53.000'} [2024-08-06 06:49:45,928][52667] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:49:46,035][52649] DAMAGECOUNT value on done: 772206.0 [2024-08-06 06:49:46,037][52649] Sum rewards: 80.843, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.018', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.068', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '67.000'} [2024-08-06 06:49:46,074][52664] DAMAGECOUNT value on done: 827138.0 [2024-08-06 06:49:46,075][52664] Sum rewards: 73.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.710', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.137', 'weapon4': '0.142', 'weapon2': '0.222', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.236', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '63.000'} [2024-08-06 06:49:47,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 588308480. Throughput: 0: 4359.3. Samples: 147077290. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:49:47,795][52567] Avg episode reward: [(0, '74.684')] [2024-08-06 06:49:48,229][52794] DAMAGECOUNT value on done: 783032.0 [2024-08-06 06:49:48,229][52794] Sum rewards: 75.346, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.357', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.136', 'AMMO4': '0.148', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.283', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:48,457][52659] DAMAGECOUNT value on done: 797198.0 [2024-08-06 06:49:48,457][52659] Sum rewards: 75.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.186', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.148', 'weapon4': '0.178', 'AMMO4': '0.205', 'weapon5': '0.206', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.000', 'weapon3': '2.724', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:48,750][52667] DAMAGECOUNT value on done: 800906.0 [2024-08-06 06:49:48,752][52667] Sum rewards: 63.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.128', 'AMMO3': '0.177', 'weapon2': '0.184', 'weapon5': '0.192', 'AMMO4': '0.266', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.980', 'weapon3': '3.244', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '52.000'} [2024-08-06 06:49:48,921][52664] DAMAGECOUNT value on done: 819184.0 [2024-08-06 06:49:48,921][52664] Sum rewards: 67.920, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.380', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon5': '0.170', 'AMMO3': '0.236', 'AMMO4': '0.278', 'weapon4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.750', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '60.000'} [2024-08-06 06:49:49,465][52649] DAMAGECOUNT value on done: 765398.0 [2024-08-06 06:49:49,467][52649] Sum rewards: 64.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.230', 'weapon2': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.118', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '53.000'} [2024-08-06 06:49:50,622][52650] Updated weights for policy 0, policy_version 71821 (0.0023) [2024-08-06 06:49:51,200][52794] DAMAGECOUNT value on done: 788922.0 [2024-08-06 06:49:51,200][52794] Sum rewards: 59.401, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.042', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.066', 'AMMO4': '0.067', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.102', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '49.000'} [2024-08-06 06:49:51,757][52664] DAMAGECOUNT value on done: 814428.0 [2024-08-06 06:49:51,757][52664] Sum rewards: 55.437, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.490', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.048', 'AMMO4': '0.140', 'weapon5': '0.162', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.622', 'WEAPON3': '0.950', 'HITCOUNT': '2.810', 'weapon3': '2.984', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '44.000'} [2024-08-06 06:49:51,806][52659] DAMAGECOUNT value on done: 788257.0 [2024-08-06 06:49:51,806][52659] Sum rewards: 78.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.108', 'weapon5': '0.132', 'AMMO4': '0.191', 'weapon2': '0.196', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '66.000'} [2024-08-06 06:49:51,817][52820] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:49:52,210][52647] DAMAGECOUNT value on done: 841031.0 [2024-08-06 06:49:52,210][52647] Sum rewards: 87.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '74.000'} [2024-08-06 06:49:52,528][52649] DAMAGECOUNT value on done: 777127.0 [2024-08-06 06:49:52,529][52649] Sum rewards: 75.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.822', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.129', 'weapon5': '0.158', 'AMMO3': '0.246', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '62.000'} [2024-08-06 06:49:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 588398592. Throughput: 0: 4355.1. Samples: 147103200. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:49:52,794][52567] Avg episode reward: [(0, '74.195')] [2024-08-06 06:49:53,022][52667] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 06:49:54,590][52794] DAMAGECOUNT value on done: 794818.0 [2024-08-06 06:49:54,590][52794] Sum rewards: 77.972, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.534', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.130', 'AMMO4': '0.143', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '65.000'} [2024-08-06 06:49:54,682][52664] DAMAGECOUNT value on done: 808493.0 [2024-08-06 06:49:54,683][52664] Sum rewards: 70.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.013', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.124', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:54,860][52650] Updated weights for policy 0, policy_version 71831 (0.0032) [2024-08-06 06:49:55,122][52647] DAMAGECOUNT value on done: 830163.0 [2024-08-06 06:49:55,123][52647] Sum rewards: 67.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.110', 'weapon4': '0.134', 'weapon2': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '56.000'} [2024-08-06 06:49:55,360][52649] DAMAGECOUNT value on done: 782820.0 [2024-08-06 06:49:55,363][52649] Sum rewards: 82.913, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.437', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.133', 'weapon5': '0.148', 'WEAPON5': '0.150', 'weapon4': '0.232', 'weapon2': '0.514', 'WEAPON3': '0.850', 'weapon3': '2.952', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '63.000'} [2024-08-06 06:49:57,170][52664] DAMAGECOUNT value on done: 823093.0 [2024-08-06 06:49:57,171][52664] Sum rewards: 74.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.068', 'weapon5': '0.088', 'AMMO4': '0.111', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:57,348][52794] DAMAGECOUNT value on done: 782007.0 [2024-08-06 06:49:57,350][52794] Sum rewards: 75.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.021', 'AMMO2': '0.055', 'AMMO3': '0.181', 'weapon2': '0.210', 'weapon5': '0.248', 'AMMO4': '0.276', 'weapon4': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '61.000'} [2024-08-06 06:49:57,645][52647] DAMAGECOUNT value on done: 835443.0 [2024-08-06 06:49:57,646][52647] Sum rewards: 80.456, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.585', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.054', 'weapon5': '0.208', 'AMMO3': '0.252', 'AMMO4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.550', 'weapon3': '2.916', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '68.000'} [2024-08-06 06:49:57,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 588488704. Throughput: 0: 4346.2. Samples: 147129340. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:49:57,794][52567] Avg episode reward: [(0, '74.274')] [2024-08-06 06:49:57,907][52665] DAMAGECOUNT value on done: 779035.0 [2024-08-06 06:49:57,908][52665] Sum rewards: 70.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.018', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.210', 'weapon5': '0.212', 'weapon2': '0.296', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '58.000'} [2024-08-06 06:49:58,539][52649] DAMAGECOUNT value on done: 778602.0 [2024-08-06 06:49:58,539][52649] Sum rewards: 84.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.234', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.040', 'AMMO4': '0.043', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.312', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.321', 'FRAGCOUNT': '70.000'} [2024-08-06 06:49:59,003][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:49:59,640][52650] Updated weights for policy 0, policy_version 71841 (0.0022) [2024-08-06 06:49:59,749][52664] DAMAGECOUNT value on done: 817407.0 [2024-08-06 06:49:59,750][52664] Sum rewards: 78.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.852', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.062', 'AMMO4': '0.158', 'weapon5': '0.184', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '63.000'} [2024-08-06 06:49:59,967][52647] DAMAGECOUNT value on done: 835290.0 [2024-08-06 06:49:59,968][52647] Sum rewards: 71.662, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.454', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.125', 'weapon5': '0.136', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.292', 'WEAPON3': '1.800', 'weapon3': '3.426', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:00,041][52658] DAMAGECOUNT value on done: 792193.0 [2024-08-06 06:50:00,042][52658] Sum rewards: 80.904, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.979', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.086', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.404', 'WEAPON3': '1.650', 'weapon3': '3.210', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:00,490][52794] DAMAGECOUNT value on done: 793089.0 [2024-08-06 06:50:00,491][52794] Sum rewards: 77.336, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.398', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.170', 'weapon5': '0.170', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.060', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:01,023][52665] DAMAGECOUNT value on done: 793334.0 [2024-08-06 06:50:01,025][52665] Sum rewards: 71.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.775', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.034', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.194', 'weapon4': '0.242', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:01,816][52649] DAMAGECOUNT value on done: 778858.0 [2024-08-06 06:50:01,816][52649] Sum rewards: 71.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.282', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'AMMO4': '0.190', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:02,073][52664] DAMAGECOUNT value on done: 830115.0 [2024-08-06 06:50:02,074][52664] Sum rewards: 82.425, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.469', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.265', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.482', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '70.000'} [2024-08-06 06:50:02,268][52647] DAMAGECOUNT value on done: 841975.0 [2024-08-06 06:50:02,270][52647] Sum rewards: 77.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.455', 'AMMO5': '0.004', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.241', 'weapon2': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '64.000'} [2024-08-06 06:50:02,685][52658] DAMAGECOUNT value on done: 793408.0 [2024-08-06 06:50:02,685][52658] Sum rewards: 67.624, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.252', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO4': '0.163', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 588570624. Throughput: 0: 4352.0. Samples: 147142460. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:50:02,794][52567] Avg episode reward: [(0, '74.313')] [2024-08-06 06:50:03,597][52794] DAMAGECOUNT value on done: 785304.0 [2024-08-06 06:50:03,597][52794] Sum rewards: 65.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.026', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.108', 'weapon5': '0.146', 'AMMO4': '0.176', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.100', 'HITCOUNT': '3.010', 'weapon3': '3.102', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:04,076][52795] Large shaping reward 2.545 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.513, 171.0), ('weapon5', 0.002)] [2024-08-06 06:50:04,129][52670] Large shaping reward 2.583 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.039, -13.0), ('weapon5', 0.002)] [2024-08-06 06:50:04,238][52665] DAMAGECOUNT value on done: 787789.0 [2024-08-06 06:50:04,238][52665] Sum rewards: 71.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.486', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.048', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:04,572][52650] Updated weights for policy 0, policy_version 71851 (0.0034) [2024-08-06 06:50:04,865][52664] DAMAGECOUNT value on done: 824937.0 [2024-08-06 06:50:04,868][52664] Sum rewards: 75.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.027', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.122', 'weapon5': '0.174', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:04,944][52649] DAMAGECOUNT value on done: 768598.0 [2024-08-06 06:50:04,945][52649] Sum rewards: 76.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.624', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.214', 'weapon4': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:04,969][52647] DAMAGECOUNT value on done: 838146.0 [2024-08-06 06:50:04,969][52647] Sum rewards: 74.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.610', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.113', 'weapon5': '0.120', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:05,509][52658] DAMAGECOUNT value on done: 797525.0 [2024-08-06 06:50:05,509][52658] Sum rewards: 84.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.240', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon4': '0.124', 'AMMO3': '0.170', 'weapon2': '0.598', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '68.000'} [2024-08-06 06:50:06,461][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:50:06,465][52794] DAMAGECOUNT value on done: 782467.0 [2024-08-06 06:50:06,465][52794] Sum rewards: 74.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.324', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.144', 'weapon5': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:07,274][52664] DAMAGECOUNT value on done: 824326.0 [2024-08-06 06:50:07,276][52664] Sum rewards: 66.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.730', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon5': '0.154', 'weapon4': '0.188', 'AMMO3': '0.198', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:07,442][52647] DAMAGECOUNT value on done: 841539.0 [2024-08-06 06:50:07,442][52647] Sum rewards: 69.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.205', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.436', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '59.000'} [2024-08-06 06:50:07,543][52665] DAMAGECOUNT value on done: 786152.0 [2024-08-06 06:50:07,547][52665] Sum rewards: 80.594, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.737', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon4': '0.104', 'AMMO4': '0.116', 'AMMO3': '0.136', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.000', 'weapon3': '3.074', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 588660736. Throughput: 0: 4346.2. Samples: 147168660. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:50:07,794][52567] Avg episode reward: [(0, '74.545')] [2024-08-06 06:50:08,090][52658] DAMAGECOUNT value on done: 793159.0 [2024-08-06 06:50:08,092][52658] Sum rewards: 68.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.264', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 06:50:08,234][52649] DAMAGECOUNT value on done: 776281.0 [2024-08-06 06:50:08,237][52649] Sum rewards: 79.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.168', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.122', 'weapon4': '0.186', 'weapon2': '0.212', 'AMMO3': '0.224', 'AMMO4': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:08,985][52650] Updated weights for policy 0, policy_version 71861 (0.0020) [2024-08-06 06:50:09,216][52794] DAMAGECOUNT value on done: 793069.0 [2024-08-06 06:50:09,217][52794] Sum rewards: 77.852, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.754', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.090', 'AMMO4': '0.150', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.498', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:09,934][52664] DAMAGECOUNT value on done: 832904.0 [2024-08-06 06:50:09,936][52664] Sum rewards: 79.270, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.558', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon4': '0.170', 'AMMO3': '0.215', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:10,134][52647] DAMAGECOUNT value on done: 818363.0 [2024-08-06 06:50:10,136][52647] Sum rewards: 56.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.446', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.312', 'WEAPON4': '0.350', 'weapon4': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.796', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '14.901', 'FRAGCOUNT': '45.000'} [2024-08-06 06:50:10,748][52665] DAMAGECOUNT value on done: 771710.0 [2024-08-06 06:50:10,749][52665] Sum rewards: 75.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.842', 'AMMO5': '0.021', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.120', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon5': '0.342', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '60.500'} [2024-08-06 06:50:10,965][52658] DAMAGECOUNT value on done: 787741.0 [2024-08-06 06:50:10,968][52658] Sum rewards: 81.062, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.510', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.044', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'weapon2': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'WEAPON3': '1.850', 'weapon3': '3.470', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '70.000'} [2024-08-06 06:50:11,331][52649] DAMAGECOUNT value on done: 759615.0 [2024-08-06 06:50:11,332][52649] Sum rewards: 65.236, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.437', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.096', 'AMMO4': '0.190', 'weapon2': '0.242', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.342', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '57.000'} [2024-08-06 06:50:12,042][52794] DAMAGECOUNT value on done: 788320.0 [2024-08-06 06:50:12,043][52794] Sum rewards: 59.565, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.552', 'AMMO5': '0.025', 'AMMO2': '0.066', 'weapon4': '0.110', 'weapon5': '0.240', 'AMMO3': '0.292', 'AMMO4': '0.330', 'weapon2': '0.480', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.736', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 588742656. Throughput: 0: 4353.8. Samples: 147195000. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:50:12,794][52567] Avg episode reward: [(0, '74.183')] [2024-08-06 06:50:13,152][52664] DAMAGECOUNT value on done: 833687.0 [2024-08-06 06:50:13,152][52664] Sum rewards: 65.251, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.651', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.146', 'AMMO4': '0.189', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '56.000'} [2024-08-06 06:50:13,304][52663] DAMAGECOUNT value on done: 806263.0 [2024-08-06 06:50:13,305][52663] Sum rewards: 82.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.869', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.400', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:13,329][52647] DAMAGECOUNT value on done: 835959.0 [2024-08-06 06:50:13,330][52647] Sum rewards: 68.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.084', 'AMMO4': '0.140', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.404', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '57.000'} [2024-08-06 06:50:13,547][52650] Updated weights for policy 0, policy_version 71871 (0.0020) [2024-08-06 06:50:13,697][52658] DAMAGECOUNT value on done: 782929.0 [2024-08-06 06:50:13,697][52658] Sum rewards: 74.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.737', 'ARMOR': '0.004', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.124', 'AMMO3': '0.190', 'weapon5': '0.262', 'AMMO4': '0.304', 'weapon2': '0.326', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:13,959][52665] DAMAGECOUNT value on done: 777632.0 [2024-08-06 06:50:13,959][52665] Sum rewards: 84.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.185', 'weapon5': '0.234', 'weapon4': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:14,144][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 06:50:14,512][52649] DAMAGECOUNT value on done: 779252.0 [2024-08-06 06:50:14,512][52649] Sum rewards: 73.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.078', 'weapon5': '0.218', 'AMMO4': '0.237', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:15,148][52794] DAMAGECOUNT value on done: 804599.0 [2024-08-06 06:50:15,149][52794] Sum rewards: 75.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.455', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:15,325][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:50:15,867][52663] DAMAGECOUNT value on done: 793394.0 [2024-08-06 06:50:15,869][52663] Sum rewards: 86.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.977', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.030', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '70.000'} [2024-08-06 06:50:15,997][52664] DAMAGECOUNT value on done: 826724.0 [2024-08-06 06:50:15,997][52664] Sum rewards: 82.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.705', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.161', 'AMMO3': '0.201', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.438', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:16,177][52647] DAMAGECOUNT value on done: 832283.0 [2024-08-06 06:50:16,188][52647] Sum rewards: 83.339, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.192', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.025', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.167', 'weapon2': '0.258', 'WEAPON3': '1.000', 'weapon3': '3.550', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:16,729][52658] DAMAGECOUNT value on done: 796820.0 [2024-08-06 06:50:16,729][52658] Sum rewards: 71.460, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO4': '0.134', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:16,734][52665] DAMAGECOUNT value on done: 781925.0 [2024-08-06 06:50:16,735][52665] Sum rewards: 79.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.066', 'weapon5': '0.148', 'AMMO3': '0.229', 'AMMO4': '0.256', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:16,974][52671] DAMAGECOUNT value on done: 797533.0 [2024-08-06 06:50:16,975][52671] Sum rewards: 92.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.286', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.171', 'weapon5': '0.188', 'AMMO3': '0.253', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.293', 'FRAGCOUNT': '76.000'} [2024-08-06 06:50:17,534][52649] DAMAGECOUNT value on done: 778995.0 [2024-08-06 06:50:17,534][52649] Sum rewards: 62.640, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.725', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.162', 'AMMO4': '0.202', 'AMMO3': '0.234', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:17,616][52669] DAMAGECOUNT value on done: 795000.0 [2024-08-06 06:50:17,617][52669] Sum rewards: 78.213, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.119', 'weapon5': '0.166', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 588832768. Throughput: 0: 4346.7. Samples: 147207840. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:50:17,794][52567] Avg episode reward: [(0, '74.114')] [2024-08-06 06:50:18,087][52794] DAMAGECOUNT value on done: 783325.0 [2024-08-06 06:50:18,087][52794] Sum rewards: 75.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.171', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon4': '0.308', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:18,698][52650] Updated weights for policy 0, policy_version 71881 (0.0014) [2024-08-06 06:50:18,715][52664] DAMAGECOUNT value on done: 815913.0 [2024-08-06 06:50:18,716][52664] Sum rewards: 65.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.115', 'AMMO3': '0.173', 'weapon4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.100', 'HITCOUNT': '3.170', 'weapon3': '3.234', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:18,878][52647] DAMAGECOUNT value on done: 832248.0 [2024-08-06 06:50:18,878][52647] Sum rewards: 77.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.040', 'AMMO4': '0.049', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.227', 'WEAPON3': '1.450', 'weapon3': '3.452', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:18,991][52663] DAMAGECOUNT value on done: 787751.0 [2024-08-06 06:50:18,991][52663] Sum rewards: 83.672, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.138', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO3': '0.179', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.350', 'weapon4': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:19,690][52671] DAMAGECOUNT value on done: 798978.0 [2024-08-06 06:50:19,694][52671] Sum rewards: 63.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.327', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.132', 'weapon4': '0.154', 'AMMO4': '0.184', 'AMMO3': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.970', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:19,711][52658] DAMAGECOUNT value on done: 785101.0 [2024-08-06 06:50:19,711][52658] Sum rewards: 73.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.200', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.114', 'AMMO4': '0.163', 'weapon5': '0.166', 'weapon2': '0.234', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:20,044][52665] DAMAGECOUNT value on done: 781554.0 [2024-08-06 06:50:20,045][52665] Sum rewards: 82.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.766', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.182', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:20,790][52649] DAMAGECOUNT value on done: 768790.0 [2024-08-06 06:50:20,790][52649] Sum rewards: 75.185, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.360', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.158', 'AMMO4': '0.161', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '3.050', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:20,798][52794] DAMAGECOUNT value on done: 800391.0 [2024-08-06 06:50:20,799][52794] Sum rewards: 91.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.374', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.174', 'AMMO3': '0.194', 'weapon5': '0.252', 'AMMO4': '0.252', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.962', 'FRAGCOUNT': '73.000'} [2024-08-06 06:50:20,855][52669] DAMAGECOUNT value on done: 784347.0 [2024-08-06 06:50:20,855][52669] Sum rewards: 67.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.594', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:21,700][52664] DAMAGECOUNT value on done: 820464.0 [2024-08-06 06:50:21,702][52664] Sum rewards: 85.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.110', 'weapon5': '0.172', 'AMMO3': '0.229', 'AMMO4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '69.000'} [2024-08-06 06:50:21,767][52647] DAMAGECOUNT value on done: 822798.0 [2024-08-06 06:50:21,767][52647] Sum rewards: 69.468, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.052', 'AMMO4': '0.082', 'weapon5': '0.138', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.984', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:22,167][52663] DAMAGECOUNT value on done: 789709.0 [2024-08-06 06:50:22,167][52663] Sum rewards: 62.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.706', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.246', 'weapon5': '0.248', 'AMMO3': '0.284', 'AMMO4': '0.306', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.718', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:22,593][52658] DAMAGECOUNT value on done: 810632.0 [2024-08-06 06:50:22,593][52658] Sum rewards: 79.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.154', 'AMMO3': '0.202', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:22,693][52665] DAMAGECOUNT value on done: 789166.0 [2024-08-06 06:50:22,694][52665] Sum rewards: 72.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.305', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.142', 'weapon5': '0.156', 'AMMO4': '0.176', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.650', 'weapon3': '2.986', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '62.500'} [2024-08-06 06:50:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 588922880. Throughput: 0: 4354.0. Samples: 147234150. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:50:22,794][52567] Avg episode reward: [(0, '74.027')] [2024-08-06 06:50:22,830][52671] DAMAGECOUNT value on done: 795336.0 [2024-08-06 06:50:22,830][52671] Sum rewards: 78.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.568', 'WEAPON3': '1.050', 'weapon3': '3.140', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:23,285][52650] Updated weights for policy 0, policy_version 71891 (0.0018) [2024-08-06 06:50:23,518][52794] DAMAGECOUNT value on done: 794887.0 [2024-08-06 06:50:23,519][52794] Sum rewards: 79.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.164', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:23,837][52669] DAMAGECOUNT value on done: 798924.0 [2024-08-06 06:50:23,837][52669] Sum rewards: 70.670, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.580', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.146', 'weapon5': '0.168', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.301', 'WEAPON3': '1.850', 'weapon3': '3.192', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:24,681][52664] DAMAGECOUNT value on done: 822385.0 [2024-08-06 06:50:24,691][52664] Sum rewards: 73.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.715', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.102', 'AMMO3': '0.160', 'AMMO4': '0.185', 'weapon4': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.028', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:24,723][52647] DAMAGECOUNT value on done: 839734.0 [2024-08-06 06:50:24,724][52647] Sum rewards: 72.866, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.056', 'AMMO4': '0.154', 'weapon5': '0.178', 'AMMO3': '0.228', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '60.500'} [2024-08-06 06:50:24,956][52663] DAMAGECOUNT value on done: 792751.0 [2024-08-06 06:50:24,956][52663] Sum rewards: 84.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.620', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.044', 'AMMO4': '0.104', 'AMMO3': '0.190', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:25,472][52671] DAMAGECOUNT value on done: 799007.0 [2024-08-06 06:50:25,473][52671] Sum rewards: 75.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.031', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.056', 'weapon4': '0.058', 'AMMO3': '0.205', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '64.000'} [2024-08-06 06:50:25,514][52658] DAMAGECOUNT value on done: 795029.0 [2024-08-06 06:50:25,515][52658] Sum rewards: 69.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.696', 'AMMO5': '0.015', 'AMMO2': '0.067', 'weapon4': '0.078', 'weapon5': '0.196', 'AMMO3': '0.226', 'AMMO4': '0.333', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '57.500'} [2024-08-06 06:50:25,726][52665] DAMAGECOUNT value on done: 780590.0 [2024-08-06 06:50:25,726][52665] Sum rewards: 76.442, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.562', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.106', 'weapon5': '0.170', 'AMMO4': '0.229', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '63.500'} [2024-08-06 06:50:26,573][52794] DAMAGECOUNT value on done: 795666.0 [2024-08-06 06:50:26,576][52794] Sum rewards: 75.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.126', 'AMMO4': '0.219', 'weapon2': '0.226', 'weapon5': '0.246', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:26,761][52669] DAMAGECOUNT value on done: 792278.0 [2024-08-06 06:50:26,764][52669] Sum rewards: 69.318, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.360', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.124', 'weapon5': '0.198', 'AMMO3': '0.276', 'AMMO4': '0.280', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '59.000'} [2024-08-06 06:50:27,582][52664] DAMAGECOUNT value on done: 819096.0 [2024-08-06 06:50:27,589][52664] Sum rewards: 74.489, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.834', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.152', 'weapon5': '0.202', 'AMMO3': '0.217', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:27,666][52647] DAMAGECOUNT value on done: 827153.0 [2024-08-06 06:50:27,667][52647] Sum rewards: 75.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.288', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.162', 'AMMO3': '0.264', 'AMMO4': '0.270', 'weapon5': '0.278', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 589004800. Throughput: 0: 4354.7. Samples: 147260110. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:50:27,794][52567] Avg episode reward: [(0, '74.359')] [2024-08-06 06:50:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071900_589004800.pth... [2024-08-06 06:50:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071390_584826880.pth [2024-08-06 06:50:28,056][52650] Updated weights for policy 0, policy_version 71901 (0.0020) [2024-08-06 06:50:28,100][52663] DAMAGECOUNT value on done: 798723.0 [2024-08-06 06:50:28,102][52663] Sum rewards: 72.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.917', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.152', 'AMMO3': '0.193', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '59.000'} [2024-08-06 06:50:28,158][52671] DAMAGECOUNT value on done: 806533.0 [2024-08-06 06:50:28,158][52671] Sum rewards: 70.601, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.921', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.104', 'AMMO4': '0.163', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:28,623][52658] DAMAGECOUNT value on done: 804599.0 [2024-08-06 06:50:28,625][52658] Sum rewards: 87.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.411', 'FRAGCOUNT': '72.000'} [2024-08-06 06:50:28,974][52665] DAMAGECOUNT value on done: 791029.0 [2024-08-06 06:50:28,975][52665] Sum rewards: 76.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.105', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:29,120][52794] DAMAGECOUNT value on done: 804571.0 [2024-08-06 06:50:29,120][52794] Sum rewards: 70.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.618', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.156', 'AMMO4': '0.157', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.650', 'weapon3': '3.074', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:29,855][52669] DAMAGECOUNT value on done: 796060.0 [2024-08-06 06:50:29,856][52669] Sum rewards: 76.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.863', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.060', 'weapon5': '0.174', 'AMMO3': '0.224', 'AMMO4': '0.231', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '64.000'} [2024-08-06 06:50:30,474][52647] DAMAGECOUNT value on done: 835325.0 [2024-08-06 06:50:30,475][52647] Sum rewards: 74.947, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.144', 'AMMO4': '0.165', 'AMMO3': '0.187', 'WEAPON5': '0.250', 'weapon4': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:30,758][52663] DAMAGECOUNT value on done: 788304.0 [2024-08-06 06:50:30,759][52663] Sum rewards: 81.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.140', 'weapon5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '70.000'} [2024-08-06 06:50:31,524][52671] DAMAGECOUNT value on done: 796759.0 [2024-08-06 06:50:31,524][52671] Sum rewards: 57.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.979', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.062', 'AMMO4': '0.160', 'weapon5': '0.172', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.250', 'HITCOUNT': '2.810', 'weapon3': '3.148', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '48.000'} [2024-08-06 06:50:31,833][52665] DAMAGECOUNT value on done: 788462.0 [2024-08-06 06:50:31,833][52665] Sum rewards: 77.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.765', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.099', 'weapon5': '0.140', 'WEAPON4': '0.150', 'weapon2': '0.154', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.410', 'weapon3': '3.468', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '64.000'} [2024-08-06 06:50:31,845][52794] DAMAGECOUNT value on done: 795113.0 [2024-08-06 06:50:31,845][52794] Sum rewards: 78.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.930', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.112', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.356', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:32,000][52658] DAMAGECOUNT value on done: 792921.0 [2024-08-06 06:50:32,000][52658] Sum rewards: 76.220, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.674', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.277', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:32,286][52669] DAMAGECOUNT value on done: 794656.0 [2024-08-06 06:50:32,286][52669] Sum rewards: 66.898, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.364', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.092', 'AMMO4': '0.219', 'weapon5': '0.260', 'AMMO3': '0.264', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '56.000'} [2024-08-06 06:50:32,740][52650] Updated weights for policy 0, policy_version 71911 (0.0011) [2024-08-06 06:50:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 589094912. Throughput: 0: 4349.6. Samples: 147273020. Policy #0 lag: (min: 0.0, avg: 4.5, max: 9.0) [2024-08-06 06:50:32,794][52567] Avg episode reward: [(0, '74.610')] [2024-08-06 06:50:33,449][52647] DAMAGECOUNT value on done: 836525.0 [2024-08-06 06:50:33,450][52647] Sum rewards: 74.151, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.168', 'AMMO4': '0.201', 'AMMO3': '0.235', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:33,536][52663] DAMAGECOUNT value on done: 780759.0 [2024-08-06 06:50:33,540][52663] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.760', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.244', 'WEAPON3': '1.600', 'weapon3': '3.394', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:34,398][52658] DAMAGECOUNT value on done: 797910.0 [2024-08-06 06:50:34,399][52658] Sum rewards: 75.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO5': '0.021', 'AMMO2': '0.037', 'AMMO3': '0.175', 'AMMO4': '0.187', 'weapon5': '0.328', 'weapon4': '0.404', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.530', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:34,603][52671] DAMAGECOUNT value on done: 799819.0 [2024-08-06 06:50:34,606][52671] Sum rewards: 72.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.658', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.270', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:34,745][52665] DAMAGECOUNT value on done: 782789.0 [2024-08-06 06:50:34,745][52665] Sum rewards: 72.762, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.611', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:35,382][52669] DAMAGECOUNT value on done: 795157.0 [2024-08-06 06:50:35,382][52669] Sum rewards: 71.967, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.654', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.205', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '59.000'} [2024-08-06 06:50:36,376][52663] DAMAGECOUNT value on done: 784453.0 [2024-08-06 06:50:36,378][52663] Sum rewards: 68.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.091', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.136', 'AMMO3': '0.161', 'AMMO4': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.310', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:36,590][52647] DAMAGECOUNT value on done: 824176.0 [2024-08-06 06:50:36,590][52647] Sum rewards: 80.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.058', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon4': '0.026', 'AMMO4': '0.101', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:37,078][52658] DAMAGECOUNT value on done: 789120.0 [2024-08-06 06:50:37,080][52658] Sum rewards: 80.596, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.698', 'AMMO2': '0.003', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO3': '0.157', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '64.000'} [2024-08-06 06:50:37,372][52650] Updated weights for policy 0, policy_version 71921 (0.0012) [2024-08-06 06:50:37,403][52665] DAMAGECOUNT value on done: 785111.0 [2024-08-06 06:50:37,403][52665] Sum rewards: 81.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.057', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.068', 'AMMO4': '0.092', 'weapon5': '0.094', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:37,442][52671] DAMAGECOUNT value on done: 797684.0 [2024-08-06 06:50:37,442][52671] Sum rewards: 62.076, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.340', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.311', 'weapon2': '0.378', 'WEAPON3': '1.850', 'HITCOUNT': '3.170', 'weapon3': '3.224', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '56.000'} [2024-08-06 06:50:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 589185024. Throughput: 0: 4351.6. Samples: 147299020. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:50:37,794][52567] Avg episode reward: [(0, '74.902')] [2024-08-06 06:50:38,252][52669] DAMAGECOUNT value on done: 795473.0 [2024-08-06 06:50:38,254][52669] Sum rewards: 68.134, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.970', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.164', 'AMMO4': '0.215', 'weapon5': '0.220', 'weapon2': '0.272', 'AMMO3': '0.279', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 06:50:39,407][52647] DAMAGECOUNT value on done: 827874.0 [2024-08-06 06:50:39,409][52647] Sum rewards: 66.828, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.905', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.144', 'weapon4': '0.210', 'AMMO4': '0.223', 'AMMO3': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '57.000'} [2024-08-06 06:50:39,746][52663] DAMAGECOUNT value on done: 788412.0 [2024-08-06 06:50:39,746][52663] Sum rewards: 74.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.515', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.370', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:39,897][52658] DAMAGECOUNT value on done: 798866.0 [2024-08-06 06:50:39,898][52658] Sum rewards: 77.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.425', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.144', 'AMMO3': '0.217', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.427', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:40,163][52670] DAMAGECOUNT value on done: 781278.0 [2024-08-06 06:50:40,164][52670] Sum rewards: 64.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.989', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.830', 'WEAPON3': '1.050', 'weapon3': '2.724', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '14.877', 'FRAGCOUNT': '52.500'} [2024-08-06 06:50:40,238][52671] DAMAGECOUNT value on done: 785706.0 [2024-08-06 06:50:40,239][52671] Sum rewards: 57.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.168', 'weapon5': '0.170', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.948', 'DAMAGECOUNT': '14.550', 'FRAGCOUNT': '47.000'} [2024-08-06 06:50:40,267][52665] DAMAGECOUNT value on done: 780436.0 [2024-08-06 06:50:40,267][52665] Sum rewards: 78.846, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.130', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:40,770][52660] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2024-08-06 06:50:41,443][52669] DAMAGECOUNT value on done: 804763.0 [2024-08-06 06:50:41,445][52669] Sum rewards: 64.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.294', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.104', 'AMMO4': '0.153', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.116', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '53.000'} [2024-08-06 06:50:42,071][52650] Updated weights for policy 0, policy_version 71931 (0.0011) [2024-08-06 06:50:42,527][52658] DAMAGECOUNT value on done: 778608.0 [2024-08-06 06:50:42,528][52658] Sum rewards: 63.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.128', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.062', 'AMMO4': '0.166', 'weapon5': '0.168', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.264', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '53.000'} [2024-08-06 06:50:42,563][52647] DAMAGECOUNT value on done: 818986.0 [2024-08-06 06:50:42,564][52647] Sum rewards: 81.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.911', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.182', 'AMMO3': '0.201', 'AMMO4': '0.241', 'weapon4': '0.338', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.744', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:42,679][52663] DAMAGECOUNT value on done: 798706.0 [2024-08-06 06:50:42,679][52663] Sum rewards: 76.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.728', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:42,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 589266944. Throughput: 0: 4351.3. Samples: 147325150. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:50:42,795][52567] Avg episode reward: [(0, '74.257')] [2024-08-06 06:50:42,917][52665] DAMAGECOUNT value on done: 785847.0 [2024-08-06 06:50:42,918][52665] Sum rewards: 91.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.686', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon2': '0.194', 'weapon4': '0.202', 'AMMO3': '0.212', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.890', 'FRAGCOUNT': '74.000'} [2024-08-06 06:50:43,122][52670] DAMAGECOUNT value on done: 794529.0 [2024-08-06 06:50:43,122][52670] Sum rewards: 70.656, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.693', 'AMMO5': '0.026', 'AMMO2': '0.059', 'weapon4': '0.162', 'AMMO3': '0.283', 'AMMO4': '0.296', 'weapon5': '0.308', 'weapon2': '0.620', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.700', 'weapon3': '2.512', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:43,123][52671] DAMAGECOUNT value on done: 797518.0 [2024-08-06 06:50:43,123][52671] Sum rewards: 77.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.907', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.066', 'weapon5': '0.122', 'AMMO3': '0.222', 'AMMO4': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:43,695][52666] DAMAGECOUNT value on done: 791537.0 [2024-08-06 06:50:43,698][52666] Sum rewards: 67.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.176', 'weapon5': '0.210', 'weapon4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:44,540][52669] DAMAGECOUNT value on done: 797545.0 [2024-08-06 06:50:44,542][52669] Sum rewards: 68.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.058', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.144', 'weapon5': '0.168', 'weapon2': '0.226', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:45,334][52658] DAMAGECOUNT value on done: 798255.0 [2024-08-06 06:50:45,342][52658] Sum rewards: 68.471, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.257', 'weapon2': '0.428', 'WEAPON3': '1.600', 'HITCOUNT': '3.220', 'weapon3': '3.292', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:45,674][52647] DAMAGECOUNT value on done: 825447.0 [2024-08-06 06:50:45,674][52647] Sum rewards: 74.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon4': '0.080', 'weapon5': '0.118', 'WEAPON4': '0.150', 'weapon2': '0.234', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:45,726][52663] DAMAGECOUNT value on done: 781850.0 [2024-08-06 06:50:45,728][52663] Sum rewards: 65.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.264', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.080', 'weapon5': '0.094', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.450', 'HITCOUNT': '2.920', 'weapon3': '3.272', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '56.000'} [2024-08-06 06:50:46,032][52671] DAMAGECOUNT value on done: 796833.0 [2024-08-06 06:50:46,032][52671] Sum rewards: 78.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.122', 'weapon2': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.300', 'weapon3': '3.572', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:46,083][52665] DAMAGECOUNT value on done: 785144.0 [2024-08-06 06:50:46,085][52665] Sum rewards: 72.263, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.841', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.121', 'AMMO3': '0.176', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '59.000'} [2024-08-06 06:50:46,157][52670] DAMAGECOUNT value on done: 780149.0 [2024-08-06 06:50:46,158][52670] Sum rewards: 63.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.245', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.074', 'AMMO4': '0.162', 'AMMO3': '0.170', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '3.222', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '52.000'} [2024-08-06 06:50:46,891][52666] DAMAGECOUNT value on done: 787452.0 [2024-08-06 06:50:46,891][52666] Sum rewards: 71.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.098', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:46,966][52650] Updated weights for policy 0, policy_version 71941 (0.0037) [2024-08-06 06:50:47,268][52666] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:50:47,648][52669] DAMAGECOUNT value on done: 799230.0 [2024-08-06 06:50:47,649][52669] Sum rewards: 73.256, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'HEALTH': '0.161', 'weapon5': '0.164', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.276', 'weapon4': '0.318', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:47,700][52658] DAMAGECOUNT value on done: 789288.0 [2024-08-06 06:50:47,701][52658] Sum rewards: 87.848, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.755', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.108', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '75.000'} [2024-08-06 06:50:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17439.3). Total num frames: 589357056. Throughput: 0: 4350.2. Samples: 147338220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:50:47,794][52567] Avg episode reward: [(0, '74.222')] [2024-08-06 06:50:48,956][52663] DAMAGECOUNT value on done: 776914.0 [2024-08-06 06:50:48,956][52663] Sum rewards: 69.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO2': '0.036', 'weapon2': '0.166', 'AMMO4': '0.178', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON3': '1.200', 'weapon3': '3.490', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:49,134][52671] DAMAGECOUNT value on done: 792289.0 [2024-08-06 06:50:49,134][52671] Sum rewards: 65.813, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.138', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.131', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'weapon2': '0.660', 'WEAPON3': '0.800', 'weapon3': '2.832', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '13.338', 'FRAGCOUNT': '52.000'} [2024-08-06 06:50:49,159][52665] DAMAGECOUNT value on done: 777416.0 [2024-08-06 06:50:49,160][52665] Sum rewards: 77.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.883', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.218', 'weapon2': '0.222', 'weapon5': '0.226', 'AMMO3': '0.239', 'AMMO4': '0.252', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '64.000'} [2024-08-06 06:50:49,333][52670] DAMAGECOUNT value on done: 780615.0 [2024-08-06 06:50:49,335][52670] Sum rewards: 67.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.042', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'AMMO4': '0.209', 'weapon2': '0.342', 'weapon4': '0.424', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:49,825][52658] DAMAGECOUNT value on done: 787267.0 [2024-08-06 06:50:49,825][52658] Sum rewards: 80.386, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.080', 'HEALTH': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.296', 'WEAPON3': '0.950', 'weapon3': '3.372', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:49,876][52666] DAMAGECOUNT value on done: 790217.0 [2024-08-06 06:50:49,878][52666] Sum rewards: 67.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.175', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.098', 'weapon5': '0.164', 'AMMO3': '0.206', 'AMMO4': '0.228', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '56.000'} [2024-08-06 06:50:50,600][52669] DAMAGECOUNT value on done: 804532.0 [2024-08-06 06:50:50,601][52669] Sum rewards: 72.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.058', 'AMMO5': '0.007', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO4': '0.123', 'AMMO3': '0.165', 'weapon4': '0.198', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.236', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.500'} [2024-08-06 06:50:51,503][52663] DAMAGECOUNT value on done: 786465.0 [2024-08-06 06:50:51,504][52663] Sum rewards: 76.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon4': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.228', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.516', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:51,752][52650] Updated weights for policy 0, policy_version 71951 (0.0018) [2024-08-06 06:50:52,250][52671] DAMAGECOUNT value on done: 803173.0 [2024-08-06 06:50:52,250][52671] Sum rewards: 66.611, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.232', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.110', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:52,304][52665] DAMAGECOUNT value on done: 780384.0 [2024-08-06 06:50:52,304][52665] Sum rewards: 73.422, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.168', 'weapon2': '0.498', 'HEALTH': '0.750', 'WEAPON3': '0.900', 'weapon3': '3.396', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '57.000'} [2024-08-06 06:50:52,429][52670] DAMAGECOUNT value on done: 793697.0 [2024-08-06 06:50:52,431][52670] Sum rewards: 76.029, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.081', 'AMMO5': '0.022', 'AMMO2': '0.065', 'weapon5': '0.212', 'AMMO3': '0.214', 'weapon4': '0.220', 'weapon2': '0.296', 'AMMO4': '0.323', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '63.000'} [2024-08-06 06:50:52,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 589447168. Throughput: 0: 4360.5. Samples: 147364880. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:50:52,794][52567] Avg episode reward: [(0, '74.268')] [2024-08-06 06:50:52,865][52658] DAMAGECOUNT value on done: 795107.0 [2024-08-06 06:50:52,866][52658] Sum rewards: 75.112, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.472', 'AMMO5': '0.027', 'AMMO2': '0.064', 'weapon4': '0.094', 'weapon5': '0.174', 'weapon2': '0.234', 'AMMO3': '0.265', 'AMMO4': '0.319', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '65.000'} [2024-08-06 06:50:52,997][52666] DAMAGECOUNT value on done: 789835.0 [2024-08-06 06:50:53,002][52666] Sum rewards: 69.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.334', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.122', 'weapon4': '0.124', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '58.000'} [2024-08-06 06:50:53,119][52669] DAMAGECOUNT value on done: 788385.0 [2024-08-06 06:50:53,119][52669] Sum rewards: 81.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.258', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.086', 'AMMO3': '0.197', 'weapon5': '0.198', 'AMMO4': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '66.000'} [2024-08-06 06:50:54,031][52663] DAMAGECOUNT value on done: 785237.0 [2024-08-06 06:50:54,032][52663] Sum rewards: 75.813, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.129', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.156', 'AMMO3': '0.183', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.364', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:55,162][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:50:55,486][52670] DAMAGECOUNT value on done: 784953.0 [2024-08-06 06:50:55,486][52670] Sum rewards: 66.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.024', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.176', 'weapon4': '0.194', 'AMMO4': '0.220', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.674', 'WEAPON3': '1.350', 'weapon3': '2.700', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '55.000'} [2024-08-06 06:50:55,559][52665] DAMAGECOUNT value on done: 785957.0 [2024-08-06 06:50:55,561][52665] Sum rewards: 62.571, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.320', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.156', 'weapon5': '0.224', 'AMMO4': '0.283', 'AMMO3': '0.289', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.756', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '53.500'} [2024-08-06 06:50:55,623][52671] DAMAGECOUNT value on done: 796515.0 [2024-08-06 06:50:55,627][52671] Sum rewards: 66.336, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.865', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.134', 'AMMO4': '0.235', 'weapon5': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.554', 'weapon4': '0.596', 'WEAPON3': '0.850', 'weapon3': '2.310', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '49.500'} [2024-08-06 06:50:55,707][52669] DAMAGECOUNT value on done: 789154.0 [2024-08-06 06:50:55,708][52669] Sum rewards: 70.743, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.140', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:55,801][52650] Updated weights for policy 0, policy_version 71961 (0.0032) [2024-08-06 06:50:56,183][52666] DAMAGECOUNT value on done: 782613.0 [2024-08-06 06:50:56,183][52666] Sum rewards: 62.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.359', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.148', 'AMMO3': '0.163', 'weapon5': '0.188', 'AMMO4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.728', 'WEAPON3': '1.000', 'HITCOUNT': '2.580', 'weapon3': '2.694', 'DAMAGECOUNT': '14.175', 'FRAGCOUNT': '50.000'} [2024-08-06 06:50:57,083][52663] DAMAGECOUNT value on done: 797567.0 [2024-08-06 06:50:57,087][52663] Sum rewards: 71.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.906', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.166', 'AMMO3': '0.176', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '60.000'} [2024-08-06 06:50:57,218][52668] DAMAGECOUNT value on done: 796801.0 [2024-08-06 06:50:57,218][52668] Sum rewards: 74.114, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.144', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.202', 'AMMO4': '0.229', 'weapon5': '0.260', 'AMMO3': '0.267', 'weapon2': '0.290', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.898', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '62.000'} [2024-08-06 06:50:57,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 589520896. Throughput: 0: 4352.6. Samples: 147390870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:50:57,795][52567] Avg episode reward: [(0, '73.377')] [2024-08-06 06:50:57,949][52614] Signal inference workers to stop experience collection... (13150 times) [2024-08-06 06:50:57,968][52614] Signal inference workers to resume experience collection... (13150 times) [2024-08-06 06:50:58,030][52650] InferenceWorker_p0-w0: stopping experience collection (13150 times) [2024-08-06 06:50:58,030][52650] InferenceWorker_p0-w0: resuming experience collection (13150 times) [2024-08-06 06:50:58,234][52671] DAMAGECOUNT value on done: 783937.0 [2024-08-06 06:50:58,234][52671] Sum rewards: 66.993, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.170', 'weapon4': '0.196', 'AMMO4': '0.218', 'weapon5': '0.226', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '54.000'} [2024-08-06 06:50:58,533][52670] DAMAGECOUNT value on done: 778743.0 [2024-08-06 06:50:58,533][52670] Sum rewards: 70.065, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.056', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.072', 'weapon5': '0.166', 'AMMO4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 06:50:58,774][52669] DAMAGECOUNT value on done: 796356.0 [2024-08-06 06:50:58,776][52669] Sum rewards: 75.791, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.765', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon5': '0.084', 'AMMO4': '0.255', 'AMMO3': '0.284', 'weapon2': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '67.000'} [2024-08-06 06:50:59,015][52666] DAMAGECOUNT value on done: 789799.0 [2024-08-06 06:50:59,019][52666] Sum rewards: 87.988, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.130', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.122', 'AMMO4': '0.146', 'weapon5': '0.162', 'weapon2': '0.270', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.140', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.945', 'FRAGCOUNT': '75.000'} [2024-08-06 06:51:00,072][52663] DAMAGECOUNT value on done: 788323.0 [2024-08-06 06:51:00,072][52663] Sum rewards: 60.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.932', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.056', 'weapon5': '0.098', 'AMMO3': '0.200', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.362', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '51.000'} [2024-08-06 06:51:00,082][52668] DAMAGECOUNT value on done: 799996.0 [2024-08-06 06:51:00,083][52668] Sum rewards: 63.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.885', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon2': '0.142', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.243', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.498', 'DAMAGECOUNT': '15.159', 'FRAGCOUNT': '55.000'} [2024-08-06 06:51:00,882][52650] Updated weights for policy 0, policy_version 71971 (0.0017) [2024-08-06 06:51:01,295][52670] DAMAGECOUNT value on done: 782775.0 [2024-08-06 06:51:01,297][52670] Sum rewards: 72.739, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.620', 'AMMO2': '0.008', 'AMMO4': '0.042', 'AMMO3': '0.238', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:01,384][52671] DAMAGECOUNT value on done: 804673.0 [2024-08-06 06:51:01,385][52671] Sum rewards: 77.118, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.264', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon4': '0.138', 'AMMO3': '0.272', 'weapon5': '0.296', 'weapon2': '0.322', 'AMMO4': '0.325', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.830', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '64.000'} [2024-08-06 06:51:01,794][52669] DAMAGECOUNT value on done: 816517.0 [2024-08-06 06:51:01,796][52669] Sum rewards: 72.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.176', 'AMMO3': '0.194', 'weapon4': '0.230', 'AMMO4': '0.281', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '60.000'} [2024-08-06 06:51:01,869][52666] DAMAGECOUNT value on done: 784434.0 [2024-08-06 06:51:01,871][52666] Sum rewards: 59.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.738', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.118', 'AMMO4': '0.211', 'AMMO3': '0.216', 'weapon5': '0.260', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.480', 'weapon3': '2.934', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '49.000'} [2024-08-06 06:51:02,264][52670] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.06, -20.0), ('weapon5', 0.002)] [2024-08-06 06:51:02,586][52668] DAMAGECOUNT value on done: 796680.0 [2024-08-06 06:51:02,587][52668] Sum rewards: 77.350, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.544', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.118', 'AMMO4': '0.148', 'AMMO3': '0.169', 'weapon4': '0.246', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 589619200. Throughput: 0: 4352.7. Samples: 147403710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:51:02,794][52567] Avg episode reward: [(0, '72.857')] [2024-08-06 06:51:03,184][52663] DAMAGECOUNT value on done: 793879.0 [2024-08-06 06:51:03,184][52663] Sum rewards: 86.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.897', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.185', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '70.000'} [2024-08-06 06:51:04,193][52670] DAMAGECOUNT value on done: 784658.0 [2024-08-06 06:51:04,193][52670] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.688', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.052', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '60.000'} [2024-08-06 06:51:04,589][52669] DAMAGECOUNT value on done: 803676.0 [2024-08-06 06:51:04,590][52669] Sum rewards: 72.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.302', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.076', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:04,616][52671] DAMAGECOUNT value on done: 802538.0 [2024-08-06 06:51:04,617][52671] Sum rewards: 82.244, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.878', 'AMMO5': '0.023', 'AMMO2': '0.046', 'AMMO3': '0.221', 'AMMO4': '0.230', 'weapon4': '0.288', 'weapon2': '0.294', 'weapon5': '0.302', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '68.000'} [2024-08-06 06:51:04,628][52666] DAMAGECOUNT value on done: 779102.0 [2024-08-06 06:51:04,629][52666] Sum rewards: 73.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.814', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.213', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:05,336][52650] Updated weights for policy 0, policy_version 71981 (0.0022) [2024-08-06 06:51:05,429][52668] DAMAGECOUNT value on done: 802780.0 [2024-08-06 06:51:05,431][52668] Sum rewards: 77.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.676', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.140', 'AMMO4': '0.190', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '64.000'} [2024-08-06 06:51:05,671][52663] DAMAGECOUNT value on done: 799472.0 [2024-08-06 06:51:05,671][52663] Sum rewards: 83.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.292', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.036', 'weapon4': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.318', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '69.000'} [2024-08-06 06:51:07,033][52669] DAMAGECOUNT value on done: 797738.0 [2024-08-06 06:51:07,034][52669] Sum rewards: 70.228, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.248', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.171', 'weapon5': '0.254', 'AMMO4': '0.267', 'weapon2': '0.356', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'weapon4': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.290', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '56.000'} [2024-08-06 06:51:07,338][52670] DAMAGECOUNT value on done: 779140.0 [2024-08-06 06:51:07,338][52670] Sum rewards: 71.837, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.315', 'AMMO5': '0.016', 'AMMO2': '0.070', 'weapon4': '0.160', 'weapon5': '0.250', 'weapon2': '0.266', 'AMMO3': '0.298', 'AMMO4': '0.349', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.990', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:07,484][52671] DAMAGECOUNT value on done: 798576.0 [2024-08-06 06:51:07,486][52671] Sum rewards: 76.031, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.138', 'AMMO4': '0.146', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.300', 'weapon3': '3.348', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:07,754][52666] DAMAGECOUNT value on done: 788508.0 [2024-08-06 06:51:07,754][52666] Sum rewards: 75.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.154', 'weapon5': '0.168', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:07,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 589709312. Throughput: 0: 4352.0. Samples: 147429990. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:51:07,794][52567] Avg episode reward: [(0, '73.114')] [2024-08-06 06:51:08,364][52663] DAMAGECOUNT value on done: 785012.0 [2024-08-06 06:51:08,364][52663] Sum rewards: 76.030, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.336', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.186', 'weapon5': '0.210', 'AMMO3': '0.244', 'AMMO4': '0.245', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '65.000'} [2024-08-06 06:51:08,370][52668] DAMAGECOUNT value on done: 785640.0 [2024-08-06 06:51:08,370][52668] Sum rewards: 82.165, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.480', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '65.000'} [2024-08-06 06:51:09,985][52669] DAMAGECOUNT value on done: 802698.0 [2024-08-06 06:51:09,987][52669] Sum rewards: 85.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '69.000'} [2024-08-06 06:51:10,098][52650] Updated weights for policy 0, policy_version 71991 (0.0014) [2024-08-06 06:51:10,295][52670] DAMAGECOUNT value on done: 791067.0 [2024-08-06 06:51:10,298][52670] Sum rewards: 60.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.464', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.048', 'weapon5': '0.066', 'AMMO4': '0.077', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.862', 'WEAPON3': '1.500', 'weapon3': '2.756', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '53.000'} [2024-08-06 06:51:10,360][52671] DAMAGECOUNT value on done: 803056.0 [2024-08-06 06:51:10,361][52671] Sum rewards: 73.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.925', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:10,874][52666] DAMAGECOUNT value on done: 781838.0 [2024-08-06 06:51:10,876][52666] Sum rewards: 66.696, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.158', 'HEALTH': '0.160', 'weapon4': '0.262', 'weapon2': '0.608', 'WEAPON3': '0.900', 'weapon3': '2.760', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '52.000'} [2024-08-06 06:51:11,089][52668] DAMAGECOUNT value on done: 798025.0 [2024-08-06 06:51:11,090][52668] Sum rewards: 77.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.326', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.140', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon5': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 589791232. Throughput: 0: 4357.5. Samples: 147456200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:51:12,795][52567] Avg episode reward: [(0, '73.091')] [2024-08-06 06:51:12,815][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:51:12,833][52669] DAMAGECOUNT value on done: 805789.0 [2024-08-06 06:51:12,834][52669] Sum rewards: 66.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.388', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '56.000'} [2024-08-06 06:51:13,248][52671] DAMAGECOUNT value on done: 790901.0 [2024-08-06 06:51:13,248][52671] Sum rewards: 64.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.096', 'AMMO4': '0.195', 'weapon2': '0.216', 'weapon5': '0.226', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.122', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '56.000'} [2024-08-06 06:51:13,370][52670] DAMAGECOUNT value on done: 774484.0 [2024-08-06 06:51:13,371][52670] Sum rewards: 63.601, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.690', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.060', 'AMMO3': '0.146', 'weapon5': '0.180', 'AMMO4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.684', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '2.894', 'DAMAGECOUNT': '14.655', 'FRAGCOUNT': '51.000'} [2024-08-06 06:51:13,757][52666] DAMAGECOUNT value on done: 789162.0 [2024-08-06 06:51:13,757][52666] Sum rewards: 64.825, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.173', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.130', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.282', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.190', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '55.000'} [2024-08-06 06:51:13,994][52668] DAMAGECOUNT value on done: 798048.0 [2024-08-06 06:51:13,994][52668] Sum rewards: 74.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.015', 'AMMO2': '0.067', 'AMMO3': '0.172', 'weapon5': '0.200', 'weapon4': '0.264', 'weapon2': '0.322', 'AMMO4': '0.337', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '60.000'} [2024-08-06 06:51:15,387][52650] Updated weights for policy 0, policy_version 72001 (0.0041) [2024-08-06 06:51:16,210][52811] DAMAGECOUNT value on done: 755404.0 [2024-08-06 06:51:16,212][52811] Sum rewards: 86.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.090', 'weapon4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '71.000'} [2024-08-06 06:51:16,287][52670] DAMAGECOUNT value on done: 786303.0 [2024-08-06 06:51:16,288][52670] Sum rewards: 71.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.537', 'AMMO5': '0.009', 'weapon4': '0.034', 'AMMO2': '0.049', 'weapon5': '0.166', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.344', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '60.000'} [2024-08-06 06:51:16,714][52668] DAMAGECOUNT value on done: 789241.0 [2024-08-06 06:51:16,715][52668] Sum rewards: 79.964, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.995', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.114', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '66.000'} [2024-08-06 06:51:16,805][52666] DAMAGECOUNT value on done: 777154.0 [2024-08-06 06:51:16,805][52666] Sum rewards: 77.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.676', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.022', 'AMMO2': '0.029', 'weapon5': '0.068', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '64.000'} [2024-08-06 06:51:16,851][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:51:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 589873152. Throughput: 0: 4360.2. Samples: 147469230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:51:17,794][52567] Avg episode reward: [(0, '72.896')] [2024-08-06 06:51:18,485][52662] DAMAGECOUNT value on done: 793105.0 [2024-08-06 06:51:18,485][52662] Sum rewards: 74.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.384', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.199', 'weapon2': '0.364', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.408', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:19,264][52811] DAMAGECOUNT value on done: 738685.0 [2024-08-06 06:51:19,264][52811] Sum rewards: 74.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.259', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.108', 'AMMO4': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:19,306][52670] DAMAGECOUNT value on done: 794930.0 [2024-08-06 06:51:19,308][52670] Sum rewards: 77.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.056', 'AMMO4': '0.175', 'weapon5': '0.186', 'AMMO3': '0.249', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '65.000'} [2024-08-06 06:51:19,440][52650] Updated weights for policy 0, policy_version 72011 (0.0013) [2024-08-06 06:51:19,604][52668] DAMAGECOUNT value on done: 789596.0 [2024-08-06 06:51:19,604][52668] Sum rewards: 80.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.435', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.039', 'weapon5': '0.144', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.229', 'WEAPON3': '1.500', 'weapon3': '3.376', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '67.000'} [2024-08-06 06:51:19,822][52666] DAMAGECOUNT value on done: 791819.0 [2024-08-06 06:51:19,822][52666] Sum rewards: 90.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.138', 'AMMO4': '0.188', 'weapon2': '0.230', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.314', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '76.000'} [2024-08-06 06:51:21,086][52662] DAMAGECOUNT value on done: 802427.0 [2024-08-06 06:51:21,092][52662] Sum rewards: 76.804, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.562', 'AMMO5': '0.024', 'AMMO2': '0.059', 'AMMO3': '0.185', 'weapon2': '0.246', 'weapon5': '0.290', 'weapon4': '0.296', 'AMMO4': '0.297', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:22,088][52670] DAMAGECOUNT value on done: 787584.0 [2024-08-06 06:51:22,089][52670] Sum rewards: 77.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.582', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.426', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '64.000'} [2024-08-06 06:51:22,424][52666] DAMAGECOUNT value on done: 786254.0 [2024-08-06 06:51:22,426][52666] Sum rewards: 82.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.448', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.092', 'AMMO3': '0.225', 'weapon5': '0.278', 'AMMO4': '0.301', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '65.000'} [2024-08-06 06:51:22,654][52811] DAMAGECOUNT value on done: 733211.0 [2024-08-06 06:51:22,654][52811] Sum rewards: 63.553, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.874', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.136', 'AMMO3': '0.194', 'weapon5': '0.234', 'AMMO4': '0.287', 'weapon2': '0.394', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '53.000'} [2024-08-06 06:51:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 589963264. Throughput: 0: 4363.3. Samples: 147495370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:22,794][52567] Avg episode reward: [(0, '73.187')] [2024-08-06 06:51:22,898][52668] DAMAGECOUNT value on done: 798322.0 [2024-08-06 06:51:22,899][52668] Sum rewards: 73.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.124', 'AMMO4': '0.158', 'weapon5': '0.172', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:24,072][52650] Updated weights for policy 0, policy_version 72021 (0.0023) [2024-08-06 06:51:24,281][52662] DAMAGECOUNT value on done: 804893.0 [2024-08-06 06:51:24,282][52662] Sum rewards: 70.744, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.060', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.178', 'WEAPON4': '0.200', 'HEALTH': '0.202', 'AMMO3': '0.219', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '58.000'} [2024-08-06 06:51:24,382][52664] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:51:25,112][52670] DAMAGECOUNT value on done: 768343.0 [2024-08-06 06:51:25,113][52670] Sum rewards: 60.272, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.190', 'AMMO5': '0.020', 'AMMO2': '0.067', 'weapon4': '0.242', 'weapon5': '0.252', 'AMMO3': '0.265', 'AMMO4': '0.334', 'weapon2': '0.378', 'WEAPON5': '0.650', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.746', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '54.000'} [2024-08-06 06:51:25,597][52666] DAMAGECOUNT value on done: 785797.0 [2024-08-06 06:51:25,598][52666] Sum rewards: 73.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.198', 'weapon4': '0.202', 'weapon2': '0.220', 'AMMO3': '0.230', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:25,658][52668] DAMAGECOUNT value on done: 792032.0 [2024-08-06 06:51:25,660][52668] Sum rewards: 75.935, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.224', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:25,870][52811] DAMAGECOUNT value on done: 735614.0 [2024-08-06 06:51:25,872][52811] Sum rewards: 75.893, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.282', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.152', 'weapon2': '0.160', 'AMMO4': '0.203', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '60.000'} [2024-08-06 06:51:27,599][52662] DAMAGECOUNT value on done: 787841.0 [2024-08-06 06:51:27,599][52662] Sum rewards: 75.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.106', 'weapon4': '0.168', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.734', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 590053376. Throughput: 0: 4363.8. Samples: 147521520. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:27,794][52567] Avg episode reward: [(0, '73.111')] [2024-08-06 06:51:28,107][52670] DAMAGECOUNT value on done: 783339.0 [2024-08-06 06:51:28,109][52670] Sum rewards: 76.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.855', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.100', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '64.000'} [2024-08-06 06:51:28,510][52666] DAMAGECOUNT value on done: 782756.0 [2024-08-06 06:51:28,512][52666] Sum rewards: 92.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.370', 'WEAPON3': '1.600', 'weapon3': '3.258', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.275', 'FRAGCOUNT': '77.000'} [2024-08-06 06:51:28,728][52668] DAMAGECOUNT value on done: 786282.0 [2024-08-06 06:51:28,731][52668] Sum rewards: 69.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.040', 'weapon5': '0.136', 'AMMO4': '0.197', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '58.000'} [2024-08-06 06:51:28,966][52811] DAMAGECOUNT value on done: 741213.0 [2024-08-06 06:51:28,966][52811] Sum rewards: 73.643, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.502', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.203', 'AMMO4': '0.234', 'weapon4': '0.250', 'weapon5': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '59.500'} [2024-08-06 06:51:29,145][52650] Updated weights for policy 0, policy_version 72031 (0.0032) [2024-08-06 06:51:30,508][52662] DAMAGECOUNT value on done: 804919.0 [2024-08-06 06:51:30,509][52662] Sum rewards: 71.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.830', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.592', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:31,123][52670] DAMAGECOUNT value on done: 791934.0 [2024-08-06 06:51:31,123][52670] Sum rewards: 88.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.895', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'AMMO4': '0.208', 'weapon4': '0.264', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '69.000'} [2024-08-06 06:51:31,391][52666] DAMAGECOUNT value on done: 782723.0 [2024-08-06 06:51:31,391][52666] Sum rewards: 71.616, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.669', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.171', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.274', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.058', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:31,576][52668] DAMAGECOUNT value on done: 781732.0 [2024-08-06 06:51:31,578][52668] Sum rewards: 69.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.758', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.064', 'weapon5': '0.076', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.382', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '56.000'} [2024-08-06 06:51:32,090][52811] DAMAGECOUNT value on done: 751259.0 [2024-08-06 06:51:32,090][52811] Sum rewards: 73.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.026', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.090', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 590143488. Throughput: 0: 4365.8. Samples: 147534680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:32,794][52567] Avg episode reward: [(0, '73.693')] [2024-08-06 06:51:32,930][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:51:33,516][52662] DAMAGECOUNT value on done: 787760.0 [2024-08-06 06:51:33,541][52662] Sum rewards: 70.795, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.772', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.086', 'weapon5': '0.136', 'weapon2': '0.238', 'AMMO4': '0.248', 'AMMO3': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.236', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:33,600][52650] Updated weights for policy 0, policy_version 72041 (0.0044) [2024-08-06 06:51:33,638][52795] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:51:33,865][52670] DAMAGECOUNT value on done: 788037.0 [2024-08-06 06:51:33,866][52670] Sum rewards: 69.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.090', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.114', 'weapon5': '0.144', 'AMMO3': '0.200', 'AMMO4': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '59.000'} [2024-08-06 06:51:34,298][52666] DAMAGECOUNT value on done: 797991.0 [2024-08-06 06:51:34,300][52666] Sum rewards: 70.923, reward structure: {'DEATHCOUNT': '-12.000', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO3': '0.134', 'AMMO4': '0.212', 'weapon5': '0.270', 'weapon2': '0.314', 'HEALTH': '0.314', 'WEAPON5': '0.350', 'weapon4': '0.394', 'WEAPON4': '0.500', 'WEAPON3': '0.800', 'weapon3': '2.766', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '57.000'} [2024-08-06 06:51:34,325][52668] DAMAGECOUNT value on done: 783184.0 [2024-08-06 06:51:34,325][52668] Sum rewards: 75.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.044', 'AMMO4': '0.180', 'AMMO3': '0.200', 'weapon5': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.946', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:35,199][52811] DAMAGECOUNT value on done: 746551.0 [2024-08-06 06:51:35,201][52811] Sum rewards: 71.042, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.890', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.162', 'AMMO4': '0.173', 'AMMO3': '0.234', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '60.000'} [2024-08-06 06:51:36,230][52662] DAMAGECOUNT value on done: 793250.0 [2024-08-06 06:51:36,230][52662] Sum rewards: 80.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.144', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.146', 'AMMO4': '0.148', 'AMMO3': '0.218', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '67.000'} [2024-08-06 06:51:37,482][52670] DAMAGECOUNT value on done: 790738.0 [2024-08-06 06:51:37,484][52670] Sum rewards: 88.739, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO2': '0.003', 'AMMO5': '0.007', 'AMMO4': '0.015', 'weapon5': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '72.000'} [2024-08-06 06:51:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 590217216. Throughput: 0: 4332.4. Samples: 147559840. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:37,794][52567] Avg episode reward: [(0, '73.754')] [2024-08-06 06:51:37,919][52666] DAMAGECOUNT value on done: 775572.0 [2024-08-06 06:51:37,920][52666] Sum rewards: 82.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '67.000'} [2024-08-06 06:51:37,928][52668] DAMAGECOUNT value on done: 779689.0 [2024-08-06 06:51:37,929][52668] Sum rewards: 75.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.252', 'weapon5': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '62.000'} [2024-08-06 06:51:38,523][52650] Updated weights for policy 0, policy_version 72051 (0.0020) [2024-08-06 06:51:38,651][52811] DAMAGECOUNT value on done: 738231.0 [2024-08-06 06:51:38,651][52811] Sum rewards: 74.529, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.307', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.192', 'weapon2': '0.208', 'AMMO3': '0.251', 'AMMO4': '0.266', 'weapon4': '0.338', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:39,123][52662] DAMAGECOUNT value on done: 809412.0 [2024-08-06 06:51:39,124][52662] Sum rewards: 78.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.080', 'weapon4': '0.160', 'AMMO4': '0.161', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '3.096', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:39,722][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:51:40,128][52663] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:51:40,778][52660] DAMAGECOUNT value on done: 792228.0 [2024-08-06 06:51:40,778][52660] Sum rewards: 65.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.084', 'weapon5': '0.166', 'AMMO4': '0.205', 'AMMO3': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '58.000'} [2024-08-06 06:51:40,778][52666] DAMAGECOUNT value on done: 785119.0 [2024-08-06 06:51:40,779][52666] Sum rewards: 73.854, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon5': '0.114', 'AMMO3': '0.183', 'weapon4': '0.234', 'weapon2': '0.240', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '59.000'} [2024-08-06 06:51:41,885][52668] DAMAGECOUNT value on done: 792789.0 [2024-08-06 06:51:41,886][52668] Sum rewards: 88.653, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.938', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.074', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.260', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '72.000'} [2024-08-06 06:51:42,176][52811] DAMAGECOUNT value on done: 747162.0 [2024-08-06 06:51:42,180][52811] Sum rewards: 65.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.107', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.098', 'weapon5': '0.178', 'AMMO3': '0.239', 'AMMO4': '0.278', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '56.000'} [2024-08-06 06:51:42,766][52662] DAMAGECOUNT value on done: 795451.0 [2024-08-06 06:51:42,767][52662] Sum rewards: 72.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.787', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon2': '0.220', 'weapon5': '0.224', 'AMMO3': '0.282', 'weapon4': '0.306', 'AMMO4': '0.325', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.956', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:42,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17203.3, 300 sec: 17383.7). Total num frames: 590299136. Throughput: 0: 4288.7. Samples: 147583860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:42,794][52567] Avg episode reward: [(0, '73.935')] [2024-08-06 06:51:43,604][52660] DAMAGECOUNT value on done: 783709.0 [2024-08-06 06:51:43,604][52660] Sum rewards: 87.163, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.789', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.187', 'AMMO3': '0.207', 'weapon2': '0.212', 'weapon5': '0.226', 'weapon4': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '71.000'} [2024-08-06 06:51:43,901][52650] Updated weights for policy 0, policy_version 72061 (0.0013) [2024-08-06 06:51:44,567][52668] DAMAGECOUNT value on done: 795267.0 [2024-08-06 06:51:44,567][52668] Sum rewards: 76.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.120', 'AMMO4': '0.167', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:45,261][52811] DAMAGECOUNT value on done: 743309.0 [2024-08-06 06:51:45,261][52811] Sum rewards: 78.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.378', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '64.000'} [2024-08-06 06:51:45,478][52662] DAMAGECOUNT value on done: 801193.0 [2024-08-06 06:51:45,478][52662] Sum rewards: 78.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.108', 'AMMO4': '0.179', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '67.000'} [2024-08-06 06:51:46,404][52660] DAMAGECOUNT value on done: 796889.0 [2024-08-06 06:51:46,405][52660] Sum rewards: 76.737, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.424', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.128', 'AMMO4': '0.177', 'weapon2': '0.258', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '67.000'} [2024-08-06 06:51:47,317][52668] DAMAGECOUNT value on done: 791461.0 [2024-08-06 06:51:47,326][52668] Sum rewards: 82.733, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.470', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO3': '0.104', 'AMMO4': '0.131', 'weapon4': '0.172', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '2.826', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '65.000'} [2024-08-06 06:51:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 590389248. Throughput: 0: 4292.4. Samples: 147596870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:47,795][52567] Avg episode reward: [(0, '74.450')] [2024-08-06 06:51:48,332][52811] DAMAGECOUNT value on done: 747843.0 [2024-08-06 06:51:48,335][52811] Sum rewards: 79.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.102', 'AMMO3': '0.176', 'weapon5': '0.222', 'AMMO4': '0.253', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '63.000'} [2024-08-06 06:51:48,472][52650] Updated weights for policy 0, policy_version 72071 (0.0024) [2024-08-06 06:51:48,484][52662] DAMAGECOUNT value on done: 791337.0 [2024-08-06 06:51:48,484][52662] Sum rewards: 69.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.491', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.066', 'weapon5': '0.110', 'AMMO4': '0.210', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '57.000'} [2024-08-06 06:51:49,233][52660] DAMAGECOUNT value on done: 806583.0 [2024-08-06 06:51:49,234][52660] Sum rewards: 81.506, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.560', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon2': '0.184', 'AMMO3': '0.293', 'WEAPON3': '1.850', 'weapon3': '3.588', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '72.000'} [2024-08-06 06:51:49,958][52668] DAMAGECOUNT value on done: 799208.0 [2024-08-06 06:51:49,963][52668] Sum rewards: 83.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.417', 'AMMO5': '0.009', 'weapon4': '0.034', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '68.500'} [2024-08-06 06:51:51,200][52662] DAMAGECOUNT value on done: 795477.0 [2024-08-06 06:51:51,203][52662] Sum rewards: 70.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.144', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.192', 'weapon5': '0.222', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2024-08-06 06:51:51,481][52811] DAMAGECOUNT value on done: 752575.0 [2024-08-06 06:51:51,482][52811] Sum rewards: 79.100, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'HEALTH': '0.252', 'weapon2': '0.356', 'WEAPON3': '0.950', 'HITCOUNT': '3.410', 'weapon3': '3.438', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '61.000'} [2024-08-06 06:51:51,872][52660] DAMAGECOUNT value on done: 788636.0 [2024-08-06 06:51:51,872][52660] Sum rewards: 77.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.179', 'AMMO3': '0.232', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '65.500'} [2024-08-06 06:51:52,696][52668] DAMAGECOUNT value on done: 796341.0 [2024-08-06 06:51:52,699][52668] Sum rewards: 80.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.327', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.187', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '64.000'} [2024-08-06 06:51:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 590479360. Throughput: 0: 4286.9. Samples: 147622900. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:52,794][52567] Avg episode reward: [(0, '74.720')] [2024-08-06 06:51:53,107][52650] Updated weights for policy 0, policy_version 72081 (0.0022) [2024-08-06 06:51:54,454][52662] DAMAGECOUNT value on done: 787265.0 [2024-08-06 06:51:54,454][52662] Sum rewards: 80.340, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.112', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.346', 'HEALTH': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '65.000'} [2024-08-06 06:51:54,489][52660] DAMAGECOUNT value on done: 783938.0 [2024-08-06 06:51:54,491][52660] Sum rewards: 87.445, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.055', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.744', 'FRAGCOUNT': '72.000'} [2024-08-06 06:51:54,504][52811] DAMAGECOUNT value on done: 744604.0 [2024-08-06 06:51:54,504][52811] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon4': '0.290', 'weapon5': '0.344', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '57.000'} [2024-08-06 06:51:57,101][52660] DAMAGECOUNT value on done: 792664.0 [2024-08-06 06:51:57,103][52660] Sum rewards: 71.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.297', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.088', 'AMMO4': '0.155', 'weapon5': '0.166', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 06:51:57,431][52662] DAMAGECOUNT value on done: 799318.0 [2024-08-06 06:51:57,432][52662] Sum rewards: 68.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.128', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.506', 'WEAPON3': '1.600', 'weapon3': '3.228', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '59.000'} [2024-08-06 06:51:57,614][52811] DAMAGECOUNT value on done: 741752.0 [2024-08-06 06:51:57,615][52811] Sum rewards: 64.785, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.680', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.166', 'AMMO4': '0.178', 'weapon5': '0.188', 'AMMO3': '0.315', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '2.948', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '60.000'} [2024-08-06 06:51:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17383.7). Total num frames: 590561280. Throughput: 0: 4290.0. Samples: 147649250. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:51:57,794][52567] Avg episode reward: [(0, '75.136')] [2024-08-06 06:51:57,981][52650] Updated weights for policy 0, policy_version 72091 (0.0021) [2024-08-06 06:51:58,849][52820] DAMAGECOUNT value on done: 735481.0 [2024-08-06 06:51:58,849][52820] Sum rewards: 66.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.384', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.130', 'weapon5': '0.242', 'AMMO3': '0.245', 'AMMO4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '2.926', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '55.000'} [2024-08-06 06:52:00,344][52662] DAMAGECOUNT value on done: 786316.0 [2024-08-06 06:52:00,346][52662] Sum rewards: 69.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.080', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.058', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.238', 'WEAPON3': '1.250', 'HITCOUNT': '3.440', 'weapon3': '3.454', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '58.000'} [2024-08-06 06:52:00,516][52660] DAMAGECOUNT value on done: 799428.0 [2024-08-06 06:52:00,517][52660] Sum rewards: 73.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.665', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.216', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.482', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '61.000'} [2024-08-06 06:52:00,533][52665] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:52:00,704][52811] DAMAGECOUNT value on done: 740556.0 [2024-08-06 06:52:00,704][52811] Sum rewards: 77.197, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.715', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'weapon2': '0.588', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '61.000'} [2024-08-06 06:52:01,936][52820] DAMAGECOUNT value on done: 737054.0 [2024-08-06 06:52:01,937][52820] Sum rewards: 65.587, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.307', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.074', 'weapon4': '0.076', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.228', 'WEAPON4': '0.250', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'weapon3': '3.370', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:02,256][52795] DAMAGECOUNT value on done: 738939.0 [2024-08-06 06:52:02,257][52795] Sum rewards: 66.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.196', 'weapon4': '0.256', 'weapon2': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '53.000'} [2024-08-06 06:52:02,687][52650] Updated weights for policy 0, policy_version 72101 (0.0013) [2024-08-06 06:52:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 590651392. Throughput: 0: 4292.7. Samples: 147662400. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 06:52:02,794][52567] Avg episode reward: [(0, '74.969')] [2024-08-06 06:52:03,162][52662] DAMAGECOUNT value on done: 804128.0 [2024-08-06 06:52:03,162][52662] Sum rewards: 75.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.142', 'AMMO4': '0.153', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '62.000'} [2024-08-06 06:52:03,339][52660] DAMAGECOUNT value on done: 785076.0 [2024-08-06 06:52:03,339][52660] Sum rewards: 83.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.056', 'AMMO4': '0.089', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '68.000'} [2024-08-06 06:52:03,792][52811] DAMAGECOUNT value on done: 742161.0 [2024-08-06 06:52:03,793][52811] Sum rewards: 69.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.915', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.130', 'weapon4': '0.136', 'AMMO3': '0.181', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.702', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '56.000'} [2024-08-06 06:52:04,542][52667] DAMAGECOUNT value on done: 793141.0 [2024-08-06 06:52:04,544][52667] Sum rewards: 59.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.546', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.122', 'DAMAGECOUNT': '14.262', 'FRAGCOUNT': '50.000'} [2024-08-06 06:52:05,202][52820] DAMAGECOUNT value on done: 736622.0 [2024-08-06 06:52:05,204][52820] Sum rewards: 74.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.488', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '62.000'} [2024-08-06 06:52:05,474][52795] DAMAGECOUNT value on done: 725314.0 [2024-08-06 06:52:05,475][52795] Sum rewards: 62.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.022', 'AMMO2': '0.068', 'weapon2': '0.210', 'AMMO3': '0.288', 'weapon5': '0.318', 'AMMO4': '0.340', 'weapon4': '0.350', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'HITCOUNT': '2.740', 'weapon3': '2.750', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '54.000'} [2024-08-06 06:52:05,822][52660] DAMAGECOUNT value on done: 786745.0 [2024-08-06 06:52:05,823][52660] Sum rewards: 61.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.146', 'AMMO3': '0.184', 'AMMO4': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.174', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '50.000'} [2024-08-06 06:52:06,381][52662] DAMAGECOUNT value on done: 796488.0 [2024-08-06 06:52:06,381][52662] Sum rewards: 74.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.233', 'weapon2': '0.258', 'weapon5': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '62.000'} [2024-08-06 06:52:06,488][52803] DAMAGECOUNT value on done: 737862.0 [2024-08-06 06:52:06,488][52803] Sum rewards: 69.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.134', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'weapon2': '0.622', 'WEAPON3': '1.650', 'weapon3': '2.886', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:06,901][52811] DAMAGECOUNT value on done: 747361.0 [2024-08-06 06:52:06,901][52811] Sum rewards: 66.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.675', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.080', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '56.000'} [2024-08-06 06:52:07,006][52659] DAMAGECOUNT value on done: 797273.0 [2024-08-06 06:52:07,007][52659] Sum rewards: 77.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.025', 'AMMO2': '0.010', 'AMMO5': '0.011', 'weapon4': '0.014', 'AMMO4': '0.048', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon2': '0.186', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.536', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '64.000'} [2024-08-06 06:52:07,473][52650] Updated weights for policy 0, policy_version 72111 (0.0014) [2024-08-06 06:52:07,685][52667] DAMAGECOUNT value on done: 802422.0 [2024-08-06 06:52:07,687][52667] Sum rewards: 83.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.201', 'weapon4': '0.232', 'weapon5': '0.264', 'AMMO4': '0.279', 'weapon2': '0.280', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17066.6, 300 sec: 17355.9). Total num frames: 590733312. Throughput: 0: 4294.9. Samples: 147688640. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:07,795][52567] Avg episode reward: [(0, '74.664')] [2024-08-06 06:52:08,315][52820] DAMAGECOUNT value on done: 727329.0 [2024-08-06 06:52:08,315][52820] Sum rewards: 71.340, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.164', 'AMMO4': '0.183', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:08,321][52660] DAMAGECOUNT value on done: 794566.0 [2024-08-06 06:52:08,323][52660] Sum rewards: 81.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.114', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.634', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:08,681][52795] DAMAGECOUNT value on done: 730084.0 [2024-08-06 06:52:08,683][52795] Sum rewards: 84.754, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.262', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.086', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.252', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.459', 'FRAGCOUNT': '72.000'} [2024-08-06 06:52:09,409][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:52:09,511][52662] DAMAGECOUNT value on done: 781358.0 [2024-08-06 06:52:09,514][52662] Sum rewards: 62.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.536', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.088', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '2.780', 'weapon3': '3.298', 'DAMAGECOUNT': '14.469', 'FRAGCOUNT': '51.000'} [2024-08-06 06:52:09,559][52803] DAMAGECOUNT value on done: 737443.0 [2024-08-06 06:52:09,561][52803] Sum rewards: 76.510, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.730', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.398', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '66.000'} [2024-08-06 06:52:09,935][52811] DAMAGECOUNT value on done: 750935.0 [2024-08-06 06:52:09,936][52811] Sum rewards: 81.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '69.000'} [2024-08-06 06:52:10,107][52659] DAMAGECOUNT value on done: 794477.0 [2024-08-06 06:52:10,108][52659] Sum rewards: 58.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.676', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.160', 'AMMO3': '0.202', 'weapon5': '0.254', 'AMMO4': '0.269', 'weapon2': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.690', 'weapon3': '2.962', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '48.000'} [2024-08-06 06:52:10,565][52667] DAMAGECOUNT value on done: 798325.0 [2024-08-06 06:52:10,566][52667] Sum rewards: 70.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.224', 'weapon2': '0.710', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:10,833][52660] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:52:11,116][52660] DAMAGECOUNT value on done: 787262.0 [2024-08-06 06:52:11,116][52660] Sum rewards: 91.569, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.743', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.097', 'weapon5': '0.142', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.242', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '73.000'} [2024-08-06 06:52:11,568][52650] Updated weights for policy 0, policy_version 72121 (0.0024) [2024-08-06 06:52:11,608][52820] DAMAGECOUNT value on done: 740107.0 [2024-08-06 06:52:11,609][52820] Sum rewards: 71.917, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.746', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.060', 'weapon5': '0.178', 'AMMO4': '0.213', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:11,816][52795] DAMAGECOUNT value on done: 738249.0 [2024-08-06 06:52:11,817][52795] Sum rewards: 75.260, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.180', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.168', 'weapon5': '0.168', 'AMMO4': '0.267', 'AMMO3': '0.301', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.946', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '66.000'} [2024-08-06 06:52:12,693][52803] DAMAGECOUNT value on done: 743163.0 [2024-08-06 06:52:12,694][52803] Sum rewards: 67.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.029', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.183', 'weapon2': '0.298', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.390', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '55.000'} [2024-08-06 06:52:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 590823424. Throughput: 0: 4296.7. Samples: 147714870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:12,794][52567] Avg episode reward: [(0, '74.599')] [2024-08-06 06:52:12,874][52662] DAMAGECOUNT value on done: 794561.0 [2024-08-06 06:52:12,875][52662] Sum rewards: 69.859, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.160', 'weapon4': '0.186', 'weapon2': '0.274', 'AMMO4': '0.276', 'weapon5': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '56.000'} [2024-08-06 06:52:12,887][52667] DAMAGECOUNT value on done: 804319.0 [2024-08-06 06:52:12,888][52667] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:12,921][52811] DAMAGECOUNT value on done: 741565.0 [2024-08-06 06:52:12,922][52811] Sum rewards: 67.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'AMMO3': '0.193', 'weapon4': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '54.000'} [2024-08-06 06:52:13,120][52659] DAMAGECOUNT value on done: 799366.0 [2024-08-06 06:52:13,121][52659] Sum rewards: 76.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.092', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:14,270][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:52:14,615][52659] Large shaping reward 2.562 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.069, -23.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:52:14,797][52660] DAMAGECOUNT value on done: 792262.0 [2024-08-06 06:52:14,797][52660] Sum rewards: 78.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.156', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.142', 'weapon4': '0.148', 'AMMO4': '0.183', 'weapon2': '0.226', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '68.000'} [2024-08-06 06:52:14,818][52820] DAMAGECOUNT value on done: 724820.0 [2024-08-06 06:52:14,820][52820] Sum rewards: 75.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.512', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon2': '0.164', 'weapon5': '0.172', 'weapon4': '0.194', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.238', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '61.000'} [2024-08-06 06:52:15,031][52795] DAMAGECOUNT value on done: 727223.0 [2024-08-06 06:52:15,032][52795] Sum rewards: 72.061, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.025', 'weapon4': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '1.004', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '57.000'} [2024-08-06 06:52:15,687][52659] DAMAGECOUNT value on done: 796184.0 [2024-08-06 06:52:15,687][52659] Sum rewards: 80.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.192', 'weapon5': '0.206', 'AMMO4': '0.273', 'weapon2': '0.324', 'WEAPON5': '0.400', 'weapon4': '0.424', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.732', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '66.000'} [2024-08-06 06:52:15,726][52803] DAMAGECOUNT value on done: 742353.0 [2024-08-06 06:52:15,726][52803] Sum rewards: 74.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.957', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon5': '0.116', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.296', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:15,847][52662] DAMAGECOUNT value on done: 785614.0 [2024-08-06 06:52:15,848][52662] Sum rewards: 73.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.165', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.140', 'AMMO4': '0.150', 'weapon2': '0.160', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.446', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:15,849][52667] DAMAGECOUNT value on done: 806208.0 [2024-08-06 06:52:15,850][52667] Sum rewards: 59.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.340', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.172', 'weapon5': '0.172', 'weapon4': '0.284', 'AMMO4': '0.305', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '48.000'} [2024-08-06 06:52:16,032][52811] DAMAGECOUNT value on done: 743699.0 [2024-08-06 06:52:16,032][52811] Sum rewards: 76.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.252', 'AMMO5': '0.013', 'AMMO2': '0.070', 'weapon5': '0.198', 'weapon4': '0.212', 'AMMO3': '0.240', 'AMMO4': '0.348', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:16,855][52650] Updated weights for policy 0, policy_version 72131 (0.0037) [2024-08-06 06:52:17,722][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:52:17,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 590921728. Throughput: 0: 4294.4. Samples: 147727930. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:17,794][52567] Avg episode reward: [(0, '74.618')] [2024-08-06 06:52:17,827][52820] DAMAGECOUNT value on done: 732244.0 [2024-08-06 06:52:17,827][52820] Sum rewards: 77.460, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.838', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon4': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.238', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '66.000'} [2024-08-06 06:52:17,961][52660] DAMAGECOUNT value on done: 802889.0 [2024-08-06 06:52:17,962][52660] Sum rewards: 73.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.358', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '61.000'} [2024-08-06 06:52:18,235][52795] DAMAGECOUNT value on done: 733751.0 [2024-08-06 06:52:18,237][52795] Sum rewards: 65.821, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.114', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.149', 'weapon5': '0.152', 'weapon4': '0.208', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.612', 'WEAPON3': '0.800', 'weapon3': '2.836', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '51.000'} [2024-08-06 06:52:18,537][52659] DAMAGECOUNT value on done: 796195.0 [2024-08-06 06:52:18,539][52659] Sum rewards: 87.283, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.201', 'HEALTH': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.476', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.922', 'FRAGCOUNT': '70.000'} [2024-08-06 06:52:18,888][52803] DAMAGECOUNT value on done: 742435.0 [2024-08-06 06:52:18,890][52803] Sum rewards: 92.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.350', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.070', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.711', 'FRAGCOUNT': '75.000'} [2024-08-06 06:52:19,066][52667] DAMAGECOUNT value on done: 803485.0 [2024-08-06 06:52:19,071][52667] Sum rewards: 75.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.206', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '62.000'} [2024-08-06 06:52:20,886][52820] DAMAGECOUNT value on done: 736547.0 [2024-08-06 06:52:20,887][52820] Sum rewards: 77.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.172', 'weapon4': '0.192', 'weapon2': '0.214', 'weapon5': '0.230', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '63.500'} [2024-08-06 06:52:21,088][52660] DAMAGECOUNT value on done: 811627.0 [2024-08-06 06:52:21,090][52660] Sum rewards: 78.398, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.123', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.184', 'weapon2': '0.242', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.384', 'WEAPON3': '1.600', 'weapon3': '2.918', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:21,313][52650] Updated weights for policy 0, policy_version 72141 (0.0011) [2024-08-06 06:52:21,469][52795] DAMAGECOUNT value on done: 743543.0 [2024-08-06 06:52:21,470][52795] Sum rewards: 76.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.382', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.150', 'weapon5': '0.204', 'AMMO3': '0.205', 'AMMO4': '0.243', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '62.500'} [2024-08-06 06:52:21,845][52659] DAMAGECOUNT value on done: 795516.0 [2024-08-06 06:52:21,850][52659] Sum rewards: 59.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.494', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.106', 'weapon5': '0.120', 'AMMO3': '0.226', 'AMMO4': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.758', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '2.800', 'DAMAGECOUNT': '14.370', 'FRAGCOUNT': '52.000'} [2024-08-06 06:52:22,010][52803] DAMAGECOUNT value on done: 742284.0 [2024-08-06 06:52:22,013][52803] Sum rewards: 76.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.082', 'AMMO4': '0.219', 'weapon5': '0.220', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '64.000'} [2024-08-06 06:52:22,108][52667] DAMAGECOUNT value on done: 800408.0 [2024-08-06 06:52:22,108][52667] Sum rewards: 70.554, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon2': '0.188', 'weapon4': '0.214', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 590995456. Throughput: 0: 4316.9. Samples: 147754100. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:22,795][52567] Avg episode reward: [(0, '74.710')] [2024-08-06 06:52:23,394][52668] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 06:52:24,068][52820] DAMAGECOUNT value on done: 736824.0 [2024-08-06 06:52:24,070][52820] Sum rewards: 62.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.108', 'AMMO4': '0.141', 'weapon5': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.238', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '52.000'} [2024-08-06 06:52:24,114][52660] DAMAGECOUNT value on done: 790849.0 [2024-08-06 06:52:24,114][52660] Sum rewards: 80.311, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.109', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.142', 'weapon2': '0.280', 'AMMO3': '0.294', 'AMMO4': '0.300', 'weapon5': '0.334', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.852', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.208', 'FRAGCOUNT': '69.000'} [2024-08-06 06:52:24,695][52795] DAMAGECOUNT value on done: 732380.0 [2024-08-06 06:52:24,696][52795] Sum rewards: 71.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.705', 'AMMO2': '0.012', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.186', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '57.000'} [2024-08-06 06:52:24,899][52667] DAMAGECOUNT value on done: 796109.0 [2024-08-06 06:52:24,901][52667] Sum rewards: 69.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.759', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.168', 'weapon4': '0.174', 'AMMO4': '0.207', 'weapon2': '0.286', 'weapon5': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.994', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '55.000'} [2024-08-06 06:52:24,956][52659] DAMAGECOUNT value on done: 796381.0 [2024-08-06 06:52:24,959][52659] Sum rewards: 71.569, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.072', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'HEALTH': '0.370', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:25,116][52803] DAMAGECOUNT value on done: 733384.0 [2024-08-06 06:52:25,116][52803] Sum rewards: 71.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.008', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon2': '0.198', 'AMMO3': '0.226', 'weapon5': '0.282', 'AMMO4': '0.301', 'weapon4': '0.360', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '61.000'} [2024-08-06 06:52:25,962][52650] Updated weights for policy 0, policy_version 72151 (0.0015) [2024-08-06 06:52:26,157][52614] Signal inference workers to stop experience collection... (13200 times) [2024-08-06 06:52:26,157][52614] Signal inference workers to resume experience collection... (13200 times) [2024-08-06 06:52:26,189][52650] InferenceWorker_p0-w0: stopping experience collection (13200 times) [2024-08-06 06:52:26,191][52650] InferenceWorker_p0-w0: resuming experience collection (13200 times) [2024-08-06 06:52:26,780][52660] DAMAGECOUNT value on done: 796894.0 [2024-08-06 06:52:26,780][52660] Sum rewards: 73.105, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.250', 'AMMO2': '0.008', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'AMMO3': '0.179', 'weapon4': '0.182', 'weapon2': '0.302', 'WEAPON3': '1.000', 'weapon3': '3.390', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:27,138][52820] DAMAGECOUNT value on done: 745607.0 [2024-08-06 06:52:27,138][52820] Sum rewards: 72.432, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.007', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.026', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.214', 'weapon4': '0.342', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:27,775][52659] DAMAGECOUNT value on done: 793638.0 [2024-08-06 06:52:27,776][52659] Sum rewards: 66.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.760', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.180', 'AMMO4': '0.225', 'weapon2': '0.244', 'weapon5': '0.244', 'weapon4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '2.932', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '55.000'} [2024-08-06 06:52:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 591085568. Throughput: 0: 4359.3. Samples: 147780030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:27,794][52567] Avg episode reward: [(0, '74.240')] [2024-08-06 06:52:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072154_591085568.pth... [2024-08-06 06:52:27,902][52795] DAMAGECOUNT value on done: 737694.0 [2024-08-06 06:52:27,904][52795] Sum rewards: 82.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.019', 'AMMO2': '0.069', 'AMMO3': '0.187', 'weapon2': '0.226', 'weapon4': '0.246', 'weapon5': '0.292', 'AMMO4': '0.346', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071646_586924032.pth [2024-08-06 06:52:27,954][52667] DAMAGECOUNT value on done: 800089.0 [2024-08-06 06:52:27,955][52667] Sum rewards: 86.239, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.072', 'weapon4': '0.082', 'HEALTH': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.050', 'weapon3': '3.254', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '68.000'} [2024-08-06 06:52:28,271][52803] DAMAGECOUNT value on done: 733792.0 [2024-08-06 06:52:28,272][52803] Sum rewards: 77.766, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'weapon5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '66.000'} [2024-08-06 06:52:29,519][52670] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.588, 196.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:52:29,783][52660] DAMAGECOUNT value on done: 797243.0 [2024-08-06 06:52:29,783][52660] Sum rewards: 81.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.078', 'weapon5': '0.120', 'AMMO4': '0.124', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '66.000'} [2024-08-06 06:52:30,396][52820] DAMAGECOUNT value on done: 729467.0 [2024-08-06 06:52:30,396][52820] Sum rewards: 76.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.158', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:30,694][52671] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:52:31,121][52795] DAMAGECOUNT value on done: 738912.0 [2024-08-06 06:52:31,121][52795] Sum rewards: 79.654, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '65.000'} [2024-08-06 06:52:31,209][52667] DAMAGECOUNT value on done: 803898.0 [2024-08-06 06:52:31,210][52667] Sum rewards: 57.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.583', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.106', 'AMMO4': '0.148', 'weapon5': '0.148', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.760', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.052', 'FRAGCOUNT': '49.000'} [2024-08-06 06:52:31,235][52650] Updated weights for policy 0, policy_version 72161 (0.0016) [2024-08-06 06:52:31,257][52659] DAMAGECOUNT value on done: 799012.0 [2024-08-06 06:52:31,258][52659] Sum rewards: 70.572, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.186', 'weapon4': '0.198', 'AMMO3': '0.256', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:31,749][52803] DAMAGECOUNT value on done: 738888.0 [2024-08-06 06:52:31,749][52803] Sum rewards: 82.668, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.255', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '66.000'} [2024-08-06 06:52:32,549][52660] DAMAGECOUNT value on done: 786306.0 [2024-08-06 06:52:32,549][52660] Sum rewards: 94.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.339', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.189', 'weapon2': '0.222', 'WEAPON3': '1.150', 'weapon3': '3.640', 'HITCOUNT': '4.550', 'DAMAGECOUNT': '22.449', 'FRAGCOUNT': '75.000'} [2024-08-06 06:52:32,795][52567] Fps is (10 sec: 18020.4, 60 sec: 17202.9, 300 sec: 17383.6). Total num frames: 591175680. Throughput: 0: 4347.2. Samples: 147792500. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:32,795][52567] Avg episode reward: [(0, '74.513')] [2024-08-06 06:52:32,828][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:52:33,091][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:52:33,587][52820] DAMAGECOUNT value on done: 738462.0 [2024-08-06 06:52:33,591][52820] Sum rewards: 71.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.163', 'AMMO3': '0.191', 'weapon4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '57.000'} [2024-08-06 06:52:33,725][52667] DAMAGECOUNT value on done: 794724.0 [2024-08-06 06:52:33,725][52667] Sum rewards: 76.141, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.398', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.092', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '64.000'} [2024-08-06 06:52:34,296][52795] DAMAGECOUNT value on done: 735189.0 [2024-08-06 06:52:34,298][52795] Sum rewards: 93.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.128', 'AMMO3': '0.180', 'weapon4': '0.214', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.206', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '75.000'} [2024-08-06 06:52:34,334][52659] DAMAGECOUNT value on done: 804068.0 [2024-08-06 06:52:34,334][52659] Sum rewards: 79.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.465', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.102', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.286', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:34,851][52803] DAMAGECOUNT value on done: 738408.0 [2024-08-06 06:52:34,851][52803] Sum rewards: 68.784, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.078', 'HEALTH': '0.084', 'weapon5': '0.190', 'AMMO3': '0.203', 'AMMO4': '0.211', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '55.000'} [2024-08-06 06:52:35,005][52660] DAMAGECOUNT value on done: 786379.0 [2024-08-06 06:52:35,008][52660] Sum rewards: 74.066, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.106', 'weapon4': '0.110', 'AMMO4': '0.135', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.768', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:35,343][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:52:35,578][52664] DAMAGECOUNT value on done: 822349.0 [2024-08-06 06:52:35,578][52664] Sum rewards: 74.042, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO3': '0.125', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.406', 'weapon2': '0.592', 'WEAPON3': '0.850', 'weapon3': '2.668', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:35,798][52650] Updated weights for policy 0, policy_version 72171 (0.0011) [2024-08-06 06:52:36,674][52667] DAMAGECOUNT value on done: 797136.0 [2024-08-06 06:52:36,676][52667] Sum rewards: 68.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.078', 'AMMO4': '0.175', 'weapon5': '0.180', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.996', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '56.000'} [2024-08-06 06:52:36,751][52820] DAMAGECOUNT value on done: 747174.0 [2024-08-06 06:52:36,752][52820] Sum rewards: 69.175, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.300', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.134', 'AMMO4': '0.174', 'weapon2': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.327', 'WEAPON3': '1.950', 'weapon3': '3.366', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '61.000'} [2024-08-06 06:52:37,474][52795] DAMAGECOUNT value on done: 729668.0 [2024-08-06 06:52:37,476][52795] Sum rewards: 92.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.295', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.252', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.222', 'FRAGCOUNT': '73.000'} [2024-08-06 06:52:37,641][52659] DAMAGECOUNT value on done: 792399.0 [2024-08-06 06:52:37,641][52659] Sum rewards: 70.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.954', 'AMMO5': '0.026', 'AMMO2': '0.077', 'AMMO3': '0.179', 'weapon4': '0.196', 'weapon2': '0.220', 'weapon5': '0.330', 'AMMO4': '0.387', 'WEAPON5': '0.700', 'WEAPON4': '0.800', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '2.958', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '59.000'} [2024-08-06 06:52:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 591257600. Throughput: 0: 4351.3. Samples: 147818710. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:37,794][52567] Avg episode reward: [(0, '74.481')] [2024-08-06 06:52:37,980][52803] DAMAGECOUNT value on done: 751709.0 [2024-08-06 06:52:37,981][52803] Sum rewards: 80.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.090', 'weapon5': '0.168', 'AMMO4': '0.182', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '64.000'} [2024-08-06 06:52:38,600][52664] DAMAGECOUNT value on done: 828541.0 [2024-08-06 06:52:38,600][52664] Sum rewards: 66.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.186', 'weapon2': '0.206', 'weapon4': '0.236', 'AMMO4': '0.245', 'AMMO3': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '55.000'} [2024-08-06 06:52:39,242][52667] DAMAGECOUNT value on done: 805936.0 [2024-08-06 06:52:39,242][52667] Sum rewards: 81.716, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.142', 'AMMO4': '0.171', 'weapon4': '0.190', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.000', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '68.500'} [2024-08-06 06:52:39,901][52820] DAMAGECOUNT value on done: 740774.0 [2024-08-06 06:52:39,902][52820] Sum rewards: 83.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.114', 'weapon5': '0.128', 'AMMO4': '0.138', 'AMMO3': '0.247', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.982', 'FRAGCOUNT': '69.000'} [2024-08-06 06:52:40,124][52650] Updated weights for policy 0, policy_version 72181 (0.0023) [2024-08-06 06:52:40,611][52795] DAMAGECOUNT value on done: 731065.0 [2024-08-06 06:52:40,612][52795] Sum rewards: 83.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'weapon4': '0.112', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.247', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '69.000'} [2024-08-06 06:52:40,758][52659] DAMAGECOUNT value on done: 802420.0 [2024-08-06 06:52:40,758][52659] Sum rewards: 82.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.585', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.104', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.400', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:41,046][52803] DAMAGECOUNT value on done: 741877.0 [2024-08-06 06:52:41,048][52803] Sum rewards: 88.414, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.850', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.068', 'AMMO4': '0.154', 'weapon5': '0.178', 'AMMO3': '0.181', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '70.000'} [2024-08-06 06:52:41,192][52664] DAMAGECOUNT value on done: 827709.0 [2024-08-06 06:52:41,193][52664] Sum rewards: 84.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.688', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.128', 'AMMO3': '0.195', 'weapon2': '0.224', 'AMMO4': '0.246', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '69.000'} [2024-08-06 06:52:41,875][52649] DAMAGECOUNT value on done: 772606.0 [2024-08-06 06:52:41,875][52649] Sum rewards: 85.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '69.000'} [2024-08-06 06:52:42,418][52667] DAMAGECOUNT value on done: 792609.0 [2024-08-06 06:52:42,420][52667] Sum rewards: 57.538, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.022', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon4': '0.158', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.294', 'WEAPON3': '1.650', 'HITCOUNT': '2.890', 'weapon3': '3.358', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '52.000'} [2024-08-06 06:52:42,794][52567] Fps is (10 sec: 17204.9, 60 sec: 17476.2, 300 sec: 17383.7). Total num frames: 591347712. Throughput: 0: 4345.1. Samples: 147844780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:42,794][52567] Avg episode reward: [(0, '74.610')] [2024-08-06 06:52:43,173][52820] DAMAGECOUNT value on done: 742050.0 [2024-08-06 06:52:43,175][52820] Sum rewards: 88.055, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.616', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.424', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.883', 'FRAGCOUNT': '74.000'} [2024-08-06 06:52:43,763][52795] DAMAGECOUNT value on done: 739612.0 [2024-08-06 06:52:43,766][52795] Sum rewards: 77.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.078', 'AMMO4': '0.093', 'weapon4': '0.120', 'weapon2': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.452', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:43,771][52664] DAMAGECOUNT value on done: 819930.0 [2024-08-06 06:52:43,771][52664] Sum rewards: 73.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.412', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.120', 'weapon2': '0.214', 'weapon5': '0.262', 'AMMO3': '0.278', 'AMMO4': '0.319', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.076', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:43,930][52659] DAMAGECOUNT value on done: 795522.0 [2024-08-06 06:52:43,931][52659] Sum rewards: 77.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.462', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.112', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:44,254][52803] DAMAGECOUNT value on done: 740275.0 [2024-08-06 06:52:44,259][52803] Sum rewards: 83.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.054', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon4': '0.196', 'AMMO3': '0.203', 'weapon5': '0.212', 'weapon2': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '68.000'} [2024-08-06 06:52:44,781][52649] DAMAGECOUNT value on done: 764081.0 [2024-08-06 06:52:44,783][52649] Sum rewards: 71.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.048', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '59.500'} [2024-08-06 06:52:45,164][52803] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:52:45,323][52650] Updated weights for policy 0, policy_version 72191 (0.0046) [2024-08-06 06:52:45,361][52667] DAMAGECOUNT value on done: 800881.0 [2024-08-06 06:52:45,361][52667] Sum rewards: 77.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.374', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO4': '0.093', 'AMMO3': '0.190', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.430', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:46,292][52664] DAMAGECOUNT value on done: 832127.0 [2024-08-06 06:52:46,296][52664] Sum rewards: 63.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.374', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.354', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '54.000'} [2024-08-06 06:52:46,307][52820] DAMAGECOUNT value on done: 738471.0 [2024-08-06 06:52:46,320][52820] Sum rewards: 82.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.068', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:46,941][52795] DAMAGECOUNT value on done: 725166.0 [2024-08-06 06:52:46,942][52795] Sum rewards: 90.816, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.786', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.150', 'weapon5': '0.224', 'AMMO3': '0.229', 'AMMO4': '0.278', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '21.906', 'FRAGCOUNT': '73.000'} [2024-08-06 06:52:47,005][52659] DAMAGECOUNT value on done: 796380.0 [2024-08-06 06:52:47,007][52659] Sum rewards: 70.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.079', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.132', 'AMMO3': '0.190', 'AMMO4': '0.236', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '57.000'} [2024-08-06 06:52:47,340][52803] DAMAGECOUNT value on done: 753149.0 [2024-08-06 06:52:47,342][52803] Sum rewards: 82.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.110', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.123', 'weapon5': '0.166', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17383.7). Total num frames: 591429632. Throughput: 0: 4342.7. Samples: 147857820. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 06:52:47,794][52567] Avg episode reward: [(0, '75.400')] [2024-08-06 06:52:47,835][52794] DAMAGECOUNT value on done: 791339.0 [2024-08-06 06:52:47,835][52794] Sum rewards: 68.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.264', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '56.000'} [2024-08-06 06:52:47,958][52649] DAMAGECOUNT value on done: 783373.0 [2024-08-06 06:52:47,960][52649] Sum rewards: 79.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.216', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.178', 'AMMO4': '0.200', 'AMMO3': '0.288', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.036', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '68.000'} [2024-08-06 06:52:48,501][52667] DAMAGECOUNT value on done: 806082.0 [2024-08-06 06:52:48,503][52667] Sum rewards: 63.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon5': '0.158', 'AMMO3': '0.216', 'AMMO4': '0.218', 'weapon4': '0.232', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '2.984', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '54.000'} [2024-08-06 06:52:48,656][52664] DAMAGECOUNT value on done: 824590.0 [2024-08-06 06:52:48,656][52664] Sum rewards: 64.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.017', 'AMMO2': '0.063', 'AMMO3': '0.191', 'weapon5': '0.232', 'AMMO4': '0.314', 'weapon2': '0.322', 'WEAPON5': '0.400', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.596', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '53.000'} [2024-08-06 06:52:48,985][52649] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:52:49,304][52647] DAMAGECOUNT value on done: 847058.0 [2024-08-06 06:52:49,308][52647] Sum rewards: 72.938, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.845', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.106', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:49,329][52650] Updated weights for policy 0, policy_version 72201 (0.0012) [2024-08-06 06:52:49,538][52820] DAMAGECOUNT value on done: 740711.0 [2024-08-06 06:52:49,539][52820] Sum rewards: 62.980, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.872', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.070', 'AMMO4': '0.181', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.313', 'weapon2': '0.362', 'WEAPON3': '1.800', 'weapon3': '3.092', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '55.000'} [2024-08-06 06:52:50,046][52795] DAMAGECOUNT value on done: 741072.0 [2024-08-06 06:52:50,047][52795] Sum rewards: 64.148, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.396', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.060', 'weapon5': '0.176', 'AMMO4': '0.239', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.600', 'weapon3': '2.910', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '56.000'} [2024-08-06 06:52:50,268][52659] DAMAGECOUNT value on done: 797609.0 [2024-08-06 06:52:50,269][52659] Sum rewards: 70.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO3': '0.172', 'AMMO4': '0.173', 'weapon5': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '57.000'} [2024-08-06 06:52:50,445][52803] DAMAGECOUNT value on done: 738971.0 [2024-08-06 06:52:50,446][52803] Sum rewards: 67.799, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.442', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.000'} [2024-08-06 06:52:50,696][52794] DAMAGECOUNT value on done: 799289.0 [2024-08-06 06:52:50,696][52794] Sum rewards: 65.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.205', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.102', 'AMMO3': '0.166', 'weapon4': '0.186', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '52.000'} [2024-08-06 06:52:50,812][52649] DAMAGECOUNT value on done: 777512.0 [2024-08-06 06:52:50,813][52649] Sum rewards: 75.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.102', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:51,519][52664] DAMAGECOUNT value on done: 819950.0 [2024-08-06 06:52:51,519][52664] Sum rewards: 68.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.138', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.270', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '57.000'} [2024-08-06 06:52:51,616][52667] DAMAGECOUNT value on done: 805043.0 [2024-08-06 06:52:51,616][52667] Sum rewards: 68.456, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.010', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.114', 'weapon5': '0.130', 'AMMO3': '0.238', 'AMMO4': '0.239', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '59.500'} [2024-08-06 06:52:52,004][52647] DAMAGECOUNT value on done: 836771.0 [2024-08-06 06:52:52,005][52647] Sum rewards: 80.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.472', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.120', 'weapon5': '0.146', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.318', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:52,685][52820] DAMAGECOUNT value on done: 752110.0 [2024-08-06 06:52:52,688][52820] Sum rewards: 73.107, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.458', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.120', 'AMMO4': '0.181', 'AMMO3': '0.230', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 591527936. Throughput: 0: 4347.5. Samples: 147884280. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:52:52,795][52567] Avg episode reward: [(0, '74.903')] [2024-08-06 06:52:53,171][52659] DAMAGECOUNT value on done: 799046.0 [2024-08-06 06:52:53,176][52659] Sum rewards: 82.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.748', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.082', 'AMMO4': '0.159', 'AMMO3': '0.185', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '65.000'} [2024-08-06 06:52:53,306][52795] DAMAGECOUNT value on done: 738570.0 [2024-08-06 06:52:53,311][52795] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.566', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.026', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.434', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '60.500'} [2024-08-06 06:52:53,460][52803] DAMAGECOUNT value on done: 742113.0 [2024-08-06 06:52:53,461][52803] Sum rewards: 73.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'AMMO4': '0.151', 'weapon5': '0.186', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '61.500'} [2024-08-06 06:52:53,780][52664] DAMAGECOUNT value on done: 815007.0 [2024-08-06 06:52:53,781][52664] Sum rewards: 78.629, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.700', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'AMMO3': '0.307', 'WEAPON3': '1.800', 'weapon3': '3.346', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '68.000'} [2024-08-06 06:52:53,915][52794] DAMAGECOUNT value on done: 803782.0 [2024-08-06 06:52:53,917][52794] Sum rewards: 77.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.197', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 06:52:54,052][52649] DAMAGECOUNT value on done: 767651.0 [2024-08-06 06:52:54,062][52649] Sum rewards: 84.774, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.158', 'weapon2': '0.186', 'AMMO4': '0.203', 'AMMO3': '0.220', 'weapon4': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '70.500'} [2024-08-06 06:52:54,239][52647] DAMAGECOUNT value on done: 841329.0 [2024-08-06 06:52:54,240][52647] Sum rewards: 69.508, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.174', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.332', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 06:52:54,353][52667] DAMAGECOUNT value on done: 804443.0 [2024-08-06 06:52:54,354][52667] Sum rewards: 75.384, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.774', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'weapon4': '0.064', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.267', 'weapon2': '0.308', 'WEAPON3': '1.650', 'weapon3': '3.354', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '64.000'} [2024-08-06 06:52:54,459][52650] Updated weights for policy 0, policy_version 72211 (0.0018) [2024-08-06 06:52:55,821][52820] DAMAGECOUNT value on done: 749354.0 [2024-08-06 06:52:55,825][52820] Sum rewards: 68.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.145', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.168', 'AMMO4': '0.175', 'weapon2': '0.216', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.270', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '56.000'} [2024-08-06 06:52:56,015][52659] DAMAGECOUNT value on done: 806248.0 [2024-08-06 06:52:56,016][52659] Sum rewards: 78.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.787', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.089', 'weapon5': '0.114', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '64.000'} [2024-08-06 06:52:56,452][52664] DAMAGECOUNT value on done: 828998.0 [2024-08-06 06:52:56,452][52664] Sum rewards: 71.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.344', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.168', 'weapon4': '0.228', 'AMMO3': '0.239', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '61.000'} [2024-08-06 06:52:56,552][52803] DAMAGECOUNT value on done: 744849.0 [2024-08-06 06:52:56,553][52803] Sum rewards: 74.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.042', 'weapon5': '0.106', 'AMMO4': '0.192', 'AMMO3': '0.210', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '62.000'} [2024-08-06 06:52:56,561][52795] DAMAGECOUNT value on done: 728188.0 [2024-08-06 06:52:56,563][52795] Sum rewards: 62.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.074', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.760', 'weapon3': '3.254', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '52.000'} [2024-08-06 06:52:56,889][52647] DAMAGECOUNT value on done: 840880.0 [2024-08-06 06:52:56,891][52647] Sum rewards: 64.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.495', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon4': '0.204', 'weapon5': '0.228', 'AMMO3': '0.260', 'AMMO4': '0.298', 'weapon2': '0.400', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.858', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '55.500'} [2024-08-06 06:52:57,023][52794] DAMAGECOUNT value on done: 791207.0 [2024-08-06 06:52:57,023][52794] Sum rewards: 83.354, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.817', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO3': '0.182', 'AMMO4': '0.189', 'weapon4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '67.000'} [2024-08-06 06:52:57,444][52649] DAMAGECOUNT value on done: 779990.0 [2024-08-06 06:52:57,444][52649] Sum rewards: 80.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.695', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.183', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.398', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '64.000'} [2024-08-06 06:52:57,479][52667] DAMAGECOUNT value on done: 801184.0 [2024-08-06 06:52:57,480][52667] Sum rewards: 70.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.725', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.188', 'AMMO3': '0.210', 'weapon4': '0.268', 'weapon2': '0.278', 'AMMO4': '0.291', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '58.000'} [2024-08-06 06:52:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 591609856. Throughput: 0: 4344.2. Samples: 147910360. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:52:57,794][52567] Avg episode reward: [(0, '75.103')] [2024-08-06 06:52:58,940][52664] DAMAGECOUNT value on done: 824091.0 [2024-08-06 06:52:58,940][52664] Sum rewards: 86.504, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.132', 'AMMO3': '0.176', 'AMMO4': '0.197', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '69.000'} [2024-08-06 06:52:59,060][52659] DAMAGECOUNT value on done: 793040.0 [2024-08-06 06:52:59,068][52659] Sum rewards: 76.944, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.250', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.082', 'AMMO3': '0.167', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.428', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 06:52:59,119][52650] Updated weights for policy 0, policy_version 72221 (0.0018) [2024-08-06 06:52:59,166][52820] DAMAGECOUNT value on done: 732044.0 [2024-08-06 06:52:59,169][52820] Sum rewards: 76.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.241', 'WEAPON3': '1.400', 'HITCOUNT': '3.560', 'weapon3': '3.586', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '65.000'} [2024-08-06 06:52:59,429][52647] DAMAGECOUNT value on done: 848904.0 [2024-08-06 06:52:59,430][52647] Sum rewards: 82.079, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.034', 'AMMO5': '0.024', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon2': '0.208', 'weapon5': '0.210', 'AMMO4': '0.224', 'AMMO3': '0.249', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.664', 'FRAGCOUNT': '70.000'} [2024-08-06 06:52:59,724][52803] DAMAGECOUNT value on done: 749809.0 [2024-08-06 06:52:59,725][52803] Sum rewards: 85.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.124', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.426', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '72.000'} [2024-08-06 06:52:59,805][52795] DAMAGECOUNT value on done: 736511.0 [2024-08-06 06:52:59,805][52795] Sum rewards: 83.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.490', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '68.000'} [2024-08-06 06:53:00,266][52794] DAMAGECOUNT value on done: 788767.0 [2024-08-06 06:53:00,267][52794] Sum rewards: 71.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO2': '0.014', 'AMMO4': '0.068', 'AMMO3': '0.191', 'weapon2': '0.288', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.570', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 06:53:00,442][52649] DAMAGECOUNT value on done: 776338.0 [2024-08-06 06:53:00,444][52649] Sum rewards: 67.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.485', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'weapon4': '0.096', 'weapon5': '0.130', 'AMMO3': '0.173', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '55.000'} [2024-08-06 06:53:00,583][52667] DAMAGECOUNT value on done: 807745.0 [2024-08-06 06:53:00,585][52667] Sum rewards: 85.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.140', 'weapon4': '0.182', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.962', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '68.000'} [2024-08-06 06:53:01,811][52659] DAMAGECOUNT value on done: 802971.0 [2024-08-06 06:53:01,813][52659] Sum rewards: 73.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.668', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.678', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:01,877][52664] DAMAGECOUNT value on done: 835593.0 [2024-08-06 06:53:01,880][52664] Sum rewards: 66.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.914', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.087', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '57.000'} [2024-08-06 06:53:02,261][52647] DAMAGECOUNT value on done: 844549.0 [2024-08-06 06:53:02,261][52647] Sum rewards: 80.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon4': '0.144', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon2': '0.212', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '65.000'} [2024-08-06 06:53:02,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 591699968. Throughput: 0: 4346.7. Samples: 147923530. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:53:02,794][52567] Avg episode reward: [(0, '75.328')] [2024-08-06 06:53:02,842][52803] DAMAGECOUNT value on done: 748905.0 [2024-08-06 06:53:02,843][52803] Sum rewards: 68.777, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.030', 'AMMO5': '0.019', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.147', 'weapon2': '0.232', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.292', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:02,934][52795] DAMAGECOUNT value on done: 743373.0 [2024-08-06 06:53:02,934][52795] Sum rewards: 66.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.445', 'AMMO5': '0.021', 'AMMO2': '0.045', 'AMMO3': '0.198', 'AMMO4': '0.228', 'weapon5': '0.240', 'weapon4': '0.280', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '54.000'} [2024-08-06 06:53:03,265][52794] DAMAGECOUNT value on done: 795183.0 [2024-08-06 06:53:03,266][52794] Sum rewards: 79.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.275', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO3': '0.153', 'AMMO4': '0.181', 'weapon4': '0.182', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon3': '3.176', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:03,308][52649] DAMAGECOUNT value on done: 780894.0 [2024-08-06 06:53:03,310][52649] Sum rewards: 87.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.722', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.210', 'AMMO3': '0.218', 'AMMO4': '0.224', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '22.548', 'FRAGCOUNT': '70.000'} [2024-08-06 06:53:04,090][52650] Updated weights for policy 0, policy_version 72231 (0.0017) [2024-08-06 06:53:04,550][52659] DAMAGECOUNT value on done: 793938.0 [2024-08-06 06:53:04,550][52659] Sum rewards: 70.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.772', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.088', 'AMMO3': '0.164', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.738', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 06:53:04,607][52664] DAMAGECOUNT value on done: 831458.0 [2024-08-06 06:53:04,607][52664] Sum rewards: 77.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.445', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.114', 'AMMO4': '0.202', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:05,187][52647] DAMAGECOUNT value on done: 847087.0 [2024-08-06 06:53:05,189][52647] Sum rewards: 62.919, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.362', 'AMMO5': '0.005', 'AMMO2': '0.062', 'weapon5': '0.098', 'weapon4': '0.110', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.305', 'AMMO4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'HITCOUNT': '3.150', 'weapon3': '3.300', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '57.000'} [2024-08-06 06:53:05,906][52803] DAMAGECOUNT value on done: 744958.0 [2024-08-06 06:53:05,906][52803] Sum rewards: 77.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.416', 'AMMO5': '0.003', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'weapon4': '0.086', 'weapon5': '0.094', 'AMMO3': '0.210', 'weapon2': '0.680', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:06,143][52794] DAMAGECOUNT value on done: 801026.0 [2024-08-06 06:53:06,146][52794] Sum rewards: 75.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.549', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.172', 'weapon4': '0.230', 'AMMO3': '0.236', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:06,171][52649] DAMAGECOUNT value on done: 778656.0 [2024-08-06 06:53:06,171][52649] Sum rewards: 85.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.070', 'weapon5': '0.096', 'AMMO4': '0.132', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '70.000'} [2024-08-06 06:53:07,608][52664] DAMAGECOUNT value on done: 830588.0 [2024-08-06 06:53:07,609][52664] Sum rewards: 76.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.176', 'weapon4': '0.206', 'AMMO3': '0.211', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 591781888. Throughput: 0: 4350.7. Samples: 147949880. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:53:07,794][52567] Avg episode reward: [(0, '75.784')] [2024-08-06 06:53:08,250][52650] Updated weights for policy 0, policy_version 72241 (0.0020) [2024-08-06 06:53:08,296][52647] DAMAGECOUNT value on done: 825829.0 [2024-08-06 06:53:08,296][52647] Sum rewards: 93.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.161', 'weapon4': '0.178', 'weapon2': '0.192', 'weapon5': '0.202', 'AMMO4': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '22.398', 'FRAGCOUNT': '74.000'} [2024-08-06 06:53:08,772][52794] DAMAGECOUNT value on done: 788119.0 [2024-08-06 06:53:08,772][52794] Sum rewards: 75.339, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.212', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.145', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:09,063][52649] DAMAGECOUNT value on done: 771829.0 [2024-08-06 06:53:09,065][52649] Sum rewards: 80.638, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.704', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.086', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.272', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '69.000'} [2024-08-06 06:53:10,040][52664] DAMAGECOUNT value on done: 839202.0 [2024-08-06 06:53:10,048][52664] Sum rewards: 81.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.178', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.167', 'weapon5': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.304', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:10,556][52647] DAMAGECOUNT value on done: 842057.0 [2024-08-06 06:53:10,556][52647] Sum rewards: 76.562, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.282', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.048', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.213', 'weapon2': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '68.000'} [2024-08-06 06:53:11,445][52658] DAMAGECOUNT value on done: 798673.0 [2024-08-06 06:53:11,445][52658] Sum rewards: 81.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'weapon4': '0.046', 'AMMO2': '0.047', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO4': '0.236', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '68.000'} [2024-08-06 06:53:11,491][52794] DAMAGECOUNT value on done: 798803.0 [2024-08-06 06:53:11,492][52794] Sum rewards: 80.266, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.200', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.166', 'weapon5': '0.174', 'AMMO4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.322', 'WEAPON3': '0.950', 'weapon3': '3.082', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:12,181][52649] DAMAGECOUNT value on done: 783234.0 [2024-08-06 06:53:12,182][52649] Sum rewards: 71.642, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.698', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'weapon5': '0.106', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'weapon3': '3.378', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 591872000. Throughput: 0: 4358.7. Samples: 147976170. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:53:12,794][52567] Avg episode reward: [(0, '75.970')] [2024-08-06 06:53:12,838][52664] DAMAGECOUNT value on done: 839558.0 [2024-08-06 06:53:12,838][52664] Sum rewards: 78.201, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.179', 'AMMO4': '0.216', 'weapon5': '0.232', 'weapon4': '0.246', 'HEALTH': '0.322', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:13,235][52647] DAMAGECOUNT value on done: 838249.0 [2024-08-06 06:53:13,235][52647] Sum rewards: 75.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.044', 'AMMO4': '0.137', 'AMMO3': '0.180', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:13,240][52650] Updated weights for policy 0, policy_version 72251 (0.0019) [2024-08-06 06:53:14,334][52658] DAMAGECOUNT value on done: 799712.0 [2024-08-06 06:53:14,334][52658] Sum rewards: 78.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.168', 'weapon5': '0.206', 'AMMO4': '0.249', 'weapon2': '0.322', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:14,702][52794] DAMAGECOUNT value on done: 791786.0 [2024-08-06 06:53:14,703][52794] Sum rewards: 81.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.040', 'weapon5': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.207', 'weapon2': '0.210', 'WEAPON3': '1.400', 'weapon3': '3.512', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:15,265][52664] DAMAGECOUNT value on done: 833063.0 [2024-08-06 06:53:15,267][52664] Sum rewards: 76.611, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.026', 'weapon5': '0.048', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '65.000'} [2024-08-06 06:53:15,295][52649] DAMAGECOUNT value on done: 789521.0 [2024-08-06 06:53:15,297][52649] Sum rewards: 75.897, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.292', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.258', 'AMMO3': '0.269', 'WEAPON3': '1.750', 'weapon3': '3.346', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.103', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:15,300][52665] DAMAGECOUNT value on done: 785398.0 [2024-08-06 06:53:15,301][52665] Sum rewards: 76.865, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.652', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.052', 'weapon4': '0.104', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon2': '0.202', 'WEAPON4': '0.250', 'AMMO3': '0.295', 'WEAPON3': '1.850', 'weapon3': '3.404', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '68.500'} [2024-08-06 06:53:15,757][52647] DAMAGECOUNT value on done: 838459.0 [2024-08-06 06:53:15,757][52647] Sum rewards: 73.849, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.086', 'weapon5': '0.132', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.280', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:17,187][52658] DAMAGECOUNT value on done: 804151.0 [2024-08-06 06:53:17,187][52658] Sum rewards: 82.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.508', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '67.000'} [2024-08-06 06:53:17,633][52650] Updated weights for policy 0, policy_version 72261 (0.0017) [2024-08-06 06:53:17,768][52794] DAMAGECOUNT value on done: 788637.0 [2024-08-06 06:53:17,771][52794] Sum rewards: 74.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.066', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.126', 'AMMO3': '0.222', 'weapon5': '0.230', 'AMMO4': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 591962112. Throughput: 0: 4375.0. Samples: 147989370. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:53:17,794][52567] Avg episode reward: [(0, '76.015')] [2024-08-06 06:53:18,055][52664] DAMAGECOUNT value on done: 821738.0 [2024-08-06 06:53:18,056][52664] Sum rewards: 72.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.966', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.176', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.400', 'weapon4': '0.446', 'WEAPON3': '1.500', 'weapon3': '2.742', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:18,500][52649] DAMAGECOUNT value on done: 783668.0 [2024-08-06 06:53:18,502][52649] Sum rewards: 63.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.354', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO3': '0.193', 'AMMO4': '0.228', 'weapon4': '0.318', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.198', 'FRAGCOUNT': '53.000'} [2024-08-06 06:53:18,510][52665] DAMAGECOUNT value on done: 799681.0 [2024-08-06 06:53:18,511][52665] Sum rewards: 74.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.148', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.146', 'weapon4': '0.158', 'AMMO3': '0.183', 'AMMO4': '0.195', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:18,558][52647] DAMAGECOUNT value on done: 828204.0 [2024-08-06 06:53:18,559][52647] Sum rewards: 68.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.196', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.242', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '57.000'} [2024-08-06 06:53:19,825][52658] DAMAGECOUNT value on done: 799748.0 [2024-08-06 06:53:19,827][52658] Sum rewards: 80.668, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.614', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.096', 'weapon5': '0.114', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:20,478][52794] DAMAGECOUNT value on done: 799065.0 [2024-08-06 06:53:20,488][52794] Sum rewards: 73.307, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.193', 'weapon5': '0.236', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.150', 'weapon3': '2.844', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '58.000'} [2024-08-06 06:53:21,198][52664] DAMAGECOUNT value on done: 826918.0 [2024-08-06 06:53:21,198][52664] Sum rewards: 82.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.335', 'AMMO5': '0.009', 'weapon4': '0.034', 'AMMO2': '0.035', 'weapon5': '0.104', 'weapon2': '0.170', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.462', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '71.000'} [2024-08-06 06:53:21,429][52649] DAMAGECOUNT value on done: 784409.0 [2024-08-06 06:53:21,430][52649] Sum rewards: 70.409, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.092', 'AMMO5': '0.016', 'AMMO2': '0.044', 'AMMO3': '0.124', 'weapon4': '0.132', 'AMMO4': '0.218', 'weapon5': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '0.850', 'weapon3': '2.920', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '54.500'} [2024-08-06 06:53:21,433][52647] DAMAGECOUNT value on done: 845256.0 [2024-08-06 06:53:21,434][52647] Sum rewards: 66.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.562', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.118', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.090', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '58.000'} [2024-08-06 06:53:21,463][52665] DAMAGECOUNT value on done: 793931.0 [2024-08-06 06:53:21,464][52665] Sum rewards: 74.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:22,524][52650] Updated weights for policy 0, policy_version 72271 (0.0025) [2024-08-06 06:53:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 592044032. Throughput: 0: 4374.0. Samples: 148015540. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:53:22,794][52567] Avg episode reward: [(0, '75.594')] [2024-08-06 06:53:22,985][52658] DAMAGECOUNT value on done: 794734.0 [2024-08-06 06:53:22,987][52658] Sum rewards: 85.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.950', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.140', 'weapon5': '0.170', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.979', 'FRAGCOUNT': '69.000'} [2024-08-06 06:53:23,108][52794] DAMAGECOUNT value on done: 794430.0 [2024-08-06 06:53:23,109][52794] Sum rewards: 78.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.559', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.106', 'AMMO4': '0.166', 'weapon5': '0.174', 'AMMO3': '0.184', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:24,259][52664] DAMAGECOUNT value on done: 828988.0 [2024-08-06 06:53:24,260][52664] Sum rewards: 83.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.174', 'AMMO4': '0.179', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '68.000'} [2024-08-06 06:53:24,487][52647] DAMAGECOUNT value on done: 833291.0 [2024-08-06 06:53:24,487][52647] Sum rewards: 82.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.075', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.110', 'AMMO3': '0.179', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '67.000'} [2024-08-06 06:53:24,546][52649] DAMAGECOUNT value on done: 774692.0 [2024-08-06 06:53:24,547][52649] Sum rewards: 74.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.806', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.122', 'AMMO4': '0.134', 'weapon4': '0.180', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:24,563][52665] DAMAGECOUNT value on done: 792127.0 [2024-08-06 06:53:24,563][52665] Sum rewards: 80.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.892', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.231', 'weapon2': '0.702', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '68.000'} [2024-08-06 06:53:25,401][52658] DAMAGECOUNT value on done: 788821.0 [2024-08-06 06:53:25,402][52658] Sum rewards: 71.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.181', 'weapon4': '0.188', 'AMMO3': '0.195', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.000'} [2024-08-06 06:53:25,935][52663] DAMAGECOUNT value on done: 812555.0 [2024-08-06 06:53:25,936][52663] Sum rewards: 75.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.138', 'weapon2': '0.164', 'AMMO4': '0.168', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:26,481][52794] DAMAGECOUNT value on done: 811335.0 [2024-08-06 06:53:26,493][52794] Sum rewards: 93.708, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.224', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.042', 'weapon4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.159', 'weapon2': '0.696', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.208', 'FRAGCOUNT': '75.000'} [2024-08-06 06:53:26,715][52664] DAMAGECOUNT value on done: 824374.0 [2024-08-06 06:53:26,716][52664] Sum rewards: 64.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.034', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.430', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '54.000'} [2024-08-06 06:53:26,814][52647] DAMAGECOUNT value on done: 841339.0 [2024-08-06 06:53:26,814][52647] Sum rewards: 73.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.362', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'weapon4': '0.168', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:27,240][52650] Updated weights for policy 0, policy_version 72281 (0.0023) [2024-08-06 06:53:27,775][52665] DAMAGECOUNT value on done: 777269.0 [2024-08-06 06:53:27,775][52665] Sum rewards: 65.910, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.418', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.084', 'AMMO4': '0.145', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 06:53:27,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17383.7). Total num frames: 592134144. Throughput: 0: 4371.5. Samples: 148041500. Policy #0 lag: (min: 0.0, avg: 2.5, max: 7.0) [2024-08-06 06:53:27,795][52567] Avg episode reward: [(0, '75.529')] [2024-08-06 06:53:27,820][52649] DAMAGECOUNT value on done: 781794.0 [2024-08-06 06:53:27,820][52649] Sum rewards: 71.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.022', 'AMMO2': '0.070', 'weapon4': '0.202', 'AMMO3': '0.207', 'weapon5': '0.246', 'weapon2': '0.334', 'AMMO4': '0.352', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:28,033][52658] DAMAGECOUNT value on done: 802837.0 [2024-08-06 06:53:28,034][52658] Sum rewards: 68.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.134', 'weapon5': '0.156', 'AMMO4': '0.213', 'AMMO3': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '57.000'} [2024-08-06 06:53:28,980][52671] DAMAGECOUNT value on done: 802736.0 [2024-08-06 06:53:28,980][52671] Sum rewards: 56.245, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.200', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.068', 'weapon4': '0.086', 'AMMO4': '0.194', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.140', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '49.000'} [2024-08-06 06:53:29,098][52663] DAMAGECOUNT value on done: 799497.0 [2024-08-06 06:53:29,098][52663] Sum rewards: 72.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.827', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.066', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:29,169][52794] DAMAGECOUNT value on done: 789428.0 [2024-08-06 06:53:29,171][52794] Sum rewards: 82.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.082', 'weapon5': '0.092', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.580', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:29,250][52647] DAMAGECOUNT value on done: 842331.0 [2024-08-06 06:53:29,253][52647] Sum rewards: 69.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.722', 'AMMO5': '0.023', 'AMMO2': '0.038', 'weapon4': '0.176', 'AMMO3': '0.185', 'AMMO4': '0.191', 'weapon2': '0.324', 'weapon5': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '57.500'} [2024-08-06 06:53:29,991][52669] DAMAGECOUNT value on done: 799526.0 [2024-08-06 06:53:29,991][52669] Sum rewards: 53.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.995', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.136', 'AMMO3': '0.166', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon4': '0.330', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.660', 'weapon3': '2.918', 'DAMAGECOUNT': '13.248', 'FRAGCOUNT': '43.000'} [2024-08-06 06:53:30,616][52658] DAMAGECOUNT value on done: 791188.0 [2024-08-06 06:53:30,617][52658] Sum rewards: 75.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.157', 'weapon5': '0.158', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:30,768][52665] DAMAGECOUNT value on done: 783416.0 [2024-08-06 06:53:30,770][52665] Sum rewards: 72.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.490', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.134', 'AMMO3': '0.196', 'weapon5': '0.200', 'AMMO4': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:30,841][52649] DAMAGECOUNT value on done: 764448.0 [2024-08-06 06:53:30,842][52649] Sum rewards: 58.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.663', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.152', 'weapon5': '0.182', 'AMMO3': '0.212', 'AMMO4': '0.215', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.594', 'WEAPON3': '1.300', 'HITCOUNT': '2.790', 'weapon3': '2.824', 'DAMAGECOUNT': '14.499', 'FRAGCOUNT': '50.000'} [2024-08-06 06:53:31,695][52794] DAMAGECOUNT value on done: 806161.0 [2024-08-06 06:53:31,697][52794] Sum rewards: 70.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.206', 'AMMO3': '0.214', 'weapon4': '0.222', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '58.000'} [2024-08-06 06:53:31,910][52647] DAMAGECOUNT value on done: 830032.0 [2024-08-06 06:53:31,911][52647] Sum rewards: 71.039, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.097', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.144', 'weapon4': '0.186', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.186', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:31,918][52650] Updated weights for policy 0, policy_version 72291 (0.0013) [2024-08-06 06:53:32,026][52663] DAMAGECOUNT value on done: 793807.0 [2024-08-06 06:53:32,028][52663] Sum rewards: 77.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.486', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.090', 'AMMO4': '0.092', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.332', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:32,072][52671] DAMAGECOUNT value on done: 805421.0 [2024-08-06 06:53:32,074][52671] Sum rewards: 79.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.176', 'weapon4': '0.188', 'AMMO3': '0.199', 'AMMO4': '0.232', 'weapon2': '0.248', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '65.000'} [2024-08-06 06:53:32,229][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:53:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.6, 300 sec: 17411.8). Total num frames: 592224256. Throughput: 0: 4376.9. Samples: 148054780. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:53:32,794][52567] Avg episode reward: [(0, '75.152')] [2024-08-06 06:53:33,055][52669] DAMAGECOUNT value on done: 790014.0 [2024-08-06 06:53:33,059][52669] Sum rewards: 67.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.262', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.174', 'weapon4': '0.182', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.086', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '56.000'} [2024-08-06 06:53:33,304][52658] DAMAGECOUNT value on done: 815879.0 [2024-08-06 06:53:33,306][52658] Sum rewards: 63.810, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.150', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.008', 'weapon5': '0.032', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.314', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.488', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '50.000'} [2024-08-06 06:53:33,422][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:53:33,822][52665] DAMAGECOUNT value on done: 788201.0 [2024-08-06 06:53:33,823][52665] Sum rewards: 79.426, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.020', 'HEALTH': '0.054', 'weapon4': '0.086', 'AMMO4': '0.099', 'weapon5': '0.136', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.576', 'WEAPON3': '0.900', 'weapon3': '3.018', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:33,865][52649] DAMAGECOUNT value on done: 785649.0 [2024-08-06 06:53:33,865][52649] Sum rewards: 79.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.142', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.450', 'weapon3': '3.364', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '67.000'} [2024-08-06 06:53:34,335][52647] DAMAGECOUNT value on done: 834554.0 [2024-08-06 06:53:34,336][52647] Sum rewards: 82.592, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.622', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.048', 'weapon4': '0.096', 'AMMO4': '0.172', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.230', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '72.000'} [2024-08-06 06:53:34,959][52794] DAMAGECOUNT value on done: 800667.0 [2024-08-06 06:53:34,959][52794] Sum rewards: 71.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.112', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:35,200][52663] DAMAGECOUNT value on done: 796252.0 [2024-08-06 06:53:35,200][52663] Sum rewards: 75.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.427', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.068', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:35,265][52671] DAMAGECOUNT value on done: 802365.0 [2024-08-06 06:53:35,265][52671] Sum rewards: 81.290, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.716', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.303', 'weapon2': '0.478', 'WEAPON3': '1.800', 'weapon3': '3.142', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.087', 'FRAGCOUNT': '70.000'} [2024-08-06 06:53:35,913][52658] DAMAGECOUNT value on done: 801324.0 [2024-08-06 06:53:35,915][52658] Sum rewards: 78.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.379', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.092', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:36,171][52669] DAMAGECOUNT value on done: 806159.0 [2024-08-06 06:53:36,171][52669] Sum rewards: 91.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.378', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.705', 'FRAGCOUNT': '74.000'} [2024-08-06 06:53:36,493][52650] Updated weights for policy 0, policy_version 72301 (0.0040) [2024-08-06 06:53:36,730][52647] DAMAGECOUNT value on done: 825470.0 [2024-08-06 06:53:36,730][52647] Sum rewards: 80.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.982', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.142', 'weapon5': '0.142', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:36,960][52665] DAMAGECOUNT value on done: 787360.0 [2024-08-06 06:53:36,962][52665] Sum rewards: 72.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.134', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:37,009][52649] DAMAGECOUNT value on done: 785411.0 [2024-08-06 06:53:37,010][52649] Sum rewards: 77.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.108', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.056', 'weapon5': '0.098', 'AMMO4': '0.138', 'AMMO3': '0.161', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.230', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:37,552][52794] DAMAGECOUNT value on done: 802050.0 [2024-08-06 06:53:37,553][52794] Sum rewards: 79.189, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.458', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.305', 'weapon2': '0.390', 'WEAPON3': '1.800', 'weapon3': '3.180', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '69.000'} [2024-08-06 06:53:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 592314368. Throughput: 0: 4371.6. Samples: 148081000. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:53:37,794][52567] Avg episode reward: [(0, '75.488')] [2024-08-06 06:53:38,206][52663] DAMAGECOUNT value on done: 798934.0 [2024-08-06 06:53:38,206][52663] Sum rewards: 82.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'AMMO2': '0.018', 'weapon4': '0.060', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.237', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.522', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '70.000'} [2024-08-06 06:53:38,518][52671] DAMAGECOUNT value on done: 804529.0 [2024-08-06 06:53:38,518][52671] Sum rewards: 65.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.086', 'AMMO4': '0.161', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.384', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '55.000'} [2024-08-06 06:53:38,907][52658] DAMAGECOUNT value on done: 811008.0 [2024-08-06 06:53:38,910][52658] Sum rewards: 75.992, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.090', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.052', 'weapon5': '0.100', 'AMMO4': '0.207', 'AMMO3': '0.300', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.750', 'weapon3': '3.238', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:39,183][52647] DAMAGECOUNT value on done: 832240.0 [2024-08-06 06:53:39,183][52647] Sum rewards: 84.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.866', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.052', 'AMMO4': '0.068', 'weapon5': '0.072', 'AMMO3': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.772', 'WEAPON3': '0.900', 'weapon3': '2.954', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '67.000'} [2024-08-06 06:53:39,229][52669] DAMAGECOUNT value on done: 798629.0 [2024-08-06 06:53:39,232][52669] Sum rewards: 82.860, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.206', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.152', 'AMMO3': '0.198', 'AMMO4': '0.222', 'weapon5': '0.282', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '68.000'} [2024-08-06 06:53:40,191][52665] DAMAGECOUNT value on done: 794630.0 [2024-08-06 06:53:40,195][52665] Sum rewards: 68.941, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.118', 'AMMO4': '0.185', 'weapon5': '0.212', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '58.000'} [2024-08-06 06:53:40,284][52649] DAMAGECOUNT value on done: 774830.0 [2024-08-06 06:53:40,285][52649] Sum rewards: 74.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.245', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:40,740][52794] DAMAGECOUNT value on done: 810566.0 [2024-08-06 06:53:40,740][52794] Sum rewards: 70.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.445', 'AMMO5': '0.009', 'weapon4': '0.028', 'weapon5': '0.038', 'AMMO2': '0.040', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.240', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.398', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '59.000'} [2024-08-06 06:53:41,273][52663] DAMAGECOUNT value on done: 804827.0 [2024-08-06 06:53:41,275][52663] Sum rewards: 72.182, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.958', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.239', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:41,396][52671] DAMAGECOUNT value on done: 813085.0 [2024-08-06 06:53:41,396][52671] Sum rewards: 78.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:41,491][52650] Updated weights for policy 0, policy_version 72311 (0.0017) [2024-08-06 06:53:41,971][52658] DAMAGECOUNT value on done: 799354.0 [2024-08-06 06:53:41,981][52658] Sum rewards: 78.435, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.425', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.043', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.218', 'weapon4': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:42,248][52669] DAMAGECOUNT value on done: 802945.0 [2024-08-06 06:53:42,252][52669] Sum rewards: 80.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.981', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.172', 'weapon5': '0.192', 'AMMO3': '0.218', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 592396288. Throughput: 0: 4368.4. Samples: 148106940. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:53:42,794][52567] Avg episode reward: [(0, '75.675')] [2024-08-06 06:53:43,273][52665] DAMAGECOUNT value on done: 786339.0 [2024-08-06 06:53:43,275][52665] Sum rewards: 70.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.586', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.161', 'weapon5': '0.174', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.050', 'weapon3': '2.916', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '56.000'} [2024-08-06 06:53:43,972][52794] DAMAGECOUNT value on done: 801976.0 [2024-08-06 06:53:43,974][52794] Sum rewards: 82.308, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.955', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon2': '0.180', 'weapon5': '0.180', 'weapon4': '0.184', 'AMMO3': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.184', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.589', 'FRAGCOUNT': '70.000'} [2024-08-06 06:53:44,087][52663] DAMAGECOUNT value on done: 794694.0 [2024-08-06 06:53:44,087][52663] Sum rewards: 82.001, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.311', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.022', 'AMMO4': '0.049', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon2': '0.640', 'WEAPON3': '0.950', 'weapon3': '3.146', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.500'} [2024-08-06 06:53:44,179][52671] DAMAGECOUNT value on done: 801659.0 [2024-08-06 06:53:44,181][52671] Sum rewards: 60.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.129', 'weapon7': '0.158', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.300', 'weapon4': '0.604', 'WEAPON3': '1.150', 'weapon3': '2.558', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '51.000'} [2024-08-06 06:53:45,047][52658] DAMAGECOUNT value on done: 805048.0 [2024-08-06 06:53:45,047][52658] Sum rewards: 92.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.167', 'AMMO5': '0.021', 'AMMO2': '0.047', 'AMMO3': '0.149', 'weapon5': '0.230', 'AMMO4': '0.235', 'weapon2': '0.244', 'weapon4': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.974', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.369', 'FRAGCOUNT': '74.000'} [2024-08-06 06:53:45,363][52669] DAMAGECOUNT value on done: 801022.0 [2024-08-06 06:53:45,365][52669] Sum rewards: 79.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.076', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.094', 'weapon5': '0.136', 'AMMO4': '0.141', 'AMMO3': '0.219', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:45,730][52650] Updated weights for policy 0, policy_version 72321 (0.0015) [2024-08-06 06:53:46,422][52665] DAMAGECOUNT value on done: 796814.0 [2024-08-06 06:53:46,422][52665] Sum rewards: 76.047, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.048', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '62.000'} [2024-08-06 06:53:46,970][52663] DAMAGECOUNT value on done: 785931.0 [2024-08-06 06:53:46,971][52663] Sum rewards: 61.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.056', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.110', 'weapon5': '0.178', 'AMMO3': '0.198', 'AMMO4': '0.297', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '51.000'} [2024-08-06 06:53:47,398][52671] DAMAGECOUNT value on done: 805809.0 [2024-08-06 06:53:47,400][52671] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.239', 'AMMO2': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.042', 'weapon4': '0.042', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:47,558][52658] DAMAGECOUNT value on done: 794722.0 [2024-08-06 06:53:47,559][52658] Sum rewards: 66.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.885', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.130', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.412', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '54.000'} [2024-08-06 06:53:47,795][52567] Fps is (10 sec: 16383.5, 60 sec: 17476.1, 300 sec: 17355.9). Total num frames: 592478208. Throughput: 0: 4360.4. Samples: 148119750. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:53:47,796][52567] Avg episode reward: [(0, '75.494')] [2024-08-06 06:53:47,947][52669] DAMAGECOUNT value on done: 801238.0 [2024-08-06 06:53:47,947][52669] Sum rewards: 74.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.185', 'weapon4': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.242', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:49,139][52665] DAMAGECOUNT value on done: 794375.0 [2024-08-06 06:53:49,141][52665] Sum rewards: 72.436, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.605', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.194', 'weapon5': '0.244', 'weapon2': '0.246', 'weapon4': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.776', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '59.000'} [2024-08-06 06:53:49,726][52670] DAMAGECOUNT value on done: 787326.0 [2024-08-06 06:53:49,726][52670] Sum rewards: 68.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.181', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '57.500'} [2024-08-06 06:53:50,097][52663] DAMAGECOUNT value on done: 790333.0 [2024-08-06 06:53:50,098][52663] Sum rewards: 71.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.132', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.184', 'AMMO4': '0.216', 'AMMO3': '0.250', 'weapon2': '0.266', 'weapon4': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:50,134][52658] DAMAGECOUNT value on done: 804493.0 [2024-08-06 06:53:50,135][52658] Sum rewards: 71.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.178', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon2': '0.174', 'AMMO4': '0.217', 'AMMO3': '0.230', 'weapon5': '0.242', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '59.000'} [2024-08-06 06:53:50,340][52671] DAMAGECOUNT value on done: 803625.0 [2024-08-06 06:53:50,342][52671] Sum rewards: 75.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.786', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.160', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.208', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '61.000'} [2024-08-06 06:53:50,739][52650] Updated weights for policy 0, policy_version 72331 (0.0013) [2024-08-06 06:53:50,886][52669] DAMAGECOUNT value on done: 801817.0 [2024-08-06 06:53:50,888][52669] Sum rewards: 74.483, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.184', 'AMMO4': '0.226', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:51,948][52665] DAMAGECOUNT value on done: 789174.0 [2024-08-06 06:53:51,948][52665] Sum rewards: 74.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.026', 'AMMO2': '0.074', 'weapon4': '0.112', 'AMMO3': '0.209', 'weapon5': '0.304', 'AMMO4': '0.371', 'weapon2': '0.442', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:52,597][52670] DAMAGECOUNT value on done: 800958.0 [2024-08-06 06:53:52,598][52670] Sum rewards: 84.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.342', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.072', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon5': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '70.000'} [2024-08-06 06:53:52,793][52663] DAMAGECOUNT value on done: 795644.0 [2024-08-06 06:53:52,793][52663] Sum rewards: 86.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.020', 'AMMO4': '0.079', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.428', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.696', 'FRAGCOUNT': '70.000'} [2024-08-06 06:53:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 592568320. Throughput: 0: 4358.4. Samples: 148146010. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:53:52,794][52567] Avg episode reward: [(0, '75.345')] [2024-08-06 06:53:52,987][52658] DAMAGECOUNT value on done: 784849.0 [2024-08-06 06:53:52,987][52658] Sum rewards: 74.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.677', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.066', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.228', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.436', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:53,120][52671] DAMAGECOUNT value on done: 792254.0 [2024-08-06 06:53:53,122][52671] Sum rewards: 80.656, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.022', 'AMMO2': '0.067', 'weapon4': '0.124', 'AMMO3': '0.250', 'weapon5': '0.268', 'AMMO4': '0.336', 'weapon2': '0.396', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.868', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '69.000'} [2024-08-06 06:53:53,249][52666] DAMAGECOUNT value on done: 796734.0 [2024-08-06 06:53:53,249][52666] Sum rewards: 66.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.090', 'weapon5': '0.092', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '55.000'} [2024-08-06 06:53:53,693][52669] DAMAGECOUNT value on done: 810907.0 [2024-08-06 06:53:53,695][52669] Sum rewards: 74.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.670', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.027', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.194', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:55,145][52670] DAMAGECOUNT value on done: 786937.0 [2024-08-06 06:53:55,146][52670] Sum rewards: 89.342, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.068', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.094', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '73.000'} [2024-08-06 06:53:55,214][52650] Updated weights for policy 0, policy_version 72341 (0.0013) [2024-08-06 06:53:55,243][52665] DAMAGECOUNT value on done: 790794.0 [2024-08-06 06:53:55,243][52665] Sum rewards: 71.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.403', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.198', 'weapon4': '0.222', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.122', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 06:53:55,559][52663] DAMAGECOUNT value on done: 805799.0 [2024-08-06 06:53:55,560][52663] Sum rewards: 86.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.565', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.112', 'AMMO4': '0.170', 'weapon4': '0.196', 'weapon2': '0.204', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '71.000'} [2024-08-06 06:53:55,706][52666] DAMAGECOUNT value on done: 792668.0 [2024-08-06 06:53:55,706][52666] Sum rewards: 65.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.720', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.108', 'AMMO3': '0.187', 'weapon5': '0.216', 'AMMO4': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.030', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '54.000'} [2024-08-06 06:53:55,724][52671] DAMAGECOUNT value on done: 804166.0 [2024-08-06 06:53:55,725][52671] Sum rewards: 76.966, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.086', 'AMMO4': '0.091', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '63.000'} [2024-08-06 06:53:56,183][52669] DAMAGECOUNT value on done: 802753.0 [2024-08-06 06:53:56,183][52669] Sum rewards: 60.340, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.834', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.116', 'weapon4': '0.134', 'AMMO3': '0.135', 'AMMO4': '0.145', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.818', 'WEAPON3': '0.850', 'weapon3': '2.660', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.624', 'FRAGCOUNT': '46.000'} [2024-08-06 06:53:56,263][52658] DAMAGECOUNT value on done: 804460.0 [2024-08-06 06:53:56,263][52658] Sum rewards: 81.422, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.374', 'HEALTH': '0.438', 'WEAPON3': '0.900', 'weapon3': '3.350', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:57,664][52670] DAMAGECOUNT value on done: 786523.0 [2024-08-06 06:53:57,678][52670] Sum rewards: 76.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.998', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'weapon2': '0.308', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '66.000'} [2024-08-06 06:53:57,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 592658432. Throughput: 0: 4358.4. Samples: 148172300. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:53:57,794][52567] Avg episode reward: [(0, '74.931')] [2024-08-06 06:53:58,111][52663] DAMAGECOUNT value on done: 787130.0 [2024-08-06 06:53:58,111][52663] Sum rewards: 64.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.688', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.058', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.324', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.400', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '53.000'} [2024-08-06 06:53:58,353][52666] DAMAGECOUNT value on done: 796199.0 [2024-08-06 06:53:58,354][52666] Sum rewards: 78.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.548', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.114', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.262', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '64.000'} [2024-08-06 06:53:58,385][52665] DAMAGECOUNT value on done: 785787.0 [2024-08-06 06:53:58,386][52665] Sum rewards: 66.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.848', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.096', 'weapon4': '0.116', 'AMMO4': '0.136', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.206', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '58.000'} [2024-08-06 06:53:58,649][52671] DAMAGECOUNT value on done: 802863.0 [2024-08-06 06:53:58,650][52671] Sum rewards: 75.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.806', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.176', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon5': '0.206', 'weapon4': '0.236', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '60.000'} [2024-08-06 06:53:58,823][52669] DAMAGECOUNT value on done: 804861.0 [2024-08-06 06:53:58,823][52669] Sum rewards: 71.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.116', 'AMMO4': '0.136', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '58.000'} [2024-08-06 06:53:59,263][52658] DAMAGECOUNT value on done: 795615.0 [2024-08-06 06:53:59,264][52658] Sum rewards: 77.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.738', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 06:54:00,231][52650] Updated weights for policy 0, policy_version 72351 (0.0014) [2024-08-06 06:54:00,562][52670] DAMAGECOUNT value on done: 799655.0 [2024-08-06 06:54:00,564][52670] Sum rewards: 75.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.020', 'AMMO2': '0.037', 'weapon5': '0.138', 'weapon4': '0.140', 'AMMO3': '0.174', 'AMMO4': '0.183', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '63.000'} [2024-08-06 06:54:00,752][52663] DAMAGECOUNT value on done: 783228.0 [2024-08-06 06:54:00,752][52663] Sum rewards: 71.654, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.344', 'AMMO5': '0.016', 'AMMO2': '0.066', 'weapon4': '0.168', 'weapon5': '0.182', 'AMMO3': '0.277', 'weapon2': '0.312', 'AMMO4': '0.332', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.032', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:01,381][52666] DAMAGECOUNT value on done: 795912.0 [2024-08-06 06:54:01,381][52666] Sum rewards: 78.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.152', 'AMMO4': '0.171', 'weapon2': '0.172', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:01,508][52671] DAMAGECOUNT value on done: 799274.0 [2024-08-06 06:54:01,510][52671] Sum rewards: 86.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.174', 'AMMO3': '0.223', 'weapon4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '70.000'} [2024-08-06 06:54:01,604][52669] DAMAGECOUNT value on done: 810192.0 [2024-08-06 06:54:01,606][52669] Sum rewards: 69.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.883', 'AMMO5': '0.025', 'AMMO2': '0.054', 'weapon4': '0.114', 'AMMO3': '0.190', 'weapon2': '0.226', 'AMMO4': '0.270', 'weapon5': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.092', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '57.000'} [2024-08-06 06:54:01,817][52665] DAMAGECOUNT value on done: 792279.0 [2024-08-06 06:54:01,820][52665] Sum rewards: 74.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.399', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon2': '0.216', 'AMMO3': '0.261', 'weapon5': '0.262', 'AMMO4': '0.298', 'WEAPON5': '0.400', 'weapon4': '0.520', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.684', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:02,311][52658] DAMAGECOUNT value on done: 792277.0 [2024-08-06 06:54:02,311][52658] Sum rewards: 58.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.924', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.154', 'AMMO3': '0.166', 'weapon5': '0.188', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.644', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '48.000'} [2024-08-06 06:54:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 592740352. Throughput: 0: 4354.7. Samples: 148185330. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:54:02,794][52567] Avg episode reward: [(0, '74.661')] [2024-08-06 06:54:03,707][52670] DAMAGECOUNT value on done: 790303.0 [2024-08-06 06:54:03,707][52670] Sum rewards: 73.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.024', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.088', 'weapon2': '0.120', 'AMMO4': '0.123', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '3.210', 'weapon3': '3.216', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:04,047][52663] DAMAGECOUNT value on done: 792535.0 [2024-08-06 06:54:04,048][52663] Sum rewards: 68.025, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.455', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.228', 'weapon4': '0.236', 'AMMO3': '0.267', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '57.000'} [2024-08-06 06:54:04,209][52665] DAMAGECOUNT value on done: 791839.0 [2024-08-06 06:54:04,211][52665] Sum rewards: 77.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.790', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon2': '0.170', 'weapon5': '0.212', 'AMMO4': '0.224', 'AMMO3': '0.249', 'weapon4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.034', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:04,312][52671] DAMAGECOUNT value on done: 808320.0 [2024-08-06 06:54:04,312][52671] Sum rewards: 61.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.494', 'WEAPON3': '1.300', 'HITCOUNT': '2.860', 'weapon3': '3.266', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '51.000'} [2024-08-06 06:54:04,514][52666] DAMAGECOUNT value on done: 788622.0 [2024-08-06 06:54:04,514][52666] Sum rewards: 68.133, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.705', 'AMMO2': '0.013', 'AMMO5': '0.015', 'weapon4': '0.022', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'weapon5': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.884', 'WEAPON3': '1.150', 'weapon3': '2.606', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '53.000'} [2024-08-06 06:54:04,643][52669] DAMAGECOUNT value on done: 794239.0 [2024-08-06 06:54:04,644][52669] Sum rewards: 73.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.108', 'weapon5': '0.166', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.168', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '60.000'} [2024-08-06 06:54:04,936][52650] Updated weights for policy 0, policy_version 72361 (0.0030) [2024-08-06 06:54:05,192][52658] DAMAGECOUNT value on done: 801313.0 [2024-08-06 06:54:05,193][52658] Sum rewards: 75.863, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.902', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.144', 'weapon5': '0.180', 'AMMO3': '0.189', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:06,406][52663] DAMAGECOUNT value on done: 791651.0 [2024-08-06 06:54:06,407][52663] Sum rewards: 73.899, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.122', 'weapon5': '0.132', 'AMMO4': '0.174', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:06,798][52668] DAMAGECOUNT value on done: 803799.0 [2024-08-06 06:54:06,800][52668] Sum rewards: 88.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.471', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.098', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '74.000'} [2024-08-06 06:54:06,941][52665] DAMAGECOUNT value on done: 783650.0 [2024-08-06 06:54:06,942][52665] Sum rewards: 74.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.681', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.114', 'AMMO4': '0.165', 'weapon2': '0.176', 'weapon5': '0.184', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:07,144][52670] DAMAGECOUNT value on done: 784872.0 [2024-08-06 06:54:07,145][52670] Sum rewards: 75.767, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.725', 'AMMO5': '0.013', 'weapon4': '0.026', 'AMMO2': '0.031', 'weapon5': '0.068', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.550', 'weapon3': '3.294', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:07,422][52669] DAMAGECOUNT value on done: 794890.0 [2024-08-06 06:54:07,423][52669] Sum rewards: 73.454, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.405', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.169', 'AMMO4': '0.246', 'weapon5': '0.252', 'weapon4': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.758', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 06:54:07,608][52671] DAMAGECOUNT value on done: 803473.0 [2024-08-06 06:54:07,610][52671] Sum rewards: 88.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.797', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.054', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '73.000'} [2024-08-06 06:54:07,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17383.7). Total num frames: 592830464. Throughput: 0: 4358.6. Samples: 148211680. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:54:07,802][52567] Avg episode reward: [(0, '74.343')] [2024-08-06 06:54:07,799][52666] DAMAGECOUNT value on done: 795455.0 [2024-08-06 06:54:07,803][52666] Sum rewards: 67.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.195', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.124', 'AMMO3': '0.173', 'weapon5': '0.266', 'weapon2': '0.290', 'AMMO4': '0.293', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '56.000'} [2024-08-06 06:54:09,372][52650] Updated weights for policy 0, policy_version 72371 (0.0035) [2024-08-06 06:54:09,646][52663] DAMAGECOUNT value on done: 802741.0 [2024-08-06 06:54:09,646][52663] Sum rewards: 67.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.154', 'weapon5': '0.208', 'AMMO3': '0.233', 'AMMO4': '0.276', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.094', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:09,732][52668] DAMAGECOUNT value on done: 806663.0 [2024-08-06 06:54:09,732][52668] Sum rewards: 87.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.287', 'AMMO5': '0.011', 'weapon4': '0.014', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.600', 'weapon3': '3.126', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '74.000'} [2024-08-06 06:54:09,779][52670] DAMAGECOUNT value on done: 788282.0 [2024-08-06 06:54:09,780][52670] Sum rewards: 64.529, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.550', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.183', 'weapon5': '0.198', 'AMMO4': '0.233', 'weapon2': '0.356', 'weapon4': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '51.500'} [2024-08-06 06:54:10,078][52665] DAMAGECOUNT value on done: 787115.0 [2024-08-06 06:54:10,078][52665] Sum rewards: 88.824, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.236', 'HEALTH': '0.269', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.450', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '74.000'} [2024-08-06 06:54:10,545][52669] DAMAGECOUNT value on done: 802238.0 [2024-08-06 06:54:10,548][52669] Sum rewards: 64.608, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.640', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.196', 'weapon4': '0.246', 'AMMO4': '0.284', 'weapon5': '0.330', 'weapon2': '0.348', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.766', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '54.000'} [2024-08-06 06:54:10,738][52666] DAMAGECOUNT value on done: 790889.0 [2024-08-06 06:54:10,739][52666] Sum rewards: 79.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.955', 'AMMO5': '0.009', 'weapon4': '0.016', 'weapon5': '0.022', 'AMMO2': '0.040', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.374', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:10,767][52671] DAMAGECOUNT value on done: 789852.0 [2024-08-06 06:54:10,767][52671] Sum rewards: 74.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.716', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.072', 'AMMO4': '0.162', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:12,219][52663] DAMAGECOUNT value on done: 795172.0 [2024-08-06 06:54:12,221][52663] Sum rewards: 78.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.209', 'weapon2': '0.248', 'AMMO4': '0.261', 'weapon5': '0.312', 'weapon4': '0.458', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.666', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:12,650][52668] DAMAGECOUNT value on done: 801363.0 [2024-08-06 06:54:12,651][52668] Sum rewards: 52.038, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.076', 'weapon5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.934', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.049', 'FRAGCOUNT': '45.500'} [2024-08-06 06:54:12,726][52670] DAMAGECOUNT value on done: 790737.0 [2024-08-06 06:54:12,727][52670] Sum rewards: 75.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.184', 'weapon5': '0.190', 'AMMO3': '0.199', 'AMMO4': '0.252', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 592912384. Throughput: 0: 4368.0. Samples: 148238060. Policy #0 lag: (min: 1.0, avg: 3.9, max: 9.0) [2024-08-06 06:54:12,794][52567] Avg episode reward: [(0, '74.743')] [2024-08-06 06:54:13,074][52665] DAMAGECOUNT value on done: 791658.0 [2024-08-06 06:54:13,075][52665] Sum rewards: 72.684, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.178', 'weapon5': '0.180', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '58.000'} [2024-08-06 06:54:13,187][52669] DAMAGECOUNT value on done: 822320.0 [2024-08-06 06:54:13,188][52669] Sum rewards: 68.552, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.007', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.040', 'weapon5': '0.094', 'AMMO4': '0.183', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '56.000'} [2024-08-06 06:54:13,381][52666] DAMAGECOUNT value on done: 786126.0 [2024-08-06 06:54:13,382][52666] Sum rewards: 88.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.422', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.218', 'weapon2': '0.262', 'WEAPON3': '1.300', 'weapon3': '3.448', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '73.000'} [2024-08-06 06:54:13,858][52650] Updated weights for policy 0, policy_version 72381 (0.0011) [2024-08-06 06:54:14,107][52671] DAMAGECOUNT value on done: 811108.0 [2024-08-06 06:54:14,109][52671] Sum rewards: 81.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.262', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.181', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:14,952][52663] DAMAGECOUNT value on done: 800961.0 [2024-08-06 06:54:14,953][52663] Sum rewards: 82.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.674', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.168', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.976', 'FRAGCOUNT': '69.000'} [2024-08-06 06:54:15,491][52670] DAMAGECOUNT value on done: 785317.0 [2024-08-06 06:54:15,491][52670] Sum rewards: 70.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.125', 'AMMO5': '0.007', 'weapon4': '0.020', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.696', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '60.000'} [2024-08-06 06:54:15,794][52668] DAMAGECOUNT value on done: 808080.0 [2024-08-06 06:54:15,795][52668] Sum rewards: 69.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.951', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.106', 'AMMO3': '0.211', 'weapon5': '0.220', 'AMMO4': '0.255', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.972', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:15,859][52669] DAMAGECOUNT value on done: 809357.0 [2024-08-06 06:54:15,861][52669] Sum rewards: 67.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.310', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.048', 'weapon5': '0.126', 'AMMO4': '0.188', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.700', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:16,328][52666] DAMAGECOUNT value on done: 793841.0 [2024-08-06 06:54:16,328][52666] Sum rewards: 61.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon5': '0.164', 'AMMO3': '0.173', 'AMMO4': '0.288', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.462', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '48.500'} [2024-08-06 06:54:16,782][52665] Large shaping reward 2.554 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.534, 178.0)] [2024-08-06 06:54:17,171][52671] DAMAGECOUNT value on done: 809328.0 [2024-08-06 06:54:17,172][52671] Sum rewards: 82.216, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.858', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon2': '0.166', 'weapon5': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '68.000'} [2024-08-06 06:54:17,474][52663] DAMAGECOUNT value on done: 805889.0 [2024-08-06 06:54:17,474][52663] Sum rewards: 80.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.312', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.122', 'AMMO4': '0.172', 'AMMO3': '0.198', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '67.000'} [2024-08-06 06:54:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 593010688. Throughput: 0: 4363.1. Samples: 148251120. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:17,802][52567] Avg episode reward: [(0, '74.976')] [2024-08-06 06:54:18,244][52669] DAMAGECOUNT value on done: 804168.0 [2024-08-06 06:54:18,245][52669] Sum rewards: 84.579, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.320', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO5': '0.008', 'weapon5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '68.000'} [2024-08-06 06:54:18,429][52670] DAMAGECOUNT value on done: 797255.0 [2024-08-06 06:54:18,429][52670] Sum rewards: 78.663, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.058', 'weapon4': '0.094', 'HEALTH': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.050', 'weapon3': '3.338', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '63.500'} [2024-08-06 06:54:18,912][52650] Updated weights for policy 0, policy_version 72391 (0.0023) [2024-08-06 06:54:19,224][52666] DAMAGECOUNT value on done: 788601.0 [2024-08-06 06:54:19,226][52666] Sum rewards: 84.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.754', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.201', 'weapon5': '0.210', 'weapon2': '0.298', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '67.500'} [2024-08-06 06:54:19,266][52668] DAMAGECOUNT value on done: 790844.0 [2024-08-06 06:54:19,267][52668] Sum rewards: 66.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.118', 'AMMO4': '0.169', 'weapon2': '0.214', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.366', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:19,734][52671] DAMAGECOUNT value on done: 805186.0 [2024-08-06 06:54:19,737][52671] Sum rewards: 80.970, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.360', 'HEALTH': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '67.000'} [2024-08-06 06:54:20,030][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:54:20,485][52663] DAMAGECOUNT value on done: 791236.0 [2024-08-06 06:54:20,486][52663] Sum rewards: 78.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.056', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '63.000'} [2024-08-06 06:54:21,149][52669] DAMAGECOUNT value on done: 808826.0 [2024-08-06 06:54:21,149][52669] Sum rewards: 76.844, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.881', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.148', 'weapon5': '0.150', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.740', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '60.000'} [2024-08-06 06:54:21,154][52670] DAMAGECOUNT value on done: 780774.0 [2024-08-06 06:54:21,155][52670] Sum rewards: 77.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.237', 'weapon2': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:21,941][52666] DAMAGECOUNT value on done: 795510.0 [2024-08-06 06:54:21,943][52666] Sum rewards: 75.521, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.772', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.054', 'weapon5': '0.124', 'AMMO4': '0.196', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.700', 'weapon3': '3.292', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '66.000'} [2024-08-06 06:54:22,259][52668] DAMAGECOUNT value on done: 803666.0 [2024-08-06 06:54:22,260][52668] Sum rewards: 69.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.178', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.326', 'WEAPON3': '1.400', 'HITCOUNT': '3.270', 'weapon3': '3.396', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '60.000'} [2024-08-06 06:54:22,721][52671] DAMAGECOUNT value on done: 808850.0 [2024-08-06 06:54:22,723][52671] Sum rewards: 63.421, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.737', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.153', 'weapon4': '0.166', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '55.500'} [2024-08-06 06:54:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 593100800. Throughput: 0: 4362.9. Samples: 148277330. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:22,794][52567] Avg episode reward: [(0, '74.745')] [2024-08-06 06:54:23,476][52650] Updated weights for policy 0, policy_version 72401 (0.0011) [2024-08-06 06:54:23,600][52669] DAMAGECOUNT value on done: 811533.0 [2024-08-06 06:54:23,600][52669] Sum rewards: 71.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.250', 'weapon4': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:24,256][52670] DAMAGECOUNT value on done: 792272.0 [2024-08-06 06:54:24,259][52670] Sum rewards: 74.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.209', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:24,928][52666] DAMAGECOUNT value on done: 783151.0 [2024-08-06 06:54:24,929][52666] Sum rewards: 73.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.212', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:25,445][52668] DAMAGECOUNT value on done: 803407.0 [2024-08-06 06:54:25,445][52668] Sum rewards: 63.080, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO5': '0.023', 'AMMO2': '0.062', 'weapon4': '0.086', 'AMMO3': '0.230', 'weapon5': '0.254', 'AMMO4': '0.308', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.850', 'weapon3': '2.924', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '52.000'} [2024-08-06 06:54:25,453][52671] DAMAGECOUNT value on done: 796716.0 [2024-08-06 06:54:25,455][52671] Sum rewards: 74.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.713', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.106', 'AMMO4': '0.168', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '64.000'} [2024-08-06 06:54:25,534][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:54:26,955][52670] DAMAGECOUNT value on done: 800412.0 [2024-08-06 06:54:26,959][52670] Sum rewards: 63.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.288', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.226', 'weapon5': '0.250', 'AMMO4': '0.273', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.356', 'ARMOR': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.732', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '53.000'} [2024-08-06 06:54:27,790][52666] DAMAGECOUNT value on done: 797511.0 [2024-08-06 06:54:27,791][52666] Sum rewards: 71.616, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.996', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.246', 'WEAPON3': '1.150', 'HITCOUNT': '3.390', 'weapon3': '3.528', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 06:54:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 593182720. Throughput: 0: 4364.9. Samples: 148303360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:27,794][52567] Avg episode reward: [(0, '74.409')] [2024-08-06 06:54:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072410_593182720.pth... [2024-08-06 06:54:27,922][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000071900_589004800.pth [2024-08-06 06:54:28,228][52650] Updated weights for policy 0, policy_version 72411 (0.0028) [2024-08-06 06:54:28,309][52668] DAMAGECOUNT value on done: 794353.0 [2024-08-06 06:54:28,311][52668] Sum rewards: 63.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.622', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.100', 'AMMO4': '0.131', 'weapon5': '0.132', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.024', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '55.000'} [2024-08-06 06:54:29,772][52670] DAMAGECOUNT value on done: 794808.0 [2024-08-06 06:54:29,773][52670] Sum rewards: 84.974, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.380', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.163', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.352', 'WEAPON3': '1.650', 'weapon3': '2.936', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.672', 'FRAGCOUNT': '71.000'} [2024-08-06 06:54:30,628][52666] DAMAGECOUNT value on done: 792575.0 [2024-08-06 06:54:30,630][52666] Sum rewards: 72.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.545', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.165', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '60.000'} [2024-08-06 06:54:31,150][52668] DAMAGECOUNT value on done: 795771.0 [2024-08-06 06:54:31,150][52668] Sum rewards: 79.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.141', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.374', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '64.000'} [2024-08-06 06:54:32,464][52670] DAMAGECOUNT value on done: 774647.0 [2024-08-06 06:54:32,464][52670] Sum rewards: 78.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon4': '0.110', 'AMMO3': '0.204', 'weapon5': '0.246', 'AMMO4': '0.309', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '64.000'} [2024-08-06 06:54:32,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 593256448. Throughput: 0: 4335.4. Samples: 148314840. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:32,794][52567] Avg episode reward: [(0, '74.197')] [2024-08-06 06:54:32,986][52662] DAMAGECOUNT value on done: 799195.0 [2024-08-06 06:54:32,986][52662] Sum rewards: 79.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.258', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.207', 'weapon4': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:33,213][52666] DAMAGECOUNT value on done: 792017.0 [2024-08-06 06:54:33,214][52666] Sum rewards: 77.180, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.269', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.183', 'weapon4': '0.246', 'AMMO4': '0.253', 'weapon5': '0.284', 'weapon2': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '63.000'} [2024-08-06 06:54:33,497][52650] Updated weights for policy 0, policy_version 72421 (0.0014) [2024-08-06 06:54:34,346][52668] DAMAGECOUNT value on done: 805018.0 [2024-08-06 06:54:34,346][52668] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.228', 'AMMO5': '0.010', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.194', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '64.000'} [2024-08-06 06:54:35,338][52670] DAMAGECOUNT value on done: 789345.0 [2024-08-06 06:54:35,338][52670] Sum rewards: 74.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.946', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.026', 'AMMO4': '0.090', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '60.000'} [2024-08-06 06:54:35,931][52662] DAMAGECOUNT value on done: 808744.0 [2024-08-06 06:54:35,932][52662] Sum rewards: 73.310, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon5': '0.172', 'weapon4': '0.174', 'AMMO3': '0.239', 'AMMO4': '0.249', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.886', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 06:54:36,267][52666] DAMAGECOUNT value on done: 789279.0 [2024-08-06 06:54:36,268][52666] Sum rewards: 86.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO3': '0.188', 'AMMO4': '0.201', 'weapon4': '0.248', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '71.000'} [2024-08-06 06:54:37,039][52668] DAMAGECOUNT value on done: 798495.0 [2024-08-06 06:54:37,041][52668] Sum rewards: 82.578, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.595', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.138', 'AMMO3': '0.163', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '66.000'} [2024-08-06 06:54:37,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17066.7, 300 sec: 17328.2). Total num frames: 593338368. Throughput: 0: 4296.2. Samples: 148339340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:37,794][52567] Avg episode reward: [(0, '74.647')] [2024-08-06 06:54:38,225][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:54:38,302][52670] DAMAGECOUNT value on done: 798017.0 [2024-08-06 06:54:38,303][52670] Sum rewards: 76.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.498', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:38,397][52650] Updated weights for policy 0, policy_version 72431 (0.0012) [2024-08-06 06:54:38,609][52662] DAMAGECOUNT value on done: 810421.0 [2024-08-06 06:54:38,609][52662] Sum rewards: 71.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO5': '0.007', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.058', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.368', 'WEAPON3': '1.100', 'HITCOUNT': '3.320', 'weapon3': '3.344', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '58.000'} [2024-08-06 06:54:39,305][52666] DAMAGECOUNT value on done: 788913.0 [2024-08-06 06:54:39,305][52666] Sum rewards: 73.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.488', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.116', 'weapon5': '0.170', 'AMMO4': '0.184', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:40,277][52668] DAMAGECOUNT value on done: 792028.0 [2024-08-06 06:54:40,279][52668] Sum rewards: 69.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.868', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.059', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.570', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:40,931][52670] DAMAGECOUNT value on done: 793472.0 [2024-08-06 06:54:40,932][52670] Sum rewards: 68.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.925', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.058', 'AMMO4': '0.184', 'AMMO3': '0.188', 'weapon5': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 06:54:41,475][52811] DAMAGECOUNT value on done: 761645.0 [2024-08-06 06:54:41,476][52811] Sum rewards: 74.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.287', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.220', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.432', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:41,857][52666] DAMAGECOUNT value on done: 804069.0 [2024-08-06 06:54:41,860][52666] Sum rewards: 76.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.335', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.125', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.704', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:41,870][52662] DAMAGECOUNT value on done: 794734.0 [2024-08-06 06:54:41,870][52662] Sum rewards: 84.850, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.900', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '69.000'} [2024-08-06 06:54:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 593428480. Throughput: 0: 4302.2. Samples: 148365900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:42,795][52567] Avg episode reward: [(0, '74.767')] [2024-08-06 06:54:42,815][52650] Updated weights for policy 0, policy_version 72441 (0.0011) [2024-08-06 06:54:43,138][52668] DAMAGECOUNT value on done: 788625.0 [2024-08-06 06:54:43,139][52668] Sum rewards: 82.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.033', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.082', 'AMMO3': '0.203', 'weapon5': '0.226', 'AMMO4': '0.231', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '66.000'} [2024-08-06 06:54:43,952][52670] DAMAGECOUNT value on done: 796111.0 [2024-08-06 06:54:43,954][52670] Sum rewards: 61.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.045', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.136', 'AMMO4': '0.193', 'AMMO3': '0.273', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.142', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '54.000'} [2024-08-06 06:54:44,706][52662] DAMAGECOUNT value on done: 811535.0 [2024-08-06 06:54:44,706][52662] Sum rewards: 81.340, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.016', 'HEALTH': '0.048', 'AMMO4': '0.082', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.286', 'weapon2': '0.488', 'WEAPON3': '0.950', 'weapon3': '2.950', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:44,761][52811] DAMAGECOUNT value on done: 745776.0 [2024-08-06 06:54:44,761][52811] Sum rewards: 79.471, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.974', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.108', 'AMMO4': '0.162', 'weapon5': '0.176', 'weapon2': '0.304', 'AMMO3': '0.307', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.086', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.255', 'FRAGCOUNT': '68.000'} [2024-08-06 06:54:44,824][52666] DAMAGECOUNT value on done: 781814.0 [2024-08-06 06:54:44,825][52666] Sum rewards: 72.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.403', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.384', 'weapon4': '0.418', 'WEAPON3': '1.500', 'weapon3': '2.796', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:46,174][52668] DAMAGECOUNT value on done: 789860.0 [2024-08-06 06:54:46,175][52668] Sum rewards: 71.274, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-3.722', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon5': '0.084', 'weapon2': '0.280', 'AMMO4': '0.294', 'weapon4': '0.306', 'AMMO3': '0.325', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.900', 'weapon3': '2.984', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '64.500'} [2024-08-06 06:54:47,534][52650] Updated weights for policy 0, policy_version 72451 (0.0011) [2024-08-06 06:54:47,735][52811] DAMAGECOUNT value on done: 739327.0 [2024-08-06 06:54:47,736][52811] Sum rewards: 73.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.932', 'AMMO5': '0.009', 'weapon4': '0.018', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'weapon5': '0.120', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '62.000'} [2024-08-06 06:54:47,753][52666] DAMAGECOUNT value on done: 790883.0 [2024-08-06 06:54:47,753][52666] Sum rewards: 65.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.508', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.057', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.220', 'AMMO3': '0.247', 'WEAPON3': '1.500', 'HITCOUNT': '3.400', 'weapon3': '3.426', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '56.000'} [2024-08-06 06:54:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17339.8, 300 sec: 17355.9). Total num frames: 593518592. Throughput: 0: 4306.2. Samples: 148379110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:47,795][52567] Avg episode reward: [(0, '74.418')] [2024-08-06 06:54:47,965][52662] DAMAGECOUNT value on done: 792113.0 [2024-08-06 06:54:47,966][52662] Sum rewards: 53.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.628', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.078', 'AMMO4': '0.089', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'weapon2': '0.190', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon7': '0.428', 'WEAPON3': '0.850', 'weapon4': '0.866', 'weapon3': '2.046', 'HITCOUNT': '2.450', 'DAMAGECOUNT': '13.059', 'FRAGCOUNT': '44.000'} [2024-08-06 06:54:49,207][52668] DAMAGECOUNT value on done: 785537.0 [2024-08-06 06:54:49,208][52668] Sum rewards: 72.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.176', 'weapon5': '0.196', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:50,785][52811] DAMAGECOUNT value on done: 740686.0 [2024-08-06 06:54:50,787][52662] DAMAGECOUNT value on done: 799432.0 [2024-08-06 06:54:50,789][52811] Sum rewards: 64.741, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.345', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'weapon2': '0.348', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.278', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '51.000'} [2024-08-06 06:54:50,790][52662] Sum rewards: 80.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.108', 'weapon5': '0.112', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '68.000'} [2024-08-06 06:54:51,481][52660] DAMAGECOUNT value on done: 797833.0 [2024-08-06 06:54:51,482][52660] Sum rewards: 72.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.126', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.235', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.402', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '61.000'} [2024-08-06 06:54:52,221][52668] DAMAGECOUNT value on done: 798621.0 [2024-08-06 06:54:52,221][52668] Sum rewards: 70.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.957', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.274', 'WEAPON3': '1.500', 'HITCOUNT': '3.370', 'weapon3': '3.406', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 06:54:52,330][52650] Updated weights for policy 0, policy_version 72461 (0.0014) [2024-08-06 06:54:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 593608704. Throughput: 0: 4304.0. Samples: 148405360. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:52,794][52567] Avg episode reward: [(0, '74.032')] [2024-08-06 06:54:53,602][52662] DAMAGECOUNT value on done: 814463.0 [2024-08-06 06:54:53,604][52662] Sum rewards: 66.957, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'AMMO3': '0.122', 'weapon5': '0.210', 'WEAPON5': '0.250', 'WEAPON3': '0.800', 'weapon2': '0.866', 'weapon3': '2.756', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.153', 'FRAGCOUNT': '52.500'} [2024-08-06 06:54:54,014][52811] DAMAGECOUNT value on done: 747407.0 [2024-08-06 06:54:54,015][52811] Sum rewards: 77.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:54,438][52660] DAMAGECOUNT value on done: 789406.0 [2024-08-06 06:54:54,441][52660] Sum rewards: 68.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.733', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.084', 'AMMO3': '0.235', 'weapon5': '0.244', 'AMMO4': '0.252', 'weapon2': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.030', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 06:54:55,229][52668] DAMAGECOUNT value on done: 801543.0 [2024-08-06 06:54:55,229][52668] Sum rewards: 82.411, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.124', 'weapon5': '0.144', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '66.000'} [2024-08-06 06:54:56,926][52662] DAMAGECOUNT value on done: 802422.0 [2024-08-06 06:54:56,926][52662] Sum rewards: 81.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.472', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.172', 'AMMO3': '0.205', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.913', 'FRAGCOUNT': '65.000'} [2024-08-06 06:54:56,985][52650] Updated weights for policy 0, policy_version 72471 (0.0037) [2024-08-06 06:54:57,055][52811] DAMAGECOUNT value on done: 757694.0 [2024-08-06 06:54:57,055][52811] Sum rewards: 84.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.415', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '70.000'} [2024-08-06 06:54:57,564][52660] DAMAGECOUNT value on done: 802724.0 [2024-08-06 06:54:57,566][52660] Sum rewards: 70.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO4': '0.105', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 06:54:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 593690624. Throughput: 0: 4298.0. Samples: 148431470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 06:54:57,794][52567] Avg episode reward: [(0, '74.261')] [2024-08-06 06:54:58,332][52668] DAMAGECOUNT value on done: 796868.0 [2024-08-06 06:54:58,335][52668] Sum rewards: 63.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.214', 'weapon2': '0.266', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.120', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '53.000'} [2024-08-06 06:54:59,642][52662] DAMAGECOUNT value on done: 807597.0 [2024-08-06 06:54:59,650][52662] Sum rewards: 80.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.111', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.126', 'AMMO4': '0.178', 'weapon2': '0.226', 'weapon4': '0.238', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '67.000'} [2024-08-06 06:55:00,199][52811] DAMAGECOUNT value on done: 752059.0 [2024-08-06 06:55:00,201][52811] Sum rewards: 66.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.176', 'AMMO4': '0.198', 'weapon2': '0.216', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.296', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '57.000'} [2024-08-06 06:55:00,839][52660] DAMAGECOUNT value on done: 813254.0 [2024-08-06 06:55:00,840][52660] Sum rewards: 81.439, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.068', 'AMMO4': '0.093', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '67.000'} [2024-08-06 06:55:01,578][52668] DAMAGECOUNT value on done: 804718.0 [2024-08-06 06:55:01,578][52668] Sum rewards: 70.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.502', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.160', 'AMMO3': '0.241', 'AMMO4': '0.252', 'weapon5': '0.276', 'weapon2': '0.408', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.902', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '59.000'} [2024-08-06 06:55:01,617][52650] Updated weights for policy 0, policy_version 72481 (0.0021) [2024-08-06 06:55:02,271][52662] DAMAGECOUNT value on done: 798331.0 [2024-08-06 06:55:02,271][52662] Sum rewards: 84.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.821', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.158', 'AMMO4': '0.172', 'weapon4': '0.210', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '2.966', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.982', 'FRAGCOUNT': '70.000'} [2024-08-06 06:55:02,693][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:55:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 593780736. Throughput: 0: 4298.4. Samples: 148444550. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:02,794][52567] Avg episode reward: [(0, '74.359')] [2024-08-06 06:55:03,286][52811] DAMAGECOUNT value on done: 744341.0 [2024-08-06 06:55:03,286][52811] Sum rewards: 75.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.268', 'weapon2': '0.288', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:03,704][52660] DAMAGECOUNT value on done: 795295.0 [2024-08-06 06:55:03,706][52660] Sum rewards: 79.185, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.549', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.136', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:04,285][52668] DAMAGECOUNT value on done: 802216.0 [2024-08-06 06:55:04,286][52668] Sum rewards: 73.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.890', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.126', 'weapon5': '0.164', 'AMMO4': '0.240', 'AMMO3': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.006', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:04,768][52662] DAMAGECOUNT value on done: 801134.0 [2024-08-06 06:55:04,768][52662] Sum rewards: 77.435, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.063', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.090', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'weapon2': '0.576', 'WEAPON3': '0.900', 'weapon3': '3.076', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:06,242][52650] Updated weights for policy 0, policy_version 72491 (0.0013) [2024-08-06 06:55:06,394][52811] DAMAGECOUNT value on done: 752772.0 [2024-08-06 06:55:06,394][52811] Sum rewards: 61.240, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon5': '0.150', 'weapon4': '0.164', 'AMMO4': '0.172', 'AMMO3': '0.236', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '51.000'} [2024-08-06 06:55:06,550][52660] DAMAGECOUNT value on done: 790118.0 [2024-08-06 06:55:06,553][52660] Sum rewards: 67.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.569', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'weapon4': '0.158', 'AMMO3': '0.223', 'weapon2': '0.244', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '55.000'} [2024-08-06 06:55:07,163][52662] DAMAGECOUNT value on done: 793673.0 [2024-08-06 06:55:07,163][52662] Sum rewards: 77.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.607', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.098', 'AMMO4': '0.141', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:07,584][52614] Signal inference workers to stop experience collection... (13250 times) [2024-08-06 06:55:07,589][52614] Signal inference workers to resume experience collection... (13250 times) [2024-08-06 06:55:07,624][52650] InferenceWorker_p0-w0: stopping experience collection (13250 times) [2024-08-06 06:55:07,625][52650] InferenceWorker_p0-w0: resuming experience collection (13250 times) [2024-08-06 06:55:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.8, 300 sec: 17383.7). Total num frames: 593870848. Throughput: 0: 4298.2. Samples: 148470750. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:07,794][52567] Avg episode reward: [(0, '74.498')] [2024-08-06 06:55:09,478][52811] DAMAGECOUNT value on done: 748982.0 [2024-08-06 06:55:09,481][52811] Sum rewards: 65.814, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO4': '0.218', 'weapon2': '0.226', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.322', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '56.000'} [2024-08-06 06:55:09,681][52660] DAMAGECOUNT value on done: 798467.0 [2024-08-06 06:55:09,683][52660] Sum rewards: 75.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.543', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.130', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.228', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '62.000'} [2024-08-06 06:55:10,182][52662] DAMAGECOUNT value on done: 805663.0 [2024-08-06 06:55:10,191][52662] Sum rewards: 80.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.707', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.118', 'weapon4': '0.124', 'AMMO4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 06:55:10,855][52650] Updated weights for policy 0, policy_version 72501 (0.0028) [2024-08-06 06:55:12,484][52811] DAMAGECOUNT value on done: 753309.0 [2024-08-06 06:55:12,485][52811] Sum rewards: 59.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.114', 'AMMO3': '0.225', 'AMMO4': '0.266', 'weapon5': '0.268', 'weapon2': '0.394', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '2.870', 'weapon3': '2.918', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '49.000'} [2024-08-06 06:55:12,725][52660] DAMAGECOUNT value on done: 805739.0 [2024-08-06 06:55:12,726][52660] Sum rewards: 77.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.475', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.042', 'AMMO4': '0.132', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 593952768. Throughput: 0: 4307.6. Samples: 148497200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:12,795][52567] Avg episode reward: [(0, '74.231')] [2024-08-06 06:55:13,430][52662] DAMAGECOUNT value on done: 793144.0 [2024-08-06 06:55:13,430][52662] Sum rewards: 87.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.505', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon2': '0.130', 'AMMO4': '0.135', 'weapon5': '0.182', 'AMMO3': '0.188', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '70.000'} [2024-08-06 06:55:14,098][52667] DAMAGECOUNT value on done: 799779.0 [2024-08-06 06:55:14,099][52667] Sum rewards: 81.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.175', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.114', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.374', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '67.000'} [2024-08-06 06:55:15,510][52665] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.054, -18.0), ('weapon5', 0.002)] [2024-08-06 06:55:15,578][52811] DAMAGECOUNT value on done: 758855.0 [2024-08-06 06:55:15,582][52811] Sum rewards: 73.946, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.232', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.128', 'AMMO4': '0.190', 'weapon5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:15,613][52660] DAMAGECOUNT value on done: 792132.0 [2024-08-06 06:55:15,613][52660] Sum rewards: 93.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.490', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.193', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.510', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.168', 'FRAGCOUNT': '76.000'} [2024-08-06 06:55:15,774][52650] Updated weights for policy 0, policy_version 72511 (0.0026) [2024-08-06 06:55:16,526][52662] DAMAGECOUNT value on done: 810120.0 [2024-08-06 06:55:16,528][52662] Sum rewards: 72.522, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.515', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.215', 'AMMO3': '0.258', 'weapon2': '0.280', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.936', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '62.000'} [2024-08-06 06:55:17,266][52667] DAMAGECOUNT value on done: 808685.0 [2024-08-06 06:55:17,266][52667] Sum rewards: 78.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.619', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.127', 'weapon4': '0.142', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 594042880. Throughput: 0: 4342.9. Samples: 148510270. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:17,794][52567] Avg episode reward: [(0, '74.467')] [2024-08-06 06:55:18,686][52660] DAMAGECOUNT value on done: 792159.0 [2024-08-06 06:55:18,687][52660] Sum rewards: 73.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.572', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.078', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '60.000'} [2024-08-06 06:55:18,732][52811] DAMAGECOUNT value on done: 749787.0 [2024-08-06 06:55:18,732][52811] Sum rewards: 61.028, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.673', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'weapon4': '0.140', 'AMMO4': '0.158', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '2.988', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '51.000'} [2024-08-06 06:55:19,400][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:55:19,603][52662] DAMAGECOUNT value on done: 802978.0 [2024-08-06 06:55:19,603][52662] Sum rewards: 79.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.704', 'AMMO5': '0.003', 'weapon5': '0.010', 'weapon4': '0.018', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.233', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '66.000'} [2024-08-06 06:55:19,830][52667] DAMAGECOUNT value on done: 804780.0 [2024-08-06 06:55:19,831][52667] Sum rewards: 80.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.403', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.052', 'weapon5': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:20,299][52650] Updated weights for policy 0, policy_version 72521 (0.0017) [2024-08-06 06:55:21,421][52659] DAMAGECOUNT value on done: 803063.0 [2024-08-06 06:55:21,422][52659] Sum rewards: 69.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon5': '0.180', 'AMMO3': '0.186', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '56.000'} [2024-08-06 06:55:21,778][52811] DAMAGECOUNT value on done: 748517.0 [2024-08-06 06:55:21,778][52811] Sum rewards: 82.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.268', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.100', 'weapon5': '0.112', 'AMMO4': '0.147', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.295', 'FRAGCOUNT': '68.000'} [2024-08-06 06:55:21,911][52660] DAMAGECOUNT value on done: 801195.0 [2024-08-06 06:55:21,911][52660] Sum rewards: 85.768, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.086', 'HEALTH': '0.126', 'AMMO4': '0.139', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '71.000'} [2024-08-06 06:55:22,605][52662] DAMAGECOUNT value on done: 788071.0 [2024-08-06 06:55:22,608][52662] Sum rewards: 80.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.601', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.044', 'weapon5': '0.086', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:22,626][52667] DAMAGECOUNT value on done: 810778.0 [2024-08-06 06:55:22,627][52667] Sum rewards: 75.548, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.148', 'AMMO3': '0.220', 'weapon5': '0.244', 'AMMO4': '0.290', 'weapon2': '0.290', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 594132992. Throughput: 0: 4376.9. Samples: 148536300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:22,794][52567] Avg episode reward: [(0, '74.807')] [2024-08-06 06:55:24,370][52659] DAMAGECOUNT value on done: 800549.0 [2024-08-06 06:55:24,370][52659] Sum rewards: 66.713, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.410', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.104', 'weapon2': '0.242', 'weapon5': '0.248', 'AMMO4': '0.299', 'AMMO3': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'weapon3': '3.002', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '60.000'} [2024-08-06 06:55:24,818][52811] DAMAGECOUNT value on done: 746184.0 [2024-08-06 06:55:24,819][52811] Sum rewards: 69.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.063', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.132', 'weapon5': '0.168', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '56.000'} [2024-08-06 06:55:24,913][52820] DAMAGECOUNT value on done: 741368.0 [2024-08-06 06:55:24,918][52820] Sum rewards: 77.137, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.038', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:24,998][52660] DAMAGECOUNT value on done: 793668.0 [2024-08-06 06:55:25,004][52660] Sum rewards: 78.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.040', 'AMMO4': '0.108', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '64.500'} [2024-08-06 06:55:25,012][52650] Updated weights for policy 0, policy_version 72531 (0.0024) [2024-08-06 06:55:25,714][52662] DAMAGECOUNT value on done: 800661.0 [2024-08-06 06:55:25,715][52662] Sum rewards: 75.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.106', 'weapon5': '0.116', 'AMMO4': '0.184', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:25,815][52667] DAMAGECOUNT value on done: 812056.0 [2024-08-06 06:55:25,818][52667] Sum rewards: 74.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.201', 'weapon5': '0.214', 'AMMO4': '0.226', 'weapon2': '0.234', 'weapon4': '0.258', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '62.000'} [2024-08-06 06:55:27,144][52659] DAMAGECOUNT value on done: 805866.0 [2024-08-06 06:55:27,145][52659] Sum rewards: 81.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.487', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.028', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.228', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'weapon3': '3.540', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '68.000'} [2024-08-06 06:55:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 594214912. Throughput: 0: 4372.5. Samples: 148562660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:27,794][52567] Avg episode reward: [(0, '74.890')] [2024-08-06 06:55:27,970][52811] DAMAGECOUNT value on done: 748974.0 [2024-08-06 06:55:27,970][52811] Sum rewards: 84.659, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.741', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.176', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'weapon4': '0.368', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '67.000'} [2024-08-06 06:55:28,053][52660] DAMAGECOUNT value on done: 797884.0 [2024-08-06 06:55:28,054][52660] Sum rewards: 65.228, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.380', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.122', 'weapon5': '0.126', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.286', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '58.000'} [2024-08-06 06:55:28,156][52820] DAMAGECOUNT value on done: 742601.0 [2024-08-06 06:55:28,156][52820] Sum rewards: 65.574, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.876', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.129', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.024', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 06:55:28,816][52662] DAMAGECOUNT value on done: 790854.0 [2024-08-06 06:55:28,819][52662] Sum rewards: 68.449, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.340', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.146', 'weapon4': '0.186', 'weapon5': '0.186', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '0.850', 'weapon3': '2.882', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '54.000'} [2024-08-06 06:55:28,873][52667] DAMAGECOUNT value on done: 809985.0 [2024-08-06 06:55:28,874][52667] Sum rewards: 71.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.023', 'AMMO2': '0.094', 'AMMO3': '0.173', 'weapon5': '0.284', 'weapon2': '0.318', 'AMMO4': '0.469', 'weapon4': '0.496', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.558', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '57.000'} [2024-08-06 06:55:29,930][52795] DAMAGECOUNT value on done: 744682.0 [2024-08-06 06:55:29,933][52795] Sum rewards: 69.004, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.174', 'AMMO3': '0.213', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.580', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '57.000'} [2024-08-06 06:55:30,161][52650] Updated weights for policy 0, policy_version 72541 (0.0024) [2024-08-06 06:55:30,477][52659] DAMAGECOUNT value on done: 801850.0 [2024-08-06 06:55:30,478][52659] Sum rewards: 68.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.130', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 06:55:30,607][52660] DAMAGECOUNT value on done: 809270.0 [2024-08-06 06:55:30,608][52660] Sum rewards: 77.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.158', 'AMMO4': '0.172', 'AMMO3': '0.222', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:30,630][52803] DAMAGECOUNT value on done: 744400.0 [2024-08-06 06:55:30,630][52803] Sum rewards: 84.365, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.667', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.098', 'AMMO4': '0.106', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.000', 'weapon3': '3.368', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '66.000'} [2024-08-06 06:55:31,210][52811] DAMAGECOUNT value on done: 753791.0 [2024-08-06 06:55:31,212][52811] Sum rewards: 84.100, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.566', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.060', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.324', 'weapon2': '0.412', 'WEAPON3': '0.900', 'weapon3': '3.032', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '66.000'} [2024-08-06 06:55:31,270][52820] DAMAGECOUNT value on done: 742481.0 [2024-08-06 06:55:31,271][52820] Sum rewards: 75.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.785', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.097', 'weapon5': '0.132', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.782', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:31,723][52667] DAMAGECOUNT value on done: 807235.0 [2024-08-06 06:55:31,730][52667] Sum rewards: 80.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.422', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.114', 'weapon5': '0.150', 'AMMO4': '0.174', 'weapon2': '0.194', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.296', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '66.000'} [2024-08-06 06:55:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17355.9). Total num frames: 594305024. Throughput: 0: 4367.1. Samples: 148575630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:32,795][52567] Avg episode reward: [(0, '74.662')] [2024-08-06 06:55:33,252][52795] DAMAGECOUNT value on done: 731478.0 [2024-08-06 06:55:33,253][52795] Sum rewards: 75.197, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.842', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO3': '0.129', 'AMMO4': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.784', 'WEAPON3': '0.850', 'weapon3': '2.900', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '58.000'} [2024-08-06 06:55:33,571][52659] DAMAGECOUNT value on done: 801309.0 [2024-08-06 06:55:33,574][52659] Sum rewards: 59.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.032', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.172', 'AMMO4': '0.200', 'AMMO3': '0.247', 'weapon5': '0.308', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '51.000'} [2024-08-06 06:55:33,623][52660] DAMAGECOUNT value on done: 818135.0 [2024-08-06 06:55:33,625][52660] Sum rewards: 85.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.408', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.146', 'weapon5': '0.180', 'AMMO3': '0.207', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '69.000'} [2024-08-06 06:55:33,863][52803] DAMAGECOUNT value on done: 743583.0 [2024-08-06 06:55:33,865][52803] Sum rewards: 75.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.092', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.424', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:34,293][52650] Updated weights for policy 0, policy_version 72551 (0.0021) [2024-08-06 06:55:34,379][52811] DAMAGECOUNT value on done: 756576.0 [2024-08-06 06:55:34,379][52811] Sum rewards: 66.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.428', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.184', 'AMMO3': '0.197', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.636', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '53.000'} [2024-08-06 06:55:34,419][52820] DAMAGECOUNT value on done: 732516.0 [2024-08-06 06:55:34,419][52820] Sum rewards: 61.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.431', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'AMMO4': '0.077', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.218', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '3.010', 'weapon3': '3.448', 'DAMAGECOUNT': '15.309', 'FRAGCOUNT': '55.000'} [2024-08-06 06:55:34,562][52667] DAMAGECOUNT value on done: 802152.0 [2024-08-06 06:55:34,562][52667] Sum rewards: 69.984, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.162', 'AMMO5': '0.014', 'AMMO2': '0.063', 'weapon4': '0.080', 'weapon5': '0.214', 'AMMO3': '0.263', 'AMMO4': '0.316', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.016', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '60.000'} [2024-08-06 06:55:36,367][52795] DAMAGECOUNT value on done: 736939.0 [2024-08-06 06:55:36,371][52795] Sum rewards: 81.402, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.315', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.162', 'weapon4': '0.192', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '68.000'} [2024-08-06 06:55:36,564][52660] DAMAGECOUNT value on done: 796854.0 [2024-08-06 06:55:36,564][52660] Sum rewards: 78.837, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.316', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.082', 'AMMO4': '0.097', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:36,670][52659] DAMAGECOUNT value on done: 801119.0 [2024-08-06 06:55:36,672][52659] Sum rewards: 61.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.180', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.108', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon4': '0.292', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '54.000'} [2024-08-06 06:55:36,944][52664] DAMAGECOUNT value on done: 828200.0 [2024-08-06 06:55:36,944][52664] Sum rewards: 69.223, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.678', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.098', 'weapon5': '0.146', 'AMMO4': '0.211', 'AMMO3': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '59.000'} [2024-08-06 06:55:36,944][52803] DAMAGECOUNT value on done: 749538.0 [2024-08-06 06:55:36,952][52803] Sum rewards: 78.384, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.159', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.260', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '62.000'} [2024-08-06 06:55:37,479][52667] DAMAGECOUNT value on done: 805832.0 [2024-08-06 06:55:37,479][52667] Sum rewards: 71.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.943', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon2': '0.176', 'weapon5': '0.222', 'weapon4': '0.236', 'AMMO3': '0.246', 'AMMO4': '0.293', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:37,482][52811] DAMAGECOUNT value on done: 748327.0 [2024-08-06 06:55:37,483][52811] Sum rewards: 77.259, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.160', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon4': '0.016', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.224', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:37,482][52820] DAMAGECOUNT value on done: 746384.0 [2024-08-06 06:55:37,486][52820] Sum rewards: 81.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.195', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.039', 'weapon5': '0.110', 'weapon4': '0.174', 'AMMO3': '0.176', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:37,795][52567] Fps is (10 sec: 18021.5, 60 sec: 17612.7, 300 sec: 17383.7). Total num frames: 594395136. Throughput: 0: 4361.5. Samples: 148601630. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:37,795][52567] Avg episode reward: [(0, '74.515')] [2024-08-06 06:55:39,157][52660] DAMAGECOUNT value on done: 803125.0 [2024-08-06 06:55:39,158][52660] Sum rewards: 75.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.660', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.178', 'AMMO4': '0.226', 'weapon2': '0.242', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.284', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '64.000'} [2024-08-06 06:55:39,192][52650] Updated weights for policy 0, policy_version 72561 (0.0019) [2024-08-06 06:55:39,691][52795] DAMAGECOUNT value on done: 744110.0 [2024-08-06 06:55:39,693][52795] Sum rewards: 70.801, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.985', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.289', 'weapon4': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.750', 'weapon3': '2.850', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:39,789][52659] DAMAGECOUNT value on done: 802876.0 [2024-08-06 06:55:39,792][52659] Sum rewards: 80.531, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.997', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.104', 'AMMO4': '0.117', 'AMMO3': '0.149', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '0.950', 'weapon3': '2.986', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '64.000'} [2024-08-06 06:55:39,950][52664] DAMAGECOUNT value on done: 833252.0 [2024-08-06 06:55:39,951][52664] Sum rewards: 61.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.100', 'weapon5': '0.188', 'AMMO3': '0.201', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '3.078', 'DAMAGECOUNT': '14.133', 'FRAGCOUNT': '53.000'} [2024-08-06 06:55:40,026][52803] DAMAGECOUNT value on done: 748369.0 [2024-08-06 06:55:40,027][52803] Sum rewards: 66.611, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.424', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.100', 'weapon5': '0.208', 'weapon2': '0.244', 'AMMO3': '0.262', 'AMMO4': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.132', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '58.000'} [2024-08-06 06:55:40,422][52667] DAMAGECOUNT value on done: 809546.0 [2024-08-06 06:55:40,422][52667] Sum rewards: 66.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.112', 'AMMO4': '0.201', 'weapon2': '0.204', 'weapon5': '0.206', 'AMMO3': '0.255', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.186', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '56.000'} [2024-08-06 06:55:40,598][52811] DAMAGECOUNT value on done: 748918.0 [2024-08-06 06:55:40,599][52811] Sum rewards: 66.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.048', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '56.000'} [2024-08-06 06:55:40,602][52820] DAMAGECOUNT value on done: 731566.0 [2024-08-06 06:55:40,603][52820] Sum rewards: 79.216, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.830', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.060', 'AMMO4': '0.085', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '63.000'} [2024-08-06 06:55:41,998][52660] DAMAGECOUNT value on done: 802102.0 [2024-08-06 06:55:42,008][52660] Sum rewards: 55.511, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.002', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon4': '0.130', 'weapon5': '0.170', 'AMMO4': '0.225', 'AMMO3': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.600', 'weapon3': '2.736', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '50.000'} [2024-08-06 06:55:42,531][52659] DAMAGECOUNT value on done: 800272.0 [2024-08-06 06:55:42,532][52659] Sum rewards: 81.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'weapon2': '0.222', 'weapon4': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '68.000'} [2024-08-06 06:55:42,755][52664] DAMAGECOUNT value on done: 834392.0 [2024-08-06 06:55:42,755][52664] Sum rewards: 85.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.609', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.140', 'weapon5': '0.146', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '70.000'} [2024-08-06 06:55:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 594477056. Throughput: 0: 4364.7. Samples: 148627880. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 06:55:42,794][52567] Avg episode reward: [(0, '74.138')] [2024-08-06 06:55:42,958][52795] DAMAGECOUNT value on done: 732642.0 [2024-08-06 06:55:42,960][52795] Sum rewards: 64.000, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.040', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon4': '0.058', 'weapon5': '0.148', 'AMMO3': '0.254', 'AMMO4': '0.287', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '54.000'} [2024-08-06 06:55:43,227][52803] DAMAGECOUNT value on done: 747845.0 [2024-08-06 06:55:43,229][52803] Sum rewards: 61.373, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.697', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.079', 'weapon4': '0.146', 'AMMO3': '0.256', 'weapon5': '0.290', 'AMMO4': '0.395', 'weapon2': '0.480', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.744', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '54.000'} [2024-08-06 06:55:43,405][52667] DAMAGECOUNT value on done: 800006.0 [2024-08-06 06:55:43,406][52667] Sum rewards: 69.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.946', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'weapon2': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon4': '0.236', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.186', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '58.000'} [2024-08-06 06:55:43,850][52820] DAMAGECOUNT value on done: 738187.0 [2024-08-06 06:55:43,852][52820] Sum rewards: 70.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '59.000'} [2024-08-06 06:55:44,011][52650] Updated weights for policy 0, policy_version 72571 (0.0012) [2024-08-06 06:55:45,086][52660] DAMAGECOUNT value on done: 792385.0 [2024-08-06 06:55:45,086][52660] Sum rewards: 74.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO4': '0.172', 'weapon5': '0.194', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '62.000'} [2024-08-06 06:55:45,345][52659] DAMAGECOUNT value on done: 804939.0 [2024-08-06 06:55:45,346][52659] Sum rewards: 69.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.215', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.087', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '57.000'} [2024-08-06 06:55:45,862][52664] DAMAGECOUNT value on done: 825847.0 [2024-08-06 06:55:45,867][52664] Sum rewards: 73.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon5': '0.130', 'weapon4': '0.154', 'AMMO3': '0.191', 'AMMO4': '0.259', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.000'} [2024-08-06 06:55:46,096][52795] DAMAGECOUNT value on done: 740061.0 [2024-08-06 06:55:46,098][52795] Sum rewards: 77.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.654', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon2': '0.214', 'AMMO3': '0.263', 'AMMO4': '0.267', 'weapon4': '0.276', 'weapon5': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.954', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '64.000'} [2024-08-06 06:55:46,208][52667] DAMAGECOUNT value on done: 803168.0 [2024-08-06 06:55:46,208][52667] Sum rewards: 75.048, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO3': '0.170', 'AMMO4': '0.186', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 06:55:46,332][52803] DAMAGECOUNT value on done: 747119.0 [2024-08-06 06:55:46,333][52803] Sum rewards: 62.515, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.823', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.066', 'weapon5': '0.096', 'AMMO4': '0.110', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.892', 'WEAPON3': '0.900', 'HITCOUNT': '2.590', 'weapon3': '2.796', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '49.000'} [2024-08-06 06:55:47,018][52820] DAMAGECOUNT value on done: 741166.0 [2024-08-06 06:55:47,019][52820] Sum rewards: 54.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.595', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.192', 'AMMO3': '0.203', 'AMMO4': '0.222', 'weapon4': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '13.857', 'FRAGCOUNT': '46.000'} [2024-08-06 06:55:47,604][52660] DAMAGECOUNT value on done: 791404.0 [2024-08-06 06:55:47,605][52660] Sum rewards: 59.549, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.218', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon7': '0.104', 'weapon5': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon4': '0.312', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.706', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '50.000'} [2024-08-06 06:55:47,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 594567168. Throughput: 0: 4370.4. Samples: 148641220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:55:47,795][52567] Avg episode reward: [(0, '73.466')] [2024-08-06 06:55:47,899][52659] DAMAGECOUNT value on done: 809762.0 [2024-08-06 06:55:47,899][52659] Sum rewards: 68.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.046', 'AMMO4': '0.134', 'weapon5': '0.134', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '55.000'} [2024-08-06 06:55:48,588][52650] Updated weights for policy 0, policy_version 72581 (0.0010) [2024-08-06 06:55:48,691][52664] DAMAGECOUNT value on done: 838845.0 [2024-08-06 06:55:48,692][52664] Sum rewards: 81.933, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'weapon4': '0.018', 'weapon5': '0.018', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.255', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.396', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '69.000'} [2024-08-06 06:55:48,918][52647] DAMAGECOUNT value on done: 854483.0 [2024-08-06 06:55:48,920][52647] Sum rewards: 94.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.088', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.077', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.194', 'WEAPON3': '1.150', 'weapon3': '3.448', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '22.275', 'FRAGCOUNT': '75.000'} [2024-08-06 06:55:49,210][52795] DAMAGECOUNT value on done: 749432.0 [2024-08-06 06:55:49,211][52795] Sum rewards: 75.008, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.250', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.736', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:49,394][52667] DAMAGECOUNT value on done: 812467.0 [2024-08-06 06:55:49,395][52667] Sum rewards: 82.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.035', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.173', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '66.000'} [2024-08-06 06:55:49,567][52803] DAMAGECOUNT value on done: 739813.0 [2024-08-06 06:55:49,569][52803] Sum rewards: 81.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.064', 'weapon5': '0.126', 'AMMO3': '0.142', 'AMMO4': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON3': '0.950', 'weapon3': '3.008', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:50,325][52820] DAMAGECOUNT value on done: 743575.0 [2024-08-06 06:55:50,327][52820] Sum rewards: 83.516, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.819', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.550', 'weapon3': '3.270', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '71.000'} [2024-08-06 06:55:50,955][52659] DAMAGECOUNT value on done: 797776.0 [2024-08-06 06:55:50,955][52659] Sum rewards: 69.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.546', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO4': '0.123', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.418', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '57.000'} [2024-08-06 06:55:51,706][52664] DAMAGECOUNT value on done: 831446.0 [2024-08-06 06:55:51,707][52664] Sum rewards: 85.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.567', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.087', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'weapon2': '0.382', 'WEAPON3': '1.650', 'weapon3': '3.188', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '73.000'} [2024-08-06 06:55:51,880][52647] DAMAGECOUNT value on done: 842815.0 [2024-08-06 06:55:51,881][52647] Sum rewards: 81.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.166', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.092', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.100', 'weapon3': '3.306', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '66.000'} [2024-08-06 06:55:52,253][52667] DAMAGECOUNT value on done: 798976.0 [2024-08-06 06:55:52,257][52667] Sum rewards: 78.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.176', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.732', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '62.500'} [2024-08-06 06:55:52,405][52795] DAMAGECOUNT value on done: 738244.0 [2024-08-06 06:55:52,406][52795] Sum rewards: 72.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.266', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.064', 'weapon4': '0.090', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:52,750][52803] DAMAGECOUNT value on done: 740739.0 [2024-08-06 06:55:52,750][52803] Sum rewards: 90.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.406', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.180', 'AMMO4': '0.186', 'weapon5': '0.194', 'AMMO3': '0.212', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.841', 'FRAGCOUNT': '75.000'} [2024-08-06 06:55:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 594657280. Throughput: 0: 4369.8. Samples: 148667390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:55:52,794][52567] Avg episode reward: [(0, '74.161')] [2024-08-06 06:55:53,261][52650] Updated weights for policy 0, policy_version 72591 (0.0013) [2024-08-06 06:55:53,458][52820] DAMAGECOUNT value on done: 751908.0 [2024-08-06 06:55:53,459][52820] Sum rewards: 78.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.006', 'weapon4': '0.024', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.151', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'weapon3': '3.538', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:53,962][52659] DAMAGECOUNT value on done: 807886.0 [2024-08-06 06:55:53,962][52659] Sum rewards: 66.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.021', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.226', 'weapon5': '0.246', 'AMMO3': '0.252', 'AMMO4': '0.297', 'weapon2': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '56.000'} [2024-08-06 06:55:54,141][52664] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:55:54,900][52664] DAMAGECOUNT value on done: 826418.0 [2024-08-06 06:55:54,900][52664] Sum rewards: 78.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.385', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.146', 'AMMO3': '0.262', 'weapon2': '0.402', 'WEAPON3': '1.700', 'weapon3': '3.216', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '67.000'} [2024-08-06 06:55:54,987][52647] DAMAGECOUNT value on done: 848661.0 [2024-08-06 06:55:54,988][52647] Sum rewards: 88.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.708', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.084', 'AMMO4': '0.192', 'AMMO3': '0.209', 'weapon5': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.996', 'FRAGCOUNT': '71.000'} [2024-08-06 06:55:55,207][52667] DAMAGECOUNT value on done: 806452.0 [2024-08-06 06:55:55,207][52667] Sum rewards: 67.213, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.168', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.158', 'weapon5': '0.180', 'AMMO3': '0.263', 'weapon2': '0.312', 'AMMO4': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '59.000'} [2024-08-06 06:55:55,539][52795] DAMAGECOUNT value on done: 744105.0 [2024-08-06 06:55:55,540][52795] Sum rewards: 74.073, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.110', 'weapon4': '0.164', 'AMMO4': '0.168', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '62.000'} [2024-08-06 06:55:55,730][52803] DAMAGECOUNT value on done: 745091.0 [2024-08-06 06:55:55,732][52803] Sum rewards: 81.413, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.915', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.143', 'AMMO4': '0.177', 'weapon5': '0.194', 'weapon4': '0.244', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.074', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:56,544][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:55:56,746][52820] DAMAGECOUNT value on done: 735880.0 [2024-08-06 06:55:56,747][52820] Sum rewards: 77.063, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.040', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.126', 'AMMO4': '0.130', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '65.000'} [2024-08-06 06:55:56,782][52671] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:55:56,966][52649] DAMAGECOUNT value on done: 779182.0 [2024-08-06 06:55:56,967][52649] Sum rewards: 82.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.128', 'weapon4': '0.152', 'AMMO4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '68.500'} [2024-08-06 06:55:57,173][52659] DAMAGECOUNT value on done: 802474.0 [2024-08-06 06:55:57,174][52659] Sum rewards: 85.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.135', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.066', 'AMMO4': '0.107', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.856', 'FRAGCOUNT': '71.000'} [2024-08-06 06:55:57,793][52664] DAMAGECOUNT value on done: 821383.0 [2024-08-06 06:55:57,793][52664] Sum rewards: 71.029, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.980', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.094', 'AMMO4': '0.199', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.302', 'WEAPON3': '1.850', 'weapon3': '3.342', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '62.000'} [2024-08-06 06:55:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17355.9). Total num frames: 594739200. Throughput: 0: 4367.5. Samples: 148693740. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:55:57,794][52567] Avg episode reward: [(0, '74.734')] [2024-08-06 06:55:57,813][52647] DAMAGECOUNT value on done: 847155.0 [2024-08-06 06:55:57,814][52647] Sum rewards: 80.546, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.088', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '67.000'} [2024-08-06 06:55:58,081][52650] Updated weights for policy 0, policy_version 72601 (0.0024) [2024-08-06 06:55:58,164][52667] DAMAGECOUNT value on done: 811355.0 [2024-08-06 06:55:58,165][52667] Sum rewards: 58.771, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.912', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.166', 'weapon2': '0.254', 'AMMO3': '0.261', 'weapon5': '0.306', 'AMMO4': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.906', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '51.500'} [2024-08-06 06:55:58,590][52795] DAMAGECOUNT value on done: 745145.0 [2024-08-06 06:55:58,591][52795] Sum rewards: 77.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.076', 'weapon5': '0.146', 'AMMO3': '0.167', 'AMMO4': '0.245', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '61.000'} [2024-08-06 06:55:58,813][52803] DAMAGECOUNT value on done: 744458.0 [2024-08-06 06:55:58,813][52803] Sum rewards: 75.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.120', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.158', 'weapon5': '0.206', 'AMMO3': '0.231', 'AMMO4': '0.257', 'weapon2': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.500'} [2024-08-06 06:55:59,798][52820] DAMAGECOUNT value on done: 743607.0 [2024-08-06 06:55:59,799][52820] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.805', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.098', 'weapon4': '0.150', 'AMMO3': '0.153', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '55.000'} [2024-08-06 06:56:00,098][52649] DAMAGECOUNT value on done: 770164.0 [2024-08-06 06:56:00,102][52649] Sum rewards: 73.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.028', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon4': '0.158', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.222', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:00,263][52659] DAMAGECOUNT value on done: 803170.0 [2024-08-06 06:56:00,266][52659] Sum rewards: 80.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.690', 'AMMO5': '0.032', 'AMMO2': '0.070', 'weapon5': '0.202', 'AMMO3': '0.226', 'weapon2': '0.304', 'weapon4': '0.332', 'AMMO4': '0.351', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '66.000'} [2024-08-06 06:56:00,477][52664] DAMAGECOUNT value on done: 834189.0 [2024-08-06 06:56:00,479][52664] Sum rewards: 62.767, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.348', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'AMMO3': '0.205', 'weapon2': '1.040', 'WEAPON3': '1.300', 'weapon3': '2.780', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '53.000'} [2024-08-06 06:56:00,509][52647] DAMAGECOUNT value on done: 854650.0 [2024-08-06 06:56:00,511][52647] Sum rewards: 81.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.477', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.134', 'weapon5': '0.162', 'AMMO4': '0.181', 'AMMO3': '0.182', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '67.000'} [2024-08-06 06:56:00,730][52667] DAMAGECOUNT value on done: 810554.0 [2024-08-06 06:56:00,731][52667] Sum rewards: 69.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO4': '0.212', 'AMMO3': '0.228', 'weapon4': '0.234', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.918', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:01,748][52795] DAMAGECOUNT value on done: 741622.0 [2024-08-06 06:56:01,748][52795] Sum rewards: 83.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.196', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '2.952', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '70.000'} [2024-08-06 06:56:01,817][52803] DAMAGECOUNT value on done: 757864.0 [2024-08-06 06:56:01,818][52803] Sum rewards: 76.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.135', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.172', 'weapon2': '0.188', 'weapon5': '0.250', 'AMMO3': '0.259', 'AMMO4': '0.320', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '66.000'} [2024-08-06 06:56:02,659][52794] DAMAGECOUNT value on done: 797519.0 [2024-08-06 06:56:02,659][52794] Sum rewards: 82.905, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.022', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'HEALTH': '0.137', 'AMMO3': '0.197', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.422', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '68.000'} [2024-08-06 06:56:02,661][52650] Updated weights for policy 0, policy_version 72611 (0.0018) [2024-08-06 06:56:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 594829312. Throughput: 0: 4366.7. Samples: 148706770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:56:02,795][52567] Avg episode reward: [(0, '74.523')] [2024-08-06 06:56:02,841][52820] DAMAGECOUNT value on done: 753419.0 [2024-08-06 06:56:02,843][52820] Sum rewards: 74.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.174', 'weapon2': '0.192', 'AMMO3': '0.209', 'weapon4': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:02,919][52664] DAMAGECOUNT value on done: 829281.0 [2024-08-06 06:56:02,921][52664] Sum rewards: 65.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.496', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '57.000'} [2024-08-06 06:56:02,938][52647] DAMAGECOUNT value on done: 850768.0 [2024-08-06 06:56:02,939][52647] Sum rewards: 77.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.795', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.584', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:03,084][52659] DAMAGECOUNT value on done: 803353.0 [2024-08-06 06:56:03,084][52659] Sum rewards: 71.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.114', 'weapon5': '0.174', 'AMMO3': '0.180', 'AMMO4': '0.200', 'weapon2': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 06:56:03,338][52649] DAMAGECOUNT value on done: 788899.0 [2024-08-06 06:56:03,340][52649] Sum rewards: 72.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.659', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.054', 'weapon4': '0.116', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.208', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.444', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:03,804][52667] DAMAGECOUNT value on done: 810183.0 [2024-08-06 06:56:03,806][52667] Sum rewards: 73.552, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.957', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.204', 'WEAPON3': '1.350', 'HITCOUNT': '3.560', 'weapon3': '3.606', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:04,954][52795] DAMAGECOUNT value on done: 734644.0 [2024-08-06 06:56:04,955][52795] Sum rewards: 58.374, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.092', 'AMMO5': '0.028', 'AMMO2': '0.066', 'weapon4': '0.116', 'weapon5': '0.244', 'AMMO3': '0.276', 'AMMO4': '0.330', 'weapon2': '0.342', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.600', 'weapon3': '2.936', 'DAMAGECOUNT': '14.928', 'FRAGCOUNT': '53.000'} [2024-08-06 06:56:04,977][52803] DAMAGECOUNT value on done: 748344.0 [2024-08-06 06:56:04,977][52803] Sum rewards: 81.762, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.072', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.113', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.218', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:05,652][52664] DAMAGECOUNT value on done: 840683.0 [2024-08-06 06:56:05,652][52664] Sum rewards: 63.240, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.122', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.212', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '50.000'} [2024-08-06 06:56:05,735][52647] DAMAGECOUNT value on done: 853179.0 [2024-08-06 06:56:05,735][52647] Sum rewards: 74.251, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.448', 'AMMO5': '0.027', 'AMMO2': '0.078', 'AMMO3': '0.169', 'weapon5': '0.224', 'weapon2': '0.318', 'weapon4': '0.346', 'AMMO4': '0.390', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.800', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:05,831][52794] DAMAGECOUNT value on done: 804932.0 [2024-08-06 06:56:05,832][52794] Sum rewards: 71.776, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.076', 'weapon4': '0.086', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.700', 'weapon3': '3.262', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:06,114][52820] DAMAGECOUNT value on done: 746848.0 [2024-08-06 06:56:06,115][52820] Sum rewards: 71.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.705', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon5': '0.178', 'AMMO3': '0.216', 'weapon4': '0.290', 'AMMO4': '0.323', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '59.000'} [2024-08-06 06:56:06,281][52659] DAMAGECOUNT value on done: 804187.0 [2024-08-06 06:56:06,284][52659] Sum rewards: 56.491, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.830', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon5': '0.226', 'AMMO3': '0.227', 'weapon4': '0.256', 'AMMO4': '0.274', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '50.000'} [2024-08-06 06:56:06,555][52649] DAMAGECOUNT value on done: 783054.0 [2024-08-06 06:56:06,556][52649] Sum rewards: 67.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.310', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.172', 'weapon4': '0.178', 'weapon2': '0.242', 'AMMO4': '0.255', 'AMMO3': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:06,569][52667] DAMAGECOUNT value on done: 806585.0 [2024-08-06 06:56:06,569][52667] Sum rewards: 67.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.146', 'AMMO3': '0.201', 'AMMO4': '0.213', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.262', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:07,162][52662] Large shaping reward 2.547 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.075, -25.0), ('weapon5', 0.002)] [2024-08-06 06:56:07,291][52650] Updated weights for policy 0, policy_version 72621 (0.0013) [2024-08-06 06:56:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 594919424. Throughput: 0: 4371.8. Samples: 148733030. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:56:07,794][52567] Avg episode reward: [(0, '73.532')] [2024-08-06 06:56:08,078][52795] DAMAGECOUNT value on done: 736900.0 [2024-08-06 06:56:08,079][52795] Sum rewards: 70.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.518', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon5': '0.162', 'AMMO4': '0.196', 'AMMO3': '0.199', 'weapon2': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.330', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:08,099][52803] DAMAGECOUNT value on done: 745808.0 [2024-08-06 06:56:08,100][52803] Sum rewards: 68.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'AMMO5': '0.021', 'AMMO2': '0.042', 'AMMO3': '0.198', 'AMMO4': '0.209', 'weapon5': '0.216', 'weapon4': '0.228', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:08,412][52794] DAMAGECOUNT value on done: 809764.0 [2024-08-06 06:56:08,414][52794] Sum rewards: 69.660, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.827', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon2': '0.204', 'weapon5': '0.212', 'weapon4': '0.274', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.016', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:08,830][52664] DAMAGECOUNT value on done: 837217.0 [2024-08-06 06:56:08,831][52664] Sum rewards: 65.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.660', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.066', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.271', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'HITCOUNT': '3.390', 'weapon3': '3.412', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '57.000'} [2024-08-06 06:56:08,844][52647] DAMAGECOUNT value on done: 831643.0 [2024-08-06 06:56:08,844][52647] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon2': '0.186', 'AMMO3': '0.189', 'AMMO4': '0.270', 'weapon5': '0.270', 'weapon4': '0.486', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:09,200][52820] DAMAGECOUNT value on done: 748414.0 [2024-08-06 06:56:09,201][52820] Sum rewards: 74.670, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.102', 'weapon2': '0.226', 'AMMO3': '0.320', 'WEAPON3': '1.850', 'weapon3': '3.302', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '66.000'} [2024-08-06 06:56:09,270][52667] DAMAGECOUNT value on done: 813534.0 [2024-08-06 06:56:09,271][52667] Sum rewards: 71.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.006', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.072', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.255', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:09,391][52659] DAMAGECOUNT value on done: 812378.0 [2024-08-06 06:56:09,392][52659] Sum rewards: 79.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.207', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '66.000'} [2024-08-06 06:56:09,812][52649] DAMAGECOUNT value on done: 774219.0 [2024-08-06 06:56:09,812][52649] Sum rewards: 79.164, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.340', 'WEAPON3': '1.600', 'weapon3': '3.290', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '67.000'} [2024-08-06 06:56:11,031][52647] DAMAGECOUNT value on done: 848116.0 [2024-08-06 06:56:11,031][52647] Sum rewards: 69.941, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon4': '0.100', 'weapon5': '0.154', 'AMMO4': '0.209', 'AMMO3': '0.210', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:11,078][52664] DAMAGECOUNT value on done: 836643.0 [2024-08-06 06:56:11,078][52664] Sum rewards: 71.973, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.221', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.066', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:11,174][52794] DAMAGECOUNT value on done: 797693.0 [2024-08-06 06:56:11,176][52794] Sum rewards: 78.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.538', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.052', 'weapon4': '0.054', 'AMMO4': '0.096', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '65.500'} [2024-08-06 06:56:11,289][52795] DAMAGECOUNT value on done: 746310.0 [2024-08-06 06:56:11,289][52795] Sum rewards: 80.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.015', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.140', 'AMMO4': '0.177', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '66.000'} [2024-08-06 06:56:11,396][52803] DAMAGECOUNT value on done: 758960.0 [2024-08-06 06:56:11,396][52803] Sum rewards: 67.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.066', 'AMMO4': '0.139', 'weapon4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:11,661][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:56:11,866][52650] Updated weights for policy 0, policy_version 72631 (0.0048) [2024-08-06 06:56:12,300][52820] DAMAGECOUNT value on done: 744369.0 [2024-08-06 06:56:12,302][52820] Sum rewards: 74.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.146', 'weapon2': '0.182', 'AMMO4': '0.190', 'AMMO3': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:12,702][52659] DAMAGECOUNT value on done: 800065.0 [2024-08-06 06:56:12,704][52659] Sum rewards: 82.433, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.764', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.122', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.075', 'FRAGCOUNT': '67.000'} [2024-08-06 06:56:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 595001344. Throughput: 0: 4364.0. Samples: 148759040. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:56:12,794][52567] Avg episode reward: [(0, '73.638')] [2024-08-06 06:56:13,012][52649] DAMAGECOUNT value on done: 785613.0 [2024-08-06 06:56:13,014][52649] Sum rewards: 72.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon4': '0.268', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:13,481][52647] DAMAGECOUNT value on done: 844695.0 [2024-08-06 06:56:13,481][52647] Sum rewards: 81.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.854', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.068', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.386', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '68.000'} [2024-08-06 06:56:13,692][52664] DAMAGECOUNT value on done: 845653.0 [2024-08-06 06:56:13,692][52664] Sum rewards: 71.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.820', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.166', 'weapon5': '0.210', 'AMMO3': '0.260', 'AMMO4': '0.290', 'weapon2': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.940', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:14,167][52794] DAMAGECOUNT value on done: 794334.0 [2024-08-06 06:56:14,169][52794] Sum rewards: 71.162, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon2': '0.160', 'weapon5': '0.184', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.264', 'WEAPON5': '0.300', 'HEALTH': '0.618', 'WEAPON3': '1.050', 'weapon3': '3.150', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '57.000'} [2024-08-06 06:56:14,451][52803] DAMAGECOUNT value on done: 745722.0 [2024-08-06 06:56:14,455][52803] Sum rewards: 89.550, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.019', 'HEALTH': '0.080', 'AMMO4': '0.095', 'weapon5': '0.160', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON4': '0.300', 'weapon4': '0.370', 'WEAPON3': '0.950', 'weapon3': '2.904', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '71.000'} [2024-08-06 06:56:14,473][52795] DAMAGECOUNT value on done: 731527.0 [2024-08-06 06:56:14,474][52795] Sum rewards: 76.296, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon5': '0.210', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.196', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:14,483][52659] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:56:15,462][52820] DAMAGECOUNT value on done: 747097.0 [2024-08-06 06:56:15,464][52820] Sum rewards: 77.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '65.000'} [2024-08-06 06:56:15,607][52659] DAMAGECOUNT value on done: 808945.0 [2024-08-06 06:56:15,609][52659] Sum rewards: 70.684, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.668', 'AMMO5': '0.013', 'AMMO2': '0.064', 'weapon5': '0.208', 'AMMO3': '0.219', 'weapon4': '0.276', 'AMMO4': '0.320', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:15,732][52647] DAMAGECOUNT value on done: 845143.0 [2024-08-06 06:56:15,733][52647] Sum rewards: 83.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon2': '0.226', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.564', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '69.000'} [2024-08-06 06:56:15,841][52664] DAMAGECOUNT value on done: 845311.0 [2024-08-06 06:56:15,841][52664] Sum rewards: 67.783, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.281', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.202', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:16,171][52649] DAMAGECOUNT value on done: 782394.0 [2024-08-06 06:56:16,173][52649] Sum rewards: 78.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.102', 'weapon5': '0.106', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '65.000'} [2024-08-06 06:56:16,756][52650] Updated weights for policy 0, policy_version 72641 (0.0032) [2024-08-06 06:56:17,152][52794] DAMAGECOUNT value on done: 802229.0 [2024-08-06 06:56:17,153][52794] Sum rewards: 87.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.104', 'AMMO4': '0.119', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.138', 'FRAGCOUNT': '71.000'} [2024-08-06 06:56:17,581][52803] DAMAGECOUNT value on done: 748706.0 [2024-08-06 06:56:17,581][52803] Sum rewards: 76.714, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.938', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.106', 'AMMO3': '0.236', 'AMMO4': '0.244', 'weapon5': '0.246', 'weapon2': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:17,688][52795] DAMAGECOUNT value on done: 746375.0 [2024-08-06 06:56:17,688][52795] Sum rewards: 61.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.215', 'weapon2': '0.246', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.496', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '52.000'} [2024-08-06 06:56:17,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.1, 300 sec: 17383.7). Total num frames: 595091456. Throughput: 0: 4369.5. Samples: 148772260. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:56:17,795][52567] Avg episode reward: [(0, '74.047')] [2024-08-06 06:56:18,090][52659] DAMAGECOUNT value on done: 800438.0 [2024-08-06 06:56:18,092][52659] Sum rewards: 83.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.545', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.193', 'WEAPON5': '0.400', 'weapon4': '0.408', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '68.000'} [2024-08-06 06:56:18,596][52820] DAMAGECOUNT value on done: 757940.0 [2024-08-06 06:56:18,596][52820] Sum rewards: 74.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.899', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.170', 'AMMO4': '0.171', 'AMMO3': '0.186', 'weapon2': '0.288', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:18,650][52647] DAMAGECOUNT value on done: 834910.0 [2024-08-06 06:56:18,651][52647] Sum rewards: 78.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.716', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon5': '0.174', 'weapon2': '0.176', 'AMMO3': '0.218', 'AMMO4': '0.224', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:18,757][52664] DAMAGECOUNT value on done: 839751.0 [2024-08-06 06:56:18,759][52664] Sum rewards: 76.000, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.080', 'weapon5': '0.186', 'AMMO4': '0.216', 'AMMO3': '0.239', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '64.500'} [2024-08-06 06:56:19,357][52649] DAMAGECOUNT value on done: 787068.0 [2024-08-06 06:56:19,357][52649] Sum rewards: 74.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.146', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.130', 'AMMO4': '0.161', 'weapon2': '0.190', 'weapon5': '0.198', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:19,908][52794] DAMAGECOUNT value on done: 806980.0 [2024-08-06 06:56:19,908][52794] Sum rewards: 74.875, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.720', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.154', 'weapon2': '0.324', 'WEAPON3': '1.000', 'HITCOUNT': '3.390', 'weapon3': '3.472', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:20,628][52803] DAMAGECOUNT value on done: 750607.0 [2024-08-06 06:56:20,630][52803] Sum rewards: 71.876, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.026', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO4': '0.213', 'weapon5': '0.228', 'AMMO3': '0.265', 'WEAPON4': '0.450', 'weapon2': '0.468', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.898', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:20,902][52795] DAMAGECOUNT value on done: 745537.0 [2024-08-06 06:56:20,904][52795] Sum rewards: 89.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO4': '0.119', 'AMMO3': '0.206', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.474', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '74.000'} [2024-08-06 06:56:20,904][52647] DAMAGECOUNT value on done: 851660.0 [2024-08-06 06:56:20,907][52647] Sum rewards: 78.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.104', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.110', 'AMMO3': '0.199', 'AMMO4': '0.228', 'weapon2': '0.240', 'weapon5': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:20,917][52658] DAMAGECOUNT value on done: 804281.0 [2024-08-06 06:56:20,917][52658] Sum rewards: 67.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.456', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.228', 'weapon2': '0.256', 'weapon4': '0.270', 'weapon5': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:21,041][52664] DAMAGECOUNT value on done: 828341.0 [2024-08-06 06:56:21,042][52664] Sum rewards: 81.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.128', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.125', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '67.000'} [2024-08-06 06:56:21,246][52650] Updated weights for policy 0, policy_version 72651 (0.0013) [2024-08-06 06:56:21,305][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:56:21,710][52820] DAMAGECOUNT value on done: 755149.0 [2024-08-06 06:56:21,711][52820] Sum rewards: 72.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.070', 'AMMO3': '0.198', 'AMMO4': '0.202', 'weapon5': '0.214', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:22,611][52794] DAMAGECOUNT value on done: 795188.0 [2024-08-06 06:56:22,613][52794] Sum rewards: 83.737, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.324', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.174', 'AMMO3': '0.250', 'weapon5': '0.250', 'AMMO4': '0.319', 'weapon2': '0.326', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.892', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.207', 'FRAGCOUNT': '69.000'} [2024-08-06 06:56:22,650][52649] DAMAGECOUNT value on done: 784047.0 [2024-08-06 06:56:22,651][52649] Sum rewards: 62.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.832', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.066', 'AMMO4': '0.168', 'weapon5': '0.170', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '53.000'} [2024-08-06 06:56:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 595173376. Throughput: 0: 4368.5. Samples: 148798210. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:56:22,802][52567] Avg episode reward: [(0, '74.790')] [2024-08-06 06:56:23,419][52647] DAMAGECOUNT value on done: 838911.0 [2024-08-06 06:56:23,420][52647] Sum rewards: 74.339, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.602', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.166', 'weapon2': '0.304', 'weapon4': '0.412', 'WEAPON3': '1.000', 'weapon3': '2.962', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '59.000'} [2024-08-06 06:56:23,642][52664] DAMAGECOUNT value on done: 833585.0 [2024-08-06 06:56:23,642][52664] Sum rewards: 74.815, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.664', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.146', 'AMMO4': '0.201', 'weapon5': '0.244', 'AMMO3': '0.292', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.926', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:23,730][52658] DAMAGECOUNT value on done: 805112.0 [2024-08-06 06:56:23,731][52658] Sum rewards: 69.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.034', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.326', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '57.000'} [2024-08-06 06:56:23,761][52803] DAMAGECOUNT value on done: 756626.0 [2024-08-06 06:56:23,762][52803] Sum rewards: 83.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.184', 'weapon2': '0.192', 'weapon4': '0.212', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '68.000'} [2024-08-06 06:56:24,090][52795] DAMAGECOUNT value on done: 733807.0 [2024-08-06 06:56:24,090][52795] Sum rewards: 64.608, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.580', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon2': '0.190', 'weapon5': '0.216', 'AMMO4': '0.245', 'AMMO3': '0.285', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '55.000'} [2024-08-06 06:56:24,814][52820] DAMAGECOUNT value on done: 737301.0 [2024-08-06 06:56:24,817][52820] Sum rewards: 64.586, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.125', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.183', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.320', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '53.000'} [2024-08-06 06:56:25,148][52794] DAMAGECOUNT value on done: 805184.0 [2024-08-06 06:56:25,149][52794] Sum rewards: 83.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.330', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'weapon4': '0.246', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '68.000'} [2024-08-06 06:56:25,541][52649] DAMAGECOUNT value on done: 778915.0 [2024-08-06 06:56:25,565][52649] Sum rewards: 84.580, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.328', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.330', 'WEAPON3': '1.650', 'weapon3': '3.158', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.258', 'FRAGCOUNT': '71.000'} [2024-08-06 06:56:26,054][52650] Updated weights for policy 0, policy_version 72661 (0.0013) [2024-08-06 06:56:26,333][52647] DAMAGECOUNT value on done: 847433.0 [2024-08-06 06:56:26,335][52647] Sum rewards: 77.997, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.216', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.006', 'AMMO4': '0.029', 'WEAPON5': '0.050', 'AMMO3': '0.161', 'weapon2': '0.296', 'WEAPON3': '1.050', 'HITCOUNT': '3.490', 'weapon3': '3.590', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:26,561][52664] DAMAGECOUNT value on done: 835773.0 [2024-08-06 06:56:26,562][52664] Sum rewards: 89.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.138', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.454', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '72.000'} [2024-08-06 06:56:26,605][52658] DAMAGECOUNT value on done: 810239.0 [2024-08-06 06:56:26,605][52658] Sum rewards: 78.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.301', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.090', 'AMMO4': '0.174', 'AMMO3': '0.183', 'weapon5': '0.198', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:27,060][52803] DAMAGECOUNT value on done: 754646.0 [2024-08-06 06:56:27,064][52803] Sum rewards: 71.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.958', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.114', 'AMMO3': '0.186', 'AMMO4': '0.265', 'weapon5': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.590', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:27,245][52795] DAMAGECOUNT value on done: 742941.0 [2024-08-06 06:56:27,246][52795] Sum rewards: 74.909, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.622', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.188', 'weapon2': '0.200', 'weapon4': '0.234', 'AMMO4': '0.239', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.042', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '65.000'} [2024-08-06 06:56:27,793][52794] DAMAGECOUNT value on done: 797926.0 [2024-08-06 06:56:27,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 595263488. Throughput: 0: 4372.2. Samples: 148824630. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 06:56:27,801][52567] Avg episode reward: [(0, '74.962')] [2024-08-06 06:56:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072664_595263488.pth... [2024-08-06 06:56:27,801][52794] Sum rewards: 80.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.172', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '65.000'} [2024-08-06 06:56:27,993][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072154_591085568.pth [2024-08-06 06:56:28,581][52671] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)] [2024-08-06 06:56:28,663][52649] DAMAGECOUNT value on done: 788883.0 [2024-08-06 06:56:28,663][52649] Sum rewards: 67.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.132', 'AMMO4': '0.137', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.136', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '55.000'} [2024-08-06 06:56:29,539][52658] DAMAGECOUNT value on done: 805836.0 [2024-08-06 06:56:29,539][52658] Sum rewards: 80.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.676', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.188', 'AMMO4': '0.198', 'AMMO3': '0.227', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '67.000'} [2024-08-06 06:56:29,551][52665] DAMAGECOUNT value on done: 792696.0 [2024-08-06 06:56:29,552][52665] Sum rewards: 86.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.351', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.106', 'weapon4': '0.110', 'AMMO4': '0.123', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.894', 'FRAGCOUNT': '71.000'} [2024-08-06 06:56:29,591][52647] DAMAGECOUNT value on done: 848369.0 [2024-08-06 06:56:29,592][52647] Sum rewards: 73.977, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.706', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.108', 'weapon5': '0.134', 'AMMO4': '0.167', 'weapon2': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.266', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '65.000'} [2024-08-06 06:56:29,918][52664] DAMAGECOUNT value on done: 830737.0 [2024-08-06 06:56:29,919][52664] Sum rewards: 78.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.035', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.202', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '65.500'} [2024-08-06 06:56:30,288][52803] DAMAGECOUNT value on done: 751715.0 [2024-08-06 06:56:30,290][52803] Sum rewards: 82.437, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.433', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon4': '0.194', 'weapon5': '0.210', 'weapon2': '0.248', 'AMMO3': '0.323', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.038', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '72.000'} [2024-08-06 06:56:30,505][52795] DAMAGECOUNT value on done: 750349.0 [2024-08-06 06:56:30,505][52795] Sum rewards: 81.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.411', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon4': '0.092', 'AMMO3': '0.194', 'AMMO4': '0.218', 'weapon5': '0.266', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.024', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.817', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:30,594][52794] DAMAGECOUNT value on done: 794307.0 [2024-08-06 06:56:30,594][52794] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.794', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.054', 'AMMO4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.668', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '55.000'} [2024-08-06 06:56:30,911][52649] DAMAGECOUNT value on done: 796525.0 [2024-08-06 06:56:30,913][52649] Sum rewards: 87.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.098', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '73.000'} [2024-08-06 06:56:31,028][52650] Updated weights for policy 0, policy_version 72671 (0.0017) [2024-08-06 06:56:32,136][52658] DAMAGECOUNT value on done: 800644.0 [2024-08-06 06:56:32,138][52658] Sum rewards: 72.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.202', 'AMMO3': '0.251', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:32,179][52665] DAMAGECOUNT value on done: 805941.0 [2024-08-06 06:56:32,180][52665] Sum rewards: 70.299, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.150', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.160', 'AMMO4': '0.246', 'weapon2': '0.300', 'AMMO3': '0.317', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.050', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:32,722][52647] DAMAGECOUNT value on done: 835902.0 [2024-08-06 06:56:32,722][52647] Sum rewards: 73.164, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.145', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon5': '0.108', 'weapon4': '0.168', 'AMMO4': '0.212', 'AMMO3': '0.258', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.124', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '66.000'} [2024-08-06 06:56:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 595353600. Throughput: 0: 4361.8. Samples: 148837500. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:56:32,794][52567] Avg episode reward: [(0, '74.795')] [2024-08-06 06:56:33,455][52794] DAMAGECOUNT value on done: 805140.0 [2024-08-06 06:56:33,457][52794] Sum rewards: 71.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.110', 'weapon5': '0.170', 'AMMO4': '0.182', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '58.500'} [2024-08-06 06:56:33,656][52649] DAMAGECOUNT value on done: 789270.0 [2024-08-06 06:56:33,656][52649] Sum rewards: 70.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.829', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.078', 'weapon5': '0.202', 'AMMO4': '0.264', 'AMMO3': '0.286', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.050', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:34,831][52663] DAMAGECOUNT value on done: 818621.0 [2024-08-06 06:56:34,833][52663] Sum rewards: 75.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.054', 'AMMO4': '0.067', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:35,078][52665] DAMAGECOUNT value on done: 799334.0 [2024-08-06 06:56:35,079][52665] Sum rewards: 68.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.600', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.146', 'AMMO3': '0.163', 'weapon4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.150', 'HITCOUNT': '2.960', 'weapon3': '3.006', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '55.000'} [2024-08-06 06:56:35,413][52650] Updated weights for policy 0, policy_version 72681 (0.0030) [2024-08-06 06:56:35,621][52658] DAMAGECOUNT value on done: 794521.0 [2024-08-06 06:56:35,621][52658] Sum rewards: 68.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.725', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.122', 'weapon2': '0.212', 'AMMO3': '0.283', 'WEAPON3': '1.750', 'HITCOUNT': '3.360', 'weapon3': '3.412', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:35,777][52647] DAMAGECOUNT value on done: 840274.0 [2024-08-06 06:56:35,778][52647] Sum rewards: 67.965, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.194', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.082', 'weapon5': '0.122', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'weapon2': '0.344', 'WEAPON3': '1.700', 'weapon3': '3.180', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.000'} [2024-08-06 06:56:36,444][52794] DAMAGECOUNT value on done: 801277.0 [2024-08-06 06:56:36,445][52794] Sum rewards: 79.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.384', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.286', 'WEAPON3': '1.700', 'weapon3': '3.298', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.541', 'FRAGCOUNT': '68.000'} [2024-08-06 06:56:36,877][52649] DAMAGECOUNT value on done: 790125.0 [2024-08-06 06:56:36,878][52649] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.322', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.158', 'AMMO4': '0.217', 'weapon5': '0.262', 'AMMO3': '0.272', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.830', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:37,437][52663] DAMAGECOUNT value on done: 804233.0 [2024-08-06 06:56:37,440][52663] Sum rewards: 55.611, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.071', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.126', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.360', 'weapon4': '0.402', 'WEAPON3': '1.000', 'HITCOUNT': '2.800', 'weapon3': '2.886', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '44.000'} [2024-08-06 06:56:37,747][52669] DAMAGECOUNT value on done: 804716.0 [2024-08-06 06:56:37,747][52669] Sum rewards: 60.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.187', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.144', 'weapon5': '0.148', 'AMMO4': '0.226', 'weapon4': '0.230', 'AMMO3': '0.249', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.250', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '52.000'} [2024-08-06 06:56:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 595443712. Throughput: 0: 4358.2. Samples: 148863510. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:56:37,794][52567] Avg episode reward: [(0, '74.416')] [2024-08-06 06:56:37,970][52665] DAMAGECOUNT value on done: 798598.0 [2024-08-06 06:56:37,972][52665] Sum rewards: 72.769, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.535', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.090', 'weapon2': '0.176', 'weapon5': '0.180', 'AMMO4': '0.199', 'AMMO3': '0.305', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.280', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:38,459][52647] DAMAGECOUNT value on done: 831928.0 [2024-08-06 06:56:38,462][52647] Sum rewards: 73.646, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.256', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.108', 'AMMO4': '0.252', 'AMMO3': '0.268', 'weapon4': '0.288', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.980', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:38,476][52658] DAMAGECOUNT value on done: 808723.0 [2024-08-06 06:56:38,477][52658] Sum rewards: 75.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.917', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:39,529][52794] DAMAGECOUNT value on done: 818120.0 [2024-08-06 06:56:39,529][52794] Sum rewards: 80.004, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.768', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.168', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'AMMO3': '0.344', 'WEAPON3': '1.950', 'weapon3': '3.138', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '70.000'} [2024-08-06 06:56:39,738][52649] DAMAGECOUNT value on done: 779895.0 [2024-08-06 06:56:39,740][52649] Sum rewards: 59.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.077', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.201', 'weapon2': '0.520', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.148', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '49.000'} [2024-08-06 06:56:40,147][52650] Updated weights for policy 0, policy_version 72691 (0.0026) [2024-08-06 06:56:40,847][52663] DAMAGECOUNT value on done: 799627.0 [2024-08-06 06:56:40,847][52663] Sum rewards: 73.880, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.216', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.119', 'weapon5': '0.176', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.314', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '59.000'} [2024-08-06 06:56:40,936][52658] DAMAGECOUNT value on done: 796798.0 [2024-08-06 06:56:40,937][52658] Sum rewards: 74.099, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.540', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.116', 'weapon4': '0.122', 'AMMO3': '0.147', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '0.900', 'weapon3': '3.178', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:41,006][52647] DAMAGECOUNT value on done: 838503.0 [2024-08-06 06:56:41,007][52647] Sum rewards: 74.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.518', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.164', 'AMMO4': '0.191', 'weapon5': '0.226', 'weapon2': '0.232', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:41,044][52669] DAMAGECOUNT value on done: 797302.0 [2024-08-06 06:56:41,044][52669] Sum rewards: 90.140, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'weapon5': '0.024', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.269', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.434', 'HITCOUNT': '4.400', 'DAMAGECOUNT': '21.864', 'FRAGCOUNT': '77.000'} [2024-08-06 06:56:41,118][52665] DAMAGECOUNT value on done: 782131.0 [2024-08-06 06:56:41,118][52665] Sum rewards: 60.367, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.299', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.154', 'weapon5': '0.182', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '48.000'} [2024-08-06 06:56:41,807][52671] DAMAGECOUNT value on done: 808666.0 [2024-08-06 06:56:41,811][52671] Sum rewards: 75.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.044', 'weapon5': '0.046', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.436', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:42,558][52794] DAMAGECOUNT value on done: 795739.0 [2024-08-06 06:56:42,560][52794] Sum rewards: 79.794, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.167', 'weapon4': '0.178', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.352', 'weapon2': '0.564', 'WEAPON3': '0.950', 'weapon3': '2.858', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 595525632. Throughput: 0: 4352.2. Samples: 148889590. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:56:42,794][52567] Avg episode reward: [(0, '74.420')] [2024-08-06 06:56:43,011][52649] DAMAGECOUNT value on done: 787386.0 [2024-08-06 06:56:43,014][52649] Sum rewards: 67.530, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.668', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.156', 'AMMO3': '0.162', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.956', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '53.000'} [2024-08-06 06:56:43,818][52663] DAMAGECOUNT value on done: 802553.0 [2024-08-06 06:56:43,819][52663] Sum rewards: 71.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.408', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.160', 'weapon5': '0.192', 'AMMO3': '0.213', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:43,885][52658] DAMAGECOUNT value on done: 821551.0 [2024-08-06 06:56:43,885][52658] Sum rewards: 73.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.514', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.138', 'weapon5': '0.166', 'AMMO4': '0.202', 'weapon4': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.622', 'WEAPON3': '0.800', 'weapon3': '2.630', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:43,956][52669] DAMAGECOUNT value on done: 812300.0 [2024-08-06 06:56:43,956][52669] Sum rewards: 75.923, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.140', 'weapon4': '0.146', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:44,290][52665] DAMAGECOUNT value on done: 788774.0 [2024-08-06 06:56:44,290][52665] Sum rewards: 71.304, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '0.002', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon7': '0.098', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.298', 'weapon2': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.670', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '57.000'} [2024-08-06 06:56:44,667][52671] DAMAGECOUNT value on done: 812323.0 [2024-08-06 06:56:44,667][52671] Sum rewards: 81.952, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.049', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.190', 'AMMO4': '0.196', 'weapon5': '0.222', 'weapon2': '0.222', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '69.000'} [2024-08-06 06:56:45,005][52650] Updated weights for policy 0, policy_version 72701 (0.0018) [2024-08-06 06:56:45,411][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:56:45,579][52794] DAMAGECOUNT value on done: 812141.0 [2024-08-06 06:56:45,579][52794] Sum rewards: 78.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.096', 'AMMO4': '0.153', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:46,093][52649] DAMAGECOUNT value on done: 770292.0 [2024-08-06 06:56:46,093][52649] Sum rewards: 72.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.700', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.122', 'weapon5': '0.166', 'weapon2': '0.188', 'AMMO4': '0.191', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.288', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:46,659][52663] DAMAGECOUNT value on done: 804483.0 [2024-08-06 06:56:46,661][52663] Sum rewards: 63.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.014', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.070', 'weapon4': '0.076', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'weapon2': '0.312', 'WEAPON3': '1.850', 'weapon3': '3.284', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:46,745][52669] DAMAGECOUNT value on done: 804293.0 [2024-08-06 06:56:46,746][52669] Sum rewards: 71.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.192', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.390', 'weapon3': '3.514', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:46,945][52658] DAMAGECOUNT value on done: 807529.0 [2024-08-06 06:56:46,946][52658] Sum rewards: 72.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.140', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '59.000'} [2024-08-06 06:56:47,440][52665] DAMAGECOUNT value on done: 791539.0 [2024-08-06 06:56:47,441][52665] Sum rewards: 40.605, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.906', 'AMMO5': '0.014', 'AMMO2': '0.047', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.117', 'weapon7': '0.190', 'AMMO4': '0.236', 'weapon5': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '0.650', 'weapon3': '1.336', 'weapon4': '1.360', 'HITCOUNT': '1.760', 'DAMAGECOUNT': '10.014', 'FRAGCOUNT': '33.000'} [2024-08-06 06:56:47,757][52671] DAMAGECOUNT value on done: 807735.0 [2024-08-06 06:56:47,758][52671] Sum rewards: 70.435, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.317', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.147', 'weapon2': '0.730', 'WEAPON3': '0.900', 'weapon3': '3.054', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17383.7). Total num frames: 595607552. Throughput: 0: 4353.1. Samples: 148902660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:56:47,794][52567] Avg episode reward: [(0, '74.558')] [2024-08-06 06:56:48,086][52794] DAMAGECOUNT value on done: 807048.0 [2024-08-06 06:56:48,086][52794] Sum rewards: 82.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.244', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.128', 'AMMO3': '0.190', 'weapon4': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '67.000'} [2024-08-06 06:56:48,873][52649] DAMAGECOUNT value on done: 791908.0 [2024-08-06 06:56:48,874][52649] Sum rewards: 74.477, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.322', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.171', 'weapon2': '0.172', 'weapon5': '0.200', 'AMMO4': '0.239', 'weapon4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.110', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '57.000'} [2024-08-06 06:56:49,439][52663] DAMAGECOUNT value on done: 810150.0 [2024-08-06 06:56:49,439][52663] Sum rewards: 64.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO2': '0.006', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'WEAPON4': '0.100', 'weapon5': '0.132', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.574', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.096', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '53.000'} [2024-08-06 06:56:49,589][52669] DAMAGECOUNT value on done: 808801.0 [2024-08-06 06:56:49,589][52669] Sum rewards: 76.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.251', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '66.000'} [2024-08-06 06:56:49,593][52650] Updated weights for policy 0, policy_version 72711 (0.0012) [2024-08-06 06:56:49,863][52658] DAMAGECOUNT value on done: 816873.0 [2024-08-06 06:56:49,865][52658] Sum rewards: 67.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.212', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon4': '0.258', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:49,940][52665] DAMAGECOUNT value on done: 792946.0 [2024-08-06 06:56:49,941][52665] Sum rewards: 64.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.103', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.054', 'AMMO4': '0.068', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.244', 'AMMO3': '0.260', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.332', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '56.000'} [2024-08-06 06:56:50,040][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:56:50,682][52671] DAMAGECOUNT value on done: 810700.0 [2024-08-06 06:56:50,683][52671] Sum rewards: 75.225, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.727', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.046', 'weapon5': '0.106', 'AMMO3': '0.169', 'AMMO4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:50,930][52794] DAMAGECOUNT value on done: 808025.0 [2024-08-06 06:56:50,932][52794] Sum rewards: 69.622, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.301', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:51,753][52649] DAMAGECOUNT value on done: 791039.0 [2024-08-06 06:56:51,753][52649] Sum rewards: 71.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.066', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '60.000'} [2024-08-06 06:56:52,004][52663] DAMAGECOUNT value on done: 800011.0 [2024-08-06 06:56:52,005][52663] Sum rewards: 65.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.915', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.197', 'weapon2': '0.870', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '55.000'} [2024-08-06 06:56:52,049][52669] DAMAGECOUNT value on done: 806657.0 [2024-08-06 06:56:52,049][52669] Sum rewards: 68.743, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.100', 'weapon4': '0.162', 'weapon2': '0.206', 'AMMO4': '0.223', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.294', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:52,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 595697664. Throughput: 0: 4345.5. Samples: 148928580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:56:52,795][52567] Avg episode reward: [(0, '74.016')] [2024-08-06 06:56:53,135][52665] DAMAGECOUNT value on done: 801383.0 [2024-08-06 06:56:53,138][52665] Sum rewards: 84.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.464', 'WEAPON3': '1.550', 'weapon3': '3.304', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '70.000'} [2024-08-06 06:56:53,532][52658] DAMAGECOUNT value on done: 805121.0 [2024-08-06 06:56:53,532][52658] Sum rewards: 73.110, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.850', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.108', 'weapon5': '0.170', 'weapon2': '0.216', 'AMMO3': '0.264', 'AMMO4': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:53,872][52794] DAMAGECOUNT value on done: 816807.0 [2024-08-06 06:56:53,875][52794] Sum rewards: 75.221, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.256', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO4': '0.165', 'weapon5': '0.166', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:53,994][52671] DAMAGECOUNT value on done: 818035.0 [2024-08-06 06:56:53,998][52671] Sum rewards: 64.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon2': '0.170', 'weapon5': '0.178', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.318', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.046', 'DAMAGECOUNT': '14.850', 'FRAGCOUNT': '53.000'} [2024-08-06 06:56:54,453][52649] DAMAGECOUNT value on done: 781147.0 [2024-08-06 06:56:54,453][52649] Sum rewards: 76.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.654', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '62.000'} [2024-08-06 06:56:54,966][52650] Updated weights for policy 0, policy_version 72721 (0.0031) [2024-08-06 06:56:55,497][52665] DAMAGECOUNT value on done: 792698.0 [2024-08-06 06:56:55,499][52665] Sum rewards: 75.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.328', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.092', 'AMMO4': '0.175', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '61.000'} [2024-08-06 06:56:55,957][52663] DAMAGECOUNT value on done: 792323.0 [2024-08-06 06:56:55,958][52663] Sum rewards: 76.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.184', 'AMMO3': '0.221', 'weapon4': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '63.000'} [2024-08-06 06:56:56,037][52669] DAMAGECOUNT value on done: 806169.0 [2024-08-06 06:56:56,037][52669] Sum rewards: 59.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.488', 'AMMO5': '0.015', 'AMMO2': '0.070', 'weapon4': '0.122', 'weapon5': '0.184', 'weapon2': '0.188', 'AMMO3': '0.218', 'AMMO4': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.740', 'weapon3': '3.186', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '50.000'} [2024-08-06 06:56:56,739][52658] DAMAGECOUNT value on done: 811723.0 [2024-08-06 06:56:56,740][52658] Sum rewards: 78.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'weapon4': '0.086', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.356', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '65.000'} [2024-08-06 06:56:56,852][52794] DAMAGECOUNT value on done: 806705.0 [2024-08-06 06:56:56,852][52794] Sum rewards: 57.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.355', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.166', 'AMMO3': '0.198', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.450', 'weapon4': '0.564', 'WEAPON3': '1.200', 'HITCOUNT': '2.450', 'weapon3': '2.580', 'DAMAGECOUNT': '14.169', 'FRAGCOUNT': '48.000'} [2024-08-06 06:56:57,380][52671] DAMAGECOUNT value on done: 807612.0 [2024-08-06 06:56:57,390][52671] Sum rewards: 71.902, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.092', 'weapon4': '0.130', 'AMMO3': '0.191', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:57,550][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:56:57,806][52567] Fps is (10 sec: 16364.3, 60 sec: 17199.8, 300 sec: 17355.2). Total num frames: 595771392. Throughput: 0: 4290.9. Samples: 148952180. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:56:57,806][52567] Avg episode reward: [(0, '73.537')] [2024-08-06 06:56:58,143][52665] DAMAGECOUNT value on done: 804036.0 [2024-08-06 06:56:58,145][52665] Sum rewards: 90.134, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.125', 'weapon5': '0.134', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'HEALTH': '0.776', 'WEAPON3': '1.000', 'weapon3': '3.408', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '71.000'} [2024-08-06 06:56:59,149][52669] DAMAGECOUNT value on done: 807123.0 [2024-08-06 06:56:59,150][52669] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.930', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '58.000'} [2024-08-06 06:56:59,160][52663] DAMAGECOUNT value on done: 796652.0 [2024-08-06 06:56:59,160][52663] Sum rewards: 77.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.050', 'weapon5': '0.072', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '64.000'} [2024-08-06 06:56:59,805][52650] Updated weights for policy 0, policy_version 72731 (0.0019) [2024-08-06 06:57:00,278][52658] DAMAGECOUNT value on done: 800901.0 [2024-08-06 06:57:00,278][52658] Sum rewards: 79.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '68.000'} [2024-08-06 06:57:00,535][52670] DAMAGECOUNT value on done: 792689.0 [2024-08-06 06:57:00,536][52670] Sum rewards: 60.015, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.496', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.118', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.504', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '51.000'} [2024-08-06 06:57:00,713][52671] DAMAGECOUNT value on done: 812241.0 [2024-08-06 06:57:00,713][52671] Sum rewards: 73.721, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.157', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.046', 'weapon5': '0.076', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:01,401][52665] DAMAGECOUNT value on done: 800464.0 [2024-08-06 06:57:01,403][52665] Sum rewards: 74.645, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.945', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.173', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.418', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2024-08-06 06:57:01,832][52663] DAMAGECOUNT value on done: 801348.0 [2024-08-06 06:57:01,832][52663] Sum rewards: 75.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'weapon5': '0.018', 'AMMO2': '0.024', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'weapon4': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '64.000'} [2024-08-06 06:57:01,837][52669] DAMAGECOUNT value on done: 816848.0 [2024-08-06 06:57:01,837][52669] Sum rewards: 71.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.197', 'AMMO3': '0.197', 'weapon4': '0.234', 'weapon5': '0.244', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '58.000'} [2024-08-06 06:57:02,794][52567] Fps is (10 sec: 15565.0, 60 sec: 17066.7, 300 sec: 17355.9). Total num frames: 595853312. Throughput: 0: 4254.5. Samples: 148963710. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:57:02,794][52567] Avg episode reward: [(0, '73.349')] [2024-08-06 06:57:03,325][52658] DAMAGECOUNT value on done: 810818.0 [2024-08-06 06:57:03,325][52658] Sum rewards: 79.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.977', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.142', 'weapon4': '0.160', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:03,824][52671] DAMAGECOUNT value on done: 809767.0 [2024-08-06 06:57:03,828][52671] Sum rewards: 79.002, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.293', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.346', 'WEAPON3': '1.050', 'weapon3': '3.430', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '64.000'} [2024-08-06 06:57:03,995][52670] DAMAGECOUNT value on done: 807043.0 [2024-08-06 06:57:03,996][52670] Sum rewards: 83.386, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.153', 'weapon5': '0.302', 'HEALTH': '0.328', 'weapon2': '0.636', 'WEAPON3': '0.850', 'weapon3': '2.918', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:04,658][52663] DAMAGECOUNT value on done: 811890.0 [2024-08-06 06:57:04,658][52663] Sum rewards: 74.820, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.875', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.253', 'weapon2': '0.562', 'WEAPON3': '1.600', 'weapon3': '3.164', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '64.000'} [2024-08-06 06:57:04,661][52669] DAMAGECOUNT value on done: 808349.0 [2024-08-06 06:57:04,664][52669] Sum rewards: 67.364, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.128', 'weapon4': '0.156', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.120', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '55.000'} [2024-08-06 06:57:04,664][52665] DAMAGECOUNT value on done: 795121.0 [2024-08-06 06:57:04,665][52665] Sum rewards: 76.964, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.355', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.076', 'weapon5': '0.096', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '3.040', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:04,983][52666] DAMAGECOUNT value on done: 803984.0 [2024-08-06 06:57:04,984][52666] Sum rewards: 87.849, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.525', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.026', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.180', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.540', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.750', 'FRAGCOUNT': '73.000'} [2024-08-06 06:57:05,375][52650] Updated weights for policy 0, policy_version 72741 (0.0020) [2024-08-06 06:57:06,437][52658] DAMAGECOUNT value on done: 791262.0 [2024-08-06 06:57:06,438][52658] Sum rewards: 78.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.502', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.114', 'AMMO3': '0.210', 'AMMO4': '0.284', 'weapon5': '0.292', 'weapon2': '0.404', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '63.000'} [2024-08-06 06:57:06,951][52671] DAMAGECOUNT value on done: 797822.0 [2024-08-06 06:57:06,952][52671] Sum rewards: 69.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.166', 'AMMO3': '0.189', 'weapon4': '0.230', 'AMMO4': '0.234', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '58.000'} [2024-08-06 06:57:07,030][52670] DAMAGECOUNT value on done: 792643.0 [2024-08-06 06:57:07,031][52670] Sum rewards: 67.590, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.115', 'AMMO2': '0.001', 'AMMO4': '0.005', 'weapon2': '0.200', 'AMMO3': '0.252', 'WEAPON3': '1.550', 'HITCOUNT': '3.470', 'weapon3': '3.608', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '58.000'} [2024-08-06 06:57:07,794][52567] Fps is (10 sec: 15583.4, 60 sec: 16793.6, 300 sec: 17300.4). Total num frames: 595927040. Throughput: 0: 4205.3. Samples: 148987450. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:57:07,795][52567] Avg episode reward: [(0, '73.435')] [2024-08-06 06:57:07,871][52669] DAMAGECOUNT value on done: 811277.0 [2024-08-06 06:57:07,871][52669] Sum rewards: 83.655, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.908', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.086', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.174', 'WEAPON4': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '68.000'} [2024-08-06 06:57:07,911][52666] DAMAGECOUNT value on done: 798783.0 [2024-08-06 06:57:07,912][52666] Sum rewards: 77.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.849', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.092', 'weapon4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '67.000'} [2024-08-06 06:57:07,923][52663] DAMAGECOUNT value on done: 792825.0 [2024-08-06 06:57:07,924][52663] Sum rewards: 67.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.373', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.109', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.246', 'weapon2': '0.562', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:07,977][52665] DAMAGECOUNT value on done: 797062.0 [2024-08-06 06:57:07,978][52665] Sum rewards: 73.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.518', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.182', 'AMMO3': '0.207', 'AMMO4': '0.237', 'weapon2': '0.270', 'weapon4': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '60.500'} [2024-08-06 06:57:09,075][52794] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:57:09,083][52658] DAMAGECOUNT value on done: 810405.0 [2024-08-06 06:57:09,084][52658] Sum rewards: 75.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.451', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.180', 'weapon5': '0.182', 'AMMO4': '0.228', 'weapon2': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.406', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 06:57:09,782][52671] DAMAGECOUNT value on done: 810702.0 [2024-08-06 06:57:09,784][52671] Sum rewards: 78.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.109', 'weapon5': '0.116', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '64.500'} [2024-08-06 06:57:09,987][52670] DAMAGECOUNT value on done: 791943.0 [2024-08-06 06:57:09,987][52670] Sum rewards: 70.239, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.340', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.139', 'weapon2': '0.732', 'WEAPON3': '0.900', 'weapon3': '3.162', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:10,149][52650] Updated weights for policy 0, policy_version 72751 (0.0023) [2024-08-06 06:57:10,284][52614] Signal inference workers to stop experience collection... (13300 times) [2024-08-06 06:57:10,284][52614] Signal inference workers to resume experience collection... (13300 times) [2024-08-06 06:57:10,341][52650] InferenceWorker_p0-w0: stopping experience collection (13300 times) [2024-08-06 06:57:10,367][52650] InferenceWorker_p0-w0: resuming experience collection (13300 times) [2024-08-06 06:57:10,719][52669] DAMAGECOUNT value on done: 816080.0 [2024-08-06 06:57:10,720][52669] Sum rewards: 73.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.026', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.193', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:10,830][52663] DAMAGECOUNT value on done: 789921.0 [2024-08-06 06:57:10,830][52663] Sum rewards: 84.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO2': '0.006', 'AMMO4': '0.029', 'AMMO3': '0.232', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '71.000'} [2024-08-06 06:57:11,146][52665] DAMAGECOUNT value on done: 791316.0 [2024-08-06 06:57:11,147][52665] Sum rewards: 72.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.228', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.288', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '62.000'} [2024-08-06 06:57:11,235][52666] DAMAGECOUNT value on done: 803485.0 [2024-08-06 06:57:11,236][52666] Sum rewards: 86.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.862', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'weapon4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.858', 'FRAGCOUNT': '69.500'} [2024-08-06 06:57:12,134][52658] DAMAGECOUNT value on done: 801745.0 [2024-08-06 06:57:12,134][52658] Sum rewards: 74.080, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.092', 'AMMO3': '0.199', 'weapon4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '60.000'} [2024-08-06 06:57:12,541][52671] DAMAGECOUNT value on done: 809234.0 [2024-08-06 06:57:12,551][52671] Sum rewards: 76.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.125', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.356', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '64.000'} [2024-08-06 06:57:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17066.7, 300 sec: 17300.4). Total num frames: 596025344. Throughput: 0: 4203.3. Samples: 149013780. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 06:57:12,794][52567] Avg episode reward: [(0, '73.489')] [2024-08-06 06:57:13,046][52670] DAMAGECOUNT value on done: 806157.0 [2024-08-06 06:57:13,047][52670] Sum rewards: 77.854, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.034', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.144', 'AMMO4': '0.153', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '67.000'} [2024-08-06 06:57:13,708][52669] DAMAGECOUNT value on done: 800024.0 [2024-08-06 06:57:13,713][52669] Sum rewards: 77.026, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.136', 'AMMO3': '0.198', 'weapon5': '0.202', 'AMMO4': '0.228', 'weapon2': '0.424', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '63.000'} [2024-08-06 06:57:13,832][52663] DAMAGECOUNT value on done: 798707.0 [2024-08-06 06:57:13,832][52663] Sum rewards: 77.017, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.166', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.132', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'weapon2': '0.332', 'WEAPON3': '1.700', 'weapon3': '3.242', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:14,263][52665] DAMAGECOUNT value on done: 797782.0 [2024-08-06 06:57:14,263][52665] Sum rewards: 71.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '59.000'} [2024-08-06 06:57:14,277][52666] DAMAGECOUNT value on done: 801499.0 [2024-08-06 06:57:14,278][52666] Sum rewards: 71.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.162', 'AMMO3': '0.219', 'AMMO4': '0.308', 'weapon5': '0.310', 'weapon2': '0.416', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '58.000'} [2024-08-06 06:57:14,698][52650] Updated weights for policy 0, policy_version 72761 (0.0014) [2024-08-06 06:57:14,806][52658] DAMAGECOUNT value on done: 798656.0 [2024-08-06 06:57:14,806][52658] Sum rewards: 83.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '68.000'} [2024-08-06 06:57:15,660][52671] DAMAGECOUNT value on done: 805204.0 [2024-08-06 06:57:15,661][52671] Sum rewards: 77.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.154', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.652', 'WEAPON3': '1.300', 'weapon3': '2.850', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '64.000'} [2024-08-06 06:57:16,083][52670] DAMAGECOUNT value on done: 796163.0 [2024-08-06 06:57:16,084][52670] Sum rewards: 66.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.912', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.076', 'AMMO4': '0.163', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:16,508][52669] DAMAGECOUNT value on done: 802184.0 [2024-08-06 06:57:16,509][52669] Sum rewards: 81.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.448', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.068', 'AMMO4': '0.186', 'weapon5': '0.222', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.014', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.882', 'FRAGCOUNT': '67.000'} [2024-08-06 06:57:16,653][52663] DAMAGECOUNT value on done: 797299.0 [2024-08-06 06:57:16,656][52663] Sum rewards: 67.362, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.674', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.127', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.280', 'WEAPON3': '1.650', 'weapon3': '3.290', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '59.000'} [2024-08-06 06:57:17,091][52666] DAMAGECOUNT value on done: 795044.0 [2024-08-06 06:57:17,091][52666] Sum rewards: 76.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.208', 'weapon2': '0.526', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '62.000'} [2024-08-06 06:57:17,211][52665] DAMAGECOUNT value on done: 798265.0 [2024-08-06 06:57:17,212][52665] Sum rewards: 82.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '67.000'} [2024-08-06 06:57:17,714][52658] DAMAGECOUNT value on done: 807252.0 [2024-08-06 06:57:17,714][52658] Sum rewards: 70.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.027', 'AMMO2': '0.066', 'AMMO3': '0.177', 'weapon5': '0.268', 'weapon2': '0.278', 'AMMO4': '0.328', 'weapon4': '0.350', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.638', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '57.000'} [2024-08-06 06:57:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 16930.3, 300 sec: 17328.2). Total num frames: 596107264. Throughput: 0: 4208.7. Samples: 149026890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:17,794][52567] Avg episode reward: [(0, '73.341')] [2024-08-06 06:57:18,427][52671] DAMAGECOUNT value on done: 813482.0 [2024-08-06 06:57:18,429][52671] Sum rewards: 59.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.858', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.076', 'weapon5': '0.144', 'AMMO3': '0.206', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '49.000'} [2024-08-06 06:57:19,091][52650] Updated weights for policy 0, policy_version 72771 (0.0019) [2024-08-06 06:57:19,306][52669] DAMAGECOUNT value on done: 808368.0 [2024-08-06 06:57:19,309][52669] Sum rewards: 78.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.930', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.102', 'weapon5': '0.128', 'AMMO4': '0.208', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:19,330][52670] DAMAGECOUNT value on done: 791803.0 [2024-08-06 06:57:19,331][52670] Sum rewards: 86.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.017', 'AMMO3': '0.205', 'weapon2': '0.562', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.793', 'FRAGCOUNT': '70.000'} [2024-08-06 06:57:19,495][52663] DAMAGECOUNT value on done: 808926.0 [2024-08-06 06:57:19,495][52663] Sum rewards: 74.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.438', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.158', 'AMMO3': '0.188', 'AMMO4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:20,332][52665] DAMAGECOUNT value on done: 789822.0 [2024-08-06 06:57:20,333][52665] Sum rewards: 72.499, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.124', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.136', 'weapon5': '0.190', 'AMMO3': '0.261', 'AMMO4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.940', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:20,440][52666] DAMAGECOUNT value on done: 801718.0 [2024-08-06 06:57:20,442][52666] Sum rewards: 76.084, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.134', 'weapon4': '0.138', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:21,415][52671] DAMAGECOUNT value on done: 809438.0 [2024-08-06 06:57:21,417][52671] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.360', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.116', 'weapon4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.454', 'WEAPON3': '1.750', 'weapon3': '2.990', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '59.000'} [2024-08-06 06:57:21,691][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:57:22,190][52668] DAMAGECOUNT value on done: 809534.0 [2024-08-06 06:57:22,193][52668] Sum rewards: 77.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.349', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.188', 'weapon5': '0.204', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:22,271][52669] DAMAGECOUNT value on done: 828864.0 [2024-08-06 06:57:22,272][52669] Sum rewards: 77.548, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.271', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.148', 'AMMO4': '0.187', 'weapon2': '0.222', 'weapon5': '0.256', 'weapon4': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.968', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:22,344][52670] DAMAGECOUNT value on done: 795197.0 [2024-08-06 06:57:22,346][52670] Sum rewards: 81.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.157', 'AMMO3': '0.209', 'weapon5': '0.232', 'weapon4': '0.252', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '65.500'} [2024-08-06 06:57:22,424][52663] DAMAGECOUNT value on done: 801594.0 [2024-08-06 06:57:22,425][52663] Sum rewards: 75.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.106', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.064', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17066.6, 300 sec: 17328.2). Total num frames: 596197376. Throughput: 0: 4218.2. Samples: 149053330. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:22,802][52567] Avg episode reward: [(0, '73.881')] [2024-08-06 06:57:23,259][52666] DAMAGECOUNT value on done: 797430.0 [2024-08-06 06:57:23,262][52666] Sum rewards: 78.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.365', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.094', 'AMMO3': '0.218', 'weapon5': '0.252', 'AMMO4': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.568', 'WEAPON3': '1.450', 'weapon3': '2.826', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '65.000'} [2024-08-06 06:57:23,485][52665] DAMAGECOUNT value on done: 794046.0 [2024-08-06 06:57:23,485][52665] Sum rewards: 84.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.413', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'weapon4': '0.172', 'weapon5': '0.196', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.793', 'FRAGCOUNT': '68.500'} [2024-08-06 06:57:24,022][52650] Updated weights for policy 0, policy_version 72781 (0.0011) [2024-08-06 06:57:24,143][52671] DAMAGECOUNT value on done: 796198.0 [2024-08-06 06:57:24,144][52671] Sum rewards: 76.684, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.168', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.172', 'AMMO4': '0.191', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '65.000'} [2024-08-06 06:57:25,072][52670] DAMAGECOUNT value on done: 796444.0 [2024-08-06 06:57:25,072][52670] Sum rewards: 69.429, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.456', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.128', 'AMMO4': '0.148', 'weapon2': '0.182', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.150', 'weapon3': '3.400', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:25,219][52668] DAMAGECOUNT value on done: 812632.0 [2024-08-06 06:57:25,222][52668] Sum rewards: 68.919, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.197', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon5': '0.136', 'weapon4': '0.140', 'weapon2': '0.248', 'AMMO3': '0.269', 'AMMO4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '60.000'} [2024-08-06 06:57:25,243][52669] DAMAGECOUNT value on done: 814215.0 [2024-08-06 06:57:25,244][52669] Sum rewards: 56.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.662', 'AMMO5': '0.018', 'AMMO2': '0.066', 'weapon4': '0.082', 'weapon5': '0.166', 'AMMO3': '0.204', 'AMMO4': '0.329', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '1.026', 'WEAPON3': '1.150', 'weapon3': '2.470', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '14.574', 'FRAGCOUNT': '47.000'} [2024-08-06 06:57:25,400][52663] DAMAGECOUNT value on done: 807018.0 [2024-08-06 06:57:25,401][52663] Sum rewards: 70.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.600', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.112', 'AMMO4': '0.141', 'weapon5': '0.146', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.550', 'weapon3': '3.174', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '60.000'} [2024-08-06 06:57:26,150][52666] DAMAGECOUNT value on done: 792191.0 [2024-08-06 06:57:26,156][52666] Sum rewards: 72.856, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.730', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.158', 'weapon5': '0.186', 'AMMO4': '0.204', 'AMMO3': '0.270', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.080', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '64.000'} [2024-08-06 06:57:26,430][52665] DAMAGECOUNT value on done: 797934.0 [2024-08-06 06:57:26,430][52665] Sum rewards: 78.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.352', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.244', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:26,478][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:57:27,243][52671] DAMAGECOUNT value on done: 817626.0 [2024-08-06 06:57:27,255][52671] Sum rewards: 80.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.854', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.118', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.664', 'WEAPON3': '1.500', 'weapon3': '2.902', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '67.000'} [2024-08-06 06:57:27,644][52670] DAMAGECOUNT value on done: 791560.0 [2024-08-06 06:57:27,646][52670] Sum rewards: 80.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.887', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.124', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.230', 'WEAPON3': '1.450', 'weapon3': '3.404', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '68.000'} [2024-08-06 06:57:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.1, 300 sec: 17300.5). Total num frames: 596279296. Throughput: 0: 4220.4. Samples: 149079510. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:27,802][52567] Avg episode reward: [(0, '73.985')] [2024-08-06 06:57:28,111][52669] DAMAGECOUNT value on done: 811185.0 [2024-08-06 06:57:28,112][52669] Sum rewards: 90.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.564', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.036', 'FRAGCOUNT': '73.000'} [2024-08-06 06:57:28,288][52663] DAMAGECOUNT value on done: 811634.0 [2024-08-06 06:57:28,290][52663] Sum rewards: 72.392, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.549', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'weapon2': '0.654', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '57.000'} [2024-08-06 06:57:28,303][52668] DAMAGECOUNT value on done: 806715.0 [2024-08-06 06:57:28,304][52668] Sum rewards: 66.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO2': '0.002', 'AMMO4': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.211', 'weapon2': '0.420', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.272', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:28,694][52666] DAMAGECOUNT value on done: 800640.0 [2024-08-06 06:57:28,696][52666] Sum rewards: 86.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.148', 'AMMO3': '0.185', 'AMMO4': '0.245', 'weapon5': '0.258', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '70.000'} [2024-08-06 06:57:29,046][52650] Updated weights for policy 0, policy_version 72791 (0.0024) [2024-08-06 06:57:30,831][52670] DAMAGECOUNT value on done: 802769.0 [2024-08-06 06:57:30,832][52670] Sum rewards: 69.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.662', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.138', 'weapon5': '0.166', 'AMMO3': '0.216', 'AMMO4': '0.227', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.172', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '59.000'} [2024-08-06 06:57:31,030][52671] DAMAGECOUNT value on done: 815264.0 [2024-08-06 06:57:31,032][52671] Sum rewards: 68.349, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.954', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO4': '0.212', 'weapon2': '0.248', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.818', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '60.000'} [2024-08-06 06:57:31,386][52669] DAMAGECOUNT value on done: 815087.0 [2024-08-06 06:57:31,386][52669] Sum rewards: 78.331, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.786', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.106', 'weapon5': '0.118', 'AMMO4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.500'} [2024-08-06 06:57:31,589][52663] DAMAGECOUNT value on done: 796495.0 [2024-08-06 06:57:31,592][52663] Sum rewards: 64.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.035', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.202', 'AMMO4': '0.211', 'AMMO3': '0.255', 'weapon4': '0.264', 'weapon2': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.924', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '55.000'} [2024-08-06 06:57:31,994][52666] DAMAGECOUNT value on done: 793976.0 [2024-08-06 06:57:31,994][52666] Sum rewards: 69.765, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.138', 'AMMO4': '0.248', 'weapon5': '0.252', 'weapon4': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.638', 'WEAPON3': '0.950', 'weapon3': '2.608', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '55.000'} [2024-08-06 06:57:32,186][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:57:32,231][52668] DAMAGECOUNT value on done: 813344.0 [2024-08-06 06:57:32,232][52668] Sum rewards: 68.067, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.017', 'AMMO4': '0.083', 'HEALTH': '0.106', 'AMMO3': '0.185', 'weapon2': '0.946', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '55.000'} [2024-08-06 06:57:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 16930.1, 300 sec: 17328.2). Total num frames: 596369408. Throughput: 0: 4184.7. Samples: 149090970. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:32,802][52567] Avg episode reward: [(0, '74.297')] [2024-08-06 06:57:33,762][52650] Updated weights for policy 0, policy_version 72801 (0.0010) [2024-08-06 06:57:33,890][52670] DAMAGECOUNT value on done: 786888.0 [2024-08-06 06:57:33,890][52670] Sum rewards: 72.142, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.466', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.068', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.440', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '63.000'} [2024-08-06 06:57:33,965][52671] DAMAGECOUNT value on done: 811196.0 [2024-08-06 06:57:33,967][52671] Sum rewards: 75.668, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.255', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.450', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '62.000'} [2024-08-06 06:57:34,542][52669] DAMAGECOUNT value on done: 818120.0 [2024-08-06 06:57:34,543][52669] Sum rewards: 83.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.170', 'weapon4': '0.186', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '69.000'} [2024-08-06 06:57:34,768][52668] DAMAGECOUNT value on done: 796618.0 [2024-08-06 06:57:34,769][52668] Sum rewards: 66.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.094', 'AMMO4': '0.145', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '55.500'} [2024-08-06 06:57:35,067][52666] DAMAGECOUNT value on done: 801590.0 [2024-08-06 06:57:35,068][52666] Sum rewards: 78.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.675', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.248', 'weapon4': '0.254', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '64.500'} [2024-08-06 06:57:36,552][52671] DAMAGECOUNT value on done: 814325.0 [2024-08-06 06:57:36,552][52671] Sum rewards: 69.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.060', 'weapon5': '0.156', 'AMMO3': '0.219', 'AMMO4': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '59.000'} [2024-08-06 06:57:36,867][52670] DAMAGECOUNT value on done: 798348.0 [2024-08-06 06:57:36,867][52670] Sum rewards: 73.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.754', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon4': '0.144', 'AMMO3': '0.205', 'weapon5': '0.224', 'AMMO4': '0.323', 'weapon2': '0.460', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:37,190][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:57:37,627][52668] DAMAGECOUNT value on done: 809758.0 [2024-08-06 06:57:37,628][52668] Sum rewards: 73.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.870', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.112', 'AMMO4': '0.172', 'weapon2': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.434', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '63.000'} [2024-08-06 06:57:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 16793.5, 300 sec: 17300.4). Total num frames: 596451328. Throughput: 0: 4190.4. Samples: 149117150. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:37,795][52567] Avg episode reward: [(0, '74.463')] [2024-08-06 06:57:37,943][52666] DAMAGECOUNT value on done: 789061.0 [2024-08-06 06:57:37,943][52666] Sum rewards: 76.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.131', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '64.000'} [2024-08-06 06:57:38,417][52650] Updated weights for policy 0, policy_version 72811 (0.0012) [2024-08-06 06:57:39,677][52671] DAMAGECOUNT value on done: 801592.0 [2024-08-06 06:57:39,678][52671] Sum rewards: 57.574, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.981', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon2': '0.202', 'weapon5': '0.234', 'AMMO3': '0.284', 'weapon4': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '2.760', 'weapon3': '2.884', 'DAMAGECOUNT': '14.328', 'FRAGCOUNT': '53.500'} [2024-08-06 06:57:39,823][52670] DAMAGECOUNT value on done: 806065.0 [2024-08-06 06:57:39,823][52670] Sum rewards: 63.973, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.648', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.126', 'weapon4': '0.162', 'AMMO4': '0.222', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:40,367][52668] DAMAGECOUNT value on done: 808645.0 [2024-08-06 06:57:40,368][52668] Sum rewards: 72.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.060', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.016', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '61.000'} [2024-08-06 06:57:40,747][52666] DAMAGECOUNT value on done: 803688.0 [2024-08-06 06:57:40,748][52666] Sum rewards: 71.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.948', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.187', 'weapon5': '0.228', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '57.000'} [2024-08-06 06:57:42,214][52671] Large shaping reward 3.216 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.165, 55.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:57:42,369][52670] DAMAGECOUNT value on done: 801504.0 [2024-08-06 06:57:42,372][52670] Sum rewards: 88.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.358', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.068', 'AMMO4': '0.158', 'weapon5': '0.204', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '73.000'} [2024-08-06 06:57:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 16930.1, 300 sec: 17328.2). Total num frames: 596541440. Throughput: 0: 4250.9. Samples: 149143420. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:42,794][52567] Avg episode reward: [(0, '74.432')] [2024-08-06 06:57:43,036][52650] Updated weights for policy 0, policy_version 72821 (0.0020) [2024-08-06 06:57:43,403][52668] DAMAGECOUNT value on done: 800281.0 [2024-08-06 06:57:43,404][52668] Sum rewards: 73.198, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.434', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.124', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '59.000'} [2024-08-06 06:57:43,411][52666] DAMAGECOUNT value on done: 799814.0 [2024-08-06 06:57:43,411][52666] Sum rewards: 84.341, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.610', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.088', 'weapon5': '0.202', 'weapon2': '0.222', 'AMMO3': '0.246', 'AMMO4': '0.299', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.717', 'FRAGCOUNT': '71.000'} [2024-08-06 06:57:44,747][52662] DAMAGECOUNT value on done: 804833.0 [2024-08-06 06:57:44,747][52662] Sum rewards: 65.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.284', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.156', 'AMMO3': '0.202', 'weapon4': '0.236', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '54.500'} [2024-08-06 06:57:45,391][52670] DAMAGECOUNT value on done: 781320.0 [2024-08-06 06:57:45,393][52670] Sum rewards: 83.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.176', 'AMMO3': '0.212', 'weapon5': '0.268', 'AMMO4': '0.283', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '68.000'} [2024-08-06 06:57:46,047][52668] DAMAGECOUNT value on done: 802242.0 [2024-08-06 06:57:46,048][52668] Sum rewards: 70.078, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.220', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.134', 'AMMO4': '0.169', 'weapon5': '0.186', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '58.000'} [2024-08-06 06:57:46,481][52666] DAMAGECOUNT value on done: 799231.0 [2024-08-06 06:57:46,483][52666] Sum rewards: 88.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.216', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.172', 'AMMO4': '0.174', 'weapon2': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.642', 'FRAGCOUNT': '72.000'} [2024-08-06 06:57:47,436][52671] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 06:57:47,552][52662] DAMAGECOUNT value on done: 815378.0 [2024-08-06 06:57:47,552][52662] Sum rewards: 81.128, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.286', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.104', 'AMMO4': '0.171', 'weapon5': '0.264', 'AMMO3': '0.283', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.012', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '70.000'} [2024-08-06 06:57:47,746][52650] Updated weights for policy 0, policy_version 72831 (0.0011) [2024-08-06 06:57:47,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17066.7, 300 sec: 17300.4). Total num frames: 596631552. Throughput: 0: 4287.8. Samples: 149156660. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:47,794][52567] Avg episode reward: [(0, '74.835')] [2024-08-06 06:57:48,320][52670] DAMAGECOUNT value on done: 795150.0 [2024-08-06 06:57:48,322][52670] Sum rewards: 71.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.718', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.122', 'AMMO3': '0.178', 'AMMO4': '0.265', 'weapon4': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '2.760', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '59.000'} [2024-08-06 06:57:48,826][52668] DAMAGECOUNT value on done: 810797.0 [2024-08-06 06:57:48,828][52668] Sum rewards: 71.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.535', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.154', 'weapon5': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.440', 'weapon2': '0.478', 'WEAPON3': '0.950', 'weapon3': '2.680', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '56.500'} [2024-08-06 06:57:49,269][52666] DAMAGECOUNT value on done: 795473.0 [2024-08-06 06:57:49,269][52666] Sum rewards: 80.043, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.034', 'AMMO4': '0.041', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.296', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '67.000'} [2024-08-06 06:57:50,725][52662] DAMAGECOUNT value on done: 816213.0 [2024-08-06 06:57:50,725][52662] Sum rewards: 71.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.910', 'AMMO5': '0.003', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.165', 'weapon4': '0.316', 'weapon2': '0.396', 'WEAPON3': '1.000', 'weapon3': '3.060', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:51,200][52670] DAMAGECOUNT value on done: 804130.0 [2024-08-06 06:57:51,200][52670] Sum rewards: 73.128, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.106', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '62.000'} [2024-08-06 06:57:51,694][52668] DAMAGECOUNT value on done: 804199.0 [2024-08-06 06:57:51,695][52668] Sum rewards: 69.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.446', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.114', 'AMMO4': '0.182', 'AMMO3': '0.188', 'weapon5': '0.232', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.120', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:52,289][52666] DAMAGECOUNT value on done: 794115.0 [2024-08-06 06:57:52,289][52666] Sum rewards: 66.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.070', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon4': '0.412', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '57.000'} [2024-08-06 06:57:52,553][52650] Updated weights for policy 0, policy_version 72841 (0.0011) [2024-08-06 06:57:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 16930.2, 300 sec: 17300.4). Total num frames: 596713472. Throughput: 0: 4343.3. Samples: 149182900. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:52,794][52567] Avg episode reward: [(0, '74.851')] [2024-08-06 06:57:53,398][52662] DAMAGECOUNT value on done: 801132.0 [2024-08-06 06:57:53,398][52662] Sum rewards: 80.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.179', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.189', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:54,078][52668] DAMAGECOUNT value on done: 798162.0 [2024-08-06 06:57:54,080][52668] Sum rewards: 77.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.728', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.110', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '65.000'} [2024-08-06 06:57:54,458][52670] DAMAGECOUNT value on done: 799639.0 [2024-08-06 06:57:54,459][52670] Sum rewards: 70.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.931', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.074', 'weapon4': '0.094', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '57.000'} [2024-08-06 06:57:55,536][52666] DAMAGECOUNT value on done: 809631.0 [2024-08-06 06:57:55,536][52666] Sum rewards: 70.579, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon4': '0.186', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.268', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '57.500'} [2024-08-06 06:57:56,266][52662] DAMAGECOUNT value on done: 817800.0 [2024-08-06 06:57:56,267][52662] Sum rewards: 80.748, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.132', 'weapon4': '0.190', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.200', 'weapon3': '3.236', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '65.000'} [2024-08-06 06:57:56,888][52668] DAMAGECOUNT value on done: 795274.0 [2024-08-06 06:57:56,891][52668] Sum rewards: 78.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.042', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '66.000'} [2024-08-06 06:57:57,061][52650] Updated weights for policy 0, policy_version 72851 (0.0023) [2024-08-06 06:57:57,782][52670] DAMAGECOUNT value on done: 801891.0 [2024-08-06 06:57:57,783][52670] Sum rewards: 72.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO2': '0.004', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'weapon4': '0.016', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '63.000'} [2024-08-06 06:57:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17206.7, 300 sec: 17300.4). Total num frames: 596803584. Throughput: 0: 4337.8. Samples: 149208980. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 06:57:57,802][52567] Avg episode reward: [(0, '74.890')] [2024-08-06 06:57:58,834][52666] DAMAGECOUNT value on done: 787607.0 [2024-08-06 06:57:58,836][52666] Sum rewards: 66.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.056', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '56.000'} [2024-08-06 06:57:59,365][52662] DAMAGECOUNT value on done: 797197.0 [2024-08-06 06:57:59,366][52662] Sum rewards: 59.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.090', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.164', 'AMMO4': '0.174', 'AMMO3': '0.262', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.146', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '52.000'} [2024-08-06 06:57:59,706][52668] DAMAGECOUNT value on done: 795179.0 [2024-08-06 06:57:59,708][52668] Sum rewards: 64.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.190', 'AMMO3': '0.194', 'AMMO4': '0.280', 'weapon4': '0.318', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '53.000'} [2024-08-06 06:58:01,666][52666] DAMAGECOUNT value on done: 796569.0 [2024-08-06 06:58:01,668][52666] Sum rewards: 70.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.080', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:01,991][52650] Updated weights for policy 0, policy_version 72861 (0.0011) [2024-08-06 06:58:02,309][52668] DAMAGECOUNT value on done: 791594.0 [2024-08-06 06:58:02,309][52668] Sum rewards: 69.527, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.108', 'AMMO3': '0.233', 'weapon5': '0.254', 'AMMO4': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '2.784', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:02,404][52662] DAMAGECOUNT value on done: 804999.0 [2024-08-06 06:58:02,405][52662] Sum rewards: 73.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.910', 'AMMO5': '0.017', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.145', 'weapon5': '0.252', 'WEAPON4': '0.300', 'weapon4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.774', 'WEAPON3': '0.850', 'weapon3': '2.480', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17328.2). Total num frames: 596893696. Throughput: 0: 4335.8. Samples: 149222000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:02,795][52567] Avg episode reward: [(0, '74.290')] [2024-08-06 06:58:03,796][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:58:05,183][52662] DAMAGECOUNT value on done: 820696.0 [2024-08-06 06:58:05,185][52662] Sum rewards: 73.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.195', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO3': '0.159', 'AMMO4': '0.172', 'weapon4': '0.308', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.902', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '58.000'} [2024-08-06 06:58:05,242][52660] DAMAGECOUNT value on done: 804840.0 [2024-08-06 06:58:05,243][52660] Sum rewards: 84.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.641', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.150', 'weapon5': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.021', 'FRAGCOUNT': '68.000'} [2024-08-06 06:58:05,444][52668] DAMAGECOUNT value on done: 803988.0 [2024-08-06 06:58:05,445][52668] Sum rewards: 65.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.335', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '53.000'} [2024-08-06 06:58:05,724][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:58:06,161][52811] DAMAGECOUNT value on done: 767752.0 [2024-08-06 06:58:06,162][52811] Sum rewards: 72.736, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.028', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'weapon5': '0.204', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.372', 'HEALTH': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:06,364][52650] Updated weights for policy 0, policy_version 72871 (0.0013) [2024-08-06 06:58:07,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17300.4). Total num frames: 596975616. Throughput: 0: 4336.0. Samples: 149248450. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:07,795][52567] Avg episode reward: [(0, '74.278')] [2024-08-06 06:58:07,989][52660] DAMAGECOUNT value on done: 795360.0 [2024-08-06 06:58:07,991][52660] Sum rewards: 66.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.854', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon4': '0.120', 'weapon5': '0.240', 'AMMO3': '0.254', 'weapon2': '0.272', 'AMMO4': '0.319', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '56.500'} [2024-08-06 06:58:08,139][52662] DAMAGECOUNT value on done: 808226.0 [2024-08-06 06:58:08,142][52662] Sum rewards: 71.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon5': '0.132', 'AMMO4': '0.136', 'AMMO3': '0.196', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.766', 'WEAPON3': '1.150', 'weapon3': '2.570', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '58.000'} [2024-08-06 06:58:08,165][52668] DAMAGECOUNT value on done: 808310.0 [2024-08-06 06:58:08,165][52668] Sum rewards: 76.425, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.555', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.228', 'weapon5': '0.232', 'AMMO4': '0.242', 'weapon2': '0.266', 'weapon4': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.890', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '64.000'} [2024-08-06 06:58:09,299][52811] DAMAGECOUNT value on done: 751057.0 [2024-08-06 06:58:09,299][52811] Sum rewards: 58.565, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.120', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon4': '0.166', 'weapon5': '0.202', 'AMMO3': '0.203', 'weapon2': '0.272', 'AMMO4': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.100', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '49.000'} [2024-08-06 06:58:10,290][52670] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.507, 169.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:58:10,961][52660] DAMAGECOUNT value on done: 808988.0 [2024-08-06 06:58:10,964][52660] Sum rewards: 76.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.927', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.668', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '65.000'} [2024-08-06 06:58:11,058][52650] Updated weights for policy 0, policy_version 72881 (0.0028) [2024-08-06 06:58:11,091][52662] DAMAGECOUNT value on done: 814811.0 [2024-08-06 06:58:11,091][52662] Sum rewards: 89.870, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.141', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.300', 'weapon2': '0.328', 'weapon4': '0.362', 'WEAPON3': '0.800', 'HEALTH': '0.866', 'weapon3': '3.008', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.642', 'FRAGCOUNT': '68.500'} [2024-08-06 06:58:11,154][52668] DAMAGECOUNT value on done: 803322.0 [2024-08-06 06:58:11,155][52668] Sum rewards: 83.258, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '67.500'} [2024-08-06 06:58:12,396][52811] DAMAGECOUNT value on done: 745924.0 [2024-08-06 06:58:12,398][52811] Sum rewards: 80.471, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.086', 'AMMO4': '0.093', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.296', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '66.000'} [2024-08-06 06:58:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17300.4). Total num frames: 597065728. Throughput: 0: 4340.0. Samples: 149274810. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:12,794][52567] Avg episode reward: [(0, '74.166')] [2024-08-06 06:58:13,722][52660] DAMAGECOUNT value on done: 818688.0 [2024-08-06 06:58:13,723][52660] Sum rewards: 67.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'weapon2': '0.200', 'AMMO3': '0.222', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.528', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:13,863][52668] DAMAGECOUNT value on done: 810141.0 [2024-08-06 06:58:13,865][52668] Sum rewards: 68.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.742', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon2': '0.198', 'weapon5': '0.202', 'AMMO3': '0.203', 'AMMO4': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.878', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:13,914][52662] DAMAGECOUNT value on done: 803820.0 [2024-08-06 06:58:13,915][52662] Sum rewards: 57.083, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.850', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.138', 'weapon4': '0.182', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '3.036', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '49.000'} [2024-08-06 06:58:15,608][52811] DAMAGECOUNT value on done: 747002.0 [2024-08-06 06:58:15,609][52811] Sum rewards: 77.561, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.267', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.314', 'WEAPON3': '1.600', 'weapon3': '3.296', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '66.000'} [2024-08-06 06:58:15,854][52650] Updated weights for policy 0, policy_version 72891 (0.0012) [2024-08-06 06:58:16,535][52662] DAMAGECOUNT value on done: 806676.0 [2024-08-06 06:58:16,540][52662] Sum rewards: 61.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.895', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.158', 'weapon4': '0.168', 'AMMO3': '0.211', 'AMMO4': '0.215', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '50.000'} [2024-08-06 06:58:16,608][52660] DAMAGECOUNT value on done: 800920.0 [2024-08-06 06:58:16,609][52660] Sum rewards: 69.374, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.126', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:16,691][52668] DAMAGECOUNT value on done: 808426.0 [2024-08-06 06:58:16,691][52668] Sum rewards: 74.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.505', 'AMMO5': '0.023', 'AMMO2': '0.053', 'weapon4': '0.206', 'AMMO3': '0.227', 'weapon5': '0.254', 'AMMO4': '0.264', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.766', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '64.000'} [2024-08-06 06:58:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.2, 300 sec: 17328.2). Total num frames: 597155840. Throughput: 0: 4379.1. Samples: 149288030. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:17,802][52567] Avg episode reward: [(0, '73.669')] [2024-08-06 06:58:18,517][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:58:18,615][52811] DAMAGECOUNT value on done: 753134.0 [2024-08-06 06:58:18,616][52811] Sum rewards: 73.602, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.146', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.248', 'weapon2': '0.566', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:19,257][52660] DAMAGECOUNT value on done: 795981.0 [2024-08-06 06:58:19,258][52660] Sum rewards: 71.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.989', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.223', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.264', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:19,458][52662] DAMAGECOUNT value on done: 799496.0 [2024-08-06 06:58:19,459][52662] Sum rewards: 72.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.447', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.078', 'weapon5': '0.172', 'AMMO3': '0.192', 'AMMO4': '0.291', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '60.500'} [2024-08-06 06:58:20,393][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:58:20,485][52650] Updated weights for policy 0, policy_version 72901 (0.0013) [2024-08-06 06:58:21,805][52811] DAMAGECOUNT value on done: 764516.0 [2024-08-06 06:58:21,806][52811] Sum rewards: 84.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.190', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '68.000'} [2024-08-06 06:58:22,113][52660] DAMAGECOUNT value on done: 804935.0 [2024-08-06 06:58:22,114][52660] Sum rewards: 78.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.056', 'AMMO4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '64.000'} [2024-08-06 06:58:22,446][52662] DAMAGECOUNT value on done: 811731.0 [2024-08-06 06:58:22,447][52662] Sum rewards: 76.064, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.323', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon4': '0.302', 'weapon2': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '61.000'} [2024-08-06 06:58:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17328.2). Total num frames: 597245952. Throughput: 0: 4383.4. Samples: 149314400. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:22,794][52567] Avg episode reward: [(0, '73.716')] [2024-08-06 06:58:24,488][52660] DAMAGECOUNT value on done: 811653.0 [2024-08-06 06:58:24,491][52660] Sum rewards: 79.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.333', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.334', 'weapon2': '0.586', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '64.000'} [2024-08-06 06:58:24,920][52811] DAMAGECOUNT value on done: 758138.0 [2024-08-06 06:58:24,920][52811] Sum rewards: 75.075, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.570', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.184', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '3.336', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '60.000'} [2024-08-06 06:58:25,231][52650] Updated weights for policy 0, policy_version 72911 (0.0022) [2024-08-06 06:58:25,419][52662] DAMAGECOUNT value on done: 799318.0 [2024-08-06 06:58:25,419][52662] Sum rewards: 76.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.015', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.104', 'AMMO4': '0.175', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '65.000'} [2024-08-06 06:58:25,996][52667] DAMAGECOUNT value on done: 805491.0 [2024-08-06 06:58:25,998][52667] Sum rewards: 69.857, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.305', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.086', 'weapon4': '0.088', 'AMMO4': '0.102', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:27,652][52660] DAMAGECOUNT value on done: 798590.0 [2024-08-06 06:58:27,654][52660] Sum rewards: 80.206, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.346', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.162', 'AMMO4': '0.194', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '66.000'} [2024-08-06 06:58:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17272.6). Total num frames: 597319680. Throughput: 0: 4382.7. Samples: 149340640. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:27,794][52567] Avg episode reward: [(0, '73.768')] [2024-08-06 06:58:27,889][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072916_597327872.pth... [2024-08-06 06:58:28,004][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072410_593182720.pth [2024-08-06 06:58:28,263][52811] DAMAGECOUNT value on done: 750991.0 [2024-08-06 06:58:28,266][52811] Sum rewards: 79.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.021', 'AMMO2': '0.074', 'weapon4': '0.114', 'AMMO3': '0.231', 'weapon5': '0.252', 'weapon2': '0.276', 'AMMO4': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '65.000'} [2024-08-06 06:58:28,483][52662] DAMAGECOUNT value on done: 816418.0 [2024-08-06 06:58:28,485][52662] Sum rewards: 82.873, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.146', 'AMMO4': '0.177', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '67.000'} [2024-08-06 06:58:29,203][52667] DAMAGECOUNT value on done: 814324.0 [2024-08-06 06:58:29,205][52667] Sum rewards: 76.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.596', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.233', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '65.000'} [2024-08-06 06:58:29,701][52650] Updated weights for policy 0, policy_version 72921 (0.0020) [2024-08-06 06:58:31,017][52660] DAMAGECOUNT value on done: 798115.0 [2024-08-06 06:58:31,020][52660] Sum rewards: 70.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.184', 'weapon5': '0.186', 'weapon2': '0.248', 'AMMO4': '0.277', 'weapon4': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:31,149][52662] DAMAGECOUNT value on done: 809072.0 [2024-08-06 06:58:31,152][52662] Sum rewards: 79.192, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.126', 'AMMO3': '0.142', 'AMMO4': '0.143', 'weapon4': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.344', 'HEALTH': '0.365', 'WEAPON3': '0.850', 'weapon3': '3.172', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 06:58:31,497][52811] DAMAGECOUNT value on done: 759105.0 [2024-08-06 06:58:31,498][52811] Sum rewards: 84.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.487', 'AMMO2': '0.014', 'AMMO5': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.171', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.050', 'weapon3': '3.196', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '67.000'} [2024-08-06 06:58:32,193][52667] DAMAGECOUNT value on done: 811309.0 [2024-08-06 06:58:32,196][52667] Sum rewards: 71.447, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.740', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.084', 'weapon4': '0.094', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.270', 'AMMO3': '0.305', 'WEAPON3': '1.800', 'weapon3': '3.262', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '63.000'} [2024-08-06 06:58:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17300.4). Total num frames: 597417984. Throughput: 0: 4363.1. Samples: 149353000. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:32,794][52567] Avg episode reward: [(0, '73.943')] [2024-08-06 06:58:33,817][52662] DAMAGECOUNT value on done: 794043.0 [2024-08-06 06:58:33,818][52662] Sum rewards: 81.403, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.754', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon2': '0.172', 'AMMO3': '0.189', 'AMMO4': '0.223', 'weapon5': '0.226', 'weapon4': '0.348', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '68.000'} [2024-08-06 06:58:34,351][52660] DAMAGECOUNT value on done: 807440.0 [2024-08-06 06:58:34,351][52660] Sum rewards: 68.497, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.315', 'weapon2': '0.318', 'WEAPON3': '1.850', 'weapon3': '3.360', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '60.000'} [2024-08-06 06:58:34,736][52650] Updated weights for policy 0, policy_version 72931 (0.0013) [2024-08-06 06:58:34,755][52811] DAMAGECOUNT value on done: 755008.0 [2024-08-06 06:58:34,757][52811] Sum rewards: 69.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.523', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '2.918', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:35,285][52667] DAMAGECOUNT value on done: 816187.0 [2024-08-06 06:58:35,286][52667] Sum rewards: 61.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.018', 'weapon5': '0.078', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.630', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.227', 'FRAGCOUNT': '52.000'} [2024-08-06 06:58:35,763][52659] DAMAGECOUNT value on done: 809214.0 [2024-08-06 06:58:35,765][52659] Sum rewards: 80.591, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.675', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '66.000'} [2024-08-06 06:58:37,106][52662] DAMAGECOUNT value on done: 806588.0 [2024-08-06 06:58:37,106][52662] Sum rewards: 71.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO4': '0.172', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.316', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:37,518][52660] DAMAGECOUNT value on done: 798540.0 [2024-08-06 06:58:37,519][52660] Sum rewards: 64.225, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.564', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.146', 'AMMO3': '0.167', 'AMMO4': '0.271', 'weapon5': '0.344', 'weapon2': '0.474', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'HITCOUNT': '2.600', 'weapon3': '2.746', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '51.000'} [2024-08-06 06:58:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17300.4). Total num frames: 597499904. Throughput: 0: 4365.8. Samples: 149379360. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:37,795][52567] Avg episode reward: [(0, '73.821')] [2024-08-06 06:58:37,892][52811] DAMAGECOUNT value on done: 759065.0 [2024-08-06 06:58:37,892][52811] Sum rewards: 75.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.513', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.172', 'AMMO3': '0.178', 'weapon5': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '60.000'} [2024-08-06 06:58:37,913][52667] Large shaping reward 2.578 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('HEALTH', -0.03, -10.0), ('weapon5', 0.002)] [2024-08-06 06:58:38,364][52667] DAMAGECOUNT value on done: 819059.0 [2024-08-06 06:58:38,365][52667] Sum rewards: 87.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.088', 'weapon5': '0.114', 'AMMO4': '0.122', 'weapon2': '0.196', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.390', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.009', 'FRAGCOUNT': '71.000'} [2024-08-06 06:58:38,441][52659] DAMAGECOUNT value on done: 806817.0 [2024-08-06 06:58:38,441][52659] Sum rewards: 78.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.615', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.166', 'AMMO3': '0.185', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '62.000'} [2024-08-06 06:58:39,347][52650] Updated weights for policy 0, policy_version 72941 (0.0016) [2024-08-06 06:58:40,039][52662] DAMAGECOUNT value on done: 796489.0 [2024-08-06 06:58:40,041][52662] Sum rewards: 65.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.616', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.156', 'AMMO3': '0.210', 'weapon2': '0.284', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.016', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '54.500'} [2024-08-06 06:58:40,475][52660] DAMAGECOUNT value on done: 803602.0 [2024-08-06 06:58:40,475][52660] Sum rewards: 62.427, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.164', 'weapon4': '0.190', 'AMMO3': '0.227', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '51.000'} [2024-08-06 06:58:40,653][52664] DAMAGECOUNT value on done: 834685.0 [2024-08-06 06:58:40,653][52664] Sum rewards: 84.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.922', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.062', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.195', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '69.000'} [2024-08-06 06:58:40,902][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:58:41,152][52667] DAMAGECOUNT value on done: 815768.0 [2024-08-06 06:58:41,154][52667] Sum rewards: 71.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.712', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.116', 'AMMO4': '0.173', 'weapon2': '0.232', 'AMMO3': '0.237', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '61.000'} [2024-08-06 06:58:41,191][52811] DAMAGECOUNT value on done: 764965.0 [2024-08-06 06:58:41,192][52811] Sum rewards: 70.154, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.482', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:41,244][52659] DAMAGECOUNT value on done: 812736.0 [2024-08-06 06:58:41,245][52659] Sum rewards: 87.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.114', 'weapon5': '0.128', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '74.000'} [2024-08-06 06:58:42,450][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:58:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17300.4). Total num frames: 597581824. Throughput: 0: 4370.4. Samples: 149405650. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 06:58:42,794][52567] Avg episode reward: [(0, '73.654')] [2024-08-06 06:58:43,086][52660] DAMAGECOUNT value on done: 815196.0 [2024-08-06 06:58:43,088][52660] Sum rewards: 76.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.345', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.145', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.462', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '62.000'} [2024-08-06 06:58:43,210][52664] DAMAGECOUNT value on done: 839352.0 [2024-08-06 06:58:43,213][52664] Sum rewards: 74.601, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.738', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.041', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '60.000'} [2024-08-06 06:58:43,946][52650] Updated weights for policy 0, policy_version 72951 (0.0011) [2024-08-06 06:58:44,009][52667] DAMAGECOUNT value on done: 812885.0 [2024-08-06 06:58:44,010][52667] Sum rewards: 71.775, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.640', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.008', 'WEAPON1': '0.020', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon2': '0.600', 'WEAPON3': '0.850', 'weapon3': '3.194', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '55.000'} [2024-08-06 06:58:44,319][52659] DAMAGECOUNT value on done: 808146.0 [2024-08-06 06:58:44,322][52659] Sum rewards: 77.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.362', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '64.000'} [2024-08-06 06:58:44,348][52811] DAMAGECOUNT value on done: 755866.0 [2024-08-06 06:58:44,350][52811] Sum rewards: 76.060, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.735', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.188', 'weapon2': '0.214', 'weapon5': '0.214', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.672', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '61.000'} [2024-08-06 06:58:46,219][52660] DAMAGECOUNT value on done: 824199.0 [2024-08-06 06:58:46,219][52660] Sum rewards: 73.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.338', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon4': '0.050', 'AMMO4': '0.157', 'weapon5': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.780', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '60.000'} [2024-08-06 06:58:46,432][52664] DAMAGECOUNT value on done: 839545.0 [2024-08-06 06:58:46,446][52664] Sum rewards: 61.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.103', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.062', 'weapon5': '0.078', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.372', 'WEAPON3': '1.450', 'HITCOUNT': '3.070', 'weapon3': '3.274', 'DAMAGECOUNT': '15.459', 'FRAGCOUNT': '54.500'} [2024-08-06 06:58:46,744][52667] DAMAGECOUNT value on done: 807520.0 [2024-08-06 06:58:46,744][52667] Sum rewards: 70.411, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.940', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.302', 'weapon2': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:47,173][52659] DAMAGECOUNT value on done: 808034.0 [2024-08-06 06:58:47,174][52659] Sum rewards: 83.229, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.344', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.172', 'AMMO4': '0.192', 'AMMO3': '0.214', 'weapon4': '0.234', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '68.000'} [2024-08-06 06:58:47,388][52811] DAMAGECOUNT value on done: 754693.0 [2024-08-06 06:58:47,388][52811] Sum rewards: 75.258, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.587', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.062', 'AMMO3': '0.147', 'weapon5': '0.168', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '58.000'} [2024-08-06 06:58:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17328.2). Total num frames: 597680128. Throughput: 0: 4374.2. Samples: 149418840. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:58:47,794][52567] Avg episode reward: [(0, '73.900')] [2024-08-06 06:58:48,932][52650] Updated weights for policy 0, policy_version 72961 (0.0013) [2024-08-06 06:58:49,087][52660] DAMAGECOUNT value on done: 803281.0 [2024-08-06 06:58:49,092][52660] Sum rewards: 85.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.183', 'weapon2': '0.744', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '69.000'} [2024-08-06 06:58:49,209][52647] DAMAGECOUNT value on done: 860322.0 [2024-08-06 06:58:49,210][52647] Sum rewards: 75.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.180', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon4': '0.282', 'weapon2': '0.398', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '60.000'} [2024-08-06 06:58:49,246][52667] DAMAGECOUNT value on done: 811566.0 [2024-08-06 06:58:49,246][52667] Sum rewards: 60.685, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.270', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.102', 'AMMO4': '0.226', 'AMMO3': '0.262', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.992', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '55.000'} [2024-08-06 06:58:49,527][52664] DAMAGECOUNT value on done: 832674.0 [2024-08-06 06:58:49,535][52664] Sum rewards: 78.707, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.701', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.225', 'weapon5': '0.226', 'AMMO4': '0.267', 'weapon4': '0.314', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '65.000'} [2024-08-06 06:58:50,095][52659] DAMAGECOUNT value on done: 807304.0 [2024-08-06 06:58:50,096][52659] Sum rewards: 75.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.928', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.109', 'weapon5': '0.136', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 06:58:50,502][52811] DAMAGECOUNT value on done: 752879.0 [2024-08-06 06:58:50,505][52811] Sum rewards: 86.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.050', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.124', 'weapon4': '0.138', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.768', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '69.000'} [2024-08-06 06:58:50,841][52820] DAMAGECOUNT value on done: 747056.0 [2024-08-06 06:58:50,841][52820] Sum rewards: 72.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.245', 'weapon2': '0.358', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '62.000'} [2024-08-06 06:58:51,679][52647] DAMAGECOUNT value on done: 848382.0 [2024-08-06 06:58:51,680][52647] Sum rewards: 69.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.096', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.098', 'weapon2': '0.158', 'AMMO3': '0.190', 'AMMO4': '0.247', 'weapon5': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.230', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '56.000'} [2024-08-06 06:58:52,051][52664] DAMAGECOUNT value on done: 844525.0 [2024-08-06 06:58:52,052][52664] Sum rewards: 67.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.153', 'AMMO5': '0.016', 'AMMO2': '0.061', 'AMMO3': '0.181', 'weapon5': '0.248', 'AMMO4': '0.305', 'weapon4': '0.310', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.750', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '53.000'} [2024-08-06 06:58:52,189][52660] DAMAGECOUNT value on done: 808877.0 [2024-08-06 06:58:52,189][52660] Sum rewards: 69.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.216', 'AMMO5': '0.016', 'AMMO2': '0.070', 'AMMO3': '0.218', 'weapon5': '0.262', 'weapon4': '0.274', 'AMMO4': '0.352', 'WEAPON5': '0.500', 'weapon2': '0.516', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.598', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '58.000'} [2024-08-06 06:58:52,266][52667] DAMAGECOUNT value on done: 815068.0 [2024-08-06 06:58:52,268][52667] Sum rewards: 71.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.124', 'weapon4': '0.144', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:52,644][52659] DAMAGECOUNT value on done: 808808.0 [2024-08-06 06:58:52,644][52659] Sum rewards: 72.043, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.162', 'weapon4': '0.164', 'AMMO4': '0.226', 'AMMO3': '0.236', 'weapon2': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '61.000'} [2024-08-06 06:58:52,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17328.2). Total num frames: 597770240. Throughput: 0: 4366.2. Samples: 149444930. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:58:52,794][52567] Avg episode reward: [(0, '73.927')] [2024-08-06 06:58:53,421][52650] Updated weights for policy 0, policy_version 72971 (0.0015) [2024-08-06 06:58:53,655][52811] DAMAGECOUNT value on done: 755264.0 [2024-08-06 06:58:53,655][52811] Sum rewards: 83.746, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.156', 'AMMO3': '0.188', 'AMMO4': '0.202', 'weapon5': '0.222', 'HEALTH': '0.252', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.082', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '67.000'} [2024-08-06 06:58:54,121][52820] DAMAGECOUNT value on done: 748826.0 [2024-08-06 06:58:54,122][52820] Sum rewards: 80.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'AMMO5': '0.017', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.174', 'weapon5': '0.194', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '66.000'} [2024-08-06 06:58:54,211][52647] DAMAGECOUNT value on done: 855266.0 [2024-08-06 06:58:54,213][52647] Sum rewards: 85.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.374', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.094', 'AMMO4': '0.121', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '69.000'} [2024-08-06 06:58:54,664][52664] DAMAGECOUNT value on done: 838320.0 [2024-08-06 06:58:54,666][52664] Sum rewards: 80.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.210', 'AMMO3': '0.230', 'weapon2': '0.296', 'weapon4': '0.300', 'WEAPON3': '1.350', 'weapon3': '2.906', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '65.000'} [2024-08-06 06:58:55,078][52659] DAMAGECOUNT value on done: 806425.0 [2024-08-06 06:58:55,078][52659] Sum rewards: 78.816, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.853', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.112', 'weapon5': '0.142', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 06:58:55,240][52667] DAMAGECOUNT value on done: 806560.0 [2024-08-06 06:58:55,242][52667] Sum rewards: 86.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.034', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.210', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '71.000'} [2024-08-06 06:58:55,249][52660] DAMAGECOUNT value on done: 807382.0 [2024-08-06 06:58:55,249][52660] Sum rewards: 66.566, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.549', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.215', 'weapon2': '0.342', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.534', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:55,780][52803] DAMAGECOUNT value on done: 751846.0 [2024-08-06 06:58:55,782][52803] Sum rewards: 89.389, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.629', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.114', 'AMMO4': '0.148', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.294', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '22.338', 'FRAGCOUNT': '74.000'} [2024-08-06 06:58:56,718][52647] DAMAGECOUNT value on done: 853497.0 [2024-08-06 06:58:56,721][52647] Sum rewards: 80.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.037', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.120', 'AMMO3': '0.174', 'AMMO4': '0.185', 'weapon5': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '2.854', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 06:58:56,801][52811] DAMAGECOUNT value on done: 759546.0 [2024-08-06 06:58:56,803][52811] Sum rewards: 68.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.866', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.144', 'AMMO4': '0.180', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.446', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '2.656', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.000'} [2024-08-06 06:58:57,231][52820] DAMAGECOUNT value on done: 748449.0 [2024-08-06 06:58:57,233][52820] Sum rewards: 75.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.604', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.128', 'AMMO4': '0.160', 'AMMO3': '0.194', 'weapon2': '0.202', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.210', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '61.000'} [2024-08-06 06:58:57,399][52664] DAMAGECOUNT value on done: 831626.0 [2024-08-06 06:58:57,400][52664] Sum rewards: 59.928, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.778', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.134', 'AMMO4': '0.152', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.138', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '46.000'} [2024-08-06 06:58:57,433][52659] DAMAGECOUNT value on done: 810497.0 [2024-08-06 06:58:57,434][52659] Sum rewards: 63.915, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.843', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.068', 'AMMO4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '51.000'} [2024-08-06 06:58:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17328.2). Total num frames: 597852160. Throughput: 0: 4364.4. Samples: 149471210. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:58:57,794][52567] Avg episode reward: [(0, '74.181')] [2024-08-06 06:58:58,189][52650] Updated weights for policy 0, policy_version 72981 (0.0015) [2024-08-06 06:58:58,348][52667] DAMAGECOUNT value on done: 808958.0 [2024-08-06 06:58:58,349][52667] Sum rewards: 74.887, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.845', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.078', 'weapon5': '0.104', 'AMMO3': '0.150', 'AMMO4': '0.151', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.942', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '59.000'} [2024-08-06 06:58:58,391][52795] DAMAGECOUNT value on done: 750638.0 [2024-08-06 06:58:58,391][52795] Sum rewards: 69.159, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.754', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO4': '0.220', 'weapon2': '0.236', 'weapon5': '0.248', 'AMMO3': '0.263', 'weapon4': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '58.000'} [2024-08-06 06:58:58,408][52660] DAMAGECOUNT value on done: 798634.0 [2024-08-06 06:58:58,410][52660] Sum rewards: 77.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.032', 'weapon5': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon4': '0.306', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '63.000'} [2024-08-06 06:58:58,889][52803] DAMAGECOUNT value on done: 749384.0 [2024-08-06 06:58:58,889][52803] Sum rewards: 71.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.818', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'weapon4': '0.102', 'AMMO4': '0.141', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '57.000'} [2024-08-06 06:58:59,831][52811] DAMAGECOUNT value on done: 762797.0 [2024-08-06 06:58:59,835][52811] Sum rewards: 77.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.312', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '65.000'} [2024-08-06 06:58:59,861][52647] DAMAGECOUNT value on done: 860604.0 [2024-08-06 06:58:59,862][52647] Sum rewards: 77.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.528', 'AMMO5': '0.020', 'AMMO2': '0.076', 'AMMO3': '0.183', 'weapon2': '0.260', 'weapon5': '0.314', 'AMMO4': '0.379', 'WEAPON5': '0.550', 'weapon4': '0.596', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.472', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '63.000'} [2024-08-06 06:59:00,240][52820] DAMAGECOUNT value on done: 738272.0 [2024-08-06 06:59:00,241][52820] Sum rewards: 69.726, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.394', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.170', 'weapon2': '0.228', 'AMMO4': '0.232', 'weapon5': '0.246', 'weapon4': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '55.000'} [2024-08-06 06:59:00,256][52659] DAMAGECOUNT value on done: 815937.0 [2024-08-06 06:59:00,258][52659] Sum rewards: 74.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.112', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:00,532][52664] DAMAGECOUNT value on done: 828158.0 [2024-08-06 06:59:00,532][52664] Sum rewards: 85.196, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'HEALTH': '0.244', 'weapon2': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.368', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '68.000'} [2024-08-06 06:59:01,325][52667] DAMAGECOUNT value on done: 818294.0 [2024-08-06 06:59:01,326][52667] Sum rewards: 74.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.796', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.132', 'AMMO3': '0.190', 'AMMO4': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:01,516][52660] DAMAGECOUNT value on done: 798361.0 [2024-08-06 06:59:01,516][52660] Sum rewards: 90.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.173', 'AMMO3': '0.206', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.871', 'FRAGCOUNT': '74.000'} [2024-08-06 06:59:01,594][52795] DAMAGECOUNT value on done: 737221.0 [2024-08-06 06:59:01,594][52795] Sum rewards: 67.772, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.402', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon2': '0.218', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.180', 'weapon3': '3.352', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 06:59:02,081][52803] DAMAGECOUNT value on done: 754930.0 [2024-08-06 06:59:02,081][52803] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.042', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.158', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:02,742][52650] Updated weights for policy 0, policy_version 72991 (0.0012) [2024-08-06 06:59:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17328.2). Total num frames: 597942272. Throughput: 0: 4367.3. Samples: 149484560. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:59:02,794][52567] Avg episode reward: [(0, '74.691')] [2024-08-06 06:59:02,903][52647] DAMAGECOUNT value on done: 857169.0 [2024-08-06 06:59:02,903][52647] Sum rewards: 73.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.157', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.157', 'weapon4': '0.212', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '61.500'} [2024-08-06 06:59:02,909][52811] DAMAGECOUNT value on done: 754300.0 [2024-08-06 06:59:02,910][52811] Sum rewards: 79.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.228', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:03,302][52659] DAMAGECOUNT value on done: 802670.0 [2024-08-06 06:59:03,304][52659] Sum rewards: 60.375, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.885', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.194', 'weapon2': '0.306', 'WEAPON3': '1.000', 'HITCOUNT': '2.870', 'weapon3': '3.274', 'DAMAGECOUNT': '14.682', 'FRAGCOUNT': '48.000'} [2024-08-06 06:59:03,307][52820] DAMAGECOUNT value on done: 752213.0 [2024-08-06 06:59:03,311][52820] Sum rewards: 74.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.158', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.070', 'weapon5': '0.108', 'AMMO4': '0.141', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '63.500'} [2024-08-06 06:59:03,431][52664] DAMAGECOUNT value on done: 841698.0 [2024-08-06 06:59:03,431][52664] Sum rewards: 92.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.254', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.096', 'AMMO4': '0.145', 'weapon5': '0.178', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '22.527', 'FRAGCOUNT': '74.000'} [2024-08-06 06:59:04,348][52667] DAMAGECOUNT value on done: 805761.0 [2024-08-06 06:59:04,348][52667] Sum rewards: 79.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.122', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon2': '0.186', 'weapon5': '0.220', 'AMMO4': '0.223', 'AMMO3': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:04,759][52795] DAMAGECOUNT value on done: 742976.0 [2024-08-06 06:59:04,764][52795] Sum rewards: 73.471, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.349', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.176', 'AMMO4': '0.177', 'AMMO3': '0.246', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:05,172][52803] DAMAGECOUNT value on done: 753330.0 [2024-08-06 06:59:05,181][52803] Sum rewards: 64.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.641', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO3': '0.144', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.000', 'weapon3': '2.928', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '52.000'} [2024-08-06 06:59:05,421][52647] DAMAGECOUNT value on done: 859023.0 [2024-08-06 06:59:05,424][52647] Sum rewards: 77.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.620', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.081', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.324', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '63.000'} [2024-08-06 06:59:05,989][52811] DAMAGECOUNT value on done: 754665.0 [2024-08-06 06:59:05,989][52811] Sum rewards: 67.396, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.495', 'AMMO5': '0.029', 'AMMO2': '0.074', 'weapon4': '0.138', 'AMMO3': '0.264', 'weapon5': '0.280', 'weapon2': '0.316', 'AMMO4': '0.369', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.840', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:06,180][52664] DAMAGECOUNT value on done: 834953.0 [2024-08-06 06:59:06,182][52664] Sum rewards: 69.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.550', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.162', 'weapon5': '0.224', 'AMMO3': '0.265', 'AMMO4': '0.272', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.866', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:06,398][52659] DAMAGECOUNT value on done: 813488.0 [2024-08-06 06:59:06,399][52659] Sum rewards: 73.352, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.223', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.072', 'weapon2': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.180', 'WEAPON3': '1.150', 'weapon3': '3.436', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:06,447][52820] DAMAGECOUNT value on done: 736675.0 [2024-08-06 06:59:06,448][52820] Sum rewards: 64.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.948', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon4': '0.056', 'weapon5': '0.108', 'weapon2': '0.218', 'AMMO3': '0.229', 'AMMO4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.422', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '55.000'} [2024-08-06 06:59:07,515][52650] Updated weights for policy 0, policy_version 73001 (0.0027) [2024-08-06 06:59:07,524][52667] DAMAGECOUNT value on done: 812815.0 [2024-08-06 06:59:07,524][52667] Sum rewards: 78.654, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.492', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.102', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '63.000'} [2024-08-06 06:59:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17328.2). Total num frames: 598024192. Throughput: 0: 4359.6. Samples: 149510580. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:59:07,794][52567] Avg episode reward: [(0, '74.776')] [2024-08-06 06:59:07,889][52795] DAMAGECOUNT value on done: 750631.0 [2024-08-06 06:59:07,891][52795] Sum rewards: 80.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.072', 'AMMO4': '0.142', 'weapon5': '0.148', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.264', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '67.000'} [2024-08-06 06:59:08,055][52647] DAMAGECOUNT value on done: 838721.0 [2024-08-06 06:59:08,055][52647] Sum rewards: 84.960, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.077', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.146', 'AMMO4': '0.153', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '21.234', 'FRAGCOUNT': '71.500'} [2024-08-06 06:59:08,268][52803] DAMAGECOUNT value on done: 753224.0 [2024-08-06 06:59:08,270][52803] Sum rewards: 71.453, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.096', 'weapon5': '0.122', 'AMMO3': '0.164', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.000', 'weapon3': '3.170', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:08,758][52664] DAMAGECOUNT value on done: 846858.0 [2024-08-06 06:59:08,758][52664] Sum rewards: 77.491, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.086', 'AMMO3': '0.179', 'weapon5': '0.214', 'AMMO4': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'HEALTH': '0.613', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:09,398][52659] DAMAGECOUNT value on done: 808582.0 [2024-08-06 06:59:09,402][52659] Sum rewards: 71.243, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.650', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.180', 'weapon5': '0.186', 'weapon2': '0.212', 'AMMO4': '0.257', 'AMMO3': '0.285', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '62.500'} [2024-08-06 06:59:09,517][52820] DAMAGECOUNT value on done: 743438.0 [2024-08-06 06:59:09,519][52820] Sum rewards: 64.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.198', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.304', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '54.000'} [2024-08-06 06:59:09,930][52667] DAMAGECOUNT value on done: 817402.0 [2024-08-06 06:59:09,932][52667] Sum rewards: 75.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.824', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.074', 'AMMO4': '0.220', 'weapon2': '0.242', 'weapon5': '0.262', 'AMMO3': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:10,462][52647] DAMAGECOUNT value on done: 854584.0 [2024-08-06 06:59:10,463][52647] Sum rewards: 81.526, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.260', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'weapon3': '3.360', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '71.000'} [2024-08-06 06:59:11,072][52795] DAMAGECOUNT value on done: 738987.0 [2024-08-06 06:59:11,072][52795] Sum rewards: 78.389, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.420', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '63.000'} [2024-08-06 06:59:11,174][52664] DAMAGECOUNT value on done: 843295.0 [2024-08-06 06:59:11,175][52664] Sum rewards: 77.073, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.886', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.148', 'AMMO3': '0.213', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.832', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '64.000'} [2024-08-06 06:59:11,376][52803] DAMAGECOUNT value on done: 753625.0 [2024-08-06 06:59:11,378][52803] Sum rewards: 80.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.348', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.094', 'weapon5': '0.122', 'AMMO4': '0.161', 'weapon2': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:12,186][52650] Updated weights for policy 0, policy_version 73011 (0.0022) [2024-08-06 06:59:12,424][52659] DAMAGECOUNT value on done: 808975.0 [2024-08-06 06:59:12,430][52659] Sum rewards: 70.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.198', 'AMMO3': '0.203', 'weapon4': '0.204', 'AMMO4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:12,637][52820] DAMAGECOUNT value on done: 745642.0 [2024-08-06 06:59:12,637][52820] Sum rewards: 58.609, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.094', 'AMMO3': '0.193', 'AMMO4': '0.223', 'weapon5': '0.246', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.096', 'DAMAGECOUNT': '13.428', 'FRAGCOUNT': '48.000'} [2024-08-06 06:59:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17300.4). Total num frames: 598114304. Throughput: 0: 4357.3. Samples: 149536720. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:59:12,794][52567] Avg episode reward: [(0, '74.791')] [2024-08-06 06:59:12,831][52667] DAMAGECOUNT value on done: 817501.0 [2024-08-06 06:59:12,831][52667] Sum rewards: 84.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.103', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.094', 'weapon5': '0.118', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '20.841', 'FRAGCOUNT': '66.500'} [2024-08-06 06:59:12,988][52647] DAMAGECOUNT value on done: 851088.0 [2024-08-06 06:59:12,989][52647] Sum rewards: 74.712, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.706', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.374', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:13,615][52664] DAMAGECOUNT value on done: 842836.0 [2024-08-06 06:59:13,616][52664] Sum rewards: 71.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.052', 'AMMO2': '0.006', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'weapon4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.570', 'WEAPON3': '1.550', 'weapon3': '3.004', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:14,185][52794] DAMAGECOUNT value on done: 803194.0 [2024-08-06 06:59:14,186][52794] Sum rewards: 67.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.424', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:14,237][52795] DAMAGECOUNT value on done: 746112.0 [2024-08-06 06:59:14,237][52795] Sum rewards: 76.027, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.273', 'AMMO5': '0.010', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.078', 'weapon4': '0.110', 'weapon5': '0.144', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.090', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:14,519][52803] DAMAGECOUNT value on done: 745363.0 [2024-08-06 06:59:14,519][52803] Sum rewards: 67.957, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.298', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.508', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '55.000'} [2024-08-06 06:59:14,853][52649] DAMAGECOUNT value on done: 785172.0 [2024-08-06 06:59:14,854][52649] Sum rewards: 71.318, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.346', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.231', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:15,388][52647] DAMAGECOUNT value on done: 851303.0 [2024-08-06 06:59:15,389][52647] Sum rewards: 74.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.954', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon4': '0.094', 'AMMO4': '0.200', 'AMMO3': '0.203', 'weapon5': '0.228', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:15,551][52659] DAMAGECOUNT value on done: 809817.0 [2024-08-06 06:59:15,560][52659] Sum rewards: 78.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.112', 'weapon4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.522', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:15,743][52820] DAMAGECOUNT value on done: 750942.0 [2024-08-06 06:59:15,744][52820] Sum rewards: 93.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '22.101', 'FRAGCOUNT': '77.000'} [2024-08-06 06:59:15,856][52667] DAMAGECOUNT value on done: 815996.0 [2024-08-06 06:59:15,856][52667] Sum rewards: 81.290, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.117', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.110', 'weapon4': '0.124', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '67.000'} [2024-08-06 06:59:16,423][52664] DAMAGECOUNT value on done: 852554.0 [2024-08-06 06:59:16,430][52664] Sum rewards: 79.062, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.632', 'AMMO5': '0.011', 'AMMO2': '0.062', 'weapon5': '0.152', 'weapon4': '0.196', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'AMMO4': '0.312', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:16,441][52647] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 06:59:16,831][52650] Updated weights for policy 0, policy_version 73021 (0.0019) [2024-08-06 06:59:17,366][52794] DAMAGECOUNT value on done: 810720.0 [2024-08-06 06:59:17,368][52794] Sum rewards: 68.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.092', 'AMMO4': '0.095', 'weapon2': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'HITCOUNT': '3.410', 'weapon3': '3.524', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:17,384][52795] DAMAGECOUNT value on done: 754837.0 [2024-08-06 06:59:17,384][52795] Sum rewards: 69.742, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.256', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.136', 'weapon5': '0.168', 'AMMO4': '0.194', 'AMMO3': '0.217', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.206', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:17,622][52803] DAMAGECOUNT value on done: 746097.0 [2024-08-06 06:59:17,624][52803] Sum rewards: 64.123, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.369', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon4': '0.162', 'AMMO3': '0.183', 'weapon2': '0.274', 'weapon5': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '52.500'} [2024-08-06 06:59:17,796][52567] Fps is (10 sec: 17200.2, 60 sec: 17339.2, 300 sec: 17272.5). Total num frames: 598196224. Throughput: 0: 4376.7. Samples: 149549960. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:59:17,796][52567] Avg episode reward: [(0, '74.747')] [2024-08-06 06:59:18,024][52649] DAMAGECOUNT value on done: 776153.0 [2024-08-06 06:59:18,024][52649] Sum rewards: 74.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.631', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:18,283][52647] DAMAGECOUNT value on done: 840658.0 [2024-08-06 06:59:18,283][52647] Sum rewards: 72.153, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.056', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:18,593][52659] DAMAGECOUNT value on done: 809120.0 [2024-08-06 06:59:18,594][52659] Sum rewards: 59.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.132', 'weapon5': '0.140', 'AMMO4': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '51.000'} [2024-08-06 06:59:18,725][52667] DAMAGECOUNT value on done: 813288.0 [2024-08-06 06:59:18,725][52667] Sum rewards: 86.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.985', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.174', 'AMMO4': '0.178', 'weapon2': '0.210', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '71.000'} [2024-08-06 06:59:19,097][52820] DAMAGECOUNT value on done: 758782.0 [2024-08-06 06:59:19,098][52820] Sum rewards: 85.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.465', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.162', 'AMMO4': '0.209', 'AMMO3': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '70.000'} [2024-08-06 06:59:19,145][52664] DAMAGECOUNT value on done: 851011.0 [2024-08-06 06:59:19,145][52664] Sum rewards: 71.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.280', 'weapon4': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:20,337][52794] DAMAGECOUNT value on done: 815719.0 [2024-08-06 06:59:20,337][52794] Sum rewards: 76.917, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.641', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.116', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'weapon4': '0.288', 'WEAPON3': '0.950', 'weapon3': '3.140', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '60.500'} [2024-08-06 06:59:20,523][52647] DAMAGECOUNT value on done: 857795.0 [2024-08-06 06:59:20,524][52647] Sum rewards: 70.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.478', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:20,604][52803] DAMAGECOUNT value on done: 751480.0 [2024-08-06 06:59:20,613][52803] Sum rewards: 74.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.448', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.086', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO4': '0.192', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:20,718][52795] DAMAGECOUNT value on done: 744595.0 [2024-08-06 06:59:20,718][52795] Sum rewards: 82.573, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.150', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.128', 'AMMO4': '0.196', 'weapon2': '0.242', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.344', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '69.000'} [2024-08-06 06:59:21,199][52649] DAMAGECOUNT value on done: 795116.0 [2024-08-06 06:59:21,202][52649] Sum rewards: 78.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.144', 'weapon5': '0.144', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.194', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:21,381][52659] DAMAGECOUNT value on done: 818587.0 [2024-08-06 06:59:21,382][52659] Sum rewards: 78.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.068', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.160', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.272', 'weapon2': '0.410', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '63.000'} [2024-08-06 06:59:21,417][52650] Updated weights for policy 0, policy_version 73031 (0.0024) [2024-08-06 06:59:21,465][52667] DAMAGECOUNT value on done: 819118.0 [2024-08-06 06:59:21,465][52667] Sum rewards: 69.313, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.860', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon2': '0.142', 'weapon5': '0.160', 'AMMO3': '0.173', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.442', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '54.000'} [2024-08-06 06:59:21,608][52664] DAMAGECOUNT value on done: 845680.0 [2024-08-06 06:59:21,608][52664] Sum rewards: 70.210, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.194', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.096', 'weapon2': '0.196', 'weapon5': '0.196', 'AMMO4': '0.241', 'AMMO3': '0.287', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.198', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:22,247][52820] DAMAGECOUNT value on done: 741570.0 [2024-08-06 06:59:22,252][52820] Sum rewards: 72.746, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.685', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.140', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon4': '0.284', 'WEAPON3': '0.950', 'weapon3': '3.088', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17300.4). Total num frames: 598286336. Throughput: 0: 4367.3. Samples: 149575890. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 06:59:22,794][52567] Avg episode reward: [(0, '74.757')] [2024-08-06 06:59:23,063][52647] DAMAGECOUNT value on done: 844386.0 [2024-08-06 06:59:23,064][52647] Sum rewards: 69.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.852', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.102', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2024-08-06 06:59:23,229][52794] DAMAGECOUNT value on done: 803520.0 [2024-08-06 06:59:23,230][52794] Sum rewards: 66.893, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.355', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.162', 'AMMO3': '0.204', 'AMMO4': '0.213', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.696', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '55.500'} [2024-08-06 06:59:23,694][52803] DAMAGECOUNT value on done: 750913.0 [2024-08-06 06:59:23,694][52803] Sum rewards: 78.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.547', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.038', 'AMMO4': '0.066', 'weapon4': '0.070', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:23,842][52795] DAMAGECOUNT value on done: 749831.0 [2024-08-06 06:59:23,845][52795] Sum rewards: 70.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:24,133][52649] DAMAGECOUNT value on done: 789173.0 [2024-08-06 06:59:24,135][52649] Sum rewards: 73.111, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.136', 'AMMO3': '0.188', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:24,232][52664] DAMAGECOUNT value on done: 834160.0 [2024-08-06 06:59:24,232][52664] Sum rewards: 74.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.532', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.078', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '62.500'} [2024-08-06 06:59:24,441][52659] DAMAGECOUNT value on done: 805760.0 [2024-08-06 06:59:24,443][52659] Sum rewards: 70.483, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.444', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon5': '0.184', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:24,873][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:59:25,475][52820] DAMAGECOUNT value on done: 750021.0 [2024-08-06 06:59:25,478][52820] Sum rewards: 83.193, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'weapon4': '0.408', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:25,903][52647] DAMAGECOUNT value on done: 853393.0 [2024-08-06 06:59:25,903][52647] Sum rewards: 75.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.048', 'AMMO4': '0.123', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.708', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:26,437][52650] Updated weights for policy 0, policy_version 73041 (0.0016) [2024-08-06 06:59:26,571][52794] DAMAGECOUNT value on done: 801259.0 [2024-08-06 06:59:26,571][52794] Sum rewards: 86.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.444', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.034', 'AMMO4': '0.104', 'weapon5': '0.122', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '69.000'} [2024-08-06 06:59:26,779][52803] DAMAGECOUNT value on done: 763308.0 [2024-08-06 06:59:26,780][52803] Sum rewards: 69.929, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.736', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.076', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.050', 'HITCOUNT': '3.300', 'weapon3': '3.342', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:26,893][52664] DAMAGECOUNT value on done: 839121.0 [2024-08-06 06:59:26,895][52664] Sum rewards: 65.478, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.634', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.252', 'WEAPON3': '1.400', 'HITCOUNT': '3.420', 'weapon3': '3.520', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '55.000'} [2024-08-06 06:59:27,072][52795] DAMAGECOUNT value on done: 751010.0 [2024-08-06 06:59:27,073][52795] Sum rewards: 72.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.080', 'weapon5': '0.154', 'AMMO3': '0.168', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.666', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:27,382][52649] DAMAGECOUNT value on done: 781286.0 [2024-08-06 06:59:27,382][52649] Sum rewards: 81.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.182', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.144', 'weapon5': '0.184', 'AMMO4': '0.197', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '21.201', 'FRAGCOUNT': '65.500'} [2024-08-06 06:59:27,608][52659] DAMAGECOUNT value on done: 813849.0 [2024-08-06 06:59:27,609][52659] Sum rewards: 58.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.838', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.150', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.764', 'WEAPON3': '1.300', 'weapon3': '2.874', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '49.000'} [2024-08-06 06:59:27,794][52567] Fps is (10 sec: 18845.0, 60 sec: 17749.3, 300 sec: 17383.7). Total num frames: 598384640. Throughput: 0: 4369.8. Samples: 149602290. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 06:59:27,794][52567] Avg episode reward: [(0, '74.695')] [2024-08-06 06:59:28,423][52647] DAMAGECOUNT value on done: 854098.0 [2024-08-06 06:59:28,424][52647] Sum rewards: 71.604, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO5': '0.014', 'AMMO2': '0.016', 'weapon5': '0.026', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon2': '0.594', 'WEAPON3': '0.950', 'weapon3': '3.160', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '56.500'} [2024-08-06 06:59:28,543][52820] DAMAGECOUNT value on done: 759551.0 [2024-08-06 06:59:28,544][52820] Sum rewards: 76.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.114', 'weapon5': '0.128', 'weapon2': '0.154', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.396', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '64.000'} [2024-08-06 06:59:29,500][52664] DAMAGECOUNT value on done: 842088.0 [2024-08-06 06:59:29,500][52664] Sum rewards: 73.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.952', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO4': '0.201', 'AMMO3': '0.223', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:29,575][52794] DAMAGECOUNT value on done: 808438.0 [2024-08-06 06:59:29,577][52794] Sum rewards: 72.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.842', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '59.500'} [2024-08-06 06:59:29,792][52803] DAMAGECOUNT value on done: 754433.0 [2024-08-06 06:59:29,795][52803] Sum rewards: 82.377, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.575', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.132', 'weapon5': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.266', 'weapon2': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.058', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:30,126][52614] Signal inference workers to stop experience collection... (13350 times) [2024-08-06 06:59:30,127][52614] Signal inference workers to resume experience collection... (13350 times) [2024-08-06 06:59:30,183][52650] InferenceWorker_p0-w0: stopping experience collection (13350 times) [2024-08-06 06:59:30,184][52650] InferenceWorker_p0-w0: resuming experience collection (13350 times) [2024-08-06 06:59:30,215][52795] DAMAGECOUNT value on done: 747323.0 [2024-08-06 06:59:30,219][52795] Sum rewards: 73.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.116', 'AMMO3': '0.179', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:30,219][52649] DAMAGECOUNT value on done: 790472.0 [2024-08-06 06:59:30,221][52649] Sum rewards: 59.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.090', 'AMMO4': '0.112', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.268', 'DAMAGECOUNT': '14.577', 'FRAGCOUNT': '51.000'} [2024-08-06 06:59:30,659][52650] Updated weights for policy 0, policy_version 73051 (0.0024) [2024-08-06 06:59:30,712][52659] DAMAGECOUNT value on done: 807012.0 [2024-08-06 06:59:30,714][52659] Sum rewards: 76.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.330', 'ARMOR': '0.008', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.138', 'AMMO4': '0.163', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:31,082][52647] DAMAGECOUNT value on done: 842141.0 [2024-08-06 06:59:31,083][52647] Sum rewards: 78.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.762', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.102', 'AMMO3': '0.241', 'weapon5': '0.248', 'weapon2': '0.280', 'AMMO4': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:31,495][52658] DAMAGECOUNT value on done: 810327.0 [2024-08-06 06:59:31,495][52658] Sum rewards: 71.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.899', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.078', 'weapon5': '0.198', 'AMMO3': '0.223', 'weapon2': '0.264', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.258', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:31,660][52820] DAMAGECOUNT value on done: 753910.0 [2024-08-06 06:59:31,661][52820] Sum rewards: 87.293, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.207', 'WEAPON3': '1.400', 'weapon3': '3.426', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '71.000'} [2024-08-06 06:59:32,267][52664] DAMAGECOUNT value on done: 835963.0 [2024-08-06 06:59:32,267][52664] Sum rewards: 66.780, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.076', 'weapon4': '0.164', 'AMMO4': '0.172', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '54.000'} [2024-08-06 06:59:32,468][52794] DAMAGECOUNT value on done: 812613.0 [2024-08-06 06:59:32,470][52794] Sum rewards: 72.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.398', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:32,712][52649] DAMAGECOUNT value on done: 788339.0 [2024-08-06 06:59:32,712][52649] Sum rewards: 71.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.607', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.084', 'weapon2': '0.148', 'weapon5': '0.182', 'AMMO3': '0.216', 'AMMO4': '0.273', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.392', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2024-08-06 06:59:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 598458368. Throughput: 0: 4368.0. Samples: 149615400. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 06:59:32,794][52567] Avg episode reward: [(0, '74.211')] [2024-08-06 06:59:32,936][52803] DAMAGECOUNT value on done: 752056.0 [2024-08-06 06:59:32,936][52803] Sum rewards: 76.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.458', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.134', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:33,327][52795] DAMAGECOUNT value on done: 740902.0 [2024-08-06 06:59:33,328][52795] Sum rewards: 79.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.055', 'weapon5': '0.130', 'AMMO3': '0.232', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO4': '0.275', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '67.000'} [2024-08-06 06:59:34,240][52647] DAMAGECOUNT value on done: 846581.0 [2024-08-06 06:59:34,241][52647] Sum rewards: 76.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.333', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.124', 'AMMO4': '0.141', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:34,279][52658] DAMAGECOUNT value on done: 810947.0 [2024-08-06 06:59:34,280][52658] Sum rewards: 72.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.830', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.108', 'AMMO4': '0.136', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.658', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:34,714][52820] DAMAGECOUNT value on done: 754380.0 [2024-08-06 06:59:34,714][52820] Sum rewards: 69.266, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.118', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.096', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.331', 'WEAPON3': '1.900', 'weapon3': '3.392', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:35,336][52649] DAMAGECOUNT value on done: 792773.0 [2024-08-06 06:59:35,336][52649] Sum rewards: 70.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.066', 'weapon5': '0.080', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:35,369][52794] DAMAGECOUNT value on done: 800192.0 [2024-08-06 06:59:35,369][52794] Sum rewards: 61.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.130', 'weapon5': '0.142', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.308', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '51.000'} [2024-08-06 06:59:35,599][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 06:59:35,788][52650] Updated weights for policy 0, policy_version 73061 (0.0012) [2024-08-06 06:59:36,094][52803] DAMAGECOUNT value on done: 764626.0 [2024-08-06 06:59:36,096][52803] Sum rewards: 75.717, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.076', 'AMMO4': '0.077', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.132', 'WEAPON4': '0.200', 'weapon2': '0.686', 'WEAPON3': '0.800', 'weapon3': '3.032', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:36,541][52795] DAMAGECOUNT value on done: 742893.0 [2024-08-06 06:59:36,541][52795] Sum rewards: 71.434, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO5': '0.018', 'weapon4': '0.064', 'AMMO2': '0.071', 'weapon5': '0.136', 'AMMO3': '0.229', 'AMMO4': '0.354', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '60.500'} [2024-08-06 06:59:37,166][52647] DAMAGECOUNT value on done: 838582.0 [2024-08-06 06:59:37,167][52647] Sum rewards: 83.668, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.696', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.113', 'weapon5': '0.124', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.744', 'WEAPON3': '0.950', 'weapon3': '2.840', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '64.000'} [2024-08-06 06:59:37,566][52658] DAMAGECOUNT value on done: 815905.0 [2024-08-06 06:59:37,566][52658] Sum rewards: 66.987, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.621', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.078', 'AMMO4': '0.133', 'weapon5': '0.180', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:37,691][52664] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 06:59:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 598548480. Throughput: 0: 4373.1. Samples: 149641720. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 06:59:37,794][52567] Avg episode reward: [(0, '74.130')] [2024-08-06 06:59:37,882][52820] DAMAGECOUNT value on done: 751333.0 [2024-08-06 06:59:37,885][52820] Sum rewards: 82.592, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.502', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO3': '0.263', 'weapon2': '0.438', 'WEAPON3': '1.650', 'weapon3': '3.086', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.883', 'FRAGCOUNT': '70.000'} [2024-08-06 06:59:38,450][52794] DAMAGECOUNT value on done: 810978.0 [2024-08-06 06:59:38,450][52794] Sum rewards: 68.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.722', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.080', 'AMMO4': '0.178', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.616', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:38,601][52649] DAMAGECOUNT value on done: 790564.0 [2024-08-06 06:59:38,602][52649] Sum rewards: 82.794, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.255', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.062', 'AMMO4': '0.078', 'AMMO3': '0.173', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.876', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:39,182][52803] DAMAGECOUNT value on done: 752137.0 [2024-08-06 06:59:39,182][52803] Sum rewards: 83.035, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.252', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.176', 'AMMO4': '0.188', 'AMMO3': '0.230', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '69.000'} [2024-08-06 06:59:39,752][52795] DAMAGECOUNT value on done: 753044.0 [2024-08-06 06:59:39,752][52795] Sum rewards: 81.449, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.580', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.098', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:39,905][52647] DAMAGECOUNT value on done: 843770.0 [2024-08-06 06:59:39,905][52647] Sum rewards: 56.728, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.090', 'weapon5': '0.138', 'AMMO3': '0.213', 'AMMO4': '0.293', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '49.000'} [2024-08-06 06:59:40,388][52650] Updated weights for policy 0, policy_version 73071 (0.0021) [2024-08-06 06:59:40,536][52658] DAMAGECOUNT value on done: 811368.0 [2024-08-06 06:59:40,537][52658] Sum rewards: 68.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.182', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.110', 'weapon4': '0.120', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.241', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:40,962][52820] DAMAGECOUNT value on done: 753161.0 [2024-08-06 06:59:40,974][52820] Sum rewards: 78.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon4': '0.220', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:41,360][52649] DAMAGECOUNT value on done: 785086.0 [2024-08-06 06:59:41,360][52649] Sum rewards: 77.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.216', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon2': '0.172', 'weapon5': '0.178', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.416', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:41,458][52794] DAMAGECOUNT value on done: 804443.0 [2024-08-06 06:59:41,459][52794] Sum rewards: 81.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.266', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.020', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '69.000'} [2024-08-06 06:59:42,142][52803] DAMAGECOUNT value on done: 754062.0 [2024-08-06 06:59:42,143][52803] Sum rewards: 69.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.156', 'AMMO4': '0.182', 'weapon2': '0.208', 'weapon4': '0.226', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17355.9). Total num frames: 598638592. Throughput: 0: 4371.3. Samples: 149667920. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 06:59:42,794][52567] Avg episode reward: [(0, '74.182')] [2024-08-06 06:59:42,903][52795] DAMAGECOUNT value on done: 738226.0 [2024-08-06 06:59:42,904][52795] Sum rewards: 76.536, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.780', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon2': '0.164', 'weapon5': '0.166', 'AMMO4': '0.200', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:43,510][52658] DAMAGECOUNT value on done: 807508.0 [2024-08-06 06:59:43,510][52658] Sum rewards: 82.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.210', 'WEAPON3': '1.300', 'weapon3': '3.500', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '67.000'} [2024-08-06 06:59:44,061][52665] DAMAGECOUNT value on done: 798565.0 [2024-08-06 06:59:44,062][52665] Sum rewards: 74.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.679', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon2': '0.124', 'AMMO3': '0.205', 'WEAPON3': '1.250', 'HITCOUNT': '3.460', 'weapon3': '3.736', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:44,070][52820] DAMAGECOUNT value on done: 764012.0 [2024-08-06 06:59:44,070][52820] Sum rewards: 77.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon4': '0.146', 'AMMO3': '0.200', 'weapon5': '0.248', 'AMMO4': '0.312', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:44,290][52794] DAMAGECOUNT value on done: 799703.0 [2024-08-06 06:59:44,291][52794] Sum rewards: 76.361, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.144', 'weapon5': '0.154', 'weapon4': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:44,406][52649] DAMAGECOUNT value on done: 795443.0 [2024-08-06 06:59:44,410][52649] Sum rewards: 79.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.593', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.060', 'AMMO4': '0.108', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:44,938][52650] Updated weights for policy 0, policy_version 73081 (0.0019) [2024-08-06 06:59:45,169][52803] DAMAGECOUNT value on done: 757232.0 [2024-08-06 06:59:45,171][52803] Sum rewards: 81.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.774', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.080', 'weapon5': '0.128', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '68.000'} [2024-08-06 06:59:45,999][52795] DAMAGECOUNT value on done: 751781.0 [2024-08-06 06:59:46,007][52795] Sum rewards: 64.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.742', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.096', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.276', 'weapon4': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '53.000'} [2024-08-06 06:59:46,327][52658] DAMAGECOUNT value on done: 800956.0 [2024-08-06 06:59:46,329][52658] Sum rewards: 77.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.484', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.102', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.273', 'WEAPON3': '1.600', 'weapon3': '3.306', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:47,019][52665] DAMAGECOUNT value on done: 812185.0 [2024-08-06 06:59:47,019][52665] Sum rewards: 75.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.443', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'weapon4': '0.086', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.434', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '63.000'} [2024-08-06 06:59:47,082][52794] DAMAGECOUNT value on done: 810327.0 [2024-08-06 06:59:47,082][52794] Sum rewards: 59.213, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.488', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon2': '0.546', 'WEAPON3': '1.700', 'HITCOUNT': '3.010', 'weapon3': '3.020', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '54.000'} [2024-08-06 06:59:47,117][52820] DAMAGECOUNT value on done: 760133.0 [2024-08-06 06:59:47,122][52820] Sum rewards: 70.038, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.247', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.074', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.500', 'weapon2': '0.570', 'WEAPON3': '0.900', 'weapon3': '2.738', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '55.000'} [2024-08-06 06:59:47,482][52649] DAMAGECOUNT value on done: 802673.0 [2024-08-06 06:59:47,482][52649] Sum rewards: 72.832, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.681', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.086', 'AMMO4': '0.159', 'AMMO3': '0.168', 'weapon4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 598728704. Throughput: 0: 4370.7. Samples: 149681240. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 06:59:47,794][52567] Avg episode reward: [(0, '74.318')] [2024-08-06 06:59:48,215][52803] DAMAGECOUNT value on done: 763036.0 [2024-08-06 06:59:48,215][52803] Sum rewards: 77.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.060', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.488', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '64.000'} [2024-08-06 06:59:48,379][52663] DAMAGECOUNT value on done: 824841.0 [2024-08-06 06:59:48,379][52663] Sum rewards: 79.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.756', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:48,979][52666] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.057, -19.0), ('weapon5', 0.002)] [2024-08-06 06:59:49,106][52658] DAMAGECOUNT value on done: 814322.0 [2024-08-06 06:59:49,106][52658] Sum rewards: 72.710, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:49,136][52795] DAMAGECOUNT value on done: 751182.0 [2024-08-06 06:59:49,136][52795] Sum rewards: 75.839, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.515', 'AMMO5': '0.020', 'AMMO2': '0.041', 'AMMO3': '0.129', 'AMMO4': '0.206', 'weapon2': '0.258', 'weapon5': '0.272', 'weapon4': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.884', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:49,611][52650] Updated weights for policy 0, policy_version 73091 (0.0044) [2024-08-06 06:59:50,291][52665] DAMAGECOUNT value on done: 804138.0 [2024-08-06 06:59:50,293][52665] Sum rewards: 53.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.864', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.066', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'weapon2': '0.358', 'WEAPON3': '1.650', 'HITCOUNT': '2.840', 'weapon3': '3.254', 'DAMAGECOUNT': '14.397', 'FRAGCOUNT': '48.500'} [2024-08-06 06:59:50,368][52669] DAMAGECOUNT value on done: 809785.0 [2024-08-06 06:59:50,368][52669] Sum rewards: 57.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.130', 'AMMO5': '0.021', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon4': '0.210', 'AMMO3': '0.221', 'weapon5': '0.226', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '48.000'} [2024-08-06 06:59:50,383][52794] DAMAGECOUNT value on done: 807097.0 [2024-08-06 06:59:50,384][52794] Sum rewards: 75.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.755', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.118', 'weapon5': '0.130', 'AMMO3': '0.158', 'AMMO4': '0.202', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.264', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:50,412][52820] DAMAGECOUNT value on done: 742550.0 [2024-08-06 06:59:50,412][52820] Sum rewards: 64.804, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.164', 'AMMO4': '0.193', 'weapon4': '0.204', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '55.000'} [2024-08-06 06:59:50,758][52649] DAMAGECOUNT value on done: 794699.0 [2024-08-06 06:59:50,758][52649] Sum rewards: 66.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.290', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.123', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.227', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.386', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:51,169][52803] DAMAGECOUNT value on done: 760041.0 [2024-08-06 06:59:51,178][52803] Sum rewards: 67.355, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.105', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.136', 'AMMO4': '0.167', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '3.216', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 06:59:51,405][52663] DAMAGECOUNT value on done: 810067.0 [2024-08-06 06:59:51,406][52663] Sum rewards: 74.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.075', 'AMMO5': '0.023', 'AMMO2': '0.049', 'weapon4': '0.166', 'AMMO3': '0.192', 'AMMO4': '0.246', 'weapon5': '0.348', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.768', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:51,773][52658] DAMAGECOUNT value on done: 802392.0 [2024-08-06 06:59:51,774][52658] Sum rewards: 63.621, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.860', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon4': '0.106', 'weapon5': '0.260', 'AMMO3': '0.267', 'AMMO4': '0.293', 'weapon2': '0.304', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.016', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '54.500'} [2024-08-06 06:59:52,201][52795] DAMAGECOUNT value on done: 740254.0 [2024-08-06 06:59:52,202][52795] Sum rewards: 80.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.070', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.000'} [2024-08-06 06:59:52,680][52671] DAMAGECOUNT value on done: 814329.0 [2024-08-06 06:59:52,681][52671] Sum rewards: 70.995, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.215', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO3': '0.106', 'AMMO4': '0.171', 'weapon5': '0.182', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.560', 'WEAPON3': '0.800', 'weapon3': '2.402', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 06:59:52,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17355.9). Total num frames: 598810624. Throughput: 0: 4372.2. Samples: 149707330. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 06:59:52,795][52567] Avg episode reward: [(0, '73.775')] [2024-08-06 06:59:53,055][52669] DAMAGECOUNT value on done: 804007.0 [2024-08-06 06:59:53,056][52669] Sum rewards: 79.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.313', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.038', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.336', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:53,088][52665] DAMAGECOUNT value on done: 804401.0 [2024-08-06 06:59:53,089][52665] Sum rewards: 71.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.710', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.098', 'weapon5': '0.208', 'AMMO3': '0.219', 'AMMO4': '0.264', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:53,242][52794] DAMAGECOUNT value on done: 823455.0 [2024-08-06 06:59:53,243][52794] Sum rewards: 62.877, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.650', 'AMMO5': '0.021', 'AMMO2': '0.075', 'weapon4': '0.098', 'weapon5': '0.188', 'AMMO3': '0.302', 'AMMO4': '0.377', 'weapon2': '0.434', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.936', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:53,455][52649] DAMAGECOUNT value on done: 796614.0 [2024-08-06 06:59:53,457][52649] Sum rewards: 76.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.132', 'AMMO4': '0.189', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '63.000'} [2024-08-06 06:59:54,115][52663] DAMAGECOUNT value on done: 805853.0 [2024-08-06 06:59:54,115][52663] Sum rewards: 77.108, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.649', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.137', 'weapon5': '0.184', 'AMMO4': '0.229', 'weapon4': '0.242', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.760', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:54,214][52650] Updated weights for policy 0, policy_version 73101 (0.0024) [2024-08-06 06:59:54,295][52658] DAMAGECOUNT value on done: 828075.0 [2024-08-06 06:59:54,297][52658] Sum rewards: 80.574, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.176', 'AMMO4': '0.195', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:54,307][52803] DAMAGECOUNT value on done: 756546.0 [2024-08-06 06:59:54,309][52803] Sum rewards: 57.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.681', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.328', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.330', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '50.000'} [2024-08-06 06:59:55,391][52795] DAMAGECOUNT value on done: 747988.0 [2024-08-06 06:59:55,393][52795] Sum rewards: 64.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.070', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '54.000'} [2024-08-06 06:59:55,521][52665] DAMAGECOUNT value on done: 787119.0 [2024-08-06 06:59:55,523][52665] Sum rewards: 61.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.294', 'weapon2': '0.628', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '50.000'} [2024-08-06 06:59:55,555][52671] DAMAGECOUNT value on done: 819842.0 [2024-08-06 06:59:55,556][52671] Sum rewards: 88.381, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.370', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.106', 'AMMO4': '0.147', 'weapon2': '0.280', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.334', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '22.557', 'FRAGCOUNT': '76.000'} [2024-08-06 06:59:55,906][52649] DAMAGECOUNT value on done: 786654.0 [2024-08-06 06:59:55,908][52649] Sum rewards: 86.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.642', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.132', 'AMMO3': '0.192', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.438', 'weapon4': '0.628', 'WEAPON3': '1.050', 'weapon3': '2.572', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '68.000'} [2024-08-06 06:59:55,914][52669] DAMAGECOUNT value on done: 817947.0 [2024-08-06 06:59:55,914][52669] Sum rewards: 73.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.054', 'AMMO4': '0.137', 'weapon5': '0.160', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '60.000'} [2024-08-06 06:59:56,303][52794] DAMAGECOUNT value on done: 802340.0 [2024-08-06 06:59:56,303][52794] Sum rewards: 74.190, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.155', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.144', 'AMMO4': '0.151', 'weapon5': '0.174', 'AMMO3': '0.212', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '59.500'} [2024-08-06 06:59:57,050][52658] DAMAGECOUNT value on done: 812865.0 [2024-08-06 06:59:57,051][52658] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.492', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.032', 'weapon4': '0.050', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '3.088', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '54.000'} [2024-08-06 06:59:57,227][52663] DAMAGECOUNT value on done: 808990.0 [2024-08-06 06:59:57,229][52663] Sum rewards: 79.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.004', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.722', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '66.000'} [2024-08-06 06:59:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 598900736. Throughput: 0: 4375.3. Samples: 149733610. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 06:59:57,794][52567] Avg episode reward: [(0, '73.450')] [2024-08-06 06:59:58,581][52665] DAMAGECOUNT value on done: 794202.0 [2024-08-06 06:59:58,581][52665] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.112', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.114', 'AMMO4': '0.141', 'weapon5': '0.208', 'AMMO3': '0.221', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.236', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '56.000'} [2024-08-06 06:59:58,585][52671] DAMAGECOUNT value on done: 813985.0 [2024-08-06 06:59:58,586][52671] Sum rewards: 79.423, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.234', 'HEALTH': '0.946', 'WEAPON3': '1.150', 'weapon3': '3.514', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.000'} [2024-08-06 06:59:58,606][52795] DAMAGECOUNT value on done: 755957.0 [2024-08-06 06:59:58,608][52795] Sum rewards: 72.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.578', 'AMMO5': '0.023', 'AMMO2': '0.043', 'weapon4': '0.084', 'weapon5': '0.214', 'AMMO4': '0.217', 'AMMO3': '0.229', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '61.000'} [2024-08-06 06:59:58,910][52794] DAMAGECOUNT value on done: 818209.0 [2024-08-06 06:59:58,912][52794] Sum rewards: 74.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.795', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.213', 'weapon2': '0.244', 'weapon4': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '62.000'} [2024-08-06 06:59:59,069][52650] Updated weights for policy 0, policy_version 73111 (0.0018) [2024-08-06 06:59:59,087][52649] DAMAGECOUNT value on done: 793886.0 [2024-08-06 06:59:59,088][52649] Sum rewards: 84.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.078', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '71.000'} [2024-08-06 06:59:59,196][52658] DAMAGECOUNT value on done: 822845.0 [2024-08-06 06:59:59,197][52658] Sum rewards: 72.773, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.166', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.175', 'weapon4': '0.194', 'AMMO4': '0.217', 'weapon5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '58.000'} [2024-08-06 06:59:59,220][52669] DAMAGECOUNT value on done: 809819.0 [2024-08-06 06:59:59,221][52669] Sum rewards: 72.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.320', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.114', 'weapon5': '0.136', 'AMMO3': '0.154', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '0.900', 'weapon3': '3.154', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:00,144][52663] DAMAGECOUNT value on done: 811090.0 [2024-08-06 07:00:00,145][52663] Sum rewards: 75.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.978', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.053', 'weapon5': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '60.500'} [2024-08-06 07:00:01,604][52658] DAMAGECOUNT value on done: 810956.0 [2024-08-06 07:00:01,605][52658] Sum rewards: 75.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO2': '0.012', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.122', 'AMMO3': '0.191', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.374', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '64.000'} [2024-08-06 07:00:01,648][52665] DAMAGECOUNT value on done: 797154.0 [2024-08-06 07:00:01,648][52665] Sum rewards: 69.586, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.205', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '57.000'} [2024-08-06 07:00:01,663][52671] DAMAGECOUNT value on done: 816126.0 [2024-08-06 07:00:01,663][52671] Sum rewards: 67.153, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.620', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.134', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon4': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.080', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '59.000'} [2024-08-06 07:00:01,822][52794] DAMAGECOUNT value on done: 812930.0 [2024-08-06 07:00:01,822][52794] Sum rewards: 77.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.264', 'weapon4': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '64.000'} [2024-08-06 07:00:01,922][52669] DAMAGECOUNT value on done: 814886.0 [2024-08-06 07:00:01,922][52669] Sum rewards: 78.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.102', 'weapon4': '0.114', 'AMMO3': '0.176', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.050', 'weapon3': '3.146', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '65.000'} [2024-08-06 07:00:02,219][52649] DAMAGECOUNT value on done: 776403.0 [2024-08-06 07:00:02,221][52649] Sum rewards: 74.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'weapon4': '0.072', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon2': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.598', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:02,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 598990848. Throughput: 0: 4375.5. Samples: 149746850. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:00:02,794][52567] Avg episode reward: [(0, '73.559')] [2024-08-06 07:00:03,172][52663] DAMAGECOUNT value on done: 815510.0 [2024-08-06 07:00:03,173][52663] Sum rewards: 61.985, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO2': '0.013', 'AMMO5': '0.014', 'weapon4': '0.044', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon5': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '51.000'} [2024-08-06 07:00:03,960][52650] Updated weights for policy 0, policy_version 73121 (0.0014) [2024-08-06 07:00:04,588][52658] DAMAGECOUNT value on done: 818770.0 [2024-08-06 07:00:04,588][52658] Sum rewards: 81.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.320', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon4': '0.150', 'AMMO3': '0.196', 'AMMO4': '0.211', 'weapon5': '0.214', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.141', 'FRAGCOUNT': '65.000'} [2024-08-06 07:00:04,693][52671] DAMAGECOUNT value on done: 823779.0 [2024-08-06 07:00:04,693][52671] Sum rewards: 71.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.615', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.086', 'weapon2': '0.130', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'HITCOUNT': '3.460', 'weapon3': '3.544', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:04,746][52794] DAMAGECOUNT value on done: 813299.0 [2024-08-06 07:00:04,746][52794] Sum rewards: 66.315, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO3': '0.215', 'AMMO4': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:04,818][52665] DAMAGECOUNT value on done: 798124.0 [2024-08-06 07:00:04,818][52665] Sum rewards: 63.219, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.284', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.193', 'weapon5': '0.212', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.436', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '50.000'} [2024-08-06 07:00:04,893][52669] DAMAGECOUNT value on done: 812282.0 [2024-08-06 07:00:04,894][52669] Sum rewards: 71.979, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.312', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.180', 'weapon5': '0.182', 'AMMO3': '0.187', 'AMMO4': '0.294', 'weapon2': '0.334', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:05,321][52649] DAMAGECOUNT value on done: 798139.0 [2024-08-06 07:00:05,323][52649] Sum rewards: 71.732, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.859', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.241', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.516', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '59.000'} [2024-08-06 07:00:06,350][52663] DAMAGECOUNT value on done: 805275.0 [2024-08-06 07:00:06,350][52663] Sum rewards: 65.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.496', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'AMMO3': '0.183', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.802', 'WEAPON3': '1.050', 'weapon3': '2.658', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '53.000'} [2024-08-06 07:00:07,169][52671] DAMAGECOUNT value on done: 813692.0 [2024-08-06 07:00:07,169][52671] Sum rewards: 80.032, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.070', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '68.000'} [2024-08-06 07:00:07,175][52794] DAMAGECOUNT value on done: 822442.0 [2024-08-06 07:00:07,176][52794] Sum rewards: 68.520, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.994', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.038', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon5': '0.198', 'weapon2': '0.226', 'AMMO3': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.260', 'weapon3': '3.302', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:07,589][52658] DAMAGECOUNT value on done: 807448.0 [2024-08-06 07:00:07,591][52658] Sum rewards: 87.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.325', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.149', 'weapon5': '0.166', 'weapon2': '0.192', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '72.000'} [2024-08-06 07:00:07,690][52669] DAMAGECOUNT value on done: 812002.0 [2024-08-06 07:00:07,690][52669] Sum rewards: 65.619, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.184', 'AMMO4': '0.223', 'AMMO3': '0.252', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17383.7). Total num frames: 599080960. Throughput: 0: 4377.8. Samples: 149772890. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:00:07,795][52567] Avg episode reward: [(0, '73.232')] [2024-08-06 07:00:07,956][52650] Updated weights for policy 0, policy_version 73131 (0.0012) [2024-08-06 07:00:07,965][52665] DAMAGECOUNT value on done: 808120.0 [2024-08-06 07:00:07,968][52665] Sum rewards: 78.228, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.925', 'AMMO5': '0.028', 'AMMO2': '0.083', 'weapon4': '0.144', 'weapon5': '0.214', 'AMMO3': '0.252', 'weapon2': '0.286', 'AMMO4': '0.413', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'weapon3': '3.002', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '69.000'} [2024-08-06 07:00:08,504][52649] DAMAGECOUNT value on done: 796713.0 [2024-08-06 07:00:08,506][52649] Sum rewards: 67.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.334', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.098', 'weapon4': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.208', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.180', 'weapon3': '3.320', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '57.000'} [2024-08-06 07:00:09,064][52663] DAMAGECOUNT value on done: 797966.0 [2024-08-06 07:00:09,065][52663] Sum rewards: 71.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.191', 'weapon2': '0.256', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.380', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '59.000'} [2024-08-06 07:00:10,015][52671] DAMAGECOUNT value on done: 818280.0 [2024-08-06 07:00:10,015][52671] Sum rewards: 79.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.132', 'AMMO4': '0.180', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.338', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '68.000'} [2024-08-06 07:00:10,074][52794] DAMAGECOUNT value on done: 813078.0 [2024-08-06 07:00:10,074][52794] Sum rewards: 79.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.026', 'AMMO5': '0.022', 'AMMO2': '0.042', 'weapon4': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.226', 'weapon5': '0.264', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.902', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '66.000'} [2024-08-06 07:00:10,710][52658] DAMAGECOUNT value on done: 817676.0 [2024-08-06 07:00:10,712][52658] Sum rewards: 86.196, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.728', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.016', 'weapon4': '0.022', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.588', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.574', 'FRAGCOUNT': '69.000'} [2024-08-06 07:00:11,005][52669] DAMAGECOUNT value on done: 812139.0 [2024-08-06 07:00:11,006][52669] Sum rewards: 59.596, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.058', 'weapon4': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.222', 'weapon2': '0.372', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.318', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '52.000'} [2024-08-06 07:00:11,073][52665] DAMAGECOUNT value on done: 799255.0 [2024-08-06 07:00:11,073][52665] Sum rewards: 81.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '67.000'} [2024-08-06 07:00:11,655][52649] DAMAGECOUNT value on done: 786860.0 [2024-08-06 07:00:11,655][52649] Sum rewards: 70.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.136', 'weapon4': '0.186', 'AMMO4': '0.207', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:12,319][52663] DAMAGECOUNT value on done: 802587.0 [2024-08-06 07:00:12,319][52663] Sum rewards: 75.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.906', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.162', 'weapon4': '0.174', 'AMMO3': '0.185', 'AMMO4': '0.229', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:12,398][52663] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:00:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17328.2). Total num frames: 599154688. Throughput: 0: 4373.6. Samples: 149799100. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:00:12,794][52567] Avg episode reward: [(0, '73.322')] [2024-08-06 07:00:13,091][52671] DAMAGECOUNT value on done: 815566.0 [2024-08-06 07:00:13,092][52671] Sum rewards: 73.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.128', 'AMMO4': '0.180', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:13,110][52650] Updated weights for policy 0, policy_version 73141 (0.0030) [2024-08-06 07:00:13,532][52658] DAMAGECOUNT value on done: 796913.0 [2024-08-06 07:00:13,532][52658] Sum rewards: 70.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.505', 'AMMO5': '0.023', 'AMMO2': '0.065', 'weapon5': '0.226', 'AMMO3': '0.241', 'weapon4': '0.278', 'AMMO4': '0.322', 'weapon2': '0.536', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.562', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:13,938][52665] DAMAGECOUNT value on done: 810288.0 [2024-08-06 07:00:13,940][52665] Sum rewards: 70.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.478', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.181', 'weapon5': '0.182', 'weapon2': '0.192', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '55.500'} [2024-08-06 07:00:13,996][52669] DAMAGECOUNT value on done: 822082.0 [2024-08-06 07:00:13,996][52669] Sum rewards: 66.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.365', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.702', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:14,563][52670] DAMAGECOUNT value on done: 798266.0 [2024-08-06 07:00:14,566][52670] Sum rewards: 65.525, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.120', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.204', 'weapon5': '0.220', 'weapon2': '0.222', 'AMMO3': '0.272', 'AMMO4': '0.285', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'HITCOUNT': '3.000', 'weapon3': '3.086', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '57.000'} [2024-08-06 07:00:15,204][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:00:15,405][52663] DAMAGECOUNT value on done: 807736.0 [2024-08-06 07:00:15,406][52663] Sum rewards: 75.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.318', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.106', 'weapon5': '0.150', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '60.000'} [2024-08-06 07:00:16,013][52671] DAMAGECOUNT value on done: 803427.0 [2024-08-06 07:00:16,014][52671] Sum rewards: 74.087, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.010', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.063', 'AMMO3': '0.120', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.316', 'WEAPON3': '0.950', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '59.000'} [2024-08-06 07:00:16,325][52658] DAMAGECOUNT value on done: 816281.0 [2024-08-06 07:00:16,326][52658] Sum rewards: 74.464, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.344', 'weapon2': '0.422', 'WEAPON3': '1.000', 'weapon3': '2.978', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:16,553][52665] DAMAGECOUNT value on done: 805706.0 [2024-08-06 07:00:16,568][52665] Sum rewards: 64.185, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.807', 'AMMO5': '0.017', 'AMMO2': '0.070', 'weapon4': '0.092', 'AMMO3': '0.228', 'weapon2': '0.234', 'weapon5': '0.248', 'AMMO4': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.116', 'DAMAGECOUNT': '15.726', 'FRAGCOUNT': '54.000'} [2024-08-06 07:00:16,723][52669] DAMAGECOUNT value on done: 813359.0 [2024-08-06 07:00:16,731][52669] Sum rewards: 63.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.110', 'AMMO3': '0.177', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.406', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '53.000'} [2024-08-06 07:00:17,587][52670] DAMAGECOUNT value on done: 813050.0 [2024-08-06 07:00:17,587][52670] Sum rewards: 77.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.824', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.102', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '65.000'} [2024-08-06 07:00:17,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.8, 300 sec: 17328.2). Total num frames: 599244800. Throughput: 0: 4365.3. Samples: 149811840. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:17,794][52567] Avg episode reward: [(0, '73.041')] [2024-08-06 07:00:17,901][52650] Updated weights for policy 0, policy_version 73151 (0.0010) [2024-08-06 07:00:18,162][52795] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:00:18,317][52663] DAMAGECOUNT value on done: 817569.0 [2024-08-06 07:00:18,319][52663] Sum rewards: 74.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.053', 'weapon5': '0.096', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.222', 'AMMO4': '0.265', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:18,510][52666] DAMAGECOUNT value on done: 810928.0 [2024-08-06 07:00:18,511][52666] Sum rewards: 79.939, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.805', 'AMMO5': '0.008', 'weapon4': '0.036', 'AMMO2': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.289', 'weapon2': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.378', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '68.000'} [2024-08-06 07:00:18,979][52658] DAMAGECOUNT value on done: 808369.0 [2024-08-06 07:00:18,979][52658] Sum rewards: 76.587, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.149', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:19,007][52671] DAMAGECOUNT value on done: 816712.0 [2024-08-06 07:00:19,012][52671] Sum rewards: 73.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.665', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:19,586][52665] DAMAGECOUNT value on done: 801576.0 [2024-08-06 07:00:19,586][52665] Sum rewards: 77.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.702', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.086', 'weapon5': '0.162', 'AMMO3': '0.228', 'AMMO4': '0.257', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '65.000'} [2024-08-06 07:00:20,043][52669] DAMAGECOUNT value on done: 817858.0 [2024-08-06 07:00:20,047][52669] Sum rewards: 78.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.925', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.126', 'weapon5': '0.176', 'weapon2': '0.210', 'AMMO4': '0.238', 'AMMO3': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '66.000'} [2024-08-06 07:00:20,606][52670] DAMAGECOUNT value on done: 798718.0 [2024-08-06 07:00:20,606][52670] Sum rewards: 83.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.770', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.040', 'weapon5': '0.060', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.288', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '68.000'} [2024-08-06 07:00:21,461][52666] DAMAGECOUNT value on done: 803682.0 [2024-08-06 07:00:21,464][52666] Sum rewards: 65.480, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.028', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.157', 'weapon5': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.050', 'HITCOUNT': '2.920', 'weapon3': '3.054', 'DAMAGECOUNT': '14.697', 'FRAGCOUNT': '54.000'} [2024-08-06 07:00:21,581][52663] DAMAGECOUNT value on done: 799122.0 [2024-08-06 07:00:21,584][52663] Sum rewards: 76.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.710', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.150', 'weapon5': '0.182', 'AMMO3': '0.232', 'AMMO4': '0.240', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '65.000'} [2024-08-06 07:00:21,677][52671] DAMAGECOUNT value on done: 815361.0 [2024-08-06 07:00:21,677][52671] Sum rewards: 78.259, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.106', 'weapon4': '0.130', 'HEALTH': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.050', 'weapon3': '3.264', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:22,092][52658] DAMAGECOUNT value on done: 804573.0 [2024-08-06 07:00:22,093][52658] Sum rewards: 73.165, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.410', 'AMMO5': '0.023', 'AMMO2': '0.077', 'weapon4': '0.180', 'weapon5': '0.192', 'AMMO3': '0.213', 'AMMO4': '0.385', 'weapon2': '0.430', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.904', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:22,231][52650] Updated weights for policy 0, policy_version 73161 (0.0022) [2024-08-06 07:00:22,516][52665] DAMAGECOUNT value on done: 802651.0 [2024-08-06 07:00:22,518][52665] Sum rewards: 58.908, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.992', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.084', 'weapon5': '0.172', 'AMMO4': '0.182', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.500', 'HITCOUNT': '2.900', 'weapon3': '3.030', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '52.000'} [2024-08-06 07:00:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 599334912. Throughput: 0: 4359.3. Samples: 149837890. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:22,794][52567] Avg episode reward: [(0, '72.938')] [2024-08-06 07:00:23,132][52669] DAMAGECOUNT value on done: 823220.0 [2024-08-06 07:00:23,133][52669] Sum rewards: 86.653, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.655', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.110', 'AMMO3': '0.218', 'AMMO4': '0.221', 'weapon5': '0.248', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.420', 'FRAGCOUNT': '71.000'} [2024-08-06 07:00:23,829][52670] DAMAGECOUNT value on done: 797429.0 [2024-08-06 07:00:23,831][52670] Sum rewards: 64.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.524', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.234', 'AMMO3': '0.240', 'AMMO4': '0.272', 'weapon5': '0.316', 'weapon2': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.856', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '53.000'} [2024-08-06 07:00:24,535][52666] DAMAGECOUNT value on done: 809953.0 [2024-08-06 07:00:24,536][52666] Sum rewards: 78.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.554', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:24,647][52663] DAMAGECOUNT value on done: 796824.0 [2024-08-06 07:00:24,649][52663] Sum rewards: 90.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.452', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.166', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.442', 'WEAPON3': '1.650', 'weapon3': '2.924', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.709', 'FRAGCOUNT': '77.000'} [2024-08-06 07:00:24,826][52658] DAMAGECOUNT value on done: 813309.0 [2024-08-06 07:00:24,828][52658] Sum rewards: 73.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.030', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'weapon4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.235', 'WEAPON3': '1.550', 'weapon3': '3.374', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:24,845][52671] DAMAGECOUNT value on done: 811352.0 [2024-08-06 07:00:24,845][52671] Sum rewards: 76.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.196', 'AMMO3': '0.206', 'AMMO4': '0.218', 'weapon2': '0.224', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:25,553][52665] DAMAGECOUNT value on done: 797096.0 [2024-08-06 07:00:25,553][52665] Sum rewards: 68.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.206', 'weapon2': '0.224', 'WEAPON3': '1.250', 'HITCOUNT': '3.500', 'weapon3': '3.586', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 07:00:25,943][52669] DAMAGECOUNT value on done: 806534.0 [2024-08-06 07:00:25,943][52669] Sum rewards: 82.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.178', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon2': '0.176', 'weapon5': '0.184', 'AMMO4': '0.186', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon4': '0.732', 'WEAPON3': '1.400', 'weapon3': '2.616', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '68.000'} [2024-08-06 07:00:26,380][52670] DAMAGECOUNT value on done: 812355.0 [2024-08-06 07:00:26,380][52670] Sum rewards: 65.951, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.422', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.068', 'weapon4': '0.096', 'AMMO4': '0.103', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.305', 'weapon2': '0.402', 'WEAPON3': '1.850', 'weapon3': '3.124', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '59.000'} [2024-08-06 07:00:27,190][52666] DAMAGECOUNT value on done: 807185.0 [2024-08-06 07:00:27,199][52666] Sum rewards: 67.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '55.000'} [2024-08-06 07:00:27,244][52650] Updated weights for policy 0, policy_version 73171 (0.0026) [2024-08-06 07:00:27,401][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:00:27,552][52663] DAMAGECOUNT value on done: 804870.0 [2024-08-06 07:00:27,553][52663] Sum rewards: 72.524, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.723', 'AMMO5': '0.017', 'AMMO2': '0.058', 'AMMO3': '0.162', 'weapon5': '0.232', 'AMMO4': '0.292', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON3': '0.900', 'weapon3': '2.598', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:27,782][52671] DAMAGECOUNT value on done: 819599.0 [2024-08-06 07:00:27,782][52671] Sum rewards: 77.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.177', 'AMMO5': '0.010', 'weapon4': '0.022', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.942', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17355.9). Total num frames: 599425024. Throughput: 0: 4357.8. Samples: 149864020. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:27,794][52567] Avg episode reward: [(0, '72.992')] [2024-08-06 07:00:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073172_599425024.pth... [2024-08-06 07:00:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072664_595263488.pth [2024-08-06 07:00:28,750][52665] DAMAGECOUNT value on done: 803548.0 [2024-08-06 07:00:28,751][52665] Sum rewards: 61.723, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.798', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.210', 'AMMO4': '0.224', 'weapon2': '0.286', 'weapon4': '0.288', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.860', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '55.000'} [2024-08-06 07:00:28,852][52669] DAMAGECOUNT value on done: 808240.0 [2024-08-06 07:00:28,853][52669] Sum rewards: 65.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.284', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:29,440][52670] DAMAGECOUNT value on done: 801224.0 [2024-08-06 07:00:29,442][52670] Sum rewards: 67.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.122', 'AMMO3': '0.206', 'weapon4': '0.214', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.052', 'DAMAGECOUNT': '15.183', 'FRAGCOUNT': '57.000'} [2024-08-06 07:00:30,363][52666] DAMAGECOUNT value on done: 800816.0 [2024-08-06 07:00:30,363][52666] Sum rewards: 70.248, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.412', 'AMMO5': '0.011', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.088', 'weapon4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '57.000'} [2024-08-06 07:00:30,548][52663] DAMAGECOUNT value on done: 803378.0 [2024-08-06 07:00:30,549][52663] Sum rewards: 72.436, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.193', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon4': '0.114', 'AMMO3': '0.155', 'AMMO4': '0.158', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.754', 'WEAPON3': '0.950', 'weapon3': '2.738', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:30,953][52671] DAMAGECOUNT value on done: 815238.0 [2024-08-06 07:00:30,954][52671] Sum rewards: 74.494, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.496', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon4': '0.148', 'AMMO4': '0.158', 'weapon5': '0.182', 'AMMO3': '0.259', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '64.000'} [2024-08-06 07:00:31,916][52665] DAMAGECOUNT value on done: 803451.0 [2024-08-06 07:00:31,917][52665] Sum rewards: 59.425, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.730', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.182', 'AMMO4': '0.216', 'weapon4': '0.244', 'weapon2': '0.276', 'AMMO3': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.954', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:32,044][52650] Updated weights for policy 0, policy_version 73181 (0.0029) [2024-08-06 07:00:32,064][52669] DAMAGECOUNT value on done: 813809.0 [2024-08-06 07:00:32,065][52669] Sum rewards: 70.480, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.807', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.149', 'AMMO4': '0.215', 'weapon4': '0.216', 'weapon2': '0.272', 'weapon5': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.794', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '55.000'} [2024-08-06 07:00:32,299][52670] DAMAGECOUNT value on done: 798051.0 [2024-08-06 07:00:32,302][52670] Sum rewards: 79.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.888', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '65.000'} [2024-08-06 07:00:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17356.0). Total num frames: 599515136. Throughput: 0: 4350.7. Samples: 149877020. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:32,794][52567] Avg episode reward: [(0, '73.010')] [2024-08-06 07:00:33,247][52663] DAMAGECOUNT value on done: 814362.0 [2024-08-06 07:00:33,248][52663] Sum rewards: 68.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.260', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.040', 'weapon4': '0.056', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.175', 'weapon2': '0.374', 'WEAPON3': '1.050', 'HITCOUNT': '3.270', 'weapon3': '3.332', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '56.000'} [2024-08-06 07:00:33,340][52666] DAMAGECOUNT value on done: 807443.0 [2024-08-06 07:00:33,341][52666] Sum rewards: 74.185, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.320', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.140', 'weapon5': '0.176', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '3.076', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 07:00:33,840][52671] DAMAGECOUNT value on done: 802176.0 [2024-08-06 07:00:33,842][52671] Sum rewards: 69.623, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.754', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.094', 'AMMO4': '0.206', 'AMMO3': '0.219', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:34,773][52669] DAMAGECOUNT value on done: 835056.0 [2024-08-06 07:00:34,774][52669] Sum rewards: 78.665, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.750', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.128', 'AMMO3': '0.139', 'AMMO4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.336', 'weapon2': '0.448', 'WEAPON3': '0.900', 'weapon3': '2.924', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '60.000'} [2024-08-06 07:00:34,789][52668] DAMAGECOUNT value on done: 816167.0 [2024-08-06 07:00:34,791][52668] Sum rewards: 78.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.228', 'AMMO5': '0.013', 'weapon4': '0.030', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '65.000'} [2024-08-06 07:00:34,819][52665] DAMAGECOUNT value on done: 795810.0 [2024-08-06 07:00:34,821][52665] Sum rewards: 70.339, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.615', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.084', 'weapon5': '0.094', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.302', 'weapon2': '0.548', 'WEAPON3': '1.800', 'weapon3': '2.996', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '64.000'} [2024-08-06 07:00:35,384][52670] DAMAGECOUNT value on done: 801367.0 [2024-08-06 07:00:35,385][52670] Sum rewards: 79.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.809', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.164', 'weapon2': '0.204', 'AMMO3': '0.210', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '66.000'} [2024-08-06 07:00:36,337][52663] DAMAGECOUNT value on done: 808036.0 [2024-08-06 07:00:36,337][52663] Sum rewards: 75.143, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.728', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.180', 'AMMO4': '0.218', 'AMMO3': '0.226', 'weapon4': '0.306', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.904', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:36,375][52666] DAMAGECOUNT value on done: 802723.0 [2024-08-06 07:00:36,375][52666] Sum rewards: 66.928, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.193', 'AMMO5': '0.018', 'AMMO2': '0.069', 'weapon4': '0.164', 'weapon5': '0.202', 'weapon2': '0.252', 'AMMO3': '0.299', 'AMMO4': '0.347', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.050', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '60.000'} [2024-08-06 07:00:36,636][52650] Updated weights for policy 0, policy_version 73191 (0.0011) [2024-08-06 07:00:36,932][52671] DAMAGECOUNT value on done: 824363.0 [2024-08-06 07:00:36,933][52671] Sum rewards: 84.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.064', 'weapon5': '0.164', 'weapon2': '0.214', 'AMMO3': '0.233', 'AMMO4': '0.272', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '70.000'} [2024-08-06 07:00:36,935][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:00:37,253][52668] DAMAGECOUNT value on done: 817354.0 [2024-08-06 07:00:37,253][52668] Sum rewards: 54.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.717', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.054', 'weapon5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '2.680', 'weapon3': '3.318', 'DAMAGECOUNT': '14.166', 'FRAGCOUNT': '45.000'} [2024-08-06 07:00:37,520][52665] DAMAGECOUNT value on done: 799992.0 [2024-08-06 07:00:37,522][52665] Sum rewards: 72.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.660', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.066', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.304', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.384', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17355.9). Total num frames: 599597056. Throughput: 0: 4349.8. Samples: 149903070. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:37,795][52567] Avg episode reward: [(0, '73.093')] [2024-08-06 07:00:37,871][52669] DAMAGECOUNT value on done: 820433.0 [2024-08-06 07:00:37,871][52669] Sum rewards: 74.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.593', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.130', 'AMMO4': '0.172', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:38,245][52670] DAMAGECOUNT value on done: 802073.0 [2024-08-06 07:00:38,253][52670] Sum rewards: 67.681, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.082', 'AMMO4': '0.089', 'weapon5': '0.130', 'AMMO3': '0.183', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.000'} [2024-08-06 07:00:39,031][52666] DAMAGECOUNT value on done: 798871.0 [2024-08-06 07:00:39,037][52666] Sum rewards: 81.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.229', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '67.000'} [2024-08-06 07:00:39,421][52663] DAMAGECOUNT value on done: 813021.0 [2024-08-06 07:00:39,422][52663] Sum rewards: 68.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.235', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '57.000'} [2024-08-06 07:00:39,915][52668] DAMAGECOUNT value on done: 813517.0 [2024-08-06 07:00:39,917][52668] Sum rewards: 79.975, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon2': '0.272', 'AMMO3': '0.295', 'WEAPON3': '1.600', 'weapon3': '3.344', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '69.000'} [2024-08-06 07:00:39,949][52671] DAMAGECOUNT value on done: 821138.0 [2024-08-06 07:00:39,949][52671] Sum rewards: 74.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.148', 'AMMO4': '0.214', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:40,622][52665] DAMAGECOUNT value on done: 803904.0 [2024-08-06 07:00:40,622][52665] Sum rewards: 74.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.884', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.058', 'weapon5': '0.078', 'AMMO4': '0.116', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:40,790][52669] DAMAGECOUNT value on done: 818254.0 [2024-08-06 07:00:40,790][52669] Sum rewards: 86.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.819', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.014', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.207', 'FRAGCOUNT': '71.000'} [2024-08-06 07:00:41,152][52670] DAMAGECOUNT value on done: 797287.0 [2024-08-06 07:00:41,153][52670] Sum rewards: 69.733, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.454', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.126', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.224', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.324', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:41,313][52650] Updated weights for policy 0, policy_version 73201 (0.0012) [2024-08-06 07:00:42,131][52666] DAMAGECOUNT value on done: 807243.0 [2024-08-06 07:00:42,132][52666] Sum rewards: 76.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.416', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:42,196][52663] DAMAGECOUNT value on done: 817367.0 [2024-08-06 07:00:42,196][52663] Sum rewards: 69.937, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.126', 'weapon5': '0.126', 'AMMO3': '0.204', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 599687168. Throughput: 0: 4351.3. Samples: 149929420. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:42,794][52567] Avg episode reward: [(0, '73.219')] [2024-08-06 07:00:42,838][52671] DAMAGECOUNT value on done: 817329.0 [2024-08-06 07:00:42,839][52671] Sum rewards: 73.903, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.629', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.052', 'AMMO4': '0.157', 'weapon5': '0.222', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.084', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:43,115][52668] DAMAGECOUNT value on done: 818997.0 [2024-08-06 07:00:43,116][52668] Sum rewards: 72.317, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.232', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.176', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '2.676', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '58.000'} [2024-08-06 07:00:43,304][52669] DAMAGECOUNT value on done: 821639.0 [2024-08-06 07:00:43,312][52669] Sum rewards: 82.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.478', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.398', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '67.000'} [2024-08-06 07:00:44,118][52670] DAMAGECOUNT value on done: 808521.0 [2024-08-06 07:00:44,121][52670] Sum rewards: 72.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO4': '0.212', 'AMMO3': '0.225', 'weapon2': '0.266', 'weapon4': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '60.000'} [2024-08-06 07:00:44,666][52663] DAMAGECOUNT value on done: 803207.0 [2024-08-06 07:00:44,669][52663] Sum rewards: 90.923, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.130', 'AMMO4': '0.161', 'weapon2': '0.166', 'HEALTH': '0.178', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.258', 'WEAPON3': '1.050', 'weapon3': '3.286', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '73.000'} [2024-08-06 07:00:45,371][52671] DAMAGECOUNT value on done: 820283.0 [2024-08-06 07:00:45,372][52671] Sum rewards: 72.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.189', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO4': '0.170', 'AMMO3': '0.171', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '59.000'} [2024-08-06 07:00:45,498][52666] DAMAGECOUNT value on done: 800417.0 [2024-08-06 07:00:45,499][52666] Sum rewards: 82.668, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.606', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.184', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '66.000'} [2024-08-06 07:00:45,929][52668] DAMAGECOUNT value on done: 803641.0 [2024-08-06 07:00:45,930][52668] Sum rewards: 88.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.253', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.228', 'weapon4': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.069', 'FRAGCOUNT': '73.000'} [2024-08-06 07:00:46,165][52650] Updated weights for policy 0, policy_version 73211 (0.0014) [2024-08-06 07:00:46,294][52669] DAMAGECOUNT value on done: 824115.0 [2024-08-06 07:00:46,295][52669] Sum rewards: 77.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.920', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon2': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.196', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '64.500'} [2024-08-06 07:00:47,161][52670] DAMAGECOUNT value on done: 792747.0 [2024-08-06 07:00:47,163][52670] Sum rewards: 67.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.152', 'weapon5': '0.168', 'weapon4': '0.206', 'AMMO4': '0.265', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.648', 'WEAPON3': '1.050', 'weapon3': '2.718', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '53.000'} [2024-08-06 07:00:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 599777280. Throughput: 0: 4351.6. Samples: 149942670. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:47,794][52567] Avg episode reward: [(0, '73.545')] [2024-08-06 07:00:47,942][52662] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:00:48,389][52671] DAMAGECOUNT value on done: 806968.0 [2024-08-06 07:00:48,392][52666] DAMAGECOUNT value on done: 807519.0 [2024-08-06 07:00:48,397][52671] Sum rewards: 70.590, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.082', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon2': '0.450', 'HEALTH': '0.650', 'WEAPON3': '0.900', 'weapon3': '3.236', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '55.000'} [2024-08-06 07:00:48,397][52666] Sum rewards: 76.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.847', 'AMMO5': '0.020', 'AMMO2': '0.070', 'AMMO3': '0.216', 'weapon5': '0.260', 'weapon4': '0.264', 'weapon2': '0.306', 'AMMO4': '0.351', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:48,789][52668] DAMAGECOUNT value on done: 816101.0 [2024-08-06 07:00:48,789][52668] Sum rewards: 76.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.493', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.082', 'AMMO4': '0.223', 'weapon5': '0.228', 'AMMO3': '0.255', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.140', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '64.000'} [2024-08-06 07:00:49,804][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:00:50,191][52670] DAMAGECOUNT value on done: 804679.0 [2024-08-06 07:00:50,193][52670] Sum rewards: 78.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.146', 'AMMO4': '0.151', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.500', 'weapon3': '2.962', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '67.000'} [2024-08-06 07:00:50,653][52650] Updated weights for policy 0, policy_version 73221 (0.0022) [2024-08-06 07:00:51,123][52666] DAMAGECOUNT value on done: 794183.0 [2024-08-06 07:00:51,123][52666] Sum rewards: 58.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.525', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '51.000'} [2024-08-06 07:00:51,585][52668] DAMAGECOUNT value on done: 813957.0 [2024-08-06 07:00:51,586][52668] Sum rewards: 65.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.038', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.128', 'weapon7': '0.148', 'WEAPON4': '0.150', 'weapon4': '0.176', 'AMMO3': '0.198', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.806', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '54.000'} [2024-08-06 07:00:52,779][52670] DAMAGECOUNT value on done: 811208.0 [2024-08-06 07:00:52,779][52670] Sum rewards: 63.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.152', 'AMMO3': '0.174', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '52.000'} [2024-08-06 07:00:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17355.9). Total num frames: 599859200. Throughput: 0: 4355.1. Samples: 149968870. Policy #0 lag: (min: 0.0, avg: 3.2, max: 8.0) [2024-08-06 07:00:52,794][52567] Avg episode reward: [(0, '73.614')] [2024-08-06 07:00:53,895][52666] DAMAGECOUNT value on done: 810384.0 [2024-08-06 07:00:53,906][52666] Sum rewards: 83.630, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.231', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.062', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.138', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.784', 'WEAPON3': '0.850', 'weapon3': '2.748', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '63.000'} [2024-08-06 07:00:54,493][52668] DAMAGECOUNT value on done: 806236.0 [2024-08-06 07:00:54,494][52668] Sum rewards: 77.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.769', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '64.000'} [2024-08-06 07:00:55,279][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:00:55,394][52650] Updated weights for policy 0, policy_version 73231 (0.0037) [2024-08-06 07:00:55,797][52670] DAMAGECOUNT value on done: 807238.0 [2024-08-06 07:00:55,798][52670] Sum rewards: 75.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.099', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:55,901][52662] DAMAGECOUNT value on done: 811130.0 [2024-08-06 07:00:55,901][52662] Sum rewards: 72.460, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon4': '0.152', 'weapon5': '0.222', 'weapon2': '0.240', 'AMMO3': '0.260', 'AMMO4': '0.305', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '60.000'} [2024-08-06 07:00:56,887][52666] DAMAGECOUNT value on done: 806180.0 [2024-08-06 07:00:56,888][52666] Sum rewards: 79.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.784', 'WEAPON3': '1.150', 'weapon3': '2.848', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '64.000'} [2024-08-06 07:00:57,463][52668] DAMAGECOUNT value on done: 808628.0 [2024-08-06 07:00:57,463][52668] Sum rewards: 76.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '61.000'} [2024-08-06 07:00:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 599949312. Throughput: 0: 4359.1. Samples: 149995260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:00:57,794][52567] Avg episode reward: [(0, '73.778')] [2024-08-06 07:00:58,590][52670] DAMAGECOUNT value on done: 787523.0 [2024-08-06 07:00:58,591][52670] Sum rewards: 75.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.920', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon2': '0.140', 'weapon4': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.486', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '62.000'} [2024-08-06 07:00:58,808][52662] DAMAGECOUNT value on done: 822297.0 [2024-08-06 07:00:58,810][52662] Sum rewards: 84.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.336', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '71.000'} [2024-08-06 07:00:59,434][52666] DAMAGECOUNT value on done: 805051.0 [2024-08-06 07:00:59,442][52666] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.062', 'weapon5': '0.170', 'AMMO3': '0.228', 'AMMO4': '0.249', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.222', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '61.000'} [2024-08-06 07:01:00,198][52650] Updated weights for policy 0, policy_version 73241 (0.0026) [2024-08-06 07:01:00,457][52668] DAMAGECOUNT value on done: 815717.0 [2024-08-06 07:01:00,458][52668] Sum rewards: 59.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.186', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.126', 'AMMO3': '0.174', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.790', 'weapon3': '3.200', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '49.000'} [2024-08-06 07:01:01,113][52811] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)] [2024-08-06 07:01:01,435][52670] DAMAGECOUNT value on done: 801655.0 [2024-08-06 07:01:01,435][52670] Sum rewards: 84.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.895', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.130', 'AMMO4': '0.178', 'weapon5': '0.220', 'AMMO3': '0.223', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '68.000'} [2024-08-06 07:01:02,050][52662] DAMAGECOUNT value on done: 821750.0 [2024-08-06 07:01:02,052][52662] Sum rewards: 71.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.456', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '61.000'} [2024-08-06 07:01:02,315][52666] DAMAGECOUNT value on done: 801285.0 [2024-08-06 07:01:02,317][52666] Sum rewards: 74.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.734', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.298', 'weapon4': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '62.000'} [2024-08-06 07:01:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 600039424. Throughput: 0: 4366.7. Samples: 150008340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:02,794][52567] Avg episode reward: [(0, '73.788')] [2024-08-06 07:01:03,679][52668] DAMAGECOUNT value on done: 809991.0 [2024-08-06 07:01:03,679][52668] Sum rewards: 70.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.167', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon2': '0.130', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.238', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '59.000'} [2024-08-06 07:01:04,431][52670] DAMAGECOUNT value on done: 811007.0 [2024-08-06 07:01:04,432][52670] Sum rewards: 88.074, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.162', 'weapon5': '0.166', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.326', 'weapon2': '0.586', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '68.000'} [2024-08-06 07:01:04,827][52650] Updated weights for policy 0, policy_version 73251 (0.0039) [2024-08-06 07:01:05,113][52666] DAMAGECOUNT value on done: 799618.0 [2024-08-06 07:01:05,113][52666] Sum rewards: 66.999, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.850', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon5': '0.224', 'weapon2': '0.236', 'AMMO3': '0.291', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.700', 'weapon3': '2.824', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '59.000'} [2024-08-06 07:01:05,128][52662] DAMAGECOUNT value on done: 807175.0 [2024-08-06 07:01:05,130][52662] Sum rewards: 71.722, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.797', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon4': '0.170', 'weapon2': '0.234', 'AMMO3': '0.291', 'WEAPON3': '1.800', 'weapon3': '3.284', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:05,236][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:01:06,741][52668] DAMAGECOUNT value on done: 804254.0 [2024-08-06 07:01:06,742][52668] Sum rewards: 71.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.170', 'AMMO4': '0.184', 'weapon4': '0.186', 'weapon5': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.100', 'weapon3': '2.628', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '56.000'} [2024-08-06 07:01:07,274][52670] DAMAGECOUNT value on done: 805481.0 [2024-08-06 07:01:07,276][52670] Sum rewards: 72.122, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.337', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.204', 'AMMO3': '0.212', 'weapon4': '0.256', 'AMMO4': '0.277', 'weapon2': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '58.000'} [2024-08-06 07:01:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17355.9). Total num frames: 600121344. Throughput: 0: 4370.0. Samples: 150034540. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:07,794][52567] Avg episode reward: [(0, '73.774')] [2024-08-06 07:01:07,972][52666] DAMAGECOUNT value on done: 815794.0 [2024-08-06 07:01:07,973][52666] Sum rewards: 78.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.094', 'weapon2': '0.168', 'AMMO3': '0.183', 'weapon5': '0.204', 'AMMO4': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.306', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:08,365][52662] DAMAGECOUNT value on done: 823927.0 [2024-08-06 07:01:08,365][52662] Sum rewards: 73.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.775', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.106', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '61.000'} [2024-08-06 07:01:09,485][52650] Updated weights for policy 0, policy_version 73261 (0.0012) [2024-08-06 07:01:09,894][52670] DAMAGECOUNT value on done: 808222.0 [2024-08-06 07:01:09,896][52670] Sum rewards: 81.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.110', 'AMMO4': '0.206', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '69.000'} [2024-08-06 07:01:09,995][52668] DAMAGECOUNT value on done: 801732.0 [2024-08-06 07:01:09,996][52668] Sum rewards: 78.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.232', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.516', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '66.000'} [2024-08-06 07:01:10,731][52666] DAMAGECOUNT value on done: 793766.0 [2024-08-06 07:01:10,731][52666] Sum rewards: 75.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.606', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon4': '0.336', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '2.854', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '64.000'} [2024-08-06 07:01:11,351][52662] DAMAGECOUNT value on done: 803637.0 [2024-08-06 07:01:11,353][52662] Sum rewards: 76.649, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.468', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.142', 'AMMO3': '0.166', 'AMMO4': '0.227', 'weapon5': '0.232', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '60.000'} [2024-08-06 07:01:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17356.0). Total num frames: 600211456. Throughput: 0: 4377.1. Samples: 150060990. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:12,794][52567] Avg episode reward: [(0, '74.223')] [2024-08-06 07:01:12,971][52668] DAMAGECOUNT value on done: 801329.0 [2024-08-06 07:01:12,971][52668] Sum rewards: 75.860, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon2': '0.246', 'weapon4': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.146', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '59.000'} [2024-08-06 07:01:13,320][52671] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.468, 156.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 07:01:13,576][52666] DAMAGECOUNT value on done: 802177.0 [2024-08-06 07:01:13,578][52666] Sum rewards: 70.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.307', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.084', 'weapon5': '0.174', 'AMMO3': '0.223', 'weapon2': '0.230', 'AMMO4': '0.295', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.320', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '59.000'} [2024-08-06 07:01:13,691][52650] Updated weights for policy 0, policy_version 73271 (0.0011) [2024-08-06 07:01:13,972][52662] DAMAGECOUNT value on done: 810404.0 [2024-08-06 07:01:13,972][52662] Sum rewards: 65.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.037', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.096', 'AMMO4': '0.135', 'weapon5': '0.180', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.754', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '54.000'} [2024-08-06 07:01:16,000][52668] DAMAGECOUNT value on done: 798342.0 [2024-08-06 07:01:16,009][52668] Sum rewards: 86.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.088', 'weapon4': '0.148', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '71.000'} [2024-08-06 07:01:16,847][52662] DAMAGECOUNT value on done: 827544.0 [2024-08-06 07:01:16,848][52662] Sum rewards: 81.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.484', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '68.000'} [2024-08-06 07:01:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17355.9). Total num frames: 600293376. Throughput: 0: 4380.2. Samples: 150074130. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:17,794][52567] Avg episode reward: [(0, '74.313')] [2024-08-06 07:01:18,873][52650] Updated weights for policy 0, policy_version 73281 (0.0022) [2024-08-06 07:01:19,245][52662] DAMAGECOUNT value on done: 814553.0 [2024-08-06 07:01:19,247][52662] Sum rewards: 71.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.574', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '3.214', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '60.500'} [2024-08-06 07:01:19,250][52668] DAMAGECOUNT value on done: 809672.0 [2024-08-06 07:01:19,252][52668] Sum rewards: 63.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.838', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.152', 'AMMO4': '0.183', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.500', 'weapon3': '2.918', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '55.000'} [2024-08-06 07:01:19,655][52660] DAMAGECOUNT value on done: 810276.0 [2024-08-06 07:01:19,657][52660] Sum rewards: 68.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.340', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '55.000'} [2024-08-06 07:01:21,917][52668] DAMAGECOUNT value on done: 814635.0 [2024-08-06 07:01:21,919][52668] Sum rewards: 83.662, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.970', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO3': '0.149', 'AMMO4': '0.151', 'weapon4': '0.272', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.068', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '66.000'} [2024-08-06 07:01:21,920][52662] DAMAGECOUNT value on done: 820490.0 [2024-08-06 07:01:21,921][52662] Sum rewards: 70.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.100', 'AMMO3': '0.187', 'AMMO4': '0.222', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.330', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '58.000'} [2024-08-06 07:01:22,219][52660] DAMAGECOUNT value on done: 801374.0 [2024-08-06 07:01:22,221][52660] Sum rewards: 72.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.596', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 07:01:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17383.7). Total num frames: 600391680. Throughput: 0: 4380.7. Samples: 150100200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:22,794][52567] Avg episode reward: [(0, '74.081')] [2024-08-06 07:01:23,475][52650] Updated weights for policy 0, policy_version 73291 (0.0030) [2024-08-06 07:01:24,887][52662] DAMAGECOUNT value on done: 809844.0 [2024-08-06 07:01:24,888][52662] Sum rewards: 73.436, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.660', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.092', 'AMMO4': '0.115', 'weapon5': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.293', 'weapon2': '0.308', 'WEAPON3': '1.800', 'weapon3': '3.188', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '65.000'} [2024-08-06 07:01:25,119][52668] DAMAGECOUNT value on done: 809440.0 [2024-08-06 07:01:25,119][52668] Sum rewards: 72.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon5': '0.154', 'weapon4': '0.156', 'weapon2': '0.192', 'AMMO4': '0.216', 'AMMO3': '0.245', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '61.000'} [2024-08-06 07:01:25,594][52660] DAMAGECOUNT value on done: 814944.0 [2024-08-06 07:01:25,595][52660] Sum rewards: 75.373, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.090', 'AMMO3': '0.242', 'AMMO4': '0.249', 'weapon5': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:25,967][52669] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:01:27,666][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:01:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 600473600. Throughput: 0: 4380.0. Samples: 150126520. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:27,794][52567] Avg episode reward: [(0, '74.191')] [2024-08-06 07:01:27,980][52650] Updated weights for policy 0, policy_version 73301 (0.0036) [2024-08-06 07:01:28,097][52668] DAMAGECOUNT value on done: 816488.0 [2024-08-06 07:01:28,097][52668] Sum rewards: 78.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.780', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.092', 'AMMO4': '0.163', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.282', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '62.000'} [2024-08-06 07:01:28,181][52662] DAMAGECOUNT value on done: 813077.0 [2024-08-06 07:01:28,181][52662] Sum rewards: 80.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.205', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.070', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '65.500'} [2024-08-06 07:01:28,315][52663] Large shaping reward 3.501 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:01:28,772][52660] DAMAGECOUNT value on done: 824904.0 [2024-08-06 07:01:28,772][52660] Sum rewards: 71.158, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.162', 'AMMO3': '0.194', 'weapon2': '0.254', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '58.000'} [2024-08-06 07:01:30,775][52811] DAMAGECOUNT value on done: 774437.0 [2024-08-06 07:01:30,775][52811] Sum rewards: 77.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.056', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.144', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '65.000'} [2024-08-06 07:01:31,198][52668] DAMAGECOUNT value on done: 814570.0 [2024-08-06 07:01:31,198][52668] Sum rewards: 76.466, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.114', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.142', 'AMMO3': '0.160', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '60.000'} [2024-08-06 07:01:31,462][52662] DAMAGECOUNT value on done: 805223.0 [2024-08-06 07:01:31,462][52662] Sum rewards: 68.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.351', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.102', 'AMMO3': '0.223', 'AMMO4': '0.227', 'weapon5': '0.240', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '57.000'} [2024-08-06 07:01:31,676][52667] DAMAGECOUNT value on done: 811571.0 [2024-08-06 07:01:31,676][52667] Sum rewards: 73.727, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.066', 'AMMO4': '0.173', 'weapon5': '0.180', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.258', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '64.000'} [2024-08-06 07:01:31,817][52660] DAMAGECOUNT value on done: 806264.0 [2024-08-06 07:01:31,819][52660] Sum rewards: 63.406, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.732', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.080', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.430', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.330', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '51.000'} [2024-08-06 07:01:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17328.2). Total num frames: 600555520. Throughput: 0: 4376.2. Samples: 150139600. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:32,794][52567] Avg episode reward: [(0, '73.887')] [2024-08-06 07:01:32,978][52650] Updated weights for policy 0, policy_version 73311 (0.0026) [2024-08-06 07:01:34,006][52811] DAMAGECOUNT value on done: 757400.0 [2024-08-06 07:01:34,006][52811] Sum rewards: 78.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.943', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.118', 'AMMO3': '0.244', 'weapon5': '0.258', 'AMMO4': '0.304', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '67.000'} [2024-08-06 07:01:34,716][52662] DAMAGECOUNT value on done: 818099.0 [2024-08-06 07:01:34,718][52662] Sum rewards: 73.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.100', 'AMMO4': '0.167', 'weapon5': '0.212', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '60.000'} [2024-08-06 07:01:34,749][52667] DAMAGECOUNT value on done: 821156.0 [2024-08-06 07:01:34,752][52667] Sum rewards: 78.193, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.015', 'weapon5': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.034', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.291', 'weapon2': '0.300', 'WEAPON3': '1.900', 'weapon3': '3.398', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '68.500'} [2024-08-06 07:01:35,024][52660] DAMAGECOUNT value on done: 803308.0 [2024-08-06 07:01:35,024][52660] Sum rewards: 94.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.084', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.194', 'weapon5': '0.194', 'AMMO4': '0.201', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.790', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.981', 'FRAGCOUNT': '76.000'} [2024-08-06 07:01:36,472][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:01:37,074][52811] DAMAGECOUNT value on done: 751886.0 [2024-08-06 07:01:37,074][52811] Sum rewards: 74.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.395', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.113', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '62.000'} [2024-08-06 07:01:37,716][52650] Updated weights for policy 0, policy_version 73321 (0.0010) [2024-08-06 07:01:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17355.9). Total num frames: 600645632. Throughput: 0: 4369.8. Samples: 150165510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:01:37,794][52567] Avg episode reward: [(0, '74.419')] [2024-08-06 07:01:37,859][52662] DAMAGECOUNT value on done: 806168.0 [2024-08-06 07:01:37,861][52662] Sum rewards: 88.123, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.106', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.092', 'weapon4': '0.106', 'AMMO3': '0.150', 'weapon2': '0.590', 'WEAPON3': '0.900', 'weapon3': '3.134', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '68.000'} [2024-08-06 07:01:37,869][52667] DAMAGECOUNT value on done: 817266.0 [2024-08-06 07:01:37,870][52667] Sum rewards: 68.028, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.222', 'AMMO3': '0.256', 'weapon5': '0.270', 'weapon4': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.892', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '58.000'} [2024-08-06 07:01:38,106][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:01:38,289][52660] DAMAGECOUNT value on done: 811076.0 [2024-08-06 07:01:38,291][52660] Sum rewards: 76.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.868', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.078', 'AMMO4': '0.192', 'weapon5': '0.196', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 07:01:40,061][52811] DAMAGECOUNT value on done: 753492.0 [2024-08-06 07:01:40,063][52811] Sum rewards: 79.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '65.000'} [2024-08-06 07:01:40,564][52667] DAMAGECOUNT value on done: 822633.0 [2024-08-06 07:01:40,564][52667] Sum rewards: 69.932, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.877', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.128', 'weapon4': '0.152', 'AMMO4': '0.207', 'weapon2': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.344', 'WEAPON4': '0.450', 'WEAPON3': '2.050', 'weapon3': '3.142', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:40,897][52662] DAMAGECOUNT value on done: 822588.0 [2024-08-06 07:01:40,899][52662] Sum rewards: 70.575, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.660', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.340', 'AMMO3': '0.344', 'WEAPON3': '2.100', 'weapon3': '3.274', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '64.000'} [2024-08-06 07:01:41,361][52660] DAMAGECOUNT value on done: 817320.0 [2024-08-06 07:01:41,362][52660] Sum rewards: 75.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.294', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.360', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:41,420][52664] DAMAGECOUNT value on done: 840810.0 [2024-08-06 07:01:41,421][52664] Sum rewards: 78.359, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.110', 'AMMO4': '0.146', 'weapon2': '0.216', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '67.000'} [2024-08-06 07:01:41,981][52650] Updated weights for policy 0, policy_version 73331 (0.0012) [2024-08-06 07:01:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17383.7). Total num frames: 600735744. Throughput: 0: 4373.8. Samples: 150192080. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:01:42,794][52567] Avg episode reward: [(0, '74.888')] [2024-08-06 07:01:43,166][52811] DAMAGECOUNT value on done: 758220.0 [2024-08-06 07:01:43,166][52811] Sum rewards: 60.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.138', 'AMMO4': '0.173', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.910', 'weapon3': '3.216', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '51.000'} [2024-08-06 07:01:43,232][52667] DAMAGECOUNT value on done: 825062.0 [2024-08-06 07:01:43,233][52667] Sum rewards: 71.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '3.390', 'weapon3': '3.414', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '60.000'} [2024-08-06 07:01:43,622][52662] DAMAGECOUNT value on done: 815939.0 [2024-08-06 07:01:43,624][52662] Sum rewards: 87.703, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.160', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.158', 'AMMO4': '0.172', 'AMMO3': '0.186', 'weapon5': '0.234', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.583', 'FRAGCOUNT': '70.000'} [2024-08-06 07:01:44,268][52664] DAMAGECOUNT value on done: 845863.0 [2024-08-06 07:01:44,269][52664] Sum rewards: 82.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon4': '0.038', 'weapon5': '0.094', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.370', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '68.000'} [2024-08-06 07:01:44,560][52659] DAMAGECOUNT value on done: 815212.0 [2024-08-06 07:01:44,561][52659] Sum rewards: 78.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.356', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.076', 'weapon5': '0.186', 'AMMO3': '0.207', 'AMMO4': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '66.000'} [2024-08-06 07:01:44,605][52660] DAMAGECOUNT value on done: 804861.0 [2024-08-06 07:01:44,606][52660] Sum rewards: 76.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.258', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.122', 'AMMO3': '0.217', 'weapon2': '0.232', 'AMMO4': '0.248', 'weapon5': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '62.000'} [2024-08-06 07:01:46,308][52811] DAMAGECOUNT value on done: 770718.0 [2024-08-06 07:01:46,309][52811] Sum rewards: 82.056, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.656', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.144', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'weapon4': '0.468', 'WEAPON3': '0.950', 'weapon3': '2.838', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '64.000'} [2024-08-06 07:01:46,315][52647] DAMAGECOUNT value on done: 866653.0 [2024-08-06 07:01:46,316][52647] Sum rewards: 80.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.771', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.040', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.221', 'weapon2': '0.274', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '67.000'} [2024-08-06 07:01:46,364][52662] DAMAGECOUNT value on done: 801036.0 [2024-08-06 07:01:46,366][52662] Sum rewards: 88.559, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.074', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.118', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.979', 'FRAGCOUNT': '71.000'} [2024-08-06 07:01:46,511][52667] DAMAGECOUNT value on done: 821901.0 [2024-08-06 07:01:46,513][52667] Sum rewards: 79.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.062', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '67.000'} [2024-08-06 07:01:46,765][52664] DAMAGECOUNT value on done: 845784.0 [2024-08-06 07:01:46,765][52664] Sum rewards: 74.266, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.896', 'AMMO5': '0.024', 'AMMO2': '0.075', 'weapon4': '0.168', 'AMMO3': '0.220', 'weapon5': '0.328', 'AMMO4': '0.376', 'weapon2': '0.454', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '62.000'} [2024-08-06 07:01:47,089][52650] Updated weights for policy 0, policy_version 73341 (0.0033) [2024-08-06 07:01:47,657][52659] DAMAGECOUNT value on done: 812673.0 [2024-08-06 07:01:47,658][52659] Sum rewards: 70.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.336', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '57.000'} [2024-08-06 07:01:47,681][52660] DAMAGECOUNT value on done: 804489.0 [2024-08-06 07:01:47,681][52660] Sum rewards: 75.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO4': '0.183', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 600825856. Throughput: 0: 4372.0. Samples: 150205080. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:01:47,802][52567] Avg episode reward: [(0, '75.519')] [2024-08-06 07:01:48,886][52667] DAMAGECOUNT value on done: 818339.0 [2024-08-06 07:01:48,887][52667] Sum rewards: 64.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.622', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.130', 'weapon2': '0.190', 'AMMO3': '0.230', 'AMMO4': '0.244', 'weapon5': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.770', 'weapon3': '3.094', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '54.000'} [2024-08-06 07:01:49,398][52647] DAMAGECOUNT value on done: 853700.0 [2024-08-06 07:01:49,398][52647] Sum rewards: 63.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.627', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.236', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.434', 'DAMAGECOUNT': '15.954', 'FRAGCOUNT': '53.000'} [2024-08-06 07:01:49,460][52662] DAMAGECOUNT value on done: 811880.0 [2024-08-06 07:01:49,462][52662] Sum rewards: 59.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.023', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.132', 'AMMO4': '0.150', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.450', 'HITCOUNT': '3.050', 'weapon3': '3.156', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '50.500'} [2024-08-06 07:01:49,475][52811] DAMAGECOUNT value on done: 763842.0 [2024-08-06 07:01:49,476][52811] Sum rewards: 67.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.178', 'AMMO4': '0.199', 'AMMO3': '0.266', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.240', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '57.000'} [2024-08-06 07:01:49,899][52664] DAMAGECOUNT value on done: 838668.0 [2024-08-06 07:01:49,900][52664] Sum rewards: 72.378, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.451', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO3': '0.195', 'AMMO4': '0.231', 'weapon4': '0.274', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '59.000'} [2024-08-06 07:01:50,377][52659] DAMAGECOUNT value on done: 818450.0 [2024-08-06 07:01:50,378][52659] Sum rewards: 70.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.035', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.110', 'AMMO3': '0.188', 'AMMO4': '0.194', 'weapon5': '0.212', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 07:01:50,629][52660] DAMAGECOUNT value on done: 814424.0 [2024-08-06 07:01:50,629][52660] Sum rewards: 94.661, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.068', 'AMMO4': '0.099', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'WEAPON3': '1.000', 'weapon3': '3.508', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '76.000'} [2024-08-06 07:01:51,256][52650] Updated weights for policy 0, policy_version 73351 (0.0014) [2024-08-06 07:01:51,469][52668] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.015, -5.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:01:51,921][52647] DAMAGECOUNT value on done: 861306.0 [2024-08-06 07:01:51,921][52647] Sum rewards: 76.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon5': '0.188', 'AMMO3': '0.199', 'weapon4': '0.246', 'AMMO4': '0.254', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '64.000'} [2024-08-06 07:01:51,958][52667] DAMAGECOUNT value on done: 813067.0 [2024-08-06 07:01:51,960][52667] Sum rewards: 66.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.588', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.134', 'weapon5': '0.168', 'AMMO4': '0.228', 'AMMO3': '0.233', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 07:01:52,432][52664] DAMAGECOUNT value on done: 849923.0 [2024-08-06 07:01:52,433][52664] Sum rewards: 65.699, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.062', 'AMMO4': '0.121', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.464', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '54.000'} [2024-08-06 07:01:52,504][52811] DAMAGECOUNT value on done: 755910.0 [2024-08-06 07:01:52,504][52811] Sum rewards: 61.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.978', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO3': '0.224', 'AMMO4': '0.246', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.060', 'weapon3': '3.112', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '53.000'} [2024-08-06 07:01:52,687][52662] DAMAGECOUNT value on done: 802968.0 [2024-08-06 07:01:52,687][52662] Sum rewards: 82.655, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.132', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.224', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.066', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '66.000'} [2024-08-06 07:01:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17412.2). Total num frames: 600907776. Throughput: 0: 4373.6. Samples: 150231350. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:01:52,802][52567] Avg episode reward: [(0, '75.000')] [2024-08-06 07:01:53,414][52659] DAMAGECOUNT value on done: 814909.0 [2024-08-06 07:01:53,416][52659] Sum rewards: 78.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.376', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.184', 'weapon4': '0.186', 'weapon5': '0.204', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '61.000'} [2024-08-06 07:01:53,832][52660] DAMAGECOUNT value on done: 805094.0 [2024-08-06 07:01:53,836][52660] Sum rewards: 81.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.124', 'AMMO4': '0.158', 'AMMO3': '0.178', 'weapon5': '0.316', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.812', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '64.500'} [2024-08-06 07:01:54,586][52660] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:01:54,894][52647] DAMAGECOUNT value on done: 860155.0 [2024-08-06 07:01:54,895][52647] Sum rewards: 74.864, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.845', 'AMMO5': '0.017', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.104', 'AMMO4': '0.116', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.172', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:55,072][52667] DAMAGECOUNT value on done: 817661.0 [2024-08-06 07:01:55,073][52667] Sum rewards: 78.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.908', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.192', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:55,594][52664] DAMAGECOUNT value on done: 845064.0 [2024-08-06 07:01:55,597][52664] Sum rewards: 79.332, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon2': '0.150', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'weapon3': '3.598', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.232', 'FRAGCOUNT': '67.000'} [2024-08-06 07:01:55,609][52811] DAMAGECOUNT value on done: 764974.0 [2024-08-06 07:01:55,611][52811] Sum rewards: 69.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.016', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.140', 'weapon5': '0.176', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '2.888', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '57.000'} [2024-08-06 07:01:56,193][52650] Updated weights for policy 0, policy_version 73361 (0.0023) [2024-08-06 07:01:56,284][52659] DAMAGECOUNT value on done: 814330.0 [2024-08-06 07:01:56,285][52659] Sum rewards: 81.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.893', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.120', 'weapon2': '0.188', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '66.000'} [2024-08-06 07:01:56,901][52660] DAMAGECOUNT value on done: 809193.0 [2024-08-06 07:01:56,903][52660] Sum rewards: 70.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.714', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.196', 'weapon4': '0.236', 'AMMO4': '0.244', 'weapon5': '0.270', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '56.000'} [2024-08-06 07:01:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 600997888. Throughput: 0: 4364.7. Samples: 150257400. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:01:57,802][52567] Avg episode reward: [(0, '74.792')] [2024-08-06 07:01:57,867][52647] DAMAGECOUNT value on done: 866716.0 [2024-08-06 07:01:57,868][52647] Sum rewards: 70.553, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.300', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.200', 'weapon5': '0.236', 'AMMO3': '0.267', 'AMMO4': '0.275', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.914', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '61.500'} [2024-08-06 07:01:58,445][52664] DAMAGECOUNT value on done: 838924.0 [2024-08-06 07:01:58,446][52664] Sum rewards: 88.926, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.174', 'weapon2': '0.208', 'AMMO3': '0.235', 'WEAPON3': '1.300', 'weapon3': '3.462', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.894', 'FRAGCOUNT': '73.000'} [2024-08-06 07:01:58,726][52667] DAMAGECOUNT value on done: 821500.0 [2024-08-06 07:01:58,727][52667] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.652', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.124', 'weapon5': '0.166', 'AMMO4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '63.000'} [2024-08-06 07:01:58,781][52811] DAMAGECOUNT value on done: 761603.0 [2024-08-06 07:01:58,781][52811] Sum rewards: 81.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.546', 'AMMO5': '0.027', 'AMMO2': '0.072', 'weapon4': '0.170', 'AMMO3': '0.224', 'weapon2': '0.336', 'AMMO4': '0.360', 'weapon5': '0.428', 'WEAPON4': '0.700', 'WEAPON5': '0.900', 'WEAPON3': '1.300', 'weapon3': '2.720', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '66.000'} [2024-08-06 07:01:59,067][52660] DAMAGECOUNT value on done: 820890.0 [2024-08-06 07:01:59,068][52660] Sum rewards: 72.770, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.442', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.038', 'weapon4': '0.116', 'AMMO4': '0.165', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '60.000'} [2024-08-06 07:01:59,613][52659] DAMAGECOUNT value on done: 813432.0 [2024-08-06 07:01:59,615][52659] Sum rewards: 75.393, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.501', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 07:01:59,877][52614] Signal inference workers to stop experience collection... (13400 times) [2024-08-06 07:01:59,881][52614] Signal inference workers to resume experience collection... (13400 times) [2024-08-06 07:01:59,959][52650] InferenceWorker_p0-w0: stopping experience collection (13400 times) [2024-08-06 07:01:59,959][52650] InferenceWorker_p0-w0: resuming experience collection (13400 times) [2024-08-06 07:02:00,312][52647] DAMAGECOUNT value on done: 863266.0 [2024-08-06 07:02:00,312][52647] Sum rewards: 74.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.738', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.094', 'weapon5': '0.186', 'AMMO3': '0.219', 'AMMO4': '0.272', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.500'} [2024-08-06 07:02:00,942][52664] DAMAGECOUNT value on done: 834048.0 [2024-08-06 07:02:00,942][52664] Sum rewards: 71.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.972', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.097', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON3': '1.550', 'HITCOUNT': '3.500', 'weapon3': '3.562', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:01,152][52650] Updated weights for policy 0, policy_version 73371 (0.0013) [2024-08-06 07:02:01,478][52667] DAMAGECOUNT value on done: 812325.0 [2024-08-06 07:02:01,479][52667] Sum rewards: 70.435, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.102', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.068', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:01,943][52811] DAMAGECOUNT value on done: 764813.0 [2024-08-06 07:02:01,945][52811] Sum rewards: 69.000, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.593', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.082', 'weapon5': '0.190', 'weapon2': '0.224', 'AMMO4': '0.249', 'AMMO3': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.238', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:02,133][52660] DAMAGECOUNT value on done: 830083.0 [2024-08-06 07:02:02,135][52660] Sum rewards: 74.031, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.978', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.174', 'AMMO4': '0.206', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.914', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:02,577][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:02:02,611][52659] DAMAGECOUNT value on done: 814663.0 [2024-08-06 07:02:02,613][52659] Sum rewards: 72.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.090', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.218', 'AMMO3': '0.230', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '61.000'} [2024-08-06 07:02:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 601088000. Throughput: 0: 4363.6. Samples: 150270490. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:02:02,794][52567] Avg episode reward: [(0, '74.998')] [2024-08-06 07:02:02,825][52647] DAMAGECOUNT value on done: 865167.0 [2024-08-06 07:02:02,825][52647] Sum rewards: 72.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.142', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.084', 'AMMO4': '0.171', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '61.000'} [2024-08-06 07:02:03,353][52664] DAMAGECOUNT value on done: 848456.0 [2024-08-06 07:02:03,353][52664] Sum rewards: 79.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.050', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.088', 'weapon4': '0.144', 'AMMO3': '0.181', 'AMMO4': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:04,570][52667] DAMAGECOUNT value on done: 815766.0 [2024-08-06 07:02:04,571][52667] Sum rewards: 75.989, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.342', 'AMMO5': '0.022', 'AMMO2': '0.040', 'weapon4': '0.172', 'AMMO4': '0.201', 'weapon5': '0.232', 'AMMO3': '0.281', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.892', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.424', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:04,971][52811] DAMAGECOUNT value on done: 770385.0 [2024-08-06 07:02:04,971][52811] Sum rewards: 64.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.090', 'weapon4': '0.102', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '54.000'} [2024-08-06 07:02:05,208][52660] DAMAGECOUNT value on done: 809223.0 [2024-08-06 07:02:05,208][52660] Sum rewards: 72.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.273', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.300', 'weapon4': '0.344', 'ARMOR': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:05,357][52659] DAMAGECOUNT value on done: 812808.0 [2024-08-06 07:02:05,358][52659] Sum rewards: 76.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.314', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.088', 'weapon5': '0.112', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '64.000'} [2024-08-06 07:02:05,400][52647] DAMAGECOUNT value on done: 843885.0 [2024-08-06 07:02:05,402][52647] Sum rewards: 66.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.886', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon5': '0.078', 'weapon4': '0.094', 'AMMO4': '0.114', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.342', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:05,563][52650] Updated weights for policy 0, policy_version 73381 (0.0039) [2024-08-06 07:02:06,164][52664] DAMAGECOUNT value on done: 840883.0 [2024-08-06 07:02:06,166][52664] Sum rewards: 78.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.857', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.115', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '68.000'} [2024-08-06 07:02:07,169][52667] DAMAGECOUNT value on done: 823214.0 [2024-08-06 07:02:07,169][52667] Sum rewards: 64.926, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.106', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.370', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '14.460', 'FRAGCOUNT': '54.000'} [2024-08-06 07:02:07,678][52660] DAMAGECOUNT value on done: 815043.0 [2024-08-06 07:02:07,678][52660] Sum rewards: 78.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.040', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.158', 'AMMO4': '0.162', 'weapon4': '0.194', 'weapon5': '0.210', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '62.000'} [2024-08-06 07:02:07,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 601161728. Throughput: 0: 4366.7. Samples: 150296700. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:02:07,795][52567] Avg episode reward: [(0, '74.722')] [2024-08-06 07:02:08,071][52811] DAMAGECOUNT value on done: 761917.0 [2024-08-06 07:02:08,073][52811] Sum rewards: 74.434, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.804', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.192', 'AMMO4': '0.203', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '61.000'} [2024-08-06 07:02:08,481][52659] DAMAGECOUNT value on done: 816252.0 [2024-08-06 07:02:08,482][52659] Sum rewards: 68.634, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon4': '0.068', 'weapon5': '0.214', 'AMMO3': '0.272', 'AMMO4': '0.282', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.034', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '57.500'} [2024-08-06 07:02:08,567][52647] DAMAGECOUNT value on done: 860061.0 [2024-08-06 07:02:08,568][52647] Sum rewards: 68.837, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.105', 'weapon5': '0.110', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'HEALTH': '0.376', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.388', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:09,446][52664] DAMAGECOUNT value on done: 853208.0 [2024-08-06 07:02:09,446][52664] Sum rewards: 78.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.605', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.126', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '2.770', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:10,230][52667] DAMAGECOUNT value on done: 811818.0 [2024-08-06 07:02:10,234][52667] Sum rewards: 74.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.452', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.142', 'AMMO3': '0.184', 'AMMO4': '0.241', 'weapon5': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.740', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:10,562][52650] Updated weights for policy 0, policy_version 73391 (0.0011) [2024-08-06 07:02:10,811][52660] DAMAGECOUNT value on done: 812926.0 [2024-08-06 07:02:10,813][52660] Sum rewards: 70.697, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.214', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:11,015][52659] DAMAGECOUNT value on done: 822464.0 [2024-08-06 07:02:11,016][52659] Sum rewards: 85.915, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.428', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.110', 'AMMO3': '0.134', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.854', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '68.000'} [2024-08-06 07:02:11,258][52811] DAMAGECOUNT value on done: 760176.0 [2024-08-06 07:02:11,262][52811] Sum rewards: 67.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.472', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.080', 'weapon4': '0.092', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.686', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:11,668][52647] DAMAGECOUNT value on done: 858041.0 [2024-08-06 07:02:11,669][52647] Sum rewards: 90.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.045', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.112', 'AMMO4': '0.139', 'weapon5': '0.172', 'AMMO3': '0.184', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '72.000'} [2024-08-06 07:02:12,498][52664] DAMAGECOUNT value on done: 849651.0 [2024-08-06 07:02:12,499][52664] Sum rewards: 79.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.160', 'AMMO3': '0.232', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.368', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:12,794][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 601251840. Throughput: 0: 4364.2. Samples: 150322910. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:02:12,802][52567] Avg episode reward: [(0, '74.834')] [2024-08-06 07:02:13,440][52667] DAMAGECOUNT value on done: 819191.0 [2024-08-06 07:02:13,442][52667] Sum rewards: 77.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.206', 'weapon5': '0.230', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '62.000'} [2024-08-06 07:02:13,998][52660] DAMAGECOUNT value on done: 804885.0 [2024-08-06 07:02:13,999][52660] Sum rewards: 80.209, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.763', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.068', 'AMMO3': '0.174', 'weapon5': '0.184', 'AMMO4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 07:02:14,096][52647] DAMAGECOUNT value on done: 856793.0 [2024-08-06 07:02:14,097][52647] Sum rewards: 68.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'AMMO4': '0.168', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.190', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 07:02:14,172][52663] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:02:14,202][52659] DAMAGECOUNT value on done: 808629.0 [2024-08-06 07:02:14,202][52659] Sum rewards: 79.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.785', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.062', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:14,518][52811] DAMAGECOUNT value on done: 758959.0 [2024-08-06 07:02:14,518][52811] Sum rewards: 81.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.952', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.094', 'weapon5': '0.136', 'AMMO3': '0.179', 'AMMO4': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:14,889][52650] Updated weights for policy 0, policy_version 73401 (0.0031) [2024-08-06 07:02:14,938][52664] DAMAGECOUNT value on done: 848441.0 [2024-08-06 07:02:14,938][52664] Sum rewards: 66.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.104', 'AMMO4': '0.223', 'weapon5': '0.228', 'AMMO3': '0.267', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.920', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '57.000'} [2024-08-06 07:02:16,124][52667] DAMAGECOUNT value on done: 823245.0 [2024-08-06 07:02:16,125][52667] Sum rewards: 69.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.148', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.092', 'AMMO4': '0.219', 'weapon5': '0.236', 'AMMO3': '0.240', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:16,165][52820] DAMAGECOUNT value on done: 752749.0 [2024-08-06 07:02:16,165][52820] Sum rewards: 77.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.668', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.026', 'AMMO4': '0.111', 'weapon5': '0.174', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:16,866][52647] DAMAGECOUNT value on done: 847082.0 [2024-08-06 07:02:16,867][52647] Sum rewards: 74.701, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.836', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.032', 'AMMO4': '0.154', 'weapon5': '0.164', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:17,071][52660] DAMAGECOUNT value on done: 803395.0 [2024-08-06 07:02:17,074][52660] Sum rewards: 63.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.058', 'AMMO4': '0.162', 'weapon5': '0.174', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.200', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '53.000'} [2024-08-06 07:02:17,151][52659] DAMAGECOUNT value on done: 817749.0 [2024-08-06 07:02:17,154][52659] Sum rewards: 47.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.075', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.666', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.020', 'DAMAGECOUNT': '12.783', 'FRAGCOUNT': '40.000'} [2024-08-06 07:02:17,614][52811] DAMAGECOUNT value on done: 761469.0 [2024-08-06 07:02:17,618][52811] Sum rewards: 78.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.094', 'AMMO4': '0.212', 'weapon5': '0.222', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 601341952. Throughput: 0: 4359.8. Samples: 150335790. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:02:17,795][52567] Avg episode reward: [(0, '74.617')] [2024-08-06 07:02:17,918][52664] DAMAGECOUNT value on done: 859188.0 [2024-08-06 07:02:17,918][52664] Sum rewards: 84.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.936', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.227', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.348', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '70.000'} [2024-08-06 07:02:17,996][52647] Large shaping reward 2.543 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.492, 164.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:02:18,680][52667] DAMAGECOUNT value on done: 823507.0 [2024-08-06 07:02:18,680][52667] Sum rewards: 77.986, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.697', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.124', 'weapon2': '0.174', 'AMMO4': '0.188', 'AMMO3': '0.191', 'weapon5': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '64.000'} [2024-08-06 07:02:19,035][52803] DAMAGECOUNT value on done: 757804.0 [2024-08-06 07:02:19,035][52803] Sum rewards: 73.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.146', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.075', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.249', 'WEAPON3': '1.450', 'weapon3': '3.392', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:19,325][52820] DAMAGECOUNT value on done: 754641.0 [2024-08-06 07:02:19,327][52820] Sum rewards: 72.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.070', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.170', 'AMMO3': '0.212', 'weapon5': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:19,595][52647] DAMAGECOUNT value on done: 864388.0 [2024-08-06 07:02:19,595][52647] Sum rewards: 74.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.010', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon2': '0.162', 'weapon5': '0.162', 'weapon4': '0.252', 'AMMO3': '0.253', 'AMMO4': '0.270', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.058', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:19,753][52650] Updated weights for policy 0, policy_version 73411 (0.0019) [2024-08-06 07:02:20,180][52659] DAMAGECOUNT value on done: 814281.0 [2024-08-06 07:02:20,182][52659] Sum rewards: 67.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.294', 'WEAPON3': '1.500', 'HITCOUNT': '3.190', 'weapon3': '3.332', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '57.000'} [2024-08-06 07:02:20,590][52664] DAMAGECOUNT value on done: 856710.0 [2024-08-06 07:02:20,590][52664] Sum rewards: 70.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.277', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.082', 'weapon5': '0.138', 'AMMO3': '0.167', 'AMMO4': '0.185', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:20,752][52811] DAMAGECOUNT value on done: 766423.0 [2024-08-06 07:02:20,753][52811] Sum rewards: 80.578, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.120', 'weapon5': '0.146', 'AMMO4': '0.208', 'AMMO3': '0.263', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '67.000'} [2024-08-06 07:02:21,364][52667] DAMAGECOUNT value on done: 822857.0 [2024-08-06 07:02:21,369][52667] Sum rewards: 82.813, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.949', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.056', 'weapon5': '0.098', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '68.000'} [2024-08-06 07:02:21,950][52647] DAMAGECOUNT value on done: 849554.0 [2024-08-06 07:02:21,950][52647] Sum rewards: 64.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.221', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.424', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.302', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '52.000'} [2024-08-06 07:02:22,104][52803] DAMAGECOUNT value on done: 755986.0 [2024-08-06 07:02:22,104][52803] Sum rewards: 77.856, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.081', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.282', 'AMMO3': '0.329', 'WEAPON3': '1.850', 'weapon3': '3.266', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '69.000'} [2024-08-06 07:02:22,562][52820] DAMAGECOUNT value on done: 755211.0 [2024-08-06 07:02:22,566][52820] Sum rewards: 71.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.194', 'AMMO3': '0.204', 'AMMO4': '0.212', 'weapon2': '0.292', 'weapon4': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '58.500'} [2024-08-06 07:02:22,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 601432064. Throughput: 0: 4375.3. Samples: 150362400. Policy #0 lag: (min: 0.0, avg: 4.2, max: 9.0) [2024-08-06 07:02:22,802][52567] Avg episode reward: [(0, '74.712')] [2024-08-06 07:02:22,864][52659] DAMAGECOUNT value on done: 815030.0 [2024-08-06 07:02:22,864][52659] Sum rewards: 73.163, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.186', 'weapon5': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.378', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '2.632', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:22,939][52664] DAMAGECOUNT value on done: 851681.0 [2024-08-06 07:02:22,941][52664] Sum rewards: 73.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.104', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:23,796][52811] DAMAGECOUNT value on done: 769336.0 [2024-08-06 07:02:23,797][52811] Sum rewards: 79.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.132', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.066', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:24,304][52647] DAMAGECOUNT value on done: 858972.0 [2024-08-06 07:02:24,305][52667] DAMAGECOUNT value on done: 818630.0 [2024-08-06 07:02:24,306][52647] Sum rewards: 61.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.138', 'weapon4': '0.138', 'AMMO3': '0.260', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.180', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '54.000'} [2024-08-06 07:02:24,306][52667] Sum rewards: 60.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.780', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.106', 'weapon5': '0.162', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '3.034', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '52.000'} [2024-08-06 07:02:24,759][52795] DAMAGECOUNT value on done: 756632.0 [2024-08-06 07:02:24,759][52795] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.648', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '57.000'} [2024-08-06 07:02:24,831][52650] Updated weights for policy 0, policy_version 73421 (0.0015) [2024-08-06 07:02:25,260][52803] DAMAGECOUNT value on done: 761019.0 [2024-08-06 07:02:25,261][52803] Sum rewards: 66.130, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.640', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.088', 'weapon5': '0.172', 'AMMO4': '0.215', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.650', 'weapon3': '3.006', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '57.000'} [2024-08-06 07:02:25,284][52664] DAMAGECOUNT value on done: 840225.0 [2024-08-06 07:02:25,285][52664] Sum rewards: 72.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.172', 'AMMO4': '0.210', 'weapon5': '0.212', 'AMMO3': '0.230', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.052', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:25,825][52659] DAMAGECOUNT value on done: 816155.0 [2024-08-06 07:02:25,826][52659] Sum rewards: 75.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.128', 'AMMO3': '0.170', 'weapon2': '0.254', 'AMMO4': '0.293', 'weapon5': '0.344', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:25,904][52820] DAMAGECOUNT value on done: 745027.0 [2024-08-06 07:02:25,904][52820] Sum rewards: 79.273, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.089', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.274', 'weapon2': '0.336', 'WEAPON3': '1.750', 'weapon3': '3.324', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '67.000'} [2024-08-06 07:02:26,748][52647] DAMAGECOUNT value on done: 860809.0 [2024-08-06 07:02:26,748][52647] Sum rewards: 80.364, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.893', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.026', 'AMMO4': '0.055', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.410', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:26,952][52811] DAMAGECOUNT value on done: 760616.0 [2024-08-06 07:02:26,953][52811] Sum rewards: 82.232, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'AMMO5': '0.005', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.138', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '67.000'} [2024-08-06 07:02:27,249][52794] DAMAGECOUNT value on done: 809908.0 [2024-08-06 07:02:27,251][52794] Sum rewards: 83.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'weapon2': '0.230', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'weapon3': '3.392', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '71.000'} [2024-08-06 07:02:27,519][52667] DAMAGECOUNT value on done: 825847.0 [2024-08-06 07:02:27,520][52667] Sum rewards: 83.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.578', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.098', 'weapon4': '0.176', 'AMMO3': '0.195', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '68.000'} [2024-08-06 07:02:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 601513984. Throughput: 0: 4364.2. Samples: 150388470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:02:27,794][52567] Avg episode reward: [(0, '74.388')] [2024-08-06 07:02:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073427_601513984.pth... [2024-08-06 07:02:27,861][52795] DAMAGECOUNT value on done: 742579.0 [2024-08-06 07:02:27,866][52795] Sum rewards: 65.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.082', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.055', 'weapon5': '0.096', 'weapon4': '0.168', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.050', 'HITCOUNT': '3.030', 'weapon3': '3.178', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '52.000'} [2024-08-06 07:02:27,942][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000072916_597327872.pth [2024-08-06 07:02:28,084][52664] DAMAGECOUNT value on done: 845330.0 [2024-08-06 07:02:28,084][52664] Sum rewards: 80.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.582', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.175', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.242', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:28,417][52649] DAMAGECOUNT value on done: 790899.0 [2024-08-06 07:02:28,418][52649] Sum rewards: 71.244, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.928', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:28,502][52803] DAMAGECOUNT value on done: 759564.0 [2024-08-06 07:02:28,504][52803] Sum rewards: 74.218, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.926', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.082', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '62.000'} [2024-08-06 07:02:28,731][52669] Large shaping reward 2.525 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47400000000000003, 158.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:02:28,886][52650] Updated weights for policy 0, policy_version 73431 (0.0021) [2024-08-06 07:02:29,021][52820] DAMAGECOUNT value on done: 759225.0 [2024-08-06 07:02:29,023][52820] Sum rewards: 85.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.104', 'weapon5': '0.126', 'weapon2': '0.206', 'AMMO3': '0.233', 'AMMO4': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.320', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.036', 'FRAGCOUNT': '70.000'} [2024-08-06 07:02:29,069][52659] DAMAGECOUNT value on done: 815257.0 [2024-08-06 07:02:29,071][52659] Sum rewards: 75.357, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.389', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.155', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:30,157][52647] DAMAGECOUNT value on done: 848617.0 [2024-08-06 07:02:30,159][52647] Sum rewards: 73.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.154', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.120', 'weapon4': '0.128', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:30,231][52794] DAMAGECOUNT value on done: 817197.0 [2024-08-06 07:02:30,233][52794] Sum rewards: 78.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.184', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.214', 'weapon4': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:30,271][52811] DAMAGECOUNT value on done: 760247.0 [2024-08-06 07:02:30,273][52811] Sum rewards: 71.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.362', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.235', 'weapon2': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.346', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '61.000'} [2024-08-06 07:02:31,017][52795] DAMAGECOUNT value on done: 747989.0 [2024-08-06 07:02:31,019][52795] Sum rewards: 66.121, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.172', 'weapon2': '0.182', 'weapon4': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.208', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:31,287][52664] DAMAGECOUNT value on done: 848085.0 [2024-08-06 07:02:31,287][52664] Sum rewards: 75.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.643', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.046', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:31,577][52649] DAMAGECOUNT value on done: 782054.0 [2024-08-06 07:02:31,578][52649] Sum rewards: 73.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.022', 'AMMO2': '0.062', 'AMMO3': '0.177', 'weapon5': '0.250', 'AMMO4': '0.308', 'weapon4': '0.342', 'weapon2': '0.524', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.544', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:31,713][52803] DAMAGECOUNT value on done: 759716.0 [2024-08-06 07:02:31,718][52803] Sum rewards: 84.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.585', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.088', 'weapon4': '0.092', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.298', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '71.000'} [2024-08-06 07:02:31,746][52659] DAMAGECOUNT value on done: 824623.0 [2024-08-06 07:02:31,747][52659] Sum rewards: 72.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.228', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.190', 'AMMO3': '0.219', 'AMMO4': '0.230', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:32,160][52820] DAMAGECOUNT value on done: 742971.0 [2024-08-06 07:02:32,160][52820] Sum rewards: 78.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.572', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.054', 'AMMO3': '0.145', 'weapon5': '0.168', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.858', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '62.000'} [2024-08-06 07:02:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 601604096. Throughput: 0: 4359.8. Samples: 150401270. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:02:32,794][52567] Avg episode reward: [(0, '74.486')] [2024-08-06 07:02:32,811][52647] DAMAGECOUNT value on done: 852664.0 [2024-08-06 07:02:32,811][52647] Sum rewards: 72.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.901', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.696', 'WEAPON3': '1.150', 'weapon3': '3.130', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '58.500'} [2024-08-06 07:02:33,624][52794] DAMAGECOUNT value on done: 822394.0 [2024-08-06 07:02:33,624][52794] Sum rewards: 83.506, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.018', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.120', 'AMMO3': '0.153', 'weapon2': '0.260', 'WEAPON3': '1.050', 'weapon3': '3.500', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:33,858][52664] DAMAGECOUNT value on done: 841680.0 [2024-08-06 07:02:33,858][52664] Sum rewards: 71.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.589', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO4': '0.141', 'AMMO3': '0.185', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 07:02:33,943][52650] Updated weights for policy 0, policy_version 73441 (0.0024) [2024-08-06 07:02:34,111][52795] DAMAGECOUNT value on done: 757290.0 [2024-08-06 07:02:34,112][52795] Sum rewards: 79.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.065', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.124', 'weapon5': '0.124', 'AMMO4': '0.126', 'AMMO3': '0.201', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:34,539][52659] DAMAGECOUNT value on done: 811435.0 [2024-08-06 07:02:34,539][52659] Sum rewards: 75.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '62.000'} [2024-08-06 07:02:34,689][52649] DAMAGECOUNT value on done: 801360.0 [2024-08-06 07:02:34,690][52649] Sum rewards: 73.109, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.682', 'AMMO5': '0.023', 'AMMO2': '0.064', 'AMMO3': '0.204', 'weapon4': '0.230', 'weapon5': '0.302', 'AMMO4': '0.322', 'weapon2': '0.370', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.776', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '61.000'} [2024-08-06 07:02:34,825][52803] DAMAGECOUNT value on done: 759435.0 [2024-08-06 07:02:34,825][52803] Sum rewards: 70.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.785', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.260', 'WEAPON3': '1.450', 'weapon3': '3.394', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:35,411][52820] DAMAGECOUNT value on done: 749330.0 [2024-08-06 07:02:35,412][52820] Sum rewards: 81.071, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.932', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.066', 'weapon5': '0.102', 'AMMO4': '0.117', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:35,488][52647] DAMAGECOUNT value on done: 844252.0 [2024-08-06 07:02:35,488][52647] Sum rewards: 71.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.094', 'AMMO3': '0.179', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '58.000'} [2024-08-06 07:02:36,317][52794] DAMAGECOUNT value on done: 809963.0 [2024-08-06 07:02:36,317][52794] Sum rewards: 71.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.588', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.082', 'AMMO4': '0.093', 'weapon5': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:37,225][52795] DAMAGECOUNT value on done: 744948.0 [2024-08-06 07:02:37,225][52795] Sum rewards: 72.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.066', 'AMMO3': '0.229', 'weapon5': '0.230', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:37,506][52659] DAMAGECOUNT value on done: 820244.0 [2024-08-06 07:02:37,506][52659] Sum rewards: 77.558, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.464', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.008', 'weapon4': '0.014', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.420', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 601694208. Throughput: 0: 4356.2. Samples: 150427380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:02:37,794][52567] Avg episode reward: [(0, '74.392')] [2024-08-06 07:02:37,871][52803] DAMAGECOUNT value on done: 752129.0 [2024-08-06 07:02:37,871][52803] Sum rewards: 85.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.240', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.098', 'AMMO4': '0.152', 'weapon5': '0.202', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '71.000'} [2024-08-06 07:02:37,901][52647] DAMAGECOUNT value on done: 849305.0 [2024-08-06 07:02:37,902][52647] Sum rewards: 71.986, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.275', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.143', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.504', 'weapon4': '0.552', 'WEAPON3': '0.950', 'weapon3': '2.604', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:37,987][52649] DAMAGECOUNT value on done: 795262.0 [2024-08-06 07:02:37,987][52649] Sum rewards: 72.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.326', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.132', 'AMMO4': '0.253', 'AMMO3': '0.271', 'weapon5': '0.294', 'weapon2': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.500'} [2024-08-06 07:02:38,536][52650] Updated weights for policy 0, policy_version 73451 (0.0012) [2024-08-06 07:02:38,540][52820] DAMAGECOUNT value on done: 752199.0 [2024-08-06 07:02:38,541][52820] Sum rewards: 77.062, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.159', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.124', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.418', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:39,229][52658] DAMAGECOUNT value on done: 816664.0 [2024-08-06 07:02:39,229][52658] Sum rewards: 75.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.096', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.322', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '61.500'} [2024-08-06 07:02:39,281][52794] DAMAGECOUNT value on done: 806841.0 [2024-08-06 07:02:39,284][52794] Sum rewards: 64.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon2': '0.150', 'weapon5': '0.182', 'AMMO4': '0.228', 'weapon4': '0.234', 'AMMO3': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.110', 'weapon3': '3.196', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.000'} [2024-08-06 07:02:40,408][52795] DAMAGECOUNT value on done: 752265.0 [2024-08-06 07:02:40,408][52795] Sum rewards: 74.964, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.824', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.098', 'weapon5': '0.154', 'AMMO4': '0.163', 'AMMO3': '0.293', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.946', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:40,550][52659] DAMAGECOUNT value on done: 812709.0 [2024-08-06 07:02:40,552][52659] Sum rewards: 70.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.376', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.036', 'AMMO4': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.464', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:41,026][52803] DAMAGECOUNT value on done: 751724.0 [2024-08-06 07:02:41,027][52803] Sum rewards: 61.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon5': '0.120', 'weapon4': '0.232', 'AMMO3': '0.248', 'weapon2': '0.254', 'AMMO4': '0.289', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '53.000'} [2024-08-06 07:02:41,116][52649] DAMAGECOUNT value on done: 787174.0 [2024-08-06 07:02:41,117][52649] Sum rewards: 68.374, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.193', 'weapon4': '0.248', 'weapon5': '0.268', 'AMMO4': '0.355', 'WEAPON5': '0.550', 'weapon2': '0.554', 'WEAPON4': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.570', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '57.000'} [2024-08-06 07:02:41,552][52658] DAMAGECOUNT value on done: 818073.0 [2024-08-06 07:02:41,554][52658] Sum rewards: 84.562, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.146', 'weapon5': '0.148', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.378', 'FRAGCOUNT': '69.000'} [2024-08-06 07:02:41,553][52820] DAMAGECOUNT value on done: 756737.0 [2024-08-06 07:02:41,555][52820] Sum rewards: 70.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'weapon4': '0.028', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.412', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '58.500'} [2024-08-06 07:02:42,538][52794] DAMAGECOUNT value on done: 814353.0 [2024-08-06 07:02:42,539][52794] Sum rewards: 74.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.925', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.086', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'weapon2': '0.204', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.400', 'weapon3': '3.402', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 601784320. Throughput: 0: 4359.1. Samples: 150453560. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:02:42,794][52567] Avg episode reward: [(0, '74.184')] [2024-08-06 07:02:43,330][52650] Updated weights for policy 0, policy_version 73461 (0.0013) [2024-08-06 07:02:43,465][52795] DAMAGECOUNT value on done: 759964.0 [2024-08-06 07:02:43,465][52795] Sum rewards: 62.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.056', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.322', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.382', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2024-08-06 07:02:43,976][52649] DAMAGECOUNT value on done: 796637.0 [2024-08-06 07:02:43,977][52649] Sum rewards: 75.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'AMMO5': '0.013', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.130', 'weapon4': '0.136', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:44,275][52803] DAMAGECOUNT value on done: 757603.0 [2024-08-06 07:02:44,275][52803] Sum rewards: 75.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.942', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.060', 'weapon4': '0.092', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.296', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:44,322][52658] DAMAGECOUNT value on done: 821985.0 [2024-08-06 07:02:44,323][52658] Sum rewards: 80.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.029', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.132', 'AMMO3': '0.162', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.168', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '64.000'} [2024-08-06 07:02:44,669][52820] DAMAGECOUNT value on done: 765166.0 [2024-08-06 07:02:44,669][52820] Sum rewards: 71.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.122', 'weapon5': '0.174', 'AMMO4': '0.234', 'AMMO3': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:45,457][52794] DAMAGECOUNT value on done: 818115.0 [2024-08-06 07:02:45,460][52794] Sum rewards: 66.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.801', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.155', 'weapon2': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.444', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:46,579][52795] DAMAGECOUNT value on done: 750759.0 [2024-08-06 07:02:46,579][52795] Sum rewards: 75.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.192', 'weapon2': '0.226', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '61.000'} [2024-08-06 07:02:46,719][52649] DAMAGECOUNT value on done: 795059.0 [2024-08-06 07:02:46,719][52649] Sum rewards: 84.235, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.175', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.151', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '2.822', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '68.000'} [2024-08-06 07:02:47,080][52658] DAMAGECOUNT value on done: 817435.0 [2024-08-06 07:02:47,082][52658] Sum rewards: 71.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon5': '0.244', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '58.500'} [2024-08-06 07:02:47,544][52803] DAMAGECOUNT value on done: 755609.0 [2024-08-06 07:02:47,544][52803] Sum rewards: 61.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.130', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.218', 'weapon2': '0.454', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.042', 'DAMAGECOUNT': '14.088', 'FRAGCOUNT': '50.000'} [2024-08-06 07:02:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 601866240. Throughput: 0: 4363.1. Samples: 150466830. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:02:47,794][52567] Avg episode reward: [(0, '74.095')] [2024-08-06 07:02:47,798][52820] DAMAGECOUNT value on done: 747613.0 [2024-08-06 07:02:47,799][52820] Sum rewards: 74.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.011', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.076', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:47,948][52650] Updated weights for policy 0, policy_version 73471 (0.0019) [2024-08-06 07:02:48,616][52794] DAMAGECOUNT value on done: 805710.0 [2024-08-06 07:02:48,618][52794] Sum rewards: 70.984, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.110', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.118', 'AMMO3': '0.125', 'weapon4': '0.140', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '0.950', 'HITCOUNT': '3.120', 'weapon3': '3.248', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:49,447][52649] DAMAGECOUNT value on done: 799217.0 [2024-08-06 07:02:49,447][52649] Sum rewards: 75.961, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.313', 'AMMO5': '0.008', 'AMMO2': '0.008', 'weapon4': '0.020', 'AMMO4': '0.041', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.314', 'weapon2': '0.376', 'WEAPON3': '1.900', 'weapon3': '3.248', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '67.000'} [2024-08-06 07:02:49,675][52795] DAMAGECOUNT value on done: 756377.0 [2024-08-06 07:02:49,677][52795] Sum rewards: 83.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.126', 'AMMO3': '0.175', 'weapon4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '67.000'} [2024-08-06 07:02:50,146][52658] DAMAGECOUNT value on done: 813578.0 [2024-08-06 07:02:50,147][52658] Sum rewards: 67.747, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-5.230', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.170', 'weapon4': '0.210', 'weapon2': '0.246', 'AMMO3': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '2.050', 'weapon3': '3.082', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:50,698][52803] DAMAGECOUNT value on done: 769576.0 [2024-08-06 07:02:50,698][52803] Sum rewards: 71.635, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.225', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'weapon2': '0.210', 'weapon4': '0.250', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:51,097][52820] DAMAGECOUNT value on done: 756310.0 [2024-08-06 07:02:51,097][52820] Sum rewards: 75.368, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.656', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.184', 'weapon2': '0.188', 'weapon5': '0.206', 'AMMO4': '0.271', 'weapon4': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '61.000'} [2024-08-06 07:02:51,464][52794] DAMAGECOUNT value on done: 817507.0 [2024-08-06 07:02:51,466][52794] Sum rewards: 81.515, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.275', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '68.000'} [2024-08-06 07:02:52,377][52649] DAMAGECOUNT value on done: 796878.0 [2024-08-06 07:02:52,377][52649] Sum rewards: 77.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.866', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.205', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '63.000'} [2024-08-06 07:02:52,582][52650] Updated weights for policy 0, policy_version 73481 (0.0021) [2024-08-06 07:02:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 601956352. Throughput: 0: 4367.1. Samples: 150493220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:02:52,794][52567] Avg episode reward: [(0, '74.236')] [2024-08-06 07:02:52,839][52795] DAMAGECOUNT value on done: 757419.0 [2024-08-06 07:02:52,839][52795] Sum rewards: 79.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.130', 'AMMO4': '0.193', 'AMMO3': '0.243', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '66.500'} [2024-08-06 07:02:53,076][52658] DAMAGECOUNT value on done: 806331.0 [2024-08-06 07:02:53,077][52658] Sum rewards: 63.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.138', 'AMMO3': '0.169', 'AMMO4': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '2.928', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '52.000'} [2024-08-06 07:02:53,820][52803] DAMAGECOUNT value on done: 760598.0 [2024-08-06 07:02:53,821][52803] Sum rewards: 77.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.614', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.220', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '62.000'} [2024-08-06 07:02:53,982][52794] DAMAGECOUNT value on done: 810904.0 [2024-08-06 07:02:53,982][52794] Sum rewards: 79.438, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.918', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO3': '0.277', 'weapon2': '0.336', 'WEAPON3': '1.800', 'weapon3': '3.340', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '69.000'} [2024-08-06 07:02:54,302][52820] DAMAGECOUNT value on done: 766317.0 [2024-08-06 07:02:54,302][52820] Sum rewards: 84.565, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.675', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'AMMO3': '0.151', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.694', 'WEAPON3': '1.000', 'weapon3': '2.870', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:54,772][52666] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:02:55,264][52803] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:02:55,452][52649] DAMAGECOUNT value on done: 791231.0 [2024-08-06 07:02:55,452][52649] Sum rewards: 81.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.175', 'weapon2': '0.192', 'WEAPON3': '1.150', 'weapon3': '3.568', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:55,993][52795] DAMAGECOUNT value on done: 753439.0 [2024-08-06 07:02:55,994][52795] Sum rewards: 80.443, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.394', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.171', 'weapon5': '0.188', 'weapon2': '0.216', 'AMMO3': '0.291', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.250', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '71.000'} [2024-08-06 07:02:56,100][52665] DAMAGECOUNT value on done: 803880.0 [2024-08-06 07:02:56,101][52665] Sum rewards: 62.656, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.188', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.402', 'WEAPON3': '1.350', 'weapon3': '2.690', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '52.000'} [2024-08-06 07:02:56,340][52658] DAMAGECOUNT value on done: 820185.0 [2024-08-06 07:02:56,340][52658] Sum rewards: 74.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.180', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.169', 'AMMO3': '0.208', 'weapon4': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '62.000'} [2024-08-06 07:02:56,515][52663] DAMAGECOUNT value on done: 831178.0 [2024-08-06 07:02:56,516][52663] Sum rewards: 75.145, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.535', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.080', 'weapon5': '0.096', 'AMMO4': '0.203', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:57,057][52803] DAMAGECOUNT value on done: 758676.0 [2024-08-06 07:02:57,057][52803] Sum rewards: 83.686, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.488', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.176', 'weapon2': '0.290', 'WEAPON3': '0.950', 'weapon3': '3.238', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '65.000'} [2024-08-06 07:02:57,076][52794] DAMAGECOUNT value on done: 805398.0 [2024-08-06 07:02:57,076][52794] Sum rewards: 67.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.108', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.238', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 07:02:57,348][52820] DAMAGECOUNT value on done: 760204.0 [2024-08-06 07:02:57,351][52820] Sum rewards: 74.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.705', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon2': '0.126', 'weapon5': '0.134', 'AMMO4': '0.147', 'AMMO3': '0.187', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.980', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '60.000'} [2024-08-06 07:02:57,373][52650] Updated weights for policy 0, policy_version 73491 (0.0013) [2024-08-06 07:02:57,733][52669] DAMAGECOUNT value on done: 815535.0 [2024-08-06 07:02:57,733][52669] Sum rewards: 69.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.606', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.128', 'weapon5': '0.142', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '59.000'} [2024-08-06 07:02:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 602038272. Throughput: 0: 4365.4. Samples: 150519350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:02:57,795][52567] Avg episode reward: [(0, '74.539')] [2024-08-06 07:02:58,353][52649] DAMAGECOUNT value on done: 801846.0 [2024-08-06 07:02:58,355][52649] Sum rewards: 85.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.008', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO4': '0.042', 'weapon5': '0.058', 'WEAPON4': '0.100', 'weapon2': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.532', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '72.000'} [2024-08-06 07:02:58,857][52665] DAMAGECOUNT value on done: 818623.0 [2024-08-06 07:02:58,858][52665] Sum rewards: 84.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.599', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.094', 'AMMO3': '0.196', 'weapon5': '0.202', 'AMMO4': '0.219', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '70.000'} [2024-08-06 07:02:59,168][52795] DAMAGECOUNT value on done: 746325.0 [2024-08-06 07:02:59,168][52795] Sum rewards: 58.864, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.176', 'AMMO5': '0.017', 'ARMOR': '0.024', 'AMMO2': '0.054', 'weapon4': '0.096', 'AMMO4': '0.272', 'AMMO3': '0.274', 'weapon5': '0.290', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.890', 'weapon3': '2.960', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '53.000'} [2024-08-06 07:02:59,242][52658] DAMAGECOUNT value on done: 808627.0 [2024-08-06 07:02:59,242][52658] Sum rewards: 80.514, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.746', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.195', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '66.000'} [2024-08-06 07:02:59,667][52663] DAMAGECOUNT value on done: 816074.0 [2024-08-06 07:02:59,667][52663] Sum rewards: 74.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO4': '0.195', 'AMMO3': '0.221', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.152', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:00,077][52794] DAMAGECOUNT value on done: 817006.0 [2024-08-06 07:03:00,077][52794] Sum rewards: 86.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.487', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.257', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '73.000'} [2024-08-06 07:03:00,243][52803] DAMAGECOUNT value on done: 770506.0 [2024-08-06 07:03:00,245][52803] Sum rewards: 72.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.481', 'AMMO2': '0.010', 'AMMO5': '0.010', 'weapon4': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:00,474][52820] DAMAGECOUNT value on done: 759948.0 [2024-08-06 07:03:00,475][52820] Sum rewards: 75.507, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.100', 'AMMO3': '0.175', 'HEALTH': '0.529', 'weapon2': '0.574', 'WEAPON3': '0.950', 'weapon3': '3.150', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:00,615][52669] DAMAGECOUNT value on done: 809837.0 [2024-08-06 07:03:00,615][52669] Sum rewards: 70.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.136', 'AMMO3': '0.184', 'weapon2': '0.226', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:00,965][52649] DAMAGECOUNT value on done: 808761.0 [2024-08-06 07:03:00,966][52649] Sum rewards: 79.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '66.000'} [2024-08-06 07:03:01,745][52665] DAMAGECOUNT value on done: 809824.0 [2024-08-06 07:03:01,747][52665] Sum rewards: 70.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.168', 'weapon4': '0.178', 'weapon2': '0.226', 'AMMO4': '0.228', 'AMMO3': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:01,843][52650] Updated weights for policy 0, policy_version 73501 (0.0012) [2024-08-06 07:03:02,252][52663] DAMAGECOUNT value on done: 811469.0 [2024-08-06 07:03:02,252][52663] Sum rewards: 70.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.182', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:02,321][52795] DAMAGECOUNT value on done: 748151.0 [2024-08-06 07:03:02,321][52795] Sum rewards: 63.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.705', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.180', 'AMMO3': '0.208', 'weapon2': '0.234', 'AMMO4': '0.317', 'weapon5': '0.342', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.932', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '52.000'} [2024-08-06 07:03:02,421][52658] DAMAGECOUNT value on done: 834644.0 [2024-08-06 07:03:02,422][52658] Sum rewards: 81.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.068', 'AMMO4': '0.071', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.220', 'WEAPON3': '1.450', 'weapon3': '3.482', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '67.000'} [2024-08-06 07:03:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 602128384. Throughput: 0: 4368.9. Samples: 150532390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:03:02,794][52567] Avg episode reward: [(0, '74.573')] [2024-08-06 07:03:02,913][52794] DAMAGECOUNT value on done: 813338.0 [2024-08-06 07:03:02,914][52794] Sum rewards: 76.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.121', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '62.000'} [2024-08-06 07:03:03,409][52669] DAMAGECOUNT value on done: 823329.0 [2024-08-06 07:03:03,411][52669] Sum rewards: 68.249, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.764', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.070', 'AMMO3': '0.108', 'weapon5': '0.164', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.714', 'WEAPON3': '0.750', 'HITCOUNT': '2.830', 'weapon3': '2.902', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '52.000'} [2024-08-06 07:03:03,500][52803] DAMAGECOUNT value on done: 757757.0 [2024-08-06 07:03:03,501][52803] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.355', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.102', 'weapon4': '0.180', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.238', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:03,522][52820] DAMAGECOUNT value on done: 757330.0 [2024-08-06 07:03:03,522][52820] Sum rewards: 71.840, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.178', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.158', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:04,076][52649] DAMAGECOUNT value on done: 801499.0 [2024-08-06 07:03:04,077][52649] Sum rewards: 83.755, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.600', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon2': '0.224', 'weapon5': '0.224', 'AMMO3': '0.225', 'AMMO4': '0.273', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '69.000'} [2024-08-06 07:03:04,191][52671] DAMAGECOUNT value on done: 820771.0 [2024-08-06 07:03:04,192][52671] Sum rewards: 71.365, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.750', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.094', 'weapon5': '0.228', 'AMMO4': '0.231', 'AMMO3': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.572', 'WEAPON3': '1.750', 'weapon3': '2.766', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:04,925][52663] DAMAGECOUNT value on done: 814668.0 [2024-08-06 07:03:04,927][52663] Sum rewards: 67.251, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.175', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.250', 'AMMO4': '0.272', 'weapon2': '0.302', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:05,008][52665] DAMAGECOUNT value on done: 810302.0 [2024-08-06 07:03:05,009][52665] Sum rewards: 65.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.296', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:05,418][52658] DAMAGECOUNT value on done: 819517.0 [2024-08-06 07:03:05,426][52658] Sum rewards: 80.319, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.525', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.118', 'weapon4': '0.128', 'AMMO3': '0.206', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '67.000'} [2024-08-06 07:03:05,434][52795] DAMAGECOUNT value on done: 759676.0 [2024-08-06 07:03:05,434][52795] Sum rewards: 85.757, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.064', 'HEALTH': '0.120', 'AMMO4': '0.158', 'weapon5': '0.158', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '71.000'} [2024-08-06 07:03:05,484][52794] DAMAGECOUNT value on done: 828927.0 [2024-08-06 07:03:05,484][52794] Sum rewards: 70.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.648', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.146', 'AMMO3': '0.216', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:05,910][52669] DAMAGECOUNT value on done: 816364.0 [2024-08-06 07:03:05,912][52669] Sum rewards: 85.970, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.992', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.074', 'weapon5': '0.090', 'AMMO4': '0.123', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '69.000'} [2024-08-06 07:03:06,515][52650] Updated weights for policy 0, policy_version 73511 (0.0031) [2024-08-06 07:03:06,580][52820] DAMAGECOUNT value on done: 759197.0 [2024-08-06 07:03:06,580][52820] Sum rewards: 77.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.013', 'weapon4': '0.044', 'AMMO4': '0.067', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:06,722][52803] DAMAGECOUNT value on done: 759630.0 [2024-08-06 07:03:06,725][52803] Sum rewards: 72.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.325', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.116', 'weapon5': '0.126', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.274', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:07,130][52671] DAMAGECOUNT value on done: 825807.0 [2024-08-06 07:03:07,130][52671] Sum rewards: 71.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.852', 'AMMO5': '0.025', 'AMMO2': '0.071', 'weapon5': '0.186', 'AMMO3': '0.189', 'weapon2': '0.222', 'AMMO4': '0.355', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'weapon4': '0.694', 'WEAPON3': '1.050', 'weapon3': '2.578', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:07,273][52663] DAMAGECOUNT value on done: 816848.0 [2024-08-06 07:03:07,273][52663] Sum rewards: 75.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.464', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.080', 'AMMO4': '0.163', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:07,396][52649] DAMAGECOUNT value on done: 802176.0 [2024-08-06 07:03:07,398][52649] Sum rewards: 72.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.030', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.120', 'weapon4': '0.176', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.336', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 602218496. Throughput: 0: 4357.6. Samples: 150558490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:03:07,794][52567] Avg episode reward: [(0, '74.633')] [2024-08-06 07:03:07,999][52665] DAMAGECOUNT value on done: 792494.0 [2024-08-06 07:03:07,999][52665] Sum rewards: 69.087, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.039', 'AMMO5': '0.023', 'AMMO2': '0.046', 'weapon4': '0.110', 'AMMO3': '0.208', 'AMMO4': '0.232', 'weapon5': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.718', 'WEAPON3': '1.300', 'weapon3': '2.642', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '60.500'} [2024-08-06 07:03:08,235][52669] DAMAGECOUNT value on done: 820770.0 [2024-08-06 07:03:08,235][52669] Sum rewards: 77.203, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.030', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.050', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.458', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:08,338][52658] DAMAGECOUNT value on done: 828906.0 [2024-08-06 07:03:08,339][52658] Sum rewards: 73.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.408', 'AMMO5': '0.021', 'AMMO2': '0.052', 'AMMO3': '0.194', 'weapon4': '0.198', 'AMMO4': '0.260', 'weapon5': '0.270', 'weapon2': '0.496', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:08,504][52795] DAMAGECOUNT value on done: 744011.0 [2024-08-06 07:03:08,505][52795] Sum rewards: 70.661, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.018', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.132', 'AMMO3': '0.155', 'weapon4': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '1.000', 'weapon3': '2.924', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:08,528][52794] DAMAGECOUNT value on done: 808199.0 [2024-08-06 07:03:08,528][52794] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.060', 'AMMO4': '0.139', 'weapon5': '0.196', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:09,722][52820] DAMAGECOUNT value on done: 769941.0 [2024-08-06 07:03:09,723][52820] Sum rewards: 77.983, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.039', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.058', 'AMMO4': '0.169', 'weapon5': '0.182', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:09,925][52803] DAMAGECOUNT value on done: 763381.0 [2024-08-06 07:03:09,926][52803] Sum rewards: 72.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.415', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.130', 'weapon5': '0.144', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:10,169][52663] DAMAGECOUNT value on done: 821625.0 [2024-08-06 07:03:10,171][52663] Sum rewards: 75.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.092', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:10,185][52671] DAMAGECOUNT value on done: 820025.0 [2024-08-06 07:03:10,186][52671] Sum rewards: 75.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.783', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO4': '0.176', 'AMMO3': '0.214', 'weapon5': '0.214', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:10,454][52649] DAMAGECOUNT value on done: 792260.0 [2024-08-06 07:03:10,464][52649] Sum rewards: 73.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon4': '0.074', 'weapon5': '0.128', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'AMMO4': '0.277', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:10,626][52658] DAMAGECOUNT value on done: 817133.0 [2024-08-06 07:03:10,627][52658] Sum rewards: 77.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:11,235][52665] DAMAGECOUNT value on done: 800223.0 [2024-08-06 07:03:11,235][52665] Sum rewards: 76.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.086', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.094', 'AMMO4': '0.114', 'weapon5': '0.182', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:11,361][52669] DAMAGECOUNT value on done: 818481.0 [2024-08-06 07:03:11,363][52669] Sum rewards: 78.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'weapon4': '0.096', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.670', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:11,408][52650] Updated weights for policy 0, policy_version 73521 (0.0032) [2024-08-06 07:03:11,449][52794] DAMAGECOUNT value on done: 823932.0 [2024-08-06 07:03:11,449][52794] Sum rewards: 64.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.302', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.334', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:11,579][52795] DAMAGECOUNT value on done: 757334.0 [2024-08-06 07:03:11,579][52795] Sum rewards: 69.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.027', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.168', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '3.176', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:12,666][52820] DAMAGECOUNT value on done: 766615.0 [2024-08-06 07:03:12,668][52820] Sum rewards: 79.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.537', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.157', 'weapon5': '0.184', 'AMMO4': '0.213', 'weapon4': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 602308608. Throughput: 0: 4362.0. Samples: 150584760. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:12,794][52567] Avg episode reward: [(0, '74.264')] [2024-08-06 07:03:13,017][52663] DAMAGECOUNT value on done: 811090.0 [2024-08-06 07:03:13,017][52663] Sum rewards: 67.964, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.128', 'weapon2': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.430', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:13,075][52803] DAMAGECOUNT value on done: 768796.0 [2024-08-06 07:03:13,077][52803] Sum rewards: 64.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.998', 'AMMO5': '0.023', 'AMMO2': '0.078', 'AMMO3': '0.276', 'weapon5': '0.308', 'weapon4': '0.332', 'AMMO4': '0.391', 'weapon2': '0.404', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.592', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:13,138][52671] DAMAGECOUNT value on done: 822837.0 [2024-08-06 07:03:13,140][52671] Sum rewards: 83.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.124', 'weapon5': '0.138', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '68.000'} [2024-08-06 07:03:13,372][52649] DAMAGECOUNT value on done: 799663.0 [2024-08-06 07:03:13,374][52649] Sum rewards: 69.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.462', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.099', 'weapon2': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.466', 'DAMAGECOUNT': '17.331', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:13,595][52658] DAMAGECOUNT value on done: 825537.0 [2024-08-06 07:03:13,597][52658] Sum rewards: 86.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.244', 'WEAPON4': '0.400', 'weapon4': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '72.000'} [2024-08-06 07:03:13,906][52665] DAMAGECOUNT value on done: 802896.0 [2024-08-06 07:03:13,906][52665] Sum rewards: 73.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.588', 'WEAPON1': '0.010', 'AMMO5': '0.029', 'AMMO2': '0.068', 'weapon4': '0.162', 'AMMO3': '0.208', 'weapon2': '0.292', 'AMMO4': '0.341', 'weapon5': '0.348', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '2.890', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:14,133][52669] DAMAGECOUNT value on done: 818188.0 [2024-08-06 07:03:14,133][52669] Sum rewards: 72.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon5': '0.056', 'weapon4': '0.058', 'AMMO4': '0.129', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:14,468][52794] DAMAGECOUNT value on done: 819457.0 [2024-08-06 07:03:14,469][52794] Sum rewards: 83.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.056', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.320', 'WEAPON3': '1.200', 'weapon3': '3.480', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '67.000'} [2024-08-06 07:03:14,705][52795] DAMAGECOUNT value on done: 756461.0 [2024-08-06 07:03:14,705][52795] Sum rewards: 65.493, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.149', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.654', 'WEAPON3': '1.450', 'weapon3': '2.842', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:15,714][52820] DAMAGECOUNT value on done: 748565.0 [2024-08-06 07:03:15,722][52820] Sum rewards: 76.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.114', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.206', 'AMMO4': '0.235', 'weapon2': '0.242', 'weapon5': '0.274', 'weapon4': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '62.000'} [2024-08-06 07:03:15,846][52650] Updated weights for policy 0, policy_version 73531 (0.0023) [2024-08-06 07:03:15,875][52671] DAMAGECOUNT value on done: 829833.0 [2024-08-06 07:03:15,876][52671] Sum rewards: 75.121, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.110', 'AMMO4': '0.171', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.100', 'HITCOUNT': '3.270', 'weapon3': '3.430', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '60.500'} [2024-08-06 07:03:15,931][52663] DAMAGECOUNT value on done: 803809.0 [2024-08-06 07:03:15,933][52663] Sum rewards: 71.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.249', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon4': '0.270', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:16,190][52649] DAMAGECOUNT value on done: 782858.0 [2024-08-06 07:03:16,191][52649] Sum rewards: 77.346, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.539', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.144', 'AMMO4': '0.154', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.323', 'WEAPON3': '1.850', 'weapon3': '3.178', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '69.000'} [2024-08-06 07:03:16,257][52803] DAMAGECOUNT value on done: 766201.0 [2024-08-06 07:03:16,257][52803] Sum rewards: 78.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.502', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.000', 'weapon3': '2.924', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '62.000'} [2024-08-06 07:03:16,669][52669] DAMAGECOUNT value on done: 818375.0 [2024-08-06 07:03:16,670][52669] Sum rewards: 76.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.156', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.058', 'weapon5': '0.084', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:16,722][52665] DAMAGECOUNT value on done: 805315.0 [2024-08-06 07:03:16,722][52665] Sum rewards: 91.968, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.929', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon4': '0.222', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '4.350', 'DAMAGECOUNT': '21.573', 'FRAGCOUNT': '75.000'} [2024-08-06 07:03:16,839][52658] DAMAGECOUNT value on done: 813538.0 [2024-08-06 07:03:16,841][52658] Sum rewards: 70.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon2': '0.150', 'weapon5': '0.176', 'AMMO4': '0.244', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.240', 'weapon3': '3.350', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:17,168][52794] DAMAGECOUNT value on done: 819906.0 [2024-08-06 07:03:17,170][52794] Sum rewards: 75.709, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.994', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.096', 'weapon5': '0.136', 'AMMO4': '0.149', 'weapon2': '0.168', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 602390528. Throughput: 0: 4366.7. Samples: 150597770. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:17,794][52567] Avg episode reward: [(0, '74.637')] [2024-08-06 07:03:17,860][52795] DAMAGECOUNT value on done: 745712.0 [2024-08-06 07:03:17,861][52795] Sum rewards: 70.118, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.164', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:18,581][52649] DAMAGECOUNT value on done: 804862.0 [2024-08-06 07:03:18,581][52649] Sum rewards: 80.205, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.075', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon5': '0.254', 'AMMO3': '0.257', 'weapon2': '0.268', 'AMMO4': '0.321', 'weapon4': '0.338', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '66.000'} [2024-08-06 07:03:18,924][52663] DAMAGECOUNT value on done: 808976.0 [2024-08-06 07:03:18,925][52663] Sum rewards: 75.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.837', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.086', 'AMMO4': '0.194', 'weapon5': '0.240', 'AMMO3': '0.249', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:18,962][52671] DAMAGECOUNT value on done: 818943.0 [2024-08-06 07:03:18,962][52671] Sum rewards: 68.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.712', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.086', 'AMMO4': '0.180', 'AMMO3': '0.201', 'weapon5': '0.222', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.230', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:18,988][52665] DAMAGECOUNT value on done: 814599.0 [2024-08-06 07:03:18,988][52665] Sum rewards: 71.571, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.260', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.174', 'weapon2': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.114', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:19,452][52658] DAMAGECOUNT value on done: 823366.0 [2024-08-06 07:03:19,453][52658] Sum rewards: 68.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.488', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.228', 'weapon2': '0.242', 'weapon5': '0.268', 'weapon4': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:19,563][52803] DAMAGECOUNT value on done: 762645.0 [2024-08-06 07:03:19,568][52803] Sum rewards: 74.105, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.022', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.068', 'AMMO4': '0.164', 'AMMO3': '0.198', 'weapon5': '0.224', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:19,896][52669] DAMAGECOUNT value on done: 827527.0 [2024-08-06 07:03:19,897][52669] Sum rewards: 69.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.156', 'AMMO3': '0.187', 'weapon4': '0.210', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:20,024][52794] DAMAGECOUNT value on done: 827683.0 [2024-08-06 07:03:20,024][52794] Sum rewards: 64.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.366', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.102', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.342', 'weapon4': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.880', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:20,971][52650] Updated weights for policy 0, policy_version 73541 (0.0013) [2024-08-06 07:03:21,057][52795] DAMAGECOUNT value on done: 754975.0 [2024-08-06 07:03:21,058][52795] Sum rewards: 85.859, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.072', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.177', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.961', 'FRAGCOUNT': '71.000'} [2024-08-06 07:03:21,548][52649] DAMAGECOUNT value on done: 802857.0 [2024-08-06 07:03:21,548][52649] Sum rewards: 80.314, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.826', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.150', 'weapon3': '3.328', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:21,981][52663] DAMAGECOUNT value on done: 813530.0 [2024-08-06 07:03:21,982][52663] Sum rewards: 69.292, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.632', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon4': '0.132', 'AMMO3': '0.250', 'AMMO4': '0.289', 'weapon5': '0.352', 'WEAPON4': '0.500', 'weapon2': '0.536', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.582', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:22,016][52671] DAMAGECOUNT value on done: 824267.0 [2024-08-06 07:03:22,018][52671] Sum rewards: 74.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.352', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.064', 'AMMO4': '0.080', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.222', 'WEAPON3': '1.200', 'weapon3': '3.442', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:22,227][52665] DAMAGECOUNT value on done: 805209.0 [2024-08-06 07:03:22,228][52665] Sum rewards: 77.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.126', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'weapon4': '0.248', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:22,277][52658] DAMAGECOUNT value on done: 803243.0 [2024-08-06 07:03:22,277][52658] Sum rewards: 78.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.071', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 602480640. Throughput: 0: 4369.8. Samples: 150624020. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:22,795][52567] Avg episode reward: [(0, '74.814')] [2024-08-06 07:03:22,856][52670] DAMAGECOUNT value on done: 803623.0 [2024-08-06 07:03:22,856][52670] Sum rewards: 68.501, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.442', 'AMMO5': '0.018', 'AMMO2': '0.028', 'weapon4': '0.102', 'AMMO4': '0.142', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon5': '0.410', 'weapon2': '0.810', 'WEAPON3': '0.950', 'weapon3': '2.478', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '53.000'} [2024-08-06 07:03:23,044][52669] DAMAGECOUNT value on done: 819554.0 [2024-08-06 07:03:23,044][52669] Sum rewards: 76.206, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.020', 'AMMO2': '0.038', 'AMMO4': '0.187', 'AMMO3': '0.208', 'weapon5': '0.274', 'weapon4': '0.334', 'weapon2': '0.424', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.646', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:23,157][52794] DAMAGECOUNT value on done: 819325.0 [2024-08-06 07:03:23,157][52794] Sum rewards: 68.967, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.547', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.054', 'weapon2': '0.156', 'weapon5': '0.178', 'AMMO4': '0.224', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:24,097][52795] DAMAGECOUNT value on done: 762399.0 [2024-08-06 07:03:24,097][52795] Sum rewards: 78.847, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.106', 'AMMO3': '0.230', 'AMMO4': '0.252', 'weapon5': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:24,478][52671] DAMAGECOUNT value on done: 822009.0 [2024-08-06 07:03:24,479][52671] Sum rewards: 79.592, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon5': '0.172', 'weapon2': '0.362', 'WEAPON3': '0.900', 'weapon3': '3.262', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:24,621][52649] DAMAGECOUNT value on done: 793791.0 [2024-08-06 07:03:24,623][52649] Sum rewards: 87.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.066', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.064', 'AMMO3': '0.187', 'AMMO4': '0.188', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.194', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '70.000'} [2024-08-06 07:03:24,811][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:03:25,032][52658] DAMAGECOUNT value on done: 822130.0 [2024-08-06 07:03:25,034][52658] Sum rewards: 71.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.138', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.678', 'WEAPON3': '1.450', 'weapon3': '2.996', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:25,107][52663] DAMAGECOUNT value on done: 824408.0 [2024-08-06 07:03:25,109][52663] Sum rewards: 79.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon4': '0.126', 'weapon5': '0.176', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'AMMO4': '0.264', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:25,329][52650] Updated weights for policy 0, policy_version 73551 (0.0012) [2024-08-06 07:03:25,344][52665] DAMAGECOUNT value on done: 816741.0 [2024-08-06 07:03:25,345][52665] Sum rewards: 84.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.689', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '69.000'} [2024-08-06 07:03:25,705][52670] DAMAGECOUNT value on done: 818169.0 [2024-08-06 07:03:25,706][52670] Sum rewards: 59.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.286', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.096', 'weapon4': '0.168', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.357', 'FRAGCOUNT': '48.000'} [2024-08-06 07:03:26,036][52669] DAMAGECOUNT value on done: 824382.0 [2024-08-06 07:03:26,039][52669] Sum rewards: 82.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.467', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.148', 'AMMO4': '0.159', 'weapon5': '0.218', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '69.000'} [2024-08-06 07:03:26,897][52666] DAMAGECOUNT value on done: 816976.0 [2024-08-06 07:03:26,898][52666] Sum rewards: 71.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.184', 'AMMO4': '0.190', 'weapon5': '0.192', 'AMMO3': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.450', 'weapon3': '2.724', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:27,200][52671] DAMAGECOUNT value on done: 809431.0 [2024-08-06 07:03:27,201][52671] Sum rewards: 72.979, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.636', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon4': '0.226', 'weapon5': '0.268', 'AMMO3': '0.284', 'AMMO4': '0.329', 'weapon2': '0.374', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.766', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 602570752. Throughput: 0: 4372.9. Samples: 150650340. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:27,794][52567] Avg episode reward: [(0, '74.593')] [2024-08-06 07:03:27,936][52665] DAMAGECOUNT value on done: 811289.0 [2024-08-06 07:03:27,936][52665] Sum rewards: 71.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.214', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:28,011][52658] DAMAGECOUNT value on done: 814012.0 [2024-08-06 07:03:28,013][52658] Sum rewards: 70.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.152', 'weapon2': '0.188', 'AMMO4': '0.221', 'weapon5': '0.232', 'AMMO3': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:28,252][52663] DAMAGECOUNT value on done: 804636.0 [2024-08-06 07:03:28,253][52663] Sum rewards: 69.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.210', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.186', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.018', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:28,274][52670] DAMAGECOUNT value on done: 804699.0 [2024-08-06 07:03:28,274][52670] Sum rewards: 72.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.656', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.090', 'weapon5': '0.128', 'AMMO4': '0.197', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.956', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '62.000'} [2024-08-06 07:03:28,381][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:03:29,320][52669] DAMAGECOUNT value on done: 828519.0 [2024-08-06 07:03:29,323][52669] Sum rewards: 61.655, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.470', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.148', 'weapon5': '0.150', 'AMMO4': '0.184', 'weapon2': '0.232', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.190', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '53.000'} [2024-08-06 07:03:29,464][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:03:29,468][52666] DAMAGECOUNT value on done: 809842.0 [2024-08-06 07:03:29,469][52666] Sum rewards: 76.795, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.418', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.178', 'AMMO4': '0.190', 'AMMO3': '0.193', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:29,695][52671] DAMAGECOUNT value on done: 822706.0 [2024-08-06 07:03:29,697][52671] Sum rewards: 70.083, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.208', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.106', 'weapon4': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.310', 'weapon2': '0.342', 'WEAPON3': '1.900', 'weapon3': '3.144', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '62.000'} [2024-08-06 07:03:30,100][52650] Updated weights for policy 0, policy_version 73561 (0.0014) [2024-08-06 07:03:31,063][52665] DAMAGECOUNT value on done: 806499.0 [2024-08-06 07:03:31,064][52665] Sum rewards: 65.509, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.861', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon4': '0.172', 'weapon5': '0.176', 'AMMO3': '0.227', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.030', 'weapon3': '3.222', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:31,096][52658] DAMAGECOUNT value on done: 810794.0 [2024-08-06 07:03:31,096][52658] Sum rewards: 75.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.157', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.162', 'AMMO4': '0.177', 'AMMO3': '0.207', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:31,115][52670] DAMAGECOUNT value on done: 803729.0 [2024-08-06 07:03:31,115][52670] Sum rewards: 71.649, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.510', 'AMMO5': '0.026', 'AMMO2': '0.054', 'weapon5': '0.194', 'AMMO3': '0.220', 'weapon2': '0.238', 'weapon4': '0.246', 'AMMO4': '0.271', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.500'} [2024-08-06 07:03:31,311][52663] DAMAGECOUNT value on done: 802775.0 [2024-08-06 07:03:31,311][52663] Sum rewards: 72.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.632', 'AMMO5': '0.016', 'AMMO2': '0.073', 'weapon4': '0.182', 'weapon5': '0.182', 'AMMO3': '0.244', 'weapon2': '0.310', 'AMMO4': '0.367', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:32,107][52671] DAMAGECOUNT value on done: 822233.0 [2024-08-06 07:03:32,108][52671] Sum rewards: 79.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.185', 'weapon5': '0.192', 'AMMO4': '0.270', 'weapon4': '0.390', 'weapon2': '0.428', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.574', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:32,189][52669] DAMAGECOUNT value on done: 812695.0 [2024-08-06 07:03:32,189][52669] Sum rewards: 75.806, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.112', 'weapon4': '0.114', 'weapon2': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:32,554][52666] DAMAGECOUNT value on done: 816165.0 [2024-08-06 07:03:32,555][52666] Sum rewards: 75.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon2': '0.196', 'weapon5': '0.216', 'AMMO3': '0.249', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 602652672. Throughput: 0: 4369.3. Samples: 150663450. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:32,795][52567] Avg episode reward: [(0, '74.188')] [2024-08-06 07:03:34,037][52665] DAMAGECOUNT value on done: 808788.0 [2024-08-06 07:03:34,039][52665] Sum rewards: 78.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.760', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.171', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:34,078][52663] DAMAGECOUNT value on done: 810646.0 [2024-08-06 07:03:34,080][52663] Sum rewards: 69.300, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.849', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.078', 'weapon5': '0.154', 'AMMO4': '0.158', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:34,157][52658] DAMAGECOUNT value on done: 819290.0 [2024-08-06 07:03:34,157][52658] Sum rewards: 69.821, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.339', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.392', 'WEAPON3': '1.600', 'weapon3': '2.964', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:34,199][52670] DAMAGECOUNT value on done: 818301.0 [2024-08-06 07:03:34,199][52670] Sum rewards: 70.927, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.943', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.106', 'weapon5': '0.142', 'AMMO4': '0.165', 'weapon2': '0.224', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:34,697][52669] DAMAGECOUNT value on done: 814015.0 [2024-08-06 07:03:34,697][52669] Sum rewards: 71.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.793', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.132', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:34,875][52650] Updated weights for policy 0, policy_version 73571 (0.0032) [2024-08-06 07:03:35,120][52671] DAMAGECOUNT value on done: 817372.0 [2024-08-06 07:03:35,121][52671] Sum rewards: 65.920, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.021', 'AMMO2': '0.082', 'weapon4': '0.228', 'weapon5': '0.252', 'AMMO3': '0.284', 'weapon2': '0.322', 'AMMO4': '0.412', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.868', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:35,768][52666] DAMAGECOUNT value on done: 813143.0 [2024-08-06 07:03:35,770][52666] Sum rewards: 72.520, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.062', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO4': '0.189', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:36,856][52663] DAMAGECOUNT value on done: 809960.0 [2024-08-06 07:03:36,856][52663] Sum rewards: 84.568, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.161', 'AMMO4': '0.168', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.556', 'WEAPON3': '0.950', 'weapon3': '2.784', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:37,048][52665] DAMAGECOUNT value on done: 802519.0 [2024-08-06 07:03:37,048][52665] Sum rewards: 63.266, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.068', 'AMMO4': '0.204', 'weapon5': '0.226', 'AMMO3': '0.260', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.204', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '54.000'} [2024-08-06 07:03:37,371][52670] DAMAGECOUNT value on done: 807537.0 [2024-08-06 07:03:37,372][52670] Sum rewards: 80.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.398', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.168', 'weapon4': '0.178', 'AMMO3': '0.179', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.272', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:37,446][52669] DAMAGECOUNT value on done: 819162.0 [2024-08-06 07:03:37,447][52669] Sum rewards: 68.615, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.595', 'AMMO5': '0.020', 'AMMO2': '0.072', 'AMMO3': '0.140', 'weapon5': '0.190', 'weapon2': '0.294', 'AMMO4': '0.362', 'WEAPON5': '0.550', 'weapon4': '0.558', 'WEAPON4': '0.650', 'WEAPON3': '0.900', 'weapon3': '2.724', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 602742784. Throughput: 0: 4368.2. Samples: 150689790. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:37,794][52567] Avg episode reward: [(0, '74.169')] [2024-08-06 07:03:37,960][52671] DAMAGECOUNT value on done: 825835.0 [2024-08-06 07:03:37,962][52671] Sum rewards: 78.955, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.184', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '66.000'} [2024-08-06 07:03:38,797][52666] DAMAGECOUNT value on done: 806480.0 [2024-08-06 07:03:38,797][52666] Sum rewards: 70.619, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.136', 'AMMO4': '0.172', 'weapon2': '0.188', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.304', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:39,311][52650] Updated weights for policy 0, policy_version 73581 (0.0012) [2024-08-06 07:03:39,421][52663] DAMAGECOUNT value on done: 819562.0 [2024-08-06 07:03:39,422][52663] Sum rewards: 59.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'weapon4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.240', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.336', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '49.000'} [2024-08-06 07:03:40,121][52669] DAMAGECOUNT value on done: 841764.0 [2024-08-06 07:03:40,122][52669] Sum rewards: 80.017, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.765', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.102', 'AMMO4': '0.105', 'weapon5': '0.136', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '69.000'} [2024-08-06 07:03:40,145][52665] DAMAGECOUNT value on done: 809419.0 [2024-08-06 07:03:40,146][52665] Sum rewards: 72.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.502', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.124', 'AMMO4': '0.199', 'weapon4': '0.204', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:40,324][52670] DAMAGECOUNT value on done: 804092.0 [2024-08-06 07:03:40,326][52670] Sum rewards: 75.369, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.943', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.056', 'AMMO4': '0.199', 'weapon2': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.500', 'weapon3': '2.988', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:41,036][52671] DAMAGECOUNT value on done: 820676.0 [2024-08-06 07:03:41,036][52671] Sum rewards: 68.434, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.045', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.426', 'weapon4': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:41,456][52666] DAMAGECOUNT value on done: 813268.0 [2024-08-06 07:03:41,458][52666] Sum rewards: 66.414, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.302', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon4': '0.222', 'weapon2': '0.722', 'WEAPON3': '1.350', 'weapon3': '2.728', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '56.000'} [2024-08-06 07:03:42,068][52663] DAMAGECOUNT value on done: 814026.0 [2024-08-06 07:03:42,069][52663] Sum rewards: 68.954, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.011', 'AMMO5': '0.021', 'AMMO2': '0.073', 'weapon5': '0.248', 'AMMO3': '0.255', 'weapon4': '0.320', 'weapon2': '0.340', 'AMMO4': '0.365', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.694', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '59.000'} [2024-08-06 07:03:42,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 602832896. Throughput: 0: 4369.8. Samples: 150715990. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:42,794][52567] Avg episode reward: [(0, '73.702')] [2024-08-06 07:03:43,074][52670] DAMAGECOUNT value on done: 807712.0 [2024-08-06 07:03:43,075][52670] Sum rewards: 75.892, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.495', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon2': '0.188', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.558', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '66.000'} [2024-08-06 07:03:43,145][52669] DAMAGECOUNT value on done: 826658.0 [2024-08-06 07:03:43,148][52669] Sum rewards: 75.938, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.174', 'AMMO3': '0.231', 'weapon2': '0.262', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:43,402][52665] DAMAGECOUNT value on done: 808999.0 [2024-08-06 07:03:43,402][52665] Sum rewards: 68.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:44,061][52671] DAMAGECOUNT value on done: 807773.0 [2024-08-06 07:03:44,062][52671] Sum rewards: 70.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.128', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.126', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:44,163][52650] Updated weights for policy 0, policy_version 73591 (0.0012) [2024-08-06 07:03:44,208][52666] DAMAGECOUNT value on done: 809406.0 [2024-08-06 07:03:44,208][52666] Sum rewards: 79.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.345', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.154', 'weapon5': '0.158', 'AMMO3': '0.160', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.140', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:45,209][52663] DAMAGECOUNT value on done: 819825.0 [2024-08-06 07:03:45,211][52663] Sum rewards: 76.704, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.414', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.030', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.184', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.372', 'WEAPON3': '1.700', 'weapon3': '3.170', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '64.500'} [2024-08-06 07:03:45,284][52614] Signal inference workers to stop experience collection... (13450 times) [2024-08-06 07:03:45,285][52614] Signal inference workers to resume experience collection... (13450 times) [2024-08-06 07:03:45,359][52650] InferenceWorker_p0-w0: stopping experience collection (13450 times) [2024-08-06 07:03:45,373][52650] InferenceWorker_p0-w0: resuming experience collection (13450 times) [2024-08-06 07:03:45,845][52670] DAMAGECOUNT value on done: 808253.0 [2024-08-06 07:03:45,845][52670] Sum rewards: 75.684, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.795', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '62.000'} [2024-08-06 07:03:46,213][52669] DAMAGECOUNT value on done: 823873.0 [2024-08-06 07:03:46,214][52669] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.802', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'weapon4': '0.110', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon2': '0.872', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:46,296][52665] DAMAGECOUNT value on done: 801509.0 [2024-08-06 07:03:46,298][52665] Sum rewards: 77.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.645', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.160', 'AMMO4': '0.176', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '64.000'} [2024-08-06 07:03:46,485][52671] DAMAGECOUNT value on done: 831248.0 [2024-08-06 07:03:46,489][52671] Sum rewards: 88.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.285', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.040', 'weapon5': '0.134', 'AMMO4': '0.187', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.421', 'FRAGCOUNT': '72.000'} [2024-08-06 07:03:47,045][52666] DAMAGECOUNT value on done: 804243.0 [2024-08-06 07:03:47,045][52666] Sum rewards: 63.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.116', 'AMMO3': '0.199', 'AMMO4': '0.261', 'weapon5': '0.328', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '2.802', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '51.000'} [2024-08-06 07:03:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 602914816. Throughput: 0: 4367.3. Samples: 150728920. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:47,804][52567] Avg episode reward: [(0, '73.917')] [2024-08-06 07:03:48,387][52663] DAMAGECOUNT value on done: 824047.0 [2024-08-06 07:03:48,388][52663] Sum rewards: 75.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.082', 'AMMO4': '0.153', 'weapon5': '0.182', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:48,529][52670] DAMAGECOUNT value on done: 802985.0 [2024-08-06 07:03:48,531][52670] Sum rewards: 74.967, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.215', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.090', 'AMMO3': '0.152', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.268', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.182', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '61.000'} [2024-08-06 07:03:48,675][52650] Updated weights for policy 0, policy_version 73601 (0.0011) [2024-08-06 07:03:49,316][52671] DAMAGECOUNT value on done: 826556.0 [2024-08-06 07:03:49,316][52671] Sum rewards: 71.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.151', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:49,365][52668] DAMAGECOUNT value on done: 823221.0 [2024-08-06 07:03:49,367][52668] Sum rewards: 86.875, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.162', 'FRAGCOUNT': '71.000'} [2024-08-06 07:03:49,403][52669] DAMAGECOUNT value on done: 827210.0 [2024-08-06 07:03:49,403][52669] Sum rewards: 68.852, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'weapon4': '0.090', 'AMMO3': '0.173', 'weapon5': '0.178', 'AMMO4': '0.191', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:49,440][52665] DAMAGECOUNT value on done: 805932.0 [2024-08-06 07:03:49,442][52665] Sum rewards: 75.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.162', 'weapon2': '0.166', 'AMMO4': '0.174', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:49,786][52666] DAMAGECOUNT value on done: 813387.0 [2024-08-06 07:03:49,787][52666] Sum rewards: 77.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.181', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.166', 'AMMO4': '0.209', 'weapon5': '0.284', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.654', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '62.000'} [2024-08-06 07:03:49,790][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:03:50,029][52820] Large shaping reward 2.727 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.585, 195.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 07:03:50,988][52670] DAMAGECOUNT value on done: 814215.0 [2024-08-06 07:03:50,990][52670] Sum rewards: 72.271, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.776', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:51,643][52663] DAMAGECOUNT value on done: 808226.0 [2024-08-06 07:03:51,643][52663] Sum rewards: 59.490, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.034', 'AMMO2': '0.005', 'weapon4': '0.022', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'AMMO3': '0.291', 'weapon2': '0.302', 'WEAPON3': '1.750', 'HITCOUNT': '3.080', 'weapon3': '3.440', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '55.000'} [2024-08-06 07:03:52,311][52671] DAMAGECOUNT value on done: 822733.0 [2024-08-06 07:03:52,312][52671] Sum rewards: 64.502, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.580', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.112', 'AMMO3': '0.159', 'AMMO4': '0.162', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.868', 'WEAPON3': '1.050', 'weapon3': '2.660', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '50.000'} [2024-08-06 07:03:52,496][52668] DAMAGECOUNT value on done: 823256.0 [2024-08-06 07:03:52,497][52668] Sum rewards: 71.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.472', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.084', 'AMMO3': '0.172', 'weapon5': '0.172', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.050', 'HITCOUNT': '2.820', 'weapon3': '3.156', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:52,499][52669] DAMAGECOUNT value on done: 830287.0 [2024-08-06 07:03:52,500][52669] Sum rewards: 73.490, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.208', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.110', 'weapon4': '0.142', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.174', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:52,547][52666] DAMAGECOUNT value on done: 806911.0 [2024-08-06 07:03:52,547][52666] Sum rewards: 77.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.506', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'WEAPON3': '1.650', 'weapon3': '3.486', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '66.000'} [2024-08-06 07:03:52,558][52665] DAMAGECOUNT value on done: 810351.0 [2024-08-06 07:03:52,558][52665] Sum rewards: 75.727, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.696', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon2': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon4': '0.356', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '65.000'} [2024-08-06 07:03:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 603004928. Throughput: 0: 4371.3. Samples: 150755200. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:03:52,794][52567] Avg episode reward: [(0, '73.722')] [2024-08-06 07:03:53,375][52650] Updated weights for policy 0, policy_version 73611 (0.0039) [2024-08-06 07:03:54,295][52670] DAMAGECOUNT value on done: 798333.0 [2024-08-06 07:03:54,296][52670] Sum rewards: 71.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.105', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.096', 'AMMO4': '0.121', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '58.000'} [2024-08-06 07:03:54,948][52671] DAMAGECOUNT value on done: 826091.0 [2024-08-06 07:03:54,950][52671] Sum rewards: 69.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.094', 'weapon4': '0.152', 'AMMO4': '0.178', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '57.000'} [2024-08-06 07:03:55,549][52668] DAMAGECOUNT value on done: 819767.0 [2024-08-06 07:03:55,550][52668] Sum rewards: 75.165, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.384', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.166', 'AMMO4': '0.174', 'weapon2': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '63.000'} [2024-08-06 07:03:55,862][52666] DAMAGECOUNT value on done: 814339.0 [2024-08-06 07:03:55,865][52666] Sum rewards: 79.876, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.278', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.120', 'weapon5': '0.182', 'AMMO4': '0.207', 'AMMO3': '0.252', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '67.000'} [2024-08-06 07:03:57,445][52670] DAMAGECOUNT value on done: 812271.0 [2024-08-06 07:03:57,445][52670] Sum rewards: 95.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.571', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.406', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '4.390', 'DAMAGECOUNT': '22.776', 'FRAGCOUNT': '78.000'} [2024-08-06 07:03:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 603095040. Throughput: 0: 4370.4. Samples: 150781430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:03:57,794][52567] Avg episode reward: [(0, '73.917')] [2024-08-06 07:03:58,065][52671] DAMAGECOUNT value on done: 812853.0 [2024-08-06 07:03:58,065][52671] Sum rewards: 73.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon4': '0.214', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '60.000'} [2024-08-06 07:03:58,250][52650] Updated weights for policy 0, policy_version 73621 (0.0030) [2024-08-06 07:03:58,301][52668] DAMAGECOUNT value on done: 825287.0 [2024-08-06 07:03:58,301][52668] Sum rewards: 84.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '70.000'} [2024-08-06 07:03:58,774][52666] DAMAGECOUNT value on done: 800709.0 [2024-08-06 07:03:58,776][52666] Sum rewards: 76.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.408', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon4': '0.172', 'weapon5': '0.218', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '2.952', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:00,390][52670] DAMAGECOUNT value on done: 816619.0 [2024-08-06 07:04:00,390][52670] Sum rewards: 68.178, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.000', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'weapon2': '0.180', 'AMMO3': '0.183', 'WEAPON3': '1.150', 'HITCOUNT': '3.110', 'weapon3': '3.434', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '55.000'} [2024-08-06 07:04:01,468][52666] DAMAGECOUNT value on done: 816901.0 [2024-08-06 07:04:01,469][52666] Sum rewards: 79.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.288', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'weapon4': '0.226', 'AMMO3': '0.263', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:01,623][52668] DAMAGECOUNT value on done: 809845.0 [2024-08-06 07:04:01,624][52668] Sum rewards: 71.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.905', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.094', 'AMMO4': '0.195', 'weapon5': '0.238', 'AMMO3': '0.261', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '60.000'} [2024-08-06 07:04:02,749][52650] Updated weights for policy 0, policy_version 73631 (0.0037) [2024-08-06 07:04:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 603185152. Throughput: 0: 4375.3. Samples: 150794660. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:02,794][52567] Avg episode reward: [(0, '73.744')] [2024-08-06 07:04:02,982][52670] DAMAGECOUNT value on done: 812867.0 [2024-08-06 07:04:02,983][52670] Sum rewards: 64.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.356', 'AMMO5': '0.014', 'AMMO2': '0.076', 'weapon2': '0.200', 'weapon5': '0.230', 'AMMO3': '0.247', 'AMMO4': '0.382', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon4': '0.698', 'WEAPON3': '1.500', 'weapon3': '2.592', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '53.000'} [2024-08-06 07:04:04,193][52668] DAMAGECOUNT value on done: 821861.0 [2024-08-06 07:04:04,193][52668] Sum rewards: 73.213, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.846', 'AMMO5': '0.027', 'AMMO2': '0.056', 'AMMO3': '0.166', 'weapon5': '0.220', 'AMMO4': '0.281', 'weapon4': '0.312', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '59.000'} [2024-08-06 07:04:04,241][52666] DAMAGECOUNT value on done: 813012.0 [2024-08-06 07:04:04,243][52666] Sum rewards: 81.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.492', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:05,624][52670] DAMAGECOUNT value on done: 793513.0 [2024-08-06 07:04:05,624][52670] Sum rewards: 73.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.076', 'AMMO4': '0.199', 'AMMO3': '0.221', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '61.000'} [2024-08-06 07:04:07,007][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:04:07,120][52662] DAMAGECOUNT value on done: 817066.0 [2024-08-06 07:04:07,120][52662] Sum rewards: 71.443, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.822', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.042', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.209', 'weapon4': '0.216', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '59.000'} [2024-08-06 07:04:07,148][52668] DAMAGECOUNT value on done: 820680.0 [2024-08-06 07:04:07,149][52668] Sum rewards: 78.123, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.494', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.014', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.290', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '64.000'} [2024-08-06 07:04:07,205][52666] DAMAGECOUNT value on done: 811945.0 [2024-08-06 07:04:07,209][52666] Sum rewards: 81.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.057', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.158', 'weapon5': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:07,664][52650] Updated weights for policy 0, policy_version 73641 (0.0012) [2024-08-06 07:04:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 603267072. Throughput: 0: 4377.6. Samples: 150821010. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:07,794][52567] Avg episode reward: [(0, '73.868')] [2024-08-06 07:04:08,871][52670] DAMAGECOUNT value on done: 808922.0 [2024-08-06 07:04:08,871][52670] Sum rewards: 86.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.330', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.165', 'weapon4': '0.184', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.801', 'FRAGCOUNT': '71.000'} [2024-08-06 07:04:09,704][52662] DAMAGECOUNT value on done: 829011.0 [2024-08-06 07:04:09,704][52662] Sum rewards: 77.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.158', 'weapon2': '0.204', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '62.000'} [2024-08-06 07:04:10,022][52668] DAMAGECOUNT value on done: 812408.0 [2024-08-06 07:04:10,023][52668] Sum rewards: 77.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon4': '0.022', 'weapon5': '0.038', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.590', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:10,353][52666] DAMAGECOUNT value on done: 806269.0 [2024-08-06 07:04:10,357][52666] Sum rewards: 61.330, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.051', 'AMMO4': '-0.024', 'AMMO2': '-0.005', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO3': '0.157', 'weapon2': '0.688', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '49.000'} [2024-08-06 07:04:12,027][52670] DAMAGECOUNT value on done: 817258.0 [2024-08-06 07:04:12,028][52670] Sum rewards: 77.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon4': '0.078', 'AMMO4': '0.147', 'weapon5': '0.162', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '61.500'} [2024-08-06 07:04:12,265][52650] Updated weights for policy 0, policy_version 73651 (0.0026) [2024-08-06 07:04:12,370][52668] DAMAGECOUNT value on done: 815142.0 [2024-08-06 07:04:12,372][52668] Sum rewards: 79.414, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.334', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.106', 'weapon4': '0.108', 'AMMO4': '0.183', 'AMMO3': '0.259', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17467.1). Total num frames: 603348992. Throughput: 0: 4378.4. Samples: 150847370. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:12,794][52567] Avg episode reward: [(0, '74.036')] [2024-08-06 07:04:12,829][52662] DAMAGECOUNT value on done: 827851.0 [2024-08-06 07:04:12,829][52662] Sum rewards: 80.406, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.774', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.122', 'AMMO3': '0.144', 'weapon5': '0.176', 'AMMO4': '0.219', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '3.168', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:13,575][52666] DAMAGECOUNT value on done: 805817.0 [2024-08-06 07:04:13,578][52666] Sum rewards: 74.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.582', 'AMMO5': '0.018', 'AMMO2': '0.059', 'AMMO3': '0.185', 'weapon5': '0.286', 'AMMO4': '0.295', 'weapon4': '0.324', 'weapon2': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '58.000'} [2024-08-06 07:04:15,144][52668] DAMAGECOUNT value on done: 822098.0 [2024-08-06 07:04:15,152][52668] Sum rewards: 80.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.827', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.064', 'AMMO4': '0.158', 'weapon5': '0.160', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.648', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '66.000'} [2024-08-06 07:04:15,280][52670] DAMAGECOUNT value on done: 810894.0 [2024-08-06 07:04:15,280][52670] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.140', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.175', 'weapon5': '0.182', 'AMMO4': '0.207', 'weapon2': '0.234', 'weapon4': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.940', 'weapon3': '3.076', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '54.000'} [2024-08-06 07:04:15,846][52662] DAMAGECOUNT value on done: 812592.0 [2024-08-06 07:04:15,847][52662] Sum rewards: 70.255, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.557', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.126', 'AMMO3': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.202', 'weapon2': '0.210', 'WEAPON3': '0.850', 'HITCOUNT': '3.290', 'weapon3': '3.320', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '55.000'} [2024-08-06 07:04:16,689][52666] DAMAGECOUNT value on done: 822044.0 [2024-08-06 07:04:16,690][52666] Sum rewards: 74.402, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.217', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO4': '0.202', 'weapon5': '0.212', 'weapon2': '0.282', 'AMMO3': '0.301', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.082', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.000'} [2024-08-06 07:04:16,792][52650] Updated weights for policy 0, policy_version 73661 (0.0012) [2024-08-06 07:04:17,613][52668] DAMAGECOUNT value on done: 816554.0 [2024-08-06 07:04:17,613][52668] Sum rewards: 78.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.336', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.188', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 603447296. Throughput: 0: 4379.1. Samples: 150860510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:17,794][52567] Avg episode reward: [(0, '74.147')] [2024-08-06 07:04:17,950][52670] DAMAGECOUNT value on done: 813822.0 [2024-08-06 07:04:17,952][52670] Sum rewards: 69.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.690', 'ARMOR': '0.004', 'AMMO2': '0.017', 'AMMO5': '0.018', 'weapon5': '0.044', 'AMMO4': '0.086', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.462', 'WEAPON3': '1.650', 'weapon3': '3.122', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '60.000'} [2024-08-06 07:04:19,047][52662] DAMAGECOUNT value on done: 830701.0 [2024-08-06 07:04:19,051][52662] Sum rewards: 78.869, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.934', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.276', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.310', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:19,337][52666] DAMAGECOUNT value on done: 800001.0 [2024-08-06 07:04:19,339][52666] Sum rewards: 74.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.446', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '61.000'} [2024-08-06 07:04:20,711][52668] DAMAGECOUNT value on done: 811099.0 [2024-08-06 07:04:20,713][52668] Sum rewards: 79.244, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.237', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon4': '0.092', 'AMMO3': '0.225', 'AMMO4': '0.244', 'weapon5': '0.280', 'weapon2': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.535', 'FRAGCOUNT': '64.000'} [2024-08-06 07:04:21,401][52650] Updated weights for policy 0, policy_version 73671 (0.0011) [2024-08-06 07:04:21,567][52670] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:04:22,376][52662] DAMAGECOUNT value on done: 808750.0 [2024-08-06 07:04:22,378][52662] Sum rewards: 67.696, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.127', 'weapon5': '0.160', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '55.000'} [2024-08-06 07:04:22,456][52666] DAMAGECOUNT value on done: 807610.0 [2024-08-06 07:04:22,457][52666] Sum rewards: 67.740, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.075', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.139', 'weapon2': '0.210', 'weapon4': '0.220', 'WEAPON3': '0.950', 'weapon3': '3.298', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '53.000'} [2024-08-06 07:04:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 603529216. Throughput: 0: 4377.8. Samples: 150886790. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:22,794][52567] Avg episode reward: [(0, '73.704')] [2024-08-06 07:04:23,596][52668] DAMAGECOUNT value on done: 807472.0 [2024-08-06 07:04:23,598][52668] Sum rewards: 73.518, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.790', 'AMMO2': '0.005', 'AMMO5': '0.008', 'weapon4': '0.018', 'AMMO4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '61.000'} [2024-08-06 07:04:25,451][52662] DAMAGECOUNT value on done: 817034.0 [2024-08-06 07:04:25,452][52662] Sum rewards: 84.807, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.060', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.150', 'AMMO4': '0.198', 'weapon2': '0.220', 'AMMO3': '0.303', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.236', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '75.000'} [2024-08-06 07:04:26,125][52650] Updated weights for policy 0, policy_version 73681 (0.0026) [2024-08-06 07:04:26,877][52668] DAMAGECOUNT value on done: 807763.0 [2024-08-06 07:04:26,879][52668] Sum rewards: 80.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.166', 'weapon5': '0.194', 'AMMO3': '0.221', 'AMMO4': '0.253', 'weapon2': '0.264', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 603619328. Throughput: 0: 4377.8. Samples: 150912990. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:27,794][52567] Avg episode reward: [(0, '73.958')] [2024-08-06 07:04:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073684_603619328.pth... [2024-08-06 07:04:27,932][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073172_599425024.pth [2024-08-06 07:04:28,305][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:04:28,627][52662] DAMAGECOUNT value on done: 833845.0 [2024-08-06 07:04:28,628][52662] Sum rewards: 77.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.076', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.102', 'weapon2': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon4': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '64.000'} [2024-08-06 07:04:29,725][52668] DAMAGECOUNT value on done: 804263.0 [2024-08-06 07:04:29,727][52668] Sum rewards: 74.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.104', 'weapon5': '0.154', 'AMMO4': '0.205', 'AMMO3': '0.208', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '62.000'} [2024-08-06 07:04:30,867][52650] Updated weights for policy 0, policy_version 73691 (0.0022) [2024-08-06 07:04:31,675][52662] DAMAGECOUNT value on done: 820224.0 [2024-08-06 07:04:31,675][52662] Sum rewards: 70.254, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.358', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.082', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '57.000'} [2024-08-06 07:04:32,304][52668] DAMAGECOUNT value on done: 816042.0 [2024-08-06 07:04:32,305][52668] Sum rewards: 78.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.956', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.166', 'weapon2': '0.168', 'AMMO4': '0.199', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.348', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '64.000'} [2024-08-06 07:04:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 603701248. Throughput: 0: 4378.0. Samples: 150925930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:32,795][52567] Avg episode reward: [(0, '74.081')] [2024-08-06 07:04:32,972][52660] DAMAGECOUNT value on done: 815439.0 [2024-08-06 07:04:32,974][52660] Sum rewards: 60.740, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.351', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.122', 'weapon2': '0.154', 'AMMO3': '0.186', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.212', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '48.000'} [2024-08-06 07:04:34,852][52662] DAMAGECOUNT value on done: 825929.0 [2024-08-06 07:04:34,852][52662] Sum rewards: 64.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.195', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.126', 'AMMO4': '0.150', 'weapon5': '0.184', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.028', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 07:04:35,011][52668] DAMAGECOUNT value on done: 820220.0 [2024-08-06 07:04:35,013][52668] Sum rewards: 71.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.106', 'weapon4': '0.162', 'AMMO4': '0.162', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '59.000'} [2024-08-06 07:04:35,479][52650] Updated weights for policy 0, policy_version 73701 (0.0012) [2024-08-06 07:04:35,652][52660] DAMAGECOUNT value on done: 807696.0 [2024-08-06 07:04:35,660][52660] Sum rewards: 87.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.228', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.096', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '70.000'} [2024-08-06 07:04:37,352][52668] DAMAGECOUNT value on done: 816302.0 [2024-08-06 07:04:37,354][52668] Sum rewards: 83.778, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.144', 'weapon2': '0.206', 'AMMO3': '0.211', 'weapon5': '0.224', 'AMMO4': '0.239', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.586', 'FRAGCOUNT': '68.000'} [2024-08-06 07:04:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 603791360. Throughput: 0: 4379.6. Samples: 150952280. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:04:37,794][52567] Avg episode reward: [(0, '74.330')] [2024-08-06 07:04:37,910][52662] DAMAGECOUNT value on done: 816384.0 [2024-08-06 07:04:37,911][52662] Sum rewards: 80.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.774', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.138', 'weapon4': '0.154', 'AMMO4': '0.199', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '69.000'} [2024-08-06 07:04:38,192][52660] DAMAGECOUNT value on done: 820140.0 [2024-08-06 07:04:38,195][52660] Sum rewards: 60.894, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.674', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO4': '0.240', 'weapon4': '0.250', 'AMMO3': '0.266', 'weapon5': '0.280', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.750', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '54.000'} [2024-08-06 07:04:39,302][52667] DAMAGECOUNT value on done: 818230.0 [2024-08-06 07:04:39,302][52667] Sum rewards: 84.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.603', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.190', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.248', 'weapon4': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:40,270][52650] Updated weights for policy 0, policy_version 73711 (0.0012) [2024-08-06 07:04:40,458][52668] DAMAGECOUNT value on done: 823029.0 [2024-08-06 07:04:40,458][52668] Sum rewards: 79.226, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.216', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.294', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '64.000'} [2024-08-06 07:04:41,018][52662] DAMAGECOUNT value on done: 819829.0 [2024-08-06 07:04:41,018][52662] Sum rewards: 82.224, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.168', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.310', 'WEAPON3': '1.700', 'weapon3': '3.290', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '73.000'} [2024-08-06 07:04:41,133][52660] DAMAGECOUNT value on done: 831185.0 [2024-08-06 07:04:41,134][52660] Sum rewards: 71.536, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.055', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.118', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.668', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '59.500'} [2024-08-06 07:04:42,096][52667] DAMAGECOUNT value on done: 827714.0 [2024-08-06 07:04:42,098][52667] Sum rewards: 82.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.307', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.026', 'weapon5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.408', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '70.000'} [2024-08-06 07:04:42,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 603881472. Throughput: 0: 4383.1. Samples: 150978670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:04:42,794][52567] Avg episode reward: [(0, '74.450')] [2024-08-06 07:04:43,025][52668] DAMAGECOUNT value on done: 821673.0 [2024-08-06 07:04:43,025][52668] Sum rewards: 85.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.317', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.129', 'weapon4': '0.138', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.309', 'FRAGCOUNT': '69.000'} [2024-08-06 07:04:43,152][52664] DAMAGECOUNT value on done: 847392.0 [2024-08-06 07:04:43,154][52664] Sum rewards: 83.952, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.624', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.140', 'weapon5': '0.178', 'AMMO3': '0.202', 'AMMO4': '0.215', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '69.000'} [2024-08-06 07:04:43,730][52660] DAMAGECOUNT value on done: 812692.0 [2024-08-06 07:04:43,731][52660] Sum rewards: 77.865, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.279', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.126', 'weapon4': '0.136', 'AMMO4': '0.163', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '62.000'} [2024-08-06 07:04:43,984][52662] DAMAGECOUNT value on done: 811497.0 [2024-08-06 07:04:43,985][52662] Sum rewards: 76.013, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.802', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.062', 'weapon5': '0.080', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:44,828][52650] Updated weights for policy 0, policy_version 73721 (0.0025) [2024-08-06 07:04:44,861][52647] DAMAGECOUNT value on done: 873151.0 [2024-08-06 07:04:44,862][52647] Sum rewards: 85.078, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.150', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.108', 'AMMO3': '0.119', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon4': '0.460', 'weapon2': '0.462', 'WEAPON3': '0.900', 'weapon3': '2.752', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:45,055][52667] DAMAGECOUNT value on done: 822929.0 [2024-08-06 07:04:45,057][52667] Sum rewards: 74.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.133', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.500', 'weapon3': '2.832', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:45,497][52664] DAMAGECOUNT value on done: 851755.0 [2024-08-06 07:04:45,498][52664] Sum rewards: 74.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.056', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '61.000'} [2024-08-06 07:04:45,689][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:04:47,122][52662] DAMAGECOUNT value on done: 824252.0 [2024-08-06 07:04:47,122][52662] Sum rewards: 75.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.680', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO4': '0.155', 'AMMO3': '0.196', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 07:04:47,135][52660] DAMAGECOUNT value on done: 809694.0 [2024-08-06 07:04:47,135][52660] Sum rewards: 80.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.116', 'weapon5': '0.126', 'AMMO4': '0.133', 'weapon2': '0.166', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.382', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '68.000'} [2024-08-06 07:04:47,158][52647] DAMAGECOUNT value on done: 859914.0 [2024-08-06 07:04:47,158][52647] Sum rewards: 71.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.399', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.136', 'AMMO4': '0.163', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '57.000'} [2024-08-06 07:04:47,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 603971584. Throughput: 0: 4382.9. Samples: 150991890. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:04:47,795][52567] Avg episode reward: [(0, '75.135')] [2024-08-06 07:04:48,020][52664] DAMAGECOUNT value on done: 852180.0 [2024-08-06 07:04:48,023][52664] Sum rewards: 76.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.340', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.138', 'AMMO4': '0.183', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.600', 'weapon3': '2.994', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '65.000'} [2024-08-06 07:04:48,091][52667] DAMAGECOUNT value on done: 829017.0 [2024-08-06 07:04:48,092][52667] Sum rewards: 80.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.775', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.174', 'AMMO4': '0.176', 'AMMO3': '0.201', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.308', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '65.000'} [2024-08-06 07:04:49,480][52650] Updated weights for policy 0, policy_version 73731 (0.0039) [2024-08-06 07:04:49,674][52647] DAMAGECOUNT value on done: 868142.0 [2024-08-06 07:04:49,676][52647] Sum rewards: 83.164, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.882', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.114', 'weapon5': '0.122', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.508', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:49,856][52662] DAMAGECOUNT value on done: 812123.0 [2024-08-06 07:04:49,859][52662] Sum rewards: 75.408, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.348', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:50,187][52660] DAMAGECOUNT value on done: 817046.0 [2024-08-06 07:04:50,187][52660] Sum rewards: 76.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.172', 'weapon4': '0.184', 'AMMO4': '0.199', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.668', 'WEAPON3': '1.400', 'weapon3': '2.648', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '65.000'} [2024-08-06 07:04:50,710][52664] DAMAGECOUNT value on done: 845394.0 [2024-08-06 07:04:50,713][52664] Sum rewards: 81.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.834', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.117', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '68.000'} [2024-08-06 07:04:50,895][52667] DAMAGECOUNT value on done: 830953.0 [2024-08-06 07:04:50,895][52667] Sum rewards: 70.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'ARMOR': '0.004', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '59.000'} [2024-08-06 07:04:52,540][52662] DAMAGECOUNT value on done: 829139.0 [2024-08-06 07:04:52,548][52662] Sum rewards: 82.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.426', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.284', 'WEAPON3': '1.000', 'weapon3': '3.454', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '66.000'} [2024-08-06 07:04:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 604061696. Throughput: 0: 4384.2. Samples: 151018300. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:04:52,794][52567] Avg episode reward: [(0, '75.684')] [2024-08-06 07:04:53,080][52647] DAMAGECOUNT value on done: 865659.0 [2024-08-06 07:04:53,080][52647] Sum rewards: 69.809, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.084', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.378', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.340', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '56.000'} [2024-08-06 07:04:53,157][52660] DAMAGECOUNT value on done: 823897.0 [2024-08-06 07:04:53,157][52660] Sum rewards: 82.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.300', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon4': '0.168', 'AMMO3': '0.170', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.000', 'weapon3': '2.878', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '65.500'} [2024-08-06 07:04:53,755][52667] DAMAGECOUNT value on done: 827108.0 [2024-08-06 07:04:53,760][52667] Sum rewards: 64.607, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.555', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.088', 'weapon5': '0.122', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.000', 'HITCOUNT': '3.020', 'weapon3': '3.110', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '51.000'} [2024-08-06 07:04:54,075][52664] DAMAGECOUNT value on done: 856203.0 [2024-08-06 07:04:54,075][52664] Sum rewards: 78.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.090', 'weapon4': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'AMMO3': '0.290', 'weapon2': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.282', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:54,213][52811] DAMAGECOUNT value on done: 779906.0 [2024-08-06 07:04:54,214][52811] Sum rewards: 65.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.306', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.044', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.702', 'WEAPON3': '1.300', 'weapon3': '2.978', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '54.000'} [2024-08-06 07:04:54,274][52650] Updated weights for policy 0, policy_version 73741 (0.0015) [2024-08-06 07:04:55,602][52660] DAMAGECOUNT value on done: 811425.0 [2024-08-06 07:04:55,602][52660] Sum rewards: 79.865, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '65.000'} [2024-08-06 07:04:55,827][52662] DAMAGECOUNT value on done: 821959.0 [2024-08-06 07:04:55,829][52662] Sum rewards: 79.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.715', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.130', 'AMMO3': '0.175', 'weapon5': '0.184', 'AMMO4': '0.191', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.990', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '65.000'} [2024-08-06 07:04:55,945][52647] DAMAGECOUNT value on done: 873202.0 [2024-08-06 07:04:55,945][52647] Sum rewards: 77.143, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.672', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.222', 'weapon4': '0.224', 'AMMO4': '0.245', 'AMMO3': '0.330', 'weapon2': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.850', 'weapon3': '2.792', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '68.000'} [2024-08-06 07:04:56,377][52667] DAMAGECOUNT value on done: 824587.0 [2024-08-06 07:04:56,377][52667] Sum rewards: 71.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.764', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'weapon5': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '58.000'} [2024-08-06 07:04:57,051][52664] DAMAGECOUNT value on done: 850300.0 [2024-08-06 07:04:57,051][52664] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.020', 'AMMO2': '0.038', 'weapon5': '0.140', 'weapon4': '0.152', 'AMMO4': '0.192', 'AMMO3': '0.208', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.160', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '55.000'} [2024-08-06 07:04:57,123][52659] DAMAGECOUNT value on done: 821052.0 [2024-08-06 07:04:57,143][52659] Sum rewards: 74.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.674', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.072', 'weapon5': '0.200', 'AMMO4': '0.294', 'AMMO3': '0.298', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.090', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '66.000'} [2024-08-06 07:04:57,336][52811] DAMAGECOUNT value on done: 762904.0 [2024-08-06 07:04:57,336][52811] Sum rewards: 67.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.087', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '55.000'} [2024-08-06 07:04:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 604143616. Throughput: 0: 4377.3. Samples: 151044350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:04:57,794][52567] Avg episode reward: [(0, '75.524')] [2024-08-06 07:04:58,222][52660] DAMAGECOUNT value on done: 810526.0 [2024-08-06 07:04:58,222][52660] Sum rewards: 74.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.120', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 07:04:58,774][52662] DAMAGECOUNT value on done: 806577.0 [2024-08-06 07:04:58,775][52662] Sum rewards: 68.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.054', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'AMMO4': '0.233', 'weapon2': '0.618', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '58.000'} [2024-08-06 07:04:58,845][52650] Updated weights for policy 0, policy_version 73751 (0.0013) [2024-08-06 07:04:59,028][52647] DAMAGECOUNT value on done: 868970.0 [2024-08-06 07:04:59,029][52647] Sum rewards: 69.672, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.172', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.370', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '55.000'} [2024-08-06 07:04:59,522][52667] DAMAGECOUNT value on done: 819681.0 [2024-08-06 07:04:59,522][52667] Sum rewards: 81.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.100', 'AMMO4': '0.163', 'weapon5': '0.170', 'AMMO3': '0.242', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '67.000'} [2024-08-06 07:04:59,635][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:05:00,297][52659] DAMAGECOUNT value on done: 818532.0 [2024-08-06 07:05:00,298][52659] Sum rewards: 73.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'weapon5': '0.006', 'AMMO5': '0.009', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'weapon4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:00,399][52664] DAMAGECOUNT value on done: 845073.0 [2024-08-06 07:05:00,403][52664] Sum rewards: 70.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.116', 'weapon5': '0.130', 'AMMO4': '0.172', 'AMMO3': '0.270', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:00,545][52660] DAMAGECOUNT value on done: 820786.0 [2024-08-06 07:05:00,547][52811] DAMAGECOUNT value on done: 758195.0 [2024-08-06 07:05:00,548][52660] Sum rewards: 74.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.178', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.076', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.208', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:00,549][52811] Sum rewards: 71.933, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.298', 'weapon2': '0.320', 'WEAPON3': '1.750', 'weapon3': '3.378', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:01,969][52662] DAMAGECOUNT value on done: 818054.0 [2024-08-06 07:05:01,969][52662] Sum rewards: 77.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.018', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.072', 'AMMO4': '0.080', 'weapon4': '0.128', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'WEAPON3': '0.950', 'weapon3': '3.442', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '61.000'} [2024-08-06 07:05:02,057][52667] DAMAGECOUNT value on done: 822785.0 [2024-08-06 07:05:02,058][52667] Sum rewards: 64.353, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.607', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.050', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO4': '0.211', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '3.106', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.372', 'FRAGCOUNT': '57.000'} [2024-08-06 07:05:02,442][52647] DAMAGECOUNT value on done: 871602.0 [2024-08-06 07:05:02,442][52647] Sum rewards: 76.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.052', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '62.500'} [2024-08-06 07:05:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 604233728. Throughput: 0: 4370.9. Samples: 151057200. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:05:02,794][52567] Avg episode reward: [(0, '75.583')] [2024-08-06 07:05:03,437][52664] DAMAGECOUNT value on done: 839931.0 [2024-08-06 07:05:03,438][52664] Sum rewards: 71.131, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.233', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.132', 'weapon5': '0.144', 'AMMO4': '0.177', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '58.000'} [2024-08-06 07:05:03,545][52659] DAMAGECOUNT value on done: 824022.0 [2024-08-06 07:05:03,547][52659] Sum rewards: 62.608, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.696', 'AMMO5': '0.024', 'AMMO2': '0.066', 'AMMO3': '0.254', 'AMMO4': '0.332', 'weapon4': '0.358', 'weapon2': '0.400', 'weapon5': '0.420', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.434', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '52.500'} [2024-08-06 07:05:03,691][52650] Updated weights for policy 0, policy_version 73761 (0.0024) [2024-08-06 07:05:03,820][52811] DAMAGECOUNT value on done: 760019.0 [2024-08-06 07:05:03,823][52811] Sum rewards: 71.847, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.568', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.180', 'weapon2': '0.232', 'weapon5': '0.272', 'AMMO3': '0.288', 'AMMO4': '0.313', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.800', 'weapon3': '2.976', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '61.500'} [2024-08-06 07:05:03,874][52660] DAMAGECOUNT value on done: 810569.0 [2024-08-06 07:05:03,875][52660] Sum rewards: 63.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.102', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.110', 'AMMO4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.682', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '53.000'} [2024-08-06 07:05:04,929][52647] DAMAGECOUNT value on done: 850441.0 [2024-08-06 07:05:04,930][52647] Sum rewards: 82.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon4': '0.172', 'weapon2': '0.224', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '68.000'} [2024-08-06 07:05:04,980][52662] DAMAGECOUNT value on done: 809286.0 [2024-08-06 07:05:04,980][52662] Sum rewards: 79.235, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.845', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.126', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.600', 'weapon3': '3.026', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '69.000'} [2024-08-06 07:05:05,504][52667] DAMAGECOUNT value on done: 827318.0 [2024-08-06 07:05:05,506][52667] Sum rewards: 63.845, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.076', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.148', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.202', 'AMMO3': '0.265', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '55.000'} [2024-08-06 07:05:05,778][52664] DAMAGECOUNT value on done: 854033.0 [2024-08-06 07:05:05,779][52664] Sum rewards: 69.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.264', 'AMMO5': '0.015', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.362', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '2.694', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:06,604][52659] DAMAGECOUNT value on done: 820811.0 [2024-08-06 07:05:06,605][52659] Sum rewards: 73.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.953', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.088', 'AMMO3': '0.179', 'AMMO4': '0.189', 'weapon5': '0.196', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '59.000'} [2024-08-06 07:05:06,935][52660] DAMAGECOUNT value on done: 815670.0 [2024-08-06 07:05:06,936][52660] Sum rewards: 81.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.026', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.188', 'weapon4': '0.222', 'weapon2': '0.252', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '66.000'} [2024-08-06 07:05:07,007][52811] DAMAGECOUNT value on done: 764767.0 [2024-08-06 07:05:07,018][52811] Sum rewards: 85.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.455', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.184', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '70.000'} [2024-08-06 07:05:07,425][52647] DAMAGECOUNT value on done: 865983.0 [2024-08-06 07:05:07,426][52647] Sum rewards: 71.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.295', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon4': '0.100', 'AMMO3': '0.178', 'AMMO4': '0.198', 'weapon5': '0.348', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '57.000'} [2024-08-06 07:05:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 604323840. Throughput: 0: 4372.9. Samples: 151083570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:05:07,794][52567] Avg episode reward: [(0, '75.125')] [2024-08-06 07:05:07,965][52650] Updated weights for policy 0, policy_version 73771 (0.0031) [2024-08-06 07:05:08,238][52667] DAMAGECOUNT value on done: 817808.0 [2024-08-06 07:05:08,240][52667] Sum rewards: 71.267, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.027', 'HEALTH': '0.033', 'weapon4': '0.066', 'AMMO4': '0.136', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.388', 'WEAPON3': '0.950', 'HITCOUNT': '3.100', 'weapon3': '3.250', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '56.000'} [2024-08-06 07:05:08,685][52659] Large shaping reward -2.521 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 07:05:08,836][52664] DAMAGECOUNT value on done: 846666.0 [2024-08-06 07:05:08,839][52664] Sum rewards: 73.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.909', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.172', 'AMMO4': '0.197', 'AMMO3': '0.211', 'weapon4': '0.244', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:09,609][52659] DAMAGECOUNT value on done: 820028.0 [2024-08-06 07:05:09,612][52659] Sum rewards: 66.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.292', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.074', 'weapon5': '0.228', 'weapon2': '0.252', 'AMMO4': '0.267', 'AMMO3': '0.279', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.154', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '58.000'} [2024-08-06 07:05:10,013][52660] DAMAGECOUNT value on done: 827107.0 [2024-08-06 07:05:10,014][52660] Sum rewards: 77.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.102', 'weapon5': '0.136', 'AMMO3': '0.174', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.662', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:10,131][52811] DAMAGECOUNT value on done: 776858.0 [2024-08-06 07:05:10,132][52811] Sum rewards: 77.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.086', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:10,235][52647] DAMAGECOUNT value on done: 864304.0 [2024-08-06 07:05:10,236][52647] Sum rewards: 71.297, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.928', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.174', 'weapon5': '0.218', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '62.500'} [2024-08-06 07:05:11,355][52667] DAMAGECOUNT value on done: 820997.0 [2024-08-06 07:05:11,355][52667] Sum rewards: 62.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.728', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.034', 'AMMO4': '0.112', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '50.000'} [2024-08-06 07:05:11,497][52664] DAMAGECOUNT value on done: 859188.0 [2024-08-06 07:05:11,497][52664] Sum rewards: 77.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.770', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.180', 'AMMO3': '0.203', 'weapon4': '0.204', 'AMMO4': '0.254', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:11,505][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:05:12,277][52659] DAMAGECOUNT value on done: 819212.0 [2024-08-06 07:05:12,278][52659] Sum rewards: 70.514, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.964', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.178', 'weapon4': '0.184', 'AMMO4': '0.211', 'AMMO3': '0.225', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 604405760. Throughput: 0: 4373.8. Samples: 151109810. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:05:12,794][52567] Avg episode reward: [(0, '74.840')] [2024-08-06 07:05:13,089][52647] DAMAGECOUNT value on done: 863519.0 [2024-08-06 07:05:13,095][52647] Sum rewards: 77.260, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.280', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.114', 'AMMO4': '0.152', 'weapon5': '0.206', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.650', 'weapon3': '2.994', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '66.000'} [2024-08-06 07:05:13,110][52650] Updated weights for policy 0, policy_version 73781 (0.0014) [2024-08-06 07:05:13,154][52660] DAMAGECOUNT value on done: 835914.0 [2024-08-06 07:05:13,155][52660] Sum rewards: 70.709, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.086', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.136', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.248', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:13,376][52811] DAMAGECOUNT value on done: 770303.0 [2024-08-06 07:05:13,378][52811] Sum rewards: 76.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.100', 'AMMO4': '0.143', 'AMMO3': '0.195', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:14,219][52664] DAMAGECOUNT value on done: 855017.0 [2024-08-06 07:05:14,219][52664] Sum rewards: 61.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.015', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO3': '0.197', 'AMMO4': '0.228', 'weapon4': '0.230', 'weapon5': '0.238', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '52.000'} [2024-08-06 07:05:14,335][52667] DAMAGECOUNT value on done: 829175.0 [2024-08-06 07:05:14,335][52667] Sum rewards: 77.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO3': '0.184', 'AMMO4': '0.196', 'weapon4': '0.224', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '2.898', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:14,901][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:05:15,216][52659] DAMAGECOUNT value on done: 820679.0 [2024-08-06 07:05:15,216][52659] Sum rewards: 70.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.475', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.036', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.262', 'weapon2': '0.636', 'WEAPON3': '1.600', 'weapon3': '3.042', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '59.000'} [2024-08-06 07:05:15,855][52647] DAMAGECOUNT value on done: 852691.0 [2024-08-06 07:05:15,855][52647] Sum rewards: 73.231, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.156', 'weapon2': '0.444', 'WEAPON3': '0.950', 'weapon3': '3.104', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '59.000'} [2024-08-06 07:05:16,389][52660] DAMAGECOUNT value on done: 815636.0 [2024-08-06 07:05:16,389][52660] Sum rewards: 76.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.385', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.162', 'AMMO3': '0.179', 'AMMO4': '0.234', 'weapon2': '0.426', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:16,631][52811] DAMAGECOUNT value on done: 761644.0 [2024-08-06 07:05:16,631][52811] Sum rewards: 69.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.668', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '58.000'} [2024-08-06 07:05:16,678][52667] DAMAGECOUNT value on done: 818274.0 [2024-08-06 07:05:16,679][52667] Sum rewards: 78.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.090', 'weapon4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.246', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 07:05:17,146][52664] DAMAGECOUNT value on done: 854702.0 [2024-08-06 07:05:17,146][52664] Sum rewards: 72.304, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.025', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.128', 'AMMO4': '0.196', 'weapon5': '0.206', 'AMMO3': '0.272', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.078', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:17,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 604487680. Throughput: 0: 4376.2. Samples: 151122860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:05:17,794][52567] Avg episode reward: [(0, '74.572')] [2024-08-06 07:05:18,055][52650] Updated weights for policy 0, policy_version 73791 (0.0038) [2024-08-06 07:05:18,265][52659] DAMAGECOUNT value on done: 819961.0 [2024-08-06 07:05:18,266][52659] Sum rewards: 89.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.795', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.086', 'AMMO4': '0.114', 'weapon5': '0.138', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.420', 'FRAGCOUNT': '72.000'} [2024-08-06 07:05:18,815][52647] DAMAGECOUNT value on done: 869934.0 [2024-08-06 07:05:18,815][52647] Sum rewards: 69.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.421', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.146', 'AMMO4': '0.197', 'weapon2': '0.234', 'AMMO3': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.224', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:19,138][52660] DAMAGECOUNT value on done: 820965.0 [2024-08-06 07:05:19,138][52660] Sum rewards: 73.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.164', 'weapon4': '0.196', 'AMMO4': '0.199', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:19,645][52667] DAMAGECOUNT value on done: 824531.0 [2024-08-06 07:05:19,649][52667] Sum rewards: 60.395, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.540', 'AMMO5': '0.020', 'AMMO2': '0.073', 'weapon4': '0.150', 'AMMO3': '0.229', 'weapon5': '0.264', 'AMMO4': '0.364', 'weapon2': '0.466', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '52.000'} [2024-08-06 07:05:19,809][52811] DAMAGECOUNT value on done: 771102.0 [2024-08-06 07:05:19,811][52811] Sum rewards: 76.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.768', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.108', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.478', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:20,322][52664] DAMAGECOUNT value on done: 866338.0 [2024-08-06 07:05:20,322][52664] Sum rewards: 79.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.301', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.450', 'FRAGCOUNT': '63.500'} [2024-08-06 07:05:20,856][52659] DAMAGECOUNT value on done: 821177.0 [2024-08-06 07:05:20,856][52659] Sum rewards: 63.443, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.392', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.070', 'AMMO4': '0.092', 'weapon5': '0.136', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.000', 'HITCOUNT': '3.050', 'weapon3': '3.276', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '51.000'} [2024-08-06 07:05:21,963][52647] DAMAGECOUNT value on done: 856074.0 [2024-08-06 07:05:21,963][52647] Sum rewards: 72.932, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.680', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.070', 'weapon4': '0.120', 'AMMO4': '0.164', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '61.000'} [2024-08-06 07:05:22,120][52660] DAMAGECOUNT value on done: 817511.0 [2024-08-06 07:05:22,122][52660] Sum rewards: 52.534, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.613', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO4': '0.175', 'weapon4': '0.236', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '2.986', 'DAMAGECOUNT': '13.755', 'FRAGCOUNT': '45.000'} [2024-08-06 07:05:22,353][52650] Updated weights for policy 0, policy_version 73801 (0.0019) [2024-08-06 07:05:22,557][52667] DAMAGECOUNT value on done: 829462.0 [2024-08-06 07:05:22,559][52667] Sum rewards: 74.408, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.048', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.184', 'AMMO4': '0.195', 'AMMO3': '0.265', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.154', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 604577792. Throughput: 0: 4368.0. Samples: 151148840. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:05:22,794][52567] Avg episode reward: [(0, '74.225')] [2024-08-06 07:05:22,949][52811] DAMAGECOUNT value on done: 767943.0 [2024-08-06 07:05:22,949][52811] Sum rewards: 83.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.921', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '68.000'} [2024-08-06 07:05:23,485][52664] DAMAGECOUNT value on done: 862483.0 [2024-08-06 07:05:23,486][52664] Sum rewards: 72.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.028', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.296', 'WEAPON3': '1.450', 'HITCOUNT': '3.300', 'weapon3': '3.404', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:23,954][52659] DAMAGECOUNT value on done: 828621.0 [2024-08-06 07:05:23,955][52659] Sum rewards: 73.717, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.808', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.095', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'weapon3': '3.340', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:25,051][52647] DAMAGECOUNT value on done: 865338.0 [2024-08-06 07:05:25,053][52647] Sum rewards: 76.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.833', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.108', 'weapon5': '0.134', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:25,105][52660] DAMAGECOUNT value on done: 810973.0 [2024-08-06 07:05:25,105][52660] Sum rewards: 85.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.542', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'AMMO4': '0.122', 'weapon4': '0.158', 'AMMO3': '0.191', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '71.000'} [2024-08-06 07:05:25,306][52667] DAMAGECOUNT value on done: 829870.0 [2024-08-06 07:05:25,308][52667] Sum rewards: 79.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.856', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.134', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:26,057][52811] DAMAGECOUNT value on done: 770879.0 [2024-08-06 07:05:26,060][52811] Sum rewards: 78.024, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.016', 'HEALTH': '0.023', 'weapon5': '0.048', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.274', 'WEAPON3': '1.000', 'weapon3': '3.546', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:26,335][52664] DAMAGECOUNT value on done: 858554.0 [2024-08-06 07:05:26,338][52664] Sum rewards: 76.522, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.480', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.150', 'weapon2': '0.200', 'weapon5': '0.220', 'AMMO4': '0.223', 'AMMO3': '0.299', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.052', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.619', 'FRAGCOUNT': '67.000'} [2024-08-06 07:05:26,771][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:05:27,062][52650] Updated weights for policy 0, policy_version 73811 (0.0018) [2024-08-06 07:05:27,108][52659] DAMAGECOUNT value on done: 814479.0 [2024-08-06 07:05:27,108][52659] Sum rewards: 74.752, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.464', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.156', 'weapon2': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '3.240', 'weapon3': '3.378', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:27,696][52667] DAMAGECOUNT value on done: 828532.0 [2024-08-06 07:05:27,696][52667] Sum rewards: 67.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.110', 'AMMO3': '0.213', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.000'} [2024-08-06 07:05:27,750][52647] DAMAGECOUNT value on done: 866843.0 [2024-08-06 07:05:27,751][52647] Sum rewards: 72.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.102', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.204', 'WEAPON3': '1.250', 'weapon3': '3.576', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 604667904. Throughput: 0: 4364.9. Samples: 151175090. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:05:27,794][52567] Avg episode reward: [(0, '74.329')] [2024-08-06 07:05:27,911][52660] DAMAGECOUNT value on done: 809300.0 [2024-08-06 07:05:27,913][52660] Sum rewards: 70.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '56.000'} [2024-08-06 07:05:28,986][52664] DAMAGECOUNT value on done: 845324.0 [2024-08-06 07:05:28,987][52664] Sum rewards: 56.686, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.094', 'weapon5': '0.252', 'AMMO4': '0.262', 'AMMO3': '0.264', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '2.994', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '50.000'} [2024-08-06 07:05:29,181][52811] DAMAGECOUNT value on done: 776588.0 [2024-08-06 07:05:29,181][52811] Sum rewards: 77.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.440', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.019', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.462', 'WEAPON3': '1.600', 'weapon3': '3.206', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:30,118][52659] DAMAGECOUNT value on done: 823666.0 [2024-08-06 07:05:30,118][52659] Sum rewards: 72.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.900', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.416', 'WEAPON3': '1.750', 'weapon3': '3.188', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:30,457][52647] DAMAGECOUNT value on done: 854040.0 [2024-08-06 07:05:30,457][52647] Sum rewards: 64.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.294', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.098', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.194', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.622', 'WEAPON3': '1.100', 'weapon3': '2.620', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '53.000'} [2024-08-06 07:05:30,714][52667] DAMAGECOUNT value on done: 824896.0 [2024-08-06 07:05:30,715][52667] Sum rewards: 74.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.765', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO4': '0.199', 'AMMO3': '0.224', 'weapon5': '0.232', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:31,972][52664] DAMAGECOUNT value on done: 850478.0 [2024-08-06 07:05:31,984][52664] Sum rewards: 62.031, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.202', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.042', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.356', 'WEAPON3': '1.500', 'HITCOUNT': '3.320', 'weapon3': '3.390', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '54.000'} [2024-08-06 07:05:32,203][52811] DAMAGECOUNT value on done: 767145.0 [2024-08-06 07:05:32,204][52811] Sum rewards: 65.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.090', 'weapon5': '0.132', 'AMMO4': '0.192', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '3.196', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '57.000'} [2024-08-06 07:05:32,205][52650] Updated weights for policy 0, policy_version 73821 (0.0031) [2024-08-06 07:05:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 604758016. Throughput: 0: 4359.1. Samples: 151188050. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:05:32,795][52567] Avg episode reward: [(0, '73.468')] [2024-08-06 07:05:33,019][52659] DAMAGECOUNT value on done: 818876.0 [2024-08-06 07:05:33,021][52659] Sum rewards: 57.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.175', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.110', 'weapon4': '0.192', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.332', 'DAMAGECOUNT': '13.785', 'FRAGCOUNT': '48.000'} [2024-08-06 07:05:33,490][52647] DAMAGECOUNT value on done: 858315.0 [2024-08-06 07:05:33,491][52647] Sum rewards: 72.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.038', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:33,529][52667] DAMAGECOUNT value on done: 831899.0 [2024-08-06 07:05:33,532][52667] Sum rewards: 71.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '59.000'} [2024-08-06 07:05:35,137][52811] DAMAGECOUNT value on done: 766501.0 [2024-08-06 07:05:35,139][52811] Sum rewards: 81.771, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.191', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.104', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '66.000'} [2024-08-06 07:05:35,280][52664] DAMAGECOUNT value on done: 854155.0 [2024-08-06 07:05:35,280][52664] Sum rewards: 71.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.496', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon4': '0.022', 'AMMO4': '0.059', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.698', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '58.000'} [2024-08-06 07:05:35,512][52794] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:05:36,088][52659] DAMAGECOUNT value on done: 821206.0 [2024-08-06 07:05:36,088][52659] Sum rewards: 75.591, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.753', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.187', 'weapon4': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:36,355][52650] Updated weights for policy 0, policy_version 73831 (0.0020) [2024-08-06 07:05:36,568][52647] DAMAGECOUNT value on done: 850438.0 [2024-08-06 07:05:36,569][52647] Sum rewards: 77.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.725', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.152', 'AMMO3': '0.180', 'weapon4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 604839936. Throughput: 0: 4353.7. Samples: 151214220. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:05:37,795][52567] Avg episode reward: [(0, '73.100')] [2024-08-06 07:05:38,380][52811] DAMAGECOUNT value on done: 764619.0 [2024-08-06 07:05:38,380][52811] Sum rewards: 73.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'weapon2': '0.440', 'WEAPON3': '1.150', 'HITCOUNT': '3.310', 'weapon3': '3.338', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 07:05:38,470][52664] DAMAGECOUNT value on done: 847212.0 [2024-08-06 07:05:38,470][52664] Sum rewards: 64.677, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.837', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.352', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '54.000'} [2024-08-06 07:05:39,329][52659] DAMAGECOUNT value on done: 822178.0 [2024-08-06 07:05:39,331][52659] Sum rewards: 81.780, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.126', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon4': '0.126', 'AMMO3': '0.170', 'weapon5': '0.228', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:39,431][52647] DAMAGECOUNT value on done: 855790.0 [2024-08-06 07:05:39,433][52647] Sum rewards: 80.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.697', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.172', 'weapon4': '0.176', 'AMMO3': '0.192', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:39,990][52794] DAMAGECOUNT value on done: 815633.0 [2024-08-06 07:05:39,991][52794] Sum rewards: 67.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.212', 'weapon2': '0.232', 'weapon4': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '55.000'} [2024-08-06 07:05:41,417][52650] Updated weights for policy 0, policy_version 73841 (0.0032) [2024-08-06 07:05:41,540][52811] DAMAGECOUNT value on done: 768171.0 [2024-08-06 07:05:41,540][52811] Sum rewards: 84.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.936', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon2': '0.152', 'weapon5': '0.172', 'AMMO4': '0.241', 'weapon4': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '71.000'} [2024-08-06 07:05:41,740][52820] DAMAGECOUNT value on done: 758082.0 [2024-08-06 07:05:41,741][52820] Sum rewards: 61.769, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.221', 'AMMO5': '0.021', 'AMMO2': '0.071', 'weapon4': '0.166', 'AMMO3': '0.167', 'weapon5': '0.256', 'AMMO4': '0.353', 'weapon2': '0.524', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '50.500'} [2024-08-06 07:05:42,060][52803] DAMAGECOUNT value on done: 762377.0 [2024-08-06 07:05:42,061][52803] Sum rewards: 51.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.280', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.174', 'AMMO4': '0.201', 'weapon5': '0.238', 'weapon4': '0.334', 'weapon2': '0.536', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.632', 'HITCOUNT': '2.770', 'DAMAGECOUNT': '13.719', 'FRAGCOUNT': '42.000'} [2024-08-06 07:05:42,515][52659] DAMAGECOUNT value on done: 821995.0 [2024-08-06 07:05:42,515][52659] Sum rewards: 79.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.848', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.087', 'weapon4': '0.120', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '0.950', 'weapon3': '3.116', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '62.500'} [2024-08-06 07:05:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 604930048. Throughput: 0: 4364.7. Samples: 151240760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:05:42,794][52567] Avg episode reward: [(0, '72.583')] [2024-08-06 07:05:43,104][52794] DAMAGECOUNT value on done: 823870.0 [2024-08-06 07:05:43,106][52794] Sum rewards: 80.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon2': '0.158', 'weapon5': '0.166', 'AMMO4': '0.185', 'weapon4': '0.236', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '66.000'} [2024-08-06 07:05:43,422][52649] DAMAGECOUNT value on done: 797093.0 [2024-08-06 07:05:43,424][52649] Sum rewards: 77.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.532', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.045', 'weapon4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.742', 'WEAPON3': '1.250', 'weapon3': '2.974', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:43,552][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:05:44,171][52658] DAMAGECOUNT value on done: 821813.0 [2024-08-06 07:05:44,172][52658] Sum rewards: 63.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.076', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '54.000'} [2024-08-06 07:05:44,576][52811] DAMAGECOUNT value on done: 772745.0 [2024-08-06 07:05:44,578][52811] Sum rewards: 76.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.082', 'WEAPON4': '0.150', 'weapon2': '0.164', 'AMMO3': '0.226', 'WEAPON3': '1.450', 'HITCOUNT': '3.460', 'weapon3': '3.558', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:44,765][52820] DAMAGECOUNT value on done: 760876.0 [2024-08-06 07:05:44,765][52820] Sum rewards: 76.505, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.797', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.112', 'AMMO3': '0.174', 'weapon5': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:45,204][52803] DAMAGECOUNT value on done: 761725.0 [2024-08-06 07:05:45,204][52803] Sum rewards: 71.039, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.037', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.202', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.398', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '59.000'} [2024-08-06 07:05:45,564][52650] Updated weights for policy 0, policy_version 73851 (0.0014) [2024-08-06 07:05:45,694][52659] DAMAGECOUNT value on done: 831079.0 [2024-08-06 07:05:45,695][52659] Sum rewards: 81.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.840', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.150', 'AMMO4': '0.155', 'weapon5': '0.186', 'AMMO3': '0.214', 'weapon2': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '66.000'} [2024-08-06 07:05:45,838][52794] DAMAGECOUNT value on done: 828642.0 [2024-08-06 07:05:45,840][52794] Sum rewards: 78.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.174', 'weapon5': '0.184', 'AMMO4': '0.200', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:46,039][52649] DAMAGECOUNT value on done: 789252.0 [2024-08-06 07:05:46,039][52649] Sum rewards: 88.972, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.898', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.322', 'WEAPON3': '1.800', 'weapon3': '3.458', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.594', 'FRAGCOUNT': '76.000'} [2024-08-06 07:05:46,944][52658] DAMAGECOUNT value on done: 824634.0 [2024-08-06 07:05:46,944][52658] Sum rewards: 81.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.894', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.038', 'weapon5': '0.138', 'AMMO4': '0.192', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '68.000'} [2024-08-06 07:05:47,659][52811] DAMAGECOUNT value on done: 776403.0 [2024-08-06 07:05:47,662][52811] Sum rewards: 89.837, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.068', 'weapon5': '0.088', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.201', 'FRAGCOUNT': '73.000'} [2024-08-06 07:05:47,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 605011968. Throughput: 0: 4372.2. Samples: 151253950. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:05:47,794][52567] Avg episode reward: [(0, '73.162')] [2024-08-06 07:05:47,844][52820] DAMAGECOUNT value on done: 760963.0 [2024-08-06 07:05:47,849][52820] Sum rewards: 72.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.260', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.192', 'weapon5': '0.212', 'AMMO4': '0.213', 'weapon4': '0.358', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.664', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '59.000'} [2024-08-06 07:05:48,314][52803] DAMAGECOUNT value on done: 767870.0 [2024-08-06 07:05:48,315][52803] Sum rewards: 94.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.136', 'AMMO3': '0.198', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.414', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '78.000'} [2024-08-06 07:05:48,615][52659] DAMAGECOUNT value on done: 817131.0 [2024-08-06 07:05:48,616][52659] Sum rewards: 70.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO3': '0.191', 'weapon5': '0.214', 'AMMO4': '0.244', 'weapon2': '0.358', 'weapon4': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.790', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '57.500'} [2024-08-06 07:05:48,816][52649] DAMAGECOUNT value on done: 806765.0 [2024-08-06 07:05:48,816][52649] Sum rewards: 70.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.458', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.072', 'AMMO3': '0.190', 'weapon2': '0.784', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '58.000'} [2024-08-06 07:05:49,171][52794] DAMAGECOUNT value on done: 816250.0 [2024-08-06 07:05:49,171][52794] Sum rewards: 83.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.516', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.134', 'weapon5': '0.144', 'AMMO4': '0.157', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '72.000'} [2024-08-06 07:05:49,823][52658] DAMAGECOUNT value on done: 828140.0 [2024-08-06 07:05:49,824][52658] Sum rewards: 71.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.164', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.247', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.396', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:50,416][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:05:50,658][52650] Updated weights for policy 0, policy_version 73861 (0.0013) [2024-08-06 07:05:50,666][52811] DAMAGECOUNT value on done: 765491.0 [2024-08-06 07:05:50,667][52811] Sum rewards: 61.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.561', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon7': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.139', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.456', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '2.688', 'DAMAGECOUNT': '14.625', 'FRAGCOUNT': '50.000'} [2024-08-06 07:05:50,882][52820] DAMAGECOUNT value on done: 749903.0 [2024-08-06 07:05:50,884][52820] Sum rewards: 60.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.959', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.184', 'AMMO4': '0.222', 'AMMO3': '0.223', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.104', 'DAMAGECOUNT': '14.628', 'FRAGCOUNT': '51.000'} [2024-08-06 07:05:51,270][52795] DAMAGECOUNT value on done: 762180.0 [2024-08-06 07:05:51,270][52795] Sum rewards: 66.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO4': '0.178', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.704', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.000'} [2024-08-06 07:05:51,459][52803] DAMAGECOUNT value on done: 766061.0 [2024-08-06 07:05:51,459][52803] Sum rewards: 78.862, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.215', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'weapon4': '0.234', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.600', 'weapon3': '3.018', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '69.000'} [2024-08-06 07:05:51,535][52649] DAMAGECOUNT value on done: 800876.0 [2024-08-06 07:05:51,535][52649] Sum rewards: 67.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.995', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.036', 'weapon5': '0.052', 'AMMO4': '0.058', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '3.300', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '54.000'} [2024-08-06 07:05:51,690][52659] DAMAGECOUNT value on done: 826027.0 [2024-08-06 07:05:51,690][52659] Sum rewards: 76.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.055', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.120', 'weapon4': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.191', 'weapon2': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:52,378][52794] DAMAGECOUNT value on done: 812998.0 [2024-08-06 07:05:52,381][52794] Sum rewards: 77.492, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.146', 'AMMO3': '0.156', 'weapon4': '0.166', 'WEAPON4': '0.200', 'weapon2': '0.234', 'WEAPON5': '0.250', 'HEALTH': '0.650', 'WEAPON3': '0.900', 'weapon3': '3.272', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:52,536][52658] DAMAGECOUNT value on done: 823058.0 [2024-08-06 07:05:52,538][52658] Sum rewards: 69.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.636', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.138', 'weapon4': '0.204', 'weapon2': '0.228', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '59.000'} [2024-08-06 07:05:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 605102080. Throughput: 0: 4368.7. Samples: 151280160. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:05:52,795][52567] Avg episode reward: [(0, '73.322')] [2024-08-06 07:05:53,784][52811] DAMAGECOUNT value on done: 766643.0 [2024-08-06 07:05:53,786][52811] Sum rewards: 81.185, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.123', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:54,017][52820] DAMAGECOUNT value on done: 764314.0 [2024-08-06 07:05:54,020][52820] Sum rewards: 64.251, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.026', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.566', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '54.000'} [2024-08-06 07:05:54,314][52649] DAMAGECOUNT value on done: 793395.0 [2024-08-06 07:05:54,315][52649] Sum rewards: 74.860, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.978', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.112', 'weapon5': '0.128', 'AMMO4': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '63.000'} [2024-08-06 07:05:54,326][52795] DAMAGECOUNT value on done: 748714.0 [2024-08-06 07:05:54,326][52795] Sum rewards: 78.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.447', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.179', 'weapon4': '0.204', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:54,636][52803] DAMAGECOUNT value on done: 765967.0 [2024-08-06 07:05:54,637][52803] Sum rewards: 78.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'weapon4': '0.194', 'AMMO3': '0.233', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.300', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:54,796][52794] DAMAGECOUNT value on done: 820384.0 [2024-08-06 07:05:54,798][52794] Sum rewards: 75.876, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.078', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon2': '0.164', 'AMMO4': '0.175', 'weapon5': '0.226', 'weapon4': '0.234', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '65.000'} [2024-08-06 07:05:54,994][52650] Updated weights for policy 0, policy_version 73871 (0.0014) [2024-08-06 07:05:54,996][52659] DAMAGECOUNT value on done: 818945.0 [2024-08-06 07:05:54,997][52659] Sum rewards: 78.543, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:55,390][52658] DAMAGECOUNT value on done: 820168.0 [2024-08-06 07:05:55,390][52658] Sum rewards: 87.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.678', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.107', 'weapon5': '0.122', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.328', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '71.000'} [2024-08-06 07:05:57,242][52820] DAMAGECOUNT value on done: 748901.0 [2024-08-06 07:05:57,250][52820] Sum rewards: 73.498, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.320', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.108', 'weapon5': '0.210', 'AMMO4': '0.225', 'weapon2': '0.260', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '67.000'} [2024-08-06 07:05:57,435][52794] DAMAGECOUNT value on done: 825104.0 [2024-08-06 07:05:57,437][52794] Sum rewards: 75.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.108', 'AMMO4': '0.174', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.922', 'FRAGCOUNT': '60.000'} [2024-08-06 07:05:57,454][52795] DAMAGECOUNT value on done: 754611.0 [2024-08-06 07:05:57,454][52795] Sum rewards: 80.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.122', 'AMMO4': '0.141', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '67.000'} [2024-08-06 07:05:57,606][52649] DAMAGECOUNT value on done: 802718.0 [2024-08-06 07:05:57,606][52649] Sum rewards: 79.683, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.311', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'weapon5': '0.094', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '64.000'} [2024-08-06 07:05:57,776][52803] DAMAGECOUNT value on done: 765460.0 [2024-08-06 07:05:57,777][52803] Sum rewards: 74.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.008', 'weapon4': '0.020', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.110', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '62.000'} [2024-08-06 07:05:57,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 605200384. Throughput: 0: 4369.6. Samples: 151306440. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:05:57,794][52567] Avg episode reward: [(0, '73.740')] [2024-08-06 07:05:58,597][52658] DAMAGECOUNT value on done: 812906.0 [2024-08-06 07:05:58,598][52658] Sum rewards: 82.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.136', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.172', 'weapon5': '0.176', 'AMMO3': '0.246', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.156', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '69.000'} [2024-08-06 07:05:59,980][52650] Updated weights for policy 0, policy_version 73881 (0.0016) [2024-08-06 07:06:00,402][52820] DAMAGECOUNT value on done: 755165.0 [2024-08-06 07:06:00,402][52820] Sum rewards: 74.354, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.518', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.146', 'AMMO3': '0.181', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:00,463][52794] DAMAGECOUNT value on done: 812448.0 [2024-08-06 07:06:00,463][52794] Sum rewards: 82.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.648', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.096', 'AMMO3': '0.249', 'AMMO4': '0.252', 'weapon5': '0.260', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:00,578][52795] DAMAGECOUNT value on done: 763565.0 [2024-08-06 07:06:00,578][52795] Sum rewards: 74.530, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.386', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.298', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '2.896', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:00,584][52649] DAMAGECOUNT value on done: 801005.0 [2024-08-06 07:06:00,585][52649] Sum rewards: 73.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.110', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.219', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.504', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:00,744][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:06:01,026][52803] DAMAGECOUNT value on done: 757654.0 [2024-08-06 07:06:01,027][52803] Sum rewards: 64.279, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.961', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.082', 'AMMO3': '0.169', 'AMMO4': '0.227', 'weapon5': '0.286', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '50.000'} [2024-08-06 07:06:01,616][52658] DAMAGECOUNT value on done: 826230.0 [2024-08-06 07:06:01,617][52658] Sum rewards: 80.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.384', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.123', 'weapon5': '0.126', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '65.000'} [2024-08-06 07:06:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 605282304. Throughput: 0: 4373.8. Samples: 151319680. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:06:02,794][52567] Avg episode reward: [(0, '74.001')] [2024-08-06 07:06:03,355][52794] DAMAGECOUNT value on done: 822404.0 [2024-08-06 07:06:03,355][52794] Sum rewards: 54.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.812', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.094', 'AMMO4': '0.161', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.130', 'DAMAGECOUNT': '14.691', 'FRAGCOUNT': '46.000'} [2024-08-06 07:06:03,732][52795] DAMAGECOUNT value on done: 750568.0 [2024-08-06 07:06:03,732][52795] Sum rewards: 73.581, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.945', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon2': '0.674', 'WEAPON3': '0.950', 'weapon3': '3.174', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '58.000'} [2024-08-06 07:06:03,770][52820] DAMAGECOUNT value on done: 758164.0 [2024-08-06 07:06:03,770][52820] Sum rewards: 69.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.308', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.147', 'weapon5': '0.176', 'weapon2': '0.210', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '58.000'} [2024-08-06 07:06:03,772][52649] DAMAGECOUNT value on done: 804209.0 [2024-08-06 07:06:03,772][52649] Sum rewards: 64.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.447', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.110', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.976', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:04,171][52803] DAMAGECOUNT value on done: 758361.0 [2024-08-06 07:06:04,173][52803] Sum rewards: 78.817, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.076', 'weapon2': '0.172', 'AMMO3': '0.205', 'weapon5': '0.216', 'AMMO4': '0.245', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:04,439][52658] DAMAGECOUNT value on done: 814127.0 [2024-08-06 07:06:04,441][52658] Sum rewards: 69.543, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.325', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.224', 'weapon4': '0.238', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.282', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 07:06:04,576][52650] Updated weights for policy 0, policy_version 73891 (0.0022) [2024-08-06 07:06:05,961][52794] DAMAGECOUNT value on done: 816859.0 [2024-08-06 07:06:05,963][52794] Sum rewards: 66.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.560', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.084', 'weapon5': '0.198', 'AMMO3': '0.232', 'AMMO4': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.494', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '56.000'} [2024-08-06 07:06:06,205][52669] DAMAGECOUNT value on done: 821836.0 [2024-08-06 07:06:06,205][52669] Sum rewards: 84.572, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'HEALTH': '0.023', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.173', 'weapon2': '0.360', 'WEAPON3': '1.000', 'weapon3': '3.414', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:06,433][52663] DAMAGECOUNT value on done: 837131.0 [2024-08-06 07:06:06,435][52663] Sum rewards: 78.319, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.563', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.132', 'AMMO3': '0.149', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.480', 'WEAPON3': '0.950', 'weapon3': '3.022', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:06,785][52795] DAMAGECOUNT value on done: 758250.0 [2024-08-06 07:06:06,787][52795] Sum rewards: 68.149, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO5': '0.019', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO4': '0.155', 'weapon5': '0.216', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.888', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:06,789][52658] DAMAGECOUNT value on done: 841034.0 [2024-08-06 07:06:06,791][52658] Sum rewards: 80.616, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.898', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.136', 'weapon4': '0.184', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'weapon5': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.586', 'WEAPON3': '0.900', 'weapon3': '2.802', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:06,909][52649] DAMAGECOUNT value on done: 803010.0 [2024-08-06 07:06:06,909][52649] Sum rewards: 73.613, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.276', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.538', 'WEAPON3': '1.500', 'weapon3': '2.840', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:06,979][52820] DAMAGECOUNT value on done: 762348.0 [2024-08-06 07:06:06,979][52820] Sum rewards: 71.786, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.505', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.054', 'AMMO3': '0.149', 'weapon5': '0.150', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '0.900', 'HITCOUNT': '3.110', 'weapon3': '3.388', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '56.500'} [2024-08-06 07:06:07,246][52803] DAMAGECOUNT value on done: 763400.0 [2024-08-06 07:06:07,248][52803] Sum rewards: 70.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.099', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.290', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.484', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '58.000'} [2024-08-06 07:06:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 605372416. Throughput: 0: 4377.8. Samples: 151345840. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:06:07,795][52567] Avg episode reward: [(0, '73.836')] [2024-08-06 07:06:08,902][52665] DAMAGECOUNT value on done: 808974.0 [2024-08-06 07:06:08,903][52665] Sum rewards: 63.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.982', 'AMMO5': '0.023', 'AMMO2': '0.046', 'AMMO3': '0.164', 'AMMO4': '0.230', 'weapon4': '0.268', 'weapon5': '0.338', 'weapon2': '0.392', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.708', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '50.000'} [2024-08-06 07:06:08,929][52650] Updated weights for policy 0, policy_version 73901 (0.0012) [2024-08-06 07:06:08,967][52794] DAMAGECOUNT value on done: 811216.0 [2024-08-06 07:06:08,967][52794] Sum rewards: 76.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.140', 'AMMO4': '0.151', 'AMMO3': '0.201', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:09,241][52669] DAMAGECOUNT value on done: 815770.0 [2024-08-06 07:06:09,242][52669] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.656', 'AMMO5': '0.017', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon4': '0.164', 'weapon5': '0.256', 'AMMO3': '0.264', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.948', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '56.000'} [2024-08-06 07:06:09,349][52658] DAMAGECOUNT value on done: 826455.0 [2024-08-06 07:06:09,350][52658] Sum rewards: 85.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.440', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.176', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO4': '0.179', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.814', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:09,558][52663] DAMAGECOUNT value on done: 822706.0 [2024-08-06 07:06:09,559][52663] Sum rewards: 83.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:09,903][52795] DAMAGECOUNT value on done: 766030.0 [2024-08-06 07:06:09,905][52795] Sum rewards: 74.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.325', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.256', 'weapon2': '0.258', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:09,959][52820] DAMAGECOUNT value on done: 771715.0 [2024-08-06 07:06:09,962][52820] Sum rewards: 84.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.105', 'weapon2': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.218', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.382', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '70.000'} [2024-08-06 07:06:10,012][52649] DAMAGECOUNT value on done: 796673.0 [2024-08-06 07:06:10,014][52649] Sum rewards: 69.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.995', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.068', 'weapon5': '0.122', 'AMMO4': '0.158', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.204', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:10,358][52803] DAMAGECOUNT value on done: 761502.0 [2024-08-06 07:06:10,360][52803] Sum rewards: 73.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.604', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon5': '0.204', 'AMMO3': '0.215', 'weapon4': '0.216', 'AMMO4': '0.251', 'weapon2': '0.358', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:11,644][52614] Signal inference workers to stop experience collection... (13500 times) [2024-08-06 07:06:11,645][52614] Signal inference workers to resume experience collection... (13500 times) [2024-08-06 07:06:11,683][52650] InferenceWorker_p0-w0: stopping experience collection (13500 times) [2024-08-06 07:06:11,691][52650] InferenceWorker_p0-w0: resuming experience collection (13500 times) [2024-08-06 07:06:11,790][52665] DAMAGECOUNT value on done: 824758.0 [2024-08-06 07:06:11,792][52665] Sum rewards: 73.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.465', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.080', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.234', 'weapon4': '0.248', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:12,078][52794] DAMAGECOUNT value on done: 822989.0 [2024-08-06 07:06:12,079][52794] Sum rewards: 78.433, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.092', 'AMMO4': '0.119', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.050', 'HITCOUNT': '3.290', 'weapon3': '3.414', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:12,172][52658] DAMAGECOUNT value on done: 835035.0 [2024-08-06 07:06:12,172][52658] Sum rewards: 81.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.195', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.052', 'weapon4': '0.086', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.420', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:12,372][52669] DAMAGECOUNT value on done: 829499.0 [2024-08-06 07:06:12,374][52669] Sum rewards: 78.016, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.108', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:12,757][52663] DAMAGECOUNT value on done: 817914.0 [2024-08-06 07:06:12,758][52663] Sum rewards: 82.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.536', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.070', 'AMMO4': '0.164', 'weapon5': '0.172', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 605454336. Throughput: 0: 4380.2. Samples: 151372200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:06:12,794][52567] Avg episode reward: [(0, '74.134')] [2024-08-06 07:06:13,075][52649] DAMAGECOUNT value on done: 807989.0 [2024-08-06 07:06:13,076][52649] Sum rewards: 76.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.756', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon5': '0.038', 'weapon4': '0.062', 'AMMO4': '0.072', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.254', 'WEAPON3': '1.100', 'weapon3': '3.490', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:13,114][52795] DAMAGECOUNT value on done: 757827.0 [2024-08-06 07:06:13,114][52795] Sum rewards: 90.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.121', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.456', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.204', 'FRAGCOUNT': '75.000'} [2024-08-06 07:06:13,162][52820] DAMAGECOUNT value on done: 753491.0 [2024-08-06 07:06:13,164][52820] Sum rewards: 74.852, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.995', 'AMMO5': '0.006', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.120', 'AMMO3': '0.140', 'weapon4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.720', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:13,484][52803] DAMAGECOUNT value on done: 775660.0 [2024-08-06 07:06:13,485][52803] Sum rewards: 70.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.276', 'AMMO5': '0.012', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon4': '0.100', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon5': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '58.000'} [2024-08-06 07:06:13,909][52650] Updated weights for policy 0, policy_version 73911 (0.0016) [2024-08-06 07:06:14,643][52658] DAMAGECOUNT value on done: 823494.0 [2024-08-06 07:06:14,643][52658] Sum rewards: 76.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.556', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.182', 'AMMO4': '0.191', 'weapon5': '0.232', 'AMMO3': '0.273', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.938', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '65.000'} [2024-08-06 07:06:14,944][52669] DAMAGECOUNT value on done: 822299.0 [2024-08-06 07:06:14,946][52669] Sum rewards: 71.734, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.378', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.164', 'AMMO4': '0.178', 'AMMO3': '0.253', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '63.000'} [2024-08-06 07:06:14,986][52665] DAMAGECOUNT value on done: 815020.0 [2024-08-06 07:06:14,988][52665] Sum rewards: 56.609, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.504', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.046', 'AMMO4': '0.144', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'weapon2': '0.400', 'WEAPON3': '1.800', 'HITCOUNT': '2.780', 'weapon3': '3.174', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '51.000'} [2024-08-06 07:06:15,189][52663] DAMAGECOUNT value on done: 820100.0 [2024-08-06 07:06:15,190][52663] Sum rewards: 71.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.921', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.152', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '59.500'} [2024-08-06 07:06:15,289][52794] DAMAGECOUNT value on done: 819860.0 [2024-08-06 07:06:15,291][52794] Sum rewards: 79.996, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.748', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:15,679][52811] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:06:15,963][52649] DAMAGECOUNT value on done: 816015.0 [2024-08-06 07:06:15,964][52649] Sum rewards: 89.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'weapon5': '0.062', 'weapon4': '0.108', 'AMMO4': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.342', 'WEAPON3': '1.100', 'weapon3': '3.284', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '21.762', 'FRAGCOUNT': '70.000'} [2024-08-06 07:06:16,110][52820] DAMAGECOUNT value on done: 761887.0 [2024-08-06 07:06:16,111][52820] Sum rewards: 66.739, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.946', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.128', 'weapon5': '0.220', 'AMMO4': '0.232', 'AMMO3': '0.301', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.750', 'weapon3': '2.880', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:16,134][52671] DAMAGECOUNT value on done: 826996.0 [2024-08-06 07:06:16,137][52671] Sum rewards: 72.605, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.191', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '58.000'} [2024-08-06 07:06:16,219][52795] DAMAGECOUNT value on done: 762956.0 [2024-08-06 07:06:16,220][52795] Sum rewards: 79.277, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.135', 'weapon5': '0.182', 'weapon4': '0.184', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.606', 'WEAPON3': '0.900', 'weapon3': '2.824', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:16,560][52803] DAMAGECOUNT value on done: 767277.0 [2024-08-06 07:06:16,560][52803] Sum rewards: 78.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.430', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.131', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.674', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:17,577][52665] DAMAGECOUNT value on done: 816581.0 [2024-08-06 07:06:17,577][52665] Sum rewards: 77.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.398', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.168', 'AMMO4': '0.213', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '63.000'} [2024-08-06 07:06:17,634][52658] DAMAGECOUNT value on done: 831546.0 [2024-08-06 07:06:17,634][52658] Sum rewards: 75.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.218', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.110', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.312', 'weapon4': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:17,764][52669] DAMAGECOUNT value on done: 827217.0 [2024-08-06 07:06:17,764][52669] Sum rewards: 82.229, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.098', 'weapon5': '0.142', 'WEAPON4': '0.150', 'HEALTH': '0.183', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.246', 'WEAPON3': '1.200', 'weapon3': '3.346', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 605544448. Throughput: 0: 4385.3. Samples: 151385390. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:17,794][52567] Avg episode reward: [(0, '75.092')] [2024-08-06 07:06:17,957][52794] DAMAGECOUNT value on done: 834682.0 [2024-08-06 07:06:17,980][52794] Sum rewards: 70.872, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.079', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.152', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.846', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '54.500'} [2024-08-06 07:06:18,140][52663] DAMAGECOUNT value on done: 823017.0 [2024-08-06 07:06:18,141][52663] Sum rewards: 74.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.840', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.164', 'weapon5': '0.184', 'AMMO3': '0.226', 'AMMO4': '0.302', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:18,821][52650] Updated weights for policy 0, policy_version 73921 (0.0055) [2024-08-06 07:06:18,942][52649] DAMAGECOUNT value on done: 807851.0 [2024-08-06 07:06:18,942][52649] Sum rewards: 76.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.840', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.180', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:19,172][52671] DAMAGECOUNT value on done: 832332.0 [2024-08-06 07:06:19,172][52671] Sum rewards: 79.010, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.468', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon4': '0.056', 'weapon5': '0.134', 'AMMO4': '0.243', 'AMMO3': '0.287', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.700', 'weapon3': '3.236', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '69.000'} [2024-08-06 07:06:19,236][52820] DAMAGECOUNT value on done: 772695.0 [2024-08-06 07:06:19,237][52820] Sum rewards: 78.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.892', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.170', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '65.000'} [2024-08-06 07:06:19,358][52795] DAMAGECOUNT value on done: 763185.0 [2024-08-06 07:06:19,360][52795] Sum rewards: 68.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.800', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.424', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.342', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 07:06:19,759][52803] DAMAGECOUNT value on done: 763931.0 [2024-08-06 07:06:19,763][52803] Sum rewards: 64.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.194', 'AMMO4': '0.202', 'AMMO3': '0.243', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '57.000'} [2024-08-06 07:06:20,457][52658] DAMAGECOUNT value on done: 819244.0 [2024-08-06 07:06:20,458][52658] Sum rewards: 73.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.927', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.098', 'weapon5': '0.124', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.320', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:20,505][52669] DAMAGECOUNT value on done: 824131.0 [2024-08-06 07:06:20,506][52669] Sum rewards: 70.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.278', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.068', 'weapon4': '0.108', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '3.216', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:20,686][52794] DAMAGECOUNT value on done: 814623.0 [2024-08-06 07:06:20,686][52794] Sum rewards: 80.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.076', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.068', 'weapon5': '0.104', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:20,714][52665] DAMAGECOUNT value on done: 798789.0 [2024-08-06 07:06:20,715][52665] Sum rewards: 79.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.126', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.118', 'weapon5': '0.118', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '66.000'} [2024-08-06 07:06:20,748][52663] DAMAGECOUNT value on done: 827980.0 [2024-08-06 07:06:20,749][52663] Sum rewards: 79.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.941', 'AMMO5': '0.008', 'weapon4': '0.030', 'weapon5': '0.032', 'AMMO2': '0.034', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.414', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:21,105][52670] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:06:21,733][52649] DAMAGECOUNT value on done: 808380.0 [2024-08-06 07:06:21,735][52649] Sum rewards: 73.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:22,367][52671] DAMAGECOUNT value on done: 826770.0 [2024-08-06 07:06:22,368][52671] Sum rewards: 80.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.345', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.168', 'AMMO4': '0.195', 'AMMO3': '0.252', 'weapon5': '0.256', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.882', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '66.000'} [2024-08-06 07:06:22,370][52820] DAMAGECOUNT value on done: 765998.0 [2024-08-06 07:06:22,370][52820] Sum rewards: 70.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.126', 'weapon4': '0.194', 'AMMO3': '0.207', 'AMMO4': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.680', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '58.000'} [2024-08-06 07:06:22,398][52795] DAMAGECOUNT value on done: 759126.0 [2024-08-06 07:06:22,398][52795] Sum rewards: 70.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.094', 'AMMO5': '0.016', 'AMMO2': '0.050', 'AMMO3': '0.174', 'weapon5': '0.184', 'AMMO4': '0.248', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.798', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '57.000'} [2024-08-06 07:06:22,788][52803] DAMAGECOUNT value on done: 776173.0 [2024-08-06 07:06:22,790][52803] Sum rewards: 72.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.126', 'weapon4': '0.152', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 605634560. Throughput: 0: 4383.1. Samples: 151411460. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:22,794][52567] Avg episode reward: [(0, '75.373')] [2024-08-06 07:06:23,188][52650] Updated weights for policy 0, policy_version 73931 (0.0018) [2024-08-06 07:06:23,235][52658] DAMAGECOUNT value on done: 828166.0 [2024-08-06 07:06:23,236][52658] Sum rewards: 54.532, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.086', 'AMMO4': '0.119', 'weapon2': '0.228', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '2.670', 'weapon3': '3.440', 'DAMAGECOUNT': '14.400', 'FRAGCOUNT': '49.000'} [2024-08-06 07:06:23,314][52669] DAMAGECOUNT value on done: 824224.0 [2024-08-06 07:06:23,314][52669] Sum rewards: 70.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.136', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:23,488][52665] DAMAGECOUNT value on done: 806386.0 [2024-08-06 07:06:23,488][52665] Sum rewards: 73.566, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.060', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'weapon3': '3.418', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.000'} [2024-08-06 07:06:23,790][52663] DAMAGECOUNT value on done: 816527.0 [2024-08-06 07:06:23,791][52663] Sum rewards: 68.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.190', 'weapon4': '0.198', 'weapon5': '0.206', 'AMMO4': '0.235', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.916', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '56.000'} [2024-08-06 07:06:23,918][52794] DAMAGECOUNT value on done: 829246.0 [2024-08-06 07:06:23,918][52794] Sum rewards: 61.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.926', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.082', 'weapon4': '0.128', 'AMMO3': '0.184', 'weapon2': '0.266', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.336', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '51.000'} [2024-08-06 07:06:24,616][52649] DAMAGECOUNT value on done: 796749.0 [2024-08-06 07:06:24,616][52649] Sum rewards: 58.764, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.125', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'weapon5': '0.112', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.467', 'FRAGCOUNT': '49.000'} [2024-08-06 07:06:25,211][52671] DAMAGECOUNT value on done: 828679.0 [2024-08-06 07:06:25,213][52671] Sum rewards: 75.960, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.577', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:25,446][52795] DAMAGECOUNT value on done: 752715.0 [2024-08-06 07:06:25,447][52795] Sum rewards: 72.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.625', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon4': '0.118', 'weapon5': '0.168', 'AMMO4': '0.270', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:25,619][52820] DAMAGECOUNT value on done: 766190.0 [2024-08-06 07:06:25,619][52820] Sum rewards: 78.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.062', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.132', 'AMMO4': '0.176', 'AMMO3': '0.242', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.260', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:25,863][52803] DAMAGECOUNT value on done: 763314.0 [2024-08-06 07:06:25,864][52803] Sum rewards: 66.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.832', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon5': '0.328', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '55.000'} [2024-08-06 07:06:26,289][52658] DAMAGECOUNT value on done: 808980.0 [2024-08-06 07:06:26,291][52658] Sum rewards: 72.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.479', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.074', 'AMMO4': '0.158', 'weapon5': '0.158', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:26,531][52669] DAMAGECOUNT value on done: 824523.0 [2024-08-06 07:06:26,533][52669] Sum rewards: 70.796, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.090', 'AMMO4': '0.160', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:26,774][52665] DAMAGECOUNT value on done: 808497.0 [2024-08-06 07:06:26,776][52665] Sum rewards: 73.773, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.080', 'weapon5': '0.202', 'AMMO3': '0.209', 'AMMO4': '0.314', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:26,887][52663] DAMAGECOUNT value on done: 809474.0 [2024-08-06 07:06:26,889][52663] Sum rewards: 69.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.676', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.174', 'AMMO3': '0.181', 'AMMO4': '0.203', 'weapon4': '0.226', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '55.000'} [2024-08-06 07:06:27,041][52794] DAMAGECOUNT value on done: 825692.0 [2024-08-06 07:06:27,041][52794] Sum rewards: 77.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.083', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 605716480. Throughput: 0: 4367.1. Samples: 151437280. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:27,794][52567] Avg episode reward: [(0, '74.382')] [2024-08-06 07:06:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073940_605716480.pth... [2024-08-06 07:06:27,923][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073427_601513984.pth [2024-08-06 07:06:28,016][52649] DAMAGECOUNT value on done: 805702.0 [2024-08-06 07:06:28,017][52649] Sum rewards: 75.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.112', 'weapon5': '0.218', 'AMMO3': '0.230', 'AMMO4': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:28,247][52650] Updated weights for policy 0, policy_version 73941 (0.0026) [2024-08-06 07:06:28,346][52671] DAMAGECOUNT value on done: 835987.0 [2024-08-06 07:06:28,347][52671] Sum rewards: 80.730, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.345', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.500', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '65.000'} [2024-08-06 07:06:28,801][52795] DAMAGECOUNT value on done: 754980.0 [2024-08-06 07:06:28,801][52795] Sum rewards: 83.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.092', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon2': '0.196', 'AMMO3': '0.254', 'weapon5': '0.262', 'weapon4': '0.266', 'AMMO4': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '69.000'} [2024-08-06 07:06:28,995][52820] DAMAGECOUNT value on done: 763179.0 [2024-08-06 07:06:28,995][52820] Sum rewards: 72.675, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.048', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.218', 'WEAPON3': '1.350', 'weapon3': '3.482', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:29,054][52803] DAMAGECOUNT value on done: 765576.0 [2024-08-06 07:06:29,054][52803] Sum rewards: 76.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.699', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO4': '0.146', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.712', 'WEAPON3': '1.350', 'weapon3': '2.876', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:29,146][52658] DAMAGECOUNT value on done: 828363.0 [2024-08-06 07:06:29,146][52658] Sum rewards: 74.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.132', 'weapon5': '0.218', 'AMMO3': '0.241', 'AMMO4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:29,413][52669] DAMAGECOUNT value on done: 833467.0 [2024-08-06 07:06:29,415][52669] Sum rewards: 74.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.116', 'AMMO4': '0.140', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:29,521][52662] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2024-08-06 07:06:29,876][52663] DAMAGECOUNT value on done: 814827.0 [2024-08-06 07:06:29,879][52663] Sum rewards: 79.872, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.450', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'weapon4': '0.124', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:29,979][52665] DAMAGECOUNT value on done: 812024.0 [2024-08-06 07:06:29,980][52665] Sum rewards: 81.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.318', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.128', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.254', 'WEAPON3': '1.200', 'weapon3': '3.202', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '65.000'} [2024-08-06 07:06:30,218][52794] DAMAGECOUNT value on done: 826656.0 [2024-08-06 07:06:30,218][52794] Sum rewards: 81.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.078', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:30,799][52649] DAMAGECOUNT value on done: 788775.0 [2024-08-06 07:06:30,801][52649] Sum rewards: 71.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.562', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.142', 'weapon5': '0.170', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:31,319][52671] DAMAGECOUNT value on done: 824321.0 [2024-08-06 07:06:31,320][52671] Sum rewards: 66.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.543', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.098', 'AMMO3': '0.222', 'weapon5': '0.254', 'weapon2': '0.260', 'AMMO4': '0.291', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '3.040', 'weapon3': '3.046', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '55.000'} [2024-08-06 07:06:32,032][52795] DAMAGECOUNT value on done: 765663.0 [2024-08-06 07:06:32,033][52795] Sum rewards: 70.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.345', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.026', 'weapon5': '0.042', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.402', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:32,094][52658] DAMAGECOUNT value on done: 820062.0 [2024-08-06 07:06:32,096][52658] Sum rewards: 75.720, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.355', 'AMMO5': '0.011', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.170', 'weapon4': '0.206', 'weapon2': '0.222', 'AMMO4': '0.267', 'AMMO3': '0.309', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.050', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:32,142][52820] DAMAGECOUNT value on done: 765317.0 [2024-08-06 07:06:32,143][52820] Sum rewards: 74.958, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.606', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO4': '0.022', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:32,242][52803] DAMAGECOUNT value on done: 770384.0 [2024-08-06 07:06:32,243][52803] Sum rewards: 85.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.602', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.174', 'AMMO4': '0.182', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.009', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:32,647][52665] DAMAGECOUNT value on done: 820254.0 [2024-08-06 07:06:32,651][52665] Sum rewards: 70.360, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.794', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.173', 'weapon2': '0.822', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 07:06:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 605798400. Throughput: 0: 4356.0. Samples: 151449970. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:32,794][52567] Avg episode reward: [(0, '74.257')] [2024-08-06 07:06:32,829][52669] DAMAGECOUNT value on done: 825435.0 [2024-08-06 07:06:32,830][52669] Sum rewards: 69.956, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.342', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.340', 'WEAPON3': '1.700', 'weapon3': '3.148', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:32,834][52650] Updated weights for policy 0, policy_version 73951 (0.0018) [2024-08-06 07:06:32,902][52794] DAMAGECOUNT value on done: 833602.0 [2024-08-06 07:06:32,902][52794] Sum rewards: 72.560, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.019', 'HEALTH': '0.021', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO3': '0.194', 'AMMO4': '0.206', 'weapon5': '0.236', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:32,915][52670] DAMAGECOUNT value on done: 810063.0 [2024-08-06 07:06:32,918][52670] Sum rewards: 79.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.799', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.104', 'weapon5': '0.228', 'weapon2': '0.234', 'AMMO4': '0.245', 'AMMO3': '0.255', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.134', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:33,286][52663] DAMAGECOUNT value on done: 819523.0 [2024-08-06 07:06:33,294][52663] Sum rewards: 74.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.788', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.215', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.482', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:34,062][52649] DAMAGECOUNT value on done: 810557.0 [2024-08-06 07:06:34,062][52649] Sum rewards: 65.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.542', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon4': '0.136', 'AMMO3': '0.214', 'weapon5': '0.254', 'AMMO4': '0.329', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:34,163][52671] DAMAGECOUNT value on done: 831021.0 [2024-08-06 07:06:34,164][52671] Sum rewards: 84.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.138', 'weapon5': '0.156', 'AMMO4': '0.172', 'weapon2': '0.182', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '70.000'} [2024-08-06 07:06:35,049][52658] DAMAGECOUNT value on done: 815953.0 [2024-08-06 07:06:35,049][52658] Sum rewards: 58.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.254', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.470', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '49.000'} [2024-08-06 07:06:35,126][52795] DAMAGECOUNT value on done: 750164.0 [2024-08-06 07:06:35,126][52795] Sum rewards: 75.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.180', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.138', 'AMMO3': '0.169', 'weapon5': '0.214', 'AMMO4': '0.241', 'weapon2': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:35,202][52820] DAMAGECOUNT value on done: 775925.0 [2024-08-06 07:06:35,202][52820] Sum rewards: 74.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.688', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'weapon4': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:35,525][52803] DAMAGECOUNT value on done: 774156.0 [2024-08-06 07:06:35,525][52803] Sum rewards: 67.096, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.382', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.052', 'weapon4': '0.122', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:35,760][52665] DAMAGECOUNT value on done: 810731.0 [2024-08-06 07:06:35,760][52665] Sum rewards: 62.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.846', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.114', 'AMMO3': '0.218', 'AMMO4': '0.261', 'weapon5': '0.310', 'weapon2': '0.526', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '52.000'} [2024-08-06 07:06:35,832][52669] DAMAGECOUNT value on done: 831579.0 [2024-08-06 07:06:35,833][52669] Sum rewards: 85.494, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.591', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:35,851][52670] DAMAGECOUNT value on done: 823514.0 [2024-08-06 07:06:35,852][52670] Sum rewards: 64.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.846', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:35,878][52794] DAMAGECOUNT value on done: 824461.0 [2024-08-06 07:06:35,878][52794] Sum rewards: 62.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.058', 'AMMO3': '0.233', 'weapon5': '0.234', 'AMMO4': '0.291', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon4': '0.522', 'WEAPON3': '1.300', 'weapon3': '2.542', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '53.000'} [2024-08-06 07:06:36,237][52663] DAMAGECOUNT value on done: 829792.0 [2024-08-06 07:06:36,238][52663] Sum rewards: 57.737, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.184', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.134', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.386', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '51.000'} [2024-08-06 07:06:36,809][52671] DAMAGECOUNT value on done: 827970.0 [2024-08-06 07:06:36,809][52671] Sum rewards: 64.918, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.154', 'weapon4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon2': '0.360', 'WEAPON3': '1.700', 'weapon3': '3.088', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '57.000'} [2024-08-06 07:06:36,946][52649] DAMAGECOUNT value on done: 808547.0 [2024-08-06 07:06:36,948][52649] Sum rewards: 73.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.004', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.121', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.758', 'WEAPON3': '1.000', 'weapon3': '2.990', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:37,372][52666] DAMAGECOUNT value on done: 823452.0 [2024-08-06 07:06:37,372][52666] Sum rewards: 80.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.084', 'AMMO3': '0.176', 'weapon5': '0.178', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:37,684][52650] Updated weights for policy 0, policy_version 73961 (0.0021) [2024-08-06 07:06:37,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 605888512. Throughput: 0: 4351.3. Samples: 151475970. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:37,795][52567] Avg episode reward: [(0, '73.862')] [2024-08-06 07:06:38,013][52658] DAMAGECOUNT value on done: 825644.0 [2024-08-06 07:06:38,014][52658] Sum rewards: 79.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '63.000'} [2024-08-06 07:06:38,130][52795] DAMAGECOUNT value on done: 763603.0 [2024-08-06 07:06:38,130][52795] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.116', 'AMMO4': '0.154', 'AMMO3': '0.173', 'weapon5': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '57.500'} [2024-08-06 07:06:38,316][52670] DAMAGECOUNT value on done: 810814.0 [2024-08-06 07:06:38,324][52670] Sum rewards: 68.801, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.150', 'AMMO5': '0.004', 'weapon4': '0.022', 'AMMO2': '0.029', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon2': '0.288', 'AMMO3': '0.319', 'WEAPON3': '1.950', 'weapon3': '3.426', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:38,511][52820] DAMAGECOUNT value on done: 772111.0 [2024-08-06 07:06:38,511][52820] Sum rewards: 67.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.628', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.194', 'AMMO4': '0.219', 'weapon5': '0.222', 'weapon4': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.634', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:38,597][52803] DAMAGECOUNT value on done: 772187.0 [2024-08-06 07:06:38,597][52803] Sum rewards: 73.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.302', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:38,615][52665] DAMAGECOUNT value on done: 822970.0 [2024-08-06 07:06:38,615][52665] Sum rewards: 75.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.702', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.164', 'AMMO4': '0.205', 'AMMO3': '0.271', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.188', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '65.000'} [2024-08-06 07:06:38,909][52669] DAMAGECOUNT value on done: 833759.0 [2024-08-06 07:06:38,909][52669] Sum rewards: 64.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.201', 'weapon2': '0.740', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.080', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 07:06:39,189][52663] DAMAGECOUNT value on done: 810645.0 [2024-08-06 07:06:39,189][52663] Sum rewards: 71.992, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'weapon5': '0.006', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.146', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.544', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:39,699][52649] DAMAGECOUNT value on done: 799760.0 [2024-08-06 07:06:39,701][52649] Sum rewards: 69.821, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.670', 'AMMO5': '0.019', 'AMMO2': '0.068', 'weapon4': '0.098', 'weapon5': '0.252', 'AMMO3': '0.292', 'AMMO4': '0.340', 'weapon2': '0.418', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.896', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:39,818][52666] DAMAGECOUNT value on done: 816288.0 [2024-08-06 07:06:39,819][52666] Sum rewards: 76.058, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.244', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.275', 'weapon2': '0.396', 'WEAPON3': '1.750', 'weapon3': '3.250', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '66.000'} [2024-08-06 07:06:39,891][52671] DAMAGECOUNT value on done: 815660.0 [2024-08-06 07:06:39,891][52671] Sum rewards: 81.988, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.517', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.107', 'weapon5': '0.124', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.424', 'WEAPON3': '0.750', 'weapon3': '3.076', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:40,915][52665] DAMAGECOUNT value on done: 816614.0 [2024-08-06 07:06:40,916][52665] Sum rewards: 66.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.276', 'weapon2': '0.844', 'WEAPON3': '1.050', 'weapon3': '2.564', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 07:06:41,306][52795] DAMAGECOUNT value on done: 762382.0 [2024-08-06 07:06:41,306][52795] Sum rewards: 67.700, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.495', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.042', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '56.000'} [2024-08-06 07:06:41,331][52670] DAMAGECOUNT value on done: 810074.0 [2024-08-06 07:06:41,331][52670] Sum rewards: 79.892, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.335', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.238', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.516', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:41,745][52803] DAMAGECOUNT value on done: 768794.0 [2024-08-06 07:06:41,746][52803] Sum rewards: 67.813, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.476', 'AMMO5': '0.020', 'AMMO2': '0.068', 'weapon5': '0.234', 'weapon4': '0.250', 'AMMO3': '0.324', 'AMMO4': '0.342', 'weapon2': '0.342', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.950', 'weapon3': '2.772', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:41,789][52820] DAMAGECOUNT value on done: 753752.0 [2024-08-06 07:06:41,791][52820] Sum rewards: 69.109, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.258', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.130', 'AMMO3': '0.156', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '55.500'} [2024-08-06 07:06:41,851][52669] DAMAGECOUNT value on done: 818913.0 [2024-08-06 07:06:41,855][52669] Sum rewards: 74.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'weapon4': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:42,151][52663] DAMAGECOUNT value on done: 808142.0 [2024-08-06 07:06:42,152][52663] Sum rewards: 61.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.992', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.174', 'weapon5': '0.210', 'AMMO3': '0.211', 'AMMO4': '0.227', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '51.500'} [2024-08-06 07:06:42,285][52650] Updated weights for policy 0, policy_version 73971 (0.0015) [2024-08-06 07:06:42,579][52671] DAMAGECOUNT value on done: 828713.0 [2024-08-06 07:06:42,582][52671] Sum rewards: 78.372, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.102', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'weapon2': '0.304', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '68.000'} [2024-08-06 07:06:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 605970432. Throughput: 0: 4350.0. Samples: 151502190. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:42,794][52567] Avg episode reward: [(0, '72.937')] [2024-08-06 07:06:43,159][52666] DAMAGECOUNT value on done: 822700.0 [2024-08-06 07:06:43,160][52666] Sum rewards: 79.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO2': '0.006', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon4': '0.066', 'AMMO3': '0.259', 'weapon2': '0.346', 'WEAPON3': '1.600', 'weapon3': '3.388', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:43,869][52665] DAMAGECOUNT value on done: 812191.0 [2024-08-06 07:06:43,869][52665] Sum rewards: 73.481, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.690', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.030', 'AMMO4': '0.124', 'AMMO3': '0.147', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '0.950', 'HITCOUNT': '3.310', 'weapon3': '3.384', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '58.000'} [2024-08-06 07:06:44,461][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:06:44,465][52795] DAMAGECOUNT value on done: 751827.0 [2024-08-06 07:06:44,467][52795] Sum rewards: 72.841, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.193', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.078', 'weapon5': '0.090', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.258', 'AMMO3': '0.304', 'WEAPON3': '1.800', 'weapon3': '3.332', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:44,622][52670] DAMAGECOUNT value on done: 824052.0 [2024-08-06 07:06:44,623][52670] Sum rewards: 65.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.120', 'AMMO4': '0.157', 'weapon5': '0.180', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:45,165][52669] DAMAGECOUNT value on done: 820303.0 [2024-08-06 07:06:45,165][52669] Sum rewards: 82.146, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.994', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.188', 'AMMO4': '0.249', 'weapon5': '0.252', 'weapon2': '0.274', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon4': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '65.000'} [2024-08-06 07:06:45,371][52663] DAMAGECOUNT value on done: 815635.0 [2024-08-06 07:06:45,371][52663] Sum rewards: 58.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.114', 'AMMO3': '0.172', 'weapon5': '0.192', 'AMMO4': '0.264', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '2.750', 'weapon3': '3.034', 'DAMAGECOUNT': '14.967', 'FRAGCOUNT': '49.000'} [2024-08-06 07:06:45,819][52671] DAMAGECOUNT value on done: 827943.0 [2024-08-06 07:06:45,821][52671] Sum rewards: 76.023, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.528', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.131', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'weapon2': '0.780', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:46,200][52665] DAMAGECOUNT value on done: 814693.0 [2024-08-06 07:06:46,202][52665] Sum rewards: 72.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.428', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.470', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:46,471][52666] DAMAGECOUNT value on done: 818753.0 [2024-08-06 07:06:46,471][52666] Sum rewards: 72.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.806', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.244', 'weapon4': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:47,089][52650] Updated weights for policy 0, policy_version 73981 (0.0011) [2024-08-06 07:06:47,385][52670] DAMAGECOUNT value on done: 813582.0 [2024-08-06 07:06:47,385][52670] Sum rewards: 76.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.815', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:47,629][52795] DAMAGECOUNT value on done: 760854.0 [2024-08-06 07:06:47,629][52795] Sum rewards: 72.316, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.076', 'weapon5': '0.120', 'AMMO4': '0.126', 'AMMO3': '0.165', 'HEALTH': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.000', 'weapon3': '3.086', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '57.000'} [2024-08-06 07:06:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 606060544. Throughput: 0: 4340.9. Samples: 151515020. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:47,795][52567] Avg episode reward: [(0, '72.825')] [2024-08-06 07:06:48,295][52669] DAMAGECOUNT value on done: 825558.0 [2024-08-06 07:06:48,297][52669] Sum rewards: 81.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.505', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.123', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:48,324][52671] DAMAGECOUNT value on done: 823584.0 [2024-08-06 07:06:48,324][52671] Sum rewards: 69.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.386', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '57.500'} [2024-08-06 07:06:48,501][52663] DAMAGECOUNT value on done: 816189.0 [2024-08-06 07:06:48,501][52663] Sum rewards: 75.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.517', 'AMMO5': '0.018', 'AMMO2': '0.050', 'AMMO3': '0.228', 'AMMO4': '0.252', 'weapon2': '0.260', 'weapon5': '0.274', 'weapon4': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:48,503][52665] DAMAGECOUNT value on done: 809641.0 [2024-08-06 07:06:48,505][52665] Sum rewards: 89.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'weapon2': '0.158', 'AMMO3': '0.229', 'WEAPON3': '1.450', 'weapon3': '3.480', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.366', 'FRAGCOUNT': '74.000'} [2024-08-06 07:06:48,948][52666] DAMAGECOUNT value on done: 811910.0 [2024-08-06 07:06:48,956][52666] Sum rewards: 67.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.157', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon5': '0.170', 'weapon2': '0.592', 'WEAPON3': '1.000', 'weapon3': '3.000', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '54.500'} [2024-08-06 07:06:50,379][52670] DAMAGECOUNT value on done: 809576.0 [2024-08-06 07:06:50,379][52670] Sum rewards: 70.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.232', 'weapon2': '0.714', 'WEAPON3': '1.350', 'weapon3': '3.030', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:50,727][52795] DAMAGECOUNT value on done: 767619.0 [2024-08-06 07:06:50,727][52795] Sum rewards: 66.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.038', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.208', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '57.000'} [2024-08-06 07:06:50,917][52665] DAMAGECOUNT value on done: 816059.0 [2024-08-06 07:06:50,919][52665] Sum rewards: 80.731, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.058', 'AMMO4': '0.185', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '66.000'} [2024-08-06 07:06:51,120][52669] DAMAGECOUNT value on done: 848111.0 [2024-08-06 07:06:51,121][52669] Sum rewards: 74.146, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.920', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.124', 'weapon5': '0.224', 'AMMO3': '0.233', 'weapon2': '0.244', 'AMMO4': '0.274', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 07:06:51,256][52671] DAMAGECOUNT value on done: 832206.0 [2024-08-06 07:06:51,256][52671] Sum rewards: 77.804, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.671', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.152', 'weapon2': '0.216', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'weapon3': '3.308', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '67.000'} [2024-08-06 07:06:51,389][52663] DAMAGECOUNT value on done: 824883.0 [2024-08-06 07:06:51,389][52663] Sum rewards: 65.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.168', 'weapon5': '0.168', 'AMMO4': '0.209', 'AMMO3': '0.220', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:51,557][52650] Updated weights for policy 0, policy_version 73991 (0.0016) [2024-08-06 07:06:52,133][52666] DAMAGECOUNT value on done: 819233.0 [2024-08-06 07:06:52,134][52666] Sum rewards: 75.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '62.000'} [2024-08-06 07:06:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 606150656. Throughput: 0: 4349.3. Samples: 151541560. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:52,794][52567] Avg episode reward: [(0, '72.861')] [2024-08-06 07:06:53,211][52665] DAMAGECOUNT value on done: 815630.0 [2024-08-06 07:06:53,212][52665] Sum rewards: 80.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.000', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.046', 'weapon5': '0.118', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'AMMO4': '0.228', 'weapon2': '0.256', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.092', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '64.000'} [2024-08-06 07:06:53,373][52670] DAMAGECOUNT value on done: 812795.0 [2024-08-06 07:06:53,374][52670] Sum rewards: 61.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.990', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO3': '0.161', 'AMMO4': '0.237', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.750', 'weapon3': '3.146', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '49.000'} [2024-08-06 07:06:54,117][52669] DAMAGECOUNT value on done: 833399.0 [2024-08-06 07:06:54,127][52669] Sum rewards: 83.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.025', 'AMMO5': '0.023', 'AMMO2': '0.043', 'weapon4': '0.088', 'weapon5': '0.140', 'AMMO3': '0.210', 'AMMO4': '0.217', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '69.000'} [2024-08-06 07:06:54,408][52671] DAMAGECOUNT value on done: 826578.0 [2024-08-06 07:06:54,409][52671] Sum rewards: 72.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.955', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.170', 'AMMO4': '0.173', 'weapon2': '0.182', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.346', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:54,423][52663] DAMAGECOUNT value on done: 819991.0 [2024-08-06 07:06:54,425][52663] Sum rewards: 72.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.291', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.084', 'weapon4': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'AMMO4': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:54,748][52666] DAMAGECOUNT value on done: 815508.0 [2024-08-06 07:06:54,748][52666] Sum rewards: 72.585, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.655', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:56,076][52665] DAMAGECOUNT value on done: 806316.0 [2024-08-06 07:06:56,077][52665] Sum rewards: 55.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.008', 'AMMO5': '0.023', 'AMMO2': '0.064', 'AMMO3': '0.158', 'weapon2': '0.264', 'weapon5': '0.288', 'AMMO4': '0.321', 'weapon4': '0.330', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.690', 'weapon3': '2.802', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '47.000'} [2024-08-06 07:06:56,196][52670] DAMAGECOUNT value on done: 814215.0 [2024-08-06 07:06:56,200][52670] Sum rewards: 79.851, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.860', 'AMMO5': '0.012', 'AMMO2': '0.065', 'weapon5': '0.206', 'weapon4': '0.232', 'AMMO3': '0.248', 'weapon2': '0.304', 'AMMO4': '0.327', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.970', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '69.000'} [2024-08-06 07:06:56,210][52650] Updated weights for policy 0, policy_version 74001 (0.0012) [2024-08-06 07:06:56,512][52668] DAMAGECOUNT value on done: 828635.0 [2024-08-06 07:06:56,513][52668] Sum rewards: 63.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.268', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.102', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.250', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '54.000'} [2024-08-06 07:06:57,132][52671] DAMAGECOUNT value on done: 814412.0 [2024-08-06 07:06:57,133][52671] Sum rewards: 85.729, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.700', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon2': '0.138', 'weapon5': '0.138', 'AMMO4': '0.146', 'weapon4': '0.226', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '71.000'} [2024-08-06 07:06:57,161][52669] DAMAGECOUNT value on done: 830934.0 [2024-08-06 07:06:57,163][52669] Sum rewards: 88.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.118', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.183', 'FRAGCOUNT': '70.000'} [2024-08-06 07:06:57,486][52663] DAMAGECOUNT value on done: 826004.0 [2024-08-06 07:06:57,490][52663] Sum rewards: 76.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.226', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '63.000'} [2024-08-06 07:06:57,776][52666] DAMAGECOUNT value on done: 810240.0 [2024-08-06 07:06:57,779][52666] Sum rewards: 72.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.425', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.102', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '59.000'} [2024-08-06 07:06:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 606240768. Throughput: 0: 4351.8. Samples: 151568030. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:06:57,794][52567] Avg episode reward: [(0, '73.051')] [2024-08-06 07:06:58,614][52665] DAMAGECOUNT value on done: 812462.0 [2024-08-06 07:06:58,615][52665] Sum rewards: 83.804, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.490', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.131', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.496', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '66.000'} [2024-08-06 07:06:59,002][52668] DAMAGECOUNT value on done: 829720.0 [2024-08-06 07:06:59,002][52668] Sum rewards: 80.132, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.115', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.114', 'weapon4': '0.120', 'AMMO3': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.542', 'WEAPON3': '0.750', 'weapon3': '3.124', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '61.000'} [2024-08-06 07:06:59,082][52670] DAMAGECOUNT value on done: 808505.0 [2024-08-06 07:06:59,083][52670] Sum rewards: 65.870, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.080', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.038', 'weapon4': '0.128', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.850', 'weapon3': '3.016', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '60.000'} [2024-08-06 07:06:59,887][52671] DAMAGECOUNT value on done: 837684.0 [2024-08-06 07:06:59,887][52671] Sum rewards: 77.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.861', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon5': '0.244', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:00,413][52669] DAMAGECOUNT value on done: 833612.0 [2024-08-06 07:07:00,413][52669] Sum rewards: 76.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.154', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.130', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:00,450][52666] DAMAGECOUNT value on done: 820488.0 [2024-08-06 07:07:00,450][52666] Sum rewards: 93.451, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.956', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.118', 'weapon4': '0.138', 'AMMO4': '0.141', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.303', 'FRAGCOUNT': '76.000'} [2024-08-06 07:07:00,617][52795] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2024-08-06 07:07:00,736][52663] DAMAGECOUNT value on done: 829330.0 [2024-08-06 07:07:00,738][52663] Sum rewards: 70.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'weapon4': '0.156', 'AMMO3': '0.185', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.120', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '58.000'} [2024-08-06 07:07:00,900][52650] Updated weights for policy 0, policy_version 74011 (0.0014) [2024-08-06 07:07:01,362][52665] DAMAGECOUNT value on done: 816398.0 [2024-08-06 07:07:01,362][52665] Sum rewards: 73.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.798', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.062', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'weapon2': '0.442', 'WEAPON3': '1.600', 'weapon3': '3.178', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:01,559][52668] DAMAGECOUNT value on done: 825865.0 [2024-08-06 07:07:01,560][52668] Sum rewards: 74.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.654', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.134', 'AMMO3': '0.208', 'AMMO4': '0.240', 'weapon5': '0.242', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '61.000'} [2024-08-06 07:07:01,703][52670] DAMAGECOUNT value on done: 820654.0 [2024-08-06 07:07:01,705][52670] Sum rewards: 79.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.535', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.046', 'AMMO4': '0.170', 'weapon5': '0.208', 'weapon2': '0.226', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '66.000'} [2024-08-06 07:07:02,702][52671] DAMAGECOUNT value on done: 832334.0 [2024-08-06 07:07:02,705][52671] Sum rewards: 68.965, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.974', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.144', 'AMMO4': '0.180', 'weapon4': '0.204', 'weapon2': '0.208', 'AMMO3': '0.257', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.204', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '59.000'} [2024-08-06 07:07:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 606322688. Throughput: 0: 4354.2. Samples: 151581330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:02,795][52567] Avg episode reward: [(0, '73.668')] [2024-08-06 07:07:03,238][52669] DAMAGECOUNT value on done: 836281.0 [2024-08-06 07:07:03,239][52669] Sum rewards: 81.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.014', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.042', 'weapon4': '0.128', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '69.000'} [2024-08-06 07:07:03,352][52666] DAMAGECOUNT value on done: 812827.0 [2024-08-06 07:07:03,352][52666] Sum rewards: 71.902, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.875', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.078', 'AMMO4': '0.175', 'weapon5': '0.210', 'weapon2': '0.252', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '61.000'} [2024-08-06 07:07:03,461][52663] DAMAGECOUNT value on done: 814409.0 [2024-08-06 07:07:03,461][52663] Sum rewards: 75.401, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.817', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.118', 'AMMO4': '0.121', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:04,441][52668] DAMAGECOUNT value on done: 832222.0 [2024-08-06 07:07:04,443][52668] Sum rewards: 88.791, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.290', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.336', 'WEAPON3': '0.950', 'weapon3': '3.466', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '69.000'} [2024-08-06 07:07:04,684][52670] DAMAGECOUNT value on done: 804319.0 [2024-08-06 07:07:04,684][52670] Sum rewards: 75.740, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.374', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.106', 'weapon4': '0.112', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '65.000'} [2024-08-06 07:07:05,597][52650] Updated weights for policy 0, policy_version 74021 (0.0019) [2024-08-06 07:07:05,947][52666] DAMAGECOUNT value on done: 820294.0 [2024-08-06 07:07:05,948][52666] Sum rewards: 75.349, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.430', 'AMMO5': '0.007', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.074', 'weapon2': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.314', 'WEAPON3': '1.850', 'weapon3': '3.508', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '68.000'} [2024-08-06 07:07:05,986][52671] DAMAGECOUNT value on done: 829008.0 [2024-08-06 07:07:05,987][52671] Sum rewards: 76.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.034', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.450', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.000'} [2024-08-06 07:07:07,442][52670] DAMAGECOUNT value on done: 818356.0 [2024-08-06 07:07:07,442][52670] Sum rewards: 80.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.805', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.030', 'weapon5': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.199', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.470', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '67.000'} [2024-08-06 07:07:07,671][52668] DAMAGECOUNT value on done: 816295.0 [2024-08-06 07:07:07,671][52668] Sum rewards: 79.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.144', 'weapon4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '66.000'} [2024-08-06 07:07:07,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17494.8). Total num frames: 606412800. Throughput: 0: 4359.3. Samples: 151607630. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:07,795][52567] Avg episode reward: [(0, '73.660')] [2024-08-06 07:07:08,310][52671] DAMAGECOUNT value on done: 832419.0 [2024-08-06 07:07:08,310][52671] Sum rewards: 77.187, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.993', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.080', 'weapon5': '0.154', 'AMMO4': '0.242', 'AMMO3': '0.251', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.198', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '67.000'} [2024-08-06 07:07:08,908][52666] DAMAGECOUNT value on done: 806190.0 [2024-08-06 07:07:08,909][52666] Sum rewards: 63.312, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.723', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.160', 'weapon2': '0.196', 'AMMO4': '0.199', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.060', 'weapon3': '3.320', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '55.000'} [2024-08-06 07:07:10,157][52650] Updated weights for policy 0, policy_version 74031 (0.0012) [2024-08-06 07:07:10,254][52670] DAMAGECOUNT value on done: 823128.0 [2024-08-06 07:07:10,256][52670] Sum rewards: 83.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.128', 'weapon5': '0.140', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.308', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '68.000'} [2024-08-06 07:07:10,935][52668] DAMAGECOUNT value on done: 827627.0 [2024-08-06 07:07:10,946][52668] Sum rewards: 69.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.514', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.108', 'AMMO4': '0.134', 'weapon4': '0.200', 'weapon2': '0.216', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.180', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '60.000'} [2024-08-06 07:07:11,228][52671] DAMAGECOUNT value on done: 818765.0 [2024-08-06 07:07:11,230][52671] Sum rewards: 77.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.172', 'weapon5': '0.178', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '64.000'} [2024-08-06 07:07:11,678][52666] DAMAGECOUNT value on done: 822839.0 [2024-08-06 07:07:11,679][52666] Sum rewards: 74.691, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.792', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.206', 'AMMO3': '0.224', 'weapon2': '0.238', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.904', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 07:07:12,518][52803] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:07:12,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 606502912. Throughput: 0: 4373.1. Samples: 151634070. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:12,795][52567] Avg episode reward: [(0, '73.676')] [2024-08-06 07:07:13,114][52670] DAMAGECOUNT value on done: 818096.0 [2024-08-06 07:07:13,116][52670] Sum rewards: 67.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.276', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.126', 'AMMO3': '0.167', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '54.000'} [2024-08-06 07:07:13,947][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:07:14,210][52668] DAMAGECOUNT value on done: 827246.0 [2024-08-06 07:07:14,211][52668] Sum rewards: 74.925, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.076', 'weapon5': '0.142', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:14,784][52666] DAMAGECOUNT value on done: 818780.0 [2024-08-06 07:07:14,786][52666] Sum rewards: 76.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.406', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '65.000'} [2024-08-06 07:07:15,085][52650] Updated weights for policy 0, policy_version 74041 (0.0019) [2024-08-06 07:07:16,441][52670] DAMAGECOUNT value on done: 799891.0 [2024-08-06 07:07:16,443][52670] Sum rewards: 76.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.078', 'weapon5': '0.162', 'AMMO3': '0.174', 'AMMO4': '0.203', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.808', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '61.000'} [2024-08-06 07:07:17,231][52668] DAMAGECOUNT value on done: 818090.0 [2024-08-06 07:07:17,232][52668] Sum rewards: 64.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.012', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.068', 'AMMO4': '0.134', 'weapon5': '0.142', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.044', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '54.500'} [2024-08-06 07:07:17,680][52666] DAMAGECOUNT value on done: 818342.0 [2024-08-06 07:07:17,681][52666] Sum rewards: 77.093, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.410', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon2': '0.244', 'weapon5': '0.260', 'weapon4': '0.274', 'AMMO4': '0.286', 'AMMO3': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.900', 'weapon3': '2.840', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '69.000'} [2024-08-06 07:07:17,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 606584832. Throughput: 0: 4382.0. Samples: 151647160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:17,795][52567] Avg episode reward: [(0, '73.730')] [2024-08-06 07:07:18,957][52670] DAMAGECOUNT value on done: 815000.0 [2024-08-06 07:07:18,958][52670] Sum rewards: 74.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.456', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO3': '0.158', 'AMMO4': '0.184', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.916', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '59.500'} [2024-08-06 07:07:19,373][52650] Updated weights for policy 0, policy_version 74051 (0.0011) [2024-08-06 07:07:20,276][52666] DAMAGECOUNT value on done: 813204.0 [2024-08-06 07:07:20,276][52666] Sum rewards: 96.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.040', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.124', 'AMMO4': '0.126', 'AMMO3': '0.151', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '0.950', 'weapon3': '3.374', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '76.000'} [2024-08-06 07:07:20,473][52668] DAMAGECOUNT value on done: 821669.0 [2024-08-06 07:07:20,474][52668] Sum rewards: 78.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon4': '0.266', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:20,475][52662] DAMAGECOUNT value on done: 823268.0 [2024-08-06 07:07:20,478][52662] Sum rewards: 71.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.176', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '59.000'} [2024-08-06 07:07:21,966][52670] DAMAGECOUNT value on done: 823685.0 [2024-08-06 07:07:21,974][52670] Sum rewards: 82.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.118', 'weapon4': '0.160', 'AMMO4': '0.160', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.732', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '66.000'} [2024-08-06 07:07:22,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 606683136. Throughput: 0: 4388.3. Samples: 151673440. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:22,794][52567] Avg episode reward: [(0, '74.157')] [2024-08-06 07:07:23,041][52666] DAMAGECOUNT value on done: 812090.0 [2024-08-06 07:07:23,041][52666] Sum rewards: 71.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.286', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.114', 'weapon5': '0.128', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '58.500'} [2024-08-06 07:07:23,578][52668] DAMAGECOUNT value on done: 828272.0 [2024-08-06 07:07:23,580][52668] Sum rewards: 73.285, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.074', 'weapon5': '0.154', 'AMMO3': '0.240', 'AMMO4': '0.246', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '62.000'} [2024-08-06 07:07:23,693][52662] DAMAGECOUNT value on done: 834042.0 [2024-08-06 07:07:23,694][52662] Sum rewards: 62.366, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.142', 'weapon4': '0.154', 'AMMO4': '0.161', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '56.000'} [2024-08-06 07:07:24,229][52670] DAMAGECOUNT value on done: 815742.0 [2024-08-06 07:07:24,231][52670] Sum rewards: 52.041, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.127', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.172', 'weapon4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon2': '0.306', 'WEAPON3': '1.550', 'HITCOUNT': '2.860', 'weapon3': '3.126', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '47.000'} [2024-08-06 07:07:24,432][52650] Updated weights for policy 0, policy_version 74061 (0.0013) [2024-08-06 07:07:25,444][52666] DAMAGECOUNT value on done: 827805.0 [2024-08-06 07:07:25,446][52666] Sum rewards: 62.084, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.605', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.104', 'AMMO4': '0.165', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.311', 'weapon2': '0.492', 'WEAPON3': '1.650', 'weapon3': '2.910', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '54.000'} [2024-08-06 07:07:26,280][52668] DAMAGECOUNT value on done: 821771.0 [2024-08-06 07:07:26,281][52668] Sum rewards: 60.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.240', 'AMMO5': '0.024', 'AMMO2': '0.045', 'AMMO3': '0.147', 'weapon4': '0.210', 'weapon5': '0.222', 'AMMO4': '0.224', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.864', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.651', 'FRAGCOUNT': '48.000'} [2024-08-06 07:07:26,553][52662] DAMAGECOUNT value on done: 834166.0 [2024-08-06 07:07:26,556][52662] Sum rewards: 85.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.108', 'AMMO3': '0.178', 'AMMO4': '0.224', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '70.000'} [2024-08-06 07:07:27,165][52670] DAMAGECOUNT value on done: 818359.0 [2024-08-06 07:07:27,175][52670] Sum rewards: 58.303, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.944', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.116', 'AMMO4': '0.120', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '2.780', 'weapon3': '3.384', 'DAMAGECOUNT': '13.611', 'FRAGCOUNT': '50.000'} [2024-08-06 07:07:27,676][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:07:27,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 606773248. Throughput: 0: 4382.0. Samples: 151699380. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:27,794][52567] Avg episode reward: [(0, '73.907')] [2024-08-06 07:07:28,675][52666] DAMAGECOUNT value on done: 805486.0 [2024-08-06 07:07:28,677][52666] Sum rewards: 72.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.060', 'weapon5': '0.154', 'AMMO3': '0.186', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.770', 'WEAPON3': '1.100', 'weapon3': '2.800', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '59.000'} [2024-08-06 07:07:28,758][52668] DAMAGECOUNT value on done: 817789.0 [2024-08-06 07:07:28,758][52668] Sum rewards: 79.200, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.072', 'AMMO4': '0.135', 'weapon5': '0.164', 'WEAPON4': '0.250', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.700', 'weapon3': '3.144', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '68.000'} [2024-08-06 07:07:28,991][52650] Updated weights for policy 0, policy_version 74071 (0.0014) [2024-08-06 07:07:29,286][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:07:29,554][52662] DAMAGECOUNT value on done: 819110.0 [2024-08-06 07:07:29,554][52662] Sum rewards: 83.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.075', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.306', 'WEAPON3': '1.500', 'weapon3': '3.244', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '71.000'} [2024-08-06 07:07:31,792][52668] DAMAGECOUNT value on done: 813939.0 [2024-08-06 07:07:31,793][52668] Sum rewards: 76.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.365', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '65.000'} [2024-08-06 07:07:31,857][52666] DAMAGECOUNT value on done: 813660.0 [2024-08-06 07:07:31,858][52666] Sum rewards: 68.958, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.430', 'AMMO5': '0.018', 'AMMO2': '0.030', 'weapon4': '0.098', 'AMMO4': '0.152', 'weapon5': '0.206', 'weapon2': '0.246', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.192', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '60.000'} [2024-08-06 07:07:32,325][52662] DAMAGECOUNT value on done: 836834.0 [2024-08-06 07:07:32,336][52662] Sum rewards: 83.269, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.862', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.242', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '70.000'} [2024-08-06 07:07:32,763][52667] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:07:32,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 606846976. Throughput: 0: 4385.1. Samples: 151712350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:32,795][52567] Avg episode reward: [(0, '74.172')] [2024-08-06 07:07:32,963][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:07:33,524][52650] Updated weights for policy 0, policy_version 74081 (0.0011) [2024-08-06 07:07:34,690][52668] DAMAGECOUNT value on done: 814556.0 [2024-08-06 07:07:34,691][52668] Sum rewards: 83.757, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.170', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.108', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.650', 'weapon3': '3.268', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '72.000'} [2024-08-06 07:07:35,227][52662] DAMAGECOUNT value on done: 816432.0 [2024-08-06 07:07:35,229][52662] Sum rewards: 88.900, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.439', 'AMMO5': '0.022', 'AMMO2': '0.065', 'weapon4': '0.162', 'AMMO3': '0.211', 'weapon5': '0.252', 'AMMO4': '0.326', 'weapon2': '0.338', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '23.046', 'FRAGCOUNT': '72.000'} [2024-08-06 07:07:37,318][52668] DAMAGECOUNT value on done: 809552.0 [2024-08-06 07:07:37,320][52668] Sum rewards: 66.330, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.660', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.054', 'weapon5': '0.144', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.100', 'HITCOUNT': '3.040', 'weapon3': '3.290', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '53.000'} [2024-08-06 07:07:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 606937088. Throughput: 0: 4383.8. Samples: 151738830. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:37,794][52567] Avg episode reward: [(0, '74.495')] [2024-08-06 07:07:37,947][52662] DAMAGECOUNT value on done: 822857.0 [2024-08-06 07:07:37,947][52662] Sum rewards: 71.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.312', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.120', 'weapon4': '0.120', 'AMMO3': '0.227', 'WEAPON3': '1.300', 'weapon3': '3.550', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2024-08-06 07:07:38,611][52650] Updated weights for policy 0, policy_version 74091 (0.0023) [2024-08-06 07:07:40,502][52668] DAMAGECOUNT value on done: 822551.0 [2024-08-06 07:07:40,504][52668] Sum rewards: 80.455, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.134', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.110', 'AMMO4': '0.192', 'weapon5': '0.206', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '69.000'} [2024-08-06 07:07:40,685][52662] DAMAGECOUNT value on done: 840086.0 [2024-08-06 07:07:40,686][52662] Sum rewards: 83.854, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.038', 'weapon4': '0.098', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'HEALTH': '0.480', 'weapon2': '0.570', 'WEAPON3': '0.900', 'weapon3': '3.146', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '66.000'} [2024-08-06 07:07:41,241][52660] DAMAGECOUNT value on done: 821132.0 [2024-08-06 07:07:41,242][52660] Sum rewards: 63.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.703', 'AMMO5': '0.012', 'AMMO2': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.070', 'weapon5': '0.192', 'AMMO3': '0.217', 'weapon2': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '53.000'} [2024-08-06 07:07:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 607027200. Throughput: 0: 4373.6. Samples: 151764840. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:07:42,794][52567] Avg episode reward: [(0, '74.568')] [2024-08-06 07:07:42,833][52650] Updated weights for policy 0, policy_version 74101 (0.0014) [2024-08-06 07:07:43,438][52668] DAMAGECOUNT value on done: 826846.0 [2024-08-06 07:07:43,438][52668] Sum rewards: 79.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.597', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.128', 'weapon4': '0.140', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:43,735][52662] DAMAGECOUNT value on done: 826806.0 [2024-08-06 07:07:43,737][52662] Sum rewards: 76.574, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.908', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.070', 'AMMO4': '0.122', 'weapon4': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.232', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '65.000'} [2024-08-06 07:07:44,330][52660] DAMAGECOUNT value on done: 814002.0 [2024-08-06 07:07:44,332][52660] Sum rewards: 76.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.870', 'AMMO5': '0.016', 'AMMO2': '0.030', 'weapon4': '0.038', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '62.000'} [2024-08-06 07:07:45,845][52667] DAMAGECOUNT value on done: 823604.0 [2024-08-06 07:07:45,847][52667] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.928', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon4': '0.054', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.388', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '58.000'} [2024-08-06 07:07:46,609][52668] DAMAGECOUNT value on done: 823047.0 [2024-08-06 07:07:46,609][52668] Sum rewards: 85.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO2': '0.016', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.207', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.448', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '69.000'} [2024-08-06 07:07:46,784][52662] DAMAGECOUNT value on done: 832206.0 [2024-08-06 07:07:46,786][52662] Sum rewards: 80.385, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.042', 'weapon5': '0.052', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '66.000'} [2024-08-06 07:07:47,466][52660] DAMAGECOUNT value on done: 826013.0 [2024-08-06 07:07:47,467][52660] Sum rewards: 75.761, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.772', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon2': '0.178', 'AMMO3': '0.204', 'weapon4': '0.240', 'AMMO4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '62.000'} [2024-08-06 07:07:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 607109120. Throughput: 0: 4366.6. Samples: 151777830. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:07:47,795][52567] Avg episode reward: [(0, '74.875')] [2024-08-06 07:07:47,841][52650] Updated weights for policy 0, policy_version 74111 (0.0024) [2024-08-06 07:07:48,736][52667] DAMAGECOUNT value on done: 834319.0 [2024-08-06 07:07:48,737][52667] Sum rewards: 83.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.171', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '68.000'} [2024-08-06 07:07:48,915][52647] DAMAGECOUNT value on done: 878944.0 [2024-08-06 07:07:48,915][52647] Sum rewards: 72.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.639', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.186', 'AMMO3': '0.193', 'AMMO4': '0.222', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '59.000'} [2024-08-06 07:07:49,459][52664] DAMAGECOUNT value on done: 853004.0 [2024-08-06 07:07:49,459][52664] Sum rewards: 68.504, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.740', 'AMMO5': '0.016', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.114', 'weapon4': '0.148', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.220', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '55.000'} [2024-08-06 07:07:49,459][52668] DAMAGECOUNT value on done: 828467.0 [2024-08-06 07:07:49,462][52668] Sum rewards: 65.703, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.034', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.058', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.252', 'weapon4': '0.268', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '57.000'} [2024-08-06 07:07:49,898][52662] DAMAGECOUNT value on done: 822442.0 [2024-08-06 07:07:49,900][52662] Sum rewards: 80.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '67.000'} [2024-08-06 07:07:50,079][52660] DAMAGECOUNT value on done: 837442.0 [2024-08-06 07:07:50,079][52660] Sum rewards: 79.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'ARMOR': '0.004', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon4': '0.168', 'AMMO3': '0.220', 'weapon2': '0.310', 'AMMO4': '0.324', 'weapon5': '0.342', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '66.000'} [2024-08-06 07:07:51,359][52667] DAMAGECOUNT value on done: 829360.0 [2024-08-06 07:07:51,360][52667] Sum rewards: 76.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.092', 'AMMO3': '0.181', 'AMMO4': '0.195', 'weapon2': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.400', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '62.000'} [2024-08-06 07:07:51,608][52647] DAMAGECOUNT value on done: 866920.0 [2024-08-06 07:07:51,608][52647] Sum rewards: 82.138, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.268', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.114', 'weapon4': '0.134', 'AMMO4': '0.166', 'weapon2': '0.196', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.284', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.889', 'FRAGCOUNT': '70.500'} [2024-08-06 07:07:52,119][52650] Updated weights for policy 0, policy_version 74121 (0.0011) [2024-08-06 07:07:52,220][52668] DAMAGECOUNT value on done: 828023.0 [2024-08-06 07:07:52,221][52668] Sum rewards: 81.517, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.465', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.220', 'AMMO3': '0.225', 'weapon2': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '68.000'} [2024-08-06 07:07:52,363][52664] DAMAGECOUNT value on done: 858179.0 [2024-08-06 07:07:52,364][52664] Sum rewards: 83.370, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.003', 'AMMO2': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'weapon2': '0.162', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.584', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '71.000'} [2024-08-06 07:07:52,548][52662] DAMAGECOUNT value on done: 825243.0 [2024-08-06 07:07:52,548][52662] Sum rewards: 70.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon2': '0.184', 'AMMO3': '0.200', 'weapon5': '0.202', 'AMMO4': '0.229', 'weapon4': '0.412', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '58.500'} [2024-08-06 07:07:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 607199232. Throughput: 0: 4366.9. Samples: 151804140. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:07:52,794][52567] Avg episode reward: [(0, '75.263')] [2024-08-06 07:07:53,025][52660] DAMAGECOUNT value on done: 818312.0 [2024-08-06 07:07:53,026][52660] Sum rewards: 73.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.672', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '61.000'} [2024-08-06 07:07:53,595][52667] DAMAGECOUNT value on done: 835686.0 [2024-08-06 07:07:53,596][52667] Sum rewards: 79.705, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.296', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.112', 'weapon4': '0.146', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '64.000'} [2024-08-06 07:07:54,540][52667] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:07:54,828][52647] DAMAGECOUNT value on done: 874224.0 [2024-08-06 07:07:54,828][52647] Sum rewards: 62.790, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.506', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO3': '0.230', 'AMMO4': '0.232', 'weapon4': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.550', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '53.500'} [2024-08-06 07:07:55,404][52664] DAMAGECOUNT value on done: 858552.0 [2024-08-06 07:07:55,404][52664] Sum rewards: 85.409, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.286', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon5': '0.158', 'weapon2': '0.682', 'WEAPON3': '1.100', 'weapon3': '2.954', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '69.000'} [2024-08-06 07:07:55,486][52662] DAMAGECOUNT value on done: 817455.0 [2024-08-06 07:07:55,486][52662] Sum rewards: 79.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.726', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO3': '0.145', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.050', 'weapon3': '3.410', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:55,748][52660] DAMAGECOUNT value on done: 815599.0 [2024-08-06 07:07:55,749][52660] Sum rewards: 70.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.014', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.219', 'weapon2': '0.274', 'WEAPON3': '1.300', 'weapon3': '3.468', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '58.000'} [2024-08-06 07:07:56,390][52667] DAMAGECOUNT value on done: 837040.0 [2024-08-06 07:07:56,390][52667] Sum rewards: 71.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.815', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon5': '0.198', 'weapon2': '0.214', 'AMMO3': '0.216', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon4': '0.692', 'WEAPON3': '1.350', 'weapon3': '2.576', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '60.000'} [2024-08-06 07:07:57,048][52650] Updated weights for policy 0, policy_version 74131 (0.0013) [2024-08-06 07:07:57,631][52647] DAMAGECOUNT value on done: 871899.0 [2024-08-06 07:07:57,631][52647] Sum rewards: 74.227, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.251', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.022', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'weapon5': '0.146', 'AMMO3': '0.187', 'weapon2': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '58.000'} [2024-08-06 07:07:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 607289344. Throughput: 0: 4363.6. Samples: 151830430. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:07:57,794][52567] Avg episode reward: [(0, '75.300')] [2024-08-06 07:07:58,212][52662] DAMAGECOUNT value on done: 830533.0 [2024-08-06 07:07:58,212][52662] Sum rewards: 76.902, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'weapon5': '0.024', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.205', 'weapon2': '0.402', 'HEALTH': '0.612', 'WEAPON3': '1.100', 'weapon3': '3.204', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '62.000'} [2024-08-06 07:07:58,447][52664] DAMAGECOUNT value on done: 851477.0 [2024-08-06 07:07:58,447][52664] Sum rewards: 72.593, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.628', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO4': '0.169', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.291', 'WEAPON3': '1.800', 'weapon3': '3.296', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '63.000'} [2024-08-06 07:07:58,771][52660] DAMAGECOUNT value on done: 823065.0 [2024-08-06 07:07:58,773][52660] Sum rewards: 76.148, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.180', 'weapon5': '0.204', 'AMMO3': '0.210', 'weapon2': '0.278', 'AMMO4': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '65.000'} [2024-08-06 07:07:59,342][52667] DAMAGECOUNT value on done: 833552.0 [2024-08-06 07:07:59,343][52667] Sum rewards: 80.386, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon4': '0.334', 'weapon2': '0.368', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:00,360][52647] DAMAGECOUNT value on done: 879399.0 [2024-08-06 07:08:00,362][52647] Sum rewards: 89.112, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.504', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.114', 'AMMO4': '0.145', 'weapon4': '0.166', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.130', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '72.000'} [2024-08-06 07:08:01,025][52664] DAMAGECOUNT value on done: 861773.0 [2024-08-06 07:08:01,025][52664] Sum rewards: 63.299, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.785', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.136', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '54.000'} [2024-08-06 07:08:01,515][52662] DAMAGECOUNT value on done: 818623.0 [2024-08-06 07:08:01,517][52662] Sum rewards: 80.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.844', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.054', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.478', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '68.000'} [2024-08-06 07:08:01,635][52660] DAMAGECOUNT value on done: 830464.0 [2024-08-06 07:08:01,637][52660] Sum rewards: 81.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.779', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO4': '0.144', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '66.000'} [2024-08-06 07:08:02,225][52650] Updated weights for policy 0, policy_version 74141 (0.0011) [2024-08-06 07:08:02,300][52667] DAMAGECOUNT value on done: 831021.0 [2024-08-06 07:08:02,300][52667] Sum rewards: 73.725, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.947', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.122', 'AMMO4': '0.168', 'AMMO3': '0.279', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.184', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '64.500'} [2024-08-06 07:08:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 607371264. Throughput: 0: 4359.8. Samples: 151843350. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:08:02,802][52567] Avg episode reward: [(0, '75.618')] [2024-08-06 07:08:03,042][52647] DAMAGECOUNT value on done: 874633.0 [2024-08-06 07:08:03,043][52647] Sum rewards: 64.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.935', 'WEAPON1': '0.010', 'AMMO5': '0.021', 'AMMO2': '0.076', 'weapon4': '0.206', 'AMMO3': '0.226', 'weapon5': '0.292', 'AMMO4': '0.382', 'weapon2': '0.410', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.724', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '53.500'} [2024-08-06 07:08:03,933][52664] DAMAGECOUNT value on done: 856575.0 [2024-08-06 07:08:03,933][52664] Sum rewards: 77.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.202', 'AMMO2': '0.002', 'WEAPON1': '0.010', 'AMMO4': '0.010', 'AMMO3': '0.223', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:04,096][52662] DAMAGECOUNT value on done: 835078.0 [2024-08-06 07:08:04,096][52662] Sum rewards: 73.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.220', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2024-08-06 07:08:04,864][52660] DAMAGECOUNT value on done: 816866.0 [2024-08-06 07:08:04,866][52660] Sum rewards: 67.542, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.761', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon4': '0.052', 'weapon5': '0.094', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon2': '0.728', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '57.000'} [2024-08-06 07:08:05,363][52667] DAMAGECOUNT value on done: 826041.0 [2024-08-06 07:08:05,364][52667] Sum rewards: 81.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.101', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.068', 'weapon5': '0.164', 'AMMO3': '0.185', 'AMMO4': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '65.000'} [2024-08-06 07:08:06,033][52647] DAMAGECOUNT value on done: 877970.0 [2024-08-06 07:08:06,035][52647] Sum rewards: 76.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.982', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.094', 'AMMO4': '0.181', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:06,421][52650] Updated weights for policy 0, policy_version 74151 (0.0037) [2024-08-06 07:08:06,699][52662] DAMAGECOUNT value on done: 828806.0 [2024-08-06 07:08:06,700][52662] Sum rewards: 84.577, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.575', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.154', 'weapon5': '0.166', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.541', 'FRAGCOUNT': '69.000'} [2024-08-06 07:08:07,073][52664] DAMAGECOUNT value on done: 851354.0 [2024-08-06 07:08:07,073][52664] Sum rewards: 80.260, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.606', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.147', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:07,467][52660] DAMAGECOUNT value on done: 816299.0 [2024-08-06 07:08:07,467][52660] Sum rewards: 69.241, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'ARMOR': '0.008', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.199', 'weapon4': '0.202', 'weapon5': '0.240', 'AMMO4': '0.327', 'weapon2': '0.498', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.738', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '57.000'} [2024-08-06 07:08:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 607461376. Throughput: 0: 4361.5. Samples: 151869710. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:08:07,802][52567] Avg episode reward: [(0, '75.516')] [2024-08-06 07:08:08,452][52667] DAMAGECOUNT value on done: 829105.0 [2024-08-06 07:08:08,454][52667] Sum rewards: 77.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO5': '0.007', 'weapon5': '0.044', 'WEAPON4': '0.100', 'weapon2': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon4': '0.378', 'WEAPON3': '1.750', 'weapon3': '3.214', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '66.000'} [2024-08-06 07:08:09,162][52647] DAMAGECOUNT value on done: 857041.0 [2024-08-06 07:08:09,162][52647] Sum rewards: 88.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.086', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.240', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.956', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '72.000'} [2024-08-06 07:08:09,227][52662] DAMAGECOUNT value on done: 812260.0 [2024-08-06 07:08:09,228][52662] Sum rewards: 70.994, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.164', 'weapon5': '0.180', 'AMMO4': '0.260', 'weapon4': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.820', 'WEAPON3': '1.050', 'weapon3': '2.356', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 07:08:10,022][52659] DAMAGECOUNT value on done: 827196.0 [2024-08-06 07:08:10,024][52659] Sum rewards: 73.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.510', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.121', 'weapon5': '0.156', 'weapon2': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.310', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:10,264][52664] DAMAGECOUNT value on done: 845702.0 [2024-08-06 07:08:10,264][52664] Sum rewards: 68.934, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.840', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.152', 'weapon5': '0.152', 'AMMO3': '0.224', 'AMMO4': '0.301', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:10,552][52660] DAMAGECOUNT value on done: 827065.0 [2024-08-06 07:08:10,553][52660] Sum rewards: 79.353, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon4': '0.122', 'weapon5': '0.122', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.286', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '68.000'} [2024-08-06 07:08:10,987][52650] Updated weights for policy 0, policy_version 74161 (0.0012) [2024-08-06 07:08:11,311][52667] DAMAGECOUNT value on done: 833417.0 [2024-08-06 07:08:11,312][52667] Sum rewards: 73.636, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.203', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.070', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:12,029][52647] DAMAGECOUNT value on done: 872471.0 [2024-08-06 07:08:12,031][52647] Sum rewards: 79.615, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.080', 'HEALTH': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:12,278][52662] DAMAGECOUNT value on done: 823278.0 [2024-08-06 07:08:12,278][52662] Sum rewards: 67.956, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.148', 'AMMO4': '0.174', 'AMMO3': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.920', 'WEAPON3': '1.100', 'weapon3': '2.658', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '55.000'} [2024-08-06 07:08:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 607551488. Throughput: 0: 4370.9. Samples: 151896070. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:08:12,795][52567] Avg episode reward: [(0, '75.513')] [2024-08-06 07:08:13,048][52664] DAMAGECOUNT value on done: 860512.0 [2024-08-06 07:08:13,049][52664] Sum rewards: 86.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.618', 'AMMO5': '0.024', 'AMMO2': '0.054', 'weapon4': '0.122', 'AMMO3': '0.153', 'weapon2': '0.190', 'weapon5': '0.204', 'AMMO4': '0.270', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '3.296', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '69.000'} [2024-08-06 07:08:13,065][52659] DAMAGECOUNT value on done: 823394.0 [2024-08-06 07:08:13,068][52659] Sum rewards: 50.595, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.868', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.196', 'AMMO4': '0.201', 'weapon2': '0.264', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.670', 'weapon3': '3.136', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '45.000'} [2024-08-06 07:08:13,624][52660] DAMAGECOUNT value on done: 815908.0 [2024-08-06 07:08:13,624][52660] Sum rewards: 63.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.090', 'AMMO4': '0.142', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '53.000'} [2024-08-06 07:08:13,772][52667] DAMAGECOUNT value on done: 823633.0 [2024-08-06 07:08:13,773][52667] Sum rewards: 65.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.689', 'AMMO5': '0.019', 'AMMO2': '0.062', 'AMMO3': '0.224', 'weapon5': '0.226', 'weapon2': '0.268', 'AMMO4': '0.312', 'weapon4': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '54.500'} [2024-08-06 07:08:14,834][52820] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:08:15,063][52647] DAMAGECOUNT value on done: 870654.0 [2024-08-06 07:08:15,064][52647] Sum rewards: 78.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.085', 'AMMO5': '0.009', 'weapon4': '0.014', 'weapon5': '0.020', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '66.000'} [2024-08-06 07:08:15,140][52662] DAMAGECOUNT value on done: 815927.0 [2024-08-06 07:08:15,142][52662] Sum rewards: 75.491, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.448', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.092', 'AMMO3': '0.226', 'AMMO4': '0.242', 'weapon5': '0.298', 'weapon2': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '60.500'} [2024-08-06 07:08:15,735][52659] DAMAGECOUNT value on done: 831135.0 [2024-08-06 07:08:15,737][52659] Sum rewards: 90.226, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.813', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.122', 'weapon5': '0.126', 'AMMO3': '0.177', 'AMMO4': '0.178', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.339', 'FRAGCOUNT': '72.000'} [2024-08-06 07:08:15,768][52666] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:08:15,943][52650] Updated weights for policy 0, policy_version 74171 (0.0013) [2024-08-06 07:08:16,090][52664] DAMAGECOUNT value on done: 852500.0 [2024-08-06 07:08:16,090][52664] Sum rewards: 71.381, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.540', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.052', 'AMMO4': '0.083', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '3.086', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '57.000'} [2024-08-06 07:08:16,421][52660] DAMAGECOUNT value on done: 820589.0 [2024-08-06 07:08:16,440][52660] Sum rewards: 60.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.678', 'AMMO5': '0.014', 'AMMO2': '0.042', 'AMMO3': '0.195', 'weapon5': '0.198', 'AMMO4': '0.209', 'weapon4': '0.290', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.757', 'FRAGCOUNT': '51.000'} [2024-08-06 07:08:16,612][52667] DAMAGECOUNT value on done: 827401.0 [2024-08-06 07:08:16,612][52667] Sum rewards: 75.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.149', 'weapon5': '0.182', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:17,500][52647] DAMAGECOUNT value on done: 869586.0 [2024-08-06 07:08:17,501][52647] Sum rewards: 70.841, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.176', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.094', 'AMMO4': '0.170', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 607641600. Throughput: 0: 4375.5. Samples: 151909250. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:08:17,802][52567] Avg episode reward: [(0, '74.943')] [2024-08-06 07:08:18,448][52659] DAMAGECOUNT value on done: 826270.0 [2024-08-06 07:08:18,448][52659] Sum rewards: 71.555, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.162', 'AMMO4': '0.199', 'AMMO3': '0.205', 'weapon2': '0.276', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '59.000'} [2024-08-06 07:08:18,453][52664] DAMAGECOUNT value on done: 864782.0 [2024-08-06 07:08:18,454][52664] Sum rewards: 68.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.054', 'AMMO4': '0.128', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '56.000'} [2024-08-06 07:08:18,693][52658] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 07:08:18,805][52811] DAMAGECOUNT value on done: 785402.0 [2024-08-06 07:08:18,806][52811] Sum rewards: 66.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.667', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.166', 'AMMO4': '0.219', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.056', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '56.000'} [2024-08-06 07:08:19,529][52660] DAMAGECOUNT value on done: 833596.0 [2024-08-06 07:08:19,531][52660] Sum rewards: 75.939, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.378', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.080', 'weapon4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.210', 'WEAPON3': '1.200', 'weapon3': '3.452', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '61.500'} [2024-08-06 07:08:19,542][52667] DAMAGECOUNT value on done: 836285.0 [2024-08-06 07:08:19,543][52667] Sum rewards: 84.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.094', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.306', 'FRAGCOUNT': '67.000'} [2024-08-06 07:08:19,897][52647] DAMAGECOUNT value on done: 859121.0 [2024-08-06 07:08:19,897][52647] Sum rewards: 82.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.596', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.090', 'AMMO4': '0.155', 'AMMO3': '0.209', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '67.000'} [2024-08-06 07:08:20,451][52650] Updated weights for policy 0, policy_version 74181 (0.0023) [2024-08-06 07:08:21,281][52664] DAMAGECOUNT value on done: 861976.0 [2024-08-06 07:08:21,282][52664] Sum rewards: 91.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.550', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.128', 'AMMO3': '0.223', 'WEAPON3': '1.350', 'weapon3': '3.626', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.877', 'FRAGCOUNT': '75.000'} [2024-08-06 07:08:21,380][52659] DAMAGECOUNT value on done: 825088.0 [2024-08-06 07:08:21,382][52659] Sum rewards: 63.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.207', 'weapon2': '0.408', 'WEAPON3': '1.300', 'HITCOUNT': '2.980', 'weapon3': '3.326', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '53.000'} [2024-08-06 07:08:21,815][52811] DAMAGECOUNT value on done: 768770.0 [2024-08-06 07:08:21,817][52811] Sum rewards: 74.366, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.510', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.048', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '3.320', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '59.000'} [2024-08-06 07:08:22,382][52660] DAMAGECOUNT value on done: 841135.0 [2024-08-06 07:08:22,383][52660] Sum rewards: 65.027, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.178', 'AMMO4': '0.215', 'weapon5': '0.232', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.550', 'weapon3': '2.804', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '57.000'} [2024-08-06 07:08:22,535][52667] DAMAGECOUNT value on done: 824845.0 [2024-08-06 07:08:22,537][52667] Sum rewards: 79.645, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.802', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.067', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.256', 'WEAPON3': '1.250', 'HITCOUNT': '3.440', 'weapon3': '3.468', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:22,686][52647] DAMAGECOUNT value on done: 875776.0 [2024-08-06 07:08:22,687][52647] Sum rewards: 72.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.409', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.119', 'weapon4': '0.138', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 07:08:22,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 607723520. Throughput: 0: 4369.3. Samples: 151935450. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:08:22,795][52567] Avg episode reward: [(0, '74.770')] [2024-08-06 07:08:23,068][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:08:23,933][52664] DAMAGECOUNT value on done: 861181.0 [2024-08-06 07:08:23,934][52664] Sum rewards: 75.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.886', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO4': '0.161', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:24,512][52659] DAMAGECOUNT value on done: 824521.0 [2024-08-06 07:08:24,513][52659] Sum rewards: 67.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.418', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.118', 'AMMO3': '0.153', 'AMMO4': '0.207', 'weapon4': '0.216', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.190', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '56.000'} [2024-08-06 07:08:24,841][52811] DAMAGECOUNT value on done: 764482.0 [2024-08-06 07:08:24,841][52811] Sum rewards: 75.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.628', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.082', 'AMMO4': '0.085', 'weapon5': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.110', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '62.500'} [2024-08-06 07:08:25,369][52650] Updated weights for policy 0, policy_version 74191 (0.0031) [2024-08-06 07:08:25,501][52647] DAMAGECOUNT value on done: 862529.0 [2024-08-06 07:08:25,502][52647] Sum rewards: 82.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.695', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.358', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '66.000'} [2024-08-06 07:08:25,503][52667] DAMAGECOUNT value on done: 831116.0 [2024-08-06 07:08:25,503][52667] Sum rewards: 85.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.136', 'AMMO3': '0.230', 'weapon2': '0.262', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '72.000'} [2024-08-06 07:08:25,648][52660] DAMAGECOUNT value on done: 820149.0 [2024-08-06 07:08:25,648][52660] Sum rewards: 58.695, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.104', 'AMMO4': '0.179', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.322', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.082', 'DAMAGECOUNT': '13.539', 'FRAGCOUNT': '49.000'} [2024-08-06 07:08:26,774][52664] DAMAGECOUNT value on done: 872382.0 [2024-08-06 07:08:26,775][52664] Sum rewards: 76.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.812', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:27,322][52659] DAMAGECOUNT value on done: 827253.0 [2024-08-06 07:08:27,325][52659] Sum rewards: 79.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.424', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.181', 'weapon4': '0.186', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '66.000'} [2024-08-06 07:08:27,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 607805440. Throughput: 0: 4377.8. Samples: 151961840. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 07:08:27,794][52567] Avg episode reward: [(0, '75.238')] [2024-08-06 07:08:27,804][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074196_607813632.pth... [2024-08-06 07:08:27,965][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073684_603619328.pth [2024-08-06 07:08:28,135][52811] DAMAGECOUNT value on done: 766156.0 [2024-08-06 07:08:28,136][52811] Sum rewards: 79.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.144', 'weapon4': '0.186', 'AMMO3': '0.194', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '65.000'} [2024-08-06 07:08:28,204][52660] DAMAGECOUNT value on done: 827232.0 [2024-08-06 07:08:28,206][52660] Sum rewards: 78.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.538', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.108', 'AMMO3': '0.194', 'AMMO4': '0.210', 'weapon5': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 07:08:28,477][52647] DAMAGECOUNT value on done: 871958.0 [2024-08-06 07:08:28,478][52647] Sum rewards: 76.858, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.377', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.172', 'AMMO4': '0.208', 'AMMO3': '0.248', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.450', 'weapon3': '2.930', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:28,546][52667] DAMAGECOUNT value on done: 835812.0 [2024-08-06 07:08:28,546][52667] Sum rewards: 82.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.706', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.132', 'weapon4': '0.164', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '67.000'} [2024-08-06 07:08:29,963][52650] Updated weights for policy 0, policy_version 74201 (0.0021) [2024-08-06 07:08:30,063][52664] DAMAGECOUNT value on done: 868639.0 [2024-08-06 07:08:30,065][52664] Sum rewards: 75.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.997', 'weapon7': '0.002', 'AMMO5': '0.020', 'AMMO2': '0.052', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'AMMO3': '0.201', 'weapon5': '0.220', 'weapon4': '0.222', 'AMMO4': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.644', 'WEAPON3': '1.200', 'weapon3': '2.590', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:30,113][52659] DAMAGECOUNT value on done: 826927.0 [2024-08-06 07:08:30,114][52659] Sum rewards: 85.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.928', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.114', 'AMMO4': '0.198', 'weapon2': '0.198', 'weapon5': '0.210', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.898', 'FRAGCOUNT': '71.000'} [2024-08-06 07:08:31,373][52811] DAMAGECOUNT value on done: 770428.0 [2024-08-06 07:08:31,376][52811] Sum rewards: 71.592, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.525', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO3': '0.121', 'AMMO4': '0.123', 'weapon4': '0.244', 'weapon5': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '0.750', 'weapon3': '2.802', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '54.000'} [2024-08-06 07:08:31,385][52660] DAMAGECOUNT value on done: 823651.0 [2024-08-06 07:08:31,387][52660] Sum rewards: 78.244, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.082', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.398', 'WEAPON3': '1.050', 'weapon3': '3.274', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '62.000'} [2024-08-06 07:08:31,535][52667] DAMAGECOUNT value on done: 836362.0 [2024-08-06 07:08:31,535][52667] Sum rewards: 77.022, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.010', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.085', 'weapon5': '0.120', 'weapon4': '0.232', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:31,721][52647] DAMAGECOUNT value on done: 872745.0 [2024-08-06 07:08:31,723][52647] Sum rewards: 72.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO4': '0.167', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.050', 'HITCOUNT': '3.310', 'weapon3': '3.360', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '59.000'} [2024-08-06 07:08:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 607903744. Throughput: 0: 4371.8. Samples: 151974560. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:08:32,795][52567] Avg episode reward: [(0, '75.493')] [2024-08-06 07:08:32,842][52659] DAMAGECOUNT value on done: 828051.0 [2024-08-06 07:08:32,844][52659] Sum rewards: 84.829, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.122', 'weapon5': '0.138', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'weapon3': '3.360', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '72.000'} [2024-08-06 07:08:33,283][52664] DAMAGECOUNT value on done: 865093.0 [2024-08-06 07:08:33,283][52664] Sum rewards: 84.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '69.000'} [2024-08-06 07:08:34,128][52660] DAMAGECOUNT value on done: 816753.0 [2024-08-06 07:08:34,128][52660] Sum rewards: 69.571, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.028', 'AMMO2': '0.032', 'AMMO3': '0.141', 'AMMO4': '0.158', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.590', 'WEAPON3': '0.950', 'weapon3': '2.946', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '55.000'} [2024-08-06 07:08:34,344][52667] DAMAGECOUNT value on done: 834113.0 [2024-08-06 07:08:34,346][52667] Sum rewards: 71.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.128', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.192', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.258', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '60.000'} [2024-08-06 07:08:34,458][52811] DAMAGECOUNT value on done: 783301.0 [2024-08-06 07:08:34,458][52811] Sum rewards: 79.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.205', 'AMMO4': '0.210', 'weapon4': '0.238', 'weapon2': '0.264', 'weapon5': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.818', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:34,833][52647] DAMAGECOUNT value on done: 859576.0 [2024-08-06 07:08:34,835][52647] Sum rewards: 68.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.220', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.134', 'AMMO4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.608', 'FRAGCOUNT': '56.000'} [2024-08-06 07:08:34,938][52650] Updated weights for policy 0, policy_version 74211 (0.0021) [2024-08-06 07:08:36,046][52659] DAMAGECOUNT value on done: 834528.0 [2024-08-06 07:08:36,046][52659] Sum rewards: 64.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.104', 'AMMO4': '0.118', 'weapon5': '0.150', 'AMMO3': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.582', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '54.000'} [2024-08-06 07:08:36,527][52664] DAMAGECOUNT value on done: 851201.0 [2024-08-06 07:08:36,529][52664] Sum rewards: 69.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.852', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO3': '0.171', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.372', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '54.000'} [2024-08-06 07:08:36,966][52667] DAMAGECOUNT value on done: 831422.0 [2024-08-06 07:08:36,969][52667] Sum rewards: 73.363, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.526', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.354', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '62.000'} [2024-08-06 07:08:37,333][52660] DAMAGECOUNT value on done: 815858.0 [2024-08-06 07:08:37,333][52660] Sum rewards: 81.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.870', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.080', 'AMMO4': '0.095', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '67.000'} [2024-08-06 07:08:37,385][52811] DAMAGECOUNT value on done: 776453.0 [2024-08-06 07:08:37,387][52811] Sum rewards: 77.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.685', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.086', 'AMMO3': '0.162', 'weapon5': '0.162', 'AMMO4': '0.194', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.304', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '62.000'} [2024-08-06 07:08:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 607985664. Throughput: 0: 4368.0. Samples: 152000700. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:08:37,794][52567] Avg episode reward: [(0, '75.339')] [2024-08-06 07:08:37,903][52647] DAMAGECOUNT value on done: 864923.0 [2024-08-06 07:08:37,904][52647] Sum rewards: 79.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.768', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon2': '0.234', 'AMMO3': '0.238', 'weapon5': '0.242', 'AMMO4': '0.276', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.738', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '67.000'} [2024-08-06 07:08:38,857][52659] DAMAGECOUNT value on done: 820431.0 [2024-08-06 07:08:38,860][52659] Sum rewards: 75.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.986', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon4': '0.186', 'weapon2': '0.206', 'AMMO3': '0.232', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:39,302][52650] Updated weights for policy 0, policy_version 74221 (0.0026) [2024-08-06 07:08:39,534][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:08:39,658][52664] DAMAGECOUNT value on done: 856991.0 [2024-08-06 07:08:39,658][52664] Sum rewards: 74.844, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.742', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.128', 'AMMO4': '0.250', 'AMMO3': '0.254', 'weapon5': '0.254', 'weapon2': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '62.000'} [2024-08-06 07:08:39,958][52667] DAMAGECOUNT value on done: 838096.0 [2024-08-06 07:08:39,958][52667] Sum rewards: 77.306, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'AMMO5': '0.009', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon5': '0.156', 'weapon4': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:40,456][52811] DAMAGECOUNT value on done: 767391.0 [2024-08-06 07:08:40,459][52811] Sum rewards: 72.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.293', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.204', 'AMMO4': '0.255', 'weapon5': '0.290', 'weapon2': '0.336', 'weapon4': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.720', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '59.000'} [2024-08-06 07:08:40,820][52647] DAMAGECOUNT value on done: 857121.0 [2024-08-06 07:08:40,821][52647] Sum rewards: 78.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.120', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.174', 'weapon5': '0.178', 'AMMO4': '0.193', 'AMMO3': '0.238', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '65.000'} [2024-08-06 07:08:42,044][52659] DAMAGECOUNT value on done: 829476.0 [2024-08-06 07:08:42,045][52659] Sum rewards: 76.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.228', 'WEAPON3': '1.200', 'HITCOUNT': '3.420', 'weapon3': '3.470', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:42,563][52664] DAMAGECOUNT value on done: 859851.0 [2024-08-06 07:08:42,563][52664] Sum rewards: 75.405, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.097', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.178', 'WEAPON3': '1.100', 'HITCOUNT': '3.410', 'weapon3': '3.594', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 608075776. Throughput: 0: 4362.2. Samples: 152026730. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:08:42,794][52567] Avg episode reward: [(0, '75.392')] [2024-08-06 07:08:43,524][52811] DAMAGECOUNT value on done: 776520.0 [2024-08-06 07:08:43,526][52811] Sum rewards: 68.049, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.163', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.338', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '55.000'} [2024-08-06 07:08:43,948][52647] DAMAGECOUNT value on done: 862016.0 [2024-08-06 07:08:43,957][52647] Sum rewards: 76.977, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.258', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.183', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:44,205][52650] Updated weights for policy 0, policy_version 74231 (0.0011) [2024-08-06 07:08:44,648][52659] DAMAGECOUNT value on done: 825341.0 [2024-08-06 07:08:44,651][52659] Sum rewards: 77.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.122', 'weapon4': '0.178', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:45,345][52664] DAMAGECOUNT value on done: 853217.0 [2024-08-06 07:08:45,346][52664] Sum rewards: 76.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.224', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.412', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:45,787][52668] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.588, 196.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:08:46,552][52811] DAMAGECOUNT value on done: 773556.0 [2024-08-06 07:08:46,553][52811] Sum rewards: 70.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.130', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.184', 'weapon2': '0.208', 'AMMO4': '0.238', 'AMMO3': '0.246', 'weapon4': '0.280', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '62.000'} [2024-08-06 07:08:47,390][52659] DAMAGECOUNT value on done: 827008.0 [2024-08-06 07:08:47,393][52659] Sum rewards: 73.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.502', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.038', 'weapon4': '0.054', 'weapon5': '0.146', 'AMMO4': '0.190', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '60.000'} [2024-08-06 07:08:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 608165888. Throughput: 0: 4368.4. Samples: 152039930. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:08:47,795][52567] Avg episode reward: [(0, '75.147')] [2024-08-06 07:08:48,621][52650] Updated weights for policy 0, policy_version 74241 (0.0025) [2024-08-06 07:08:49,625][52614] Signal inference workers to stop experience collection... (13550 times) [2024-08-06 07:08:49,625][52614] Signal inference workers to resume experience collection... (13550 times) [2024-08-06 07:08:49,705][52650] InferenceWorker_p0-w0: stopping experience collection (13550 times) [2024-08-06 07:08:49,705][52650] InferenceWorker_p0-w0: resuming experience collection (13550 times) [2024-08-06 07:08:49,817][52811] DAMAGECOUNT value on done: 777745.0 [2024-08-06 07:08:49,817][52811] Sum rewards: 78.481, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.082', 'weapon5': '0.182', 'AMMO3': '0.234', 'AMMO4': '0.281', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:50,423][52659] DAMAGECOUNT value on done: 828026.0 [2024-08-06 07:08:50,423][52659] Sum rewards: 73.134, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.595', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.130', 'AMMO3': '0.186', 'AMMO4': '0.211', 'weapon5': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.712', 'WEAPON3': '1.150', 'weapon3': '2.614', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '59.000'} [2024-08-06 07:08:50,743][52794] DAMAGECOUNT value on done: 821323.0 [2024-08-06 07:08:50,744][52794] Sum rewards: 72.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.044', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.054', 'AMMO4': '0.153', 'weapon5': '0.154', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '60.000'} [2024-08-06 07:08:51,955][52649] DAMAGECOUNT value on done: 803366.0 [2024-08-06 07:08:51,955][52649] Sum rewards: 76.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.590', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon4': '0.156', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 608247808. Throughput: 0: 4367.4. Samples: 152066240. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:08:52,794][52567] Avg episode reward: [(0, '75.077')] [2024-08-06 07:08:52,924][52811] DAMAGECOUNT value on done: 783373.0 [2024-08-06 07:08:52,924][52811] Sum rewards: 90.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.034', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.502', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '74.000'} [2024-08-06 07:08:53,206][52659] DAMAGECOUNT value on done: 827736.0 [2024-08-06 07:08:53,206][52659] Sum rewards: 75.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.510', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '63.000'} [2024-08-06 07:08:53,373][52658] DAMAGECOUNT value on done: 827880.0 [2024-08-06 07:08:53,374][52658] Sum rewards: 75.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.571', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'weapon4': '0.072', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.412', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:53,619][52650] Updated weights for policy 0, policy_version 74251 (0.0012) [2024-08-06 07:08:53,660][52794] DAMAGECOUNT value on done: 829710.0 [2024-08-06 07:08:53,660][52794] Sum rewards: 70.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.066', 'weapon4': '0.102', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.272', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:55,227][52649] DAMAGECOUNT value on done: 795897.0 [2024-08-06 07:08:55,228][52649] Sum rewards: 85.244, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.561', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.037', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'AMMO4': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '67.000'} [2024-08-06 07:08:56,149][52811] DAMAGECOUNT value on done: 773926.0 [2024-08-06 07:08:56,149][52811] Sum rewards: 90.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.277', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.034', 'weapon5': '0.088', 'AMMO4': '0.172', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.326', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '74.000'} [2024-08-06 07:08:56,291][52658] DAMAGECOUNT value on done: 830481.0 [2024-08-06 07:08:56,292][52658] Sum rewards: 71.500, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.499', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.114', 'AMMO4': '0.144', 'weapon5': '0.248', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:56,456][52659] DAMAGECOUNT value on done: 836660.0 [2024-08-06 07:08:56,456][52659] Sum rewards: 67.177, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.766', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.152', 'weapon5': '0.182', 'AMMO3': '0.262', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.140', 'weapon3': '3.172', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '60.000'} [2024-08-06 07:08:56,499][52794] DAMAGECOUNT value on done: 836097.0 [2024-08-06 07:08:56,500][52794] Sum rewards: 91.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.366', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.235', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.650', 'weapon3': '3.276', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '22.365', 'FRAGCOUNT': '75.000'} [2024-08-06 07:08:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 608337920. Throughput: 0: 4358.0. Samples: 152092180. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:08:57,794][52567] Avg episode reward: [(0, '75.506')] [2024-08-06 07:08:57,959][52667] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:08:58,186][52811] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:08:58,317][52650] Updated weights for policy 0, policy_version 74261 (0.0025) [2024-08-06 07:08:58,444][52649] DAMAGECOUNT value on done: 812745.0 [2024-08-06 07:08:58,446][52649] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.488', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.096', 'AMMO4': '0.194', 'AMMO3': '0.201', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '61.000'} [2024-08-06 07:08:58,929][52658] DAMAGECOUNT value on done: 834455.0 [2024-08-06 07:08:58,932][52658] Sum rewards: 79.626, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.078', 'AMMO4': '0.134', 'weapon5': '0.216', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.266', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '66.000'} [2024-08-06 07:08:59,426][52811] DAMAGECOUNT value on done: 772925.0 [2024-08-06 07:08:59,428][52811] Sum rewards: 76.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.157', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.172', 'weapon5': '0.236', 'AMMO3': '0.252', 'AMMO4': '0.270', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:59,457][52794] DAMAGECOUNT value on done: 822714.0 [2024-08-06 07:08:59,460][52794] Sum rewards: 80.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.121', 'weapon5': '0.140', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.298', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '64.000'} [2024-08-06 07:08:59,461][52659] DAMAGECOUNT value on done: 821816.0 [2024-08-06 07:08:59,473][52659] Sum rewards: 53.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.202', 'AMMO3': '0.229', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.468', 'WEAPON3': '1.350', 'HITCOUNT': '2.790', 'weapon3': '2.810', 'DAMAGECOUNT': '14.055', 'FRAGCOUNT': '45.000'} [2024-08-06 07:08:59,767][52658] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:09:00,088][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:09:01,096][52649] DAMAGECOUNT value on done: 807400.0 [2024-08-06 07:09:01,097][52649] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.062', 'weapon5': '0.172', 'AMMO3': '0.226', 'AMMO4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:01,942][52658] DAMAGECOUNT value on done: 829233.0 [2024-08-06 07:09:01,945][52658] Sum rewards: 71.258, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.235', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.120', 'AMMO3': '0.158', 'weapon4': '0.172', 'AMMO4': '0.185', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '0.900', 'weapon3': '3.118', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '55.000'} [2024-08-06 07:09:02,090][52659] DAMAGECOUNT value on done: 831551.0 [2024-08-06 07:09:02,090][52659] Sum rewards: 72.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon2': '0.172', 'weapon5': '0.204', 'AMMO3': '0.222', 'AMMO4': '0.235', 'weapon4': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '59.000'} [2024-08-06 07:09:02,567][52811] DAMAGECOUNT value on done: 770989.0 [2024-08-06 07:09:02,568][52811] Sum rewards: 79.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.495', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.046', 'weapon4': '0.090', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:02,633][52794] DAMAGECOUNT value on done: 819405.0 [2024-08-06 07:09:02,636][52794] Sum rewards: 76.987, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.236', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.050', 'weapon4': '0.118', 'WEAPON5': '0.150', 'weapon2': '0.172', 'WEAPON4': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.416', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '66.000'} [2024-08-06 07:09:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 608419840. Throughput: 0: 4357.4. Samples: 152105330. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:09:02,795][52567] Avg episode reward: [(0, '75.327')] [2024-08-06 07:09:02,959][52650] Updated weights for policy 0, policy_version 74271 (0.0019) [2024-08-06 07:09:04,091][52649] DAMAGECOUNT value on done: 799387.0 [2024-08-06 07:09:04,091][52649] Sum rewards: 72.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.052', 'weapon5': '0.074', 'AMMO4': '0.112', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:04,869][52658] DAMAGECOUNT value on done: 826042.0 [2024-08-06 07:09:04,877][52658] Sum rewards: 79.831, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.747', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.131', 'weapon4': '0.290', 'ARMOR': '0.400', 'weapon2': '0.472', 'WEAPON3': '0.850', 'weapon3': '3.122', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:05,118][52659] DAMAGECOUNT value on done: 825452.0 [2024-08-06 07:09:05,120][52659] Sum rewards: 81.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.205', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '66.000'} [2024-08-06 07:09:05,419][52794] DAMAGECOUNT value on done: 826828.0 [2024-08-06 07:09:05,419][52794] Sum rewards: 86.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.314', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '71.000'} [2024-08-06 07:09:05,515][52803] DAMAGECOUNT value on done: 769268.0 [2024-08-06 07:09:05,517][52803] Sum rewards: 83.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.431', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.200', 'AMMO3': '0.228', 'AMMO4': '0.233', 'weapon5': '0.254', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:05,658][52811] DAMAGECOUNT value on done: 774641.0 [2024-08-06 07:09:05,658][52811] Sum rewards: 80.893, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.046', 'weapon5': '0.082', 'AMMO4': '0.107', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.766', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:07,183][52649] DAMAGECOUNT value on done: 809809.0 [2024-08-06 07:09:07,185][52649] Sum rewards: 87.557, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.485', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO3': '0.216', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.273', 'FRAGCOUNT': '71.000'} [2024-08-06 07:09:07,456][52650] Updated weights for policy 0, policy_version 74281 (0.0022) [2024-08-06 07:09:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 608509952. Throughput: 0: 4356.0. Samples: 152131470. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:09:07,794][52567] Avg episode reward: [(0, '75.754')] [2024-08-06 07:09:07,867][52820] DAMAGECOUNT value on done: 764369.0 [2024-08-06 07:09:07,868][52820] Sum rewards: 73.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.072', 'weapon5': '0.074', 'AMMO4': '0.125', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.378', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '61.000'} [2024-08-06 07:09:07,958][52658] DAMAGECOUNT value on done: 819724.0 [2024-08-06 07:09:07,960][52658] Sum rewards: 77.619, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.804', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.120', 'weapon2': '0.200', 'AMMO4': '0.224', 'AMMO3': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.312', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '66.500'} [2024-08-06 07:09:08,470][52794] DAMAGECOUNT value on done: 831129.0 [2024-08-06 07:09:08,470][52794] Sum rewards: 78.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.328', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.175', 'weapon5': '0.218', 'weapon4': '0.276', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:08,638][52811] DAMAGECOUNT value on done: 777703.0 [2024-08-06 07:09:08,638][52811] Sum rewards: 62.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.257', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.088', 'AMMO3': '0.167', 'weapon5': '0.204', 'AMMO4': '0.208', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.182', 'DAMAGECOUNT': '14.874', 'FRAGCOUNT': '50.500'} [2024-08-06 07:09:08,682][52803] DAMAGECOUNT value on done: 768864.0 [2024-08-06 07:09:08,682][52803] Sum rewards: 89.175, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.100', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.046', 'AMMO4': '0.113', 'weapon4': '0.114', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'WEAPON3': '1.800', 'weapon3': '3.366', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '21.417', 'FRAGCOUNT': '77.000'} [2024-08-06 07:09:10,323][52649] DAMAGECOUNT value on done: 807827.0 [2024-08-06 07:09:10,332][52649] Sum rewards: 85.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '71.000'} [2024-08-06 07:09:10,728][52658] DAMAGECOUNT value on done: 832216.0 [2024-08-06 07:09:10,728][52658] Sum rewards: 68.589, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.993', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.158', 'AMMO4': '0.185', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '58.500'} [2024-08-06 07:09:10,941][52820] DAMAGECOUNT value on done: 766586.0 [2024-08-06 07:09:10,941][52820] Sum rewards: 74.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.073', 'weapon4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:11,030][52794] DAMAGECOUNT value on done: 818527.0 [2024-08-06 07:09:11,032][52794] Sum rewards: 76.173, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.654', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.182', 'weapon2': '0.216', 'AMMO3': '0.252', 'weapon4': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:11,701][52811] DAMAGECOUNT value on done: 782975.0 [2024-08-06 07:09:11,701][52811] Sum rewards: 80.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.569', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.080', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.000', 'weapon3': '3.238', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:11,796][52803] DAMAGECOUNT value on done: 774746.0 [2024-08-06 07:09:11,797][52803] Sum rewards: 80.210, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.298', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.084', 'AMMO4': '0.098', 'weapon5': '0.156', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.316', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:12,385][52650] Updated weights for policy 0, policy_version 74291 (0.0013) [2024-08-06 07:09:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 608600064. Throughput: 0: 4359.8. Samples: 152158030. Policy #0 lag: (min: 1.0, avg: 3.2, max: 7.0) [2024-08-06 07:09:12,794][52567] Avg episode reward: [(0, '76.120')] [2024-08-06 07:09:13,409][52649] DAMAGECOUNT value on done: 810862.0 [2024-08-06 07:09:13,410][52649] Sum rewards: 79.664, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.325', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'weapon3': '3.622', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:13,564][52794] DAMAGECOUNT value on done: 828172.0 [2024-08-06 07:09:13,564][52794] Sum rewards: 75.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.114', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.080', 'weapon4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:13,654][52658] DAMAGECOUNT value on done: 819815.0 [2024-08-06 07:09:13,656][52658] Sum rewards: 69.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.648', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.142', 'weapon2': '0.162', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:14,110][52820] DAMAGECOUNT value on done: 766892.0 [2024-08-06 07:09:14,111][52820] Sum rewards: 64.328, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.815', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon4': '0.138', 'AMMO4': '0.210', 'AMMO3': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.750', 'weapon3': '2.868', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:14,765][52811] DAMAGECOUNT value on done: 770630.0 [2024-08-06 07:09:14,765][52811] Sum rewards: 58.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.062', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.324', 'WEAPON3': '1.500', 'HITCOUNT': '3.070', 'weapon3': '3.372', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '50.000'} [2024-08-06 07:09:14,974][52803] DAMAGECOUNT value on done: 772200.0 [2024-08-06 07:09:14,974][52803] Sum rewards: 78.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.406', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.203', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:16,320][52794] DAMAGECOUNT value on done: 824608.0 [2024-08-06 07:09:16,321][52794] Sum rewards: 92.654, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.886', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.122', 'AMMO4': '0.257', 'AMMO3': '0.265', 'weapon5': '0.280', 'weapon2': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '23.247', 'FRAGCOUNT': '75.000'} [2024-08-06 07:09:16,531][52665] DAMAGECOUNT value on done: 815558.0 [2024-08-06 07:09:16,532][52665] Sum rewards: 82.850, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.148', 'weapon5': '0.158', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.242', 'HEALTH': '0.779', 'WEAPON3': '0.850', 'weapon3': '3.212', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:16,539][52649] DAMAGECOUNT value on done: 809638.0 [2024-08-06 07:09:16,540][52649] Sum rewards: 77.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.094', 'AMMO3': '0.204', 'AMMO4': '0.217', 'weapon5': '0.232', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:16,742][52795] DAMAGECOUNT value on done: 768432.0 [2024-08-06 07:09:16,743][52795] Sum rewards: 75.944, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.701', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.102', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:16,832][52650] Updated weights for policy 0, policy_version 74301 (0.0011) [2024-08-06 07:09:16,857][52658] DAMAGECOUNT value on done: 848664.0 [2024-08-06 07:09:16,858][52658] Sum rewards: 95.535, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'weapon3': '3.456', 'HITCOUNT': '4.390', 'DAMAGECOUNT': '22.890', 'FRAGCOUNT': '78.000'} [2024-08-06 07:09:17,109][52820] DAMAGECOUNT value on done: 756249.0 [2024-08-06 07:09:17,111][52820] Sum rewards: 80.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'weapon4': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.242', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:17,662][52811] DAMAGECOUNT value on done: 771405.0 [2024-08-06 07:09:17,662][52811] Sum rewards: 60.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.122', 'weapon4': '0.134', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.100', 'HITCOUNT': '2.880', 'weapon3': '2.892', 'DAMAGECOUNT': '14.286', 'FRAGCOUNT': '49.000'} [2024-08-06 07:09:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 608681984. Throughput: 0: 4364.9. Samples: 152170980. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:17,794][52567] Avg episode reward: [(0, '76.451')] [2024-08-06 07:09:18,143][52803] DAMAGECOUNT value on done: 772013.0 [2024-08-06 07:09:18,143][52803] Sum rewards: 79.182, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.126', 'weapon2': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:18,633][52669] DAMAGECOUNT value on done: 828376.0 [2024-08-06 07:09:18,634][52669] Sum rewards: 79.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.245', 'AMMO2': '0.006', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.208', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:18,866][52794] DAMAGECOUNT value on done: 817557.0 [2024-08-06 07:09:18,866][52794] Sum rewards: 74.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.355', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.106', 'AMMO4': '0.196', 'weapon5': '0.224', 'AMMO3': '0.269', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.060', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:19,568][52663] DAMAGECOUNT value on done: 843482.0 [2024-08-06 07:09:19,569][52663] Sum rewards: 78.771, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.536', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.078', 'weapon5': '0.162', 'AMMO4': '0.202', 'AMMO3': '0.253', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:19,626][52665] DAMAGECOUNT value on done: 830972.0 [2024-08-06 07:09:19,626][52665] Sum rewards: 76.377, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.068', 'AMMO4': '0.095', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:19,659][52649] DAMAGECOUNT value on done: 802804.0 [2024-08-06 07:09:19,659][52649] Sum rewards: 74.449, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.790', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.179', 'weapon2': '0.188', 'weapon4': '0.228', 'AMMO3': '0.241', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:19,775][52658] DAMAGECOUNT value on done: 831417.0 [2024-08-06 07:09:19,777][52658] Sum rewards: 54.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.978', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO3': '0.165', 'AMMO4': '0.206', 'weapon4': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '2.736', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.886', 'FRAGCOUNT': '46.500'} [2024-08-06 07:09:19,919][52795] DAMAGECOUNT value on done: 754704.0 [2024-08-06 07:09:19,920][52795] Sum rewards: 75.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.065', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.068', 'weapon5': '0.092', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:20,166][52820] DAMAGECOUNT value on done: 770305.0 [2024-08-06 07:09:20,171][52820] Sum rewards: 84.578, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.531', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.137', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.362', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '70.000'} [2024-08-06 07:09:21,287][52803] DAMAGECOUNT value on done: 771521.0 [2024-08-06 07:09:21,287][52803] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.022', 'AMMO4': '0.031', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.264', 'weapon2': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.482', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '56.000'} [2024-08-06 07:09:21,572][52650] Updated weights for policy 0, policy_version 74311 (0.0013) [2024-08-06 07:09:21,643][52669] DAMAGECOUNT value on done: 821227.0 [2024-08-06 07:09:21,643][52669] Sum rewards: 64.198, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.562', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.058', 'weapon5': '0.150', 'AMMO4': '0.218', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.500', 'weapon3': '2.898', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '56.000'} [2024-08-06 07:09:21,730][52794] DAMAGECOUNT value on done: 828597.0 [2024-08-06 07:09:21,730][52794] Sum rewards: 70.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO3': '0.180', 'AMMO4': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:22,472][52658] DAMAGECOUNT value on done: 841532.0 [2024-08-06 07:09:22,472][52658] Sum rewards: 77.408, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.198', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.126', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:22,502][52663] DAMAGECOUNT value on done: 828833.0 [2024-08-06 07:09:22,504][52663] Sum rewards: 77.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.411', 'AMMO5': '0.004', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.100', 'weapon4': '0.158', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:22,572][52665] DAMAGECOUNT value on done: 821226.0 [2024-08-06 07:09:22,572][52665] Sum rewards: 77.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.345', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO4': '0.160', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.050', 'weapon3': '3.260', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:22,683][52649] DAMAGECOUNT value on done: 814012.0 [2024-08-06 07:09:22,683][52649] Sum rewards: 73.608, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.526', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.294', 'weapon2': '0.422', 'WEAPON3': '1.650', 'weapon3': '3.222', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 608772096. Throughput: 0: 4368.9. Samples: 152197300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:22,795][52567] Avg episode reward: [(0, '76.197')] [2024-08-06 07:09:23,046][52795] DAMAGECOUNT value on done: 759959.0 [2024-08-06 07:09:23,046][52795] Sum rewards: 67.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.235', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.054', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.504', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.284', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 07:09:23,292][52820] DAMAGECOUNT value on done: 755110.0 [2024-08-06 07:09:23,294][52820] Sum rewards: 77.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.128', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:24,000][52669] DAMAGECOUNT value on done: 834713.0 [2024-08-06 07:09:24,001][52669] Sum rewards: 68.911, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.126', 'AMMO3': '0.129', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'weapon4': '0.532', 'WEAPON3': '0.850', 'weapon3': '2.436', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2024-08-06 07:09:24,347][52803] DAMAGECOUNT value on done: 764240.0 [2024-08-06 07:09:24,349][52803] Sum rewards: 80.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.617', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.064', 'weapon5': '0.166', 'AMMO3': '0.181', 'AMMO4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:24,379][52794] DAMAGECOUNT value on done: 825559.0 [2024-08-06 07:09:24,379][52794] Sum rewards: 70.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.482', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.068', 'AMMO4': '0.075', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.198', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.406', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:24,950][52663] DAMAGECOUNT value on done: 824180.0 [2024-08-06 07:09:24,951][52663] Sum rewards: 79.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.024', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.090', 'weapon5': '0.124', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '66.000'} [2024-08-06 07:09:25,346][52665] DAMAGECOUNT value on done: 823472.0 [2024-08-06 07:09:25,347][52665] Sum rewards: 81.107, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.364', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.102', 'weapon5': '0.114', 'AMMO4': '0.150', 'weapon2': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.315', 'WEAPON3': '1.900', 'weapon3': '3.344', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '70.000'} [2024-08-06 07:09:25,469][52649] DAMAGECOUNT value on done: 822752.0 [2024-08-06 07:09:25,469][52649] Sum rewards: 88.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '73.000'} [2024-08-06 07:09:25,686][52671] DAMAGECOUNT value on done: 833397.0 [2024-08-06 07:09:25,687][52671] Sum rewards: 76.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.176', 'weapon2': '0.208', 'weapon5': '0.208', 'AMMO3': '0.236', 'AMMO4': '0.255', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '63.500'} [2024-08-06 07:09:25,795][52658] DAMAGECOUNT value on done: 829470.0 [2024-08-06 07:09:25,808][52658] Sum rewards: 69.045, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.072', 'AMMO4': '0.110', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.276', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:26,129][52795] DAMAGECOUNT value on done: 768893.0 [2024-08-06 07:09:26,130][52795] Sum rewards: 64.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.118', 'weapon5': '0.130', 'AMMO3': '0.200', 'AMMO4': '0.202', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.316', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '54.000'} [2024-08-06 07:09:26,327][52650] Updated weights for policy 0, policy_version 74321 (0.0012) [2024-08-06 07:09:26,656][52820] DAMAGECOUNT value on done: 761792.0 [2024-08-06 07:09:26,666][52820] Sum rewards: 81.686, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.613', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.159', 'AMMO4': '0.246', 'weapon5': '0.260', 'WEAPON5': '0.400', 'weapon4': '0.402', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.638', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:27,069][52669] DAMAGECOUNT value on done: 828232.0 [2024-08-06 07:09:27,069][52669] Sum rewards: 77.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.130', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:27,466][52803] DAMAGECOUNT value on done: 764704.0 [2024-08-06 07:09:27,469][52803] Sum rewards: 80.106, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.545', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.046', 'weapon5': '0.066', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.418', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '69.000'} [2024-08-06 07:09:27,579][52794] DAMAGECOUNT value on done: 840557.0 [2024-08-06 07:09:27,580][52794] Sum rewards: 67.400, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.541', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.098', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'HITCOUNT': '3.170', 'weapon3': '3.430', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 608862208. Throughput: 0: 4369.3. Samples: 152223350. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:27,794][52567] Avg episode reward: [(0, '76.179')] [2024-08-06 07:09:27,958][52663] DAMAGECOUNT value on done: 825679.0 [2024-08-06 07:09:27,960][52663] Sum rewards: 60.402, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.014', 'AMMO5': '0.023', 'AMMO2': '0.073', 'weapon4': '0.134', 'AMMO3': '0.312', 'weapon5': '0.332', 'weapon2': '0.342', 'AMMO4': '0.365', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.750', 'weapon3': '2.858', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '52.000'} [2024-08-06 07:09:28,504][52665] DAMAGECOUNT value on done: 805412.0 [2024-08-06 07:09:28,505][52665] Sum rewards: 81.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.435', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.342', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:28,527][52671] DAMAGECOUNT value on done: 838485.0 [2024-08-06 07:09:28,529][52671] Sum rewards: 72.622, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.756', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.149', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.208', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '59.000'} [2024-08-06 07:09:28,658][52649] DAMAGECOUNT value on done: 813945.0 [2024-08-06 07:09:28,659][52649] Sum rewards: 78.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.149', 'weapon2': '0.180', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:28,727][52658] DAMAGECOUNT value on done: 837589.0 [2024-08-06 07:09:28,727][52658] Sum rewards: 82.332, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.385', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO3': '0.151', 'AMMO4': '0.174', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.720', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:29,283][52795] DAMAGECOUNT value on done: 756640.0 [2024-08-06 07:09:29,283][52795] Sum rewards: 77.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.442', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:29,837][52669] DAMAGECOUNT value on done: 833996.0 [2024-08-06 07:09:29,838][52669] Sum rewards: 87.341, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.638', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.174', 'weapon4': '0.174', 'weapon5': '0.200', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '71.000'} [2024-08-06 07:09:29,998][52820] DAMAGECOUNT value on done: 763671.0 [2024-08-06 07:09:29,998][52820] Sum rewards: 67.800, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.248', 'AMMO5': '0.020', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.174', 'AMMO4': '0.195', 'AMMO3': '0.245', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '2.940', 'weapon3': '3.012', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '59.000'} [2024-08-06 07:09:30,327][52794] DAMAGECOUNT value on done: 821340.0 [2024-08-06 07:09:30,329][52794] Sum rewards: 82.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.145', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.094', 'AMMO4': '0.171', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:30,667][52803] DAMAGECOUNT value on done: 769758.0 [2024-08-06 07:09:30,669][52803] Sum rewards: 72.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.160', 'AMMO4': '0.180', 'AMMO3': '0.222', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:30,709][52663] DAMAGECOUNT value on done: 829097.0 [2024-08-06 07:09:30,710][52663] Sum rewards: 69.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.790', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.206', 'weapon4': '0.230', 'AMMO3': '0.243', 'AMMO4': '0.252', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:31,009][52650] Updated weights for policy 0, policy_version 74331 (0.0011) [2024-08-06 07:09:31,502][52658] DAMAGECOUNT value on done: 826270.0 [2024-08-06 07:09:31,504][52658] Sum rewards: 79.985, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.146', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.650', 'weapon3': '3.192', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.778', 'FRAGCOUNT': '66.000'} [2024-08-06 07:09:31,591][52671] DAMAGECOUNT value on done: 833174.0 [2024-08-06 07:09:31,593][52671] Sum rewards: 78.343, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.072', 'AMMO3': '0.179', 'weapon5': '0.218', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '63.500'} [2024-08-06 07:09:31,788][52665] DAMAGECOUNT value on done: 812279.0 [2024-08-06 07:09:31,788][52665] Sum rewards: 70.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.170', 'weapon4': '0.190', 'AMMO4': '0.206', 'AMMO3': '0.244', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.006', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '59.000'} [2024-08-06 07:09:31,999][52649] DAMAGECOUNT value on done: 814718.0 [2024-08-06 07:09:32,001][52649] Sum rewards: 80.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.741', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO3': '0.188', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '66.000'} [2024-08-06 07:09:32,445][52795] DAMAGECOUNT value on done: 763414.0 [2024-08-06 07:09:32,446][52795] Sum rewards: 66.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.428', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon2': '0.164', 'AMMO3': '0.191', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.660', 'DAMAGECOUNT': '15.492', 'FRAGCOUNT': '55.000'} [2024-08-06 07:09:32,459][52669] DAMAGECOUNT value on done: 830121.0 [2024-08-06 07:09:32,459][52669] Sum rewards: 72.423, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.152', 'AMMO4': '0.161', 'HEALTH': '0.170', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.218', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '59.000'} [2024-08-06 07:09:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 608944128. Throughput: 0: 4364.2. Samples: 152236320. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:32,795][52567] Avg episode reward: [(0, '76.140')] [2024-08-06 07:09:33,123][52794] DAMAGECOUNT value on done: 835431.0 [2024-08-06 07:09:33,123][52794] Sum rewards: 68.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.245', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.138', 'weapon4': '0.156', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.600', 'weapon3': '3.084', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '56.000'} [2024-08-06 07:09:33,127][52820] DAMAGECOUNT value on done: 769363.0 [2024-08-06 07:09:33,127][52820] Sum rewards: 89.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.146', 'AMMO4': '-0.013', 'AMMO2': '-0.002', 'AMMO3': '0.225', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '74.000'} [2024-08-06 07:09:33,531][52663] DAMAGECOUNT value on done: 833895.0 [2024-08-06 07:09:33,532][52663] Sum rewards: 75.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.785', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.148', 'AMMO4': '0.198', 'weapon5': '0.208', 'AMMO3': '0.212', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:33,646][52803] DAMAGECOUNT value on done: 767810.0 [2024-08-06 07:09:33,649][52803] Sum rewards: 80.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.441', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:34,154][52665] DAMAGECOUNT value on done: 815571.0 [2024-08-06 07:09:34,155][52665] Sum rewards: 85.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.744', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.174', 'AMMO3': '0.197', 'AMMO4': '0.204', 'weapon5': '0.222', 'weapon2': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.222', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:34,448][52649] DAMAGECOUNT value on done: 802725.0 [2024-08-06 07:09:34,448][52649] Sum rewards: 70.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.124', 'AMMO3': '0.199', 'weapon5': '0.268', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.910', 'WEAPON3': '1.150', 'weapon3': '2.400', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:34,536][52658] DAMAGECOUNT value on done: 834311.0 [2024-08-06 07:09:34,538][52658] Sum rewards: 71.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.121', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.116', 'weapon4': '0.118', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '60.500'} [2024-08-06 07:09:34,847][52671] DAMAGECOUNT value on done: 834810.0 [2024-08-06 07:09:34,848][52671] Sum rewards: 77.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.885', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.172', 'weapon5': '0.180', 'weapon2': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '66.000'} [2024-08-06 07:09:35,343][52669] DAMAGECOUNT value on done: 831129.0 [2024-08-06 07:09:35,345][52669] Sum rewards: 89.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.777', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.123', 'weapon5': '0.156', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.715', 'FRAGCOUNT': '73.000'} [2024-08-06 07:09:35,461][52650] Updated weights for policy 0, policy_version 74341 (0.0033) [2024-08-06 07:09:35,622][52794] DAMAGECOUNT value on done: 831378.0 [2024-08-06 07:09:35,630][52794] Sum rewards: 69.701, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.562', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.168', 'weapon4': '0.178', 'AMMO4': '0.188', 'weapon5': '0.206', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '56.000'} [2024-08-06 07:09:35,647][52795] DAMAGECOUNT value on done: 772103.0 [2024-08-06 07:09:35,648][52795] Sum rewards: 72.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.949', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.080', 'weapon4': '0.090', 'AMMO4': '0.152', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:36,143][52663] DAMAGECOUNT value on done: 823306.0 [2024-08-06 07:09:36,144][52663] Sum rewards: 80.180, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.022', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.161', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:36,326][52820] DAMAGECOUNT value on done: 777098.0 [2024-08-06 07:09:36,328][52820] Sum rewards: 66.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.865', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.146', 'AMMO4': '0.204', 'weapon5': '0.206', 'AMMO3': '0.245', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '2.910', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:36,734][52803] DAMAGECOUNT value on done: 781360.0 [2024-08-06 07:09:36,736][52803] Sum rewards: 71.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.236', 'WEAPON3': '1.200', 'HITCOUNT': '3.380', 'weapon3': '3.506', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:37,310][52665] DAMAGECOUNT value on done: 818104.0 [2024-08-06 07:09:37,312][52665] Sum rewards: 72.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.206', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.138', 'weapon5': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:37,601][52649] DAMAGECOUNT value on done: 812048.0 [2024-08-06 07:09:37,602][52649] Sum rewards: 69.933, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.835', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon5': '0.116', 'weapon4': '0.162', 'AMMO3': '0.294', 'WEAPON5': '0.300', 'AMMO4': '0.323', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.094', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:37,648][52658] DAMAGECOUNT value on done: 816023.0 [2024-08-06 07:09:37,648][52658] Sum rewards: 86.476, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.130', 'weapon5': '0.142', 'AMMO3': '0.163', 'AMMO4': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.129', 'FRAGCOUNT': '70.000'} [2024-08-06 07:09:37,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 609034240. Throughput: 0: 4360.4. Samples: 152262460. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:37,795][52567] Avg episode reward: [(0, '76.015')] [2024-08-06 07:09:37,799][52671] DAMAGECOUNT value on done: 842166.0 [2024-08-06 07:09:37,799][52671] Sum rewards: 76.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.088', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:38,394][52669] DAMAGECOUNT value on done: 830173.0 [2024-08-06 07:09:38,395][52669] Sum rewards: 74.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.594', 'AMMO2': '0.003', 'AMMO5': '0.009', 'AMMO4': '0.014', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:38,428][52794] DAMAGECOUNT value on done: 832802.0 [2024-08-06 07:09:38,429][52794] Sum rewards: 76.697, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.102', 'weapon5': '0.110', 'AMMO3': '0.184', 'AMMO4': '0.206', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '61.500'} [2024-08-06 07:09:38,838][52795] DAMAGECOUNT value on done: 764340.0 [2024-08-06 07:09:38,839][52795] Sum rewards: 76.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'AMMO5': '0.015', 'AMMO2': '0.064', 'weapon4': '0.086', 'weapon5': '0.176', 'weapon2': '0.226', 'AMMO3': '0.241', 'AMMO4': '0.321', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:39,027][52663] DAMAGECOUNT value on done: 815658.0 [2024-08-06 07:09:39,029][52663] Sum rewards: 72.642, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.305', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.079', 'weapon4': '0.090', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'WEAPON3': '1.150', 'HITCOUNT': '3.470', 'weapon3': '3.478', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:39,619][52820] DAMAGECOUNT value on done: 757808.0 [2024-08-06 07:09:39,619][52820] Sum rewards: 52.066, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.082', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO4': '0.138', 'weapon5': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.450', 'HITCOUNT': '2.660', 'weapon3': '3.016', 'DAMAGECOUNT': '12.951', 'FRAGCOUNT': '46.000'} [2024-08-06 07:09:39,805][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:09:39,825][52803] DAMAGECOUNT value on done: 774162.0 [2024-08-06 07:09:39,825][52803] Sum rewards: 85.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.538', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '69.000'} [2024-08-06 07:09:40,128][52665] DAMAGECOUNT value on done: 826236.0 [2024-08-06 07:09:40,131][52665] Sum rewards: 78.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.170', 'weapon2': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.200', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:40,218][52658] DAMAGECOUNT value on done: 835160.0 [2024-08-06 07:09:40,218][52658] Sum rewards: 86.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.352', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.136', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.391', 'FRAGCOUNT': '70.000'} [2024-08-06 07:09:40,315][52649] DAMAGECOUNT value on done: 795404.0 [2024-08-06 07:09:40,316][52649] Sum rewards: 81.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.249', 'weapon2': '0.320', 'WEAPON3': '1.650', 'weapon3': '3.454', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '69.000'} [2024-08-06 07:09:40,543][52650] Updated weights for policy 0, policy_version 74351 (0.0021) [2024-08-06 07:09:40,704][52669] DAMAGECOUNT value on done: 840531.0 [2024-08-06 07:09:40,712][52669] Sum rewards: 78.737, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.848', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.152', 'AMMO3': '0.260', 'AMMO4': '0.266', 'weapon2': '0.280', 'weapon4': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.908', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:40,914][52671] DAMAGECOUNT value on done: 831526.0 [2024-08-06 07:09:40,915][52671] Sum rewards: 82.970, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.794', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.069', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.360', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.615', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:41,551][52663] DAMAGECOUNT value on done: 821957.0 [2024-08-06 07:09:41,552][52663] Sum rewards: 88.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.877', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.192', 'weapon2': '0.198', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '71.000'} [2024-08-06 07:09:41,556][52794] DAMAGECOUNT value on done: 839215.0 [2024-08-06 07:09:41,557][52794] Sum rewards: 71.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.020', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.178', 'weapon5': '0.190', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.268', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:42,101][52795] DAMAGECOUNT value on done: 769263.0 [2024-08-06 07:09:42,101][52795] Sum rewards: 69.064, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.126', 'AMMO4': '0.132', 'weapon2': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'weapon3': '3.268', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:42,757][52820] DAMAGECOUNT value on done: 768996.0 [2024-08-06 07:09:42,758][52820] Sum rewards: 79.910, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.466', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO4': '0.174', 'weapon2': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.374', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.327', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:42,782][52658] DAMAGECOUNT value on done: 825619.0 [2024-08-06 07:09:42,782][52658] Sum rewards: 66.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.965', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO4': '0.181', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.600', 'weapon3': '3.100', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '59.000'} [2024-08-06 07:09:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 609116160. Throughput: 0: 4363.6. Samples: 152288540. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:42,794][52567] Avg episode reward: [(0, '75.894')] [2024-08-06 07:09:42,916][52803] DAMAGECOUNT value on done: 768606.0 [2024-08-06 07:09:42,916][52803] Sum rewards: 54.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.973', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.096', 'AMMO4': '0.113', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.300', 'HITCOUNT': '2.730', 'weapon3': '3.102', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '46.000'} [2024-08-06 07:09:43,049][52665] DAMAGECOUNT value on done: 816550.0 [2024-08-06 07:09:43,050][52665] Sum rewards: 70.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.092', 'AMMO4': '0.145', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON3': '1.150', 'weapon3': '3.508', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '56.000'} [2024-08-06 07:09:43,221][52649] DAMAGECOUNT value on done: 815865.0 [2024-08-06 07:09:43,222][52649] Sum rewards: 65.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.216', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.144', 'weapon4': '0.166', 'AMMO3': '0.184', 'AMMO4': '0.186', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.166', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '55.000'} [2024-08-06 07:09:43,826][52669] DAMAGECOUNT value on done: 831216.0 [2024-08-06 07:09:43,827][52669] Sum rewards: 74.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.052', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.628', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:43,895][52671] DAMAGECOUNT value on done: 836311.0 [2024-08-06 07:09:43,897][52671] Sum rewards: 66.461, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.132', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.144', 'AMMO4': '0.170', 'weapon5': '0.216', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.452', 'WEAPON3': '0.900', 'weapon3': '2.824', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '52.000'} [2024-08-06 07:09:44,313][52670] DAMAGECOUNT value on done: 815902.0 [2024-08-06 07:09:44,313][52670] Sum rewards: 71.676, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.510', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.128', 'weapon4': '0.138', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.142', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:44,616][52794] DAMAGECOUNT value on done: 831666.0 [2024-08-06 07:09:44,616][52794] Sum rewards: 90.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.113', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.173', 'weapon2': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '21.615', 'FRAGCOUNT': '72.000'} [2024-08-06 07:09:44,839][52663] DAMAGECOUNT value on done: 825773.0 [2024-08-06 07:09:44,841][52663] Sum rewards: 71.302, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.151', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO3': '0.191', 'weapon2': '0.194', 'AMMO4': '0.223', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.314', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:45,204][52650] Updated weights for policy 0, policy_version 74361 (0.0014) [2024-08-06 07:09:45,279][52795] DAMAGECOUNT value on done: 769379.0 [2024-08-06 07:09:45,279][52795] Sum rewards: 74.877, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.236', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.060', 'AMMO3': '0.195', 'AMMO4': '0.233', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:45,725][52658] DAMAGECOUNT value on done: 822648.0 [2024-08-06 07:09:45,733][52658] Sum rewards: 79.894, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.185', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.146', 'weapon5': '0.206', 'AMMO3': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.450', 'weapon3': '2.742', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:45,933][52820] DAMAGECOUNT value on done: 779334.0 [2024-08-06 07:09:45,935][52820] Sum rewards: 84.619, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.019', 'HEALTH': '0.084', 'weapon5': '0.086', 'weapon4': '0.090', 'AMMO4': '0.095', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:45,980][52803] DAMAGECOUNT value on done: 781974.0 [2024-08-06 07:09:45,980][52803] Sum rewards: 66.277, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.094', 'AMMO5': '0.009', 'AMMO2': '0.032', 'ARMOR': '0.036', 'weapon4': '0.114', 'weapon5': '0.114', 'AMMO4': '0.161', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.650', 'weapon3': '2.974', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:46,022][52665] DAMAGECOUNT value on done: 829032.0 [2024-08-06 07:09:46,022][52665] Sum rewards: 75.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.525', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.124', 'weapon4': '0.140', 'AMMO4': '0.153', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:46,300][52649] DAMAGECOUNT value on done: 815169.0 [2024-08-06 07:09:46,300][52649] Sum rewards: 80.386, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.532', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon2': '0.200', 'AMMO3': '0.213', 'weapon4': '0.226', 'AMMO4': '0.233', 'weapon5': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:46,635][52669] DAMAGECOUNT value on done: 838036.0 [2024-08-06 07:09:46,636][52669] Sum rewards: 71.730, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.062', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon4': '0.168', 'weapon2': '0.274', 'AMMO3': '0.279', 'weapon5': '0.298', 'AMMO4': '0.313', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.872', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:46,803][52671] DAMAGECOUNT value on done: 834945.0 [2024-08-06 07:09:46,806][52671] Sum rewards: 78.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.798', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon2': '0.194', 'weapon5': '0.216', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.925', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:47,422][52670] DAMAGECOUNT value on done: 829764.0 [2024-08-06 07:09:47,422][52670] Sum rewards: 80.177, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.088', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:47,478][52663] DAMAGECOUNT value on done: 837108.0 [2024-08-06 07:09:47,479][52663] Sum rewards: 87.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.900', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.134', 'weapon2': '0.188', 'AMMO4': '0.195', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.344', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.948', 'FRAGCOUNT': '73.000'} [2024-08-06 07:09:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 609206272. Throughput: 0: 4362.2. Samples: 152301630. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:47,794][52567] Avg episode reward: [(0, '75.342')] [2024-08-06 07:09:48,481][52795] DAMAGECOUNT value on done: 765449.0 [2024-08-06 07:09:48,482][52795] Sum rewards: 80.285, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.758', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.155', 'weapon5': '0.182', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:48,873][52666] DAMAGECOUNT value on done: 828993.0 [2024-08-06 07:09:48,873][52666] Sum rewards: 58.636, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.551', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.100', 'weapon5': '0.180', 'AMMO4': '0.223', 'weapon2': '0.246', 'AMMO3': '0.301', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.160', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '54.000'} [2024-08-06 07:09:48,945][52820] DAMAGECOUNT value on done: 772148.0 [2024-08-06 07:09:48,948][52820] Sum rewards: 73.433, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.135', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.494', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:49,005][52803] DAMAGECOUNT value on done: 769113.0 [2024-08-06 07:09:49,005][52665] DAMAGECOUNT value on done: 822954.0 [2024-08-06 07:09:49,006][52803] Sum rewards: 76.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '3.058', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:49,006][52665] Sum rewards: 81.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.084', 'weapon4': '0.112', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:49,016][52658] DAMAGECOUNT value on done: 831455.0 [2024-08-06 07:09:49,016][52658] Sum rewards: 66.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.084', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon2': '0.202', 'weapon5': '0.216', 'AMMO3': '0.217', 'AMMO4': '0.231', 'weapon4': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.010', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:49,207][52669] DAMAGECOUNT value on done: 840291.0 [2024-08-06 07:09:49,207][52669] Sum rewards: 81.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.092', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.191', 'weapon2': '0.266', 'weapon4': '0.268', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '66.000'} [2024-08-06 07:09:49,512][52649] DAMAGECOUNT value on done: 806758.0 [2024-08-06 07:09:49,513][52649] Sum rewards: 83.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.572', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.112', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.464', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:49,809][52650] Updated weights for policy 0, policy_version 74371 (0.0018) [2024-08-06 07:09:49,830][52670] DAMAGECOUNT value on done: 816235.0 [2024-08-06 07:09:49,831][52670] Sum rewards: 72.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.890', 'AMMO5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.300', 'weapon3': '3.330', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:50,000][52671] DAMAGECOUNT value on done: 821642.0 [2024-08-06 07:09:50,000][52671] Sum rewards: 77.110, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.683', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.164', 'weapon2': '0.566', 'WEAPON3': '1.000', 'weapon3': '3.300', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '61.000'} [2024-08-06 07:09:50,079][52663] DAMAGECOUNT value on done: 817138.0 [2024-08-06 07:09:50,080][52663] Sum rewards: 79.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.881', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.040', 'AMMO4': '0.132', 'weapon5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:51,206][52666] DAMAGECOUNT value on done: 822034.0 [2024-08-06 07:09:51,214][52666] Sum rewards: 70.310, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.148', 'weapon2': '0.184', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:51,763][52795] DAMAGECOUNT value on done: 759269.0 [2024-08-06 07:09:51,763][52795] Sum rewards: 78.710, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.710', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon2': '0.116', 'weapon5': '0.126', 'AMMO4': '0.181', 'AMMO3': '0.210', 'weapon4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.370', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '63.000'} [2024-08-06 07:09:52,021][52665] DAMAGECOUNT value on done: 817966.0 [2024-08-06 07:09:52,021][52665] Sum rewards: 66.116, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.170', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.136', 'AMMO4': '0.171', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.700', 'weapon3': '3.154', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 07:09:52,071][52669] DAMAGECOUNT value on done: 825994.0 [2024-08-06 07:09:52,073][52669] Sum rewards: 85.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.379', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.142', 'weapon5': '0.184', 'AMMO4': '0.211', 'AMMO3': '0.223', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.243', 'FRAGCOUNT': '71.000'} [2024-08-06 07:09:52,094][52803] DAMAGECOUNT value on done: 771592.0 [2024-08-06 07:09:52,095][52820] DAMAGECOUNT value on done: 772937.0 [2024-08-06 07:09:52,097][52803] Sum rewards: 70.177, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.182', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.096', 'weapon4': '0.134', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '59.000'} [2024-08-06 07:09:52,097][52820] Sum rewards: 90.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '77.000'} [2024-08-06 07:09:52,122][52670] DAMAGECOUNT value on done: 816425.0 [2024-08-06 07:09:52,124][52670] Sum rewards: 76.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.842', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.174', 'AMMO4': '0.186', 'AMMO3': '0.191', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.784', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 609296384. Throughput: 0: 4360.0. Samples: 152327670. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:52,794][52567] Avg episode reward: [(0, '75.731')] [2024-08-06 07:09:52,883][52671] DAMAGECOUNT value on done: 835515.0 [2024-08-06 07:09:52,883][52671] Sum rewards: 82.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.124', 'weapon5': '0.174', 'AMMO3': '0.211', 'AMMO4': '0.225', 'weapon2': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:53,092][52663] DAMAGECOUNT value on done: 814334.0 [2024-08-06 07:09:53,092][52663] Sum rewards: 75.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.586', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.112', 'AMMO3': '0.210', 'AMMO4': '0.220', 'weapon5': '0.258', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '62.000'} [2024-08-06 07:09:53,693][52666] DAMAGECOUNT value on done: 827957.0 [2024-08-06 07:09:53,695][52666] Sum rewards: 63.952, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.735', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.096', 'weapon4': '0.100', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'ARMOR': '0.400', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '53.000'} [2024-08-06 07:09:54,622][52650] Updated weights for policy 0, policy_version 74381 (0.0027) [2024-08-06 07:09:54,642][52665] DAMAGECOUNT value on done: 821104.0 [2024-08-06 07:09:54,643][52665] Sum rewards: 77.289, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.106', 'weapon5': '0.120', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:54,869][52795] DAMAGECOUNT value on done: 761561.0 [2024-08-06 07:09:54,872][52795] Sum rewards: 84.284, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.162', 'AMMO3': '0.198', 'AMMO4': '0.248', 'weapon5': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.832', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:54,887][52670] DAMAGECOUNT value on done: 829220.0 [2024-08-06 07:09:54,889][52670] Sum rewards: 65.745, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.070', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.120', 'AMMO3': '0.148', 'AMMO4': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '53.000'} [2024-08-06 07:09:54,901][52669] DAMAGECOUNT value on done: 826332.0 [2024-08-06 07:09:54,901][52669] Sum rewards: 78.285, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.368', 'AMMO5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '64.000'} [2024-08-06 07:09:55,210][52820] DAMAGECOUNT value on done: 769452.0 [2024-08-06 07:09:55,212][52820] Sum rewards: 81.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.135', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.140', 'weapon4': '0.178', 'AMMO4': '0.208', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:55,251][52803] DAMAGECOUNT value on done: 777283.0 [2024-08-06 07:09:55,253][52803] Sum rewards: 83.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.637', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.420', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:55,629][52663] DAMAGECOUNT value on done: 821647.0 [2024-08-06 07:09:55,631][52663] Sum rewards: 79.121, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.992', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.204', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.334', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:55,918][52671] DAMAGECOUNT value on done: 834160.0 [2024-08-06 07:09:55,920][52671] Sum rewards: 77.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.414', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.117', 'weapon5': '0.132', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '65.000'} [2024-08-06 07:09:56,803][52666] DAMAGECOUNT value on done: 825024.0 [2024-08-06 07:09:56,804][52666] Sum rewards: 73.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.112', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.068', 'AMMO4': '0.180', 'weapon5': '0.190', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:57,400][52669] DAMAGECOUNT value on done: 832083.0 [2024-08-06 07:09:57,401][52669] Sum rewards: 84.159, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.360', 'AMMO5': '0.006', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.167', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.256', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:57,683][52665] DAMAGECOUNT value on done: 814376.0 [2024-08-06 07:09:57,684][52665] Sum rewards: 54.991, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.448', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon7': '0.082', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.124', 'AMMO3': '0.128', 'AMMO4': '0.166', 'WEAPON7': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.598', 'weapon4': '0.656', 'WEAPON3': '0.800', 'weapon3': '2.146', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.205', 'FRAGCOUNT': '44.000'} [2024-08-06 07:09:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 609386496. Throughput: 0: 4350.7. Samples: 152353810. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:09:57,794][52567] Avg episode reward: [(0, '75.900')] [2024-08-06 07:09:58,049][52670] DAMAGECOUNT value on done: 819071.0 [2024-08-06 07:09:58,051][52670] Sum rewards: 70.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.394', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.336', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.366', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '57.000'} [2024-08-06 07:09:58,160][52795] DAMAGECOUNT value on done: 771626.0 [2024-08-06 07:09:58,160][52795] Sum rewards: 69.259, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.550', 'AMMO5': '0.018', 'AMMO2': '0.066', 'weapon5': '0.130', 'weapon4': '0.138', 'AMMO3': '0.224', 'AMMO4': '0.330', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.000'} [2024-08-06 07:09:58,296][52663] DAMAGECOUNT value on done: 822431.0 [2024-08-06 07:09:58,297][52663] Sum rewards: 80.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO3': '0.208', 'AMMO4': '0.211', 'weapon2': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '67.000'} [2024-08-06 07:09:58,330][52803] DAMAGECOUNT value on done: 780546.0 [2024-08-06 07:09:58,330][52803] Sum rewards: 80.517, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.099', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.248', 'weapon2': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.440', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '68.000'} [2024-08-06 07:09:58,367][52820] DAMAGECOUNT value on done: 770920.0 [2024-08-06 07:09:58,367][52820] Sum rewards: 63.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.270', 'AMMO5': '0.021', 'AMMO2': '0.072', 'AMMO3': '0.237', 'weapon2': '0.250', 'weapon5': '0.278', 'weapon4': '0.308', 'AMMO4': '0.360', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.858', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '54.000'} [2024-08-06 07:09:58,977][52671] DAMAGECOUNT value on done: 830230.0 [2024-08-06 07:09:58,980][52671] Sum rewards: 86.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.058', 'weapon5': '0.114', 'AMMO3': '0.202', 'AMMO4': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '72.000'} [2024-08-06 07:09:59,260][52650] Updated weights for policy 0, policy_version 74391 (0.0011) [2024-08-06 07:09:59,495][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:09:59,857][52666] DAMAGECOUNT value on done: 818316.0 [2024-08-06 07:09:59,858][52666] Sum rewards: 81.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.144', 'AMMO4': '0.161', 'weapon5': '0.186', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '69.000'} [2024-08-06 07:10:00,196][52665] DAMAGECOUNT value on done: 822028.0 [2024-08-06 07:10:00,197][52665] Sum rewards: 78.806, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.566', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.185', 'weapon5': '0.254', 'AMMO4': '0.257', 'weapon2': '0.294', 'weapon4': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.880', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:00,386][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:10:00,511][52669] DAMAGECOUNT value on done: 854744.0 [2024-08-06 07:10:00,512][52669] Sum rewards: 82.340, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '68.000'} [2024-08-06 07:10:01,098][52670] DAMAGECOUNT value on done: 815785.0 [2024-08-06 07:10:01,098][52670] Sum rewards: 73.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.762', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.042', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.282', 'AMMO3': '0.292', 'WEAPON3': '1.750', 'HITCOUNT': '3.430', 'weapon3': '3.458', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '64.000'} [2024-08-06 07:10:01,192][52795] DAMAGECOUNT value on done: 755889.0 [2024-08-06 07:10:01,192][52795] Sum rewards: 72.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.546', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.136', 'weapon4': '0.198', 'AMMO3': '0.203', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 07:10:01,435][52820] DAMAGECOUNT value on done: 781129.0 [2024-08-06 07:10:01,436][52820] Sum rewards: 57.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.524', 'AMMO2': '0.010', 'AMMO5': '0.011', 'AMMO4': '0.047', 'weapon5': '0.192', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon4': '0.348', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.620', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '49.500'} [2024-08-06 07:10:01,520][52803] DAMAGECOUNT value on done: 777485.0 [2024-08-06 07:10:01,520][52803] Sum rewards: 61.895, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.310', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.068', 'AMMO4': '0.130', 'weapon4': '0.148', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.514', 'WEAPON3': '0.900', 'weapon3': '3.096', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '48.000'} [2024-08-06 07:10:01,608][52663] DAMAGECOUNT value on done: 830417.0 [2024-08-06 07:10:01,609][52663] Sum rewards: 71.203, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.040', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.480', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.192', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '61.000'} [2024-08-06 07:10:02,130][52671] DAMAGECOUNT value on done: 838695.0 [2024-08-06 07:10:02,131][52671] Sum rewards: 80.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.334', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 609476608. Throughput: 0: 4359.3. Samples: 152367150. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:02,794][52567] Avg episode reward: [(0, '75.537')] [2024-08-06 07:10:02,807][52666] DAMAGECOUNT value on done: 825671.0 [2024-08-06 07:10:02,807][52666] Sum rewards: 78.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.419', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.138', 'weapon5': '0.140', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.212', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '66.000'} [2024-08-06 07:10:03,275][52665] DAMAGECOUNT value on done: 821672.0 [2024-08-06 07:10:03,276][52665] Sum rewards: 77.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.300', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.050', 'AMMO4': '0.139', 'weapon5': '0.180', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '64.000'} [2024-08-06 07:10:03,610][52669] DAMAGECOUNT value on done: 840275.0 [2024-08-06 07:10:03,610][52669] Sum rewards: 84.849, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.017', 'weapon4': '0.018', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.258', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.488', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '73.000'} [2024-08-06 07:10:03,895][52650] Updated weights for policy 0, policy_version 74401 (0.0012) [2024-08-06 07:10:04,066][52670] DAMAGECOUNT value on done: 819245.0 [2024-08-06 07:10:04,067][52670] Sum rewards: 79.296, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.294', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:04,433][52795] DAMAGECOUNT value on done: 770796.0 [2024-08-06 07:10:04,433][52795] Sum rewards: 90.528, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.579', 'FRAGCOUNT': '74.000'} [2024-08-06 07:10:04,461][52663] DAMAGECOUNT value on done: 826206.0 [2024-08-06 07:10:04,462][52663] Sum rewards: 78.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.308', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'weapon2': '0.108', 'AMMO3': '0.215', 'WEAPON3': '1.300', 'weapon3': '3.518', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:04,513][52820] DAMAGECOUNT value on done: 777876.0 [2024-08-06 07:10:04,514][52820] Sum rewards: 71.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.645', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO3': '0.145', 'AMMO4': '0.200', 'weapon5': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON3': '0.850', 'weapon3': '2.948', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '56.500'} [2024-08-06 07:10:04,681][52803] DAMAGECOUNT value on done: 775647.0 [2024-08-06 07:10:04,683][52803] Sum rewards: 77.895, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.280', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.126', 'weapon2': '0.144', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.301', 'WEAPON3': '1.850', 'weapon3': '3.440', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:05,137][52671] DAMAGECOUNT value on done: 833685.0 [2024-08-06 07:10:05,138][52671] Sum rewards: 91.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.708', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon5': '0.066', 'weapon4': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.321', 'FRAGCOUNT': '75.000'} [2024-08-06 07:10:05,487][52666] DAMAGECOUNT value on done: 821691.0 [2024-08-06 07:10:05,488][52666] Sum rewards: 76.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.987', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.090', 'AMMO3': '0.216', 'weapon5': '0.246', 'AMMO4': '0.251', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2024-08-06 07:10:05,753][52665] DAMAGECOUNT value on done: 813146.0 [2024-08-06 07:10:05,754][52665] Sum rewards: 84.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.743', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.076', 'weapon5': '0.088', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.346', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '71.000'} [2024-08-06 07:10:06,356][52669] DAMAGECOUNT value on done: 837579.0 [2024-08-06 07:10:06,356][52669] Sum rewards: 79.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.174', 'weapon5': '0.208', 'AMMO3': '0.230', 'AMMO4': '0.284', 'WEAPON5': '0.500', 'weapon2': '0.528', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.794', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '65.500'} [2024-08-06 07:10:06,802][52670] DAMAGECOUNT value on done: 820327.0 [2024-08-06 07:10:06,802][52670] Sum rewards: 76.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.627', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.058', 'weapon5': '0.094', 'AMMO3': '0.146', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '0.950', 'weapon3': '3.242', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '60.000'} [2024-08-06 07:10:07,471][52663] DAMAGECOUNT value on done: 831861.0 [2024-08-06 07:10:07,474][52663] Sum rewards: 68.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.088', 'AMMO3': '0.139', 'weapon4': '0.194', 'AMMO4': '0.296', 'weapon2': '0.370', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '3.146', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '56.000'} [2024-08-06 07:10:07,571][52820] DAMAGECOUNT value on done: 760261.0 [2024-08-06 07:10:07,573][52820] Sum rewards: 78.475, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.910', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.329', 'weapon2': '0.406', 'WEAPON3': '1.900', 'weapon3': '3.186', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '69.000'} [2024-08-06 07:10:07,602][52795] DAMAGECOUNT value on done: 768207.0 [2024-08-06 07:10:07,602][52795] Sum rewards: 72.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.122', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '61.000'} [2024-08-06 07:10:07,761][52671] DAMAGECOUNT value on done: 819878.0 [2024-08-06 07:10:07,763][52671] Sum rewards: 61.421, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.925', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.184', 'weapon4': '0.190', 'weapon2': '0.252', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.118', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '54.000'} [2024-08-06 07:10:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 609558528. Throughput: 0: 4351.3. Samples: 152393110. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:07,794][52567] Avg episode reward: [(0, '76.075')] [2024-08-06 07:10:08,265][52665] DAMAGECOUNT value on done: 817483.0 [2024-08-06 07:10:08,265][52665] Sum rewards: 61.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.737', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO4': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.772', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.856', 'DAMAGECOUNT': '14.529', 'FRAGCOUNT': '52.000'} [2024-08-06 07:10:08,709][52666] DAMAGECOUNT value on done: 815934.0 [2024-08-06 07:10:08,709][52666] Sum rewards: 75.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '64.000'} [2024-08-06 07:10:08,825][52650] Updated weights for policy 0, policy_version 74411 (0.0013) [2024-08-06 07:10:08,925][52668] DAMAGECOUNT value on done: 835476.0 [2024-08-06 07:10:08,927][52668] Sum rewards: 86.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.214', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'weapon3': '3.554', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '72.500'} [2024-08-06 07:10:09,481][52669] DAMAGECOUNT value on done: 839340.0 [2024-08-06 07:10:09,481][52669] Sum rewards: 77.088, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.154', 'AMMO4': '0.201', 'weapon2': '0.242', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:09,964][52670] DAMAGECOUNT value on done: 814647.0 [2024-08-06 07:10:09,964][52670] Sum rewards: 70.133, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.698', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.086', 'AMMO4': '0.217', 'weapon5': '0.232', 'AMMO3': '0.264', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '59.000'} [2024-08-06 07:10:10,236][52663] DAMAGECOUNT value on done: 834740.0 [2024-08-06 07:10:10,237][52663] Sum rewards: 61.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.996', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.110', 'weapon4': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.790', 'WEAPON3': '1.350', 'weapon3': '2.528', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '53.000'} [2024-08-06 07:10:10,448][52671] DAMAGECOUNT value on done: 843905.0 [2024-08-06 07:10:10,448][52671] Sum rewards: 71.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.229', 'weapon4': '0.272', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '59.000'} [2024-08-06 07:10:10,690][52795] DAMAGECOUNT value on done: 757333.0 [2024-08-06 07:10:10,691][52795] Sum rewards: 68.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.156', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '56.000'} [2024-08-06 07:10:11,078][52665] DAMAGECOUNT value on done: 823353.0 [2024-08-06 07:10:11,078][52665] Sum rewards: 88.690, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.264', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.076', 'AMMO4': '0.196', 'weapon2': '0.208', 'AMMO3': '0.222', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.865', 'FRAGCOUNT': '74.000'} [2024-08-06 07:10:11,772][52666] DAMAGECOUNT value on done: 826175.0 [2024-08-06 07:10:11,773][52666] Sum rewards: 71.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.400', 'weapon3': '2.830', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '60.000'} [2024-08-06 07:10:11,954][52668] DAMAGECOUNT value on done: 836453.0 [2024-08-06 07:10:11,957][52668] Sum rewards: 82.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.960', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.070', 'weapon5': '0.122', 'AMMO4': '0.127', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '68.000'} [2024-08-06 07:10:12,234][52669] DAMAGECOUNT value on done: 841959.0 [2024-08-06 07:10:12,235][52669] Sum rewards: 74.242, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'HEALTH': '0.318', 'weapon2': '0.816', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '60.000'} [2024-08-06 07:10:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 609648640. Throughput: 0: 4360.9. Samples: 152419590. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:12,794][52567] Avg episode reward: [(0, '75.629')] [2024-08-06 07:10:12,883][52671] DAMAGECOUNT value on done: 839073.0 [2024-08-06 07:10:12,885][52671] Sum rewards: 89.300, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'weapon4': '0.348', 'weapon2': '0.464', 'WEAPON3': '1.000', 'weapon3': '2.990', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '71.000'} [2024-08-06 07:10:12,898][52670] DAMAGECOUNT value on done: 826663.0 [2024-08-06 07:10:12,899][52670] Sum rewards: 77.008, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.215', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.442', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:13,193][52650] Updated weights for policy 0, policy_version 74421 (0.0016) [2024-08-06 07:10:13,328][52663] DAMAGECOUNT value on done: 820010.0 [2024-08-06 07:10:13,329][52663] Sum rewards: 71.496, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.466', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.096', 'AMMO3': '0.221', 'AMMO4': '0.222', 'weapon5': '0.248', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '61.000'} [2024-08-06 07:10:13,677][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:10:13,812][52795] DAMAGECOUNT value on done: 767725.0 [2024-08-06 07:10:13,812][52795] Sum rewards: 88.133, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.395', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.092', 'weapon5': '0.202', 'weapon2': '0.216', 'AMMO3': '0.251', 'AMMO4': '0.273', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '75.000'} [2024-08-06 07:10:13,880][52660] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 07:10:14,222][52666] DAMAGECOUNT value on done: 818729.0 [2024-08-06 07:10:14,224][52666] Sum rewards: 74.411, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.853', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.190', 'AMMO4': '0.192', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:14,874][52668] DAMAGECOUNT value on done: 832104.0 [2024-08-06 07:10:14,877][52668] Sum rewards: 72.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.670', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.130', 'weapon5': '0.180', 'AMMO4': '0.180', 'weapon2': '0.224', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '61.000'} [2024-08-06 07:10:15,466][52670] DAMAGECOUNT value on done: 808704.0 [2024-08-06 07:10:15,467][52670] Sum rewards: 55.988, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.155', 'weapon2': '0.468', 'WEAPON3': '0.950', 'HITCOUNT': '2.790', 'weapon3': '3.362', 'DAMAGECOUNT': '13.155', 'FRAGCOUNT': '46.000'} [2024-08-06 07:10:15,790][52671] DAMAGECOUNT value on done: 834716.0 [2024-08-06 07:10:15,791][52671] Sum rewards: 74.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.070', 'AMMO4': '0.090', 'weapon4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.216', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:16,934][52795] DAMAGECOUNT value on done: 774083.0 [2024-08-06 07:10:16,935][52795] Sum rewards: 78.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon2': '0.188', 'AMMO3': '0.217', 'weapon5': '0.228', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:17,066][52666] DAMAGECOUNT value on done: 826821.0 [2024-08-06 07:10:17,068][52666] Sum rewards: 80.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.523', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.132', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 609730560. Throughput: 0: 4360.5. Samples: 152432540. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:17,802][52567] Avg episode reward: [(0, '76.008')] [2024-08-06 07:10:17,907][52668] DAMAGECOUNT value on done: 837541.0 [2024-08-06 07:10:17,908][52668] Sum rewards: 63.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.154', 'weapon2': '0.166', 'AMMO4': '0.218', 'AMMO3': '0.232', 'weapon4': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.880', 'weapon3': '3.142', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '53.000'} [2024-08-06 07:10:18,098][52650] Updated weights for policy 0, policy_version 74431 (0.0025) [2024-08-06 07:10:18,211][52670] DAMAGECOUNT value on done: 824205.0 [2024-08-06 07:10:18,213][52670] Sum rewards: 78.540, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.137', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO3': '0.128', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '0.850', 'weapon3': '2.914', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:18,610][52671] DAMAGECOUNT value on done: 838707.0 [2024-08-06 07:10:18,611][52671] Sum rewards: 79.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.176', 'weapon2': '0.214', 'WEAPON3': '1.100', 'weapon3': '3.470', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:20,158][52666] DAMAGECOUNT value on done: 812865.0 [2024-08-06 07:10:20,159][52666] Sum rewards: 80.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.094', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.554', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:20,967][52668] DAMAGECOUNT value on done: 822925.0 [2024-08-06 07:10:20,969][52668] Sum rewards: 78.726, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.170', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.080', 'AMMO4': '0.184', 'weapon4': '0.192', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.700', 'weapon3': '3.004', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '69.000'} [2024-08-06 07:10:21,084][52671] DAMAGECOUNT value on done: 825053.0 [2024-08-06 07:10:21,085][52671] Sum rewards: 74.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.985', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.082', 'weapon5': '0.164', 'AMMO3': '0.226', 'AMMO4': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '61.000'} [2024-08-06 07:10:21,662][52670] DAMAGECOUNT value on done: 829506.0 [2024-08-06 07:10:21,663][52670] Sum rewards: 80.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.116', 'weapon4': '0.134', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.764', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '64.000'} [2024-08-06 07:10:22,702][52650] Updated weights for policy 0, policy_version 74441 (0.0051) [2024-08-06 07:10:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 609820672. Throughput: 0: 4365.6. Samples: 152458910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:22,794][52567] Avg episode reward: [(0, '75.973')] [2024-08-06 07:10:23,400][52666] DAMAGECOUNT value on done: 829240.0 [2024-08-06 07:10:23,400][52666] Sum rewards: 81.012, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.570', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.356', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:24,061][52668] DAMAGECOUNT value on done: 833807.0 [2024-08-06 07:10:24,064][52668] Sum rewards: 76.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.086', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.240', 'weapon2': '0.482', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:24,483][52670] DAMAGECOUNT value on done: 823885.0 [2024-08-06 07:10:24,484][52670] Sum rewards: 68.178, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.990', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.086', 'weapon2': '0.172', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.370', 'WEAPON3': '2.100', 'HITCOUNT': '3.400', 'weapon3': '3.406', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '64.000'} [2024-08-06 07:10:26,592][52666] DAMAGECOUNT value on done: 824850.0 [2024-08-06 07:10:26,592][52666] Sum rewards: 77.685, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.158', 'AMMO3': '0.184', 'weapon2': '0.246', 'HEALTH': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.342', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '62.000'} [2024-08-06 07:10:27,055][52668] DAMAGECOUNT value on done: 833462.0 [2024-08-06 07:10:27,057][52668] Sum rewards: 80.866, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.136', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '66.000'} [2024-08-06 07:10:27,315][52650] Updated weights for policy 0, policy_version 74451 (0.0011) [2024-08-06 07:10:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 609910784. Throughput: 0: 4373.1. Samples: 152485330. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:27,795][52567] Avg episode reward: [(0, '76.090')] [2024-08-06 07:10:27,803][52670] DAMAGECOUNT value on done: 805441.0 [2024-08-06 07:10:27,804][52670] Sum rewards: 67.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.634', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.244', 'weapon2': '0.250', 'AMMO4': '0.254', 'WEAPON4': '0.350', 'weapon5': '0.362', 'WEAPON5': '0.400', 'weapon4': '0.434', 'WEAPON3': '1.300', 'weapon3': '2.632', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 07:10:27,852][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074453_609918976.pth... [2024-08-06 07:10:27,993][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000073940_605716480.pth [2024-08-06 07:10:28,355][52662] DAMAGECOUNT value on done: 829848.0 [2024-08-06 07:10:28,355][52662] Sum rewards: 81.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.036', 'weapon4': '0.046', 'AMMO4': '0.149', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.458', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '68.000'} [2024-08-06 07:10:29,674][52666] DAMAGECOUNT value on done: 824451.0 [2024-08-06 07:10:29,675][52666] Sum rewards: 78.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.755', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '3.390', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:30,178][52668] DAMAGECOUNT value on done: 823926.0 [2024-08-06 07:10:30,178][52668] Sum rewards: 72.246, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.120', 'AMMO4': '0.171', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '62.000'} [2024-08-06 07:10:30,467][52670] DAMAGECOUNT value on done: 821408.0 [2024-08-06 07:10:30,468][52670] Sum rewards: 85.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.072', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.120', 'AMMO4': '0.124', 'weapon2': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.494', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '70.000'} [2024-08-06 07:10:31,480][52662] DAMAGECOUNT value on done: 839116.0 [2024-08-06 07:10:31,482][52662] Sum rewards: 58.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.725', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon5': '0.136', 'AMMO3': '0.219', 'weapon4': '0.248', 'weapon2': '0.274', 'WEAPON5': '0.300', 'AMMO4': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '48.000'} [2024-08-06 07:10:31,955][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:10:32,056][52650] Updated weights for policy 0, policy_version 74461 (0.0053) [2024-08-06 07:10:32,451][52666] DAMAGECOUNT value on done: 819408.0 [2024-08-06 07:10:32,452][52666] Sum rewards: 70.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO4': '0.191', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '58.000'} [2024-08-06 07:10:32,700][52668] DAMAGECOUNT value on done: 827287.0 [2024-08-06 07:10:32,700][52668] Sum rewards: 67.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.862', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.120', 'AMMO4': '0.169', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '54.000'} [2024-08-06 07:10:32,801][52567] Fps is (10 sec: 17190.7, 60 sec: 17474.2, 300 sec: 17466.6). Total num frames: 609992704. Throughput: 0: 4367.3. Samples: 152498190. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:32,802][52567] Avg episode reward: [(0, '75.867')] [2024-08-06 07:10:33,528][52670] DAMAGECOUNT value on done: 830019.0 [2024-08-06 07:10:33,536][52670] Sum rewards: 77.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.285', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.180', 'AMMO3': '0.214', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:34,596][52662] DAMAGECOUNT value on done: 840667.0 [2024-08-06 07:10:34,598][52662] Sum rewards: 86.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.332', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon2': '0.206', 'AMMO3': '0.237', 'WEAPON3': '1.550', 'weapon3': '3.624', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '73.000'} [2024-08-06 07:10:35,427][52666] DAMAGECOUNT value on done: 818645.0 [2024-08-06 07:10:35,427][52666] Sum rewards: 83.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.022', 'weapon5': '0.038', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.230', 'AMMO3': '0.233', 'WEAPON3': '1.350', 'weapon3': '3.510', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '70.000'} [2024-08-06 07:10:35,789][52668] DAMAGECOUNT value on done: 835008.0 [2024-08-06 07:10:35,792][52668] Sum rewards: 83.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.036', 'AMMO4': '0.112', 'weapon5': '0.160', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.208', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:36,276][52670] DAMAGECOUNT value on done: 821831.0 [2024-08-06 07:10:36,276][52670] Sum rewards: 78.338, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.534', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'weapon4': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.259', 'WEAPON3': '1.500', 'weapon3': '3.282', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:36,776][52650] Updated weights for policy 0, policy_version 74471 (0.0041) [2024-08-06 07:10:37,600][52662] DAMAGECOUNT value on done: 825576.0 [2024-08-06 07:10:37,602][52662] Sum rewards: 74.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.186', 'AMMO3': '0.214', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.300', 'weapon3': '2.766', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '59.000'} [2024-08-06 07:10:37,681][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:10:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 610082816. Throughput: 0: 4380.2. Samples: 152524780. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:37,795][52567] Avg episode reward: [(0, '76.063')] [2024-08-06 07:10:38,268][52666] DAMAGECOUNT value on done: 833435.0 [2024-08-06 07:10:38,269][52666] Sum rewards: 67.360, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.630', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.108', 'AMMO4': '0.115', 'AMMO3': '0.154', 'weapon5': '0.156', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '53.000'} [2024-08-06 07:10:38,876][52668] DAMAGECOUNT value on done: 828177.0 [2024-08-06 07:10:38,876][52668] Sum rewards: 80.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.988', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon2': '0.174', 'AMMO3': '0.196', 'WEAPON3': '1.200', 'weapon3': '3.608', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:39,254][52670] DAMAGECOUNT value on done: 823810.0 [2024-08-06 07:10:39,255][52670] Sum rewards: 63.724, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.056', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.152', 'AMMO4': '0.163', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '54.000'} [2024-08-06 07:10:40,633][52662] DAMAGECOUNT value on done: 843019.0 [2024-08-06 07:10:40,633][52662] Sum rewards: 75.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.535', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.084', 'weapon5': '0.180', 'weapon2': '0.196', 'AMMO3': '0.202', 'AMMO4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.320', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:41,249][52650] Updated weights for policy 0, policy_version 74481 (0.0037) [2024-08-06 07:10:41,309][52666] DAMAGECOUNT value on done: 811667.0 [2024-08-06 07:10:41,310][52666] Sum rewards: 75.362, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.048', 'weapon5': '0.074', 'AMMO4': '0.113', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:41,953][52668] DAMAGECOUNT value on done: 824102.0 [2024-08-06 07:10:41,953][52668] Sum rewards: 72.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.645', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.038', 'AMMO4': '0.123', 'weapon5': '0.146', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '61.000'} [2024-08-06 07:10:42,794][52567] Fps is (10 sec: 18035.0, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 610172928. Throughput: 0: 4377.7. Samples: 152550810. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:10:42,795][52567] Avg episode reward: [(0, '75.742')] [2024-08-06 07:10:43,953][52662] DAMAGECOUNT value on done: 821850.0 [2024-08-06 07:10:43,956][52662] Sum rewards: 67.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.472', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.030', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.526', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2024-08-06 07:10:44,218][52666] DAMAGECOUNT value on done: 819282.0 [2024-08-06 07:10:44,218][52666] Sum rewards: 74.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.166', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.084', 'AMMO4': '0.214', 'weapon5': '0.220', 'AMMO3': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.550', 'weapon3': '2.954', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:45,129][52668] DAMAGECOUNT value on done: 820085.0 [2024-08-06 07:10:45,129][52668] Sum rewards: 78.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.144', 'weapon4': '0.152', 'AMMO4': '0.175', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:46,065][52650] Updated weights for policy 0, policy_version 74491 (0.0025) [2024-08-06 07:10:46,887][52662] DAMAGECOUNT value on done: 827989.0 [2024-08-06 07:10:46,889][52662] Sum rewards: 62.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.573', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.387', 'FRAGCOUNT': '52.000'} [2024-08-06 07:10:47,610][52668] DAMAGECOUNT value on done: 820999.0 [2024-08-06 07:10:47,611][52668] Sum rewards: 77.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.890', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.178', 'weapon2': '0.208', 'weapon4': '0.244', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 610254848. Throughput: 0: 4374.4. Samples: 152564000. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:10:47,795][52567] Avg episode reward: [(0, '75.518')] [2024-08-06 07:10:49,517][52662] DAMAGECOUNT value on done: 846473.0 [2024-08-06 07:10:49,518][52662] Sum rewards: 77.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.023', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.153', 'weapon5': '0.154', 'AMMO3': '0.232', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:49,783][52647] DAMAGECOUNT value on done: 884244.0 [2024-08-06 07:10:49,783][52647] Sum rewards: 64.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.081', 'AMMO5': '0.019', 'AMMO2': '0.049', 'AMMO3': '0.171', 'weapon5': '0.172', 'weapon4': '0.244', 'AMMO4': '0.247', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '2.730', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '52.000'} [2024-08-06 07:10:50,500][52668] DAMAGECOUNT value on done: 815391.0 [2024-08-06 07:10:50,500][52668] Sum rewards: 70.367, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.110', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.148', 'weapon5': '0.180', 'AMMO4': '0.229', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.650', 'weapon3': '2.872', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '61.000'} [2024-08-06 07:10:50,826][52650] Updated weights for policy 0, policy_version 74501 (0.0022) [2024-08-06 07:10:52,266][52647] DAMAGECOUNT value on done: 872110.0 [2024-08-06 07:10:52,266][52647] Sum rewards: 65.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.842', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.157', 'weapon5': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.570', 'FRAGCOUNT': '56.000'} [2024-08-06 07:10:52,282][52662] DAMAGECOUNT value on done: 833467.0 [2024-08-06 07:10:52,282][52662] Sum rewards: 80.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.136', 'weapon4': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '65.000'} [2024-08-06 07:10:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 610344960. Throughput: 0: 4385.5. Samples: 152590460. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:10:52,795][52567] Avg episode reward: [(0, '75.212')] [2024-08-06 07:10:53,248][52664] DAMAGECOUNT value on done: 857975.0 [2024-08-06 07:10:53,249][52664] Sum rewards: 56.854, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon2': '0.216', 'weapon4': '0.240', 'AMMO3': '0.267', 'weapon5': '0.276', 'AMMO4': '0.322', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'HITCOUNT': '2.680', 'weapon3': '2.972', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '49.000'} [2024-08-06 07:10:53,575][52668] DAMAGECOUNT value on done: 829092.0 [2024-08-06 07:10:53,575][52668] Sum rewards: 77.284, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.765', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '64.000'} [2024-08-06 07:10:54,749][52660] DAMAGECOUNT value on done: 827551.0 [2024-08-06 07:10:54,759][52660] Sum rewards: 81.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.125', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon2': '0.176', 'weapon5': '0.180', 'AMMO3': '0.198', 'weapon4': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '66.000'} [2024-08-06 07:10:55,007][52662] DAMAGECOUNT value on done: 838289.0 [2024-08-06 07:10:55,008][52662] Sum rewards: 81.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.777', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO4': '0.179', 'weapon4': '0.180', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:55,200][52647] DAMAGECOUNT value on done: 880454.0 [2024-08-06 07:10:55,201][52647] Sum rewards: 73.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.523', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.126', 'weapon4': '0.156', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '58.000'} [2024-08-06 07:10:55,354][52650] Updated weights for policy 0, policy_version 74511 (0.0017) [2024-08-06 07:10:55,898][52664] DAMAGECOUNT value on done: 863608.0 [2024-08-06 07:10:55,898][52664] Sum rewards: 69.096, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.765', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.108', 'weapon5': '0.136', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.576', 'WEAPON3': '0.950', 'weapon3': '2.980', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '54.000'} [2024-08-06 07:10:56,415][52668] DAMAGECOUNT value on done: 833269.0 [2024-08-06 07:10:56,416][52668] Sum rewards: 82.679, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.618', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.162', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '66.000'} [2024-08-06 07:10:56,895][52667] DAMAGECOUNT value on done: 830471.0 [2024-08-06 07:10:56,895][52667] Sum rewards: 79.607, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.462', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.098', 'AMMO4': '0.141', 'weapon5': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '67.000'} [2024-08-06 07:10:57,444][52660] DAMAGECOUNT value on done: 820827.0 [2024-08-06 07:10:57,444][52660] Sum rewards: 83.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.102', 'AMMO4': '0.192', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.475', 'FRAGCOUNT': '68.000'} [2024-08-06 07:10:57,678][52662] DAMAGECOUNT value on done: 828102.0 [2024-08-06 07:10:57,680][52662] Sum rewards: 65.634, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon4': '0.302', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 07:10:57,766][52647] DAMAGECOUNT value on done: 878559.0 [2024-08-06 07:10:57,767][52647] Sum rewards: 77.141, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.029', 'AMMO2': '0.080', 'weapon2': '0.218', 'AMMO3': '0.225', 'weapon4': '0.376', 'AMMO4': '0.401', 'weapon5': '0.440', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '62.000'} [2024-08-06 07:10:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 610426880. Throughput: 0: 4383.5. Samples: 152616850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:10:57,795][52567] Avg episode reward: [(0, '75.255')] [2024-08-06 07:10:57,989][52614] Signal inference workers to stop experience collection... (13600 times) [2024-08-06 07:10:57,990][52614] Signal inference workers to resume experience collection... (13600 times) [2024-08-06 07:10:58,036][52650] InferenceWorker_p0-w0: stopping experience collection (13600 times) [2024-08-06 07:10:58,036][52650] InferenceWorker_p0-w0: resuming experience collection (13600 times) [2024-08-06 07:10:58,732][52664] DAMAGECOUNT value on done: 865343.0 [2024-08-06 07:10:58,732][52664] Sum rewards: 84.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.430', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '69.000'} [2024-08-06 07:10:59,193][52668] DAMAGECOUNT value on done: 828793.0 [2024-08-06 07:10:59,195][52668] Sum rewards: 73.580, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.080', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.271', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.280', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '63.000'} [2024-08-06 07:10:59,826][52650] Updated weights for policy 0, policy_version 74521 (0.0018) [2024-08-06 07:10:59,928][52667] DAMAGECOUNT value on done: 839500.0 [2024-08-06 07:10:59,930][52667] Sum rewards: 67.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.174', 'AMMO3': '0.207', 'AMMO4': '0.221', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.020', 'weapon3': '3.226', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '57.000'} [2024-08-06 07:11:00,359][52662] DAMAGECOUNT value on done: 831440.0 [2024-08-06 07:11:00,361][52662] Sum rewards: 75.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO2': '0.003', 'AMMO5': '0.004', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.060', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '63.000'} [2024-08-06 07:11:00,601][52647] DAMAGECOUNT value on done: 885791.0 [2024-08-06 07:11:00,603][52647] Sum rewards: 79.161, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.154', 'weapon4': '0.176', 'weapon2': '0.354', 'WEAPON3': '0.850', 'HEALTH': '0.910', 'weapon3': '3.296', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '60.000'} [2024-08-06 07:11:00,632][52660] DAMAGECOUNT value on done: 831246.0 [2024-08-06 07:11:00,632][52660] Sum rewards: 61.845, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.510', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO4': '0.243', 'weapon2': '0.294', 'AMMO3': '0.299', 'weapon4': '0.312', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'HITCOUNT': '2.870', 'weapon3': '2.952', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '55.000'} [2024-08-06 07:11:01,722][52664] DAMAGECOUNT value on done: 857866.0 [2024-08-06 07:11:01,724][52664] Sum rewards: 83.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.292', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.110', 'weapon4': '0.126', 'AMMO4': '0.144', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '70.000'} [2024-08-06 07:11:02,308][52667] DAMAGECOUNT value on done: 835314.0 [2024-08-06 07:11:02,310][52667] Sum rewards: 72.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.825', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.127', 'weapon5': '0.196', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.450', 'weapon3': '2.938', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '61.000'} [2024-08-06 07:11:02,312][52668] DAMAGECOUNT value on done: 834440.0 [2024-08-06 07:11:02,312][52668] Sum rewards: 77.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.795', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.057', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 610525184. Throughput: 0: 4384.9. Samples: 152629860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:11:02,794][52567] Avg episode reward: [(0, '75.455')] [2024-08-06 07:11:03,200][52662] DAMAGECOUNT value on done: 823017.0 [2024-08-06 07:11:03,201][52662] Sum rewards: 69.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.962', 'AMMO5': '0.023', 'AMMO2': '0.065', 'weapon4': '0.166', 'weapon2': '0.190', 'AMMO3': '0.239', 'AMMO4': '0.324', 'weapon5': '0.402', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.894', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 07:11:03,640][52660] DAMAGECOUNT value on done: 843292.0 [2024-08-06 07:11:03,641][52660] Sum rewards: 68.095, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.633', 'AMMO5': '0.032', 'AMMO2': '0.068', 'AMMO3': '0.222', 'weapon4': '0.274', 'weapon5': '0.326', 'AMMO4': '0.338', 'weapon2': '0.468', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.560', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '58.000'} [2024-08-06 07:11:03,835][52647] DAMAGECOUNT value on done: 881302.0 [2024-08-06 07:11:03,835][52647] Sum rewards: 81.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.144', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.108', 'AMMO4': '0.196', 'AMMO3': '0.209', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '68.500'} [2024-08-06 07:11:04,628][52664] DAMAGECOUNT value on done: 867629.0 [2024-08-06 07:11:04,631][52664] Sum rewards: 72.829, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'AMMO3': '0.178', 'weapon5': '0.196', 'HEALTH': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.354', 'weapon2': '0.414', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '57.000'} [2024-08-06 07:11:04,934][52650] Updated weights for policy 0, policy_version 74531 (0.0019) [2024-08-06 07:11:05,089][52668] DAMAGECOUNT value on done: 834010.0 [2024-08-06 07:11:05,089][52668] Sum rewards: 71.805, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.312', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.244', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '2.840', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '63.000'} [2024-08-06 07:11:05,264][52667] DAMAGECOUNT value on done: 842340.0 [2024-08-06 07:11:05,264][52667] Sum rewards: 78.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.136', 'AMMO4': '0.223', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.714', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:05,932][52662] DAMAGECOUNT value on done: 837149.0 [2024-08-06 07:11:05,934][52662] Sum rewards: 87.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.798', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.187', 'weapon2': '0.482', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '72.000'} [2024-08-06 07:11:06,376][52647] DAMAGECOUNT value on done: 884446.0 [2024-08-06 07:11:06,377][52647] Sum rewards: 83.667, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.055', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:06,484][52660] DAMAGECOUNT value on done: 824921.0 [2024-08-06 07:11:06,484][52660] Sum rewards: 76.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.010', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.155', 'weapon5': '0.164', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.614', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:07,630][52664] DAMAGECOUNT value on done: 863018.0 [2024-08-06 07:11:07,630][52664] Sum rewards: 79.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.327', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.049', 'weapon4': '0.072', 'weapon5': '0.106', 'AMMO3': '0.211', 'weapon2': '0.220', 'AMMO4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:07,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 610607104. Throughput: 0: 4379.6. Samples: 152655990. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:11:07,794][52567] Avg episode reward: [(0, '75.005')] [2024-08-06 07:11:08,143][52667] DAMAGECOUNT value on done: 843641.0 [2024-08-06 07:11:08,143][52667] Sum rewards: 82.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.015', 'AMMO2': '0.061', 'AMMO3': '0.194', 'weapon5': '0.206', 'weapon4': '0.300', 'AMMO4': '0.303', 'weapon2': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '66.000'} [2024-08-06 07:11:09,222][52660] DAMAGECOUNT value on done: 821510.0 [2024-08-06 07:11:09,224][52660] Sum rewards: 77.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.213', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:09,262][52650] Updated weights for policy 0, policy_version 74541 (0.0024) [2024-08-06 07:11:09,294][52647] DAMAGECOUNT value on done: 862955.0 [2024-08-06 07:11:09,295][52647] Sum rewards: 78.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.746', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.073', 'weapon4': '0.094', 'weapon5': '0.118', 'AMMO3': '0.200', 'AMMO4': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '66.000'} [2024-08-06 07:11:09,307][52662] DAMAGECOUNT value on done: 824884.0 [2024-08-06 07:11:09,307][52662] Sum rewards: 73.834, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:10,198][52664] DAMAGECOUNT value on done: 857652.0 [2024-08-06 07:11:10,208][52664] Sum rewards: 77.590, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.472', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO4': '0.161', 'weapon5': '0.168', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:10,868][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:11:11,447][52667] DAMAGECOUNT value on done: 840243.0 [2024-08-06 07:11:11,449][52667] Sum rewards: 80.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.098', 'AMMO3': '0.242', 'weapon5': '0.248', 'AMMO4': '0.293', 'weapon2': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '67.000'} [2024-08-06 07:11:11,811][52662] DAMAGECOUNT value on done: 842016.0 [2024-08-06 07:11:11,812][52662] Sum rewards: 76.539, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.966', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.134', 'AMMO4': '0.165', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.814', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:11,819][52647] DAMAGECOUNT value on done: 878579.0 [2024-08-06 07:11:11,820][52647] Sum rewards: 78.215, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.074', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.088', 'AMMO3': '0.139', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon2': '0.360', 'WEAPON3': '0.950', 'weapon3': '3.084', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '61.000'} [2024-08-06 07:11:12,175][52660] DAMAGECOUNT value on done: 828821.0 [2024-08-06 07:11:12,176][52660] Sum rewards: 65.505, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.100', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.318', 'WEAPON3': '1.950', 'HITCOUNT': '3.400', 'weapon3': '3.452', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '59.000'} [2024-08-06 07:11:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 610697216. Throughput: 0: 4377.6. Samples: 152682320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:11:12,794][52567] Avg episode reward: [(0, '75.299')] [2024-08-06 07:11:13,082][52664] DAMAGECOUNT value on done: 852578.0 [2024-08-06 07:11:13,084][52664] Sum rewards: 85.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.175', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.398', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '69.000'} [2024-08-06 07:11:13,953][52650] Updated weights for policy 0, policy_version 74551 (0.0017) [2024-08-06 07:11:14,497][52647] DAMAGECOUNT value on done: 876870.0 [2024-08-06 07:11:14,497][52647] Sum rewards: 79.158, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.300', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.176', 'AMMO3': '0.178', 'AMMO4': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.972', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:14,575][52667] DAMAGECOUNT value on done: 836808.0 [2024-08-06 07:11:14,575][52667] Sum rewards: 74.559, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.046', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.234', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '63.000'} [2024-08-06 07:11:14,614][52669] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:11:14,896][52662] DAMAGECOUNT value on done: 834585.0 [2024-08-06 07:11:14,896][52662] Sum rewards: 74.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.072', 'weapon4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '63.000'} [2024-08-06 07:11:15,306][52660] DAMAGECOUNT value on done: 836570.0 [2024-08-06 07:11:15,306][52660] Sum rewards: 71.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.005', 'AMMO5': '0.023', 'AMMO2': '0.063', 'weapon5': '0.228', 'AMMO3': '0.246', 'weapon2': '0.260', 'weapon4': '0.298', 'AMMO4': '0.315', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.902', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '60.000'} [2024-08-06 07:11:15,615][52664] DAMAGECOUNT value on done: 866122.0 [2024-08-06 07:11:15,616][52664] Sum rewards: 63.127, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.833', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.056', 'AMMO4': '0.158', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.394', 'WEAPON3': '1.600', 'weapon3': '3.072', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '55.000'} [2024-08-06 07:11:16,771][52647] DAMAGECOUNT value on done: 874865.0 [2024-08-06 07:11:16,771][52647] Sum rewards: 59.580, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.106', 'AMMO3': '0.203', 'AMMO4': '0.224', 'weapon5': '0.316', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '2.970', 'weapon3': '3.006', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '49.000'} [2024-08-06 07:11:17,201][52667] DAMAGECOUNT value on done: 833043.0 [2024-08-06 07:11:17,203][52667] Sum rewards: 87.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.462', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.188', 'AMMO4': '0.195', 'weapon2': '0.228', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.284', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.006', 'FRAGCOUNT': '72.000'} [2024-08-06 07:11:17,695][52662] DAMAGECOUNT value on done: 818811.0 [2024-08-06 07:11:17,696][52662] Sum rewards: 76.199, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.037', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.094', 'weapon5': '0.190', 'AMMO4': '0.195', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.110', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:17,746][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:11:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 610779136. Throughput: 0: 4384.7. Samples: 152695470. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:11:17,794][52567] Avg episode reward: [(0, '75.364')] [2024-08-06 07:11:18,199][52664] DAMAGECOUNT value on done: 859519.0 [2024-08-06 07:11:18,199][52664] Sum rewards: 81.533, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.035', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon2': '0.238', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.432', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.057', 'FRAGCOUNT': '69.000'} [2024-08-06 07:11:18,650][52650] Updated weights for policy 0, policy_version 74561 (0.0036) [2024-08-06 07:11:18,805][52660] DAMAGECOUNT value on done: 823181.0 [2024-08-06 07:11:18,805][52660] Sum rewards: 70.448, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.731', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon5': '0.146', 'AMMO3': '0.225', 'weapon4': '0.246', 'AMMO4': '0.282', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '60.500'} [2024-08-06 07:11:19,750][52647] DAMAGECOUNT value on done: 865301.0 [2024-08-06 07:11:19,750][52647] Sum rewards: 81.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.076', 'weapon5': '0.088', 'AMMO4': '0.113', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '67.000'} [2024-08-06 07:11:20,306][52667] DAMAGECOUNT value on done: 835077.0 [2024-08-06 07:11:20,318][52667] Sum rewards: 73.230, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon4': '0.090', 'weapon5': '0.214', 'AMMO3': '0.220', 'weapon2': '0.256', 'AMMO4': '0.301', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '61.000'} [2024-08-06 07:11:20,435][52659] DAMAGECOUNT value on done: 832807.0 [2024-08-06 07:11:20,435][52659] Sum rewards: 69.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.106', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.122', 'AMMO4': '0.193', 'AMMO3': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON4': '0.450', 'weapon2': '0.556', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '58.000'} [2024-08-06 07:11:20,952][52662] DAMAGECOUNT value on done: 829056.0 [2024-08-06 07:11:20,952][52662] Sum rewards: 68.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.126', 'weapon5': '0.136', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '56.000'} [2024-08-06 07:11:21,150][52664] DAMAGECOUNT value on done: 871180.0 [2024-08-06 07:11:21,153][52664] Sum rewards: 76.970, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.106', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.278', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '66.000'} [2024-08-06 07:11:21,332][52660] DAMAGECOUNT value on done: 822723.0 [2024-08-06 07:11:21,333][52660] Sum rewards: 82.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.705', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.204', 'AMMO3': '0.211', 'weapon2': '0.240', 'AMMO4': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:22,175][52647] DAMAGECOUNT value on done: 881535.0 [2024-08-06 07:11:22,175][52647] Sum rewards: 72.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.928', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.266', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '2.806', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '61.000'} [2024-08-06 07:11:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 610869248. Throughput: 0: 4369.6. Samples: 152721410. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:11:22,794][52567] Avg episode reward: [(0, '75.311')] [2024-08-06 07:11:23,037][52667] DAMAGECOUNT value on done: 839865.0 [2024-08-06 07:11:23,039][52667] Sum rewards: 81.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.215', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.128', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.322', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:23,353][52659] DAMAGECOUNT value on done: 829095.0 [2024-08-06 07:11:23,353][52659] Sum rewards: 67.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.102', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon2': '0.176', 'weapon5': '0.228', 'AMMO3': '0.239', 'AMMO4': '0.247', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.010', 'weapon3': '3.218', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '57.000'} [2024-08-06 07:11:23,358][52650] Updated weights for policy 0, policy_version 74571 (0.0021) [2024-08-06 07:11:23,574][52664] DAMAGECOUNT value on done: 868655.0 [2024-08-06 07:11:23,576][52664] Sum rewards: 80.644, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.366', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.100', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.249', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:24,047][52662] DAMAGECOUNT value on done: 822157.0 [2024-08-06 07:11:24,047][52662] Sum rewards: 74.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.558', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO3': '0.192', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '59.000'} [2024-08-06 07:11:24,465][52660] DAMAGECOUNT value on done: 833554.0 [2024-08-06 07:11:24,465][52660] Sum rewards: 79.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.308', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:24,919][52647] DAMAGECOUNT value on done: 868640.0 [2024-08-06 07:11:24,920][52647] Sum rewards: 75.858, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.698', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.158', 'AMMO4': '0.173', 'AMMO3': '0.247', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:25,952][52659] DAMAGECOUNT value on done: 837239.0 [2024-08-06 07:11:25,955][52659] Sum rewards: 72.459, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.150', 'weapon4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:26,215][52667] DAMAGECOUNT value on done: 829865.0 [2024-08-06 07:11:26,216][52667] Sum rewards: 73.384, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.688', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.196', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:26,218][52664] DAMAGECOUNT value on done: 867267.0 [2024-08-06 07:11:26,220][52664] Sum rewards: 78.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.456', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.113', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'weapon2': '0.520', 'WEAPON3': '1.000', 'weapon3': '3.050', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '63.000'} [2024-08-06 07:11:26,977][52660] DAMAGECOUNT value on done: 821615.0 [2024-08-06 07:11:26,979][52660] Sum rewards: 76.509, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:27,151][52647] DAMAGECOUNT value on done: 878395.0 [2024-08-06 07:11:27,152][52647] Sum rewards: 76.483, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.405', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon2': '0.180', 'AMMO3': '0.320', 'WEAPON3': '1.950', 'weapon3': '3.606', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 610959360. Throughput: 0: 4375.1. Samples: 152747690. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:11:27,794][52567] Avg episode reward: [(0, '75.260')] [2024-08-06 07:11:28,258][52650] Updated weights for policy 0, policy_version 74581 (0.0022) [2024-08-06 07:11:28,695][52664] DAMAGECOUNT value on done: 878344.0 [2024-08-06 07:11:28,695][52664] Sum rewards: 76.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.441', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.116', 'AMMO4': '0.149', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:29,183][52659] DAMAGECOUNT value on done: 831917.0 [2024-08-06 07:11:29,186][52659] Sum rewards: 65.047, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.224', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '57.000'} [2024-08-06 07:11:29,317][52667] DAMAGECOUNT value on done: 833405.0 [2024-08-06 07:11:29,317][52667] Sum rewards: 74.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.098', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '60.000'} [2024-08-06 07:11:29,711][52660] DAMAGECOUNT value on done: 826974.0 [2024-08-06 07:11:29,712][52660] Sum rewards: 82.481, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.110', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.266', 'WEAPON3': '1.050', 'weapon3': '3.490', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:29,959][52647] DAMAGECOUNT value on done: 878723.0 [2024-08-06 07:11:29,960][52647] Sum rewards: 76.743, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO5': '0.018', 'AMMO2': '0.060', 'AMMO3': '0.179', 'weapon5': '0.242', 'weapon4': '0.252', 'AMMO4': '0.298', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '61.000'} [2024-08-06 07:11:31,932][52664] DAMAGECOUNT value on done: 875138.0 [2024-08-06 07:11:31,932][52664] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.500', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.174', 'weapon4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:32,109][52659] DAMAGECOUNT value on done: 831032.0 [2024-08-06 07:11:32,109][52659] Sum rewards: 72.275, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.360', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.074', 'weapon4': '0.124', 'AMMO4': '0.229', 'AMMO3': '0.281', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.278', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:32,202][52667] DAMAGECOUNT value on done: 842085.0 [2024-08-06 07:11:32,202][52667] Sum rewards: 77.223, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.084', 'weapon4': '0.084', 'AMMO3': '0.175', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:32,305][52660] DAMAGECOUNT value on done: 838955.0 [2024-08-06 07:11:32,305][52660] Sum rewards: 67.640, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.652', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.179', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON4': '0.450', 'weapon4': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '56.000'} [2024-08-06 07:11:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17478.4, 300 sec: 17467.0). Total num frames: 611041280. Throughput: 0: 4374.0. Samples: 152760830. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:11:32,794][52567] Avg episode reward: [(0, '75.227')] [2024-08-06 07:11:32,963][52650] Updated weights for policy 0, policy_version 74591 (0.0010) [2024-08-06 07:11:33,252][52647] DAMAGECOUNT value on done: 865439.0 [2024-08-06 07:11:33,253][52647] Sum rewards: 66.150, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.645', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.098', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.293', 'weapon2': '0.584', 'WEAPON3': '1.700', 'weapon3': '2.904', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '57.000'} [2024-08-06 07:11:34,748][52667] DAMAGECOUNT value on done: 830407.0 [2024-08-06 07:11:34,750][52667] Sum rewards: 69.931, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.173', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.134', 'weapon5': '0.150', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.140', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '59.000'} [2024-08-06 07:11:34,904][52664] DAMAGECOUNT value on done: 872360.0 [2024-08-06 07:11:34,904][52664] Sum rewards: 88.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.095', 'AMMO5': '0.009', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.162', 'weapon4': '0.202', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.801', 'FRAGCOUNT': '71.000'} [2024-08-06 07:11:34,960][52659] DAMAGECOUNT value on done: 830306.0 [2024-08-06 07:11:34,963][52659] Sum rewards: 60.708, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.130', 'weapon4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'weapon2': '0.392', 'WEAPON3': '1.700', 'weapon3': '3.028', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '53.000'} [2024-08-06 07:11:35,498][52660] DAMAGECOUNT value on done: 847760.0 [2024-08-06 07:11:35,498][52660] Sum rewards: 79.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.052', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.310', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:35,610][52647] DAMAGECOUNT value on done: 870497.0 [2024-08-06 07:11:35,610][52647] Sum rewards: 68.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.320', 'AMMO5': '0.025', 'AMMO2': '0.081', 'AMMO3': '0.201', 'weapon5': '0.278', 'weapon2': '0.356', 'AMMO4': '0.404', 'weapon4': '0.492', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.540', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '57.500'} [2024-08-06 07:11:37,367][52664] DAMAGECOUNT value on done: 858576.0 [2024-08-06 07:11:37,375][52664] Sum rewards: 96.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON5': '0.150', 'weapon2': '0.206', 'weapon4': '0.236', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '22.125', 'FRAGCOUNT': '79.000'} [2024-08-06 07:11:37,663][52650] Updated weights for policy 0, policy_version 74601 (0.0012) [2024-08-06 07:11:37,668][52667] DAMAGECOUNT value on done: 837567.0 [2024-08-06 07:11:37,672][52667] Sum rewards: 76.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.181', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '63.000'} [2024-08-06 07:11:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 611131392. Throughput: 0: 4368.5. Samples: 152787040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:11:37,794][52567] Avg episode reward: [(0, '75.099')] [2024-08-06 07:11:37,953][52811] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:11:38,014][52659] DAMAGECOUNT value on done: 833423.0 [2024-08-06 07:11:38,016][52659] Sum rewards: 74.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.862', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.066', 'AMMO4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.276', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.148', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:38,387][52647] DAMAGECOUNT value on done: 862825.0 [2024-08-06 07:11:38,387][52647] Sum rewards: 70.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.397', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon4': '0.474', 'weapon2': '0.658', 'WEAPON3': '1.100', 'weapon3': '2.604', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 07:11:38,630][52660] DAMAGECOUNT value on done: 825692.0 [2024-08-06 07:11:38,631][52660] Sum rewards: 62.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.880', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.107', 'weapon5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.291', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.800', 'weapon3': '3.030', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '55.000'} [2024-08-06 07:11:40,401][52664] DAMAGECOUNT value on done: 863331.0 [2024-08-06 07:11:40,402][52664] Sum rewards: 79.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.074', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.085', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:40,681][52659] DAMAGECOUNT value on done: 833014.0 [2024-08-06 07:11:40,682][52659] Sum rewards: 81.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.222', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.380', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:40,792][52667] DAMAGECOUNT value on done: 842368.0 [2024-08-06 07:11:40,792][52667] Sum rewards: 77.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.206', 'AMMO3': '0.212', 'AMMO4': '0.220', 'weapon4': '0.254', 'weapon2': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '62.500'} [2024-08-06 07:11:41,128][52649] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 07:11:41,132][52811] DAMAGECOUNT value on done: 791482.0 [2024-08-06 07:11:41,132][52811] Sum rewards: 75.463, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.005', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.134', 'AMMO3': '0.151', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 07:11:41,283][52647] DAMAGECOUNT value on done: 868317.0 [2024-08-06 07:11:41,283][52647] Sum rewards: 85.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.193', 'weapon4': '0.196', 'AMMO4': '0.270', 'weapon5': '0.280', 'weapon2': '0.304', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '69.000'} [2024-08-06 07:11:41,601][52660] DAMAGECOUNT value on done: 833044.0 [2024-08-06 07:11:41,601][52660] Sum rewards: 72.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.105', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.118', 'AMMO4': '0.122', 'AMMO3': '0.170', 'weapon4': '0.172', 'weapon2': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.346', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 07:11:42,234][52650] Updated weights for policy 0, policy_version 74611 (0.0011) [2024-08-06 07:11:42,609][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:11:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 611213312. Throughput: 0: 4365.8. Samples: 152813310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:11:42,794][52567] Avg episode reward: [(0, '75.399')] [2024-08-06 07:11:43,395][52659] DAMAGECOUNT value on done: 833696.0 [2024-08-06 07:11:43,397][52659] Sum rewards: 72.100, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.810', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.069', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '59.000'} [2024-08-06 07:11:43,484][52667] DAMAGECOUNT value on done: 843589.0 [2024-08-06 07:11:43,485][52667] Sum rewards: 86.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.851', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon5': '0.196', 'weapon2': '0.276', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.666', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:43,516][52664] DAMAGECOUNT value on done: 865809.0 [2024-08-06 07:11:43,517][52664] Sum rewards: 77.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.185', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.084', 'weapon4': '0.094', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.202', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '65.000'} [2024-08-06 07:11:44,181][52811] DAMAGECOUNT value on done: 775089.0 [2024-08-06 07:11:44,182][52811] Sum rewards: 85.424, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO5': '0.012', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.074', 'AMMO3': '0.129', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'weapon2': '0.874', 'weapon3': '2.888', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '67.000'} [2024-08-06 07:11:44,710][52660] DAMAGECOUNT value on done: 829766.0 [2024-08-06 07:11:44,710][52660] Sum rewards: 73.340, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.634', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.128', 'AMMO4': '0.166', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '60.000'} [2024-08-06 07:11:46,261][52664] DAMAGECOUNT value on done: 858504.0 [2024-08-06 07:11:46,262][52664] Sum rewards: 65.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.067', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.114', 'weapon5': '0.140', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.202', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '56.000'} [2024-08-06 07:11:46,325][52667] DAMAGECOUNT value on done: 839445.0 [2024-08-06 07:11:46,325][52667] Sum rewards: 61.805, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.980', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.130', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.214', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '55.000'} [2024-08-06 07:11:46,514][52659] DAMAGECOUNT value on done: 840648.0 [2024-08-06 07:11:46,514][52659] Sum rewards: 76.773, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.015', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.027', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.271', 'weapon2': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.448', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '67.000'} [2024-08-06 07:11:46,891][52650] Updated weights for policy 0, policy_version 74621 (0.0019) [2024-08-06 07:11:47,205][52811] DAMAGECOUNT value on done: 770546.0 [2024-08-06 07:11:47,207][52811] Sum rewards: 73.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.210', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.090', 'weapon4': '0.184', 'AMMO4': '0.191', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '61.000'} [2024-08-06 07:11:47,740][52660] DAMAGECOUNT value on done: 822322.0 [2024-08-06 07:11:47,740][52660] Sum rewards: 75.823, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.124', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.320', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 611311616. Throughput: 0: 4368.2. Samples: 152826430. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:11:47,795][52567] Avg episode reward: [(0, '75.613')] [2024-08-06 07:11:49,072][52667] DAMAGECOUNT value on done: 837321.0 [2024-08-06 07:11:49,075][52667] Sum rewards: 67.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.119', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.152', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '56.000'} [2024-08-06 07:11:49,593][52659] DAMAGECOUNT value on done: 826742.0 [2024-08-06 07:11:49,595][52659] Sum rewards: 74.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.672', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.124', 'weapon4': '0.286', 'AMMO3': '0.296', 'weapon2': '0.310', 'WEAPON3': '1.650', 'weapon3': '3.014', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:50,351][52811] DAMAGECOUNT value on done: 772024.0 [2024-08-06 07:11:50,354][52811] Sum rewards: 65.286, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.780', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.138', 'AMMO4': '0.222', 'weapon2': '0.264', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.232', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '59.000'} [2024-08-06 07:11:50,683][52660] DAMAGECOUNT value on done: 821576.0 [2024-08-06 07:11:50,684][52660] Sum rewards: 72.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.579', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.064', 'AMMO4': '0.180', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon5': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '61.000'} [2024-08-06 07:11:51,858][52650] Updated weights for policy 0, policy_version 74631 (0.0028) [2024-08-06 07:11:52,084][52659] DAMAGECOUNT value on done: 835566.0 [2024-08-06 07:11:52,085][52659] Sum rewards: 74.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.104', 'AMMO4': '0.149', 'weapon5': '0.192', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '62.000'} [2024-08-06 07:11:52,284][52667] DAMAGECOUNT value on done: 843496.0 [2024-08-06 07:11:52,285][52667] Sum rewards: 68.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.044', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.128', 'weapon4': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.110', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '60.000'} [2024-08-06 07:11:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 611393536. Throughput: 0: 4372.4. Samples: 152852750. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:11:52,794][52567] Avg episode reward: [(0, '75.253')] [2024-08-06 07:11:53,507][52811] DAMAGECOUNT value on done: 777223.0 [2024-08-06 07:11:53,509][52811] Sum rewards: 83.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.186', 'AMMO4': '0.199', 'AMMO3': '0.238', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.152', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '68.000'} [2024-08-06 07:11:54,899][52659] DAMAGECOUNT value on done: 831830.0 [2024-08-06 07:11:54,899][52659] Sum rewards: 80.909, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.068', 'weapon4': '0.084', 'AMMO4': '0.126', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.262', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:56,129][52650] Updated weights for policy 0, policy_version 74641 (0.0017) [2024-08-06 07:11:56,648][52811] DAMAGECOUNT value on done: 789008.0 [2024-08-06 07:11:56,648][52811] Sum rewards: 69.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.230', 'weapon2': '0.494', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.260', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.000'} [2024-08-06 07:11:56,999][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:11:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 611475456. Throughput: 0: 4369.8. Samples: 152878960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:11:57,794][52567] Avg episode reward: [(0, '75.236')] [2024-08-06 07:11:58,168][52659] DAMAGECOUNT value on done: 833016.0 [2024-08-06 07:11:58,170][52659] Sum rewards: 76.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.110', 'weapon4': '0.188', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '64.000'} [2024-08-06 07:11:59,811][52811] DAMAGECOUNT value on done: 782348.0 [2024-08-06 07:11:59,811][52811] Sum rewards: 71.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.595', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.144', 'AMMO3': '0.185', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:01,035][52794] DAMAGECOUNT value on done: 827672.0 [2024-08-06 07:12:01,036][52794] Sum rewards: 82.558, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.398', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.235', 'weapon2': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.606', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '70.000'} [2024-08-06 07:12:01,086][52650] Updated weights for policy 0, policy_version 74651 (0.0026) [2024-08-06 07:12:01,271][52659] DAMAGECOUNT value on done: 834415.0 [2024-08-06 07:12:01,272][52659] Sum rewards: 84.194, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.098', 'weapon4': '0.120', 'AMMO4': '0.153', 'AMMO3': '0.170', 'HEALTH': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.000', 'weapon3': '3.208', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:02,190][52658] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:12:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 611565568. Throughput: 0: 4365.8. Samples: 152891930. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:12:02,795][52567] Avg episode reward: [(0, '75.539')] [2024-08-06 07:12:02,913][52811] DAMAGECOUNT value on done: 773170.0 [2024-08-06 07:12:02,914][52811] Sum rewards: 73.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.094', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:04,068][52794] DAMAGECOUNT value on done: 836171.0 [2024-08-06 07:12:04,069][52794] Sum rewards: 72.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.965', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.172', 'AMMO4': '0.176', 'weapon2': '0.230', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:04,415][52659] DAMAGECOUNT value on done: 833461.0 [2024-08-06 07:12:04,419][52659] Sum rewards: 78.308, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.074', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.086', 'AMMO3': '0.185', 'weapon5': '0.206', 'AMMO4': '0.262', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:04,438][52658] DAMAGECOUNT value on done: 833926.0 [2024-08-06 07:12:04,439][52658] Sum rewards: 77.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.044', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon4': '0.048', 'AMMO4': '0.138', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:05,386][52650] Updated weights for policy 0, policy_version 74661 (0.0012) [2024-08-06 07:12:05,912][52811] DAMAGECOUNT value on done: 782560.0 [2024-08-06 07:12:05,913][52811] Sum rewards: 74.230, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '3.044', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:06,971][52659] DAMAGECOUNT value on done: 843142.0 [2024-08-06 07:12:06,973][52659] Sum rewards: 81.075, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.592', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.068', 'AMMO4': '0.135', 'weapon5': '0.176', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.144', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '69.000'} [2024-08-06 07:12:07,154][52794] DAMAGECOUNT value on done: 842662.0 [2024-08-06 07:12:07,158][52794] Sum rewards: 81.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon2': '0.168', 'weapon5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.234', 'AMMO4': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '67.000'} [2024-08-06 07:12:07,267][52649] DAMAGECOUNT value on done: 808196.0 [2024-08-06 07:12:07,268][52649] Sum rewards: 60.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.568', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '2.820', 'weapon3': '3.516', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '53.000'} [2024-08-06 07:12:07,411][52658] DAMAGECOUNT value on done: 836864.0 [2024-08-06 07:12:07,411][52658] Sum rewards: 71.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.190', 'AMMO5': '0.022', 'AMMO2': '0.050', 'weapon5': '0.090', 'AMMO3': '0.219', 'weapon4': '0.228', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '60.500'} [2024-08-06 07:12:07,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 611663872. Throughput: 0: 4374.2. Samples: 152918250. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:12:07,795][52567] Avg episode reward: [(0, '75.494')] [2024-08-06 07:12:08,836][52811] DAMAGECOUNT value on done: 780202.0 [2024-08-06 07:12:08,837][52811] Sum rewards: 77.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.635', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon4': '0.126', 'AMMO3': '0.180', 'weapon5': '0.230', 'weapon2': '0.282', 'AMMO4': '0.292', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:09,683][52659] DAMAGECOUNT value on done: 827185.0 [2024-08-06 07:12:09,684][52659] Sum rewards: 66.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.857', 'AMMO5': '0.022', 'AMMO2': '0.037', 'weapon4': '0.084', 'AMMO4': '0.185', 'AMMO3': '0.190', 'weapon2': '0.250', 'weapon5': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '55.000'} [2024-08-06 07:12:10,207][52650] Updated weights for policy 0, policy_version 74671 (0.0012) [2024-08-06 07:12:10,264][52794] DAMAGECOUNT value on done: 828725.0 [2024-08-06 07:12:10,264][52794] Sum rewards: 73.657, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:10,283][52666] Large shaping reward 2.649 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 07:12:10,377][52658] DAMAGECOUNT value on done: 840213.0 [2024-08-06 07:12:10,379][52658] Sum rewards: 76.643, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.968', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.084', 'weapon5': '0.136', 'AMMO3': '0.163', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:10,439][52649] DAMAGECOUNT value on done: 801918.0 [2024-08-06 07:12:10,440][52649] Sum rewards: 76.033, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.098', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.162', 'weapon5': '0.178', 'AMMO4': '0.206', 'weapon2': '0.226', 'WEAPON5': '0.500', 'weapon4': '0.596', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.752', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:11,925][52811] DAMAGECOUNT value on done: 783131.0 [2024-08-06 07:12:11,927][52811] Sum rewards: 61.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.675', 'AMMO2': '0.004', 'AMMO5': '0.006', 'weapon4': '0.012', 'AMMO4': '0.018', 'WEAPON4': '0.100', 'weapon5': '0.122', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.948', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '50.000'} [2024-08-06 07:12:12,763][52659] DAMAGECOUNT value on done: 837695.0 [2024-08-06 07:12:12,764][52659] Sum rewards: 78.382, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.239', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.056', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 611745792. Throughput: 0: 4376.2. Samples: 152944620. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 07:12:12,794][52567] Avg episode reward: [(0, '74.953')] [2024-08-06 07:12:12,862][52658] DAMAGECOUNT value on done: 835252.0 [2024-08-06 07:12:12,862][52658] Sum rewards: 74.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.864', 'AMMO2': '0.007', 'AMMO5': '0.015', 'AMMO4': '0.034', 'weapon4': '0.040', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'weapon5': '0.306', 'WEAPON5': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:13,017][52649] DAMAGECOUNT value on done: 818648.0 [2024-08-06 07:12:13,017][52649] Sum rewards: 74.539, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.162', 'weapon4': '0.236', 'AMMO3': '0.238', 'AMMO4': '0.255', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:13,240][52794] DAMAGECOUNT value on done: 825351.0 [2024-08-06 07:12:13,243][52794] Sum rewards: 70.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.675', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.078', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:15,084][52650] Updated weights for policy 0, policy_version 74681 (0.0012) [2024-08-06 07:12:15,115][52811] DAMAGECOUNT value on done: 789651.0 [2024-08-06 07:12:15,115][52811] Sum rewards: 72.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.685', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.064', 'weapon4': '0.110', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'weapon2': '0.340', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:15,531][52659] DAMAGECOUNT value on done: 831472.0 [2024-08-06 07:12:15,532][52659] Sum rewards: 75.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.675', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.108', 'AMMO3': '0.220', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:15,692][52658] DAMAGECOUNT value on done: 832019.0 [2024-08-06 07:12:15,693][52658] Sum rewards: 74.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.065', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.122', 'AMMO4': '0.213', 'AMMO3': '0.223', 'weapon5': '0.230', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:15,729][52649] DAMAGECOUNT value on done: 813726.0 [2024-08-06 07:12:15,729][52649] Sum rewards: 81.426, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.066', 'HEALTH': '0.130', 'AMMO4': '0.132', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.272', 'WEAPON3': '0.900', 'weapon3': '3.458', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:16,326][52794] DAMAGECOUNT value on done: 832472.0 [2024-08-06 07:12:16,326][52794] Sum rewards: 71.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.111', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.110', 'weapon5': '0.110', 'AMMO4': '0.122', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:17,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 611827712. Throughput: 0: 4378.9. Samples: 152957880. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:17,795][52567] Avg episode reward: [(0, '74.746')] [2024-08-06 07:12:18,222][52658] DAMAGECOUNT value on done: 825470.0 [2024-08-06 07:12:18,226][52658] Sum rewards: 70.281, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon4': '0.120', 'weapon2': '0.228', 'weapon5': '0.244', 'AMMO3': '0.251', 'AMMO4': '0.344', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '3.112', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:18,306][52811] DAMAGECOUNT value on done: 780270.0 [2024-08-06 07:12:18,306][52811] Sum rewards: 78.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.258', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.160', 'AMMO4': '0.180', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.650', 'weapon3': '3.096', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:18,509][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:12:19,004][52794] DAMAGECOUNT value on done: 837495.0 [2024-08-06 07:12:19,005][52794] Sum rewards: 77.267, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.274', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.722', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:19,018][52649] DAMAGECOUNT value on done: 805117.0 [2024-08-06 07:12:19,018][52649] Sum rewards: 67.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.026', 'AMMO2': '0.071', 'weapon4': '0.140', 'AMMO3': '0.240', 'weapon5': '0.344', 'AMMO4': '0.354', 'weapon2': '0.536', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.656', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '55.500'} [2024-08-06 07:12:19,341][52650] Updated weights for policy 0, policy_version 74691 (0.0022) [2024-08-06 07:12:21,302][52811] DAMAGECOUNT value on done: 780099.0 [2024-08-06 07:12:21,304][52811] Sum rewards: 88.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.515', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.097', 'weapon5': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.522', 'FRAGCOUNT': '73.000'} [2024-08-06 07:12:21,336][52658] DAMAGECOUNT value on done: 839216.0 [2024-08-06 07:12:21,339][52658] Sum rewards: 88.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '72.000'} [2024-08-06 07:12:21,491][52649] DAMAGECOUNT value on done: 816863.0 [2024-08-06 07:12:21,491][52649] Sum rewards: 83.048, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.395', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.170', 'AMMO4': '0.190', 'AMMO3': '0.241', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.072', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '72.500'} [2024-08-06 07:12:21,691][52794] DAMAGECOUNT value on done: 823942.0 [2024-08-06 07:12:21,691][52794] Sum rewards: 62.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.808', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO3': '0.221', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '52.000'} [2024-08-06 07:12:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 611917824. Throughput: 0: 4376.2. Samples: 152983970. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:22,794][52567] Avg episode reward: [(0, '75.023')] [2024-08-06 07:12:24,190][52794] DAMAGECOUNT value on done: 834191.0 [2024-08-06 07:12:24,191][52794] Sum rewards: 68.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.130', 'AMMO4': '0.147', 'weapon2': '0.186', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.426', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '54.000'} [2024-08-06 07:12:24,222][52668] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:12:24,371][52650] Updated weights for policy 0, policy_version 74701 (0.0028) [2024-08-06 07:12:24,483][52811] DAMAGECOUNT value on done: 776554.0 [2024-08-06 07:12:24,484][52811] Sum rewards: 69.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.292', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.126', 'weapon5': '0.136', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:24,588][52649] DAMAGECOUNT value on done: 813677.0 [2024-08-06 07:12:24,588][52649] Sum rewards: 77.365, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.617', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.280', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:24,590][52658] DAMAGECOUNT value on done: 824481.0 [2024-08-06 07:12:24,590][52658] Sum rewards: 57.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.268', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.148', 'weapon5': '0.196', 'AMMO3': '0.237', 'AMMO4': '0.241', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.158', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '50.000'} [2024-08-06 07:12:25,244][52669] DAMAGECOUNT value on done: 834823.0 [2024-08-06 07:12:25,245][52669] Sum rewards: 77.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.308', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.234', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:26,764][52794] DAMAGECOUNT value on done: 830467.0 [2024-08-06 07:12:26,765][52794] Sum rewards: 75.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.150', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.022', 'weapon5': '0.038', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.462', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:26,814][52663] DAMAGECOUNT value on done: 848760.0 [2024-08-06 07:12:26,815][52663] Sum rewards: 65.154, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.295', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.038', 'AMMO3': '0.147', 'AMMO4': '0.189', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.336', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '2.878', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '51.500'} [2024-08-06 07:12:27,560][52811] DAMAGECOUNT value on done: 781104.0 [2024-08-06 07:12:27,561][52811] Sum rewards: 79.118, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.964', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.140', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '67.000'} [2024-08-06 07:12:27,627][52658] DAMAGECOUNT value on done: 854495.0 [2024-08-06 07:12:27,627][52658] Sum rewards: 79.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.238', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.098', 'weapon4': '0.126', 'AMMO3': '0.188', 'AMMO4': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.818', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '67.000'} [2024-08-06 07:12:27,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 612007936. Throughput: 0: 4372.2. Samples: 153010060. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:27,794][52567] Avg episode reward: [(0, '74.750')] [2024-08-06 07:12:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074708_612007936.pth... [2024-08-06 07:12:27,934][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074196_607813632.pth [2024-08-06 07:12:27,939][52669] DAMAGECOUNT value on done: 827696.0 [2024-08-06 07:12:27,939][52669] Sum rewards: 83.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.491', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.092', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:28,079][52649] DAMAGECOUNT value on done: 816870.0 [2024-08-06 07:12:28,079][52649] Sum rewards: 78.303, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.204', 'weapon2': '0.264', 'HEALTH': '0.396', 'WEAPON3': '1.100', 'weapon3': '3.294', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:28,918][52803] DAMAGECOUNT value on done: 776420.0 [2024-08-06 07:12:28,919][52803] Sum rewards: 88.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.160', 'weapon5': '0.188', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.456', 'FRAGCOUNT': '72.000'} [2024-08-06 07:12:28,955][52665] DAMAGECOUNT value on done: 821283.0 [2024-08-06 07:12:28,955][52665] Sum rewards: 66.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.147', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon4': '0.092', 'weapon5': '0.210', 'AMMO3': '0.289', 'AMMO4': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.700', 'weapon3': '2.984', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:29,139][52663] DAMAGECOUNT value on done: 835067.0 [2024-08-06 07:12:29,139][52663] Sum rewards: 78.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.614', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.026', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.300', 'weapon4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:29,235][52650] Updated weights for policy 0, policy_version 74711 (0.0029) [2024-08-06 07:12:29,466][52794] DAMAGECOUNT value on done: 824213.0 [2024-08-06 07:12:29,466][52794] Sum rewards: 86.260, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.325', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.194', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.402', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '70.000'} [2024-08-06 07:12:30,528][52669] DAMAGECOUNT value on done: 841694.0 [2024-08-06 07:12:30,529][52669] Sum rewards: 81.819, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.446', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.234', 'weapon2': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.518', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.943', 'FRAGCOUNT': '67.000'} [2024-08-06 07:12:30,656][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:12:30,830][52811] DAMAGECOUNT value on done: 783549.0 [2024-08-06 07:12:30,833][52811] Sum rewards: 73.992, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.092', 'AMMO4': '0.173', 'AMMO3': '0.193', 'weapon5': '0.268', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'HEALTH': '0.358', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '3.046', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:30,930][52658] DAMAGECOUNT value on done: 837448.0 [2024-08-06 07:12:30,930][52658] Sum rewards: 73.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.286', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.366', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:31,059][52649] DAMAGECOUNT value on done: 815075.0 [2024-08-06 07:12:31,059][52649] Sum rewards: 70.126, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'HEALTH': '0.026', 'AMMO2': '0.033', 'weapon4': '0.076', 'AMMO4': '0.165', 'weapon5': '0.170', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.000', 'HITCOUNT': '2.990', 'weapon3': '3.010', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:31,688][52665] DAMAGECOUNT value on done: 837608.0 [2024-08-06 07:12:31,689][52665] Sum rewards: 84.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.620', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.103', 'weapon4': '0.134', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.358', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '68.000'} [2024-08-06 07:12:31,823][52663] DAMAGECOUNT value on done: 829565.0 [2024-08-06 07:12:31,824][52663] Sum rewards: 69.351, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.156', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.302', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '55.000'} [2024-08-06 07:12:32,192][52803] DAMAGECOUNT value on done: 774747.0 [2024-08-06 07:12:32,194][52803] Sum rewards: 75.193, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.220', 'AMMO3': '0.223', 'weapon5': '0.246', 'weapon2': '0.268', 'AMMO4': '0.304', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:32,211][52794] DAMAGECOUNT value on done: 835056.0 [2024-08-06 07:12:32,211][52794] Sum rewards: 81.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.120', 'AMMO3': '0.205', 'AMMO4': '0.212', 'weapon2': '0.224', 'weapon5': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 612098048. Throughput: 0: 4366.7. Samples: 153022930. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:32,795][52567] Avg episode reward: [(0, '75.131')] [2024-08-06 07:12:33,180][52669] DAMAGECOUNT value on done: 833873.0 [2024-08-06 07:12:33,181][52669] Sum rewards: 69.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.892', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.044', 'weapon5': '0.052', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.422', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.260', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:33,784][52658] DAMAGECOUNT value on done: 847076.0 [2024-08-06 07:12:33,784][52658] Sum rewards: 67.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.552', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.054', 'weapon5': '0.132', 'weapon2': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'HITCOUNT': '3.210', 'weapon3': '3.410', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:33,999][52650] Updated weights for policy 0, policy_version 74721 (0.0014) [2024-08-06 07:12:34,010][52811] DAMAGECOUNT value on done: 790087.0 [2024-08-06 07:12:34,012][52811] Sum rewards: 86.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.048', 'weapon4': '0.058', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.336', 'FRAGCOUNT': '72.000'} [2024-08-06 07:12:34,131][52649] DAMAGECOUNT value on done: 809344.0 [2024-08-06 07:12:34,133][52649] Sum rewards: 81.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.260', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:34,285][52663] DAMAGECOUNT value on done: 831945.0 [2024-08-06 07:12:34,286][52663] Sum rewards: 69.391, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.490', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.082', 'weapon5': '0.136', 'AMMO4': '0.258', 'AMMO3': '0.280', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.076', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:34,468][52671] DAMAGECOUNT value on done: 839578.0 [2024-08-06 07:12:34,469][52671] Sum rewards: 77.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.134', 'weapon5': '0.174', 'AMMO4': '0.177', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:34,717][52820] DAMAGECOUNT value on done: 769992.0 [2024-08-06 07:12:34,717][52820] Sum rewards: 67.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.535', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.026', 'AMMO4': '0.099', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.296', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.346', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:34,796][52665] DAMAGECOUNT value on done: 826886.0 [2024-08-06 07:12:34,796][52665] Sum rewards: 69.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.096', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:35,339][52803] DAMAGECOUNT value on done: 781566.0 [2024-08-06 07:12:35,339][52803] Sum rewards: 77.530, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.324', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.124', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.328', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:35,428][52794] DAMAGECOUNT value on done: 831663.0 [2024-08-06 07:12:35,428][52794] Sum rewards: 80.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.316', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.095', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '67.000'} [2024-08-06 07:12:35,577][52669] DAMAGECOUNT value on done: 840711.0 [2024-08-06 07:12:35,578][52669] Sum rewards: 86.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON1': '0.020', 'AMMO4': '0.057', 'weapon5': '0.090', 'weapon4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '71.000'} [2024-08-06 07:12:36,896][52663] DAMAGECOUNT value on done: 835549.0 [2024-08-06 07:12:36,901][52663] Sum rewards: 74.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.184', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:36,916][52658] DAMAGECOUNT value on done: 835637.0 [2024-08-06 07:12:36,918][52658] Sum rewards: 74.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.166', 'weapon5': '0.188', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:36,940][52671] DAMAGECOUNT value on done: 844208.0 [2024-08-06 07:12:36,940][52671] Sum rewards: 63.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.565', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.206', 'weapon4': '0.206', 'AMMO4': '0.215', 'weapon5': '0.224', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '53.000'} [2024-08-06 07:12:36,993][52811] DAMAGECOUNT value on done: 776504.0 [2024-08-06 07:12:36,996][52811] Sum rewards: 75.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.717', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:37,266][52649] DAMAGECOUNT value on done: 820062.0 [2024-08-06 07:12:37,267][52649] Sum rewards: 69.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.314', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.257', 'weapon2': '0.490', 'WEAPON3': '1.600', 'weapon3': '3.218', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 612188160. Throughput: 0: 4369.1. Samples: 153049360. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:37,794][52567] Avg episode reward: [(0, '75.177')] [2024-08-06 07:12:37,867][52820] DAMAGECOUNT value on done: 773180.0 [2024-08-06 07:12:37,867][52820] Sum rewards: 82.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.425', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.224', 'weapon4': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:37,874][52665] DAMAGECOUNT value on done: 829205.0 [2024-08-06 07:12:37,874][52665] Sum rewards: 73.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.169', 'AMMO4': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.008', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:38,192][52669] DAMAGECOUNT value on done: 837188.0 [2024-08-06 07:12:38,201][52669] Sum rewards: 88.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.390', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.042', 'weapon5': '0.140', 'AMMO4': '0.195', 'AMMO3': '0.251', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.282', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.201', 'FRAGCOUNT': '74.000'} [2024-08-06 07:12:38,415][52803] DAMAGECOUNT value on done: 779079.0 [2024-08-06 07:12:38,416][52803] Sum rewards: 85.269, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.944', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.108', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.279', 'weapon2': '0.332', 'WEAPON3': '1.650', 'weapon3': '3.258', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '73.000'} [2024-08-06 07:12:38,617][52650] Updated weights for policy 0, policy_version 74731 (0.0010) [2024-08-06 07:12:38,679][52794] DAMAGECOUNT value on done: 847136.0 [2024-08-06 07:12:38,682][52794] Sum rewards: 80.302, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.472', 'AMMO5': '0.005', 'weapon4': '0.022', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:39,688][52663] DAMAGECOUNT value on done: 840005.0 [2024-08-06 07:12:39,689][52663] Sum rewards: 73.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.613', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.106', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.440', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:40,040][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:12:40,074][52811] DAMAGECOUNT value on done: 777729.0 [2024-08-06 07:12:40,075][52811] Sum rewards: 74.018, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.925', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.295', 'weapon2': '0.316', 'WEAPON3': '1.850', 'weapon3': '3.418', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:40,122][52658] DAMAGECOUNT value on done: 844128.0 [2024-08-06 07:12:40,122][52658] Sum rewards: 75.456, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.366', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.196', 'AMMO4': '0.243', 'weapon2': '0.260', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.892', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:40,425][52671] DAMAGECOUNT value on done: 839834.0 [2024-08-06 07:12:40,428][52671] Sum rewards: 78.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.136', 'AMMO3': '0.256', 'weapon2': '0.268', 'AMMO4': '0.294', 'weapon5': '0.332', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.912', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:40,444][52649] DAMAGECOUNT value on done: 828541.0 [2024-08-06 07:12:40,444][52649] Sum rewards: 73.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.686', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.060', 'weapon4': '0.148', 'AMMO3': '0.200', 'weapon5': '0.252', 'weapon2': '0.266', 'AMMO4': '0.299', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:40,967][52665] DAMAGECOUNT value on done: 811229.0 [2024-08-06 07:12:40,967][52665] Sum rewards: 67.772, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.304', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon4': '0.034', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.306', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:40,986][52669] DAMAGECOUNT value on done: 837265.0 [2024-08-06 07:12:40,988][52669] Sum rewards: 77.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.128', 'AMMO3': '0.208', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:41,132][52820] DAMAGECOUNT value on done: 772700.0 [2024-08-06 07:12:41,132][52820] Sum rewards: 72.167, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.086', 'AMMO3': '0.165', 'weapon5': '0.200', 'AMMO4': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.828', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:41,503][52803] DAMAGECOUNT value on done: 778199.0 [2024-08-06 07:12:41,504][52803] Sum rewards: 66.137, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.322', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon4': '0.224', 'weapon2': '0.274', 'AMMO4': '0.329', 'AMMO3': '0.331', 'weapon5': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.850', 'weapon3': '2.706', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '59.500'} [2024-08-06 07:12:41,709][52794] DAMAGECOUNT value on done: 827851.0 [2024-08-06 07:12:41,711][52794] Sum rewards: 78.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.102', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:42,382][52663] DAMAGECOUNT value on done: 829450.0 [2024-08-06 07:12:42,383][52663] Sum rewards: 76.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.124', 'AMMO3': '0.210', 'weapon2': '0.218', 'AMMO4': '0.249', 'weapon5': '0.256', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 612270080. Throughput: 0: 4362.2. Samples: 153075260. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:42,794][52567] Avg episode reward: [(0, '75.202')] [2024-08-06 07:12:42,845][52795] DAMAGECOUNT value on done: 774628.0 [2024-08-06 07:12:42,845][52795] Sum rewards: 76.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'AMMO4': '0.123', 'weapon4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.232', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:43,042][52671] DAMAGECOUNT value on done: 841437.0 [2024-08-06 07:12:43,044][52671] Sum rewards: 87.363, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.152', 'AMMO4': '0.209', 'AMMO3': '0.217', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '71.000'} [2024-08-06 07:12:43,245][52649] DAMAGECOUNT value on done: 819193.0 [2024-08-06 07:12:43,253][52649] Sum rewards: 70.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.740', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.066', 'AMMO3': '0.173', 'AMMO4': '0.175', 'weapon5': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:43,297][52658] DAMAGECOUNT value on done: 832155.0 [2024-08-06 07:12:43,300][52658] Sum rewards: 71.163, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.426', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.064', 'weapon5': '0.162', 'AMMO3': '0.226', 'AMMO4': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:43,377][52650] Updated weights for policy 0, policy_version 74741 (0.0011) [2024-08-06 07:12:43,689][52669] DAMAGECOUNT value on done: 836420.0 [2024-08-06 07:12:43,691][52669] Sum rewards: 74.795, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.106', 'AMMO5': '0.015', 'AMMO2': '0.058', 'AMMO3': '0.252', 'weapon4': '0.254', 'weapon5': '0.276', 'weapon2': '0.278', 'AMMO4': '0.289', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:43,812][52665] DAMAGECOUNT value on done: 817519.0 [2024-08-06 07:12:43,812][52665] Sum rewards: 62.476, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.160', 'AMMO3': '0.238', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '54.000'} [2024-08-06 07:12:44,483][52794] DAMAGECOUNT value on done: 841359.0 [2024-08-06 07:12:44,483][52794] Sum rewards: 71.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.993', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.074', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:44,519][52820] DAMAGECOUNT value on done: 761494.0 [2024-08-06 07:12:44,522][52820] Sum rewards: 66.211, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.072', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.072', 'AMMO4': '0.124', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '0.850', 'HITCOUNT': '2.870', 'weapon3': '3.332', 'DAMAGECOUNT': '15.735', 'FRAGCOUNT': '55.000'} [2024-08-06 07:12:44,702][52803] DAMAGECOUNT value on done: 776902.0 [2024-08-06 07:12:44,707][52803] Sum rewards: 64.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.392', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.130', 'weapon5': '0.160', 'AMMO3': '0.204', 'weapon2': '0.204', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.234', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '53.000'} [2024-08-06 07:12:45,198][52663] DAMAGECOUNT value on done: 821261.0 [2024-08-06 07:12:45,198][52663] Sum rewards: 64.419, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.295', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'HITCOUNT': '3.150', 'weapon3': '3.420', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '56.500'} [2024-08-06 07:12:45,818][52658] DAMAGECOUNT value on done: 839499.0 [2024-08-06 07:12:45,820][52658] Sum rewards: 65.528, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.051', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.110', 'weapon4': '0.118', 'AMMO3': '0.240', 'AMMO4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.638', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '56.000'} [2024-08-06 07:12:46,057][52795] DAMAGECOUNT value on done: 760645.0 [2024-08-06 07:12:46,058][52795] Sum rewards: 70.033, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.116', 'AMMO5': '0.026', 'AMMO2': '0.071', 'weapon4': '0.148', 'AMMO3': '0.237', 'weapon5': '0.310', 'AMMO4': '0.356', 'weapon2': '0.364', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '60.000'} [2024-08-06 07:12:46,080][52671] DAMAGECOUNT value on done: 848345.0 [2024-08-06 07:12:46,082][52671] Sum rewards: 75.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.630', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.068', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'AMMO3': '0.249', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.164', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:46,213][52649] DAMAGECOUNT value on done: 820304.0 [2024-08-06 07:12:46,214][52649] Sum rewards: 66.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.114', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '55.000'} [2024-08-06 07:12:46,471][52669] DAMAGECOUNT value on done: 846977.0 [2024-08-06 07:12:46,471][52669] Sum rewards: 80.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.548', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.102', 'weapon4': '0.130', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '68.000'} [2024-08-06 07:12:46,647][52665] DAMAGECOUNT value on done: 821339.0 [2024-08-06 07:12:46,649][52665] Sum rewards: 67.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.367', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.078', 'AMMO3': '0.218', 'AMMO4': '0.240', 'weapon2': '0.274', 'weapon5': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.090', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '54.500'} [2024-08-06 07:12:47,249][52794] DAMAGECOUNT value on done: 837500.0 [2024-08-06 07:12:47,250][52794] Sum rewards: 76.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.089', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.280', 'weapon4': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:47,649][52820] DAMAGECOUNT value on done: 776013.0 [2024-08-06 07:12:47,649][52820] Sum rewards: 78.609, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.207', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.170', 'weapon5': '0.204', 'weapon4': '0.290', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:47,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 612352000. Throughput: 0: 4368.4. Samples: 153088510. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:47,795][52567] Avg episode reward: [(0, '74.626')] [2024-08-06 07:12:47,853][52650] Updated weights for policy 0, policy_version 74751 (0.0019) [2024-08-06 07:12:47,875][52803] DAMAGECOUNT value on done: 771208.0 [2024-08-06 07:12:47,877][52803] Sum rewards: 86.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.202', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '70.000'} [2024-08-06 07:12:47,972][52663] DAMAGECOUNT value on done: 827766.0 [2024-08-06 07:12:47,973][52663] Sum rewards: 71.084, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.932', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO4': '0.233', 'weapon5': '0.236', 'AMMO3': '0.271', 'weapon2': '0.278', 'weapon4': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.756', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:48,725][52658] DAMAGECOUNT value on done: 822025.0 [2024-08-06 07:12:48,725][52658] Sum rewards: 69.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.118', 'AMMO4': '0.146', 'weapon2': '0.248', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:49,242][52649] DAMAGECOUNT value on done: 808589.0 [2024-08-06 07:12:49,244][52649] Sum rewards: 74.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.935', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.101', 'weapon4': '0.158', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:49,270][52671] DAMAGECOUNT value on done: 836374.0 [2024-08-06 07:12:49,271][52671] Sum rewards: 59.404, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.405', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'weapon5': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon4': '0.230', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '2.548', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '48.000'} [2024-08-06 07:12:49,276][52795] DAMAGECOUNT value on done: 765697.0 [2024-08-06 07:12:49,278][52795] Sum rewards: 71.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.282', 'AMMO5': '0.004', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'AMMO4': '0.163', 'weapon2': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.320', 'weapon3': '3.476', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:49,628][52669] DAMAGECOUNT value on done: 837188.0 [2024-08-06 07:12:49,629][52669] Sum rewards: 75.471, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.625', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.382', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:49,731][52665] DAMAGECOUNT value on done: 823212.0 [2024-08-06 07:12:49,732][52665] Sum rewards: 67.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.123', 'weapon2': '0.136', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.150', 'weapon3': '3.316', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '56.000'} [2024-08-06 07:12:50,412][52794] DAMAGECOUNT value on done: 838941.0 [2024-08-06 07:12:50,414][52794] Sum rewards: 79.169, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.060', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.136', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'weapon5': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.702', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.500'} [2024-08-06 07:12:50,886][52820] DAMAGECOUNT value on done: 761302.0 [2024-08-06 07:12:50,887][52820] Sum rewards: 72.797, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.088', 'weapon5': '0.124', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.164', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:50,952][52666] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:12:50,998][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:12:51,015][52803] DAMAGECOUNT value on done: 770927.0 [2024-08-06 07:12:51,017][52803] Sum rewards: 78.206, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.645', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.104', 'weapon4': '0.146', 'AMMO4': '0.151', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:51,027][52663] DAMAGECOUNT value on done: 832520.0 [2024-08-06 07:12:51,027][52663] Sum rewards: 82.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.490', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.129', 'AMMO3': '0.233', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '67.000'} [2024-08-06 07:12:51,288][52658] DAMAGECOUNT value on done: 840863.0 [2024-08-06 07:12:51,289][52658] Sum rewards: 70.316, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.315', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.134', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.238', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:52,151][52669] DAMAGECOUNT value on done: 844105.0 [2024-08-06 07:12:52,151][52669] Sum rewards: 74.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.440', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.062', 'weapon5': '0.092', 'AMMO4': '0.215', 'AMMO3': '0.220', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:52,270][52649] DAMAGECOUNT value on done: 818718.0 [2024-08-06 07:12:52,272][52649] Sum rewards: 83.899, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.402', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.016', 'weapon5': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.184', 'weapon2': '0.588', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '68.000'} [2024-08-06 07:12:52,370][52671] DAMAGECOUNT value on done: 842491.0 [2024-08-06 07:12:52,370][52671] Sum rewards: 71.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.206', 'weapon5': '0.232', 'AMMO4': '0.281', 'weapon4': '0.292', 'weapon2': '0.342', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:52,410][52795] DAMAGECOUNT value on done: 774475.0 [2024-08-06 07:12:52,411][52795] Sum rewards: 72.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.986', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.104', 'weapon4': '0.180', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.278', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:52,547][52665] DAMAGECOUNT value on done: 832201.0 [2024-08-06 07:12:52,549][52665] Sum rewards: 74.829, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.946', 'AMMO5': '0.018', 'AMMO2': '0.068', 'weapon4': '0.114', 'AMMO3': '0.235', 'weapon5': '0.246', 'weapon2': '0.300', 'AMMO4': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:52,755][52650] Updated weights for policy 0, policy_version 74761 (0.0024) [2024-08-06 07:12:52,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 612442112. Throughput: 0: 4360.9. Samples: 153114490. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:52,795][52567] Avg episode reward: [(0, '74.688')] [2024-08-06 07:12:53,264][52794] DAMAGECOUNT value on done: 844588.0 [2024-08-06 07:12:53,266][52794] Sum rewards: 63.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon4': '0.130', 'weapon5': '0.166', 'AMMO3': '0.198', 'AMMO4': '0.232', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '54.000'} [2024-08-06 07:12:53,606][52663] DAMAGECOUNT value on done: 842762.0 [2024-08-06 07:12:53,607][52663] Sum rewards: 75.676, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.490', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '3.252', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '61.000'} [2024-08-06 07:12:53,886][52820] DAMAGECOUNT value on done: 768002.0 [2024-08-06 07:12:53,887][52820] Sum rewards: 81.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.878', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.128', 'AMMO4': '0.179', 'weapon2': '0.188', 'weapon5': '0.188', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:54,140][52803] DAMAGECOUNT value on done: 776513.0 [2024-08-06 07:12:54,141][52803] Sum rewards: 81.774, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.750', 'AMMO5': '0.013', 'AMMO2': '0.060', 'weapon4': '0.074', 'weapon2': '0.176', 'weapon5': '0.196', 'AMMO4': '0.300', 'AMMO3': '0.303', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.248', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '71.000'} [2024-08-06 07:12:54,246][52658] DAMAGECOUNT value on done: 831466.0 [2024-08-06 07:12:54,247][52658] Sum rewards: 70.762, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.029', 'HEALTH': '0.090', 'weapon4': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.176', 'weapon5': '0.210', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.000', 'HITCOUNT': '3.110', 'weapon3': '3.128', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '56.000'} [2024-08-06 07:12:54,567][52670] DAMAGECOUNT value on done: 821882.0 [2024-08-06 07:12:54,568][52670] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.265', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.294', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:54,930][52671] DAMAGECOUNT value on done: 842042.0 [2024-08-06 07:12:54,930][52671] Sum rewards: 84.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.078', 'AMMO4': '0.207', 'AMMO3': '0.219', 'weapon5': '0.222', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '21.291', 'FRAGCOUNT': '68.000'} [2024-08-06 07:12:54,972][52649] DAMAGECOUNT value on done: 801168.0 [2024-08-06 07:12:54,973][52649] Sum rewards: 72.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.685', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.168', 'AMMO3': '0.200', 'weapon2': '0.238', 'weapon4': '0.240', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '62.000'} [2024-08-06 07:12:55,239][52669] DAMAGECOUNT value on done: 846601.0 [2024-08-06 07:12:55,240][52669] Sum rewards: 67.330, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.864', 'AMMO5': '0.023', 'AMMO2': '0.071', 'weapon4': '0.134', 'AMMO3': '0.214', 'weapon5': '0.246', 'AMMO4': '0.356', 'weapon2': '0.368', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '57.500'} [2024-08-06 07:12:55,391][52665] DAMAGECOUNT value on done: 823027.0 [2024-08-06 07:12:55,393][52665] Sum rewards: 74.479, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.362', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.150', 'AMMO4': '0.171', 'weapon2': '0.214', 'AMMO3': '0.317', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.268', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:55,621][52795] DAMAGECOUNT value on done: 762874.0 [2024-08-06 07:12:55,622][52795] Sum rewards: 72.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon4': '0.098', 'AMMO4': '0.142', 'weapon5': '0.184', 'AMMO3': '0.224', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:56,253][52794] DAMAGECOUNT value on done: 837702.0 [2024-08-06 07:12:56,253][52794] Sum rewards: 68.507, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.126', 'AMMO4': '0.138', 'weapon5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '57.500'} [2024-08-06 07:12:56,882][52820] DAMAGECOUNT value on done: 769022.0 [2024-08-06 07:12:56,883][52820] Sum rewards: 68.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.843', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.380', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.298', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '58.000'} [2024-08-06 07:12:56,934][52663] DAMAGECOUNT value on done: 823677.0 [2024-08-06 07:12:56,934][52663] Sum rewards: 80.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.296', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.151', 'weapon5': '0.214', 'AMMO4': '0.223', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.414', 'WEAPON3': '1.000', 'weapon3': '2.750', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '63.000'} [2024-08-06 07:12:57,140][52803] DAMAGECOUNT value on done: 774353.0 [2024-08-06 07:12:57,140][52803] Sum rewards: 79.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.838', 'AMMO5': '0.011', 'weapon4': '0.050', 'AMMO2': '0.054', 'weapon5': '0.174', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:57,172][52658] DAMAGECOUNT value on done: 829322.0 [2024-08-06 07:12:57,173][52658] Sum rewards: 82.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.005', 'AMMO2': '0.047', 'weapon5': '0.048', 'WEAPON5': '0.150', 'weapon4': '0.212', 'AMMO4': '0.234', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '70.000'} [2024-08-06 07:12:57,232][52670] DAMAGECOUNT value on done: 835338.0 [2024-08-06 07:12:57,233][52670] Sum rewards: 64.871, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.670', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.161', 'weapon2': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.154', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '57.000'} [2024-08-06 07:12:57,432][52650] Updated weights for policy 0, policy_version 74771 (0.0024) [2024-08-06 07:12:57,578][52671] DAMAGECOUNT value on done: 826763.0 [2024-08-06 07:12:57,579][52671] Sum rewards: 62.265, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon4': '0.198', 'weapon5': '0.246', 'weapon2': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.036', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '54.000'} [2024-08-06 07:12:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 612524032. Throughput: 0: 4358.7. Samples: 153140760. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 07:12:57,795][52567] Avg episode reward: [(0, '74.575')] [2024-08-06 07:12:58,203][52669] DAMAGECOUNT value on done: 832118.0 [2024-08-06 07:12:58,203][52669] Sum rewards: 78.457, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.104', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.102', 'AMMO4': '0.115', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.202', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '64.000'} [2024-08-06 07:12:58,343][52649] DAMAGECOUNT value on done: 822428.0 [2024-08-06 07:12:58,343][52649] Sum rewards: 80.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.835', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.170', 'AMMO4': '0.193', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '66.000'} [2024-08-06 07:12:58,682][52795] DAMAGECOUNT value on done: 769835.0 [2024-08-06 07:12:58,683][52795] Sum rewards: 78.853, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.180', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.144', 'weapon5': '0.148', 'AMMO4': '0.231', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '69.000'} [2024-08-06 07:12:58,717][52665] DAMAGECOUNT value on done: 835734.0 [2024-08-06 07:12:58,719][52665] Sum rewards: 80.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.670', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.036', 'WEAPON4': '0.100', 'weapon5': '0.114', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'weapon2': '0.340', 'WEAPON3': '1.750', 'weapon3': '3.284', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '68.000'} [2024-08-06 07:12:59,465][52666] DAMAGECOUNT value on done: 835781.0 [2024-08-06 07:12:59,465][52666] Sum rewards: 79.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.046', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.042', 'weapon4': '0.088', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.398', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '65.000'} [2024-08-06 07:12:59,792][52820] DAMAGECOUNT value on done: 775100.0 [2024-08-06 07:12:59,793][52820] Sum rewards: 71.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.125', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.178', 'AMMO4': '0.191', 'AMMO3': '0.211', 'weapon4': '0.248', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '59.000'} [2024-08-06 07:12:59,882][52663] DAMAGECOUNT value on done: 819235.0 [2024-08-06 07:12:59,883][52663] Sum rewards: 55.883, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.000', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.170', 'AMMO3': '0.174', 'weapon2': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.574', 'WEAPON3': '1.050', 'weapon3': '2.670', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '14.703', 'FRAGCOUNT': '44.000'} [2024-08-06 07:13:00,048][52658] DAMAGECOUNT value on done: 837237.0 [2024-08-06 07:13:00,048][52658] Sum rewards: 73.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 07:13:00,073][52670] DAMAGECOUNT value on done: 822150.0 [2024-08-06 07:13:00,074][52670] Sum rewards: 71.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.582', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.332', 'weapon4': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:00,206][52803] DAMAGECOUNT value on done: 787761.0 [2024-08-06 07:13:00,207][52803] Sum rewards: 85.136, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.026', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.216', 'AMMO3': '0.222', 'HEALTH': '0.482', 'WEAPON3': '1.200', 'weapon3': '3.526', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '70.000'} [2024-08-06 07:13:00,608][52671] DAMAGECOUNT value on done: 841831.0 [2024-08-06 07:13:00,609][52671] Sum rewards: 75.868, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.041', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.132', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:01,093][52649] DAMAGECOUNT value on done: 820518.0 [2024-08-06 07:13:01,094][52649] Sum rewards: 65.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.228', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.156', 'AMMO4': '0.158', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '55.500'} [2024-08-06 07:13:01,322][52669] DAMAGECOUNT value on done: 832423.0 [2024-08-06 07:13:01,324][52669] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.236', 'weapon4': '0.248', 'WEAPON3': '1.100', 'weapon3': '3.350', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:01,415][52665] DAMAGECOUNT value on done: 828708.0 [2024-08-06 07:13:01,415][52665] Sum rewards: 74.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.136', 'AMMO3': '0.175', 'weapon5': '0.196', 'AMMO4': '0.197', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:01,830][52650] Updated weights for policy 0, policy_version 74781 (0.0012) [2024-08-06 07:13:01,943][52795] DAMAGECOUNT value on done: 777243.0 [2024-08-06 07:13:01,943][52795] Sum rewards: 64.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.318', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.143', 'weapon5': '0.164', 'AMMO3': '0.219', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.262', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '55.000'} [2024-08-06 07:13:02,503][52666] DAMAGECOUNT value on done: 828627.0 [2024-08-06 07:13:02,503][52666] Sum rewards: 81.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.116', 'weapon5': '0.180', 'AMMO3': '0.210', 'AMMO4': '0.216', 'weapon2': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 612614144. Throughput: 0: 4353.6. Samples: 153153790. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:02,794][52567] Avg episode reward: [(0, '74.209')] [2024-08-06 07:13:02,964][52820] DAMAGECOUNT value on done: 783488.0 [2024-08-06 07:13:02,965][52820] Sum rewards: 85.021, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.185', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon4': '0.202', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '69.000'} [2024-08-06 07:13:02,985][52663] DAMAGECOUNT value on done: 827444.0 [2024-08-06 07:13:02,985][52663] Sum rewards: 71.793, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.684', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.088', 'weapon5': '0.180', 'AMMO4': '0.228', 'AMMO3': '0.244', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:02,998][52671] DAMAGECOUNT value on done: 840616.0 [2024-08-06 07:13:02,999][52671] Sum rewards: 79.003, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.118', 'AMMO4': '0.135', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:03,335][52670] DAMAGECOUNT value on done: 822228.0 [2024-08-06 07:13:03,336][52670] Sum rewards: 76.201, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.448', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO4': '0.087', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:03,436][52803] DAMAGECOUNT value on done: 780171.0 [2024-08-06 07:13:03,436][52803] Sum rewards: 76.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.959', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.214', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:04,454][52669] DAMAGECOUNT value on done: 837966.0 [2024-08-06 07:13:04,456][52669] Sum rewards: 77.627, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.076', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.066', 'weapon5': '0.146', 'AMMO3': '0.205', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:04,711][52649] DAMAGECOUNT value on done: 812714.0 [2024-08-06 07:13:04,719][52649] Sum rewards: 71.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.366', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.072', 'weapon4': '0.102', 'AMMO4': '0.138', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.274', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:04,982][52665] DAMAGECOUNT value on done: 824023.0 [2024-08-06 07:13:04,984][52665] Sum rewards: 72.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.461', 'AMMO5': '0.012', 'AMMO2': '0.048', 'AMMO3': '0.206', 'AMMO4': '0.238', 'weapon5': '0.260', 'weapon2': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'weapon4': '0.692', 'WEAPON3': '1.250', 'weapon3': '2.488', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:05,078][52795] DAMAGECOUNT value on done: 770767.0 [2024-08-06 07:13:05,080][52795] Sum rewards: 81.314, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.083', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.100', 'weapon3': '3.518', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:05,416][52671] DAMAGECOUNT value on done: 836416.0 [2024-08-06 07:13:05,418][52671] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.216', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.182', 'weapon4': '0.188', 'weapon5': '0.206', 'AMMO4': '0.228', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '59.500'} [2024-08-06 07:13:05,424][52666] DAMAGECOUNT value on done: 834476.0 [2024-08-06 07:13:05,426][52666] Sum rewards: 79.683, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.212', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.166', 'weapon4': '0.224', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '66.500'} [2024-08-06 07:13:05,976][52670] DAMAGECOUNT value on done: 835048.0 [2024-08-06 07:13:05,976][52670] Sum rewards: 70.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.516', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:06,257][52663] DAMAGECOUNT value on done: 828961.0 [2024-08-06 07:13:06,258][52663] Sum rewards: 85.229, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'weapon4': '0.102', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.582', 'WEAPON3': '1.500', 'weapon3': '2.998', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '72.000'} [2024-08-06 07:13:06,309][52820] DAMAGECOUNT value on done: 764053.0 [2024-08-06 07:13:06,311][52820] Sum rewards: 72.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.093', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.654', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:06,345][52803] DAMAGECOUNT value on done: 774890.0 [2024-08-06 07:13:06,347][52803] Sum rewards: 75.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.300', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.217', 'weapon5': '0.226', 'weapon4': '0.242', 'AMMO4': '0.248', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:06,588][52650] Updated weights for policy 0, policy_version 74791 (0.0011) [2024-08-06 07:13:07,610][52669] DAMAGECOUNT value on done: 860622.0 [2024-08-06 07:13:07,612][52669] Sum rewards: 69.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.485', 'AMMO5': '0.008', 'weapon4': '0.042', 'AMMO2': '0.043', 'weapon5': '0.144', 'AMMO4': '0.214', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '57.000'} [2024-08-06 07:13:07,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 612712448. Throughput: 0: 4354.7. Samples: 153179930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:07,794][52567] Avg episode reward: [(0, '74.280')] [2024-08-06 07:13:08,032][52665] DAMAGECOUNT value on done: 828607.0 [2024-08-06 07:13:08,033][52665] Sum rewards: 92.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.072', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.082', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '22.509', 'FRAGCOUNT': '75.000'} [2024-08-06 07:13:08,263][52795] DAMAGECOUNT value on done: 774727.0 [2024-08-06 07:13:08,263][52795] Sum rewards: 64.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.094', 'AMMO3': '0.225', 'weapon5': '0.260', 'AMMO4': '0.303', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.074', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '54.000'} [2024-08-06 07:13:08,446][52671] DAMAGECOUNT value on done: 845210.0 [2024-08-06 07:13:08,447][52671] Sum rewards: 78.071, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.756', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.084', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:08,544][52666] DAMAGECOUNT value on done: 831104.0 [2024-08-06 07:13:08,546][52666] Sum rewards: 71.230, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.160', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.144', 'AMMO3': '0.264', 'weapon5': '0.270', 'weapon2': '0.278', 'AMMO4': '0.326', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:09,195][52663] DAMAGECOUNT value on done: 836623.0 [2024-08-06 07:13:09,195][52663] Sum rewards: 73.410, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.158', 'weapon4': '0.160', 'AMMO4': '0.202', 'weapon2': '0.260', 'AMMO3': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.092', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:09,343][52670] DAMAGECOUNT value on done: 824963.0 [2024-08-06 07:13:09,343][52670] Sum rewards: 69.516, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.980', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.050', 'weapon5': '0.100', 'weapon2': '0.176', 'AMMO4': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.307', 'WEAPON3': '1.950', 'weapon3': '3.430', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '62.000'} [2024-08-06 07:13:09,411][52803] DAMAGECOUNT value on done: 787924.0 [2024-08-06 07:13:09,414][52803] Sum rewards: 72.195, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.622', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.454', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:09,496][52820] DAMAGECOUNT value on done: 774615.0 [2024-08-06 07:13:09,498][52820] Sum rewards: 63.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.226', 'AMMO3': '0.266', 'weapon4': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.900', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '55.000'} [2024-08-06 07:13:09,721][52664] Large shaping reward 2.519 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.042, -14.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:13:09,783][52614] Signal inference workers to stop experience collection... (13650 times) [2024-08-06 07:13:09,783][52614] Signal inference workers to resume experience collection... (13650 times) [2024-08-06 07:13:09,856][52650] InferenceWorker_p0-w0: stopping experience collection (13650 times) [2024-08-06 07:13:09,856][52650] InferenceWorker_p0-w0: resuming experience collection (13650 times) [2024-08-06 07:13:10,326][52665] DAMAGECOUNT value on done: 819980.0 [2024-08-06 07:13:10,328][52665] Sum rewards: 71.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.254', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.406', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 07:13:10,455][52669] DAMAGECOUNT value on done: 846548.0 [2024-08-06 07:13:10,456][52669] Sum rewards: 73.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.144', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.093', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.274', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.194', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:11,187][52671] DAMAGECOUNT value on done: 839820.0 [2024-08-06 07:13:11,187][52671] Sum rewards: 75.016, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.345', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon2': '0.216', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.408', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:11,455][52795] DAMAGECOUNT value on done: 775612.0 [2024-08-06 07:13:11,455][52795] Sum rewards: 70.833, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.623', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.112', 'weapon5': '0.248', 'AMMO4': '0.252', 'weapon2': '0.262', 'AMMO3': '0.343', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '2.000', 'weapon3': '3.034', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:11,570][52650] Updated weights for policy 0, policy_version 74801 (0.0013) [2024-08-06 07:13:11,736][52666] DAMAGECOUNT value on done: 824814.0 [2024-08-06 07:13:11,736][52666] Sum rewards: 82.852, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.134', 'AMMO4': '0.162', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.920', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:11,891][52663] DAMAGECOUNT value on done: 832481.0 [2024-08-06 07:13:11,892][52663] Sum rewards: 73.435, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.728', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.136', 'weapon5': '0.158', 'AMMO4': '0.239', 'AMMO3': '0.243', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.916', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:12,660][52670] DAMAGECOUNT value on done: 822167.0 [2024-08-06 07:13:12,660][52670] Sum rewards: 83.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.568', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon4': '0.158', 'weapon5': '0.174', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '68.000'} [2024-08-06 07:13:12,670][52803] DAMAGECOUNT value on done: 774834.0 [2024-08-06 07:13:12,670][52803] Sum rewards: 73.390, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.822', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.108', 'AMMO3': '0.197', 'AMMO4': '0.204', 'weapon5': '0.216', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:12,708][52820] DAMAGECOUNT value on done: 785979.0 [2024-08-06 07:13:12,708][52820] Sum rewards: 76.976, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.050', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.080', 'weapon5': '0.176', 'AMMO4': '0.219', 'weapon2': '0.246', 'AMMO3': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.170', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '67.000'} [2024-08-06 07:13:12,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 612794368. Throughput: 0: 4351.1. Samples: 153205860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:12,795][52567] Avg episode reward: [(0, '73.922')] [2024-08-06 07:13:13,031][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:13:13,157][52669] DAMAGECOUNT value on done: 842681.0 [2024-08-06 07:13:13,157][52669] Sum rewards: 61.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.420', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO4': '0.115', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.344', 'DAMAGECOUNT': '15.306', 'FRAGCOUNT': '53.500'} [2024-08-06 07:13:13,436][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:13:13,560][52665] DAMAGECOUNT value on done: 827981.0 [2024-08-06 07:13:13,562][52665] Sum rewards: 71.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.480', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon2': '0.228', 'weapon4': '0.228', 'AMMO3': '0.236', 'weapon5': '0.238', 'AMMO4': '0.256', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '61.500'} [2024-08-06 07:13:13,692][52671] DAMAGECOUNT value on done: 825463.0 [2024-08-06 07:13:13,692][52671] Sum rewards: 71.662, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO3': '0.142', 'WEAPON4': '0.150', 'weapon4': '0.320', 'weapon2': '0.842', 'WEAPON3': '0.900', 'weapon3': '2.560', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '55.000'} [2024-08-06 07:13:14,631][52663] DAMAGECOUNT value on done: 838915.0 [2024-08-06 07:13:14,631][52663] Sum rewards: 84.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'weapon2': '0.260', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.162', 'FRAGCOUNT': '71.000'} [2024-08-06 07:13:14,805][52666] DAMAGECOUNT value on done: 832471.0 [2024-08-06 07:13:14,805][52795] DAMAGECOUNT value on done: 771322.0 [2024-08-06 07:13:14,813][52666] Sum rewards: 78.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.840', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.158', 'weapon5': '0.164', 'weapon2': '0.186', 'AMMO3': '0.227', 'AMMO4': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:14,814][52795] Sum rewards: 70.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.764', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.280', 'WEAPON3': '1.500', 'weapon3': '3.390', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:15,532][52670] DAMAGECOUNT value on done: 824911.0 [2024-08-06 07:13:15,534][52670] Sum rewards: 65.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.887', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.022', 'weapon5': '0.062', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '54.000'} [2024-08-06 07:13:15,723][52803] DAMAGECOUNT value on done: 777539.0 [2024-08-06 07:13:15,723][52803] Sum rewards: 71.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.161', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.044', 'AMMO4': '0.156', 'weapon5': '0.180', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.590', 'WEAPON3': '1.450', 'weapon3': '2.922', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:15,830][52820] DAMAGECOUNT value on done: 778386.0 [2024-08-06 07:13:15,831][52820] Sum rewards: 76.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.465', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO4': '0.229', 'AMMO3': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.912', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:15,915][52669] DAMAGECOUNT value on done: 845412.0 [2024-08-06 07:13:15,916][52669] Sum rewards: 71.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.230', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.154', 'weapon5': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.276', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.034', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 07:13:16,010][52650] Updated weights for policy 0, policy_version 74811 (0.0021) [2024-08-06 07:13:16,209][52671] DAMAGECOUNT value on done: 849694.0 [2024-08-06 07:13:16,211][52671] Sum rewards: 71.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.152', 'AMMO3': '0.165', 'weapon2': '0.218', 'AMMO4': '0.225', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:16,228][52665] DAMAGECOUNT value on done: 827548.0 [2024-08-06 07:13:16,229][52665] Sum rewards: 67.631, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.065', 'weapon4': '0.084', 'weapon2': '0.190', 'weapon5': '0.220', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO4': '0.325', 'WEAPON3': '1.700', 'weapon3': '3.228', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:17,196][52666] DAMAGECOUNT value on done: 827884.0 [2024-08-06 07:13:17,197][52666] Sum rewards: 70.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon2': '0.126', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon4': '0.244', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '57.000'} [2024-08-06 07:13:17,774][52663] DAMAGECOUNT value on done: 840486.0 [2024-08-06 07:13:17,775][52663] Sum rewards: 73.905, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.055', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO3': '0.196', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 612884480. Throughput: 0: 4363.8. Samples: 153219300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:17,795][52567] Avg episode reward: [(0, '74.250')] [2024-08-06 07:13:17,944][52795] DAMAGECOUNT value on done: 765959.0 [2024-08-06 07:13:17,945][52795] Sum rewards: 86.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.805', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.058', 'weapon5': '0.152', 'AMMO4': '0.164', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '70.000'} [2024-08-06 07:13:18,039][52670] DAMAGECOUNT value on done: 825594.0 [2024-08-06 07:13:18,040][52670] Sum rewards: 60.819, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.028', 'AMMO5': '0.021', 'AMMO2': '0.057', 'AMMO3': '0.203', 'weapon2': '0.232', 'AMMO4': '0.286', 'weapon5': '0.302', 'weapon4': '0.488', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.526', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.801', 'FRAGCOUNT': '50.000'} [2024-08-06 07:13:18,632][52671] DAMAGECOUNT value on done: 845372.0 [2024-08-06 07:13:18,632][52671] Sum rewards: 72.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.181', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.178', 'AMMO3': '0.185', 'AMMO4': '0.202', 'weapon5': '0.212', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '56.000'} [2024-08-06 07:13:18,759][52803] DAMAGECOUNT value on done: 783002.0 [2024-08-06 07:13:18,760][52803] Sum rewards: 68.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'weapon2': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.396', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:18,883][52669] DAMAGECOUNT value on done: 848238.0 [2024-08-06 07:13:18,884][52669] Sum rewards: 80.087, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.250', 'AMMO3': '0.312', 'WEAPON3': '1.850', 'weapon3': '3.382', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '71.500'} [2024-08-06 07:13:18,971][52820] DAMAGECOUNT value on done: 779595.0 [2024-08-06 07:13:18,971][52820] Sum rewards: 84.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.372', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.146', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '71.000'} [2024-08-06 07:13:19,122][52665] DAMAGECOUNT value on done: 819455.0 [2024-08-06 07:13:19,122][52665] Sum rewards: 77.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.141', 'AMMO5': '0.011', 'AMMO2': '0.064', 'weapon5': '0.170', 'weapon4': '0.236', 'weapon2': '0.240', 'AMMO3': '0.251', 'AMMO4': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:19,910][52666] DAMAGECOUNT value on done: 822131.0 [2024-08-06 07:13:19,918][52666] Sum rewards: 71.429, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.998', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.076', 'weapon5': '0.132', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'AMMO3': '0.337', 'WEAPON3': '2.050', 'weapon3': '3.162', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:20,099][52663] DAMAGECOUNT value on done: 826760.0 [2024-08-06 07:13:20,099][52663] Sum rewards: 83.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon5': '0.182', 'weapon4': '0.194', 'AMMO3': '0.205', 'AMMO4': '0.205', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '68.000'} [2024-08-06 07:13:20,653][52650] Updated weights for policy 0, policy_version 74821 (0.0026) [2024-08-06 07:13:20,761][52670] DAMAGECOUNT value on done: 821510.0 [2024-08-06 07:13:20,761][52670] Sum rewards: 77.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.865', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO4': '0.222', 'weapon5': '0.230', 'AMMO3': '0.247', 'weapon2': '0.318', 'weapon4': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.768', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:20,806][52668] DAMAGECOUNT value on done: 841941.0 [2024-08-06 07:13:20,806][52668] Sum rewards: 76.544, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.186', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon4': '0.096', 'weapon5': '0.182', 'AMMO3': '0.266', 'AMMO4': '0.304', 'weapon2': '0.382', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.044', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '67.000'} [2024-08-06 07:13:21,050][52795] DAMAGECOUNT value on done: 767815.0 [2024-08-06 07:13:21,051][52795] Sum rewards: 70.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.874', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.122', 'AMMO4': '0.123', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:21,610][52665] DAMAGECOUNT value on done: 823369.0 [2024-08-06 07:13:21,612][52665] Sum rewards: 67.612, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.892', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon2': '0.184', 'weapon5': '0.186', 'weapon4': '0.194', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.188', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:21,785][52671] DAMAGECOUNT value on done: 840800.0 [2024-08-06 07:13:21,787][52671] Sum rewards: 74.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.082', 'weapon5': '0.164', 'AMMO4': '0.187', 'AMMO3': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:22,014][52803] DAMAGECOUNT value on done: 786833.0 [2024-08-06 07:13:22,015][52803] Sum rewards: 79.974, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.848', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.138', 'AMMO4': '0.179', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:22,232][52820] DAMAGECOUNT value on done: 775830.0 [2024-08-06 07:13:22,236][52820] Sum rewards: 82.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.637', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.187', 'AMMO4': '0.217', 'weapon5': '0.228', 'weapon2': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:22,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 612966400. Throughput: 0: 4365.6. Samples: 153245810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:22,794][52567] Avg episode reward: [(0, '74.413')] [2024-08-06 07:13:23,132][52666] DAMAGECOUNT value on done: 832128.0 [2024-08-06 07:13:23,132][52666] Sum rewards: 66.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.108', 'AMMO3': '0.207', 'AMMO4': '0.242', 'weapon5': '0.296', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '53.000'} [2024-08-06 07:13:23,764][52668] DAMAGECOUNT value on done: 841487.0 [2024-08-06 07:13:23,765][52668] Sum rewards: 61.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.326', 'AMMO5': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.100', 'weapon4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.650', 'HITCOUNT': '2.770', 'weapon3': '3.288', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '54.000'} [2024-08-06 07:13:23,994][52670] DAMAGECOUNT value on done: 832873.0 [2024-08-06 07:13:23,996][52670] Sum rewards: 81.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.180', 'AMMO3': '0.198', 'weapon4': '0.246', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:24,177][52665] DAMAGECOUNT value on done: 829282.0 [2024-08-06 07:13:24,178][52665] Sum rewards: 66.259, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.294', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.082', 'weapon5': '0.106', 'AMMO4': '0.276', 'weapon2': '0.304', 'AMMO3': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.138', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:24,210][52795] DAMAGECOUNT value on done: 778314.0 [2024-08-06 07:13:24,211][52795] Sum rewards: 84.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.506', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '71.000'} [2024-08-06 07:13:24,989][52671] DAMAGECOUNT value on done: 845579.0 [2024-08-06 07:13:24,997][52671] Sum rewards: 83.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.404', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.246', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.430', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '69.000'} [2024-08-06 07:13:25,071][52803] DAMAGECOUNT value on done: 784062.0 [2024-08-06 07:13:25,074][52803] Sum rewards: 80.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.478', 'AMMO2': '0.010', 'AMMO5': '0.014', 'weapon4': '0.044', 'AMMO4': '0.048', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.326', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:25,181][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:13:25,397][52650] Updated weights for policy 0, policy_version 74831 (0.0012) [2024-08-06 07:13:25,439][52820] DAMAGECOUNT value on done: 776789.0 [2024-08-06 07:13:25,441][52820] Sum rewards: 72.009, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.108', 'weapon5': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.225', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '60.500'} [2024-08-06 07:13:26,300][52666] DAMAGECOUNT value on done: 824808.0 [2024-08-06 07:13:26,302][52666] Sum rewards: 72.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO3': '0.158', 'weapon5': '0.172', 'AMMO4': '0.179', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.642', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:26,960][52668] DAMAGECOUNT value on done: 838287.0 [2024-08-06 07:13:26,962][52668] Sum rewards: 76.680, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.104', 'weapon5': '0.188', 'AMMO3': '0.218', 'AMMO4': '0.301', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:27,286][52670] DAMAGECOUNT value on done: 815157.0 [2024-08-06 07:13:27,287][52670] Sum rewards: 81.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '69.000'} [2024-08-06 07:13:27,312][52795] DAMAGECOUNT value on done: 762341.0 [2024-08-06 07:13:27,312][52795] Sum rewards: 75.162, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.654', 'AMMO5': '0.023', 'AMMO2': '0.070', 'weapon4': '0.154', 'AMMO3': '0.259', 'weapon2': '0.316', 'AMMO4': '0.349', 'weapon5': '0.390', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.728', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:27,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 613048320. Throughput: 0: 4377.6. Samples: 153272250. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:27,794][52567] Avg episode reward: [(0, '74.517')] [2024-08-06 07:13:27,817][52671] DAMAGECOUNT value on done: 830419.0 [2024-08-06 07:13:27,822][52671] Sum rewards: 64.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.527', 'AMMO2': '0.021', 'AMMO5': '0.024', 'weapon4': '0.062', 'AMMO4': '0.106', 'weapon5': '0.142', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'HITCOUNT': '2.970', 'weapon3': '3.108', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '54.000'} [2024-08-06 07:13:28,054][52803] DAMAGECOUNT value on done: 781795.0 [2024-08-06 07:13:28,057][52803] Sum rewards: 80.855, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.482', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.064', 'weapon5': '0.112', 'AMMO3': '0.131', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.684', 'WEAPON3': '0.850', 'weapon3': '2.876', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:28,721][52820] DAMAGECOUNT value on done: 786218.0 [2024-08-06 07:13:28,723][52820] Sum rewards: 59.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.168', 'AMMO4': '0.180', 'weapon4': '0.184', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '50.000'} [2024-08-06 07:13:29,297][52666] DAMAGECOUNT value on done: 833487.0 [2024-08-06 07:13:29,299][52666] Sum rewards: 78.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.106', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.259', 'WEAPON3': '1.650', 'weapon3': '3.390', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:29,970][52650] Updated weights for policy 0, policy_version 74841 (0.0012) [2024-08-06 07:13:30,120][52670] DAMAGECOUNT value on done: 830320.0 [2024-08-06 07:13:30,131][52670] Sum rewards: 69.973, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.796', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.104', 'weapon5': '0.210', 'AMMO3': '0.218', 'AMMO4': '0.307', 'weapon2': '0.422', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.944', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '59.000'} [2024-08-06 07:13:30,134][52668] DAMAGECOUNT value on done: 843963.0 [2024-08-06 07:13:30,134][52668] Sum rewards: 83.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.784', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.142', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.280', 'WEAPON5': '0.300', 'weapon4': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.816', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '67.000'} [2024-08-06 07:13:30,513][52795] DAMAGECOUNT value on done: 776820.0 [2024-08-06 07:13:30,514][52795] Sum rewards: 74.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.667', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.046', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.179', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '3.202', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:31,875][52820] DAMAGECOUNT value on done: 784175.0 [2024-08-06 07:13:31,875][52820] Sum rewards: 80.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.147', 'weapon2': '0.172', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.516', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:32,422][52666] DAMAGECOUNT value on done: 818368.0 [2024-08-06 07:13:32,424][52666] Sum rewards: 66.140, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.218', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.134', 'weapon4': '0.152', 'AMMO4': '0.203', 'AMMO3': '0.229', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '57.000'} [2024-08-06 07:13:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 613146624. Throughput: 0: 4373.1. Samples: 153285300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:32,795][52567] Avg episode reward: [(0, '74.559')] [2024-08-06 07:13:32,944][52668] DAMAGECOUNT value on done: 829829.0 [2024-08-06 07:13:32,945][52668] Sum rewards: 82.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.106', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.070', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '69.000'} [2024-08-06 07:13:33,242][52670] DAMAGECOUNT value on done: 836331.0 [2024-08-06 07:13:33,246][52670] Sum rewards: 87.441, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.034', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.562', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.475', 'FRAGCOUNT': '75.500'} [2024-08-06 07:13:33,689][52795] DAMAGECOUNT value on done: 774138.0 [2024-08-06 07:13:33,689][52795] Sum rewards: 73.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.709', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.105', 'weapon5': '0.140', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 07:13:34,823][52650] Updated weights for policy 0, policy_version 74851 (0.0010) [2024-08-06 07:13:35,055][52820] DAMAGECOUNT value on done: 767192.0 [2024-08-06 07:13:35,057][52820] Sum rewards: 91.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.793', 'FRAGCOUNT': '74.000'} [2024-08-06 07:13:35,653][52666] DAMAGECOUNT value on done: 835771.0 [2024-08-06 07:13:35,654][52666] Sum rewards: 79.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.474', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.142', 'weapon2': '0.206', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:35,808][52664] Large shaping reward 2.615 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.594, 198.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:13:36,442][52668] DAMAGECOUNT value on done: 839294.0 [2024-08-06 07:13:36,443][52668] Sum rewards: 64.362, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.326', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.074', 'weapon2': '0.190', 'weapon5': '0.228', 'AMMO4': '0.247', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.240', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '54.000'} [2024-08-06 07:13:36,485][52670] DAMAGECOUNT value on done: 829721.0 [2024-08-06 07:13:36,485][52670] Sum rewards: 72.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.166', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:37,032][52795] DAMAGECOUNT value on done: 763392.0 [2024-08-06 07:13:37,032][52795] Sum rewards: 68.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.142', 'AMMO3': '0.222', 'AMMO4': '0.256', 'weapon5': '0.340', 'weapon2': '0.496', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.678', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '56.000'} [2024-08-06 07:13:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 613228544. Throughput: 0: 4375.1. Samples: 153311370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:37,794][52567] Avg episode reward: [(0, '74.768')] [2024-08-06 07:13:38,086][52662] DAMAGECOUNT value on done: 835755.0 [2024-08-06 07:13:38,087][52662] Sum rewards: 78.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.506', 'AMMO2': '0.013', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'weapon4': '0.178', 'AMMO3': '0.235', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.340', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '67.000'} [2024-08-06 07:13:38,442][52666] DAMAGECOUNT value on done: 830550.0 [2024-08-06 07:13:38,444][52666] Sum rewards: 70.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.660', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.062', 'AMMO4': '0.161', 'weapon5': '0.178', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.646', 'WEAPON3': '1.450', 'weapon3': '2.906', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:38,910][52670] DAMAGECOUNT value on done: 810598.0 [2024-08-06 07:13:38,910][52670] Sum rewards: 63.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.508', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.068', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon4': '0.226', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.256', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '54.500'} [2024-08-06 07:13:39,208][52668] DAMAGECOUNT value on done: 839549.0 [2024-08-06 07:13:39,209][52668] Sum rewards: 77.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.156', 'AMMO4': '0.182', 'AMMO3': '0.221', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '65.000'} [2024-08-06 07:13:39,425][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:13:39,531][52650] Updated weights for policy 0, policy_version 74861 (0.0016) [2024-08-06 07:13:40,334][52795] DAMAGECOUNT value on done: 773701.0 [2024-08-06 07:13:40,335][52795] Sum rewards: 74.491, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.224', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:41,348][52662] DAMAGECOUNT value on done: 845335.0 [2024-08-06 07:13:41,356][52662] Sum rewards: 80.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.068', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.218', 'WEAPON3': '1.350', 'weapon3': '3.502', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:41,614][52666] DAMAGECOUNT value on done: 830712.0 [2024-08-06 07:13:41,615][52666] Sum rewards: 87.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.605', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '3.230', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '70.000'} [2024-08-06 07:13:42,110][52668] DAMAGECOUNT value on done: 829966.0 [2024-08-06 07:13:42,111][52668] Sum rewards: 71.437, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.465', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.102', 'weapon4': '0.106', 'AMMO4': '0.123', 'weapon2': '0.186', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.370', 'weapon3': '3.382', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '62.500'} [2024-08-06 07:13:42,232][52670] DAMAGECOUNT value on done: 827216.0 [2024-08-06 07:13:42,233][52670] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.630', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.072', 'AMMO4': '0.141', 'weapon5': '0.166', 'AMMO3': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 613318656. Throughput: 0: 4365.8. Samples: 153337220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:42,794][52567] Avg episode reward: [(0, '74.782')] [2024-08-06 07:13:43,613][52795] DAMAGECOUNT value on done: 779534.0 [2024-08-06 07:13:43,614][52795] Sum rewards: 65.811, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.716', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon5': '0.132', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.402', 'weapon4': '0.440', 'WEAPON3': '1.250', 'weapon3': '2.840', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '54.000'} [2024-08-06 07:13:44,035][52650] Updated weights for policy 0, policy_version 74871 (0.0010) [2024-08-06 07:13:44,245][52666] DAMAGECOUNT value on done: 824976.0 [2024-08-06 07:13:44,246][52666] Sum rewards: 69.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.708', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.165', 'AMMO4': '0.289', 'weapon5': '0.316', 'weapon2': '0.340', 'weapon4': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.650', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '56.000'} [2024-08-06 07:13:44,449][52662] DAMAGECOUNT value on done: 847075.0 [2024-08-06 07:13:44,450][52662] Sum rewards: 77.454, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.759', 'AMMO5': '0.012', 'weapon5': '0.024', 'AMMO2': '0.038', 'weapon4': '0.122', 'AMMO4': '0.188', 'weapon2': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '68.000'} [2024-08-06 07:13:44,759][52670] DAMAGECOUNT value on done: 836205.0 [2024-08-06 07:13:44,760][52670] Sum rewards: 82.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.096', 'AMMO5': '0.009', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.130', 'weapon4': '0.174', 'weapon2': '0.194', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '69.000'} [2024-08-06 07:13:45,343][52668] DAMAGECOUNT value on done: 833213.0 [2024-08-06 07:13:45,344][52668] Sum rewards: 76.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.916', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '63.000'} [2024-08-06 07:13:46,918][52666] DAMAGECOUNT value on done: 825137.0 [2024-08-06 07:13:46,926][52666] Sum rewards: 72.932, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.014', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.140', 'weapon5': '0.146', 'AMMO3': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '62.000'} [2024-08-06 07:13:47,540][52662] DAMAGECOUNT value on done: 831423.0 [2024-08-06 07:13:47,540][52662] Sum rewards: 70.675, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.326', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.338', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.430', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:47,575][52670] DAMAGECOUNT value on done: 827938.0 [2024-08-06 07:13:47,576][52670] Sum rewards: 79.409, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.128', 'weapon4': '0.282', 'weapon2': '0.422', 'WEAPON3': '0.850', 'weapon3': '2.916', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 613400576. Throughput: 0: 4367.6. Samples: 153350330. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:13:47,794][52567] Avg episode reward: [(0, '74.595')] [2024-08-06 07:13:48,350][52668] DAMAGECOUNT value on done: 841528.0 [2024-08-06 07:13:48,351][52668] Sum rewards: 82.358, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.625', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.128', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'weapon4': '0.332', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:48,829][52650] Updated weights for policy 0, policy_version 74881 (0.0049) [2024-08-06 07:13:50,239][52666] DAMAGECOUNT value on done: 839947.0 [2024-08-06 07:13:50,242][52666] Sum rewards: 79.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.320', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.072', 'AMMO4': '0.121', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.700', 'weapon3': '3.452', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '68.000'} [2024-08-06 07:13:50,388][52662] DAMAGECOUNT value on done: 848730.0 [2024-08-06 07:13:50,389][52662] Sum rewards: 68.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.014', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.095', 'weapon5': '0.110', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:51,063][52670] DAMAGECOUNT value on done: 830936.0 [2024-08-06 07:13:51,063][52670] Sum rewards: 85.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.911', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.088', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.458', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.378', 'FRAGCOUNT': '69.000'} [2024-08-06 07:13:51,105][52647] DAMAGECOUNT value on done: 890524.0 [2024-08-06 07:13:51,106][52647] Sum rewards: 75.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.114', 'weapon2': '0.262', 'AMMO3': '0.267', 'AMMO4': '0.300', 'weapon5': '0.306', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.012', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '62.000'} [2024-08-06 07:13:51,883][52668] DAMAGECOUNT value on done: 833672.0 [2024-08-06 07:13:51,884][52668] Sum rewards: 68.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.437', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.060', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.594', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '55.000'} [2024-08-06 07:13:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 613490688. Throughput: 0: 4372.0. Samples: 153376670. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:13:52,795][52567] Avg episode reward: [(0, '74.626')] [2024-08-06 07:13:53,255][52662] DAMAGECOUNT value on done: 827559.0 [2024-08-06 07:13:53,257][52662] Sum rewards: 70.546, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.167', 'weapon4': '0.216', 'AMMO4': '0.220', 'weapon5': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '54.500'} [2024-08-06 07:13:53,410][52666] DAMAGECOUNT value on done: 817158.0 [2024-08-06 07:13:53,410][52666] Sum rewards: 67.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.338', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.172', 'AMMO4': '0.185', 'AMMO3': '0.211', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '57.000'} [2024-08-06 07:13:53,528][52650] Updated weights for policy 0, policy_version 74891 (0.0010) [2024-08-06 07:13:54,160][52647] DAMAGECOUNT value on done: 879300.0 [2024-08-06 07:13:54,160][52647] Sum rewards: 80.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.981', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.304', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '68.000'} [2024-08-06 07:13:55,035][52668] DAMAGECOUNT value on done: 830841.0 [2024-08-06 07:13:55,037][52668] Sum rewards: 86.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon4': '0.212', 'weapon2': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.772', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '70.000'} [2024-08-06 07:13:55,935][52662] DAMAGECOUNT value on done: 834086.0 [2024-08-06 07:13:55,938][52662] Sum rewards: 75.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.068', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.556', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:56,490][52666] DAMAGECOUNT value on done: 825164.0 [2024-08-06 07:13:56,490][52666] Sum rewards: 70.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.646', 'AMMO5': '0.025', 'AMMO2': '0.076', 'weapon4': '0.148', 'AMMO3': '0.214', 'weapon5': '0.344', 'weapon2': '0.370', 'AMMO4': '0.379', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.822', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '58.000'} [2024-08-06 07:13:57,285][52647] DAMAGECOUNT value on done: 886773.0 [2024-08-06 07:13:57,285][52647] Sum rewards: 81.793, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.295', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.122', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '66.000'} [2024-08-06 07:13:57,605][52668] DAMAGECOUNT value on done: 825062.0 [2024-08-06 07:13:57,605][52668] Sum rewards: 66.044, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.195', 'weapon2': '0.604', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.242', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '56.000'} [2024-08-06 07:13:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 613580800. Throughput: 0: 4377.8. Samples: 153402860. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:13:57,794][52567] Avg episode reward: [(0, '74.708')] [2024-08-06 07:13:58,064][52650] Updated weights for policy 0, policy_version 74901 (0.0017) [2024-08-06 07:13:58,581][52662] DAMAGECOUNT value on done: 852101.0 [2024-08-06 07:13:58,581][52662] Sum rewards: 72.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.571', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.062', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '61.000'} [2024-08-06 07:13:58,725][52664] DAMAGECOUNT value on done: 864650.0 [2024-08-06 07:13:58,726][52664] Sum rewards: 81.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.611', 'AMMO4': '-0.008', 'AMMO2': '-0.002', 'AMMO3': '0.179', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '3.290', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '64.000'} [2024-08-06 07:13:59,731][52647] DAMAGECOUNT value on done: 885945.0 [2024-08-06 07:13:59,732][52647] Sum rewards: 86.095, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.354', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.064', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.320', 'WEAPON3': '1.950', 'weapon3': '3.378', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '22.158', 'FRAGCOUNT': '74.000'} [2024-08-06 07:14:00,805][52668] DAMAGECOUNT value on done: 826488.0 [2024-08-06 07:14:00,806][52668] Sum rewards: 64.815, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.022', 'AMMO5': '0.022', 'AMMO2': '0.061', 'weapon4': '0.096', 'weapon5': '0.216', 'AMMO3': '0.286', 'AMMO4': '0.304', 'weapon2': '0.356', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.008', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '59.000'} [2024-08-06 07:14:00,915][52662] DAMAGECOUNT value on done: 838816.0 [2024-08-06 07:14:00,916][52662] Sum rewards: 61.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.259', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.174', 'AMMO3': '0.181', 'AMMO4': '0.223', 'weapon4': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.634', 'WEAPON3': '1.000', 'weapon3': '2.642', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.047', 'FRAGCOUNT': '51.000'} [2024-08-06 07:14:01,359][52664] DAMAGECOUNT value on done: 870470.0 [2024-08-06 07:14:01,361][52664] Sum rewards: 89.165, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.076', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.136', 'AMMO4': '0.180', 'weapon2': '0.240', 'weapon5': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.356', 'WEAPON3': '0.950', 'weapon3': '2.938', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.583', 'FRAGCOUNT': '69.000'} [2024-08-06 07:14:02,410][52647] DAMAGECOUNT value on done: 891914.0 [2024-08-06 07:14:02,412][52647] Sum rewards: 81.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.494', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.076', 'weapon4': '0.136', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.078', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 613662720. Throughput: 0: 4372.0. Samples: 153416040. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:14:02,795][52567] Avg episode reward: [(0, '74.967')] [2024-08-06 07:14:02,932][52667] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon5', 0.002)] [2024-08-06 07:14:03,051][52650] Updated weights for policy 0, policy_version 74911 (0.0013) [2024-08-06 07:14:03,440][52662] DAMAGECOUNT value on done: 844492.0 [2024-08-06 07:14:03,441][52662] Sum rewards: 74.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.110', 'weapon5': '0.162', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '60.000'} [2024-08-06 07:14:03,800][52664] DAMAGECOUNT value on done: 870990.0 [2024-08-06 07:14:03,801][52664] Sum rewards: 65.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.114', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.038', 'weapon5': '0.078', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.450', 'weapon3': '3.202', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '55.000'} [2024-08-06 07:14:03,836][52668] DAMAGECOUNT value on done: 821351.0 [2024-08-06 07:14:03,837][52668] Sum rewards: 79.080, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.064', 'weapon5': '0.168', 'AMMO3': '0.180', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '64.000'} [2024-08-06 07:14:05,021][52647] DAMAGECOUNT value on done: 886918.0 [2024-08-06 07:14:05,021][52647] Sum rewards: 63.477, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO3': '0.157', 'AMMO4': '0.183', 'weapon2': '0.260', 'HEALTH': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.480', 'WEAPON3': '0.850', 'weapon3': '2.890', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '50.000'} [2024-08-06 07:14:05,323][52664] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:14:06,111][52662] DAMAGECOUNT value on done: 834261.0 [2024-08-06 07:14:06,111][52662] Sum rewards: 74.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.140', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.155', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '62.000'} [2024-08-06 07:14:06,213][52667] DAMAGECOUNT value on done: 836285.0 [2024-08-06 07:14:06,213][52667] Sum rewards: 70.281, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.795', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.274', 'weapon4': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '60.000'} [2024-08-06 07:14:06,534][52664] DAMAGECOUNT value on done: 863306.0 [2024-08-06 07:14:06,534][52664] Sum rewards: 71.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.184', 'AMMO4': '0.185', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '58.500'} [2024-08-06 07:14:07,030][52668] DAMAGECOUNT value on done: 835485.0 [2024-08-06 07:14:07,030][52668] Sum rewards: 76.242, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.897', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '64.500'} [2024-08-06 07:14:07,482][52650] Updated weights for policy 0, policy_version 74921 (0.0026) [2024-08-06 07:14:07,585][52647] DAMAGECOUNT value on done: 890876.0 [2024-08-06 07:14:07,587][52647] Sum rewards: 79.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.118', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.098', 'AMMO3': '0.176', 'AMMO4': '0.182', 'weapon5': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.062', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '64.000'} [2024-08-06 07:14:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 613752832. Throughput: 0: 4365.8. Samples: 153442270. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:14:07,794][52567] Avg episode reward: [(0, '74.778')] [2024-08-06 07:14:08,562][52660] DAMAGECOUNT value on done: 833768.0 [2024-08-06 07:14:08,563][52660] Sum rewards: 75.856, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.728', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.150', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.380', 'weapon3': '3.444', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '63.000'} [2024-08-06 07:14:08,817][52667] DAMAGECOUNT value on done: 846702.0 [2024-08-06 07:14:08,819][52667] Sum rewards: 83.346, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon2': '0.218', 'AMMO4': '0.237', 'weapon4': '0.254', 'AMMO3': '0.270', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.916', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '69.000'} [2024-08-06 07:14:09,011][52662] DAMAGECOUNT value on done: 837562.0 [2024-08-06 07:14:09,011][52662] Sum rewards: 84.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.941', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.036', 'weapon4': '0.110', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '71.000'} [2024-08-06 07:14:09,134][52664] DAMAGECOUNT value on done: 872984.0 [2024-08-06 07:14:09,135][52664] Sum rewards: 66.466, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.084', 'weapon5': '0.110', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '58.000'} [2024-08-06 07:14:10,387][52668] DAMAGECOUNT value on done: 839319.0 [2024-08-06 07:14:10,388][52668] Sum rewards: 72.265, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.060', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon4': '0.142', 'weapon2': '0.184', 'AMMO3': '0.198', 'AMMO4': '0.200', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '59.000'} [2024-08-06 07:14:10,411][52647] DAMAGECOUNT value on done: 868385.0 [2024-08-06 07:14:10,414][52647] Sum rewards: 66.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.562', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.142', 'weapon4': '0.164', 'AMMO4': '0.214', 'AMMO3': '0.222', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.920', 'weapon3': '3.004', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '57.000'} [2024-08-06 07:14:11,652][52660] DAMAGECOUNT value on done: 825775.0 [2024-08-06 07:14:11,652][52660] Sum rewards: 57.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'weapon4': '0.032', 'AMMO2': '0.049', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.244', 'AMMO3': '0.245', 'weapon2': '0.720', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '2.964', 'DAMAGECOUNT': '14.544', 'FRAGCOUNT': '49.000'} [2024-08-06 07:14:11,695][52667] DAMAGECOUNT value on done: 841745.0 [2024-08-06 07:14:11,697][52667] Sum rewards: 75.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.822', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.169', 'AMMO3': '0.173', 'weapon4': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '61.000'} [2024-08-06 07:14:11,775][52664] DAMAGECOUNT value on done: 869399.0 [2024-08-06 07:14:11,777][52664] Sum rewards: 82.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.142', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.436', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '68.000'} [2024-08-06 07:14:12,105][52662] DAMAGECOUNT value on done: 829292.0 [2024-08-06 07:14:12,107][52662] Sum rewards: 74.563, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.106', 'weapon2': '0.198', 'AMMO3': '0.244', 'AMMO4': '0.248', 'weapon5': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '63.000'} [2024-08-06 07:14:12,213][52650] Updated weights for policy 0, policy_version 74931 (0.0010) [2024-08-06 07:14:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 613842944. Throughput: 0: 4355.1. Samples: 153468230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:14:12,794][52567] Avg episode reward: [(0, '75.003')] [2024-08-06 07:14:12,845][52647] DAMAGECOUNT value on done: 884746.0 [2024-08-06 07:14:12,845][52647] Sum rewards: 75.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.044', 'AMMO4': '0.057', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '63.000'} [2024-08-06 07:14:13,522][52667] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon5', 0.002)] [2024-08-06 07:14:13,541][52668] DAMAGECOUNT value on done: 836174.0 [2024-08-06 07:14:13,541][52668] Sum rewards: 96.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '22.143', 'FRAGCOUNT': '78.000'} [2024-08-06 07:14:14,340][52664] DAMAGECOUNT value on done: 863682.0 [2024-08-06 07:14:14,340][52664] Sum rewards: 76.750, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.575', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO3': '0.177', 'weapon2': '0.428', 'WEAPON3': '1.100', 'HITCOUNT': '3.380', 'weapon3': '3.420', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '62.000'} [2024-08-06 07:14:14,367][52659] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:14:14,678][52667] DAMAGECOUNT value on done: 849287.0 [2024-08-06 07:14:14,678][52667] Sum rewards: 92.195, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.095', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'HEALTH': '0.260', 'weapon2': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.146', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.841', 'FRAGCOUNT': '73.000'} [2024-08-06 07:14:14,720][52660] DAMAGECOUNT value on done: 837811.0 [2024-08-06 07:14:14,721][52660] Sum rewards: 88.367, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.152', 'weapon2': '0.188', 'WEAPON3': '0.850', 'HEALTH': '0.992', 'weapon3': '3.590', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '70.000'} [2024-08-06 07:14:14,957][52662] DAMAGECOUNT value on done: 843593.0 [2024-08-06 07:14:14,958][52662] Sum rewards: 82.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.105', 'weapon5': '0.112', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.210', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:15,397][52647] DAMAGECOUNT value on done: 882951.0 [2024-08-06 07:14:15,397][52647] Sum rewards: 72.025, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.032', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.275', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '2.860', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 07:14:16,523][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:14:16,633][52668] DAMAGECOUNT value on done: 840606.0 [2024-08-06 07:14:16,636][52668] Sum rewards: 73.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO5': '0.023', 'AMMO2': '0.050', 'AMMO3': '0.175', 'weapon5': '0.214', 'AMMO4': '0.248', 'weapon4': '0.316', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.870', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '58.000'} [2024-08-06 07:14:16,955][52664] DAMAGECOUNT value on done: 859130.0 [2024-08-06 07:14:16,957][52664] Sum rewards: 82.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.225', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '69.000'} [2024-08-06 07:14:17,221][52650] Updated weights for policy 0, policy_version 74941 (0.0031) [2024-08-06 07:14:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 613924864. Throughput: 0: 4357.8. Samples: 153481400. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:14:17,795][52567] Avg episode reward: [(0, '75.484')] [2024-08-06 07:14:17,822][52662] DAMAGECOUNT value on done: 831324.0 [2024-08-06 07:14:17,824][52662] Sum rewards: 73.316, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.834', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.150', 'AMMO4': '0.194', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '60.000'} [2024-08-06 07:14:17,874][52647] DAMAGECOUNT value on done: 881180.0 [2024-08-06 07:14:17,875][52647] Sum rewards: 77.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.246', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.132', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '65.000'} [2024-08-06 07:14:18,045][52667] DAMAGECOUNT value on done: 849467.0 [2024-08-06 07:14:18,046][52667] Sum rewards: 73.955, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.706', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.176', 'AMMO3': '0.189', 'AMMO4': '0.258', 'weapon5': '0.370', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.590', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2024-08-06 07:14:18,098][52660] DAMAGECOUNT value on done: 849739.0 [2024-08-06 07:14:18,099][52660] Sum rewards: 81.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.799', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.082', 'weapon5': '0.154', 'AMMO3': '0.223', 'AMMO4': '0.250', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.058', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '69.000'} [2024-08-06 07:14:19,539][52664] DAMAGECOUNT value on done: 872398.0 [2024-08-06 07:14:19,539][52664] Sum rewards: 75.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.502', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.142', 'weapon4': '0.162', 'AMMO3': '0.214', 'AMMO4': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '61.000'} [2024-08-06 07:14:19,941][52668] DAMAGECOUNT value on done: 841297.0 [2024-08-06 07:14:19,942][52668] Sum rewards: 88.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.305', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.231', 'WEAPON3': '1.600', 'weapon3': '3.464', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.861', 'FRAGCOUNT': '73.000'} [2024-08-06 07:14:20,327][52647] DAMAGECOUNT value on done: 870407.0 [2024-08-06 07:14:20,327][52647] Sum rewards: 66.344, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.856', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.318', 'FRAGCOUNT': '55.000'} [2024-08-06 07:14:20,852][52662] DAMAGECOUNT value on done: 848182.0 [2024-08-06 07:14:20,855][52662] Sum rewards: 78.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON3': '1.250', 'HITCOUNT': '3.390', 'weapon3': '3.438', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '64.000'} [2024-08-06 07:14:20,945][52667] DAMAGECOUNT value on done: 846859.0 [2024-08-06 07:14:20,946][52667] Sum rewards: 79.683, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.305', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO3': '0.160', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '63.000'} [2024-08-06 07:14:20,983][52660] DAMAGECOUNT value on done: 830345.0 [2024-08-06 07:14:20,985][52660] Sum rewards: 68.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.515', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.102', 'AMMO4': '0.133', 'weapon5': '0.136', 'AMMO3': '0.152', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '56.000'} [2024-08-06 07:14:21,492][52650] Updated weights for policy 0, policy_version 74951 (0.0013) [2024-08-06 07:14:21,944][52664] DAMAGECOUNT value on done: 865975.0 [2024-08-06 07:14:21,945][52664] Sum rewards: 82.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.228', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.072', 'weapon5': '0.096', 'AMMO4': '0.110', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.318', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 07:14:22,518][52647] DAMAGECOUNT value on done: 887017.0 [2024-08-06 07:14:22,519][52647] Sum rewards: 66.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'AMMO5': '0.017', 'AMMO2': '0.063', 'weapon4': '0.114', 'weapon5': '0.228', 'AMMO3': '0.235', 'AMMO4': '0.314', 'weapon2': '0.348', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.982', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '58.000'} [2024-08-06 07:14:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 614014976. Throughput: 0: 4358.2. Samples: 153507490. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:14:22,794][52567] Avg episode reward: [(0, '75.616')] [2024-08-06 07:14:23,798][52662] DAMAGECOUNT value on done: 841170.0 [2024-08-06 07:14:23,799][52662] Sum rewards: 72.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.906', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.116', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '58.500'} [2024-08-06 07:14:23,838][52667] DAMAGECOUNT value on done: 843000.0 [2024-08-06 07:14:23,838][52667] Sum rewards: 69.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.200', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.086', 'weapon5': '0.132', 'AMMO3': '0.226', 'AMMO4': '0.270', 'weapon2': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '58.000'} [2024-08-06 07:14:24,126][52664] DAMAGECOUNT value on done: 877210.0 [2024-08-06 07:14:24,126][52664] Sum rewards: 72.378, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.601', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.192', 'AMMO3': '0.239', 'AMMO4': '0.248', 'weapon2': '0.266', 'weapon5': '0.288', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '61.000'} [2024-08-06 07:14:24,200][52660] DAMAGECOUNT value on done: 828683.0 [2024-08-06 07:14:24,202][52660] Sum rewards: 89.749, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.312', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.110', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon4': '0.214', 'weapon2': '0.232', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.519', 'FRAGCOUNT': '71.000'} [2024-08-06 07:14:24,884][52647] DAMAGECOUNT value on done: 875026.0 [2024-08-06 07:14:24,884][52647] Sum rewards: 82.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.435', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.094', 'AMMO4': '0.117', 'weapon5': '0.136', 'AMMO3': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '0.950', 'weapon3': '3.258', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '64.000'} [2024-08-06 07:14:26,478][52650] Updated weights for policy 0, policy_version 74961 (0.0017) [2024-08-06 07:14:26,640][52664] DAMAGECOUNT value on done: 874461.0 [2024-08-06 07:14:26,640][52664] Sum rewards: 70.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.180', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 07:14:26,767][52667] DAMAGECOUNT value on done: 839199.0 [2024-08-06 07:14:26,769][52667] Sum rewards: 76.867, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.261', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.332', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:27,038][52662] DAMAGECOUNT value on done: 825730.0 [2024-08-06 07:14:27,038][52662] Sum rewards: 84.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.075', 'weapon5': '0.086', 'weapon2': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'weapon3': '3.626', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '68.000'} [2024-08-06 07:14:27,252][52647] DAMAGECOUNT value on done: 884942.0 [2024-08-06 07:14:27,253][52647] Sum rewards: 81.913, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.434', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon5': '0.212', 'weapon4': '0.222', 'AMMO3': '0.235', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '68.000'} [2024-08-06 07:14:27,267][52660] DAMAGECOUNT value on done: 835219.0 [2024-08-06 07:14:27,267][52660] Sum rewards: 82.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.132', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.720', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '69.000'} [2024-08-06 07:14:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 614105088. Throughput: 0: 4358.4. Samples: 153533350. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:14:27,794][52567] Avg episode reward: [(0, '76.129')] [2024-08-06 07:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074964_614105088.pth... [2024-08-06 07:14:27,959][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074453_609918976.pth [2024-08-06 07:14:28,378][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:14:29,103][52664] DAMAGECOUNT value on done: 873948.0 [2024-08-06 07:14:29,103][52664] Sum rewards: 81.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.284', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.138', 'AMMO4': '0.219', 'weapon5': '0.232', 'AMMO3': '0.238', 'weapon2': '0.238', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '68.000'} [2024-08-06 07:14:29,545][52659] DAMAGECOUNT value on done: 839038.0 [2024-08-06 07:14:29,548][52659] Sum rewards: 75.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.179', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.208', 'weapon2': '0.284', 'WEAPON3': '1.350', 'HITCOUNT': '3.420', 'weapon3': '3.466', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '62.000'} [2024-08-06 07:14:29,794][52647] DAMAGECOUNT value on done: 885131.0 [2024-08-06 07:14:29,795][52647] Sum rewards: 78.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.582', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.214', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.326', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '64.000'} [2024-08-06 07:14:30,043][52667] DAMAGECOUNT value on done: 841579.0 [2024-08-06 07:14:30,043][52667] Sum rewards: 77.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.516', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.174', 'weapon2': '0.178', 'AMMO3': '0.228', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '63.000'} [2024-08-06 07:14:30,049][52660] DAMAGECOUNT value on done: 842907.0 [2024-08-06 07:14:30,050][52660] Sum rewards: 80.168, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.046', 'weapon4': '0.090', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:30,261][52662] DAMAGECOUNT value on done: 835434.0 [2024-08-06 07:14:30,263][52662] Sum rewards: 76.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.823', 'AMMO5': '0.014', 'AMMO2': '0.063', 'weapon5': '0.116', 'weapon4': '0.144', 'AMMO3': '0.225', 'AMMO4': '0.317', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.694', 'WEAPON3': '1.350', 'weapon3': '2.774', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '63.000'} [2024-08-06 07:14:30,959][52650] Updated weights for policy 0, policy_version 74971 (0.0018) [2024-08-06 07:14:31,500][52664] DAMAGECOUNT value on done: 884777.0 [2024-08-06 07:14:31,500][52664] Sum rewards: 83.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.390', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.036', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.202', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '67.000'} [2024-08-06 07:14:32,172][52647] DAMAGECOUNT value on done: 871897.0 [2024-08-06 07:14:32,173][52647] Sum rewards: 80.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.084', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.120', 'AMMO4': '0.171', 'weapon2': '0.176', 'weapon5': '0.186', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '67.000'} [2024-08-06 07:14:32,406][52659] DAMAGECOUNT value on done: 836006.0 [2024-08-06 07:14:32,408][52659] Sum rewards: 84.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.455', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.147', 'weapon2': '0.214', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.900', 'weapon3': '3.336', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.733', 'FRAGCOUNT': '73.000'} [2024-08-06 07:14:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 614187008. Throughput: 0: 4354.4. Samples: 153546280. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:14:32,794][52567] Avg episode reward: [(0, '76.123')] [2024-08-06 07:14:33,149][52667] DAMAGECOUNT value on done: 846504.0 [2024-08-06 07:14:33,149][52667] Sum rewards: 80.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.158', 'weapon4': '0.196', 'AMMO3': '0.227', 'AMMO4': '0.234', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '65.000'} [2024-08-06 07:14:33,260][52662] DAMAGECOUNT value on done: 828446.0 [2024-08-06 07:14:33,260][52662] Sum rewards: 68.287, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.320', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.058', 'AMMO4': '0.060', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.524', 'WEAPON3': '1.550', 'weapon3': '3.110', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '59.000'} [2024-08-06 07:14:33,437][52660] DAMAGECOUNT value on done: 829337.0 [2024-08-06 07:14:33,440][52660] Sum rewards: 81.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.186', 'AMMO4': '0.201', 'weapon5': '0.204', 'weapon2': '0.284', 'weapon4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '65.000'} [2024-08-06 07:14:34,226][52664] DAMAGECOUNT value on done: 880615.0 [2024-08-06 07:14:34,226][52664] Sum rewards: 63.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.024', 'AMMO2': '0.063', 'AMMO3': '0.170', 'weapon4': '0.194', 'AMMO4': '0.315', 'weapon5': '0.332', 'weapon2': '0.464', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '51.000'} [2024-08-06 07:14:34,289][52659] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:14:34,693][52647] DAMAGECOUNT value on done: 876362.0 [2024-08-06 07:14:34,694][52647] Sum rewards: 81.875, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.675', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.129', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.386', 'weapon2': '0.394', 'WEAPON3': '0.900', 'weapon3': '2.852', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '65.000'} [2024-08-06 07:14:35,217][52659] DAMAGECOUNT value on done: 842909.0 [2024-08-06 07:14:35,217][52659] Sum rewards: 66.718, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.665', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.082', 'AMMO3': '0.239', 'AMMO4': '0.254', 'weapon5': '0.258', 'weapon2': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '56.500'} [2024-08-06 07:14:35,931][52667] DAMAGECOUNT value on done: 835171.0 [2024-08-06 07:14:35,937][52667] Sum rewards: 68.126, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.937', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.090', 'AMMO4': '0.135', 'AMMO3': '0.167', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '56.000'} [2024-08-06 07:14:35,987][52650] Updated weights for policy 0, policy_version 74981 (0.0026) [2024-08-06 07:14:36,402][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:14:36,654][52660] DAMAGECOUNT value on done: 828929.0 [2024-08-06 07:14:36,654][52660] Sum rewards: 79.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.756', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.118', 'AMMO4': '0.129', 'weapon4': '0.158', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:36,687][52664] DAMAGECOUNT value on done: 879002.0 [2024-08-06 07:14:36,687][52664] Sum rewards: 72.099, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.051', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.114', 'weapon5': '0.134', 'AMMO4': '0.196', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.345', 'WEAPON3': '2.100', 'weapon3': '3.224', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '63.000'} [2024-08-06 07:14:37,388][52647] DAMAGECOUNT value on done: 869444.0 [2024-08-06 07:14:37,390][52647] Sum rewards: 81.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon4': '0.306', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 614277120. Throughput: 0: 4355.3. Samples: 153572660. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:14:37,794][52567] Avg episode reward: [(0, '76.193')] [2024-08-06 07:14:38,213][52659] DAMAGECOUNT value on done: 839133.0 [2024-08-06 07:14:38,213][52659] Sum rewards: 95.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.386', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.047', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.408', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.648', 'FRAGCOUNT': '79.000'} [2024-08-06 07:14:38,651][52667] DAMAGECOUNT value on done: 840133.0 [2024-08-06 07:14:38,654][52667] Sum rewards: 85.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.844', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.128', 'AMMO4': '0.213', 'weapon5': '0.228', 'AMMO3': '0.252', 'weapon2': '0.274', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '72.000'} [2024-08-06 07:14:39,543][52664] DAMAGECOUNT value on done: 865071.0 [2024-08-06 07:14:39,545][52664] Sum rewards: 75.618, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.510', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.070', 'weapon5': '0.194', 'AMMO4': '0.244', 'weapon2': '0.256', 'AMMO3': '0.291', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.234', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '64.000'} [2024-08-06 07:14:39,752][52660] DAMAGECOUNT value on done: 839542.0 [2024-08-06 07:14:39,754][52660] Sum rewards: 69.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.632', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.295', 'weapon2': '0.476', 'WEAPON3': '1.800', 'weapon3': '3.226', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '60.000'} [2024-08-06 07:14:40,213][52647] DAMAGECOUNT value on done: 873808.0 [2024-08-06 07:14:40,213][52647] Sum rewards: 67.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.678', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.312', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.412', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '55.000'} [2024-08-06 07:14:40,336][52650] Updated weights for policy 0, policy_version 74991 (0.0011) [2024-08-06 07:14:40,959][52659] DAMAGECOUNT value on done: 837126.0 [2024-08-06 07:14:40,967][52659] Sum rewards: 70.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.105', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.064', 'weapon5': '0.184', 'AMMO3': '0.235', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.500'} [2024-08-06 07:14:41,732][52667] DAMAGECOUNT value on done: 848114.0 [2024-08-06 07:14:41,733][52667] Sum rewards: 76.309, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.260', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:42,196][52664] DAMAGECOUNT value on done: 869481.0 [2024-08-06 07:14:42,197][52664] Sum rewards: 76.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.931', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.061', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '64.000'} [2024-08-06 07:14:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 614359040. Throughput: 0: 4354.7. Samples: 153598820. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:14:42,794][52567] Avg episode reward: [(0, '76.492')] [2024-08-06 07:14:42,795][52614] Saving new best policy, reward=76.492! [2024-08-06 07:14:42,998][52660] DAMAGECOUNT value on done: 828135.0 [2024-08-06 07:14:42,999][52660] Sum rewards: 80.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.361', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.696', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:43,768][52659] DAMAGECOUNT value on done: 837054.0 [2024-08-06 07:14:43,770][52659] Sum rewards: 79.527, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.214', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:44,408][52667] DAMAGECOUNT value on done: 836483.0 [2024-08-06 07:14:44,409][52667] Sum rewards: 78.996, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.016', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.152', 'weapon2': '0.730', 'WEAPON3': '1.000', 'weapon3': '3.098', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '62.000'} [2024-08-06 07:14:45,021][52664] DAMAGECOUNT value on done: 871109.0 [2024-08-06 07:14:45,021][52664] Sum rewards: 64.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.213', 'AMMO4': '0.256', 'weapon4': '0.268', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '2.538', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '55.000'} [2024-08-06 07:14:45,226][52650] Updated weights for policy 0, policy_version 75001 (0.0020) [2024-08-06 07:14:45,809][52660] DAMAGECOUNT value on done: 832505.0 [2024-08-06 07:14:45,811][52660] Sum rewards: 67.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.213', 'weapon5': '0.222', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '2.660', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '56.000'} [2024-08-06 07:14:46,427][52659] DAMAGECOUNT value on done: 840421.0 [2024-08-06 07:14:46,427][52659] Sum rewards: 82.694, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.166', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.084', 'weapon5': '0.142', 'AMMO4': '0.147', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '69.000'} [2024-08-06 07:14:47,466][52667] DAMAGECOUNT value on done: 843847.0 [2024-08-06 07:14:47,466][52667] Sum rewards: 77.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.254', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.456', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '65.000'} [2024-08-06 07:14:47,698][52664] DAMAGECOUNT value on done: 864450.0 [2024-08-06 07:14:47,698][52664] Sum rewards: 68.781, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.185', 'AMMO3': '0.247', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '56.000'} [2024-08-06 07:14:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 614449152. Throughput: 0: 4349.1. Samples: 153611750. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:14:47,794][52567] Avg episode reward: [(0, '76.408')] [2024-08-06 07:14:48,326][52660] DAMAGECOUNT value on done: 844409.0 [2024-08-06 07:14:48,326][52660] Sum rewards: 64.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.136', 'AMMO4': '0.165', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.240', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '55.000'} [2024-08-06 07:14:49,241][52659] DAMAGECOUNT value on done: 838371.0 [2024-08-06 07:14:49,241][52659] Sum rewards: 60.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon2': '0.196', 'AMMO4': '0.241', 'AMMO3': '0.256', 'weapon5': '0.314', 'weapon4': '0.382', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.790', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '52.000'} [2024-08-06 07:14:49,883][52650] Updated weights for policy 0, policy_version 75011 (0.0012) [2024-08-06 07:14:50,317][52667] DAMAGECOUNT value on done: 849717.0 [2024-08-06 07:14:50,318][52667] Sum rewards: 94.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.256', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.148', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.270', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '22.047', 'FRAGCOUNT': '76.000'} [2024-08-06 07:14:51,130][52660] DAMAGECOUNT value on done: 855016.0 [2024-08-06 07:14:51,132][52660] Sum rewards: 92.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.277', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.164', 'AMMO4': '0.171', 'weapon5': '0.184', 'weapon4': '0.218', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.768', 'FRAGCOUNT': '75.000'} [2024-08-06 07:14:52,021][52659] DAMAGECOUNT value on done: 840010.0 [2024-08-06 07:14:52,023][52659] Sum rewards: 75.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '62.000'} [2024-08-06 07:14:52,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 614531072. Throughput: 0: 4336.2. Samples: 153637400. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:14:52,795][52567] Avg episode reward: [(0, '76.487')] [2024-08-06 07:14:53,587][52667] DAMAGECOUNT value on done: 850417.0 [2024-08-06 07:14:53,588][52667] Sum rewards: 85.229, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.780', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.132', 'weapon4': '0.140', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.000', 'weapon3': '3.254', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:54,188][52660] DAMAGECOUNT value on done: 831643.0 [2024-08-06 07:14:54,190][52660] Sum rewards: 78.164, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.068', 'AMMO5': '0.007', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.342', 'weapon2': '0.538', 'WEAPON3': '0.950', 'weapon3': '2.814', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '61.000'} [2024-08-06 07:14:54,650][52650] Updated weights for policy 0, policy_version 75021 (0.0018) [2024-08-06 07:14:54,801][52659] DAMAGECOUNT value on done: 847122.0 [2024-08-06 07:14:54,803][52659] Sum rewards: 79.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.305', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.182', 'AMMO3': '0.192', 'AMMO4': '0.211', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '66.000'} [2024-08-06 07:14:56,590][52667] DAMAGECOUNT value on done: 845058.0 [2024-08-06 07:14:56,592][52667] Sum rewards: 73.452, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.910', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO3': '0.143', 'weapon5': '0.160', 'AMMO4': '0.176', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.766', 'WEAPON3': '0.950', 'weapon3': '2.834', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 07:14:57,315][52660] DAMAGECOUNT value on done: 839054.0 [2024-08-06 07:14:57,315][52660] Sum rewards: 70.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.750', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.082', 'AMMO4': '0.151', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.286', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '60.000'} [2024-08-06 07:14:57,698][52659] DAMAGECOUNT value on done: 832451.0 [2024-08-06 07:14:57,701][52659] Sum rewards: 65.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.774', 'AMMO5': '0.014', 'AMMO2': '0.063', 'weapon2': '0.160', 'weapon5': '0.186', 'AMMO3': '0.265', 'AMMO4': '0.317', 'weapon4': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.004', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '56.000'} [2024-08-06 07:14:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 614621184. Throughput: 0: 4348.5. Samples: 153663910. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:14:57,794][52567] Avg episode reward: [(0, '76.426')] [2024-08-06 07:14:58,720][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:14:59,182][52650] Updated weights for policy 0, policy_version 75031 (0.0037) [2024-08-06 07:14:59,371][52667] DAMAGECOUNT value on done: 843550.0 [2024-08-06 07:14:59,371][52667] Sum rewards: 73.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.018', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.216', 'weapon4': '0.244', 'weapon5': '0.252', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.790', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:00,313][52660] DAMAGECOUNT value on done: 835906.0 [2024-08-06 07:15:00,315][52660] Sum rewards: 78.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.804', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.106', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'WEAPON3': '1.200', 'weapon3': '3.562', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:00,828][52659] DAMAGECOUNT value on done: 842696.0 [2024-08-06 07:15:00,828][52659] Sum rewards: 88.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.006', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.124', 'weapon4': '0.154', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.206', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '72.000'} [2024-08-06 07:15:01,526][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:15:01,878][52794] Large shaping reward 2.752 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 07:15:02,334][52667] DAMAGECOUNT value on done: 849098.0 [2024-08-06 07:15:02,335][52667] Sum rewards: 74.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.466', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.068', 'weapon5': '0.082', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '61.000'} [2024-08-06 07:15:02,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 614711296. Throughput: 0: 4345.6. Samples: 153676950. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:15:02,794][52567] Avg episode reward: [(0, '76.605')] [2024-08-06 07:15:02,795][52614] Saving new best policy, reward=76.605! [2024-08-06 07:15:02,982][52660] DAMAGECOUNT value on done: 827931.0 [2024-08-06 07:15:02,984][52660] Sum rewards: 69.457, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.598', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO3': '0.158', 'AMMO4': '0.168', 'weapon5': '0.218', 'weapon4': '0.222', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '54.000'} [2024-08-06 07:15:03,378][52803] Large shaping reward 2.640 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:15:03,480][52614] Signal inference workers to stop experience collection... (13700 times) [2024-08-06 07:15:03,481][52614] Signal inference workers to resume experience collection... (13700 times) [2024-08-06 07:15:03,551][52650] InferenceWorker_p0-w0: stopping experience collection (13700 times) [2024-08-06 07:15:03,551][52650] InferenceWorker_p0-w0: resuming experience collection (13700 times) [2024-08-06 07:15:03,904][52659] DAMAGECOUNT value on done: 837192.0 [2024-08-06 07:15:03,905][52659] Sum rewards: 68.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.276', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.161', 'weapon7': '0.170', 'weapon5': '0.192', 'AMMO4': '0.214', 'weapon4': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.000', 'weapon3': '2.282', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.699', 'FRAGCOUNT': '57.000'} [2024-08-06 07:15:04,388][52650] Updated weights for policy 0, policy_version 75041 (0.0021) [2024-08-06 07:15:05,217][52811] DAMAGECOUNT value on done: 797649.0 [2024-08-06 07:15:05,219][52811] Sum rewards: 72.615, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.478', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:05,954][52660] DAMAGECOUNT value on done: 827757.0 [2024-08-06 07:15:05,954][52660] Sum rewards: 81.105, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.520', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.134', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.326', 'weapon2': '0.634', 'WEAPON3': '0.900', 'weapon3': '2.730', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:06,959][52659] DAMAGECOUNT value on done: 838395.0 [2024-08-06 07:15:06,961][52659] Sum rewards: 66.592, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.397', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'AMMO4': '0.196', 'WEAPON7': '0.200', 'WEAPON4': '0.250', 'weapon7': '0.256', 'weapon4': '0.302', 'weapon2': '0.388', 'WEAPON3': '1.000', 'weapon3': '2.590', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '53.000'} [2024-08-06 07:15:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 614793216. Throughput: 0: 4340.7. Samples: 153702820. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:15:07,794][52567] Avg episode reward: [(0, '76.626')] [2024-08-06 07:15:07,798][52614] Saving new best policy, reward=76.626! [2024-08-06 07:15:08,299][52811] DAMAGECOUNT value on done: 781847.0 [2024-08-06 07:15:08,299][52811] Sum rewards: 76.331, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.471', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.159', 'weapon5': '0.172', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.130', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '64.500'} [2024-08-06 07:15:08,706][52650] Updated weights for policy 0, policy_version 75051 (0.0034) [2024-08-06 07:15:10,060][52659] DAMAGECOUNT value on done: 840767.0 [2024-08-06 07:15:10,061][52659] Sum rewards: 75.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.094', 'AMMO4': '0.146', 'weapon5': '0.222', 'AMMO3': '0.241', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.146', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:10,497][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:15:11,329][52794] DAMAGECOUNT value on done: 834494.0 [2024-08-06 07:15:11,331][52794] Sum rewards: 74.281, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.910', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.058', 'weapon4': '0.128', 'weapon2': '0.212', 'AMMO4': '0.224', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.354', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '63.500'} [2024-08-06 07:15:11,417][52811] DAMAGECOUNT value on done: 775735.0 [2024-08-06 07:15:11,419][52811] Sum rewards: 64.242, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.151', 'AMMO3': '0.168', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.826', 'WEAPON3': '1.050', 'weapon3': '2.758', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '52.000'} [2024-08-06 07:15:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 614883328. Throughput: 0: 4350.4. Samples: 153729120. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:15:12,794][52567] Avg episode reward: [(0, '76.564')] [2024-08-06 07:15:12,952][52659] DAMAGECOUNT value on done: 840084.0 [2024-08-06 07:15:12,952][52659] Sum rewards: 82.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.784', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.142', 'AMMO3': '0.163', 'weapon4': '0.190', 'AMMO4': '0.211', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:13,911][52650] Updated weights for policy 0, policy_version 75061 (0.0019) [2024-08-06 07:15:14,081][52794] DAMAGECOUNT value on done: 842779.0 [2024-08-06 07:15:14,081][52794] Sum rewards: 83.020, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.066', 'AMMO3': '0.169', 'weapon5': '0.174', 'AMMO4': '0.178', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.276', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '65.000'} [2024-08-06 07:15:14,213][52662] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:15:14,566][52811] DAMAGECOUNT value on done: 778643.0 [2024-08-06 07:15:14,567][52811] Sum rewards: 88.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.120', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '73.000'} [2024-08-06 07:15:15,845][52658] DAMAGECOUNT value on done: 839568.0 [2024-08-06 07:15:15,845][52658] Sum rewards: 74.119, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.499', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.096', 'AMMO4': '0.107', 'weapon5': '0.138', 'AMMO3': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '0.900', 'weapon3': '3.124', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '58.000'} [2024-08-06 07:15:16,027][52659] DAMAGECOUNT value on done: 849282.0 [2024-08-06 07:15:16,030][52659] Sum rewards: 77.030, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.128', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:16,361][52659] Large shaping reward 2.513 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.108, -36.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:15:17,048][52794] DAMAGECOUNT value on done: 848181.0 [2024-08-06 07:15:17,050][52794] Sum rewards: 68.798, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.134', 'weapon2': '0.174', 'AMMO4': '0.200', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.528', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '54.000'} [2024-08-06 07:15:17,601][52811] DAMAGECOUNT value on done: 782554.0 [2024-08-06 07:15:17,602][52811] Sum rewards: 58.318, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.462', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.176', 'AMMO4': '0.195', 'AMMO3': '0.258', 'weapon2': '0.272', 'weapon5': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '2.850', 'weapon3': '2.876', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '51.000'} [2024-08-06 07:15:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 614973440. Throughput: 0: 4351.8. Samples: 153742110. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 07:15:17,794][52567] Avg episode reward: [(0, '76.819')] [2024-08-06 07:15:17,798][52614] Saving new best policy, reward=76.819! [2024-08-06 07:15:18,149][52650] Updated weights for policy 0, policy_version 75071 (0.0040) [2024-08-06 07:15:19,104][52659] DAMAGECOUNT value on done: 833348.0 [2024-08-06 07:15:19,104][52659] Sum rewards: 75.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.019', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon4': '0.096', 'weapon5': '0.158', 'AMMO3': '0.256', 'weapon2': '0.256', 'AMMO4': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:19,118][52658] DAMAGECOUNT value on done: 843141.0 [2024-08-06 07:15:19,118][52658] Sum rewards: 74.238, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.340', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.142', 'AMMO4': '0.172', 'weapon2': '0.284', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.220', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '65.000'} [2024-08-06 07:15:20,340][52794] DAMAGECOUNT value on done: 835062.0 [2024-08-06 07:15:20,341][52794] Sum rewards: 78.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.082', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:20,632][52811] DAMAGECOUNT value on done: 794716.0 [2024-08-06 07:15:20,632][52811] Sum rewards: 70.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.108', 'weapon5': '0.182', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '58.500'} [2024-08-06 07:15:20,758][52649] DAMAGECOUNT value on done: 814221.0 [2024-08-06 07:15:20,758][52649] Sum rewards: 80.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.205', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.330', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '67.000'} [2024-08-06 07:15:21,538][52659] DAMAGECOUNT value on done: 844005.0 [2024-08-06 07:15:21,538][52659] Sum rewards: 78.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.130', 'weapon5': '0.174', 'AMMO4': '0.192', 'AMMO3': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:22,257][52658] DAMAGECOUNT value on done: 845900.0 [2024-08-06 07:15:22,258][52658] Sum rewards: 69.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.018', 'AMMO2': '0.073', 'weapon4': '0.134', 'AMMO3': '0.246', 'weapon5': '0.246', 'WEAPON4': '0.350', 'AMMO4': '0.365', 'weapon2': '0.410', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 07:15:22,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 615047168. Throughput: 0: 4340.4. Samples: 153767980. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:22,795][52567] Avg episode reward: [(0, '76.359')] [2024-08-06 07:15:23,240][52650] Updated weights for policy 0, policy_version 75081 (0.0021) [2024-08-06 07:15:23,323][52794] DAMAGECOUNT value on done: 830284.0 [2024-08-06 07:15:23,324][52794] Sum rewards: 60.712, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.125', 'weapon5': '0.180', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.336', 'DAMAGECOUNT': '14.799', 'FRAGCOUNT': '54.000'} [2024-08-06 07:15:23,565][52811] DAMAGECOUNT value on done: 788735.0 [2024-08-06 07:15:23,566][52811] Sum rewards: 77.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.070', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.152', 'AMMO3': '0.212', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.486', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:23,941][52649] DAMAGECOUNT value on done: 808149.0 [2024-08-06 07:15:23,942][52649] Sum rewards: 77.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.835', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:24,615][52659] DAMAGECOUNT value on done: 836940.0 [2024-08-06 07:15:24,616][52659] Sum rewards: 67.903, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.430', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.040', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.163', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.946', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '54.000'} [2024-08-06 07:15:24,655][52649] Large shaping reward 2.543 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.08700000000000001, -29.0)] [2024-08-06 07:15:24,796][52658] DAMAGECOUNT value on done: 841930.0 [2024-08-06 07:15:24,798][52658] Sum rewards: 77.044, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.940', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.174', 'AMMO4': '0.191', 'weapon4': '0.222', 'AMMO3': '0.290', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.002', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:26,765][52811] DAMAGECOUNT value on done: 779967.0 [2024-08-06 07:15:26,766][52811] Sum rewards: 80.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.588', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.080', 'AMMO4': '0.119', 'AMMO3': '0.183', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.466', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.391', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:26,845][52794] DAMAGECOUNT value on done: 838592.0 [2024-08-06 07:15:26,845][52794] Sum rewards: 71.359, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.594', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.188', 'AMMO4': '0.207', 'AMMO3': '0.214', 'weapon4': '0.282', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.782', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:27,115][52649] DAMAGECOUNT value on done: 824784.0 [2024-08-06 07:15:27,119][52649] Sum rewards: 70.275, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.488', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.062', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'weapon2': '0.706', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:27,338][52658] DAMAGECOUNT value on done: 837162.0 [2024-08-06 07:15:27,338][52658] Sum rewards: 62.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.120', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '51.000'} [2024-08-06 07:15:27,698][52650] Updated weights for policy 0, policy_version 75091 (0.0025) [2024-08-06 07:15:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.4). Total num frames: 615145472. Throughput: 0: 4341.8. Samples: 153794200. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:27,794][52567] Avg episode reward: [(0, '75.763')] [2024-08-06 07:15:29,903][52794] DAMAGECOUNT value on done: 843419.0 [2024-08-06 07:15:29,905][52794] Sum rewards: 80.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.457', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.164', 'weapon4': '0.172', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.344', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '67.000'} [2024-08-06 07:15:30,011][52811] DAMAGECOUNT value on done: 788204.0 [2024-08-06 07:15:30,012][52811] Sum rewards: 75.977, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.254', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.032', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.496', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:30,017][52658] DAMAGECOUNT value on done: 832099.0 [2024-08-06 07:15:30,018][52658] Sum rewards: 73.532, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.200', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon5': '0.202', 'AMMO4': '0.222', 'AMMO3': '0.267', 'weapon4': '0.310', 'weapon2': '0.512', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.598', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '65.000'} [2024-08-06 07:15:30,403][52649] DAMAGECOUNT value on done: 819802.0 [2024-08-06 07:15:30,406][52649] Sum rewards: 78.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.584', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.190', 'AMMO3': '0.201', 'weapon5': '0.240', 'AMMO4': '0.278', 'weapon2': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:32,167][52794] DAMAGECOUNT value on done: 830136.0 [2024-08-06 07:15:32,167][52794] Sum rewards: 74.379, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.196', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.255', 'weapon2': '0.656', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:32,328][52650] Updated weights for policy 0, policy_version 75101 (0.0045) [2024-08-06 07:15:32,533][52669] DAMAGECOUNT value on done: 842024.0 [2024-08-06 07:15:32,533][52669] Sum rewards: 89.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.194', 'AMMO4': '0.199', 'weapon2': '0.212', 'AMMO3': '0.248', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.603', 'FRAGCOUNT': '73.000'} [2024-08-06 07:15:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 615227392. Throughput: 0: 4342.4. Samples: 153807160. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:32,794][52567] Avg episode reward: [(0, '75.918')] [2024-08-06 07:15:33,104][52658] DAMAGECOUNT value on done: 845050.0 [2024-08-06 07:15:33,105][52811] DAMAGECOUNT value on done: 786468.0 [2024-08-06 07:15:33,105][52658] Sum rewards: 72.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.436', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2024-08-06 07:15:33,107][52811] Sum rewards: 73.268, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.558', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.073', 'weapon5': '0.090', 'WEAPON4': '0.150', 'weapon2': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.386', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:33,239][52649] DAMAGECOUNT value on done: 811121.0 [2024-08-06 07:15:33,240][52649] Sum rewards: 77.718, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.776', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:34,861][52794] DAMAGECOUNT value on done: 840046.0 [2024-08-06 07:15:34,863][52794] Sum rewards: 69.079, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.644', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.166', 'weapon2': '0.170', 'AMMO3': '0.255', 'weapon4': '0.270', 'AMMO4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:34,900][52663] DAMAGECOUNT value on done: 855914.0 [2024-08-06 07:15:34,900][52663] Sum rewards: 87.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.801', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.140', 'weapon5': '0.160', 'AMMO4': '0.188', 'AMMO3': '0.216', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.462', 'FRAGCOUNT': '70.000'} [2024-08-06 07:15:35,114][52669] DAMAGECOUNT value on done: 834040.0 [2024-08-06 07:15:35,116][52669] Sum rewards: 76.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'AMMO3': '0.199', 'weapon2': '0.234', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:35,606][52658] DAMAGECOUNT value on done: 830986.0 [2024-08-06 07:15:35,607][52658] Sum rewards: 78.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.328', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:36,204][52811] DAMAGECOUNT value on done: 788998.0 [2024-08-06 07:15:36,205][52811] Sum rewards: 74.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'AMMO5': '0.025', 'AMMO2': '0.054', 'weapon4': '0.126', 'weapon5': '0.178', 'AMMO3': '0.188', 'AMMO4': '0.271', 'weapon2': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:36,568][52649] DAMAGECOUNT value on done: 822152.0 [2024-08-06 07:15:36,570][52649] Sum rewards: 71.386, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.426', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.184', 'weapon2': '0.304', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.578', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:37,160][52650] Updated weights for policy 0, policy_version 75111 (0.0014) [2024-08-06 07:15:37,267][52794] DAMAGECOUNT value on done: 836934.0 [2024-08-06 07:15:37,269][52794] Sum rewards: 80.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.126', 'weapon4': '0.136', 'AMMO3': '0.183', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.174', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:37,320][52663] DAMAGECOUNT value on done: 841023.0 [2024-08-06 07:15:37,323][52663] Sum rewards: 71.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.262', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.092', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.356', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.278', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:37,569][52669] DAMAGECOUNT value on done: 846524.0 [2024-08-06 07:15:37,569][52669] Sum rewards: 54.787, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.270', 'AMMO5': '0.013', 'AMMO2': '0.050', 'AMMO3': '0.179', 'weapon5': '0.232', 'AMMO4': '0.252', 'weapon2': '0.258', 'weapon4': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '2.918', 'DAMAGECOUNT': '14.490', 'FRAGCOUNT': '43.000'} [2024-08-06 07:15:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 615317504. Throughput: 0: 4355.8. Samples: 153833410. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:37,795][52567] Avg episode reward: [(0, '75.479')] [2024-08-06 07:15:38,922][52658] DAMAGECOUNT value on done: 860286.0 [2024-08-06 07:15:38,922][52658] Sum rewards: 72.952, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.464', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:39,170][52649] DAMAGECOUNT value on done: 819642.0 [2024-08-06 07:15:39,173][52649] Sum rewards: 75.737, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.660', 'AMMO5': '0.018', 'AMMO2': '0.065', 'weapon4': '0.090', 'weapon5': '0.220', 'AMMO3': '0.265', 'weapon2': '0.292', 'AMMO4': '0.325', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '65.000'} [2024-08-06 07:15:39,386][52811] DAMAGECOUNT value on done: 795932.0 [2024-08-06 07:15:39,386][52811] Sum rewards: 81.354, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.361', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.160', 'weapon4': '0.184', 'AMMO4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '68.000'} [2024-08-06 07:15:39,783][52663] DAMAGECOUNT value on done: 836223.0 [2024-08-06 07:15:39,784][52663] Sum rewards: 79.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.542', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon5': '0.112', 'AMMO4': '0.130', 'AMMO3': '0.207', 'weapon4': '0.256', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:39,821][52794] DAMAGECOUNT value on done: 829832.0 [2024-08-06 07:15:39,821][52794] Sum rewards: 70.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.727', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.120', 'weapon4': '0.154', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.344', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:39,970][52669] DAMAGECOUNT value on done: 840523.0 [2024-08-06 07:15:39,972][52669] Sum rewards: 77.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.364', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '62.500'} [2024-08-06 07:15:40,977][52665] DAMAGECOUNT value on done: 827399.0 [2024-08-06 07:15:40,978][52665] Sum rewards: 75.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.442', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.037', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.258', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:41,689][52650] Updated weights for policy 0, policy_version 75121 (0.0021) [2024-08-06 07:15:41,806][52658] DAMAGECOUNT value on done: 843694.0 [2024-08-06 07:15:41,806][52658] Sum rewards: 69.968, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.999', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon4': '0.288', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '58.000'} [2024-08-06 07:15:42,320][52649] DAMAGECOUNT value on done: 822227.0 [2024-08-06 07:15:42,322][52649] Sum rewards: 68.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.728', 'AMMO5': '0.026', 'AMMO2': '0.084', 'weapon4': '0.154', 'weapon5': '0.252', 'AMMO3': '0.257', 'weapon2': '0.350', 'AMMO4': '0.421', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.912', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:42,396][52811] DAMAGECOUNT value on done: 786071.0 [2024-08-06 07:15:42,396][52811] Sum rewards: 76.467, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.570', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.156', 'AMMO4': '0.187', 'weapon5': '0.262', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.642', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:42,555][52663] DAMAGECOUNT value on done: 838107.0 [2024-08-06 07:15:42,558][52663] Sum rewards: 74.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.147', 'AMMO5': '0.020', 'AMMO2': '0.067', 'weapon4': '0.174', 'AMMO3': '0.198', 'weapon5': '0.296', 'AMMO4': '0.336', 'weapon2': '0.408', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.880', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:42,591][52794] DAMAGECOUNT value on done: 841570.0 [2024-08-06 07:15:42,592][52794] Sum rewards: 80.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.394', 'AMMO5': '0.021', 'AMMO2': '0.064', 'AMMO3': '0.183', 'weapon2': '0.316', 'AMMO4': '0.320', 'weapon4': '0.326', 'weapon5': '0.328', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 615407616. Throughput: 0: 4351.1. Samples: 153859710. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:42,795][52567] Avg episode reward: [(0, '75.016')] [2024-08-06 07:15:42,878][52669] DAMAGECOUNT value on done: 846510.0 [2024-08-06 07:15:42,878][52669] Sum rewards: 70.523, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.226', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.124', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:43,352][52671] DAMAGECOUNT value on done: 846578.0 [2024-08-06 07:15:43,354][52671] Sum rewards: 87.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.825', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.205', 'AMMO4': '0.208', 'weapon4': '0.224', 'weapon5': '0.226', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '69.000'} [2024-08-06 07:15:44,175][52665] DAMAGECOUNT value on done: 843836.0 [2024-08-06 07:15:44,176][52665] Sum rewards: 81.346, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.944', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.098', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.346', 'WEAPON3': '1.050', 'weapon3': '3.280', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '65.000'} [2024-08-06 07:15:44,426][52658] DAMAGECOUNT value on done: 853621.0 [2024-08-06 07:15:44,427][52658] Sum rewards: 85.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon4': '0.086', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.626', 'WEAPON3': '1.500', 'weapon3': '2.922', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '72.000'} [2024-08-06 07:15:45,342][52811] DAMAGECOUNT value on done: 785643.0 [2024-08-06 07:15:45,343][52811] Sum rewards: 68.127, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.028', 'weapon4': '0.080', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.220', 'weapon2': '0.632', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '56.000'} [2024-08-06 07:15:45,500][52794] DAMAGECOUNT value on done: 837582.0 [2024-08-06 07:15:45,500][52794] Sum rewards: 70.179, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.158', 'AMMO4': '0.188', 'weapon5': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.400', 'weapon2': '0.420', 'HEALTH': '0.858', 'WEAPON3': '0.900', 'weapon3': '2.756', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '54.000'} [2024-08-06 07:15:45,518][52663] DAMAGECOUNT value on done: 841486.0 [2024-08-06 07:15:45,518][52663] Sum rewards: 73.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.096', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.045', 'weapon5': '0.098', 'WEAPON4': '0.200', 'AMMO4': '0.223', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '61.000'} [2024-08-06 07:15:45,524][52649] DAMAGECOUNT value on done: 820946.0 [2024-08-06 07:15:45,525][52649] Sum rewards: 70.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.776', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon4': '0.084', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:45,870][52669] DAMAGECOUNT value on done: 842363.0 [2024-08-06 07:15:45,872][52669] Sum rewards: 65.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.034', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.171', 'weapon2': '0.186', 'weapon5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'HITCOUNT': '2.870', 'weapon3': '3.202', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '57.000'} [2024-08-06 07:15:46,171][52671] DAMAGECOUNT value on done: 850562.0 [2024-08-06 07:15:46,172][52671] Sum rewards: 80.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'weapon4': '0.192', 'AMMO3': '0.230', 'weapon2': '0.506', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '67.000'} [2024-08-06 07:15:46,385][52650] Updated weights for policy 0, policy_version 75131 (0.0017) [2024-08-06 07:15:47,266][52665] DAMAGECOUNT value on done: 833218.0 [2024-08-06 07:15:47,268][52665] Sum rewards: 79.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.117', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '64.500'} [2024-08-06 07:15:47,269][52658] DAMAGECOUNT value on done: 842059.0 [2024-08-06 07:15:47,271][52658] Sum rewards: 72.395, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.994', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.068', 'AMMO4': '0.105', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 615497728. Throughput: 0: 4355.8. Samples: 153872960. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:47,795][52567] Avg episode reward: [(0, '74.990')] [2024-08-06 07:15:48,351][52794] DAMAGECOUNT value on done: 852880.0 [2024-08-06 07:15:48,351][52794] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.767', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.114', 'weapon5': '0.164', 'AMMO4': '0.197', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:48,414][52663] DAMAGECOUNT value on done: 846842.0 [2024-08-06 07:15:48,414][52663] Sum rewards: 83.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.938', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.195', 'weapon2': '0.224', 'WEAPON3': '1.200', 'weapon3': '3.544', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '67.000'} [2024-08-06 07:15:48,429][52811] DAMAGECOUNT value on done: 782522.0 [2024-08-06 07:15:48,431][52811] Sum rewards: 72.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.154', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.096', 'AMMO4': '0.106', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '61.000'} [2024-08-06 07:15:48,696][52649] DAMAGECOUNT value on done: 814716.0 [2024-08-06 07:15:48,698][52649] Sum rewards: 72.168, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.438', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.066', 'weapon5': '0.130', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.502', 'WEAPON3': '0.950', 'weapon3': '3.154', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '58.000'} [2024-08-06 07:15:48,769][52669] DAMAGECOUNT value on done: 844064.0 [2024-08-06 07:15:48,770][52669] Sum rewards: 84.635, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.020', 'AMMO2': '0.067', 'AMMO3': '0.187', 'weapon4': '0.258', 'weapon5': '0.282', 'weapon2': '0.318', 'AMMO4': '0.335', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '68.000'} [2024-08-06 07:15:48,980][52671] DAMAGECOUNT value on done: 846656.0 [2024-08-06 07:15:48,980][52671] Sum rewards: 85.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.712', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.088', 'AMMO4': '0.166', 'AMMO3': '0.205', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '70.000'} [2024-08-06 07:15:49,247][52811] Large shaping reward 2.731 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.009000000000000001, -3.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 07:15:49,691][52658] DAMAGECOUNT value on done: 850219.0 [2024-08-06 07:15:49,692][52658] Sum rewards: 76.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.055', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon2': '0.128', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'HITCOUNT': '3.590', 'weapon3': '3.702', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:50,404][52665] DAMAGECOUNT value on done: 835181.0 [2024-08-06 07:15:50,404][52665] Sum rewards: 74.221, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.317', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.122', 'AMMO4': '0.208', 'weapon5': '0.252', 'AMMO3': '0.258', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:51,152][52650] Updated weights for policy 0, policy_version 75141 (0.0048) [2024-08-06 07:15:51,385][52663] DAMAGECOUNT value on done: 835611.0 [2024-08-06 07:15:51,385][52663] Sum rewards: 74.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.782', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.030', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.199', 'weapon2': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.504', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '61.000'} [2024-08-06 07:15:51,604][52811] DAMAGECOUNT value on done: 787451.0 [2024-08-06 07:15:51,606][52811] Sum rewards: 81.882, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.225', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.082', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.380', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '66.000'} [2024-08-06 07:15:51,664][52649] DAMAGECOUNT value on done: 826132.0 [2024-08-06 07:15:51,665][52649] Sum rewards: 76.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.037', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.113', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.574', 'WEAPON3': '0.950', 'weapon3': '3.042', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:51,687][52794] DAMAGECOUNT value on done: 834146.0 [2024-08-06 07:15:51,690][52794] Sum rewards: 73.962, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon4': '0.094', 'weapon5': '0.140', 'AMMO3': '0.210', 'AMMO4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '60.500'} [2024-08-06 07:15:51,868][52669] DAMAGECOUNT value on done: 843087.0 [2024-08-06 07:15:51,869][52669] Sum rewards: 85.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.044', 'weapon4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '71.000'} [2024-08-06 07:15:51,923][52671] DAMAGECOUNT value on done: 847383.0 [2024-08-06 07:15:51,924][52671] Sum rewards: 71.653, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.180', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.222', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:52,739][52658] DAMAGECOUNT value on done: 838424.0 [2024-08-06 07:15:52,739][52658] Sum rewards: 82.286, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.585', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.136', 'weapon4': '0.146', 'AMMO4': '0.152', 'AMMO3': '0.165', 'weapon2': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.364', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '65.000'} [2024-08-06 07:15:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 615579648. Throughput: 0: 4358.4. Samples: 153898950. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:52,794][52567] Avg episode reward: [(0, '75.332')] [2024-08-06 07:15:53,320][52665] DAMAGECOUNT value on done: 817465.0 [2024-08-06 07:15:53,321][52665] Sum rewards: 82.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.180', 'AMMO4': '0.182', 'AMMO3': '0.193', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.828', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '67.500'} [2024-08-06 07:15:53,913][52803] DAMAGECOUNT value on done: 781187.0 [2024-08-06 07:15:53,915][52803] Sum rewards: 59.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.204', 'weapon2': '0.248', 'weapon4': '0.294', 'weapon5': '0.298', 'AMMO4': '0.323', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.854', 'DAMAGECOUNT': '14.301', 'FRAGCOUNT': '49.000'} [2024-08-06 07:15:54,252][52663] DAMAGECOUNT value on done: 827216.0 [2024-08-06 07:15:54,252][52663] Sum rewards: 73.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.335', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.112', 'weapon5': '0.126', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.000'} [2024-08-06 07:15:54,516][52794] DAMAGECOUNT value on done: 847846.0 [2024-08-06 07:15:54,516][52794] Sum rewards: 74.292, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.836', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.074', 'AMMO4': '0.115', 'weapon5': '0.126', 'weapon2': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'HITCOUNT': '3.260', 'weapon3': '3.374', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:54,591][52669] DAMAGECOUNT value on done: 852453.0 [2024-08-06 07:15:54,592][52669] Sum rewards: 70.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.250', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.112', 'AMMO3': '0.144', 'weapon5': '0.236', 'AMMO4': '0.279', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '2.980', 'weapon3': '3.130', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '57.000'} [2024-08-06 07:15:54,657][52671] DAMAGECOUNT value on done: 854824.0 [2024-08-06 07:15:54,658][52671] Sum rewards: 75.423, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.132', 'weapon5': '0.150', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '62.500'} [2024-08-06 07:15:54,794][52649] DAMAGECOUNT value on done: 834202.0 [2024-08-06 07:15:54,795][52649] Sum rewards: 68.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.019', 'AMMO2': '0.053', 'weapon2': '0.224', 'AMMO3': '0.229', 'AMMO4': '0.263', 'weapon5': '0.324', 'weapon4': '0.494', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.630', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '56.000'} [2024-08-06 07:15:54,918][52811] DAMAGECOUNT value on done: 789808.0 [2024-08-06 07:15:54,918][52811] Sum rewards: 76.974, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.025', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.201', 'weapon5': '0.222', 'AMMO3': '0.231', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:55,888][52658] DAMAGECOUNT value on done: 844240.0 [2024-08-06 07:15:55,889][52658] Sum rewards: 55.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.189', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.180', 'weapon5': '0.222', 'AMMO3': '0.241', 'AMMO4': '0.272', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.852', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '14.223', 'FRAGCOUNT': '48.000'} [2024-08-06 07:15:55,964][52650] Updated weights for policy 0, policy_version 75151 (0.0025) [2024-08-06 07:15:56,416][52665] DAMAGECOUNT value on done: 823415.0 [2024-08-06 07:15:56,417][52665] Sum rewards: 77.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.188', 'AMMO3': '0.194', 'weapon2': '0.274', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '64.000'} [2024-08-06 07:15:56,773][52663] DAMAGECOUNT value on done: 834257.0 [2024-08-06 07:15:56,773][52663] Sum rewards: 80.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.199', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.128', 'weapon2': '0.178', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.408', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '67.000'} [2024-08-06 07:15:57,021][52803] DAMAGECOUNT value on done: 780689.0 [2024-08-06 07:15:57,023][52803] Sum rewards: 68.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.972', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.118', 'AMMO3': '0.164', 'weapon5': '0.172', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '54.000'} [2024-08-06 07:15:57,110][52669] DAMAGECOUNT value on done: 842889.0 [2024-08-06 07:15:57,111][52669] Sum rewards: 73.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.078', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.370', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.338', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '60.000'} [2024-08-06 07:15:57,623][52671] DAMAGECOUNT value on done: 842003.0 [2024-08-06 07:15:57,624][52671] Sum rewards: 71.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon5': '0.116', 'AMMO3': '0.193', 'weapon4': '0.254', 'AMMO4': '0.291', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '59.000'} [2024-08-06 07:15:57,682][52649] DAMAGECOUNT value on done: 825203.0 [2024-08-06 07:15:57,683][52649] Sum rewards: 77.846, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.640', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.058', 'AMMO4': '0.183', 'weapon5': '0.184', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '63.000'} [2024-08-06 07:15:57,754][52794] DAMAGECOUNT value on done: 843908.0 [2024-08-06 07:15:57,757][52794] Sum rewards: 72.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.020', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.154', 'AMMO3': '0.232', 'AMMO4': '0.236', 'weapon2': '0.236', 'WEAPON5': '0.450', 'weapon4': '0.474', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.814', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '60.500'} [2024-08-06 07:15:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 615669760. Throughput: 0: 4358.4. Samples: 153925250. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:15:57,794][52567] Avg episode reward: [(0, '74.841')] [2024-08-06 07:15:58,114][52811] DAMAGECOUNT value on done: 795997.0 [2024-08-06 07:15:58,114][52811] Sum rewards: 74.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.108', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '62.000'} [2024-08-06 07:15:58,973][52665] DAMAGECOUNT value on done: 828266.0 [2024-08-06 07:15:58,976][52665] Sum rewards: 89.432, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.823', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.148', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.282', 'weapon4': '0.488', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.781', 'FRAGCOUNT': '72.000'} [2024-08-06 07:15:59,052][52658] DAMAGECOUNT value on done: 828744.0 [2024-08-06 07:15:59,053][52658] Sum rewards: 82.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.400', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.298', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '67.000'} [2024-08-06 07:15:59,413][52663] DAMAGECOUNT value on done: 839280.0 [2024-08-06 07:15:59,413][52663] Sum rewards: 89.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.160', 'AMMO3': '0.204', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '73.000'} [2024-08-06 07:15:59,725][52669] DAMAGECOUNT value on done: 850782.0 [2024-08-06 07:15:59,725][52669] Sum rewards: 79.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.109', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO4': '0.179', 'weapon5': '0.180', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:00,124][52803] DAMAGECOUNT value on done: 787675.0 [2024-08-06 07:16:00,124][52803] Sum rewards: 74.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.353', 'AMMO5': '0.007', 'AMMO2': '0.054', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'AMMO4': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.332', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:00,324][52649] DAMAGECOUNT value on done: 826340.0 [2024-08-06 07:16:00,325][52649] Sum rewards: 72.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.946', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.182', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.734', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:00,400][52794] DAMAGECOUNT value on done: 844177.0 [2024-08-06 07:16:00,401][52794] Sum rewards: 58.908, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.235', 'AMMO5': '0.011', 'AMMO2': '0.058', 'weapon5': '0.172', 'weapon4': '0.182', 'AMMO4': '0.288', 'weapon2': '0.340', 'WEAPON5': '0.350', 'AMMO3': '0.368', 'WEAPON4': '0.500', 'WEAPON3': '2.100', 'weapon3': '2.966', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.708', 'FRAGCOUNT': '55.000'} [2024-08-06 07:16:00,441][52671] DAMAGECOUNT value on done: 848449.0 [2024-08-06 07:16:00,444][52671] Sum rewards: 77.073, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.205', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.116', 'weapon4': '0.124', 'AMMO4': '0.132', 'AMMO3': '0.148', 'weapon2': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.446', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:00,510][52650] Updated weights for policy 0, policy_version 75161 (0.0014) [2024-08-06 07:16:01,348][52811] DAMAGECOUNT value on done: 782155.0 [2024-08-06 07:16:01,349][52811] Sum rewards: 64.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.152', 'AMMO3': '0.213', 'AMMO4': '0.214', 'weapon5': '0.226', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.036', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '53.000'} [2024-08-06 07:16:01,802][52665] DAMAGECOUNT value on done: 829073.0 [2024-08-06 07:16:01,802][52665] Sum rewards: 70.269, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.056', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.152', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.314', 'AMMO3': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.108', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '64.000'} [2024-08-06 07:16:01,851][52820] DAMAGECOUNT value on done: 777864.0 [2024-08-06 07:16:01,854][52820] Sum rewards: 105.775, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.450', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.166', 'weapon5': '0.186', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON3': '1.050', 'weapon3': '3.086', 'HITCOUNT': '4.420', 'DAMAGECOUNT': '23.616', 'FRAGCOUNT': '83.000'} [2024-08-06 07:16:01,884][52658] DAMAGECOUNT value on done: 846882.0 [2024-08-06 07:16:01,884][52658] Sum rewards: 72.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.203', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.085', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:02,022][52663] DAMAGECOUNT value on done: 847900.0 [2024-08-06 07:16:02,025][52663] Sum rewards: 58.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.122', 'AMMO4': '0.225', 'AMMO3': '0.251', 'weapon5': '0.274', 'weapon2': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.032', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '50.000'} [2024-08-06 07:16:02,385][52669] DAMAGECOUNT value on done: 852122.0 [2024-08-06 07:16:02,387][52669] Sum rewards: 71.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.842', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.098', 'weapon4': '0.132', 'AMMO4': '0.165', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 615751680. Throughput: 0: 4359.8. Samples: 153938300. Policy #0 lag: (min: 0.0, avg: 2.7, max: 8.0) [2024-08-06 07:16:02,794][52567] Avg episode reward: [(0, '75.102')] [2024-08-06 07:16:03,196][52803] DAMAGECOUNT value on done: 786593.0 [2024-08-06 07:16:03,197][52803] Sum rewards: 93.787, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.185', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.060', 'weapon5': '0.158', 'weapon2': '0.160', 'AMMO4': '0.223', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.362', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '22.542', 'FRAGCOUNT': '78.000'} [2024-08-06 07:16:03,252][52671] DAMAGECOUNT value on done: 847937.0 [2024-08-06 07:16:03,252][52671] Sum rewards: 69.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.082', 'AMMO4': '0.164', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '57.000'} [2024-08-06 07:16:03,361][52649] DAMAGECOUNT value on done: 814248.0 [2024-08-06 07:16:03,365][52649] Sum rewards: 70.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.096', 'AMMO4': '0.172', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '56.500'} [2024-08-06 07:16:03,410][52794] DAMAGECOUNT value on done: 851642.0 [2024-08-06 07:16:03,410][52794] Sum rewards: 86.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.514', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.020', 'weapon5': '0.046', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.162', 'FRAGCOUNT': '70.000'} [2024-08-06 07:16:04,572][52811] DAMAGECOUNT value on done: 782993.0 [2024-08-06 07:16:04,573][52811] Sum rewards: 67.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.188', 'AMMO3': '0.201', 'AMMO4': '0.236', 'weapon5': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.708', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '56.000'} [2024-08-06 07:16:04,770][52663] DAMAGECOUNT value on done: 829273.0 [2024-08-06 07:16:04,771][52663] Sum rewards: 72.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.009', 'weapon4': '0.040', 'AMMO2': '0.045', 'weapon5': '0.126', 'weapon2': '0.192', 'AMMO3': '0.198', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.424', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:04,924][52665] DAMAGECOUNT value on done: 837805.0 [2024-08-06 07:16:04,924][52665] Sum rewards: 65.547, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.100', 'weapon4': '0.176', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '54.000'} [2024-08-06 07:16:04,978][52658] DAMAGECOUNT value on done: 837446.0 [2024-08-06 07:16:04,979][52658] Sum rewards: 76.133, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'weapon5': '0.200', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:05,054][52820] DAMAGECOUNT value on done: 779431.0 [2024-08-06 07:16:05,055][52820] Sum rewards: 77.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.083', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.154', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:05,150][52650] Updated weights for policy 0, policy_version 75171 (0.0018) [2024-08-06 07:16:05,330][52669] DAMAGECOUNT value on done: 838150.0 [2024-08-06 07:16:05,332][52669] Sum rewards: 76.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.890', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.094', 'AMMO4': '0.104', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:06,002][52671] DAMAGECOUNT value on done: 833358.0 [2024-08-06 07:16:06,002][52671] Sum rewards: 82.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.802', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.694', 'WEAPON3': '1.150', 'weapon3': '2.886', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:06,206][52649] DAMAGECOUNT value on done: 824633.0 [2024-08-06 07:16:06,206][52649] Sum rewards: 70.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.754', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.198', 'AMMO4': '0.218', 'AMMO3': '0.230', 'weapon4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.938', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:06,374][52803] DAMAGECOUNT value on done: 783862.0 [2024-08-06 07:16:06,375][52803] Sum rewards: 65.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.548', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.119', 'weapon5': '0.120', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'HITCOUNT': '3.190', 'weapon3': '3.354', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.500'} [2024-08-06 07:16:06,396][52670] DAMAGECOUNT value on done: 828237.0 [2024-08-06 07:16:06,397][52670] Sum rewards: 82.239, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.378', 'AMMO5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.106', 'AMMO3': '0.188', 'weapon2': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '67.000'} [2024-08-06 07:16:06,440][52794] DAMAGECOUNT value on done: 844062.0 [2024-08-06 07:16:06,441][52794] Sum rewards: 77.279, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.825', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.140', 'AMMO4': '0.163', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:07,781][52665] DAMAGECOUNT value on done: 829085.0 [2024-08-06 07:16:07,785][52665] Sum rewards: 77.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.034', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.211', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 615841792. Throughput: 0: 4372.7. Samples: 153964750. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:07,794][52567] Avg episode reward: [(0, '75.396')] [2024-08-06 07:16:07,860][52658] DAMAGECOUNT value on done: 835869.0 [2024-08-06 07:16:07,860][52658] Sum rewards: 80.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.094', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:08,103][52663] DAMAGECOUNT value on done: 825151.0 [2024-08-06 07:16:08,103][52663] Sum rewards: 74.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:08,233][52820] DAMAGECOUNT value on done: 777600.0 [2024-08-06 07:16:08,234][52820] Sum rewards: 58.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon4': '0.080', 'AMMO4': '0.143', 'AMMO3': '0.179', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.662', 'WEAPON3': '1.100', 'weapon3': '2.768', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '48.000'} [2024-08-06 07:16:08,454][52669] DAMAGECOUNT value on done: 838642.0 [2024-08-06 07:16:08,455][52669] Sum rewards: 74.577, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.668', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.356', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '64.000'} [2024-08-06 07:16:08,733][52671] DAMAGECOUNT value on done: 848446.0 [2024-08-06 07:16:08,734][52671] Sum rewards: 75.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.060', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.225', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:09,013][52670] DAMAGECOUNT value on done: 841971.0 [2024-08-06 07:16:09,013][52670] Sum rewards: 83.689, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.253', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.240', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '70.000'} [2024-08-06 07:16:09,120][52649] DAMAGECOUNT value on done: 806893.0 [2024-08-06 07:16:09,121][52649] Sum rewards: 69.334, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.518', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.132', 'weapon4': '0.162', 'AMMO4': '0.179', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.000'} [2024-08-06 07:16:09,308][52795] DAMAGECOUNT value on done: 780870.0 [2024-08-06 07:16:09,308][52795] Sum rewards: 78.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.702', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon2': '0.182', 'AMMO4': '0.198', 'weapon5': '0.232', 'AMMO3': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:09,454][52803] DAMAGECOUNT value on done: 784194.0 [2024-08-06 07:16:09,454][52803] Sum rewards: 86.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon2': '0.136', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.876', 'FRAGCOUNT': '70.000'} [2024-08-06 07:16:09,948][52650] Updated weights for policy 0, policy_version 75181 (0.0012) [2024-08-06 07:16:10,487][52665] DAMAGECOUNT value on done: 842272.0 [2024-08-06 07:16:10,488][52665] Sum rewards: 82.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.198', 'AMMO3': '0.205', 'WEAPON3': '1.300', 'weapon3': '3.570', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '68.000'} [2024-08-06 07:16:10,784][52658] DAMAGECOUNT value on done: 842625.0 [2024-08-06 07:16:10,784][52658] Sum rewards: 67.679, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.123', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.130', 'weapon5': '0.142', 'WEAPON3': '0.750', 'weapon2': '0.814', 'weapon3': '2.882', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '52.000'} [2024-08-06 07:16:10,956][52663] DAMAGECOUNT value on done: 833675.0 [2024-08-06 07:16:10,958][52663] Sum rewards: 78.227, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.120', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO4': '0.149', 'weapon2': '0.278', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.218', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '69.000'} [2024-08-06 07:16:11,469][52820] DAMAGECOUNT value on done: 766715.0 [2024-08-06 07:16:11,471][52820] Sum rewards: 63.587, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.025', 'AMMO2': '0.058', 'weapon4': '0.170', 'AMMO3': '0.214', 'weapon5': '0.282', 'AMMO4': '0.293', 'weapon2': '0.552', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.600', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '54.500'} [2024-08-06 07:16:11,477][52669] DAMAGECOUNT value on done: 844225.0 [2024-08-06 07:16:11,479][52669] Sum rewards: 72.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.678', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.102', 'AMMO4': '0.115', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.112', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:11,514][52671] DAMAGECOUNT value on done: 846442.0 [2024-08-06 07:16:11,517][52671] Sum rewards: 73.058, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.022', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon4': '0.132', 'weapon5': '0.158', 'AMMO4': '0.237', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.550', 'weapon3': '3.000', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:11,567][52666] DAMAGECOUNT value on done: 842210.0 [2024-08-06 07:16:11,567][52666] Sum rewards: 80.729, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.840', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.110', 'AMMO4': '0.165', 'weapon5': '0.214', 'AMMO3': '0.238', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '69.000'} [2024-08-06 07:16:12,011][52649] DAMAGECOUNT value on done: 828529.0 [2024-08-06 07:16:12,012][52649] Sum rewards: 73.611, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.380', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.091', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'AMMO3': '0.309', 'weapon2': '0.370', 'WEAPON3': '1.850', 'weapon3': '3.194', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:12,014][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:16:12,067][52670] DAMAGECOUNT value on done: 828453.0 [2024-08-06 07:16:12,069][52670] Sum rewards: 72.748, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.138', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.131', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.275', 'weapon2': '0.394', 'WEAPON3': '1.600', 'weapon3': '3.140', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:12,368][52795] DAMAGECOUNT value on done: 765940.0 [2024-08-06 07:16:12,368][52795] Sum rewards: 67.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.830', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.154', 'weapon5': '0.174', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.256', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '55.000'} [2024-08-06 07:16:12,548][52803] DAMAGECOUNT value on done: 777100.0 [2024-08-06 07:16:12,552][52803] Sum rewards: 69.001, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.965', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.312', 'WEAPON3': '1.650', 'weapon3': '3.334', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.500'} [2024-08-06 07:16:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 615931904. Throughput: 0: 4376.2. Samples: 153991130. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:12,794][52567] Avg episode reward: [(0, '75.109')] [2024-08-06 07:16:13,549][52665] DAMAGECOUNT value on done: 834986.0 [2024-08-06 07:16:13,550][52665] Sum rewards: 79.069, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.452', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.170', 'AMMO4': '0.178', 'weapon5': '0.218', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.000', 'weapon3': '2.694', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:14,032][52663] DAMAGECOUNT value on done: 835853.0 [2024-08-06 07:16:14,032][52663] Sum rewards: 87.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.114', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '73.000'} [2024-08-06 07:16:14,225][52650] Updated weights for policy 0, policy_version 75191 (0.0012) [2024-08-06 07:16:14,295][52671] DAMAGECOUNT value on done: 842250.0 [2024-08-06 07:16:14,295][52671] Sum rewards: 70.484, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'AMMO5': '0.022', 'AMMO2': '0.071', 'AMMO3': '0.220', 'weapon4': '0.232', 'weapon5': '0.266', 'AMMO4': '0.356', 'weapon2': '0.440', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.768', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 07:16:14,490][52669] DAMAGECOUNT value on done: 866653.0 [2024-08-06 07:16:14,491][52669] Sum rewards: 72.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.024', 'AMMO2': '0.087', 'weapon4': '0.180', 'AMMO3': '0.204', 'weapon5': '0.274', 'AMMO4': '0.434', 'weapon2': '0.606', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.654', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:14,569][52820] DAMAGECOUNT value on done: 782511.0 [2024-08-06 07:16:14,569][52820] Sum rewards: 80.517, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.266', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.132', 'AMMO3': '0.170', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:14,765][52666] DAMAGECOUNT value on done: 834491.0 [2024-08-06 07:16:14,766][52666] Sum rewards: 68.775, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.570', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.118', 'AMMO4': '0.166', 'weapon4': '0.180', 'WEAPON5': '0.300', 'AMMO3': '0.308', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.086', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:15,044][52649] DAMAGECOUNT value on done: 826909.0 [2024-08-06 07:16:15,045][52649] Sum rewards: 74.744, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.338', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.286', 'weapon2': '0.394', 'WEAPON3': '1.750', 'weapon3': '3.258', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '64.000'} [2024-08-06 07:16:15,306][52670] DAMAGECOUNT value on done: 828754.0 [2024-08-06 07:16:15,307][52670] Sum rewards: 77.082, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.856', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.242', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:15,444][52795] DAMAGECOUNT value on done: 771553.0 [2024-08-06 07:16:15,448][52795] Sum rewards: 71.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.677', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.140', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:15,695][52803] DAMAGECOUNT value on done: 777077.0 [2024-08-06 07:16:15,696][52803] Sum rewards: 73.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.352', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'weapon5': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:16,274][52665] DAMAGECOUNT value on done: 829959.0 [2024-08-06 07:16:16,275][52665] Sum rewards: 75.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.696', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.195', 'AMMO4': '0.218', 'weapon4': '0.230', 'weapon5': '0.238', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:16,968][52671] DAMAGECOUNT value on done: 850380.0 [2024-08-06 07:16:16,968][52671] Sum rewards: 61.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.229', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon4': '0.086', 'weapon5': '0.216', 'AMMO3': '0.249', 'AMMO4': '0.299', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.008', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2024-08-06 07:16:17,173][52663] DAMAGECOUNT value on done: 842186.0 [2024-08-06 07:16:17,174][52663] Sum rewards: 69.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.417', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.211', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '57.000'} [2024-08-06 07:16:17,479][52669] DAMAGECOUNT value on done: 853883.0 [2024-08-06 07:16:17,480][52669] Sum rewards: 87.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.675', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.068', 'AMMO4': '0.178', 'weapon5': '0.216', 'AMMO3': '0.241', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '22.005', 'FRAGCOUNT': '71.000'} [2024-08-06 07:16:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 616022016. Throughput: 0: 4380.9. Samples: 154004300. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:17,794][52567] Avg episode reward: [(0, '75.083')] [2024-08-06 07:16:17,796][52666] DAMAGECOUNT value on done: 840848.0 [2024-08-06 07:16:17,802][52666] Sum rewards: 75.930, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.160', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon5': '0.128', 'weapon4': '0.166', 'AMMO3': '0.263', 'AMMO4': '0.273', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:17,824][52820] DAMAGECOUNT value on done: 767160.0 [2024-08-06 07:16:17,825][52820] Sum rewards: 76.492, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.029', 'HEALTH': '0.130', 'AMMO4': '0.142', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.206', 'weapon2': '0.424', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:18,060][52649] DAMAGECOUNT value on done: 819434.0 [2024-08-06 07:16:18,062][52649] Sum rewards: 82.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.106', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.066', 'AMMO4': '0.188', 'AMMO3': '0.222', 'weapon5': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.920', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '68.500'} [2024-08-06 07:16:18,168][52670] DAMAGECOUNT value on done: 840912.0 [2024-08-06 07:16:18,170][52670] Sum rewards: 59.414, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.358', 'AMMO5': '0.023', 'AMMO2': '0.067', 'weapon4': '0.192', 'weapon5': '0.214', 'AMMO3': '0.334', 'AMMO4': '0.337', 'weapon2': '0.368', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.950', 'weapon3': '2.844', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '55.000'} [2024-08-06 07:16:18,649][52795] DAMAGECOUNT value on done: 780435.0 [2024-08-06 07:16:18,649][52795] Sum rewards: 71.293, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.708', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.119', 'weapon4': '0.184', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '58.000'} [2024-08-06 07:16:18,838][52803] DAMAGECOUNT value on done: 783504.0 [2024-08-06 07:16:18,839][52803] Sum rewards: 84.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon4': '0.120', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '69.000'} [2024-08-06 07:16:19,078][52665] DAMAGECOUNT value on done: 834669.0 [2024-08-06 07:16:19,080][52665] Sum rewards: 74.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.167', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.168', 'AMMO3': '0.175', 'AMMO4': '0.215', 'weapon4': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:19,428][52650] Updated weights for policy 0, policy_version 75201 (0.0011) [2024-08-06 07:16:19,831][52663] DAMAGECOUNT value on done: 839295.0 [2024-08-06 07:16:19,834][52663] Sum rewards: 83.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.242', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '68.000'} [2024-08-06 07:16:19,996][52671] DAMAGECOUNT value on done: 846295.0 [2024-08-06 07:16:19,997][52671] Sum rewards: 77.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.250', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.128', 'weapon2': '0.190', 'AMMO4': '0.196', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.400', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:20,167][52669] DAMAGECOUNT value on done: 847569.0 [2024-08-06 07:16:20,168][52669] Sum rewards: 64.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.020', 'AMMO5': '0.017', 'WEAPON1': '0.030', 'AMMO2': '0.041', 'weapon4': '0.122', 'AMMO3': '0.175', 'AMMO4': '0.206', 'weapon2': '0.268', 'weapon5': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '2.958', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '52.000'} [2024-08-06 07:16:20,369][52666] DAMAGECOUNT value on done: 837591.0 [2024-08-06 07:16:20,369][52666] Sum rewards: 74.351, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.196', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.122', 'AMMO4': '0.123', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.313', 'WEAPON3': '1.850', 'weapon3': '3.308', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:20,680][52670] DAMAGECOUNT value on done: 830485.0 [2024-08-06 07:16:20,680][52670] Sum rewards: 65.400, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon5': '0.182', 'AMMO4': '0.221', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '57.000'} [2024-08-06 07:16:20,881][52820] DAMAGECOUNT value on done: 773702.0 [2024-08-06 07:16:20,881][52820] Sum rewards: 70.957, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 07:16:21,768][52795] DAMAGECOUNT value on done: 768798.0 [2024-08-06 07:16:21,772][52795] Sum rewards: 75.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.078', 'AMMO3': '0.192', 'AMMO4': '0.199', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:21,914][52665] DAMAGECOUNT value on done: 826941.0 [2024-08-06 07:16:21,915][52665] Sum rewards: 91.884, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.232', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon2': '0.536', 'WEAPON3': '0.850', 'weapon3': '3.286', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.883', 'FRAGCOUNT': '72.000'} [2024-08-06 07:16:21,986][52803] DAMAGECOUNT value on done: 779871.0 [2024-08-06 07:16:21,987][52803] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.102', 'weapon5': '0.134', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '54.500'} [2024-08-06 07:16:22,251][52663] DAMAGECOUNT value on done: 844789.0 [2024-08-06 07:16:22,253][52663] Sum rewards: 76.926, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.033', 'weapon5': '0.086', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '0.850', 'weapon3': '3.170', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:22,756][52669] DAMAGECOUNT value on done: 851254.0 [2024-08-06 07:16:22,758][52669] Sum rewards: 68.158, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.320', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.164', 'weapon2': '0.232', 'AMMO3': '0.255', 'AMMO4': '0.274', 'weapon5': '0.286', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17749.4, 300 sec: 17467.0). Total num frames: 616112128. Throughput: 0: 4384.5. Samples: 154030710. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:22,794][52567] Avg episode reward: [(0, '74.805')] [2024-08-06 07:16:23,114][52671] DAMAGECOUNT value on done: 831355.0 [2024-08-06 07:16:23,115][52671] Sum rewards: 73.982, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.350', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.056', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'weapon2': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '3.440', 'weapon3': '3.484', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:23,526][52666] DAMAGECOUNT value on done: 830910.0 [2024-08-06 07:16:23,530][52666] Sum rewards: 75.364, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.403', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.146', 'weapon5': '0.174', 'AMMO4': '0.188', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:23,711][52650] Updated weights for policy 0, policy_version 75211 (0.0033) [2024-08-06 07:16:23,929][52670] DAMAGECOUNT value on done: 827878.0 [2024-08-06 07:16:23,931][52670] Sum rewards: 65.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.472', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon4': '0.298', 'weapon2': '0.556', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '54.000'} [2024-08-06 07:16:24,123][52820] DAMAGECOUNT value on done: 774484.0 [2024-08-06 07:16:24,125][52820] Sum rewards: 67.853, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.911', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.104', 'AMMO4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '54.500'} [2024-08-06 07:16:24,529][52665] DAMAGECOUNT value on done: 833382.0 [2024-08-06 07:16:24,531][52665] Sum rewards: 65.875, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.554', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.112', 'AMMO3': '0.218', 'weapon5': '0.224', 'weapon2': '0.274', 'AMMO4': '0.298', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '57.000'} [2024-08-06 07:16:24,898][52795] DAMAGECOUNT value on done: 776227.0 [2024-08-06 07:16:24,900][52795] Sum rewards: 82.586, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.447', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon4': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:25,140][52803] DAMAGECOUNT value on done: 793384.0 [2024-08-06 07:16:25,142][52803] Sum rewards: 67.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.886', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.082', 'weapon5': '0.090', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '56.000'} [2024-08-06 07:16:25,471][52663] DAMAGECOUNT value on done: 845920.0 [2024-08-06 07:16:25,471][52663] Sum rewards: 73.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.247', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.033', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.171', 'weapon2': '0.932', 'WEAPON3': '0.950', 'weapon3': '2.804', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:25,842][52669] DAMAGECOUNT value on done: 854020.0 [2024-08-06 07:16:25,843][52669] Sum rewards: 69.293, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.050', 'weapon4': '0.114', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.243', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:25,910][52671] DAMAGECOUNT value on done: 855950.0 [2024-08-06 07:16:25,912][52671] Sum rewards: 79.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.494', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'weapon2': '0.678', 'WEAPON3': '0.950', 'weapon3': '3.002', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:26,426][52666] DAMAGECOUNT value on done: 837816.0 [2024-08-06 07:16:26,427][52666] Sum rewards: 71.106, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.014', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.050', 'AMMO4': '0.165', 'weapon5': '0.166', 'AMMO3': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.000', 'weapon3': '3.114', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '56.000'} [2024-08-06 07:16:26,760][52670] DAMAGECOUNT value on done: 831260.0 [2024-08-06 07:16:26,760][52670] Sum rewards: 82.057, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.315', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.094', 'AMMO4': '0.155', 'AMMO3': '0.157', 'weapon5': '0.220', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.202', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '64.500'} [2024-08-06 07:16:27,284][52665] DAMAGECOUNT value on done: 834070.0 [2024-08-06 07:16:27,285][52665] Sum rewards: 78.758, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.955', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.096', 'weapon5': '0.184', 'AMMO4': '0.204', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '67.500'} [2024-08-06 07:16:27,306][52820] DAMAGECOUNT value on done: 781040.0 [2024-08-06 07:16:27,306][52820] Sum rewards: 72.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.090', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '3.370', 'weapon3': '3.384', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:27,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 616185856. Throughput: 0: 4388.4. Samples: 154057190. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:27,795][52567] Avg episode reward: [(0, '74.696')] [2024-08-06 07:16:27,812][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075219_616194048.pth... [2024-08-06 07:16:27,982][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074708_612007936.pth [2024-08-06 07:16:28,059][52795] DAMAGECOUNT value on done: 783232.0 [2024-08-06 07:16:28,060][52795] Sum rewards: 78.176, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.094', 'weapon5': '0.128', 'AMMO4': '0.157', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.000', 'weapon3': '3.202', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:28,280][52663] DAMAGECOUNT value on done: 832399.0 [2024-08-06 07:16:28,281][52663] Sum rewards: 69.472, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.198', 'AMMO5': '0.006', 'weapon4': '0.034', 'AMMO2': '0.036', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.189', 'weapon2': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '3.350', 'weapon3': '3.360', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '56.000'} [2024-08-06 07:16:28,498][52650] Updated weights for policy 0, policy_version 75221 (0.0031) [2024-08-06 07:16:28,499][52803] DAMAGECOUNT value on done: 786080.0 [2024-08-06 07:16:28,500][52803] Sum rewards: 67.141, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.180', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.074', 'weapon5': '0.154', 'AMMO3': '0.259', 'AMMO4': '0.270', 'weapon2': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '3.200', 'weapon3': '3.220', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:28,543][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:16:28,572][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:16:29,028][52666] DAMAGECOUNT value on done: 833856.0 [2024-08-06 07:16:29,029][52666] Sum rewards: 74.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon4': '0.248', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:29,050][52671] DAMAGECOUNT value on done: 852166.0 [2024-08-06 07:16:29,050][52671] Sum rewards: 83.426, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.655', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.134', 'weapon5': '0.168', 'AMMO4': '0.220', 'weapon2': '0.280', 'AMMO3': '0.289', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.172', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '71.000'} [2024-08-06 07:16:29,389][52670] DAMAGECOUNT value on done: 831334.0 [2024-08-06 07:16:29,390][52670] Sum rewards: 72.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.348', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.614', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:30,146][52665] DAMAGECOUNT value on done: 825817.0 [2024-08-06 07:16:30,146][52665] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.269', 'AMMO5': '0.014', 'weapon4': '0.062', 'AMMO2': '0.064', 'weapon5': '0.220', 'AMMO3': '0.310', 'AMMO4': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.850', 'weapon3': '2.846', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '64.000'} [2024-08-06 07:16:30,554][52820] DAMAGECOUNT value on done: 789644.0 [2024-08-06 07:16:30,558][52820] Sum rewards: 71.296, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.406', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.108', 'weapon5': '0.142', 'AMMO3': '0.192', 'AMMO4': '0.221', 'weapon2': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '58.500'} [2024-08-06 07:16:31,212][52671] DAMAGECOUNT value on done: 847122.0 [2024-08-06 07:16:31,212][52671] Sum rewards: 80.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.428', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.110', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:31,213][52795] DAMAGECOUNT value on done: 776777.0 [2024-08-06 07:16:31,216][52795] Sum rewards: 78.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.458', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon2': '0.150', 'AMMO3': '0.183', 'WEAPON3': '1.100', 'HITCOUNT': '3.530', 'weapon3': '3.568', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:31,790][52803] DAMAGECOUNT value on done: 781222.0 [2024-08-06 07:16:31,790][52803] Sum rewards: 77.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.132', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.218', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:32,370][52666] DAMAGECOUNT value on done: 828926.0 [2024-08-06 07:16:32,373][52666] Sum rewards: 83.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.053', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.146', 'weapon5': '0.156', 'AMMO4': '0.188', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '69.000'} [2024-08-06 07:16:32,680][52670] DAMAGECOUNT value on done: 827860.0 [2024-08-06 07:16:32,682][52670] Sum rewards: 75.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.916', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.157', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 616284160. Throughput: 0: 4372.4. Samples: 154069720. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:32,794][52567] Avg episode reward: [(0, '74.710')] [2024-08-06 07:16:32,799][52665] DAMAGECOUNT value on done: 829509.0 [2024-08-06 07:16:32,799][52665] Sum rewards: 73.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.098', 'weapon5': '0.122', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '60.500'} [2024-08-06 07:16:33,148][52650] Updated weights for policy 0, policy_version 75231 (0.0011) [2024-08-06 07:16:33,572][52820] DAMAGECOUNT value on done: 769927.0 [2024-08-06 07:16:33,575][52820] Sum rewards: 74.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.839', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon2': '0.224', 'AMMO3': '0.239', 'WEAPON3': '1.500', 'HITCOUNT': '3.480', 'weapon3': '3.592', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '64.000'} [2024-08-06 07:16:34,352][52795] DAMAGECOUNT value on done: 781102.0 [2024-08-06 07:16:34,352][52795] Sum rewards: 76.797, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.106', 'AMMO3': '0.166', 'AMMO4': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:34,399][52671] DAMAGECOUNT value on done: 851859.0 [2024-08-06 07:16:34,399][52671] Sum rewards: 76.976, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon2': '0.150', 'weapon5': '0.164', 'weapon4': '0.230', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:35,063][52803] DAMAGECOUNT value on done: 794995.0 [2024-08-06 07:16:35,066][52803] Sum rewards: 83.651, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.112', 'weapon2': '0.182', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.440', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.213', 'FRAGCOUNT': '71.000'} [2024-08-06 07:16:35,247][52666] DAMAGECOUNT value on done: 836913.0 [2024-08-06 07:16:35,250][52666] Sum rewards: 57.998, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.136', 'AMMO3': '0.190', 'AMMO4': '0.249', 'weapon2': '0.252', 'weapon5': '0.252', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.092', 'DAMAGECOUNT': '14.355', 'FRAGCOUNT': '48.000'} [2024-08-06 07:16:35,621][52670] DAMAGECOUNT value on done: 839206.0 [2024-08-06 07:16:35,623][52670] Sum rewards: 74.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.034', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:35,963][52665] DAMAGECOUNT value on done: 835327.0 [2024-08-06 07:16:35,964][52665] Sum rewards: 74.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.097', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:36,060][52668] DAMAGECOUNT value on done: 847474.0 [2024-08-06 07:16:36,060][52668] Sum rewards: 66.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.056', 'weapon5': '0.138', 'weapon4': '0.156', 'AMMO3': '0.228', 'AMMO4': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '55.000'} [2024-08-06 07:16:36,716][52820] DAMAGECOUNT value on done: 781220.0 [2024-08-06 07:16:36,717][52820] Sum rewards: 75.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.060', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.038', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.283', 'weapon2': '0.324', 'WEAPON3': '1.850', 'weapon3': '3.350', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:37,398][52795] DAMAGECOUNT value on done: 782162.0 [2024-08-06 07:16:37,401][52795] Sum rewards: 78.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'weapon2': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.253', 'WEAPON3': '1.450', 'weapon3': '3.436', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:37,434][52671] DAMAGECOUNT value on done: 836741.0 [2024-08-06 07:16:37,434][52671] Sum rewards: 80.866, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'HEALTH': '0.018', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.140', 'AMMO4': '0.155', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:37,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 616366080. Throughput: 0: 4381.3. Samples: 154096110. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:37,794][52567] Avg episode reward: [(0, '74.601')] [2024-08-06 07:16:37,901][52650] Updated weights for policy 0, policy_version 75241 (0.0024) [2024-08-06 07:16:38,164][52803] DAMAGECOUNT value on done: 780775.0 [2024-08-06 07:16:38,164][52803] Sum rewards: 73.270, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.511', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.144', 'weapon4': '0.182', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:38,468][52666] DAMAGECOUNT value on done: 830713.0 [2024-08-06 07:16:38,469][52666] Sum rewards: 71.584, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.154', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'weapon4': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '58.000'} [2024-08-06 07:16:38,784][52670] DAMAGECOUNT value on done: 822741.0 [2024-08-06 07:16:38,794][52670] Sum rewards: 95.487, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.276', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.168', 'weapon5': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.362', 'weapon4': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.634', 'HITCOUNT': '4.290', 'DAMAGECOUNT': '22.752', 'FRAGCOUNT': '73.000'} [2024-08-06 07:16:38,805][52668] DAMAGECOUNT value on done: 848029.0 [2024-08-06 07:16:38,805][52668] Sum rewards: 77.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.006', 'AMMO2': '0.045', 'weapon5': '0.052', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon4': '0.220', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '61.500'} [2024-08-06 07:16:39,983][52820] DAMAGECOUNT value on done: 792125.0 [2024-08-06 07:16:39,985][52820] Sum rewards: 78.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.655', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.116', 'weapon2': '0.162', 'weapon4': '0.190', 'AMMO3': '0.191', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:40,535][52795] DAMAGECOUNT value on done: 777735.0 [2024-08-06 07:16:40,539][52795] Sum rewards: 74.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon5': '0.208', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:41,289][52803] DAMAGECOUNT value on done: 783958.0 [2024-08-06 07:16:41,291][52803] Sum rewards: 80.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.451', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.097', 'weapon5': '0.130', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'weapon3': '3.432', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '67.000'} [2024-08-06 07:16:41,652][52666] DAMAGECOUNT value on done: 839693.0 [2024-08-06 07:16:41,654][52666] Sum rewards: 72.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.200', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.134', 'AMMO3': '0.203', 'weapon5': '0.254', 'AMMO4': '0.261', 'weapon2': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:41,895][52668] DAMAGECOUNT value on done: 843862.0 [2024-08-06 07:16:41,899][52668] Sum rewards: 72.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.192', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.116', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '58.000'} [2024-08-06 07:16:41,995][52670] DAMAGECOUNT value on done: 837682.0 [2024-08-06 07:16:41,995][52670] Sum rewards: 92.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.183', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.126', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.272', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '22.086', 'FRAGCOUNT': '78.000'} [2024-08-06 07:16:42,591][52650] Updated weights for policy 0, policy_version 75251 (0.0014) [2024-08-06 07:16:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 616456192. Throughput: 0: 4381.8. Samples: 154122430. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:42,794][52567] Avg episode reward: [(0, '74.829')] [2024-08-06 07:16:43,031][52820] DAMAGECOUNT value on done: 784244.0 [2024-08-06 07:16:43,034][52820] Sum rewards: 75.528, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.052', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.818', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:43,314][52670] Large shaping reward 2.624 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:16:43,652][52795] DAMAGECOUNT value on done: 772282.0 [2024-08-06 07:16:43,652][52795] Sum rewards: 76.383, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.134', 'AMMO4': '0.184', 'weapon4': '0.208', 'AMMO3': '0.210', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:44,416][52803] DAMAGECOUNT value on done: 789002.0 [2024-08-06 07:16:44,425][52803] Sum rewards: 81.100, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.434', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.042', 'weapon5': '0.084', 'AMMO3': '0.143', 'AMMO4': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '3.276', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:44,946][52668] DAMAGECOUNT value on done: 849833.0 [2024-08-06 07:16:44,947][52668] Sum rewards: 71.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.148', 'AMMO4': '0.168', 'weapon5': '0.180', 'AMMO3': '0.212', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '58.000'} [2024-08-06 07:16:44,976][52666] DAMAGECOUNT value on done: 824759.0 [2024-08-06 07:16:44,978][52666] Sum rewards: 75.624, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.070', 'weapon5': '0.126', 'AMMO4': '0.216', 'AMMO3': '0.260', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '64.000'} [2024-08-06 07:16:45,235][52670] DAMAGECOUNT value on done: 842205.0 [2024-08-06 07:16:45,237][52670] Sum rewards: 64.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.795', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.214', 'AMMO4': '0.222', 'AMMO3': '0.225', 'weapon5': '0.276', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '53.000'} [2024-08-06 07:16:46,338][52820] DAMAGECOUNT value on done: 785617.0 [2024-08-06 07:16:46,339][52820] Sum rewards: 76.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.070', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.058', 'AMMO4': '0.081', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.224', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.408', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:46,791][52795] DAMAGECOUNT value on done: 774936.0 [2024-08-06 07:16:46,791][52795] Sum rewards: 84.889, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.928', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.122', 'AMMO3': '0.201', 'AMMO4': '0.211', 'weapon4': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.363', 'FRAGCOUNT': '68.000'} [2024-08-06 07:16:47,192][52666] DAMAGECOUNT value on done: 842598.0 [2024-08-06 07:16:47,193][52666] Sum rewards: 81.841, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.594', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'weapon4': '0.210', 'AMMO3': '0.221', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:47,415][52650] Updated weights for policy 0, policy_version 75261 (0.0028) [2024-08-06 07:16:47,498][52803] DAMAGECOUNT value on done: 793020.0 [2024-08-06 07:16:47,498][52803] Sum rewards: 72.322, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.415', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon2': '0.292', 'AMMO3': '0.295', 'WEAPON3': '1.800', 'weapon3': '3.488', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '64.000'} [2024-08-06 07:16:47,538][52668] DAMAGECOUNT value on done: 835914.0 [2024-08-06 07:16:47,538][52668] Sum rewards: 74.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.112', 'AMMO4': '0.128', 'weapon5': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.728', 'WEAPON3': '1.250', 'weapon3': '2.778', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:47,670][52670] DAMAGECOUNT value on done: 835812.0 [2024-08-06 07:16:47,671][52670] Sum rewards: 69.661, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.958', 'AMMO5': '0.026', 'AMMO2': '0.057', 'weapon4': '0.186', 'weapon5': '0.250', 'AMMO3': '0.282', 'AMMO4': '0.287', 'weapon2': '0.518', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.680', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 616546304. Throughput: 0: 4386.5. Samples: 154135690. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:16:47,794][52567] Avg episode reward: [(0, '74.951')] [2024-08-06 07:16:48,133][52647] DAMAGECOUNT value on done: 896357.0 [2024-08-06 07:16:48,134][52647] Sum rewards: 72.035, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.416', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.090', 'weapon4': '0.126', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '61.000'} [2024-08-06 07:16:49,316][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:16:49,494][52671] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:16:49,540][52820] DAMAGECOUNT value on done: 782953.0 [2024-08-06 07:16:49,543][52820] Sum rewards: 85.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.743', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.056', 'weapon4': '0.076', 'AMMO4': '0.119', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '72.000'} [2024-08-06 07:16:49,964][52795] DAMAGECOUNT value on done: 784514.0 [2024-08-06 07:16:49,965][52795] Sum rewards: 78.451, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.522', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.183', 'weapon2': '0.200', 'AMMO3': '0.220', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '67.000'} [2024-08-06 07:16:50,093][52662] DAMAGECOUNT value on done: 841175.0 [2024-08-06 07:16:50,093][52662] Sum rewards: 71.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon4': '0.236', 'weapon2': '0.248', 'WEAPON3': '1.150', 'weapon3': '3.234', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:50,126][52666] DAMAGECOUNT value on done: 837111.0 [2024-08-06 07:16:50,126][52666] Sum rewards: 83.648, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.246', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.062', 'AMMO4': '0.101', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.238', 'WEAPON3': '1.450', 'weapon3': '3.340', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '71.000'} [2024-08-06 07:16:50,427][52670] DAMAGECOUNT value on done: 816200.0 [2024-08-06 07:16:50,428][52670] Sum rewards: 68.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.949', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '56.000'} [2024-08-06 07:16:50,542][52668] DAMAGECOUNT value on done: 845499.0 [2024-08-06 07:16:50,544][52668] Sum rewards: 83.188, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.181', 'weapon2': '0.830', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '67.000'} [2024-08-06 07:16:50,646][52803] DAMAGECOUNT value on done: 790426.0 [2024-08-06 07:16:50,646][52803] Sum rewards: 77.744, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.054', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.080', 'weapon4': '0.132', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:51,350][52647] DAMAGECOUNT value on done: 885409.0 [2024-08-06 07:16:51,351][52647] Sum rewards: 76.491, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.661', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.263', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:51,923][52650] Updated weights for policy 0, policy_version 75271 (0.0013) [2024-08-06 07:16:52,600][52666] DAMAGECOUNT value on done: 837217.0 [2024-08-06 07:16:52,600][52666] Sum rewards: 86.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.067', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.268', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '72.000'} [2024-08-06 07:16:52,626][52820] DAMAGECOUNT value on done: 783028.0 [2024-08-06 07:16:52,627][52820] Sum rewards: 73.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.770', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.184', 'AMMO3': '0.209', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.436', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '59.000'} [2024-08-06 07:16:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 616628224. Throughput: 0: 4381.1. Samples: 154161900. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:16:52,794][52567] Avg episode reward: [(0, '75.349')] [2024-08-06 07:16:52,931][52670] DAMAGECOUNT value on done: 832606.0 [2024-08-06 07:16:52,934][52670] Sum rewards: 61.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.050', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.458', 'WEAPON3': '1.600', 'weapon3': '3.266', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '53.000'} [2024-08-06 07:16:53,167][52662] DAMAGECOUNT value on done: 850972.0 [2024-08-06 07:16:53,168][52662] Sum rewards: 63.998, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.500', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.216', 'AMMO3': '0.229', 'weapon5': '0.246', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.684', 'WEAPON3': '1.400', 'weapon3': '2.578', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '54.000'} [2024-08-06 07:16:53,251][52795] DAMAGECOUNT value on done: 769647.0 [2024-08-06 07:16:53,251][52795] Sum rewards: 85.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.330', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.178', 'weapon5': '0.198', 'AMMO3': '0.217', 'AMMO4': '0.258', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.966', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.918', 'FRAGCOUNT': '71.000'} [2024-08-06 07:16:53,748][52668] DAMAGECOUNT value on done: 846239.0 [2024-08-06 07:16:53,748][52668] Sum rewards: 86.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '72.000'} [2024-08-06 07:16:53,812][52803] DAMAGECOUNT value on done: 787644.0 [2024-08-06 07:16:53,813][52803] Sum rewards: 72.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.740', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.154', 'weapon5': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.970', 'WEAPON3': '1.000', 'weapon3': '2.288', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.500'} [2024-08-06 07:16:53,825][52647] DAMAGECOUNT value on done: 891942.0 [2024-08-06 07:16:53,825][52647] Sum rewards: 68.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.528', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.194', 'AMMO4': '0.211', 'weapon2': '0.236', 'weapon5': '0.272', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '56.000'} [2024-08-06 07:16:54,078][52669] Large shaping reward 2.527 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2024-08-06 07:16:55,594][52666] DAMAGECOUNT value on done: 830456.0 [2024-08-06 07:16:55,595][52666] Sum rewards: 64.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.384', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.074', 'AMMO3': '0.229', 'weapon5': '0.244', 'AMMO4': '0.273', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '53.000'} [2024-08-06 07:16:55,723][52820] DAMAGECOUNT value on done: 792261.0 [2024-08-06 07:16:55,726][52820] Sum rewards: 66.042, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.022', 'AMMO2': '0.057', 'AMMO3': '0.239', 'AMMO4': '0.286', 'weapon5': '0.296', 'weapon4': '0.326', 'weapon2': '0.378', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.690', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '54.000'} [2024-08-06 07:16:55,976][52670] DAMAGECOUNT value on done: 841908.0 [2024-08-06 07:16:55,976][52670] Sum rewards: 62.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon2': '0.170', 'weapon4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.245', 'AMMO4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.264', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '53.000'} [2024-08-06 07:16:56,026][52662] DAMAGECOUNT value on done: 851881.0 [2024-08-06 07:16:56,026][52662] Sum rewards: 56.628, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.126', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.138', 'AMMO4': '0.174', 'weapon2': '0.188', 'AMMO3': '0.293', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.930', 'weapon3': '3.330', 'DAMAGECOUNT': '14.418', 'FRAGCOUNT': '52.000'} [2024-08-06 07:16:56,401][52795] DAMAGECOUNT value on done: 782475.0 [2024-08-06 07:16:56,402][52795] Sum rewards: 66.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon7': '0.138', 'weapon4': '0.158', 'AMMO6': '0.160', 'AMMO7': '0.160', 'weapon5': '0.162', 'WEAPON7': '0.200', 'AMMO3': '0.218', 'AMMO4': '0.238', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.818', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '55.000'} [2024-08-06 07:16:56,760][52650] Updated weights for policy 0, policy_version 75281 (0.0030) [2024-08-06 07:16:56,849][52647] DAMAGECOUNT value on done: 892058.0 [2024-08-06 07:16:56,851][52647] Sum rewards: 75.821, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.138', 'AMMO4': '0.191', 'AMMO3': '0.216', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:56,967][52668] DAMAGECOUNT value on done: 836117.0 [2024-08-06 07:16:56,968][52668] Sum rewards: 74.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.195', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.610', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '62.000'} [2024-08-06 07:16:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 616726528. Throughput: 0: 4375.3. Samples: 154188020. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:16:57,794][52567] Avg episode reward: [(0, '74.637')] [2024-08-06 07:16:58,687][52666] DAMAGECOUNT value on done: 830892.0 [2024-08-06 07:16:58,687][52666] Sum rewards: 67.277, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.252', 'AMMO3': '0.305', 'WEAPON3': '1.800', 'HITCOUNT': '3.250', 'weapon3': '3.352', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 07:16:58,791][52820] DAMAGECOUNT value on done: 789616.0 [2024-08-06 07:16:58,792][52820] Sum rewards: 72.179, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.088', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '58.000'} [2024-08-06 07:16:58,828][52662] DAMAGECOUNT value on done: 837509.0 [2024-08-06 07:16:58,829][52662] Sum rewards: 79.091, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.135', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.048', 'weapon5': '0.058', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '65.000'} [2024-08-06 07:16:59,106][52670] DAMAGECOUNT value on done: 834311.0 [2024-08-06 07:16:59,106][52670] Sum rewards: 73.571, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.866', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.104', 'AMMO4': '0.155', 'weapon5': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.700', 'weapon3': '3.066', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '63.000'} [2024-08-06 07:16:59,189][52664] DAMAGECOUNT value on done: 871630.0 [2024-08-06 07:16:59,192][52664] Sum rewards: 82.295, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.228', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.297', 'WEAPON3': '1.800', 'weapon3': '3.360', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.940', 'FRAGCOUNT': '71.000'} [2024-08-06 07:16:59,531][52795] DAMAGECOUNT value on done: 780735.0 [2024-08-06 07:16:59,533][52795] Sum rewards: 82.775, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.268', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.042', 'AMMO4': '0.086', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '66.000'} [2024-08-06 07:16:59,548][52647] DAMAGECOUNT value on done: 897564.0 [2024-08-06 07:16:59,548][52647] Sum rewards: 72.433, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.069', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:00,150][52668] DAMAGECOUNT value on done: 839558.0 [2024-08-06 07:17:00,151][52668] Sum rewards: 78.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.415', 'AMMO4': '-0.020', 'AMMO2': '-0.004', 'AMMO3': '0.226', 'weapon2': '0.410', 'WEAPON3': '1.550', 'weapon3': '3.404', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '66.000'} [2024-08-06 07:17:01,366][52650] Updated weights for policy 0, policy_version 75291 (0.0011) [2024-08-06 07:17:01,623][52662] DAMAGECOUNT value on done: 855372.0 [2024-08-06 07:17:01,625][52662] Sum rewards: 86.358, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.892', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.132', 'AMMO3': '0.176', 'weapon5': '0.178', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.968', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '68.000'} [2024-08-06 07:17:01,713][52664] DAMAGECOUNT value on done: 876163.0 [2024-08-06 07:17:01,715][52664] Sum rewards: 74.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.735', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.122', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:01,786][52666] DAMAGECOUNT value on done: 846007.0 [2024-08-06 07:17:01,786][52666] Sum rewards: 74.888, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.086', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.219', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon5': '0.258', 'weapon4': '0.306', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:01,886][52820] DAMAGECOUNT value on done: 772479.0 [2024-08-06 07:17:01,887][52820] Sum rewards: 64.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.416', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.306', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '54.000'} [2024-08-06 07:17:02,121][52670] DAMAGECOUNT value on done: 836449.0 [2024-08-06 07:17:02,123][52670] Sum rewards: 67.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO3': '0.182', 'AMMO4': '0.202', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '55.000'} [2024-08-06 07:17:02,159][52647] DAMAGECOUNT value on done: 893848.0 [2024-08-06 07:17:02,160][52647] Sum rewards: 84.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.367', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.106', 'weapon5': '0.110', 'AMMO4': '0.131', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '68.000'} [2024-08-06 07:17:02,791][52795] DAMAGECOUNT value on done: 769624.0 [2024-08-06 07:17:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 616808448. Throughput: 0: 4373.6. Samples: 154201110. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:02,792][52795] Sum rewards: 70.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.072', 'weapon5': '0.164', 'AMMO3': '0.210', 'AMMO4': '0.239', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '59.000'} [2024-08-06 07:17:02,795][52567] Avg episode reward: [(0, '74.867')] [2024-08-06 07:17:03,302][52668] DAMAGECOUNT value on done: 848278.0 [2024-08-06 07:17:03,303][52668] Sum rewards: 79.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.815', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.144', 'weapon5': '0.212', 'AMMO3': '0.215', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '65.500'} [2024-08-06 07:17:04,265][52662] DAMAGECOUNT value on done: 833285.0 [2024-08-06 07:17:04,265][52662] Sum rewards: 70.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.870', 'AMMO5': '0.014', 'AMMO2': '0.057', 'weapon4': '0.078', 'AMMO3': '0.187', 'weapon5': '0.218', 'AMMO4': '0.283', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '55.500'} [2024-08-06 07:17:04,418][52664] DAMAGECOUNT value on done: 877458.0 [2024-08-06 07:17:04,419][52664] Sum rewards: 83.871, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.606', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.044', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'weapon2': '0.196', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.404', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '70.000'} [2024-08-06 07:17:04,747][52647] DAMAGECOUNT value on done: 896542.0 [2024-08-06 07:17:04,748][52647] Sum rewards: 65.971, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.584', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon4': '0.208', 'weapon5': '0.228', 'AMMO4': '0.290', 'weapon2': '0.314', 'AMMO3': '0.334', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.900', 'weapon3': '2.916', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:04,759][52666] DAMAGECOUNT value on done: 823460.0 [2024-08-06 07:17:04,761][52666] Sum rewards: 83.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.128', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.074', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '69.000'} [2024-08-06 07:17:05,874][52650] Updated weights for policy 0, policy_version 75301 (0.0023) [2024-08-06 07:17:05,963][52795] DAMAGECOUNT value on done: 778049.0 [2024-08-06 07:17:05,966][52795] Sum rewards: 57.198, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.024', 'weapon5': '0.074', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.648', 'WEAPON3': '1.150', 'HITCOUNT': '2.620', 'weapon3': '3.070', 'DAMAGECOUNT': '13.044', 'FRAGCOUNT': '48.000'} [2024-08-06 07:17:06,447][52668] DAMAGECOUNT value on done: 839409.0 [2024-08-06 07:17:06,456][52668] Sum rewards: 73.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.560', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.102', 'AMMO3': '0.159', 'AMMO4': '0.182', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.954', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:07,129][52664] DAMAGECOUNT value on done: 869576.0 [2024-08-06 07:17:07,129][52664] Sum rewards: 73.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.244', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:07,176][52662] DAMAGECOUNT value on done: 840921.0 [2024-08-06 07:17:07,176][52662] Sum rewards: 84.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.981', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.156', 'AMMO4': '0.157', 'weapon2': '0.170', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '73.000'} [2024-08-06 07:17:07,533][52647] DAMAGECOUNT value on done: 873836.0 [2024-08-06 07:17:07,534][52647] Sum rewards: 67.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.076', 'weapon5': '0.208', 'AMMO3': '0.235', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '56.000'} [2024-08-06 07:17:07,725][52666] DAMAGECOUNT value on done: 831292.0 [2024-08-06 07:17:07,729][52666] Sum rewards: 76.098, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.522', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.074', 'weapon4': '0.080', 'AMMO4': '0.147', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.408', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '63.000'} [2024-08-06 07:17:07,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 616898560. Throughput: 0: 4376.4. Samples: 154227650. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:07,795][52567] Avg episode reward: [(0, '75.080')] [2024-08-06 07:17:09,207][52795] DAMAGECOUNT value on done: 784920.0 [2024-08-06 07:17:09,209][52795] Sum rewards: 65.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.954', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.086', 'AMMO4': '0.139', 'weapon5': '0.142', 'AMMO3': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2024-08-06 07:17:09,432][52668] DAMAGECOUNT value on done: 836286.0 [2024-08-06 07:17:09,434][52668] Sum rewards: 66.915, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.590', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.428', 'WEAPON3': '1.650', 'weapon3': '3.158', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '61.000'} [2024-08-06 07:17:09,824][52664] DAMAGECOUNT value on done: 878458.0 [2024-08-06 07:17:09,825][52664] Sum rewards: 68.930, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.374', 'WEAPON3': '1.200', 'HITCOUNT': '3.180', 'weapon3': '3.402', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '56.000'} [2024-08-06 07:17:10,025][52647] DAMAGECOUNT value on done: 890617.0 [2024-08-06 07:17:10,025][52647] Sum rewards: 68.284, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.840', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.172', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'AMMO3': '0.274', 'WEAPON3': '1.650', 'weapon3': '3.024', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:10,490][52662] DAMAGECOUNT value on done: 858713.0 [2024-08-06 07:17:10,490][52662] Sum rewards: 82.112, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'weapon5': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '67.000'} [2024-08-06 07:17:10,609][52650] Updated weights for policy 0, policy_version 75311 (0.0014) [2024-08-06 07:17:12,073][52664] DAMAGECOUNT value on done: 876558.0 [2024-08-06 07:17:12,073][52664] Sum rewards: 91.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'weapon3': '3.488', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.477', 'FRAGCOUNT': '76.000'} [2024-08-06 07:17:12,169][52668] DAMAGECOUNT value on done: 831777.0 [2024-08-06 07:17:12,169][52668] Sum rewards: 84.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.334', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO4': '0.153', 'AMMO3': '0.199', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.352', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '68.000'} [2024-08-06 07:17:12,479][52647] DAMAGECOUNT value on done: 888729.0 [2024-08-06 07:17:12,479][52647] Sum rewards: 72.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.522', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.076', 'AMMO4': '0.122', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 616980480. Throughput: 0: 4365.8. Samples: 154253650. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:12,795][52567] Avg episode reward: [(0, '75.087')] [2024-08-06 07:17:13,058][52662] DAMAGECOUNT value on done: 844303.0 [2024-08-06 07:17:13,061][52662] Sum rewards: 68.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.170', 'AMMO4': '0.212', 'AMMO3': '0.218', 'weapon4': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '2.852', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.461', 'FRAGCOUNT': '57.000'} [2024-08-06 07:17:15,002][52668] DAMAGECOUNT value on done: 832056.0 [2024-08-06 07:17:15,002][52668] Sum rewards: 71.358, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon2': '0.176', 'AMMO3': '0.193', 'weapon5': '0.294', 'AMMO4': '0.311', 'weapon4': '0.424', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.704', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:15,060][52664] DAMAGECOUNT value on done: 869147.0 [2024-08-06 07:17:15,061][52664] Sum rewards: 61.017, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.167', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.102', 'weapon2': '0.206', 'weapon5': '0.214', 'AMMO3': '0.256', 'AMMO4': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.206', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '54.000'} [2024-08-06 07:17:15,183][52647] DAMAGECOUNT value on done: 886734.0 [2024-08-06 07:17:15,185][52647] Sum rewards: 67.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon4': '0.094', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.632', 'WEAPON3': '1.450', 'weapon3': '2.758', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '57.000'} [2024-08-06 07:17:15,418][52650] Updated weights for policy 0, policy_version 75321 (0.0013) [2024-08-06 07:17:15,825][52667] DAMAGECOUNT value on done: 842676.0 [2024-08-06 07:17:15,826][52667] Sum rewards: 74.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon4': '0.102', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.744', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '59.000'} [2024-08-06 07:17:15,929][52662] DAMAGECOUNT value on done: 851538.0 [2024-08-06 07:17:15,929][52662] Sum rewards: 86.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.551', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.096', 'AMMO4': '0.198', 'AMMO3': '0.226', 'weapon2': '0.230', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '21.051', 'FRAGCOUNT': '71.000'} [2024-08-06 07:17:17,522][52664] DAMAGECOUNT value on done: 864530.0 [2024-08-06 07:17:17,523][52664] Sum rewards: 68.509, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.070', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.084', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon4': '0.246', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '56.000'} [2024-08-06 07:17:17,553][52647] DAMAGECOUNT value on done: 876645.0 [2024-08-06 07:17:17,554][52647] Sum rewards: 74.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.174', 'weapon2': '0.194', 'weapon5': '0.198', 'AMMO4': '0.209', 'AMMO3': '0.237', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:17,600][52668] DAMAGECOUNT value on done: 827157.0 [2024-08-06 07:17:17,602][52668] Sum rewards: 70.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.142', 'AMMO3': '0.205', 'AMMO4': '0.208', 'weapon5': '0.306', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '2.956', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:17,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 617062400. Throughput: 0: 4384.5. Samples: 154267020. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:17,794][52567] Avg episode reward: [(0, '74.660')] [2024-08-06 07:17:18,460][52667] DAMAGECOUNT value on done: 853110.0 [2024-08-06 07:17:18,460][52667] Sum rewards: 80.100, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.978', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.350', 'weapon4': '0.368', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '64.500'} [2024-08-06 07:17:19,285][52662] DAMAGECOUNT value on done: 840583.0 [2024-08-06 07:17:19,286][52662] Sum rewards: 83.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.151', 'weapon2': '0.152', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.392', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '66.000'} [2024-08-06 07:17:19,943][52647] DAMAGECOUNT value on done: 891962.0 [2024-08-06 07:17:19,944][52647] Sum rewards: 57.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.086', 'weapon5': '0.150', 'AMMO3': '0.180', 'AMMO4': '0.210', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '49.000'} [2024-08-06 07:17:19,949][52664] DAMAGECOUNT value on done: 876709.0 [2024-08-06 07:17:19,950][52664] Sum rewards: 51.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.880', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.212', 'weapon5': '0.290', 'weapon4': '0.292', 'AMMO4': '0.327', 'weapon2': '0.432', 'WEAPON5': '0.550', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'HITCOUNT': '2.340', 'weapon3': '2.682', 'DAMAGECOUNT': '12.933', 'FRAGCOUNT': '47.000'} [2024-08-06 07:17:20,242][52650] Updated weights for policy 0, policy_version 75331 (0.0020) [2024-08-06 07:17:20,599][52668] DAMAGECOUNT value on done: 841099.0 [2024-08-06 07:17:20,601][52668] Sum rewards: 69.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.696', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon2': '0.182', 'AMMO3': '0.188', 'weapon4': '0.222', 'AMMO4': '0.299', 'weapon5': '0.362', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '2.740', 'weapon3': '2.918', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '56.000'} [2024-08-06 07:17:21,683][52667] DAMAGECOUNT value on done: 848044.0 [2024-08-06 07:17:21,685][52667] Sum rewards: 69.744, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.590', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.084', 'AMMO4': '0.225', 'weapon5': '0.240', 'AMMO3': '0.265', 'weapon2': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.112', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:22,381][52662] DAMAGECOUNT value on done: 843389.0 [2024-08-06 07:17:22,383][52662] Sum rewards: 70.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.815', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon5': '0.134', 'weapon4': '0.166', 'AMMO3': '0.177', 'AMMO4': '0.211', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:22,452][52660] DAMAGECOUNT value on done: 839556.0 [2024-08-06 07:17:22,454][52660] Sum rewards: 65.906, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.530', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.096', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.306', 'WEAPON3': '1.800', 'weapon3': '3.306', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:22,765][52647] DAMAGECOUNT value on done: 881113.0 [2024-08-06 07:17:22,765][52647] Sum rewards: 74.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.329', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.146', 'AMMO4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.726', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:22,789][52664] DAMAGECOUNT value on done: 871647.0 [2024-08-06 07:17:22,789][52664] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.238', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.120', 'weapon4': '0.194', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:22,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 617152512. Throughput: 0: 4378.9. Samples: 154293160. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:22,794][52567] Avg episode reward: [(0, '74.291')] [2024-08-06 07:17:23,389][52668] DAMAGECOUNT value on done: 845240.0 [2024-08-06 07:17:23,391][52668] Sum rewards: 75.478, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'AMMO5': '0.008', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.042', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '61.000'} [2024-08-06 07:17:24,128][52670] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon5', 0.002)] [2024-08-06 07:17:24,684][52650] Updated weights for policy 0, policy_version 75341 (0.0013) [2024-08-06 07:17:24,760][52667] DAMAGECOUNT value on done: 855069.0 [2024-08-06 07:17:24,760][52667] Sum rewards: 65.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.215', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.090', 'weapon5': '0.146', 'AMMO4': '0.160', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '53.000'} [2024-08-06 07:17:25,093][52662] DAMAGECOUNT value on done: 835566.0 [2024-08-06 07:17:25,093][52662] Sum rewards: 74.106, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.285', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.204', 'weapon4': '0.226', 'AMMO4': '0.263', 'AMMO3': '0.267', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.916', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '65.000'} [2024-08-06 07:17:25,394][52660] DAMAGECOUNT value on done: 832452.0 [2024-08-06 07:17:25,396][52660] Sum rewards: 79.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '65.000'} [2024-08-06 07:17:25,489][52647] DAMAGECOUNT value on done: 891335.0 [2024-08-06 07:17:25,489][52647] Sum rewards: 80.673, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.523', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.152', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '67.500'} [2024-08-06 07:17:25,593][52664] DAMAGECOUNT value on done: 882823.0 [2024-08-06 07:17:25,594][52664] Sum rewards: 69.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.944', 'AMMO5': '0.018', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.128', 'AMMO3': '0.232', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '57.500'} [2024-08-06 07:17:26,388][52668] DAMAGECOUNT value on done: 842872.0 [2024-08-06 07:17:26,388][52668] Sum rewards: 85.066, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.186', 'AMMO3': '0.242', 'weapon2': '0.242', 'weapon4': '0.252', 'AMMO4': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '70.000'} [2024-08-06 07:17:27,696][52662] DAMAGECOUNT value on done: 849470.0 [2024-08-06 07:17:27,696][52662] Sum rewards: 70.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.750', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.176', 'AMMO3': '0.222', 'weapon2': '0.262', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.990', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 07:17:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17439.2). Total num frames: 617242624. Throughput: 0: 4374.0. Samples: 154319260. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:27,802][52567] Avg episode reward: [(0, '73.869')] [2024-08-06 07:17:27,898][52667] DAMAGECOUNT value on done: 855078.0 [2024-08-06 07:17:27,898][52667] Sum rewards: 75.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.890', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.038', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.212', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:28,066][52660] DAMAGECOUNT value on done: 844050.0 [2024-08-06 07:17:28,068][52660] Sum rewards: 76.505, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.256', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.126', 'AMMO3': '0.191', 'weapon5': '0.208', 'weapon2': '0.230', 'AMMO4': '0.243', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '63.000'} [2024-08-06 07:17:28,318][52647] DAMAGECOUNT value on done: 891175.0 [2024-08-06 07:17:28,318][52647] Sum rewards: 68.950, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.102', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.088', 'weapon2': '0.180', 'AMMO4': '0.200', 'weapon5': '0.254', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '59.000'} [2024-08-06 07:17:28,407][52664] DAMAGECOUNT value on done: 881032.0 [2024-08-06 07:17:28,408][52664] Sum rewards: 83.468, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.122', 'weapon5': '0.122', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '71.000'} [2024-08-06 07:17:28,770][52668] DAMAGECOUNT value on done: 847681.0 [2024-08-06 07:17:28,770][52668] Sum rewards: 84.547, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.126', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.139', 'weapon4': '0.212', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.225', 'FRAGCOUNT': '71.000'} [2024-08-06 07:17:29,352][52650] Updated weights for policy 0, policy_version 75351 (0.0023) [2024-08-06 07:17:30,190][52662] DAMAGECOUNT value on done: 837073.0 [2024-08-06 07:17:30,192][52662] Sum rewards: 71.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon5': '0.132', 'AMMO3': '0.178', 'AMMO4': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:30,500][52614] Signal inference workers to stop experience collection... (13750 times) [2024-08-06 07:17:30,504][52614] Signal inference workers to resume experience collection... (13750 times) [2024-08-06 07:17:30,591][52650] InferenceWorker_p0-w0: stopping experience collection (13750 times) [2024-08-06 07:17:30,591][52650] InferenceWorker_p0-w0: resuming experience collection (13750 times) [2024-08-06 07:17:30,652][52667] DAMAGECOUNT value on done: 853857.0 [2024-08-06 07:17:30,652][52667] Sum rewards: 82.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.545', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.084', 'weapon5': '0.184', 'AMMO3': '0.242', 'AMMO4': '0.266', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.182', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.820', 'FRAGCOUNT': '68.000'} [2024-08-06 07:17:30,744][52647] DAMAGECOUNT value on done: 878371.0 [2024-08-06 07:17:30,744][52647] Sum rewards: 82.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.591', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.388', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '69.000'} [2024-08-06 07:17:30,816][52664] DAMAGECOUNT value on done: 879840.0 [2024-08-06 07:17:30,816][52664] Sum rewards: 71.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon2': '0.218', 'AMMO3': '0.237', 'WEAPON3': '1.550', 'HITCOUNT': '3.380', 'weapon3': '3.466', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:30,893][52660] DAMAGECOUNT value on done: 855828.0 [2024-08-06 07:17:30,893][52660] Sum rewards: 78.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon2': '0.146', 'weapon5': '0.166', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '66.000'} [2024-08-06 07:17:31,732][52668] DAMAGECOUNT value on done: 847362.0 [2024-08-06 07:17:31,732][52668] Sum rewards: 73.589, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.259', 'WEAPON3': '1.550', 'HITCOUNT': '3.390', 'weapon3': '3.408', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '63.000'} [2024-08-06 07:17:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 617324544. Throughput: 0: 4372.2. Samples: 154332440. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:32,795][52567] Avg episode reward: [(0, '73.914')] [2024-08-06 07:17:33,049][52647] DAMAGECOUNT value on done: 883413.0 [2024-08-06 07:17:33,049][52647] Sum rewards: 88.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.392', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.108', 'weapon4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.314', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.153', 'FRAGCOUNT': '73.000'} [2024-08-06 07:17:33,324][52664] DAMAGECOUNT value on done: 891360.0 [2024-08-06 07:17:33,326][52664] Sum rewards: 79.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.396', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '64.000'} [2024-08-06 07:17:33,379][52667] DAMAGECOUNT value on done: 848972.0 [2024-08-06 07:17:33,381][52667] Sum rewards: 70.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.344', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.186', 'AMMO4': '0.189', 'weapon4': '0.236', 'AMMO3': '0.244', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '59.000'} [2024-08-06 07:17:33,405][52662] DAMAGECOUNT value on done: 854290.0 [2024-08-06 07:17:33,406][52662] Sum rewards: 71.064, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.440', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.126', 'AMMO4': '0.190', 'weapon4': '0.230', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.922', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '62.000'} [2024-08-06 07:17:34,002][52650] Updated weights for policy 0, policy_version 75361 (0.0020) [2024-08-06 07:17:34,082][52660] DAMAGECOUNT value on done: 836799.0 [2024-08-06 07:17:34,086][52660] Sum rewards: 77.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.096', 'AMMO3': '0.204', 'AMMO4': '0.231', 'weapon4': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '64.000'} [2024-08-06 07:17:35,783][52647] DAMAGECOUNT value on done: 876590.0 [2024-08-06 07:17:35,783][52647] Sum rewards: 84.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.076', 'AMMO4': '0.130', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.650', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.438', 'FRAGCOUNT': '66.000'} [2024-08-06 07:17:35,867][52667] DAMAGECOUNT value on done: 845373.0 [2024-08-06 07:17:35,869][52667] Sum rewards: 76.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.567', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '64.000'} [2024-08-06 07:17:36,074][52664] DAMAGECOUNT value on done: 886506.0 [2024-08-06 07:17:36,074][52664] Sum rewards: 67.921, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.906', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.254', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '3.402', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:36,189][52662] DAMAGECOUNT value on done: 847720.0 [2024-08-06 07:17:36,192][52662] Sum rewards: 76.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'weapon2': '0.240', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.508', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '65.000'} [2024-08-06 07:17:37,296][52660] DAMAGECOUNT value on done: 835386.0 [2024-08-06 07:17:37,297][52660] Sum rewards: 84.462, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.491', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.176', 'AMMO4': '0.195', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '68.000'} [2024-08-06 07:17:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 617422848. Throughput: 0: 4373.6. Samples: 154358710. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:17:37,794][52567] Avg episode reward: [(0, '74.099')] [2024-08-06 07:17:38,292][52659] DAMAGECOUNT value on done: 845479.0 [2024-08-06 07:17:38,294][52659] Sum rewards: 77.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.141', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon2': '0.174', 'AMMO3': '0.206', 'weapon5': '0.228', 'AMMO4': '0.245', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.810', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '63.000'} [2024-08-06 07:17:38,519][52647] DAMAGECOUNT value on done: 879583.0 [2024-08-06 07:17:38,519][52647] Sum rewards: 69.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.155', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.112', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:38,704][52664] DAMAGECOUNT value on done: 885237.0 [2024-08-06 07:17:38,704][52664] Sum rewards: 73.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.322', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.114', 'weapon5': '0.172', 'AMMO4': '0.201', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:39,030][52667] DAMAGECOUNT value on done: 847695.0 [2024-08-06 07:17:39,030][52667] Sum rewards: 79.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.064', 'weapon5': '0.106', 'AMMO4': '0.161', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '65.000'} [2024-08-06 07:17:39,062][52650] Updated weights for policy 0, policy_version 75371 (0.0029) [2024-08-06 07:17:39,518][52662] DAMAGECOUNT value on done: 832033.0 [2024-08-06 07:17:39,518][52662] Sum rewards: 78.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.207', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO4': '0.214', 'AMMO3': '0.218', 'weapon4': '0.262', 'weapon5': '0.298', 'weapon2': '0.360', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.716', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '66.000'} [2024-08-06 07:17:40,013][52660] DAMAGECOUNT value on done: 841717.0 [2024-08-06 07:17:40,015][52660] Sum rewards: 73.340, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.900', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO4': '0.236', 'weapon5': '0.256', 'weapon2': '0.274', 'weapon4': '0.296', 'AMMO3': '0.302', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.800', 'weapon3': '2.838', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '63.000'} [2024-08-06 07:17:41,203][52659] DAMAGECOUNT value on done: 842510.0 [2024-08-06 07:17:41,204][52659] Sum rewards: 84.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.062', 'weapon5': '0.088', 'AMMO4': '0.134', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.318', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '69.000'} [2024-08-06 07:17:41,462][52664] DAMAGECOUNT value on done: 870881.0 [2024-08-06 07:17:41,462][52664] Sum rewards: 70.715, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.143', 'weapon2': '0.216', 'AMMO4': '0.220', 'weapon5': '0.226', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'weapon3': '2.950', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '56.000'} [2024-08-06 07:17:42,021][52667] DAMAGECOUNT value on done: 853237.0 [2024-08-06 07:17:42,022][52667] Sum rewards: 84.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.628', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '68.000'} [2024-08-06 07:17:42,694][52662] DAMAGECOUNT value on done: 841868.0 [2024-08-06 07:17:42,696][52662] Sum rewards: 79.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.445', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.078', 'weapon5': '0.180', 'weapon2': '0.228', 'AMMO3': '0.231', 'AMMO4': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '66.000'} [2024-08-06 07:17:42,794][52567] Fps is (10 sec: 18842.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 617512960. Throughput: 0: 4374.2. Samples: 154384860. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:17:42,794][52567] Avg episode reward: [(0, '74.173')] [2024-08-06 07:17:43,122][52660] DAMAGECOUNT value on done: 848241.0 [2024-08-06 07:17:43,124][52660] Sum rewards: 61.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.245', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.120', 'weapon5': '0.216', 'AMMO3': '0.236', 'AMMO4': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '53.500'} [2024-08-06 07:17:43,319][52650] Updated weights for policy 0, policy_version 75381 (0.0022) [2024-08-06 07:17:43,793][52659] DAMAGECOUNT value on done: 849430.0 [2024-08-06 07:17:43,795][52659] Sum rewards: 80.818, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.368', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '69.000'} [2024-08-06 07:17:44,276][52664] DAMAGECOUNT value on done: 876295.0 [2024-08-06 07:17:44,277][52664] Sum rewards: 84.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.460', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.096', 'AMMO4': '0.103', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '67.000'} [2024-08-06 07:17:44,607][52667] DAMAGECOUNT value on done: 840966.0 [2024-08-06 07:17:44,608][52667] Sum rewards: 76.983, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.084', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.160', 'weapon2': '0.602', 'WEAPON3': '1.000', 'weapon3': '3.082', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 07:17:45,613][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:17:46,037][52662] DAMAGECOUNT value on done: 835025.0 [2024-08-06 07:17:46,038][52662] Sum rewards: 93.635, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.187', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.054', 'AMMO4': '0.066', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.198', 'WEAPON3': '1.050', 'weapon3': '3.490', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '76.000'} [2024-08-06 07:17:46,456][52660] DAMAGECOUNT value on done: 835805.0 [2024-08-06 07:17:46,456][52660] Sum rewards: 81.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.149', 'weapon2': '0.178', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.470', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '67.000'} [2024-08-06 07:17:46,724][52664] DAMAGECOUNT value on done: 877763.0 [2024-08-06 07:17:46,725][52664] Sum rewards: 79.931, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.966', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.320', 'weapon2': '0.340', 'WEAPON3': '1.950', 'weapon3': '3.222', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '70.000'} [2024-08-06 07:17:46,934][52659] DAMAGECOUNT value on done: 845041.0 [2024-08-06 07:17:46,934][52659] Sum rewards: 70.061, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.638', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.216', 'AMMO3': '0.226', 'AMMO4': '0.240', 'weapon4': '0.306', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '57.000'} [2024-08-06 07:17:47,475][52667] DAMAGECOUNT value on done: 845643.0 [2024-08-06 07:17:47,476][52667] Sum rewards: 64.657, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.625', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.036', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.273', 'WEAPON3': '1.650', 'HITCOUNT': '3.180', 'weapon3': '3.398', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '57.000'} [2024-08-06 07:17:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 617594880. Throughput: 0: 4372.7. Samples: 154397880. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:17:47,794][52567] Avg episode reward: [(0, '75.047')] [2024-08-06 07:17:48,098][52650] Updated weights for policy 0, policy_version 75391 (0.0012) [2024-08-06 07:17:49,450][52660] DAMAGECOUNT value on done: 834057.0 [2024-08-06 07:17:49,451][52660] Sum rewards: 64.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.284', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon5': '0.070', 'weapon4': '0.096', 'AMMO4': '0.186', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '56.000'} [2024-08-06 07:17:49,749][52664] DAMAGECOUNT value on done: 870246.0 [2024-08-06 07:17:49,750][52664] Sum rewards: 69.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.680', 'AMMO5': '0.027', 'AMMO2': '0.043', 'weapon4': '0.202', 'AMMO3': '0.209', 'AMMO4': '0.213', 'weapon5': '0.242', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:49,904][52659] DAMAGECOUNT value on done: 842627.0 [2024-08-06 07:17:49,905][52659] Sum rewards: 71.959, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.316', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'weapon4': '0.072', 'AMMO3': '0.168', 'weapon2': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.552', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:50,429][52667] DAMAGECOUNT value on done: 854469.0 [2024-08-06 07:17:50,430][52667] Sum rewards: 78.506, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.505', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.046', 'weapon4': '0.072', 'AMMO3': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2024-08-06 07:17:52,623][52650] Updated weights for policy 0, policy_version 75401 (0.0017) [2024-08-06 07:17:52,736][52659] DAMAGECOUNT value on done: 843310.0 [2024-08-06 07:17:52,738][52659] Sum rewards: 73.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.162', 'AMMO3': '0.210', 'weapon5': '0.228', 'weapon4': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '2.752', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '59.000'} [2024-08-06 07:17:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 617684992. Throughput: 0: 4368.7. Samples: 154424240. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:17:52,802][52567] Avg episode reward: [(0, '74.831')] [2024-08-06 07:17:52,848][52660] DAMAGECOUNT value on done: 846281.0 [2024-08-06 07:17:52,848][52660] Sum rewards: 82.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.073', 'weapon4': '0.132', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '67.000'} [2024-08-06 07:17:53,421][52667] DAMAGECOUNT value on done: 842565.0 [2024-08-06 07:17:53,422][52667] Sum rewards: 72.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.088', 'AMMO4': '0.165', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '59.000'} [2024-08-06 07:17:55,891][52659] DAMAGECOUNT value on done: 846373.0 [2024-08-06 07:17:55,891][52659] Sum rewards: 71.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.951', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.112', 'weapon2': '0.208', 'AMMO3': '0.231', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.444', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2024-08-06 07:17:56,027][52660] DAMAGECOUNT value on done: 833071.0 [2024-08-06 07:17:56,028][52660] Sum rewards: 60.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.952', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.138', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.750', 'weapon3': '3.130', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '53.000'} [2024-08-06 07:17:56,379][52667] DAMAGECOUNT value on done: 850729.0 [2024-08-06 07:17:56,380][52667] Sum rewards: 86.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.373', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.070', 'weapon5': '0.094', 'AMMO4': '0.124', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '71.000'} [2024-08-06 07:17:56,711][52664] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 07:17:57,643][52650] Updated weights for policy 0, policy_version 75411 (0.0011) [2024-08-06 07:17:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 617766912. Throughput: 0: 4374.0. Samples: 154450480. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:17:57,802][52567] Avg episode reward: [(0, '74.600')] [2024-08-06 07:17:58,944][52659] DAMAGECOUNT value on done: 844806.0 [2024-08-06 07:17:58,946][52659] Sum rewards: 72.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.074', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.170', 'weapon5': '0.250', 'weapon2': '0.328', 'AMMO4': '0.330', 'weapon4': '0.332', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '58.000'} [2024-08-06 07:17:59,118][52667] DAMAGECOUNT value on done: 856510.0 [2024-08-06 07:17:59,120][52667] Sum rewards: 89.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.584', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.037', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.400', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '73.000'} [2024-08-06 07:17:59,126][52660] DAMAGECOUNT value on done: 838489.0 [2024-08-06 07:17:59,127][52660] Sum rewards: 75.966, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.511', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO3': '0.146', 'weapon4': '0.152', 'AMMO4': '0.185', 'weapon5': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.936', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 07:18:01,702][52667] DAMAGECOUNT value on done: 856983.0 [2024-08-06 07:18:01,704][52667] Sum rewards: 82.656, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.260', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '66.000'} [2024-08-06 07:18:01,763][52659] DAMAGECOUNT value on done: 844898.0 [2024-08-06 07:18:01,765][52659] Sum rewards: 57.686, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.134', 'weapon5': '0.168', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.500', 'weapon3': '2.852', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.664', 'FRAGCOUNT': '50.000'} [2024-08-06 07:18:01,898][52650] Updated weights for policy 0, policy_version 75421 (0.0010) [2024-08-06 07:18:01,996][52660] DAMAGECOUNT value on done: 850038.0 [2024-08-06 07:18:01,998][52660] Sum rewards: 71.601, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.175', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'weapon4': '0.540', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '57.000'} [2024-08-06 07:18:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 617857024. Throughput: 0: 4371.1. Samples: 154463720. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:18:02,802][52567] Avg episode reward: [(0, '74.732')] [2024-08-06 07:18:04,365][52659] DAMAGECOUNT value on done: 852636.0 [2024-08-06 07:18:04,367][52659] Sum rewards: 62.546, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.727', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.196', 'weapon2': '0.220', 'weapon4': '0.254', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '55.000'} [2024-08-06 07:18:04,727][52667] DAMAGECOUNT value on done: 850854.0 [2024-08-06 07:18:04,729][52667] Sum rewards: 69.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.875', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.174', 'weapon5': '0.190', 'AMMO3': '0.210', 'AMMO4': '0.229', 'weapon2': '0.252', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:05,019][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:18:05,044][52660] DAMAGECOUNT value on done: 861141.0 [2024-08-06 07:18:05,046][52660] Sum rewards: 73.105, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO2': '0.001', 'AMMO4': '0.004', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO3': '0.226', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.000'} [2024-08-06 07:18:06,869][52650] Updated weights for policy 0, policy_version 75431 (0.0019) [2024-08-06 07:18:07,051][52659] DAMAGECOUNT value on done: 838361.0 [2024-08-06 07:18:07,056][52659] Sum rewards: 75.950, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.740', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '63.000'} [2024-08-06 07:18:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 617938944. Throughput: 0: 4366.9. Samples: 154489670. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:18:07,802][52567] Avg episode reward: [(0, '74.638')] [2024-08-06 07:18:07,913][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:18:07,989][52667] DAMAGECOUNT value on done: 849790.0 [2024-08-06 07:18:07,989][52667] Sum rewards: 76.899, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.820', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.172', 'weapon5': '0.172', 'AMMO4': '0.200', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '2.940', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '67.000'} [2024-08-06 07:18:08,229][52660] DAMAGECOUNT value on done: 837933.0 [2024-08-06 07:18:08,229][52660] Sum rewards: 82.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.894', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.062', 'weapon5': '0.156', 'AMMO3': '0.211', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '68.000'} [2024-08-06 07:18:09,699][52659] DAMAGECOUNT value on done: 848866.0 [2024-08-06 07:18:09,700][52659] Sum rewards: 74.673, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.870', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO4': '0.191', 'weapon4': '0.204', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.802', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '61.000'} [2024-08-06 07:18:10,623][52667] DAMAGECOUNT value on done: 855011.0 [2024-08-06 07:18:10,625][52667] Sum rewards: 68.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.075', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.104', 'AMMO3': '0.190', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '56.000'} [2024-08-06 07:18:11,483][52660] DAMAGECOUNT value on done: 845494.0 [2024-08-06 07:18:11,484][52660] Sum rewards: 83.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '68.000'} [2024-08-06 07:18:11,673][52650] Updated weights for policy 0, policy_version 75441 (0.0012) [2024-08-06 07:18:12,692][52659] DAMAGECOUNT value on done: 843292.0 [2024-08-06 07:18:12,692][52659] Sum rewards: 74.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.676', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon4': '0.080', 'weapon5': '0.174', 'AMMO3': '0.234', 'weapon2': '0.276', 'AMMO4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '62.000'} [2024-08-06 07:18:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 618029056. Throughput: 0: 4367.8. Samples: 154515810. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:18:12,794][52567] Avg episode reward: [(0, '74.834')] [2024-08-06 07:18:14,399][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:18:14,677][52660] DAMAGECOUNT value on done: 841778.0 [2024-08-06 07:18:14,678][52660] Sum rewards: 69.822, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO2': '0.036', 'weapon5': '0.074', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:15,952][52659] DAMAGECOUNT value on done: 844034.0 [2024-08-06 07:18:15,955][52659] Sum rewards: 72.376, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.722', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon2': '0.500', 'WEAPON3': '1.000', 'weapon3': '3.216', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:16,161][52650] Updated weights for policy 0, policy_version 75451 (0.0032) [2024-08-06 07:18:17,565][52660] DAMAGECOUNT value on done: 833836.0 [2024-08-06 07:18:17,567][52660] Sum rewards: 74.295, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.152', 'AMMO4': '0.210', 'weapon5': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.392', 'HEALTH': '0.424', 'weapon2': '0.504', 'WEAPON3': '0.850', 'weapon3': '2.652', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '57.000'} [2024-08-06 07:18:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 618119168. Throughput: 0: 4363.6. Samples: 154528800. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:18:17,794][52567] Avg episode reward: [(0, '74.958')] [2024-08-06 07:18:18,811][52659] DAMAGECOUNT value on done: 846899.0 [2024-08-06 07:18:18,813][52659] Sum rewards: 80.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.442', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.047', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.222', 'WEAPON3': '1.250', 'weapon3': '3.502', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '67.000'} [2024-08-06 07:18:20,218][52660] DAMAGECOUNT value on done: 832836.0 [2024-08-06 07:18:20,218][52660] Sum rewards: 59.934, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.729', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.170', 'AMMO3': '0.194', 'weapon5': '0.220', 'AMMO4': '0.223', 'weapon2': '0.250', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.150', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '48.500'} [2024-08-06 07:18:20,893][52650] Updated weights for policy 0, policy_version 75461 (0.0032) [2024-08-06 07:18:21,700][52659] DAMAGECOUNT value on done: 846299.0 [2024-08-06 07:18:21,703][52659] Sum rewards: 72.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.589', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.183', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.276', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '57.000'} [2024-08-06 07:18:22,742][52658] DAMAGECOUNT value on done: 846223.0 [2024-08-06 07:18:22,742][52658] Sum rewards: 77.981, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.024', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '64.000'} [2024-08-06 07:18:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 618209280. Throughput: 0: 4365.1. Samples: 154555140. Policy #0 lag: (min: 0.0, avg: 3.2, max: 9.0) [2024-08-06 07:18:22,794][52567] Avg episode reward: [(0, '74.550')] [2024-08-06 07:18:23,011][52794] DAMAGECOUNT value on done: 840283.0 [2024-08-06 07:18:23,012][52794] Sum rewards: 68.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.439', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.140', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:24,695][52659] DAMAGECOUNT value on done: 855482.0 [2024-08-06 07:18:24,696][52659] Sum rewards: 85.104, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.140', 'AMMO3': '0.170', 'HEALTH': '0.180', 'WEAPON5': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '69.000'} [2024-08-06 07:18:25,683][52650] Updated weights for policy 0, policy_version 75471 (0.0012) [2024-08-06 07:18:25,835][52658] DAMAGECOUNT value on done: 849061.0 [2024-08-06 07:18:25,838][52658] Sum rewards: 77.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.295', 'AMMO5': '0.023', 'AMMO2': '0.066', 'AMMO3': '0.199', 'weapon4': '0.210', 'weapon5': '0.270', 'AMMO4': '0.332', 'weapon2': '0.336', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '66.500'} [2024-08-06 07:18:25,945][52794] DAMAGECOUNT value on done: 849129.0 [2024-08-06 07:18:25,945][52794] Sum rewards: 83.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.138', 'weapon4': '0.196', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '68.000'} [2024-08-06 07:18:27,540][52659] DAMAGECOUNT value on done: 839466.0 [2024-08-06 07:18:27,541][52659] Sum rewards: 73.912, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.614', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.216', 'AMMO3': '0.220', 'AMMO4': '0.235', 'weapon4': '0.258', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.946', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '61.000'} [2024-08-06 07:18:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 618291200. Throughput: 0: 4365.1. Samples: 154581290. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:18:27,802][52567] Avg episode reward: [(0, '75.005')] [2024-08-06 07:18:27,820][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075476_618299392.pth... [2024-08-06 07:18:27,939][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000074964_614105088.pth [2024-08-06 07:18:28,500][52811] DAMAGECOUNT value on done: 804501.0 [2024-08-06 07:18:28,500][52811] Sum rewards: 87.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.280', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.184', 'AMMO3': '0.211', 'AMMO4': '0.227', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '72.000'} [2024-08-06 07:18:28,793][52658] DAMAGECOUNT value on done: 851005.0 [2024-08-06 07:18:28,795][52658] Sum rewards: 56.957, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.596', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.184', 'weapon5': '0.236', 'AMMO4': '0.288', 'AMMO3': '0.311', 'weapon2': '0.404', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.826', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '51.000'} [2024-08-06 07:18:28,922][52794] DAMAGECOUNT value on done: 853521.0 [2024-08-06 07:18:28,922][52794] Sum rewards: 64.664, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.100', 'weapon4': '0.140', 'AMMO4': '0.151', 'AMMO3': '0.184', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '54.000'} [2024-08-06 07:18:30,237][52650] Updated weights for policy 0, policy_version 75481 (0.0023) [2024-08-06 07:18:30,284][52659] DAMAGECOUNT value on done: 850288.0 [2024-08-06 07:18:30,285][52659] Sum rewards: 82.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.323', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.062', 'weapon5': '0.102', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '67.000'} [2024-08-06 07:18:31,511][52811] DAMAGECOUNT value on done: 787868.0 [2024-08-06 07:18:31,512][52811] Sum rewards: 64.670, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.330', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.126', 'AMMO4': '0.187', 'AMMO3': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.114', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:31,588][52794] DAMAGECOUNT value on done: 841025.0 [2024-08-06 07:18:31,589][52794] Sum rewards: 72.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO3': '0.178', 'AMMO4': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.370', 'weapon2': '0.384', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '57.000'} [2024-08-06 07:18:31,785][52658] DAMAGECOUNT value on done: 847414.0 [2024-08-06 07:18:31,786][52658] Sum rewards: 63.638, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.128', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.120', 'AMMO4': '0.191', 'weapon5': '0.194', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.104', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '56.000'} [2024-08-06 07:18:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 618381312. Throughput: 0: 4364.0. Samples: 154594260. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:18:32,794][52567] Avg episode reward: [(0, '74.711')] [2024-08-06 07:18:33,299][52659] DAMAGECOUNT value on done: 843665.0 [2024-08-06 07:18:33,299][52659] Sum rewards: 82.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.812', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.088', 'weapon5': '0.186', 'AMMO4': '0.204', 'AMMO3': '0.233', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '67.000'} [2024-08-06 07:18:34,480][52658] DAMAGECOUNT value on done: 842410.0 [2024-08-06 07:18:34,481][52658] Sum rewards: 56.956, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.840', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.134', 'weapon5': '0.232', 'AMMO4': '0.268', 'AMMO3': '0.288', 'weapon2': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'HITCOUNT': '2.750', 'weapon3': '2.984', 'DAMAGECOUNT': '15.744', 'FRAGCOUNT': '50.000'} [2024-08-06 07:18:34,819][52794] DAMAGECOUNT value on done: 835722.0 [2024-08-06 07:18:34,821][52794] Sum rewards: 69.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.761', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.109', 'weapon5': '0.130', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.192', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '56.000'} [2024-08-06 07:18:34,853][52811] DAMAGECOUNT value on done: 781481.0 [2024-08-06 07:18:34,853][52811] Sum rewards: 73.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.168', 'weapon4': '0.192', 'weapon5': '0.216', 'AMMO4': '0.220', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.500'} [2024-08-06 07:18:35,390][52650] Updated weights for policy 0, policy_version 75491 (0.0019) [2024-08-06 07:18:37,303][52794] DAMAGECOUNT value on done: 844518.0 [2024-08-06 07:18:37,306][52794] Sum rewards: 75.362, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.150', 'weapon4': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.293', 'weapon2': '0.584', 'WEAPON3': '0.950', 'weapon3': '2.892', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '59.000'} [2024-08-06 07:18:37,322][52658] DAMAGECOUNT value on done: 838350.0 [2024-08-06 07:18:37,324][52658] Sum rewards: 73.691, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.886', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon2': '0.188', 'weapon5': '0.242', 'weapon4': '0.262', 'AMMO3': '0.282', 'AMMO4': '0.282', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '2.994', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 07:18:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 618463232. Throughput: 0: 4355.3. Samples: 154620230. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:18:37,794][52567] Avg episode reward: [(0, '75.000')] [2024-08-06 07:18:37,905][52811] DAMAGECOUNT value on done: 785430.0 [2024-08-06 07:18:37,906][52811] Sum rewards: 78.838, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.734', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'AMMO3': '0.314', 'WEAPON3': '1.850', 'weapon3': '3.290', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '69.000'} [2024-08-06 07:18:38,374][52669] DAMAGECOUNT value on done: 848029.0 [2024-08-06 07:18:38,383][52669] Sum rewards: 69.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.131', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon4': '0.162', 'AMMO3': '0.264', 'weapon5': '0.266', 'AMMO4': '0.310', 'weapon2': '0.452', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.812', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:39,018][52649] DAMAGECOUNT value on done: 820129.0 [2024-08-06 07:18:39,019][52649] Sum rewards: 73.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.038', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.189', 'AMMO3': '0.247', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.328', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '63.000'} [2024-08-06 07:18:39,392][52650] Updated weights for policy 0, policy_version 75501 (0.0011) [2024-08-06 07:18:39,809][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:18:40,004][52658] DAMAGECOUNT value on done: 850606.0 [2024-08-06 07:18:40,004][52658] Sum rewards: 65.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.980', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'weapon4': '0.244', 'AMMO3': '0.266', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:40,309][52794] DAMAGECOUNT value on done: 849612.0 [2024-08-06 07:18:40,310][52794] Sum rewards: 77.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.503', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.104', 'AMMO4': '0.199', 'AMMO3': '0.206', 'weapon5': '0.228', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '64.000'} [2024-08-06 07:18:41,034][52811] DAMAGECOUNT value on done: 788401.0 [2024-08-06 07:18:41,035][52811] Sum rewards: 72.890, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.951', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.080', 'weapon5': '0.084', 'AMMO4': '0.128', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '59.000'} [2024-08-06 07:18:41,416][52669] DAMAGECOUNT value on done: 840425.0 [2024-08-06 07:18:41,416][52669] Sum rewards: 72.160, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-5.025', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.126', 'weapon5': '0.148', 'AMMO3': '0.214', 'AMMO4': '0.267', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '63.000'} [2024-08-06 07:18:42,160][52649] DAMAGECOUNT value on done: 813754.0 [2024-08-06 07:18:42,161][52649] Sum rewards: 66.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'weapon4': '0.136', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.212', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.478', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '54.000'} [2024-08-06 07:18:42,276][52663] DAMAGECOUNT value on done: 861852.0 [2024-08-06 07:18:42,277][52663] Sum rewards: 71.651, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.518', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.172', 'AMMO3': '0.191', 'weapon4': '0.194', 'AMMO4': '0.229', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 07:18:42,430][52658] DAMAGECOUNT value on done: 837112.0 [2024-08-06 07:18:42,430][52658] Sum rewards: 71.918, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.413', 'AMMO5': '0.021', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.192', 'weapon5': '0.228', 'weapon4': '0.238', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '58.000'} [2024-08-06 07:18:42,767][52670] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:18:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 618553344. Throughput: 0: 4355.8. Samples: 154646490. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:18:42,794][52567] Avg episode reward: [(0, '74.743')] [2024-08-06 07:18:43,460][52794] DAMAGECOUNT value on done: 836516.0 [2024-08-06 07:18:43,469][52794] Sum rewards: 72.981, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.078', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.098', 'weapon4': '0.126', 'AMMO4': '0.188', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.000'} [2024-08-06 07:18:44,195][52811] DAMAGECOUNT value on done: 801194.0 [2024-08-06 07:18:44,199][52811] Sum rewards: 74.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.836', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.200', 'weapon2': '0.246', 'weapon5': '0.262', 'AMMO4': '0.294', 'weapon4': '0.296', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '60.000'} [2024-08-06 07:18:44,470][52669] DAMAGECOUNT value on done: 853010.0 [2024-08-06 07:18:44,470][52669] Sum rewards: 79.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.346', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.044', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.188', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '63.000'} [2024-08-06 07:18:44,581][52650] Updated weights for policy 0, policy_version 75511 (0.0010) [2024-08-06 07:18:45,285][52663] DAMAGECOUNT value on done: 846996.0 [2024-08-06 07:18:45,286][52663] Sum rewards: 71.598, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.186', 'AMMO4': '0.204', 'AMMO3': '0.218', 'weapon2': '0.240', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '59.000'} [2024-08-06 07:18:45,301][52649] DAMAGECOUNT value on done: 831166.0 [2024-08-06 07:18:45,303][52649] Sum rewards: 83.501, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.947', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.131', 'weapon5': '0.144', 'AMMO3': '0.196', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.384', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '68.000'} [2024-08-06 07:18:45,429][52658] DAMAGECOUNT value on done: 866429.0 [2024-08-06 07:18:45,430][52658] Sum rewards: 75.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.636', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.082', 'AMMO3': '0.165', 'weapon5': '0.170', 'AMMO4': '0.209', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.168', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '60.000'} [2024-08-06 07:18:46,276][52794] DAMAGECOUNT value on done: 846742.0 [2024-08-06 07:18:46,278][52794] Sum rewards: 80.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.090', 'AMMO4': '0.173', 'weapon5': '0.208', 'AMMO3': '0.237', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.202', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '67.000'} [2024-08-06 07:18:47,363][52811] DAMAGECOUNT value on done: 794888.0 [2024-08-06 07:18:47,367][52811] Sum rewards: 67.879, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.434', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.210', 'AMMO3': '0.235', 'AMMO4': '0.239', 'weapon4': '0.270', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '56.000'} [2024-08-06 07:18:47,587][52669] DAMAGECOUNT value on done: 846121.0 [2024-08-06 07:18:47,587][52669] Sum rewards: 73.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.884', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.058', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '61.000'} [2024-08-06 07:18:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 618635264. Throughput: 0: 4350.9. Samples: 154659510. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:18:47,794][52567] Avg episode reward: [(0, '74.532')] [2024-08-06 07:18:48,201][52658] DAMAGECOUNT value on done: 848784.0 [2024-08-06 07:18:48,202][52658] Sum rewards: 53.520, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.622', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.178', 'AMMO4': '0.220', 'weapon4': '0.244', 'AMMO3': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.500', 'HITCOUNT': '2.780', 'weapon3': '2.818', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '48.000'} [2024-08-06 07:18:48,497][52649] DAMAGECOUNT value on done: 825392.0 [2024-08-06 07:18:48,498][52649] Sum rewards: 65.429, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.082', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.056', 'AMMO4': '0.212', 'weapon5': '0.218', 'AMMO3': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.500', 'weapon3': '2.882', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '56.000'} [2024-08-06 07:18:48,586][52663] DAMAGECOUNT value on done: 841693.0 [2024-08-06 07:18:48,586][52663] Sum rewards: 66.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.186', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.720', 'WEAPON3': '1.200', 'weapon3': '2.922', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '54.000'} [2024-08-06 07:18:48,909][52650] Updated weights for policy 0, policy_version 75521 (0.0012) [2024-08-06 07:18:49,201][52794] DAMAGECOUNT value on done: 842361.0 [2024-08-06 07:18:49,203][52794] Sum rewards: 70.209, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.075', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.162', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.396', 'weapon4': '0.484', 'WEAPON3': '0.950', 'weapon3': '2.722', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '57.000'} [2024-08-06 07:18:50,416][52669] DAMAGECOUNT value on done: 853145.0 [2024-08-06 07:18:50,416][52669] Sum rewards: 78.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.814', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.172', 'weapon2': '0.174', 'AMMO4': '0.192', 'weapon4': '0.194', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '64.000'} [2024-08-06 07:18:50,573][52811] DAMAGECOUNT value on done: 785998.0 [2024-08-06 07:18:50,574][52811] Sum rewards: 76.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.726', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.060', 'weapon5': '0.096', 'AMMO4': '0.104', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '63.000'} [2024-08-06 07:18:50,959][52671] DAMAGECOUNT value on done: 852966.0 [2024-08-06 07:18:50,959][52671] Sum rewards: 77.080, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.845', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.134', 'weapon4': '0.144', 'AMMO4': '0.274', 'AMMO3': '0.281', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.100', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '67.000'} [2024-08-06 07:18:51,020][52663] DAMAGECOUNT value on done: 844312.0 [2024-08-06 07:18:51,020][52663] Sum rewards: 75.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.696', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.158', 'AMMO4': '0.168', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.316', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '62.000'} [2024-08-06 07:18:51,076][52658] DAMAGECOUNT value on done: 859238.0 [2024-08-06 07:18:51,079][52658] Sum rewards: 69.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.013', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.344', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.366', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '57.000'} [2024-08-06 07:18:51,839][52649] DAMAGECOUNT value on done: 817955.0 [2024-08-06 07:18:51,841][52649] Sum rewards: 84.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.056', 'AMMO4': '0.174', 'AMMO3': '0.179', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '67.500'} [2024-08-06 07:18:52,020][52794] DAMAGECOUNT value on done: 835899.0 [2024-08-06 07:18:52,020][52794] Sum rewards: 77.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.687', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.031', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '64.000'} [2024-08-06 07:18:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 618725376. Throughput: 0: 4351.6. Samples: 154685490. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:18:52,794][52567] Avg episode reward: [(0, '73.973')] [2024-08-06 07:18:52,898][52669] DAMAGECOUNT value on done: 849728.0 [2024-08-06 07:18:52,899][52669] Sum rewards: 93.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.068', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.402', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '22.095', 'FRAGCOUNT': '78.000'} [2024-08-06 07:18:53,065][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:18:53,633][52658] DAMAGECOUNT value on done: 847096.0 [2024-08-06 07:18:53,641][52658] Sum rewards: 62.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.082', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.348', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.232', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '54.000'} [2024-08-06 07:18:53,712][52811] DAMAGECOUNT value on done: 794129.0 [2024-08-06 07:18:53,714][52811] Sum rewards: 76.833, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.227', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.198', 'AMMO3': '0.198', 'weapon5': '0.210', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '62.000'} [2024-08-06 07:18:53,856][52663] DAMAGECOUNT value on done: 846956.0 [2024-08-06 07:18:53,857][52663] Sum rewards: 70.690, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.380', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.124', 'AMMO3': '0.171', 'weapon4': '0.226', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.000'} [2024-08-06 07:18:53,996][52671] DAMAGECOUNT value on done: 857419.0 [2024-08-06 07:18:53,996][52671] Sum rewards: 87.072, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.051', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'weapon5': '0.178', 'weapon4': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON3': '0.950', 'weapon3': '2.980', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '68.000'} [2024-08-06 07:18:54,184][52650] Updated weights for policy 0, policy_version 75531 (0.0027) [2024-08-06 07:18:54,681][52649] DAMAGECOUNT value on done: 828648.0 [2024-08-06 07:18:54,681][52649] Sum rewards: 82.206, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.205', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.278', 'WEAPON3': '1.750', 'weapon3': '3.336', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '71.000'} [2024-08-06 07:18:54,788][52794] DAMAGECOUNT value on done: 848333.0 [2024-08-06 07:18:54,788][52794] Sum rewards: 84.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.114', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.270', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '68.000'} [2024-08-06 07:18:55,858][52669] DAMAGECOUNT value on done: 850147.0 [2024-08-06 07:18:55,859][52669] Sum rewards: 73.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.612', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.240', 'weapon2': '0.644', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '61.500'} [2024-08-06 07:18:56,356][52658] DAMAGECOUNT value on done: 855978.0 [2024-08-06 07:18:56,357][52658] Sum rewards: 73.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.206', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.130', 'weapon2': '0.160', 'AMMO3': '0.170', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.124', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2024-08-06 07:18:56,479][52663] DAMAGECOUNT value on done: 852855.0 [2024-08-06 07:18:56,479][52663] Sum rewards: 78.114, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.424', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '63.000'} [2024-08-06 07:18:56,505][52665] DAMAGECOUNT value on done: 834087.0 [2024-08-06 07:18:56,505][52665] Sum rewards: 82.516, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.853', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.098', 'weapon5': '0.128', 'weapon2': '0.184', 'AMMO4': '0.212', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.400', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '69.000'} [2024-08-06 07:18:56,792][52811] DAMAGECOUNT value on done: 792705.0 [2024-08-06 07:18:56,795][52811] Sum rewards: 78.898, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.168', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.410', 'weapon2': '0.550', 'WEAPON3': '0.950', 'weapon3': '2.994', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '64.000'} [2024-08-06 07:18:56,844][52649] DAMAGECOUNT value on done: 825246.0 [2024-08-06 07:18:56,844][52649] Sum rewards: 72.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.255', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.174', 'weapon2': '0.180', 'weapon4': '0.190', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 07:18:57,215][52671] DAMAGECOUNT value on done: 853618.0 [2024-08-06 07:18:57,217][52671] Sum rewards: 88.422, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.652', 'AMMO5': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.038', 'weapon4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.394', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.886', 'FRAGCOUNT': '73.000'} [2024-08-06 07:18:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 618815488. Throughput: 0: 4355.8. Samples: 154711820. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:18:57,794][52567] Avg episode reward: [(0, '74.276')] [2024-08-06 07:18:58,126][52669] DAMAGECOUNT value on done: 848789.0 [2024-08-06 07:18:58,128][52669] Sum rewards: 72.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.548', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon2': '0.746', 'WEAPON3': '1.050', 'weapon3': '2.976', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '59.000'} [2024-08-06 07:18:58,258][52794] DAMAGECOUNT value on done: 843103.0 [2024-08-06 07:18:58,259][52794] Sum rewards: 69.492, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.173', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.224', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '59.000'} [2024-08-06 07:18:58,560][52650] Updated weights for policy 0, policy_version 75541 (0.0017) [2024-08-06 07:18:58,821][52658] DAMAGECOUNT value on done: 845241.0 [2024-08-06 07:18:58,829][52658] Sum rewards: 79.844, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.122', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.116', 'weapon5': '0.184', 'AMMO4': '0.191', 'weapon2': '0.246', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '67.000'} [2024-08-06 07:18:58,902][52663] DAMAGECOUNT value on done: 841977.0 [2024-08-06 07:18:58,903][52663] Sum rewards: 77.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.540', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '63.000'} [2024-08-06 07:18:59,466][52665] DAMAGECOUNT value on done: 849874.0 [2024-08-06 07:18:59,466][52665] Sum rewards: 79.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.122', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.238', 'weapon4': '0.284', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '69.000'} [2024-08-06 07:18:59,828][52811] DAMAGECOUNT value on done: 795912.0 [2024-08-06 07:18:59,829][52811] Sum rewards: 87.271, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.187', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.140', 'AMMO3': '0.152', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '68.000'} [2024-08-06 07:18:59,899][52649] DAMAGECOUNT value on done: 828922.0 [2024-08-06 07:18:59,900][52649] Sum rewards: 82.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.068', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO3': '0.177', 'AMMO4': '0.214', 'weapon5': '0.222', 'weapon4': '0.264', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '66.000'} [2024-08-06 07:19:00,182][52659] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0)] [2024-08-06 07:19:00,263][52671] DAMAGECOUNT value on done: 853530.0 [2024-08-06 07:19:00,264][52671] Sum rewards: 73.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.043', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.178', 'weapon4': '0.212', 'AMMO4': '0.216', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '59.000'} [2024-08-06 07:19:00,873][52669] DAMAGECOUNT value on done: 859245.0 [2024-08-06 07:19:00,873][52669] Sum rewards: 78.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.041', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.204', 'weapon2': '0.246', 'AMMO3': '0.249', 'AMMO4': '0.269', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:01,116][52794] DAMAGECOUNT value on done: 858742.0 [2024-08-06 07:19:01,119][52794] Sum rewards: 68.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO4': '0.176', 'weapon2': '0.250', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.330', 'weapon3': '3.386', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:01,282][52658] DAMAGECOUNT value on done: 850947.0 [2024-08-06 07:19:01,282][52658] Sum rewards: 83.431, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.711', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.142', 'AMMO4': '0.148', 'weapon2': '0.168', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.434', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '68.000'} [2024-08-06 07:19:01,643][52663] DAMAGECOUNT value on done: 833959.0 [2024-08-06 07:19:01,644][52663] Sum rewards: 84.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.088', 'weapon4': '0.114', 'AMMO4': '0.184', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '69.000'} [2024-08-06 07:19:02,506][52665] DAMAGECOUNT value on done: 838658.0 [2024-08-06 07:19:02,506][52665] Sum rewards: 69.646, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.614', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.038', 'weapon4': '0.082', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 618897408. Throughput: 0: 4363.1. Samples: 154725140. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:19:02,795][52567] Avg episode reward: [(0, '74.592')] [2024-08-06 07:19:02,883][52649] DAMAGECOUNT value on done: 826871.0 [2024-08-06 07:19:02,886][52649] Sum rewards: 74.815, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.924', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.118', 'AMMO3': '0.180', 'weapon4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:02,936][52811] DAMAGECOUNT value on done: 801506.0 [2024-08-06 07:19:02,938][52811] Sum rewards: 65.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.486', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:03,323][52669] DAMAGECOUNT value on done: 849074.0 [2024-08-06 07:19:03,324][52669] Sum rewards: 76.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.050', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.016', 'weapon4': '0.024', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:03,398][52671] DAMAGECOUNT value on done: 859823.0 [2024-08-06 07:19:03,399][52671] Sum rewards: 59.355, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'weapon2': '0.622', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.200', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '48.000'} [2024-08-06 07:19:03,591][52650] Updated weights for policy 0, policy_version 75551 (0.0020) [2024-08-06 07:19:04,016][52794] DAMAGECOUNT value on done: 840027.0 [2024-08-06 07:19:04,024][52794] Sum rewards: 68.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.530', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.054', 'AMMO3': '0.267', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.376', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:04,396][52663] DAMAGECOUNT value on done: 840549.0 [2024-08-06 07:19:04,398][52663] Sum rewards: 77.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.326', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon2': '0.182', 'AMMO3': '0.236', 'weapon5': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.412', 'WEAPON3': '1.450', 'weapon3': '2.706', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:04,588][52658] DAMAGECOUNT value on done: 834674.0 [2024-08-06 07:19:04,588][52658] Sum rewards: 68.842, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.246', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:04,930][52665] DAMAGECOUNT value on done: 841187.0 [2024-08-06 07:19:04,930][52665] Sum rewards: 77.933, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.088', 'AMMO4': '0.105', 'weapon4': '0.110', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:05,268][52649] DAMAGECOUNT value on done: 821137.0 [2024-08-06 07:19:05,294][52649] Sum rewards: 75.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.680', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.078', 'weapon5': '0.082', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.530', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:05,884][52671] DAMAGECOUNT value on done: 848186.0 [2024-08-06 07:19:05,885][52671] Sum rewards: 72.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.736', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.166', 'weapon4': '0.168', 'AMMO3': '0.223', 'AMMO4': '0.225', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.674', 'WEAPON3': '1.400', 'weapon3': '2.704', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:05,993][52811] DAMAGECOUNT value on done: 791750.0 [2024-08-06 07:19:05,994][52811] Sum rewards: 67.825, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.882', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.108', 'AMMO4': '0.127', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:06,565][52669] DAMAGECOUNT value on done: 856552.0 [2024-08-06 07:19:06,566][52669] Sum rewards: 64.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.971', 'AMMO5': '0.021', 'AMMO2': '0.036', 'weapon5': '0.146', 'AMMO4': '0.182', 'AMMO3': '0.205', 'weapon4': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.654', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '54.500'} [2024-08-06 07:19:06,932][52794] DAMAGECOUNT value on done: 854401.0 [2024-08-06 07:19:06,935][52794] Sum rewards: 81.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.293', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon5': '0.190', 'AMMO3': '0.226', 'weapon4': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '2.786', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '66.000'} [2024-08-06 07:19:07,549][52663] DAMAGECOUNT value on done: 845564.0 [2024-08-06 07:19:07,551][52663] Sum rewards: 77.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.158', 'weapon4': '0.178', 'AMMO4': '0.208', 'AMMO3': '0.221', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:07,663][52650] Updated weights for policy 0, policy_version 75561 (0.0011) [2024-08-06 07:19:07,706][52658] DAMAGECOUNT value on done: 853336.0 [2024-08-06 07:19:07,706][52658] Sum rewards: 79.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.956', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.042', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'weapon3': '3.486', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '68.000'} [2024-08-06 07:19:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 618995712. Throughput: 0: 4362.9. Samples: 154751470. Policy #0 lag: (min: 1.0, avg: 3.9, max: 7.0) [2024-08-06 07:19:07,794][52567] Avg episode reward: [(0, '74.308')] [2024-08-06 07:19:08,024][52665] DAMAGECOUNT value on done: 823925.0 [2024-08-06 07:19:08,024][52665] Sum rewards: 80.446, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.434', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.220', 'AMMO3': '0.228', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '69.000'} [2024-08-06 07:19:08,247][52671] DAMAGECOUNT value on done: 854025.0 [2024-08-06 07:19:08,249][52671] Sum rewards: 68.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.060', 'AMMO4': '0.123', 'weapon2': '0.162', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.508', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:08,562][52649] DAMAGECOUNT value on done: 831870.0 [2024-08-06 07:19:08,562][52649] Sum rewards: 69.579, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.655', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.118', 'weapon2': '0.214', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:08,986][52811] DAMAGECOUNT value on done: 790945.0 [2024-08-06 07:19:08,989][52811] Sum rewards: 57.362, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.042', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.158', 'weapon5': '0.164', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '50.500'} [2024-08-06 07:19:09,527][52669] DAMAGECOUNT value on done: 857494.0 [2024-08-06 07:19:09,528][52669] Sum rewards: 62.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.195', 'weapon2': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.464', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '52.000'} [2024-08-06 07:19:10,078][52794] DAMAGECOUNT value on done: 849425.0 [2024-08-06 07:19:10,078][52794] Sum rewards: 61.883, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-0.630', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.302', 'weapon2': '0.320', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:10,348][52614] Signal inference workers to stop experience collection... (13800 times) [2024-08-06 07:19:10,351][52614] Signal inference workers to resume experience collection... (13800 times) [2024-08-06 07:19:10,437][52650] InferenceWorker_p0-w0: stopping experience collection (13800 times) [2024-08-06 07:19:10,440][52650] InferenceWorker_p0-w0: resuming experience collection (13800 times) [2024-08-06 07:19:10,475][52663] DAMAGECOUNT value on done: 854873.0 [2024-08-06 07:19:10,475][52663] Sum rewards: 86.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.705', 'AMMO5': '0.015', 'weapon4': '0.042', 'AMMO2': '0.044', 'weapon5': '0.200', 'AMMO4': '0.219', 'AMMO3': '0.266', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.240', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '72.000'} [2024-08-06 07:19:10,692][52658] DAMAGECOUNT value on done: 844477.0 [2024-08-06 07:19:10,692][52658] Sum rewards: 82.649, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.658', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.176', 'weapon4': '0.228', 'weapon2': '0.244', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.076', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.093', 'FRAGCOUNT': '68.000'} [2024-08-06 07:19:11,178][52671] DAMAGECOUNT value on done: 854153.0 [2024-08-06 07:19:11,179][52671] Sum rewards: 82.140, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.310', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.060', 'weapon5': '0.078', 'AMMO4': '0.098', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '1.100', 'HITCOUNT': '3.410', 'weapon3': '3.464', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:11,214][52665] DAMAGECOUNT value on done: 829643.0 [2024-08-06 07:19:11,214][52665] Sum rewards: 74.618, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.841', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'weapon4': '0.220', 'AMMO3': '0.236', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:11,650][52649] DAMAGECOUNT value on done: 839600.0 [2024-08-06 07:19:11,659][52649] Sum rewards: 66.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.319', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.230', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:12,045][52811] DAMAGECOUNT value on done: 789220.0 [2024-08-06 07:19:12,046][52811] Sum rewards: 80.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.036', 'weapon5': '0.108', 'AMMO4': '0.167', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:12,266][52669] DAMAGECOUNT value on done: 843653.0 [2024-08-06 07:19:12,267][52669] Sum rewards: 68.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.086', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '57.000'} [2024-08-06 07:19:12,747][52650] Updated weights for policy 0, policy_version 75571 (0.0014) [2024-08-06 07:19:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 619077632. Throughput: 0: 4365.8. Samples: 154777750. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:12,795][52567] Avg episode reward: [(0, '74.120')] [2024-08-06 07:19:13,169][52663] DAMAGECOUNT value on done: 836264.0 [2024-08-06 07:19:13,170][52663] Sum rewards: 86.886, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.361', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.146', 'weapon4': '0.178', 'AMMO4': '0.265', 'AMMO3': '0.273', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '74.000'} [2024-08-06 07:19:13,236][52794] DAMAGECOUNT value on done: 849982.0 [2024-08-06 07:19:13,236][52794] Sum rewards: 78.286, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.960', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.102', 'weapon5': '0.102', 'AMMO3': '0.130', 'AMMO4': '0.158', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.628', 'WEAPON3': '0.850', 'weapon3': '2.956', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:13,577][52658] DAMAGECOUNT value on done: 841348.0 [2024-08-06 07:19:13,579][52658] Sum rewards: 69.511, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.070', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.146', 'AMMO3': '0.155', 'weapon5': '0.174', 'AMMO4': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.140', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '54.000'} [2024-08-06 07:19:14,107][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:19:14,199][52671] DAMAGECOUNT value on done: 839879.0 [2024-08-06 07:19:14,200][52671] Sum rewards: 80.733, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.313', 'AMMO5': '0.017', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.150', 'weapon4': '0.188', 'weapon5': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:14,237][52665] DAMAGECOUNT value on done: 834358.0 [2024-08-06 07:19:14,239][52665] Sum rewards: 80.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.650', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.136', 'AMMO4': '0.175', 'AMMO3': '0.233', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.078', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '69.000'} [2024-08-06 07:19:14,687][52649] DAMAGECOUNT value on done: 830872.0 [2024-08-06 07:19:14,695][52649] Sum rewards: 72.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.016', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.215', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '3.194', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:15,144][52811] DAMAGECOUNT value on done: 792981.0 [2024-08-06 07:19:15,145][52811] Sum rewards: 71.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.050', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO3': '0.149', 'AMMO4': '0.156', 'weapon5': '0.156', 'weapon4': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '0.900', 'weapon3': '2.844', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '57.000'} [2024-08-06 07:19:15,227][52669] DAMAGECOUNT value on done: 843660.0 [2024-08-06 07:19:15,229][52669] Sum rewards: 64.106, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.670', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.030', 'AMMO4': '0.031', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.910', 'WEAPON3': '1.000', 'weapon3': '2.726', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '52.000'} [2024-08-06 07:19:16,189][52658] DAMAGECOUNT value on done: 849872.0 [2024-08-06 07:19:16,189][52658] Sum rewards: 92.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.687', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.126', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.741', 'FRAGCOUNT': '76.000'} [2024-08-06 07:19:16,192][52794] DAMAGECOUNT value on done: 857096.0 [2024-08-06 07:19:16,193][52794] Sum rewards: 65.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.158', 'AMMO4': '0.193', 'AMMO3': '0.226', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '55.000'} [2024-08-06 07:19:16,324][52663] DAMAGECOUNT value on done: 831413.0 [2024-08-06 07:19:16,325][52663] Sum rewards: 78.993, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.120', 'weapon5': '0.176', 'AMMO4': '0.205', 'AMMO3': '0.210', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:16,538][52670] DAMAGECOUNT value on done: 834365.0 [2024-08-06 07:19:16,540][52670] Sum rewards: 73.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.825', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:17,046][52665] DAMAGECOUNT value on done: 834733.0 [2024-08-06 07:19:17,047][52665] Sum rewards: 70.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'weapon4': '0.238', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:17,203][52650] Updated weights for policy 0, policy_version 75581 (0.0022) [2024-08-06 07:19:17,256][52671] DAMAGECOUNT value on done: 854728.0 [2024-08-06 07:19:17,256][52671] Sum rewards: 80.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.056', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.144', 'AMMO4': '0.169', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:17,610][52649] DAMAGECOUNT value on done: 832557.0 [2024-08-06 07:19:17,610][52649] Sum rewards: 75.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.960', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.148', 'AMMO4': '0.196', 'weapon2': '0.220', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 619167744. Throughput: 0: 4370.2. Samples: 154790920. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:17,794][52567] Avg episode reward: [(0, '74.734')] [2024-08-06 07:19:18,190][52811] DAMAGECOUNT value on done: 796176.0 [2024-08-06 07:19:18,190][52811] Sum rewards: 75.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.597', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.068', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.222', 'WEAPON3': '1.450', 'HITCOUNT': '3.470', 'weapon3': '3.508', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:18,296][52803] DAMAGECOUNT value on done: 787331.0 [2024-08-06 07:19:18,298][52803] Sum rewards: 78.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.694', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.170', 'AMMO4': '0.178', 'AMMO3': '0.209', 'weapon4': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '2.886', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '66.000'} [2024-08-06 07:19:18,375][52669] DAMAGECOUNT value on done: 849379.0 [2024-08-06 07:19:18,376][52669] Sum rewards: 63.741, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.410', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.110', 'weapon4': '0.128', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.660', 'WEAPON3': '1.550', 'weapon3': '2.842', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:19,282][52794] DAMAGECOUNT value on done: 850384.0 [2024-08-06 07:19:19,282][52794] Sum rewards: 80.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.630', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.246', 'WEAPON3': '1.450', 'weapon3': '3.466', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '68.000'} [2024-08-06 07:19:19,650][52663] DAMAGECOUNT value on done: 839776.0 [2024-08-06 07:19:19,652][52663] Sum rewards: 74.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.313', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.103', 'weapon5': '0.152', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.736', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '59.500'} [2024-08-06 07:19:19,862][52670] DAMAGECOUNT value on done: 848357.0 [2024-08-06 07:19:19,862][52670] Sum rewards: 76.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.741', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.060', 'AMMO4': '0.172', 'AMMO3': '0.183', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:20,253][52665] DAMAGECOUNT value on done: 843568.0 [2024-08-06 07:19:20,254][52665] Sum rewards: 69.347, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.400', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.152', 'AMMO4': '0.207', 'AMMO3': '0.235', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:20,424][52671] DAMAGECOUNT value on done: 852449.0 [2024-08-06 07:19:20,426][52671] Sum rewards: 69.926, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.154', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.102', 'weapon5': '0.222', 'weapon2': '0.238', 'AMMO3': '0.287', 'AMMO4': '0.321', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.126', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:20,850][52649] DAMAGECOUNT value on done: 820176.0 [2024-08-06 07:19:20,851][52649] Sum rewards: 68.461, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.720', 'AMMO5': '0.021', 'AMMO2': '0.075', 'weapon5': '0.252', 'weapon4': '0.278', 'AMMO3': '0.355', 'weapon2': '0.368', 'AMMO4': '0.375', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'WEAPON3': '2.000', 'weapon3': '2.722', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:21,251][52811] DAMAGECOUNT value on done: 803081.0 [2024-08-06 07:19:21,254][52811] Sum rewards: 84.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.800', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.052', 'weapon4': '0.094', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.081', 'FRAGCOUNT': '68.000'} [2024-08-06 07:19:21,384][52803] DAMAGECOUNT value on done: 786139.0 [2024-08-06 07:19:21,385][52803] Sum rewards: 65.257, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.500', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.040', 'AMMO4': '0.108', 'weapon5': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '52.000'} [2024-08-06 07:19:21,525][52669] DAMAGECOUNT value on done: 872153.0 [2024-08-06 07:19:21,525][52669] Sum rewards: 67.438, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.076', 'AMMO4': '0.119', 'AMMO3': '0.218', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.446', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:22,194][52650] Updated weights for policy 0, policy_version 75591 (0.0014) [2024-08-06 07:19:22,458][52666] DAMAGECOUNT value on done: 848128.0 [2024-08-06 07:19:22,458][52666] Sum rewards: 75.832, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.132', 'weapon5': '0.132', 'AMMO4': '0.164', 'AMMO3': '0.227', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:22,545][52663] DAMAGECOUNT value on done: 841955.0 [2024-08-06 07:19:22,546][52663] Sum rewards: 72.768, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.132', 'weapon5': '0.214', 'AMMO3': '0.217', 'weapon2': '0.218', 'AMMO4': '0.291', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '60.500'} [2024-08-06 07:19:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 619257856. Throughput: 0: 4377.3. Samples: 154817210. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:22,794][52567] Avg episode reward: [(0, '74.787')] [2024-08-06 07:19:22,914][52670] DAMAGECOUNT value on done: 834561.0 [2024-08-06 07:19:22,915][52670] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.064', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:23,226][52671] DAMAGECOUNT value on done: 848539.0 [2024-08-06 07:19:23,226][52671] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.565', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:23,229][52665] DAMAGECOUNT value on done: 835192.0 [2024-08-06 07:19:23,230][52665] Sum rewards: 79.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.078', 'weapon4': '0.102', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:23,884][52649] DAMAGECOUNT value on done: 830023.0 [2024-08-06 07:19:23,894][52649] Sum rewards: 66.004, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.633', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.066', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '59.000'} [2024-08-06 07:19:24,335][52803] DAMAGECOUNT value on done: 793644.0 [2024-08-06 07:19:24,336][52803] Sum rewards: 78.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.017', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.197', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:24,378][52811] DAMAGECOUNT value on done: 788076.0 [2024-08-06 07:19:24,380][52811] Sum rewards: 77.658, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'weapon4': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:24,393][52669] DAMAGECOUNT value on done: 860630.0 [2024-08-06 07:19:24,395][52669] Sum rewards: 86.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.098', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.241', 'FRAGCOUNT': '71.000'} [2024-08-06 07:19:25,171][52666] DAMAGECOUNT value on done: 840319.0 [2024-08-06 07:19:25,172][52666] Sum rewards: 74.169, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.002', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.096', 'AMMO3': '0.157', 'AMMO4': '0.180', 'weapon5': '0.190', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:25,561][52663] DAMAGECOUNT value on done: 848371.0 [2024-08-06 07:19:25,562][52663] Sum rewards: 77.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.725', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.330', 'weapon4': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:25,612][52670] DAMAGECOUNT value on done: 835011.0 [2024-08-06 07:19:25,613][52670] Sum rewards: 76.881, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.728', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.123', 'weapon5': '0.124', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:26,179][52671] DAMAGECOUNT value on done: 856067.0 [2024-08-06 07:19:26,180][52671] Sum rewards: 69.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.288', 'weapon2': '0.654', 'WEAPON3': '1.800', 'weapon3': '2.948', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:26,336][52665] DAMAGECOUNT value on done: 848218.0 [2024-08-06 07:19:26,336][52665] Sum rewards: 70.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.225', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '59.000'} [2024-08-06 07:19:26,752][52650] Updated weights for policy 0, policy_version 75601 (0.0010) [2024-08-06 07:19:27,033][52649] DAMAGECOUNT value on done: 812949.0 [2024-08-06 07:19:27,033][52649] Sum rewards: 77.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.935', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.148', 'weapon4': '0.156', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:27,052][52820] DAMAGECOUNT value on done: 784335.0 [2024-08-06 07:19:27,056][52820] Sum rewards: 76.557, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.434', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:27,375][52669] DAMAGECOUNT value on done: 853638.0 [2024-08-06 07:19:27,377][52669] Sum rewards: 72.476, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.759', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.104', 'AMMO4': '0.181', 'weapon5': '0.196', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:27,423][52811] DAMAGECOUNT value on done: 788670.0 [2024-08-06 07:19:27,424][52811] Sum rewards: 68.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.114', 'weapon4': '0.138', 'AMMO4': '0.191', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:27,497][52803] DAMAGECOUNT value on done: 793040.0 [2024-08-06 07:19:27,497][52803] Sum rewards: 80.912, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.294', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.182', 'weapon4': '0.196', 'AMMO3': '0.209', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:27,535][52666] DAMAGECOUNT value on done: 846998.0 [2024-08-06 07:19:27,536][52666] Sum rewards: 72.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'weapon4': '0.024', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.366', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 619339776. Throughput: 0: 4377.8. Samples: 154843490. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:27,794][52567] Avg episode reward: [(0, '75.025')] [2024-08-06 07:19:27,920][52670] DAMAGECOUNT value on done: 847241.0 [2024-08-06 07:19:27,920][52670] Sum rewards: 86.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '70.000'} [2024-08-06 07:19:28,624][52663] DAMAGECOUNT value on done: 845549.0 [2024-08-06 07:19:28,624][52663] Sum rewards: 83.370, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.060', 'weapon4': '0.080', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.352', 'WEAPON3': '1.050', 'weapon3': '3.344', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:29,064][52671] DAMAGECOUNT value on done: 851737.0 [2024-08-06 07:19:29,073][52671] Sum rewards: 66.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.915', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.110', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon4': '0.126', 'WEAPON5': '0.150', 'weapon7': '0.170', 'WEAPON7': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.186', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '55.000'} [2024-08-06 07:19:29,416][52665] DAMAGECOUNT value on done: 841323.0 [2024-08-06 07:19:29,416][52665] Sum rewards: 80.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.528', 'ARMOR': '0.012', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.096', 'weapon5': '0.204', 'AMMO4': '0.211', 'AMMO3': '0.224', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:30,049][52669] DAMAGECOUNT value on done: 857513.0 [2024-08-06 07:19:30,051][52669] Sum rewards: 75.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.493', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.074', 'weapon4': '0.114', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:30,146][52649] DAMAGECOUNT value on done: 835792.0 [2024-08-06 07:19:30,147][52649] Sum rewards: 91.244, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon4': '0.186', 'AMMO3': '0.234', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '4.290', 'DAMAGECOUNT': '21.789', 'FRAGCOUNT': '75.000'} [2024-08-06 07:19:30,196][52820] DAMAGECOUNT value on done: 785508.0 [2024-08-06 07:19:30,199][52820] Sum rewards: 71.788, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.027', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.191', 'weapon2': '0.820', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '57.000'} [2024-08-06 07:19:30,391][52666] DAMAGECOUNT value on done: 843609.0 [2024-08-06 07:19:30,395][52666] Sum rewards: 74.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.268', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:30,441][52803] DAMAGECOUNT value on done: 789718.0 [2024-08-06 07:19:30,443][52803] Sum rewards: 76.720, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon2': '0.244', 'AMMO3': '0.260', 'AMMO4': '0.308', 'weapon5': '0.312', 'weapon4': '0.386', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:30,506][52664] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2024-08-06 07:19:30,641][52670] DAMAGECOUNT value on done: 836185.0 [2024-08-06 07:19:30,641][52670] Sum rewards: 69.897, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.092', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.143', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon4': '0.284', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.600', 'weapon3': '2.922', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:31,196][52663] DAMAGECOUNT value on done: 851067.0 [2024-08-06 07:19:31,197][52663] Sum rewards: 76.378, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.210', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'weapon2': '0.188', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:31,240][52650] Updated weights for policy 0, policy_version 75611 (0.0014) [2024-08-06 07:19:31,941][52671] DAMAGECOUNT value on done: 837983.0 [2024-08-06 07:19:31,942][52671] Sum rewards: 74.576, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.153', 'weapon4': '0.236', 'weapon2': '0.244', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.024', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:32,422][52665] DAMAGECOUNT value on done: 836128.0 [2024-08-06 07:19:32,425][52665] Sum rewards: 74.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.711', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.068', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:32,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 619421696. Throughput: 0: 4377.8. Samples: 154856510. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:32,795][52567] Avg episode reward: [(0, '74.821')] [2024-08-06 07:19:32,959][52669] DAMAGECOUNT value on done: 860360.0 [2024-08-06 07:19:32,963][52669] Sum rewards: 78.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.086', 'AMMO4': '0.091', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:33,178][52649] DAMAGECOUNT value on done: 832937.0 [2024-08-06 07:19:33,178][52649] Sum rewards: 75.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.154', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.178', 'weapon2': '0.186', 'weapon4': '0.190', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:33,440][52803] DAMAGECOUNT value on done: 789950.0 [2024-08-06 07:19:33,441][52803] Sum rewards: 69.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.477', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.288', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '59.000'} [2024-08-06 07:19:33,478][52820] DAMAGECOUNT value on done: 783981.0 [2024-08-06 07:19:33,478][52820] Sum rewards: 71.333, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.020', 'AMMO2': '0.069', 'weapon4': '0.146', 'AMMO3': '0.232', 'weapon2': '0.282', 'weapon5': '0.296', 'AMMO4': '0.347', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:33,759][52666] DAMAGECOUNT value on done: 837223.0 [2024-08-06 07:19:33,759][52666] Sum rewards: 82.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.241', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.132', 'AMMO3': '0.167', 'weapon4': '0.176', 'weapon2': '0.212', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:33,848][52670] DAMAGECOUNT value on done: 834039.0 [2024-08-06 07:19:33,848][52670] Sum rewards: 82.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.417', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.185', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '69.000'} [2024-08-06 07:19:33,865][52663] DAMAGECOUNT value on done: 852828.0 [2024-08-06 07:19:33,865][52663] Sum rewards: 84.200, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.586', 'WEAPON3': '1.650', 'weapon3': '3.000', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.724', 'FRAGCOUNT': '72.000'} [2024-08-06 07:19:35,026][52671] DAMAGECOUNT value on done: 861362.0 [2024-08-06 07:19:35,027][52671] Sum rewards: 66.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.160', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.096', 'weapon5': '0.126', 'AMMO4': '0.176', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.250', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '56.000'} [2024-08-06 07:19:35,436][52665] DAMAGECOUNT value on done: 841522.0 [2024-08-06 07:19:35,437][52665] Sum rewards: 76.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.265', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.198', 'weapon5': '0.198', 'AMMO3': '0.259', 'AMMO4': '0.268', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.870', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:35,835][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:19:36,085][52795] DAMAGECOUNT value on done: 786718.0 [2024-08-06 07:19:36,088][52795] Sum rewards: 68.682, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.630', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'weapon4': '0.098', 'AMMO3': '0.278', 'weapon2': '0.420', 'WEAPON3': '1.700', 'weapon3': '3.240', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:36,178][52650] Updated weights for policy 0, policy_version 75621 (0.0025) [2024-08-06 07:19:36,229][52649] DAMAGECOUNT value on done: 825162.0 [2024-08-06 07:19:36,233][52649] Sum rewards: 68.167, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.058', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.096', 'weapon2': '0.186', 'AMMO4': '0.189', 'weapon4': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.192', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:36,300][52666] DAMAGECOUNT value on done: 843891.0 [2024-08-06 07:19:36,302][52666] Sum rewards: 76.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:36,347][52670] DAMAGECOUNT value on done: 838552.0 [2024-08-06 07:19:36,352][52670] Sum rewards: 91.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.170', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON3': '1.350', 'weapon3': '2.940', 'HITCOUNT': '4.390', 'DAMAGECOUNT': '21.876', 'FRAGCOUNT': '75.000'} [2024-08-06 07:19:36,359][52663] DAMAGECOUNT value on done: 837850.0 [2024-08-06 07:19:36,361][52663] Sum rewards: 64.181, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.712', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.576', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '54.000'} [2024-08-06 07:19:36,567][52803] DAMAGECOUNT value on done: 783697.0 [2024-08-06 07:19:36,569][52803] Sum rewards: 75.344, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.196', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.121', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:36,615][52820] DAMAGECOUNT value on done: 772587.0 [2024-08-06 07:19:36,616][52820] Sum rewards: 71.371, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.152', 'AMMO4': '0.176', 'weapon4': '0.184', 'AMMO3': '0.217', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:37,785][52671] DAMAGECOUNT value on done: 858917.0 [2024-08-06 07:19:37,786][52671] Sum rewards: 84.227, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.168', 'AMMO3': '0.273', 'WEAPON3': '1.550', 'weapon3': '3.530', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '72.000'} [2024-08-06 07:19:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 619511808. Throughput: 0: 4380.7. Samples: 154882620. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:37,795][52567] Avg episode reward: [(0, '74.767')] [2024-08-06 07:19:38,335][52665] DAMAGECOUNT value on done: 832810.0 [2024-08-06 07:19:38,335][52665] Sum rewards: 72.670, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.901', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.196', 'AMMO3': '0.275', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '2.822', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '62.500'} [2024-08-06 07:19:38,693][52670] DAMAGECOUNT value on done: 837689.0 [2024-08-06 07:19:38,695][52670] Sum rewards: 81.484, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.775', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.096', 'AMMO4': '0.119', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '66.000'} [2024-08-06 07:19:38,721][52666] DAMAGECOUNT value on done: 838796.0 [2024-08-06 07:19:38,723][52666] Sum rewards: 62.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.972', 'AMMO5': '0.016', 'AMMO2': '0.061', 'weapon5': '0.164', 'AMMO3': '0.222', 'weapon4': '0.262', 'weapon2': '0.272', 'AMMO4': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.060', 'DAMAGECOUNT': '14.820', 'FRAGCOUNT': '54.000'} [2024-08-06 07:19:39,259][52795] DAMAGECOUNT value on done: 772982.0 [2024-08-06 07:19:39,259][52795] Sum rewards: 88.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.206', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.034', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.188', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.126', 'FRAGCOUNT': '69.000'} [2024-08-06 07:19:39,691][52803] DAMAGECOUNT value on done: 783786.0 [2024-08-06 07:19:39,691][52803] Sum rewards: 80.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.200', 'AMMO5': '0.016', 'AMMO2': '0.070', 'weapon4': '0.110', 'weapon5': '0.186', 'weapon2': '0.208', 'AMMO3': '0.275', 'AMMO4': '0.349', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.216', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '67.500'} [2024-08-06 07:19:39,763][52820] DAMAGECOUNT value on done: 788381.0 [2024-08-06 07:19:39,763][52820] Sum rewards: 72.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.200', 'weapon5': '0.242', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 07:19:40,745][52650] Updated weights for policy 0, policy_version 75631 (0.0013) [2024-08-06 07:19:40,818][52671] DAMAGECOUNT value on done: 853055.0 [2024-08-06 07:19:40,818][52671] Sum rewards: 80.090, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.055', 'AMMO5': '0.006', 'ARMOR': '0.020', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '66.000'} [2024-08-06 07:19:41,313][52665] DAMAGECOUNT value on done: 839778.0 [2024-08-06 07:19:41,323][52665] Sum rewards: 77.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.176', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO4': '0.227', 'AMMO3': '0.232', 'weapon2': '0.266', 'weapon5': '0.320', 'weapon4': '0.384', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.648', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:41,705][52670] DAMAGECOUNT value on done: 833426.0 [2024-08-06 07:19:41,707][52670] Sum rewards: 73.012, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.120', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.074', 'AMMO3': '0.139', 'weapon5': '0.200', 'AMMO4': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.542', 'WEAPON3': '0.900', 'weapon3': '2.976', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '57.000'} [2024-08-06 07:19:41,820][52666] DAMAGECOUNT value on done: 835851.0 [2024-08-06 07:19:41,821][52666] Sum rewards: 84.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.864', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.134', 'AMMO4': '0.148', 'weapon2': '0.182', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.390', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '68.000'} [2024-08-06 07:19:42,411][52795] DAMAGECOUNT value on done: 777671.0 [2024-08-06 07:19:42,413][52795] Sum rewards: 76.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.068', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.076', 'weapon4': '0.082', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.414', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 619601920. Throughput: 0: 4380.7. Samples: 154908950. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:42,794][52567] Avg episode reward: [(0, '75.178')] [2024-08-06 07:19:42,830][52820] DAMAGECOUNT value on done: 773254.0 [2024-08-06 07:19:42,831][52820] Sum rewards: 76.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.820', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.062', 'AMMO4': '0.174', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.550', 'weapon3': '3.396', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:42,874][52803] DAMAGECOUNT value on done: 790083.0 [2024-08-06 07:19:42,874][52803] Sum rewards: 85.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.845', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon2': '0.164', 'AMMO4': '0.166', 'weapon5': '0.174', 'AMMO3': '0.216', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '70.000'} [2024-08-06 07:19:43,479][52671] DAMAGECOUNT value on done: 858075.0 [2024-08-06 07:19:43,479][52671] Sum rewards: 79.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.286', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.438', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:44,343][52665] DAMAGECOUNT value on done: 839860.0 [2024-08-06 07:19:44,344][52665] Sum rewards: 67.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.280', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.044', 'weapon4': '0.108', 'AMMO4': '0.192', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.698', 'WEAPON3': '1.500', 'weapon3': '2.896', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:44,490][52670] DAMAGECOUNT value on done: 845532.0 [2024-08-06 07:19:44,490][52670] Sum rewards: 79.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.309', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.120', 'AMMO4': '0.172', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:44,634][52666] DAMAGECOUNT value on done: 843671.0 [2024-08-06 07:19:44,635][52666] Sum rewards: 81.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.112', 'AMMO5': '0.006', 'weapon4': '0.012', 'AMMO2': '0.018', 'weapon5': '0.018', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.444', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:45,135][52650] Updated weights for policy 0, policy_version 75641 (0.0025) [2024-08-06 07:19:45,621][52795] DAMAGECOUNT value on done: 786642.0 [2024-08-06 07:19:45,621][52795] Sum rewards: 77.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.808', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.146', 'weapon5': '0.170', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:45,915][52803] DAMAGECOUNT value on done: 785986.0 [2024-08-06 07:19:45,916][52803] Sum rewards: 71.784, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.450', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.090', 'weapon5': '0.090', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon2': '0.402', 'WEAPON3': '1.750', 'weapon3': '3.116', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:46,023][52820] DAMAGECOUNT value on done: 779433.0 [2024-08-06 07:19:46,029][52820] Sum rewards: 70.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.032', 'AMMO2': '0.092', 'AMMO3': '0.226', 'weapon4': '0.234', 'weapon2': '0.244', 'weapon5': '0.422', 'AMMO4': '0.458', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.770', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:46,131][52671] DAMAGECOUNT value on done: 842668.0 [2024-08-06 07:19:46,131][52671] Sum rewards: 72.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.310', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.111', 'weapon5': '0.134', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.818', 'WEAPON3': '1.100', 'weapon3': '2.836', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 07:19:46,283][52647] DAMAGECOUNT value on done: 902566.0 [2024-08-06 07:19:46,285][52647] Sum rewards: 75.004, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.550', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.088', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.340', 'WEAPON3': '1.700', 'weapon3': '3.322', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:47,259][52670] DAMAGECOUNT value on done: 828691.0 [2024-08-06 07:19:47,259][52670] Sum rewards: 79.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.180', 'weapon4': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:47,371][52666] DAMAGECOUNT value on done: 836957.0 [2024-08-06 07:19:47,371][52666] Sum rewards: 83.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.861', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.116', 'AMMO4': '0.199', 'AMMO3': '0.229', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '73.000'} [2024-08-06 07:19:47,591][52665] DAMAGECOUNT value on done: 831768.0 [2024-08-06 07:19:47,591][52665] Sum rewards: 76.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.567', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.146', 'weapon5': '0.250', 'AMMO3': '0.257', 'AMMO4': '0.295', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.602', 'WEAPON3': '1.500', 'weapon3': '2.678', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 619692032. Throughput: 0: 4375.3. Samples: 154922030. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:47,795][52567] Avg episode reward: [(0, '75.659')] [2024-08-06 07:19:48,710][52647] DAMAGECOUNT value on done: 891348.0 [2024-08-06 07:19:48,712][52647] Sum rewards: 73.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.062', 'weapon5': '0.144', 'AMMO3': '0.248', 'AMMO4': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:48,825][52795] DAMAGECOUNT value on done: 774640.0 [2024-08-06 07:19:48,826][52795] Sum rewards: 73.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.749', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon5': '0.164', 'AMMO3': '0.183', 'AMMO4': '0.235', 'weapon4': '0.254', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:49,096][52820] DAMAGECOUNT value on done: 780854.0 [2024-08-06 07:19:49,102][52820] Sum rewards: 79.087, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.011', 'AMMO2': '0.035', 'HEALTH': '0.099', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO4': '0.174', 'weapon2': '0.196', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '66.000'} [2024-08-06 07:19:49,172][52803] DAMAGECOUNT value on done: 799455.0 [2024-08-06 07:19:49,175][52803] Sum rewards: 69.792, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.700', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.148', 'AMMO4': '0.173', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '57.000'} [2024-08-06 07:19:49,434][52668] DAMAGECOUNT value on done: 853460.0 [2024-08-06 07:19:49,436][52668] Sum rewards: 76.649, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.806', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.145', 'weapon5': '0.176', 'AMMO3': '0.280', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.146', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '68.000'} [2024-08-06 07:19:50,256][52650] Updated weights for policy 0, policy_version 75651 (0.0049) [2024-08-06 07:19:50,364][52670] DAMAGECOUNT value on done: 843452.0 [2024-08-06 07:19:50,365][52670] Sum rewards: 73.153, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.262', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.132', 'weapon5': '0.132', 'AMMO4': '0.178', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.516', 'weapon2': '0.526', 'WEAPON3': '0.900', 'weapon3': '2.600', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '57.500'} [2024-08-06 07:19:50,463][52666] DAMAGECOUNT value on done: 845499.0 [2024-08-06 07:19:50,464][52666] Sum rewards: 74.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.098', 'AMMO4': '0.121', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:50,807][52665] DAMAGECOUNT value on done: 836023.0 [2024-08-06 07:19:50,808][52665] Sum rewards: 83.471, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.733', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.177', 'weapon2': '0.200', 'weapon4': '0.226', 'AMMO4': '0.239', 'weapon5': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '66.500'} [2024-08-06 07:19:51,108][52647] DAMAGECOUNT value on done: 898288.0 [2024-08-06 07:19:51,110][52647] Sum rewards: 74.697, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.990', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.158', 'weapon2': '0.218', 'weapon5': '0.288', 'AMMO3': '0.298', 'AMMO4': '0.323', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.990', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:51,995][52795] DAMAGECOUNT value on done: 782397.0 [2024-08-06 07:19:51,999][52795] Sum rewards: 74.827, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.455', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'weapon2': '0.228', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'weapon3': '3.366', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:52,303][52803] DAMAGECOUNT value on done: 792298.0 [2024-08-06 07:19:52,306][52803] Sum rewards: 83.689, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.631', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.175', 'weapon2': '0.592', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:52,359][52820] DAMAGECOUNT value on done: 787072.0 [2024-08-06 07:19:52,361][52820] Sum rewards: 77.726, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.244', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.356', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '66.000'} [2024-08-06 07:19:52,411][52668] DAMAGECOUNT value on done: 854581.0 [2024-08-06 07:19:52,411][52668] Sum rewards: 79.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.058', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '67.000'} [2024-08-06 07:19:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 619773952. Throughput: 0: 4369.1. Samples: 154948080. Policy #0 lag: (min: 2.0, avg: 4.4, max: 9.0) [2024-08-06 07:19:52,794][52567] Avg episode reward: [(0, '75.841')] [2024-08-06 07:19:53,283][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:19:53,395][52670] DAMAGECOUNT value on done: 847941.0 [2024-08-06 07:19:53,395][52670] Sum rewards: 70.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.686', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.014', 'weapon4': '0.018', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.888', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '59.000'} [2024-08-06 07:19:53,493][52666] DAMAGECOUNT value on done: 830456.0 [2024-08-06 07:19:53,499][52666] Sum rewards: 73.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.512', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.126', 'weapon5': '0.164', 'AMMO4': '0.190', 'AMMO3': '0.210', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '61.000'} [2024-08-06 07:19:53,812][52665] DAMAGECOUNT value on done: 840991.0 [2024-08-06 07:19:53,813][52665] Sum rewards: 74.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.128', 'weapon4': '0.140', 'AMMO3': '0.194', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '60.000'} [2024-08-06 07:19:54,090][52647] DAMAGECOUNT value on done: 898890.0 [2024-08-06 07:19:54,090][52647] Sum rewards: 85.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.122', 'weapon5': '0.172', 'AMMO3': '0.223', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '69.000'} [2024-08-06 07:19:54,860][52650] Updated weights for policy 0, policy_version 75661 (0.0032) [2024-08-06 07:19:54,993][52795] DAMAGECOUNT value on done: 789530.0 [2024-08-06 07:19:54,997][52795] Sum rewards: 76.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.046', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.156', 'AMMO3': '0.217', 'weapon5': '0.232', 'AMMO4': '0.316', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:55,449][52820] DAMAGECOUNT value on done: 795532.0 [2024-08-06 07:19:55,450][52820] Sum rewards: 74.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.034', 'WEAPON5': '0.050', 'AMMO3': '0.192', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '62.000'} [2024-08-06 07:19:55,563][52803] DAMAGECOUNT value on done: 786520.0 [2024-08-06 07:19:55,564][52803] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '55.000'} [2024-08-06 07:19:55,564][52668] DAMAGECOUNT value on done: 850380.0 [2024-08-06 07:19:55,568][52668] Sum rewards: 75.234, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.848', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.150', 'AMMO4': '0.223', 'weapon2': '0.254', 'AMMO3': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:55,925][52670] DAMAGECOUNT value on done: 841466.0 [2024-08-06 07:19:55,927][52670] Sum rewards: 68.491, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.566', 'AMMO5': '0.019', 'AMMO2': '0.054', 'AMMO3': '0.162', 'weapon5': '0.230', 'AMMO4': '0.271', 'weapon4': '0.492', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.734', 'WEAPON3': '1.000', 'weapon3': '2.202', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '54.000'} [2024-08-06 07:19:56,035][52666] DAMAGECOUNT value on done: 848906.0 [2024-08-06 07:19:56,037][52666] Sum rewards: 76.647, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.536', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.122', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '64.000'} [2024-08-06 07:19:56,531][52647] DAMAGECOUNT value on done: 904065.0 [2024-08-06 07:19:56,531][52647] Sum rewards: 77.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.971', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.226', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 619864064. Throughput: 0: 4367.3. Samples: 154974280. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:19:57,794][52567] Avg episode reward: [(0, '75.955')] [2024-08-06 07:19:58,121][52795] DAMAGECOUNT value on done: 782421.0 [2024-08-06 07:19:58,126][52795] Sum rewards: 68.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.645', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.098', 'weapon5': '0.110', 'weapon2': '0.176', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.486', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '56.500'} [2024-08-06 07:19:58,566][52820] DAMAGECOUNT value on done: 776021.0 [2024-08-06 07:19:58,567][52820] Sum rewards: 75.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.076', 'weapon5': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.263', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '63.000'} [2024-08-06 07:19:58,626][52803] DAMAGECOUNT value on done: 801383.0 [2024-08-06 07:19:58,627][52803] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.305', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.203', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '56.500'} [2024-08-06 07:19:58,704][52668] DAMAGECOUNT value on done: 856039.0 [2024-08-06 07:19:58,705][52668] Sum rewards: 71.061, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.849', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.092', 'weapon5': '0.192', 'AMMO3': '0.196', 'AMMO4': '0.244', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '58.000'} [2024-08-06 07:19:59,206][52670] DAMAGECOUNT value on done: 822425.0 [2024-08-06 07:19:59,206][52670] Sum rewards: 78.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.157', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.208', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.470', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:59,296][52666] DAMAGECOUNT value on done: 843344.0 [2024-08-06 07:19:59,297][52666] Sum rewards: 74.903, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.042', 'weapon4': '0.058', 'AMMO4': '0.128', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '65.000'} [2024-08-06 07:19:59,384][52650] Updated weights for policy 0, policy_version 75671 (0.0018) [2024-08-06 07:19:59,726][52647] DAMAGECOUNT value on done: 900419.0 [2024-08-06 07:19:59,726][52647] Sum rewards: 88.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.054', 'weapon4': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.394', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '72.000'} [2024-08-06 07:19:59,751][52664] DAMAGECOUNT value on done: 877094.0 [2024-08-06 07:19:59,752][52664] Sum rewards: 58.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.659', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.140', 'AMMO4': '0.190', 'AMMO3': '0.285', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'HITCOUNT': '3.230', 'weapon3': '3.250', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '51.000'} [2024-08-06 07:20:01,306][52795] DAMAGECOUNT value on done: 787249.0 [2024-08-06 07:20:01,307][52795] Sum rewards: 76.501, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.870', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.238', 'AMMO3': '0.288', 'WEAPON3': '1.750', 'weapon3': '3.418', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '68.000'} [2024-08-06 07:20:01,670][52668] DAMAGECOUNT value on done: 842018.0 [2024-08-06 07:20:01,671][52668] Sum rewards: 72.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.619', 'AMMO5': '0.017', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.197', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:01,729][52803] DAMAGECOUNT value on done: 787521.0 [2024-08-06 07:20:01,731][52803] Sum rewards: 84.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.646', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO3': '0.152', 'AMMO4': '0.172', 'weapon5': '0.244', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.090', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:01,749][52820] DAMAGECOUNT value on done: 787435.0 [2024-08-06 07:20:01,752][52820] Sum rewards: 79.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.928', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO5': '0.004', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.418', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '68.000'} [2024-08-06 07:20:02,194][52670] DAMAGECOUNT value on done: 839715.0 [2024-08-06 07:20:02,196][52670] Sum rewards: 88.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.800', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.140', 'AMMO3': '0.235', 'AMMO4': '0.241', 'weapon5': '0.252', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '21.327', 'FRAGCOUNT': '72.000'} [2024-08-06 07:20:02,265][52666] DAMAGECOUNT value on done: 843341.0 [2024-08-06 07:20:02,265][52666] Sum rewards: 72.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.078', 'AMMO4': '0.180', 'weapon5': '0.190', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '59.000'} [2024-08-06 07:20:02,578][52664] DAMAGECOUNT value on done: 882724.0 [2024-08-06 07:20:02,579][52664] Sum rewards: 81.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.528', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.126', 'weapon5': '0.158', 'AMMO4': '0.229', 'AMMO3': '0.256', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '70.000'} [2024-08-06 07:20:02,595][52647] DAMAGECOUNT value on done: 902483.0 [2024-08-06 07:20:02,596][52647] Sum rewards: 68.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.360', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.132', 'AMMO4': '0.178', 'weapon2': '0.198', 'AMMO3': '0.237', 'weapon4': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.180', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:02,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 619954176. Throughput: 0: 4364.9. Samples: 154987340. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:02,795][52567] Avg episode reward: [(0, '76.072')] [2024-08-06 07:20:03,077][52662] DAMAGECOUNT value on done: 846817.0 [2024-08-06 07:20:03,079][52662] Sum rewards: 68.735, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.775', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.362', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.344', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '56.000'} [2024-08-06 07:20:04,157][52650] Updated weights for policy 0, policy_version 75681 (0.0011) [2024-08-06 07:20:04,423][52795] DAMAGECOUNT value on done: 788418.0 [2024-08-06 07:20:04,423][52795] Sum rewards: 76.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.580', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.124', 'weapon5': '0.140', 'weapon2': '0.160', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.450', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:04,747][52668] DAMAGECOUNT value on done: 851638.0 [2024-08-06 07:20:04,749][52668] Sum rewards: 72.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.342', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO4': '0.217', 'AMMO3': '0.222', 'weapon5': '0.278', 'weapon2': '0.318', 'weapon4': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '59.000'} [2024-08-06 07:20:04,849][52803] DAMAGECOUNT value on done: 790937.0 [2024-08-06 07:20:04,851][52803] Sum rewards: 84.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.142', 'weapon2': '0.210', 'weapon5': '0.214', 'AMMO3': '0.229', 'AMMO4': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.937', 'FRAGCOUNT': '69.000'} [2024-08-06 07:20:04,896][52820] DAMAGECOUNT value on done: 798155.0 [2024-08-06 07:20:04,897][52820] Sum rewards: 66.409, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.234', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.128', 'AMMO3': '0.229', 'AMMO4': '0.251', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '56.500'} [2024-08-06 07:20:05,082][52670] DAMAGECOUNT value on done: 848906.0 [2024-08-06 07:20:05,082][52670] Sum rewards: 92.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.265', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.163', 'weapon2': '0.466', 'WEAPON3': '1.000', 'weapon3': '3.420', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '73.000'} [2024-08-06 07:20:05,144][52666] DAMAGECOUNT value on done: 837026.0 [2024-08-06 07:20:05,146][52666] Sum rewards: 79.322, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.268', 'weapon2': '0.428', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:05,621][52647] DAMAGECOUNT value on done: 880118.0 [2024-08-06 07:20:05,625][52647] Sum rewards: 78.921, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.131', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO3': '0.166', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.390', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:05,630][52664] DAMAGECOUNT value on done: 884010.0 [2024-08-06 07:20:05,631][52664] Sum rewards: 77.334, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.885', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.162', 'AMMO3': '0.210', 'AMMO4': '0.240', 'weapon4': '0.246', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:06,312][52662] DAMAGECOUNT value on done: 857357.0 [2024-08-06 07:20:06,315][52662] Sum rewards: 78.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.520', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.121', 'weapon2': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'weapon3': '3.398', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '67.000'} [2024-08-06 07:20:07,506][52670] DAMAGECOUNT value on done: 839662.0 [2024-08-06 07:20:07,507][52670] Sum rewards: 62.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.727', 'AMMO5': '0.025', 'AMMO2': '0.057', 'weapon4': '0.172', 'AMMO3': '0.174', 'weapon5': '0.278', 'AMMO4': '0.283', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'weapon2': '0.780', 'WEAPON3': '1.050', 'weapon3': '2.476', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '51.000'} [2024-08-06 07:20:07,592][52795] DAMAGECOUNT value on done: 784023.0 [2024-08-06 07:20:07,612][52795] Sum rewards: 80.391, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.200', 'AMMO5': '0.014', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.111', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.650', 'weapon3': '3.104', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '69.000'} [2024-08-06 07:20:07,682][52666] DAMAGECOUNT value on done: 837321.0 [2024-08-06 07:20:07,685][52666] Sum rewards: 75.506, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO5': '0.019', 'AMMO2': '0.034', 'AMMO3': '0.140', 'AMMO4': '0.172', 'weapon4': '0.226', 'weapon5': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.964', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:07,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 620044288. Throughput: 0: 4362.2. Samples: 155013510. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:07,802][52567] Avg episode reward: [(0, '75.995')] [2024-08-06 07:20:07,923][52668] DAMAGECOUNT value on done: 852822.0 [2024-08-06 07:20:07,925][52668] Sum rewards: 78.353, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.505', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.586', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:08,014][52803] DAMAGECOUNT value on done: 795988.0 [2024-08-06 07:20:08,014][52803] Sum rewards: 84.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.075', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.104', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '70.000'} [2024-08-06 07:20:08,109][52820] DAMAGECOUNT value on done: 789275.0 [2024-08-06 07:20:08,109][52820] Sum rewards: 62.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.176', 'AMMO4': '0.203', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '52.000'} [2024-08-06 07:20:08,390][52820] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:20:08,802][52650] Updated weights for policy 0, policy_version 75691 (0.0037) [2024-08-06 07:20:08,806][52647] DAMAGECOUNT value on done: 895866.0 [2024-08-06 07:20:08,813][52647] Sum rewards: 65.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.186', 'AMMO4': '0.192', 'AMMO3': '0.217', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.114', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '55.000'} [2024-08-06 07:20:08,838][52664] DAMAGECOUNT value on done: 875059.0 [2024-08-06 07:20:08,838][52664] Sum rewards: 71.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.510', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.090', 'weapon4': '0.114', 'AMMO3': '0.160', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '58.500'} [2024-08-06 07:20:09,017][52795] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:20:09,270][52662] DAMAGECOUNT value on done: 858382.0 [2024-08-06 07:20:09,271][52662] Sum rewards: 82.888, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.248', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.100', 'weapon5': '0.220', 'AMMO3': '0.233', 'weapon2': '0.272', 'AMMO4': '0.275', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '68.000'} [2024-08-06 07:20:10,221][52670] DAMAGECOUNT value on done: 842945.0 [2024-08-06 07:20:10,221][52670] Sum rewards: 80.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.492', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.082', 'weapon4': '0.142', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '68.000'} [2024-08-06 07:20:10,367][52666] DAMAGECOUNT value on done: 851807.0 [2024-08-06 07:20:10,368][52666] Sum rewards: 68.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.028', 'AMMO2': '0.054', 'weapon4': '0.122', 'AMMO3': '0.163', 'AMMO4': '0.271', 'weapon5': '0.368', 'WEAPON4': '0.550', 'weapon2': '0.576', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.658', 'HITCOUNT': '2.730', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '55.000'} [2024-08-06 07:20:10,756][52668] DAMAGECOUNT value on done: 842201.0 [2024-08-06 07:20:10,756][52668] Sum rewards: 75.954, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.609', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.080', 'AMMO4': '0.196', 'weapon5': '0.206', 'AMMO3': '0.279', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.134', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:10,773][52795] DAMAGECOUNT value on done: 778070.0 [2024-08-06 07:20:10,773][52795] Sum rewards: 75.382, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.882', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.172', 'weapon5': '0.204', 'AMMO4': '0.215', 'weapon4': '0.236', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '60.000'} [2024-08-06 07:20:11,125][52803] DAMAGECOUNT value on done: 798156.0 [2024-08-06 07:20:11,125][52803] Sum rewards: 58.877, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'ARMOR': '0.004', 'AMMO5': '0.024', 'weapon7': '0.050', 'AMMO2': '0.057', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.180', 'weapon5': '0.246', 'AMMO4': '0.285', 'weapon2': '0.402', 'WEAPON4': '0.600', 'weapon4': '0.602', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.428', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '48.500'} [2024-08-06 07:20:11,331][52820] DAMAGECOUNT value on done: 791252.0 [2024-08-06 07:20:11,332][52820] Sum rewards: 65.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.611', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon4': '0.124', 'weapon5': '0.156', 'AMMO3': '0.211', 'AMMO4': '0.315', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '55.500'} [2024-08-06 07:20:11,926][52647] DAMAGECOUNT value on done: 893754.0 [2024-08-06 07:20:11,926][52647] Sum rewards: 56.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.510', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.124', 'weapon5': '0.136', 'AMMO4': '0.157', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.798', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.075', 'FRAGCOUNT': '47.000'} [2024-08-06 07:20:11,983][52662] DAMAGECOUNT value on done: 843439.0 [2024-08-06 07:20:11,984][52662] Sum rewards: 74.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.459', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.088', 'weapon5': '0.132', 'AMMO3': '0.192', 'AMMO4': '0.232', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '62.000'} [2024-08-06 07:20:12,024][52664] DAMAGECOUNT value on done: 883804.0 [2024-08-06 07:20:12,026][52664] Sum rewards: 64.279, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.170', 'weapon5': '0.180', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.028', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '55.000'} [2024-08-06 07:20:12,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 620126208. Throughput: 0: 4363.6. Samples: 155039850. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:12,802][52567] Avg episode reward: [(0, '75.368')] [2024-08-06 07:20:12,872][52666] DAMAGECOUNT value on done: 829221.0 [2024-08-06 07:20:12,873][52666] Sum rewards: 71.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.535', 'AMMO5': '0.016', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.180', 'weapon5': '0.368', 'weapon4': '0.396', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.476', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:13,157][52668] DAMAGECOUNT value on done: 845580.0 [2024-08-06 07:20:13,157][52668] Sum rewards: 70.195, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.302', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.140', 'weapon4': '0.186', 'AMMO4': '0.217', 'weapon2': '0.218', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '61.000'} [2024-08-06 07:20:13,487][52650] Updated weights for policy 0, policy_version 75701 (0.0020) [2024-08-06 07:20:14,018][52795] DAMAGECOUNT value on done: 780512.0 [2024-08-06 07:20:14,021][52795] Sum rewards: 61.710, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.760', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.060', 'weapon5': '0.134', 'AMMO4': '0.223', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'AMMO3': '0.375', 'WEAPON3': '2.150', 'weapon3': '3.212', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:14,161][52803] DAMAGECOUNT value on done: 796727.0 [2024-08-06 07:20:14,162][52803] Sum rewards: 77.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.496', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.044', 'AMMO4': '0.145', 'AMMO3': '0.180', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.816', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '62.000'} [2024-08-06 07:20:14,561][52820] DAMAGECOUNT value on done: 788913.0 [2024-08-06 07:20:14,561][52820] Sum rewards: 73.825, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.656', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.274', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:14,633][52647] DAMAGECOUNT value on done: 893205.0 [2024-08-06 07:20:14,634][52647] Sum rewards: 75.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.342', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.044', 'weapon4': '0.068', 'AMMO4': '0.222', 'weapon2': '0.238', 'AMMO3': '0.286', 'weapon5': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.800', 'weapon3': '3.138', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:14,754][52664] DAMAGECOUNT value on done: 881977.0 [2024-08-06 07:20:14,756][52664] Sum rewards: 65.510, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.016', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.257', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:14,870][52662] DAMAGECOUNT value on done: 861187.0 [2024-08-06 07:20:14,872][52662] Sum rewards: 73.590, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.105', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.250', 'WEAPON3': '0.950', 'HEALTH': '1.122', 'weapon3': '3.368', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '59.000'} [2024-08-06 07:20:15,911][52668] DAMAGECOUNT value on done: 853828.0 [2024-08-06 07:20:15,913][52668] Sum rewards: 69.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.236', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.214', 'AMMO4': '0.230', 'weapon5': '0.300', 'weapon4': '0.340', 'weapon2': '0.412', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.646', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:16,220][52666] DAMAGECOUNT value on done: 836952.0 [2024-08-06 07:20:16,221][52666] Sum rewards: 68.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.349', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:17,174][52795] DAMAGECOUNT value on done: 790553.0 [2024-08-06 07:20:17,175][52795] Sum rewards: 67.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.860', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.086', 'weapon5': '0.198', 'AMMO4': '0.211', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '55.000'} [2024-08-06 07:20:17,230][52803] DAMAGECOUNT value on done: 793362.0 [2024-08-06 07:20:17,232][52803] Sum rewards: 68.199, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.916', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.648', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:17,309][52647] DAMAGECOUNT value on done: 882242.0 [2024-08-06 07:20:17,311][52647] Sum rewards: 63.413, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.304', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.226', 'AMMO3': '0.228', 'AMMO4': '0.246', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '54.000'} [2024-08-06 07:20:17,522][52662] DAMAGECOUNT value on done: 840180.0 [2024-08-06 07:20:17,522][52662] Sum rewards: 79.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.395', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.068', 'AMMO4': '0.194', 'weapon5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:17,554][52664] DAMAGECOUNT value on done: 874567.0 [2024-08-06 07:20:17,555][52664] Sum rewards: 67.304, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.117', 'weapon5': '0.132', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.266', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '55.000'} [2024-08-06 07:20:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17522.6). Total num frames: 620216320. Throughput: 0: 4365.8. Samples: 155052970. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:17,794][52567] Avg episode reward: [(0, '74.431')] [2024-08-06 07:20:17,817][52820] DAMAGECOUNT value on done: 788703.0 [2024-08-06 07:20:17,821][52820] Sum rewards: 66.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.004', 'AMMO5': '0.028', 'AMMO2': '0.056', 'AMMO3': '0.186', 'weapon2': '0.216', 'AMMO4': '0.281', 'weapon4': '0.402', 'weapon5': '0.410', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.692', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '54.000'} [2024-08-06 07:20:18,524][52650] Updated weights for policy 0, policy_version 75711 (0.0013) [2024-08-06 07:20:19,191][52668] DAMAGECOUNT value on done: 844663.0 [2024-08-06 07:20:19,195][52668] Sum rewards: 64.155, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.376', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.078', 'AMMO4': '0.144', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.202', 'weapon2': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '2.980', 'weapon3': '3.276', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 07:20:19,790][52647] DAMAGECOUNT value on done: 898354.0 [2024-08-06 07:20:19,790][52647] Sum rewards: 78.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.820', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.136', 'AMMO3': '0.172', 'AMMO4': '0.188', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.000'} [2024-08-06 07:20:19,983][52664] DAMAGECOUNT value on done: 871165.0 [2024-08-06 07:20:19,985][52664] Sum rewards: 85.556, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.080', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.121', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.660', 'WEAPON3': '0.950', 'weapon3': '2.898', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '67.000'} [2024-08-06 07:20:20,329][52795] DAMAGECOUNT value on done: 775821.0 [2024-08-06 07:20:20,333][52795] Sum rewards: 73.850, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.964', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.212', 'AMMO4': '0.218', 'weapon2': '0.230', 'AMMO3': '0.255', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:20,515][52662] DAMAGECOUNT value on done: 846766.0 [2024-08-06 07:20:20,517][52662] Sum rewards: 66.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.856', 'AMMO5': '0.020', 'AMMO2': '0.065', 'AMMO3': '0.277', 'weapon5': '0.290', 'weapon4': '0.292', 'AMMO4': '0.327', 'weapon2': '0.452', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.664', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '56.000'} [2024-08-06 07:20:20,924][52820] DAMAGECOUNT value on done: 797961.0 [2024-08-06 07:20:20,924][52820] Sum rewards: 69.083, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.855', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO4': '0.157', 'weapon5': '0.174', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:21,299][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:20:22,486][52647] DAMAGECOUNT value on done: 887573.0 [2024-08-06 07:20:22,486][52647] Sum rewards: 82.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.395', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.066', 'AMMO4': '0.131', 'weapon5': '0.140', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.050', 'weapon3': '3.270', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:22,556][52650] Updated weights for policy 0, policy_version 75721 (0.0047) [2024-08-06 07:20:22,560][52668] DAMAGECOUNT value on done: 841588.0 [2024-08-06 07:20:22,560][52668] Sum rewards: 72.737, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.190', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.040', 'weapon5': '0.084', 'AMMO4': '0.108', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.240', 'WEAPON3': '0.800', 'HITCOUNT': '3.020', 'weapon3': '3.520', 'DAMAGECOUNT': '15.906', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:22,684][52667] DAMAGECOUNT value on done: 848845.0 [2024-08-06 07:20:22,685][52667] Sum rewards: 81.437, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.375', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'weapon4': '0.102', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.212', 'WEAPON3': '1.250', 'weapon3': '3.430', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '67.000'} [2024-08-06 07:20:22,732][52664] DAMAGECOUNT value on done: 882317.0 [2024-08-06 07:20:22,734][52664] Sum rewards: 69.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon4': '0.306', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 620306432. Throughput: 0: 4366.0. Samples: 155079090. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:22,795][52567] Avg episode reward: [(0, '74.012')] [2024-08-06 07:20:23,226][52662] DAMAGECOUNT value on done: 864817.0 [2024-08-06 07:20:23,227][52662] Sum rewards: 77.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:23,242][52659] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:20:23,513][52795] DAMAGECOUNT value on done: 789128.0 [2024-08-06 07:20:23,514][52795] Sum rewards: 78.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.648', 'AMMO5': '0.017', 'AMMO2': '0.059', 'AMMO3': '0.252', 'weapon4': '0.252', 'weapon5': '0.266', 'AMMO4': '0.296', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.766', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:23,927][52820] DAMAGECOUNT value on done: 796127.0 [2024-08-06 07:20:23,927][52820] Sum rewards: 77.154, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.817', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.096', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.342', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:24,868][52647] DAMAGECOUNT value on done: 897786.0 [2024-08-06 07:20:24,870][52647] Sum rewards: 83.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.005', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.122', 'AMMO3': '0.180', 'weapon4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '68.000'} [2024-08-06 07:20:25,259][52664] DAMAGECOUNT value on done: 877892.0 [2024-08-06 07:20:25,260][52664] Sum rewards: 74.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.038', 'weapon5': '0.112', 'AMMO4': '0.190', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '60.500'} [2024-08-06 07:20:25,378][52668] DAMAGECOUNT value on done: 837873.0 [2024-08-06 07:20:25,379][52668] Sum rewards: 75.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.728', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.214', 'AMMO4': '0.214', 'weapon4': '0.216', 'AMMO3': '0.251', 'weapon2': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.978', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:25,639][52667] DAMAGECOUNT value on done: 858798.0 [2024-08-06 07:20:25,639][52667] Sum rewards: 69.966, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.158', 'weapon5': '0.176', 'AMMO3': '0.225', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.190', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:26,264][52662] DAMAGECOUNT value on done: 850613.0 [2024-08-06 07:20:26,264][52662] Sum rewards: 75.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.594', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:26,682][52795] DAMAGECOUNT value on done: 786758.0 [2024-08-06 07:20:26,683][52795] Sum rewards: 72.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '60.000'} [2024-08-06 07:20:26,998][52820] DAMAGECOUNT value on done: 778135.0 [2024-08-06 07:20:26,999][52820] Sum rewards: 68.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.428', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon4': '0.134', 'weapon5': '0.138', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'weapon2': '0.276', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.242', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '55.000'} [2024-08-06 07:20:27,632][52647] DAMAGECOUNT value on done: 897361.0 [2024-08-06 07:20:27,639][52647] Sum rewards: 79.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.698', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.142', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '67.000'} [2024-08-06 07:20:27,697][52650] Updated weights for policy 0, policy_version 75731 (0.0023) [2024-08-06 07:20:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 620388352. Throughput: 0: 4364.6. Samples: 155105360. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:27,795][52567] Avg episode reward: [(0, '74.055')] [2024-08-06 07:20:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075731_620388352.pth... [2024-08-06 07:20:27,967][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075219_616194048.pth [2024-08-06 07:20:27,978][52668] DAMAGECOUNT value on done: 837258.0 [2024-08-06 07:20:27,980][52668] Sum rewards: 63.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.940', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.110', 'weapon5': '0.154', 'AMMO4': '0.189', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.942', 'WEAPON3': '1.350', 'weapon3': '2.620', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '52.000'} [2024-08-06 07:20:28,274][52664] DAMAGECOUNT value on done: 888686.0 [2024-08-06 07:20:28,274][52664] Sum rewards: 79.342, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.916', 'WEAPON3': '1.000', 'weapon3': '2.902', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:28,557][52667] DAMAGECOUNT value on done: 854976.0 [2024-08-06 07:20:28,558][52667] Sum rewards: 90.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.227', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.159', 'weapon5': '0.188', 'AMMO4': '0.226', 'weapon2': '0.336', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.832', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.796', 'FRAGCOUNT': '72.000'} [2024-08-06 07:20:29,178][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:20:29,264][52662] DAMAGECOUNT value on done: 857385.0 [2024-08-06 07:20:29,264][52662] Sum rewards: 72.068, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon4': '0.158', 'AMMO3': '0.224', 'weapon5': '0.260', 'AMMO4': '0.299', 'weapon2': '0.398', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '61.000'} [2024-08-06 07:20:30,151][52795] DAMAGECOUNT value on done: 775168.0 [2024-08-06 07:20:30,152][52795] Sum rewards: 65.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.565', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.094', 'weapon5': '0.094', 'WEAPON4': '0.200', 'weapon2': '0.226', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.434', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:30,353][52668] DAMAGECOUNT value on done: 833104.0 [2024-08-06 07:20:30,354][52668] Sum rewards: 77.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.555', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon5': '0.180', 'AMMO4': '0.205', 'AMMO3': '0.209', 'weapon4': '0.244', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:31,059][52647] DAMAGECOUNT value on done: 884502.0 [2024-08-06 07:20:31,059][52647] Sum rewards: 78.226, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.763', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.136', 'AMMO4': '0.173', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:31,156][52667] DAMAGECOUNT value on done: 861526.0 [2024-08-06 07:20:31,156][52667] Sum rewards: 81.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.216', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '68.000'} [2024-08-06 07:20:31,676][52664] DAMAGECOUNT value on done: 886697.0 [2024-08-06 07:20:31,680][52664] Sum rewards: 63.835, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.320', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.184', 'weapon2': '0.228', 'weapon4': '0.228', 'AMMO4': '0.261', 'AMMO3': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.062', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '56.500'} [2024-08-06 07:20:32,176][52650] Updated weights for policy 0, policy_version 75741 (0.0033) [2024-08-06 07:20:32,351][52662] DAMAGECOUNT value on done: 846973.0 [2024-08-06 07:20:32,351][52662] Sum rewards: 77.648, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.191', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.084', 'AMMO3': '0.180', 'weapon5': '0.180', 'AMMO4': '0.199', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.166', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '62.000'} [2024-08-06 07:20:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 620478464. Throughput: 0: 4359.4. Samples: 155118200. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:32,794][52567] Avg episode reward: [(0, '73.888')] [2024-08-06 07:20:32,901][52668] DAMAGECOUNT value on done: 846723.0 [2024-08-06 07:20:32,901][52668] Sum rewards: 65.354, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.488', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.088', 'weapon5': '0.186', 'weapon2': '0.214', 'AMMO3': '0.260', 'AMMO4': '0.323', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.190', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:33,356][52795] DAMAGECOUNT value on done: 783425.0 [2024-08-06 07:20:33,357][52795] Sum rewards: 70.171, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.135', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.122', 'AMMO3': '0.145', 'weapon5': '0.178', 'AMMO4': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '0.950', 'HITCOUNT': '3.010', 'weapon3': '3.020', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '56.000'} [2024-08-06 07:20:33,766][52647] DAMAGECOUNT value on done: 889738.0 [2024-08-06 07:20:33,766][52647] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.415', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.132', 'weapon5': '0.144', 'AMMO4': '0.172', 'AMMO3': '0.219', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '68.000'} [2024-08-06 07:20:34,185][52667] DAMAGECOUNT value on done: 861071.0 [2024-08-06 07:20:34,185][52667] Sum rewards: 74.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.182', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.172', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'weapon4': '0.344', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '61.000'} [2024-08-06 07:20:34,277][52664] DAMAGECOUNT value on done: 885715.0 [2024-08-06 07:20:34,277][52664] Sum rewards: 72.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-4.345', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.148', 'AMMO3': '0.157', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'weapon4': '0.422', 'weapon2': '0.586', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.604', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '60.000'} [2024-08-06 07:20:35,028][52660] DAMAGECOUNT value on done: 845864.0 [2024-08-06 07:20:35,038][52660] Sum rewards: 75.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.164', 'AMMO4': '0.203', 'AMMO3': '0.237', 'weapon4': '0.292', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.862', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '61.000'} [2024-08-06 07:20:35,211][52662] DAMAGECOUNT value on done: 849450.0 [2024-08-06 07:20:35,213][52662] Sum rewards: 76.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.424', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:35,704][52668] DAMAGECOUNT value on done: 850907.0 [2024-08-06 07:20:35,704][52668] Sum rewards: 71.447, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.600', 'HITCOUNT': '3.220', 'weapon3': '3.238', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:36,349][52647] DAMAGECOUNT value on done: 883114.0 [2024-08-06 07:20:36,349][52647] Sum rewards: 78.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.128', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON3': '1.550', 'weapon3': '3.540', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '67.000'} [2024-08-06 07:20:36,684][52795] DAMAGECOUNT value on done: 791008.0 [2024-08-06 07:20:36,684][52795] Sum rewards: 72.990, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.157', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.134', 'AMMO4': '0.165', 'weapon5': '0.186', 'AMMO3': '0.280', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.082', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:36,827][52664] DAMAGECOUNT value on done: 897092.0 [2024-08-06 07:20:36,828][52664] Sum rewards: 67.760, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.758', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon5': '0.154', 'weapon4': '0.160', 'AMMO3': '0.216', 'AMMO4': '0.291', 'weapon2': '0.362', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:37,057][52650] Updated weights for policy 0, policy_version 75751 (0.0013) [2024-08-06 07:20:37,337][52667] DAMAGECOUNT value on done: 860471.0 [2024-08-06 07:20:37,337][52667] Sum rewards: 80.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.375', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.150', 'AMMO4': '0.177', 'weapon2': '0.242', 'AMMO3': '0.253', 'weapon4': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '67.000'} [2024-08-06 07:20:37,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 620560384. Throughput: 0: 4365.3. Samples: 155144520. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:20:37,796][52567] Avg episode reward: [(0, '73.888')] [2024-08-06 07:20:38,186][52662] DAMAGECOUNT value on done: 841695.0 [2024-08-06 07:20:38,186][52662] Sum rewards: 79.226, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.514', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:38,278][52660] DAMAGECOUNT value on done: 838022.0 [2024-08-06 07:20:38,279][52660] Sum rewards: 67.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.196', 'weapon2': '0.210', 'AMMO3': '0.212', 'AMMO4': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.358', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '56.500'} [2024-08-06 07:20:38,837][52668] DAMAGECOUNT value on done: 848617.0 [2024-08-06 07:20:38,839][52668] Sum rewards: 69.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.140', 'weapon5': '0.168', 'AMMO4': '0.183', 'AMMO3': '0.208', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.624', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '59.000'} [2024-08-06 07:20:38,850][52647] DAMAGECOUNT value on done: 885193.0 [2024-08-06 07:20:38,851][52647] Sum rewards: 71.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.614', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '59.000'} [2024-08-06 07:20:39,317][52664] DAMAGECOUNT value on done: 892896.0 [2024-08-06 07:20:39,319][52664] Sum rewards: 78.479, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.232', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.123', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '65.500'} [2024-08-06 07:20:40,371][52667] DAMAGECOUNT value on done: 855092.0 [2024-08-06 07:20:40,379][52667] Sum rewards: 70.832, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.973', 'AMMO5': '0.023', 'AMMO2': '0.066', 'weapon5': '0.176', 'weapon4': '0.212', 'AMMO3': '0.224', 'weapon2': '0.304', 'AMMO4': '0.328', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '60.000'} [2024-08-06 07:20:40,989][52662] DAMAGECOUNT value on done: 854899.0 [2024-08-06 07:20:40,989][52662] Sum rewards: 68.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.348', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.058', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.948', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:41,249][52660] DAMAGECOUNT value on done: 850587.0 [2024-08-06 07:20:41,249][52660] Sum rewards: 80.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.934', 'AMMO5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.043', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.656', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:41,749][52650] Updated weights for policy 0, policy_version 75761 (0.0025) [2024-08-06 07:20:41,909][52668] DAMAGECOUNT value on done: 853516.0 [2024-08-06 07:20:41,909][52668] Sum rewards: 69.101, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.268', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.094', 'weapon5': '0.236', 'AMMO4': '0.257', 'AMMO3': '0.261', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.934', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '58.000'} [2024-08-06 07:20:42,027][52664] DAMAGECOUNT value on done: 890993.0 [2024-08-06 07:20:42,028][52664] Sum rewards: 65.415, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.938', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.090', 'weapon5': '0.164', 'AMMO4': '0.222', 'weapon2': '0.222', 'AMMO3': '0.251', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.278', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2024-08-06 07:20:42,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 620650496. Throughput: 0: 4367.1. Samples: 155170800. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:20:42,795][52567] Avg episode reward: [(0, '73.355')] [2024-08-06 07:20:43,387][52662] DAMAGECOUNT value on done: 842787.0 [2024-08-06 07:20:43,389][52662] Sum rewards: 69.477, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.664', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.142', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'weapon4': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.000', 'weapon3': '3.154', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '54.000'} [2024-08-06 07:20:43,405][52667] DAMAGECOUNT value on done: 851893.0 [2024-08-06 07:20:43,405][52667] Sum rewards: 77.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.117', 'weapon5': '0.124', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '3.078', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:44,269][52660] DAMAGECOUNT value on done: 861478.0 [2024-08-06 07:20:44,270][52660] Sum rewards: 73.837, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO3': '0.169', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '3.150', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '60.000'} [2024-08-06 07:20:44,345][52664] DAMAGECOUNT value on done: 876877.0 [2024-08-06 07:20:44,346][52664] Sum rewards: 76.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.217', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.178', 'weapon5': '0.216', 'AMMO4': '0.231', 'AMMO3': '0.243', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:45,056][52668] DAMAGECOUNT value on done: 853425.0 [2024-08-06 07:20:45,059][52668] Sum rewards: 73.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.456', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.108', 'AMMO3': '0.216', 'AMMO4': '0.236', 'weapon5': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.678', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '59.000'} [2024-08-06 07:20:46,067][52662] DAMAGECOUNT value on done: 860962.0 [2024-08-06 07:20:46,067][52662] Sum rewards: 82.348, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.098', 'weapon5': '0.194', 'AMMO4': '0.226', 'AMMO3': '0.231', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '69.000'} [2024-08-06 07:20:46,418][52667] DAMAGECOUNT value on done: 853617.0 [2024-08-06 07:20:46,422][52667] Sum rewards: 77.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.691', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.087', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '63.000'} [2024-08-06 07:20:46,459][52650] Updated weights for policy 0, policy_version 75771 (0.0031) [2024-08-06 07:20:47,228][52664] DAMAGECOUNT value on done: 882304.0 [2024-08-06 07:20:47,228][52664] Sum rewards: 72.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.378', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.145', 'weapon2': '0.218', 'AMMO3': '0.242', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '60.000'} [2024-08-06 07:20:47,245][52660] DAMAGECOUNT value on done: 843524.0 [2024-08-06 07:20:47,254][52660] Sum rewards: 82.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.943', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon4': '0.234', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.018', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '69.000'} [2024-08-06 07:20:47,709][52659] DAMAGECOUNT value on done: 851781.0 [2024-08-06 07:20:47,710][52659] Sum rewards: 76.974, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.032', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO4': '0.163', 'AMMO3': '0.176', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '62.000'} [2024-08-06 07:20:47,794][52567] Fps is (10 sec: 17204.1, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 620732416. Throughput: 0: 4366.9. Samples: 155183850. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:20:47,794][52567] Avg episode reward: [(0, '73.342')] [2024-08-06 07:20:48,672][52662] DAMAGECOUNT value on done: 854228.0 [2024-08-06 07:20:48,673][52662] Sum rewards: 77.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.002', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon5': '0.202', 'weapon4': '0.246', 'AMMO3': '0.255', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:49,354][52667] DAMAGECOUNT value on done: 859530.0 [2024-08-06 07:20:49,355][52667] Sum rewards: 82.655, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.282', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:50,005][52664] DAMAGECOUNT value on done: 884284.0 [2024-08-06 07:20:50,006][52664] Sum rewards: 76.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.095', 'weapon5': '0.106', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '62.500'} [2024-08-06 07:20:50,598][52660] DAMAGECOUNT value on done: 841217.0 [2024-08-06 07:20:50,599][52660] Sum rewards: 67.755, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.840', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.294', 'WEAPON3': '1.700', 'HITCOUNT': '3.330', 'weapon3': '3.456', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '60.000'} [2024-08-06 07:20:50,622][52659] DAMAGECOUNT value on done: 847944.0 [2024-08-06 07:20:50,627][52659] Sum rewards: 62.678, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.154', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO4': '0.186', 'weapon4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '2.940', 'weapon3': '3.136', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '57.000'} [2024-08-06 07:20:50,927][52650] Updated weights for policy 0, policy_version 75781 (0.0019) [2024-08-06 07:20:51,829][52662] DAMAGECOUNT value on done: 838160.0 [2024-08-06 07:20:51,829][52662] Sum rewards: 78.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.956', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.052', 'weapon5': '0.076', 'AMMO4': '0.078', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '3.202', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:52,352][52667] DAMAGECOUNT value on done: 847131.0 [2024-08-06 07:20:52,352][52667] Sum rewards: 76.161, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.465', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.072', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '62.000'} [2024-08-06 07:20:52,686][52664] DAMAGECOUNT value on done: 876124.0 [2024-08-06 07:20:52,688][52664] Sum rewards: 72.118, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.720', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.160', 'weapon5': '0.238', 'AMMO4': '0.258', 'AMMO3': '0.309', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.750', 'weapon3': '2.802', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:52,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 620822528. Throughput: 0: 4362.0. Samples: 155209800. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:20:52,794][52567] Avg episode reward: [(0, '73.246')] [2024-08-06 07:20:53,113][52660] DAMAGECOUNT value on done: 848535.0 [2024-08-06 07:20:53,113][52660] Sum rewards: 77.887, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.619', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.162', 'weapon2': '0.212', 'AMMO4': '0.219', 'weapon4': '0.226', 'AMMO3': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.084', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '67.500'} [2024-08-06 07:20:53,954][52659] DAMAGECOUNT value on done: 856476.0 [2024-08-06 07:20:53,954][52659] Sum rewards: 85.011, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.201', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.263', 'weapon2': '0.294', 'WEAPON3': '1.700', 'weapon3': '3.408', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.138', 'FRAGCOUNT': '72.000'} [2024-08-06 07:20:54,690][52662] DAMAGECOUNT value on done: 848359.0 [2024-08-06 07:20:54,692][52662] Sum rewards: 79.913, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.090', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.058', 'weapon5': '0.166', 'AMMO4': '0.222', 'AMMO3': '0.260', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '69.000'} [2024-08-06 07:20:54,904][52667] DAMAGECOUNT value on done: 851706.0 [2024-08-06 07:20:54,905][52667] Sum rewards: 74.726, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.105', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.115', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.284', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '59.000'} [2024-08-06 07:20:55,996][52650] Updated weights for policy 0, policy_version 75791 (0.0016) [2024-08-06 07:20:56,196][52660] DAMAGECOUNT value on done: 854722.0 [2024-08-06 07:20:56,196][52660] Sum rewards: 79.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.935', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon5': '0.056', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.242', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '65.000'} [2024-08-06 07:20:57,022][52659] DAMAGECOUNT value on done: 850124.0 [2024-08-06 07:20:57,022][52659] Sum rewards: 62.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.078', 'weapon5': '0.196', 'AMMO3': '0.232', 'AMMO4': '0.234', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.116', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '52.000'} [2024-08-06 07:20:57,262][52662] DAMAGECOUNT value on done: 840977.0 [2024-08-06 07:20:57,263][52662] Sum rewards: 76.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.275', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.282', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.298', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '64.000'} [2024-08-06 07:20:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 620912640. Throughput: 0: 4366.4. Samples: 155236340. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:20:57,794][52567] Avg episode reward: [(0, '73.405')] [2024-08-06 07:20:58,164][52667] DAMAGECOUNT value on done: 860801.0 [2024-08-06 07:20:58,164][52667] Sum rewards: 82.894, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.375', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.076', 'weapon5': '0.148', 'AMMO4': '0.171', 'AMMO3': '0.176', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '66.000'} [2024-08-06 07:20:58,899][52660] DAMAGECOUNT value on done: 840956.0 [2024-08-06 07:20:58,899][52660] Sum rewards: 71.191, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.012', 'weapon4': '0.034', 'AMMO2': '0.043', 'weapon5': '0.110', 'AMMO4': '0.217', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '61.000'} [2024-08-06 07:20:59,645][52659] DAMAGECOUNT value on done: 849023.0 [2024-08-06 07:20:59,646][52659] Sum rewards: 75.179, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.858', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.106', 'weapon5': '0.180', 'AMMO4': '0.219', 'AMMO3': '0.261', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '63.000'} [2024-08-06 07:21:00,426][52650] Updated weights for policy 0, policy_version 75801 (0.0023) [2024-08-06 07:21:01,277][52667] DAMAGECOUNT value on done: 849391.0 [2024-08-06 07:21:01,278][52667] Sum rewards: 86.680, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.598', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.159', 'weapon4': '0.196', 'AMMO3': '0.220', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '70.000'} [2024-08-06 07:21:02,011][52660] DAMAGECOUNT value on done: 840041.0 [2024-08-06 07:21:02,013][52660] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.475', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.362', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '57.000'} [2024-08-06 07:21:02,290][52659] DAMAGECOUNT value on done: 849555.0 [2024-08-06 07:21:02,293][52659] Sum rewards: 80.406, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.063', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.120', 'AMMO4': '0.135', 'weapon5': '0.162', 'AMMO3': '0.197', 'weapon2': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '67.000'} [2024-08-06 07:21:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 621002752. Throughput: 0: 4369.3. Samples: 155249590. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:21:02,794][52567] Avg episode reward: [(0, '74.119')] [2024-08-06 07:21:03,734][52658] Large shaping reward 2.580 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.558, 186.0), ('weapon3', 0.002)] [2024-08-06 07:21:03,844][52667] DAMAGECOUNT value on done: 857545.0 [2024-08-06 07:21:03,844][52667] Sum rewards: 81.571, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.584', 'AMMO5': '0.019', 'AMMO2': '0.041', 'AMMO3': '0.194', 'AMMO4': '0.203', 'weapon2': '0.220', 'weapon5': '0.302', 'weapon4': '0.438', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.448', 'FRAGCOUNT': '63.000'} [2024-08-06 07:21:04,998][52660] DAMAGECOUNT value on done: 852060.0 [2024-08-06 07:21:04,998][52660] Sum rewards: 70.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.220', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 07:21:05,141][52650] Updated weights for policy 0, policy_version 75811 (0.0032) [2024-08-06 07:21:05,424][52659] DAMAGECOUNT value on done: 852860.0 [2024-08-06 07:21:05,425][52659] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.417', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.124', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '2.966', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '61.000'} [2024-08-06 07:21:06,283][52667] DAMAGECOUNT value on done: 862744.0 [2024-08-06 07:21:06,284][52667] Sum rewards: 73.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.346', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.124', 'AMMO4': '0.186', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '60.000'} [2024-08-06 07:21:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 621084672. Throughput: 0: 4373.3. Samples: 155275890. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:21:07,794][52567] Avg episode reward: [(0, '74.302')] [2024-08-06 07:21:08,287][52660] DAMAGECOUNT value on done: 840291.0 [2024-08-06 07:21:08,289][52660] Sum rewards: 84.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.400', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.062', 'AMMO4': '0.156', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.660', 'FRAGCOUNT': '69.000'} [2024-08-06 07:21:08,408][52659] DAMAGECOUNT value on done: 851210.0 [2024-08-06 07:21:08,410][52659] Sum rewards: 77.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.125', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.094', 'AMMO4': '0.118', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '65.000'} [2024-08-06 07:21:08,923][52667] DAMAGECOUNT value on done: 863386.0 [2024-08-06 07:21:08,925][52667] Sum rewards: 82.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.072', 'weapon4': '0.094', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.358', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '66.000'} [2024-08-06 07:21:09,757][52650] Updated weights for policy 0, policy_version 75821 (0.0011) [2024-08-06 07:21:09,868][52614] Signal inference workers to stop experience collection... (13850 times) [2024-08-06 07:21:09,877][52614] Signal inference workers to resume experience collection... (13850 times) [2024-08-06 07:21:09,952][52650] InferenceWorker_p0-w0: stopping experience collection (13850 times) [2024-08-06 07:21:09,952][52650] InferenceWorker_p0-w0: resuming experience collection (13850 times) [2024-08-06 07:21:11,216][52659] DAMAGECOUNT value on done: 851034.0 [2024-08-06 07:21:11,217][52659] Sum rewards: 78.462, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.212', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '64.000'} [2024-08-06 07:21:11,392][52660] DAMAGECOUNT value on done: 843951.0 [2024-08-06 07:21:11,394][52660] Sum rewards: 63.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.023', 'AMMO2': '0.068', 'AMMO3': '0.224', 'weapon4': '0.244', 'AMMO4': '0.339', 'weapon5': '0.402', 'weapon2': '0.424', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.598', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '53.000'} [2024-08-06 07:21:11,608][52667] DAMAGECOUNT value on done: 856884.0 [2024-08-06 07:21:11,609][52667] Sum rewards: 70.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.146', 'AMMO3': '0.221', 'AMMO4': '0.232', 'weapon5': '0.238', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '58.500'} [2024-08-06 07:21:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 621174784. Throughput: 0: 4380.0. Samples: 155302460. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:21:12,794][52567] Avg episode reward: [(0, '74.618')] [2024-08-06 07:21:13,583][52659] DAMAGECOUNT value on done: 859314.0 [2024-08-06 07:21:13,584][52659] Sum rewards: 85.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.688', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.116', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '70.000'} [2024-08-06 07:21:14,314][52660] DAMAGECOUNT value on done: 855818.0 [2024-08-06 07:21:14,314][52660] Sum rewards: 68.211, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.626', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.171', 'weapon4': '0.246', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '57.000'} [2024-08-06 07:21:14,390][52650] Updated weights for policy 0, policy_version 75831 (0.0019) [2024-08-06 07:21:14,748][52667] DAMAGECOUNT value on done: 855909.0 [2024-08-06 07:21:14,748][52667] Sum rewards: 80.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.141', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.074', 'weapon5': '0.086', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '69.000'} [2024-08-06 07:21:15,554][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:21:16,517][52659] DAMAGECOUNT value on done: 843741.0 [2024-08-06 07:21:16,520][52659] Sum rewards: 71.176, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.062', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.147', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '59.000'} [2024-08-06 07:21:16,776][52660] DAMAGECOUNT value on done: 867478.0 [2024-08-06 07:21:16,777][52660] Sum rewards: 79.399, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.950', 'AMMO2': '0.001', 'AMMO4': '0.005', 'AMMO3': '0.259', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.460', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '68.000'} [2024-08-06 07:21:17,318][52667] DAMAGECOUNT value on done: 860503.0 [2024-08-06 07:21:17,319][52667] Sum rewards: 71.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.270', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.040', 'AMMO4': '0.167', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '58.000'} [2024-08-06 07:21:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 621264896. Throughput: 0: 4380.0. Samples: 155315300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:21:17,794][52567] Avg episode reward: [(0, '75.053')] [2024-08-06 07:21:19,107][52650] Updated weights for policy 0, policy_version 75841 (0.0012) [2024-08-06 07:21:19,440][52659] DAMAGECOUNT value on done: 855540.0 [2024-08-06 07:21:19,442][52659] Sum rewards: 79.646, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.845', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.088', 'weapon2': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.386', 'WEAPON3': '1.650', 'weapon3': '3.070', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '67.000'} [2024-08-06 07:21:19,587][52660] DAMAGECOUNT value on done: 844369.0 [2024-08-06 07:21:19,588][52660] Sum rewards: 78.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.122', 'weapon4': '0.160', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '63.000'} [2024-08-06 07:21:22,148][52659] DAMAGECOUNT value on done: 848913.0 [2024-08-06 07:21:22,150][52659] Sum rewards: 72.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.682', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.158', 'AMMO3': '0.175', 'weapon4': '0.214', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '60.000'} [2024-08-06 07:21:22,364][52669] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:21:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 621346816. Throughput: 0: 4382.7. Samples: 155341740. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:21:22,794][52567] Avg episode reward: [(0, '75.080')] [2024-08-06 07:21:23,037][52660] DAMAGECOUNT value on done: 851732.0 [2024-08-06 07:21:23,039][52660] Sum rewards: 70.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.567', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.082', 'AMMO3': '0.214', 'weapon5': '0.234', 'AMMO4': '0.278', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '58.000'} [2024-08-06 07:21:23,814][52650] Updated weights for policy 0, policy_version 75851 (0.0023) [2024-08-06 07:21:25,532][52659] DAMAGECOUNT value on done: 849041.0 [2024-08-06 07:21:25,533][52659] Sum rewards: 60.353, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.074', 'AMMO4': '0.170', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.264', 'DAMAGECOUNT': '14.721', 'FRAGCOUNT': '55.000'} [2024-08-06 07:21:25,732][52660] DAMAGECOUNT value on done: 847860.0 [2024-08-06 07:21:25,732][52660] Sum rewards: 77.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.143', 'weapon5': '0.144', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '67.000'} [2024-08-06 07:21:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 621436928. Throughput: 0: 4370.3. Samples: 155367460. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:21:27,794][52567] Avg episode reward: [(0, '75.079')] [2024-08-06 07:21:28,442][52660] DAMAGECOUNT value on done: 840243.0 [2024-08-06 07:21:28,444][52660] Sum rewards: 76.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.101', 'AMMO5': '0.006', 'weapon4': '0.028', 'weapon5': '0.032', 'AMMO2': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'AMMO4': '0.213', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '62.000'} [2024-08-06 07:21:28,456][52659] DAMAGECOUNT value on done: 853245.0 [2024-08-06 07:21:28,458][52659] Sum rewards: 77.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.633', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.130', 'AMMO3': '0.228', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.380', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '64.000'} [2024-08-06 07:21:28,997][52650] Updated weights for policy 0, policy_version 75861 (0.0010) [2024-08-06 07:21:30,318][52658] DAMAGECOUNT value on done: 851942.0 [2024-08-06 07:21:30,318][52658] Sum rewards: 68.909, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.049', 'weapon5': '0.052', 'weapon4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'AMMO4': '0.246', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.228', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '59.000'} [2024-08-06 07:21:31,062][52659] DAMAGECOUNT value on done: 852201.0 [2024-08-06 07:21:31,063][52659] Sum rewards: 72.586, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.128', 'AMMO4': '0.201', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '60.000'} [2024-08-06 07:21:31,527][52660] DAMAGECOUNT value on done: 838678.0 [2024-08-06 07:21:31,528][52660] Sum rewards: 73.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.416', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'ARMOR': '0.036', 'AMMO2': '0.049', 'AMMO3': '0.183', 'weapon2': '0.200', 'AMMO4': '0.244', 'weapon4': '0.248', 'weapon5': '0.262', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 07:21:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 621527040. Throughput: 0: 4377.3. Samples: 155380830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:21:32,794][52567] Avg episode reward: [(0, '74.937')] [2024-08-06 07:21:32,926][52650] Updated weights for policy 0, policy_version 75871 (0.0030) [2024-08-06 07:21:32,978][52794] DAMAGECOUNT value on done: 846279.0 [2024-08-06 07:21:32,978][52794] Sum rewards: 67.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.455', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon2': '0.170', 'AMMO3': '0.232', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.488', 'WEAPON3': '1.400', 'weapon3': '2.736', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '55.000'} [2024-08-06 07:21:33,120][52658] DAMAGECOUNT value on done: 855045.0 [2024-08-06 07:21:33,122][52658] Sum rewards: 79.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.248', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.168', 'AMMO4': '0.191', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '66.000'} [2024-08-06 07:21:34,256][52659] DAMAGECOUNT value on done: 861156.0 [2024-08-06 07:21:34,256][52659] Sum rewards: 68.646, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.315', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.156', 'AMMO4': '0.224', 'AMMO3': '0.269', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.188', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '62.000'} [2024-08-06 07:21:35,048][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:21:35,742][52658] DAMAGECOUNT value on done: 857006.0 [2024-08-06 07:21:35,745][52658] Sum rewards: 73.371, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.197', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '62.000'} [2024-08-06 07:21:36,245][52794] DAMAGECOUNT value on done: 854580.0 [2024-08-06 07:21:36,247][52794] Sum rewards: 67.712, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.418', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.360', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '59.000'} [2024-08-06 07:21:37,301][52659] DAMAGECOUNT value on done: 845712.0 [2024-08-06 07:21:37,301][52659] Sum rewards: 79.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.422', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '64.000'} [2024-08-06 07:21:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 621608960. Throughput: 0: 4382.0. Samples: 155406990. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:21:37,802][52567] Avg episode reward: [(0, '74.705')] [2024-08-06 07:21:37,910][52650] Updated weights for policy 0, policy_version 75881 (0.0049) [2024-08-06 07:21:38,793][52658] DAMAGECOUNT value on done: 854143.0 [2024-08-06 07:21:38,793][52658] Sum rewards: 84.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.740', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '69.000'} [2024-08-06 07:21:38,822][52794] DAMAGECOUNT value on done: 859417.0 [2024-08-06 07:21:38,822][52794] Sum rewards: 76.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.858', 'weapon7': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.082', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.172', 'AMMO3': '0.191', 'AMMO4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '64.000'} [2024-08-06 07:21:40,561][52659] DAMAGECOUNT value on done: 857224.0 [2024-08-06 07:21:40,562][52659] Sum rewards: 84.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.435', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.056', 'weapon4': '0.058', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.262', 'WEAPON3': '1.650', 'weapon3': '3.446', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.808', 'FRAGCOUNT': '72.000'} [2024-08-06 07:21:41,359][52794] DAMAGECOUNT value on done: 847725.0 [2024-08-06 07:21:41,360][52794] Sum rewards: 79.874, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.142', 'AMMO3': '0.184', 'weapon4': '0.206', 'AMMO4': '0.246', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '63.000'} [2024-08-06 07:21:41,533][52658] DAMAGECOUNT value on done: 849287.0 [2024-08-06 07:21:41,534][52658] Sum rewards: 84.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.186', 'AMMO5': '0.021', 'AMMO2': '0.056', 'AMMO3': '0.240', 'weapon5': '0.270', 'weapon4': '0.274', 'AMMO4': '0.280', 'weapon2': '0.376', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.726', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '69.000'} [2024-08-06 07:21:42,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 621690880. Throughput: 0: 4375.1. Samples: 155433220. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:21:42,795][52567] Avg episode reward: [(0, '75.204')] [2024-08-06 07:21:42,802][52650] Updated weights for policy 0, policy_version 75891 (0.0013) [2024-08-06 07:21:43,964][52659] DAMAGECOUNT value on done: 849772.0 [2024-08-06 07:21:43,964][52659] Sum rewards: 77.665, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.584', 'WEAPON3': '0.850', 'HEALTH': '1.010', 'weapon3': '3.176', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.500'} [2024-08-06 07:21:44,061][52794] DAMAGECOUNT value on done: 841908.0 [2024-08-06 07:21:44,063][52794] Sum rewards: 71.281, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.575', 'AMMO5': '0.027', 'AMMO2': '0.077', 'weapon4': '0.252', 'weapon2': '0.268', 'AMMO3': '0.277', 'weapon5': '0.350', 'AMMO4': '0.386', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.700', 'weapon3': '2.710', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '64.000'} [2024-08-06 07:21:44,531][52658] DAMAGECOUNT value on done: 843440.0 [2024-08-06 07:21:44,531][52658] Sum rewards: 59.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.526', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.174', 'AMMO4': '0.182', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.150', 'HITCOUNT': '2.910', 'weapon3': '3.074', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '49.000'} [2024-08-06 07:21:44,787][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:21:46,740][52794] DAMAGECOUNT value on done: 850455.0 [2024-08-06 07:21:46,741][52794] Sum rewards: 70.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.120', 'weapon4': '0.174', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 07:21:47,054][52658] DAMAGECOUNT value on done: 856266.0 [2024-08-06 07:21:47,056][52658] Sum rewards: 70.842, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.062', 'weapon5': '0.088', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.288', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.352', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '59.000'} [2024-08-06 07:21:47,172][52650] Updated weights for policy 0, policy_version 75901 (0.0017) [2024-08-06 07:21:47,596][52669] DAMAGECOUNT value on done: 853477.0 [2024-08-06 07:21:47,597][52669] Sum rewards: 64.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.865', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.092', 'AMMO3': '0.225', 'weapon5': '0.226', 'AMMO4': '0.250', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 07:21:47,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 621789184. Throughput: 0: 4374.2. Samples: 155446430. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:21:47,795][52567] Avg episode reward: [(0, '74.723')] [2024-08-06 07:21:49,784][52794] DAMAGECOUNT value on done: 855529.0 [2024-08-06 07:21:49,786][52794] Sum rewards: 70.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.142', 'AMMO3': '0.194', 'weapon4': '0.238', 'weapon2': '0.268', 'AMMO4': '0.276', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '59.000'} [2024-08-06 07:21:49,994][52658] DAMAGECOUNT value on done: 844145.0 [2024-08-06 07:21:49,994][52658] Sum rewards: 84.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.124', 'AMMO4': '0.196', 'AMMO3': '0.233', 'weapon4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.478', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.781', 'FRAGCOUNT': '71.000'} [2024-08-06 07:21:50,253][52669] DAMAGECOUNT value on done: 845921.0 [2024-08-06 07:21:50,255][52669] Sum rewards: 70.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.139', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.112', 'weapon5': '0.126', 'AMMO3': '0.183', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '56.500'} [2024-08-06 07:21:52,037][52650] Updated weights for policy 0, policy_version 75911 (0.0034) [2024-08-06 07:21:52,273][52811] DAMAGECOUNT value on done: 809869.0 [2024-08-06 07:21:52,273][52811] Sum rewards: 66.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.261', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.096', 'AMMO4': '0.144', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.366', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '53.000'} [2024-08-06 07:21:52,390][52663] DAMAGECOUNT value on done: 868559.0 [2024-08-06 07:21:52,390][52663] Sum rewards: 83.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.142', 'AMMO3': '0.215', 'weapon2': '0.276', 'weapon5': '0.286', 'AMMO4': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '68.000'} [2024-08-06 07:21:52,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 621879296. Throughput: 0: 4372.9. Samples: 155472670. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:21:52,794][52567] Avg episode reward: [(0, '74.894')] [2024-08-06 07:21:52,807][52794] DAMAGECOUNT value on done: 842392.0 [2024-08-06 07:21:52,808][52794] Sum rewards: 68.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.887', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.135', 'weapon5': '0.160', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '58.000'} [2024-08-06 07:21:53,109][52669] DAMAGECOUNT value on done: 858428.0 [2024-08-06 07:21:53,110][52669] Sum rewards: 68.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.793', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon4': '0.156', 'weapon5': '0.184', 'weapon2': '0.194', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.262', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '56.000'} [2024-08-06 07:21:53,371][52658] DAMAGECOUNT value on done: 872655.0 [2024-08-06 07:21:53,372][52658] Sum rewards: 79.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.036', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.176', 'AMMO4': '0.210', 'weapon4': '0.228', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.976', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '67.000'} [2024-08-06 07:21:54,842][52649] DAMAGECOUNT value on done: 825432.0 [2024-08-06 07:21:54,842][52649] Sum rewards: 68.623, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.065', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.124', 'weapon5': '0.228', 'AMMO3': '0.250', 'AMMO4': '0.252', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.952', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '60.000'} [2024-08-06 07:21:55,220][52663] DAMAGECOUNT value on done: 853132.0 [2024-08-06 07:21:55,222][52663] Sum rewards: 74.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.626', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.106', 'weapon5': '0.170', 'AMMO3': '0.224', 'AMMO4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '2.902', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '64.000'} [2024-08-06 07:21:55,385][52811] DAMAGECOUNT value on done: 793821.0 [2024-08-06 07:21:55,385][52811] Sum rewards: 71.907, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.506', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon5': '0.058', 'weapon4': '0.084', 'AMMO4': '0.141', 'AMMO3': '0.216', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.348', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '62.000'} [2024-08-06 07:21:55,760][52669] DAMAGECOUNT value on done: 852253.0 [2024-08-06 07:21:55,760][52669] Sum rewards: 74.196, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.516', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.094', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.606', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '60.500'} [2024-08-06 07:21:55,902][52658] DAMAGECOUNT value on done: 854418.0 [2024-08-06 07:21:55,902][52658] Sum rewards: 65.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.114', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '54.500'} [2024-08-06 07:21:56,359][52794] DAMAGECOUNT value on done: 852388.0 [2024-08-06 07:21:56,359][52794] Sum rewards: 65.037, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.358', 'AMMO5': '0.021', 'AMMO2': '0.064', 'weapon4': '0.140', 'weapon5': '0.220', 'AMMO3': '0.269', 'weapon2': '0.280', 'AMMO4': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.074', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '55.000'} [2024-08-06 07:21:57,041][52650] Updated weights for policy 0, policy_version 75921 (0.0036) [2024-08-06 07:21:57,246][52649] DAMAGECOUNT value on done: 820504.0 [2024-08-06 07:21:57,246][52649] Sum rewards: 76.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.135', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.094', 'AMMO4': '0.167', 'weapon5': '0.176', 'AMMO3': '0.179', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '61.000'} [2024-08-06 07:21:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 621961216. Throughput: 0: 4355.3. Samples: 155498450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:21:57,802][52567] Avg episode reward: [(0, '74.515')] [2024-08-06 07:21:58,082][52663] DAMAGECOUNT value on done: 846032.0 [2024-08-06 07:21:58,082][52663] Sum rewards: 56.039, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.069', 'weapon5': '0.128', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon2': '1.290', 'weapon3': '2.384', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '13.017', 'FRAGCOUNT': '45.000'} [2024-08-06 07:21:58,391][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:21:58,532][52811] DAMAGECOUNT value on done: 787669.0 [2024-08-06 07:21:58,533][52811] Sum rewards: 73.851, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.392', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.172', 'AMMO4': '0.214', 'AMMO3': '0.217', 'weapon4': '0.224', 'weapon2': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '61.000'} [2024-08-06 07:21:58,595][52669] DAMAGECOUNT value on done: 859513.0 [2024-08-06 07:21:58,596][52669] Sum rewards: 81.838, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.445', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon2': '0.146', 'AMMO3': '0.174', 'weapon5': '0.190', 'AMMO4': '0.215', 'weapon4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '65.000'} [2024-08-06 07:21:59,034][52658] DAMAGECOUNT value on done: 864260.0 [2024-08-06 07:21:59,036][52658] Sum rewards: 60.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.435', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.152', 'AMMO3': '0.203', 'weapon5': '0.240', 'AMMO4': '0.268', 'weapon2': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.038', 'DAMAGECOUNT': '15.066', 'FRAGCOUNT': '50.500'} [2024-08-06 07:21:59,383][52794] DAMAGECOUNT value on done: 847903.0 [2024-08-06 07:21:59,385][52794] Sum rewards: 75.493, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.071', 'weapon5': '0.072', 'WEAPON5': '0.100', 'HEALTH': '0.157', 'weapon4': '0.168', 'AMMO3': '0.192', 'weapon2': '0.626', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '62.000'} [2024-08-06 07:21:59,807][52649] DAMAGECOUNT value on done: 836760.0 [2024-08-06 07:21:59,807][52649] Sum rewards: 69.303, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO4': '0.185', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:00,655][52663] DAMAGECOUNT value on done: 850367.0 [2024-08-06 07:22:00,656][52663] Sum rewards: 77.710, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.104', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.134', 'AMMO3': '0.163', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:00,682][52671] DAMAGECOUNT value on done: 858122.0 [2024-08-06 07:22:00,682][52671] Sum rewards: 60.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.060', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.274', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '51.000'} [2024-08-06 07:22:01,211][52650] Updated weights for policy 0, policy_version 75931 (0.0012) [2024-08-06 07:22:01,246][52669] DAMAGECOUNT value on done: 855421.0 [2024-08-06 07:22:01,247][52669] Sum rewards: 72.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.475', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO4': '0.189', 'AMMO3': '0.194', 'weapon2': '0.214', 'weapon4': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 07:22:01,670][52811] DAMAGECOUNT value on done: 791249.0 [2024-08-06 07:22:01,671][52811] Sum rewards: 72.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon4': '0.100', 'weapon5': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:01,808][52658] DAMAGECOUNT value on done: 853072.0 [2024-08-06 07:22:01,809][52658] Sum rewards: 74.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.109', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.032', 'AMMO4': '0.115', 'weapon5': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.158', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:02,429][52794] DAMAGECOUNT value on done: 841181.0 [2024-08-06 07:22:02,431][52794] Sum rewards: 64.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.882', 'AMMO5': '0.022', 'AMMO2': '0.053', 'weapon4': '0.064', 'weapon5': '0.144', 'AMMO3': '0.192', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '53.000'} [2024-08-06 07:22:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 622043136. Throughput: 0: 4358.2. Samples: 155511420. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:22:02,794][52567] Avg episode reward: [(0, '74.238')] [2024-08-06 07:22:02,839][52649] DAMAGECOUNT value on done: 831667.0 [2024-08-06 07:22:02,841][52649] Sum rewards: 76.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.249', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.101', 'WEAPON5': '0.150', 'weapon4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:03,278][52663] DAMAGECOUNT value on done: 853397.0 [2024-08-06 07:22:03,279][52663] Sum rewards: 76.273, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.666', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.190', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.552', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:03,751][52669] DAMAGECOUNT value on done: 855531.0 [2024-08-06 07:22:03,752][52669] Sum rewards: 63.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.924', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.216', 'weapon4': '0.342', 'weapon5': '0.346', 'AMMO4': '0.353', 'weapon2': '0.424', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.584', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '54.000'} [2024-08-06 07:22:03,794][52671] DAMAGECOUNT value on done: 863470.0 [2024-08-06 07:22:03,795][52671] Sum rewards: 73.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.050', 'AMMO4': '0.104', 'weapon4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:04,545][52658] DAMAGECOUNT value on done: 862043.0 [2024-08-06 07:22:04,546][52658] Sum rewards: 73.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.396', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.201', 'AMMO3': '0.210', 'weapon2': '0.286', 'weapon5': '0.310', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.756', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '59.000'} [2024-08-06 07:22:04,858][52811] DAMAGECOUNT value on done: 794879.0 [2024-08-06 07:22:04,860][52811] Sum rewards: 77.709, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.964', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'weapon5': '0.086', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon2': '0.908', 'WEAPON3': '0.950', 'weapon3': '2.884', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:05,157][52794] DAMAGECOUNT value on done: 853881.0 [2024-08-06 07:22:05,159][52794] Sum rewards: 65.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.118', 'weapon5': '0.136', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '55.000'} [2024-08-06 07:22:05,955][52649] DAMAGECOUNT value on done: 824873.0 [2024-08-06 07:22:05,955][52649] Sum rewards: 91.620, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.485', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.052', 'AMMO4': '0.109', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.290', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.754', 'FRAGCOUNT': '74.000'} [2024-08-06 07:22:06,214][52650] Updated weights for policy 0, policy_version 75941 (0.0018) [2024-08-06 07:22:06,390][52663] DAMAGECOUNT value on done: 858684.0 [2024-08-06 07:22:06,401][52663] Sum rewards: 74.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.138', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:06,835][52669] DAMAGECOUNT value on done: 855415.0 [2024-08-06 07:22:06,835][52669] Sum rewards: 77.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.855', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.116', 'AMMO4': '0.132', 'weapon5': '0.270', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.800', 'weapon3': '2.852', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '67.500'} [2024-08-06 07:22:06,944][52671] DAMAGECOUNT value on done: 859511.0 [2024-08-06 07:22:06,948][52671] Sum rewards: 73.910, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.568', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.167', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.610', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:07,375][52658] DAMAGECOUNT value on done: 851221.0 [2024-08-06 07:22:07,375][52658] Sum rewards: 72.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.132', 'weapon2': '0.190', 'AMMO4': '0.201', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 622141440. Throughput: 0: 4355.1. Samples: 155537720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:22:07,802][52567] Avg episode reward: [(0, '74.058')] [2024-08-06 07:22:07,980][52811] DAMAGECOUNT value on done: 807653.0 [2024-08-06 07:22:07,980][52811] Sum rewards: 79.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.599', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.199', 'weapon5': '0.200', 'AMMO4': '0.218', 'weapon4': '0.230', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:08,025][52794] DAMAGECOUNT value on done: 849083.0 [2024-08-06 07:22:08,028][52794] Sum rewards: 73.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.194', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.092', 'AMMO4': '0.141', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:08,729][52660] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2024-08-06 07:22:09,014][52649] DAMAGECOUNT value on done: 835648.0 [2024-08-06 07:22:09,015][52649] Sum rewards: 85.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.892', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.102', 'AMMO4': '0.127', 'weapon4': '0.128', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '70.500'} [2024-08-06 07:22:09,058][52663] DAMAGECOUNT value on done: 847833.0 [2024-08-06 07:22:09,060][52663] Sum rewards: 74.253, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.264', 'weapon2': '0.426', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:09,448][52669] DAMAGECOUNT value on done: 865203.0 [2024-08-06 07:22:09,449][52669] Sum rewards: 77.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.830', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.118', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:09,684][52665] DAMAGECOUNT value on done: 840300.0 [2024-08-06 07:22:09,686][52665] Sum rewards: 73.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.101', 'weapon5': '0.128', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'HITCOUNT': '3.430', 'weapon3': '3.476', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:10,259][52671] DAMAGECOUNT value on done: 859951.0 [2024-08-06 07:22:10,261][52671] Sum rewards: 78.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.746', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.123', 'weapon4': '0.154', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:10,293][52658] DAMAGECOUNT value on done: 857568.0 [2024-08-06 07:22:10,294][52658] Sum rewards: 84.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.272', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '70.000'} [2024-08-06 07:22:10,438][52650] Updated weights for policy 0, policy_version 75951 (0.0013) [2024-08-06 07:22:10,592][52794] DAMAGECOUNT value on done: 864203.0 [2024-08-06 07:22:10,593][52794] Sum rewards: 62.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.973', 'AMMO5': '0.022', 'AMMO2': '0.076', 'weapon4': '0.106', 'AMMO3': '0.211', 'weapon5': '0.234', 'AMMO4': '0.381', 'weapon2': '0.490', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '52.500'} [2024-08-06 07:22:10,968][52811] DAMAGECOUNT value on done: 801137.0 [2024-08-06 07:22:10,968][52811] Sum rewards: 82.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO4': '0.184', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '68.000'} [2024-08-06 07:22:11,819][52663] DAMAGECOUNT value on done: 840673.0 [2024-08-06 07:22:11,821][52663] Sum rewards: 82.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.617', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.170', 'AMMO3': '0.206', 'AMMO4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:12,163][52649] DAMAGECOUNT value on done: 831122.0 [2024-08-06 07:22:12,164][52649] Sum rewards: 77.201, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.648', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.038', 'AMMO4': '0.127', 'weapon5': '0.128', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:12,262][52669] DAMAGECOUNT value on done: 854190.0 [2024-08-06 07:22:12,262][52669] Sum rewards: 68.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.285', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.147', 'weapon5': '0.218', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'weapon2': '0.504', 'WEAPON3': '0.900', 'weapon3': '2.740', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '55.000'} [2024-08-06 07:22:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 622223360. Throughput: 0: 4361.6. Samples: 155563730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:22:12,794][52567] Avg episode reward: [(0, '74.218')] [2024-08-06 07:22:12,839][52665] DAMAGECOUNT value on done: 855774.0 [2024-08-06 07:22:12,840][52665] Sum rewards: 73.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.120', 'AMMO4': '0.147', 'AMMO3': '0.190', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.418', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:13,305][52658] DAMAGECOUNT value on done: 841386.0 [2024-08-06 07:22:13,306][52658] Sum rewards: 81.431, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.064', 'AMMO4': '0.228', 'AMMO3': '0.243', 'weapon5': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '67.000'} [2024-08-06 07:22:13,351][52671] DAMAGECOUNT value on done: 865901.0 [2024-08-06 07:22:13,352][52671] Sum rewards: 73.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.490', 'AMMO5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.034', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:13,590][52794] DAMAGECOUNT value on done: 845991.0 [2024-08-06 07:22:13,591][52794] Sum rewards: 75.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.142', 'AMMO3': '0.198', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:14,092][52811] DAMAGECOUNT value on done: 791618.0 [2024-08-06 07:22:14,093][52811] Sum rewards: 69.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.074', 'AMMO4': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.488', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:14,948][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:22:14,964][52663] DAMAGECOUNT value on done: 847172.0 [2024-08-06 07:22:14,965][52663] Sum rewards: 84.435, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.060', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.084', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '70.000'} [2024-08-06 07:22:14,988][52649] DAMAGECOUNT value on done: 835122.0 [2024-08-06 07:22:14,988][52649] Sum rewards: 76.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon2': '0.122', 'weapon5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:15,441][52650] Updated weights for policy 0, policy_version 75961 (0.0033) [2024-08-06 07:22:15,469][52669] DAMAGECOUNT value on done: 862839.0 [2024-08-06 07:22:15,472][52669] Sum rewards: 73.174, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.482', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.068', 'AMMO4': '0.098', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.249', 'weapon2': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.298', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:15,749][52665] DAMAGECOUNT value on done: 845177.0 [2024-08-06 07:22:15,750][52665] Sum rewards: 81.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.178', 'weapon4': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:16,089][52658] DAMAGECOUNT value on done: 859372.0 [2024-08-06 07:22:16,089][52658] Sum rewards: 78.203, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.623', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.140', 'AMMO4': '0.178', 'weapon5': '0.182', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.576', 'WEAPON3': '0.850', 'weapon3': '2.726', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:16,419][52794] DAMAGECOUNT value on done: 860622.0 [2024-08-06 07:22:16,420][52794] Sum rewards: 77.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.560', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.040', 'weapon5': '0.120', 'AMMO4': '0.153', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:16,439][52671] DAMAGECOUNT value on done: 854499.0 [2024-08-06 07:22:16,442][52671] Sum rewards: 76.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.122', 'AMMO4': '0.151', 'weapon5': '0.172', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '2.964', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:17,141][52811] DAMAGECOUNT value on done: 800831.0 [2024-08-06 07:22:17,142][52811] Sum rewards: 85.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.005', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.088', 'weapon4': '0.156', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.302', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '67.000'} [2024-08-06 07:22:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 622305280. Throughput: 0: 4354.7. Samples: 155576790. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:17,802][52567] Avg episode reward: [(0, '74.297')] [2024-08-06 07:22:18,060][52663] DAMAGECOUNT value on done: 852280.0 [2024-08-06 07:22:18,060][52663] Sum rewards: 84.754, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.062', 'weapon4': '0.120', 'AMMO4': '0.164', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '71.000'} [2024-08-06 07:22:18,250][52649] DAMAGECOUNT value on done: 833347.0 [2024-08-06 07:22:18,251][52649] Sum rewards: 81.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.335', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.122', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON3': '1.550', 'weapon3': '3.572', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '68.000'} [2024-08-06 07:22:18,564][52669] DAMAGECOUNT value on done: 863363.0 [2024-08-06 07:22:18,566][52669] Sum rewards: 69.221, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.482', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon4': '0.162', 'weapon5': '0.222', 'AMMO3': '0.274', 'AMMO4': '0.327', 'weapon2': '0.418', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.818', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:18,896][52658] DAMAGECOUNT value on done: 849337.0 [2024-08-06 07:22:18,896][52658] Sum rewards: 56.683, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.080', 'weapon5': '0.124', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'weapon2': '0.766', 'WEAPON3': '1.150', 'weapon3': '2.840', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.580', 'FRAGCOUNT': '47.000'} [2024-08-06 07:22:18,934][52665] DAMAGECOUNT value on done: 847516.0 [2024-08-06 07:22:18,936][52665] Sum rewards: 78.367, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.172', 'AMMO3': '0.198', 'AMMO4': '0.230', 'weapon4': '0.250', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:19,464][52671] DAMAGECOUNT value on done: 859108.0 [2024-08-06 07:22:19,466][52671] Sum rewards: 61.780, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.455', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon2': '0.200', 'AMMO3': '0.210', 'weapon5': '0.216', 'weapon4': '0.218', 'AMMO4': '0.244', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.810', 'weapon3': '3.122', 'DAMAGECOUNT': '15.249', 'FRAGCOUNT': '50.000'} [2024-08-06 07:22:19,625][52794] DAMAGECOUNT value on done: 855231.0 [2024-08-06 07:22:19,627][52794] Sum rewards: 63.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.110', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.092', 'weapon5': '0.178', 'AMMO4': '0.183', 'AMMO3': '0.241', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '54.000'} [2024-08-06 07:22:20,251][52811] DAMAGECOUNT value on done: 798687.0 [2024-08-06 07:22:20,251][52811] Sum rewards: 72.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.880', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.028', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.262', 'AMMO3': '0.274', 'WEAPON3': '1.800', 'weapon3': '3.474', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:20,379][52650] Updated weights for policy 0, policy_version 75971 (0.0031) [2024-08-06 07:22:20,816][52663] DAMAGECOUNT value on done: 860648.0 [2024-08-06 07:22:20,816][52663] Sum rewards: 73.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.086', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.174', 'AMMO3': '0.208', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '59.000'} [2024-08-06 07:22:21,021][52649] DAMAGECOUNT value on done: 827237.0 [2024-08-06 07:22:21,022][52649] Sum rewards: 72.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.168', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.100', 'weapon5': '0.174', 'AMMO3': '0.250', 'AMMO4': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.850', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:21,482][52669] DAMAGECOUNT value on done: 849619.0 [2024-08-06 07:22:21,482][52669] Sum rewards: 71.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon4': '0.184', 'AMMO3': '0.206', 'weapon5': '0.264', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '58.000'} [2024-08-06 07:22:21,767][52665] DAMAGECOUNT value on done: 830650.0 [2024-08-06 07:22:21,767][52665] Sum rewards: 84.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.345', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon4': '0.046', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.384', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '68.000'} [2024-08-06 07:22:21,799][52658] DAMAGECOUNT value on done: 847008.0 [2024-08-06 07:22:21,800][52658] Sum rewards: 66.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.203', 'weapon5': '0.212', 'AMMO3': '0.241', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:22,435][52671] DAMAGECOUNT value on done: 859882.0 [2024-08-06 07:22:22,436][52671] Sum rewards: 72.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.151', 'weapon5': '0.184', 'AMMO4': '0.207', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '0.950', 'weapon3': '2.872', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 622395392. Throughput: 0: 4364.0. Samples: 155603370. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:22,795][52567] Avg episode reward: [(0, '73.939')] [2024-08-06 07:22:22,797][52794] DAMAGECOUNT value on done: 855956.0 [2024-08-06 07:22:22,802][52794] Sum rewards: 69.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.395', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:23,322][52811] DAMAGECOUNT value on done: 801831.0 [2024-08-06 07:22:23,322][52811] Sum rewards: 71.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.225', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.150', 'AMMO4': '0.193', 'AMMO3': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.330', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '59.000'} [2024-08-06 07:22:23,689][52649] DAMAGECOUNT value on done: 838089.0 [2024-08-06 07:22:23,689][52649] Sum rewards: 74.104, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.578', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.134', 'AMMO3': '0.189', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '58.000'} [2024-08-06 07:22:24,044][52663] DAMAGECOUNT value on done: 841717.0 [2024-08-06 07:22:24,049][52663] Sum rewards: 71.779, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-0.845', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.108', 'weapon5': '0.132', 'AMMO4': '0.174', 'weapon4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.700', 'weapon2': '0.948', 'weapon3': '2.552', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '54.000'} [2024-08-06 07:22:24,322][52665] DAMAGECOUNT value on done: 835762.0 [2024-08-06 07:22:24,323][52665] Sum rewards: 74.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.274', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.070', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.580', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:24,505][52669] DAMAGECOUNT value on done: 850101.0 [2024-08-06 07:22:24,508][52669] Sum rewards: 73.886, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.830', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.108', 'AMMO4': '0.138', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:24,771][52650] Updated weights for policy 0, policy_version 75981 (0.0022) [2024-08-06 07:22:24,773][52658] DAMAGECOUNT value on done: 856710.0 [2024-08-06 07:22:24,773][52658] Sum rewards: 81.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.185', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.171', 'AMMO3': '0.232', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.322', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '68.000'} [2024-08-06 07:22:25,276][52670] DAMAGECOUNT value on done: 839662.0 [2024-08-06 07:22:25,280][52670] Sum rewards: 68.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.104', 'AMMO4': '0.130', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.158', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '56.000'} [2024-08-06 07:22:25,309][52671] DAMAGECOUNT value on done: 845041.0 [2024-08-06 07:22:25,310][52671] Sum rewards: 68.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.089', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.207', 'weapon5': '0.220', 'AMMO4': '0.261', 'weapon4': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.642', 'WEAPON3': '1.250', 'weapon3': '2.614', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:25,637][52794] DAMAGECOUNT value on done: 863366.0 [2024-08-06 07:22:25,638][52794] Sum rewards: 76.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.592', 'WEAPON3': '1.200', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:26,185][52649] DAMAGECOUNT value on done: 844873.0 [2024-08-06 07:22:26,186][52649] Sum rewards: 66.200, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.198', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO3': '0.163', 'AMMO4': '0.165', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.572', 'WEAPON3': '0.950', 'weapon3': '2.956', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '53.000'} [2024-08-06 07:22:26,316][52811] DAMAGECOUNT value on done: 807779.0 [2024-08-06 07:22:26,316][52811] Sum rewards: 83.580, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.040', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.203', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '69.000'} [2024-08-06 07:22:26,854][52665] DAMAGECOUNT value on done: 840237.0 [2024-08-06 07:22:26,856][52665] Sum rewards: 76.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.978', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.118', 'weapon4': '0.160', 'AMMO4': '0.201', 'AMMO3': '0.263', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.196', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '67.000'} [2024-08-06 07:22:27,128][52663] DAMAGECOUNT value on done: 837102.0 [2024-08-06 07:22:27,130][52663] Sum rewards: 67.944, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.170', 'AMMO4': '0.187', 'AMMO3': '0.202', 'weapon5': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '2.968', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '54.000'} [2024-08-06 07:22:27,172][52811] Large shaping reward 2.536 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.096, -32.0), ('weapon5', 0.002)] [2024-08-06 07:22:27,536][52669] DAMAGECOUNT value on done: 855396.0 [2024-08-06 07:22:27,538][52669] Sum rewards: 73.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.606', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.252', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 622485504. Throughput: 0: 4360.0. Samples: 155629420. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:27,795][52567] Avg episode reward: [(0, '73.543')] [2024-08-06 07:22:27,807][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075988_622493696.pth... [2024-08-06 07:22:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075476_618299392.pth [2024-08-06 07:22:28,255][52794] DAMAGECOUNT value on done: 856595.0 [2024-08-06 07:22:28,256][52794] Sum rewards: 81.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.090', 'AMMO3': '0.158', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.000', 'weapon3': '3.204', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:28,362][52671] DAMAGECOUNT value on done: 861323.0 [2024-08-06 07:22:28,363][52671] Sum rewards: 79.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.125', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:28,553][52670] DAMAGECOUNT value on done: 854694.0 [2024-08-06 07:22:28,554][52670] Sum rewards: 78.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.443', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.159', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:29,207][52649] DAMAGECOUNT value on done: 835670.0 [2024-08-06 07:22:29,207][52649] Sum rewards: 62.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.521', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.414', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.288', 'DAMAGECOUNT': '14.394', 'FRAGCOUNT': '52.000'} [2024-08-06 07:22:29,464][52811] DAMAGECOUNT value on done: 798096.0 [2024-08-06 07:22:29,464][52811] Sum rewards: 78.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.585', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:29,704][52650] Updated weights for policy 0, policy_version 75991 (0.0027) [2024-08-06 07:22:29,808][52665] DAMAGECOUNT value on done: 840649.0 [2024-08-06 07:22:29,809][52665] Sum rewards: 73.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.796', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.159', 'AMMO3': '0.188', 'weapon5': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:30,254][52663] DAMAGECOUNT value on done: 846793.0 [2024-08-06 07:22:30,254][52663] Sum rewards: 85.532, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.318', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.182', 'weapon2': '0.184', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.480', 'WEAPON3': '1.300', 'weapon3': '2.846', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.051', 'FRAGCOUNT': '69.000'} [2024-08-06 07:22:30,582][52669] DAMAGECOUNT value on done: 878703.0 [2024-08-06 07:22:30,583][52669] Sum rewards: 86.588, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.785', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon4': '0.056', 'weapon5': '0.186', 'AMMO3': '0.192', 'AMMO4': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.212', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '70.000'} [2024-08-06 07:22:30,670][52659] Large shaping reward -2.513 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.264, -88.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:22:31,196][52670] DAMAGECOUNT value on done: 840358.0 [2024-08-06 07:22:31,196][52670] Sum rewards: 69.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.613', 'AMMO5': '0.008', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.054', 'weapon5': '0.090', 'AMMO4': '0.095', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 07:22:31,464][52666] DAMAGECOUNT value on done: 853942.0 [2024-08-06 07:22:31,465][52666] Sum rewards: 66.975, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.197', 'AMMO5': '0.023', 'AMMO2': '0.059', 'weapon4': '0.084', 'AMMO3': '0.232', 'weapon5': '0.248', 'AMMO4': '0.294', 'WEAPON4': '0.550', 'weapon2': '0.558', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:31,666][52671] DAMAGECOUNT value on done: 858026.0 [2024-08-06 07:22:31,666][52671] Sum rewards: 76.835, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.053', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.176', 'AMMO3': '0.185', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:32,266][52649] DAMAGECOUNT value on done: 837988.0 [2024-08-06 07:22:32,268][52649] Sum rewards: 64.572, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.647', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.166', 'AMMO3': '0.235', 'weapon5': '0.254', 'AMMO4': '0.319', 'weapon2': '0.426', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.752', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '56.000'} [2024-08-06 07:22:32,549][52811] DAMAGECOUNT value on done: 796965.0 [2024-08-06 07:22:32,554][52811] Sum rewards: 77.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.776', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.155', 'weapon5': '0.200', 'AMMO4': '0.209', 'weapon4': '0.268', 'weapon2': '0.392', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 622567424. Throughput: 0: 4350.5. Samples: 155642200. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:32,795][52567] Avg episode reward: [(0, '74.091')] [2024-08-06 07:22:32,959][52665] DAMAGECOUNT value on done: 848466.0 [2024-08-06 07:22:32,960][52665] Sum rewards: 57.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.951', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.092', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.118', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '48.000'} [2024-08-06 07:22:32,982][52614] Signal inference workers to stop experience collection... (13900 times) [2024-08-06 07:22:32,982][52614] Signal inference workers to resume experience collection... (13900 times) [2024-08-06 07:22:33,043][52650] InferenceWorker_p0-w0: stopping experience collection (13900 times) [2024-08-06 07:22:33,043][52650] InferenceWorker_p0-w0: resuming experience collection (13900 times) [2024-08-06 07:22:33,193][52663] DAMAGECOUNT value on done: 847695.0 [2024-08-06 07:22:33,194][52663] Sum rewards: 75.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.138', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.167', 'weapon2': '0.198', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:33,544][52669] DAMAGECOUNT value on done: 866472.0 [2024-08-06 07:22:33,545][52669] Sum rewards: 74.925, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.710', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon4': '0.042', 'AMMO3': '0.110', 'AMMO4': '0.133', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.722', 'WEAPON3': '0.750', 'weapon3': '2.834', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:34,111][52650] Updated weights for policy 0, policy_version 76001 (0.0015) [2024-08-06 07:22:34,277][52670] DAMAGECOUNT value on done: 840267.0 [2024-08-06 07:22:34,280][52670] Sum rewards: 66.482, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.034', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.216', 'weapon2': '0.226', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.458', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:34,516][52666] DAMAGECOUNT value on done: 846933.0 [2024-08-06 07:22:34,517][52666] Sum rewards: 78.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon4': '0.194', 'AMMO3': '0.202', 'weapon2': '0.226', 'weapon5': '0.278', 'AMMO4': '0.285', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:34,975][52671] DAMAGECOUNT value on done: 853808.0 [2024-08-06 07:22:34,975][52671] Sum rewards: 66.496, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.185', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.137', 'AMMO4': '0.154', 'weapon5': '0.180', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.474', 'WEAPON3': '0.850', 'weapon3': '2.892', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '52.000'} [2024-08-06 07:22:35,394][52649] DAMAGECOUNT value on done: 826439.0 [2024-08-06 07:22:35,395][52649] Sum rewards: 76.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.788', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.210', 'weapon5': '0.220', 'AMMO3': '0.229', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:35,720][52811] DAMAGECOUNT value on done: 795344.0 [2024-08-06 07:22:35,724][52811] Sum rewards: 73.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.169', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.134', 'AMMO3': '0.194', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.730', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:36,246][52665] DAMAGECOUNT value on done: 841319.0 [2024-08-06 07:22:36,248][52665] Sum rewards: 71.538, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.322', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.040', 'AMMO4': '0.111', 'weapon5': '0.126', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:36,349][52663] DAMAGECOUNT value on done: 853870.0 [2024-08-06 07:22:36,350][52663] Sum rewards: 64.534, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.582', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.070', 'AMMO4': '0.213', 'weapon5': '0.214', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '55.000'} [2024-08-06 07:22:36,649][52669] DAMAGECOUNT value on done: 859578.0 [2024-08-06 07:22:36,650][52669] Sum rewards: 72.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.023', 'AMMO2': '0.049', 'weapon4': '0.082', 'weapon2': '0.232', 'AMMO3': '0.235', 'AMMO4': '0.247', 'weapon5': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '61.500'} [2024-08-06 07:22:37,582][52670] DAMAGECOUNT value on done: 853797.0 [2024-08-06 07:22:37,584][52670] Sum rewards: 82.838, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.290', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.088', 'weapon5': '0.162', 'AMMO3': '0.236', 'AMMO4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.500', 'weapon3': '3.150', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '69.000'} [2024-08-06 07:22:37,753][52666] DAMAGECOUNT value on done: 853729.0 [2024-08-06 07:22:37,753][52666] Sum rewards: 85.646, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.134', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.155', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '71.000'} [2024-08-06 07:22:37,795][52567] Fps is (10 sec: 16382.0, 60 sec: 17339.3, 300 sec: 17411.4). Total num frames: 622649344. Throughput: 0: 4353.0. Samples: 155668560. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:37,796][52567] Avg episode reward: [(0, '74.302')] [2024-08-06 07:22:37,898][52671] DAMAGECOUNT value on done: 861320.0 [2024-08-06 07:22:37,900][52671] Sum rewards: 65.590, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'HEALTH': '0.022', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.148', 'AMMO4': '0.180', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.348', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '53.000'} [2024-08-06 07:22:38,689][52649] DAMAGECOUNT value on done: 836016.0 [2024-08-06 07:22:38,689][52649] Sum rewards: 75.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.080', 'weapon5': '0.168', 'AMMO3': '0.202', 'AMMO4': '0.222', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:38,767][52811] DAMAGECOUNT value on done: 798541.0 [2024-08-06 07:22:38,768][52811] Sum rewards: 73.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.036', 'weapon5': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.203', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.350', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:38,899][52663] DAMAGECOUNT value on done: 851901.0 [2024-08-06 07:22:38,899][52663] Sum rewards: 78.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.836', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.131', 'weapon5': '0.132', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:39,024][52650] Updated weights for policy 0, policy_version 76011 (0.0024) [2024-08-06 07:22:39,291][52669] DAMAGECOUNT value on done: 863550.0 [2024-08-06 07:22:39,292][52669] Sum rewards: 74.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.376', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.176', 'AMMO4': '0.176', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:39,301][52665] DAMAGECOUNT value on done: 854984.0 [2024-08-06 07:22:39,302][52665] Sum rewards: 77.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.895', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.142', 'weapon5': '0.142', 'AMMO4': '0.160', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.118', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '66.000'} [2024-08-06 07:22:40,757][52670] DAMAGECOUNT value on done: 842831.0 [2024-08-06 07:22:40,761][52670] Sum rewards: 83.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.182', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.140', 'weapon4': '0.192', 'weapon2': '0.216', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '68.000'} [2024-08-06 07:22:40,953][52666] DAMAGECOUNT value on done: 849670.0 [2024-08-06 07:22:40,953][52666] Sum rewards: 77.081, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.818', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.266', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '66.000'} [2024-08-06 07:22:41,214][52671] DAMAGECOUNT value on done: 858363.0 [2024-08-06 07:22:41,214][52671] Sum rewards: 78.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.161', 'weapon4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:41,486][52663] DAMAGECOUNT value on done: 857055.0 [2024-08-06 07:22:41,486][52663] Sum rewards: 71.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.190', 'weapon5': '0.204', 'AMMO3': '0.237', 'AMMO4': '0.261', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.500'} [2024-08-06 07:22:41,652][52649] DAMAGECOUNT value on done: 818119.0 [2024-08-06 07:22:41,652][52649] Sum rewards: 62.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.850', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '2.840', 'weapon3': '3.336', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '50.000'} [2024-08-06 07:22:41,895][52811] DAMAGECOUNT value on done: 802424.0 [2024-08-06 07:22:41,897][52811] Sum rewards: 69.453, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.277', 'AMMO5': '0.023', 'AMMO2': '0.079', 'weapon4': '0.102', 'weapon5': '0.254', 'AMMO3': '0.273', 'weapon2': '0.282', 'AMMO4': '0.396', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '3.066', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:41,945][52669] DAMAGECOUNT value on done: 866845.0 [2024-08-06 07:22:41,946][52669] Sum rewards: 80.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.275', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.152', 'weapon2': '0.176', 'AMMO3': '0.191', 'WEAPON3': '1.300', 'weapon3': '3.612', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:42,341][52665] DAMAGECOUNT value on done: 846933.0 [2024-08-06 07:22:42,341][52665] Sum rewards: 65.784, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.090', 'AMMO4': '0.142', 'weapon5': '0.176', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '57.500'} [2024-08-06 07:22:42,503][52803] DAMAGECOUNT value on done: 793671.0 [2024-08-06 07:22:42,504][52803] Sum rewards: 84.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.117', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.053', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '68.000'} [2024-08-06 07:22:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 622747648. Throughput: 0: 4360.0. Samples: 155694650. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:42,794][52567] Avg episode reward: [(0, '74.594')] [2024-08-06 07:22:43,551][52650] Updated weights for policy 0, policy_version 76021 (0.0011) [2024-08-06 07:22:43,771][52670] DAMAGECOUNT value on done: 839598.0 [2024-08-06 07:22:43,780][52670] Sum rewards: 72.171, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.240', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO3': '0.156', 'AMMO4': '0.178', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '0.900', 'weapon3': '3.098', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 07:22:43,923][52666] DAMAGECOUNT value on done: 842861.0 [2024-08-06 07:22:43,923][52666] Sum rewards: 66.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.478', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.044', 'weapon5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '0.950', 'weapon3': '2.976', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '53.000'} [2024-08-06 07:22:44,044][52671] DAMAGECOUNT value on done: 844481.0 [2024-08-06 07:22:44,045][52671] Sum rewards: 80.979, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.207', 'AMMO4': '0.253', 'weapon5': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.404', 'HEALTH': '0.474', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.446', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '64.000'} [2024-08-06 07:22:44,457][52663] DAMAGECOUNT value on done: 858556.0 [2024-08-06 07:22:44,457][52663] Sum rewards: 69.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.366', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.096', 'AMMO3': '0.176', 'weapon5': '0.202', 'AMMO4': '0.245', 'weapon2': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.214', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '59.000'} [2024-08-06 07:22:44,843][52649] DAMAGECOUNT value on done: 841645.0 [2024-08-06 07:22:44,843][52649] Sum rewards: 74.906, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.054', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.198', 'AMMO4': '0.199', 'weapon5': '0.216', 'weapon4': '0.240', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:44,916][52811] DAMAGECOUNT value on done: 807999.0 [2024-08-06 07:22:44,917][52811] Sum rewards: 62.234, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.064', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.222', 'DAMAGECOUNT': '14.754', 'FRAGCOUNT': '50.000'} [2024-08-06 07:22:45,390][52665] DAMAGECOUNT value on done: 842798.0 [2024-08-06 07:22:45,390][52665] Sum rewards: 84.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.046', 'AMMO4': '0.064', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '69.000'} [2024-08-06 07:22:45,565][52803] DAMAGECOUNT value on done: 791590.0 [2024-08-06 07:22:45,567][52803] Sum rewards: 68.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.219', 'weapon2': '0.406', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.426', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:45,649][52647] DAMAGECOUNT value on done: 908380.0 [2024-08-06 07:22:45,649][52647] Sum rewards: 70.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.288', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.048', 'AMMO4': '0.064', 'weapon5': '0.104', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.816', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:46,482][52671] DAMAGECOUNT value on done: 867109.0 [2024-08-06 07:22:46,482][52671] Sum rewards: 70.207, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.015', 'AMMO5': '0.010', 'weapon5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.046', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.684', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:46,785][52668] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:22:47,116][52670] DAMAGECOUNT value on done: 845045.0 [2024-08-06 07:22:47,116][52670] Sum rewards: 77.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.873', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.144', 'AMMO4': '0.160', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:47,254][52666] DAMAGECOUNT value on done: 850035.0 [2024-08-06 07:22:47,254][52666] Sum rewards: 71.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.243', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.048', 'AMMO4': '0.180', 'weapon5': '0.190', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:47,536][52663] DAMAGECOUNT value on done: 843655.0 [2024-08-06 07:22:47,536][52663] Sum rewards: 72.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.365', 'AMMO5': '0.009', 'weapon4': '0.046', 'AMMO2': '0.055', 'weapon5': '0.124', 'weapon2': '0.220', 'AMMO3': '0.224', 'AMMO4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.406', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:47,794][52567] Fps is (10 sec: 18024.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 622829568. Throughput: 0: 4365.8. Samples: 155707880. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:47,795][52567] Avg episode reward: [(0, '74.127')] [2024-08-06 07:22:47,866][52649] DAMAGECOUNT value on done: 838612.0 [2024-08-06 07:22:47,867][52649] Sum rewards: 70.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.172', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.052', 'AMMO4': '0.062', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '59.000'} [2024-08-06 07:22:47,999][52647] DAMAGECOUNT value on done: 897491.0 [2024-08-06 07:22:48,001][52647] Sum rewards: 76.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.020', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.034', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:48,048][52811] DAMAGECOUNT value on done: 794046.0 [2024-08-06 07:22:48,050][52811] Sum rewards: 68.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.781', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.178', 'weapon5': '0.206', 'AMMO3': '0.224', 'weapon2': '0.242', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '58.000'} [2024-08-06 07:22:48,190][52650] Updated weights for policy 0, policy_version 76031 (0.0015) [2024-08-06 07:22:48,389][52665] DAMAGECOUNT value on done: 847274.0 [2024-08-06 07:22:48,391][52665] Sum rewards: 71.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.800', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.134', 'AMMO4': '0.175', 'weapon5': '0.178', 'AMMO3': '0.235', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '60.000'} [2024-08-06 07:22:48,637][52803] DAMAGECOUNT value on done: 799519.0 [2024-08-06 07:22:48,637][52803] Sum rewards: 74.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.195', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.054', 'AMMO4': '0.057', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:49,355][52671] DAMAGECOUNT value on done: 864825.0 [2024-08-06 07:22:49,363][52671] Sum rewards: 70.052, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.084', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '56.000'} [2024-08-06 07:22:49,834][52670] DAMAGECOUNT value on done: 844039.0 [2024-08-06 07:22:49,835][52670] Sum rewards: 76.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.590', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.179', 'AMMO3': '0.246', 'weapon4': '0.254', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.972', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:49,930][52666] DAMAGECOUNT value on done: 844607.0 [2024-08-06 07:22:49,930][52666] Sum rewards: 71.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.212', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.186', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.050', 'weapon3': '2.924', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:50,596][52647] DAMAGECOUNT value on done: 904447.0 [2024-08-06 07:22:50,597][52647] Sum rewards: 72.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.138', 'AMMO5': '0.025', 'AMMO2': '0.065', 'weapon4': '0.210', 'weapon2': '0.222', 'AMMO3': '0.244', 'weapon5': '0.288', 'AMMO4': '0.326', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.938', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:51,028][52649] DAMAGECOUNT value on done: 831381.0 [2024-08-06 07:22:51,029][52649] Sum rewards: 74.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.290', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '61.000'} [2024-08-06 07:22:51,196][52811] DAMAGECOUNT value on done: 794621.0 [2024-08-06 07:22:51,198][52811] Sum rewards: 65.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.668', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.126', 'weapon5': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.600', 'weapon3': '2.982', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '55.000'} [2024-08-06 07:22:51,469][52665] DAMAGECOUNT value on done: 838800.0 [2024-08-06 07:22:51,470][52665] Sum rewards: 72.828, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'AMMO4': '0.129', 'weapon2': '0.782', 'WEAPON3': '0.900', 'weapon3': '2.996', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '56.000'} [2024-08-06 07:22:51,720][52803] DAMAGECOUNT value on done: 798466.0 [2024-08-06 07:22:51,720][52803] Sum rewards: 68.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.095', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.046', 'weapon4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.179', 'AMMO3': '0.218', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '58.000'} [2024-08-06 07:22:52,314][52671] DAMAGECOUNT value on done: 859871.0 [2024-08-06 07:22:52,314][52671] Sum rewards: 83.348, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.148', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon4': '0.134', 'weapon5': '0.176', 'AMMO3': '0.194', 'AMMO4': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.448', 'FRAGCOUNT': '68.000'} [2024-08-06 07:22:52,329][52820] DAMAGECOUNT value on done: 790285.0 [2024-08-06 07:22:52,333][52820] Sum rewards: 70.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.530', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon5': '0.048', 'weapon4': '0.060', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.296', 'weapon2': '0.384', 'WEAPON3': '1.900', 'weapon3': '3.258', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:52,534][52670] DAMAGECOUNT value on done: 839930.0 [2024-08-06 07:22:52,537][52670] Sum rewards: 86.268, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.066', 'AMMO4': '0.136', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.275', 'weapon4': '0.310', 'weapon2': '0.598', 'WEAPON3': '0.850', 'weapon3': '2.912', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '67.000'} [2024-08-06 07:22:52,694][52666] DAMAGECOUNT value on done: 842377.0 [2024-08-06 07:22:52,697][52666] Sum rewards: 79.745, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.744', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.102', 'weapon4': '0.166', 'AMMO4': '0.214', 'AMMO3': '0.236', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '67.000'} [2024-08-06 07:22:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 622919680. Throughput: 0: 4369.1. Samples: 155734330. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:52,794][52567] Avg episode reward: [(0, '73.495')] [2024-08-06 07:22:53,145][52650] Updated weights for policy 0, policy_version 76041 (0.0021) [2024-08-06 07:22:53,669][52647] DAMAGECOUNT value on done: 904813.0 [2024-08-06 07:22:53,669][52647] Sum rewards: 81.797, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.962', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '3.292', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '66.000'} [2024-08-06 07:22:53,731][52665] DAMAGECOUNT value on done: 845590.0 [2024-08-06 07:22:53,732][52665] Sum rewards: 67.622, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.244', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.106', 'AMMO4': '0.223', 'weapon5': '0.232', 'AMMO3': '0.253', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '57.000'} [2024-08-06 07:22:54,851][52803] DAMAGECOUNT value on done: 795645.0 [2024-08-06 07:22:54,853][52803] Sum rewards: 68.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.988', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.206', 'AMMO3': '0.219', 'weapon2': '0.262', 'AMMO4': '0.281', 'weapon4': '0.328', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '56.500'} [2024-08-06 07:22:55,096][52671] DAMAGECOUNT value on done: 864503.0 [2024-08-06 07:22:55,097][52671] Sum rewards: 78.852, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.052', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.324', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '65.000'} [2024-08-06 07:22:55,410][52820] DAMAGECOUNT value on done: 790779.0 [2024-08-06 07:22:55,410][52820] Sum rewards: 64.159, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.548', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.158', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '54.000'} [2024-08-06 07:22:55,778][52670] DAMAGECOUNT value on done: 850924.0 [2024-08-06 07:22:55,779][52670] Sum rewards: 66.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.378', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.163', 'weapon4': '0.168', 'weapon5': '0.222', 'AMMO4': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.676', 'WEAPON3': '0.900', 'weapon3': '2.690', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 07:22:55,874][52666] DAMAGECOUNT value on done: 850401.0 [2024-08-06 07:22:55,874][52666] Sum rewards: 78.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.110', 'AMMO3': '0.157', 'AMMO4': '0.168', 'weapon5': '0.172', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.140', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:55,998][52647] DAMAGECOUNT value on done: 910959.0 [2024-08-06 07:22:55,998][52647] Sum rewards: 82.300, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.432', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.028', 'AMMO4': '0.111', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '66.500'} [2024-08-06 07:22:56,704][52665] DAMAGECOUNT value on done: 845385.0 [2024-08-06 07:22:56,704][52665] Sum rewards: 63.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.176', 'weapon5': '0.208', 'AMMO3': '0.221', 'AMMO4': '0.281', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '53.000'} [2024-08-06 07:22:57,570][52671] DAMAGECOUNT value on done: 849125.0 [2024-08-06 07:22:57,572][52671] Sum rewards: 78.255, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.200', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '62.000'} [2024-08-06 07:22:57,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 623001600. Throughput: 0: 4380.0. Samples: 155760830. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 07:22:57,795][52567] Avg episode reward: [(0, '73.640')] [2024-08-06 07:22:57,869][52803] DAMAGECOUNT value on done: 796089.0 [2024-08-06 07:22:57,870][52803] Sum rewards: 81.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.304', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.050', 'AMMO4': '0.138', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '67.000'} [2024-08-06 07:22:57,901][52650] Updated weights for policy 0, policy_version 76051 (0.0016) [2024-08-06 07:22:58,318][52670] DAMAGECOUNT value on done: 833756.0 [2024-08-06 07:22:58,319][52670] Sum rewards: 58.228, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.004', 'AMMO2': '0.023', 'weapon5': '0.028', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON5': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.116', 'weapon7': '0.144', 'WEAPON4': '0.150', 'weapon2': '0.286', 'AMMO3': '0.289', 'weapon4': '0.394', 'WEAPON3': '1.700', 'weapon3': '2.688', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '52.000'} [2024-08-06 07:22:58,397][52666] DAMAGECOUNT value on done: 843431.0 [2024-08-06 07:22:58,399][52666] Sum rewards: 74.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.948', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO4': '0.156', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '59.500'} [2024-08-06 07:22:58,602][52820] DAMAGECOUNT value on done: 790711.0 [2024-08-06 07:22:58,605][52820] Sum rewards: 89.466, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.075', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon4': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '72.000'} [2024-08-06 07:22:59,075][52647] DAMAGECOUNT value on done: 906498.0 [2024-08-06 07:22:59,076][52647] Sum rewards: 76.856, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.375', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.064', 'weapon5': '0.122', 'AMMO3': '0.201', 'AMMO4': '0.231', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '63.000'} [2024-08-06 07:22:59,876][52665] DAMAGECOUNT value on done: 838039.0 [2024-08-06 07:22:59,884][52665] Sum rewards: 68.198, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.600', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.178', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.323', 'WEAPON3': '1.850', 'HITCOUNT': '3.360', 'weapon3': '3.362', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:00,462][52668] DAMAGECOUNT value on done: 860376.0 [2024-08-06 07:23:00,462][52668] Sum rewards: 87.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.743', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.160', 'AMMO3': '0.179', 'weapon2': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '69.000'} [2024-08-06 07:23:01,021][52803] DAMAGECOUNT value on done: 788723.0 [2024-08-06 07:23:01,022][52803] Sum rewards: 55.216, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.449', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.586', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.078', 'FRAGCOUNT': '47.000'} [2024-08-06 07:23:01,148][52670] DAMAGECOUNT value on done: 849513.0 [2024-08-06 07:23:01,150][52670] Sum rewards: 71.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.925', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.074', 'AMMO4': '0.076', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.241', 'WEAPON3': '1.400', 'weapon3': '3.470', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '58.000'} [2024-08-06 07:23:01,164][52666] DAMAGECOUNT value on done: 851743.0 [2024-08-06 07:23:01,164][52666] Sum rewards: 80.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.306', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.043', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.215', 'AMMO3': '0.226', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:01,630][52820] DAMAGECOUNT value on done: 779036.0 [2024-08-06 07:23:01,630][52820] Sum rewards: 80.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.107', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.062', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.432', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '67.000'} [2024-08-06 07:23:01,640][52647] DAMAGECOUNT value on done: 909389.0 [2024-08-06 07:23:01,641][52647] Sum rewards: 81.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.915', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon5': '0.210', 'AMMO3': '0.241', 'AMMO4': '0.243', 'weapon2': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.140', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.718', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:02,058][52795] DAMAGECOUNT value on done: 792294.0 [2024-08-06 07:23:02,061][52795] Sum rewards: 73.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.765', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.146', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:02,081][52664] DAMAGECOUNT value on done: 883231.0 [2024-08-06 07:23:02,082][52664] Sum rewards: 78.802, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO4': '0.077', 'AMMO3': '0.188', 'weapon4': '0.234', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:02,450][52650] Updated weights for policy 0, policy_version 76061 (0.0018) [2024-08-06 07:23:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 623099904. Throughput: 0: 4379.1. Samples: 155773850. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:02,794][52567] Avg episode reward: [(0, '73.970')] [2024-08-06 07:23:03,203][52665] DAMAGECOUNT value on done: 842257.0 [2024-08-06 07:23:03,204][52665] Sum rewards: 75.750, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.852', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.034', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon2': '0.222', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.480', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '65.000'} [2024-08-06 07:23:03,353][52668] DAMAGECOUNT value on done: 860976.0 [2024-08-06 07:23:03,355][52668] Sum rewards: 76.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.690', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.046', 'AMMO4': '0.171', 'AMMO3': '0.205', 'weapon4': '0.214', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.280', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:03,869][52670] DAMAGECOUNT value on done: 853563.0 [2024-08-06 07:23:03,871][52670] Sum rewards: 70.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.186', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.180', 'weapon2': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.142', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:03,876][52666] DAMAGECOUNT value on done: 835864.0 [2024-08-06 07:23:03,877][52666] Sum rewards: 66.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.124', 'weapon2': '0.144', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:04,148][52647] DAMAGECOUNT value on done: 886303.0 [2024-08-06 07:23:04,149][52647] Sum rewards: 81.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.845', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.151', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'WEAPON3': '1.200', 'weapon3': '3.376', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '67.000'} [2024-08-06 07:23:04,240][52803] DAMAGECOUNT value on done: 790044.0 [2024-08-06 07:23:04,241][52803] Sum rewards: 78.298, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.220', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.492', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:04,659][52664] DAMAGECOUNT value on done: 889292.0 [2024-08-06 07:23:04,660][52664] Sum rewards: 80.536, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.142', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.206', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.428', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:04,775][52820] DAMAGECOUNT value on done: 794765.0 [2024-08-06 07:23:04,776][52820] Sum rewards: 78.803, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.710', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.114', 'AMMO4': '0.145', 'weapon2': '0.176', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.458', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:05,211][52795] DAMAGECOUNT value on done: 778074.0 [2024-08-06 07:23:05,219][52795] Sum rewards: 68.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.080', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO3': '0.147', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.586', 'WEAPON3': '0.850', 'HITCOUNT': '2.970', 'weapon3': '3.098', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:06,303][52668] DAMAGECOUNT value on done: 855648.0 [2024-08-06 07:23:06,305][52668] Sum rewards: 65.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.858', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.056', 'weapon4': '0.108', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.804', 'FRAGCOUNT': '53.000'} [2024-08-06 07:23:06,356][52665] DAMAGECOUNT value on done: 847421.0 [2024-08-06 07:23:06,357][52665] Sum rewards: 81.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.943', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.044', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '67.000'} [2024-08-06 07:23:06,379][52670] DAMAGECOUNT value on done: 847213.0 [2024-08-06 07:23:06,380][52670] Sum rewards: 75.929, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.581', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon4': '0.230', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:06,439][52666] DAMAGECOUNT value on done: 855899.0 [2024-08-06 07:23:06,440][52666] Sum rewards: 84.007, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.148', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.214', 'AMMO3': '0.238', 'weapon2': '0.294', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.884', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.979', 'FRAGCOUNT': '71.000'} [2024-08-06 07:23:06,561][52647] DAMAGECOUNT value on done: 902283.0 [2024-08-06 07:23:06,563][52647] Sum rewards: 78.040, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.145', 'AMMO5': '0.014', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.193', 'weapon5': '0.214', 'weapon2': '0.308', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:06,915][52650] Updated weights for policy 0, policy_version 76071 (0.0014) [2024-08-06 07:23:07,342][52664] DAMAGECOUNT value on done: 889904.0 [2024-08-06 07:23:07,344][52664] Sum rewards: 73.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.810', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.090', 'weapon5': '0.134', 'AMMO4': '0.142', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:07,346][52803] DAMAGECOUNT value on done: 795828.0 [2024-08-06 07:23:07,348][52803] Sum rewards: 69.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.759', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.108', 'AMMO4': '0.143', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '56.000'} [2024-08-06 07:23:07,796][52567] Fps is (10 sec: 18838.9, 60 sec: 17475.9, 300 sec: 17494.7). Total num frames: 623190016. Throughput: 0: 4372.3. Samples: 155800130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:07,796][52567] Avg episode reward: [(0, '73.932')] [2024-08-06 07:23:07,926][52820] DAMAGECOUNT value on done: 778454.0 [2024-08-06 07:23:07,926][52820] Sum rewards: 62.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.165', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.152', 'weapon4': '0.154', 'AMMO3': '0.202', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.212', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '50.000'} [2024-08-06 07:23:08,339][52795] DAMAGECOUNT value on done: 783809.0 [2024-08-06 07:23:08,339][52795] Sum rewards: 77.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.491', 'AMMO5': '0.007', 'ARMOR': '0.008', 'AMMO2': '0.022', 'weapon4': '0.088', 'weapon5': '0.106', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:09,069][52670] DAMAGECOUNT value on done: 828615.0 [2024-08-06 07:23:09,071][52670] Sum rewards: 75.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.604', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.279', 'weapon2': '0.414', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:09,076][52666] DAMAGECOUNT value on done: 849199.0 [2024-08-06 07:23:09,076][52666] Sum rewards: 72.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.334', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '59.000'} [2024-08-06 07:23:09,210][52668] DAMAGECOUNT value on done: 861651.0 [2024-08-06 07:23:09,211][52668] Sum rewards: 73.470, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.070', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.120', 'AMMO4': '0.136', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'weapon2': '0.498', 'WEAPON3': '0.900', 'weapon3': '2.994', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:09,497][52647] DAMAGECOUNT value on done: 900094.0 [2024-08-06 07:23:09,498][52647] Sum rewards: 78.548, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.063', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.190', 'AMMO3': '0.191', 'AMMO4': '0.257', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.566', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:10,128][52664] DAMAGECOUNT value on done: 880035.0 [2024-08-06 07:23:10,129][52664] Sum rewards: 66.971, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.099', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon4': '0.252', 'weapon2': '0.388', 'WEAPON3': '1.000', 'weapon3': '2.980', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '14.838', 'FRAGCOUNT': '54.000'} [2024-08-06 07:23:10,471][52803] DAMAGECOUNT value on done: 791756.0 [2024-08-06 07:23:10,479][52803] Sum rewards: 64.480, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.188', 'AMMO3': '0.196', 'weapon4': '0.232', 'AMMO4': '0.240', 'weapon2': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '54.000'} [2024-08-06 07:23:11,088][52820] DAMAGECOUNT value on done: 785252.0 [2024-08-06 07:23:11,088][52820] Sum rewards: 78.673, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.340', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.336', 'weapon2': '0.508', 'WEAPON3': '0.950', 'weapon3': '2.872', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:11,442][52795] DAMAGECOUNT value on done: 793214.0 [2024-08-06 07:23:11,442][52795] Sum rewards: 79.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.852', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.244', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:11,506][52658] Large shaping reward 2.600 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.042, -14.0), ('weapon5', 0.002)] [2024-08-06 07:23:11,685][52650] Updated weights for policy 0, policy_version 76081 (0.0032) [2024-08-06 07:23:11,908][52666] DAMAGECOUNT value on done: 848305.0 [2024-08-06 07:23:11,908][52666] Sum rewards: 61.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.496', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.086', 'AMMO4': '0.122', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.494', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '52.000'} [2024-08-06 07:23:11,926][52670] DAMAGECOUNT value on done: 846341.0 [2024-08-06 07:23:11,927][52670] Sum rewards: 82.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.068', 'weapon5': '0.166', 'AMMO3': '0.203', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:11,947][52647] DAMAGECOUNT value on done: 899364.0 [2024-08-06 07:23:11,948][52647] Sum rewards: 70.804, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.720', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'weapon2': '0.380', 'WEAPON3': '1.750', 'weapon3': '3.172', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:12,202][52668] DAMAGECOUNT value on done: 848193.0 [2024-08-06 07:23:12,202][52668] Sum rewards: 69.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.312', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.115', 'weapon5': '0.142', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:12,621][52664] DAMAGECOUNT value on done: 890922.0 [2024-08-06 07:23:12,622][52664] Sum rewards: 87.037, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.146', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.064', 'weapon5': '0.158', 'AMMO3': '0.218', 'weapon2': '0.218', 'AMMO4': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.354', 'FRAGCOUNT': '70.000'} [2024-08-06 07:23:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 623271936. Throughput: 0: 4374.2. Samples: 155826260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:12,794][52567] Avg episode reward: [(0, '74.055')] [2024-08-06 07:23:13,038][52662] DAMAGECOUNT value on done: 853473.0 [2024-08-06 07:23:13,039][52662] Sum rewards: 84.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.948', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.134', 'weapon4': '0.164', 'AMMO4': '0.185', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '69.000'} [2024-08-06 07:23:13,478][52803] DAMAGECOUNT value on done: 805288.0 [2024-08-06 07:23:13,482][52803] Sum rewards: 69.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.514', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon5': '0.186', 'AMMO3': '0.195', 'weapon4': '0.212', 'AMMO4': '0.287', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '58.000'} [2024-08-06 07:23:14,225][52820] DAMAGECOUNT value on done: 787430.0 [2024-08-06 07:23:14,225][52820] Sum rewards: 78.246, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.655', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.104', 'weapon5': '0.160', 'AMMO3': '0.179', 'AMMO4': '0.255', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:14,516][52670] DAMAGECOUNT value on done: 854824.0 [2024-08-06 07:23:14,516][52670] Sum rewards: 65.884, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.088', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.066', 'AMMO4': '0.158', 'weapon5': '0.220', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '56.000'} [2024-08-06 07:23:14,522][52666] DAMAGECOUNT value on done: 843729.0 [2024-08-06 07:23:14,523][52666] Sum rewards: 80.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.182', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO3': '0.179', 'AMMO4': '0.179', 'weapon2': '0.250', 'weapon4': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.950', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:14,639][52795] DAMAGECOUNT value on done: 781104.0 [2024-08-06 07:23:14,639][52795] Sum rewards: 80.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.882', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:14,661][52647] DAMAGECOUNT value on done: 887563.0 [2024-08-06 07:23:14,662][52647] Sum rewards: 64.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.609', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.216', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.540', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:15,225][52668] DAMAGECOUNT value on done: 857654.0 [2024-08-06 07:23:15,226][52668] Sum rewards: 73.282, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.343', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO4': '0.070', 'AMMO3': '0.204', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.434', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '60.500'} [2024-08-06 07:23:15,509][52664] DAMAGECOUNT value on done: 888384.0 [2024-08-06 07:23:15,519][52664] Sum rewards: 81.440, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.052', 'weapon5': '0.136', 'AMMO3': '0.169', 'AMMO4': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.246', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:15,988][52662] DAMAGECOUNT value on done: 863066.0 [2024-08-06 07:23:15,988][52662] Sum rewards: 69.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon4': '0.218', 'AMMO3': '0.233', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:16,188][52650] Updated weights for policy 0, policy_version 76091 (0.0014) [2024-08-06 07:23:16,567][52803] DAMAGECOUNT value on done: 798577.0 [2024-08-06 07:23:16,567][52803] Sum rewards: 84.300, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon4': '0.180', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'HEALTH': '0.326', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '3.138', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '67.000'} [2024-08-06 07:23:17,294][52647] DAMAGECOUNT value on done: 904945.0 [2024-08-06 07:23:17,296][52647] Sum rewards: 78.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.075', 'AMMO3': '0.183', 'weapon5': '0.204', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.542', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:17,306][52670] DAMAGECOUNT value on done: 845324.0 [2024-08-06 07:23:17,306][52670] Sum rewards: 70.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.350', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.250', 'weapon2': '0.274', 'weapon4': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '59.000'} [2024-08-06 07:23:17,321][52666] DAMAGECOUNT value on done: 843085.0 [2024-08-06 07:23:17,323][52666] Sum rewards: 69.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.885', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.140', 'AMMO4': '0.185', 'AMMO3': '0.189', 'weapon4': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:17,387][52820] DAMAGECOUNT value on done: 793131.0 [2024-08-06 07:23:17,389][52820] Sum rewards: 71.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.368', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.162', 'weapon4': '0.182', 'AMMO4': '0.239', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:17,763][52795] DAMAGECOUNT value on done: 787689.0 [2024-08-06 07:23:17,765][52795] Sum rewards: 60.721, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.014', 'AMMO2': '0.050', 'AMMO3': '0.181', 'weapon5': '0.194', 'weapon4': '0.210', 'AMMO4': '0.250', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.072', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '49.000'} [2024-08-06 07:23:17,794][52567] Fps is (10 sec: 17205.7, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 623362048. Throughput: 0: 4386.0. Samples: 155839570. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:17,794][52567] Avg episode reward: [(0, '74.095')] [2024-08-06 07:23:17,970][52668] DAMAGECOUNT value on done: 859706.0 [2024-08-06 07:23:17,970][52668] Sum rewards: 82.257, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.790', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.096', 'weapon5': '0.190', 'AMMO3': '0.233', 'weapon2': '0.240', 'AMMO4': '0.273', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '69.000'} [2024-08-06 07:23:18,106][52664] DAMAGECOUNT value on done: 879561.0 [2024-08-06 07:23:18,109][52664] Sum rewards: 56.663, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.922', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.138', 'weapon5': '0.146', 'AMMO4': '0.209', 'WEAPON5': '0.250', 'AMMO3': '0.292', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '14.982', 'FRAGCOUNT': '51.000'} [2024-08-06 07:23:18,679][52662] DAMAGECOUNT value on done: 864256.0 [2024-08-06 07:23:18,679][52662] Sum rewards: 72.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.380', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.196', 'AMMO4': '0.198', 'AMMO3': '0.242', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.796', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:19,748][52803] DAMAGECOUNT value on done: 791915.0 [2024-08-06 07:23:19,749][52803] Sum rewards: 73.203, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'weapon4': '0.104', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'HEALTH': '0.270', 'weapon2': '0.336', 'WEAPON3': '0.850', 'HITCOUNT': '3.190', 'weapon3': '3.320', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '58.000'} [2024-08-06 07:23:20,104][52647] DAMAGECOUNT value on done: 894549.0 [2024-08-06 07:23:20,105][52647] Sum rewards: 85.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.064', 'AMMO4': '0.098', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.202', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.928', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:20,319][52670] DAMAGECOUNT value on done: 849357.0 [2024-08-06 07:23:20,319][52670] Sum rewards: 77.661, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.837', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.110', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.006', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:20,358][52666] DAMAGECOUNT value on done: 858255.0 [2024-08-06 07:23:20,360][52666] Sum rewards: 85.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.606', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '71.000'} [2024-08-06 07:23:20,529][52820] DAMAGECOUNT value on done: 801292.0 [2024-08-06 07:23:20,537][52820] Sum rewards: 70.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.017', 'AMMO2': '0.065', 'AMMO3': '0.179', 'weapon5': '0.268', 'AMMO4': '0.323', 'WEAPON5': '0.450', 'weapon4': '0.472', 'WEAPON4': '0.500', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.316', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2024-08-06 07:23:20,910][52795] DAMAGECOUNT value on done: 796854.0 [2024-08-06 07:23:20,912][52795] Sum rewards: 92.665, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.273', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.972', 'FRAGCOUNT': '74.000'} [2024-08-06 07:23:20,997][52668] DAMAGECOUNT value on done: 847428.0 [2024-08-06 07:23:21,001][52668] Sum rewards: 63.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.524', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.110', 'AMMO3': '0.136', 'AMMO4': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.666', 'WEAPON3': '0.900', 'HITCOUNT': '2.980', 'weapon3': '3.030', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '50.000'} [2024-08-06 07:23:21,079][52650] Updated weights for policy 0, policy_version 76101 (0.0016) [2024-08-06 07:23:21,159][52664] DAMAGECOUNT value on done: 877954.0 [2024-08-06 07:23:21,159][52664] Sum rewards: 81.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.345', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.180', 'AMMO3': '0.210', 'weapon2': '0.262', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '67.000'} [2024-08-06 07:23:21,497][52662] DAMAGECOUNT value on done: 849562.0 [2024-08-06 07:23:21,499][52662] Sum rewards: 79.002, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.013', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.139', 'AMMO3': '0.169', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:22,784][52647] DAMAGECOUNT value on done: 902931.0 [2024-08-06 07:23:22,784][52647] Sum rewards: 63.458, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.156', 'AMMO4': '0.160', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.450', 'HITCOUNT': '2.990', 'weapon3': '2.996', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '54.000'} [2024-08-06 07:23:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 623443968. Throughput: 0: 4386.8. Samples: 155865960. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:22,794][52567] Avg episode reward: [(0, '74.480')] [2024-08-06 07:23:22,880][52803] DAMAGECOUNT value on done: 808360.0 [2024-08-06 07:23:22,880][52803] Sum rewards: 86.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.506', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.124', 'weapon5': '0.194', 'AMMO4': '0.210', 'AMMO3': '0.214', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.931', 'FRAGCOUNT': '71.500'} [2024-08-06 07:23:23,152][52666] DAMAGECOUNT value on done: 834577.0 [2024-08-06 07:23:23,152][52666] Sum rewards: 68.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.086', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.080', 'weapon3': '3.420', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '58.000'} [2024-08-06 07:23:23,564][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:23:23,666][52664] DAMAGECOUNT value on done: 888360.0 [2024-08-06 07:23:23,666][52664] Sum rewards: 78.799, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.385', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.884', 'WEAPON3': '1.050', 'weapon3': '2.876', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:23,725][52820] DAMAGECOUNT value on done: 782060.0 [2024-08-06 07:23:23,725][52820] Sum rewards: 73.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.190', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:23,981][52795] DAMAGECOUNT value on done: 787341.0 [2024-08-06 07:23:23,982][52795] Sum rewards: 61.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.816', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon7': '0.080', 'weapon5': '0.098', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.165', 'WEAPON7': '0.200', 'weapon2': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.460', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '14.760', 'FRAGCOUNT': '52.000'} [2024-08-06 07:23:24,001][52662] DAMAGECOUNT value on done: 867012.0 [2024-08-06 07:23:24,003][52662] Sum rewards: 69.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.296', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.084', 'AMMO4': '0.136', 'weapon5': '0.162', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:24,002][52668] DAMAGECOUNT value on done: 851529.0 [2024-08-06 07:23:24,005][52668] Sum rewards: 68.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.171', 'weapon2': '0.186', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.380', 'weapon3': '3.384', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '57.500'} [2024-08-06 07:23:25,277][52650] Updated weights for policy 0, policy_version 76111 (0.0012) [2024-08-06 07:23:25,307][52647] DAMAGECOUNT value on done: 903587.0 [2024-08-06 07:23:25,308][52647] Sum rewards: 78.816, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.802', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.460', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '67.000'} [2024-08-06 07:23:26,112][52803] DAMAGECOUNT value on done: 794088.0 [2024-08-06 07:23:26,112][52803] Sum rewards: 73.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.016', 'AMMO2': '0.074', 'weapon4': '0.220', 'weapon5': '0.228', 'AMMO3': '0.230', 'AMMO4': '0.369', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'weapon2': '0.734', 'WEAPON3': '1.350', 'weapon3': '2.542', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:26,138][52664] DAMAGECOUNT value on done: 883971.0 [2024-08-06 07:23:26,139][52664] Sum rewards: 70.050, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.366', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.164', 'weapon5': '0.196', 'AMMO3': '0.216', 'weapon2': '0.268', 'AMMO4': '0.277', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:26,315][52666] DAMAGECOUNT value on done: 843051.0 [2024-08-06 07:23:26,315][52666] Sum rewards: 71.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.337', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon2': '0.198', 'AMMO3': '0.205', 'weapon4': '0.266', 'weapon5': '0.282', 'AMMO4': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:26,483][52662] DAMAGECOUNT value on done: 846616.0 [2024-08-06 07:23:26,483][52662] Sum rewards: 77.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.108', 'weapon5': '0.120', 'AMMO4': '0.139', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '65.000'} [2024-08-06 07:23:26,832][52820] DAMAGECOUNT value on done: 793232.0 [2024-08-06 07:23:26,834][52820] Sum rewards: 71.208, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.884', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon5': '0.246', 'AMMO3': '0.253', 'weapon4': '0.276', 'AMMO4': '0.297', 'weapon2': '0.350', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.758', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:27,171][52668] DAMAGECOUNT value on done: 859715.0 [2024-08-06 07:23:27,172][52668] Sum rewards: 72.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.084', 'weapon4': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.210', 'weapon2': '0.342', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.280', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:27,267][52795] DAMAGECOUNT value on done: 793242.0 [2024-08-06 07:23:27,268][52795] Sum rewards: 73.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.672', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.120', 'weapon5': '0.218', 'AMMO4': '0.240', 'AMMO3': '0.256', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 623534080. Throughput: 0: 4390.9. Samples: 155892240. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:27,794][52567] Avg episode reward: [(0, '74.333')] [2024-08-06 07:23:27,870][52647] DAMAGECOUNT value on done: 890855.0 [2024-08-06 07:23:27,871][52647] Sum rewards: 85.487, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.252', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.108', 'AMMO3': '0.153', 'weapon2': '0.176', 'WEAPON4': '0.200', 'weapon4': '0.230', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.346', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:28,901][52664] DAMAGECOUNT value on done: 894211.0 [2024-08-06 07:23:28,901][52664] Sum rewards: 71.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.226', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.184', 'AMMO4': '0.193', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:29,203][52803] DAMAGECOUNT value on done: 796976.0 [2024-08-06 07:23:29,203][52662] DAMAGECOUNT value on done: 852800.0 [2024-08-06 07:23:29,206][52803] Sum rewards: 68.731, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.261', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.074', 'AMMO4': '0.156', 'AMMO3': '0.195', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '54.000'} [2024-08-06 07:23:29,206][52662] Sum rewards: 75.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.195', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.076', 'AMMO4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:30,083][52820] DAMAGECOUNT value on done: 804844.0 [2024-08-06 07:23:30,084][52820] Sum rewards: 83.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.349', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.110', 'weapon5': '0.140', 'AMMO4': '0.153', 'AMMO3': '0.228', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:30,153][52667] DAMAGECOUNT value on done: 854572.0 [2024-08-06 07:23:30,153][52667] Sum rewards: 71.047, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO3': '0.167', 'AMMO4': '0.170', 'weapon4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '57.500'} [2024-08-06 07:23:30,302][52668] DAMAGECOUNT value on done: 850010.0 [2024-08-06 07:23:30,302][52668] Sum rewards: 69.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.992', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.178', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '56.000'} [2024-08-06 07:23:30,307][52650] Updated weights for policy 0, policy_version 76121 (0.0013) [2024-08-06 07:23:30,430][52647] DAMAGECOUNT value on done: 895743.0 [2024-08-06 07:23:30,430][52647] Sum rewards: 73.428, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'weapon4': '0.146', 'AMMO3': '0.190', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '59.000'} [2024-08-06 07:23:30,451][52795] DAMAGECOUNT value on done: 794326.0 [2024-08-06 07:23:30,451][52795] Sum rewards: 73.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.989', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.052', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO4': '0.180', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '59.000'} [2024-08-06 07:23:31,830][52664] DAMAGECOUNT value on done: 893303.0 [2024-08-06 07:23:31,830][52664] Sum rewards: 78.200, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.525', 'AMMO5': '0.004', 'weapon4': '0.012', 'weapon5': '0.016', 'AMMO2': '0.031', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.245', 'weapon2': '0.522', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:32,032][52662] DAMAGECOUNT value on done: 869882.0 [2024-08-06 07:23:32,032][52662] Sum rewards: 60.884, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.915', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon7': '0.084', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.167', 'WEAPON7': '0.200', 'AMMO4': '0.200', 'weapon5': '0.216', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.450', 'HITCOUNT': '2.710', 'DAMAGECOUNT': '15.195', 'FRAGCOUNT': '49.000'} [2024-08-06 07:23:32,311][52803] DAMAGECOUNT value on done: 802389.0 [2024-08-06 07:23:32,312][52803] Sum rewards: 78.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'AMMO3': '0.221', 'weapon2': '0.692', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:32,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 623616000. Throughput: 0: 4384.9. Samples: 155905200. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:32,795][52567] Avg episode reward: [(0, '74.322')] [2024-08-06 07:23:33,100][52647] DAMAGECOUNT value on done: 889966.0 [2024-08-06 07:23:33,101][52647] Sum rewards: 96.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.497', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.102', 'weapon5': '0.162', 'AMMO3': '0.198', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '79.000'} [2024-08-06 07:23:33,134][52820] DAMAGECOUNT value on done: 794834.0 [2024-08-06 07:23:33,134][52820] Sum rewards: 68.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.011', 'weapon4': '0.044', 'AMMO2': '0.046', 'AMMO3': '0.221', 'weapon5': '0.230', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.216', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '58.000'} [2024-08-06 07:23:33,146][52668] DAMAGECOUNT value on done: 847500.0 [2024-08-06 07:23:33,146][52668] Sum rewards: 76.574, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.720', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:33,374][52667] DAMAGECOUNT value on done: 864770.0 [2024-08-06 07:23:33,375][52667] Sum rewards: 72.275, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.960', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.056', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.274', 'weapon2': '0.338', 'WEAPON3': '1.650', 'weapon3': '3.326', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '65.000'} [2024-08-06 07:23:33,615][52795] DAMAGECOUNT value on done: 790463.0 [2024-08-06 07:23:33,619][52795] Sum rewards: 81.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.213', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.334', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '65.000'} [2024-08-06 07:23:34,435][52664] DAMAGECOUNT value on done: 890889.0 [2024-08-06 07:23:34,437][52664] Sum rewards: 68.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO4': '0.067', 'AMMO3': '0.179', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '56.000'} [2024-08-06 07:23:34,772][52662] DAMAGECOUNT value on done: 855720.0 [2024-08-06 07:23:34,774][52662] Sum rewards: 59.749, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.673', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon4': '0.146', 'AMMO3': '0.256', 'weapon2': '0.546', 'WEAPON3': '1.550', 'weapon3': '2.970', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '53.000'} [2024-08-06 07:23:35,062][52650] Updated weights for policy 0, policy_version 76131 (0.0019) [2024-08-06 07:23:35,539][52803] DAMAGECOUNT value on done: 805068.0 [2024-08-06 07:23:35,543][52803] Sum rewards: 86.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.086', 'AMMO4': '0.120', 'weapon5': '0.126', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '69.000'} [2024-08-06 07:23:35,793][52668] DAMAGECOUNT value on done: 844062.0 [2024-08-06 07:23:35,793][52668] Sum rewards: 71.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.404', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.084', 'AMMO4': '0.162', 'weapon5': '0.188', 'AMMO3': '0.265', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.650', 'weapon3': '3.074', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:35,820][52647] DAMAGECOUNT value on done: 890722.0 [2024-08-06 07:23:35,820][52647] Sum rewards: 69.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.324', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.188', 'weapon2': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:36,452][52667] DAMAGECOUNT value on done: 861187.0 [2024-08-06 07:23:36,453][52667] Sum rewards: 81.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.609', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.098', 'weapon5': '0.126', 'AMMO4': '0.188', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:36,546][52820] DAMAGECOUNT value on done: 797545.0 [2024-08-06 07:23:36,546][52820] Sum rewards: 77.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.980', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.151', 'weapon5': '0.224', 'AMMO3': '0.242', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:36,884][52795] DAMAGECOUNT value on done: 783968.0 [2024-08-06 07:23:36,885][52795] Sum rewards: 70.248, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.305', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.138', 'weapon4': '0.146', 'AMMO4': '0.208', 'AMMO3': '0.270', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:37,035][52664] DAMAGECOUNT value on done: 902777.0 [2024-08-06 07:23:37,036][52664] Sum rewards: 65.700, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.188', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.048', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '53.000'} [2024-08-06 07:23:37,484][52662] DAMAGECOUNT value on done: 862892.0 [2024-08-06 07:23:37,484][52662] Sum rewards: 70.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.531', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.088', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.208', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:37,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17613.2, 300 sec: 17467.0). Total num frames: 623706112. Throughput: 0: 4372.0. Samples: 155931070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:37,795][52567] Avg episode reward: [(0, '74.188')] [2024-08-06 07:23:38,656][52803] DAMAGECOUNT value on done: 802905.0 [2024-08-06 07:23:38,657][52803] Sum rewards: 76.981, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.673', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.084', 'AMMO4': '0.086', 'weapon4': '0.094', 'WEAPON5': '0.100', 'weapon2': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'WEAPON3': '1.350', 'weapon3': '3.430', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:39,063][52668] DAMAGECOUNT value on done: 843214.0 [2024-08-06 07:23:39,065][52668] Sum rewards: 70.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.945', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.036', 'AMMO4': '0.049', 'WEAPON5': '0.100', 'weapon4': '0.132', 'WEAPON4': '0.150', 'weapon2': '0.160', 'AMMO3': '0.228', 'WEAPON3': '1.450', 'weapon3': '3.498', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '59.000'} [2024-08-06 07:23:39,358][52667] DAMAGECOUNT value on done: 867249.0 [2024-08-06 07:23:39,361][52667] Sum rewards: 67.738, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.052', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:39,545][52820] DAMAGECOUNT value on done: 794969.0 [2024-08-06 07:23:39,548][52820] Sum rewards: 73.797, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.715', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.220', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:39,656][52650] Updated weights for policy 0, policy_version 76141 (0.0011) [2024-08-06 07:23:40,032][52795] DAMAGECOUNT value on done: 786782.0 [2024-08-06 07:23:40,032][52795] Sum rewards: 74.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.674', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.466', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:40,135][52664] DAMAGECOUNT value on done: 899360.0 [2024-08-06 07:23:40,136][52664] Sum rewards: 81.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.257', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.090', 'weapon5': '0.130', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:40,396][52662] DAMAGECOUNT value on done: 852865.0 [2024-08-06 07:23:40,397][52662] Sum rewards: 73.799, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.322', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.124', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:41,835][52803] DAMAGECOUNT value on done: 800666.0 [2024-08-06 07:23:41,835][52803] Sum rewards: 82.074, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.720', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.146', 'weapon5': '0.168', 'weapon2': '0.222', 'AMMO3': '0.260', 'AMMO4': '0.262', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.136', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.912', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:41,844][52668] DAMAGECOUNT value on done: 840079.0 [2024-08-06 07:23:41,845][52668] Sum rewards: 87.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.642', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.124', 'weapon5': '0.164', 'AMMO4': '0.190', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '2.902', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.925', 'FRAGCOUNT': '72.000'} [2024-08-06 07:23:42,268][52667] DAMAGECOUNT value on done: 867565.0 [2024-08-06 07:23:42,268][52667] Sum rewards: 82.090, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '68.000'} [2024-08-06 07:23:42,595][52820] DAMAGECOUNT value on done: 794272.0 [2024-08-06 07:23:42,596][52820] Sum rewards: 65.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.122', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.250', 'weapon3': '3.340', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:42,750][52664] DAMAGECOUNT value on done: 897621.0 [2024-08-06 07:23:42,751][52664] Sum rewards: 84.755, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.112', 'AMMO3': '0.192', 'AMMO4': '0.246', 'weapon4': '0.252', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '69.000'} [2024-08-06 07:23:42,794][52567] Fps is (10 sec: 18842.2, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 623804416. Throughput: 0: 4373.6. Samples: 155957640. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:42,794][52567] Avg episode reward: [(0, '74.303')] [2024-08-06 07:23:43,166][52795] DAMAGECOUNT value on done: 796512.0 [2024-08-06 07:23:43,169][52795] Sum rewards: 75.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.110', 'weapon4': '0.112', 'AMMO4': '0.123', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.494', 'WEAPON3': '1.600', 'weapon3': '3.020', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '65.000'} [2024-08-06 07:23:43,701][52662] DAMAGECOUNT value on done: 855114.0 [2024-08-06 07:23:43,704][52662] Sum rewards: 72.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.371', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.178', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:44,236][52650] Updated weights for policy 0, policy_version 76151 (0.0033) [2024-08-06 07:23:44,599][52668] DAMAGECOUNT value on done: 853304.0 [2024-08-06 07:23:44,601][52668] Sum rewards: 83.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.219', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.088', 'weapon5': '0.176', 'AMMO4': '0.183', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '69.000'} [2024-08-06 07:23:44,716][52667] DAMAGECOUNT value on done: 866764.0 [2024-08-06 07:23:44,717][52667] Sum rewards: 83.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.298', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.102', 'weapon5': '0.110', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '70.000'} [2024-08-06 07:23:45,158][52664] DAMAGECOUNT value on done: 881651.0 [2024-08-06 07:23:45,160][52664] Sum rewards: 51.374, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.065', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.232', 'weapon2': '0.248', 'weapon4': '0.266', 'weapon5': '0.294', 'AMMO4': '0.311', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'HITCOUNT': '2.660', 'weapon3': '2.880', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '45.000'} [2024-08-06 07:23:45,727][52820] DAMAGECOUNT value on done: 802903.0 [2024-08-06 07:23:45,730][52820] Sum rewards: 67.188, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.328', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO3': '0.193', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.766', 'WEAPON3': '1.100', 'weapon3': '2.820', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.826', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:46,327][52795] DAMAGECOUNT value on done: 782691.0 [2024-08-06 07:23:46,328][52795] Sum rewards: 86.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.780', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.176', 'weapon2': '0.194', 'AMMO4': '0.198', 'AMMO3': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.604', 'FRAGCOUNT': '70.000'} [2024-08-06 07:23:46,815][52662] DAMAGECOUNT value on done: 848207.0 [2024-08-06 07:23:46,826][52662] Sum rewards: 77.335, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.889', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.072', 'AMMO3': '0.186', 'AMMO4': '0.222', 'weapon5': '0.258', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:47,381][52660] DAMAGECOUNT value on done: 851236.0 [2024-08-06 07:23:47,392][52660] Sum rewards: 66.399, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.169', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon5': '0.208', 'weapon2': '0.226', 'AMMO3': '0.233', 'weapon4': '0.274', 'AMMO4': '0.343', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '3.000', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '59.000'} [2024-08-06 07:23:47,536][52667] DAMAGECOUNT value on done: 861392.0 [2024-08-06 07:23:47,536][52667] Sum rewards: 75.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.790', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.225', 'weapon4': '0.234', 'weapon2': '0.244', 'AMMO4': '0.254', 'weapon5': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:47,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 623886336. Throughput: 0: 4376.0. Samples: 155970770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 07:23:47,795][52567] Avg episode reward: [(0, '74.557')] [2024-08-06 07:23:47,949][52668] DAMAGECOUNT value on done: 857059.0 [2024-08-06 07:23:47,950][52668] Sum rewards: 78.468, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.127', 'weapon2': '0.318', 'weapon4': '0.322', 'HEALTH': '0.385', 'WEAPON3': '0.750', 'weapon3': '3.050', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '59.000'} [2024-08-06 07:23:47,998][52664] DAMAGECOUNT value on done: 888005.0 [2024-08-06 07:23:47,999][52664] Sum rewards: 69.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.236', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.072', 'weapon5': '0.190', 'AMMO3': '0.217', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:48,049][52662] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:23:48,976][52650] Updated weights for policy 0, policy_version 76161 (0.0019) [2024-08-06 07:23:49,038][52820] DAMAGECOUNT value on done: 801315.0 [2024-08-06 07:23:49,040][52820] Sum rewards: 65.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.094', 'weapon2': '0.168', 'weapon5': '0.184', 'AMMO3': '0.221', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.060', 'weapon3': '3.348', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:49,546][52795] DAMAGECOUNT value on done: 795299.0 [2024-08-06 07:23:49,548][52795] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.770', 'AMMO5': '0.025', 'AMMO2': '0.056', 'weapon4': '0.164', 'weapon5': '0.266', 'AMMO3': '0.268', 'AMMO4': '0.278', 'weapon2': '0.376', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.830', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '56.000'} [2024-08-06 07:23:49,982][52662] DAMAGECOUNT value on done: 859416.0 [2024-08-06 07:23:49,983][52662] Sum rewards: 58.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.845', 'AMMO5': '0.008', 'AMMO2': '0.034', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.160', 'weapon5': '0.166', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.402', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.424', 'HITCOUNT': '2.530', 'DAMAGECOUNT': '13.551', 'FRAGCOUNT': '48.000'} [2024-08-06 07:23:50,014][52667] DAMAGECOUNT value on done: 857894.0 [2024-08-06 07:23:50,016][52667] Sum rewards: 78.087, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.680', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.162', 'weapon5': '0.234', 'AMMO4': '0.242', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.620', 'WEAPON3': '0.950', 'weapon3': '2.574', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '61.000'} [2024-08-06 07:23:50,289][52660] DAMAGECOUNT value on done: 844446.0 [2024-08-06 07:23:50,289][52660] Sum rewards: 77.827, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.807', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.110', 'weapon5': '0.166', 'AMMO3': '0.172', 'AMMO4': '0.177', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:50,658][52668] DAMAGECOUNT value on done: 854055.0 [2024-08-06 07:23:50,660][52668] Sum rewards: 68.433, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.072', 'AMMO3': '0.180', 'weapon2': '0.324', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.488', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:50,907][52664] DAMAGECOUNT value on done: 890757.0 [2024-08-06 07:23:50,908][52664] Sum rewards: 81.405, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.066', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon2': '0.138', 'weapon5': '0.138', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '1.100', 'weapon3': '3.164', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '64.000'} [2024-08-06 07:23:52,155][52820] DAMAGECOUNT value on done: 784029.0 [2024-08-06 07:23:52,155][52820] Sum rewards: 75.993, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.078', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:52,711][52795] DAMAGECOUNT value on done: 791859.0 [2024-08-06 07:23:52,718][52795] Sum rewards: 65.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.092', 'weapon5': '0.174', 'AMMO4': '0.212', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '56.000'} [2024-08-06 07:23:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 623976448. Throughput: 0: 4377.7. Samples: 155997120. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:23:52,794][52567] Avg episode reward: [(0, '74.125')] [2024-08-06 07:23:52,801][52667] DAMAGECOUNT value on done: 859986.0 [2024-08-06 07:23:52,805][52667] Sum rewards: 78.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.110', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.088', 'AMMO4': '0.135', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '63.500'} [2024-08-06 07:23:53,032][52660] DAMAGECOUNT value on done: 855933.0 [2024-08-06 07:23:53,038][52660] Sum rewards: 66.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.648', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.144', 'AMMO3': '0.227', 'weapon5': '0.254', 'weapon2': '0.310', 'AMMO4': '0.315', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:53,052][52662] DAMAGECOUNT value on done: 848597.0 [2024-08-06 07:23:53,054][52662] Sum rewards: 64.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.992', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.156', 'weapon5': '0.194', 'AMMO4': '0.242', 'AMMO3': '0.256', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:53,342][52664] DAMAGECOUNT value on done: 882169.0 [2024-08-06 07:23:53,342][52664] Sum rewards: 77.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.098', 'weapon5': '0.146', 'AMMO4': '0.185', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '63.500'} [2024-08-06 07:23:53,412][52668] DAMAGECOUNT value on done: 859347.0 [2024-08-06 07:23:53,413][52668] Sum rewards: 64.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.920', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.048', 'weapon5': '0.054', 'AMMO4': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.316', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.316', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '55.000'} [2024-08-06 07:23:53,650][52650] Updated weights for policy 0, policy_version 76171 (0.0010) [2024-08-06 07:23:55,417][52660] DAMAGECOUNT value on done: 867988.0 [2024-08-06 07:23:55,420][52660] Sum rewards: 83.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.468', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.044', 'AMMO4': '0.103', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '2.996', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '70.000'} [2024-08-06 07:23:55,806][52667] DAMAGECOUNT value on done: 865837.0 [2024-08-06 07:23:55,806][52667] Sum rewards: 76.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.450', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.227', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '62.000'} [2024-08-06 07:23:55,831][52668] DAMAGECOUNT value on done: 858799.0 [2024-08-06 07:23:55,831][52668] Sum rewards: 63.435, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.490', 'AMMO5': '0.012', 'weapon5': '0.040', 'AMMO2': '0.044', 'weapon4': '0.054', 'AMMO4': '0.220', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.426', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '57.000'} [2024-08-06 07:23:55,837][52795] DAMAGECOUNT value on done: 781084.0 [2024-08-06 07:23:55,837][52795] Sum rewards: 73.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.757', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.134', 'AMMO3': '0.188', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '60.000'} [2024-08-06 07:23:55,882][52662] DAMAGECOUNT value on done: 867150.0 [2024-08-06 07:23:55,884][52662] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.095', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.038', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.458', 'WEAPON3': '1.550', 'weapon3': '3.272', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '66.000'} [2024-08-06 07:23:56,774][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:23:57,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 624058368. Throughput: 0: 4381.1. Samples: 156023410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:23:57,794][52567] Avg episode reward: [(0, '73.844')] [2024-08-06 07:23:58,373][52660] DAMAGECOUNT value on done: 849098.0 [2024-08-06 07:23:58,373][52660] Sum rewards: 71.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.048', 'AMMO4': '0.061', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.360', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '58.000'} [2024-08-06 07:23:58,694][52650] Updated weights for policy 0, policy_version 76181 (0.0012) [2024-08-06 07:23:58,847][52667] DAMAGECOUNT value on done: 853496.0 [2024-08-06 07:23:58,847][52667] Sum rewards: 78.586, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.961', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.096', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '63.000'} [2024-08-06 07:23:58,926][52795] DAMAGECOUNT value on done: 789093.0 [2024-08-06 07:23:58,927][52795] Sum rewards: 64.091, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.246', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.056', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '51.000'} [2024-08-06 07:23:59,051][52662] DAMAGECOUNT value on done: 859776.0 [2024-08-06 07:23:59,051][52662] Sum rewards: 65.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO4': '0.200', 'weapon4': '0.222', 'AMMO3': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '54.000'} [2024-08-06 07:23:59,670][52659] DAMAGECOUNT value on done: 858002.0 [2024-08-06 07:23:59,671][52659] Sum rewards: 75.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.158', 'AMMO4': '0.171', 'weapon2': '0.208', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '64.000'} [2024-08-06 07:24:01,141][52660] DAMAGECOUNT value on done: 847468.0 [2024-08-06 07:24:01,143][52660] Sum rewards: 81.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.091', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.332', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '67.000'} [2024-08-06 07:24:01,660][52667] DAMAGECOUNT value on done: 857379.0 [2024-08-06 07:24:01,660][52667] Sum rewards: 72.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.383', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.120', 'weapon5': '0.140', 'AMMO3': '0.186', 'AMMO4': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:01,674][52662] DAMAGECOUNT value on done: 844454.0 [2024-08-06 07:24:01,675][52662] Sum rewards: 77.468, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.842', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.136', 'AMMO3': '0.155', 'weapon2': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON3': '0.950', 'weapon3': '3.162', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:02,099][52795] DAMAGECOUNT value on done: 796188.0 [2024-08-06 07:24:02,100][52795] Sum rewards: 55.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.416', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.125', 'weapon4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.540', 'FRAGCOUNT': '46.000'} [2024-08-06 07:24:02,617][52659] DAMAGECOUNT value on done: 854470.0 [2024-08-06 07:24:02,617][52659] Sum rewards: 88.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.224', 'weapon2': '0.436', 'WEAPON3': '1.400', 'weapon3': '3.400', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '74.000'} [2024-08-06 07:24:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 624148480. Throughput: 0: 4377.8. Samples: 156036570. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:24:02,794][52567] Avg episode reward: [(0, '73.795')] [2024-08-06 07:24:03,110][52650] Updated weights for policy 0, policy_version 76191 (0.0018) [2024-08-06 07:24:04,260][52660] DAMAGECOUNT value on done: 854780.0 [2024-08-06 07:24:04,261][52660] Sum rewards: 75.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.194', 'AMMO3': '0.213', 'AMMO4': '0.236', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.756', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 07:24:04,576][52667] DAMAGECOUNT value on done: 866878.0 [2024-08-06 07:24:04,576][52667] Sum rewards: 76.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.115', 'weapon5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '62.000'} [2024-08-06 07:24:04,612][52662] DAMAGECOUNT value on done: 855190.0 [2024-08-06 07:24:04,613][52662] Sum rewards: 90.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon2': '0.212', 'AMMO4': '0.222', 'AMMO3': '0.229', 'weapon5': '0.268', 'weapon4': '0.424', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.810', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '74.000'} [2024-08-06 07:24:05,198][52659] DAMAGECOUNT value on done: 863612.0 [2024-08-06 07:24:05,198][52659] Sum rewards: 87.059, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.613', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.238', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.480', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.408', 'FRAGCOUNT': '72.000'} [2024-08-06 07:24:07,018][52660] DAMAGECOUNT value on done: 860919.0 [2024-08-06 07:24:07,018][52660] Sum rewards: 75.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.256', 'AMMO5': '0.011', 'AMMO2': '0.064', 'weapon4': '0.170', 'weapon5': '0.182', 'weapon2': '0.214', 'AMMO3': '0.245', 'AMMO4': '0.323', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '64.000'} [2024-08-06 07:24:07,435][52662] DAMAGECOUNT value on done: 846594.0 [2024-08-06 07:24:07,436][52662] Sum rewards: 67.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.056', 'AMMO4': '0.062', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '57.000'} [2024-08-06 07:24:07,634][52650] Updated weights for policy 0, policy_version 76201 (0.0020) [2024-08-06 07:24:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.7, 300 sec: 17494.8). Total num frames: 624238592. Throughput: 0: 4374.9. Samples: 156062830. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:24:07,794][52567] Avg episode reward: [(0, '73.844')] [2024-08-06 07:24:07,855][52667] DAMAGECOUNT value on done: 855526.0 [2024-08-06 07:24:07,859][52667] Sum rewards: 75.734, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.122', 'AMMO3': '0.161', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.272', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:08,211][52659] DAMAGECOUNT value on done: 857150.0 [2024-08-06 07:24:08,212][52659] Sum rewards: 84.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.176', 'weapon5': '0.196', 'AMMO3': '0.204', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.078', 'FRAGCOUNT': '68.000'} [2024-08-06 07:24:09,881][52660] DAMAGECOUNT value on done: 847930.0 [2024-08-06 07:24:09,882][52660] Sum rewards: 84.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.636', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO4': '0.168', 'weapon2': '0.216', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.650', 'weapon3': '3.362', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '70.000'} [2024-08-06 07:24:10,616][52659] DAMAGECOUNT value on done: 854725.0 [2024-08-06 07:24:10,617][52659] Sum rewards: 74.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO2': '0.005', 'AMMO5': '0.006', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.174', 'AMMO3': '0.222', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '63.000'} [2024-08-06 07:24:10,891][52667] DAMAGECOUNT value on done: 862721.0 [2024-08-06 07:24:10,892][52667] Sum rewards: 69.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.294', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.078', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.203', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.558', 'DAMAGECOUNT': '15.528', 'FRAGCOUNT': '59.000'} [2024-08-06 07:24:12,526][52650] Updated weights for policy 0, policy_version 76211 (0.0010) [2024-08-06 07:24:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 624328704. Throughput: 0: 4374.0. Samples: 156089070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:24:12,794][52567] Avg episode reward: [(0, '74.209')] [2024-08-06 07:24:12,949][52660] DAMAGECOUNT value on done: 845770.0 [2024-08-06 07:24:12,951][52660] Sum rewards: 71.121, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.073', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.040', 'AMMO4': '0.046', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '59.000'} [2024-08-06 07:24:13,468][52667] DAMAGECOUNT value on done: 868325.0 [2024-08-06 07:24:13,468][52667] Sum rewards: 66.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.930', 'AMMO5': '0.004', 'AMMO2': '0.006', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO4': '0.028', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon2': '0.628', 'WEAPON3': '1.100', 'weapon3': '3.222', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '53.000'} [2024-08-06 07:24:13,707][52659] DAMAGECOUNT value on done: 856123.0 [2024-08-06 07:24:13,708][52659] Sum rewards: 80.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.372', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.090', 'AMMO3': '0.232', 'AMMO4': '0.251', 'weapon5': '0.272', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '65.000'} [2024-08-06 07:24:15,965][52660] DAMAGECOUNT value on done: 856579.0 [2024-08-06 07:24:15,967][52660] Sum rewards: 55.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.275', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.164', 'AMMO4': '0.168', 'weapon4': '0.192', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.500', 'HITCOUNT': '2.800', 'weapon3': '2.942', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '48.000'} [2024-08-06 07:24:16,313][52667] DAMAGECOUNT value on done: 869019.0 [2024-08-06 07:24:16,313][52667] Sum rewards: 68.826, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.909', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.066', 'AMMO4': '0.160', 'weapon5': '0.162', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '57.000'} [2024-08-06 07:24:16,781][52650] Updated weights for policy 0, policy_version 76221 (0.0029) [2024-08-06 07:24:16,812][52659] DAMAGECOUNT value on done: 858617.0 [2024-08-06 07:24:16,812][52659] Sum rewards: 65.607, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.098', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon4': '0.204', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'weapon2': '0.474', 'WEAPON3': '1.550', 'weapon3': '2.980', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '56.500'} [2024-08-06 07:24:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 624410624. Throughput: 0: 4380.0. Samples: 156102300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:24:17,794][52567] Avg episode reward: [(0, '73.889')] [2024-08-06 07:24:18,770][52660] DAMAGECOUNT value on done: 846245.0 [2024-08-06 07:24:18,770][52660] Sum rewards: 73.051, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.045', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.082', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.362', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:19,424][52659] DAMAGECOUNT value on done: 857130.0 [2024-08-06 07:24:19,425][52659] Sum rewards: 74.472, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.731', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.187', 'weapon4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '61.000'} [2024-08-06 07:24:19,670][52667] DAMAGECOUNT value on done: 863621.0 [2024-08-06 07:24:19,672][52667] Sum rewards: 80.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.154', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.062', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.201', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '66.000'} [2024-08-06 07:24:21,546][52660] DAMAGECOUNT value on done: 849380.0 [2024-08-06 07:24:21,548][52660] Sum rewards: 63.241, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.896', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon4': '0.090', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.372', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '54.000'} [2024-08-06 07:24:21,807][52650] Updated weights for policy 0, policy_version 76231 (0.0031) [2024-08-06 07:24:22,263][52659] DAMAGECOUNT value on done: 856982.0 [2024-08-06 07:24:22,265][52659] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.750', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO4': '0.232', 'weapon5': '0.238', 'AMMO3': '0.253', 'weapon2': '0.306', 'weapon4': '0.350', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '59.000'} [2024-08-06 07:24:22,467][52667] DAMAGECOUNT value on done: 861873.0 [2024-08-06 07:24:22,467][52667] Sum rewards: 77.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '64.000'} [2024-08-06 07:24:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 624500736. Throughput: 0: 4385.3. Samples: 156128410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:24:22,794][52567] Avg episode reward: [(0, '73.836')] [2024-08-06 07:24:24,612][52660] DAMAGECOUNT value on done: 860729.0 [2024-08-06 07:24:24,612][52660] Sum rewards: 59.641, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.940', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.098', 'weapon5': '0.120', 'AMMO3': '0.154', 'AMMO4': '0.164', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.776', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '14.733', 'FRAGCOUNT': '46.000'} [2024-08-06 07:24:25,124][52659] DAMAGECOUNT value on done: 866189.0 [2024-08-06 07:24:25,125][52659] Sum rewards: 86.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.144', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.090', 'weapon4': '0.198', 'AMMO3': '0.228', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '70.000'} [2024-08-06 07:24:25,136][52667] DAMAGECOUNT value on done: 865919.0 [2024-08-06 07:24:25,137][52667] Sum rewards: 63.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.905', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.055', 'weapon4': '0.100', 'weapon5': '0.248', 'AMMO3': '0.251', 'AMMO4': '0.273', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.880', 'weapon3': '3.010', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '55.000'} [2024-08-06 07:24:26,748][52650] Updated weights for policy 0, policy_version 76241 (0.0018) [2024-08-06 07:24:27,492][52660] DAMAGECOUNT value on done: 873429.0 [2024-08-06 07:24:27,495][52660] Sum rewards: 75.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.148', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon4': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.000'} [2024-08-06 07:24:27,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17522.6). Total num frames: 624590848. Throughput: 0: 4379.8. Samples: 156154730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:24:27,795][52567] Avg episode reward: [(0, '73.700')] [2024-08-06 07:24:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000076244_624590848.pth... [2024-08-06 07:24:27,971][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075731_620388352.pth [2024-08-06 07:24:28,402][52659] DAMAGECOUNT value on done: 849852.0 [2024-08-06 07:24:28,404][52659] Sum rewards: 76.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.215', 'weapon2': '0.222', 'WEAPON3': '1.300', 'weapon3': '3.628', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '63.000'} [2024-08-06 07:24:30,760][52660] DAMAGECOUNT value on done: 850079.0 [2024-08-06 07:24:30,762][52660] Sum rewards: 69.219, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.076', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.384', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.376', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '56.000'} [2024-08-06 07:24:31,267][52650] Updated weights for policy 0, policy_version 76251 (0.0015) [2024-08-06 07:24:31,569][52659] DAMAGECOUNT value on done: 862125.0 [2024-08-06 07:24:31,573][52659] Sum rewards: 80.760, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.952', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.145', 'weapon5': '0.160', 'weapon2': '0.218', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.328', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '69.000'} [2024-08-06 07:24:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 624664576. Throughput: 0: 4366.5. Samples: 156167260. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:24:32,795][52567] Avg episode reward: [(0, '73.712')] [2024-08-06 07:24:32,970][52660] DAMAGECOUNT value on done: 858088.0 [2024-08-06 07:24:32,973][52660] Sum rewards: 71.738, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.658', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.176', 'AMMO3': '0.239', 'weapon5': '0.270', 'AMMO4': '0.279', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:33,346][52614] Signal inference workers to stop experience collection... (13950 times) [2024-08-06 07:24:33,366][52614] Signal inference workers to resume experience collection... (13950 times) [2024-08-06 07:24:33,431][52650] InferenceWorker_p0-w0: stopping experience collection (13950 times) [2024-08-06 07:24:33,431][52650] InferenceWorker_p0-w0: resuming experience collection (13950 times) [2024-08-06 07:24:34,582][52659] DAMAGECOUNT value on done: 854336.0 [2024-08-06 07:24:34,582][52659] Sum rewards: 65.673, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.085', 'AMMO5': '0.012', 'AMMO2': '0.057', 'AMMO3': '0.167', 'weapon5': '0.200', 'AMMO4': '0.286', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '54.000'} [2024-08-06 07:24:35,920][52660] DAMAGECOUNT value on done: 853606.0 [2024-08-06 07:24:35,928][52660] Sum rewards: 73.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.100', 'weapon5': '0.174', 'AMMO4': '0.194', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '61.000'} [2024-08-06 07:24:36,068][52650] Updated weights for policy 0, policy_version 76261 (0.0012) [2024-08-06 07:24:37,302][52659] DAMAGECOUNT value on done: 854393.0 [2024-08-06 07:24:37,304][52659] Sum rewards: 70.505, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO4': '0.144', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.100', 'weapon3': '3.120', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '57.000'} [2024-08-06 07:24:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 624762880. Throughput: 0: 4368.0. Samples: 156193680. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:24:37,794][52567] Avg episode reward: [(0, '73.485')] [2024-08-06 07:24:37,882][52658] DAMAGECOUNT value on done: 858100.0 [2024-08-06 07:24:37,883][52658] Sum rewards: 78.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.670', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.092', 'weapon5': '0.130', 'AMMO4': '0.132', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '62.000'} [2024-08-06 07:24:38,712][52660] DAMAGECOUNT value on done: 846471.0 [2024-08-06 07:24:38,712][52660] Sum rewards: 75.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.158', 'AMMO3': '0.194', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '60.500'} [2024-08-06 07:24:40,307][52659] DAMAGECOUNT value on done: 859953.0 [2024-08-06 07:24:40,307][52659] Sum rewards: 82.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.144', 'weapon4': '0.220', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '68.000'} [2024-08-06 07:24:40,552][52650] Updated weights for policy 0, policy_version 76271 (0.0011) [2024-08-06 07:24:40,689][52658] DAMAGECOUNT value on done: 861747.0 [2024-08-06 07:24:40,690][52658] Sum rewards: 79.628, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.665', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.304', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '68.000'} [2024-08-06 07:24:41,267][52660] DAMAGECOUNT value on done: 844278.0 [2024-08-06 07:24:41,275][52660] Sum rewards: 69.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.048', 'AMMO4': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.474', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '61.000'} [2024-08-06 07:24:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 624852992. Throughput: 0: 4372.9. Samples: 156220190. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:24:42,794][52567] Avg episode reward: [(0, '73.761')] [2024-08-06 07:24:43,078][52659] DAMAGECOUNT value on done: 857736.0 [2024-08-06 07:24:43,079][52659] Sum rewards: 68.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.480', 'AMMO5': '0.009', 'weapon5': '0.026', 'AMMO2': '0.044', 'weapon4': '0.078', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '59.500'} [2024-08-06 07:24:43,746][52658] DAMAGECOUNT value on done: 863277.0 [2024-08-06 07:24:43,746][52658] Sum rewards: 75.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.931', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.080', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:44,178][52794] DAMAGECOUNT value on done: 851454.0 [2024-08-06 07:24:44,179][52794] Sum rewards: 63.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.842', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.146', 'weapon5': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '53.000'} [2024-08-06 07:24:44,962][52650] Updated weights for policy 0, policy_version 76281 (0.0012) [2024-08-06 07:24:45,994][52659] DAMAGECOUNT value on done: 867352.0 [2024-08-06 07:24:45,996][52659] Sum rewards: 78.330, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.224', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.122', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '63.000'} [2024-08-06 07:24:46,635][52658] DAMAGECOUNT value on done: 859800.0 [2024-08-06 07:24:46,637][52658] Sum rewards: 65.909, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.129', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '54.000'} [2024-08-06 07:24:47,517][52794] DAMAGECOUNT value on done: 861342.0 [2024-08-06 07:24:47,518][52794] Sum rewards: 84.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.135', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon2': '0.226', 'AMMO3': '0.283', 'WEAPON3': '1.800', 'weapon3': '3.504', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '72.000'} [2024-08-06 07:24:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 624934912. Throughput: 0: 4367.3. Samples: 156233100. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:24:47,797][52567] Avg episode reward: [(0, '73.569')] [2024-08-06 07:24:48,931][52659] DAMAGECOUNT value on done: 851275.0 [2024-08-06 07:24:48,932][52659] Sum rewards: 60.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.957', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon4': '0.164', 'weapon2': '0.190', 'weapon5': '0.198', 'AMMO3': '0.246', 'AMMO4': '0.285', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'HITCOUNT': '2.930', 'weapon3': '3.136', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '51.000'} [2024-08-06 07:24:49,475][52658] DAMAGECOUNT value on done: 855027.0 [2024-08-06 07:24:49,475][52658] Sum rewards: 67.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.006', 'weapon5': '0.040', 'AMMO2': '0.040', 'weapon4': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.202', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.000'} [2024-08-06 07:24:50,174][52650] Updated weights for policy 0, policy_version 76291 (0.0014) [2024-08-06 07:24:50,619][52794] DAMAGECOUNT value on done: 865589.0 [2024-08-06 07:24:50,619][52794] Sum rewards: 79.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.543', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.093', 'weapon4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '66.000'} [2024-08-06 07:24:51,902][52658] DAMAGECOUNT value on done: 849382.0 [2024-08-06 07:24:51,911][52658] Sum rewards: 75.415, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.066', 'AMMO3': '0.174', 'AMMO4': '0.185', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.760', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:52,019][52659] DAMAGECOUNT value on done: 862765.0 [2024-08-06 07:24:52,020][52659] Sum rewards: 71.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.058', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '59.000'} [2024-08-06 07:24:52,215][52647] Large shaping reward 2.609 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.021, -7.0)] [2024-08-06 07:24:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 625016832. Throughput: 0: 4357.8. Samples: 156258930. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:24:52,794][52567] Avg episode reward: [(0, '73.596')] [2024-08-06 07:24:53,512][52794] DAMAGECOUNT value on done: 854503.0 [2024-08-06 07:24:53,513][52794] Sum rewards: 88.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.026', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.488', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '71.000'} [2024-08-06 07:24:54,576][52650] Updated weights for policy 0, policy_version 76301 (0.0022) [2024-08-06 07:24:54,754][52658] DAMAGECOUNT value on done: 863058.0 [2024-08-06 07:24:54,758][52658] Sum rewards: 75.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.368', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.120', 'weapon5': '0.154', 'AMMO4': '0.250', 'AMMO3': '0.265', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.040', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '65.000'} [2024-08-06 07:24:55,020][52659] DAMAGECOUNT value on done: 855618.0 [2024-08-06 07:24:55,021][52659] Sum rewards: 72.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.007', 'WEAPON1': '0.010', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.116', 'AMMO3': '0.206', 'weapon5': '0.248', 'AMMO4': '0.280', 'weapon2': '0.332', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '61.000'} [2024-08-06 07:24:56,474][52794] DAMAGECOUNT value on done: 848699.0 [2024-08-06 07:24:56,475][52794] Sum rewards: 79.561, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.943', 'AMMO5': '0.023', 'AMMO2': '0.066', 'weapon4': '0.120', 'AMMO3': '0.255', 'weapon5': '0.300', 'weapon2': '0.302', 'AMMO4': '0.329', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '67.000'} [2024-08-06 07:24:57,298][52669] DAMAGECOUNT value on done: 860230.0 [2024-08-06 07:24:57,306][52669] Sum rewards: 81.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.555', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.100', 'weapon5': '0.166', 'AMMO3': '0.202', 'weapon2': '0.226', 'AMMO4': '0.271', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '65.000'} [2024-08-06 07:24:57,771][52658] DAMAGECOUNT value on done: 851072.0 [2024-08-06 07:24:57,772][52658] Sum rewards: 76.392, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.407', 'AMMO5': '0.028', 'AMMO2': '0.090', 'AMMO3': '0.186', 'weapon2': '0.262', 'weapon5': '0.292', 'weapon4': '0.350', 'AMMO4': '0.450', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.781', 'FRAGCOUNT': '60.000'} [2024-08-06 07:24:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 625106944. Throughput: 0: 4350.6. Samples: 156284850. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:24:57,795][52567] Avg episode reward: [(0, '73.704')] [2024-08-06 07:24:59,469][52650] Updated weights for policy 0, policy_version 76311 (0.0033) [2024-08-06 07:24:59,567][52794] DAMAGECOUNT value on done: 855852.0 [2024-08-06 07:24:59,567][52794] Sum rewards: 70.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.040', 'AMMO4': '0.154', 'weapon5': '0.158', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.214', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:00,008][52669] DAMAGECOUNT value on done: 852714.0 [2024-08-06 07:25:00,008][52669] Sum rewards: 83.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.025', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon2': '0.130', 'weapon5': '0.180', 'AMMO3': '0.191', 'AMMO4': '0.203', 'weapon4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:00,831][52658] DAMAGECOUNT value on done: 877867.0 [2024-08-06 07:25:00,831][52658] Sum rewards: 64.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.412', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '55.000'} [2024-08-06 07:25:02,715][52794] DAMAGECOUNT value on done: 861495.0 [2024-08-06 07:25:02,715][52794] Sum rewards: 70.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.940', 'AMMO5': '0.014', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.130', 'AMMO3': '0.194', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '57.500'} [2024-08-06 07:25:02,736][52669] DAMAGECOUNT value on done: 864122.0 [2024-08-06 07:25:02,737][52669] Sum rewards: 69.537, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.514', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.068', 'AMMO3': '0.142', 'weapon5': '0.156', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '0.950', 'weapon3': '3.110', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '56.000'} [2024-08-06 07:25:02,741][52663] DAMAGECOUNT value on done: 874881.0 [2024-08-06 07:25:02,742][52663] Sum rewards: 71.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.786', 'AMMO5': '0.011', 'AMMO2': '0.068', 'weapon5': '0.158', 'weapon4': '0.214', 'AMMO3': '0.232', 'weapon2': '0.312', 'AMMO4': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 625197056. Throughput: 0: 4355.6. Samples: 156298300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:25:02,794][52567] Avg episode reward: [(0, '73.397')] [2024-08-06 07:25:03,668][52658] DAMAGECOUNT value on done: 861225.0 [2024-08-06 07:25:03,668][52658] Sum rewards: 75.042, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-5.090', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.066', 'weapon4': '0.136', 'AMMO4': '0.170', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.222', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.421', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:04,150][52650] Updated weights for policy 0, policy_version 76321 (0.0015) [2024-08-06 07:25:05,557][52794] DAMAGECOUNT value on done: 848180.0 [2024-08-06 07:25:05,558][52794] Sum rewards: 70.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.212', 'weapon2': '0.480', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:05,560][52669] DAMAGECOUNT value on done: 857936.0 [2024-08-06 07:25:05,561][52669] Sum rewards: 72.553, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.086', 'AMMO4': '0.166', 'AMMO3': '0.179', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:05,617][52663] DAMAGECOUNT value on done: 859056.0 [2024-08-06 07:25:05,618][52663] Sum rewards: 74.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.354', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.098', 'AMMO4': '0.230', 'AMMO3': '0.232', 'weapon4': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:06,582][52663] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:25:06,708][52658] DAMAGECOUNT value on done: 870764.0 [2024-08-06 07:25:06,709][52658] Sum rewards: 78.596, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.645', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.156', 'weapon5': '0.206', 'AMMO3': '0.216', 'AMMO4': '0.216', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '65.000'} [2024-08-06 07:25:07,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 625278976. Throughput: 0: 4359.3. Samples: 156324580. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:25:07,794][52567] Avg episode reward: [(0, '73.318')] [2024-08-06 07:25:08,085][52669] DAMAGECOUNT value on done: 865834.0 [2024-08-06 07:25:08,085][52669] Sum rewards: 79.250, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.036', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '65.000'} [2024-08-06 07:25:08,115][52663] DAMAGECOUNT value on done: 852268.0 [2024-08-06 07:25:08,118][52663] Sum rewards: 75.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.128', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.124', 'AMMO4': '0.127', 'weapon2': '0.226', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.424', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:08,332][52794] DAMAGECOUNT value on done: 858820.0 [2024-08-06 07:25:08,334][52794] Sum rewards: 79.782, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.214', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.187', 'weapon4': '0.288', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:08,684][52650] Updated weights for policy 0, policy_version 76331 (0.0027) [2024-08-06 07:25:09,687][52658] DAMAGECOUNT value on done: 858192.0 [2024-08-06 07:25:09,691][52658] Sum rewards: 61.055, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.189', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.176', 'weapon2': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.520', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '50.000'} [2024-08-06 07:25:09,751][52649] DAMAGECOUNT value on done: 830593.0 [2024-08-06 07:25:09,752][52649] Sum rewards: 61.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.162', 'AMMO4': '0.177', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.092', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '53.000'} [2024-08-06 07:25:10,762][52669] DAMAGECOUNT value on done: 861058.0 [2024-08-06 07:25:10,764][52669] Sum rewards: 71.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.245', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.152', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'weapon4': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '57.500'} [2024-08-06 07:25:10,803][52663] DAMAGECOUNT value on done: 857459.0 [2024-08-06 07:25:10,804][52663] Sum rewards: 87.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.603', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.490', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.276', 'FRAGCOUNT': '69.000'} [2024-08-06 07:25:11,059][52671] DAMAGECOUNT value on done: 864233.0 [2024-08-06 07:25:11,059][52671] Sum rewards: 74.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.114', 'AMMO4': '0.174', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:11,361][52794] DAMAGECOUNT value on done: 854006.0 [2024-08-06 07:25:11,363][52794] Sum rewards: 76.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.918', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.113', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '64.000'} [2024-08-06 07:25:12,106][52649] DAMAGECOUNT value on done: 825654.0 [2024-08-06 07:25:12,106][52649] Sum rewards: 66.157, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.631', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'weapon5': '0.114', 'weapon4': '0.138', 'AMMO3': '0.163', 'AMMO4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '0.950', 'weapon3': '3.044', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '53.000'} [2024-08-06 07:25:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 625369088. Throughput: 0: 4354.7. Samples: 156350690. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:25:12,794][52567] Avg episode reward: [(0, '73.621')] [2024-08-06 07:25:13,126][52658] DAMAGECOUNT value on done: 867714.0 [2024-08-06 07:25:13,128][52658] Sum rewards: 67.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.055', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.086', 'weapon4': '0.164', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.550', 'weapon3': '3.320', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:13,580][52650] Updated weights for policy 0, policy_version 76341 (0.0024) [2024-08-06 07:25:13,664][52669] DAMAGECOUNT value on done: 861929.0 [2024-08-06 07:25:13,665][52669] Sum rewards: 82.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.412', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.128', 'weapon5': '0.172', 'AMMO3': '0.199', 'AMMO4': '0.210', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:13,694][52663] DAMAGECOUNT value on done: 859212.0 [2024-08-06 07:25:13,695][52663] Sum rewards: 70.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.325', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.171', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.328', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '57.000'} [2024-08-06 07:25:14,113][52671] DAMAGECOUNT value on done: 869410.0 [2024-08-06 07:25:14,113][52671] Sum rewards: 64.527, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.326', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '55.500'} [2024-08-06 07:25:14,613][52794] DAMAGECOUNT value on done: 846547.0 [2024-08-06 07:25:14,613][52794] Sum rewards: 71.611, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.129', 'weapon2': '0.444', 'WEAPON3': '0.850', 'HITCOUNT': '3.200', 'weapon3': '3.282', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '56.000'} [2024-08-06 07:25:14,778][52811] DAMAGECOUNT value on done: 816323.0 [2024-08-06 07:25:14,780][52811] Sum rewards: 80.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.140', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:14,939][52649] DAMAGECOUNT value on done: 842393.0 [2024-08-06 07:25:14,941][52649] Sum rewards: 70.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.116', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:15,994][52658] DAMAGECOUNT value on done: 857614.0 [2024-08-06 07:25:15,994][52658] Sum rewards: 76.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.430', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.112', 'AMMO4': '0.154', 'AMMO3': '0.159', 'weapon4': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.000', 'weapon3': '3.132', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:16,594][52671] DAMAGECOUNT value on done: 865192.0 [2024-08-06 07:25:16,598][52671] Sum rewards: 67.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.088', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.220', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 07:25:16,679][52669] DAMAGECOUNT value on done: 860700.0 [2024-08-06 07:25:16,680][52669] Sum rewards: 64.417, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.099', 'weapon5': '0.116', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.314', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '53.000'} [2024-08-06 07:25:16,759][52663] DAMAGECOUNT value on done: 864471.0 [2024-08-06 07:25:16,759][52663] Sum rewards: 73.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.112', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.120', 'weapon4': '0.176', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:17,225][52794] DAMAGECOUNT value on done: 860587.0 [2024-08-06 07:25:17,226][52794] Sum rewards: 76.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.995', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon5': '0.058', 'weapon4': '0.078', 'AMMO4': '0.167', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.852', 'WEAPON3': '1.350', 'weapon3': '2.788', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 625459200. Throughput: 0: 4370.0. Samples: 156363910. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 07:25:17,794][52567] Avg episode reward: [(0, '73.448')] [2024-08-06 07:25:17,956][52811] DAMAGECOUNT value on done: 800378.0 [2024-08-06 07:25:17,956][52811] Sum rewards: 79.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.251', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:18,070][52649] DAMAGECOUNT value on done: 837742.0 [2024-08-06 07:25:18,072][52649] Sum rewards: 73.424, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.104', 'AMMO3': '0.191', 'weapon5': '0.196', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:18,161][52650] Updated weights for policy 0, policy_version 76351 (0.0013) [2024-08-06 07:25:19,120][52658] DAMAGECOUNT value on done: 864198.0 [2024-08-06 07:25:19,120][52658] Sum rewards: 79.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.058', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.072', 'weapon5': '0.204', 'AMMO3': '0.244', 'AMMO4': '0.281', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '65.000'} [2024-08-06 07:25:19,216][52669] DAMAGECOUNT value on done: 871429.0 [2024-08-06 07:25:19,218][52669] Sum rewards: 77.324, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.975', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.094', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.498', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '65.000'} [2024-08-06 07:25:19,299][52663] DAMAGECOUNT value on done: 854888.0 [2024-08-06 07:25:19,301][52663] Sum rewards: 81.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.187', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.056', 'WEAPON5': '0.200', 'AMMO4': '0.210', 'AMMO3': '0.263', 'weapon4': '0.266', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.142', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '69.000'} [2024-08-06 07:25:19,611][52794] DAMAGECOUNT value on done: 855147.0 [2024-08-06 07:25:19,612][52794] Sum rewards: 74.944, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.102', 'weapon4': '0.146', 'AMMO4': '0.151', 'weapon2': '0.192', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.344', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:19,850][52671] DAMAGECOUNT value on done: 865928.0 [2024-08-06 07:25:19,851][52671] Sum rewards: 78.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.915', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.113', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '64.000'} [2024-08-06 07:25:21,069][52811] DAMAGECOUNT value on done: 793716.0 [2024-08-06 07:25:21,070][52811] Sum rewards: 73.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.738', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.140', 'AMMO4': '0.192', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:21,318][52649] DAMAGECOUNT value on done: 830335.0 [2024-08-06 07:25:21,320][52649] Sum rewards: 62.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.460', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.027', 'weapon5': '0.090', 'WEAPON4': '0.150', 'weapon4': '0.152', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '52.000'} [2024-08-06 07:25:22,087][52669] DAMAGECOUNT value on done: 860674.0 [2024-08-06 07:25:22,087][52669] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.084', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.284', 'WEAPON3': '1.550', 'weapon3': '3.314', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:22,169][52663] DAMAGECOUNT value on done: 846937.0 [2024-08-06 07:25:22,170][52663] Sum rewards: 80.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.697', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon2': '0.158', 'AMMO3': '0.189', 'AMMO4': '0.293', 'weapon5': '0.296', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.904', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '64.000'} [2024-08-06 07:25:22,219][52658] DAMAGECOUNT value on done: 847771.0 [2024-08-06 07:25:22,223][52658] Sum rewards: 77.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.902', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.052', 'AMMO4': '0.138', 'weapon5': '0.140', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:22,457][52671] DAMAGECOUNT value on done: 871664.0 [2024-08-06 07:25:22,459][52671] Sum rewards: 75.920, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.222', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.171', 'weapon5': '0.190', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:22,768][52794] DAMAGECOUNT value on done: 869381.0 [2024-08-06 07:25:22,769][52794] Sum rewards: 58.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.027', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.058', 'weapon5': '0.158', 'AMMO4': '0.209', 'AMMO3': '0.225', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.222', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '48.000'} [2024-08-06 07:25:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 625541120. Throughput: 0: 4365.5. Samples: 156390130. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:22,795][52567] Avg episode reward: [(0, '73.879')] [2024-08-06 07:25:22,863][52650] Updated weights for policy 0, policy_version 76361 (0.0013) [2024-08-06 07:25:23,473][52665] DAMAGECOUNT value on done: 846075.0 [2024-08-06 07:25:23,475][52665] Sum rewards: 72.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.226', 'weapon2': '0.636', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:24,136][52811] DAMAGECOUNT value on done: 798109.0 [2024-08-06 07:25:24,136][52811] Sum rewards: 91.188, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.374', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.150', 'weapon5': '0.196', 'weapon2': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.464', 'WEAPON3': '0.950', 'weapon3': '2.932', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.580', 'FRAGCOUNT': '71.000'} [2024-08-06 07:25:24,455][52649] DAMAGECOUNT value on done: 841559.0 [2024-08-06 07:25:24,455][52649] Sum rewards: 68.808, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.058', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.211', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '56.000'} [2024-08-06 07:25:25,185][52669] DAMAGECOUNT value on done: 869268.0 [2024-08-06 07:25:25,185][52669] Sum rewards: 79.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.176', 'weapon4': '0.194', 'weapon2': '0.204', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:25,278][52663] DAMAGECOUNT value on done: 853211.0 [2024-08-06 07:25:25,279][52663] Sum rewards: 70.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.620', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'AMMO4': '0.105', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.262', 'WEAPON3': '1.650', 'weapon3': '3.412', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:25,281][52658] DAMAGECOUNT value on done: 865009.0 [2024-08-06 07:25:25,281][52658] Sum rewards: 71.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.441', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.038', 'AMMO4': '0.132', 'weapon5': '0.138', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:25,942][52794] DAMAGECOUNT value on done: 851466.0 [2024-08-06 07:25:25,943][52794] Sum rewards: 69.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.875', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.210', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.486', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:26,001][52671] DAMAGECOUNT value on done: 859928.0 [2024-08-06 07:25:26,004][52671] Sum rewards: 68.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.386', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.148', 'weapon2': '0.158', 'AMMO3': '0.209', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:26,284][52665] DAMAGECOUNT value on done: 861400.0 [2024-08-06 07:25:26,286][52665] Sum rewards: 69.376, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.818', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'HITCOUNT': '3.320', 'weapon3': '3.368', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:27,178][52811] DAMAGECOUNT value on done: 801103.0 [2024-08-06 07:25:27,179][52811] Sum rewards: 76.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:27,337][52649] DAMAGECOUNT value on done: 836937.0 [2024-08-06 07:25:27,340][52649] Sum rewards: 68.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.005', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '56.000'} [2024-08-06 07:25:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 625623040. Throughput: 0: 4361.8. Samples: 156416470. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:27,795][52567] Avg episode reward: [(0, '73.259')] [2024-08-06 07:25:27,928][52650] Updated weights for policy 0, policy_version 76371 (0.0014) [2024-08-06 07:25:28,166][52669] DAMAGECOUNT value on done: 869410.0 [2024-08-06 07:25:28,166][52669] Sum rewards: 74.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.319', 'AMMO5': '0.012', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.208', 'weapon5': '0.238', 'weapon2': '0.270', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:28,307][52663] DAMAGECOUNT value on done: 857992.0 [2024-08-06 07:25:28,309][52663] Sum rewards: 66.281, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.712', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.235', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.530', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '55.000'} [2024-08-06 07:25:28,318][52658] DAMAGECOUNT value on done: 855843.0 [2024-08-06 07:25:28,318][52658] Sum rewards: 77.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.110', 'AMMO4': '0.134', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:28,608][52671] DAMAGECOUNT value on done: 864381.0 [2024-08-06 07:25:28,609][52671] Sum rewards: 63.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.590', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.056', 'weapon5': '0.126', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'AMMO4': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.144', 'DAMAGECOUNT': '15.792', 'FRAGCOUNT': '53.000'} [2024-08-06 07:25:29,171][52794] DAMAGECOUNT value on done: 866755.0 [2024-08-06 07:25:29,174][52794] Sum rewards: 69.692, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.491', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.110', 'weapon5': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'weapon2': '0.312', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:29,454][52665] DAMAGECOUNT value on done: 850339.0 [2024-08-06 07:25:29,454][52665] Sum rewards: 68.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.200', 'weapon2': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.344', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '57.000'} [2024-08-06 07:25:30,350][52811] DAMAGECOUNT value on done: 813727.0 [2024-08-06 07:25:30,351][52811] Sum rewards: 76.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.218', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:30,488][52649] DAMAGECOUNT value on done: 840915.0 [2024-08-06 07:25:30,489][52649] Sum rewards: 74.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:30,944][52658] DAMAGECOUNT value on done: 852388.0 [2024-08-06 07:25:30,945][52658] Sum rewards: 69.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.453', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.130', 'weapon4': '0.176', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '57.000'} [2024-08-06 07:25:31,390][52669] DAMAGECOUNT value on done: 855303.0 [2024-08-06 07:25:31,401][52669] Sum rewards: 73.171, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.424', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO4': '0.078', 'AMMO3': '0.234', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.370', 'weapon3': '3.482', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:31,513][52663] DAMAGECOUNT value on done: 866056.0 [2024-08-06 07:25:31,514][52663] Sum rewards: 68.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.890', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.098', 'AMMO4': '0.194', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:31,643][52671] DAMAGECOUNT value on done: 866308.0 [2024-08-06 07:25:31,644][52671] Sum rewards: 80.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:32,064][52665] DAMAGECOUNT value on done: 853396.0 [2024-08-06 07:25:32,065][52665] Sum rewards: 75.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.285', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.044', 'weapon4': '0.090', 'AMMO3': '0.170', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.412', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:32,089][52650] Updated weights for policy 0, policy_version 76381 (0.0040) [2024-08-06 07:25:32,535][52794] DAMAGECOUNT value on done: 861039.0 [2024-08-06 07:25:32,535][52794] Sum rewards: 69.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.108', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 625721344. Throughput: 0: 4364.5. Samples: 156429500. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:32,794][52567] Avg episode reward: [(0, '73.456')] [2024-08-06 07:25:32,941][52649] DAMAGECOUNT value on done: 839247.0 [2024-08-06 07:25:32,942][52649] Sum rewards: 73.640, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.188', 'AMMO3': '0.199', 'weapon5': '0.206', 'weapon2': '0.242', 'AMMO4': '0.281', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:33,461][52811] DAMAGECOUNT value on done: 806959.0 [2024-08-06 07:25:33,461][52811] Sum rewards: 74.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.748', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.175', 'weapon4': '0.180', 'AMMO3': '0.194', 'weapon2': '0.208', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:33,891][52669] DAMAGECOUNT value on done: 855638.0 [2024-08-06 07:25:33,891][52669] Sum rewards: 63.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.118', 'AMMO3': '0.218', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '52.500'} [2024-08-06 07:25:33,970][52663] DAMAGECOUNT value on done: 848252.0 [2024-08-06 07:25:33,970][52663] Sum rewards: 85.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.092', 'weapon4': '0.132', 'AMMO3': '0.156', 'AMMO4': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '70.000'} [2024-08-06 07:25:34,114][52658] DAMAGECOUNT value on done: 862595.0 [2024-08-06 07:25:34,115][52658] Sum rewards: 72.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.695', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.132', 'AMMO3': '0.175', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:34,412][52671] DAMAGECOUNT value on done: 851917.0 [2024-08-06 07:25:34,412][52671] Sum rewards: 87.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.458', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '72.000'} [2024-08-06 07:25:35,069][52665] DAMAGECOUNT value on done: 836534.0 [2024-08-06 07:25:35,070][52665] Sum rewards: 72.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.462', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.136', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:35,206][52794] DAMAGECOUNT value on done: 862037.0 [2024-08-06 07:25:35,208][52794] Sum rewards: 74.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.268', 'AMMO5': '0.013', 'AMMO2': '0.054', 'AMMO3': '0.205', 'weapon5': '0.218', 'weapon4': '0.246', 'AMMO4': '0.269', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.938', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:36,090][52649] DAMAGECOUNT value on done: 833799.0 [2024-08-06 07:25:36,092][52649] Sum rewards: 82.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.945', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.120', 'AMMO4': '0.168', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.338', 'WEAPON3': '1.700', 'weapon3': '3.068', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '71.000'} [2024-08-06 07:25:36,569][52811] DAMAGECOUNT value on done: 798058.0 [2024-08-06 07:25:36,577][52811] Sum rewards: 78.461, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.832', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.112', 'AMMO4': '0.169', 'weapon5': '0.178', 'AMMO3': '0.253', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.204', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:36,834][52670] DAMAGECOUNT value on done: 844899.0 [2024-08-06 07:25:36,834][52670] Sum rewards: 61.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.534', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.124', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '51.000'} [2024-08-06 07:25:36,842][52669] DAMAGECOUNT value on done: 861582.0 [2024-08-06 07:25:36,842][52669] Sum rewards: 80.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.042', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.198', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.196', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '65.000'} [2024-08-06 07:25:36,985][52663] DAMAGECOUNT value on done: 843882.0 [2024-08-06 07:25:36,986][52663] Sum rewards: 84.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.122', 'weapon4': '0.138', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.366', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '69.000'} [2024-08-06 07:25:37,054][52671] DAMAGECOUNT value on done: 866221.0 [2024-08-06 07:25:37,056][52671] Sum rewards: 58.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.782', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.098', 'weapon5': '0.144', 'AMMO4': '0.169', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '14.694', 'FRAGCOUNT': '48.000'} [2024-08-06 07:25:37,074][52650] Updated weights for policy 0, policy_version 76391 (0.0032) [2024-08-06 07:25:37,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 625811456. Throughput: 0: 4372.4. Samples: 156455690. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:37,794][52567] Avg episode reward: [(0, '73.703')] [2024-08-06 07:25:38,214][52665] DAMAGECOUNT value on done: 840912.0 [2024-08-06 07:25:38,215][52665] Sum rewards: 60.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.060', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.094', 'weapon5': '0.110', 'AMMO3': '0.156', 'AMMO4': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.696', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '50.000'} [2024-08-06 07:25:38,429][52794] DAMAGECOUNT value on done: 869411.0 [2024-08-06 07:25:38,429][52794] Sum rewards: 76.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.635', 'AMMO5': '0.019', 'AMMO2': '0.042', 'AMMO3': '0.138', 'weapon5': '0.160', 'AMMO4': '0.211', 'weapon2': '0.418', 'WEAPON5': '0.550', 'weapon4': '0.582', 'WEAPON4': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.606', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:39,293][52649] DAMAGECOUNT value on done: 844128.0 [2024-08-06 07:25:39,294][52649] Sum rewards: 77.147, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.260', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.188', 'AMMO4': '0.194', 'weapon2': '0.306', 'AMMO3': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.054', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '69.000'} [2024-08-06 07:25:39,411][52669] DAMAGECOUNT value on done: 883904.0 [2024-08-06 07:25:39,412][52669] Sum rewards: 73.631, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.525', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.166', 'AMMO3': '0.181', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.094', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:39,479][52663] DAMAGECOUNT value on done: 852791.0 [2024-08-06 07:25:39,479][52663] Sum rewards: 66.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.174', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.138', 'weapon2': '0.188', 'weapon5': '0.200', 'AMMO3': '0.253', 'AMMO4': '0.271', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.202', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '55.000'} [2024-08-06 07:25:39,553][52670] DAMAGECOUNT value on done: 860308.0 [2024-08-06 07:25:39,553][52670] Sum rewards: 71.614, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.906', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.122', 'weapon4': '0.144', 'AMMO4': '0.188', 'AMMO3': '0.238', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.214', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:39,642][52811] DAMAGECOUNT value on done: 807473.0 [2024-08-06 07:25:39,642][52811] Sum rewards: 78.990, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.405', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.116', 'weapon5': '0.132', 'AMMO4': '0.164', 'weapon2': '0.196', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.322', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:40,072][52671] DAMAGECOUNT value on done: 863529.0 [2024-08-06 07:25:40,073][52671] Sum rewards: 72.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.939', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon2': '0.144', 'AMMO4': '0.174', 'AMMO3': '0.186', 'weapon5': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.418', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:41,230][52665] DAMAGECOUNT value on done: 846804.0 [2024-08-06 07:25:41,231][52665] Sum rewards: 78.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.391', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.235', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:41,466][52794] DAMAGECOUNT value on done: 862533.0 [2024-08-06 07:25:41,466][52794] Sum rewards: 76.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.044', 'weapon5': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:41,813][52650] Updated weights for policy 0, policy_version 76401 (0.0033) [2024-08-06 07:25:41,932][52669] DAMAGECOUNT value on done: 871449.0 [2024-08-06 07:25:41,933][52669] Sum rewards: 60.764, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.301', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.190', 'AMMO3': '0.254', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON3': '1.400', 'weapon3': '2.950', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '52.000'} [2024-08-06 07:25:42,021][52663] DAMAGECOUNT value on done: 854312.0 [2024-08-06 07:25:42,022][52663] Sum rewards: 84.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.156', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO4': '0.149', 'AMMO3': '0.198', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '68.000'} [2024-08-06 07:25:42,302][52670] DAMAGECOUNT value on done: 845996.0 [2024-08-06 07:25:42,302][52670] Sum rewards: 70.034, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.429', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.090', 'AMMO3': '0.169', 'weapon4': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '56.000'} [2024-08-06 07:25:42,382][52649] DAMAGECOUNT value on done: 851035.0 [2024-08-06 07:25:42,382][52649] Sum rewards: 79.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.911', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.138', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:42,478][52666] DAMAGECOUNT value on done: 859440.0 [2024-08-06 07:25:42,478][52666] Sum rewards: 64.929, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.557', 'AMMO5': '0.004', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.265', 'weapon2': '0.280', 'WEAPON3': '1.650', 'weapon3': '3.462', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:42,784][52811] DAMAGECOUNT value on done: 804973.0 [2024-08-06 07:25:42,785][52811] Sum rewards: 78.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.454', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.102', 'weapon5': '0.214', 'AMMO4': '0.217', 'AMMO3': '0.229', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 625893376. Throughput: 0: 4376.3. Samples: 156481780. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:42,794][52567] Avg episode reward: [(0, '73.356')] [2024-08-06 07:25:43,202][52671] DAMAGECOUNT value on done: 859863.0 [2024-08-06 07:25:43,202][52671] Sum rewards: 77.714, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:43,355][52647] DAMAGECOUNT value on done: 914586.0 [2024-08-06 07:25:43,355][52647] Sum rewards: 76.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.154', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.102', 'weapon5': '0.162', 'AMMO3': '0.188', 'AMMO4': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:44,524][52665] DAMAGECOUNT value on done: 846867.0 [2024-08-06 07:25:44,524][52665] Sum rewards: 74.926, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.245', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.046', 'weapon4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.314', 'WEAPON3': '1.000', 'weapon3': '3.434', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:44,526][52669] DAMAGECOUNT value on done: 865321.0 [2024-08-06 07:25:44,526][52669] Sum rewards: 72.130, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.228', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.138', 'AMMO4': '0.178', 'AMMO3': '0.185', 'weapon5': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:44,596][52663] DAMAGECOUNT value on done: 859605.0 [2024-08-06 07:25:44,597][52663] Sum rewards: 70.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.960', 'AMMO5': '0.005', 'weapon4': '0.008', 'weapon5': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:45,230][52670] DAMAGECOUNT value on done: 846775.0 [2024-08-06 07:25:45,230][52670] Sum rewards: 84.377, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.199', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.180', 'weapon5': '0.222', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:45,475][52666] DAMAGECOUNT value on done: 852737.0 [2024-08-06 07:25:45,478][52666] Sum rewards: 71.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.202', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.430', 'weapon3': '3.562', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:45,514][52649] DAMAGECOUNT value on done: 841725.0 [2024-08-06 07:25:45,515][52649] Sum rewards: 72.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.022', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.178', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:45,802][52811] DAMAGECOUNT value on done: 807929.0 [2024-08-06 07:25:45,803][52811] Sum rewards: 74.448, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.148', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:45,987][52671] DAMAGECOUNT value on done: 866963.0 [2024-08-06 07:25:45,988][52671] Sum rewards: 65.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.116', 'AMMO3': '0.176', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '52.000'} [2024-08-06 07:25:46,362][52650] Updated weights for policy 0, policy_version 76411 (0.0016) [2024-08-06 07:25:46,373][52647] DAMAGECOUNT value on done: 903020.0 [2024-08-06 07:25:46,374][52647] Sum rewards: 69.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.282', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.041', 'weapon5': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.249', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.587', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:47,018][52669] DAMAGECOUNT value on done: 870634.0 [2024-08-06 07:25:47,018][52669] Sum rewards: 92.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.078', 'AMMO4': '0.104', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.252', 'FRAGCOUNT': '76.000'} [2024-08-06 07:25:47,080][52663] DAMAGECOUNT value on done: 858179.0 [2024-08-06 07:25:47,080][52663] Sum rewards: 77.038, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.630', 'AMMO5': '0.029', 'AMMO2': '0.079', 'weapon4': '0.170', 'weapon2': '0.252', 'AMMO3': '0.283', 'weapon5': '0.396', 'AMMO4': '0.397', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.600', 'weapon3': '2.808', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:47,295][52665] DAMAGECOUNT value on done: 854396.0 [2024-08-06 07:25:47,297][52665] Sum rewards: 76.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.055', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.060', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.448', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '64.000'} [2024-08-06 07:25:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 625983488. Throughput: 0: 4373.6. Samples: 156495110. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:47,794][52567] Avg episode reward: [(0, '73.819')] [2024-08-06 07:25:48,347][52670] DAMAGECOUNT value on done: 860878.0 [2024-08-06 07:25:48,347][52670] Sum rewards: 94.343, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.846', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.156', 'weapon4': '0.198', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '2.728', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.243', 'FRAGCOUNT': '74.000'} [2024-08-06 07:25:48,388][52649] DAMAGECOUNT value on done: 844478.0 [2024-08-06 07:25:48,388][52649] Sum rewards: 84.788, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.688', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.048', 'AMMO4': '0.107', 'AMMO3': '0.152', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '0.950', 'weapon3': '3.064', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '66.500'} [2024-08-06 07:25:48,588][52666] DAMAGECOUNT value on done: 859680.0 [2024-08-06 07:25:48,589][52666] Sum rewards: 66.154, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.510', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.114', 'weapon5': '0.212', 'weapon2': '0.218', 'AMMO4': '0.245', 'AMMO3': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '2.100', 'weapon3': '3.118', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:48,904][52811] DAMAGECOUNT value on done: 812889.0 [2024-08-06 07:25:48,905][52811] Sum rewards: 58.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.648', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.116', 'weapon2': '0.212', 'AMMO4': '0.274', 'AMMO3': '0.279', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.830', 'weapon3': '3.066', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '51.000'} [2024-08-06 07:25:49,207][52671] DAMAGECOUNT value on done: 864048.0 [2024-08-06 07:25:49,208][52671] Sum rewards: 70.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.849', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.128', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:49,390][52669] DAMAGECOUNT value on done: 873101.0 [2024-08-06 07:25:49,390][52669] Sum rewards: 78.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.114', 'weapon4': '0.168', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:49,451][52647] DAMAGECOUNT value on done: 911027.0 [2024-08-06 07:25:49,455][52647] Sum rewards: 78.897, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.144', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.156', 'weapon5': '0.204', 'weapon2': '0.238', 'AMMO3': '0.252', 'AMMO4': '0.271', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:49,496][52663] DAMAGECOUNT value on done: 862204.0 [2024-08-06 07:25:49,497][52663] Sum rewards: 63.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.488', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.298', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '52.000'} [2024-08-06 07:25:50,003][52665] DAMAGECOUNT value on done: 846583.0 [2024-08-06 07:25:50,003][52665] Sum rewards: 66.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.025', 'AMMO5': '0.033', 'AMMO2': '0.085', 'weapon4': '0.212', 'AMMO3': '0.224', 'weapon5': '0.326', 'AMMO4': '0.426', 'weapon2': '0.628', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.474', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '57.000'} [2024-08-06 07:25:50,937][52650] Updated weights for policy 0, policy_version 76421 (0.0034) [2024-08-06 07:25:50,942][52649] DAMAGECOUNT value on done: 832070.0 [2024-08-06 07:25:50,948][52649] Sum rewards: 73.890, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.595', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'AMMO3': '0.190', 'weapon2': '0.272', 'WEAPON3': '1.150', 'HITCOUNT': '3.420', 'weapon3': '3.536', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:51,222][52670] DAMAGECOUNT value on done: 848194.0 [2024-08-06 07:25:51,223][52670] Sum rewards: 62.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.155', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon4': '0.304', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.089', 'FRAGCOUNT': '51.000'} [2024-08-06 07:25:51,380][52666] DAMAGECOUNT value on done: 855171.0 [2024-08-06 07:25:51,381][52666] Sum rewards: 70.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.084', 'AMMO4': '0.176', 'weapon5': '0.194', 'AMMO3': '0.216', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.198', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '58.000'} [2024-08-06 07:25:52,095][52647] DAMAGECOUNT value on done: 910604.0 [2024-08-06 07:25:52,108][52647] Sum rewards: 75.838, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.475', 'AMMO5': '0.011', 'AMMO2': '0.041', 'AMMO3': '0.167', 'weapon5': '0.178', 'weapon4': '0.190', 'AMMO4': '0.206', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:52,111][52811] DAMAGECOUNT value on done: 803863.0 [2024-08-06 07:25:52,112][52811] Sum rewards: 73.169, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.313', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.104', 'AMMO4': '0.120', 'weapon5': '0.138', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:52,216][52663] DAMAGECOUNT value on done: 865245.0 [2024-08-06 07:25:52,217][52663] Sum rewards: 86.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.026', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'weapon3': '3.546', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '75.000'} [2024-08-06 07:25:52,655][52671] DAMAGECOUNT value on done: 849630.0 [2024-08-06 07:25:52,657][52671] Sum rewards: 59.808, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.706', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'AMMO3': '0.252', 'weapon2': '0.324', 'WEAPON3': '1.600', 'HITCOUNT': '3.070', 'weapon3': '3.330', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '53.000'} [2024-08-06 07:25:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 626065408. Throughput: 0: 4372.4. Samples: 156521340. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:52,795][52567] Avg episode reward: [(0, '73.795')] [2024-08-06 07:25:52,920][52665] DAMAGECOUNT value on done: 861179.0 [2024-08-06 07:25:52,920][52665] Sum rewards: 72.556, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.901', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.204', 'AMMO3': '0.219', 'weapon2': '0.222', 'weapon4': '0.262', 'AMMO4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '61.000'} [2024-08-06 07:25:53,957][52670] DAMAGECOUNT value on done: 845300.0 [2024-08-06 07:25:53,958][52670] Sum rewards: 73.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.224', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '62.000'} [2024-08-06 07:25:53,962][52649] DAMAGECOUNT value on done: 842674.0 [2024-08-06 07:25:53,963][52649] Sum rewards: 82.812, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.062', 'weapon5': '0.086', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.370', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '70.000'} [2024-08-06 07:25:54,236][52666] DAMAGECOUNT value on done: 848242.0 [2024-08-06 07:25:54,236][52666] Sum rewards: 67.514, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.695', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.130', 'weapon5': '0.200', 'AMMO4': '0.251', 'AMMO3': '0.261', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.070', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:54,826][52647] DAMAGECOUNT value on done: 917372.0 [2024-08-06 07:25:54,828][52647] Sum rewards: 79.388, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.893', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.082', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:55,055][52663] DAMAGECOUNT value on done: 850763.0 [2024-08-06 07:25:55,057][52663] Sum rewards: 82.668, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.088', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.215', 'weapon5': '0.242', 'weapon2': '0.276', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.784', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.324', 'FRAGCOUNT': '67.500'} [2024-08-06 07:25:55,219][52811] DAMAGECOUNT value on done: 803638.0 [2024-08-06 07:25:55,219][52811] Sum rewards: 75.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.714', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.110', 'weapon5': '0.136', 'AMMO4': '0.216', 'AMMO3': '0.235', 'weapon2': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '63.000'} [2024-08-06 07:25:55,224][52671] DAMAGECOUNT value on done: 873479.0 [2024-08-06 07:25:55,226][52671] Sum rewards: 81.830, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.479', 'weapon5': '0.002', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.154', 'weapon2': '0.404', 'WEAPON3': '1.050', 'weapon3': '3.440', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '65.000'} [2024-08-06 07:25:55,554][52650] Updated weights for policy 0, policy_version 76431 (0.0014) [2024-08-06 07:25:55,780][52665] DAMAGECOUNT value on done: 852629.0 [2024-08-06 07:25:55,781][52665] Sum rewards: 68.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.333', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.138', 'AMMO4': '0.173', 'AMMO3': '0.189', 'weapon4': '0.222', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.086', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '55.000'} [2024-08-06 07:25:57,053][52649] DAMAGECOUNT value on done: 824539.0 [2024-08-06 07:25:57,054][52649] Sum rewards: 84.239, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.519', 'AMMO5': '0.009', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.059', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '67.000'} [2024-08-06 07:25:57,143][52670] DAMAGECOUNT value on done: 851430.0 [2024-08-06 07:25:57,145][52670] Sum rewards: 80.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.619', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.026', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.214', 'weapon2': '0.214', 'WEAPON3': '1.350', 'weapon3': '3.510', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '66.000'} [2024-08-06 07:25:57,401][52666] DAMAGECOUNT value on done: 855627.0 [2024-08-06 07:25:57,402][52666] Sum rewards: 72.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.660', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '59.000'} [2024-08-06 07:25:57,465][52647] DAMAGECOUNT value on done: 912647.0 [2024-08-06 07:25:57,466][52647] Sum rewards: 79.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.047', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '64.000'} [2024-08-06 07:25:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 626155520. Throughput: 0: 4367.1. Samples: 156547210. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:25:57,794][52567] Avg episode reward: [(0, '73.908')] [2024-08-06 07:25:58,199][52671] DAMAGECOUNT value on done: 871785.0 [2024-08-06 07:25:58,201][52671] Sum rewards: 89.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.068', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon2': '0.314', 'WEAPON3': '1.050', 'weapon3': '3.296', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '72.000'} [2024-08-06 07:25:58,406][52811] DAMAGECOUNT value on done: 801172.0 [2024-08-06 07:25:58,406][52811] Sum rewards: 72.450, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.264', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.370', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.264', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '60.000'} [2024-08-06 07:25:58,500][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:25:58,917][52665] DAMAGECOUNT value on done: 849160.0 [2024-08-06 07:25:58,919][52665] Sum rewards: 78.329, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.228', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.128', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '68.000'} [2024-08-06 07:25:59,714][52670] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:25:59,971][52647] DAMAGECOUNT value on done: 916015.0 [2024-08-06 07:25:59,975][52647] Sum rewards: 77.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.034', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.216', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '64.000'} [2024-08-06 07:26:00,081][52670] DAMAGECOUNT value on done: 850362.0 [2024-08-06 07:26:00,082][52670] Sum rewards: 73.213, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.010', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.146', 'weapon5': '0.162', 'AMMO4': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.282', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.098', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:00,140][52649] DAMAGECOUNT value on done: 847600.0 [2024-08-06 07:26:00,141][52649] Sum rewards: 77.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.854', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.136', 'weapon4': '0.146', 'AMMO4': '0.172', 'weapon2': '0.184', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:00,372][52666] DAMAGECOUNT value on done: 851088.0 [2024-08-06 07:26:00,372][52666] Sum rewards: 85.707, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.531', 'AMMO2': '0.011', 'AMMO5': '0.013', 'AMMO4': '0.055', 'weapon5': '0.140', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.228', 'weapon4': '0.238', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '70.000'} [2024-08-06 07:26:00,775][52650] Updated weights for policy 0, policy_version 76441 (0.0041) [2024-08-06 07:26:01,016][52671] DAMAGECOUNT value on done: 865916.0 [2024-08-06 07:26:01,016][52671] Sum rewards: 77.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.493', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.128', 'weapon4': '0.176', 'AMMO3': '0.193', 'AMMO4': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:01,446][52811] DAMAGECOUNT value on done: 804998.0 [2024-08-06 07:26:01,446][52811] Sum rewards: 85.077, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.100', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon2': '0.154', 'AMMO3': '0.164', 'WEAPON3': '1.000', 'weapon3': '3.564', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:02,035][52665] DAMAGECOUNT value on done: 854069.0 [2024-08-06 07:26:02,036][52665] Sum rewards: 91.170, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.041', 'weapon5': '0.084', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'weapon2': '0.212', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.480', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '76.000'} [2024-08-06 07:26:02,530][52647] DAMAGECOUNT value on done: 892071.0 [2024-08-06 07:26:02,540][52647] Sum rewards: 68.901, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.796', 'AMMO5': '0.031', 'AMMO2': '0.079', 'AMMO3': '0.176', 'weapon4': '0.228', 'weapon5': '0.352', 'weapon2': '0.388', 'AMMO4': '0.395', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.100', 'weapon3': '2.724', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '56.000'} [2024-08-06 07:26:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 626245632. Throughput: 0: 4372.2. Samples: 156560660. Policy #0 lag: (min: 0.0, avg: 4.5, max: 8.0) [2024-08-06 07:26:02,794][52567] Avg episode reward: [(0, '74.712')] [2024-08-06 07:26:03,076][52670] DAMAGECOUNT value on done: 846008.0 [2024-08-06 07:26:03,079][52670] Sum rewards: 75.469, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.062', 'weapon4': '0.064', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:03,243][52649] DAMAGECOUNT value on done: 844272.0 [2024-08-06 07:26:03,243][52649] Sum rewards: 67.501, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.004', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO3': '0.204', 'AMMO4': '0.229', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.358', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '56.000'} [2024-08-06 07:26:03,301][52664] DAMAGECOUNT value on done: 889339.0 [2024-08-06 07:26:03,302][52664] Sum rewards: 80.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.644', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.158', 'AMMO4': '0.173', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:03,305][52666] DAMAGECOUNT value on done: 848012.0 [2024-08-06 07:26:03,305][52666] Sum rewards: 66.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.311', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.144', 'weapon5': '0.168', 'AMMO4': '0.201', 'AMMO3': '0.205', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.192', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '54.000'} [2024-08-06 07:26:03,830][52671] DAMAGECOUNT value on done: 870813.0 [2024-08-06 07:26:03,832][52671] Sum rewards: 77.909, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.042', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.106', 'weapon5': '0.108', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.162', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:04,636][52811] DAMAGECOUNT value on done: 808315.0 [2024-08-06 07:26:04,638][52811] Sum rewards: 74.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.665', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon2': '0.156', 'AMMO3': '0.217', 'weapon5': '0.228', 'weapon4': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 07:26:04,841][52650] Updated weights for policy 0, policy_version 76451 (0.0011) [2024-08-06 07:26:05,111][52665] DAMAGECOUNT value on done: 844860.0 [2024-08-06 07:26:05,113][52665] Sum rewards: 72.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.770', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:05,164][52647] DAMAGECOUNT value on done: 908150.0 [2024-08-06 07:26:05,165][52647] Sum rewards: 67.777, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.692', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '53.000'} [2024-08-06 07:26:05,495][52803] DAMAGECOUNT value on done: 799480.0 [2024-08-06 07:26:05,496][52803] Sum rewards: 62.101, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.266', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.114', 'weapon5': '0.204', 'weapon2': '0.206', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'AMMO3': '0.378', 'WEAPON3': '2.250', 'weapon3': '3.098', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '58.000'} [2024-08-06 07:26:05,996][52664] DAMAGECOUNT value on done: 895930.0 [2024-08-06 07:26:05,997][52664] Sum rewards: 79.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.118', 'AMMO4': '0.152', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '64.500'} [2024-08-06 07:26:06,251][52670] DAMAGECOUNT value on done: 856671.0 [2024-08-06 07:26:06,251][52670] Sum rewards: 75.874, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.470', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon4': '0.084', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.606', 'WEAPON3': '0.900', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '61.000'} [2024-08-06 07:26:06,430][52671] DAMAGECOUNT value on done: 855713.0 [2024-08-06 07:26:06,431][52671] Sum rewards: 75.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.600', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'weapon2': '0.380', 'WEAPON3': '1.750', 'weapon3': '3.250', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '64.000'} [2024-08-06 07:26:06,457][52666] DAMAGECOUNT value on done: 856773.0 [2024-08-06 07:26:06,460][52666] Sum rewards: 81.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.932', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.116', 'weapon5': '0.156', 'AMMO4': '0.172', 'AMMO3': '0.196', 'weapon2': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:06,491][52649] DAMAGECOUNT value on done: 837780.0 [2024-08-06 07:26:06,492][52649] Sum rewards: 80.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.766', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.201', 'weapon5': '0.208', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 626335744. Throughput: 0: 4362.9. Samples: 156586460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:07,794][52567] Avg episode reward: [(0, '75.000')] [2024-08-06 07:26:07,847][52811] DAMAGECOUNT value on done: 813590.0 [2024-08-06 07:26:07,847][52811] Sum rewards: 66.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:07,909][52647] DAMAGECOUNT value on done: 906829.0 [2024-08-06 07:26:07,909][52647] Sum rewards: 80.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.136', 'AMMO3': '0.225', 'weapon5': '0.250', 'AMMO4': '0.255', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:08,153][52665] DAMAGECOUNT value on done: 851797.0 [2024-08-06 07:26:08,155][52665] Sum rewards: 79.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.331', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.134', 'AMMO4': '0.155', 'AMMO3': '0.232', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:08,530][52803] DAMAGECOUNT value on done: 797471.0 [2024-08-06 07:26:08,532][52803] Sum rewards: 70.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.929', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '57.000'} [2024-08-06 07:26:08,926][52664] DAMAGECOUNT value on done: 896891.0 [2024-08-06 07:26:08,928][52664] Sum rewards: 84.437, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.126', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.274', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.961', 'FRAGCOUNT': '70.000'} [2024-08-06 07:26:09,199][52670] DAMAGECOUNT value on done: 839133.0 [2024-08-06 07:26:09,199][52670] Sum rewards: 71.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO2': '0.038', 'weapon5': '0.066', 'AMMO4': '0.191', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.282', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:09,291][52666] DAMAGECOUNT value on done: 849804.0 [2024-08-06 07:26:09,293][52666] Sum rewards: 75.725, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.986', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.143', 'weapon5': '0.170', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:09,673][52650] Updated weights for policy 0, policy_version 76461 (0.0017) [2024-08-06 07:26:10,960][52647] DAMAGECOUNT value on done: 905944.0 [2024-08-06 07:26:10,960][52647] Sum rewards: 82.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.164', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.087', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '69.000'} [2024-08-06 07:26:10,970][52665] DAMAGECOUNT value on done: 851646.0 [2024-08-06 07:26:10,972][52665] Sum rewards: 75.121, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.745', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.098', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '58.000'} [2024-08-06 07:26:11,012][52811] DAMAGECOUNT value on done: 799514.0 [2024-08-06 07:26:11,014][52811] Sum rewards: 60.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.415', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.150', 'weapon5': '0.150', 'AMMO4': '0.206', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.070', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '51.000'} [2024-08-06 07:26:11,616][52803] DAMAGECOUNT value on done: 805058.0 [2024-08-06 07:26:11,617][52803] Sum rewards: 62.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.918', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.172', 'AMMO3': '0.186', 'weapon5': '0.204', 'AMMO4': '0.293', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.930', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '50.500'} [2024-08-06 07:26:11,783][52670] DAMAGECOUNT value on done: 855236.0 [2024-08-06 07:26:11,785][52670] Sum rewards: 60.606, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.610', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.138', 'AMMO3': '0.249', 'weapon4': '0.258', 'AMMO4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.604', 'WEAPON3': '1.500', 'weapon3': '2.694', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '52.500'} [2024-08-06 07:26:11,818][52664] DAMAGECOUNT value on done: 886239.0 [2024-08-06 07:26:11,819][52664] Sum rewards: 76.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.098', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.231', 'WEAPON3': '1.500', 'weapon3': '3.454', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '64.000'} [2024-08-06 07:26:11,891][52666] DAMAGECOUNT value on done: 857575.0 [2024-08-06 07:26:11,893][52666] Sum rewards: 66.250, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.730', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.136', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.292', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:11,961][52668] DAMAGECOUNT value on done: 866091.0 [2024-08-06 07:26:11,964][52668] Sum rewards: 66.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.154', 'weapon4': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '57.000'} [2024-08-06 07:26:12,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 626417664. Throughput: 0: 4361.3. Samples: 156612730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:12,803][52567] Avg episode reward: [(0, '74.435')] [2024-08-06 07:26:13,402][52647] DAMAGECOUNT value on done: 894147.0 [2024-08-06 07:26:13,403][52647] Sum rewards: 86.558, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.130', 'HEALTH': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '69.000'} [2024-08-06 07:26:14,109][52811] DAMAGECOUNT value on done: 801457.0 [2024-08-06 07:26:14,111][52811] Sum rewards: 80.740, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.508', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.158', 'weapon4': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '2.980', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.508', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:14,118][52665] DAMAGECOUNT value on done: 843566.0 [2024-08-06 07:26:14,119][52665] Sum rewards: 66.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.122', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.016', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '54.000'} [2024-08-06 07:26:14,295][52670] DAMAGECOUNT value on done: 860466.0 [2024-08-06 07:26:14,297][52670] Sum rewards: 86.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.420', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.164', 'AMMO3': '0.193', 'AMMO4': '0.197', 'weapon4': '0.266', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.709', 'FRAGCOUNT': '72.000'} [2024-08-06 07:26:14,334][52664] DAMAGECOUNT value on done: 897565.0 [2024-08-06 07:26:14,334][52664] Sum rewards: 84.552, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.468', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.234', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.556', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '71.000'} [2024-08-06 07:26:14,359][52666] DAMAGECOUNT value on done: 841399.0 [2024-08-06 07:26:14,359][52666] Sum rewards: 72.231, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.166', 'AMMO3': '0.216', 'WEAPON3': '1.250', 'HITCOUNT': '3.350', 'weapon3': '3.596', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:14,430][52650] Updated weights for policy 0, policy_version 76471 (0.0012) [2024-08-06 07:26:14,798][52668] DAMAGECOUNT value on done: 867503.0 [2024-08-06 07:26:14,799][52668] Sum rewards: 80.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.940', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.042', 'weapon5': '0.130', 'AMMO4': '0.202', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.750', 'weapon3': '3.222', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '69.000'} [2024-08-06 07:26:14,820][52803] DAMAGECOUNT value on done: 804826.0 [2024-08-06 07:26:14,820][52803] Sum rewards: 76.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.178', 'AMMO4': '0.194', 'AMMO3': '0.214', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:16,170][52647] DAMAGECOUNT value on done: 910789.0 [2024-08-06 07:26:16,170][52647] Sum rewards: 74.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.064', 'WEAPON5': '0.100', 'weapon2': '0.192', 'AMMO3': '0.213', 'WEAPON3': '1.350', 'HITCOUNT': '3.460', 'weapon3': '3.602', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:17,067][52664] DAMAGECOUNT value on done: 893854.0 [2024-08-06 07:26:17,068][52664] Sum rewards: 63.747, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.888', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon5': '0.118', 'AMMO4': '0.196', 'AMMO3': '0.265', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.980', 'weapon3': '3.248', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.500'} [2024-08-06 07:26:17,222][52670] DAMAGECOUNT value on done: 854255.0 [2024-08-06 07:26:17,222][52670] Sum rewards: 86.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.072', 'weapon5': '0.172', 'AMMO3': '0.214', 'AMMO4': '0.265', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.126', 'FRAGCOUNT': '72.000'} [2024-08-06 07:26:17,325][52665] DAMAGECOUNT value on done: 848341.0 [2024-08-06 07:26:17,326][52665] Sum rewards: 67.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.826', 'AMMO5': '0.019', 'AMMO2': '0.078', 'weapon4': '0.146', 'weapon5': '0.182', 'AMMO3': '0.241', 'weapon2': '0.292', 'AMMO4': '0.391', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '57.000'} [2024-08-06 07:26:17,350][52666] DAMAGECOUNT value on done: 861598.0 [2024-08-06 07:26:17,350][52666] Sum rewards: 70.650, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'AMMO3': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '0.900', 'HITCOUNT': '3.240', 'weapon3': '3.308', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:17,560][52668] DAMAGECOUNT value on done: 861597.0 [2024-08-06 07:26:17,560][52668] Sum rewards: 68.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'AMMO4': '0.090', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.404', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '58.000'} [2024-08-06 07:26:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 626507776. Throughput: 0: 4364.4. Samples: 156625900. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:17,794][52567] Avg episode reward: [(0, '75.036')] [2024-08-06 07:26:17,898][52803] DAMAGECOUNT value on done: 801642.0 [2024-08-06 07:26:17,900][52803] Sum rewards: 72.684, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.156', 'AMMO4': '0.173', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.188', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.000'} [2024-08-06 07:26:18,629][52647] DAMAGECOUNT value on done: 900286.0 [2024-08-06 07:26:18,631][52647] Sum rewards: 70.107, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.026', 'weapon5': '0.052', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon2': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON3': '1.650', 'HITCOUNT': '3.480', 'weapon3': '3.506', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '61.500'} [2024-08-06 07:26:19,078][52820] DAMAGECOUNT value on done: 796158.0 [2024-08-06 07:26:19,081][52820] Sum rewards: 73.123, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.108', 'AMMO4': '0.129', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.200', 'HITCOUNT': '3.310', 'weapon3': '3.346', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:19,088][52650] Updated weights for policy 0, policy_version 76481 (0.0015) [2024-08-06 07:26:19,408][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:26:19,488][52664] DAMAGECOUNT value on done: 885333.0 [2024-08-06 07:26:19,488][52664] Sum rewards: 71.782, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.567', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.030', 'AMMO4': '0.042', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.648', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:20,030][52668] DAMAGECOUNT value on done: 867890.0 [2024-08-06 07:26:20,034][52668] Sum rewards: 77.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.958', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.172', 'AMMO3': '0.203', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:20,236][52670] DAMAGECOUNT value on done: 835315.0 [2024-08-06 07:26:20,237][52670] Sum rewards: 80.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.876', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.122', 'weapon5': '0.142', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:20,366][52666] DAMAGECOUNT value on done: 855962.0 [2024-08-06 07:26:20,367][52666] Sum rewards: 87.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.204', 'AMMO4': '0.206', 'weapon4': '0.216', 'weapon5': '0.224', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '71.000'} [2024-08-06 07:26:20,535][52665] DAMAGECOUNT value on done: 853264.0 [2024-08-06 07:26:20,536][52665] Sum rewards: 70.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.530', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.126', 'AMMO4': '0.195', 'AMMO3': '0.234', 'weapon2': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.260', 'weapon3': '3.340', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:20,896][52647] DAMAGECOUNT value on done: 908478.0 [2024-08-06 07:26:20,898][52647] Sum rewards: 67.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.045', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon2': '0.210', 'AMMO3': '0.257', 'weapon5': '0.262', 'AMMO4': '0.272', 'weapon4': '0.320', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.870', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 07:26:20,947][52803] DAMAGECOUNT value on done: 801661.0 [2024-08-06 07:26:20,949][52803] Sum rewards: 68.509, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.038', 'AMMO4': '0.059', 'weapon5': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.412', 'HEALTH': '0.418', 'WEAPON3': '0.950', 'HITCOUNT': '3.220', 'weapon3': '3.226', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '55.500'} [2024-08-06 07:26:21,781][52664] DAMAGECOUNT value on done: 883543.0 [2024-08-06 07:26:21,783][52664] Sum rewards: 70.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.070', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.466', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '58.000'} [2024-08-06 07:26:22,471][52820] DAMAGECOUNT value on done: 797002.0 [2024-08-06 07:26:22,472][52820] Sum rewards: 78.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.267', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.026', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.245', 'weapon2': '0.426', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:22,527][52614] Signal inference workers to stop experience collection... (14000 times) [2024-08-06 07:26:22,532][52614] Signal inference workers to resume experience collection... (14000 times) [2024-08-06 07:26:22,607][52650] InferenceWorker_p0-w0: stopping experience collection (14000 times) [2024-08-06 07:26:22,607][52650] InferenceWorker_p0-w0: resuming experience collection (14000 times) [2024-08-06 07:26:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 626597888. Throughput: 0: 4363.3. Samples: 156652040. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:22,794][52567] Avg episode reward: [(0, '74.931')] [2024-08-06 07:26:22,915][52670] DAMAGECOUNT value on done: 851296.0 [2024-08-06 07:26:22,916][52670] Sum rewards: 63.007, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.544', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.090', 'weapon4': '0.098', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.050', 'HITCOUNT': '2.700', 'weapon3': '3.398', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '51.000'} [2024-08-06 07:26:23,046][52663] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:26:23,053][52666] DAMAGECOUNT value on done: 855081.0 [2024-08-06 07:26:23,054][52666] Sum rewards: 86.766, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.678', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.042', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.147', 'weapon2': '0.538', 'WEAPON3': '0.950', 'weapon3': '3.286', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:23,251][52662] DAMAGECOUNT value on done: 859391.0 [2024-08-06 07:26:23,251][52662] Sum rewards: 68.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.930', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO3': '0.192', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.660', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '56.000'} [2024-08-06 07:26:23,254][52668] DAMAGECOUNT value on done: 854211.0 [2024-08-06 07:26:23,254][52668] Sum rewards: 66.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.167', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.154', 'AMMO4': '0.165', 'weapon5': '0.224', 'AMMO3': '0.260', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.010', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '56.000'} [2024-08-06 07:26:23,255][52647] DAMAGECOUNT value on done: 909128.0 [2024-08-06 07:26:23,255][52647] Sum rewards: 73.602, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.012', 'weapon5': '0.044', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.242', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.556', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '61.000'} [2024-08-06 07:26:23,474][52803] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:26:23,750][52650] Updated weights for policy 0, policy_version 76491 (0.0030) [2024-08-06 07:26:24,100][52803] DAMAGECOUNT value on done: 795425.0 [2024-08-06 07:26:24,102][52803] Sum rewards: 79.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'weapon4': '0.376', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:24,588][52664] DAMAGECOUNT value on done: 894357.0 [2024-08-06 07:26:24,589][52664] Sum rewards: 75.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.732', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.182', 'AMMO4': '0.182', 'weapon5': '0.222', 'weapon2': '0.254', 'weapon4': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.976', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 07:26:25,642][52820] DAMAGECOUNT value on done: 796727.0 [2024-08-06 07:26:25,643][52820] Sum rewards: 71.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.552', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.080', 'AMMO4': '0.191', 'weapon5': '0.214', 'AMMO3': '0.248', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '60.500'} [2024-08-06 07:26:26,066][52670] DAMAGECOUNT value on done: 861411.0 [2024-08-06 07:26:26,071][52670] Sum rewards: 86.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.090', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.272', 'WEAPON3': '1.300', 'weapon3': '3.418', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '72.000'} [2024-08-06 07:26:26,095][52668] DAMAGECOUNT value on done: 862658.0 [2024-08-06 07:26:26,096][52668] Sum rewards: 65.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.022', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.066', 'AMMO4': '0.083', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.234', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.384', 'DAMAGECOUNT': '15.012', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:26,107][52662] DAMAGECOUNT value on done: 869727.0 [2024-08-06 07:26:26,109][52662] Sum rewards: 83.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.277', 'AMMO5': '0.011', 'AMMO2': '0.065', 'weapon5': '0.156', 'weapon4': '0.258', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.300', 'AMMO4': '0.324', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.980', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '71.000'} [2024-08-06 07:26:26,198][52647] DAMAGECOUNT value on done: 896145.0 [2024-08-06 07:26:26,204][52647] Sum rewards: 61.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.912', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.172', 'AMMO3': '0.207', 'weapon2': '0.212', 'weapon5': '0.216', 'AMMO4': '0.220', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.670', 'weapon3': '3.218', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '52.000'} [2024-08-06 07:26:26,225][52666] DAMAGECOUNT value on done: 848999.0 [2024-08-06 07:26:26,225][52666] Sum rewards: 68.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.314', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.140', 'weapon4': '0.158', 'AMMO3': '0.206', 'AMMO4': '0.244', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:27,258][52803] DAMAGECOUNT value on done: 795660.0 [2024-08-06 07:26:27,258][52803] Sum rewards: 68.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.066', 'weapon4': '0.098', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.262', 'weapon2': '0.812', 'WEAPON3': '1.600', 'weapon3': '2.782', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:27,440][52664] DAMAGECOUNT value on done: 890263.0 [2024-08-06 07:26:27,441][52664] Sum rewards: 71.725, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.546', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.146', 'AMMO4': '0.223', 'AMMO3': '0.226', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '59.500'} [2024-08-06 07:26:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17749.4, 300 sec: 17494.8). Total num frames: 626688000. Throughput: 0: 4362.9. Samples: 156678110. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:27,802][52567] Avg episode reward: [(0, '74.666')] [2024-08-06 07:26:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000076500_626688000.pth... [2024-08-06 07:26:27,918][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000075988_622493696.pth [2024-08-06 07:26:28,128][52663] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:26:28,607][52795] DAMAGECOUNT value on done: 797545.0 [2024-08-06 07:26:28,608][52795] Sum rewards: 64.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.026', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.182', 'weapon5': '0.200', 'AMMO4': '0.208', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.450', 'weapon3': '2.816', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '54.000'} [2024-08-06 07:26:28,677][52650] Updated weights for policy 0, policy_version 76501 (0.0014) [2024-08-06 07:26:28,834][52820] DAMAGECOUNT value on done: 785190.0 [2024-08-06 07:26:28,837][52820] Sum rewards: 78.518, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.098', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.088', 'weapon5': '0.124', 'AMMO4': '0.207', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:29,093][52668] DAMAGECOUNT value on done: 865735.0 [2024-08-06 07:26:29,096][52668] Sum rewards: 75.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.355', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.080', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '64.000'} [2024-08-06 07:26:29,212][52670] DAMAGECOUNT value on done: 851950.0 [2024-08-06 07:26:29,212][52670] Sum rewards: 81.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.592', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.157', 'weapon5': '0.168', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:29,318][52647] DAMAGECOUNT value on done: 901674.0 [2024-08-06 07:26:29,319][52647] Sum rewards: 67.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.533', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.089', 'weapon5': '0.098', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.768', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:29,342][52662] DAMAGECOUNT value on done: 869940.0 [2024-08-06 07:26:29,344][52662] Sum rewards: 70.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.106', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:29,349][52666] DAMAGECOUNT value on done: 849091.0 [2024-08-06 07:26:29,349][52666] Sum rewards: 74.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.930', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.084', 'AMMO4': '0.165', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:30,361][52811] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:26:30,424][52803] DAMAGECOUNT value on done: 802434.0 [2024-08-06 07:26:30,426][52803] Sum rewards: 81.838, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.650', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.220', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.376', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:30,527][52664] DAMAGECOUNT value on done: 899789.0 [2024-08-06 07:26:30,527][52664] Sum rewards: 70.510, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.144', 'weapon2': '0.154', 'weapon5': '0.168', 'AMMO3': '0.186', 'AMMO4': '0.189', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.306', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 07:26:31,802][52795] DAMAGECOUNT value on done: 784048.0 [2024-08-06 07:26:31,805][52795] Sum rewards: 71.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.872', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.195', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:31,992][52670] DAMAGECOUNT value on done: 854934.0 [2024-08-06 07:26:31,993][52670] Sum rewards: 70.612, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.424', 'weapon4': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '56.000'} [2024-08-06 07:26:32,020][52668] DAMAGECOUNT value on done: 853683.0 [2024-08-06 07:26:32,021][52668] Sum rewards: 83.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.593', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.102', 'weapon2': '0.112', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'WEAPON3': '1.150', 'weapon3': '3.494', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:32,040][52820] DAMAGECOUNT value on done: 799505.0 [2024-08-06 07:26:32,042][52820] Sum rewards: 58.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.805', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.112', 'weapon5': '0.146', 'AMMO4': '0.171', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.200', 'HITCOUNT': '2.870', 'weapon3': '3.068', 'DAMAGECOUNT': '14.220', 'FRAGCOUNT': '48.000'} [2024-08-06 07:26:32,051][52666] DAMAGECOUNT value on done: 864545.0 [2024-08-06 07:26:32,052][52666] Sum rewards: 77.186, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO4': '0.197', 'weapon4': '0.214', 'AMMO3': '0.263', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:32,496][52647] DAMAGECOUNT value on done: 895947.0 [2024-08-06 07:26:32,496][52647] Sum rewards: 78.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.434', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.044', 'weapon5': '0.068', 'AMMO4': '0.211', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:32,578][52662] DAMAGECOUNT value on done: 856842.0 [2024-08-06 07:26:32,580][52662] Sum rewards: 91.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.624', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.034', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon2': '0.184', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'weapon3': '3.568', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.840', 'FRAGCOUNT': '76.000'} [2024-08-06 07:26:32,594][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:26:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 626761728. Throughput: 0: 4345.1. Samples: 156690640. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:32,794][52567] Avg episode reward: [(0, '74.649')] [2024-08-06 07:26:33,124][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:26:33,423][52650] Updated weights for policy 0, policy_version 76511 (0.0030) [2024-08-06 07:26:33,433][52664] DAMAGECOUNT value on done: 899037.0 [2024-08-06 07:26:33,435][52664] Sum rewards: 72.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.136', 'weapon5': '0.138', 'AMMO3': '0.185', 'AMMO4': '0.198', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '61.000'} [2024-08-06 07:26:33,528][52803] DAMAGECOUNT value on done: 796710.0 [2024-08-06 07:26:33,529][52803] Sum rewards: 58.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.102', 'weapon5': '0.194', 'AMMO3': '0.224', 'AMMO4': '0.227', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.016', 'DAMAGECOUNT': '14.862', 'FRAGCOUNT': '48.000'} [2024-08-06 07:26:34,800][52668] DAMAGECOUNT value on done: 857252.0 [2024-08-06 07:26:34,802][52668] Sum rewards: 76.986, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.880', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.152', 'weapon2': '0.382', 'WEAPON3': '1.000', 'HITCOUNT': '3.450', 'weapon3': '3.452', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:34,817][52647] DAMAGECOUNT value on done: 897230.0 [2024-08-06 07:26:34,818][52647] Sum rewards: 83.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.884', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.084', 'AMMO4': '0.146', 'weapon2': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '70.000'} [2024-08-06 07:26:34,859][52666] DAMAGECOUNT value on done: 840422.0 [2024-08-06 07:26:34,859][52666] Sum rewards: 76.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.255', 'AMMO5': '0.006', 'AMMO2': '0.048', 'weapon5': '0.082', 'weapon4': '0.096', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.000', 'weapon3': '3.030', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:34,950][52795] DAMAGECOUNT value on done: 789613.0 [2024-08-06 07:26:34,951][52795] Sum rewards: 70.801, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.130', 'AMMO4': '0.172', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.348', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 07:26:34,970][52820] DAMAGECOUNT value on done: 784527.0 [2024-08-06 07:26:34,971][52820] Sum rewards: 78.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.884', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.164', 'AMMO3': '0.180', 'weapon5': '0.206', 'AMMO4': '0.221', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '64.000'} [2024-08-06 07:26:35,260][52662] DAMAGECOUNT value on done: 873519.0 [2024-08-06 07:26:35,262][52662] Sum rewards: 83.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.088', 'AMMO4': '0.119', 'weapon5': '0.130', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '69.000'} [2024-08-06 07:26:35,977][52664] DAMAGECOUNT value on done: 896962.0 [2024-08-06 07:26:35,978][52664] Sum rewards: 74.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.112', 'weapon5': '0.184', 'AMMO4': '0.209', 'AMMO3': '0.213', 'weapon2': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:36,767][52803] DAMAGECOUNT value on done: 812031.0 [2024-08-06 07:26:36,769][52803] Sum rewards: 90.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '76.000'} [2024-08-06 07:26:37,630][52668] DAMAGECOUNT value on done: 865706.0 [2024-08-06 07:26:37,631][52668] Sum rewards: 71.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.754', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.196', 'weapon2': '0.376', 'WEAPON3': '1.250', 'HITCOUNT': '3.420', 'weapon3': '3.494', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '58.000'} [2024-08-06 07:26:37,667][52666] DAMAGECOUNT value on done: 848925.0 [2024-08-06 07:26:37,667][52666] Sum rewards: 74.938, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.145', 'weapon5': '0.168', 'AMMO3': '0.175', 'HEALTH': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.000', 'weapon3': '3.088', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '60.000'} [2024-08-06 07:26:37,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 626851840. Throughput: 0: 4347.1. Samples: 156716960. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:37,795][52567] Avg episode reward: [(0, '74.287')] [2024-08-06 07:26:38,015][52662] DAMAGECOUNT value on done: 852998.0 [2024-08-06 07:26:38,018][52662] Sum rewards: 82.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.626', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.134', 'weapon4': '0.164', 'weapon2': '0.188', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '69.000'} [2024-08-06 07:26:38,040][52820] DAMAGECOUNT value on done: 790399.0 [2024-08-06 07:26:38,041][52820] Sum rewards: 63.661, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.540', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.140', 'AMMO4': '0.169', 'weapon4': '0.196', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.824', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '54.000'} [2024-08-06 07:26:38,115][52795] DAMAGECOUNT value on done: 800211.0 [2024-08-06 07:26:38,117][52795] Sum rewards: 84.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.452', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.222', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.470', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.991', 'FRAGCOUNT': '68.000'} [2024-08-06 07:26:38,207][52650] Updated weights for policy 0, policy_version 76521 (0.0012) [2024-08-06 07:26:38,841][52664] DAMAGECOUNT value on done: 908990.0 [2024-08-06 07:26:38,842][52664] Sum rewards: 76.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.748', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.106', 'AMMO4': '0.122', 'weapon2': '0.158', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.476', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:39,866][52803] DAMAGECOUNT value on done: 804100.0 [2024-08-06 07:26:39,870][52803] Sum rewards: 68.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.116', 'AMMO4': '0.174', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:40,453][52668] DAMAGECOUNT value on done: 856476.0 [2024-08-06 07:26:40,455][52668] Sum rewards: 78.508, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.837', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.168', 'weapon5': '0.180', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '2.984', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:40,940][52667] DAMAGECOUNT value on done: 861056.0 [2024-08-06 07:26:40,942][52667] Sum rewards: 75.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.840', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.120', 'weapon5': '0.174', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '64.000'} [2024-08-06 07:26:41,151][52662] DAMAGECOUNT value on done: 858572.0 [2024-08-06 07:26:41,153][52662] Sum rewards: 74.508, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.509', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.106', 'AMMO3': '0.157', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '3.218', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:41,270][52820] DAMAGECOUNT value on done: 794431.0 [2024-08-06 07:26:41,274][52820] Sum rewards: 91.560, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO4': '0.192', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HEALTH': '0.365', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.003', 'FRAGCOUNT': '73.000'} [2024-08-06 07:26:41,349][52795] DAMAGECOUNT value on done: 786856.0 [2024-08-06 07:26:41,352][52795] Sum rewards: 73.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.631', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.130', 'AMMO4': '0.147', 'weapon2': '0.198', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.354', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:41,919][52664] DAMAGECOUNT value on done: 904684.0 [2024-08-06 07:26:41,919][52664] Sum rewards: 65.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.168', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO4': '0.171', 'weapon5': '0.180', 'AMMO3': '0.208', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.830', 'weapon3': '3.308', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '54.000'} [2024-08-06 07:26:42,553][52650] Updated weights for policy 0, policy_version 76531 (0.0019) [2024-08-06 07:26:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 626950144. Throughput: 0: 4354.0. Samples: 156743140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:42,794][52567] Avg episode reward: [(0, '74.591')] [2024-08-06 07:26:42,920][52803] DAMAGECOUNT value on done: 798784.0 [2024-08-06 07:26:42,921][52803] Sum rewards: 84.259, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.456', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon2': '0.170', 'weapon4': '0.178', 'AMMO4': '0.214', 'weapon5': '0.222', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '71.000'} [2024-08-06 07:26:43,430][52668] DAMAGECOUNT value on done: 853673.0 [2024-08-06 07:26:43,431][52668] Sum rewards: 71.472, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.162', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.110', 'weapon4': '0.190', 'AMMO3': '0.200', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:44,180][52662] DAMAGECOUNT value on done: 876350.0 [2024-08-06 07:26:44,180][52662] Sum rewards: 79.466, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon2': '0.234', 'WEAPON3': '1.050', 'weapon3': '3.486', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:44,200][52667] DAMAGECOUNT value on done: 870911.0 [2024-08-06 07:26:44,203][52667] Sum rewards: 77.535, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.665', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.084', 'AMMO3': '0.164', 'weapon5': '0.186', 'AMMO4': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.094', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:44,272][52664] DAMAGECOUNT value on done: 904414.0 [2024-08-06 07:26:44,273][52664] Sum rewards: 79.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.286', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.205', 'AMMO4': '0.222', 'weapon5': '0.264', 'weapon4': '0.282', 'weapon2': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:44,427][52795] DAMAGECOUNT value on done: 793795.0 [2024-08-06 07:26:44,427][52795] Sum rewards: 79.279, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.045', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.193', 'weapon2': '0.234', 'WEAPON3': '1.300', 'weapon3': '3.604', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:44,435][52820] DAMAGECOUNT value on done: 798930.0 [2024-08-06 07:26:44,437][52820] Sum rewards: 69.286, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.136', 'weapon4': '0.138', 'AMMO3': '0.166', 'AMMO4': '0.272', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.758', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '56.000'} [2024-08-06 07:26:46,052][52803] DAMAGECOUNT value on done: 814746.0 [2024-08-06 07:26:46,053][52803] Sum rewards: 80.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.056', 'AMMO4': '0.090', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:46,575][52668] DAMAGECOUNT value on done: 850118.0 [2024-08-06 07:26:46,579][52668] Sum rewards: 70.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.745', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.108', 'weapon4': '0.226', 'AMMO3': '0.229', 'AMMO4': '0.234', 'weapon2': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:46,877][52664] DAMAGECOUNT value on done: 887471.0 [2024-08-06 07:26:46,878][52664] Sum rewards: 69.193, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.222', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.078', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '59.500'} [2024-08-06 07:26:47,091][52667] DAMAGECOUNT value on done: 867969.0 [2024-08-06 07:26:47,091][52667] Sum rewards: 81.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.050', 'weapon5': '0.076', 'WEAPON4': '0.100', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'weapon3': '3.494', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '68.000'} [2024-08-06 07:26:47,272][52662] DAMAGECOUNT value on done: 861658.0 [2024-08-06 07:26:47,272][52662] Sum rewards: 77.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO3': '0.168', 'AMMO4': '0.174', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '2.870', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:47,584][52820] DAMAGECOUNT value on done: 806959.0 [2024-08-06 07:26:47,586][52820] Sum rewards: 72.387, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.844', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.148', 'weapon5': '0.182', 'AMMO3': '0.225', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:47,614][52795] DAMAGECOUNT value on done: 803502.0 [2024-08-06 07:26:47,616][52795] Sum rewards: 85.754, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.122', 'AMMO4': '0.139', 'AMMO3': '0.157', 'weapon5': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'HEALTH': '0.339', 'weapon2': '0.554', 'WEAPON3': '0.900', 'weapon3': '2.838', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '66.000'} [2024-08-06 07:26:47,701][52650] Updated weights for policy 0, policy_version 76541 (0.0011) [2024-08-06 07:26:47,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 627023872. Throughput: 0: 4348.4. Samples: 156756340. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:47,794][52567] Avg episode reward: [(0, '74.566')] [2024-08-06 07:26:49,287][52803] DAMAGECOUNT value on done: 799392.0 [2024-08-06 07:26:49,295][52803] Sum rewards: 63.257, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO2': '0.021', 'weapon4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.227', 'weapon2': '0.364', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.354', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:49,564][52668] DAMAGECOUNT value on done: 850525.0 [2024-08-06 07:26:49,565][52668] Sum rewards: 90.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.917', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.152', 'weapon5': '0.166', 'weapon4': '0.274', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.933', 'FRAGCOUNT': '70.000'} [2024-08-06 07:26:49,619][52664] DAMAGECOUNT value on done: 893150.0 [2024-08-06 07:26:49,619][52664] Sum rewards: 65.807, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.324', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.346', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:49,857][52667] DAMAGECOUNT value on done: 872422.0 [2024-08-06 07:26:49,858][52667] Sum rewards: 63.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.114', 'AMMO4': '0.165', 'AMMO3': '0.173', 'weapon5': '0.178', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '2.998', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '52.000'} [2024-08-06 07:26:50,576][52662] DAMAGECOUNT value on done: 868827.0 [2024-08-06 07:26:50,576][52662] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.185', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.221', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:50,749][52795] DAMAGECOUNT value on done: 793807.0 [2024-08-06 07:26:50,750][52795] Sum rewards: 75.738, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.510', 'weapon5': '0.002', 'AMMO2': '0.008', 'weapon4': '0.010', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'AMMO3': '0.261', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.488', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:50,857][52820] DAMAGECOUNT value on done: 788310.0 [2024-08-06 07:26:50,857][52820] Sum rewards: 70.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.122', 'AMMO4': '0.162', 'weapon5': '0.220', 'AMMO3': '0.247', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '58.000'} [2024-08-06 07:26:51,978][52650] Updated weights for policy 0, policy_version 76551 (0.0034) [2024-08-06 07:26:52,345][52664] DAMAGECOUNT value on done: 896216.0 [2024-08-06 07:26:52,346][52664] Sum rewards: 70.293, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.088', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.108', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:52,456][52803] DAMAGECOUNT value on done: 802515.0 [2024-08-06 07:26:52,456][52803] Sum rewards: 75.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.529', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.145', 'AMMO3': '0.197', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:52,571][52667] DAMAGECOUNT value on done: 874532.0 [2024-08-06 07:26:52,572][52667] Sum rewards: 86.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.945', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.214', 'WEAPON3': '1.500', 'weapon3': '3.426', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '71.000'} [2024-08-06 07:26:52,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 627113984. Throughput: 0: 4361.1. Samples: 156782710. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:26:52,794][52567] Avg episode reward: [(0, '74.789')] [2024-08-06 07:26:52,852][52668] DAMAGECOUNT value on done: 845955.0 [2024-08-06 07:26:52,855][52668] Sum rewards: 68.099, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.096', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.164', 'weapon4': '0.202', 'weapon2': '0.210', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.146', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:53,372][52662] DAMAGECOUNT value on done: 859214.0 [2024-08-06 07:26:53,372][52662] Sum rewards: 76.997, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.132', 'AMMO4': '0.159', 'AMMO3': '0.220', 'weapon2': '0.256', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.894', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '63.000'} [2024-08-06 07:26:53,961][52795] DAMAGECOUNT value on done: 799108.0 [2024-08-06 07:26:53,962][52795] Sum rewards: 70.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.932', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.180', 'AMMO3': '0.220', 'weapon5': '0.220', 'AMMO4': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:54,066][52820] DAMAGECOUNT value on done: 799581.0 [2024-08-06 07:26:54,066][52820] Sum rewards: 76.631, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.180', 'AMMO4': '0.206', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.134', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '64.000'} [2024-08-06 07:26:54,708][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:26:55,016][52664] DAMAGECOUNT value on done: 888064.0 [2024-08-06 07:26:55,017][52664] Sum rewards: 77.811, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.065', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.111', 'AMMO3': '0.158', 'weapon2': '0.442', 'WEAPON3': '1.050', 'weapon3': '3.380', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:55,605][52668] DAMAGECOUNT value on done: 858661.0 [2024-08-06 07:26:55,608][52668] Sum rewards: 64.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.238', 'weapon2': '0.246', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.528', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '54.000'} [2024-08-06 07:26:55,636][52803] DAMAGECOUNT value on done: 808312.0 [2024-08-06 07:26:55,638][52803] Sum rewards: 67.378, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.724', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.122', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.256', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'HITCOUNT': '3.250', 'weapon3': '3.262', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '59.000'} [2024-08-06 07:26:55,750][52667] DAMAGECOUNT value on done: 872985.0 [2024-08-06 07:26:55,750][52667] Sum rewards: 81.719, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.840', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.134', 'weapon5': '0.136', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:56,594][52662] DAMAGECOUNT value on done: 861616.0 [2024-08-06 07:26:56,595][52662] Sum rewards: 85.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.370', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.143', 'AMMO3': '0.185', 'weapon5': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '69.000'} [2024-08-06 07:26:56,687][52650] Updated weights for policy 0, policy_version 76561 (0.0031) [2024-08-06 07:26:57,075][52795] DAMAGECOUNT value on done: 800282.0 [2024-08-06 07:26:57,075][52795] Sum rewards: 70.163, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.478', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.124', 'AMMO4': '0.218', 'weapon4': '0.228', 'AMMO3': '0.242', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '2.850', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '62.000'} [2024-08-06 07:26:57,106][52820] DAMAGECOUNT value on done: 810308.0 [2024-08-06 07:26:57,106][52820] Sum rewards: 69.089, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.531', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.131', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.000', 'HITCOUNT': '3.180', 'weapon3': '3.218', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:57,804][52567] Fps is (10 sec: 18004.7, 60 sec: 17473.4, 300 sec: 17494.2). Total num frames: 627204096. Throughput: 0: 4358.8. Samples: 156808920. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:26:57,804][52567] Avg episode reward: [(0, '74.687')] [2024-08-06 07:26:58,426][52660] DAMAGECOUNT value on done: 856836.0 [2024-08-06 07:26:58,426][52660] Sum rewards: 68.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO2': '0.010', 'ARMOR': '0.024', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO3': '0.189', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.256', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '55.000'} [2024-08-06 07:26:58,476][52668] DAMAGECOUNT value on done: 862344.0 [2024-08-06 07:26:58,476][52668] Sum rewards: 65.116, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.370', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'WEAPON4': '0.150', 'weapon4': '0.186', 'AMMO3': '0.188', 'weapon2': '0.704', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '15.855', 'FRAGCOUNT': '53.000'} [2024-08-06 07:26:58,858][52803] DAMAGECOUNT value on done: 811732.0 [2024-08-06 07:26:58,858][52803] Sum rewards: 82.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.593', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.056', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.354', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '67.000'} [2024-08-06 07:26:58,995][52667] DAMAGECOUNT value on done: 867567.0 [2024-08-06 07:26:58,995][52667] Sum rewards: 77.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.854', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.215', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '65.000'} [2024-08-06 07:26:59,396][52662] DAMAGECOUNT value on done: 854907.0 [2024-08-06 07:26:59,397][52662] Sum rewards: 84.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '69.000'} [2024-08-06 07:27:00,176][52795] DAMAGECOUNT value on done: 796513.0 [2024-08-06 07:27:00,178][52795] Sum rewards: 72.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.482', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.184', 'AMMO4': '0.190', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 07:27:00,369][52820] DAMAGECOUNT value on done: 801349.0 [2024-08-06 07:27:00,369][52820] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.765', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.145', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '68.000'} [2024-08-06 07:27:00,774][52660] DAMAGECOUNT value on done: 850784.0 [2024-08-06 07:27:00,776][52660] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.609', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.157', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'weapon4': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '62.000'} [2024-08-06 07:27:00,854][52668] DAMAGECOUNT value on done: 859692.0 [2024-08-06 07:27:00,858][52668] Sum rewards: 69.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.711', 'AMMO5': '0.015', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon5': '0.212', 'AMMO3': '0.224', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '59.000'} [2024-08-06 07:27:01,507][52650] Updated weights for policy 0, policy_version 76571 (0.0011) [2024-08-06 07:27:01,906][52667] DAMAGECOUNT value on done: 863847.0 [2024-08-06 07:27:01,906][52667] Sum rewards: 73.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.034', 'AMMO4': '0.116', 'weapon5': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '62.000'} [2024-08-06 07:27:02,007][52803] DAMAGECOUNT value on done: 809499.0 [2024-08-06 07:27:02,011][52803] Sum rewards: 84.991, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.307', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.040', 'AMMO4': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.378', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '72.000'} [2024-08-06 07:27:02,447][52662] DAMAGECOUNT value on done: 865856.0 [2024-08-06 07:27:02,450][52662] Sum rewards: 77.455, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.730', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.032', 'AMMO4': '0.105', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.336', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '66.000'} [2024-08-06 07:27:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 627294208. Throughput: 0: 4359.6. Samples: 156822080. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:02,794][52567] Avg episode reward: [(0, '75.066')] [2024-08-06 07:27:03,340][52795] DAMAGECOUNT value on done: 788540.0 [2024-08-06 07:27:03,340][52795] Sum rewards: 60.081, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.274', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO4': '0.216', 'AMMO3': '0.216', 'weapon5': '0.258', 'weapon2': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.410', 'weapon3': '3.118', 'DAMAGECOUNT': '13.716', 'FRAGCOUNT': '51.000'} [2024-08-06 07:27:03,344][52660] DAMAGECOUNT value on done: 862279.0 [2024-08-06 07:27:03,344][52660] Sum rewards: 78.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.187', 'weapon2': '0.236', 'AMMO4': '0.256', 'weapon5': '0.258', 'weapon4': '0.352', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.862', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '63.000'} [2024-08-06 07:27:03,541][52668] DAMAGECOUNT value on done: 866220.0 [2024-08-06 07:27:03,541][52668] Sum rewards: 81.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.305', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.098', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.619', 'FRAGCOUNT': '68.000'} [2024-08-06 07:27:03,581][52820] DAMAGECOUNT value on done: 803829.0 [2024-08-06 07:27:03,584][52820] Sum rewards: 75.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.215', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.110', 'weapon5': '0.182', 'AMMO4': '0.195', 'AMMO3': '0.205', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '62.000'} [2024-08-06 07:27:04,959][52667] DAMAGECOUNT value on done: 866078.0 [2024-08-06 07:27:04,961][52667] Sum rewards: 74.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.002', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.116', 'weapon4': '0.168', 'AMMO4': '0.176', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '62.000'} [2024-08-06 07:27:05,187][52803] DAMAGECOUNT value on done: 806898.0 [2024-08-06 07:27:05,195][52803] Sum rewards: 80.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.494', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.080', 'weapon5': '0.176', 'AMMO3': '0.197', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '65.000'} [2024-08-06 07:27:05,372][52662] DAMAGECOUNT value on done: 854814.0 [2024-08-06 07:27:05,373][52662] Sum rewards: 81.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.308', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '66.000'} [2024-08-06 07:27:05,806][52650] Updated weights for policy 0, policy_version 76581 (0.0023) [2024-08-06 07:27:06,538][52795] DAMAGECOUNT value on done: 793462.0 [2024-08-06 07:27:06,540][52795] Sum rewards: 83.705, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.606', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.110', 'weapon2': '0.180', 'weapon5': '0.208', 'AMMO4': '0.247', 'AMMO3': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '71.000'} [2024-08-06 07:27:06,559][52660] DAMAGECOUNT value on done: 873711.0 [2024-08-06 07:27:06,560][52660] Sum rewards: 68.113, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.596', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.112', 'AMMO4': '0.201', 'weapon5': '0.226', 'weapon2': '0.244', 'AMMO3': '0.275', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '61.000'} [2024-08-06 07:27:06,637][52820] DAMAGECOUNT value on done: 800321.0 [2024-08-06 07:27:06,638][52820] Sum rewards: 66.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.141', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.180', 'AMMO3': '0.186', 'AMMO4': '0.224', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.186', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '54.500'} [2024-08-06 07:27:06,725][52668] DAMAGECOUNT value on done: 865138.0 [2024-08-06 07:27:06,726][52668] Sum rewards: 74.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.437', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.168', 'AMMO4': '0.252', 'weapon5': '0.294', 'weapon4': '0.338', 'weapon2': '0.396', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.634', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '59.000'} [2024-08-06 07:27:07,794][52567] Fps is (10 sec: 17220.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 627376128. Throughput: 0: 4364.2. Samples: 156848430. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:07,794][52567] Avg episode reward: [(0, '75.061')] [2024-08-06 07:27:07,942][52667] DAMAGECOUNT value on done: 872305.0 [2024-08-06 07:27:07,944][52667] Sum rewards: 81.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.017', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.308', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '65.000'} [2024-08-06 07:27:07,977][52659] DAMAGECOUNT value on done: 864001.0 [2024-08-06 07:27:07,977][52659] Sum rewards: 69.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.634', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.120', 'AMMO4': '0.132', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '57.000'} [2024-08-06 07:27:08,579][52662] DAMAGECOUNT value on done: 873703.0 [2024-08-06 07:27:08,581][52662] Sum rewards: 79.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.915', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.173', 'weapon5': '0.192', 'weapon2': '0.194', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '66.000'} [2024-08-06 07:27:09,135][52794] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:27:09,534][52660] DAMAGECOUNT value on done: 855237.0 [2024-08-06 07:27:09,534][52660] Sum rewards: 74.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.812', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.196', 'AMMO4': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '62.000'} [2024-08-06 07:27:09,654][52820] DAMAGECOUNT value on done: 801351.0 [2024-08-06 07:27:09,655][52820] Sum rewards: 92.612, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.608', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.149', 'weapon5': '0.210', 'weapon2': '0.228', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.237', 'FRAGCOUNT': '77.000'} [2024-08-06 07:27:09,779][52795] DAMAGECOUNT value on done: 802570.0 [2024-08-06 07:27:09,780][52795] Sum rewards: 69.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.330', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.104', 'weapon5': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.500', 'weapon3': '3.126', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '57.000'} [2024-08-06 07:27:10,504][52667] DAMAGECOUNT value on done: 859053.0 [2024-08-06 07:27:10,506][52667] Sum rewards: 64.552, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.275', 'AMMO5': '0.026', 'AMMO2': '0.058', 'weapon4': '0.132', 'AMMO3': '0.179', 'weapon5': '0.230', 'AMMO4': '0.288', 'WEAPON4': '0.500', 'weapon2': '0.508', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.868', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '51.000'} [2024-08-06 07:27:10,808][52650] Updated weights for policy 0, policy_version 76591 (0.0012) [2024-08-06 07:27:10,972][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:27:11,054][52659] DAMAGECOUNT value on done: 861031.0 [2024-08-06 07:27:11,055][52659] Sum rewards: 79.463, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.132', 'AMMO4': '0.177', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '66.000'} [2024-08-06 07:27:11,492][52662] DAMAGECOUNT value on done: 865689.0 [2024-08-06 07:27:11,493][52662] Sum rewards: 71.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.987', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.102', 'AMMO4': '0.166', 'weapon5': '0.166', 'AMMO3': '0.171', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.084', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '56.500'} [2024-08-06 07:27:12,026][52660] DAMAGECOUNT value on done: 853834.0 [2024-08-06 07:27:12,027][52660] Sum rewards: 76.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.127', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon4': '0.310', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '63.000'} [2024-08-06 07:27:12,215][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:27:12,347][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:27:12,779][52820] DAMAGECOUNT value on done: 808080.0 [2024-08-06 07:27:12,779][52820] Sum rewards: 71.872, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.023', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.128', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.222', 'weapon2': '0.264', 'WEAPON3': '0.850', 'HITCOUNT': '3.180', 'weapon3': '3.186', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '57.000'} [2024-08-06 07:27:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 627458048. Throughput: 0: 4368.7. Samples: 156874700. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:12,794][52567] Avg episode reward: [(0, '75.502')] [2024-08-06 07:27:12,893][52795] DAMAGECOUNT value on done: 788597.0 [2024-08-06 07:27:12,893][52795] Sum rewards: 73.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.515', 'AMMO5': '0.010', 'weapon4': '0.040', 'AMMO2': '0.044', 'weapon5': '0.098', 'AMMO3': '0.155', 'AMMO4': '0.220', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.280', 'weapon3': '3.480', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '60.000'} [2024-08-06 07:27:13,215][52667] DAMAGECOUNT value on done: 862453.0 [2024-08-06 07:27:13,217][52667] Sum rewards: 57.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.070', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.228', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.470', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '48.000'} [2024-08-06 07:27:13,665][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:27:14,106][52659] DAMAGECOUNT value on done: 870219.0 [2024-08-06 07:27:14,106][52659] Sum rewards: 81.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.172', 'AMMO4': '0.173', 'weapon5': '0.228', 'weapon2': '0.230', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '67.000'} [2024-08-06 07:27:14,593][52662] DAMAGECOUNT value on done: 850841.0 [2024-08-06 07:27:14,593][52662] Sum rewards: 76.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.391', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.186', 'AMMO4': '0.221', 'AMMO3': '0.223', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '62.000'} [2024-08-06 07:27:14,739][52660] DAMAGECOUNT value on done: 860791.0 [2024-08-06 07:27:14,741][52660] Sum rewards: 71.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.549', 'AMMO5': '0.025', 'AMMO2': '0.069', 'AMMO3': '0.196', 'weapon4': '0.280', 'weapon5': '0.316', 'weapon2': '0.322', 'AMMO4': '0.347', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '58.000'} [2024-08-06 07:27:15,891][52820] DAMAGECOUNT value on done: 807774.0 [2024-08-06 07:27:15,902][52820] Sum rewards: 78.143, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.888', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.278', 'weapon2': '0.622', 'WEAPON3': '1.700', 'weapon3': '3.160', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '67.000'} [2024-08-06 07:27:15,967][52795] DAMAGECOUNT value on done: 799931.0 [2024-08-06 07:27:15,970][52795] Sum rewards: 57.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.964', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.156', 'AMMO3': '0.200', 'weapon4': '0.262', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.250', 'weapon3': '2.718', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '13.896', 'FRAGCOUNT': '49.000'} [2024-08-06 07:27:15,999][52650] Updated weights for policy 0, policy_version 76601 (0.0012) [2024-08-06 07:27:16,400][52667] DAMAGECOUNT value on done: 872270.0 [2024-08-06 07:27:16,402][52667] Sum rewards: 66.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.060', 'AMMO4': '0.066', 'weapon5': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '55.000'} [2024-08-06 07:27:17,092][52659] DAMAGECOUNT value on done: 863651.0 [2024-08-06 07:27:17,097][52659] Sum rewards: 82.759, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.340', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon2': '0.134', 'weapon5': '0.138', 'weapon4': '0.226', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.280', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '70.000'} [2024-08-06 07:27:17,704][52662] DAMAGECOUNT value on done: 861364.0 [2024-08-06 07:27:17,706][52662] Sum rewards: 75.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.066', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.108', 'AMMO3': '0.202', 'AMMO4': '0.218', 'weapon5': '0.258', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.984', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '63.000'} [2024-08-06 07:27:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 627556352. Throughput: 0: 4383.8. Samples: 156887910. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:17,794][52567] Avg episode reward: [(0, '75.315')] [2024-08-06 07:27:17,894][52660] DAMAGECOUNT value on done: 867558.0 [2024-08-06 07:27:17,894][52660] Sum rewards: 83.691, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.084', 'AMMO4': '0.144', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '69.000'} [2024-08-06 07:27:18,695][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:27:19,188][52820] DAMAGECOUNT value on done: 790088.0 [2024-08-06 07:27:19,190][52820] Sum rewards: 77.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.449', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.160', 'AMMO4': '0.169', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 07:27:19,307][52795] DAMAGECOUNT value on done: 797269.0 [2024-08-06 07:27:19,309][52795] Sum rewards: 65.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon5': '0.238', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '54.000'} [2024-08-06 07:27:19,363][52667] DAMAGECOUNT value on done: 861610.0 [2024-08-06 07:27:19,364][52667] Sum rewards: 79.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.875', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.036', 'weapon4': '0.076', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon2': '0.174', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.510', 'weapon3': '3.560', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '65.000'} [2024-08-06 07:27:19,543][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:27:19,626][52659] DAMAGECOUNT value on done: 860925.0 [2024-08-06 07:27:19,628][52659] Sum rewards: 74.036, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.170', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.074', 'weapon5': '0.146', 'AMMO4': '0.183', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.650', 'weapon3': '3.066', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '64.000'} [2024-08-06 07:27:20,080][52650] Updated weights for policy 0, policy_version 76611 (0.0013) [2024-08-06 07:27:20,659][52662] DAMAGECOUNT value on done: 853144.0 [2024-08-06 07:27:20,661][52662] Sum rewards: 83.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.425', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.180', 'AMMO3': '0.239', 'weapon5': '0.278', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.526', 'WEAPON3': '1.450', 'weapon3': '2.558', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '69.000'} [2024-08-06 07:27:21,016][52660] DAMAGECOUNT value on done: 854629.0 [2024-08-06 07:27:21,016][52660] Sum rewards: 86.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.335', 'AMMO5': '0.009', 'weapon4': '0.042', 'AMMO2': '0.048', 'weapon5': '0.130', 'AMMO3': '0.237', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '72.000'} [2024-08-06 07:27:22,294][52667] DAMAGECOUNT value on done: 868043.0 [2024-08-06 07:27:22,296][52667] Sum rewards: 73.357, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.413', 'AMMO5': '0.005', 'weapon4': '0.024', 'AMMO2': '0.025', 'weapon5': '0.086', 'AMMO4': '0.126', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.598', 'WEAPON3': '0.900', 'weapon3': '3.150', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '58.000'} [2024-08-06 07:27:22,697][52795] DAMAGECOUNT value on done: 787723.0 [2024-08-06 07:27:22,698][52795] Sum rewards: 83.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.200', 'weapon2': '0.266', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.848', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '70.000'} [2024-08-06 07:27:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 627638272. Throughput: 0: 4369.8. Samples: 156913600. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:22,794][52567] Avg episode reward: [(0, '75.329')] [2024-08-06 07:27:22,953][52659] DAMAGECOUNT value on done: 862171.0 [2024-08-06 07:27:22,954][52659] Sum rewards: 76.478, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.303', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.038', 'AMMO4': '0.055', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.602', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '63.000'} [2024-08-06 07:27:23,770][52660] DAMAGECOUNT value on done: 852275.0 [2024-08-06 07:27:23,771][52660] Sum rewards: 83.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '68.000'} [2024-08-06 07:27:25,085][52650] Updated weights for policy 0, policy_version 76621 (0.0028) [2024-08-06 07:27:25,451][52667] DAMAGECOUNT value on done: 873836.0 [2024-08-06 07:27:25,455][52667] Sum rewards: 70.152, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.776', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.132', 'AMMO4': '0.209', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '61.000'} [2024-08-06 07:27:25,865][52795] DAMAGECOUNT value on done: 795499.0 [2024-08-06 07:27:25,867][52795] Sum rewards: 79.284, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.762', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.096', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON3': '1.500', 'HITCOUNT': '3.500', 'weapon3': '3.562', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '66.000'} [2024-08-06 07:27:26,082][52659] DAMAGECOUNT value on done: 864108.0 [2024-08-06 07:27:26,084][52659] Sum rewards: 65.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.306', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.368', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.366', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '54.000'} [2024-08-06 07:27:26,569][52660] DAMAGECOUNT value on done: 862540.0 [2024-08-06 07:27:26,570][52660] Sum rewards: 72.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.118', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '60.000'} [2024-08-06 07:27:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17467.0). Total num frames: 627720192. Throughput: 0: 4371.1. Samples: 156939840. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:27,794][52567] Avg episode reward: [(0, '75.289')] [2024-08-06 07:27:28,247][52667] DAMAGECOUNT value on done: 876280.0 [2024-08-06 07:27:28,247][52667] Sum rewards: 91.132, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.788', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'weapon3': '3.338', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.783', 'FRAGCOUNT': '76.000'} [2024-08-06 07:27:29,146][52795] DAMAGECOUNT value on done: 802381.0 [2024-08-06 07:27:29,149][52795] Sum rewards: 70.566, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.895', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.184', 'AMMO3': '0.199', 'weapon4': '0.210', 'AMMO4': '0.260', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '56.000'} [2024-08-06 07:27:29,239][52659] DAMAGECOUNT value on done: 863718.0 [2024-08-06 07:27:29,242][52659] Sum rewards: 80.505, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.994', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.128', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '68.000'} [2024-08-06 07:27:29,329][52660] DAMAGECOUNT value on done: 852445.0 [2024-08-06 07:27:29,329][52660] Sum rewards: 82.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.213', 'WEAPON3': '1.350', 'weapon3': '3.560', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '69.000'} [2024-08-06 07:27:29,493][52650] Updated weights for policy 0, policy_version 76631 (0.0015) [2024-08-06 07:27:30,827][52667] DAMAGECOUNT value on done: 870192.0 [2024-08-06 07:27:30,828][52667] Sum rewards: 81.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.348', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.184', 'AMMO4': '0.204', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '68.000'} [2024-08-06 07:27:31,962][52659] DAMAGECOUNT value on done: 862354.0 [2024-08-06 07:27:31,962][52659] Sum rewards: 61.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.616', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.118', 'AMMO4': '0.142', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.116', 'FRAGCOUNT': '52.000'} [2024-08-06 07:27:32,345][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:27:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.9). Total num frames: 627810304. Throughput: 0: 4365.8. Samples: 156952800. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:32,795][52567] Avg episode reward: [(0, '75.376')] [2024-08-06 07:27:32,993][52660] DAMAGECOUNT value on done: 854843.0 [2024-08-06 07:27:32,993][52660] Sum rewards: 62.609, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.158', 'weapon2': '0.198', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '53.000'} [2024-08-06 07:27:33,682][52667] DAMAGECOUNT value on done: 867525.0 [2024-08-06 07:27:33,683][52667] Sum rewards: 66.552, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.789', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.106', 'AMMO3': '0.188', 'weapon5': '0.202', 'AMMO4': '0.218', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.140', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '54.000'} [2024-08-06 07:27:34,351][52650] Updated weights for policy 0, policy_version 76641 (0.0015) [2024-08-06 07:27:34,849][52659] DAMAGECOUNT value on done: 871973.0 [2024-08-06 07:27:34,854][52659] Sum rewards: 69.308, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.944', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.046', 'weapon5': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.282', 'weapon2': '0.402', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '61.000'} [2024-08-06 07:27:35,818][52660] DAMAGECOUNT value on done: 867015.0 [2024-08-06 07:27:35,818][52660] Sum rewards: 83.633, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.986', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.098', 'weapon5': '0.148', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '67.000'} [2024-08-06 07:27:36,794][52667] DAMAGECOUNT value on done: 871678.0 [2024-08-06 07:27:36,796][52667] Sum rewards: 74.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.121', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.153', 'AMMO3': '0.164', 'weapon5': '0.210', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '0.950', 'weapon3': '3.014', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '58.000'} [2024-08-06 07:27:37,543][52659] DAMAGECOUNT value on done: 856556.0 [2024-08-06 07:27:37,544][52659] Sum rewards: 81.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.433', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon2': '0.214', 'AMMO3': '0.219', 'weapon5': '0.224', 'weapon4': '0.286', 'AMMO4': '0.305', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '67.000'} [2024-08-06 07:27:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 627900416. Throughput: 0: 4370.7. Samples: 156979390. Policy #0 lag: (min: 1.0, avg: 3.7, max: 8.0) [2024-08-06 07:27:37,794][52567] Avg episode reward: [(0, '75.040')] [2024-08-06 07:27:38,511][52660] DAMAGECOUNT value on done: 880040.0 [2024-08-06 07:27:38,514][52660] Sum rewards: 78.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.157', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.152', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.450', 'weapon3': '3.280', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '65.000'} [2024-08-06 07:27:39,122][52650] Updated weights for policy 0, policy_version 76651 (0.0013) [2024-08-06 07:27:40,656][52659] DAMAGECOUNT value on done: 868376.0 [2024-08-06 07:27:40,656][52659] Sum rewards: 76.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.955', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.233', 'WEAPON3': '1.500', 'weapon3': '3.506', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 07:27:41,629][52660] DAMAGECOUNT value on done: 856195.0 [2024-08-06 07:27:41,629][52660] Sum rewards: 76.201, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.798', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.308', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '60.000'} [2024-08-06 07:27:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.1, 300 sec: 17467.0). Total num frames: 627982336. Throughput: 0: 4370.7. Samples: 157005560. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:27:42,802][52567] Avg episode reward: [(0, '75.155')] [2024-08-06 07:27:43,384][52659] DAMAGECOUNT value on done: 859696.0 [2024-08-06 07:27:43,385][52659] Sum rewards: 62.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.084', 'weapon5': '0.112', 'AMMO4': '0.140', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.374', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '55.000'} [2024-08-06 07:27:43,462][52650] Updated weights for policy 0, policy_version 76661 (0.0027) [2024-08-06 07:27:43,534][52820] Large shaping reward 3.515 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.126, -42.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:27:44,755][52660] DAMAGECOUNT value on done: 864438.0 [2024-08-06 07:27:44,757][52660] Sum rewards: 78.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.890', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.048', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.256', 'WEAPON3': '1.350', 'weapon3': '3.486', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '65.000'} [2024-08-06 07:27:46,718][52659] DAMAGECOUNT value on done: 860810.0 [2024-08-06 07:27:46,720][52659] Sum rewards: 84.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.755', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.172', 'AMMO3': '0.173', 'weapon4': '0.176', 'AMMO4': '0.245', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '68.000'} [2024-08-06 07:27:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 628072448. Throughput: 0: 4365.6. Samples: 157018530. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:27:47,794][52567] Avg episode reward: [(0, '75.137')] [2024-08-06 07:27:47,896][52660] DAMAGECOUNT value on done: 860060.0 [2024-08-06 07:27:47,898][52660] Sum rewards: 79.330, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.035', 'AMMO5': '0.006', 'AMMO2': '0.062', 'weapon5': '0.064', 'weapon4': '0.094', 'WEAPON5': '0.150', 'weapon2': '0.182', 'WEAPON4': '0.250', 'AMMO3': '0.304', 'AMMO4': '0.311', 'WEAPON3': '1.850', 'weapon3': '3.450', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '69.000'} [2024-08-06 07:27:48,451][52650] Updated weights for policy 0, policy_version 76671 (0.0013) [2024-08-06 07:27:49,549][52659] DAMAGECOUNT value on done: 865983.0 [2024-08-06 07:27:49,549][52659] Sum rewards: 76.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.066', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.494', 'WEAPON3': '1.200', 'weapon3': '3.132', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '64.000'} [2024-08-06 07:27:50,830][52660] DAMAGECOUNT value on done: 852518.0 [2024-08-06 07:27:50,833][52660] Sum rewards: 73.952, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.089', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.038', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon5': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '60.000'} [2024-08-06 07:27:51,414][52658] DAMAGECOUNT value on done: 863739.0 [2024-08-06 07:27:51,416][52658] Sum rewards: 62.913, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.401', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.178', 'weapon2': '0.242', 'weapon5': '0.250', 'AMMO4': '0.251', 'AMMO3': '0.271', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.052', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '55.000'} [2024-08-06 07:27:52,617][52659] DAMAGECOUNT value on done: 862804.0 [2024-08-06 07:27:52,618][52659] Sum rewards: 59.151, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.178', 'AMMO4': '0.191', 'weapon2': '0.192', 'weapon5': '0.212', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.928', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '47.000'} [2024-08-06 07:27:52,730][52650] Updated weights for policy 0, policy_version 76681 (0.0011) [2024-08-06 07:27:52,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17612.8, 300 sec: 17522.6). Total num frames: 628170752. Throughput: 0: 4360.9. Samples: 157044670. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:27:52,802][52567] Avg episode reward: [(0, '74.877')] [2024-08-06 07:27:53,374][52660] DAMAGECOUNT value on done: 850648.0 [2024-08-06 07:27:53,376][52660] Sum rewards: 79.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.926', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.160', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.242', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '64.000'} [2024-08-06 07:27:54,385][52658] DAMAGECOUNT value on done: 868124.0 [2024-08-06 07:27:54,386][52658] Sum rewards: 78.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.022', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.388', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '63.000'} [2024-08-06 07:27:56,011][52659] DAMAGECOUNT value on done: 873344.0 [2024-08-06 07:27:56,011][52659] Sum rewards: 70.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.092', 'weapon4': '0.112', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '60.000'} [2024-08-06 07:27:57,269][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:27:57,525][52658] DAMAGECOUNT value on done: 870098.0 [2024-08-06 07:27:57,529][52658] Sum rewards: 82.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.819', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.120', 'AMMO3': '0.206', 'AMMO4': '0.217', 'weapon5': '0.232', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.463', 'FRAGCOUNT': '67.000'} [2024-08-06 07:27:57,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17342.4, 300 sec: 17439.2). Total num frames: 628244480. Throughput: 0: 4362.4. Samples: 157071010. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:27:57,795][52567] Avg episode reward: [(0, '75.151')] [2024-08-06 07:27:57,872][52650] Updated weights for policy 0, policy_version 76691 (0.0019) [2024-08-06 07:27:58,670][52794] DAMAGECOUNT value on done: 857313.0 [2024-08-06 07:27:58,674][52794] Sum rewards: 80.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.104', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '67.000'} [2024-08-06 07:27:58,804][52659] DAMAGECOUNT value on done: 856977.0 [2024-08-06 07:27:58,805][52659] Sum rewards: 73.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.324', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon2': '0.162', 'weapon5': '0.216', 'AMMO3': '0.232', 'weapon4': '0.272', 'AMMO4': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:00,735][52658] DAMAGECOUNT value on done: 866275.0 [2024-08-06 07:28:00,735][52658] Sum rewards: 84.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.158', 'weapon5': '0.164', 'weapon4': '0.174', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:01,367][52794] DAMAGECOUNT value on done: 867782.0 [2024-08-06 07:28:01,367][52794] Sum rewards: 81.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.005', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '69.000'} [2024-08-06 07:28:01,626][52659] DAMAGECOUNT value on done: 868791.0 [2024-08-06 07:28:01,626][52659] Sum rewards: 71.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.296', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.037', 'weapon5': '0.084', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.330', 'WEAPON3': '1.550', 'weapon3': '3.350', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:02,307][52650] Updated weights for policy 0, policy_version 76701 (0.0017) [2024-08-06 07:28:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.1). Total num frames: 628342784. Throughput: 0: 4360.7. Samples: 157084140. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:02,802][52567] Avg episode reward: [(0, '75.289')] [2024-08-06 07:28:03,688][52658] DAMAGECOUNT value on done: 861449.0 [2024-08-06 07:28:03,692][52658] Sum rewards: 82.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.474', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.134', 'weapon2': '0.160', 'AMMO4': '0.172', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.380', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '70.000'} [2024-08-06 07:28:04,192][52794] DAMAGECOUNT value on done: 871301.0 [2024-08-06 07:28:04,193][52794] Sum rewards: 74.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO2': '0.010', 'AMMO4': '0.048', 'AMMO3': '0.220', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:04,774][52659] DAMAGECOUNT value on done: 861714.0 [2024-08-06 07:28:04,774][52659] Sum rewards: 72.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.676', 'AMMO5': '0.022', 'AMMO2': '0.072', 'weapon4': '0.112', 'AMMO3': '0.218', 'weapon5': '0.298', 'AMMO4': '0.362', 'weapon2': '0.486', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.804', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:05,419][52669] DAMAGECOUNT value on done: 865406.0 [2024-08-06 07:28:05,420][52669] Sum rewards: 63.081, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.470', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.068', 'weapon5': '0.164', 'AMMO4': '0.226', 'AMMO3': '0.264', 'weapon2': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.050', 'weapon3': '3.222', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '57.000'} [2024-08-06 07:28:06,723][52658] DAMAGECOUNT value on done: 855127.0 [2024-08-06 07:28:06,723][52658] Sum rewards: 74.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.397', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.092', 'weapon4': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.207', 'weapon2': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.354', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '64.000'} [2024-08-06 07:28:07,182][52650] Updated weights for policy 0, policy_version 76711 (0.0026) [2024-08-06 07:28:07,331][52794] DAMAGECOUNT value on done: 860899.0 [2024-08-06 07:28:07,331][52794] Sum rewards: 78.681, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.690', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.101', 'weapon5': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'weapon2': '0.310', 'WEAPON3': '1.650', 'weapon3': '3.334', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:07,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 628424704. Throughput: 0: 4373.8. Samples: 157110420. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:07,794][52567] Avg episode reward: [(0, '75.362')] [2024-08-06 07:28:08,575][52669] DAMAGECOUNT value on done: 858910.0 [2024-08-06 07:28:08,576][52669] Sum rewards: 75.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.395', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.070', 'AMMO4': '0.163', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '65.000'} [2024-08-06 07:28:09,492][52658] DAMAGECOUNT value on done: 868889.0 [2024-08-06 07:28:09,494][52658] Sum rewards: 72.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.230', 'AMMO3': '0.233', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:10,573][52794] DAMAGECOUNT value on done: 854699.0 [2024-08-06 07:28:10,573][52794] Sum rewards: 77.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'weapon4': '0.124', 'AMMO3': '0.185', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:11,412][52669] DAMAGECOUNT value on done: 870555.0 [2024-08-06 07:28:11,413][52669] Sum rewards: 81.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.234', 'weapon4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '65.500'} [2024-08-06 07:28:11,785][52650] Updated weights for policy 0, policy_version 76721 (0.0019) [2024-08-06 07:28:11,960][52663] DAMAGECOUNT value on done: 880811.0 [2024-08-06 07:28:11,961][52663] Sum rewards: 74.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.126', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon4': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '2.878', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:12,523][52658] DAMAGECOUNT value on done: 857526.0 [2024-08-06 07:28:12,524][52658] Sum rewards: 87.110, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.535', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.132', 'AMMO3': '0.148', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON3': '0.950', 'weapon3': '3.262', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 628506624. Throughput: 0: 4374.9. Samples: 157136710. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:12,795][52567] Avg episode reward: [(0, '75.648')] [2024-08-06 07:28:13,604][52794] DAMAGECOUNT value on done: 860898.0 [2024-08-06 07:28:13,605][52794] Sum rewards: 64.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.975', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.086', 'AMMO3': '0.178', 'weapon5': '0.212', 'AMMO4': '0.246', 'weapon2': '0.340', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '3.000', 'weapon3': '3.112', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '53.000'} [2024-08-06 07:28:14,454][52669] DAMAGECOUNT value on done: 863487.0 [2024-08-06 07:28:14,454][52669] Sum rewards: 75.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.363', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.072', 'WEAPON5': '0.150', 'weapon4': '0.170', 'weapon2': '0.172', 'AMMO4': '0.172', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.400', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:15,159][52663] DAMAGECOUNT value on done: 864909.0 [2024-08-06 07:28:15,163][52663] Sum rewards: 70.480, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon2': '0.262', 'AMMO3': '0.264', 'AMMO4': '0.274', 'weapon5': '0.320', 'weapon4': '0.402', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.612', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:15,350][52658] DAMAGECOUNT value on done: 884067.0 [2024-08-06 07:28:15,351][52658] Sum rewards: 75.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '62.000'} [2024-08-06 07:28:16,262][52794] DAMAGECOUNT value on done: 867095.0 [2024-08-06 07:28:16,262][52794] Sum rewards: 73.356, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.108', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'weapon4': '0.314', 'WEAPON3': '0.900', 'weapon3': '2.958', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '58.000'} [2024-08-06 07:28:16,430][52650] Updated weights for policy 0, policy_version 76731 (0.0014) [2024-08-06 07:28:17,284][52669] DAMAGECOUNT value on done: 871876.0 [2024-08-06 07:28:17,284][52669] Sum rewards: 69.753, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.720', 'AMMO5': '0.026', 'AMMO2': '0.075', 'weapon2': '0.232', 'AMMO3': '0.244', 'weapon4': '0.248', 'AMMO4': '0.376', 'weapon5': '0.410', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.710', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 628604928. Throughput: 0: 4374.7. Samples: 157149660. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:17,794][52567] Avg episode reward: [(0, '75.281')] [2024-08-06 07:28:17,900][52663] DAMAGECOUNT value on done: 859008.0 [2024-08-06 07:28:17,900][52663] Sum rewards: 81.974, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.273', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon2': '0.182', 'AMMO3': '0.199', 'AMMO4': '0.225', 'weapon5': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.852', 'WEAPON3': '1.150', 'weapon3': '2.472', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '64.500'} [2024-08-06 07:28:18,462][52658] DAMAGECOUNT value on done: 868489.0 [2024-08-06 07:28:18,463][52658] Sum rewards: 89.562, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.019', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.105', 'weapon4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.317', 'weapon2': '0.392', 'WEAPON3': '1.850', 'weapon3': '3.138', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.792', 'FRAGCOUNT': '77.000'} [2024-08-06 07:28:18,968][52794] DAMAGECOUNT value on done: 853604.0 [2024-08-06 07:28:18,969][52794] Sum rewards: 67.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.942', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.166', 'AMMO4': '0.173', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.764', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:19,275][52660] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:28:19,577][52671] DAMAGECOUNT value on done: 870563.0 [2024-08-06 07:28:19,577][52671] Sum rewards: 76.220, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.842', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.404', 'WEAPON3': '1.700', 'weapon3': '3.268', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:20,161][52669] DAMAGECOUNT value on done: 867175.0 [2024-08-06 07:28:20,161][52669] Sum rewards: 78.111, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.974', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.045', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:20,849][52650] Updated weights for policy 0, policy_version 76741 (0.0023) [2024-08-06 07:28:21,021][52663] DAMAGECOUNT value on done: 864280.0 [2024-08-06 07:28:21,021][52663] Sum rewards: 86.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.086', 'weapon2': '0.190', 'AMMO3': '0.219', 'weapon5': '0.236', 'AMMO4': '0.270', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.463', 'FRAGCOUNT': '71.000'} [2024-08-06 07:28:21,574][52794] DAMAGECOUNT value on done: 865867.0 [2024-08-06 07:28:21,574][52794] Sum rewards: 91.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.724', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.092', 'AMMO3': '0.166', 'AMMO4': '0.203', 'weapon2': '0.314', 'weapon5': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.066', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.141', 'FRAGCOUNT': '71.000'} [2024-08-06 07:28:21,688][52658] DAMAGECOUNT value on done: 877160.0 [2024-08-06 07:28:21,689][52658] Sum rewards: 80.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.172', 'AMMO4': '0.212', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.360', 'weapon4': '0.364', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:22,681][52671] DAMAGECOUNT value on done: 875695.0 [2024-08-06 07:28:22,687][52671] Sum rewards: 76.427, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO4': '0.231', 'AMMO3': '0.243', 'weapon5': '0.270', 'weapon2': '0.320', 'weapon4': '0.434', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.658', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 628686848. Throughput: 0: 4361.6. Samples: 157175660. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:22,802][52567] Avg episode reward: [(0, '75.704')] [2024-08-06 07:28:22,933][52614] Signal inference workers to stop experience collection... (14050 times) [2024-08-06 07:28:22,936][52614] Signal inference workers to resume experience collection... (14050 times) [2024-08-06 07:28:23,024][52650] InferenceWorker_p0-w0: stopping experience collection (14050 times) [2024-08-06 07:28:23,024][52650] InferenceWorker_p0-w0: resuming experience collection (14050 times) [2024-08-06 07:28:23,279][52669] DAMAGECOUNT value on done: 868230.0 [2024-08-06 07:28:23,281][52669] Sum rewards: 83.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.454', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.170', 'AMMO3': '0.175', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:24,026][52663] DAMAGECOUNT value on done: 864639.0 [2024-08-06 07:28:24,026][52663] Sum rewards: 66.897, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.258', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.123', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '2.970', 'weapon3': '3.470', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '58.000'} [2024-08-06 07:28:24,675][52658] DAMAGECOUNT value on done: 864177.0 [2024-08-06 07:28:24,676][52658] Sum rewards: 71.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.068', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.228', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:24,890][52794] DAMAGECOUNT value on done: 861001.0 [2024-08-06 07:28:24,890][52794] Sum rewards: 84.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.966', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.186', 'weapon2': '0.188', 'AMMO4': '0.275', 'weapon5': '0.338', 'weapon4': '0.366', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.985', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:25,105][52649] DAMAGECOUNT value on done: 836183.0 [2024-08-06 07:28:25,105][52649] Sum rewards: 64.507, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.816', 'AMMO5': '0.023', 'AMMO2': '0.049', 'weapon4': '0.108', 'AMMO4': '0.248', 'weapon5': '0.268', 'weapon2': '0.270', 'AMMO3': '0.331', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '2.000', 'weapon3': '3.032', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '60.500'} [2024-08-06 07:28:25,881][52650] Updated weights for policy 0, policy_version 76751 (0.0014) [2024-08-06 07:28:25,942][52671] DAMAGECOUNT value on done: 870387.0 [2024-08-06 07:28:25,945][52671] Sum rewards: 60.073, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.140', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.104', 'weapon5': '0.106', 'AMMO4': '0.193', 'AMMO3': '0.294', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.160', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:26,151][52669] DAMAGECOUNT value on done: 866368.0 [2024-08-06 07:28:26,152][52669] Sum rewards: 64.313, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.880', 'AMMO5': '0.024', 'AMMO2': '0.078', 'weapon4': '0.172', 'weapon5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.242', 'AMMO4': '0.389', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.126', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '56.500'} [2024-08-06 07:28:26,899][52663] DAMAGECOUNT value on done: 871238.0 [2024-08-06 07:28:26,901][52663] Sum rewards: 78.206, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.540', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon2': '0.204', 'AMMO3': '0.211', 'weapon5': '0.270', 'weapon4': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '64.000'} [2024-08-06 07:28:27,584][52658] DAMAGECOUNT value on done: 874243.0 [2024-08-06 07:28:27,585][52658] Sum rewards: 84.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.820', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.040', 'weapon5': '0.148', 'AMMO3': '0.179', 'AMMO4': '0.198', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.360', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:27,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 628768768. Throughput: 0: 4363.3. Samples: 157201910. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:27,802][52567] Avg episode reward: [(0, '75.489')] [2024-08-06 07:28:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000076754_628768768.pth... [2024-08-06 07:28:27,818][52794] DAMAGECOUNT value on done: 851639.0 [2024-08-06 07:28:27,819][52794] Sum rewards: 58.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.900', 'AMMO5': '0.018', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.162', 'weapon5': '0.188', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.006', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '50.000'} [2024-08-06 07:28:27,938][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000076244_624590848.pth [2024-08-06 07:28:28,491][52671] DAMAGECOUNT value on done: 872321.0 [2024-08-06 07:28:28,493][52671] Sum rewards: 80.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.226', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.052', 'weapon5': '0.170', 'AMMO3': '0.187', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '64.000'} [2024-08-06 07:28:28,584][52649] DAMAGECOUNT value on done: 832584.0 [2024-08-06 07:28:28,584][52649] Sum rewards: 90.314, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.153', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '71.000'} [2024-08-06 07:28:29,190][52669] DAMAGECOUNT value on done: 876957.0 [2024-08-06 07:28:29,190][52669] Sum rewards: 67.687, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.166', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.152', 'AMMO4': '0.174', 'AMMO3': '0.195', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.272', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '57.000'} [2024-08-06 07:28:29,808][52663] DAMAGECOUNT value on done: 861996.0 [2024-08-06 07:28:29,810][52663] Sum rewards: 89.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.082', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '21.324', 'FRAGCOUNT': '74.000'} [2024-08-06 07:28:30,783][52650] Updated weights for policy 0, policy_version 76761 (0.0012) [2024-08-06 07:28:30,813][52658] DAMAGECOUNT value on done: 862904.0 [2024-08-06 07:28:30,814][52658] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.072', 'AMMO4': '0.119', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.100', 'weapon3': '3.236', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:31,046][52794] DAMAGECOUNT value on done: 866765.0 [2024-08-06 07:28:31,049][52794] Sum rewards: 84.252, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.210', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.078', 'weapon4': '0.088', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:31,149][52671] DAMAGECOUNT value on done: 876465.0 [2024-08-06 07:28:31,149][52671] Sum rewards: 60.243, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.122', 'AMMO3': '0.152', 'weapon4': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '2.640', 'weapon3': '3.138', 'DAMAGECOUNT': '14.403', 'FRAGCOUNT': '50.000'} [2024-08-06 07:28:31,644][52649] DAMAGECOUNT value on done: 848731.0 [2024-08-06 07:28:31,645][52649] Sum rewards: 74.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.646', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.158', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:32,125][52669] DAMAGECOUNT value on done: 866215.0 [2024-08-06 07:28:32,127][52669] Sum rewards: 71.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.405', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.184', 'AMMO3': '0.216', 'AMMO4': '0.229', 'weapon4': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 628858880. Throughput: 0: 4359.3. Samples: 157214700. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:32,794][52567] Avg episode reward: [(0, '75.550')] [2024-08-06 07:28:32,975][52663] DAMAGECOUNT value on done: 852933.0 [2024-08-06 07:28:32,975][52663] Sum rewards: 73.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.120', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:33,451][52658] DAMAGECOUNT value on done: 870344.0 [2024-08-06 07:28:33,462][52658] Sum rewards: 74.127, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.736', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.162', 'AMMO4': '0.178', 'weapon2': '0.256', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.254', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:34,108][52794] DAMAGECOUNT value on done: 860842.0 [2024-08-06 07:28:34,108][52794] Sum rewards: 69.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.088', 'AMMO3': '0.180', 'AMMO4': '0.203', 'weapon5': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.754', 'WEAPON3': '1.100', 'weapon3': '2.652', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '54.000'} [2024-08-06 07:28:34,302][52671] DAMAGECOUNT value on done: 866078.0 [2024-08-06 07:28:34,302][52671] Sum rewards: 74.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.168', 'AMMO3': '0.213', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.460', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:34,801][52649] DAMAGECOUNT value on done: 844360.0 [2024-08-06 07:28:34,803][52649] Sum rewards: 85.926, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.474', 'HEALTH': '0.540', 'WEAPON3': '0.950', 'weapon3': '3.254', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:35,143][52669] DAMAGECOUNT value on done: 875884.0 [2024-08-06 07:28:35,144][52669] Sum rewards: 75.127, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.606', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.188', 'AMMO4': '0.269', 'AMMO3': '0.336', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.950', 'weapon3': '2.992', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:35,387][52650] Updated weights for policy 0, policy_version 76771 (0.0015) [2024-08-06 07:28:35,980][52663] DAMAGECOUNT value on done: 859532.0 [2024-08-06 07:28:35,980][52663] Sum rewards: 83.447, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.994', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon2': '0.216', 'AMMO3': '0.222', 'weapon4': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:36,186][52658] DAMAGECOUNT value on done: 853668.0 [2024-08-06 07:28:36,188][52658] Sum rewards: 70.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.949', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.138', 'AMMO3': '0.191', 'weapon4': '0.198', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '58.500'} [2024-08-06 07:28:37,278][52794] DAMAGECOUNT value on done: 876089.0 [2024-08-06 07:28:37,279][52794] Sum rewards: 86.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.413', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.072', 'AMMO4': '0.151', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.200', 'weapon3': '3.424', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '70.000'} [2024-08-06 07:28:37,301][52671] DAMAGECOUNT value on done: 870750.0 [2024-08-06 07:28:37,301][52671] Sum rewards: 75.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon5': '0.042', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.236', 'weapon4': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '62.000'} [2024-08-06 07:28:37,660][52811] DAMAGECOUNT value on done: 821987.0 [2024-08-06 07:28:37,662][52811] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.898', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.149', 'weapon2': '0.536', 'WEAPON3': '1.050', 'weapon3': '3.384', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 628948992. Throughput: 0: 4357.8. Samples: 157240770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:37,794][52567] Avg episode reward: [(0, '75.814')] [2024-08-06 07:28:38,034][52649] DAMAGECOUNT value on done: 837227.0 [2024-08-06 07:28:38,036][52649] Sum rewards: 85.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.068', 'AMMO4': '0.072', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO3': '0.213', 'WEAPON3': '1.350', 'weapon3': '3.502', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '69.000'} [2024-08-06 07:28:38,055][52669] DAMAGECOUNT value on done: 875030.0 [2024-08-06 07:28:38,056][52669] Sum rewards: 66.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.106', 'weapon5': '0.136', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.520', 'WEAPON3': '1.650', 'weapon3': '2.976', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '57.000'} [2024-08-06 07:28:38,197][52665] DAMAGECOUNT value on done: 852357.0 [2024-08-06 07:28:38,197][52665] Sum rewards: 81.381, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.112', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.188', 'weapon2': '0.296', 'WEAPON3': '1.000', 'weapon3': '3.214', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '64.000'} [2024-08-06 07:28:38,905][52663] DAMAGECOUNT value on done: 864498.0 [2024-08-06 07:28:38,915][52663] Sum rewards: 85.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.349', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.136', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '72.000'} [2024-08-06 07:28:39,371][52658] DAMAGECOUNT value on done: 870555.0 [2024-08-06 07:28:39,373][52658] Sum rewards: 66.441, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.746', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon2': '0.230', 'AMMO4': '0.240', 'weapon4': '0.268', 'weapon5': '0.288', 'AMMO3': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.888', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:39,490][52647] DAMAGECOUNT value on done: 920006.0 [2024-08-06 07:28:39,490][52647] Sum rewards: 68.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.212', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.072', 'weapon5': '0.088', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.470', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.128', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:39,731][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:28:39,902][52650] Updated weights for policy 0, policy_version 76781 (0.0021) [2024-08-06 07:28:40,182][52671] DAMAGECOUNT value on done: 872918.0 [2024-08-06 07:28:40,182][52671] Sum rewards: 78.016, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.108', 'AMMO4': '0.215', 'weapon5': '0.216', 'weapon2': '0.220', 'AMMO3': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:40,365][52794] DAMAGECOUNT value on done: 856752.0 [2024-08-06 07:28:40,365][52794] Sum rewards: 67.075, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.713', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.244', 'weapon2': '0.372', 'WEAPON3': '0.950', 'weapon3': '3.122', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '54.000'} [2024-08-06 07:28:40,810][52811] DAMAGECOUNT value on done: 806834.0 [2024-08-06 07:28:40,812][52811] Sum rewards: 83.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.222', 'weapon2': '0.730', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '70.000'} [2024-08-06 07:28:40,854][52669] DAMAGECOUNT value on done: 862358.0 [2024-08-06 07:28:40,855][52669] Sum rewards: 83.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.126', 'weapon5': '0.138', 'weapon2': '0.224', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.141', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:41,056][52649] DAMAGECOUNT value on done: 847776.0 [2024-08-06 07:28:41,057][52649] Sum rewards: 73.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.605', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.058', 'weapon5': '0.134', 'AMMO4': '0.248', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '64.000'} [2024-08-06 07:28:41,230][52665] DAMAGECOUNT value on done: 866839.0 [2024-08-06 07:28:41,230][52665] Sum rewards: 67.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.995', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.044', 'AMMO4': '0.137', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'weapon2': '0.338', 'weapon5': '0.372', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.048', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '56.000'} [2024-08-06 07:28:41,663][52663] DAMAGECOUNT value on done: 871978.0 [2024-08-06 07:28:41,663][52663] Sum rewards: 71.246, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.040', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'weapon4': '0.340', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '56.000'} [2024-08-06 07:28:42,087][52658] DAMAGECOUNT value on done: 861869.0 [2024-08-06 07:28:42,088][52658] Sum rewards: 81.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.208', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon5': '0.078', 'AMMO3': '0.174', 'weapon2': '0.314', 'WEAPON3': '1.000', 'weapon3': '3.434', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:42,142][52647] DAMAGECOUNT value on done: 910012.0 [2024-08-06 07:28:42,143][52647] Sum rewards: 90.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.306', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO3': '0.166', 'AMMO4': '0.173', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.976', 'FRAGCOUNT': '71.000'} [2024-08-06 07:28:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 629039104. Throughput: 0: 4355.2. Samples: 157266990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:42,794][52567] Avg episode reward: [(0, '75.583')] [2024-08-06 07:28:43,142][52671] DAMAGECOUNT value on done: 857811.0 [2024-08-06 07:28:43,143][52671] Sum rewards: 71.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.672', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.121', 'weapon5': '0.132', 'AMMO3': '0.191', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.436', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '58.000'} [2024-08-06 07:28:43,718][52669] DAMAGECOUNT value on done: 862000.0 [2024-08-06 07:28:43,719][52669] Sum rewards: 77.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.894', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO4': '0.198', 'AMMO3': '0.218', 'weapon5': '0.284', 'weapon2': '0.314', 'weapon4': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.706', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '62.500'} [2024-08-06 07:28:43,719][52811] DAMAGECOUNT value on done: 800627.0 [2024-08-06 07:28:43,720][52811] Sum rewards: 85.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.733', 'FRAGCOUNT': '69.000'} [2024-08-06 07:28:43,798][52794] DAMAGECOUNT value on done: 873329.0 [2024-08-06 07:28:43,800][52794] Sum rewards: 79.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.712', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO4': '0.114', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '65.500'} [2024-08-06 07:28:43,980][52649] DAMAGECOUNT value on done: 843187.0 [2024-08-06 07:28:43,988][52649] Sum rewards: 83.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.013', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:44,055][52665] DAMAGECOUNT value on done: 856368.0 [2024-08-06 07:28:44,055][52665] Sum rewards: 75.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.268', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.110', 'AMMO4': '0.201', 'AMMO3': '0.216', 'weapon5': '0.238', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:44,317][52663] DAMAGECOUNT value on done: 854148.0 [2024-08-06 07:28:44,318][52663] Sum rewards: 76.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.800', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon5': '0.106', 'weapon4': '0.110', 'AMMO3': '0.160', 'AMMO4': '0.196', 'weapon2': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.376', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '62.000'} [2024-08-06 07:28:44,651][52650] Updated weights for policy 0, policy_version 76791 (0.0024) [2024-08-06 07:28:44,761][52670] DAMAGECOUNT value on done: 851347.0 [2024-08-06 07:28:44,762][52670] Sum rewards: 80.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.099', 'weapon5': '0.102', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:45,025][52647] DAMAGECOUNT value on done: 916297.0 [2024-08-06 07:28:45,026][52647] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.131', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.402', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '57.000'} [2024-08-06 07:28:45,198][52668] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:28:45,269][52658] DAMAGECOUNT value on done: 858656.0 [2024-08-06 07:28:45,269][52658] Sum rewards: 78.065, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.280', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.066', 'AMMO3': '0.173', 'weapon5': '0.184', 'AMMO4': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.750', 'WEAPON3': '1.000', 'weapon3': '2.764', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:46,162][52669] DAMAGECOUNT value on done: 867519.0 [2024-08-06 07:28:46,162][52669] Sum rewards: 72.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.026', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.442', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:46,170][52671] DAMAGECOUNT value on done: 872339.0 [2024-08-06 07:28:46,170][52671] Sum rewards: 76.614, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.960', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.094', 'weapon5': '0.238', 'weapon2': '0.276', 'AMMO4': '0.277', 'AMMO3': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:46,505][52794] DAMAGECOUNT value on done: 866991.0 [2024-08-06 07:28:46,506][52794] Sum rewards: 76.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.396', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.118', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:46,725][52649] DAMAGECOUNT value on done: 846852.0 [2024-08-06 07:28:46,727][52649] Sum rewards: 75.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.914', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.195', 'weapon4': '0.212', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:46,790][52665] DAMAGECOUNT value on done: 859696.0 [2024-08-06 07:28:46,792][52665] Sum rewards: 68.799, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.430', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon5': '0.140', 'AMMO4': '0.243', 'WEAPON5': '0.250', 'weapon2': '0.288', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'WEAPON3': '1.850', 'weapon3': '3.218', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:46,823][52811] DAMAGECOUNT value on done: 804355.0 [2024-08-06 07:28:46,826][52811] Sum rewards: 83.212, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.932', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.088', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:47,095][52663] DAMAGECOUNT value on done: 850573.0 [2024-08-06 07:28:47,096][52663] Sum rewards: 85.061, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.407', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.082', 'weapon5': '0.134', 'AMMO4': '0.241', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.750', 'weapon3': '3.140', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '73.000'} [2024-08-06 07:28:47,648][52658] DAMAGECOUNT value on done: 868444.0 [2024-08-06 07:28:47,649][52658] Sum rewards: 73.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.265', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.186', 'AMMO3': '0.199', 'AMMO4': '0.226', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.180', 'weapon3': '3.212', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:47,679][52670] DAMAGECOUNT value on done: 866068.0 [2024-08-06 07:28:47,680][52670] Sum rewards: 78.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.894', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.171', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '65.000'} [2024-08-06 07:28:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 629121024. Throughput: 0: 4359.1. Samples: 157280300. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:47,794][52567] Avg episode reward: [(0, '76.360')] [2024-08-06 07:28:47,853][52647] DAMAGECOUNT value on done: 916095.0 [2024-08-06 07:28:47,853][52647] Sum rewards: 68.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.046', 'weapon4': '0.074', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.204', 'WEAPON3': '1.200', 'HITCOUNT': '3.310', 'weapon3': '3.540', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '56.000'} [2024-08-06 07:28:49,205][52650] Updated weights for policy 0, policy_version 76801 (0.0019) [2024-08-06 07:28:49,351][52671] DAMAGECOUNT value on done: 869114.0 [2024-08-06 07:28:49,351][52671] Sum rewards: 75.628, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.102', 'HEALTH': '0.141', 'AMMO3': '0.171', 'weapon5': '0.178', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.676', 'WEAPON3': '1.000', 'weapon3': '2.814', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:49,401][52669] DAMAGECOUNT value on done: 890641.0 [2024-08-06 07:28:49,402][52669] Sum rewards: 85.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.994', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.478', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '71.000'} [2024-08-06 07:28:49,591][52794] DAMAGECOUNT value on done: 868138.0 [2024-08-06 07:28:49,592][52794] Sum rewards: 73.774, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.162', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.108', 'AMMO4': '0.203', 'AMMO3': '0.260', 'weapon2': '0.262', 'weapon5': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.988', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '62.000'} [2024-08-06 07:28:49,773][52649] DAMAGECOUNT value on done: 845203.0 [2024-08-06 07:28:49,774][52649] Sum rewards: 74.237, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.385', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.038', 'AMMO4': '0.056', 'weapon4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.626', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:49,829][52665] DAMAGECOUNT value on done: 842243.0 [2024-08-06 07:28:49,830][52665] Sum rewards: 72.444, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.060', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:49,906][52811] DAMAGECOUNT value on done: 806556.0 [2024-08-06 07:28:49,906][52811] Sum rewards: 66.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.786', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.160', 'weapon2': '0.218', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.428', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:50,238][52663] DAMAGECOUNT value on done: 857794.0 [2024-08-06 07:28:50,239][52663] Sum rewards: 64.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.046', 'AMMO5': '0.013', 'AMMO2': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.176', 'weapon5': '0.208', 'AMMO3': '0.215', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.312', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.734', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.009', 'FRAGCOUNT': '53.500'} [2024-08-06 07:28:50,499][52647] DAMAGECOUNT value on done: 923744.0 [2024-08-06 07:28:50,501][52647] Sum rewards: 84.762, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '69.000'} [2024-08-06 07:28:50,854][52670] DAMAGECOUNT value on done: 851488.0 [2024-08-06 07:28:50,854][52670] Sum rewards: 67.659, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.078', 'AMMO4': '0.119', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:51,021][52666] DAMAGECOUNT value on done: 865971.0 [2024-08-06 07:28:51,022][52666] Sum rewards: 73.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.393', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.112', 'AMMO4': '0.198', 'weapon5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.782', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:52,334][52794] DAMAGECOUNT value on done: 876020.0 [2024-08-06 07:28:52,335][52794] Sum rewards: 76.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.138', 'weapon5': '0.188', 'AMMO3': '0.226', 'AMMO4': '0.278', 'weapon2': '0.376', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:52,529][52671] DAMAGECOUNT value on done: 866099.0 [2024-08-06 07:28:52,531][52671] Sum rewards: 76.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.572', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.172', 'AMMO4': '0.198', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 07:28:52,602][52669] DAMAGECOUNT value on done: 877622.0 [2024-08-06 07:28:52,602][52669] Sum rewards: 79.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.656', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.118', 'weapon4': '0.138', 'AMMO3': '0.203', 'AMMO4': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 629211136. Throughput: 0: 4353.3. Samples: 157306320. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:52,794][52567] Avg episode reward: [(0, '76.070')] [2024-08-06 07:28:52,851][52665] DAMAGECOUNT value on done: 847581.0 [2024-08-06 07:28:52,852][52665] Sum rewards: 81.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.070', 'weapon5': '0.194', 'AMMO3': '0.207', 'AMMO4': '0.249', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:52,873][52649] DAMAGECOUNT value on done: 839890.0 [2024-08-06 07:28:52,873][52649] Sum rewards: 75.563, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.054', 'weapon4': '0.116', 'weapon5': '0.134', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.221', 'AMMO4': '0.269', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '64.500'} [2024-08-06 07:28:52,991][52811] DAMAGECOUNT value on done: 820231.0 [2024-08-06 07:28:52,991][52811] Sum rewards: 82.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.518', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.126', 'AMMO4': '0.137', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:53,198][52647] DAMAGECOUNT value on done: 918466.0 [2024-08-06 07:28:53,198][52647] Sum rewards: 73.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.055', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'weapon4': '0.130', 'AMMO3': '0.191', 'weapon2': '0.256', 'WEAPON3': '1.050', 'HITCOUNT': '3.410', 'weapon3': '3.428', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:53,484][52663] DAMAGECOUNT value on done: 859822.0 [2024-08-06 07:28:53,486][52663] Sum rewards: 69.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.071', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'weapon2': '0.160', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.692', 'WEAPON3': '0.950', 'weapon3': '2.812', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:53,840][52670] DAMAGECOUNT value on done: 854173.0 [2024-08-06 07:28:53,842][52670] Sum rewards: 93.723, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.357', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.100', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.293', 'WEAPON3': '1.700', 'weapon3': '3.396', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '22.194', 'FRAGCOUNT': '81.000'} [2024-08-06 07:28:53,965][52666] DAMAGECOUNT value on done: 859283.0 [2024-08-06 07:28:53,965][52666] Sum rewards: 78.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.445', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.184', 'weapon2': '0.186', 'AMMO3': '0.227', 'AMMO4': '0.290', 'weapon4': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:54,118][52794] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:28:54,330][52650] Updated weights for policy 0, policy_version 76811 (0.0014) [2024-08-06 07:28:55,020][52794] DAMAGECOUNT value on done: 868779.0 [2024-08-06 07:28:55,021][52794] Sum rewards: 80.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.468', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO4': '0.183', 'AMMO3': '0.188', 'weapon4': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '64.000'} [2024-08-06 07:28:55,297][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:28:55,629][52671] DAMAGECOUNT value on done: 873803.0 [2024-08-06 07:28:55,632][52671] Sum rewards: 75.529, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.476', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.084', 'AMMO4': '0.228', 'weapon5': '0.234', 'AMMO3': '0.312', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.900', 'weapon3': '2.910', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:55,797][52647] DAMAGECOUNT value on done: 922052.0 [2024-08-06 07:28:55,798][52647] Sum rewards: 78.269, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.168', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.026', 'weapon5': '0.094', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.432', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '65.000'} [2024-08-06 07:28:56,004][52669] DAMAGECOUNT value on done: 872623.0 [2024-08-06 07:28:56,005][52669] Sum rewards: 90.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.134', 'weapon4': '0.148', 'AMMO4': '0.169', 'weapon2': '0.218', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.906', 'FRAGCOUNT': '73.000'} [2024-08-06 07:28:56,153][52665] DAMAGECOUNT value on done: 853064.0 [2024-08-06 07:28:56,153][52665] Sum rewards: 81.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.822', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.152', 'AMMO3': '0.159', 'weapon4': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.214', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '66.000'} [2024-08-06 07:28:56,209][52649] DAMAGECOUNT value on done: 849545.0 [2024-08-06 07:28:56,210][52649] Sum rewards: 68.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.076', 'AMMO4': '0.199', 'weapon2': '0.206', 'weapon5': '0.210', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.196', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:56,214][52670] DAMAGECOUNT value on done: 866966.0 [2024-08-06 07:28:56,215][52670] Sum rewards: 68.899, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.773', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.166', 'weapon5': '0.192', 'AMMO4': '0.211', 'AMMO3': '0.271', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.918', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '59.000'} [2024-08-06 07:28:56,232][52811] DAMAGECOUNT value on done: 813063.0 [2024-08-06 07:28:56,232][52811] Sum rewards: 77.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.147', 'AMMO3': '0.212', 'weapon4': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '64.000'} [2024-08-06 07:28:56,306][52663] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:28:56,334][52666] DAMAGECOUNT value on done: 865989.0 [2024-08-06 07:28:56,335][52666] Sum rewards: 80.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.039', 'weapon5': '0.082', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.452', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:56,812][52663] DAMAGECOUNT value on done: 864940.0 [2024-08-06 07:28:56,812][52663] Sum rewards: 67.071, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.875', 'AMMO2': '0.014', 'AMMO4': '0.070', 'AMMO3': '0.174', 'weapon2': '0.378', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.516', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '55.000'} [2024-08-06 07:28:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 629293056. Throughput: 0: 4349.1. Samples: 157332420. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:28:57,794][52567] Avg episode reward: [(0, '76.404')] [2024-08-06 07:28:58,496][52671] DAMAGECOUNT value on done: 869872.0 [2024-08-06 07:28:58,497][52671] Sum rewards: 74.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.487', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.169', 'weapon5': '0.200', 'AMMO4': '0.205', 'weapon2': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'weapon4': '0.642', 'WEAPON3': '1.100', 'weapon3': '2.428', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:58,511][52647] DAMAGECOUNT value on done: 898339.0 [2024-08-06 07:28:58,511][52647] Sum rewards: 74.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.258', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.077', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.498', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:58,791][52650] Updated weights for policy 0, policy_version 76821 (0.0031) [2024-08-06 07:28:58,893][52669] DAMAGECOUNT value on done: 876854.0 [2024-08-06 07:28:58,894][52669] Sum rewards: 81.034, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.254', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.090', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '68.000'} [2024-08-06 07:28:59,151][52811] DAMAGECOUNT value on done: 804139.0 [2024-08-06 07:28:59,153][52811] Sum rewards: 78.049, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.134', 'AMMO4': '0.139', 'AMMO3': '0.178', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '65.000'} [2024-08-06 07:28:59,236][52670] DAMAGECOUNT value on done: 854940.0 [2024-08-06 07:28:59,236][52670] Sum rewards: 82.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '67.000'} [2024-08-06 07:28:59,314][52665] DAMAGECOUNT value on done: 852036.0 [2024-08-06 07:28:59,316][52665] Sum rewards: 61.774, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.126', 'AMMO4': '0.155', 'weapon5': '0.160', 'AMMO3': '0.177', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.298', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '50.000'} [2024-08-06 07:28:59,348][52649] DAMAGECOUNT value on done: 856771.0 [2024-08-06 07:28:59,349][52649] Sum rewards: 70.187, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.245', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.152', 'weapon5': '0.172', 'weapon2': '0.198', 'AMMO3': '0.218', 'AMMO4': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '60.000'} [2024-08-06 07:28:59,427][52666] DAMAGECOUNT value on done: 861226.0 [2024-08-06 07:28:59,428][52666] Sum rewards: 73.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.658', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.124', 'weapon2': '0.144', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON3': '1.500', 'weapon3': '3.484', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 07:28:59,729][52663] DAMAGECOUNT value on done: 864018.0 [2024-08-06 07:28:59,732][52663] Sum rewards: 68.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.232', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon2': '0.206', 'AMMO3': '0.219', 'weapon4': '0.272', 'AMMO4': '0.278', 'weapon5': '0.334', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.830', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '56.000'} [2024-08-06 07:29:00,811][52647] DAMAGECOUNT value on done: 914633.0 [2024-08-06 07:29:00,813][52647] Sum rewards: 82.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.462', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.176', 'weapon2': '0.194', 'WEAPON5': '0.350', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '67.000'} [2024-08-06 07:29:01,328][52671] DAMAGECOUNT value on done: 854770.0 [2024-08-06 07:29:01,328][52671] Sum rewards: 69.969, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.530', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.166', 'AMMO3': '0.177', 'AMMO4': '0.183', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.420', 'FRAGCOUNT': '58.000'} [2024-08-06 07:29:01,481][52664] DAMAGECOUNT value on done: 895235.0 [2024-08-06 07:29:01,483][52664] Sum rewards: 66.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.090', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.267', 'weapon2': '0.460', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '57.000'} [2024-08-06 07:29:01,663][52669] DAMAGECOUNT value on done: 879131.0 [2024-08-06 07:29:01,664][52669] Sum rewards: 78.439, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.730', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.054', 'weapon4': '0.094', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.200', 'weapon3': '3.328', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:02,288][52665] DAMAGECOUNT value on done: 860572.0 [2024-08-06 07:29:02,288][52665] Sum rewards: 82.636, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.017', 'HEALTH': '0.022', 'weapon5': '0.058', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.540', 'WEAPON3': '0.850', 'weapon3': '3.108', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:02,332][52649] DAMAGECOUNT value on done: 848235.0 [2024-08-06 07:29:02,336][52649] Sum rewards: 77.916, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.644', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.199', 'weapon5': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '62.500'} [2024-08-06 07:29:02,340][52811] DAMAGECOUNT value on done: 812809.0 [2024-08-06 07:29:02,342][52811] Sum rewards: 63.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.181', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.170', 'AMMO3': '0.204', 'AMMO4': '0.222', 'weapon5': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '2.946', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '52.000'} [2024-08-06 07:29:02,488][52663] DAMAGECOUNT value on done: 867840.0 [2024-08-06 07:29:02,488][52663] Sum rewards: 70.925, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.574', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.186', 'weapon2': '0.192', 'WEAPON4': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon4': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '58.000'} [2024-08-06 07:29:02,535][52670] DAMAGECOUNT value on done: 850382.0 [2024-08-06 07:29:02,536][52670] Sum rewards: 62.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.905', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.096', 'AMMO4': '0.143', 'weapon5': '0.162', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.074', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '52.500'} [2024-08-06 07:29:02,677][52666] DAMAGECOUNT value on done: 855006.0 [2024-08-06 07:29:02,677][52666] Sum rewards: 84.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.924', 'AMMO5': '0.011', 'weapon4': '0.038', 'AMMO2': '0.044', 'weapon5': '0.078', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'AMMO4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.368', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '67.000'} [2024-08-06 07:29:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 629383168. Throughput: 0: 4347.1. Samples: 157345280. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:29:02,794][52567] Avg episode reward: [(0, '75.866')] [2024-08-06 07:29:03,349][52650] Updated weights for policy 0, policy_version 76831 (0.0024) [2024-08-06 07:29:03,524][52647] DAMAGECOUNT value on done: 912989.0 [2024-08-06 07:29:03,524][52647] Sum rewards: 73.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.553', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.122', 'AMMO4': '0.180', 'weapon5': '0.188', 'AMMO3': '0.236', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:04,208][52664] DAMAGECOUNT value on done: 901341.0 [2024-08-06 07:29:04,209][52664] Sum rewards: 69.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.703', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.112', 'AMMO4': '0.142', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.232', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '56.000'} [2024-08-06 07:29:04,315][52671] DAMAGECOUNT value on done: 878793.0 [2024-08-06 07:29:04,319][52671] Sum rewards: 69.222, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.995', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.168', 'weapon5': '0.170', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.942', 'FRAGCOUNT': '56.000'} [2024-08-06 07:29:05,054][52665] DAMAGECOUNT value on done: 852587.0 [2024-08-06 07:29:05,055][52665] Sum rewards: 72.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.073', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.326', 'WEAPON3': '1.350', 'HITCOUNT': '3.320', 'weapon3': '3.354', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '61.000'} [2024-08-06 07:29:05,073][52649] DAMAGECOUNT value on done: 849859.0 [2024-08-06 07:29:05,074][52649] Sum rewards: 59.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.250', 'weapon4': '0.252', 'AMMO3': '0.261', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.778', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '50.000'} [2024-08-06 07:29:05,128][52663] DAMAGECOUNT value on done: 872321.0 [2024-08-06 07:29:05,130][52663] Sum rewards: 81.743, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.510', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.140', 'AMMO4': '0.152', 'weapon2': '0.256', 'AMMO3': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.202', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.228', 'FRAGCOUNT': '70.000'} [2024-08-06 07:29:05,211][52670] DAMAGECOUNT value on done: 858100.0 [2024-08-06 07:29:05,212][52670] Sum rewards: 84.534, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.241', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.138', 'weapon4': '0.174', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '69.000'} [2024-08-06 07:29:05,378][52666] DAMAGECOUNT value on done: 861287.0 [2024-08-06 07:29:05,379][52666] Sum rewards: 69.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.219', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.072', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.656', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '57.000'} [2024-08-06 07:29:05,400][52811] DAMAGECOUNT value on done: 809997.0 [2024-08-06 07:29:05,401][52811] Sum rewards: 68.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.220', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.171', 'weapon2': '0.546', 'WEAPON3': '0.950', 'HITCOUNT': '3.230', 'weapon3': '3.272', 'DAMAGECOUNT': '15.072', 'FRAGCOUNT': '56.000'} [2024-08-06 07:29:06,756][52647] DAMAGECOUNT value on done: 912287.0 [2024-08-06 07:29:06,756][52647] Sum rewards: 73.479, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.132', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.146', 'weapon5': '0.168', 'AMMO4': '0.186', 'AMMO3': '0.272', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.120', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:07,236][52671] DAMAGECOUNT value on done: 878533.0 [2024-08-06 07:29:07,238][52671] Sum rewards: 81.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.572', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.178', 'weapon5': '0.190', 'AMMO3': '0.199', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:07,457][52664] DAMAGECOUNT value on done: 901865.0 [2024-08-06 07:29:07,457][52664] Sum rewards: 60.482, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.433', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.102', 'weapon4': '0.110', 'AMMO4': '0.164', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.350', 'HITCOUNT': '3.000', 'weapon3': '3.136', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '50.000'} [2024-08-06 07:29:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 629465088. Throughput: 0: 4352.4. Samples: 157371520. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:29:07,794][52567] Avg episode reward: [(0, '75.553')] [2024-08-06 07:29:07,821][52670] DAMAGECOUNT value on done: 855774.0 [2024-08-06 07:29:07,823][52670] Sum rewards: 63.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.494', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon2': '0.198', 'AMMO4': '0.200', 'weapon5': '0.222', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '55.000'} [2024-08-06 07:29:07,963][52666] DAMAGECOUNT value on done: 857475.0 [2024-08-06 07:29:07,964][52666] Sum rewards: 77.833, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.272', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.178', 'AMMO3': '0.206', 'weapon5': '0.216', 'AMMO4': '0.242', 'weapon2': '0.364', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:08,021][52665] DAMAGECOUNT value on done: 867254.0 [2024-08-06 07:29:08,023][52665] Sum rewards: 73.674, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.008', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.124', 'weapon4': '0.144', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON4': '0.250', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.272', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:08,061][52649] DAMAGECOUNT value on done: 837476.0 [2024-08-06 07:29:08,062][52649] Sum rewards: 66.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.014', 'weapon5': '0.034', 'AMMO2': '0.049', 'weapon4': '0.062', 'AMMO3': '0.210', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.420', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '57.000'} [2024-08-06 07:29:08,274][52663] DAMAGECOUNT value on done: 856518.0 [2024-08-06 07:29:08,276][52663] Sum rewards: 74.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:08,319][52650] Updated weights for policy 0, policy_version 76841 (0.0022) [2024-08-06 07:29:08,542][52811] DAMAGECOUNT value on done: 813751.0 [2024-08-06 07:29:08,543][52811] Sum rewards: 70.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.697', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.094', 'AMMO4': '0.156', 'weapon5': '0.188', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '57.000'} [2024-08-06 07:29:09,475][52811] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 07:29:09,714][52647] DAMAGECOUNT value on done: 900764.0 [2024-08-06 07:29:09,716][52647] Sum rewards: 78.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.904', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon4': '0.194', 'weapon5': '0.206', 'AMMO3': '0.229', 'weapon2': '0.266', 'AMMO4': '0.330', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:09,941][52671] DAMAGECOUNT value on done: 871753.0 [2024-08-06 07:29:09,941][52671] Sum rewards: 63.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.124', 'weapon4': '0.168', 'AMMO3': '0.218', 'AMMO4': '0.232', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '52.000'} [2024-08-06 07:29:10,167][52664] DAMAGECOUNT value on done: 891772.0 [2024-08-06 07:29:10,167][52664] Sum rewards: 58.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.680', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.169', 'weapon5': '0.184', 'AMMO3': '0.303', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'HITCOUNT': '2.970', 'weapon3': '3.098', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '52.000'} [2024-08-06 07:29:10,715][52665] DAMAGECOUNT value on done: 858744.0 [2024-08-06 07:29:10,723][52665] Sum rewards: 72.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.158', 'AMMO5': '0.019', 'AMMO2': '0.068', 'weapon4': '0.190', 'AMMO3': '0.198', 'weapon5': '0.266', 'weapon2': '0.326', 'AMMO4': '0.339', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '59.000'} [2024-08-06 07:29:10,811][52649] DAMAGECOUNT value on done: 848833.0 [2024-08-06 07:29:10,814][52649] Sum rewards: 74.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.148', 'weapon5': '0.204', 'AMMO3': '0.206', 'AMMO4': '0.251', 'weapon2': '0.412', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:11,087][52670] DAMAGECOUNT value on done: 851478.0 [2024-08-06 07:29:11,087][52670] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.894', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.192', 'AMMO3': '0.221', 'WEAPON5': '0.350', 'weapon2': '0.374', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.808', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '54.000'} [2024-08-06 07:29:11,204][52666] DAMAGECOUNT value on done: 854561.0 [2024-08-06 07:29:11,206][52666] Sum rewards: 86.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.040', 'weapon5': '0.126', 'AMMO4': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.484', 'WEAPON3': '1.550', 'weapon3': '3.076', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '73.000'} [2024-08-06 07:29:11,718][52811] DAMAGECOUNT value on done: 819791.0 [2024-08-06 07:29:11,718][52811] Sum rewards: 84.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.445', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.490', 'WEAPON3': '1.700', 'weapon3': '3.170', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '71.000'} [2024-08-06 07:29:12,181][52647] DAMAGECOUNT value on done: 916473.0 [2024-08-06 07:29:12,183][52647] Sum rewards: 71.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.142', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '58.000'} [2024-08-06 07:29:12,322][52671] DAMAGECOUNT value on done: 877232.0 [2024-08-06 07:29:12,322][52671] Sum rewards: 76.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.022', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.164', 'AMMO4': '0.184', 'AMMO3': '0.205', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.644', 'WEAPON3': '1.300', 'weapon3': '2.722', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:12,672][52650] Updated weights for policy 0, policy_version 76851 (0.0028) [2024-08-06 07:29:12,753][52664] DAMAGECOUNT value on done: 904534.0 [2024-08-06 07:29:12,754][52664] Sum rewards: 83.427, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.450', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.070', 'weapon5': '0.188', 'AMMO4': '0.248', 'AMMO3': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.550', 'weapon3': '2.970', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.907', 'FRAGCOUNT': '71.000'} [2024-08-06 07:29:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 629563392. Throughput: 0: 4357.3. Samples: 157397990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:29:12,795][52567] Avg episode reward: [(0, '75.112')] [2024-08-06 07:29:13,498][52662] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 07:29:13,891][52665] DAMAGECOUNT value on done: 855596.0 [2024-08-06 07:29:13,891][52665] Sum rewards: 82.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.223', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.179', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '3.278', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:14,015][52649] DAMAGECOUNT value on done: 830625.0 [2024-08-06 07:29:14,017][52649] Sum rewards: 77.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.005', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.252', 'weapon4': '0.276', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '62.500'} [2024-08-06 07:29:14,407][52663] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:29:14,478][52670] DAMAGECOUNT value on done: 863561.0 [2024-08-06 07:29:14,478][52670] Sum rewards: 82.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.122', 'weapon4': '0.138', 'weapon2': '0.230', 'AMMO4': '0.231', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.254', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.670', 'FRAGCOUNT': '70.000'} [2024-08-06 07:29:14,568][52666] DAMAGECOUNT value on done: 862747.0 [2024-08-06 07:29:14,568][52666] Sum rewards: 75.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.434', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.178', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:14,746][52671] DAMAGECOUNT value on done: 862233.0 [2024-08-06 07:29:14,749][52671] Sum rewards: 83.026, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.183', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.222', 'WEAPON3': '1.150', 'weapon3': '3.552', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:14,757][52647] DAMAGECOUNT value on done: 905472.0 [2024-08-06 07:29:14,759][52647] Sum rewards: 64.438, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.121', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.096', 'AMMO4': '0.157', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.342', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '51.000'} [2024-08-06 07:29:14,811][52811] DAMAGECOUNT value on done: 810301.0 [2024-08-06 07:29:14,812][52811] Sum rewards: 74.128, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.194', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.160', 'AMMO4': '0.238', 'weapon2': '0.242', 'weapon5': '0.258', 'AMMO3': '0.283', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.952', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:15,363][52664] DAMAGECOUNT value on done: 900277.0 [2024-08-06 07:29:15,365][52664] Sum rewards: 77.132, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.074', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.313', 'weapon2': '0.414', 'WEAPON3': '1.750', 'weapon3': '3.192', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '67.000'} [2024-08-06 07:29:17,033][52665] DAMAGECOUNT value on done: 859904.0 [2024-08-06 07:29:17,037][52665] Sum rewards: 66.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.390', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.100', 'AMMO3': '0.195', 'AMMO4': '0.209', 'weapon4': '0.210', 'weapon2': '0.392', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '57.000'} [2024-08-06 07:29:17,115][52649] DAMAGECOUNT value on done: 853503.0 [2024-08-06 07:29:17,116][52649] Sum rewards: 79.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.200', 'AMMO3': '0.209', 'weapon5': '0.216', 'AMMO4': '0.226', 'weapon4': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:17,206][52670] DAMAGECOUNT value on done: 845509.0 [2024-08-06 07:29:17,208][52670] Sum rewards: 84.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.555', 'AMMO2': '0.009', 'AMMO4': '0.046', 'AMMO3': '0.174', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.528', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '68.000'} [2024-08-06 07:29:17,296][52647] DAMAGECOUNT value on done: 914587.0 [2024-08-06 07:29:17,297][52647] Sum rewards: 70.497, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.960', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.156', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.600', 'weapon3': '3.158', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:17,333][52666] DAMAGECOUNT value on done: 856376.0 [2024-08-06 07:29:17,334][52666] Sum rewards: 81.504, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.986', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.146', 'weapon5': '0.158', 'AMMO4': '0.219', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '68.000'} [2024-08-06 07:29:17,436][52650] Updated weights for policy 0, policy_version 76861 (0.0018) [2024-08-06 07:29:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 629645312. Throughput: 0: 4367.8. Samples: 157411250. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:17,794][52567] Avg episode reward: [(0, '74.873')] [2024-08-06 07:29:17,932][52811] DAMAGECOUNT value on done: 809882.0 [2024-08-06 07:29:17,936][52811] Sum rewards: 77.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.082', 'AMMO4': '0.181', 'weapon5': '0.182', 'AMMO3': '0.233', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:18,181][52664] DAMAGECOUNT value on done: 891016.0 [2024-08-06 07:29:18,181][52664] Sum rewards: 67.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.015', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '54.000'} [2024-08-06 07:29:19,941][52670] DAMAGECOUNT value on done: 860564.0 [2024-08-06 07:29:19,944][52670] Sum rewards: 64.432, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.272', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '54.000'} [2024-08-06 07:29:19,995][52666] DAMAGECOUNT value on done: 863592.0 [2024-08-06 07:29:19,998][52666] Sum rewards: 76.641, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.223', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.146', 'weapon2': '0.670', 'WEAPON3': '0.900', 'weapon3': '3.164', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '59.000'} [2024-08-06 07:29:20,173][52665] DAMAGECOUNT value on done: 851445.0 [2024-08-06 07:29:20,173][52665] Sum rewards: 80.305, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.021', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.084', 'weapon5': '0.200', 'AMMO3': '0.233', 'AMMO4': '0.289', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:20,192][52647] DAMAGECOUNT value on done: 915965.0 [2024-08-06 07:29:20,193][52647] Sum rewards: 81.719, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.352', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.182', 'AMMO4': '0.196', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '69.000'} [2024-08-06 07:29:20,283][52668] DAMAGECOUNT value on done: 872376.0 [2024-08-06 07:29:20,283][52668] Sum rewards: 75.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.947', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.046', 'AMMO4': '0.146', 'weapon5': '0.244', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:20,334][52649] DAMAGECOUNT value on done: 851372.0 [2024-08-06 07:29:20,334][52649] Sum rewards: 83.993, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.916', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.172', 'weapon5': '0.192', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '21.249', 'FRAGCOUNT': '69.000'} [2024-08-06 07:29:21,010][52811] DAMAGECOUNT value on done: 807228.0 [2024-08-06 07:29:21,012][52811] Sum rewards: 75.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.379', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.252', 'WEAPON3': '1.250', 'HITCOUNT': '3.360', 'weapon3': '3.534', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:21,160][52664] DAMAGECOUNT value on done: 889755.0 [2024-08-06 07:29:21,162][52664] Sum rewards: 71.395, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.037', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.279', 'weapon2': '0.360', 'WEAPON3': '1.750', 'weapon3': '3.372', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '62.500'} [2024-08-06 07:29:22,289][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:29:22,294][52650] Updated weights for policy 0, policy_version 76871 (0.0012) [2024-08-06 07:29:22,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 629735424. Throughput: 0: 4375.3. Samples: 157437660. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:22,794][52567] Avg episode reward: [(0, '74.812')] [2024-08-06 07:29:22,939][52647] DAMAGECOUNT value on done: 902365.0 [2024-08-06 07:29:22,939][52647] Sum rewards: 76.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.066', 'AMMO4': '0.133', 'weapon5': '0.134', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:22,969][52668] DAMAGECOUNT value on done: 873901.0 [2024-08-06 07:29:22,969][52668] Sum rewards: 78.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.086', 'weapon5': '0.124', 'AMMO4': '0.152', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:23,031][52670] DAMAGECOUNT value on done: 866602.0 [2024-08-06 07:29:23,031][52670] Sum rewards: 76.674, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.584', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.048', 'weapon4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.189', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:23,044][52665] DAMAGECOUNT value on done: 858466.0 [2024-08-06 07:29:23,045][52665] Sum rewards: 79.181, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.358', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '68.000'} [2024-08-06 07:29:23,112][52666] DAMAGECOUNT value on done: 847300.0 [2024-08-06 07:29:23,112][52666] Sum rewards: 74.511, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.483', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.104', 'AMMO3': '0.192', 'weapon2': '0.242', 'AMMO4': '0.251', 'weapon5': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:23,183][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:29:23,193][52649] DAMAGECOUNT value on done: 843449.0 [2024-08-06 07:29:23,193][52649] Sum rewards: 75.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.398', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.038', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:23,914][52664] DAMAGECOUNT value on done: 900627.0 [2024-08-06 07:29:23,915][52664] Sum rewards: 78.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.658', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.151', 'AMMO3': '0.201', 'weapon4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:24,079][52811] DAMAGECOUNT value on done: 810941.0 [2024-08-06 07:29:24,079][52811] Sum rewards: 73.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.902', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.202', 'weapon4': '0.234', 'weapon5': '0.266', 'AMMO4': '0.270', 'weapon2': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:25,679][52647] DAMAGECOUNT value on done: 907617.0 [2024-08-06 07:29:25,690][52647] Sum rewards: 76.583, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.606', 'AMMO5': '0.008', 'weapon4': '0.044', 'AMMO2': '0.045', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'AMMO3': '0.245', 'weapon2': '0.508', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:25,742][52670] DAMAGECOUNT value on done: 859652.0 [2024-08-06 07:29:25,742][52670] Sum rewards: 65.716, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon4': '0.278', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '56.000'} [2024-08-06 07:29:25,780][52665] DAMAGECOUNT value on done: 857977.0 [2024-08-06 07:29:25,781][52665] Sum rewards: 73.448, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.235', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.134', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.368', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '2.594', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:25,847][52666] DAMAGECOUNT value on done: 867347.0 [2024-08-06 07:29:25,847][52666] Sum rewards: 72.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.157', 'AMMO3': '0.193', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '59.000'} [2024-08-06 07:29:25,963][52668] DAMAGECOUNT value on done: 867723.0 [2024-08-06 07:29:25,966][52668] Sum rewards: 68.973, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.019', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.098', 'AMMO4': '0.121', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '59.000'} [2024-08-06 07:29:26,574][52664] DAMAGECOUNT value on done: 896632.0 [2024-08-06 07:29:26,575][52664] Sum rewards: 75.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.315', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.050', 'AMMO4': '0.146', 'weapon5': '0.220', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:26,871][52650] Updated weights for policy 0, policy_version 76881 (0.0035) [2024-08-06 07:29:27,156][52811] DAMAGECOUNT value on done: 815371.0 [2024-08-06 07:29:27,157][52811] Sum rewards: 87.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.268', 'AMMO5': '0.017', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.108', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '2.762', 'HITCOUNT': '4.350', 'DAMAGECOUNT': '21.168', 'FRAGCOUNT': '72.000'} [2024-08-06 07:29:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 629817344. Throughput: 0: 4375.1. Samples: 157463870. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:27,794][52567] Avg episode reward: [(0, '74.794')] [2024-08-06 07:29:28,421][52647] DAMAGECOUNT value on done: 901744.0 [2024-08-06 07:29:28,421][52647] Sum rewards: 77.936, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.063', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.122', 'AMMO3': '0.164', 'weapon5': '0.164', 'AMMO4': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:28,730][52670] DAMAGECOUNT value on done: 841278.0 [2024-08-06 07:29:28,731][52670] Sum rewards: 75.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.038', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'weapon2': '0.230', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:28,738][52665] DAMAGECOUNT value on done: 850090.0 [2024-08-06 07:29:28,739][52665] Sum rewards: 79.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon2': '0.186', 'weapon5': '0.216', 'weapon4': '0.246', 'AMMO3': '0.253', 'AMMO4': '0.272', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.062', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '67.000'} [2024-08-06 07:29:28,823][52666] DAMAGECOUNT value on done: 862367.0 [2024-08-06 07:29:28,824][52666] Sum rewards: 73.615, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.142', 'AMMO5': '0.011', 'AMMO2': '0.062', 'weapon5': '0.166', 'weapon4': '0.188', 'AMMO3': '0.213', 'AMMO4': '0.312', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.970', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '61.000'} [2024-08-06 07:29:28,889][52668] DAMAGECOUNT value on done: 873744.0 [2024-08-06 07:29:28,889][52668] Sum rewards: 70.795, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.116', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '55.000'} [2024-08-06 07:29:29,342][52664] DAMAGECOUNT value on done: 906412.0 [2024-08-06 07:29:29,342][52664] Sum rewards: 82.511, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.111', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'weapon4': '0.170', 'AMMO3': '0.246', 'weapon2': '0.308', 'WEAPON3': '1.650', 'weapon3': '3.286', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '70.000'} [2024-08-06 07:29:30,111][52803] DAMAGECOUNT value on done: 806236.0 [2024-08-06 07:29:30,113][52803] Sum rewards: 84.135, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.585', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.102', 'AMMO3': '0.172', 'weapon2': '0.242', 'WEAPON3': '1.050', 'weapon3': '3.562', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:30,219][52811] DAMAGECOUNT value on done: 819980.0 [2024-08-06 07:29:30,220][52811] Sum rewards: 77.212, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.204', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:30,749][52647] DAMAGECOUNT value on done: 903765.0 [2024-08-06 07:29:30,749][52647] Sum rewards: 76.813, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.685', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.108', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.380', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:31,443][52670] DAMAGECOUNT value on done: 856380.0 [2024-08-06 07:29:31,445][52670] Sum rewards: 64.050, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'HEALTH': '0.125', 'AMMO3': '0.166', 'weapon2': '0.844', 'WEAPON3': '0.900', 'weapon3': '2.936', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '50.000'} [2024-08-06 07:29:31,510][52666] DAMAGECOUNT value on done: 860460.0 [2024-08-06 07:29:31,511][52666] Sum rewards: 64.587, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.570', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.093', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.508', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '52.000'} [2024-08-06 07:29:31,564][52650] Updated weights for policy 0, policy_version 76891 (0.0035) [2024-08-06 07:29:31,692][52668] DAMAGECOUNT value on done: 860364.0 [2024-08-06 07:29:31,692][52668] Sum rewards: 69.923, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.005', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.120', 'weapon5': '0.190', 'AMMO4': '0.200', 'weapon2': '0.250', 'AMMO3': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.148', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:31,720][52664] DAMAGECOUNT value on done: 905090.0 [2024-08-06 07:29:31,720][52664] Sum rewards: 75.119, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.769', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.086', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '59.000'} [2024-08-06 07:29:31,838][52665] DAMAGECOUNT value on done: 853933.0 [2024-08-06 07:29:31,838][52665] Sum rewards: 70.801, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.090', 'weapon5': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.392', 'WEAPON3': '1.550', 'weapon3': '3.282', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '61.000'} [2024-08-06 07:29:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 629915648. Throughput: 0: 4369.3. Samples: 157476920. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:32,794][52567] Avg episode reward: [(0, '74.361')] [2024-08-06 07:29:33,242][52803] DAMAGECOUNT value on done: 803115.0 [2024-08-06 07:29:33,243][52803] Sum rewards: 72.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.907', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.151', 'weapon4': '0.204', 'AMMO3': '0.206', 'weapon2': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:33,286][52811] DAMAGECOUNT value on done: 805442.0 [2024-08-06 07:29:33,288][52811] Sum rewards: 78.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.535', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.129', 'weapon5': '0.162', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.302', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:34,254][52670] DAMAGECOUNT value on done: 867172.0 [2024-08-06 07:29:34,254][52670] Sum rewards: 76.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.503', 'AMMO5': '0.021', 'AMMO2': '0.031', 'weapon4': '0.084', 'AMMO4': '0.157', 'AMMO3': '0.222', 'weapon5': '0.226', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:34,282][52664] DAMAGECOUNT value on done: 903926.0 [2024-08-06 07:29:34,283][52664] Sum rewards: 87.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.135', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.228', 'WEAPON3': '1.450', 'weapon3': '3.540', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.892', 'FRAGCOUNT': '72.000'} [2024-08-06 07:29:34,286][52666] DAMAGECOUNT value on done: 855159.0 [2024-08-06 07:29:34,286][52666] Sum rewards: 76.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.154', 'AMMO3': '0.164', 'AMMO4': '0.210', 'weapon2': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.256', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:34,362][52668] DAMAGECOUNT value on done: 868467.0 [2024-08-06 07:29:34,362][52668] Sum rewards: 73.076, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.440', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon2': '0.160', 'AMMO3': '0.297', 'WEAPON3': '1.650', 'HITCOUNT': '3.550', 'weapon3': '3.654', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:34,968][52665] DAMAGECOUNT value on done: 859922.0 [2024-08-06 07:29:34,970][52665] Sum rewards: 81.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.742', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.126', 'weapon5': '0.138', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:36,433][52650] Updated weights for policy 0, policy_version 76901 (0.0034) [2024-08-06 07:29:36,490][52811] DAMAGECOUNT value on done: 807266.0 [2024-08-06 07:29:36,490][52811] Sum rewards: 78.352, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.780', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.038', 'weapon5': '0.038', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon2': '0.524', 'WEAPON3': '0.950', 'weapon3': '3.246', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:36,494][52803] DAMAGECOUNT value on done: 811878.0 [2024-08-06 07:29:36,495][52803] Sum rewards: 88.692, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.028', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.140', 'AMMO4': '0.156', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '70.000'} [2024-08-06 07:29:36,879][52662] DAMAGECOUNT value on done: 865435.0 [2024-08-06 07:29:36,879][52662] Sum rewards: 72.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.056', 'weapon5': '0.086', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.744', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 07:29:37,109][52664] DAMAGECOUNT value on done: 915590.0 [2024-08-06 07:29:37,110][52664] Sum rewards: 85.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.935', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.328', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '72.000'} [2024-08-06 07:29:37,390][52666] DAMAGECOUNT value on done: 854615.0 [2024-08-06 07:29:37,391][52666] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.395', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO4': '0.030', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.290', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '57.000'} [2024-08-06 07:29:37,423][52670] DAMAGECOUNT value on done: 858581.0 [2024-08-06 07:29:37,424][52670] Sum rewards: 82.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.658', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.092', 'weapon5': '0.134', 'AMMO4': '0.143', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '67.000'} [2024-08-06 07:29:37,550][52668] DAMAGECOUNT value on done: 871915.0 [2024-08-06 07:29:37,552][52668] Sum rewards: 82.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.187', 'AMMO3': '0.211', 'weapon2': '0.262', 'weapon4': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '70.000'} [2024-08-06 07:29:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 629997568. Throughput: 0: 4368.2. Samples: 157502890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:37,795][52567] Avg episode reward: [(0, '74.996')] [2024-08-06 07:29:38,107][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:29:38,987][52670] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 07:29:39,520][52803] DAMAGECOUNT value on done: 810892.0 [2024-08-06 07:29:39,521][52803] Sum rewards: 76.885, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.400', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.124', 'AMMO4': '0.130', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:39,906][52662] DAMAGECOUNT value on done: 876637.0 [2024-08-06 07:29:39,907][52662] Sum rewards: 85.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.078', 'weapon4': '0.108', 'AMMO4': '0.147', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.730', 'FRAGCOUNT': '72.000'} [2024-08-06 07:29:39,913][52664] DAMAGECOUNT value on done: 910512.0 [2024-08-06 07:29:39,915][52664] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.864', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.184', 'weapon5': '0.338', 'AMMO4': '0.339', 'weapon2': '0.346', 'weapon4': '0.506', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.498', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 07:29:40,365][52668] DAMAGECOUNT value on done: 860413.0 [2024-08-06 07:29:40,367][52668] Sum rewards: 87.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '72.000'} [2024-08-06 07:29:40,600][52666] DAMAGECOUNT value on done: 871646.0 [2024-08-06 07:29:40,603][52666] Sum rewards: 89.316, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.211', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.282', 'FRAGCOUNT': '74.000'} [2024-08-06 07:29:40,714][52670] DAMAGECOUNT value on done: 860766.0 [2024-08-06 07:29:40,716][52670] Sum rewards: 70.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.086', 'AMMO4': '0.131', 'weapon5': '0.146', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '56.500'} [2024-08-06 07:29:40,940][52650] Updated weights for policy 0, policy_version 76911 (0.0017) [2024-08-06 07:29:41,113][52671] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:29:41,821][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:29:42,325][52664] DAMAGECOUNT value on done: 909910.0 [2024-08-06 07:29:42,325][52664] Sum rewards: 63.774, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.944', 'AMMO5': '0.024', 'AMMO2': '0.070', 'weapon4': '0.228', 'AMMO3': '0.241', 'weapon5': '0.284', 'weapon2': '0.334', 'AMMO4': '0.349', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '55.000'} [2024-08-06 07:29:42,535][52662] DAMAGECOUNT value on done: 876337.0 [2024-08-06 07:29:42,536][52662] Sum rewards: 75.106, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.981', 'AMMO5': '0.025', 'AMMO2': '0.066', 'AMMO3': '0.212', 'weapon4': '0.268', 'weapon5': '0.310', 'AMMO4': '0.332', 'weapon2': '0.508', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.534', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '62.000'} [2024-08-06 07:29:42,622][52803] DAMAGECOUNT value on done: 807559.0 [2024-08-06 07:29:42,623][52803] Sum rewards: 67.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.124', 'weapon5': '0.132', 'AMMO3': '0.241', 'AMMO4': '0.242', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '57.000'} [2024-08-06 07:29:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 630087680. Throughput: 0: 4371.8. Samples: 157529150. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:42,794][52567] Avg episode reward: [(0, '75.449')] [2024-08-06 07:29:43,260][52668] DAMAGECOUNT value on done: 863265.0 [2024-08-06 07:29:43,263][52668] Sum rewards: 70.248, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.635', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.162', 'AMMO4': '0.220', 'weapon2': '0.238', 'AMMO3': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.210', 'weapon3': '3.294', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:43,789][52666] DAMAGECOUNT value on done: 847179.0 [2024-08-06 07:29:43,790][52666] Sum rewards: 87.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.120', 'weapon2': '0.174', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.424', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.271', 'FRAGCOUNT': '71.000'} [2024-08-06 07:29:44,445][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:29:44,929][52820] DAMAGECOUNT value on done: 802719.0 [2024-08-06 07:29:44,929][52820] Sum rewards: 81.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.101', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.125', 'weapon5': '0.128', 'weapon2': '0.154', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.478', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '68.000'} [2024-08-06 07:29:45,109][52664] DAMAGECOUNT value on done: 893835.0 [2024-08-06 07:29:45,109][52664] Sum rewards: 72.517, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.939', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.140', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:45,566][52650] Updated weights for policy 0, policy_version 76921 (0.0013) [2024-08-06 07:29:45,575][52662] DAMAGECOUNT value on done: 861764.0 [2024-08-06 07:29:45,575][52662] Sum rewards: 59.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.062', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon5': '0.060', 'weapon4': '0.062', 'AMMO4': '0.128', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.300', 'HITCOUNT': '3.030', 'weapon3': '3.384', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '51.000'} [2024-08-06 07:29:45,742][52803] DAMAGECOUNT value on done: 807123.0 [2024-08-06 07:29:45,743][52803] Sum rewards: 67.665, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.959', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon2': '0.658', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '55.000'} [2024-08-06 07:29:46,225][52668] DAMAGECOUNT value on done: 871632.0 [2024-08-06 07:29:46,229][52668] Sum rewards: 72.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.142', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.270', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '58.000'} [2024-08-06 07:29:46,454][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:29:46,679][52666] DAMAGECOUNT value on done: 855183.0 [2024-08-06 07:29:46,679][52666] Sum rewards: 76.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.094', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:47,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 630177792. Throughput: 0: 4376.7. Samples: 157542230. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:47,794][52567] Avg episode reward: [(0, '75.521')] [2024-08-06 07:29:47,892][52664] DAMAGECOUNT value on done: 898196.0 [2024-08-06 07:29:47,893][52664] Sum rewards: 62.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.918', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.092', 'AMMO3': '0.198', 'weapon5': '0.202', 'AMMO4': '0.305', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.860', 'weapon3': '3.082', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '52.500'} [2024-08-06 07:29:48,113][52820] DAMAGECOUNT value on done: 803086.0 [2024-08-06 07:29:48,113][52820] Sum rewards: 69.158, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.025', 'AMMO5': '0.026', 'AMMO2': '0.076', 'AMMO3': '0.222', 'weapon5': '0.242', 'weapon2': '0.294', 'AMMO4': '0.379', 'weapon4': '0.454', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.680', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:48,303][52662] DAMAGECOUNT value on done: 879910.0 [2024-08-06 07:29:48,304][52662] Sum rewards: 77.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.304', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.154', 'weapon5': '0.154', 'AMMO3': '0.192', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.620', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:48,657][52803] DAMAGECOUNT value on done: 801928.0 [2024-08-06 07:29:48,657][52803] Sum rewards: 76.101, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.029', 'AMMO5': '0.008', 'weapon4': '0.040', 'AMMO2': '0.040', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'weapon2': '0.256', 'AMMO3': '0.313', 'WEAPON3': '1.900', 'weapon3': '3.320', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '68.000'} [2024-08-06 07:29:48,746][52668] DAMAGECOUNT value on done: 862322.0 [2024-08-06 07:29:48,746][52668] Sum rewards: 74.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.096', 'weapon5': '0.180', 'AMMO4': '0.188', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '61.000'} [2024-08-06 07:29:50,277][52650] Updated weights for policy 0, policy_version 76931 (0.0024) [2024-08-06 07:29:50,744][52662] DAMAGECOUNT value on done: 858559.0 [2024-08-06 07:29:50,746][52662] Sum rewards: 61.245, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.736', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.106', 'AMMO4': '0.118', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.650', 'weapon3': '3.028', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '55.000'} [2024-08-06 07:29:51,121][52664] DAMAGECOUNT value on done: 902881.0 [2024-08-06 07:29:51,121][52664] Sum rewards: 83.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '68.000'} [2024-08-06 07:29:51,236][52820] DAMAGECOUNT value on done: 803201.0 [2024-08-06 07:29:51,236][52820] Sum rewards: 84.945, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.725', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.282', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '67.000'} [2024-08-06 07:29:51,712][52803] DAMAGECOUNT value on done: 802060.0 [2024-08-06 07:29:51,725][52803] Sum rewards: 79.297, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.695', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.070', 'AMMO4': '0.107', 'AMMO3': '0.142', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:51,773][52668] DAMAGECOUNT value on done: 858978.0 [2024-08-06 07:29:51,778][52668] Sum rewards: 69.481, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.385', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon4': '0.172', 'AMMO3': '0.175', 'weapon2': '0.860', 'WEAPON3': '1.000', 'weapon3': '2.782', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '55.000'} [2024-08-06 07:29:52,489][52667] DAMAGECOUNT value on done: 867501.0 [2024-08-06 07:29:52,494][52667] Sum rewards: 80.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.895', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.084', 'weapon5': '0.114', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 630259712. Throughput: 0: 4380.9. Samples: 157568660. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:52,794][52567] Avg episode reward: [(0, '75.966')] [2024-08-06 07:29:53,736][52664] DAMAGECOUNT value on done: 894056.0 [2024-08-06 07:29:53,736][52664] Sum rewards: 77.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.467', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.035', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.540', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:53,886][52662] DAMAGECOUNT value on done: 864341.0 [2024-08-06 07:29:53,887][52662] Sum rewards: 72.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.050', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.087', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.320', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '58.000'} [2024-08-06 07:29:54,425][52820] DAMAGECOUNT value on done: 791103.0 [2024-08-06 07:29:54,428][52820] Sum rewards: 67.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.575', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO3': '0.192', 'AMMO4': '0.231', 'weapon2': '0.258', 'weapon4': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.026', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '55.000'} [2024-08-06 07:29:54,848][52668] DAMAGECOUNT value on done: 856911.0 [2024-08-06 07:29:54,849][52668] Sum rewards: 76.892, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.231', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.122', 'weapon2': '0.176', 'weapon4': '0.204', 'AMMO3': '0.240', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:54,855][52803] DAMAGECOUNT value on done: 808662.0 [2024-08-06 07:29:54,856][52803] Sum rewards: 76.303, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.608', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.114', 'AMMO4': '0.171', 'weapon5': '0.184', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '2.996', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 07:29:55,050][52650] Updated weights for policy 0, policy_version 76941 (0.0016) [2024-08-06 07:29:55,633][52667] DAMAGECOUNT value on done: 878195.0 [2024-08-06 07:29:55,634][52667] Sum rewards: 88.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.498', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.100', 'weapon5': '0.162', 'AMMO4': '0.173', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.852', 'FRAGCOUNT': '70.000'} [2024-08-06 07:29:56,248][52795] DAMAGECOUNT value on done: 804103.0 [2024-08-06 07:29:56,250][52795] Sum rewards: 76.521, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.740', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.099', 'weapon5': '0.130', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.312', 'WEAPON3': '1.800', 'weapon3': '3.432', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '66.000'} [2024-08-06 07:29:56,558][52662] DAMAGECOUNT value on done: 882706.0 [2024-08-06 07:29:56,559][52662] Sum rewards: 80.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.525', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.170', 'AMMO3': '0.203', 'weapon4': '0.218', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '67.000'} [2024-08-06 07:29:57,578][52820] DAMAGECOUNT value on done: 805286.0 [2024-08-06 07:29:57,579][52820] Sum rewards: 76.640, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.787', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.126', 'AMMO3': '0.146', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '0.950', 'weapon3': '3.174', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 07:29:57,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 630341632. Throughput: 0: 4376.9. Samples: 157594950. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:29:57,795][52567] Avg episode reward: [(0, '75.811')] [2024-08-06 07:29:58,053][52668] DAMAGECOUNT value on done: 857367.0 [2024-08-06 07:29:58,053][52668] Sum rewards: 78.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.435', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon2': '0.152', 'AMMO4': '0.172', 'weapon5': '0.174', 'AMMO3': '0.197', 'weapon4': '0.198', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:58,192][52803] DAMAGECOUNT value on done: 802644.0 [2024-08-06 07:29:58,193][52803] Sum rewards: 76.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.193', 'weapon2': '0.274', 'WEAPON3': '1.250', 'HITCOUNT': '3.500', 'weapon3': '3.502', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '63.000'} [2024-08-06 07:29:58,594][52667] DAMAGECOUNT value on done: 874216.0 [2024-08-06 07:29:58,595][52667] Sum rewards: 80.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.937', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO4': '0.169', 'weapon5': '0.186', 'AMMO3': '0.191', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:59,355][52662] DAMAGECOUNT value on done: 867150.0 [2024-08-06 07:29:59,357][52662] Sum rewards: 69.219, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.170', 'AMMO3': '0.217', 'weapon5': '0.288', 'AMMO4': '0.298', 'weapon2': '0.318', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '56.000'} [2024-08-06 07:29:59,427][52795] DAMAGECOUNT value on done: 790580.0 [2024-08-06 07:29:59,428][52795] Sum rewards: 77.428, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.126', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.100', 'AMMO3': '0.224', 'AMMO4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.300', 'weapon3': '2.904', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '65.000'} [2024-08-06 07:29:59,555][52650] Updated weights for policy 0, policy_version 76951 (0.0020) [2024-08-06 07:30:00,761][52820] DAMAGECOUNT value on done: 791495.0 [2024-08-06 07:30:00,762][52820] Sum rewards: 87.631, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.060', 'weapon5': '0.078', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '72.000'} [2024-08-06 07:30:01,174][52803] DAMAGECOUNT value on done: 818137.0 [2024-08-06 07:30:01,175][52803] Sum rewards: 79.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.125', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '67.000'} [2024-08-06 07:30:01,233][52668] DAMAGECOUNT value on done: 852847.0 [2024-08-06 07:30:01,236][52668] Sum rewards: 83.173, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.538', 'AMMO5': '0.023', 'AMMO2': '0.039', 'weapon4': '0.082', 'weapon5': '0.166', 'AMMO4': '0.194', 'AMMO3': '0.230', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '70.500'} [2024-08-06 07:30:01,652][52667] DAMAGECOUNT value on done: 878095.0 [2024-08-06 07:30:01,652][52667] Sum rewards: 72.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.324', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon4': '0.208', 'weapon2': '0.302', 'WEAPON3': '1.100', 'weapon3': '3.294', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '58.000'} [2024-08-06 07:30:02,532][52662] DAMAGECOUNT value on done: 874694.0 [2024-08-06 07:30:02,533][52662] Sum rewards: 72.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.143', 'weapon5': '0.160', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:02,685][52795] DAMAGECOUNT value on done: 796046.0 [2024-08-06 07:30:02,695][52795] Sum rewards: 79.468, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.235', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.428', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '65.000'} [2024-08-06 07:30:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 630431744. Throughput: 0: 4373.3. Samples: 157608050. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:02,794][52567] Avg episode reward: [(0, '76.053')] [2024-08-06 07:30:03,943][52820] DAMAGECOUNT value on done: 796476.0 [2024-08-06 07:30:03,944][52820] Sum rewards: 75.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.192', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.108', 'AMMO3': '0.214', 'AMMO4': '0.259', 'weapon5': '0.268', 'weapon2': '0.352', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:04,248][52650] Updated weights for policy 0, policy_version 76961 (0.0027) [2024-08-06 07:30:04,327][52668] DAMAGECOUNT value on done: 864626.0 [2024-08-06 07:30:04,328][52668] Sum rewards: 76.188, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.872', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.084', 'weapon5': '0.158', 'AMMO4': '0.206', 'AMMO3': '0.313', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.750', 'weapon3': '3.016', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '68.000'} [2024-08-06 07:30:04,427][52803] DAMAGECOUNT value on done: 811374.0 [2024-08-06 07:30:04,429][52803] Sum rewards: 85.663, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.140', 'AMMO5': '0.022', 'AMMO2': '0.074', 'weapon4': '0.104', 'weapon5': '0.260', 'AMMO3': '0.294', 'AMMO4': '0.369', 'weapon2': '0.444', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.884', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.822', 'FRAGCOUNT': '73.000'} [2024-08-06 07:30:04,777][52667] DAMAGECOUNT value on done: 881521.0 [2024-08-06 07:30:04,779][52667] Sum rewards: 83.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.340', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.068', 'weapon5': '0.236', 'AMMO3': '0.239', 'AMMO4': '0.239', 'weapon2': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.174', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.967', 'FRAGCOUNT': '69.000'} [2024-08-06 07:30:05,566][52662] DAMAGECOUNT value on done: 865373.0 [2024-08-06 07:30:05,566][52662] Sum rewards: 71.289, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.116', 'weapon5': '0.136', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.182', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 07:30:05,784][52795] DAMAGECOUNT value on done: 806440.0 [2024-08-06 07:30:05,786][52795] Sum rewards: 74.287, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.850', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.298', 'WEAPON3': '1.850', 'weapon3': '3.542', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '65.000'} [2024-08-06 07:30:07,238][52820] DAMAGECOUNT value on done: 799728.0 [2024-08-06 07:30:07,238][52820] Sum rewards: 66.474, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.810', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.169', 'weapon5': '0.170', 'weapon4': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '53.000'} [2024-08-06 07:30:07,497][52668] DAMAGECOUNT value on done: 868089.0 [2024-08-06 07:30:07,497][52668] Sum rewards: 70.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.458', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '58.000'} [2024-08-06 07:30:07,497][52667] DAMAGECOUNT value on done: 879170.0 [2024-08-06 07:30:07,500][52667] Sum rewards: 78.367, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'HEALTH': '0.115', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.288', 'weapon5': '0.294', 'weapon4': '0.324', 'WEAPON3': '0.950', 'weapon3': '2.898', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:07,516][52803] DAMAGECOUNT value on done: 804533.0 [2024-08-06 07:30:07,516][52803] Sum rewards: 74.003, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.265', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.100', 'weapon5': '0.132', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:07,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 630521856. Throughput: 0: 4368.4. Samples: 157634240. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:07,802][52567] Avg episode reward: [(0, '76.072')] [2024-08-06 07:30:08,127][52660] DAMAGECOUNT value on done: 863384.0 [2024-08-06 07:30:08,131][52660] Sum rewards: 83.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.137', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '67.000'} [2024-08-06 07:30:08,827][52662] DAMAGECOUNT value on done: 867487.0 [2024-08-06 07:30:08,829][52662] Sum rewards: 74.412, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.128', 'weapon5': '0.182', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '63.000'} [2024-08-06 07:30:08,890][52795] DAMAGECOUNT value on done: 792891.0 [2024-08-06 07:30:08,891][52795] Sum rewards: 69.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.740', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.138', 'weapon4': '0.174', 'AMMO3': '0.277', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:08,994][52650] Updated weights for policy 0, policy_version 76971 (0.0045) [2024-08-06 07:30:09,912][52667] DAMAGECOUNT value on done: 872922.0 [2024-08-06 07:30:09,915][52667] Sum rewards: 66.105, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.934', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.098', 'AMMO4': '0.188', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '54.000'} [2024-08-06 07:30:10,282][52820] DAMAGECOUNT value on done: 805652.0 [2024-08-06 07:30:10,284][52820] Sum rewards: 84.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.124', 'AMMO4': '0.149', 'weapon5': '0.198', 'AMMO3': '0.234', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '69.000'} [2024-08-06 07:30:10,537][52668] DAMAGECOUNT value on done: 865611.0 [2024-08-06 07:30:10,540][52668] Sum rewards: 72.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.036', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.262', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:10,584][52803] DAMAGECOUNT value on done: 820802.0 [2024-08-06 07:30:10,585][52803] Sum rewards: 80.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.318', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.064', 'weapon5': '0.150', 'AMMO3': '0.197', 'AMMO4': '0.244', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.188', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '67.000'} [2024-08-06 07:30:11,027][52660] DAMAGECOUNT value on done: 856880.0 [2024-08-06 07:30:11,028][52660] Sum rewards: 76.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.070', 'AMMO4': '0.187', 'AMMO3': '0.248', 'weapon5': '0.254', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.000', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '65.000'} [2024-08-06 07:30:11,478][52662] DAMAGECOUNT value on done: 860615.0 [2024-08-06 07:30:11,479][52662] Sum rewards: 67.582, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.090', 'AMMO4': '0.216', 'weapon5': '0.216', 'AMMO3': '0.235', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '57.000'} [2024-08-06 07:30:11,994][52795] DAMAGECOUNT value on done: 799420.0 [2024-08-06 07:30:11,998][52795] Sum rewards: 61.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.327', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.100', 'AMMO4': '0.137', 'weapon5': '0.176', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '50.500'} [2024-08-06 07:30:12,753][52667] DAMAGECOUNT value on done: 870987.0 [2024-08-06 07:30:12,755][52667] Sum rewards: 85.863, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.775', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.038', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.268', 'weapon2': '0.344', 'WEAPON3': '1.750', 'weapon3': '3.406', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.420', 'FRAGCOUNT': '73.000'} [2024-08-06 07:30:12,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 630611968. Throughput: 0: 4363.6. Samples: 157660230. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:12,794][52567] Avg episode reward: [(0, '76.041')] [2024-08-06 07:30:13,081][52668] DAMAGECOUNT value on done: 871219.0 [2024-08-06 07:30:13,089][52668] Sum rewards: 60.772, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.299', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.058', 'AMMO3': '0.167', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.164', 'DAMAGECOUNT': '14.997', 'FRAGCOUNT': '49.000'} [2024-08-06 07:30:13,421][52820] DAMAGECOUNT value on done: 813125.0 [2024-08-06 07:30:13,421][52820] Sum rewards: 75.336, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.134', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.308', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '63.000'} [2024-08-06 07:30:13,636][52660] DAMAGECOUNT value on done: 867440.0 [2024-08-06 07:30:13,637][52660] Sum rewards: 63.376, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.120', 'AMMO4': '0.146', 'AMMO3': '0.201', 'weapon5': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.896', 'WEAPON3': '1.250', 'weapon3': '2.422', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '53.000'} [2024-08-06 07:30:13,718][52803] DAMAGECOUNT value on done: 804415.0 [2024-08-06 07:30:13,719][52803] Sum rewards: 62.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.054', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.336', 'DAMAGECOUNT': '15.069', 'FRAGCOUNT': '52.000'} [2024-08-06 07:30:13,950][52650] Updated weights for policy 0, policy_version 76981 (0.0013) [2024-08-06 07:30:14,382][52662] DAMAGECOUNT value on done: 871819.0 [2024-08-06 07:30:14,382][52662] Sum rewards: 73.199, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.706', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.134', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'weapon2': '0.624', 'WEAPON3': '1.200', 'weapon3': '2.760', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:15,132][52795] DAMAGECOUNT value on done: 809250.0 [2024-08-06 07:30:15,132][52795] Sum rewards: 77.745, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.355', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon2': '0.748', 'WEAPON3': '1.000', 'weapon3': '3.084', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '62.000'} [2024-08-06 07:30:15,436][52667] DAMAGECOUNT value on done: 871605.0 [2024-08-06 07:30:15,437][52667] Sum rewards: 63.279, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.998', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.061', 'weapon4': '0.116', 'weapon5': '0.278', 'AMMO3': '0.290', 'AMMO4': '0.304', 'weapon2': '0.556', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.700', 'weapon3': '2.618', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '57.000'} [2024-08-06 07:30:15,988][52668] DAMAGECOUNT value on done: 871151.0 [2024-08-06 07:30:15,988][52668] Sum rewards: 70.132, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.266', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.078', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:16,588][52820] DAMAGECOUNT value on done: 794151.0 [2024-08-06 07:30:16,589][52820] Sum rewards: 76.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.587', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.136', 'AMMO4': '0.149', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '63.000'} [2024-08-06 07:30:16,653][52660] DAMAGECOUNT value on done: 879730.0 [2024-08-06 07:30:16,653][52660] Sum rewards: 73.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.996', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.146', 'AMMO4': '0.182', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:16,764][52803] DAMAGECOUNT value on done: 808655.0 [2024-08-06 07:30:16,764][52803] Sum rewards: 73.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.970', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.030', 'weapon5': '0.042', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.446', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:17,388][52662] DAMAGECOUNT value on done: 860026.0 [2024-08-06 07:30:17,388][52662] Sum rewards: 53.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.603', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.214', 'weapon4': '0.214', 'weapon5': '0.244', 'AMMO4': '0.275', 'weapon2': '0.486', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.754', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '44.500'} [2024-08-06 07:30:17,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 630702080. Throughput: 0: 4367.8. Samples: 157673470. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:17,795][52567] Avg episode reward: [(0, '74.988')] [2024-08-06 07:30:18,185][52667] DAMAGECOUNT value on done: 879189.0 [2024-08-06 07:30:18,186][52667] Sum rewards: 90.540, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.185', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.076', 'AMMO4': '0.188', 'AMMO3': '0.202', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '74.000'} [2024-08-06 07:30:18,206][52795] DAMAGECOUNT value on done: 800250.0 [2024-08-06 07:30:18,209][52795] Sum rewards: 84.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.140', 'AMMO4': '0.222', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon4': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '71.000'} [2024-08-06 07:30:18,376][52650] Updated weights for policy 0, policy_version 76991 (0.0020) [2024-08-06 07:30:19,472][52660] DAMAGECOUNT value on done: 861376.0 [2024-08-06 07:30:19,472][52660] Sum rewards: 74.749, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.084', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.110', 'weapon5': '0.112', 'AMMO4': '0.151', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '62.000'} [2024-08-06 07:30:19,698][52820] DAMAGECOUNT value on done: 804720.0 [2024-08-06 07:30:19,699][52820] Sum rewards: 64.974, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.098', 'weapon5': '0.144', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.162', 'DAMAGECOUNT': '15.417', 'FRAGCOUNT': '53.000'} [2024-08-06 07:30:19,775][52803] DAMAGECOUNT value on done: 814376.0 [2024-08-06 07:30:19,776][52803] Sum rewards: 74.394, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.859', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO2': '0.048', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'AMMO4': '0.242', 'weapon2': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '3.380', 'weapon3': '3.418', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:19,800][52659] DAMAGECOUNT value on done: 870887.0 [2024-08-06 07:30:19,801][52659] Sum rewards: 89.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.618', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.166', 'AMMO4': '0.171', 'AMMO3': '0.201', 'weapon5': '0.210', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '72.000'} [2024-08-06 07:30:20,682][52662] DAMAGECOUNT value on done: 878955.0 [2024-08-06 07:30:20,682][52662] Sum rewards: 62.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.236', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.124', 'weapon5': '0.178', 'AMMO4': '0.189', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.350', 'weapon3': '2.768', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 07:30:21,158][52667] DAMAGECOUNT value on done: 865812.0 [2024-08-06 07:30:21,160][52667] Sum rewards: 82.411, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.490', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.122', 'weapon4': '0.196', 'AMMO4': '0.200', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '69.000'} [2024-08-06 07:30:21,352][52795] DAMAGECOUNT value on done: 804952.0 [2024-08-06 07:30:21,356][52795] Sum rewards: 69.588, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:22,220][52660] DAMAGECOUNT value on done: 860228.0 [2024-08-06 07:30:22,220][52660] Sum rewards: 77.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.192', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.160', 'AMMO4': '0.166', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '64.000'} [2024-08-06 07:30:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 630784000. Throughput: 0: 4370.0. Samples: 157699540. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:22,794][52567] Avg episode reward: [(0, '75.337')] [2024-08-06 07:30:22,845][52820] DAMAGECOUNT value on done: 817019.0 [2024-08-06 07:30:22,846][52820] Sum rewards: 83.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.510', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.068', 'AMMO3': '0.189', 'AMMO4': '0.196', 'weapon5': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.860', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '68.000'} [2024-08-06 07:30:22,990][52803] DAMAGECOUNT value on done: 818061.0 [2024-08-06 07:30:22,992][52803] Sum rewards: 75.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.157', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '63.500'} [2024-08-06 07:30:23,016][52659] DAMAGECOUNT value on done: 866967.0 [2024-08-06 07:30:23,017][52659] Sum rewards: 72.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.348', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.139', 'weapon2': '0.168', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:23,246][52650] Updated weights for policy 0, policy_version 77001 (0.0026) [2024-08-06 07:30:23,300][52662] DAMAGECOUNT value on done: 871319.0 [2024-08-06 07:30:23,302][52662] Sum rewards: 64.996, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.955', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon5': '0.190', 'weapon4': '0.234', 'weapon2': '0.244', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '57.000'} [2024-08-06 07:30:23,798][52667] DAMAGECOUNT value on done: 868258.0 [2024-08-06 07:30:23,800][52667] Sum rewards: 72.678, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.683', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.147', 'weapon5': '0.152', 'AMMO3': '0.168', 'weapon2': '0.178', 'WEAPON5': '0.300', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:24,514][52795] DAMAGECOUNT value on done: 806962.0 [2024-08-06 07:30:24,514][52795] Sum rewards: 90.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.034', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '75.000'} [2024-08-06 07:30:24,715][52660] DAMAGECOUNT value on done: 866916.0 [2024-08-06 07:30:24,716][52660] Sum rewards: 75.149, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.706', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.022', 'weapon5': '0.082', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:25,948][52820] DAMAGECOUNT value on done: 807691.0 [2024-08-06 07:30:25,949][52820] Sum rewards: 73.035, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.930', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.220', 'AMMO4': '0.223', 'AMMO3': '0.331', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '2.894', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '64.000'} [2024-08-06 07:30:26,253][52659] DAMAGECOUNT value on done: 875984.0 [2024-08-06 07:30:26,257][52659] Sum rewards: 69.287, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.040', 'HEALTH': '0.050', 'weapon4': '0.104', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.000', 'weapon3': '3.216', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '55.000'} [2024-08-06 07:30:26,305][52803] DAMAGECOUNT value on done: 816353.0 [2024-08-06 07:30:26,309][52803] Sum rewards: 89.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.226', 'weapon2': '0.252', 'WEAPON3': '1.450', 'weapon3': '3.592', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.562', 'FRAGCOUNT': '75.000'} [2024-08-06 07:30:26,550][52662] DAMAGECOUNT value on done: 857848.0 [2024-08-06 07:30:26,550][52662] Sum rewards: 83.036, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.514', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.021', 'FRAGCOUNT': '67.000'} [2024-08-06 07:30:26,835][52667] DAMAGECOUNT value on done: 878759.0 [2024-08-06 07:30:26,836][52667] Sum rewards: 85.018, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.029', 'HEALTH': '0.048', 'weapon5': '0.112', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon4': '0.268', 'weapon2': '0.394', 'WEAPON3': '0.950', 'weapon3': '3.024', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '67.000'} [2024-08-06 07:30:27,583][52660] DAMAGECOUNT value on done: 872925.0 [2024-08-06 07:30:27,583][52660] Sum rewards: 67.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.215', 'AMMO5': '0.007', 'weapon5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.032', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.376', 'WEAPON3': '1.150', 'HITCOUNT': '3.250', 'weapon3': '3.414', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '56.000'} [2024-08-06 07:30:27,603][52795] DAMAGECOUNT value on done: 802489.0 [2024-08-06 07:30:27,603][52795] Sum rewards: 74.343, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.218', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.210', 'AMMO4': '0.255', 'weapon4': '0.260', 'weapon5': '0.264', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.760', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '62.000'} [2024-08-06 07:30:27,607][52650] Updated weights for policy 0, policy_version 77011 (0.0011) [2024-08-06 07:30:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 630874112. Throughput: 0: 4371.3. Samples: 157725860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:27,794][52567] Avg episode reward: [(0, '74.823')] [2024-08-06 07:30:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077011_630874112.pth... [2024-08-06 07:30:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000076500_626688000.pth [2024-08-06 07:30:29,051][52662] DAMAGECOUNT value on done: 866816.0 [2024-08-06 07:30:29,052][52662] Sum rewards: 64.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon4': '0.202', 'AMMO3': '0.209', 'weapon5': '0.224', 'WEAPON4': '0.450', 'weapon2': '0.474', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '54.000'} [2024-08-06 07:30:29,119][52820] DAMAGECOUNT value on done: 810212.0 [2024-08-06 07:30:29,119][52820] Sum rewards: 80.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.068', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.054', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.252', 'weapon5': '0.342', 'WEAPON3': '0.950', 'weapon3': '3.160', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '62.000'} [2024-08-06 07:30:29,251][52659] DAMAGECOUNT value on done: 869585.0 [2024-08-06 07:30:29,252][52659] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.608', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.096', 'AMMO4': '0.113', 'weapon5': '0.188', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:29,497][52803] DAMAGECOUNT value on done: 812130.0 [2024-08-06 07:30:29,498][52803] Sum rewards: 67.757, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.600', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.148', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '3.212', 'DAMAGECOUNT': '15.696', 'FRAGCOUNT': '54.000'} [2024-08-06 07:30:29,727][52667] DAMAGECOUNT value on done: 868234.0 [2024-08-06 07:30:29,727][52667] Sum rewards: 82.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.633', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.121', 'weapon5': '0.126', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.826', 'WEAPON3': '1.050', 'weapon3': '2.814', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '64.000'} [2024-08-06 07:30:30,595][52795] DAMAGECOUNT value on done: 794621.0 [2024-08-06 07:30:30,596][52795] Sum rewards: 74.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.032', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.126', 'weapon4': '0.168', 'AMMO3': '0.222', 'AMMO4': '0.250', 'weapon2': '0.362', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '63.000'} [2024-08-06 07:30:30,952][52660] DAMAGECOUNT value on done: 861740.0 [2024-08-06 07:30:30,955][52660] Sum rewards: 91.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon2': '0.208', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'weapon3': '3.634', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.333', 'FRAGCOUNT': '76.000'} [2024-08-06 07:30:32,141][52662] DAMAGECOUNT value on done: 859063.0 [2024-08-06 07:30:32,143][52662] Sum rewards: 76.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.045', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.186', 'weapon5': '0.214', 'AMMO4': '0.216', 'weapon2': '0.244', 'weapon4': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '63.000'} [2024-08-06 07:30:32,161][52659] DAMAGECOUNT value on done: 866321.0 [2024-08-06 07:30:32,162][52659] Sum rewards: 65.617, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.586', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.218', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '52.000'} [2024-08-06 07:30:32,244][52820] DAMAGECOUNT value on done: 805405.0 [2024-08-06 07:30:32,246][52820] Sum rewards: 65.262, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.027', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.110', 'AMMO4': '0.132', 'weapon5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '2.930', 'weapon3': '2.950', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '53.000'} [2024-08-06 07:30:32,425][52667] DAMAGECOUNT value on done: 874249.0 [2024-08-06 07:30:32,425][52667] Sum rewards: 73.152, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.160', 'AMMO4': '0.179', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:32,464][52650] Updated weights for policy 0, policy_version 77021 (0.0012) [2024-08-06 07:30:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 630956032. Throughput: 0: 4368.7. Samples: 157738820. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:32,794][52567] Avg episode reward: [(0, '75.102')] [2024-08-06 07:30:33,735][52795] DAMAGECOUNT value on done: 799268.0 [2024-08-06 07:30:33,736][52795] Sum rewards: 67.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.932', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.259', 'weapon2': '0.290', 'WEAPON3': '1.650', 'HITCOUNT': '3.460', 'weapon3': '3.536', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 07:30:34,008][52660] DAMAGECOUNT value on done: 858492.0 [2024-08-06 07:30:34,008][52660] Sum rewards: 76.841, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.242', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.155', 'AMMO3': '0.157', 'weapon4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.050', 'weapon3': '3.108', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:35,149][52803] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:30:35,397][52820] DAMAGECOUNT value on done: 807722.0 [2024-08-06 07:30:35,397][52820] Sum rewards: 76.087, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.322', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.166', 'weapon2': '0.190', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.360', 'weapon3': '3.372', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '64.000'} [2024-08-06 07:30:35,447][52659] DAMAGECOUNT value on done: 868971.0 [2024-08-06 07:30:35,449][52659] Sum rewards: 80.043, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.990', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.106', 'AMMO4': '0.145', 'weapon5': '0.150', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.258', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '69.000'} [2024-08-06 07:30:35,762][52667] DAMAGECOUNT value on done: 879659.0 [2024-08-06 07:30:35,763][52667] Sum rewards: 67.872, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.170', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO3': '0.156', 'weapon5': '0.170', 'weapon4': '0.180', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.758', 'WEAPON3': '0.850', 'weapon3': '2.676', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '53.000'} [2024-08-06 07:30:36,672][52614] Signal inference workers to stop experience collection... (14100 times) [2024-08-06 07:30:36,673][52614] Signal inference workers to resume experience collection... (14100 times) [2024-08-06 07:30:36,760][52650] InferenceWorker_p0-w0: stopping experience collection (14100 times) [2024-08-06 07:30:36,761][52650] InferenceWorker_p0-w0: resuming experience collection (14100 times) [2024-08-06 07:30:36,797][52660] DAMAGECOUNT value on done: 868708.0 [2024-08-06 07:30:36,798][52660] Sum rewards: 70.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.194', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.091', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.273', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.240', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:36,970][52795] DAMAGECOUNT value on done: 809201.0 [2024-08-06 07:30:36,971][52795] Sum rewards: 79.568, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.084', 'weapon5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '64.000'} [2024-08-06 07:30:37,316][52650] Updated weights for policy 0, policy_version 77031 (0.0012) [2024-08-06 07:30:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 631046144. Throughput: 0: 4367.8. Samples: 157765210. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:37,794][52567] Avg episode reward: [(0, '75.325')] [2024-08-06 07:30:38,148][52667] DAMAGECOUNT value on done: 882545.0 [2024-08-06 07:30:38,150][52667] Sum rewards: 80.007, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO3': '0.150', 'weapon4': '0.152', 'AMMO4': '0.187', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '64.000'} [2024-08-06 07:30:38,309][52659] DAMAGECOUNT value on done: 870138.0 [2024-08-06 07:30:38,309][52659] Sum rewards: 75.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.140', 'AMMO4': '0.169', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:38,485][52820] DAMAGECOUNT value on done: 814698.0 [2024-08-06 07:30:38,485][52820] Sum rewards: 77.070, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.970', 'AMMO5': '0.023', 'AMMO2': '0.057', 'weapon4': '0.150', 'weapon5': '0.196', 'AMMO3': '0.230', 'weapon2': '0.262', 'AMMO4': '0.285', 'WEAPON5': '0.600', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '65.000'} [2024-08-06 07:30:39,830][52660] DAMAGECOUNT value on done: 858360.0 [2024-08-06 07:30:39,830][52660] Sum rewards: 75.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.402', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.024', 'AMMO4': '0.108', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.548', 'WEAPON3': '0.950', 'weapon3': '3.164', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '59.500'} [2024-08-06 07:30:40,145][52795] DAMAGECOUNT value on done: 795235.0 [2024-08-06 07:30:40,146][52795] Sum rewards: 76.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.285', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.220', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:40,788][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:30:41,089][52659] DAMAGECOUNT value on done: 869597.0 [2024-08-06 07:30:41,090][52659] Sum rewards: 74.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.083', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.209', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:41,218][52667] DAMAGECOUNT value on done: 877524.0 [2024-08-06 07:30:41,219][52667] Sum rewards: 87.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.196', 'AMMO3': '0.200', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.996', 'FRAGCOUNT': '72.000'} [2024-08-06 07:30:41,628][52820] DAMAGECOUNT value on done: 814057.0 [2024-08-06 07:30:41,629][52820] Sum rewards: 73.966, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.902', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.122', 'AMMO3': '0.216', 'AMMO4': '0.240', 'weapon2': '0.264', 'weapon5': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '62.000'} [2024-08-06 07:30:41,907][52650] Updated weights for policy 0, policy_version 77041 (0.0022) [2024-08-06 07:30:42,766][52660] DAMAGECOUNT value on done: 860381.0 [2024-08-06 07:30:42,767][52660] Sum rewards: 65.029, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.400', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.176', 'AMMO4': '0.228', 'AMMO3': '0.241', 'weapon4': '0.270', 'weapon2': '0.278', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.970', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '56.000'} [2024-08-06 07:30:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 631128064. Throughput: 0: 4366.0. Samples: 157791420. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:42,794][52567] Avg episode reward: [(0, '75.379')] [2024-08-06 07:30:43,447][52795] DAMAGECOUNT value on done: 807093.0 [2024-08-06 07:30:43,447][52795] Sum rewards: 86.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.504', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.218', 'AMMO3': '0.233', 'WEAPON3': '1.500', 'weapon3': '3.428', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.486', 'FRAGCOUNT': '72.000'} [2024-08-06 07:30:43,689][52659] DAMAGECOUNT value on done: 867968.0 [2024-08-06 07:30:43,692][52659] Sum rewards: 72.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.038', 'weapon4': '0.084', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.304', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '59.000'} [2024-08-06 07:30:44,509][52667] DAMAGECOUNT value on done: 874064.0 [2024-08-06 07:30:44,510][52667] Sum rewards: 74.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.996', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.174', 'weapon5': '0.196', 'weapon2': '0.204', 'AMMO3': '0.211', 'AMMO4': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '62.000'} [2024-08-06 07:30:44,720][52820] DAMAGECOUNT value on done: 796241.0 [2024-08-06 07:30:44,721][52820] Sum rewards: 81.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.476', 'AMMO5': '0.011', 'AMMO2': '0.056', 'weapon4': '0.112', 'weapon5': '0.184', 'AMMO3': '0.210', 'AMMO4': '0.279', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '68.000'} [2024-08-06 07:30:45,432][52660] DAMAGECOUNT value on done: 872729.0 [2024-08-06 07:30:45,433][52660] Sum rewards: 67.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.175', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.158', 'AMMO4': '0.187', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '55.000'} [2024-08-06 07:30:46,404][52650] Updated weights for policy 0, policy_version 77051 (0.0011) [2024-08-06 07:30:46,513][52795] DAMAGECOUNT value on done: 803942.0 [2024-08-06 07:30:46,515][52795] Sum rewards: 84.307, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.149', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.100', 'weapon5': '0.110', 'weapon2': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON3': '1.250', 'weapon3': '3.516', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '68.000'} [2024-08-06 07:30:46,639][52659] DAMAGECOUNT value on done: 878786.0 [2024-08-06 07:30:46,641][52659] Sum rewards: 78.422, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.665', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.096', 'AMMO4': '0.143', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'weapon2': '0.308', 'WEAPON3': '1.700', 'weapon3': '3.234', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '68.000'} [2024-08-06 07:30:47,118][52667] DAMAGECOUNT value on done: 877589.0 [2024-08-06 07:30:47,120][52667] Sum rewards: 70.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.122', 'weapon5': '0.136', 'AMMO3': '0.220', 'weapon2': '0.220', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '58.000'} [2024-08-06 07:30:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 631218176. Throughput: 0: 4370.0. Samples: 157804700. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:30:47,794][52567] Avg episode reward: [(0, '75.076')] [2024-08-06 07:30:48,418][52660] DAMAGECOUNT value on done: 885664.0 [2024-08-06 07:30:48,419][52660] Sum rewards: 67.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.168', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.206', 'AMMO4': '0.243', 'weapon4': '0.254', 'weapon5': '0.266', 'weapon2': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.838', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 07:30:49,637][52795] DAMAGECOUNT value on done: 794315.0 [2024-08-06 07:30:49,637][52795] Sum rewards: 84.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.039', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.434', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '70.000'} [2024-08-06 07:30:49,853][52659] DAMAGECOUNT value on done: 863368.0 [2024-08-06 07:30:49,855][52659] Sum rewards: 78.461, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.000', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.066', 'weapon5': '0.154', 'AMMO4': '0.261', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.084', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '68.000'} [2024-08-06 07:30:50,885][52660] DAMAGECOUNT value on done: 861848.0 [2024-08-06 07:30:50,893][52660] Sum rewards: 66.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.344', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.074', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '57.500'} [2024-08-06 07:30:51,592][52650] Updated weights for policy 0, policy_version 77061 (0.0018) [2024-08-06 07:30:52,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 631316480. Throughput: 0: 4377.8. Samples: 157831240. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:30:52,794][52567] Avg episode reward: [(0, '74.910')] [2024-08-06 07:30:52,828][52659] DAMAGECOUNT value on done: 874063.0 [2024-08-06 07:30:52,830][52659] Sum rewards: 65.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.019', 'AMMO2': '0.062', 'AMMO3': '0.194', 'weapon5': '0.244', 'AMMO4': '0.310', 'weapon4': '0.446', 'weapon2': '0.468', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.500', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '52.000'} [2024-08-06 07:30:52,908][52795] DAMAGECOUNT value on done: 801158.0 [2024-08-06 07:30:52,909][52795] Sum rewards: 71.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.084', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.067', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.492', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '58.000'} [2024-08-06 07:30:53,557][52660] DAMAGECOUNT value on done: 870684.0 [2024-08-06 07:30:53,559][52660] Sum rewards: 71.382, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.622', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.084', 'weapon5': '0.154', 'AMMO4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:55,525][52650] Updated weights for policy 0, policy_version 77071 (0.0032) [2024-08-06 07:30:56,092][52659] DAMAGECOUNT value on done: 865336.0 [2024-08-06 07:30:56,102][52659] Sum rewards: 72.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.080', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 07:30:56,103][52795] DAMAGECOUNT value on done: 808905.0 [2024-08-06 07:30:56,104][52795] Sum rewards: 84.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.746', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.120', 'AMMO4': '0.132', 'weapon5': '0.142', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.438', 'WEAPON3': '0.950', 'weapon3': '3.100', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '67.000'} [2024-08-06 07:30:56,754][52660] DAMAGECOUNT value on done: 866348.0 [2024-08-06 07:30:56,755][52660] Sum rewards: 75.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.026', 'weapon5': '0.080', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.476', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '61.000'} [2024-08-06 07:30:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 631398400. Throughput: 0: 4377.5. Samples: 157857220. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:30:57,794][52567] Avg episode reward: [(0, '74.722')] [2024-08-06 07:30:59,057][52659] DAMAGECOUNT value on done: 866556.0 [2024-08-06 07:30:59,057][52659] Sum rewards: 70.312, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.075', 'weapon5': '0.096', 'weapon2': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.520', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 07:30:59,950][52660] DAMAGECOUNT value on done: 859144.0 [2024-08-06 07:30:59,951][52660] Sum rewards: 85.945, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.024', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.141', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '3.226', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:00,580][52650] Updated weights for policy 0, policy_version 77081 (0.0021) [2024-08-06 07:31:00,668][52658] DAMAGECOUNT value on done: 869445.0 [2024-08-06 07:31:00,668][52658] Sum rewards: 60.317, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.910', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.108', 'weapon5': '0.224', 'AMMO4': '0.248', 'AMMO3': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.842', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '54.000'} [2024-08-06 07:31:01,623][52659] DAMAGECOUNT value on done: 871517.0 [2024-08-06 07:31:01,624][52659] Sum rewards: 65.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.166', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.283', 'weapon2': '0.320', 'WEAPON3': '1.650', 'HITCOUNT': '3.280', 'weapon3': '3.394', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:02,513][52660] DAMAGECOUNT value on done: 858171.0 [2024-08-06 07:31:02,513][52660] Sum rewards: 96.565, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.266', 'WEAPON3': '1.150', 'weapon3': '3.454', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '22.569', 'FRAGCOUNT': '77.000'} [2024-08-06 07:31:02,591][52667] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:31:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 631488512. Throughput: 0: 4376.7. Samples: 157870420. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:31:02,794][52567] Avg episode reward: [(0, '74.690')] [2024-08-06 07:31:03,423][52658] DAMAGECOUNT value on done: 873875.0 [2024-08-06 07:31:03,427][52658] Sum rewards: 70.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.078', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.206', 'WEAPON3': '1.250', 'HITCOUNT': '3.260', 'weapon3': '3.356', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:04,317][52659] DAMAGECOUNT value on done: 868556.0 [2024-08-06 07:31:04,317][52659] Sum rewards: 69.539, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.092', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.146', 'AMMO4': '0.202', 'AMMO3': '0.217', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.342', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:05,316][52650] Updated weights for policy 0, policy_version 77091 (0.0011) [2024-08-06 07:31:06,626][52658] DAMAGECOUNT value on done: 875663.0 [2024-08-06 07:31:06,636][52658] Sum rewards: 73.232, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.475', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.029', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:07,092][52659] DAMAGECOUNT value on done: 879020.0 [2024-08-06 07:31:07,094][52659] Sum rewards: 66.161, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.356', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.294', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '56.000'} [2024-08-06 07:31:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 631570432. Throughput: 0: 4377.1. Samples: 157896510. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:31:07,794][52567] Avg episode reward: [(0, '74.418')] [2024-08-06 07:31:09,727][52650] Updated weights for policy 0, policy_version 77101 (0.0012) [2024-08-06 07:31:09,770][52658] DAMAGECOUNT value on done: 872630.0 [2024-08-06 07:31:09,770][52658] Sum rewards: 82.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.325', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '68.000'} [2024-08-06 07:31:09,800][52659] DAMAGECOUNT value on done: 861890.0 [2024-08-06 07:31:09,801][52659] Sum rewards: 60.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.200', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.166', 'AMMO3': '0.185', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '2.930', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '50.000'} [2024-08-06 07:31:10,821][52794] DAMAGECOUNT value on done: 863673.0 [2024-08-06 07:31:10,821][52794] Sum rewards: 70.089, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.145', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.152', 'weapon5': '0.206', 'AMMO3': '0.277', 'AMMO4': '0.298', 'weapon2': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.990', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '60.000'} [2024-08-06 07:31:12,539][52659] DAMAGECOUNT value on done: 875884.0 [2024-08-06 07:31:12,540][52659] Sum rewards: 82.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.274', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '65.000'} [2024-08-06 07:31:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 631660544. Throughput: 0: 4380.4. Samples: 157922980. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:31:12,794][52567] Avg episode reward: [(0, '74.438')] [2024-08-06 07:31:12,844][52658] DAMAGECOUNT value on done: 867082.0 [2024-08-06 07:31:12,845][52658] Sum rewards: 69.107, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.647', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon4': '0.178', 'weapon2': '0.560', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '54.000'} [2024-08-06 07:31:13,404][52794] DAMAGECOUNT value on done: 874657.0 [2024-08-06 07:31:13,405][52794] Sum rewards: 91.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.072', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.502', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '75.000'} [2024-08-06 07:31:14,469][52650] Updated weights for policy 0, policy_version 77111 (0.0010) [2024-08-06 07:31:14,714][52669] DAMAGECOUNT value on done: 871800.0 [2024-08-06 07:31:14,715][52669] Sum rewards: 75.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.222', 'WEAPON3': '1.300', 'weapon3': '3.274', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '62.000'} [2024-08-06 07:31:15,493][52659] DAMAGECOUNT value on done: 868139.0 [2024-08-06 07:31:15,495][52659] Sum rewards: 79.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.126', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.088', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.772', 'WEAPON3': '1.200', 'weapon3': '2.706', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '64.000'} [2024-08-06 07:31:15,907][52658] DAMAGECOUNT value on done: 861157.0 [2024-08-06 07:31:15,908][52658] Sum rewards: 70.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '0.018', 'AMMO5': '0.021', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.192', 'AMMO3': '0.195', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:15,911][52794] DAMAGECOUNT value on done: 877484.0 [2024-08-06 07:31:15,912][52794] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.060', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.276', 'AMMO3': '0.297', 'WEAPON3': '1.800', 'weapon3': '3.338', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:17,347][52669] DAMAGECOUNT value on done: 865011.0 [2024-08-06 07:31:17,350][52669] Sum rewards: 81.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 631750656. Throughput: 0: 4388.7. Samples: 157936310. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:31:17,794][52567] Avg episode reward: [(0, '74.807')] [2024-08-06 07:31:18,443][52658] DAMAGECOUNT value on done: 875040.0 [2024-08-06 07:31:18,443][52658] Sum rewards: 78.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon5': '0.160', 'weapon4': '0.162', 'AMMO3': '0.195', 'AMMO4': '0.265', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.692', 'WEAPON3': '1.200', 'weapon3': '2.696', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '65.000'} [2024-08-06 07:31:19,009][52794] DAMAGECOUNT value on done: 867290.0 [2024-08-06 07:31:19,010][52794] Sum rewards: 72.261, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.560', 'AMMO5': '0.021', 'AMMO2': '0.063', 'weapon4': '0.126', 'weapon5': '0.188', 'AMMO3': '0.229', 'AMMO4': '0.317', 'weapon2': '0.446', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '61.000'} [2024-08-06 07:31:19,343][52650] Updated weights for policy 0, policy_version 77121 (0.0037) [2024-08-06 07:31:20,163][52669] DAMAGECOUNT value on done: 876022.0 [2024-08-06 07:31:20,163][52669] Sum rewards: 63.677, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.022', 'AMMO2': '0.054', 'AMMO3': '0.211', 'weapon4': '0.220', 'weapon5': '0.248', 'AMMO4': '0.268', 'weapon2': '0.286', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '54.000'} [2024-08-06 07:31:21,233][52658] DAMAGECOUNT value on done: 863599.0 [2024-08-06 07:31:21,234][52658] Sum rewards: 68.985, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.363', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.158', 'weapon5': '0.192', 'AMMO4': '0.239', 'weapon2': '0.242', 'AMMO3': '0.269', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:21,569][52663] DAMAGECOUNT value on done: 887722.0 [2024-08-06 07:31:21,569][52663] Sum rewards: 85.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.848', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.186', 'AMMO3': '0.198', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'weapon2': '0.370', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '69.000'} [2024-08-06 07:31:22,123][52794] DAMAGECOUNT value on done: 861009.0 [2024-08-06 07:31:22,125][52794] Sum rewards: 81.056, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.389', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.169', 'weapon5': '0.178', 'AMMO3': '0.198', 'weapon2': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 07:31:22,611][52669] DAMAGECOUNT value on done: 869288.0 [2024-08-06 07:31:22,611][52669] Sum rewards: 71.733, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.122', 'weapon5': '0.146', 'AMMO4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 631832576. Throughput: 0: 4386.7. Samples: 157962610. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:31:22,802][52567] Avg episode reward: [(0, '75.171')] [2024-08-06 07:31:23,559][52650] Updated weights for policy 0, policy_version 77131 (0.0012) [2024-08-06 07:31:23,975][52658] DAMAGECOUNT value on done: 889982.0 [2024-08-06 07:31:23,977][52658] Sum rewards: 79.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.098', 'weapon4': '0.130', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:24,320][52663] DAMAGECOUNT value on done: 871255.0 [2024-08-06 07:31:24,324][52663] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.402', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.275', 'WEAPON3': '1.700', 'weapon3': '3.326', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '61.000'} [2024-08-06 07:31:25,100][52794] DAMAGECOUNT value on done: 867272.0 [2024-08-06 07:31:25,101][52794] Sum rewards: 80.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.502', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '66.000'} [2024-08-06 07:31:25,493][52669] DAMAGECOUNT value on done: 877746.0 [2024-08-06 07:31:25,495][52669] Sum rewards: 71.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.004', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.292', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.784', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '60.000'} [2024-08-06 07:31:26,975][52658] DAMAGECOUNT value on done: 873795.0 [2024-08-06 07:31:26,976][52658] Sum rewards: 65.604, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.448', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.134', 'AMMO3': '0.143', 'weapon5': '0.174', 'AMMO4': '0.197', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'HITCOUNT': '3.180', 'weapon3': '3.182', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '51.000'} [2024-08-06 07:31:27,484][52663] DAMAGECOUNT value on done: 864853.0 [2024-08-06 07:31:27,484][52663] Sum rewards: 69.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon2': '0.190', 'AMMO3': '0.208', 'AMMO4': '0.214', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '58.000'} [2024-08-06 07:31:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 631922688. Throughput: 0: 4385.3. Samples: 157988760. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:31:27,794][52567] Avg episode reward: [(0, '75.008')] [2024-08-06 07:31:27,881][52794] DAMAGECOUNT value on done: 872600.0 [2024-08-06 07:31:27,882][52794] Sum rewards: 68.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.500', 'AMMO5': '0.021', 'AMMO2': '0.068', 'weapon4': '0.208', 'AMMO3': '0.247', 'weapon5': '0.286', 'AMMO4': '0.339', 'weapon2': '0.546', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.616', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:28,568][52650] Updated weights for policy 0, policy_version 77141 (0.0012) [2024-08-06 07:31:28,605][52669] DAMAGECOUNT value on done: 873648.0 [2024-08-06 07:31:28,607][52669] Sum rewards: 84.118, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.070', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'HEALTH': '0.104', 'weapon4': '0.120', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.000', 'weapon3': '3.222', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '66.000'} [2024-08-06 07:31:29,484][52671] DAMAGECOUNT value on done: 876634.0 [2024-08-06 07:31:29,487][52671] Sum rewards: 73.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.394', 'AMMO5': '0.011', 'AMMO2': '0.063', 'weapon4': '0.094', 'weapon5': '0.178', 'AMMO3': '0.232', 'AMMO4': '0.315', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '60.000'} [2024-08-06 07:31:29,668][52658] DAMAGECOUNT value on done: 883475.0 [2024-08-06 07:31:29,670][52658] Sum rewards: 82.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.718', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.094', 'weapon4': '0.118', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '68.000'} [2024-08-06 07:31:30,510][52794] DAMAGECOUNT value on done: 859034.0 [2024-08-06 07:31:30,512][52794] Sum rewards: 66.314, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.150', 'AMMO2': '0.012', 'weapon4': '0.056', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'AMMO3': '0.261', 'weapon2': '0.678', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:30,613][52663] DAMAGECOUNT value on done: 870315.0 [2024-08-06 07:31:30,614][52663] Sum rewards: 74.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.665', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.094', 'weapon4': '0.104', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '62.000'} [2024-08-06 07:31:31,575][52669] DAMAGECOUNT value on done: 874199.0 [2024-08-06 07:31:31,575][52669] Sum rewards: 79.334, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.113', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '65.000'} [2024-08-06 07:31:32,398][52671] DAMAGECOUNT value on done: 882019.0 [2024-08-06 07:31:32,401][52671] Sum rewards: 80.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.084', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.582', 'WEAPON3': '1.050', 'weapon3': '2.876', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '64.000'} [2024-08-06 07:31:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 632004608. Throughput: 0: 4379.3. Samples: 158001770. Policy #0 lag: (min: 0.0, avg: 2.9, max: 7.0) [2024-08-06 07:31:32,794][52567] Avg episode reward: [(0, '75.130')] [2024-08-06 07:31:32,906][52658] DAMAGECOUNT value on done: 870901.0 [2024-08-06 07:31:32,909][52658] Sum rewards: 76.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.400', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.160', 'weapon5': '0.186', 'AMMO3': '0.237', 'AMMO4': '0.243', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '62.000'} [2024-08-06 07:31:33,064][52650] Updated weights for policy 0, policy_version 77151 (0.0014) [2024-08-06 07:31:33,128][52794] DAMAGECOUNT value on done: 871908.0 [2024-08-06 07:31:33,129][52794] Sum rewards: 77.932, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.854', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.154', 'weapon5': '0.154', 'AMMO3': '0.170', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.838', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '61.000'} [2024-08-06 07:31:33,409][52663] DAMAGECOUNT value on done: 871486.0 [2024-08-06 07:31:33,409][52663] Sum rewards: 89.910, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.392', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.541', 'FRAGCOUNT': '72.000'} [2024-08-06 07:31:34,302][52669] DAMAGECOUNT value on done: 872401.0 [2024-08-06 07:31:34,303][52669] Sum rewards: 67.770, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.192', 'AMMO5': '0.023', 'AMMO2': '0.075', 'AMMO3': '0.264', 'weapon4': '0.280', 'weapon5': '0.374', 'AMMO4': '0.374', 'weapon2': '0.402', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.550', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:35,136][52671] DAMAGECOUNT value on done: 877345.0 [2024-08-06 07:31:35,136][52671] Sum rewards: 85.410, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.818', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.062', 'weapon4': '0.120', 'weapon2': '0.184', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.440', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '69.000'} [2024-08-06 07:31:35,854][52794] DAMAGECOUNT value on done: 866435.0 [2024-08-06 07:31:35,854][52794] Sum rewards: 64.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.390', 'WEAPON3': '1.350', 'HITCOUNT': '3.250', 'weapon3': '3.352', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '53.000'} [2024-08-06 07:31:35,955][52658] DAMAGECOUNT value on done: 879855.0 [2024-08-06 07:31:35,955][52658] Sum rewards: 68.694, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.122', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'AMMO3': '0.297', 'WEAPON3': '1.700', 'HITCOUNT': '3.130', 'weapon3': '3.298', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '61.000'} [2024-08-06 07:31:36,443][52663] DAMAGECOUNT value on done: 876490.0 [2024-08-06 07:31:36,443][52663] Sum rewards: 60.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.148', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon5': '0.206', 'AMMO3': '0.242', 'weapon4': '0.268', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '52.000'} [2024-08-06 07:31:37,528][52669] DAMAGECOUNT value on done: 883876.0 [2024-08-06 07:31:37,529][52669] Sum rewards: 79.606, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.835', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.098', 'AMMO4': '0.194', 'weapon5': '0.206', 'AMMO3': '0.222', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '65.500'} [2024-08-06 07:31:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 632094720. Throughput: 0: 4373.3. Samples: 158028040. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:31:37,802][52567] Avg episode reward: [(0, '75.058')] [2024-08-06 07:31:37,891][52647] DAMAGECOUNT value on done: 926232.0 [2024-08-06 07:31:37,891][52647] Sum rewards: 74.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.187', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.110', 'AMMO4': '0.241', 'weapon5': '0.252', 'AMMO3': '0.260', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '62.000'} [2024-08-06 07:31:38,063][52650] Updated weights for policy 0, policy_version 77161 (0.0019) [2024-08-06 07:31:38,080][52671] DAMAGECOUNT value on done: 877819.0 [2024-08-06 07:31:38,082][52671] Sum rewards: 65.631, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.780', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.295', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.152', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '60.000'} [2024-08-06 07:31:38,527][52658] DAMAGECOUNT value on done: 869998.0 [2024-08-06 07:31:38,529][52658] Sum rewards: 91.031, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO4': '0.177', 'weapon5': '0.180', 'AMMO3': '0.186', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '73.000'} [2024-08-06 07:31:38,849][52794] DAMAGECOUNT value on done: 858009.0 [2024-08-06 07:31:38,851][52794] Sum rewards: 86.282, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.800', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO3': '0.149', 'weapon2': '0.414', 'WEAPON3': '1.000', 'weapon3': '3.382', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '69.000'} [2024-08-06 07:31:39,338][52663] DAMAGECOUNT value on done: 868137.0 [2024-08-06 07:31:39,340][52663] Sum rewards: 80.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.256', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.142', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '65.000'} [2024-08-06 07:31:40,117][52669] DAMAGECOUNT value on done: 871164.0 [2024-08-06 07:31:40,119][52669] Sum rewards: 56.367, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.932', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.088', 'AMMO4': '0.151', 'weapon5': '0.220', 'AMMO3': '0.227', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.166', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '47.000'} [2024-08-06 07:31:40,691][52647] DAMAGECOUNT value on done: 915798.0 [2024-08-06 07:31:40,692][52647] Sum rewards: 66.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.156', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '54.000'} [2024-08-06 07:31:41,328][52658] DAMAGECOUNT value on done: 875974.0 [2024-08-06 07:31:41,328][52658] Sum rewards: 67.928, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.343', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon2': '0.178', 'AMMO3': '0.201', 'weapon5': '0.222', 'AMMO4': '0.274', 'weapon4': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:41,546][52671] DAMAGECOUNT value on done: 883245.0 [2024-08-06 07:31:41,548][52671] Sum rewards: 88.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.162', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '71.000'} [2024-08-06 07:31:41,869][52794] DAMAGECOUNT value on done: 873387.0 [2024-08-06 07:31:41,869][52794] Sum rewards: 81.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.901', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.078', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.218', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:41,981][52663] DAMAGECOUNT value on done: 859299.0 [2024-08-06 07:31:41,983][52663] Sum rewards: 79.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.041', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.388', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:42,243][52649] DAMAGECOUNT value on done: 842625.0 [2024-08-06 07:31:42,244][52649] Sum rewards: 79.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.476', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.118', 'weapon5': '0.130', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '63.000'} [2024-08-06 07:31:42,786][52650] Updated weights for policy 0, policy_version 77171 (0.0013) [2024-08-06 07:31:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 632184832. Throughput: 0: 4380.4. Samples: 158054340. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:31:42,802][52567] Avg episode reward: [(0, '74.903')] [2024-08-06 07:31:42,914][52669] DAMAGECOUNT value on done: 882150.0 [2024-08-06 07:31:42,914][52669] Sum rewards: 78.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.088', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.074', 'weapon2': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'weapon3': '3.552', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:43,543][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:31:43,674][52647] DAMAGECOUNT value on done: 922622.0 [2024-08-06 07:31:43,675][52647] Sum rewards: 72.082, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.639', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.122', 'AMMO4': '0.149', 'weapon2': '0.192', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.328', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '64.000'} [2024-08-06 07:31:44,355][52658] DAMAGECOUNT value on done: 860035.0 [2024-08-06 07:31:44,357][52658] Sum rewards: 74.476, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.385', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon5': '0.132', 'AMMO4': '0.240', 'AMMO3': '0.270', 'weapon4': '0.292', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.008', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '64.000'} [2024-08-06 07:31:44,423][52671] DAMAGECOUNT value on done: 872411.0 [2024-08-06 07:31:44,425][52671] Sum rewards: 70.094, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.027', 'AMMO2': '0.057', 'AMMO3': '0.234', 'AMMO4': '0.283', 'weapon4': '0.326', 'weapon2': '0.360', 'weapon5': '0.390', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.478', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:44,699][52649] DAMAGECOUNT value on done: 838463.0 [2024-08-06 07:31:44,702][52649] Sum rewards: 71.850, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.216', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.126', 'weapon5': '0.176', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.128', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '63.000'} [2024-08-06 07:31:44,964][52794] DAMAGECOUNT value on done: 867616.0 [2024-08-06 07:31:44,964][52794] Sum rewards: 83.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.815', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.142', 'weapon2': '0.146', 'weapon4': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.350', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:45,069][52663] DAMAGECOUNT value on done: 866043.0 [2024-08-06 07:31:45,071][52663] Sum rewards: 78.352, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.138', 'AMMO4': '0.156', 'weapon4': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.700', 'weapon3': '3.046', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:45,822][52669] DAMAGECOUNT value on done: 881272.0 [2024-08-06 07:31:45,822][52669] Sum rewards: 76.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.234', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.124', 'weapon2': '0.192', 'weapon5': '0.216', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 07:31:46,784][52647] DAMAGECOUNT value on done: 922425.0 [2024-08-06 07:31:46,785][52647] Sum rewards: 68.379, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.053', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.250', 'AMMO3': '0.315', 'WEAPON3': '1.750', 'weapon3': '3.360', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:47,028][52658] DAMAGECOUNT value on done: 877072.0 [2024-08-06 07:31:47,030][52658] Sum rewards: 79.783, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.662', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '65.000'} [2024-08-06 07:31:47,245][52650] Updated weights for policy 0, policy_version 77181 (0.0016) [2024-08-06 07:31:47,453][52649] DAMAGECOUNT value on done: 854319.0 [2024-08-06 07:31:47,453][52649] Sum rewards: 69.693, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.962', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.082', 'weapon4': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.257', 'weapon2': '0.526', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:47,513][52671] DAMAGECOUNT value on done: 877190.0 [2024-08-06 07:31:47,513][52671] Sum rewards: 77.526, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.253', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.154', 'AMMO3': '0.192', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '62.500'} [2024-08-06 07:31:47,709][52663] DAMAGECOUNT value on done: 870352.0 [2024-08-06 07:31:47,709][52663] Sum rewards: 75.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '62.000'} [2024-08-06 07:31:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 632266752. Throughput: 0: 4380.7. Samples: 158067550. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:31:47,802][52567] Avg episode reward: [(0, '75.109')] [2024-08-06 07:31:47,913][52794] DAMAGECOUNT value on done: 882111.0 [2024-08-06 07:31:47,913][52794] Sum rewards: 73.306, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.021', 'AMMO2': '0.067', 'weapon4': '0.134', 'AMMO3': '0.229', 'weapon5': '0.332', 'AMMO4': '0.336', 'weapon2': '0.424', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '62.000'} [2024-08-06 07:31:48,453][52669] DAMAGECOUNT value on done: 868457.0 [2024-08-06 07:31:48,455][52669] Sum rewards: 75.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 07:31:48,706][52794] Large shaping reward 2.752 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 07:31:49,653][52658] DAMAGECOUNT value on done: 869064.0 [2024-08-06 07:31:49,653][52658] Sum rewards: 90.701, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.072', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.448', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.585', 'FRAGCOUNT': '76.000'} [2024-08-06 07:31:49,683][52647] DAMAGECOUNT value on done: 930312.0 [2024-08-06 07:31:49,683][52647] Sum rewards: 88.618, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.898', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.133', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'weapon4': '0.300', 'WEAPON3': '0.900', 'weapon3': '3.108', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '69.000'} [2024-08-06 07:31:50,113][52663] DAMAGECOUNT value on done: 877262.0 [2024-08-06 07:31:50,117][52663] Sum rewards: 65.525, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.061', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '56.000'} [2024-08-06 07:31:50,606][52649] DAMAGECOUNT value on done: 849788.0 [2024-08-06 07:31:50,609][52649] Sum rewards: 66.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.134', 'weapon4': '0.142', 'AMMO4': '0.153', 'AMMO3': '0.175', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.178', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '55.000'} [2024-08-06 07:31:50,680][52671] DAMAGECOUNT value on done: 879768.0 [2024-08-06 07:31:50,683][52671] Sum rewards: 83.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.966', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.168', 'weapon5': '0.194', 'AMMO3': '0.212', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.550', 'FRAGCOUNT': '70.000'} [2024-08-06 07:31:50,801][52670] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:31:50,908][52794] DAMAGECOUNT value on done: 862023.0 [2024-08-06 07:31:50,908][52794] Sum rewards: 66.621, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.415', 'AMMO5': '0.016', 'AMMO2': '0.065', 'weapon5': '0.200', 'AMMO3': '0.220', 'AMMO4': '0.324', 'weapon4': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.670', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '56.000'} [2024-08-06 07:31:51,091][52669] DAMAGECOUNT value on done: 869248.0 [2024-08-06 07:31:51,091][52669] Sum rewards: 88.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.931', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.050', 'weapon5': '0.062', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '21.744', 'FRAGCOUNT': '71.000'} [2024-08-06 07:31:51,967][52658] DAMAGECOUNT value on done: 865296.0 [2024-08-06 07:31:51,968][52658] Sum rewards: 77.899, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.400', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.308', 'weapon4': '0.332', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.014', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '67.000'} [2024-08-06 07:31:52,140][52650] Updated weights for policy 0, policy_version 77191 (0.0033) [2024-08-06 07:31:52,329][52665] DAMAGECOUNT value on done: 859406.0 [2024-08-06 07:31:52,330][52665] Sum rewards: 88.363, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.080', 'weapon4': '0.148', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.147', 'FRAGCOUNT': '74.000'} [2024-08-06 07:31:52,742][52647] DAMAGECOUNT value on done: 925160.0 [2024-08-06 07:31:52,744][52647] Sum rewards: 75.083, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.555', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.090', 'weapon2': '0.182', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.320', 'WEAPON3': '1.900', 'weapon3': '3.346', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '66.000'} [2024-08-06 07:31:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.6). Total num frames: 632356864. Throughput: 0: 4377.6. Samples: 158093500. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:31:52,794][52567] Avg episode reward: [(0, '75.380')] [2024-08-06 07:31:53,203][52663] DAMAGECOUNT value on done: 860525.0 [2024-08-06 07:31:53,207][52663] Sum rewards: 75.381, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.605', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.088', 'weapon2': '0.184', 'AMMO4': '0.223', 'weapon5': '0.240', 'AMMO3': '0.269', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '63.000'} [2024-08-06 07:31:53,639][52794] DAMAGECOUNT value on done: 879139.0 [2024-08-06 07:31:53,639][52794] Sum rewards: 72.951, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.255', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.070', 'weapon5': '0.082', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '59.000'} [2024-08-06 07:31:53,790][52649] DAMAGECOUNT value on done: 842836.0 [2024-08-06 07:31:53,792][52649] Sum rewards: 65.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.713', 'AMMO5': '0.007', 'weapon4': '0.040', 'AMMO2': '0.061', 'weapon5': '0.100', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.306', 'weapon2': '0.568', 'WEAPON3': '1.350', 'weapon3': '3.078', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '54.000'} [2024-08-06 07:31:53,800][52671] DAMAGECOUNT value on done: 863617.0 [2024-08-06 07:31:53,802][52671] Sum rewards: 72.610, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO4': '-0.017', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '60.000'} [2024-08-06 07:31:54,154][52669] DAMAGECOUNT value on done: 874297.0 [2024-08-06 07:31:54,154][52669] Sum rewards: 86.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.060', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.202', 'weapon2': '0.234', 'AMMO4': '0.277', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '70.000'} [2024-08-06 07:31:54,568][52658] DAMAGECOUNT value on done: 874136.0 [2024-08-06 07:31:54,568][52658] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.558', 'AMMO5': '0.005', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.050', 'AMMO4': '0.087', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.246', 'WEAPON3': '1.550', 'HITCOUNT': '3.340', 'weapon3': '3.346', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '61.000'} [2024-08-06 07:31:55,063][52647] DAMAGECOUNT value on done: 928282.0 [2024-08-06 07:31:55,063][52647] Sum rewards: 80.654, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.380', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon4': '0.224', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '64.000'} [2024-08-06 07:31:55,509][52665] DAMAGECOUNT value on done: 872330.0 [2024-08-06 07:31:55,510][52665] Sum rewards: 67.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.134', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.050', 'AMMO3': '0.233', 'weapon5': '0.236', 'AMMO4': '0.250', 'weapon4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.706', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '56.000'} [2024-08-06 07:31:56,272][52794] DAMAGECOUNT value on done: 873516.0 [2024-08-06 07:31:56,275][52794] Sum rewards: 81.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.717', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.278', 'WEAPON3': '1.100', 'weapon3': '3.420', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '65.000'} [2024-08-06 07:31:56,403][52663] DAMAGECOUNT value on done: 856587.0 [2024-08-06 07:31:56,403][52663] Sum rewards: 79.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.220', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.128', 'AMMO4': '0.129', 'weapon5': '0.140', 'weapon2': '0.172', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.340', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '66.000'} [2024-08-06 07:31:56,701][52650] Updated weights for policy 0, policy_version 77201 (0.0030) [2024-08-06 07:31:56,871][52649] DAMAGECOUNT value on done: 853262.0 [2024-08-06 07:31:56,872][52649] Sum rewards: 66.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO5': '0.019', 'AMMO2': '0.076', 'weapon4': '0.102', 'AMMO3': '0.217', 'weapon5': '0.266', 'AMMO4': '0.382', 'weapon2': '0.388', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '55.000'} [2024-08-06 07:31:56,936][52671] DAMAGECOUNT value on done: 878100.0 [2024-08-06 07:31:56,937][52671] Sum rewards: 73.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.202', 'weapon2': '0.502', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '60.000'} [2024-08-06 07:31:57,014][52669] DAMAGECOUNT value on done: 896739.0 [2024-08-06 07:31:57,015][52669] Sum rewards: 74.482, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.632', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.098', 'AMMO4': '0.191', 'weapon2': '0.202', 'weapon5': '0.208', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '61.000'} [2024-08-06 07:31:57,448][52670] DAMAGECOUNT value on done: 857875.0 [2024-08-06 07:31:57,449][52670] Sum rewards: 77.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.086', 'AMMO3': '0.199', 'AMMO4': '0.247', 'weapon5': '0.252', 'weapon2': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '63.000'} [2024-08-06 07:31:57,792][52647] DAMAGECOUNT value on done: 904396.0 [2024-08-06 07:31:57,794][52647] Sum rewards: 67.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.845', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.148', 'weapon5': '0.172', 'AMMO3': '0.233', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.286', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '55.000'} [2024-08-06 07:31:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 632446976. Throughput: 0: 4370.9. Samples: 158119670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:31:57,799][52567] Avg episode reward: [(0, '75.437')] [2024-08-06 07:31:58,577][52665] DAMAGECOUNT value on done: 861960.0 [2024-08-06 07:31:58,578][52665] Sum rewards: 70.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.152', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'weapon5': '0.276', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '57.000'} [2024-08-06 07:31:59,021][52663] DAMAGECOUNT value on done: 864789.0 [2024-08-06 07:31:59,023][52663] Sum rewards: 92.133, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.195', 'WEAPON3': '1.050', 'HEALTH': '1.209', 'weapon3': '3.520', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.985', 'FRAGCOUNT': '74.000'} [2024-08-06 07:31:59,398][52671] DAMAGECOUNT value on done: 875370.0 [2024-08-06 07:31:59,398][52671] Sum rewards: 81.329, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'weapon4': '0.114', 'AMMO4': '0.135', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '66.000'} [2024-08-06 07:31:59,626][52669] DAMAGECOUNT value on done: 884405.0 [2024-08-06 07:31:59,627][52669] Sum rewards: 87.204, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.965', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.066', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.346', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '70.000'} [2024-08-06 07:31:59,661][52794] DAMAGECOUNT value on done: 874837.0 [2024-08-06 07:31:59,661][52794] Sum rewards: 84.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.188', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon4': '0.104', 'weapon5': '0.138', 'AMMO3': '0.175', 'AMMO4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:00,057][52649] DAMAGECOUNT value on done: 849728.0 [2024-08-06 07:32:00,058][52649] Sum rewards: 78.910, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.088', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.284', 'weapon2': '0.364', 'WEAPON3': '1.750', 'weapon3': '3.268', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:00,299][52647] DAMAGECOUNT value on done: 920646.0 [2024-08-06 07:32:00,299][52647] Sum rewards: 72.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.078', 'AMMO3': '0.186', 'weapon5': '0.232', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '59.000'} [2024-08-06 07:32:00,546][52670] DAMAGECOUNT value on done: 872247.0 [2024-08-06 07:32:00,547][52670] Sum rewards: 75.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.415', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.134', 'AMMO3': '0.212', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.588', 'WEAPON3': '1.400', 'weapon3': '2.690', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:01,368][52811] DAMAGECOUNT value on done: 827875.0 [2024-08-06 07:32:01,370][52811] Sum rewards: 80.302, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.170', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:01,511][52650] Updated weights for policy 0, policy_version 77211 (0.0013) [2024-08-06 07:32:01,539][52663] DAMAGECOUNT value on done: 866693.0 [2024-08-06 07:32:01,539][52663] Sum rewards: 87.205, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.516', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'weapon2': '0.218', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'weapon3': '3.498', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '74.000'} [2024-08-06 07:32:01,713][52665] DAMAGECOUNT value on done: 865816.0 [2024-08-06 07:32:01,713][52665] Sum rewards: 70.963, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.222', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.233', 'AMMO3': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.650', 'weapon3': '2.932', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:02,045][52671] DAMAGECOUNT value on done: 872235.0 [2024-08-06 07:32:02,048][52671] Sum rewards: 73.897, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.724', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.078', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.186', 'AMMO3': '0.193', 'WEAPON3': '1.200', 'weapon3': '3.466', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '60.000'} [2024-08-06 07:32:02,226][52669] DAMAGECOUNT value on done: 879414.0 [2024-08-06 07:32:02,227][52669] Sum rewards: 90.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.146', 'weapon5': '0.178', 'AMMO3': '0.209', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '75.000'} [2024-08-06 07:32:02,611][52647] DAMAGECOUNT value on done: 919173.0 [2024-08-06 07:32:02,614][52647] Sum rewards: 77.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.038', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 632537088. Throughput: 0: 4362.9. Samples: 158132640. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:32:02,795][52567] Avg episode reward: [(0, '76.152')] [2024-08-06 07:32:02,932][52794] DAMAGECOUNT value on done: 882401.0 [2024-08-06 07:32:02,933][52794] Sum rewards: 83.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.484', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '71.000'} [2024-08-06 07:32:03,018][52664] DAMAGECOUNT value on done: 900726.0 [2024-08-06 07:32:03,020][52664] Sum rewards: 63.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.728', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.220', 'weapon4': '0.268', 'weapon5': '0.268', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '54.000'} [2024-08-06 07:32:03,217][52649] DAMAGECOUNT value on done: 852451.0 [2024-08-06 07:32:03,217][52649] Sum rewards: 72.695, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.734', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.152', 'weapon5': '0.158', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.196', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:03,457][52666] DAMAGECOUNT value on done: 872255.0 [2024-08-06 07:32:03,459][52666] Sum rewards: 79.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.531', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.085', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.338', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:03,480][52670] DAMAGECOUNT value on done: 858286.0 [2024-08-06 07:32:03,480][52670] Sum rewards: 83.200, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.394', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:04,363][52663] DAMAGECOUNT value on done: 870663.0 [2024-08-06 07:32:04,364][52663] Sum rewards: 75.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.050', 'weapon4': '0.090', 'AMMO4': '0.131', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:04,580][52811] DAMAGECOUNT value on done: 812445.0 [2024-08-06 07:32:04,580][52811] Sum rewards: 65.613, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.860', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.056', 'weapon5': '0.118', 'AMMO4': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.188', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:04,871][52665] DAMAGECOUNT value on done: 848610.0 [2024-08-06 07:32:04,874][52665] Sum rewards: 76.025, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.414', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.092', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:04,910][52671] DAMAGECOUNT value on done: 879636.0 [2024-08-06 07:32:04,912][52671] Sum rewards: 79.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.898', 'AMMO5': '0.024', 'AMMO2': '0.061', 'AMMO3': '0.196', 'weapon2': '0.202', 'AMMO4': '0.304', 'weapon5': '0.306', 'weapon4': '0.598', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.496', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:04,999][52669] DAMAGECOUNT value on done: 883531.0 [2024-08-06 07:32:05,001][52669] Sum rewards: 82.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.542', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.128', 'weapon5': '0.144', 'weapon2': '0.210', 'AMMO3': '0.249', 'AMMO4': '0.273', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.290', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '70.000'} [2024-08-06 07:32:05,006][52647] DAMAGECOUNT value on done: 917155.0 [2024-08-06 07:32:05,007][52647] Sum rewards: 60.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.164', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.070', 'weapon5': '0.178', 'AMMO3': '0.184', 'AMMO4': '0.261', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.644', 'WEAPON3': '1.000', 'HITCOUNT': '2.770', 'weapon3': '2.794', 'DAMAGECOUNT': '14.604', 'FRAGCOUNT': '49.000'} [2024-08-06 07:32:05,464][52664] DAMAGECOUNT value on done: 907711.0 [2024-08-06 07:32:05,464][52664] Sum rewards: 79.289, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.028', 'weapon5': '0.066', 'AMMO4': '0.090', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:05,972][52794] DAMAGECOUNT value on done: 874814.0 [2024-08-06 07:32:05,973][52794] Sum rewards: 77.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.084', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.372', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:06,106][52666] DAMAGECOUNT value on done: 866294.0 [2024-08-06 07:32:06,106][52666] Sum rewards: 88.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.722', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.152', 'AMMO3': '0.159', 'weapon5': '0.166', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.136', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.033', 'FRAGCOUNT': '70.000'} [2024-08-06 07:32:06,139][52650] Updated weights for policy 0, policy_version 77221 (0.0012) [2024-08-06 07:32:06,154][52670] DAMAGECOUNT value on done: 860699.0 [2024-08-06 07:32:06,155][52670] Sum rewards: 78.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.058', 'AMMO3': '0.155', 'AMMO4': '0.160', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '62.500'} [2024-08-06 07:32:06,348][52649] DAMAGECOUNT value on done: 850466.0 [2024-08-06 07:32:06,348][52649] Sum rewards: 66.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.082', 'weapon5': '0.154', 'AMMO4': '0.158', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:06,850][52663] DAMAGECOUNT value on done: 869416.0 [2024-08-06 07:32:06,850][52663] Sum rewards: 65.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.045', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.226', 'AMMO3': '0.227', 'weapon4': '0.236', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:07,548][52647] DAMAGECOUNT value on done: 906903.0 [2024-08-06 07:32:07,548][52647] Sum rewards: 85.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.179', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.150', 'weapon5': '0.168', 'AMMO4': '0.236', 'weapon2': '0.264', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.072', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '67.000'} [2024-08-06 07:32:07,693][52669] DAMAGECOUNT value on done: 885330.0 [2024-08-06 07:32:07,694][52669] Sum rewards: 77.538, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.160', 'weapon2': '0.174', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'WEAPON3': '1.000', 'weapon3': '3.194', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:07,707][52811] DAMAGECOUNT value on done: 806487.0 [2024-08-06 07:32:07,709][52811] Sum rewards: 72.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.128', 'weapon4': '0.136', 'AMMO4': '0.139', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '59.000'} [2024-08-06 07:32:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 632619008. Throughput: 0: 4370.2. Samples: 158159270. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:32:07,794][52567] Avg episode reward: [(0, '76.390')] [2024-08-06 07:32:07,989][52665] DAMAGECOUNT value on done: 853265.0 [2024-08-06 07:32:07,990][52665] Sum rewards: 65.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'weapon4': '0.278', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '55.000'} [2024-08-06 07:32:08,104][52671] DAMAGECOUNT value on done: 875791.0 [2024-08-06 07:32:08,105][52671] Sum rewards: 75.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.170', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:08,137][52664] DAMAGECOUNT value on done: 907523.0 [2024-08-06 07:32:08,137][52664] Sum rewards: 69.298, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.046', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.308', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.366', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:09,026][52670] DAMAGECOUNT value on done: 873421.0 [2024-08-06 07:32:09,028][52670] Sum rewards: 79.950, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.110', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.232', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.442', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:09,045][52666] DAMAGECOUNT value on done: 872618.0 [2024-08-06 07:32:09,046][52666] Sum rewards: 84.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.147', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.142', 'AMMO4': '0.181', 'AMMO3': '0.206', 'weapon2': '0.282', 'weapon4': '0.388', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '69.000'} [2024-08-06 07:32:09,371][52663] DAMAGECOUNT value on done: 874610.0 [2024-08-06 07:32:09,371][52663] Sum rewards: 81.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.038', 'AMMO4': '0.115', 'weapon5': '0.124', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.546', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '64.500'} [2024-08-06 07:32:09,491][52649] DAMAGECOUNT value on done: 844922.0 [2024-08-06 07:32:09,491][52649] Sum rewards: 64.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.291', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.076', 'weapon5': '0.092', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '55.000'} [2024-08-06 07:32:10,627][52647] DAMAGECOUNT value on done: 922356.0 [2024-08-06 07:32:10,627][52647] Sum rewards: 75.632, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.275', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.180', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:10,770][52650] Updated weights for policy 0, policy_version 77231 (0.0014) [2024-08-06 07:32:10,811][52811] DAMAGECOUNT value on done: 809942.0 [2024-08-06 07:32:10,812][52811] Sum rewards: 62.517, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.126', 'weapon4': '0.198', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '52.000'} [2024-08-06 07:32:10,974][52665] DAMAGECOUNT value on done: 858377.0 [2024-08-06 07:32:10,976][52665] Sum rewards: 68.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.098', 'weapon4': '0.110', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.518', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '56.000'} [2024-08-06 07:32:11,250][52664] DAMAGECOUNT value on done: 898738.0 [2024-08-06 07:32:11,251][52664] Sum rewards: 84.689, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.984', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon2': '0.210', 'weapon5': '0.210', 'AMMO3': '0.238', 'AMMO4': '0.248', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.898', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:11,255][52671] DAMAGECOUNT value on done: 860671.0 [2024-08-06 07:32:11,255][52671] Sum rewards: 66.941, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.810', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.096', 'weapon5': '0.174', 'AMMO4': '0.212', 'AMMO3': '0.250', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.014', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:11,787][52663] DAMAGECOUNT value on done: 878651.0 [2024-08-06 07:32:11,788][52663] Sum rewards: 81.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.097', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.223', 'WEAPON3': '1.350', 'weapon3': '3.616', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:11,995][52670] DAMAGECOUNT value on done: 860846.0 [2024-08-06 07:32:11,995][52670] Sum rewards: 85.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.022', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.225', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.400', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '73.000'} [2024-08-06 07:32:12,004][52666] DAMAGECOUNT value on done: 867217.0 [2024-08-06 07:32:12,004][52666] Sum rewards: 70.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.884', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.173', 'AMMO3': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:12,500][52649] DAMAGECOUNT value on done: 854482.0 [2024-08-06 07:32:12,502][52649] Sum rewards: 58.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.064', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.350', 'HITCOUNT': '2.760', 'weapon3': '3.020', 'DAMAGECOUNT': '14.811', 'FRAGCOUNT': '49.000'} [2024-08-06 07:32:12,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 632700928. Throughput: 0: 4370.0. Samples: 158185410. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:32:12,794][52567] Avg episode reward: [(0, '76.197')] [2024-08-06 07:32:12,979][52647] DAMAGECOUNT value on done: 910868.0 [2024-08-06 07:32:12,980][52647] Sum rewards: 70.401, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.015', 'AMMO2': '0.021', 'AMMO4': '0.102', 'weapon5': '0.132', 'AMMO3': '0.153', 'weapon4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.982', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:13,547][52664] DAMAGECOUNT value on done: 910546.0 [2024-08-06 07:32:13,549][52664] Sum rewards: 76.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'weapon4': '0.068', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.286', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:13,957][52811] DAMAGECOUNT value on done: 812650.0 [2024-08-06 07:32:13,959][52811] Sum rewards: 84.972, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.142', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.366', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '69.000'} [2024-08-06 07:32:14,061][52665] DAMAGECOUNT value on done: 857967.0 [2024-08-06 07:32:14,063][52665] Sum rewards: 75.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.082', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.092', 'AMMO4': '0.136', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:14,434][52671] DAMAGECOUNT value on done: 885184.0 [2024-08-06 07:32:14,435][52671] Sum rewards: 78.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.024', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.060', 'weapon5': '0.176', 'AMMO4': '0.228', 'AMMO3': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:14,874][52663] DAMAGECOUNT value on done: 862026.0 [2024-08-06 07:32:14,874][52663] Sum rewards: 72.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.982', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.193', 'weapon4': '0.204', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:14,886][52666] DAMAGECOUNT value on done: 861468.0 [2024-08-06 07:32:14,886][52666] Sum rewards: 74.339, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.150', 'weapon5': '0.184', 'weapon2': '0.204', 'AMMO3': '0.276', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:14,932][52670] DAMAGECOUNT value on done: 856133.0 [2024-08-06 07:32:14,932][52670] Sum rewards: 70.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.004', 'weapon5': '0.028', 'AMMO2': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'AMMO4': '0.218', 'ARMOR': '0.456', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '56.000'} [2024-08-06 07:32:15,351][52649] DAMAGECOUNT value on done: 861936.0 [2024-08-06 07:32:15,353][52649] Sum rewards: 58.382, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.174', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.030', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'AMMO3': '0.265', 'weapon2': '0.286', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.356', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '51.000'} [2024-08-06 07:32:15,636][52650] Updated weights for policy 0, policy_version 77241 (0.0017) [2024-08-06 07:32:15,721][52647] DAMAGECOUNT value on done: 921131.0 [2024-08-06 07:32:15,721][52647] Sum rewards: 74.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.155', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.104', 'weapon5': '0.156', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:16,432][52664] DAMAGECOUNT value on done: 906328.0 [2024-08-06 07:32:16,434][52664] Sum rewards: 71.200, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon4': '0.160', 'weapon5': '0.166', 'weapon2': '0.200', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '60.000'} [2024-08-06 07:32:16,573][52665] DAMAGECOUNT value on done: 866343.0 [2024-08-06 07:32:16,587][52665] Sum rewards: 69.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.475', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:17,056][52811] DAMAGECOUNT value on done: 826799.0 [2024-08-06 07:32:17,057][52811] Sum rewards: 87.277, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.438', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '73.000'} [2024-08-06 07:32:17,088][52671] DAMAGECOUNT value on done: 884321.0 [2024-08-06 07:32:17,089][52671] Sum rewards: 70.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.134', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.648', 'WEAPON3': '1.300', 'weapon3': '2.846', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 632799232. Throughput: 0: 4370.4. Samples: 158198440. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:32:17,802][52567] Avg episode reward: [(0, '75.803')] [2024-08-06 07:32:18,104][52666] DAMAGECOUNT value on done: 867428.0 [2024-08-06 07:32:18,105][52666] Sum rewards: 76.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.052', 'AMMO4': '0.177', 'weapon2': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:18,165][52670] DAMAGECOUNT value on done: 862828.0 [2024-08-06 07:32:18,165][52670] Sum rewards: 55.318, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.897', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon5': '0.184', 'weapon4': '0.194', 'weapon2': '0.212', 'AMMO3': '0.291', 'AMMO4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'HITCOUNT': '2.810', 'weapon3': '3.074', 'DAMAGECOUNT': '14.184', 'FRAGCOUNT': '50.000'} [2024-08-06 07:32:18,267][52649] DAMAGECOUNT value on done: 854580.0 [2024-08-06 07:32:18,268][52649] Sum rewards: 75.586, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.026', 'AMMO2': '0.071', 'AMMO3': '0.201', 'weapon4': '0.270', 'weapon5': '0.332', 'weapon2': '0.352', 'AMMO4': '0.355', 'WEAPON5': '0.750', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.664', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:18,782][52647] DAMAGECOUNT value on done: 921951.0 [2024-08-06 07:32:18,783][52647] Sum rewards: 79.437, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.042', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:19,180][52667] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon5', 0.002)] [2024-08-06 07:32:19,365][52665] DAMAGECOUNT value on done: 858866.0 [2024-08-06 07:32:19,365][52665] Sum rewards: 76.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.568', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.396', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:19,623][52664] DAMAGECOUNT value on done: 896512.0 [2024-08-06 07:32:19,623][52664] Sum rewards: 69.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.752', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.104', 'weapon5': '0.218', 'AMMO4': '0.219', 'AMMO3': '0.230', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.488', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:19,839][52671] DAMAGECOUNT value on done: 878192.0 [2024-08-06 07:32:19,839][52671] Sum rewards: 77.068, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.130', 'AMMO4': '0.155', 'weapon5': '0.164', 'AMMO3': '0.240', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.186', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:19,974][52650] Updated weights for policy 0, policy_version 77251 (0.0028) [2024-08-06 07:32:20,185][52811] DAMAGECOUNT value on done: 820315.0 [2024-08-06 07:32:20,185][52811] Sum rewards: 93.684, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.181', 'weapon5': '0.220', 'weapon4': '0.224', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.492', 'WEAPON3': '1.000', 'weapon3': '3.018', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.756', 'FRAGCOUNT': '74.000'} [2024-08-06 07:32:20,632][52649] DAMAGECOUNT value on done: 856138.0 [2024-08-06 07:32:20,632][52649] Sum rewards: 72.053, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.305', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.088', 'weapon5': '0.174', 'AMMO4': '0.213', 'AMMO3': '0.309', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.850', 'weapon3': '3.036', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:20,852][52670] DAMAGECOUNT value on done: 862150.0 [2024-08-06 07:32:20,852][52670] Sum rewards: 77.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.736', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.160', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:20,873][52666] DAMAGECOUNT value on done: 863434.0 [2024-08-06 07:32:20,874][52666] Sum rewards: 71.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.374', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.090', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.528', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '59.000'} [2024-08-06 07:32:21,692][52665] DAMAGECOUNT value on done: 873724.0 [2024-08-06 07:32:21,692][52665] Sum rewards: 84.001, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.460', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.192', 'weapon2': '0.206', 'WEAPON3': '1.150', 'weapon3': '3.558', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:21,977][52647] DAMAGECOUNT value on done: 909162.0 [2024-08-06 07:32:21,977][52647] Sum rewards: 83.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.082', 'AMMO4': '0.175', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:22,698][52671] DAMAGECOUNT value on done: 883971.0 [2024-08-06 07:32:22,698][52671] Sum rewards: 77.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.852', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'weapon2': '0.218', 'AMMO3': '0.229', 'WEAPON3': '1.500', 'weapon3': '3.412', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:22,795][52567] Fps is (10 sec: 18021.4, 60 sec: 17476.1, 300 sec: 17494.7). Total num frames: 632881152. Throughput: 0: 4368.2. Samples: 158224610. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:22,803][52567] Avg episode reward: [(0, '75.763')] [2024-08-06 07:32:22,921][52664] DAMAGECOUNT value on done: 896127.0 [2024-08-06 07:32:22,922][52664] Sum rewards: 80.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.558', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.144', 'weapon4': '0.156', 'AMMO4': '0.172', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:23,140][52649] DAMAGECOUNT value on done: 843595.0 [2024-08-06 07:32:23,140][52649] Sum rewards: 78.778, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.251', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.096', 'AMMO3': '0.135', 'weapon4': '0.146', 'weapon5': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '0.900', 'weapon3': '2.950', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:23,375][52811] DAMAGECOUNT value on done: 809605.0 [2024-08-06 07:32:23,377][52811] Sum rewards: 63.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.951', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.136', 'AMMO3': '0.223', 'weapon5': '0.260', 'AMMO4': '0.281', 'weapon2': '0.398', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.898', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '55.000'} [2024-08-06 07:32:23,443][52666] DAMAGECOUNT value on done: 860754.0 [2024-08-06 07:32:23,444][52666] Sum rewards: 75.044, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.558', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.086', 'AMMO3': '0.198', 'AMMO4': '0.209', 'weapon5': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:23,529][52670] DAMAGECOUNT value on done: 856547.0 [2024-08-06 07:32:23,530][52670] Sum rewards: 64.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.826', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.174', 'AMMO3': '0.212', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON4': '0.400', 'weapon4': '0.490', 'WEAPON3': '1.250', 'weapon3': '2.504', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '56.000'} [2024-08-06 07:32:23,659][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:32:24,362][52665] DAMAGECOUNT value on done: 864790.0 [2024-08-06 07:32:24,363][52665] Sum rewards: 73.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'AMMO3': '0.246', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:24,783][52647] DAMAGECOUNT value on done: 914195.0 [2024-08-06 07:32:24,784][52647] Sum rewards: 78.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.251', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:25,073][52650] Updated weights for policy 0, policy_version 77261 (0.0014) [2024-08-06 07:32:25,567][52664] DAMAGECOUNT value on done: 907762.0 [2024-08-06 07:32:25,567][52664] Sum rewards: 93.875, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.287', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.405', 'FRAGCOUNT': '74.500'} [2024-08-06 07:32:25,671][52671] DAMAGECOUNT value on done: 868539.0 [2024-08-06 07:32:25,672][52671] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.660', 'AMMO5': '0.005', 'AMMO2': '0.040', 'weapon5': '0.088', 'weapon4': '0.138', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:25,794][52649] DAMAGECOUNT value on done: 854131.0 [2024-08-06 07:32:25,797][52649] Sum rewards: 60.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.628', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.040', 'weapon5': '0.146', 'AMMO4': '0.202', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.198', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '52.000'} [2024-08-06 07:32:26,346][52666] DAMAGECOUNT value on done: 869170.0 [2024-08-06 07:32:26,346][52666] Sum rewards: 80.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.566', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.106', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.264', 'WEAPON3': '1.350', 'weapon3': '3.316', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:26,364][52670] DAMAGECOUNT value on done: 870338.0 [2024-08-06 07:32:26,364][52670] Sum rewards: 90.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.384', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '73.000'} [2024-08-06 07:32:26,460][52811] DAMAGECOUNT value on done: 818987.0 [2024-08-06 07:32:26,460][52811] Sum rewards: 77.545, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO3': '0.156', 'AMMO4': '0.183', 'weapon5': '0.234', 'weapon4': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '2.640', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '60.000'} [2024-08-06 07:32:26,548][52649] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:32:26,851][52665] DAMAGECOUNT value on done: 861206.0 [2024-08-06 07:32:26,853][52665] Sum rewards: 70.765, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.288', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.098', 'weapon4': '0.112', 'AMMO4': '0.233', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:27,706][52647] DAMAGECOUNT value on done: 907921.0 [2024-08-06 07:32:27,706][52647] Sum rewards: 79.839, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.580', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.454', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:27,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 632971264. Throughput: 0: 4363.1. Samples: 158250680. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:27,802][52567] Avg episode reward: [(0, '75.649')] [2024-08-06 07:32:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077267_632971264.pth... [2024-08-06 07:32:27,926][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000076754_628768768.pth [2024-08-06 07:32:28,250][52649] DAMAGECOUNT value on done: 836800.0 [2024-08-06 07:32:28,250][52649] Sum rewards: 71.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.755', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon5': '0.226', 'AMMO3': '0.227', 'weapon2': '0.260', 'AMMO4': '0.304', 'weapon4': '0.422', 'WEAPON5': '0.450', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.778', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '60.000'} [2024-08-06 07:32:28,818][52664] DAMAGECOUNT value on done: 903005.0 [2024-08-06 07:32:28,819][52664] Sum rewards: 72.377, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.730', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.176', 'weapon2': '0.264', 'weapon4': '0.310', 'AMMO3': '0.317', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '2.962', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:28,896][52666] DAMAGECOUNT value on done: 862787.0 [2024-08-06 07:32:28,897][52666] Sum rewards: 81.754, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.068', 'weapon5': '0.182', 'weapon2': '0.184', 'AMMO3': '0.193', 'AMMO4': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.372', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:28,915][52670] DAMAGECOUNT value on done: 851454.0 [2024-08-06 07:32:28,916][52670] Sum rewards: 76.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.192', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon2': '0.656', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:29,235][52665] DAMAGECOUNT value on done: 866547.0 [2024-08-06 07:32:29,236][52665] Sum rewards: 80.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.084', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.422', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:29,416][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:32:29,477][52650] Updated weights for policy 0, policy_version 77271 (0.0035) [2024-08-06 07:32:29,589][52811] DAMAGECOUNT value on done: 815643.0 [2024-08-06 07:32:29,589][52811] Sum rewards: 69.968, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.780', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.128', 'weapon4': '0.130', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:30,701][52649] DAMAGECOUNT value on done: 859078.0 [2024-08-06 07:32:30,703][52649] Sum rewards: 72.994, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.571', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.448', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:30,824][52647] DAMAGECOUNT value on done: 910152.0 [2024-08-06 07:32:30,824][52647] Sum rewards: 81.337, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon4': '0.360', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:31,743][52664] DAMAGECOUNT value on done: 911830.0 [2024-08-06 07:32:31,743][52664] Sum rewards: 72.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.114', 'AMMO4': '0.120', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:31,804][52666] DAMAGECOUNT value on done: 869451.0 [2024-08-06 07:32:31,805][52666] Sum rewards: 74.868, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.101', 'weapon5': '0.118', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'weapon3': '3.364', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:31,854][52670] DAMAGECOUNT value on done: 866927.0 [2024-08-06 07:32:31,855][52670] Sum rewards: 79.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.082', 'weapon4': '0.100', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:31,968][52668] DAMAGECOUNT value on done: 878231.0 [2024-08-06 07:32:31,971][52668] Sum rewards: 70.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.315', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.034', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '60.000'} [2024-08-06 07:32:31,981][52665] DAMAGECOUNT value on done: 857859.0 [2024-08-06 07:32:31,981][52665] Sum rewards: 81.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:32,640][52811] DAMAGECOUNT value on done: 820090.0 [2024-08-06 07:32:32,643][52811] Sum rewards: 82.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.776', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.145', 'weapon2': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:32,794][52567] Fps is (10 sec: 17204.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 633053184. Throughput: 0: 4355.6. Samples: 158263550. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:32,794][52567] Avg episode reward: [(0, '75.557')] [2024-08-06 07:32:33,799][52649] DAMAGECOUNT value on done: 857910.0 [2024-08-06 07:32:33,803][52649] Sum rewards: 78.196, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.205', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.160', 'weapon5': '0.180', 'AMMO3': '0.233', 'AMMO4': '0.240', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:34,219][52650] Updated weights for policy 0, policy_version 77281 (0.0014) [2024-08-06 07:32:34,250][52664] DAMAGECOUNT value on done: 911218.0 [2024-08-06 07:32:34,251][52664] Sum rewards: 80.199, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.074', 'weapon5': '0.086', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:34,757][52666] DAMAGECOUNT value on done: 853075.0 [2024-08-06 07:32:34,757][52666] Sum rewards: 64.954, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.852', 'AMMO5': '0.024', 'AMMO2': '0.070', 'weapon5': '0.198', 'AMMO3': '0.268', 'weapon4': '0.290', 'AMMO4': '0.352', 'weapon2': '0.422', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.686', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '59.000'} [2024-08-06 07:32:34,808][52670] DAMAGECOUNT value on done: 871867.0 [2024-08-06 07:32:34,809][52670] Sum rewards: 63.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.122', 'AMMO4': '0.150', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.244', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '55.000'} [2024-08-06 07:32:34,938][52668] DAMAGECOUNT value on done: 879307.0 [2024-08-06 07:32:34,938][52668] Sum rewards: 64.651, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.652', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.076', 'weapon5': '0.086', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.218', 'FRAGCOUNT': '52.000'} [2024-08-06 07:32:34,999][52665] DAMAGECOUNT value on done: 864766.0 [2024-08-06 07:32:35,000][52665] Sum rewards: 78.530, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.136', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.134', 'weapon4': '0.196', 'AMMO4': '0.235', 'AMMO3': '0.258', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:35,729][52811] DAMAGECOUNT value on done: 825874.0 [2024-08-06 07:32:35,731][52811] Sum rewards: 72.105, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.884', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.118', 'AMMO4': '0.181', 'weapon4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:36,657][52649] DAMAGECOUNT value on done: 850342.0 [2024-08-06 07:32:36,657][52649] Sum rewards: 85.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.216', 'WEAPON3': '1.200', 'weapon3': '3.560', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:37,310][52664] DAMAGECOUNT value on done: 910146.0 [2024-08-06 07:32:37,311][52664] Sum rewards: 82.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.092', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'weapon4': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '67.000'} [2024-08-06 07:32:37,331][52666] DAMAGECOUNT value on done: 872869.0 [2024-08-06 07:32:37,332][52666] Sum rewards: 66.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.274', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.151', 'weapon5': '0.192', 'AMMO3': '0.219', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.192', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '56.000'} [2024-08-06 07:32:37,398][52670] DAMAGECOUNT value on done: 865528.0 [2024-08-06 07:32:37,399][52670] Sum rewards: 73.272, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.844', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.046', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.508', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 633143296. Throughput: 0: 4363.3. Samples: 158289850. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:37,794][52567] Avg episode reward: [(0, '75.101')] [2024-08-06 07:32:37,805][52665] DAMAGECOUNT value on done: 864851.0 [2024-08-06 07:32:37,807][52665] Sum rewards: 79.654, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.022', 'AMMO2': '0.059', 'AMMO3': '0.165', 'weapon2': '0.242', 'weapon4': '0.244', 'weapon5': '0.282', 'AMMO4': '0.297', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:38,015][52668] DAMAGECOUNT value on done: 874360.0 [2024-08-06 07:32:38,015][52668] Sum rewards: 79.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.520', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.306', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:38,824][52811] DAMAGECOUNT value on done: 817203.0 [2024-08-06 07:32:38,825][52811] Sum rewards: 89.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.352', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.160', 'AMMO3': '0.198', 'AMMO4': '0.215', 'weapon5': '0.228', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.980', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.676', 'FRAGCOUNT': '71.000'} [2024-08-06 07:32:39,156][52650] Updated weights for policy 0, policy_version 77291 (0.0013) [2024-08-06 07:32:40,043][52664] DAMAGECOUNT value on done: 921625.0 [2024-08-06 07:32:40,044][52664] Sum rewards: 68.742, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.220', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.138', 'weapon5': '0.190', 'AMMO3': '0.242', 'AMMO4': '0.285', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon2': '0.642', 'WEAPON3': '1.450', 'weapon3': '2.712', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '59.000'} [2024-08-06 07:32:40,287][52670] DAMAGECOUNT value on done: 847327.0 [2024-08-06 07:32:40,289][52670] Sum rewards: 76.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.981', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.039', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.167', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:40,297][52666] DAMAGECOUNT value on done: 869350.0 [2024-08-06 07:32:40,299][52666] Sum rewards: 91.860, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.054', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.540', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '74.000'} [2024-08-06 07:32:40,932][52665] DAMAGECOUNT value on done: 855611.0 [2024-08-06 07:32:40,932][52665] Sum rewards: 62.522, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.148', 'weapon5': '0.148', 'AMMO4': '0.277', 'weapon2': '0.278', 'AMMO3': '0.285', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.114', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '55.000'} [2024-08-06 07:32:41,013][52668] DAMAGECOUNT value on done: 879079.0 [2024-08-06 07:32:41,014][52668] Sum rewards: 63.077, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.013', 'HEALTH': '0.030', 'AMMO2': '0.054', 'AMMO3': '0.165', 'weapon5': '0.216', 'AMMO4': '0.270', 'weapon4': '0.358', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.718', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '48.500'} [2024-08-06 07:32:41,977][52811] DAMAGECOUNT value on done: 815053.0 [2024-08-06 07:32:41,978][52811] Sum rewards: 60.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.834', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.130', 'AMMO3': '0.184', 'weapon5': '0.216', 'AMMO4': '0.296', 'weapon2': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.078', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '49.000'} [2024-08-06 07:32:42,238][52660] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0), ('weapon5', 0.002)] [2024-08-06 07:32:42,623][52664] DAMAGECOUNT value on done: 916267.0 [2024-08-06 07:32:42,635][52664] Sum rewards: 70.778, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.502', 'AMMO5': '0.014', 'AMMO2': '0.020', 'weapon5': '0.072', 'weapon4': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.664', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 07:32:42,674][52670] DAMAGECOUNT value on done: 862083.0 [2024-08-06 07:32:42,674][52670] Sum rewards: 68.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.396', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.140', 'AMMO4': '0.193', 'WEAPON5': '0.250', 'weapon4': '0.262', 'AMMO3': '0.269', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.060', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:42,720][52666] DAMAGECOUNT value on done: 866614.0 [2024-08-06 07:32:42,722][52666] Sum rewards: 76.113, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.048', 'AMMO4': '0.160', 'weapon5': '0.176', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 633233408. Throughput: 0: 4364.7. Samples: 158316080. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:42,794][52567] Avg episode reward: [(0, '74.821')] [2024-08-06 07:32:43,559][52650] Updated weights for policy 0, policy_version 77301 (0.0032) [2024-08-06 07:32:44,024][52665] DAMAGECOUNT value on done: 860430.0 [2024-08-06 07:32:44,024][52665] Sum rewards: 84.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.560', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.162', 'AMMO4': '0.165', 'AMMO3': '0.212', 'weapon4': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '70.000'} [2024-08-06 07:32:44,151][52668] DAMAGECOUNT value on done: 866058.0 [2024-08-06 07:32:44,153][52668] Sum rewards: 68.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO3': '0.179', 'AMMO4': '0.196', 'weapon2': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '56.000'} [2024-08-06 07:32:45,017][52811] DAMAGECOUNT value on done: 813456.0 [2024-08-06 07:32:45,018][52811] Sum rewards: 79.178, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.032', 'WEAPON4': '0.050', 'AMMO4': '0.052', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:45,231][52664] DAMAGECOUNT value on done: 915552.0 [2024-08-06 07:32:45,231][52664] Sum rewards: 71.296, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.718', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.086', 'AMMO4': '0.088', 'weapon2': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:45,620][52670] DAMAGECOUNT value on done: 872398.0 [2024-08-06 07:32:45,621][52670] Sum rewards: 67.644, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.145', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.114', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'weapon2': '0.328', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '55.000'} [2024-08-06 07:32:45,628][52666] DAMAGECOUNT value on done: 859755.0 [2024-08-06 07:32:45,628][52666] Sum rewards: 54.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.602', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.170', 'weapon5': '0.174', 'AMMO4': '0.199', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.350', 'HITCOUNT': '2.630', 'weapon3': '2.956', 'DAMAGECOUNT': '13.788', 'FRAGCOUNT': '48.000'} [2024-08-06 07:32:47,167][52665] DAMAGECOUNT value on done: 866186.0 [2024-08-06 07:32:47,169][52665] Sum rewards: 71.967, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.170', 'weapon2': '0.232', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:47,343][52668] DAMAGECOUNT value on done: 874643.0 [2024-08-06 07:32:47,343][52668] Sum rewards: 83.769, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.167', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:47,783][52664] DAMAGECOUNT value on done: 899469.0 [2024-08-06 07:32:47,785][52664] Sum rewards: 66.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.057', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.124', 'AMMO4': '0.130', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 633323520. Throughput: 0: 4370.5. Samples: 158329310. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:47,794][52567] Avg episode reward: [(0, '74.723')] [2024-08-06 07:32:48,122][52811] DAMAGECOUNT value on done: 816363.0 [2024-08-06 07:32:48,122][52811] Sum rewards: 65.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.974', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.122', 'weapon5': '0.158', 'AMMO4': '0.162', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:48,224][52650] Updated weights for policy 0, policy_version 77311 (0.0012) [2024-08-06 07:32:48,739][52670] DAMAGECOUNT value on done: 864276.0 [2024-08-06 07:32:48,740][52670] Sum rewards: 69.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.194', 'AMMO4': '0.200', 'weapon4': '0.210', 'AMMO3': '0.211', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '58.000'} [2024-08-06 07:32:48,782][52666] DAMAGECOUNT value on done: 861095.0 [2024-08-06 07:32:48,785][52666] Sum rewards: 85.034, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.094', 'AMMO3': '0.172', 'weapon2': '0.248', 'weapon5': '0.252', 'AMMO4': '0.317', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '68.000'} [2024-08-06 07:32:48,938][52662] DAMAGECOUNT value on done: 871863.0 [2024-08-06 07:32:48,941][52662] Sum rewards: 80.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'weapon4': '0.056', 'AMMO4': '0.065', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.592', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:50,230][52664] DAMAGECOUNT value on done: 904787.0 [2024-08-06 07:32:50,231][52664] Sum rewards: 78.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.612', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.169', 'weapon2': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.396', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:50,276][52668] DAMAGECOUNT value on done: 877845.0 [2024-08-06 07:32:50,278][52668] Sum rewards: 71.311, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.738', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.020', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.102', 'weapon2': '0.238', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.400', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:51,307][52811] DAMAGECOUNT value on done: 821602.0 [2024-08-06 07:32:51,307][52811] Sum rewards: 82.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.208', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.092', 'AMMO3': '0.172', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.266', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '66.000'} [2024-08-06 07:32:51,660][52670] DAMAGECOUNT value on done: 866692.0 [2024-08-06 07:32:51,661][52670] Sum rewards: 72.512, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.326', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.250', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.008', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:51,736][52666] DAMAGECOUNT value on done: 877537.0 [2024-08-06 07:32:51,737][52666] Sum rewards: 77.088, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.692', 'AMMO4': '-0.019', 'AMMO2': '-0.004', 'WEAPON1': '0.020', 'AMMO3': '0.222', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:51,790][52662] DAMAGECOUNT value on done: 882648.0 [2024-08-06 07:32:51,794][52662] Sum rewards: 76.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.117', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 633405440. Throughput: 0: 4360.5. Samples: 158355490. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:52,794][52567] Avg episode reward: [(0, '74.743')] [2024-08-06 07:32:53,023][52650] Updated weights for policy 0, policy_version 77321 (0.0028) [2024-08-06 07:32:53,133][52664] DAMAGECOUNT value on done: 909504.0 [2024-08-06 07:32:53,135][52664] Sum rewards: 74.685, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.848', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon5': '0.224', 'weapon4': '0.244', 'weapon2': '0.282', 'AMMO4': '0.304', 'AMMO3': '0.310', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.852', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '65.000'} [2024-08-06 07:32:53,519][52668] DAMAGECOUNT value on done: 865714.0 [2024-08-06 07:32:53,521][52668] Sum rewards: 59.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.670', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.150', 'weapon5': '0.180', 'AMMO4': '0.227', 'AMMO3': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.450', 'HITCOUNT': '2.840', 'weapon3': '2.894', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '51.000'} [2024-08-06 07:32:54,484][52811] DAMAGECOUNT value on done: 825991.0 [2024-08-06 07:32:54,484][52811] Sum rewards: 74.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.175', 'weapon4': '0.182', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:54,648][52666] DAMAGECOUNT value on done: 853829.0 [2024-08-06 07:32:54,651][52666] Sum rewards: 80.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.020', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.166', 'weapon5': '0.174', 'AMMO3': '0.218', 'AMMO4': '0.233', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '67.000'} [2024-08-06 07:32:54,702][52803] DAMAGECOUNT value on done: 812762.0 [2024-08-06 07:32:54,702][52803] Sum rewards: 85.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.421', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.094', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '70.000'} [2024-08-06 07:32:54,825][52662] DAMAGECOUNT value on done: 881890.0 [2024-08-06 07:32:54,826][52662] Sum rewards: 66.319, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.275', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '54.000'} [2024-08-06 07:32:55,542][52664] DAMAGECOUNT value on done: 899731.0 [2024-08-06 07:32:55,543][52664] Sum rewards: 71.372, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.058', 'AMMO4': '0.113', 'AMMO3': '0.135', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '0.850', 'HITCOUNT': '3.200', 'weapon3': '3.228', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 07:32:56,618][52668] DAMAGECOUNT value on done: 868867.0 [2024-08-06 07:32:56,620][52668] Sum rewards: 64.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon2': '0.164', 'weapon4': '0.164', 'weapon5': '0.164', 'AMMO4': '0.224', 'AMMO3': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.110', 'weapon3': '3.280', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '55.000'} [2024-08-06 07:32:57,130][52803] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 07:32:57,381][52662] DAMAGECOUNT value on done: 867995.0 [2024-08-06 07:32:57,383][52662] Sum rewards: 76.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.170', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.090', 'AMMO4': '0.220', 'weapon2': '0.230', 'AMMO3': '0.249', 'weapon5': '0.264', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '64.000'} [2024-08-06 07:32:57,638][52650] Updated weights for policy 0, policy_version 77331 (0.0014) [2024-08-06 07:32:57,664][52811] DAMAGECOUNT value on done: 811343.0 [2024-08-06 07:32:57,666][52811] Sum rewards: 76.303, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.100', 'AMMO3': '0.166', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'weapon4': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.428', 'HEALTH': '0.615', 'WEAPON3': '0.900', 'weapon3': '2.962', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '61.000'} [2024-08-06 07:32:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 633495552. Throughput: 0: 4351.6. Samples: 158381230. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:32:57,794][52567] Avg episode reward: [(0, '74.853')] [2024-08-06 07:32:57,795][52666] DAMAGECOUNT value on done: 860552.0 [2024-08-06 07:32:57,796][52666] Sum rewards: 74.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.698', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.158', 'AMMO3': '0.200', 'weapon4': '0.262', 'AMMO4': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '63.000'} [2024-08-06 07:32:57,913][52803] DAMAGECOUNT value on done: 808669.0 [2024-08-06 07:32:57,915][52803] Sum rewards: 76.086, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.076', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.688', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '62.000'} [2024-08-06 07:32:58,585][52667] DAMAGECOUNT value on done: 872912.0 [2024-08-06 07:32:58,585][52667] Sum rewards: 61.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.343', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon4': '0.100', 'weapon5': '0.158', 'AMMO3': '0.238', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.648', 'WEAPON3': '1.500', 'weapon3': '2.858', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '54.000'} [2024-08-06 07:32:59,160][52668] DAMAGECOUNT value on done: 877707.0 [2024-08-06 07:32:59,160][52668] Sum rewards: 79.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.330', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.134', 'weapon5': '0.138', 'weapon2': '0.178', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '67.000'} [2024-08-06 07:32:59,897][52662] DAMAGECOUNT value on done: 885748.0 [2024-08-06 07:32:59,897][52662] Sum rewards: 70.155, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.746', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.128', 'AMMO4': '0.174', 'weapon5': '0.180', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.100', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '59.000'} [2024-08-06 07:33:00,781][52667] DAMAGECOUNT value on done: 884532.0 [2024-08-06 07:33:00,789][52667] Sum rewards: 75.948, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.406', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.152', 'weapon5': '0.164', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '60.000'} [2024-08-06 07:33:00,851][52811] DAMAGECOUNT value on done: 811813.0 [2024-08-06 07:33:00,852][52811] Sum rewards: 61.152, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.103', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.048', 'AMMO4': '0.064', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON3': '0.800', 'weapon2': '0.856', 'HITCOUNT': '2.800', 'weapon3': '2.846', 'DAMAGECOUNT': '13.641', 'FRAGCOUNT': '48.000'} [2024-08-06 07:33:00,980][52803] DAMAGECOUNT value on done: 817567.0 [2024-08-06 07:33:00,983][52803] Sum rewards: 71.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.326', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.046', 'weapon4': '0.078', 'AMMO4': '0.083', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:02,088][52668] DAMAGECOUNT value on done: 868647.0 [2024-08-06 07:33:02,089][52668] Sum rewards: 76.586, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.022', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.050', 'weapon5': '0.066', 'AMMO3': '0.220', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:02,432][52650] Updated weights for policy 0, policy_version 77341 (0.0011) [2024-08-06 07:33:02,651][52662] DAMAGECOUNT value on done: 864288.0 [2024-08-06 07:33:02,652][52662] Sum rewards: 67.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.305', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.078', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '56.500'} [2024-08-06 07:33:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 633577472. Throughput: 0: 4359.6. Samples: 158394620. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:33:02,794][52567] Avg episode reward: [(0, '74.640')] [2024-08-06 07:33:03,900][52667] DAMAGECOUNT value on done: 880505.0 [2024-08-06 07:33:03,902][52667] Sum rewards: 78.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon2': '0.210', 'weapon5': '0.210', 'AMMO3': '0.257', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.646', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:04,143][52803] DAMAGECOUNT value on done: 817365.0 [2024-08-06 07:33:04,145][52803] Sum rewards: 78.069, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.134', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.296', 'weapon4': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '64.000'} [2024-08-06 07:33:04,803][52668] DAMAGECOUNT value on done: 865261.0 [2024-08-06 07:33:04,804][52668] Sum rewards: 69.339, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.392', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.122', 'AMMO4': '0.162', 'weapon5': '0.192', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.600', 'weapon3': '2.902', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:05,621][52662] DAMAGECOUNT value on done: 870461.0 [2024-08-06 07:33:05,621][52662] Sum rewards: 80.286, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.153', 'AMMO4': '0.196', 'weapon5': '0.258', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '0.800', 'HEALTH': '0.934', 'weapon3': '2.586', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:06,571][52667] DAMAGECOUNT value on done: 883481.0 [2024-08-06 07:33:06,572][52667] Sum rewards: 67.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'AMMO5': '0.012', 'AMMO2': '0.066', 'weapon5': '0.146', 'weapon4': '0.178', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'AMMO4': '0.331', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '57.000'} [2024-08-06 07:33:07,177][52650] Updated weights for policy 0, policy_version 77351 (0.0015) [2024-08-06 07:33:07,222][52803] DAMAGECOUNT value on done: 813668.0 [2024-08-06 07:33:07,224][52803] Sum rewards: 77.705, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.129', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon4': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '2.978', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '66.000'} [2024-08-06 07:33:07,645][52668] DAMAGECOUNT value on done: 862772.0 [2024-08-06 07:33:07,645][52668] Sum rewards: 72.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.126', 'weapon5': '0.190', 'weapon2': '0.198', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 633667584. Throughput: 0: 4360.1. Samples: 158420810. Policy #0 lag: (min: 1.0, avg: 3.0, max: 7.0) [2024-08-06 07:33:07,794][52567] Avg episode reward: [(0, '74.423')] [2024-08-06 07:33:08,433][52662] DAMAGECOUNT value on done: 888618.0 [2024-08-06 07:33:08,433][52662] Sum rewards: 72.367, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.205', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.132', 'AMMO3': '0.178', 'weapon5': '0.182', 'AMMO4': '0.219', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.954', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '57.000'} [2024-08-06 07:33:09,686][52667] DAMAGECOUNT value on done: 888106.0 [2024-08-06 07:33:09,688][52667] Sum rewards: 83.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO2': '0.007', 'AMMO5': '0.009', 'weapon4': '0.032', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '69.000'} [2024-08-06 07:33:09,914][52614] Signal inference workers to stop experience collection... (14150 times) [2024-08-06 07:33:09,918][52614] Signal inference workers to resume experience collection... (14150 times) [2024-08-06 07:33:10,012][52650] InferenceWorker_p0-w0: stopping experience collection (14150 times) [2024-08-06 07:33:10,012][52650] InferenceWorker_p0-w0: resuming experience collection (14150 times) [2024-08-06 07:33:10,313][52820] DAMAGECOUNT value on done: 808625.0 [2024-08-06 07:33:10,313][52820] Sum rewards: 73.492, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.090', 'AMMO4': '0.123', 'weapon5': '0.136', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.000'} [2024-08-06 07:33:10,396][52803] DAMAGECOUNT value on done: 813551.0 [2024-08-06 07:33:10,400][52803] Sum rewards: 73.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.677', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.151', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.378', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '59.000'} [2024-08-06 07:33:10,647][52668] DAMAGECOUNT value on done: 863282.0 [2024-08-06 07:33:10,647][52668] Sum rewards: 75.239, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.254', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon4': '0.276', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:10,660][52662] DAMAGECOUNT value on done: 873223.0 [2024-08-06 07:33:10,660][52662] Sum rewards: 72.674, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.350', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.086', 'weapon5': '0.104', 'AMMO4': '0.154', 'AMMO3': '0.215', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '64.000'} [2024-08-06 07:33:11,722][52650] Updated weights for policy 0, policy_version 77361 (0.0019) [2024-08-06 07:33:12,657][52667] DAMAGECOUNT value on done: 886119.0 [2024-08-06 07:33:12,659][52667] Sum rewards: 85.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.058', 'weapon5': '0.138', 'AMMO4': '0.225', 'AMMO3': '0.236', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '72.000'} [2024-08-06 07:33:12,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 633749504. Throughput: 0: 4366.4. Samples: 158447170. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:12,795][52567] Avg episode reward: [(0, '74.561')] [2024-08-06 07:33:13,435][52820] DAMAGECOUNT value on done: 809926.0 [2024-08-06 07:33:13,436][52820] Sum rewards: 87.764, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'HEALTH': '0.248', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '71.000'} [2024-08-06 07:33:13,559][52803] DAMAGECOUNT value on done: 807852.0 [2024-08-06 07:33:13,560][52803] Sum rewards: 77.594, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.160', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO3': '0.158', 'AMMO4': '0.172', 'weapon5': '0.276', 'weapon2': '0.284', 'weapon4': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:13,678][52662] DAMAGECOUNT value on done: 880785.0 [2024-08-06 07:33:13,680][52662] Sum rewards: 69.429, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:13,946][52668] DAMAGECOUNT value on done: 858434.0 [2024-08-06 07:33:13,947][52668] Sum rewards: 62.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon5': '0.190', 'AMMO3': '0.238', 'weapon4': '0.252', 'AMMO4': '0.314', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.796', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '52.000'} [2024-08-06 07:33:15,737][52667] DAMAGECOUNT value on done: 878762.0 [2024-08-06 07:33:15,737][52667] Sum rewards: 69.645, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.687', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon4': '0.174', 'weapon5': '0.222', 'AMMO3': '0.275', 'AMMO4': '0.286', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.878', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:16,471][52650] Updated weights for policy 0, policy_version 77371 (0.0018) [2024-08-06 07:33:16,638][52820] DAMAGECOUNT value on done: 808750.0 [2024-08-06 07:33:16,638][52820] Sum rewards: 55.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.200', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.192', 'AMMO3': '0.243', 'weapon4': '0.266', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.954', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '45.500'} [2024-08-06 07:33:16,729][52803] DAMAGECOUNT value on done: 808413.0 [2024-08-06 07:33:16,732][52803] Sum rewards: 80.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.939', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.176', 'AMMO4': '0.195', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '66.000'} [2024-08-06 07:33:16,886][52662] DAMAGECOUNT value on done: 872021.0 [2024-08-06 07:33:16,887][52662] Sum rewards: 86.923, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO4': '0.194', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '71.000'} [2024-08-06 07:33:17,063][52668] DAMAGECOUNT value on done: 870615.0 [2024-08-06 07:33:17,063][52668] Sum rewards: 68.060, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.077', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon4': '0.118', 'AMMO3': '0.212', 'AMMO4': '0.292', 'weapon5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '55.000'} [2024-08-06 07:33:17,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 633847808. Throughput: 0: 4372.2. Samples: 158460300. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:17,795][52567] Avg episode reward: [(0, '74.169')] [2024-08-06 07:33:18,892][52667] DAMAGECOUNT value on done: 877154.0 [2024-08-06 07:33:18,894][52667] Sum rewards: 79.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.081', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.077', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.326', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:19,439][52662] DAMAGECOUNT value on done: 873420.0 [2024-08-06 07:33:19,440][52662] Sum rewards: 76.424, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.140', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.102', 'weapon5': '0.132', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.710', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:19,655][52820] DAMAGECOUNT value on done: 797127.0 [2024-08-06 07:33:19,656][52820] Sum rewards: 76.554, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.111', 'weapon5': '0.128', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.202', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:19,857][52803] DAMAGECOUNT value on done: 815332.0 [2024-08-06 07:33:19,860][52803] Sum rewards: 80.913, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.686', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.086', 'weapon5': '0.178', 'AMMO4': '0.188', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.450', 'weapon3': '3.036', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '66.000'} [2024-08-06 07:33:20,300][52668] DAMAGECOUNT value on done: 873880.0 [2024-08-06 07:33:20,301][52668] Sum rewards: 70.181, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.112', 'AMMO5': '0.019', 'AMMO2': '0.057', 'AMMO3': '0.187', 'weapon5': '0.218', 'AMMO4': '0.283', 'weapon4': '0.342', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:21,415][52650] Updated weights for policy 0, policy_version 77381 (0.0013) [2024-08-06 07:33:21,554][52660] DAMAGECOUNT value on done: 869416.0 [2024-08-06 07:33:21,555][52660] Sum rewards: 75.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.682', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.100', 'AMMO4': '0.151', 'weapon5': '0.196', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:21,919][52667] DAMAGECOUNT value on done: 877850.0 [2024-08-06 07:33:21,919][52667] Sum rewards: 72.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '60.000'} [2024-08-06 07:33:21,934][52662] DAMAGECOUNT value on done: 865232.0 [2024-08-06 07:33:21,935][52662] Sum rewards: 55.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO3': '0.228', 'weapon2': '0.530', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.116', 'DAMAGECOUNT': '13.851', 'FRAGCOUNT': '48.000'} [2024-08-06 07:33:22,789][52795] DAMAGECOUNT value on done: 809541.0 [2024-08-06 07:33:22,789][52795] Sum rewards: 61.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.206', 'weapon2': '0.226', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.314', 'FRAGCOUNT': '51.000'} [2024-08-06 07:33:22,795][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 633929728. Throughput: 0: 4370.6. Samples: 158486530. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:22,795][52567] Avg episode reward: [(0, '73.989')] [2024-08-06 07:33:22,850][52820] DAMAGECOUNT value on done: 811261.0 [2024-08-06 07:33:22,851][52820] Sum rewards: 77.184, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.558', 'AMMO5': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.144', 'weapon2': '0.146', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.108', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:23,050][52803] DAMAGECOUNT value on done: 808745.0 [2024-08-06 07:33:23,052][52803] Sum rewards: 72.317, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.549', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.104', 'AMMO4': '0.184', 'weapon5': '0.186', 'weapon2': '0.270', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.104', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:23,418][52668] DAMAGECOUNT value on done: 872005.0 [2024-08-06 07:33:23,420][52668] Sum rewards: 85.047, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.134', 'AMMO4': '0.169', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '69.000'} [2024-08-06 07:33:24,704][52660] DAMAGECOUNT value on done: 862548.0 [2024-08-06 07:33:24,706][52660] Sum rewards: 70.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.684', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.185', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.766', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '56.000'} [2024-08-06 07:33:24,750][52662] DAMAGECOUNT value on done: 876887.0 [2024-08-06 07:33:24,752][52662] Sum rewards: 59.365, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.090', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.160', 'weapon2': '0.778', 'WEAPON3': '0.950', 'HITCOUNT': '2.970', 'weapon3': '2.984', 'DAMAGECOUNT': '15.204', 'FRAGCOUNT': '46.000'} [2024-08-06 07:33:25,306][52667] DAMAGECOUNT value on done: 885368.0 [2024-08-06 07:33:25,306][52667] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.165', 'weapon4': '0.244', 'AMMO3': '0.246', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '64.000'} [2024-08-06 07:33:25,805][52650] Updated weights for policy 0, policy_version 77391 (0.0020) [2024-08-06 07:33:25,921][52795] DAMAGECOUNT value on done: 795750.0 [2024-08-06 07:33:25,924][52795] Sum rewards: 66.170, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.142', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'weapon4': '0.220', 'WEAPON3': '0.900', 'HITCOUNT': '2.790', 'weapon3': '3.192', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '52.000'} [2024-08-06 07:33:26,068][52820] DAMAGECOUNT value on done: 796955.0 [2024-08-06 07:33:26,069][52820] Sum rewards: 67.341, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.233', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.134', 'weapon5': '0.226', 'AMMO3': '0.236', 'AMMO4': '0.253', 'weapon2': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.380', 'FRAGCOUNT': '56.000'} [2024-08-06 07:33:26,228][52803] DAMAGECOUNT value on done: 823225.0 [2024-08-06 07:33:26,228][52803] Sum rewards: 59.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.232', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.138', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.262', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.210', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '52.000'} [2024-08-06 07:33:26,469][52668] DAMAGECOUNT value on done: 877352.0 [2024-08-06 07:33:26,472][52668] Sum rewards: 79.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.194', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.392', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '64.000'} [2024-08-06 07:33:27,416][52660] DAMAGECOUNT value on done: 873099.0 [2024-08-06 07:33:27,418][52660] Sum rewards: 76.748, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.196', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.092', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon4': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '0.950', 'weapon3': '3.194', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 634019840. Throughput: 0: 4366.2. Samples: 158512560. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:27,794][52567] Avg episode reward: [(0, '73.572')] [2024-08-06 07:33:27,850][52662] DAMAGECOUNT value on done: 865862.0 [2024-08-06 07:33:27,852][52662] Sum rewards: 76.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.051', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.114', 'AMMO4': '0.118', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:28,276][52667] DAMAGECOUNT value on done: 872421.0 [2024-08-06 07:33:28,276][52667] Sum rewards: 83.810, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.115', 'AMMO5': '0.004', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.266', 'weapon2': '0.342', 'WEAPON3': '1.750', 'weapon3': '3.420', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '74.000'} [2024-08-06 07:33:28,956][52668] DAMAGECOUNT value on done: 877369.0 [2024-08-06 07:33:28,956][52668] Sum rewards: 71.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.922', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon4': '0.088', 'AMMO3': '0.209', 'weapon5': '0.252', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:29,174][52795] DAMAGECOUNT value on done: 801255.0 [2024-08-06 07:33:29,177][52795] Sum rewards: 62.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.013', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.110', 'DAMAGECOUNT': '15.627', 'FRAGCOUNT': '51.000'} [2024-08-06 07:33:29,261][52803] DAMAGECOUNT value on done: 817282.0 [2024-08-06 07:33:29,263][52803] Sum rewards: 73.398, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.188', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.176', 'AMMO3': '0.185', 'weapon2': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '59.000'} [2024-08-06 07:33:29,450][52820] DAMAGECOUNT value on done: 803166.0 [2024-08-06 07:33:29,450][52820] Sum rewards: 79.715, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.271', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.100', 'AMMO4': '0.152', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '67.000'} [2024-08-06 07:33:30,064][52660] DAMAGECOUNT value on done: 885233.0 [2024-08-06 07:33:30,064][52660] Sum rewards: 68.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.669', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon2': '0.204', 'AMMO3': '0.226', 'weapon4': '0.240', 'AMMO4': '0.251', 'weapon5': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:30,655][52650] Updated weights for policy 0, policy_version 77401 (0.0010) [2024-08-06 07:33:30,735][52662] DAMAGECOUNT value on done: 884791.0 [2024-08-06 07:33:30,737][52662] Sum rewards: 75.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.137', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:30,932][52667] DAMAGECOUNT value on done: 874695.0 [2024-08-06 07:33:30,934][52667] Sum rewards: 75.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.034', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.548', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:31,713][52659] DAMAGECOUNT value on done: 877084.0 [2024-08-06 07:33:31,724][52659] Sum rewards: 73.327, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.173', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.210', 'AMMO3': '0.271', 'WEAPON3': '1.550', 'weapon3': '3.366', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:32,286][52803] DAMAGECOUNT value on done: 810474.0 [2024-08-06 07:33:32,288][52803] Sum rewards: 72.340, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.392', 'ARMOR': '0.004', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.096', 'AMMO3': '0.209', 'weapon4': '0.236', 'AMMO4': '0.244', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '60.000'} [2024-08-06 07:33:32,370][52795] DAMAGECOUNT value on done: 812837.0 [2024-08-06 07:33:32,372][52795] Sum rewards: 84.834, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.993', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.152', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.408', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '70.000'} [2024-08-06 07:33:32,468][52820] DAMAGECOUNT value on done: 806892.0 [2024-08-06 07:33:32,472][52820] Sum rewards: 86.383, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon4': '0.124', 'weapon5': '0.204', 'AMMO3': '0.234', 'weapon2': '0.250', 'AMMO4': '0.287', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.492', 'FRAGCOUNT': '70.000'} [2024-08-06 07:33:32,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 634101760. Throughput: 0: 4361.6. Samples: 158525580. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:32,794][52567] Avg episode reward: [(0, '73.363')] [2024-08-06 07:33:32,922][52660] DAMAGECOUNT value on done: 867121.0 [2024-08-06 07:33:32,922][52660] Sum rewards: 70.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.718', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.275', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.190', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:33,743][52662] DAMAGECOUNT value on done: 877549.0 [2024-08-06 07:33:33,743][52662] Sum rewards: 73.725, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.780', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.756', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:33,830][52667] DAMAGECOUNT value on done: 884950.0 [2024-08-06 07:33:33,830][52667] Sum rewards: 85.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.157', 'weapon4': '0.266', 'weapon2': '0.392', 'WEAPON3': '1.000', 'weapon3': '2.914', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '69.000'} [2024-08-06 07:33:34,811][52659] DAMAGECOUNT value on done: 873124.0 [2024-08-06 07:33:34,813][52659] Sum rewards: 76.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.700', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.136', 'weapon4': '0.148', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '60.000'} [2024-08-06 07:33:35,146][52650] Updated weights for policy 0, policy_version 77411 (0.0020) [2024-08-06 07:33:35,420][52660] DAMAGECOUNT value on done: 866473.0 [2024-08-06 07:33:35,420][52660] Sum rewards: 80.913, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.732', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.428', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '69.000'} [2024-08-06 07:33:35,421][52803] DAMAGECOUNT value on done: 826461.0 [2024-08-06 07:33:35,424][52803] Sum rewards: 71.936, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.221', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.142', 'AMMO4': '0.143', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '57.000'} [2024-08-06 07:33:35,525][52795] DAMAGECOUNT value on done: 798493.0 [2024-08-06 07:33:35,525][52795] Sum rewards: 66.063, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.206', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.074', 'AMMO4': '0.158', 'weapon5': '0.178', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '56.000'} [2024-08-06 07:33:35,692][52820] DAMAGECOUNT value on done: 812402.0 [2024-08-06 07:33:35,695][52820] Sum rewards: 84.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.578', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.130', 'weapon4': '0.140', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '69.000'} [2024-08-06 07:33:36,566][52662] DAMAGECOUNT value on done: 864460.0 [2024-08-06 07:33:36,568][52662] Sum rewards: 85.787, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.151', 'weapon4': '0.160', 'weapon2': '0.304', 'HEALTH': '0.609', 'WEAPON3': '0.850', 'weapon3': '3.364', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '67.000'} [2024-08-06 07:33:37,024][52667] DAMAGECOUNT value on done: 874610.0 [2024-08-06 07:33:37,026][52667] Sum rewards: 75.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.154', 'weapon4': '0.174', 'AMMO3': '0.221', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 634191872. Throughput: 0: 4361.6. Samples: 158551760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:37,794][52567] Avg episode reward: [(0, '73.979')] [2024-08-06 07:33:38,079][52660] DAMAGECOUNT value on done: 872982.0 [2024-08-06 07:33:38,091][52659] DAMAGECOUNT value on done: 881801.0 [2024-08-06 07:33:38,092][52659] Sum rewards: 73.172, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.306', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.036', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'weapon2': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.274', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '60.000'} [2024-08-06 07:33:38,124][52660] Sum rewards: 72.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.274', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.161', 'weapon5': '0.190', 'weapon4': '0.212', 'AMMO4': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.936', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '58.500'} [2024-08-06 07:33:38,554][52803] DAMAGECOUNT value on done: 809359.0 [2024-08-06 07:33:38,556][52803] Sum rewards: 67.521, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.065', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '14.832', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:38,681][52795] DAMAGECOUNT value on done: 804542.0 [2024-08-06 07:33:38,683][52795] Sum rewards: 72.901, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.747', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.112', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon2': '0.668', 'WEAPON3': '0.900', 'weapon3': '2.986', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.366', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:38,957][52820] DAMAGECOUNT value on done: 819279.0 [2024-08-06 07:33:38,960][52820] Sum rewards: 78.085, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.470', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '66.000'} [2024-08-06 07:33:39,612][52667] DAMAGECOUNT value on done: 880373.0 [2024-08-06 07:33:39,612][52667] Sum rewards: 76.342, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.018', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.153', 'AMMO4': '0.154', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.270', 'WEAPON3': '0.900', 'weapon3': '3.098', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:39,642][52662] DAMAGECOUNT value on done: 872951.0 [2024-08-06 07:33:39,643][52662] Sum rewards: 73.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.120', 'weapon5': '0.124', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:40,089][52650] Updated weights for policy 0, policy_version 77421 (0.0012) [2024-08-06 07:33:41,193][52659] DAMAGECOUNT value on done: 875206.0 [2024-08-06 07:33:41,197][52659] Sum rewards: 66.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.908', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.116', 'AMMO4': '0.175', 'AMMO3': '0.214', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.324', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '57.000'} [2024-08-06 07:33:41,237][52660] DAMAGECOUNT value on done: 879213.0 [2024-08-06 07:33:41,239][52660] Sum rewards: 81.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.015', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.080', 'weapon4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.560', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:41,640][52803] DAMAGECOUNT value on done: 815106.0 [2024-08-06 07:33:41,642][52803] Sum rewards: 77.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.024', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.116', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.314', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:41,880][52795] DAMAGECOUNT value on done: 815337.0 [2024-08-06 07:33:41,880][52795] Sum rewards: 78.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.346', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.144', 'AMMO3': '0.217', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:42,010][52820] DAMAGECOUNT value on done: 800864.0 [2024-08-06 07:33:42,010][52820] Sum rewards: 84.760, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.009', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.152', 'weapon4': '0.154', 'WEAPON4': '0.250', 'weapon5': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '0.900', 'weapon3': '2.770', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '66.000'} [2024-08-06 07:33:42,390][52667] DAMAGECOUNT value on done: 886495.0 [2024-08-06 07:33:42,399][52667] Sum rewards: 89.518, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.060', 'AMMO4': '0.161', 'weapon5': '0.178', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.508', 'FRAGCOUNT': '73.000'} [2024-08-06 07:33:42,491][52662] DAMAGECOUNT value on done: 865739.0 [2024-08-06 07:33:42,492][52662] Sum rewards: 83.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.629', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.104', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.342', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '67.000'} [2024-08-06 07:33:42,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 634281984. Throughput: 0: 4369.5. Samples: 158577860. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:42,795][52567] Avg episode reward: [(0, '74.361')] [2024-08-06 07:33:44,187][52659] DAMAGECOUNT value on done: 872651.0 [2024-08-06 07:33:44,187][52659] Sum rewards: 82.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.114', 'weapon5': '0.140', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '68.000'} [2024-08-06 07:33:44,370][52660] DAMAGECOUNT value on done: 867207.0 [2024-08-06 07:33:44,370][52660] Sum rewards: 66.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.051', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.126', 'weapon5': '0.160', 'AMMO4': '0.198', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.250', 'HITCOUNT': '3.010', 'weapon3': '3.200', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '55.000'} [2024-08-06 07:33:44,582][52803] DAMAGECOUNT value on done: 820102.0 [2024-08-06 07:33:44,586][52803] Sum rewards: 68.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.226', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.110', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'weapon4': '0.240', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.500'} [2024-08-06 07:33:44,931][52650] Updated weights for policy 0, policy_version 77431 (0.0020) [2024-08-06 07:33:45,026][52820] DAMAGECOUNT value on done: 810765.0 [2024-08-06 07:33:45,027][52820] Sum rewards: 77.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.220', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.134', 'weapon5': '0.184', 'AMMO4': '0.191', 'weapon2': '0.204', 'AMMO3': '0.239', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '64.000'} [2024-08-06 07:33:45,110][52795] DAMAGECOUNT value on done: 806611.0 [2024-08-06 07:33:45,110][52795] Sum rewards: 79.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.483', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.146', 'AMMO4': '0.180', 'AMMO3': '0.226', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '66.000'} [2024-08-06 07:33:45,230][52667] DAMAGECOUNT value on done: 888872.0 [2024-08-06 07:33:45,230][52667] Sum rewards: 71.171, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.624', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.099', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.318', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:47,140][52659] DAMAGECOUNT value on done: 874535.0 [2024-08-06 07:33:47,140][52659] Sum rewards: 73.776, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'AMMO3': '0.156', 'AMMO4': '0.216', 'weapon4': '0.266', 'weapon5': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.410', 'HEALTH': '0.771', 'WEAPON3': '0.850', 'weapon3': '2.596', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 07:33:47,204][52660] DAMAGECOUNT value on done: 864119.0 [2024-08-06 07:33:47,206][52660] Sum rewards: 74.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.956', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.074', 'AMMO4': '0.163', 'weapon5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.152', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:47,624][52803] DAMAGECOUNT value on done: 824366.0 [2024-08-06 07:33:47,634][52803] Sum rewards: 74.096, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.830', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.600', 'weapon3': '3.018', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 634363904. Throughput: 0: 4365.5. Samples: 158591070. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:47,795][52567] Avg episode reward: [(0, '74.491')] [2024-08-06 07:33:47,941][52667] DAMAGECOUNT value on done: 882978.0 [2024-08-06 07:33:47,941][52667] Sum rewards: 61.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.108', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.084', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.340', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.252', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '50.000'} [2024-08-06 07:33:48,297][52795] DAMAGECOUNT value on done: 810943.0 [2024-08-06 07:33:48,299][52795] Sum rewards: 78.950, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.575', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.188', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.522', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:48,449][52820] DAMAGECOUNT value on done: 823913.0 [2024-08-06 07:33:48,452][52820] Sum rewards: 87.159, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.508', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.104', 'AMMO3': '0.171', 'AMMO4': '0.211', 'weapon5': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.667', 'FRAGCOUNT': '68.000'} [2024-08-06 07:33:49,116][52650] Updated weights for policy 0, policy_version 77441 (0.0020) [2024-08-06 07:33:49,690][52660] DAMAGECOUNT value on done: 874507.0 [2024-08-06 07:33:49,692][52660] Sum rewards: 66.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.752', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.249', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '57.000'} [2024-08-06 07:33:49,908][52659] DAMAGECOUNT value on done: 876585.0 [2024-08-06 07:33:49,909][52659] Sum rewards: 82.344, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.345', 'AMMO5': '0.010', 'AMMO2': '0.045', 'AMMO3': '0.174', 'weapon5': '0.180', 'AMMO4': '0.226', 'weapon2': '0.334', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:50,737][52803] DAMAGECOUNT value on done: 822705.0 [2024-08-06 07:33:50,741][52803] Sum rewards: 80.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.710', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '66.000'} [2024-08-06 07:33:50,912][52667] DAMAGECOUNT value on done: 880105.0 [2024-08-06 07:33:50,914][52667] Sum rewards: 73.832, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.350', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.175', 'weapon5': '0.260', 'weapon4': '0.294', 'AMMO4': '0.326', 'weapon2': '0.384', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:51,564][52820] DAMAGECOUNT value on done: 813111.0 [2024-08-06 07:33:51,566][52820] Sum rewards: 65.380, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.296', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.092', 'weapon5': '0.120', 'AMMO4': '0.198', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '55.000'} [2024-08-06 07:33:51,610][52795] DAMAGECOUNT value on done: 813469.0 [2024-08-06 07:33:51,611][52795] Sum rewards: 81.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.016', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.108', 'AMMO4': '0.186', 'AMMO3': '0.230', 'weapon5': '0.282', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '67.000'} [2024-08-06 07:33:52,551][52660] DAMAGECOUNT value on done: 864690.0 [2024-08-06 07:33:52,554][52660] Sum rewards: 74.896, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.614', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.128', 'weapon4': '0.134', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.040', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '60.000'} [2024-08-06 07:33:52,800][52567] Fps is (10 sec: 17193.7, 60 sec: 17474.6, 300 sec: 17494.4). Total num frames: 634454016. Throughput: 0: 4367.4. Samples: 158617370. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:33:52,800][52567] Avg episode reward: [(0, '74.770')] [2024-08-06 07:33:52,973][52659] DAMAGECOUNT value on done: 875782.0 [2024-08-06 07:33:52,973][52659] Sum rewards: 79.269, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.604', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.098', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'weapon5': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.072', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 07:33:53,360][52667] DAMAGECOUNT value on done: 883285.0 [2024-08-06 07:33:53,364][52667] Sum rewards: 75.859, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.064', 'AMMO3': '0.165', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'HEALTH': '0.296', 'weapon2': '0.348', 'WEAPON3': '0.950', 'weapon3': '3.048', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '61.000'} [2024-08-06 07:33:53,901][52650] Updated weights for policy 0, policy_version 77451 (0.0018) [2024-08-06 07:33:53,906][52803] DAMAGECOUNT value on done: 817245.0 [2024-08-06 07:33:53,906][52803] Sum rewards: 54.743, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.575', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.130', 'weapon4': '0.142', 'AMMO4': '0.181', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '2.980', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '47.000'} [2024-08-06 07:33:54,716][52820] DAMAGECOUNT value on done: 814617.0 [2024-08-06 07:33:54,716][52820] Sum rewards: 53.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.176', 'weapon2': '0.180', 'AMMO3': '0.198', 'AMMO4': '0.298', 'weapon4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.680', 'weapon3': '3.024', 'DAMAGECOUNT': '13.215', 'FRAGCOUNT': '45.000'} [2024-08-06 07:33:54,839][52795] DAMAGECOUNT value on done: 808271.0 [2024-08-06 07:33:54,839][52795] Sum rewards: 77.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.527', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'weapon4': '0.308', 'weapon2': '0.412', 'WEAPON3': '0.950', 'weapon3': '3.088', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:55,651][52659] DAMAGECOUNT value on done: 874888.0 [2024-08-06 07:33:55,652][52659] Sum rewards: 87.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.436', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '20.760', 'FRAGCOUNT': '70.000'} [2024-08-06 07:33:55,704][52660] DAMAGECOUNT value on done: 865784.0 [2024-08-06 07:33:55,704][52660] Sum rewards: 64.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.146', 'AMMO3': '0.188', 'weapon4': '0.216', 'AMMO4': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '53.000'} [2024-08-06 07:33:57,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 634535936. Throughput: 0: 4368.0. Samples: 158643730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:33:57,795][52567] Avg episode reward: [(0, '74.517')] [2024-08-06 07:33:57,859][52820] DAMAGECOUNT value on done: 811059.0 [2024-08-06 07:33:57,859][52820] Sum rewards: 72.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.896', 'AMMO5': '0.007', 'AMMO2': '0.020', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'weapon5': '0.136', 'weapon4': '0.170', 'weapon2': '0.194', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '62.000'} [2024-08-06 07:33:58,044][52795] DAMAGECOUNT value on done: 800221.0 [2024-08-06 07:33:58,045][52795] Sum rewards: 70.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.505', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.023', 'weapon5': '0.078', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon4': '0.288', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.774', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '57.000'} [2024-08-06 07:33:58,292][52660] DAMAGECOUNT value on done: 878599.0 [2024-08-06 07:33:58,292][52660] Sum rewards: 79.815, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.218', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.176', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '3.396', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '65.000'} [2024-08-06 07:33:58,585][52650] Updated weights for policy 0, policy_version 77461 (0.0025) [2024-08-06 07:33:58,767][52659] DAMAGECOUNT value on done: 885371.0 [2024-08-06 07:33:58,767][52659] Sum rewards: 85.981, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.110', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.012', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.203', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '71.000'} [2024-08-06 07:34:00,846][52820] DAMAGECOUNT value on done: 814094.0 [2024-08-06 07:34:00,847][52820] Sum rewards: 77.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.596', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.034', 'weapon5': '0.116', 'weapon4': '0.164', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:01,076][52660] DAMAGECOUNT value on done: 891307.0 [2024-08-06 07:34:01,076][52660] Sum rewards: 73.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.914', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.117', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '61.000'} [2024-08-06 07:34:01,125][52795] DAMAGECOUNT value on done: 805331.0 [2024-08-06 07:34:01,126][52795] Sum rewards: 75.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.370', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.176', 'AMMO4': '0.201', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:01,569][52659] DAMAGECOUNT value on done: 869861.0 [2024-08-06 07:34:01,569][52659] Sum rewards: 81.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.248', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.070', 'weapon4': '0.074', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '67.000'} [2024-08-06 07:34:02,794][52567] Fps is (10 sec: 18032.6, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 634634240. Throughput: 0: 4369.3. Samples: 158656920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:02,794][52567] Avg episode reward: [(0, '74.589')] [2024-08-06 07:34:03,469][52650] Updated weights for policy 0, policy_version 77471 (0.0021) [2024-08-06 07:34:03,912][52820] DAMAGECOUNT value on done: 821109.0 [2024-08-06 07:34:03,913][52820] Sum rewards: 80.547, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.318', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.201', 'AMMO4': '0.210', 'weapon4': '0.222', 'WEAPON4': '0.350', 'weapon5': '0.376', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.618', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:04,193][52795] DAMAGECOUNT value on done: 814489.0 [2024-08-06 07:34:04,194][52795] Sum rewards: 60.584, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.076', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon5': '0.120', 'weapon4': '0.152', 'AMMO4': '0.267', 'AMMO3': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.650', 'HITCOUNT': '2.950', 'weapon3': '2.998', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '54.000'} [2024-08-06 07:34:04,289][52660] DAMAGECOUNT value on done: 867206.0 [2024-08-06 07:34:04,290][52660] Sum rewards: 67.543, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.762', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.144', 'AMMO3': '0.168', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '54.000'} [2024-08-06 07:34:04,458][52659] DAMAGECOUNT value on done: 881196.0 [2024-08-06 07:34:04,459][52659] Sum rewards: 88.986, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.084', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.158', 'AMMO3': '0.171', 'weapon2': '0.212', 'weapon5': '0.220', 'AMMO4': '0.273', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.399', 'FRAGCOUNT': '71.000'} [2024-08-06 07:34:07,010][52820] DAMAGECOUNT value on done: 819983.0 [2024-08-06 07:34:07,010][52820] Sum rewards: 73.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.315', 'AMMO2': '0.008', 'AMMO5': '0.013', 'AMMO4': '0.040', 'weapon4': '0.064', 'WEAPON4': '0.100', 'weapon5': '0.194', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.650', 'weapon3': '2.950', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:07,476][52795] DAMAGECOUNT value on done: 801396.0 [2024-08-06 07:34:07,477][52795] Sum rewards: 74.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.280', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '60.000'} [2024-08-06 07:34:07,543][52659] DAMAGECOUNT value on done: 872545.0 [2024-08-06 07:34:07,543][52659] Sum rewards: 87.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.292', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.196', 'WEAPON3': '1.350', 'weapon3': '3.522', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.627', 'FRAGCOUNT': '70.000'} [2024-08-06 07:34:07,702][52658] DAMAGECOUNT value on done: 875228.0 [2024-08-06 07:34:07,702][52658] Sum rewards: 73.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.593', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.063', 'weapon4': '0.118', 'weapon5': '0.178', 'AMMO3': '0.203', 'AMMO4': '0.317', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '62.000'} [2024-08-06 07:34:07,730][52660] DAMAGECOUNT value on done: 876966.0 [2024-08-06 07:34:07,730][52660] Sum rewards: 79.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.160', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'weapon4': '0.062', 'AMMO4': '0.079', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '66.000'} [2024-08-06 07:34:07,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 634716160. Throughput: 0: 4376.7. Samples: 158683480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:07,795][52567] Avg episode reward: [(0, '74.860')] [2024-08-06 07:34:07,842][52650] Updated weights for policy 0, policy_version 77481 (0.0026) [2024-08-06 07:34:10,349][52659] DAMAGECOUNT value on done: 872079.0 [2024-08-06 07:34:10,357][52659] Sum rewards: 70.139, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.026', 'weapon5': '0.100', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '56.000'} [2024-08-06 07:34:10,419][52820] DAMAGECOUNT value on done: 802833.0 [2024-08-06 07:34:10,419][52820] Sum rewards: 81.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.865', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.050', 'AMMO4': '0.185', 'AMMO3': '0.208', 'weapon5': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '67.000'} [2024-08-06 07:34:10,627][52660] DAMAGECOUNT value on done: 872503.0 [2024-08-06 07:34:10,629][52660] Sum rewards: 78.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.103', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:10,686][52795] DAMAGECOUNT value on done: 812573.0 [2024-08-06 07:34:10,687][52795] Sum rewards: 65.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.266', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.116', 'AMMO3': '0.212', 'AMMO4': '0.216', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.190', 'weapon3': '3.334', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '56.000'} [2024-08-06 07:34:10,810][52658] DAMAGECOUNT value on done: 880039.0 [2024-08-06 07:34:10,821][52658] Sum rewards: 72.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.678', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.148', 'AMMO4': '0.174', 'weapon2': '0.204', 'weapon5': '0.230', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.114', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '61.000'} [2024-08-06 07:34:12,735][52650] Updated weights for policy 0, policy_version 77491 (0.0012) [2024-08-06 07:34:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 634806272. Throughput: 0: 4360.0. Samples: 158708760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:12,794][52567] Avg episode reward: [(0, '74.716')] [2024-08-06 07:34:12,978][52660] DAMAGECOUNT value on done: 864890.0 [2024-08-06 07:34:12,980][52660] Sum rewards: 70.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.103', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '59.000'} [2024-08-06 07:34:13,289][52659] DAMAGECOUNT value on done: 877547.0 [2024-08-06 07:34:13,290][52659] Sum rewards: 79.139, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.315', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.087', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:13,778][52795] DAMAGECOUNT value on done: 809795.0 [2024-08-06 07:34:13,779][52795] Sum rewards: 70.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.938', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.148', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.252', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:14,122][52658] DAMAGECOUNT value on done: 881284.0 [2024-08-06 07:34:14,123][52658] Sum rewards: 68.638, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.582', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.140', 'AMMO4': '0.148', 'AMMO3': '0.180', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.420', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.728', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '56.000'} [2024-08-06 07:34:15,875][52659] DAMAGECOUNT value on done: 875139.0 [2024-08-06 07:34:15,875][52659] Sum rewards: 83.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.090', 'weapon5': '0.132', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.160', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '68.000'} [2024-08-06 07:34:16,089][52660] DAMAGECOUNT value on done: 863906.0 [2024-08-06 07:34:16,091][52660] Sum rewards: 70.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.376', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '56.000'} [2024-08-06 07:34:17,125][52795] DAMAGECOUNT value on done: 800804.0 [2024-08-06 07:34:17,135][52795] Sum rewards: 77.160, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon5': '0.170', 'AMMO3': '0.187', 'weapon4': '0.212', 'AMMO4': '0.239', 'weapon2': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.114', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:17,186][52658] DAMAGECOUNT value on done: 879582.0 [2024-08-06 07:34:17,186][52658] Sum rewards: 83.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.938', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.056', 'weapon5': '0.086', 'AMMO4': '0.092', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.856', 'FRAGCOUNT': '69.000'} [2024-08-06 07:34:17,547][52650] Updated weights for policy 0, policy_version 77501 (0.0013) [2024-08-06 07:34:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 634888192. Throughput: 0: 4362.9. Samples: 158721910. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:17,795][52567] Avg episode reward: [(0, '75.045')] [2024-08-06 07:34:18,611][52659] DAMAGECOUNT value on done: 884889.0 [2024-08-06 07:34:18,613][52659] Sum rewards: 71.436, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:19,611][52669] DAMAGECOUNT value on done: 876942.0 [2024-08-06 07:34:19,613][52669] Sum rewards: 65.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.855', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.114', 'AMMO3': '0.214', 'AMMO4': '0.265', 'weapon5': '0.292', 'weapon2': '0.480', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2024-08-06 07:34:20,101][52658] DAMAGECOUNT value on done: 872757.0 [2024-08-06 07:34:20,101][52658] Sum rewards: 68.678, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.316', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.112', 'AMMO4': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 07:34:20,266][52795] DAMAGECOUNT value on done: 806970.0 [2024-08-06 07:34:20,268][52795] Sum rewards: 74.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.172', 'AMMO4': '0.181', 'AMMO3': '0.230', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '62.000'} [2024-08-06 07:34:21,694][52659] DAMAGECOUNT value on done: 868920.0 [2024-08-06 07:34:21,694][52659] Sum rewards: 86.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.075', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'weapon3': '3.458', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.090', 'FRAGCOUNT': '71.000'} [2024-08-06 07:34:21,755][52794] DAMAGECOUNT value on done: 869766.0 [2024-08-06 07:34:21,757][52794] Sum rewards: 81.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.485', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.170', 'weapon2': '0.638', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:22,139][52650] Updated weights for policy 0, policy_version 77511 (0.0011) [2024-08-06 07:34:22,206][52669] DAMAGECOUNT value on done: 871164.0 [2024-08-06 07:34:22,206][52669] Sum rewards: 76.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.315', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:22,412][52665] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 07:34:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 634970112. Throughput: 0: 4364.7. Samples: 158748170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:22,794][52567] Avg episode reward: [(0, '75.435')] [2024-08-06 07:34:22,977][52811] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:34:23,216][52658] DAMAGECOUNT value on done: 867628.0 [2024-08-06 07:34:23,217][52658] Sum rewards: 77.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.138', 'AMMO3': '0.182', 'weapon4': '0.240', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.972', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:23,494][52795] DAMAGECOUNT value on done: 814711.0 [2024-08-06 07:34:23,497][52795] Sum rewards: 67.685, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.384', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.088', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.279', 'weapon2': '0.484', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:24,646][52659] DAMAGECOUNT value on done: 881232.0 [2024-08-06 07:34:24,646][52659] Sum rewards: 66.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.345', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '56.000'} [2024-08-06 07:34:24,776][52794] DAMAGECOUNT value on done: 881008.0 [2024-08-06 07:34:24,776][52794] Sum rewards: 79.028, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.040', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO4': '0.201', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'weapon3': '3.488', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '67.000'} [2024-08-06 07:34:25,168][52669] DAMAGECOUNT value on done: 882088.0 [2024-08-06 07:34:25,168][52669] Sum rewards: 72.146, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.676', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.306', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:26,199][52658] DAMAGECOUNT value on done: 881100.0 [2024-08-06 07:34:26,199][52658] Sum rewards: 69.689, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.076', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.214', 'AMMO3': '0.295', 'WEAPON3': '1.700', 'HITCOUNT': '3.310', 'weapon3': '3.432', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2024-08-06 07:34:26,907][52650] Updated weights for policy 0, policy_version 77521 (0.0012) [2024-08-06 07:34:27,412][52659] DAMAGECOUNT value on done: 873832.0 [2024-08-06 07:34:27,413][52659] Sum rewards: 71.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.782', 'ARMOR': '-0.001', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.118', 'weapon5': '0.122', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '60.000'} [2024-08-06 07:34:27,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 635068416. Throughput: 0: 4366.0. Samples: 158774330. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:27,794][52567] Avg episode reward: [(0, '75.299')] [2024-08-06 07:34:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077523_635068416.pth... [2024-08-06 07:34:27,865][52663] DAMAGECOUNT value on done: 893311.0 [2024-08-06 07:34:27,868][52663] Sum rewards: 78.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.299', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.183', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:27,897][52669] DAMAGECOUNT value on done: 875351.0 [2024-08-06 07:34:27,899][52669] Sum rewards: 79.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.295', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.070', 'weapon5': '0.106', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '67.000'} [2024-08-06 07:34:27,918][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077011_630874112.pth [2024-08-06 07:34:27,963][52794] DAMAGECOUNT value on done: 883610.0 [2024-08-06 07:34:27,965][52794] Sum rewards: 76.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.208', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.414', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:29,376][52658] DAMAGECOUNT value on done: 869647.0 [2024-08-06 07:34:29,377][52658] Sum rewards: 73.030, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO2': '0.005', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon5': '0.154', 'AMMO3': '0.189', 'weapon2': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.294', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:30,532][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:34:30,785][52794] DAMAGECOUNT value on done: 872612.0 [2024-08-06 07:34:30,785][52794] Sum rewards: 67.684, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.324', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.662', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '56.000'} [2024-08-06 07:34:30,888][52663] DAMAGECOUNT value on done: 877093.0 [2024-08-06 07:34:30,889][52663] Sum rewards: 73.246, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.712', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.044', 'AMMO4': '0.134', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.292', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:30,906][52669] DAMAGECOUNT value on done: 884263.0 [2024-08-06 07:34:30,906][52669] Sum rewards: 79.047, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.062', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.204', 'WEAPON3': '1.300', 'weapon3': '3.524', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:31,970][52658] DAMAGECOUNT value on done: 896111.0 [2024-08-06 07:34:31,972][52658] Sum rewards: 77.768, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.015', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.512', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:31,978][52650] Updated weights for policy 0, policy_version 77531 (0.0011) [2024-08-06 07:34:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 635150336. Throughput: 0: 4362.5. Samples: 158787380. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:32,794][52567] Avg episode reward: [(0, '75.227')] [2024-08-06 07:34:33,588][52669] DAMAGECOUNT value on done: 879860.0 [2024-08-06 07:34:33,588][52669] Sum rewards: 74.463, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.060', 'weapon4': '0.104', 'AMMO4': '0.205', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:33,594][52663] DAMAGECOUNT value on done: 870568.0 [2024-08-06 07:34:33,594][52663] Sum rewards: 75.538, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.145', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.068', 'AMMO3': '0.235', 'weapon2': '0.238', 'WEAPON3': '1.550', 'HITCOUNT': '3.490', 'weapon3': '3.534', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:33,876][52794] DAMAGECOUNT value on done: 867357.0 [2024-08-06 07:34:33,879][52794] Sum rewards: 84.050, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.078', 'weapon5': '0.216', 'AMMO4': '0.235', 'AMMO3': '0.249', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '71.000'} [2024-08-06 07:34:33,932][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:34:35,052][52658] DAMAGECOUNT value on done: 880321.0 [2024-08-06 07:34:35,055][52658] Sum rewards: 82.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.434', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.046', 'weapon5': '0.106', 'AMMO4': '0.112', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '70.000'} [2024-08-06 07:34:35,994][52647] DAMAGECOUNT value on done: 932441.0 [2024-08-06 07:34:35,997][52647] Sum rewards: 83.148, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.156', 'weapon2': '0.810', 'WEAPON3': '0.900', 'weapon3': '2.976', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:36,300][52794] DAMAGECOUNT value on done: 873315.0 [2024-08-06 07:34:36,301][52794] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.666', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.126', 'weapon2': '0.136', 'weapon4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.650', 'HITCOUNT': '3.300', 'weapon3': '3.314', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:36,412][52650] Updated weights for policy 0, policy_version 77541 (0.0040) [2024-08-06 07:34:36,874][52669] DAMAGECOUNT value on done: 880425.0 [2024-08-06 07:34:36,874][52669] Sum rewards: 76.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO3': '0.224', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:36,904][52663] DAMAGECOUNT value on done: 876637.0 [2024-08-06 07:34:36,904][52663] Sum rewards: 82.194, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '67.000'} [2024-08-06 07:34:37,429][52662] Large shaping reward 2.575 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.555, 185.0)] [2024-08-06 07:34:37,582][52658] DAMAGECOUNT value on done: 890153.0 [2024-08-06 07:34:37,582][52658] Sum rewards: 85.900, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.126', 'weapon4': '0.176', 'AMMO3': '0.179', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '69.000'} [2024-08-06 07:34:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 635240448. Throughput: 0: 4359.2. Samples: 158813510. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:37,794][52567] Avg episode reward: [(0, '75.423')] [2024-08-06 07:34:38,527][52647] DAMAGECOUNT value on done: 921477.0 [2024-08-06 07:34:38,529][52647] Sum rewards: 66.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.446', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.482', 'WEAPON3': '0.950', 'weapon3': '3.182', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '53.000'} [2024-08-06 07:34:39,214][52794] DAMAGECOUNT value on done: 878215.0 [2024-08-06 07:34:39,214][52794] Sum rewards: 63.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.100', 'AMMO4': '0.143', 'weapon5': '0.158', 'AMMO3': '0.278', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '3.120', 'weapon3': '3.192', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '55.000'} [2024-08-06 07:34:39,326][52669] DAMAGECOUNT value on done: 878373.0 [2024-08-06 07:34:39,327][52669] Sum rewards: 73.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.535', 'AMMO5': '0.009', 'AMMO2': '0.056', 'weapon5': '0.110', 'weapon4': '0.124', 'AMMO3': '0.233', 'weapon2': '0.274', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '62.000'} [2024-08-06 07:34:39,381][52663] DAMAGECOUNT value on done: 877740.0 [2024-08-06 07:34:39,383][52663] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.009', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '61.000'} [2024-08-06 07:34:40,002][52658] DAMAGECOUNT value on done: 877252.0 [2024-08-06 07:34:40,017][52658] Sum rewards: 78.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.024', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon4': '0.220', 'weapon2': '0.230', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:40,587][52671] DAMAGECOUNT value on done: 882594.0 [2024-08-06 07:34:40,587][52671] Sum rewards: 71.813, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.197', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.100', 'AMMO3': '0.177', 'AMMO4': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '59.000'} [2024-08-06 07:34:40,786][52650] Updated weights for policy 0, policy_version 77551 (0.0024) [2024-08-06 07:34:41,415][52647] DAMAGECOUNT value on done: 928933.0 [2024-08-06 07:34:41,416][52647] Sum rewards: 73.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.240', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.174', 'WEAPON5': '0.300', 'weapon2': '0.622', 'WEAPON3': '0.950', 'weapon3': '2.912', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '57.500'} [2024-08-06 07:34:42,092][52794] DAMAGECOUNT value on done: 864902.0 [2024-08-06 07:34:42,092][52794] Sum rewards: 69.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.398', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.138', 'weapon5': '0.148', 'AMMO3': '0.182', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '55.000'} [2024-08-06 07:34:42,390][52669] DAMAGECOUNT value on done: 889050.0 [2024-08-06 07:34:42,391][52669] Sum rewards: 66.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'weapon4': '0.042', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO3': '0.210', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.300', 'HITCOUNT': '2.810', 'weapon3': '3.232', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '55.000'} [2024-08-06 07:34:42,481][52663] DAMAGECOUNT value on done: 883428.0 [2024-08-06 07:34:42,481][52663] Sum rewards: 83.676, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.014', 'AMMO2': '0.036', 'AMMO3': '0.167', 'AMMO4': '0.178', 'weapon5': '0.200', 'weapon2': '0.216', 'HEALTH': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.814', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:42,536][52658] DAMAGECOUNT value on done: 886577.0 [2024-08-06 07:34:42,537][52658] Sum rewards: 80.531, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.368', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.142', 'weapon5': '0.222', 'weapon2': '0.240', 'AMMO3': '0.256', 'AMMO4': '0.301', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '68.000'} [2024-08-06 07:34:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 635322368. Throughput: 0: 4355.8. Samples: 158839740. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:34:42,795][52567] Avg episode reward: [(0, '75.133')] [2024-08-06 07:34:43,557][52671] DAMAGECOUNT value on done: 887173.0 [2024-08-06 07:34:43,560][52671] Sum rewards: 61.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.240', 'weapon2': '0.268', 'weapon5': '0.276', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '53.000'} [2024-08-06 07:34:44,197][52647] DAMAGECOUNT value on done: 928359.0 [2024-08-06 07:34:44,197][52647] Sum rewards: 74.202, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.128', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '62.000'} [2024-08-06 07:34:44,862][52669] DAMAGECOUNT value on done: 877510.0 [2024-08-06 07:34:44,862][52669] Sum rewards: 72.968, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.183', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.202', 'AMMO3': '0.228', 'weapon2': '0.256', 'AMMO4': '0.264', 'weapon4': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '61.000'} [2024-08-06 07:34:45,028][52663] DAMAGECOUNT value on done: 874990.0 [2024-08-06 07:34:45,029][52663] Sum rewards: 79.704, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.558', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.128', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '67.000'} [2024-08-06 07:34:45,364][52794] DAMAGECOUNT value on done: 878435.0 [2024-08-06 07:34:45,364][52794] Sum rewards: 75.775, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.988', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.150', 'weapon2': '0.170', 'weapon5': '0.170', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.366', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '62.000'} [2024-08-06 07:34:45,505][52658] DAMAGECOUNT value on done: 875896.0 [2024-08-06 07:34:45,506][52658] Sum rewards: 72.379, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.176', 'AMMO4': '0.203', 'AMMO3': '0.204', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:45,773][52650] Updated weights for policy 0, policy_version 77561 (0.0013) [2024-08-06 07:34:46,542][52671] DAMAGECOUNT value on done: 883872.0 [2024-08-06 07:34:46,550][52671] Sum rewards: 77.471, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.916', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.364', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:46,602][52647] DAMAGECOUNT value on done: 936431.0 [2024-08-06 07:34:46,602][52647] Sum rewards: 75.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.007', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.111', 'AMMO3': '0.158', 'weapon5': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.050', 'weapon3': '3.210', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '60.000'} [2024-08-06 07:34:47,757][52669] DAMAGECOUNT value on done: 888269.0 [2024-08-06 07:34:47,758][52669] Sum rewards: 81.119, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.467', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.177', 'AMMO4': '0.191', 'weapon5': '0.220', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.930', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 635412480. Throughput: 0: 4358.0. Samples: 158853030. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:34:47,794][52567] Avg episode reward: [(0, '74.928')] [2024-08-06 07:34:47,873][52663] DAMAGECOUNT value on done: 864459.0 [2024-08-06 07:34:47,874][52663] Sum rewards: 65.176, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.670', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.144', 'weapon2': '0.510', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.316', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '52.000'} [2024-08-06 07:34:48,440][52658] DAMAGECOUNT value on done: 882125.0 [2024-08-06 07:34:48,440][52658] Sum rewards: 76.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.962', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.632', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:48,491][52794] DAMAGECOUNT value on done: 872926.0 [2024-08-06 07:34:48,492][52794] Sum rewards: 81.430, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.082', 'weapon5': '0.148', 'AMMO4': '0.224', 'AMMO3': '0.229', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '68.000'} [2024-08-06 07:34:49,443][52647] DAMAGECOUNT value on done: 930746.0 [2024-08-06 07:34:49,444][52647] Sum rewards: 65.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.316', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.678', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '53.000'} [2024-08-06 07:34:49,533][52671] DAMAGECOUNT value on done: 883667.0 [2024-08-06 07:34:49,534][52671] Sum rewards: 69.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.642', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.154', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'weapon5': '0.326', 'WEAPON5': '0.350', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '2.554', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '55.000'} [2024-08-06 07:34:50,379][52650] Updated weights for policy 0, policy_version 77571 (0.0028) [2024-08-06 07:34:50,873][52669] DAMAGECOUNT value on done: 887093.0 [2024-08-06 07:34:50,875][52669] Sum rewards: 70.463, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.173', 'weapon2': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '55.000'} [2024-08-06 07:34:51,004][52663] DAMAGECOUNT value on done: 871932.0 [2024-08-06 07:34:51,004][52663] Sum rewards: 70.289, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.357', 'AMMO5': '0.010', 'AMMO2': '0.051', 'AMMO3': '0.136', 'weapon5': '0.162', 'weapon4': '0.232', 'WEAPON5': '0.250', 'AMMO4': '0.255', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon3': '3.070', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '54.000'} [2024-08-06 07:34:51,334][52658] DAMAGECOUNT value on done: 865527.0 [2024-08-06 07:34:51,335][52658] Sum rewards: 71.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.080', 'weapon5': '0.130', 'AMMO4': '0.178', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.100', 'HITCOUNT': '2.990', 'weapon3': '3.256', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '59.000'} [2024-08-06 07:34:51,374][52794] DAMAGECOUNT value on done: 864748.0 [2024-08-06 07:34:51,379][52794] Sum rewards: 79.448, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.954', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.152', 'AMMO4': '0.158', 'AMMO3': '0.209', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:51,822][52647] DAMAGECOUNT value on done: 934576.0 [2024-08-06 07:34:51,822][52647] Sum rewards: 77.751, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.362', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.286', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.326', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '68.000'} [2024-08-06 07:34:52,288][52671] DAMAGECOUNT value on done: 889024.0 [2024-08-06 07:34:52,288][52671] Sum rewards: 72.602, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.108', 'AMMO3': '0.185', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.358', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '59.000'} [2024-08-06 07:34:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17477.9, 300 sec: 17494.8). Total num frames: 635502592. Throughput: 0: 4344.2. Samples: 158878970. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:34:52,794][52567] Avg episode reward: [(0, '74.667')] [2024-08-06 07:34:53,260][52669] DAMAGECOUNT value on done: 874384.0 [2024-08-06 07:34:53,262][52669] Sum rewards: 75.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.436', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.410', 'weapon4': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.796', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:53,582][52663] DAMAGECOUNT value on done: 875836.0 [2024-08-06 07:34:53,582][52663] Sum rewards: 68.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.605', 'AMMO5': '0.019', 'AMMO2': '0.070', 'AMMO3': '0.193', 'weapon2': '0.230', 'weapon5': '0.256', 'weapon4': '0.338', 'AMMO4': '0.351', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '57.000'} [2024-08-06 07:34:54,062][52658] DAMAGECOUNT value on done: 882813.0 [2024-08-06 07:34:54,062][52658] Sum rewards: 65.880, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.036', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'weapon5': '0.210', 'weapon2': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.266', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '57.000'} [2024-08-06 07:34:54,252][52647] DAMAGECOUNT value on done: 910272.0 [2024-08-06 07:34:54,254][52647] Sum rewards: 75.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.489', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.163', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '3.214', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '61.000'} [2024-08-06 07:34:54,423][52794] DAMAGECOUNT value on done: 879646.0 [2024-08-06 07:34:54,423][52794] Sum rewards: 74.244, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.835', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.084', 'AMMO3': '0.172', 'AMMO4': '0.217', 'weapon5': '0.250', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '60.000'} [2024-08-06 07:34:54,729][52671] DAMAGECOUNT value on done: 878724.0 [2024-08-06 07:34:54,729][52671] Sum rewards: 77.028, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon5': '0.100', 'weapon4': '0.144', 'AMMO4': '0.169', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 07:34:55,212][52650] Updated weights for policy 0, policy_version 77581 (0.0037) [2024-08-06 07:34:55,352][52614] Signal inference workers to stop experience collection... (14200 times) [2024-08-06 07:34:55,364][52614] Signal inference workers to resume experience collection... (14200 times) [2024-08-06 07:34:55,439][52650] InferenceWorker_p0-w0: stopping experience collection (14200 times) [2024-08-06 07:34:55,439][52650] InferenceWorker_p0-w0: resuming experience collection (14200 times) [2024-08-06 07:34:56,320][52669] DAMAGECOUNT value on done: 875547.0 [2024-08-06 07:34:56,322][52669] Sum rewards: 80.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.544', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.199', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '66.000'} [2024-08-06 07:34:56,510][52663] DAMAGECOUNT value on done: 883290.0 [2024-08-06 07:34:56,512][52663] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.272', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.152', 'weapon4': '0.184', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '59.000'} [2024-08-06 07:34:56,643][52658] DAMAGECOUNT value on done: 875281.0 [2024-08-06 07:34:56,645][52658] Sum rewards: 73.793, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.304', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.108', 'AMMO3': '0.228', 'weapon2': '0.282', 'AMMO4': '0.289', 'weapon5': '0.298', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.992', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '63.000'} [2024-08-06 07:34:57,271][52647] DAMAGECOUNT value on done: 926319.0 [2024-08-06 07:34:57,279][52647] Sum rewards: 73.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.134', 'weapon2': '0.184', 'AMMO3': '0.201', 'weapon4': '0.204', 'AMMO4': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.232', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '61.000'} [2024-08-06 07:34:57,474][52794] DAMAGECOUNT value on done: 874235.0 [2024-08-06 07:34:57,476][52794] Sum rewards: 82.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.618', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.149', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:57,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 635584512. Throughput: 0: 4368.9. Samples: 158905360. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:34:57,795][52567] Avg episode reward: [(0, '74.947')] [2024-08-06 07:34:57,893][52671] DAMAGECOUNT value on done: 883617.0 [2024-08-06 07:34:57,895][52671] Sum rewards: 76.367, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.112', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '62.000'} [2024-08-06 07:34:58,082][52669] Large shaping reward 2.521 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.489, 163.0), ('weapon5', 0.002)] [2024-08-06 07:34:59,249][52669] DAMAGECOUNT value on done: 880472.0 [2024-08-06 07:34:59,251][52669] Sum rewards: 72.581, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.730', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.176', 'weapon4': '0.212', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:59,254][52658] DAMAGECOUNT value on done: 871766.0 [2024-08-06 07:34:59,257][52658] Sum rewards: 79.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '67.000'} [2024-08-06 07:34:59,399][52649] DAMAGECOUNT value on done: 848626.0 [2024-08-06 07:34:59,403][52649] Sum rewards: 75.457, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.310', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.182', 'AMMO4': '0.204', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '65.000'} [2024-08-06 07:34:59,599][52650] Updated weights for policy 0, policy_version 77591 (0.0025) [2024-08-06 07:34:59,601][52663] DAMAGECOUNT value on done: 865938.0 [2024-08-06 07:34:59,602][52663] Sum rewards: 68.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.492', 'AMMO5': '0.018', 'AMMO2': '0.073', 'weapon4': '0.176', 'AMMO3': '0.220', 'weapon2': '0.276', 'weapon5': '0.314', 'AMMO4': '0.366', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '58.000'} [2024-08-06 07:34:59,985][52647] DAMAGECOUNT value on done: 925623.0 [2024-08-06 07:34:59,985][52647] Sum rewards: 84.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.252', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.072', 'weapon5': '0.114', 'AMMO3': '0.170', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.678', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:00,610][52794] DAMAGECOUNT value on done: 888197.0 [2024-08-06 07:35:00,610][52794] Sum rewards: 71.678, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.505', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon5': '0.198', 'weapon4': '0.208', 'AMMO4': '0.230', 'AMMO3': '0.235', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.802', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '61.500'} [2024-08-06 07:35:00,749][52671] DAMAGECOUNT value on done: 885388.0 [2024-08-06 07:35:00,749][52671] Sum rewards: 68.048, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.694', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO3': '0.186', 'AMMO4': '0.207', 'weapon5': '0.216', 'weapon4': '0.218', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '54.000'} [2024-08-06 07:35:02,272][52649] DAMAGECOUNT value on done: 844956.0 [2024-08-06 07:35:02,279][52649] Sum rewards: 77.955, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.522', 'AMMO5': '0.021', 'AMMO2': '0.066', 'AMMO3': '0.223', 'weapon4': '0.228', 'weapon2': '0.234', 'AMMO4': '0.331', 'weapon5': '0.378', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:02,318][52669] DAMAGECOUNT value on done: 902654.0 [2024-08-06 07:35:02,321][52669] Sum rewards: 76.878, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.515', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.066', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:02,470][52658] DAMAGECOUNT value on done: 880718.0 [2024-08-06 07:35:02,470][52658] Sum rewards: 83.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon2': '0.170', 'AMMO3': '0.235', 'WEAPON3': '1.400', 'weapon3': '3.596', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '69.000'} [2024-08-06 07:35:02,631][52663] DAMAGECOUNT value on done: 863948.0 [2024-08-06 07:35:02,632][52663] Sum rewards: 92.396, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.032', 'HEALTH': '0.090', 'weapon4': '0.126', 'AMMO3': '0.152', 'AMMO4': '0.157', 'weapon5': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON3': '0.950', 'weapon3': '2.980', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '22.083', 'FRAGCOUNT': '71.000'} [2024-08-06 07:35:02,692][52647] DAMAGECOUNT value on done: 923330.0 [2024-08-06 07:35:02,693][52647] Sum rewards: 81.501, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.098', 'AMMO3': '0.199', 'AMMO4': '0.217', 'weapon5': '0.240', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '67.000'} [2024-08-06 07:35:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 635674624. Throughput: 0: 4368.2. Samples: 158918480. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:35:02,794][52567] Avg episode reward: [(0, '75.025')] [2024-08-06 07:35:03,119][52664] DAMAGECOUNT value on done: 907168.0 [2024-08-06 07:35:03,119][52664] Sum rewards: 75.997, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.736', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.190', 'AMMO3': '0.199', 'weapon2': '0.248', 'AMMO4': '0.248', 'weapon5': '0.314', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:03,350][52671] DAMAGECOUNT value on done: 869851.0 [2024-08-06 07:35:03,351][52671] Sum rewards: 76.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.060', 'AMMO4': '0.080', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.196', 'WEAPON3': '1.100', 'weapon3': '3.490', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:03,808][52794] DAMAGECOUNT value on done: 867241.0 [2024-08-06 07:35:03,810][52794] Sum rewards: 69.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.992', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.416', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.356', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:04,292][52650] Updated weights for policy 0, policy_version 77601 (0.0029) [2024-08-06 07:35:04,913][52649] DAMAGECOUNT value on done: 861444.0 [2024-08-06 07:35:04,914][52649] Sum rewards: 88.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.081', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.148', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.375', 'FRAGCOUNT': '70.000'} [2024-08-06 07:35:05,196][52669] DAMAGECOUNT value on done: 890473.0 [2024-08-06 07:35:05,198][52669] Sum rewards: 76.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.342', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:05,523][52663] DAMAGECOUNT value on done: 870619.0 [2024-08-06 07:35:05,526][52663] Sum rewards: 68.779, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.580', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.084', 'AMMO3': '0.144', 'weapon5': '0.162', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.156', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '53.000'} [2024-08-06 07:35:05,914][52647] DAMAGECOUNT value on done: 913197.0 [2024-08-06 07:35:05,914][52647] Sum rewards: 77.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.578', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon4': '0.074', 'weapon5': '0.074', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:06,183][52671] DAMAGECOUNT value on done: 884229.0 [2024-08-06 07:35:06,184][52671] Sum rewards: 76.437, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:06,343][52664] DAMAGECOUNT value on done: 914038.0 [2024-08-06 07:35:06,343][52664] Sum rewards: 78.068, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.370', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.116', 'weapon5': '0.140', 'AMMO4': '0.164', 'AMMO3': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.076', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:06,851][52794] DAMAGECOUNT value on done: 884366.0 [2024-08-06 07:35:06,851][52794] Sum rewards: 65.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon4': '0.110', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '3.298', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '55.000'} [2024-08-06 07:35:07,655][52665] DAMAGECOUNT value on done: 864852.0 [2024-08-06 07:35:07,655][52665] Sum rewards: 70.303, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.740', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.098', 'weapon5': '0.166', 'AMMO3': '0.183', 'AMMO4': '0.191', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '3.254', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:07,734][52649] DAMAGECOUNT value on done: 856682.0 [2024-08-06 07:35:07,735][52649] Sum rewards: 86.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.170', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.154', 'AMMO4': '0.169', 'AMMO3': '0.177', 'weapon5': '0.194', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '70.000'} [2024-08-06 07:35:07,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 635764736. Throughput: 0: 4367.8. Samples: 158944720. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:35:07,794][52567] Avg episode reward: [(0, '75.216')] [2024-08-06 07:35:08,331][52669] DAMAGECOUNT value on done: 885156.0 [2024-08-06 07:35:08,331][52669] Sum rewards: 64.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.004', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.186', 'AMMO4': '0.194', 'weapon4': '0.236', 'AMMO3': '0.290', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.946', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '56.000'} [2024-08-06 07:35:08,479][52647] DAMAGECOUNT value on done: 929056.0 [2024-08-06 07:35:08,480][52647] Sum rewards: 84.812, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.740', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.090', 'AMMO3': '0.189', 'AMMO4': '0.208', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '67.000'} [2024-08-06 07:35:08,727][52663] DAMAGECOUNT value on done: 873269.0 [2024-08-06 07:35:08,731][52663] Sum rewards: 77.964, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.090', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon2': '0.166', 'weapon5': '0.174', 'weapon4': '0.278', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.048', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '66.000'} [2024-08-06 07:35:08,822][52647] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:35:08,877][52664] DAMAGECOUNT value on done: 914164.0 [2024-08-06 07:35:08,878][52664] Sum rewards: 89.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.186', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.322', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '72.000'} [2024-08-06 07:35:09,202][52671] DAMAGECOUNT value on done: 881182.0 [2024-08-06 07:35:09,202][52671] Sum rewards: 74.644, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.785', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.416', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:09,225][52794] DAMAGECOUNT value on done: 878343.0 [2024-08-06 07:35:09,226][52794] Sum rewards: 61.822, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.062', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.652', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '52.000'} [2024-08-06 07:35:09,524][52650] Updated weights for policy 0, policy_version 77611 (0.0013) [2024-08-06 07:35:09,993][52670] DAMAGECOUNT value on done: 863057.0 [2024-08-06 07:35:09,993][52670] Sum rewards: 65.272, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.925', 'AMMO5': '0.007', 'weapon5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.710', 'WEAPON3': '0.900', 'weapon3': '3.160', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '52.000'} [2024-08-06 07:35:10,569][52665] DAMAGECOUNT value on done: 877127.0 [2024-08-06 07:35:10,570][52665] Sum rewards: 60.468, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.355', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.136', 'weapon5': '0.148', 'WEAPON5': '0.200', 'AMMO4': '0.238', 'weapon4': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.408', 'ARMOR': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '2.938', 'DAMAGECOUNT': '14.391', 'FRAGCOUNT': '49.000'} [2024-08-06 07:35:10,734][52649] DAMAGECOUNT value on done: 849718.0 [2024-08-06 07:35:10,734][52649] Sum rewards: 85.629, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.176', 'AMMO4': '0.204', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.802', 'WEAPON3': '1.400', 'weapon3': '2.664', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '71.000'} [2024-08-06 07:35:11,353][52647] DAMAGECOUNT value on done: 917304.0 [2024-08-06 07:35:11,353][52647] Sum rewards: 83.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.174', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:11,496][52669] DAMAGECOUNT value on done: 889996.0 [2024-08-06 07:35:11,497][52669] Sum rewards: 71.151, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.507', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.168', 'weapon2': '0.212', 'AMMO4': '0.226', 'AMMO3': '0.315', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.248', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:11,760][52663] DAMAGECOUNT value on done: 877385.0 [2024-08-06 07:35:11,760][52663] Sum rewards: 82.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.540', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.115', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.156', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '71.000'} [2024-08-06 07:35:11,976][52664] DAMAGECOUNT value on done: 904839.0 [2024-08-06 07:35:11,977][52664] Sum rewards: 78.786, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.639', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.070', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.226', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:12,167][52671] DAMAGECOUNT value on done: 878437.0 [2024-08-06 07:35:12,167][52671] Sum rewards: 76.281, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.221', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:12,354][52794] DAMAGECOUNT value on done: 881660.0 [2024-08-06 07:35:12,358][52794] Sum rewards: 82.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.012', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon4': '0.338', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '2.706', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:12,366][52670] DAMAGECOUNT value on done: 878371.0 [2024-08-06 07:35:12,366][52670] Sum rewards: 76.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.518', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.040', 'weapon5': '0.082', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 635846656. Throughput: 0: 4368.7. Samples: 158970920. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:35:12,795][52567] Avg episode reward: [(0, '75.492')] [2024-08-06 07:35:13,275][52665] DAMAGECOUNT value on done: 867525.0 [2024-08-06 07:35:13,276][52665] Sum rewards: 67.710, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.020', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.134', 'weapon5': '0.174', 'AMMO4': '0.229', 'AMMO3': '0.269', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.120', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:13,374][52649] DAMAGECOUNT value on done: 858533.0 [2024-08-06 07:35:13,375][52649] Sum rewards: 63.235, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.224', 'AMMO5': '0.005', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.470', 'WEAPON3': '1.350', 'HITCOUNT': '2.810', 'weapon3': '3.226', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '53.000'} [2024-08-06 07:35:13,703][52650] Updated weights for policy 0, policy_version 77621 (0.0012) [2024-08-06 07:35:14,329][52647] DAMAGECOUNT value on done: 926385.0 [2024-08-06 07:35:14,331][52647] Sum rewards: 61.416, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.352', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.130', 'weapon5': '0.188', 'AMMO3': '0.247', 'AMMO4': '0.272', 'weapon2': '0.288', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.762', 'FRAGCOUNT': '53.000'} [2024-08-06 07:35:14,410][52669] DAMAGECOUNT value on done: 891304.0 [2024-08-06 07:35:14,410][52669] Sum rewards: 71.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.864', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon2': '0.124', 'weapon4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON3': '1.350', 'HITCOUNT': '3.410', 'weapon3': '3.474', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:14,773][52664] DAMAGECOUNT value on done: 916385.0 [2024-08-06 07:35:14,775][52664] Sum rewards: 71.248, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.987', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.114', 'weapon5': '0.164', 'weapon2': '0.204', 'AMMO4': '0.220', 'AMMO3': '0.277', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.232', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:14,945][52663] DAMAGECOUNT value on done: 875835.0 [2024-08-06 07:35:14,947][52663] Sum rewards: 78.540, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.030', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.064', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.314', 'WEAPON3': '1.650', 'weapon3': '3.414', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '67.000'} [2024-08-06 07:35:15,290][52671] DAMAGECOUNT value on done: 885324.0 [2024-08-06 07:35:15,290][52671] Sum rewards: 73.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.044', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.152', 'AMMO3': '0.219', 'weapon4': '0.220', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:15,297][52670] DAMAGECOUNT value on done: 864249.0 [2024-08-06 07:35:15,299][52670] Sum rewards: 73.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.408', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:15,486][52794] DAMAGECOUNT value on done: 888570.0 [2024-08-06 07:35:15,487][52794] Sum rewards: 75.539, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.956', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.177', 'weapon4': '0.180', 'weapon2': '0.266', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.222', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '65.000'} [2024-08-06 07:35:15,963][52663] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:35:16,166][52665] DAMAGECOUNT value on done: 871231.0 [2024-08-06 07:35:16,169][52665] Sum rewards: 67.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.236', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.106', 'AMMO4': '0.110', 'weapon5': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '56.000'} [2024-08-06 07:35:16,184][52666] DAMAGECOUNT value on done: 878390.0 [2024-08-06 07:35:16,184][52666] Sum rewards: 70.671, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.970', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.060', 'AMMO4': '0.191', 'weapon5': '0.222', 'AMMO3': '0.288', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.900', 'weapon3': '3.174', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:16,277][52649] DAMAGECOUNT value on done: 856294.0 [2024-08-06 07:35:16,277][52649] Sum rewards: 74.115, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.554', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.106', 'weapon4': '0.114', 'AMMO4': '0.170', 'weapon2': '0.188', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.372', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:17,106][52647] DAMAGECOUNT value on done: 927571.0 [2024-08-06 07:35:17,106][52647] Sum rewards: 64.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.210', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO4': '0.195', 'weapon2': '0.214', 'AMMO3': '0.230', 'weapon5': '0.252', 'weapon4': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.830', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '54.000'} [2024-08-06 07:35:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 635936768. Throughput: 0: 4368.9. Samples: 158983980. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:35:17,794][52567] Avg episode reward: [(0, '74.558')] [2024-08-06 07:35:17,794][52664] DAMAGECOUNT value on done: 912870.0 [2024-08-06 07:35:17,802][52664] Sum rewards: 87.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.978', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.114', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '71.000'} [2024-08-06 07:35:18,013][52663] DAMAGECOUNT value on done: 880758.0 [2024-08-06 07:35:18,017][52663] Sum rewards: 73.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.374', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:18,257][52670] DAMAGECOUNT value on done: 866564.0 [2024-08-06 07:35:18,260][52670] Sum rewards: 75.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.236', 'AMMO5': '0.009', 'weapon5': '0.020', 'AMMO2': '0.023', 'weapon4': '0.100', 'AMMO4': '0.117', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:18,259][52671] DAMAGECOUNT value on done: 882061.0 [2024-08-06 07:35:18,261][52671] Sum rewards: 77.700, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.420', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.270', 'weapon2': '0.434', 'WEAPON3': '1.650', 'weapon3': '3.218', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '66.000'} [2024-08-06 07:35:18,587][52650] Updated weights for policy 0, policy_version 77631 (0.0011) [2024-08-06 07:35:18,615][52794] DAMAGECOUNT value on done: 880579.0 [2024-08-06 07:35:18,616][52794] Sum rewards: 71.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.076', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.133', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.336', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:18,934][52665] DAMAGECOUNT value on done: 854715.0 [2024-08-06 07:35:18,934][52665] Sum rewards: 71.233, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.414', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.123', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:19,061][52666] DAMAGECOUNT value on done: 872414.0 [2024-08-06 07:35:19,061][52666] Sum rewards: 74.894, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.221', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.146', 'AMMO4': '0.188', 'weapon5': '0.230', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:19,067][52649] DAMAGECOUNT value on done: 858451.0 [2024-08-06 07:35:19,067][52649] Sum rewards: 65.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.810', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.108', 'weapon5': '0.152', 'AMMO4': '0.176', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.590', 'WEAPON3': '1.600', 'weapon3': '2.862', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '55.000'} [2024-08-06 07:35:20,204][52647] DAMAGECOUNT value on done: 915226.0 [2024-08-06 07:35:20,204][52647] Sum rewards: 77.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.768', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.252', 'WEAPON3': '1.150', 'weapon3': '3.574', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:20,639][52663] DAMAGECOUNT value on done: 884528.0 [2024-08-06 07:35:20,641][52663] Sum rewards: 72.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.340', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.048', 'AMMO4': '0.051', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:20,934][52664] DAMAGECOUNT value on done: 902171.0 [2024-08-06 07:35:20,935][52664] Sum rewards: 65.854, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-4.460', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.044', 'weapon5': '0.090', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '55.000'} [2024-08-06 07:35:21,200][52665] DAMAGECOUNT value on done: 858962.0 [2024-08-06 07:35:21,201][52665] Sum rewards: 78.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.535', 'AMMO5': '0.005', 'AMMO2': '0.057', 'weapon5': '0.098', 'WEAPON5': '0.200', 'weapon4': '0.206', 'AMMO3': '0.207', 'weapon2': '0.244', 'AMMO4': '0.283', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.250', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '65.000'} [2024-08-06 07:35:21,296][52670] DAMAGECOUNT value on done: 879936.0 [2024-08-06 07:35:21,297][52670] Sum rewards: 80.956, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.580', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.110', 'weapon4': '0.148', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '0.900', 'weapon3': '3.176', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:21,344][52671] DAMAGECOUNT value on done: 867458.0 [2024-08-06 07:35:21,345][52671] Sum rewards: 84.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.295', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.040', 'AMMO4': '0.077', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.358', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:21,438][52649] DAMAGECOUNT value on done: 856488.0 [2024-08-06 07:35:21,439][52649] Sum rewards: 66.930, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.235', 'weapon2': '0.496', 'WEAPON3': '1.500', 'weapon3': '3.226', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '55.000'} [2024-08-06 07:35:22,241][52666] DAMAGECOUNT value on done: 878860.0 [2024-08-06 07:35:22,241][52666] Sum rewards: 76.018, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.142', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.318', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:22,764][52650] Updated weights for policy 0, policy_version 77641 (0.0012) [2024-08-06 07:35:22,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 636035072. Throughput: 0: 4373.8. Samples: 159010330. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:35:22,794][52567] Avg episode reward: [(0, '74.744')] [2024-08-06 07:35:23,323][52647] DAMAGECOUNT value on done: 920615.0 [2024-08-06 07:35:23,327][52647] Sum rewards: 78.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.996', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.162', 'weapon5': '0.226', 'weapon2': '0.238', 'AMMO4': '0.252', 'AMMO3': '0.271', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '66.500'} [2024-08-06 07:35:23,566][52663] DAMAGECOUNT value on done: 868034.0 [2024-08-06 07:35:23,567][52663] Sum rewards: 74.835, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.458', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.126', 'AMMO4': '0.168', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:23,807][52665] DAMAGECOUNT value on done: 865832.0 [2024-08-06 07:35:23,809][52665] Sum rewards: 90.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.194', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.128', 'weapon4': '0.142', 'AMMO3': '0.212', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '22.365', 'FRAGCOUNT': '73.000'} [2024-08-06 07:35:23,896][52670] DAMAGECOUNT value on done: 867552.0 [2024-08-06 07:35:23,896][52670] Sum rewards: 83.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.005', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.586', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:24,037][52649] DAMAGECOUNT value on done: 850887.0 [2024-08-06 07:35:24,039][52649] Sum rewards: 73.112, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.173', 'weapon5': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.372', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '2.732', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:24,088][52664] DAMAGECOUNT value on done: 902571.0 [2024-08-06 07:35:24,088][52664] Sum rewards: 81.256, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.108', 'AMMO4': '0.123', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '67.000'} [2024-08-06 07:35:24,130][52671] DAMAGECOUNT value on done: 891641.0 [2024-08-06 07:35:24,130][52671] Sum rewards: 79.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.198', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon4': '0.092', 'weapon5': '0.230', 'weapon2': '0.244', 'AMMO3': '0.290', 'AMMO4': '0.344', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.850', 'weapon3': '3.162', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '69.000'} [2024-08-06 07:35:24,714][52666] DAMAGECOUNT value on done: 872905.0 [2024-08-06 07:35:24,714][52666] Sum rewards: 69.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.166', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon5': '0.048', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.280', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:25,151][52811] DAMAGECOUNT value on done: 833831.0 [2024-08-06 07:35:25,151][52811] Sum rewards: 73.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.116', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.086', 'weapon4': '0.140', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:25,937][52647] DAMAGECOUNT value on done: 913587.0 [2024-08-06 07:35:25,937][52647] Sum rewards: 65.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.110', 'AMMO4': '0.154', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '54.000'} [2024-08-06 07:35:26,499][52664] DAMAGECOUNT value on done: 913800.0 [2024-08-06 07:35:26,500][52664] Sum rewards: 71.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.061', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.078', 'AMMO4': '0.188', 'weapon5': '0.188', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:26,531][52670] DAMAGECOUNT value on done: 861393.0 [2024-08-06 07:35:26,532][52670] Sum rewards: 64.967, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.665', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.032', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.686', 'WEAPON3': '1.000', 'weapon3': '3.064', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '52.000'} [2024-08-06 07:35:26,827][52665] DAMAGECOUNT value on done: 864630.0 [2024-08-06 07:35:26,830][52665] Sum rewards: 77.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.685', 'AMMO5': '0.014', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.201', 'weapon5': '0.202', 'weapon4': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '63.500'} [2024-08-06 07:35:27,124][52666] DAMAGECOUNT value on done: 867455.0 [2024-08-06 07:35:27,126][52666] Sum rewards: 75.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:27,161][52649] DAMAGECOUNT value on done: 861480.0 [2024-08-06 07:35:27,162][52649] Sum rewards: 87.421, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.455', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.076', 'weapon5': '0.140', 'AMMO4': '0.254', 'AMMO3': '0.265', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '74.000'} [2024-08-06 07:35:27,222][52671] DAMAGECOUNT value on done: 889875.0 [2024-08-06 07:35:27,223][52671] Sum rewards: 69.621, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.150', 'weapon4': '0.160', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '56.000'} [2024-08-06 07:35:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 636108800. Throughput: 0: 4367.3. Samples: 159036270. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:35:27,795][52567] Avg episode reward: [(0, '75.124')] [2024-08-06 07:35:27,854][52650] Updated weights for policy 0, policy_version 77651 (0.0031) [2024-08-06 07:35:28,248][52811] DAMAGECOUNT value on done: 818765.0 [2024-08-06 07:35:28,250][52811] Sum rewards: 79.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.126', 'AMMO4': '0.172', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.332', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:28,515][52647] DAMAGECOUNT value on done: 915592.0 [2024-08-06 07:35:28,516][52647] Sum rewards: 66.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.646', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.249', 'WEAPON4': '0.350', 'weapon2': '0.508', 'weapon4': '0.548', 'WEAPON3': '1.450', 'weapon3': '2.528', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:29,227][52664] DAMAGECOUNT value on done: 908921.0 [2024-08-06 07:35:29,228][52664] Sum rewards: 74.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO4': '0.209', 'AMMO3': '0.219', 'weapon5': '0.226', 'weapon4': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:29,416][52670] DAMAGECOUNT value on done: 868857.0 [2024-08-06 07:35:29,416][52670] Sum rewards: 76.640, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.132', 'AMMO4': '0.197', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'weapon4': '0.346', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:29,915][52671] DAMAGECOUNT value on done: 883803.0 [2024-08-06 07:35:29,916][52671] Sum rewards: 62.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.320', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.096', 'weapon5': '0.160', 'AMMO4': '0.225', 'AMMO3': '0.237', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '53.500'} [2024-08-06 07:35:29,924][52665] DAMAGECOUNT value on done: 871627.0 [2024-08-06 07:35:29,925][52665] Sum rewards: 66.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.140', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.106', 'AMMO3': '0.180', 'weapon5': '0.282', 'AMMO4': '0.308', 'weapon2': '0.490', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.920', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.500'} [2024-08-06 07:35:30,134][52666] DAMAGECOUNT value on done: 872920.0 [2024-08-06 07:35:30,135][52666] Sum rewards: 66.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.898', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.175', 'weapon5': '0.182', 'AMMO4': '0.246', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.686', 'WEAPON3': '1.100', 'weapon3': '2.486', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.500'} [2024-08-06 07:35:30,414][52649] DAMAGECOUNT value on done: 868510.0 [2024-08-06 07:35:30,415][52649] Sum rewards: 78.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.702', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'weapon4': '0.060', 'weapon2': '0.238', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.478', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '66.000'} [2024-08-06 07:35:31,319][52811] DAMAGECOUNT value on done: 811890.0 [2024-08-06 07:35:31,320][52811] Sum rewards: 73.376, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.035', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.170', 'weapon2': '0.624', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:31,925][52664] DAMAGECOUNT value on done: 918214.0 [2024-08-06 07:35:31,933][52664] Sum rewards: 74.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.132', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.131', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:32,448][52650] Updated weights for policy 0, policy_version 77661 (0.0010) [2024-08-06 07:35:32,449][52670] DAMAGECOUNT value on done: 866593.0 [2024-08-06 07:35:32,450][52670] Sum rewards: 59.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.855', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.106', 'weapon5': '0.120', 'AMMO4': '0.147', 'AMMO3': '0.156', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.000', 'HITCOUNT': '2.570', 'weapon3': '3.088', 'DAMAGECOUNT': '13.329', 'FRAGCOUNT': '49.000'} [2024-08-06 07:35:32,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 636198912. Throughput: 0: 4366.4. Samples: 159049520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:35:32,794][52567] Avg episode reward: [(0, '74.708')] [2024-08-06 07:35:32,823][52671] DAMAGECOUNT value on done: 890294.0 [2024-08-06 07:35:32,824][52671] Sum rewards: 70.921, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.835', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.208', 'AMMO3': '0.222', 'weapon2': '0.246', 'weapon4': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '57.500'} [2024-08-06 07:35:32,886][52665] DAMAGECOUNT value on done: 864910.0 [2024-08-06 07:35:32,888][52665] Sum rewards: 76.455, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.710', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.094', 'weapon5': '0.098', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'weapon2': '0.534', 'WEAPON3': '0.900', 'weapon3': '3.196', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:33,159][52666] DAMAGECOUNT value on done: 869569.0 [2024-08-06 07:35:33,159][52666] Sum rewards: 68.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.048', 'AMMO4': '0.077', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.269', 'WEAPON3': '1.550', 'HITCOUNT': '3.390', 'weapon3': '3.396', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:33,415][52649] DAMAGECOUNT value on done: 861188.0 [2024-08-06 07:35:33,418][52649] Sum rewards: 81.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.608', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.072', 'weapon2': '0.180', 'AMMO4': '0.196', 'weapon5': '0.210', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '67.000'} [2024-08-06 07:35:34,395][52811] DAMAGECOUNT value on done: 815225.0 [2024-08-06 07:35:34,396][52811] Sum rewards: 67.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.675', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.082', 'weapon5': '0.106', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '56.000'} [2024-08-06 07:35:34,426][52664] DAMAGECOUNT value on done: 917095.0 [2024-08-06 07:35:34,429][52664] Sum rewards: 70.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.672', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.098', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '57.000'} [2024-08-06 07:35:35,106][52670] DAMAGECOUNT value on done: 862701.0 [2024-08-06 07:35:35,107][52670] Sum rewards: 78.902, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'HEALTH': '0.035', 'weapon4': '0.042', 'weapon5': '0.046', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:35,733][52666] DAMAGECOUNT value on done: 867351.0 [2024-08-06 07:35:35,734][52666] Sum rewards: 81.419, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.644', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.046', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.160', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '71.000'} [2024-08-06 07:35:35,926][52671] DAMAGECOUNT value on done: 873566.0 [2024-08-06 07:35:35,928][52671] Sum rewards: 63.980, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.568', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.112', 'AMMO3': '0.143', 'AMMO4': '0.229', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.720', 'WEAPON3': '0.850', 'weapon3': '2.660', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.081', 'FRAGCOUNT': '51.000'} [2024-08-06 07:35:35,996][52665] DAMAGECOUNT value on done: 879605.0 [2024-08-06 07:35:35,996][52665] Sum rewards: 67.957, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.135', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.144', 'weapon2': '0.208', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.450', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:36,547][52649] DAMAGECOUNT value on done: 862334.0 [2024-08-06 07:35:36,548][52649] Sum rewards: 76.902, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.264', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.362', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '67.000'} [2024-08-06 07:35:36,968][52664] DAMAGECOUNT value on done: 916230.0 [2024-08-06 07:35:36,977][52664] Sum rewards: 75.390, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'AMMO2': '0.032', 'weapon5': '0.044', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:37,467][52650] Updated weights for policy 0, policy_version 77671 (0.0013) [2024-08-06 07:35:37,566][52811] DAMAGECOUNT value on done: 818318.0 [2024-08-06 07:35:37,566][52811] Sum rewards: 65.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.243', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.167', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON4': '0.500', 'weapon4': '0.568', 'WEAPON3': '1.050', 'weapon3': '2.594', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '53.000'} [2024-08-06 07:35:37,795][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 636280832. Throughput: 0: 4376.4. Samples: 159075910. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:35:37,795][52567] Avg episode reward: [(0, '74.359')] [2024-08-06 07:35:38,323][52670] DAMAGECOUNT value on done: 876378.0 [2024-08-06 07:35:38,324][52670] Sum rewards: 75.147, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.776', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.140', 'weapon4': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '65.000'} [2024-08-06 07:35:38,829][52666] DAMAGECOUNT value on done: 875116.0 [2024-08-06 07:35:38,831][52666] Sum rewards: 74.817, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.303', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.164', 'weapon2': '0.642', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:38,843][52665] DAMAGECOUNT value on done: 871200.0 [2024-08-06 07:35:38,843][52665] Sum rewards: 83.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.778', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon2': '0.172', 'AMMO3': '0.175', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.216', 'WEAPON3': '1.100', 'weapon3': '3.284', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '66.000'} [2024-08-06 07:35:39,386][52649] DAMAGECOUNT value on done: 850143.0 [2024-08-06 07:35:39,386][52649] Sum rewards: 83.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.302', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.218', 'weapon2': '0.670', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '69.000'} [2024-08-06 07:35:39,653][52664] DAMAGECOUNT value on done: 927509.0 [2024-08-06 07:35:39,654][52664] Sum rewards: 74.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.914', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.159', 'weapon5': '0.164', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:40,611][52670] DAMAGECOUNT value on done: 857787.0 [2024-08-06 07:35:40,612][52670] Sum rewards: 78.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.124', 'AMMO4': '0.141', 'AMMO3': '0.195', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '65.000'} [2024-08-06 07:35:40,869][52811] DAMAGECOUNT value on done: 832927.0 [2024-08-06 07:35:40,869][52811] Sum rewards: 76.903, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.036', 'AMMO4': '0.062', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:41,455][52666] DAMAGECOUNT value on done: 868494.0 [2024-08-06 07:35:41,456][52666] Sum rewards: 69.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.455', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.154', 'weapon4': '0.162', 'AMMO3': '0.209', 'AMMO4': '0.269', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.552', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 07:35:41,617][52650] Updated weights for policy 0, policy_version 77681 (0.0021) [2024-08-06 07:35:42,129][52665] DAMAGECOUNT value on done: 866727.0 [2024-08-06 07:35:42,137][52665] Sum rewards: 68.067, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.745', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.201', 'weapon2': '0.230', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.150', 'weapon3': '3.328', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:42,599][52664] DAMAGECOUNT value on done: 923268.0 [2024-08-06 07:35:42,603][52664] Sum rewards: 79.328, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.058', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.271', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.003', 'FRAGCOUNT': '66.000'} [2024-08-06 07:35:42,630][52668] DAMAGECOUNT value on done: 883578.0 [2024-08-06 07:35:42,631][52668] Sum rewards: 66.066, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon2': '0.242', 'AMMO3': '0.280', 'WEAPON3': '1.700', 'HITCOUNT': '3.250', 'weapon3': '3.372', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 636370944. Throughput: 0: 4368.0. Samples: 159101920. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:35:42,794][52567] Avg episode reward: [(0, '73.997')] [2024-08-06 07:35:42,998][52649] DAMAGECOUNT value on done: 859665.0 [2024-08-06 07:35:42,998][52649] Sum rewards: 73.472, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.034', 'HEALTH': '0.070', 'AMMO4': '0.117', 'AMMO3': '0.139', 'WEAPON5': '0.150', 'weapon5': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.538', 'WEAPON3': '0.850', 'weapon3': '3.090', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:43,736][52670] DAMAGECOUNT value on done: 873321.0 [2024-08-06 07:35:43,737][52670] Sum rewards: 76.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.265', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.108', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.384', 'weapon2': '0.626', 'WEAPON3': '1.450', 'weapon3': '2.636', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:43,996][52811] DAMAGECOUNT value on done: 826270.0 [2024-08-06 07:35:43,997][52811] Sum rewards: 80.758, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.032', 'AMMO3': '0.130', 'weapon5': '0.136', 'AMMO4': '0.158', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON4': '0.400', 'weapon2': '0.628', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:44,310][52666] DAMAGECOUNT value on done: 875559.0 [2024-08-06 07:35:44,312][52666] Sum rewards: 76.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.956', 'AMMO5': '0.012', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '65.000'} [2024-08-06 07:35:45,185][52668] DAMAGECOUNT value on done: 884882.0 [2024-08-06 07:35:45,187][52668] Sum rewards: 68.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.025', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.092', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.010', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:45,336][52664] DAMAGECOUNT value on done: 921421.0 [2024-08-06 07:35:45,336][52664] Sum rewards: 74.127, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.155', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.152', 'weapon2': '0.554', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:45,523][52665] DAMAGECOUNT value on done: 872286.0 [2024-08-06 07:35:45,524][52665] Sum rewards: 73.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.356', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.204', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:46,274][52649] DAMAGECOUNT value on done: 843256.0 [2024-08-06 07:35:46,276][52649] Sum rewards: 78.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.160', 'weapon4': '0.176', 'AMMO3': '0.190', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '2.962', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '63.500'} [2024-08-06 07:35:46,626][52650] Updated weights for policy 0, policy_version 77691 (0.0018) [2024-08-06 07:35:46,995][52811] DAMAGECOUNT value on done: 816053.0 [2024-08-06 07:35:46,995][52811] Sum rewards: 78.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.439', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon2': '0.180', 'AMMO4': '0.200', 'weapon5': '0.264', 'AMMO3': '0.283', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.170', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '67.000'} [2024-08-06 07:35:47,159][52670] DAMAGECOUNT value on done: 877893.0 [2024-08-06 07:35:47,159][52670] Sum rewards: 75.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.543', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon5': '0.168', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:47,687][52666] DAMAGECOUNT value on done: 859576.0 [2024-08-06 07:35:47,688][52666] Sum rewards: 76.323, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.044', 'weapon5': '0.132', 'AMMO4': '0.189', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.600', 'weapon3': '3.232', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:47,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 636461056. Throughput: 0: 4371.3. Samples: 159115190. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:35:47,795][52567] Avg episode reward: [(0, '74.130')] [2024-08-06 07:35:47,862][52668] DAMAGECOUNT value on done: 879991.0 [2024-08-06 07:35:47,864][52668] Sum rewards: 68.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.154', 'AMMO3': '0.210', 'weapon5': '0.214', 'AMMO4': '0.235', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 07:35:47,978][52664] DAMAGECOUNT value on done: 905503.0 [2024-08-06 07:35:47,979][52664] Sum rewards: 77.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.155', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.124', 'weapon5': '0.136', 'AMMO3': '0.207', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.346', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:48,699][52665] DAMAGECOUNT value on done: 864742.0 [2024-08-06 07:35:48,699][52665] Sum rewards: 81.727, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.012', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.268', 'weapon2': '0.460', 'WEAPON3': '1.700', 'weapon3': '3.238', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '70.000'} [2024-08-06 07:35:49,633][52649] DAMAGECOUNT value on done: 864812.0 [2024-08-06 07:35:49,634][52649] Sum rewards: 71.422, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.456', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '58.000'} [2024-08-06 07:35:49,730][52670] DAMAGECOUNT value on done: 870925.0 [2024-08-06 07:35:49,733][52670] Sum rewards: 60.565, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.930', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.132', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.268', 'WEAPON3': '1.650', 'HITCOUNT': '3.020', 'weapon3': '3.406', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2024-08-06 07:35:50,099][52666] DAMAGECOUNT value on done: 879446.0 [2024-08-06 07:35:50,100][52666] Sum rewards: 81.846, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.330', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.124', 'AMMO4': '0.133', 'AMMO3': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.740', 'WEAPON3': '1.000', 'weapon3': '2.942', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:50,138][52811] DAMAGECOUNT value on done: 824459.0 [2024-08-06 07:35:50,139][52811] Sum rewards: 70.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.466', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO4': '0.126', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.216', 'weapon4': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2024-08-06 07:35:50,497][52668] DAMAGECOUNT value on done: 884589.0 [2024-08-06 07:35:50,499][52668] Sum rewards: 68.273, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.011', 'AMMO2': '0.013', 'weapon4': '0.036', 'weapon5': '0.062', 'AMMO4': '0.064', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.370', 'WEAPON3': '1.650', 'weapon3': '3.270', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:50,690][52664] DAMAGECOUNT value on done: 910188.0 [2024-08-06 07:35:50,691][52664] Sum rewards: 67.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.426', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.128', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.150', 'weapon3': '3.366', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '58.500'} [2024-08-06 07:35:51,487][52670] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 07:35:51,533][52650] Updated weights for policy 0, policy_version 77701 (0.0028) [2024-08-06 07:35:51,875][52665] DAMAGECOUNT value on done: 870840.0 [2024-08-06 07:35:51,876][52665] Sum rewards: 73.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.057', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.134', 'AMMO4': '0.145', 'AMMO3': '0.239', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:52,427][52649] DAMAGECOUNT value on done: 864138.0 [2024-08-06 07:35:52,429][52649] Sum rewards: 72.622, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.148', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon2': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.242', 'AMMO3': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '62.500'} [2024-08-06 07:35:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 636551168. Throughput: 0: 4367.1. Samples: 159141240. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:35:52,795][52567] Avg episode reward: [(0, '73.781')] [2024-08-06 07:35:52,877][52670] DAMAGECOUNT value on done: 854073.0 [2024-08-06 07:35:52,880][52670] Sum rewards: 81.777, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.935', 'AMMO5': '0.007', 'AMMO2': '0.033', 'AMMO3': '0.143', 'weapon5': '0.154', 'AMMO4': '0.163', 'weapon2': '0.242', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.102', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:53,306][52666] DAMAGECOUNT value on done: 875002.0 [2024-08-06 07:35:53,306][52666] Sum rewards: 71.229, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.384', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.096', 'AMMO4': '0.100', 'AMMO3': '0.124', 'weapon4': '0.136', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.584', 'WEAPON3': '0.800', 'weapon3': '2.986', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '54.500'} [2024-08-06 07:35:53,356][52811] DAMAGECOUNT value on done: 821518.0 [2024-08-06 07:35:53,356][52811] Sum rewards: 76.192, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.815', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.107', 'weapon5': '0.120', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:53,467][52664] DAMAGECOUNT value on done: 915069.0 [2024-08-06 07:35:53,467][52664] Sum rewards: 65.409, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.955', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.064', 'weapon5': '0.250', 'weapon2': '0.270', 'AMMO4': '0.275', 'AMMO3': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '2.000', 'weapon3': '3.028', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '60.000'} [2024-08-06 07:35:53,642][52668] DAMAGECOUNT value on done: 872583.0 [2024-08-06 07:35:53,643][52668] Sum rewards: 80.392, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.232', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.077', 'weapon4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '65.000'} [2024-08-06 07:35:54,875][52665] DAMAGECOUNT value on done: 871259.0 [2024-08-06 07:35:54,875][52665] Sum rewards: 75.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.024', 'AMMO2': '0.077', 'weapon5': '0.220', 'AMMO3': '0.238', 'weapon4': '0.286', 'weapon2': '0.304', 'AMMO4': '0.385', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.854', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:55,245][52670] DAMAGECOUNT value on done: 868596.0 [2024-08-06 07:35:55,247][52670] Sum rewards: 78.742, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.778', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.128', 'weapon5': '0.208', 'AMMO4': '0.214', 'weapon2': '0.232', 'AMMO3': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.164', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:55,359][52649] DAMAGECOUNT value on done: 856474.0 [2024-08-06 07:35:55,360][52649] Sum rewards: 71.571, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.644', 'AMMO5': '0.015', 'weapon4': '0.052', 'AMMO2': '0.055', 'weapon5': '0.126', 'weapon2': '0.226', 'AMMO3': '0.259', 'AMMO4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:55,817][52650] Updated weights for policy 0, policy_version 77711 (0.0014) [2024-08-06 07:35:55,904][52666] DAMAGECOUNT value on done: 872279.0 [2024-08-06 07:35:55,908][52666] Sum rewards: 73.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.818', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.030', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.784', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 07:35:56,480][52811] DAMAGECOUNT value on done: 825951.0 [2024-08-06 07:35:56,483][52811] Sum rewards: 74.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.248', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.166', 'weapon4': '0.188', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.022', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '63.000'} [2024-08-06 07:35:56,506][52668] DAMAGECOUNT value on done: 881409.0 [2024-08-06 07:35:56,508][52668] Sum rewards: 86.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.904', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.040', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.428', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '71.000'} [2024-08-06 07:35:56,666][52664] DAMAGECOUNT value on done: 905874.0 [2024-08-06 07:35:56,667][52664] Sum rewards: 74.624, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.653', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.128', 'weapon5': '0.168', 'AMMO3': '0.208', 'AMMO4': '0.214', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 07:35:57,705][52665] DAMAGECOUNT value on done: 861664.0 [2024-08-06 07:35:57,714][52665] Sum rewards: 74.647, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.152', 'AMMO3': '0.272', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:57,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 636641280. Throughput: 0: 4366.9. Samples: 159167430. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:35:57,795][52567] Avg episode reward: [(0, '74.201')] [2024-08-06 07:35:58,115][52662] DAMAGECOUNT value on done: 877717.0 [2024-08-06 07:35:58,115][52662] Sum rewards: 76.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.092', 'AMMO4': '0.148', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '64.000'} [2024-08-06 07:35:58,411][52670] DAMAGECOUNT value on done: 878029.0 [2024-08-06 07:35:58,413][52670] Sum rewards: 74.569, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.855', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.130', 'weapon4': '0.132', 'AMMO3': '0.177', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '61.000'} [2024-08-06 07:35:58,995][52666] DAMAGECOUNT value on done: 866098.0 [2024-08-06 07:35:58,995][52666] Sum rewards: 81.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.764', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.182', 'weapon4': '0.212', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '68.000'} [2024-08-06 07:35:59,198][52668] DAMAGECOUNT value on done: 883177.0 [2024-08-06 07:35:59,200][52668] Sum rewards: 63.242, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.250', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.133', 'WEAPON5': '0.150', 'weapon2': '0.166', 'weapon4': '0.218', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.276', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '57.000'} [2024-08-06 07:35:59,461][52811] DAMAGECOUNT value on done: 831938.0 [2024-08-06 07:35:59,462][52811] Sum rewards: 74.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.062', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:00,537][52650] Updated weights for policy 0, policy_version 77721 (0.0017) [2024-08-06 07:36:00,615][52665] DAMAGECOUNT value on done: 865476.0 [2024-08-06 07:36:00,617][52665] Sum rewards: 56.917, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.314', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.136', 'weapon5': '0.168', 'AMMO4': '0.169', 'AMMO3': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.138', 'FRAGCOUNT': '49.000'} [2024-08-06 07:36:00,692][52662] DAMAGECOUNT value on done: 888008.0 [2024-08-06 07:36:00,693][52662] Sum rewards: 67.549, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.548', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.140', 'AMMO3': '0.149', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.272', 'weapon4': '0.372', 'WEAPON3': '1.000', 'weapon3': '3.034', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2024-08-06 07:36:01,574][52670] DAMAGECOUNT value on done: 870987.0 [2024-08-06 07:36:01,578][52670] Sum rewards: 78.827, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.610', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.364', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '67.000'} [2024-08-06 07:36:01,899][52668] DAMAGECOUNT value on done: 871646.0 [2024-08-06 07:36:01,899][52668] Sum rewards: 71.956, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.053', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.160', 'AMMO4': '0.184', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:02,271][52666] DAMAGECOUNT value on done: 866527.0 [2024-08-06 07:36:02,273][52666] Sum rewards: 64.182, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.600', 'weapon3': '2.830', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '57.000'} [2024-08-06 07:36:02,764][52811] DAMAGECOUNT value on done: 822758.0 [2024-08-06 07:36:02,771][52811] Sum rewards: 71.379, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.965', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon5': '0.022', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.206', 'weapon2': '0.484', 'WEAPON3': '1.000', 'weapon3': '3.068', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '58.000'} [2024-08-06 07:36:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 636723200. Throughput: 0: 4368.9. Samples: 159180580. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:36:02,795][52567] Avg episode reward: [(0, '73.996')] [2024-08-06 07:36:03,124][52662] DAMAGECOUNT value on done: 887462.0 [2024-08-06 07:36:03,124][52662] Sum rewards: 69.675, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.092', 'AMMO3': '0.182', 'AMMO4': '0.203', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:03,576][52665] DAMAGECOUNT value on done: 872036.0 [2024-08-06 07:36:03,577][52665] Sum rewards: 69.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.107', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.076', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.294', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.398', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:04,542][52668] DAMAGECOUNT value on done: 875083.0 [2024-08-06 07:36:04,543][52668] Sum rewards: 75.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.186', 'weapon4': '0.236', 'WEAPON3': '1.050', 'weapon3': '3.352', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:04,763][52670] DAMAGECOUNT value on done: 873512.0 [2024-08-06 07:36:04,763][52670] Sum rewards: 80.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.402', 'AMMO5': '0.008', 'weapon4': '0.050', 'AMMO2': '0.051', 'weapon5': '0.124', 'AMMO4': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.322', 'weapon2': '0.322', 'WEAPON3': '1.900', 'weapon3': '3.198', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '69.000'} [2024-08-06 07:36:05,284][52650] Updated weights for policy 0, policy_version 77731 (0.0011) [2024-08-06 07:36:05,424][52666] DAMAGECOUNT value on done: 883969.0 [2024-08-06 07:36:05,425][52666] Sum rewards: 83.593, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.468', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.146', 'weapon5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '70.000'} [2024-08-06 07:36:05,938][52811] DAMAGECOUNT value on done: 820891.0 [2024-08-06 07:36:05,939][52811] Sum rewards: 66.274, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.652', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.108', 'AMMO4': '0.110', 'weapon4': '0.118', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.256', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '57.000'} [2024-08-06 07:36:06,400][52662] DAMAGECOUNT value on done: 874444.0 [2024-08-06 07:36:06,401][52662] Sum rewards: 82.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon2': '0.190', 'weapon5': '0.198', 'AMMO3': '0.212', 'AMMO4': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '69.000'} [2024-08-06 07:36:07,363][52668] DAMAGECOUNT value on done: 884166.0 [2024-08-06 07:36:07,364][52668] Sum rewards: 79.454, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.285', 'AMMO5': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.136', 'weapon5': '0.156', 'AMMO4': '0.179', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '61.000'} [2024-08-06 07:36:07,665][52667] DAMAGECOUNT value on done: 878202.0 [2024-08-06 07:36:07,667][52667] Sum rewards: 68.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.216', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON4': '0.050', 'weapon4': '0.224', 'AMMO3': '0.228', 'weapon2': '0.254', 'ARMOR': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.320', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:07,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 636805120. Throughput: 0: 4365.6. Samples: 159206780. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:36:07,795][52567] Avg episode reward: [(0, '73.556')] [2024-08-06 07:36:07,996][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:36:08,401][52666] DAMAGECOUNT value on done: 859057.0 [2024-08-06 07:36:08,401][52666] Sum rewards: 57.641, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.399', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.154', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon4': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '49.000'} [2024-08-06 07:36:09,030][52811] DAMAGECOUNT value on done: 819498.0 [2024-08-06 07:36:09,032][52811] Sum rewards: 71.413, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.190', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.064', 'weapon5': '0.134', 'weapon2': '0.152', 'AMMO3': '0.216', 'AMMO4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.442', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '61.000'} [2024-08-06 07:36:09,503][52662] DAMAGECOUNT value on done: 891636.0 [2024-08-06 07:36:09,506][52662] Sum rewards: 73.171, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.186', 'HEALTH': '0.260', 'weapon2': '0.304', 'WEAPON3': '1.000', 'weapon3': '3.168', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:09,668][52668] DAMAGECOUNT value on done: 874919.0 [2024-08-06 07:36:09,670][52668] Sum rewards: 74.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.260', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.185', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.650', 'weapon3': '3.226', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:10,066][52650] Updated weights for policy 0, policy_version 77741 (0.0019) [2024-08-06 07:36:10,749][52667] DAMAGECOUNT value on done: 890460.0 [2024-08-06 07:36:10,749][52667] Sum rewards: 71.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.022', 'weapon5': '0.050', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.342', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.356', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:10,875][52666] DAMAGECOUNT value on done: 867137.0 [2024-08-06 07:36:10,875][52666] Sum rewards: 79.315, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.096', 'AMMO4': '0.133', 'AMMO3': '0.146', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '0.950', 'weapon3': '3.138', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:11,660][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:36:12,133][52811] DAMAGECOUNT value on done: 821839.0 [2024-08-06 07:36:12,136][52811] Sum rewards: 70.962, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.640', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO4': '0.209', 'AMMO3': '0.224', 'weapon2': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.972', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:12,215][52668] DAMAGECOUNT value on done: 870831.0 [2024-08-06 07:36:12,215][52668] Sum rewards: 65.402, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.038', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.174', 'weapon5': '0.184', 'weapon2': '0.206', 'AMMO3': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'HITCOUNT': '3.240', 'weapon3': '3.256', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 636895232. Throughput: 0: 4374.7. Samples: 159233130. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:36:12,802][52567] Avg episode reward: [(0, '73.421')] [2024-08-06 07:36:12,930][52662] DAMAGECOUNT value on done: 870221.0 [2024-08-06 07:36:12,932][52662] Sum rewards: 76.128, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.008', 'AMMO4': '0.033', 'weapon4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '64.000'} [2024-08-06 07:36:13,490][52667] DAMAGECOUNT value on done: 887015.0 [2024-08-06 07:36:13,490][52667] Sum rewards: 78.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.164', 'AMMO4': '0.181', 'weapon5': '0.224', 'weapon4': '0.256', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:14,548][52650] Updated weights for policy 0, policy_version 77751 (0.0020) [2024-08-06 07:36:15,080][52811] DAMAGECOUNT value on done: 828153.0 [2024-08-06 07:36:15,084][52811] Sum rewards: 84.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.926', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.180', 'AMMO3': '0.182', 'WEAPON3': '1.150', 'weapon3': '3.570', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '68.000'} [2024-08-06 07:36:15,138][52668] DAMAGECOUNT value on done: 868712.0 [2024-08-06 07:36:15,140][52668] Sum rewards: 75.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.388', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:15,841][52662] DAMAGECOUNT value on done: 877328.0 [2024-08-06 07:36:15,843][52662] Sum rewards: 82.840, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon5': '0.204', 'weapon2': '0.370', 'HEALTH': '0.644', 'WEAPON3': '0.950', 'weapon3': '3.270', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '64.000'} [2024-08-06 07:36:16,101][52667] DAMAGECOUNT value on done: 890187.0 [2024-08-06 07:36:16,102][52667] Sum rewards: 86.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.054', 'AMMO4': '0.086', 'weapon5': '0.090', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '70.000'} [2024-08-06 07:36:17,183][52803] DAMAGECOUNT value on done: 818312.0 [2024-08-06 07:36:17,184][52803] Sum rewards: 68.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.505', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.200', 'weapon4': '0.208', 'AMMO4': '0.249', 'weapon5': '0.304', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 636985344. Throughput: 0: 4372.2. Samples: 159246270. Policy #0 lag: (min: 0.0, avg: 4.0, max: 7.0) [2024-08-06 07:36:17,795][52567] Avg episode reward: [(0, '73.767')] [2024-08-06 07:36:18,296][52811] DAMAGECOUNT value on done: 831368.0 [2024-08-06 07:36:18,296][52811] Sum rewards: 65.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.250', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.192', 'weapon4': '0.196', 'weapon5': '0.218', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '53.000'} [2024-08-06 07:36:18,320][52668] DAMAGECOUNT value on done: 869013.0 [2024-08-06 07:36:18,320][52668] Sum rewards: 71.374, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.054', 'AMMO3': '0.134', 'AMMO4': '0.170', 'weapon5': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon2': '0.862', 'weapon3': '2.680', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:18,698][52662] DAMAGECOUNT value on done: 895059.0 [2024-08-06 07:36:18,698][52662] Sum rewards: 77.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.182', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.126', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '66.000'} [2024-08-06 07:36:18,737][52667] DAMAGECOUNT value on done: 894137.0 [2024-08-06 07:36:18,737][52667] Sum rewards: 74.381, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.060', 'AMMO3': '0.155', 'AMMO4': '0.196', 'WEAPON5': '0.250', 'weapon4': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.420', 'WEAPON3': '0.950', 'weapon3': '3.002', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:19,304][52650] Updated weights for policy 0, policy_version 77761 (0.0013) [2024-08-06 07:36:20,192][52803] DAMAGECOUNT value on done: 815068.0 [2024-08-06 07:36:20,194][52803] Sum rewards: 77.187, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'weapon2': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.396', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '65.000'} [2024-08-06 07:36:21,116][52662] DAMAGECOUNT value on done: 878822.0 [2024-08-06 07:36:21,117][52662] Sum rewards: 66.762, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.985', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.132', 'weapon5': '0.164', 'AMMO4': '0.189', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.074', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2024-08-06 07:36:21,536][52811] DAMAGECOUNT value on done: 817707.0 [2024-08-06 07:36:21,536][52811] Sum rewards: 79.561, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.146', 'weapon5': '0.184', 'AMMO3': '0.245', 'AMMO4': '0.290', 'weapon2': '0.294', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '66.000'} [2024-08-06 07:36:21,542][52668] DAMAGECOUNT value on done: 863533.0 [2024-08-06 07:36:21,542][52668] Sum rewards: 64.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.054', 'weapon5': '0.082', 'AMMO4': '0.092', 'weapon2': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.550', 'HITCOUNT': '2.990', 'weapon3': '3.536', 'DAMAGECOUNT': '15.297', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:21,615][52667] DAMAGECOUNT value on done: 891025.0 [2024-08-06 07:36:21,616][52667] Sum rewards: 56.755, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.078', 'weapon5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON3': '1.050', 'HITCOUNT': '2.940', 'weapon3': '3.342', 'DAMAGECOUNT': '14.718', 'FRAGCOUNT': '45.000'} [2024-08-06 07:36:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 637075456. Throughput: 0: 4371.2. Samples: 159272610. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:22,802][52567] Avg episode reward: [(0, '73.755')] [2024-08-06 07:36:23,277][52803] DAMAGECOUNT value on done: 824251.0 [2024-08-06 07:36:23,277][52803] Sum rewards: 81.904, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.469', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.063', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.282', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '66.000'} [2024-08-06 07:36:23,692][52662] DAMAGECOUNT value on done: 886844.0 [2024-08-06 07:36:23,694][52662] Sum rewards: 71.122, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.755', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.108', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:23,886][52650] Updated weights for policy 0, policy_version 77771 (0.0012) [2024-08-06 07:36:24,550][52667] DAMAGECOUNT value on done: 883964.0 [2024-08-06 07:36:24,550][52667] Sum rewards: 67.001, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.580', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.086', 'AMMO3': '0.127', 'AMMO4': '0.169', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.788', 'WEAPON3': '0.800', 'weapon3': '2.760', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '51.000'} [2024-08-06 07:36:24,592][52668] DAMAGECOUNT value on done: 877742.0 [2024-08-06 07:36:24,595][52668] Sum rewards: 83.463, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'weapon4': '0.026', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.265', 'weapon2': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.414', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.381', 'FRAGCOUNT': '70.500'} [2024-08-06 07:36:24,823][52811] DAMAGECOUNT value on done: 817946.0 [2024-08-06 07:36:24,824][52811] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.102', 'weapon4': '0.146', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'AMMO3': '0.287', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.700', 'weapon3': '3.082', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '61.500'} [2024-08-06 07:36:26,397][52662] DAMAGECOUNT value on done: 878338.0 [2024-08-06 07:36:26,397][52662] Sum rewards: 76.385, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.625', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.108', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'weapon2': '0.332', 'WEAPON3': '1.650', 'weapon3': '3.208', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 07:36:26,429][52803] DAMAGECOUNT value on done: 822349.0 [2024-08-06 07:36:26,432][52803] Sum rewards: 57.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.482', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.136', 'AMMO3': '0.175', 'AMMO4': '0.208', 'weapon5': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.880', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '46.000'} [2024-08-06 07:36:27,256][52668] DAMAGECOUNT value on done: 879412.0 [2024-08-06 07:36:27,256][52668] Sum rewards: 69.171, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.132', 'AMMO3': '0.198', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:27,642][52667] DAMAGECOUNT value on done: 883265.0 [2024-08-06 07:36:27,644][52667] Sum rewards: 71.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.790', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.024', 'weapon5': '0.076', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.254', 'AMMO3': '0.263', 'WEAPON3': '1.750', 'weapon3': '3.410', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 637157376. Throughput: 0: 4372.9. Samples: 159298700. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:27,795][52567] Avg episode reward: [(0, '73.606')] [2024-08-06 07:36:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077778_637157376.pth... [2024-08-06 07:36:27,954][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077267_632971264.pth [2024-08-06 07:36:28,547][52650] Updated weights for policy 0, policy_version 77781 (0.0029) [2024-08-06 07:36:29,017][52660] DAMAGECOUNT value on done: 876113.0 [2024-08-06 07:36:29,017][52660] Sum rewards: 81.931, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.048', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.045', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '68.000'} [2024-08-06 07:36:29,661][52803] DAMAGECOUNT value on done: 819208.0 [2024-08-06 07:36:29,663][52803] Sum rewards: 69.618, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.744', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.108', 'AMMO3': '0.165', 'weapon5': '0.186', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:29,813][52662] DAMAGECOUNT value on done: 879043.0 [2024-08-06 07:36:29,813][52662] Sum rewards: 68.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.411', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.134', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.247', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '58.000'} [2024-08-06 07:36:30,130][52668] DAMAGECOUNT value on done: 878413.0 [2024-08-06 07:36:30,132][52668] Sum rewards: 84.487, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.340', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.176', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '3.274', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '67.000'} [2024-08-06 07:36:30,144][52667] DAMAGECOUNT value on done: 883378.0 [2024-08-06 07:36:30,146][52667] Sum rewards: 73.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.428', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.090', 'AMMO4': '0.122', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.218', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:31,987][52660] DAMAGECOUNT value on done: 868802.0 [2024-08-06 07:36:31,989][52660] Sum rewards: 75.645, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.158', 'weapon5': '0.168', 'AMMO4': '0.210', 'weapon2': '0.232', 'WEAPON5': '0.450', 'weapon4': '0.524', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.780', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '60.500'} [2024-08-06 07:36:32,291][52662] DAMAGECOUNT value on done: 872261.0 [2024-08-06 07:36:32,294][52662] Sum rewards: 86.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.372', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.046', 'AMMO4': '0.102', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.150', 'weapon3': '3.532', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.087', 'FRAGCOUNT': '70.000'} [2024-08-06 07:36:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 637247488. Throughput: 0: 4364.7. Samples: 159311600. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:32,794][52567] Avg episode reward: [(0, '73.654')] [2024-08-06 07:36:32,844][52667] DAMAGECOUNT value on done: 890633.0 [2024-08-06 07:36:32,845][52667] Sum rewards: 66.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.208', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.260', 'weapon2': '0.310', 'WEAPON3': '1.500', 'HITCOUNT': '3.290', 'weapon3': '3.468', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '57.000'} [2024-08-06 07:36:32,915][52803] DAMAGECOUNT value on done: 819955.0 [2024-08-06 07:36:32,916][52803] Sum rewards: 80.765, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.635', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.024', 'weapon5': '0.070', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.272', 'WEAPON3': '1.700', 'weapon3': '3.558', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '70.000'} [2024-08-06 07:36:33,112][52668] DAMAGECOUNT value on done: 882627.0 [2024-08-06 07:36:33,113][52668] Sum rewards: 68.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.418', 'WEAPON3': '1.300', 'HITCOUNT': '3.220', 'weapon3': '3.274', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '57.000'} [2024-08-06 07:36:33,934][52650] Updated weights for policy 0, policy_version 77791 (0.0030) [2024-08-06 07:36:34,024][52614] Signal inference workers to stop experience collection... (14250 times) [2024-08-06 07:36:34,031][52614] Signal inference workers to resume experience collection... (14250 times) [2024-08-06 07:36:34,098][52650] InferenceWorker_p0-w0: stopping experience collection (14250 times) [2024-08-06 07:36:34,098][52650] InferenceWorker_p0-w0: resuming experience collection (14250 times) [2024-08-06 07:36:34,977][52660] DAMAGECOUNT value on done: 878756.0 [2024-08-06 07:36:34,979][52660] Sum rewards: 67.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.734', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.130', 'AMMO4': '0.175', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.268', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:35,335][52662] DAMAGECOUNT value on done: 883476.0 [2024-08-06 07:36:35,335][52662] Sum rewards: 81.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.404', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.044', 'weapon4': '0.054', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '69.000'} [2024-08-06 07:36:35,637][52667] DAMAGECOUNT value on done: 877694.0 [2024-08-06 07:36:35,637][52667] Sum rewards: 63.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.180', 'weapon4': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.220', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.350', 'HITCOUNT': '2.940', 'weapon3': '2.948', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '52.000'} [2024-08-06 07:36:36,032][52820] DAMAGECOUNT value on done: 814738.0 [2024-08-06 07:36:36,036][52820] Sum rewards: 79.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.098', 'AMMO5': '0.009', 'weapon4': '0.044', 'AMMO2': '0.045', 'weapon5': '0.116', 'weapon2': '0.160', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.440', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '68.000'} [2024-08-06 07:36:36,164][52803] DAMAGECOUNT value on done: 814041.0 [2024-08-06 07:36:36,164][52803] Sum rewards: 72.450, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.138', 'weapon4': '0.164', 'AMMO4': '0.179', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '58.000'} [2024-08-06 07:36:36,184][52668] DAMAGECOUNT value on done: 883896.0 [2024-08-06 07:36:36,186][52668] Sum rewards: 75.176, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.232', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.162', 'AMMO3': '0.219', 'weapon4': '0.230', 'AMMO4': '0.269', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.698', 'WEAPON3': '1.350', 'weapon3': '2.586', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:37,712][52660] DAMAGECOUNT value on done: 891099.0 [2024-08-06 07:36:37,715][52660] Sum rewards: 64.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.549', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.090', 'AMMO3': '0.213', 'weapon5': '0.218', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '53.000'} [2024-08-06 07:36:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 637337600. Throughput: 0: 4367.3. Samples: 159337770. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:37,794][52567] Avg episode reward: [(0, '73.495')] [2024-08-06 07:36:38,053][52650] Updated weights for policy 0, policy_version 77801 (0.0030) [2024-08-06 07:36:38,348][52667] DAMAGECOUNT value on done: 881073.0 [2024-08-06 07:36:38,356][52667] Sum rewards: 76.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.114', 'AMMO3': '0.205', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:38,528][52662] DAMAGECOUNT value on done: 872096.0 [2024-08-06 07:36:38,528][52662] Sum rewards: 78.972, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.194', 'AMMO2': '0.003', 'AMMO5': '0.005', 'AMMO4': '0.013', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '64.000'} [2024-08-06 07:36:39,163][52820] DAMAGECOUNT value on done: 814853.0 [2024-08-06 07:36:39,163][52820] Sum rewards: 60.852, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.572', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon4': '0.118', 'weapon5': '0.148', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '49.000'} [2024-08-06 07:36:39,187][52803] DAMAGECOUNT value on done: 814422.0 [2024-08-06 07:36:39,188][52803] Sum rewards: 72.024, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.731', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.143', 'AMMO3': '0.178', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '57.000'} [2024-08-06 07:36:40,896][52660] DAMAGECOUNT value on done: 872889.0 [2024-08-06 07:36:40,898][52660] Sum rewards: 68.928, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.164', 'AMMO4': '0.207', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:41,045][52667] DAMAGECOUNT value on done: 891309.0 [2024-08-06 07:36:41,046][52667] Sum rewards: 77.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.182', 'AMMO3': '0.233', 'weapon4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.928', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:41,082][52662] DAMAGECOUNT value on done: 891132.0 [2024-08-06 07:36:41,083][52662] Sum rewards: 80.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.213', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.176', 'AMMO3': '0.202', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '65.000'} [2024-08-06 07:36:42,261][52803] DAMAGECOUNT value on done: 821244.0 [2024-08-06 07:36:42,263][52803] Sum rewards: 75.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon4': '0.292', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:42,319][52820] DAMAGECOUNT value on done: 814634.0 [2024-08-06 07:36:42,320][52820] Sum rewards: 65.645, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.420', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.132', 'AMMO4': '0.192', 'weapon5': '0.194', 'AMMO3': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.068', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:42,665][52659] DAMAGECOUNT value on done: 883538.0 [2024-08-06 07:36:42,667][52659] Sum rewards: 79.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.741', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.108', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '64.000'} [2024-08-06 07:36:42,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 637419520. Throughput: 0: 4362.7. Samples: 159363750. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:42,795][52567] Avg episode reward: [(0, '73.297')] [2024-08-06 07:36:42,877][52650] Updated weights for policy 0, policy_version 77811 (0.0021) [2024-08-06 07:36:43,746][52660] DAMAGECOUNT value on done: 871860.0 [2024-08-06 07:36:43,747][52660] Sum rewards: 59.198, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.335', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon7': '0.110', 'AMMO4': '0.147', 'weapon5': '0.230', 'weapon2': '0.232', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.022', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '52.000'} [2024-08-06 07:36:43,900][52667] DAMAGECOUNT value on done: 882021.0 [2024-08-06 07:36:43,901][52667] Sum rewards: 94.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.262', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon4': '0.118', 'weapon5': '0.132', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '22.233', 'FRAGCOUNT': '74.000'} [2024-08-06 07:36:43,942][52662] DAMAGECOUNT value on done: 882728.0 [2024-08-06 07:36:43,943][52662] Sum rewards: 67.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.675', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.098', 'weapon2': '0.156', 'AMMO3': '0.209', 'weapon5': '0.214', 'AMMO4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.910', 'weapon3': '3.314', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '56.000'} [2024-08-06 07:36:45,238][52803] DAMAGECOUNT value on done: 814759.0 [2024-08-06 07:36:45,239][52803] Sum rewards: 78.555, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.138', 'weapon4': '0.156', 'AMMO3': '0.190', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '64.000'} [2024-08-06 07:36:45,336][52659] DAMAGECOUNT value on done: 879160.0 [2024-08-06 07:36:45,336][52659] Sum rewards: 76.433, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.444', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.133', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.222', 'weapon2': '0.512', 'WEAPON3': '0.800', 'weapon3': '2.886', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:45,345][52820] DAMAGECOUNT value on done: 803783.0 [2024-08-06 07:36:45,346][52820] Sum rewards: 81.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.765', 'AMMO5': '0.007', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon4': '0.324', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '65.500'} [2024-08-06 07:36:46,417][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:36:46,535][52662] DAMAGECOUNT value on done: 871662.0 [2024-08-06 07:36:46,535][52662] Sum rewards: 87.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.521', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.028', 'AMMO4': '0.103', 'weapon5': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.306', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '71.500'} [2024-08-06 07:36:46,850][52660] DAMAGECOUNT value on done: 878977.0 [2024-08-06 07:36:46,851][52660] Sum rewards: 74.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.365', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.158', 'AMMO4': '0.179', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '3.018', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:46,932][52667] DAMAGECOUNT value on done: 886678.0 [2024-08-06 07:36:46,934][52667] Sum rewards: 77.625, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.915', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.038', 'weapon4': '0.140', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 637501440. Throughput: 0: 4359.3. Samples: 159376750. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:47,794][52567] Avg episode reward: [(0, '73.787')] [2024-08-06 07:36:47,971][52650] Updated weights for policy 0, policy_version 77821 (0.0028) [2024-08-06 07:36:48,354][52803] DAMAGECOUNT value on done: 829582.0 [2024-08-06 07:36:48,354][52803] Sum rewards: 79.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.538', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.188', 'AMMO3': '0.201', 'weapon4': '0.206', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.146', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '65.000'} [2024-08-06 07:36:48,414][52659] DAMAGECOUNT value on done: 889019.0 [2024-08-06 07:36:48,415][52659] Sum rewards: 91.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.401', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.098', 'AMMO4': '0.131', 'weapon5': '0.134', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.654', 'FRAGCOUNT': '74.000'} [2024-08-06 07:36:48,602][52820] DAMAGECOUNT value on done: 817214.0 [2024-08-06 07:36:48,602][52820] Sum rewards: 75.895, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.400', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.193', 'AMMO4': '0.201', 'weapon5': '0.230', 'weapon4': '0.242', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:49,493][52660] DAMAGECOUNT value on done: 886303.0 [2024-08-06 07:36:49,494][52660] Sum rewards: 88.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.640', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.270', 'FRAGCOUNT': '72.000'} [2024-08-06 07:36:49,741][52662] DAMAGECOUNT value on done: 878638.0 [2024-08-06 07:36:49,742][52662] Sum rewards: 72.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'weapon4': '0.038', 'AMMO2': '0.043', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'AMMO4': '0.215', 'weapon2': '0.830', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '59.000'} [2024-08-06 07:36:49,760][52667] DAMAGECOUNT value on done: 892614.0 [2024-08-06 07:36:49,761][52667] Sum rewards: 73.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.196', 'AMMO3': '0.216', 'weapon2': '0.222', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:50,206][52795] DAMAGECOUNT value on done: 815304.0 [2024-08-06 07:36:50,206][52795] Sum rewards: 73.655, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.270', 'weapon3': '3.454', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:50,929][52659] DAMAGECOUNT value on done: 881587.0 [2024-08-06 07:36:50,929][52659] Sum rewards: 79.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.943', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.098', 'weapon5': '0.106', 'AMMO4': '0.167', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '65.000'} [2024-08-06 07:36:51,488][52803] DAMAGECOUNT value on done: 822936.0 [2024-08-06 07:36:51,489][52803] Sum rewards: 68.076, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.330', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.150', 'weapon4': '0.156', 'AMMO4': '0.194', 'AMMO3': '0.241', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.162', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '58.000'} [2024-08-06 07:36:51,529][52820] DAMAGECOUNT value on done: 803406.0 [2024-08-06 07:36:51,529][52820] Sum rewards: 80.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '66.000'} [2024-08-06 07:36:52,191][52650] Updated weights for policy 0, policy_version 77831 (0.0012) [2024-08-06 07:36:52,268][52660] DAMAGECOUNT value on done: 874545.0 [2024-08-06 07:36:52,269][52660] Sum rewards: 93.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.968', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.219', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '22.014', 'FRAGCOUNT': '75.500'} [2024-08-06 07:36:52,645][52662] DAMAGECOUNT value on done: 871549.0 [2024-08-06 07:36:52,645][52662] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.092', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.221', 'weapon2': '0.560', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:52,777][52667] DAMAGECOUNT value on done: 895363.0 [2024-08-06 07:36:52,778][52667] Sum rewards: 78.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.285', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO3': '0.202', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:52,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 637599744. Throughput: 0: 4356.2. Samples: 159402810. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:52,795][52567] Avg episode reward: [(0, '74.198')] [2024-08-06 07:36:53,526][52795] DAMAGECOUNT value on done: 802160.0 [2024-08-06 07:36:53,527][52795] Sum rewards: 82.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.025', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.074', 'weapon5': '0.086', 'AMMO4': '0.123', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.222', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '66.000'} [2024-08-06 07:36:54,086][52659] DAMAGECOUNT value on done: 878175.0 [2024-08-06 07:36:54,087][52659] Sum rewards: 70.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.286', 'WEAPON3': '1.250', 'HITCOUNT': '3.310', 'weapon3': '3.524', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '60.000'} [2024-08-06 07:36:54,662][52803] DAMAGECOUNT value on done: 817163.0 [2024-08-06 07:36:54,663][52803] Sum rewards: 81.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.615', 'AMMO2': '0.034', 'WEAPON4': '0.050', 'weapon4': '0.110', 'AMMO4': '0.170', 'AMMO3': '0.241', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '67.000'} [2024-08-06 07:36:54,711][52820] DAMAGECOUNT value on done: 809463.0 [2024-08-06 07:36:54,712][52820] Sum rewards: 79.251, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.086', 'AMMO4': '0.144', 'weapon5': '0.184', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'HEALTH': '0.855', 'WEAPON3': '1.000', 'weapon3': '2.986', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '63.000'} [2024-08-06 07:36:55,164][52660] DAMAGECOUNT value on done: 869902.0 [2024-08-06 07:36:55,164][52660] Sum rewards: 69.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.389', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon5': '0.192', 'AMMO3': '0.216', 'weapon4': '0.262', 'AMMO4': '0.313', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '58.000'} [2024-08-06 07:36:55,411][52667] DAMAGECOUNT value on done: 888493.0 [2024-08-06 07:36:55,411][52667] Sum rewards: 66.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.265', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.107', 'weapon5': '0.138', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '57.000'} [2024-08-06 07:36:56,586][52795] DAMAGECOUNT value on done: 806797.0 [2024-08-06 07:36:56,588][52795] Sum rewards: 64.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.962', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.170', 'AMMO4': '0.208', 'AMMO3': '0.255', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.090', 'weapon3': '3.132', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '55.000'} [2024-08-06 07:36:56,822][52659] DAMAGECOUNT value on done: 880875.0 [2024-08-06 07:36:56,822][52659] Sum rewards: 75.943, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.332', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.104', 'weapon2': '0.216', 'weapon5': '0.246', 'AMMO4': '0.248', 'AMMO3': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.850', 'weapon3': '3.104', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 07:36:57,029][52650] Updated weights for policy 0, policy_version 77841 (0.0010) [2024-08-06 07:36:57,722][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:36:57,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 637689856. Throughput: 0: 4354.7. Samples: 159429090. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:36:57,795][52567] Avg episode reward: [(0, '74.551')] [2024-08-06 07:36:57,839][52660] DAMAGECOUNT value on done: 879744.0 [2024-08-06 07:36:57,839][52660] Sum rewards: 73.161, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.130', 'weapon4': '0.138', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '61.000'} [2024-08-06 07:36:57,843][52820] DAMAGECOUNT value on done: 812834.0 [2024-08-06 07:36:57,844][52820] Sum rewards: 75.846, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.778', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.182', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '62.000'} [2024-08-06 07:36:57,926][52803] DAMAGECOUNT value on done: 832020.0 [2024-08-06 07:36:57,926][52803] Sum rewards: 67.707, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.022', 'AMMO2': '0.077', 'AMMO3': '0.184', 'weapon4': '0.200', 'weapon5': '0.246', 'AMMO4': '0.385', 'weapon2': '0.442', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.150', 'weapon3': '2.744', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.000'} [2024-08-06 07:36:58,313][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:36:58,591][52667] DAMAGECOUNT value on done: 885013.0 [2024-08-06 07:36:58,592][52667] Sum rewards: 64.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.494', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.140', 'AMMO3': '0.179', 'weapon2': '0.414', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.264', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '53.000'} [2024-08-06 07:36:59,778][52659] DAMAGECOUNT value on done: 883114.0 [2024-08-06 07:36:59,778][52659] Sum rewards: 83.160, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.740', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.150', 'weapon4': '0.210', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '67.000'} [2024-08-06 07:36:59,943][52795] DAMAGECOUNT value on done: 818585.0 [2024-08-06 07:36:59,944][52795] Sum rewards: 66.628, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.774', 'AMMO5': '0.003', 'weapon4': '0.014', 'weapon5': '0.014', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.127', 'AMMO3': '0.238', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.426', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.500'} [2024-08-06 07:37:00,295][52660] DAMAGECOUNT value on done: 871019.0 [2024-08-06 07:37:00,297][52660] Sum rewards: 77.789, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.275', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.080', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.586', 'WEAPON3': '1.050', 'weapon3': '3.124', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '62.000'} [2024-08-06 07:37:00,957][52820] DAMAGECOUNT value on done: 818416.0 [2024-08-06 07:37:00,957][52820] Sum rewards: 73.504, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.426', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:01,057][52803] DAMAGECOUNT value on done: 815653.0 [2024-08-06 07:37:01,059][52803] Sum rewards: 74.783, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.918', 'AMMO5': '0.015', 'AMMO2': '0.060', 'weapon5': '0.118', 'weapon4': '0.220', 'AMMO3': '0.273', 'AMMO4': '0.299', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.026', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:01,783][52667] DAMAGECOUNT value on done: 888900.0 [2024-08-06 07:37:01,785][52667] Sum rewards: 72.700, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.698', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.124', 'weapon4': '0.126', 'AMMO4': '0.152', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:01,905][52650] Updated weights for policy 0, policy_version 77851 (0.0026) [2024-08-06 07:37:02,360][52659] DAMAGECOUNT value on done: 881924.0 [2024-08-06 07:37:02,360][52659] Sum rewards: 71.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.166', 'weapon5': '0.176', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '58.000'} [2024-08-06 07:37:02,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 637779968. Throughput: 0: 4356.5. Samples: 159442310. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 07:37:02,794][52567] Avg episode reward: [(0, '74.518')] [2024-08-06 07:37:02,894][52660] DAMAGECOUNT value on done: 872442.0 [2024-08-06 07:37:02,895][52660] Sum rewards: 83.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.745', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.052', 'weapon5': '0.154', 'AMMO3': '0.254', 'AMMO4': '0.259', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.064', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '69.000'} [2024-08-06 07:37:03,216][52795] DAMAGECOUNT value on done: 804355.0 [2024-08-06 07:37:03,216][52795] Sum rewards: 74.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.186', 'weapon2': '0.188', 'weapon4': '0.188', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:04,054][52820] DAMAGECOUNT value on done: 825298.0 [2024-08-06 07:37:04,057][52820] Sum rewards: 68.063, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.428', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.166', 'AMMO4': '0.196', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.321', 'WEAPON3': '1.650', 'weapon3': '3.182', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '58.000'} [2024-08-06 07:37:04,074][52803] DAMAGECOUNT value on done: 821990.0 [2024-08-06 07:37:04,076][52803] Sum rewards: 86.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.100', 'weapon5': '0.118', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.400', 'weapon3': '3.498', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '72.000'} [2024-08-06 07:37:05,461][52659] DAMAGECOUNT value on done: 880753.0 [2024-08-06 07:37:05,463][52659] Sum rewards: 71.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.176', 'WEAPON3': '1.100', 'HITCOUNT': '3.380', 'weapon3': '3.528', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:05,739][52660] DAMAGECOUNT value on done: 884142.0 [2024-08-06 07:37:05,739][52660] Sum rewards: 70.461, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.522', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.236', 'WEAPON3': '1.150', 'weapon3': '3.408', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.629', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:06,172][52650] Updated weights for policy 0, policy_version 77861 (0.0017) [2024-08-06 07:37:06,368][52795] DAMAGECOUNT value on done: 811997.0 [2024-08-06 07:37:06,370][52795] Sum rewards: 89.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.150', 'weapon5': '0.208', 'AMMO3': '0.213', 'AMMO4': '0.256', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '22.365', 'FRAGCOUNT': '73.000'} [2024-08-06 07:37:06,820][52820] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.582, 194.0), ('weapon5', 0.002)] [2024-08-06 07:37:07,179][52820] DAMAGECOUNT value on done: 807324.0 [2024-08-06 07:37:07,179][52820] Sum rewards: 84.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.920', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon4': '0.194', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.998', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '69.000'} [2024-08-06 07:37:07,236][52803] DAMAGECOUNT value on done: 825731.0 [2024-08-06 07:37:07,236][52803] Sum rewards: 71.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.676', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.060', 'weapon4': '0.092', 'AMMO4': '0.121', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.368', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:07,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 637853696. Throughput: 0: 4354.0. Samples: 159468540. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:07,795][52567] Avg episode reward: [(0, '74.921')] [2024-08-06 07:37:08,396][52660] DAMAGECOUNT value on done: 897115.0 [2024-08-06 07:37:08,399][52660] Sum rewards: 72.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.756', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon4': '0.134', 'weapon5': '0.170', 'AMMO4': '0.266', 'weapon2': '0.272', 'AMMO3': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.130', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '65.000'} [2024-08-06 07:37:08,660][52659] DAMAGECOUNT value on done: 890287.0 [2024-08-06 07:37:08,661][52659] Sum rewards: 60.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.149', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.162', 'AMMO3': '0.222', 'weapon5': '0.222', 'AMMO4': '0.276', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.006', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '51.000'} [2024-08-06 07:37:09,512][52795] DAMAGECOUNT value on done: 821481.0 [2024-08-06 07:37:09,513][52795] Sum rewards: 72.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.930', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.126', 'AMMO3': '0.254', 'AMMO4': '0.296', 'weapon5': '0.304', 'weapon2': '0.346', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.848', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '61.000'} [2024-08-06 07:37:10,195][52820] DAMAGECOUNT value on done: 817575.0 [2024-08-06 07:37:10,195][52820] Sum rewards: 85.907, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.230', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.034', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.372', 'WEAPON3': '1.700', 'weapon3': '3.432', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '73.000'} [2024-08-06 07:37:10,419][52803] DAMAGECOUNT value on done: 830738.0 [2024-08-06 07:37:10,419][52803] Sum rewards: 75.397, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.596', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.118', 'weapon5': '0.252', 'AMMO3': '0.261', 'AMMO4': '0.261', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.024', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '63.500'} [2024-08-06 07:37:11,152][52650] Updated weights for policy 0, policy_version 77871 (0.0012) [2024-08-06 07:37:11,292][52659] DAMAGECOUNT value on done: 875293.0 [2024-08-06 07:37:11,293][52659] Sum rewards: 65.639, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.161', 'weapon4': '0.190', 'weapon2': '0.192', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.332', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '55.000'} [2024-08-06 07:37:11,404][52660] DAMAGECOUNT value on done: 873627.0 [2024-08-06 07:37:11,408][52660] Sum rewards: 80.292, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.842', 'AMMO5': '0.018', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '67.000'} [2024-08-06 07:37:11,896][52649] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:37:12,649][52795] DAMAGECOUNT value on done: 812921.0 [2024-08-06 07:37:12,649][52795] Sum rewards: 69.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.650', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.162', 'AMMO4': '0.183', 'weapon4': '0.188', 'AMMO3': '0.270', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.100', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '58.000'} [2024-08-06 07:37:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 637943808. Throughput: 0: 4364.4. Samples: 159495100. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:12,794][52567] Avg episode reward: [(0, '74.618')] [2024-08-06 07:37:13,295][52820] DAMAGECOUNT value on done: 829702.0 [2024-08-06 07:37:13,296][52820] Sum rewards: 72.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.065', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.044', 'weapon5': '0.084', 'AMMO4': '0.103', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:13,499][52803] DAMAGECOUNT value on done: 828848.0 [2024-08-06 07:37:13,499][52803] Sum rewards: 78.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.216', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.131', 'AMMO3': '0.176', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '3.220', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 07:37:14,124][52659] DAMAGECOUNT value on done: 887473.0 [2024-08-06 07:37:14,125][52659] Sum rewards: 79.008, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.044', 'HEALTH': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.212', 'weapon4': '0.226', 'WEAPON3': '1.100', 'weapon3': '3.292', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:14,362][52660] DAMAGECOUNT value on done: 882505.0 [2024-08-06 07:37:14,362][52660] Sum rewards: 67.476, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.325', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.096', 'weapon5': '0.108', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '54.500'} [2024-08-06 07:37:15,831][52795] DAMAGECOUNT value on done: 817543.0 [2024-08-06 07:37:15,831][52795] Sum rewards: 79.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.222', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.194', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.078', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:15,947][52650] Updated weights for policy 0, policy_version 77881 (0.0027) [2024-08-06 07:37:16,281][52658] DAMAGECOUNT value on done: 881437.0 [2024-08-06 07:37:16,282][52658] Sum rewards: 77.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '65.500'} [2024-08-06 07:37:16,367][52820] DAMAGECOUNT value on done: 819274.0 [2024-08-06 07:37:16,367][52820] Sum rewards: 73.022, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.330', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.110', 'AMMO4': '0.149', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '63.500'} [2024-08-06 07:37:16,522][52659] DAMAGECOUNT value on done: 878669.0 [2024-08-06 07:37:16,522][52659] Sum rewards: 71.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.162', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.466', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:16,670][52803] DAMAGECOUNT value on done: 823502.0 [2024-08-06 07:37:16,671][52803] Sum rewards: 77.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.090', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '65.000'} [2024-08-06 07:37:17,558][52660] DAMAGECOUNT value on done: 879445.0 [2024-08-06 07:37:17,561][52660] Sum rewards: 82.162, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.170', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.136', 'AMMO4': '0.196', 'weapon2': '0.262', 'AMMO3': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.234', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '71.000'} [2024-08-06 07:37:17,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 638042112. Throughput: 0: 4370.2. Samples: 159508260. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:17,795][52567] Avg episode reward: [(0, '74.986')] [2024-08-06 07:37:18,838][52658] DAMAGECOUNT value on done: 885599.0 [2024-08-06 07:37:18,838][52658] Sum rewards: 70.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.046', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.486', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.216', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '58.000'} [2024-08-06 07:37:19,064][52795] DAMAGECOUNT value on done: 819192.0 [2024-08-06 07:37:19,068][52795] Sum rewards: 68.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.959', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon5': '0.236', 'AMMO3': '0.241', 'weapon2': '0.244', 'AMMO4': '0.259', 'WEAPON5': '0.400', 'weapon4': '0.404', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.824', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:19,462][52820] DAMAGECOUNT value on done: 820878.0 [2024-08-06 07:37:19,464][52820] Sum rewards: 85.730, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon5': '0.018', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.452', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '70.000'} [2024-08-06 07:37:19,551][52659] DAMAGECOUNT value on done: 878402.0 [2024-08-06 07:37:19,551][52659] Sum rewards: 76.826, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.055', 'AMMO5': '0.011', 'AMMO2': '0.063', 'weapon5': '0.164', 'weapon2': '0.212', 'AMMO3': '0.295', 'WEAPON5': '0.300', 'AMMO4': '0.313', 'weapon4': '0.374', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '2.980', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '66.000'} [2024-08-06 07:37:20,323][52650] Updated weights for policy 0, policy_version 77891 (0.0025) [2024-08-06 07:37:20,644][52659] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:37:20,721][52660] DAMAGECOUNT value on done: 870924.0 [2024-08-06 07:37:20,722][52660] Sum rewards: 74.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.803', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.128', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.040', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:21,766][52658] DAMAGECOUNT value on done: 887165.0 [2024-08-06 07:37:21,775][52658] Sum rewards: 64.270, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.070', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.142', 'AMMO4': '0.216', 'weapon5': '0.216', 'AMMO3': '0.295', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.866', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:22,255][52795] DAMAGECOUNT value on done: 814109.0 [2024-08-06 07:37:22,255][52795] Sum rewards: 72.395, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.154', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.120', 'weapon5': '0.130', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.272', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:22,385][52659] DAMAGECOUNT value on done: 882876.0 [2024-08-06 07:37:22,386][52659] Sum rewards: 65.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.622', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'HITCOUNT': '3.200', 'weapon3': '3.524', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '56.000'} [2024-08-06 07:37:22,661][52820] DAMAGECOUNT value on done: 817034.0 [2024-08-06 07:37:22,663][52820] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.635', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.070', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '62.000'} [2024-08-06 07:37:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 638124032. Throughput: 0: 4370.2. Samples: 159534430. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:22,794][52567] Avg episode reward: [(0, '75.001')] [2024-08-06 07:37:22,919][52667] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:37:23,760][52660] DAMAGECOUNT value on done: 869468.0 [2024-08-06 07:37:23,762][52660] Sum rewards: 74.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.732', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.012', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.374', 'WEAPON3': '0.950', 'weapon3': '3.302', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:24,532][52658] DAMAGECOUNT value on done: 885380.0 [2024-08-06 07:37:24,533][52658] Sum rewards: 71.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.096', 'AMMO5': '0.016', 'AMMO2': '0.043', 'AMMO3': '0.169', 'weapon2': '0.176', 'AMMO4': '0.214', 'weapon5': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.628', 'WEAPON3': '1.000', 'weapon3': '2.652', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:25,169][52650] Updated weights for policy 0, policy_version 77901 (0.0012) [2024-08-06 07:37:25,441][52795] DAMAGECOUNT value on done: 805986.0 [2024-08-06 07:37:25,442][52795] Sum rewards: 77.382, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.959', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.130', 'AMMO4': '0.131', 'weapon5': '0.140', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '0.950', 'weapon3': '3.218', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '62.000'} [2024-08-06 07:37:25,558][52659] DAMAGECOUNT value on done: 880986.0 [2024-08-06 07:37:25,559][52659] Sum rewards: 66.541, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.700', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'weapon4': '0.106', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.321', 'weapon2': '0.550', 'WEAPON3': '1.900', 'weapon3': '2.958', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:25,679][52820] DAMAGECOUNT value on done: 819622.0 [2024-08-06 07:37:25,681][52820] Sum rewards: 69.654, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.654', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.138', 'AMMO4': '0.176', 'AMMO3': '0.178', 'weapon5': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.862', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '56.000'} [2024-08-06 07:37:27,178][52658] DAMAGECOUNT value on done: 879121.0 [2024-08-06 07:37:27,178][52658] Sum rewards: 71.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.065', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.124', 'weapon5': '0.206', 'AMMO4': '0.243', 'weapon2': '0.254', 'AMMO3': '0.260', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.140', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 638205952. Throughput: 0: 4379.1. Samples: 159560810. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:27,794][52567] Avg episode reward: [(0, '74.796')] [2024-08-06 07:37:28,263][52659] DAMAGECOUNT value on done: 890959.0 [2024-08-06 07:37:28,265][52659] Sum rewards: 76.146, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.671', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.158', 'AMMO3': '0.165', 'AMMO4': '0.172', 'weapon5': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.000', 'weapon3': '2.952', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:28,615][52795] DAMAGECOUNT value on done: 811776.0 [2024-08-06 07:37:28,616][52795] Sum rewards: 76.368, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.485', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.148', 'AMMO4': '0.168', 'weapon5': '0.192', 'AMMO3': '0.296', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.008', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '67.000'} [2024-08-06 07:37:28,943][52820] DAMAGECOUNT value on done: 827253.0 [2024-08-06 07:37:28,944][52820] Sum rewards: 75.264, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.100', 'AMMO3': '0.155', 'AMMO4': '0.156', 'weapon5': '0.174', 'HEALTH': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '0.900', 'weapon3': '3.092', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:29,207][52669] DAMAGECOUNT value on done: 883372.0 [2024-08-06 07:37:29,208][52669] Sum rewards: 71.749, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.319', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon2': '0.276', 'AMMO4': '0.277', 'AMMO3': '0.289', 'weapon5': '0.306', 'weapon4': '0.330', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.696', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '61.000'} [2024-08-06 07:37:29,726][52650] Updated weights for policy 0, policy_version 77911 (0.0020) [2024-08-06 07:37:30,239][52658] DAMAGECOUNT value on done: 873637.0 [2024-08-06 07:37:30,241][52658] Sum rewards: 75.005, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.505', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.016', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'weapon4': '0.272', 'weapon2': '0.310', 'WEAPON3': '1.050', 'weapon3': '3.222', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:30,998][52659] DAMAGECOUNT value on done: 874642.0 [2024-08-06 07:37:30,998][52659] Sum rewards: 69.125, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.310', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.024', 'AMMO4': '0.106', 'weapon5': '0.118', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '55.000'} [2024-08-06 07:37:31,741][52669] DAMAGECOUNT value on done: 876820.0 [2024-08-06 07:37:31,741][52669] Sum rewards: 63.995, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.147', 'weapon4': '0.198', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.050', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '54.000'} [2024-08-06 07:37:31,778][52795] DAMAGECOUNT value on done: 820132.0 [2024-08-06 07:37:31,778][52795] Sum rewards: 71.542, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.961', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.169', 'weapon5': '0.240', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:32,135][52820] DAMAGECOUNT value on done: 826218.0 [2024-08-06 07:37:32,138][52820] Sum rewards: 78.905, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon4': '0.106', 'WEAPON4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '1.150', 'weapon3': '3.282', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:32,465][52794] DAMAGECOUNT value on done: 875340.0 [2024-08-06 07:37:32,473][52794] Sum rewards: 73.241, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.790', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 638296064. Throughput: 0: 4382.0. Samples: 159573940. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:32,795][52567] Avg episode reward: [(0, '74.899')] [2024-08-06 07:37:32,949][52658] DAMAGECOUNT value on done: 886430.0 [2024-08-06 07:37:32,949][52658] Sum rewards: 63.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.115', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO3': '0.242', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.990', 'FRAGCOUNT': '55.000'} [2024-08-06 07:37:33,896][52659] DAMAGECOUNT value on done: 887222.0 [2024-08-06 07:37:33,897][52659] Sum rewards: 72.209, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.414', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.160', 'weapon4': '0.190', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '61.000'} [2024-08-06 07:37:34,213][52650] Updated weights for policy 0, policy_version 77921 (0.0035) [2024-08-06 07:37:34,899][52669] DAMAGECOUNT value on done: 888178.0 [2024-08-06 07:37:34,900][52669] Sum rewards: 75.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.908', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.186', 'AMMO4': '0.221', 'AMMO3': '0.248', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.254', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:35,000][52795] DAMAGECOUNT value on done: 807903.0 [2024-08-06 07:37:35,001][52795] Sum rewards: 73.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.016', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.192', 'weapon2': '0.594', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:35,022][52820] DAMAGECOUNT value on done: 808718.0 [2024-08-06 07:37:35,023][52820] Sum rewards: 71.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.406', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.102', 'AMMO4': '0.122', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:35,092][52794] DAMAGECOUNT value on done: 888245.0 [2024-08-06 07:37:35,094][52794] Sum rewards: 89.112, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.110', 'weapon5': '0.172', 'AMMO4': '0.207', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.054', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.711', 'FRAGCOUNT': '73.000'} [2024-08-06 07:37:35,993][52658] DAMAGECOUNT value on done: 874910.0 [2024-08-06 07:37:35,993][52658] Sum rewards: 63.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.019', 'weapon4': '0.020', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.215', 'weapon2': '0.362', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.398', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.000'} [2024-08-06 07:37:36,895][52659] DAMAGECOUNT value on done: 880436.0 [2024-08-06 07:37:36,895][52659] Sum rewards: 78.662, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.042', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.252', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.236', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '66.000'} [2024-08-06 07:37:37,587][52669] DAMAGECOUNT value on done: 881380.0 [2024-08-06 07:37:37,596][52669] Sum rewards: 71.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon7': '0.086', 'AMMO4': '0.102', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.132', 'weapon4': '0.142', 'WEAPON7': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.804', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 638386176. Throughput: 0: 4384.0. Samples: 159600090. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:37,794][52567] Avg episode reward: [(0, '74.772')] [2024-08-06 07:37:38,193][52795] DAMAGECOUNT value on done: 818988.0 [2024-08-06 07:37:38,193][52795] Sum rewards: 79.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.054', 'weapon4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.179', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:38,267][52794] DAMAGECOUNT value on done: 889807.0 [2024-08-06 07:37:38,269][52794] Sum rewards: 78.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.985', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.058', 'weapon4': '0.058', 'AMMO4': '0.078', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.358', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:38,936][52658] DAMAGECOUNT value on done: 902199.0 [2024-08-06 07:37:38,937][52658] Sum rewards: 80.854, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.074', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'weapon3': '3.576', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '68.000'} [2024-08-06 07:37:39,086][52650] Updated weights for policy 0, policy_version 77931 (0.0013) [2024-08-06 07:37:39,164][52663] DAMAGECOUNT value on done: 900102.0 [2024-08-06 07:37:39,164][52663] Sum rewards: 80.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.090', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'AMMO4': '0.219', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:40,522][52669] DAMAGECOUNT value on done: 890714.0 [2024-08-06 07:37:40,524][52669] Sum rewards: 82.975, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.210', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.170', 'AMMO3': '0.183', 'weapon5': '0.190', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '3.008', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '67.000'} [2024-08-06 07:37:40,900][52647] DAMAGECOUNT value on done: 939019.0 [2024-08-06 07:37:40,902][52647] Sum rewards: 79.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO5': '0.016', 'AMMO2': '0.069', 'weapon4': '0.090', 'AMMO3': '0.210', 'weapon2': '0.218', 'weapon5': '0.226', 'AMMO4': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '65.000'} [2024-08-06 07:37:41,178][52794] DAMAGECOUNT value on done: 878784.0 [2024-08-06 07:37:41,178][52794] Sum rewards: 72.601, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.856', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO4': '0.173', 'weapon5': '0.178', 'weapon2': '0.210', 'AMMO3': '0.295', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.262', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:41,434][52795] DAMAGECOUNT value on done: 815110.0 [2024-08-06 07:37:41,434][52795] Sum rewards: 63.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.495', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.070', 'AMMO4': '0.160', 'weapon5': '0.226', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.600', 'HITCOUNT': '2.960', 'weapon3': '3.032', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 07:37:42,188][52663] DAMAGECOUNT value on done: 882626.0 [2024-08-06 07:37:42,188][52663] Sum rewards: 69.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.009', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.066', 'weapon4': '0.082', 'AMMO4': '0.168', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:42,219][52658] DAMAGECOUNT value on done: 886586.0 [2024-08-06 07:37:42,221][52658] Sum rewards: 80.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.224', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '67.000'} [2024-08-06 07:37:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 638468096. Throughput: 0: 4389.8. Samples: 159626630. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:42,794][52567] Avg episode reward: [(0, '74.545')] [2024-08-06 07:37:43,451][52650] Updated weights for policy 0, policy_version 77941 (0.0025) [2024-08-06 07:37:43,606][52647] DAMAGECOUNT value on done: 927268.0 [2024-08-06 07:37:43,607][52647] Sum rewards: 70.680, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.764', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.158', 'AMMO3': '0.180', 'weapon5': '0.224', 'AMMO4': '0.264', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 07:37:43,635][52669] DAMAGECOUNT value on done: 886782.0 [2024-08-06 07:37:43,636][52669] Sum rewards: 83.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.660', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.108', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.394', 'WEAPON3': '1.700', 'weapon3': '3.108', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.766', 'FRAGCOUNT': '71.000'} [2024-08-06 07:37:44,373][52794] DAMAGECOUNT value on done: 873567.0 [2024-08-06 07:37:44,374][52794] Sum rewards: 77.935, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:44,742][52795] DAMAGECOUNT value on done: 805835.0 [2024-08-06 07:37:44,742][52795] Sum rewards: 66.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.649', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.136', 'weapon4': '0.160', 'AMMO4': '0.164', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '56.000'} [2024-08-06 07:37:45,244][52663] DAMAGECOUNT value on done: 877126.0 [2024-08-06 07:37:45,245][52663] Sum rewards: 81.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.125', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.108', 'AMMO3': '0.207', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.292', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '67.000'} [2024-08-06 07:37:45,470][52658] DAMAGECOUNT value on done: 896422.0 [2024-08-06 07:37:45,470][52658] Sum rewards: 79.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.783', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.104', 'weapon4': '0.148', 'AMMO3': '0.173', 'AMMO4': '0.200', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '66.000'} [2024-08-06 07:37:46,513][52647] DAMAGECOUNT value on done: 935160.0 [2024-08-06 07:37:46,514][52647] Sum rewards: 81.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon4': '0.176', 'weapon5': '0.190', 'AMMO3': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '67.000'} [2024-08-06 07:37:46,588][52669] DAMAGECOUNT value on done: 886880.0 [2024-08-06 07:37:46,589][52669] Sum rewards: 81.866, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.694', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.078', 'weapon4': '0.090', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.406', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:47,469][52794] DAMAGECOUNT value on done: 878593.0 [2024-08-06 07:37:47,470][52794] Sum rewards: 71.769, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.190', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.076', 'AMMO3': '0.162', 'AMMO4': '0.216', 'weapon5': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.872', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '57.000'} [2024-08-06 07:37:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 638558208. Throughput: 0: 4382.4. Samples: 159639520. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:47,795][52567] Avg episode reward: [(0, '74.457')] [2024-08-06 07:37:47,948][52795] DAMAGECOUNT value on done: 812774.0 [2024-08-06 07:37:47,948][52795] Sum rewards: 67.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.066', 'weapon5': '0.112', 'AMMO3': '0.196', 'AMMO4': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.250', 'weapon3': '3.036', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '55.500'} [2024-08-06 07:37:48,295][52663] DAMAGECOUNT value on done: 883266.0 [2024-08-06 07:37:48,295][52663] Sum rewards: 84.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO2': '0.011', 'AMMO4': '0.057', 'AMMO3': '0.236', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '70.000'} [2024-08-06 07:37:48,411][52650] Updated weights for policy 0, policy_version 77951 (0.0041) [2024-08-06 07:37:48,482][52658] DAMAGECOUNT value on done: 883592.0 [2024-08-06 07:37:48,482][52658] Sum rewards: 77.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.898', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:48,875][52671] DAMAGECOUNT value on done: 888795.0 [2024-08-06 07:37:48,876][52671] Sum rewards: 75.205, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.830', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.154', 'weapon2': '0.170', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.604', 'WEAPON3': '0.950', 'weapon3': '2.626', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '58.000'} [2024-08-06 07:37:48,979][52647] DAMAGECOUNT value on done: 934558.0 [2024-08-06 07:37:48,981][52647] Sum rewards: 77.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.879', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.338', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:49,542][52669] DAMAGECOUNT value on done: 884443.0 [2024-08-06 07:37:49,542][52669] Sum rewards: 76.026, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.360', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.112', 'AMMO4': '0.218', 'weapon5': '0.228', 'AMMO3': '0.230', 'weapon2': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:50,662][52794] DAMAGECOUNT value on done: 884287.0 [2024-08-06 07:37:50,663][52794] Sum rewards: 73.682, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.390', 'WEAPON3': '1.450', 'weapon3': '3.360', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:51,057][52795] DAMAGECOUNT value on done: 820430.0 [2024-08-06 07:37:51,060][52795] Sum rewards: 73.469, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.179', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.184', 'AMMO3': '0.187', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '60.000'} [2024-08-06 07:37:51,351][52658] DAMAGECOUNT value on done: 892678.0 [2024-08-06 07:37:51,351][52658] Sum rewards: 75.860, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.718', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.232', 'AMMO3': '0.248', 'WEAPON3': '1.600', 'weapon3': '3.454', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '65.000'} [2024-08-06 07:37:51,371][52663] DAMAGECOUNT value on done: 884753.0 [2024-08-06 07:37:51,373][52663] Sum rewards: 89.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.985', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.242', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.448', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.039', 'FRAGCOUNT': '74.000'} [2024-08-06 07:37:51,521][52671] DAMAGECOUNT value on done: 893063.0 [2024-08-06 07:37:51,522][52671] Sum rewards: 78.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.729', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.221', 'weapon2': '0.292', 'WEAPON3': '1.350', 'HITCOUNT': '3.430', 'weapon3': '3.572', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '66.000'} [2024-08-06 07:37:51,720][52647] DAMAGECOUNT value on done: 942342.0 [2024-08-06 07:37:51,720][52647] Sum rewards: 78.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.158', 'AMMO4': '0.205', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.370', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '65.000'} [2024-08-06 07:37:52,530][52669] DAMAGECOUNT value on done: 895725.0 [2024-08-06 07:37:52,532][52669] Sum rewards: 85.854, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.626', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.090', 'weapon2': '0.190', 'AMMO3': '0.230', 'AMMO4': '0.251', 'weapon5': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '70.000'} [2024-08-06 07:37:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 638648320. Throughput: 0: 4376.9. Samples: 159665500. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 07:37:52,802][52567] Avg episode reward: [(0, '75.081')] [2024-08-06 07:37:53,344][52650] Updated weights for policy 0, policy_version 77961 (0.0025) [2024-08-06 07:37:53,951][52794] DAMAGECOUNT value on done: 870982.0 [2024-08-06 07:37:53,951][52794] Sum rewards: 83.531, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.975', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO3': '0.125', 'AMMO4': '0.162', 'weapon5': '0.210', 'weapon4': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '0.900', 'weapon3': '2.862', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '66.000'} [2024-08-06 07:37:54,156][52671] DAMAGECOUNT value on done: 889455.0 [2024-08-06 07:37:54,157][52671] Sum rewards: 74.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.098', 'weapon5': '0.126', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.398', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '63.000'} [2024-08-06 07:37:54,395][52658] DAMAGECOUNT value on done: 881569.0 [2024-08-06 07:37:54,395][52658] Sum rewards: 67.079, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.752', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.175', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.310', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '54.000'} [2024-08-06 07:37:54,424][52663] DAMAGECOUNT value on done: 889890.0 [2024-08-06 07:37:54,425][52663] Sum rewards: 79.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.266', 'weapon2': '0.530', 'WEAPON3': '1.650', 'weapon3': '3.222', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '68.000'} [2024-08-06 07:37:54,448][52647] DAMAGECOUNT value on done: 937608.0 [2024-08-06 07:37:54,449][52647] Sum rewards: 87.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '71.000'} [2024-08-06 07:37:54,631][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:37:55,641][52669] DAMAGECOUNT value on done: 884197.0 [2024-08-06 07:37:55,642][52669] Sum rewards: 80.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.893', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.130', 'weapon2': '0.152', 'AMMO3': '0.186', 'weapon4': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.334', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '64.000'} [2024-08-06 07:37:56,596][52671] DAMAGECOUNT value on done: 890242.0 [2024-08-06 07:37:56,596][52671] Sum rewards: 84.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.142', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon2': '0.198', 'AMMO4': '0.203', 'weapon5': '0.226', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.234', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '70.000'} [2024-08-06 07:37:56,907][52794] DAMAGECOUNT value on done: 884638.0 [2024-08-06 07:37:56,907][52794] Sum rewards: 79.603, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.065', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.072', 'weapon4': '0.084', 'weapon5': '0.086', 'AMMO3': '0.147', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.312', 'WEAPON3': '0.900', 'weapon3': '3.348', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '62.000'} [2024-08-06 07:37:57,222][52658] DAMAGECOUNT value on done: 888311.0 [2024-08-06 07:37:57,223][52658] Sum rewards: 73.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.825', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon4': '0.190', 'weapon2': '0.200', 'weapon5': '0.212', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '62.000'} [2024-08-06 07:37:57,483][52663] DAMAGECOUNT value on done: 881600.0 [2024-08-06 07:37:57,486][52663] Sum rewards: 80.843, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.175', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.074', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '68.000'} [2024-08-06 07:37:57,514][52647] DAMAGECOUNT value on done: 940024.0 [2024-08-06 07:37:57,515][52647] Sum rewards: 66.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.084', 'weapon5': '0.192', 'AMMO3': '0.196', 'AMMO4': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '55.000'} [2024-08-06 07:37:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 638730240. Throughput: 0: 4370.2. Samples: 159691760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:37:57,802][52567] Avg episode reward: [(0, '75.328')] [2024-08-06 07:37:58,031][52650] Updated weights for policy 0, policy_version 77971 (0.0040) [2024-08-06 07:37:58,722][52669] DAMAGECOUNT value on done: 894038.0 [2024-08-06 07:37:58,725][52669] Sum rewards: 73.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.078', 'weapon5': '0.132', 'AMMO3': '0.153', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '2.994', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '58.000'} [2024-08-06 07:37:59,462][52671] DAMAGECOUNT value on done: 894829.0 [2024-08-06 07:37:59,462][52671] Sum rewards: 67.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.950', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.114', 'AMMO4': '0.190', 'AMMO3': '0.234', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '59.000'} [2024-08-06 07:37:59,930][52794] DAMAGECOUNT value on done: 878942.0 [2024-08-06 07:37:59,932][52794] Sum rewards: 78.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.170', 'weapon4': '0.180', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '66.000'} [2024-08-06 07:37:59,947][52658] DAMAGECOUNT value on done: 871392.0 [2024-08-06 07:37:59,948][52658] Sum rewards: 73.834, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.686', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.098', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.752', 'WEAPON3': '0.900', 'weapon3': '2.958', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:00,131][52647] DAMAGECOUNT value on done: 917438.0 [2024-08-06 07:38:00,131][52647] Sum rewards: 87.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.324', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.094', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon4': '0.302', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.198', 'FRAGCOUNT': '70.000'} [2024-08-06 07:38:00,614][52663] DAMAGECOUNT value on done: 870323.0 [2024-08-06 07:38:00,619][52663] Sum rewards: 74.600, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.525', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.032', 'weapon5': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:00,788][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:38:02,005][52669] DAMAGECOUNT value on done: 893166.0 [2024-08-06 07:38:02,005][52669] Sum rewards: 75.996, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.104', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:02,327][52671] DAMAGECOUNT value on done: 884397.0 [2024-08-06 07:38:02,329][52671] Sum rewards: 69.417, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.044', 'weapon5': '0.128', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:02,440][52650] Updated weights for policy 0, policy_version 77981 (0.0014) [2024-08-06 07:38:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 638820352. Throughput: 0: 4359.8. Samples: 159704450. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:02,794][52567] Avg episode reward: [(0, '75.408')] [2024-08-06 07:38:02,819][52658] DAMAGECOUNT value on done: 889177.0 [2024-08-06 07:38:02,819][52658] Sum rewards: 75.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.875', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.126', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:02,835][52647] DAMAGECOUNT value on done: 932129.0 [2024-08-06 07:38:02,835][52647] Sum rewards: 70.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.274', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.197', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:03,129][52794] DAMAGECOUNT value on done: 871776.0 [2024-08-06 07:38:03,129][52794] Sum rewards: 87.805, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.725', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'AMMO3': '0.158', 'weapon5': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.084', 'FRAGCOUNT': '70.000'} [2024-08-06 07:38:03,386][52663] DAMAGECOUNT value on done: 878132.0 [2024-08-06 07:38:03,386][52663] Sum rewards: 79.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.672', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.122', 'weapon2': '0.198', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.124', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:04,556][52669] DAMAGECOUNT value on done: 880121.0 [2024-08-06 07:38:04,556][52669] Sum rewards: 70.108, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.124', 'AMMO4': '0.146', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.406', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:04,748][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:38:05,478][52671] DAMAGECOUNT value on done: 889679.0 [2024-08-06 07:38:05,479][52671] Sum rewards: 76.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.254', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.112', 'AMMO4': '0.135', 'weapon5': '0.146', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:05,538][52647] DAMAGECOUNT value on done: 931556.0 [2024-08-06 07:38:05,538][52647] Sum rewards: 71.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.135', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.100', 'weapon4': '0.128', 'AMMO4': '0.183', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:05,730][52794] DAMAGECOUNT value on done: 885812.0 [2024-08-06 07:38:05,731][52794] Sum rewards: 77.689, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.170', 'AMMO3': '0.211', 'weapon5': '0.222', 'AMMO4': '0.265', 'weapon2': '0.420', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:05,970][52658] DAMAGECOUNT value on done: 880954.0 [2024-08-06 07:38:05,970][52658] Sum rewards: 70.776, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.786', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.098', 'weapon4': '0.104', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.272', 'WEAPON3': '1.100', 'HITCOUNT': '3.170', 'weapon3': '3.368', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:06,243][52663] DAMAGECOUNT value on done: 882386.0 [2024-08-06 07:38:06,243][52663] Sum rewards: 73.962, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.130', 'weapon5': '0.164', 'AMMO4': '0.268', 'AMMO3': '0.275', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.086', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:07,280][52650] Updated weights for policy 0, policy_version 77991 (0.0014) [2024-08-06 07:38:07,693][52669] DAMAGECOUNT value on done: 881021.0 [2024-08-06 07:38:07,696][52669] Sum rewards: 73.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'AMMO3': '0.258', 'weapon2': '0.390', 'WEAPON3': '1.600', 'weapon3': '3.356', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 638910464. Throughput: 0: 4365.5. Samples: 159730880. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:07,802][52567] Avg episode reward: [(0, '75.362')] [2024-08-06 07:38:08,067][52647] DAMAGECOUNT value on done: 929322.0 [2024-08-06 07:38:08,068][52647] Sum rewards: 75.788, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.762', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.148', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:08,115][52794] DAMAGECOUNT value on done: 880944.0 [2024-08-06 07:38:08,117][52794] Sum rewards: 84.638, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.382', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.254', 'WEAPON3': '1.600', 'weapon3': '3.460', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '71.000'} [2024-08-06 07:38:08,422][52671] DAMAGECOUNT value on done: 891650.0 [2024-08-06 07:38:08,423][52671] Sum rewards: 83.386, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.303', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.122', 'weapon5': '0.132', 'AMMO4': '0.152', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:09,015][52658] DAMAGECOUNT value on done: 877481.0 [2024-08-06 07:38:09,015][52658] Sum rewards: 74.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.016', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.098', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:09,474][52663] DAMAGECOUNT value on done: 889435.0 [2024-08-06 07:38:09,475][52663] Sum rewards: 77.623, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.789', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.092', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.408', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '65.000'} [2024-08-06 07:38:10,720][52794] DAMAGECOUNT value on done: 893586.0 [2024-08-06 07:38:10,721][52794] Sum rewards: 67.905, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.868', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon5': '0.158', 'weapon4': '0.174', 'AMMO4': '0.277', 'AMMO3': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '2.912', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '60.000'} [2024-08-06 07:38:10,752][52669] DAMAGECOUNT value on done: 886763.0 [2024-08-06 07:38:10,758][52669] Sum rewards: 74.826, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.454', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.088', 'AMMO4': '0.099', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.313', 'WEAPON3': '1.800', 'HITCOUNT': '3.430', 'weapon3': '3.448', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:11,284][52671] DAMAGECOUNT value on done: 875750.0 [2024-08-06 07:38:11,287][52671] Sum rewards: 70.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.200', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.162', 'AMMO3': '0.206', 'AMMO4': '0.216', 'weapon5': '0.264', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:11,298][52647] DAMAGECOUNT value on done: 920116.0 [2024-08-06 07:38:11,298][52647] Sum rewards: 81.609, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.372', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.024', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.244', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:11,568][52664] DAMAGECOUNT value on done: 913321.0 [2024-08-06 07:38:11,569][52664] Sum rewards: 78.367, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.602', 'AMMO5': '0.013', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'weapon5': '0.220', 'AMMO3': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.750', 'weapon3': '2.916', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '69.000'} [2024-08-06 07:38:12,108][52658] DAMAGECOUNT value on done: 886853.0 [2024-08-06 07:38:12,109][52658] Sum rewards: 80.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.265', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.122', 'weapon5': '0.126', 'AMMO4': '0.159', 'weapon2': '0.172', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.380', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:12,221][52650] Updated weights for policy 0, policy_version 78001 (0.0015) [2024-08-06 07:38:12,387][52663] DAMAGECOUNT value on done: 871325.0 [2024-08-06 07:38:12,389][52663] Sum rewards: 70.501, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.784', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'AMMO3': '0.172', 'AMMO4': '0.180', 'weapon5': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.602', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 638992384. Throughput: 0: 4363.6. Samples: 159757170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:12,794][52567] Avg episode reward: [(0, '75.739')] [2024-08-06 07:38:12,953][52649] DAMAGECOUNT value on done: 854776.0 [2024-08-06 07:38:12,954][52649] Sum rewards: 75.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.175', 'AMMO5': '0.015', 'AMMO2': '0.064', 'weapon5': '0.204', 'weapon2': '0.232', 'weapon4': '0.238', 'AMMO3': '0.267', 'AMMO4': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.040', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:13,456][52669] DAMAGECOUNT value on done: 908983.0 [2024-08-06 07:38:13,456][52669] Sum rewards: 74.523, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.396', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.132', 'weapon2': '0.188', 'AMMO3': '0.206', 'weapon4': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '60.000'} [2024-08-06 07:38:13,691][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:38:14,037][52794] DAMAGECOUNT value on done: 872991.0 [2024-08-06 07:38:14,037][52794] Sum rewards: 72.973, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:14,364][52647] DAMAGECOUNT value on done: 935234.0 [2024-08-06 07:38:14,364][52647] Sum rewards: 76.795, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.560', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'weapon2': '0.154', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.622', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:14,365][52671] DAMAGECOUNT value on done: 889430.0 [2024-08-06 07:38:14,365][52671] Sum rewards: 68.359, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.474', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.194', 'weapon2': '0.552', 'WEAPON3': '1.050', 'weapon3': '3.026', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '56.000'} [2024-08-06 07:38:14,716][52664] DAMAGECOUNT value on done: 919404.0 [2024-08-06 07:38:14,717][52664] Sum rewards: 68.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.100', 'AMMO3': '0.223', 'weapon5': '0.262', 'AMMO4': '0.320', 'weapon2': '0.392', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:14,949][52663] DAMAGECOUNT value on done: 869342.0 [2024-08-06 07:38:14,951][52663] Sum rewards: 63.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.474', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.138', 'weapon5': '0.192', 'AMMO4': '0.207', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '52.000'} [2024-08-06 07:38:15,482][52649] DAMAGECOUNT value on done: 850339.0 [2024-08-06 07:38:15,483][52649] Sum rewards: 62.467, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.180', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.064', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.654', 'WEAPON3': '1.650', 'weapon3': '3.070', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '56.000'} [2024-08-06 07:38:15,877][52669] DAMAGECOUNT value on done: 897240.0 [2024-08-06 07:38:15,878][52669] Sum rewards: 83.396, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.082', 'AMMO4': '0.118', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.332', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '68.000'} [2024-08-06 07:38:16,263][52663] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0), ('weapon5', 0.002)] [2024-08-06 07:38:16,490][52650] Updated weights for policy 0, policy_version 78011 (0.0010) [2024-08-06 07:38:16,931][52794] DAMAGECOUNT value on done: 889735.0 [2024-08-06 07:38:16,933][52794] Sum rewards: 60.141, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.394', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.160', 'weapon4': '0.210', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.550', 'weapon3': '2.972', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '53.000'} [2024-08-06 07:38:17,180][52647] DAMAGECOUNT value on done: 923181.0 [2024-08-06 07:38:17,181][52647] Sum rewards: 69.321, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.348', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.178', 'AMMO4': '0.225', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:17,200][52671] DAMAGECOUNT value on done: 888537.0 [2024-08-06 07:38:17,201][52671] Sum rewards: 91.382, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.665', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.384', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '22.020', 'FRAGCOUNT': '73.000'} [2024-08-06 07:38:17,452][52664] DAMAGECOUNT value on done: 920705.0 [2024-08-06 07:38:17,452][52664] Sum rewards: 84.877, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.610', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.129', 'weapon4': '0.144', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '68.000'} [2024-08-06 07:38:17,689][52663] DAMAGECOUNT value on done: 876826.0 [2024-08-06 07:38:17,691][52663] Sum rewards: 79.792, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.558', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.068', 'weapon5': '0.166', 'AMMO4': '0.194', 'AMMO3': '0.216', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.296', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 639082496. Throughput: 0: 4358.0. Samples: 159770050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:17,794][52567] Avg episode reward: [(0, '75.923')] [2024-08-06 07:38:18,591][52649] DAMAGECOUNT value on done: 867403.0 [2024-08-06 07:38:18,591][52649] Sum rewards: 76.939, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.805', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.382', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '65.000'} [2024-08-06 07:38:18,866][52669] DAMAGECOUNT value on done: 890675.0 [2024-08-06 07:38:18,867][52669] Sum rewards: 67.723, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.675', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'weapon4': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.186', 'weapon5': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '55.000'} [2024-08-06 07:38:19,468][52670] DAMAGECOUNT value on done: 870219.0 [2024-08-06 07:38:19,469][52670] Sum rewards: 88.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.375', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.184', 'weapon4': '0.226', 'weapon5': '0.266', 'AMMO4': '0.310', 'weapon2': '0.350', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.486', 'FRAGCOUNT': '70.000'} [2024-08-06 07:38:19,888][52647] DAMAGECOUNT value on done: 931991.0 [2024-08-06 07:38:19,889][52647] Sum rewards: 70.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.040', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.612', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 07:38:20,031][52671] DAMAGECOUNT value on done: 884245.0 [2024-08-06 07:38:20,031][52671] Sum rewards: 76.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.120', 'AMMO4': '0.138', 'AMMO3': '0.198', 'weapon2': '0.202', 'weapon4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:20,088][52665] DAMAGECOUNT value on done: 871240.0 [2024-08-06 07:38:20,089][52665] Sum rewards: 79.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '65.000'} [2024-08-06 07:38:20,097][52794] DAMAGECOUNT value on done: 884124.0 [2024-08-06 07:38:20,098][52794] Sum rewards: 65.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.092', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '56.000'} [2024-08-06 07:38:20,337][52664] DAMAGECOUNT value on done: 910789.0 [2024-08-06 07:38:20,337][52664] Sum rewards: 74.342, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.931', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon2': '0.182', 'weapon5': '0.182', 'AMMO4': '0.189', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:20,753][52663] DAMAGECOUNT value on done: 879681.0 [2024-08-06 07:38:20,755][52663] Sum rewards: 73.978, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.568', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:21,158][52649] DAMAGECOUNT value on done: 863397.0 [2024-08-06 07:38:21,159][52649] Sum rewards: 78.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon5': '0.232', 'weapon4': '0.236', 'AMMO3': '0.257', 'AMMO4': '0.286', 'weapon2': '0.320', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.870', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:21,335][52650] Updated weights for policy 0, policy_version 78021 (0.0023) [2024-08-06 07:38:22,093][52669] DAMAGECOUNT value on done: 896611.0 [2024-08-06 07:38:22,093][52669] Sum rewards: 79.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.820', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.092', 'AMMO4': '0.128', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.259', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:22,417][52670] DAMAGECOUNT value on done: 884542.0 [2024-08-06 07:38:22,417][52670] Sum rewards: 79.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.123', 'weapon5': '0.132', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:22,675][52794] DAMAGECOUNT value on done: 888262.0 [2024-08-06 07:38:22,677][52794] Sum rewards: 88.649, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.686', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'AMMO3': '0.152', 'weapon4': '0.164', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '0.950', 'weapon3': '2.976', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '70.000'} [2024-08-06 07:38:22,766][52665] DAMAGECOUNT value on done: 883369.0 [2024-08-06 07:38:22,767][52665] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.615', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.034', 'weapon5': '0.094', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'AMMO3': '0.294', 'WEAPON3': '1.800', 'weapon3': '3.462', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 639172608. Throughput: 0: 4367.1. Samples: 159796610. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:22,794][52567] Avg episode reward: [(0, '76.295')] [2024-08-06 07:38:22,891][52671] DAMAGECOUNT value on done: 891149.0 [2024-08-06 07:38:22,891][52671] Sum rewards: 67.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.364', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.228', 'AMMO4': '0.257', 'weapon5': '0.290', 'weapon4': '0.296', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.754', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '55.000'} [2024-08-06 07:38:22,938][52647] DAMAGECOUNT value on done: 934284.0 [2024-08-06 07:38:22,939][52647] Sum rewards: 82.968, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.104', 'AMMO3': '0.208', 'AMMO4': '0.250', 'weapon5': '0.306', 'weapon2': '0.366', 'HEALTH': '0.485', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.890', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:23,393][52664] DAMAGECOUNT value on done: 922044.0 [2024-08-06 07:38:23,394][52664] Sum rewards: 67.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.445', 'AMMO5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.294', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '55.000'} [2024-08-06 07:38:23,881][52663] DAMAGECOUNT value on done: 884040.0 [2024-08-06 07:38:23,881][52663] Sum rewards: 79.194, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.174', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.094', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.333', 'WEAPON3': '2.000', 'weapon3': '3.408', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '70.000'} [2024-08-06 07:38:24,139][52614] Signal inference workers to stop experience collection... (14300 times) [2024-08-06 07:38:24,140][52614] Signal inference workers to resume experience collection... (14300 times) [2024-08-06 07:38:24,229][52650] InferenceWorker_p0-w0: stopping experience collection (14300 times) [2024-08-06 07:38:24,229][52650] InferenceWorker_p0-w0: resuming experience collection (14300 times) [2024-08-06 07:38:24,254][52649] DAMAGECOUNT value on done: 855503.0 [2024-08-06 07:38:24,254][52649] Sum rewards: 71.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.345', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.112', 'AMMO3': '0.165', 'AMMO4': '0.227', 'weapon5': '0.264', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.948', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '56.000'} [2024-08-06 07:38:24,825][52666] Large shaping reward 3.146 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.105, 35.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:38:25,199][52669] DAMAGECOUNT value on done: 897456.0 [2024-08-06 07:38:25,200][52669] Sum rewards: 79.110, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.065', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.074', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.265', 'weapon2': '0.448', 'WEAPON3': '1.600', 'weapon3': '3.182', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '68.000'} [2024-08-06 07:38:25,254][52670] DAMAGECOUNT value on done: 870395.0 [2024-08-06 07:38:25,256][52670] Sum rewards: 76.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.035', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.074', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:25,459][52647] DAMAGECOUNT value on done: 921434.0 [2024-08-06 07:38:25,459][52647] Sum rewards: 71.668, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.166', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.100', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.700', 'weapon3': '3.052', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:25,732][52671] DAMAGECOUNT value on done: 888260.0 [2024-08-06 07:38:25,735][52671] Sum rewards: 77.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.419', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO4': '0.146', 'AMMO3': '0.180', 'weapon2': '0.232', 'WEAPON3': '1.150', 'weapon3': '3.526', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:25,919][52650] Updated weights for policy 0, policy_version 78031 (0.0025) [2024-08-06 07:38:25,956][52794] DAMAGECOUNT value on done: 895877.0 [2024-08-06 07:38:25,956][52794] Sum rewards: 93.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.784', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.092', 'AMMO4': '0.129', 'AMMO3': '0.175', 'weapon5': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.921', 'FRAGCOUNT': '74.000'} [2024-08-06 07:38:26,042][52665] DAMAGECOUNT value on done: 873234.0 [2024-08-06 07:38:26,042][52665] Sum rewards: 71.861, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.610', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:26,051][52664] DAMAGECOUNT value on done: 919233.0 [2024-08-06 07:38:26,052][52664] Sum rewards: 77.565, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.782', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO4': '0.181', 'AMMO3': '0.198', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:26,315][52666] DAMAGECOUNT value on done: 883367.0 [2024-08-06 07:38:26,316][52666] Sum rewards: 61.681, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.425', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.158', 'AMMO3': '0.178', 'AMMO4': '0.192', 'weapon2': '0.220', 'WEAPON5': '0.300', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.004', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '49.000'} [2024-08-06 07:38:27,025][52663] DAMAGECOUNT value on done: 882294.0 [2024-08-06 07:38:27,025][52663] Sum rewards: 79.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.366', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.208', 'AMMO3': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.582', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '65.000'} [2024-08-06 07:38:27,482][52649] DAMAGECOUNT value on done: 865285.0 [2024-08-06 07:38:27,483][52649] Sum rewards: 79.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.816', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.191', 'weapon5': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 639262720. Throughput: 0: 4354.2. Samples: 159822570. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:27,802][52567] Avg episode reward: [(0, '76.114')] [2024-08-06 07:38:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078035_639262720.pth... [2024-08-06 07:38:27,951][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077523_635068416.pth [2024-08-06 07:38:28,001][52647] DAMAGECOUNT value on done: 927496.0 [2024-08-06 07:38:28,002][52647] Sum rewards: 87.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.545', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.272', 'WEAPON3': '1.300', 'weapon3': '3.432', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '72.000'} [2024-08-06 07:38:28,206][52670] DAMAGECOUNT value on done: 873192.0 [2024-08-06 07:38:28,208][52670] Sum rewards: 82.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.114', 'AMMO3': '0.197', 'weapon5': '0.280', 'AMMO4': '0.283', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:28,693][52794] DAMAGECOUNT value on done: 886218.0 [2024-08-06 07:38:28,693][52794] Sum rewards: 69.979, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO3': '0.211', 'AMMO4': '0.227', 'weapon4': '0.250', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:28,838][52671] DAMAGECOUNT value on done: 874738.0 [2024-08-06 07:38:28,839][52671] Sum rewards: 92.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.076', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.840', 'FRAGCOUNT': '75.000'} [2024-08-06 07:38:28,928][52664] DAMAGECOUNT value on done: 908495.0 [2024-08-06 07:38:28,929][52664] Sum rewards: 74.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.076', 'weapon4': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon2': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.388', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '62.500'} [2024-08-06 07:38:29,104][52666] DAMAGECOUNT value on done: 879786.0 [2024-08-06 07:38:29,106][52666] Sum rewards: 93.323, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.424', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.169', 'weapon5': '0.202', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.700', 'weapon3': '3.160', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.116', 'FRAGCOUNT': '78.000'} [2024-08-06 07:38:29,150][52665] DAMAGECOUNT value on done: 876402.0 [2024-08-06 07:38:29,151][52665] Sum rewards: 62.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.266', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.192', 'weapon2': '0.510', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.186', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '51.000'} [2024-08-06 07:38:30,154][52663] DAMAGECOUNT value on done: 886288.0 [2024-08-06 07:38:30,155][52663] Sum rewards: 68.623, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'weapon5': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.682', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '55.000'} [2024-08-06 07:38:30,605][52670] DAMAGECOUNT value on done: 886509.0 [2024-08-06 07:38:30,606][52670] Sum rewards: 82.594, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.766', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.144', 'AMMO3': '0.167', 'weapon2': '0.186', 'AMMO4': '0.196', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:30,773][52650] Updated weights for policy 0, policy_version 78041 (0.0019) [2024-08-06 07:38:30,787][52649] DAMAGECOUNT value on done: 861769.0 [2024-08-06 07:38:30,787][52649] Sum rewards: 68.189, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.026', 'weapon5': '0.048', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.192', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.608', 'DAMAGECOUNT': '16.425', 'FRAGCOUNT': '57.000'} [2024-08-06 07:38:31,297][52647] DAMAGECOUNT value on done: 919531.0 [2024-08-06 07:38:31,297][52647] Sum rewards: 69.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.092', 'AMMO4': '0.253', 'AMMO3': '0.273', 'weapon2': '0.312', 'weapon5': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.942', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:31,465][52671] DAMAGECOUNT value on done: 897842.0 [2024-08-06 07:38:31,465][52671] Sum rewards: 77.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.240', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.183', 'weapon5': '0.234', 'weapon4': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:32,027][52666] DAMAGECOUNT value on done: 885820.0 [2024-08-06 07:38:32,028][52666] Sum rewards: 84.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.412', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:32,059][52664] DAMAGECOUNT value on done: 909060.0 [2024-08-06 07:38:32,061][52664] Sum rewards: 78.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.357', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.096', 'weapon5': '0.102', 'AMMO4': '0.108', 'AMMO3': '0.217', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '65.000'} [2024-08-06 07:38:32,092][52665] DAMAGECOUNT value on done: 860253.0 [2024-08-06 07:38:32,093][52665] Sum rewards: 63.699, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.142', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.094', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '52.000'} [2024-08-06 07:38:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 639336448. Throughput: 0: 4351.1. Samples: 159835320. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:32,794][52567] Avg episode reward: [(0, '76.014')] [2024-08-06 07:38:33,265][52663] DAMAGECOUNT value on done: 890638.0 [2024-08-06 07:38:33,276][52663] Sum rewards: 80.795, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.084', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '3.326', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:33,338][52649] DAMAGECOUNT value on done: 865266.0 [2024-08-06 07:38:33,340][52649] Sum rewards: 82.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.198', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.445', 'FRAGCOUNT': '68.000'} [2024-08-06 07:38:33,534][52670] DAMAGECOUNT value on done: 874300.0 [2024-08-06 07:38:33,535][52670] Sum rewards: 79.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon5': '0.132', 'AMMO4': '0.144', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.400', 'weapon3': '3.258', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '65.000'} [2024-08-06 07:38:34,449][52647] DAMAGECOUNT value on done: 921737.0 [2024-08-06 07:38:34,450][52647] Sum rewards: 80.269, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.200', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.132', 'weapon4': '0.146', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:34,523][52671] DAMAGECOUNT value on done: 896055.0 [2024-08-06 07:38:34,525][52671] Sum rewards: 75.194, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.019', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.048', 'weapon4': '0.122', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.217', 'weapon2': '0.314', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:34,664][52665] DAMAGECOUNT value on done: 864223.0 [2024-08-06 07:38:34,664][52665] Sum rewards: 66.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.392', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.127', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.684', 'WEAPON3': '0.900', 'weapon3': '3.090', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.783', 'FRAGCOUNT': '53.000'} [2024-08-06 07:38:34,973][52666] DAMAGECOUNT value on done: 879204.0 [2024-08-06 07:38:34,973][52666] Sum rewards: 79.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.218', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.094', 'weapon2': '0.128', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'weapon4': '0.372', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:35,039][52664] DAMAGECOUNT value on done: 919622.0 [2024-08-06 07:38:35,041][52664] Sum rewards: 72.842, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'AMMO3': '0.179', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.384', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 07:38:35,918][52650] Updated weights for policy 0, policy_version 78051 (0.0020) [2024-08-06 07:38:36,248][52649] DAMAGECOUNT value on done: 861626.0 [2024-08-06 07:38:36,248][52649] Sum rewards: 66.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.006', 'WEAPON1': '0.020', 'AMMO4': '0.028', 'weapon4': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO3': '0.185', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.332', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '56.000'} [2024-08-06 07:38:36,468][52663] DAMAGECOUNT value on done: 874568.0 [2024-08-06 07:38:36,469][52663] Sum rewards: 85.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.241', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.146', 'AMMO3': '0.198', 'weapon5': '0.208', 'AMMO4': '0.244', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '68.000'} [2024-08-06 07:38:36,659][52670] DAMAGECOUNT value on done: 867350.0 [2024-08-06 07:38:36,660][52670] Sum rewards: 71.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.343', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.110', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:37,068][52671] DAMAGECOUNT value on done: 889984.0 [2024-08-06 07:38:37,069][52671] Sum rewards: 75.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.349', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.064', 'AMMO3': '0.207', 'weapon5': '0.220', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:37,703][52666] DAMAGECOUNT value on done: 873304.0 [2024-08-06 07:38:37,705][52666] Sum rewards: 76.787, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.595', 'AMMO2': '0.008', 'AMMO5': '0.009', 'AMMO4': '0.037', 'weapon5': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'weapon4': '0.298', 'weapon2': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.852', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '60.000'} [2024-08-06 07:38:37,783][52665] DAMAGECOUNT value on done: 872219.0 [2024-08-06 07:38:37,784][52665] Sum rewards: 71.333, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.094', 'weapon5': '0.182', 'AMMO4': '0.193', 'AMMO3': '0.269', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:37,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 639434752. Throughput: 0: 4354.2. Samples: 159861440. Policy #0 lag: (min: 0.0, avg: 3.5, max: 9.0) [2024-08-06 07:38:37,795][52567] Avg episode reward: [(0, '75.953')] [2024-08-06 07:38:37,845][52664] DAMAGECOUNT value on done: 915420.0 [2024-08-06 07:38:37,846][52664] Sum rewards: 78.901, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.136', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.162', 'weapon4': '0.188', 'WEAPON4': '0.250', 'weapon5': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:37,855][52670] Large shaping reward 2.559 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2024-08-06 07:38:39,129][52670] DAMAGECOUNT value on done: 875506.0 [2024-08-06 07:38:39,131][52670] Sum rewards: 78.771, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.400', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.175', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '66.000'} [2024-08-06 07:38:39,385][52649] DAMAGECOUNT value on done: 857489.0 [2024-08-06 07:38:39,385][52649] Sum rewards: 84.388, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.171', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.062', 'weapon5': '0.132', 'AMMO4': '0.193', 'AMMO3': '0.263', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.238', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '73.000'} [2024-08-06 07:38:40,047][52671] DAMAGECOUNT value on done: 895800.0 [2024-08-06 07:38:40,050][52671] Sum rewards: 67.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.534', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.027', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.193', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 07:38:40,054][52650] Updated weights for policy 0, policy_version 78061 (0.0018) [2024-08-06 07:38:40,443][52666] DAMAGECOUNT value on done: 879787.0 [2024-08-06 07:38:40,445][52666] Sum rewards: 92.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.949', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.092', 'weapon5': '0.096', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.290', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '75.000'} [2024-08-06 07:38:40,591][52664] DAMAGECOUNT value on done: 924222.0 [2024-08-06 07:38:40,591][52664] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'HEALTH': '0.114', 'AMMO3': '0.204', 'weapon2': '0.706', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:40,973][52665] DAMAGECOUNT value on done: 871180.0 [2024-08-06 07:38:40,974][52665] Sum rewards: 78.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.469', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:41,686][52670] DAMAGECOUNT value on done: 872212.0 [2024-08-06 07:38:41,688][52670] Sum rewards: 68.119, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.270', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.158', 'weapon2': '0.166', 'AMMO3': '0.171', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.256', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '54.000'} [2024-08-06 07:38:42,366][52649] DAMAGECOUNT value on done: 868034.0 [2024-08-06 07:38:42,366][52649] Sum rewards: 80.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.806', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.078', 'weapon5': '0.142', 'AMMO3': '0.189', 'AMMO4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '64.500'} [2024-08-06 07:38:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 639516672. Throughput: 0: 4350.7. Samples: 159887540. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:38:42,794][52567] Avg episode reward: [(0, '75.992')] [2024-08-06 07:38:42,887][52666] DAMAGECOUNT value on done: 875545.0 [2024-08-06 07:38:42,887][52666] Sum rewards: 74.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.175', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.210', 'weapon4': '0.212', 'weapon2': '0.506', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:42,899][52671] DAMAGECOUNT value on done: 879533.0 [2024-08-06 07:38:42,900][52671] Sum rewards: 73.510, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.677', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.121', 'weapon5': '0.134', 'AMMO3': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.306', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '59.000'} [2024-08-06 07:38:43,579][52664] DAMAGECOUNT value on done: 923115.0 [2024-08-06 07:38:43,579][52664] Sum rewards: 67.633, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.485', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.147', 'weapon5': '0.164', 'weapon2': '0.234', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.264', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:43,770][52665] DAMAGECOUNT value on done: 877215.0 [2024-08-06 07:38:43,771][52665] Sum rewards: 62.234, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.042', 'AMMO4': '0.120', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.368', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '55.000'} [2024-08-06 07:38:44,418][52670] DAMAGECOUNT value on done: 868576.0 [2024-08-06 07:38:44,423][52670] Sum rewards: 67.443, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'HITCOUNT': '3.190', 'weapon3': '3.472', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:44,966][52650] Updated weights for policy 0, policy_version 78071 (0.0023) [2024-08-06 07:38:45,331][52649] DAMAGECOUNT value on done: 874587.0 [2024-08-06 07:38:45,335][52649] Sum rewards: 77.402, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.383', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.072', 'AMMO4': '0.137', 'AMMO3': '0.164', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.226', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:45,435][52666] DAMAGECOUNT value on done: 873393.0 [2024-08-06 07:38:45,435][52666] Sum rewards: 81.946, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.982', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.060', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:45,741][52649] Large shaping reward 2.605 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 07:38:46,189][52664] DAMAGECOUNT value on done: 921876.0 [2024-08-06 07:38:46,190][52664] Sum rewards: 64.017, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.482', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.044', 'AMMO4': '0.139', 'weapon5': '0.142', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '3.172', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '50.000'} [2024-08-06 07:38:46,741][52665] DAMAGECOUNT value on done: 871740.0 [2024-08-06 07:38:46,743][52665] Sum rewards: 83.556, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.918', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.064', 'weapon5': '0.178', 'AMMO4': '0.246', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '71.000'} [2024-08-06 07:38:47,345][52670] DAMAGECOUNT value on done: 883069.0 [2024-08-06 07:38:47,346][52670] Sum rewards: 82.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-5.250', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO4': '0.188', 'AMMO3': '0.293', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.230', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '72.000'} [2024-08-06 07:38:47,796][52567] Fps is (10 sec: 16381.7, 60 sec: 17339.2, 300 sec: 17439.5). Total num frames: 639598592. Throughput: 0: 4357.1. Samples: 159900530. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:38:47,797][52567] Avg episode reward: [(0, '75.773')] [2024-08-06 07:38:48,099][52668] DAMAGECOUNT value on done: 889908.0 [2024-08-06 07:38:48,099][52668] Sum rewards: 75.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.156', 'weapon5': '0.170', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:48,362][52649] DAMAGECOUNT value on done: 866782.0 [2024-08-06 07:38:48,363][52649] Sum rewards: 73.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.165', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.118', 'weapon4': '0.124', 'AMMO3': '0.175', 'AMMO4': '0.270', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:48,411][52811] DAMAGECOUNT value on done: 840162.0 [2024-08-06 07:38:48,413][52811] Sum rewards: 77.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.737', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.126', 'weapon5': '0.134', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:48,702][52666] DAMAGECOUNT value on done: 881265.0 [2024-08-06 07:38:48,703][52666] Sum rewards: 78.328, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.628', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon5': '0.160', 'AMMO3': '0.185', 'AMMO4': '0.263', 'weapon4': '0.344', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:48,964][52664] DAMAGECOUNT value on done: 933747.0 [2024-08-06 07:38:48,965][52664] Sum rewards: 73.718, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.108', 'weapon2': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.700', 'weapon3': '3.072', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '63.000'} [2024-08-06 07:38:49,388][52665] DAMAGECOUNT value on done: 885985.0 [2024-08-06 07:38:49,389][52665] Sum rewards: 78.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.785', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO3': '0.203', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:49,657][52650] Updated weights for policy 0, policy_version 78081 (0.0013) [2024-08-06 07:38:50,452][52670] DAMAGECOUNT value on done: 863491.0 [2024-08-06 07:38:50,454][52670] Sum rewards: 64.561, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.936', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.128', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.400', 'weapon3': '3.060', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '54.500'} [2024-08-06 07:38:50,979][52649] DAMAGECOUNT value on done: 868305.0 [2024-08-06 07:38:50,981][52649] Sum rewards: 72.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.232', 'weapon5': '0.240', 'weapon4': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.948', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:51,397][52668] DAMAGECOUNT value on done: 891236.0 [2024-08-06 07:38:51,397][52668] Sum rewards: 79.295, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.785', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:51,589][52811] DAMAGECOUNT value on done: 824352.0 [2024-08-06 07:38:51,590][52811] Sum rewards: 73.863, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.040', 'HEALTH': '0.078', 'weapon4': '0.172', 'AMMO3': '0.177', 'weapon5': '0.182', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.050', 'weapon3': '3.162', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '60.000'} [2024-08-06 07:38:51,702][52664] DAMAGECOUNT value on done: 929018.0 [2024-08-06 07:38:51,703][52664] Sum rewards: 76.582, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.110', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.108', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.000', 'weapon3': '3.240', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '61.000'} [2024-08-06 07:38:51,854][52666] DAMAGECOUNT value on done: 875244.0 [2024-08-06 07:38:51,855][52666] Sum rewards: 80.737, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.198', 'AMMO4': '0.219', 'AMMO3': '0.248', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:52,083][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:38:52,353][52665] DAMAGECOUNT value on done: 878095.0 [2024-08-06 07:38:52,356][52665] Sum rewards: 83.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.439', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon4': '0.052', 'weapon5': '0.114', 'AMMO3': '0.233', 'AMMO4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.550', 'weapon3': '3.350', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '70.000'} [2024-08-06 07:38:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 639696896. Throughput: 0: 4358.9. Samples: 159927030. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:38:52,794][52567] Avg episode reward: [(0, '75.900')] [2024-08-06 07:38:53,255][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:38:53,554][52670] DAMAGECOUNT value on done: 879422.0 [2024-08-06 07:38:53,556][52670] Sum rewards: 72.642, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.711', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon4': '0.206', 'weapon2': '0.284', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '60.000'} [2024-08-06 07:38:54,123][52664] DAMAGECOUNT value on done: 927857.0 [2024-08-06 07:38:54,124][52664] Sum rewards: 80.672, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.513', 'AMMO5': '0.031', 'AMMO2': '0.074', 'weapon4': '0.170', 'AMMO3': '0.240', 'weapon5': '0.266', 'weapon2': '0.284', 'AMMO4': '0.368', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.954', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '69.000'} [2024-08-06 07:38:54,139][52649] DAMAGECOUNT value on done: 856235.0 [2024-08-06 07:38:54,139][52649] Sum rewards: 76.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.651', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.220', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'weapon4': '0.368', 'WEAPON3': '1.200', 'weapon3': '2.688', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '62.000'} [2024-08-06 07:38:54,315][52668] DAMAGECOUNT value on done: 885798.0 [2024-08-06 07:38:54,315][52668] Sum rewards: 82.962, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.012', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO3': '0.144', 'AMMO4': '0.162', 'weapon5': '0.168', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:54,495][52650] Updated weights for policy 0, policy_version 78091 (0.0014) [2024-08-06 07:38:54,797][52811] DAMAGECOUNT value on done: 817465.0 [2024-08-06 07:38:54,798][52811] Sum rewards: 69.636, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.864', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.163', 'weapon5': '0.218', 'weapon2': '0.252', 'AMMO4': '0.277', 'WEAPON5': '0.350', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.846', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '54.000'} [2024-08-06 07:38:55,038][52666] DAMAGECOUNT value on done: 880885.0 [2024-08-06 07:38:55,039][52666] Sum rewards: 65.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.410', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.136', 'AMMO4': '0.242', 'weapon5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.268', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.950', 'weapon3': '3.096', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '56.000'} [2024-08-06 07:38:55,454][52665] DAMAGECOUNT value on done: 873319.0 [2024-08-06 07:38:55,456][52665] Sum rewards: 73.256, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.140', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.118', 'AMMO4': '0.149', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '58.000'} [2024-08-06 07:38:56,711][52670] DAMAGECOUNT value on done: 883572.0 [2024-08-06 07:38:56,711][52670] Sum rewards: 71.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.123', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.193', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.642', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '59.500'} [2024-08-06 07:38:57,047][52664] DAMAGECOUNT value on done: 912172.0 [2024-08-06 07:38:57,048][52664] Sum rewards: 87.812, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.084', 'weapon5': '0.214', 'AMMO3': '0.250', 'AMMO4': '0.257', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '72.000'} [2024-08-06 07:38:57,127][52649] DAMAGECOUNT value on done: 865835.0 [2024-08-06 07:38:57,129][52649] Sum rewards: 78.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '65.000'} [2024-08-06 07:38:57,149][52662] Large shaping reward 2.590 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.042, -14.0), ('weapon5', 0.002)] [2024-08-06 07:38:57,179][52668] DAMAGECOUNT value on done: 891151.0 [2024-08-06 07:38:57,180][52668] Sum rewards: 79.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.756', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.126', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.204', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '67.000'} [2024-08-06 07:38:57,794][52567] Fps is (10 sec: 18026.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 639778816. Throughput: 0: 4357.3. Samples: 159953250. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:38:57,794][52567] Avg episode reward: [(0, '76.210')] [2024-08-06 07:38:57,813][52811] DAMAGECOUNT value on done: 821032.0 [2024-08-06 07:38:57,813][52811] Sum rewards: 72.500, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.674', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.140', 'AMMO3': '0.150', 'AMMO4': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.798', 'WEAPON3': '0.900', 'weapon3': '2.816', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '56.500'} [2024-08-06 07:38:58,144][52665] DAMAGECOUNT value on done: 878156.0 [2024-08-06 07:38:58,144][52665] Sum rewards: 75.701, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.897', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.120', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:58,155][52666] DAMAGECOUNT value on done: 865181.0 [2024-08-06 07:38:58,158][52666] Sum rewards: 75.871, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.527', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.167', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '64.000'} [2024-08-06 07:38:58,951][52650] Updated weights for policy 0, policy_version 78101 (0.0031) [2024-08-06 07:38:59,778][52670] DAMAGECOUNT value on done: 877090.0 [2024-08-06 07:38:59,779][52670] Sum rewards: 71.407, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.930', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.084', 'AMMO4': '0.123', 'weapon5': '0.128', 'AMMO3': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.650', 'weapon3': '3.094', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:00,031][52668] DAMAGECOUNT value on done: 878207.0 [2024-08-06 07:39:00,034][52668] Sum rewards: 67.287, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.568', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon5': '0.044', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.738', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '58.000'} [2024-08-06 07:39:00,324][52649] DAMAGECOUNT value on done: 848663.0 [2024-08-06 07:39:00,324][52649] Sum rewards: 67.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.828', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.186', 'weapon4': '0.256', 'AMMO4': '0.276', 'weapon5': '0.350', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '53.500'} [2024-08-06 07:39:00,362][52664] DAMAGECOUNT value on done: 915414.0 [2024-08-06 07:39:00,362][52664] Sum rewards: 64.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon2': '0.132', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.758', 'WEAPON3': '1.250', 'weapon3': '2.668', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '53.000'} [2024-08-06 07:39:00,671][52811] DAMAGECOUNT value on done: 824487.0 [2024-08-06 07:39:00,672][52811] Sum rewards: 77.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.202', 'weapon4': '0.220', 'AMMO4': '0.228', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:00,820][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:39:01,065][52666] DAMAGECOUNT value on done: 885707.0 [2024-08-06 07:39:01,065][52666] Sum rewards: 74.303, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.808', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon4': '0.154', 'AMMO3': '0.233', 'weapon5': '0.274', 'AMMO4': '0.330', 'weapon2': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '62.000'} [2024-08-06 07:39:01,176][52665] DAMAGECOUNT value on done: 871255.0 [2024-08-06 07:39:01,178][52665] Sum rewards: 81.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.068', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.177', 'weapon2': '0.262', 'WEAPON3': '1.150', 'weapon3': '3.368', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 639868928. Throughput: 0: 4360.2. Samples: 159966260. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:39:02,794][52567] Avg episode reward: [(0, '75.944')] [2024-08-06 07:39:02,819][52649] DAMAGECOUNT value on done: 870344.0 [2024-08-06 07:39:02,820][52649] Sum rewards: 71.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.117', 'weapon5': '0.130', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'weapon4': '0.318', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '58.000'} [2024-08-06 07:39:02,944][52668] DAMAGECOUNT value on done: 886545.0 [2024-08-06 07:39:02,946][52668] Sum rewards: 58.955, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.927', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon5': '0.144', 'weapon4': '0.202', 'AMMO3': '0.248', 'AMMO4': '0.261', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '51.000'} [2024-08-06 07:39:03,035][52670] DAMAGECOUNT value on done: 860833.0 [2024-08-06 07:39:03,035][52670] Sum rewards: 78.826, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.910', 'AMMO5': '0.023', 'AMMO2': '0.048', 'weapon4': '0.078', 'AMMO4': '0.239', 'AMMO3': '0.246', 'weapon5': '0.252', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.958', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '68.000'} [2024-08-06 07:39:03,281][52650] Updated weights for policy 0, policy_version 78111 (0.0020) [2024-08-06 07:39:03,558][52664] DAMAGECOUNT value on done: 920800.0 [2024-08-06 07:39:03,558][52664] Sum rewards: 71.193, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.102', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.258', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '57.000'} [2024-08-06 07:39:03,616][52811] DAMAGECOUNT value on done: 839233.0 [2024-08-06 07:39:03,616][52811] Sum rewards: 82.176, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.005', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.096', 'weapon4': '0.124', 'AMMO4': '0.178', 'AMMO3': '0.189', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.344', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:03,738][52665] DAMAGECOUNT value on done: 876838.0 [2024-08-06 07:39:03,739][52665] Sum rewards: 75.469, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.604', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.074', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '64.500'} [2024-08-06 07:39:04,048][52666] DAMAGECOUNT value on done: 880089.0 [2024-08-06 07:39:04,049][52666] Sum rewards: 59.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.718', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.130', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'weapon4': '0.222', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.500', 'HITCOUNT': '2.910', 'weapon3': '3.038', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '53.000'} [2024-08-06 07:39:05,343][52668] DAMAGECOUNT value on done: 888285.0 [2024-08-06 07:39:05,343][52668] Sum rewards: 63.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.556', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon5': '0.066', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon4': '0.164', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.336', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '51.000'} [2024-08-06 07:39:05,366][52649] DAMAGECOUNT value on done: 869559.0 [2024-08-06 07:39:05,367][52649] Sum rewards: 62.944, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.532', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.154', 'AMMO4': '0.172', 'weapon2': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.311', 'weapon4': '0.406', 'WEAPON3': '1.800', 'weapon3': '2.932', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '56.000'} [2024-08-06 07:39:05,678][52670] DAMAGECOUNT value on done: 875107.0 [2024-08-06 07:39:05,678][52670] Sum rewards: 78.310, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.782', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.104', 'AMMO4': '0.125', 'weapon5': '0.184', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:06,238][52664] DAMAGECOUNT value on done: 911993.0 [2024-08-06 07:39:06,238][52664] Sum rewards: 74.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.215', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon2': '0.152', 'AMMO4': '0.220', 'AMMO3': '0.223', 'weapon4': '0.318', 'weapon5': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.870', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:06,580][52665] DAMAGECOUNT value on done: 876621.0 [2024-08-06 07:39:06,580][52665] Sum rewards: 68.784, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.083', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO3': '0.126', 'weapon5': '0.138', 'AMMO4': '0.176', 'weapon2': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.470', 'WEAPON3': '0.900', 'weapon3': '2.990', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '55.000'} [2024-08-06 07:39:06,708][52811] DAMAGECOUNT value on done: 832179.0 [2024-08-06 07:39:06,709][52811] Sum rewards: 69.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.309', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.102', 'weapon5': '0.178', 'AMMO4': '0.197', 'AMMO3': '0.223', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '57.000'} [2024-08-06 07:39:06,901][52666] DAMAGECOUNT value on done: 878283.0 [2024-08-06 07:39:06,902][52666] Sum rewards: 72.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'ARMOR': '0.004', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.101', 'weapon5': '0.114', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.748', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:07,701][52662] DAMAGECOUNT value on done: 883643.0 [2024-08-06 07:39:07,702][52662] Sum rewards: 75.473, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.187', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 639950848. Throughput: 0: 4360.7. Samples: 159992840. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:39:07,794][52567] Avg episode reward: [(0, '75.018')] [2024-08-06 07:39:08,237][52650] Updated weights for policy 0, policy_version 78121 (0.0013) [2024-08-06 07:39:08,337][52668] DAMAGECOUNT value on done: 877757.0 [2024-08-06 07:39:08,337][52668] Sum rewards: 70.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.730', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.102', 'AMMO4': '0.127', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.152', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:08,394][52649] DAMAGECOUNT value on done: 862735.0 [2024-08-06 07:39:08,394][52649] Sum rewards: 68.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.915', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.140', 'weapon5': '0.156', 'weapon2': '0.214', 'AMMO3': '0.215', 'AMMO4': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '56.000'} [2024-08-06 07:39:08,488][52670] DAMAGECOUNT value on done: 884440.0 [2024-08-06 07:39:08,489][52670] Sum rewards: 77.958, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO4': '0.128', 'weapon5': '0.132', 'weapon2': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:09,402][52665] DAMAGECOUNT value on done: 867726.0 [2024-08-06 07:39:09,402][52665] Sum rewards: 75.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.814', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.082', 'AMMO4': '0.114', 'weapon5': '0.148', 'AMMO3': '0.156', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:09,861][52666] DAMAGECOUNT value on done: 872179.0 [2024-08-06 07:39:09,862][52666] Sum rewards: 79.411, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.055', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.170', 'AMMO4': '0.172', 'AMMO3': '0.179', 'weapon2': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.278', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '64.000'} [2024-08-06 07:39:09,924][52811] DAMAGECOUNT value on done: 822213.0 [2024-08-06 07:39:09,924][52811] Sum rewards: 78.786, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.078', 'AMMO3': '0.162', 'AMMO4': '0.184', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 07:39:10,307][52662] DAMAGECOUNT value on done: 893769.0 [2024-08-06 07:39:10,309][52662] Sum rewards: 73.008, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.365', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.132', 'AMMO3': '0.187', 'weapon4': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.283', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:11,477][52670] DAMAGECOUNT value on done: 877908.0 [2024-08-06 07:39:11,477][52670] Sum rewards: 90.498, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.664', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '74.000'} [2024-08-06 07:39:11,896][52668] DAMAGECOUNT value on done: 881473.0 [2024-08-06 07:39:11,897][52668] Sum rewards: 81.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon5': '0.036', 'AMMO4': '0.062', 'weapon4': '0.072', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon2': '0.392', 'WEAPON3': '1.600', 'weapon3': '3.254', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '70.000'} [2024-08-06 07:39:11,962][52665] DAMAGECOUNT value on done: 872843.0 [2024-08-06 07:39:11,963][52665] Sum rewards: 90.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.494', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.044', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.194', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'weapon3': '3.550', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.101', 'FRAGCOUNT': '74.000'} [2024-08-06 07:39:12,780][52666] DAMAGECOUNT value on done: 872451.0 [2024-08-06 07:39:12,781][52666] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'HEALTH': '0.022', 'AMMO2': '0.041', 'weapon4': '0.090', 'AMMO3': '0.162', 'weapon5': '0.170', 'AMMO4': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.000', 'weapon3': '3.156', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 640040960. Throughput: 0: 4364.9. Samples: 160018990. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:39:12,794][52567] Avg episode reward: [(0, '75.051')] [2024-08-06 07:39:13,036][52811] DAMAGECOUNT value on done: 830113.0 [2024-08-06 07:39:13,039][52811] Sum rewards: 67.392, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.450', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.092', 'AMMO4': '0.199', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '59.000'} [2024-08-06 07:39:13,103][52650] Updated weights for policy 0, policy_version 78131 (0.0012) [2024-08-06 07:39:13,243][52662] DAMAGECOUNT value on done: 892820.0 [2024-08-06 07:39:13,243][52662] Sum rewards: 67.066, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.056', 'AMMO4': '0.066', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.274', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.366', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '56.000'} [2024-08-06 07:39:14,368][52670] DAMAGECOUNT value on done: 879873.0 [2024-08-06 07:39:14,369][52670] Sum rewards: 76.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.940', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.124', 'weapon2': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.700', 'weapon3': '3.494', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '66.000'} [2024-08-06 07:39:14,668][52668] DAMAGECOUNT value on done: 889728.0 [2024-08-06 07:39:14,669][52668] Sum rewards: 68.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.755', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.090', 'AMMO3': '0.175', 'weapon5': '0.204', 'AMMO4': '0.233', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.092', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '55.000'} [2024-08-06 07:39:15,037][52665] DAMAGECOUNT value on done: 877852.0 [2024-08-06 07:39:15,038][52665] Sum rewards: 72.085, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.092', 'weapon5': '0.092', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:15,562][52666] DAMAGECOUNT value on done: 889907.0 [2024-08-06 07:39:15,564][52666] Sum rewards: 71.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.915', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.072', 'AMMO4': '0.144', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:15,954][52811] DAMAGECOUNT value on done: 829018.0 [2024-08-06 07:39:15,955][52811] Sum rewards: 97.060, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.270', 'AMMO3': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.440', 'HITCOUNT': '4.270', 'DAMAGECOUNT': '22.500', 'FRAGCOUNT': '82.000'} [2024-08-06 07:39:16,041][52662] DAMAGECOUNT value on done: 879460.0 [2024-08-06 07:39:16,041][52662] Sum rewards: 63.195, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon4': '0.188', 'WEAPON4': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '52.000'} [2024-08-06 07:39:17,208][52667] DAMAGECOUNT value on done: 883966.0 [2024-08-06 07:39:17,209][52667] Sum rewards: 72.727, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.648', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.144', 'weapon4': '0.162', 'AMMO4': '0.181', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:17,456][52668] DAMAGECOUNT value on done: 881689.0 [2024-08-06 07:39:17,456][52668] Sum rewards: 79.622, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.150', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.116', 'weapon5': '0.134', 'AMMO4': '0.165', 'weapon2': '0.246', 'WEAPON5': '0.250', 'AMMO3': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.208', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '69.000'} [2024-08-06 07:39:17,576][52650] Updated weights for policy 0, policy_version 78141 (0.0022) [2024-08-06 07:39:17,795][52567] Fps is (10 sec: 18020.4, 60 sec: 17475.9, 300 sec: 17494.7). Total num frames: 640131072. Throughput: 0: 4375.0. Samples: 160032200. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:39:17,796][52567] Avg episode reward: [(0, '74.815')] [2024-08-06 07:39:18,130][52666] DAMAGECOUNT value on done: 864854.0 [2024-08-06 07:39:18,130][52666] Sum rewards: 70.559, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.132', 'AMMO3': '0.200', 'AMMO4': '0.220', 'weapon4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.916', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2024-08-06 07:39:19,011][52811] DAMAGECOUNT value on done: 832138.0 [2024-08-06 07:39:19,012][52811] Sum rewards: 76.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.083', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'weapon4': '0.182', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '63.000'} [2024-08-06 07:39:19,166][52662] DAMAGECOUNT value on done: 897651.0 [2024-08-06 07:39:19,166][52662] Sum rewards: 78.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.255', 'AMMO5': '0.008', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon4': '0.254', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:20,240][52667] DAMAGECOUNT value on done: 896692.0 [2024-08-06 07:39:20,242][52667] Sum rewards: 78.288, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.122', 'AMMO4': '0.146', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.424', 'weapon4': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.764', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '62.000'} [2024-08-06 07:39:20,464][52668] DAMAGECOUNT value on done: 877047.0 [2024-08-06 07:39:20,464][52668] Sum rewards: 69.618, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.390', 'AMMO5': '0.025', 'AMMO2': '0.074', 'weapon4': '0.152', 'weapon2': '0.226', 'AMMO3': '0.243', 'weapon5': '0.280', 'AMMO4': '0.368', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.500', 'weapon3': '3.032', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '58.000'} [2024-08-06 07:39:21,421][52666] DAMAGECOUNT value on done: 873433.0 [2024-08-06 07:39:21,422][52666] Sum rewards: 81.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.425', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.080', 'weapon4': '0.110', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:22,095][52662] DAMAGECOUNT value on done: 875667.0 [2024-08-06 07:39:22,098][52662] Sum rewards: 71.150, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.256', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.110', 'weapon5': '0.176', 'AMMO3': '0.185', 'AMMO4': '0.188', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.100', 'weapon3': '2.904', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '56.500'} [2024-08-06 07:39:22,142][52811] DAMAGECOUNT value on done: 837702.0 [2024-08-06 07:39:22,143][52811] Sum rewards: 69.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.087', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '58.000'} [2024-08-06 07:39:22,237][52650] Updated weights for policy 0, policy_version 78151 (0.0015) [2024-08-06 07:39:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 640221184. Throughput: 0: 4376.1. Samples: 160058360. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:39:22,794][52567] Avg episode reward: [(0, '74.801')] [2024-08-06 07:39:23,149][52667] DAMAGECOUNT value on done: 893473.0 [2024-08-06 07:39:23,150][52667] Sum rewards: 85.235, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.421', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.134', 'AMMO3': '0.152', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.668', 'WEAPON3': '1.000', 'weapon3': '2.678', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:23,708][52668] DAMAGECOUNT value on done: 875280.0 [2024-08-06 07:39:23,710][52668] Sum rewards: 79.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.648', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.192', 'weapon5': '0.222', 'AMMO4': '0.229', 'AMMO3': '0.232', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.010', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:24,728][52662] DAMAGECOUNT value on done: 883293.0 [2024-08-06 07:39:24,729][52662] Sum rewards: 81.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.623', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.180', 'AMMO4': '0.196', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:25,216][52811] DAMAGECOUNT value on done: 828711.0 [2024-08-06 07:39:25,217][52811] Sum rewards: 73.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.762', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO3': '0.171', 'AMMO4': '0.175', 'weapon4': '0.202', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.194', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '58.000'} [2024-08-06 07:39:25,997][52667] DAMAGECOUNT value on done: 897282.0 [2024-08-06 07:39:25,998][52667] Sum rewards: 85.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.077', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.285', 'FRAGCOUNT': '70.000'} [2024-08-06 07:39:26,753][52668] DAMAGECOUNT value on done: 874869.0 [2024-08-06 07:39:26,754][52668] Sum rewards: 76.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.162', 'weapon5': '0.164', 'weapon4': '0.180', 'AMMO4': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '62.000'} [2024-08-06 07:39:27,043][52650] Updated weights for policy 0, policy_version 78161 (0.0035) [2024-08-06 07:39:27,643][52662] DAMAGECOUNT value on done: 900703.0 [2024-08-06 07:39:27,643][52662] Sum rewards: 63.732, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.026', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.236', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.480', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '53.000'} [2024-08-06 07:39:27,794][52567] Fps is (10 sec: 17205.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 640303104. Throughput: 0: 4379.8. Samples: 160084630. Policy #0 lag: (min: 2.0, avg: 3.8, max: 8.0) [2024-08-06 07:39:27,795][52567] Avg episode reward: [(0, '74.914')] [2024-08-06 07:39:28,323][52811] DAMAGECOUNT value on done: 825607.0 [2024-08-06 07:39:28,323][52811] Sum rewards: 54.775, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.232', 'WEAPON4': '0.300', 'weapon4': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '2.930', 'weapon3': '3.064', 'DAMAGECOUNT': '14.148', 'FRAGCOUNT': '47.000'} [2024-08-06 07:39:29,030][52667] DAMAGECOUNT value on done: 900209.0 [2024-08-06 07:39:29,031][52667] Sum rewards: 78.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.655', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.199', 'weapon5': '0.220', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '66.000'} [2024-08-06 07:39:29,537][52668] DAMAGECOUNT value on done: 869345.0 [2024-08-06 07:39:29,538][52668] Sum rewards: 81.048, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.430', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.160', 'weapon4': '0.174', 'weapon2': '0.370', 'WEAPON3': '0.950', 'weapon3': '3.310', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:30,299][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:39:30,685][52667] Large shaping reward 3.516 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:39:30,818][52662] DAMAGECOUNT value on done: 885081.0 [2024-08-06 07:39:30,820][52662] Sum rewards: 76.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '64.000'} [2024-08-06 07:39:31,440][52811] DAMAGECOUNT value on done: 825701.0 [2024-08-06 07:39:31,443][52811] Sum rewards: 77.122, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.098', 'AMMO4': '0.154', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.656', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '64.000'} [2024-08-06 07:39:31,686][52650] Updated weights for policy 0, policy_version 78171 (0.0014) [2024-08-06 07:39:31,980][52668] DAMAGECOUNT value on done: 884072.0 [2024-08-06 07:39:31,980][52668] Sum rewards: 78.629, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.450', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.150', 'weapon5': '0.204', 'weapon2': '0.226', 'AMMO3': '0.247', 'AMMO4': '0.277', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:32,142][52667] DAMAGECOUNT value on done: 897155.0 [2024-08-06 07:39:32,142][52667] Sum rewards: 75.019, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.880', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.170', 'weapon4': '0.180', 'AMMO4': '0.182', 'AMMO3': '0.197', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 640385024. Throughput: 0: 4382.2. Samples: 160097720. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:39:32,794][52567] Avg episode reward: [(0, '74.678')] [2024-08-06 07:39:33,678][52662] DAMAGECOUNT value on done: 893798.0 [2024-08-06 07:39:33,679][52662] Sum rewards: 88.858, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon2': '0.186', 'weapon5': '0.222', 'weapon4': '0.246', 'AMMO3': '0.257', 'AMMO4': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '75.000'} [2024-08-06 07:39:34,362][52811] DAMAGECOUNT value on done: 827939.0 [2024-08-06 07:39:34,363][52811] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.610', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon2': '0.172', 'AMMO3': '0.218', 'weapon5': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.448', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:34,721][52668] DAMAGECOUNT value on done: 886193.0 [2024-08-06 07:39:34,725][52668] Sum rewards: 70.152, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-3.300', 'AMMO5': '0.025', 'AMMO2': '0.049', 'weapon5': '0.100', 'weapon4': '0.222', 'AMMO4': '0.243', 'AMMO3': '0.272', 'weapon2': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.936', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '62.000'} [2024-08-06 07:39:35,257][52667] DAMAGECOUNT value on done: 890751.0 [2024-08-06 07:39:35,262][52667] Sum rewards: 80.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon2': '0.170', 'AMMO3': '0.183', 'weapon5': '0.190', 'AMMO4': '0.311', 'weapon4': '0.370', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '64.000'} [2024-08-06 07:39:36,311][52650] Updated weights for policy 0, policy_version 78181 (0.0014) [2024-08-06 07:39:36,406][52662] DAMAGECOUNT value on done: 885410.0 [2024-08-06 07:39:36,408][52662] Sum rewards: 90.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.114', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.060', 'weapon5': '0.166', 'AMMO3': '0.211', 'AMMO4': '0.255', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.282', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.216', 'FRAGCOUNT': '72.000'} [2024-08-06 07:39:37,376][52660] DAMAGECOUNT value on done: 882039.0 [2024-08-06 07:39:37,376][52660] Sum rewards: 66.673, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.140', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.140', 'weapon4': '0.184', 'AMMO3': '0.256', 'AMMO4': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '57.000'} [2024-08-06 07:39:37,479][52811] DAMAGECOUNT value on done: 835291.0 [2024-08-06 07:39:37,480][52811] Sum rewards: 81.254, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.412', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon2': '0.204', 'AMMO4': '0.225', 'weapon5': '0.228', 'AMMO3': '0.239', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.414', 'FRAGCOUNT': '66.000'} [2024-08-06 07:39:37,736][52668] DAMAGECOUNT value on done: 884074.0 [2024-08-06 07:39:37,739][52668] Sum rewards: 69.249, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.240', 'weapon2': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '55.000'} [2024-08-06 07:39:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 640483328. Throughput: 0: 4376.9. Samples: 160123990. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:39:37,795][52567] Avg episode reward: [(0, '75.020')] [2024-08-06 07:39:38,046][52667] DAMAGECOUNT value on done: 889079.0 [2024-08-06 07:39:38,047][52667] Sum rewards: 73.145, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.376', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon5': '0.060', 'AMMO4': '0.097', 'weapon4': '0.144', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'weapon2': '0.200', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.388', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:39,552][52662] DAMAGECOUNT value on done: 885182.0 [2024-08-06 07:39:39,553][52662] Sum rewards: 80.968, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.149', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.256', 'weapon2': '0.540', 'WEAPON3': '0.950', 'weapon3': '3.196', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:40,096][52660] DAMAGECOUNT value on done: 875687.0 [2024-08-06 07:39:40,096][52660] Sum rewards: 84.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.556', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.296', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '71.000'} [2024-08-06 07:39:40,413][52803] DAMAGECOUNT value on done: 823906.0 [2024-08-06 07:39:40,414][52803] Sum rewards: 68.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.488', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.102', 'weapon4': '0.114', 'AMMO4': '0.169', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.226', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '56.000'} [2024-08-06 07:39:40,488][52668] DAMAGECOUNT value on done: 888560.0 [2024-08-06 07:39:40,488][52668] Sum rewards: 72.183, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.273', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.084', 'AMMO4': '0.111', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '59.000'} [2024-08-06 07:39:40,613][52811] DAMAGECOUNT value on done: 837940.0 [2024-08-06 07:39:40,615][52811] Sum rewards: 83.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'weapon2': '0.174', 'AMMO3': '0.186', 'WEAPON3': '1.150', 'weapon3': '3.494', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '68.000'} [2024-08-06 07:39:40,855][52650] Updated weights for policy 0, policy_version 78191 (0.0026) [2024-08-06 07:39:40,956][52667] DAMAGECOUNT value on done: 889273.0 [2024-08-06 07:39:40,956][52667] Sum rewards: 71.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO4': '0.188', 'weapon5': '0.214', 'AMMO3': '0.240', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '2.864', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:42,395][52662] DAMAGECOUNT value on done: 878187.0 [2024-08-06 07:39:42,404][52662] Sum rewards: 75.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.100', 'weapon5': '0.130', 'weapon2': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'weapon3': '3.456', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:42,584][52660] DAMAGECOUNT value on done: 885511.0 [2024-08-06 07:39:42,585][52660] Sum rewards: 88.036, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.178', 'weapon2': '0.702', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '70.000'} [2024-08-06 07:39:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 640565248. Throughput: 0: 4386.0. Samples: 160150620. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:39:42,794][52567] Avg episode reward: [(0, '75.269')] [2024-08-06 07:39:42,827][52668] DAMAGECOUNT value on done: 890641.0 [2024-08-06 07:39:42,827][52668] Sum rewards: 84.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.456', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.120', 'weapon5': '0.184', 'AMMO4': '0.197', 'AMMO3': '0.219', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '68.000'} [2024-08-06 07:39:43,643][52803] DAMAGECOUNT value on done: 821885.0 [2024-08-06 07:39:43,643][52803] Sum rewards: 77.695, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.553', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.170', 'weapon4': '0.190', 'AMMO3': '0.192', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:43,689][52811] DAMAGECOUNT value on done: 824392.0 [2024-08-06 07:39:43,689][52811] Sum rewards: 85.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.126', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.082', 'weapon5': '0.184', 'AMMO4': '0.232', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '72.000'} [2024-08-06 07:39:43,917][52671] Large shaping reward 2.520 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0), ('weapon5', 0.002)] [2024-08-06 07:39:44,088][52667] DAMAGECOUNT value on done: 896534.0 [2024-08-06 07:39:44,088][52667] Sum rewards: 80.065, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.235', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.118', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '70.000'} [2024-08-06 07:39:45,245][52662] DAMAGECOUNT value on done: 888738.0 [2024-08-06 07:39:45,247][52662] Sum rewards: 64.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.076', 'weapon4': '0.114', 'AMMO4': '0.167', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.170', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '56.000'} [2024-08-06 07:39:45,640][52650] Updated weights for policy 0, policy_version 78201 (0.0029) [2024-08-06 07:39:45,724][52660] DAMAGECOUNT value on done: 897195.0 [2024-08-06 07:39:45,724][52660] Sum rewards: 76.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.835', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.139', 'weapon4': '0.172', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.584', 'WEAPON3': '1.450', 'weapon3': '2.828', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '64.000'} [2024-08-06 07:39:46,663][52667] DAMAGECOUNT value on done: 884416.0 [2024-08-06 07:39:46,663][52667] Sum rewards: 86.012, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.064', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.358', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '71.000'} [2024-08-06 07:39:46,686][52803] DAMAGECOUNT value on done: 830202.0 [2024-08-06 07:39:46,686][52803] Sum rewards: 73.187, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.465', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.090', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon5': '0.218', 'AMMO4': '0.240', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:46,894][52811] DAMAGECOUNT value on done: 823586.0 [2024-08-06 07:39:46,895][52811] Sum rewards: 66.768, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.725', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.122', 'AMMO4': '0.132', 'weapon2': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.317', 'WEAPON3': '1.850', 'weapon3': '3.408', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:46,896][52668] Large shaping reward 2.611 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2024-08-06 07:39:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17613.4, 300 sec: 17467.0). Total num frames: 640655360. Throughput: 0: 4385.8. Samples: 160163620. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:39:47,794][52567] Avg episode reward: [(0, '75.230')] [2024-08-06 07:39:48,541][52662] DAMAGECOUNT value on done: 879596.0 [2024-08-06 07:39:48,543][52662] Sum rewards: 91.446, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.098', 'weapon5': '0.134', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '22.500', 'FRAGCOUNT': '71.000'} [2024-08-06 07:39:48,970][52660] DAMAGECOUNT value on done: 878660.0 [2024-08-06 07:39:48,970][52660] Sum rewards: 75.276, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.243', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.364', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '63.000'} [2024-08-06 07:39:49,344][52667] DAMAGECOUNT value on done: 887115.0 [2024-08-06 07:39:49,347][52667] Sum rewards: 76.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.128', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'weapon4': '0.126', 'WEAPON4': '0.150', 'weapon2': '0.208', 'AMMO3': '0.216', 'WEAPON3': '1.300', 'weapon3': '3.424', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '63.000'} [2024-08-06 07:39:49,753][52803] DAMAGECOUNT value on done: 828333.0 [2024-08-06 07:39:49,755][52803] Sum rewards: 71.409, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.451', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.171', 'weapon5': '0.204', 'AMMO3': '0.262', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.176', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '61.000'} [2024-08-06 07:39:50,153][52659] DAMAGECOUNT value on done: 889947.0 [2024-08-06 07:39:50,153][52659] Sum rewards: 77.687, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.650', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.204', 'AMMO3': '0.274', 'weapon5': '0.274', 'AMMO4': '0.317', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.762', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:50,291][52650] Updated weights for policy 0, policy_version 78211 (0.0013) [2024-08-06 07:39:51,353][52662] DAMAGECOUNT value on done: 896940.0 [2024-08-06 07:39:51,355][52662] Sum rewards: 73.475, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.009', 'AMMO2': '0.032', 'HEALTH': '0.090', 'weapon5': '0.112', 'weapon4': '0.116', 'AMMO4': '0.158', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.284', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '58.000'} [2024-08-06 07:39:51,895][52660] DAMAGECOUNT value on done: 877973.0 [2024-08-06 07:39:51,896][52660] Sum rewards: 81.421, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO2': '0.006', 'HEALTH': '0.030', 'AMMO4': '0.032', 'AMMO3': '0.164', 'weapon2': '0.306', 'WEAPON3': '0.900', 'HITCOUNT': '3.570', 'weapon3': '3.574', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '65.000'} [2024-08-06 07:39:52,317][52667] DAMAGECOUNT value on done: 897072.0 [2024-08-06 07:39:52,317][52667] Sum rewards: 75.372, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.178', 'weapon4': '0.228', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.876', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '64.000'} [2024-08-06 07:39:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 640745472. Throughput: 0: 4381.3. Samples: 160190000. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:39:52,794][52567] Avg episode reward: [(0, '75.411')] [2024-08-06 07:39:52,853][52803] DAMAGECOUNT value on done: 825029.0 [2024-08-06 07:39:52,854][52803] Sum rewards: 73.439, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.164', 'weapon5': '0.228', 'AMMO4': '0.231', 'weapon2': '0.330', 'weapon4': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '57.000'} [2024-08-06 07:39:53,006][52659] DAMAGECOUNT value on done: 884268.0 [2024-08-06 07:39:53,007][52659] Sum rewards: 64.031, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.775', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon4': '0.088', 'weapon5': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon2': '0.520', 'WEAPON3': '0.950', 'HITCOUNT': '3.120', 'weapon3': '3.160', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '50.000'} [2024-08-06 07:39:54,069][52662] DAMAGECOUNT value on done: 888960.0 [2024-08-06 07:39:54,069][52662] Sum rewards: 75.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.725', 'AMMO4': '-0.029', 'AMMO2': '-0.006', 'AMMO3': '0.197', 'weapon2': '0.596', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '62.000'} [2024-08-06 07:39:54,172][52669] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 07:39:54,839][52660] DAMAGECOUNT value on done: 884093.0 [2024-08-06 07:39:54,840][52660] Sum rewards: 63.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.934', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.164', 'weapon5': '0.182', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.252', 'DAMAGECOUNT': '15.348', 'FRAGCOUNT': '52.000'} [2024-08-06 07:39:55,006][52650] Updated weights for policy 0, policy_version 78221 (0.0039) [2024-08-06 07:39:55,412][52667] DAMAGECOUNT value on done: 887536.0 [2024-08-06 07:39:55,416][52667] Sum rewards: 61.689, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.435', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.176', 'AMMO4': '0.178', 'AMMO3': '0.269', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '53.500'} [2024-08-06 07:39:55,525][52659] DAMAGECOUNT value on done: 896030.0 [2024-08-06 07:39:55,528][52659] Sum rewards: 83.137, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.463', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.226', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.033', 'FRAGCOUNT': '67.000'} [2024-08-06 07:39:55,999][52803] DAMAGECOUNT value on done: 825724.0 [2024-08-06 07:39:55,999][52803] Sum rewards: 73.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.898', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO4': '0.027', 'weapon5': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.110', 'weapon2': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON3': '1.450', 'HITCOUNT': '3.450', 'weapon3': '3.504', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '62.000'} [2024-08-06 07:39:57,362][52662] DAMAGECOUNT value on done: 877275.0 [2024-08-06 07:39:57,362][52662] Sum rewards: 71.982, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.028', 'HEALTH': '0.080', 'weapon5': '0.118', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.248', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '2.912', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '58.000'} [2024-08-06 07:39:57,664][52660] DAMAGECOUNT value on done: 891836.0 [2024-08-06 07:39:57,664][52660] Sum rewards: 70.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.445', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.160', 'weapon5': '0.164', 'AMMO4': '0.198', 'AMMO3': '0.210', 'weapon2': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '60.000'} [2024-08-06 07:39:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 640827392. Throughput: 0: 4379.3. Samples: 160216060. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:39:57,802][52567] Avg episode reward: [(0, '75.276')] [2024-08-06 07:39:58,264][52667] DAMAGECOUNT value on done: 891979.0 [2024-08-06 07:39:58,266][52667] Sum rewards: 64.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.472', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.138', 'weapon5': '0.182', 'AMMO4': '0.209', 'AMMO3': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.550', 'HITCOUNT': '3.030', 'weapon3': '3.034', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '55.000'} [2024-08-06 07:39:58,351][52659] DAMAGECOUNT value on done: 888302.0 [2024-08-06 07:39:58,353][52659] Sum rewards: 82.735, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.047', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.040', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.166', 'AMMO3': '0.194', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.316', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '66.000'} [2024-08-06 07:39:59,215][52803] DAMAGECOUNT value on done: 820431.0 [2024-08-06 07:39:59,215][52803] Sum rewards: 76.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.040', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.176', 'weapon4': '0.176', 'AMMO4': '0.225', 'AMMO3': '0.239', 'weapon5': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '62.000'} [2024-08-06 07:39:59,625][52650] Updated weights for policy 0, policy_version 78231 (0.0032) [2024-08-06 07:39:59,949][52820] DAMAGECOUNT value on done: 819869.0 [2024-08-06 07:39:59,953][52820] Sum rewards: 56.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.398', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.210', 'weapon2': '0.218', 'weapon5': '0.262', 'AMMO4': '0.272', 'weapon4': '0.328', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '48.000'} [2024-08-06 07:40:00,189][52662] DAMAGECOUNT value on done: 885097.0 [2024-08-06 07:40:00,192][52662] Sum rewards: 87.654, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.820', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.181', 'weapon5': '0.186', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.016', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '70.000'} [2024-08-06 07:40:00,507][52660] DAMAGECOUNT value on done: 880272.0 [2024-08-06 07:40:00,509][52660] Sum rewards: 73.719, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.575', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.173', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.340', 'WEAPON3': '1.000', 'weapon3': '2.852', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 07:40:00,674][52659] DAMAGECOUNT value on done: 883956.0 [2024-08-06 07:40:00,675][52659] Sum rewards: 71.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.228', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.088', 'weapon5': '0.198', 'AMMO3': '0.227', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:01,346][52667] DAMAGECOUNT value on done: 899254.0 [2024-08-06 07:40:01,348][52667] Sum rewards: 81.473, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.885', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.172', 'AMMO3': '0.192', 'AMMO4': '0.204', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.314', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '65.000'} [2024-08-06 07:40:02,350][52803] DAMAGECOUNT value on done: 820860.0 [2024-08-06 07:40:02,350][52803] Sum rewards: 76.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.710', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO4': '0.217', 'AMMO3': '0.229', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '65.000'} [2024-08-06 07:40:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 640917504. Throughput: 0: 4382.3. Samples: 160229400. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:40:02,802][52567] Avg episode reward: [(0, '75.673')] [2024-08-06 07:40:03,046][52660] DAMAGECOUNT value on done: 875469.0 [2024-08-06 07:40:03,048][52660] Sum rewards: 72.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.064', 'weapon4': '0.064', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '59.000'} [2024-08-06 07:40:03,118][52820] DAMAGECOUNT value on done: 820791.0 [2024-08-06 07:40:03,118][52820] Sum rewards: 73.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.112', 'AMMO4': '0.151', 'AMMO3': '0.202', 'weapon2': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.438', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:03,247][52662] DAMAGECOUNT value on done: 878343.0 [2024-08-06 07:40:03,250][52662] Sum rewards: 86.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.759', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.148', 'AMMO3': '0.178', 'AMMO4': '0.205', 'weapon5': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.100', 'weapon3': '2.874', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '69.000'} [2024-08-06 07:40:03,288][52614] Signal inference workers to stop experience collection... (14350 times) [2024-08-06 07:40:03,289][52614] Signal inference workers to resume experience collection... (14350 times) [2024-08-06 07:40:03,384][52650] InferenceWorker_p0-w0: stopping experience collection (14350 times) [2024-08-06 07:40:03,388][52650] InferenceWorker_p0-w0: resuming experience collection (14350 times) [2024-08-06 07:40:03,449][52659] DAMAGECOUNT value on done: 886710.0 [2024-08-06 07:40:03,450][52659] Sum rewards: 74.262, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon4': '0.206', 'weapon2': '0.210', 'AMMO3': '0.222', 'HEALTH': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:04,257][52650] Updated weights for policy 0, policy_version 78241 (0.0012) [2024-08-06 07:40:04,272][52667] DAMAGECOUNT value on done: 900988.0 [2024-08-06 07:40:04,273][52667] Sum rewards: 62.569, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.128', 'AMMO3': '0.201', 'AMMO4': '0.264', 'weapon2': '0.274', 'weapon5': '0.312', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '51.000'} [2024-08-06 07:40:05,428][52803] DAMAGECOUNT value on done: 828249.0 [2024-08-06 07:40:05,429][52803] Sum rewards: 86.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.102', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.066', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.376', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.015', 'FRAGCOUNT': '69.000'} [2024-08-06 07:40:06,183][52820] DAMAGECOUNT value on done: 820465.0 [2024-08-06 07:40:06,183][52820] Sum rewards: 72.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'WEAPON5': '0.050', 'weapon5': '0.056', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO3': '0.218', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:06,212][52660] DAMAGECOUNT value on done: 885869.0 [2024-08-06 07:40:06,212][52660] Sum rewards: 73.483, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.689', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.104', 'weapon5': '0.110', 'AMMO4': '0.159', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:06,600][52659] DAMAGECOUNT value on done: 889607.0 [2024-08-06 07:40:06,603][52659] Sum rewards: 82.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.124', 'weapon5': '0.152', 'AMMO4': '0.159', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:06,679][52667] DAMAGECOUNT value on done: 893903.0 [2024-08-06 07:40:06,679][52667] Sum rewards: 69.423, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.025', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.058', 'weapon5': '0.088', 'AMMO4': '0.089', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '57.000'} [2024-08-06 07:40:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 641007616. Throughput: 0: 4379.6. Samples: 160255440. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:40:07,794][52567] Avg episode reward: [(0, '75.884')] [2024-08-06 07:40:07,806][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:40:08,560][52803] DAMAGECOUNT value on done: 820917.0 [2024-08-06 07:40:08,561][52803] Sum rewards: 77.975, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.856', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.120', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:08,661][52663] Large shaping reward 3.642 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:40:09,175][52650] Updated weights for policy 0, policy_version 78251 (0.0032) [2024-08-06 07:40:09,224][52660] DAMAGECOUNT value on done: 876727.0 [2024-08-06 07:40:09,225][52660] Sum rewards: 63.809, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.470', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon4': '0.168', 'weapon2': '0.236', 'weapon5': '0.236', 'AMMO3': '0.249', 'AMMO4': '0.310', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.930', 'weapon3': '3.090', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '56.000'} [2024-08-06 07:40:09,348][52667] DAMAGECOUNT value on done: 890739.0 [2024-08-06 07:40:09,349][52667] Sum rewards: 66.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.855', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.120', 'weapon5': '0.138', 'AMMO3': '0.195', 'weapon2': '0.230', 'AMMO4': '0.233', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.000'} [2024-08-06 07:40:09,353][52820] DAMAGECOUNT value on done: 809286.0 [2024-08-06 07:40:09,353][52820] Sum rewards: 64.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.408', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.102', 'weapon5': '0.146', 'AMMO3': '0.191', 'AMMO4': '0.201', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.840', 'weapon3': '3.274', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '53.000'} [2024-08-06 07:40:09,735][52659] DAMAGECOUNT value on done: 886755.0 [2024-08-06 07:40:09,736][52659] Sum rewards: 58.073, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.038', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon2': '0.182', 'weapon5': '0.210', 'AMMO4': '0.249', 'AMMO3': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.770', 'weapon3': '3.200', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '54.000'} [2024-08-06 07:40:11,760][52803] DAMAGECOUNT value on done: 835242.0 [2024-08-06 07:40:11,762][52803] Sum rewards: 67.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.455', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.176', 'AMMO4': '0.187', 'AMMO3': '0.248', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.162', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '59.000'} [2024-08-06 07:40:12,073][52667] DAMAGECOUNT value on done: 895672.0 [2024-08-06 07:40:12,073][52667] Sum rewards: 78.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.144', 'weapon5': '0.202', 'AMMO4': '0.248', 'AMMO3': '0.250', 'weapon2': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.164', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '65.000'} [2024-08-06 07:40:12,136][52660] DAMAGECOUNT value on done: 878596.0 [2024-08-06 07:40:12,137][52660] Sum rewards: 72.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.902', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.216', 'weapon2': '0.246', 'AMMO3': '0.247', 'weapon4': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.866', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:12,477][52659] DAMAGECOUNT value on done: 886849.0 [2024-08-06 07:40:12,478][52659] Sum rewards: 73.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.224', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.194', 'AMMO3': '0.195', 'weapon5': '0.222', 'AMMO4': '0.235', 'weapon2': '0.382', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:12,527][52820] DAMAGECOUNT value on done: 822690.0 [2024-08-06 07:40:12,528][52820] Sum rewards: 62.488, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.544', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.114', 'AMMO3': '0.229', 'weapon5': '0.236', 'AMMO4': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.700', 'weapon3': '3.016', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '52.000'} [2024-08-06 07:40:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 641097728. Throughput: 0: 4378.7. Samples: 160281670. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 07:40:12,794][52567] Avg episode reward: [(0, '75.029')] [2024-08-06 07:40:13,662][52650] Updated weights for policy 0, policy_version 78261 (0.0022) [2024-08-06 07:40:14,612][52660] DAMAGECOUNT value on done: 889304.0 [2024-08-06 07:40:14,613][52660] Sum rewards: 61.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.015', 'AMMO2': '0.070', 'AMMO3': '0.160', 'weapon4': '0.192', 'weapon5': '0.210', 'AMMO4': '0.349', 'WEAPON5': '0.450', 'weapon2': '0.492', 'WEAPON4': '0.700', 'WEAPON3': '1.000', 'HITCOUNT': '2.770', 'weapon3': '2.810', 'DAMAGECOUNT': '15.486', 'FRAGCOUNT': '50.000'} [2024-08-06 07:40:14,959][52803] DAMAGECOUNT value on done: 828451.0 [2024-08-06 07:40:14,962][52803] Sum rewards: 66.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.199', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.230', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '54.000'} [2024-08-06 07:40:15,094][52659] DAMAGECOUNT value on done: 895884.0 [2024-08-06 07:40:15,098][52659] Sum rewards: 66.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.051', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.208', 'AMMO4': '0.210', 'AMMO3': '0.212', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '57.000'} [2024-08-06 07:40:15,623][52820] DAMAGECOUNT value on done: 810002.0 [2024-08-06 07:40:15,626][52820] Sum rewards: 75.559, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.096', 'AMMO4': '0.217', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:17,292][52795] DAMAGECOUNT value on done: 821435.0 [2024-08-06 07:40:17,296][52795] Sum rewards: 74.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.985', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.182', 'AMMO3': '0.209', 'weapon2': '0.214', 'weapon5': '0.222', 'AMMO4': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:17,566][52660] DAMAGECOUNT value on done: 902725.0 [2024-08-06 07:40:17,568][52660] Sum rewards: 72.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.841', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.084', 'weapon4': '0.146', 'weapon2': '0.160', 'AMMO4': '0.172', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.408', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:17,764][52659] DAMAGECOUNT value on done: 881056.0 [2024-08-06 07:40:17,764][52659] Sum rewards: 75.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.428', 'AMMO2': '0.007', 'AMMO4': '0.037', 'AMMO3': '0.197', 'weapon2': '0.374', 'WEAPON3': '1.250', 'HITCOUNT': '3.420', 'weapon3': '3.520', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.6, 300 sec: 17439.2). Total num frames: 641179648. Throughput: 0: 4382.2. Samples: 160294920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:17,802][52567] Avg episode reward: [(0, '74.643')] [2024-08-06 07:40:18,184][52803] DAMAGECOUNT value on done: 821899.0 [2024-08-06 07:40:18,184][52803] Sum rewards: 61.190, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.018', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO3': '0.179', 'weapon5': '0.202', 'AMMO4': '0.227', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.474', 'WEAPON3': '1.150', 'HITCOUNT': '2.670', 'weapon3': '3.048', 'DAMAGECOUNT': '14.208', 'FRAGCOUNT': '52.000'} [2024-08-06 07:40:18,302][52650] Updated weights for policy 0, policy_version 78271 (0.0030) [2024-08-06 07:40:18,773][52820] DAMAGECOUNT value on done: 816081.0 [2024-08-06 07:40:18,773][52820] Sum rewards: 81.865, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.203', 'weapon2': '0.240', 'WEAPON3': '1.250', 'weapon3': '3.586', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:20,425][52659] DAMAGECOUNT value on done: 893458.0 [2024-08-06 07:40:20,427][52659] Sum rewards: 74.348, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.300', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.152', 'weapon4': '0.184', 'weapon5': '0.188', 'AMMO4': '0.209', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.488', 'WEAPON3': '1.000', 'weapon3': '2.934', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '58.000'} [2024-08-06 07:40:20,463][52795] DAMAGECOUNT value on done: 807797.0 [2024-08-06 07:40:20,464][52795] Sum rewards: 68.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.168', 'AMMO4': '0.174', 'AMMO3': '0.191', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '56.000'} [2024-08-06 07:40:20,669][52660] DAMAGECOUNT value on done: 880143.0 [2024-08-06 07:40:20,672][52660] Sum rewards: 81.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.090', 'AMMO4': '0.146', 'AMMO3': '0.189', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:21,267][52803] DAMAGECOUNT value on done: 838516.0 [2024-08-06 07:40:21,270][52803] Sum rewards: 80.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.480', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.141', 'weapon4': '0.142', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '67.000'} [2024-08-06 07:40:22,009][52820] DAMAGECOUNT value on done: 819659.0 [2024-08-06 07:40:22,009][52820] Sum rewards: 82.702, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.527', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon4': '0.180', 'weapon5': '0.212', 'weapon2': '0.254', 'AMMO3': '0.285', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.032', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.475', 'FRAGCOUNT': '71.000'} [2024-08-06 07:40:22,795][52567] Fps is (10 sec: 17201.4, 60 sec: 17476.0, 300 sec: 17494.7). Total num frames: 641269760. Throughput: 0: 4376.4. Samples: 160320930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:22,803][52567] Avg episode reward: [(0, '74.743')] [2024-08-06 07:40:23,027][52659] DAMAGECOUNT value on done: 884606.0 [2024-08-06 07:40:23,027][52659] Sum rewards: 75.807, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon4': '0.246', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:23,190][52650] Updated weights for policy 0, policy_version 78281 (0.0020) [2024-08-06 07:40:23,747][52795] DAMAGECOUNT value on done: 813330.0 [2024-08-06 07:40:23,748][52795] Sum rewards: 81.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.582', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.220', 'WEAPON3': '1.350', 'weapon3': '3.462', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '67.000'} [2024-08-06 07:40:23,800][52660] DAMAGECOUNT value on done: 888071.0 [2024-08-06 07:40:23,801][52660] Sum rewards: 71.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.584', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.062', 'AMMO3': '0.172', 'AMMO4': '0.201', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.970', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '58.000'} [2024-08-06 07:40:24,365][52803] DAMAGECOUNT value on done: 821537.0 [2024-08-06 07:40:24,365][52803] Sum rewards: 70.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.395', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.120', 'weapon2': '0.190', 'AMMO4': '0.273', 'AMMO3': '0.278', 'weapon5': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:25,035][52820] DAMAGECOUNT value on done: 823893.0 [2024-08-06 07:40:25,038][52820] Sum rewards: 62.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.869', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.248', 'weapon4': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '54.000'} [2024-08-06 07:40:26,083][52659] DAMAGECOUNT value on done: 884999.0 [2024-08-06 07:40:26,085][52659] Sum rewards: 79.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.164', 'weapon2': '0.210', 'AMMO4': '0.241', 'weapon5': '0.260', 'AMMO3': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:26,898][52795] DAMAGECOUNT value on done: 825255.0 [2024-08-06 07:40:26,899][52795] Sum rewards: 74.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.462', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.163', 'weapon4': '0.172', 'weapon5': '0.222', 'AMMO4': '0.260', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '57.000'} [2024-08-06 07:40:27,013][52660] DAMAGECOUNT value on done: 886079.0 [2024-08-06 07:40:27,014][52660] Sum rewards: 87.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.232', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.185', 'AMMO4': '0.198', 'weapon5': '0.212', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.698', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '72.000'} [2024-08-06 07:40:27,572][52650] Updated weights for policy 0, policy_version 78291 (0.0015) [2024-08-06 07:40:27,597][52803] DAMAGECOUNT value on done: 828416.0 [2024-08-06 07:40:27,598][52803] Sum rewards: 78.681, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.770', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.155', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '3.250', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:27,612][52658] DAMAGECOUNT value on done: 888182.0 [2024-08-06 07:40:27,616][52658] Sum rewards: 81.611, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.719', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.126', 'AMMO4': '0.127', 'weapon4': '0.150', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.050', 'weapon3': '3.242', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '64.000'} [2024-08-06 07:40:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 641359872. Throughput: 0: 4369.3. Samples: 160347240. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:27,794][52567] Avg episode reward: [(0, '74.789')] [2024-08-06 07:40:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078291_641359872.pth... [2024-08-06 07:40:27,943][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000077778_637157376.pth [2024-08-06 07:40:28,322][52820] DAMAGECOUNT value on done: 830951.0 [2024-08-06 07:40:28,324][52820] Sum rewards: 72.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.568', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.140', 'AMMO4': '0.142', 'weapon4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.026', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:29,362][52659] DAMAGECOUNT value on done: 889651.0 [2024-08-06 07:40:29,363][52659] Sum rewards: 77.637, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.562', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.294', 'WEAPON3': '1.650', 'weapon3': '3.088', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:29,781][52660] DAMAGECOUNT value on done: 876271.0 [2024-08-06 07:40:29,782][52660] Sum rewards: 69.619, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.607', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.072', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.162', 'weapon2': '0.512', 'WEAPON3': '1.000', 'HITCOUNT': '3.190', 'weapon3': '3.242', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '56.000'} [2024-08-06 07:40:30,117][52795] DAMAGECOUNT value on done: 811433.0 [2024-08-06 07:40:30,117][52795] Sum rewards: 85.681, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.110', 'weapon5': '0.176', 'AMMO4': '0.213', 'AMMO3': '0.214', 'weapon2': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.234', 'FRAGCOUNT': '70.000'} [2024-08-06 07:40:30,673][52803] DAMAGECOUNT value on done: 831565.0 [2024-08-06 07:40:30,674][52803] Sum rewards: 70.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.415', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.068', 'AMMO4': '0.138', 'weapon5': '0.174', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:30,685][52658] DAMAGECOUNT value on done: 891559.0 [2024-08-06 07:40:30,686][52658] Sum rewards: 72.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.115', 'AMMO5': '0.012', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO4': '0.077', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.278', 'weapon4': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.118', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:31,640][52820] DAMAGECOUNT value on done: 813476.0 [2024-08-06 07:40:31,640][52820] Sum rewards: 81.238, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.920', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.140', 'weapon4': '0.150', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.338', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '70.000'} [2024-08-06 07:40:32,327][52659] DAMAGECOUNT value on done: 887520.0 [2024-08-06 07:40:32,328][52659] Sum rewards: 82.366, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.132', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.700', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '65.000'} [2024-08-06 07:40:32,599][52650] Updated weights for policy 0, policy_version 78301 (0.0014) [2024-08-06 07:40:32,794][52567] Fps is (10 sec: 17205.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 641441792. Throughput: 0: 4369.6. Samples: 160360250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:32,794][52567] Avg episode reward: [(0, '74.708')] [2024-08-06 07:40:32,892][52660] DAMAGECOUNT value on done: 876052.0 [2024-08-06 07:40:32,892][52660] Sum rewards: 84.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.192', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.235', 'weapon2': '0.248', 'weapon4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '68.000'} [2024-08-06 07:40:33,273][52795] DAMAGECOUNT value on done: 817170.0 [2024-08-06 07:40:33,273][52795] Sum rewards: 59.393, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.005', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.074', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.270', 'AMMO3': '0.282', 'WEAPON3': '1.650', 'HITCOUNT': '3.050', 'weapon3': '3.198', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 07:40:33,717][52803] DAMAGECOUNT value on done: 836706.0 [2024-08-06 07:40:33,716][52658] DAMAGECOUNT value on done: 892993.0 [2024-08-06 07:40:33,719][52803] Sum rewards: 71.593, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.924', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.177', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '57.000'} [2024-08-06 07:40:33,719][52658] Sum rewards: 74.145, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.449', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.024', 'AMMO4': '0.041', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.400', 'weapon3': '3.490', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:34,744][52820] DAMAGECOUNT value on done: 823625.0 [2024-08-06 07:40:34,747][52820] Sum rewards: 76.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.531', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.086', 'weapon4': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.326', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.000'} [2024-08-06 07:40:34,757][52659] DAMAGECOUNT value on done: 896991.0 [2024-08-06 07:40:34,757][52659] Sum rewards: 73.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.091', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.105', 'weapon5': '0.136', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.380', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '59.000'} [2024-08-06 07:40:36,634][52795] DAMAGECOUNT value on done: 827158.0 [2024-08-06 07:40:36,637][52795] Sum rewards: 74.565, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.905', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.114', 'AMMO4': '0.154', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.276', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:36,770][52658] DAMAGECOUNT value on done: 890869.0 [2024-08-06 07:40:36,770][52658] Sum rewards: 67.741, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.281', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.152', 'AMMO4': '0.160', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.278', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '54.000'} [2024-08-06 07:40:36,838][52803] DAMAGECOUNT value on done: 835708.0 [2024-08-06 07:40:36,840][52803] Sum rewards: 83.389, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.162', 'AMMO4': '0.182', 'weapon5': '0.188', 'weapon2': '0.204', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'HEALTH': '0.351', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.580', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:37,303][52650] Updated weights for policy 0, policy_version 78311 (0.0014) [2024-08-06 07:40:37,372][52659] DAMAGECOUNT value on done: 880881.0 [2024-08-06 07:40:37,374][52659] Sum rewards: 81.676, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.311', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.072', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '67.000'} [2024-08-06 07:40:37,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 641523712. Throughput: 0: 4361.3. Samples: 160386260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:37,794][52567] Avg episode reward: [(0, '74.467')] [2024-08-06 07:40:37,949][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:40:38,011][52820] DAMAGECOUNT value on done: 836031.0 [2024-08-06 07:40:38,013][52820] Sum rewards: 81.107, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.440', 'AMMO5': '0.014', 'AMMO2': '0.044', 'AMMO3': '0.184', 'weapon5': '0.218', 'AMMO4': '0.221', 'weapon4': '0.246', 'weapon2': '0.294', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:39,753][52669] DAMAGECOUNT value on done: 888255.0 [2024-08-06 07:40:39,755][52669] Sum rewards: 62.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.151', 'weapon4': '0.162', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.248', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '51.000'} [2024-08-06 07:40:39,869][52795] DAMAGECOUNT value on done: 819782.0 [2024-08-06 07:40:39,875][52795] Sum rewards: 83.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.875', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.144', 'weapon2': '0.146', 'weapon4': '0.170', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.583', 'FRAGCOUNT': '66.000'} [2024-08-06 07:40:39,908][52658] DAMAGECOUNT value on done: 884959.0 [2024-08-06 07:40:39,909][52658] Sum rewards: 68.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.635', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO3': '0.236', 'weapon2': '0.318', 'WEAPON3': '1.400', 'HITCOUNT': '3.400', 'weapon3': '3.432', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '57.000'} [2024-08-06 07:40:39,955][52803] DAMAGECOUNT value on done: 829449.0 [2024-08-06 07:40:39,957][52803] Sum rewards: 75.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.191', 'weapon2': '0.474', 'WEAPON3': '1.150', 'weapon3': '3.388', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:39,969][52659] DAMAGECOUNT value on done: 892183.0 [2024-08-06 07:40:39,970][52659] Sum rewards: 59.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.351', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.064', 'AMMO4': '0.141', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '2.974', 'DAMAGECOUNT': '14.883', 'FRAGCOUNT': '50.000'} [2024-08-06 07:40:41,147][52820] DAMAGECOUNT value on done: 824530.0 [2024-08-06 07:40:41,150][52820] Sum rewards: 61.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.004', 'AMMO5': '0.025', 'AMMO2': '0.047', 'weapon4': '0.116', 'AMMO3': '0.207', 'AMMO4': '0.237', 'weapon5': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '2.890', 'DAMAGECOUNT': '15.768', 'FRAGCOUNT': '53.000'} [2024-08-06 07:40:41,789][52647] DAMAGECOUNT value on done: 945760.0 [2024-08-06 07:40:41,790][52647] Sum rewards: 82.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.072', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '67.000'} [2024-08-06 07:40:41,994][52650] Updated weights for policy 0, policy_version 78321 (0.0033) [2024-08-06 07:40:42,372][52669] DAMAGECOUNT value on done: 882734.0 [2024-08-06 07:40:42,372][52669] Sum rewards: 71.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.245', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.168', 'AMMO4': '0.170', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '58.000'} [2024-08-06 07:40:42,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 641622016. Throughput: 0: 4357.5. Samples: 160412150. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:42,795][52567] Avg episode reward: [(0, '73.907')] [2024-08-06 07:40:42,956][52659] DAMAGECOUNT value on done: 886877.0 [2024-08-06 07:40:42,957][52659] Sum rewards: 75.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.150', 'AMMO4': '0.151', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '63.000'} [2024-08-06 07:40:43,060][52795] DAMAGECOUNT value on done: 823453.0 [2024-08-06 07:40:43,060][52795] Sum rewards: 73.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.804', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.040', 'AMMO4': '0.104', 'weapon5': '0.130', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 07:40:43,259][52658] DAMAGECOUNT value on done: 880108.0 [2024-08-06 07:40:43,261][52658] Sum rewards: 76.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.121', 'weapon2': '0.218', 'AMMO3': '0.226', 'WEAPON3': '1.500', 'weapon3': '3.456', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '64.000'} [2024-08-06 07:40:44,241][52820] DAMAGECOUNT value on done: 826942.0 [2024-08-06 07:40:44,245][52820] Sum rewards: 72.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.124', 'AMMO3': '0.200', 'weapon5': '0.240', 'weapon2': '0.294', 'AMMO4': '0.317', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.088', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:44,333][52647] DAMAGECOUNT value on done: 934194.0 [2024-08-06 07:40:44,334][52647] Sum rewards: 87.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.306', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.107', 'AMMO3': '0.171', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.340', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.778', 'FRAGCOUNT': '69.000'} [2024-08-06 07:40:45,605][52669] DAMAGECOUNT value on done: 893765.0 [2024-08-06 07:40:45,606][52669] Sum rewards: 69.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.782', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.126', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '57.000'} [2024-08-06 07:40:45,811][52794] DAMAGECOUNT value on done: 880957.0 [2024-08-06 07:40:45,811][52794] Sum rewards: 68.551, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.330', 'AMMO5': '0.028', 'AMMO2': '0.078', 'weapon4': '0.190', 'weapon2': '0.228', 'AMMO3': '0.256', 'weapon5': '0.278', 'AMMO4': '0.388', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:46,182][52795] DAMAGECOUNT value on done: 825768.0 [2024-08-06 07:40:46,183][52795] Sum rewards: 82.582, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.094', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.300', 'weapon3': '3.422', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '67.000'} [2024-08-06 07:40:46,278][52658] DAMAGECOUNT value on done: 892813.0 [2024-08-06 07:40:46,278][52658] Sum rewards: 85.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.638', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.169', 'AMMO4': '0.185', 'weapon5': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'weapon4': '0.496', 'WEAPON3': '0.950', 'weapon3': '2.550', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '69.000'} [2024-08-06 07:40:46,739][52647] DAMAGECOUNT value on done: 940949.0 [2024-08-06 07:40:46,740][52647] Sum rewards: 80.403, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.851', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.062', 'weapon5': '0.086', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.372', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '67.000'} [2024-08-06 07:40:46,986][52650] Updated weights for policy 0, policy_version 78331 (0.0022) [2024-08-06 07:40:47,492][52820] DAMAGECOUNT value on done: 822367.0 [2024-08-06 07:40:47,494][52820] Sum rewards: 65.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO4': '-0.025', 'AMMO2': '-0.005', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.229', 'weapon2': '0.912', 'WEAPON3': '1.450', 'weapon3': '2.748', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '56.000'} [2024-08-06 07:40:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 641703936. Throughput: 0: 4347.3. Samples: 160425030. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:47,794][52567] Avg episode reward: [(0, '73.805')] [2024-08-06 07:40:48,314][52794] DAMAGECOUNT value on done: 893345.0 [2024-08-06 07:40:48,317][52794] Sum rewards: 63.658, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.022', 'weapon5': '0.036', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.260', 'weapon2': '0.766', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '55.000'} [2024-08-06 07:40:48,489][52669] DAMAGECOUNT value on done: 888119.0 [2024-08-06 07:40:48,489][52669] Sum rewards: 79.772, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.282', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.126', 'AMMO4': '0.196', 'weapon2': '0.258', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '68.000'} [2024-08-06 07:40:49,208][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:40:49,249][52658] DAMAGECOUNT value on done: 882429.0 [2024-08-06 07:40:49,250][52658] Sum rewards: 92.333, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.220', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.052', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO3': '0.205', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '4.370', 'DAMAGECOUNT': '22.557', 'FRAGCOUNT': '75.000'} [2024-08-06 07:40:49,284][52795] DAMAGECOUNT value on done: 819746.0 [2024-08-06 07:40:49,284][52795] Sum rewards: 73.186, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.134', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.096', 'AMMO4': '0.151', 'weapon5': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:49,306][52647] DAMAGECOUNT value on done: 940120.0 [2024-08-06 07:40:49,307][52647] Sum rewards: 68.562, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.434', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon5': '0.208', 'AMMO3': '0.222', 'AMMO4': '0.268', 'weapon4': '0.330', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.762', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '59.000'} [2024-08-06 07:40:50,815][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:40:50,858][52820] DAMAGECOUNT value on done: 825365.0 [2024-08-06 07:40:50,860][52820] Sum rewards: 69.458, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.305', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.144', 'AMMO3': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'weapon4': '0.538', 'WEAPON3': '1.150', 'weapon3': '2.738', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '55.000'} [2024-08-06 07:40:50,985][52663] DAMAGECOUNT value on done: 905624.0 [2024-08-06 07:40:50,985][52663] Sum rewards: 69.210, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.689', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.190', 'weapon4': '0.198', 'weapon5': '0.208', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.052', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '56.500'} [2024-08-06 07:40:51,223][52794] DAMAGECOUNT value on done: 895472.0 [2024-08-06 07:40:51,223][52794] Sum rewards: 73.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.394', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.294', 'DAMAGECOUNT': '16.995', 'FRAGCOUNT': '62.000'} [2024-08-06 07:40:51,271][52650] Updated weights for policy 0, policy_version 78341 (0.0032) [2024-08-06 07:40:51,467][52669] DAMAGECOUNT value on done: 897128.0 [2024-08-06 07:40:51,472][52669] Sum rewards: 69.973, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.670', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.078', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.190', 'AMMO3': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.464', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:52,017][52647] DAMAGECOUNT value on done: 948841.0 [2024-08-06 07:40:52,018][52647] Sum rewards: 81.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.791', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.100', 'AMMO4': '0.133', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '65.000'} [2024-08-06 07:40:52,024][52658] DAMAGECOUNT value on done: 907877.0 [2024-08-06 07:40:52,026][52658] Sum rewards: 69.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.125', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon4': '0.080', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.518', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 07:40:52,612][52795] DAMAGECOUNT value on done: 812208.0 [2024-08-06 07:40:52,613][52795] Sum rewards: 88.047, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.890', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.202', 'weapon2': '0.598', 'WEAPON3': '0.950', 'weapon3': '2.986', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '70.000'} [2024-08-06 07:40:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 641794048. Throughput: 0: 4356.4. Samples: 160451480. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:52,795][52567] Avg episode reward: [(0, '74.178')] [2024-08-06 07:40:53,137][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:40:53,876][52820] DAMAGECOUNT value on done: 834173.0 [2024-08-06 07:40:53,876][52820] Sum rewards: 86.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.102', 'weapon5': '0.174', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.760', 'FRAGCOUNT': '69.000'} [2024-08-06 07:40:54,163][52671] DAMAGECOUNT value on done: 894627.0 [2024-08-06 07:40:54,163][52671] Sum rewards: 69.607, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.384', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.130', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '56.000'} [2024-08-06 07:40:54,315][52794] DAMAGECOUNT value on done: 884573.0 [2024-08-06 07:40:54,317][52794] Sum rewards: 69.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.320', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.172', 'weapon5': '0.222', 'AMMO3': '0.234', 'AMMO4': '0.236', 'weapon2': '0.238', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.128', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '59.000'} [2024-08-06 07:40:54,368][52663] DAMAGECOUNT value on done: 889161.0 [2024-08-06 07:40:54,368][52663] Sum rewards: 77.795, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.928', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.211', 'weapon2': '0.236', 'AMMO4': '0.236', 'weapon5': '0.288', 'weapon4': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '64.000'} [2024-08-06 07:40:54,580][52647] DAMAGECOUNT value on done: 944145.0 [2024-08-06 07:40:54,581][52647] Sum rewards: 83.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.310', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.075', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '68.000'} [2024-08-06 07:40:54,715][52658] DAMAGECOUNT value on done: 892446.0 [2024-08-06 07:40:54,716][52658] Sum rewards: 68.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.330', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.144', 'AMMO4': '0.176', 'weapon5': '0.178', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '58.000'} [2024-08-06 07:40:54,911][52669] DAMAGECOUNT value on done: 893559.0 [2024-08-06 07:40:54,911][52669] Sum rewards: 85.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon2': '0.136', 'AMMO3': '0.189', 'AMMO4': '0.195', 'weapon5': '0.226', 'weapon4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '68.000'} [2024-08-06 07:40:55,717][52795] DAMAGECOUNT value on done: 818919.0 [2024-08-06 07:40:55,718][52795] Sum rewards: 86.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.767', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.082', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.220', 'weapon2': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.039', 'FRAGCOUNT': '68.000'} [2024-08-06 07:40:56,265][52650] Updated weights for policy 0, policy_version 78351 (0.0017) [2024-08-06 07:40:56,372][52671] DAMAGECOUNT value on done: 899215.0 [2024-08-06 07:40:56,372][52671] Sum rewards: 70.846, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.730', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.160', 'weapon5': '0.224', 'AMMO3': '0.254', 'AMMO4': '0.289', 'weapon2': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '61.000'} [2024-08-06 07:40:56,974][52647] DAMAGECOUNT value on done: 946369.0 [2024-08-06 07:40:56,974][52647] Sum rewards: 81.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.930', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.130', 'AMMO4': '0.163', 'weapon5': '0.172', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '68.000'} [2024-08-06 07:40:57,007][52820] DAMAGECOUNT value on done: 831643.0 [2024-08-06 07:40:57,008][52820] Sum rewards: 68.055, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.150', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon4': '0.328', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '54.000'} [2024-08-06 07:40:57,305][52794] DAMAGECOUNT value on done: 879505.0 [2024-08-06 07:40:57,306][52794] Sum rewards: 64.959, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon5': '0.128', 'AMMO3': '0.164', 'AMMO4': '0.297', 'weapon4': '0.426', 'WEAPON5': '0.450', 'weapon2': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.656', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '53.500'} [2024-08-06 07:40:57,329][52663] DAMAGECOUNT value on done: 883033.0 [2024-08-06 07:40:57,333][52663] Sum rewards: 80.804, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.014', 'AMMO5': '0.011', 'AMMO2': '0.044', 'AMMO3': '0.157', 'weapon5': '0.206', 'AMMO4': '0.219', 'weapon2': '0.266', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon3': '3.068', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '63.000'} [2024-08-06 07:40:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 641884160. Throughput: 0: 4356.4. Samples: 160477710. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:40:57,794][52567] Avg episode reward: [(0, '74.341')] [2024-08-06 07:40:57,827][52669] DAMAGECOUNT value on done: 893200.0 [2024-08-06 07:40:57,830][52669] Sum rewards: 81.942, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.212', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.182', 'AMMO3': '0.189', 'AMMO4': '0.198', 'weapon2': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '68.000'} [2024-08-06 07:40:57,889][52658] DAMAGECOUNT value on done: 902499.0 [2024-08-06 07:40:57,891][52658] Sum rewards: 78.756, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '64.000'} [2024-08-06 07:40:58,934][52795] DAMAGECOUNT value on done: 825632.0 [2024-08-06 07:40:58,934][52795] Sum rewards: 61.271, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.148', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.064', 'AMMO4': '0.108', 'weapon4': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '55.000'} [2024-08-06 07:40:59,158][52671] DAMAGECOUNT value on done: 895837.0 [2024-08-06 07:40:59,159][52671] Sum rewards: 75.401, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.300', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.174', 'AMMO4': '0.196', 'weapon5': '0.216', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.886', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '64.000'} [2024-08-06 07:40:59,862][52794] DAMAGECOUNT value on done: 884871.0 [2024-08-06 07:40:59,866][52794] Sum rewards: 83.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.865', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.178', 'AMMO4': '0.180', 'AMMO3': '0.212', 'weapon2': '0.220', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '69.000'} [2024-08-06 07:40:59,936][52647] DAMAGECOUNT value on done: 923165.0 [2024-08-06 07:40:59,936][52647] Sum rewards: 77.178, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.060', 'AMMO2': '0.004', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.418', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '63.000'} [2024-08-06 07:41:00,269][52820] DAMAGECOUNT value on done: 815758.0 [2024-08-06 07:41:00,269][52820] Sum rewards: 86.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.965', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.506', 'WEAPON3': '1.550', 'weapon3': '3.172', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '21.120', 'FRAGCOUNT': '72.000'} [2024-08-06 07:41:00,518][52663] DAMAGECOUNT value on done: 889123.0 [2024-08-06 07:41:00,518][52663] Sum rewards: 76.622, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.870', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.139', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.362', 'weapon4': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '61.000'} [2024-08-06 07:41:00,568][52658] DAMAGECOUNT value on done: 889846.0 [2024-08-06 07:41:00,570][52658] Sum rewards: 75.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.973', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.172', 'weapon5': '0.194', 'AMMO3': '0.207', 'AMMO4': '0.210', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '2.780', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '61.000'} [2024-08-06 07:41:00,639][52650] Updated weights for policy 0, policy_version 78361 (0.0012) [2024-08-06 07:41:00,991][52669] DAMAGECOUNT value on done: 890098.0 [2024-08-06 07:41:00,992][52669] Sum rewards: 67.336, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.203', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '55.000'} [2024-08-06 07:41:02,033][52671] DAMAGECOUNT value on done: 895854.0 [2024-08-06 07:41:02,036][52671] Sum rewards: 66.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.052', 'AMMO4': '0.095', 'weapon4': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.312', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '56.000'} [2024-08-06 07:41:02,115][52795] DAMAGECOUNT value on done: 814574.0 [2024-08-06 07:41:02,117][52795] Sum rewards: 79.811, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.523', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.592', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:02,631][52794] DAMAGECOUNT value on done: 889061.0 [2024-08-06 07:41:02,633][52794] Sum rewards: 63.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon4': '0.092', 'weapon5': '0.192', 'AMMO3': '0.200', 'AMMO4': '0.313', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.250', 'HITCOUNT': '2.710', 'weapon3': '3.096', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '54.000'} [2024-08-06 07:41:02,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 641957888. Throughput: 0: 4351.5. Samples: 160490740. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:41:02,795][52567] Avg episode reward: [(0, '74.968')] [2024-08-06 07:41:02,855][52647] DAMAGECOUNT value on done: 938374.0 [2024-08-06 07:41:02,856][52647] Sum rewards: 76.223, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.138', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.092', 'weapon4': '0.156', 'AMMO4': '0.202', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.154', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.000'} [2024-08-06 07:41:03,452][52663] DAMAGECOUNT value on done: 890743.0 [2024-08-06 07:41:03,452][52663] Sum rewards: 71.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.658', 'AMMO5': '0.024', 'AMMO2': '0.075', 'AMMO3': '0.201', 'weapon2': '0.234', 'weapon4': '0.262', 'weapon5': '0.280', 'AMMO4': '0.373', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:03,796][52658] DAMAGECOUNT value on done: 898986.0 [2024-08-06 07:41:03,796][52658] Sum rewards: 73.959, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.130', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.078', 'weapon5': '0.172', 'AMMO4': '0.240', 'AMMO3': '0.303', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.118', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '65.000'} [2024-08-06 07:41:03,854][52669] DAMAGECOUNT value on done: 902648.0 [2024-08-06 07:41:03,856][52669] Sum rewards: 85.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.114', 'AMMO4': '0.169', 'weapon5': '0.188', 'weapon2': '0.204', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.769', 'FRAGCOUNT': '70.000'} [2024-08-06 07:41:04,841][52671] DAMAGECOUNT value on done: 901754.0 [2024-08-06 07:41:04,842][52671] Sum rewards: 88.924, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.084', 'AMMO4': '0.115', 'AMMO3': '0.145', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '0.900', 'weapon3': '3.138', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '70.000'} [2024-08-06 07:41:05,229][52794] DAMAGECOUNT value on done: 876436.0 [2024-08-06 07:41:05,231][52794] Sum rewards: 64.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.281', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.128', 'weapon4': '0.132', 'AMMO4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.220', 'weapon3': '3.236', 'DAMAGECOUNT': '16.353', 'FRAGCOUNT': '52.000'} [2024-08-06 07:41:05,273][52795] DAMAGECOUNT value on done: 824561.0 [2024-08-06 07:41:05,273][52795] Sum rewards: 59.902, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.600', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.078', 'weapon5': '0.168', 'weapon2': '0.192', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'AMMO3': '0.291', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '2.920', 'weapon3': '3.286', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '53.000'} [2024-08-06 07:41:05,311][52647] DAMAGECOUNT value on done: 937559.0 [2024-08-06 07:41:05,312][52647] Sum rewards: 75.328, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.050', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'weapon5': '0.064', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'weapon4': '0.340', 'WEAPON3': '1.000', 'weapon3': '3.246', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:05,675][52650] Updated weights for policy 0, policy_version 78371 (0.0017) [2024-08-06 07:41:06,582][52663] DAMAGECOUNT value on done: 895816.0 [2024-08-06 07:41:06,583][52663] Sum rewards: 73.579, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.159', 'AMMO5': '0.026', 'AMMO2': '0.064', 'AMMO3': '0.237', 'weapon5': '0.260', 'AMMO4': '0.319', 'weapon4': '0.336', 'weapon2': '0.392', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.696', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '63.500'} [2024-08-06 07:41:06,864][52669] DAMAGECOUNT value on done: 890832.0 [2024-08-06 07:41:06,866][52669] Sum rewards: 82.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.062', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.356', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:07,120][52658] DAMAGECOUNT value on done: 888030.0 [2024-08-06 07:41:07,128][52658] Sum rewards: 78.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.240', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.106', 'AMMO3': '0.189', 'AMMO4': '0.205', 'weapon5': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '3.006', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '61.000'} [2024-08-06 07:41:07,348][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:41:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 642048000. Throughput: 0: 4353.0. Samples: 160516810. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:07,794][52567] Avg episode reward: [(0, '75.490')] [2024-08-06 07:41:07,848][52647] DAMAGECOUNT value on done: 935472.0 [2024-08-06 07:41:07,849][52647] Sum rewards: 78.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.096', 'AMMO4': '0.174', 'weapon2': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.228', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:07,870][52671] DAMAGECOUNT value on done: 891435.0 [2024-08-06 07:41:07,871][52671] Sum rewards: 86.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.115', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.114', 'FRAGCOUNT': '71.000'} [2024-08-06 07:41:08,023][52794] DAMAGECOUNT value on done: 891321.0 [2024-08-06 07:41:08,023][52794] Sum rewards: 81.432, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.026', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.094', 'AMMO4': '0.145', 'weapon2': '0.238', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '68.500'} [2024-08-06 07:41:08,410][52795] DAMAGECOUNT value on done: 822066.0 [2024-08-06 07:41:08,410][52795] Sum rewards: 86.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.007', 'weapon5': '0.018', 'AMMO2': '0.025', 'weapon4': '0.032', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.853', 'FRAGCOUNT': '71.000'} [2024-08-06 07:41:09,381][52663] DAMAGECOUNT value on done: 888599.0 [2024-08-06 07:41:09,381][52663] Sum rewards: 87.821, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.951', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.072', 'weapon4': '0.116', 'AMMO4': '0.152', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '73.000'} [2024-08-06 07:41:09,853][52658] DAMAGECOUNT value on done: 894862.0 [2024-08-06 07:41:09,855][52658] Sum rewards: 81.317, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.723', 'AMMO5': '0.013', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.130', 'AMMO3': '0.148', 'WEAPON4': '0.250', 'weapon4': '0.282', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.826', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '63.000'} [2024-08-06 07:41:09,952][52650] Updated weights for policy 0, policy_version 78381 (0.0040) [2024-08-06 07:41:09,961][52669] DAMAGECOUNT value on done: 899012.0 [2024-08-06 07:41:09,964][52669] Sum rewards: 60.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.666', 'AMMO5': '0.022', 'AMMO2': '0.049', 'weapon4': '0.116', 'AMMO3': '0.210', 'AMMO4': '0.244', 'weapon2': '0.256', 'weapon5': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.040', 'DAMAGECOUNT': '14.922', 'FRAGCOUNT': '50.000'} [2024-08-06 07:41:10,318][52671] DAMAGECOUNT value on done: 895326.0 [2024-08-06 07:41:10,318][52671] Sum rewards: 66.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.330', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '54.000'} [2024-08-06 07:41:10,656][52647] DAMAGECOUNT value on done: 925736.0 [2024-08-06 07:41:10,660][52647] Sum rewards: 69.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.950', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.096', 'AMMO4': '0.132', 'weapon5': '0.204', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:11,215][52794] DAMAGECOUNT value on done: 884280.0 [2024-08-06 07:41:11,215][52794] Sum rewards: 67.453, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.796', 'WEAPON3': '1.050', 'weapon3': '2.970', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.014', 'FRAGCOUNT': '53.000'} [2024-08-06 07:41:11,583][52795] DAMAGECOUNT value on done: 812132.0 [2024-08-06 07:41:11,585][52795] Sum rewards: 83.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.616', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.131', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.234', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '71.000'} [2024-08-06 07:41:12,092][52663] DAMAGECOUNT value on done: 876083.0 [2024-08-06 07:41:12,094][52663] Sum rewards: 71.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.298', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.106', 'weapon5': '0.132', 'AMMO4': '0.136', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:12,106][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:41:12,671][52669] DAMAGECOUNT value on done: 899208.0 [2024-08-06 07:41:12,671][52669] Sum rewards: 77.397, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.490', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO3': '0.124', 'AMMO4': '0.129', 'weapon5': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.392', 'weapon2': '0.534', 'WEAPON3': '0.800', 'weapon3': '2.686', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:12,771][52671] DAMAGECOUNT value on done: 896695.0 [2024-08-06 07:41:12,771][52671] Sum rewards: 68.929, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.173', 'weapon2': '0.654', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '57.000'} [2024-08-06 07:41:12,794][52567] Fps is (10 sec: 18842.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 642146304. Throughput: 0: 4347.3. Samples: 160542870. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:12,794][52567] Avg episode reward: [(0, '75.395')] [2024-08-06 07:41:13,005][52658] DAMAGECOUNT value on done: 877845.0 [2024-08-06 07:41:13,009][52658] Sum rewards: 75.655, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.066', 'AMMO4': '0.101', 'weapon5': '0.142', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '62.000'} [2024-08-06 07:41:13,456][52647] DAMAGECOUNT value on done: 940674.0 [2024-08-06 07:41:13,456][52647] Sum rewards: 65.223, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.333', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.036', 'AMMO4': '0.170', 'AMMO3': '0.222', 'weapon2': '0.226', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '55.000'} [2024-08-06 07:41:13,839][52794] DAMAGECOUNT value on done: 878227.0 [2024-08-06 07:41:13,841][52794] Sum rewards: 82.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.084', 'AMMO4': '0.200', 'AMMO3': '0.209', 'weapon5': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '68.000'} [2024-08-06 07:41:13,908][52664] DAMAGECOUNT value on done: 919710.0 [2024-08-06 07:41:13,912][52664] Sum rewards: 78.837, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.922', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.116', 'weapon5': '0.136', 'AMMO4': '0.153', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:14,645][52795] DAMAGECOUNT value on done: 819283.0 [2024-08-06 07:41:14,647][52795] Sum rewards: 75.249, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.700', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.100', 'weapon4': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.264', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '64.000'} [2024-08-06 07:41:14,705][52650] Updated weights for policy 0, policy_version 78391 (0.0026) [2024-08-06 07:41:15,301][52663] DAMAGECOUNT value on done: 884935.0 [2024-08-06 07:41:15,302][52663] Sum rewards: 84.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.814', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.188', 'AMMO4': '0.202', 'weapon2': '0.220', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.409', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:15,649][52662] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 07:41:15,788][52669] DAMAGECOUNT value on done: 885138.0 [2024-08-06 07:41:15,789][52669] Sum rewards: 59.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO5': '0.022', 'AMMO2': '0.043', 'AMMO3': '0.128', 'weapon5': '0.178', 'AMMO4': '0.214', 'weapon4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.796', 'WEAPON3': '0.800', 'weapon3': '2.470', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '15.051', 'FRAGCOUNT': '48.000'} [2024-08-06 07:41:15,887][52658] DAMAGECOUNT value on done: 895246.0 [2024-08-06 07:41:15,887][52658] Sum rewards: 66.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.181', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon5': '0.126', 'AMMO3': '0.218', 'weapon4': '0.228', 'AMMO4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '56.500'} [2024-08-06 07:41:16,031][52671] DAMAGECOUNT value on done: 881754.0 [2024-08-06 07:41:16,032][52671] Sum rewards: 74.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.712', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.100', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:16,234][52647] DAMAGECOUNT value on done: 929784.0 [2024-08-06 07:41:16,236][52647] Sum rewards: 82.674, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.056', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.294', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '70.000'} [2024-08-06 07:41:16,530][52794] DAMAGECOUNT value on done: 891814.0 [2024-08-06 07:41:16,530][52794] Sum rewards: 67.248, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.420', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.064', 'weapon5': '0.134', 'AMMO4': '0.237', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.800', 'weapon3': '3.238', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:16,568][52664] DAMAGECOUNT value on done: 924983.0 [2024-08-06 07:41:16,568][52664] Sum rewards: 66.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.188', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.192', 'weapon5': '0.204', 'weapon4': '0.220', 'AMMO4': '0.255', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '54.000'} [2024-08-06 07:41:17,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 642228224. Throughput: 0: 4358.9. Samples: 160556400. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:17,794][52567] Avg episode reward: [(0, '75.081')] [2024-08-06 07:41:17,813][52795] DAMAGECOUNT value on done: 827239.0 [2024-08-06 07:41:17,815][52795] Sum rewards: 83.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.479', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.097', 'weapon5': '0.152', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.427', 'FRAGCOUNT': '70.000'} [2024-08-06 07:41:18,442][52658] DAMAGECOUNT value on done: 887039.0 [2024-08-06 07:41:18,445][52658] Sum rewards: 75.101, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.336', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.161', 'weapon2': '0.326', 'WEAPON3': '1.000', 'weapon3': '3.544', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:18,474][52663] DAMAGECOUNT value on done: 887731.0 [2024-08-06 07:41:18,474][52663] Sum rewards: 65.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.110', 'weapon5': '0.116', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.268', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '55.000'} [2024-08-06 07:41:18,575][52647] DAMAGECOUNT value on done: 938004.0 [2024-08-06 07:41:18,575][52647] Sum rewards: 73.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.564', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.213', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.986', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '60.000'} [2024-08-06 07:41:18,926][52671] DAMAGECOUNT value on done: 896151.0 [2024-08-06 07:41:18,927][52671] Sum rewards: 82.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.242', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '68.000'} [2024-08-06 07:41:18,941][52669] DAMAGECOUNT value on done: 886941.0 [2024-08-06 07:41:18,941][52669] Sum rewards: 69.543, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.838', 'AMMO5': '0.021', 'AMMO2': '0.047', 'weapon4': '0.064', 'weapon5': '0.158', 'AMMO4': '0.237', 'AMMO3': '0.238', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '61.000'} [2024-08-06 07:41:19,038][52664] DAMAGECOUNT value on done: 926370.0 [2024-08-06 07:41:19,039][52664] Sum rewards: 69.045, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.144', 'AMMO3': '0.145', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '0.750', 'weapon2': '0.814', 'HEALTH': '0.988', 'weapon3': '2.464', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '55.000'} [2024-08-06 07:41:19,305][52650] Updated weights for policy 0, policy_version 78401 (0.0033) [2024-08-06 07:41:19,333][52794] DAMAGECOUNT value on done: 886145.0 [2024-08-06 07:41:19,333][52794] Sum rewards: 65.131, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.884', 'AMMO5': '0.009', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.040', 'AMMO4': '0.097', 'weapon5': '0.102', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.603', 'FRAGCOUNT': '56.000'} [2024-08-06 07:41:21,159][52647] DAMAGECOUNT value on done: 939915.0 [2024-08-06 07:41:21,160][52647] Sum rewards: 70.367, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.070', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '60.000'} [2024-08-06 07:41:21,313][52671] DAMAGECOUNT value on done: 894733.0 [2024-08-06 07:41:21,313][52671] Sum rewards: 74.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.942', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.182', 'AMMO4': '0.190', 'AMMO3': '0.192', 'weapon5': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.840', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:21,361][52663] DAMAGECOUNT value on done: 895297.0 [2024-08-06 07:41:21,361][52663] Sum rewards: 78.182, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.463', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.074', 'AMMO4': '0.084', 'AMMO3': '0.146', 'WEAPON5': '0.150', 'weapon4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.050', 'weapon3': '3.112', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '62.000'} [2024-08-06 07:41:21,648][52658] DAMAGECOUNT value on done: 883599.0 [2024-08-06 07:41:21,649][52658] Sum rewards: 75.134, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.099', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '60.000'} [2024-08-06 07:41:21,690][52669] DAMAGECOUNT value on done: 893027.0 [2024-08-06 07:41:21,692][52669] Sum rewards: 73.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.145', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.146', 'weapon5': '0.190', 'AMMO3': '0.194', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.190', 'weapon3': '3.260', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:21,773][52664] DAMAGECOUNT value on done: 916360.0 [2024-08-06 07:41:21,776][52664] Sum rewards: 68.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.795', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.108', 'weapon5': '0.126', 'weapon2': '0.146', 'AMMO4': '0.209', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.354', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:22,156][52794] DAMAGECOUNT value on done: 899447.0 [2024-08-06 07:41:22,158][52794] Sum rewards: 68.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.102', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.124', 'weapon4': '0.138', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '57.000'} [2024-08-06 07:41:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.6, 300 sec: 17494.8). Total num frames: 642318336. Throughput: 0: 4366.2. Samples: 160582740. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:22,794][52567] Avg episode reward: [(0, '74.977')] [2024-08-06 07:41:23,903][52671] DAMAGECOUNT value on done: 890814.0 [2024-08-06 07:41:23,903][52671] Sum rewards: 76.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.248', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.120', 'weapon5': '0.148', 'AMMO4': '0.162', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '63.000'} [2024-08-06 07:41:23,920][52647] DAMAGECOUNT value on done: 927068.0 [2024-08-06 07:41:23,920][52647] Sum rewards: 73.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.850', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.068', 'weapon5': '0.128', 'AMMO3': '0.198', 'AMMO4': '0.236', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '62.000'} [2024-08-06 07:41:24,185][52650] Updated weights for policy 0, policy_version 78411 (0.0025) [2024-08-06 07:41:24,437][52663] DAMAGECOUNT value on done: 877714.0 [2024-08-06 07:41:24,440][52663] Sum rewards: 75.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.140', 'AMMO2': '0.033', 'weapon4': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.165', 'AMMO3': '0.248', 'weapon2': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.500', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '63.000'} [2024-08-06 07:41:24,452][52658] DAMAGECOUNT value on done: 893149.0 [2024-08-06 07:41:24,453][52658] Sum rewards: 80.916, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.723', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '3.062', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '64.000'} [2024-08-06 07:41:24,611][52664] DAMAGECOUNT value on done: 928563.0 [2024-08-06 07:41:24,611][52664] Sum rewards: 79.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.805', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.144', 'AMMO4': '0.149', 'weapon2': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '65.500'} [2024-08-06 07:41:25,008][52669] DAMAGECOUNT value on done: 915416.0 [2024-08-06 07:41:25,010][52669] Sum rewards: 80.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.498', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.145', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.800', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '65.000'} [2024-08-06 07:41:25,355][52794] DAMAGECOUNT value on done: 879995.0 [2024-08-06 07:41:25,357][52794] Sum rewards: 86.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.762', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.136', 'weapon5': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.238', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.012', 'FRAGCOUNT': '72.000'} [2024-08-06 07:41:26,497][52647] DAMAGECOUNT value on done: 933961.0 [2024-08-06 07:41:26,498][52647] Sum rewards: 80.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.076', 'AMMO4': '0.113', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:27,022][52664] DAMAGECOUNT value on done: 925746.0 [2024-08-06 07:41:27,023][52664] Sum rewards: 71.676, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.580', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.074', 'weapon5': '0.216', 'AMMO4': '0.242', 'AMMO3': '0.284', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.096', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '61.000'} [2024-08-06 07:41:27,074][52671] DAMAGECOUNT value on done: 896307.0 [2024-08-06 07:41:27,075][52671] Sum rewards: 68.722, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.636', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.046', 'AMMO3': '0.128', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.229', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON3': '0.750', 'weapon4': '0.892', 'weapon3': '2.274', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '54.500'} [2024-08-06 07:41:27,283][52649] DAMAGECOUNT value on done: 860770.0 [2024-08-06 07:41:27,284][52649] Sum rewards: 72.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.896', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.190', 'weapon4': '0.230', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.932', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '57.000'} [2024-08-06 07:41:27,409][52663] DAMAGECOUNT value on done: 874589.0 [2024-08-06 07:41:27,410][52663] Sum rewards: 62.986, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.402', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.182', 'AMMO4': '0.183', 'AMMO3': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.600', 'HITCOUNT': '2.870', 'weapon3': '3.002', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '56.000'} [2024-08-06 07:41:27,728][52669] DAMAGECOUNT value on done: 902667.0 [2024-08-06 07:41:27,728][52669] Sum rewards: 69.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.865', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.074', 'weapon5': '0.168', 'AMMO3': '0.206', 'AMMO4': '0.218', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.248', 'DAMAGECOUNT': '16.281', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:27,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 642400256. Throughput: 0: 4371.1. Samples: 160608850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:27,802][52567] Avg episode reward: [(0, '74.774')] [2024-08-06 07:41:28,445][52794] DAMAGECOUNT value on done: 894829.0 [2024-08-06 07:41:28,445][52794] Sum rewards: 58.295, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.092', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.084', 'DAMAGECOUNT': '15.282', 'FRAGCOUNT': '50.500'} [2024-08-06 07:41:28,635][52650] Updated weights for policy 0, policy_version 78421 (0.0013) [2024-08-06 07:41:29,126][52647] DAMAGECOUNT value on done: 924648.0 [2024-08-06 07:41:29,126][52647] Sum rewards: 63.016, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.108', 'weapon5': '0.178', 'AMMO4': '0.203', 'AMMO3': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '2.880', 'weapon3': '3.036', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '55.000'} [2024-08-06 07:41:29,664][52664] DAMAGECOUNT value on done: 915203.0 [2024-08-06 07:41:29,664][52664] Sum rewards: 81.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.721', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.100', 'AMMO4': '0.197', 'AMMO3': '0.210', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.388', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '67.000'} [2024-08-06 07:41:30,056][52663] DAMAGECOUNT value on done: 883401.0 [2024-08-06 07:41:30,062][52663] Sum rewards: 80.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.788', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.138', 'AMMO4': '0.151', 'AMMO3': '0.224', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:30,249][52671] DAMAGECOUNT value on done: 894034.0 [2024-08-06 07:41:30,250][52671] Sum rewards: 76.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.388', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.052', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '63.000'} [2024-08-06 07:41:30,313][52649] DAMAGECOUNT value on done: 856601.0 [2024-08-06 07:41:30,315][52649] Sum rewards: 75.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon5': '0.170', 'AMMO3': '0.183', 'weapon4': '0.228', 'AMMO4': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '60.000'} [2024-08-06 07:41:30,616][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:41:30,685][52669] DAMAGECOUNT value on done: 896782.0 [2024-08-06 07:41:30,687][52669] Sum rewards: 73.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.106', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.152', 'AMMO3': '0.196', 'weapon5': '0.200', 'weapon2': '0.238', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.706', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '61.000'} [2024-08-06 07:41:31,382][52670] DAMAGECOUNT value on done: 875630.0 [2024-08-06 07:41:31,382][52670] Sum rewards: 68.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.046', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.287', 'weapon2': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.302', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '61.000'} [2024-08-06 07:41:31,614][52794] DAMAGECOUNT value on done: 889710.0 [2024-08-06 07:41:31,615][52794] Sum rewards: 58.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.720', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.110', 'AMMO4': '0.151', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.200', 'HITCOUNT': '2.940', 'weapon3': '3.066', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '48.500'} [2024-08-06 07:41:31,809][52647] DAMAGECOUNT value on done: 928563.0 [2024-08-06 07:41:31,811][52647] Sum rewards: 85.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.590', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.118', 'AMMO3': '0.196', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:31,840][52663] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:41:32,410][52664] DAMAGECOUNT value on done: 915002.0 [2024-08-06 07:41:32,410][52664] Sum rewards: 74.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.586', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:32,638][52663] DAMAGECOUNT value on done: 885886.0 [2024-08-06 07:41:32,639][52663] Sum rewards: 76.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.186', 'weapon5': '0.206', 'AMMO4': '0.229', 'weapon4': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '62.000'} [2024-08-06 07:41:32,784][52671] DAMAGECOUNT value on done: 881287.0 [2024-08-06 07:41:32,784][52671] Sum rewards: 77.700, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.692', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.160', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.474', 'WEAPON3': '1.550', 'weapon3': '2.998', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '66.500'} [2024-08-06 07:41:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 642490368. Throughput: 0: 4370.9. Samples: 160621720. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:32,795][52567] Avg episode reward: [(0, '74.605')] [2024-08-06 07:41:33,140][52665] DAMAGECOUNT value on done: 877602.0 [2024-08-06 07:41:33,141][52665] Sum rewards: 75.811, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.992', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.184', 'AMMO4': '0.194', 'AMMO3': '0.230', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.086', 'FRAGCOUNT': '64.000'} [2024-08-06 07:41:33,259][52669] DAMAGECOUNT value on done: 902681.0 [2024-08-06 07:41:33,259][52669] Sum rewards: 71.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.045', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.094', 'AMMO4': '0.153', 'weapon2': '0.172', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '57.000'} [2024-08-06 07:41:33,381][52649] DAMAGECOUNT value on done: 873616.0 [2024-08-06 07:41:33,382][52649] Sum rewards: 76.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.622', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.054', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon5': '0.218', 'AMMO3': '0.226', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '65.000'} [2024-08-06 07:41:33,603][52650] Updated weights for policy 0, policy_version 78431 (0.0029) [2024-08-06 07:41:34,379][52670] DAMAGECOUNT value on done: 891327.0 [2024-08-06 07:41:34,379][52670] Sum rewards: 84.597, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.070', 'AMMO4': '0.211', 'AMMO3': '0.237', 'weapon5': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:34,796][52794] DAMAGECOUNT value on done: 893483.0 [2024-08-06 07:41:34,797][52794] Sum rewards: 61.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.067', 'weapon5': '0.170', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'weapon2': '0.326', 'AMMO4': '0.335', 'weapon4': '0.482', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.804', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '51.000'} [2024-08-06 07:41:35,383][52664] DAMAGECOUNT value on done: 924789.0 [2024-08-06 07:41:35,384][52664] Sum rewards: 60.648, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.397', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.189', 'weapon2': '0.208', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '2.890', 'weapon3': '3.034', 'DAMAGECOUNT': '15.501', 'FRAGCOUNT': '50.000'} [2024-08-06 07:41:35,670][52671] DAMAGECOUNT value on done: 903263.0 [2024-08-06 07:41:35,674][52671] Sum rewards: 71.131, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.426', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon4': '0.088', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon2': '0.352', 'WEAPON3': '1.000', 'HITCOUNT': '3.060', 'weapon3': '3.292', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '57.000'} [2024-08-06 07:41:35,710][52663] DAMAGECOUNT value on done: 890144.0 [2024-08-06 07:41:35,712][52663] Sum rewards: 77.052, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.960', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.046', 'AMMO4': '0.077', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 07:41:36,337][52665] DAMAGECOUNT value on done: 890379.0 [2024-08-06 07:41:36,338][52665] Sum rewards: 87.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO3': '0.200', 'AMMO4': '0.230', 'weapon4': '0.334', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.030', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:36,364][52669] DAMAGECOUNT value on done: 904129.0 [2024-08-06 07:41:36,366][52669] Sum rewards: 85.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.477', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.076', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon2': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON3': '1.250', 'weapon3': '3.508', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '70.000'} [2024-08-06 07:41:36,607][52649] DAMAGECOUNT value on done: 869038.0 [2024-08-06 07:41:36,607][52649] Sum rewards: 76.292, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'weapon5': '0.132', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.408', 'weapon4': '0.608', 'WEAPON3': '1.150', 'weapon3': '2.678', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '62.000'} [2024-08-06 07:41:36,797][52670] DAMAGECOUNT value on done: 876295.0 [2024-08-06 07:41:36,798][52670] Sum rewards: 79.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.045', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.024', 'AMMO4': '0.055', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '67.000'} [2024-08-06 07:41:37,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 642580480. Throughput: 0: 4368.2. Samples: 160648050. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:37,794][52567] Avg episode reward: [(0, '74.575')] [2024-08-06 07:41:37,817][52664] DAMAGECOUNT value on done: 921767.0 [2024-08-06 07:41:37,817][52664] Sum rewards: 79.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.684', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.096', 'weapon4': '0.104', 'AMMO4': '0.145', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '65.000'} [2024-08-06 07:41:37,904][52794] DAMAGECOUNT value on done: 901741.0 [2024-08-06 07:41:37,908][52794] Sum rewards: 77.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.908', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.094', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '64.000'} [2024-08-06 07:41:38,187][52650] Updated weights for policy 0, policy_version 78441 (0.0022) [2024-08-06 07:41:38,217][52666] DAMAGECOUNT value on done: 889228.0 [2024-08-06 07:41:38,217][52666] Sum rewards: 70.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.680', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.138', 'AMMO4': '0.212', 'weapon5': '0.214', 'weapon2': '0.218', 'AMMO3': '0.245', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:38,774][52671] DAMAGECOUNT value on done: 901666.0 [2024-08-06 07:41:38,776][52671] Sum rewards: 64.145, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.994', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.114', 'AMMO4': '0.220', 'WEAPON5': '0.250', 'AMMO3': '0.276', 'weapon4': '0.292', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.966', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '56.000'} [2024-08-06 07:41:39,005][52663] DAMAGECOUNT value on done: 888385.0 [2024-08-06 07:41:39,006][52663] Sum rewards: 70.866, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.128', 'weapon4': '0.138', 'AMMO4': '0.144', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:39,278][52665] DAMAGECOUNT value on done: 879451.0 [2024-08-06 07:41:39,280][52665] Sum rewards: 81.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.955', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.193', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '67.000'} [2024-08-06 07:41:39,476][52670] DAMAGECOUNT value on done: 879834.0 [2024-08-06 07:41:39,476][52670] Sum rewards: 80.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.146', 'AMMO4': '0.185', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '67.000'} [2024-08-06 07:41:39,627][52649] DAMAGECOUNT value on done: 862802.0 [2024-08-06 07:41:39,632][52649] Sum rewards: 87.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.038', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.192', 'AMMO3': '0.225', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.879', 'FRAGCOUNT': '70.000'} [2024-08-06 07:41:40,535][52664] DAMAGECOUNT value on done: 930841.0 [2024-08-06 07:41:40,535][52664] Sum rewards: 80.010, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.087', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.176', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.540', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:40,908][52666] DAMAGECOUNT value on done: 884987.0 [2024-08-06 07:41:40,909][52666] Sum rewards: 60.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '2.994', 'DAMAGECOUNT': '15.303', 'FRAGCOUNT': '51.000'} [2024-08-06 07:41:41,250][52794] DAMAGECOUNT value on done: 892250.0 [2024-08-06 07:41:41,252][52794] Sum rewards: 74.649, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.034', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.147', 'AMMO4': '0.161', 'weapon5': '0.164', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '0.850', 'weapon3': '2.854', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:41,424][52671] DAMAGECOUNT value on done: 896568.0 [2024-08-06 07:41:41,424][52671] Sum rewards: 80.564, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.434', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO4': '0.145', 'weapon5': '0.170', 'weapon2': '0.208', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:41,511][52663] DAMAGECOUNT value on done: 891819.0 [2024-08-06 07:41:41,513][52663] Sum rewards: 72.271, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.777', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.094', 'weapon4': '0.102', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.196', 'DAMAGECOUNT': '16.593', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:42,010][52665] DAMAGECOUNT value on done: 881660.0 [2024-08-06 07:41:42,013][52665] Sum rewards: 74.018, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.228', 'AMMO2': '0.012', 'AMMO5': '0.020', 'weapon4': '0.040', 'AMMO4': '0.059', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.162', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '0.950', 'HITCOUNT': '3.060', 'weapon3': '3.212', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '60.000'} [2024-08-06 07:41:42,478][52670] DAMAGECOUNT value on done: 892630.0 [2024-08-06 07:41:42,480][52670] Sum rewards: 71.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.902', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.059', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:42,551][52649] DAMAGECOUNT value on done: 871829.0 [2024-08-06 07:41:42,552][52649] Sum rewards: 81.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.928', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.131', 'weapon2': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.228', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'weapon3': '3.304', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 642662400. Throughput: 0: 4367.1. Samples: 160674230. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:42,795][52567] Avg episode reward: [(0, '74.526')] [2024-08-06 07:41:42,951][52650] Updated weights for policy 0, policy_version 78451 (0.0044) [2024-08-06 07:41:43,267][52664] DAMAGECOUNT value on done: 928507.0 [2024-08-06 07:41:43,268][52664] Sum rewards: 69.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.410', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.156', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '57.000'} [2024-08-06 07:41:43,622][52614] Signal inference workers to stop experience collection... (14400 times) [2024-08-06 07:41:43,622][52614] Signal inference workers to resume experience collection... (14400 times) [2024-08-06 07:41:43,663][52650] InferenceWorker_p0-w0: stopping experience collection (14400 times) [2024-08-06 07:41:43,664][52650] InferenceWorker_p0-w0: resuming experience collection (14400 times) [2024-08-06 07:41:43,959][52671] DAMAGECOUNT value on done: 902080.0 [2024-08-06 07:41:43,961][52671] Sum rewards: 76.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.637', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.038', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '62.000'} [2024-08-06 07:41:44,205][52666] DAMAGECOUNT value on done: 892587.0 [2024-08-06 07:41:44,206][52666] Sum rewards: 84.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.526', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.066', 'weapon2': '0.112', 'weapon5': '0.134', 'AMMO4': '0.143', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.528', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '69.000'} [2024-08-06 07:41:44,538][52663] DAMAGECOUNT value on done: 897183.0 [2024-08-06 07:41:44,539][52663] Sum rewards: 83.658, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.290', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.156', 'AMMO3': '0.172', 'AMMO4': '0.183', 'weapon5': '0.218', 'weapon2': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:44,738][52665] DAMAGECOUNT value on done: 866372.0 [2024-08-06 07:41:44,740][52665] Sum rewards: 73.277, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.118', 'weapon5': '0.194', 'AMMO3': '0.207', 'AMMO4': '0.216', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '61.500'} [2024-08-06 07:41:45,310][52649] DAMAGECOUNT value on done: 867304.0 [2024-08-06 07:41:45,314][52649] Sum rewards: 66.144, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon5': '0.064', 'AMMO3': '0.156', 'AMMO4': '0.159', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '0.950', 'weapon3': '3.014', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '53.500'} [2024-08-06 07:41:45,914][52670] DAMAGECOUNT value on done: 880137.0 [2024-08-06 07:41:45,915][52670] Sum rewards: 71.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:46,179][52664] DAMAGECOUNT value on done: 927258.0 [2024-08-06 07:41:46,179][52664] Sum rewards: 61.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.264', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.154', 'AMMO3': '0.216', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '51.000'} [2024-08-06 07:41:46,569][52671] DAMAGECOUNT value on done: 884461.0 [2024-08-06 07:41:46,569][52671] Sum rewards: 58.477, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.170', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.070', 'AMMO4': '0.109', 'weapon5': '0.142', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.108', 'DAMAGECOUNT': '14.784', 'FRAGCOUNT': '51.000'} [2024-08-06 07:41:47,381][52666] DAMAGECOUNT value on done: 885380.0 [2024-08-06 07:41:47,383][52666] Sum rewards: 77.530, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.302', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.036', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.422', 'WEAPON3': '1.300', 'weapon3': '3.330', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '64.000'} [2024-08-06 07:41:47,586][52650] Updated weights for policy 0, policy_version 78461 (0.0012) [2024-08-06 07:41:47,587][52663] DAMAGECOUNT value on done: 880443.0 [2024-08-06 07:41:47,590][52663] Sum rewards: 71.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.102', 'weapon5': '0.124', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:47,684][52665] DAMAGECOUNT value on done: 870695.0 [2024-08-06 07:41:47,684][52665] Sum rewards: 82.604, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.416', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO3': '0.152', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '64.000'} [2024-08-06 07:41:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 642752512. Throughput: 0: 4370.7. Samples: 160687420. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:47,794][52567] Avg episode reward: [(0, '73.957')] [2024-08-06 07:41:48,094][52649] DAMAGECOUNT value on done: 871064.0 [2024-08-06 07:41:48,095][52649] Sum rewards: 68.633, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.075', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.152', 'AMMO4': '0.219', 'AMMO3': '0.219', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:49,070][52670] DAMAGECOUNT value on done: 874318.0 [2024-08-06 07:41:49,070][52670] Sum rewards: 88.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.013', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon4': '0.180', 'AMMO3': '0.199', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '72.000'} [2024-08-06 07:41:49,214][52664] DAMAGECOUNT value on done: 939574.0 [2024-08-06 07:41:49,214][52664] Sum rewards: 72.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.201', 'weapon5': '0.252', 'weapon4': '0.268', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:50,340][52665] DAMAGECOUNT value on done: 877974.0 [2024-08-06 07:41:50,341][52665] Sum rewards: 71.829, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.080', 'weapon4': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.414', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:50,557][52666] DAMAGECOUNT value on done: 879908.0 [2024-08-06 07:41:50,558][52666] Sum rewards: 80.713, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.941', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon4': '0.156', 'AMMO3': '0.209', 'weapon5': '0.266', 'AMMO4': '0.292', 'weapon2': '0.480', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.776', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '66.000'} [2024-08-06 07:41:50,943][52649] DAMAGECOUNT value on done: 867503.0 [2024-08-06 07:41:50,945][52649] Sum rewards: 70.931, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:51,821][52664] DAMAGECOUNT value on done: 935408.0 [2024-08-06 07:41:51,823][52664] Sum rewards: 78.471, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.394', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.090', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 07:41:52,108][52670] DAMAGECOUNT value on done: 880176.0 [2024-08-06 07:41:52,109][52670] Sum rewards: 61.944, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.902', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO3': '0.212', 'AMMO4': '0.241', 'weapon2': '0.270', 'weapon5': '0.304', 'weapon4': '0.430', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.636', 'HITCOUNT': '2.670', 'DAMAGECOUNT': '14.010', 'FRAGCOUNT': '53.000'} [2024-08-06 07:41:52,258][52671] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:41:52,481][52650] Updated weights for policy 0, policy_version 78471 (0.0013) [2024-08-06 07:41:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 642842624. Throughput: 0: 4379.3. Samples: 160713880. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 07:41:52,802][52567] Avg episode reward: [(0, '74.084')] [2024-08-06 07:41:53,380][52665] DAMAGECOUNT value on done: 878140.0 [2024-08-06 07:41:53,382][52665] Sum rewards: 81.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.814', 'AMMO5': '0.005', 'weapon5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.018', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.448', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '68.000'} [2024-08-06 07:41:53,391][52666] DAMAGECOUNT value on done: 885971.0 [2024-08-06 07:41:53,391][52666] Sum rewards: 70.616, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.570', 'AMMO5': '0.015', 'AMMO2': '0.059', 'AMMO3': '0.249', 'weapon5': '0.260', 'weapon2': '0.264', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'weapon4': '0.474', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.658', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '59.000'} [2024-08-06 07:41:54,106][52649] DAMAGECOUNT value on done: 863977.0 [2024-08-06 07:41:54,109][52649] Sum rewards: 87.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.125', 'AMMO5': '0.006', 'AMMO2': '0.056', 'weapon5': '0.058', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.207', 'AMMO4': '0.283', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '72.000'} [2024-08-06 07:41:54,488][52664] DAMAGECOUNT value on done: 935115.0 [2024-08-06 07:41:54,491][52664] Sum rewards: 96.955, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.408', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.062', 'AMMO4': '0.113', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '3.420', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.579', 'FRAGCOUNT': '78.000'} [2024-08-06 07:41:54,831][52670] DAMAGECOUNT value on done: 878448.0 [2024-08-06 07:41:54,832][52670] Sum rewards: 76.166, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.805', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.182', 'AMMO3': '0.207', 'AMMO4': '0.249', 'weapon5': '0.266', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '63.000'} [2024-08-06 07:41:56,318][52666] DAMAGECOUNT value on done: 881235.0 [2024-08-06 07:41:56,318][52666] Sum rewards: 67.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.255', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.040', 'AMMO4': '0.099', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '55.000'} [2024-08-06 07:41:56,471][52665] DAMAGECOUNT value on done: 882927.0 [2024-08-06 07:41:56,474][52665] Sum rewards: 74.045, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.550', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.124', 'AMMO3': '0.158', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.576', 'WEAPON3': '0.950', 'weapon3': '2.578', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 07:41:56,948][52650] Updated weights for policy 0, policy_version 78481 (0.0012) [2024-08-06 07:41:57,174][52649] DAMAGECOUNT value on done: 874666.0 [2024-08-06 07:41:57,175][52649] Sum rewards: 83.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.760', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.098', 'weapon5': '0.124', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '67.000'} [2024-08-06 07:41:57,269][52664] DAMAGECOUNT value on done: 917867.0 [2024-08-06 07:41:57,270][52664] Sum rewards: 64.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.130', 'AMMO5': '0.026', 'AMMO2': '0.063', 'weapon4': '0.110', 'AMMO3': '0.223', 'weapon5': '0.288', 'weapon2': '0.296', 'AMMO4': '0.316', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.036', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '53.500'} [2024-08-06 07:41:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 642924544. Throughput: 0: 4380.2. Samples: 160739980. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:41:57,802][52567] Avg episode reward: [(0, '74.416')] [2024-08-06 07:41:57,945][52670] DAMAGECOUNT value on done: 875656.0 [2024-08-06 07:41:57,945][52670] Sum rewards: 86.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.794', 'AMMO2': '0.002', 'AMMO5': '0.007', 'AMMO4': '0.010', 'WEAPON1': '0.020', 'weapon4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '72.000'} [2024-08-06 07:41:59,252][52666] DAMAGECOUNT value on done: 880082.0 [2024-08-06 07:41:59,253][52666] Sum rewards: 79.810, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon5': '0.088', 'weapon2': '0.214', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'AMMO4': '0.289', 'weapon4': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '67.000'} [2024-08-06 07:41:59,565][52665] DAMAGECOUNT value on done: 877598.0 [2024-08-06 07:41:59,566][52665] Sum rewards: 80.045, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon5': '0.082', 'weapon4': '0.138', 'AMMO4': '0.155', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '65.000'} [2024-08-06 07:41:59,883][52664] DAMAGECOUNT value on done: 921766.0 [2024-08-06 07:41:59,883][52664] Sum rewards: 80.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.660', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.578', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '65.000'} [2024-08-06 07:41:59,972][52668] DAMAGECOUNT value on done: 896227.0 [2024-08-06 07:41:59,974][52668] Sum rewards: 76.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.154', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'weapon4': '0.062', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'weapon2': '0.398', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:00,019][52649] DAMAGECOUNT value on done: 880300.0 [2024-08-06 07:42:00,019][52649] Sum rewards: 70.002, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.092', 'AMMO4': '0.185', 'weapon2': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.200', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.302', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '59.000'} [2024-08-06 07:42:00,723][52670] DAMAGECOUNT value on done: 889663.0 [2024-08-06 07:42:00,723][52670] Sum rewards: 83.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.046', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '68.000'} [2024-08-06 07:42:01,084][52668] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:01,326][52663] Large shaping reward 2.608 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('weapon5', 0.002)] [2024-08-06 07:42:01,764][52650] Updated weights for policy 0, policy_version 78491 (0.0013) [2024-08-06 07:42:01,997][52666] DAMAGECOUNT value on done: 887787.0 [2024-08-06 07:42:01,998][52666] Sum rewards: 81.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.294', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.080', 'WEAPON5': '0.150', 'weapon2': '0.150', 'AMMO4': '0.167', 'weapon4': '0.176', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:02,011][52665] DAMAGECOUNT value on done: 893276.0 [2024-08-06 07:42:02,013][52665] Sum rewards: 87.648, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.022', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.168', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.200', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.753', 'FRAGCOUNT': '75.000'} [2024-08-06 07:42:02,064][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:42:02,762][52649] DAMAGECOUNT value on done: 873661.0 [2024-08-06 07:42:02,763][52649] Sum rewards: 89.583, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.828', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.122', 'AMMO4': '0.142', 'AMMO3': '0.166', 'weapon5': '0.178', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '71.000'} [2024-08-06 07:42:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 643014656. Throughput: 0: 4373.1. Samples: 160753190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:02,802][52567] Avg episode reward: [(0, '75.394')] [2024-08-06 07:42:02,869][52664] DAMAGECOUNT value on done: 926763.0 [2024-08-06 07:42:02,869][52664] Sum rewards: 75.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.645', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO3': '0.202', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:02,993][52668] DAMAGECOUNT value on done: 898201.0 [2024-08-06 07:42:02,993][52668] Sum rewards: 90.476, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.045', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '73.000'} [2024-08-06 07:42:03,714][52670] DAMAGECOUNT value on done: 870610.0 [2024-08-06 07:42:03,715][52670] Sum rewards: 89.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.112', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.182', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.357', 'FRAGCOUNT': '72.000'} [2024-08-06 07:42:04,102][52664] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:04,362][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:04,546][52665] DAMAGECOUNT value on done: 883748.0 [2024-08-06 07:42:04,547][52665] Sum rewards: 70.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.736', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon2': '0.130', 'weapon5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.472', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:05,102][52666] DAMAGECOUNT value on done: 882177.0 [2024-08-06 07:42:05,102][52666] Sum rewards: 87.710, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.277', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.052', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '70.000'} [2024-08-06 07:42:05,195][52649] DAMAGECOUNT value on done: 874143.0 [2024-08-06 07:42:05,196][52649] Sum rewards: 64.427, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.098', 'AMMO4': '0.206', 'weapon5': '0.252', 'AMMO3': '0.267', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.550', 'weapon3': '2.746', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '55.000'} [2024-08-06 07:42:06,126][52668] DAMAGECOUNT value on done: 891154.0 [2024-08-06 07:42:06,127][52668] Sum rewards: 64.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.919', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.093', 'AMMO3': '0.167', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.340', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '52.000'} [2024-08-06 07:42:06,163][52664] DAMAGECOUNT value on done: 918239.0 [2024-08-06 07:42:06,164][52664] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '61.000'} [2024-08-06 07:42:06,301][52650] Updated weights for policy 0, policy_version 78501 (0.0012) [2024-08-06 07:42:06,647][52660] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:42:06,701][52670] DAMAGECOUNT value on done: 886215.0 [2024-08-06 07:42:06,701][52670] Sum rewards: 79.150, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.868', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.106', 'AMMO4': '0.172', 'weapon2': '0.228', 'AMMO3': '0.232', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.154', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:07,412][52665] DAMAGECOUNT value on done: 880154.0 [2024-08-06 07:42:07,412][52665] Sum rewards: 85.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.210', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.271', 'weapon2': '0.338', 'WEAPON3': '1.850', 'weapon3': '3.452', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '74.000'} [2024-08-06 07:42:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 643096576. Throughput: 0: 4373.3. Samples: 160779540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:07,795][52567] Avg episode reward: [(0, '75.882')] [2024-08-06 07:42:07,902][52666] DAMAGECOUNT value on done: 887350.0 [2024-08-06 07:42:07,903][52666] Sum rewards: 86.251, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.136', 'AMMO3': '0.195', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.450', 'weapon4': '0.460', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '68.000'} [2024-08-06 07:42:08,750][52649] DAMAGECOUNT value on done: 862476.0 [2024-08-06 07:42:08,750][52649] Sum rewards: 77.691, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.084', 'AMMO4': '0.193', 'weapon5': '0.212', 'weapon2': '0.260', 'AMMO3': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.172', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '67.000'} [2024-08-06 07:42:09,016][52668] DAMAGECOUNT value on done: 896654.0 [2024-08-06 07:42:09,017][52668] Sum rewards: 68.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.328', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '56.000'} [2024-08-06 07:42:09,380][52670] DAMAGECOUNT value on done: 889715.0 [2024-08-06 07:42:09,380][52670] Sum rewards: 71.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.942', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.042', 'weapon5': '0.150', 'AMMO4': '0.211', 'AMMO3': '0.236', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:10,446][52666] DAMAGECOUNT value on done: 870592.0 [2024-08-06 07:42:10,446][52666] Sum rewards: 65.123, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.511', 'AMMO5': '0.006', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.187', 'weapon2': '0.770', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '52.000'} [2024-08-06 07:42:10,574][52665] DAMAGECOUNT value on done: 883426.0 [2024-08-06 07:42:10,576][52665] Sum rewards: 72.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.120', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.058', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.528', 'WEAPON3': '1.100', 'weapon3': '2.832', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '61.000'} [2024-08-06 07:42:10,997][52650] Updated weights for policy 0, policy_version 78511 (0.0028) [2024-08-06 07:42:11,001][52811] DAMAGECOUNT value on done: 845968.0 [2024-08-06 07:42:11,002][52811] Sum rewards: 68.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon5': '0.210', 'AMMO4': '0.218', 'AMMO3': '0.228', 'weapon2': '0.300', 'weapon4': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '57.000'} [2024-08-06 07:42:11,345][52649] DAMAGECOUNT value on done: 872615.0 [2024-08-06 07:42:11,347][52649] Sum rewards: 77.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.108', 'AMMO3': '0.164', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.436', 'weapon4': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.794', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '61.000'} [2024-08-06 07:42:11,847][52668] DAMAGECOUNT value on done: 884792.0 [2024-08-06 07:42:11,847][52668] Sum rewards: 78.753, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.692', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.076', 'AMMO4': '0.162', 'weapon5': '0.216', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:12,033][52670] DAMAGECOUNT value on done: 883761.0 [2024-08-06 07:42:12,033][52670] Sum rewards: 92.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.906', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.044', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.220', 'WEAPON3': '1.300', 'weapon3': '3.510', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '77.000'} [2024-08-06 07:42:12,673][52660] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 643194880. Throughput: 0: 4363.4. Samples: 160805200. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:12,794][52567] Avg episode reward: [(0, '75.935')] [2024-08-06 07:42:13,149][52666] DAMAGECOUNT value on done: 891670.0 [2024-08-06 07:42:13,150][52666] Sum rewards: 70.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.282', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.132', 'AMMO4': '0.153', 'weapon2': '0.180', 'weapon5': '0.198', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '58.000'} [2024-08-06 07:42:13,452][52665] DAMAGECOUNT value on done: 876960.0 [2024-08-06 07:42:13,453][52665] Sum rewards: 67.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.084', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.346', 'weapon2': '0.364', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '54.000'} [2024-08-06 07:42:14,203][52811] DAMAGECOUNT value on done: 830290.0 [2024-08-06 07:42:14,204][52811] Sum rewards: 66.473, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.160', 'AMMO4': '0.192', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '55.000'} [2024-08-06 07:42:14,474][52668] DAMAGECOUNT value on done: 892335.0 [2024-08-06 07:42:14,475][52668] Sum rewards: 70.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.168', 'AMMO4': '0.225', 'AMMO3': '0.255', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:14,603][52649] DAMAGECOUNT value on done: 855151.0 [2024-08-06 07:42:14,604][52649] Sum rewards: 82.794, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.374', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.392', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '71.000'} [2024-08-06 07:42:14,619][52670] DAMAGECOUNT value on done: 866778.0 [2024-08-06 07:42:14,620][52670] Sum rewards: 65.639, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.642', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'weapon5': '0.208', 'weapon2': '0.252', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.242', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '57.000'} [2024-08-06 07:42:15,743][52650] Updated weights for policy 0, policy_version 78521 (0.0028) [2024-08-06 07:42:15,869][52666] DAMAGECOUNT value on done: 886516.0 [2024-08-06 07:42:15,872][52666] Sum rewards: 76.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.802', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.090', 'weapon5': '0.208', 'AMMO3': '0.243', 'AMMO4': '0.266', 'weapon2': '0.266', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:16,613][52665] DAMAGECOUNT value on done: 882836.0 [2024-08-06 07:42:16,614][52665] Sum rewards: 66.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.450', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.050', 'AMMO4': '0.164', 'weapon5': '0.194', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '54.000'} [2024-08-06 07:42:17,190][52670] DAMAGECOUNT value on done: 880753.0 [2024-08-06 07:42:17,191][52670] Sum rewards: 58.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.222', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.118', 'AMMO3': '0.259', 'AMMO4': '0.312', 'weapon5': '0.332', 'weapon2': '0.380', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'HITCOUNT': '2.790', 'weapon3': '2.836', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '49.000'} [2024-08-06 07:42:17,305][52811] DAMAGECOUNT value on done: 822656.0 [2024-08-06 07:42:17,305][52811] Sum rewards: 66.602, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.119', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.106', 'weapon5': '0.210', 'AMMO4': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '0.750', 'weapon4': '0.938', 'weapon3': '2.186', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '50.000'} [2024-08-06 07:42:17,334][52668] DAMAGECOUNT value on done: 894873.0 [2024-08-06 07:42:17,336][52668] Sum rewards: 79.208, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.042', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:17,679][52649] DAMAGECOUNT value on done: 876767.0 [2024-08-06 07:42:17,680][52649] Sum rewards: 79.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.781', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.114', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '3.036', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '64.000'} [2024-08-06 07:42:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 643276800. Throughput: 0: 4373.8. Samples: 160818540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:17,802][52567] Avg episode reward: [(0, '75.729')] [2024-08-06 07:42:18,776][52666] DAMAGECOUNT value on done: 885247.0 [2024-08-06 07:42:18,776][52666] Sum rewards: 86.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.143', 'AMMO3': '0.187', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.452', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.892', 'FRAGCOUNT': '70.000'} [2024-08-06 07:42:19,332][52665] DAMAGECOUNT value on done: 882992.0 [2024-08-06 07:42:19,333][52665] Sum rewards: 78.756, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.503', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'weapon4': '0.140', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.366', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '64.000'} [2024-08-06 07:42:20,267][52649] DAMAGECOUNT value on done: 875487.0 [2024-08-06 07:42:20,268][52649] Sum rewards: 71.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.360', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.082', 'AMMO4': '0.217', 'weapon4': '0.238', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.550', 'weapon3': '3.032', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '60.500'} [2024-08-06 07:42:20,292][52668] DAMAGECOUNT value on done: 884631.0 [2024-08-06 07:42:20,293][52668] Sum rewards: 80.892, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.498', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.090', 'AMMO4': '0.168', 'weapon5': '0.226', 'AMMO3': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.850', 'weapon3': '2.972', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '70.000'} [2024-08-06 07:42:20,386][52650] Updated weights for policy 0, policy_version 78531 (0.0025) [2024-08-06 07:42:20,461][52811] DAMAGECOUNT value on done: 827719.0 [2024-08-06 07:42:20,463][52811] Sum rewards: 82.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.218', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'weapon5': '0.126', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.342', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '68.000'} [2024-08-06 07:42:20,472][52670] DAMAGECOUNT value on done: 890563.0 [2024-08-06 07:42:20,475][52670] Sum rewards: 76.894, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.142', 'weapon2': '0.154', 'weapon4': '0.162', 'AMMO4': '0.201', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '64.000'} [2024-08-06 07:42:20,703][52662] DAMAGECOUNT value on done: 889781.0 [2024-08-06 07:42:20,705][52662] Sum rewards: 80.911, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.736', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.082', 'weapon5': '0.092', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.216', 'AMMO3': '0.239', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '68.000'} [2024-08-06 07:42:21,993][52666] DAMAGECOUNT value on done: 878496.0 [2024-08-06 07:42:21,994][52666] Sum rewards: 84.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon2': '0.130', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.192', 'WEAPON3': '1.200', 'weapon3': '3.382', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '69.000'} [2024-08-06 07:42:22,386][52665] DAMAGECOUNT value on done: 873619.0 [2024-08-06 07:42:22,386][52665] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.697', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.038', 'AMMO4': '0.039', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.182', 'AMMO3': '0.209', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '58.000'} [2024-08-06 07:42:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 643366912. Throughput: 0: 4366.7. Samples: 160844550. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:22,802][52567] Avg episode reward: [(0, '76.294')] [2024-08-06 07:42:22,848][52668] DAMAGECOUNT value on done: 888851.0 [2024-08-06 07:42:22,849][52668] Sum rewards: 84.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.828', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.206', 'weapon2': '0.208', 'weapon5': '0.234', 'AMMO3': '0.245', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.068', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '22.134', 'FRAGCOUNT': '67.000'} [2024-08-06 07:42:23,416][52670] DAMAGECOUNT value on done: 883992.0 [2024-08-06 07:42:23,416][52670] Sum rewards: 72.139, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.786', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.080', 'AMMO4': '0.168', 'weapon5': '0.240', 'AMMO3': '0.243', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:23,436][52649] DAMAGECOUNT value on done: 868778.0 [2024-08-06 07:42:23,437][52649] Sum rewards: 74.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.856', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.034', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.282', 'weapon2': '0.470', 'WEAPON3': '1.700', 'weapon3': '3.154', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:23,524][52811] DAMAGECOUNT value on done: 830441.0 [2024-08-06 07:42:23,524][52811] Sum rewards: 77.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.199', 'weapon2': '0.272', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.346', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '64.000'} [2024-08-06 07:42:23,725][52662] DAMAGECOUNT value on done: 899735.0 [2024-08-06 07:42:23,725][52662] Sum rewards: 77.813, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.572', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon4': '0.100', 'AMMO4': '0.133', 'weapon5': '0.140', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:24,787][52668] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:42:25,102][52650] Updated weights for policy 0, policy_version 78541 (0.0030) [2024-08-06 07:42:25,152][52666] DAMAGECOUNT value on done: 877607.0 [2024-08-06 07:42:25,153][52666] Sum rewards: 63.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.650', 'AMMO5': '0.004', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.215', 'weapon2': '0.662', 'WEAPON3': '1.400', 'HITCOUNT': '3.140', 'weapon3': '3.144', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '54.000'} [2024-08-06 07:42:25,366][52665] DAMAGECOUNT value on done: 878693.0 [2024-08-06 07:42:25,368][52665] Sum rewards: 71.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.222', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.516', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:25,545][52668] DAMAGECOUNT value on done: 895829.0 [2024-08-06 07:42:25,545][52668] Sum rewards: 74.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.110', 'AMMO3': '0.198', 'weapon5': '0.246', 'AMMO4': '0.265', 'WEAPON4': '0.500', 'weapon2': '0.516', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:26,494][52670] DAMAGECOUNT value on done: 886162.0 [2024-08-06 07:42:26,494][52670] Sum rewards: 71.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.158', 'AMMO5': '0.007', 'weapon5': '0.020', 'AMMO2': '0.026', 'weapon4': '0.032', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.318', 'WEAPON3': '1.500', 'weapon3': '3.428', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '61.000'} [2024-08-06 07:42:26,689][52811] DAMAGECOUNT value on done: 846180.0 [2024-08-06 07:42:26,692][52811] Sum rewards: 87.940, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.164', 'weapon2': '0.192', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '73.000'} [2024-08-06 07:42:26,799][52662] DAMAGECOUNT value on done: 899421.0 [2024-08-06 07:42:26,804][52662] Sum rewards: 78.223, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.820', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.126', 'weapon4': '0.138', 'AMMO4': '0.157', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.266', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:27,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 643448832. Throughput: 0: 4358.8. Samples: 160870380. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:27,795][52567] Avg episode reward: [(0, '76.094')] [2024-08-06 07:42:27,825][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078547_643457024.pth... [2024-08-06 07:42:27,945][52666] DAMAGECOUNT value on done: 897037.0 [2024-08-06 07:42:27,946][52666] Sum rewards: 90.494, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.278', 'weapon4': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '4.450', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '75.000'} [2024-08-06 07:42:27,962][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078035_639262720.pth [2024-08-06 07:42:28,085][52665] DAMAGECOUNT value on done: 883607.0 [2024-08-06 07:42:28,086][52665] Sum rewards: 73.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.865', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.070', 'weapon5': '0.248', 'AMMO3': '0.260', 'AMMO4': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.660', 'WEAPON3': '1.550', 'weapon3': '2.744', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:28,600][52668] DAMAGECOUNT value on done: 887839.0 [2024-08-06 07:42:28,601][52668] Sum rewards: 68.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.806', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.116', 'weapon4': '0.126', 'AMMO4': '0.179', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '57.500'} [2024-08-06 07:42:28,625][52667] DAMAGECOUNT value on done: 889857.0 [2024-08-06 07:42:28,626][52667] Sum rewards: 75.380, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.119', 'weapon5': '0.148', 'AMMO3': '0.205', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.298', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:29,831][52811] DAMAGECOUNT value on done: 839146.0 [2024-08-06 07:42:29,836][52811] Sum rewards: 87.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.226', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '69.000'} [2024-08-06 07:42:30,054][52662] DAMAGECOUNT value on done: 885014.0 [2024-08-06 07:42:30,054][52662] Sum rewards: 64.773, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.410', 'AMMO5': '0.033', 'AMMO2': '0.086', 'weapon4': '0.176', 'AMMO3': '0.262', 'weapon5': '0.298', 'AMMO4': '0.428', 'weapon2': '0.444', 'WEAPON4': '0.900', 'WEAPON5': '0.900', 'WEAPON3': '1.650', 'weapon3': '2.664', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '58.000'} [2024-08-06 07:42:30,147][52650] Updated weights for policy 0, policy_version 78551 (0.0022) [2024-08-06 07:42:30,801][52666] DAMAGECOUNT value on done: 870746.0 [2024-08-06 07:42:30,802][52666] Sum rewards: 69.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.219', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.060', 'weapon5': '0.126', 'AMMO3': '0.216', 'AMMO4': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.216', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '59.000'} [2024-08-06 07:42:31,437][52667] DAMAGECOUNT value on done: 902848.0 [2024-08-06 07:42:31,439][52667] Sum rewards: 78.053, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.008', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.131', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.288', 'WEAPON3': '1.500', 'weapon3': '3.378', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:31,754][52668] DAMAGECOUNT value on done: 883603.0 [2024-08-06 07:42:31,755][52668] Sum rewards: 80.979, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.408', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:32,796][52567] Fps is (10 sec: 16381.0, 60 sec: 17339.2, 300 sec: 17439.1). Total num frames: 643530752. Throughput: 0: 4352.5. Samples: 160883290. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:32,796][52567] Avg episode reward: [(0, '76.155')] [2024-08-06 07:42:32,860][52811] DAMAGECOUNT value on done: 827509.0 [2024-08-06 07:42:32,860][52811] Sum rewards: 64.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.934', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.164', 'weapon4': '0.204', 'AMMO4': '0.220', 'AMMO3': '0.245', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '3.080', 'weapon3': '3.086', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '57.000'} [2024-08-06 07:42:33,059][52662] DAMAGECOUNT value on done: 903763.0 [2024-08-06 07:42:33,059][52662] Sum rewards: 74.024, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.487', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.152', 'AMMO3': '0.161', 'AMMO4': '0.238', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '2.938', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '59.000'} [2024-08-06 07:42:33,544][52666] DAMAGECOUNT value on done: 879904.0 [2024-08-06 07:42:33,545][52666] Sum rewards: 77.798, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.802', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.080', 'AMMO4': '0.159', 'weapon5': '0.168', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:34,426][52650] Updated weights for policy 0, policy_version 78561 (0.0023) [2024-08-06 07:42:34,586][52667] DAMAGECOUNT value on done: 900176.0 [2024-08-06 07:42:34,586][52667] Sum rewards: 87.752, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.405', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.108', 'AMMO3': '0.164', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.000', 'weapon3': '3.094', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '68.000'} [2024-08-06 07:42:34,795][52668] DAMAGECOUNT value on done: 881847.0 [2024-08-06 07:42:34,795][52668] Sum rewards: 79.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.408', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.102', 'weapon5': '0.186', 'AMMO4': '0.206', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '66.000'} [2024-08-06 07:42:35,633][52667] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:35,952][52811] DAMAGECOUNT value on done: 836657.0 [2024-08-06 07:42:35,954][52811] Sum rewards: 81.869, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.800', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.140', 'AMMO3': '0.164', 'AMMO4': '0.211', 'weapon5': '0.228', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.114', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:36,546][52662] DAMAGECOUNT value on done: 881796.0 [2024-08-06 07:42:36,546][52662] Sum rewards: 76.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.494', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.078', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:37,543][52668] DAMAGECOUNT value on done: 881097.0 [2024-08-06 07:42:37,543][52668] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.862', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.120', 'weapon4': '0.172', 'AMMO3': '0.211', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:37,683][52667] DAMAGECOUNT value on done: 903368.0 [2024-08-06 07:42:37,685][52667] Sum rewards: 76.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.999', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.124', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.386', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:37,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 643620864. Throughput: 0: 4341.3. Samples: 160909240. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:42:37,795][52567] Avg episode reward: [(0, '76.683')] [2024-08-06 07:42:38,241][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:39,054][52811] DAMAGECOUNT value on done: 834412.0 [2024-08-06 07:42:39,066][52811] Sum rewards: 66.709, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO2': '0.001', 'AMMO4': '0.003', 'AMMO3': '0.176', 'weapon2': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '3.320', 'weapon3': '3.432', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '54.000'} [2024-08-06 07:42:39,288][52650] Updated weights for policy 0, policy_version 78571 (0.0024) [2024-08-06 07:42:39,464][52662] DAMAGECOUNT value on done: 889905.0 [2024-08-06 07:42:39,466][52662] Sum rewards: 81.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.558', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.146', 'AMMO4': '0.153', 'weapon4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '66.500'} [2024-08-06 07:42:40,153][52668] DAMAGECOUNT value on done: 875284.0 [2024-08-06 07:42:40,153][52668] Sum rewards: 81.784, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'HEALTH': '0.015', 'AMMO2': '0.022', 'weapon5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.113', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.614', 'WEAPON3': '0.700', 'weapon3': '2.912', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '64.000'} [2024-08-06 07:42:40,329][52667] DAMAGECOUNT value on done: 905407.0 [2024-08-06 07:42:40,329][52667] Sum rewards: 67.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.138', 'AMMO4': '0.197', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.174', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '58.000'} [2024-08-06 07:42:42,101][52811] DAMAGECOUNT value on done: 838520.0 [2024-08-06 07:42:42,102][52811] Sum rewards: 79.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.529', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.230', 'WEAPON3': '1.250', 'HITCOUNT': '3.460', 'weapon3': '3.568', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:42,531][52662] DAMAGECOUNT value on done: 906486.0 [2024-08-06 07:42:42,534][52662] Sum rewards: 73.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.102', 'weapon5': '0.130', 'AMMO4': '0.135', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '61.000'} [2024-08-06 07:42:42,794][52567] Fps is (10 sec: 18025.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 643710976. Throughput: 0: 4336.7. Samples: 160935130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:42:42,794][52567] Avg episode reward: [(0, '76.575')] [2024-08-06 07:42:43,132][52668] DAMAGECOUNT value on done: 889946.0 [2024-08-06 07:42:43,135][52668] Sum rewards: 76.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.406', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '64.000'} [2024-08-06 07:42:43,435][52667] DAMAGECOUNT value on done: 903160.0 [2024-08-06 07:42:43,437][52667] Sum rewards: 74.974, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.005', 'AMMO5': '0.026', 'AMMO2': '0.061', 'weapon5': '0.160', 'weapon4': '0.166', 'AMMO3': '0.202', 'weapon2': '0.218', 'AMMO4': '0.306', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '64.000'} [2024-08-06 07:42:44,082][52650] Updated weights for policy 0, policy_version 78581 (0.0012) [2024-08-06 07:42:44,094][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:45,166][52662] DAMAGECOUNT value on done: 890966.0 [2024-08-06 07:42:45,169][52662] Sum rewards: 71.453, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.044', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.134', 'AMMO3': '0.138', 'weapon2': '0.198', 'WEAPON5': '0.300', 'weapon4': '0.346', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.160', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '54.000'} [2024-08-06 07:42:45,295][52811] DAMAGECOUNT value on done: 843312.0 [2024-08-06 07:42:45,297][52811] Sum rewards: 72.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.101', 'weapon5': '0.150', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:46,138][52668] DAMAGECOUNT value on done: 892165.0 [2024-08-06 07:42:46,138][52668] Sum rewards: 75.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon2': '0.320', 'weapon4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '61.000'} [2024-08-06 07:42:46,453][52667] DAMAGECOUNT value on done: 896968.0 [2024-08-06 07:42:46,454][52667] Sum rewards: 77.042, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.019', 'AMMO5': '0.013', 'AMMO2': '0.067', 'weapon2': '0.176', 'weapon5': '0.220', 'AMMO3': '0.272', 'weapon4': '0.314', 'AMMO4': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 643792896. Throughput: 0: 4334.2. Samples: 160948230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:42:47,795][52567] Avg episode reward: [(0, '76.715')] [2024-08-06 07:42:47,902][52658] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:42:48,307][52811] DAMAGECOUNT value on done: 833914.0 [2024-08-06 07:42:48,308][52811] Sum rewards: 65.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.040', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.374', 'WEAPON3': '1.600', 'weapon3': '3.200', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '57.000'} [2024-08-06 07:42:48,453][52662] DAMAGECOUNT value on done: 900087.0 [2024-08-06 07:42:48,454][52662] Sum rewards: 82.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.120', 'weapon4': '0.156', 'AMMO3': '0.185', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '68.000'} [2024-08-06 07:42:48,714][52650] Updated weights for policy 0, policy_version 78591 (0.0012) [2024-08-06 07:42:48,860][52668] DAMAGECOUNT value on done: 890346.0 [2024-08-06 07:42:48,862][52668] Sum rewards: 79.032, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.748', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.104', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:49,042][52660] DAMAGECOUNT value on done: 888246.0 [2024-08-06 07:42:49,043][52660] Sum rewards: 71.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.696', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.106', 'AMMO4': '0.139', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '59.000'} [2024-08-06 07:42:49,098][52667] DAMAGECOUNT value on done: 894555.0 [2024-08-06 07:42:49,105][52667] Sum rewards: 69.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.308', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.088', 'weapon7': '0.096', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.482', 'weapon2': '0.546', 'WEAPON3': '1.000', 'weapon3': '2.488', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '56.000'} [2024-08-06 07:42:51,168][52662] DAMAGECOUNT value on done: 892197.0 [2024-08-06 07:42:51,169][52662] Sum rewards: 84.996, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.781', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.227', 'weapon2': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '71.000'} [2024-08-06 07:42:51,298][52668] DAMAGECOUNT value on done: 894719.0 [2024-08-06 07:42:51,300][52668] Sum rewards: 80.825, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.108', 'AMMO4': '0.126', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.360', 'weapon2': '0.446', 'WEAPON3': '0.850', 'weapon3': '3.226', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:51,448][52811] DAMAGECOUNT value on done: 831683.0 [2024-08-06 07:42:51,448][52811] Sum rewards: 79.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.955', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.110', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.396', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '65.000'} [2024-08-06 07:42:51,525][52660] DAMAGECOUNT value on done: 880152.0 [2024-08-06 07:42:51,525][52660] Sum rewards: 57.350, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.128', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.402', 'weapon4': '0.402', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '2.852', 'DAMAGECOUNT': '13.395', 'FRAGCOUNT': '47.000'} [2024-08-06 07:42:52,155][52667] DAMAGECOUNT value on done: 895279.0 [2024-08-06 07:42:52,155][52667] Sum rewards: 73.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.872', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.122', 'weapon5': '0.124', 'AMMO4': '0.153', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:52,662][52659] DAMAGECOUNT value on done: 894601.0 [2024-08-06 07:42:52,664][52659] Sum rewards: 58.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.513', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.192', 'weapon5': '0.226', 'AMMO3': '0.227', 'AMMO4': '0.291', 'weapon2': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '2.600', 'weapon3': '2.990', 'DAMAGECOUNT': '13.962', 'FRAGCOUNT': '52.000'} [2024-08-06 07:42:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 643883008. Throughput: 0: 4336.5. Samples: 160974680. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:42:52,794][52567] Avg episode reward: [(0, '75.968')] [2024-08-06 07:42:53,358][52650] Updated weights for policy 0, policy_version 78601 (0.0011) [2024-08-06 07:42:53,774][52662] DAMAGECOUNT value on done: 891168.0 [2024-08-06 07:42:53,775][52662] Sum rewards: 66.189, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.232', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.104', 'AMMO3': '0.254', 'weapon5': '0.274', 'AMMO4': '0.312', 'weapon2': '0.414', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.882', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '57.000'} [2024-08-06 07:42:54,327][52668] DAMAGECOUNT value on done: 897000.0 [2024-08-06 07:42:54,329][52668] Sum rewards: 79.815, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.015', 'AMMO2': '0.025', 'HEALTH': '0.037', 'AMMO4': '0.124', 'AMMO3': '0.171', 'weapon5': '0.236', 'WEAPON4': '0.300', 'weapon4': '0.316', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '62.000'} [2024-08-06 07:42:54,580][52811] DAMAGECOUNT value on done: 831445.0 [2024-08-06 07:42:54,582][52811] Sum rewards: 68.400, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.140', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.806', 'WEAPON3': '1.100', 'weapon3': '2.894', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '54.000'} [2024-08-06 07:42:54,705][52660] DAMAGECOUNT value on done: 891952.0 [2024-08-06 07:42:54,707][52660] Sum rewards: 74.510, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.720', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.102', 'weapon5': '0.134', 'AMMO4': '0.152', 'weapon2': '0.218', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.266', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:55,140][52667] DAMAGECOUNT value on done: 902818.0 [2024-08-06 07:42:55,142][52667] Sum rewards: 78.730, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.022', 'weapon5': '0.050', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '63.000'} [2024-08-06 07:42:55,441][52659] DAMAGECOUNT value on done: 890473.0 [2024-08-06 07:42:55,441][52659] Sum rewards: 72.760, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.339', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon4': '0.192', 'AMMO3': '0.245', 'weapon5': '0.258', 'weapon2': '0.262', 'AMMO4': '0.311', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.978', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '60.000'} [2024-08-06 07:42:56,517][52662] DAMAGECOUNT value on done: 885390.0 [2024-08-06 07:42:56,517][52662] Sum rewards: 89.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.053', 'AMMO5': '0.019', 'AMMO2': '0.044', 'AMMO3': '0.201', 'weapon5': '0.218', 'AMMO4': '0.222', 'weapon2': '0.272', 'weapon4': '0.300', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.912', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.609', 'FRAGCOUNT': '71.000'} [2024-08-06 07:42:57,697][52811] DAMAGECOUNT value on done: 833281.0 [2024-08-06 07:42:57,702][52811] Sum rewards: 66.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.755', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon4': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.195', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.070', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '54.000'} [2024-08-06 07:42:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 643973120. Throughput: 0: 4350.0. Samples: 161000950. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:42:57,795][52567] Avg episode reward: [(0, '75.494')] [2024-08-06 07:42:57,869][52660] DAMAGECOUNT value on done: 903435.0 [2024-08-06 07:42:57,871][52660] Sum rewards: 75.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.896', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.033', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.286', 'weapon2': '0.440', 'WEAPON3': '1.850', 'weapon3': '3.256', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '67.000'} [2024-08-06 07:42:58,011][52650] Updated weights for policy 0, policy_version 78611 (0.0013) [2024-08-06 07:42:58,101][52667] DAMAGECOUNT value on done: 891345.0 [2024-08-06 07:42:58,103][52667] Sum rewards: 86.884, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.140', 'AMMO4': '0.149', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.432', 'HEALTH': '0.794', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.787', 'FRAGCOUNT': '68.000'} [2024-08-06 07:42:58,621][52659] DAMAGECOUNT value on done: 902273.0 [2024-08-06 07:42:58,630][52659] Sum rewards: 75.693, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.413', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.040', 'AMMO4': '0.060', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.500'} [2024-08-06 07:42:59,889][52662] DAMAGECOUNT value on done: 895154.0 [2024-08-06 07:42:59,890][52662] Sum rewards: 75.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.044', 'weapon5': '0.114', 'WEAPON4': '0.150', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.312', 'WEAPON3': '1.700', 'weapon3': '3.316', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:00,807][52811] DAMAGECOUNT value on done: 841259.0 [2024-08-06 07:43:00,808][52811] Sum rewards: 71.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.550', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon2': '0.162', 'weapon5': '0.182', 'AMMO3': '0.188', 'weapon4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:00,973][52660] DAMAGECOUNT value on done: 885611.0 [2024-08-06 07:43:00,973][52660] Sum rewards: 85.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.364', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.078', 'AMMO4': '0.102', 'weapon5': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '69.500'} [2024-08-06 07:43:01,080][52667] DAMAGECOUNT value on done: 893456.0 [2024-08-06 07:43:01,080][52667] Sum rewards: 78.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.136', 'AMMO3': '0.189', 'weapon5': '0.204', 'AMMO4': '0.221', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:01,629][52659] DAMAGECOUNT value on done: 894966.0 [2024-08-06 07:43:01,629][52659] Sum rewards: 84.251, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'AMMO3': '0.186', 'weapon4': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '67.000'} [2024-08-06 07:43:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 644055040. Throughput: 0: 4344.4. Samples: 161014040. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:43:02,794][52567] Avg episode reward: [(0, '75.622')] [2024-08-06 07:43:02,968][52650] Updated weights for policy 0, policy_version 78621 (0.0022) [2024-08-06 07:43:03,194][52662] DAMAGECOUNT value on done: 885128.0 [2024-08-06 07:43:03,194][52662] Sum rewards: 65.907, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.806', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.054', 'weapon4': '0.060', 'AMMO3': '0.239', 'AMMO4': '0.247', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '56.500'} [2024-08-06 07:43:03,688][52660] DAMAGECOUNT value on done: 884941.0 [2024-08-06 07:43:03,689][52660] Sum rewards: 85.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.998', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.098', 'AMMO4': '0.170', 'AMMO3': '0.184', 'weapon2': '0.210', 'weapon5': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '69.000'} [2024-08-06 07:43:03,850][52811] DAMAGECOUNT value on done: 843318.0 [2024-08-06 07:43:03,850][52811] Sum rewards: 66.618, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.009', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.053', 'WEAPON4': '0.150', 'weapon5': '0.174', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '55.000'} [2024-08-06 07:43:04,084][52667] DAMAGECOUNT value on done: 902634.0 [2024-08-06 07:43:04,085][52667] Sum rewards: 70.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.215', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.146', 'weapon5': '0.176', 'AMMO3': '0.207', 'AMMO4': '0.238', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.660', 'WEAPON3': '1.250', 'weapon3': '2.624', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:04,419][52659] DAMAGECOUNT value on done: 890820.0 [2024-08-06 07:43:04,419][52659] Sum rewards: 85.888, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.709', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.270', 'weapon2': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.534', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '73.000'} [2024-08-06 07:43:04,777][52803] DAMAGECOUNT value on done: 830567.0 [2024-08-06 07:43:04,778][52803] Sum rewards: 78.553, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.140', 'AMMO4': '0.151', 'weapon2': '0.206', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.368', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '66.000'} [2024-08-06 07:43:05,974][52671] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:43:06,225][52662] DAMAGECOUNT value on done: 902569.0 [2024-08-06 07:43:06,226][52662] Sum rewards: 65.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.080', 'weapon2': '0.192', 'weapon5': '0.216', 'AMMO4': '0.248', 'AMMO3': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.000', 'weapon3': '3.298', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '55.000'} [2024-08-06 07:43:06,728][52660] DAMAGECOUNT value on done: 891434.0 [2024-08-06 07:43:06,729][52660] Sum rewards: 83.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.255', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.208', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.738', 'FRAGCOUNT': '65.500'} [2024-08-06 07:43:06,911][52811] DAMAGECOUNT value on done: 831803.0 [2024-08-06 07:43:06,914][52811] Sum rewards: 87.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.407', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.244', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '22.233', 'FRAGCOUNT': '71.000'} [2024-08-06 07:43:06,930][52667] DAMAGECOUNT value on done: 893241.0 [2024-08-06 07:43:06,932][52667] Sum rewards: 66.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.923', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.103', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.222', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '54.000'} [2024-08-06 07:43:06,968][52659] DAMAGECOUNT value on done: 893722.0 [2024-08-06 07:43:06,969][52659] Sum rewards: 83.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.580', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.247', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.410', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.036', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:07,542][52650] Updated weights for policy 0, policy_version 78631 (0.0013) [2024-08-06 07:43:07,685][52803] DAMAGECOUNT value on done: 828333.0 [2024-08-06 07:43:07,687][52803] Sum rewards: 81.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.968', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.098', 'AMMO4': '0.173', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.230', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '66.000'} [2024-08-06 07:43:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 644145152. Throughput: 0: 4346.7. Samples: 161040150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:43:07,794][52567] Avg episode reward: [(0, '75.690')] [2024-08-06 07:43:08,575][52662] DAMAGECOUNT value on done: 895623.0 [2024-08-06 07:43:08,575][52662] Sum rewards: 80.777, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.860', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.164', 'weapon5': '0.168', 'AMMO4': '0.185', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.600', 'weapon3': '2.992', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '67.000'} [2024-08-06 07:43:09,631][52660] DAMAGECOUNT value on done: 897542.0 [2024-08-06 07:43:09,631][52660] Sum rewards: 67.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.306', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.072', 'weapon5': '0.106', 'AMMO4': '0.137', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '57.500'} [2024-08-06 07:43:09,856][52667] DAMAGECOUNT value on done: 898812.0 [2024-08-06 07:43:09,857][52667] Sum rewards: 88.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.231', 'weapon2': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.558', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '73.000'} [2024-08-06 07:43:09,891][52659] DAMAGECOUNT value on done: 895372.0 [2024-08-06 07:43:09,894][52659] Sum rewards: 72.238, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.022', 'AMMO2': '0.073', 'weapon4': '0.140', 'AMMO3': '0.176', 'weapon5': '0.296', 'weapon2': '0.342', 'AMMO4': '0.367', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '59.000'} [2024-08-06 07:43:09,970][52811] DAMAGECOUNT value on done: 829524.0 [2024-08-06 07:43:09,972][52811] Sum rewards: 76.157, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.090', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.052', 'weapon5': '0.168', 'AMMO4': '0.210', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.920', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:10,400][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:43:10,872][52803] DAMAGECOUNT value on done: 836413.0 [2024-08-06 07:43:10,872][52803] Sum rewards: 66.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.740', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.158', 'AMMO4': '0.216', 'AMMO3': '0.219', 'weapon2': '0.316', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '55.000'} [2024-08-06 07:43:11,476][52662] DAMAGECOUNT value on done: 883921.0 [2024-08-06 07:43:11,477][52662] Sum rewards: 81.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.621', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.100', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '66.000'} [2024-08-06 07:43:12,226][52650] Updated weights for policy 0, policy_version 78641 (0.0025) [2024-08-06 07:43:12,230][52660] DAMAGECOUNT value on done: 887153.0 [2024-08-06 07:43:12,231][52660] Sum rewards: 88.982, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.191', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.184', 'AMMO3': '0.207', 'weapon2': '0.272', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '72.000'} [2024-08-06 07:43:12,490][52659] DAMAGECOUNT value on done: 892526.0 [2024-08-06 07:43:12,492][52659] Sum rewards: 71.526, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.654', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.072', 'AMMO4': '0.114', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'weapon2': '0.410', 'WEAPON3': '1.700', 'weapon3': '3.102', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '62.000'} [2024-08-06 07:43:12,777][52667] DAMAGECOUNT value on done: 905302.0 [2024-08-06 07:43:12,778][52667] Sum rewards: 77.591, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.064', 'AMMO3': '0.149', 'HEALTH': '0.220', 'weapon2': '0.538', 'WEAPON3': '0.900', 'weapon3': '3.208', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '61.000'} [2024-08-06 07:43:12,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 644235264. Throughput: 0: 4354.0. Samples: 161066310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:43:12,794][52567] Avg episode reward: [(0, '76.401')] [2024-08-06 07:43:14,081][52803] DAMAGECOUNT value on done: 834256.0 [2024-08-06 07:43:14,083][52803] Sum rewards: 68.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.948', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.134', 'AMMO4': '0.191', 'AMMO3': '0.224', 'weapon5': '0.236', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '57.000'} [2024-08-06 07:43:14,307][52662] DAMAGECOUNT value on done: 890134.0 [2024-08-06 07:43:14,307][52662] Sum rewards: 61.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.107', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.104', 'weapon4': '0.150', 'AMMO3': '0.201', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.536', 'DAMAGECOUNT': '15.111', 'FRAGCOUNT': '50.000'} [2024-08-06 07:43:15,027][52660] DAMAGECOUNT value on done: 881661.0 [2024-08-06 07:43:15,035][52660] Sum rewards: 78.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.100', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:15,081][52659] DAMAGECOUNT value on done: 892089.0 [2024-08-06 07:43:15,082][52659] Sum rewards: 65.158, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.596', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.040', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.392', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.292', 'DAMAGECOUNT': '15.720', 'FRAGCOUNT': '53.000'} [2024-08-06 07:43:15,741][52667] DAMAGECOUNT value on done: 906243.0 [2024-08-06 07:43:15,742][52667] Sum rewards: 64.288, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.346', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.098', 'AMMO4': '0.139', 'AMMO3': '0.146', 'WEAPON4': '0.300', 'weapon5': '0.314', 'WEAPON5': '0.450', 'weapon2': '0.904', 'WEAPON3': '0.950', 'weapon3': '2.494', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '50.000'} [2024-08-06 07:43:17,032][52650] Updated weights for policy 0, policy_version 78651 (0.0031) [2024-08-06 07:43:17,149][52803] DAMAGECOUNT value on done: 830730.0 [2024-08-06 07:43:17,150][52803] Sum rewards: 68.981, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.158', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.149', 'weapon2': '0.170', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.800', 'weapon3': '3.274', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '61.500'} [2024-08-06 07:43:17,479][52662] DAMAGECOUNT value on done: 884383.0 [2024-08-06 07:43:17,480][52662] Sum rewards: 76.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.300', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:17,643][52659] DAMAGECOUNT value on done: 901480.0 [2024-08-06 07:43:17,643][52659] Sum rewards: 73.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.198', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO3': '0.165', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.000', 'weapon3': '2.928', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 644325376. Throughput: 0: 4361.9. Samples: 161079570. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:43:17,795][52567] Avg episode reward: [(0, '75.571')] [2024-08-06 07:43:18,218][52660] DAMAGECOUNT value on done: 890660.0 [2024-08-06 07:43:18,218][52660] Sum rewards: 60.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.487', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.051', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'HITCOUNT': '2.850', 'weapon3': '3.516', 'DAMAGECOUNT': '14.373', 'FRAGCOUNT': '53.000'} [2024-08-06 07:43:18,501][52667] DAMAGECOUNT value on done: 899098.0 [2024-08-06 07:43:18,502][52667] Sum rewards: 65.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.352', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.324', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '54.000'} [2024-08-06 07:43:20,281][52803] DAMAGECOUNT value on done: 831224.0 [2024-08-06 07:43:20,290][52803] Sum rewards: 63.049, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.216', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '53.000'} [2024-08-06 07:43:20,751][52659] DAMAGECOUNT value on done: 886695.0 [2024-08-06 07:43:20,752][52659] Sum rewards: 76.871, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.406', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.474', 'WEAPON3': '1.050', 'weapon3': '3.190', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '62.000'} [2024-08-06 07:43:21,295][52660] DAMAGECOUNT value on done: 883222.0 [2024-08-06 07:43:21,295][52660] Sum rewards: 86.920, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.932', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.132', 'AMMO4': '0.134', 'AMMO3': '0.178', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '70.000'} [2024-08-06 07:43:21,455][52650] Updated weights for policy 0, policy_version 78661 (0.0015) [2024-08-06 07:43:21,479][52667] DAMAGECOUNT value on done: 897603.0 [2024-08-06 07:43:21,480][52667] Sum rewards: 82.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.600', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.120', 'AMMO4': '0.148', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.592', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 644407296. Throughput: 0: 4370.5. Samples: 161105910. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:43:22,794][52567] Avg episode reward: [(0, '75.285')] [2024-08-06 07:43:23,464][52803] DAMAGECOUNT value on done: 826744.0 [2024-08-06 07:43:23,466][52803] Sum rewards: 77.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.096', 'AMMO4': '0.153', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '64.000'} [2024-08-06 07:43:23,810][52659] DAMAGECOUNT value on done: 899441.0 [2024-08-06 07:43:23,811][52659] Sum rewards: 75.691, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.578', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon5': '0.214', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.078', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '61.000'} [2024-08-06 07:43:24,351][52667] DAMAGECOUNT value on done: 902126.0 [2024-08-06 07:43:24,351][52667] Sum rewards: 80.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.226', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.172', 'AMMO3': '0.180', 'AMMO4': '0.180', 'weapon4': '0.202', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '64.000'} [2024-08-06 07:43:24,435][52660] DAMAGECOUNT value on done: 884386.0 [2024-08-06 07:43:24,436][52660] Sum rewards: 72.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.344', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'weapon4': '0.104', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.350', 'weapon3': '3.392', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 07:43:26,210][52659] DAMAGECOUNT value on done: 891251.0 [2024-08-06 07:43:26,213][52659] Sum rewards: 83.874, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.795', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.132', 'weapon2': '0.158', 'AMMO4': '0.175', 'AMMO3': '0.182', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:26,445][52650] Updated weights for policy 0, policy_version 78671 (0.0031) [2024-08-06 07:43:26,586][52803] DAMAGECOUNT value on done: 826834.0 [2024-08-06 07:43:26,588][52803] Sum rewards: 75.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.203', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.922', 'FRAGCOUNT': '61.000'} [2024-08-06 07:43:26,757][52820] DAMAGECOUNT value on done: 825612.0 [2024-08-06 07:43:26,759][52820] Sum rewards: 64.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '53.500'} [2024-08-06 07:43:27,693][52660] DAMAGECOUNT value on done: 896033.0 [2024-08-06 07:43:27,694][52660] Sum rewards: 91.943, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.112', 'AMMO3': '0.161', 'weapon5': '0.164', 'AMMO4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.594', 'WEAPON3': '0.900', 'HEALTH': '0.922', 'weapon3': '2.910', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '72.000'} [2024-08-06 07:43:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.4, 300 sec: 17494.8). Total num frames: 644497408. Throughput: 0: 4370.4. Samples: 161131800. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:43:27,794][52567] Avg episode reward: [(0, '75.351')] [2024-08-06 07:43:28,703][52668] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:43:29,474][52659] DAMAGECOUNT value on done: 890834.0 [2024-08-06 07:43:29,476][52659] Sum rewards: 69.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.558', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.126', 'AMMO4': '0.175', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.350', 'HITCOUNT': '3.210', 'weapon3': '3.260', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:29,632][52803] DAMAGECOUNT value on done: 834021.0 [2024-08-06 07:43:29,634][52803] Sum rewards: 71.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.255', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.072', 'AMMO4': '0.128', 'AMMO3': '0.226', 'weapon5': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '61.000'} [2024-08-06 07:43:29,929][52820] DAMAGECOUNT value on done: 826550.0 [2024-08-06 07:43:29,932][52820] Sum rewards: 71.475, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.918', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.048', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '59.000'} [2024-08-06 07:43:30,762][52660] DAMAGECOUNT value on done: 909077.0 [2024-08-06 07:43:30,765][52660] Sum rewards: 75.034, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.250', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.076', 'weapon5': '0.196', 'AMMO4': '0.215', 'AMMO3': '0.278', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.138', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '64.500'} [2024-08-06 07:43:30,827][52650] Updated weights for policy 0, policy_version 78681 (0.0013) [2024-08-06 07:43:32,521][52659] DAMAGECOUNT value on done: 894853.0 [2024-08-06 07:43:32,526][52659] Sum rewards: 68.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.665', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.217', 'weapon5': '0.220', 'AMMO4': '0.243', 'weapon4': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17613.3, 300 sec: 17467.0). Total num frames: 644587520. Throughput: 0: 4370.9. Samples: 161144920. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:43:32,795][52567] Avg episode reward: [(0, '75.214')] [2024-08-06 07:43:32,843][52803] DAMAGECOUNT value on done: 827440.0 [2024-08-06 07:43:32,845][52803] Sum rewards: 82.049, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'weapon2': '0.154', 'weapon4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:32,985][52820] DAMAGECOUNT value on done: 826383.0 [2024-08-06 07:43:32,986][52820] Sum rewards: 71.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.704', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon2': '0.166', 'weapon5': '0.174', 'AMMO4': '0.176', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.332', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 07:43:33,942][52660] DAMAGECOUNT value on done: 886744.0 [2024-08-06 07:43:33,945][52660] Sum rewards: 74.305, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.283', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.048', 'weapon5': '0.092', 'AMMO4': '0.237', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.800', 'weapon3': '3.218', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:35,734][52659] DAMAGECOUNT value on done: 893130.0 [2024-08-06 07:43:35,734][52659] Sum rewards: 72.106, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.918', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.238', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '60.000'} [2024-08-06 07:43:35,749][52650] Updated weights for policy 0, policy_version 78691 (0.0019) [2024-08-06 07:43:35,923][52803] DAMAGECOUNT value on done: 841719.0 [2024-08-06 07:43:35,923][52803] Sum rewards: 78.273, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.635', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.040', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.204', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.394', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:36,111][52820] DAMAGECOUNT value on done: 815850.0 [2024-08-06 07:43:36,112][52820] Sum rewards: 70.303, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.748', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.072', 'weapon5': '0.184', 'weapon2': '0.278', 'AMMO4': '0.294', 'AMMO3': '0.345', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '2.050', 'weapon3': '3.124', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '64.000'} [2024-08-06 07:43:36,772][52660] DAMAGECOUNT value on done: 894120.0 [2024-08-06 07:43:36,772][52660] Sum rewards: 79.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.911', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.163', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '66.000'} [2024-08-06 07:43:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 644669440. Throughput: 0: 4370.2. Samples: 161171340. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:43:37,794][52567] Avg episode reward: [(0, '75.174')] [2024-08-06 07:43:38,502][52659] DAMAGECOUNT value on done: 902452.0 [2024-08-06 07:43:38,506][52659] Sum rewards: 65.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.306', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.144', 'weapon5': '0.220', 'weapon2': '0.238', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.020', 'weapon3': '3.256', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '56.000'} [2024-08-06 07:43:39,185][52803] DAMAGECOUNT value on done: 834715.0 [2024-08-06 07:43:39,189][52803] Sum rewards: 75.003, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.010', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.118', 'AMMO4': '0.172', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '59.000'} [2024-08-06 07:43:39,197][52820] DAMAGECOUNT value on done: 828256.0 [2024-08-06 07:43:39,197][52820] Sum rewards: 64.167, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.330', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.066', 'AMMO4': '0.186', 'weapon5': '0.190', 'AMMO3': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '56.000'} [2024-08-06 07:43:39,577][52660] DAMAGECOUNT value on done: 891248.0 [2024-08-06 07:43:39,580][52660] Sum rewards: 66.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.356', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.108', 'AMMO4': '0.173', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:40,488][52650] Updated weights for policy 0, policy_version 78701 (0.0010) [2024-08-06 07:43:40,624][52658] DAMAGECOUNT value on done: 894757.0 [2024-08-06 07:43:40,625][52658] Sum rewards: 83.858, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.012', 'weapon4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.188', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.350', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:41,419][52659] DAMAGECOUNT value on done: 886599.0 [2024-08-06 07:43:41,419][52659] Sum rewards: 76.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.690', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.098', 'AMMO3': '0.183', 'weapon2': '0.242', 'WEAPON3': '1.150', 'HITCOUNT': '3.340', 'weapon3': '3.482', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:42,179][52647] DAMAGECOUNT value on done: 952333.0 [2024-08-06 07:43:42,181][52647] Sum rewards: 74.972, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.712', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.172', 'AMMO4': '0.208', 'weapon4': '0.214', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '2.936', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:42,225][52803] DAMAGECOUNT value on done: 827754.0 [2024-08-06 07:43:42,226][52803] Sum rewards: 75.014, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.058', 'HEALTH': '0.084', 'weapon5': '0.146', 'AMMO3': '0.149', 'AMMO4': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.804', 'WEAPON3': '0.900', 'weapon3': '2.796', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:42,366][52820] DAMAGECOUNT value on done: 815812.0 [2024-08-06 07:43:42,371][52820] Sum rewards: 73.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO3': '0.162', 'AMMO4': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.364', 'weapon2': '0.412', 'WEAPON3': '0.950', 'weapon3': '2.756', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.500'} [2024-08-06 07:43:42,496][52660] DAMAGECOUNT value on done: 882475.0 [2024-08-06 07:43:42,496][52660] Sum rewards: 79.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.010', 'AMMO2': '0.037', 'AMMO4': '0.182', 'weapon5': '0.194', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon4': '0.324', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:42,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17494.9). Total num frames: 644759552. Throughput: 0: 4367.6. Samples: 161197490. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:43:42,794][52567] Avg episode reward: [(0, '74.811')] [2024-08-06 07:43:43,598][52658] DAMAGECOUNT value on done: 898652.0 [2024-08-06 07:43:43,599][52658] Sum rewards: 94.127, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.715', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.078', 'weapon2': '0.164', 'weapon5': '0.234', 'AMMO4': '0.248', 'AMMO3': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.262', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '79.000'} [2024-08-06 07:43:44,351][52659] DAMAGECOUNT value on done: 898393.0 [2024-08-06 07:43:44,356][52659] Sum rewards: 74.697, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.498', 'AMMO5': '0.017', 'AMMO2': '0.065', 'weapon4': '0.100', 'AMMO3': '0.195', 'weapon5': '0.258', 'AMMO4': '0.324', 'weapon2': '0.530', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '60.500'} [2024-08-06 07:43:44,423][52795] DAMAGECOUNT value on done: 827464.0 [2024-08-06 07:43:44,423][52795] Sum rewards: 76.264, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.552', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.186', 'AMMO3': '0.191', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '61.000'} [2024-08-06 07:43:44,967][52650] Updated weights for policy 0, policy_version 78711 (0.0013) [2024-08-06 07:43:45,058][52647] DAMAGECOUNT value on done: 939556.0 [2024-08-06 07:43:45,062][52647] Sum rewards: 66.567, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.095', 'weapon5': '0.144', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.410', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '56.000'} [2024-08-06 07:43:45,305][52803] DAMAGECOUNT value on done: 844471.0 [2024-08-06 07:43:45,305][52803] Sum rewards: 80.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.544', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO3': '0.166', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.000', 'weapon3': '3.126', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '64.000'} [2024-08-06 07:43:45,318][52660] DAMAGECOUNT value on done: 882012.0 [2024-08-06 07:43:45,319][52660] Sum rewards: 75.468, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.538', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '64.000'} [2024-08-06 07:43:45,586][52820] DAMAGECOUNT value on done: 823177.0 [2024-08-06 07:43:45,590][52820] Sum rewards: 83.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.804', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.184', 'AMMO3': '0.199', 'AMMO4': '0.231', 'weapon4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.288', 'FRAGCOUNT': '66.000'} [2024-08-06 07:43:46,247][52658] DAMAGECOUNT value on done: 899254.0 [2024-08-06 07:43:46,247][52658] Sum rewards: 78.394, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.535', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.179', 'weapon4': '0.192', 'weapon2': '0.214', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.108', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '67.000'} [2024-08-06 07:43:47,461][52659] DAMAGECOUNT value on done: 892101.0 [2024-08-06 07:43:47,462][52659] Sum rewards: 66.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO4': '0.223', 'AMMO3': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:47,708][52647] DAMAGECOUNT value on done: 947224.0 [2024-08-06 07:43:47,708][52647] Sum rewards: 79.204, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.156', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.660', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:47,710][52795] DAMAGECOUNT value on done: 813903.0 [2024-08-06 07:43:47,710][52795] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.650', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.026', 'AMMO4': '0.059', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '61.000'} [2024-08-06 07:43:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 644841472. Throughput: 0: 4370.0. Samples: 161210690. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:43:47,802][52567] Avg episode reward: [(0, '75.094')] [2024-08-06 07:43:48,415][52803] DAMAGECOUNT value on done: 827448.0 [2024-08-06 07:43:48,415][52803] Sum rewards: 76.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.431', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon2': '0.232', 'AMMO3': '0.242', 'weapon4': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.288', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:48,804][52820] DAMAGECOUNT value on done: 825947.0 [2024-08-06 07:43:48,807][52820] Sum rewards: 80.818, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.285', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.238', 'AMMO3': '0.273', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '70.000'} [2024-08-06 07:43:49,323][52658] DAMAGECOUNT value on done: 897287.0 [2024-08-06 07:43:49,324][52658] Sum rewards: 77.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.532', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.124', 'AMMO3': '0.219', 'weapon5': '0.302', 'AMMO4': '0.318', 'weapon2': '0.440', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '64.000'} [2024-08-06 07:43:49,724][52650] Updated weights for policy 0, policy_version 78721 (0.0013) [2024-08-06 07:43:50,085][52647] DAMAGECOUNT value on done: 946530.0 [2024-08-06 07:43:50,088][52647] Sum rewards: 80.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.976', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.048', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.570', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '67.000'} [2024-08-06 07:43:50,135][52669] DAMAGECOUNT value on done: 893539.0 [2024-08-06 07:43:50,137][52669] Sum rewards: 67.833, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.003', 'AMMO2': '0.046', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.064', 'WEAPON4': '0.150', 'AMMO3': '0.209', 'AMMO4': '0.229', 'weapon2': '0.638', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '56.000'} [2024-08-06 07:43:50,882][52795] DAMAGECOUNT value on done: 820088.0 [2024-08-06 07:43:50,882][52795] Sum rewards: 82.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.064', 'AMMO4': '0.202', 'weapon5': '0.214', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:51,532][52803] DAMAGECOUNT value on done: 834915.0 [2024-08-06 07:43:51,537][52803] Sum rewards: 76.612, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.498', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.174', 'AMMO4': '0.214', 'AMMO3': '0.222', 'weapon5': '0.236', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:51,969][52820] DAMAGECOUNT value on done: 830268.0 [2024-08-06 07:43:51,971][52820] Sum rewards: 77.920, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.400', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon4': '0.110', 'AMMO3': '0.277', 'weapon2': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.254', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:52,449][52658] DAMAGECOUNT value on done: 891671.0 [2024-08-06 07:43:52,450][52658] Sum rewards: 78.023, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.709', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.241', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.368', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:52,461][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:43:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 644931584. Throughput: 0: 4371.1. Samples: 161236850. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:43:52,795][52567] Avg episode reward: [(0, '75.558')] [2024-08-06 07:43:52,896][52669] DAMAGECOUNT value on done: 889198.0 [2024-08-06 07:43:52,897][52669] Sum rewards: 81.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.450', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.205', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '68.000'} [2024-08-06 07:43:53,308][52664] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:43:53,329][52647] DAMAGECOUNT value on done: 954639.0 [2024-08-06 07:43:53,330][52647] Sum rewards: 75.919, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.058', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.140', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'WEAPON3': '1.100', 'weapon3': '3.364', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '61.000'} [2024-08-06 07:43:54,124][52795] DAMAGECOUNT value on done: 831028.0 [2024-08-06 07:43:54,126][52795] Sum rewards: 67.976, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.832', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon4': '0.152', 'weapon5': '0.154', 'weapon2': '0.168', 'AMMO3': '0.270', 'AMMO4': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.308', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 07:43:54,565][52650] Updated weights for policy 0, policy_version 78731 (0.0012) [2024-08-06 07:43:54,703][52803] DAMAGECOUNT value on done: 838056.0 [2024-08-06 07:43:54,706][52803] Sum rewards: 75.397, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.160', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '62.000'} [2024-08-06 07:43:55,045][52820] DAMAGECOUNT value on done: 837461.0 [2024-08-06 07:43:55,046][52820] Sum rewards: 77.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.500', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.158', 'AMMO3': '0.181', 'AMMO4': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '62.000'} [2024-08-06 07:43:55,482][52669] DAMAGECOUNT value on done: 901253.0 [2024-08-06 07:43:55,483][52669] Sum rewards: 93.889, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.455', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.152', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.812', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '22.464', 'FRAGCOUNT': '72.000'} [2024-08-06 07:43:55,782][52658] DAMAGECOUNT value on done: 885577.0 [2024-08-06 07:43:55,784][52658] Sum rewards: 64.749, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.102', 'AMMO4': '0.122', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.302', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '54.500'} [2024-08-06 07:43:56,280][52647] DAMAGECOUNT value on done: 950652.0 [2024-08-06 07:43:56,280][52647] Sum rewards: 86.525, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.845', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.091', 'weapon5': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '71.000'} [2024-08-06 07:43:57,320][52795] DAMAGECOUNT value on done: 816905.0 [2024-08-06 07:43:57,320][52795] Sum rewards: 71.526, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.300', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO3': '0.152', 'AMMO4': '0.166', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.812', 'WEAPON3': '0.950', 'weapon3': '2.636', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2024-08-06 07:43:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 645021696. Throughput: 0: 4379.6. Samples: 161263390. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:43:57,794][52567] Avg episode reward: [(0, '75.616')] [2024-08-06 07:43:57,815][52803] DAMAGECOUNT value on done: 842733.0 [2024-08-06 07:43:57,815][52803] Sum rewards: 77.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.110', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.136', 'AMMO4': '0.143', 'weapon5': '0.180', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:57,900][52671] DAMAGECOUNT value on done: 900256.0 [2024-08-06 07:43:57,901][52671] Sum rewards: 71.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.205', 'AMMO5': '0.021', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.136', 'weapon5': '0.166', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.876', 'WEAPON3': '1.050', 'weapon3': '2.684', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '58.000'} [2024-08-06 07:43:58,207][52669] DAMAGECOUNT value on done: 893993.0 [2024-08-06 07:43:58,208][52669] Sum rewards: 74.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon5': '0.116', 'weapon4': '0.116', 'AMMO4': '0.134', 'AMMO3': '0.197', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '63.000'} [2024-08-06 07:43:58,272][52820] DAMAGECOUNT value on done: 819372.0 [2024-08-06 07:43:58,272][52820] Sum rewards: 77.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon4': '0.090', 'weapon5': '0.102', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '65.000'} [2024-08-06 07:43:58,400][52658] DAMAGECOUNT value on done: 899469.0 [2024-08-06 07:43:58,400][52658] Sum rewards: 77.986, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.595', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.164', 'weapon5': '0.208', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '64.500'} [2024-08-06 07:43:59,021][52647] DAMAGECOUNT value on done: 953456.0 [2024-08-06 07:43:59,022][52650] Updated weights for policy 0, policy_version 78741 (0.0011) [2024-08-06 07:43:59,023][52647] Sum rewards: 87.699, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.474', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.146', 'AMMO4': '0.171', 'weapon2': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.312', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.261', 'FRAGCOUNT': '74.000'} [2024-08-06 07:43:59,661][52794] DAMAGECOUNT value on done: 886047.0 [2024-08-06 07:43:59,662][52794] Sum rewards: 62.093, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.520', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.042', 'AMMO4': '0.112', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.000', 'HITCOUNT': '3.080', 'weapon3': '3.366', 'DAMAGECOUNT': '15.270', 'FRAGCOUNT': '50.000'} [2024-08-06 07:44:00,411][52795] DAMAGECOUNT value on done: 823394.0 [2024-08-06 07:44:00,413][52795] Sum rewards: 75.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.807', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.122', 'AMMO3': '0.188', 'AMMO4': '0.237', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '60.500'} [2024-08-06 07:44:01,005][52671] DAMAGECOUNT value on done: 904664.0 [2024-08-06 07:44:01,006][52671] Sum rewards: 69.252, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.627', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.274', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'HITCOUNT': '3.270', 'weapon3': '3.332', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:01,008][52803] DAMAGECOUNT value on done: 841401.0 [2024-08-06 07:44:01,009][52803] Sum rewards: 68.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.916', 'AMMO5': '0.032', 'AMMO2': '0.079', 'weapon4': '0.152', 'AMMO3': '0.212', 'weapon2': '0.246', 'weapon5': '0.290', 'AMMO4': '0.395', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '2.994', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '58.000'} [2024-08-06 07:44:01,070][52669] DAMAGECOUNT value on done: 903696.0 [2024-08-06 07:44:01,071][52669] Sum rewards: 80.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.712', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'weapon4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:01,169][52658] DAMAGECOUNT value on done: 888502.0 [2024-08-06 07:44:01,179][52658] Sum rewards: 73.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.771', 'AMMO5': '0.026', 'AMMO2': '0.072', 'AMMO3': '0.236', 'AMMO4': '0.360', 'weapon2': '0.360', 'weapon5': '0.366', 'weapon4': '0.482', 'WEAPON5': '0.600', 'WEAPON4': '0.750', 'WEAPON3': '1.400', 'weapon3': '2.456', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:01,510][52820] DAMAGECOUNT value on done: 830488.0 [2024-08-06 07:44:01,512][52820] Sum rewards: 84.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.004', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.589', 'FRAGCOUNT': '69.000'} [2024-08-06 07:44:01,800][52663] DAMAGECOUNT value on done: 912194.0 [2024-08-06 07:44:01,800][52663] Sum rewards: 81.550, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.666', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.084', 'weapon4': '0.092', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.212', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '68.000'} [2024-08-06 07:44:01,896][52647] DAMAGECOUNT value on done: 928732.0 [2024-08-06 07:44:01,896][52647] Sum rewards: 70.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.754', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '58.000'} [2024-08-06 07:44:02,291][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:44:02,507][52794] DAMAGECOUNT value on done: 898978.0 [2024-08-06 07:44:02,509][52794] Sum rewards: 67.094, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.965', 'AMMO5': '0.024', 'AMMO2': '0.065', 'AMMO3': '0.189', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'weapon5': '0.236', 'AMMO4': '0.324', 'weapon4': '0.360', 'weapon2': '0.362', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '56.000'} [2024-08-06 07:44:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 645111808. Throughput: 0: 4376.0. Samples: 161276490. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:44:02,794][52567] Avg episode reward: [(0, '75.253')] [2024-08-06 07:44:03,661][52795] DAMAGECOUNT value on done: 832821.0 [2024-08-06 07:44:03,661][52795] Sum rewards: 71.977, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.959', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.036', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon2': '0.662', 'WEAPON3': '1.100', 'weapon3': '3.060', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '57.000'} [2024-08-06 07:44:03,840][52671] DAMAGECOUNT value on done: 901942.0 [2024-08-06 07:44:03,841][52671] Sum rewards: 65.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.136', 'AMMO3': '0.215', 'AMMO4': '0.249', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:03,922][52650] Updated weights for policy 0, policy_version 78751 (0.0024) [2024-08-06 07:44:03,940][52658] DAMAGECOUNT value on done: 914984.0 [2024-08-06 07:44:03,943][52658] Sum rewards: 88.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.392', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.056', 'AMMO4': '0.143', 'weapon5': '0.170', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '21.321', 'FRAGCOUNT': '72.000'} [2024-08-06 07:44:04,021][52803] DAMAGECOUNT value on done: 836218.0 [2024-08-06 07:44:04,021][52803] Sum rewards: 85.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.156', 'AMMO4': '0.159', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '68.000'} [2024-08-06 07:44:04,028][52669] DAMAGECOUNT value on done: 900246.0 [2024-08-06 07:44:04,029][52669] Sum rewards: 85.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.683', 'AMMO5': '0.012', 'AMMO2': '0.041', 'AMMO3': '0.145', 'AMMO4': '0.204', 'weapon2': '0.204', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.424', 'WEAPON3': '0.900', 'weapon3': '2.796', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:04,692][52820] DAMAGECOUNT value on done: 841654.0 [2024-08-06 07:44:04,694][52820] Sum rewards: 63.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.535', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.042', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '52.000'} [2024-08-06 07:44:04,732][52663] DAMAGECOUNT value on done: 895698.0 [2024-08-06 07:44:04,733][52663] Sum rewards: 80.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.676', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.034', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'AMMO3': '0.209', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '65.000'} [2024-08-06 07:44:04,891][52647] DAMAGECOUNT value on done: 945123.0 [2024-08-06 07:44:04,892][52647] Sum rewards: 87.080, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.132', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.420', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '72.000'} [2024-08-06 07:44:05,575][52794] DAMAGECOUNT value on done: 901774.0 [2024-08-06 07:44:05,578][52794] Sum rewards: 75.846, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.670', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.046', 'weapon5': '0.106', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.308', 'weapon2': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.234', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:06,641][52671] DAMAGECOUNT value on done: 902157.0 [2024-08-06 07:44:06,643][52671] Sum rewards: 78.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.800', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.166', 'AMMO4': '0.209', 'weapon5': '0.226', 'weapon2': '0.362', 'WEAPON5': '0.400', 'weapon4': '0.416', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.670', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:06,791][52795] DAMAGECOUNT value on done: 825389.0 [2024-08-06 07:44:06,791][52795] Sum rewards: 72.599, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.134', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.094', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.112', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '58.000'} [2024-08-06 07:44:06,806][52658] DAMAGECOUNT value on done: 899502.0 [2024-08-06 07:44:06,807][52658] Sum rewards: 88.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.216', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.144', 'weapon4': '0.148', 'AMMO4': '0.191', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.168', 'FRAGCOUNT': '71.000'} [2024-08-06 07:44:07,030][52669] DAMAGECOUNT value on done: 898744.0 [2024-08-06 07:44:07,030][52669] Sum rewards: 67.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.217', 'weapon5': '0.226', 'weapon4': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '2.728', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '57.000'} [2024-08-06 07:44:07,430][52647] DAMAGECOUNT value on done: 944161.0 [2024-08-06 07:44:07,431][52647] Sum rewards: 84.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.435', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.149', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:07,764][52663] DAMAGECOUNT value on done: 889413.0 [2024-08-06 07:44:07,765][52663] Sum rewards: 75.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.738', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.348', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 645193728. Throughput: 0: 4368.2. Samples: 161302480. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:44:07,794][52567] Avg episode reward: [(0, '75.606')] [2024-08-06 07:44:07,873][52820] DAMAGECOUNT value on done: 830865.0 [2024-08-06 07:44:07,873][52820] Sum rewards: 75.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.457', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.112', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:08,407][52650] Updated weights for policy 0, policy_version 78761 (0.0014) [2024-08-06 07:44:08,680][52794] DAMAGECOUNT value on done: 891412.0 [2024-08-06 07:44:08,682][52794] Sum rewards: 81.012, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.054', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.072', 'AMMO4': '0.133', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:09,194][52658] DAMAGECOUNT value on done: 908080.0 [2024-08-06 07:44:09,195][52658] Sum rewards: 67.728, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.375', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.090', 'AMMO3': '0.241', 'weapon5': '0.248', 'AMMO4': '0.263', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '57.000'} [2024-08-06 07:44:09,633][52671] DAMAGECOUNT value on done: 908473.0 [2024-08-06 07:44:09,634][52671] Sum rewards: 87.664, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '72.000'} [2024-08-06 07:44:09,867][52647] DAMAGECOUNT value on done: 941629.0 [2024-08-06 07:44:09,867][52647] Sum rewards: 72.208, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.735', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon4': '0.150', 'weapon5': '0.212', 'AMMO3': '0.273', 'AMMO4': '0.308', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.054', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:09,877][52795] DAMAGECOUNT value on done: 829770.0 [2024-08-06 07:44:09,878][52795] Sum rewards: 76.538, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.835', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.092', 'weapon5': '0.148', 'AMMO4': '0.159', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:09,972][52669] DAMAGECOUNT value on done: 895913.0 [2024-08-06 07:44:09,973][52669] Sum rewards: 70.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.735', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.070', 'AMMO4': '0.096', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.271', 'weapon2': '0.320', 'WEAPON3': '1.650', 'weapon3': '3.162', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:10,490][52663] DAMAGECOUNT value on done: 894863.0 [2024-08-06 07:44:10,490][52663] Sum rewards: 75.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:10,989][52820] DAMAGECOUNT value on done: 833073.0 [2024-08-06 07:44:10,991][52820] Sum rewards: 78.363, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.675', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.170', 'AMMO4': '0.186', 'AMMO3': '0.198', 'weapon2': '0.202', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:11,608][52794] DAMAGECOUNT value on done: 886052.0 [2024-08-06 07:44:11,608][52794] Sum rewards: 79.658, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.127', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:12,347][52647] DAMAGECOUNT value on done: 932553.0 [2024-08-06 07:44:12,347][52647] Sum rewards: 78.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.976', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.054', 'AMMO4': '0.155', 'weapon5': '0.178', 'weapon2': '0.252', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.210', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:12,416][52658] DAMAGECOUNT value on done: 896140.0 [2024-08-06 07:44:12,416][52658] Sum rewards: 81.570, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'weapon5': '0.132', 'HEALTH': '0.198', 'AMMO3': '0.224', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.250', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:12,608][52669] DAMAGECOUNT value on done: 909375.0 [2024-08-06 07:44:12,609][52669] Sum rewards: 76.609, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.215', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.158', 'AMMO4': '0.212', 'weapon2': '0.222', 'AMMO3': '0.232', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:12,756][52671] DAMAGECOUNT value on done: 896764.0 [2024-08-06 07:44:12,756][52671] Sum rewards: 70.254, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.440', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.038', 'AMMO4': '0.053', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '59.000'} [2024-08-06 07:44:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.1). Total num frames: 645283840. Throughput: 0: 4380.7. Samples: 161328930. Policy #0 lag: (min: 1.0, avg: 3.3, max: 7.0) [2024-08-06 07:44:12,795][52567] Avg episode reward: [(0, '76.175')] [2024-08-06 07:44:12,985][52795] DAMAGECOUNT value on done: 831768.0 [2024-08-06 07:44:12,985][52795] Sum rewards: 76.439, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO2': '0.015', 'weapon4': '0.054', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon2': '0.712', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:13,235][52650] Updated weights for policy 0, policy_version 78771 (0.0013) [2024-08-06 07:44:13,385][52663] DAMAGECOUNT value on done: 896802.0 [2024-08-06 07:44:13,387][52663] Sum rewards: 70.648, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.970', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'weapon2': '0.276', 'AMMO3': '0.298', 'WEAPON3': '1.800', 'weapon3': '3.356', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:13,986][52820] DAMAGECOUNT value on done: 828170.0 [2024-08-06 07:44:13,987][52820] Sum rewards: 71.620, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.018', 'WEAPON5': '0.050', 'HEALTH': '0.050', 'weapon5': '0.068', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'AMMO3': '0.157', 'weapon2': '0.398', 'weapon4': '0.416', 'WEAPON3': '0.900', 'weapon3': '2.822', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '56.000'} [2024-08-06 07:44:14,396][52794] DAMAGECOUNT value on done: 892303.0 [2024-08-06 07:44:14,397][52794] Sum rewards: 94.416, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.418', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.234', 'weapon2': '0.304', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '22.296', 'FRAGCOUNT': '77.000'} [2024-08-06 07:44:15,226][52647] DAMAGECOUNT value on done: 947145.0 [2024-08-06 07:44:15,227][52647] Sum rewards: 84.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'AMMO5': '0.003', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'weapon5': '0.056', 'weapon4': '0.106', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.384', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '69.000'} [2024-08-06 07:44:15,449][52658] DAMAGECOUNT value on done: 905229.0 [2024-08-06 07:44:15,451][52658] Sum rewards: 83.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.054', 'AMMO5': '0.019', 'AMMO2': '0.046', 'AMMO3': '0.185', 'AMMO4': '0.232', 'weapon4': '0.234', 'weapon5': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '2.688', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:15,471][52669] DAMAGECOUNT value on done: 897917.0 [2024-08-06 07:44:15,472][52669] Sum rewards: 87.612, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.528', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.104', 'AMMO4': '0.211', 'AMMO3': '0.214', 'weapon5': '0.218', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.255', 'FRAGCOUNT': '69.000'} [2024-08-06 07:44:15,988][52671] DAMAGECOUNT value on done: 902154.0 [2024-08-06 07:44:15,988][52671] Sum rewards: 82.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.120', 'weapon5': '0.176', 'AMMO4': '0.198', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:16,129][52795] DAMAGECOUNT value on done: 826383.0 [2024-08-06 07:44:16,132][52795] Sum rewards: 86.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.804', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO4': '0.218', 'AMMO3': '0.246', 'weapon5': '0.258', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.072', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '72.000'} [2024-08-06 07:44:16,211][52663] DAMAGECOUNT value on done: 902626.0 [2024-08-06 07:44:16,215][52663] Sum rewards: 82.904, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.636', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.076', 'weapon4': '0.096', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:17,005][52820] DAMAGECOUNT value on done: 831784.0 [2024-08-06 07:44:17,006][52820] Sum rewards: 82.128, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.300', 'AMMO2': '0.003', 'AMMO5': '0.003', 'AMMO4': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.276', 'weapon2': '0.672', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:17,143][52794] DAMAGECOUNT value on done: 895196.0 [2024-08-06 07:44:17,143][52794] Sum rewards: 76.815, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.084', 'AMMO4': '0.103', 'weapon5': '0.124', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.000', 'weapon3': '3.256', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '60.000'} [2024-08-06 07:44:17,428][52650] Updated weights for policy 0, policy_version 78781 (0.0019) [2024-08-06 07:44:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 645373952. Throughput: 0: 4383.6. Samples: 161342180. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:17,794][52567] Avg episode reward: [(0, '76.955')] [2024-08-06 07:44:17,805][52614] Saving new best policy, reward=76.955! [2024-08-06 07:44:18,281][52647] DAMAGECOUNT value on done: 935684.0 [2024-08-06 07:44:18,283][52647] Sum rewards: 72.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.056', 'weapon5': '0.084', 'AMMO4': '0.135', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 07:44:18,409][52658] DAMAGECOUNT value on done: 893963.0 [2024-08-06 07:44:18,410][52658] Sum rewards: 68.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.432', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.146', 'weapon2': '0.178', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.446', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:18,523][52664] DAMAGECOUNT value on done: 926184.0 [2024-08-06 07:44:18,523][52664] Sum rewards: 75.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.012', 'AMMO4': '0.017', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.254', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:18,644][52669] DAMAGECOUNT value on done: 905435.0 [2024-08-06 07:44:18,647][52669] Sum rewards: 81.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.304', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.159', 'weapon4': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:18,922][52671] DAMAGECOUNT value on done: 902253.0 [2024-08-06 07:44:18,927][52671] Sum rewards: 63.366, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.387', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.050', 'AMMO4': '0.097', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.265', 'weapon2': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.062', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:19,277][52795] DAMAGECOUNT value on done: 818564.0 [2024-08-06 07:44:19,277][52795] Sum rewards: 78.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.162', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.074', 'weapon4': '0.120', 'AMMO4': '0.160', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:19,411][52663] DAMAGECOUNT value on done: 895619.0 [2024-08-06 07:44:19,415][52663] Sum rewards: 88.125, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.272', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.138', 'weapon4': '0.158', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.060', 'FRAGCOUNT': '69.000'} [2024-08-06 07:44:20,158][52820] DAMAGECOUNT value on done: 839818.0 [2024-08-06 07:44:20,160][52820] Sum rewards: 70.016, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.658', 'AMMO5': '0.003', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.036', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO3': '0.171', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 07:44:20,419][52794] DAMAGECOUNT value on done: 882704.0 [2024-08-06 07:44:20,420][52794] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.514', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.128', 'weapon5': '0.134', 'AMMO4': '0.185', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:20,946][52647] DAMAGECOUNT value on done: 944003.0 [2024-08-06 07:44:20,946][52647] Sum rewards: 71.331, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.110', 'weapon5': '0.170', 'AMMO4': '0.187', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.000'} [2024-08-06 07:44:21,010][52658] DAMAGECOUNT value on done: 901546.0 [2024-08-06 07:44:21,011][52658] Sum rewards: 74.783, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.274', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.116', 'weapon4': '0.198', 'AMMO4': '0.212', 'AMMO3': '0.263', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:21,289][52664] DAMAGECOUNT value on done: 930142.0 [2024-08-06 07:44:21,289][52664] Sum rewards: 64.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.868', 'AMMO5': '0.010', 'ARMOR': '0.012', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.172', 'AMMO4': '0.181', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.152', 'DAMAGECOUNT': '15.477', 'FRAGCOUNT': '54.000'} [2024-08-06 07:44:21,451][52669] DAMAGECOUNT value on done: 905229.0 [2024-08-06 07:44:21,451][52669] Sum rewards: 74.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.048', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO4': '0.169', 'weapon5': '0.174', 'AMMO3': '0.206', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:22,023][52663] DAMAGECOUNT value on done: 882289.0 [2024-08-06 07:44:22,024][52663] Sum rewards: 76.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.122', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon5': '0.062', 'AMMO4': '0.069', 'weapon4': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:22,060][52671] DAMAGECOUNT value on done: 887320.0 [2024-08-06 07:44:22,060][52671] Sum rewards: 72.391, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.787', 'ARMOR': '0.004', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.062', 'AMMO4': '0.154', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.680', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '59.000'} [2024-08-06 07:44:22,492][52795] DAMAGECOUNT value on done: 825386.0 [2024-08-06 07:44:22,493][52795] Sum rewards: 83.174, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.974', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.099', 'weapon2': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON3': '1.500', 'weapon3': '3.538', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '71.000'} [2024-08-06 07:44:22,522][52650] Updated weights for policy 0, policy_version 78791 (0.0011) [2024-08-06 07:44:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 645455872. Throughput: 0: 4372.2. Samples: 161368090. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:22,794][52567] Avg episode reward: [(0, '76.857')] [2024-08-06 07:44:23,243][52820] DAMAGECOUNT value on done: 838196.0 [2024-08-06 07:44:23,248][52820] Sum rewards: 78.524, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.768', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.146', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'weapon3': '3.592', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:23,413][52794] DAMAGECOUNT value on done: 896952.0 [2024-08-06 07:44:23,414][52794] Sum rewards: 65.069, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.680', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.226', 'weapon2': '0.330', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.444', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '54.000'} [2024-08-06 07:44:23,705][52658] DAMAGECOUNT value on done: 883070.0 [2024-08-06 07:44:23,705][52658] Sum rewards: 61.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.306', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.106', 'AMMO3': '0.169', 'AMMO4': '0.265', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.820', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '49.500'} [2024-08-06 07:44:23,853][52647] DAMAGECOUNT value on done: 946556.0 [2024-08-06 07:44:23,855][52647] Sum rewards: 78.864, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.998', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.050', 'weapon4': '0.116', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:24,207][52664] DAMAGECOUNT value on done: 932398.0 [2024-08-06 07:44:24,211][52664] Sum rewards: 77.784, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.018', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.144', 'weapon4': '0.160', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:24,391][52669] DAMAGECOUNT value on done: 891438.0 [2024-08-06 07:44:24,392][52669] Sum rewards: 76.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.090', 'weapon5': '0.204', 'AMMO3': '0.242', 'AMMO4': '0.310', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.594', 'WEAPON3': '1.400', 'weapon3': '2.852', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:25,093][52663] DAMAGECOUNT value on done: 891347.0 [2024-08-06 07:44:25,093][52663] Sum rewards: 77.753, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.055', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.354', 'weapon4': '0.386', 'WEAPON3': '0.800', 'weapon3': '3.014', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '58.000'} [2024-08-06 07:44:25,298][52671] DAMAGECOUNT value on done: 902375.0 [2024-08-06 07:44:25,298][52671] Sum rewards: 76.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.120', 'weapon5': '0.134', 'AMMO4': '0.148', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.106', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:25,650][52795] DAMAGECOUNT value on done: 831692.0 [2024-08-06 07:44:25,653][52795] Sum rewards: 74.768, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.330', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.128', 'weapon4': '0.164', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.326', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:26,426][52820] DAMAGECOUNT value on done: 822818.0 [2024-08-06 07:44:26,427][52820] Sum rewards: 91.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.524', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.120', 'weapon2': '0.154', 'weapon4': '0.182', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '75.000'} [2024-08-06 07:44:26,434][52794] DAMAGECOUNT value on done: 890077.0 [2024-08-06 07:44:26,435][52794] Sum rewards: 70.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.848', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.128', 'weapon4': '0.140', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '60.000'} [2024-08-06 07:44:26,688][52647] DAMAGECOUNT value on done: 932594.0 [2024-08-06 07:44:26,689][52647] Sum rewards: 60.941, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.091', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.079', 'weapon5': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.532', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '50.000'} [2024-08-06 07:44:26,822][52658] DAMAGECOUNT value on done: 902078.0 [2024-08-06 07:44:26,824][52658] Sum rewards: 85.129, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.889', 'AMMO5': '0.011', 'AMMO2': '0.057', 'weapon2': '0.170', 'weapon5': '0.174', 'weapon4': '0.212', 'AMMO3': '0.232', 'AMMO4': '0.286', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '72.000'} [2024-08-06 07:44:26,944][52664] DAMAGECOUNT value on done: 922304.0 [2024-08-06 07:44:26,945][52664] Sum rewards: 72.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.106', 'weapon4': '0.118', 'AMMO4': '0.119', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.286', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '60.500'} [2024-08-06 07:44:27,284][52669] DAMAGECOUNT value on done: 892783.0 [2024-08-06 07:44:27,312][52669] Sum rewards: 65.964, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.130', 'AMMO3': '0.235', 'AMMO4': '0.286', 'weapon5': '0.298', 'weapon2': '0.418', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '54.500'} [2024-08-06 07:44:27,399][52650] Updated weights for policy 0, policy_version 78801 (0.0032) [2024-08-06 07:44:27,795][52567] Fps is (10 sec: 16383.4, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 645537792. Throughput: 0: 4375.5. Samples: 161394390. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:27,795][52567] Avg episode reward: [(0, '76.545')] [2024-08-06 07:44:27,862][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078802_645545984.pth... [2024-08-06 07:44:27,897][52671] DAMAGECOUNT value on done: 900722.0 [2024-08-06 07:44:27,897][52671] Sum rewards: 75.038, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.438', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.076', 'weapon4': '0.128', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '3.122', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '58.500'} [2024-08-06 07:44:27,966][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078291_641359872.pth [2024-08-06 07:44:27,984][52663] DAMAGECOUNT value on done: 893939.0 [2024-08-06 07:44:27,984][52663] Sum rewards: 78.514, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.096', 'AMMO3': '0.168', 'weapon5': '0.190', 'AMMO4': '0.204', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.168', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:28,909][52795] DAMAGECOUNT value on done: 820426.0 [2024-08-06 07:44:28,910][52795] Sum rewards: 77.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.126', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.102', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:29,205][52647] DAMAGECOUNT value on done: 941026.0 [2024-08-06 07:44:29,206][52647] Sum rewards: 89.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.390', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.148', 'AMMO4': '0.203', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '21.195', 'FRAGCOUNT': '73.000'} [2024-08-06 07:44:29,481][52664] DAMAGECOUNT value on done: 935405.0 [2024-08-06 07:44:29,481][52664] Sum rewards: 87.661, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.255', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.081', 'weapon5': '0.130', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '71.000'} [2024-08-06 07:44:29,533][52794] DAMAGECOUNT value on done: 884632.0 [2024-08-06 07:44:29,536][52794] Sum rewards: 71.513, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.330', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.176', 'weapon4': '0.188', 'AMMO3': '0.268', 'AMMO4': '0.277', 'WEAPON5': '0.500', 'weapon2': '0.512', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.806', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:29,890][52658] DAMAGECOUNT value on done: 892813.0 [2024-08-06 07:44:29,890][52658] Sum rewards: 74.090, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.054', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '60.000'} [2024-08-06 07:44:29,999][52669] DAMAGECOUNT value on done: 899148.0 [2024-08-06 07:44:29,999][52669] Sum rewards: 67.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.085', 'AMMO5': '0.010', 'weapon4': '0.014', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'weapon2': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON3': '1.450', 'HITCOUNT': '3.490', 'weapon3': '3.676', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '56.000'} [2024-08-06 07:44:30,755][52663] DAMAGECOUNT value on done: 900512.0 [2024-08-06 07:44:30,757][52663] Sum rewards: 62.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.042', 'weapon5': '0.060', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'weapon2': '0.266', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.270', 'DAMAGECOUNT': '15.645', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:31,156][52671] DAMAGECOUNT value on done: 897432.0 [2024-08-06 07:44:31,157][52671] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.124', 'AMMO4': '0.177', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'WEAPON3': '1.600', 'weapon3': '3.328', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:31,820][52666] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:44:31,841][52650] Updated weights for policy 0, policy_version 78811 (0.0050) [2024-08-06 07:44:31,965][52647] DAMAGECOUNT value on done: 930857.0 [2024-08-06 07:44:31,966][52647] Sum rewards: 80.313, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.785', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.076', 'weapon5': '0.078', 'AMMO4': '0.085', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.356', 'WEAPON3': '0.900', 'weapon3': '3.308', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:32,080][52795] DAMAGECOUNT value on done: 830504.0 [2024-08-06 07:44:32,080][52795] Sum rewards: 78.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '65.000'} [2024-08-06 07:44:32,224][52664] DAMAGECOUNT value on done: 931789.0 [2024-08-06 07:44:32,224][52664] Sum rewards: 75.064, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO2': '0.005', 'AMMO5': '0.005', 'ARMOR': '0.020', 'AMMO4': '0.023', 'weapon5': '0.090', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'weapon4': '0.408', 'WEAPON3': '1.150', 'weapon3': '2.974', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:32,581][52669] DAMAGECOUNT value on done: 921114.0 [2024-08-06 07:44:32,583][52669] Sum rewards: 74.033, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.631', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.140', 'weapon5': '0.182', 'weapon2': '0.194', 'AMMO3': '0.196', 'AMMO4': '0.223', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.000', 'weapon3': '3.226', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 645627904. Throughput: 0: 4363.3. Samples: 161407040. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:32,794][52567] Avg episode reward: [(0, '76.491')] [2024-08-06 07:44:32,822][52658] DAMAGECOUNT value on done: 889519.0 [2024-08-06 07:44:32,822][52658] Sum rewards: 77.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.216', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.988', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:32,846][52794] DAMAGECOUNT value on done: 897880.0 [2024-08-06 07:44:32,847][52794] Sum rewards: 75.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.913', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.162', 'weapon4': '0.182', 'AMMO4': '0.209', 'AMMO3': '0.226', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:33,239][52663] DAMAGECOUNT value on done: 884498.0 [2024-08-06 07:44:33,239][52663] Sum rewards: 89.083, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.712', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.036', 'weapon4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.406', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '72.000'} [2024-08-06 07:44:34,160][52671] DAMAGECOUNT value on done: 902412.0 [2024-08-06 07:44:34,161][52671] Sum rewards: 77.920, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.815', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.318', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:34,402][52647] DAMAGECOUNT value on done: 935134.0 [2024-08-06 07:44:34,402][52647] Sum rewards: 78.060, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.658', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:34,796][52664] DAMAGECOUNT value on done: 921355.0 [2024-08-06 07:44:34,798][52664] Sum rewards: 73.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.821', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.148', 'weapon2': '0.182', 'weapon5': '0.190', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.378', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '59.000'} [2024-08-06 07:44:35,182][52795] DAMAGECOUNT value on done: 826732.0 [2024-08-06 07:44:35,183][52795] Sum rewards: 54.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.133', 'AMMO5': '0.021', 'AMMO2': '0.062', 'weapon4': '0.140', 'AMMO3': '0.218', 'weapon5': '0.290', 'AMMO4': '0.310', 'weapon2': '0.562', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.636', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '13.998', 'FRAGCOUNT': '46.000'} [2024-08-06 07:44:35,517][52669] DAMAGECOUNT value on done: 908789.0 [2024-08-06 07:44:35,519][52669] Sum rewards: 79.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.182', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.159', 'weapon5': '0.168', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:35,737][52794] DAMAGECOUNT value on done: 892259.0 [2024-08-06 07:44:35,748][52794] Sum rewards: 71.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.220', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.166', 'weapon2': '0.192', 'AMMO4': '0.194', 'AMMO3': '0.279', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'HITCOUNT': '3.230', 'weapon3': '3.336', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:35,925][52658] DAMAGECOUNT value on done: 899392.0 [2024-08-06 07:44:35,927][52658] Sum rewards: 81.715, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.134', 'AMMO3': '0.170', 'AMMO4': '0.194', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '68.000'} [2024-08-06 07:44:36,424][52663] DAMAGECOUNT value on done: 880262.0 [2024-08-06 07:44:36,424][52663] Sum rewards: 74.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.576', 'AMMO5': '0.010', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.057', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:36,651][52650] Updated weights for policy 0, policy_version 78821 (0.0010) [2024-08-06 07:44:36,699][52671] DAMAGECOUNT value on done: 899997.0 [2024-08-06 07:44:36,699][52671] Sum rewards: 74.638, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.666', 'AMMO2': '0.008', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '60.500'} [2024-08-06 07:44:37,242][52664] DAMAGECOUNT value on done: 921023.0 [2024-08-06 07:44:37,242][52664] Sum rewards: 72.228, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.238', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.117', 'weapon5': '0.156', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:37,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 645718016. Throughput: 0: 4369.6. Samples: 161433480. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:37,794][52567] Avg episode reward: [(0, '76.452')] [2024-08-06 07:44:38,243][52795] DAMAGECOUNT value on done: 816807.0 [2024-08-06 07:44:38,244][52795] Sum rewards: 58.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.170', 'AMMO4': '0.196', 'AMMO3': '0.200', 'weapon5': '0.224', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.500', 'weapon3': '3.036', 'DAMAGECOUNT': '14.025', 'FRAGCOUNT': '49.000'} [2024-08-06 07:44:38,575][52669] DAMAGECOUNT value on done: 903156.0 [2024-08-06 07:44:38,577][52669] Sum rewards: 75.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.555', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon5': '0.128', 'AMMO4': '0.198', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:38,766][52794] DAMAGECOUNT value on done: 905173.0 [2024-08-06 07:44:38,768][52794] Sum rewards: 74.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.062', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.173', 'weapon4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:39,336][52663] DAMAGECOUNT value on done: 889875.0 [2024-08-06 07:44:39,337][52663] Sum rewards: 82.696, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.896', 'AMMO5': '0.017', 'AMMO2': '0.062', 'AMMO3': '0.199', 'weapon5': '0.208', 'weapon4': '0.296', 'AMMO4': '0.308', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.864', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:39,351][52670] DAMAGECOUNT value on done: 881261.0 [2024-08-06 07:44:39,352][52670] Sum rewards: 72.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.726', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.126', 'AMMO3': '0.167', 'AMMO4': '0.245', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.798', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 07:44:39,550][52671] DAMAGECOUNT value on done: 886456.0 [2024-08-06 07:44:39,551][52671] Sum rewards: 66.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.367', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.396', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.340', 'DAMAGECOUNT': '15.507', 'FRAGCOUNT': '56.000'} [2024-08-06 07:44:40,038][52664] DAMAGECOUNT value on done: 930907.0 [2024-08-06 07:44:40,040][52664] Sum rewards: 73.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.362', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.165', 'AMMO3': '0.205', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.208', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '58.000'} [2024-08-06 07:44:40,468][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:44:41,157][52669] DAMAGECOUNT value on done: 908426.0 [2024-08-06 07:44:41,165][52649] DAMAGECOUNT value on done: 866654.0 [2024-08-06 07:44:41,167][52669] Sum rewards: 77.225, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.041', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.189', 'AMMO4': '0.205', 'HEALTH': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.050', 'weapon3': '3.254', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:41,167][52649] Sum rewards: 67.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.470', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.064', 'AMMO4': '0.103', 'weapon5': '0.138', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.550', 'weapon3': '3.112', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '59.000'} [2024-08-06 07:44:41,296][52650] Updated weights for policy 0, policy_version 78831 (0.0034) [2024-08-06 07:44:41,416][52795] DAMAGECOUNT value on done: 825401.0 [2024-08-06 07:44:41,420][52795] Sum rewards: 74.765, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.449', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon5': '0.148', 'AMMO3': '0.200', 'AMMO4': '0.235', 'weapon4': '0.284', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:41,583][52794] DAMAGECOUNT value on done: 885976.0 [2024-08-06 07:44:41,585][52794] Sum rewards: 74.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.366', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.056', 'AMMO4': '0.181', 'weapon5': '0.190', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:41,817][52663] DAMAGECOUNT value on done: 893002.0 [2024-08-06 07:44:41,817][52663] Sum rewards: 92.811, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.162', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.914', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.348', 'FRAGCOUNT': '75.000'} [2024-08-06 07:44:42,485][52671] DAMAGECOUNT value on done: 909133.0 [2024-08-06 07:44:42,485][52671] Sum rewards: 73.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.720', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.072', 'weapon5': '0.134', 'AMMO4': '0.155', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:42,726][52670] DAMAGECOUNT value on done: 897802.0 [2024-08-06 07:44:42,726][52670] Sum rewards: 79.317, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.271', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.128', 'weapon5': '0.170', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '65.000'} [2024-08-06 07:44:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 645799936. Throughput: 0: 4364.2. Samples: 161459780. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:42,795][52567] Avg episode reward: [(0, '76.117')] [2024-08-06 07:44:42,951][52664] DAMAGECOUNT value on done: 927979.0 [2024-08-06 07:44:42,952][52664] Sum rewards: 79.738, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.735', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.118', 'weapon2': '0.174', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:43,482][52669] DAMAGECOUNT value on done: 910071.0 [2024-08-06 07:44:43,482][52669] Sum rewards: 70.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.230', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.030', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'WEAPON3': '0.850', 'weapon2': '1.162', 'weapon3': '2.642', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:43,823][52794] DAMAGECOUNT value on done: 900795.0 [2024-08-06 07:44:43,825][52794] Sum rewards: 75.280, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.280', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.151', 'AMMO3': '0.167', 'weapon4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '59.000'} [2024-08-06 07:44:43,896][52614] Signal inference workers to stop experience collection... (14450 times) [2024-08-06 07:44:43,897][52614] Signal inference workers to resume experience collection... (14450 times) [2024-08-06 07:44:43,938][52650] InferenceWorker_p0-w0: stopping experience collection (14450 times) [2024-08-06 07:44:43,942][52650] InferenceWorker_p0-w0: resuming experience collection (14450 times) [2024-08-06 07:44:44,294][52663] DAMAGECOUNT value on done: 896852.0 [2024-08-06 07:44:44,294][52663] Sum rewards: 82.055, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.334', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.124', 'FRAGCOUNT': '69.000'} [2024-08-06 07:44:44,339][52649] DAMAGECOUNT value on done: 863243.0 [2024-08-06 07:44:44,340][52649] Sum rewards: 83.907, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.178', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.166', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.450', 'weapon3': '3.326', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '69.000'} [2024-08-06 07:44:44,493][52795] DAMAGECOUNT value on done: 834026.0 [2024-08-06 07:44:44,495][52795] Sum rewards: 81.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.011', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'weapon4': '0.156', 'AMMO3': '0.231', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:45,348][52665] DAMAGECOUNT value on done: 883744.0 [2024-08-06 07:44:45,350][52665] Sum rewards: 75.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.072', 'weapon5': '0.072', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.214', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '65.000'} [2024-08-06 07:44:45,460][52671] DAMAGECOUNT value on done: 908560.0 [2024-08-06 07:44:45,460][52671] Sum rewards: 78.169, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.706', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.048', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'AMMO4': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '63.500'} [2024-08-06 07:44:45,796][52670] DAMAGECOUNT value on done: 882043.0 [2024-08-06 07:44:45,796][52670] Sum rewards: 74.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.069', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.084', 'AMMO4': '0.183', 'AMMO3': '0.202', 'weapon5': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '62.000'} [2024-08-06 07:44:45,983][52650] Updated weights for policy 0, policy_version 78841 (0.0033) [2024-08-06 07:44:46,540][52794] DAMAGECOUNT value on done: 896593.0 [2024-08-06 07:44:46,541][52794] Sum rewards: 85.073, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.914', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.204', 'AMMO4': '0.209', 'AMMO3': '0.232', 'weapon4': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '68.000'} [2024-08-06 07:44:46,639][52664] DAMAGECOUNT value on done: 936262.0 [2024-08-06 07:44:46,640][52664] Sum rewards: 69.232, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO3': '0.155', 'weapon4': '0.258', 'weapon2': '0.512', 'WEAPON3': '0.950', 'weapon3': '2.908', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.263', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:46,721][52663] DAMAGECOUNT value on done: 894779.0 [2024-08-06 07:44:46,723][52663] Sum rewards: 82.662, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.770', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.090', 'weapon5': '0.134', 'AMMO4': '0.160', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '69.000'} [2024-08-06 07:44:47,345][52666] DAMAGECOUNT value on done: 895346.0 [2024-08-06 07:44:47,345][52666] Sum rewards: 73.095, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.220', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.138', 'AMMO4': '0.199', 'weapon2': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.238', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:47,390][52649] DAMAGECOUNT value on done: 879636.0 [2024-08-06 07:44:47,392][52649] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.126', 'weapon2': '0.198', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'weapon3': '3.448', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '59.000'} [2024-08-06 07:44:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 645898240. Throughput: 0: 4364.2. Samples: 161472880. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:47,795][52567] Avg episode reward: [(0, '76.109')] [2024-08-06 07:44:47,871][52671] DAMAGECOUNT value on done: 901743.0 [2024-08-06 07:44:47,872][52671] Sum rewards: 67.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon4': '0.210', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.525', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:48,466][52665] DAMAGECOUNT value on done: 895999.0 [2024-08-06 07:44:48,467][52665] Sum rewards: 65.053, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.692', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'weapon2': '0.372', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.136', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '52.500'} [2024-08-06 07:44:48,826][52670] DAMAGECOUNT value on done: 885950.0 [2024-08-06 07:44:48,829][52670] Sum rewards: 81.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.173', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.066', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.422', 'WEAPON3': '1.100', 'weapon3': '3.364', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '66.000'} [2024-08-06 07:44:49,227][52664] DAMAGECOUNT value on done: 933875.0 [2024-08-06 07:44:49,227][52664] Sum rewards: 66.195, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.065', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO4': '0.184', 'AMMO3': '0.207', 'weapon5': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '57.000'} [2024-08-06 07:44:49,597][52794] DAMAGECOUNT value on done: 900582.0 [2024-08-06 07:44:49,598][52794] Sum rewards: 85.058, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.270', 'AMMO5': '0.022', 'AMMO2': '0.055', 'AMMO3': '0.161', 'weapon2': '0.244', 'weapon4': '0.250', 'weapon5': '0.262', 'AMMO4': '0.275', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.992', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '68.000'} [2024-08-06 07:44:49,889][52663] DAMAGECOUNT value on done: 898119.0 [2024-08-06 07:44:49,891][52663] Sum rewards: 76.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.049', 'weapon5': '0.050', 'WEAPON4': '0.100', 'weapon2': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'HITCOUNT': '3.520', 'weapon3': '3.610', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:50,252][52671] DAMAGECOUNT value on done: 907886.0 [2024-08-06 07:44:50,253][52671] Sum rewards: 73.013, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.158', 'AMMO3': '0.225', 'AMMO4': '0.226', 'weapon4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:50,546][52666] DAMAGECOUNT value on done: 890973.0 [2024-08-06 07:44:50,547][52666] Sum rewards: 67.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '58.000'} [2024-08-06 07:44:50,595][52650] Updated weights for policy 0, policy_version 78851 (0.0031) [2024-08-06 07:44:50,632][52649] DAMAGECOUNT value on done: 875709.0 [2024-08-06 07:44:50,632][52649] Sum rewards: 78.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.000', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.162', 'weapon4': '0.250', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.600', 'weapon3': '2.942', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '65.000'} [2024-08-06 07:44:51,632][52665] DAMAGECOUNT value on done: 885111.0 [2024-08-06 07:44:51,641][52665] Sum rewards: 70.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.434', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.076', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'weapon2': '0.534', 'WEAPON3': '1.500', 'weapon3': '3.138', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:51,669][52670] DAMAGECOUNT value on done: 898380.0 [2024-08-06 07:44:51,670][52670] Sum rewards: 68.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.454', 'AMMO5': '0.010', 'weapon5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.024', 'AMMO4': '0.087', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.400', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '57.000'} [2024-08-06 07:44:51,929][52664] DAMAGECOUNT value on done: 932904.0 [2024-08-06 07:44:51,931][52664] Sum rewards: 74.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.596', 'AMMO5': '0.019', 'AMMO2': '0.066', 'weapon5': '0.152', 'AMMO3': '0.172', 'weapon4': '0.288', 'AMMO4': '0.328', 'weapon2': '0.422', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.904', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '62.500'} [2024-08-06 07:44:52,655][52663] DAMAGECOUNT value on done: 904087.0 [2024-08-06 07:44:52,655][52663] Sum rewards: 88.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.062', 'weapon5': '0.090', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.332', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '70.000'} [2024-08-06 07:44:52,745][52794] DAMAGECOUNT value on done: 908565.0 [2024-08-06 07:44:52,747][52794] Sum rewards: 85.455, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon5': '0.108', 'weapon4': '0.184', 'AMMO4': '0.186', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '70.000'} [2024-08-06 07:44:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 645980160. Throughput: 0: 4370.7. Samples: 161499160. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:52,794][52567] Avg episode reward: [(0, '75.341')] [2024-08-06 07:44:53,073][52666] DAMAGECOUNT value on done: 898631.0 [2024-08-06 07:44:53,075][52666] Sum rewards: 73.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.624', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.155', 'weapon4': '0.214', 'AMMO3': '0.258', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.002', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '63.000'} [2024-08-06 07:44:53,356][52671] DAMAGECOUNT value on done: 889301.0 [2024-08-06 07:44:53,357][52671] Sum rewards: 59.778, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.633', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.900', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '49.000'} [2024-08-06 07:44:53,507][52649] DAMAGECOUNT value on done: 868781.0 [2024-08-06 07:44:53,509][52649] Sum rewards: 74.940, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.051', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.062', 'weapon5': '0.098', 'AMMO4': '0.177', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '65.000'} [2024-08-06 07:44:54,253][52665] DAMAGECOUNT value on done: 888479.0 [2024-08-06 07:44:54,255][52665] Sum rewards: 82.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.102', 'AMMO4': '0.104', 'weapon5': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.457', 'FRAGCOUNT': '68.000'} [2024-08-06 07:44:54,415][52670] DAMAGECOUNT value on done: 886036.0 [2024-08-06 07:44:54,418][52670] Sum rewards: 71.541, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.572', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.080', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.312', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '60.000'} [2024-08-06 07:44:54,882][52664] DAMAGECOUNT value on done: 945324.0 [2024-08-06 07:44:54,882][52664] Sum rewards: 75.685, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.120', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon4': '0.282', 'WEAPON4': '0.450', 'weapon2': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '64.000'} [2024-08-06 07:44:55,226][52650] Updated weights for policy 0, policy_version 78861 (0.0013) [2024-08-06 07:44:55,447][52663] DAMAGECOUNT value on done: 886778.0 [2024-08-06 07:44:55,448][52663] Sum rewards: 71.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.725', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.040', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.122', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.276', 'WEAPON3': '1.750', 'weapon3': '3.420', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:55,817][52794] DAMAGECOUNT value on done: 898894.0 [2024-08-06 07:44:55,819][52794] Sum rewards: 78.402, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.248', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon4': '0.092', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'weapon2': '0.236', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '65.000'} [2024-08-06 07:44:55,932][52666] DAMAGECOUNT value on done: 892035.0 [2024-08-06 07:44:55,935][52666] Sum rewards: 80.690, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.480', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.038', 'weapon5': '0.106', 'AMMO4': '0.117', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '67.000'} [2024-08-06 07:44:56,306][52649] DAMAGECOUNT value on done: 878687.0 [2024-08-06 07:44:56,306][52649] Sum rewards: 85.552, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.705', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.116', 'weapon4': '0.118', 'AMMO4': '0.163', 'weapon2': '0.234', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.574', 'FRAGCOUNT': '71.000'} [2024-08-06 07:44:57,095][52665] DAMAGECOUNT value on done: 872587.0 [2024-08-06 07:44:57,103][52665] Sum rewards: 75.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.884', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.106', 'AMMO3': '0.220', 'weapon5': '0.220', 'AMMO4': '0.252', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:57,186][52670] DAMAGECOUNT value on done: 880073.0 [2024-08-06 07:44:57,186][52670] Sum rewards: 71.520, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.850', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.138', 'weapon5': '0.172', 'AMMO3': '0.184', 'AMMO4': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.250', 'weapon3': '2.712', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '58.000'} [2024-08-06 07:44:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 646070272. Throughput: 0: 4366.0. Samples: 161525400. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:44:57,794][52567] Avg episode reward: [(0, '75.477')] [2024-08-06 07:44:57,845][52664] DAMAGECOUNT value on done: 941825.0 [2024-08-06 07:44:57,847][52664] Sum rewards: 72.741, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.015', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.114', 'weapon5': '0.118', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '61.000'} [2024-08-06 07:44:58,688][52666] DAMAGECOUNT value on done: 885610.0 [2024-08-06 07:44:58,690][52666] Sum rewards: 68.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.020', 'AMMO2': '0.058', 'AMMO3': '0.205', 'AMMO4': '0.290', 'weapon5': '0.294', 'weapon2': '0.346', 'weapon4': '0.354', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.668', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '55.000'} [2024-08-06 07:44:59,178][52649] DAMAGECOUNT value on done: 874010.0 [2024-08-06 07:44:59,178][52649] Sum rewards: 83.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.462', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.034', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.442', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '70.000'} [2024-08-06 07:45:00,018][52670] DAMAGECOUNT value on done: 885523.0 [2024-08-06 07:45:00,018][52670] Sum rewards: 63.174, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.593', 'AMMO5': '0.025', 'AMMO2': '0.069', 'weapon4': '0.216', 'weapon2': '0.252', 'AMMO3': '0.296', 'AMMO4': '0.348', 'weapon5': '0.386', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.774', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '55.000'} [2024-08-06 07:45:00,193][52665] DAMAGECOUNT value on done: 876455.0 [2024-08-06 07:45:00,193][52665] Sum rewards: 69.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.345', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.148', 'weapon4': '0.236', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.550', 'weapon3': '2.880', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:00,255][52650] Updated weights for policy 0, policy_version 78871 (0.0026) [2024-08-06 07:45:00,290][52664] DAMAGECOUNT value on done: 940918.0 [2024-08-06 07:45:00,290][52664] Sum rewards: 66.699, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-2.865', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.262', 'AMMO3': '0.348', 'WEAPON3': '2.000', 'HITCOUNT': '3.210', 'weapon3': '3.330', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:01,159][52666] DAMAGECOUNT value on done: 892007.0 [2024-08-06 07:45:01,160][52666] Sum rewards: 74.779, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.855', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.209', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:02,410][52649] DAMAGECOUNT value on done: 877497.0 [2024-08-06 07:45:02,419][52649] Sum rewards: 83.181, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.402', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.036', 'weapon5': '0.132', 'AMMO4': '0.142', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '67.000'} [2024-08-06 07:45:02,609][52670] DAMAGECOUNT value on done: 884844.0 [2024-08-06 07:45:02,610][52670] Sum rewards: 78.294, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.156', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon4': '0.090', 'AMMO3': '0.169', 'weapon5': '0.224', 'weapon2': '0.292', 'AMMO4': '0.313', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:02,734][52664] DAMAGECOUNT value on done: 923615.0 [2024-08-06 07:45:02,734][52664] Sum rewards: 76.521, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.738', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.328', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '2.804', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '61.000'} [2024-08-06 07:45:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 646152192. Throughput: 0: 4366.9. Samples: 161538690. Policy #0 lag: (min: 1.0, avg: 4.0, max: 9.0) [2024-08-06 07:45:02,794][52567] Avg episode reward: [(0, '75.383')] [2024-08-06 07:45:03,393][52665] DAMAGECOUNT value on done: 884555.0 [2024-08-06 07:45:03,393][52665] Sum rewards: 79.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.220', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.186', 'weapon2': '0.212', 'AMMO3': '0.255', 'weapon5': '0.258', 'AMMO4': '0.267', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '67.000'} [2024-08-06 07:45:03,766][52666] DAMAGECOUNT value on done: 887322.0 [2024-08-06 07:45:03,766][52666] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO3': '0.224', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.426', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:04,669][52650] Updated weights for policy 0, policy_version 78881 (0.0021) [2024-08-06 07:45:05,229][52664] DAMAGECOUNT value on done: 927545.0 [2024-08-06 07:45:05,230][52664] Sum rewards: 77.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.903', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.112', 'weapon4': '0.148', 'AMMO4': '0.160', 'AMMO3': '0.180', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '64.000'} [2024-08-06 07:45:05,233][52670] DAMAGECOUNT value on done: 881322.0 [2024-08-06 07:45:05,235][52670] Sum rewards: 71.281, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.060', 'weapon5': '0.202', 'AMMO3': '0.212', 'AMMO4': '0.248', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:05,528][52649] DAMAGECOUNT value on done: 873268.0 [2024-08-06 07:45:05,529][52649] Sum rewards: 72.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.140', 'weapon4': '0.194', 'AMMO3': '0.225', 'AMMO4': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '61.000'} [2024-08-06 07:45:06,494][52665] DAMAGECOUNT value on done: 884989.0 [2024-08-06 07:45:06,494][52665] Sum rewards: 80.525, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'HEALTH': '0.160', 'AMMO3': '0.239', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '66.000'} [2024-08-06 07:45:06,586][52666] DAMAGECOUNT value on done: 886273.0 [2024-08-06 07:45:06,587][52666] Sum rewards: 78.074, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.136', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '64.000'} [2024-08-06 07:45:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 646242304. Throughput: 0: 4373.3. Samples: 161564890. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:07,795][52567] Avg episode reward: [(0, '75.334')] [2024-08-06 07:45:07,890][52664] DAMAGECOUNT value on done: 933672.0 [2024-08-06 07:45:07,892][52664] Sum rewards: 90.995, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.436', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.164', 'AMMO3': '0.192', 'AMMO4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'weapon4': '0.280', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.727', 'FRAGCOUNT': '72.000'} [2024-08-06 07:45:08,040][52670] DAMAGECOUNT value on done: 894636.0 [2024-08-06 07:45:08,042][52670] Sum rewards: 62.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.055', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON1': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.188', 'weapon2': '0.462', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.320', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '52.000'} [2024-08-06 07:45:08,769][52649] DAMAGECOUNT value on done: 869617.0 [2024-08-06 07:45:08,771][52649] Sum rewards: 66.737, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.014', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.126', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.402', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.212', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '56.000'} [2024-08-06 07:45:09,419][52666] DAMAGECOUNT value on done: 893640.0 [2024-08-06 07:45:09,422][52666] Sum rewards: 71.730, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.074', 'AMMO4': '0.196', 'weapon2': '0.210', 'weapon5': '0.240', 'AMMO3': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.204', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '61.000'} [2024-08-06 07:45:09,658][52650] Updated weights for policy 0, policy_version 78891 (0.0012) [2024-08-06 07:45:09,717][52665] DAMAGECOUNT value on done: 889659.0 [2024-08-06 07:45:09,718][52665] Sum rewards: 86.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.098', 'weapon2': '0.176', 'AMMO3': '0.203', 'WEAPON3': '1.300', 'weapon3': '3.552', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '71.000'} [2024-08-06 07:45:10,337][52664] DAMAGECOUNT value on done: 924859.0 [2024-08-06 07:45:10,337][52664] Sum rewards: 83.153, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.156', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.136', 'AMMO4': '0.171', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '69.000'} [2024-08-06 07:45:11,071][52668] DAMAGECOUNT value on done: 901751.0 [2024-08-06 07:45:11,072][52668] Sum rewards: 67.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.202', 'AMMO3': '0.245', 'weapon4': '0.258', 'weapon5': '0.302', 'weapon2': '0.444', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.640', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '56.000'} [2024-08-06 07:45:11,104][52670] DAMAGECOUNT value on done: 877122.0 [2024-08-06 07:45:11,106][52670] Sum rewards: 78.540, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.074', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.104', 'AMMO3': '0.237', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.426', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '65.000'} [2024-08-06 07:45:11,915][52649] DAMAGECOUNT value on done: 882281.0 [2024-08-06 07:45:11,915][52649] Sum rewards: 95.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.335', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.082', 'weapon5': '0.086', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '22.845', 'FRAGCOUNT': '78.000'} [2024-08-06 07:45:12,488][52666] DAMAGECOUNT value on done: 888184.0 [2024-08-06 07:45:12,491][52666] Sum rewards: 71.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.458', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.080', 'weapon5': '0.110', 'AMMO4': '0.141', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:12,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 646332416. Throughput: 0: 4372.3. Samples: 161591140. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:12,802][52567] Avg episode reward: [(0, '75.489')] [2024-08-06 07:45:12,850][52665] DAMAGECOUNT value on done: 883478.0 [2024-08-06 07:45:12,850][52665] Sum rewards: 76.135, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:13,564][52668] DAMAGECOUNT value on done: 904165.0 [2024-08-06 07:45:13,564][52668] Sum rewards: 77.633, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.085', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'weapon2': '0.294', 'WEAPON3': '1.300', 'weapon3': '3.442', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '64.000'} [2024-08-06 07:45:13,956][52650] Updated weights for policy 0, policy_version 78901 (0.0045) [2024-08-06 07:45:14,229][52670] DAMAGECOUNT value on done: 892517.0 [2024-08-06 07:45:14,229][52670] Sum rewards: 72.959, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.389', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.113', 'weapon4': '0.154', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.289', 'weapon2': '0.326', 'WEAPON3': '1.700', 'weapon3': '3.154', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '63.000'} [2024-08-06 07:45:14,969][52649] DAMAGECOUNT value on done: 886331.0 [2024-08-06 07:45:14,970][52649] Sum rewards: 81.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.128', 'weapon5': '0.172', 'weapon2': '0.190', 'AMMO3': '0.192', 'AMMO4': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '67.000'} [2024-08-06 07:45:15,695][52666] DAMAGECOUNT value on done: 893262.0 [2024-08-06 07:45:15,696][52666] Sum rewards: 76.491, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.345', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'weapon4': '0.166', 'AMMO3': '0.220', 'weapon2': '0.246', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '63.000'} [2024-08-06 07:45:15,932][52665] DAMAGECOUNT value on done: 898463.0 [2024-08-06 07:45:15,934][52665] Sum rewards: 68.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.360', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.160', 'weapon5': '0.174', 'weapon2': '0.240', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.020', 'weapon3': '3.088', 'DAMAGECOUNT': '15.561', 'FRAGCOUNT': '54.000'} [2024-08-06 07:45:16,101][52668] DAMAGECOUNT value on done: 898114.0 [2024-08-06 07:45:16,103][52668] Sum rewards: 86.967, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.025', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.066', 'AMMO4': '0.130', 'AMMO3': '0.180', 'weapon5': '0.194', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '68.000'} [2024-08-06 07:45:17,575][52670] DAMAGECOUNT value on done: 896291.0 [2024-08-06 07:45:17,577][52670] Sum rewards: 79.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.156', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.042', 'weapon4': '0.082', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '66.000'} [2024-08-06 07:45:17,689][52660] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:45:17,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 646414336. Throughput: 0: 4386.4. Samples: 161604430. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:17,794][52567] Avg episode reward: [(0, '75.671')] [2024-08-06 07:45:18,079][52649] DAMAGECOUNT value on done: 880033.0 [2024-08-06 07:45:18,079][52649] Sum rewards: 80.334, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'weapon5': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '64.000'} [2024-08-06 07:45:18,525][52668] DAMAGECOUNT value on done: 901803.0 [2024-08-06 07:45:18,527][52668] Sum rewards: 62.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.032', 'AMMO5': '0.006', 'weapon4': '0.022', 'AMMO2': '0.033', 'weapon5': '0.084', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.328', 'WEAPON3': '1.550', 'HITCOUNT': '3.000', 'weapon3': '3.362', 'DAMAGECOUNT': '15.447', 'FRAGCOUNT': '56.000'} [2024-08-06 07:45:18,665][52650] Updated weights for policy 0, policy_version 78911 (0.0024) [2024-08-06 07:45:18,784][52666] DAMAGECOUNT value on done: 876378.0 [2024-08-06 07:45:18,785][52666] Sum rewards: 71.090, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.768', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.095', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.240', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'weapon3': '3.410', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '62.500'} [2024-08-06 07:45:19,042][52665] DAMAGECOUNT value on done: 889856.0 [2024-08-06 07:45:19,044][52665] Sum rewards: 75.406, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.282', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.068', 'AMMO4': '0.135', 'weapon5': '0.212', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:20,485][52670] DAMAGECOUNT value on done: 888881.0 [2024-08-06 07:45:20,487][52670] Sum rewards: 67.213, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.012', 'AMMO4': '0.058', 'HEALTH': '0.125', 'AMMO3': '0.208', 'weapon2': '0.264', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.616', 'DAMAGECOUNT': '15.360', 'FRAGCOUNT': '56.000'} [2024-08-06 07:45:21,007][52668] DAMAGECOUNT value on done: 890565.0 [2024-08-06 07:45:21,008][52668] Sum rewards: 64.775, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.003', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon4': '0.114', 'weapon2': '0.210', 'weapon5': '0.228', 'AMMO3': '0.264', 'AMMO4': '0.298', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.174', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '56.000'} [2024-08-06 07:45:21,518][52649] DAMAGECOUNT value on done: 879878.0 [2024-08-06 07:45:21,521][52649] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.171', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '3.336', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:21,805][52666] DAMAGECOUNT value on done: 897637.0 [2024-08-06 07:45:21,808][52666] Sum rewards: 73.984, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.130', 'weapon5': '0.136', 'AMMO4': '0.143', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.916', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '58.000'} [2024-08-06 07:45:22,494][52665] DAMAGECOUNT value on done: 886115.0 [2024-08-06 07:45:22,495][52665] Sum rewards: 73.986, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.505', 'AMMO2': '0.011', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO4': '0.054', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon4': '0.184', 'WEAPON5': '0.250', 'weapon2': '0.726', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 646512640. Throughput: 0: 4380.0. Samples: 161630580. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:22,802][52567] Avg episode reward: [(0, '75.314')] [2024-08-06 07:45:23,122][52670] DAMAGECOUNT value on done: 872663.0 [2024-08-06 07:45:23,123][52670] Sum rewards: 77.787, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.376', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'weapon4': '0.058', 'AMMO4': '0.073', 'AMMO3': '0.170', 'weapon2': '0.788', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:23,557][52650] Updated weights for policy 0, policy_version 78921 (0.0029) [2024-08-06 07:45:24,036][52668] DAMAGECOUNT value on done: 898535.0 [2024-08-06 07:45:24,038][52668] Sum rewards: 79.293, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.062', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '66.000'} [2024-08-06 07:45:24,257][52666] DAMAGECOUNT value on done: 891616.0 [2024-08-06 07:45:24,258][52666] Sum rewards: 68.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.750', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon2': '0.152', 'weapon5': '0.168', 'AMMO4': '0.175', 'AMMO3': '0.218', 'WEAPON5': '0.400', 'weapon4': '0.460', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.830', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:25,106][52649] DAMAGECOUNT value on done: 868668.0 [2024-08-06 07:45:25,108][52649] Sum rewards: 71.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.154', 'AMMO4': '0.176', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.212', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:25,881][52665] DAMAGECOUNT value on done: 888887.0 [2024-08-06 07:45:25,881][52665] Sum rewards: 68.060, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.104', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon5': '0.166', 'AMMO3': '0.267', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.500', 'weapon3': '2.746', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:25,967][52670] DAMAGECOUNT value on done: 887375.0 [2024-08-06 07:45:25,970][52670] Sum rewards: 81.915, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.111', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.408', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '71.000'} [2024-08-06 07:45:27,096][52668] DAMAGECOUNT value on done: 900725.0 [2024-08-06 07:45:27,097][52668] Sum rewards: 71.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.082', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.138', 'AMMO3': '0.199', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:27,348][52671] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:45:27,394][52666] DAMAGECOUNT value on done: 891320.0 [2024-08-06 07:45:27,394][52666] Sum rewards: 72.695, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.914', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.224', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:27,752][52650] Updated weights for policy 0, policy_version 78931 (0.0015) [2024-08-06 07:45:27,794][52567] Fps is (10 sec: 18841.0, 60 sec: 17749.4, 300 sec: 17494.8). Total num frames: 646602752. Throughput: 0: 4373.3. Samples: 161656580. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:27,795][52567] Avg episode reward: [(0, '75.449')] [2024-08-06 07:45:27,891][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:45:28,102][52649] DAMAGECOUNT value on done: 878576.0 [2024-08-06 07:45:28,102][52649] Sum rewards: 76.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.984', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.080', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.211', 'WEAPON3': '1.350', 'weapon3': '3.504', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '63.000'} [2024-08-06 07:45:28,870][52665] DAMAGECOUNT value on done: 882949.0 [2024-08-06 07:45:28,872][52665] Sum rewards: 77.949, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.940', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.072', 'AMMO4': '0.219', 'weapon5': '0.238', 'AMMO3': '0.243', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.894', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '67.000'} [2024-08-06 07:45:28,990][52670] DAMAGECOUNT value on done: 896568.0 [2024-08-06 07:45:28,992][52670] Sum rewards: 75.790, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.745', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO3': '0.178', 'weapon2': '0.636', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '61.000'} [2024-08-06 07:45:30,031][52668] DAMAGECOUNT value on done: 891171.0 [2024-08-06 07:45:30,031][52668] Sum rewards: 83.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.562', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '69.000'} [2024-08-06 07:45:30,158][52666] DAMAGECOUNT value on done: 885058.0 [2024-08-06 07:45:30,158][52666] Sum rewards: 74.888, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.320', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.074', 'AMMO4': '0.159', 'weapon5': '0.166', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:31,266][52649] DAMAGECOUNT value on done: 861140.0 [2024-08-06 07:45:31,267][52649] Sum rewards: 75.798, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.710', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.712', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '65.000'} [2024-08-06 07:45:31,743][52670] DAMAGECOUNT value on done: 889895.0 [2024-08-06 07:45:31,751][52670] Sum rewards: 77.379, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.246', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.031', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.158', 'weapon2': '0.538', 'WEAPON3': '1.050', 'weapon3': '3.244', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:31,897][52665] DAMAGECOUNT value on done: 888451.0 [2024-08-06 07:45:31,897][52665] Sum rewards: 74.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.426', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.038', 'AMMO4': '0.116', 'weapon5': '0.126', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:32,615][52666] DAMAGECOUNT value on done: 884165.0 [2024-08-06 07:45:32,616][52666] Sum rewards: 81.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.090', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '66.000'} [2024-08-06 07:45:32,666][52668] DAMAGECOUNT value on done: 895242.0 [2024-08-06 07:45:32,666][52668] Sum rewards: 74.281, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.306', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.202', 'AMMO4': '0.205', 'weapon4': '0.224', 'weapon5': '0.226', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 646676480. Throughput: 0: 4372.9. Samples: 161669660. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:32,794][52567] Avg episode reward: [(0, '75.516')] [2024-08-06 07:45:32,964][52650] Updated weights for policy 0, policy_version 78941 (0.0022) [2024-08-06 07:45:33,493][52811] DAMAGECOUNT value on done: 851473.0 [2024-08-06 07:45:33,493][52811] Sum rewards: 73.622, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.688', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.092', 'weapon5': '0.152', 'AMMO3': '0.183', 'AMMO4': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.050', 'HITCOUNT': '3.010', 'weapon3': '3.118', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:34,129][52649] DAMAGECOUNT value on done: 882841.0 [2024-08-06 07:45:34,131][52649] Sum rewards: 77.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.214', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.157', 'weapon2': '0.270', 'WEAPON3': '1.000', 'HITCOUNT': '3.400', 'weapon3': '3.542', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:34,147][52662] DAMAGECOUNT value on done: 895832.0 [2024-08-06 07:45:34,148][52662] Sum rewards: 75.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.254', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.070', 'weapon5': '0.122', 'AMMO4': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '63.000'} [2024-08-06 07:45:34,357][52670] DAMAGECOUNT value on done: 891702.0 [2024-08-06 07:45:34,357][52670] Sum rewards: 68.923, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.537', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.162', 'weapon5': '0.184', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '55.000'} [2024-08-06 07:45:34,531][52665] DAMAGECOUNT value on done: 888575.0 [2024-08-06 07:45:34,533][52665] Sum rewards: 73.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.835', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.134', 'weapon5': '0.136', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '61.000'} [2024-08-06 07:45:35,585][52666] DAMAGECOUNT value on done: 903263.0 [2024-08-06 07:45:35,586][52666] Sum rewards: 76.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.060', 'weapon4': '0.110', 'AMMO4': '0.174', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:35,632][52668] DAMAGECOUNT value on done: 901699.0 [2024-08-06 07:45:35,632][52668] Sum rewards: 74.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.639', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.154', 'AMMO3': '0.168', 'AMMO4': '0.209', 'weapon4': '0.324', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.810', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:36,526][52811] DAMAGECOUNT value on done: 835801.0 [2024-08-06 07:45:36,527][52811] Sum rewards: 68.623, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.545', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '57.000'} [2024-08-06 07:45:37,014][52649] DAMAGECOUNT value on done: 881768.0 [2024-08-06 07:45:37,014][52649] Sum rewards: 76.634, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.282', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.168', 'AMMO3': '0.173', 'weapon5': '0.180', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '61.000'} [2024-08-06 07:45:37,247][52662] DAMAGECOUNT value on done: 905634.0 [2024-08-06 07:45:37,248][52662] Sum rewards: 71.769, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.995', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO4': '0.067', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'weapon2': '0.260', 'weapon4': '0.306', 'ARMOR': '0.463', 'WEAPON3': '1.000', 'weapon3': '3.144', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '55.000'} [2024-08-06 07:45:37,475][52650] Updated weights for policy 0, policy_version 78951 (0.0020) [2024-08-06 07:45:37,649][52665] DAMAGECOUNT value on done: 879217.0 [2024-08-06 07:45:37,650][52665] Sum rewards: 62.807, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon2': '0.224', 'weapon5': '0.236', 'weapon4': '0.256', 'AMMO4': '0.264', 'AMMO3': '0.272', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '54.000'} [2024-08-06 07:45:37,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 646766592. Throughput: 0: 4372.0. Samples: 161695900. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:37,794][52567] Avg episode reward: [(0, '74.898')] [2024-08-06 07:45:37,834][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:45:38,184][52668] DAMAGECOUNT value on done: 894941.0 [2024-08-06 07:45:38,184][52668] Sum rewards: 92.874, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.595', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'weapon2': '0.184', 'AMMO3': '0.260', 'WEAPON3': '1.650', 'weapon3': '3.426', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.306', 'FRAGCOUNT': '79.000'} [2024-08-06 07:45:38,295][52666] DAMAGECOUNT value on done: 876699.0 [2024-08-06 07:45:38,297][52666] Sum rewards: 73.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.653', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.076', 'AMMO3': '0.173', 'weapon5': '0.180', 'AMMO4': '0.235', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:39,621][52811] DAMAGECOUNT value on done: 829785.0 [2024-08-06 07:45:39,624][52811] Sum rewards: 87.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.047', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.387', 'FRAGCOUNT': '73.000'} [2024-08-06 07:45:39,912][52667] DAMAGECOUNT value on done: 896373.0 [2024-08-06 07:45:39,915][52667] Sum rewards: 77.657, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.992', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.120', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.186', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '66.000'} [2024-08-06 07:45:40,093][52662] DAMAGECOUNT value on done: 905330.0 [2024-08-06 07:45:40,093][52662] Sum rewards: 77.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.110', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.187', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '3.264', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '63.000'} [2024-08-06 07:45:40,125][52649] DAMAGECOUNT value on done: 874961.0 [2024-08-06 07:45:40,126][52649] Sum rewards: 69.545, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.120', 'weapon5': '0.192', 'AMMO4': '0.245', 'AMMO3': '0.269', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.072', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '61.000'} [2024-08-06 07:45:40,549][52665] DAMAGECOUNT value on done: 884143.0 [2024-08-06 07:45:40,551][52665] Sum rewards: 68.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.152', 'weapon4': '0.164', 'AMMO4': '0.216', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '58.000'} [2024-08-06 07:45:41,226][52668] DAMAGECOUNT value on done: 890236.0 [2024-08-06 07:45:41,226][52668] Sum rewards: 86.808, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.326', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.082', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '72.000'} [2024-08-06 07:45:41,274][52666] DAMAGECOUNT value on done: 886217.0 [2024-08-06 07:45:41,277][52666] Sum rewards: 78.311, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.065', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.048', 'weapon4': '0.064', 'weapon2': '0.142', 'AMMO4': '0.195', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.532', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '65.000'} [2024-08-06 07:45:42,051][52650] Updated weights for policy 0, policy_version 78961 (0.0011) [2024-08-06 07:45:42,646][52667] DAMAGECOUNT value on done: 909696.0 [2024-08-06 07:45:42,647][52667] Sum rewards: 80.683, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.177', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.162', 'weapon2': '0.202', 'weapon5': '0.202', 'AMMO4': '0.221', 'AMMO3': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '67.000'} [2024-08-06 07:45:42,745][52811] DAMAGECOUNT value on done: 833208.0 [2024-08-06 07:45:42,745][52811] Sum rewards: 72.212, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.485', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.156', 'weapon2': '0.428', 'WEAPON3': '1.000', 'HITCOUNT': '3.260', 'weapon3': '3.366', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 07:45:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 646856704. Throughput: 0: 4377.8. Samples: 161722400. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:42,794][52567] Avg episode reward: [(0, '75.518')] [2024-08-06 07:45:43,044][52662] DAMAGECOUNT value on done: 891673.0 [2024-08-06 07:45:43,046][52662] Sum rewards: 80.599, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.136', 'AMMO3': '0.171', 'weapon5': '0.216', 'AMMO4': '0.297', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '64.000'} [2024-08-06 07:45:43,440][52665] DAMAGECOUNT value on done: 889580.0 [2024-08-06 07:45:43,441][52665] Sum rewards: 73.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.835', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.134', 'weapon4': '0.162', 'AMMO3': '0.235', 'weapon2': '0.240', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:44,147][52668] DAMAGECOUNT value on done: 887653.0 [2024-08-06 07:45:44,147][52668] Sum rewards: 69.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.500', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.030', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.314', 'WEAPON3': '1.450', 'HITCOUNT': '3.350', 'weapon3': '3.440', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:45,553][52667] DAMAGECOUNT value on done: 905998.0 [2024-08-06 07:45:45,553][52667] Sum rewards: 69.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.154', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.094', 'weapon4': '0.110', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:45,750][52811] DAMAGECOUNT value on done: 837118.0 [2024-08-06 07:45:45,752][52811] Sum rewards: 84.097, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.672', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.221', 'AMMO4': '0.249', 'weapon4': '0.254', 'weapon5': '0.286', 'weapon2': '0.300', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.838', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '69.000'} [2024-08-06 07:45:46,209][52662] DAMAGECOUNT value on done: 910225.0 [2024-08-06 07:45:46,209][52662] Sum rewards: 81.949, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.024', 'AMMO2': '0.064', 'weapon4': '0.106', 'AMMO3': '0.250', 'weapon2': '0.266', 'weapon5': '0.292', 'AMMO4': '0.319', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.042', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '69.000'} [2024-08-06 07:45:46,572][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:45:46,910][52650] Updated weights for policy 0, policy_version 78971 (0.0030) [2024-08-06 07:45:47,142][52668] DAMAGECOUNT value on done: 886471.0 [2024-08-06 07:45:47,150][52668] Sum rewards: 62.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.062', 'AMMO4': '0.091', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.028', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '54.000'} [2024-08-06 07:45:47,221][52660] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:45:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 646938624. Throughput: 0: 4367.8. Samples: 161735240. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:47,794][52567] Avg episode reward: [(0, '75.484')] [2024-08-06 07:45:48,215][52667] DAMAGECOUNT value on done: 909862.0 [2024-08-06 07:45:48,215][52667] Sum rewards: 78.410, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '64.000'} [2024-08-06 07:45:48,798][52811] DAMAGECOUNT value on done: 852763.0 [2024-08-06 07:45:48,799][52811] Sum rewards: 85.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.448', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.038', 'weapon5': '0.052', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.336', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '70.000'} [2024-08-06 07:45:49,405][52662] DAMAGECOUNT value on done: 886854.0 [2024-08-06 07:45:49,406][52662] Sum rewards: 64.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.094', 'AMMO5': '0.009', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.048', 'AMMO4': '0.174', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.620', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.130', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '54.000'} [2024-08-06 07:45:49,665][52668] DAMAGECOUNT value on done: 881027.0 [2024-08-06 07:45:49,665][52668] Sum rewards: 71.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.492', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.186', 'weapon2': '0.192', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '59.000'} [2024-08-06 07:45:51,338][52667] DAMAGECOUNT value on done: 910967.0 [2024-08-06 07:45:51,339][52667] Sum rewards: 68.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.052', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.042', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.236', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '54.500'} [2024-08-06 07:45:51,477][52650] Updated weights for policy 0, policy_version 78981 (0.0023) [2024-08-06 07:45:51,921][52811] DAMAGECOUNT value on done: 845098.0 [2024-08-06 07:45:51,923][52811] Sum rewards: 74.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.216', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '63.000'} [2024-08-06 07:45:52,453][52668] DAMAGECOUNT value on done: 896239.0 [2024-08-06 07:45:52,455][52668] Sum rewards: 73.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.710', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon2': '0.178', 'weapon5': '0.180', 'AMMO4': '0.190', 'weapon4': '0.218', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:52,632][52662] DAMAGECOUNT value on done: 896292.0 [2024-08-06 07:45:52,634][52662] Sum rewards: 82.331, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.228', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.040', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.171', 'weapon2': '0.426', 'WEAPON3': '1.000', 'weapon3': '3.330', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '65.000'} [2024-08-06 07:45:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 647036928. Throughput: 0: 4377.8. Samples: 161761890. Policy #0 lag: (min: 1.0, avg: 4.4, max: 8.0) [2024-08-06 07:45:52,794][52567] Avg episode reward: [(0, '75.252')] [2024-08-06 07:45:54,634][52667] DAMAGECOUNT value on done: 909182.0 [2024-08-06 07:45:54,634][52667] Sum rewards: 76.669, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.716', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.266', 'weapon4': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:55,015][52811] DAMAGECOUNT value on done: 834105.0 [2024-08-06 07:45:55,019][52811] Sum rewards: 79.385, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.309', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.192', 'weapon4': '0.194', 'weapon5': '0.226', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '63.500'} [2024-08-06 07:45:55,450][52668] DAMAGECOUNT value on done: 898734.0 [2024-08-06 07:45:55,451][52668] Sum rewards: 76.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.442', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.096', 'weapon5': '0.144', 'AMMO4': '0.198', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '62.000'} [2024-08-06 07:45:55,778][52662] DAMAGECOUNT value on done: 912096.0 [2024-08-06 07:45:55,779][52662] Sum rewards: 69.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.443', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.162', 'weapon5': '0.164', 'weapon4': '0.200', 'AMMO4': '0.202', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.610', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '56.000'} [2024-08-06 07:45:56,093][52650] Updated weights for policy 0, policy_version 78991 (0.0024) [2024-08-06 07:45:56,584][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:45:57,676][52667] DAMAGECOUNT value on done: 903395.0 [2024-08-06 07:45:57,683][52667] Sum rewards: 78.728, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.402', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon5': '0.112', 'weapon4': '0.130', 'AMMO4': '0.185', 'AMMO3': '0.221', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '66.000'} [2024-08-06 07:45:57,726][52811] Large shaping reward 2.641 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:45:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 647118848. Throughput: 0: 4367.3. Samples: 161787670. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:45:57,794][52567] Avg episode reward: [(0, '75.471')] [2024-08-06 07:45:57,977][52811] DAMAGECOUNT value on done: 842329.0 [2024-08-06 07:45:57,977][52811] Sum rewards: 65.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.126', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '55.000'} [2024-08-06 07:45:58,099][52668] DAMAGECOUNT value on done: 897553.0 [2024-08-06 07:45:58,099][52668] Sum rewards: 91.360, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.992', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.052', 'weapon4': '0.064', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.428', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.621', 'FRAGCOUNT': '76.000'} [2024-08-06 07:45:58,534][52660] DAMAGECOUNT value on done: 894212.0 [2024-08-06 07:45:58,534][52660] Sum rewards: 73.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.763', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.168', 'AMMO4': '0.175', 'weapon2': '0.204', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.354', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '60.000'} [2024-08-06 07:45:58,766][52662] DAMAGECOUNT value on done: 898004.0 [2024-08-06 07:45:58,767][52662] Sum rewards: 86.005, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.718', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.152', 'AMMO3': '0.202', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.114', 'FRAGCOUNT': '69.000'} [2024-08-06 07:46:00,117][52659] DAMAGECOUNT value on done: 901234.0 [2024-08-06 07:46:00,118][52659] Sum rewards: 82.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.310', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon5': '0.146', 'weapon4': '0.154', 'AMMO3': '0.200', 'AMMO4': '0.250', 'weapon2': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '68.500'} [2024-08-06 07:46:00,567][52667] DAMAGECOUNT value on done: 901132.0 [2024-08-06 07:46:00,568][52667] Sum rewards: 80.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.914', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon2': '0.176', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon4': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '67.000'} [2024-08-06 07:46:00,975][52650] Updated weights for policy 0, policy_version 79001 (0.0035) [2024-08-06 07:46:01,013][52668] DAMAGECOUNT value on done: 900464.0 [2024-08-06 07:46:01,013][52668] Sum rewards: 76.293, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.570', 'AMMO2': '0.012', 'AMMO4': '0.058', 'AMMO3': '0.148', 'weapon2': '0.410', 'WEAPON3': '0.950', 'weapon3': '3.470', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:01,196][52811] DAMAGECOUNT value on done: 840702.0 [2024-08-06 07:46:01,198][52811] Sum rewards: 80.963, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.137', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '70.000'} [2024-08-06 07:46:01,355][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:01,508][52660] DAMAGECOUNT value on done: 887281.0 [2024-08-06 07:46:01,509][52660] Sum rewards: 86.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.926', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.166', 'weapon4': '0.178', 'AMMO3': '0.221', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.156', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.387', 'FRAGCOUNT': '69.000'} [2024-08-06 07:46:02,066][52662] DAMAGECOUNT value on done: 905505.0 [2024-08-06 07:46:02,068][52662] Sum rewards: 73.701, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.196', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.088', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon5': '0.280', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.000', 'weapon3': '2.868', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '59.000'} [2024-08-06 07:46:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 647208960. Throughput: 0: 4366.0. Samples: 161800900. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:02,794][52567] Avg episode reward: [(0, '75.941')] [2024-08-06 07:46:02,892][52659] DAMAGECOUNT value on done: 896366.0 [2024-08-06 07:46:02,892][52659] Sum rewards: 75.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.804', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO3': '0.177', 'weapon5': '0.200', 'AMMO4': '0.204', 'weapon2': '0.254', 'weapon4': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.966', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:03,499][52667] DAMAGECOUNT value on done: 901268.0 [2024-08-06 07:46:03,500][52667] Sum rewards: 73.224, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.202', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.191', 'AMMO4': '0.205', 'weapon5': '0.212', 'weapon4': '0.294', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '59.000'} [2024-08-06 07:46:04,153][52668] DAMAGECOUNT value on done: 903518.0 [2024-08-06 07:46:04,153][52668] Sum rewards: 77.829, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.296', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.370', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '66.000'} [2024-08-06 07:46:04,228][52811] DAMAGECOUNT value on done: 845315.0 [2024-08-06 07:46:04,231][52811] Sum rewards: 88.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.188', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.162', 'weapon5': '0.178', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.000', 'weapon3': '2.788', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '70.000'} [2024-08-06 07:46:04,568][52811] Large shaping reward 2.512 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.492, 164.0)] [2024-08-06 07:46:04,690][52660] DAMAGECOUNT value on done: 897889.0 [2024-08-06 07:46:04,692][52660] Sum rewards: 71.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.024', 'AMMO2': '0.062', 'AMMO3': '0.189', 'weapon5': '0.200', 'AMMO4': '0.312', 'weapon4': '0.378', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.736', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '58.000'} [2024-08-06 07:46:05,274][52662] DAMAGECOUNT value on done: 897853.0 [2024-08-06 07:46:05,277][52662] Sum rewards: 69.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.218', 'weapon2': '0.406', 'WEAPON3': '1.300', 'HITCOUNT': '3.250', 'weapon3': '3.288', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '57.000'} [2024-08-06 07:46:05,370][52650] Updated weights for policy 0, policy_version 79011 (0.0029) [2024-08-06 07:46:05,626][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:05,915][52659] DAMAGECOUNT value on done: 908068.0 [2024-08-06 07:46:05,919][52659] Sum rewards: 73.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.638', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.233', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.568', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '61.000'} [2024-08-06 07:46:06,360][52667] DAMAGECOUNT value on done: 909415.0 [2024-08-06 07:46:06,363][52667] Sum rewards: 84.498, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.006', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.072', 'AMMO3': '0.166', 'weapon5': '0.216', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '2.956', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '66.000'} [2024-08-06 07:46:07,302][52811] DAMAGECOUNT value on done: 849711.0 [2024-08-06 07:46:07,303][52811] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.310', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon5': '0.166', 'AMMO3': '0.171', 'AMMO4': '0.186', 'weapon4': '0.228', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:07,746][52660] DAMAGECOUNT value on done: 909782.0 [2024-08-06 07:46:07,747][52660] Sum rewards: 80.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.215', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.118', 'AMMO4': '0.147', 'weapon2': '0.188', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.476', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '67.000'} [2024-08-06 07:46:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 647290880. Throughput: 0: 4368.4. Samples: 161827160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:07,802][52567] Avg episode reward: [(0, '76.014')] [2024-08-06 07:46:08,268][52666] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:08,647][52662] DAMAGECOUNT value on done: 897208.0 [2024-08-06 07:46:08,649][52662] Sum rewards: 76.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.552', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.088', 'AMMO4': '0.124', 'weapon5': '0.162', 'weapon2': '0.174', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:08,949][52659] DAMAGECOUNT value on done: 900842.0 [2024-08-06 07:46:08,949][52659] Sum rewards: 72.535, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.094', 'AMMO4': '0.102', 'weapon5': '0.112', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2024-08-06 07:46:09,276][52667] DAMAGECOUNT value on done: 896555.0 [2024-08-06 07:46:09,277][52667] Sum rewards: 65.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.276', 'weapon4': '0.308', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '55.000'} [2024-08-06 07:46:10,480][52811] DAMAGECOUNT value on done: 840046.0 [2024-08-06 07:46:10,483][52811] Sum rewards: 76.814, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.706', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.036', 'AMMO4': '0.053', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.178', 'AMMO3': '0.197', 'WEAPON3': '1.200', 'HITCOUNT': '3.370', 'weapon3': '3.536', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:10,515][52650] Updated weights for policy 0, policy_version 79021 (0.0012) [2024-08-06 07:46:10,893][52660] DAMAGECOUNT value on done: 892491.0 [2024-08-06 07:46:10,893][52660] Sum rewards: 81.486, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.943', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.248', 'weapon2': '0.324', 'WEAPON4': '0.350', 'weapon4': '0.352', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '68.500'} [2024-08-06 07:46:11,556][52662] DAMAGECOUNT value on done: 891411.0 [2024-08-06 07:46:11,556][52662] Sum rewards: 77.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.332', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.098', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '65.000'} [2024-08-06 07:46:12,047][52667] DAMAGECOUNT value on done: 900309.0 [2024-08-06 07:46:12,047][52667] Sum rewards: 83.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.734', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.170', 'AMMO3': '0.235', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '69.000'} [2024-08-06 07:46:12,336][52659] DAMAGECOUNT value on done: 896542.0 [2024-08-06 07:46:12,336][52659] Sum rewards: 70.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.312', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.128', 'AMMO4': '0.149', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.618', 'WEAPON3': '1.150', 'weapon3': '3.002', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '57.000'} [2024-08-06 07:46:12,794][52567] Fps is (10 sec: 16383.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 647372800. Throughput: 0: 4372.2. Samples: 161853330. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:12,794][52567] Avg episode reward: [(0, '75.749')] [2024-08-06 07:46:13,450][52811] DAMAGECOUNT value on done: 837228.0 [2024-08-06 07:46:13,451][52811] Sum rewards: 65.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.426', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.090', 'weapon5': '0.116', 'AMMO4': '0.148', 'AMMO3': '0.192', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.354', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '55.000'} [2024-08-06 07:46:13,484][52660] DAMAGECOUNT value on done: 891326.0 [2024-08-06 07:46:13,486][52660] Sum rewards: 77.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.641', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.160', 'AMMO4': '0.169', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:14,274][52662] DAMAGECOUNT value on done: 901087.0 [2024-08-06 07:46:14,276][52662] Sum rewards: 65.035, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.342', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'AMMO4': '0.109', 'weapon5': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.306', 'weapon2': '0.392', 'WEAPON3': '1.700', 'weapon3': '3.184', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '56.000'} [2024-08-06 07:46:14,900][52667] DAMAGECOUNT value on done: 908373.0 [2024-08-06 07:46:14,901][52667] Sum rewards: 74.123, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.176', 'AMMO3': '0.178', 'weapon5': '0.182', 'weapon4': '0.218', 'HEALTH': '0.250', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:15,215][52650] Updated weights for policy 0, policy_version 79031 (0.0047) [2024-08-06 07:46:15,289][52659] DAMAGECOUNT value on done: 899301.0 [2024-08-06 07:46:15,289][52659] Sum rewards: 72.969, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.800', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.080', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.103', 'WEAPON3': '0.750', 'weapon2': '0.804', 'weapon3': '2.984', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '56.000'} [2024-08-06 07:46:15,586][52659] Large shaping reward 2.504 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.453, 151.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:16,620][52811] DAMAGECOUNT value on done: 837577.0 [2024-08-06 07:46:16,621][52811] Sum rewards: 78.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.060', 'weapon5': '0.100', 'AMMO3': '0.196', 'AMMO4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '65.000'} [2024-08-06 07:46:16,693][52660] DAMAGECOUNT value on done: 897611.0 [2024-08-06 07:46:16,694][52660] Sum rewards: 76.855, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.398', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.217', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '66.000'} [2024-08-06 07:46:17,273][52662] DAMAGECOUNT value on done: 891878.0 [2024-08-06 07:46:17,274][52662] Sum rewards: 82.969, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.336', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.184', 'weapon5': '0.194', 'weapon4': '0.210', 'AMMO4': '0.299', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '2.696', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '66.000'} [2024-08-06 07:46:17,769][52667] DAMAGECOUNT value on done: 899421.0 [2024-08-06 07:46:17,769][52667] Sum rewards: 86.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO3': '0.172', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.388', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '72.000'} [2024-08-06 07:46:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 647471104. Throughput: 0: 4369.1. Samples: 161866270. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:17,794][52567] Avg episode reward: [(0, '75.764')] [2024-08-06 07:46:17,948][52649] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:46:18,184][52659] DAMAGECOUNT value on done: 902007.0 [2024-08-06 07:46:18,184][52659] Sum rewards: 81.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.936', 'AMMO5': '0.013', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.108', 'weapon4': '0.194', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '67.000'} [2024-08-06 07:46:19,572][52650] Updated weights for policy 0, policy_version 79041 (0.0011) [2024-08-06 07:46:19,744][52660] DAMAGECOUNT value on done: 902738.0 [2024-08-06 07:46:19,745][52660] Sum rewards: 58.364, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.190', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.089', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.304', 'WEAPON3': '1.650', 'HITCOUNT': '3.160', 'weapon3': '3.244', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '51.000'} [2024-08-06 07:46:19,771][52811] DAMAGECOUNT value on done: 839029.0 [2024-08-06 07:46:19,771][52811] Sum rewards: 77.296, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.084', 'weapon4': '0.156', 'AMMO4': '0.182', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:20,667][52662] DAMAGECOUNT value on done: 908964.0 [2024-08-06 07:46:20,668][52662] Sum rewards: 76.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.022', 'AMMO2': '0.077', 'weapon4': '0.196', 'weapon2': '0.202', 'AMMO3': '0.224', 'weapon5': '0.332', 'AMMO4': '0.385', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.912', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:20,717][52659] DAMAGECOUNT value on done: 898304.0 [2024-08-06 07:46:20,718][52659] Sum rewards: 68.583, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.735', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.218', 'weapon5': '0.218', 'AMMO4': '0.241', 'weapon2': '0.278', 'AMMO3': '0.305', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '2.882', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 07:46:20,956][52667] DAMAGECOUNT value on done: 903980.0 [2024-08-06 07:46:20,956][52667] Sum rewards: 60.712, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.825', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO4': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.221', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.468', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '51.000'} [2024-08-06 07:46:22,110][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:22,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 647561216. Throughput: 0: 4371.3. Samples: 161892610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:22,794][52567] Avg episode reward: [(0, '75.735')] [2024-08-06 07:46:23,026][52660] DAMAGECOUNT value on done: 892363.0 [2024-08-06 07:46:23,026][52811] DAMAGECOUNT value on done: 847484.0 [2024-08-06 07:46:23,028][52811] Sum rewards: 78.641, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.078', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon5': '0.126', 'AMMO4': '0.134', 'weapon4': '0.138', 'AMMO3': '0.172', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:23,028][52660] Sum rewards: 64.824, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.170', 'AMMO3': '0.215', 'AMMO4': '0.217', 'weapon4': '0.326', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.786', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.630', 'FRAGCOUNT': '54.000'} [2024-08-06 07:46:23,093][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:46:23,328][52662] DAMAGECOUNT value on done: 901198.0 [2024-08-06 07:46:23,330][52662] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.318', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.068', 'AMMO4': '0.143', 'AMMO3': '0.169', 'weapon4': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.000', 'weapon3': '3.186', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '61.000'} [2024-08-06 07:46:23,489][52659] DAMAGECOUNT value on done: 898592.0 [2024-08-06 07:46:23,489][52659] Sum rewards: 78.794, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '64.000'} [2024-08-06 07:46:23,987][52667] DAMAGECOUNT value on done: 910905.0 [2024-08-06 07:46:23,987][52667] Sum rewards: 73.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.610', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.020', 'AMMO4': '0.067', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:24,522][52650] Updated weights for policy 0, policy_version 79051 (0.0023) [2024-08-06 07:46:26,078][52660] DAMAGECOUNT value on done: 887352.0 [2024-08-06 07:46:26,078][52660] Sum rewards: 72.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.939', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.122', 'weapon5': '0.208', 'AMMO3': '0.240', 'AMMO4': '0.255', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '61.000'} [2024-08-06 07:46:26,130][52811] DAMAGECOUNT value on done: 850177.0 [2024-08-06 07:46:26,131][52811] Sum rewards: 81.935, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.401', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.094', 'AMMO4': '0.151', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.420', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '71.000'} [2024-08-06 07:46:26,259][52662] DAMAGECOUNT value on done: 889614.0 [2024-08-06 07:46:26,260][52662] Sum rewards: 71.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.014', 'AMMO2': '0.067', 'weapon5': '0.174', 'AMMO3': '0.203', 'weapon4': '0.214', 'AMMO4': '0.335', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.744', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '58.000'} [2024-08-06 07:46:26,322][52659] DAMAGECOUNT value on done: 906181.0 [2024-08-06 07:46:26,324][52659] Sum rewards: 63.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.446', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.194', 'AMMO4': '0.198', 'weapon4': '0.202', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.642', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.103', 'FRAGCOUNT': '52.000'} [2024-08-06 07:46:26,932][52667] DAMAGECOUNT value on done: 911867.0 [2024-08-06 07:46:26,932][52667] Sum rewards: 77.282, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.550', 'AMMO5': '0.009', 'AMMO2': '0.054', 'weapon5': '0.098', 'weapon4': '0.110', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'weapon2': '0.276', 'WEAPON3': '1.100', 'weapon3': '3.342', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:27,743][52811] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.3, 300 sec: 17439.2). Total num frames: 647634944. Throughput: 0: 4362.0. Samples: 161918690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:27,794][52567] Avg episode reward: [(0, '75.551')] [2024-08-06 07:46:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079057_647634944.pth... [2024-08-06 07:46:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078547_643457024.pth [2024-08-06 07:46:28,262][52803] DAMAGECOUNT value on done: 835793.0 [2024-08-06 07:46:28,264][52803] Sum rewards: 66.768, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.151', 'weapon5': '0.174', 'weapon4': '0.198', 'AMMO4': '0.231', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.818', 'WEAPON3': '0.900', 'weapon3': '2.620', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '53.000'} [2024-08-06 07:46:28,860][52650] Updated weights for policy 0, policy_version 79061 (0.0025) [2024-08-06 07:46:29,137][52662] DAMAGECOUNT value on done: 895891.0 [2024-08-06 07:46:29,139][52662] Sum rewards: 72.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.234', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.186', 'weapon2': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '3.410', 'weapon3': '3.486', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '59.000'} [2024-08-06 07:46:29,231][52659] DAMAGECOUNT value on done: 893246.0 [2024-08-06 07:46:29,232][52659] Sum rewards: 80.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.410', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.106', 'AMMO4': '0.197', 'AMMO3': '0.229', 'weapon5': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '65.000'} [2024-08-06 07:46:29,491][52811] DAMAGECOUNT value on done: 838127.0 [2024-08-06 07:46:29,491][52811] Sum rewards: 75.667, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.030', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.026', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon4': '0.234', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:29,493][52667] DAMAGECOUNT value on done: 905661.0 [2024-08-06 07:46:29,495][52667] Sum rewards: 80.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.214', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon5': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.209', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '65.000'} [2024-08-06 07:46:29,521][52660] DAMAGECOUNT value on done: 896415.0 [2024-08-06 07:46:29,521][52660] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.006', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.088', 'weapon4': '0.132', 'AMMO3': '0.240', 'AMMO4': '0.247', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:31,357][52803] DAMAGECOUNT value on done: 834187.0 [2024-08-06 07:46:31,358][52803] Sum rewards: 77.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.818', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO4': '0.185', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '65.000'} [2024-08-06 07:46:31,654][52662] DAMAGECOUNT value on done: 890780.0 [2024-08-06 07:46:31,655][52662] Sum rewards: 75.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.108', 'weapon4': '0.152', 'AMMO4': '0.152', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:32,083][52659] DAMAGECOUNT value on done: 905194.0 [2024-08-06 07:46:32,085][52659] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.734', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.138', 'AMMO3': '0.213', 'weapon2': '0.224', 'weapon5': '0.232', 'AMMO4': '0.246', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '56.000'} [2024-08-06 07:46:32,535][52667] DAMAGECOUNT value on done: 903508.0 [2024-08-06 07:46:32,536][52667] Sum rewards: 71.443, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.528', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.136', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'HITCOUNT': '3.380', 'weapon3': '3.562', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '62.000'} [2024-08-06 07:46:32,539][52811] DAMAGECOUNT value on done: 835598.0 [2024-08-06 07:46:32,540][52811] Sum rewards: 76.859, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.235', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.128', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '64.500'} [2024-08-06 07:46:32,573][52660] DAMAGECOUNT value on done: 888960.0 [2024-08-06 07:46:32,573][52660] Sum rewards: 70.169, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.014', 'AMMO5': '0.015', 'AMMO2': '0.079', 'weapon5': '0.220', 'AMMO3': '0.230', 'weapon4': '0.260', 'weapon2': '0.368', 'AMMO4': '0.396', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '59.500'} [2024-08-06 07:46:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 647725056. Throughput: 0: 4360.0. Samples: 161931440. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:32,794][52567] Avg episode reward: [(0, '75.397')] [2024-08-06 07:46:33,863][52650] Updated weights for policy 0, policy_version 79071 (0.0034) [2024-08-06 07:46:33,925][52668] Large shaping reward 2.603 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.552, 184.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:34,555][52803] DAMAGECOUNT value on done: 842609.0 [2024-08-06 07:46:34,559][52803] Sum rewards: 72.474, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon4': '0.056', 'weapon5': '0.138', 'weapon2': '0.224', 'AMMO4': '0.245', 'AMMO3': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '3.220', 'weapon3': '3.316', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:34,981][52659] DAMAGECOUNT value on done: 897378.0 [2024-08-06 07:46:34,983][52659] Sum rewards: 80.989, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.652', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.090', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.320', 'weapon2': '0.330', 'WEAPON3': '1.050', 'weapon3': '3.058', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '64.000'} [2024-08-06 07:46:35,405][52667] DAMAGECOUNT value on done: 908041.0 [2024-08-06 07:46:35,405][52667] Sum rewards: 69.179, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.574', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.076', 'weapon5': '0.192', 'AMMO3': '0.235', 'AMMO4': '0.252', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '57.500'} [2024-08-06 07:46:35,753][52660] DAMAGECOUNT value on done: 890110.0 [2024-08-06 07:46:35,754][52660] Sum rewards: 71.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.074', 'AMMO5': '0.005', 'weapon4': '0.006', 'weapon5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.754', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '58.000'} [2024-08-06 07:46:37,315][52614] Signal inference workers to stop experience collection... (14500 times) [2024-08-06 07:46:37,318][52614] Signal inference workers to resume experience collection... (14500 times) [2024-08-06 07:46:37,402][52650] InferenceWorker_p0-w0: stopping experience collection (14500 times) [2024-08-06 07:46:37,402][52650] InferenceWorker_p0-w0: resuming experience collection (14500 times) [2024-08-06 07:46:37,723][52659] DAMAGECOUNT value on done: 896688.0 [2024-08-06 07:46:37,723][52659] Sum rewards: 76.373, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.245', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.104', 'weapon5': '0.132', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.340', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:37,795][52567] Fps is (10 sec: 18021.3, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 647815168. Throughput: 0: 4349.3. Samples: 161957610. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:46:37,795][52567] Avg episode reward: [(0, '75.376')] [2024-08-06 07:46:37,898][52803] DAMAGECOUNT value on done: 840138.0 [2024-08-06 07:46:37,899][52803] Sum rewards: 65.224, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.895', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.074', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.304', 'WEAPON3': '1.600', 'HITCOUNT': '3.250', 'weapon3': '3.384', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '56.000'} [2024-08-06 07:46:38,398][52650] Updated weights for policy 0, policy_version 79081 (0.0011) [2024-08-06 07:46:38,579][52660] DAMAGECOUNT value on done: 902227.0 [2024-08-06 07:46:38,580][52660] Sum rewards: 80.471, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.090', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '64.000'} [2024-08-06 07:46:40,570][52659] DAMAGECOUNT value on done: 899122.0 [2024-08-06 07:46:40,571][52659] Sum rewards: 52.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.078', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon4': '0.144', 'AMMO3': '0.178', 'weapon5': '0.288', 'AMMO4': '0.307', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.050', 'HITCOUNT': '2.520', 'weapon3': '2.842', 'DAMAGECOUNT': '12.807', 'FRAGCOUNT': '43.500'} [2024-08-06 07:46:41,066][52660] DAMAGECOUNT value on done: 914402.0 [2024-08-06 07:46:41,066][52660] Sum rewards: 67.432, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.880', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.148', 'AMMO4': '0.168', 'weapon5': '0.220', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON3': '0.950', 'weapon3': '2.930', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '54.000'} [2024-08-06 07:46:41,134][52803] DAMAGECOUNT value on done: 836483.0 [2024-08-06 07:46:41,135][52803] Sum rewards: 77.263, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.162', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:41,841][52647] DAMAGECOUNT value on done: 958521.0 [2024-08-06 07:46:41,841][52647] Sum rewards: 70.707, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.488', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.062', 'AMMO3': '0.254', 'weapon2': '0.530', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 647897088. Throughput: 0: 4362.2. Samples: 161983970. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:46:42,794][52567] Avg episode reward: [(0, '74.972')] [2024-08-06 07:46:43,274][52650] Updated weights for policy 0, policy_version 79091 (0.0010) [2024-08-06 07:46:43,509][52659] DAMAGECOUNT value on done: 899121.0 [2024-08-06 07:46:43,509][52659] Sum rewards: 78.458, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.346', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '64.000'} [2024-08-06 07:46:44,374][52803] DAMAGECOUNT value on done: 837801.0 [2024-08-06 07:46:44,374][52803] Sum rewards: 82.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.742', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.452', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '68.000'} [2024-08-06 07:46:44,475][52660] DAMAGECOUNT value on done: 892692.0 [2024-08-06 07:46:44,475][52660] Sum rewards: 75.344, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.356', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.208', 'weapon5': '0.234', 'AMMO3': '0.238', 'AMMO4': '0.267', 'weapon2': '0.282', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.978', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '63.000'} [2024-08-06 07:46:44,652][52647] DAMAGECOUNT value on done: 946060.0 [2024-08-06 07:46:44,653][52647] Sum rewards: 80.602, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.014', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.088', 'weapon4': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 07:46:46,645][52659] DAMAGECOUNT value on done: 908625.0 [2024-08-06 07:46:46,646][52659] Sum rewards: 65.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.076', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.140', 'weapon5': '0.182', 'AMMO3': '0.214', 'AMMO4': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '2.950', 'weapon3': '3.042', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '52.000'} [2024-08-06 07:46:46,785][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:46,944][52647] DAMAGECOUNT value on done: 952926.0 [2024-08-06 07:46:46,945][52647] Sum rewards: 76.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.554', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.078', 'weapon5': '0.084', 'AMMO3': '0.168', 'AMMO4': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '64.000'} [2024-08-06 07:46:47,469][52803] DAMAGECOUNT value on done: 831917.0 [2024-08-06 07:46:47,469][52803] Sum rewards: 61.410, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.455', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.064', 'AMMO4': '0.083', 'AMMO3': '0.236', 'weapon2': '0.436', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.340', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 07:46:47,707][52650] Updated weights for policy 0, policy_version 79101 (0.0026) [2024-08-06 07:46:47,756][52660] DAMAGECOUNT value on done: 900320.0 [2024-08-06 07:46:47,756][52660] Sum rewards: 74.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.067', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.110', 'AMMO3': '0.182', 'AMMO4': '0.238', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '2.948', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:47,794][52567] Fps is (10 sec: 18023.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 647995392. Throughput: 0: 4359.8. Samples: 161997090. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:46:47,794][52567] Avg episode reward: [(0, '74.807')] [2024-08-06 07:46:49,751][52659] DAMAGECOUNT value on done: 892900.0 [2024-08-06 07:46:49,751][52659] Sum rewards: 73.226, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '59.000'} [2024-08-06 07:46:49,926][52647] DAMAGECOUNT value on done: 951819.0 [2024-08-06 07:46:49,926][52647] Sum rewards: 69.118, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.540', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.133', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.326', 'weapon2': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.876', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '55.000'} [2024-08-06 07:46:50,531][52803] DAMAGECOUNT value on done: 831976.0 [2024-08-06 07:46:50,533][52803] Sum rewards: 64.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.128', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.112', 'AMMO4': '0.133', 'weapon4': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.274', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '56.000'} [2024-08-06 07:46:51,009][52660] DAMAGECOUNT value on done: 896884.0 [2024-08-06 07:46:51,009][52660] Sum rewards: 69.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.571', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.072', 'AMMO4': '0.148', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.100', 'HITCOUNT': '3.310', 'weapon3': '3.354', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '57.000'} [2024-08-06 07:46:51,839][52658] DAMAGECOUNT value on done: 901134.0 [2024-08-06 07:46:51,846][52658] Sum rewards: 70.573, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.016', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.154', 'weapon5': '0.172', 'AMMO4': '0.216', 'AMMO3': '0.261', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.600', 'weapon3': '2.858', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:52,473][52650] Updated weights for policy 0, policy_version 79111 (0.0013) [2024-08-06 07:46:52,770][52659] DAMAGECOUNT value on done: 905057.0 [2024-08-06 07:46:52,771][52659] Sum rewards: 83.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon4': '0.030', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '67.000'} [2024-08-06 07:46:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 648077312. Throughput: 0: 4355.5. Samples: 162023160. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:46:52,794][52567] Avg episode reward: [(0, '74.349')] [2024-08-06 07:46:53,088][52647] DAMAGECOUNT value on done: 961175.0 [2024-08-06 07:46:53,088][52647] Sum rewards: 80.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.368', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.054', 'weapon5': '0.176', 'AMMO4': '0.219', 'AMMO3': '0.265', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.198', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '70.000'} [2024-08-06 07:46:53,503][52820] DAMAGECOUNT value on done: 831433.0 [2024-08-06 07:46:53,504][52820] Sum rewards: 73.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.794', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'weapon4': '0.196', 'AMMO3': '0.224', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 07:46:53,616][52803] DAMAGECOUNT value on done: 840036.0 [2024-08-06 07:46:53,618][52803] Sum rewards: 70.703, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.666', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.330', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '60.500'} [2024-08-06 07:46:53,961][52660] DAMAGECOUNT value on done: 888366.0 [2024-08-06 07:46:53,961][52660] Sum rewards: 74.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.178', 'AMMO4': '0.193', 'AMMO3': '0.196', 'weapon4': '0.200', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 07:46:55,067][52658] DAMAGECOUNT value on done: 904923.0 [2024-08-06 07:46:55,067][52658] Sum rewards: 77.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.913', 'AMMO5': '0.018', 'AMMO2': '0.042', 'weapon4': '0.144', 'weapon5': '0.190', 'AMMO4': '0.211', 'AMMO3': '0.245', 'weapon2': '0.260', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '65.000'} [2024-08-06 07:46:55,192][52659] DAMAGECOUNT value on done: 897874.0 [2024-08-06 07:46:55,196][52659] Sum rewards: 67.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.894', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'weapon2': '0.546', 'WEAPON3': '1.650', 'weapon3': '3.018', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '58.000'} [2024-08-06 07:46:55,751][52647] DAMAGECOUNT value on done: 956461.0 [2024-08-06 07:46:55,754][52647] Sum rewards: 65.565, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.625', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.052', 'weapon4': '0.058', 'AMMO4': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.288', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.386', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '57.000'} [2024-08-06 07:46:56,623][52820] DAMAGECOUNT value on done: 832597.0 [2024-08-06 07:46:56,626][52820] Sum rewards: 75.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.518', 'AMMO5': '0.011', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.150', 'weapon5': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '62.000'} [2024-08-06 07:46:56,685][52803] DAMAGECOUNT value on done: 832470.0 [2024-08-06 07:46:56,687][52803] Sum rewards: 56.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.419', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO4': '0.120', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.360', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '47.000'} [2024-08-06 07:46:57,006][52660] DAMAGECOUNT value on done: 887737.0 [2024-08-06 07:46:57,014][52660] Sum rewards: 72.567, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.066', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.022', 'weapon5': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon2': '0.938', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '58.500'} [2024-08-06 07:46:57,397][52650] Updated weights for policy 0, policy_version 79121 (0.0012) [2024-08-06 07:46:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 648159232. Throughput: 0: 4360.5. Samples: 162049550. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:46:57,794][52567] Avg episode reward: [(0, '74.172')] [2024-08-06 07:46:58,102][52658] DAMAGECOUNT value on done: 904558.0 [2024-08-06 07:46:58,102][52658] Sum rewards: 57.477, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.405', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.082', 'AMMO4': '0.204', 'weapon5': '0.224', 'AMMO3': '0.230', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.854', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '47.000'} [2024-08-06 07:46:58,534][52647] DAMAGECOUNT value on done: 960299.0 [2024-08-06 07:46:58,535][52647] Sum rewards: 85.193, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.226', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.210', 'weapon2': '0.558', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '70.000'} [2024-08-06 07:46:58,782][52669] DAMAGECOUNT value on done: 899736.0 [2024-08-06 07:46:58,782][52669] Sum rewards: 75.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.106', 'AMMO4': '0.161', 'AMMO3': '0.168', 'weapon5': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.740', 'WEAPON3': '1.050', 'weapon3': '2.712', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '61.000'} [2024-08-06 07:46:59,116][52795] Large shaping reward -2.548 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('weapon5', 0.002)] [2024-08-06 07:46:59,775][52820] DAMAGECOUNT value on done: 833978.0 [2024-08-06 07:46:59,777][52820] Sum rewards: 94.371, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.074', 'weapon5': '0.140', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '22.785', 'FRAGCOUNT': '76.000'} [2024-08-06 07:46:59,778][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:46:59,931][52803] DAMAGECOUNT value on done: 847742.0 [2024-08-06 07:46:59,931][52803] Sum rewards: 77.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.065', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.070', 'weapon5': '0.114', 'AMMO4': '0.125', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON3': '1.100', 'weapon3': '3.334', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:01,146][52658] DAMAGECOUNT value on done: 903957.0 [2024-08-06 07:47:01,146][52658] Sum rewards: 87.259, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.578', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.064', 'AMMO4': '0.081', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '69.000'} [2024-08-06 07:47:01,650][52647] DAMAGECOUNT value on done: 935220.0 [2024-08-06 07:47:01,650][52647] Sum rewards: 73.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.106', 'weapon5': '0.218', 'AMMO4': '0.278', 'AMMO3': '0.285', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '3.026', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:01,705][52650] Updated weights for policy 0, policy_version 79131 (0.0025) [2024-08-06 07:47:01,944][52669] DAMAGECOUNT value on done: 895451.0 [2024-08-06 07:47:01,945][52669] Sum rewards: 86.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.981', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.188', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.316', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '71.000'} [2024-08-06 07:47:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 648249344. Throughput: 0: 4362.4. Samples: 162062580. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:47:02,794][52567] Avg episode reward: [(0, '74.173')] [2024-08-06 07:47:02,933][52803] DAMAGECOUNT value on done: 840669.0 [2024-08-06 07:47:02,934][52803] Sum rewards: 74.624, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'weapon4': '0.026', 'AMMO2': '0.039', 'weapon5': '0.130', 'AMMO3': '0.174', 'AMMO4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.314', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:02,986][52820] DAMAGECOUNT value on done: 821265.0 [2024-08-06 07:47:02,989][52820] Sum rewards: 68.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.826', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.070', 'AMMO4': '0.182', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon5': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '2.900', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:04,046][52658] DAMAGECOUNT value on done: 897621.0 [2024-08-06 07:47:04,047][52658] Sum rewards: 74.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.824', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.130', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:04,339][52647] DAMAGECOUNT value on done: 950791.0 [2024-08-06 07:47:04,339][52647] Sum rewards: 65.573, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.327', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.132', 'AMMO4': '0.192', 'weapon5': '0.208', 'AMMO3': '0.232', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:04,937][52669] DAMAGECOUNT value on done: 907588.0 [2024-08-06 07:47:04,938][52669] Sum rewards: 82.111, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.465', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon4': '0.042', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.166', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:05,005][52671] DAMAGECOUNT value on done: 905401.0 [2024-08-06 07:47:05,006][52671] Sum rewards: 60.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.568', 'WEAPON3': '1.300', 'HITCOUNT': '2.950', 'weapon3': '3.038', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '50.000'} [2024-08-06 07:47:05,957][52803] DAMAGECOUNT value on done: 833176.0 [2024-08-06 07:47:05,958][52803] Sum rewards: 74.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.332', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.096', 'weapon5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.200', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.344', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:06,161][52820] DAMAGECOUNT value on done: 833782.0 [2024-08-06 07:47:06,161][52820] Sum rewards: 69.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.185', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.123', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:06,556][52647] DAMAGECOUNT value on done: 950598.0 [2024-08-06 07:47:06,556][52647] Sum rewards: 81.322, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.055', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.252', 'weapon2': '0.280', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '69.000'} [2024-08-06 07:47:06,699][52669] Large shaping reward 2.523 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.585, 195.0), ('HEALTH', -0.084, -28.0), ('weapon5', 0.002)] [2024-08-06 07:47:06,702][52650] Updated weights for policy 0, policy_version 79141 (0.0048) [2024-08-06 07:47:07,001][52658] DAMAGECOUNT value on done: 891417.0 [2024-08-06 07:47:07,003][52658] Sum rewards: 77.127, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.920', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.088', 'weapon5': '0.132', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:07,771][52671] DAMAGECOUNT value on done: 911028.0 [2024-08-06 07:47:07,771][52671] Sum rewards: 80.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.525', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.020', 'weapon5': '0.038', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.460', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:07,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 648339456. Throughput: 0: 4350.2. Samples: 162088370. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:47:07,802][52567] Avg episode reward: [(0, '73.697')] [2024-08-06 07:47:07,926][52669] DAMAGECOUNT value on done: 900066.0 [2024-08-06 07:47:07,926][52669] Sum rewards: 78.544, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon2': '0.864', 'WEAPON3': '1.050', 'weapon3': '2.968', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:09,019][52803] DAMAGECOUNT value on done: 849864.0 [2024-08-06 07:47:09,022][52803] Sum rewards: 64.610, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.066', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '56.000'} [2024-08-06 07:47:09,354][52820] DAMAGECOUNT value on done: 821507.0 [2024-08-06 07:47:09,357][52820] Sum rewards: 68.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.070', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.076', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '3.126', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:09,627][52647] DAMAGECOUNT value on done: 947476.0 [2024-08-06 07:47:09,628][52647] Sum rewards: 74.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.018', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.174', 'weapon5': '0.198', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:09,855][52658] DAMAGECOUNT value on done: 905686.0 [2024-08-06 07:47:09,857][52658] Sum rewards: 77.170, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.335', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon4': '0.120', 'weapon5': '0.134', 'weapon2': '0.256', 'AMMO3': '0.280', 'AMMO4': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.230', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:10,419][52671] DAMAGECOUNT value on done: 907811.0 [2024-08-06 07:47:10,419][52671] Sum rewards: 68.315, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.151', 'weapon4': '0.184', 'HEALTH': '0.240', 'weapon2': '0.438', 'WEAPON3': '0.850', 'weapon3': '3.038', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '51.000'} [2024-08-06 07:47:10,586][52795] DAMAGECOUNT value on done: 832485.0 [2024-08-06 07:47:10,586][52795] Sum rewards: 61.631, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.915', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.098', 'weapon4': '0.160', 'AMMO4': '0.180', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.014', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '53.000'} [2024-08-06 07:47:10,619][52669] DAMAGECOUNT value on done: 909881.0 [2024-08-06 07:47:10,620][52669] Sum rewards: 79.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.038', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.191', 'AMMO3': '0.239', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:11,509][52650] Updated weights for policy 0, policy_version 79151 (0.0021) [2024-08-06 07:47:12,043][52803] DAMAGECOUNT value on done: 833094.0 [2024-08-06 07:47:12,043][52803] Sum rewards: 70.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.584', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.170', 'AMMO4': '0.194', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.144', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:12,552][52820] DAMAGECOUNT value on done: 828091.0 [2024-08-06 07:47:12,553][52820] Sum rewards: 65.147, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.467', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.132', 'weapon5': '0.136', 'AMMO3': '0.207', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.058', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '54.000'} [2024-08-06 07:47:12,569][52663] DAMAGECOUNT value on done: 918514.0 [2024-08-06 07:47:12,570][52663] Sum rewards: 68.919, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.066', 'weapon5': '0.168', 'weapon2': '0.250', 'AMMO4': '0.251', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:12,711][52794] DAMAGECOUNT value on done: 892577.0 [2024-08-06 07:47:12,711][52794] Sum rewards: 78.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.460', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.412', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:12,761][52647] DAMAGECOUNT value on done: 938675.0 [2024-08-06 07:47:12,761][52647] Sum rewards: 77.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.167', 'weapon5': '0.220', 'weapon4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.050', 'weapon3': '2.854', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:12,793][52658] DAMAGECOUNT value on done: 893814.0 [2024-08-06 07:47:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 648429568. Throughput: 0: 4352.4. Samples: 162114550. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:47:12,800][52567] Avg episode reward: [(0, '73.397')] [2024-08-06 07:47:12,800][52658] Sum rewards: 68.298, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.984', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.092', 'weapon5': '0.124', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.266', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '55.000'} [2024-08-06 07:47:13,583][52671] DAMAGECOUNT value on done: 909249.0 [2024-08-06 07:47:13,583][52671] Sum rewards: 92.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.220', 'weapon4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '21.276', 'FRAGCOUNT': '75.000'} [2024-08-06 07:47:13,740][52795] DAMAGECOUNT value on done: 819946.0 [2024-08-06 07:47:13,741][52795] Sum rewards: 70.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.380', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.230', 'weapon2': '0.568', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '59.000'} [2024-08-06 07:47:13,775][52669] DAMAGECOUNT value on done: 906597.0 [2024-08-06 07:47:13,776][52669] Sum rewards: 75.267, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.127', 'weapon5': '0.232', 'weapon4': '0.248', 'AMMO4': '0.255', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.800', 'weapon3': '2.866', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:15,208][52803] DAMAGECOUNT value on done: 841533.0 [2024-08-06 07:47:15,209][52803] Sum rewards: 82.050, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.072', 'weapon4': '0.074', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.264', 'WEAPON3': '1.400', 'weapon3': '3.420', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:15,257][52663] DAMAGECOUNT value on done: 902207.0 [2024-08-06 07:47:15,259][52663] Sum rewards: 80.498, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.778', 'AMMO5': '0.006', 'weapon4': '0.020', 'AMMO2': '0.021', 'weapon5': '0.082', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.420', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:15,465][52647] DAMAGECOUNT value on done: 952901.0 [2024-08-06 07:47:15,465][52647] Sum rewards: 72.540, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.057', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.716', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:15,544][52794] DAMAGECOUNT value on done: 905059.0 [2024-08-06 07:47:15,545][52794] Sum rewards: 76.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.611', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.118', 'weapon4': '0.122', 'AMMO3': '0.207', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:15,679][52820] DAMAGECOUNT value on done: 832906.0 [2024-08-06 07:47:15,679][52820] Sum rewards: 87.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.232', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.072', 'weapon5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '71.000'} [2024-08-06 07:47:15,820][52650] Updated weights for policy 0, policy_version 79161 (0.0026) [2024-08-06 07:47:16,048][52658] DAMAGECOUNT value on done: 921866.0 [2024-08-06 07:47:16,049][52658] Sum rewards: 86.222, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.460', 'AMMO5': '0.003', 'weapon5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.018', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '70.000'} [2024-08-06 07:47:16,199][52669] DAMAGECOUNT value on done: 905181.0 [2024-08-06 07:47:16,200][52669] Sum rewards: 80.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.044', 'weapon4': '0.090', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.476', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:16,240][52671] DAMAGECOUNT value on done: 915531.0 [2024-08-06 07:47:16,242][52671] Sum rewards: 79.019, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.610', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.040', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.306', 'WEAPON3': '1.900', 'weapon3': '3.514', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.174', 'FRAGCOUNT': '68.500'} [2024-08-06 07:47:17,110][52795] DAMAGECOUNT value on done: 826040.0 [2024-08-06 07:47:17,110][52795] Sum rewards: 74.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.402', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.112', 'weapon5': '0.142', 'AMMO4': '0.182', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.106', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:17,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 648511488. Throughput: 0: 4362.7. Samples: 162127760. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:47:17,794][52567] Avg episode reward: [(0, '74.043')] [2024-08-06 07:47:17,944][52663] DAMAGECOUNT value on done: 895587.0 [2024-08-06 07:47:17,945][52663] Sum rewards: 78.423, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.426', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.120', 'AMMO3': '0.168', 'weapon5': '0.170', 'AMMO4': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:18,188][52647] DAMAGECOUNT value on done: 942334.0 [2024-08-06 07:47:18,189][52647] Sum rewards: 75.047, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.133', 'AMMO5': '0.012', 'AMMO2': '0.061', 'weapon4': '0.112', 'weapon5': '0.140', 'weapon2': '0.276', 'AMMO3': '0.289', 'AMMO4': '0.307', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.182', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:18,346][52803] DAMAGECOUNT value on done: 843670.0 [2024-08-06 07:47:18,346][52803] Sum rewards: 66.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.167', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.088', 'weapon4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '55.000'} [2024-08-06 07:47:18,398][52794] DAMAGECOUNT value on done: 907413.0 [2024-08-06 07:47:18,399][52794] Sum rewards: 73.774, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.085', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:18,875][52669] DAMAGECOUNT value on done: 901620.0 [2024-08-06 07:47:18,876][52669] Sum rewards: 74.879, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.341', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.452', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:19,011][52820] DAMAGECOUNT value on done: 837080.0 [2024-08-06 07:47:19,012][52820] Sum rewards: 78.211, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.490', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.094', 'AMMO4': '0.185', 'weapon5': '0.266', 'AMMO3': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.650', 'weapon3': '2.800', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '65.000'} [2024-08-06 07:47:19,195][52671] DAMAGECOUNT value on done: 903124.0 [2024-08-06 07:47:19,195][52671] Sum rewards: 76.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.681', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.170', 'AMMO4': '0.175', 'AMMO3': '0.260', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '64.000'} [2024-08-06 07:47:19,209][52658] DAMAGECOUNT value on done: 905665.0 [2024-08-06 07:47:19,210][52658] Sum rewards: 70.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.180', 'weapon4': '0.208', 'AMMO3': '0.214', 'AMMO4': '0.221', 'weapon2': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:20,257][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:47:20,338][52795] DAMAGECOUNT value on done: 838092.0 [2024-08-06 07:47:20,340][52795] Sum rewards: 82.229, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.404', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon4': '0.284', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '69.000'} [2024-08-06 07:47:20,834][52663] DAMAGECOUNT value on done: 901991.0 [2024-08-06 07:47:20,835][52663] Sum rewards: 76.073, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.668', 'AMMO5': '0.030', 'AMMO2': '0.085', 'AMMO3': '0.227', 'weapon4': '0.262', 'weapon5': '0.326', 'weapon2': '0.374', 'AMMO4': '0.423', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.400', 'weapon3': '2.640', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '21.384', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:20,949][52650] Updated weights for policy 0, policy_version 79171 (0.0019) [2024-08-06 07:47:21,258][52647] DAMAGECOUNT value on done: 949631.0 [2024-08-06 07:47:21,258][52647] Sum rewards: 67.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.945', 'AMMO5': '0.021', 'AMMO2': '0.040', 'weapon4': '0.120', 'AMMO3': '0.153', 'AMMO4': '0.202', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '0.950', 'weapon3': '2.982', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '53.500'} [2024-08-06 07:47:21,487][52664] DAMAGECOUNT value on done: 931834.0 [2024-08-06 07:47:21,487][52664] Sum rewards: 67.616, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.124', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '59.000'} [2024-08-06 07:47:21,521][52803] DAMAGECOUNT value on done: 849517.0 [2024-08-06 07:47:21,524][52803] Sum rewards: 77.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.875', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.120', 'AMMO4': '0.173', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '64.000'} [2024-08-06 07:47:21,571][52794] DAMAGECOUNT value on done: 897467.0 [2024-08-06 07:47:21,571][52794] Sum rewards: 76.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.220', 'AMMO5': '0.012', 'AMMO2': '0.059', 'AMMO3': '0.192', 'weapon5': '0.200', 'weapon4': '0.290', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:22,001][52658] DAMAGECOUNT value on done: 914225.0 [2024-08-06 07:47:22,002][52658] Sum rewards: 77.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.770', 'AMMO5': '0.025', 'AMMO2': '0.062', 'AMMO3': '0.175', 'weapon2': '0.286', 'AMMO4': '0.310', 'weapon5': '0.314', 'weapon4': '0.570', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.532', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:22,090][52669] DAMAGECOUNT value on done: 915347.0 [2024-08-06 07:47:22,090][52669] Sum rewards: 75.601, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.974', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.080', 'AMMO3': '0.128', 'weapon2': '0.222', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '0.850', 'weapon3': '3.118', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:22,161][52671] DAMAGECOUNT value on done: 908448.0 [2024-08-06 07:47:22,163][52671] Sum rewards: 74.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.667', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.132', 'AMMO4': '0.173', 'weapon5': '0.194', 'AMMO3': '0.273', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.046', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:22,255][52820] DAMAGECOUNT value on done: 843104.0 [2024-08-06 07:47:22,255][52820] Sum rewards: 66.417, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.088', 'weapon5': '0.092', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:22,516][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:47:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 648601600. Throughput: 0: 4356.9. Samples: 162153670. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:47:22,794][52567] Avg episode reward: [(0, '74.063')] [2024-08-06 07:47:23,526][52795] DAMAGECOUNT value on done: 823333.0 [2024-08-06 07:47:23,526][52795] Sum rewards: 83.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.813', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.178', 'weapon2': '0.190', 'WEAPON3': '1.150', 'weapon3': '3.370', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:23,689][52663] DAMAGECOUNT value on done: 902581.0 [2024-08-06 07:47:23,689][52663] Sum rewards: 72.990, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.464', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.110', 'weapon5': '0.154', 'AMMO3': '0.158', 'AMMO4': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.540', 'WEAPON3': '0.950', 'HITCOUNT': '2.860', 'weapon3': '2.946', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:23,932][52647] DAMAGECOUNT value on done: 952542.0 [2024-08-06 07:47:23,934][52647] Sum rewards: 69.187, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.248', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.096', 'weapon5': '0.220', 'AMMO4': '0.267', 'AMMO3': '0.292', 'weapon2': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.800', 'weapon3': '3.028', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:24,200][52664] DAMAGECOUNT value on done: 935517.0 [2024-08-06 07:47:24,200][52664] Sum rewards: 72.013, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.856', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.177', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:24,542][52794] DAMAGECOUNT value on done: 890802.0 [2024-08-06 07:47:24,543][52794] Sum rewards: 57.954, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.538', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.168', 'AMMO3': '0.174', 'WEAPON3': '1.100', 'HITCOUNT': '2.690', 'weapon3': '3.638', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '47.000'} [2024-08-06 07:47:24,590][52658] DAMAGECOUNT value on done: 901429.0 [2024-08-06 07:47:24,590][52658] Sum rewards: 65.069, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.400', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon5': '0.188', 'AMMO3': '0.239', 'weapon4': '0.304', 'weapon2': '0.310', 'AMMO4': '0.321', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.966', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:24,705][52803] DAMAGECOUNT value on done: 847059.0 [2024-08-06 07:47:24,706][52803] Sum rewards: 72.448, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.356', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:25,110][52669] DAMAGECOUNT value on done: 903993.0 [2024-08-06 07:47:25,110][52669] Sum rewards: 84.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.140', 'weapon5': '0.150', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '71.000'} [2024-08-06 07:47:25,305][52671] DAMAGECOUNT value on done: 908592.0 [2024-08-06 07:47:25,307][52671] Sum rewards: 79.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.102', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:25,387][52820] DAMAGECOUNT value on done: 825597.0 [2024-08-06 07:47:25,388][52820] Sum rewards: 73.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.594', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.090', 'AMMO4': '0.120', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:25,654][52650] Updated weights for policy 0, policy_version 79181 (0.0030) [2024-08-06 07:47:26,221][52647] DAMAGECOUNT value on done: 938273.0 [2024-08-06 07:47:26,222][52647] Sum rewards: 69.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.763', 'AMMO5': '0.012', 'weapon4': '0.028', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:26,621][52664] DAMAGECOUNT value on done: 938477.0 [2024-08-06 07:47:26,621][52664] Sum rewards: 72.625, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.795', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO4': '0.204', 'weapon4': '0.204', 'AMMO3': '0.235', 'weapon5': '0.236', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.842', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '59.000'} [2024-08-06 07:47:26,775][52663] DAMAGECOUNT value on done: 908772.0 [2024-08-06 07:47:26,776][52663] Sum rewards: 79.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.109', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.206', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.478', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '65.000'} [2024-08-06 07:47:26,791][52795] DAMAGECOUNT value on done: 829690.0 [2024-08-06 07:47:26,792][52795] Sum rewards: 73.436, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.340', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.074', 'weapon5': '0.154', 'AMMO4': '0.222', 'AMMO3': '0.241', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '63.500'} [2024-08-06 07:47:27,061][52658] DAMAGECOUNT value on done: 911048.0 [2024-08-06 07:47:27,065][52658] Sum rewards: 72.573, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.366', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon4': '0.078', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.158', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:27,113][52794] DAMAGECOUNT value on done: 898210.0 [2024-08-06 07:47:27,119][52794] Sum rewards: 71.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.456', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.102', 'AMMO4': '0.140', 'weapon2': '0.226', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:27,754][52803] DAMAGECOUNT value on done: 843684.0 [2024-08-06 07:47:27,756][52803] Sum rewards: 96.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.657', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.058', 'AMMO4': '0.064', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.388', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '22.398', 'FRAGCOUNT': '76.000'} [2024-08-06 07:47:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.9). Total num frames: 648691712. Throughput: 0: 4356.4. Samples: 162180010. Policy #0 lag: (min: 0.0, avg: 3.9, max: 9.0) [2024-08-06 07:47:27,794][52567] Avg episode reward: [(0, '74.080')] [2024-08-06 07:47:27,869][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:47:27,937][52671] DAMAGECOUNT value on done: 893838.0 [2024-08-06 07:47:27,940][52671] Sum rewards: 81.959, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.286', 'WEAPON3': '1.350', 'weapon3': '3.514', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:28,050][52669] DAMAGECOUNT value on done: 911979.0 [2024-08-06 07:47:28,050][52669] Sum rewards: 86.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.058', 'weapon5': '0.158', 'AMMO3': '0.199', 'AMMO4': '0.230', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '70.000'} [2024-08-06 07:47:28,447][52820] DAMAGECOUNT value on done: 836794.0 [2024-08-06 07:47:28,450][52820] Sum rewards: 75.533, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.108', 'AMMO4': '0.121', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:28,747][52647] DAMAGECOUNT value on done: 946360.0 [2024-08-06 07:47:28,748][52647] Sum rewards: 64.114, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.246', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.092', 'weapon5': '0.180', 'AMMO3': '0.216', 'AMMO4': '0.231', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '54.000'} [2024-08-06 07:47:28,833][52659] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:47:29,366][52664] DAMAGECOUNT value on done: 927971.0 [2024-08-06 07:47:29,366][52664] Sum rewards: 67.854, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.416', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.170', 'AMMO4': '0.176', 'weapon2': '0.228', 'AMMO3': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.218', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '59.000'} [2024-08-06 07:47:29,738][52663] DAMAGECOUNT value on done: 901232.0 [2024-08-06 07:47:29,739][52663] Sum rewards: 73.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.801', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.080', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.386', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:29,855][52650] Updated weights for policy 0, policy_version 79191 (0.0012) [2024-08-06 07:47:29,903][52795] DAMAGECOUNT value on done: 838293.0 [2024-08-06 07:47:29,905][52795] Sum rewards: 64.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.088', 'AMMO2': '0.005', 'AMMO4': '0.023', 'weapon4': '0.030', 'WEAPON4': '0.100', 'AMMO3': '0.233', 'weapon2': '0.738', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '56.000'} [2024-08-06 07:47:30,110][52658] DAMAGECOUNT value on done: 899095.0 [2024-08-06 07:47:30,112][52658] Sum rewards: 61.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.503', 'AMMO5': '0.016', 'ARMOR': '0.016', 'AMMO2': '0.063', 'weapon4': '0.138', 'weapon5': '0.194', 'AMMO3': '0.254', 'AMMO4': '0.315', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '53.000'} [2024-08-06 07:47:30,396][52794] DAMAGECOUNT value on done: 901128.0 [2024-08-06 07:47:30,398][52794] Sum rewards: 75.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.592', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.180', 'AMMO3': '0.196', 'weapon4': '0.218', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.140', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:30,578][52669] DAMAGECOUNT value on done: 911423.0 [2024-08-06 07:47:30,578][52669] Sum rewards: 75.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.928', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.102', 'weapon5': '0.122', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.550', 'weapon3': '3.028', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '64.000'} [2024-08-06 07:47:30,920][52671] DAMAGECOUNT value on done: 907878.0 [2024-08-06 07:47:30,920][52671] Sum rewards: 68.698, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.038', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.118', 'AMMO3': '0.186', 'weapon4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.268', 'DAMAGECOUNT': '16.509', 'FRAGCOUNT': '55.000'} [2024-08-06 07:47:31,791][52820] DAMAGECOUNT value on done: 848508.0 [2024-08-06 07:47:31,795][52820] Sum rewards: 81.170, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.062', 'weapon5': '0.110', 'AMMO4': '0.113', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon2': '0.514', 'WEAPON3': '1.650', 'weapon3': '3.006', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.562', 'FRAGCOUNT': '70.000'} [2024-08-06 07:47:31,860][52663] DAMAGECOUNT value on done: 888467.0 [2024-08-06 07:47:31,861][52663] Sum rewards: 74.500, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.976', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.081', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '61.500'} [2024-08-06 07:47:31,907][52647] DAMAGECOUNT value on done: 936942.0 [2024-08-06 07:47:31,907][52647] Sum rewards: 79.046, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.036', 'AMMO4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:32,415][52664] DAMAGECOUNT value on done: 941706.0 [2024-08-06 07:47:32,415][52664] Sum rewards: 75.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.661', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.292', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:32,528][52811] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:47:32,797][52567] Fps is (10 sec: 18017.8, 60 sec: 17612.1, 300 sec: 17494.6). Total num frames: 648781824. Throughput: 0: 4356.6. Samples: 162193150. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:47:32,797][52567] Avg episode reward: [(0, '74.446')] [2024-08-06 07:47:32,990][52658] DAMAGECOUNT value on done: 906898.0 [2024-08-06 07:47:32,992][52658] Sum rewards: 65.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.138', 'weapon5': '0.162', 'AMMO4': '0.173', 'AMMO3': '0.194', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.244', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '54.000'} [2024-08-06 07:47:33,020][52795] DAMAGECOUNT value on done: 830317.0 [2024-08-06 07:47:33,022][52795] Sum rewards: 61.614, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.080', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.090', 'AMMO3': '0.162', 'weapon5': '0.186', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon2': '1.132', 'weapon3': '2.400', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '48.000'} [2024-08-06 07:47:33,078][52669] DAMAGECOUNT value on done: 899007.0 [2024-08-06 07:47:33,079][52669] Sum rewards: 89.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.414', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.192', 'AMMO3': '0.231', 'weapon2': '0.254', 'weapon4': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '22.707', 'FRAGCOUNT': '73.000'} [2024-08-06 07:47:33,337][52794] DAMAGECOUNT value on done: 888735.0 [2024-08-06 07:47:33,337][52794] Sum rewards: 74.507, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.994', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.196', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.418', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:34,044][52671] DAMAGECOUNT value on done: 906691.0 [2024-08-06 07:47:34,045][52671] Sum rewards: 71.663, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.272', 'WEAPON3': '1.600', 'weapon3': '3.446', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:34,343][52647] DAMAGECOUNT value on done: 940847.0 [2024-08-06 07:47:34,343][52647] Sum rewards: 70.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.112', 'AMMO4': '0.168', 'weapon5': '0.174', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:34,953][52663] DAMAGECOUNT value on done: 897872.0 [2024-08-06 07:47:34,954][52663] Sum rewards: 80.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.655', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.062', 'weapon5': '0.202', 'AMMO3': '0.205', 'weapon2': '0.280', 'AMMO4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:35,031][52650] Updated weights for policy 0, policy_version 79201 (0.0046) [2024-08-06 07:47:35,091][52664] DAMAGECOUNT value on done: 938721.0 [2024-08-06 07:47:35,091][52664] Sum rewards: 88.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.144', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.125', 'weapon2': '0.136', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.466', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.796', 'FRAGCOUNT': '72.000'} [2024-08-06 07:47:35,128][52820] DAMAGECOUNT value on done: 837845.0 [2024-08-06 07:47:35,129][52820] Sum rewards: 82.418, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.385', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.100', 'weapon5': '0.130', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.306', 'WEAPON3': '1.850', 'weapon3': '3.338', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.940', 'FRAGCOUNT': '71.000'} [2024-08-06 07:47:35,625][52658] DAMAGECOUNT value on done: 889441.0 [2024-08-06 07:47:35,627][52658] Sum rewards: 81.957, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.084', 'weapon4': '0.152', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:36,128][52669] DAMAGECOUNT value on done: 898416.0 [2024-08-06 07:47:36,129][52669] Sum rewards: 73.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.299', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.195', 'AMMO3': '0.212', 'weapon5': '0.240', 'weapon4': '0.246', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:36,141][52794] DAMAGECOUNT value on done: 903348.0 [2024-08-06 07:47:36,142][52794] Sum rewards: 79.268, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.200', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.094', 'weapon5': '0.128', 'AMMO4': '0.141', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '65.000'} [2024-08-06 07:47:36,237][52795] DAMAGECOUNT value on done: 835537.0 [2024-08-06 07:47:36,238][52795] Sum rewards: 70.753, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.569', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.076', 'weapon4': '0.120', 'AMMO4': '0.140', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:37,115][52671] DAMAGECOUNT value on done: 903126.0 [2024-08-06 07:47:37,115][52671] Sum rewards: 73.622, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.186', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO4': '0.165', 'weapon2': '0.222', 'weapon4': '0.222', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:37,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 648855552. Throughput: 0: 4359.1. Samples: 162219320. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:47:37,795][52567] Avg episode reward: [(0, '74.587')] [2024-08-06 07:47:38,195][52663] DAMAGECOUNT value on done: 899332.0 [2024-08-06 07:47:38,198][52663] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.002', 'AMMO4': '0.008', 'AMMO3': '0.221', 'weapon2': '0.244', 'HEALTH': '0.536', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.590', 'DAMAGECOUNT': '16.179', 'FRAGCOUNT': '55.000'} [2024-08-06 07:47:38,244][52664] DAMAGECOUNT value on done: 926468.0 [2024-08-06 07:47:38,245][52664] Sum rewards: 61.194, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.262', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon4': '0.108', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.502', 'WEAPON3': '1.250', 'HITCOUNT': '2.900', 'weapon3': '3.038', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '51.000'} [2024-08-06 07:47:38,266][52658] DAMAGECOUNT value on done: 908235.0 [2024-08-06 07:47:38,267][52658] Sum rewards: 73.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.270', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.176', 'weapon5': '0.184', 'AMMO3': '0.214', 'AMMO4': '0.251', 'weapon2': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.048', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:38,444][52820] DAMAGECOUNT value on done: 839370.0 [2024-08-06 07:47:38,446][52820] Sum rewards: 78.628, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.030', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.150', 'AMMO3': '0.229', 'weapon2': '0.270', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:38,594][52794] DAMAGECOUNT value on done: 896375.0 [2024-08-06 07:47:38,595][52794] Sum rewards: 82.303, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.120', 'HEALTH': '0.156', 'AMMO4': '0.160', 'weapon5': '0.204', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:39,371][52795] DAMAGECOUNT value on done: 838296.0 [2024-08-06 07:47:39,372][52795] Sum rewards: 81.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.248', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.090', 'AMMO4': '0.204', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:39,417][52669] DAMAGECOUNT value on done: 905037.0 [2024-08-06 07:47:39,418][52669] Sum rewards: 68.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.717', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.120', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '56.500'} [2024-08-06 07:47:39,824][52650] Updated weights for policy 0, policy_version 79211 (0.0034) [2024-08-06 07:47:40,105][52671] DAMAGECOUNT value on done: 908862.0 [2024-08-06 07:47:40,105][52671] Sum rewards: 72.416, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.475', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.086', 'AMMO4': '0.148', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'WEAPON3': '1.650', 'weapon3': '3.434', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:40,648][52664] DAMAGECOUNT value on done: 927225.0 [2024-08-06 07:47:40,648][52664] Sum rewards: 82.049, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.520', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.112', 'weapon4': '0.122', 'weapon2': '0.178', 'AMMO3': '0.195', 'AMMO4': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.408', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:41,009][52663] DAMAGECOUNT value on done: 907356.0 [2024-08-06 07:47:41,011][52663] Sum rewards: 83.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'weapon5': '0.082', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '69.500'} [2024-08-06 07:47:41,172][52794] DAMAGECOUNT value on done: 891239.0 [2024-08-06 07:47:41,173][52794] Sum rewards: 75.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.490', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.126', 'AMMO4': '0.139', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.500', 'weapon3': '3.232', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:41,376][52658] DAMAGECOUNT value on done: 899506.0 [2024-08-06 07:47:41,376][52658] Sum rewards: 80.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.551', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon4': '0.134', 'weapon5': '0.146', 'AMMO3': '0.209', 'AMMO4': '0.337', 'weapon2': '0.352', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:41,577][52820] DAMAGECOUNT value on done: 833683.0 [2024-08-06 07:47:41,579][52820] Sum rewards: 67.776, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.286', 'AMMO2': '0.006', 'AMMO5': '0.006', 'AMMO4': '0.028', 'weapon4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '58.000'} [2024-08-06 07:47:41,818][52669] DAMAGECOUNT value on done: 927617.0 [2024-08-06 07:47:41,818][52669] Sum rewards: 74.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.072', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '59.000'} [2024-08-06 07:47:42,484][52795] DAMAGECOUNT value on done: 832930.0 [2024-08-06 07:47:42,485][52795] Sum rewards: 80.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.800', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.159', 'weapon4': '0.162', 'AMMO3': '0.171', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '65.000'} [2024-08-06 07:47:42,621][52671] DAMAGECOUNT value on done: 906501.0 [2024-08-06 07:47:42,623][52671] Sum rewards: 84.332, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.505', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.092', 'AMMO3': '0.181', 'weapon5': '0.214', 'AMMO4': '0.246', 'weapon2': '0.282', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:42,794][52567] Fps is (10 sec: 16388.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 648945664. Throughput: 0: 4357.1. Samples: 162245620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:47:42,794][52567] Avg episode reward: [(0, '75.085')] [2024-08-06 07:47:43,453][52664] DAMAGECOUNT value on done: 937197.0 [2024-08-06 07:47:43,461][52664] Sum rewards: 73.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.876', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.026', 'weapon5': '0.038', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:43,583][52663] DAMAGECOUNT value on done: 889591.0 [2024-08-06 07:47:43,586][52663] Sum rewards: 56.753, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.545', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.076', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.694', 'WEAPON3': '1.500', 'weapon3': '3.026', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '48.000'} [2024-08-06 07:47:44,276][52794] DAMAGECOUNT value on done: 904254.0 [2024-08-06 07:47:44,278][52794] Sum rewards: 81.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.478', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'weapon4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.326', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:44,303][52650] Updated weights for policy 0, policy_version 79221 (0.0010) [2024-08-06 07:47:44,554][52658] DAMAGECOUNT value on done: 895739.0 [2024-08-06 07:47:44,555][52658] Sum rewards: 73.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.105', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.116', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.714', 'WEAPON3': '1.400', 'weapon3': '2.946', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:44,659][52820] DAMAGECOUNT value on done: 837574.0 [2024-08-06 07:47:44,660][52820] Sum rewards: 64.006, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.100', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.120', 'weapon4': '0.138', 'AMMO4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.248', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '55.500'} [2024-08-06 07:47:44,682][52669] DAMAGECOUNT value on done: 915007.0 [2024-08-06 07:47:44,684][52669] Sum rewards: 74.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.042', 'weapon4': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:45,634][52795] DAMAGECOUNT value on done: 824570.0 [2024-08-06 07:47:45,635][52795] Sum rewards: 82.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.268', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon2': '0.208', 'AMMO3': '0.210', 'WEAPON3': '1.400', 'weapon3': '3.518', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '69.000'} [2024-08-06 07:47:45,759][52671] DAMAGECOUNT value on done: 892375.0 [2024-08-06 07:47:45,760][52671] Sum rewards: 72.006, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.026', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.082', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.494', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:46,021][52664] DAMAGECOUNT value on done: 934143.0 [2024-08-06 07:47:46,021][52664] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.480', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.092', 'weapon5': '0.098', 'AMMO4': '0.156', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.301', 'weapon2': '0.462', 'WEAPON3': '1.750', 'weapon3': '2.998', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:46,281][52663] DAMAGECOUNT value on done: 887015.0 [2024-08-06 07:47:46,281][52663] Sum rewards: 81.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.248', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.122', 'weapon4': '0.144', 'AMMO4': '0.147', 'AMMO3': '0.166', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '64.000'} [2024-08-06 07:47:47,211][52794] DAMAGECOUNT value on done: 898023.0 [2024-08-06 07:47:47,211][52794] Sum rewards: 72.469, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.064', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO4': '0.199', 'weapon5': '0.214', 'AMMO3': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:47,248][52658] DAMAGECOUNT value on done: 904997.0 [2024-08-06 07:47:47,250][52658] Sum rewards: 74.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.126', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon5': '0.138', 'weapon4': '0.194', 'AMMO3': '0.210', 'weapon2': '0.228', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:47,327][52669] DAMAGECOUNT value on done: 908819.0 [2024-08-06 07:47:47,328][52669] Sum rewards: 76.870, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.151', 'HEALTH': '0.184', 'AMMO3': '0.184', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:47,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 649043968. Throughput: 0: 4359.8. Samples: 162258770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:47:47,794][52820] DAMAGECOUNT value on done: 846005.0 [2024-08-06 07:47:47,794][52567] Avg episode reward: [(0, '74.901')] [2024-08-06 07:47:47,795][52820] Sum rewards: 73.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.074', 'AMMO4': '0.161', 'weapon5': '0.172', 'AMMO3': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:48,297][52671] DAMAGECOUNT value on done: 915309.0 [2024-08-06 07:47:48,297][52671] Sum rewards: 76.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.518', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon2': '0.144', 'weapon5': '0.156', 'AMMO4': '0.168', 'AMMO3': '0.196', 'WEAPON5': '0.400', 'weapon4': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.040', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:48,759][52795] DAMAGECOUNT value on done: 831774.0 [2024-08-06 07:47:48,769][52795] Sum rewards: 75.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.068', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.404', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:48,922][52663] DAMAGECOUNT value on done: 896217.0 [2024-08-06 07:47:48,922][52663] Sum rewards: 76.403, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.942', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.098', 'AMMO4': '0.113', 'weapon4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '65.000'} [2024-08-06 07:47:49,047][52650] Updated weights for policy 0, policy_version 79231 (0.0011) [2024-08-06 07:47:49,196][52664] DAMAGECOUNT value on done: 942646.0 [2024-08-06 07:47:49,198][52664] Sum rewards: 77.052, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.062', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.062', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon4': '0.278', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:49,595][52794] DAMAGECOUNT value on done: 911467.0 [2024-08-06 07:47:49,597][52794] Sum rewards: 79.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.668', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.048', 'weapon4': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:50,179][52669] DAMAGECOUNT value on done: 915409.0 [2024-08-06 07:47:50,184][52669] Sum rewards: 81.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.905', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO3': '0.284', 'weapon2': '0.288', 'WEAPON3': '1.800', 'weapon3': '3.420', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '70.000'} [2024-08-06 07:47:50,624][52670] DAMAGECOUNT value on done: 887844.0 [2024-08-06 07:47:50,624][52670] Sum rewards: 79.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.196', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.120', 'AMMO4': '0.162', 'weapon5': '0.172', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:50,905][52820] DAMAGECOUNT value on done: 843726.0 [2024-08-06 07:47:50,907][52820] Sum rewards: 63.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.612', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.072', 'weapon5': '0.124', 'AMMO4': '0.125', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.250', 'weapon3': '2.996', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '52.000'} [2024-08-06 07:47:51,114][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:47:51,173][52671] DAMAGECOUNT value on done: 914095.0 [2024-08-06 07:47:51,173][52671] Sum rewards: 71.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.152', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.042', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.376', 'WEAPON3': '1.550', 'HITCOUNT': '3.370', 'weapon3': '3.384', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:51,545][52664] DAMAGECOUNT value on done: 940837.0 [2024-08-06 07:47:51,546][52664] Sum rewards: 83.147, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.131', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.136', 'weapon4': '0.142', 'AMMO4': '0.155', 'AMMO3': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.811', 'FRAGCOUNT': '65.000'} [2024-08-06 07:47:51,866][52795] DAMAGECOUNT value on done: 837681.0 [2024-08-06 07:47:51,867][52795] Sum rewards: 70.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.558', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.132', 'weapon4': '0.172', 'weapon2': '0.190', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.282', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '59.000'} [2024-08-06 07:47:52,270][52663] DAMAGECOUNT value on done: 898723.0 [2024-08-06 07:47:52,270][52663] Sum rewards: 71.960, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.224', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.152', 'AMMO3': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:52,360][52794] DAMAGECOUNT value on done: 891850.0 [2024-08-06 07:47:52,360][52794] Sum rewards: 69.932, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.430', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.102', 'AMMO3': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '3.350', 'weapon3': '3.638', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 649125888. Throughput: 0: 4373.8. Samples: 162285190. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:47:52,794][52567] Avg episode reward: [(0, '74.617')] [2024-08-06 07:47:53,481][52650] Updated weights for policy 0, policy_version 79241 (0.0022) [2024-08-06 07:47:53,507][52669] DAMAGECOUNT value on done: 916541.0 [2024-08-06 07:47:53,509][52669] Sum rewards: 79.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.239', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.160', 'AMMO3': '0.218', 'weapon5': '0.260', 'AMMO4': '0.271', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:53,544][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:47:53,639][52670] DAMAGECOUNT value on done: 904654.0 [2024-08-06 07:47:53,640][52670] Sum rewards: 79.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon4': '0.204', 'AMMO3': '0.277', 'weapon2': '0.292', 'weapon5': '0.304', 'AMMO4': '0.343', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.910', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '66.000'} [2024-08-06 07:47:54,003][52820] DAMAGECOUNT value on done: 829315.0 [2024-08-06 07:47:54,003][52820] Sum rewards: 79.371, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.014', 'AMMO2': '0.042', 'HEALTH': '0.066', 'weapon5': '0.092', 'weapon4': '0.158', 'AMMO4': '0.210', 'weapon2': '0.220', 'AMMO3': '0.230', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '65.000'} [2024-08-06 07:47:54,012][52664] DAMAGECOUNT value on done: 938779.0 [2024-08-06 07:47:54,013][52664] Sum rewards: 74.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.102', 'AMMO4': '0.146', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '63.000'} [2024-08-06 07:47:54,370][52671] DAMAGECOUNT value on done: 908141.0 [2024-08-06 07:47:54,371][52671] Sum rewards: 81.242, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.222', 'weapon2': '0.254', 'HEALTH': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.580', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '67.000'} [2024-08-06 07:47:54,768][52794] DAMAGECOUNT value on done: 906680.0 [2024-08-06 07:47:54,770][52794] Sum rewards: 71.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.686', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.730', 'WEAPON3': '1.650', 'weapon3': '2.886', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2024-08-06 07:47:54,896][52795] DAMAGECOUNT value on done: 826466.0 [2024-08-06 07:47:54,896][52795] Sum rewards: 72.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.545', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.118', 'AMMO4': '0.153', 'weapon5': '0.182', 'AMMO3': '0.201', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '61.000'} [2024-08-06 07:47:55,364][52663] DAMAGECOUNT value on done: 903862.0 [2024-08-06 07:47:55,365][52663] Sum rewards: 85.534, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.088', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.207', 'weapon5': '0.230', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.030', 'FRAGCOUNT': '68.000'} [2024-08-06 07:47:56,227][52649] DAMAGECOUNT value on done: 873182.0 [2024-08-06 07:47:56,228][52649] Sum rewards: 84.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.162', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.045', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'AMMO4': '0.225', 'weapon2': '0.266', 'WEAPON3': '1.350', 'weapon3': '3.492', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '70.000'} [2024-08-06 07:47:56,608][52664] DAMAGECOUNT value on done: 951943.0 [2024-08-06 07:47:56,608][52664] Sum rewards: 75.639, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.380', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.160', 'AMMO3': '0.198', 'weapon5': '0.210', 'AMMO4': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:56,624][52670] DAMAGECOUNT value on done: 889388.0 [2024-08-06 07:47:56,624][52670] Sum rewards: 88.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.786', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO3': '0.159', 'weapon5': '0.188', 'AMMO4': '0.192', 'weapon4': '0.270', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.982', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '22.035', 'FRAGCOUNT': '70.000'} [2024-08-06 07:47:57,458][52671] DAMAGECOUNT value on done: 914223.0 [2024-08-06 07:47:57,459][52671] Sum rewards: 76.781, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.120', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.190', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '64.000'} [2024-08-06 07:47:57,617][52794] DAMAGECOUNT value on done: 903940.0 [2024-08-06 07:47:57,618][52794] Sum rewards: 89.727, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.064', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.119', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.306', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.041', 'FRAGCOUNT': '76.000'} [2024-08-06 07:47:57,645][52666] DAMAGECOUNT value on done: 902121.0 [2024-08-06 07:47:57,647][52666] Sum rewards: 85.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.820', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.139', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.338', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '72.000'} [2024-08-06 07:47:57,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 649207808. Throughput: 0: 4375.3. Samples: 162311440. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:47:57,795][52567] Avg episode reward: [(0, '75.483')] [2024-08-06 07:47:57,939][52795] DAMAGECOUNT value on done: 835477.0 [2024-08-06 07:47:57,942][52795] Sum rewards: 56.580, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.796', 'AMMO5': '0.029', 'AMMO2': '0.072', 'AMMO3': '0.177', 'weapon4': '0.250', 'AMMO4': '0.362', 'weapon5': '0.396', 'weapon2': '0.410', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.570', 'HITCOUNT': '2.640', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '49.000'} [2024-08-06 07:47:58,174][52663] DAMAGECOUNT value on done: 900211.0 [2024-08-06 07:47:58,177][52663] Sum rewards: 64.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.450', 'AMMO5': '0.015', 'weapon7': '0.026', 'AMMO2': '0.049', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon5': '0.176', 'AMMO3': '0.233', 'AMMO4': '0.245', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON4': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.550', 'weapon3': '2.678', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2024-08-06 07:47:58,249][52650] Updated weights for policy 0, policy_version 79251 (0.0014) [2024-08-06 07:47:58,475][52665] DAMAGECOUNT value on done: 890213.0 [2024-08-06 07:47:58,476][52665] Sum rewards: 83.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.640', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.106', 'AMMO4': '0.157', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '69.000'} [2024-08-06 07:47:58,943][52649] DAMAGECOUNT value on done: 869185.0 [2024-08-06 07:47:58,944][52649] Sum rewards: 71.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.074', 'weapon5': '0.084', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '57.000'} [2024-08-06 07:47:59,730][52664] DAMAGECOUNT value on done: 947427.0 [2024-08-06 07:47:59,732][52664] Sum rewards: 70.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.815', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '3.340', 'weapon3': '3.382', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '60.000'} [2024-08-06 07:47:59,824][52670] DAMAGECOUNT value on done: 892139.0 [2024-08-06 07:47:59,825][52670] Sum rewards: 82.053, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.390', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.092', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.408', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '67.000'} [2024-08-06 07:48:00,318][52794] DAMAGECOUNT value on done: 906448.0 [2024-08-06 07:48:00,319][52794] Sum rewards: 72.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.140', 'AMMO4': '0.143', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.324', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '59.000'} [2024-08-06 07:48:00,377][52671] DAMAGECOUNT value on done: 895691.0 [2024-08-06 07:48:00,378][52671] Sum rewards: 80.275, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.525', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.148', 'AMMO3': '0.155', 'weapon4': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '0.900', 'weapon3': '3.116', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:00,489][52666] DAMAGECOUNT value on done: 897038.0 [2024-08-06 07:48:00,489][52666] Sum rewards: 72.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.777', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.245', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.292', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.000'} [2024-08-06 07:48:01,191][52795] DAMAGECOUNT value on done: 833561.0 [2024-08-06 07:48:01,192][52795] Sum rewards: 86.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.098', 'weapon5': '0.134', 'AMMO3': '0.212', 'AMMO4': '0.222', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '71.000'} [2024-08-06 07:48:01,216][52663] DAMAGECOUNT value on done: 904373.0 [2024-08-06 07:48:01,218][52663] Sum rewards: 81.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.665', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon4': '0.152', 'weapon5': '0.164', 'AMMO3': '0.220', 'AMMO4': '0.276', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '69.000'} [2024-08-06 07:48:01,518][52665] DAMAGECOUNT value on done: 901803.0 [2024-08-06 07:48:01,520][52665] Sum rewards: 75.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'weapon5': '0.014', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'weapon2': '0.364', 'WEAPON3': '1.100', 'weapon3': '3.276', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '62.000'} [2024-08-06 07:48:02,208][52649] DAMAGECOUNT value on done: 885988.0 [2024-08-06 07:48:02,209][52649] Sum rewards: 72.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.620', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.141', 'weapon4': '0.202', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '60.000'} [2024-08-06 07:48:02,301][52664] DAMAGECOUNT value on done: 945745.0 [2024-08-06 07:48:02,302][52664] Sum rewards: 54.930, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.268', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.932', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.481', 'FRAGCOUNT': '46.000'} [2024-08-06 07:48:02,321][52670] DAMAGECOUNT value on done: 904012.0 [2024-08-06 07:48:02,322][52670] Sum rewards: 69.222, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.095', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.054', 'weapon5': '0.156', 'AMMO4': '0.212', 'AMMO3': '0.227', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '59.000'} [2024-08-06 07:48:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 649297920. Throughput: 0: 4376.7. Samples: 162324710. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:48:02,794][52567] Avg episode reward: [(0, '75.199')] [2024-08-06 07:48:02,929][52650] Updated weights for policy 0, policy_version 79261 (0.0016) [2024-08-06 07:48:03,138][52794] DAMAGECOUNT value on done: 915069.0 [2024-08-06 07:48:03,139][52794] Sum rewards: 83.821, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.108', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.116', 'weapon5': '0.116', 'AMMO4': '0.133', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '70.000'} [2024-08-06 07:48:03,439][52666] DAMAGECOUNT value on done: 905180.0 [2024-08-06 07:48:03,439][52666] Sum rewards: 79.039, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.915', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.102', 'weapon5': '0.122', 'AMMO4': '0.168', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.150', 'weapon3': '3.302', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '64.000'} [2024-08-06 07:48:04,184][52665] DAMAGECOUNT value on done: 891870.0 [2024-08-06 07:48:04,192][52665] Sum rewards: 90.782, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.004', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.078', 'AMMO4': '0.108', 'weapon5': '0.158', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '73.000'} [2024-08-06 07:48:04,288][52663] DAMAGECOUNT value on done: 910166.0 [2024-08-06 07:48:04,290][52663] Sum rewards: 79.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.468', 'AMMO5': '0.014', 'AMMO2': '0.070', 'weapon4': '0.088', 'weapon2': '0.182', 'weapon5': '0.204', 'AMMO3': '0.222', 'AMMO4': '0.349', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:04,345][52795] DAMAGECOUNT value on done: 822791.0 [2024-08-06 07:48:04,346][52795] Sum rewards: 69.830, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.351', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO3': '0.119', 'AMMO4': '0.136', 'weapon5': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.428', 'weapon2': '0.492', 'WEAPON3': '0.750', 'weapon3': '2.634', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '51.500'} [2024-08-06 07:48:04,894][52649] DAMAGECOUNT value on done: 881567.0 [2024-08-06 07:48:04,894][52649] Sum rewards: 78.165, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.984', 'AMMO5': '0.009', 'weapon4': '0.020', 'AMMO2': '0.025', 'weapon5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '3.066', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:05,552][52670] DAMAGECOUNT value on done: 892493.0 [2024-08-06 07:48:05,553][52670] Sum rewards: 73.892, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.078', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.092', 'weapon5': '0.170', 'AMMO4': '0.224', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.142', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '61.000'} [2024-08-06 07:48:05,567][52664] DAMAGECOUNT value on done: 929534.0 [2024-08-06 07:48:05,567][52664] Sum rewards: 69.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.082', 'weapon4': '0.126', 'AMMO3': '0.176', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.050', 'weapon3': '3.192', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '54.500'} [2024-08-06 07:48:06,090][52794] DAMAGECOUNT value on done: 904776.0 [2024-08-06 07:48:06,090][52794] Sum rewards: 69.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.124', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '58.000'} [2024-08-06 07:48:06,541][52666] DAMAGECOUNT value on done: 897207.0 [2024-08-06 07:48:06,542][52666] Sum rewards: 66.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.064', 'weapon4': '0.128', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.328', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '56.000'} [2024-08-06 07:48:06,772][52663] DAMAGECOUNT value on done: 893320.0 [2024-08-06 07:48:06,773][52663] Sum rewards: 81.248, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.640', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO3': '0.172', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.306', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:07,224][52665] DAMAGECOUNT value on done: 895344.0 [2024-08-06 07:48:07,226][52665] Sum rewards: 86.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.616', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.190', 'weapon4': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.583', 'FRAGCOUNT': '69.000'} [2024-08-06 07:48:07,420][52795] DAMAGECOUNT value on done: 831389.0 [2024-08-06 07:48:07,420][52795] Sum rewards: 78.881, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.084', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.183', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '64.000'} [2024-08-06 07:48:07,492][52650] Updated weights for policy 0, policy_version 79271 (0.0041) [2024-08-06 07:48:07,715][52649] DAMAGECOUNT value on done: 875414.0 [2024-08-06 07:48:07,717][52649] Sum rewards: 78.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.160', 'AMMO5': '0.012', 'AMMO2': '0.063', 'weapon5': '0.156', 'weapon4': '0.184', 'weapon2': '0.226', 'AMMO3': '0.280', 'WEAPON5': '0.300', 'AMMO4': '0.315', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.170', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 649388032. Throughput: 0: 4384.0. Samples: 162350950. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:48:07,794][52567] Avg episode reward: [(0, '75.818')] [2024-08-06 07:48:08,606][52670] DAMAGECOUNT value on done: 885670.0 [2024-08-06 07:48:08,607][52670] Sum rewards: 66.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.711', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.196', 'weapon5': '0.232', 'AMMO3': '0.234', 'AMMO4': '0.251', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '2.710', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '56.000'} [2024-08-06 07:48:08,684][52664] DAMAGECOUNT value on done: 933508.0 [2024-08-06 07:48:08,684][52664] Sum rewards: 78.944, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.054', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.140', 'AMMO4': '0.148', 'weapon2': '0.166', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.390', 'weapon3': '3.404', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '69.000'} [2024-08-06 07:48:09,381][52614] Signal inference workers to stop experience collection... (14550 times) [2024-08-06 07:48:09,386][52614] Signal inference workers to resume experience collection... (14550 times) [2024-08-06 07:48:09,475][52650] InferenceWorker_p0-w0: stopping experience collection (14550 times) [2024-08-06 07:48:09,475][52650] InferenceWorker_p0-w0: resuming experience collection (14550 times) [2024-08-06 07:48:09,616][52666] DAMAGECOUNT value on done: 892076.0 [2024-08-06 07:48:09,616][52666] Sum rewards: 84.987, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.380', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.046', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.472', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '72.000'} [2024-08-06 07:48:09,779][52665] DAMAGECOUNT value on done: 878704.0 [2024-08-06 07:48:09,779][52665] Sum rewards: 80.537, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.546', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.116', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '67.000'} [2024-08-06 07:48:10,499][52649] DAMAGECOUNT value on done: 884776.0 [2024-08-06 07:48:10,502][52649] Sum rewards: 75.538, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon5': '0.154', 'weapon4': '0.160', 'AMMO3': '0.227', 'AMMO4': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:10,579][52795] DAMAGECOUNT value on done: 839866.0 [2024-08-06 07:48:10,580][52795] Sum rewards: 77.982, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.102', 'weapon4': '0.118', 'AMMO4': '0.136', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.654', 'WEAPON3': '0.950', 'weapon3': '2.880', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '62.000'} [2024-08-06 07:48:11,329][52664] DAMAGECOUNT value on done: 939239.0 [2024-08-06 07:48:11,329][52664] Sum rewards: 62.733, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.066', 'AMMO4': '0.097', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.328', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2024-08-06 07:48:11,609][52670] DAMAGECOUNT value on done: 891320.0 [2024-08-06 07:48:11,609][52670] Sum rewards: 72.164, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.023', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.104', 'AMMO4': '0.174', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2024-08-06 07:48:12,327][52665] DAMAGECOUNT value on done: 882848.0 [2024-08-06 07:48:12,327][52665] Sum rewards: 82.487, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.890', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.163', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'weapon4': '0.842', 'WEAPON3': '1.100', 'weapon3': '2.438', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:12,480][52650] Updated weights for policy 0, policy_version 79281 (0.0019) [2024-08-06 07:48:12,526][52666] DAMAGECOUNT value on done: 898233.0 [2024-08-06 07:48:12,527][52666] Sum rewards: 77.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.696', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.200', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '64.000'} [2024-08-06 07:48:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 649469952. Throughput: 0: 4380.0. Samples: 162377110. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 07:48:12,795][52567] Avg episode reward: [(0, '75.757')] [2024-08-06 07:48:12,913][52649] DAMAGECOUNT value on done: 879729.0 [2024-08-06 07:48:12,913][52649] Sum rewards: 72.680, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.204', 'weapon2': '0.412', 'WEAPON3': '1.300', 'HITCOUNT': '3.300', 'weapon3': '3.400', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '60.000'} [2024-08-06 07:48:14,160][52664] DAMAGECOUNT value on done: 930619.0 [2024-08-06 07:48:14,161][52664] Sum rewards: 74.137, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.454', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.104', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.306', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.446', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 07:48:14,595][52670] DAMAGECOUNT value on done: 890733.0 [2024-08-06 07:48:14,599][52670] Sum rewards: 70.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.712', 'AMMO5': '0.022', 'AMMO2': '0.062', 'weapon4': '0.190', 'weapon5': '0.238', 'AMMO3': '0.253', 'AMMO4': '0.311', 'weapon2': '0.444', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.820', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '60.000'} [2024-08-06 07:48:15,337][52665] DAMAGECOUNT value on done: 891099.0 [2024-08-06 07:48:15,339][52665] Sum rewards: 83.773, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.158', 'weapon5': '0.170', 'AMMO4': '0.178', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.480', 'HEALTH': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:15,628][52666] DAMAGECOUNT value on done: 893169.0 [2024-08-06 07:48:15,630][52666] Sum rewards: 66.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.465', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.054', 'AMMO4': '0.145', 'weapon5': '0.168', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.540', 'WEAPON3': '1.700', 'weapon3': '2.962', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '57.000'} [2024-08-06 07:48:16,120][52649] DAMAGECOUNT value on done: 883819.0 [2024-08-06 07:48:16,124][52649] Sum rewards: 80.364, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.946', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.139', 'weapon5': '0.174', 'AMMO4': '0.197', 'weapon4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.432', 'WEAPON3': '0.950', 'weapon3': '2.816', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:16,850][52650] Updated weights for policy 0, policy_version 79291 (0.0012) [2024-08-06 07:48:17,411][52670] DAMAGECOUNT value on done: 886964.0 [2024-08-06 07:48:17,411][52670] Sum rewards: 63.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.518', 'AMMO5': '0.016', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.226', 'AMMO3': '0.241', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.510', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '2.468', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '52.000'} [2024-08-06 07:48:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 649560064. Throughput: 0: 4379.1. Samples: 162390200. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:17,794][52567] Avg episode reward: [(0, '75.882')] [2024-08-06 07:48:18,303][52665] DAMAGECOUNT value on done: 891852.0 [2024-08-06 07:48:18,306][52665] Sum rewards: 86.682, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.367', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.589', 'FRAGCOUNT': '70.000'} [2024-08-06 07:48:18,421][52666] DAMAGECOUNT value on done: 892513.0 [2024-08-06 07:48:18,421][52666] Sum rewards: 78.714, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.388', 'WEAPON3': '1.050', 'weapon3': '3.444', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '62.000'} [2024-08-06 07:48:18,848][52649] DAMAGECOUNT value on done: 878958.0 [2024-08-06 07:48:18,850][52649] Sum rewards: 76.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.895', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.152', 'AMMO3': '0.170', 'AMMO4': '0.218', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '62.000'} [2024-08-06 07:48:20,263][52663] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:48:20,441][52670] DAMAGECOUNT value on done: 901006.0 [2024-08-06 07:48:20,443][52670] Sum rewards: 80.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.211', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO4': '0.196', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:20,899][52665] DAMAGECOUNT value on done: 896012.0 [2024-08-06 07:48:20,899][52665] Sum rewards: 78.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.908', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.145', 'AMMO3': '0.194', 'weapon4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.876', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:21,434][52649] DAMAGECOUNT value on done: 875278.0 [2024-08-06 07:48:21,434][52649] Sum rewards: 67.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.676', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.126', 'weapon4': '0.172', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '54.500'} [2024-08-06 07:48:21,474][52666] DAMAGECOUNT value on done: 900620.0 [2024-08-06 07:48:21,475][52666] Sum rewards: 86.346, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.909', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO3': '0.230', 'AMMO4': '0.245', 'weapon2': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.940', 'FRAGCOUNT': '72.000'} [2024-08-06 07:48:21,897][52650] Updated weights for policy 0, policy_version 79301 (0.0018) [2024-08-06 07:48:22,076][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:48:22,242][52668] DAMAGECOUNT value on done: 908662.0 [2024-08-06 07:48:22,242][52668] Sum rewards: 81.599, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.300', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.078', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.430', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.733', 'FRAGCOUNT': '68.500'} [2024-08-06 07:48:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 649650176. Throughput: 0: 4382.0. Samples: 162416510. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:22,794][52567] Avg episode reward: [(0, '76.000')] [2024-08-06 07:48:22,939][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:48:23,304][52665] DAMAGECOUNT value on done: 889202.0 [2024-08-06 07:48:23,305][52665] Sum rewards: 67.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.486', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.053', 'weapon5': '0.220', 'AMMO3': '0.242', 'AMMO4': '0.265', 'WEAPON5': '0.300', 'weapon4': '0.312', 'WEAPON4': '0.500', 'weapon2': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.694', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '55.000'} [2024-08-06 07:48:23,525][52670] DAMAGECOUNT value on done: 882914.0 [2024-08-06 07:48:23,526][52670] Sum rewards: 67.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.365', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.086', 'weapon5': '0.140', 'AMMO4': '0.194', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '55.000'} [2024-08-06 07:48:24,147][52649] DAMAGECOUNT value on done: 888569.0 [2024-08-06 07:48:24,148][52649] Sum rewards: 75.245, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.681', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.144', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon4': '0.276', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '2.844', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '60.000'} [2024-08-06 07:48:24,545][52666] DAMAGECOUNT value on done: 893880.0 [2024-08-06 07:48:24,547][52666] Sum rewards: 72.034, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.645', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon5': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.086', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '58.000'} [2024-08-06 07:48:25,476][52668] DAMAGECOUNT value on done: 910267.0 [2024-08-06 07:48:25,478][52668] Sum rewards: 75.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.985', 'AMMO5': '0.004', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.152', 'AMMO3': '0.187', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 07:48:25,861][52665] DAMAGECOUNT value on done: 904553.0 [2024-08-06 07:48:25,864][52665] Sum rewards: 76.937, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.731', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.126', 'weapon5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.254', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '62.000'} [2024-08-06 07:48:25,909][52647] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:48:26,382][52650] Updated weights for policy 0, policy_version 79311 (0.0013) [2024-08-06 07:48:26,514][52670] DAMAGECOUNT value on done: 898916.0 [2024-08-06 07:48:26,515][52670] Sum rewards: 82.663, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO2': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.163', 'AMMO4': '0.167', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.378', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:26,730][52649] DAMAGECOUNT value on done: 892095.0 [2024-08-06 07:48:26,731][52649] Sum rewards: 71.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.323', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.160', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 07:48:27,487][52666] DAMAGECOUNT value on done: 898486.0 [2024-08-06 07:48:27,490][52666] Sum rewards: 63.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon4': '0.112', 'AMMO3': '0.217', 'weapon5': '0.224', 'AMMO4': '0.230', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.966', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '53.000'} [2024-08-06 07:48:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 649732096. Throughput: 0: 4385.1. Samples: 162442950. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:27,795][52567] Avg episode reward: [(0, '75.808')] [2024-08-06 07:48:27,870][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079314_649740288.pth... [2024-08-06 07:48:28,040][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000078802_645545984.pth [2024-08-06 07:48:28,599][52665] DAMAGECOUNT value on done: 895752.0 [2024-08-06 07:48:28,600][52665] Sum rewards: 66.828, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.920', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.060', 'weapon5': '0.100', 'AMMO4': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'weapon2': '0.580', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '58.000'} [2024-08-06 07:48:28,723][52668] DAMAGECOUNT value on done: 905000.0 [2024-08-06 07:48:28,725][52668] Sum rewards: 83.544, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.880', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.130', 'AMMO4': '0.198', 'weapon2': '0.208', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '71.000'} [2024-08-06 07:48:29,597][52649] DAMAGECOUNT value on done: 886201.0 [2024-08-06 07:48:29,597][52649] Sum rewards: 81.372, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.219', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'weapon4': '0.332', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:29,699][52670] DAMAGECOUNT value on done: 902248.0 [2024-08-06 07:48:29,700][52670] Sum rewards: 76.823, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.090', 'AMMO4': '0.104', 'weapon5': '0.138', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.245', 'weapon2': '0.484', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '61.000'} [2024-08-06 07:48:30,363][52666] DAMAGECOUNT value on done: 882780.0 [2024-08-06 07:48:30,365][52666] Sum rewards: 77.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.242', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.094', 'weapon5': '0.174', 'AMMO3': '0.191', 'weapon2': '0.194', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:31,043][52650] Updated weights for policy 0, policy_version 79321 (0.0023) [2024-08-06 07:48:31,579][52665] DAMAGECOUNT value on done: 892949.0 [2024-08-06 07:48:31,580][52665] Sum rewards: 84.420, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.779', 'AMMO2': '0.009', 'AMMO5': '0.012', 'weapon4': '0.016', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.062', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.386', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '70.000'} [2024-08-06 07:48:31,591][52668] DAMAGECOUNT value on done: 908311.0 [2024-08-06 07:48:31,591][52668] Sum rewards: 81.528, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.568', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.084', 'AMMO4': '0.100', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.264', 'WEAPON3': '1.550', 'weapon3': '3.204', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '69.000'} [2024-08-06 07:48:32,282][52670] DAMAGECOUNT value on done: 895460.0 [2024-08-06 07:48:32,282][52670] Sum rewards: 80.493, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.528', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.111', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '67.000'} [2024-08-06 07:48:32,425][52649] DAMAGECOUNT value on done: 885682.0 [2024-08-06 07:48:32,427][52649] Sum rewards: 70.881, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.760', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.116', 'AMMO4': '0.150', 'weapon2': '0.214', 'weapon5': '0.218', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.030', 'weapon3': '3.144', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '60.000'} [2024-08-06 07:48:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17340.5, 300 sec: 17467.0). Total num frames: 649822208. Throughput: 0: 4380.5. Samples: 162455890. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:32,794][52567] Avg episode reward: [(0, '76.164')] [2024-08-06 07:48:33,231][52666] DAMAGECOUNT value on done: 904455.0 [2024-08-06 07:48:33,232][52666] Sum rewards: 79.455, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.797', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.484', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:33,961][52665] DAMAGECOUNT value on done: 896671.0 [2024-08-06 07:48:33,962][52665] Sum rewards: 90.692, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.532', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.174', 'AMMO4': '0.193', 'AMMO3': '0.247', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.977', 'FRAGCOUNT': '74.000'} [2024-08-06 07:48:34,425][52659] Large shaping reward 2.593 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)] [2024-08-06 07:48:34,706][52668] DAMAGECOUNT value on done: 896828.0 [2024-08-06 07:48:34,706][52668] Sum rewards: 78.767, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.222', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.120', 'weapon5': '0.136', 'AMMO4': '0.159', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:35,246][52670] DAMAGECOUNT value on done: 878337.0 [2024-08-06 07:48:35,246][52670] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.018', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.070', 'AMMO3': '0.142', 'weapon5': '0.178', 'AMMO4': '0.201', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '0.950', 'HITCOUNT': '3.050', 'weapon3': '3.086', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '52.000'} [2024-08-06 07:48:35,293][52649] DAMAGECOUNT value on done: 874743.0 [2024-08-06 07:48:35,293][52649] Sum rewards: 78.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.405', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.167', 'AMMO3': '0.185', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.318', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:35,932][52666] DAMAGECOUNT value on done: 897710.0 [2024-08-06 07:48:35,934][52666] Sum rewards: 73.018, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.745', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.122', 'AMMO4': '0.170', 'weapon2': '0.230', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.260', 'weapon3': '3.364', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 07:48:36,069][52650] Updated weights for policy 0, policy_version 79331 (0.0037) [2024-08-06 07:48:37,346][52665] DAMAGECOUNT value on done: 889572.0 [2024-08-06 07:48:37,348][52665] Sum rewards: 84.332, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.930', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.141', 'weapon5': '0.156', 'AMMO3': '0.268', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.280', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '73.000'} [2024-08-06 07:48:37,447][52668] DAMAGECOUNT value on done: 904145.0 [2024-08-06 07:48:37,449][52668] Sum rewards: 71.595, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.133', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.082', 'weapon5': '0.128', 'AMMO4': '0.167', 'AMMO3': '0.175', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.366', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '58.000'} [2024-08-06 07:48:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 649912320. Throughput: 0: 4370.4. Samples: 162481860. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:37,794][52567] Avg episode reward: [(0, '76.177')] [2024-08-06 07:48:38,087][52670] DAMAGECOUNT value on done: 893479.0 [2024-08-06 07:48:38,088][52670] Sum rewards: 71.734, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.036', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.130', 'weapon2': '0.206', 'AMMO3': '0.235', 'AMMO4': '0.269', 'weapon5': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '59.000'} [2024-08-06 07:48:38,318][52649] DAMAGECOUNT value on done: 884731.0 [2024-08-06 07:48:38,326][52649] Sum rewards: 72.180, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.571', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.142', 'AMMO3': '0.168', 'weapon5': '0.230', 'AMMO4': '0.257', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.580', 'WEAPON3': '1.100', 'weapon3': '2.810', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '57.000'} [2024-08-06 07:48:38,751][52666] DAMAGECOUNT value on done: 897507.0 [2024-08-06 07:48:38,752][52666] Sum rewards: 77.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon4': '0.174', 'weapon2': '0.202', 'AMMO3': '0.205', 'weapon5': '0.224', 'AMMO4': '0.279', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:40,214][52665] DAMAGECOUNT value on done: 895556.0 [2024-08-06 07:48:40,215][52665] Sum rewards: 85.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.141', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.315', 'FRAGCOUNT': '70.000'} [2024-08-06 07:48:40,416][52670] DAMAGECOUNT value on done: 902781.0 [2024-08-06 07:48:40,416][52670] Sum rewards: 78.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.288', 'weapon4': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:40,427][52668] DAMAGECOUNT value on done: 905830.0 [2024-08-06 07:48:40,428][52668] Sum rewards: 58.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.154', 'weapon5': '0.174', 'AMMO4': '0.232', 'AMMO3': '0.253', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'HITCOUNT': '2.850', 'weapon3': '3.012', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '51.000'} [2024-08-06 07:48:40,503][52650] Updated weights for policy 0, policy_version 79341 (0.0019) [2024-08-06 07:48:41,260][52649] DAMAGECOUNT value on done: 866483.0 [2024-08-06 07:48:41,261][52649] Sum rewards: 64.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.676', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.134', 'AMMO4': '0.193', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '54.000'} [2024-08-06 07:48:41,415][52666] DAMAGECOUNT value on done: 890615.0 [2024-08-06 07:48:41,416][52666] Sum rewards: 64.629, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.969', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.084', 'weapon5': '0.220', 'AMMO3': '0.226', 'AMMO4': '0.271', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.970', 'weapon3': '2.990', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '54.000'} [2024-08-06 07:48:41,927][52662] DAMAGECOUNT value on done: 901229.0 [2024-08-06 07:48:41,927][52662] Sum rewards: 68.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.590', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon2': '0.170', 'weapon4': '0.172', 'AMMO3': '0.205', 'AMMO4': '0.251', 'weapon5': '0.256', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '56.000'} [2024-08-06 07:48:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 650002432. Throughput: 0: 4372.9. Samples: 162508220. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:42,794][52567] Avg episode reward: [(0, '75.961')] [2024-08-06 07:48:42,979][52668] DAMAGECOUNT value on done: 896961.0 [2024-08-06 07:48:42,981][52668] Sum rewards: 77.156, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.635', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.206', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.366', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '64.000'} [2024-08-06 07:48:43,363][52665] DAMAGECOUNT value on done: 894934.0 [2024-08-06 07:48:43,371][52665] Sum rewards: 77.020, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.844', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'weapon4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '64.000'} [2024-08-06 07:48:43,540][52670] DAMAGECOUNT value on done: 896544.0 [2024-08-06 07:48:43,541][52670] Sum rewards: 79.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.404', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.120', 'AMMO4': '0.169', 'weapon2': '0.218', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.422', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:44,197][52662] DAMAGECOUNT value on done: 911400.0 [2024-08-06 07:48:44,199][52662] Sum rewards: 69.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.193', 'ARMOR': '0.004', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.174', 'weapon2': '0.196', 'AMMO3': '0.227', 'AMMO4': '0.263', 'weapon5': '0.280', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2024-08-06 07:48:44,272][52649] DAMAGECOUNT value on done: 888649.0 [2024-08-06 07:48:44,272][52649] Sum rewards: 73.463, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.095', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.089', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '59.000'} [2024-08-06 07:48:44,558][52666] DAMAGECOUNT value on done: 890976.0 [2024-08-06 07:48:44,560][52666] Sum rewards: 85.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.767', 'AMMO5': '0.008', 'weapon4': '0.044', 'AMMO2': '0.045', 'weapon5': '0.140', 'AMMO3': '0.227', 'AMMO4': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '3.038', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '70.000'} [2024-08-06 07:48:45,053][52650] Updated weights for policy 0, policy_version 79351 (0.0014) [2024-08-06 07:48:45,960][52668] DAMAGECOUNT value on done: 901549.0 [2024-08-06 07:48:45,961][52668] Sum rewards: 78.001, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.058', 'weapon5': '0.130', 'AMMO4': '0.191', 'AMMO3': '0.227', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:46,442][52665] DAMAGECOUNT value on done: 885227.0 [2024-08-06 07:48:46,442][52665] Sum rewards: 73.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.836', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.222', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 07:48:46,666][52662] DAMAGECOUNT value on done: 911035.0 [2024-08-06 07:48:46,668][52662] Sum rewards: 70.992, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.929', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO4': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.306', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '58.000'} [2024-08-06 07:48:46,733][52670] DAMAGECOUNT value on done: 897501.0 [2024-08-06 07:48:46,734][52670] Sum rewards: 71.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.843', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.112', 'AMMO3': '0.222', 'weapon2': '0.256', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '59.000'} [2024-08-06 07:48:47,595][52649] DAMAGECOUNT value on done: 887764.0 [2024-08-06 07:48:47,596][52649] Sum rewards: 72.416, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.402', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.150', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.278', 'weapon2': '0.338', 'WEAPON3': '1.000', 'weapon3': '2.772', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '56.000'} [2024-08-06 07:48:47,765][52666] DAMAGECOUNT value on done: 909541.0 [2024-08-06 07:48:47,767][52666] Sum rewards: 81.650, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO4': '0.215', 'AMMO3': '0.217', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '67.000'} [2024-08-06 07:48:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 650084352. Throughput: 0: 4368.9. Samples: 162521310. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:47,794][52567] Avg episode reward: [(0, '75.339')] [2024-08-06 07:48:48,932][52668] DAMAGECOUNT value on done: 907894.0 [2024-08-06 07:48:48,932][52668] Sum rewards: 80.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.724', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.108', 'weapon4': '0.110', 'AMMO4': '0.115', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.594', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '67.000'} [2024-08-06 07:48:49,281][52665] DAMAGECOUNT value on done: 889990.0 [2024-08-06 07:48:49,282][52665] Sum rewards: 69.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.295', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '56.000'} [2024-08-06 07:48:49,327][52662] DAMAGECOUNT value on done: 897576.0 [2024-08-06 07:48:49,328][52662] Sum rewards: 74.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.312', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.052', 'weapon5': '0.096', 'WEAPON4': '0.150', 'weapon4': '0.180', 'weapon2': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.650', 'weapon3': '3.232', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:49,706][52650] Updated weights for policy 0, policy_version 79361 (0.0014) [2024-08-06 07:48:50,022][52667] DAMAGECOUNT value on done: 902750.0 [2024-08-06 07:48:50,023][52667] Sum rewards: 80.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.136', 'weapon4': '0.172', 'AMMO4': '0.210', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.118', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '67.000'} [2024-08-06 07:48:50,290][52649] DAMAGECOUNT value on done: 880219.0 [2024-08-06 07:48:50,290][52649] Sum rewards: 57.349, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.510', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.070', 'weapon4': '0.142', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'AMMO3': '0.341', 'weapon2': '0.370', 'WEAPON3': '1.950', 'weapon3': '3.110', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '54.000'} [2024-08-06 07:48:50,766][52666] DAMAGECOUNT value on done: 883124.0 [2024-08-06 07:48:50,769][52666] Sum rewards: 84.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.274', 'weapon4': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '69.000'} [2024-08-06 07:48:51,253][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:48:51,942][52668] DAMAGECOUNT value on done: 901587.0 [2024-08-06 07:48:51,942][52668] Sum rewards: 81.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.552', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.098', 'AMMO4': '0.203', 'AMMO3': '0.210', 'weapon5': '0.254', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:52,076][52665] DAMAGECOUNT value on done: 896054.0 [2024-08-06 07:48:52,079][52665] Sum rewards: 85.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.121', 'AMMO3': '0.216', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '71.000'} [2024-08-06 07:48:52,168][52662] DAMAGECOUNT value on done: 916501.0 [2024-08-06 07:48:52,168][52662] Sum rewards: 77.512, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.124', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:52,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 650174464. Throughput: 0: 4371.8. Samples: 162547680. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:52,794][52567] Avg episode reward: [(0, '75.666')] [2024-08-06 07:48:53,050][52667] DAMAGECOUNT value on done: 916213.0 [2024-08-06 07:48:53,050][52667] Sum rewards: 76.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.097', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.056', 'AMMO4': '0.217', 'weapon5': '0.220', 'AMMO3': '0.280', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.202', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '66.000'} [2024-08-06 07:48:53,856][52666] DAMAGECOUNT value on done: 892620.0 [2024-08-06 07:48:53,856][52666] Sum rewards: 80.052, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.090', 'AMMO3': '0.191', 'AMMO4': '0.196', 'weapon2': '0.274', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '65.000'} [2024-08-06 07:48:54,602][52650] Updated weights for policy 0, policy_version 79371 (0.0023) [2024-08-06 07:48:54,995][52668] DAMAGECOUNT value on done: 897061.0 [2024-08-06 07:48:54,998][52668] Sum rewards: 73.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.682', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.070', 'AMMO4': '0.135', 'weapon5': '0.208', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.475', 'FRAGCOUNT': '59.500'} [2024-08-06 07:48:55,033][52662] DAMAGECOUNT value on done: 892117.0 [2024-08-06 07:48:55,034][52662] Sum rewards: 63.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.116', 'weapon5': '0.214', 'AMMO3': '0.223', 'AMMO4': '0.292', 'weapon2': '0.320', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.950', 'weapon3': '3.098', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '54.000'} [2024-08-06 07:48:56,027][52667] DAMAGECOUNT value on done: 912452.0 [2024-08-06 07:48:56,028][52667] Sum rewards: 75.037, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.380', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.092', 'weapon4': '0.096', 'weapon2': '0.170', 'AMMO3': '0.217', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.450', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '63.000'} [2024-08-06 07:48:57,361][52811] DAMAGECOUNT value on done: 856552.0 [2024-08-06 07:48:57,362][52811] Sum rewards: 60.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon5': '0.170', 'AMMO3': '0.200', 'AMMO4': '0.273', 'weapon4': '0.324', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '51.000'} [2024-08-06 07:48:57,617][52668] DAMAGECOUNT value on done: 893924.0 [2024-08-06 07:48:57,619][52668] Sum rewards: 79.303, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.156', 'AMMO4': '0.187', 'AMMO3': '0.215', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '64.000'} [2024-08-06 07:48:57,748][52662] DAMAGECOUNT value on done: 901603.0 [2024-08-06 07:48:57,750][52662] Sum rewards: 64.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.245', 'AMMO5': '0.021', 'AMMO2': '0.048', 'weapon4': '0.136', 'AMMO3': '0.188', 'weapon5': '0.222', 'AMMO4': '0.238', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.933', 'FRAGCOUNT': '53.000'} [2024-08-06 07:48:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 650256384. Throughput: 0: 4377.1. Samples: 162574080. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:48:57,794][52567] Avg episode reward: [(0, '75.327')] [2024-08-06 07:48:58,898][52667] DAMAGECOUNT value on done: 915414.0 [2024-08-06 07:48:58,898][52667] Sum rewards: 67.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.213', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '56.000'} [2024-08-06 07:48:58,914][52650] Updated weights for policy 0, policy_version 79381 (0.0012) [2024-08-06 07:49:00,062][52662] DAMAGECOUNT value on done: 917883.0 [2024-08-06 07:49:00,070][52662] Sum rewards: 71.720, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.034', 'weapon5': '0.060', 'AMMO4': '0.065', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.275', 'weapon2': '0.406', 'WEAPON3': '1.600', 'weapon3': '3.250', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:00,398][52668] DAMAGECOUNT value on done: 892547.0 [2024-08-06 07:49:00,398][52668] Sum rewards: 72.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.582', 'AMMO5': '0.022', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.173', 'AMMO3': '0.207', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon5': '0.516', 'WEAPON3': '1.250', 'weapon3': '2.770', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:00,694][52811] DAMAGECOUNT value on done: 841770.0 [2024-08-06 07:49:00,695][52811] Sum rewards: 77.409, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.974', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.082', 'AMMO4': '0.105', 'weapon5': '0.110', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:01,496][52667] DAMAGECOUNT value on done: 917105.0 [2024-08-06 07:49:01,497][52667] Sum rewards: 73.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.166', 'AMMO4': '0.185', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '60.000'} [2024-08-06 07:49:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 650346496. Throughput: 0: 4372.9. Samples: 162586980. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 07:49:02,795][52567] Avg episode reward: [(0, '75.252')] [2024-08-06 07:49:03,116][52662] DAMAGECOUNT value on done: 904333.0 [2024-08-06 07:49:03,117][52662] Sum rewards: 78.223, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.832', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.124', 'weapon5': '0.140', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.092', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:03,259][52668] DAMAGECOUNT value on done: 886989.0 [2024-08-06 07:49:03,260][52668] Sum rewards: 70.583, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.132', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.253', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '60.000'} [2024-08-06 07:49:03,676][52811] DAMAGECOUNT value on done: 835861.0 [2024-08-06 07:49:03,676][52811] Sum rewards: 80.560, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.346', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.173', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.440', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:03,819][52650] Updated weights for policy 0, policy_version 79391 (0.0012) [2024-08-06 07:49:04,595][52667] DAMAGECOUNT value on done: 916337.0 [2024-08-06 07:49:04,596][52667] Sum rewards: 91.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.865', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '74.000'} [2024-08-06 07:49:04,608][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:49:06,105][52662] DAMAGECOUNT value on done: 911023.0 [2024-08-06 07:49:06,106][52662] Sum rewards: 66.327, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.605', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon2': '0.162', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '54.000'} [2024-08-06 07:49:06,399][52668] DAMAGECOUNT value on done: 901757.0 [2024-08-06 07:49:06,399][52668] Sum rewards: 66.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.834', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.068', 'AMMO4': '0.113', 'weapon5': '0.116', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.204', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '55.000'} [2024-08-06 07:49:06,803][52811] DAMAGECOUNT value on done: 839759.0 [2024-08-06 07:49:06,803][52811] Sum rewards: 81.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.269', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO2': '0.027', 'weapon5': '0.046', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '67.000'} [2024-08-06 07:49:07,049][52667] DAMAGECOUNT value on done: 909833.0 [2024-08-06 07:49:07,049][52667] Sum rewards: 81.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.174', 'AMMO4': '0.182', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 650436608. Throughput: 0: 4374.0. Samples: 162613340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:07,794][52567] Avg episode reward: [(0, '75.360')] [2024-08-06 07:49:08,696][52650] Updated weights for policy 0, policy_version 79401 (0.0042) [2024-08-06 07:49:08,706][52659] DAMAGECOUNT value on done: 907745.0 [2024-08-06 07:49:08,709][52659] Sum rewards: 77.855, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.168', 'AMMO5': '0.025', 'AMMO2': '0.089', 'AMMO3': '0.262', 'weapon2': '0.266', 'weapon5': '0.274', 'weapon4': '0.330', 'AMMO4': '0.445', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.550', 'weapon3': '2.728', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '67.000'} [2024-08-06 07:49:08,983][52662] DAMAGECOUNT value on done: 903768.0 [2024-08-06 07:49:08,987][52662] Sum rewards: 74.823, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.638', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.452', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.000'} [2024-08-06 07:49:09,643][52668] DAMAGECOUNT value on done: 905021.0 [2024-08-06 07:49:09,643][52668] Sum rewards: 78.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.737', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.054', 'weapon5': '0.176', 'AMMO3': '0.193', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:09,925][52811] DAMAGECOUNT value on done: 843055.0 [2024-08-06 07:49:09,926][52811] Sum rewards: 77.171, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.129', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.118', 'AMMO4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.266', 'WEAPON3': '1.100', 'HITCOUNT': '3.390', 'weapon3': '3.392', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:10,273][52667] DAMAGECOUNT value on done: 906811.0 [2024-08-06 07:49:10,273][52667] Sum rewards: 70.171, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.676', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.148', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.284', 'weapon2': '0.670', 'WEAPON3': '0.950', 'weapon3': '2.714', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '54.000'} [2024-08-06 07:49:11,326][52659] DAMAGECOUNT value on done: 902393.0 [2024-08-06 07:49:11,334][52659] Sum rewards: 76.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.160', 'AMMO3': '0.196', 'AMMO4': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.290', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:12,194][52662] DAMAGECOUNT value on done: 903009.0 [2024-08-06 07:49:12,201][52662] Sum rewards: 75.853, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.753', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.072', 'AMMO4': '0.132', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.330', 'WEAPON3': '1.100', 'weapon3': '3.362', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:12,287][52668] DAMAGECOUNT value on done: 903461.0 [2024-08-06 07:49:12,289][52668] Sum rewards: 74.197, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.742', 'AMMO5': '0.005', 'ARMOR': '0.008', 'AMMO2': '0.017', 'weapon4': '0.026', 'weapon5': '0.042', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.808', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '61.000'} [2024-08-06 07:49:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 650526720. Throughput: 0: 4368.2. Samples: 162639520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:12,794][52567] Avg episode reward: [(0, '75.266')] [2024-08-06 07:49:12,883][52650] Updated weights for policy 0, policy_version 79411 (0.0011) [2024-08-06 07:49:13,179][52811] DAMAGECOUNT value on done: 858494.0 [2024-08-06 07:49:13,181][52811] Sum rewards: 69.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.496', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.146', 'AMMO4': '0.152', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:13,288][52667] DAMAGECOUNT value on done: 908087.0 [2024-08-06 07:49:13,288][52667] Sum rewards: 78.656, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.111', 'AMMO5': '0.022', 'AMMO2': '0.081', 'AMMO3': '0.254', 'weapon2': '0.256', 'weapon4': '0.286', 'weapon5': '0.388', 'AMMO4': '0.405', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.550', 'weapon3': '2.648', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '20.457', 'FRAGCOUNT': '65.000'} [2024-08-06 07:49:13,434][52660] DAMAGECOUNT value on done: 900103.0 [2024-08-06 07:49:13,435][52660] Sum rewards: 67.721, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.392', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.134', 'AMMO4': '0.149', 'weapon2': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.308', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '57.000'} [2024-08-06 07:49:14,036][52659] DAMAGECOUNT value on done: 914645.0 [2024-08-06 07:49:14,038][52659] Sum rewards: 84.802, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.141', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.354', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '69.000'} [2024-08-06 07:49:15,111][52662] DAMAGECOUNT value on done: 898033.0 [2024-08-06 07:49:15,111][52662] Sum rewards: 77.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.610', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.068', 'weapon5': '0.122', 'AMMO4': '0.124', 'weapon2': '0.146', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'weapon3': '3.460', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '65.000'} [2024-08-06 07:49:15,137][52668] DAMAGECOUNT value on done: 905762.0 [2024-08-06 07:49:15,139][52668] Sum rewards: 63.974, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.043', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.084', 'AMMO4': '0.149', 'AMMO3': '0.192', 'weapon5': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.598', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.894', 'FRAGCOUNT': '54.000'} [2024-08-06 07:49:15,827][52647] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon3', 0.002)] [2024-08-06 07:49:15,965][52667] DAMAGECOUNT value on done: 915900.0 [2024-08-06 07:49:15,966][52667] Sum rewards: 80.047, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.830', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.660', 'WEAPON3': '1.450', 'weapon3': '3.062', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:16,379][52811] DAMAGECOUNT value on done: 851172.0 [2024-08-06 07:49:16,381][52811] Sum rewards: 79.718, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.192', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.118', 'weapon4': '0.186', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:16,472][52660] DAMAGECOUNT value on done: 892488.0 [2024-08-06 07:49:16,473][52660] Sum rewards: 62.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.230', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon5': '0.070', 'AMMO4': '0.075', 'weapon4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.204', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '54.000'} [2024-08-06 07:49:16,943][52659] DAMAGECOUNT value on done: 906835.0 [2024-08-06 07:49:16,944][52659] Sum rewards: 71.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.148', 'AMMO4': '0.201', 'AMMO3': '0.206', 'weapon2': '0.306', 'weapon4': '0.336', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.004', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 650608640. Throughput: 0: 4370.4. Samples: 162652560. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:17,794][52567] Avg episode reward: [(0, '75.083')] [2024-08-06 07:49:17,986][52650] Updated weights for policy 0, policy_version 79421 (0.0013) [2024-08-06 07:49:18,155][52662] DAMAGECOUNT value on done: 906940.0 [2024-08-06 07:49:18,155][52662] Sum rewards: 75.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.776', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.080', 'AMMO4': '0.195', 'weapon5': '0.212', 'AMMO3': '0.216', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:18,261][52668] DAMAGECOUNT value on done: 909090.0 [2024-08-06 07:49:18,272][52668] Sum rewards: 69.715, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.656', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.078', 'AMMO3': '0.184', 'AMMO4': '0.190', 'weapon5': '0.236', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.890', 'weapon3': '3.110', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '57.000'} [2024-08-06 07:49:18,958][52667] DAMAGECOUNT value on done: 901987.0 [2024-08-06 07:49:18,958][52667] Sum rewards: 63.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.838', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.166', 'weapon5': '0.184', 'weapon2': '0.238', 'AMMO3': '0.239', 'AMMO4': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.150', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '54.000'} [2024-08-06 07:49:19,307][52660] DAMAGECOUNT value on done: 903281.0 [2024-08-06 07:49:19,307][52660] Sum rewards: 61.019, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.679', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO4': '0.195', 'weapon5': '0.228', 'AMMO3': '0.281', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.782', 'WEAPON3': '1.600', 'weapon3': '2.582', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '52.000'} [2024-08-06 07:49:19,470][52811] DAMAGECOUNT value on done: 840516.0 [2024-08-06 07:49:19,473][52811] Sum rewards: 77.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.311', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.198', 'AMMO3': '0.215', 'AMMO4': '0.246', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '64.000'} [2024-08-06 07:49:20,191][52659] DAMAGECOUNT value on done: 902512.0 [2024-08-06 07:49:20,192][52659] Sum rewards: 70.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.273', 'AMMO5': '0.026', 'AMMO2': '0.074', 'weapon4': '0.158', 'AMMO3': '0.272', 'AMMO4': '0.368', 'weapon5': '0.376', 'weapon2': '0.516', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.634', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '60.000'} [2024-08-06 07:49:20,553][52662] DAMAGECOUNT value on done: 897585.0 [2024-08-06 07:49:20,553][52662] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.428', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.148', 'AMMO3': '0.191', 'AMMO4': '0.232', 'weapon5': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.000'} [2024-08-06 07:49:21,898][52667] DAMAGECOUNT value on done: 906607.0 [2024-08-06 07:49:21,906][52667] Sum rewards: 78.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.912', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.102', 'weapon5': '0.166', 'AMMO3': '0.233', 'AMMO4': '0.233', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.014', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:22,478][52650] Updated weights for policy 0, policy_version 79431 (0.0052) [2024-08-06 07:49:22,481][52660] DAMAGECOUNT value on done: 916268.0 [2024-08-06 07:49:22,482][52660] Sum rewards: 77.879, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.210', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.104', 'AMMO3': '0.223', 'AMMO4': '0.240', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '65.000'} [2024-08-06 07:49:22,536][52811] DAMAGECOUNT value on done: 848115.0 [2024-08-06 07:49:22,536][52811] Sum rewards: 72.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.925', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.126', 'weapon5': '0.154', 'AMMO4': '0.194', 'AMMO3': '0.228', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '60.500'} [2024-08-06 07:49:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 650698752. Throughput: 0: 4377.6. Samples: 162678850. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:22,794][52567] Avg episode reward: [(0, '74.719')] [2024-08-06 07:49:23,088][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:49:23,099][52659] DAMAGECOUNT value on done: 905362.0 [2024-08-06 07:49:23,100][52659] Sum rewards: 68.693, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.613', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.098', 'AMMO4': '0.140', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '54.500'} [2024-08-06 07:49:23,269][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:49:23,663][52662] DAMAGECOUNT value on done: 914775.0 [2024-08-06 07:49:23,665][52662] Sum rewards: 73.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.924', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon2': '0.230', 'weapon4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.344', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '61.000'} [2024-08-06 07:49:24,246][52667] DAMAGECOUNT value on done: 914073.0 [2024-08-06 07:49:24,248][52667] Sum rewards: 73.284, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.538', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.368', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:25,447][52660] DAMAGECOUNT value on done: 897833.0 [2024-08-06 07:49:25,447][52660] Sum rewards: 69.158, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.777', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.131', 'weapon5': '0.170', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:25,666][52811] DAMAGECOUNT value on done: 846726.0 [2024-08-06 07:49:25,666][52811] Sum rewards: 72.842, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.264', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.080', 'AMMO4': '0.175', 'AMMO3': '0.196', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '58.000'} [2024-08-06 07:49:26,311][52659] DAMAGECOUNT value on done: 908819.0 [2024-08-06 07:49:26,311][52659] Sum rewards: 86.904, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.098', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '72.000'} [2024-08-06 07:49:26,672][52662] DAMAGECOUNT value on done: 907099.0 [2024-08-06 07:49:26,672][52662] Sum rewards: 68.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.385', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.114', 'weapon5': '0.116', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '56.000'} [2024-08-06 07:49:27,061][52667] DAMAGECOUNT value on done: 905375.0 [2024-08-06 07:49:27,070][52667] Sum rewards: 73.651, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.345', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.160', 'weapon2': '0.216', 'weapon4': '0.252', 'AMMO4': '0.271', 'AMMO3': '0.281', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '3.050', 'weapon3': '3.086', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '64.000'} [2024-08-06 07:49:27,243][52650] Updated weights for policy 0, policy_version 79441 (0.0012) [2024-08-06 07:49:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 650788864. Throughput: 0: 4369.6. Samples: 162704850. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:27,794][52567] Avg episode reward: [(0, '74.560')] [2024-08-06 07:49:28,123][52660] DAMAGECOUNT value on done: 897634.0 [2024-08-06 07:49:28,123][52660] Sum rewards: 77.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.539', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.153', 'weapon5': '0.154', 'AMMO3': '0.222', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:28,801][52811] DAMAGECOUNT value on done: 851066.0 [2024-08-06 07:49:28,804][52811] Sum rewards: 74.955, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.655', 'AMMO5': '0.023', 'AMMO2': '0.027', 'weapon4': '0.088', 'AMMO4': '0.136', 'weapon5': '0.156', 'AMMO3': '0.158', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.830', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:29,683][52659] DAMAGECOUNT value on done: 904949.0 [2024-08-06 07:49:29,684][52659] Sum rewards: 81.431, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.887', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.048', 'AMMO4': '0.072', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '67.000'} [2024-08-06 07:49:29,871][52662] DAMAGECOUNT value on done: 897295.0 [2024-08-06 07:49:29,871][52662] Sum rewards: 99.565, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.168', 'AMMO3': '0.292', 'WEAPON3': '1.700', 'weapon3': '3.554', 'HITCOUNT': '4.440', 'DAMAGECOUNT': '23.043', 'FRAGCOUNT': '84.000'} [2024-08-06 07:49:30,446][52667] DAMAGECOUNT value on done: 909323.0 [2024-08-06 07:49:30,447][52667] Sum rewards: 61.864, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.630', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.122', 'weapon5': '0.152', 'AMMO3': '0.216', 'AMMO4': '0.296', 'weapon2': '0.360', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '56.000'} [2024-08-06 07:49:30,997][52660] DAMAGECOUNT value on done: 902700.0 [2024-08-06 07:49:30,998][52660] Sum rewards: 59.216, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.423', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon2': '0.302', 'AMMO3': '0.303', 'WEAPON3': '1.850', 'HITCOUNT': '3.010', 'weapon3': '3.420', 'DAMAGECOUNT': '15.267', 'FRAGCOUNT': '54.000'} [2024-08-06 07:49:31,815][52650] Updated weights for policy 0, policy_version 79451 (0.0037) [2024-08-06 07:49:31,876][52811] DAMAGECOUNT value on done: 856240.0 [2024-08-06 07:49:31,877][52811] Sum rewards: 75.553, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.140', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.056', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.504', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '65.000'} [2024-08-06 07:49:32,471][52659] DAMAGECOUNT value on done: 904589.0 [2024-08-06 07:49:32,473][52659] Sum rewards: 72.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.951', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.180', 'AMMO4': '0.198', 'weapon2': '0.212', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '60.000'} [2024-08-06 07:49:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 650870784. Throughput: 0: 4372.0. Samples: 162718050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:32,794][52567] Avg episode reward: [(0, '74.148')] [2024-08-06 07:49:33,048][52667] DAMAGECOUNT value on done: 916435.0 [2024-08-06 07:49:33,048][52667] Sum rewards: 65.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.102', 'AMMO3': '0.226', 'weapon2': '0.288', 'AMMO4': '0.296', 'weapon5': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.940', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '54.000'} [2024-08-06 07:49:33,147][52662] DAMAGECOUNT value on done: 901702.0 [2024-08-06 07:49:33,151][52662] Sum rewards: 70.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.271', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.306', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '61.000'} [2024-08-06 07:49:33,914][52660] DAMAGECOUNT value on done: 909376.0 [2024-08-06 07:49:33,914][52660] Sum rewards: 80.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.778', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.096', 'AMMO4': '0.114', 'weapon2': '0.134', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'WEAPON3': '1.850', 'weapon3': '3.394', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '69.000'} [2024-08-06 07:49:34,858][52811] DAMAGECOUNT value on done: 846030.0 [2024-08-06 07:49:34,859][52811] Sum rewards: 79.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.355', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.163', 'weapon2': '0.706', 'WEAPON3': '0.950', 'weapon3': '3.100', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:35,465][52659] DAMAGECOUNT value on done: 912705.0 [2024-08-06 07:49:35,468][52659] Sum rewards: 78.489, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.072', 'AMMO4': '0.099', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.616', 'WEAPON3': '1.550', 'weapon3': '2.936', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '68.000'} [2024-08-06 07:49:35,600][52667] DAMAGECOUNT value on done: 918191.0 [2024-08-06 07:49:35,602][52667] Sum rewards: 82.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.410', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.016', 'AMMO4': '0.048', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.446', 'WEAPON3': '1.550', 'weapon3': '3.244', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '70.000'} [2024-08-06 07:49:36,348][52662] DAMAGECOUNT value on done: 896870.0 [2024-08-06 07:49:36,349][52662] Sum rewards: 81.626, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.009', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.118', 'HEALTH': '0.134', 'AMMO3': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'weapon4': '0.416', 'WEAPON3': '0.900', 'weapon3': '3.034', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '64.000'} [2024-08-06 07:49:36,650][52650] Updated weights for policy 0, policy_version 79461 (0.0037) [2024-08-06 07:49:36,710][52660] DAMAGECOUNT value on done: 898457.0 [2024-08-06 07:49:36,711][52660] Sum rewards: 78.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.336', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.236', 'WEAPON3': '1.250', 'weapon3': '3.476', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '65.000'} [2024-08-06 07:49:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 650960896. Throughput: 0: 4373.6. Samples: 162744490. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:37,794][52567] Avg episode reward: [(0, '74.390')] [2024-08-06 07:49:38,099][52811] DAMAGECOUNT value on done: 843399.0 [2024-08-06 07:49:38,100][52811] Sum rewards: 65.918, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.425', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO4': '0.143', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.700', 'weapon3': '3.370', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '56.000'} [2024-08-06 07:49:38,172][52667] DAMAGECOUNT value on done: 912316.0 [2024-08-06 07:49:38,173][52667] Sum rewards: 83.396, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.154', 'AMMO2': '0.012', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.172', 'weapon2': '0.424', 'WEAPON3': '0.950', 'weapon3': '3.390', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:38,492][52659] DAMAGECOUNT value on done: 899774.0 [2024-08-06 07:49:38,492][52659] Sum rewards: 78.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.370', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.116', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '64.000'} [2024-08-06 07:49:39,587][52660] DAMAGECOUNT value on done: 894275.0 [2024-08-06 07:49:39,589][52660] Sum rewards: 88.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.470', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.080', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO4': '0.168', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.208', 'WEAPON3': '1.050', 'weapon3': '3.360', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.769', 'FRAGCOUNT': '71.000'} [2024-08-06 07:49:40,831][52667] DAMAGECOUNT value on done: 909539.0 [2024-08-06 07:49:40,833][52667] Sum rewards: 74.388, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon5': '0.072', 'AMMO4': '0.073', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:41,160][52811] DAMAGECOUNT value on done: 844149.0 [2024-08-06 07:49:41,162][52811] Sum rewards: 84.844, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.125', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.074', 'AMMO4': '0.092', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon5': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.832', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '68.000'} [2024-08-06 07:49:41,395][52650] Updated weights for policy 0, policy_version 79471 (0.0012) [2024-08-06 07:49:41,444][52659] DAMAGECOUNT value on done: 911415.0 [2024-08-06 07:49:41,444][52659] Sum rewards: 78.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.042', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon5': '0.084', 'weapon4': '0.090', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:42,058][52660] DAMAGECOUNT value on done: 901952.0 [2024-08-06 07:49:42,058][52660] Sum rewards: 72.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.162', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.158', 'weapon5': '0.172', 'AMMO4': '0.241', 'weapon2': '0.248', 'WEAPON5': '0.350', 'weapon4': '0.444', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.950', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.611', 'FRAGCOUNT': '58.000'} [2024-08-06 07:49:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 651051008. Throughput: 0: 4372.2. Samples: 162770830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:42,794][52567] Avg episode reward: [(0, '74.921')] [2024-08-06 07:49:43,840][52659] DAMAGECOUNT value on done: 903958.0 [2024-08-06 07:49:43,840][52659] Sum rewards: 83.730, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.342', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon4': '0.240', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '67.000'} [2024-08-06 07:49:43,921][52667] DAMAGECOUNT value on done: 914333.0 [2024-08-06 07:49:43,921][52667] Sum rewards: 79.006, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.874', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.118', 'weapon5': '0.144', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:44,258][52647] DAMAGECOUNT value on done: 965130.0 [2024-08-06 07:49:44,259][52647] Sum rewards: 77.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.792', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.068', 'weapon5': '0.076', 'AMMO4': '0.186', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.500', 'weapon3': '2.986', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '65.500'} [2024-08-06 07:49:44,338][52811] DAMAGECOUNT value on done: 844960.0 [2024-08-06 07:49:44,338][52811] Sum rewards: 80.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.164', 'weapon4': '0.184', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:45,095][52660] DAMAGECOUNT value on done: 895324.0 [2024-08-06 07:49:45,095][52660] Sum rewards: 76.185, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.580', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.227', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:45,797][52650] Updated weights for policy 0, policy_version 79481 (0.0027) [2024-08-06 07:49:46,514][52659] DAMAGECOUNT value on done: 902477.0 [2024-08-06 07:49:46,522][52659] Sum rewards: 71.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.102', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '59.500'} [2024-08-06 07:49:47,278][52647] DAMAGECOUNT value on done: 953036.0 [2024-08-06 07:49:47,279][52647] Sum rewards: 82.638, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.505', 'AMMO5': '0.011', 'weapon4': '0.032', 'AMMO2': '0.035', 'weapon5': '0.070', 'WEAPON4': '0.150', 'AMMO4': '0.174', 'weapon2': '0.182', 'WEAPON5': '0.200', 'AMMO3': '0.302', 'WEAPON3': '1.800', 'weapon3': '3.440', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.757', 'FRAGCOUNT': '72.000'} [2024-08-06 07:49:47,305][52811] DAMAGECOUNT value on done: 853225.0 [2024-08-06 07:49:47,305][52811] Sum rewards: 75.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.764', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon4': '0.208', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:47,790][52660] DAMAGECOUNT value on done: 895712.0 [2024-08-06 07:49:47,791][52660] Sum rewards: 74.960, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.255', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.056', 'AMMO4': '0.179', 'weapon5': '0.190', 'AMMO3': '0.225', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.188', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '64.000'} [2024-08-06 07:49:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 651141120. Throughput: 0: 4376.7. Samples: 162783930. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:47,794][52567] Avg episode reward: [(0, '75.159')] [2024-08-06 07:49:49,240][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:49:49,403][52659] DAMAGECOUNT value on done: 905752.0 [2024-08-06 07:49:49,403][52659] Sum rewards: 79.236, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.570', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.158', 'weapon2': '0.196', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '66.000'} [2024-08-06 07:49:50,424][52811] DAMAGECOUNT value on done: 856489.0 [2024-08-06 07:49:50,424][52811] Sum rewards: 74.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.118', 'weapon2': '0.224', 'AMMO3': '0.238', 'AMMO4': '0.240', 'weapon4': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:50,449][52660] DAMAGECOUNT value on done: 907749.0 [2024-08-06 07:49:50,451][52660] Sum rewards: 70.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.044', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.130', 'AMMO4': '0.154', 'AMMO3': '0.196', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.318', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '59.000'} [2024-08-06 07:49:50,492][52647] DAMAGECOUNT value on done: 959146.0 [2024-08-06 07:49:50,492][52647] Sum rewards: 77.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.247', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.096', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:50,711][52650] Updated weights for policy 0, policy_version 79491 (0.0021) [2024-08-06 07:49:52,328][52803] DAMAGECOUNT value on done: 842131.0 [2024-08-06 07:49:52,329][52803] Sum rewards: 80.849, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.088', 'weapon5': '0.096', 'AMMO4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '3.054', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '63.000'} [2024-08-06 07:49:52,362][52659] DAMAGECOUNT value on done: 905086.0 [2024-08-06 07:49:52,364][52659] Sum rewards: 77.348, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon5': '0.038', 'WEAPON5': '0.050', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.198', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '64.000'} [2024-08-06 07:49:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 651231232. Throughput: 0: 4377.8. Samples: 162810340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 07:49:52,794][52567] Avg episode reward: [(0, '75.341')] [2024-08-06 07:49:53,441][52811] DAMAGECOUNT value on done: 844002.0 [2024-08-06 07:49:53,441][52811] Sum rewards: 71.440, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'HEALTH': '0.040', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.336', 'WEAPON3': '1.050', 'HITCOUNT': '3.300', 'weapon3': '3.376', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '57.000'} [2024-08-06 07:49:53,506][52660] DAMAGECOUNT value on done: 919491.0 [2024-08-06 07:49:53,506][52660] Sum rewards: 60.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.140', 'weapon5': '0.178', 'AMMO3': '0.220', 'weapon2': '0.246', 'AMMO4': '0.271', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '3.144', 'DAMAGECOUNT': '15.177', 'FRAGCOUNT': '52.000'} [2024-08-06 07:49:53,605][52647] DAMAGECOUNT value on done: 958511.0 [2024-08-06 07:49:53,606][52647] Sum rewards: 82.738, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.068', 'weapon5': '0.216', 'AMMO3': '0.236', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '70.000'} [2024-08-06 07:49:54,780][52659] DAMAGECOUNT value on done: 914073.0 [2024-08-06 07:49:54,780][52659] Sum rewards: 68.600, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.997', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.278', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '58.000'} [2024-08-06 07:49:55,271][52650] Updated weights for policy 0, policy_version 79501 (0.0012) [2024-08-06 07:49:55,430][52803] DAMAGECOUNT value on done: 840399.0 [2024-08-06 07:49:55,431][52803] Sum rewards: 79.479, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.960', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.152', 'weapon4': '0.158', 'AMMO3': '0.174', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:56,505][52811] DAMAGECOUNT value on done: 842113.0 [2024-08-06 07:49:56,506][52811] Sum rewards: 81.521, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.104', 'weapon4': '0.128', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '68.500'} [2024-08-06 07:49:56,663][52658] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('weapon5', 0.002)] [2024-08-06 07:49:56,791][52647] DAMAGECOUNT value on done: 967649.0 [2024-08-06 07:49:56,794][52647] Sum rewards: 77.540, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.242', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '61.000'} [2024-08-06 07:49:56,829][52660] DAMAGECOUNT value on done: 898668.0 [2024-08-06 07:49:56,831][52660] Sum rewards: 70.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.090', 'AMMO3': '0.238', 'AMMO4': '0.253', 'weapon5': '0.280', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '58.000'} [2024-08-06 07:49:57,497][52659] DAMAGECOUNT value on done: 898917.0 [2024-08-06 07:49:57,497][52659] Sum rewards: 74.091, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.045', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.170', 'AMMO4': '0.175', 'weapon2': '0.224', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.294', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '61.000'} [2024-08-06 07:49:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 651313152. Throughput: 0: 4371.8. Samples: 162836250. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:49:57,795][52567] Avg episode reward: [(0, '75.019')] [2024-08-06 07:49:58,593][52803] DAMAGECOUNT value on done: 849258.0 [2024-08-06 07:49:58,593][52803] Sum rewards: 83.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.830', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.142', 'AMMO3': '0.207', 'WEAPON3': '1.400', 'weapon3': '3.676', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '68.000'} [2024-08-06 07:49:58,887][52665] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:49:59,503][52660] DAMAGECOUNT value on done: 906442.0 [2024-08-06 07:49:59,505][52660] Sum rewards: 74.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon4': '0.120', 'weapon5': '0.136', 'weapon2': '0.206', 'AMMO4': '0.235', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '62.000'} [2024-08-06 07:49:59,943][52647] DAMAGECOUNT value on done: 963590.0 [2024-08-06 07:49:59,943][52647] Sum rewards: 84.297, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.500', 'AMMO5': '0.016', 'AMMO2': '0.069', 'weapon4': '0.122', 'weapon5': '0.220', 'AMMO3': '0.234', 'weapon2': '0.276', 'AMMO4': '0.346', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '21.387', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:00,093][52650] Updated weights for policy 0, policy_version 79511 (0.0020) [2024-08-06 07:50:00,253][52659] DAMAGECOUNT value on done: 910761.0 [2024-08-06 07:50:00,254][52659] Sum rewards: 70.508, reward structure: {'DEATHCOUNT': '-18.000', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.105', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.250', 'weapon2': '0.258', 'AMMO3': '0.283', 'WEAPON3': '1.500', 'HITCOUNT': '3.120', 'weapon3': '3.202', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:00,659][52658] DAMAGECOUNT value on done: 907369.0 [2024-08-06 07:50:00,659][52658] Sum rewards: 79.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon4': '0.154', 'weapon2': '0.208', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.348', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:01,651][52803] DAMAGECOUNT value on done: 846314.0 [2024-08-06 07:50:01,651][52803] Sum rewards: 73.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.036', 'weapon4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon2': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.226', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:02,208][52660] DAMAGECOUNT value on done: 902893.0 [2024-08-06 07:50:02,211][52660] Sum rewards: 70.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.697', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.099', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '59.000'} [2024-08-06 07:50:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 651403264. Throughput: 0: 4378.7. Samples: 162849600. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:02,794][52567] Avg episode reward: [(0, '75.445')] [2024-08-06 07:50:02,946][52659] DAMAGECOUNT value on done: 904219.0 [2024-08-06 07:50:02,950][52659] Sum rewards: 77.780, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.864', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.176', 'AMMO4': '0.180', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.630', 'WEAPON3': '1.550', 'weapon3': '2.874', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:03,143][52647] DAMAGECOUNT value on done: 965106.0 [2024-08-06 07:50:03,145][52647] Sum rewards: 67.069, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO3': '0.138', 'weapon5': '0.138', 'AMMO4': '0.144', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'WEAPON3': '0.900', 'HITCOUNT': '2.970', 'weapon3': '3.152', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '54.000'} [2024-08-06 07:50:03,386][52658] DAMAGECOUNT value on done: 910806.0 [2024-08-06 07:50:03,388][52658] Sum rewards: 71.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.160', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.082', 'weapon5': '0.218', 'AMMO3': '0.225', 'AMMO4': '0.244', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.152', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '59.000'} [2024-08-06 07:50:04,795][52650] Updated weights for policy 0, policy_version 79521 (0.0013) [2024-08-06 07:50:04,803][52803] DAMAGECOUNT value on done: 842289.0 [2024-08-06 07:50:04,805][52803] Sum rewards: 73.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.738', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'AMMO3': '0.225', 'weapon2': '0.582', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '61.000'} [2024-08-06 07:50:05,155][52660] DAMAGECOUNT value on done: 894822.0 [2024-08-06 07:50:05,157][52660] Sum rewards: 81.813, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.940', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.098', 'weapon2': '0.154', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.600', 'weapon3': '3.464', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:05,747][52647] DAMAGECOUNT value on done: 940728.0 [2024-08-06 07:50:05,747][52647] Sum rewards: 63.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.396', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '50.000'} [2024-08-06 07:50:06,251][52658] DAMAGECOUNT value on done: 910711.0 [2024-08-06 07:50:06,253][52658] Sum rewards: 77.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.133', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.132', 'weapon4': '0.138', 'AMMO4': '0.170', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:07,667][52658] Large shaping reward 2.527 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.105, -35.0), ('weapon5', 0.002)] [2024-08-06 07:50:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 651485184. Throughput: 0: 4377.1. Samples: 162875820. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:07,794][52567] Avg episode reward: [(0, '75.294')] [2024-08-06 07:50:07,836][52660] DAMAGECOUNT value on done: 893864.0 [2024-08-06 07:50:07,837][52660] Sum rewards: 79.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.060', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.492', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:08,003][52803] DAMAGECOUNT value on done: 843830.0 [2024-08-06 07:50:08,003][52803] Sum rewards: 73.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.109', 'AMMO2': '0.002', 'AMMO4': '0.011', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO3': '0.166', 'weapon2': '0.650', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '60.000'} [2024-08-06 07:50:08,030][52647] DAMAGECOUNT value on done: 956209.0 [2024-08-06 07:50:08,031][52647] Sum rewards: 72.032, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.657', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'AMMO3': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.504', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '57.000'} [2024-08-06 07:50:08,038][52669] DAMAGECOUNT value on done: 906065.0 [2024-08-06 07:50:08,039][52669] Sum rewards: 80.142, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.605', 'AMMO5': '0.025', 'AMMO2': '0.064', 'weapon4': '0.130', 'weapon2': '0.236', 'AMMO3': '0.248', 'AMMO4': '0.323', 'weapon5': '0.338', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:09,249][52650] Updated weights for policy 0, policy_version 79531 (0.0011) [2024-08-06 07:50:09,389][52658] DAMAGECOUNT value on done: 909982.0 [2024-08-06 07:50:09,390][52658] Sum rewards: 74.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.635', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '59.000'} [2024-08-06 07:50:10,608][52647] DAMAGECOUNT value on done: 956331.0 [2024-08-06 07:50:10,608][52647] Sum rewards: 74.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.162', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.151', 'weapon5': '0.162', 'AMMO3': '0.219', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:10,988][52803] DAMAGECOUNT value on done: 837538.0 [2024-08-06 07:50:10,990][52803] Sum rewards: 65.500, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.555', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.188', 'weapon2': '0.234', 'WEAPON4': '0.250', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.336', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '56.000'} [2024-08-06 07:50:11,014][52669] DAMAGECOUNT value on done: 902213.0 [2024-08-06 07:50:11,014][52669] Sum rewards: 72.542, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.371', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon5': '0.246', 'AMMO3': '0.272', 'AMMO4': '0.294', 'weapon2': '0.328', 'weapon4': '0.372', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.654', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '61.000'} [2024-08-06 07:50:11,072][52671] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:50:12,214][52658] DAMAGECOUNT value on done: 902787.0 [2024-08-06 07:50:12,214][52658] Sum rewards: 63.574, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.570', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.078', 'weapon5': '0.170', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.400', 'HITCOUNT': '2.980', 'weapon3': '2.994', 'DAMAGECOUNT': '15.498', 'FRAGCOUNT': '55.000'} [2024-08-06 07:50:12,367][52671] DAMAGECOUNT value on done: 911502.0 [2024-08-06 07:50:12,369][52671] Sum rewards: 78.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.072', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 651575296. Throughput: 0: 4382.4. Samples: 162902060. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:12,794][52567] Avg episode reward: [(0, '74.969')] [2024-08-06 07:50:13,145][52647] DAMAGECOUNT value on done: 953324.0 [2024-08-06 07:50:13,148][52647] Sum rewards: 77.563, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.185', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.422', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:13,826][52669] DAMAGECOUNT value on done: 913733.0 [2024-08-06 07:50:13,827][52669] Sum rewards: 78.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.104', 'AMMO3': '0.220', 'weapon5': '0.220', 'AMMO4': '0.229', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '64.000'} [2024-08-06 07:50:14,071][52650] Updated weights for policy 0, policy_version 79541 (0.0027) [2024-08-06 07:50:14,102][52803] DAMAGECOUNT value on done: 838129.0 [2024-08-06 07:50:14,103][52803] Sum rewards: 75.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.305', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.042', 'weapon5': '0.064', 'AMMO4': '0.085', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'weapon2': '0.744', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:14,770][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:50:15,052][52658] DAMAGECOUNT value on done: 897742.0 [2024-08-06 07:50:15,054][52658] Sum rewards: 82.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.191', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:15,080][52671] DAMAGECOUNT value on done: 917417.0 [2024-08-06 07:50:15,080][52671] Sum rewards: 80.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.964', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.056', 'weapon5': '0.090', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'AMMO4': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '3.264', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:15,919][52647] DAMAGECOUNT value on done: 944798.0 [2024-08-06 07:50:15,920][52647] Sum rewards: 78.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.836', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.084', 'AMMO3': '0.205', 'AMMO4': '0.223', 'weapon5': '0.236', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:16,703][52669] DAMAGECOUNT value on done: 906847.0 [2024-08-06 07:50:16,704][52669] Sum rewards: 84.815, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'weapon4': '0.092', 'AMMO4': '0.096', 'AMMO3': '0.239', 'weapon2': '0.668', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '71.000'} [2024-08-06 07:50:17,256][52803] DAMAGECOUNT value on done: 846664.0 [2024-08-06 07:50:17,257][52803] Sum rewards: 83.073, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.242', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.234', 'AMMO3': '0.241', 'WEAPON3': '1.350', 'weapon3': '3.372', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:17,619][52671] DAMAGECOUNT value on done: 914438.0 [2024-08-06 07:50:17,621][52671] Sum rewards: 80.350, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.892', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.154', 'weapon4': '0.244', 'AMMO3': '0.248', 'AMMO4': '0.257', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.046', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 651665408. Throughput: 0: 4379.8. Samples: 162915140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:17,794][52567] Avg episode reward: [(0, '75.551')] [2024-08-06 07:50:18,195][52658] DAMAGECOUNT value on done: 911934.0 [2024-08-06 07:50:18,195][52658] Sum rewards: 87.015, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.125', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.117', 'weapon4': '0.208', 'weapon2': '0.352', 'WEAPON3': '0.750', 'weapon3': '3.212', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:18,576][52647] DAMAGECOUNT value on done: 957861.0 [2024-08-06 07:50:18,577][52647] Sum rewards: 63.941, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.117', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.149', 'weapon5': '0.210', 'AMMO4': '0.238', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON4': '0.400', 'weapon2': '0.532', 'WEAPON3': '0.850', 'weapon3': '2.636', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.880', 'FRAGCOUNT': '50.000'} [2024-08-06 07:50:18,786][52650] Updated weights for policy 0, policy_version 79551 (0.0011) [2024-08-06 07:50:19,192][52820] DAMAGECOUNT value on done: 837642.0 [2024-08-06 07:50:19,193][52820] Sum rewards: 80.242, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.942', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.402', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:19,666][52794] DAMAGECOUNT value on done: 898760.0 [2024-08-06 07:50:19,667][52794] Sum rewards: 71.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.731', 'AMMO5': '0.025', 'AMMO2': '0.071', 'weapon4': '0.150', 'AMMO3': '0.177', 'weapon5': '0.294', 'AMMO4': '0.357', 'weapon2': '0.568', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.752', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '56.500'} [2024-08-06 07:50:19,699][52669] DAMAGECOUNT value on done: 916417.0 [2024-08-06 07:50:19,700][52669] Sum rewards: 77.093, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.012', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.168', 'AMMO4': '0.182', 'weapon5': '0.182', 'WEAPON5': '0.300', 'AMMO3': '0.344', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.950', 'weapon3': '2.850', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:20,429][52803] DAMAGECOUNT value on done: 839081.0 [2024-08-06 07:50:20,430][52803] Sum rewards: 81.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.158', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:20,724][52671] DAMAGECOUNT value on done: 915594.0 [2024-08-06 07:50:20,726][52671] Sum rewards: 77.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.937', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.197', 'weapon5': '0.202', 'AMMO3': '0.216', 'weapon2': '0.246', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:20,906][52658] DAMAGECOUNT value on done: 900430.0 [2024-08-06 07:50:20,906][52658] Sum rewards: 82.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.444', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.202', 'AMMO3': '0.219', 'AMMO4': '0.224', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:21,066][52647] DAMAGECOUNT value on done: 948500.0 [2024-08-06 07:50:21,067][52647] Sum rewards: 71.480, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.620', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.138', 'weapon4': '0.148', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.317', 'weapon2': '0.396', 'WEAPON3': '1.800', 'weapon3': '3.040', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:21,811][52663] DAMAGECOUNT value on done: 925000.0 [2024-08-06 07:50:21,811][52663] Sum rewards: 80.248, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.018', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon5': '0.180', 'weapon4': '0.200', 'AMMO4': '0.241', 'weapon2': '0.246', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:22,431][52820] DAMAGECOUNT value on done: 839072.0 [2024-08-06 07:50:22,431][52820] Sum rewards: 79.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.090', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.218', 'AMMO4': '0.230', 'AMMO3': '0.248', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '66.500'} [2024-08-06 07:50:22,447][52669] DAMAGECOUNT value on done: 912737.0 [2024-08-06 07:50:22,447][52669] Sum rewards: 66.335, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.175', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.042', 'weapon5': '0.070', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.285', 'weapon2': '0.300', 'WEAPON3': '1.850', 'HITCOUNT': '3.210', 'weapon3': '3.360', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '58.000'} [2024-08-06 07:50:22,707][52794] DAMAGECOUNT value on done: 911122.0 [2024-08-06 07:50:22,707][52794] Sum rewards: 79.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.130', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.175', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 651755520. Throughput: 0: 4378.0. Samples: 162941500. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:22,794][52567] Avg episode reward: [(0, '76.227')] [2024-08-06 07:50:23,321][52650] Updated weights for policy 0, policy_version 79561 (0.0013) [2024-08-06 07:50:23,473][52658] DAMAGECOUNT value on done: 928051.0 [2024-08-06 07:50:23,475][52658] Sum rewards: 76.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.699', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.174', 'weapon4': '0.202', 'AMMO3': '0.226', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:23,549][52803] DAMAGECOUNT value on done: 853908.0 [2024-08-06 07:50:23,549][52803] Sum rewards: 75.749, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.174', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.187', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '60.000'} [2024-08-06 07:50:23,676][52671] DAMAGECOUNT value on done: 922180.0 [2024-08-06 07:50:23,677][52671] Sum rewards: 83.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.704', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.054', 'AMMO4': '0.162', 'weapon5': '0.182', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:24,071][52647] DAMAGECOUNT value on done: 955053.0 [2024-08-06 07:50:24,072][52647] Sum rewards: 66.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.597', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.121', 'weapon5': '0.228', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '57.000'} [2024-08-06 07:50:24,731][52663] DAMAGECOUNT value on done: 908610.0 [2024-08-06 07:50:24,731][52663] Sum rewards: 81.731, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon5': '0.154', 'AMMO3': '0.157', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'weapon2': '0.240', 'weapon4': '0.240', 'WEAPON4': '0.350', 'WEAPON3': '0.950', 'weapon3': '3.188', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:24,937][52669] Large shaping reward 2.613 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.591, 197.0), ('weapon5', 0.002)] [2024-08-06 07:50:25,340][52794] DAMAGECOUNT value on done: 914489.0 [2024-08-06 07:50:25,342][52794] Sum rewards: 92.258, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.202', 'weapon2': '0.382', 'HEALTH': '0.516', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.228', 'FRAGCOUNT': '73.000'} [2024-08-06 07:50:25,393][52669] DAMAGECOUNT value on done: 912029.0 [2024-08-06 07:50:25,395][52669] Sum rewards: 81.967, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.190', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.136', 'AMMO4': '0.141', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:25,545][52794] Large shaping reward 2.574 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.552, 184.0), ('weapon5', 0.002)] [2024-08-06 07:50:25,573][52820] DAMAGECOUNT value on done: 839180.0 [2024-08-06 07:50:25,574][52820] Sum rewards: 62.093, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.989', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.624', 'WEAPON3': '1.400', 'HITCOUNT': '3.060', 'weapon3': '3.144', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '52.000'} [2024-08-06 07:50:26,290][52658] DAMAGECOUNT value on done: 912582.0 [2024-08-06 07:50:26,292][52658] Sum rewards: 82.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.078', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'weapon3': '3.348', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:26,479][52671] DAMAGECOUNT value on done: 908654.0 [2024-08-06 07:50:26,481][52671] Sum rewards: 65.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.456', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.080', 'AMMO4': '0.112', 'weapon5': '0.184', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.200', 'HITCOUNT': '2.910', 'weapon3': '3.034', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '54.000'} [2024-08-06 07:50:26,599][52803] DAMAGECOUNT value on done: 847602.0 [2024-08-06 07:50:26,600][52803] Sum rewards: 82.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.230', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.122', 'weapon5': '0.232', 'AMMO4': '0.242', 'weapon2': '0.244', 'AMMO3': '0.300', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.124', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:27,139][52647] DAMAGECOUNT value on done: 958754.0 [2024-08-06 07:50:27,141][52647] Sum rewards: 75.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon5': '0.104', 'AMMO3': '0.185', 'AMMO4': '0.216', 'WEAPON5': '0.350', 'weapon4': '0.384', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.808', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '61.000'} [2024-08-06 07:50:27,383][52663] DAMAGECOUNT value on done: 902358.0 [2024-08-06 07:50:27,384][52663] Sum rewards: 81.391, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.132', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.058', 'weapon4': '0.192', 'AMMO4': '0.215', 'weapon2': '0.218', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:27,540][52614] Signal inference workers to stop experience collection... (14600 times) [2024-08-06 07:50:27,541][52614] Signal inference workers to resume experience collection... (14600 times) [2024-08-06 07:50:27,575][52650] InferenceWorker_p0-w0: stopping experience collection (14600 times) [2024-08-06 07:50:27,575][52650] InferenceWorker_p0-w0: resuming experience collection (14600 times) [2024-08-06 07:50:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 651837440. Throughput: 0: 4367.3. Samples: 162967360. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:27,794][52567] Avg episode reward: [(0, '76.565')] [2024-08-06 07:50:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079570_651837440.pth... [2024-08-06 07:50:27,837][52669] DAMAGECOUNT value on done: 907874.0 [2024-08-06 07:50:27,840][52669] Sum rewards: 70.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.092', 'AMMO4': '0.175', 'weapon5': '0.182', 'weapon2': '0.214', 'AMMO3': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '58.000'} [2024-08-06 07:50:27,919][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079057_647634944.pth [2024-08-06 07:50:27,990][52664] DAMAGECOUNT value on done: 936024.0 [2024-08-06 07:50:27,992][52664] Sum rewards: 52.763, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon7': '0.122', 'AMMO3': '0.126', 'AMMO4': '0.144', 'WEAPON7': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '0.800', 'weapon4': '0.962', 'weapon3': '2.186', 'HITCOUNT': '2.390', 'DAMAGECOUNT': '12.570', 'FRAGCOUNT': '41.000'} [2024-08-06 07:50:28,175][52650] Updated weights for policy 0, policy_version 79571 (0.0030) [2024-08-06 07:50:28,313][52794] DAMAGECOUNT value on done: 903032.0 [2024-08-06 07:50:28,321][52794] Sum rewards: 70.945, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.710', 'AMMO5': '0.020', 'AMMO2': '0.039', 'AMMO3': '0.128', 'weapon5': '0.184', 'weapon4': '0.188', 'AMMO4': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.740', 'WEAPON3': '0.950', 'weapon3': '2.714', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '55.000'} [2024-08-06 07:50:28,837][52820] DAMAGECOUNT value on done: 827806.0 [2024-08-06 07:50:28,837][52820] Sum rewards: 80.063, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.132', 'AMMO3': '0.177', 'weapon4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '64.000'} [2024-08-06 07:50:29,328][52658] DAMAGECOUNT value on done: 920144.0 [2024-08-06 07:50:29,329][52658] Sum rewards: 72.125, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.145', 'AMMO5': '0.016', 'AMMO2': '0.054', 'AMMO3': '0.185', 'weapon5': '0.240', 'AMMO4': '0.272', 'weapon4': '0.454', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.636', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '58.000'} [2024-08-06 07:50:29,547][52671] DAMAGECOUNT value on done: 913153.0 [2024-08-06 07:50:29,549][52671] Sum rewards: 63.726, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.120', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.136', 'AMMO3': '0.145', 'AMMO4': '0.156', 'weapon5': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '0.900', 'HITCOUNT': '2.830', 'weapon3': '3.048', 'DAMAGECOUNT': '14.115', 'FRAGCOUNT': '51.000'} [2024-08-06 07:50:29,731][52803] DAMAGECOUNT value on done: 838699.0 [2024-08-06 07:50:29,731][52803] Sum rewards: 68.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.956', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.172', 'AMMO3': '0.178', 'weapon4': '0.198', 'AMMO4': '0.254', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '56.000'} [2024-08-06 07:50:30,237][52647] DAMAGECOUNT value on done: 943876.0 [2024-08-06 07:50:30,240][52647] Sum rewards: 69.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.725', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.050', 'weapon4': '0.172', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '59.000'} [2024-08-06 07:50:30,866][52664] DAMAGECOUNT value on done: 940943.0 [2024-08-06 07:50:30,868][52664] Sum rewards: 76.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.532', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.120', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.268', 'weapon4': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:30,906][52663] DAMAGECOUNT value on done: 908465.0 [2024-08-06 07:50:30,906][52663] Sum rewards: 79.836, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.990', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.078', 'weapon5': '0.082', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.632', 'WEAPON3': '0.950', 'weapon3': '3.012', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:31,358][52669] DAMAGECOUNT value on done: 921165.0 [2024-08-06 07:50:31,360][52669] Sum rewards: 64.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.044', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.122', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.050', 'weapon3': '3.302', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '53.000'} [2024-08-06 07:50:31,468][52794] DAMAGECOUNT value on done: 896951.0 [2024-08-06 07:50:31,468][52794] Sum rewards: 72.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.144', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '59.000'} [2024-08-06 07:50:32,012][52820] DAMAGECOUNT value on done: 840384.0 [2024-08-06 07:50:32,014][52820] Sum rewards: 84.691, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO2': '0.019', 'AMMO4': '0.093', 'AMMO3': '0.181', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.336', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:32,123][52658] DAMAGECOUNT value on done: 907709.0 [2024-08-06 07:50:32,124][52658] Sum rewards: 81.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.785', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.140', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.610', 'WEAPON3': '1.200', 'weapon3': '2.822', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:32,537][52671] DAMAGECOUNT value on done: 915146.0 [2024-08-06 07:50:32,539][52671] Sum rewards: 80.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.022', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.056', 'AMMO4': '0.167', 'weapon5': '0.182', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '63.500'} [2024-08-06 07:50:32,787][52650] Updated weights for policy 0, policy_version 79581 (0.0019) [2024-08-06 07:50:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 651927552. Throughput: 0: 4357.3. Samples: 162980010. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:32,794][52567] Avg episode reward: [(0, '75.769')] [2024-08-06 07:50:32,872][52803] DAMAGECOUNT value on done: 856168.0 [2024-08-06 07:50:32,873][52803] Sum rewards: 82.403, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.795', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.042', 'AMMO4': '0.137', 'AMMO3': '0.152', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.264', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:32,895][52647] DAMAGECOUNT value on done: 952636.0 [2024-08-06 07:50:32,895][52647] Sum rewards: 77.211, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.264', 'AMMO3': '0.306', 'WEAPON3': '1.750', 'weapon3': '3.478', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:33,650][52663] DAMAGECOUNT value on done: 908480.0 [2024-08-06 07:50:33,650][52663] Sum rewards: 77.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.660', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.124', 'weapon4': '0.132', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '64.000'} [2024-08-06 07:50:33,784][52664] DAMAGECOUNT value on done: 944607.0 [2024-08-06 07:50:33,784][52664] Sum rewards: 77.846, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.750', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.086', 'AMMO4': '0.202', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'weapon2': '0.314', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:34,116][52669] DAMAGECOUNT value on done: 910000.0 [2024-08-06 07:50:34,117][52669] Sum rewards: 78.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.878', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.040', 'AMMO4': '0.080', 'weapon5': '0.102', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.728', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '64.000'} [2024-08-06 07:50:34,573][52794] DAMAGECOUNT value on done: 904157.0 [2024-08-06 07:50:34,574][52794] Sum rewards: 69.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.150', 'AMMO4': '0.157', 'weapon2': '0.218', 'AMMO3': '0.232', 'weapon4': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '58.000'} [2024-08-06 07:50:35,057][52820] DAMAGECOUNT value on done: 828260.0 [2024-08-06 07:50:35,057][52671] DAMAGECOUNT value on done: 899715.0 [2024-08-06 07:50:35,065][52820] Sum rewards: 86.428, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.932', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.090', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '3.054', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:35,066][52671] Sum rewards: 73.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.275', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.110', 'AMMO4': '0.204', 'AMMO3': '0.211', 'weapon5': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '60.000'} [2024-08-06 07:50:35,125][52658] DAMAGECOUNT value on done: 917428.0 [2024-08-06 07:50:35,127][52658] Sum rewards: 71.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.711', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon4': '0.154', 'AMMO3': '0.201', 'AMMO4': '0.234', 'weapon5': '0.264', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '57.000'} [2024-08-06 07:50:35,868][52647] DAMAGECOUNT value on done: 943647.0 [2024-08-06 07:50:35,870][52647] Sum rewards: 83.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.106', 'AMMO3': '0.165', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.246', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:35,956][52803] DAMAGECOUNT value on done: 840176.0 [2024-08-06 07:50:35,957][52803] Sum rewards: 86.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.056', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.130', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.246', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:36,587][52663] DAMAGECOUNT value on done: 915311.0 [2024-08-06 07:50:36,588][52663] Sum rewards: 77.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.094', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.118', 'AMMO4': '0.143', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:36,632][52664] DAMAGECOUNT value on done: 934059.0 [2024-08-06 07:50:36,632][52664] Sum rewards: 74.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.160', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.066', 'weapon5': '0.116', 'AMMO4': '0.133', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '61.000'} [2024-08-06 07:50:37,039][52669] DAMAGECOUNT value on done: 918099.0 [2024-08-06 07:50:37,042][52669] Sum rewards: 77.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.579', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.102', 'weapon5': '0.130', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:37,067][52795] DAMAGECOUNT value on done: 837687.0 [2024-08-06 07:50:37,068][52795] Sum rewards: 66.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.205', 'AMMO4': '0.251', 'weapon5': '0.270', 'weapon4': '0.304', 'weapon2': '0.378', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '55.000'} [2024-08-06 07:50:37,087][52794] DAMAGECOUNT value on done: 907664.0 [2024-08-06 07:50:37,088][52794] Sum rewards: 76.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.638', 'AMMO5': '0.020', 'AMMO2': '0.059', 'AMMO3': '0.216', 'weapon2': '0.252', 'AMMO4': '0.295', 'weapon5': '0.298', 'weapon4': '0.316', 'WEAPON5': '0.500', 'WEAPON4': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:37,367][52650] Updated weights for policy 0, policy_version 79591 (0.0027) [2024-08-06 07:50:37,733][52668] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:50:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 652009472. Throughput: 0: 4358.2. Samples: 163006460. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:50:37,794][52567] Avg episode reward: [(0, '75.789')] [2024-08-06 07:50:37,806][52658] DAMAGECOUNT value on done: 905481.0 [2024-08-06 07:50:37,808][52658] Sum rewards: 81.863, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.008', 'weapon4': '0.024', 'AMMO2': '0.044', 'weapon5': '0.090', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.221', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.216', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '64.000'} [2024-08-06 07:50:38,057][52671] DAMAGECOUNT value on done: 914156.0 [2024-08-06 07:50:38,058][52671] Sum rewards: 79.162, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.876', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO4': '0.197', 'AMMO3': '0.210', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:38,208][52820] DAMAGECOUNT value on done: 834626.0 [2024-08-06 07:50:38,208][52820] Sum rewards: 78.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.754', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.040', 'weapon5': '0.110', 'AMMO4': '0.123', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:38,820][52647] DAMAGECOUNT value on done: 946940.0 [2024-08-06 07:50:38,820][52647] Sum rewards: 82.891, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon4': '0.100', 'AMMO3': '0.190', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:39,066][52803] DAMAGECOUNT value on done: 848401.0 [2024-08-06 07:50:39,066][52803] Sum rewards: 82.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.050', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.076', 'weapon5': '0.128', 'weapon2': '0.134', 'AMMO4': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.600', 'weapon3': '3.424', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.604', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:39,837][52663] DAMAGECOUNT value on done: 906320.0 [2024-08-06 07:50:39,837][52663] Sum rewards: 58.276, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.409', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.128', 'AMMO3': '0.151', 'AMMO4': '0.152', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'HITCOUNT': '2.900', 'weapon3': '3.420', 'DAMAGECOUNT': '14.964', 'FRAGCOUNT': '46.500'} [2024-08-06 07:50:39,852][52664] DAMAGECOUNT value on done: 948815.0 [2024-08-06 07:50:39,854][52664] Sum rewards: 85.300, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.143', 'AMMO3': '0.237', 'weapon5': '0.246', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.327', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:40,105][52794] DAMAGECOUNT value on done: 895354.0 [2024-08-06 07:50:40,116][52794] Sum rewards: 83.735, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.042', 'weapon5': '0.134', 'HEALTH': '0.192', 'AMMO4': '0.194', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:40,183][52795] DAMAGECOUNT value on done: 826646.0 [2024-08-06 07:50:40,185][52795] Sum rewards: 80.813, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.927', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.128', 'AMMO4': '0.207', 'AMMO3': '0.212', 'weapon5': '0.222', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '67.000'} [2024-08-06 07:50:40,295][52669] DAMAGECOUNT value on done: 918099.0 [2024-08-06 07:50:40,295][52669] Sum rewards: 86.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.265', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.116', 'AMMO4': '0.188', 'AMMO3': '0.198', 'weapon5': '0.226', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:40,743][52658] DAMAGECOUNT value on done: 913004.0 [2024-08-06 07:50:40,744][52658] Sum rewards: 77.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.126', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.199', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '64.500'} [2024-08-06 07:50:40,810][52671] DAMAGECOUNT value on done: 912167.0 [2024-08-06 07:50:40,811][52671] Sum rewards: 71.928, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.351', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.128', 'AMMO4': '0.134', 'AMMO3': '0.222', 'weapon5': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.706', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '61.000'} [2024-08-06 07:50:41,475][52820] DAMAGECOUNT value on done: 838507.0 [2024-08-06 07:50:41,476][52820] Sum rewards: 66.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.421', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon5': '0.172', 'weapon4': '0.208', 'AMMO4': '0.211', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '2.974', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '54.000'} [2024-08-06 07:50:41,987][52803] DAMAGECOUNT value on done: 849862.0 [2024-08-06 07:50:41,987][52803] Sum rewards: 79.367, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.062', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO3': '0.127', 'weapon5': '0.136', 'AMMO4': '0.147', 'WEAPON5': '0.250', 'weapon4': '0.288', 'WEAPON4': '0.350', 'weapon2': '0.504', 'WEAPON3': '0.800', 'weapon3': '2.914', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '60.000'} [2024-08-06 07:50:42,387][52650] Updated weights for policy 0, policy_version 79601 (0.0022) [2024-08-06 07:50:42,741][52664] DAMAGECOUNT value on done: 944048.0 [2024-08-06 07:50:42,746][52664] Sum rewards: 65.752, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.018', 'WEAPON5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.084', 'AMMO3': '0.133', 'WEAPON4': '0.150', 'weapon2': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '53.000'} [2024-08-06 07:50:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 652099584. Throughput: 0: 4362.7. Samples: 163032570. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:50:42,795][52567] Avg episode reward: [(0, '76.020')] [2024-08-06 07:50:43,103][52663] DAMAGECOUNT value on done: 893717.0 [2024-08-06 07:50:43,103][52663] Sum rewards: 67.124, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.022', 'AMMO4': '0.045', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'weapon2': '0.396', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.350', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '56.000'} [2024-08-06 07:50:43,326][52658] DAMAGECOUNT value on done: 895881.0 [2024-08-06 07:50:43,326][52658] Sum rewards: 81.084, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.536', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.170', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'WEAPON3': '1.000', 'weapon3': '3.210', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:43,396][52671] DAMAGECOUNT value on done: 909111.0 [2024-08-06 07:50:43,397][52671] Sum rewards: 70.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.900', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.080', 'weapon4': '0.110', 'AMMO4': '0.135', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '57.000'} [2024-08-06 07:50:43,437][52795] DAMAGECOUNT value on done: 831995.0 [2024-08-06 07:50:43,438][52795] Sum rewards: 71.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.188', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.530', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '60.000'} [2024-08-06 07:50:43,507][52794] DAMAGECOUNT value on done: 910628.0 [2024-08-06 07:50:43,508][52794] Sum rewards: 89.046, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.188', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.840', 'FRAGCOUNT': '72.000'} [2024-08-06 07:50:43,528][52669] DAMAGECOUNT value on done: 904892.0 [2024-08-06 07:50:43,535][52669] Sum rewards: 71.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.270', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.067', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.257', 'weapon2': '0.544', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:44,731][52820] DAMAGECOUNT value on done: 843602.0 [2024-08-06 07:50:44,731][52820] Sum rewards: 85.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.114', 'AMMO4': '0.132', 'weapon2': '0.184', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '71.000'} [2024-08-06 07:50:45,044][52803] DAMAGECOUNT value on done: 855228.0 [2024-08-06 07:50:45,046][52803] Sum rewards: 65.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.186', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.044', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.464', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '54.000'} [2024-08-06 07:50:45,589][52663] DAMAGECOUNT value on done: 904614.0 [2024-08-06 07:50:45,590][52663] Sum rewards: 80.178, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.815', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.180', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.580', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:45,612][52664] DAMAGECOUNT value on done: 932147.0 [2024-08-06 07:50:45,613][52664] Sum rewards: 68.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.492', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.115', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.100', 'HITCOUNT': '3.210', 'weapon3': '3.232', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '55.000'} [2024-08-06 07:50:45,872][52669] DAMAGECOUNT value on done: 904555.0 [2024-08-06 07:50:45,875][52669] Sum rewards: 78.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.062', 'weapon5': '0.088', 'weapon4': '0.140', 'AMMO3': '0.245', 'WEAPON5': '0.300', 'AMMO4': '0.309', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:46,338][52794] DAMAGECOUNT value on done: 902312.0 [2024-08-06 07:50:46,340][52671] DAMAGECOUNT value on done: 914918.0 [2024-08-06 07:50:46,340][52794] Sum rewards: 72.953, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.325', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.278', 'weapon2': '0.312', 'WEAPON3': '1.700', 'weapon3': '3.404', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '64.000'} [2024-08-06 07:50:46,343][52671] Sum rewards: 70.105, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.894', 'AMMO5': '0.025', 'AMMO2': '0.064', 'weapon4': '0.144', 'AMMO3': '0.219', 'weapon2': '0.308', 'AMMO4': '0.319', 'weapon5': '0.360', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.832', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '58.000'} [2024-08-06 07:50:46,486][52658] DAMAGECOUNT value on done: 913868.0 [2024-08-06 07:50:46,487][52658] Sum rewards: 74.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.359', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.062', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.362', 'WEAPON3': '1.150', 'HITCOUNT': '3.150', 'weapon3': '3.410', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '61.000'} [2024-08-06 07:50:46,692][52795] DAMAGECOUNT value on done: 845091.0 [2024-08-06 07:50:46,693][52795] Sum rewards: 89.258, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.098', 'WEAPON5': '0.100', 'weapon5': '0.112', 'AMMO4': '0.132', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'HEALTH': '0.404', 'weapon2': '0.424', 'WEAPON3': '0.950', 'weapon3': '3.128', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:46,756][52650] Updated weights for policy 0, policy_version 79611 (0.0011) [2024-08-06 07:50:47,007][52667] Large shaping reward 3.612 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('weapon5', 0.002)] [2024-08-06 07:50:47,787][52820] DAMAGECOUNT value on done: 849886.0 [2024-08-06 07:50:47,787][52820] Sum rewards: 87.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.337', 'AMMO2': '0.008', 'AMMO4': '0.041', 'AMMO3': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.342', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:47,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 652181504. Throughput: 0: 4350.9. Samples: 163045390. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:50:47,795][52567] Avg episode reward: [(0, '76.272')] [2024-08-06 07:50:48,196][52664] DAMAGECOUNT value on done: 933299.0 [2024-08-06 07:50:48,197][52664] Sum rewards: 75.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.793', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.068', 'weapon4': '0.108', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:48,224][52803] DAMAGECOUNT value on done: 853375.0 [2024-08-06 07:50:48,224][52803] Sum rewards: 79.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon4': '0.066', 'weapon5': '0.140', 'AMMO3': '0.217', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:48,228][52663] DAMAGECOUNT value on done: 904939.0 [2024-08-06 07:50:48,230][52663] Sum rewards: 72.305, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.622', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.118', 'AMMO4': '0.151', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '59.000'} [2024-08-06 07:50:48,551][52669] DAMAGECOUNT value on done: 911150.0 [2024-08-06 07:50:48,553][52669] Sum rewards: 73.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.172', 'AMMO3': '0.221', 'weapon5': '0.240', 'AMMO4': '0.282', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:48,739][52658] DAMAGECOUNT value on done: 905632.0 [2024-08-06 07:50:48,741][52658] Sum rewards: 79.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.226', 'weapon4': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:49,365][52671] DAMAGECOUNT value on done: 912136.0 [2024-08-06 07:50:49,368][52671] Sum rewards: 70.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.130', 'weapon2': '0.146', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.278', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '57.000'} [2024-08-06 07:50:49,622][52794] DAMAGECOUNT value on done: 896743.0 [2024-08-06 07:50:49,622][52794] Sum rewards: 65.125, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.832', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.068', 'AMMO4': '0.104', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '56.000'} [2024-08-06 07:50:49,913][52795] DAMAGECOUNT value on done: 829238.0 [2024-08-06 07:50:49,916][52795] Sum rewards: 73.510, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'weapon2': '0.174', 'AMMO3': '0.243', 'WEAPON3': '1.500', 'HITCOUNT': '3.410', 'weapon3': '3.422', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:50,986][52820] DAMAGECOUNT value on done: 833042.0 [2024-08-06 07:50:50,988][52663] DAMAGECOUNT value on done: 913621.0 [2024-08-06 07:50:50,996][52820] Sum rewards: 90.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.049', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.114', 'AMMO3': '0.208', 'AMMO4': '0.249', 'weapon5': '0.270', 'weapon2': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '22.335', 'FRAGCOUNT': '72.000'} [2024-08-06 07:50:50,996][52663] Sum rewards: 77.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.903', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.128', 'AMMO4': '0.145', 'weapon2': '0.276', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.850', 'weapon3': '3.240', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:51,159][52664] DAMAGECOUNT value on done: 942667.0 [2024-08-06 07:50:51,160][52664] Sum rewards: 64.143, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.134', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.196', 'weapon5': '0.206', 'AMMO4': '0.267', 'AMMO3': '0.268', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.812', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '55.500'} [2024-08-06 07:50:51,242][52669] DAMAGECOUNT value on done: 933863.0 [2024-08-06 07:50:51,243][52669] Sum rewards: 79.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.416', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.171', 'weapon5': '0.178', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:51,344][52803] DAMAGECOUNT value on done: 849933.0 [2024-08-06 07:50:51,345][52803] Sum rewards: 75.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.015', 'AMMO2': '0.005', 'AMMO5': '0.010', 'weapon4': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'weapon5': '0.058', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '60.000'} [2024-08-06 07:50:51,735][52650] Updated weights for policy 0, policy_version 79621 (0.0012) [2024-08-06 07:50:51,855][52658] DAMAGECOUNT value on done: 902297.0 [2024-08-06 07:50:51,856][52658] Sum rewards: 74.502, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.274', 'weapon2': '0.324', 'WEAPON3': '1.650', 'weapon3': '3.318', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:52,129][52671] DAMAGECOUNT value on done: 897858.0 [2024-08-06 07:50:52,131][52671] Sum rewards: 63.848, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.083', 'AMMO5': '0.012', 'weapon4': '0.040', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO4': '0.203', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.072', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '55.000'} [2024-08-06 07:50:52,741][52794] DAMAGECOUNT value on done: 910637.0 [2024-08-06 07:50:52,743][52794] Sum rewards: 75.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.294', 'AMMO5': '0.024', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.188', 'AMMO3': '0.218', 'AMMO4': '0.271', 'weapon2': '0.370', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '62.000'} [2024-08-06 07:50:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 652271616. Throughput: 0: 4351.5. Samples: 163071640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:50:52,794][52567] Avg episode reward: [(0, '76.006')] [2024-08-06 07:50:53,117][52795] DAMAGECOUNT value on done: 835038.0 [2024-08-06 07:50:53,117][52795] Sum rewards: 58.359, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.789', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.104', 'AMMO3': '0.243', 'weapon5': '0.264', 'AMMO4': '0.282', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.598', 'WEAPON3': '1.500', 'weapon3': '2.708', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '51.000'} [2024-08-06 07:50:53,612][52664] DAMAGECOUNT value on done: 940805.0 [2024-08-06 07:50:53,614][52664] Sum rewards: 82.942, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.172', 'weapon5': '0.218', 'AMMO3': '0.226', 'weapon2': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '70.000'} [2024-08-06 07:50:53,637][52663] DAMAGECOUNT value on done: 896915.0 [2024-08-06 07:50:53,637][52663] Sum rewards: 89.287, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.154', 'AMMO4': '0.175', 'AMMO3': '0.217', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.124', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.972', 'FRAGCOUNT': '73.500'} [2024-08-06 07:50:53,817][52669] DAMAGECOUNT value on done: 920708.0 [2024-08-06 07:50:53,820][52669] Sum rewards: 65.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.958', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.060', 'weapon4': '0.074', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.332', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '55.000'} [2024-08-06 07:50:54,145][52820] DAMAGECOUNT value on done: 843556.0 [2024-08-06 07:50:54,145][52820] Sum rewards: 84.630, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.276', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.181', 'weapon4': '0.352', 'weapon2': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.810', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '66.500'} [2024-08-06 07:50:54,728][52658] DAMAGECOUNT value on done: 911324.0 [2024-08-06 07:50:54,729][52658] Sum rewards: 76.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.488', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:55,394][52671] DAMAGECOUNT value on done: 922540.0 [2024-08-06 07:50:55,396][52671] Sum rewards: 92.771, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.192', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.096', 'AMMO4': '0.177', 'weapon2': '0.184', 'AMMO3': '0.201', 'WEAPON5': '0.250', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '4.360', 'DAMAGECOUNT': '21.333', 'FRAGCOUNT': '75.000'} [2024-08-06 07:50:55,964][52794] DAMAGECOUNT value on done: 904090.0 [2024-08-06 07:50:55,964][52794] Sum rewards: 69.108, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.455', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.124', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.400', 'weapon3': '2.944', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '57.000'} [2024-08-06 07:50:56,219][52795] DAMAGECOUNT value on done: 844806.0 [2024-08-06 07:50:56,219][52795] Sum rewards: 81.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.857', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.068', 'AMMO4': '0.107', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.440', 'weapon3': '3.482', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '66.000'} [2024-08-06 07:50:56,262][52664] DAMAGECOUNT value on done: 949191.0 [2024-08-06 07:50:56,262][52664] Sum rewards: 83.462, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.252', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.134', 'weapon4': '0.138', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.000', 'weapon3': '3.272', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:56,322][52650] Updated weights for policy 0, policy_version 79631 (0.0029) [2024-08-06 07:50:56,431][52663] DAMAGECOUNT value on done: 893378.0 [2024-08-06 07:50:56,431][52663] Sum rewards: 85.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.358', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.054', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '3.330', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '68.000'} [2024-08-06 07:50:56,582][52669] DAMAGECOUNT value on done: 915688.0 [2024-08-06 07:50:56,583][52669] Sum rewards: 82.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.152', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.103', 'weapon5': '0.126', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '65.000'} [2024-08-06 07:50:57,303][52820] DAMAGECOUNT value on done: 855071.0 [2024-08-06 07:50:57,305][52820] Sum rewards: 82.249, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.810', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.138', 'weapon4': '0.156', 'weapon2': '0.216', 'AMMO3': '0.224', 'AMMO4': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '69.000'} [2024-08-06 07:50:57,572][52803] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:50:57,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 652353536. Throughput: 0: 4354.0. Samples: 163097990. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:50:57,794][52567] Avg episode reward: [(0, '76.365')] [2024-08-06 07:50:58,466][52671] DAMAGECOUNT value on done: 920516.0 [2024-08-06 07:50:58,469][52671] Sum rewards: 78.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.782', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.219', 'weapon2': '0.636', 'WEAPON3': '1.200', 'weapon3': '2.824', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '63.000'} [2024-08-06 07:50:58,927][52794] DAMAGECOUNT value on done: 917224.0 [2024-08-06 07:50:58,927][52794] Sum rewards: 71.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.888', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.140', 'weapon4': '0.158', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '61.500'} [2024-08-06 07:50:59,143][52664] DAMAGECOUNT value on done: 946848.0 [2024-08-06 07:50:59,143][52664] Sum rewards: 72.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.699', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '60.000'} [2024-08-06 07:50:59,323][52795] DAMAGECOUNT value on done: 835374.0 [2024-08-06 07:50:59,327][52795] Sum rewards: 62.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.872', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.222', 'weapon2': '0.272', 'WEAPON3': '1.250', 'HITCOUNT': '3.040', 'weapon3': '3.454', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '53.000'} [2024-08-06 07:50:59,591][52663] DAMAGECOUNT value on done: 902207.0 [2024-08-06 07:50:59,593][52663] Sum rewards: 79.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.330', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.171', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.928', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '64.000'} [2024-08-06 07:50:59,811][52669] DAMAGECOUNT value on done: 922231.0 [2024-08-06 07:50:59,813][52669] Sum rewards: 87.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.830', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.110', 'AMMO3': '0.194', 'weapon5': '0.220', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '72.000'} [2024-08-06 07:51:00,523][52820] DAMAGECOUNT value on done: 844137.0 [2024-08-06 07:51:00,525][52820] Sum rewards: 75.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.838', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.090', 'AMMO4': '0.157', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.208', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:01,197][52650] Updated weights for policy 0, policy_version 79641 (0.0013) [2024-08-06 07:51:01,779][52671] DAMAGECOUNT value on done: 913831.0 [2024-08-06 07:51:01,779][52671] Sum rewards: 69.878, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.239', 'weapon2': '0.272', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.418', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '59.000'} [2024-08-06 07:51:01,938][52663] DAMAGECOUNT value on done: 904396.0 [2024-08-06 07:51:01,940][52663] Sum rewards: 73.341, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon5': '0.174', 'AMMO4': '0.195', 'weapon2': '0.206', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.292', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '64.000'} [2024-08-06 07:51:02,117][52794] DAMAGECOUNT value on done: 898832.0 [2024-08-06 07:51:02,117][52794] Sum rewards: 88.171, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.270', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.204', 'weapon5': '0.210', 'weapon4': '0.212', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.946', 'FRAGCOUNT': '73.000'} [2024-08-06 07:51:02,139][52669] DAMAGECOUNT value on done: 921915.0 [2024-08-06 07:51:02,140][52669] Sum rewards: 71.281, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.880', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.198', 'weapon5': '0.226', 'AMMO4': '0.276', 'weapon2': '0.288', 'weapon4': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:02,225][52664] DAMAGECOUNT value on done: 945265.0 [2024-08-06 07:51:02,225][52664] Sum rewards: 75.724, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.078', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.282', 'WEAPON3': '1.800', 'weapon3': '3.486', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '66.000'} [2024-08-06 07:51:02,503][52795] DAMAGECOUNT value on done: 840625.0 [2024-08-06 07:51:02,503][52795] Sum rewards: 62.893, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.868', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.086', 'AMMO4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.878', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.264', 'FRAGCOUNT': '49.000'} [2024-08-06 07:51:02,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 652451840. Throughput: 0: 4349.6. Samples: 163110870. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:51:02,794][52567] Avg episode reward: [(0, '76.271')] [2024-08-06 07:51:03,057][52670] DAMAGECOUNT value on done: 893536.0 [2024-08-06 07:51:03,062][52670] Sum rewards: 71.831, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.050', 'AMMO4': '0.134', 'weapon5': '0.148', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '57.000'} [2024-08-06 07:51:03,564][52820] DAMAGECOUNT value on done: 845002.0 [2024-08-06 07:51:03,564][52820] Sum rewards: 67.819, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.144', 'weapon4': '0.162', 'AMMO4': '0.190', 'weapon2': '0.212', 'AMMO3': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.158', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:04,681][52663] DAMAGECOUNT value on done: 909452.0 [2024-08-06 07:51:04,683][52663] Sum rewards: 68.896, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.462', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.088', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'AMMO4': '0.231', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '57.000'} [2024-08-06 07:51:04,740][52671] DAMAGECOUNT value on done: 921287.0 [2024-08-06 07:51:04,740][52671] Sum rewards: 89.373, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.118', 'weapon5': '0.172', 'AMMO4': '0.195', 'weapon2': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '72.000'} [2024-08-06 07:51:04,987][52794] DAMAGECOUNT value on done: 912271.0 [2024-08-06 07:51:04,988][52794] Sum rewards: 71.150, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.758', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.239', 'weapon2': '0.472', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:05,042][52664] DAMAGECOUNT value on done: 957531.0 [2024-08-06 07:51:05,043][52664] Sum rewards: 65.392, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.266', 'weapon4': '0.004', 'AMMO2': '0.008', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'AMMO3': '0.163', 'weapon2': '0.606', 'WEAPON3': '1.100', 'weapon3': '3.296', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '52.000'} [2024-08-06 07:51:05,667][52795] DAMAGECOUNT value on done: 844147.0 [2024-08-06 07:51:05,670][52795] Sum rewards: 77.423, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.588', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.102', 'weapon5': '0.120', 'weapon2': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '3.320', 'weapon3': '3.412', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:05,704][52650] Updated weights for policy 0, policy_version 79651 (0.0015) [2024-08-06 07:51:06,078][52670] DAMAGECOUNT value on done: 910958.0 [2024-08-06 07:51:06,078][52670] Sum rewards: 73.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.090', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.030', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.068', 'AMMO3': '0.237', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.398', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:06,681][52820] DAMAGECOUNT value on done: 839504.0 [2024-08-06 07:51:06,682][52820] Sum rewards: 68.519, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.330', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.218', 'AMMO3': '0.222', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.450', 'weapon4': '0.468', 'WEAPON3': '1.400', 'weapon3': '2.620', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '57.000'} [2024-08-06 07:51:07,158][52671] DAMAGECOUNT value on done: 901693.0 [2024-08-06 07:51:07,159][52671] Sum rewards: 71.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.126', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.380', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:07,308][52663] DAMAGECOUNT value on done: 906503.0 [2024-08-06 07:51:07,310][52663] Sum rewards: 78.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.504', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.175', 'AMMO4': '0.175', 'weapon5': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.444', 'weapon2': '0.474', 'WEAPON3': '1.050', 'weapon3': '2.590', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:07,447][52664] DAMAGECOUNT value on done: 953896.0 [2024-08-06 07:51:07,448][52664] Sum rewards: 86.618, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.134', 'AMMO4': '0.158', 'AMMO3': '0.209', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '71.000'} [2024-08-06 07:51:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 652533760. Throughput: 0: 4349.6. Samples: 163137230. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:51:07,794][52567] Avg episode reward: [(0, '76.215')] [2024-08-06 07:51:08,093][52794] DAMAGECOUNT value on done: 910153.0 [2024-08-06 07:51:08,094][52794] Sum rewards: 77.465, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.018', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.486', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '66.500'} [2024-08-06 07:51:08,890][52795] DAMAGECOUNT value on done: 840194.0 [2024-08-06 07:51:08,890][52795] Sum rewards: 93.080, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.345', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'AMMO3': '0.156', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.394', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '21.792', 'FRAGCOUNT': '73.000'} [2024-08-06 07:51:09,277][52670] DAMAGECOUNT value on done: 895388.0 [2024-08-06 07:51:09,277][52670] Sum rewards: 80.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.015', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.392', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '67.000'} [2024-08-06 07:51:09,322][52649] DAMAGECOUNT value on done: 878955.0 [2024-08-06 07:51:09,323][52649] Sum rewards: 74.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.200', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.132', 'AMMO3': '0.149', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.100', 'weapon3': '3.096', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '59.000'} [2024-08-06 07:51:09,343][52665] DAMAGECOUNT value on done: 895459.0 [2024-08-06 07:51:09,344][52665] Sum rewards: 69.299, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.086', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.110', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.736', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '55.000'} [2024-08-06 07:51:09,846][52820] DAMAGECOUNT value on done: 843156.0 [2024-08-06 07:51:09,847][52820] Sum rewards: 64.005, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.791', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.126', 'weapon5': '0.192', 'AMMO4': '0.215', 'weapon2': '0.226', 'AMMO3': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'HITCOUNT': '2.940', 'weapon3': '3.164', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '56.000'} [2024-08-06 07:51:10,146][52663] DAMAGECOUNT value on done: 910045.0 [2024-08-06 07:51:10,147][52663] Sum rewards: 65.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.558', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.042', 'weapon5': '0.100', 'AMMO4': '0.162', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.050', 'HITCOUNT': '3.070', 'weapon3': '3.272', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '52.500'} [2024-08-06 07:51:10,268][52650] Updated weights for policy 0, policy_version 79661 (0.0011) [2024-08-06 07:51:10,492][52664] DAMAGECOUNT value on done: 952078.0 [2024-08-06 07:51:10,494][52664] Sum rewards: 80.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.420', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.142', 'AMMO3': '0.169', 'weapon5': '0.272', 'weapon2': '0.288', 'AMMO4': '0.316', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.984', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '66.000'} [2024-08-06 07:51:10,495][52666] DAMAGECOUNT value on done: 907194.0 [2024-08-06 07:51:10,496][52666] Sum rewards: 56.733, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.560', 'AMMO5': '0.028', 'AMMO2': '0.062', 'weapon4': '0.196', 'AMMO3': '0.229', 'weapon5': '0.258', 'AMMO4': '0.311', 'weapon2': '0.420', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '50.000'} [2024-08-06 07:51:10,697][52794] DAMAGECOUNT value on done: 912637.0 [2024-08-06 07:51:10,697][52794] Sum rewards: 72.672, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.074', 'weapon5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.217', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:12,179][52795] DAMAGECOUNT value on done: 829758.0 [2024-08-06 07:51:12,179][52795] Sum rewards: 69.558, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.106', 'AMMO5': '0.019', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.245', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.100', 'weapon3': '3.196', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:12,306][52670] DAMAGECOUNT value on done: 897225.0 [2024-08-06 07:51:12,307][52670] Sum rewards: 64.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.326', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.154', 'weapon5': '0.164', 'AMMO3': '0.226', 'weapon2': '0.286', 'AMMO4': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.120', 'weapon3': '3.142', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '57.000'} [2024-08-06 07:51:12,470][52649] DAMAGECOUNT value on done: 876007.0 [2024-08-06 07:51:12,473][52649] Sum rewards: 85.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.208', 'AMMO3': '0.240', 'WEAPON3': '1.550', 'weapon3': '3.546', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '72.000'} [2024-08-06 07:51:12,508][52665] DAMAGECOUNT value on done: 908448.0 [2024-08-06 07:51:12,514][52665] Sum rewards: 87.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.802', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.076', 'weapon5': '0.192', 'AMMO4': '0.195', 'AMMO3': '0.252', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '75.000'} [2024-08-06 07:51:12,795][52567] Fps is (10 sec: 16382.7, 60 sec: 17339.5, 300 sec: 17439.2). Total num frames: 652615680. Throughput: 0: 4359.7. Samples: 163163550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:51:12,796][52567] Avg episode reward: [(0, '75.855')] [2024-08-06 07:51:12,961][52820] DAMAGECOUNT value on done: 851614.0 [2024-08-06 07:51:12,963][52820] Sum rewards: 71.041, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.116', 'weapon4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '57.000'} [2024-08-06 07:51:13,066][52794] DAMAGECOUNT value on done: 921739.0 [2024-08-06 07:51:13,067][52794] Sum rewards: 78.173, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.305', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.414', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:13,150][52664] DAMAGECOUNT value on done: 936383.0 [2024-08-06 07:51:13,163][52664] Sum rewards: 89.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.376', 'AMMO2': '0.006', 'AMMO4': '0.032', 'AMMO3': '0.233', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.560', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '74.000'} [2024-08-06 07:51:13,310][52663] DAMAGECOUNT value on done: 916465.0 [2024-08-06 07:51:13,311][52663] Sum rewards: 83.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.024', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.500', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '68.000'} [2024-08-06 07:51:13,623][52666] DAMAGECOUNT value on done: 903102.0 [2024-08-06 07:51:13,623][52666] Sum rewards: 74.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.828', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.140', 'AMMO3': '0.182', 'weapon2': '0.224', 'AMMO4': '0.241', 'weapon5': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '61.500'} [2024-08-06 07:51:15,166][52650] Updated weights for policy 0, policy_version 79671 (0.0018) [2024-08-06 07:51:15,252][52795] DAMAGECOUNT value on done: 838084.0 [2024-08-06 07:51:15,252][52795] Sum rewards: 78.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO5': '0.018', 'AMMO2': '0.024', 'weapon4': '0.072', 'weapon5': '0.106', 'AMMO4': '0.121', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:15,565][52665] DAMAGECOUNT value on done: 898765.0 [2024-08-06 07:51:15,564][52649] DAMAGECOUNT value on done: 890958.0 [2024-08-06 07:51:15,565][52665] Sum rewards: 83.917, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.236', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '70.000'} [2024-08-06 07:51:15,565][52649] Sum rewards: 64.388, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.192', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon2': '0.132', 'AMMO3': '0.137', 'weapon5': '0.212', 'AMMO4': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.628', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '51.000'} [2024-08-06 07:51:15,616][52670] DAMAGECOUNT value on done: 909258.0 [2024-08-06 07:51:15,617][52670] Sum rewards: 63.952, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.632', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.054', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.490', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.200', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '51.000'} [2024-08-06 07:51:15,655][52664] DAMAGECOUNT value on done: 939420.0 [2024-08-06 07:51:15,657][52664] Sum rewards: 71.268, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.236', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.102', 'weapon5': '0.122', 'AMMO4': '0.157', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:15,910][52663] DAMAGECOUNT value on done: 899357.0 [2024-08-06 07:51:15,910][52663] Sum rewards: 76.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.142', 'AMMO3': '0.181', 'weapon4': '0.208', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:15,934][52794] DAMAGECOUNT value on done: 911600.0 [2024-08-06 07:51:15,934][52794] Sum rewards: 82.168, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.856', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO4': '0.240', 'AMMO3': '0.252', 'weapon2': '0.262', 'weapon4': '0.276', 'weapon5': '0.288', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.856', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '68.000'} [2024-08-06 07:51:16,097][52820] DAMAGECOUNT value on done: 850320.0 [2024-08-06 07:51:16,097][52820] Sum rewards: 84.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.988', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.118', 'AMMO4': '0.133', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '70.000'} [2024-08-06 07:51:16,894][52666] DAMAGECOUNT value on done: 911165.0 [2024-08-06 07:51:16,896][52666] Sum rewards: 76.198, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.088', 'weapon4': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.220', 'WEAPON3': '1.400', 'weapon3': '3.460', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 652705792. Throughput: 0: 4369.3. Samples: 163176630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:51:17,794][52567] Avg episode reward: [(0, '75.722')] [2024-08-06 07:51:17,811][52662] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:51:17,865][52664] DAMAGECOUNT value on done: 946205.0 [2024-08-06 07:51:17,868][52664] Sum rewards: 86.117, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.534', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.128', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.898', 'FRAGCOUNT': '69.000'} [2024-08-06 07:51:18,219][52662] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:51:18,326][52795] DAMAGECOUNT value on done: 843599.0 [2024-08-06 07:51:18,327][52795] Sum rewards: 76.775, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.634', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.051', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.808', 'WEAPON3': '0.950', 'weapon3': '2.798', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:18,582][52665] DAMAGECOUNT value on done: 901665.0 [2024-08-06 07:51:18,584][52665] Sum rewards: 82.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.524', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.072', 'AMMO3': '0.130', 'weapon5': '0.140', 'AMMO4': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.768', 'WEAPON3': '0.800', 'weapon3': '2.830', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:18,636][52649] DAMAGECOUNT value on done: 888242.0 [2024-08-06 07:51:18,638][52649] Sum rewards: 77.746, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.080', 'AMMO5': '0.021', 'AMMO2': '0.089', 'weapon5': '0.216', 'weapon2': '0.224', 'weapon4': '0.282', 'AMMO3': '0.307', 'AMMO4': '0.447', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'WEAPON3': '1.850', 'weapon3': '2.904', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '68.500'} [2024-08-06 07:51:18,729][52670] DAMAGECOUNT value on done: 898417.0 [2024-08-06 07:51:18,731][52670] Sum rewards: 80.577, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.134', 'AMMO4': '0.166', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:19,278][52820] DAMAGECOUNT value on done: 836333.0 [2024-08-06 07:51:19,278][52820] Sum rewards: 83.655, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.562', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.120', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.298', 'WEAPON3': '1.700', 'weapon3': '3.306', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.054', 'FRAGCOUNT': '71.000'} [2024-08-06 07:51:19,588][52650] Updated weights for policy 0, policy_version 79681 (0.0012) [2024-08-06 07:51:19,876][52666] DAMAGECOUNT value on done: 903775.0 [2024-08-06 07:51:19,877][52666] Sum rewards: 82.909, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.075', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.130', 'weapon2': '0.236', 'weapon4': '0.240', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.164', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '72.000'} [2024-08-06 07:51:20,827][52664] DAMAGECOUNT value on done: 936601.0 [2024-08-06 07:51:20,828][52664] Sum rewards: 72.251, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.455', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'weapon4': '0.102', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:21,261][52665] DAMAGECOUNT value on done: 884537.0 [2024-08-06 07:51:21,261][52665] Sum rewards: 71.550, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.124', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.150', 'weapon3': '3.204', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '59.000'} [2024-08-06 07:51:21,280][52649] DAMAGECOUNT value on done: 881026.0 [2024-08-06 07:51:21,281][52649] Sum rewards: 68.754, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.686', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon2': '0.166', 'AMMO4': '0.174', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'WEAPON3': '1.750', 'weapon3': '3.292', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:21,460][52795] DAMAGECOUNT value on done: 832350.0 [2024-08-06 07:51:21,460][52795] Sum rewards: 77.002, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.626', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.154', 'weapon2': '0.436', 'WEAPON3': '1.000', 'weapon3': '3.374', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '61.000'} [2024-08-06 07:51:21,774][52670] DAMAGECOUNT value on done: 892683.0 [2024-08-06 07:51:21,774][52670] Sum rewards: 85.112, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.606', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.195', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.039', 'FRAGCOUNT': '68.500'} [2024-08-06 07:51:22,794][52567] Fps is (10 sec: 18023.7, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 652795904. Throughput: 0: 4361.6. Samples: 163202730. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:51:22,802][52567] Avg episode reward: [(0, '76.211')] [2024-08-06 07:51:22,804][52794] Large shaping reward 2.521 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.501, 167.0)] [2024-08-06 07:51:22,982][52666] DAMAGECOUNT value on done: 898225.0 [2024-08-06 07:51:22,983][52666] Sum rewards: 77.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.096', 'weapon5': '0.128', 'AMMO4': '0.189', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:23,318][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:51:23,779][52665] DAMAGECOUNT value on done: 888752.0 [2024-08-06 07:51:23,780][52665] Sum rewards: 74.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.734', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.134', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:23,884][52649] DAMAGECOUNT value on done: 889839.0 [2024-08-06 07:51:23,884][52649] Sum rewards: 63.415, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.156', 'AMMO4': '0.170', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.780', 'weapon3': '3.070', 'DAMAGECOUNT': '15.189', 'FRAGCOUNT': '55.000'} [2024-08-06 07:51:24,462][52670] DAMAGECOUNT value on done: 896862.0 [2024-08-06 07:51:24,462][52670] Sum rewards: 70.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.518', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.130', 'AMMO4': '0.150', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon5': '0.334', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '57.000'} [2024-08-06 07:51:24,467][52650] Updated weights for policy 0, policy_version 79691 (0.0012) [2024-08-06 07:51:24,557][52795] DAMAGECOUNT value on done: 841112.0 [2024-08-06 07:51:24,558][52795] Sum rewards: 68.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.060', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.204', 'AMMO3': '0.206', 'weapon2': '0.230', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '56.000'} [2024-08-06 07:51:25,472][52666] DAMAGECOUNT value on done: 904100.0 [2024-08-06 07:51:25,472][52666] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.746', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.114', 'weapon4': '0.134', 'AMMO3': '0.191', 'AMMO4': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:26,356][52665] DAMAGECOUNT value on done: 897432.0 [2024-08-06 07:51:26,357][52665] Sum rewards: 77.611, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.156', 'AMMO4': '0.158', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '66.000'} [2024-08-06 07:51:26,519][52649] DAMAGECOUNT value on done: 885996.0 [2024-08-06 07:51:26,520][52649] Sum rewards: 82.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.060', 'weapon4': '0.086', 'AMMO4': '0.130', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.430', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '68.000'} [2024-08-06 07:51:27,064][52670] DAMAGECOUNT value on done: 897289.0 [2024-08-06 07:51:27,067][52670] Sum rewards: 84.022, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.755', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.060', 'AMMO4': '0.125', 'weapon2': '0.160', 'weapon5': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '71.000'} [2024-08-06 07:51:27,644][52795] DAMAGECOUNT value on done: 839453.0 [2024-08-06 07:51:27,646][52795] Sum rewards: 72.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.464', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.173', 'AMMO3': '0.178', 'weapon2': '0.200', 'weapon4': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 652886016. Throughput: 0: 4371.3. Samples: 163229280. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:51:27,794][52567] Avg episode reward: [(0, '75.914')] [2024-08-06 07:51:28,295][52666] DAMAGECOUNT value on done: 899453.0 [2024-08-06 07:51:28,295][52666] Sum rewards: 75.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.115', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.080', 'weapon4': '0.098', 'AMMO4': '0.149', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '64.000'} [2024-08-06 07:51:28,965][52665] DAMAGECOUNT value on done: 898010.0 [2024-08-06 07:51:28,966][52665] Sum rewards: 82.598, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.183', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.153', 'weapon2': '0.160', 'weapon5': '0.188', 'AMMO4': '0.190', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.134', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '66.000'} [2024-08-06 07:51:29,127][52649] DAMAGECOUNT value on done: 889806.0 [2024-08-06 07:51:29,127][52649] Sum rewards: 68.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.931', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.092', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.334', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:29,278][52650] Updated weights for policy 0, policy_version 79701 (0.0013) [2024-08-06 07:51:29,861][52670] DAMAGECOUNT value on done: 894209.0 [2024-08-06 07:51:29,863][52670] Sum rewards: 94.938, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.009', 'HEALTH': '0.033', 'weapon5': '0.038', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'weapon2': '0.284', 'WEAPON3': '1.050', 'weapon3': '3.452', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.735', 'FRAGCOUNT': '75.000'} [2024-08-06 07:51:30,867][52795] DAMAGECOUNT value on done: 829010.0 [2024-08-06 07:51:30,867][52795] Sum rewards: 83.082, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.096', 'AMMO4': '0.129', 'AMMO3': '0.192', 'weapon2': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '69.000'} [2024-08-06 07:51:31,193][52666] DAMAGECOUNT value on done: 898633.0 [2024-08-06 07:51:31,194][52666] Sum rewards: 80.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.686', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.080', 'AMMO4': '0.133', 'weapon5': '0.158', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.920', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '67.000'} [2024-08-06 07:51:32,104][52665] DAMAGECOUNT value on done: 902445.0 [2024-08-06 07:51:32,104][52665] Sum rewards: 77.475, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.145', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.412', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:32,372][52649] DAMAGECOUNT value on done: 885678.0 [2024-08-06 07:51:32,375][52649] Sum rewards: 85.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.256', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.088', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.490', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '71.000'} [2024-08-06 07:51:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 652976128. Throughput: 0: 4375.4. Samples: 163242280. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:51:32,794][52567] Avg episode reward: [(0, '76.385')] [2024-08-06 07:51:32,952][52670] DAMAGECOUNT value on done: 906887.0 [2024-08-06 07:51:32,954][52670] Sum rewards: 69.066, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon5': '0.110', 'weapon4': '0.112', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.258', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:33,210][52668] DAMAGECOUNT value on done: 915533.0 [2024-08-06 07:51:33,210][52668] Sum rewards: 82.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.924', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.022', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon4': '0.258', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '67.000'} [2024-08-06 07:51:33,721][52650] Updated weights for policy 0, policy_version 79711 (0.0011) [2024-08-06 07:51:34,033][52795] DAMAGECOUNT value on done: 836449.0 [2024-08-06 07:51:34,036][52795] Sum rewards: 60.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.636', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.090', 'AMMO4': '0.121', 'weapon5': '0.188', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.150', 'HITCOUNT': '2.600', 'weapon3': '2.806', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '50.000'} [2024-08-06 07:51:34,379][52666] DAMAGECOUNT value on done: 906925.0 [2024-08-06 07:51:34,380][52666] Sum rewards: 79.802, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'weapon4': '0.366', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '64.000'} [2024-08-06 07:51:35,043][52665] DAMAGECOUNT value on done: 895351.0 [2024-08-06 07:51:35,044][52665] Sum rewards: 82.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.062', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '68.000'} [2024-08-06 07:51:35,407][52649] DAMAGECOUNT value on done: 880631.0 [2024-08-06 07:51:35,410][52649] Sum rewards: 67.462, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.882', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon4': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '59.000'} [2024-08-06 07:51:35,947][52668] DAMAGECOUNT value on done: 916412.0 [2024-08-06 07:51:35,951][52668] Sum rewards: 72.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.210', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.110', 'AMMO4': '0.199', 'AMMO3': '0.208', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.368', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:36,209][52670] DAMAGECOUNT value on done: 889285.0 [2024-08-06 07:51:36,209][52670] Sum rewards: 76.024, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.104', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.286', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '64.000'} [2024-08-06 07:51:37,120][52795] DAMAGECOUNT value on done: 845374.0 [2024-08-06 07:51:37,122][52795] Sum rewards: 70.693, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.307', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.139', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.288', 'weapon2': '0.318', 'WEAPON3': '0.900', 'HITCOUNT': '2.960', 'weapon3': '3.030', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '55.000'} [2024-08-06 07:51:37,601][52666] DAMAGECOUNT value on done: 900097.0 [2024-08-06 07:51:37,604][52666] Sum rewards: 73.665, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.464', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.108', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '61.000'} [2024-08-06 07:51:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 653058048. Throughput: 0: 4371.6. Samples: 163268360. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:51:37,794][52567] Avg episode reward: [(0, '76.266')] [2024-08-06 07:51:38,175][52665] DAMAGECOUNT value on done: 910964.0 [2024-08-06 07:51:38,176][52665] Sum rewards: 85.331, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.149', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.118', 'weapon5': '0.158', 'AMMO4': '0.176', 'AMMO3': '0.187', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '69.000'} [2024-08-06 07:51:38,398][52649] DAMAGECOUNT value on done: 894475.0 [2024-08-06 07:51:38,399][52649] Sum rewards: 74.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.240', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:38,726][52650] Updated weights for policy 0, policy_version 79721 (0.0010) [2024-08-06 07:51:39,077][52668] DAMAGECOUNT value on done: 912029.0 [2024-08-06 07:51:39,079][52668] Sum rewards: 92.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.236', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.188', 'weapon2': '0.296', 'WEAPON3': '1.150', 'weapon3': '3.486', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.087', 'FRAGCOUNT': '76.000'} [2024-08-06 07:51:39,279][52670] DAMAGECOUNT value on done: 905436.0 [2024-08-06 07:51:39,281][52670] Sum rewards: 85.722, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.737', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.522', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '72.000'} [2024-08-06 07:51:40,650][52666] DAMAGECOUNT value on done: 905012.0 [2024-08-06 07:51:40,654][52666] Sum rewards: 82.061, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.163', 'weapon5': '0.188', 'AMMO4': '0.245', 'weapon2': '0.322', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.806', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:40,848][52665] DAMAGECOUNT value on done: 902010.0 [2024-08-06 07:51:40,849][52665] Sum rewards: 74.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.745', 'AMMO5': '0.009', 'weapon4': '0.026', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.330', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:41,301][52649] DAMAGECOUNT value on done: 899731.0 [2024-08-06 07:51:41,301][52649] Sum rewards: 94.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.606', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.086', 'weapon5': '0.184', 'AMMO4': '0.192', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.044', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '22.908', 'FRAGCOUNT': '77.000'} [2024-08-06 07:51:41,842][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:51:42,191][52668] DAMAGECOUNT value on done: 913933.0 [2024-08-06 07:51:42,191][52668] Sum rewards: 69.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.110', 'AMMO3': '0.243', 'weapon5': '0.250', 'AMMO4': '0.304', 'weapon2': '0.480', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.872', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '59.000'} [2024-08-06 07:51:42,394][52670] DAMAGECOUNT value on done: 908147.0 [2024-08-06 07:51:42,394][52670] Sum rewards: 71.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.621', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.128', 'AMMO3': '0.221', 'weapon2': '0.260', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.484', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 07:51:42,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 653139968. Throughput: 0: 4374.4. Samples: 163294840. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:51:42,802][52567] Avg episode reward: [(0, '76.290')] [2024-08-06 07:51:43,249][52650] Updated weights for policy 0, policy_version 79731 (0.0034) [2024-08-06 07:51:43,456][52665] DAMAGECOUNT value on done: 899242.0 [2024-08-06 07:51:43,460][52665] Sum rewards: 85.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.370', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.136', 'AMMO4': '0.175', 'AMMO3': '0.215', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.344', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '71.000'} [2024-08-06 07:51:43,806][52649] DAMAGECOUNT value on done: 892939.0 [2024-08-06 07:51:43,807][52649] Sum rewards: 80.373, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.620', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.074', 'AMMO4': '0.078', 'weapon5': '0.090', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '64.500'} [2024-08-06 07:51:43,874][52666] DAMAGECOUNT value on done: 889498.0 [2024-08-06 07:51:43,875][52666] Sum rewards: 84.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.912', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.132', 'weapon4': '0.144', 'weapon2': '0.204', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.380', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '70.000'} [2024-08-06 07:51:45,414][52668] DAMAGECOUNT value on done: 903309.0 [2024-08-06 07:51:45,425][52668] Sum rewards: 76.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.530', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.466', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '61.000'} [2024-08-06 07:51:45,527][52670] DAMAGECOUNT value on done: 901569.0 [2024-08-06 07:51:45,527][52670] Sum rewards: 76.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.314', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.184', 'AMMO4': '0.199', 'AMMO3': '0.214', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.422', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:46,557][52665] DAMAGECOUNT value on done: 903032.0 [2024-08-06 07:51:46,559][52665] Sum rewards: 77.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO4': '0.172', 'weapon5': '0.220', 'AMMO3': '0.231', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:46,783][52666] DAMAGECOUNT value on done: 911324.0 [2024-08-06 07:51:46,788][52666] Sum rewards: 96.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.105', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.090', 'AMMO3': '0.209', 'weapon2': '0.216', 'WEAPON3': '1.250', 'weapon3': '3.496', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '80.000'} [2024-08-06 07:51:46,831][52649] DAMAGECOUNT value on done: 891899.0 [2024-08-06 07:51:46,833][52649] Sum rewards: 77.534, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.720', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.098', 'weapon5': '0.100', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 653230080. Throughput: 0: 4373.5. Samples: 163307680. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:51:47,802][52567] Avg episode reward: [(0, '76.740')] [2024-08-06 07:51:47,830][52650] Updated weights for policy 0, policy_version 79741 (0.0034) [2024-08-06 07:51:48,200][52668] DAMAGECOUNT value on done: 910765.0 [2024-08-06 07:51:48,201][52668] Sum rewards: 88.839, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.082', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'HEALTH': '0.270', 'weapon2': '0.270', 'WEAPON3': '1.000', 'weapon3': '3.432', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '71.000'} [2024-08-06 07:51:48,502][52670] DAMAGECOUNT value on done: 884986.0 [2024-08-06 07:51:48,502][52670] Sum rewards: 83.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.497', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.110', 'AMMO4': '0.124', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '67.000'} [2024-08-06 07:51:48,599][52649] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:51:49,075][52665] DAMAGECOUNT value on done: 895783.0 [2024-08-06 07:51:49,075][52665] Sum rewards: 73.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.120', 'AMMO4': '0.137', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:49,384][52649] DAMAGECOUNT value on done: 881283.0 [2024-08-06 07:51:49,385][52649] Sum rewards: 84.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.062', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '70.000'} [2024-08-06 07:51:50,132][52666] DAMAGECOUNT value on done: 903780.0 [2024-08-06 07:51:50,133][52666] Sum rewards: 75.391, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.623', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.088', 'AMMO4': '0.171', 'AMMO3': '0.182', 'weapon5': '0.214', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '60.000'} [2024-08-06 07:51:50,136][52662] DAMAGECOUNT value on done: 908347.0 [2024-08-06 07:51:50,137][52662] Sum rewards: 87.265, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.556', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.130', 'AMMO4': '0.134', 'weapon4': '0.148', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.354', 'FRAGCOUNT': '69.500'} [2024-08-06 07:51:51,376][52668] DAMAGECOUNT value on done: 912242.0 [2024-08-06 07:51:51,378][52668] Sum rewards: 80.210, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.133', 'AMMO3': '0.190', 'weapon2': '0.220', 'weapon4': '0.224', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '64.500'} [2024-08-06 07:51:51,771][52670] DAMAGECOUNT value on done: 899948.0 [2024-08-06 07:51:51,773][52670] Sum rewards: 74.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.035', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.255', 'weapon2': '0.286', 'weapon5': '0.302', 'AMMO4': '0.353', 'weapon4': '0.392', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.600', 'weapon3': '2.686', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:52,028][52665] DAMAGECOUNT value on done: 901140.0 [2024-08-06 07:51:52,028][52665] Sum rewards: 66.464, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.925', 'AMMO5': '0.016', 'weapon4': '0.046', 'AMMO2': '0.047', 'weapon5': '0.176', 'AMMO3': '0.177', 'AMMO4': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '53.000'} [2024-08-06 07:51:52,139][52659] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon5', 0.002)] [2024-08-06 07:51:52,515][52649] DAMAGECOUNT value on done: 891721.0 [2024-08-06 07:51:52,516][52649] Sum rewards: 77.929, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.072', 'weapon5': '0.186', 'weapon2': '0.196', 'AMMO3': '0.254', 'AMMO4': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.970', 'FRAGCOUNT': '64.000'} [2024-08-06 07:51:52,597][52662] DAMAGECOUNT value on done: 917793.0 [2024-08-06 07:51:52,599][52662] Sum rewards: 80.517, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.098', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.076', 'AMMO4': '0.121', 'weapon5': '0.172', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:52,725][52650] Updated weights for policy 0, policy_version 79751 (0.0030) [2024-08-06 07:51:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 653320192. Throughput: 0: 4374.0. Samples: 163334060. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:51:52,794][52567] Avg episode reward: [(0, '77.500')] [2024-08-06 07:51:52,802][52614] Saving new best policy, reward=77.500! [2024-08-06 07:51:53,366][52666] DAMAGECOUNT value on done: 903553.0 [2024-08-06 07:51:53,368][52666] Sum rewards: 75.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.586', 'AMMO5': '0.019', 'AMMO2': '0.058', 'weapon5': '0.178', 'AMMO3': '0.224', 'weapon4': '0.238', 'AMMO4': '0.289', 'weapon2': '0.298', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:54,439][52668] DAMAGECOUNT value on done: 903017.0 [2024-08-06 07:51:54,440][52668] Sum rewards: 77.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.048', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:54,640][52670] DAMAGECOUNT value on done: 909017.0 [2024-08-06 07:51:54,644][52670] Sum rewards: 78.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.125', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.164', 'weapon5': '0.220', 'AMMO4': '0.235', 'weapon2': '0.238', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.148', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:55,262][52665] DAMAGECOUNT value on done: 901268.0 [2024-08-06 07:51:55,263][52665] Sum rewards: 78.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.082', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.274', 'WEAPON3': '1.200', 'weapon3': '3.310', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '63.000'} [2024-08-06 07:51:55,511][52662] DAMAGECOUNT value on done: 916658.0 [2024-08-06 07:51:55,514][52662] Sum rewards: 66.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.222', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.334', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.869', 'FRAGCOUNT': '56.000'} [2024-08-06 07:51:55,801][52649] DAMAGECOUNT value on done: 872349.0 [2024-08-06 07:51:55,801][52649] Sum rewards: 74.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.072', 'AMMO4': '0.094', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.262', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.318', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '62.000'} [2024-08-06 07:51:56,135][52666] DAMAGECOUNT value on done: 897545.0 [2024-08-06 07:51:56,136][52666] Sum rewards: 86.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.912', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '69.000'} [2024-08-06 07:51:57,142][52650] Updated weights for policy 0, policy_version 79761 (0.0029) [2024-08-06 07:51:57,447][52670] DAMAGECOUNT value on done: 902559.0 [2024-08-06 07:51:57,449][52670] Sum rewards: 67.619, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.018', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.214', 'AMMO3': '0.230', 'weapon4': '0.276', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.652', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '58.000'} [2024-08-06 07:51:57,495][52668] DAMAGECOUNT value on done: 907246.0 [2024-08-06 07:51:57,495][52668] Sum rewards: 64.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.384', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '53.000'} [2024-08-06 07:51:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 653402112. Throughput: 0: 4370.3. Samples: 163360210. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:51:57,794][52567] Avg episode reward: [(0, '77.200')] [2024-08-06 07:51:58,349][52667] DAMAGECOUNT value on done: 907620.0 [2024-08-06 07:51:58,351][52667] Sum rewards: 60.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.058', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.046', 'weapon4': '0.074', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'WEAPON4': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.050', 'HITCOUNT': '2.910', 'weapon3': '3.132', 'DAMAGECOUNT': '14.610', 'FRAGCOUNT': '51.000'} [2024-08-06 07:51:58,375][52665] DAMAGECOUNT value on done: 891534.0 [2024-08-06 07:51:58,379][52665] Sum rewards: 79.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.282', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon5': '0.154', 'AMMO3': '0.185', 'weapon4': '0.220', 'AMMO4': '0.230', 'weapon2': '0.230', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '65.000'} [2024-08-06 07:51:58,510][52662] DAMAGECOUNT value on done: 905089.0 [2024-08-06 07:51:58,511][52662] Sum rewards: 100.343, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.455', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.145', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.539', 'FRAGCOUNT': '80.000'} [2024-08-06 07:51:58,678][52666] DAMAGECOUNT value on done: 897588.0 [2024-08-06 07:51:58,680][52666] Sum rewards: 82.635, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.108', 'AMMO3': '0.140', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.738', 'WEAPON3': '1.000', 'weapon3': '2.766', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '64.500'} [2024-08-06 07:51:58,923][52649] DAMAGECOUNT value on done: 895129.0 [2024-08-06 07:51:58,924][52649] Sum rewards: 82.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.084', 'weapon4': '0.096', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.392', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '68.000'} [2024-08-06 07:52:00,224][52670] DAMAGECOUNT value on done: 903719.0 [2024-08-06 07:52:00,225][52670] Sum rewards: 76.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.957', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.206', 'weapon4': '0.212', 'weapon5': '0.214', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 07:52:00,366][52668] DAMAGECOUNT value on done: 914895.0 [2024-08-06 07:52:00,367][52668] Sum rewards: 90.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.322', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.184', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'weapon4': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '73.000'} [2024-08-06 07:52:01,524][52667] DAMAGECOUNT value on done: 923384.0 [2024-08-06 07:52:01,525][52667] Sum rewards: 89.031, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.122', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.070', 'weapon5': '0.132', 'AMMO4': '0.134', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '21.513', 'FRAGCOUNT': '69.000'} [2024-08-06 07:52:01,542][52662] DAMAGECOUNT value on done: 923554.0 [2024-08-06 07:52:01,543][52662] Sum rewards: 90.618, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.400', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.165', 'weapon2': '0.692', 'WEAPON3': '1.050', 'weapon3': '3.128', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.159', 'FRAGCOUNT': '71.000'} [2024-08-06 07:52:01,595][52665] DAMAGECOUNT value on done: 895809.0 [2024-08-06 07:52:01,596][52665] Sum rewards: 65.346, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.714', 'AMMO5': '0.027', 'AMMO2': '0.068', 'weapon2': '0.258', 'AMMO3': '0.267', 'AMMO4': '0.341', 'weapon5': '0.344', 'weapon4': '0.460', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.552', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '55.000'} [2024-08-06 07:52:01,642][52666] DAMAGECOUNT value on done: 915501.0 [2024-08-06 07:52:01,646][52666] Sum rewards: 71.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.653', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.204', 'AMMO3': '0.212', 'AMMO4': '0.217', 'weapon5': '0.224', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.606', 'WEAPON3': '1.300', 'weapon3': '2.618', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '59.000'} [2024-08-06 07:52:02,145][52649] DAMAGECOUNT value on done: 893981.0 [2024-08-06 07:52:02,146][52649] Sum rewards: 80.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.411', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.094', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:02,183][52650] Updated weights for policy 0, policy_version 79771 (0.0040) [2024-08-06 07:52:02,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 653500416. Throughput: 0: 4370.4. Samples: 163373300. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:52:02,794][52567] Avg episode reward: [(0, '78.046')] [2024-08-06 07:52:02,795][52614] Saving new best policy, reward=78.046! [2024-08-06 07:52:03,295][52668] DAMAGECOUNT value on done: 907929.0 [2024-08-06 07:52:03,295][52668] Sum rewards: 80.847, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.064', 'AMMO3': '0.149', 'AMMO4': '0.158', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '0.900', 'weapon3': '3.170', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 07:52:04,052][52662] DAMAGECOUNT value on done: 898193.0 [2024-08-06 07:52:04,053][52662] Sum rewards: 72.731, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.326', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '58.000'} [2024-08-06 07:52:04,325][52667] DAMAGECOUNT value on done: 918038.0 [2024-08-06 07:52:04,325][52667] Sum rewards: 71.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.930', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.052', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.226', 'WEAPON4': '0.250', 'weapon2': '0.272', 'AMMO3': '0.277', 'WEAPON3': '1.850', 'weapon3': '3.192', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.758', 'FRAGCOUNT': '64.000'} [2024-08-06 07:52:04,682][52665] DAMAGECOUNT value on done: 902043.0 [2024-08-06 07:52:04,682][52665] Sum rewards: 74.448, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.275', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon4': '0.028', 'AMMO4': '0.134', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'weapon5': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '0.950', 'weapon3': '2.924', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '58.000'} [2024-08-06 07:52:04,692][52666] DAMAGECOUNT value on done: 890230.0 [2024-08-06 07:52:04,695][52666] Sum rewards: 90.063, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.046', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.318', 'FRAGCOUNT': '74.000'} [2024-08-06 07:52:05,275][52649] DAMAGECOUNT value on done: 886414.0 [2024-08-06 07:52:05,277][52649] Sum rewards: 74.761, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.598', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.078', 'AMMO4': '0.125', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.502', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '64.000'} [2024-08-06 07:52:06,409][52668] DAMAGECOUNT value on done: 903060.0 [2024-08-06 07:52:06,409][52668] Sum rewards: 78.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.013', 'weapon5': '0.054', 'AMMO2': '0.054', 'weapon4': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:06,542][52650] Updated weights for policy 0, policy_version 79781 (0.0013) [2024-08-06 07:52:06,803][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:52:06,845][52662] DAMAGECOUNT value on done: 908164.0 [2024-08-06 07:52:06,847][52662] Sum rewards: 79.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.354', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.128', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.074', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '63.000'} [2024-08-06 07:52:07,120][52667] DAMAGECOUNT value on done: 921869.0 [2024-08-06 07:52:07,122][52667] Sum rewards: 79.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.045', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.086', 'weapon4': '0.120', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.372', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:07,488][52666] DAMAGECOUNT value on done: 899475.0 [2024-08-06 07:52:07,489][52666] Sum rewards: 80.841, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.511', 'AMMO5': '0.020', 'AMMO2': '0.029', 'weapon4': '0.138', 'AMMO4': '0.147', 'AMMO3': '0.182', 'weapon5': '0.184', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 653574144. Throughput: 0: 4366.9. Samples: 163399240. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:52:07,795][52567] Avg episode reward: [(0, '78.247')] [2024-08-06 07:52:07,801][52614] Saving new best policy, reward=78.247! [2024-08-06 07:52:09,596][52668] DAMAGECOUNT value on done: 899517.0 [2024-08-06 07:52:09,597][52668] Sum rewards: 67.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.280', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.201', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '2.892', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '58.000'} [2024-08-06 07:52:09,886][52662] DAMAGECOUNT value on done: 923848.0 [2024-08-06 07:52:09,890][52662] Sum rewards: 72.078, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.520', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO3': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '59.000'} [2024-08-06 07:52:10,154][52667] DAMAGECOUNT value on done: 923457.0 [2024-08-06 07:52:10,156][52667] Sum rewards: 79.810, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.812', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.168', 'AMMO4': '0.170', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:11,454][52650] Updated weights for policy 0, policy_version 79791 (0.0017) [2024-08-06 07:52:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17613.0, 300 sec: 17494.8). Total num frames: 653672448. Throughput: 0: 4354.7. Samples: 163425240. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:52:12,794][52567] Avg episode reward: [(0, '78.048')] [2024-08-06 07:52:12,850][52668] DAMAGECOUNT value on done: 899375.0 [2024-08-06 07:52:12,852][52668] Sum rewards: 81.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.130', 'AMMO4': '0.173', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.300', 'weapon3': '3.402', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:12,875][52667] DAMAGECOUNT value on done: 922378.0 [2024-08-06 07:52:12,876][52667] Sum rewards: 73.811, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.071', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.037', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.640', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 07:52:12,905][52662] DAMAGECOUNT value on done: 910887.0 [2024-08-06 07:52:12,906][52662] Sum rewards: 79.360, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.606', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.130', 'weapon5': '0.172', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:15,561][52668] DAMAGECOUNT value on done: 893069.0 [2024-08-06 07:52:15,561][52668] Sum rewards: 79.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.076', 'weapon5': '0.114', 'AMMO3': '0.172', 'AMMO4': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.294', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:15,964][52650] Updated weights for policy 0, policy_version 79801 (0.0013) [2024-08-06 07:52:15,967][52662] DAMAGECOUNT value on done: 917198.0 [2024-08-06 07:52:15,969][52662] Sum rewards: 79.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.040', 'weapon5': '0.060', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'AMMO4': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:15,984][52667] DAMAGECOUNT value on done: 915504.0 [2024-08-06 07:52:15,985][52667] Sum rewards: 63.401, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.840', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.080', 'weapon5': '0.216', 'AMMO4': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.968', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '54.000'} [2024-08-06 07:52:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 653754368. Throughput: 0: 4352.4. Samples: 163438140. Policy #0 lag: (min: 1.0, avg: 3.9, max: 8.0) [2024-08-06 07:52:17,794][52567] Avg episode reward: [(0, '77.834')] [2024-08-06 07:52:18,325][52659] DAMAGECOUNT value on done: 913633.0 [2024-08-06 07:52:18,325][52659] Sum rewards: 73.302, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.560', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.056', 'AMMO4': '0.139', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.400', 'weapon2': '0.592', 'WEAPON3': '0.950', 'weapon3': '2.974', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '56.000'} [2024-08-06 07:52:18,691][52668] DAMAGECOUNT value on done: 908036.0 [2024-08-06 07:52:18,692][52668] Sum rewards: 82.287, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.007', 'HEALTH': '0.021', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.127', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.736', 'WEAPON3': '0.800', 'weapon3': '2.926', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.837', 'FRAGCOUNT': '63.000'} [2024-08-06 07:52:18,927][52667] DAMAGECOUNT value on done: 912403.0 [2024-08-06 07:52:18,927][52667] Sum rewards: 70.996, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.760', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.140', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon4': '0.410', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '2.764', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.776', 'FRAGCOUNT': '58.000'} [2024-08-06 07:52:19,167][52662] DAMAGECOUNT value on done: 910287.0 [2024-08-06 07:52:19,169][52662] Sum rewards: 81.883, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.999', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.146', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:20,762][52650] Updated weights for policy 0, policy_version 79811 (0.0013) [2024-08-06 07:52:21,548][52659] DAMAGECOUNT value on done: 908917.0 [2024-08-06 07:52:21,549][52659] Sum rewards: 85.887, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.620', 'AMMO5': '0.011', 'AMMO2': '0.043', 'AMMO3': '0.157', 'weapon5': '0.160', 'weapon4': '0.208', 'AMMO4': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.000', 'weapon3': '2.998', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:21,623][52667] DAMAGECOUNT value on done: 913998.0 [2024-08-06 07:52:21,624][52667] Sum rewards: 71.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.454', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.110', 'AMMO4': '0.145', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '59.000'} [2024-08-06 07:52:21,852][52668] DAMAGECOUNT value on done: 910178.0 [2024-08-06 07:52:21,852][52668] Sum rewards: 63.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon5': '0.188', 'AMMO3': '0.227', 'AMMO4': '0.246', 'weapon2': '0.262', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'HITCOUNT': '2.930', 'weapon3': '3.234', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '54.000'} [2024-08-06 07:52:21,969][52811] DAMAGECOUNT value on done: 863985.0 [2024-08-06 07:52:21,969][52811] Sum rewards: 85.367, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.295', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'weapon2': '0.158', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'weapon3': '3.570', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '22.299', 'FRAGCOUNT': '71.000'} [2024-08-06 07:52:22,011][52662] DAMAGECOUNT value on done: 909215.0 [2024-08-06 07:52:22,011][52662] Sum rewards: 76.800, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.576', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.104', 'AMMO4': '0.176', 'AMMO3': '0.216', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '63.500'} [2024-08-06 07:52:22,794][52567] Fps is (10 sec: 17202.5, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 653844480. Throughput: 0: 4354.4. Samples: 163464310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:22,795][52567] Avg episode reward: [(0, '78.185')] [2024-08-06 07:52:24,132][52659] DAMAGECOUNT value on done: 920186.0 [2024-08-06 07:52:24,132][52659] Sum rewards: 63.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.896', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.202', 'AMMO4': '0.228', 'weapon2': '0.248', 'AMMO3': '0.263', 'weapon4': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.928', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '56.000'} [2024-08-06 07:52:24,632][52667] DAMAGECOUNT value on done: 922147.0 [2024-08-06 07:52:24,633][52667] Sum rewards: 78.872, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.200', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.138', 'AMMO3': '0.198', 'AMMO4': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '64.000'} [2024-08-06 07:52:24,858][52662] DAMAGECOUNT value on done: 903870.0 [2024-08-06 07:52:24,860][52662] Sum rewards: 72.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.124', 'weapon5': '0.174', 'weapon2': '0.178', 'AMMO4': '0.236', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.304', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '61.000'} [2024-08-06 07:52:25,055][52668] DAMAGECOUNT value on done: 909572.0 [2024-08-06 07:52:25,057][52668] Sum rewards: 82.712, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.468', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.086', 'AMMO3': '0.140', 'WEAPON4': '0.200', 'AMMO4': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.668', 'WEAPON3': '0.850', 'weapon3': '3.016', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '64.000'} [2024-08-06 07:52:25,171][52811] DAMAGECOUNT value on done: 847447.0 [2024-08-06 07:52:25,174][52811] Sum rewards: 70.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.136', 'AMMO3': '0.189', 'weapon5': '0.272', 'AMMO4': '0.299', 'weapon2': '0.368', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.940', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '57.500'} [2024-08-06 07:52:25,469][52650] Updated weights for policy 0, policy_version 79821 (0.0013) [2024-08-06 07:52:26,700][52660] DAMAGECOUNT value on done: 906865.0 [2024-08-06 07:52:26,701][52660] Sum rewards: 81.773, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.321', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.080', 'weapon5': '0.132', 'AMMO4': '0.146', 'weapon2': '0.240', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:27,110][52659] DAMAGECOUNT value on done: 913746.0 [2024-08-06 07:52:27,110][52659] Sum rewards: 85.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.136', 'weapon4': '0.160', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.733', 'FRAGCOUNT': '68.000'} [2024-08-06 07:52:27,466][52662] DAMAGECOUNT value on done: 913176.0 [2024-08-06 07:52:27,466][52662] Sum rewards: 75.210, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.848', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.088', 'weapon4': '0.094', 'WEAPON5': '0.100', 'weapon2': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.446', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '64.000'} [2024-08-06 07:52:27,544][52667] DAMAGECOUNT value on done: 908630.0 [2024-08-06 07:52:27,545][52667] Sum rewards: 84.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.605', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.102', 'AMMO4': '0.144', 'weapon5': '0.154', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '70.000'} [2024-08-06 07:52:27,715][52668] DAMAGECOUNT value on done: 912180.0 [2024-08-06 07:52:27,715][52668] Sum rewards: 82.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon5': '0.130', 'AMMO4': '0.177', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.4). Total num frames: 653926400. Throughput: 0: 4354.2. Samples: 163490780. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:27,794][52567] Avg episode reward: [(0, '78.027')] [2024-08-06 07:52:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079825_653926400.pth... [2024-08-06 07:52:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079314_649740288.pth [2024-08-06 07:52:28,330][52811] DAMAGECOUNT value on done: 841454.0 [2024-08-06 07:52:28,331][52811] Sum rewards: 66.211, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.215', 'weapon5': '0.254', 'AMMO4': '0.256', 'weapon2': '0.294', 'weapon4': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.802', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '55.500'} [2024-08-06 07:52:29,351][52660] DAMAGECOUNT value on done: 898104.0 [2024-08-06 07:52:29,352][52660] Sum rewards: 65.921, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.035', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon5': '0.088', 'weapon4': '0.192', 'AMMO3': '0.208', 'weapon2': '0.242', 'AMMO4': '0.281', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.246', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '55.000'} [2024-08-06 07:52:29,567][52659] DAMAGECOUNT value on done: 908852.0 [2024-08-06 07:52:29,569][52659] Sum rewards: 73.703, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.365', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.066', 'AMMO4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '63.000'} [2024-08-06 07:52:30,033][52650] Updated weights for policy 0, policy_version 79831 (0.0011) [2024-08-06 07:52:30,268][52662] DAMAGECOUNT value on done: 903611.0 [2024-08-06 07:52:30,269][52662] Sum rewards: 75.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.330', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon4': '0.078', 'weapon5': '0.084', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '61.000'} [2024-08-06 07:52:30,399][52668] DAMAGECOUNT value on done: 914759.0 [2024-08-06 07:52:30,400][52668] Sum rewards: 66.110, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.206', 'AMMO4': '0.242', 'AMMO3': '0.289', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.060', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '58.000'} [2024-08-06 07:52:30,849][52667] DAMAGECOUNT value on done: 912417.0 [2024-08-06 07:52:30,851][52667] Sum rewards: 68.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.176', 'AMMO4': '0.236', 'weapon5': '0.238', 'weapon4': '0.242', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '56.000'} [2024-08-06 07:52:31,307][52811] DAMAGECOUNT value on done: 846297.0 [2024-08-06 07:52:31,308][52811] Sum rewards: 78.271, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.229', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:31,700][52660] DAMAGECOUNT value on done: 910000.0 [2024-08-06 07:52:31,702][52660] Sum rewards: 80.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.172', 'weapon4': '0.176', 'AMMO4': '0.210', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '65.500'} [2024-08-06 07:52:32,280][52659] DAMAGECOUNT value on done: 912085.0 [2024-08-06 07:52:32,280][52659] Sum rewards: 87.277, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.454', 'HEALTH': '0.723', 'WEAPON3': '1.100', 'weapon3': '3.076', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '70.000'} [2024-08-06 07:52:32,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 654016512. Throughput: 0: 4357.3. Samples: 163503760. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:32,794][52567] Avg episode reward: [(0, '77.789')] [2024-08-06 07:52:33,161][52662] DAMAGECOUNT value on done: 920936.0 [2024-08-06 07:52:33,172][52662] Sum rewards: 76.673, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.668', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.164', 'weapon4': '0.340', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '61.000'} [2024-08-06 07:52:33,852][52667] DAMAGECOUNT value on done: 920480.0 [2024-08-06 07:52:33,853][52667] Sum rewards: 81.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.066', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '68.000'} [2024-08-06 07:52:34,371][52660] DAMAGECOUNT value on done: 922158.0 [2024-08-06 07:52:34,372][52660] Sum rewards: 71.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.197', 'weapon5': '0.210', 'AMMO4': '0.227', 'weapon4': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '58.000'} [2024-08-06 07:52:34,558][52811] DAMAGECOUNT value on done: 849269.0 [2024-08-06 07:52:34,559][52811] Sum rewards: 80.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon2': '0.116', 'weapon5': '0.130', 'AMMO4': '0.145', 'weapon4': '0.168', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:34,995][52650] Updated weights for policy 0, policy_version 79841 (0.0013) [2024-08-06 07:52:35,034][52659] DAMAGECOUNT value on done: 913879.0 [2024-08-06 07:52:35,034][52659] Sum rewards: 58.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.716', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon5': '0.178', 'weapon4': '0.184', 'AMMO3': '0.211', 'AMMO4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.250', 'HITCOUNT': '2.940', 'weapon3': '2.950', 'DAMAGECOUNT': '15.180', 'FRAGCOUNT': '48.500'} [2024-08-06 07:52:35,916][52662] DAMAGECOUNT value on done: 913574.0 [2024-08-06 07:52:35,917][52662] Sum rewards: 74.247, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.949', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.094', 'weapon5': '0.122', 'AMMO4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.650', 'weapon3': '3.110', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '64.000'} [2024-08-06 07:52:36,897][52667] DAMAGECOUNT value on done: 912082.0 [2024-08-06 07:52:36,897][52667] Sum rewards: 85.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.024', 'weapon5': '0.092', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.574', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '72.000'} [2024-08-06 07:52:36,902][52660] DAMAGECOUNT value on done: 903082.0 [2024-08-06 07:52:36,903][52660] Sum rewards: 61.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.763', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.034', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.580', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.747', 'FRAGCOUNT': '52.000'} [2024-08-06 07:52:37,698][52811] DAMAGECOUNT value on done: 864683.0 [2024-08-06 07:52:37,700][52811] Sum rewards: 82.239, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.485', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.083', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.530', 'WEAPON3': '0.950', 'weapon3': '3.204', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:37,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 654106624. Throughput: 0: 4354.6. Samples: 163530020. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:37,795][52567] Avg episode reward: [(0, '77.375')] [2024-08-06 07:52:38,251][52659] DAMAGECOUNT value on done: 911270.0 [2024-08-06 07:52:38,251][52659] Sum rewards: 79.947, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.305', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.174', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.490', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:38,737][52662] DAMAGECOUNT value on done: 903511.0 [2024-08-06 07:52:38,739][52662] Sum rewards: 79.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.315', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon4': '0.038', 'weapon5': '0.062', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.274', 'WEAPON3': '1.450', 'HITCOUNT': '3.450', 'weapon3': '3.460', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:39,766][52660] DAMAGECOUNT value on done: 903214.0 [2024-08-06 07:52:39,767][52660] Sum rewards: 67.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.196', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.134', 'weapon2': '0.178', 'weapon4': '0.198', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '56.000'} [2024-08-06 07:52:39,771][52667] DAMAGECOUNT value on done: 915175.0 [2024-08-06 07:52:39,771][52667] Sum rewards: 71.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.751', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.176', 'weapon2': '0.222', 'AMMO4': '0.225', 'AMMO3': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.262', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '61.000'} [2024-08-06 07:52:39,954][52650] Updated weights for policy 0, policy_version 79851 (0.0011) [2024-08-06 07:52:40,849][52811] DAMAGECOUNT value on done: 857682.0 [2024-08-06 07:52:40,851][52811] Sum rewards: 78.444, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.154', 'weapon5': '0.190', 'AMMO3': '0.224', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '64.000'} [2024-08-06 07:52:41,328][52659] DAMAGECOUNT value on done: 910857.0 [2024-08-06 07:52:41,329][52659] Sum rewards: 84.422, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.110', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.200', 'weapon4': '0.300', 'weapon2': '0.696', 'WEAPON3': '0.850', 'weapon3': '2.754', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:41,803][52662] DAMAGECOUNT value on done: 907414.0 [2024-08-06 07:52:41,804][52662] Sum rewards: 64.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.204', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon4': '0.098', 'weapon5': '0.176', 'AMMO3': '0.215', 'AMMO4': '0.237', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '53.000'} [2024-08-06 07:52:42,326][52667] DAMAGECOUNT value on done: 923288.0 [2024-08-06 07:52:42,326][52667] Sum rewards: 92.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.885', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.040', 'weapon5': '0.064', 'AMMO4': '0.157', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.396', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '76.000'} [2024-08-06 07:52:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 654188544. Throughput: 0: 4356.9. Samples: 163556270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:42,794][52567] Avg episode reward: [(0, '77.186')] [2024-08-06 07:52:42,880][52660] DAMAGECOUNT value on done: 908265.0 [2024-08-06 07:52:42,880][52660] Sum rewards: 67.019, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.265', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.100', 'weapon5': '0.178', 'AMMO4': '0.196', 'weapon2': '0.204', 'AMMO3': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.110', 'weapon3': '3.254', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '58.000'} [2024-08-06 07:52:42,900][52614] Signal inference workers to stop experience collection... (14650 times) [2024-08-06 07:52:42,900][52614] Signal inference workers to resume experience collection... (14650 times) [2024-08-06 07:52:42,989][52650] InferenceWorker_p0-w0: stopping experience collection (14650 times) [2024-08-06 07:52:42,989][52650] InferenceWorker_p0-w0: resuming experience collection (14650 times) [2024-08-06 07:52:43,242][52794] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.513, 171.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:52:43,984][52811] DAMAGECOUNT value on done: 846707.0 [2024-08-06 07:52:43,985][52811] Sum rewards: 77.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.108', 'weapon4': '0.150', 'weapon2': '0.186', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'weapon3': '3.348', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '63.000'} [2024-08-06 07:52:44,128][52650] Updated weights for policy 0, policy_version 79861 (0.0012) [2024-08-06 07:52:44,159][52659] DAMAGECOUNT value on done: 919403.0 [2024-08-06 07:52:44,163][52659] Sum rewards: 82.723, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.006', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.175', 'weapon5': '0.206', 'AMMO3': '0.244', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '69.000'} [2024-08-06 07:52:44,860][52662] DAMAGECOUNT value on done: 903824.0 [2024-08-06 07:52:44,862][52662] Sum rewards: 82.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.635', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.029', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.232', 'weapon2': '0.258', 'WEAPON3': '1.450', 'weapon3': '3.510', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '67.500'} [2024-08-06 07:52:44,987][52667] DAMAGECOUNT value on done: 923301.0 [2024-08-06 07:52:44,988][52667] Sum rewards: 60.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.220', 'weapon3': '3.370', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '53.000'} [2024-08-06 07:52:45,509][52660] DAMAGECOUNT value on done: 915933.0 [2024-08-06 07:52:45,509][52660] Sum rewards: 84.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.369', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO4': '0.201', 'AMMO3': '0.210', 'weapon2': '0.248', 'weapon4': '0.276', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '69.000'} [2024-08-06 07:52:46,330][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:52:47,004][52811] DAMAGECOUNT value on done: 854162.0 [2024-08-06 07:52:47,004][52811] Sum rewards: 75.538, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.116', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.174', 'AMMO4': '0.185', 'weapon5': '0.222', 'weapon4': '0.344', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.626', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '59.000'} [2024-08-06 07:52:47,016][52647] DAMAGECOUNT value on done: 971549.0 [2024-08-06 07:52:47,016][52647] Sum rewards: 81.111, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.068', 'weapon5': '0.082', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.222', 'WEAPON3': '1.200', 'weapon3': '3.414', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:47,080][52659] DAMAGECOUNT value on done: 905990.0 [2024-08-06 07:52:47,081][52659] Sum rewards: 72.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.719', 'AMMO5': '0.006', 'AMMO2': '0.044', 'weapon5': '0.078', 'weapon4': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'AMMO3': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.252', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '62.000'} [2024-08-06 07:52:47,778][52667] DAMAGECOUNT value on done: 917346.0 [2024-08-06 07:52:47,780][52667] Sum rewards: 60.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.159', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.147', 'weapon2': '0.214', 'AMMO3': '0.217', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.254', 'DAMAGECOUNT': '15.090', 'FRAGCOUNT': '50.000'} [2024-08-06 07:52:47,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 654278656. Throughput: 0: 4355.8. Samples: 163569310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:47,794][52567] Avg episode reward: [(0, '76.586')] [2024-08-06 07:52:48,377][52660] DAMAGECOUNT value on done: 904173.0 [2024-08-06 07:52:48,378][52660] Sum rewards: 68.408, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.000', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon4': '0.076', 'weapon5': '0.172', 'AMMO3': '0.248', 'AMMO4': '0.290', 'weapon2': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.500'} [2024-08-06 07:52:48,902][52650] Updated weights for policy 0, policy_version 79871 (0.0035) [2024-08-06 07:52:50,048][52659] DAMAGECOUNT value on done: 917752.0 [2024-08-06 07:52:50,048][52659] Sum rewards: 79.892, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'weapon2': '0.210', 'AMMO3': '0.219', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:50,072][52811] DAMAGECOUNT value on done: 853109.0 [2024-08-06 07:52:50,072][52811] Sum rewards: 81.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.230', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.410', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '68.000'} [2024-08-06 07:52:50,087][52647] DAMAGECOUNT value on done: 958868.0 [2024-08-06 07:52:50,087][52647] Sum rewards: 65.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.464', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.116', 'AMMO4': '0.117', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.676', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '53.500'} [2024-08-06 07:52:50,345][52667] DAMAGECOUNT value on done: 916637.0 [2024-08-06 07:52:50,346][52667] Sum rewards: 83.494, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.566', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.112', 'AMMO4': '0.171', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.374', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '21.294', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:51,351][52660] DAMAGECOUNT value on done: 899961.0 [2024-08-06 07:52:51,351][52660] Sum rewards: 71.567, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.666', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.136', 'AMMO4': '0.158', 'weapon5': '0.160', 'AMMO3': '0.198', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '62.000'} [2024-08-06 07:52:52,102][52665] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2024-08-06 07:52:52,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 654368768. Throughput: 0: 4363.8. Samples: 163595610. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:52,795][52567] Avg episode reward: [(0, '76.396')] [2024-08-06 07:52:52,874][52811] DAMAGECOUNT value on done: 857019.0 [2024-08-06 07:52:52,876][52811] Sum rewards: 77.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.266', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.112', 'weapon5': '0.134', 'AMMO4': '0.154', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '65.000'} [2024-08-06 07:52:52,906][52667] DAMAGECOUNT value on done: 919962.0 [2024-08-06 07:52:52,908][52667] Sum rewards: 71.591, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.731', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.098', 'weapon5': '0.128', 'AMMO4': '0.168', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '59.000'} [2024-08-06 07:52:53,220][52647] DAMAGECOUNT value on done: 965638.0 [2024-08-06 07:52:53,220][52647] Sum rewards: 75.972, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.592', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.174', 'weapon2': '0.200', 'AMMO4': '0.223', 'weapon4': '0.294', 'AMMO3': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.050', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '66.000'} [2024-08-06 07:52:53,259][52659] DAMAGECOUNT value on done: 910638.0 [2024-08-06 07:52:53,259][52659] Sum rewards: 84.037, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.103', 'weapon5': '0.120', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:53,354][52650] Updated weights for policy 0, policy_version 79881 (0.0054) [2024-08-06 07:52:54,428][52660] DAMAGECOUNT value on done: 907875.0 [2024-08-06 07:52:54,428][52660] Sum rewards: 66.159, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.590', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.108', 'weapon2': '0.206', 'AMMO4': '0.221', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.328', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '57.000'} [2024-08-06 07:52:55,882][52811] DAMAGECOUNT value on done: 861654.0 [2024-08-06 07:52:55,884][52811] Sum rewards: 62.308, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.506', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon4': '0.070', 'AMMO4': '0.086', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.492', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.068', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '54.000'} [2024-08-06 07:52:56,198][52659] DAMAGECOUNT value on done: 908624.0 [2024-08-06 07:52:56,198][52659] Sum rewards: 72.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.978', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.182', 'weapon4': '0.202', 'AMMO4': '0.230', 'AMMO3': '0.241', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '61.000'} [2024-08-06 07:52:56,234][52647] DAMAGECOUNT value on done: 964699.0 [2024-08-06 07:52:56,236][52647] Sum rewards: 81.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.314', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.518', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '67.000'} [2024-08-06 07:52:57,604][52660] DAMAGECOUNT value on done: 901680.0 [2024-08-06 07:52:57,605][52660] Sum rewards: 75.670, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.932', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.068', 'weapon5': '0.092', 'AMMO4': '0.141', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'weapon2': '0.422', 'WEAPON3': '1.500', 'weapon3': '3.192', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '64.500'} [2024-08-06 07:52:57,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 654450688. Throughput: 0: 4366.9. Samples: 163621750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:52:57,795][52567] Avg episode reward: [(0, '76.507')] [2024-08-06 07:52:58,236][52650] Updated weights for policy 0, policy_version 79891 (0.0021) [2024-08-06 07:52:58,743][52647] DAMAGECOUNT value on done: 973617.0 [2024-08-06 07:52:58,743][52647] Sum rewards: 80.988, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.490', 'ARMOR': '0.004', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon4': '0.092', 'weapon5': '0.262', 'AMMO3': '0.263', 'AMMO4': '0.283', 'weapon2': '0.446', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.920', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '70.000'} [2024-08-06 07:52:58,913][52659] DAMAGECOUNT value on done: 911458.0 [2024-08-06 07:52:58,914][52659] Sum rewards: 73.486, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.424', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '60.000'} [2024-08-06 07:52:59,008][52811] DAMAGECOUNT value on done: 851248.0 [2024-08-06 07:52:59,008][52811] Sum rewards: 62.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.451', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '2.910', 'weapon3': '3.454', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '54.000'} [2024-08-06 07:53:00,577][52660] DAMAGECOUNT value on done: 901879.0 [2024-08-06 07:53:00,579][52660] Sum rewards: 77.465, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.936', 'AMMO5': '0.003', 'ARMOR': '0.008', 'AMMO2': '0.024', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.068', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.246', 'AMMO3': '0.265', 'WEAPON3': '1.650', 'weapon3': '3.480', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:01,626][52647] DAMAGECOUNT value on done: 969728.0 [2024-08-06 07:53:01,626][52647] Sum rewards: 71.059, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.074', 'weapon5': '0.112', 'AMMO4': '0.168', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:01,647][52659] DAMAGECOUNT value on done: 910381.0 [2024-08-06 07:53:01,647][52659] Sum rewards: 70.091, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.789', 'AMMO2': '0.027', 'weapon4': '0.052', 'WEAPON4': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.253', 'weapon2': '0.368', 'WEAPON3': '1.400', 'HITCOUNT': '3.300', 'weapon3': '3.362', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:02,014][52811] DAMAGECOUNT value on done: 849335.0 [2024-08-06 07:53:02,016][52811] Sum rewards: 75.015, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.580', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon5': '0.192', 'weapon4': '0.210', 'weapon2': '0.228', 'AMMO4': '0.251', 'AMMO3': '0.253', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 654540800. Throughput: 0: 4375.1. Samples: 163635020. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:53:02,795][52567] Avg episode reward: [(0, '75.607')] [2024-08-06 07:53:03,382][52650] Updated weights for policy 0, policy_version 79901 (0.0011) [2024-08-06 07:53:03,444][52660] DAMAGECOUNT value on done: 913596.0 [2024-08-06 07:53:03,445][52660] Sum rewards: 75.153, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.715', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.028', 'AMMO4': '0.113', 'weapon5': '0.142', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 07:53:04,200][52647] DAMAGECOUNT value on done: 972639.0 [2024-08-06 07:53:04,201][52647] Sum rewards: 87.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.999', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.144', 'AMMO4': '0.165', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.650', 'weapon3': '3.134', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '22.593', 'FRAGCOUNT': '72.000'} [2024-08-06 07:53:04,603][52659] DAMAGECOUNT value on done: 919767.0 [2024-08-06 07:53:04,605][52659] Sum rewards: 72.306, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.158', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.138', 'AMMO3': '0.182', 'AMMO4': '0.183', 'weapon4': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '60.000'} [2024-08-06 07:53:05,188][52811] DAMAGECOUNT value on done: 851095.0 [2024-08-06 07:53:05,188][52811] Sum rewards: 82.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.665', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.076', 'weapon5': '0.216', 'AMMO3': '0.230', 'weapon2': '0.240', 'AMMO4': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.838', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:06,615][52660] DAMAGECOUNT value on done: 925895.0 [2024-08-06 07:53:06,617][52660] Sum rewards: 77.842, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.570', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.171', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:06,970][52647] DAMAGECOUNT value on done: 946652.0 [2024-08-06 07:53:06,970][52647] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.120', 'weapon4': '0.128', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.258', 'AMMO3': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:07,419][52659] DAMAGECOUNT value on done: 905569.0 [2024-08-06 07:53:07,419][52659] Sum rewards: 80.036, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.172', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO4': '0.219', 'weapon2': '0.242', 'weapon5': '0.256', 'AMMO3': '0.259', 'weapon4': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.854', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:07,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 654622720. Throughput: 0: 4373.8. Samples: 163661130. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 07:53:07,794][52567] Avg episode reward: [(0, '75.749')] [2024-08-06 07:53:07,997][52650] Updated weights for policy 0, policy_version 79911 (0.0019) [2024-08-06 07:53:08,218][52811] DAMAGECOUNT value on done: 851098.0 [2024-08-06 07:53:08,218][52811] Sum rewards: 75.111, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.720', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.084', 'weapon4': '0.106', 'AMMO4': '0.155', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 07:53:08,983][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.03, -10.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:53:09,587][52660] DAMAGECOUNT value on done: 904466.0 [2024-08-06 07:53:09,590][52660] Sum rewards: 68.424, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.662', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.186', 'AMMO4': '0.199', 'weapon2': '0.254', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.232', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '58.000'} [2024-08-06 07:53:09,685][52647] DAMAGECOUNT value on done: 962156.0 [2024-08-06 07:53:09,688][52647] Sum rewards: 71.049, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.352', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.255', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '59.000'} [2024-08-06 07:53:09,935][52659] DAMAGECOUNT value on done: 917129.0 [2024-08-06 07:53:09,936][52659] Sum rewards: 78.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.206', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.178', 'AMMO4': '0.216', 'weapon5': '0.236', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.804', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '62.500'} [2024-08-06 07:53:10,003][52658] DAMAGECOUNT value on done: 913293.0 [2024-08-06 07:53:10,003][52658] Sum rewards: 77.601, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.246', 'AMMO3': '0.252', 'weapon2': '0.336', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:11,007][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:53:11,442][52811] DAMAGECOUNT value on done: 859349.0 [2024-08-06 07:53:11,442][52811] Sum rewards: 79.619, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.410', 'AMMO5': '0.009', 'AMMO2': '0.018', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.090', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '0.950', 'weapon3': '3.164', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '64.000'} [2024-08-06 07:53:12,086][52650] Updated weights for policy 0, policy_version 79921 (0.0012) [2024-08-06 07:53:12,103][52647] DAMAGECOUNT value on done: 961552.0 [2024-08-06 07:53:12,104][52647] Sum rewards: 59.317, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.601', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.062', 'weapon5': '0.062', 'AMMO3': '0.196', 'AMMO4': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.178', 'DAMAGECOUNT': '15.663', 'FRAGCOUNT': '52.000'} [2024-08-06 07:53:12,631][52660] DAMAGECOUNT value on done: 911948.0 [2024-08-06 07:53:12,632][52660] Sum rewards: 68.768, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO4': '0.164', 'AMMO3': '0.165', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'HEALTH': '0.453', 'weapon2': '0.456', 'WEAPON3': '0.950', 'weapon3': '3.052', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '54.000'} [2024-08-06 07:53:12,771][52658] DAMAGECOUNT value on done: 916626.0 [2024-08-06 07:53:12,771][52658] Sum rewards: 67.836, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.830', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon4': '0.052', 'WEAPON4': '0.100', 'weapon2': '0.188', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'HITCOUNT': '3.300', 'weapon3': '3.594', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '59.000'} [2024-08-06 07:53:12,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 654712832. Throughput: 0: 4374.9. Samples: 163687650. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:12,794][52567] Avg episode reward: [(0, '75.287')] [2024-08-06 07:53:13,258][52659] DAMAGECOUNT value on done: 910394.0 [2024-08-06 07:53:13,258][52659] Sum rewards: 77.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.330', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.048', 'weapon5': '0.086', 'weapon2': '0.182', 'AMMO3': '0.189', 'AMMO4': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.540', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:14,144][52669] DAMAGECOUNT value on done: 911358.0 [2024-08-06 07:53:14,145][52669] Sum rewards: 73.337, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.146', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.112', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'weapon2': '0.616', 'WEAPON3': '1.000', 'weapon3': '2.988', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '59.000'} [2024-08-06 07:53:14,515][52811] DAMAGECOUNT value on done: 862390.0 [2024-08-06 07:53:14,517][52811] Sum rewards: 74.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.923', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO3': '0.185', 'AMMO4': '0.254', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.294', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:14,523][52647] DAMAGECOUNT value on done: 959209.0 [2024-08-06 07:53:14,523][52647] Sum rewards: 78.238, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.730', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.064', 'weapon4': '0.112', 'AMMO4': '0.121', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.392', 'WEAPON3': '1.000', 'weapon3': '3.252', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:15,428][52658] DAMAGECOUNT value on done: 917337.0 [2024-08-06 07:53:15,431][52658] Sum rewards: 83.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.993', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '69.000'} [2024-08-06 07:53:15,438][52660] DAMAGECOUNT value on done: 909036.0 [2024-08-06 07:53:15,440][52660] Sum rewards: 78.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.264', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.073', 'AMMO3': '0.192', 'weapon2': '0.402', 'WEAPON3': '1.300', 'weapon3': '3.392', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '64.000'} [2024-08-06 07:53:16,240][52803] DAMAGECOUNT value on done: 847906.0 [2024-08-06 07:53:16,240][52803] Sum rewards: 74.329, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.189', 'weapon2': '0.344', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.332', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:16,847][52647] DAMAGECOUNT value on done: 950919.0 [2024-08-06 07:53:16,848][52647] Sum rewards: 74.511, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.565', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.146', 'weapon4': '0.148', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:16,889][52669] DAMAGECOUNT value on done: 908014.0 [2024-08-06 07:53:16,889][52669] Sum rewards: 69.989, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.334', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.100', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.384', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:17,058][52650] Updated weights for policy 0, policy_version 79931 (0.0022) [2024-08-06 07:53:17,785][52811] DAMAGECOUNT value on done: 849885.0 [2024-08-06 07:53:17,786][52811] Sum rewards: 69.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.138', 'weapon2': '0.180', 'AMMO4': '0.180', 'weapon4': '0.184', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '59.500'} [2024-08-06 07:53:17,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 654811136. Throughput: 0: 4380.9. Samples: 163700900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:17,794][52567] Avg episode reward: [(0, '75.154')] [2024-08-06 07:53:18,223][52658] DAMAGECOUNT value on done: 915507.0 [2024-08-06 07:53:18,226][52658] Sum rewards: 71.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.990', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.186', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.575', 'FRAGCOUNT': '58.000'} [2024-08-06 07:53:18,724][52660] DAMAGECOUNT value on done: 901414.0 [2024-08-06 07:53:18,724][52660] Sum rewards: 77.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.994', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.040', 'weapon5': '0.132', 'AMMO4': '0.173', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.090', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:19,380][52803] DAMAGECOUNT value on done: 847154.0 [2024-08-06 07:53:19,381][52803] Sum rewards: 83.751, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'weapon2': '0.244', 'weapon4': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:19,609][52669] DAMAGECOUNT value on done: 920599.0 [2024-08-06 07:53:19,610][52669] Sum rewards: 92.950, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.570', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.118', 'AMMO3': '0.130', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '0.850', 'weapon3': '3.028', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '74.000'} [2024-08-06 07:53:19,682][52647] DAMAGECOUNT value on done: 962278.0 [2024-08-06 07:53:19,683][52647] Sum rewards: 54.035, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.890', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.152', 'AMMO4': '0.161', 'AMMO3': '0.212', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.350', 'HITCOUNT': '2.550', 'weapon3': '2.864', 'DAMAGECOUNT': '13.251', 'FRAGCOUNT': '46.000'} [2024-08-06 07:53:20,649][52658] DAMAGECOUNT value on done: 908928.0 [2024-08-06 07:53:20,651][52658] Sum rewards: 79.691, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.784', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.087', 'AMMO3': '0.143', 'weapon5': '0.182', 'weapon4': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '0.950', 'weapon3': '2.904', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:20,738][52811] DAMAGECOUNT value on done: 847772.0 [2024-08-06 07:53:20,738][52811] Sum rewards: 71.384, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.063', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.163', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '3.114', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '57.000'} [2024-08-06 07:53:21,642][52660] DAMAGECOUNT value on done: 900764.0 [2024-08-06 07:53:21,644][52660] Sum rewards: 86.823, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.715', 'AMMO5': '0.009', 'AMMO2': '0.051', 'weapon5': '0.112', 'weapon4': '0.178', 'weapon2': '0.212', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'AMMO4': '0.256', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '72.000'} [2024-08-06 07:53:21,765][52650] Updated weights for policy 0, policy_version 79941 (0.0014) [2024-08-06 07:53:22,175][52647] DAMAGECOUNT value on done: 954205.0 [2024-08-06 07:53:22,175][52647] Sum rewards: 69.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.772', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.122', 'AMMO3': '0.189', 'weapon4': '0.202', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '56.000'} [2024-08-06 07:53:22,271][52671] DAMAGECOUNT value on done: 917992.0 [2024-08-06 07:53:22,274][52671] Sum rewards: 80.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.043', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.492', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:22,408][52803] DAMAGECOUNT value on done: 854476.0 [2024-08-06 07:53:22,411][52803] Sum rewards: 64.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.772', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.062', 'AMMO4': '0.124', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.258', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '55.000'} [2024-08-06 07:53:22,696][52669] DAMAGECOUNT value on done: 913290.0 [2024-08-06 07:53:22,697][52669] Sum rewards: 80.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.149', 'weapon2': '0.152', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.380', 'weapon3': '3.470', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:22,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 654893056. Throughput: 0: 4376.2. Samples: 163726950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:22,795][52567] Avg episode reward: [(0, '75.107')] [2024-08-06 07:53:23,070][52658] DAMAGECOUNT value on done: 904691.0 [2024-08-06 07:53:23,071][52658] Sum rewards: 85.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.845', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'weapon2': '0.302', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '72.000'} [2024-08-06 07:53:24,893][52647] DAMAGECOUNT value on done: 961572.0 [2024-08-06 07:53:24,894][52647] Sum rewards: 80.199, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.098', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.070', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:25,336][52671] DAMAGECOUNT value on done: 924148.0 [2024-08-06 07:53:25,337][52671] Sum rewards: 82.462, reward structure: {'DEATHCOUNT': '-12.750', 'WEAPON1': '0.010', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon4': '0.152', 'AMMO3': '0.175', 'AMMO4': '0.289', 'weapon5': '0.292', 'HEALTH': '0.374', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '2.628', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '65.000'} [2024-08-06 07:53:25,421][52658] DAMAGECOUNT value on done: 918217.0 [2024-08-06 07:53:25,421][52658] Sum rewards: 72.272, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.814', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.126', 'AMMO3': '0.238', 'weapon5': '0.246', 'AMMO4': '0.262', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:25,497][52803] DAMAGECOUNT value on done: 852303.0 [2024-08-06 07:53:25,505][52803] Sum rewards: 72.200, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.072', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.253', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:25,566][52669] DAMAGECOUNT value on done: 922242.0 [2024-08-06 07:53:25,567][52669] Sum rewards: 72.290, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.262', 'weapon2': '0.352', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.384', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:26,437][52650] Updated weights for policy 0, policy_version 79951 (0.0013) [2024-08-06 07:53:27,744][52647] DAMAGECOUNT value on done: 964832.0 [2024-08-06 07:53:27,745][52647] Sum rewards: 74.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.433', 'AMMO5': '0.022', 'AMMO2': '0.054', 'AMMO3': '0.182', 'weapon2': '0.250', 'AMMO4': '0.268', 'weapon5': '0.280', 'weapon4': '0.342', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '60.000'} [2024-08-06 07:53:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 654983168. Throughput: 0: 4373.8. Samples: 163753090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:27,794][52567] Avg episode reward: [(0, '75.166')] [2024-08-06 07:53:28,158][52671] DAMAGECOUNT value on done: 920505.0 [2024-08-06 07:53:28,158][52671] Sum rewards: 77.739, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.070', 'AMMO4': '0.105', 'weapon5': '0.130', 'HEALTH': '0.170', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.150', 'HITCOUNT': '3.240', 'weapon3': '3.284', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '64.000'} [2024-08-06 07:53:28,260][52669] DAMAGECOUNT value on done: 919570.0 [2024-08-06 07:53:28,260][52669] Sum rewards: 85.626, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.975', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon4': '0.082', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:28,456][52658] DAMAGECOUNT value on done: 906858.0 [2024-08-06 07:53:28,456][52658] Sum rewards: 78.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.150', 'weapon5': '0.182', 'AMMO4': '0.189', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.628', 'WEAPON3': '1.250', 'weapon3': '2.820', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:28,521][52663] DAMAGECOUNT value on done: 930530.0 [2024-08-06 07:53:28,523][52663] Sum rewards: 69.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO3': '0.175', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '57.000'} [2024-08-06 07:53:28,566][52803] DAMAGECOUNT value on done: 848341.0 [2024-08-06 07:53:28,566][52803] Sum rewards: 73.668, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'AMMO2': '0.042', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.211', 'weapon4': '0.228', 'AMMO3': '0.250', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:28,848][52668] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon5', 0.002)] [2024-08-06 07:53:30,469][52647] DAMAGECOUNT value on done: 949917.0 [2024-08-06 07:53:30,469][52647] Sum rewards: 76.890, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.580', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO4': '0.171', 'weapon2': '0.180', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:30,794][52794] DAMAGECOUNT value on done: 904831.0 [2024-08-06 07:53:30,795][52794] Sum rewards: 69.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.692', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.058', 'AMMO4': '0.059', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '58.500'} [2024-08-06 07:53:30,997][52669] DAMAGECOUNT value on done: 917713.0 [2024-08-06 07:53:30,998][52669] Sum rewards: 72.467, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.138', 'AMMO4': '0.184', 'weapon2': '0.194', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.060', 'weapon3': '3.330', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:31,101][52671] DAMAGECOUNT value on done: 922035.0 [2024-08-06 07:53:31,103][52671] Sum rewards: 83.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.969', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.148', 'AMMO4': '0.154', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:31,249][52650] Updated weights for policy 0, policy_version 79961 (0.0012) [2024-08-06 07:53:31,392][52663] DAMAGECOUNT value on done: 914999.0 [2024-08-06 07:53:31,392][52663] Sum rewards: 81.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.652', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.178', 'AMMO4': '0.180', 'AMMO3': '0.214', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.244', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:31,456][52658] DAMAGECOUNT value on done: 933769.0 [2024-08-06 07:53:31,458][52658] Sum rewards: 75.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.140', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.082', 'weapon5': '0.114', 'AMMO4': '0.161', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '65.000'} [2024-08-06 07:53:31,464][52664] DAMAGECOUNT value on done: 942057.0 [2024-08-06 07:53:31,465][52664] Sum rewards: 76.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.088', 'AMMO4': '0.140', 'AMMO3': '0.194', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '63.500'} [2024-08-06 07:53:31,745][52803] DAMAGECOUNT value on done: 848808.0 [2024-08-06 07:53:31,746][52803] Sum rewards: 65.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.516', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.036', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.594', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.064', 'DAMAGECOUNT': '14.934', 'FRAGCOUNT': '54.000'} [2024-08-06 07:53:32,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 655073280. Throughput: 0: 4375.8. Samples: 163766220. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:32,794][52567] Avg episode reward: [(0, '75.430')] [2024-08-06 07:53:33,355][52794] DAMAGECOUNT value on done: 917950.0 [2024-08-06 07:53:33,356][52794] Sum rewards: 83.011, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.451', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.078', 'AMMO4': '0.193', 'weapon5': '0.196', 'AMMO3': '0.251', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '70.500'} [2024-08-06 07:53:33,609][52647] DAMAGECOUNT value on done: 957975.0 [2024-08-06 07:53:33,609][52647] Sum rewards: 61.631, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.278', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.108', 'AMMO4': '0.128', 'weapon5': '0.136', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.174', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '53.500'} [2024-08-06 07:53:33,942][52658] DAMAGECOUNT value on done: 919234.0 [2024-08-06 07:53:33,944][52658] Sum rewards: 84.568, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.760', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'weapon2': '0.146', 'weapon4': '0.152', 'AMMO3': '0.276', 'WEAPON3': '1.750', 'weapon3': '3.420', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '74.000'} [2024-08-06 07:53:34,184][52669] DAMAGECOUNT value on done: 914670.0 [2024-08-06 07:53:34,185][52669] Sum rewards: 85.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.389', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon4': '0.136', 'weapon5': '0.160', 'AMMO3': '0.197', 'weapon2': '0.242', 'AMMO4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '69.000'} [2024-08-06 07:53:34,231][52671] DAMAGECOUNT value on done: 928198.0 [2024-08-06 07:53:34,231][52671] Sum rewards: 77.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.645', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'AMMO3': '0.203', 'weapon2': '0.780', 'WEAPON3': '1.250', 'weapon3': '3.014', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:34,521][52663] DAMAGECOUNT value on done: 908450.0 [2024-08-06 07:53:34,521][52663] Sum rewards: 76.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.264', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.023', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.454', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:34,613][52664] DAMAGECOUNT value on done: 946614.0 [2024-08-06 07:53:34,613][52664] Sum rewards: 65.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.684', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.116', 'AMMO4': '0.141', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.800', 'HITCOUNT': '3.160', 'weapon3': '3.306', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '58.500'} [2024-08-06 07:53:34,871][52803] DAMAGECOUNT value on done: 843915.0 [2024-08-06 07:53:34,874][52803] Sum rewards: 73.730, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.496', 'WEAPON3': '1.150', 'weapon3': '3.192', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '57.000'} [2024-08-06 07:53:35,595][52650] Updated weights for policy 0, policy_version 79971 (0.0021) [2024-08-06 07:53:35,908][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:53:36,293][52794] DAMAGECOUNT value on done: 921278.0 [2024-08-06 07:53:36,293][52794] Sum rewards: 85.772, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.645', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO3': '0.156', 'AMMO4': '0.227', 'weapon5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:36,594][52647] DAMAGECOUNT value on done: 950206.0 [2024-08-06 07:53:36,594][52647] Sum rewards: 77.811, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.560', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.074', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:36,661][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:53:36,752][52658] DAMAGECOUNT value on done: 926313.0 [2024-08-06 07:53:36,753][52658] Sum rewards: 79.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.682', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO4': '0.201', 'weapon2': '0.210', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.286', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:36,961][52669] DAMAGECOUNT value on done: 926923.0 [2024-08-06 07:53:36,963][52669] Sum rewards: 70.336, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.387', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.240', 'AMMO3': '0.280', 'WEAPON3': '1.650', 'HITCOUNT': '3.370', 'weapon3': '3.482', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:37,224][52671] DAMAGECOUNT value on done: 914913.0 [2024-08-06 07:53:37,224][52671] Sum rewards: 78.232, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.735', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.038', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.420', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '65.000'} [2024-08-06 07:53:37,407][52663] DAMAGECOUNT value on done: 915013.0 [2024-08-06 07:53:37,410][52663] Sum rewards: 76.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.078', 'weapon5': '0.202', 'AMMO3': '0.255', 'AMMO4': '0.262', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.114', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:37,667][52664] DAMAGECOUNT value on done: 950797.0 [2024-08-06 07:53:37,669][52664] Sum rewards: 80.705, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.080', 'weapon4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.392', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 655155200. Throughput: 0: 4377.4. Samples: 163792590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:37,794][52567] Avg episode reward: [(0, '75.444')] [2024-08-06 07:53:37,952][52803] DAMAGECOUNT value on done: 844171.0 [2024-08-06 07:53:37,952][52803] Sum rewards: 73.081, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.056', 'weapon4': '0.066', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.269', 'WEAPON3': '1.500', 'weapon3': '3.404', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '64.000'} [2024-08-06 07:53:39,074][52794] DAMAGECOUNT value on done: 909771.0 [2024-08-06 07:53:39,074][52794] Sum rewards: 81.637, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'AMMO3': '0.265', 'weapon2': '0.444', 'WEAPON3': '1.650', 'weapon3': '3.354', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '69.000'} [2024-08-06 07:53:39,140][52647] DAMAGECOUNT value on done: 952912.0 [2024-08-06 07:53:39,142][52647] Sum rewards: 76.831, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.170', 'AMMO4': '0.174', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'weapon4': '0.390', 'WEAPON3': '1.150', 'weapon3': '2.952', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:39,679][52671] DAMAGECOUNT value on done: 918501.0 [2024-08-06 07:53:39,679][52671] Sum rewards: 70.721, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.844', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'AMMO3': '0.189', 'weapon2': '0.246', 'WEAPON3': '1.150', 'HITCOUNT': '3.090', 'weapon3': '3.350', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '58.000'} [2024-08-06 07:53:39,818][52658] DAMAGECOUNT value on done: 913043.0 [2024-08-06 07:53:39,818][52658] Sum rewards: 65.835, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.076', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.129', 'AMMO3': '0.231', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.354', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '56.000'} [2024-08-06 07:53:39,880][52669] DAMAGECOUNT value on done: 917157.0 [2024-08-06 07:53:39,882][52669] Sum rewards: 90.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.471', 'FRAGCOUNT': '74.000'} [2024-08-06 07:53:40,016][52664] DAMAGECOUNT value on done: 939687.0 [2024-08-06 07:53:40,017][52664] Sum rewards: 65.728, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.178', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.128', 'weapon4': '0.140', 'AMMO4': '0.170', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '57.000'} [2024-08-06 07:53:40,184][52663] DAMAGECOUNT value on done: 915270.0 [2024-08-06 07:53:40,184][52663] Sum rewards: 80.522, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.102', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.110', 'AMMO4': '0.147', 'weapon2': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.366', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '70.000'} [2024-08-06 07:53:40,587][52650] Updated weights for policy 0, policy_version 79981 (0.0012) [2024-08-06 07:53:40,951][52803] DAMAGECOUNT value on done: 852661.0 [2024-08-06 07:53:40,959][52803] Sum rewards: 78.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.320', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.064', 'AMMO4': '0.128', 'AMMO3': '0.185', 'weapon5': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.100', 'weapon3': '3.258', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:42,081][52794] DAMAGECOUNT value on done: 903254.0 [2024-08-06 07:53:42,084][52794] Sum rewards: 78.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.390', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.026', 'weapon5': '0.076', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.268', 'weapon2': '0.608', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:42,429][52669] DAMAGECOUNT value on done: 924172.0 [2024-08-06 07:53:42,429][52669] Sum rewards: 74.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.450', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO4': '0.186', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 07:53:42,555][52671] DAMAGECOUNT value on done: 921792.0 [2024-08-06 07:53:42,555][52671] Sum rewards: 80.272, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'weapon4': '0.076', 'WEAPON4': '0.150', 'AMMO3': '0.260', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.336', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:42,767][52663] DAMAGECOUNT value on done: 921394.0 [2024-08-06 07:53:42,768][52663] Sum rewards: 69.397, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.095', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.162', 'weapon4': '0.174', 'AMMO3': '0.185', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '55.000'} [2024-08-06 07:53:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 655245312. Throughput: 0: 4377.8. Samples: 163818750. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:42,794][52567] Avg episode reward: [(0, '75.584')] [2024-08-06 07:53:42,839][52658] DAMAGECOUNT value on done: 923575.0 [2024-08-06 07:53:42,840][52658] Sum rewards: 80.115, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.228', 'AMMO3': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.540', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:42,967][52664] DAMAGECOUNT value on done: 954855.0 [2024-08-06 07:53:42,967][52664] Sum rewards: 79.528, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.338', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:43,592][52820] DAMAGECOUNT value on done: 842834.0 [2024-08-06 07:53:43,596][52820] Sum rewards: 59.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.173', 'AMMO5': '0.026', 'AMMO2': '0.056', 'AMMO3': '0.176', 'weapon5': '0.206', 'weapon4': '0.210', 'AMMO4': '0.279', 'weapon2': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '49.500'} [2024-08-06 07:53:43,990][52803] DAMAGECOUNT value on done: 846528.0 [2024-08-06 07:53:43,992][52803] Sum rewards: 95.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.112', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'WEAPON3': '1.500', 'weapon3': '3.442', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '22.341', 'FRAGCOUNT': '78.000'} [2024-08-06 07:53:44,946][52669] DAMAGECOUNT value on done: 924456.0 [2024-08-06 07:53:44,949][52669] Sum rewards: 76.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'AMMO5': '0.016', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.163', 'weapon5': '0.288', 'weapon2': '0.302', 'WEAPON4': '0.350', 'weapon4': '0.434', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.720', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '58.000'} [2024-08-06 07:53:44,990][52794] DAMAGECOUNT value on done: 910567.0 [2024-08-06 07:53:44,991][52794] Sum rewards: 83.888, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.915', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.054', 'weapon4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'AMMO4': '0.171', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:45,248][52650] Updated weights for policy 0, policy_version 79991 (0.0011) [2024-08-06 07:53:45,254][52671] DAMAGECOUNT value on done: 905534.0 [2024-08-06 07:53:45,255][52671] Sum rewards: 72.999, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO3': '0.190', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.760', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '59.000'} [2024-08-06 07:53:45,411][52663] DAMAGECOUNT value on done: 912265.0 [2024-08-06 07:53:45,411][52663] Sum rewards: 70.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.435', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.126', 'weapon5': '0.174', 'AMMO3': '0.242', 'AMMO4': '0.253', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '58.000'} [2024-08-06 07:53:45,889][52658] DAMAGECOUNT value on done: 911691.0 [2024-08-06 07:53:45,889][52658] Sum rewards: 76.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.556', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.256', 'WEAPON3': '1.350', 'HITCOUNT': '3.470', 'weapon3': '3.560', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:46,354][52664] DAMAGECOUNT value on done: 949644.0 [2024-08-06 07:53:46,354][52664] Sum rewards: 67.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.288', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.088', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '54.000'} [2024-08-06 07:53:46,697][52820] DAMAGECOUNT value on done: 845148.0 [2024-08-06 07:53:46,699][52820] Sum rewards: 75.711, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.014', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.124', 'AMMO4': '0.138', 'AMMO3': '0.152', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '59.500'} [2024-08-06 07:53:47,081][52803] DAMAGECOUNT value on done: 859688.0 [2024-08-06 07:53:47,082][52803] Sum rewards: 73.287, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.560', 'AMMO5': '0.011', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.106', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '64.000'} [2024-08-06 07:53:47,709][52794] DAMAGECOUNT value on done: 914313.0 [2024-08-06 07:53:47,712][52794] Sum rewards: 78.764, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.229', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.218', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:47,712][52671] DAMAGECOUNT value on done: 920028.0 [2024-08-06 07:53:47,715][52671] Sum rewards: 69.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.154', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.476', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '2.532', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '57.000'} [2024-08-06 07:53:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 655327232. Throughput: 0: 4374.3. Samples: 163831860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:47,794][52567] Avg episode reward: [(0, '75.867')] [2024-08-06 07:53:48,150][52669] DAMAGECOUNT value on done: 911473.0 [2024-08-06 07:53:48,151][52669] Sum rewards: 84.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.080', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.052', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '3.122', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:48,501][52663] DAMAGECOUNT value on done: 899208.0 [2024-08-06 07:53:48,501][52663] Sum rewards: 67.056, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon5': '0.066', 'weapon4': '0.152', 'AMMO4': '0.195', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '58.000'} [2024-08-06 07:53:48,949][52658] DAMAGECOUNT value on done: 919073.0 [2024-08-06 07:53:48,949][52658] Sum rewards: 73.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.432', 'AMMO5': '0.021', 'AMMO2': '0.057', 'AMMO3': '0.202', 'weapon2': '0.226', 'weapon5': '0.250', 'AMMO4': '0.286', 'weapon4': '0.338', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:49,550][52664] DAMAGECOUNT value on done: 938501.0 [2024-08-06 07:53:49,551][52664] Sum rewards: 73.367, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.194', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.072', 'weapon2': '0.216', 'weapon5': '0.226', 'AMMO4': '0.248', 'AMMO3': '0.333', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.142', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '66.000'} [2024-08-06 07:53:49,732][52650] Updated weights for policy 0, policy_version 80001 (0.0024) [2024-08-06 07:53:49,740][52820] DAMAGECOUNT value on done: 845686.0 [2024-08-06 07:53:49,741][52820] Sum rewards: 81.192, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.744', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon4': '0.070', 'weapon5': '0.168', 'AMMO3': '0.242', 'AMMO4': '0.309', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:50,201][52803] DAMAGECOUNT value on done: 853618.0 [2024-08-06 07:53:50,201][52803] Sum rewards: 72.106, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.245', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO4': '0.152', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.350', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '64.000'} [2024-08-06 07:53:50,512][52794] DAMAGECOUNT value on done: 902361.0 [2024-08-06 07:53:50,512][52794] Sum rewards: 83.313, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.072', 'weapon5': '0.114', 'AMMO4': '0.151', 'weapon2': '0.198', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.360', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.021', 'FRAGCOUNT': '70.000'} [2024-08-06 07:53:50,844][52671] DAMAGECOUNT value on done: 919176.0 [2024-08-06 07:53:50,844][52671] Sum rewards: 86.499, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.690', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.090', 'weapon4': '0.094', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'WEAPON3': '1.800', 'weapon3': '3.300', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.027', 'FRAGCOUNT': '74.000'} [2024-08-06 07:53:51,210][52669] DAMAGECOUNT value on done: 910710.0 [2024-08-06 07:53:51,213][52669] Sum rewards: 79.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.572', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.104', 'weapon5': '0.240', 'AMMO3': '0.244', 'weapon2': '0.248', 'AMMO4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '69.000'} [2024-08-06 07:53:51,616][52663] DAMAGECOUNT value on done: 910807.0 [2024-08-06 07:53:51,617][52663] Sum rewards: 74.617, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.068', 'weapon5': '0.164', 'AMMO3': '0.233', 'AMMO4': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.902', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:51,673][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:53:51,900][52658] DAMAGECOUNT value on done: 901991.0 [2024-08-06 07:53:51,901][52658] Sum rewards: 80.033, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.305', 'AMMO2': '0.012', 'AMMO4': '0.061', 'AMMO3': '0.206', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.454', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:52,485][52664] DAMAGECOUNT value on done: 939373.0 [2024-08-06 07:53:52,487][52664] Sum rewards: 72.446, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.074', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon5': '0.252', 'WEAPON5': '0.300', 'weapon4': '0.302', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '58.000'} [2024-08-06 07:53:52,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 655417344. Throughput: 0: 4378.4. Samples: 163858160. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 07:53:52,795][52567] Avg episode reward: [(0, '75.974')] [2024-08-06 07:53:52,806][52820] DAMAGECOUNT value on done: 834656.0 [2024-08-06 07:53:52,807][52820] Sum rewards: 84.623, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.265', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.092', 'weapon5': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'weapon2': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.342', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.550', 'FRAGCOUNT': '73.000'} [2024-08-06 07:53:53,024][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:53:53,266][52803] DAMAGECOUNT value on done: 845710.0 [2024-08-06 07:53:53,268][52803] Sum rewards: 88.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.426', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.748', 'FRAGCOUNT': '71.000'} [2024-08-06 07:53:53,412][52671] DAMAGECOUNT value on done: 915890.0 [2024-08-06 07:53:53,413][52671] Sum rewards: 85.981, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.504', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.160', 'weapon5': '0.210', 'AMMO4': '0.253', 'weapon2': '0.306', 'weapon4': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.796', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '67.000'} [2024-08-06 07:53:53,436][52794] DAMAGECOUNT value on done: 917103.0 [2024-08-06 07:53:53,436][52794] Sum rewards: 78.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.937', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.236', 'weapon5': '0.236', 'AMMO4': '0.244', 'weapon2': '0.248', 'AMMO3': '0.254', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.988', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '65.000'} [2024-08-06 07:53:54,345][52669] DAMAGECOUNT value on done: 917745.0 [2024-08-06 07:53:54,347][52669] Sum rewards: 79.297, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.259', 'weapon2': '0.428', 'WEAPON3': '1.600', 'weapon3': '3.320', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '68.000'} [2024-08-06 07:53:54,484][52650] Updated weights for policy 0, policy_version 80011 (0.0020) [2024-08-06 07:53:54,637][52663] DAMAGECOUNT value on done: 910538.0 [2024-08-06 07:53:54,638][52663] Sum rewards: 68.217, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.568', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.145', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.178', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '57.000'} [2024-08-06 07:53:54,720][52658] DAMAGECOUNT value on done: 919524.0 [2024-08-06 07:53:54,720][52658] Sum rewards: 68.270, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.274', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.109', 'weapon5': '0.122', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.124', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '56.500'} [2024-08-06 07:53:55,327][52664] DAMAGECOUNT value on done: 949427.0 [2024-08-06 07:53:55,327][52664] Sum rewards: 84.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.312', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.033', 'weapon5': '0.058', 'AMMO4': '0.165', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '69.000'} [2024-08-06 07:53:55,966][52820] DAMAGECOUNT value on done: 846667.0 [2024-08-06 07:53:55,967][52820] Sum rewards: 81.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.158', 'weapon5': '0.172', 'AMMO4': '0.209', 'weapon2': '0.220', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.178', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '70.000'} [2024-08-06 07:53:56,338][52803] DAMAGECOUNT value on done: 862069.0 [2024-08-06 07:53:56,338][52803] Sum rewards: 73.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.206', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.084', 'AMMO4': '0.176', 'weapon5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.210', 'weapon3': '3.228', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 07:53:56,457][52671] DAMAGECOUNT value on done: 920279.0 [2024-08-06 07:53:56,458][52671] Sum rewards: 65.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.670', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.162', 'AMMO4': '0.172', 'weapon5': '0.206', 'weapon2': '0.224', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.030', 'weapon3': '3.132', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '57.000'} [2024-08-06 07:53:56,610][52794] DAMAGECOUNT value on done: 909882.0 [2024-08-06 07:53:56,611][52794] Sum rewards: 92.873, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.640', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.104', 'AMMO4': '0.127', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON3': '1.650', 'weapon3': '3.328', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '22.695', 'FRAGCOUNT': '79.000'} [2024-08-06 07:53:57,149][52658] DAMAGECOUNT value on done: 911893.0 [2024-08-06 07:53:57,157][52658] Sum rewards: 74.693, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.625', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.042', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.272', 'weapon2': '0.348', 'WEAPON3': '1.750', 'weapon3': '3.254', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '65.000'} [2024-08-06 07:53:57,316][52669] DAMAGECOUNT value on done: 939583.0 [2024-08-06 07:53:57,317][52669] Sum rewards: 78.088, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO4': '0.081', 'AMMO3': '0.129', 'WEAPON5': '0.150', 'weapon5': '0.158', 'weapon2': '0.524', 'WEAPON3': '0.850', 'weapon3': '3.118', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '61.000'} [2024-08-06 07:53:57,642][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:53:57,780][52664] DAMAGECOUNT value on done: 947353.0 [2024-08-06 07:53:57,782][52664] Sum rewards: 85.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.485', 'AMMO5': '0.004', 'weapon5': '0.026', 'AMMO2': '0.039', 'WEAPON5': '0.100', 'AMMO4': '0.195', 'AMMO3': '0.212', 'weapon4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '70.000'} [2024-08-06 07:53:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 655507456. Throughput: 0: 4370.0. Samples: 163884300. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:53:57,794][52567] Avg episode reward: [(0, '76.716')] [2024-08-06 07:53:57,850][52663] DAMAGECOUNT value on done: 919822.0 [2024-08-06 07:53:57,851][52663] Sum rewards: 68.386, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.212', 'AMMO5': '0.015', 'AMMO2': '0.069', 'weapon5': '0.184', 'weapon4': '0.228', 'AMMO3': '0.236', 'AMMO4': '0.344', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '57.500'} [2024-08-06 07:53:59,090][52671] DAMAGECOUNT value on done: 917830.0 [2024-08-06 07:53:59,091][52671] Sum rewards: 70.550, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.284', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.298', 'WEAPON3': '1.550', 'weapon3': '3.378', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '62.000'} [2024-08-06 07:53:59,203][52650] Updated weights for policy 0, policy_version 80021 (0.0019) [2024-08-06 07:53:59,244][52820] DAMAGECOUNT value on done: 834393.0 [2024-08-06 07:53:59,248][52820] Sum rewards: 81.641, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.127', 'weapon5': '0.146', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.250', 'weapon2': '0.478', 'WEAPON3': '0.850', 'HEALTH': '0.936', 'weapon3': '2.900', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '63.000'} [2024-08-06 07:53:59,444][52803] DAMAGECOUNT value on done: 846568.0 [2024-08-06 07:53:59,448][52803] Sum rewards: 76.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.040', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.312', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.378', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '65.000'} [2024-08-06 07:53:59,877][52794] DAMAGECOUNT value on done: 903213.0 [2024-08-06 07:53:59,877][52794] Sum rewards: 80.935, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.904', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.202', 'weapon2': '0.206', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:00,114][52664] DAMAGECOUNT value on done: 955221.0 [2024-08-06 07:54:00,114][52664] Sum rewards: 75.085, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.680', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.064', 'AMMO4': '0.156', 'weapon5': '0.188', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.136', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '62.000'} [2024-08-06 07:54:00,192][52658] DAMAGECOUNT value on done: 907127.0 [2024-08-06 07:54:00,193][52658] Sum rewards: 53.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.325', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon5': '0.094', 'weapon4': '0.138', 'AMMO4': '0.195', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.250', 'HITCOUNT': '2.510', 'weapon3': '3.164', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '46.000'} [2024-08-06 07:54:00,498][52669] DAMAGECOUNT value on done: 926230.0 [2024-08-06 07:54:00,499][52669] Sum rewards: 70.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.000', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.068', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.242', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.520', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '57.000'} [2024-08-06 07:54:01,118][52663] DAMAGECOUNT value on done: 902029.0 [2024-08-06 07:54:01,119][52663] Sum rewards: 60.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.078', 'weapon5': '0.106', 'AMMO4': '0.158', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.592', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '51.000'} [2024-08-06 07:54:02,074][52671] DAMAGECOUNT value on done: 903794.0 [2024-08-06 07:54:02,076][52671] Sum rewards: 70.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.383', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO4': '0.141', 'weapon5': '0.170', 'AMMO3': '0.207', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.812', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '59.000'} [2024-08-06 07:54:02,395][52820] DAMAGECOUNT value on done: 840671.0 [2024-08-06 07:54:02,405][52820] Sum rewards: 70.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:02,565][52794] DAMAGECOUNT value on done: 916788.0 [2024-08-06 07:54:02,566][52794] Sum rewards: 76.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.736', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.088', 'weapon5': '0.088', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '3.170', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:02,599][52803] DAMAGECOUNT value on done: 853884.0 [2024-08-06 07:54:02,600][52803] Sum rewards: 70.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.252', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.107', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon5': '0.262', 'weapon2': '0.372', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.706', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:02,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 655589376. Throughput: 0: 4371.8. Samples: 163897630. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:02,794][52567] Avg episode reward: [(0, '76.073')] [2024-08-06 07:54:03,175][52664] DAMAGECOUNT value on done: 952987.0 [2024-08-06 07:54:03,176][52664] Sum rewards: 80.131, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.090', 'weapon5': '0.132', 'AMMO3': '0.161', 'AMMO4': '0.242', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '3.250', 'weapon3': '3.304', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:03,179][52658] DAMAGECOUNT value on done: 917425.0 [2024-08-06 07:54:03,181][52658] Sum rewards: 71.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.148', 'weapon4': '0.170', 'AMMO4': '0.176', 'AMMO3': '0.189', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '57.000'} [2024-08-06 07:54:03,266][52669] DAMAGECOUNT value on done: 921540.0 [2024-08-06 07:54:03,267][52669] Sum rewards: 74.127, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.134', 'AMMO3': '0.155', 'AMMO4': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.000', 'weapon3': '3.100', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:03,603][52658] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:54:03,723][52795] DAMAGECOUNT value on done: 843987.0 [2024-08-06 07:54:03,723][52795] Sum rewards: 65.078, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.980', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.090', 'weapon5': '0.206', 'weapon2': '0.256', 'AMMO4': '0.271', 'AMMO3': '0.309', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.900', 'weapon3': '3.132', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:03,798][52663] DAMAGECOUNT value on done: 899108.0 [2024-08-06 07:54:03,798][52663] Sum rewards: 69.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.704', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.101', 'weapon5': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.058', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:03,800][52650] Updated weights for policy 0, policy_version 80031 (0.0012) [2024-08-06 07:54:05,219][52794] DAMAGECOUNT value on done: 911714.0 [2024-08-06 07:54:05,221][52794] Sum rewards: 97.781, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.044', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon4': '0.168', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.180', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '22.872', 'FRAGCOUNT': '77.000'} [2024-08-06 07:54:05,482][52671] DAMAGECOUNT value on done: 927485.0 [2024-08-06 07:54:05,482][52671] Sum rewards: 55.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.521', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.142', 'weapon5': '0.166', 'weapon4': '0.198', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.450', 'HITCOUNT': '2.880', 'weapon3': '2.970', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '48.500'} [2024-08-06 07:54:05,503][52820] DAMAGECOUNT value on done: 844097.0 [2024-08-06 07:54:05,505][52820] Sum rewards: 71.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.354', 'AMMO5': '0.011', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.248', 'AMMO3': '0.253', 'weapon4': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.130', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '62.000'} [2024-08-06 07:54:05,765][52669] DAMAGECOUNT value on done: 928059.0 [2024-08-06 07:54:05,776][52669] Sum rewards: 72.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.162', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon2': '0.146', 'weapon5': '0.152', 'AMMO3': '0.190', 'AMMO4': '0.199', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.020', 'weapon3': '3.440', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:05,816][52664] DAMAGECOUNT value on done: 951465.0 [2024-08-06 07:54:05,816][52664] Sum rewards: 74.671, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.520', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'weapon5': '0.084', 'WEAPON4': '0.150', 'weapon2': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.297', 'WEAPON3': '1.800', 'HITCOUNT': '3.350', 'weapon3': '3.504', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '66.000'} [2024-08-06 07:54:05,945][52803] DAMAGECOUNT value on done: 856400.0 [2024-08-06 07:54:05,945][52803] Sum rewards: 78.844, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.600', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.122', 'weapon5': '0.232', 'AMMO3': '0.256', 'AMMO4': '0.282', 'weapon2': '0.518', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.774', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:06,413][52663] DAMAGECOUNT value on done: 908111.0 [2024-08-06 07:54:06,413][52663] Sum rewards: 75.108, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.273', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.098', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'weapon4': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:06,948][52795] DAMAGECOUNT value on done: 832102.0 [2024-08-06 07:54:06,948][52795] Sum rewards: 62.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.214', 'weapon4': '0.236', 'AMMO4': '0.253', 'AMMO3': '0.266', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.362', 'FRAGCOUNT': '53.000'} [2024-08-06 07:54:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 655679488. Throughput: 0: 4373.6. Samples: 163923760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:07,794][52567] Avg episode reward: [(0, '75.784')] [2024-08-06 07:54:08,013][52794] DAMAGECOUNT value on done: 922732.0 [2024-08-06 07:54:08,013][52794] Sum rewards: 66.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.425', 'AMMO5': '0.007', 'weapon4': '0.026', 'AMMO2': '0.026', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.241', 'weapon2': '0.598', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '56.000'} [2024-08-06 07:54:08,070][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:54:08,248][52671] DAMAGECOUNT value on done: 926782.0 [2024-08-06 07:54:08,248][52671] Sum rewards: 74.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.070', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.070', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.188', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '58.500'} [2024-08-06 07:54:08,593][52650] Updated weights for policy 0, policy_version 80041 (0.0040) [2024-08-06 07:54:08,742][52820] DAMAGECOUNT value on done: 849161.0 [2024-08-06 07:54:08,745][52820] Sum rewards: 70.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.084', 'weapon5': '0.180', 'AMMO3': '0.182', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '57.500'} [2024-08-06 07:54:08,775][52669] DAMAGECOUNT value on done: 928492.0 [2024-08-06 07:54:08,777][52669] Sum rewards: 77.945, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.495', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.102', 'AMMO4': '0.155', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:08,777][52663] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:54:08,828][52803] DAMAGECOUNT value on done: 861981.0 [2024-08-06 07:54:08,830][52803] Sum rewards: 87.068, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'weapon5': '0.016', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '70.000'} [2024-08-06 07:54:09,002][52664] DAMAGECOUNT value on done: 964207.0 [2024-08-06 07:54:09,003][52664] Sum rewards: 83.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.862', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.104', 'weapon4': '0.116', 'AMMO4': '0.176', 'weapon2': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.344', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '70.000'} [2024-08-06 07:54:09,271][52663] DAMAGECOUNT value on done: 911091.0 [2024-08-06 07:54:09,275][52663] Sum rewards: 82.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.757', 'AMMO5': '0.004', 'AMMO2': '0.037', 'weapon5': '0.038', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '68.000'} [2024-08-06 07:54:09,571][52794] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:54:09,648][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:54:09,920][52795] DAMAGECOUNT value on done: 838073.0 [2024-08-06 07:54:09,924][52795] Sum rewards: 75.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon2': '0.130', 'AMMO3': '0.213', 'WEAPON3': '1.300', 'HITCOUNT': '3.540', 'weapon3': '3.788', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '62.000'} [2024-08-06 07:54:10,680][52670] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 07:54:10,704][52794] DAMAGECOUNT value on done: 905123.0 [2024-08-06 07:54:10,705][52794] Sum rewards: 81.727, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.124', 'weapon5': '0.158', 'weapon2': '0.166', 'AMMO3': '0.223', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '68.000'} [2024-08-06 07:54:11,047][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:54:11,270][52664] DAMAGECOUNT value on done: 959937.0 [2024-08-06 07:54:11,270][52664] Sum rewards: 72.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.072', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.074', 'AMMO4': '0.124', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon4': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:11,404][52671] DAMAGECOUNT value on done: 919456.0 [2024-08-06 07:54:11,408][52671] Sum rewards: 72.773, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.250', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.107', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.086', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 07:54:11,921][52820] DAMAGECOUNT value on done: 856298.0 [2024-08-06 07:54:11,923][52820] Sum rewards: 80.134, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.099', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.066', 'weapon4': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.188', 'AMMO3': '0.190', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.462', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '65.500'} [2024-08-06 07:54:11,965][52803] DAMAGECOUNT value on done: 860114.0 [2024-08-06 07:54:11,965][52803] Sum rewards: 85.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.728', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.084', 'weapon4': '0.096', 'weapon2': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON3': '1.550', 'weapon3': '3.508', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '72.000'} [2024-08-06 07:54:12,448][52663] DAMAGECOUNT value on done: 915028.0 [2024-08-06 07:54:12,449][52663] Sum rewards: 70.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.350', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.144', 'weapon4': '0.156', 'AMMO4': '0.173', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 655769600. Throughput: 0: 4384.9. Samples: 163950410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:12,794][52567] Avg episode reward: [(0, '75.822')] [2024-08-06 07:54:13,007][52650] Updated weights for policy 0, policy_version 80051 (0.0011) [2024-08-06 07:54:13,119][52795] DAMAGECOUNT value on done: 850276.0 [2024-08-06 07:54:13,121][52795] Sum rewards: 66.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.461', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.110', 'AMMO4': '0.120', 'weapon2': '0.122', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.000', 'weapon3': '3.046', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '55.000'} [2024-08-06 07:54:13,695][52794] DAMAGECOUNT value on done: 917841.0 [2024-08-06 07:54:13,695][52794] Sum rewards: 68.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.048', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.010', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.212', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.270', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '57.000'} [2024-08-06 07:54:13,795][52664] DAMAGECOUNT value on done: 958076.0 [2024-08-06 07:54:13,796][52664] Sum rewards: 77.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.700', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.138', 'AMMO4': '0.160', 'weapon4': '0.216', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:14,132][52670] DAMAGECOUNT value on done: 898947.0 [2024-08-06 07:54:14,136][52670] Sum rewards: 67.102, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.432', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.134', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.230', 'DAMAGECOUNT': '16.233', 'FRAGCOUNT': '54.000'} [2024-08-06 07:54:14,502][52671] DAMAGECOUNT value on done: 927662.0 [2024-08-06 07:54:14,502][52671] Sum rewards: 78.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.182', 'AMMO4': '0.200', 'AMMO3': '0.205', 'weapon2': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.312', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:15,008][52820] DAMAGECOUNT value on done: 840086.0 [2024-08-06 07:54:15,011][52820] Sum rewards: 82.706, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.904', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.070', 'weapon5': '0.124', 'AMMO4': '0.132', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.132', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:15,063][52803] DAMAGECOUNT value on done: 855901.0 [2024-08-06 07:54:15,068][52803] Sum rewards: 73.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.138', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.048', 'weapon4': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:15,318][52663] DAMAGECOUNT value on done: 912580.0 [2024-08-06 07:54:15,318][52663] Sum rewards: 78.375, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.379', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.180', 'AMMO4': '0.198', 'weapon4': '0.198', 'AMMO3': '0.226', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:16,209][52795] DAMAGECOUNT value on done: 835981.0 [2024-08-06 07:54:16,210][52795] Sum rewards: 83.799, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.731', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.166', 'weapon2': '0.172', 'AMMO3': '0.183', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:16,493][52664] DAMAGECOUNT value on done: 942556.0 [2024-08-06 07:54:16,493][52664] Sum rewards: 72.992, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.106', 'weapon5': '0.132', 'AMMO4': '0.134', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.299', 'weapon2': '0.348', 'WEAPON3': '1.750', 'weapon3': '3.110', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:16,635][52794] DAMAGECOUNT value on done: 915424.0 [2024-08-06 07:54:16,635][52794] Sum rewards: 61.277, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon5': '0.214', 'weapon4': '0.226', 'AMMO3': '0.240', 'AMMO4': '0.285', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '52.500'} [2024-08-06 07:54:17,077][52670] DAMAGECOUNT value on done: 916755.0 [2024-08-06 07:54:17,077][52670] Sum rewards: 76.702, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.424', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.185', 'weapon4': '0.210', 'AMMO4': '0.231', 'weapon5': '0.270', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.916', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:17,303][52671] DAMAGECOUNT value on done: 907777.0 [2024-08-06 07:54:17,303][52671] Sum rewards: 75.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.302', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.128', 'weapon4': '0.160', 'AMMO3': '0.173', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 655851520. Throughput: 0: 4386.0. Samples: 163963590. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:17,794][52567] Avg episode reward: [(0, '75.579')] [2024-08-06 07:54:17,905][52650] Updated weights for policy 0, policy_version 80061 (0.0012) [2024-08-06 07:54:18,080][52820] DAMAGECOUNT value on done: 848846.0 [2024-08-06 07:54:18,080][52820] Sum rewards: 64.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.005', 'AMMO5': '0.004', 'AMMO2': '0.032', 'weapon5': '0.038', 'weapon4': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.188', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '52.000'} [2024-08-06 07:54:18,398][52663] DAMAGECOUNT value on done: 916927.0 [2024-08-06 07:54:18,398][52663] Sum rewards: 83.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.118', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO3': '0.210', 'AMMO4': '0.210', 'weapon4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:19,043][52664] DAMAGECOUNT value on done: 944892.0 [2024-08-06 07:54:19,043][52664] Sum rewards: 71.301, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.875', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon4': '0.294', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:19,306][52795] DAMAGECOUNT value on done: 840805.0 [2024-08-06 07:54:19,308][52795] Sum rewards: 71.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.144', 'weapon2': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.330', 'weapon3': '3.464', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:19,461][52794] DAMAGECOUNT value on done: 918693.0 [2024-08-06 07:54:19,461][52794] Sum rewards: 75.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.941', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.092', 'AMMO3': '0.172', 'AMMO4': '0.178', 'weapon5': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:20,153][52670] DAMAGECOUNT value on done: 900969.0 [2024-08-06 07:54:20,168][52670] Sum rewards: 67.344, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.632', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.110', 'weapon5': '0.136', 'AMMO4': '0.145', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '53.000'} [2024-08-06 07:54:21,293][52666] DAMAGECOUNT value on done: 911664.0 [2024-08-06 07:54:21,295][52666] Sum rewards: 58.633, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.875', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.018', 'weapon4': '0.028', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.109', 'weapon2': '0.638', 'WEAPON3': '0.750', 'HITCOUNT': '2.670', 'weapon3': '3.226', 'DAMAGECOUNT': '13.410', 'FRAGCOUNT': '46.000'} [2024-08-06 07:54:21,303][52820] DAMAGECOUNT value on done: 861016.0 [2024-08-06 07:54:21,305][52820] Sum rewards: 76.712, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.129', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon5': '0.062', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.272', 'WEAPON3': '0.950', 'weapon3': '3.516', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:21,526][52663] DAMAGECOUNT value on done: 922437.0 [2024-08-06 07:54:21,527][52663] Sum rewards: 66.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.110', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.196', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon5': '0.270', 'weapon4': '0.300', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '54.500'} [2024-08-06 07:54:21,605][52664] DAMAGECOUNT value on done: 952808.0 [2024-08-06 07:54:21,606][52664] Sum rewards: 86.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.270', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.188', 'weapon4': '0.220', 'AMMO3': '0.222', 'AMMO4': '0.222', 'weapon2': '0.318', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.988', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '71.000'} [2024-08-06 07:54:21,666][52665] DAMAGECOUNT value on done: 902926.0 [2024-08-06 07:54:21,666][52665] Sum rewards: 96.024, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.018', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.137', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '22.401', 'FRAGCOUNT': '78.000'} [2024-08-06 07:54:22,505][52795] DAMAGECOUNT value on done: 850760.0 [2024-08-06 07:54:22,505][52795] Sum rewards: 67.881, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.002', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.090', 'AMMO4': '0.222', 'AMMO3': '0.224', 'weapon5': '0.256', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '56.500'} [2024-08-06 07:54:22,639][52794] DAMAGECOUNT value on done: 927893.0 [2024-08-06 07:54:22,640][52794] Sum rewards: 75.536, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.895', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.189', 'AMMO4': '0.204', 'weapon5': '0.206', 'weapon2': '0.256', 'weapon4': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:22,701][52650] Updated weights for policy 0, policy_version 80071 (0.0013) [2024-08-06 07:54:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 655941632. Throughput: 0: 4378.9. Samples: 163989640. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:22,794][52567] Avg episode reward: [(0, '75.102')] [2024-08-06 07:54:23,111][52670] DAMAGECOUNT value on done: 903090.0 [2024-08-06 07:54:23,112][52670] Sum rewards: 73.103, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.132', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.044', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:23,370][52649] DAMAGECOUNT value on done: 885733.0 [2024-08-06 07:54:23,370][52649] Sum rewards: 78.682, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.493', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.099', 'weapon5': '0.128', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.315', 'WEAPON3': '1.800', 'weapon3': '3.316', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '68.000'} [2024-08-06 07:54:24,029][52663] DAMAGECOUNT value on done: 904235.0 [2024-08-06 07:54:24,029][52663] Sum rewards: 60.603, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.094', 'AMMO3': '0.170', 'weapon5': '0.190', 'weapon2': '0.240', 'AMMO4': '0.246', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'HITCOUNT': '2.540', 'weapon3': '3.250', 'DAMAGECOUNT': '14.634', 'FRAGCOUNT': '50.500'} [2024-08-06 07:54:24,324][52666] DAMAGECOUNT value on done: 909192.0 [2024-08-06 07:54:24,326][52666] Sum rewards: 73.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:24,338][52664] DAMAGECOUNT value on done: 942648.0 [2024-08-06 07:54:24,338][52664] Sum rewards: 77.776, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.674', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.132', 'weapon4': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '66.000'} [2024-08-06 07:54:24,561][52820] DAMAGECOUNT value on done: 850638.0 [2024-08-06 07:54:24,561][52820] Sum rewards: 81.375, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '0.012', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.112', 'AMMO4': '0.170', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '68.000'} [2024-08-06 07:54:24,756][52665] DAMAGECOUNT value on done: 913505.0 [2024-08-06 07:54:24,757][52665] Sum rewards: 59.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.344', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.140', 'weapon2': '0.168', 'AMMO3': '0.185', 'weapon5': '0.196', 'AMMO4': '0.208', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.282', 'DAMAGECOUNT': '15.171', 'FRAGCOUNT': '49.500'} [2024-08-06 07:54:25,548][52670] DAMAGECOUNT value on done: 915275.0 [2024-08-06 07:54:25,550][52670] Sum rewards: 68.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.846', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.194', 'AMMO3': '0.223', 'AMMO4': '0.245', 'weapon4': '0.266', 'weapon2': '0.364', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:25,739][52795] DAMAGECOUNT value on done: 842073.0 [2024-08-06 07:54:25,741][52795] Sum rewards: 80.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.263', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.140', 'weapon4': '0.162', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '64.500'} [2024-08-06 07:54:25,767][52794] DAMAGECOUNT value on done: 918089.0 [2024-08-06 07:54:25,769][52794] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.088', 'weapon5': '0.202', 'AMMO3': '0.275', 'AMMO4': '0.299', 'weapon2': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.000', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:26,473][52649] DAMAGECOUNT value on done: 882056.0 [2024-08-06 07:54:26,477][52649] Sum rewards: 76.517, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.448', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.206', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:26,933][52650] Updated weights for policy 0, policy_version 80081 (0.0020) [2024-08-06 07:54:26,968][52666] DAMAGECOUNT value on done: 916655.0 [2024-08-06 07:54:26,972][52666] Sum rewards: 70.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.017', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.138', 'AMMO4': '0.161', 'weapon5': '0.174', 'AMMO3': '0.178', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.154', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '57.000'} [2024-08-06 07:54:27,646][52820] DAMAGECOUNT value on done: 850837.0 [2024-08-06 07:54:27,646][52820] Sum rewards: 67.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.148', 'weapon4': '0.160', 'AMMO4': '0.177', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.992', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '56.000'} [2024-08-06 07:54:27,738][52665] DAMAGECOUNT value on done: 905275.0 [2024-08-06 07:54:27,739][52665] Sum rewards: 80.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.048', 'weapon2': '0.154', 'AMMO3': '0.203', 'AMMO4': '0.214', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '66.000'} [2024-08-06 07:54:27,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 656031744. Throughput: 0: 4377.6. Samples: 164015740. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:27,794][52567] Avg episode reward: [(0, '74.881')] [2024-08-06 07:54:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080082_656031744.pth... [2024-08-06 07:54:27,919][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079570_651837440.pth [2024-08-06 07:54:28,819][52670] DAMAGECOUNT value on done: 904854.0 [2024-08-06 07:54:28,821][52670] Sum rewards: 80.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.820', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.110', 'weapon5': '0.126', 'AMMO4': '0.182', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:29,016][52795] DAMAGECOUNT value on done: 846075.0 [2024-08-06 07:54:29,018][52795] Sum rewards: 66.976, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.388', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.098', 'weapon4': '0.112', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.540', 'WEAPON3': '1.000', 'weapon3': '3.084', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '53.000'} [2024-08-06 07:54:29,699][52649] DAMAGECOUNT value on done: 896849.0 [2024-08-06 07:54:29,701][52649] Sum rewards: 73.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON5': '0.100', 'weapon4': '0.148', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '3.240', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '57.000'} [2024-08-06 07:54:30,180][52666] DAMAGECOUNT value on done: 909698.0 [2024-08-06 07:54:30,180][52666] Sum rewards: 68.655, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.568', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO4': '0.202', 'weapon2': '0.252', 'AMMO3': '0.285', 'weapon5': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.990', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '59.000'} [2024-08-06 07:54:30,832][52820] DAMAGECOUNT value on done: 846375.0 [2024-08-06 07:54:30,833][52820] Sum rewards: 87.968, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.086', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '71.000'} [2024-08-06 07:54:30,880][52665] DAMAGECOUNT value on done: 908452.0 [2024-08-06 07:54:30,881][52665] Sum rewards: 80.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.096', 'weapon5': '0.176', 'AMMO3': '0.198', 'AMMO4': '0.289', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:31,436][52670] DAMAGECOUNT value on done: 898699.0 [2024-08-06 07:54:31,437][52670] Sum rewards: 76.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.132', 'AMMO4': '0.146', 'AMMO3': '0.181', 'WEAPON5': '0.350', 'weapon2': '0.424', 'weapon4': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.752', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '63.000'} [2024-08-06 07:54:32,069][52650] Updated weights for policy 0, policy_version 80091 (0.0011) [2024-08-06 07:54:32,113][52795] DAMAGECOUNT value on done: 851154.0 [2024-08-06 07:54:32,114][52795] Sum rewards: 86.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.074', 'AMMO4': '0.103', 'weapon4': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.021', 'FRAGCOUNT': '71.000'} [2024-08-06 07:54:32,793][52666] DAMAGECOUNT value on done: 904983.0 [2024-08-06 07:54:32,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 656121856. Throughput: 0: 4374.6. Samples: 164028720. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:32,795][52567] Avg episode reward: [(0, '74.565')] [2024-08-06 07:54:32,797][52666] Sum rewards: 84.455, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '68.000'} [2024-08-06 07:54:32,882][52649] DAMAGECOUNT value on done: 894848.0 [2024-08-06 07:54:32,884][52649] Sum rewards: 81.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.795', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.080', 'AMMO4': '0.162', 'weapon5': '0.176', 'AMMO3': '0.179', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '66.000'} [2024-08-06 07:54:33,916][52820] DAMAGECOUNT value on done: 850063.0 [2024-08-06 07:54:33,919][52820] Sum rewards: 88.277, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.116', 'weapon5': '0.166', 'AMMO3': '0.214', 'AMMO4': '0.232', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '72.000'} [2024-08-06 07:54:34,082][52665] DAMAGECOUNT value on done: 890107.0 [2024-08-06 07:54:34,082][52665] Sum rewards: 68.457, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.989', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.139', 'AMMO3': '0.179', 'weapon5': '0.198', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '56.000'} [2024-08-06 07:54:34,475][52670] DAMAGECOUNT value on done: 901326.0 [2024-08-06 07:54:34,478][52670] Sum rewards: 45.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.180', 'AMMO3': '0.197', 'weapon4': '0.214', 'AMMO4': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.608', 'WEAPON3': '1.200', 'HITCOUNT': '2.660', 'weapon3': '2.698', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '39.000'} [2024-08-06 07:54:35,266][52795] DAMAGECOUNT value on done: 845506.0 [2024-08-06 07:54:35,266][52795] Sum rewards: 66.449, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.856', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.160', 'AMMO3': '0.171', 'AMMO4': '0.177', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.070', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '53.000'} [2024-08-06 07:54:35,921][52649] DAMAGECOUNT value on done: 887378.0 [2024-08-06 07:54:35,923][52649] Sum rewards: 73.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.387', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.122', 'weapon2': '0.210', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '63.000'} [2024-08-06 07:54:35,983][52666] DAMAGECOUNT value on done: 909305.0 [2024-08-06 07:54:35,984][52666] Sum rewards: 66.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.619', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.114', 'weapon5': '0.142', 'AMMO4': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '56.000'} [2024-08-06 07:54:36,552][52650] Updated weights for policy 0, policy_version 80101 (0.0027) [2024-08-06 07:54:36,934][52820] DAMAGECOUNT value on done: 857651.0 [2024-08-06 07:54:36,934][52820] Sum rewards: 68.155, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.150', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.092', 'AMMO4': '0.108', 'WEAPON5': '0.200', 'weapon2': '0.202', 'WEAPON4': '0.250', 'weapon4': '0.326', 'AMMO3': '0.330', 'WEAPON3': '1.900', 'weapon3': '3.088', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:37,054][52665] DAMAGECOUNT value on done: 893825.0 [2024-08-06 07:54:37,054][52665] Sum rewards: 68.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.556', 'AMMO5': '0.013', 'AMMO2': '0.058', 'weapon5': '0.158', 'AMMO3': '0.216', 'AMMO4': '0.291', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.402', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '57.000'} [2024-08-06 07:54:37,441][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:54:37,785][52670] DAMAGECOUNT value on done: 903633.0 [2024-08-06 07:54:37,787][52670] Sum rewards: 83.779, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.030', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.182', 'weapon2': '0.276', 'WEAPON4': '0.350', 'weapon4': '0.428', 'WEAPON3': '1.050', 'weapon3': '2.946', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 656203776. Throughput: 0: 4375.6. Samples: 164055060. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:37,794][52567] Avg episode reward: [(0, '74.003')] [2024-08-06 07:54:38,414][52795] DAMAGECOUNT value on done: 836242.0 [2024-08-06 07:54:38,415][52795] Sum rewards: 77.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.539', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.122', 'weapon5': '0.164', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:38,987][52649] DAMAGECOUNT value on done: 896015.0 [2024-08-06 07:54:38,990][52649] Sum rewards: 78.441, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.682', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.194', 'weapon2': '0.200', 'weapon5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:39,458][52666] DAMAGECOUNT value on done: 906504.0 [2024-08-06 07:54:39,459][52666] Sum rewards: 88.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.304', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.048', 'AMMO4': '0.089', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.153', 'FRAGCOUNT': '71.000'} [2024-08-06 07:54:40,117][52665] DAMAGECOUNT value on done: 903046.0 [2024-08-06 07:54:40,117][52665] Sum rewards: 73.809, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.711', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.158', 'AMMO4': '0.176', 'AMMO3': '0.185', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.316', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:40,132][52820] DAMAGECOUNT value on done: 856016.0 [2024-08-06 07:54:40,133][52820] Sum rewards: 69.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.255', 'weapon2': '0.520', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '59.000'} [2024-08-06 07:54:40,854][52670] DAMAGECOUNT value on done: 899340.0 [2024-08-06 07:54:40,854][52670] Sum rewards: 62.661, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.052', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.108', 'AMMO3': '0.208', 'AMMO4': '0.220', 'weapon2': '0.242', 'weapon5': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.740', 'weapon3': '3.066', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '51.500'} [2024-08-06 07:54:41,309][52650] Updated weights for policy 0, policy_version 80111 (0.0024) [2024-08-06 07:54:41,706][52795] DAMAGECOUNT value on done: 845017.0 [2024-08-06 07:54:41,709][52795] Sum rewards: 91.170, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.082', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '75.000'} [2024-08-06 07:54:42,030][52649] DAMAGECOUNT value on done: 892372.0 [2024-08-06 07:54:42,032][52649] Sum rewards: 79.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.830', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.134', 'weapon5': '0.154', 'AMMO4': '0.207', 'AMMO3': '0.211', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:42,233][52666] DAMAGECOUNT value on done: 903839.0 [2024-08-06 07:54:42,234][52666] Sum rewards: 60.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.616', 'AMMO5': '0.021', 'AMMO2': '0.035', 'weapon4': '0.072', 'AMMO4': '0.176', 'weapon5': '0.236', 'AMMO3': '0.238', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.960', 'weapon3': '3.156', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '51.500'} [2024-08-06 07:54:42,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 656293888. Throughput: 0: 4380.2. Samples: 164081410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 07:54:42,794][52567] Avg episode reward: [(0, '74.229')] [2024-08-06 07:54:43,236][52665] DAMAGECOUNT value on done: 904104.0 [2024-08-06 07:54:43,236][52665] Sum rewards: 80.045, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.764', 'AMMO4': '-0.021', 'AMMO2': '-0.004', 'AMMO5': '0.005', 'AMMO3': '0.185', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.372', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:43,308][52820] DAMAGECOUNT value on done: 842536.0 [2024-08-06 07:54:43,308][52820] Sum rewards: 77.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.129', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.106', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '65.000'} [2024-08-06 07:54:43,522][52670] DAMAGECOUNT value on done: 912737.0 [2024-08-06 07:54:43,523][52670] Sum rewards: 72.457, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.078', 'weapon5': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.676', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:44,816][52795] DAMAGECOUNT value on done: 849693.0 [2024-08-06 07:54:44,818][52795] Sum rewards: 72.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.435', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.216', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.000'} [2024-08-06 07:54:44,978][52666] DAMAGECOUNT value on done: 913282.0 [2024-08-06 07:54:44,980][52666] Sum rewards: 81.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.180', 'AMMO4': '0.207', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:45,235][52649] DAMAGECOUNT value on done: 895589.0 [2024-08-06 07:54:45,235][52649] Sum rewards: 74.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.985', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.176', 'weapon4': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.114', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:45,958][52650] Updated weights for policy 0, policy_version 80121 (0.0011) [2024-08-06 07:54:45,968][52668] DAMAGECOUNT value on done: 921777.0 [2024-08-06 07:54:45,968][52668] Sum rewards: 78.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.511', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.142', 'AMMO3': '0.152', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.378', 'WEAPON3': '0.950', 'weapon3': '3.208', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '61.000'} [2024-08-06 07:54:46,021][52665] DAMAGECOUNT value on done: 909110.0 [2024-08-06 07:54:46,021][52665] Sum rewards: 77.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.173', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'weapon2': '0.254', 'AMMO3': '0.275', 'WEAPON3': '1.450', 'weapon3': '3.480', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:46,685][52670] DAMAGECOUNT value on done: 896064.0 [2024-08-06 07:54:46,686][52670] Sum rewards: 87.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.865', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon4': '0.272', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '72.000'} [2024-08-06 07:54:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 656384000. Throughput: 0: 4373.6. Samples: 164094440. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:54:47,794][52567] Avg episode reward: [(0, '74.850')] [2024-08-06 07:54:47,916][52649] DAMAGECOUNT value on done: 891498.0 [2024-08-06 07:54:47,916][52795] DAMAGECOUNT value on done: 838227.0 [2024-08-06 07:54:47,917][52649] Sum rewards: 75.610, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.542', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.249', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:47,919][52795] Sum rewards: 67.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.557', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon5': '0.060', 'weapon4': '0.140', 'AMMO4': '0.201', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.254', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '59.000'} [2024-08-06 07:54:48,216][52666] DAMAGECOUNT value on done: 906604.0 [2024-08-06 07:54:48,217][52666] Sum rewards: 80.954, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.104', 'weapon5': '0.152', 'AMMO4': '0.192', 'weapon2': '0.228', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'ARMOR': '0.485', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:48,568][52668] DAMAGECOUNT value on done: 922336.0 [2024-08-06 07:54:48,568][52668] Sum rewards: 76.581, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.410', 'AMMO5': '0.014', 'AMMO2': '0.058', 'AMMO3': '0.141', 'weapon4': '0.224', 'weapon5': '0.234', 'AMMO4': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.496', 'WEAPON3': '0.850', 'weapon3': '2.794', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '59.000'} [2024-08-06 07:54:48,872][52665] DAMAGECOUNT value on done: 901061.0 [2024-08-06 07:54:48,872][52665] Sum rewards: 74.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.766', 'AMMO2': '0.004', 'AMMO4': '0.022', 'AMMO3': '0.160', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.478', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:49,985][52670] DAMAGECOUNT value on done: 911772.0 [2024-08-06 07:54:49,989][52670] Sum rewards: 76.787, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon5': '0.126', 'AMMO4': '0.187', 'AMMO3': '0.211', 'weapon4': '0.316', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:50,530][52650] Updated weights for policy 0, policy_version 80131 (0.0026) [2024-08-06 07:54:50,857][52649] DAMAGECOUNT value on done: 886895.0 [2024-08-06 07:54:50,857][52649] Sum rewards: 77.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.899', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '63.000'} [2024-08-06 07:54:51,043][52795] DAMAGECOUNT value on done: 846459.0 [2024-08-06 07:54:51,043][52795] Sum rewards: 64.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.497', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.090', 'weapon4': '0.128', 'AMMO3': '0.189', 'AMMO4': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.591', 'FRAGCOUNT': '54.000'} [2024-08-06 07:54:51,311][52666] DAMAGECOUNT value on done: 911439.0 [2024-08-06 07:54:51,314][52666] Sum rewards: 76.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.284', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.044', 'AMMO4': '0.061', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.382', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:51,426][52668] DAMAGECOUNT value on done: 919209.0 [2024-08-06 07:54:51,426][52668] Sum rewards: 82.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.068', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.062', 'weapon5': '0.118', 'AMMO4': '0.131', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '21.540', 'FRAGCOUNT': '68.500'} [2024-08-06 07:54:51,753][52665] DAMAGECOUNT value on done: 916950.0 [2024-08-06 07:54:51,760][52665] Sum rewards: 69.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.438', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO3': '0.240', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 656474112. Throughput: 0: 4380.2. Samples: 164120870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:54:52,794][52567] Avg episode reward: [(0, '75.097')] [2024-08-06 07:54:53,191][52670] DAMAGECOUNT value on done: 914587.0 [2024-08-06 07:54:53,192][52670] Sum rewards: 83.021, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.886', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.090', 'AMMO4': '0.109', 'weapon4': '0.154', 'AMMO3': '0.190', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '68.000'} [2024-08-06 07:54:53,922][52649] DAMAGECOUNT value on done: 900610.0 [2024-08-06 07:54:53,923][52649] Sum rewards: 78.591, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.142', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.097', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.270', 'WEAPON3': '1.600', 'weapon3': '3.358', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:54,009][52664] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:54:54,195][52795] DAMAGECOUNT value on done: 845660.0 [2024-08-06 07:54:54,195][52795] Sum rewards: 80.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.114', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.246', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '67.000'} [2024-08-06 07:54:54,332][52668] DAMAGECOUNT value on done: 920808.0 [2024-08-06 07:54:54,333][52668] Sum rewards: 81.815, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.144', 'AMMO3': '0.201', 'weapon5': '0.240', 'AMMO4': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.848', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '64.500'} [2024-08-06 07:54:54,486][52666] DAMAGECOUNT value on done: 895230.0 [2024-08-06 07:54:54,488][52666] Sum rewards: 72.486, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.120', 'AMMO3': '0.139', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.372', 'weapon4': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.802', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '56.000'} [2024-08-06 07:54:54,992][52665] DAMAGECOUNT value on done: 907124.0 [2024-08-06 07:54:54,996][52665] Sum rewards: 66.731, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.088', 'weapon4': '0.094', 'AMMO4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.500', 'HITCOUNT': '3.100', 'weapon3': '3.130', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:55,333][52650] Updated weights for policy 0, policy_version 80141 (0.0033) [2024-08-06 07:54:55,862][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:54:56,143][52670] DAMAGECOUNT value on done: 908045.0 [2024-08-06 07:54:56,144][52670] Sum rewards: 77.232, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.952', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.118', 'AMMO4': '0.203', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.792', 'WEAPON3': '1.400', 'weapon3': '2.788', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '64.000'} [2024-08-06 07:54:57,045][52614] Signal inference workers to stop experience collection... (14700 times) [2024-08-06 07:54:57,060][52668] DAMAGECOUNT value on done: 908886.0 [2024-08-06 07:54:57,064][52614] Signal inference workers to resume experience collection... (14700 times) [2024-08-06 07:54:57,064][52668] Sum rewards: 70.921, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.076', 'weapon5': '0.086', 'AMMO4': '0.109', 'HEALTH': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.306', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '58.000'} [2024-08-06 07:54:57,094][52650] InferenceWorker_p0-w0: stopping experience collection (14700 times) [2024-08-06 07:54:57,094][52650] InferenceWorker_p0-w0: resuming experience collection (14700 times) [2024-08-06 07:54:57,282][52649] DAMAGECOUNT value on done: 906877.0 [2024-08-06 07:54:57,282][52649] Sum rewards: 89.674, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.670', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.068', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.460', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.438', 'FRAGCOUNT': '72.000'} [2024-08-06 07:54:57,393][52795] DAMAGECOUNT value on done: 833936.0 [2024-08-06 07:54:57,394][52795] Sum rewards: 62.838, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.160', 'AMMO3': '0.188', 'AMMO4': '0.195', 'weapon5': '0.208', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.850', 'weapon3': '3.134', 'DAMAGECOUNT': '14.712', 'FRAGCOUNT': '53.000'} [2024-08-06 07:54:57,489][52666] DAMAGECOUNT value on done: 916831.0 [2024-08-06 07:54:57,489][52666] Sum rewards: 68.004, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.238', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.116', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '60.000'} [2024-08-06 07:54:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 656556032. Throughput: 0: 4364.2. Samples: 164146800. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:54:57,795][52567] Avg episode reward: [(0, '74.711')] [2024-08-06 07:54:58,249][52665] DAMAGECOUNT value on done: 906039.0 [2024-08-06 07:54:58,251][52665] Sum rewards: 83.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.065', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'weapon4': '0.142', 'AMMO3': '0.244', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.391', 'FRAGCOUNT': '69.000'} [2024-08-06 07:54:59,145][52670] DAMAGECOUNT value on done: 891518.0 [2024-08-06 07:54:59,147][52670] Sum rewards: 81.258, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.096', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.248', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.312', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '68.000'} [2024-08-06 07:54:59,959][52649] DAMAGECOUNT value on done: 899142.0 [2024-08-06 07:54:59,959][52649] Sum rewards: 74.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.639', 'AMMO5': '0.012', 'weapon4': '0.032', 'AMMO2': '0.032', 'weapon5': '0.068', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '61.000'} [2024-08-06 07:55:00,305][52650] Updated weights for policy 0, policy_version 80151 (0.0016) [2024-08-06 07:55:00,376][52658] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 07:55:00,381][52666] DAMAGECOUNT value on done: 909806.0 [2024-08-06 07:55:00,382][52666] Sum rewards: 70.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.428', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.156', 'AMMO3': '0.190', 'weapon5': '0.200', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '57.000'} [2024-08-06 07:55:00,439][52668] DAMAGECOUNT value on done: 917027.0 [2024-08-06 07:55:00,441][52668] Sum rewards: 80.612, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.106', 'weapon5': '0.176', 'AMMO3': '0.179', 'AMMO4': '0.235', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.500'} [2024-08-06 07:55:00,570][52665] DAMAGECOUNT value on done: 908514.0 [2024-08-06 07:55:00,571][52665] Sum rewards: 69.204, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.600', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.086', 'weapon5': '0.098', 'AMMO4': '0.143', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.304', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '59.000'} [2024-08-06 07:55:00,642][52795] DAMAGECOUNT value on done: 842687.0 [2024-08-06 07:55:00,643][52795] Sum rewards: 76.666, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.152', 'AMMO4': '0.201', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:01,258][52662] DAMAGECOUNT value on done: 914362.0 [2024-08-06 07:55:01,259][52662] Sum rewards: 75.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.932', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.096', 'weapon5': '0.120', 'weapon2': '0.208', 'AMMO3': '0.246', 'AMMO4': '0.270', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.330', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:02,096][52670] DAMAGECOUNT value on done: 906689.0 [2024-08-06 07:55:02,105][52670] Sum rewards: 80.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.972', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.166', 'AMMO3': '0.258', 'WEAPON3': '1.600', 'weapon3': '3.580', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '68.000'} [2024-08-06 07:55:02,625][52649] DAMAGECOUNT value on done: 897812.0 [2024-08-06 07:55:02,625][52649] Sum rewards: 72.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.101', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.062', 'AMMO4': '0.126', 'weapon5': '0.170', 'AMMO3': '0.231', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 656637952. Throughput: 0: 4359.8. Samples: 164159780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:55:02,794][52567] Avg episode reward: [(0, '74.888')] [2024-08-06 07:55:03,117][52668] DAMAGECOUNT value on done: 918317.0 [2024-08-06 07:55:03,117][52668] Sum rewards: 72.294, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon2': '0.162', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.300', 'HITCOUNT': '3.560', 'weapon3': '3.564', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '59.500'} [2024-08-06 07:55:03,148][52665] DAMAGECOUNT value on done: 902576.0 [2024-08-06 07:55:03,150][52665] Sum rewards: 78.926, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.430', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.048', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.223', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:03,533][52666] DAMAGECOUNT value on done: 910034.0 [2024-08-06 07:55:03,533][52666] Sum rewards: 80.526, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.158', 'AMMO4': '0.170', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '66.000'} [2024-08-06 07:55:03,808][52667] DAMAGECOUNT value on done: 913650.0 [2024-08-06 07:55:03,808][52667] Sum rewards: 80.957, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.216', 'WEAPON3': '1.200', 'HITCOUNT': '3.350', 'weapon3': '3.464', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '66.000'} [2024-08-06 07:55:03,810][52795] DAMAGECOUNT value on done: 851075.0 [2024-08-06 07:55:03,811][52795] Sum rewards: 66.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.939', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.152', 'weapon5': '0.196', 'AMMO3': '0.220', 'AMMO4': '0.276', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '57.000'} [2024-08-06 07:55:04,288][52662] DAMAGECOUNT value on done: 923927.0 [2024-08-06 07:55:04,288][52662] Sum rewards: 81.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.732', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.038', 'AMMO4': '0.097', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.290', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:04,830][52650] Updated weights for policy 0, policy_version 80161 (0.0014) [2024-08-06 07:55:05,090][52670] DAMAGECOUNT value on done: 914799.0 [2024-08-06 07:55:05,093][52670] Sum rewards: 71.313, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.180', 'AMMO3': '0.211', 'AMMO4': '0.222', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.214', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 07:55:05,199][52649] DAMAGECOUNT value on done: 886917.0 [2024-08-06 07:55:05,199][52649] Sum rewards: 70.129, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.513', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.106', 'AMMO4': '0.132', 'weapon4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.231', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.344', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '59.000'} [2024-08-06 07:55:05,745][52665] DAMAGECOUNT value on done: 908303.0 [2024-08-06 07:55:05,747][52665] Sum rewards: 87.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.130', 'AMMO4': '0.174', 'weapon2': '0.216', 'AMMO3': '0.225', 'weapon5': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.489', 'FRAGCOUNT': '70.000'} [2024-08-06 07:55:06,306][52668] DAMAGECOUNT value on done: 909106.0 [2024-08-06 07:55:06,306][52668] Sum rewards: 78.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.669', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.158', 'weapon4': '0.178', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:06,339][52666] DAMAGECOUNT value on done: 902886.0 [2024-08-06 07:55:06,339][52666] Sum rewards: 65.433, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon4': '0.168', 'AMMO3': '0.197', 'AMMO4': '0.301', 'weapon2': '0.370', 'weapon5': '0.414', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '53.000'} [2024-08-06 07:55:06,621][52667] DAMAGECOUNT value on done: 929638.0 [2024-08-06 07:55:06,623][52667] Sum rewards: 80.004, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.232', 'WEAPON3': '1.450', 'weapon3': '3.464', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '68.000'} [2024-08-06 07:55:07,311][52662] DAMAGECOUNT value on done: 922916.0 [2024-08-06 07:55:07,320][52662] Sum rewards: 77.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.440', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.138', 'weapon5': '0.146', 'AMMO4': '0.184', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '62.000'} [2024-08-06 07:55:07,762][52670] DAMAGECOUNT value on done: 909761.0 [2024-08-06 07:55:07,765][52670] Sum rewards: 83.346, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.350', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.285', 'weapon2': '0.324', 'WEAPON3': '1.750', 'weapon3': '3.336', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '70.000'} [2024-08-06 07:55:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 656728064. Throughput: 0: 4362.2. Samples: 164185940. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:55:07,794][52567] Avg episode reward: [(0, '75.583')] [2024-08-06 07:55:07,818][52649] DAMAGECOUNT value on done: 898168.0 [2024-08-06 07:55:07,820][52649] Sum rewards: 80.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.497', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.180', 'AMMO4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:08,423][52665] DAMAGECOUNT value on done: 908133.0 [2024-08-06 07:55:08,423][52665] Sum rewards: 83.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.185', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.154', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon4': '0.262', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.589', 'FRAGCOUNT': '70.000'} [2024-08-06 07:55:09,101][52668] DAMAGECOUNT value on done: 913584.0 [2024-08-06 07:55:09,102][52668] Sum rewards: 76.854, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.985', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.078', 'weapon5': '0.132', 'AMMO4': '0.201', 'AMMO3': '0.227', 'weapon2': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:09,139][52666] DAMAGECOUNT value on done: 902692.0 [2024-08-06 07:55:09,140][52666] Sum rewards: 62.905, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.795', 'AMMO5': '0.022', 'AMMO2': '0.025', 'weapon5': '0.076', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.154', 'weapon4': '0.218', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '0.950', 'HITCOUNT': '3.070', 'weapon3': '3.122', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '49.500'} [2024-08-06 07:55:09,375][52667] DAMAGECOUNT value on done: 924030.0 [2024-08-06 07:55:09,377][52667] Sum rewards: 76.185, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.995', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.120', 'AMMO3': '0.147', 'weapon4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:09,556][52650] Updated weights for policy 0, policy_version 80171 (0.0014) [2024-08-06 07:55:10,351][52662] DAMAGECOUNT value on done: 911554.0 [2024-08-06 07:55:10,351][52662] Sum rewards: 81.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.780', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.132', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON4': '0.350', 'weapon2': '0.778', 'WEAPON3': '1.350', 'weapon3': '2.530', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:10,512][52649] DAMAGECOUNT value on done: 878495.0 [2024-08-06 07:55:10,512][52649] Sum rewards: 74.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.592', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.148', 'AMMO4': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.242', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '61.000'} [2024-08-06 07:55:11,035][52670] DAMAGECOUNT value on done: 909833.0 [2024-08-06 07:55:11,036][52670] Sum rewards: 81.914, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.128', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.126', 'AMMO3': '0.164', 'AMMO4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.516', 'WEAPON3': '1.050', 'weapon3': '3.140', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:11,253][52665] DAMAGECOUNT value on done: 897858.0 [2024-08-06 07:55:11,253][52665] Sum rewards: 78.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.706', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.050', 'weapon5': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:11,757][52668] DAMAGECOUNT value on done: 921100.0 [2024-08-06 07:55:11,757][52668] Sum rewards: 77.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.531', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.306', 'weapon4': '0.482', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:12,107][52667] DAMAGECOUNT value on done: 927689.0 [2024-08-06 07:55:12,107][52667] Sum rewards: 65.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.019', 'AMMO2': '0.058', 'AMMO3': '0.205', 'weapon2': '0.232', 'AMMO4': '0.290', 'weapon5': '0.336', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.488', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '52.500'} [2024-08-06 07:55:12,264][52666] DAMAGECOUNT value on done: 921340.0 [2024-08-06 07:55:12,264][52666] Sum rewards: 72.225, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.252', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.095', 'weapon4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.230', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.344', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 656818176. Throughput: 0: 4373.8. Samples: 164212560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:55:12,794][52567] Avg episode reward: [(0, '75.744')] [2024-08-06 07:55:13,319][52649] DAMAGECOUNT value on done: 901238.0 [2024-08-06 07:55:13,319][52649] Sum rewards: 70.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.621', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '57.000'} [2024-08-06 07:55:13,563][52662] DAMAGECOUNT value on done: 930680.0 [2024-08-06 07:55:13,563][52662] Sum rewards: 82.905, reward structure: {'DEATHCOUNT': '-18.000', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.114', 'AMMO4': '0.150', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'HEALTH': '0.426', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.378', 'FRAGCOUNT': '69.000'} [2024-08-06 07:55:13,902][52665] DAMAGECOUNT value on done: 901706.0 [2024-08-06 07:55:13,902][52665] Sum rewards: 76.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.491', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.011', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.660', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.000'} [2024-08-06 07:55:14,292][52650] Updated weights for policy 0, policy_version 80181 (0.0015) [2024-08-06 07:55:14,711][52668] DAMAGECOUNT value on done: 914628.0 [2024-08-06 07:55:14,714][52668] Sum rewards: 82.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.878', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.064', 'AMMO4': '0.107', 'weapon5': '0.136', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:14,917][52666] DAMAGECOUNT value on done: 895295.0 [2024-08-06 07:55:14,918][52666] Sum rewards: 67.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon5': '0.058', 'AMMO4': '0.071', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.172', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.512', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '56.000'} [2024-08-06 07:55:15,338][52667] DAMAGECOUNT value on done: 929617.0 [2024-08-06 07:55:15,339][52667] Sum rewards: 74.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.170', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.144', 'AMMO4': '0.175', 'weapon2': '0.220', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:16,528][52662] DAMAGECOUNT value on done: 904668.0 [2024-08-06 07:55:16,530][52662] Sum rewards: 78.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.865', 'AMMO5': '0.023', 'AMMO2': '0.063', 'weapon4': '0.100', 'AMMO3': '0.214', 'weapon5': '0.314', 'AMMO4': '0.315', 'weapon2': '0.380', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:16,564][52649] DAMAGECOUNT value on done: 900632.0 [2024-08-06 07:55:16,564][52649] Sum rewards: 79.385, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.830', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.076', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.416', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '66.000'} [2024-08-06 07:55:17,197][52665] DAMAGECOUNT value on done: 908421.0 [2024-08-06 07:55:17,197][52665] Sum rewards: 77.353, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.096', 'AMMO5': '0.018', 'AMMO2': '0.066', 'AMMO3': '0.152', 'weapon5': '0.192', 'AMMO4': '0.332', 'WEAPON4': '0.400', 'weapon2': '0.404', 'WEAPON5': '0.450', 'weapon4': '0.496', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:17,512][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:55:17,592][52668] DAMAGECOUNT value on done: 908955.0 [2024-08-06 07:55:17,593][52668] Sum rewards: 75.770, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.535', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.160', 'AMMO3': '0.166', 'AMMO4': '0.172', 'weapon2': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.298', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 656900096. Throughput: 0: 4371.6. Samples: 164225440. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:55:17,802][52567] Avg episode reward: [(0, '75.916')] [2024-08-06 07:55:17,883][52666] DAMAGECOUNT value on done: 906654.0 [2024-08-06 07:55:17,887][52666] Sum rewards: 83.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.261', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.168', 'AMMO3': '0.194', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.537', 'FRAGCOUNT': '66.000'} [2024-08-06 07:55:18,421][52667] DAMAGECOUNT value on done: 928388.0 [2024-08-06 07:55:18,423][52667] Sum rewards: 75.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.900', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.201', 'weapon2': '0.254', 'WEAPON3': '1.150', 'weapon3': '3.574', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 07:55:18,649][52650] Updated weights for policy 0, policy_version 80191 (0.0013) [2024-08-06 07:55:19,306][52649] DAMAGECOUNT value on done: 892571.0 [2024-08-06 07:55:19,307][52649] Sum rewards: 73.734, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.335', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.070', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'weapon4': '0.178', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '59.000'} [2024-08-06 07:55:19,328][52662] DAMAGECOUNT value on done: 912762.0 [2024-08-06 07:55:19,328][52662] Sum rewards: 54.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.230', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.142', 'AMMO4': '0.174', 'AMMO3': '0.194', 'weapon4': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.818', 'WEAPON3': '1.300', 'weapon3': '2.460', 'HITCOUNT': '2.780', 'DAMAGECOUNT': '13.794', 'FRAGCOUNT': '45.000'} [2024-08-06 07:55:20,887][52668] DAMAGECOUNT value on done: 905944.0 [2024-08-06 07:55:20,888][52668] Sum rewards: 74.273, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.900', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.104', 'weapon5': '0.240', 'AMMO3': '0.252', 'AMMO4': '0.289', 'weapon2': '0.372', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.976', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '62.500'} [2024-08-06 07:55:21,027][52667] DAMAGECOUNT value on done: 921229.0 [2024-08-06 07:55:21,028][52667] Sum rewards: 71.156, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.709', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.106', 'AMMO3': '0.129', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.626', 'WEAPON3': '0.850', 'weapon3': '2.954', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '55.000'} [2024-08-06 07:55:22,341][52662] DAMAGECOUNT value on done: 929098.0 [2024-08-06 07:55:22,341][52662] Sum rewards: 65.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.026', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.484', 'WEAPON3': '1.550', 'weapon3': '3.086', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '57.000'} [2024-08-06 07:55:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 656990208. Throughput: 0: 4365.6. Samples: 164251510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:55:22,794][52567] Avg episode reward: [(0, '75.246')] [2024-08-06 07:55:23,591][52650] Updated weights for policy 0, policy_version 80201 (0.0015) [2024-08-06 07:55:24,066][52667] DAMAGECOUNT value on done: 918096.0 [2024-08-06 07:55:24,070][52667] Sum rewards: 68.963, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.250', 'AMMO5': '0.013', 'AMMO2': '0.038', 'AMMO3': '0.125', 'AMMO4': '0.190', 'weapon5': '0.218', 'weapon4': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '0.900', 'weapon3': '2.722', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '54.000'} [2024-08-06 07:55:24,097][52668] DAMAGECOUNT value on done: 904695.0 [2024-08-06 07:55:24,099][52668] Sum rewards: 60.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.732', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.046', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '51.000'} [2024-08-06 07:55:25,321][52662] DAMAGECOUNT value on done: 916935.0 [2024-08-06 07:55:25,323][52662] Sum rewards: 78.186, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.542', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.180', 'weapon4': '0.196', 'weapon5': '0.200', 'AMMO4': '0.252', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:26,790][52667] DAMAGECOUNT value on done: 921453.0 [2024-08-06 07:55:26,791][52667] Sum rewards: 93.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.287', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.106', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '22.221', 'FRAGCOUNT': '76.000'} [2024-08-06 07:55:27,164][52668] DAMAGECOUNT value on done: 898522.0 [2024-08-06 07:55:27,164][52668] Sum rewards: 71.256, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.039', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.196', 'weapon4': '0.202', 'AMMO3': '0.205', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.236', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:27,183][52659] DAMAGECOUNT value on done: 918995.0 [2024-08-06 07:55:27,184][52659] Sum rewards: 64.189, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.057', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO4': '0.173', 'weapon5': '0.188', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.600', 'HITCOUNT': '3.040', 'weapon3': '3.098', 'DAMAGECOUNT': '15.771', 'FRAGCOUNT': '56.000'} [2024-08-06 07:55:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 657080320. Throughput: 0: 4366.4. Samples: 164277900. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:55:27,794][52567] Avg episode reward: [(0, '75.733')] [2024-08-06 07:55:28,024][52650] Updated weights for policy 0, policy_version 80211 (0.0012) [2024-08-06 07:55:28,250][52662] DAMAGECOUNT value on done: 922707.0 [2024-08-06 07:55:28,251][52662] Sum rewards: 73.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon2': '0.148', 'AMMO3': '0.225', 'WEAPON3': '1.300', 'HITCOUNT': '3.000', 'weapon3': '3.718', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '62.000'} [2024-08-06 07:55:29,752][52659] DAMAGECOUNT value on done: 915526.0 [2024-08-06 07:55:29,753][52659] Sum rewards: 85.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.718', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.034', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '71.000'} [2024-08-06 07:55:29,858][52667] DAMAGECOUNT value on done: 928185.0 [2024-08-06 07:55:29,858][52667] Sum rewards: 73.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.144', 'AMMO3': '0.191', 'AMMO4': '0.202', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.218', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '62.000'} [2024-08-06 07:55:29,966][52668] DAMAGECOUNT value on done: 914494.0 [2024-08-06 07:55:29,968][52668] Sum rewards: 82.138, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.015', 'HEALTH': '0.020', 'AMMO2': '0.045', 'weapon4': '0.104', 'AMMO3': '0.200', 'AMMO4': '0.227', 'weapon5': '0.266', 'weapon2': '0.336', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '66.000'} [2024-08-06 07:55:31,493][52662] DAMAGECOUNT value on done: 915833.0 [2024-08-06 07:55:31,495][52662] Sum rewards: 69.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.210', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.040', 'weapon5': '0.074', 'AMMO4': '0.177', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '56.000'} [2024-08-06 07:55:32,694][52667] DAMAGECOUNT value on done: 915212.0 [2024-08-06 07:55:32,695][52667] Sum rewards: 83.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.202', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '69.000'} [2024-08-06 07:55:32,711][52668] DAMAGECOUNT value on done: 916378.0 [2024-08-06 07:55:32,711][52668] Sum rewards: 76.512, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon2': '0.208', 'AMMO3': '0.248', 'weapon5': '0.254', 'AMMO4': '0.256', 'weapon4': '0.334', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.754', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 657162240. Throughput: 0: 4361.8. Samples: 164290720. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 07:55:32,794][52567] Avg episode reward: [(0, '75.833')] [2024-08-06 07:55:32,837][52659] DAMAGECOUNT value on done: 926901.0 [2024-08-06 07:55:32,838][52659] Sum rewards: 81.810, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.126', 'weapon5': '0.202', 'AMMO3': '0.220', 'AMMO4': '0.227', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:33,179][52650] Updated weights for policy 0, policy_version 80221 (0.0021) [2024-08-06 07:55:34,763][52662] DAMAGECOUNT value on done: 915473.0 [2024-08-06 07:55:34,763][52662] Sum rewards: 74.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.068', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.290', 'WEAPON3': '1.500', 'weapon3': '3.392', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:35,486][52667] DAMAGECOUNT value on done: 917843.0 [2024-08-06 07:55:35,487][52667] Sum rewards: 66.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon5': '0.146', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '56.000'} [2024-08-06 07:55:35,502][52668] DAMAGECOUNT value on done: 916265.0 [2024-08-06 07:55:35,503][52668] Sum rewards: 81.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.446', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.104', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'weapon3': '3.482', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:35,528][52659] DAMAGECOUNT value on done: 919914.0 [2024-08-06 07:55:35,529][52659] Sum rewards: 74.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.044', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.216', 'AMMO3': '0.240', 'WEAPON3': '1.550', 'weapon3': '3.522', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:37,491][52662] DAMAGECOUNT value on done: 909720.0 [2024-08-06 07:55:37,492][52662] Sum rewards: 66.781, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.570', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.158', 'weapon2': '0.182', 'AMMO4': '0.212', 'AMMO3': '0.234', 'weapon4': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '58.000'} [2024-08-06 07:55:37,651][52650] Updated weights for policy 0, policy_version 80231 (0.0013) [2024-08-06 07:55:37,772][52660] DAMAGECOUNT value on done: 912575.0 [2024-08-06 07:55:37,782][52660] Sum rewards: 72.340, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.764', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.130', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.236', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '61.000'} [2024-08-06 07:55:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 657252352. Throughput: 0: 4360.0. Samples: 164317070. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:55:37,794][52567] Avg episode reward: [(0, '75.668')] [2024-08-06 07:55:38,196][52659] DAMAGECOUNT value on done: 915358.0 [2024-08-06 07:55:38,196][52659] Sum rewards: 76.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.981', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.146', 'AMMO3': '0.176', 'weapon4': '0.188', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.284', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '61.500'} [2024-08-06 07:55:38,332][52668] DAMAGECOUNT value on done: 917577.0 [2024-08-06 07:55:38,333][52668] Sum rewards: 66.714, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.615', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.086', 'AMMO4': '0.131', 'weapon5': '0.144', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.814', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '53.000'} [2024-08-06 07:55:38,671][52667] DAMAGECOUNT value on done: 927199.0 [2024-08-06 07:55:38,675][52667] Sum rewards: 82.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.032', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO4': '0.145', 'AMMO3': '0.185', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.044', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '66.000'} [2024-08-06 07:55:40,300][52660] DAMAGECOUNT value on done: 903968.0 [2024-08-06 07:55:40,303][52660] Sum rewards: 75.114, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.112', 'AMMO4': '0.174', 'weapon5': '0.190', 'weapon2': '0.218', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.222', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '62.000'} [2024-08-06 07:55:40,556][52662] DAMAGECOUNT value on done: 918893.0 [2024-08-06 07:55:40,556][52662] Sum rewards: 72.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.084', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.082', 'AMMO4': '0.163', 'AMMO3': '0.248', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.500', 'HITCOUNT': '2.920', 'weapon3': '3.034', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '62.000'} [2024-08-06 07:55:40,675][52659] DAMAGECOUNT value on done: 918495.0 [2024-08-06 07:55:40,677][52659] Sum rewards: 73.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.023', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.080', 'AMMO4': '0.082', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '3.176', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '62.000'} [2024-08-06 07:55:40,971][52668] DAMAGECOUNT value on done: 921195.0 [2024-08-06 07:55:40,972][52668] Sum rewards: 78.689, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.063', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.252', 'weapon2': '0.256', 'WEAPON3': '1.650', 'weapon3': '3.496', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:41,764][52667] DAMAGECOUNT value on done: 918185.0 [2024-08-06 07:55:41,766][52667] Sum rewards: 81.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.729', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.064', 'weapon5': '0.096', 'AMMO4': '0.113', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '70.000'} [2024-08-06 07:55:42,604][52650] Updated weights for policy 0, policy_version 80241 (0.0014) [2024-08-06 07:55:42,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17339.6, 300 sec: 17467.0). Total num frames: 657334272. Throughput: 0: 4359.1. Samples: 164342960. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:55:42,795][52567] Avg episode reward: [(0, '75.500')] [2024-08-06 07:55:43,135][52662] DAMAGECOUNT value on done: 910002.0 [2024-08-06 07:55:43,136][52662] Sum rewards: 76.490, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.048', 'AMMO4': '0.150', 'weapon5': '0.196', 'weapon2': '0.206', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.288', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:43,231][52660] DAMAGECOUNT value on done: 915651.0 [2024-08-06 07:55:43,231][52660] Sum rewards: 71.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.350', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.106', 'AMMO3': '0.194', 'weapon5': '0.254', 'AMMO4': '0.262', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '58.000'} [2024-08-06 07:55:43,738][52659] DAMAGECOUNT value on done: 919758.0 [2024-08-06 07:55:43,739][52659] Sum rewards: 65.262, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.860', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.092', 'weapon4': '0.098', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.288', 'AMMO3': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.246', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '58.000'} [2024-08-06 07:55:44,811][52811] DAMAGECOUNT value on done: 870252.0 [2024-08-06 07:55:44,811][52811] Sum rewards: 79.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.126', 'weapon5': '0.128', 'weapon2': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.470', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:44,983][52667] DAMAGECOUNT value on done: 922588.0 [2024-08-06 07:55:44,984][52667] Sum rewards: 89.231, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.845', 'AMMO2': '0.024', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'weapon4': '0.254', 'weapon2': '0.386', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '22.239', 'FRAGCOUNT': '73.000'} [2024-08-06 07:55:46,084][52660] DAMAGECOUNT value on done: 928563.0 [2024-08-06 07:55:46,084][52660] Sum rewards: 75.585, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.166', 'weapon4': '0.238', 'AMMO4': '0.266', 'weapon5': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.578', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:46,340][52662] DAMAGECOUNT value on done: 927859.0 [2024-08-06 07:55:46,340][52662] Sum rewards: 83.731, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.622', 'AMMO5': '0.032', 'AMMO2': '0.084', 'weapon4': '0.130', 'AMMO3': '0.235', 'weapon5': '0.252', 'AMMO4': '0.420', 'weapon2': '0.442', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.450', 'weapon3': '2.808', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '71.000'} [2024-08-06 07:55:46,469][52659] DAMAGECOUNT value on done: 917994.0 [2024-08-06 07:55:46,471][52659] Sum rewards: 78.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.507', 'AMMO5': '0.022', 'AMMO2': '0.047', 'weapon4': '0.082', 'weapon5': '0.226', 'AMMO3': '0.236', 'AMMO4': '0.237', 'weapon2': '0.418', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:46,693][52650] Updated weights for policy 0, policy_version 80251 (0.0011) [2024-08-06 07:55:47,228][52667] DAMAGECOUNT value on done: 929623.0 [2024-08-06 07:55:47,229][52667] Sum rewards: 76.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.808', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon4': '0.074', 'weapon5': '0.116', 'AMMO4': '0.124', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 657424384. Throughput: 0: 4362.7. Samples: 164356100. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:55:47,794][52567] Avg episode reward: [(0, '75.651')] [2024-08-06 07:55:47,940][52811] DAMAGECOUNT value on done: 853380.0 [2024-08-06 07:55:47,940][52811] Sum rewards: 77.283, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.020', 'HEALTH': '0.050', 'weapon4': '0.066', 'AMMO4': '0.098', 'weapon5': '0.186', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.158', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:48,006][52647] DAMAGECOUNT value on done: 977739.0 [2024-08-06 07:55:48,007][52647] Sum rewards: 76.076, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO2': '0.035', 'weapon5': '0.058', 'AMMO4': '0.176', 'weapon2': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.500', 'weapon3': '3.528', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:49,118][52660] DAMAGECOUNT value on done: 908989.0 [2024-08-06 07:55:49,121][52660] Sum rewards: 76.608, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.166', 'AMMO4': '0.198', 'AMMO3': '0.216', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:49,198][52662] DAMAGECOUNT value on done: 919578.0 [2024-08-06 07:55:49,199][52662] Sum rewards: 76.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.164', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:49,510][52659] DAMAGECOUNT value on done: 917167.0 [2024-08-06 07:55:49,511][52659] Sum rewards: 77.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.475', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.350', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:50,144][52667] DAMAGECOUNT value on done: 929516.0 [2024-08-06 07:55:50,145][52667] Sum rewards: 75.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.531', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.038', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.396', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:50,546][52647] DAMAGECOUNT value on done: 964356.0 [2024-08-06 07:55:50,547][52647] Sum rewards: 65.017, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.580', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.042', 'AMMO4': '0.141', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.490', 'WEAPON3': '0.950', 'HITCOUNT': '3.100', 'weapon3': '3.290', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '51.000'} [2024-08-06 07:55:50,862][52659] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:55:51,072][52811] DAMAGECOUNT value on done: 848352.0 [2024-08-06 07:55:51,073][52811] Sum rewards: 82.175, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.362', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.122', 'AMMO3': '0.201', 'AMMO4': '0.242', 'weapon5': '0.248', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '67.000'} [2024-08-06 07:55:51,713][52662] DAMAGECOUNT value on done: 909090.0 [2024-08-06 07:55:51,715][52662] Sum rewards: 71.248, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.076', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.015', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.356', 'WEAPON3': '1.300', 'HITCOUNT': '3.100', 'weapon3': '3.344', 'DAMAGECOUNT': '16.737', 'FRAGCOUNT': '59.000'} [2024-08-06 07:55:51,812][52650] Updated weights for policy 0, policy_version 80261 (0.0036) [2024-08-06 07:55:52,001][52660] DAMAGECOUNT value on done: 908496.0 [2024-08-06 07:55:52,003][52660] Sum rewards: 62.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.037', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.128', 'AMMO4': '0.225', 'AMMO3': '0.252', 'weapon5': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.822', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '54.000'} [2024-08-06 07:55:52,333][52659] DAMAGECOUNT value on done: 925237.0 [2024-08-06 07:55:52,333][52659] Sum rewards: 78.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.150', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.114', 'AMMO3': '0.163', 'weapon5': '0.230', 'AMMO4': '0.256', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.018', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:52,584][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:55:52,794][52567] Fps is (10 sec: 18842.2, 60 sec: 17476.3, 300 sec: 17522.5). Total num frames: 657522688. Throughput: 0: 4364.5. Samples: 164382340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:55:52,795][52567] Avg episode reward: [(0, '75.513')] [2024-08-06 07:55:52,927][52667] DAMAGECOUNT value on done: 924043.0 [2024-08-06 07:55:52,929][52667] Sum rewards: 79.388, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.091', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:53,616][52647] DAMAGECOUNT value on done: 971943.0 [2024-08-06 07:55:53,617][52647] Sum rewards: 75.285, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.122', 'weapon4': '0.216', 'AMMO3': '0.230', 'AMMO4': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.922', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:54,173][52811] DAMAGECOUNT value on done: 852920.0 [2024-08-06 07:55:54,174][52811] Sum rewards: 80.824, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.048', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '66.000'} [2024-08-06 07:55:54,822][52662] DAMAGECOUNT value on done: 913426.0 [2024-08-06 07:55:54,823][52662] Sum rewards: 72.174, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.784', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon5': '0.058', 'weapon4': '0.104', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO4': '0.235', 'AMMO3': '0.247', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.400', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '63.000'} [2024-08-06 07:55:54,882][52660] DAMAGECOUNT value on done: 913991.0 [2024-08-06 07:55:54,884][52660] Sum rewards: 67.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.892', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.106', 'AMMO3': '0.209', 'weapon5': '0.312', 'AMMO4': '0.317', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'HITCOUNT': '2.950', 'weapon3': '2.974', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.000'} [2024-08-06 07:55:55,332][52659] DAMAGECOUNT value on done: 912123.0 [2024-08-06 07:55:55,332][52659] Sum rewards: 78.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.161', 'AMMO3': '0.211', 'weapon4': '0.212', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '65.000'} [2024-08-06 07:55:55,691][52667] DAMAGECOUNT value on done: 922607.0 [2024-08-06 07:55:55,693][52667] Sum rewards: 69.595, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.052', 'AMMO5': '0.006', 'ARMOR': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.420', 'weapon3': '3.428', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '57.000'} [2024-08-06 07:55:56,545][52647] DAMAGECOUNT value on done: 970547.0 [2024-08-06 07:55:56,550][52647] Sum rewards: 73.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.544', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.186', 'AMMO3': '0.220', 'weapon5': '0.256', 'AMMO4': '0.271', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 07:55:56,592][52650] Updated weights for policy 0, policy_version 80271 (0.0029) [2024-08-06 07:55:57,230][52811] DAMAGECOUNT value on done: 854958.0 [2024-08-06 07:55:57,230][52811] Sum rewards: 68.188, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.350', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.072', 'AMMO4': '0.171', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.264', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '59.000'} [2024-08-06 07:55:57,542][52660] DAMAGECOUNT value on done: 921777.0 [2024-08-06 07:55:57,544][52660] Sum rewards: 68.635, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.740', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.056', 'weapon5': '0.088', 'AMMO4': '0.233', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.700', 'weapon3': '3.188', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 657604608. Throughput: 0: 4350.0. Samples: 164408310. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:55:57,802][52567] Avg episode reward: [(0, '75.317')] [2024-08-06 07:55:57,928][52662] DAMAGECOUNT value on done: 909997.0 [2024-08-06 07:55:57,929][52662] Sum rewards: 74.506, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.700', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.112', 'AMMO4': '0.126', 'weapon5': '0.132', 'weapon2': '0.232', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.260', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '64.000'} [2024-08-06 07:55:58,058][52659] DAMAGECOUNT value on done: 923284.0 [2024-08-06 07:55:58,059][52659] Sum rewards: 67.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.828', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.154', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.284', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.596', 'FRAGCOUNT': '54.000'} [2024-08-06 07:55:58,392][52667] DAMAGECOUNT value on done: 925897.0 [2024-08-06 07:55:58,393][52667] Sum rewards: 73.001, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.836', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.172', 'weapon2': '0.690', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '60.000'} [2024-08-06 07:55:58,994][52647] DAMAGECOUNT value on done: 978542.0 [2024-08-06 07:55:58,994][52647] Sum rewards: 64.309, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.228', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.142', 'weapon4': '0.180', 'AMMO4': '0.199', 'AMMO3': '0.255', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.934', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.775', 'FRAGCOUNT': '59.000'} [2024-08-06 07:55:59,914][52660] DAMAGECOUNT value on done: 910462.0 [2024-08-06 07:55:59,916][52660] Sum rewards: 74.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.297', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.048', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:00,366][52811] DAMAGECOUNT value on done: 871748.0 [2024-08-06 07:56:00,366][52811] Sum rewards: 86.770, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO2': '0.005', 'AMMO4': '0.024', 'AMMO3': '0.229', 'HEALTH': '0.262', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.534', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.195', 'FRAGCOUNT': '70.000'} [2024-08-06 07:56:00,852][52650] Updated weights for policy 0, policy_version 80281 (0.0012) [2024-08-06 07:56:00,939][52659] DAMAGECOUNT value on done: 917559.0 [2024-08-06 07:56:00,943][52659] Sum rewards: 82.611, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.124', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.125', 'weapon2': '0.176', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.408', 'WEAPON3': '1.550', 'weapon3': '2.908', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '69.000'} [2024-08-06 07:56:01,856][52647] DAMAGECOUNT value on done: 975780.0 [2024-08-06 07:56:01,856][52647] Sum rewards: 79.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.046', 'AMMO4': '0.165', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:02,608][52660] DAMAGECOUNT value on done: 906626.0 [2024-08-06 07:56:02,608][52660] Sum rewards: 87.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.206', 'weapon2': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.614', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.995', 'FRAGCOUNT': '72.000'} [2024-08-06 07:56:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 657686528. Throughput: 0: 4362.7. Samples: 164421760. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:56:02,802][52567] Avg episode reward: [(0, '75.264')] [2024-08-06 07:56:03,451][52811] DAMAGECOUNT value on done: 864097.0 [2024-08-06 07:56:03,452][52811] Sum rewards: 82.583, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.678', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon4': '0.172', 'AMMO3': '0.173', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.100', 'weapon3': '3.088', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:04,019][52659] DAMAGECOUNT value on done: 914848.0 [2024-08-06 07:56:04,035][52659] Sum rewards: 78.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'weapon5': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.392', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:04,260][52647] DAMAGECOUNT value on done: 978233.0 [2024-08-06 07:56:04,260][52647] Sum rewards: 64.993, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.050', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.059', 'weapon4': '0.072', 'weapon5': '0.152', 'AMMO3': '0.263', 'AMMO4': '0.293', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.152', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '57.000'} [2024-08-06 07:56:04,297][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:56:05,351][52660] DAMAGECOUNT value on done: 913490.0 [2024-08-06 07:56:05,353][52660] Sum rewards: 67.991, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.890', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon5': '0.120', 'AMMO4': '0.268', 'AMMO3': '0.290', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon4': '0.414', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.792', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:05,740][52650] Updated weights for policy 0, policy_version 80291 (0.0037) [2024-08-06 07:56:06,577][52811] DAMAGECOUNT value on done: 853027.0 [2024-08-06 07:56:06,579][52811] Sum rewards: 76.241, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.020', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.149', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.335', 'WEAPON3': '1.950', 'weapon3': '3.384', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '69.000'} [2024-08-06 07:56:07,116][52647] DAMAGECOUNT value on done: 952868.0 [2024-08-06 07:56:07,116][52647] Sum rewards: 79.108, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.636', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.195', 'weapon2': '0.758', 'WEAPON3': '1.250', 'weapon3': '3.032', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:07,146][52659] DAMAGECOUNT value on done: 917178.0 [2024-08-06 07:56:07,147][52659] Sum rewards: 64.467, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.107', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.070', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.446', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.276', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '52.000'} [2024-08-06 07:56:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 657776640. Throughput: 0: 4369.5. Samples: 164448140. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:56:07,794][52567] Avg episode reward: [(0, '74.940')] [2024-08-06 07:56:08,214][52660] DAMAGECOUNT value on done: 907994.0 [2024-08-06 07:56:08,215][52660] Sum rewards: 76.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.939', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon4': '0.146', 'AMMO3': '0.252', 'weapon2': '0.274', 'weapon5': '0.274', 'AMMO4': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:09,430][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:56:09,717][52811] DAMAGECOUNT value on done: 859936.0 [2024-08-06 07:56:09,717][52811] Sum rewards: 69.982, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.291', 'WEAPON1': '0.020', 'AMMO5': '0.023', 'AMMO2': '0.045', 'weapon4': '0.128', 'AMMO4': '0.227', 'weapon5': '0.234', 'AMMO3': '0.236', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '58.500'} [2024-08-06 07:56:09,743][52659] DAMAGECOUNT value on done: 916448.0 [2024-08-06 07:56:09,743][52659] Sum rewards: 74.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.016', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.328', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:09,942][52647] DAMAGECOUNT value on done: 968269.0 [2024-08-06 07:56:09,943][52647] Sum rewards: 69.703, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.529', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.158', 'AMMO3': '0.209', 'AMMO4': '0.242', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '58.500'} [2024-08-06 07:56:10,443][52650] Updated weights for policy 0, policy_version 80301 (0.0027) [2024-08-06 07:56:10,961][52660] DAMAGECOUNT value on done: 908473.0 [2024-08-06 07:56:10,962][52660] Sum rewards: 77.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.142', 'AMMO4': '0.187', 'weapon2': '0.204', 'AMMO3': '0.257', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:12,304][52647] DAMAGECOUNT value on done: 966552.0 [2024-08-06 07:56:12,305][52647] Sum rewards: 65.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.100', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.104', 'weapon5': '0.124', 'AMMO3': '0.201', 'AMMO4': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.250', 'HITCOUNT': '2.960', 'weapon3': '3.150', 'DAMAGECOUNT': '15.000', 'FRAGCOUNT': '54.000'} [2024-08-06 07:56:12,460][52659] DAMAGECOUNT value on done: 926065.0 [2024-08-06 07:56:12,460][52659] Sum rewards: 81.016, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.009', 'weapon5': '0.018', 'weapon4': '0.024', 'AMMO2': '0.039', 'AMMO3': '0.195', 'AMMO4': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.390', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '67.500'} [2024-08-06 07:56:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 657866752. Throughput: 0: 4371.8. Samples: 164474630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:56:12,794][52567] Avg episode reward: [(0, '74.754')] [2024-08-06 07:56:12,815][52811] DAMAGECOUNT value on done: 858075.0 [2024-08-06 07:56:12,815][52811] Sum rewards: 63.843, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.136', 'weapon5': '0.184', 'AMMO3': '0.209', 'AMMO4': '0.218', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.750', 'weapon3': '3.150', 'DAMAGECOUNT': '14.898', 'FRAGCOUNT': '54.000'} [2024-08-06 07:56:13,362][52660] DAMAGECOUNT value on done: 919517.0 [2024-08-06 07:56:13,364][52660] Sum rewards: 72.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.027', 'WEAPON5': '0.050', 'AMMO4': '0.137', 'AMMO3': '0.237', 'weapon2': '0.574', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:15,010][52659] DAMAGECOUNT value on done: 911173.0 [2024-08-06 07:56:15,010][52659] Sum rewards: 68.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.650', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.140', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '57.500'} [2024-08-06 07:56:15,271][52650] Updated weights for policy 0, policy_version 80311 (0.0013) [2024-08-06 07:56:15,686][52647] DAMAGECOUNT value on done: 964377.0 [2024-08-06 07:56:15,687][52647] Sum rewards: 67.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.645', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.160', 'AMMO3': '0.203', 'weapon5': '0.236', 'weapon2': '0.270', 'AMMO4': '0.307', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.504', 'FRAGCOUNT': '58.000'} [2024-08-06 07:56:15,696][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:56:15,772][52811] DAMAGECOUNT value on done: 863359.0 [2024-08-06 07:56:15,773][52811] Sum rewards: 78.288, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.705', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.150', 'weapon5': '0.196', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:16,327][52658] DAMAGECOUNT value on done: 918998.0 [2024-08-06 07:56:16,327][52658] Sum rewards: 74.398, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.238', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.024', 'weapon5': '0.082', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:16,396][52660] DAMAGECOUNT value on done: 932270.0 [2024-08-06 07:56:16,399][52660] Sum rewards: 83.513, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.274', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.054', 'AMMO3': '0.139', 'AMMO4': '0.152', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.926', 'WEAPON3': '1.000', 'weapon3': '2.638', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 657948672. Throughput: 0: 4378.2. Samples: 164487740. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:56:17,794][52567] Avg episode reward: [(0, '74.661')] [2024-08-06 07:56:17,956][52659] DAMAGECOUNT value on done: 922789.0 [2024-08-06 07:56:17,956][52659] Sum rewards: 68.791, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.280', 'AMMO5': '0.010', 'weapon4': '0.044', 'AMMO2': '0.047', 'weapon5': '0.096', 'AMMO3': '0.219', 'AMMO4': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '59.000'} [2024-08-06 07:56:18,304][52647] DAMAGECOUNT value on done: 956671.0 [2024-08-06 07:56:18,304][52647] Sum rewards: 67.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.543', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.178', 'AMMO3': '0.198', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'weapon4': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '54.000'} [2024-08-06 07:56:18,981][52811] DAMAGECOUNT value on done: 867862.0 [2024-08-06 07:56:18,981][52811] Sum rewards: 75.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.413', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.120', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'weapon4': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:19,327][52660] DAMAGECOUNT value on done: 910709.0 [2024-08-06 07:56:19,329][52660] Sum rewards: 72.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.821', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.100', 'weapon5': '0.188', 'AMMO3': '0.211', 'AMMO4': '0.238', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:19,367][52658] DAMAGECOUNT value on done: 922422.0 [2024-08-06 07:56:19,367][52658] Sum rewards: 74.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.592', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.168', 'AMMO3': '0.198', 'weapon5': '0.248', 'AMMO4': '0.279', 'weapon2': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:19,549][52650] Updated weights for policy 0, policy_version 80321 (0.0024) [2024-08-06 07:56:20,410][52659] DAMAGECOUNT value on done: 915831.0 [2024-08-06 07:56:20,411][52659] Sum rewards: 68.389, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.575', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.143', 'weapon2': '0.206', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.290', 'weapon3': '3.432', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '58.000'} [2024-08-06 07:56:20,890][52647] DAMAGECOUNT value on done: 967202.0 [2024-08-06 07:56:20,890][52647] Sum rewards: 60.986, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.137', 'weapon5': '0.140', 'AMMO4': '0.157', 'HEALTH': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.308', 'weapon2': '0.316', 'WEAPON3': '0.750', 'HITCOUNT': '2.690', 'weapon3': '2.956', 'DAMAGECOUNT': '14.772', 'FRAGCOUNT': '47.000'} [2024-08-06 07:56:21,489][52669] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:56:22,189][52811] DAMAGECOUNT value on done: 857352.0 [2024-08-06 07:56:22,190][52811] Sum rewards: 73.400, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.124', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.193', 'weapon5': '0.198', 'weapon2': '0.234', 'AMMO3': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.122', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '65.500'} [2024-08-06 07:56:22,232][52660] DAMAGECOUNT value on done: 918229.0 [2024-08-06 07:56:22,233][52660] Sum rewards: 72.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.297', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.182', 'AMMO3': '0.204', 'AMMO4': '0.204', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '58.500'} [2024-08-06 07:56:22,312][52658] DAMAGECOUNT value on done: 923983.0 [2024-08-06 07:56:22,312][52658] Sum rewards: 82.210, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.064', 'weapon5': '0.114', 'AMMO4': '0.147', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.250', 'weapon3': '3.274', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 658046976. Throughput: 0: 4376.4. Samples: 164514010. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 07:56:22,794][52567] Avg episode reward: [(0, '74.328')] [2024-08-06 07:56:23,508][52647] DAMAGECOUNT value on done: 961315.0 [2024-08-06 07:56:23,509][52647] Sum rewards: 84.808, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.130', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.052', 'weapon5': '0.108', 'AMMO4': '0.146', 'AMMO3': '0.285', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.750', 'weapon3': '2.992', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.330', 'FRAGCOUNT': '72.000'} [2024-08-06 07:56:24,384][52650] Updated weights for policy 0, policy_version 80331 (0.0024) [2024-08-06 07:56:24,840][52658] DAMAGECOUNT value on done: 921190.0 [2024-08-06 07:56:24,842][52658] Sum rewards: 68.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.804', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.142', 'AMMO4': '0.167', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.326', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '55.000'} [2024-08-06 07:56:25,420][52811] DAMAGECOUNT value on done: 856620.0 [2024-08-06 07:56:25,420][52811] Sum rewards: 90.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.693', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.036', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.181', 'AMMO3': '0.207', 'weapon2': '0.746', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '21.855', 'FRAGCOUNT': '73.000'} [2024-08-06 07:56:25,525][52660] DAMAGECOUNT value on done: 915074.0 [2024-08-06 07:56:25,528][52660] Sum rewards: 72.084, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.064', 'AMMO4': '0.165', 'weapon5': '0.170', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'HEALTH': '0.640', 'WEAPON3': '1.050', 'weapon3': '3.116', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '56.000'} [2024-08-06 07:56:25,982][52669] DAMAGECOUNT value on done: 917775.0 [2024-08-06 07:56:25,984][52669] Sum rewards: 69.894, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.730', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.056', 'AMMO4': '0.082', 'weapon4': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.264', 'AMMO3': '0.289', 'WEAPON3': '1.650', 'weapon3': '3.328', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:26,112][52647] DAMAGECOUNT value on done: 967604.0 [2024-08-06 07:56:26,112][52647] Sum rewards: 78.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.365', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'weapon2': '0.246', 'WEAPON5': '0.250', 'weapon4': '0.284', 'WEAPON3': '1.100', 'weapon3': '3.148', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:27,398][52671] DAMAGECOUNT value on done: 923369.0 [2024-08-06 07:56:27,400][52671] Sum rewards: 60.799, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.338', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.098', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.276', 'weapon2': '0.336', 'WEAPON3': '1.650', 'weapon3': '3.158', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '54.000'} [2024-08-06 07:56:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 658128896. Throughput: 0: 4376.7. Samples: 164539910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:56:27,802][52567] Avg episode reward: [(0, '74.546')] [2024-08-06 07:56:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080338_658128896.pth... [2024-08-06 07:56:27,935][52658] DAMAGECOUNT value on done: 915252.0 [2024-08-06 07:56:27,935][52658] Sum rewards: 75.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.612', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.148', 'weapon5': '0.168', 'AMMO3': '0.234', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000079825_653926400.pth [2024-08-06 07:56:28,380][52660] DAMAGECOUNT value on done: 907501.0 [2024-08-06 07:56:28,382][52660] Sum rewards: 76.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.068', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.342', 'weapon4': '0.342', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:28,572][52811] DAMAGECOUNT value on done: 857291.0 [2024-08-06 07:56:28,572][52811] Sum rewards: 73.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.768', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.172', 'weapon5': '0.186', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '2.926', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:28,716][52647] DAMAGECOUNT value on done: 970958.0 [2024-08-06 07:56:28,716][52647] Sum rewards: 76.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.074', 'AMMO4': '0.180', 'AMMO3': '0.208', 'weapon2': '0.208', 'weapon5': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '62.000'} [2024-08-06 07:56:29,086][52650] Updated weights for policy 0, policy_version 80341 (0.0012) [2024-08-06 07:56:29,134][52669] DAMAGECOUNT value on done: 914792.0 [2024-08-06 07:56:29,134][52669] Sum rewards: 83.082, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO2': '0.034', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO4': '0.168', 'AMMO3': '0.258', 'weapon2': '0.278', 'WEAPON3': '1.500', 'weapon3': '3.480', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '69.000'} [2024-08-06 07:56:29,413][52820] Large shaping reward 2.598 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.024, -8.0), ('weapon5', 0.002)] [2024-08-06 07:56:29,747][52671] DAMAGECOUNT value on done: 929515.0 [2024-08-06 07:56:29,747][52671] Sum rewards: 66.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.670', 'AMMO2': '0.002', 'AMMO4': '0.012', 'AMMO3': '0.223', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '56.000'} [2024-08-06 07:56:31,113][52658] DAMAGECOUNT value on done: 911517.0 [2024-08-06 07:56:31,113][52658] Sum rewards: 84.857, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon7': '0.072', 'weapon5': '0.086', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'HEALTH': '0.100', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.159', 'WEAPON7': '0.200', 'weapon2': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.668', 'WEAPON3': '0.850', 'weapon3': '2.720', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:31,364][52647] DAMAGECOUNT value on done: 955772.0 [2024-08-06 07:56:31,364][52647] Sum rewards: 67.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.042', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '56.000'} [2024-08-06 07:56:31,582][52660] DAMAGECOUNT value on done: 907643.0 [2024-08-06 07:56:31,582][52660] Sum rewards: 86.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.794', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.170', 'AMMO4': '0.206', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.352', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.744', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '72.000'} [2024-08-06 07:56:31,727][52811] DAMAGECOUNT value on done: 856991.0 [2024-08-06 07:56:31,727][52811] Sum rewards: 72.982, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.120', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon5': '0.146', 'weapon4': '0.150', 'weapon2': '0.182', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.330', 'weapon3': '3.360', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:32,095][52669] DAMAGECOUNT value on done: 927209.0 [2024-08-06 07:56:32,097][52669] Sum rewards: 82.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.026', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.354', 'WEAPON3': '1.050', 'weapon3': '3.448', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:32,324][52671] DAMAGECOUNT value on done: 926126.0 [2024-08-06 07:56:32,324][52671] Sum rewards: 71.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.099', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO3': '0.223', 'AMMO4': '0.258', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '62.000'} [2024-08-06 07:56:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 658210816. Throughput: 0: 4375.3. Samples: 164552990. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:56:32,794][52567] Avg episode reward: [(0, '74.545')] [2024-08-06 07:56:34,030][52650] Updated weights for policy 0, policy_version 80351 (0.0021) [2024-08-06 07:56:34,035][52647] DAMAGECOUNT value on done: 963794.0 [2024-08-06 07:56:34,038][52647] Sum rewards: 70.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.765', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.172', 'weapon4': '0.178', 'weapon2': '0.180', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:34,184][52658] DAMAGECOUNT value on done: 924613.0 [2024-08-06 07:56:34,187][52658] Sum rewards: 78.755, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO4': '0.172', 'AMMO3': '0.178', 'weapon2': '0.190', 'weapon4': '0.210', 'weapon5': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:34,708][52811] DAMAGECOUNT value on done: 866043.0 [2024-08-06 07:56:34,709][52811] Sum rewards: 82.503, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.745', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.151', 'AMMO3': '0.252', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.322', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '70.000'} [2024-08-06 07:56:34,880][52669] DAMAGECOUNT value on done: 919171.0 [2024-08-06 07:56:34,882][52669] Sum rewards: 72.821, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.098', 'weapon5': '0.120', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON4': '0.250', 'AMMO3': '0.266', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:34,958][52664] DAMAGECOUNT value on done: 947202.0 [2024-08-06 07:56:34,961][52664] Sum rewards: 69.157, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.024', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.050', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.142', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'HITCOUNT': '2.990', 'weapon3': '3.548', 'DAMAGECOUNT': '15.435', 'FRAGCOUNT': '62.000'} [2024-08-06 07:56:35,141][52671] DAMAGECOUNT value on done: 928079.0 [2024-08-06 07:56:35,143][52671] Sum rewards: 81.198, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.019', 'HEALTH': '0.022', 'AMMO2': '0.052', 'AMMO3': '0.160', 'AMMO4': '0.261', 'weapon5': '0.302', 'weapon4': '0.324', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.622', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:36,418][52647] DAMAGECOUNT value on done: 955147.0 [2024-08-06 07:56:36,419][52647] Sum rewards: 61.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.082', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.482', 'WEAPON3': '1.100', 'HITCOUNT': '2.890', 'weapon3': '3.258', 'DAMAGECOUNT': '14.823', 'FRAGCOUNT': '50.000'} [2024-08-06 07:56:37,056][52658] DAMAGECOUNT value on done: 913809.0 [2024-08-06 07:56:37,058][52658] Sum rewards: 86.934, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.540', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO4': '0.192', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.853', 'FRAGCOUNT': '71.000'} [2024-08-06 07:56:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17522.5). Total num frames: 658309120. Throughput: 0: 4375.5. Samples: 164579240. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:56:37,795][52567] Avg episode reward: [(0, '74.714')] [2024-08-06 07:56:37,817][52664] DAMAGECOUNT value on done: 952653.0 [2024-08-06 07:56:37,818][52664] Sum rewards: 75.790, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.704', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.064', 'AMMO4': '0.149', 'AMMO3': '0.193', 'weapon5': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 07:56:38,026][52811] DAMAGECOUNT value on done: 869341.0 [2024-08-06 07:56:38,026][52811] Sum rewards: 84.596, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.202', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.058', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon4': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.853', 'FRAGCOUNT': '69.000'} [2024-08-06 07:56:38,199][52671] DAMAGECOUNT value on done: 934915.0 [2024-08-06 07:56:38,200][52671] Sum rewards: 85.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.962', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.174', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '70.500'} [2024-08-06 07:56:38,247][52669] DAMAGECOUNT value on done: 927879.0 [2024-08-06 07:56:38,249][52669] Sum rewards: 73.212, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.250', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.091', 'WEAPON5': '0.100', 'weapon4': '0.146', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.150', 'HITCOUNT': '3.410', 'weapon3': '3.488', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:38,834][52650] Updated weights for policy 0, policy_version 80361 (0.0047) [2024-08-06 07:56:39,109][52647] DAMAGECOUNT value on done: 959259.0 [2024-08-06 07:56:39,117][52647] Sum rewards: 84.133, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.088', 'AMMO3': '0.123', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.630', 'WEAPON3': '0.950', 'weapon3': '2.972', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '66.000'} [2024-08-06 07:56:39,353][52670] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:56:40,059][52664] DAMAGECOUNT value on done: 956789.0 [2024-08-06 07:56:40,060][52664] Sum rewards: 70.695, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.124', 'weapon5': '0.126', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.374', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:40,067][52803] DAMAGECOUNT value on done: 852693.0 [2024-08-06 07:56:40,067][52803] Sum rewards: 56.350, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon4': '0.108', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.402', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.174', 'DAMAGECOUNT': '14.361', 'FRAGCOUNT': '47.000'} [2024-08-06 07:56:40,212][52658] DAMAGECOUNT value on done: 939142.0 [2024-08-06 07:56:40,213][52658] Sum rewards: 59.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.350', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.122', 'weapon4': '0.164', 'AMMO3': '0.217', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.090', 'weapon3': '3.258', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '49.000'} [2024-08-06 07:56:40,866][52671] DAMAGECOUNT value on done: 920999.0 [2024-08-06 07:56:40,867][52671] Sum rewards: 74.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.596', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.056', 'AMMO4': '0.138', 'weapon5': '0.164', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:41,078][52811] DAMAGECOUNT value on done: 855846.0 [2024-08-06 07:56:41,080][52811] Sum rewards: 73.422, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.156', 'AMMO3': '0.164', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.766', 'WEAPON3': '1.050', 'weapon3': '2.726', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '58.000'} [2024-08-06 07:56:41,104][52669] DAMAGECOUNT value on done: 925696.0 [2024-08-06 07:56:41,105][52669] Sum rewards: 72.983, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.214', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO3': '0.227', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:42,514][52664] DAMAGECOUNT value on done: 946018.0 [2024-08-06 07:56:42,516][52664] Sum rewards: 77.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.220', 'WEAPON3': '1.450', 'weapon3': '3.490', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:42,710][52663] DAMAGECOUNT value on done: 936835.0 [2024-08-06 07:56:42,710][52658] DAMAGECOUNT value on done: 925320.0 [2024-08-06 07:56:42,713][52663] Sum rewards: 76.727, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.046', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.086', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.226', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:42,713][52658] Sum rewards: 71.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.828', 'AMMO5': '0.015', 'AMMO2': '0.054', 'AMMO3': '0.211', 'weapon5': '0.268', 'AMMO4': '0.270', 'weapon4': '0.274', 'weapon2': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 658382848. Throughput: 0: 4377.8. Samples: 164605310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:56:42,795][52567] Avg episode reward: [(0, '74.280')] [2024-08-06 07:56:43,133][52650] Updated weights for policy 0, policy_version 80371 (0.0019) [2024-08-06 07:56:43,181][52803] DAMAGECOUNT value on done: 852879.0 [2024-08-06 07:56:43,185][52803] Sum rewards: 71.304, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.410', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.174', 'weapon5': '0.216', 'weapon2': '0.238', 'WEAPON5': '0.350', 'weapon4': '0.426', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.000'} [2024-08-06 07:56:43,355][52794] DAMAGECOUNT value on done: 911033.0 [2024-08-06 07:56:43,356][52794] Sum rewards: 75.667, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.070', 'weapon5': '0.084', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.251', 'WEAPON3': '1.450', 'HITCOUNT': '3.360', 'weapon3': '3.464', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:43,796][52671] DAMAGECOUNT value on done: 924658.0 [2024-08-06 07:56:43,797][52671] Sum rewards: 76.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.158', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.180', 'weapon2': '0.208', 'weapon5': '0.312', 'AMMO4': '0.336', 'weapon4': '0.440', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:43,885][52669] DAMAGECOUNT value on done: 922522.0 [2024-08-06 07:56:43,885][52669] Sum rewards: 51.268, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.918', 'AMMO5': '0.030', 'AMMO2': '0.074', 'weapon4': '0.142', 'AMMO3': '0.287', 'weapon2': '0.292', 'weapon5': '0.334', 'AMMO4': '0.372', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.700', 'HITCOUNT': '2.470', 'weapon3': '2.808', 'DAMAGECOUNT': '14.427', 'FRAGCOUNT': '47.000'} [2024-08-06 07:56:44,172][52811] DAMAGECOUNT value on done: 854158.0 [2024-08-06 07:56:44,181][52811] Sum rewards: 77.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.152', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.184', 'weapon4': '0.202', 'AMMO3': '0.223', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:45,282][52663] DAMAGECOUNT value on done: 921491.0 [2024-08-06 07:56:45,282][52663] Sum rewards: 81.020, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.025', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.100', 'AMMO4': '0.126', 'AMMO3': '0.149', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.000', 'weapon3': '3.338', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:45,516][52664] DAMAGECOUNT value on done: 961260.0 [2024-08-06 07:56:45,516][52664] Sum rewards: 81.007, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.984', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon2': '0.204', 'AMMO4': '0.232', 'AMMO3': '0.234', 'weapon5': '0.262', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:45,923][52658] DAMAGECOUNT value on done: 932336.0 [2024-08-06 07:56:45,935][52658] Sum rewards: 77.202, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.165', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.132', 'weapon5': '0.146', 'AMMO3': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.896', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:46,235][52794] DAMAGECOUNT value on done: 924227.0 [2024-08-06 07:56:46,235][52794] Sum rewards: 78.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.738', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon4': '0.206', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.126', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:46,319][52803] DAMAGECOUNT value on done: 859568.0 [2024-08-06 07:56:46,320][52803] Sum rewards: 67.020, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.140', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.084', 'weapon4': '0.124', 'AMMO4': '0.169', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.654', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.276', 'FRAGCOUNT': '55.000'} [2024-08-06 07:56:46,797][52671] DAMAGECOUNT value on done: 927980.0 [2024-08-06 07:56:46,797][52671] Sum rewards: 78.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.080', 'weapon5': '0.190', 'AMMO3': '0.195', 'AMMO4': '0.291', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:46,868][52669] DAMAGECOUNT value on done: 920869.0 [2024-08-06 07:56:46,870][52669] Sum rewards: 79.923, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.018', 'AMMO5': '0.006', 'weapon4': '0.026', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.152', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.466', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:47,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 658472960. Throughput: 0: 4367.1. Samples: 164618280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:56:47,794][52567] Avg episode reward: [(0, '74.192')] [2024-08-06 07:56:47,966][52650] Updated weights for policy 0, policy_version 80381 (0.0019) [2024-08-06 07:56:48,201][52664] DAMAGECOUNT value on done: 956468.0 [2024-08-06 07:56:48,201][52664] Sum rewards: 85.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'AMMO5': '0.009', 'AMMO2': '0.050', 'weapon5': '0.106', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon4': '0.246', 'AMMO4': '0.251', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '68.000'} [2024-08-06 07:56:48,301][52663] DAMAGECOUNT value on done: 914964.0 [2024-08-06 07:56:48,303][52663] Sum rewards: 81.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.080', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon5': '0.064', 'weapon4': '0.090', 'AMMO4': '0.108', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.232', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:48,712][52658] DAMAGECOUNT value on done: 919599.0 [2024-08-06 07:56:48,712][52658] Sum rewards: 80.704, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.084', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'WEAPON5': '0.200', 'weapon5': '0.252', 'HEALTH': '0.324', 'weapon2': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.936', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:49,340][52614] Signal inference workers to stop experience collection... (14750 times) [2024-08-06 07:56:49,340][52614] Signal inference workers to resume experience collection... (14750 times) [2024-08-06 07:56:49,383][52650] InferenceWorker_p0-w0: stopping experience collection (14750 times) [2024-08-06 07:56:49,383][52650] InferenceWorker_p0-w0: resuming experience collection (14750 times) [2024-08-06 07:56:49,402][52794] DAMAGECOUNT value on done: 927857.0 [2024-08-06 07:56:49,402][52794] Sum rewards: 77.667, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.930', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.092', 'weapon4': '0.134', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.700', 'weapon3': '3.138', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:49,625][52803] DAMAGECOUNT value on done: 857922.0 [2024-08-06 07:56:49,625][52803] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.824', 'AMMO5': '0.021', 'AMMO2': '0.070', 'AMMO3': '0.215', 'weapon5': '0.242', 'weapon4': '0.264', 'AMMO4': '0.349', 'weapon2': '0.366', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.872', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 07:56:49,881][52671] DAMAGECOUNT value on done: 911024.0 [2024-08-06 07:56:49,884][52671] Sum rewards: 61.732, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.275', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon4': '0.112', 'weapon2': '0.262', 'AMMO3': '0.268', 'weapon5': '0.318', 'AMMO4': '0.347', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'HITCOUNT': '2.870', 'weapon3': '3.016', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '54.000'} [2024-08-06 07:56:49,920][52669] DAMAGECOUNT value on done: 932963.0 [2024-08-06 07:56:49,922][52669] Sum rewards: 79.070, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.890', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.026', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'weapon2': '0.502', 'WEAPON3': '0.950', 'weapon3': '3.292', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '62.000'} [2024-08-06 07:56:50,613][52664] DAMAGECOUNT value on done: 944468.0 [2024-08-06 07:56:50,614][52664] Sum rewards: 76.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.919', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.161', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:51,134][52658] DAMAGECOUNT value on done: 928918.0 [2024-08-06 07:56:51,137][52658] Sum rewards: 66.890, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.143', 'WEAPON4': '0.150', 'AMMO3': '0.158', 'weapon4': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '54.000'} [2024-08-06 07:56:51,169][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:56:51,283][52663] DAMAGECOUNT value on done: 921870.0 [2024-08-06 07:56:51,283][52663] Sum rewards: 83.721, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.052', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '69.000'} [2024-08-06 07:56:52,139][52794] DAMAGECOUNT value on done: 915654.0 [2024-08-06 07:56:52,139][52794] Sum rewards: 67.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '54.500'} [2024-08-06 07:56:52,413][52650] Updated weights for policy 0, policy_version 80391 (0.0035) [2024-08-06 07:56:52,794][52567] Fps is (10 sec: 18841.9, 60 sec: 17476.3, 300 sec: 17522.6). Total num frames: 658571264. Throughput: 0: 4363.1. Samples: 164644480. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:56:52,794][52567] Avg episode reward: [(0, '74.698')] [2024-08-06 07:56:52,891][52803] DAMAGECOUNT value on done: 854119.0 [2024-08-06 07:56:52,892][52803] Sum rewards: 74.853, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.935', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.188', 'weapon4': '0.468', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:52,914][52669] DAMAGECOUNT value on done: 923233.0 [2024-08-06 07:56:52,916][52669] Sum rewards: 75.249, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'HEALTH': '0.028', 'AMMO2': '0.033', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO4': '0.163', 'AMMO3': '0.184', 'weapon4': '0.262', 'WEAPON3': '1.050', 'weapon3': '3.320', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '60.000'} [2024-08-06 07:56:53,089][52671] DAMAGECOUNT value on done: 925953.0 [2024-08-06 07:56:53,091][52671] Sum rewards: 79.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.037', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.070', 'weapon5': '0.190', 'AMMO3': '0.193', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '65.000'} [2024-08-06 07:56:53,339][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:56:53,474][52664] DAMAGECOUNT value on done: 945881.0 [2024-08-06 07:56:53,475][52664] Sum rewards: 82.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.498', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.180', 'AMMO4': '0.222', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.580', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '69.000'} [2024-08-06 07:56:53,976][52658] DAMAGECOUNT value on done: 917426.0 [2024-08-06 07:56:53,979][52658] Sum rewards: 71.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.600', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.056', 'weapon5': '0.144', 'AMMO4': '0.181', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.668', 'WEAPON3': '1.100', 'weapon3': '2.864', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '59.000'} [2024-08-06 07:56:54,110][52663] DAMAGECOUNT value on done: 921041.0 [2024-08-06 07:56:54,111][52663] Sum rewards: 73.911, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.605', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.010', 'weapon5': '0.082', 'AMMO3': '0.122', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.594', 'weapon4': '0.640', 'WEAPON3': '0.850', 'weapon3': '2.532', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '58.000'} [2024-08-06 07:56:55,222][52794] DAMAGECOUNT value on done: 908424.0 [2024-08-06 07:56:55,222][52794] Sum rewards: 64.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.536', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.460', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2024-08-06 07:56:55,819][52669] DAMAGECOUNT value on done: 930492.0 [2024-08-06 07:56:55,820][52669] Sum rewards: 79.122, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.460', 'AMMO2': '0.001', 'AMMO4': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon4': '0.262', 'weapon2': '0.834', 'WEAPON3': '1.100', 'weapon3': '2.674', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:55,983][52803] DAMAGECOUNT value on done: 854929.0 [2024-08-06 07:56:55,983][52803] Sum rewards: 77.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.214', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '64.000'} [2024-08-06 07:56:56,015][52671] DAMAGECOUNT value on done: 924861.0 [2024-08-06 07:56:56,017][52671] Sum rewards: 72.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.975', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO4': '0.167', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '61.000'} [2024-08-06 07:56:56,362][52664] DAMAGECOUNT value on done: 955575.0 [2024-08-06 07:56:56,362][52664] Sum rewards: 80.955, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.078', 'AMMO4': '0.089', 'HEALTH': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.214', 'weapon2': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '66.000'} [2024-08-06 07:56:56,563][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:56:57,108][52658] DAMAGECOUNT value on done: 925923.0 [2024-08-06 07:56:57,111][52658] Sum rewards: 91.501, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.028', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '74.000'} [2024-08-06 07:56:57,315][52663] DAMAGECOUNT value on done: 926935.0 [2024-08-06 07:56:57,318][52663] Sum rewards: 64.607, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.225', 'AMMO5': '0.015', 'AMMO2': '0.065', 'weapon5': '0.094', 'weapon4': '0.134', 'AMMO3': '0.260', 'AMMO4': '0.323', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.148', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '57.000'} [2024-08-06 07:56:57,505][52650] Updated weights for policy 0, policy_version 80401 (0.0014) [2024-08-06 07:56:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 658644992. Throughput: 0: 4350.4. Samples: 164670400. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:56:57,795][52567] Avg episode reward: [(0, '74.567')] [2024-08-06 07:56:57,916][52794] DAMAGECOUNT value on done: 917043.0 [2024-08-06 07:56:57,916][52794] Sum rewards: 83.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.585', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.063', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '67.000'} [2024-08-06 07:56:58,752][52671] DAMAGECOUNT value on done: 922905.0 [2024-08-06 07:56:58,753][52671] Sum rewards: 86.278, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.094', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.207', 'WEAPON3': '1.250', 'weapon3': '3.486', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '70.000'} [2024-08-06 07:56:58,940][52669] DAMAGECOUNT value on done: 930261.0 [2024-08-06 07:56:58,940][52669] Sum rewards: 72.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.336', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.110', 'weapon4': '0.182', 'AMMO4': '0.200', 'weapon2': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.240', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:58,947][52664] DAMAGECOUNT value on done: 953708.0 [2024-08-06 07:56:58,947][52664] Sum rewards: 79.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.412', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.174', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.626', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 07:56:59,141][52803] DAMAGECOUNT value on done: 850597.0 [2024-08-06 07:56:59,143][52803] Sum rewards: 82.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.240', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.104', 'weapon5': '0.122', 'AMMO3': '0.175', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.478', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:00,331][52658] DAMAGECOUNT value on done: 907537.0 [2024-08-06 07:57:00,339][52658] Sum rewards: 65.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.526', 'ARMOR': '0.012', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon5': '0.190', 'AMMO3': '0.197', 'AMMO4': '0.243', 'weapon4': '0.364', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.622', 'WEAPON3': '1.150', 'weapon3': '2.578', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '53.000'} [2024-08-06 07:57:00,466][52794] DAMAGECOUNT value on done: 920156.0 [2024-08-06 07:57:00,466][52794] Sum rewards: 74.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'AMMO5': '0.011', 'weapon4': '0.042', 'AMMO2': '0.046', 'weapon5': '0.134', 'AMMO3': '0.209', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:00,612][52663] DAMAGECOUNT value on done: 918406.0 [2024-08-06 07:57:00,612][52663] Sum rewards: 81.516, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.014', 'AMMO4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:01,511][52664] DAMAGECOUNT value on done: 961007.0 [2024-08-06 07:57:01,524][52664] Sum rewards: 73.425, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.206', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.110', 'weapon4': '0.154', 'AMMO4': '0.204', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:01,540][52671] DAMAGECOUNT value on done: 926211.0 [2024-08-06 07:57:01,548][52671] Sum rewards: 79.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'weapon4': '0.068', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.414', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:01,880][52650] Updated weights for policy 0, policy_version 80411 (0.0034) [2024-08-06 07:57:02,243][52669] DAMAGECOUNT value on done: 917818.0 [2024-08-06 07:57:02,247][52669] Sum rewards: 79.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.468', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon2': '0.176', 'AMMO3': '0.235', 'WEAPON3': '1.400', 'weapon3': '3.674', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '66.000'} [2024-08-06 07:57:02,348][52803] DAMAGECOUNT value on done: 851040.0 [2024-08-06 07:57:02,349][52803] Sum rewards: 89.161, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon2': '0.174', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.522', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '75.000'} [2024-08-06 07:57:02,540][52660] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 07:57:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 658735104. Throughput: 0: 4345.3. Samples: 164683280. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:57:02,794][52567] Avg episode reward: [(0, '75.402')] [2024-08-06 07:57:03,222][52794] DAMAGECOUNT value on done: 908329.0 [2024-08-06 07:57:03,224][52794] Sum rewards: 78.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.550', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.054', 'weapon5': '0.144', 'AMMO3': '0.210', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:03,326][52658] DAMAGECOUNT value on done: 925488.0 [2024-08-06 07:57:03,327][52658] Sum rewards: 73.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.380', 'AMMO5': '0.014', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.092', 'weapon5': '0.102', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.000'} [2024-08-06 07:57:03,392][52663] DAMAGECOUNT value on done: 905268.0 [2024-08-06 07:57:03,392][52663] Sum rewards: 73.166, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.011', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon5': '0.216', 'AMMO4': '0.232', 'AMMO3': '0.236', 'weapon4': '0.242', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.690', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '63.500'} [2024-08-06 07:57:04,131][52671] DAMAGECOUNT value on done: 923808.0 [2024-08-06 07:57:04,132][52671] Sum rewards: 76.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.069', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.176', 'weapon2': '0.190', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.028', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '63.000'} [2024-08-06 07:57:04,757][52664] DAMAGECOUNT value on done: 958667.0 [2024-08-06 07:57:04,758][52664] Sum rewards: 66.875, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.549', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.094', 'weapon4': '0.136', 'AMMO3': '0.224', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:05,073][52669] DAMAGECOUNT value on done: 915757.0 [2024-08-06 07:57:05,073][52669] Sum rewards: 61.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.947', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.092', 'weapon2': '0.192', 'AMMO3': '0.199', 'weapon5': '0.246', 'AMMO4': '0.247', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.770', 'weapon3': '3.204', 'DAMAGECOUNT': '15.141', 'FRAGCOUNT': '51.000'} [2024-08-06 07:57:05,218][52803] DAMAGECOUNT value on done: 859501.0 [2024-08-06 07:57:05,219][52803] Sum rewards: 91.290, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.507', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.196', 'WEAPON3': '1.250', 'weapon3': '3.622', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '74.000'} [2024-08-06 07:57:06,271][52794] DAMAGECOUNT value on done: 922711.0 [2024-08-06 07:57:06,274][52794] Sum rewards: 65.113, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.264', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.310', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:06,288][52663] DAMAGECOUNT value on done: 917377.0 [2024-08-06 07:57:06,289][52663] Sum rewards: 78.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.003', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.220', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.482', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:06,408][52658] DAMAGECOUNT value on done: 918836.0 [2024-08-06 07:57:06,410][52658] Sum rewards: 79.779, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.990', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.082', 'weapon5': '0.146', 'AMMO4': '0.166', 'weapon2': '0.188', 'AMMO3': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.304', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.748', 'FRAGCOUNT': '69.000'} [2024-08-06 07:57:06,811][52671] DAMAGECOUNT value on done: 910153.0 [2024-08-06 07:57:06,811][52671] Sum rewards: 74.713, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.835', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.136', 'AMMO4': '0.181', 'AMMO3': '0.217', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.236', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:06,851][52650] Updated weights for policy 0, policy_version 80421 (0.0030) [2024-08-06 07:57:07,598][52664] DAMAGECOUNT value on done: 957638.0 [2024-08-06 07:57:07,599][52664] Sum rewards: 67.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.782', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.138', 'AMMO3': '0.227', 'weapon5': '0.230', 'AMMO4': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '55.000'} [2024-08-06 07:57:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 658817024. Throughput: 0: 4343.1. Samples: 164709450. Policy #0 lag: (min: 0.0, avg: 3.6, max: 9.0) [2024-08-06 07:57:07,795][52567] Avg episode reward: [(0, '75.432')] [2024-08-06 07:57:07,844][52669] DAMAGECOUNT value on done: 924382.0 [2024-08-06 07:57:07,845][52669] Sum rewards: 77.121, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.455', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.096', 'weapon5': '0.228', 'AMMO3': '0.254', 'weapon2': '0.272', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.080', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:08,475][52803] DAMAGECOUNT value on done: 852310.0 [2024-08-06 07:57:08,475][52803] Sum rewards: 71.019, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon2': '0.164', 'AMMO4': '0.226', 'AMMO3': '0.249', 'weapon5': '0.302', 'weapon4': '0.408', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.840', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:08,765][52820] DAMAGECOUNT value on done: 849472.0 [2024-08-06 07:57:08,766][52820] Sum rewards: 87.300, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.609', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.174', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.396', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '71.000'} [2024-08-06 07:57:09,096][52794] DAMAGECOUNT value on done: 916791.0 [2024-08-06 07:57:09,097][52794] Sum rewards: 81.748, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.395', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.099', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.242', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.727', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:09,215][52663] DAMAGECOUNT value on done: 916723.0 [2024-08-06 07:57:09,216][52663] Sum rewards: 76.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.044', 'AMMO4': '0.062', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '65.000'} [2024-08-06 07:57:09,426][52658] DAMAGECOUNT value on done: 913071.0 [2024-08-06 07:57:09,426][52658] Sum rewards: 76.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.715', 'ARMOR': '0.012', 'AMMO5': '0.016', 'AMMO2': '0.026', 'AMMO3': '0.124', 'weapon4': '0.124', 'AMMO4': '0.128', 'weapon5': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.650', 'WEAPON3': '0.850', 'weapon3': '2.862', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:09,720][52671] DAMAGECOUNT value on done: 934360.0 [2024-08-06 07:57:09,720][52671] Sum rewards: 82.897, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.106', 'weapon5': '0.118', 'AMMO4': '0.157', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.625', 'FRAGCOUNT': '68.000'} [2024-08-06 07:57:10,124][52664] DAMAGECOUNT value on done: 971103.0 [2024-08-06 07:57:10,124][52664] Sum rewards: 88.062, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.948', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.084', 'AMMO3': '0.171', 'weapon5': '0.216', 'weapon4': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '71.000'} [2024-08-06 07:57:10,623][52669] DAMAGECOUNT value on done: 945465.0 [2024-08-06 07:57:10,624][52669] Sum rewards: 73.947, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.055', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.130', 'weapon5': '0.148', 'AMMO4': '0.204', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '63.000'} [2024-08-06 07:57:11,592][52650] Updated weights for policy 0, policy_version 80431 (0.0015) [2024-08-06 07:57:11,666][52803] DAMAGECOUNT value on done: 866437.0 [2024-08-06 07:57:11,666][52803] Sum rewards: 84.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.925', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.090', 'weapon5': '0.096', 'AMMO4': '0.157', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:11,998][52820] DAMAGECOUNT value on done: 851515.0 [2024-08-06 07:57:12,001][52820] Sum rewards: 76.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.637', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '63.000'} [2024-08-06 07:57:12,009][52663] DAMAGECOUNT value on done: 925580.0 [2024-08-06 07:57:12,009][52663] Sum rewards: 63.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.328', 'AMMO5': '0.019', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.162', 'AMMO4': '0.184', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.088', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '55.000'} [2024-08-06 07:57:12,071][52794] DAMAGECOUNT value on done: 910716.0 [2024-08-06 07:57:12,072][52794] Sum rewards: 90.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.535', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.086', 'AMMO3': '0.169', 'AMMO4': '0.175', 'weapon5': '0.196', 'weapon2': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.270', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '22.395', 'FRAGCOUNT': '72.000'} [2024-08-06 07:57:12,408][52671] DAMAGECOUNT value on done: 933294.0 [2024-08-06 07:57:12,409][52671] Sum rewards: 74.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.685', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.096', 'AMMO4': '0.188', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:12,436][52658] DAMAGECOUNT value on done: 922666.0 [2024-08-06 07:57:12,437][52658] Sum rewards: 64.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.069', 'AMMO5': '0.023', 'AMMO2': '0.062', 'weapon4': '0.100', 'AMMO3': '0.177', 'weapon5': '0.242', 'AMMO4': '0.310', 'weapon2': '0.498', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '52.000'} [2024-08-06 07:57:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 658907136. Throughput: 0: 4346.9. Samples: 164735520. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:12,794][52567] Avg episode reward: [(0, '75.837')] [2024-08-06 07:57:13,282][52664] DAMAGECOUNT value on done: 965908.0 [2024-08-06 07:57:13,282][52664] Sum rewards: 71.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.035', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.040', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '59.000'} [2024-08-06 07:57:13,914][52669] DAMAGECOUNT value on done: 932673.0 [2024-08-06 07:57:13,915][52669] Sum rewards: 79.558, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'AMMO4': '0.116', 'weapon4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON3': '1.350', 'weapon3': '3.432', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '65.000'} [2024-08-06 07:57:14,629][52794] DAMAGECOUNT value on done: 924616.0 [2024-08-06 07:57:14,630][52794] Sum rewards: 94.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.578', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.090', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '23.322', 'FRAGCOUNT': '75.000'} [2024-08-06 07:57:14,838][52803] DAMAGECOUNT value on done: 860612.0 [2024-08-06 07:57:14,839][52803] Sum rewards: 90.635, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.235', 'AMMO5': '0.008', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.122', 'AMMO4': '0.157', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '3.198', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.982', 'FRAGCOUNT': '71.000'} [2024-08-06 07:57:15,128][52820] DAMAGECOUNT value on done: 852039.0 [2024-08-06 07:57:15,130][52820] Sum rewards: 82.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.136', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.098', 'AMMO3': '0.166', 'AMMO4': '0.242', 'weapon5': '0.280', 'weapon2': '0.366', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:15,151][52671] DAMAGECOUNT value on done: 924641.0 [2024-08-06 07:57:15,157][52671] Sum rewards: 74.084, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.435', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO3': '0.135', 'AMMO4': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.584', 'WEAPON3': '0.850', 'weapon3': '3.090', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:15,494][52663] DAMAGECOUNT value on done: 908754.0 [2024-08-06 07:57:15,494][52663] Sum rewards: 82.058, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.332', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon5': '0.158', 'AMMO3': '0.195', 'AMMO4': '0.218', 'weapon4': '0.224', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.772', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:15,876][52664] DAMAGECOUNT value on done: 964136.0 [2024-08-06 07:57:15,877][52664] Sum rewards: 78.175, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.086', 'weapon5': '0.088', 'AMMO4': '0.111', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 07:57:16,346][52650] Updated weights for policy 0, policy_version 80441 (0.0013) [2024-08-06 07:57:16,960][52794] DAMAGECOUNT value on done: 917526.0 [2024-08-06 07:57:16,970][52794] Sum rewards: 68.809, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.221', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.122', 'weapon5': '0.174', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '59.000'} [2024-08-06 07:57:16,973][52669] DAMAGECOUNT value on done: 928066.0 [2024-08-06 07:57:16,973][52669] Sum rewards: 80.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO2': '0.008', 'AMMO4': '0.038', 'AMMO3': '0.204', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.440', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '66.000'} [2024-08-06 07:57:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 658997248. Throughput: 0: 4348.0. Samples: 164748650. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:17,794][52567] Avg episode reward: [(0, '76.414')] [2024-08-06 07:57:17,920][52803] DAMAGECOUNT value on done: 851702.0 [2024-08-06 07:57:17,922][52803] Sum rewards: 68.757, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.202', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'weapon2': '0.236', 'AMMO3': '0.248', 'WEAPON3': '1.550', 'HITCOUNT': '3.470', 'weapon3': '3.530', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:18,138][52663] DAMAGECOUNT value on done: 905663.0 [2024-08-06 07:57:18,139][52663] Sum rewards: 77.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.860', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.172', 'weapon4': '0.206', 'AMMO4': '0.208', 'AMMO3': '0.228', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.928', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '66.000'} [2024-08-06 07:57:18,222][52671] DAMAGECOUNT value on done: 932958.0 [2024-08-06 07:57:18,223][52671] Sum rewards: 63.640, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.199', 'weapon5': '0.220', 'AMMO4': '0.234', 'weapon2': '0.246', 'weapon4': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '2.970', 'weapon3': '2.984', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '53.000'} [2024-08-06 07:57:18,314][52820] DAMAGECOUNT value on done: 841348.0 [2024-08-06 07:57:18,316][52820] Sum rewards: 78.907, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.128', 'AMMO3': '0.204', 'weapon5': '0.250', 'AMMO4': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '63.000'} [2024-08-06 07:57:18,630][52664] DAMAGECOUNT value on done: 948296.0 [2024-08-06 07:57:18,630][52664] Sum rewards: 70.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.144', 'AMMO4': '0.209', 'AMMO3': '0.253', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:19,732][52669] DAMAGECOUNT value on done: 934588.0 [2024-08-06 07:57:19,732][52669] Sum rewards: 82.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.016', 'AMMO2': '0.035', 'AMMO4': '0.172', 'AMMO3': '0.197', 'weapon5': '0.218', 'weapon4': '0.296', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.870', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:19,786][52794] DAMAGECOUNT value on done: 928943.0 [2024-08-06 07:57:19,788][52794] Sum rewards: 73.561, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.904', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.190', 'AMMO3': '0.200', 'AMMO4': '0.210', 'weapon4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:19,899][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:57:19,938][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:57:20,858][52650] Updated weights for policy 0, policy_version 80451 (0.0011) [2024-08-06 07:57:21,068][52663] DAMAGECOUNT value on done: 914782.0 [2024-08-06 07:57:21,068][52663] Sum rewards: 82.327, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.374', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.181', 'weapon2': '0.214', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.050', 'weapon3': '3.286', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '65.000'} [2024-08-06 07:57:21,072][52803] DAMAGECOUNT value on done: 868898.0 [2024-08-06 07:57:21,073][52803] Sum rewards: 90.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.520', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.358', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '75.000'} [2024-08-06 07:57:21,268][52671] DAMAGECOUNT value on done: 913752.0 [2024-08-06 07:57:21,268][52671] Sum rewards: 67.264, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.532', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.024', 'weapon4': '0.090', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.263', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.344', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '57.000'} [2024-08-06 07:57:21,277][52664] DAMAGECOUNT value on done: 950020.0 [2024-08-06 07:57:21,278][52664] Sum rewards: 63.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.376', 'AMMO5': '0.004', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.636', 'WEAPON3': '1.350', 'HITCOUNT': '2.890', 'weapon3': '3.176', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '54.000'} [2024-08-06 07:57:21,334][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:57:21,435][52820] DAMAGECOUNT value on done: 852700.0 [2024-08-06 07:57:21,436][52820] Sum rewards: 74.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.058', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.166', 'AMMO3': '0.183', 'weapon4': '0.200', 'AMMO4': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:22,674][52669] DAMAGECOUNT value on done: 935874.0 [2024-08-06 07:57:22,676][52669] Sum rewards: 91.919, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.515', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '22.146', 'FRAGCOUNT': '76.000'} [2024-08-06 07:57:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 659087360. Throughput: 0: 4351.6. Samples: 164775060. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:22,794][52567] Avg episode reward: [(0, '76.525')] [2024-08-06 07:57:22,904][52794] DAMAGECOUNT value on done: 911668.0 [2024-08-06 07:57:22,905][52794] Sum rewards: 85.738, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon2': '0.168', 'WEAPON3': '1.150', 'weapon3': '3.650', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '69.000'} [2024-08-06 07:57:24,031][52664] DAMAGECOUNT value on done: 959981.0 [2024-08-06 07:57:24,033][52664] Sum rewards: 90.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.535', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.200', 'AMMO3': '0.205', 'weapon5': '0.224', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.519', 'FRAGCOUNT': '73.000'} [2024-08-06 07:57:24,170][52803] DAMAGECOUNT value on done: 852485.0 [2024-08-06 07:57:24,170][52803] Sum rewards: 69.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.351', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.124', 'AMMO4': '0.173', 'weapon2': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON3': '1.700', 'weapon3': '3.386', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:24,188][52663] DAMAGECOUNT value on done: 917409.0 [2024-08-06 07:57:24,188][52663] Sum rewards: 75.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.234', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.040', 'weapon5': '0.154', 'AMMO4': '0.158', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.130', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:24,699][52820] DAMAGECOUNT value on done: 839963.0 [2024-08-06 07:57:24,701][52820] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.460', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.090', 'AMMO3': '0.144', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.620', 'WEAPON3': '0.850', 'weapon3': '2.976', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '59.000'} [2024-08-06 07:57:25,073][52660] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:57:25,588][52650] Updated weights for policy 0, policy_version 80461 (0.0035) [2024-08-06 07:57:25,726][52670] DAMAGECOUNT value on done: 904336.0 [2024-08-06 07:57:25,726][52670] Sum rewards: 63.683, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.310', 'AMMO5': '0.013', 'AMMO2': '0.019', 'WEAPON1': '0.020', 'weapon4': '0.044', 'AMMO4': '0.093', 'weapon5': '0.098', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.286', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '55.000'} [2024-08-06 07:57:26,062][52794] DAMAGECOUNT value on done: 922971.0 [2024-08-06 07:57:26,062][52794] Sum rewards: 65.503, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.374', 'AMMO5': '0.011', 'AMMO2': '0.050', 'AMMO3': '0.139', 'weapon5': '0.182', 'AMMO4': '0.252', 'weapon4': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.512', 'WEAPON3': '0.900', 'weapon3': '2.674', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.390', 'FRAGCOUNT': '50.000'} [2024-08-06 07:57:26,705][52664] DAMAGECOUNT value on done: 948318.0 [2024-08-06 07:57:26,706][52664] Sum rewards: 61.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.782', 'AMMO5': '0.027', 'AMMO2': '0.075', 'weapon4': '0.128', 'AMMO3': '0.218', 'weapon5': '0.258', 'weapon2': '0.312', 'AMMO4': '0.374', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '51.500'} [2024-08-06 07:57:27,245][52663] DAMAGECOUNT value on done: 921525.0 [2024-08-06 07:57:27,246][52663] Sum rewards: 74.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.100', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.352', 'WEAPON3': '1.650', 'weapon3': '3.368', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '63.000'} [2024-08-06 07:57:27,393][52803] DAMAGECOUNT value on done: 860704.0 [2024-08-06 07:57:27,395][52803] Sum rewards: 81.863, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.957', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.196', 'weapon5': '0.202', 'AMMO3': '0.228', 'weapon2': '0.234', 'weapon4': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '69.000'} [2024-08-06 07:57:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 659169280. Throughput: 0: 4350.5. Samples: 164801080. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:27,794][52567] Avg episode reward: [(0, '76.551')] [2024-08-06 07:57:27,857][52820] DAMAGECOUNT value on done: 846186.0 [2024-08-06 07:57:27,859][52820] Sum rewards: 71.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.382', 'AMMO5': '0.005', 'weapon4': '0.022', 'AMMO2': '0.039', 'weapon5': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.320', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '59.000'} [2024-08-06 07:57:28,133][52670] DAMAGECOUNT value on done: 922782.0 [2024-08-06 07:57:28,133][52670] Sum rewards: 78.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.646', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.120', 'weapon5': '0.132', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.236', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:29,220][52794] DAMAGECOUNT value on done: 921597.0 [2024-08-06 07:57:29,223][52794] Sum rewards: 80.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.038', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.132', 'AMMO3': '0.178', 'weapon5': '0.178', 'AMMO4': '0.255', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.662', 'WEAPON3': '1.000', 'weapon3': '2.764', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:30,100][52650] Updated weights for policy 0, policy_version 80471 (0.0011) [2024-08-06 07:57:30,244][52663] DAMAGECOUNT value on done: 918984.0 [2024-08-06 07:57:30,244][52663] Sum rewards: 78.587, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.618', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.128', 'weapon5': '0.158', 'AMMO4': '0.195', 'AMMO3': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.052', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '68.000'} [2024-08-06 07:57:30,383][52803] DAMAGECOUNT value on done: 862149.0 [2024-08-06 07:57:30,383][52803] Sum rewards: 71.164, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.164', 'weapon2': '0.222', 'AMMO3': '0.226', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'weapon4': '0.510', 'WEAPON3': '1.400', 'weapon3': '2.818', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:30,718][52670] DAMAGECOUNT value on done: 906886.0 [2024-08-06 07:57:30,721][52670] Sum rewards: 76.729, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.105', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.193', 'weapon2': '0.338', 'WEAPON3': '1.050', 'weapon3': '3.344', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '61.500'} [2024-08-06 07:57:31,058][52795] DAMAGECOUNT value on done: 848348.0 [2024-08-06 07:57:31,059][52795] Sum rewards: 51.606, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.592', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.142', 'weapon5': '0.146', 'AMMO3': '0.147', 'AMMO4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.320', 'WEAPON3': '0.900', 'HITCOUNT': '2.540', 'weapon3': '3.166', 'DAMAGECOUNT': '13.011', 'FRAGCOUNT': '40.000'} [2024-08-06 07:57:31,088][52820] DAMAGECOUNT value on done: 849754.0 [2024-08-06 07:57:31,090][52820] Sum rewards: 68.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.600', 'AMMO5': '0.006', 'weapon4': '0.020', 'AMMO2': '0.027', 'weapon5': '0.114', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:32,291][52666] DAMAGECOUNT value on done: 917206.0 [2024-08-06 07:57:32,292][52666] Sum rewards: 68.067, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.066', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.220', 'weapon5': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.180', 'weapon3': '3.264', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:32,507][52794] DAMAGECOUNT value on done: 924354.0 [2024-08-06 07:57:32,507][52794] Sum rewards: 70.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.126', 'AMMO4': '0.221', 'AMMO3': '0.231', 'weapon2': '0.234', 'weapon5': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.144', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '59.000'} [2024-08-06 07:57:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.3). Total num frames: 659251200. Throughput: 0: 4359.1. Samples: 164814440. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:32,802][52567] Avg episode reward: [(0, '76.126')] [2024-08-06 07:57:32,971][52663] DAMAGECOUNT value on done: 922422.0 [2024-08-06 07:57:32,971][52663] Sum rewards: 71.581, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.585', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.032', 'weapon5': '0.082', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.218', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:33,491][52803] DAMAGECOUNT value on done: 868461.0 [2024-08-06 07:57:33,491][52803] Sum rewards: 81.200, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.322', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '69.000'} [2024-08-06 07:57:33,701][52670] DAMAGECOUNT value on done: 908649.0 [2024-08-06 07:57:33,702][52670] Sum rewards: 67.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.465', 'AMMO5': '0.018', 'AMMO2': '0.067', 'weapon4': '0.088', 'AMMO3': '0.194', 'weapon5': '0.194', 'AMMO4': '0.334', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'HITCOUNT': '2.890', 'weapon3': '3.082', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:34,143][52795] DAMAGECOUNT value on done: 838163.0 [2024-08-06 07:57:34,143][52795] Sum rewards: 77.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.822', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '65.500'} [2024-08-06 07:57:34,188][52820] DAMAGECOUNT value on done: 855405.0 [2024-08-06 07:57:34,188][52820] Sum rewards: 72.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.320', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.088', 'AMMO3': '0.208', 'AMMO4': '0.224', 'weapon5': '0.274', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '58.000'} [2024-08-06 07:57:34,885][52650] Updated weights for policy 0, policy_version 80481 (0.0030) [2024-08-06 07:57:35,312][52794] DAMAGECOUNT value on done: 934791.0 [2024-08-06 07:57:35,314][52794] Sum rewards: 73.934, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.381', 'AMMO5': '0.023', 'AMMO2': '0.058', 'weapon4': '0.168', 'AMMO3': '0.251', 'weapon5': '0.282', 'AMMO4': '0.289', 'weapon2': '0.388', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.792', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '20.424', 'FRAGCOUNT': '63.000'} [2024-08-06 07:57:35,410][52666] DAMAGECOUNT value on done: 915586.0 [2024-08-06 07:57:35,411][52666] Sum rewards: 77.144, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.040', 'HEALTH': '0.140', 'weapon5': '0.188', 'AMMO4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.358', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '2.766', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:36,084][52663] DAMAGECOUNT value on done: 928871.0 [2024-08-06 07:57:36,084][52663] Sum rewards: 76.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.734', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.350', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.302', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:36,356][52803] DAMAGECOUNT value on done: 866199.0 [2024-08-06 07:57:36,359][52803] Sum rewards: 82.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.874', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.068', 'AMMO4': '0.130', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '69.000'} [2024-08-06 07:57:36,765][52670] DAMAGECOUNT value on done: 921921.0 [2024-08-06 07:57:36,766][52670] Sum rewards: 82.410, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.812', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO4': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'weapon2': '0.310', 'WEAPON3': '1.750', 'weapon3': '3.348', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '71.000'} [2024-08-06 07:57:37,369][52820] DAMAGECOUNT value on done: 862957.0 [2024-08-06 07:57:37,372][52820] Sum rewards: 77.989, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.042', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.178', 'AMMO3': '0.316', 'WEAPON3': '1.850', 'weapon3': '3.502', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '68.000'} [2024-08-06 07:57:37,395][52795] DAMAGECOUNT value on done: 844256.0 [2024-08-06 07:57:37,399][52795] Sum rewards: 71.295, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.686', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.058', 'weapon5': '0.158', 'AMMO4': '0.186', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.650', 'weapon3': '3.042', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:37,687][52665] DAMAGECOUNT value on done: 908346.0 [2024-08-06 07:57:37,688][52665] Sum rewards: 74.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.782', 'AMMO5': '0.018', 'AMMO2': '0.080', 'weapon5': '0.208', 'AMMO3': '0.214', 'weapon2': '0.248', 'weapon4': '0.390', 'AMMO4': '0.398', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17494.8). Total num frames: 659349504. Throughput: 0: 4356.2. Samples: 164840510. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:37,794][52567] Avg episode reward: [(0, '76.249')] [2024-08-06 07:57:38,274][52666] DAMAGECOUNT value on done: 922909.0 [2024-08-06 07:57:38,274][52666] Sum rewards: 76.807, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.744', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.074', 'weapon2': '0.208', 'weapon5': '0.218', 'AMMO4': '0.245', 'AMMO3': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.234', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '65.000'} [2024-08-06 07:57:38,381][52794] DAMAGECOUNT value on done: 923922.0 [2024-08-06 07:57:38,384][52794] Sum rewards: 70.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.271', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.084', 'weapon4': '0.132', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '57.000'} [2024-08-06 07:57:39,127][52663] DAMAGECOUNT value on done: 910182.0 [2024-08-06 07:57:39,127][52663] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.280', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon2': '0.260', 'AMMO3': '0.297', 'WEAPON3': '1.800', 'HITCOUNT': '3.340', 'weapon3': '3.554', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:39,421][52803] DAMAGECOUNT value on done: 861393.0 [2024-08-06 07:57:39,424][52803] Sum rewards: 63.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.189', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.226', 'weapon2': '0.456', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.382', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '54.000'} [2024-08-06 07:57:39,622][52650] Updated weights for policy 0, policy_version 80491 (0.0011) [2024-08-06 07:57:39,628][52670] DAMAGECOUNT value on done: 910289.0 [2024-08-06 07:57:39,628][52670] Sum rewards: 68.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.222', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.132', 'weapon2': '0.184', 'AMMO3': '0.203', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.500', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '57.000'} [2024-08-06 07:57:40,504][52820] DAMAGECOUNT value on done: 845302.0 [2024-08-06 07:57:40,506][52820] Sum rewards: 67.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.082', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.136', 'AMMO3': '0.168', 'weapon5': '0.170', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.438', 'WEAPON3': '0.950', 'weapon3': '2.938', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.648', 'FRAGCOUNT': '55.000'} [2024-08-06 07:57:40,584][52795] DAMAGECOUNT value on done: 857080.0 [2024-08-06 07:57:40,586][52795] Sum rewards: 87.625, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.824', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.096', 'AMMO4': '0.119', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.306', 'weapon2': '0.352', 'WEAPON3': '0.850', 'weapon3': '3.042', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '68.000'} [2024-08-06 07:57:40,673][52665] DAMAGECOUNT value on done: 919754.0 [2024-08-06 07:57:40,673][52665] Sum rewards: 81.086, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.490', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.164', 'weapon5': '0.198', 'weapon4': '0.244', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.990', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '65.000'} [2024-08-06 07:57:40,981][52666] DAMAGECOUNT value on done: 915994.0 [2024-08-06 07:57:40,981][52666] Sum rewards: 79.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.009', 'weapon4': '0.046', 'AMMO2': '0.047', 'weapon5': '0.148', 'AMMO3': '0.198', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '66.000'} [2024-08-06 07:57:41,522][52649] DAMAGECOUNT value on done: 891839.0 [2024-08-06 07:57:41,523][52649] Sum rewards: 77.925, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.180', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.176', 'WEAPON4': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:42,047][52670] DAMAGECOUNT value on done: 905715.0 [2024-08-06 07:57:42,048][52670] Sum rewards: 94.478, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.156', 'weapon4': '0.158', 'weapon5': '0.204', 'WEAPON4': '0.250', 'HEALTH': '0.296', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '0.900', 'weapon3': '2.892', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.868', 'FRAGCOUNT': '76.000'} [2024-08-06 07:57:42,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 659439616. Throughput: 0: 4358.2. Samples: 164866520. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:42,802][52567] Avg episode reward: [(0, '76.046')] [2024-08-06 07:57:43,206][52667] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('HEALTH', -0.045, -15.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:57:43,646][52820] DAMAGECOUNT value on done: 854671.0 [2024-08-06 07:57:43,647][52820] Sum rewards: 73.093, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.062', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.184', 'AMMO3': '0.241', 'HEALTH': '0.360', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:43,727][52795] DAMAGECOUNT value on done: 841697.0 [2024-08-06 07:57:43,728][52795] Sum rewards: 69.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.477', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.108', 'weapon5': '0.116', 'AMMO4': '0.125', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.050', 'HITCOUNT': '3.060', 'weapon3': '3.146', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '55.000'} [2024-08-06 07:57:43,741][52666] DAMAGECOUNT value on done: 911165.0 [2024-08-06 07:57:43,742][52665] DAMAGECOUNT value on done: 912971.0 [2024-08-06 07:57:43,743][52665] Sum rewards: 92.182, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.072', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.274', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.348', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '23.088', 'FRAGCOUNT': '76.000'} [2024-08-06 07:57:43,742][52666] Sum rewards: 78.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.575', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.116', 'AMMO4': '0.127', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:44,293][52650] Updated weights for policy 0, policy_version 80501 (0.0010) [2024-08-06 07:57:44,385][52649] DAMAGECOUNT value on done: 887873.0 [2024-08-06 07:57:44,385][52649] Sum rewards: 76.220, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.272', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.160', 'AMMO4': '0.180', 'weapon5': '0.206', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:45,204][52670] DAMAGECOUNT value on done: 907607.0 [2024-08-06 07:57:45,205][52670] Sum rewards: 77.698, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.758', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.149', 'weapon5': '0.170', 'weapon2': '0.238', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '66.000'} [2024-08-06 07:57:46,359][52665] DAMAGECOUNT value on done: 914440.0 [2024-08-06 07:57:46,361][52665] Sum rewards: 83.523, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.355', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.052', 'AMMO4': '0.066', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.282', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.402', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '68.000'} [2024-08-06 07:57:46,698][52820] DAMAGECOUNT value on done: 866812.0 [2024-08-06 07:57:46,699][52820] Sum rewards: 68.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.795', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon4': '0.138', 'weapon5': '0.164', 'AMMO3': '0.197', 'AMMO4': '0.342', 'weapon2': '0.538', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.884', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '58.000'} [2024-08-06 07:57:46,770][52666] DAMAGECOUNT value on done: 915691.0 [2024-08-06 07:57:46,770][52666] Sum rewards: 83.068, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.700', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.101', 'weapon5': '0.130', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.250', 'weapon3': '3.466', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '68.000'} [2024-08-06 07:57:46,891][52795] DAMAGECOUNT value on done: 846944.0 [2024-08-06 07:57:46,895][52795] Sum rewards: 72.314, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.515', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.101', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:47,269][52649] DAMAGECOUNT value on done: 902461.0 [2024-08-06 07:57:47,269][52649] Sum rewards: 64.282, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.218', 'AMMO5': '0.022', 'AMMO2': '0.041', 'weapon4': '0.146', 'AMMO4': '0.204', 'AMMO3': '0.249', 'weapon5': '0.338', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.798', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '55.000'} [2024-08-06 07:57:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 659521536. Throughput: 0: 4371.1. Samples: 164879980. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:47,802][52567] Avg episode reward: [(0, '75.972')] [2024-08-06 07:57:48,193][52670] DAMAGECOUNT value on done: 909243.0 [2024-08-06 07:57:48,195][52670] Sum rewards: 72.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.018', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.102', 'AMMO4': '0.175', 'weapon5': '0.206', 'AMMO3': '0.208', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.206', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:48,927][52650] Updated weights for policy 0, policy_version 80511 (0.0025) [2024-08-06 07:57:49,400][52665] DAMAGECOUNT value on done: 896169.0 [2024-08-06 07:57:49,400][52665] Sum rewards: 79.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.182', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.406', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '65.000'} [2024-08-06 07:57:49,870][52820] DAMAGECOUNT value on done: 856613.0 [2024-08-06 07:57:49,870][52820] Sum rewards: 74.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.730', 'AMMO5': '0.022', 'AMMO2': '0.073', 'weapon4': '0.194', 'AMMO3': '0.251', 'weapon5': '0.324', 'AMMO4': '0.367', 'weapon2': '0.384', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.704', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:49,922][52666] DAMAGECOUNT value on done: 912345.0 [2024-08-06 07:57:49,927][52666] Sum rewards: 72.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'weapon4': '0.026', 'AMMO2': '0.031', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.153', 'AMMO3': '0.211', 'weapon2': '0.278', 'WEAPON3': '1.250', 'HITCOUNT': '3.400', 'weapon3': '3.464', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:50,138][52795] DAMAGECOUNT value on done: 856307.0 [2024-08-06 07:57:50,138][52795] Sum rewards: 71.595, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.722', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:50,330][52649] DAMAGECOUNT value on done: 901982.0 [2024-08-06 07:57:50,331][52649] Sum rewards: 85.172, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.851', 'AMMO5': '0.017', 'AMMO2': '0.068', 'weapon4': '0.104', 'AMMO3': '0.229', 'weapon5': '0.272', 'AMMO4': '0.341', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.928', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '21.402', 'FRAGCOUNT': '68.000'} [2024-08-06 07:57:51,123][52670] DAMAGECOUNT value on done: 904191.0 [2024-08-06 07:57:51,123][52670] Sum rewards: 65.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.064', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.096', 'AMMO4': '0.146', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.100', 'HITCOUNT': '2.960', 'weapon3': '3.346', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '55.000'} [2024-08-06 07:57:52,035][52665] DAMAGECOUNT value on done: 900573.0 [2024-08-06 07:57:52,035][52665] Sum rewards: 80.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.314', 'WEAPON3': '1.250', 'weapon3': '3.358', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:52,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17203.1, 300 sec: 17467.0). Total num frames: 659603456. Throughput: 0: 4373.1. Samples: 164906240. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:52,795][52567] Avg episode reward: [(0, '76.049')] [2024-08-06 07:57:52,811][52666] DAMAGECOUNT value on done: 909192.0 [2024-08-06 07:57:52,811][52666] Sum rewards: 65.034, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.777', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.085', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.293', 'weapon2': '0.394', 'WEAPON3': '1.750', 'weapon3': '3.250', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '58.000'} [2024-08-06 07:57:53,014][52649] DAMAGECOUNT value on done: 893541.0 [2024-08-06 07:57:53,015][52649] Sum rewards: 80.510, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.872', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon4': '0.128', 'weapon5': '0.158', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.728', 'WEAPON3': '1.500', 'weapon3': '2.682', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '69.000'} [2024-08-06 07:57:53,037][52820] DAMAGECOUNT value on done: 857152.0 [2024-08-06 07:57:53,042][52820] Sum rewards: 78.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.229', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.392', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '66.000'} [2024-08-06 07:57:53,250][52795] DAMAGECOUNT value on done: 848530.0 [2024-08-06 07:57:53,250][52795] Sum rewards: 76.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.029', 'AMMO2': '0.050', 'weapon5': '0.160', 'weapon4': '0.168', 'AMMO3': '0.210', 'AMMO4': '0.249', 'weapon2': '0.382', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '64.000'} [2024-08-06 07:57:53,605][52650] Updated weights for policy 0, policy_version 80521 (0.0020) [2024-08-06 07:57:54,014][52670] DAMAGECOUNT value on done: 918705.0 [2024-08-06 07:57:54,015][52670] Sum rewards: 73.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.229', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.136', 'AMMO3': '0.211', 'AMMO4': '0.231', 'weapon5': '0.232', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '2.858', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:54,698][52794] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 07:57:55,132][52668] DAMAGECOUNT value on done: 927763.0 [2024-08-06 07:57:55,143][52668] Sum rewards: 74.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.092', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:55,236][52665] DAMAGECOUNT value on done: 908767.0 [2024-08-06 07:57:55,238][52665] Sum rewards: 72.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.306', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.098', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.198', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '60.000'} [2024-08-06 07:57:55,637][52666] DAMAGECOUNT value on done: 919951.0 [2024-08-06 07:57:55,640][52666] Sum rewards: 80.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.532', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '67.000'} [2024-08-06 07:57:56,027][52820] DAMAGECOUNT value on done: 852620.0 [2024-08-06 07:57:56,029][52820] Sum rewards: 71.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.082', 'AMMO4': '0.188', 'AMMO3': '0.231', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 07:57:56,249][52649] DAMAGECOUNT value on done: 901516.0 [2024-08-06 07:57:56,250][52649] Sum rewards: 69.829, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.060', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon2': '0.634', 'WEAPON3': '0.950', 'weapon3': '3.104', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:56,426][52795] DAMAGECOUNT value on done: 851358.0 [2024-08-06 07:57:56,428][52795] Sum rewards: 67.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.066', 'weapon5': '0.184', 'AMMO3': '0.193', 'AMMO4': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.930', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.849', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:57,037][52670] DAMAGECOUNT value on done: 902133.0 [2024-08-06 07:57:57,038][52670] Sum rewards: 73.844, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.076', 'AMMO4': '0.193', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '60.500'} [2024-08-06 07:57:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 659701760. Throughput: 0: 4376.0. Samples: 164932440. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:57:57,794][52567] Avg episode reward: [(0, '75.370')] [2024-08-06 07:57:58,008][52668] DAMAGECOUNT value on done: 928366.0 [2024-08-06 07:57:58,009][52668] Sum rewards: 71.706, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.060', 'weapon5': '0.116', 'AMMO4': '0.239', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '3.162', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '62.000'} [2024-08-06 07:57:58,392][52650] Updated weights for policy 0, policy_version 80531 (0.0018) [2024-08-06 07:57:58,505][52666] DAMAGECOUNT value on done: 912169.0 [2024-08-06 07:57:58,505][52666] Sum rewards: 72.424, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.286', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.096', 'weapon4': '0.144', 'AMMO4': '0.147', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.246', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '59.000'} [2024-08-06 07:57:58,576][52665] DAMAGECOUNT value on done: 910282.0 [2024-08-06 07:57:58,577][52665] Sum rewards: 81.693, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.265', 'AMMO5': '0.009', 'weapon4': '0.032', 'AMMO2': '0.046', 'weapon5': '0.116', 'AMMO3': '0.172', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.394', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '66.000'} [2024-08-06 07:57:59,113][52820] DAMAGECOUNT value on done: 856991.0 [2024-08-06 07:57:59,114][52820] Sum rewards: 85.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.228', 'WEAPON3': '1.500', 'weapon3': '3.436', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '70.000'} [2024-08-06 07:57:59,556][52670] DAMAGECOUNT value on done: 917173.0 [2024-08-06 07:57:59,558][52670] Sum rewards: 69.520, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.555', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.104', 'weapon5': '0.134', 'AMMO3': '0.155', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.124', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '56.000'} [2024-08-06 07:57:59,789][52649] DAMAGECOUNT value on done: 898875.0 [2024-08-06 07:57:59,789][52649] Sum rewards: 76.499, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.916', 'AMMO5': '0.018', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.164', 'weapon2': '0.182', 'weapon5': '0.184', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '63.000'} [2024-08-06 07:57:59,856][52795] DAMAGECOUNT value on done: 858270.0 [2024-08-06 07:57:59,859][52795] Sum rewards: 91.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.725', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'weapon5': '0.056', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.416', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.348', 'FRAGCOUNT': '74.000'} [2024-08-06 07:58:00,875][52668] DAMAGECOUNT value on done: 925178.0 [2024-08-06 07:58:00,876][52668] Sum rewards: 74.644, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.252', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.094', 'AMMO4': '0.218', 'AMMO3': '0.261', 'weapon5': '0.268', 'weapon2': '0.312', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.998', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:00,941][52666] DAMAGECOUNT value on done: 917294.0 [2024-08-06 07:58:00,943][52666] Sum rewards: 78.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.282', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.144', 'AMMO3': '0.202', 'AMMO4': '0.220', 'weapon4': '0.256', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.696', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:01,792][52665] DAMAGECOUNT value on done: 914938.0 [2024-08-06 07:58:01,794][52665] Sum rewards: 71.592, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.120', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.092', 'weapon5': '0.192', 'AMMO4': '0.219', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.600', 'weapon3': '2.986', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:02,096][52820] DAMAGECOUNT value on done: 862982.0 [2024-08-06 07:58:02,097][52820] Sum rewards: 67.087, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.950', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.070', 'weapon5': '0.162', 'AMMO4': '0.194', 'AMMO3': '0.274', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '2.970', 'weapon3': '3.132', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '62.000'} [2024-08-06 07:58:02,237][52670] DAMAGECOUNT value on done: 921459.0 [2024-08-06 07:58:02,238][52670] Sum rewards: 91.004, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.018', 'AMMO4': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'weapon2': '0.708', 'WEAPON3': '1.000', 'weapon3': '3.076', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '73.000'} [2024-08-06 07:58:02,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 659783680. Throughput: 0: 4382.7. Samples: 164945870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:02,802][52567] Avg episode reward: [(0, '75.276')] [2024-08-06 07:58:02,899][52649] DAMAGECOUNT value on done: 901960.0 [2024-08-06 07:58:02,899][52649] Sum rewards: 79.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.108', 'AMMO4': '0.153', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '67.000'} [2024-08-06 07:58:02,988][52795] DAMAGECOUNT value on done: 852524.0 [2024-08-06 07:58:02,990][52795] Sum rewards: 90.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.368', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.040', 'AMMO4': '0.060', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.964', 'FRAGCOUNT': '74.000'} [2024-08-06 07:58:03,027][52650] Updated weights for policy 0, policy_version 80541 (0.0024) [2024-08-06 07:58:03,657][52666] DAMAGECOUNT value on done: 901859.0 [2024-08-06 07:58:03,659][52666] Sum rewards: 84.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.090', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '70.000'} [2024-08-06 07:58:03,836][52668] DAMAGECOUNT value on done: 927502.0 [2024-08-06 07:58:03,837][52668] Sum rewards: 79.069, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.870', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.042', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:04,845][52665] DAMAGECOUNT value on done: 906338.0 [2024-08-06 07:58:04,846][52665] Sum rewards: 69.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.444', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'AMMO3': '0.218', 'weapon2': '0.582', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '58.000'} [2024-08-06 07:58:04,960][52670] DAMAGECOUNT value on done: 915375.0 [2024-08-06 07:58:04,961][52670] Sum rewards: 83.747, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.088', 'AMMO5': '0.010', 'weapon4': '0.042', 'AMMO2': '0.065', 'weapon5': '0.120', 'weapon2': '0.246', 'WEAPON5': '0.300', 'AMMO3': '0.316', 'AMMO4': '0.326', 'WEAPON4': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.330', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.990', 'FRAGCOUNT': '72.000'} [2024-08-06 07:58:05,157][52820] DAMAGECOUNT value on done: 862101.0 [2024-08-06 07:58:05,157][52820] Sum rewards: 83.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.197', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '69.000'} [2024-08-06 07:58:05,859][52649] DAMAGECOUNT value on done: 897383.0 [2024-08-06 07:58:05,860][52649] Sum rewards: 72.118, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.344', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.046', 'weapon5': '0.096', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.650', 'HITCOUNT': '3.120', 'weapon3': '3.204', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:06,065][52795] DAMAGECOUNT value on done: 841797.0 [2024-08-06 07:58:06,065][52795] Sum rewards: 66.365, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.053', 'AMMO5': '0.024', 'AMMO2': '0.043', 'weapon4': '0.078', 'AMMO3': '0.213', 'AMMO4': '0.215', 'weapon5': '0.222', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '56.500'} [2024-08-06 07:58:06,207][52668] DAMAGECOUNT value on done: 914827.0 [2024-08-06 07:58:06,208][52668] Sum rewards: 71.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.670', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.096', 'weapon5': '0.124', 'AMMO3': '0.175', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '3.092', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:06,239][52666] DAMAGECOUNT value on done: 923272.0 [2024-08-06 07:58:06,239][52666] Sum rewards: 77.721, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.097', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.098', 'weapon5': '0.154', 'weapon2': '0.196', 'AMMO4': '0.249', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.312', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '67.000'} [2024-08-06 07:58:07,383][52670] DAMAGECOUNT value on done: 897471.0 [2024-08-06 07:58:07,383][52670] Sum rewards: 73.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.076', 'AMMO5': '0.008', 'weapon4': '0.048', 'AMMO2': '0.053', 'weapon5': '0.106', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'AMMO4': '0.266', 'weapon2': '0.274', 'WEAPON3': '1.650', 'HITCOUNT': '3.290', 'weapon3': '3.332', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '62.000'} [2024-08-06 07:58:07,712][52650] Updated weights for policy 0, policy_version 80551 (0.0022) [2024-08-06 07:58:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 659873792. Throughput: 0: 4367.1. Samples: 164971580. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:07,802][52567] Avg episode reward: [(0, '75.650')] [2024-08-06 07:58:07,840][52665] DAMAGECOUNT value on done: 922889.0 [2024-08-06 07:58:07,841][52665] Sum rewards: 72.879, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.060', 'AMMO3': '0.141', 'AMMO4': '0.158', 'weapon5': '0.166', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.586', 'WEAPON3': '0.950', 'weapon3': '2.998', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '57.000'} [2024-08-06 07:58:08,178][52820] DAMAGECOUNT value on done: 848926.0 [2024-08-06 07:58:08,180][52820] Sum rewards: 76.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.660', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon4': '0.126', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.268', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:08,905][52666] DAMAGECOUNT value on done: 916129.0 [2024-08-06 07:58:08,906][52666] Sum rewards: 76.356, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.172', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.234', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.406', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:08,987][52649] DAMAGECOUNT value on done: 892709.0 [2024-08-06 07:58:08,988][52649] Sum rewards: 73.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.130', 'weapon4': '0.152', 'WEAPON5': '0.200', 'AMMO4': '0.203', 'weapon2': '0.234', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.256', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.442', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:09,176][52668] DAMAGECOUNT value on done: 923937.0 [2024-08-06 07:58:09,177][52668] Sum rewards: 86.824, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.043', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.178', 'AMMO4': '0.228', 'weapon4': '0.228', 'weapon2': '0.288', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.014', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.727', 'FRAGCOUNT': '74.000'} [2024-08-06 07:58:09,243][52795] DAMAGECOUNT value on done: 849838.0 [2024-08-06 07:58:09,243][52795] Sum rewards: 62.436, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.985', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.137', 'AMMO4': '0.164', 'weapon5': '0.172', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.368', 'weapon2': '0.742', 'WEAPON3': '0.900', 'weapon3': '2.522', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '14.463', 'FRAGCOUNT': '50.000'} [2024-08-06 07:58:09,956][52670] DAMAGECOUNT value on done: 913144.0 [2024-08-06 07:58:09,956][52670] Sum rewards: 82.505, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.118', 'AMMO4': '0.148', 'weapon2': '0.178', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.398', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '71.000'} [2024-08-06 07:58:10,928][52665] DAMAGECOUNT value on done: 914182.0 [2024-08-06 07:58:10,929][52665] Sum rewards: 86.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.104', 'AMMO4': '0.194', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.290', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.174', 'FRAGCOUNT': '73.000'} [2024-08-06 07:58:11,314][52666] DAMAGECOUNT value on done: 916992.0 [2024-08-06 07:58:11,316][52666] Sum rewards: 88.268, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.794', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.068', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '73.000'} [2024-08-06 07:58:12,189][52649] DAMAGECOUNT value on done: 907234.0 [2024-08-06 07:58:12,191][52649] Sum rewards: 85.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.009', 'AMMO2': '0.048', 'weapon5': '0.116', 'AMMO3': '0.162', 'weapon4': '0.182', 'AMMO4': '0.238', 'weapon2': '0.298', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.196', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '69.500'} [2024-08-06 07:58:12,254][52668] DAMAGECOUNT value on done: 924402.0 [2024-08-06 07:58:12,255][52668] Sum rewards: 78.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.178', 'AMMO4': '0.202', 'weapon4': '0.228', 'AMMO3': '0.239', 'weapon2': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:12,374][52650] Updated weights for policy 0, policy_version 80561 (0.0028) [2024-08-06 07:58:12,384][52670] DAMAGECOUNT value on done: 921194.0 [2024-08-06 07:58:12,385][52670] Sum rewards: 79.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.100', 'weapon4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.370', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '68.000'} [2024-08-06 07:58:12,542][52795] DAMAGECOUNT value on done: 855617.0 [2024-08-06 07:58:12,542][52795] Sum rewards: 73.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.040', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.298', 'WEAPON3': '1.300', 'HITCOUNT': '3.390', 'weapon3': '3.434', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '62.000'} [2024-08-06 07:58:12,623][52662] DAMAGECOUNT value on done: 920905.0 [2024-08-06 07:58:12,623][52662] Sum rewards: 80.937, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.154', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.178', 'weapon5': '0.186', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.398', 'WEAPON3': '1.050', 'weapon3': '2.944', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '62.500'} [2024-08-06 07:58:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 659963904. Throughput: 0: 4378.0. Samples: 164998090. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:12,794][52567] Avg episode reward: [(0, '76.032')] [2024-08-06 07:58:13,406][52667] DAMAGECOUNT value on done: 920119.0 [2024-08-06 07:58:13,407][52667] Sum rewards: 75.076, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.490', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.068', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.292', 'WEAPON3': '1.400', 'weapon3': '3.400', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '61.000'} [2024-08-06 07:58:14,150][52666] DAMAGECOUNT value on done: 908812.0 [2024-08-06 07:58:14,150][52666] Sum rewards: 68.651, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.314', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO4': '0.132', 'weapon5': '0.164', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '56.000'} [2024-08-06 07:58:14,227][52665] DAMAGECOUNT value on done: 912421.0 [2024-08-06 07:58:14,227][52665] Sum rewards: 86.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.111', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.226', 'WEAPON3': '1.150', 'weapon3': '3.452', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '71.000'} [2024-08-06 07:58:14,856][52668] DAMAGECOUNT value on done: 916233.0 [2024-08-06 07:58:14,857][52668] Sum rewards: 86.961, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.568', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.140', 'weapon5': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.381', 'FRAGCOUNT': '72.000'} [2024-08-06 07:58:15,227][52649] DAMAGECOUNT value on done: 913873.0 [2024-08-06 07:58:15,228][52649] Sum rewards: 91.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.242', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon4': '0.202', 'AMMO3': '0.210', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '75.000'} [2024-08-06 07:58:15,330][52670] DAMAGECOUNT value on done: 916180.0 [2024-08-06 07:58:15,330][52670] Sum rewards: 80.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.124', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.211', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.468', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:15,715][52795] DAMAGECOUNT value on done: 843989.0 [2024-08-06 07:58:15,718][52795] Sum rewards: 71.759, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.423', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.130', 'weapon4': '0.164', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '58.000'} [2024-08-06 07:58:15,729][52662] DAMAGECOUNT value on done: 929298.0 [2024-08-06 07:58:15,729][52662] Sum rewards: 60.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.883', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.172', 'weapon4': '0.222', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.004', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '53.000'} [2024-08-06 07:58:16,015][52667] DAMAGECOUNT value on done: 935118.0 [2024-08-06 07:58:16,015][52667] Sum rewards: 70.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.132', 'AMMO3': '0.214', 'weapon2': '0.220', 'AMMO4': '0.261', 'weapon5': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:16,844][52666] DAMAGECOUNT value on done: 908640.0 [2024-08-06 07:58:16,845][52666] Sum rewards: 70.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.658', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.050', 'AMMO4': '0.136', 'weapon5': '0.156', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:17,165][52665] DAMAGECOUNT value on done: 913043.0 [2024-08-06 07:58:17,165][52665] Sum rewards: 48.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.660', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.164', 'AMMO4': '0.206', 'weapon5': '0.266', 'AMMO3': '0.294', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '2.420', 'weapon3': '2.942', 'DAMAGECOUNT': '13.557', 'FRAGCOUNT': '44.000'} [2024-08-06 07:58:17,292][52650] Updated weights for policy 0, policy_version 80571 (0.0015) [2024-08-06 07:58:17,487][52668] DAMAGECOUNT value on done: 919492.0 [2024-08-06 07:58:17,487][52668] Sum rewards: 71.620, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.162', 'AMMO3': '0.183', 'weapon5': '0.212', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '56.500'} [2024-08-06 07:58:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 660045824. Throughput: 0: 4369.6. Samples: 165011070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:17,794][52567] Avg episode reward: [(0, '76.287')] [2024-08-06 07:58:17,947][52670] DAMAGECOUNT value on done: 917278.0 [2024-08-06 07:58:17,947][52670] Sum rewards: 90.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.730', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.171', 'weapon5': '0.186', 'weapon2': '0.192', 'AMMO3': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '22.035', 'FRAGCOUNT': '73.000'} [2024-08-06 07:58:18,384][52649] DAMAGECOUNT value on done: 904743.0 [2024-08-06 07:58:18,386][52649] Sum rewards: 68.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.213', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.272', 'WEAPON5': '0.300', 'weapon2': '0.396', 'weapon4': '0.404', 'WEAPON3': '1.600', 'weapon3': '2.790', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:18,782][52795] DAMAGECOUNT value on done: 852008.0 [2024-08-06 07:58:18,784][52795] Sum rewards: 73.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.198', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.111', 'weapon5': '0.132', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.050', 'HITCOUNT': '3.120', 'weapon3': '3.240', 'DAMAGECOUNT': '16.647', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:18,891][52662] DAMAGECOUNT value on done: 928498.0 [2024-08-06 07:58:18,893][52662] Sum rewards: 66.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.794', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'weapon4': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.282', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.336', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '55.000'} [2024-08-06 07:58:19,030][52667] DAMAGECOUNT value on done: 929070.0 [2024-08-06 07:58:19,030][52667] Sum rewards: 66.458, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'AMMO5': '0.014', 'weapon4': '0.056', 'AMMO2': '0.060', 'weapon5': '0.128', 'AMMO3': '0.138', 'AMMO4': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.642', 'WEAPON3': '0.950', 'weapon3': '2.962', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '53.000'} [2024-08-06 07:58:19,553][52666] DAMAGECOUNT value on done: 927818.0 [2024-08-06 07:58:19,553][52666] Sum rewards: 78.660, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.219', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:19,822][52665] DAMAGECOUNT value on done: 908561.0 [2024-08-06 07:58:19,823][52665] Sum rewards: 69.578, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.145', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.076', 'weapon5': '0.164', 'AMMO3': '0.226', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:20,000][52668] DAMAGECOUNT value on done: 927038.0 [2024-08-06 07:58:20,000][52668] Sum rewards: 75.661, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.305', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'AMMO3': '0.323', 'weapon2': '0.418', 'WEAPON3': '1.900', 'weapon3': '3.378', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '68.000'} [2024-08-06 07:58:20,109][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:58:20,963][52649] DAMAGECOUNT value on done: 903656.0 [2024-08-06 07:58:20,966][52649] Sum rewards: 66.624, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.116', 'weapon5': '0.128', 'AMMO4': '0.202', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.814', 'WEAPON3': '1.350', 'weapon3': '2.688', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '56.000'} [2024-08-06 07:58:21,555][52650] Updated weights for policy 0, policy_version 80581 (0.0019) [2024-08-06 07:58:21,858][52667] DAMAGECOUNT value on done: 934020.0 [2024-08-06 07:58:21,858][52795] DAMAGECOUNT value on done: 851905.0 [2024-08-06 07:58:21,858][52667] Sum rewards: 72.520, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.950', 'AMMO5': '0.020', 'AMMO2': '0.051', 'weapon4': '0.200', 'AMMO4': '0.257', 'AMMO3': '0.260', 'weapon2': '0.300', 'weapon5': '0.376', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.550', 'weapon3': '2.756', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '60.000'} [2024-08-06 07:58:21,858][52795] Sum rewards: 79.761, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.862', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.088', 'weapon2': '0.172', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.256', 'WEAPON3': '1.150', 'weapon3': '3.302', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:22,081][52662] DAMAGECOUNT value on done: 917805.0 [2024-08-06 07:58:22,082][52662] Sum rewards: 77.896, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.180', 'AMMO4': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.370', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:22,083][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:58:22,583][52665] DAMAGECOUNT value on done: 913607.0 [2024-08-06 07:58:22,584][52665] Sum rewards: 67.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.383', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon2': '0.186', 'AMMO3': '0.205', 'weapon5': '0.256', 'AMMO4': '0.286', 'weapon4': '0.428', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.912', 'FRAGCOUNT': '55.000'} [2024-08-06 07:58:22,666][52666] DAMAGECOUNT value on done: 900978.0 [2024-08-06 07:58:22,667][52666] Sum rewards: 69.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.715', 'AMMO5': '0.023', 'AMMO2': '0.063', 'weapon4': '0.130', 'AMMO3': '0.166', 'AMMO4': '0.313', 'weapon5': '0.356', 'weapon2': '0.548', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.700', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '55.000'} [2024-08-06 07:58:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 660135936. Throughput: 0: 4376.4. Samples: 165037450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:22,794][52567] Avg episode reward: [(0, '76.208')] [2024-08-06 07:58:23,173][52668] DAMAGECOUNT value on done: 920973.0 [2024-08-06 07:58:23,175][52668] Sum rewards: 78.161, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.128', 'AMMO4': '0.144', 'weapon5': '0.166', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:23,745][52649] DAMAGECOUNT value on done: 892549.0 [2024-08-06 07:58:23,746][52649] Sum rewards: 71.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.074', 'AMMO2': '0.042', 'AMMO4': '0.208', 'AMMO3': '0.230', 'weapon2': '0.312', 'WEAPON3': '1.300', 'HITCOUNT': '3.390', 'weapon3': '3.516', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '60.000'} [2024-08-06 07:58:24,367][52667] DAMAGECOUNT value on done: 935400.0 [2024-08-06 07:58:24,368][52667] Sum rewards: 74.326, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.084', 'AMMO4': '0.138', 'AMMO3': '0.199', 'weapon5': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.349', 'FRAGCOUNT': '62.000'} [2024-08-06 07:58:24,750][52662] DAMAGECOUNT value on done: 936109.0 [2024-08-06 07:58:24,750][52662] Sum rewards: 71.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.292', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.042', 'AMMO4': '0.045', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '58.000'} [2024-08-06 07:58:25,168][52795] DAMAGECOUNT value on done: 839595.0 [2024-08-06 07:58:25,170][52795] Sum rewards: 70.682, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.190', 'AMMO3': '0.210', 'weapon2': '0.248', 'weapon4': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '58.000'} [2024-08-06 07:58:25,638][52665] DAMAGECOUNT value on done: 913238.0 [2024-08-06 07:58:25,639][52665] Sum rewards: 62.163, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.436', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.062', 'AMMO3': '0.168', 'AMMO4': '0.185', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '0.950', 'HITCOUNT': '2.860', 'weapon3': '3.148', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '50.000'} [2024-08-06 07:58:25,750][52666] DAMAGECOUNT value on done: 913240.0 [2024-08-06 07:58:25,750][52666] Sum rewards: 81.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.880', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO4': '0.141', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '67.000'} [2024-08-06 07:58:26,026][52668] DAMAGECOUNT value on done: 915396.0 [2024-08-06 07:58:26,029][52668] Sum rewards: 78.296, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.687', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.128', 'weapon5': '0.208', 'weapon2': '0.212', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:26,609][52650] Updated weights for policy 0, policy_version 80591 (0.0024) [2024-08-06 07:58:26,736][52667] DAMAGECOUNT value on done: 934555.0 [2024-08-06 07:58:26,736][52667] Sum rewards: 72.125, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.502', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.120', 'AMMO4': '0.148', 'weapon5': '0.152', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:27,066][52649] DAMAGECOUNT value on done: 905160.0 [2024-08-06 07:58:27,067][52649] Sum rewards: 89.413, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.506', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.390', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.976', 'FRAGCOUNT': '75.000'} [2024-08-06 07:58:27,623][52811] Large shaping reward -2.513 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.264, -88.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:58:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 660226048. Throughput: 0: 4378.2. Samples: 165063540. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:27,794][52567] Avg episode reward: [(0, '75.608')] [2024-08-06 07:58:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080594_660226048.pth... [2024-08-06 07:58:27,876][52662] DAMAGECOUNT value on done: 910791.0 [2024-08-06 07:58:27,877][52662] Sum rewards: 78.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.529', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon4': '0.222', 'weapon2': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:27,947][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080082_656031744.pth [2024-08-06 07:58:28,328][52795] DAMAGECOUNT value on done: 849800.0 [2024-08-06 07:58:28,329][52795] Sum rewards: 79.458, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.350', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.120', 'weapon5': '0.176', 'AMMO4': '0.225', 'WEAPON5': '0.300', 'AMMO3': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.850', 'weapon3': '2.934', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '21.339', 'FRAGCOUNT': '68.000'} [2024-08-06 07:58:28,844][52665] DAMAGECOUNT value on done: 904148.0 [2024-08-06 07:58:28,844][52665] Sum rewards: 76.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'weapon5': '0.028', 'AMMO4': '0.037', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.223', 'weapon2': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:29,194][52667] DAMAGECOUNT value on done: 927426.0 [2024-08-06 07:58:29,195][52667] Sum rewards: 75.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.146', 'AMMO3': '0.206', 'weapon2': '0.234', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'weapon4': '0.492', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '61.000'} [2024-08-06 07:58:29,206][52668] DAMAGECOUNT value on done: 911821.0 [2024-08-06 07:58:29,207][52668] Sum rewards: 74.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.129', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.178', 'AMMO3': '0.212', 'weapon2': '0.268', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.374', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '61.000'} [2024-08-06 07:58:29,933][52649] DAMAGECOUNT value on done: 885437.0 [2024-08-06 07:58:29,935][52649] Sum rewards: 84.955, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.158', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.148', 'weapon5': '0.178', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.116', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '71.000'} [2024-08-06 07:58:30,508][52662] DAMAGECOUNT value on done: 918985.0 [2024-08-06 07:58:30,509][52662] Sum rewards: 75.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.488', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.156', 'weapon5': '0.172', 'AMMO3': '0.204', 'AMMO4': '0.218', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '61.000'} [2024-08-06 07:58:30,785][52650] Updated weights for policy 0, policy_version 80601 (0.0013) [2024-08-06 07:58:31,477][52795] DAMAGECOUNT value on done: 858025.0 [2024-08-06 07:58:31,478][52795] Sum rewards: 82.759, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.300', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.108', 'weapon5': '0.190', 'AMMO3': '0.225', 'AMMO4': '0.290', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.850', 'FRAGCOUNT': '68.000'} [2024-08-06 07:58:31,683][52668] DAMAGECOUNT value on done: 910093.0 [2024-08-06 07:58:31,685][52668] Sum rewards: 68.694, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.080', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.120', 'AMMO3': '0.128', 'AMMO4': '0.205', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON3': '0.800', 'weapon3': '3.042', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '52.000'} [2024-08-06 07:58:31,746][52665] DAMAGECOUNT value on done: 907273.0 [2024-08-06 07:58:31,747][52665] Sum rewards: 69.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.665', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.144', 'AMMO4': '0.191', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.260', 'weapon4': '0.298', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '57.000'} [2024-08-06 07:58:31,900][52667] DAMAGECOUNT value on done: 923475.0 [2024-08-06 07:58:31,901][52667] Sum rewards: 68.767, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.662', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.022', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon5': '0.154', 'weapon2': '0.504', 'WEAPON3': '0.950', 'HITCOUNT': '3.080', 'weapon3': '3.092', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '54.000'} [2024-08-06 07:58:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 660307968. Throughput: 0: 4366.4. Samples: 165076470. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:32,794][52567] Avg episode reward: [(0, '75.746')] [2024-08-06 07:58:33,072][52649] DAMAGECOUNT value on done: 906860.0 [2024-08-06 07:58:33,072][52649] Sum rewards: 68.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.095', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.282', 'WEAPON3': '1.350', 'HITCOUNT': '3.080', 'weapon3': '3.298', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '57.000'} [2024-08-06 07:58:33,515][52662] DAMAGECOUNT value on done: 935579.0 [2024-08-06 07:58:33,515][52662] Sum rewards: 78.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.008', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.098', 'AMMO4': '0.128', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:33,926][52659] DAMAGECOUNT value on done: 925427.0 [2024-08-06 07:58:33,926][52659] Sum rewards: 81.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon4': '0.174', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '66.000'} [2024-08-06 07:58:34,538][52668] DAMAGECOUNT value on done: 904854.0 [2024-08-06 07:58:34,539][52668] Sum rewards: 80.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.695', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.152', 'weapon4': '0.172', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.208', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '66.000'} [2024-08-06 07:58:34,734][52665] DAMAGECOUNT value on done: 913941.0 [2024-08-06 07:58:34,734][52665] Sum rewards: 70.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.598', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.142', 'AMMO4': '0.168', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '58.000'} [2024-08-06 07:58:34,843][52667] DAMAGECOUNT value on done: 926952.0 [2024-08-06 07:58:34,845][52667] Sum rewards: 68.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.734', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.088', 'AMMO3': '0.179', 'weapon5': '0.218', 'AMMO4': '0.235', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.654', 'WEAPON3': '1.050', 'weapon3': '2.716', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '56.000'} [2024-08-06 07:58:35,846][52649] DAMAGECOUNT value on done: 907515.0 [2024-08-06 07:58:35,846][52649] Sum rewards: 79.556, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.248', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.120', 'AMMO3': '0.214', 'AMMO4': '0.220', 'weapon5': '0.224', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '66.000'} [2024-08-06 07:58:35,915][52662] DAMAGECOUNT value on done: 923323.0 [2024-08-06 07:58:35,915][52662] Sum rewards: 80.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.014', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.082', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:35,964][52650] Updated weights for policy 0, policy_version 80611 (0.0039) [2024-08-06 07:58:37,207][52659] DAMAGECOUNT value on done: 922197.0 [2024-08-06 07:58:37,207][52659] Sum rewards: 83.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon5': '0.184', 'weapon4': '0.204', 'AMMO3': '0.223', 'AMMO4': '0.235', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.008', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '68.000'} [2024-08-06 07:58:37,374][52668] DAMAGECOUNT value on done: 920169.0 [2024-08-06 07:58:37,375][52668] Sum rewards: 71.034, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.070', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon4': '0.338', 'weapon2': '0.618', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '58.000'} [2024-08-06 07:58:37,592][52667] DAMAGECOUNT value on done: 933810.0 [2024-08-06 07:58:37,593][52667] Sum rewards: 74.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.440', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.092', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.350', 'weapon3': '3.086', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 660398080. Throughput: 0: 4368.0. Samples: 165102800. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:37,794][52567] Avg episode reward: [(0, '75.759')] [2024-08-06 07:58:38,898][52649] DAMAGECOUNT value on done: 898865.0 [2024-08-06 07:58:38,898][52649] Sum rewards: 75.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.154', 'AMMO3': '0.199', 'weapon5': '0.224', 'AMMO4': '0.249', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.914', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '61.000'} [2024-08-06 07:58:38,945][52662] DAMAGECOUNT value on done: 928669.0 [2024-08-06 07:58:38,945][52662] Sum rewards: 73.203, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.825', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.136', 'weapon5': '0.212', 'AMMO4': '0.224', 'AMMO3': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.400', 'weapon3': '2.878', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '60.000'} [2024-08-06 07:58:40,114][52667] DAMAGECOUNT value on done: 922410.0 [2024-08-06 07:58:40,115][52667] Sum rewards: 91.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO3': '0.199', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.472', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.594', 'FRAGCOUNT': '74.000'} [2024-08-06 07:58:40,322][52659] DAMAGECOUNT value on done: 933173.0 [2024-08-06 07:58:40,322][52659] Sum rewards: 76.975, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.394', 'AMMO5': '0.026', 'AMMO2': '0.078', 'AMMO3': '0.193', 'weapon5': '0.266', 'weapon2': '0.292', 'weapon4': '0.324', 'AMMO4': '0.391', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:40,376][52650] Updated weights for policy 0, policy_version 80621 (0.0013) [2024-08-06 07:58:40,534][52668] DAMAGECOUNT value on done: 922381.0 [2024-08-06 07:58:40,536][52668] Sum rewards: 70.118, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.290', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon2': '0.410', 'WEAPON3': '1.600', 'weapon3': '3.252', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '60.000'} [2024-08-06 07:58:41,903][52662] DAMAGECOUNT value on done: 921881.0 [2024-08-06 07:58:41,904][52662] Sum rewards: 68.278, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.854', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.124', 'AMMO4': '0.140', 'weapon5': '0.208', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '56.000'} [2024-08-06 07:58:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 660488192. Throughput: 0: 4370.7. Samples: 165129120. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:42,794][52567] Avg episode reward: [(0, '76.042')] [2024-08-06 07:58:43,059][52659] DAMAGECOUNT value on done: 926252.0 [2024-08-06 07:58:43,060][52659] Sum rewards: 80.501, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.440', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '68.000'} [2024-08-06 07:58:43,188][52667] DAMAGECOUNT value on done: 923789.0 [2024-08-06 07:58:43,188][52667] Sum rewards: 70.332, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.954', 'AMMO5': '0.021', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.148', 'weapon5': '0.190', 'AMMO3': '0.251', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.188', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '60.000'} [2024-08-06 07:58:43,556][52668] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:58:43,638][52668] DAMAGECOUNT value on done: 922047.0 [2024-08-06 07:58:43,638][52668] Sum rewards: 71.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.102', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.156', 'AMMO4': '0.212', 'weapon5': '0.218', 'AMMO3': '0.219', 'weapon2': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:44,671][52662] DAMAGECOUNT value on done: 921846.0 [2024-08-06 07:58:44,671][52662] Sum rewards: 77.096, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.180', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.080', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.176', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '66.000'} [2024-08-06 07:58:45,051][52650] Updated weights for policy 0, policy_version 80631 (0.0024) [2024-08-06 07:58:45,604][52659] DAMAGECOUNT value on done: 920781.0 [2024-08-06 07:58:45,606][52659] Sum rewards: 73.917, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.684', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.372', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.364', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '61.000'} [2024-08-06 07:58:46,090][52660] DAMAGECOUNT value on done: 918541.0 [2024-08-06 07:58:46,091][52660] Sum rewards: 69.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.592', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.130', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'AMMO4': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '2.922', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '56.000'} [2024-08-06 07:58:46,288][52667] DAMAGECOUNT value on done: 932312.0 [2024-08-06 07:58:46,290][52667] Sum rewards: 65.354, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.092', 'HEALTH': '0.116', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'weapon2': '0.558', 'WEAPON3': '0.950', 'weapon3': '3.106', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '51.000'} [2024-08-06 07:58:46,776][52647] DAMAGECOUNT value on done: 984930.0 [2024-08-06 07:58:46,776][52647] Sum rewards: 87.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.536', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.080', 'weapon5': '0.130', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.573', 'FRAGCOUNT': '69.000'} [2024-08-06 07:58:46,854][52668] DAMAGECOUNT value on done: 922593.0 [2024-08-06 07:58:46,854][52668] Sum rewards: 64.821, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.682', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'AMMO3': '0.155', 'AMMO4': '0.165', 'weapon4': '0.204', 'weapon5': '0.206', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '54.000'} [2024-08-06 07:58:47,611][52662] DAMAGECOUNT value on done: 915782.0 [2024-08-06 07:58:47,613][52662] Sum rewards: 74.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.770', 'AMMO5': '0.022', 'AMMO2': '0.054', 'weapon4': '0.084', 'AMMO3': '0.246', 'weapon5': '0.250', 'AMMO4': '0.272', 'weapon2': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '3.134', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 07:58:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 660570112. Throughput: 0: 4363.5. Samples: 165142230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 07:58:47,794][52567] Avg episode reward: [(0, '75.518')] [2024-08-06 07:58:48,558][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:58:48,607][52659] DAMAGECOUNT value on done: 924326.0 [2024-08-06 07:58:48,607][52659] Sum rewards: 69.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.946', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.130', 'AMMO3': '0.262', 'weapon4': '0.276', 'AMMO4': '0.287', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.500', 'weapon3': '2.768', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:49,177][52660] DAMAGECOUNT value on done: 911022.0 [2024-08-06 07:58:49,180][52660] Sum rewards: 83.470, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.428', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.100', 'weapon4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.162', 'FRAGCOUNT': '67.000'} [2024-08-06 07:58:49,308][52667] DAMAGECOUNT value on done: 923864.0 [2024-08-06 07:58:49,309][52667] Sum rewards: 69.742, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.621', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon5': '0.184', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '56.000'} [2024-08-06 07:58:49,455][52647] DAMAGECOUNT value on done: 970403.0 [2024-08-06 07:58:49,456][52647] Sum rewards: 70.441, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.293', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.154', 'AMMO4': '0.177', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '58.500'} [2024-08-06 07:58:49,924][52650] Updated weights for policy 0, policy_version 80641 (0.0011) [2024-08-06 07:58:49,927][52668] DAMAGECOUNT value on done: 927601.0 [2024-08-06 07:58:49,933][52668] Sum rewards: 77.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon5': '0.128', 'AMMO3': '0.186', 'weapon4': '0.200', 'AMMO4': '0.214', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:50,305][52662] DAMAGECOUNT value on done: 924519.0 [2024-08-06 07:58:50,305][52662] Sum rewards: 70.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.229', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.121', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.366', 'WEAPON3': '1.400', 'weapon3': '3.142', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '60.000'} [2024-08-06 07:58:51,369][52659] DAMAGECOUNT value on done: 925723.0 [2024-08-06 07:58:51,372][52659] Sum rewards: 77.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.891', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.164', 'weapon5': '0.198', 'weapon2': '0.286', 'weapon4': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.964', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '61.000'} [2024-08-06 07:58:51,914][52647] DAMAGECOUNT value on done: 977447.0 [2024-08-06 07:58:51,916][52647] Sum rewards: 64.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.176', 'AMMO4': '0.222', 'weapon2': '0.230', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.260', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '54.000'} [2024-08-06 07:58:52,129][52667] DAMAGECOUNT value on done: 929345.0 [2024-08-06 07:58:52,132][52667] Sum rewards: 82.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.245', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.167', 'weapon5': '0.168', 'AMMO3': '0.203', 'weapon4': '0.232', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '67.000'} [2024-08-06 07:58:52,370][52660] DAMAGECOUNT value on done: 922726.0 [2024-08-06 07:58:52,373][52660] Sum rewards: 87.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.218', 'weapon4': '0.220', 'weapon2': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '4.290', 'DAMAGECOUNT': '21.225', 'FRAGCOUNT': '71.000'} [2024-08-06 07:58:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 660660224. Throughput: 0: 4374.4. Samples: 165168430. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:58:52,794][52567] Avg episode reward: [(0, '75.259')] [2024-08-06 07:58:53,014][52662] DAMAGECOUNT value on done: 916356.0 [2024-08-06 07:58:53,014][52662] Sum rewards: 80.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.703', 'AMMO2': '0.000', 'AMMO4': '0.001', 'AMMO3': '0.221', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.502', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '68.000'} [2024-08-06 07:58:53,119][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:58:54,351][52647] DAMAGECOUNT value on done: 975870.0 [2024-08-06 07:58:54,351][52647] Sum rewards: 67.731, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'HEALTH': '0.040', 'AMMO2': '0.040', 'weapon4': '0.152', 'AMMO3': '0.172', 'AMMO4': '0.202', 'weapon5': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '54.000'} [2024-08-06 07:58:54,370][52659] DAMAGECOUNT value on done: 924038.0 [2024-08-06 07:58:54,371][52659] Sum rewards: 71.377, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.757', 'AMMO5': '0.010', 'ARMOR': '0.024', 'AMMO2': '0.038', 'weapon5': '0.150', 'AMMO4': '0.191', 'weapon4': '0.192', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.614', 'WEAPON3': '1.450', 'weapon3': '2.696', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 07:58:54,539][52650] Updated weights for policy 0, policy_version 80651 (0.0015) [2024-08-06 07:58:55,168][52667] DAMAGECOUNT value on done: 934861.0 [2024-08-06 07:58:55,178][52667] Sum rewards: 71.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.168', 'weapon4': '0.170', 'AMMO4': '0.179', 'weapon5': '0.180', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '59.000'} [2024-08-06 07:58:55,615][52660] DAMAGECOUNT value on done: 935374.0 [2024-08-06 07:58:55,617][52660] Sum rewards: 75.757, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.172', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO4': '0.163', 'weapon5': '0.172', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '64.000'} [2024-08-06 07:58:55,994][52662] DAMAGECOUNT value on done: 934762.0 [2024-08-06 07:58:55,994][52662] Sum rewards: 83.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.016', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.038', 'weapon5': '0.086', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.348', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '70.000'} [2024-08-06 07:58:56,808][52647] DAMAGECOUNT value on done: 985016.0 [2024-08-06 07:58:56,809][52647] Sum rewards: 77.986, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.815', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.100', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.550', 'weapon3': '3.146', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '67.000'} [2024-08-06 07:58:57,481][52659] DAMAGECOUNT value on done: 922823.0 [2024-08-06 07:58:57,483][52659] Sum rewards: 66.342, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.610', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.171', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.384', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '53.000'} [2024-08-06 07:58:57,797][52567] Fps is (10 sec: 17198.9, 60 sec: 17339.0, 300 sec: 17466.9). Total num frames: 660742144. Throughput: 0: 4370.4. Samples: 165194770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:58:57,797][52567] Avg episode reward: [(0, '75.223')] [2024-08-06 07:58:58,270][52667] DAMAGECOUNT value on done: 935822.0 [2024-08-06 07:58:58,271][52667] Sum rewards: 80.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.697', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.163', 'AMMO3': '0.190', 'weapon4': '0.236', 'weapon5': '0.240', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:58,515][52662] DAMAGECOUNT value on done: 925828.0 [2024-08-06 07:58:58,515][52662] Sum rewards: 80.332, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.163', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.168', 'weapon5': '0.170', 'AMMO4': '0.219', 'weapon2': '0.242', 'weapon4': '0.440', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:58,787][52660] DAMAGECOUNT value on done: 915445.0 [2024-08-06 07:58:58,787][52660] Sum rewards: 79.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.368', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.052', 'weapon5': '0.064', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'AMMO4': '0.211', 'weapon2': '0.458', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '65.000'} [2024-08-06 07:58:59,004][52647] DAMAGECOUNT value on done: 981755.0 [2024-08-06 07:58:59,004][52647] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.880', 'AMMO5': '0.014', 'AMMO2': '0.017', 'weapon4': '0.058', 'AMMO4': '0.087', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.650', 'weapon3': '3.168', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '63.000'} [2024-08-06 07:58:59,213][52650] Updated weights for policy 0, policy_version 80661 (0.0013) [2024-08-06 07:59:00,241][52659] DAMAGECOUNT value on done: 930514.0 [2024-08-06 07:59:00,248][52659] Sum rewards: 59.527, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.985', 'AMMO5': '0.025', 'AMMO2': '0.052', 'weapon4': '0.112', 'AMMO3': '0.236', 'AMMO4': '0.262', 'weapon5': '0.268', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.846', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '52.000'} [2024-08-06 07:59:00,908][52614] Signal inference workers to stop experience collection... (14800 times) [2024-08-06 07:59:00,909][52614] Signal inference workers to resume experience collection... (14800 times) [2024-08-06 07:59:00,940][52650] InferenceWorker_p0-w0: stopping experience collection (14800 times) [2024-08-06 07:59:00,940][52650] InferenceWorker_p0-w0: resuming experience collection (14800 times) [2024-08-06 07:59:01,273][52647] DAMAGECOUNT value on done: 983852.0 [2024-08-06 07:59:01,273][52647] Sum rewards: 64.460, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.658', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.034', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.268', 'weapon2': '0.394', 'WEAPON3': '1.550', 'HITCOUNT': '3.170', 'weapon3': '3.318', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 07:59:01,413][52667] DAMAGECOUNT value on done: 931174.0 [2024-08-06 07:59:01,415][52667] Sum rewards: 85.197, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.279', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.016', 'AMMO4': '0.017', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.344', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.393', 'FRAGCOUNT': '67.000'} [2024-08-06 07:59:01,455][52662] DAMAGECOUNT value on done: 915613.0 [2024-08-06 07:59:01,455][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 07:59:01,459][52662] Sum rewards: 86.605, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.534', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.178', 'AMMO3': '0.179', 'weapon2': '0.212', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '69.000'} [2024-08-06 07:59:01,756][52660] DAMAGECOUNT value on done: 913517.0 [2024-08-06 07:59:01,756][52660] Sum rewards: 62.134, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'AMMO3': '0.201', 'HEALTH': '0.314', 'ARMOR': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.292', 'DAMAGECOUNT': '15.063', 'FRAGCOUNT': '50.000'} [2024-08-06 07:59:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 660832256. Throughput: 0: 4374.7. Samples: 165207930. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:02,795][52567] Avg episode reward: [(0, '74.605')] [2024-08-06 07:59:03,817][52650] Updated weights for policy 0, policy_version 80671 (0.0049) [2024-08-06 07:59:03,966][52647] DAMAGECOUNT value on done: 959361.0 [2024-08-06 07:59:03,968][52647] Sum rewards: 83.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.521', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.106', 'weapon4': '0.108', 'AMMO4': '0.120', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '70.000'} [2024-08-06 07:59:04,009][52659] DAMAGECOUNT value on done: 918705.0 [2024-08-06 07:59:04,009][52659] Sum rewards: 78.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.354', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO3': '0.270', 'AMMO4': '0.271', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.002', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '67.000'} [2024-08-06 07:59:04,518][52667] DAMAGECOUNT value on done: 928495.0 [2024-08-06 07:59:04,519][52667] Sum rewards: 75.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.984', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon5': '0.106', 'AMMO4': '0.121', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.350', 'weapon4': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:04,536][52662] DAMAGECOUNT value on done: 920019.0 [2024-08-06 07:59:04,537][52662] Sum rewards: 80.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.760', 'AMMO5': '0.016', 'AMMO2': '0.069', 'weapon5': '0.180', 'AMMO3': '0.218', 'weapon4': '0.256', 'AMMO4': '0.347', 'weapon2': '0.348', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.916', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '67.000'} [2024-08-06 07:59:04,881][52660] DAMAGECOUNT value on done: 919561.0 [2024-08-06 07:59:04,882][52660] Sum rewards: 73.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.270', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.044', 'AMMO4': '0.178', 'weapon5': '0.218', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '61.000'} [2024-08-06 07:59:06,814][52647] DAMAGECOUNT value on done: 974452.0 [2024-08-06 07:59:06,814][52647] Sum rewards: 77.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.146', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '65.000'} [2024-08-06 07:59:06,953][52659] DAMAGECOUNT value on done: 929785.0 [2024-08-06 07:59:06,953][52659] Sum rewards: 82.626, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.036', 'AMMO4': '0.135', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '68.000'} [2024-08-06 07:59:07,104][52649] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:59:07,320][52667] DAMAGECOUNT value on done: 932228.0 [2024-08-06 07:59:07,321][52667] Sum rewards: 72.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.661', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.086', 'weapon5': '0.218', 'AMMO3': '0.220', 'weapon2': '0.238', 'AMMO4': '0.244', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.100', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '61.000'} [2024-08-06 07:59:07,422][52662] DAMAGECOUNT value on done: 915829.0 [2024-08-06 07:59:07,422][52662] Sum rewards: 74.345, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.189', 'HEALTH': '0.278', 'weapon2': '0.420', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 07:59:07,494][52811] DAMAGECOUNT value on done: 876536.0 [2024-08-06 07:59:07,498][52811] Sum rewards: 72.117, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.048', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.340', 'WEAPON3': '1.650', 'weapon3': '3.270', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '61.000'} [2024-08-06 07:59:07,770][52660] DAMAGECOUNT value on done: 927653.0 [2024-08-06 07:59:07,770][52660] Sum rewards: 69.279, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.066', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.150', 'weapon4': '0.204', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'AMMO3': '0.278', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.016', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '60.000'} [2024-08-06 07:59:07,794][52567] Fps is (10 sec: 18026.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 660922368. Throughput: 0: 4369.5. Samples: 165234080. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:07,794][52567] Avg episode reward: [(0, '74.969')] [2024-08-06 07:59:08,632][52650] Updated weights for policy 0, policy_version 80681 (0.0010) [2024-08-06 07:59:09,927][52647] DAMAGECOUNT value on done: 972169.0 [2024-08-06 07:59:09,927][52647] Sum rewards: 74.416, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.280', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.097', 'weapon4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon2': '0.420', 'WEAPON3': '0.950', 'weapon3': '3.282', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '59.000'} [2024-08-06 07:59:10,081][52659] DAMAGECOUNT value on done: 923702.0 [2024-08-06 07:59:10,082][52659] Sum rewards: 77.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.773', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.157', 'AMMO3': '0.233', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '2.954', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '65.000'} [2024-08-06 07:59:10,590][52660] DAMAGECOUNT value on done: 917167.0 [2024-08-06 07:59:10,590][52660] Sum rewards: 87.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.111', 'AMMO3': '0.207', 'weapon2': '0.222', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.162', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '72.000'} [2024-08-06 07:59:10,650][52811] DAMAGECOUNT value on done: 859412.0 [2024-08-06 07:59:10,650][52811] Sum rewards: 74.254, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.072', 'weapon5': '0.208', 'AMMO3': '0.210', 'AMMO4': '0.248', 'weapon2': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '3.160', 'weapon3': '3.200', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:12,677][52647] DAMAGECOUNT value on done: 970245.0 [2024-08-06 07:59:12,681][52647] Sum rewards: 67.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.078', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.088', 'weapon5': '0.144', 'AMMO4': '0.180', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.220', 'weapon3': '3.226', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '57.000'} [2024-08-06 07:59:12,796][52567] Fps is (10 sec: 18019.8, 60 sec: 17475.8, 300 sec: 17494.7). Total num frames: 661012480. Throughput: 0: 4380.7. Samples: 165260680. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:12,796][52567] Avg episode reward: [(0, '75.091')] [2024-08-06 07:59:12,893][52659] DAMAGECOUNT value on done: 919739.0 [2024-08-06 07:59:12,893][52659] Sum rewards: 60.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.120', 'weapon5': '0.158', 'AMMO4': '0.188', 'AMMO3': '0.189', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.148', 'DAMAGECOUNT': '14.673', 'FRAGCOUNT': '50.000'} [2024-08-06 07:59:13,177][52650] Updated weights for policy 0, policy_version 80691 (0.0017) [2024-08-06 07:59:13,436][52660] DAMAGECOUNT value on done: 912863.0 [2024-08-06 07:59:13,438][52660] Sum rewards: 82.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.054', 'weapon5': '0.162', 'AMMO4': '0.183', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.536', 'WEAPON3': '1.150', 'weapon3': '3.042', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '66.500'} [2024-08-06 07:59:13,724][52811] DAMAGECOUNT value on done: 854368.0 [2024-08-06 07:59:13,727][52811] Sum rewards: 72.507, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.128', 'AMMO4': '0.179', 'AMMO3': '0.191', 'weapon5': '0.200', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '58.000'} [2024-08-06 07:59:15,241][52647] DAMAGECOUNT value on done: 963166.0 [2024-08-06 07:59:15,242][52647] Sum rewards: 78.888, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.885', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.172', 'AMMO4': '0.189', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.534', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:15,814][52659] DAMAGECOUNT value on done: 924114.0 [2024-08-06 07:59:15,815][52659] Sum rewards: 75.692, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.740', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.204', 'AMMO4': '0.220', 'AMMO3': '0.280', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.062', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.808', 'FRAGCOUNT': '64.500'} [2024-08-06 07:59:16,450][52660] DAMAGECOUNT value on done: 919619.0 [2024-08-06 07:59:16,452][52660] Sum rewards: 68.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.190', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.094', 'weapon5': '0.180', 'AMMO3': '0.214', 'AMMO4': '0.251', 'weapon2': '0.338', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '59.000'} [2024-08-06 07:59:16,751][52811] DAMAGECOUNT value on done: 858881.0 [2024-08-06 07:59:16,753][52811] Sum rewards: 79.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.421', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.124', 'weapon2': '0.162', 'weapon4': '0.168', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '67.000'} [2024-08-06 07:59:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 661094400. Throughput: 0: 4386.2. Samples: 165273850. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:17,794][52567] Avg episode reward: [(0, '75.054')] [2024-08-06 07:59:17,832][52647] DAMAGECOUNT value on done: 973702.0 [2024-08-06 07:59:17,832][52647] Sum rewards: 75.386, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.005', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.113', 'weapon5': '0.168', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '60.000'} [2024-08-06 07:59:17,916][52650] Updated weights for policy 0, policy_version 80701 (0.0016) [2024-08-06 07:59:18,558][52659] DAMAGECOUNT value on done: 922302.0 [2024-08-06 07:59:18,559][52659] Sum rewards: 74.643, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.994', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.091', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '63.000'} [2024-08-06 07:59:19,633][52660] DAMAGECOUNT value on done: 914240.0 [2024-08-06 07:59:19,633][52660] Sum rewards: 81.858, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.306', 'AMMO5': '0.003', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'weapon4': '0.058', 'AMMO4': '0.076', 'AMMO3': '0.216', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.424', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '68.000'} [2024-08-06 07:59:19,886][52811] DAMAGECOUNT value on done: 861070.0 [2024-08-06 07:59:19,888][52811] Sum rewards: 75.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.072', 'AMMO5': '0.013', 'AMMO2': '0.066', 'weapon4': '0.172', 'AMMO3': '0.209', 'weapon5': '0.216', 'AMMO4': '0.331', 'weapon2': '0.396', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:20,695][52647] DAMAGECOUNT value on done: 967365.0 [2024-08-06 07:59:20,696][52647] Sum rewards: 76.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.227', 'weapon2': '0.574', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:21,490][52659] DAMAGECOUNT value on done: 932003.0 [2024-08-06 07:59:21,491][52659] Sum rewards: 68.936, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.564', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.026', 'weapon4': '0.056', 'AMMO4': '0.131', 'weapon5': '0.164', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.100', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '57.000'} [2024-08-06 07:59:22,281][52660] DAMAGECOUNT value on done: 913189.0 [2024-08-06 07:59:22,281][52660] Sum rewards: 56.743, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.960', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon7': '0.094', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO3': '0.146', 'AMMO4': '0.198', 'weapon5': '0.198', 'WEAPON7': '0.200', 'weapon2': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.720', 'WEAPON3': '0.850', 'weapon3': '2.340', 'HITCOUNT': '2.610', 'DAMAGECOUNT': '13.797', 'FRAGCOUNT': '45.000'} [2024-08-06 07:59:22,290][52662] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:59:22,454][52650] Updated weights for policy 0, policy_version 80711 (0.0047) [2024-08-06 07:59:22,794][52567] Fps is (10 sec: 17205.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 661184512. Throughput: 0: 4380.2. Samples: 165299910. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:22,802][52567] Avg episode reward: [(0, '75.119')] [2024-08-06 07:59:22,995][52811] DAMAGECOUNT value on done: 877716.0 [2024-08-06 07:59:22,995][52811] Sum rewards: 74.777, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.293', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.086', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:23,185][52647] DAMAGECOUNT value on done: 974273.0 [2024-08-06 07:59:23,185][52647] Sum rewards: 82.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.160', 'AMMO4': '0.185', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '66.000'} [2024-08-06 07:59:23,840][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 07:59:24,571][52659] DAMAGECOUNT value on done: 917768.0 [2024-08-06 07:59:24,571][52659] Sum rewards: 82.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.502', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.191', 'AMMO4': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '66.000'} [2024-08-06 07:59:24,982][52660] DAMAGECOUNT value on done: 924604.0 [2024-08-06 07:59:24,983][52660] Sum rewards: 63.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.082', 'weapon4': '0.084', 'AMMO4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.450', 'HITCOUNT': '3.040', 'weapon3': '3.436', 'DAMAGECOUNT': '15.261', 'FRAGCOUNT': '54.000'} [2024-08-06 07:59:25,092][52658] DAMAGECOUNT value on done: 926761.0 [2024-08-06 07:59:25,092][52658] Sum rewards: 98.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO3': '0.202', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.554', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '22.794', 'FRAGCOUNT': '80.000'} [2024-08-06 07:59:25,913][52647] DAMAGECOUNT value on done: 976998.0 [2024-08-06 07:59:25,914][52647] Sum rewards: 73.826, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.200', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.078', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon2': '0.212', 'weapon4': '0.256', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.190', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:26,154][52811] DAMAGECOUNT value on done: 870018.0 [2024-08-06 07:59:26,155][52811] Sum rewards: 70.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.155', 'weapon5': '0.178', 'AMMO4': '0.203', 'weapon4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '56.000'} [2024-08-06 07:59:27,236][52650] Updated weights for policy 0, policy_version 80721 (0.0028) [2024-08-06 07:59:27,563][52660] DAMAGECOUNT value on done: 937814.0 [2024-08-06 07:59:27,563][52660] Sum rewards: 66.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.291', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.179', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '3.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '54.000'} [2024-08-06 07:59:27,789][52659] DAMAGECOUNT value on done: 929165.0 [2024-08-06 07:59:27,791][52659] Sum rewards: 73.163, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.826', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.151', 'AMMO3': '0.259', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '63.500'} [2024-08-06 07:59:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 661274624. Throughput: 0: 4376.7. Samples: 165326070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:27,801][52567] Avg episode reward: [(0, '75.067')] [2024-08-06 07:59:27,878][52658] DAMAGECOUNT value on done: 928274.0 [2024-08-06 07:59:27,880][52658] Sum rewards: 71.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.952', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.096', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '3.088', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '57.000'} [2024-08-06 07:59:28,838][52647] DAMAGECOUNT value on done: 961045.0 [2024-08-06 07:59:28,838][52647] Sum rewards: 62.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.684', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.108', 'weapon5': '0.142', 'AMMO4': '0.159', 'AMMO3': '0.195', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.400', 'weapon3': '2.888', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '53.000'} [2024-08-06 07:59:29,325][52811] DAMAGECOUNT value on done: 857502.0 [2024-08-06 07:59:29,329][52811] Sum rewards: 53.367, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon2': '0.156', 'weapon4': '0.162', 'AMMO3': '0.199', 'weapon5': '0.230', 'AMMO4': '0.234', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.520', 'weapon3': '3.244', 'DAMAGECOUNT': '13.425', 'FRAGCOUNT': '45.000'} [2024-08-06 07:59:30,687][52660] DAMAGECOUNT value on done: 916706.0 [2024-08-06 07:59:30,687][52660] Sum rewards: 75.515, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'weapon5': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:30,748][52658] DAMAGECOUNT value on done: 929908.0 [2024-08-06 07:59:30,748][52658] Sum rewards: 70.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.078', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon2': '0.204', 'weapon5': '0.204', 'AMMO3': '0.220', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '58.000'} [2024-08-06 07:59:30,847][52659] DAMAGECOUNT value on done: 921484.0 [2024-08-06 07:59:30,847][52659] Sum rewards: 66.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon4': '0.358', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '2.926', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '56.000'} [2024-08-06 07:59:31,309][52647] DAMAGECOUNT value on done: 969193.0 [2024-08-06 07:59:31,313][52647] Sum rewards: 68.276, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.960', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.134', 'WEAPON5': '0.150', 'weapon2': '0.362', 'WEAPON3': '0.900', 'weapon3': '3.258', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '53.500'} [2024-08-06 07:59:31,980][52650] Updated weights for policy 0, policy_version 80731 (0.0024) [2024-08-06 07:59:32,267][52662] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 07:59:32,521][52811] DAMAGECOUNT value on done: 865560.0 [2024-08-06 07:59:32,522][52811] Sum rewards: 76.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.344', 'AMMO5': '0.003', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'weapon5': '0.056', 'AMMO4': '0.126', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.203', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '63.000'} [2024-08-06 07:59:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 661356544. Throughput: 0: 4375.1. Samples: 165339110. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:32,794][52567] Avg episode reward: [(0, '74.550')] [2024-08-06 07:59:33,281][52660] DAMAGECOUNT value on done: 924369.0 [2024-08-06 07:59:33,281][52660] Sum rewards: 79.779, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.872', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.256', 'weapon2': '0.530', 'WEAPON3': '1.600', 'weapon3': '3.266', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '69.000'} [2024-08-06 07:59:33,414][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:59:33,728][52658] DAMAGECOUNT value on done: 926984.0 [2024-08-06 07:59:33,729][52658] Sum rewards: 72.495, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.739', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.041', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.210', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '59.000'} [2024-08-06 07:59:34,251][52647] DAMAGECOUNT value on done: 961769.0 [2024-08-06 07:59:34,252][52647] Sum rewards: 85.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.526', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.056', 'weapon5': '0.082', 'AMMO4': '0.097', 'AMMO3': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.228', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '69.000'} [2024-08-06 07:59:35,646][52660] DAMAGECOUNT value on done: 921410.0 [2024-08-06 07:59:35,648][52660] Sum rewards: 79.867, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.121', 'AMMO5': '0.006', 'weapon4': '0.024', 'AMMO2': '0.034', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.214', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '66.000'} [2024-08-06 07:59:35,696][52811] DAMAGECOUNT value on done: 865068.0 [2024-08-06 07:59:35,706][52811] Sum rewards: 87.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.625', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.093', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.979', 'FRAGCOUNT': '72.000'} [2024-08-06 07:59:35,708][52664] DAMAGECOUNT value on done: 952478.0 [2024-08-06 07:59:35,709][52664] Sum rewards: 61.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.203', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.064', 'weapon5': '0.188', 'AMMO4': '0.224', 'AMMO3': '0.254', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.102', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 07:59:36,342][52658] DAMAGECOUNT value on done: 920979.0 [2024-08-06 07:59:36,342][52658] Sum rewards: 72.962, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.100', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.164', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.268', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.500', 'weapon3': '2.946', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '61.000'} [2024-08-06 07:59:36,631][52650] Updated weights for policy 0, policy_version 80741 (0.0026) [2024-08-06 07:59:36,929][52647] DAMAGECOUNT value on done: 965480.0 [2024-08-06 07:59:36,930][52647] Sum rewards: 78.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon2': '0.148', 'weapon5': '0.168', 'AMMO4': '0.190', 'AMMO3': '0.198', 'weapon4': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 661438464. Throughput: 0: 4373.3. Samples: 165365230. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 07:59:37,794][52567] Avg episode reward: [(0, '74.516')] [2024-08-06 07:59:38,076][52664] DAMAGECOUNT value on done: 958977.0 [2024-08-06 07:59:38,082][52664] Sum rewards: 75.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.130', 'AMMO3': '0.210', 'AMMO4': '0.219', 'weapon5': '0.226', 'weapon2': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.000'} [2024-08-06 07:59:38,533][52671] DAMAGECOUNT value on done: 928720.0 [2024-08-06 07:59:38,536][52671] Sum rewards: 66.785, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.756', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.118', 'weapon5': '0.176', 'AMMO4': '0.252', 'weapon2': '0.262', 'AMMO3': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'HITCOUNT': '3.060', 'weapon3': '3.190', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '58.000'} [2024-08-06 07:59:38,584][52660] DAMAGECOUNT value on done: 913589.0 [2024-08-06 07:59:38,584][52660] Sum rewards: 73.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.255', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.404', 'WEAPON3': '1.550', 'weapon3': '3.378', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:38,768][52669] DAMAGECOUNT value on done: 923953.0 [2024-08-06 07:59:38,770][52669] Sum rewards: 77.711, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.242', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.098', 'AMMO3': '0.146', 'AMMO4': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.784', 'WEAPON3': '0.850', 'weapon3': '2.922', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '61.000'} [2024-08-06 07:59:38,772][52811] DAMAGECOUNT value on done: 869722.0 [2024-08-06 07:59:38,774][52811] Sum rewards: 77.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.100', 'weapon5': '0.190', 'AMMO4': '0.196', 'AMMO3': '0.200', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:39,159][52658] DAMAGECOUNT value on done: 917917.0 [2024-08-06 07:59:39,161][52658] Sum rewards: 82.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.891', 'AMMO5': '0.018', 'AMMO2': '0.052', 'AMMO3': '0.216', 'weapon2': '0.252', 'AMMO4': '0.260', 'weapon5': '0.264', 'weapon4': '0.314', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '67.000'} [2024-08-06 07:59:41,038][52664] DAMAGECOUNT value on done: 961453.0 [2024-08-06 07:59:41,046][52664] Sum rewards: 60.576, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.202', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.042', 'AMMO4': '0.067', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.728', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '13.992', 'FRAGCOUNT': '52.000'} [2024-08-06 07:59:41,243][52669] DAMAGECOUNT value on done: 921510.0 [2024-08-06 07:59:41,243][52669] Sum rewards: 84.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.447', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.162', 'weapon4': '0.174', 'AMMO4': '0.181', 'AMMO3': '0.198', 'weapon2': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '69.000'} [2024-08-06 07:59:41,427][52650] Updated weights for policy 0, policy_version 80751 (0.0016) [2024-08-06 07:59:41,823][52671] DAMAGECOUNT value on done: 935383.0 [2024-08-06 07:59:41,826][52671] Sum rewards: 77.110, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.890', 'AMMO2': '0.013', 'AMMO4': '0.063', 'AMMO3': '0.152', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '3.404', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:41,922][52660] DAMAGECOUNT value on done: 913569.0 [2024-08-06 07:59:41,924][52660] Sum rewards: 73.007, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.036', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.294', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.482', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '60.000'} [2024-08-06 07:59:42,030][52811] DAMAGECOUNT value on done: 874363.0 [2024-08-06 07:59:42,030][52811] Sum rewards: 82.790, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.362', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.130', 'AMMO4': '0.132', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.200', 'weapon2': '0.622', 'WEAPON3': '1.000', 'weapon3': '2.848', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:42,175][52658] DAMAGECOUNT value on done: 930895.0 [2024-08-06 07:59:42,175][52658] Sum rewards: 76.948, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.020', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'weapon5': '0.140', 'AMMO3': '0.201', 'weapon2': '0.582', 'WEAPON3': '1.150', 'weapon3': '3.068', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:42,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 661536768. Throughput: 0: 4367.1. Samples: 165391280. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:59:42,795][52567] Avg episode reward: [(0, '74.601')] [2024-08-06 07:59:43,509][52664] DAMAGECOUNT value on done: 952118.0 [2024-08-06 07:59:43,511][52664] Sum rewards: 70.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.230', 'AMMO5': '0.004', 'weapon4': '0.012', 'weapon5': '0.028', 'AMMO2': '0.039', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.197', 'weapon2': '0.236', 'AMMO3': '0.238', 'WEAPON3': '1.600', 'weapon3': '3.558', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '60.000'} [2024-08-06 07:59:44,163][52669] DAMAGECOUNT value on done: 933864.0 [2024-08-06 07:59:44,165][52669] Sum rewards: 81.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.490', 'AMMO5': '0.010', 'weapon4': '0.032', 'AMMO2': '0.036', 'WEAPON4': '0.100', 'weapon5': '0.144', 'AMMO4': '0.178', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.060', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '66.000'} [2024-08-06 07:59:44,735][52671] DAMAGECOUNT value on done: 933182.0 [2024-08-06 07:59:44,737][52671] Sum rewards: 89.091, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.120', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.208', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '3.032', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.042', 'FRAGCOUNT': '70.000'} [2024-08-06 07:59:45,019][52658] DAMAGECOUNT value on done: 919098.0 [2024-08-06 07:59:45,021][52811] DAMAGECOUNT value on done: 864026.0 [2024-08-06 07:59:45,022][52811] Sum rewards: 77.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon2': '0.192', 'AMMO3': '0.232', 'weapon5': '0.294', 'AMMO4': '0.307', 'weapon4': '0.328', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.880', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '63.000'} [2024-08-06 07:59:45,020][52658] Sum rewards: 58.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.475', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.120', 'weapon5': '0.168', 'weapon2': '0.216', 'AMMO3': '0.253', 'AMMO4': '0.290', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.212', 'DAMAGECOUNT': '15.867', 'FRAGCOUNT': '50.000'} [2024-08-06 07:59:45,842][52650] Updated weights for policy 0, policy_version 80761 (0.0013) [2024-08-06 07:59:46,328][52664] DAMAGECOUNT value on done: 966838.0 [2024-08-06 07:59:46,328][52664] Sum rewards: 73.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.092', 'AMMO4': '0.181', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.234', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:47,326][52669] DAMAGECOUNT value on done: 924879.0 [2024-08-06 07:59:47,327][52669] Sum rewards: 74.249, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.975', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.119', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'weapon2': '0.244', 'WEAPON3': '1.200', 'weapon3': '3.296', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '61.000'} [2024-08-06 07:59:47,655][52671] DAMAGECOUNT value on done: 934026.0 [2024-08-06 07:59:47,657][52671] Sum rewards: 69.746, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.064', 'weapon5': '0.092', 'AMMO4': '0.117', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.294', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 07:59:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 661618688. Throughput: 0: 4366.2. Samples: 165404410. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:59:47,794][52567] Avg episode reward: [(0, '74.663')] [2024-08-06 07:59:48,167][52811] DAMAGECOUNT value on done: 862121.0 [2024-08-06 07:59:48,169][52811] Sum rewards: 66.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.677', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.165', 'weapon4': '0.178', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2024-08-06 07:59:48,276][52658] DAMAGECOUNT value on done: 945608.0 [2024-08-06 07:59:48,278][52658] Sum rewards: 78.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.774', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon4': '0.124', 'weapon5': '0.176', 'AMMO3': '0.193', 'AMMO4': '0.294', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.000'} [2024-08-06 07:59:48,978][52664] DAMAGECOUNT value on done: 962778.0 [2024-08-06 07:59:48,980][52664] Sum rewards: 78.271, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.018', 'AMMO4': '0.039', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.208', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:50,185][52671] DAMAGECOUNT value on done: 941410.0 [2024-08-06 07:59:50,185][52671] Sum rewards: 75.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.520', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'AMMO3': '0.212', 'weapon2': '0.602', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '62.000'} [2024-08-06 07:59:50,369][52669] DAMAGECOUNT value on done: 934207.0 [2024-08-06 07:59:50,370][52669] Sum rewards: 78.991, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.436', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.118', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '65.000'} [2024-08-06 07:59:50,727][52650] Updated weights for policy 0, policy_version 80771 (0.0030) [2024-08-06 07:59:51,159][52811] DAMAGECOUNT value on done: 864174.0 [2024-08-06 07:59:51,159][52811] Sum rewards: 88.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.258', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.160', 'AMMO3': '0.178', 'weapon2': '0.190', 'AMMO4': '0.244', 'weapon4': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '71.000'} [2024-08-06 07:59:51,471][52658] DAMAGECOUNT value on done: 931655.0 [2024-08-06 07:59:51,480][52658] Sum rewards: 80.320, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.603', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.086', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'weapon2': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.394', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:51,932][52794] DAMAGECOUNT value on done: 918204.0 [2024-08-06 07:59:51,935][52794] Sum rewards: 88.325, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.072', 'weapon5': '0.130', 'AMMO4': '0.145', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.513', 'FRAGCOUNT': '69.000'} [2024-08-06 07:59:52,080][52664] DAMAGECOUNT value on done: 951071.0 [2024-08-06 07:59:52,080][52664] Sum rewards: 83.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.590', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.171', 'AMMO3': '0.180', 'weapon5': '0.218', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.000', 'weapon3': '2.698', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:52,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 661700608. Throughput: 0: 4373.8. Samples: 165430900. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:59:52,794][52567] Avg episode reward: [(0, '75.020')] [2024-08-06 07:59:52,829][52669] DAMAGECOUNT value on done: 932036.0 [2024-08-06 07:59:52,831][52669] Sum rewards: 77.408, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.134', 'weapon5': '0.156', 'AMMO4': '0.198', 'weapon2': '0.214', 'AMMO3': '0.240', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 07:59:53,322][52671] DAMAGECOUNT value on done: 927483.0 [2024-08-06 07:59:53,323][52671] Sum rewards: 76.120, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.550', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.176', 'AMMO4': '0.193', 'AMMO3': '0.271', 'weapon2': '0.322', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.208', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '65.000'} [2024-08-06 07:59:54,288][52658] DAMAGECOUNT value on done: 937942.0 [2024-08-06 07:59:54,289][52658] Sum rewards: 68.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.495', 'AMMO5': '0.028', 'AMMO2': '0.055', 'AMMO3': '0.133', 'weapon5': '0.208', 'weapon4': '0.258', 'AMMO4': '0.277', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '55.000'} [2024-08-06 07:59:54,293][52811] DAMAGECOUNT value on done: 863239.0 [2024-08-06 07:59:54,294][52811] Sum rewards: 71.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.165', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.112', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.276', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '58.000'} [2024-08-06 07:59:54,959][52664] DAMAGECOUNT value on done: 953090.0 [2024-08-06 07:59:54,959][52664] Sum rewards: 84.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.955', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.114', 'weapon5': '0.134', 'AMMO4': '0.176', 'AMMO3': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.627', 'FRAGCOUNT': '67.000'} [2024-08-06 07:59:54,965][52794] DAMAGECOUNT value on done: 930611.0 [2024-08-06 07:59:54,967][52794] Sum rewards: 82.173, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.485', 'AMMO2': '0.010', 'AMMO4': '0.049', 'AMMO3': '0.171', 'weapon2': '0.256', 'WEAPON3': '1.150', 'weapon3': '3.620', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '66.000'} [2024-08-06 07:59:55,362][52663] DAMAGECOUNT value on done: 942984.0 [2024-08-06 07:59:55,362][52663] Sum rewards: 81.304, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.140', 'AMMO4': '0.149', 'weapon2': '0.180', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.408', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '70.000'} [2024-08-06 07:59:55,897][52669] DAMAGECOUNT value on done: 928956.0 [2024-08-06 07:59:55,897][52669] Sum rewards: 82.265, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.795', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.056', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.232', 'WEAPON3': '1.150', 'weapon3': '3.552', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '66.000'} [2024-08-06 07:59:55,925][52650] Updated weights for policy 0, policy_version 80781 (0.0037) [2024-08-06 07:59:56,422][52671] DAMAGECOUNT value on done: 930260.0 [2024-08-06 07:59:56,422][52671] Sum rewards: 68.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.046', 'weapon5': '0.088', 'weapon4': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.229', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.142', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '59.000'} [2024-08-06 07:59:56,518][52660] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 07:59:57,330][52658] DAMAGECOUNT value on done: 924600.0 [2024-08-06 07:59:57,331][52658] Sum rewards: 63.489, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.896', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.084', 'AMMO3': '0.190', 'AMMO4': '0.236', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.100', 'HITCOUNT': '2.770', 'weapon3': '2.848', 'DAMAGECOUNT': '15.003', 'FRAGCOUNT': '51.000'} [2024-08-06 07:59:57,367][52811] DAMAGECOUNT value on done: 872045.0 [2024-08-06 07:59:57,368][52811] Sum rewards: 76.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.850', 'AMMO5': '0.023', 'AMMO2': '0.084', 'weapon4': '0.232', 'AMMO3': '0.240', 'weapon5': '0.264', 'weapon2': '0.272', 'AMMO4': '0.420', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '64.000'} [2024-08-06 07:59:57,661][52794] DAMAGECOUNT value on done: 934942.0 [2024-08-06 07:59:57,662][52794] Sum rewards: 79.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.203', 'AMMO5': '0.019', 'AMMO2': '0.043', 'weapon4': '0.188', 'weapon5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.217', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.958', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '21.255', 'FRAGCOUNT': '63.000'} [2024-08-06 07:59:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17613.5, 300 sec: 17494.8). Total num frames: 661798912. Throughput: 0: 4359.3. Samples: 165456840. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 07:59:57,794][52567] Avg episode reward: [(0, '75.279')] [2024-08-06 07:59:58,168][52664] DAMAGECOUNT value on done: 961475.0 [2024-08-06 07:59:58,168][52664] Sum rewards: 79.867, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.080', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon2': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'weapon4': '0.290', 'ARMOR': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '67.000'} [2024-08-06 07:59:58,496][52663] DAMAGECOUNT value on done: 926781.0 [2024-08-06 07:59:58,497][52663] Sum rewards: 64.924, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.632', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.094', 'weapon4': '0.096', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.472', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '53.000'} [2024-08-06 07:59:59,029][52669] DAMAGECOUNT value on done: 927524.0 [2024-08-06 07:59:59,030][52669] Sum rewards: 83.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.138', 'AMMO4': '0.171', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '68.000'} [2024-08-06 07:59:59,505][52671] DAMAGECOUNT value on done: 935237.0 [2024-08-06 07:59:59,506][52671] Sum rewards: 95.349, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.230', 'weapon2': '0.488', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.771', 'FRAGCOUNT': '79.000'} [2024-08-06 08:00:00,004][52650] Updated weights for policy 0, policy_version 80791 (0.0033) [2024-08-06 08:00:00,091][52658] DAMAGECOUNT value on done: 934723.0 [2024-08-06 08:00:00,094][52658] Sum rewards: 72.394, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.655', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 08:00:00,347][52794] DAMAGECOUNT value on done: 921024.0 [2024-08-06 08:00:00,350][52794] Sum rewards: 68.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon2': '0.164', 'AMMO3': '0.213', 'weapon5': '0.226', 'AMMO4': '0.277', 'weapon4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.960', 'weapon3': '3.072', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:00,476][52811] DAMAGECOUNT value on done: 875331.0 [2024-08-06 08:00:00,477][52811] Sum rewards: 77.973, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.012', 'AMMO2': '0.023', 'HEALTH': '0.065', 'AMMO4': '0.113', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '62.000'} [2024-08-06 08:00:01,270][52664] DAMAGECOUNT value on done: 960632.0 [2024-08-06 08:00:01,270][52664] Sum rewards: 88.400, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.588', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '72.000'} [2024-08-06 08:00:01,470][52663] DAMAGECOUNT value on done: 921683.0 [2024-08-06 08:00:01,470][52663] Sum rewards: 79.361, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.146', 'AMMO4': '0.171', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:01,937][52669] DAMAGECOUNT value on done: 939417.0 [2024-08-06 08:00:01,941][52669] Sum rewards: 82.751, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.218', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.151', 'AMMO4': '0.156', 'weapon4': '0.180', 'weapon5': '0.188', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.180', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:02,511][52658] DAMAGECOUNT value on done: 923584.0 [2024-08-06 08:00:02,521][52658] Sum rewards: 79.543, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.078', 'weapon4': '0.120', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:02,746][52671] DAMAGECOUNT value on done: 918051.0 [2024-08-06 08:00:02,746][52671] Sum rewards: 81.667, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.160', 'AMMO4': '0.172', 'weapon2': '0.218', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.081', 'FRAGCOUNT': '67.000'} [2024-08-06 08:00:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 661880832. Throughput: 0: 4351.6. Samples: 165469670. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 08:00:02,794][52567] Avg episode reward: [(0, '75.586')] [2024-08-06 08:00:03,198][52794] DAMAGECOUNT value on done: 914629.0 [2024-08-06 08:00:03,198][52794] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.429', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.142', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.280', 'AMMO3': '0.285', 'WEAPON3': '1.700', 'weapon3': '3.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:03,597][52811] DAMAGECOUNT value on done: 861805.0 [2024-08-06 08:00:03,597][52811] Sum rewards: 73.799, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.644', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.326', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '60.500'} [2024-08-06 08:00:03,682][52803] DAMAGECOUNT value on done: 859655.0 [2024-08-06 08:00:03,683][52803] Sum rewards: 83.302, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.755', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.208', 'AMMO4': '0.226', 'AMMO3': '0.259', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.600', 'weapon3': '2.946', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.886', 'FRAGCOUNT': '69.000'} [2024-08-06 08:00:04,473][52663] DAMAGECOUNT value on done: 927268.0 [2024-08-06 08:00:04,476][52663] Sum rewards: 56.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.498', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.146', 'weapon5': '0.178', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'HITCOUNT': '2.980', 'weapon3': '3.152', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '49.000'} [2024-08-06 08:00:04,514][52664] DAMAGECOUNT value on done: 967302.0 [2024-08-06 08:00:04,516][52664] Sum rewards: 77.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.058', 'weapon5': '0.170', 'AMMO4': '0.244', 'weapon2': '0.278', 'AMMO3': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.228', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:04,923][52669] DAMAGECOUNT value on done: 928992.0 [2024-08-06 08:00:04,926][52669] Sum rewards: 75.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.916', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.122', 'weapon5': '0.168', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:05,196][52658] DAMAGECOUNT value on done: 932111.0 [2024-08-06 08:00:05,196][52658] Sum rewards: 78.192, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.161', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:05,201][52650] Updated weights for policy 0, policy_version 80801 (0.0014) [2024-08-06 08:00:05,591][52671] DAMAGECOUNT value on done: 931324.0 [2024-08-06 08:00:05,591][52671] Sum rewards: 66.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.500', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.128', 'weapon4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.284', 'WEAPON3': '1.150', 'HITCOUNT': '3.070', 'weapon3': '3.192', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '54.000'} [2024-08-06 08:00:06,196][52794] DAMAGECOUNT value on done: 921807.0 [2024-08-06 08:00:06,196][52794] Sum rewards: 61.251, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.815', 'AMMO5': '0.006', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'AMMO4': '0.073', 'weapon5': '0.076', 'AMMO3': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.338', 'weapon2': '0.706', 'WEAPON3': '0.750', 'weapon3': '2.702', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.292', 'FRAGCOUNT': '48.000'} [2024-08-06 08:00:06,584][52811] DAMAGECOUNT value on done: 860351.0 [2024-08-06 08:00:06,586][52811] Sum rewards: 71.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.580', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.102', 'AMMO4': '0.197', 'weapon2': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.170', 'weapon3': '3.416', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '61.000'} [2024-08-06 08:00:06,803][52803] DAMAGECOUNT value on done: 859024.0 [2024-08-06 08:00:06,804][52803] Sum rewards: 78.031, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.455', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.046', 'AMMO4': '0.142', 'weapon5': '0.144', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:07,205][52664] DAMAGECOUNT value on done: 963933.0 [2024-08-06 08:00:07,208][52664] Sum rewards: 66.194, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.004', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.096', 'AMMO3': '0.174', 'weapon5': '0.228', 'AMMO4': '0.280', 'weapon2': '0.494', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.920', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '55.000'} [2024-08-06 08:00:07,652][52663] DAMAGECOUNT value on done: 926243.0 [2024-08-06 08:00:07,662][52663] Sum rewards: 69.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.208', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.203', 'weapon5': '0.204', 'AMMO4': '0.226', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.770', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '58.000'} [2024-08-06 08:00:07,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 661962752. Throughput: 0: 4354.2. Samples: 165495850. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 08:00:07,794][52567] Avg episode reward: [(0, '75.248')] [2024-08-06 08:00:08,016][52669] DAMAGECOUNT value on done: 936053.0 [2024-08-06 08:00:08,017][52669] Sum rewards: 72.390, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.513', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.126', 'AMMO3': '0.159', 'weapon5': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.320', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:08,227][52658] DAMAGECOUNT value on done: 913625.0 [2024-08-06 08:00:08,227][52658] Sum rewards: 72.988, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.060', 'weapon5': '0.154', 'AMMO4': '0.211', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '61.000'} [2024-08-06 08:00:08,525][52671] DAMAGECOUNT value on done: 930949.0 [2024-08-06 08:00:08,526][52671] Sum rewards: 77.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'weapon2': '0.326', 'weapon4': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:09,174][52794] DAMAGECOUNT value on done: 926424.0 [2024-08-06 08:00:09,177][52794] Sum rewards: 79.558, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.180', 'AMMO4': '0.180', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:09,473][52650] Updated weights for policy 0, policy_version 80811 (0.0046) [2024-08-06 08:00:10,039][52803] DAMAGECOUNT value on done: 865772.0 [2024-08-06 08:00:10,041][52803] Sum rewards: 78.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.816', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.302', 'WEAPON3': '1.550', 'weapon3': '3.360', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:10,182][52664] DAMAGECOUNT value on done: 963273.0 [2024-08-06 08:00:10,185][52664] Sum rewards: 77.070, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.600', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.147', 'weapon5': '0.166', 'AMMO4': '0.190', 'weapon4': '0.268', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.092', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '62.000'} [2024-08-06 08:00:10,403][52663] DAMAGECOUNT value on done: 933902.0 [2024-08-06 08:00:10,404][52663] Sum rewards: 87.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.305', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.248', 'WEAPON3': '1.150', 'weapon3': '3.566', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.901', 'FRAGCOUNT': '71.000'} [2024-08-06 08:00:10,615][52669] DAMAGECOUNT value on done: 936518.0 [2024-08-06 08:00:10,616][52669] Sum rewards: 81.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.068', 'AMMO5': '0.003', 'weapon4': '0.020', 'AMMO2': '0.028', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.204', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.420', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '67.000'} [2024-08-06 08:00:10,982][52658] DAMAGECOUNT value on done: 930680.0 [2024-08-06 08:00:10,983][52658] Sum rewards: 63.773, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.190', 'weapon2': '0.200', 'weapon5': '0.208', 'AMMO4': '0.224', 'weapon4': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.970', 'weapon3': '3.146', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '53.000'} [2024-08-06 08:00:11,708][52671] DAMAGECOUNT value on done: 929509.0 [2024-08-06 08:00:11,708][52671] Sum rewards: 86.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.980', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.074', 'AMMO4': '0.088', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.308', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '71.000'} [2024-08-06 08:00:12,348][52794] DAMAGECOUNT value on done: 914416.0 [2024-08-06 08:00:12,349][52794] Sum rewards: 72.007, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.077', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.196', 'AMMO4': '0.197', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '61.000'} [2024-08-06 08:00:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.7, 300 sec: 17494.8). Total num frames: 662061056. Throughput: 0: 4350.0. Samples: 165521820. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 08:00:12,795][52567] Avg episode reward: [(0, '75.603')] [2024-08-06 08:00:13,123][52803] DAMAGECOUNT value on done: 863346.0 [2024-08-06 08:00:13,125][52803] Sum rewards: 70.131, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.094', 'weapon5': '0.148', 'AMMO4': '0.154', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.886', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:13,203][52663] DAMAGECOUNT value on done: 923868.0 [2024-08-06 08:00:13,204][52663] Sum rewards: 64.899, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.172', 'AMMO4': '0.218', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.500', 'HITCOUNT': '3.090', 'weapon3': '3.258', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '56.000'} [2024-08-06 08:00:13,318][52664] DAMAGECOUNT value on done: 977402.0 [2024-08-06 08:00:13,318][52664] Sum rewards: 71.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.013', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.197', 'weapon5': '0.216', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '2.810', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:13,509][52669] DAMAGECOUNT value on done: 923833.0 [2024-08-06 08:00:13,510][52669] Sum rewards: 75.867, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.220', 'AMMO5': '0.025', 'AMMO2': '0.086', 'weapon4': '0.224', 'AMMO3': '0.232', 'weapon5': '0.336', 'weapon2': '0.402', 'AMMO4': '0.430', 'WEAPON5': '0.700', 'WEAPON4': '0.850', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:13,696][52658] DAMAGECOUNT value on done: 925138.0 [2024-08-06 08:00:13,698][52658] Sum rewards: 76.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.325', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.062', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.340', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.008', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:14,275][52650] Updated weights for policy 0, policy_version 80821 (0.0026) [2024-08-06 08:00:14,865][52671] DAMAGECOUNT value on done: 931777.0 [2024-08-06 08:00:14,867][52671] Sum rewards: 67.159, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.116', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.064', 'WEAPON4': '0.100', 'weapon2': '0.198', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'HITCOUNT': '3.230', 'weapon3': '3.454', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:15,395][52794] DAMAGECOUNT value on done: 929163.0 [2024-08-06 08:00:15,400][52794] Sum rewards: 75.587, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.288', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon4': '0.190', 'weapon5': '0.190', 'weapon2': '0.214', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:15,799][52663] DAMAGECOUNT value on done: 910951.0 [2024-08-06 08:00:15,801][52663] Sum rewards: 70.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.883', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.152', 'weapon2': '0.156', 'weapon5': '0.160', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.346', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:16,037][52664] DAMAGECOUNT value on done: 971873.0 [2024-08-06 08:00:16,038][52664] Sum rewards: 77.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.378', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.138', 'AMMO4': '0.152', 'AMMO3': '0.176', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.364', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '62.500'} [2024-08-06 08:00:16,183][52669] DAMAGECOUNT value on done: 921083.0 [2024-08-06 08:00:16,185][52669] Sum rewards: 65.534, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.275', 'AMMO5': '0.024', 'AMMO2': '0.068', 'AMMO3': '0.198', 'weapon2': '0.236', 'weapon4': '0.236', 'AMMO4': '0.339', 'weapon5': '0.344', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.760', 'weapon3': '2.876', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '54.000'} [2024-08-06 08:00:16,197][52658] Large shaping reward 2.595 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('weapon5', 0.002)] [2024-08-06 08:00:16,220][52803] DAMAGECOUNT value on done: 859481.0 [2024-08-06 08:00:16,221][52803] Sum rewards: 67.666, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.736', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.144', 'AMMO4': '0.164', 'weapon5': '0.172', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.010', 'weapon3': '3.066', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:16,679][52658] DAMAGECOUNT value on done: 919096.0 [2024-08-06 08:00:16,682][52658] Sum rewards: 82.825, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.211', 'AMMO4': '0.215', 'weapon5': '0.234', 'weapon2': '0.244', 'weapon4': '0.300', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '69.000'} [2024-08-06 08:00:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 662142976. Throughput: 0: 4357.6. Samples: 165535200. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 08:00:17,802][52567] Avg episode reward: [(0, '75.637')] [2024-08-06 08:00:18,048][52671] DAMAGECOUNT value on done: 930009.0 [2024-08-06 08:00:18,049][52671] Sum rewards: 79.824, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.132', 'weapon5': '0.134', 'AMMO4': '0.191', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:18,431][52794] DAMAGECOUNT value on done: 923250.0 [2024-08-06 08:00:18,434][52794] Sum rewards: 84.943, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.153', 'AMMO3': '0.156', 'weapon4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.000', 'weapon3': '3.214', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '68.000'} [2024-08-06 08:00:18,456][52664] DAMAGECOUNT value on done: 970237.0 [2024-08-06 08:00:18,457][52664] Sum rewards: 76.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.486', 'AMMO2': '0.004', 'AMMO5': '0.006', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'weapon4': '0.070', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:18,672][52663] DAMAGECOUNT value on done: 923031.0 [2024-08-06 08:00:18,675][52663] Sum rewards: 68.138, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.246', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.052', 'AMMO4': '0.157', 'weapon5': '0.166', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:19,007][52669] DAMAGECOUNT value on done: 930660.0 [2024-08-06 08:00:19,009][52669] Sum rewards: 79.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.114', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.254', 'WEAPON3': '1.250', 'weapon3': '3.406', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:19,134][52650] Updated weights for policy 0, policy_version 80831 (0.0024) [2024-08-06 08:00:19,406][52803] DAMAGECOUNT value on done: 859379.0 [2024-08-06 08:00:19,408][52803] Sum rewards: 55.526, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.421', 'AMMO5': '0.022', 'AMMO2': '0.083', 'AMMO3': '0.206', 'weapon5': '0.272', 'weapon4': '0.294', 'AMMO4': '0.417', 'weapon2': '0.420', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.560', 'weapon3': '2.772', 'DAMAGECOUNT': '13.350', 'FRAGCOUNT': '47.000'} [2024-08-06 08:00:19,874][52658] DAMAGECOUNT value on done: 927891.0 [2024-08-06 08:00:19,875][52658] Sum rewards: 68.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.360', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.080', 'AMMO4': '0.206', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.400', 'HITCOUNT': '3.150', 'weapon3': '3.306', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:20,806][52671] DAMAGECOUNT value on done: 915590.0 [2024-08-06 08:00:20,811][52671] Sum rewards: 67.416, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.158', 'AMMO3': '0.211', 'weapon5': '0.214', 'AMMO4': '0.232', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '56.000'} [2024-08-06 08:00:21,059][52664] DAMAGECOUNT value on done: 953556.0 [2024-08-06 08:00:21,062][52664] Sum rewards: 67.556, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.003', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.102', 'weapon4': '0.118', 'AMMO3': '0.142', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON3': '0.850', 'HITCOUNT': '3.250', 'weapon3': '3.328', 'DAMAGECOUNT': '15.780', 'FRAGCOUNT': '52.000'} [2024-08-06 08:00:21,360][52794] DAMAGECOUNT value on done: 916813.0 [2024-08-06 08:00:21,360][52794] Sum rewards: 76.014, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.144', 'AMMO5': '0.023', 'AMMO2': '0.053', 'weapon4': '0.104', 'AMMO3': '0.172', 'weapon5': '0.232', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'weapon2': '0.522', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.878', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '60.000'} [2024-08-06 08:00:21,710][52663] DAMAGECOUNT value on done: 923266.0 [2024-08-06 08:00:21,712][52663] Sum rewards: 83.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.101', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.048', 'AMMO4': '0.086', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '68.000'} [2024-08-06 08:00:22,001][52669] DAMAGECOUNT value on done: 951482.0 [2024-08-06 08:00:22,001][52669] Sum rewards: 73.279, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.038', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '3.408', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '58.000'} [2024-08-06 08:00:22,608][52803] DAMAGECOUNT value on done: 856083.0 [2024-08-06 08:00:22,608][52803] Sum rewards: 64.663, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.411', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.166', 'AMMO4': '0.194', 'weapon5': '0.210', 'AMMO3': '0.247', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '55.000'} [2024-08-06 08:00:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 662233088. Throughput: 0: 4367.5. Samples: 165561770. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 08:00:22,795][52567] Avg episode reward: [(0, '75.362')] [2024-08-06 08:00:23,758][52671] DAMAGECOUNT value on done: 941234.0 [2024-08-06 08:00:23,758][52671] Sum rewards: 90.055, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.058', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.051', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.360', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '75.000'} [2024-08-06 08:00:23,855][52794] DAMAGECOUNT value on done: 929892.0 [2024-08-06 08:00:23,857][52794] Sum rewards: 70.630, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.792', 'AMMO5': '0.012', 'AMMO2': '0.053', 'AMMO3': '0.188', 'weapon5': '0.226', 'AMMO4': '0.264', 'weapon4': '0.294', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '2.870', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:23,887][52664] DAMAGECOUNT value on done: 956770.0 [2024-08-06 08:00:23,887][52664] Sum rewards: 81.579, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.038', 'AMMO4': '0.139', 'weapon5': '0.170', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.250', 'FRAGCOUNT': '66.500'} [2024-08-06 08:00:24,014][52650] Updated weights for policy 0, policy_version 80841 (0.0021) [2024-08-06 08:00:25,078][52663] DAMAGECOUNT value on done: 931636.0 [2024-08-06 08:00:25,078][52663] Sum rewards: 71.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.679', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.106', 'AMMO4': '0.178', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.100', 'weapon3': '3.308', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '58.500'} [2024-08-06 08:00:25,360][52669] DAMAGECOUNT value on done: 938585.0 [2024-08-06 08:00:25,361][52669] Sum rewards: 73.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.242', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.116', 'weapon5': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '60.000'} [2024-08-06 08:00:25,670][52803] DAMAGECOUNT value on done: 856721.0 [2024-08-06 08:00:25,672][52803] Sum rewards: 71.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.548', 'AMMO5': '0.024', 'AMMO2': '0.058', 'AMMO3': '0.208', 'weapon4': '0.212', 'AMMO4': '0.292', 'weapon5': '0.336', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.728', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 08:00:26,444][52664] DAMAGECOUNT value on done: 966202.0 [2024-08-06 08:00:26,445][52664] Sum rewards: 83.142, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.562', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.070', 'weapon4': '0.150', 'AMMO3': '0.172', 'AMMO4': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.000', 'weapon3': '3.026', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '67.000'} [2024-08-06 08:00:26,815][52794] DAMAGECOUNT value on done: 923124.0 [2024-08-06 08:00:26,815][52794] Sum rewards: 74.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.231', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.058', 'AMMO3': '0.168', 'weapon2': '0.192', 'weapon4': '0.242', 'WEAPON3': '1.100', 'weapon3': '3.292', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '61.000'} [2024-08-06 08:00:26,959][52671] DAMAGECOUNT value on done: 938068.0 [2024-08-06 08:00:26,960][52671] Sum rewards: 59.380, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.542', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.121', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'AMMO3': '0.331', 'WEAPON3': '1.900', 'HITCOUNT': '2.860', 'weapon3': '3.240', 'DAMAGECOUNT': '14.322', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 662315008. Throughput: 0: 4365.3. Samples: 165587720. Policy #0 lag: (min: 0.0, avg: 4.2, max: 8.0) [2024-08-06 08:00:27,794][52567] Avg episode reward: [(0, '75.227')] [2024-08-06 08:00:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080850_662323200.pth... [2024-08-06 08:00:27,945][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080338_658128896.pth [2024-08-06 08:00:28,061][52663] DAMAGECOUNT value on done: 915193.0 [2024-08-06 08:00:28,061][52663] Sum rewards: 84.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.809', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.045', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.216', 'WEAPON3': '1.100', 'weapon3': '3.516', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '67.000'} [2024-08-06 08:00:28,287][52650] Updated weights for policy 0, policy_version 80851 (0.0013) [2024-08-06 08:00:28,318][52669] DAMAGECOUNT value on done: 933770.0 [2024-08-06 08:00:28,321][52669] Sum rewards: 75.257, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.094', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.178', 'weapon4': '0.192', 'AMMO3': '0.210', 'weapon2': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:28,971][52803] DAMAGECOUNT value on done: 865980.0 [2024-08-06 08:00:28,973][52803] Sum rewards: 78.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.425', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.162', 'AMMO3': '0.192', 'weapon5': '0.198', 'AMMO4': '0.199', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:29,391][52664] DAMAGECOUNT value on done: 954318.0 [2024-08-06 08:00:29,393][52664] Sum rewards: 73.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.690', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.163', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '61.000'} [2024-08-06 08:00:29,873][52794] DAMAGECOUNT value on done: 935363.0 [2024-08-06 08:00:29,875][52794] Sum rewards: 83.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.768', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.123', 'AMMO3': '0.167', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.050', 'weapon3': '3.422', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '67.000'} [2024-08-06 08:00:30,185][52671] DAMAGECOUNT value on done: 931836.0 [2024-08-06 08:00:30,186][52671] Sum rewards: 84.157, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.267', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon2': '0.174', 'AMMO3': '0.195', 'weapon5': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.378', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.585', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:31,308][52663] DAMAGECOUNT value on done: 911486.0 [2024-08-06 08:00:31,310][52663] Sum rewards: 68.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.137', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon4': '0.124', 'weapon5': '0.174', 'AMMO3': '0.249', 'AMMO4': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2024-08-06 08:00:31,490][52669] DAMAGECOUNT value on done: 940954.0 [2024-08-06 08:00:31,493][52669] Sum rewards: 77.331, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.078', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '62.000'} [2024-08-06 08:00:32,131][52803] DAMAGECOUNT value on done: 858154.0 [2024-08-06 08:00:32,132][52803] Sum rewards: 72.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.905', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.140', 'weapon5': '0.174', 'AMMO3': '0.188', 'AMMO4': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.032', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:32,191][52659] Large shaping reward 2.543 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.513, 171.0)] [2024-08-06 08:00:32,794][52567] Fps is (10 sec: 16384.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 662396928. Throughput: 0: 4362.9. Samples: 165600740. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:00:32,794][52567] Avg episode reward: [(0, '75.500')] [2024-08-06 08:00:32,833][52794] DAMAGECOUNT value on done: 917756.0 [2024-08-06 08:00:32,834][52794] Sum rewards: 78.165, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.110', 'AMMO5': '0.007', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.150', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.542', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:33,310][52671] DAMAGECOUNT value on done: 938339.0 [2024-08-06 08:00:33,318][52671] Sum rewards: 67.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.848', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.128', 'AMMO4': '0.165', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.143', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:33,345][52650] Updated weights for policy 0, policy_version 80861 (0.0024) [2024-08-06 08:00:33,572][52820] DAMAGECOUNT value on done: 856106.0 [2024-08-06 08:00:33,573][52820] Sum rewards: 84.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'weapon7': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.110', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'weapon2': '0.348', 'weapon4': '0.410', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '69.000'} [2024-08-06 08:00:33,904][52663] DAMAGECOUNT value on done: 921350.0 [2024-08-06 08:00:33,904][52663] Sum rewards: 82.811, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.714', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.112', 'AMMO4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '69.000'} [2024-08-06 08:00:34,033][52669] DAMAGECOUNT value on done: 941876.0 [2024-08-06 08:00:34,034][52669] Sum rewards: 75.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.085', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.106', 'AMMO4': '0.135', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:35,031][52670] DAMAGECOUNT value on done: 910832.0 [2024-08-06 08:00:35,032][52670] Sum rewards: 84.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.470', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.058', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.150', 'weapon3': '3.350', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '69.000'} [2024-08-06 08:00:35,201][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:00:35,232][52803] DAMAGECOUNT value on done: 872333.0 [2024-08-06 08:00:35,232][52803] Sum rewards: 78.664, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.130', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon4': '0.224', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:35,990][52671] DAMAGECOUNT value on done: 919602.0 [2024-08-06 08:00:35,990][52671] Sum rewards: 67.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.146', 'weapon4': '0.148', 'AMMO4': '0.169', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.250', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:36,104][52663] DAMAGECOUNT value on done: 923539.0 [2024-08-06 08:00:36,106][52663] Sum rewards: 74.036, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.322', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '60.000'} [2024-08-06 08:00:36,132][52794] DAMAGECOUNT value on done: 929815.0 [2024-08-06 08:00:36,133][52794] Sum rewards: 81.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.594', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.099', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:36,695][52820] DAMAGECOUNT value on done: 858173.0 [2024-08-06 08:00:36,697][52820] Sum rewards: 82.934, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.324', 'AMMO5': '0.013', 'AMMO2': '0.039', 'AMMO3': '0.157', 'AMMO4': '0.195', 'weapon5': '0.212', 'weapon2': '0.282', 'weapon4': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.028', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '64.500'} [2024-08-06 08:00:37,761][52650] Updated weights for policy 0, policy_version 80871 (0.0026) [2024-08-06 08:00:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 662495232. Throughput: 0: 4352.2. Samples: 165626750. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:00:37,794][52567] Avg episode reward: [(0, '75.371')] [2024-08-06 08:00:37,901][52670] DAMAGECOUNT value on done: 928312.0 [2024-08-06 08:00:37,902][52670] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO4': '0.193', 'weapon5': '0.206', 'weapon2': '0.230', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.000', 'weapon3': '3.246', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '60.000'} [2024-08-06 08:00:38,391][52803] DAMAGECOUNT value on done: 866996.0 [2024-08-06 08:00:38,402][52803] Sum rewards: 75.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.135', 'weapon4': '0.138', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '61.000'} [2024-08-06 08:00:39,227][52794] DAMAGECOUNT value on done: 927058.0 [2024-08-06 08:00:39,227][52794] Sum rewards: 70.151, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.110', 'weapon5': '0.120', 'AMMO3': '0.140', 'HEALTH': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.432', 'WEAPON3': '0.850', 'weapon3': '3.224', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '54.000'} [2024-08-06 08:00:39,260][52663] DAMAGECOUNT value on done: 927236.0 [2024-08-06 08:00:39,261][52663] Sum rewards: 70.595, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.616', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon5': '0.054', 'weapon4': '0.112', 'AMMO3': '0.236', 'AMMO4': '0.241', 'weapon2': '0.352', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:39,772][52820] DAMAGECOUNT value on done: 858743.0 [2024-08-06 08:00:39,773][52820] Sum rewards: 85.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.871', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO3': '0.196', 'weapon2': '0.342', 'WEAPON3': '1.200', 'weapon3': '3.490', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '68.000'} [2024-08-06 08:00:40,610][52670] DAMAGECOUNT value on done: 912380.0 [2024-08-06 08:00:40,611][52670] Sum rewards: 67.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.640', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO3': '0.173', 'AMMO4': '0.176', 'weapon2': '0.204', 'weapon4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.210', 'DAMAGECOUNT': '16.482', 'FRAGCOUNT': '54.000'} [2024-08-06 08:00:41,471][52803] DAMAGECOUNT value on done: 858785.0 [2024-08-06 08:00:41,471][52803] Sum rewards: 83.146, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.090', 'weapon4': '0.102', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.320', 'WEAPON3': '1.900', 'weapon3': '3.350', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.249', 'FRAGCOUNT': '72.000'} [2024-08-06 08:00:42,283][52794] DAMAGECOUNT value on done: 930672.0 [2024-08-06 08:00:42,285][52794] Sum rewards: 73.600, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.150', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.178', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.600', 'weapon3': '3.124', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:42,372][52663] DAMAGECOUNT value on done: 925180.0 [2024-08-06 08:00:42,374][52663] Sum rewards: 77.455, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.008', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.114', 'weapon2': '0.218', 'weapon5': '0.234', 'AMMO4': '0.248', 'AMMO3': '0.249', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:42,788][52650] Updated weights for policy 0, policy_version 80881 (0.0032) [2024-08-06 08:00:42,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 662577152. Throughput: 0: 4364.4. Samples: 165653240. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:00:42,794][52567] Avg episode reward: [(0, '75.326')] [2024-08-06 08:00:42,820][52666] DAMAGECOUNT value on done: 925055.0 [2024-08-06 08:00:42,820][52666] Sum rewards: 97.153, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.754', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.064', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '23.547', 'FRAGCOUNT': '80.000'} [2024-08-06 08:00:42,944][52820] DAMAGECOUNT value on done: 847911.0 [2024-08-06 08:00:42,944][52820] Sum rewards: 77.915, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.420', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.146', 'AMMO4': '0.199', 'weapon2': '0.206', 'AMMO3': '0.230', 'weapon4': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.068', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:43,955][52670] DAMAGECOUNT value on done: 915483.0 [2024-08-06 08:00:43,963][52670] Sum rewards: 84.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.273', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.088', 'AMMO4': '0.123', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '68.000'} [2024-08-06 08:00:44,701][52803] DAMAGECOUNT value on done: 875264.0 [2024-08-06 08:00:44,704][52803] Sum rewards: 77.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.142', 'AMMO4': '0.162', 'weapon5': '0.166', 'AMMO3': '0.234', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.226', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:44,752][52667] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:00:45,342][52794] DAMAGECOUNT value on done: 940724.0 [2024-08-06 08:00:45,342][52794] Sum rewards: 71.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.098', 'AMMO4': '0.163', 'weapon5': '0.190', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:45,507][52663] DAMAGECOUNT value on done: 930155.0 [2024-08-06 08:00:45,507][52663] Sum rewards: 101.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.524', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.125', 'weapon5': '0.128', 'weapon2': '0.192', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.454', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '23.199', 'FRAGCOUNT': '82.000'} [2024-08-06 08:00:45,557][52666] DAMAGECOUNT value on done: 921922.0 [2024-08-06 08:00:45,558][52666] Sum rewards: 76.788, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.437', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon5': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.248', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:46,028][52820] DAMAGECOUNT value on done: 858621.0 [2024-08-06 08:00:46,028][52820] Sum rewards: 75.053, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.042', 'AMMO4': '0.129', 'weapon5': '0.132', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.150', 'weapon3': '3.350', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '62.000'} [2024-08-06 08:00:46,649][52670] DAMAGECOUNT value on done: 927950.0 [2024-08-06 08:00:46,650][52670] Sum rewards: 77.271, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.042', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.150', 'weapon5': '0.218', 'AMMO3': '0.239', 'AMMO4': '0.262', 'weapon2': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:47,126][52650] Updated weights for policy 0, policy_version 80891 (0.0052) [2024-08-06 08:00:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 662667264. Throughput: 0: 4371.8. Samples: 165666400. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:00:47,794][52567] Avg episode reward: [(0, '75.627')] [2024-08-06 08:00:47,840][52803] DAMAGECOUNT value on done: 858310.0 [2024-08-06 08:00:47,840][52803] Sum rewards: 64.786, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.766', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.222', 'AMMO4': '0.226', 'AMMO3': '0.264', 'weapon5': '0.272', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.860', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '54.000'} [2024-08-06 08:00:48,225][52663] DAMAGECOUNT value on done: 934820.0 [2024-08-06 08:00:48,226][52663] Sum rewards: 74.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.144', 'weapon5': '0.164', 'AMMO3': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '61.500'} [2024-08-06 08:00:48,258][52666] DAMAGECOUNT value on done: 929780.0 [2024-08-06 08:00:48,260][52666] Sum rewards: 80.858, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.503', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO4': '0.144', 'weapon5': '0.154', 'weapon2': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:48,357][52794] DAMAGECOUNT value on done: 930062.0 [2024-08-06 08:00:48,358][52794] Sum rewards: 75.246, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.062', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '0.950', 'HITCOUNT': '3.380', 'weapon3': '3.438', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '60.000'} [2024-08-06 08:00:49,260][52820] DAMAGECOUNT value on done: 846144.0 [2024-08-06 08:00:49,269][52820] Sum rewards: 70.242, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.554', 'AMMO5': '0.013', 'ARMOR': '0.016', 'AMMO2': '0.045', 'weapon4': '0.176', 'weapon5': '0.190', 'AMMO4': '0.226', 'weapon2': '0.256', 'AMMO3': '0.257', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:49,466][52670] DAMAGECOUNT value on done: 915558.0 [2024-08-06 08:00:49,466][52670] Sum rewards: 61.230, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.388', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.086', 'weapon5': '0.182', 'AMMO3': '0.254', 'AMMO4': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.572', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '53.000'} [2024-08-06 08:00:50,937][52663] DAMAGECOUNT value on done: 915728.0 [2024-08-06 08:00:50,939][52663] Sum rewards: 66.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'weapon2': '0.292', 'WEAPON3': '1.550', 'HITCOUNT': '3.080', 'weapon3': '3.272', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '58.000'} [2024-08-06 08:00:50,957][52803] DAMAGECOUNT value on done: 867624.0 [2024-08-06 08:00:50,960][52803] Sum rewards: 84.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.036', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.030', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.106', 'AMMO4': '0.107', 'AMMO3': '0.213', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.760', 'FRAGCOUNT': '70.000'} [2024-08-06 08:00:51,351][52666] DAMAGECOUNT value on done: 923044.0 [2024-08-06 08:00:51,353][52666] Sum rewards: 84.541, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.054', 'AMMO4': '0.170', 'weapon5': '0.174', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.172', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '21.114', 'FRAGCOUNT': '70.000'} [2024-08-06 08:00:51,374][52665] DAMAGECOUNT value on done: 914358.0 [2024-08-06 08:00:51,375][52665] Sum rewards: 69.676, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.130', 'weapon5': '0.130', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.104', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:52,194][52650] Updated weights for policy 0, policy_version 80901 (0.0024) [2024-08-06 08:00:52,297][52670] DAMAGECOUNT value on done: 911620.0 [2024-08-06 08:00:52,301][52670] Sum rewards: 77.181, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.795', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.196', 'weapon2': '0.570', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '63.000'} [2024-08-06 08:00:52,408][52820] DAMAGECOUNT value on done: 851328.0 [2024-08-06 08:00:52,409][52820] Sum rewards: 65.315, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.692', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.124', 'AMMO3': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.164', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '54.000'} [2024-08-06 08:00:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 662757376. Throughput: 0: 4370.2. Samples: 165692510. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:00:52,794][52567] Avg episode reward: [(0, '75.288')] [2024-08-06 08:00:54,028][52803] DAMAGECOUNT value on done: 868339.0 [2024-08-06 08:00:54,032][52803] Sum rewards: 72.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.750', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.146', 'weapon2': '0.162', 'AMMO4': '0.210', 'AMMO3': '0.226', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '59.000'} [2024-08-06 08:00:54,159][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:00:54,203][52665] DAMAGECOUNT value on done: 926347.0 [2024-08-06 08:00:54,212][52665] Sum rewards: 79.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.086', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'weapon2': '0.484', 'WEAPON3': '1.600', 'weapon3': '3.136', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '66.000'} [2024-08-06 08:00:54,366][52666] DAMAGECOUNT value on done: 917582.0 [2024-08-06 08:00:54,367][52666] Sum rewards: 79.798, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.060', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.574', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '68.000'} [2024-08-06 08:00:55,193][52670] DAMAGECOUNT value on done: 914018.0 [2024-08-06 08:00:55,196][52670] Sum rewards: 77.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.610', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.150', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.332', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:55,446][52820] DAMAGECOUNT value on done: 854858.0 [2024-08-06 08:00:55,448][52820] Sum rewards: 56.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.213', 'weapon5': '0.214', 'AMMO4': '0.240', 'weapon4': '0.278', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.300', 'weapon3': '2.640', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '47.000'} [2024-08-06 08:00:56,326][52650] Updated weights for policy 0, policy_version 80911 (0.0014) [2024-08-06 08:00:56,940][52649] DAMAGECOUNT value on done: 897203.0 [2024-08-06 08:00:56,943][52649] Sum rewards: 65.768, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.078', 'weapon5': '0.160', 'AMMO3': '0.167', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.204', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '52.000'} [2024-08-06 08:00:57,158][52666] DAMAGECOUNT value on done: 920801.0 [2024-08-06 08:00:57,160][52666] Sum rewards: 62.880, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.230', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.166', 'AMMO4': '0.194', 'weapon2': '0.262', 'WEAPON4': '0.350', 'weapon5': '0.372', 'WEAPON5': '0.450', 'weapon4': '0.470', 'WEAPON3': '1.000', 'weapon3': '2.590', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '49.000'} [2024-08-06 08:00:57,235][52803] DAMAGECOUNT value on done: 874773.0 [2024-08-06 08:00:57,237][52803] Sum rewards: 79.031, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.928', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon2': '0.154', 'weapon5': '0.174', 'AMMO3': '0.221', 'AMMO4': '0.297', 'WEAPON5': '0.400', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '64.000'} [2024-08-06 08:00:57,344][52665] DAMAGECOUNT value on done: 918985.0 [2024-08-06 08:00:57,344][52665] Sum rewards: 68.149, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.954', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.124', 'weapon5': '0.132', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.317', 'WEAPON3': '1.850', 'HITCOUNT': '3.140', 'weapon3': '3.328', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 08:00:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 662839296. Throughput: 0: 4376.5. Samples: 165718760. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:00:57,794][52567] Avg episode reward: [(0, '75.203')] [2024-08-06 08:00:58,276][52670] DAMAGECOUNT value on done: 915025.0 [2024-08-06 08:00:58,279][52670] Sum rewards: 69.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.109', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.178', 'AMMO3': '0.199', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '57.000'} [2024-08-06 08:00:58,621][52614] Signal inference workers to stop experience collection... (14850 times) [2024-08-06 08:00:58,621][52614] Signal inference workers to resume experience collection... (14850 times) [2024-08-06 08:00:58,705][52650] InferenceWorker_p0-w0: stopping experience collection (14850 times) [2024-08-06 08:00:58,706][52650] InferenceWorker_p0-w0: resuming experience collection (14850 times) [2024-08-06 08:00:58,751][52820] DAMAGECOUNT value on done: 861340.0 [2024-08-06 08:00:58,752][52820] Sum rewards: 72.144, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.434', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.147', 'weapon4': '0.166', 'weapon2': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.124', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '65.000'} [2024-08-06 08:00:58,806][52795] DAMAGECOUNT value on done: 854308.0 [2024-08-06 08:00:58,807][52795] Sum rewards: 76.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.120', 'weapon4': '0.138', 'AMMO4': '0.164', 'AMMO3': '0.194', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '64.000'} [2024-08-06 08:01:00,128][52649] DAMAGECOUNT value on done: 893992.0 [2024-08-06 08:01:00,131][52649] Sum rewards: 73.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.292', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:00,197][52666] DAMAGECOUNT value on done: 918813.0 [2024-08-06 08:01:00,197][52666] Sum rewards: 83.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'weapon5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.028', 'WEAPON4': '0.100', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '70.000'} [2024-08-06 08:01:00,431][52803] DAMAGECOUNT value on done: 871700.0 [2024-08-06 08:01:00,434][52803] Sum rewards: 64.578, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.102', 'weapon5': '0.132', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.216', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '53.000'} [2024-08-06 08:01:00,478][52665] DAMAGECOUNT value on done: 920573.0 [2024-08-06 08:01:00,481][52665] Sum rewards: 75.358, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.385', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '64.000'} [2024-08-06 08:01:00,960][52668] DAMAGECOUNT value on done: 935203.0 [2024-08-06 08:01:00,961][52668] Sum rewards: 92.694, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.062', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.116', 'AMMO4': '0.122', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '22.185', 'FRAGCOUNT': '72.000'} [2024-08-06 08:01:01,184][52670] DAMAGECOUNT value on done: 910990.0 [2024-08-06 08:01:01,185][52670] Sum rewards: 84.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.944', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.094', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.330', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:01,510][52650] Updated weights for policy 0, policy_version 80921 (0.0025) [2024-08-06 08:01:01,958][52795] DAMAGECOUNT value on done: 844168.0 [2024-08-06 08:01:01,958][52795] Sum rewards: 68.907, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.004', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.048', 'AMMO4': '0.049', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.178', 'AMMO3': '0.276', 'WEAPON3': '1.650', 'weapon3': '3.430', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:01,973][52820] DAMAGECOUNT value on done: 868762.0 [2024-08-06 08:01:01,974][52820] Sum rewards: 73.651, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.240', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.098', 'AMMO3': '0.151', 'AMMO4': '0.155', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.484', 'WEAPON3': '0.900', 'weapon3': '3.164', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 662929408. Throughput: 0: 4367.1. Samples: 165731720. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:01:02,794][52567] Avg episode reward: [(0, '75.259')] [2024-08-06 08:01:03,027][52649] DAMAGECOUNT value on done: 908329.0 [2024-08-06 08:01:03,028][52649] Sum rewards: 75.548, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.686', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.130', 'weapon5': '0.130', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.312', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '62.500'} [2024-08-06 08:01:03,183][52666] DAMAGECOUNT value on done: 915324.0 [2024-08-06 08:01:03,183][52666] Sum rewards: 73.972, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.020', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.119', 'weapon5': '0.154', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '2.942', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:03,223][52665] DAMAGECOUNT value on done: 902958.0 [2024-08-06 08:01:03,223][52665] Sum rewards: 87.838, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.074', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.262', 'weapon2': '0.468', 'WEAPON3': '1.500', 'weapon3': '3.210', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '75.000'} [2024-08-06 08:01:03,509][52803] DAMAGECOUNT value on done: 866891.0 [2024-08-06 08:01:03,509][52803] Sum rewards: 71.604, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.742', 'WEAPON3': '1.050', 'weapon3': '2.930', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:03,865][52668] DAMAGECOUNT value on done: 934493.0 [2024-08-06 08:01:03,867][52668] Sum rewards: 76.365, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.329', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.090', 'AMMO3': '0.170', 'weapon5': '0.216', 'AMMO4': '0.220', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:03,970][52670] DAMAGECOUNT value on done: 924681.0 [2024-08-06 08:01:03,971][52670] Sum rewards: 78.521, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.092', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.052', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:05,133][52795] DAMAGECOUNT value on done: 850229.0 [2024-08-06 08:01:05,134][52795] Sum rewards: 72.232, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.038', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.232', 'weapon2': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.320', 'weapon3': '3.326', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:05,178][52820] DAMAGECOUNT value on done: 851041.0 [2024-08-06 08:01:05,180][52820] Sum rewards: 75.981, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.023', 'weapon5': '0.032', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '3.354', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '62.000'} [2024-08-06 08:01:05,830][52650] Updated weights for policy 0, policy_version 80931 (0.0021) [2024-08-06 08:01:05,873][52649] DAMAGECOUNT value on done: 908111.0 [2024-08-06 08:01:05,873][52649] Sum rewards: 75.511, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.035', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.170', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '3.326', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:05,903][52666] DAMAGECOUNT value on done: 926077.0 [2024-08-06 08:01:05,903][52666] Sum rewards: 73.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.204', 'weapon2': '0.692', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:06,062][52665] DAMAGECOUNT value on done: 906759.0 [2024-08-06 08:01:06,062][52665] Sum rewards: 76.614, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.254', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.130', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:06,725][52670] DAMAGECOUNT value on done: 908542.0 [2024-08-06 08:01:06,725][52670] Sum rewards: 75.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.040', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.198', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:06,919][52668] DAMAGECOUNT value on done: 930791.0 [2024-08-06 08:01:06,919][52668] Sum rewards: 69.696, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.727', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.014', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.143', 'weapon2': '0.736', 'WEAPON3': '0.950', 'weapon3': '3.114', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.839', 'FRAGCOUNT': '54.000'} [2024-08-06 08:01:07,698][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:01:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 663019520. Throughput: 0: 4356.9. Samples: 165757830. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:01:07,794][52567] Avg episode reward: [(0, '75.371')] [2024-08-06 08:01:08,178][52820] DAMAGECOUNT value on done: 860807.0 [2024-08-06 08:01:08,180][52820] Sum rewards: 67.569, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.365', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.224', 'AMMO3': '0.257', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.402', 'WEAPON3': '1.550', 'weapon3': '2.846', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '56.000'} [2024-08-06 08:01:08,312][52666] DAMAGECOUNT value on done: 918532.0 [2024-08-06 08:01:08,312][52666] Sum rewards: 78.953, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.118', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '64.500'} [2024-08-06 08:01:08,348][52795] DAMAGECOUNT value on done: 863010.0 [2024-08-06 08:01:08,349][52795] Sum rewards: 78.015, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.684', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.104', 'AMMO3': '0.138', 'weapon4': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '0.900', 'weapon3': '3.252', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:08,972][52649] DAMAGECOUNT value on done: 901034.0 [2024-08-06 08:01:08,972][52649] Sum rewards: 93.314, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.496', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.122', 'AMMO3': '0.171', 'weapon5': '0.186', 'weapon4': '0.236', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.458', 'FRAGCOUNT': '73.000'} [2024-08-06 08:01:09,253][52670] DAMAGECOUNT value on done: 924042.0 [2024-08-06 08:01:09,254][52670] Sum rewards: 88.453, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.834', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.178', 'AMMO3': '0.181', 'weapon4': '0.222', 'AMMO4': '0.232', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '70.000'} [2024-08-06 08:01:09,323][52665] DAMAGECOUNT value on done: 915733.0 [2024-08-06 08:01:09,325][52665] Sum rewards: 88.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.164', 'AMMO3': '0.252', 'WEAPON3': '1.500', 'weapon3': '3.612', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.898', 'FRAGCOUNT': '74.000'} [2024-08-06 08:01:10,018][52668] DAMAGECOUNT value on done: 934118.0 [2024-08-06 08:01:10,022][52668] Sum rewards: 88.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.561', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.038', 'weapon5': '0.138', 'AMMO4': '0.170', 'weapon2': '0.198', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.416', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '73.000'} [2024-08-06 08:01:10,631][52650] Updated weights for policy 0, policy_version 80941 (0.0010) [2024-08-06 08:01:11,329][52666] DAMAGECOUNT value on done: 922930.0 [2024-08-06 08:01:11,329][52666] Sum rewards: 67.212, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.078', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.136', 'AMMO3': '0.144', 'AMMO4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.564', 'WEAPON3': '0.950', 'weapon3': '3.072', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '52.000'} [2024-08-06 08:01:11,413][52795] DAMAGECOUNT value on done: 847651.0 [2024-08-06 08:01:11,416][52795] Sum rewards: 70.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.722', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.034', 'WEAPON5': '0.100', 'weapon5': '0.114', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.252', 'WEAPON3': '1.250', 'weapon3': '3.390', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '59.000'} [2024-08-06 08:01:11,431][52820] DAMAGECOUNT value on done: 873574.0 [2024-08-06 08:01:11,431][52820] Sum rewards: 84.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.267', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.037', 'weapon5': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.189', 'weapon2': '0.272', 'WEAPON3': '1.100', 'weapon3': '3.456', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '68.000'} [2024-08-06 08:01:12,120][52649] DAMAGECOUNT value on done: 908932.0 [2024-08-06 08:01:12,120][52649] Sum rewards: 92.030, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.909', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.032', 'weapon5': '0.050', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.229', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '22.248', 'FRAGCOUNT': '76.000'} [2024-08-06 08:01:12,353][52670] DAMAGECOUNT value on done: 927824.0 [2024-08-06 08:01:12,354][52670] Sum rewards: 81.359, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.435', 'AMMO2': '0.023', 'AMMO4': '0.115', 'AMMO3': '0.170', 'weapon4': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.336', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:12,420][52665] DAMAGECOUNT value on done: 916040.0 [2024-08-06 08:01:12,421][52665] Sum rewards: 72.205, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.048', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.138', 'weapon5': '0.152', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.310', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '57.000'} [2024-08-06 08:01:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 663101440. Throughput: 0: 4368.7. Samples: 165784310. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:01:12,794][52567] Avg episode reward: [(0, '76.451')] [2024-08-06 08:01:12,874][52668] DAMAGECOUNT value on done: 920599.0 [2024-08-06 08:01:12,875][52668] Sum rewards: 76.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.249', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.076', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.172', 'AMMO3': '0.195', 'weapon4': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '63.500'} [2024-08-06 08:01:14,045][52666] DAMAGECOUNT value on done: 907880.0 [2024-08-06 08:01:14,046][52666] Sum rewards: 71.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.270', 'WEAPON3': '1.350', 'HITCOUNT': '3.270', 'weapon3': '3.418', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:14,537][52795] DAMAGECOUNT value on done: 853612.0 [2024-08-06 08:01:14,539][52795] Sum rewards: 81.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.390', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.170', 'weapon4': '0.176', 'weapon5': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.050', 'weapon3': '2.866', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:14,650][52820] DAMAGECOUNT value on done: 862599.0 [2024-08-06 08:01:14,650][52820] Sum rewards: 73.325, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.729', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon5': '0.066', 'AMMO4': '0.108', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.368', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '2.828', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:15,115][52650] Updated weights for policy 0, policy_version 80951 (0.0026) [2024-08-06 08:01:15,222][52670] DAMAGECOUNT value on done: 921512.0 [2024-08-06 08:01:15,224][52670] Sum rewards: 74.510, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.230', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.070', 'AMMO4': '0.219', 'weapon5': '0.246', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.694', 'WEAPON3': '1.450', 'weapon3': '2.694', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:15,254][52649] DAMAGECOUNT value on done: 904800.0 [2024-08-06 08:01:15,256][52649] Sum rewards: 70.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.053', 'AMMO5': '0.013', 'weapon7': '0.014', 'AMMO2': '0.039', 'weapon4': '0.124', 'AMMO3': '0.162', 'weapon5': '0.178', 'AMMO4': '0.197', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '56.000'} [2024-08-06 08:01:15,497][52665] DAMAGECOUNT value on done: 920108.0 [2024-08-06 08:01:15,500][52665] Sum rewards: 64.459, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.610', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.146', 'weapon5': '0.176', 'AMMO3': '0.181', 'weapon2': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.172', 'DAMAGECOUNT': '15.510', 'FRAGCOUNT': '53.000'} [2024-08-06 08:01:15,639][52668] DAMAGECOUNT value on done: 930205.0 [2024-08-06 08:01:15,641][52668] Sum rewards: 78.303, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.945', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.006', 'WEAPON5': '0.050', 'weapon5': '0.090', 'AMMO3': '0.192', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:16,964][52666] DAMAGECOUNT value on done: 929072.0 [2024-08-06 08:01:16,964][52666] Sum rewards: 74.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.073', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.354', 'WEAPON3': '1.100', 'weapon3': '3.354', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:17,672][52649] DAMAGECOUNT value on done: 907428.0 [2024-08-06 08:01:17,673][52649] Sum rewards: 72.166, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.030', 'AMMO4': '0.033', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:17,699][52795] DAMAGECOUNT value on done: 863175.0 [2024-08-06 08:01:17,700][52795] Sum rewards: 88.523, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.046', 'weapon4': '0.064', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '20.604', 'FRAGCOUNT': '71.000'} [2024-08-06 08:01:17,782][52820] DAMAGECOUNT value on done: 862259.0 [2024-08-06 08:01:17,784][52820] Sum rewards: 65.328, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.360', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '3.188', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.321', 'FRAGCOUNT': '54.000'} [2024-08-06 08:01:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 663191552. Throughput: 0: 4367.8. Samples: 165797290. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:01:17,794][52567] Avg episode reward: [(0, '76.337')] [2024-08-06 08:01:17,910][52665] DAMAGECOUNT value on done: 912909.0 [2024-08-06 08:01:17,910][52665] Sum rewards: 83.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.791', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.067', 'weapon5': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:18,046][52670] DAMAGECOUNT value on done: 904945.0 [2024-08-06 08:01:18,046][52670] Sum rewards: 90.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.338', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.118', 'AMMO4': '0.161', 'AMMO3': '0.183', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '22.422', 'FRAGCOUNT': '73.000'} [2024-08-06 08:01:18,205][52668] DAMAGECOUNT value on done: 931268.0 [2024-08-06 08:01:18,207][52668] Sum rewards: 84.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.094', 'weapon5': '0.122', 'AMMO4': '0.142', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.338', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '70.500'} [2024-08-06 08:01:19,874][52650] Updated weights for policy 0, policy_version 80961 (0.0011) [2024-08-06 08:01:20,090][52666] DAMAGECOUNT value on done: 922301.0 [2024-08-06 08:01:20,090][52666] Sum rewards: 74.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.216', 'AMMO3': '0.240', 'WEAPON3': '1.400', 'HITCOUNT': '3.410', 'weapon3': '3.424', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '62.000'} [2024-08-06 08:01:20,201][52667] DAMAGECOUNT value on done: 926027.0 [2024-08-06 08:01:20,203][52667] Sum rewards: 73.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.096', 'weapon5': '0.140', 'AMMO3': '0.175', 'AMMO4': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:20,637][52668] DAMAGECOUNT value on done: 923092.0 [2024-08-06 08:01:20,639][52668] Sum rewards: 85.986, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.043', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.696', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '69.000'} [2024-08-06 08:01:20,813][52649] DAMAGECOUNT value on done: 903479.0 [2024-08-06 08:01:20,813][52649] Sum rewards: 74.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.155', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.054', 'weapon5': '0.170', 'AMMO3': '0.220', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '62.000'} [2024-08-06 08:01:20,877][52795] DAMAGECOUNT value on done: 854052.0 [2024-08-06 08:01:20,877][52795] Sum rewards: 69.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.166', 'weapon5': '0.210', 'AMMO4': '0.249', 'weapon4': '0.288', 'weapon2': '0.442', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.804', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '55.500'} [2024-08-06 08:01:21,025][52820] DAMAGECOUNT value on done: 859303.0 [2024-08-06 08:01:21,025][52820] Sum rewards: 80.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.044', 'AMMO4': '0.198', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon5': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:21,086][52665] DAMAGECOUNT value on done: 928986.0 [2024-08-06 08:01:21,087][52665] Sum rewards: 77.444, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO4': '0.198', 'weapon4': '0.214', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '2.950', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:21,144][52670] DAMAGECOUNT value on done: 918657.0 [2024-08-06 08:01:21,145][52670] Sum rewards: 69.952, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.060', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.320', 'WEAPON3': '0.950', 'HEALTH': '1.255', 'HITCOUNT': '2.930', 'weapon3': '3.392', 'DAMAGECOUNT': '16.539', 'FRAGCOUNT': '56.000'} [2024-08-06 08:01:22,440][52667] DAMAGECOUNT value on done: 942228.0 [2024-08-06 08:01:22,442][52667] Sum rewards: 89.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.560', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon4': '0.032', 'AMMO4': '0.046', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '21.330', 'FRAGCOUNT': '70.000'} [2024-08-06 08:01:22,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.9, 300 sec: 17439.2). Total num frames: 663273472. Throughput: 0: 4375.3. Samples: 165823640. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:22,802][52567] Avg episode reward: [(0, '76.429')] [2024-08-06 08:01:23,110][52662] DAMAGECOUNT value on done: 926828.0 [2024-08-06 08:01:23,111][52662] Sum rewards: 72.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.431', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.114', 'WEAPON4': '0.200', 'weapon2': '0.224', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon4': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:23,115][52666] DAMAGECOUNT value on done: 923062.0 [2024-08-06 08:01:23,116][52666] Sum rewards: 66.238, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.402', 'AMMO5': '0.022', 'AMMO2': '0.060', 'weapon4': '0.118', 'AMMO3': '0.270', 'weapon5': '0.292', 'weapon2': '0.298', 'AMMO4': '0.302', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.968', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '56.000'} [2024-08-06 08:01:23,473][52668] DAMAGECOUNT value on done: 926151.0 [2024-08-06 08:01:23,473][52668] Sum rewards: 82.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.580', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.076', 'AMMO3': '0.181', 'weapon5': '0.186', 'AMMO4': '0.205', 'weapon2': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.238', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '65.500'} [2024-08-06 08:01:23,857][52649] DAMAGECOUNT value on done: 898620.0 [2024-08-06 08:01:23,857][52649] Sum rewards: 76.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.536', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO3': '0.145', 'AMMO4': '0.202', 'weapon5': '0.210', 'weapon2': '0.268', 'weapon4': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.916', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:24,002][52795] DAMAGECOUNT value on done: 857713.0 [2024-08-06 08:01:24,004][52795] Sum rewards: 85.985, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.335', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.130', 'weapon5': '0.132', 'AMMO3': '0.155', 'AMMO4': '0.167', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.668', 'WEAPON3': '0.900', 'weapon3': '2.862', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:24,059][52665] DAMAGECOUNT value on done: 921540.0 [2024-08-06 08:01:24,061][52665] Sum rewards: 92.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.187', 'weapon4': '0.206', 'weapon2': '0.234', 'WEAPON3': '1.300', 'weapon3': '3.314', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '22.074', 'FRAGCOUNT': '73.000'} [2024-08-06 08:01:24,246][52670] DAMAGECOUNT value on done: 927377.0 [2024-08-06 08:01:24,247][52670] Sum rewards: 79.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.354', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.068', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon5': '0.178', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:24,260][52820] DAMAGECOUNT value on done: 862347.0 [2024-08-06 08:01:24,261][52820] Sum rewards: 66.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.124', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '56.000'} [2024-08-06 08:01:24,503][52650] Updated weights for policy 0, policy_version 80971 (0.0013) [2024-08-06 08:01:25,132][52667] DAMAGECOUNT value on done: 934637.0 [2024-08-06 08:01:25,133][52667] Sum rewards: 69.841, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.140', 'AMMO3': '0.160', 'weapon5': '0.188', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.598', 'WEAPON3': '1.050', 'weapon3': '2.856', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '55.000'} [2024-08-06 08:01:25,919][52662] DAMAGECOUNT value on done: 936121.0 [2024-08-06 08:01:25,921][52662] Sum rewards: 84.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.747', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.152', 'weapon2': '0.208', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.370', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '68.000'} [2024-08-06 08:01:25,999][52666] DAMAGECOUNT value on done: 915765.0 [2024-08-06 08:01:25,999][52666] Sum rewards: 86.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.422', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.859', 'FRAGCOUNT': '71.000'} [2024-08-06 08:01:26,094][52663] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:01:26,349][52649] DAMAGECOUNT value on done: 912969.0 [2024-08-06 08:01:26,349][52649] Sum rewards: 66.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO2': '0.010', 'AMMO5': '0.011', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.478', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '54.000'} [2024-08-06 08:01:26,444][52665] DAMAGECOUNT value on done: 918401.0 [2024-08-06 08:01:26,446][52665] Sum rewards: 72.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'AMMO3': '0.225', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.300', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:26,455][52668] DAMAGECOUNT value on done: 933566.0 [2024-08-06 08:01:26,457][52668] Sum rewards: 80.710, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.088', 'weapon5': '0.158', 'AMMO4': '0.203', 'AMMO3': '0.209', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:26,868][52670] DAMAGECOUNT value on done: 921961.0 [2024-08-06 08:01:26,868][52670] Sum rewards: 74.453, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.860', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.768', 'WEAPON3': '1.050', 'weapon3': '3.046', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:27,082][52795] DAMAGECOUNT value on done: 864002.0 [2024-08-06 08:01:27,082][52795] Sum rewards: 71.324, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.345', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.120', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.246', 'weapon2': '0.256', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.220', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:27,486][52820] DAMAGECOUNT value on done: 869107.0 [2024-08-06 08:01:27,490][52820] Sum rewards: 81.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.314', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 663363584. Throughput: 0: 4367.5. Samples: 165849780. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:27,795][52567] Avg episode reward: [(0, '76.167')] [2024-08-06 08:01:28,264][52667] DAMAGECOUNT value on done: 939998.0 [2024-08-06 08:01:28,265][52667] Sum rewards: 72.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.750', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon5': '0.176', 'AMMO4': '0.198', 'AMMO3': '0.256', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.204', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:28,619][52662] DAMAGECOUNT value on done: 935045.0 [2024-08-06 08:01:28,619][52662] Sum rewards: 80.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.204', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.142', 'AMMO3': '0.235', 'WEAPON3': '1.500', 'weapon3': '3.634', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:28,965][52666] DAMAGECOUNT value on done: 914352.0 [2024-08-06 08:01:28,965][52666] Sum rewards: 70.720, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.044', 'AMMO3': '0.191', 'weapon5': '0.198', 'AMMO4': '0.219', 'weapon2': '0.280', 'weapon4': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:29,007][52649] DAMAGECOUNT value on done: 921342.0 [2024-08-06 08:01:29,008][52649] Sum rewards: 86.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.066', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.140', 'weapon5': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '22.407', 'FRAGCOUNT': '70.000'} [2024-08-06 08:01:29,123][52665] DAMAGECOUNT value on done: 919140.0 [2024-08-06 08:01:29,124][52665] Sum rewards: 74.872, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.088', 'weapon4': '0.130', 'AMMO4': '0.199', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.600', 'weapon3': '3.046', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:29,136][52666] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:01:29,304][52650] Updated weights for policy 0, policy_version 80981 (0.0013) [2024-08-06 08:01:29,473][52668] DAMAGECOUNT value on done: 926365.0 [2024-08-06 08:01:29,475][52668] Sum rewards: 72.477, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.170', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO3': '0.159', 'AMMO4': '0.166', 'weapon2': '0.266', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:30,025][52670] DAMAGECOUNT value on done: 923041.0 [2024-08-06 08:01:30,027][52670] Sum rewards: 71.979, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.090', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO4': '0.193', 'AMMO3': '0.215', 'weapon5': '0.242', 'weapon4': '0.246', 'weapon2': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.992', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '59.000'} [2024-08-06 08:01:30,318][52795] DAMAGECOUNT value on done: 858439.0 [2024-08-06 08:01:30,319][52795] Sum rewards: 73.169, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.344', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.088', 'AMMO4': '0.200', 'weapon2': '0.214', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.350', 'weapon3': '3.390', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:30,596][52820] DAMAGECOUNT value on done: 868387.0 [2024-08-06 08:01:30,596][52820] Sum rewards: 79.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.972', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.099', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.282', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:31,364][52667] DAMAGECOUNT value on done: 941473.0 [2024-08-06 08:01:31,366][52667] Sum rewards: 74.945, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.062', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.276', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:31,678][52662] DAMAGECOUNT value on done: 924343.0 [2024-08-06 08:01:31,680][52662] Sum rewards: 80.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.162', 'AMMO3': '0.206', 'WEAPON3': '1.250', 'weapon3': '3.620', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:32,010][52666] DAMAGECOUNT value on done: 933953.0 [2024-08-06 08:01:32,010][52666] Sum rewards: 77.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.800', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.120', 'AMMO4': '0.139', 'AMMO3': '0.191', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.410', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:32,028][52649] DAMAGECOUNT value on done: 909928.0 [2024-08-06 08:01:32,029][52649] Sum rewards: 66.697, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.525', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.088', 'AMMO4': '0.236', 'weapon5': '0.248', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '2.840', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:32,100][52665] DAMAGECOUNT value on done: 914822.0 [2024-08-06 08:01:32,102][52665] Sum rewards: 76.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.359', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.262', 'AMMO3': '0.267', 'WEAPON3': '1.550', 'HITCOUNT': '3.270', 'weapon3': '3.396', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:32,180][52668] DAMAGECOUNT value on done: 921279.0 [2024-08-06 08:01:32,183][52668] Sum rewards: 67.664, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.130', 'AMMO5': '0.023', 'AMMO2': '0.053', 'AMMO3': '0.175', 'weapon4': '0.182', 'weapon5': '0.182', 'AMMO4': '0.266', 'WEAPON4': '0.400', 'weapon2': '0.482', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '54.000'} [2024-08-06 08:01:32,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 663453696. Throughput: 0: 4369.1. Samples: 165863010. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:32,802][52567] Avg episode reward: [(0, '76.394')] [2024-08-06 08:01:33,437][52795] DAMAGECOUNT value on done: 848815.0 [2024-08-06 08:01:33,438][52795] Sum rewards: 90.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.102', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.033', 'AMMO4': '0.166', 'weapon5': '0.176', 'AMMO3': '0.192', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '2.852', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.054', 'FRAGCOUNT': '73.000'} [2024-08-06 08:01:33,718][52820] DAMAGECOUNT value on done: 855915.0 [2024-08-06 08:01:33,718][52820] Sum rewards: 80.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'weapon4': '0.040', 'AMMO2': '0.045', 'weapon5': '0.196', 'AMMO4': '0.224', 'AMMO3': '0.255', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.228', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.967', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:33,824][52650] Updated weights for policy 0, policy_version 80991 (0.0027) [2024-08-06 08:01:34,437][52662] DAMAGECOUNT value on done: 941785.0 [2024-08-06 08:01:34,438][52662] Sum rewards: 68.098, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.760', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.156', 'weapon4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.954', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '54.000'} [2024-08-06 08:01:34,663][52667] DAMAGECOUNT value on done: 939950.0 [2024-08-06 08:01:34,664][52667] Sum rewards: 65.476, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.175', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.010', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'weapon4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'weapon2': '0.270', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.462', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '54.000'} [2024-08-06 08:01:34,827][52666] DAMAGECOUNT value on done: 907526.0 [2024-08-06 08:01:34,829][52666] Sum rewards: 76.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.695', 'AMMO5': '0.008', 'weapon4': '0.044', 'AMMO2': '0.048', 'weapon5': '0.082', 'AMMO4': '0.242', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.636', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:34,913][52668] DAMAGECOUNT value on done: 917938.0 [2024-08-06 08:01:34,914][52668] Sum rewards: 78.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.615', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.088', 'AMMO3': '0.178', 'weapon5': '0.202', 'AMMO4': '0.216', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:35,080][52649] DAMAGECOUNT value on done: 910715.0 [2024-08-06 08:01:35,082][52649] Sum rewards: 93.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.152', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.026', 'AMMO4': '0.035', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.177', 'FRAGCOUNT': '77.000'} [2024-08-06 08:01:35,166][52665] DAMAGECOUNT value on done: 919280.0 [2024-08-06 08:01:35,167][52665] Sum rewards: 70.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.251', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.104', 'AMMO3': '0.165', 'AMMO4': '0.171', 'weapon5': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:36,563][52795] DAMAGECOUNT value on done: 855985.0 [2024-08-06 08:01:36,564][52795] Sum rewards: 73.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.922', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.136', 'AMMO4': '0.165', 'AMMO3': '0.214', 'weapon2': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.280', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:37,550][52667] DAMAGECOUNT value on done: 934046.0 [2024-08-06 08:01:37,550][52667] Sum rewards: 77.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.042', 'AMMO4': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.234', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:37,641][52668] DAMAGECOUNT value on done: 916200.0 [2024-08-06 08:01:37,641][52668] Sum rewards: 76.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.974', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon4': '0.070', 'AMMO3': '0.206', 'weapon5': '0.216', 'weapon2': '0.292', 'AMMO4': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '64.000'} [2024-08-06 08:01:37,661][52662] DAMAGECOUNT value on done: 917467.0 [2024-08-06 08:01:37,663][52662] Sum rewards: 82.529, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.416', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.097', 'weapon5': '0.142', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'WEAPON3': '1.250', 'weapon3': '3.310', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '20.028', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:37,678][52666] DAMAGECOUNT value on done: 919460.0 [2024-08-06 08:01:37,678][52666] Sum rewards: 76.948, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.874', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon7': '0.034', 'AMMO4': '0.107', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.298', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 663543808. Throughput: 0: 4366.7. Samples: 165889010. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:37,802][52567] Avg episode reward: [(0, '77.218')] [2024-08-06 08:01:38,054][52649] DAMAGECOUNT value on done: 898178.0 [2024-08-06 08:01:38,056][52649] Sum rewards: 64.891, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.142', 'weapon4': '0.182', 'AMMO3': '0.247', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '57.000'} [2024-08-06 08:01:38,068][52665] DAMAGECOUNT value on done: 919168.0 [2024-08-06 08:01:38,068][52665] Sum rewards: 77.140, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.040', 'AMMO4': '0.133', 'weapon5': '0.136', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.294', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:38,884][52650] Updated weights for policy 0, policy_version 81001 (0.0025) [2024-08-06 08:01:39,937][52668] DAMAGECOUNT value on done: 911074.0 [2024-08-06 08:01:39,937][52668] Sum rewards: 68.971, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.125', 'AMMO5': '0.027', 'AMMO2': '0.079', 'weapon4': '0.194', 'AMMO3': '0.225', 'weapon5': '0.238', 'weapon2': '0.318', 'AMMO4': '0.393', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.888', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '59.500'} [2024-08-06 08:01:40,037][52795] DAMAGECOUNT value on done: 861037.0 [2024-08-06 08:01:40,038][52795] Sum rewards: 74.221, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.167', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '3.158', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:40,247][52662] DAMAGECOUNT value on done: 925392.0 [2024-08-06 08:01:40,247][52662] Sum rewards: 79.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.783', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.198', 'weapon4': '0.202', 'AMMO4': '0.231', 'weapon5': '0.252', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:40,532][52667] DAMAGECOUNT value on done: 928728.0 [2024-08-06 08:01:40,533][52667] Sum rewards: 70.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.874', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.187', 'weapon4': '0.206', 'weapon5': '0.216', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.010', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:41,241][52649] DAMAGECOUNT value on done: 911461.0 [2024-08-06 08:01:41,241][52649] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.193', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '62.000'} [2024-08-06 08:01:41,288][52665] DAMAGECOUNT value on done: 909579.0 [2024-08-06 08:01:41,290][52665] Sum rewards: 68.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.975', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.208', 'AMMO3': '0.212', 'AMMO4': '0.225', 'weapon2': '0.254', 'weapon4': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '57.000'} [2024-08-06 08:01:42,571][52668] DAMAGECOUNT value on done: 926874.0 [2024-08-06 08:01:42,572][52668] Sum rewards: 82.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.798', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.116', 'AMMO4': '0.183', 'weapon5': '0.190', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '68.000'} [2024-08-06 08:01:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 663633920. Throughput: 0: 4373.8. Samples: 165915580. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:42,794][52567] Avg episode reward: [(0, '76.804')] [2024-08-06 08:01:42,799][52662] DAMAGECOUNT value on done: 941583.0 [2024-08-06 08:01:42,800][52662] Sum rewards: 74.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.762', 'AMMO5': '0.014', 'AMMO2': '0.064', 'weapon5': '0.210', 'AMMO3': '0.226', 'weapon2': '0.314', 'AMMO4': '0.318', 'weapon4': '0.322', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.826', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '62.000'} [2024-08-06 08:01:43,269][52667] DAMAGECOUNT value on done: 933469.0 [2024-08-06 08:01:43,271][52667] Sum rewards: 81.475, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.320', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon4': '0.128', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'AMMO4': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:43,342][52795] DAMAGECOUNT value on done: 850019.0 [2024-08-06 08:01:43,342][52795] Sum rewards: 75.873, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.429', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.248', 'WEAPON3': '1.100', 'HITCOUNT': '3.430', 'weapon3': '3.508', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:43,434][52650] Updated weights for policy 0, policy_version 81011 (0.0036) [2024-08-06 08:01:44,458][52649] DAMAGECOUNT value on done: 891724.0 [2024-08-06 08:01:44,460][52649] Sum rewards: 79.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.168', 'weapon4': '0.180', 'AMMO4': '0.180', 'AMMO3': '0.193', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:44,484][52665] DAMAGECOUNT value on done: 913732.0 [2024-08-06 08:01:44,486][52665] Sum rewards: 77.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.746', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.213', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.464', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:45,539][52662] DAMAGECOUNT value on done: 929640.0 [2024-08-06 08:01:45,539][52662] Sum rewards: 84.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.246', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.132', 'AMMO3': '0.164', 'weapon5': '0.168', 'AMMO4': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.088', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:45,905][52668] DAMAGECOUNT value on done: 928608.0 [2024-08-06 08:01:45,905][52668] Sum rewards: 79.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.006', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.168', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.228', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:46,211][52647] DAMAGECOUNT value on done: 990551.0 [2024-08-06 08:01:46,211][52647] Sum rewards: 70.251, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon5': '0.058', 'weapon4': '0.064', 'AMMO4': '0.119', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '59.000'} [2024-08-06 08:01:46,223][52667] DAMAGECOUNT value on done: 939625.0 [2024-08-06 08:01:46,223][52667] Sum rewards: 73.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.145', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:46,401][52795] DAMAGECOUNT value on done: 858041.0 [2024-08-06 08:01:46,404][52795] Sum rewards: 72.121, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.590', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.054', 'weapon5': '0.144', 'AMMO4': '0.252', 'AMMO3': '0.288', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.190', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:47,459][52649] DAMAGECOUNT value on done: 912545.0 [2024-08-06 08:01:47,461][52649] Sum rewards: 72.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.127', 'AMMO3': '0.194', 'weapon2': '0.246', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.444', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:47,477][52665] DAMAGECOUNT value on done: 919524.0 [2024-08-06 08:01:47,483][52665] Sum rewards: 68.375, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.840', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO3': '0.152', 'AMMO4': '0.169', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.400', 'weapon2': '0.438', 'WEAPON3': '0.950', 'weapon3': '2.748', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '53.000'} [2024-08-06 08:01:47,605][52659] DAMAGECOUNT value on done: 931275.0 [2024-08-06 08:01:47,607][52659] Sum rewards: 74.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.710', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.026', 'AMMO4': '0.075', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 663715840. Throughput: 0: 4373.6. Samples: 165928530. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:47,794][52567] Avg episode reward: [(0, '76.736')] [2024-08-06 08:01:47,903][52650] Updated weights for policy 0, policy_version 81021 (0.0027) [2024-08-06 08:01:48,396][52662] DAMAGECOUNT value on done: 934330.0 [2024-08-06 08:01:48,397][52662] Sum rewards: 73.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.908', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon5': '0.178', 'AMMO4': '0.198', 'weapon2': '0.202', 'AMMO3': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.220', 'weapon3': '3.232', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:49,004][52668] DAMAGECOUNT value on done: 928935.0 [2024-08-06 08:01:49,004][52668] Sum rewards: 81.009, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.212', 'AMMO3': '0.247', 'weapon4': '0.274', 'weapon2': '0.280', 'AMMO4': '0.284', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.946', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.664', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:49,242][52647] DAMAGECOUNT value on done: 976780.0 [2024-08-06 08:01:49,242][52647] Sum rewards: 77.159, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.065', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.130', 'weapon4': '0.138', 'AMMO4': '0.172', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '3.006', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '61.000'} [2024-08-06 08:01:49,293][52667] DAMAGECOUNT value on done: 928630.0 [2024-08-06 08:01:49,293][52667] Sum rewards: 76.013, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.104', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.090', 'weapon5': '0.192', 'AMMO4': '0.241', 'AMMO3': '0.279', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.078', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '65.000'} [2024-08-06 08:01:49,462][52795] DAMAGECOUNT value on done: 858805.0 [2024-08-06 08:01:49,466][52795] Sum rewards: 86.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '71.000'} [2024-08-06 08:01:49,924][52659] DAMAGECOUNT value on done: 927455.0 [2024-08-06 08:01:49,927][52659] Sum rewards: 67.277, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.925', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.114', 'AMMO3': '0.171', 'weapon5': '0.178', 'AMMO4': '0.203', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.226', 'DAMAGECOUNT': '15.774', 'FRAGCOUNT': '54.000'} [2024-08-06 08:01:50,661][52649] DAMAGECOUNT value on done: 913089.0 [2024-08-06 08:01:50,661][52649] Sum rewards: 69.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.245', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.074', 'weapon5': '0.176', 'AMMO3': '0.203', 'AMMO4': '0.233', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.548', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '2.990', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '58.000'} [2024-08-06 08:01:51,332][52660] DAMAGECOUNT value on done: 924879.0 [2024-08-06 08:01:51,333][52660] Sum rewards: 81.739, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.450', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.132', 'AMMO4': '0.172', 'weapon5': '0.178', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:51,579][52662] DAMAGECOUNT value on done: 927947.0 [2024-08-06 08:01:51,582][52662] Sum rewards: 79.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.356', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.156', 'AMMO4': '0.175', 'weapon5': '0.198', 'AMMO3': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '2.970', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '69.000'} [2024-08-06 08:01:51,833][52668] DAMAGECOUNT value on done: 928673.0 [2024-08-06 08:01:51,833][52668] Sum rewards: 77.613, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.035', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.107', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '62.000'} [2024-08-06 08:01:52,205][52667] DAMAGECOUNT value on done: 930273.0 [2024-08-06 08:01:52,205][52667] Sum rewards: 78.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.717', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO4': '0.192', 'AMMO3': '0.241', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:52,239][52647] DAMAGECOUNT value on done: 983546.0 [2024-08-06 08:01:52,239][52647] Sum rewards: 73.779, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.472', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon5': '0.138', 'weapon4': '0.152', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'AMMO4': '0.266', 'WEAPON4': '0.350', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '57.000'} [2024-08-06 08:01:52,596][52795] DAMAGECOUNT value on done: 844861.0 [2024-08-06 08:01:52,597][52795] Sum rewards: 67.101, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.245', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.074', 'weapon5': '0.090', 'AMMO4': '0.141', 'AMMO3': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.050', 'HITCOUNT': '2.990', 'weapon3': '3.322', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '55.000'} [2024-08-06 08:01:52,633][52659] DAMAGECOUNT value on done: 939488.0 [2024-08-06 08:01:52,637][52659] Sum rewards: 74.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.090', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'WEAPON4': '0.200', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.464', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:52,737][52650] Updated weights for policy 0, policy_version 81031 (0.0012) [2024-08-06 08:01:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 663805952. Throughput: 0: 4383.8. Samples: 165955100. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:52,802][52567] Avg episode reward: [(0, '76.262')] [2024-08-06 08:01:53,590][52649] DAMAGECOUNT value on done: 904249.0 [2024-08-06 08:01:53,591][52649] Sum rewards: 69.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.124', 'weapon5': '0.124', 'AMMO4': '0.126', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '56.000'} [2024-08-06 08:01:54,454][52660] DAMAGECOUNT value on done: 917551.0 [2024-08-06 08:01:54,455][52660] Sum rewards: 83.518, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.309', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.082', 'AMMO3': '0.164', 'weapon5': '0.210', 'AMMO4': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.618', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '67.000'} [2024-08-06 08:01:54,617][52662] DAMAGECOUNT value on done: 928851.0 [2024-08-06 08:01:54,619][52662] Sum rewards: 91.523, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.112', 'weapon5': '0.128', 'AMMO4': '0.148', 'AMMO3': '0.157', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '3.134', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.595', 'FRAGCOUNT': '72.000'} [2024-08-06 08:01:55,039][52647] DAMAGECOUNT value on done: 981209.0 [2024-08-06 08:01:55,041][52647] Sum rewards: 63.881, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.810', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.176', 'weapon2': '0.222', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.702', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '52.000'} [2024-08-06 08:01:55,073][52668] DAMAGECOUNT value on done: 934031.0 [2024-08-06 08:01:55,073][52668] Sum rewards: 84.040, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.076', 'weapon5': '0.104', 'AMMO4': '0.112', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.200', 'weapon3': '3.368', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '68.000'} [2024-08-06 08:01:55,306][52659] DAMAGECOUNT value on done: 932332.0 [2024-08-06 08:01:55,306][52659] Sum rewards: 68.330, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.454', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon2': '0.154', 'weapon5': '0.168', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.312', 'WEAPON3': '1.800', 'weapon3': '3.294', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:55,377][52667] DAMAGECOUNT value on done: 938208.0 [2024-08-06 08:01:55,380][52667] Sum rewards: 69.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.180', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.116', 'AMMO4': '0.132', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.332', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '55.000'} [2024-08-06 08:01:55,839][52795] DAMAGECOUNT value on done: 856202.0 [2024-08-06 08:01:55,840][52795] Sum rewards: 83.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'AMMO3': '0.196', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.350', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '68.000'} [2024-08-06 08:01:57,021][52662] DAMAGECOUNT value on done: 921404.0 [2024-08-06 08:01:57,021][52662] Sum rewards: 71.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.012', 'weapon5': '0.036', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.374', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.432', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '60.000'} [2024-08-06 08:01:57,306][52660] DAMAGECOUNT value on done: 928903.0 [2024-08-06 08:01:57,307][52660] Sum rewards: 79.588, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.578', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.066', 'weapon5': '0.100', 'AMMO3': '0.145', 'AMMO4': '0.147', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '0.900', 'weapon3': '3.074', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 08:01:57,439][52650] Updated weights for policy 0, policy_version 81041 (0.0027) [2024-08-06 08:01:57,735][52647] DAMAGECOUNT value on done: 991505.0 [2024-08-06 08:01:57,735][52647] Sum rewards: 83.121, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.390', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.126', 'AMMO4': '0.217', 'AMMO3': '0.226', 'weapon5': '0.262', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.052', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '69.000'} [2024-08-06 08:01:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 663887872. Throughput: 0: 4372.4. Samples: 165981070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:01:57,794][52567] Avg episode reward: [(0, '76.271')] [2024-08-06 08:01:58,208][52659] DAMAGECOUNT value on done: 927118.0 [2024-08-06 08:01:58,210][52659] Sum rewards: 76.017, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.167', 'AMMO5': '0.020', 'AMMO2': '0.084', 'weapon5': '0.242', 'AMMO3': '0.257', 'weapon4': '0.272', 'weapon2': '0.314', 'AMMO4': '0.418', 'WEAPON5': '0.600', 'WEAPON4': '0.800', 'WEAPON3': '1.600', 'weapon3': '2.856', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '66.000'} [2024-08-06 08:01:58,260][52667] DAMAGECOUNT value on done: 929146.0 [2024-08-06 08:01:58,261][52667] Sum rewards: 61.680, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.925', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.060', 'AMMO4': '0.099', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.000', 'HITCOUNT': '3.160', 'weapon3': '3.162', 'DAMAGECOUNT': '15.846', 'FRAGCOUNT': '48.000'} [2024-08-06 08:01:58,958][52795] DAMAGECOUNT value on done: 863946.0 [2024-08-06 08:01:58,958][52795] Sum rewards: 73.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.374', 'AMMO5': '0.027', 'AMMO2': '0.076', 'AMMO3': '0.202', 'weapon2': '0.288', 'AMMO4': '0.379', 'weapon5': '0.408', 'weapon4': '0.412', 'WEAPON5': '0.800', 'WEAPON4': '0.850', 'WEAPON3': '1.150', 'weapon3': '2.514', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '60.000'} [2024-08-06 08:02:00,070][52662] DAMAGECOUNT value on done: 931650.0 [2024-08-06 08:02:00,071][52662] Sum rewards: 86.672, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.430', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.132', 'AMMO4': '0.150', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'weapon3': '3.402', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.363', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:00,396][52660] DAMAGECOUNT value on done: 941547.0 [2024-08-06 08:02:00,396][52660] Sum rewards: 77.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.381', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.100', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '63.000'} [2024-08-06 08:02:00,870][52647] DAMAGECOUNT value on done: 987014.0 [2024-08-06 08:02:00,871][52647] Sum rewards: 63.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.050', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.062', 'weapon5': '0.178', 'AMMO3': '0.208', 'AMMO4': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.634', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '53.000'} [2024-08-06 08:02:01,242][52659] DAMAGECOUNT value on done: 930278.0 [2024-08-06 08:02:01,245][52659] Sum rewards: 77.123, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.126', 'AMMO3': '0.178', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.500'} [2024-08-06 08:02:01,270][52667] DAMAGECOUNT value on done: 935695.0 [2024-08-06 08:02:01,271][52667] Sum rewards: 82.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.410', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.152', 'AMMO4': '0.155', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '67.000'} [2024-08-06 08:02:01,960][52650] Updated weights for policy 0, policy_version 81051 (0.0023) [2024-08-06 08:02:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 663977984. Throughput: 0: 4379.6. Samples: 165994370. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:02:02,794][52567] Avg episode reward: [(0, '76.057')] [2024-08-06 08:02:03,106][52662] DAMAGECOUNT value on done: 922656.0 [2024-08-06 08:02:03,106][52662] Sum rewards: 76.146, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.665', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.200', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.392', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '61.000'} [2024-08-06 08:02:03,281][52660] DAMAGECOUNT value on done: 922860.0 [2024-08-06 08:02:03,281][52660] Sum rewards: 89.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.490', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.163', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon4': '0.268', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.369', 'FRAGCOUNT': '76.000'} [2024-08-06 08:02:03,862][52667] DAMAGECOUNT value on done: 941612.0 [2024-08-06 08:02:03,862][52667] Sum rewards: 82.904, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.308', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.041', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.259', 'weapon2': '0.328', 'WEAPON3': '1.700', 'weapon3': '3.394', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:03,881][52647] DAMAGECOUNT value on done: 989879.0 [2024-08-06 08:02:03,882][52647] Sum rewards: 73.389, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'weapon5': '0.004', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'weapon4': '0.018', 'AMMO2': '0.019', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.596', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '60.000'} [2024-08-06 08:02:04,281][52659] DAMAGECOUNT value on done: 931553.0 [2024-08-06 08:02:04,283][52659] Sum rewards: 71.626, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.570', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.182', 'AMMO4': '0.227', 'weapon4': '0.258', 'AMMO3': '0.274', 'weapon2': '0.316', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.928', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '63.000'} [2024-08-06 08:02:06,165][52662] DAMAGECOUNT value on done: 941105.0 [2024-08-06 08:02:06,165][52662] Sum rewards: 74.411, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.400', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.060', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'AMMO3': '0.300', 'WEAPON3': '1.850', 'weapon3': '3.378', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '66.000'} [2024-08-06 08:02:06,325][52660] DAMAGECOUNT value on done: 919612.0 [2024-08-06 08:02:06,327][52660] Sum rewards: 71.381, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.954', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon2': '0.158', 'weapon5': '0.164', 'AMMO3': '0.194', 'AMMO4': '0.216', 'weapon4': '0.372', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '58.000'} [2024-08-06 08:02:06,475][52647] DAMAGECOUNT value on done: 966282.0 [2024-08-06 08:02:06,475][52647] Sum rewards: 91.556, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.606', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.158', 'weapon5': '0.184', 'AMMO4': '0.189', 'AMMO3': '0.206', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.112', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '75.000'} [2024-08-06 08:02:06,617][52667] DAMAGECOUNT value on done: 941279.0 [2024-08-06 08:02:06,618][52667] Sum rewards: 64.758, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.044', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.098', 'AMMO4': '0.204', 'AMMO3': '0.209', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '55.500'} [2024-08-06 08:02:06,776][52650] Updated weights for policy 0, policy_version 81061 (0.0032) [2024-08-06 08:02:07,260][52659] DAMAGECOUNT value on done: 930596.0 [2024-08-06 08:02:07,261][52659] Sum rewards: 79.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.162', 'weapon2': '0.180', 'AMMO4': '0.198', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '65.000'} [2024-08-06 08:02:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 664068096. Throughput: 0: 4376.9. Samples: 166020600. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:02:07,794][52567] Avg episode reward: [(0, '76.044')] [2024-08-06 08:02:08,718][52662] DAMAGECOUNT value on done: 931998.0 [2024-08-06 08:02:08,719][52662] Sum rewards: 73.246, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.844', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.098', 'weapon5': '0.136', 'AMMO4': '0.150', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.700', 'weapon3': '3.148', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '64.000'} [2024-08-06 08:02:08,984][52660] DAMAGECOUNT value on done: 925269.0 [2024-08-06 08:02:08,984][52660] Sum rewards: 65.505, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.021', 'AMMO5': '0.022', 'AMMO2': '0.056', 'weapon4': '0.120', 'AMMO3': '0.222', 'AMMO4': '0.282', 'weapon5': '0.342', 'weapon2': '0.374', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.784', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '54.000'} [2024-08-06 08:02:09,298][52647] DAMAGECOUNT value on done: 980638.0 [2024-08-06 08:02:09,298][52647] Sum rewards: 77.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.152', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.136', 'weapon4': '0.204', 'weapon2': '0.208', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.222', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '64.000'} [2024-08-06 08:02:09,442][52667] DAMAGECOUNT value on done: 937166.0 [2024-08-06 08:02:09,443][52667] Sum rewards: 78.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.018', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.504', 'WEAPON3': '1.350', 'weapon3': '3.258', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '65.000'} [2024-08-06 08:02:10,317][52659] DAMAGECOUNT value on done: 929505.0 [2024-08-06 08:02:10,319][52659] Sum rewards: 85.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.752', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.110', 'AMMO3': '0.263', 'weapon2': '0.386', 'WEAPON3': '1.450', 'weapon3': '3.160', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '72.000'} [2024-08-06 08:02:11,509][52650] Updated weights for policy 0, policy_version 81071 (0.0021) [2024-08-06 08:02:11,638][52662] DAMAGECOUNT value on done: 922222.0 [2024-08-06 08:02:11,639][52662] Sum rewards: 76.011, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.800', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.124', 'weapon5': '0.126', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO3': '0.290', 'WEAPON3': '1.700', 'weapon3': '3.246', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '66.000'} [2024-08-06 08:02:11,885][52660] DAMAGECOUNT value on done: 933284.0 [2024-08-06 08:02:11,885][52660] Sum rewards: 67.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.112', 'weapon5': '0.116', 'AMMO4': '0.224', 'weapon2': '0.230', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.240', 'weapon3': '3.346', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '56.000'} [2024-08-06 08:02:11,947][52667] DAMAGECOUNT value on done: 934593.0 [2024-08-06 08:02:11,947][52667] Sum rewards: 78.364, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.028', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.226', 'WEAPON3': '1.250', 'weapon3': '3.580', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '64.000'} [2024-08-06 08:02:12,329][52647] DAMAGECOUNT value on done: 978256.0 [2024-08-06 08:02:12,331][52647] Sum rewards: 78.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.244', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.086', 'weapon4': '0.094', 'AMMO4': '0.130', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.000'} [2024-08-06 08:02:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 664150016. Throughput: 0: 4372.2. Samples: 166046530. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:12,794][52567] Avg episode reward: [(0, '75.973')] [2024-08-06 08:02:13,448][52659] DAMAGECOUNT value on done: 937475.0 [2024-08-06 08:02:13,451][52659] Sum rewards: 84.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.691', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'WEAPON1': '0.030', 'weapon4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.242', 'weapon2': '0.542', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.883', 'FRAGCOUNT': '70.000'} [2024-08-06 08:02:14,570][52662] DAMAGECOUNT value on done: 925582.0 [2024-08-06 08:02:14,573][52662] Sum rewards: 72.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.210', 'weapon2': '0.328', 'WEAPON3': '1.200', 'HITCOUNT': '3.410', 'weapon3': '3.416', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '60.000'} [2024-08-06 08:02:14,739][52667] DAMAGECOUNT value on done: 938190.0 [2024-08-06 08:02:14,739][52667] Sum rewards: 74.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.107', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.104', 'weapon5': '0.146', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '3.050', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 08:02:14,816][52647] DAMAGECOUNT value on done: 976773.0 [2024-08-06 08:02:14,817][52647] Sum rewards: 80.923, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'AMMO3': '0.171', 'weapon5': '0.176', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.326', 'weapon2': '0.372', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '62.000'} [2024-08-06 08:02:15,216][52660] DAMAGECOUNT value on done: 922857.0 [2024-08-06 08:02:15,217][52660] Sum rewards: 68.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.110', 'AMMO4': '0.139', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.212', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '55.000'} [2024-08-06 08:02:16,071][52650] Updated weights for policy 0, policy_version 81081 (0.0024) [2024-08-06 08:02:16,298][52659] DAMAGECOUNT value on done: 925135.0 [2024-08-06 08:02:16,298][52659] Sum rewards: 79.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO2': '0.028', 'weapon5': '0.056', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '66.000'} [2024-08-06 08:02:17,290][52647] DAMAGECOUNT value on done: 969542.0 [2024-08-06 08:02:17,290][52647] Sum rewards: 83.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.012', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon5': '0.258', 'AMMO3': '0.268', 'weapon4': '0.324', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.764', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:17,653][52662] DAMAGECOUNT value on done: 922624.0 [2024-08-06 08:02:17,654][52662] Sum rewards: 85.322, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.823', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.062', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.476', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '70.000'} [2024-08-06 08:02:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 664240128. Throughput: 0: 4369.8. Samples: 166059650. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:17,795][52567] Avg episode reward: [(0, '76.109')] [2024-08-06 08:02:18,130][52660] DAMAGECOUNT value on done: 918339.0 [2024-08-06 08:02:18,130][52660] Sum rewards: 68.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.912', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.231', 'weapon5': '0.246', 'weapon2': '0.256', 'weapon4': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.904', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '59.000'} [2024-08-06 08:02:19,259][52659] DAMAGECOUNT value on done: 935362.0 [2024-08-06 08:02:19,259][52659] Sum rewards: 67.351, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.080', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'weapon2': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '54.000'} [2024-08-06 08:02:20,172][52647] DAMAGECOUNT value on done: 979515.0 [2024-08-06 08:02:20,172][52647] Sum rewards: 76.885, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.185', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '63.000'} [2024-08-06 08:02:20,663][52660] DAMAGECOUNT value on done: 926534.0 [2024-08-06 08:02:20,665][52660] Sum rewards: 86.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.284', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon4': '0.256', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:20,993][52650] Updated weights for policy 0, policy_version 81091 (0.0020) [2024-08-06 08:02:22,419][52659] DAMAGECOUNT value on done: 929449.0 [2024-08-06 08:02:22,422][52659] Sum rewards: 66.813, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.252', 'AMMO3': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '58.000'} [2024-08-06 08:02:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 664330240. Throughput: 0: 4378.0. Samples: 166086020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:22,794][52567] Avg episode reward: [(0, '76.178')] [2024-08-06 08:02:23,070][52647] DAMAGECOUNT value on done: 974415.0 [2024-08-06 08:02:23,071][52647] Sum rewards: 89.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.176', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.088', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.150', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:23,085][52660] DAMAGECOUNT value on done: 920785.0 [2024-08-06 08:02:23,086][52660] Sum rewards: 75.768, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.078', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.424', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '65.000'} [2024-08-06 08:02:25,302][52650] Updated weights for policy 0, policy_version 81101 (0.0014) [2024-08-06 08:02:25,491][52647] DAMAGECOUNT value on done: 980546.0 [2024-08-06 08:02:25,491][52647] Sum rewards: 75.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.995', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.132', 'weapon5': '0.212', 'AMMO4': '0.219', 'AMMO3': '0.225', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '63.000'} [2024-08-06 08:02:25,598][52659] DAMAGECOUNT value on done: 926290.0 [2024-08-06 08:02:25,598][52659] Sum rewards: 79.556, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.215', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.052', 'weapon4': '0.064', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.388', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '66.000'} [2024-08-06 08:02:25,999][52660] DAMAGECOUNT value on done: 919436.0 [2024-08-06 08:02:25,999][52660] Sum rewards: 79.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.027', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.100', 'AMMO3': '0.222', 'AMMO4': '0.223', 'weapon5': '0.298', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.500'} [2024-08-06 08:02:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 664412160. Throughput: 0: 4364.0. Samples: 166111960. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:27,803][52567] Avg episode reward: [(0, '76.354')] [2024-08-06 08:02:27,850][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081106_664420352.pth... [2024-08-06 08:02:28,018][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080594_660226048.pth [2024-08-06 08:02:28,380][52647] DAMAGECOUNT value on done: 982820.0 [2024-08-06 08:02:28,380][52647] Sum rewards: 77.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.130', 'weapon4': '0.164', 'weapon2': '0.190', 'AMMO4': '0.195', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.328', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '63.000'} [2024-08-06 08:02:28,710][52660] DAMAGECOUNT value on done: 931144.0 [2024-08-06 08:02:28,711][52660] Sum rewards: 81.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.804', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.138', 'AMMO4': '0.176', 'AMMO3': '0.197', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '67.000'} [2024-08-06 08:02:28,925][52659] DAMAGECOUNT value on done: 930688.0 [2024-08-06 08:02:28,926][52659] Sum rewards: 81.862, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.130', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.058', 'AMMO4': '0.115', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.295', 'weapon2': '0.326', 'WEAPON3': '1.850', 'weapon3': '3.312', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '73.000'} [2024-08-06 08:02:30,374][52811] DAMAGECOUNT value on done: 881650.0 [2024-08-06 08:02:30,374][52811] Sum rewards: 59.922, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.390', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.054', 'weapon5': '0.138', 'AMMO3': '0.242', 'AMMO4': '0.250', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.920', 'weapon3': '3.212', 'DAMAGECOUNT': '15.342', 'FRAGCOUNT': '52.000'} [2024-08-06 08:02:30,519][52650] Updated weights for policy 0, policy_version 81111 (0.0051) [2024-08-06 08:02:31,522][52660] DAMAGECOUNT value on done: 943601.0 [2024-08-06 08:02:31,523][52660] Sum rewards: 72.011, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'weapon5': '0.102', 'AMMO3': '0.138', 'WEAPON5': '0.200', 'weapon2': '0.262', 'weapon4': '0.320', 'WEAPON3': '1.000', 'weapon3': '2.864', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '56.000'} [2024-08-06 08:02:31,597][52647] DAMAGECOUNT value on done: 967749.0 [2024-08-06 08:02:31,598][52647] Sum rewards: 82.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.830', 'AMMO5': '0.012', 'AMMO2': '0.066', 'weapon4': '0.168', 'weapon5': '0.178', 'AMMO3': '0.247', 'weapon2': '0.258', 'AMMO4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '70.000'} [2024-08-06 08:02:32,152][52659] DAMAGECOUNT value on done: 928821.0 [2024-08-06 08:02:32,153][52659] Sum rewards: 79.178, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.214', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.088', 'AMMO4': '0.113', 'weapon5': '0.134', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '65.000'} [2024-08-06 08:02:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 664494080. Throughput: 0: 4353.3. Samples: 166124430. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:32,794][52567] Avg episode reward: [(0, '76.167')] [2024-08-06 08:02:33,426][52811] DAMAGECOUNT value on done: 864737.0 [2024-08-06 08:02:33,426][52811] Sum rewards: 71.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.156', 'AMMO3': '0.203', 'weapon2': '0.372', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '60.000'} [2024-08-06 08:02:34,329][52647] DAMAGECOUNT value on done: 975525.0 [2024-08-06 08:02:34,331][52647] Sum rewards: 86.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.684', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon2': '0.166', 'weapon4': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.203', 'weapon5': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:34,424][52658] DAMAGECOUNT value on done: 932743.0 [2024-08-06 08:02:34,426][52658] Sum rewards: 75.210, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.064', 'HEALTH': '0.123', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.326', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '61.000'} [2024-08-06 08:02:34,542][52660] DAMAGECOUNT value on done: 923839.0 [2024-08-06 08:02:34,543][52660] Sum rewards: 84.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.115', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.070', 'AMMO3': '0.181', 'weapon5': '0.188', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.399', 'FRAGCOUNT': '67.000'} [2024-08-06 08:02:35,265][52659] DAMAGECOUNT value on done: 938594.0 [2024-08-06 08:02:35,266][52659] Sum rewards: 87.115, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.170', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.156', 'AMMO3': '0.208', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:35,310][52650] Updated weights for policy 0, policy_version 81121 (0.0019) [2024-08-06 08:02:35,326][52667] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:02:36,464][52811] DAMAGECOUNT value on done: 860744.0 [2024-08-06 08:02:36,465][52811] Sum rewards: 80.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.095', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon4': '0.102', 'weapon5': '0.130', 'AMMO3': '0.178', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '65.000'} [2024-08-06 08:02:36,866][52658] DAMAGECOUNT value on done: 934785.0 [2024-08-06 08:02:36,867][52658] Sum rewards: 79.673, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.445', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.176', 'AMMO4': '0.227', 'AMMO3': '0.235', 'weapon2': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '66.000'} [2024-08-06 08:02:37,326][52647] DAMAGECOUNT value on done: 968068.0 [2024-08-06 08:02:37,327][52647] Sum rewards: 82.330, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.055', 'AMMO5': '0.019', 'weapon4': '0.040', 'AMMO2': '0.054', 'weapon5': '0.064', 'AMMO3': '0.259', 'AMMO4': '0.269', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.346', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '72.000'} [2024-08-06 08:02:37,616][52660] DAMAGECOUNT value on done: 930565.0 [2024-08-06 08:02:37,616][52660] Sum rewards: 82.485, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.024', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.092', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '70.000'} [2024-08-06 08:02:37,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 664592384. Throughput: 0: 4344.4. Samples: 166150600. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:37,794][52567] Avg episode reward: [(0, '76.893')] [2024-08-06 08:02:37,882][52659] DAMAGECOUNT value on done: 923802.0 [2024-08-06 08:02:37,882][52659] Sum rewards: 79.439, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.250', 'WEAPON3': '1.000', 'HITCOUNT': '3.240', 'weapon3': '3.478', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '63.000'} [2024-08-06 08:02:39,666][52650] Updated weights for policy 0, policy_version 81131 (0.0017) [2024-08-06 08:02:39,736][52811] DAMAGECOUNT value on done: 864958.0 [2024-08-06 08:02:39,736][52811] Sum rewards: 71.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.684', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO3': '0.218', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.584', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '59.000'} [2024-08-06 08:02:39,819][52647] DAMAGECOUNT value on done: 971360.0 [2024-08-06 08:02:39,819][52647] Sum rewards: 72.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.836', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.122', 'AMMO4': '0.175', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon4': '0.432', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '2.742', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '58.000'} [2024-08-06 08:02:39,954][52658] DAMAGECOUNT value on done: 936138.0 [2024-08-06 08:02:39,957][52658] Sum rewards: 82.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.090', 'weapon4': '0.112', 'AMMO4': '0.181', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '69.000'} [2024-08-06 08:02:40,494][52660] DAMAGECOUNT value on done: 928133.0 [2024-08-06 08:02:40,497][52660] Sum rewards: 80.201, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.310', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO4': '0.173', 'weapon5': '0.184', 'weapon2': '0.228', 'AMMO3': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.234', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '68.000'} [2024-08-06 08:02:40,700][52659] DAMAGECOUNT value on done: 936351.0 [2024-08-06 08:02:40,700][52659] Sum rewards: 84.824, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.605', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.076', 'AMMO4': '0.099', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'weapon2': '0.430', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.558', 'FRAGCOUNT': '70.000'} [2024-08-06 08:02:41,429][52664] DAMAGECOUNT value on done: 958301.0 [2024-08-06 08:02:41,430][52664] Sum rewards: 68.992, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.156', 'AMMO4': '0.176', 'AMMO3': '0.208', 'weapon5': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.718', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '57.000'} [2024-08-06 08:02:42,796][52567] Fps is (10 sec: 18018.1, 60 sec: 17339.1, 300 sec: 17466.9). Total num frames: 664674304. Throughput: 0: 4348.7. Samples: 166176770. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:42,797][52567] Avg episode reward: [(0, '76.745')] [2024-08-06 08:02:42,800][52811] DAMAGECOUNT value on done: 867512.0 [2024-08-06 08:02:42,802][52811] Sum rewards: 84.552, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.286', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.132', 'AMMO4': '0.147', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.326', 'FRAGCOUNT': '68.000'} [2024-08-06 08:02:43,167][52658] DAMAGECOUNT value on done: 933353.0 [2024-08-06 08:02:43,169][52658] Sum rewards: 77.944, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.596', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.114', 'weapon5': '0.154', 'AMMO3': '0.201', 'weapon2': '0.208', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '62.000'} [2024-08-06 08:02:43,418][52659] DAMAGECOUNT value on done: 927281.0 [2024-08-06 08:02:43,419][52659] Sum rewards: 67.183, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.196', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.094', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.256', 'weapon4': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.168', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '59.000'} [2024-08-06 08:02:43,607][52660] DAMAGECOUNT value on done: 919210.0 [2024-08-06 08:02:43,608][52660] Sum rewards: 68.644, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.215', 'AMMO5': '0.009', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.142', 'AMMO3': '0.148', 'weapon4': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.200', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '54.000'} [2024-08-06 08:02:44,177][52664] DAMAGECOUNT value on done: 964888.0 [2024-08-06 08:02:44,178][52664] Sum rewards: 74.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.313', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.142', 'AMMO3': '0.185', 'AMMO4': '0.203', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '60.000'} [2024-08-06 08:02:44,592][52650] Updated weights for policy 0, policy_version 81141 (0.0019) [2024-08-06 08:02:45,946][52811] DAMAGECOUNT value on done: 884274.0 [2024-08-06 08:02:45,946][52811] Sum rewards: 82.649, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '67.000'} [2024-08-06 08:02:46,087][52658] DAMAGECOUNT value on done: 926697.0 [2024-08-06 08:02:46,087][52658] Sum rewards: 69.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.180', 'AMMO3': '0.191', 'weapon5': '0.192', 'AMMO4': '0.220', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '57.000'} [2024-08-06 08:02:46,625][52660] DAMAGECOUNT value on done: 920313.0 [2024-08-06 08:02:46,626][52660] Sum rewards: 90.279, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.795', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.146', 'AMMO3': '0.162', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.232', 'FRAGCOUNT': '72.000'} [2024-08-06 08:02:47,139][52664] DAMAGECOUNT value on done: 967661.0 [2024-08-06 08:02:47,139][52664] Sum rewards: 74.295, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon5': '0.156', 'AMMO3': '0.174', 'weapon2': '0.250', 'AMMO4': '0.266', 'weapon4': '0.390', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.944', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '60.000'} [2024-08-06 08:02:47,258][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:02:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 664756224. Throughput: 0: 4342.0. Samples: 166189760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:47,794][52567] Avg episode reward: [(0, '76.969')] [2024-08-06 08:02:48,665][52658] DAMAGECOUNT value on done: 923771.0 [2024-08-06 08:02:48,665][52658] Sum rewards: 76.095, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.065', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.161', 'weapon5': '0.226', 'AMMO4': '0.230', 'weapon4': '0.372', 'weapon2': '0.416', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.538', 'FRAGCOUNT': '60.000'} [2024-08-06 08:02:49,034][52811] DAMAGECOUNT value on done: 875993.0 [2024-08-06 08:02:49,034][52811] Sum rewards: 71.447, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.375', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.180', 'AMMO3': '0.257', 'AMMO4': '0.273', 'weapon5': '0.294', 'weapon2': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.804', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 08:02:49,181][52669] DAMAGECOUNT value on done: 930623.0 [2024-08-06 08:02:49,181][52669] Sum rewards: 77.263, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.275', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.160', 'AMMO3': '0.200', 'AMMO4': '0.252', 'weapon5': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '64.000'} [2024-08-06 08:02:49,299][52650] Updated weights for policy 0, policy_version 81151 (0.0029) [2024-08-06 08:02:49,808][52664] DAMAGECOUNT value on done: 957956.0 [2024-08-06 08:02:49,809][52664] Sum rewards: 69.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.203', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.225', 'weapon2': '0.306', 'WEAPON3': '1.450', 'weapon3': '3.484', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '58.000'} [2024-08-06 08:02:49,969][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:02:50,054][52671] DAMAGECOUNT value on done: 935418.0 [2024-08-06 08:02:50,056][52671] Sum rewards: 85.086, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.238', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.534', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:51,536][52658] DAMAGECOUNT value on done: 937591.0 [2024-08-06 08:02:51,544][52658] Sum rewards: 81.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.365', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.060', 'weapon5': '0.092', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.356', 'WEAPON3': '1.450', 'weapon3': '3.278', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '68.000'} [2024-08-06 08:02:52,033][52669] DAMAGECOUNT value on done: 927674.0 [2024-08-06 08:02:52,033][52669] Sum rewards: 83.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.349', 'AMMO2': '0.006', 'AMMO4': '0.031', 'AMMO3': '0.202', 'weapon2': '0.490', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '70.000'} [2024-08-06 08:02:52,202][52811] DAMAGECOUNT value on done: 862698.0 [2024-08-06 08:02:52,202][52811] Sum rewards: 66.216, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.915', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.088', 'AMMO3': '0.174', 'AMMO4': '0.192', 'weapon5': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.032', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '54.000'} [2024-08-06 08:02:52,795][52567] Fps is (10 sec: 18025.7, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 664854528. Throughput: 0: 4347.1. Samples: 166216220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:52,795][52567] Avg episode reward: [(0, '76.924')] [2024-08-06 08:02:52,982][52664] DAMAGECOUNT value on done: 973494.0 [2024-08-06 08:02:52,983][52664] Sum rewards: 82.490, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.110', 'AMMO3': '0.175', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '65.000'} [2024-08-06 08:02:53,089][52671] DAMAGECOUNT value on done: 942743.0 [2024-08-06 08:02:53,091][52671] Sum rewards: 91.451, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.625', 'AMMO5': '0.014', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.093', 'weapon5': '0.156', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '22.080', 'FRAGCOUNT': '71.000'} [2024-08-06 08:02:54,126][52650] Updated weights for policy 0, policy_version 81161 (0.0011) [2024-08-06 08:02:54,516][52658] DAMAGECOUNT value on done: 926272.0 [2024-08-06 08:02:54,518][52658] Sum rewards: 91.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.893', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.062', 'weapon5': '0.154', 'AMMO4': '0.164', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.222', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.222', 'FRAGCOUNT': '76.000'} [2024-08-06 08:02:54,756][52669] DAMAGECOUNT value on done: 939225.0 [2024-08-06 08:02:54,757][52669] Sum rewards: 65.366, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.190', 'AMMO2': '0.004', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.344', 'WEAPON3': '1.100', 'HITCOUNT': '3.110', 'weapon3': '3.414', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '52.000'} [2024-08-06 08:02:55,282][52664] DAMAGECOUNT value on done: 967850.0 [2024-08-06 08:02:55,283][52664] Sum rewards: 63.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.128', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.025', 'weapon4': '0.032', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.608', 'WEAPON3': '1.250', 'HITCOUNT': '3.050', 'weapon3': '3.088', 'DAMAGECOUNT': '15.216', 'FRAGCOUNT': '53.000'} [2024-08-06 08:02:55,293][52811] DAMAGECOUNT value on done: 870936.0 [2024-08-06 08:02:55,296][52811] Sum rewards: 67.022, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.808', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.080', 'AMMO4': '0.098', 'AMMO3': '0.201', 'weapon2': '0.362', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.396', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '55.000'} [2024-08-06 08:02:56,085][52671] DAMAGECOUNT value on done: 938978.0 [2024-08-06 08:02:56,087][52671] Sum rewards: 71.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.072', 'weapon5': '0.180', 'weapon2': '0.194', 'AMMO3': '0.210', 'AMMO4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.346', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '58.000'} [2024-08-06 08:02:57,458][52658] DAMAGECOUNT value on done: 951376.0 [2024-08-06 08:02:57,469][52658] Sum rewards: 66.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.412', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon5': '0.190', 'AMMO3': '0.225', 'AMMO4': '0.250', 'weapon2': '0.280', 'weapon4': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.880', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '55.000'} [2024-08-06 08:02:57,674][52669] DAMAGECOUNT value on done: 930287.0 [2024-08-06 08:02:57,675][52669] Sum rewards: 69.048, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon5': '0.142', 'AMMO3': '0.160', 'weapon2': '0.194', 'AMMO4': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '3.030', 'weapon3': '3.420', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '55.000'} [2024-08-06 08:02:57,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 664936448. Throughput: 0: 4345.6. Samples: 166242080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:02:57,795][52567] Avg episode reward: [(0, '76.739')] [2024-08-06 08:02:58,216][52664] DAMAGECOUNT value on done: 958112.0 [2024-08-06 08:02:58,218][52664] Sum rewards: 87.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon2': '0.142', 'AMMO3': '0.183', 'weapon5': '0.196', 'WEAPON4': '0.200', 'weapon4': '0.298', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.118', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.123', 'FRAGCOUNT': '69.000'} [2024-08-06 08:02:58,313][52811] DAMAGECOUNT value on done: 871208.0 [2024-08-06 08:02:58,314][52811] Sum rewards: 79.739, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.330', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '68.000'} [2024-08-06 08:02:58,662][52671] DAMAGECOUNT value on done: 939977.0 [2024-08-06 08:02:58,663][52671] Sum rewards: 78.018, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.168', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.151', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.050', 'weapon3': '3.256', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.000'} [2024-08-06 08:02:58,696][52650] Updated weights for policy 0, policy_version 81171 (0.0024) [2024-08-06 08:02:59,750][52670] Large shaping reward 2.564 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.534, 178.0)] [2024-08-06 08:03:00,391][52658] DAMAGECOUNT value on done: 938419.0 [2024-08-06 08:03:00,392][52658] Sum rewards: 85.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.531', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.054', 'weapon5': '0.182', 'AMMO3': '0.184', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.050', 'weapon3': '2.974', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:00,533][52669] DAMAGECOUNT value on done: 939735.0 [2024-08-06 08:03:00,535][52669] Sum rewards: 63.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.301', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.168', 'weapon4': '0.176', 'AMMO3': '0.228', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '54.000'} [2024-08-06 08:03:00,820][52664] DAMAGECOUNT value on done: 959824.0 [2024-08-06 08:03:00,822][52664] Sum rewards: 77.390, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.200', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.144', 'AMMO4': '0.169', 'weapon5': '0.178', 'weapon2': '0.260', 'WEAPON5': '0.300', 'AMMO3': '0.309', 'WEAPON4': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.124', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:01,429][52811] DAMAGECOUNT value on done: 876354.0 [2024-08-06 08:03:01,429][52811] Sum rewards: 77.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.378', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.120', 'weapon5': '0.188', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '64.500'} [2024-08-06 08:03:01,502][52671] DAMAGECOUNT value on done: 947771.0 [2024-08-06 08:03:01,502][52671] Sum rewards: 77.844, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.237', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.556', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:02,794][52567] Fps is (10 sec: 16384.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 665018368. Throughput: 0: 4346.5. Samples: 166255240. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:02,794][52567] Avg episode reward: [(0, '77.090')] [2024-08-06 08:03:03,103][52658] DAMAGECOUNT value on done: 943713.0 [2024-08-06 08:03:03,104][52658] Sum rewards: 75.844, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.650', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.040', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.408', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '62.000'} [2024-08-06 08:03:03,214][52650] Updated weights for policy 0, policy_version 81181 (0.0012) [2024-08-06 08:03:03,233][52669] DAMAGECOUNT value on done: 937980.0 [2024-08-06 08:03:03,233][52669] Sum rewards: 74.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.101', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.368', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '62.000'} [2024-08-06 08:03:03,664][52794] DAMAGECOUNT value on done: 925122.0 [2024-08-06 08:03:03,665][52794] Sum rewards: 79.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.680', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.260', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '2.986', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.754', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:03,736][52664] DAMAGECOUNT value on done: 967242.0 [2024-08-06 08:03:03,736][52664] Sum rewards: 64.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.712', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.090', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.320', 'weapon4': '0.386', 'WEAPON3': '1.500', 'weapon3': '2.912', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '55.000'} [2024-08-06 08:03:04,326][52811] DAMAGECOUNT value on done: 880644.0 [2024-08-06 08:03:04,326][52811] Sum rewards: 74.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.402', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:04,589][52671] DAMAGECOUNT value on done: 934313.0 [2024-08-06 08:03:04,595][52671] Sum rewards: 84.772, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.082', 'weapon4': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '69.000'} [2024-08-06 08:03:05,927][52658] DAMAGECOUNT value on done: 930166.0 [2024-08-06 08:03:05,927][52658] Sum rewards: 70.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.280', 'AMMO5': '0.017', 'AMMO2': '0.047', 'AMMO3': '0.174', 'weapon5': '0.222', 'weapon4': '0.230', 'AMMO4': '0.233', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '57.000'} [2024-08-06 08:03:05,995][52669] DAMAGECOUNT value on done: 936932.0 [2024-08-06 08:03:06,000][52669] Sum rewards: 94.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.610', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.048', 'weapon5': '0.058', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.574', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '4.350', 'DAMAGECOUNT': '23.928', 'FRAGCOUNT': '74.000'} [2024-08-06 08:03:06,765][52664] DAMAGECOUNT value on done: 967559.0 [2024-08-06 08:03:06,767][52664] Sum rewards: 83.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.085', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.781', 'FRAGCOUNT': '68.000'} [2024-08-06 08:03:06,778][52794] DAMAGECOUNT value on done: 937266.0 [2024-08-06 08:03:06,779][52794] Sum rewards: 78.167, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.405', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.144', 'AMMO3': '0.235', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON4': '0.450', 'weapon4': '0.522', 'WEAPON3': '1.350', 'weapon3': '2.810', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:07,005][52663] DAMAGECOUNT value on done: 949296.0 [2024-08-06 08:03:07,006][52663] Sum rewards: 78.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.508', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.196', 'AMMO3': '0.215', 'AMMO4': '0.239', 'weapon5': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.528', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:07,488][52671] DAMAGECOUNT value on done: 937304.0 [2024-08-06 08:03:07,488][52671] Sum rewards: 82.510, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.180', 'AMMO3': '0.227', 'weapon5': '0.238', 'AMMO4': '0.246', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.132', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:07,595][52811] DAMAGECOUNT value on done: 870207.0 [2024-08-06 08:03:07,595][52811] Sum rewards: 75.125, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.184', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.430', 'weapon4': '0.440', 'WEAPON3': '1.100', 'weapon3': '2.756', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '61.000'} [2024-08-06 08:03:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 665108480. Throughput: 0: 4340.2. Samples: 166281330. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:07,794][52567] Avg episode reward: [(0, '77.262')] [2024-08-06 08:03:08,108][52650] Updated weights for policy 0, policy_version 81191 (0.0023) [2024-08-06 08:03:08,465][52658] DAMAGECOUNT value on done: 940263.0 [2024-08-06 08:03:08,466][52658] Sum rewards: 67.029, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.070', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO3': '0.168', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '0.950', 'HITCOUNT': '3.120', 'weapon3': '3.490', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '53.000'} [2024-08-06 08:03:09,057][52669] DAMAGECOUNT value on done: 934146.0 [2024-08-06 08:03:09,058][52669] Sum rewards: 79.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.018', 'AMMO2': '0.058', 'weapon4': '0.092', 'AMMO3': '0.189', 'AMMO4': '0.291', 'weapon2': '0.296', 'weapon5': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.984', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:09,327][52794] DAMAGECOUNT value on done: 941137.0 [2024-08-06 08:03:09,327][52794] Sum rewards: 73.798, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.960', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO3': '0.129', 'weapon5': '0.180', 'AMMO4': '0.199', 'weapon4': '0.394', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.812', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:09,491][52664] DAMAGECOUNT value on done: 974196.0 [2024-08-06 08:03:09,491][52664] Sum rewards: 81.329, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.110', 'weapon5': '0.190', 'AMMO3': '0.198', 'weapon2': '0.224', 'AMMO4': '0.247', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:09,782][52663] DAMAGECOUNT value on done: 933048.0 [2024-08-06 08:03:09,783][52663] Sum rewards: 77.392, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.187', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.170', 'AMMO3': '0.176', 'weapon2': '0.220', 'AMMO4': '0.226', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.022', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '61.000'} [2024-08-06 08:03:10,376][52671] DAMAGECOUNT value on done: 941854.0 [2024-08-06 08:03:10,378][52671] Sum rewards: 78.077, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.076', 'weapon5': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.230', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:10,660][52811] DAMAGECOUNT value on done: 868021.0 [2024-08-06 08:03:10,661][52811] Sum rewards: 72.137, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.306', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.121', 'weapon5': '0.130', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:11,351][52658] DAMAGECOUNT value on done: 930105.0 [2024-08-06 08:03:11,351][52658] Sum rewards: 80.230, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.049', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon4': '0.116', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.160', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:11,481][52669] DAMAGECOUNT value on done: 944894.0 [2024-08-06 08:03:11,481][52669] Sum rewards: 68.116, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.688', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.164', 'AMMO3': '0.165', 'AMMO4': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'weapon4': '0.358', 'WEAPON3': '1.000', 'weapon3': '2.946', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '53.000'} [2024-08-06 08:03:12,033][52664] DAMAGECOUNT value on done: 968978.0 [2024-08-06 08:03:12,034][52664] Sum rewards: 65.972, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.085', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.126', 'AMMO3': '0.177', 'weapon4': '0.184', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.050', 'HITCOUNT': '2.900', 'weapon3': '2.978', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '53.000'} [2024-08-06 08:03:12,325][52663] DAMAGECOUNT value on done: 927509.0 [2024-08-06 08:03:12,325][52663] Sum rewards: 72.546, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.190', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO3': '0.154', 'AMMO4': '0.160', 'weapon4': '0.162', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '0.900', 'weapon3': '3.036', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:12,538][52794] DAMAGECOUNT value on done: 927123.0 [2024-08-06 08:03:12,538][52794] Sum rewards: 69.361, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.218', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.147', 'weapon4': '0.182', 'AMMO3': '0.255', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.110', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:12,664][52650] Updated weights for policy 0, policy_version 81201 (0.0020) [2024-08-06 08:03:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 665198592. Throughput: 0: 4346.2. Samples: 166307540. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:12,794][52567] Avg episode reward: [(0, '76.955')] [2024-08-06 08:03:13,566][52671] DAMAGECOUNT value on done: 923269.0 [2024-08-06 08:03:13,567][52671] Sum rewards: 63.816, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.580', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.162', 'weapon2': '0.228', 'weapon5': '0.244', 'AMMO4': '0.272', 'weapon4': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '2.990', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '51.000'} [2024-08-06 08:03:13,868][52811] DAMAGECOUNT value on done: 871254.0 [2024-08-06 08:03:13,869][52811] Sum rewards: 90.315, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.585', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.136', 'AMMO4': '0.179', 'AMMO3': '0.202', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '74.000'} [2024-08-06 08:03:14,034][52669] DAMAGECOUNT value on done: 936451.0 [2024-08-06 08:03:14,036][52669] Sum rewards: 90.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.114', 'weapon5': '0.170', 'AMMO4': '0.225', 'AMMO3': '0.239', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '22.377', 'FRAGCOUNT': '73.000'} [2024-08-06 08:03:14,062][52658] DAMAGECOUNT value on done: 937745.0 [2024-08-06 08:03:14,064][52658] Sum rewards: 71.329, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.245', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.170', 'AMMO3': '0.210', 'weapon4': '0.246', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '61.000'} [2024-08-06 08:03:14,946][52794] DAMAGECOUNT value on done: 920763.0 [2024-08-06 08:03:14,954][52794] Sum rewards: 77.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.102', 'AMMO3': '0.176', 'weapon5': '0.214', 'AMMO4': '0.244', 'weapon2': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:15,074][52663] DAMAGECOUNT value on done: 933428.0 [2024-08-06 08:03:15,074][52663] Sum rewards: 77.896, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.134', 'weapon4': '0.154', 'AMMO3': '0.176', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '61.000'} [2024-08-06 08:03:15,114][52664] DAMAGECOUNT value on done: 969756.0 [2024-08-06 08:03:15,115][52664] Sum rewards: 82.689, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.879', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.072', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:15,655][52614] Signal inference workers to stop experience collection... (14900 times) [2024-08-06 08:03:15,655][52614] Signal inference workers to resume experience collection... (14900 times) [2024-08-06 08:03:15,714][52650] InferenceWorker_p0-w0: stopping experience collection (14900 times) [2024-08-06 08:03:15,714][52650] InferenceWorker_p0-w0: resuming experience collection (14900 times) [2024-08-06 08:03:16,674][52669] DAMAGECOUNT value on done: 942843.0 [2024-08-06 08:03:16,674][52669] Sum rewards: 80.444, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.874', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.096', 'weapon5': '0.168', 'AMMO4': '0.187', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:16,705][52671] DAMAGECOUNT value on done: 937324.0 [2024-08-06 08:03:16,705][52671] Sum rewards: 77.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.130', 'weapon5': '0.220', 'AMMO3': '0.227', 'AMMO4': '0.232', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:16,844][52658] DAMAGECOUNT value on done: 919798.0 [2024-08-06 08:03:16,844][52658] Sum rewards: 78.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.038', 'WEAPON5': '0.100', 'weapon4': '0.114', 'AMMO4': '0.118', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:16,993][52811] DAMAGECOUNT value on done: 869200.0 [2024-08-06 08:03:16,994][52811] Sum rewards: 71.696, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.880', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.274', 'WEAPON3': '1.500', 'weapon3': '3.374', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '61.000'} [2024-08-06 08:03:17,523][52650] Updated weights for policy 0, policy_version 81211 (0.0041) [2024-08-06 08:03:17,603][52664] DAMAGECOUNT value on done: 983119.0 [2024-08-06 08:03:17,603][52664] Sum rewards: 66.671, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.965', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.179', 'weapon5': '0.196', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.512', 'WEAPON3': '1.150', 'weapon3': '2.690', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '52.000'} [2024-08-06 08:03:17,679][52663] DAMAGECOUNT value on done: 932645.0 [2024-08-06 08:03:17,680][52663] Sum rewards: 81.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO3': '0.225', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.368', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '68.000'} [2024-08-06 08:03:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 665280512. Throughput: 0: 4358.9. Samples: 166320580. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:17,795][52567] Avg episode reward: [(0, '77.115')] [2024-08-06 08:03:17,949][52794] DAMAGECOUNT value on done: 927635.0 [2024-08-06 08:03:17,952][52794] Sum rewards: 70.490, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.747', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.136', 'AMMO3': '0.184', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.320', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.670', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '58.000'} [2024-08-06 08:03:19,568][52669] DAMAGECOUNT value on done: 941948.0 [2024-08-06 08:03:19,568][52669] Sum rewards: 63.564, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.164', 'weapon2': '0.214', 'weapon5': '0.216', 'AMMO3': '0.254', 'AMMO4': '0.274', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '55.000'} [2024-08-06 08:03:19,729][52671] DAMAGECOUNT value on done: 936551.0 [2024-08-06 08:03:19,730][52671] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.142', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.090', 'AMMO3': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.254', 'weapon4': '0.296', 'WEAPON3': '0.900', 'HITCOUNT': '3.170', 'weapon3': '3.214', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 08:03:19,962][52658] DAMAGECOUNT value on done: 935778.0 [2024-08-06 08:03:19,970][52658] Sum rewards: 62.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.142', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.128', 'AMMO4': '0.141', 'weapon2': '0.166', 'AMMO3': '0.214', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.274', 'DAMAGECOUNT': '15.294', 'FRAGCOUNT': '53.000'} [2024-08-06 08:03:19,979][52811] DAMAGECOUNT value on done: 878369.0 [2024-08-06 08:03:19,983][52811] Sum rewards: 73.873, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.299', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.128', 'weapon2': '0.232', 'AMMO3': '0.272', 'weapon5': '0.308', 'AMMO4': '0.321', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.912', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:20,319][52664] DAMAGECOUNT value on done: 977780.0 [2024-08-06 08:03:20,323][52664] Sum rewards: 65.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.708', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.158', 'weapon5': '0.166', 'AMMO3': '0.250', 'AMMO4': '0.279', 'weapon2': '0.352', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '3.052', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '57.000'} [2024-08-06 08:03:20,680][52663] DAMAGECOUNT value on done: 940731.0 [2024-08-06 08:03:20,680][52663] Sum rewards: 89.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.121', 'weapon5': '0.126', 'AMMO3': '0.204', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '73.000'} [2024-08-06 08:03:20,982][52794] DAMAGECOUNT value on done: 932229.0 [2024-08-06 08:03:20,983][52794] Sum rewards: 67.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.876', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.120', 'AMMO3': '0.204', 'AMMO4': '0.219', 'weapon5': '0.280', 'WEAPON4': '0.300', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '2.940', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:21,895][52650] Updated weights for policy 0, policy_version 81221 (0.0011) [2024-08-06 08:03:22,482][52669] DAMAGECOUNT value on done: 929839.0 [2024-08-06 08:03:22,484][52669] Sum rewards: 78.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.098', 'weapon4': '0.146', 'AMMO3': '0.169', 'AMMO4': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 665370624. Throughput: 0: 4365.8. Samples: 166347060. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:22,794][52567] Avg episode reward: [(0, '76.567')] [2024-08-06 08:03:22,818][52671] DAMAGECOUNT value on done: 936542.0 [2024-08-06 08:03:22,819][52671] Sum rewards: 84.587, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.066', 'AMMO4': '0.117', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.416', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.099', 'FRAGCOUNT': '68.000'} [2024-08-06 08:03:23,003][52658] DAMAGECOUNT value on done: 931595.0 [2024-08-06 08:03:23,003][52658] Sum rewards: 78.822, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.540', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.116', 'AMMO3': '0.123', 'AMMO4': '0.130', 'weapon5': '0.140', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.630', 'WEAPON3': '0.900', 'weapon3': '2.958', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '59.000'} [2024-08-06 08:03:23,014][52811] DAMAGECOUNT value on done: 881256.0 [2024-08-06 08:03:23,015][52811] Sum rewards: 75.168, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.231', 'weapon5': '0.254', 'weapon2': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.775', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:23,169][52664] DAMAGECOUNT value on done: 977652.0 [2024-08-06 08:03:23,170][52664] Sum rewards: 88.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.084', 'AMMO3': '0.211', 'weapon5': '0.220', 'AMMO4': '0.259', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '2.926', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '22.245', 'FRAGCOUNT': '70.000'} [2024-08-06 08:03:23,939][52663] DAMAGECOUNT value on done: 930925.0 [2024-08-06 08:03:23,943][52663] Sum rewards: 91.983, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.430', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.082', 'AMMO4': '0.148', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.171', 'FRAGCOUNT': '74.000'} [2024-08-06 08:03:24,017][52794] DAMAGECOUNT value on done: 920996.0 [2024-08-06 08:03:24,018][52794] Sum rewards: 77.473, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.320', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.194', 'AMMO4': '0.205', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:25,394][52671] DAMAGECOUNT value on done: 937904.0 [2024-08-06 08:03:25,396][52671] Sum rewards: 75.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.854', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.096', 'weapon5': '0.196', 'AMMO3': '0.216', 'AMMO4': '0.257', 'weapon2': '0.412', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:25,871][52669] DAMAGECOUNT value on done: 926758.0 [2024-08-06 08:03:25,871][52669] Sum rewards: 68.385, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 08:03:25,965][52811] DAMAGECOUNT value on done: 866875.0 [2024-08-06 08:03:25,966][52811] Sum rewards: 57.922, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.024', 'AMMO2': '0.066', 'weapon4': '0.108', 'AMMO3': '0.230', 'weapon5': '0.256', 'AMMO4': '0.328', 'weapon2': '0.508', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.832', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.210', 'FRAGCOUNT': '50.000'} [2024-08-06 08:03:25,978][52658] DAMAGECOUNT value on done: 925381.0 [2024-08-06 08:03:25,979][52658] Sum rewards: 76.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.970', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.058', 'weapon4': '0.090', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.294', 'WEAPON3': '1.550', 'weapon3': '3.284', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:26,037][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:03:26,208][52664] DAMAGECOUNT value on done: 959242.0 [2024-08-06 08:03:26,208][52664] Sum rewards: 78.099, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.148', 'AMMO3': '0.176', 'AMMO4': '0.189', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.980', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:26,721][52650] Updated weights for policy 0, policy_version 81231 (0.0026) [2024-08-06 08:03:26,866][52794] DAMAGECOUNT value on done: 934846.0 [2024-08-06 08:03:26,868][52794] Sum rewards: 70.456, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.600', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.268', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:27,018][52663] DAMAGECOUNT value on done: 915715.0 [2024-08-06 08:03:27,020][52663] Sum rewards: 59.635, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO3': '0.139', 'weapon5': '0.148', 'AMMO4': '0.156', 'weapon4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.620', 'WEAPON3': '0.950', 'HITCOUNT': '2.720', 'weapon3': '2.878', 'DAMAGECOUNT': '13.932', 'FRAGCOUNT': '48.000'} [2024-08-06 08:03:27,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 665468928. Throughput: 0: 4360.9. Samples: 166373000. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:27,795][52567] Avg episode reward: [(0, '75.971')] [2024-08-06 08:03:27,841][52803] DAMAGECOUNT value on done: 865382.0 [2024-08-06 08:03:27,842][52803] Sum rewards: 68.431, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.958', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.142', 'AMMO4': '0.178', 'weapon2': '0.272', 'AMMO3': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.230', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:27,843][52671] DAMAGECOUNT value on done: 937061.0 [2024-08-06 08:03:27,844][52671] Sum rewards: 83.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.206', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.991', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:28,647][52669] DAMAGECOUNT value on done: 936705.0 [2024-08-06 08:03:28,649][52669] Sum rewards: 78.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.904', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.058', 'AMMO3': '0.177', 'weapon4': '0.180', 'AMMO4': '0.274', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.234', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:28,923][52664] DAMAGECOUNT value on done: 962851.0 [2024-08-06 08:03:28,923][52664] Sum rewards: 78.449, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'weapon4': '0.146', 'AMMO4': '0.147', 'weapon2': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.276', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:29,001][52811] DAMAGECOUNT value on done: 867151.0 [2024-08-06 08:03:29,005][52811] Sum rewards: 83.684, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.140', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'weapon4': '0.264', 'weapon2': '0.288', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.112', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:29,039][52658] DAMAGECOUNT value on done: 933919.0 [2024-08-06 08:03:29,043][52658] Sum rewards: 77.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.603', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.173', 'weapon5': '0.188', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:29,163][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:03:29,623][52663] DAMAGECOUNT value on done: 929882.0 [2024-08-06 08:03:29,625][52663] Sum rewards: 82.425, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.066', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.198', 'AMMO3': '0.211', 'WEAPON3': '1.350', 'weapon3': '3.542', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '68.000'} [2024-08-06 08:03:30,069][52794] DAMAGECOUNT value on done: 930417.0 [2024-08-06 08:03:30,070][52794] Sum rewards: 86.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.392', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.062', 'weapon2': '0.198', 'AMMO4': '0.201', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.510', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '72.000'} [2024-08-06 08:03:30,893][52671] DAMAGECOUNT value on done: 921212.0 [2024-08-06 08:03:30,903][52671] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.664', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon5': '0.042', 'AMMO4': '0.055', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.200', 'weapon2': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:30,976][52803] DAMAGECOUNT value on done: 864964.0 [2024-08-06 08:03:30,977][52803] Sum rewards: 72.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.740', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.199', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.314', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:31,370][52664] DAMAGECOUNT value on done: 971938.0 [2024-08-06 08:03:31,371][52664] Sum rewards: 76.407, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.611', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon5': '0.178', 'AMMO3': '0.186', 'weapon4': '0.190', 'AMMO4': '0.236', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.952', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:31,520][52669] DAMAGECOUNT value on done: 957557.0 [2024-08-06 08:03:31,523][52669] Sum rewards: 77.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.460', 'AMMO5': '0.005', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.340', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:31,582][52650] Updated weights for policy 0, policy_version 81241 (0.0034) [2024-08-06 08:03:32,647][52663] DAMAGECOUNT value on done: 929370.0 [2024-08-06 08:03:32,650][52663] Sum rewards: 74.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.090', 'AMMO3': '0.178', 'weapon5': '0.236', 'AMMO4': '0.239', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:32,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 665550848. Throughput: 0: 4364.7. Samples: 166386170. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:32,795][52567] Avg episode reward: [(0, '76.221')] [2024-08-06 08:03:33,229][52794] DAMAGECOUNT value on done: 922534.0 [2024-08-06 08:03:33,230][52794] Sum rewards: 73.822, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.540', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.140', 'AMMO3': '0.153', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '0.950', 'HITCOUNT': '3.130', 'weapon3': '3.298', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '59.000'} [2024-08-06 08:03:33,875][52671] DAMAGECOUNT value on done: 946714.0 [2024-08-06 08:03:33,875][52671] Sum rewards: 70.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.588', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.166', 'weapon5': '0.172', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '58.000'} [2024-08-06 08:03:34,066][52664] DAMAGECOUNT value on done: 959744.0 [2024-08-06 08:03:34,068][52664] Sum rewards: 63.223, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.026', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO4': '0.197', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.010', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:34,140][52803] DAMAGECOUNT value on done: 871843.0 [2024-08-06 08:03:34,140][52803] Sum rewards: 82.411, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.658', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.046', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon4': '0.220', 'weapon5': '0.220', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '69.000'} [2024-08-06 08:03:34,681][52669] DAMAGECOUNT value on done: 944243.0 [2024-08-06 08:03:34,681][52669] Sum rewards: 71.079, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.732', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO3': '0.148', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '0.950', 'weapon3': '3.102', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '55.000'} [2024-08-06 08:03:35,966][52663] DAMAGECOUNT value on done: 938142.0 [2024-08-06 08:03:35,966][52663] Sum rewards: 77.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.240', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.060', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.340', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:36,020][52794] DAMAGECOUNT value on done: 935922.0 [2024-08-06 08:03:36,022][52794] Sum rewards: 78.722, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.516', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.118', 'weapon5': '0.140', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.222', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:36,031][52650] Updated weights for policy 0, policy_version 81251 (0.0019) [2024-08-06 08:03:36,631][52671] DAMAGECOUNT value on done: 944884.0 [2024-08-06 08:03:36,632][52671] Sum rewards: 80.896, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.188', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.070', 'AMMO4': '0.153', 'weapon5': '0.216', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.448', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:37,299][52803] DAMAGECOUNT value on done: 868867.0 [2024-08-06 08:03:37,300][52803] Sum rewards: 64.175, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.670', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.070', 'weapon5': '0.140', 'AMMO3': '0.220', 'AMMO4': '0.245', 'weapon2': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:37,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17203.1, 300 sec: 17411.5). Total num frames: 665624576. Throughput: 0: 4360.3. Samples: 166412430. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:37,795][52567] Avg episode reward: [(0, '75.752')] [2024-08-06 08:03:38,143][52669] DAMAGECOUNT value on done: 941288.0 [2024-08-06 08:03:38,143][52669] Sum rewards: 97.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.154', 'AMMO3': '0.165', 'AMMO4': '0.177', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '22.554', 'FRAGCOUNT': '77.000'} [2024-08-06 08:03:39,130][52794] DAMAGECOUNT value on done: 929205.0 [2024-08-06 08:03:39,130][52794] Sum rewards: 78.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.300', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.068', 'AMMO4': '0.101', 'weapon5': '0.122', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:39,183][52671] DAMAGECOUNT value on done: 938177.0 [2024-08-06 08:03:39,185][52671] Sum rewards: 79.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.090', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.228', 'weapon4': '0.280', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:39,263][52663] DAMAGECOUNT value on done: 921252.0 [2024-08-06 08:03:39,265][52663] Sum rewards: 69.766, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.922', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.102', 'weapon5': '0.202', 'AMMO3': '0.248', 'AMMO4': '0.269', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '61.000'} [2024-08-06 08:03:40,467][52803] DAMAGECOUNT value on done: 866215.0 [2024-08-06 08:03:40,468][52803] Sum rewards: 77.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.002', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.175', 'weapon2': '0.196', 'AMMO3': '0.214', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '62.000'} [2024-08-06 08:03:40,884][52650] Updated weights for policy 0, policy_version 81261 (0.0014) [2024-08-06 08:03:40,971][52669] DAMAGECOUNT value on done: 947297.0 [2024-08-06 08:03:40,979][52669] Sum rewards: 78.223, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.674', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon5': '0.178', 'weapon4': '0.180', 'AMMO3': '0.224', 'AMMO4': '0.230', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:42,099][52794] DAMAGECOUNT value on done: 940881.0 [2024-08-06 08:03:42,099][52794] Sum rewards: 72.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'ARMOR': '0.024', 'AMMO2': '0.039', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.162', 'AMMO4': '0.194', 'AMMO3': '0.211', 'weapon4': '0.244', 'weapon2': '0.254', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.124', 'DAMAGECOUNT': '16.554', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:42,315][52663] DAMAGECOUNT value on done: 918074.0 [2024-08-06 08:03:42,315][52663] Sum rewards: 80.864, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.020', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.100', 'weapon5': '0.126', 'weapon2': '0.160', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.380', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '67.000'} [2024-08-06 08:03:42,622][52671] DAMAGECOUNT value on done: 943795.0 [2024-08-06 08:03:42,624][52671] Sum rewards: 70.707, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.928', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.094', 'AMMO3': '0.187', 'AMMO4': '0.245', 'WEAPON5': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.810', 'WEAPON3': '1.200', 'weapon3': '2.584', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '58.000'} [2024-08-06 08:03:42,800][52567] Fps is (10 sec: 17193.3, 60 sec: 17475.3, 300 sec: 17466.7). Total num frames: 665722880. Throughput: 0: 4363.7. Samples: 166438470. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:42,800][52567] Avg episode reward: [(0, '76.167')] [2024-08-06 08:03:43,346][52662] Large shaping reward 2.573 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.522, 174.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:03:43,594][52803] DAMAGECOUNT value on done: 865553.0 [2024-08-06 08:03:43,597][52803] Sum rewards: 77.301, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.488', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.125', 'weapon5': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:44,021][52669] DAMAGECOUNT value on done: 948112.0 [2024-08-06 08:03:44,022][52669] Sum rewards: 75.299, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.115', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.180', 'AMMO3': '0.185', 'AMMO4': '0.226', 'weapon2': '0.228', 'weapon4': '0.232', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '61.000'} [2024-08-06 08:03:44,905][52794] DAMAGECOUNT value on done: 923707.0 [2024-08-06 08:03:44,906][52794] Sum rewards: 69.137, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.480', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.180', 'weapon4': '0.210', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '2.930', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '60.000'} [2024-08-06 08:03:45,069][52663] DAMAGECOUNT value on done: 927742.0 [2024-08-06 08:03:45,071][52663] Sum rewards: 69.355, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.650', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.133', 'weapon5': '0.154', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '58.000'} [2024-08-06 08:03:45,455][52650] Updated weights for policy 0, policy_version 81271 (0.0020) [2024-08-06 08:03:45,585][52671] DAMAGECOUNT value on done: 925287.0 [2024-08-06 08:03:45,586][52671] Sum rewards: 71.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.136', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '59.000'} [2024-08-06 08:03:46,063][52670] DAMAGECOUNT value on done: 917002.0 [2024-08-06 08:03:46,074][52670] Sum rewards: 76.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.040', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.086', 'AMMO4': '0.170', 'weapon5': '0.182', 'weapon2': '0.262', 'AMMO3': '0.283', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.178', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:46,638][52803] DAMAGECOUNT value on done: 862901.0 [2024-08-06 08:03:46,639][52803] Sum rewards: 78.558, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO4': '0.173', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:47,771][52794] DAMAGECOUNT value on done: 936242.0 [2024-08-06 08:03:47,774][52794] Sum rewards: 81.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.070', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.059', 'weapon4': '0.186', 'AMMO3': '0.207', 'weapon5': '0.226', 'AMMO4': '0.293', 'weapon2': '0.424', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.880', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:47,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 665804800. Throughput: 0: 4366.4. Samples: 166451730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:03:47,794][52567] Avg episode reward: [(0, '75.933')] [2024-08-06 08:03:47,989][52663] DAMAGECOUNT value on done: 929128.0 [2024-08-06 08:03:47,990][52663] Sum rewards: 68.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.086', 'AMMO3': '0.194', 'weapon5': '0.218', 'AMMO4': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '57.000'} [2024-08-06 08:03:49,259][52670] DAMAGECOUNT value on done: 934646.0 [2024-08-06 08:03:49,261][52670] Sum rewards: 74.495, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.082', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.140', 'AMMO4': '0.272', 'weapon5': '0.306', 'AMMO3': '0.326', 'weapon2': '0.356', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.850', 'weapon3': '2.792', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '65.000'} [2024-08-06 08:03:49,757][52803] DAMAGECOUNT value on done: 861805.0 [2024-08-06 08:03:49,760][52803] Sum rewards: 64.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.088', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.456', 'WEAPON3': '1.200', 'HITCOUNT': '2.930', 'weapon3': '3.256', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '53.000'} [2024-08-06 08:03:50,020][52650] Updated weights for policy 0, policy_version 81281 (0.0016) [2024-08-06 08:03:50,375][52658] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:03:50,597][52663] DAMAGECOUNT value on done: 933147.0 [2024-08-06 08:03:50,597][52663] Sum rewards: 79.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.640', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:50,681][52794] DAMAGECOUNT value on done: 932185.0 [2024-08-06 08:03:50,681][52794] Sum rewards: 64.761, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.360', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.138', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '3.102', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '55.000'} [2024-08-06 08:03:52,190][52670] DAMAGECOUNT value on done: 918761.0 [2024-08-06 08:03:52,190][52670] Sum rewards: 80.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.026', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.202', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '66.000'} [2024-08-06 08:03:52,794][52567] Fps is (10 sec: 18032.9, 60 sec: 17476.4, 300 sec: 17494.9). Total num frames: 665903104. Throughput: 0: 4370.0. Samples: 166477980. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:03:52,794][52567] Avg episode reward: [(0, '75.810')] [2024-08-06 08:03:52,859][52803] DAMAGECOUNT value on done: 871948.0 [2024-08-06 08:03:52,859][52803] Sum rewards: 71.413, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.476', 'AMMO5': '0.013', 'AMMO2': '0.059', 'AMMO3': '0.197', 'weapon4': '0.210', 'weapon5': '0.214', 'weapon2': '0.276', 'AMMO4': '0.297', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '59.000'} [2024-08-06 08:03:53,360][52663] DAMAGECOUNT value on done: 930970.0 [2024-08-06 08:03:53,361][52663] Sum rewards: 68.284, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.092', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.538', 'WEAPON3': '1.600', 'weapon3': '3.004', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '59.000'} [2024-08-06 08:03:53,932][52794] DAMAGECOUNT value on done: 937544.0 [2024-08-06 08:03:53,933][52794] Sum rewards: 90.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.202', 'AMMO3': '0.212', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '75.000'} [2024-08-06 08:03:54,294][52666] DAMAGECOUNT value on done: 931908.0 [2024-08-06 08:03:54,294][52666] Sum rewards: 89.612, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.171', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.234', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '71.000'} [2024-08-06 08:03:55,096][52670] DAMAGECOUNT value on done: 920835.0 [2024-08-06 08:03:55,097][52670] Sum rewards: 68.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.190', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.102', 'AMMO3': '0.158', 'AMMO4': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '0.900', 'HITCOUNT': '3.170', 'weapon3': '3.274', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '56.000'} [2024-08-06 08:03:55,099][52650] Updated weights for policy 0, policy_version 81291 (0.0014) [2024-08-06 08:03:55,975][52803] DAMAGECOUNT value on done: 864400.0 [2024-08-06 08:03:55,977][52803] Sum rewards: 79.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.308', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.184', 'AMMO4': '0.198', 'weapon5': '0.250', 'weapon4': '0.276', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.876', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:56,045][52663] DAMAGECOUNT value on done: 937387.0 [2024-08-06 08:03:56,048][52663] Sum rewards: 90.863, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.890', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon5': '0.174', 'weapon4': '0.176', 'AMMO3': '0.241', 'weapon2': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.176', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.696', 'FRAGCOUNT': '74.000'} [2024-08-06 08:03:56,971][52794] DAMAGECOUNT value on done: 946936.0 [2024-08-06 08:03:56,973][52794] Sum rewards: 75.669, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.921', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.090', 'weapon5': '0.140', 'AMMO4': '0.155', 'AMMO3': '0.205', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.222', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '63.000'} [2024-08-06 08:03:57,165][52666] DAMAGECOUNT value on done: 928896.0 [2024-08-06 08:03:57,165][52666] Sum rewards: 89.736, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.210', 'weapon4': '0.318', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.922', 'FRAGCOUNT': '71.000'} [2024-08-06 08:03:57,626][52670] DAMAGECOUNT value on done: 934046.0 [2024-08-06 08:03:57,626][52670] Sum rewards: 80.259, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.662', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.126', 'AMMO4': '0.138', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.256', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 665976832. Throughput: 0: 4369.6. Samples: 166504170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:03:57,795][52567] Avg episode reward: [(0, '75.921')] [2024-08-06 08:03:58,982][52663] DAMAGECOUNT value on done: 941520.0 [2024-08-06 08:03:58,982][52663] Sum rewards: 82.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.349', 'AMMO5': '0.013', 'AMMO2': '0.040', 'AMMO3': '0.161', 'AMMO4': '0.198', 'weapon5': '0.216', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '0.950', 'weapon3': '2.906', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '64.000'} [2024-08-06 08:03:59,126][52803] DAMAGECOUNT value on done: 878166.0 [2024-08-06 08:03:59,127][52803] Sum rewards: 71.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.086', 'weapon5': '0.094', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.766', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '58.000'} [2024-08-06 08:03:59,592][52820] DAMAGECOUNT value on done: 862889.0 [2024-08-06 08:03:59,593][52820] Sum rewards: 88.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.028', 'AMMO4': '0.135', 'AMMO3': '0.185', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.920', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '71.000'} [2024-08-06 08:03:59,605][52650] Updated weights for policy 0, policy_version 81301 (0.0019) [2024-08-06 08:03:59,616][52666] DAMAGECOUNT value on done: 935112.0 [2024-08-06 08:03:59,618][52666] Sum rewards: 65.087, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.576', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.158', 'AMMO4': '0.177', 'weapon2': '0.224', 'AMMO3': '0.229', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.090', 'weapon3': '3.156', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '54.000'} [2024-08-06 08:04:00,018][52670] DAMAGECOUNT value on done: 920893.0 [2024-08-06 08:04:00,018][52670] Sum rewards: 63.797, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.285', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.154', 'AMMO4': '0.160', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.164', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '53.000'} [2024-08-06 08:04:00,184][52794] DAMAGECOUNT value on done: 935973.0 [2024-08-06 08:04:00,184][52794] Sum rewards: 70.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.598', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.090', 'weapon5': '0.166', 'AMMO4': '0.203', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:01,339][52663] DAMAGECOUNT value on done: 921258.0 [2024-08-06 08:04:01,341][52663] Sum rewards: 65.678, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.786', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.162', 'AMMO4': '0.211', 'weapon4': '0.230', 'AMMO3': '0.257', 'weapon2': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.020', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:01,406][52669] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.021, -7.0), ('weapon5', 0.002)] [2024-08-06 08:04:02,143][52803] DAMAGECOUNT value on done: 873063.0 [2024-08-06 08:04:02,144][52803] Sum rewards: 72.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.086', 'weapon5': '0.150', 'AMMO4': '0.196', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.171', 'FRAGCOUNT': '58.500'} [2024-08-06 08:04:02,398][52666] DAMAGECOUNT value on done: 928880.0 [2024-08-06 08:04:02,399][52666] Sum rewards: 76.415, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.562', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.120', 'AMMO3': '0.146', 'weapon5': '0.196', 'AMMO4': '0.231', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.724', 'WEAPON3': '0.900', 'weapon3': '2.730', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 666066944. Throughput: 0: 4371.4. Samples: 166517290. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:04:02,794][52567] Avg episode reward: [(0, '75.795')] [2024-08-06 08:04:02,845][52820] DAMAGECOUNT value on done: 863925.0 [2024-08-06 08:04:02,848][52820] Sum rewards: 78.039, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.891', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.163', 'weapon2': '0.212', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'weapon4': '0.294', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:02,870][52670] DAMAGECOUNT value on done: 918601.0 [2024-08-06 08:04:02,870][52670] Sum rewards: 84.886, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.204', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.496', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '20.943', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:03,749][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:04:04,287][52650] Updated weights for policy 0, policy_version 81311 (0.0012) [2024-08-06 08:04:04,660][52665] DAMAGECOUNT value on done: 920384.0 [2024-08-06 08:04:04,660][52665] Sum rewards: 76.967, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.448', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.084', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.598', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:05,184][52666] DAMAGECOUNT value on done: 922884.0 [2024-08-06 08:04:05,186][52666] Sum rewards: 66.134, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.020', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.062', 'AMMO4': '0.111', 'weapon5': '0.138', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 08:04:05,230][52803] DAMAGECOUNT value on done: 865344.0 [2024-08-06 08:04:05,231][52803] Sum rewards: 78.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.842', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.170', 'weapon5': '0.176', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.704', 'WEAPON3': '1.450', 'weapon3': '2.810', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:05,640][52670] DAMAGECOUNT value on done: 919516.0 [2024-08-06 08:04:05,640][52670] Sum rewards: 64.824, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.164', 'AMMO4': '0.176', 'AMMO3': '0.195', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.494', 'FRAGCOUNT': '54.000'} [2024-08-06 08:04:06,024][52820] DAMAGECOUNT value on done: 864937.0 [2024-08-06 08:04:06,027][52820] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.020', 'AMMO2': '0.078', 'weapon4': '0.150', 'weapon2': '0.202', 'AMMO3': '0.233', 'weapon5': '0.294', 'AMMO4': '0.389', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17439.3). Total num frames: 666157056. Throughput: 0: 4361.8. Samples: 166543340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:04:07,795][52567] Avg episode reward: [(0, '75.641')] [2024-08-06 08:04:07,878][52666] DAMAGECOUNT value on done: 926550.0 [2024-08-06 08:04:07,880][52666] Sum rewards: 70.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.240', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.162', 'AMMO4': '0.224', 'AMMO3': '0.224', 'weapon2': '0.260', 'weapon5': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:07,928][52665] DAMAGECOUNT value on done: 932372.0 [2024-08-06 08:04:07,930][52665] Sum rewards: 75.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.267', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.191', 'weapon2': '0.510', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:08,318][52803] DAMAGECOUNT value on done: 881112.0 [2024-08-06 08:04:08,318][52803] Sum rewards: 73.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.668', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.272', 'weapon2': '0.408', 'WEAPON3': '1.650', 'weapon3': '3.382', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:08,432][52670] DAMAGECOUNT value on done: 921529.0 [2024-08-06 08:04:08,432][52670] Sum rewards: 82.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.554', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.072', 'weapon5': '0.122', 'AMMO4': '0.141', 'AMMO3': '0.189', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '68.000'} [2024-08-06 08:04:08,916][52650] Updated weights for policy 0, policy_version 81321 (0.0022) [2024-08-06 08:04:09,212][52820] DAMAGECOUNT value on done: 854028.0 [2024-08-06 08:04:09,214][52820] Sum rewards: 71.922, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.355', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon5': '0.110', 'weapon4': '0.120', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.254', 'AMMO3': '0.279', 'WEAPON3': '1.700', 'weapon3': '3.194', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:09,682][52668] DAMAGECOUNT value on done: 940978.0 [2024-08-06 08:04:09,683][52668] Sum rewards: 72.503, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.008', 'AMMO2': '0.056', 'weapon4': '0.114', 'weapon5': '0.126', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'AMMO4': '0.281', 'WEAPON4': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:10,704][52666] DAMAGECOUNT value on done: 925099.0 [2024-08-06 08:04:10,705][52666] Sum rewards: 76.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.138', 'weapon2': '0.210', 'AMMO3': '0.234', 'AMMO4': '0.246', 'weapon5': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.960', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:10,758][52665] DAMAGECOUNT value on done: 925156.0 [2024-08-06 08:04:10,758][52665] Sum rewards: 80.815, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.185', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.097', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '3.006', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:11,086][52670] DAMAGECOUNT value on done: 916270.0 [2024-08-06 08:04:11,089][52670] Sum rewards: 63.681, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.520', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.154', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '51.000'} [2024-08-06 08:04:11,397][52803] DAMAGECOUNT value on done: 864524.0 [2024-08-06 08:04:11,397][52803] Sum rewards: 76.335, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.645', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.098', 'AMMO4': '0.168', 'weapon5': '0.184', 'AMMO3': '0.217', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '65.000'} [2024-08-06 08:04:12,250][52820] DAMAGECOUNT value on done: 865657.0 [2024-08-06 08:04:12,251][52820] Sum rewards: 78.429, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.722', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.102', 'AMMO4': '0.236', 'AMMO3': '0.242', 'weapon5': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.870', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '21.099', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:12,497][52668] DAMAGECOUNT value on done: 939838.0 [2024-08-06 08:04:12,501][52668] Sum rewards: 69.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.044', 'weapon5': '0.066', 'AMMO3': '0.194', 'AMMO4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:12,544][52649] DAMAGECOUNT value on done: 902792.0 [2024-08-06 08:04:12,545][52649] Sum rewards: 68.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.419', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.164', 'weapon5': '0.180', 'weapon4': '0.210', 'AMMO3': '0.226', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '57.000'} [2024-08-06 08:04:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 666247168. Throughput: 0: 4369.6. Samples: 166569630. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:04:12,794][52567] Avg episode reward: [(0, '75.765')] [2024-08-06 08:04:13,555][52666] DAMAGECOUNT value on done: 921817.0 [2024-08-06 08:04:13,555][52666] Sum rewards: 85.401, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.462', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.047', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.324', 'WEAPON3': '1.050', 'weapon3': '3.406', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '68.000'} [2024-08-06 08:04:13,624][52650] Updated weights for policy 0, policy_version 81331 (0.0011) [2024-08-06 08:04:13,832][52665] DAMAGECOUNT value on done: 927494.0 [2024-08-06 08:04:13,834][52665] Sum rewards: 86.446, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.056', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'HEALTH': '0.406', 'weapon2': '0.772', 'WEAPON3': '1.050', 'weapon3': '2.906', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:14,217][52670] DAMAGECOUNT value on done: 930865.0 [2024-08-06 08:04:14,219][52670] Sum rewards: 76.667, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.740', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.132', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.382', 'WEAPON3': '1.600', 'weapon3': '3.094', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:14,579][52803] DAMAGECOUNT value on done: 873847.0 [2024-08-06 08:04:14,580][52803] Sum rewards: 76.377, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.086', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.358', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:15,275][52820] DAMAGECOUNT value on done: 852642.0 [2024-08-06 08:04:15,276][52820] Sum rewards: 77.861, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.830', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.128', 'weapon5': '0.180', 'weapon2': '0.218', 'AMMO4': '0.220', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.162', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:15,557][52649] DAMAGECOUNT value on done: 900213.0 [2024-08-06 08:04:15,557][52649] Sum rewards: 82.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.810', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.050', 'AMMO3': '0.219', 'weapon2': '0.622', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:15,660][52668] DAMAGECOUNT value on done: 937061.0 [2024-08-06 08:04:15,662][52668] Sum rewards: 74.730, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.318', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.074', 'AMMO4': '0.108', 'weapon5': '0.116', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'ARMOR': '0.449', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:16,240][52666] DAMAGECOUNT value on done: 931722.0 [2024-08-06 08:04:16,242][52666] Sum rewards: 67.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.160', 'AMMO3': '0.165', 'weapon4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.050', 'HITCOUNT': '3.050', 'weapon3': '3.088', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '54.000'} [2024-08-06 08:04:16,813][52670] DAMAGECOUNT value on done: 914125.0 [2024-08-06 08:04:16,815][52670] Sum rewards: 65.984, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.124', 'AMMO3': '0.243', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '56.000'} [2024-08-06 08:04:17,014][52665] DAMAGECOUNT value on done: 909383.0 [2024-08-06 08:04:17,015][52665] Sum rewards: 77.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.670', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.088', 'weapon5': '0.138', 'AMMO4': '0.148', 'weapon2': '0.222', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:17,725][52803] DAMAGECOUNT value on done: 874810.0 [2024-08-06 08:04:17,726][52803] Sum rewards: 82.145, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.742', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.156', 'AMMO3': '0.160', 'weapon5': '0.186', 'weapon4': '0.208', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.144', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:17,800][52567] Fps is (10 sec: 18012.0, 60 sec: 17611.1, 300 sec: 17466.7). Total num frames: 666337280. Throughput: 0: 4368.8. Samples: 166582790. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:04:17,800][52567] Avg episode reward: [(0, '75.527')] [2024-08-06 08:04:18,351][52650] Updated weights for policy 0, policy_version 81341 (0.0023) [2024-08-06 08:04:18,391][52668] DAMAGECOUNT value on done: 939931.0 [2024-08-06 08:04:18,394][52668] Sum rewards: 77.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.503', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.082', 'AMMO4': '0.155', 'weapon5': '0.190', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:18,466][52820] DAMAGECOUNT value on done: 858094.0 [2024-08-06 08:04:18,467][52820] Sum rewards: 83.375, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.525', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.144', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.104', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '70.000'} [2024-08-06 08:04:18,482][52649] DAMAGECOUNT value on done: 914461.0 [2024-08-06 08:04:18,484][52649] Sum rewards: 74.637, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.502', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:19,393][52666] DAMAGECOUNT value on done: 924508.0 [2024-08-06 08:04:19,393][52666] Sum rewards: 76.593, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.625', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.044', 'weapon4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.153', 'weapon2': '0.342', 'WEAPON3': '1.050', 'weapon3': '3.372', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:19,769][52670] DAMAGECOUNT value on done: 930537.0 [2024-08-06 08:04:19,770][52670] Sum rewards: 80.703, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.106', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.104', 'AMMO3': '0.166', 'weapon5': '0.170', 'weapon2': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.446', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '62.500'} [2024-08-06 08:04:19,937][52665] DAMAGECOUNT value on done: 912746.0 [2024-08-06 08:04:19,937][52665] Sum rewards: 75.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.852', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.131', 'weapon5': '0.212', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:20,942][52803] DAMAGECOUNT value on done: 880863.0 [2024-08-06 08:04:20,944][52803] Sum rewards: 70.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.064', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.038', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.376', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:21,247][52668] DAMAGECOUNT value on done: 927328.0 [2024-08-06 08:04:21,249][52668] Sum rewards: 81.904, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.957', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.176', 'AMMO3': '0.180', 'weapon5': '0.202', 'AMMO4': '0.218', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.986', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:21,603][52649] DAMAGECOUNT value on done: 915050.0 [2024-08-06 08:04:21,604][52649] Sum rewards: 84.684, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.712', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.074', 'weapon5': '0.166', 'weapon2': '0.236', 'AMMO3': '0.239', 'AMMO4': '0.272', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.254', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.817', 'FRAGCOUNT': '71.000'} [2024-08-06 08:04:21,646][52820] DAMAGECOUNT value on done: 860874.0 [2024-08-06 08:04:21,650][52820] Sum rewards: 83.530, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.290', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.131', 'WEAPON5': '0.150', 'weapon2': '0.682', 'WEAPON3': '0.800', 'weapon3': '3.102', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:21,781][52666] DAMAGECOUNT value on done: 929428.0 [2024-08-06 08:04:21,783][52666] Sum rewards: 80.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.198', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.110', 'AMMO4': '0.151', 'weapon5': '0.164', 'AMMO3': '0.194', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '65.000'} [2024-08-06 08:04:22,341][52670] DAMAGECOUNT value on done: 934382.0 [2024-08-06 08:04:22,341][52670] Sum rewards: 82.918, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.870', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.134', 'AMMO3': '0.184', 'weapon2': '0.190', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 666419200. Throughput: 0: 4368.9. Samples: 166609030. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:04:22,794][52567] Avg episode reward: [(0, '76.090')] [2024-08-06 08:04:23,105][52650] Updated weights for policy 0, policy_version 81351 (0.0027) [2024-08-06 08:04:23,120][52665] DAMAGECOUNT value on done: 922816.0 [2024-08-06 08:04:23,120][52665] Sum rewards: 85.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.682', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.164', 'AMMO3': '0.225', 'weapon2': '0.598', 'WEAPON3': '1.450', 'weapon3': '2.984', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.249', 'FRAGCOUNT': '70.000'} [2024-08-06 08:04:23,921][52668] DAMAGECOUNT value on done: 936118.0 [2024-08-06 08:04:23,922][52668] Sum rewards: 68.994, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.306', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO4': '0.176', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '2.908', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:24,074][52803] DAMAGECOUNT value on done: 877944.0 [2024-08-06 08:04:24,074][52803] Sum rewards: 75.555, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.062', 'AMMO4': '0.075', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.298', 'weapon2': '0.318', 'WEAPON3': '1.750', 'weapon3': '3.178', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:24,471][52666] DAMAGECOUNT value on done: 914877.0 [2024-08-06 08:04:24,472][52666] Sum rewards: 85.999, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.817', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.190', 'weapon2': '0.212', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.370', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.991', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:24,518][52820] DAMAGECOUNT value on done: 867423.0 [2024-08-06 08:04:24,518][52820] Sum rewards: 75.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.092', 'weapon5': '0.116', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:24,787][52649] DAMAGECOUNT value on done: 906694.0 [2024-08-06 08:04:24,787][52649] Sum rewards: 74.090, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.662', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.157', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.050', 'HITCOUNT': '3.270', 'weapon3': '3.296', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:24,935][52670] DAMAGECOUNT value on done: 927511.0 [2024-08-06 08:04:24,936][52670] Sum rewards: 70.095, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.698', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.106', 'AMMO4': '0.172', 'AMMO3': '0.191', 'weapon5': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.686', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:25,670][52795] DAMAGECOUNT value on done: 860573.0 [2024-08-06 08:04:25,671][52795] Sum rewards: 79.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.438', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.148', 'AMMO4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.054', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:26,052][52665] DAMAGECOUNT value on done: 922539.0 [2024-08-06 08:04:26,054][52665] Sum rewards: 81.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.104', 'AMMO5': '0.015', 'AMMO2': '0.023', 'weapon4': '0.054', 'AMMO4': '0.115', 'weapon5': '0.178', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '68.000'} [2024-08-06 08:04:26,830][52668] DAMAGECOUNT value on done: 936431.0 [2024-08-06 08:04:26,831][52668] Sum rewards: 62.942, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.930', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.098', 'AMMO3': '0.158', 'weapon2': '0.206', 'AMMO4': '0.221', 'weapon5': '0.278', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.810', 'weapon3': '3.152', 'DAMAGECOUNT': '15.489', 'FRAGCOUNT': '51.000'} [2024-08-06 08:04:27,202][52666] DAMAGECOUNT value on done: 935854.0 [2024-08-06 08:04:27,202][52666] Sum rewards: 82.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.416', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.172', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:27,269][52803] DAMAGECOUNT value on done: 872232.0 [2024-08-06 08:04:27,270][52803] Sum rewards: 67.983, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO4': '0.139', 'weapon5': '0.180', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.150', 'HITCOUNT': '3.040', 'weapon3': '3.310', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '55.000'} [2024-08-06 08:04:27,569][52670] DAMAGECOUNT value on done: 911716.0 [2024-08-06 08:04:27,569][52670] Sum rewards: 81.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.191', 'weapon2': '0.198', 'WEAPON4': '0.200', 'weapon4': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.194', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:27,587][52820] DAMAGECOUNT value on done: 875992.0 [2024-08-06 08:04:27,588][52820] Sum rewards: 90.327, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.034', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.034', 'AMMO4': '0.123', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.390', 'HITCOUNT': '4.330', 'DAMAGECOUNT': '21.690', 'FRAGCOUNT': '74.000'} [2024-08-06 08:04:27,794][52567] Fps is (10 sec: 16393.8, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 666501120. Throughput: 0: 4373.7. Samples: 166635260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:04:27,795][52567] Avg episode reward: [(0, '76.362')] [2024-08-06 08:04:27,805][52649] DAMAGECOUNT value on done: 915977.0 [2024-08-06 08:04:27,805][52649] Sum rewards: 88.485, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.494', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.126', 'AMMO4': '0.164', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '72.000'} [2024-08-06 08:04:27,870][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081361_666509312.pth... [2024-08-06 08:04:27,944][52650] Updated weights for policy 0, policy_version 81361 (0.0044) [2024-08-06 08:04:28,039][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000080850_662323200.pth [2024-08-06 08:04:28,936][52667] DAMAGECOUNT value on done: 932649.0 [2024-08-06 08:04:28,936][52667] Sum rewards: 82.912, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.560', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon4': '0.116', 'weapon2': '0.234', 'AMMO3': '0.271', 'weapon5': '0.302', 'AMMO4': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.978', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '70.000'} [2024-08-06 08:04:29,062][52795] DAMAGECOUNT value on done: 850719.0 [2024-08-06 08:04:29,062][52795] Sum rewards: 79.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.288', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.245', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.348', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:29,201][52669] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon3', 0.002)] [2024-08-06 08:04:29,561][52665] DAMAGECOUNT value on done: 926014.0 [2024-08-06 08:04:29,561][52665] Sum rewards: 71.562, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.178', 'AMMO3': '0.203', 'weapon5': '0.238', 'AMMO4': '0.266', 'weapon2': '0.356', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.966', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:29,760][52668] DAMAGECOUNT value on done: 928651.0 [2024-08-06 08:04:29,760][52668] Sum rewards: 62.417, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.572', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.150', 'AMMO3': '0.179', 'AMMO4': '0.190', 'weapon2': '0.196', 'weapon5': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.118', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '48.500'} [2024-08-06 08:04:29,981][52666] DAMAGECOUNT value on done: 929077.0 [2024-08-06 08:04:29,981][52666] Sum rewards: 86.317, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.965', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.224', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '71.000'} [2024-08-06 08:04:30,626][52670] DAMAGECOUNT value on done: 924657.0 [2024-08-06 08:04:30,628][52670] Sum rewards: 73.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.515', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.072', 'weapon5': '0.126', 'AMMO4': '0.131', 'AMMO3': '0.181', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.388', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:30,718][52820] DAMAGECOUNT value on done: 857162.0 [2024-08-06 08:04:30,718][52820] Sum rewards: 74.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.442', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.183', 'weapon4': '0.254', 'weapon2': '0.278', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '59.000'} [2024-08-06 08:04:31,187][52649] DAMAGECOUNT value on done: 910870.0 [2024-08-06 08:04:31,187][52649] Sum rewards: 81.184, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.647', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.142', 'AMMO4': '0.152', 'weapon5': '0.178', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:31,679][52667] DAMAGECOUNT value on done: 948874.0 [2024-08-06 08:04:31,679][52667] Sum rewards: 81.203, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.878', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'weapon2': '0.256', 'AMMO3': '0.279', 'WEAPON3': '1.550', 'weapon3': '3.180', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:32,245][52795] DAMAGECOUNT value on done: 856345.0 [2024-08-06 08:04:32,245][52795] Sum rewards: 77.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.305', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'weapon4': '0.090', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.218', 'WEAPON3': '1.250', 'weapon3': '3.486', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:32,507][52650] Updated weights for policy 0, policy_version 81371 (0.0035) [2024-08-06 08:04:32,551][52668] DAMAGECOUNT value on done: 931876.0 [2024-08-06 08:04:32,553][52668] Sum rewards: 75.005, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.770', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.126', 'AMMO3': '0.154', 'weapon5': '0.160', 'AMMO4': '0.298', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.986', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:32,667][52665] DAMAGECOUNT value on done: 919591.0 [2024-08-06 08:04:32,667][52665] Sum rewards: 86.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.226', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.076', 'weapon5': '0.082', 'AMMO4': '0.093', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'WEAPON3': '1.150', 'weapon3': '3.406', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '70.000'} [2024-08-06 08:04:32,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 666599424. Throughput: 0: 4366.6. Samples: 166648230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:04:32,795][52567] Avg episode reward: [(0, '76.649')] [2024-08-06 08:04:33,034][52666] DAMAGECOUNT value on done: 929875.0 [2024-08-06 08:04:33,036][52666] Sum rewards: 80.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'AMMO5': '0.007', 'weapon5': '0.052', 'AMMO2': '0.058', 'weapon4': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'weapon2': '0.272', 'AMMO4': '0.290', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:33,403][52670] DAMAGECOUNT value on done: 933316.0 [2024-08-06 08:04:33,403][52670] Sum rewards: 71.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.145', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon5': '0.144', 'AMMO3': '0.200', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.714', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '61.500'} [2024-08-06 08:04:33,863][52820] DAMAGECOUNT value on done: 868067.0 [2024-08-06 08:04:33,865][52820] Sum rewards: 96.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.067', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.080', 'AMMO4': '0.092', 'weapon5': '0.136', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.492', 'WEAPON3': '1.000', 'weapon3': '3.062', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.780', 'FRAGCOUNT': '76.000'} [2024-08-06 08:04:34,261][52649] DAMAGECOUNT value on done: 913936.0 [2024-08-06 08:04:34,262][52649] Sum rewards: 81.092, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.826', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO3': '0.137', 'AMMO4': '0.172', 'weapon2': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.452', 'WEAPON3': '1.000', 'weapon3': '3.004', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:34,510][52667] DAMAGECOUNT value on done: 941168.0 [2024-08-06 08:04:34,510][52667] Sum rewards: 75.261, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.594', 'AMMO5': '0.019', 'AMMO2': '0.051', 'weapon4': '0.192', 'weapon5': '0.196', 'AMMO4': '0.255', 'AMMO3': '0.256', 'weapon2': '0.348', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.876', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '65.000'} [2024-08-06 08:04:35,285][52662] DAMAGECOUNT value on done: 932759.0 [2024-08-06 08:04:35,288][52662] Sum rewards: 72.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'weapon2': '0.166', 'AMMO3': '0.187', 'WEAPON3': '1.150', 'HITCOUNT': '3.460', 'weapon3': '3.480', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '59.000'} [2024-08-06 08:04:35,452][52795] DAMAGECOUNT value on done: 870077.0 [2024-08-06 08:04:35,452][52795] Sum rewards: 84.774, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.830', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.068', 'weapon5': '0.092', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.362', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.201', 'FRAGCOUNT': '71.000'} [2024-08-06 08:04:35,605][52665] DAMAGECOUNT value on done: 934913.0 [2024-08-06 08:04:35,605][52665] Sum rewards: 70.222, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.272', 'AMMO5': '0.020', 'AMMO2': '0.033', 'weapon5': '0.104', 'weapon4': '0.146', 'AMMO4': '0.164', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:35,648][52668] DAMAGECOUNT value on done: 940106.0 [2024-08-06 08:04:35,656][52668] Sum rewards: 85.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.114', 'weapon5': '0.136', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '70.000'} [2024-08-06 08:04:35,684][52666] DAMAGECOUNT value on done: 922334.0 [2024-08-06 08:04:35,686][52666] Sum rewards: 82.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.140', 'AMMO2': '0.014', 'AMMO4': '0.072', 'AMMO3': '0.233', 'weapon2': '0.256', 'WEAPON3': '1.350', 'weapon3': '3.566', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '68.000'} [2024-08-06 08:04:36,119][52670] DAMAGECOUNT value on done: 927972.0 [2024-08-06 08:04:36,120][52670] Sum rewards: 75.901, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.955', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.172', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.430', 'WEAPON3': '1.050', 'weapon3': '2.828', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:36,946][52820] DAMAGECOUNT value on done: 879912.0 [2024-08-06 08:04:36,951][52820] Sum rewards: 78.444, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.930', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.096', 'weapon4': '0.144', 'AMMO4': '0.160', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:37,064][52649] DAMAGECOUNT value on done: 909409.0 [2024-08-06 08:04:37,065][52649] Sum rewards: 72.087, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.915', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.146', 'AMMO3': '0.163', 'weapon5': '0.188', 'AMMO4': '0.201', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.560', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:37,117][52650] Updated weights for policy 0, policy_version 81381 (0.0023) [2024-08-06 08:04:37,736][52667] DAMAGECOUNT value on done: 945414.0 [2024-08-06 08:04:37,736][52667] Sum rewards: 63.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.725', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.182', 'weapon2': '0.186', 'AMMO4': '0.216', 'AMMO3': '0.228', 'weapon4': '0.274', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '52.000'} [2024-08-06 08:04:37,794][52567] Fps is (10 sec: 18021.8, 60 sec: 17612.7, 300 sec: 17439.2). Total num frames: 666681344. Throughput: 0: 4360.2. Samples: 166674190. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:04:37,795][52567] Avg episode reward: [(0, '77.431')] [2024-08-06 08:04:37,979][52666] DAMAGECOUNT value on done: 920797.0 [2024-08-06 08:04:37,979][52666] Sum rewards: 78.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.160', 'AMMO3': '0.207', 'AMMO4': '0.213', 'weapon5': '0.218', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:38,140][52665] DAMAGECOUNT value on done: 928839.0 [2024-08-06 08:04:38,140][52665] Sum rewards: 93.315, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.124', 'weapon2': '0.172', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.897', 'FRAGCOUNT': '75.000'} [2024-08-06 08:04:38,378][52670] DAMAGECOUNT value on done: 928981.0 [2024-08-06 08:04:38,380][52670] Sum rewards: 75.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.226', 'AMMO3': '0.254', 'weapon2': '0.444', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '65.000'} [2024-08-06 08:04:38,446][52662] DAMAGECOUNT value on done: 942424.0 [2024-08-06 08:04:38,446][52662] Sum rewards: 75.914, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.146', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:38,582][52668] DAMAGECOUNT value on done: 932826.0 [2024-08-06 08:04:38,582][52668] Sum rewards: 81.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.404', 'AMMO5': '0.023', 'AMMO2': '0.042', 'AMMO3': '0.156', 'AMMO4': '0.211', 'weapon4': '0.238', 'weapon5': '0.378', 'WEAPON4': '0.400', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.626', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.383', 'FRAGCOUNT': '63.500'} [2024-08-06 08:04:38,797][52795] DAMAGECOUNT value on done: 855140.0 [2024-08-06 08:04:38,801][52795] Sum rewards: 91.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.194', 'weapon5': '0.228', 'AMMO3': '0.233', 'AMMO4': '0.262', 'weapon2': '0.314', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '22.467', 'FRAGCOUNT': '75.000'} [2024-08-06 08:04:39,773][52649] DAMAGECOUNT value on done: 904848.0 [2024-08-06 08:04:39,774][52649] Sum rewards: 76.875, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.166', 'weapon4': '0.232', 'AMMO4': '0.252', 'weapon5': '0.294', 'weapon2': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'HEALTH': '1.093', 'weapon3': '2.872', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:40,194][52820] DAMAGECOUNT value on done: 869514.0 [2024-08-06 08:04:40,194][52820] Sum rewards: 87.934, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.545', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.034', 'AMMO4': '0.130', 'AMMO3': '0.161', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.836', 'WEAPON3': '1.000', 'weapon3': '2.816', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '68.000'} [2024-08-06 08:04:40,533][52666] DAMAGECOUNT value on done: 940726.0 [2024-08-06 08:04:40,534][52666] Sum rewards: 81.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.080', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.346', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:40,827][52667] DAMAGECOUNT value on done: 947790.0 [2024-08-06 08:04:40,836][52667] Sum rewards: 74.574, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.170', 'AMMO2': '0.033', 'weapon4': '0.062', 'WEAPON4': '0.100', 'AMMO4': '0.166', 'AMMO3': '0.267', 'weapon2': '0.394', 'WEAPON3': '1.650', 'weapon3': '3.340', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:41,049][52665] DAMAGECOUNT value on done: 924643.0 [2024-08-06 08:04:41,052][52665] Sum rewards: 73.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.545', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.454', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '59.500'} [2024-08-06 08:04:41,095][52669] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:04:41,273][52662] DAMAGECOUNT value on done: 941125.0 [2024-08-06 08:04:41,273][52662] Sum rewards: 83.048, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.399', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon4': '0.156', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:41,623][52668] DAMAGECOUNT value on done: 927663.0 [2024-08-06 08:04:41,625][52668] Sum rewards: 82.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.294', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.106', 'AMMO4': '0.139', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.264', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:41,893][52650] Updated weights for policy 0, policy_version 81391 (0.0012) [2024-08-06 08:04:42,023][52795] DAMAGECOUNT value on done: 859776.0 [2024-08-06 08:04:42,023][52795] Sum rewards: 74.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.395', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.074', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:42,669][52649] DAMAGECOUNT value on done: 919181.0 [2024-08-06 08:04:42,670][52649] Sum rewards: 71.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.895', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.164', 'AMMO3': '0.178', 'weapon2': '0.214', 'weapon4': '0.216', 'AMMO4': '0.220', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '57.500'} [2024-08-06 08:04:42,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17341.4, 300 sec: 17439.2). Total num frames: 666763264. Throughput: 0: 4356.4. Samples: 166700210. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:04:42,794][52567] Avg episode reward: [(0, '77.641')] [2024-08-06 08:04:43,339][52666] DAMAGECOUNT value on done: 913966.0 [2024-08-06 08:04:43,339][52666] Sum rewards: 80.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.980', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:43,418][52820] DAMAGECOUNT value on done: 867806.0 [2024-08-06 08:04:43,418][52820] Sum rewards: 70.251, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.952', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.058', 'AMMO3': '0.166', 'weapon5': '0.188', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.234', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '56.000'} [2024-08-06 08:04:43,483][52803] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:04:43,908][52667] DAMAGECOUNT value on done: 946049.0 [2024-08-06 08:04:43,908][52667] Sum rewards: 75.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.316', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.190', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '62.500'} [2024-08-06 08:04:43,971][52665] DAMAGECOUNT value on done: 923793.0 [2024-08-06 08:04:43,971][52665] Sum rewards: 55.487, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.924', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.094', 'weapon5': '0.210', 'AMMO3': '0.233', 'AMMO4': '0.258', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.048', 'DAMAGECOUNT': '13.959', 'FRAGCOUNT': '49.000'} [2024-08-06 08:04:44,548][52662] DAMAGECOUNT value on done: 931179.0 [2024-08-06 08:04:44,549][52662] Sum rewards: 81.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.220', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.234', 'weapon5': '0.258', 'AMMO4': '0.267', 'weapon2': '0.286', 'weapon4': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.676', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:44,701][52668] DAMAGECOUNT value on done: 924018.0 [2024-08-06 08:04:44,702][52668] Sum rewards: 79.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.245', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'AMMO3': '0.188', 'weapon4': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '3.140', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:45,156][52795] DAMAGECOUNT value on done: 869862.0 [2024-08-06 08:04:45,156][52795] Sum rewards: 89.497, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO4': '0.061', 'AMMO3': '0.192', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '73.000'} [2024-08-06 08:04:46,018][52649] DAMAGECOUNT value on done: 926504.0 [2024-08-06 08:04:46,026][52649] Sum rewards: 66.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO3': '0.154', 'AMMO4': '0.165', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.364', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '2.766', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '54.000'} [2024-08-06 08:04:46,128][52666] DAMAGECOUNT value on done: 926037.0 [2024-08-06 08:04:46,128][52666] Sum rewards: 91.211, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.952', 'AMMO2': '0.013', 'AMMO4': '0.062', 'AMMO3': '0.169', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.460', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '74.000'} [2024-08-06 08:04:46,396][52667] DAMAGECOUNT value on done: 939955.0 [2024-08-06 08:04:46,398][52667] Sum rewards: 70.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.442', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.094', 'AMMO3': '0.210', 'weapon4': '0.230', 'AMMO4': '0.243', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.056', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '59.000'} [2024-08-06 08:04:46,546][52650] Updated weights for policy 0, policy_version 81401 (0.0033) [2024-08-06 08:04:46,580][52820] DAMAGECOUNT value on done: 865690.0 [2024-08-06 08:04:46,582][52820] Sum rewards: 75.211, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.210', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.104', 'weapon5': '0.154', 'weapon2': '0.218', 'AMMO4': '0.251', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '64.000'} [2024-08-06 08:04:46,858][52665] DAMAGECOUNT value on done: 920553.0 [2024-08-06 08:04:46,858][52665] Sum rewards: 67.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.128', 'weapon5': '0.158', 'AMMO4': '0.238', 'AMMO3': '0.261', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:47,501][52662] DAMAGECOUNT value on done: 948399.0 [2024-08-06 08:04:47,502][52662] Sum rewards: 81.762, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.305', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.478', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:47,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 666853376. Throughput: 0: 4355.5. Samples: 166713290. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:04:47,794][52567] Avg episode reward: [(0, '77.748')] [2024-08-06 08:04:47,805][52668] DAMAGECOUNT value on done: 922050.0 [2024-08-06 08:04:47,805][52668] Sum rewards: 74.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:48,037][52647] DAMAGECOUNT value on done: 996878.0 [2024-08-06 08:04:48,038][52647] Sum rewards: 76.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO3': '0.174', 'AMMO4': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:48,210][52795] DAMAGECOUNT value on done: 860213.0 [2024-08-06 08:04:48,212][52795] Sum rewards: 80.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.084', 'AMMO4': '0.148', 'weapon5': '0.184', 'AMMO3': '0.215', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '67.000'} [2024-08-06 08:04:48,693][52649] DAMAGECOUNT value on done: 916180.0 [2024-08-06 08:04:48,693][52649] Sum rewards: 75.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.109', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.134', 'AMMO4': '0.177', 'AMMO3': '0.189', 'weapon2': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.370', 'weapon3': '3.408', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:48,912][52667] DAMAGECOUNT value on done: 935198.0 [2024-08-06 08:04:48,913][52667] Sum rewards: 76.676, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.996', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.124', 'AMMO4': '0.133', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:49,792][52662] DAMAGECOUNT value on done: 924644.0 [2024-08-06 08:04:49,792][52662] Sum rewards: 87.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.394', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.152', 'weapon5': '0.202', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.531', 'FRAGCOUNT': '71.000'} [2024-08-06 08:04:49,810][52665] DAMAGECOUNT value on done: 926345.0 [2024-08-06 08:04:49,811][52665] Sum rewards: 94.198, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.034', 'AMMO3': '0.169', 'AMMO4': '0.171', 'weapon4': '0.180', 'weapon5': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '76.000'} [2024-08-06 08:04:49,852][52820] DAMAGECOUNT value on done: 867777.0 [2024-08-06 08:04:49,852][52820] Sum rewards: 68.503, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.721', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.068', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.408', 'WEAPON3': '1.600', 'weapon3': '3.276', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '59.000'} [2024-08-06 08:04:50,636][52668] DAMAGECOUNT value on done: 917885.0 [2024-08-06 08:04:50,639][52668] Sum rewards: 78.944, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.272', 'ARMOR': '0.004', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.096', 'AMMO4': '0.180', 'weapon5': '0.192', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '66.500'} [2024-08-06 08:04:50,662][52649] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:04:51,122][52650] Updated weights for policy 0, policy_version 81411 (0.0026) [2024-08-06 08:04:51,185][52647] DAMAGECOUNT value on done: 982562.0 [2024-08-06 08:04:51,185][52647] Sum rewards: 71.462, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.992', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.213', 'weapon2': '0.232', 'AMMO4': '0.246', 'weapon5': '0.328', 'weapon4': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.746', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:51,424][52795] DAMAGECOUNT value on done: 863451.0 [2024-08-06 08:04:51,425][52795] Sum rewards: 77.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.282', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.096', 'AMMO3': '0.155', 'weapon5': '0.160', 'AMMO4': '0.202', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.092', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:51,433][52667] DAMAGECOUNT value on done: 939284.0 [2024-08-06 08:04:51,435][52667] Sum rewards: 81.749, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.134', 'weapon5': '0.140', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:51,447][52649] DAMAGECOUNT value on done: 916479.0 [2024-08-06 08:04:51,448][52649] Sum rewards: 73.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.972', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon4': '0.096', 'AMMO3': '0.197', 'weapon5': '0.224', 'AMMO4': '0.284', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:52,651][52662] DAMAGECOUNT value on done: 931742.0 [2024-08-06 08:04:52,652][52662] Sum rewards: 78.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.019', 'AMMO2': '0.048', 'AMMO3': '0.183', 'weapon5': '0.226', 'weapon4': '0.232', 'AMMO4': '0.239', 'weapon2': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '63.000'} [2024-08-06 08:04:52,671][52665] DAMAGECOUNT value on done: 924253.0 [2024-08-06 08:04:52,671][52665] Sum rewards: 66.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.464', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.132', 'weapon2': '0.146', 'AMMO3': '0.160', 'AMMO4': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.450', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '54.000'} [2024-08-06 08:04:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 666943488. Throughput: 0: 4360.2. Samples: 166739550. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:04:52,794][52567] Avg episode reward: [(0, '77.915')] [2024-08-06 08:04:52,935][52820] DAMAGECOUNT value on done: 875998.0 [2024-08-06 08:04:52,935][52820] Sum rewards: 81.291, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.940', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.024', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.234', 'AMMO3': '0.287', 'WEAPON3': '1.800', 'weapon3': '3.496', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '72.000'} [2024-08-06 08:04:53,498][52668] DAMAGECOUNT value on done: 932823.0 [2024-08-06 08:04:53,498][52668] Sum rewards: 75.506, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.110', 'weapon5': '0.148', 'AMMO4': '0.155', 'AMMO3': '0.186', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.726', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:54,001][52647] DAMAGECOUNT value on done: 990160.0 [2024-08-06 08:04:54,001][52647] Sum rewards: 81.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.146', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.068', 'weapon5': '0.158', 'AMMO3': '0.194', 'AMMO4': '0.227', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.814', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '66.000'} [2024-08-06 08:04:54,220][52667] DAMAGECOUNT value on done: 944968.0 [2024-08-06 08:04:54,221][52667] Sum rewards: 66.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.939', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.154', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'weapon4': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '54.000'} [2024-08-06 08:04:54,576][52795] DAMAGECOUNT value on done: 869529.0 [2024-08-06 08:04:54,576][52795] Sum rewards: 63.884, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.240', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO4': '0.234', 'AMMO3': '0.273', 'weapon5': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.370', 'weapon2': '0.424', 'WEAPON3': '1.600', 'weapon3': '2.604', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.581', 'FRAGCOUNT': '54.000'} [2024-08-06 08:04:54,738][52649] DAMAGECOUNT value on done: 904274.0 [2024-08-06 08:04:54,739][52649] Sum rewards: 74.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.174', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.216', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:55,403][52662] DAMAGECOUNT value on done: 948191.0 [2024-08-06 08:04:55,403][52662] Sum rewards: 80.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.033', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.142', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.824', 'FRAGCOUNT': '65.000'} [2024-08-06 08:04:55,745][52665] DAMAGECOUNT value on done: 915916.0 [2024-08-06 08:04:55,745][52665] Sum rewards: 75.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.750', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.268', 'weapon2': '0.346', 'WEAPON3': '1.750', 'weapon3': '3.240', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '65.000'} [2024-08-06 08:04:55,921][52650] Updated weights for policy 0, policy_version 81421 (0.0020) [2024-08-06 08:04:56,014][52820] DAMAGECOUNT value on done: 874049.0 [2024-08-06 08:04:56,017][52820] Sum rewards: 68.766, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.130', 'AMMO4': '0.181', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '57.000'} [2024-08-06 08:04:56,523][52668] DAMAGECOUNT value on done: 933942.0 [2024-08-06 08:04:56,523][52668] Sum rewards: 71.133, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.105', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.120', 'weapon5': '0.120', 'weapon2': '0.156', 'AMMO4': '0.168', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.400', 'DAMAGECOUNT': '16.002', 'FRAGCOUNT': '60.000'} [2024-08-06 08:04:56,741][52647] DAMAGECOUNT value on done: 987558.0 [2024-08-06 08:04:56,741][52647] Sum rewards: 68.716, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.240', 'AMMO5': '0.027', 'AMMO2': '0.077', 'weapon4': '0.106', 'AMMO3': '0.236', 'weapon5': '0.254', 'AMMO4': '0.386', 'weapon2': '0.468', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.834', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.047', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:56,992][52667] DAMAGECOUNT value on done: 934238.0 [2024-08-06 08:04:56,992][52667] Sum rewards: 76.669, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.720', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.153', 'weapon5': '0.180', 'weapon4': '0.206', 'AMMO4': '0.216', 'weapon2': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.064', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '62.000'} [2024-08-06 08:04:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 667025408. Throughput: 0: 4360.4. Samples: 166765850. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:04:57,794][52567] Avg episode reward: [(0, '77.613')] [2024-08-06 08:04:57,806][52795] DAMAGECOUNT value on done: 864668.0 [2024-08-06 08:04:57,807][52795] Sum rewards: 67.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.622', 'AMMO5': '0.018', 'AMMO2': '0.038', 'AMMO4': '0.189', 'AMMO3': '0.222', 'weapon5': '0.222', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '55.000'} [2024-08-06 08:04:58,030][52649] DAMAGECOUNT value on done: 916822.0 [2024-08-06 08:04:58,030][52649] Sum rewards: 70.611, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.715', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.184', 'weapon2': '0.382', 'WEAPON3': '1.200', 'HITCOUNT': '3.340', 'weapon3': '3.530', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:58,107][52662] DAMAGECOUNT value on done: 935979.0 [2024-08-06 08:04:58,108][52662] Sum rewards: 81.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.048', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon2': '0.146', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.548', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '69.000'} [2024-08-06 08:04:58,897][52665] DAMAGECOUNT value on done: 919602.0 [2024-08-06 08:04:58,898][52665] Sum rewards: 72.099, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.049', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.088', 'AMMO4': '0.091', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.402', 'WEAPON3': '1.050', 'weapon3': '3.220', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '58.000'} [2024-08-06 08:04:59,108][52820] DAMAGECOUNT value on done: 863309.0 [2024-08-06 08:04:59,108][52820] Sum rewards: 84.729, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.002', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.096', 'AMMO4': '0.105', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.202', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '22.182', 'FRAGCOUNT': '68.000'} [2024-08-06 08:04:59,435][52668] DAMAGECOUNT value on done: 934839.0 [2024-08-06 08:04:59,437][52668] Sum rewards: 74.298, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.110', 'weapon5': '0.114', 'AMMO3': '0.218', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.368', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '61.000'} [2024-08-06 08:04:59,520][52647] DAMAGECOUNT value on done: 997462.0 [2024-08-06 08:04:59,521][52647] Sum rewards: 73.939, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.768', 'AMMO5': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon4': '0.116', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon5': '0.246', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '59.000'} [2024-08-06 08:05:00,193][52667] DAMAGECOUNT value on done: 936615.0 [2024-08-06 08:05:00,193][52667] Sum rewards: 78.887, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.101', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.134', 'weapon5': '0.172', 'AMMO4': '0.185', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '64.000'} [2024-08-06 08:05:00,241][52659] DAMAGECOUNT value on done: 937218.0 [2024-08-06 08:05:00,241][52659] Sum rewards: 71.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.414', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.022', 'AMMO4': '0.028', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.322', 'WEAPON3': '1.350', 'HITCOUNT': '3.310', 'weapon3': '3.434', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '60.000'} [2024-08-06 08:05:00,655][52650] Updated weights for policy 0, policy_version 81431 (0.0037) [2024-08-06 08:05:00,800][52649] DAMAGECOUNT value on done: 897875.0 [2024-08-06 08:05:00,801][52649] Sum rewards: 71.770, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.084', 'HEALTH': '0.122', 'AMMO3': '0.148', 'AMMO4': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON4': '0.350', 'weapon4': '0.396', 'WEAPON3': '0.900', 'weapon3': '2.896', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '56.000'} [2024-08-06 08:05:01,043][52795] DAMAGECOUNT value on done: 855675.0 [2024-08-06 08:05:01,043][52795] Sum rewards: 83.604, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.660', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.257', 'weapon2': '0.314', 'WEAPON3': '1.700', 'weapon3': '3.396', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.580', 'FRAGCOUNT': '71.000'} [2024-08-06 08:05:01,121][52662] DAMAGECOUNT value on done: 940861.0 [2024-08-06 08:05:01,122][52662] Sum rewards: 82.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.545', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.098', 'weapon4': '0.106', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.370', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '70.000'} [2024-08-06 08:05:01,832][52665] DAMAGECOUNT value on done: 925911.0 [2024-08-06 08:05:01,840][52665] Sum rewards: 81.071, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.616', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.036', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.182', 'AMMO3': '0.211', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.396', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:02,556][52668] DAMAGECOUNT value on done: 934107.0 [2024-08-06 08:05:02,556][52668] Sum rewards: 67.290, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.920', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.086', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.502', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.238', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '54.000'} [2024-08-06 08:05:02,582][52667] DAMAGECOUNT value on done: 944658.0 [2024-08-06 08:05:02,583][52667] Sum rewards: 78.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon4': '0.100', 'AMMO3': '0.196', 'weapon5': '0.208', 'AMMO4': '0.276', 'weapon2': '0.442', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.956', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '63.000'} [2024-08-06 08:05:02,618][52660] DAMAGECOUNT value on done: 930017.0 [2024-08-06 08:05:02,618][52660] Sum rewards: 64.555, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.096', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.320', 'DAMAGECOUNT': '15.414', 'FRAGCOUNT': '58.000'} [2024-08-06 08:05:02,650][52647] DAMAGECOUNT value on done: 992785.0 [2024-08-06 08:05:02,651][52647] Sum rewards: 69.563, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.134', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.063', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 08:05:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 667115520. Throughput: 0: 4359.9. Samples: 166778960. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:05:02,794][52567] Avg episode reward: [(0, '77.118')] [2024-08-06 08:05:03,403][52659] DAMAGECOUNT value on done: 933942.0 [2024-08-06 08:05:03,403][52659] Sum rewards: 78.373, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.058', 'weapon5': '0.160', 'AMMO3': '0.208', 'AMMO4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:03,671][52649] DAMAGECOUNT value on done: 918217.0 [2024-08-06 08:05:03,671][52649] Sum rewards: 66.894, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.455', 'AMMO5': '0.007', 'AMMO2': '0.048', 'weapon4': '0.050', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'AMMO4': '0.240', 'weapon2': '0.312', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.298', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '53.000'} [2024-08-06 08:05:04,172][52795] DAMAGECOUNT value on done: 862536.0 [2024-08-06 08:05:04,173][52795] Sum rewards: 76.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.027', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon5': '0.048', 'AMMO4': '0.078', 'weapon4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.252', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.372', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:04,694][52662] DAMAGECOUNT value on done: 934199.0 [2024-08-06 08:05:04,697][52662] Sum rewards: 76.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.466', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.103', 'weapon4': '0.104', 'weapon5': '0.112', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '63.000'} [2024-08-06 08:05:05,147][52650] Updated weights for policy 0, policy_version 81441 (0.0013) [2024-08-06 08:05:05,183][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:05:05,494][52667] DAMAGECOUNT value on done: 934271.0 [2024-08-06 08:05:05,494][52667] Sum rewards: 65.309, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.158', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '56.000'} [2024-08-06 08:05:05,505][52668] DAMAGECOUNT value on done: 940563.0 [2024-08-06 08:05:05,505][52668] Sum rewards: 77.868, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO4': '0.170', 'AMMO3': '0.242', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:05,588][52660] DAMAGECOUNT value on done: 923016.0 [2024-08-06 08:05:05,588][52660] Sum rewards: 70.358, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.130', 'AMMO4': '0.166', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.250', 'HITCOUNT': '3.210', 'weapon3': '3.254', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '59.000'} [2024-08-06 08:05:05,688][52647] DAMAGECOUNT value on done: 996458.0 [2024-08-06 08:05:05,688][52647] Sum rewards: 82.819, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.359', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.094', 'AMMO4': '0.105', 'weapon5': '0.130', 'AMMO3': '0.161', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:06,104][52659] DAMAGECOUNT value on done: 945075.0 [2024-08-06 08:05:06,104][52659] Sum rewards: 65.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.126', 'weapon4': '0.130', 'AMMO4': '0.217', 'AMMO3': '0.231', 'weapon2': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.250', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '56.000'} [2024-08-06 08:05:06,523][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:05:06,849][52649] DAMAGECOUNT value on done: 919044.0 [2024-08-06 08:05:06,857][52649] Sum rewards: 77.100, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.602', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.119', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '3.198', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '62.000'} [2024-08-06 08:05:07,310][52662] DAMAGECOUNT value on done: 934312.0 [2024-08-06 08:05:07,310][52662] Sum rewards: 64.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'AMMO3': '0.244', 'weapon2': '0.486', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '56.000'} [2024-08-06 08:05:07,357][52795] DAMAGECOUNT value on done: 867114.0 [2024-08-06 08:05:07,359][52795] Sum rewards: 80.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.074', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:07,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 667205632. Throughput: 0: 4361.3. Samples: 166805290. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:05:07,795][52567] Avg episode reward: [(0, '76.454')] [2024-08-06 08:05:08,573][52660] DAMAGECOUNT value on done: 935369.0 [2024-08-06 08:05:08,574][52660] Sum rewards: 79.852, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.048', 'weapon4': '0.094', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:08,650][52667] DAMAGECOUNT value on done: 941816.0 [2024-08-06 08:05:08,650][52667] Sum rewards: 71.747, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.002', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.104', 'weapon4': '0.126', 'AMMO4': '0.157', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '61.000'} [2024-08-06 08:05:08,706][52647] DAMAGECOUNT value on done: 972521.0 [2024-08-06 08:05:08,707][52647] Sum rewards: 78.659, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.786', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon4': '0.138', 'weapon5': '0.204', 'AMMO3': '0.219', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '67.000'} [2024-08-06 08:05:08,788][52659] DAMAGECOUNT value on done: 937479.0 [2024-08-06 08:05:08,791][52659] Sum rewards: 61.743, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.479', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.168', 'AMMO3': '0.175', 'AMMO4': '0.191', 'weapon4': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.000', 'weapon3': '2.912', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '50.500'} [2024-08-06 08:05:09,826][52662] DAMAGECOUNT value on done: 927185.0 [2024-08-06 08:05:09,826][52662] Sum rewards: 74.874, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.540', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.110', 'AMMO3': '0.164', 'weapon5': '0.186', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '0.950', 'weapon3': '2.998', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '59.000'} [2024-08-06 08:05:09,883][52649] DAMAGECOUNT value on done: 909472.0 [2024-08-06 08:05:09,884][52649] Sum rewards: 60.291, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.104', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.274', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.310', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '53.000'} [2024-08-06 08:05:09,954][52650] Updated weights for policy 0, policy_version 81451 (0.0011) [2024-08-06 08:05:10,647][52795] DAMAGECOUNT value on done: 856248.0 [2024-08-06 08:05:10,647][52795] Sum rewards: 79.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.224', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.072', 'AMMO3': '0.164', 'weapon5': '0.172', 'AMMO4': '0.248', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.650', 'WEAPON3': '0.950', 'weapon3': '2.858', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '64.000'} [2024-08-06 08:05:11,445][52660] DAMAGECOUNT value on done: 946951.0 [2024-08-06 08:05:11,447][52660] Sum rewards: 69.736, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.508', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.154', 'AMMO3': '0.193', 'AMMO4': '0.197', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.214', 'DAMAGECOUNT': '16.212', 'FRAGCOUNT': '57.000'} [2024-08-06 08:05:11,720][52667] DAMAGECOUNT value on done: 947710.0 [2024-08-06 08:05:11,723][52667] Sum rewards: 79.584, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.310', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:11,810][52659] DAMAGECOUNT value on done: 933076.0 [2024-08-06 08:05:11,810][52647] DAMAGECOUNT value on done: 986117.0 [2024-08-06 08:05:11,810][52647] Sum rewards: 66.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.152', 'weapon5': '0.208', 'weapon2': '0.224', 'AMMO3': '0.230', 'AMMO4': '0.250', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.140', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:11,812][52659] Sum rewards: 77.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.402', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.226', 'WEAPON3': '1.500', 'weapon3': '3.468', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '67.000'} [2024-08-06 08:05:12,427][52662] DAMAGECOUNT value on done: 937760.0 [2024-08-06 08:05:12,428][52662] Sum rewards: 79.110, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.050', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'weapon4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:12,794][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 667295744. Throughput: 0: 4358.2. Samples: 166831380. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:05:12,795][52567] Avg episode reward: [(0, '75.624')] [2024-08-06 08:05:13,914][52795] DAMAGECOUNT value on done: 864700.0 [2024-08-06 08:05:13,914][52795] Sum rewards: 78.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.193', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.088', 'AMMO4': '0.192', 'AMMO3': '0.246', 'weapon2': '0.282', 'weapon5': '0.320', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.998', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:14,081][52660] DAMAGECOUNT value on done: 928844.0 [2024-08-06 08:05:14,081][52660] Sum rewards: 72.039, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.101', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.134', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon5': '0.214', 'AMMO3': '0.245', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '2.986', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '61.000'} [2024-08-06 08:05:14,323][52659] Large shaping reward 3.516 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:05:14,433][52659] DAMAGECOUNT value on done: 937381.0 [2024-08-06 08:05:14,434][52659] Sum rewards: 90.828, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon4': '0.038', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.231', 'weapon2': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.446', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.309', 'FRAGCOUNT': '74.000'} [2024-08-06 08:05:14,506][52647] DAMAGECOUNT value on done: 984277.0 [2024-08-06 08:05:14,506][52647] Sum rewards: 78.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.465', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.151', 'weapon4': '0.168', 'AMMO3': '0.185', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '64.000'} [2024-08-06 08:05:14,541][52650] Updated weights for policy 0, policy_version 81461 (0.0018) [2024-08-06 08:05:14,697][52667] DAMAGECOUNT value on done: 947073.0 [2024-08-06 08:05:14,698][52667] Sum rewards: 76.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.096', 'AMMO3': '0.225', 'weapon5': '0.226', 'weapon2': '0.232', 'AMMO4': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:15,524][52662] DAMAGECOUNT value on done: 929720.0 [2024-08-06 08:05:15,526][52662] Sum rewards: 92.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.783', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon4': '0.024', 'weapon5': '0.038', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.384', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '75.000'} [2024-08-06 08:05:16,439][52660] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:05:16,904][52660] DAMAGECOUNT value on done: 926159.0 [2024-08-06 08:05:16,904][52660] Sum rewards: 82.830, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.538', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.168', 'AMMO3': '0.207', 'weapon2': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.922', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '67.000'} [2024-08-06 08:05:16,995][52659] DAMAGECOUNT value on done: 937022.0 [2024-08-06 08:05:16,998][52659] Sum rewards: 74.300, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.578', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.151', 'AMMO3': '0.180', 'weapon5': '0.234', 'weapon4': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.716', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '60.000'} [2024-08-06 08:05:17,128][52795] DAMAGECOUNT value on done: 865158.0 [2024-08-06 08:05:17,128][52795] Sum rewards: 73.577, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.016', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon5': '0.158', 'weapon4': '0.160', 'AMMO4': '0.230', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '63.000'} [2024-08-06 08:05:17,585][52647] DAMAGECOUNT value on done: 983072.0 [2024-08-06 08:05:17,586][52647] Sum rewards: 80.057, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.523', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.176', 'weapon4': '0.182', 'AMMO3': '0.255', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '68.000'} [2024-08-06 08:05:17,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17478.0, 300 sec: 17467.0). Total num frames: 667385856. Throughput: 0: 4359.4. Samples: 166844400. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:05:17,794][52567] Avg episode reward: [(0, '75.754')] [2024-08-06 08:05:18,227][52667] DAMAGECOUNT value on done: 943720.0 [2024-08-06 08:05:18,229][52667] Sum rewards: 75.400, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.446', 'AMMO5': '0.026', 'AMMO2': '0.064', 'weapon4': '0.124', 'weapon5': '0.218', 'AMMO3': '0.256', 'weapon2': '0.308', 'AMMO4': '0.320', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.968', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '66.500'} [2024-08-06 08:05:18,590][52662] DAMAGECOUNT value on done: 947284.0 [2024-08-06 08:05:18,590][52662] Sum rewards: 80.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.588', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'weapon5': '0.110', 'weapon4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.254', 'WEAPON3': '1.350', 'weapon3': '3.328', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:19,542][52650] Updated weights for policy 0, policy_version 81471 (0.0026) [2024-08-06 08:05:19,889][52660] DAMAGECOUNT value on done: 930591.0 [2024-08-06 08:05:19,889][52660] Sum rewards: 66.452, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.037', 'AMMO5': '0.021', 'AMMO2': '0.040', 'AMMO3': '0.124', 'AMMO4': '0.199', 'weapon2': '0.236', 'weapon5': '0.270', 'weapon4': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '0.750', 'weapon3': '2.920', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.966', 'FRAGCOUNT': '50.000'} [2024-08-06 08:05:20,141][52659] DAMAGECOUNT value on done: 936849.0 [2024-08-06 08:05:20,144][52659] Sum rewards: 78.681, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.738', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.094', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.280', 'WEAPON3': '1.350', 'weapon3': '3.302', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:20,269][52795] DAMAGECOUNT value on done: 852105.0 [2024-08-06 08:05:20,269][52795] Sum rewards: 91.177, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.157', 'weapon4': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.275', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.184', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.732', 'FRAGCOUNT': '77.000'} [2024-08-06 08:05:20,364][52647] DAMAGECOUNT value on done: 975234.0 [2024-08-06 08:05:20,364][52647] Sum rewards: 66.983, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.836', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.194', 'AMMO3': '0.213', 'AMMO4': '0.215', 'weapon4': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:20,751][52667] DAMAGECOUNT value on done: 941442.0 [2024-08-06 08:05:20,753][52667] Sum rewards: 80.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.086', 'weapon5': '0.214', 'AMMO4': '0.247', 'AMMO3': '0.255', 'weapon2': '0.308', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:21,322][52662] DAMAGECOUNT value on done: 938261.0 [2024-08-06 08:05:21,322][52662] Sum rewards: 76.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.085', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.106', 'AMMO4': '0.212', 'weapon5': '0.216', 'AMMO3': '0.242', 'weapon2': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '63.000'} [2024-08-06 08:05:22,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 667467776. Throughput: 0: 4369.4. Samples: 166870810. Policy #0 lag: (min: 1.0, avg: 4.3, max: 8.0) [2024-08-06 08:05:22,794][52567] Avg episode reward: [(0, '75.559')] [2024-08-06 08:05:23,011][52660] DAMAGECOUNT value on done: 939627.0 [2024-08-06 08:05:23,011][52660] Sum rewards: 74.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.136', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO3': '0.210', 'AMMO4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '62.000'} [2024-08-06 08:05:23,288][52659] DAMAGECOUNT value on done: 934850.0 [2024-08-06 08:05:23,291][52659] Sum rewards: 65.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.430', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.250', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:23,305][52667] DAMAGECOUNT value on done: 944581.0 [2024-08-06 08:05:23,305][52667] Sum rewards: 72.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.690', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.158', 'AMMO4': '0.164', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.650', 'weapon3': '3.128', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '61.000'} [2024-08-06 08:05:23,388][52647] DAMAGECOUNT value on done: 985943.0 [2024-08-06 08:05:23,388][52647] Sum rewards: 74.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.100', 'AMMO5': '0.022', 'AMMO2': '0.068', 'weapon4': '0.128', 'AMMO3': '0.231', 'weapon5': '0.312', 'AMMO4': '0.340', 'weapon2': '0.368', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.836', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.284', 'FRAGCOUNT': '64.000'} [2024-08-06 08:05:23,575][52795] DAMAGECOUNT value on done: 861602.0 [2024-08-06 08:05:23,577][52795] Sum rewards: 64.529, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.570', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.104', 'AMMO4': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.422', 'WEAPON3': '1.500', 'weapon3': '3.134', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.200', 'FRAGCOUNT': '58.000'} [2024-08-06 08:05:23,873][52662] DAMAGECOUNT value on done: 927767.0 [2024-08-06 08:05:23,873][52662] Sum rewards: 68.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.155', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'weapon2': '0.194', 'AMMO3': '0.242', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.560', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '58.000'} [2024-08-06 08:05:23,970][52650] Updated weights for policy 0, policy_version 81481 (0.0017) [2024-08-06 08:05:25,952][52660] DAMAGECOUNT value on done: 929189.0 [2024-08-06 08:05:25,954][52660] Sum rewards: 78.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.395', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.190', 'weapon2': '0.244', 'weapon5': '0.312', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '63.000'} [2024-08-06 08:05:26,365][52659] DAMAGECOUNT value on done: 944648.0 [2024-08-06 08:05:26,366][52659] Sum rewards: 91.644, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.174', 'HEALTH': '0.182', 'weapon2': '0.318', 'WEAPON3': '1.050', 'weapon3': '3.336', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.519', 'FRAGCOUNT': '72.000'} [2024-08-06 08:05:26,413][52647] DAMAGECOUNT value on done: 979919.0 [2024-08-06 08:05:26,414][52647] Sum rewards: 69.023, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.346', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.686', 'WEAPON3': '1.150', 'weapon3': '3.016', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '56.000'} [2024-08-06 08:05:26,733][52795] DAMAGECOUNT value on done: 869609.0 [2024-08-06 08:05:26,734][52795] Sum rewards: 72.369, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.959', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.038', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.215', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '60.000'} [2024-08-06 08:05:26,787][52662] DAMAGECOUNT value on done: 932499.0 [2024-08-06 08:05:26,791][52662] Sum rewards: 84.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.092', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.223', 'WEAPON3': '1.400', 'weapon3': '3.414', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '70.000'} [2024-08-06 08:05:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 667549696. Throughput: 0: 4383.1. Samples: 166897450. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:05:27,802][52567] Avg episode reward: [(0, '75.385')] [2024-08-06 08:05:28,673][52660] DAMAGECOUNT value on done: 924806.0 [2024-08-06 08:05:28,674][52660] Sum rewards: 79.107, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.316', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.201', 'weapon4': '0.380', 'weapon2': '0.528', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '63.500'} [2024-08-06 08:05:28,752][52650] Updated weights for policy 0, policy_version 81491 (0.0020) [2024-08-06 08:05:29,530][52647] DAMAGECOUNT value on done: 987112.0 [2024-08-06 08:05:29,531][52647] Sum rewards: 80.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.178', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.064', 'AMMO3': '0.238', 'weapon4': '0.264', 'weapon2': '0.348', 'WEAPON3': '1.450', 'weapon3': '3.030', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '68.000'} [2024-08-06 08:05:29,552][52659] DAMAGECOUNT value on done: 931435.0 [2024-08-06 08:05:29,552][52659] Sum rewards: 82.205, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.152', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.316', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:29,836][52662] DAMAGECOUNT value on done: 928960.0 [2024-08-06 08:05:29,837][52662] Sum rewards: 81.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.156', 'AMMO3': '0.203', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.300', 'weapon3': '2.896', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:31,230][52660] DAMAGECOUNT value on done: 931949.0 [2024-08-06 08:05:31,230][52660] Sum rewards: 65.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.692', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.080', 'weapon4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.233', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '54.000'} [2024-08-06 08:05:32,247][52647] DAMAGECOUNT value on done: 988011.0 [2024-08-06 08:05:32,248][52647] Sum rewards: 68.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.068', 'weapon5': '0.098', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.198', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.448', 'DAMAGECOUNT': '15.408', 'FRAGCOUNT': '57.000'} [2024-08-06 08:05:32,432][52659] DAMAGECOUNT value on done: 942126.0 [2024-08-06 08:05:32,432][52659] Sum rewards: 83.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.686', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.538', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '68.000'} [2024-08-06 08:05:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.9, 300 sec: 17439.2). Total num frames: 667639808. Throughput: 0: 4381.1. Samples: 166910440. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:05:32,794][52567] Avg episode reward: [(0, '75.475')] [2024-08-06 08:05:33,159][52650] Updated weights for policy 0, policy_version 81501 (0.0034) [2024-08-06 08:05:34,033][52660] DAMAGECOUNT value on done: 926929.0 [2024-08-06 08:05:34,041][52660] Sum rewards: 73.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.098', 'AMMO4': '0.148', 'weapon5': '0.180', 'AMMO3': '0.214', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '61.000'} [2024-08-06 08:05:35,240][52647] DAMAGECOUNT value on done: 974458.0 [2024-08-06 08:05:35,240][52647] Sum rewards: 85.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.845', 'AMMO5': '0.007', 'AMMO2': '0.045', 'weapon4': '0.086', 'weapon5': '0.132', 'weapon2': '0.138', 'AMMO3': '0.186', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.434', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '68.000'} [2024-08-06 08:05:35,536][52659] DAMAGECOUNT value on done: 934671.0 [2024-08-06 08:05:35,540][52659] Sum rewards: 64.309, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.075', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'AMMO3': '0.156', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.050', 'HITCOUNT': '2.960', 'weapon3': '3.236', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '51.000'} [2024-08-06 08:05:36,788][52660] DAMAGECOUNT value on done: 926278.0 [2024-08-06 08:05:36,788][52660] Sum rewards: 83.464, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.215', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '68.000'} [2024-08-06 08:05:37,594][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:05:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 667729920. Throughput: 0: 4380.7. Samples: 166936680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:05:37,794][52567] Avg episode reward: [(0, '75.274')] [2024-08-06 08:05:37,981][52647] DAMAGECOUNT value on done: 980875.0 [2024-08-06 08:05:37,982][52647] Sum rewards: 69.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.092', 'weapon4': '0.110', 'AMMO3': '0.191', 'AMMO4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.050', 'FRAGCOUNT': '58.000'} [2024-08-06 08:05:38,107][52650] Updated weights for policy 0, policy_version 81511 (0.0012) [2024-08-06 08:05:38,773][52659] DAMAGECOUNT value on done: 931476.0 [2024-08-06 08:05:38,775][52659] Sum rewards: 64.650, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.200', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.068', 'weapon5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.267', 'weapon2': '0.326', 'WEAPON3': '1.600', 'HITCOUNT': '3.240', 'weapon3': '3.244', 'DAMAGECOUNT': '15.558', 'FRAGCOUNT': '57.000'} [2024-08-06 08:05:39,848][52660] DAMAGECOUNT value on done: 936602.0 [2024-08-06 08:05:39,850][52660] Sum rewards: 68.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.110', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.168', 'AMMO3': '0.193', 'AMMO4': '0.240', 'weapon5': '0.244', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '56.500'} [2024-08-06 08:05:40,513][52647] DAMAGECOUNT value on done: 974243.0 [2024-08-06 08:05:40,514][52647] Sum rewards: 78.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO5': '0.023', 'AMMO2': '0.061', 'AMMO3': '0.159', 'weapon5': '0.290', 'AMMO4': '0.307', 'weapon4': '0.324', 'weapon2': '0.506', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.594', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '62.500'} [2024-08-06 08:05:41,581][52659] DAMAGECOUNT value on done: 936895.0 [2024-08-06 08:05:41,581][52659] Sum rewards: 77.952, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.595', 'AMMO2': '0.003', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO4': '0.015', 'WEAPON4': '0.050', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.728', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 08:05:42,439][52658] DAMAGECOUNT value on done: 939280.0 [2024-08-06 08:05:42,442][52658] Sum rewards: 75.722, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.414', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.122', 'AMMO4': '0.185', 'weapon5': '0.204', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '2.976', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '63.500'} [2024-08-06 08:05:42,505][52650] Updated weights for policy 0, policy_version 81521 (0.0024) [2024-08-06 08:05:42,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 667828224. Throughput: 0: 4376.9. Samples: 166962810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:05:42,794][52567] Avg episode reward: [(0, '74.988')] [2024-08-06 08:05:42,888][52660] DAMAGECOUNT value on done: 950811.0 [2024-08-06 08:05:42,889][52660] Sum rewards: 88.925, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.630', 'FRAGCOUNT': '71.000'} [2024-08-06 08:05:43,367][52647] DAMAGECOUNT value on done: 978369.0 [2024-08-06 08:05:43,367][52647] Sum rewards: 93.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO2': '0.004', 'AMMO4': '0.020', 'AMMO3': '0.228', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.558', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.027', 'FRAGCOUNT': '79.000'} [2024-08-06 08:05:44,571][52659] DAMAGECOUNT value on done: 935361.0 [2024-08-06 08:05:44,572][52659] Sum rewards: 83.404, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.578', 'AMMO5': '0.014', 'weapon4': '0.044', 'AMMO2': '0.046', 'weapon5': '0.118', 'AMMO3': '0.220', 'AMMO4': '0.228', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '69.000'} [2024-08-06 08:05:44,854][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:05:45,336][52660] DAMAGECOUNT value on done: 929986.0 [2024-08-06 08:05:45,336][52660] Sum rewards: 76.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.265', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.040', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.390', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '62.000'} [2024-08-06 08:05:45,513][52658] DAMAGECOUNT value on done: 941154.0 [2024-08-06 08:05:45,517][52658] Sum rewards: 78.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.838', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.068', 'weapon5': '0.178', 'AMMO3': '0.213', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '63.000'} [2024-08-06 08:05:47,340][52650] Updated weights for policy 0, policy_version 81531 (0.0015) [2024-08-06 08:05:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 667901952. Throughput: 0: 4380.0. Samples: 166976060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:05:47,794][52567] Avg episode reward: [(0, '75.490')] [2024-08-06 08:05:48,031][52659] DAMAGECOUNT value on done: 944849.0 [2024-08-06 08:05:48,033][52659] Sum rewards: 72.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.480', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.164', 'weapon2': '0.208', 'AMMO3': '0.242', 'weapon5': '0.252', 'AMMO4': '0.321', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '60.000'} [2024-08-06 08:05:48,039][52664] DAMAGECOUNT value on done: 963963.0 [2024-08-06 08:05:48,041][52664] Sum rewards: 71.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.016', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon4': '0.226', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '59.000'} [2024-08-06 08:05:48,339][52660] DAMAGECOUNT value on done: 936582.0 [2024-08-06 08:05:48,339][52660] Sum rewards: 73.324, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.114', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.066', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.296', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '62.000'} [2024-08-06 08:05:48,550][52658] DAMAGECOUNT value on done: 941692.0 [2024-08-06 08:05:48,550][52658] Sum rewards: 73.461, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.512', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO3': '0.163', 'AMMO4': '0.175', 'weapon5': '0.184', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '2.998', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '58.000'} [2024-08-06 08:05:48,671][52614] Signal inference workers to stop experience collection... (14950 times) [2024-08-06 08:05:48,671][52614] Signal inference workers to resume experience collection... (14950 times) [2024-08-06 08:05:48,747][52650] InferenceWorker_p0-w0: stopping experience collection (14950 times) [2024-08-06 08:05:48,749][52650] InferenceWorker_p0-w0: resuming experience collection (14950 times) [2024-08-06 08:05:49,433][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:05:50,799][52660] DAMAGECOUNT value on done: 933624.0 [2024-08-06 08:05:50,801][52660] Sum rewards: 66.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'AMMO5': '0.015', 'AMMO2': '0.071', 'weapon5': '0.102', 'weapon4': '0.112', 'AMMO3': '0.178', 'WEAPON5': '0.350', 'AMMO4': '0.353', 'WEAPON4': '0.400', 'weapon2': '0.630', 'WEAPON3': '1.100', 'weapon3': '2.984', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:51,171][52659] DAMAGECOUNT value on done: 928674.0 [2024-08-06 08:05:51,171][52659] Sum rewards: 60.587, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.630', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.197', 'weapon2': '0.386', 'WEAPON3': '1.150', 'HITCOUNT': '2.840', 'weapon3': '3.254', 'DAMAGECOUNT': '14.616', 'FRAGCOUNT': '50.000'} [2024-08-06 08:05:51,323][52811] DAMAGECOUNT value on done: 887798.0 [2024-08-06 08:05:51,324][52811] Sum rewards: 74.737, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.964', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.090', 'AMMO4': '0.202', 'weapon5': '0.242', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.550', 'weapon3': '2.886', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '65.000'} [2024-08-06 08:05:51,353][52664] DAMAGECOUNT value on done: 970450.0 [2024-08-06 08:05:51,353][52664] Sum rewards: 66.731, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.042', 'AMMO4': '0.051', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.304', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.432', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '54.000'} [2024-08-06 08:05:51,382][52658] DAMAGECOUNT value on done: 939506.0 [2024-08-06 08:05:51,383][52658] Sum rewards: 80.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.927', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.116', 'weapon5': '0.120', 'weapon2': '0.236', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '69.000'} [2024-08-06 08:05:51,742][52650] Updated weights for policy 0, policy_version 81541 (0.0038) [2024-08-06 08:05:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 667992064. Throughput: 0: 4372.5. Samples: 167002050. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:05:52,794][52567] Avg episode reward: [(0, '75.412')] [2024-08-06 08:05:53,392][52669] DAMAGECOUNT value on done: 936008.0 [2024-08-06 08:05:53,393][52669] Sum rewards: 68.208, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.336', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.018', 'weapon5': '0.046', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.534', 'WEAPON3': '1.150', 'weapon3': '3.248', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.155', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:53,775][52660] DAMAGECOUNT value on done: 924988.0 [2024-08-06 08:05:53,775][52660] Sum rewards: 67.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.055', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.112', 'weapon5': '0.136', 'AMMO4': '0.150', 'weapon2': '0.150', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.160', 'weapon3': '3.420', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '56.000'} [2024-08-06 08:05:54,005][52664] DAMAGECOUNT value on done: 973320.0 [2024-08-06 08:05:54,006][52664] Sum rewards: 67.846, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.356', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.156', 'weapon5': '0.156', 'AMMO4': '0.170', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:54,318][52811] DAMAGECOUNT value on done: 872105.0 [2024-08-06 08:05:54,318][52811] Sum rewards: 88.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.199', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.086', 'weapon5': '0.170', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '22.104', 'FRAGCOUNT': '71.000'} [2024-08-06 08:05:54,389][52658] DAMAGECOUNT value on done: 932145.0 [2024-08-06 08:05:54,389][52658] Sum rewards: 61.046, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.708', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon4': '0.180', 'weapon2': '0.222', 'AMMO3': '0.229', 'AMMO4': '0.296', 'weapon5': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '2.940', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '52.500'} [2024-08-06 08:05:54,452][52659] DAMAGECOUNT value on done: 941711.0 [2024-08-06 08:05:54,453][52659] Sum rewards: 68.284, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.546', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.132', 'weapon5': '0.170', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.276', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:56,115][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:05:56,210][52669] DAMAGECOUNT value on done: 934485.0 [2024-08-06 08:05:56,210][52669] Sum rewards: 90.166, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.185', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.037', 'weapon5': '0.054', 'AMMO4': '0.184', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.334', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.433', 'FRAGCOUNT': '74.000'} [2024-08-06 08:05:56,497][52664] DAMAGECOUNT value on done: 964416.0 [2024-08-06 08:05:56,499][52664] Sum rewards: 80.145, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.974', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.168', 'AMMO4': '0.174', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '67.000'} [2024-08-06 08:05:56,774][52650] Updated weights for policy 0, policy_version 81551 (0.0013) [2024-08-06 08:05:56,982][52660] DAMAGECOUNT value on done: 926576.0 [2024-08-06 08:05:56,983][52660] Sum rewards: 74.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.444', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.100', 'AMMO3': '0.160', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.322', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '2.882', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '60.000'} [2024-08-06 08:05:57,075][52658] DAMAGECOUNT value on done: 929927.0 [2024-08-06 08:05:57,075][52658] Sum rewards: 80.343, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.159', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.046', 'AMMO4': '0.046', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.488', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '66.000'} [2024-08-06 08:05:57,508][52659] DAMAGECOUNT value on done: 933093.0 [2024-08-06 08:05:57,511][52659] Sum rewards: 69.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.878', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.012', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.342', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.406', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '56.000'} [2024-08-06 08:05:57,550][52811] DAMAGECOUNT value on done: 866386.0 [2024-08-06 08:05:57,551][52811] Sum rewards: 69.128, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon4': '0.160', 'AMMO3': '0.172', 'weapon5': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.014', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '55.000'} [2024-08-06 08:05:57,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 668082176. Throughput: 0: 4376.2. Samples: 167028310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:05:57,795][52567] Avg episode reward: [(0, '74.999')] [2024-08-06 08:05:58,974][52669] DAMAGECOUNT value on done: 945942.0 [2024-08-06 08:05:58,975][52669] Sum rewards: 83.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.435', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon2': '0.196', 'AMMO3': '0.202', 'weapon5': '0.262', 'AMMO4': '0.293', 'WEAPON5': '0.500', 'weapon4': '0.602', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.586', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '67.000'} [2024-08-06 08:05:59,239][52664] DAMAGECOUNT value on done: 980101.0 [2024-08-06 08:05:59,253][52664] Sum rewards: 79.528, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.845', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.134', 'weapon5': '0.254', 'AMMO4': '0.272', 'AMMO3': '0.282', 'weapon2': '0.306', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.024', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '67.000'} [2024-08-06 08:06:00,174][52658] DAMAGECOUNT value on done: 943423.0 [2024-08-06 08:06:00,176][52658] Sum rewards: 63.772, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.544', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'weapon5': '0.068', 'AMMO3': '0.209', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '51.000'} [2024-08-06 08:06:00,574][52811] DAMAGECOUNT value on done: 871259.0 [2024-08-06 08:06:00,575][52811] Sum rewards: 78.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.140', 'AMMO3': '0.172', 'weapon4': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:01,425][52650] Updated weights for policy 0, policy_version 81561 (0.0012) [2024-08-06 08:06:01,800][52669] DAMAGECOUNT value on done: 935934.0 [2024-08-06 08:06:01,802][52669] Sum rewards: 75.209, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.108', 'AMMO3': '0.127', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.542', 'WEAPON3': '0.950', 'weapon3': '3.054', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:02,424][52664] DAMAGECOUNT value on done: 973432.0 [2024-08-06 08:06:02,425][52664] Sum rewards: 69.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.556', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.096', 'AMMO4': '0.124', 'weapon2': '0.160', 'weapon5': '0.182', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.030', 'weapon3': '3.222', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '57.000'} [2024-08-06 08:06:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 668164096. Throughput: 0: 4378.2. Samples: 167041420. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:06:02,795][52567] Avg episode reward: [(0, '75.252')] [2024-08-06 08:06:03,180][52658] DAMAGECOUNT value on done: 932930.0 [2024-08-06 08:06:03,183][52658] Sum rewards: 73.777, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.235', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.221', 'weapon4': '0.232', 'weapon5': '0.314', 'AMMO4': '0.342', 'weapon2': '0.342', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.766', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '59.000'} [2024-08-06 08:06:03,241][52671] DAMAGECOUNT value on done: 941310.0 [2024-08-06 08:06:03,242][52671] Sum rewards: 74.838, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.228', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.068', 'AMMO4': '0.121', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:03,668][52811] DAMAGECOUNT value on done: 873179.0 [2024-08-06 08:06:03,668][52811] Sum rewards: 71.039, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.140', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '2.970', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '57.000'} [2024-08-06 08:06:04,575][52669] DAMAGECOUNT value on done: 945780.0 [2024-08-06 08:06:04,577][52669] Sum rewards: 80.839, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.375', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.172', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '67.000'} [2024-08-06 08:06:05,403][52664] DAMAGECOUNT value on done: 964197.0 [2024-08-06 08:06:05,403][52664] Sum rewards: 68.342, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.404', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.112', 'AMMO3': '0.230', 'AMMO4': '0.252', 'weapon5': '0.290', 'weapon2': '0.470', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.818', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '55.000'} [2024-08-06 08:06:05,765][52671] DAMAGECOUNT value on done: 948735.0 [2024-08-06 08:06:05,768][52671] Sum rewards: 75.810, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.015', 'AMMO2': '0.048', 'HEALTH': '0.070', 'weapon4': '0.168', 'AMMO3': '0.188', 'weapon5': '0.198', 'AMMO4': '0.238', 'WEAPON5': '0.400', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.992', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '61.000'} [2024-08-06 08:06:06,106][52650] Updated weights for policy 0, policy_version 81571 (0.0014) [2024-08-06 08:06:06,395][52658] DAMAGECOUNT value on done: 957309.0 [2024-08-06 08:06:06,396][52658] Sum rewards: 72.010, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.992', 'AMMO5': '0.008', 'weapon4': '0.042', 'AMMO2': '0.045', 'weapon5': '0.110', 'AMMO4': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'AMMO3': '0.315', 'WEAPON3': '1.800', 'weapon3': '3.212', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '65.000'} [2024-08-06 08:06:06,847][52811] DAMAGECOUNT value on done: 890533.0 [2024-08-06 08:06:06,848][52811] Sum rewards: 81.751, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.055', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.088', 'AMMO4': '0.120', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.282', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '66.000'} [2024-08-06 08:06:06,959][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:06:07,745][52669] DAMAGECOUNT value on done: 943759.0 [2024-08-06 08:06:07,745][52669] Sum rewards: 66.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.792', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.148', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '55.000'} [2024-08-06 08:06:07,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 668254208. Throughput: 0: 4370.9. Samples: 167067500. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:06:07,794][52567] Avg episode reward: [(0, '75.315')] [2024-08-06 08:06:07,970][52664] DAMAGECOUNT value on done: 965595.0 [2024-08-06 08:06:07,970][52664] Sum rewards: 77.898, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.014', 'HEALTH': '0.034', 'weapon5': '0.036', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.050', 'HITCOUNT': '3.320', 'weapon3': '3.562', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:08,948][52658] DAMAGECOUNT value on done: 944782.0 [2024-08-06 08:06:08,949][52658] Sum rewards: 81.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.092', 'AMMO4': '0.142', 'weapon4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.226', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '67.000'} [2024-08-06 08:06:08,994][52671] DAMAGECOUNT value on done: 943925.0 [2024-08-06 08:06:08,995][52671] Sum rewards: 66.191, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.958', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.090', 'weapon2': '0.124', 'weapon4': '0.138', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '2.860', 'weapon3': '3.496', 'DAMAGECOUNT': '14.841', 'FRAGCOUNT': '55.000'} [2024-08-06 08:06:09,897][52811] DAMAGECOUNT value on done: 881706.0 [2024-08-06 08:06:09,897][52811] Sum rewards: 64.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.935', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.112', 'AMMO3': '0.194', 'AMMO4': '0.195', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.058', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '52.000'} [2024-08-06 08:06:10,463][52669] DAMAGECOUNT value on done: 942008.0 [2024-08-06 08:06:10,465][52669] Sum rewards: 68.277, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.324', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon2': '0.374', 'WEAPON3': '1.000', 'HITCOUNT': '3.070', 'weapon3': '3.454', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '55.000'} [2024-08-06 08:06:10,945][52650] Updated weights for policy 0, policy_version 81581 (0.0027) [2024-08-06 08:06:11,195][52664] DAMAGECOUNT value on done: 972954.0 [2024-08-06 08:06:11,196][52664] Sum rewards: 73.194, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.180', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.028', 'AMMO4': '0.121', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.322', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.136', 'FRAGCOUNT': '61.000'} [2024-08-06 08:06:11,395][52658] DAMAGECOUNT value on done: 950380.0 [2024-08-06 08:06:11,395][52658] Sum rewards: 83.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.450', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.136', 'weapon5': '0.182', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '68.000'} [2024-08-06 08:06:12,092][52671] DAMAGECOUNT value on done: 946797.0 [2024-08-06 08:06:12,094][52671] Sum rewards: 84.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.874', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'AMMO3': '0.223', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.532', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '68.000'} [2024-08-06 08:06:12,521][52663] DAMAGECOUNT value on done: 955335.0 [2024-08-06 08:06:12,523][52663] Sum rewards: 73.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.878', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO2': '0.035', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.194', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 668344320. Throughput: 0: 4364.7. Samples: 167093860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 9.0) [2024-08-06 08:06:12,794][52567] Avg episode reward: [(0, '75.483')] [2024-08-06 08:06:12,953][52811] DAMAGECOUNT value on done: 868362.0 [2024-08-06 08:06:12,953][52811] Sum rewards: 72.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.026', 'AMMO4': '0.063', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.176', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '59.000'} [2024-08-06 08:06:13,572][52669] DAMAGECOUNT value on done: 940342.0 [2024-08-06 08:06:13,573][52669] Sum rewards: 75.208, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.889', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.150', 'weapon5': '0.202', 'AMMO4': '0.217', 'AMMO3': '0.235', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:13,873][52664] DAMAGECOUNT value on done: 973297.0 [2024-08-06 08:06:13,877][52664] Sum rewards: 75.848, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.975', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.151', 'weapon2': '0.198', 'AMMO4': '0.221', 'weapon5': '0.274', 'weapon4': '0.390', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '61.000'} [2024-08-06 08:06:14,290][52658] DAMAGECOUNT value on done: 935922.0 [2024-08-06 08:06:14,294][52658] Sum rewards: 74.769, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.940', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.044', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.147', 'weapon2': '0.536', 'WEAPON3': '0.950', 'weapon3': '3.240', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '59.000'} [2024-08-06 08:06:14,783][52794] DAMAGECOUNT value on done: 931934.0 [2024-08-06 08:06:14,784][52794] Sum rewards: 86.527, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.098', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.062', 'weapon5': '0.198', 'AMMO4': '0.245', 'WEAPON4': '0.250', 'weapon2': '0.304', 'AMMO3': '0.309', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.130', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.436', 'FRAGCOUNT': '76.000'} [2024-08-06 08:06:15,258][52671] DAMAGECOUNT value on done: 953640.0 [2024-08-06 08:06:15,259][52671] Sum rewards: 70.925, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.628', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '59.000'} [2024-08-06 08:06:15,412][52650] Updated weights for policy 0, policy_version 81591 (0.0036) [2024-08-06 08:06:15,633][52663] DAMAGECOUNT value on done: 939011.0 [2024-08-06 08:06:15,634][52663] Sum rewards: 76.881, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.125', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.060', 'AMMO3': '0.153', 'weapon5': '0.162', 'AMMO4': '0.167', 'WEAPON4': '0.250', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '3.310', 'weapon3': '3.316', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:16,004][52811] DAMAGECOUNT value on done: 876740.0 [2024-08-06 08:06:16,007][52811] Sum rewards: 71.971, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.420', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.058', 'weapon5': '0.142', 'AMMO4': '0.146', 'weapon2': '0.234', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'HITCOUNT': '3.180', 'weapon3': '3.304', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:16,549][52669] DAMAGECOUNT value on done: 951317.0 [2024-08-06 08:06:16,552][52669] Sum rewards: 78.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.798', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.100', 'AMMO3': '0.254', 'AMMO4': '0.255', 'weapon5': '0.260', 'weapon2': '0.310', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.042', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '65.000'} [2024-08-06 08:06:17,004][52658] DAMAGECOUNT value on done: 946067.0 [2024-08-06 08:06:17,004][52658] Sum rewards: 70.487, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.479', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.260', 'weapon2': '0.392', 'WEAPON3': '1.000', 'weapon3': '2.978', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '55.000'} [2024-08-06 08:06:17,050][52664] DAMAGECOUNT value on done: 979935.0 [2024-08-06 08:06:17,050][52664] Sum rewards: 65.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.116', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.166', 'AMMO3': '0.199', 'weapon5': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.692', 'WEAPON3': '1.250', 'weapon3': '2.752', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '53.000'} [2024-08-06 08:06:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 668434432. Throughput: 0: 4364.9. Samples: 167106860. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:17,794][52567] Avg episode reward: [(0, '74.931')] [2024-08-06 08:06:17,900][52794] DAMAGECOUNT value on done: 943664.0 [2024-08-06 08:06:17,900][52794] Sum rewards: 84.432, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.545', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.064', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.352', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '68.000'} [2024-08-06 08:06:18,227][52671] DAMAGECOUNT value on done: 940705.0 [2024-08-06 08:06:18,229][52671] Sum rewards: 84.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.576', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:18,584][52663] DAMAGECOUNT value on done: 934018.0 [2024-08-06 08:06:18,586][52663] Sum rewards: 78.913, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.580', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.098', 'AMMO4': '0.201', 'weapon5': '0.246', 'AMMO3': '0.249', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.088', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '66.000'} [2024-08-06 08:06:19,118][52811] DAMAGECOUNT value on done: 877021.0 [2024-08-06 08:06:19,118][52811] Sum rewards: 71.793, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.042', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.094', 'AMMO4': '0.163', 'weapon5': '0.184', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.860', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '62.000'} [2024-08-06 08:06:19,374][52669] DAMAGECOUNT value on done: 942816.0 [2024-08-06 08:06:19,376][52669] Sum rewards: 84.761, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.835', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.088', 'AMMO4': '0.141', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'weapon4': '0.416', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '70.000'} [2024-08-06 08:06:19,985][52658] DAMAGECOUNT value on done: 936260.0 [2024-08-06 08:06:19,985][52658] Sum rewards: 77.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.250', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.011', 'weapon4': '0.036', 'AMMO4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.342', 'WEAPON3': '1.100', 'weapon3': '3.364', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:20,033][52664] DAMAGECOUNT value on done: 974892.0 [2024-08-06 08:06:20,034][52664] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.810', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.150', 'AMMO3': '0.169', 'weapon5': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.550', 'weapon2': '0.728', 'WEAPON3': '1.200', 'weapon3': '2.646', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '57.000'} [2024-08-06 08:06:20,108][52650] Updated weights for policy 0, policy_version 81601 (0.0021) [2024-08-06 08:06:20,549][52794] DAMAGECOUNT value on done: 947964.0 [2024-08-06 08:06:20,550][52794] Sum rewards: 86.811, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.890', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon4': '0.134', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '0.950', 'weapon3': '2.986', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '67.000'} [2024-08-06 08:06:21,383][52671] DAMAGECOUNT value on done: 942759.0 [2024-08-06 08:06:21,383][52671] Sum rewards: 63.000, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.748', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.090', 'AMMO4': '0.221', 'weapon2': '0.244', 'AMMO3': '0.247', 'weapon5': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.108', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '53.000'} [2024-08-06 08:06:21,395][52663] DAMAGECOUNT value on done: 939548.0 [2024-08-06 08:06:21,398][52663] Sum rewards: 75.017, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.860', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.132', 'AMMO4': '0.153', 'weapon5': '0.170', 'weapon2': '0.274', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.120', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '65.000'} [2024-08-06 08:06:22,120][52669] DAMAGECOUNT value on done: 948678.0 [2024-08-06 08:06:22,120][52669] Sum rewards: 71.768, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.867', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.076', 'weapon5': '0.172', 'AMMO4': '0.174', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '62.000'} [2024-08-06 08:06:22,329][52811] DAMAGECOUNT value on done: 881567.0 [2024-08-06 08:06:22,329][52811] Sum rewards: 66.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.101', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.148', 'weapon5': '0.156', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '54.000'} [2024-08-06 08:06:22,804][52567] Fps is (10 sec: 17186.3, 60 sec: 17473.4, 300 sec: 17466.4). Total num frames: 668516352. Throughput: 0: 4357.3. Samples: 167132800. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:22,804][52567] Avg episode reward: [(0, '74.896')] [2024-08-06 08:06:23,018][52658] DAMAGECOUNT value on done: 943763.0 [2024-08-06 08:06:23,020][52658] Sum rewards: 73.418, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.142', 'weapon4': '0.186', 'AMMO3': '0.214', 'AMMO4': '0.215', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 08:06:23,094][52664] DAMAGECOUNT value on done: 976204.0 [2024-08-06 08:06:23,095][52664] Sum rewards: 75.606, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.048', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.614', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.344', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:23,447][52794] DAMAGECOUNT value on done: 933309.0 [2024-08-06 08:06:23,450][52794] Sum rewards: 76.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.480', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.164', 'weapon5': '0.172', 'AMMO3': '0.197', 'AMMO4': '0.246', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:23,998][52663] DAMAGECOUNT value on done: 939138.0 [2024-08-06 08:06:23,999][52663] Sum rewards: 86.678, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.672', 'AMMO5': '0.016', 'weapon4': '0.042', 'AMMO2': '0.047', 'AMMO3': '0.194', 'weapon5': '0.214', 'AMMO4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '70.000'} [2024-08-06 08:06:24,633][52671] DAMAGECOUNT value on done: 947916.0 [2024-08-06 08:06:24,633][52671] Sum rewards: 72.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.909', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.176', 'AMMO3': '0.187', 'AMMO4': '0.194', 'weapon5': '0.216', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '57.000'} [2024-08-06 08:06:24,776][52669] DAMAGECOUNT value on done: 948450.0 [2024-08-06 08:06:24,778][52669] Sum rewards: 80.957, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.904', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.286', 'weapon2': '0.358', 'WEAPON3': '1.650', 'weapon3': '3.238', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '70.000'} [2024-08-06 08:06:25,135][52650] Updated weights for policy 0, policy_version 81611 (0.0011) [2024-08-06 08:06:25,408][52658] DAMAGECOUNT value on done: 926041.0 [2024-08-06 08:06:25,408][52658] Sum rewards: 77.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.290', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.184', 'AMMO3': '0.204', 'weapon4': '0.220', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '62.000'} [2024-08-06 08:06:25,440][52811] DAMAGECOUNT value on done: 887805.0 [2024-08-06 08:06:25,444][52811] Sum rewards: 91.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.704', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.104', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.148', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.183', 'FRAGCOUNT': '73.000'} [2024-08-06 08:06:25,668][52664] DAMAGECOUNT value on done: 989141.0 [2024-08-06 08:06:25,668][52664] Sum rewards: 77.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.858', 'AMMO5': '0.005', 'weapon4': '0.032', 'AMMO2': '0.032', 'weapon5': '0.090', 'AMMO4': '0.161', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '65.000'} [2024-08-06 08:06:26,887][52794] DAMAGECOUNT value on done: 927178.0 [2024-08-06 08:06:26,889][52794] Sum rewards: 83.108, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.064', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.084', 'AMMO4': '0.111', 'weapon5': '0.140', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '66.000'} [2024-08-06 08:06:27,129][52663] DAMAGECOUNT value on done: 947248.0 [2024-08-06 08:06:27,130][52663] Sum rewards: 85.463, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.389', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.138', 'AMMO3': '0.188', 'weapon5': '0.224', 'AMMO4': '0.227', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.788', 'WEAPON3': '1.100', 'weapon3': '2.588', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:27,564][52671] DAMAGECOUNT value on done: 930006.0 [2024-08-06 08:06:27,564][52671] Sum rewards: 84.218, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.818', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.072', 'weapon4': '0.178', 'AMMO4': '0.182', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 668606464. Throughput: 0: 4361.3. Samples: 167159070. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:27,794][52567] Avg episode reward: [(0, '75.541')] [2024-08-06 08:06:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081617_668606464.pth... [2024-08-06 08:06:27,887][52669] DAMAGECOUNT value on done: 934924.0 [2024-08-06 08:06:27,888][52669] Sum rewards: 65.649, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.206', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon4': '0.172', 'WEAPON4': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.000', 'HITCOUNT': '3.110', 'weapon3': '3.262', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '52.000'} [2024-08-06 08:06:27,917][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081106_664420352.pth [2024-08-06 08:06:28,058][52658] DAMAGECOUNT value on done: 942078.0 [2024-08-06 08:06:28,059][52658] Sum rewards: 76.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.078', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.176', 'AMMO3': '0.196', 'AMMO4': '0.221', 'weapon2': '0.262', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:28,070][52664] DAMAGECOUNT value on done: 984072.0 [2024-08-06 08:06:28,070][52664] Sum rewards: 78.266, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.540', 'AMMO5': '0.017', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.188', 'weapon4': '0.192', 'weapon5': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.622', 'WEAPON3': '1.250', 'weapon3': '2.702', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '62.500'} [2024-08-06 08:06:28,633][52811] DAMAGECOUNT value on done: 876880.0 [2024-08-06 08:06:28,634][52811] Sum rewards: 84.759, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.245', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon5': '0.048', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'AMMO3': '0.259', 'weapon2': '0.314', 'WEAPON3': '1.650', 'weapon3': '3.302', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '73.000'} [2024-08-06 08:06:29,896][52650] Updated weights for policy 0, policy_version 81621 (0.0012) [2024-08-06 08:06:30,101][52794] DAMAGECOUNT value on done: 933858.0 [2024-08-06 08:06:30,102][52794] Sum rewards: 81.175, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.510', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.040', 'AMMO4': '0.102', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.156', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.050', 'weapon3': '3.314', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:30,382][52663] DAMAGECOUNT value on done: 937665.0 [2024-08-06 08:06:30,383][52663] Sum rewards: 83.850, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.992', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.038', 'AMMO4': '0.159', 'AMMO3': '0.194', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '3.062', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '67.000'} [2024-08-06 08:06:30,648][52658] DAMAGECOUNT value on done: 937067.0 [2024-08-06 08:06:30,649][52658] Sum rewards: 63.624, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.406', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO4': '0.197', 'AMMO3': '0.250', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '54.000'} [2024-08-06 08:06:30,814][52671] DAMAGECOUNT value on done: 944611.0 [2024-08-06 08:06:30,815][52671] Sum rewards: 92.266, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.519', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.054', 'weapon5': '0.168', 'AMMO3': '0.199', 'AMMO4': '0.231', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.861', 'FRAGCOUNT': '73.000'} [2024-08-06 08:06:30,950][52669] DAMAGECOUNT value on done: 933583.0 [2024-08-06 08:06:30,950][52669] Sum rewards: 87.777, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.640', 'AMMO5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.118', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.470', 'WEAPON3': '1.000', 'weapon3': '3.232', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.475', 'FRAGCOUNT': '68.500'} [2024-08-06 08:06:31,048][52664] DAMAGECOUNT value on done: 983971.0 [2024-08-06 08:06:31,049][52664] Sum rewards: 77.772, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.078', 'AMMO4': '0.183', 'AMMO3': '0.202', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '62.000'} [2024-08-06 08:06:31,754][52811] DAMAGECOUNT value on done: 875244.0 [2024-08-06 08:06:31,756][52811] Sum rewards: 90.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.520', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.098', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.264', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.360', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.669', 'FRAGCOUNT': '74.000'} [2024-08-06 08:06:31,913][52803] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:06:32,794][52567] Fps is (10 sec: 17219.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 668688384. Throughput: 0: 4352.4. Samples: 167171920. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:32,794][52567] Avg episode reward: [(0, '76.135')] [2024-08-06 08:06:33,098][52794] DAMAGECOUNT value on done: 939082.0 [2024-08-06 08:06:33,100][52794] Sum rewards: 84.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.818', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.466', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:33,287][52663] DAMAGECOUNT value on done: 922089.0 [2024-08-06 08:06:33,290][52663] Sum rewards: 81.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.886', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.068', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'AMMO3': '0.209', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.210', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '68.000'} [2024-08-06 08:06:33,415][52658] DAMAGECOUNT value on done: 931731.0 [2024-08-06 08:06:33,416][52658] Sum rewards: 69.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.440', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon4': '0.202', 'weapon5': '0.224', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '58.000'} [2024-08-06 08:06:33,945][52671] DAMAGECOUNT value on done: 941879.0 [2024-08-06 08:06:33,946][52671] Sum rewards: 61.752, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.372', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.166', 'weapon5': '0.230', 'AMMO3': '0.239', 'AMMO4': '0.252', 'weapon2': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '15.984', 'FRAGCOUNT': '52.000'} [2024-08-06 08:06:34,005][52669] DAMAGECOUNT value on done: 943184.0 [2024-08-06 08:06:34,005][52669] Sum rewards: 77.394, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.007', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.154', 'weapon5': '0.208', 'AMMO4': '0.221', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.000', 'weapon3': '2.904', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:34,062][52664] DAMAGECOUNT value on done: 965397.0 [2024-08-06 08:06:34,063][52664] Sum rewards: 74.622, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.430', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.028', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.348', 'WEAPON3': '1.550', 'weapon3': '3.230', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '65.000'} [2024-08-06 08:06:34,367][52650] Updated weights for policy 0, policy_version 81631 (0.0012) [2024-08-06 08:06:34,819][52811] DAMAGECOUNT value on done: 876932.0 [2024-08-06 08:06:34,821][52811] Sum rewards: 70.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.204', 'AMMO4': '0.207', 'weapon2': '0.254', 'weapon5': '0.260', 'weapon4': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '56.000'} [2024-08-06 08:06:35,817][52658] DAMAGECOUNT value on done: 940765.0 [2024-08-06 08:06:35,818][52658] Sum rewards: 84.450, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.387', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.058', 'weapon4': '0.120', 'AMMO4': '0.137', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '71.000'} [2024-08-06 08:06:35,918][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:06:36,519][52794] DAMAGECOUNT value on done: 927426.0 [2024-08-06 08:06:36,519][52794] Sum rewards: 69.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.093', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '56.000'} [2024-08-06 08:06:36,542][52663] DAMAGECOUNT value on done: 936817.0 [2024-08-06 08:06:36,543][52663] Sum rewards: 85.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.520', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.080', 'weapon5': '0.088', 'AMMO4': '0.153', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON4': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.350', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '73.000'} [2024-08-06 08:06:36,784][52664] DAMAGECOUNT value on done: 969191.0 [2024-08-06 08:06:36,784][52664] Sum rewards: 80.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.762', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'weapon4': '0.104', 'AMMO4': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.226', 'WEAPON3': '1.000', 'weapon3': '3.406', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:37,091][52671] DAMAGECOUNT value on done: 942902.0 [2024-08-06 08:06:37,092][52671] Sum rewards: 79.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.573', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.112', 'weapon5': '0.148', 'AMMO4': '0.189', 'AMMO3': '0.221', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '65.000'} [2024-08-06 08:06:37,333][52669] DAMAGECOUNT value on done: 963322.0 [2024-08-06 08:06:37,333][52669] Sum rewards: 75.999, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.106', 'weapon4': '0.144', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'weapon2': '0.678', 'WEAPON3': '0.900', 'HEALTH': '0.930', 'weapon3': '2.852', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 668778496. Throughput: 0: 4358.0. Samples: 167198160. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:37,794][52567] Avg episode reward: [(0, '75.971')] [2024-08-06 08:06:37,950][52811] DAMAGECOUNT value on done: 875742.0 [2024-08-06 08:06:37,950][52811] Sum rewards: 87.429, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.245', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.094', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '71.000'} [2024-08-06 08:06:39,250][52650] Updated weights for policy 0, policy_version 81641 (0.0013) [2024-08-06 08:06:39,320][52664] DAMAGECOUNT value on done: 979186.0 [2024-08-06 08:06:39,322][52664] Sum rewards: 92.135, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.005', 'AMMO5': '0.019', 'AMMO2': '0.037', 'AMMO3': '0.177', 'weapon4': '0.180', 'AMMO4': '0.187', 'weapon5': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.744', 'FRAGCOUNT': '72.000'} [2024-08-06 08:06:39,689][52663] DAMAGECOUNT value on done: 935217.0 [2024-08-06 08:06:39,689][52663] Sum rewards: 73.332, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.382', 'AMMO5': '0.026', 'AMMO2': '0.065', 'weapon4': '0.130', 'AMMO3': '0.172', 'AMMO4': '0.326', 'weapon5': '0.326', 'weapon2': '0.552', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '61.000'} [2024-08-06 08:06:39,941][52794] DAMAGECOUNT value on done: 941408.0 [2024-08-06 08:06:39,942][52794] Sum rewards: 79.115, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.012', 'weapon5': '0.028', 'AMMO4': '0.037', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.267', 'weapon2': '0.406', 'WEAPON3': '1.650', 'weapon3': '3.318', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '68.000'} [2024-08-06 08:06:39,984][52671] DAMAGECOUNT value on done: 943275.0 [2024-08-06 08:06:39,986][52671] Sum rewards: 67.976, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.344', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.062', 'weapon5': '0.130', 'AMMO4': '0.145', 'AMMO3': '0.213', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.364', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '58.000'} [2024-08-06 08:06:40,452][52669] DAMAGECOUNT value on done: 950762.0 [2024-08-06 08:06:40,453][52669] Sum rewards: 78.225, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.148', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'WEAPON3': '1.450', 'weapon3': '3.508', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:41,023][52811] DAMAGECOUNT value on done: 884365.0 [2024-08-06 08:06:41,023][52811] Sum rewards: 73.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.031', 'weapon5': '0.090', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.280', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.416', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:42,014][52664] DAMAGECOUNT value on done: 965321.0 [2024-08-06 08:06:42,015][52664] Sum rewards: 70.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.075', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.358', 'WEAPON3': '1.250', 'HITCOUNT': '3.110', 'weapon3': '3.300', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '59.000'} [2024-08-06 08:06:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 668868608. Throughput: 0: 4356.7. Samples: 167224360. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:42,795][52567] Avg episode reward: [(0, '76.674')] [2024-08-06 08:06:42,809][52663] DAMAGECOUNT value on done: 944615.0 [2024-08-06 08:06:42,809][52663] Sum rewards: 79.284, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.125', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.046', 'weapon4': '0.116', 'AMMO3': '0.183', 'weapon5': '0.224', 'AMMO4': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.419', 'FRAGCOUNT': '62.000'} [2024-08-06 08:06:42,832][52794] DAMAGECOUNT value on done: 936072.0 [2024-08-06 08:06:42,834][52794] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '60.000'} [2024-08-06 08:06:42,928][52671] DAMAGECOUNT value on done: 942991.0 [2024-08-06 08:06:42,929][52671] Sum rewards: 74.429, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.864', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.108', 'AMMO3': '0.142', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.354', 'weapon4': '0.436', 'WEAPON3': '0.900', 'weapon3': '2.876', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '57.000'} [2024-08-06 08:06:43,294][52669] DAMAGECOUNT value on done: 947715.0 [2024-08-06 08:06:43,295][52669] Sum rewards: 84.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.720', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'weapon4': '0.094', 'AMMO4': '0.154', 'weapon5': '0.164', 'AMMO3': '0.178', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '70.000'} [2024-08-06 08:06:44,007][52650] Updated weights for policy 0, policy_version 81651 (0.0023) [2024-08-06 08:06:44,090][52811] DAMAGECOUNT value on done: 887394.0 [2024-08-06 08:06:44,091][52811] Sum rewards: 76.193, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.790', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.132', 'AMMO4': '0.179', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:45,362][52671] DAMAGECOUNT value on done: 927200.0 [2024-08-06 08:06:45,363][52671] Sum rewards: 72.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.262', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon4': '0.178', 'weapon5': '0.178', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.000'} [2024-08-06 08:06:45,662][52663] DAMAGECOUNT value on done: 927608.0 [2024-08-06 08:06:45,665][52663] Sum rewards: 83.965, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.328', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.032', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.258', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:46,000][52794] DAMAGECOUNT value on done: 928748.0 [2024-08-06 08:06:46,001][52794] Sum rewards: 78.521, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.783', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.172', 'AMMO4': '0.202', 'AMMO3': '0.248', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '65.000'} [2024-08-06 08:06:46,331][52669] DAMAGECOUNT value on done: 952603.0 [2024-08-06 08:06:46,333][52669] Sum rewards: 64.772, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.800', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.144', 'AMMO4': '0.170', 'AMMO3': '0.244', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.130', 'weapon3': '3.296', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '57.000'} [2024-08-06 08:06:47,261][52811] DAMAGECOUNT value on done: 873315.0 [2024-08-06 08:06:47,262][52811] Sum rewards: 79.907, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.761', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.132', 'AMMO4': '0.169', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '67.000'} [2024-08-06 08:06:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 668950528. Throughput: 0: 4356.9. Samples: 167237480. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:47,795][52567] Avg episode reward: [(0, '76.665')] [2024-08-06 08:06:48,402][52650] Updated weights for policy 0, policy_version 81661 (0.0013) [2024-08-06 08:06:48,541][52671] DAMAGECOUNT value on done: 952571.0 [2024-08-06 08:06:48,541][52671] Sum rewards: 75.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.548', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '61.000'} [2024-08-06 08:06:48,548][52794] DAMAGECOUNT value on done: 942525.0 [2024-08-06 08:06:48,549][52794] Sum rewards: 82.970, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.192', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO3': '0.144', 'AMMO4': '0.144', 'weapon5': '0.218', 'weapon4': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '0.950', 'weapon3': '2.804', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:48,700][52663] DAMAGECOUNT value on done: 924377.0 [2024-08-06 08:06:48,701][52663] Sum rewards: 75.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.192', 'weapon2': '0.198', 'AMMO3': '0.216', 'AMMO4': '0.282', 'weapon4': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '62.000'} [2024-08-06 08:06:49,416][52669] DAMAGECOUNT value on done: 954159.0 [2024-08-06 08:06:49,417][52669] Sum rewards: 74.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.070', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.174', 'weapon2': '0.724', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '59.000'} [2024-08-06 08:06:50,507][52811] DAMAGECOUNT value on done: 873342.0 [2024-08-06 08:06:50,509][52811] Sum rewards: 76.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.486', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.128', 'weapon5': '0.174', 'AMMO3': '0.215', 'AMMO4': '0.247', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '66.000'} [2024-08-06 08:06:51,222][52663] DAMAGECOUNT value on done: 933296.0 [2024-08-06 08:06:51,223][52663] Sum rewards: 69.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.898', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.040', 'AMMO4': '0.103', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.368', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '58.000'} [2024-08-06 08:06:51,443][52671] DAMAGECOUNT value on done: 950088.0 [2024-08-06 08:06:51,443][52671] Sum rewards: 63.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.186', 'weapon5': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.612', 'FRAGCOUNT': '52.000'} [2024-08-06 08:06:51,546][52794] DAMAGECOUNT value on done: 936029.0 [2024-08-06 08:06:51,546][52794] Sum rewards: 86.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '71.500'} [2024-08-06 08:06:51,900][52803] DAMAGECOUNT value on done: 871926.0 [2024-08-06 08:06:51,900][52803] Sum rewards: 75.480, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.410', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon4': '0.120', 'weapon5': '0.132', 'AMMO4': '0.224', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.452', 'WEAPON3': '1.650', 'weapon3': '3.034', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:51,994][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:06:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 669040640. Throughput: 0: 4361.6. Samples: 167263770. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:52,794][52567] Avg episode reward: [(0, '76.789')] [2024-08-06 08:06:53,055][52650] Updated weights for policy 0, policy_version 81671 (0.0031) [2024-08-06 08:06:53,110][52670] DAMAGECOUNT value on done: 923520.0 [2024-08-06 08:06:53,111][52670] Sum rewards: 86.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.326', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.134', 'weapon5': '0.170', 'AMMO3': '0.189', 'AMMO4': '0.221', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:54,096][52663] DAMAGECOUNT value on done: 935532.0 [2024-08-06 08:06:54,096][52663] Sum rewards: 76.934, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.071', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'weapon2': '0.180', 'AMMO3': '0.231', 'WEAPON3': '1.500', 'HITCOUNT': '3.560', 'weapon3': '3.572', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '64.000'} [2024-08-06 08:06:54,474][52671] DAMAGECOUNT value on done: 944889.0 [2024-08-06 08:06:54,475][52671] Sum rewards: 86.986, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.812', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.129', 'AMMO4': '0.158', 'weapon5': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'weapon4': '0.536', 'WEAPON3': '0.800', 'weapon3': '2.614', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '67.000'} [2024-08-06 08:06:54,515][52794] DAMAGECOUNT value on done: 947417.0 [2024-08-06 08:06:54,516][52794] Sum rewards: 85.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.584', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO3': '0.188', 'weapon2': '0.298', 'WEAPON3': '1.100', 'weapon3': '3.580', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:55,026][52803] DAMAGECOUNT value on done: 871054.0 [2024-08-06 08:06:55,026][52803] Sum rewards: 77.050, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.890', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.144', 'weapon5': '0.180', 'AMMO4': '0.196', 'AMMO3': '0.197', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.564', 'WEAPON3': '1.250', 'weapon3': '2.878', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:55,867][52670] DAMAGECOUNT value on done: 942443.0 [2024-08-06 08:06:55,868][52670] Sum rewards: 103.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.128', 'weapon5': '0.136', 'AMMO4': '0.192', 'weapon2': '0.204', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.320', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '23.391', 'FRAGCOUNT': '84.000'} [2024-08-06 08:06:57,031][52663] DAMAGECOUNT value on done: 938779.0 [2024-08-06 08:06:57,031][52663] Sum rewards: 65.188, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.094', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '55.000'} [2024-08-06 08:06:57,329][52794] DAMAGECOUNT value on done: 930146.0 [2024-08-06 08:06:57,332][52794] Sum rewards: 84.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.941', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.100', 'weapon3': '3.402', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '69.000'} [2024-08-06 08:06:57,444][52671] DAMAGECOUNT value on done: 949838.0 [2024-08-06 08:06:57,444][52671] Sum rewards: 73.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.022', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.265', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.356', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.129', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:57,559][52650] Updated weights for policy 0, policy_version 81681 (0.0015) [2024-08-06 08:06:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 669130752. Throughput: 0: 4356.0. Samples: 167289880. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:06:57,794][52567] Avg episode reward: [(0, '77.651')] [2024-08-06 08:06:58,157][52803] DAMAGECOUNT value on done: 877985.0 [2024-08-06 08:06:58,159][52803] Sum rewards: 73.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.804', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.124', 'weapon4': '0.154', 'AMMO4': '0.185', 'AMMO3': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.350', 'weapon3': '3.094', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '61.000'} [2024-08-06 08:06:58,379][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:06:59,153][52670] DAMAGECOUNT value on done: 925353.0 [2024-08-06 08:06:59,154][52670] Sum rewards: 79.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.148', 'AMMO3': '0.170', 'weapon4': '0.180', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.186', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '63.000'} [2024-08-06 08:06:59,715][52663] DAMAGECOUNT value on done: 937118.0 [2024-08-06 08:06:59,715][52663] Sum rewards: 68.106, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.980', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.200', 'AMMO4': '0.247', 'weapon4': '0.268', 'weapon2': '0.298', 'AMMO3': '0.306', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.932', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '59.000'} [2024-08-06 08:07:00,097][52794] DAMAGECOUNT value on done: 942054.0 [2024-08-06 08:07:00,097][52794] Sum rewards: 80.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.744', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.078', 'AMMO4': '0.167', 'weapon5': '0.194', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:00,260][52671] DAMAGECOUNT value on done: 932237.0 [2024-08-06 08:07:00,261][52671] Sum rewards: 85.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.109', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.148', 'AMMO3': '0.177', 'AMMO4': '0.182', 'weapon5': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.844', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:01,225][52803] DAMAGECOUNT value on done: 874324.0 [2024-08-06 08:07:01,233][52803] Sum rewards: 66.770, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.305', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.318', 'WEAPON3': '0.950', 'HITCOUNT': '3.170', 'weapon3': '3.434', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '52.000'} [2024-08-06 08:07:02,012][52666] DAMAGECOUNT value on done: 937525.0 [2024-08-06 08:07:02,013][52666] Sum rewards: 72.240, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.392', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.060', 'AMMO3': '0.169', 'weapon5': '0.180', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '58.000'} [2024-08-06 08:07:02,452][52663] DAMAGECOUNT value on done: 943095.0 [2024-08-06 08:07:02,452][52663] Sum rewards: 72.251, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.956', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.036', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.238', 'weapon2': '0.538', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:02,563][52650] Updated weights for policy 0, policy_version 81691 (0.0012) [2024-08-06 08:07:02,775][52670] DAMAGECOUNT value on done: 927448.0 [2024-08-06 08:07:02,775][52670] Sum rewards: 82.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.403', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.104', 'AMMO4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 669212672. Throughput: 0: 4356.0. Samples: 167302880. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:07:02,794][52567] Avg episode reward: [(0, '77.576')] [2024-08-06 08:07:03,139][52794] DAMAGECOUNT value on done: 938554.0 [2024-08-06 08:07:03,139][52794] Sum rewards: 79.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.860', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.080', 'weapon4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'weapon2': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON3': '1.350', 'weapon3': '3.470', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:04,438][52803] DAMAGECOUNT value on done: 872531.0 [2024-08-06 08:07:04,440][52803] Sum rewards: 82.165, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.124', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon4': '0.112', 'weapon5': '0.172', 'AMMO3': '0.213', 'AMMO4': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '68.000'} [2024-08-06 08:07:05,111][52666] DAMAGECOUNT value on done: 934971.0 [2024-08-06 08:07:05,111][52666] Sum rewards: 77.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.038', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:05,336][52794] Large shaping reward 2.652 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 08:07:05,596][52794] DAMAGECOUNT value on done: 944853.0 [2024-08-06 08:07:05,598][52794] Sum rewards: 88.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.005', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.064', 'AMMO4': '0.093', 'weapon5': '0.156', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON3': '1.150', 'weapon3': '3.350', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.927', 'FRAGCOUNT': '70.000'} [2024-08-06 08:07:05,715][52663] DAMAGECOUNT value on done: 948338.0 [2024-08-06 08:07:05,715][52663] Sum rewards: 85.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.550', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.178', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.392', 'WEAPON3': '1.050', 'weapon3': '3.294', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '68.000'} [2024-08-06 08:07:05,853][52670] DAMAGECOUNT value on done: 939813.0 [2024-08-06 08:07:05,854][52670] Sum rewards: 73.989, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.151', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.098', 'weapon5': '0.212', 'AMMO3': '0.237', 'AMMO4': '0.240', 'weapon2': '0.316', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.092', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:07,205][52650] Updated weights for policy 0, policy_version 81701 (0.0025) [2024-08-06 08:07:07,458][52803] DAMAGECOUNT value on done: 871448.0 [2024-08-06 08:07:07,460][52803] Sum rewards: 66.388, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.000', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.060', 'WEAPON4': '0.150', 'weapon5': '0.188', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '53.000'} [2024-08-06 08:07:07,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 669302784. Throughput: 0: 4360.0. Samples: 167328960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:07,795][52567] Avg episode reward: [(0, '77.981')] [2024-08-06 08:07:08,328][52666] DAMAGECOUNT value on done: 941092.0 [2024-08-06 08:07:08,328][52666] Sum rewards: 80.198, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.058', 'HEALTH': '0.117', 'weapon5': '0.182', 'AMMO4': '0.202', 'AMMO3': '0.218', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '66.000'} [2024-08-06 08:07:08,432][52663] DAMAGECOUNT value on done: 927710.0 [2024-08-06 08:07:08,432][52663] Sum rewards: 83.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.787', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.044', 'AMMO4': '0.129', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '70.000'} [2024-08-06 08:07:08,807][52794] DAMAGECOUNT value on done: 953931.0 [2024-08-06 08:07:08,807][52794] Sum rewards: 87.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.741', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.046', 'weapon4': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'AMMO3': '0.253', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.346', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.985', 'FRAGCOUNT': '74.000'} [2024-08-06 08:07:08,985][52670] DAMAGECOUNT value on done: 926852.0 [2024-08-06 08:07:08,985][52670] Sum rewards: 70.457, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.076', 'AMMO4': '0.197', 'AMMO3': '0.231', 'weapon5': '0.252', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.084', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '58.000'} [2024-08-06 08:07:10,674][52803] DAMAGECOUNT value on done: 869744.0 [2024-08-06 08:07:10,677][52803] Sum rewards: 84.032, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.412', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.144', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon4': '0.352', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '70.000'} [2024-08-06 08:07:11,358][52666] DAMAGECOUNT value on done: 935375.0 [2024-08-06 08:07:11,359][52666] Sum rewards: 76.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:11,391][52794] DAMAGECOUNT value on done: 941462.0 [2024-08-06 08:07:11,391][52794] Sum rewards: 67.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.986', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.174', 'weapon2': '0.176', 'weapon5': '0.214', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.230', 'weapon3': '3.316', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '56.500'} [2024-08-06 08:07:12,058][52650] Updated weights for policy 0, policy_version 81711 (0.0018) [2024-08-06 08:07:12,122][52670] DAMAGECOUNT value on done: 925075.0 [2024-08-06 08:07:12,123][52670] Sum rewards: 81.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.518', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.098', 'AMMO4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:12,795][52567] Fps is (10 sec: 17202.3, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 669384704. Throughput: 0: 4355.1. Samples: 167355050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:12,795][52567] Avg episode reward: [(0, '77.922')] [2024-08-06 08:07:13,769][52803] DAMAGECOUNT value on done: 867892.0 [2024-08-06 08:07:13,770][52803] Sum rewards: 74.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.496', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.074', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '61.000'} [2024-08-06 08:07:14,359][52666] DAMAGECOUNT value on done: 928272.0 [2024-08-06 08:07:14,361][52666] Sum rewards: 67.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon2': '0.174', 'AMMO3': '0.186', 'weapon5': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.164', 'FRAGCOUNT': '55.000'} [2024-08-06 08:07:15,173][52670] DAMAGECOUNT value on done: 926505.0 [2024-08-06 08:07:15,175][52670] Sum rewards: 83.484, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.146', 'AMMO4': '0.171', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.500', 'weapon3': '3.078', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.667', 'FRAGCOUNT': '69.000'} [2024-08-06 08:07:16,848][52650] Updated weights for policy 0, policy_version 81721 (0.0014) [2024-08-06 08:07:16,935][52803] DAMAGECOUNT value on done: 878311.0 [2024-08-06 08:07:16,938][52803] Sum rewards: 78.628, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.698', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'WEAPON5': '0.050', 'AMMO3': '0.227', 'weapon2': '0.576', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:17,306][52666] DAMAGECOUNT value on done: 932826.0 [2024-08-06 08:07:17,308][52666] Sum rewards: 73.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.091', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '61.000'} [2024-08-06 08:07:17,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 669474816. Throughput: 0: 4360.0. Samples: 167368120. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:17,794][52567] Avg episode reward: [(0, '78.210')] [2024-08-06 08:07:18,156][52670] DAMAGECOUNT value on done: 926227.0 [2024-08-06 08:07:18,157][52670] Sum rewards: 58.890, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.865', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.063', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon2': '0.622', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.144', 'DAMAGECOUNT': '14.094', 'FRAGCOUNT': '48.000'} [2024-08-06 08:07:18,618][52668] DAMAGECOUNT value on done: 947554.0 [2024-08-06 08:07:18,619][52668] Sum rewards: 82.121, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.576', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.142', 'AMMO4': '0.149', 'AMMO3': '0.257', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.256', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '69.000'} [2024-08-06 08:07:18,744][52665] DAMAGECOUNT value on done: 925875.0 [2024-08-06 08:07:18,744][52665] Sum rewards: 66.963, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.011', 'weapon4': '0.038', 'AMMO2': '0.042', 'weapon5': '0.130', 'AMMO3': '0.182', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.194', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '53.000'} [2024-08-06 08:07:20,059][52803] DAMAGECOUNT value on done: 871266.0 [2024-08-06 08:07:20,060][52803] Sum rewards: 91.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.218', 'WEAPON3': '1.200', 'weapon3': '3.568', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '74.000'} [2024-08-06 08:07:20,135][52666] DAMAGECOUNT value on done: 931595.0 [2024-08-06 08:07:20,135][52666] Sum rewards: 77.709, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.695', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.278', 'WEAPON3': '1.650', 'weapon3': '3.300', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:20,800][52670] DAMAGECOUNT value on done: 923044.0 [2024-08-06 08:07:20,800][52670] Sum rewards: 85.430, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.080', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.255', 'weapon2': '0.362', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '72.000'} [2024-08-06 08:07:21,146][52665] DAMAGECOUNT value on done: 937388.0 [2024-08-06 08:07:21,149][52665] Sum rewards: 60.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.581', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon4': '0.098', 'AMMO3': '0.201', 'AMMO4': '0.232', 'weapon5': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '15.048', 'FRAGCOUNT': '51.000'} [2024-08-06 08:07:21,169][52650] Updated weights for policy 0, policy_version 81731 (0.0025) [2024-08-06 08:07:21,780][52668] DAMAGECOUNT value on done: 946739.0 [2024-08-06 08:07:21,781][52668] Sum rewards: 88.946, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.706', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.244', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.703', 'FRAGCOUNT': '72.000'} [2024-08-06 08:07:22,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17479.1, 300 sec: 17467.0). Total num frames: 669564928. Throughput: 0: 4357.8. Samples: 167394260. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:22,802][52567] Avg episode reward: [(0, '77.946')] [2024-08-06 08:07:23,152][52803] DAMAGECOUNT value on done: 884385.0 [2024-08-06 08:07:23,152][52803] Sum rewards: 70.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.580', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.086', 'weapon5': '0.102', 'AMMO4': '0.182', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.204', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:23,163][52666] DAMAGECOUNT value on done: 927607.0 [2024-08-06 08:07:23,164][52666] Sum rewards: 70.312, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.533', 'AMMO5': '0.003', 'AMMO2': '0.017', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO6': '0.100', 'WEAPON7': '0.100', 'AMMO7': '0.100', 'weapon4': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.278', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '60.000'} [2024-08-06 08:07:23,793][52670] DAMAGECOUNT value on done: 937534.0 [2024-08-06 08:07:23,794][52670] Sum rewards: 81.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.738', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.096', 'AMMO3': '0.189', 'AMMO4': '0.219', 'weapon2': '0.266', 'weapon5': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '66.000'} [2024-08-06 08:07:24,206][52665] DAMAGECOUNT value on done: 931168.0 [2024-08-06 08:07:24,206][52665] Sum rewards: 82.211, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.144', 'AMMO4': '0.182', 'AMMO3': '0.193', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:24,883][52668] DAMAGECOUNT value on done: 942380.0 [2024-08-06 08:07:24,885][52668] Sum rewards: 64.059, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.488', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO4': '0.171', 'AMMO3': '0.207', 'weapon2': '0.258', 'WEAPON3': '1.200', 'HITCOUNT': '2.880', 'weapon3': '3.262', 'DAMAGECOUNT': '15.957', 'FRAGCOUNT': '53.000'} [2024-08-06 08:07:26,055][52820] DAMAGECOUNT value on done: 868785.0 [2024-08-06 08:07:26,059][52820] Sum rewards: 77.289, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.024', 'weapon5': '0.092', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.342', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:26,169][52666] DAMAGECOUNT value on done: 938117.0 [2024-08-06 08:07:26,170][52650] Updated weights for policy 0, policy_version 81741 (0.0054) [2024-08-06 08:07:26,170][52666] Sum rewards: 81.605, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.754', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.130', 'AMMO4': '0.160', 'weapon5': '0.170', 'weapon2': '0.192', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '68.000'} [2024-08-06 08:07:26,423][52803] DAMAGECOUNT value on done: 879198.0 [2024-08-06 08:07:26,427][52803] Sum rewards: 75.625, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.540', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.189', 'weapon2': '0.202', 'weapon5': '0.248', 'AMMO4': '0.269', 'WEAPON4': '0.400', 'weapon4': '0.438', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.782', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '60.500'} [2024-08-06 08:07:26,936][52670] DAMAGECOUNT value on done: 920303.0 [2024-08-06 08:07:26,937][52670] Sum rewards: 73.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.484', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.096', 'weapon5': '0.138', 'AMMO4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '60.000'} [2024-08-06 08:07:26,940][52820] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:07:26,952][52665] DAMAGECOUNT value on done: 933867.0 [2024-08-06 08:07:26,953][52665] Sum rewards: 87.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'weapon4': '0.008', 'AMMO2': '0.023', 'weapon5': '0.024', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.171', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '72.000'} [2024-08-06 08:07:27,345][52649] DAMAGECOUNT value on done: 908895.0 [2024-08-06 08:07:27,345][52649] Sum rewards: 73.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.169', 'AMMO3': '0.218', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '61.000'} [2024-08-06 08:07:27,581][52668] DAMAGECOUNT value on done: 946503.0 [2024-08-06 08:07:27,582][52668] Sum rewards: 82.816, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon5': '0.110', 'weapon2': '0.176', 'AMMO3': '0.182', 'WEAPON3': '1.150', 'weapon3': '3.442', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 669646848. Throughput: 0: 4359.1. Samples: 167420520. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:27,794][52567] Avg episode reward: [(0, '77.484')] [2024-08-06 08:07:29,310][52820] DAMAGECOUNT value on done: 870568.0 [2024-08-06 08:07:29,312][52820] Sum rewards: 84.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.325', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.040', 'AMMO4': '0.089', 'weapon5': '0.116', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '69.000'} [2024-08-06 08:07:29,483][52666] DAMAGECOUNT value on done: 930786.0 [2024-08-06 08:07:29,485][52666] Sum rewards: 77.524, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.358', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.147', 'weapon5': '0.176', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.726', 'WEAPON3': '1.450', 'weapon3': '2.774', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '65.500'} [2024-08-06 08:07:29,504][52803] DAMAGECOUNT value on done: 871048.0 [2024-08-06 08:07:29,504][52803] Sum rewards: 70.543, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.403', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.092', 'weapon5': '0.148', 'AMMO3': '0.190', 'weapon2': '0.234', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '56.000'} [2024-08-06 08:07:30,000][52670] DAMAGECOUNT value on done: 935216.0 [2024-08-06 08:07:30,001][52670] Sum rewards: 58.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.612', 'AMMO5': '0.022', 'AMMO2': '0.073', 'weapon4': '0.168', 'AMMO3': '0.193', 'weapon2': '0.208', 'weapon5': '0.282', 'AMMO4': '0.363', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'HITCOUNT': '2.860', 'weapon3': '3.066', 'DAMAGECOUNT': '14.037', 'FRAGCOUNT': '49.000'} [2024-08-06 08:07:30,078][52665] DAMAGECOUNT value on done: 915405.0 [2024-08-06 08:07:30,079][52665] Sum rewards: 76.652, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.460', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.076', 'weapon5': '0.146', 'AMMO4': '0.173', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:30,390][52668] DAMAGECOUNT value on done: 933126.0 [2024-08-06 08:07:30,391][52668] Sum rewards: 70.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.023', 'AMMO2': '0.060', 'AMMO3': '0.190', 'weapon2': '0.204', 'weapon4': '0.236', 'AMMO4': '0.298', 'weapon5': '0.312', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.846', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '57.500'} [2024-08-06 08:07:30,487][52649] DAMAGECOUNT value on done: 906783.0 [2024-08-06 08:07:30,487][52649] Sum rewards: 86.780, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.128', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.092', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.208', 'weapon2': '0.470', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '68.000'} [2024-08-06 08:07:30,986][52650] Updated weights for policy 0, policy_version 81751 (0.0020) [2024-08-06 08:07:31,824][52666] DAMAGECOUNT value on done: 935718.0 [2024-08-06 08:07:31,825][52666] Sum rewards: 80.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.208', 'weapon4': '0.208', 'weapon5': '0.210', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '66.000'} [2024-08-06 08:07:32,555][52820] DAMAGECOUNT value on done: 872223.0 [2024-08-06 08:07:32,556][52670] DAMAGECOUNT value on done: 939822.0 [2024-08-06 08:07:32,557][52670] Sum rewards: 64.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.340', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon5': '0.194', 'weapon4': '0.238', 'AMMO4': '0.269', 'AMMO3': '0.271', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.830', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '55.000'} [2024-08-06 08:07:32,558][52820] Sum rewards: 91.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.451', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.056', 'AMMO4': '0.103', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.264', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.858', 'FRAGCOUNT': '75.000'} [2024-08-06 08:07:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 669736960. Throughput: 0: 4361.8. Samples: 167433760. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:32,802][52567] Avg episode reward: [(0, '77.378')] [2024-08-06 08:07:32,798][52803] DAMAGECOUNT value on done: 887587.0 [2024-08-06 08:07:32,802][52803] Sum rewards: 71.858, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.750', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.130', 'AMMO4': '0.199', 'weapon2': '0.252', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.282', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '62.500'} [2024-08-06 08:07:33,062][52665] DAMAGECOUNT value on done: 918883.0 [2024-08-06 08:07:33,063][52665] Sum rewards: 76.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.192', 'weapon2': '0.538', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:33,564][52649] DAMAGECOUNT value on done: 920639.0 [2024-08-06 08:07:33,566][52649] Sum rewards: 80.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.116', 'AMMO4': '0.184', 'AMMO3': '0.188', 'weapon5': '0.202', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:33,731][52668] DAMAGECOUNT value on done: 942651.0 [2024-08-06 08:07:33,732][52668] Sum rewards: 80.989, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.216', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.080', 'AMMO4': '0.151', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.388', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:34,529][52667] DAMAGECOUNT value on done: 938609.0 [2024-08-06 08:07:34,530][52667] Sum rewards: 76.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.240', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.096', 'AMMO4': '0.129', 'weapon5': '0.138', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '64.500'} [2024-08-06 08:07:34,849][52666] DAMAGECOUNT value on done: 920678.0 [2024-08-06 08:07:34,850][52666] Sum rewards: 73.107, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.298', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.038', 'weapon5': '0.098', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.362', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.308', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:35,355][52650] Updated weights for policy 0, policy_version 81761 (0.0037) [2024-08-06 08:07:35,647][52670] DAMAGECOUNT value on done: 932587.0 [2024-08-06 08:07:35,647][52670] Sum rewards: 61.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.778', 'WEAPON3': '1.200', 'weapon3': '2.726', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '53.000'} [2024-08-06 08:07:35,661][52820] DAMAGECOUNT value on done: 859429.0 [2024-08-06 08:07:35,663][52820] Sum rewards: 62.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.052', 'weapon4': '0.054', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.486', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.206', 'DAMAGECOUNT': '16.203', 'FRAGCOUNT': '53.000'} [2024-08-06 08:07:35,796][52803] DAMAGECOUNT value on done: 870242.0 [2024-08-06 08:07:35,796][52803] Sum rewards: 72.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.148', 'weapon2': '0.168', 'AMMO3': '0.225', 'WEAPON3': '1.400', 'HITCOUNT': '3.280', 'weapon3': '3.584', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:35,846][52665] DAMAGECOUNT value on done: 929296.0 [2024-08-06 08:07:35,846][52665] Sum rewards: 73.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.191', 'weapon5': '0.292', 'AMMO4': '0.303', 'weapon4': '0.490', 'weapon2': '0.526', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.394', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '59.000'} [2024-08-06 08:07:36,334][52649] DAMAGECOUNT value on done: 921621.0 [2024-08-06 08:07:36,335][52649] Sum rewards: 86.420, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.070', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.043', 'weapon4': '0.044', 'weapon5': '0.116', 'AMMO4': '0.215', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.368', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '73.000'} [2024-08-06 08:07:36,457][52668] DAMAGECOUNT value on done: 942248.0 [2024-08-06 08:07:36,459][52668] Sum rewards: 68.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.070', 'AMMO3': '0.174', 'weapon5': '0.178', 'AMMO4': '0.262', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'HITCOUNT': '3.000', 'weapon3': '3.096', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '55.000'} [2024-08-06 08:07:37,429][52667] DAMAGECOUNT value on done: 955437.0 [2024-08-06 08:07:37,432][52667] Sum rewards: 82.311, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.535', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.062', 'weapon5': '0.108', 'AMMO4': '0.138', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '69.000'} [2024-08-06 08:07:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.1). Total num frames: 669827072. Throughput: 0: 4356.9. Samples: 167459830. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:37,794][52567] Avg episode reward: [(0, '76.904')] [2024-08-06 08:07:37,924][52666] DAMAGECOUNT value on done: 942020.0 [2024-08-06 08:07:37,925][52666] Sum rewards: 74.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.486', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.193', 'weapon5': '0.198', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '61.500'} [2024-08-06 08:07:38,296][52795] Large shaping reward 2.532 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.51, 170.0), ('weapon5', 0.002)] [2024-08-06 08:07:38,420][52670] DAMAGECOUNT value on done: 917431.0 [2024-08-06 08:07:38,421][52670] Sum rewards: 70.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.075', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon5': '0.062', 'weapon4': '0.072', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.618', 'WEAPON3': '1.400', 'weapon3': '3.034', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 08:07:38,791][52820] DAMAGECOUNT value on done: 871995.0 [2024-08-06 08:07:38,792][52820] Sum rewards: 82.621, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.259', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.198', 'weapon2': '0.214', 'WEAPON3': '1.150', 'weapon3': '3.568', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:38,876][52803] DAMAGECOUNT value on done: 880558.0 [2024-08-06 08:07:38,876][52803] Sum rewards: 90.155, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.015', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.105', 'AMMO3': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.133', 'FRAGCOUNT': '72.000'} [2024-08-06 08:07:39,054][52665] DAMAGECOUNT value on done: 928008.0 [2024-08-06 08:07:39,054][52665] Sum rewards: 67.054, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.641', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.320', 'DAMAGECOUNT': '16.407', 'FRAGCOUNT': '55.000'} [2024-08-06 08:07:39,248][52668] DAMAGECOUNT value on done: 934090.0 [2024-08-06 08:07:39,251][52668] Sum rewards: 60.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon5': '0.088', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.219', 'AMMO3': '0.253', 'weapon2': '0.770', 'WEAPON3': '1.550', 'weapon3': '2.782', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '52.000'} [2024-08-06 08:07:39,462][52649] DAMAGECOUNT value on done: 912854.0 [2024-08-06 08:07:39,464][52649] Sum rewards: 76.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.669', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:40,191][52650] Updated weights for policy 0, policy_version 81771 (0.0025) [2024-08-06 08:07:40,670][52667] DAMAGECOUNT value on done: 946319.0 [2024-08-06 08:07:40,672][52667] Sum rewards: 59.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.084', 'weapon5': '0.206', 'AMMO4': '0.208', 'AMMO3': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.782', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.453', 'FRAGCOUNT': '49.000'} [2024-08-06 08:07:40,696][52666] DAMAGECOUNT value on done: 935756.0 [2024-08-06 08:07:40,697][52666] Sum rewards: 86.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.272', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.460', 'WEAPON3': '1.150', 'weapon3': '3.188', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.037', 'FRAGCOUNT': '69.000'} [2024-08-06 08:07:41,235][52670] DAMAGECOUNT value on done: 930806.0 [2024-08-06 08:07:41,235][52670] Sum rewards: 72.170, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.623', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.160', 'AMMO4': '0.187', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.904', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '58.000'} [2024-08-06 08:07:41,950][52820] DAMAGECOUNT value on done: 858960.0 [2024-08-06 08:07:41,950][52820] Sum rewards: 79.619, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:41,964][52803] DAMAGECOUNT value on done: 880896.0 [2024-08-06 08:07:41,965][52803] Sum rewards: 77.222, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.728', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.042', 'AMMO4': '0.134', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '65.500'} [2024-08-06 08:07:42,032][52665] DAMAGECOUNT value on done: 932653.0 [2024-08-06 08:07:42,032][52665] Sum rewards: 81.162, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.052', 'weapon4': '0.066', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.229', 'weapon2': '0.382', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '68.000'} [2024-08-06 08:07:42,319][52668] DAMAGECOUNT value on done: 937846.0 [2024-08-06 08:07:42,321][52668] Sum rewards: 76.465, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.066', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.132', 'weapon4': '0.140', 'AMMO4': '0.182', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '63.000'} [2024-08-06 08:07:42,650][52649] DAMAGECOUNT value on done: 922073.0 [2024-08-06 08:07:42,650][52649] Sum rewards: 77.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon4': '0.136', 'AMMO3': '0.193', 'weapon5': '0.250', 'AMMO4': '0.329', 'weapon2': '0.428', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.940', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 669908992. Throughput: 0: 4359.3. Samples: 167486050. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:42,802][52567] Avg episode reward: [(0, '76.731')] [2024-08-06 08:07:43,177][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:07:43,269][52662] DAMAGECOUNT value on done: 939190.0 [2024-08-06 08:07:43,269][52662] Sum rewards: 78.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.098', 'weapon2': '0.144', 'weapon5': '0.194', 'AMMO4': '0.225', 'AMMO3': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:43,354][52666] DAMAGECOUNT value on done: 935398.0 [2024-08-06 08:07:43,355][52666] Sum rewards: 66.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.103', 'weapon5': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.254', 'WEAPON3': '1.350', 'HITCOUNT': '3.070', 'weapon3': '3.398', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 08:07:43,653][52667] DAMAGECOUNT value on done: 951888.0 [2024-08-06 08:07:43,653][52667] Sum rewards: 74.358, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.720', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.172', 'weapon5': '0.224', 'AMMO4': '0.225', 'weapon2': '0.228', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.040', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:44,004][52670] DAMAGECOUNT value on done: 940547.0 [2024-08-06 08:07:44,006][52670] Sum rewards: 92.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.150', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon2': '0.196', 'AMMO3': '0.203', 'AMMO4': '0.246', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.693', 'FRAGCOUNT': '74.000'} [2024-08-06 08:07:44,504][52650] Updated weights for policy 0, policy_version 81781 (0.0031) [2024-08-06 08:07:44,923][52668] DAMAGECOUNT value on done: 946220.0 [2024-08-06 08:07:44,924][52668] Sum rewards: 76.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.894', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.131', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.618', 'WEAPON3': '1.100', 'weapon3': '3.004', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '61.000'} [2024-08-06 08:07:44,960][52665] DAMAGECOUNT value on done: 926312.0 [2024-08-06 08:07:44,961][52665] Sum rewards: 79.967, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.154', 'AMMO3': '0.212', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '2.894', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:44,975][52820] DAMAGECOUNT value on done: 863590.0 [2024-08-06 08:07:44,977][52820] Sum rewards: 67.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.660', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.180', 'AMMO3': '0.207', 'weapon4': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.846', 'WEAPON3': '1.300', 'weapon3': '2.492', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '55.000'} [2024-08-06 08:07:45,014][52803] DAMAGECOUNT value on done: 887056.0 [2024-08-06 08:07:45,014][52803] Sum rewards: 74.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.024', 'WEAPON5': '0.050', 'weapon4': '0.088', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.262', 'weapon2': '0.354', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:45,491][52649] DAMAGECOUNT value on done: 917340.0 [2024-08-06 08:07:45,492][52649] Sum rewards: 79.908, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.562', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.198', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.468', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:46,096][52666] DAMAGECOUNT value on done: 928382.0 [2024-08-06 08:07:46,097][52666] Sum rewards: 74.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.142', 'AMMO3': '0.199', 'weapon5': '0.206', 'AMMO4': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '60.000'} [2024-08-06 08:07:46,268][52662] DAMAGECOUNT value on done: 949128.0 [2024-08-06 08:07:46,269][52662] Sum rewards: 79.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.572', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.040', 'AMMO4': '0.113', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:46,802][52667] DAMAGECOUNT value on done: 953224.0 [2024-08-06 08:07:46,802][52667] Sum rewards: 64.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.498', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.172', 'weapon5': '0.192', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.118', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '53.000'} [2024-08-06 08:07:46,834][52670] DAMAGECOUNT value on done: 933200.0 [2024-08-06 08:07:46,835][52670] Sum rewards: 64.876, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.750', 'AMMO2': '0.011', 'weapon4': '0.048', 'WEAPON4': '0.050', 'AMMO4': '0.054', 'AMMO3': '0.225', 'weapon2': '0.462', 'WEAPON3': '1.550', 'HITCOUNT': '3.240', 'weapon3': '3.302', 'DAMAGECOUNT': '15.684', 'FRAGCOUNT': '56.000'} [2024-08-06 08:07:47,599][52665] DAMAGECOUNT value on done: 941557.0 [2024-08-06 08:07:47,600][52665] Sum rewards: 82.785, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.060', 'AMMO4': '0.159', 'AMMO3': '0.178', 'weapon5': '0.278', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.978', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '66.000'} [2024-08-06 08:07:47,733][52668] DAMAGECOUNT value on done: 939018.0 [2024-08-06 08:07:47,734][52668] Sum rewards: 79.814, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO3': '0.138', 'weapon5': '0.140', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.560', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 669999104. Throughput: 0: 4367.5. Samples: 167499420. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:47,794][52567] Avg episode reward: [(0, '76.197')] [2024-08-06 08:07:48,009][52820] DAMAGECOUNT value on done: 866400.0 [2024-08-06 08:07:48,009][52820] Sum rewards: 69.664, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.798', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.110', 'AMMO3': '0.117', 'AMMO4': '0.139', 'weapon5': '0.142', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'WEAPON3': '0.800', 'weapon2': '1.108', 'weapon3': '2.288', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '53.000'} [2024-08-06 08:07:48,291][52649] DAMAGECOUNT value on done: 920697.0 [2024-08-06 08:07:48,293][52649] Sum rewards: 84.010, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.048', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.084', 'AMMO4': '0.151', 'weapon5': '0.204', 'weapon2': '0.236', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.208', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '69.000'} [2024-08-06 08:07:48,303][52803] DAMAGECOUNT value on done: 884225.0 [2024-08-06 08:07:48,307][52803] Sum rewards: 80.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.033', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.200', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '66.000'} [2024-08-06 08:07:48,967][52666] DAMAGECOUNT value on done: 926782.0 [2024-08-06 08:07:48,969][52666] Sum rewards: 65.175, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.628', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.182', 'AMMO4': '0.188', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.494', 'WEAPON3': '1.500', 'weapon3': '2.932', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '56.000'} [2024-08-06 08:07:49,122][52662] DAMAGECOUNT value on done: 946709.0 [2024-08-06 08:07:49,123][52662] Sum rewards: 65.565, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.227', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.114', 'AMMO4': '0.169', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '57.000'} [2024-08-06 08:07:49,512][52650] Updated weights for policy 0, policy_version 81791 (0.0014) [2024-08-06 08:07:49,666][52667] DAMAGECOUNT value on done: 951851.0 [2024-08-06 08:07:49,669][52667] Sum rewards: 78.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.578', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon4': '0.200', 'weapon2': '0.540', 'WEAPON3': '1.100', 'weapon3': '3.000', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '64.000'} [2024-08-06 08:07:49,719][52670] DAMAGECOUNT value on done: 934837.0 [2024-08-06 08:07:49,721][52670] Sum rewards: 77.541, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.995', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.191', 'weapon4': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '63.000'} [2024-08-06 08:07:50,579][52668] DAMAGECOUNT value on done: 934122.0 [2024-08-06 08:07:50,579][52668] Sum rewards: 81.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.913', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:50,659][52665] DAMAGECOUNT value on done: 935517.0 [2024-08-06 08:07:50,660][52665] Sum rewards: 84.961, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '70.000'} [2024-08-06 08:07:50,962][52820] DAMAGECOUNT value on done: 873568.0 [2024-08-06 08:07:50,963][52820] Sum rewards: 74.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.288', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.458', 'WEAPON3': '1.150', 'weapon3': '3.240', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '60.000'} [2024-08-06 08:07:51,345][52803] DAMAGECOUNT value on done: 879048.0 [2024-08-06 08:07:51,347][52803] Sum rewards: 78.496, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.672', 'AMMO5': '0.030', 'AMMO2': '0.069', 'weapon4': '0.126', 'AMMO3': '0.219', 'weapon2': '0.238', 'weapon5': '0.338', 'AMMO4': '0.347', 'WEAPON4': '0.700', 'WEAPON5': '0.800', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '20.448', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:51,438][52649] DAMAGECOUNT value on done: 915820.0 [2024-08-06 08:07:51,440][52649] Sum rewards: 80.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.082', 'weapon2': '0.142', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'weapon3': '3.610', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.233', 'FRAGCOUNT': '67.000'} [2024-08-06 08:07:51,957][52662] DAMAGECOUNT value on done: 936608.0 [2024-08-06 08:07:51,958][52662] Sum rewards: 67.502, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.838', 'AMMO5': '0.022', 'AMMO2': '0.056', 'AMMO3': '0.183', 'weapon4': '0.216', 'AMMO4': '0.280', 'weapon5': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.050', 'weapon3': '2.662', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '55.500'} [2024-08-06 08:07:52,006][52666] DAMAGECOUNT value on done: 947314.0 [2024-08-06 08:07:52,006][52666] Sum rewards: 89.842, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.104', 'weapon5': '0.136', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.302', 'HEALTH': '0.338', 'WEAPON3': '0.950', 'weapon3': '3.324', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '71.000'} [2024-08-06 08:07:52,454][52647] DAMAGECOUNT value on done: 1003144.0 [2024-08-06 08:07:52,456][52647] Sum rewards: 74.612, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.172', 'AMMO4': '0.193', 'AMMO3': '0.266', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '63.000'} [2024-08-06 08:07:52,766][52667] DAMAGECOUNT value on done: 945302.0 [2024-08-06 08:07:52,769][52667] Sum rewards: 68.998, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.852', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.132', 'weapon5': '0.146', 'AMMO4': '0.153', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.041', 'FRAGCOUNT': '56.000'} [2024-08-06 08:07:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 670089216. Throughput: 0: 4367.4. Samples: 167525490. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:07:52,794][52567] Avg episode reward: [(0, '76.120')] [2024-08-06 08:07:53,253][52795] DAMAGECOUNT value on done: 865914.0 [2024-08-06 08:07:53,254][52795] Sum rewards: 71.820, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.940', 'AMMO5': '0.016', 'AMMO2': '0.062', 'weapon4': '0.080', 'weapon5': '0.180', 'AMMO3': '0.245', 'AMMO4': '0.312', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.023', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:53,333][52668] DAMAGECOUNT value on done: 929704.0 [2024-08-06 08:07:53,334][52668] Sum rewards: 73.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.060', 'AMMO4': '0.129', 'weapon5': '0.170', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '61.000'} [2024-08-06 08:07:54,088][52820] DAMAGECOUNT value on done: 881948.0 [2024-08-06 08:07:54,088][52820] Sum rewards: 74.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.870', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.045', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '61.000'} [2024-08-06 08:07:54,112][52665] DAMAGECOUNT value on done: 930071.0 [2024-08-06 08:07:54,114][52665] Sum rewards: 68.031, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.134', 'AMMO4': '0.195', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.250', 'HITCOUNT': '3.090', 'weapon3': '3.194', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '56.000'} [2024-08-06 08:07:54,155][52650] Updated weights for policy 0, policy_version 81801 (0.0013) [2024-08-06 08:07:54,606][52649] DAMAGECOUNT value on done: 911786.0 [2024-08-06 08:07:54,608][52649] Sum rewards: 78.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.349', 'WEAPON1': '0.010', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.154', 'AMMO3': '0.211', 'weapon5': '0.246', 'AMMO4': '0.286', 'weapon2': '0.516', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.812', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.814', 'FRAGCOUNT': '62.000'} [2024-08-06 08:07:54,805][52666] DAMAGECOUNT value on done: 919944.0 [2024-08-06 08:07:54,805][52666] Sum rewards: 76.250, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.234', 'weapon4': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.244', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '65.000'} [2024-08-06 08:07:55,033][52662] DAMAGECOUNT value on done: 954735.0 [2024-08-06 08:07:55,033][52662] Sum rewards: 75.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.026', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.204', 'weapon4': '0.204', 'weapon5': '0.208', 'AMMO4': '0.225', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '60.000'} [2024-08-06 08:07:55,637][52647] DAMAGECOUNT value on done: 988922.0 [2024-08-06 08:07:55,638][52647] Sum rewards: 79.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.435', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.132', 'AMMO3': '0.192', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.012', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '63.000'} [2024-08-06 08:07:55,964][52667] DAMAGECOUNT value on done: 941748.0 [2024-08-06 08:07:55,965][52667] Sum rewards: 85.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.544', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '69.000'} [2024-08-06 08:07:56,501][52668] DAMAGECOUNT value on done: 928479.0 [2024-08-06 08:07:56,502][52668] Sum rewards: 78.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.825', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.096', 'AMMO4': '0.185', 'AMMO3': '0.224', 'weapon5': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.802', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '63.000'} [2024-08-06 08:07:56,671][52795] DAMAGECOUNT value on done: 857893.0 [2024-08-06 08:07:56,671][52795] Sum rewards: 90.965, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.908', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.040', 'AMMO4': '0.140', 'weapon5': '0.140', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.650', 'weapon3': '3.242', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.522', 'FRAGCOUNT': '76.000'} [2024-08-06 08:07:57,010][52665] DAMAGECOUNT value on done: 929434.0 [2024-08-06 08:07:57,010][52665] Sum rewards: 69.825, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.422', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.078', 'AMMO3': '0.146', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.760', 'WEAPON3': '0.950', 'weapon3': '2.926', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '56.000'} [2024-08-06 08:07:57,286][52666] DAMAGECOUNT value on done: 931849.0 [2024-08-06 08:07:57,287][52666] Sum rewards: 76.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.858', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.150', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '0.950', 'weapon3': '3.152', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '63.000'} [2024-08-06 08:07:57,328][52820] DAMAGECOUNT value on done: 864263.0 [2024-08-06 08:07:57,328][52820] Sum rewards: 89.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'weapon4': '0.172', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.303', 'FRAGCOUNT': '72.000'} [2024-08-06 08:07:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 670171136. Throughput: 0: 4367.4. Samples: 167551580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:07:57,794][52567] Avg episode reward: [(0, '76.295')] [2024-08-06 08:07:57,837][52649] DAMAGECOUNT value on done: 924678.0 [2024-08-06 08:07:57,838][52649] Sum rewards: 73.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.608', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.029', 'weapon4': '0.112', 'weapon5': '0.120', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.344', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '61.000'} [2024-08-06 08:07:58,254][52662] DAMAGECOUNT value on done: 931155.0 [2024-08-06 08:07:58,256][52662] Sum rewards: 79.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.090', 'AMMO4': '0.144', 'weapon4': '0.194', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '66.000'} [2024-08-06 08:07:58,312][52647] DAMAGECOUNT value on done: 995345.0 [2024-08-06 08:07:58,313][52647] Sum rewards: 65.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.758', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO3': '0.189', 'weapon2': '0.378', 'WEAPON3': '1.150', 'HITCOUNT': '3.060', 'weapon3': '3.498', 'DAMAGECOUNT': '15.555', 'FRAGCOUNT': '54.000'} [2024-08-06 08:07:58,735][52667] DAMAGECOUNT value on done: 945261.0 [2024-08-06 08:07:58,737][52667] Sum rewards: 74.043, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.930', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.068', 'AMMO4': '0.187', 'weapon5': '0.188', 'AMMO3': '0.189', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '60.000'} [2024-08-06 08:07:59,042][52650] Updated weights for policy 0, policy_version 81811 (0.0018) [2024-08-06 08:07:59,310][52668] DAMAGECOUNT value on done: 923695.0 [2024-08-06 08:07:59,312][52668] Sum rewards: 74.484, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'HEALTH': '0.027', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO3': '0.140', 'weapon4': '0.144', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.678', 'WEAPON3': '0.800', 'weapon3': '2.854', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '58.000'} [2024-08-06 08:07:59,968][52795] DAMAGECOUNT value on done: 862888.0 [2024-08-06 08:07:59,969][52795] Sum rewards: 79.607, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.420', 'AMMO5': '0.013', 'weapon4': '0.042', 'AMMO2': '0.046', 'weapon5': '0.132', 'AMMO3': '0.198', 'AMMO4': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '64.000'} [2024-08-06 08:08:00,009][52665] DAMAGECOUNT value on done: 927088.0 [2024-08-06 08:08:00,009][52665] Sum rewards: 82.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon4': '0.176', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'weapon2': '0.388', 'WEAPON3': '1.450', 'weapon3': '3.166', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '68.000'} [2024-08-06 08:08:00,440][52820] DAMAGECOUNT value on done: 874158.0 [2024-08-06 08:08:00,442][52820] Sum rewards: 78.288, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.395', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.236', 'AMMO3': '0.251', 'weapon2': '0.324', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '66.000'} [2024-08-06 08:08:00,836][52647] DAMAGECOUNT value on done: 993754.0 [2024-08-06 08:08:00,839][52647] Sum rewards: 78.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.885', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.072', 'weapon4': '0.108', 'AMMO3': '0.191', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '64.500'} [2024-08-06 08:08:01,029][52649] DAMAGECOUNT value on done: 932075.0 [2024-08-06 08:08:01,030][52649] Sum rewards: 65.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.600', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.154', 'weapon5': '0.252', 'AMMO4': '0.263', 'AMMO3': '0.264', 'weapon2': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'HITCOUNT': '2.890', 'weapon3': '2.922', 'DAMAGECOUNT': '16.713', 'FRAGCOUNT': '57.000'} [2024-08-06 08:08:01,231][52662] DAMAGECOUNT value on done: 937763.0 [2024-08-06 08:08:01,233][52662] Sum rewards: 80.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.305', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.426', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:02,283][52667] DAMAGECOUNT value on done: 951022.0 [2024-08-06 08:08:02,286][52667] Sum rewards: 80.483, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.711', 'AMMO5': '0.021', 'AMMO2': '0.068', 'weapon4': '0.158', 'weapon5': '0.226', 'AMMO3': '0.239', 'weapon2': '0.248', 'AMMO4': '0.338', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '68.000'} [2024-08-06 08:08:02,383][52668] DAMAGECOUNT value on done: 938262.0 [2024-08-06 08:08:02,385][52668] Sum rewards: 66.711, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.868', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.090', 'AMMO3': '0.188', 'weapon5': '0.196', 'AMMO4': '0.217', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.778', 'WEAPON3': '1.150', 'weapon3': '2.676', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.317', 'FRAGCOUNT': '54.000'} [2024-08-06 08:08:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 670261248. Throughput: 0: 4365.8. Samples: 167564580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:02,794][52567] Avg episode reward: [(0, '76.011')] [2024-08-06 08:08:03,219][52795] DAMAGECOUNT value on done: 876997.0 [2024-08-06 08:08:03,219][52795] Sum rewards: 89.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.236', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.144', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'weapon2': '0.288', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.760', 'FRAGCOUNT': '75.000'} [2024-08-06 08:08:03,240][52665] DAMAGECOUNT value on done: 933069.0 [2024-08-06 08:08:03,240][52665] Sum rewards: 81.933, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.188', 'weapon4': '0.212', 'AMMO4': '0.265', 'weapon5': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.612', 'WEAPON3': '1.100', 'weapon3': '2.636', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:03,253][52647] DAMAGECOUNT value on done: 1003170.0 [2024-08-06 08:08:03,254][52647] Sum rewards: 73.255, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.100', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO4': '0.072', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '59.000'} [2024-08-06 08:08:03,574][52650] Updated weights for policy 0, policy_version 81821 (0.0023) [2024-08-06 08:08:03,716][52820] DAMAGECOUNT value on done: 886390.0 [2024-08-06 08:08:03,716][52820] Sum rewards: 74.841, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.438', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.058', 'AMMO4': '0.093', 'weapon5': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '59.000'} [2024-08-06 08:08:04,031][52662] DAMAGECOUNT value on done: 954804.0 [2024-08-06 08:08:04,031][52662] Sum rewards: 80.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.697', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.136', 'AMMO4': '0.163', 'weapon5': '0.170', 'AMMO3': '0.225', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.032', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:04,202][52649] DAMAGECOUNT value on done: 923011.0 [2024-08-06 08:08:04,202][52649] Sum rewards: 80.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.084', 'weapon4': '0.096', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:04,860][52667] DAMAGECOUNT value on done: 940503.0 [2024-08-06 08:08:04,861][52667] Sum rewards: 79.234, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.450', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.102', 'weapon5': '0.126', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON3': '1.250', 'weapon3': '3.490', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:05,525][52668] DAMAGECOUNT value on done: 941025.0 [2024-08-06 08:08:05,527][52668] Sum rewards: 86.988, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.026', 'weapon5': '0.046', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.334', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.249', 'FRAGCOUNT': '72.000'} [2024-08-06 08:08:05,773][52647] DAMAGECOUNT value on done: 999052.0 [2024-08-06 08:08:05,774][52647] Sum rewards: 78.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.942', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.260', 'weapon2': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.414', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:06,211][52665] DAMAGECOUNT value on done: 930312.0 [2024-08-06 08:08:06,213][52665] Sum rewards: 75.580, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.590', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.138', 'weapon4': '0.188', 'AMMO4': '0.227', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.068', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:06,337][52795] DAMAGECOUNT value on done: 861317.0 [2024-08-06 08:08:06,338][52795] Sum rewards: 68.233, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.935', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.110', 'weapon5': '0.238', 'AMMO4': '0.281', 'AMMO3': '0.291', 'weapon2': '0.402', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.876', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '59.000'} [2024-08-06 08:08:06,849][52820] DAMAGECOUNT value on done: 875115.0 [2024-08-06 08:08:06,854][52820] Sum rewards: 69.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.831', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.202', 'weapon4': '0.222', 'AMMO3': '0.236', 'AMMO4': '0.253', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '58.000'} [2024-08-06 08:08:06,965][52662] DAMAGECOUNT value on done: 942066.0 [2024-08-06 08:08:06,965][52662] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.320', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.180', 'AMMO3': '0.195', 'weapon5': '0.232', 'AMMO4': '0.237', 'weapon2': '0.440', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.874', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '51.000'} [2024-08-06 08:08:07,134][52649] DAMAGECOUNT value on done: 922304.0 [2024-08-06 08:08:07,134][52649] Sum rewards: 74.583, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.940', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.088', 'AMMO4': '0.176', 'weapon5': '0.180', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:07,351][52667] DAMAGECOUNT value on done: 942202.0 [2024-08-06 08:08:07,351][52667] Sum rewards: 66.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.218', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.124', 'AMMO4': '0.143', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.428', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.210', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '54.000'} [2024-08-06 08:08:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.4, 300 sec: 17467.0). Total num frames: 670351360. Throughput: 0: 4372.9. Samples: 167591040. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:07,794][52567] Avg episode reward: [(0, '75.985')] [2024-08-06 08:08:08,095][52668] Large shaping reward 2.502 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.48, 160.0), ('weapon5', 0.002)] [2024-08-06 08:08:08,222][52650] Updated weights for policy 0, policy_version 81831 (0.0011) [2024-08-06 08:08:08,456][52668] DAMAGECOUNT value on done: 940784.0 [2024-08-06 08:08:08,457][52668] Sum rewards: 75.462, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.436', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.064', 'AMMO4': '0.096', 'weapon4': '0.112', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon2': '0.406', 'WEAPON3': '1.000', 'weapon3': '3.222', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:08,579][52647] DAMAGECOUNT value on done: 1002187.0 [2024-08-06 08:08:08,580][52647] Sum rewards: 69.882, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.934', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.134', 'weapon5': '0.162', 'AMMO4': '0.206', 'AMMO3': '0.272', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.124', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:08,865][52664] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:08:09,253][52665] DAMAGECOUNT value on done: 922216.0 [2024-08-06 08:08:09,256][52665] Sum rewards: 76.562, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.202', 'weapon2': '0.354', 'HEALTH': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.446', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:09,428][52795] DAMAGECOUNT value on done: 866153.0 [2024-08-06 08:08:09,430][52795] Sum rewards: 82.082, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.107', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.086', 'AMMO3': '0.139', 'AMMO4': '0.162', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '0.950', 'weapon3': '3.246', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:09,916][52662] DAMAGECOUNT value on done: 946141.0 [2024-08-06 08:08:09,917][52662] Sum rewards: 65.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.398', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.082', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.286', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.422', 'DAMAGECOUNT': '15.840', 'FRAGCOUNT': '54.000'} [2024-08-06 08:08:09,978][52820] DAMAGECOUNT value on done: 873481.0 [2024-08-06 08:08:09,980][52820] Sum rewards: 61.304, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.380', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon2': '0.192', 'weapon5': '0.212', 'AMMO4': '0.219', 'weapon4': '0.260', 'AMMO3': '0.264', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.052', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '54.500'} [2024-08-06 08:08:10,007][52667] DAMAGECOUNT value on done: 950608.0 [2024-08-06 08:08:10,009][52667] Sum rewards: 75.823, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.998', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.198', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:10,327][52649] DAMAGECOUNT value on done: 910023.0 [2024-08-06 08:08:10,328][52649] Sum rewards: 70.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.730', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.112', 'AMMO4': '0.129', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '58.000'} [2024-08-06 08:08:11,190][52647] DAMAGECOUNT value on done: 978031.0 [2024-08-06 08:08:11,190][52647] Sum rewards: 69.939, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO3': '0.164', 'weapon2': '0.572', 'WEAPON3': '1.000', 'weapon3': '3.026', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '56.000'} [2024-08-06 08:08:11,438][52668] DAMAGECOUNT value on done: 940382.0 [2024-08-06 08:08:11,438][52668] Sum rewards: 80.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.564', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.066', 'AMMO4': '0.153', 'weapon5': '0.164', 'AMMO3': '0.210', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 08:08:11,717][52665] DAMAGECOUNT value on done: 926252.0 [2024-08-06 08:08:11,718][52665] Sum rewards: 81.949, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.128', 'AMMO4': '0.183', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.600', 'weapon3': '3.122', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.950', 'FRAGCOUNT': '69.000'} [2024-08-06 08:08:11,742][52660] DAMAGECOUNT value on done: 936017.0 [2024-08-06 08:08:11,742][52660] Sum rewards: 72.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.098', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon4': '0.294', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '2.974', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:12,636][52795] DAMAGECOUNT value on done: 876288.0 [2024-08-06 08:08:12,638][52795] Sum rewards: 73.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.454', 'AMMO4': '-0.009', 'AMMO2': '-0.002', 'AMMO5': '0.004', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.296', 'WEAPON3': '1.550', 'weapon3': '3.502', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:12,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 670433280. Throughput: 0: 4372.6. Samples: 167617290. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:12,802][52567] Avg episode reward: [(0, '75.847')] [2024-08-06 08:08:12,830][52650] Updated weights for policy 0, policy_version 81841 (0.0012) [2024-08-06 08:08:12,886][52662] DAMAGECOUNT value on done: 941160.0 [2024-08-06 08:08:12,887][52662] Sum rewards: 88.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.278', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.138', 'AMMO4': '0.178', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.344', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.883', 'FRAGCOUNT': '73.000'} [2024-08-06 08:08:12,919][52659] DAMAGECOUNT value on done: 942297.0 [2024-08-06 08:08:12,919][52659] Sum rewards: 65.118, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.506', 'DAMAGECOUNT': '15.237', 'FRAGCOUNT': '56.000'} [2024-08-06 08:08:12,937][52649] DAMAGECOUNT value on done: 923147.0 [2024-08-06 08:08:12,937][52649] Sum rewards: 72.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.795', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.282', 'WEAPON4': '0.300', 'weapon2': '0.316', 'weapon4': '0.322', 'WEAPON3': '1.650', 'weapon3': '2.990', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:13,027][52667] DAMAGECOUNT value on done: 940421.0 [2024-08-06 08:08:13,028][52667] Sum rewards: 73.636, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.636', 'AMMO2': '0.004', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.428', 'WEAPON3': '1.200', 'weapon3': '3.372', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '59.000'} [2024-08-06 08:08:13,159][52820] DAMAGECOUNT value on done: 872232.0 [2024-08-06 08:08:13,160][52820] Sum rewards: 86.450, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.030', 'HEALTH': '0.058', 'weapon5': '0.126', 'AMMO4': '0.149', 'AMMO3': '0.189', 'weapon4': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.152', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '70.000'} [2024-08-06 08:08:14,008][52647] DAMAGECOUNT value on done: 992047.0 [2024-08-06 08:08:14,010][52647] Sum rewards: 75.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.364', 'AMMO5': '0.024', 'AMMO2': '0.054', 'AMMO3': '0.244', 'weapon2': '0.262', 'AMMO4': '0.272', 'weapon5': '0.282', 'weapon4': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.796', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '64.000'} [2024-08-06 08:08:14,365][52668] DAMAGECOUNT value on done: 947296.0 [2024-08-06 08:08:14,365][52668] Sum rewards: 86.778, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.365', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.142', 'AMMO4': '0.186', 'AMMO3': '0.200', 'weapon5': '0.212', 'weapon2': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '70.000'} [2024-08-06 08:08:14,667][52660] DAMAGECOUNT value on done: 928269.0 [2024-08-06 08:08:14,670][52660] Sum rewards: 62.766, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.972', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.110', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.826', 'WEAPON3': '1.400', 'weapon3': '2.704', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '54.000'} [2024-08-06 08:08:14,861][52665] DAMAGECOUNT value on done: 931662.0 [2024-08-06 08:08:14,861][52665] Sum rewards: 73.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.819', 'AMMO5': '0.015', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.131', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '3.132', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.253', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:15,786][52667] DAMAGECOUNT value on done: 947281.0 [2024-08-06 08:08:15,786][52667] Sum rewards: 66.896, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.920', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.048', 'AMMO6': '0.120', 'AMMO7': '0.120', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'weapon4': '0.192', 'AMMO3': '0.196', 'WEAPON7': '0.200', 'weapon7': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '56.000'} [2024-08-06 08:08:15,832][52795] DAMAGECOUNT value on done: 866107.0 [2024-08-06 08:08:15,832][52795] Sum rewards: 75.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.124', 'weapon5': '0.124', 'AMMO4': '0.139', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.300', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:15,981][52662] DAMAGECOUNT value on done: 940406.0 [2024-08-06 08:08:15,981][52662] Sum rewards: 73.312, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.528', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.208', 'AMMO3': '0.273', 'WEAPON3': '1.500', 'weapon3': '3.364', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:16,042][52659] DAMAGECOUNT value on done: 941190.0 [2024-08-06 08:08:16,042][52659] Sum rewards: 87.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.206', 'AMMO3': '0.212', 'weapon5': '0.214', 'weapon2': '0.266', 'AMMO4': '0.268', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.032', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.699', 'FRAGCOUNT': '72.000'} [2024-08-06 08:08:16,178][52649] DAMAGECOUNT value on done: 904252.0 [2024-08-06 08:08:16,178][52649] Sum rewards: 83.629, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.066', 'AMMO4': '0.120', 'weapon5': '0.144', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '68.000'} [2024-08-06 08:08:16,212][52820] DAMAGECOUNT value on done: 873727.0 [2024-08-06 08:08:16,215][52820] Sum rewards: 75.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.330', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon4': '0.166', 'AMMO3': '0.218', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.284', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:16,742][52647] DAMAGECOUNT value on done: 990607.0 [2024-08-06 08:08:16,743][52647] Sum rewards: 76.626, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.102', 'weapon5': '0.114', 'AMMO4': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.254', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:17,504][52660] DAMAGECOUNT value on done: 940377.0 [2024-08-06 08:08:17,504][52660] Sum rewards: 60.574, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.782', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.078', 'weapon5': '0.080', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.218', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'HITCOUNT': '2.960', 'weapon3': '3.382', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '55.000'} [2024-08-06 08:08:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 670515200. Throughput: 0: 4367.6. Samples: 167630300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:17,794][52567] Avg episode reward: [(0, '75.936')] [2024-08-06 08:08:18,193][52650] Updated weights for policy 0, policy_version 81851 (0.0027) [2024-08-06 08:08:18,571][52662] DAMAGECOUNT value on done: 934017.0 [2024-08-06 08:08:18,576][52662] Sum rewards: 80.436, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.815', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.136', 'AMMO4': '0.140', 'weapon2': '0.226', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '64.000'} [2024-08-06 08:08:18,622][52667] DAMAGECOUNT value on done: 953467.0 [2024-08-06 08:08:18,624][52667] Sum rewards: 71.715, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.092', 'weapon5': '0.112', 'AMMO4': '0.120', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '57.000'} [2024-08-06 08:08:18,941][52795] DAMAGECOUNT value on done: 869550.0 [2024-08-06 08:08:18,941][52795] Sum rewards: 70.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.150', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.144', 'weapon5': '0.160', 'AMMO3': '0.206', 'AMMO4': '0.257', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '57.000'} [2024-08-06 08:08:19,072][52659] DAMAGECOUNT value on done: 951403.0 [2024-08-06 08:08:19,073][52659] Sum rewards: 77.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.505', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.060', 'weapon5': '0.144', 'AMMO4': '0.167', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:19,211][52820] DAMAGECOUNT value on done: 882091.0 [2024-08-06 08:08:19,214][52820] Sum rewards: 75.631, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.137', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.380', 'weapon2': '0.424', 'WEAPON3': '1.000', 'weapon3': '3.188', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:19,256][52649] DAMAGECOUNT value on done: 924214.0 [2024-08-06 08:08:19,256][52649] Sum rewards: 76.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.954', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.096', 'AMMO4': '0.158', 'AMMO3': '0.170', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.050', 'weapon3': '2.850', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:19,701][52647] DAMAGECOUNT value on done: 989025.0 [2024-08-06 08:08:19,702][52647] Sum rewards: 67.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'WEAPON1': '0.020', 'AMMO5': '0.025', 'AMMO2': '0.079', 'AMMO3': '0.189', 'weapon4': '0.206', 'weapon5': '0.354', 'weapon2': '0.372', 'AMMO4': '0.397', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.200', 'weapon3': '2.678', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '54.000'} [2024-08-06 08:08:20,632][52660] DAMAGECOUNT value on done: 952679.0 [2024-08-06 08:08:20,637][52660] Sum rewards: 75.442, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.150', 'weapon5': '0.158', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:21,544][52667] DAMAGECOUNT value on done: 952972.0 [2024-08-06 08:08:21,544][52667] Sum rewards: 79.024, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.100', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.116', 'weapon4': '0.152', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.180', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:21,644][52659] DAMAGECOUNT value on done: 943483.0 [2024-08-06 08:08:21,645][52659] Sum rewards: 71.007, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.762', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.105', 'AMMO3': '0.188', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '57.000'} [2024-08-06 08:08:21,842][52662] DAMAGECOUNT value on done: 944103.0 [2024-08-06 08:08:21,842][52662] Sum rewards: 77.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.043', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.179', 'weapon4': '0.210', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:21,953][52650] Updated weights for policy 0, policy_version 81861 (0.0012) [2024-08-06 08:08:22,049][52649] DAMAGECOUNT value on done: 925363.0 [2024-08-06 08:08:22,051][52649] Sum rewards: 75.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.084', 'AMMO3': '0.177', 'AMMO4': '0.231', 'weapon5': '0.248', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.022', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '61.500'} [2024-08-06 08:08:22,121][52795] DAMAGECOUNT value on done: 876129.0 [2024-08-06 08:08:22,123][52795] Sum rewards: 81.973, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.090', 'AMMO4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.384', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '69.000'} [2024-08-06 08:08:22,412][52820] DAMAGECOUNT value on done: 880976.0 [2024-08-06 08:08:22,416][52820] Sum rewards: 87.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.465', 'AMMO4': '-0.001', 'AMMO2': '-0.000', 'AMMO3': '0.189', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.408', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.781', 'FRAGCOUNT': '71.000'} [2024-08-06 08:08:22,652][52647] DAMAGECOUNT value on done: 981914.0 [2024-08-06 08:08:22,654][52647] Sum rewards: 81.120, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.048', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.163', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '68.000'} [2024-08-06 08:08:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 670613504. Throughput: 0: 4369.1. Samples: 167656440. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:22,795][52567] Avg episode reward: [(0, '75.920')] [2024-08-06 08:08:23,474][52660] DAMAGECOUNT value on done: 934515.0 [2024-08-06 08:08:23,474][52660] Sum rewards: 68.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.824', 'AMMO5': '0.025', 'AMMO2': '0.074', 'weapon4': '0.174', 'AMMO3': '0.200', 'weapon2': '0.250', 'AMMO4': '0.368', 'weapon5': '0.468', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.770', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '55.000'} [2024-08-06 08:08:24,558][52659] DAMAGECOUNT value on done: 939483.0 [2024-08-06 08:08:24,560][52659] Sum rewards: 71.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.636', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon4': '0.158', 'AMMO3': '0.219', 'AMMO4': '0.315', 'weapon2': '0.318', 'weapon5': '0.402', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.766', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '59.000'} [2024-08-06 08:08:24,640][52667] DAMAGECOUNT value on done: 950505.0 [2024-08-06 08:08:24,642][52667] Sum rewards: 87.094, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.066', 'AMMO3': '0.158', 'weapon5': '0.178', 'AMMO4': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '3.082', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '69.000'} [2024-08-06 08:08:25,100][52647] DAMAGECOUNT value on done: 991388.0 [2024-08-06 08:08:25,100][52647] Sum rewards: 69.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.932', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.074', 'AMMO4': '0.089', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.336', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.306', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '58.000'} [2024-08-06 08:08:25,197][52662] DAMAGECOUNT value on done: 935852.0 [2024-08-06 08:08:25,198][52662] Sum rewards: 69.536, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.839', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.092', 'weapon5': '0.100', 'AMMO4': '0.138', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.350', 'HITCOUNT': '3.200', 'weapon3': '3.286', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '57.000'} [2024-08-06 08:08:25,235][52649] DAMAGECOUNT value on done: 915129.0 [2024-08-06 08:08:25,236][52649] Sum rewards: 72.421, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.406', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.056', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon2': '0.304', 'WEAPON3': '1.200', 'HITCOUNT': '3.360', 'weapon3': '3.432', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:25,274][52795] DAMAGECOUNT value on done: 871100.0 [2024-08-06 08:08:25,275][52795] Sum rewards: 79.299, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.126', 'AMMO3': '0.245', 'AMMO4': '0.261', 'weapon5': '0.308', 'weapon2': '0.478', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.784', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:25,525][52820] DAMAGECOUNT value on done: 869010.0 [2024-08-06 08:08:25,527][52820] Sum rewards: 68.304, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.579', 'AMMO5': '0.026', 'AMMO2': '0.058', 'AMMO3': '0.200', 'weapon4': '0.200', 'AMMO4': '0.292', 'weapon5': '0.356', 'weapon2': '0.508', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.602', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '58.000'} [2024-08-06 08:08:26,247][52660] DAMAGECOUNT value on done: 932556.0 [2024-08-06 08:08:26,248][52660] Sum rewards: 75.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.716', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.116', 'AMMO4': '0.145', 'AMMO3': '0.188', 'weapon5': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:27,117][52650] Updated weights for policy 0, policy_version 81871 (0.0012) [2024-08-06 08:08:27,258][52667] DAMAGECOUNT value on done: 947572.0 [2024-08-06 08:08:27,260][52667] Sum rewards: 69.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.096', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.178', 'AMMO3': '0.244', 'AMMO4': '0.256', 'weapon5': '0.280', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.754', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '56.000'} [2024-08-06 08:08:27,583][52659] DAMAGECOUNT value on done: 944788.0 [2024-08-06 08:08:27,583][52659] Sum rewards: 92.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.046', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.208', 'AMMO3': '0.232', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '22.221', 'FRAGCOUNT': '76.000'} [2024-08-06 08:08:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 670695424. Throughput: 0: 4371.8. Samples: 167682780. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:27,802][52567] Avg episode reward: [(0, '75.704')] [2024-08-06 08:08:27,853][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081873_670703616.pth... [2024-08-06 08:08:28,021][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081361_666509312.pth [2024-08-06 08:08:28,033][52614] Signal inference workers to stop experience collection... (15000 times) [2024-08-06 08:08:28,039][52614] Signal inference workers to resume experience collection... (15000 times) [2024-08-06 08:08:28,119][52650] InferenceWorker_p0-w0: stopping experience collection (15000 times) [2024-08-06 08:08:28,119][52650] InferenceWorker_p0-w0: resuming experience collection (15000 times) [2024-08-06 08:08:28,284][52647] DAMAGECOUNT value on done: 985521.0 [2024-08-06 08:08:28,287][52647] Sum rewards: 58.267, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.346', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.130', 'AMMO3': '0.237', 'AMMO4': '0.238', 'weapon4': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.892', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '48.000'} [2024-08-06 08:08:28,345][52662] DAMAGECOUNT value on done: 953477.0 [2024-08-06 08:08:28,346][52662] Sum rewards: 74.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.754', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.096', 'AMMO4': '0.120', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:28,467][52795] DAMAGECOUNT value on done: 862936.0 [2024-08-06 08:08:28,472][52795] Sum rewards: 91.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.976', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.162', 'weapon5': '0.180', 'AMMO4': '0.183', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.783', 'FRAGCOUNT': '74.000'} [2024-08-06 08:08:29,057][52660] DAMAGECOUNT value on done: 937652.0 [2024-08-06 08:08:29,061][52660] Sum rewards: 80.473, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.044', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.253', 'weapon2': '0.452', 'WEAPON3': '1.600', 'weapon3': '3.186', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.183', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:29,958][52794] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:08:30,234][52667] DAMAGECOUNT value on done: 951167.0 [2024-08-06 08:08:30,234][52667] Sum rewards: 80.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.909', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.151', 'weapon4': '0.160', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:30,399][52659] DAMAGECOUNT value on done: 942897.0 [2024-08-06 08:08:30,400][52659] Sum rewards: 77.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.381', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.129', 'weapon5': '0.152', 'AMMO3': '0.213', 'weapon2': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '66.000'} [2024-08-06 08:08:30,937][52647] DAMAGECOUNT value on done: 993486.0 [2024-08-06 08:08:30,937][52647] Sum rewards: 76.243, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.356', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.110', 'weapon5': '0.174', 'AMMO3': '0.224', 'AMMO4': '0.235', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.180', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:31,358][52662] DAMAGECOUNT value on done: 943947.0 [2024-08-06 08:08:31,377][52662] Sum rewards: 68.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.063', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.184', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.440', 'WEAPON3': '1.450', 'weapon3': '2.800', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '58.000'} [2024-08-06 08:08:31,600][52650] Updated weights for policy 0, policy_version 81881 (0.0016) [2024-08-06 08:08:31,677][52795] DAMAGECOUNT value on done: 869446.0 [2024-08-06 08:08:31,677][52795] Sum rewards: 83.800, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.790', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.192', 'weapon4': '0.214', 'AMMO3': '0.250', 'weapon5': '0.254', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.730', 'FRAGCOUNT': '70.000'} [2024-08-06 08:08:31,914][52660] DAMAGECOUNT value on done: 945059.0 [2024-08-06 08:08:31,916][52660] Sum rewards: 62.492, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.762', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.151', 'weapon5': '0.234', 'AMMO3': '0.269', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.098', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2024-08-06 08:08:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 670785536. Throughput: 0: 4356.7. Samples: 167695470. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:32,794][52567] Avg episode reward: [(0, '75.846')] [2024-08-06 08:08:33,141][52659] DAMAGECOUNT value on done: 942932.0 [2024-08-06 08:08:33,145][52659] Sum rewards: 74.719, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.108', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.072', 'weapon5': '0.192', 'weapon2': '0.204', 'AMMO4': '0.271', 'AMMO3': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.268', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:33,607][52647] DAMAGECOUNT value on done: 994464.0 [2024-08-06 08:08:33,610][52647] Sum rewards: 77.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.025', 'AMMO2': '0.059', 'AMMO3': '0.166', 'weapon2': '0.276', 'weapon5': '0.276', 'AMMO4': '0.293', 'weapon4': '0.344', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.722', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:34,322][52662] DAMAGECOUNT value on done: 933693.0 [2024-08-06 08:08:34,322][52662] Sum rewards: 71.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.455', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.064', 'weapon5': '0.216', 'AMMO3': '0.237', 'AMMO4': '0.244', 'weapon2': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '60.500'} [2024-08-06 08:08:34,761][52795] DAMAGECOUNT value on done: 873686.0 [2024-08-06 08:08:34,761][52795] Sum rewards: 82.198, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.396', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.118', 'weapon5': '0.136', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.198', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:34,836][52660] DAMAGECOUNT value on done: 934504.0 [2024-08-06 08:08:34,837][52660] Sum rewards: 65.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.909', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.047', 'weapon4': '0.186', 'AMMO3': '0.224', 'AMMO4': '0.235', 'weapon5': '0.280', 'weapon2': '0.414', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '15.945', 'FRAGCOUNT': '55.000'} [2024-08-06 08:08:36,292][52650] Updated weights for policy 0, policy_version 81891 (0.0013) [2024-08-06 08:08:36,296][52659] DAMAGECOUNT value on done: 941080.0 [2024-08-06 08:08:36,297][52659] Sum rewards: 83.509, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.977', 'AMMO5': '0.003', 'ARMOR': '0.004', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.039', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon2': '0.284', 'WEAPON3': '0.950', 'weapon3': '3.538', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '66.000'} [2024-08-06 08:08:36,661][52647] DAMAGECOUNT value on done: 980859.0 [2024-08-06 08:08:36,662][52647] Sum rewards: 83.405, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.355', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.142', 'weapon4': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.680', 'WEAPON3': '1.100', 'weapon3': '2.898', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:37,183][52662] DAMAGECOUNT value on done: 938472.0 [2024-08-06 08:08:37,185][52662] Sum rewards: 79.960, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.241', 'AMMO5': '0.009', 'AMMO2': '0.048', 'AMMO3': '0.130', 'weapon5': '0.138', 'weapon4': '0.158', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.450', 'WEAPON3': '0.800', 'weapon3': '3.112', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '62.000'} [2024-08-06 08:08:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.4). Total num frames: 670875648. Throughput: 0: 4363.6. Samples: 167721850. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:37,794][52567] Avg episode reward: [(0, '75.586')] [2024-08-06 08:08:37,937][52795] DAMAGECOUNT value on done: 861726.0 [2024-08-06 08:08:37,937][52795] Sum rewards: 66.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.049', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.064', 'weapon5': '0.124', 'AMMO3': '0.175', 'AMMO4': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '0.950', 'weapon3': '3.062', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '52.000'} [2024-08-06 08:08:38,301][52660] DAMAGECOUNT value on done: 930832.0 [2024-08-06 08:08:38,303][52660] Sum rewards: 75.990, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.940', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.132', 'weapon4': '0.172', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:38,413][52795] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:08:39,535][52662] DAMAGECOUNT value on done: 935332.0 [2024-08-06 08:08:39,537][52662] Sum rewards: 81.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.052', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:39,573][52647] DAMAGECOUNT value on done: 987389.0 [2024-08-06 08:08:39,574][52647] Sum rewards: 80.028, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.086', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.103', 'weapon5': '0.106', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '3.052', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:39,656][52659] DAMAGECOUNT value on done: 950891.0 [2024-08-06 08:08:39,656][52659] Sum rewards: 78.426, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.032', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.174', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:40,953][52795] DAMAGECOUNT value on done: 870575.0 [2024-08-06 08:08:40,954][52795] Sum rewards: 72.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.086', 'weapon4': '0.146', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.184', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:41,119][52650] Updated weights for policy 0, policy_version 81901 (0.0025) [2024-08-06 08:08:41,486][52660] DAMAGECOUNT value on done: 938359.0 [2024-08-06 08:08:41,486][52660] Sum rewards: 73.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.982', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.586', 'WEAPON3': '1.650', 'weapon3': '3.116', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:42,113][52647] DAMAGECOUNT value on done: 980830.0 [2024-08-06 08:08:42,114][52647] Sum rewards: 78.127, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.058', 'WEAPON5': '0.100', 'AMMO3': '0.236', 'weapon2': '0.348', 'HEALTH': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:42,752][52659] DAMAGECOUNT value on done: 937495.0 [2024-08-06 08:08:42,753][52659] Sum rewards: 78.836, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.548', 'AMMO2': '0.016', 'AMMO4': '0.079', 'AMMO3': '0.171', 'weapon2': '0.270', 'WEAPON3': '1.050', 'HITCOUNT': '3.500', 'weapon3': '3.618', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '63.000'} [2024-08-06 08:08:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 670957568. Throughput: 0: 4372.2. Samples: 167748330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:08:42,795][52567] Avg episode reward: [(0, '75.658')] [2024-08-06 08:08:44,143][52795] DAMAGECOUNT value on done: 870826.0 [2024-08-06 08:08:44,143][52795] Sum rewards: 67.296, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.132', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.100', 'weapon5': '0.144', 'AMMO4': '0.146', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '55.000'} [2024-08-06 08:08:44,196][52660] DAMAGECOUNT value on done: 933324.0 [2024-08-06 08:08:44,197][52660] Sum rewards: 77.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.576', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.088', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon4': '0.296', 'weapon2': '0.678', 'WEAPON3': '0.950', 'weapon3': '2.662', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:44,727][52647] DAMAGECOUNT value on done: 983617.0 [2024-08-06 08:08:44,739][52647] Sum rewards: 66.524, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.091', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '55.000'} [2024-08-06 08:08:45,558][52650] Updated weights for policy 0, policy_version 81911 (0.0016) [2024-08-06 08:08:45,635][52659] DAMAGECOUNT value on done: 947851.0 [2024-08-06 08:08:45,637][52659] Sum rewards: 67.222, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.605', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.154', 'weapon4': '0.178', 'AMMO4': '0.182', 'AMMO3': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '54.000'} [2024-08-06 08:08:47,212][52795] DAMAGECOUNT value on done: 858460.0 [2024-08-06 08:08:47,213][52795] Sum rewards: 76.255, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'weapon4': '0.108', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '64.000'} [2024-08-06 08:08:47,240][52660] DAMAGECOUNT value on done: 933333.0 [2024-08-06 08:08:47,240][52660] Sum rewards: 88.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '72.000'} [2024-08-06 08:08:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 671047680. Throughput: 0: 4371.3. Samples: 167761290. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:08:47,794][52567] Avg episode reward: [(0, '75.421')] [2024-08-06 08:08:48,428][52659] DAMAGECOUNT value on done: 940623.0 [2024-08-06 08:08:48,429][52659] Sum rewards: 73.415, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.649', 'ARMOR': '0.008', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.126', 'weapon4': '0.170', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:49,536][52660] DAMAGECOUNT value on done: 942942.0 [2024-08-06 08:08:49,538][52660] Sum rewards: 83.439, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.419', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.070', 'AMMO4': '0.105', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.050', 'weapon3': '3.336', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:49,571][52658] DAMAGECOUNT value on done: 946124.0 [2024-08-06 08:08:49,571][52658] Sum rewards: 89.343, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.335', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.024', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.532', 'FRAGCOUNT': '74.000'} [2024-08-06 08:08:50,353][52795] DAMAGECOUNT value on done: 868029.0 [2024-08-06 08:08:50,362][52795] Sum rewards: 83.220, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.110', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.056', 'weapon5': '0.132', 'AMMO3': '0.150', 'AMMO4': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '0.900', 'weapon3': '3.386', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '64.000'} [2024-08-06 08:08:50,391][52650] Updated weights for policy 0, policy_version 81921 (0.0012) [2024-08-06 08:08:51,488][52659] DAMAGECOUNT value on done: 937373.0 [2024-08-06 08:08:51,488][52659] Sum rewards: 72.055, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.006', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.238', 'weapon2': '0.604', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:52,041][52664] DAMAGECOUNT value on done: 970314.0 [2024-08-06 08:08:52,041][52664] Sum rewards: 78.790, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.768', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'weapon2': '0.238', 'AMMO3': '0.262', 'WEAPON3': '1.500', 'weapon3': '3.380', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '66.000'} [2024-08-06 08:08:52,371][52660] DAMAGECOUNT value on done: 956732.0 [2024-08-06 08:08:52,371][52660] Sum rewards: 80.197, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.090', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.763', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:52,449][52658] DAMAGECOUNT value on done: 947245.0 [2024-08-06 08:08:52,449][52658] Sum rewards: 74.055, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.854', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.172', 'weapon5': '0.198', 'AMMO3': '0.225', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.212', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '61.000'} [2024-08-06 08:08:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 671129600. Throughput: 0: 4371.1. Samples: 167787740. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:08:52,795][52567] Avg episode reward: [(0, '75.567')] [2024-08-06 08:08:53,521][52795] DAMAGECOUNT value on done: 875804.0 [2024-08-06 08:08:53,522][52795] Sum rewards: 81.515, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.244', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO3': '0.180', 'AMMO4': '0.201', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '65.000'} [2024-08-06 08:08:54,339][52659] DAMAGECOUNT value on done: 942866.0 [2024-08-06 08:08:54,340][52659] Sum rewards: 74.910, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.014', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.158', 'weapon5': '0.190', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.372', 'WEAPON3': '1.050', 'weapon3': '2.934', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '59.000'} [2024-08-06 08:08:54,755][52660] DAMAGECOUNT value on done: 936673.0 [2024-08-06 08:08:54,756][52660] Sum rewards: 85.490, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.270', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.044', 'weapon5': '0.116', 'AMMO4': '0.133', 'AMMO3': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.000', 'weapon3': '3.200', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:55,005][52664] DAMAGECOUNT value on done: 976280.0 [2024-08-06 08:08:55,006][52664] Sum rewards: 70.702, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.742', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.146', 'AMMO4': '0.152', 'weapon2': '0.204', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.260', 'weapon3': '3.376', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '59.000'} [2024-08-06 08:08:55,206][52658] DAMAGECOUNT value on done: 948678.0 [2024-08-06 08:08:55,206][52658] Sum rewards: 92.750, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.336', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.084', 'AMMO3': '0.187', 'AMMO4': '0.240', 'weapon5': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '73.000'} [2024-08-06 08:08:55,439][52650] Updated weights for policy 0, policy_version 81931 (0.0021) [2024-08-06 08:08:57,456][52659] DAMAGECOUNT value on done: 941712.0 [2024-08-06 08:08:57,456][52659] Sum rewards: 76.142, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.915', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.084', 'weapon4': '0.090', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.258', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '64.000'} [2024-08-06 08:08:57,741][52660] DAMAGECOUNT value on done: 942899.0 [2024-08-06 08:08:57,744][52660] Sum rewards: 79.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon2': '0.164', 'weapon5': '0.180', 'AMMO3': '0.204', 'AMMO4': '0.240', 'weapon4': '0.266', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '66.000'} [2024-08-06 08:08:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 671227904. Throughput: 0: 4377.1. Samples: 167814260. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:08:57,794][52567] Avg episode reward: [(0, '76.091')] [2024-08-06 08:08:57,838][52658] DAMAGECOUNT value on done: 945111.0 [2024-08-06 08:08:57,840][52658] Sum rewards: 69.659, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.794', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.244', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.394', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '60.000'} [2024-08-06 08:08:57,995][52664] DAMAGECOUNT value on done: 980095.0 [2024-08-06 08:08:57,995][52664] Sum rewards: 80.943, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.615', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.086', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.368', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '67.000'} [2024-08-06 08:08:59,413][52650] Updated weights for policy 0, policy_version 81941 (0.0043) [2024-08-06 08:09:00,465][52659] DAMAGECOUNT value on done: 951866.0 [2024-08-06 08:09:00,473][52659] Sum rewards: 89.775, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.890', 'AMMO5': '0.011', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon5': '0.132', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '72.000'} [2024-08-06 08:09:00,478][52664] DAMAGECOUNT value on done: 970836.0 [2024-08-06 08:09:00,480][52664] Sum rewards: 78.654, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.092', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon4': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.288', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:00,803][52660] DAMAGECOUNT value on done: 939503.0 [2024-08-06 08:09:00,805][52660] Sum rewards: 74.322, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.110', 'AMMO5': '0.005', 'weapon4': '0.038', 'AMMO2': '0.044', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.221', 'AMMO3': '0.253', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:01,204][52658] DAMAGECOUNT value on done: 938316.0 [2024-08-06 08:09:01,207][52658] Sum rewards: 73.832, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.130', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.024', 'weapon5': '0.112', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.404', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 08:09:02,767][52669] DAMAGECOUNT value on done: 942600.0 [2024-08-06 08:09:02,767][52669] Sum rewards: 76.582, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.520', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.122', 'weapon5': '0.140', 'weapon2': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.284', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '66.000'} [2024-08-06 08:09:02,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 671318016. Throughput: 0: 4378.0. Samples: 167827310. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:09:02,794][52567] Avg episode reward: [(0, '76.543')] [2024-08-06 08:09:02,871][52664] DAMAGECOUNT value on done: 985259.0 [2024-08-06 08:09:02,872][52664] Sum rewards: 61.038, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.802', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.082', 'AMMO3': '0.199', 'AMMO4': '0.207', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.632', 'WEAPON3': '1.100', 'HITCOUNT': '2.540', 'weapon3': '2.774', 'DAMAGECOUNT': '15.174', 'FRAGCOUNT': '50.000'} [2024-08-06 08:09:03,118][52659] DAMAGECOUNT value on done: 934561.0 [2024-08-06 08:09:03,119][52659] Sum rewards: 69.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.120', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.144', 'AMMO4': '0.186', 'weapon4': '0.192', 'AMMO3': '0.227', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '59.000'} [2024-08-06 08:09:03,834][52660] DAMAGECOUNT value on done: 930760.0 [2024-08-06 08:09:03,836][52660] Sum rewards: 67.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.158', 'weapon5': '0.182', 'weapon2': '0.228', 'AMMO4': '0.237', 'AMMO3': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '56.000'} [2024-08-06 08:09:04,312][52658] DAMAGECOUNT value on done: 936705.0 [2024-08-06 08:09:04,312][52658] Sum rewards: 83.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.030', 'AMMO5': '0.005', 'AMMO2': '0.009', 'WEAPON1': '0.020', 'AMMO4': '0.047', 'weapon4': '0.048', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.590', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '69.000'} [2024-08-06 08:09:04,614][52650] Updated weights for policy 0, policy_version 81951 (0.0011) [2024-08-06 08:09:05,387][52669] DAMAGECOUNT value on done: 940584.0 [2024-08-06 08:09:05,388][52669] Sum rewards: 80.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.147', 'AMMO3': '0.197', 'weapon4': '0.332', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '66.000'} [2024-08-06 08:09:05,429][52659] DAMAGECOUNT value on done: 947706.0 [2024-08-06 08:09:05,430][52659] Sum rewards: 68.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.583', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.098', 'weapon4': '0.194', 'AMMO3': '0.219', 'AMMO4': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '58.500'} [2024-08-06 08:09:06,040][52664] DAMAGECOUNT value on done: 980588.0 [2024-08-06 08:09:06,040][52664] Sum rewards: 87.185, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.097', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.054', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.468', 'FRAGCOUNT': '72.000'} [2024-08-06 08:09:06,971][52660] DAMAGECOUNT value on done: 932367.0 [2024-08-06 08:09:06,971][52660] Sum rewards: 76.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.806', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon4': '0.190', 'AMMO3': '0.204', 'weapon5': '0.214', 'AMMO4': '0.309', 'WEAPON5': '0.500', 'weapon2': '0.522', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.742', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:07,320][52658] DAMAGECOUNT value on done: 949189.0 [2024-08-06 08:09:07,320][52658] Sum rewards: 72.724, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.080', 'AMMO5': '0.034', 'AMMO2': '0.084', 'weapon4': '0.168', 'AMMO3': '0.172', 'weapon5': '0.340', 'weapon2': '0.344', 'AMMO4': '0.421', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.050', 'weapon3': '2.802', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '60.500'} [2024-08-06 08:09:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 671399936. Throughput: 0: 4390.5. Samples: 167854010. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:09:07,794][52567] Avg episode reward: [(0, '76.162')] [2024-08-06 08:09:08,291][52669] DAMAGECOUNT value on done: 951195.0 [2024-08-06 08:09:08,293][52669] Sum rewards: 72.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.340', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.165', 'weapon4': '0.168', 'AMMO4': '0.177', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '2.852', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.759', 'FRAGCOUNT': '58.000'} [2024-08-06 08:09:08,440][52659] DAMAGECOUNT value on done: 938763.0 [2024-08-06 08:09:08,442][52659] Sum rewards: 68.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.082', 'AMMO3': '0.194', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '59.000'} [2024-08-06 08:09:08,643][52650] Updated weights for policy 0, policy_version 81961 (0.0012) [2024-08-06 08:09:08,852][52664] DAMAGECOUNT value on done: 970963.0 [2024-08-06 08:09:08,852][52664] Sum rewards: 80.453, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.036', 'weapon5': '0.080', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '66.000'} [2024-08-06 08:09:09,508][52795] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:09:10,541][52658] DAMAGECOUNT value on done: 938913.0 [2024-08-06 08:09:10,543][52658] Sum rewards: 68.855, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.302', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.128', 'AMMO4': '0.173', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '58.000'} [2024-08-06 08:09:11,323][52664] DAMAGECOUNT value on done: 971469.0 [2024-08-06 08:09:11,332][52664] Sum rewards: 74.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.255', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:11,605][52669] DAMAGECOUNT value on done: 942260.0 [2024-08-06 08:09:11,607][52669] Sum rewards: 76.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.025', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.046', 'weapon5': '0.092', 'weapon2': '0.208', 'AMMO3': '0.212', 'AMMO4': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.416', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '65.000'} [2024-08-06 08:09:12,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17439.6). Total num frames: 671481856. Throughput: 0: 4393.1. Samples: 167880470. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:09:12,795][52567] Avg episode reward: [(0, '76.179')] [2024-08-06 08:09:12,931][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:09:13,188][52811] DAMAGECOUNT value on done: 893693.0 [2024-08-06 08:09:13,191][52811] Sum rewards: 73.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.275', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon5': '0.164', 'AMMO3': '0.167', 'weapon4': '0.230', 'AMMO4': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '58.500'} [2024-08-06 08:09:13,366][52671] DAMAGECOUNT value on done: 947814.0 [2024-08-06 08:09:13,367][52671] Sum rewards: 77.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.052', 'AMMO4': '0.182', 'AMMO3': '0.223', 'weapon5': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '62.000'} [2024-08-06 08:09:13,570][52650] Updated weights for policy 0, policy_version 81971 (0.0010) [2024-08-06 08:09:13,754][52658] DAMAGECOUNT value on done: 963793.0 [2024-08-06 08:09:13,756][52658] Sum rewards: 80.536, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.580', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.149', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.864', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:14,497][52664] DAMAGECOUNT value on done: 978573.0 [2024-08-06 08:09:14,499][52664] Sum rewards: 67.015, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.948', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.066', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.448', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.216', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '56.000'} [2024-08-06 08:09:14,707][52669] DAMAGECOUNT value on done: 951167.0 [2024-08-06 08:09:14,708][52669] Sum rewards: 68.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.188', 'AMMO4': '0.218', 'AMMO3': '0.221', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.142', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '58.000'} [2024-08-06 08:09:16,040][52671] DAMAGECOUNT value on done: 954343.0 [2024-08-06 08:09:16,040][52671] Sum rewards: 71.362, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.076', 'weapon5': '0.128', 'AMMO4': '0.171', 'AMMO3': '0.179', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.030', 'weapon3': '3.312', 'DAMAGECOUNT': '16.824', 'FRAGCOUNT': '58.000'} [2024-08-06 08:09:16,246][52811] DAMAGECOUNT value on done: 877324.0 [2024-08-06 08:09:16,249][52811] Sum rewards: 59.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.690', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.086', 'AMMO4': '0.147', 'weapon5': '0.166', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.202', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '50.500'} [2024-08-06 08:09:16,614][52658] DAMAGECOUNT value on done: 950964.0 [2024-08-06 08:09:16,616][52658] Sum rewards: 72.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.130', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.056', 'weapon5': '0.060', 'AMMO4': '0.061', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.404', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 08:09:17,508][52669] DAMAGECOUNT value on done: 949215.0 [2024-08-06 08:09:17,510][52669] Sum rewards: 64.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.228', 'AMMO3': '0.235', 'WEAPON3': '1.450', 'HITCOUNT': '3.270', 'weapon3': '3.450', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '56.000'} [2024-08-06 08:09:17,509][52664] DAMAGECOUNT value on done: 978773.0 [2024-08-06 08:09:17,513][52664] Sum rewards: 68.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.848', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.148', 'AMMO4': '0.157', 'weapon5': '0.162', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '56.000'} [2024-08-06 08:09:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 671580160. Throughput: 0: 4402.9. Samples: 167893600. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:09:17,794][52567] Avg episode reward: [(0, '75.727')] [2024-08-06 08:09:18,498][52650] Updated weights for policy 0, policy_version 81981 (0.0011) [2024-08-06 08:09:18,574][52671] DAMAGECOUNT value on done: 948905.0 [2024-08-06 08:09:18,575][52671] Sum rewards: 62.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.036', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.168', 'AMMO3': '0.181', 'weapon4': '0.252', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.970', 'weapon3': '3.066', 'DAMAGECOUNT': '14.940', 'FRAGCOUNT': '51.000'} [2024-08-06 08:09:19,407][52811] DAMAGECOUNT value on done: 872272.0 [2024-08-06 08:09:19,407][52811] Sum rewards: 70.728, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.325', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.050', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.285', 'weapon2': '0.444', 'WEAPON3': '1.650', 'weapon3': '3.180', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:19,748][52658] DAMAGECOUNT value on done: 956242.0 [2024-08-06 08:09:19,750][52658] Sum rewards: 70.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.484', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.022', 'AMMO4': '0.106', 'weapon5': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'HITCOUNT': '3.280', 'weapon3': '3.302', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2024-08-06 08:09:20,164][52669] DAMAGECOUNT value on done: 948067.0 [2024-08-06 08:09:20,165][52669] Sum rewards: 80.201, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.920', 'AMMO2': '0.004', 'AMMO5': '0.006', 'weapon4': '0.012', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.322', 'WEAPON3': '1.050', 'weapon3': '3.420', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:20,750][52664] DAMAGECOUNT value on done: 986175.0 [2024-08-06 08:09:20,750][52664] Sum rewards: 74.739, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.078', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '62.000'} [2024-08-06 08:09:21,436][52671] DAMAGECOUNT value on done: 953282.0 [2024-08-06 08:09:21,437][52671] Sum rewards: 76.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.691', 'AMMO5': '0.018', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.190', 'AMMO4': '0.194', 'AMMO3': '0.211', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:22,469][52811] DAMAGECOUNT value on done: 876778.0 [2024-08-06 08:09:22,476][52811] Sum rewards: 67.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon4': '0.100', 'weapon5': '0.112', 'weapon2': '0.164', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.388', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '56.000'} [2024-08-06 08:09:22,518][52658] DAMAGECOUNT value on done: 941707.0 [2024-08-06 08:09:22,519][52658] Sum rewards: 67.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.810', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.098', 'weapon5': '0.118', 'AMMO4': '0.124', 'weapon2': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.450', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '57.000'} [2024-08-06 08:09:22,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 671662080. Throughput: 0: 4395.8. Samples: 167919660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:09:22,794][52567] Avg episode reward: [(0, '75.273')] [2024-08-06 08:09:22,817][52650] Updated weights for policy 0, policy_version 81991 (0.0019) [2024-08-06 08:09:22,924][52669] DAMAGECOUNT value on done: 947275.0 [2024-08-06 08:09:22,925][52669] Sum rewards: 81.121, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.012', 'weapon4': '0.044', 'AMMO2': '0.051', 'weapon5': '0.104', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'AMMO4': '0.257', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '68.000'} [2024-08-06 08:09:23,106][52663] DAMAGECOUNT value on done: 961902.0 [2024-08-06 08:09:23,107][52663] Sum rewards: 80.269, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.575', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.158', 'AMMO4': '0.168', 'weapon2': '0.192', 'weapon4': '0.192', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.146', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.701', 'FRAGCOUNT': '68.000'} [2024-08-06 08:09:23,499][52664] DAMAGECOUNT value on done: 980629.0 [2024-08-06 08:09:23,499][52664] Sum rewards: 75.998, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.444', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'weapon5': '0.026', 'WEAPON4': '0.050', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.770', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '61.000'} [2024-08-06 08:09:24,320][52671] DAMAGECOUNT value on done: 959462.0 [2024-08-06 08:09:24,320][52671] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.995', 'weapon5': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.178', 'weapon2': '0.322', 'WEAPON3': '1.100', 'HITCOUNT': '3.400', 'weapon3': '3.458', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '60.500'} [2024-08-06 08:09:25,323][52669] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.546, 182.0)] [2024-08-06 08:09:25,375][52658] DAMAGECOUNT value on done: 952968.0 [2024-08-06 08:09:25,376][52658] Sum rewards: 82.088, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.473', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.188', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.502', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.703', 'FRAGCOUNT': '68.000'} [2024-08-06 08:09:25,484][52811] DAMAGECOUNT value on done: 879815.0 [2024-08-06 08:09:25,484][52811] Sum rewards: 85.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.068', 'AMMO4': '0.096', 'weapon4': '0.146', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '70.000'} [2024-08-06 08:09:25,985][52669] DAMAGECOUNT value on done: 957142.0 [2024-08-06 08:09:25,986][52669] Sum rewards: 74.419, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.826', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.107', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '60.000'} [2024-08-06 08:09:26,165][52663] DAMAGECOUNT value on done: 944778.0 [2024-08-06 08:09:26,169][52663] Sum rewards: 70.592, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.572', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.159', 'weapon2': '0.278', 'WEAPON3': '1.000', 'HITCOUNT': '3.360', 'weapon3': '3.376', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '55.000'} [2024-08-06 08:09:26,398][52664] DAMAGECOUNT value on done: 982436.0 [2024-08-06 08:09:26,399][52664] Sum rewards: 83.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.675', 'AMMO5': '0.008', 'weapon4': '0.042', 'AMMO2': '0.045', 'weapon5': '0.134', 'weapon2': '0.168', 'AMMO4': '0.223', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.434', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '70.000'} [2024-08-06 08:09:26,878][52671] DAMAGECOUNT value on done: 946792.0 [2024-08-06 08:09:26,880][52671] Sum rewards: 69.744, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.622', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.134', 'WEAPON5': '0.250', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.542', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '61.000'} [2024-08-06 08:09:27,588][52650] Updated weights for policy 0, policy_version 82001 (0.0012) [2024-08-06 08:09:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 671752192. Throughput: 0: 4389.3. Samples: 167945850. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:09:27,794][52567] Avg episode reward: [(0, '75.627')] [2024-08-06 08:09:28,329][52658] DAMAGECOUNT value on done: 942867.0 [2024-08-06 08:09:28,329][52658] Sum rewards: 79.644, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.702', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.026', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.064', 'AMMO3': '0.246', 'weapon2': '0.390', 'WEAPON3': '1.500', 'weapon3': '3.388', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '66.000'} [2024-08-06 08:09:28,504][52811] DAMAGECOUNT value on done: 895214.0 [2024-08-06 08:09:28,505][52811] Sum rewards: 66.151, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.080', 'AMMO2': '0.005', 'AMMO4': '0.026', 'AMMO3': '0.124', 'weapon2': '0.652', 'WEAPON3': '0.750', 'HITCOUNT': '2.820', 'weapon3': '3.310', 'DAMAGECOUNT': '14.043', 'FRAGCOUNT': '52.000'} [2024-08-06 08:09:28,771][52669] DAMAGECOUNT value on done: 949079.0 [2024-08-06 08:09:28,774][52669] Sum rewards: 76.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.243', 'weapon2': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.424', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:29,006][52663] DAMAGECOUNT value on done: 941000.0 [2024-08-06 08:09:29,010][52663] Sum rewards: 87.786, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.660', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.086', 'weapon5': '0.172', 'AMMO4': '0.210', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.946', 'FRAGCOUNT': '73.000'} [2024-08-06 08:09:29,170][52794] DAMAGECOUNT value on done: 938455.0 [2024-08-06 08:09:29,170][52794] Sum rewards: 84.674, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.890', 'ARMOR': '0.004', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.191', 'AMMO4': '0.201', 'weapon5': '0.240', 'weapon2': '0.248', 'weapon4': '0.338', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '68.000'} [2024-08-06 08:09:29,596][52664] DAMAGECOUNT value on done: 995102.0 [2024-08-06 08:09:29,597][52664] Sum rewards: 73.012, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.132', 'AMMO4': '0.150', 'AMMO3': '0.207', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '59.000'} [2024-08-06 08:09:29,665][52671] DAMAGECOUNT value on done: 948590.0 [2024-08-06 08:09:29,665][52671] Sum rewards: 75.087, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.181', 'weapon2': '0.364', 'WEAPON3': '1.050', 'HITCOUNT': '3.360', 'weapon3': '3.410', 'DAMAGECOUNT': '17.493', 'FRAGCOUNT': '60.000'} [2024-08-06 08:09:31,332][52658] DAMAGECOUNT value on done: 949793.0 [2024-08-06 08:09:31,333][52658] Sum rewards: 71.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.262', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.160', 'AMMO3': '0.192', 'weapon4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.250', 'weapon3': '2.936', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '59.000'} [2024-08-06 08:09:31,439][52811] DAMAGECOUNT value on done: 887977.0 [2024-08-06 08:09:31,442][52811] Sum rewards: 76.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.000', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.116', 'weapon4': '0.148', 'AMMO3': '0.179', 'AMMO4': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.234', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '61.000'} [2024-08-06 08:09:31,661][52669] DAMAGECOUNT value on done: 955968.0 [2024-08-06 08:09:31,662][52669] Sum rewards: 88.826, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.962', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.018', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.484', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.870', 'FRAGCOUNT': '73.000'} [2024-08-06 08:09:31,801][52663] DAMAGECOUNT value on done: 945815.0 [2024-08-06 08:09:31,804][52663] Sum rewards: 80.261, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.180', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.098', 'AMMO3': '0.193', 'weapon5': '0.226', 'AMMO4': '0.246', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.912', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:32,079][52664] DAMAGECOUNT value on done: 990518.0 [2024-08-06 08:09:32,079][52664] Sum rewards: 80.697, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.588', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.208', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.338', 'FRAGCOUNT': '68.500'} [2024-08-06 08:09:32,160][52794] DAMAGECOUNT value on done: 949701.0 [2024-08-06 08:09:32,161][52794] Sum rewards: 76.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.484', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.151', 'weapon2': '0.170', 'AMMO3': '0.212', 'WEAPON3': '1.250', 'HITCOUNT': '3.510', 'weapon3': '3.602', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:32,190][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:09:32,374][52671] DAMAGECOUNT value on done: 953548.0 [2024-08-06 08:09:32,374][52671] Sum rewards: 67.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.355', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.396', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.386', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '57.000'} [2024-08-06 08:09:32,383][52650] Updated weights for policy 0, policy_version 82011 (0.0011) [2024-08-06 08:09:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 671834112. Throughput: 0: 4396.0. Samples: 167959110. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:09:32,794][52567] Avg episode reward: [(0, '75.786')] [2024-08-06 08:09:34,233][52658] DAMAGECOUNT value on done: 932212.0 [2024-08-06 08:09:34,233][52658] Sum rewards: 74.541, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.176', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon5': '0.064', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.660', 'WEAPON3': '1.050', 'weapon3': '2.984', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '60.000'} [2024-08-06 08:09:34,419][52669] DAMAGECOUNT value on done: 954360.0 [2024-08-06 08:09:34,419][52669] Sum rewards: 73.931, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.614', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.026', 'AMMO4': '0.086', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '60.000'} [2024-08-06 08:09:34,420][52811] DAMAGECOUNT value on done: 873811.0 [2024-08-06 08:09:34,421][52811] Sum rewards: 69.897, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.204', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.074', 'weapon5': '0.100', 'AMMO3': '0.149', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '0.950', 'HITCOUNT': '3.320', 'weapon3': '3.420', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '55.500'} [2024-08-06 08:09:34,612][52663] DAMAGECOUNT value on done: 945275.0 [2024-08-06 08:09:34,616][52663] Sum rewards: 80.335, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.086', 'AMMO4': '0.119', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.234', 'WEAPON3': '1.100', 'weapon3': '3.356', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:34,733][52664] DAMAGECOUNT value on done: 989887.0 [2024-08-06 08:09:34,733][52664] Sum rewards: 74.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.468', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.050', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.227', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.576', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:35,068][52671] DAMAGECOUNT value on done: 935926.0 [2024-08-06 08:09:35,070][52671] Sum rewards: 76.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.675', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.202', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.406', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:35,211][52794] DAMAGECOUNT value on done: 954129.0 [2024-08-06 08:09:35,213][52794] Sum rewards: 79.549, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.630', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.090', 'WEAPON4': '0.100', 'weapon4': '0.138', 'AMMO3': '0.142', 'WEAPON5': '0.200', 'weapon2': '0.748', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '62.000'} [2024-08-06 08:09:36,435][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:09:36,767][52658] DAMAGECOUNT value on done: 948240.0 [2024-08-06 08:09:36,768][52658] Sum rewards: 77.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.094', 'weapon5': '0.094', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.269', 'weapon2': '0.518', 'WEAPON3': '1.600', 'weapon3': '3.062', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '66.000'} [2024-08-06 08:09:36,992][52664] DAMAGECOUNT value on done: 971732.0 [2024-08-06 08:09:36,992][52664] Sum rewards: 80.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.135', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.088', 'AMMO3': '0.200', 'weapon5': '0.214', 'AMMO4': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.024', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '65.000'} [2024-08-06 08:09:37,166][52650] Updated weights for policy 0, policy_version 82021 (0.0010) [2024-08-06 08:09:37,339][52811] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:09:37,706][52811] DAMAGECOUNT value on done: 882644.0 [2024-08-06 08:09:37,707][52811] Sum rewards: 73.696, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.575', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon4': '0.178', 'weapon2': '0.208', 'weapon5': '0.278', 'AMMO3': '0.285', 'AMMO4': '0.304', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'weapon3': '3.006', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 671932416. Throughput: 0: 4398.7. Samples: 167985680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:09:37,794][52567] Avg episode reward: [(0, '75.688')] [2024-08-06 08:09:37,797][52669] DAMAGECOUNT value on done: 941282.0 [2024-08-06 08:09:37,797][52669] Sum rewards: 77.460, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.265', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.064', 'AMMO4': '0.105', 'weapon5': '0.130', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:37,924][52663] DAMAGECOUNT value on done: 952894.0 [2024-08-06 08:09:37,926][52663] Sum rewards: 70.051, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.060', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.128', 'weapon5': '0.200', 'AMMO3': '0.253', 'AMMO4': '0.264', 'weapon2': '0.404', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.956', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '61.000'} [2024-08-06 08:09:37,976][52671] DAMAGECOUNT value on done: 950557.0 [2024-08-06 08:09:37,978][52671] Sum rewards: 79.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.538', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'AMMO3': '0.174', 'weapon5': '0.178', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.342', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.838', 'FRAGCOUNT': '65.000'} [2024-08-06 08:09:38,146][52794] DAMAGECOUNT value on done: 940202.0 [2024-08-06 08:09:38,148][52794] Sum rewards: 88.894, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.127', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '73.000'} [2024-08-06 08:09:38,791][52669] Large shaping reward 2.624 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.594, 198.0)] [2024-08-06 08:09:39,282][52664] DAMAGECOUNT value on done: 975676.0 [2024-08-06 08:09:39,282][52664] Sum rewards: 82.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.404', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.054', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.414', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '67.000'} [2024-08-06 08:09:39,838][52658] DAMAGECOUNT value on done: 943060.0 [2024-08-06 08:09:39,841][52658] Sum rewards: 76.008, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.053', 'weapon4': '0.074', 'weapon5': '0.126', 'AMMO3': '0.188', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:40,349][52811] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:09:40,655][52671] DAMAGECOUNT value on done: 947695.0 [2024-08-06 08:09:40,655][52671] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.100', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.200', 'AMMO4': '0.202', 'weapon4': '0.220', 'weapon2': '0.294', 'WEAPON5': '0.300', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '62.500'} [2024-08-06 08:09:40,794][52669] DAMAGECOUNT value on done: 940615.0 [2024-08-06 08:09:40,796][52669] Sum rewards: 88.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.867', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.066', 'weapon5': '0.088', 'AMMO4': '0.159', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.096', 'FRAGCOUNT': '71.000'} [2024-08-06 08:09:40,874][52811] DAMAGECOUNT value on done: 882595.0 [2024-08-06 08:09:40,875][52811] Sum rewards: 68.974, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.379', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon5': '0.110', 'AMMO3': '0.118', 'weapon4': '0.134', 'AMMO4': '0.136', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.554', 'WEAPON3': '0.700', 'weapon3': '2.998', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '53.000'} [2024-08-06 08:09:41,033][52663] DAMAGECOUNT value on done: 943895.0 [2024-08-06 08:09:41,034][52663] Sum rewards: 76.840, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.088', 'weapon4': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:41,141][52794] DAMAGECOUNT value on done: 934218.0 [2024-08-06 08:09:41,141][52794] Sum rewards: 86.062, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.125', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO3': '0.235', 'AMMO4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.120', 'FRAGCOUNT': '71.000'} [2024-08-06 08:09:41,492][52650] Updated weights for policy 0, policy_version 82031 (0.0013) [2024-08-06 08:09:42,265][52664] DAMAGECOUNT value on done: 985808.0 [2024-08-06 08:09:42,265][52664] Sum rewards: 74.777, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.365', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.026', 'weapon4': '0.028', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'weapon2': '0.422', 'WEAPON3': '1.600', 'weapon3': '3.278', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '65.000'} [2024-08-06 08:09:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 672006144. Throughput: 0: 4397.6. Samples: 168012150. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:09:42,794][52567] Avg episode reward: [(0, '76.129')] [2024-08-06 08:09:42,865][52658] DAMAGECOUNT value on done: 938458.0 [2024-08-06 08:09:42,869][52658] Sum rewards: 87.744, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.470', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'AMMO4': '0.094', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '70.000'} [2024-08-06 08:09:43,227][52671] DAMAGECOUNT value on done: 948764.0 [2024-08-06 08:09:43,228][52671] Sum rewards: 73.901, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.710', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.152', 'AMMO3': '0.176', 'AMMO4': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.350', 'weapon3': '3.240', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '61.000'} [2024-08-06 08:09:43,940][52669] DAMAGECOUNT value on done: 950100.0 [2024-08-06 08:09:43,940][52669] Sum rewards: 79.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.167', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.150', 'weapon5': '0.216', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.616', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.748', 'FRAGCOUNT': '64.000'} [2024-08-06 08:09:43,986][52811] DAMAGECOUNT value on done: 886957.0 [2024-08-06 08:09:43,987][52811] Sum rewards: 64.070, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.098', 'AMMO4': '0.103', 'weapon5': '0.138', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.170', 'FRAGCOUNT': '54.000'} [2024-08-06 08:09:44,076][52663] DAMAGECOUNT value on done: 927444.0 [2024-08-06 08:09:44,076][52663] Sum rewards: 70.161, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.222', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.019', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.192', 'weapon2': '0.576', 'WEAPON3': '1.050', 'weapon3': '3.220', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '57.000'} [2024-08-06 08:09:44,511][52794] DAMAGECOUNT value on done: 939351.0 [2024-08-06 08:09:44,514][52794] Sum rewards: 67.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.998', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.238', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '57.000'} [2024-08-06 08:09:45,100][52664] DAMAGECOUNT value on done: 972600.0 [2024-08-06 08:09:45,102][52664] Sum rewards: 90.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.144', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.123', 'weapon4': '0.148', 'weapon2': '0.202', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.822', 'FRAGCOUNT': '74.000'} [2024-08-06 08:09:45,873][52658] DAMAGECOUNT value on done: 947172.0 [2024-08-06 08:09:45,873][52658] Sum rewards: 80.906, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.671', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.426', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '68.000'} [2024-08-06 08:09:46,226][52671] DAMAGECOUNT value on done: 949481.0 [2024-08-06 08:09:46,226][52671] Sum rewards: 73.645, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.640', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon4': '0.166', 'AMMO3': '0.196', 'AMMO4': '0.242', 'weapon5': '0.274', 'weapon2': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.856', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '58.000'} [2024-08-06 08:09:46,365][52650] Updated weights for policy 0, policy_version 82041 (0.0019) [2024-08-06 08:09:46,582][52669] DAMAGECOUNT value on done: 969900.0 [2024-08-06 08:09:46,583][52669] Sum rewards: 74.676, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.880', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.084', 'AMMO4': '0.146', 'weapon2': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.424', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '65.000'} [2024-08-06 08:09:46,699][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:09:46,792][52663] DAMAGECOUNT value on done: 942263.0 [2024-08-06 08:09:46,793][52663] Sum rewards: 67.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.650', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.191', 'AMMO4': '0.274', 'weapon4': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon5': '0.332', 'WEAPON3': '1.150', 'weapon3': '2.770', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '54.500'} [2024-08-06 08:09:46,904][52811] DAMAGECOUNT value on done: 893615.0 [2024-08-06 08:09:46,906][52811] Sum rewards: 73.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.240', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.238', 'AMMO3': '0.242', 'WEAPON3': '1.600', 'HITCOUNT': '3.300', 'weapon3': '3.352', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:47,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 672104448. Throughput: 0: 4399.8. Samples: 168025300. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:09:47,794][52567] Avg episode reward: [(0, '75.495')] [2024-08-06 08:09:47,937][52794] DAMAGECOUNT value on done: 945040.0 [2024-08-06 08:09:47,939][52794] Sum rewards: 75.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.375', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.062', 'AMMO4': '0.137', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.386', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '61.000'} [2024-08-06 08:09:48,999][52671] DAMAGECOUNT value on done: 949848.0 [2024-08-06 08:09:48,999][52671] Sum rewards: 88.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.429', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.117', 'weapon5': '0.184', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '71.000'} [2024-08-06 08:09:49,709][52669] DAMAGECOUNT value on done: 956651.0 [2024-08-06 08:09:49,709][52669] Sum rewards: 73.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.012', 'weapon5': '0.020', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.235', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '62.000'} [2024-08-06 08:09:49,956][52663] DAMAGECOUNT value on done: 940895.0 [2024-08-06 08:09:49,956][52663] Sum rewards: 74.040, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.182', 'weapon4': '0.192', 'AMMO4': '0.194', 'AMMO3': '0.246', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '63.000'} [2024-08-06 08:09:50,051][52811] DAMAGECOUNT value on done: 883237.0 [2024-08-06 08:09:50,052][52811] Sum rewards: 82.969, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.022', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.050', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '67.000'} [2024-08-06 08:09:50,603][52794] DAMAGECOUNT value on done: 933204.0 [2024-08-06 08:09:50,605][52794] Sum rewards: 71.523, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.625', 'AMMO5': '0.017', 'AMMO2': '0.051', 'AMMO3': '0.244', 'AMMO4': '0.257', 'weapon5': '0.264', 'weapon4': '0.270', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '61.000'} [2024-08-06 08:09:50,771][52650] Updated weights for policy 0, policy_version 82051 (0.0032) [2024-08-06 08:09:52,037][52671] DAMAGECOUNT value on done: 933298.0 [2024-08-06 08:09:52,037][52671] Sum rewards: 71.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.800', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.100', 'weapon5': '0.118', 'AMMO4': '0.188', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.624', 'WEAPON3': '1.400', 'weapon3': '2.922', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '59.000'} [2024-08-06 08:09:52,711][52669] DAMAGECOUNT value on done: 954048.0 [2024-08-06 08:09:52,711][52669] Sum rewards: 82.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.090', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon5': '0.120', 'weapon4': '0.196', 'AMMO3': '0.218', 'AMMO4': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '68.000'} [2024-08-06 08:09:52,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17749.3, 300 sec: 17522.5). Total num frames: 672194560. Throughput: 0: 4386.9. Samples: 168051420. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:09:52,794][52567] Avg episode reward: [(0, '75.462')] [2024-08-06 08:09:52,881][52663] DAMAGECOUNT value on done: 949719.0 [2024-08-06 08:09:52,885][52663] Sum rewards: 63.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.012', 'AMMO4': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.766', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.312', 'FRAGCOUNT': '52.000'} [2024-08-06 08:09:53,084][52794] DAMAGECOUNT value on done: 947103.0 [2024-08-06 08:09:53,087][52794] Sum rewards: 69.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.596', 'AMMO5': '0.014', 'AMMO2': '0.026', 'weapon4': '0.052', 'AMMO4': '0.128', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon5': '0.292', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 08:09:53,230][52811] DAMAGECOUNT value on done: 882264.0 [2024-08-06 08:09:53,231][52811] Sum rewards: 85.261, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.120', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.280', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.060', 'FRAGCOUNT': '69.500'} [2024-08-06 08:09:55,098][52669] DAMAGECOUNT value on done: 959468.0 [2024-08-06 08:09:55,098][52669] Sum rewards: 84.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.357', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.595', 'FRAGCOUNT': '68.000'} [2024-08-06 08:09:55,197][52671] DAMAGECOUNT value on done: 959450.0 [2024-08-06 08:09:55,198][52671] Sum rewards: 87.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.231', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.136', 'AMMO3': '0.227', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '72.000'} [2024-08-06 08:09:55,241][52663] DAMAGECOUNT value on done: 933411.0 [2024-08-06 08:09:55,242][52663] Sum rewards: 74.459, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.800', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.118', 'AMMO3': '0.179', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.409', 'FRAGCOUNT': '60.000'} [2024-08-06 08:09:55,545][52794] DAMAGECOUNT value on done: 942755.0 [2024-08-06 08:09:55,545][52794] Sum rewards: 88.572, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.928', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.034', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.212', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.482', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '73.000'} [2024-08-06 08:09:55,711][52650] Updated weights for policy 0, policy_version 82061 (0.0020) [2024-08-06 08:09:56,372][52811] DAMAGECOUNT value on done: 883099.0 [2024-08-06 08:09:56,372][52811] Sum rewards: 72.356, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.070', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.273', 'WEAPON3': '1.600', 'weapon3': '3.454', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '62.000'} [2024-08-06 08:09:57,774][52669] DAMAGECOUNT value on done: 960119.0 [2024-08-06 08:09:57,783][52669] Sum rewards: 70.431, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.416', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.098', 'weapon5': '0.178', 'AMMO4': '0.226', 'AMMO3': '0.268', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '60.000'} [2024-08-06 08:09:57,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 672276480. Throughput: 0: 4386.4. Samples: 168077860. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:09:57,795][52567] Avg episode reward: [(0, '75.768')] [2024-08-06 08:09:57,853][52663] DAMAGECOUNT value on done: 929492.0 [2024-08-06 08:09:57,853][52663] Sum rewards: 60.832, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.394', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.116', 'AMMO4': '0.142', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '49.000'} [2024-08-06 08:09:58,045][52671] DAMAGECOUNT value on done: 956808.0 [2024-08-06 08:09:58,045][52671] Sum rewards: 81.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.160', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.084', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '66.000'} [2024-08-06 08:09:58,570][52794] DAMAGECOUNT value on done: 934675.0 [2024-08-06 08:09:58,570][52794] Sum rewards: 71.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.165', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.094', 'AMMO3': '0.209', 'weapon2': '0.210', 'weapon5': '0.234', 'AMMO4': '0.247', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'HITCOUNT': '3.170', 'weapon3': '3.182', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '60.000'} [2024-08-06 08:09:59,298][52811] DAMAGECOUNT value on done: 881390.0 [2024-08-06 08:09:59,299][52811] Sum rewards: 67.796, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.108', 'weapon5': '0.126', 'AMMO3': '0.165', 'AMMO4': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.116', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '54.000'} [2024-08-06 08:10:00,528][52650] Updated weights for policy 0, policy_version 82071 (0.0022) [2024-08-06 08:10:00,699][52663] DAMAGECOUNT value on done: 938877.0 [2024-08-06 08:10:00,700][52663] Sum rewards: 73.651, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.408', 'AMMO5': '0.011', 'AMMO2': '0.045', 'AMMO3': '0.165', 'weapon5': '0.188', 'AMMO4': '0.225', 'weapon4': '0.230', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.026', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '58.000'} [2024-08-06 08:10:01,216][52671] DAMAGECOUNT value on done: 950659.0 [2024-08-06 08:10:01,217][52671] Sum rewards: 76.399, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.320', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.310', 'WEAPON3': '1.250', 'HITCOUNT': '3.320', 'weapon3': '3.482', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:01,560][52794] DAMAGECOUNT value on done: 949815.0 [2024-08-06 08:10:01,561][52794] Sum rewards: 90.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.598', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.104', 'AMMO4': '0.161', 'weapon5': '0.170', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.870', 'FRAGCOUNT': '73.000'} [2024-08-06 08:10:02,473][52811] DAMAGECOUNT value on done: 889336.0 [2024-08-06 08:10:02,475][52811] Sum rewards: 59.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.016', 'AMMO2': '0.033', 'AMMO3': '0.160', 'AMMO4': '0.167', 'weapon5': '0.192', 'weapon2': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.418', 'WEAPON3': '1.050', 'weapon3': '2.764', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '49.500'} [2024-08-06 08:10:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 672366592. Throughput: 0: 4385.3. Samples: 168090940. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:10:02,802][52567] Avg episode reward: [(0, '75.648')] [2024-08-06 08:10:03,617][52663] DAMAGECOUNT value on done: 941746.0 [2024-08-06 08:10:03,617][52663] Sum rewards: 77.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.028', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.074', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'weapon4': '0.354', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:04,186][52671] DAMAGECOUNT value on done: 955408.0 [2024-08-06 08:10:04,187][52671] Sum rewards: 69.887, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.102', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.398', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.142', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:04,265][52794] DAMAGECOUNT value on done: 942693.0 [2024-08-06 08:10:04,267][52794] Sum rewards: 85.694, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.215', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.046', 'weapon5': '0.140', 'AMMO4': '0.219', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.550', 'weapon3': '3.274', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '72.000'} [2024-08-06 08:10:05,004][52650] Updated weights for policy 0, policy_version 82081 (0.0033) [2024-08-06 08:10:05,056][52670] DAMAGECOUNT value on done: 929594.0 [2024-08-06 08:10:05,056][52670] Sum rewards: 81.708, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.206', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.052', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.132', 'weapon2': '0.458', 'WEAPON3': '0.850', 'weapon3': '3.276', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '64.000'} [2024-08-06 08:10:05,561][52811] DAMAGECOUNT value on done: 893909.0 [2024-08-06 08:10:05,561][52811] Sum rewards: 81.168, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.760', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.030', 'WEAPON5': '0.050', 'weapon2': '0.196', 'AMMO3': '0.208', 'WEAPON3': '1.400', 'weapon3': '3.654', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:06,184][52663] DAMAGECOUNT value on done: 944947.0 [2024-08-06 08:10:06,186][52663] Sum rewards: 67.272, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.042', 'weapon5': '0.094', 'AMMO4': '0.195', 'weapon2': '0.206', 'AMMO3': '0.228', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.310', 'weapon3': '3.454', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:07,295][52671] DAMAGECOUNT value on done: 938762.0 [2024-08-06 08:10:07,297][52671] Sum rewards: 80.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.296', 'AMMO5': '0.024', 'AMMO2': '0.054', 'weapon4': '0.140', 'AMMO3': '0.221', 'weapon5': '0.258', 'AMMO4': '0.269', 'weapon2': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:07,429][52794] DAMAGECOUNT value on done: 954646.0 [2024-08-06 08:10:07,435][52794] Sum rewards: 86.519, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.944', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.102', 'AMMO4': '0.127', 'weapon2': '0.200', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.452', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.687', 'FRAGCOUNT': '70.000'} [2024-08-06 08:10:07,546][52670] DAMAGECOUNT value on done: 948737.0 [2024-08-06 08:10:07,548][52670] Sum rewards: 77.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.041', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.211', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.410', 'weapon3': '3.458', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 672448512. Throughput: 0: 4381.1. Samples: 168116810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:10:07,802][52567] Avg episode reward: [(0, '76.421')] [2024-08-06 08:10:08,637][52811] DAMAGECOUNT value on done: 879615.0 [2024-08-06 08:10:08,638][52811] Sum rewards: 78.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.160', 'AMMO3': '0.212', 'AMMO4': '0.222', 'weapon5': '0.252', 'weapon2': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.034', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:09,210][52663] DAMAGECOUNT value on done: 943080.0 [2024-08-06 08:10:09,210][52663] Sum rewards: 76.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.655', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.135', 'weapon5': '0.178', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '62.500'} [2024-08-06 08:10:09,627][52650] Updated weights for policy 0, policy_version 82091 (0.0011) [2024-08-06 08:10:10,167][52794] DAMAGECOUNT value on done: 936526.0 [2024-08-06 08:10:10,167][52794] Sum rewards: 77.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.100', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.062', 'AMMO4': '0.161', 'weapon5': '0.166', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:10,782][52670] DAMAGECOUNT value on done: 930958.0 [2024-08-06 08:10:10,785][52670] Sum rewards: 68.242, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.366', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.116', 'AMMO4': '0.170', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:11,635][52811] DAMAGECOUNT value on done: 880102.0 [2024-08-06 08:10:11,635][52811] Sum rewards: 84.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.386', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.240', 'weapon4': '0.246', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '68.000'} [2024-08-06 08:10:12,318][52663] DAMAGECOUNT value on done: 949281.0 [2024-08-06 08:10:12,320][52663] Sum rewards: 77.041, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.517', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.102', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.208', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '64.000'} [2024-08-06 08:10:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 672538624. Throughput: 0: 4384.9. Samples: 168143170. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:10:12,802][52567] Avg episode reward: [(0, '76.688')] [2024-08-06 08:10:12,957][52666] DAMAGECOUNT value on done: 943892.0 [2024-08-06 08:10:12,959][52666] Sum rewards: 84.783, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.770', 'AMMO2': '0.007', 'AMMO5': '0.010', 'AMMO4': '0.035', 'WEAPON4': '0.100', 'weapon4': '0.136', 'AMMO3': '0.155', 'weapon5': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.620', 'WEAPON3': '1.100', 'weapon3': '2.834', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:13,010][52794] DAMAGECOUNT value on done: 947984.0 [2024-08-06 08:10:13,013][52794] Sum rewards: 69.325, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.262', 'ARMOR': '0.004', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon4': '0.146', 'AMMO3': '0.217', 'weapon2': '0.226', 'weapon5': '0.294', 'AMMO4': '0.343', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '58.000'} [2024-08-06 08:10:13,572][52670] DAMAGECOUNT value on done: 934342.0 [2024-08-06 08:10:13,574][52670] Sum rewards: 88.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.676', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon4': '0.090', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.197', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '71.000'} [2024-08-06 08:10:14,356][52650] Updated weights for policy 0, policy_version 82101 (0.0017) [2024-08-06 08:10:15,134][52668] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:10:15,330][52663] DAMAGECOUNT value on done: 954477.0 [2024-08-06 08:10:15,331][52663] Sum rewards: 78.818, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.923', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.122', 'AMMO3': '0.174', 'AMMO4': '0.219', 'weapon5': '0.304', 'WEAPON4': '0.450', 'weapon2': '0.484', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:15,928][52803] DAMAGECOUNT value on done: 877461.0 [2024-08-06 08:10:15,930][52803] Sum rewards: 66.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.226', 'weapon2': '0.242', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.526', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '56.000'} [2024-08-06 08:10:15,962][52794] DAMAGECOUNT value on done: 944594.0 [2024-08-06 08:10:15,962][52794] Sum rewards: 70.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.887', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.148', 'AMMO4': '0.175', 'AMMO3': '0.249', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '60.000'} [2024-08-06 08:10:16,114][52666] DAMAGECOUNT value on done: 940998.0 [2024-08-06 08:10:16,114][52666] Sum rewards: 71.092, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.524', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.124', 'weapon5': '0.204', 'AMMO4': '0.230', 'AMMO3': '0.248', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:16,367][52666] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('HEALTH', -0.033, -11.0), ('weapon5', 0.002)] [2024-08-06 08:10:17,049][52670] DAMAGECOUNT value on done: 945479.0 [2024-08-06 08:10:17,049][52670] Sum rewards: 63.421, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.403', 'AMMO5': '0.013', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.103', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.320', 'WEAPON3': '1.850', 'weapon3': '3.310', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 672628736. Throughput: 0: 4381.8. Samples: 168156290. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:10:17,794][52567] Avg episode reward: [(0, '76.465')] [2024-08-06 08:10:18,379][52663] DAMAGECOUNT value on done: 933900.0 [2024-08-06 08:10:18,379][52663] Sum rewards: 75.914, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.266', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.150', 'weapon4': '0.152', 'weapon5': '0.188', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:19,048][52803] DAMAGECOUNT value on done: 876549.0 [2024-08-06 08:10:19,049][52803] Sum rewards: 65.588, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.030', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.245', 'AMMO3': '0.289', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.092', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.485', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:19,152][52794] DAMAGECOUNT value on done: 951369.0 [2024-08-06 08:10:19,154][52794] Sum rewards: 81.921, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.139', 'weapon5': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.324', 'weapon2': '0.372', 'weapon4': '0.432', 'WEAPON3': '0.850', 'weapon3': '2.780', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:19,203][52666] DAMAGECOUNT value on done: 946351.0 [2024-08-06 08:10:19,203][52666] Sum rewards: 67.387, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.011', 'AMMO2': '0.040', 'AMMO3': '0.185', 'weapon5': '0.190', 'AMMO4': '0.201', 'weapon4': '0.208', 'weapon2': '0.244', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.777', 'FRAGCOUNT': '54.000'} [2024-08-06 08:10:19,403][52650] Updated weights for policy 0, policy_version 82111 (0.0021) [2024-08-06 08:10:19,855][52670] DAMAGECOUNT value on done: 932473.0 [2024-08-06 08:10:19,856][52670] Sum rewards: 75.132, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.225', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:21,679][52666] DAMAGECOUNT value on done: 941255.0 [2024-08-06 08:10:21,681][52666] Sum rewards: 76.483, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.680', 'weapon5': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.036', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.110', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:22,352][52803] DAMAGECOUNT value on done: 883383.0 [2024-08-06 08:10:22,352][52803] Sum rewards: 55.496, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.440', 'AMMO5': '0.023', 'AMMO2': '0.087', 'weapon4': '0.266', 'weapon5': '0.276', 'AMMO3': '0.295', 'weapon2': '0.424', 'AMMO4': '0.435', 'WEAPON5': '0.650', 'WEAPON4': '0.800', 'WEAPON3': '1.700', 'weapon3': '2.586', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '16.194', 'FRAGCOUNT': '51.000'} [2024-08-06 08:10:22,369][52794] DAMAGECOUNT value on done: 960325.0 [2024-08-06 08:10:22,369][52794] Sum rewards: 76.360, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.294', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.044', 'weapon4': '0.054', 'WEAPON5': '0.100', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.850', 'weapon3': '3.436', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:22,461][52670] DAMAGECOUNT value on done: 931358.0 [2024-08-06 08:10:22,462][52670] Sum rewards: 75.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.935', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.140', 'weapon4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:22,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17522.5). Total num frames: 672718848. Throughput: 0: 4375.1. Samples: 168182560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:10:22,795][52567] Avg episode reward: [(0, '76.035')] [2024-08-06 08:10:23,690][52650] Updated weights for policy 0, policy_version 82121 (0.0012) [2024-08-06 08:10:24,743][52666] DAMAGECOUNT value on done: 934748.0 [2024-08-06 08:10:24,747][52666] Sum rewards: 80.708, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.096', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.024', 'AMMO4': '0.059', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.606', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:24,812][52794] DAMAGECOUNT value on done: 947146.0 [2024-08-06 08:10:24,812][52794] Sum rewards: 69.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.680', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon4': '0.112', 'weapon5': '0.148', 'AMMO3': '0.206', 'AMMO4': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '58.000'} [2024-08-06 08:10:25,372][52803] DAMAGECOUNT value on done: 879998.0 [2024-08-06 08:10:25,372][52803] Sum rewards: 72.851, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.402', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.102', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.316', 'WEAPON3': '1.050', 'HITCOUNT': '3.280', 'weapon3': '3.310', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '58.000'} [2024-08-06 08:10:25,583][52670] DAMAGECOUNT value on done: 932442.0 [2024-08-06 08:10:25,584][52670] Sum rewards: 71.575, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.385', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.060', 'weapon5': '0.062', 'AMMO4': '0.109', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.272', 'weapon2': '0.386', 'WEAPON3': '1.600', 'weapon3': '3.212', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:26,222][52668] DAMAGECOUNT value on done: 953849.0 [2024-08-06 08:10:26,222][52668] Sum rewards: 81.604, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.725', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.102', 'weapon5': '0.134', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.736', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:27,590][52666] DAMAGECOUNT value on done: 938867.0 [2024-08-06 08:10:27,590][52666] Sum rewards: 66.352, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.190', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon4': '0.162', 'AMMO3': '0.239', 'weapon5': '0.244', 'AMMO4': '0.314', 'weapon2': '0.376', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.848', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '60.000'} [2024-08-06 08:10:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 672800768. Throughput: 0: 4369.1. Samples: 168208760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:10:27,794][52567] Avg episode reward: [(0, '75.811')] [2024-08-06 08:10:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082129_672800768.pth... [2024-08-06 08:10:27,949][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081617_668606464.pth [2024-08-06 08:10:28,201][52670] DAMAGECOUNT value on done: 932784.0 [2024-08-06 08:10:28,201][52670] Sum rewards: 84.826, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.170', 'weapon2': '0.206', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.314', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '68.000'} [2024-08-06 08:10:28,221][52665] DAMAGECOUNT value on done: 931590.0 [2024-08-06 08:10:28,221][52665] Sum rewards: 63.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.743', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.150', 'AMMO3': '0.184', 'AMMO4': '0.245', 'weapon5': '0.266', 'weapon2': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.906', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '51.000'} [2024-08-06 08:10:28,447][52650] Updated weights for policy 0, policy_version 82131 (0.0012) [2024-08-06 08:10:28,585][52803] DAMAGECOUNT value on done: 878371.0 [2024-08-06 08:10:28,585][52803] Sum rewards: 72.869, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.240', 'weapon2': '0.822', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 08:10:29,311][52668] DAMAGECOUNT value on done: 952758.0 [2024-08-06 08:10:29,312][52668] Sum rewards: 73.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.985', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.066', 'weapon5': '0.182', 'AMMO3': '0.201', 'AMMO4': '0.234', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.890', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:29,996][52666] DAMAGECOUNT value on done: 938217.0 [2024-08-06 08:10:29,996][52666] Sum rewards: 82.614, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.155', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.069', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.538', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '68.000'} [2024-08-06 08:10:30,582][52670] DAMAGECOUNT value on done: 929722.0 [2024-08-06 08:10:30,583][52670] Sum rewards: 83.883, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.811', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.074', 'weapon5': '0.198', 'AMMO4': '0.207', 'AMMO3': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '70.000'} [2024-08-06 08:10:31,102][52665] DAMAGECOUNT value on done: 943330.0 [2024-08-06 08:10:31,102][52665] Sum rewards: 75.286, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON3': '1.350', 'weapon3': '3.212', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:31,680][52803] DAMAGECOUNT value on done: 878217.0 [2024-08-06 08:10:31,682][52803] Sum rewards: 87.663, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.442', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.052', 'AMMO4': '0.106', 'weapon5': '0.132', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.000', 'weapon3': '3.232', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '69.000'} [2024-08-06 08:10:32,329][52666] DAMAGECOUNT value on done: 934078.0 [2024-08-06 08:10:32,329][52666] Sum rewards: 70.413, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.380', 'AMMO5': '0.024', 'AMMO2': '0.059', 'weapon4': '0.176', 'AMMO3': '0.257', 'AMMO4': '0.293', 'weapon5': '0.318', 'weapon2': '0.380', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.682', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '59.500'} [2024-08-06 08:10:32,380][52668] DAMAGECOUNT value on done: 949109.0 [2024-08-06 08:10:32,381][52668] Sum rewards: 83.569, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.925', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.098', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.250', 'weapon3': '3.228', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:32,794][52567] Fps is (10 sec: 17203.9, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 672890880. Throughput: 0: 4364.0. Samples: 168221680. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:10:32,794][52567] Avg episode reward: [(0, '76.051')] [2024-08-06 08:10:33,021][52650] Updated weights for policy 0, policy_version 82141 (0.0020) [2024-08-06 08:10:33,135][52670] DAMAGECOUNT value on done: 943748.0 [2024-08-06 08:10:33,135][52670] Sum rewards: 73.315, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.392', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.064', 'weapon4': '0.098', 'AMMO4': '0.199', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:33,827][52665] DAMAGECOUNT value on done: 936966.0 [2024-08-06 08:10:33,827][52665] Sum rewards: 63.047, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.140', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.106', 'AMMO3': '0.244', 'AMMO4': '0.281', 'weapon5': '0.324', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '2.762', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '53.000'} [2024-08-06 08:10:34,861][52803] DAMAGECOUNT value on done: 875737.0 [2024-08-06 08:10:34,861][52803] Sum rewards: 70.400, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.030', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.140', 'AMMO4': '0.166', 'weapon4': '0.240', 'AMMO3': '0.244', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.054', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 08:10:35,446][52666] DAMAGECOUNT value on done: 944439.0 [2024-08-06 08:10:35,448][52666] Sum rewards: 79.848, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.232', 'WEAPON3': '1.300', 'weapon3': '3.536', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:35,467][52668] DAMAGECOUNT value on done: 952950.0 [2024-08-06 08:10:35,468][52668] Sum rewards: 70.624, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.130', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.072', 'weapon5': '0.220', 'AMMO4': '0.238', 'AMMO3': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.482', 'WEAPON3': '1.650', 'weapon3': '2.908', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:36,030][52670] DAMAGECOUNT value on done: 926275.0 [2024-08-06 08:10:36,032][52670] Sum rewards: 68.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon5': '0.050', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.220', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.324', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '56.000'} [2024-08-06 08:10:36,515][52665] DAMAGECOUNT value on done: 939485.0 [2024-08-06 08:10:36,515][52665] Sum rewards: 66.739, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.508', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.142', 'AMMO3': '0.171', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.734', 'WEAPON3': '1.050', 'weapon3': '2.722', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '53.000'} [2024-08-06 08:10:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 672972800. Throughput: 0: 4370.9. Samples: 168248110. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:10:37,794][52567] Avg episode reward: [(0, '75.504')] [2024-08-06 08:10:37,919][52650] Updated weights for policy 0, policy_version 82151 (0.0022) [2024-08-06 08:10:38,070][52614] Signal inference workers to stop experience collection... (15050 times) [2024-08-06 08:10:38,071][52614] Signal inference workers to resume experience collection... (15050 times) [2024-08-06 08:10:38,124][52803] DAMAGECOUNT value on done: 874621.0 [2024-08-06 08:10:38,133][52803] Sum rewards: 86.241, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.798', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.094', 'weapon4': '0.104', 'AMMO4': '0.111', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '71.000'} [2024-08-06 08:10:38,132][52650] InferenceWorker_p0-w0: stopping experience collection (15050 times) [2024-08-06 08:10:38,145][52650] InferenceWorker_p0-w0: resuming experience collection (15050 times) [2024-08-06 08:10:38,239][52668] DAMAGECOUNT value on done: 937819.0 [2024-08-06 08:10:38,240][52668] Sum rewards: 57.033, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.574', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.131', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.756', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '14.079', 'FRAGCOUNT': '47.000'} [2024-08-06 08:10:38,431][52666] DAMAGECOUNT value on done: 936923.0 [2024-08-06 08:10:38,431][52666] Sum rewards: 72.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.478', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon5': '0.172', 'AMMO3': '0.214', 'weapon4': '0.226', 'AMMO4': '0.277', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '60.000'} [2024-08-06 08:10:38,813][52649] DAMAGECOUNT value on done: 915639.0 [2024-08-06 08:10:38,813][52649] Sum rewards: 88.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.507', 'AMMO5': '0.018', 'AMMO2': '0.056', 'AMMO3': '0.169', 'weapon4': '0.182', 'weapon5': '0.224', 'weapon2': '0.264', 'AMMO4': '0.279', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.088', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '71.000'} [2024-08-06 08:10:39,245][52670] DAMAGECOUNT value on done: 941575.0 [2024-08-06 08:10:39,247][52670] Sum rewards: 80.996, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.997', 'AMMO2': '0.006', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'AMMO3': '0.184', 'weapon5': '0.214', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '3.046', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:39,539][52665] DAMAGECOUNT value on done: 922005.0 [2024-08-06 08:10:39,539][52665] Sum rewards: 75.631, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.678', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.050', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.186', 'AMMO3': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.450', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:40,954][52666] DAMAGECOUNT value on done: 943045.0 [2024-08-06 08:10:40,955][52666] Sum rewards: 96.360, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.214', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.981', 'FRAGCOUNT': '79.000'} [2024-08-06 08:10:41,185][52668] DAMAGECOUNT value on done: 948901.0 [2024-08-06 08:10:41,185][52668] Sum rewards: 82.487, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.043', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon4': '0.042', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '67.000'} [2024-08-06 08:10:41,402][52803] DAMAGECOUNT value on done: 883769.0 [2024-08-06 08:10:41,403][52803] Sum rewards: 68.200, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.664', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.150', 'weapon2': '0.166', 'AMMO4': '0.199', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.406', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:41,748][52670] DAMAGECOUNT value on done: 945381.0 [2024-08-06 08:10:41,748][52670] Sum rewards: 70.793, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.612', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.122', 'AMMO3': '0.190', 'AMMO4': '0.274', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON4': '0.400', 'weapon4': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.560', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:41,846][52649] DAMAGECOUNT value on done: 912973.0 [2024-08-06 08:10:41,847][52649] Sum rewards: 74.168, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.011', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.108', 'weapon4': '0.124', 'AMMO4': '0.160', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.280', 'weapon2': '0.396', 'WEAPON3': '1.600', 'weapon3': '3.090', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '64.000'} [2024-08-06 08:10:42,298][52650] Updated weights for policy 0, policy_version 82161 (0.0030) [2024-08-06 08:10:42,605][52665] DAMAGECOUNT value on done: 924618.0 [2024-08-06 08:10:42,606][52665] Sum rewards: 70.330, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.843', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.172', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.350', 'weapon4': '0.510', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 673062912. Throughput: 0: 4365.8. Samples: 168274320. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:10:42,795][52567] Avg episode reward: [(0, '75.418')] [2024-08-06 08:10:43,491][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.096, -32.0), ('weapon5', 0.002)] [2024-08-06 08:10:44,095][52666] DAMAGECOUNT value on done: 926952.0 [2024-08-06 08:10:44,097][52666] Sum rewards: 73.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.406', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.187', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '3.108', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '58.000'} [2024-08-06 08:10:44,366][52668] DAMAGECOUNT value on done: 948820.0 [2024-08-06 08:10:44,366][52668] Sum rewards: 79.436, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.078', 'AMMO4': '0.172', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:44,521][52803] DAMAGECOUNT value on done: 879020.0 [2024-08-06 08:10:44,525][52803] Sum rewards: 104.920, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.737', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.070', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.162', 'weapon2': '0.186', 'WEAPON4': '0.200', 'weapon4': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.336', 'HITCOUNT': '4.390', 'DAMAGECOUNT': '23.262', 'FRAGCOUNT': '84.000'} [2024-08-06 08:10:44,766][52649] DAMAGECOUNT value on done: 926437.0 [2024-08-06 08:10:44,766][52649] Sum rewards: 67.152, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.170', 'AMMO5': '0.021', 'AMMO2': '0.079', 'weapon4': '0.102', 'AMMO3': '0.259', 'weapon2': '0.270', 'weapon5': '0.278', 'AMMO4': '0.395', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.650', 'weapon3': '3.044', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:44,905][52670] DAMAGECOUNT value on done: 938952.0 [2024-08-06 08:10:44,906][52670] Sum rewards: 80.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.296', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:45,325][52665] DAMAGECOUNT value on done: 935803.0 [2024-08-06 08:10:45,326][52665] Sum rewards: 78.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.015', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.176', 'AMMO3': '0.215', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.678', 'WEAPON3': '1.300', 'weapon3': '2.516', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '64.000'} [2024-08-06 08:10:45,608][52667] DAMAGECOUNT value on done: 943620.0 [2024-08-06 08:10:45,610][52667] Sum rewards: 67.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.565', 'AMMO5': '0.004', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.688', 'WEAPON3': '1.300', 'HITCOUNT': '2.920', 'weapon3': '3.168', 'DAMAGECOUNT': '15.033', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:46,930][52666] DAMAGECOUNT value on done: 947422.0 [2024-08-06 08:10:46,931][52666] Sum rewards: 65.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.143', 'AMMO3': '0.229', 'weapon4': '0.264', 'weapon2': '0.282', 'weapon5': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.866', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '54.000'} [2024-08-06 08:10:47,122][52650] Updated weights for policy 0, policy_version 82171 (0.0012) [2024-08-06 08:10:47,320][52668] DAMAGECOUNT value on done: 941244.0 [2024-08-06 08:10:47,321][52668] Sum rewards: 88.530, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon4': '0.126', 'weapon5': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.060', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.243', 'FRAGCOUNT': '69.000'} [2024-08-06 08:10:47,361][52649] DAMAGECOUNT value on done: 928376.0 [2024-08-06 08:10:47,361][52649] Sum rewards: 82.757, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.179', 'weapon5': '0.186', 'weapon4': '0.234', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.994', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:47,561][52670] DAMAGECOUNT value on done: 923625.0 [2024-08-06 08:10:47,563][52670] Sum rewards: 70.443, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.102', 'weapon5': '0.160', 'AMMO3': '0.229', 'AMMO4': '0.263', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.138', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:47,581][52803] DAMAGECOUNT value on done: 890437.0 [2024-08-06 08:10:47,581][52803] Sum rewards: 75.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.090', 'AMMO4': '0.145', 'AMMO3': '0.194', 'weapon5': '0.200', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '61.000'} [2024-08-06 08:10:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 673153024. Throughput: 0: 4369.3. Samples: 168287560. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:10:47,794][52567] Avg episode reward: [(0, '75.679')] [2024-08-06 08:10:48,071][52665] DAMAGECOUNT value on done: 934121.0 [2024-08-06 08:10:48,074][52665] Sum rewards: 78.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.276', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.161', 'weapon4': '0.202', 'weapon2': '0.420', 'WEAPON3': '0.950', 'weapon3': '3.058', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '61.000'} [2024-08-06 08:10:48,670][52667] DAMAGECOUNT value on done: 961291.0 [2024-08-06 08:10:48,672][52667] Sum rewards: 80.015, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.355', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon5': '0.048', 'weapon4': '0.092', 'AMMO4': '0.145', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.000', 'weapon3': '3.254', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:49,750][52666] DAMAGECOUNT value on done: 942235.0 [2024-08-06 08:10:49,750][52666] Sum rewards: 86.363, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.040', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.152', 'AMMO3': '0.162', 'weapon5': '0.182', 'weapon4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.050', 'weapon3': '2.864', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '68.000'} [2024-08-06 08:10:50,000][52668] DAMAGECOUNT value on done: 943202.0 [2024-08-06 08:10:50,002][52668] Sum rewards: 65.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.830', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.118', 'AMMO4': '0.160', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.680', 'WEAPON3': '1.100', 'weapon3': '2.728', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '53.500'} [2024-08-06 08:10:50,594][52670] DAMAGECOUNT value on done: 937391.0 [2024-08-06 08:10:50,595][52670] Sum rewards: 86.770, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.320', 'AMMO2': '0.004', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'weapon4': '0.062', 'AMMO3': '0.154', 'weapon2': '0.608', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '70.000'} [2024-08-06 08:10:50,723][52649] DAMAGECOUNT value on done: 919213.0 [2024-08-06 08:10:50,724][52649] Sum rewards: 81.671, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.850', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon5': '0.084', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.216', 'weapon4': '0.232', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.156', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '65.000'} [2024-08-06 08:10:50,749][52803] DAMAGECOUNT value on done: 885305.0 [2024-08-06 08:10:50,751][52803] Sum rewards: 73.859, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.271', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.124', 'AMMO4': '0.163', 'weapon5': '0.174', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.300', 'weapon3': '2.996', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '60.000'} [2024-08-06 08:10:51,305][52665] DAMAGECOUNT value on done: 938567.0 [2024-08-06 08:10:51,305][52665] Sum rewards: 72.994, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.155', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '61.000'} [2024-08-06 08:10:51,707][52820] DAMAGECOUNT value on done: 875280.0 [2024-08-06 08:10:51,707][52820] Sum rewards: 76.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.391', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.082', 'AMMO4': '0.177', 'weapon5': '0.212', 'AMMO3': '0.227', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:51,773][52667] DAMAGECOUNT value on done: 952519.0 [2024-08-06 08:10:51,773][52667] Sum rewards: 73.351, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.278', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.102', 'AMMO4': '0.178', 'AMMO3': '0.192', 'weapon5': '0.236', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '60.000'} [2024-08-06 08:10:52,001][52650] Updated weights for policy 0, policy_version 82181 (0.0012) [2024-08-06 08:10:52,538][52668] DAMAGECOUNT value on done: 952730.0 [2024-08-06 08:10:52,539][52668] Sum rewards: 83.654, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.036', 'weapon5': '0.076', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.400', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '69.000'} [2024-08-06 08:10:52,551][52666] DAMAGECOUNT value on done: 941778.0 [2024-08-06 08:10:52,551][52666] Sum rewards: 80.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.818', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON1': '0.010', 'weapon4': '0.046', 'AMMO4': '0.047', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '64.000'} [2024-08-06 08:10:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 673234944. Throughput: 0: 4378.9. Samples: 168313860. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:10:52,795][52567] Avg episode reward: [(0, '75.741')] [2024-08-06 08:10:52,916][52647] DAMAGECOUNT value on done: 1009978.0 [2024-08-06 08:10:52,917][52647] Sum rewards: 86.349, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.354', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.022', 'WEAPON4': '0.050', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.198', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.302', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.502', 'FRAGCOUNT': '69.000'} [2024-08-06 08:10:53,443][52670] DAMAGECOUNT value on done: 946465.0 [2024-08-06 08:10:53,443][52670] Sum rewards: 70.399, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.076', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO3': '0.200', 'AMMO4': '0.218', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.256', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:53,861][52649] DAMAGECOUNT value on done: 928023.0 [2024-08-06 08:10:53,861][52649] Sum rewards: 78.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.100', 'weapon5': '0.164', 'AMMO3': '0.203', 'AMMO4': '0.214', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '64.000'} [2024-08-06 08:10:54,016][52803] DAMAGECOUNT value on done: 876801.0 [2024-08-06 08:10:54,019][52803] Sum rewards: 71.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.336', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.094', 'weapon5': '0.176', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '58.000'} [2024-08-06 08:10:54,406][52667] DAMAGECOUNT value on done: 958156.0 [2024-08-06 08:10:54,408][52667] Sum rewards: 87.390, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.821', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.046', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.232', 'WEAPON3': '1.050', 'weapon3': '3.582', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '70.000'} [2024-08-06 08:10:54,598][52665] DAMAGECOUNT value on done: 931852.0 [2024-08-06 08:10:54,601][52665] Sum rewards: 68.742, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.692', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.166', 'weapon2': '0.172', 'AMMO4': '0.173', 'AMMO3': '0.225', 'weapon4': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 08:10:54,853][52820] DAMAGECOUNT value on done: 875874.0 [2024-08-06 08:10:54,854][52820] Sum rewards: 66.929, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.158', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.072', 'weapon5': '0.096', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.348', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.218', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '56.000'} [2024-08-06 08:10:55,304][52647] DAMAGECOUNT value on done: 994401.0 [2024-08-06 08:10:55,305][52647] Sum rewards: 67.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.165', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.140', 'weapon4': '0.178', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '56.000'} [2024-08-06 08:10:55,538][52668] DAMAGECOUNT value on done: 944700.0 [2024-08-06 08:10:55,538][52668] Sum rewards: 72.577, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.197', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'AMMO3': '0.175', 'weapon5': '0.262', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.100', 'weapon3': '2.746', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:55,773][52666] DAMAGECOUNT value on done: 934817.0 [2024-08-06 08:10:55,774][52666] Sum rewards: 72.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.604', 'AMMO5': '0.023', 'AMMO2': '0.074', 'AMMO3': '0.158', 'weapon4': '0.222', 'weapon5': '0.326', 'weapon2': '0.344', 'AMMO4': '0.369', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:56,358][52650] Updated weights for policy 0, policy_version 82191 (0.0025) [2024-08-06 08:10:56,608][52670] DAMAGECOUNT value on done: 939294.0 [2024-08-06 08:10:56,609][52670] Sum rewards: 75.747, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.400', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.114', 'weapon5': '0.162', 'AMMO3': '0.170', 'AMMO4': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.602', 'WEAPON3': '0.950', 'weapon3': '2.928', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:57,001][52649] DAMAGECOUNT value on done: 923158.0 [2024-08-06 08:10:57,002][52649] Sum rewards: 74.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.918', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon5': '0.180', 'AMMO3': '0.201', 'weapon2': '0.228', 'AMMO4': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.280', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:57,216][52667] DAMAGECOUNT value on done: 958669.0 [2024-08-06 08:10:57,217][52667] Sum rewards: 62.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.100', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.112', 'weapon5': '0.212', 'AMMO3': '0.217', 'AMMO4': '0.261', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.970', 'weapon3': '3.068', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '52.000'} [2024-08-06 08:10:57,245][52803] DAMAGECOUNT value on done: 893188.0 [2024-08-06 08:10:57,246][52803] Sum rewards: 70.848, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.316', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon4': '0.186', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.266', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.803', 'FRAGCOUNT': '56.000'} [2024-08-06 08:10:57,256][52662] DAMAGECOUNT value on done: 944977.0 [2024-08-06 08:10:57,256][52662] Sum rewards: 73.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.170', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'AMMO3': '0.195', 'weapon5': '0.208', 'weapon4': '0.296', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:57,675][52665] DAMAGECOUNT value on done: 947831.0 [2024-08-06 08:10:57,676][52665] Sum rewards: 74.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.650', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.050', 'weapon4': '0.062', 'AMMO4': '0.124', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '63.000'} [2024-08-06 08:10:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 673325056. Throughput: 0: 4369.1. Samples: 168339780. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:10:57,794][52567] Avg episode reward: [(0, '75.523')] [2024-08-06 08:10:57,963][52647] DAMAGECOUNT value on done: 1001664.0 [2024-08-06 08:10:57,964][52647] Sum rewards: 75.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.716', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.074', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'weapon3': '3.442', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '64.000'} [2024-08-06 08:10:58,178][52820] DAMAGECOUNT value on done: 877982.0 [2024-08-06 08:10:58,178][52820] Sum rewards: 74.847, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.818', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon5': '0.092', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.372', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '2.888', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.277', 'FRAGCOUNT': '60.000'} [2024-08-06 08:10:58,388][52666] DAMAGECOUNT value on done: 932855.0 [2024-08-06 08:10:58,390][52666] Sum rewards: 78.494, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.540', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.136', 'weapon4': '0.138', 'AMMO3': '0.182', 'AMMO4': '0.182', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '3.120', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '62.000'} [2024-08-06 08:10:58,516][52668] DAMAGECOUNT value on done: 940603.0 [2024-08-06 08:10:58,517][52668] Sum rewards: 78.751, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.394', 'AMMO5': '0.014', 'AMMO2': '0.041', 'AMMO4': '0.207', 'weapon5': '0.214', 'AMMO3': '0.303', 'weapon2': '0.332', 'weapon4': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.796', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '68.000'} [2024-08-06 08:10:59,219][52670] DAMAGECOUNT value on done: 940719.0 [2024-08-06 08:10:59,219][52670] Sum rewards: 71.880, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.054', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '3.216', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '59.000'} [2024-08-06 08:10:59,978][52662] DAMAGECOUNT value on done: 955055.0 [2024-08-06 08:10:59,979][52662] Sum rewards: 78.758, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.250', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.036', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.161', 'weapon2': '0.340', 'WEAPON3': '1.100', 'HITCOUNT': '3.430', 'weapon3': '3.484', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:00,053][52667] DAMAGECOUNT value on done: 957978.0 [2024-08-06 08:11:00,055][52667] Sum rewards: 78.534, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.022', 'AMMO4': '0.072', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.320', 'WEAPON3': '1.500', 'weapon3': '3.314', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '67.000'} [2024-08-06 08:11:00,301][52803] DAMAGECOUNT value on done: 876880.0 [2024-08-06 08:11:00,303][52803] Sum rewards: 79.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.860', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.070', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.340', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:00,356][52649] DAMAGECOUNT value on done: 926853.0 [2024-08-06 08:11:00,358][52649] Sum rewards: 75.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.824', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.144', 'AMMO4': '0.152', 'weapon2': '0.212', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '63.000'} [2024-08-06 08:11:00,902][52647] DAMAGECOUNT value on done: 999819.0 [2024-08-06 08:11:00,902][52647] Sum rewards: 78.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.434', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.102', 'AMMO4': '0.200', 'AMMO3': '0.211', 'weapon5': '0.222', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '63.500'} [2024-08-06 08:11:00,936][52665] DAMAGECOUNT value on done: 941405.0 [2024-08-06 08:11:00,938][52665] Sum rewards: 66.748, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.019', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.202', 'weapon2': '0.276', 'weapon5': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.434', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '53.000'} [2024-08-06 08:11:01,161][52820] DAMAGECOUNT value on done: 865515.0 [2024-08-06 08:11:01,162][52820] Sum rewards: 77.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.742', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '63.000'} [2024-08-06 08:11:01,302][52666] DAMAGECOUNT value on done: 953672.0 [2024-08-06 08:11:01,303][52666] Sum rewards: 76.892, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.009', 'weapon4': '0.042', 'AMMO2': '0.043', 'weapon5': '0.126', 'AMMO3': '0.158', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.708', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:01,408][52650] Updated weights for policy 0, policy_version 82201 (0.0048) [2024-08-06 08:11:01,570][52668] DAMAGECOUNT value on done: 936438.0 [2024-08-06 08:11:01,571][52668] Sum rewards: 83.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.347', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.062', 'weapon5': '0.102', 'AMMO4': '0.254', 'AMMO3': '0.266', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.214', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '73.000'} [2024-08-06 08:11:01,921][52660] Large shaping reward 2.752 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('weapon5', 0.002)] [2024-08-06 08:11:02,524][52662] DAMAGECOUNT value on done: 952654.0 [2024-08-06 08:11:02,525][52662] Sum rewards: 74.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.292', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.078', 'weapon5': '0.078', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '63.000'} [2024-08-06 08:11:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 673415168. Throughput: 0: 4373.3. Samples: 168353090. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:11:02,794][52567] Avg episode reward: [(0, '75.466')] [2024-08-06 08:11:02,924][52667] DAMAGECOUNT value on done: 951290.0 [2024-08-06 08:11:02,926][52667] Sum rewards: 75.171, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.088', 'AMMO4': '0.137', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:03,309][52649] DAMAGECOUNT value on done: 921628.0 [2024-08-06 08:11:03,318][52649] Sum rewards: 74.116, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '62.000'} [2024-08-06 08:11:03,357][52803] DAMAGECOUNT value on done: 886169.0 [2024-08-06 08:11:03,357][52803] Sum rewards: 69.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.402', 'WEAPON3': '1.400', 'HITCOUNT': '3.160', 'weapon3': '3.314', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:03,639][52665] DAMAGECOUNT value on done: 936347.0 [2024-08-06 08:11:03,639][52665] Sum rewards: 78.234, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.159', 'AMMO3': '0.213', 'weapon4': '0.220', 'weapon5': '0.222', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:04,123][52647] DAMAGECOUNT value on done: 1008823.0 [2024-08-06 08:11:04,124][52647] Sum rewards: 71.587, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.355', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.106', 'AMMO4': '0.132', 'weapon5': '0.156', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.116', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:04,343][52820] DAMAGECOUNT value on done: 877273.0 [2024-08-06 08:11:04,343][52820] Sum rewards: 65.190, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.929', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.125', 'weapon4': '0.208', 'AMMO4': '0.251', 'weapon5': '0.256', 'weapon2': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.800', 'weapon3': '2.980', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.834', 'FRAGCOUNT': '50.000'} [2024-08-06 08:11:04,348][52666] DAMAGECOUNT value on done: 925683.0 [2024-08-06 08:11:04,348][52666] Sum rewards: 70.604, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.790', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.060', 'weapon5': '0.170', 'weapon2': '0.192', 'AMMO4': '0.222', 'AMMO3': '0.279', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.180', 'weapon3': '3.368', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '62.000'} [2024-08-06 08:11:04,399][52668] DAMAGECOUNT value on done: 933944.0 [2024-08-06 08:11:04,400][52668] Sum rewards: 71.527, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.538', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon5': '0.188', 'WEAPON4': '0.200', 'weapon4': '0.326', 'weapon2': '0.394', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:05,828][52662] DAMAGECOUNT value on done: 943119.0 [2024-08-06 08:11:05,828][52662] Sum rewards: 80.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.091', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.533', 'FRAGCOUNT': '66.500'} [2024-08-06 08:11:05,935][52650] Updated weights for policy 0, policy_version 82211 (0.0036) [2024-08-06 08:11:05,969][52667] DAMAGECOUNT value on done: 947286.0 [2024-08-06 08:11:05,971][52667] Sum rewards: 71.499, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.878', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.225', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:06,031][52649] DAMAGECOUNT value on done: 917206.0 [2024-08-06 08:11:06,033][52649] Sum rewards: 65.221, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.040', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.100', 'AMMO4': '0.143', 'weapon5': '0.166', 'AMMO3': '0.207', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.232', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '54.000'} [2024-08-06 08:11:06,434][52803] DAMAGECOUNT value on done: 886882.0 [2024-08-06 08:11:06,434][52803] Sum rewards: 73.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.090', 'weapon4': '0.186', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.200', 'weapon3': '3.082', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:06,462][52665] DAMAGECOUNT value on done: 936496.0 [2024-08-06 08:11:06,466][52665] Sum rewards: 82.736, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.125', 'weapon5': '0.136', 'weapon2': '0.228', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.362', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '67.000'} [2024-08-06 08:11:07,182][52647] DAMAGECOUNT value on done: 1004968.0 [2024-08-06 08:11:07,183][52647] Sum rewards: 73.161, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.108', 'AMMO4': '0.177', 'weapon5': '0.180', 'HEALTH': '0.184', 'AMMO3': '0.219', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.170', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:07,205][52668] DAMAGECOUNT value on done: 929218.0 [2024-08-06 08:11:07,205][52668] Sum rewards: 69.152, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.148', 'AMMO3': '0.197', 'weapon2': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:07,289][52666] DAMAGECOUNT value on done: 938106.0 [2024-08-06 08:11:07,290][52666] Sum rewards: 78.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.615', 'AMMO5': '0.027', 'AMMO2': '0.082', 'AMMO3': '0.225', 'weapon4': '0.236', 'weapon5': '0.302', 'AMMO4': '0.410', 'weapon2': '0.440', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:07,485][52820] DAMAGECOUNT value on done: 864954.0 [2024-08-06 08:11:07,485][52820] Sum rewards: 77.376, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.158', 'weapon2': '0.174', 'AMMO3': '0.258', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.098', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 673497088. Throughput: 0: 4370.0. Samples: 168379210. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:11:07,794][52567] Avg episode reward: [(0, '75.539')] [2024-08-06 08:11:08,355][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:11:08,748][52649] DAMAGECOUNT value on done: 931748.0 [2024-08-06 08:11:08,749][52649] Sum rewards: 81.941, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.620', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.060', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.412', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.210', 'FRAGCOUNT': '69.000'} [2024-08-06 08:11:08,882][52662] DAMAGECOUNT value on done: 960602.0 [2024-08-06 08:11:08,882][52662] Sum rewards: 72.047, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.092', 'AMMO4': '0.154', 'weapon5': '0.212', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:09,130][52667] DAMAGECOUNT value on done: 951077.0 [2024-08-06 08:11:09,132][52667] Sum rewards: 71.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.140', 'weapon4': '0.152', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:09,200][52665] DAMAGECOUNT value on done: 933529.0 [2024-08-06 08:11:09,200][52665] Sum rewards: 81.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.312', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.070', 'weapon5': '0.074', 'AMMO4': '0.144', 'weapon2': '0.156', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.526', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:09,663][52803] DAMAGECOUNT value on done: 893628.0 [2024-08-06 08:11:09,667][52803] Sum rewards: 79.884, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.030', 'AMMO5': '0.005', 'AMMO2': '0.011', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon2': '0.188', 'AMMO3': '0.307', 'WEAPON3': '1.800', 'weapon3': '3.614', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.716', 'FRAGCOUNT': '69.000'} [2024-08-06 08:11:09,854][52668] DAMAGECOUNT value on done: 944115.0 [2024-08-06 08:11:09,858][52668] Sum rewards: 79.584, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.883', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.042', 'AMMO4': '0.048', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.416', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:10,046][52647] DAMAGECOUNT value on done: 1008339.0 [2024-08-06 08:11:10,046][52647] Sum rewards: 77.329, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.090', 'AMMO3': '0.139', 'weapon4': '0.166', 'AMMO4': '0.207', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.270', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:10,576][52820] DAMAGECOUNT value on done: 869591.0 [2024-08-06 08:11:10,576][52820] Sum rewards: 71.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.075', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.080', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.212', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:10,847][52650] Updated weights for policy 0, policy_version 82221 (0.0027) [2024-08-06 08:11:11,748][52649] DAMAGECOUNT value on done: 937769.0 [2024-08-06 08:11:11,748][52649] Sum rewards: 73.247, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.104', 'AMMO5': '0.006', 'AMMO2': '0.040', 'weapon5': '0.074', 'weapon4': '0.088', 'AMMO4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.348', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:11,808][52662] DAMAGECOUNT value on done: 936727.0 [2024-08-06 08:11:11,809][52662] Sum rewards: 66.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.058', 'AMMO4': '0.173', 'weapon2': '0.186', 'weapon5': '0.192', 'AMMO3': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.000', 'weapon3': '3.322', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:12,081][52667] DAMAGECOUNT value on done: 957126.0 [2024-08-06 08:11:12,083][52667] Sum rewards: 82.880, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.583', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.024', 'weapon5': '0.026', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.444', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '71.000'} [2024-08-06 08:11:12,295][52665] DAMAGECOUNT value on done: 939549.0 [2024-08-06 08:11:12,295][52665] Sum rewards: 74.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.425', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.126', 'weapon4': '0.142', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:12,562][52647] DAMAGECOUNT value on done: 983787.0 [2024-08-06 08:11:12,563][52647] Sum rewards: 68.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.407', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.162', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '2.882', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 673587200. Throughput: 0: 4365.3. Samples: 168405200. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:11:12,794][52567] Avg episode reward: [(0, '75.564')] [2024-08-06 08:11:12,796][52803] DAMAGECOUNT value on done: 890601.0 [2024-08-06 08:11:12,799][52803] Sum rewards: 78.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.760', 'AMMO5': '0.019', 'AMMO2': '0.064', 'AMMO3': '0.205', 'weapon2': '0.228', 'weapon5': '0.292', 'weapon4': '0.312', 'AMMO4': '0.321', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '65.000'} [2024-08-06 08:11:12,975][52668] DAMAGECOUNT value on done: 946650.0 [2024-08-06 08:11:12,976][52668] Sum rewards: 69.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.995', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.232', 'AMMO3': '0.254', 'WEAPON3': '1.500', 'HITCOUNT': '3.510', 'weapon3': '3.542', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:13,681][52820] DAMAGECOUNT value on done: 872000.0 [2024-08-06 08:11:13,682][52820] Sum rewards: 69.793, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.526', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.122', 'AMMO4': '0.135', 'weapon5': '0.166', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.060', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '56.000'} [2024-08-06 08:11:14,613][52662] DAMAGECOUNT value on done: 944407.0 [2024-08-06 08:11:14,613][52662] Sum rewards: 82.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.706', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.094', 'weapon5': '0.108', 'AMMO4': '0.168', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:14,872][52649] DAMAGECOUNT value on done: 929185.0 [2024-08-06 08:11:14,872][52649] Sum rewards: 73.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.810', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon2': '0.150', 'AMMO4': '0.223', 'weapon5': '0.238', 'AMMO3': '0.261', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.408', 'WEAPON3': '1.550', 'weapon3': '2.768', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:14,997][52647] DAMAGECOUNT value on done: 998082.0 [2024-08-06 08:11:14,997][52647] Sum rewards: 75.632, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.112', 'AMMO4': '0.135', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.558', 'weapon2': '0.654', 'WEAPON3': '0.900', 'weapon3': '3.008', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '58.500'} [2024-08-06 08:11:15,074][52667] DAMAGECOUNT value on done: 946746.0 [2024-08-06 08:11:15,077][52667] Sum rewards: 70.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.426', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.234', 'AMMO3': '0.238', 'weapon5': '0.242', 'AMMO4': '0.305', 'weapon2': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.882', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:15,192][52650] Updated weights for policy 0, policy_version 82231 (0.0012) [2024-08-06 08:11:15,349][52665] DAMAGECOUNT value on done: 935320.0 [2024-08-06 08:11:15,349][52665] Sum rewards: 55.863, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.300', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon5': '0.210', 'AMMO3': '0.241', 'weapon4': '0.292', 'AMMO4': '0.307', 'weapon2': '0.328', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.890', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '15.024', 'FRAGCOUNT': '50.000'} [2024-08-06 08:11:15,611][52668] DAMAGECOUNT value on done: 946419.0 [2024-08-06 08:11:15,611][52668] Sum rewards: 74.326, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'weapon2': '0.760', 'WEAPON3': '0.900', 'weapon3': '3.120', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:16,050][52803] DAMAGECOUNT value on done: 885608.0 [2024-08-06 08:11:16,050][52803] Sum rewards: 83.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.170', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.138', 'AMMO4': '0.168', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.050', 'weapon3': '3.178', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:16,882][52820] DAMAGECOUNT value on done: 879817.0 [2024-08-06 08:11:16,884][52820] Sum rewards: 76.555, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.076', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.100', 'weapon5': '0.120', 'AMMO4': '0.152', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.638', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:17,245][52662] DAMAGECOUNT value on done: 961409.0 [2024-08-06 08:11:17,246][52662] Sum rewards: 82.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.611', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.110', 'AMMO3': '0.150', 'weapon5': '0.204', 'AMMO4': '0.275', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '68.000'} [2024-08-06 08:11:17,637][52647] DAMAGECOUNT value on done: 996398.0 [2024-08-06 08:11:17,637][52647] Sum rewards: 72.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.255', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.066', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.474', 'WEAPON3': '1.400', 'HITCOUNT': '3.220', 'weapon3': '3.224', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:17,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17495.4). Total num frames: 673677312. Throughput: 0: 4372.0. Samples: 168418420. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:17,795][52567] Avg episode reward: [(0, '75.366')] [2024-08-06 08:11:17,946][52649] DAMAGECOUNT value on done: 928701.0 [2024-08-06 08:11:17,946][52649] Sum rewards: 81.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.449', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.060', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.308', 'WEAPON3': '1.400', 'weapon3': '3.430', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '68.000'} [2024-08-06 08:11:17,957][52667] DAMAGECOUNT value on done: 947136.0 [2024-08-06 08:11:17,959][52667] Sum rewards: 60.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.700', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.116', 'AMMO4': '0.169', 'AMMO3': '0.173', 'weapon4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.208', 'DAMAGECOUNT': '14.802', 'FRAGCOUNT': '49.500'} [2024-08-06 08:11:18,369][52665] DAMAGECOUNT value on done: 927363.0 [2024-08-06 08:11:18,370][52665] Sum rewards: 66.960, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.170', 'AMMO3': '0.203', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '56.000'} [2024-08-06 08:11:18,457][52668] DAMAGECOUNT value on done: 946241.0 [2024-08-06 08:11:18,457][52668] Sum rewards: 76.241, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.619', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon5': '0.088', 'weapon4': '0.104', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:19,206][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:11:19,230][52660] DAMAGECOUNT value on done: 942108.0 [2024-08-06 08:11:19,232][52660] Sum rewards: 74.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.852', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.106', 'AMMO3': '0.224', 'weapon5': '0.260', 'AMMO4': '0.265', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.898', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '63.000'} [2024-08-06 08:11:19,334][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:11:19,646][52795] DAMAGECOUNT value on done: 871161.0 [2024-08-06 08:11:19,650][52795] Sum rewards: 60.878, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.590', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.120', 'AMMO4': '0.248', 'weapon2': '0.252', 'AMMO3': '0.254', 'weapon5': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.964', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.741', 'FRAGCOUNT': '52.000'} [2024-08-06 08:11:20,018][52650] Updated weights for policy 0, policy_version 82241 (0.0014) [2024-08-06 08:11:20,034][52820] DAMAGECOUNT value on done: 887194.0 [2024-08-06 08:11:20,034][52820] Sum rewards: 66.023, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'HEALTH': '0.169', 'weapon2': '0.380', 'weapon4': '0.528', 'WEAPON3': '0.850', 'weapon3': '2.590', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.738', 'FRAGCOUNT': '52.000'} [2024-08-06 08:11:20,118][52662] DAMAGECOUNT value on done: 948959.0 [2024-08-06 08:11:20,119][52662] Sum rewards: 88.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.063', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '71.000'} [2024-08-06 08:11:20,498][52647] DAMAGECOUNT value on done: 994857.0 [2024-08-06 08:11:20,499][52647] Sum rewards: 78.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.540', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.160', 'AMMO4': '0.183', 'AMMO3': '0.184', 'weapon5': '0.274', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.006', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '63.000'} [2024-08-06 08:11:20,921][52649] DAMAGECOUNT value on done: 916326.0 [2024-08-06 08:11:20,923][52649] Sum rewards: 68.963, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.552', 'AMMO5': '0.022', 'AMMO2': '0.074', 'AMMO3': '0.250', 'weapon5': '0.294', 'weapon4': '0.330', 'AMMO4': '0.368', 'weapon2': '0.438', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.596', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:20,979][52667] DAMAGECOUNT value on done: 957348.0 [2024-08-06 08:11:20,979][52667] Sum rewards: 86.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.130', 'AMMO3': '0.160', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.612', 'WEAPON3': '1.150', 'weapon3': '2.830', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '69.000'} [2024-08-06 08:11:21,221][52665] DAMAGECOUNT value on done: 932627.0 [2024-08-06 08:11:21,222][52665] Sum rewards: 81.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.594', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.185', 'weapon4': '0.246', 'weapon5': '0.306', 'AMMO4': '0.320', 'weapon2': '0.346', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.816', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:21,280][52668] DAMAGECOUNT value on done: 952728.0 [2024-08-06 08:11:21,280][52668] Sum rewards: 67.533, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.210', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.128', 'weapon4': '0.130', 'AMMO4': '0.157', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.102', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2024-08-06 08:11:21,454][52659] DAMAGECOUNT value on done: 948436.0 [2024-08-06 08:11:21,455][52659] Sum rewards: 74.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.038', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon4': '0.074', 'AMMO4': '0.083', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '62.000'} [2024-08-06 08:11:21,524][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:11:22,003][52660] DAMAGECOUNT value on done: 933496.0 [2024-08-06 08:11:22,003][52660] Sum rewards: 64.471, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.003', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.128', 'weapon4': '0.132', 'AMMO3': '0.136', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.706', 'WEAPON3': '0.850', 'weapon3': '2.766', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '49.000'} [2024-08-06 08:11:22,716][52795] DAMAGECOUNT value on done: 864764.0 [2024-08-06 08:11:22,716][52795] Sum rewards: 88.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.746', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.144', 'AMMO4': '0.191', 'weapon4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '0.900', 'weapon3': '3.070', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '70.000'} [2024-08-06 08:11:22,800][52567] Fps is (10 sec: 17193.2, 60 sec: 17338.2, 300 sec: 17466.7). Total num frames: 673759232. Throughput: 0: 4365.4. Samples: 168444580. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:22,800][52567] Avg episode reward: [(0, '74.845')] [2024-08-06 08:11:23,070][52662] DAMAGECOUNT value on done: 952315.0 [2024-08-06 08:11:23,072][52662] Sum rewards: 72.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.620', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.060', 'weapon5': '0.162', 'AMMO4': '0.213', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.700', 'weapon3': '3.098', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:23,133][52820] DAMAGECOUNT value on done: 870361.0 [2024-08-06 08:11:23,134][52820] Sum rewards: 78.133, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.234', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.140', 'weapon4': '0.144', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '65.000'} [2024-08-06 08:11:23,537][52647] DAMAGECOUNT value on done: 988076.0 [2024-08-06 08:11:23,541][52647] Sum rewards: 77.304, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon4': '0.130', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:23,648][52649] DAMAGECOUNT value on done: 929692.0 [2024-08-06 08:11:23,651][52649] Sum rewards: 81.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.112', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.094', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.416', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:23,986][52667] DAMAGECOUNT value on done: 946244.0 [2024-08-06 08:11:23,988][52667] Sum rewards: 73.801, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.539', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.128', 'AMMO4': '0.156', 'AMMO3': '0.191', 'weapon4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.028', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:24,045][52665] DAMAGECOUNT value on done: 937807.0 [2024-08-06 08:11:24,049][52665] Sum rewards: 74.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.098', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.082', 'AMMO4': '0.197', 'AMMO3': '0.259', 'weapon2': '0.270', 'weapon5': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.046', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '62.000'} [2024-08-06 08:11:24,134][52659] DAMAGECOUNT value on done: 946882.0 [2024-08-06 08:11:24,135][52659] Sum rewards: 71.245, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.096', 'AMMO4': '0.151', 'weapon5': '0.172', 'weapon2': '0.206', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.080', 'weapon3': '3.270', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:24,517][52660] DAMAGECOUNT value on done: 946728.0 [2024-08-06 08:11:24,525][52660] Sum rewards: 75.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.612', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '62.000'} [2024-08-06 08:11:24,911][52650] Updated weights for policy 0, policy_version 82251 (0.0013) [2024-08-06 08:11:25,837][52795] DAMAGECOUNT value on done: 868602.0 [2024-08-06 08:11:25,839][52795] Sum rewards: 71.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.725', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.038', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:26,084][52647] DAMAGECOUNT value on done: 997631.0 [2024-08-06 08:11:26,087][52647] Sum rewards: 81.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.058', 'weapon4': '0.112', 'AMMO4': '0.134', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.824', 'WEAPON3': '1.200', 'weapon3': '2.778', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '67.000'} [2024-08-06 08:11:26,197][52662] DAMAGECOUNT value on done: 948220.0 [2024-08-06 08:11:26,197][52662] Sum rewards: 91.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.098', 'AMMO3': '0.190', 'AMMO4': '0.196', 'weapon4': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.148', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '75.000'} [2024-08-06 08:11:26,319][52820] DAMAGECOUNT value on done: 880799.0 [2024-08-06 08:11:26,320][52820] Sum rewards: 78.572, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.309', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.126', 'weapon5': '0.180', 'weapon2': '0.232', 'AMMO4': '0.238', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.154', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '68.000'} [2024-08-06 08:11:26,803][52649] DAMAGECOUNT value on done: 910271.0 [2024-08-06 08:11:26,804][52649] Sum rewards: 69.639, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.930', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.156', 'AMMO4': '0.183', 'AMMO3': '0.209', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:26,848][52659] DAMAGECOUNT value on done: 958259.0 [2024-08-06 08:11:26,849][52659] Sum rewards: 81.440, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.530', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon5': '0.116', 'weapon4': '0.154', 'AMMO4': '0.218', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:26,918][52660] DAMAGECOUNT value on done: 958191.0 [2024-08-06 08:11:26,918][52660] Sum rewards: 71.814, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.136', 'AMMO5': '0.010', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.096', 'WEAPON4': '0.100', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.244', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:27,177][52667] DAMAGECOUNT value on done: 953523.0 [2024-08-06 08:11:27,178][52667] Sum rewards: 79.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.826', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.082', 'AMMO4': '0.124', 'weapon2': '0.172', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.518', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '69.000'} [2024-08-06 08:11:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 673849344. Throughput: 0: 4362.7. Samples: 168470640. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:27,794][52567] Avg episode reward: [(0, '74.707')] [2024-08-06 08:11:28,299][52647] DAMAGECOUNT value on done: 991238.0 [2024-08-06 08:11:28,299][52647] Sum rewards: 69.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.114', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.628', 'WEAPON3': '1.350', 'weapon3': '2.908', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:29,007][52795] DAMAGECOUNT value on done: 882996.0 [2024-08-06 08:11:29,009][52795] Sum rewards: 74.447, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.825', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.152', 'weapon5': '0.192', 'AMMO4': '0.206', 'weapon4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.544', 'WEAPON3': '0.950', 'weapon3': '2.822', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:29,151][52662] DAMAGECOUNT value on done: 946418.0 [2024-08-06 08:11:29,152][52662] Sum rewards: 70.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.935', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.110', 'weapon4': '0.142', 'AMMO4': '0.152', 'AMMO3': '0.215', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:29,487][52820] DAMAGECOUNT value on done: 893103.0 [2024-08-06 08:11:29,489][52820] Sum rewards: 83.326, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.404', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.130', 'weapon5': '0.152', 'AMMO4': '0.156', 'AMMO3': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.139', 'FRAGCOUNT': '69.000'} [2024-08-06 08:11:29,497][52650] Updated weights for policy 0, policy_version 82261 (0.0016) [2024-08-06 08:11:29,757][52667] DAMAGECOUNT value on done: 959138.0 [2024-08-06 08:11:29,757][52667] Sum rewards: 65.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.083', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.062', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.404', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.294', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '54.000'} [2024-08-06 08:11:29,826][52659] DAMAGECOUNT value on done: 949876.0 [2024-08-06 08:11:29,827][52659] Sum rewards: 79.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.005', 'weapon5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.052', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.225', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.442', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:29,899][52649] DAMAGECOUNT value on done: 929743.0 [2024-08-06 08:11:29,899][52649] Sum rewards: 72.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.114', 'AMMO3': '0.192', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.278', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:30,165][52660] DAMAGECOUNT value on done: 940126.0 [2024-08-06 08:11:30,168][52660] Sum rewards: 73.881, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.653', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.066', 'AMMO4': '0.067', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '3.220', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:30,552][52660] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:11:30,677][52647] DAMAGECOUNT value on done: 999455.0 [2024-08-06 08:11:30,678][52647] Sum rewards: 67.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.530', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.066', 'weapon5': '0.074', 'AMMO3': '0.195', 'AMMO4': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.714', 'WEAPON3': '1.350', 'weapon3': '2.898', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:32,214][52795] DAMAGECOUNT value on done: 866640.0 [2024-08-06 08:11:32,215][52795] Sum rewards: 67.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.134', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.128', 'AMMO4': '0.180', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.330', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '2.808', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '54.000'} [2024-08-06 08:11:32,269][52662] DAMAGECOUNT value on done: 940602.0 [2024-08-06 08:11:32,269][52662] Sum rewards: 76.604, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.474', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.118', 'weapon5': '0.140', 'AMMO4': '0.242', 'weapon2': '0.248', 'AMMO3': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '65.500'} [2024-08-06 08:11:32,490][52659] DAMAGECOUNT value on done: 945049.0 [2024-08-06 08:11:32,491][52659] Sum rewards: 70.049, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.058', 'AMMO4': '0.069', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:32,576][52667] DAMAGECOUNT value on done: 960241.0 [2024-08-06 08:11:32,577][52667] Sum rewards: 86.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.061', 'AMMO2': '0.013', 'AMMO5': '0.017', 'AMMO4': '0.066', 'weapon4': '0.094', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.224', 'WEAPON3': '1.150', 'weapon3': '3.372', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.807', 'FRAGCOUNT': '67.500'} [2024-08-06 08:11:32,606][52820] DAMAGECOUNT value on done: 882000.0 [2024-08-06 08:11:32,609][52820] Sum rewards: 84.612, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.190', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.116', 'weapon4': '0.120', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.132', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '71.000'} [2024-08-06 08:11:32,794][52567] Fps is (10 sec: 17213.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 673931264. Throughput: 0: 4358.2. Samples: 168483680. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:32,794][52567] Avg episode reward: [(0, '74.951')] [2024-08-06 08:11:33,077][52649] DAMAGECOUNT value on done: 931041.0 [2024-08-06 08:11:33,080][52649] Sum rewards: 64.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.440', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.044', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.272', 'WEAPON3': '1.450', 'HITCOUNT': '3.390', 'weapon3': '3.506', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '53.000'} [2024-08-06 08:11:33,332][52647] DAMAGECOUNT value on done: 1000514.0 [2024-08-06 08:11:33,333][52647] Sum rewards: 76.666, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.920', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon2': '0.150', 'weapon5': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.378', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:33,387][52660] DAMAGECOUNT value on done: 938266.0 [2024-08-06 08:11:33,387][52660] Sum rewards: 68.275, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.785', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.118', 'weapon5': '0.128', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.000', 'HITCOUNT': '3.170', 'weapon3': '3.204', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '53.000'} [2024-08-06 08:11:34,319][52650] Updated weights for policy 0, policy_version 82271 (0.0033) [2024-08-06 08:11:34,768][52666] Large shaping reward 2.650 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:11:35,233][52659] DAMAGECOUNT value on done: 949779.0 [2024-08-06 08:11:35,235][52659] Sum rewards: 68.823, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'AMMO3': '0.112', 'weapon5': '0.112', 'weapon2': '0.470', 'WEAPON3': '0.750', 'HITCOUNT': '3.120', 'weapon3': '3.290', 'DAMAGECOUNT': '14.973', 'FRAGCOUNT': '53.500'} [2024-08-06 08:11:35,273][52662] DAMAGECOUNT value on done: 950861.0 [2024-08-06 08:11:35,273][52662] Sum rewards: 88.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.192', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.152', 'AMMO3': '0.213', 'weapon4': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '72.000'} [2024-08-06 08:11:35,297][52795] DAMAGECOUNT value on done: 872461.0 [2024-08-06 08:11:35,297][52795] Sum rewards: 80.474, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon4': '0.254', 'weapon2': '0.328', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '65.000'} [2024-08-06 08:11:35,661][52667] DAMAGECOUNT value on done: 956979.0 [2024-08-06 08:11:35,662][52667] Sum rewards: 78.302, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.097', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.096', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.466', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '65.000'} [2024-08-06 08:11:35,774][52820] DAMAGECOUNT value on done: 879525.0 [2024-08-06 08:11:35,776][52820] Sum rewards: 67.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.166', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.154', 'AMMO3': '0.183', 'weapon2': '0.218', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.188', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '54.000'} [2024-08-06 08:11:36,066][52649] DAMAGECOUNT value on done: 920783.0 [2024-08-06 08:11:36,067][52649] Sum rewards: 70.371, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.080', 'weapon4': '0.084', 'AMMO4': '0.098', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'weapon2': '0.796', 'WEAPON3': '1.550', 'weapon3': '2.834', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:36,404][52647] DAMAGECOUNT value on done: 985838.0 [2024-08-06 08:11:36,405][52647] Sum rewards: 62.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.914', 'AMMO5': '0.011', 'AMMO2': '0.049', 'weapon2': '0.172', 'weapon5': '0.172', 'weapon4': '0.194', 'AMMO3': '0.219', 'AMMO4': '0.247', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.980', 'weapon3': '3.250', 'DAMAGECOUNT': '14.937', 'FRAGCOUNT': '52.000'} [2024-08-06 08:11:36,440][52660] DAMAGECOUNT value on done: 943492.0 [2024-08-06 08:11:36,440][52660] Sum rewards: 71.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.144', 'weapon4': '0.146', 'AMMO3': '0.219', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.220', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '61.000'} [2024-08-06 08:11:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 674021376. Throughput: 0: 4356.9. Samples: 168509920. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:37,794][52567] Avg episode reward: [(0, '74.506')] [2024-08-06 08:11:37,909][52659] DAMAGECOUNT value on done: 949018.0 [2024-08-06 08:11:37,909][52659] Sum rewards: 74.648, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.841', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.131', 'AMMO3': '0.174', 'weapon5': '0.274', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:38,037][52662] DAMAGECOUNT value on done: 942837.0 [2024-08-06 08:11:38,037][52662] Sum rewards: 82.887, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.320', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.172', 'weapon5': '0.232', 'weapon2': '0.234', 'AMMO3': '0.264', 'AMMO4': '0.347', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.955', 'FRAGCOUNT': '70.000'} [2024-08-06 08:11:38,399][52795] DAMAGECOUNT value on done: 882323.0 [2024-08-06 08:11:38,400][52795] Sum rewards: 76.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.552', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.050', 'weapon5': '0.074', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.346', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.304', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:38,703][52650] Updated weights for policy 0, policy_version 82281 (0.0011) [2024-08-06 08:11:38,852][52660] DAMAGECOUNT value on done: 950819.0 [2024-08-06 08:11:38,855][52660] Sum rewards: 72.789, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.260', 'WEAPON3': '1.050', 'HITCOUNT': '3.280', 'weapon3': '3.502', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:38,876][52667] DAMAGECOUNT value on done: 953656.0 [2024-08-06 08:11:38,877][52667] Sum rewards: 70.780, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.589', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.060', 'AMMO4': '0.076', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.376', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:38,970][52820] DAMAGECOUNT value on done: 878302.0 [2024-08-06 08:11:38,971][52820] Sum rewards: 70.374, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.489', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.052', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'weapon3': '3.484', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '59.000'} [2024-08-06 08:11:39,027][52647] DAMAGECOUNT value on done: 993870.0 [2024-08-06 08:11:39,029][52647] Sum rewards: 84.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.101', 'weapon2': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon5': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.356', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '70.000'} [2024-08-06 08:11:40,542][52659] DAMAGECOUNT value on done: 949903.0 [2024-08-06 08:11:40,543][52659] Sum rewards: 83.862, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.092', 'weapon5': '0.096', 'AMMO4': '0.175', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.913', 'FRAGCOUNT': '69.000'} [2024-08-06 08:11:40,800][52662] DAMAGECOUNT value on done: 960855.0 [2024-08-06 08:11:40,801][52662] Sum rewards: 93.584, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.150', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.173', 'AMMO3': '0.188', 'weapon4': '0.202', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '22.134', 'FRAGCOUNT': '76.000'} [2024-08-06 08:11:41,573][52795] DAMAGECOUNT value on done: 872592.0 [2024-08-06 08:11:41,574][52795] Sum rewards: 84.988, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.115', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.184', 'AMMO3': '0.185', 'AMMO4': '0.197', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.912', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '68.000'} [2024-08-06 08:11:41,715][52667] DAMAGECOUNT value on done: 957440.0 [2024-08-06 08:11:41,715][52667] Sum rewards: 77.104, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.021', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.132', 'weapon4': '0.174', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.094', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:41,856][52660] DAMAGECOUNT value on done: 940576.0 [2024-08-06 08:11:41,857][52660] Sum rewards: 75.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.464', 'AMMO5': '0.015', 'AMMO2': '0.053', 'AMMO3': '0.146', 'weapon2': '0.172', 'weapon5': '0.202', 'AMMO4': '0.267', 'weapon4': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.148', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:41,958][52647] DAMAGECOUNT value on done: 987093.0 [2024-08-06 08:11:41,959][52647] Sum rewards: 75.420, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.135', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.140', 'weapon4': '0.202', 'weapon2': '0.582', 'WEAPON3': '0.850', 'weapon3': '2.962', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '57.000'} [2024-08-06 08:11:42,316][52820] DAMAGECOUNT value on done: 879360.0 [2024-08-06 08:11:42,318][52820] Sum rewards: 70.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.500', 'AMMO5': '0.013', 'AMMO2': '0.026', 'AMMO3': '0.126', 'AMMO4': '0.127', 'weapon5': '0.152', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.354', 'WEAPON3': '0.800', 'weapon3': '2.896', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '56.000'} [2024-08-06 08:11:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 674111488. Throughput: 0: 4368.9. Samples: 168536380. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:42,794][52567] Avg episode reward: [(0, '75.216')] [2024-08-06 08:11:43,209][52659] DAMAGECOUNT value on done: 947533.0 [2024-08-06 08:11:43,209][52659] Sum rewards: 80.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.785', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.046', 'AMMO4': '0.145', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '67.000'} [2024-08-06 08:11:43,386][52662] DAMAGECOUNT value on done: 949544.0 [2024-08-06 08:11:43,386][52662] Sum rewards: 70.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.174', 'AMMO5': '0.026', 'AMMO2': '0.076', 'AMMO3': '0.209', 'weapon4': '0.306', 'weapon5': '0.362', 'AMMO4': '0.382', 'weapon2': '0.396', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.552', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:43,580][52650] Updated weights for policy 0, policy_version 82291 (0.0025) [2024-08-06 08:11:44,384][52647] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:11:44,683][52795] DAMAGECOUNT value on done: 874532.0 [2024-08-06 08:11:44,684][52795] Sum rewards: 60.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.414', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.142', 'AMMO4': '0.179', 'AMMO3': '0.206', 'weapon5': '0.216', 'weapon2': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.138', 'DAMAGECOUNT': '14.946', 'FRAGCOUNT': '51.500'} [2024-08-06 08:11:44,860][52647] DAMAGECOUNT value on done: 990171.0 [2024-08-06 08:11:44,862][52647] Sum rewards: 85.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.396', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.106', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.680', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '71.000'} [2024-08-06 08:11:44,989][52660] DAMAGECOUNT value on done: 937766.0 [2024-08-06 08:11:44,989][52660] Sum rewards: 81.743, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.212', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.097', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.222', 'WEAPON3': '1.400', 'weapon3': '3.386', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.802', 'FRAGCOUNT': '67.000'} [2024-08-06 08:11:45,627][52820] DAMAGECOUNT value on done: 888522.0 [2024-08-06 08:11:45,628][52820] Sum rewards: 74.932, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.937', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.116', 'AMMO4': '0.139', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '3.092', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '63.000'} [2024-08-06 08:11:45,972][52659] DAMAGECOUNT value on done: 956415.0 [2024-08-06 08:11:45,973][52659] Sum rewards: 64.165, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon5': '0.176', 'weapon2': '0.192', 'AMMO3': '0.193', 'weapon4': '0.200', 'AMMO4': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.176', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '52.500'} [2024-08-06 08:11:46,048][52662] DAMAGECOUNT value on done: 939368.0 [2024-08-06 08:11:46,048][52662] Sum rewards: 69.570, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.470', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.131', 'weapon5': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.536', 'WEAPON3': '1.550', 'weapon3': '2.942', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:47,794][52567] Fps is (10 sec: 18021.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 674201600. Throughput: 0: 4367.5. Samples: 168549630. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:47,795][52567] Avg episode reward: [(0, '74.971')] [2024-08-06 08:11:47,836][52660] DAMAGECOUNT value on done: 944325.0 [2024-08-06 08:11:47,837][52660] Sum rewards: 76.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.685', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.159', 'weapon2': '0.690', 'WEAPON3': '1.000', 'weapon3': '2.922', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '62.000'} [2024-08-06 08:11:47,923][52795] DAMAGECOUNT value on done: 882526.0 [2024-08-06 08:11:47,925][52795] Sum rewards: 82.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.140', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.074', 'AMMO4': '0.189', 'weapon5': '0.212', 'AMMO3': '0.228', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '68.000'} [2024-08-06 08:11:48,460][52650] Updated weights for policy 0, policy_version 82301 (0.0014) [2024-08-06 08:11:48,968][52820] DAMAGECOUNT value on done: 887936.0 [2024-08-06 08:11:48,968][52820] Sum rewards: 88.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.556', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.178', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '72.000'} [2024-08-06 08:11:49,020][52659] DAMAGECOUNT value on done: 943086.0 [2024-08-06 08:11:49,021][52659] Sum rewards: 66.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.016', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.116', 'AMMO4': '0.177', 'AMMO3': '0.180', 'weapon5': '0.198', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.730', 'WEAPON3': '1.150', 'weapon3': '2.748', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '55.000'} [2024-08-06 08:11:49,436][52662] DAMAGECOUNT value on done: 945089.0 [2024-08-06 08:11:49,438][52662] Sum rewards: 88.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.041', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.094', 'weapon5': '0.198', 'AMMO4': '0.225', 'AMMO3': '0.234', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '74.000'} [2024-08-06 08:11:50,830][52660] DAMAGECOUNT value on done: 939796.0 [2024-08-06 08:11:50,841][52660] Sum rewards: 80.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.088', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.223', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:51,085][52795] DAMAGECOUNT value on done: 877321.0 [2024-08-06 08:11:51,086][52795] Sum rewards: 79.477, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.352', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.141', 'AMMO3': '0.180', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:51,483][52659] DAMAGECOUNT value on done: 954386.0 [2024-08-06 08:11:51,483][52659] Sum rewards: 76.799, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.283', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.153', 'weapon5': '0.178', 'weapon4': '0.194', 'weapon2': '0.222', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '65.000'} [2024-08-06 08:11:52,100][52820] DAMAGECOUNT value on done: 876028.0 [2024-08-06 08:11:52,100][52820] Sum rewards: 89.494, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.140', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.054', 'FRAGCOUNT': '76.000'} [2024-08-06 08:11:52,492][52662] DAMAGECOUNT value on done: 940821.0 [2024-08-06 08:11:52,492][52662] Sum rewards: 67.857, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.366', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.138', 'weapon5': '0.148', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 674283520. Throughput: 0: 4365.6. Samples: 168575660. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:52,794][52567] Avg episode reward: [(0, '75.515')] [2024-08-06 08:11:52,822][52650] Updated weights for policy 0, policy_version 82311 (0.0035) [2024-08-06 08:11:53,818][52660] DAMAGECOUNT value on done: 939048.0 [2024-08-06 08:11:53,820][52660] Sum rewards: 70.231, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.075', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.264', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.332', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '60.000'} [2024-08-06 08:11:54,152][52659] DAMAGECOUNT value on done: 946790.0 [2024-08-06 08:11:54,152][52659] Sum rewards: 76.457, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.105', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.096', 'weapon4': '0.100', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:54,307][52795] DAMAGECOUNT value on done: 869413.0 [2024-08-06 08:11:54,309][52795] Sum rewards: 77.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.122', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.088', 'weapon2': '0.186', 'AMMO4': '0.197', 'weapon5': '0.208', 'AMMO3': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '64.000'} [2024-08-06 08:11:54,311][52664] DAMAGECOUNT value on done: 976769.0 [2024-08-06 08:11:54,313][52664] Sum rewards: 78.603, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.174', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.169', 'weapon5': '0.188', 'AMMO3': '0.209', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '65.000'} [2024-08-06 08:11:56,542][52660] DAMAGECOUNT value on done: 948333.0 [2024-08-06 08:11:56,550][52660] Sum rewards: 63.984, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.525', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.122', 'AMMO4': '0.275', 'weapon5': '0.298', 'weapon2': '0.304', 'AMMO3': '0.346', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.900', 'weapon3': '2.912', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '58.000'} [2024-08-06 08:11:57,012][52659] DAMAGECOUNT value on done: 944119.0 [2024-08-06 08:11:57,015][52659] Sum rewards: 81.916, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.850', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.132', 'AMMO3': '0.210', 'weapon5': '0.216', 'AMMO4': '0.250', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '68.000'} [2024-08-06 08:11:57,153][52664] DAMAGECOUNT value on done: 982511.0 [2024-08-06 08:11:57,154][52664] Sum rewards: 80.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.278', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.090', 'weapon5': '0.106', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.318', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '66.000'} [2024-08-06 08:11:57,597][52795] DAMAGECOUNT value on done: 875726.0 [2024-08-06 08:11:57,597][52795] Sum rewards: 73.351, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.146', 'weapon4': '0.186', 'weapon2': '0.206', 'AMMO4': '0.219', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '63.000'} [2024-08-06 08:11:57,635][52650] Updated weights for policy 0, policy_version 82321 (0.0013) [2024-08-06 08:11:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 674373632. Throughput: 0: 4362.9. Samples: 168601530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:11:57,795][52567] Avg episode reward: [(0, '75.688')] [2024-08-06 08:11:58,901][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:11:59,423][52660] DAMAGECOUNT value on done: 962841.0 [2024-08-06 08:11:59,425][52660] Sum rewards: 75.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.094', 'AMMO4': '0.113', 'weapon4': '0.180', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '62.000'} [2024-08-06 08:11:59,973][52659] DAMAGECOUNT value on done: 948895.0 [2024-08-06 08:11:59,973][52659] Sum rewards: 76.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.023', 'AMMO2': '0.053', 'weapon4': '0.154', 'AMMO3': '0.204', 'weapon5': '0.252', 'AMMO4': '0.264', 'weapon2': '0.430', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '63.000'} [2024-08-06 08:12:00,015][52664] DAMAGECOUNT value on done: 986814.0 [2024-08-06 08:12:00,016][52664] Sum rewards: 88.166, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.078', 'weapon4': '0.132', 'AMMO4': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '72.000'} [2024-08-06 08:12:00,892][52795] DAMAGECOUNT value on done: 879622.0 [2024-08-06 08:12:00,894][52795] Sum rewards: 79.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.131', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '66.000'} [2024-08-06 08:12:02,303][52658] DAMAGECOUNT value on done: 951915.0 [2024-08-06 08:12:02,304][52658] Sum rewards: 74.008, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.210', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.070', 'AMMO4': '0.099', 'AMMO3': '0.144', 'weapon5': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON3': '0.900', 'weapon3': '3.096', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '58.000'} [2024-08-06 08:12:02,485][52650] Updated weights for policy 0, policy_version 82331 (0.0012) [2024-08-06 08:12:02,570][52660] DAMAGECOUNT value on done: 943196.0 [2024-08-06 08:12:02,571][52660] Sum rewards: 72.863, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.138', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.198', 'AMMO3': '0.281', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.232', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '62.000'} [2024-08-06 08:12:02,777][52664] DAMAGECOUNT value on done: 976863.0 [2024-08-06 08:12:02,778][52664] Sum rewards: 77.712, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.585', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon2': '0.372', 'WEAPON3': '0.950', 'weapon3': '3.334', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 674463744. Throughput: 0: 4358.4. Samples: 168614550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 8.0) [2024-08-06 08:12:02,795][52567] Avg episode reward: [(0, '75.950')] [2024-08-06 08:12:03,042][52659] DAMAGECOUNT value on done: 948311.0 [2024-08-06 08:12:03,042][52659] Sum rewards: 80.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.338', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.064', 'AMMO4': '0.114', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.242', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '67.500'} [2024-08-06 08:12:04,169][52795] DAMAGECOUNT value on done: 867867.0 [2024-08-06 08:12:04,170][52795] Sum rewards: 75.026, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.816', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.058', 'weapon5': '0.122', 'AMMO4': '0.163', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '63.000'} [2024-08-06 08:12:05,071][52658] DAMAGECOUNT value on done: 953161.0 [2024-08-06 08:12:05,072][52658] Sum rewards: 69.755, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.190', 'AMMO5': '0.016', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon4': '0.078', 'AMMO3': '0.174', 'weapon5': '0.186', 'AMMO4': '0.203', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '56.000'} [2024-08-06 08:12:05,431][52664] DAMAGECOUNT value on done: 991408.0 [2024-08-06 08:12:05,431][52664] Sum rewards: 76.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.142', 'weapon5': '0.182', 'AMMO4': '0.184', 'weapon2': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:05,502][52659] DAMAGECOUNT value on done: 959539.0 [2024-08-06 08:12:05,502][52659] Sum rewards: 96.560, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.996', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.044', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.203', 'WEAPON3': '1.300', 'weapon3': '3.556', 'HITCOUNT': '4.470', 'DAMAGECOUNT': '23.019', 'FRAGCOUNT': '78.000'} [2024-08-06 08:12:06,035][52660] DAMAGECOUNT value on done: 949340.0 [2024-08-06 08:12:06,038][52660] Sum rewards: 78.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO2': '0.009', 'AMMO4': '0.044', 'AMMO3': '0.181', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '64.000'} [2024-08-06 08:12:06,883][52650] Updated weights for policy 0, policy_version 82341 (0.0027) [2024-08-06 08:12:07,408][52795] DAMAGECOUNT value on done: 876793.0 [2024-08-06 08:12:07,409][52795] Sum rewards: 79.384, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.458', 'WEAPON3': '1.500', 'weapon3': '3.200', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '67.000'} [2024-08-06 08:12:07,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 674537472. Throughput: 0: 4357.7. Samples: 168640650. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:07,795][52567] Avg episode reward: [(0, '76.282')] [2024-08-06 08:12:07,998][52659] DAMAGECOUNT value on done: 940961.0 [2024-08-06 08:12:07,999][52659] Sum rewards: 84.729, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.708', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.028', 'AMMO4': '0.109', 'weapon5': '0.132', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.224', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2024-08-06 08:12:08,241][52658] DAMAGECOUNT value on done: 954733.0 [2024-08-06 08:12:08,245][52658] Sum rewards: 77.749, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.044', 'AMMO4': '0.086', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.173', 'weapon2': '0.484', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '62.000'} [2024-08-06 08:12:08,515][52660] DAMAGECOUNT value on done: 945420.0 [2024-08-06 08:12:08,517][52660] Sum rewards: 67.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.737', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.056', 'AMMO4': '0.201', 'AMMO3': '0.213', 'weapon5': '0.218', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '56.000'} [2024-08-06 08:12:08,568][52664] DAMAGECOUNT value on done: 987111.0 [2024-08-06 08:12:08,569][52664] Sum rewards: 83.240, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.592', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.096', 'weapon5': '0.126', 'AMMO4': '0.165', 'weapon2': '0.232', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.569', 'FRAGCOUNT': '69.000'} [2024-08-06 08:12:10,516][52659] DAMAGECOUNT value on done: 953348.0 [2024-08-06 08:12:10,517][52659] Sum rewards: 64.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.622', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.186', 'AMMO4': '0.190', 'AMMO3': '0.209', 'weapon2': '0.230', 'weapon4': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '54.500'} [2024-08-06 08:12:10,574][52795] DAMAGECOUNT value on done: 877311.0 [2024-08-06 08:12:10,575][52795] Sum rewards: 79.754, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.104', 'AMMO4': '0.132', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.128', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '67.000'} [2024-08-06 08:12:11,204][52664] DAMAGECOUNT value on done: 976573.0 [2024-08-06 08:12:11,204][52664] Sum rewards: 75.097, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.267', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.191', 'weapon2': '0.244', 'WEAPON3': '1.100', 'HITCOUNT': '3.400', 'weapon3': '3.474', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:11,372][52658] DAMAGECOUNT value on done: 951842.0 [2024-08-06 08:12:11,374][52658] Sum rewards: 79.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.352', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.056', 'AMMO4': '0.063', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '65.000'} [2024-08-06 08:12:11,537][52650] Updated weights for policy 0, policy_version 82351 (0.0011) [2024-08-06 08:12:11,801][52660] DAMAGECOUNT value on done: 936628.0 [2024-08-06 08:12:11,801][52660] Sum rewards: 75.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.455', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.230', 'weapon2': '0.586', 'WEAPON3': '1.500', 'weapon3': '3.134', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '64.000'} [2024-08-06 08:12:12,270][52669] DAMAGECOUNT value on done: 948687.0 [2024-08-06 08:12:12,270][52669] Sum rewards: 77.109, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.186', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '63.000'} [2024-08-06 08:12:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 674635776. Throughput: 0: 4361.6. Samples: 168666910. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:12,794][52567] Avg episode reward: [(0, '76.333')] [2024-08-06 08:12:13,570][52659] DAMAGECOUNT value on done: 945059.0 [2024-08-06 08:12:13,570][52659] Sum rewards: 79.637, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'AMMO4': '0.117', 'weapon4': '0.122', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.722', 'WEAPON3': '1.000', 'weapon3': '2.922', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '62.000'} [2024-08-06 08:12:13,826][52795] DAMAGECOUNT value on done: 864847.0 [2024-08-06 08:12:13,826][52795] Sum rewards: 77.996, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.950', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.123', 'weapon5': '0.134', 'weapon2': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '66.000'} [2024-08-06 08:12:13,872][52647] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:12:14,003][52658] DAMAGECOUNT value on done: 944107.0 [2024-08-06 08:12:14,004][52658] Sum rewards: 72.300, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.555', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'AMMO3': '0.136', 'AMMO4': '0.151', 'weapon2': '0.496', 'WEAPON3': '0.850', 'weapon3': '3.130', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '55.000'} [2024-08-06 08:12:14,149][52664] DAMAGECOUNT value on done: 977987.0 [2024-08-06 08:12:14,150][52664] Sum rewards: 76.392, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.768', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.122', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '64.000'} [2024-08-06 08:12:14,387][52660] DAMAGECOUNT value on done: 938949.0 [2024-08-06 08:12:14,389][52660] Sum rewards: 77.460, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.027', 'AMMO2': '0.073', 'AMMO3': '0.203', 'weapon5': '0.290', 'weapon2': '0.336', 'AMMO4': '0.364', 'weapon4': '0.446', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.614', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '63.000'} [2024-08-06 08:12:15,263][52669] DAMAGECOUNT value on done: 946546.0 [2024-08-06 08:12:15,264][52669] Sum rewards: 74.319, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.118', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.420', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:15,637][52664] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.498, 166.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:12:16,528][52650] Updated weights for policy 0, policy_version 82361 (0.0013) [2024-08-06 08:12:16,654][52664] DAMAGECOUNT value on done: 984531.0 [2024-08-06 08:12:16,654][52664] Sum rewards: 71.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.012', 'AMMO2': '0.047', 'AMMO3': '0.162', 'weapon5': '0.204', 'weapon4': '0.226', 'AMMO4': '0.232', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.928', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.715', 'FRAGCOUNT': '56.500'} [2024-08-06 08:12:16,781][52658] DAMAGECOUNT value on done: 942400.0 [2024-08-06 08:12:16,781][52658] Sum rewards: 73.066, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.240', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.094', 'AMMO4': '0.124', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'weapon2': '0.348', 'WEAPON3': '0.850', 'weapon3': '3.074', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '57.000'} [2024-08-06 08:12:16,978][52795] DAMAGECOUNT value on done: 874652.0 [2024-08-06 08:12:16,979][52795] Sum rewards: 87.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'AMMO2': '0.041', 'weapon5': '0.090', 'weapon4': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.205', 'weapon2': '0.216', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.394', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '73.000'} [2024-08-06 08:12:17,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 674717696. Throughput: 0: 4359.3. Samples: 168679850. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:17,795][52567] Avg episode reward: [(0, '76.273')] [2024-08-06 08:12:18,144][52669] DAMAGECOUNT value on done: 958120.0 [2024-08-06 08:12:18,144][52669] Sum rewards: 87.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.832', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.105', 'weapon5': '0.108', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.380', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '69.000'} [2024-08-06 08:12:18,324][52671] DAMAGECOUNT value on done: 954979.0 [2024-08-06 08:12:18,325][52671] Sum rewards: 90.313, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.222', 'AMMO3': '0.257', 'WEAPON3': '1.400', 'weapon3': '3.424', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.495', 'FRAGCOUNT': '75.000'} [2024-08-06 08:12:19,491][52664] DAMAGECOUNT value on done: 983945.0 [2024-08-06 08:12:19,492][52664] Sum rewards: 65.032, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.275', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.092', 'weapon5': '0.132', 'AMMO3': '0.140', 'AMMO4': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON3': '0.950', 'weapon3': '3.068', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.516', 'FRAGCOUNT': '53.000'} [2024-08-06 08:12:20,098][52658] DAMAGECOUNT value on done: 955433.0 [2024-08-06 08:12:20,099][52658] Sum rewards: 71.531, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.432', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.074', 'weapon5': '0.160', 'AMMO4': '0.189', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.500', 'weapon3': '3.084', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:20,439][52795] DAMAGECOUNT value on done: 882297.0 [2024-08-06 08:12:20,440][52795] Sum rewards: 76.908, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.438', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.174', 'AMMO3': '0.208', 'weapon4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '62.000'} [2024-08-06 08:12:20,697][52671] DAMAGECOUNT value on done: 960239.0 [2024-08-06 08:12:20,699][52671] Sum rewards: 65.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.930', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.176', 'weapon4': '0.188', 'AMMO4': '0.219', 'AMMO3': '0.251', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.740', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '56.000'} [2024-08-06 08:12:21,148][52650] Updated weights for policy 0, policy_version 82371 (0.0038) [2024-08-06 08:12:21,286][52669] DAMAGECOUNT value on done: 948454.0 [2024-08-06 08:12:21,286][52669] Sum rewards: 80.522, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.084', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO3': '0.207', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '66.000'} [2024-08-06 08:12:22,540][52664] DAMAGECOUNT value on done: 992155.0 [2024-08-06 08:12:22,541][52664] Sum rewards: 68.173, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-1.418', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon5': '0.108', 'weapon4': '0.176', 'WEAPON5': '0.250', 'AMMO4': '0.274', 'AMMO3': '0.288', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.060', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17478.0, 300 sec: 17494.8). Total num frames: 674807808. Throughput: 0: 4360.2. Samples: 168706130. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:22,794][52567] Avg episode reward: [(0, '76.381')] [2024-08-06 08:12:23,110][52671] DAMAGECOUNT value on done: 954329.0 [2024-08-06 08:12:23,112][52671] Sum rewards: 69.250, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.110', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon4': '0.024', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.145', 'weapon2': '0.516', 'WEAPON3': '0.850', 'HITCOUNT': '3.140', 'weapon3': '3.242', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.000'} [2024-08-06 08:12:23,209][52658] DAMAGECOUNT value on done: 944028.0 [2024-08-06 08:12:23,210][52658] Sum rewards: 61.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO5': '0.008', 'weapon4': '0.034', 'AMMO2': '0.038', 'weapon5': '0.054', 'AMMO4': '0.192', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.228', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.530', 'DAMAGECOUNT': '15.345', 'FRAGCOUNT': '51.000'} [2024-08-06 08:12:24,377][52669] DAMAGECOUNT value on done: 957340.0 [2024-08-06 08:12:24,379][52669] Sum rewards: 70.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.914', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.173', 'weapon5': '0.178', 'AMMO3': '0.217', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '57.000'} [2024-08-06 08:12:25,474][52671] DAMAGECOUNT value on done: 958844.0 [2024-08-06 08:12:25,475][52671] Sum rewards: 76.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.280', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.099', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.306', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.290', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '63.000'} [2024-08-06 08:12:25,664][52650] Updated weights for policy 0, policy_version 82381 (0.0015) [2024-08-06 08:12:25,809][52664] DAMAGECOUNT value on done: 986849.0 [2024-08-06 08:12:25,810][52664] Sum rewards: 78.636, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.017', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'weapon5': '0.148', 'AMMO3': '0.171', 'WEAPON5': '0.200', 'weapon2': '0.688', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '63.000'} [2024-08-06 08:12:26,366][52658] DAMAGECOUNT value on done: 970710.0 [2024-08-06 08:12:26,368][52658] Sum rewards: 87.582, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.535', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.097', 'weapon5': '0.138', 'weapon2': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'WEAPON3': '1.550', 'weapon3': '3.440', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '73.000'} [2024-08-06 08:12:27,379][52669] DAMAGECOUNT value on done: 955373.0 [2024-08-06 08:12:27,380][52669] Sum rewards: 73.202, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.026', 'weapon5': '0.038', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.254', 'WEAPON3': '1.400', 'weapon3': '3.526', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '60.000'} [2024-08-06 08:12:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 674897920. Throughput: 0: 4352.4. Samples: 168732240. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:27,795][52567] Avg episode reward: [(0, '76.404')] [2024-08-06 08:12:27,806][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082385_674897920.pth... [2024-08-06 08:12:27,950][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000081873_670703616.pth [2024-08-06 08:12:28,517][52671] DAMAGECOUNT value on done: 966566.0 [2024-08-06 08:12:28,519][52671] Sum rewards: 94.325, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.782', 'AMMO2': '0.003', 'AMMO4': '0.015', 'AMMO3': '0.168', 'weapon2': '0.548', 'WEAPON3': '1.100', 'weapon3': '3.300', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.312', 'FRAGCOUNT': '75.000'} [2024-08-06 08:12:28,740][52664] DAMAGECOUNT value on done: 987818.0 [2024-08-06 08:12:28,741][52664] Sum rewards: 62.869, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.940', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.159', 'weapon2': '0.174', 'weapon4': '0.178', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'HITCOUNT': '3.040', 'weapon3': '3.262', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '56.000'} [2024-08-06 08:12:29,394][52658] DAMAGECOUNT value on done: 957539.0 [2024-08-06 08:12:29,395][52658] Sum rewards: 83.615, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.658', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.326', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '68.000'} [2024-08-06 08:12:29,784][52669] DAMAGECOUNT value on done: 954934.0 [2024-08-06 08:12:29,784][52669] Sum rewards: 81.478, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.598', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.090', 'AMMO4': '0.246', 'weapon5': '0.246', 'weapon2': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.074', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '69.000'} [2024-08-06 08:12:30,826][52650] Updated weights for policy 0, policy_version 82391 (0.0014) [2024-08-06 08:12:31,019][52671] DAMAGECOUNT value on done: 952747.0 [2024-08-06 08:12:31,022][52671] Sum rewards: 74.869, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.005', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon5': '0.028', 'AMMO4': '0.036', 'weapon4': '0.040', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:32,045][52664] DAMAGECOUNT value on done: 1000410.0 [2024-08-06 08:12:32,045][52664] Sum rewards: 66.006, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.225', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.162', 'AMMO3': '0.186', 'AMMO4': '0.218', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.120', 'weapon3': '3.150', 'DAMAGECOUNT': '15.924', 'FRAGCOUNT': '54.000'} [2024-08-06 08:12:32,230][52669] DAMAGECOUNT value on done: 953822.0 [2024-08-06 08:12:32,232][52669] Sum rewards: 85.708, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.181', 'AMMO4': '0.190', 'weapon5': '0.196', 'weapon4': '0.218', 'HEALTH': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '69.000'} [2024-08-06 08:12:32,542][52658] DAMAGECOUNT value on done: 961650.0 [2024-08-06 08:12:32,543][52658] Sum rewards: 68.102, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.382', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.128', 'AMMO4': '0.159', 'AMMO3': '0.202', 'weapon4': '0.228', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.146', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.224', 'FRAGCOUNT': '57.500'} [2024-08-06 08:12:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 674979840. Throughput: 0: 4347.6. Samples: 168745270. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:32,795][52567] Avg episode reward: [(0, '76.480')] [2024-08-06 08:12:32,881][52663] DAMAGECOUNT value on done: 967839.0 [2024-08-06 08:12:32,881][52663] Sum rewards: 67.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.190', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.110', 'weapon5': '0.130', 'AMMO4': '0.212', 'AMMO3': '0.258', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'HITCOUNT': '3.150', 'weapon3': '3.188', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '60.000'} [2024-08-06 08:12:33,574][52671] DAMAGECOUNT value on done: 954899.0 [2024-08-06 08:12:33,576][52671] Sum rewards: 77.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.005', 'weapon5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.016', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.306', 'WEAPON3': '1.400', 'weapon3': '3.506', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '65.000'} [2024-08-06 08:12:34,944][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:12:34,947][52664] DAMAGECOUNT value on done: 996527.0 [2024-08-06 08:12:34,949][52664] Sum rewards: 78.920, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.118', 'weapon5': '0.150', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '65.000'} [2024-08-06 08:12:35,251][52650] Updated weights for policy 0, policy_version 82401 (0.0013) [2024-08-06 08:12:35,273][52811] DAMAGECOUNT value on done: 899250.0 [2024-08-06 08:12:35,273][52811] Sum rewards: 66.516, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.200', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.203', 'weapon5': '0.212', 'AMMO4': '0.266', 'weapon4': '0.278', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.914', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '55.000'} [2024-08-06 08:12:35,313][52669] DAMAGECOUNT value on done: 963692.0 [2024-08-06 08:12:35,313][52669] Sum rewards: 88.200, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.925', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.058', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'AMMO3': '0.190', 'weapon2': '0.358', 'WEAPON3': '1.150', 'weapon3': '3.404', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '72.000'} [2024-08-06 08:12:35,826][52658] DAMAGECOUNT value on done: 948494.0 [2024-08-06 08:12:35,826][52658] Sum rewards: 83.339, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.644', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.090', 'AMMO4': '0.177', 'weapon2': '0.222', 'weapon5': '0.226', 'AMMO3': '0.281', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.116', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '71.000'} [2024-08-06 08:12:35,893][52663] DAMAGECOUNT value on done: 950719.0 [2024-08-06 08:12:35,894][52663] Sum rewards: 73.893, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.134', 'AMMO3': '0.184', 'AMMO4': '0.189', 'weapon4': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.044', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '59.000'} [2024-08-06 08:12:36,582][52671] DAMAGECOUNT value on done: 960177.0 [2024-08-06 08:12:36,584][52671] Sum rewards: 81.635, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.434', 'AMMO5': '0.010', 'ARMOR': '0.016', 'AMMO2': '0.039', 'weapon5': '0.182', 'weapon4': '0.190', 'AMMO4': '0.196', 'AMMO3': '0.220', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '67.000'} [2024-08-06 08:12:37,497][52664] DAMAGECOUNT value on done: 995168.0 [2024-08-06 08:12:37,497][52664] Sum rewards: 62.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.961', 'AMMO5': '0.006', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.084', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.534', 'WEAPON3': '1.400', 'weapon3': '3.014', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '53.000'} [2024-08-06 08:12:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 675069952. Throughput: 0: 4345.3. Samples: 168771200. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:37,794][52567] Avg episode reward: [(0, '76.786')] [2024-08-06 08:12:37,890][52669] DAMAGECOUNT value on done: 955709.0 [2024-08-06 08:12:37,891][52669] Sum rewards: 85.550, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon7': '0.050', 'AMMO4': '0.071', 'weapon5': '0.090', 'AMMO6': '0.160', 'AMMO7': '0.160', 'AMMO3': '0.171', 'weapon4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON7': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.050', 'weapon3': '2.990', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '69.000'} [2024-08-06 08:12:37,990][52666] Large shaping reward 2.549 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.081, -27.0)] [2024-08-06 08:12:38,490][52663] DAMAGECOUNT value on done: 945660.0 [2024-08-06 08:12:38,491][52663] Sum rewards: 58.194, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.286', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.088', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.338', 'WEAPON3': '1.200', 'HITCOUNT': '3.050', 'weapon3': '3.158', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '48.000'} [2024-08-06 08:12:38,510][52811] DAMAGECOUNT value on done: 883248.0 [2024-08-06 08:12:38,510][52811] Sum rewards: 70.836, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.506', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.266', 'weapon2': '0.330', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 08:12:38,929][52658] DAMAGECOUNT value on done: 960181.0 [2024-08-06 08:12:38,938][52658] Sum rewards: 85.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.649', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.088', 'AMMO4': '0.178', 'AMMO3': '0.211', 'weapon4': '0.240', 'weapon2': '0.274', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.142', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.636', 'FRAGCOUNT': '69.500'} [2024-08-06 08:12:39,436][52671] DAMAGECOUNT value on done: 941522.0 [2024-08-06 08:12:39,436][52671] Sum rewards: 74.308, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.335', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.134', 'AMMO3': '0.157', 'AMMO4': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '0.950', 'weapon3': '2.980', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '59.000'} [2024-08-06 08:12:39,888][52664] DAMAGECOUNT value on done: 978232.0 [2024-08-06 08:12:39,888][52664] Sum rewards: 81.978, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.914', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.182', 'weapon4': '0.190', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '68.000'} [2024-08-06 08:12:40,108][52650] Updated weights for policy 0, policy_version 82411 (0.0010) [2024-08-06 08:12:40,750][52669] DAMAGECOUNT value on done: 961540.0 [2024-08-06 08:12:40,750][52669] Sum rewards: 68.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.074', 'AMMO4': '0.081', 'weapon4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '56.000'} [2024-08-06 08:12:40,967][52794] DAMAGECOUNT value on done: 945692.0 [2024-08-06 08:12:40,967][52794] Sum rewards: 89.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.153', 'weapon2': '0.184', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.524', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.711', 'FRAGCOUNT': '72.000'} [2024-08-06 08:12:41,375][52663] DAMAGECOUNT value on done: 952069.0 [2024-08-06 08:12:41,378][52663] Sum rewards: 81.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.564', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.145', 'weapon5': '0.166', 'AMMO3': '0.225', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.260', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '68.000'} [2024-08-06 08:12:41,669][52811] DAMAGECOUNT value on done: 879095.0 [2024-08-06 08:12:41,670][52811] Sum rewards: 85.607, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.585', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.214', 'weapon2': '0.360', 'WEAPON3': '1.250', 'weapon3': '3.394', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '70.000'} [2024-08-06 08:12:42,058][52658] DAMAGECOUNT value on done: 948954.0 [2024-08-06 08:12:42,059][52658] Sum rewards: 78.084, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.640', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.032', 'AMMO4': '0.040', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.286', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '64.000'} [2024-08-06 08:12:42,324][52671] DAMAGECOUNT value on done: 956104.0 [2024-08-06 08:12:42,325][52671] Sum rewards: 70.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.757', 'AMMO5': '0.003', 'AMMO2': '0.040', 'weapon5': '0.078', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '59.000'} [2024-08-06 08:12:42,561][52664] Large shaping reward 2.583 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.561, 187.0), ('weapon5', 0.002)] [2024-08-06 08:12:42,594][52664] DAMAGECOUNT value on done: 981555.0 [2024-08-06 08:12:42,594][52664] Sum rewards: 72.476, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.410', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.080', 'AMMO4': '0.151', 'weapon5': '0.158', 'AMMO3': '0.181', 'weapon2': '0.292', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'HITCOUNT': '3.220', 'weapon3': '3.226', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '59.000'} [2024-08-06 08:12:42,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 675160064. Throughput: 0: 4356.9. Samples: 168797590. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:42,794][52567] Avg episode reward: [(0, '76.686')] [2024-08-06 08:12:43,336][52794] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:12:43,377][52669] DAMAGECOUNT value on done: 960735.0 [2024-08-06 08:12:43,379][52669] Sum rewards: 78.173, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.846', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.124', 'weapon5': '0.130', 'WEAPON4': '0.200', 'AMMO4': '0.205', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '64.500'} [2024-08-06 08:12:44,073][52663] DAMAGECOUNT value on done: 951554.0 [2024-08-06 08:12:44,073][52663] Sum rewards: 80.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.401', 'AMMO5': '0.021', 'AMMO2': '0.056', 'weapon5': '0.162', 'weapon2': '0.166', 'AMMO3': '0.169', 'weapon4': '0.242', 'AMMO4': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '65.000'} [2024-08-06 08:12:44,112][52794] DAMAGECOUNT value on done: 954630.0 [2024-08-06 08:12:44,113][52794] Sum rewards: 59.668, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.884', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.042', 'AMMO4': '0.139', 'weapon4': '0.164', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.654', 'WEAPON3': '1.050', 'HITCOUNT': '2.890', 'weapon3': '2.976', 'DAMAGECOUNT': '14.787', 'FRAGCOUNT': '48.000'} [2024-08-06 08:12:44,474][52650] Updated weights for policy 0, policy_version 82421 (0.0012) [2024-08-06 08:12:44,695][52811] DAMAGECOUNT value on done: 882880.0 [2024-08-06 08:12:44,696][52811] Sum rewards: 68.444, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.756', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.090', 'weapon5': '0.168', 'AMMO4': '0.195', 'AMMO3': '0.252', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '59.500'} [2024-08-06 08:12:44,770][52658] DAMAGECOUNT value on done: 955442.0 [2024-08-06 08:12:44,770][52658] Sum rewards: 63.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.334', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.098', 'AMMO4': '0.215', 'weapon5': '0.226', 'AMMO3': '0.255', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'HITCOUNT': '3.020', 'weapon3': '3.028', 'DAMAGECOUNT': '16.422', 'FRAGCOUNT': '56.000'} [2024-08-06 08:12:45,071][52664] DAMAGECOUNT value on done: 992389.0 [2024-08-06 08:12:45,073][52664] Sum rewards: 83.630, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.101', 'weapon4': '0.164', 'AMMO3': '0.217', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '69.000'} [2024-08-06 08:12:45,226][52671] DAMAGECOUNT value on done: 953891.0 [2024-08-06 08:12:45,226][52671] Sum rewards: 81.761, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon5': '0.012', 'weapon4': '0.026', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'HEALTH': '0.139', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon2': '0.832', 'WEAPON3': '1.000', 'weapon3': '2.938', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '66.000'} [2024-08-06 08:12:45,952][52669] DAMAGECOUNT value on done: 946978.0 [2024-08-06 08:12:45,954][52669] Sum rewards: 71.733, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon5': '0.126', 'weapon2': '0.156', 'AMMO4': '0.213', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '60.000'} [2024-08-06 08:12:46,962][52663] DAMAGECOUNT value on done: 958968.0 [2024-08-06 08:12:46,963][52663] Sum rewards: 75.981, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.180', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon5': '0.114', 'AMMO4': '0.184', 'weapon2': '0.224', 'weapon4': '0.236', 'AMMO3': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.142', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '66.000'} [2024-08-06 08:12:47,012][52794] DAMAGECOUNT value on done: 960433.0 [2024-08-06 08:12:47,014][52794] Sum rewards: 73.070, reward structure: {'DEATHCOUNT': '-15.750', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.086', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'weapon5': '0.214', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.324', 'HEALTH': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '60.000'} [2024-08-06 08:12:47,788][52811] DAMAGECOUNT value on done: 886351.0 [2024-08-06 08:12:47,789][52811] Sum rewards: 75.326, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.497', 'AMMO5': '0.012', 'AMMO2': '0.062', 'weapon5': '0.136', 'weapon4': '0.204', 'weapon2': '0.252', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'AMMO4': '0.311', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.124', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '63.000'} [2024-08-06 08:12:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 675250176. Throughput: 0: 4360.0. Samples: 168810750. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:47,794][52567] Avg episode reward: [(0, '76.317')] [2024-08-06 08:12:47,795][52671] DAMAGECOUNT value on done: 954483.0 [2024-08-06 08:12:47,795][52671] Sum rewards: 75.072, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.042', 'AMMO5': '0.005', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.058', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon4': '0.240', 'weapon2': '0.626', 'WEAPON3': '0.950', 'weapon3': '2.926', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '60.000'} [2024-08-06 08:12:48,017][52658] DAMAGECOUNT value on done: 938419.0 [2024-08-06 08:12:48,018][52658] Sum rewards: 79.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.950', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.654', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '64.000'} [2024-08-06 08:12:48,151][52664] DAMAGECOUNT value on done: 978564.0 [2024-08-06 08:12:48,151][52664] Sum rewards: 80.520, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.293', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.106', 'AMMO4': '0.179', 'weapon4': '0.180', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.232', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '66.000'} [2024-08-06 08:12:48,992][52669] DAMAGECOUNT value on done: 946866.0 [2024-08-06 08:12:48,996][52669] Sum rewards: 75.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.769', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.052', 'AMMO4': '0.078', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '3.156', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '64.000'} [2024-08-06 08:12:49,254][52650] Updated weights for policy 0, policy_version 82431 (0.0021) [2024-08-06 08:12:50,005][52663] DAMAGECOUNT value on done: 950147.0 [2024-08-06 08:12:50,006][52663] Sum rewards: 80.128, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.014', 'AMMO4': '0.057', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.346', 'WEAPON3': '1.450', 'weapon3': '3.458', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '67.000'} [2024-08-06 08:12:50,069][52794] DAMAGECOUNT value on done: 946352.0 [2024-08-06 08:12:50,072][52794] Sum rewards: 72.878, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.213', 'weapon4': '0.248', 'AMMO4': '0.269', 'weapon2': '0.290', 'weapon5': '0.330', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.784', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '59.000'} [2024-08-06 08:12:50,213][52671] DAMAGECOUNT value on done: 955301.0 [2024-08-06 08:12:50,213][52671] Sum rewards: 79.544, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.124', 'weapon4': '0.250', 'weapon2': '0.418', 'WEAPON3': '0.850', 'weapon3': '3.186', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '62.000'} [2024-08-06 08:12:50,831][52811] DAMAGECOUNT value on done: 902502.0 [2024-08-06 08:12:50,835][52811] Sum rewards: 85.968, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.825', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon4': '0.202', 'weapon5': '0.224', 'AMMO3': '0.236', 'weapon2': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.862', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '21.864', 'FRAGCOUNT': '71.500'} [2024-08-06 08:12:51,047][52658] DAMAGECOUNT value on done: 953820.0 [2024-08-06 08:12:51,049][52658] Sum rewards: 68.931, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.500', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.070', 'AMMO4': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.316', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.390', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '58.500'} [2024-08-06 08:12:52,055][52669] DAMAGECOUNT value on done: 956483.0 [2024-08-06 08:12:52,057][52669] Sum rewards: 81.527, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.155', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.089', 'AMMO3': '0.222', 'weapon2': '0.568', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '68.000'} [2024-08-06 08:12:52,355][52665] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:12:52,694][52671] DAMAGECOUNT value on done: 956427.0 [2024-08-06 08:12:52,696][52671] Sum rewards: 85.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.763', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.074', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '68.000'} [2024-08-06 08:12:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 675332096. Throughput: 0: 4374.0. Samples: 168837480. Policy #0 lag: (min: 0.0, avg: 4.1, max: 9.0) [2024-08-06 08:12:52,794][52567] Avg episode reward: [(0, '76.547')] [2024-08-06 08:12:53,058][52794] DAMAGECOUNT value on done: 941385.0 [2024-08-06 08:12:53,060][52794] Sum rewards: 90.126, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.802', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.073', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.501', 'FRAGCOUNT': '74.000'} [2024-08-06 08:12:53,251][52663] DAMAGECOUNT value on done: 934732.0 [2024-08-06 08:12:53,253][52663] Sum rewards: 94.917, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO5': '0.017', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.102', 'weapon5': '0.146', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.864', 'FRAGCOUNT': '75.000'} [2024-08-06 08:12:53,929][52650] Updated weights for policy 0, policy_version 82441 (0.0010) [2024-08-06 08:12:54,001][52811] DAMAGECOUNT value on done: 893709.0 [2024-08-06 08:12:54,002][52811] Sum rewards: 71.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.378', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.112', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.204', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '59.000'} [2024-08-06 08:12:54,245][52658] DAMAGECOUNT value on done: 949414.0 [2024-08-06 08:12:54,250][52658] Sum rewards: 83.336, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'weapon4': '0.296', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.028', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '68.000'} [2024-08-06 08:12:55,269][52669] DAMAGECOUNT value on done: 975875.0 [2024-08-06 08:12:55,283][52669] Sum rewards: 73.205, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.079', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.134', 'weapon5': '0.208', 'AMMO3': '0.224', 'AMMO4': '0.299', 'weapon2': '0.362', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.002', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:55,499][52671] DAMAGECOUNT value on done: 939188.0 [2024-08-06 08:12:55,499][52671] Sum rewards: 71.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.362', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.062', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon4': '0.282', 'weapon2': '0.452', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '58.000'} [2024-08-06 08:12:55,624][52794] DAMAGECOUNT value on done: 945476.0 [2024-08-06 08:12:55,626][52794] Sum rewards: 72.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.026', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.056', 'AMMO4': '0.108', 'weapon5': '0.116', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.562', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '62.000'} [2024-08-06 08:12:56,323][52663] DAMAGECOUNT value on done: 947976.0 [2024-08-06 08:12:56,324][52663] Sum rewards: 72.962, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.033', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.128', 'AMMO3': '0.164', 'AMMO4': '0.199', 'weapon4': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.652', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.139', 'FRAGCOUNT': '58.000'} [2024-08-06 08:12:56,990][52803] Large shaping reward -2.527 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HITCOUNT', 0.01, 1.0), ('DAMAGECOUNT', 0.012, 4.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:12:57,260][52811] DAMAGECOUNT value on done: 880294.0 [2024-08-06 08:12:57,262][52811] Sum rewards: 79.963, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.578', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '64.000'} [2024-08-06 08:12:57,515][52658] DAMAGECOUNT value on done: 944950.0 [2024-08-06 08:12:57,515][52658] Sum rewards: 78.163, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.168', 'AMMO4': '0.171', 'AMMO3': '0.198', 'HEALTH': '0.206', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.340', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '2.854', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '61.000'} [2024-08-06 08:12:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 675422208. Throughput: 0: 4358.4. Samples: 168863040. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:12:57,794][52567] Avg episode reward: [(0, '76.737')] [2024-08-06 08:12:58,313][52794] DAMAGECOUNT value on done: 951310.0 [2024-08-06 08:12:58,314][52794] Sum rewards: 81.647, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.132', 'AMMO2': '0.013', 'AMMO4': '0.067', 'AMMO3': '0.251', 'weapon2': '0.408', 'WEAPON3': '1.500', 'weapon3': '3.440', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '69.000'} [2024-08-06 08:12:58,387][52669] DAMAGECOUNT value on done: 962883.0 [2024-08-06 08:12:58,388][52669] Sum rewards: 72.451, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.211', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.177', 'weapon5': '0.204', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.060', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '60.500'} [2024-08-06 08:12:58,400][52671] DAMAGECOUNT value on done: 966098.0 [2024-08-06 08:12:58,401][52671] Sum rewards: 75.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'weapon4': '0.268', 'weapon2': '0.690', 'WEAPON3': '1.100', 'weapon3': '2.712', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '59.000'} [2024-08-06 08:12:58,702][52650] Updated weights for policy 0, policy_version 82451 (0.0019) [2024-08-06 08:12:59,348][52663] DAMAGECOUNT value on done: 947980.0 [2024-08-06 08:12:59,349][52663] Sum rewards: 95.046, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.195', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.138', 'weapon4': '0.166', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '4.350', 'DAMAGECOUNT': '21.255', 'FRAGCOUNT': '76.000'} [2024-08-06 08:12:59,985][52614] Signal inference workers to stop experience collection... (15100 times) [2024-08-06 08:12:59,988][52614] Signal inference workers to resume experience collection... (15100 times) [2024-08-06 08:13:00,030][52650] InferenceWorker_p0-w0: stopping experience collection (15100 times) [2024-08-06 08:13:00,080][52650] InferenceWorker_p0-w0: resuming experience collection (15100 times) [2024-08-06 08:13:00,292][52811] DAMAGECOUNT value on done: 889328.0 [2024-08-06 08:13:00,305][52811] Sum rewards: 73.354, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.865', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon5': '0.154', 'weapon4': '0.190', 'weapon2': '0.218', 'AMMO4': '0.242', 'AMMO3': '0.288', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '62.000'} [2024-08-06 08:13:00,652][52794] DAMAGECOUNT value on done: 938433.0 [2024-08-06 08:13:00,652][52794] Sum rewards: 62.725, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.637', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.076', 'AMMO4': '0.155', 'weapon5': '0.176', 'weapon2': '0.218', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.240', 'DAMAGECOUNT': '15.687', 'FRAGCOUNT': '53.000'} [2024-08-06 08:13:00,780][52658] DAMAGECOUNT value on done: 953327.0 [2024-08-06 08:13:00,781][52658] Sum rewards: 72.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.845', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.237', 'AMMO4': '0.245', 'weapon2': '0.304', 'weapon5': '0.312', 'weapon4': '0.452', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.548', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 08:13:01,125][52669] DAMAGECOUNT value on done: 960610.0 [2024-08-06 08:13:01,127][52669] Sum rewards: 85.220, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.715', 'AMMO2': '0.011', 'AMMO4': '0.052', 'AMMO3': '0.156', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.464', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '68.000'} [2024-08-06 08:13:01,613][52671] DAMAGECOUNT value on done: 962809.0 [2024-08-06 08:13:01,614][52671] Sum rewards: 65.059, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.438', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.150', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.268', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '55.500'} [2024-08-06 08:13:01,693][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:13:02,054][52663] DAMAGECOUNT value on done: 955439.0 [2024-08-06 08:13:02,055][52663] Sum rewards: 72.545, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.161', 'weapon2': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 675504128. Throughput: 0: 4363.4. Samples: 168876200. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:02,794][52567] Avg episode reward: [(0, '76.423')] [2024-08-06 08:13:03,145][52650] Updated weights for policy 0, policy_version 82461 (0.0031) [2024-08-06 08:13:03,267][52794] DAMAGECOUNT value on done: 953124.0 [2024-08-06 08:13:03,269][52794] Sum rewards: 80.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.005', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.162', 'AMMO4': '0.166', 'AMMO3': '0.172', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'weapon3': '3.470', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '65.000'} [2024-08-06 08:13:03,433][52811] DAMAGECOUNT value on done: 888710.0 [2024-08-06 08:13:03,434][52811] Sum rewards: 72.239, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.875', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.072', 'weapon4': '0.112', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'weapon2': '0.298', 'WEAPON3': '1.650', 'weapon3': '3.290', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '62.000'} [2024-08-06 08:13:04,131][52669] DAMAGECOUNT value on done: 965388.0 [2024-08-06 08:13:04,133][52669] Sum rewards: 71.351, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.055', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.092', 'AMMO4': '0.175', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:04,642][52671] DAMAGECOUNT value on done: 956623.0 [2024-08-06 08:13:04,644][52671] Sum rewards: 73.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.019', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.188', 'weapon5': '0.226', 'weapon4': '0.350', 'weapon2': '0.448', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.722', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:05,079][52663] DAMAGECOUNT value on done: 939376.0 [2024-08-06 08:13:05,080][52663] Sum rewards: 70.108, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO4': '0.199', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:05,920][52794] DAMAGECOUNT value on done: 949597.0 [2024-08-06 08:13:05,921][52794] Sum rewards: 87.378, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.885', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.132', 'weapon5': '0.140', 'AMMO4': '0.175', 'weapon2': '0.256', 'AMMO3': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '75.000'} [2024-08-06 08:13:06,526][52811] DAMAGECOUNT value on done: 893428.0 [2024-08-06 08:13:06,527][52811] Sum rewards: 82.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.195', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.079', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.542', 'WEAPON3': '1.100', 'weapon3': '3.136', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '66.000'} [2024-08-06 08:13:06,986][52669] DAMAGECOUNT value on done: 966664.0 [2024-08-06 08:13:06,986][52669] Sum rewards: 79.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.990', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '65.000'} [2024-08-06 08:13:07,405][52671] DAMAGECOUNT value on done: 961642.0 [2024-08-06 08:13:07,406][52671] Sum rewards: 79.637, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.124', 'weapon5': '0.124', 'AMMO4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.260', 'HEALTH': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.316', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '64.000'} [2024-08-06 08:13:07,773][52663] DAMAGECOUNT value on done: 935543.0 [2024-08-06 08:13:07,773][52663] Sum rewards: 73.746, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.222', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.110', 'AMMO3': '0.205', 'AMMO4': '0.269', 'weapon5': '0.278', 'weapon2': '0.432', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 675594240. Throughput: 0: 4358.2. Samples: 168902250. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:07,794][52567] Avg episode reward: [(0, '76.485')] [2024-08-06 08:13:08,347][52650] Updated weights for policy 0, policy_version 82471 (0.0017) [2024-08-06 08:13:08,556][52794] DAMAGECOUNT value on done: 940446.0 [2024-08-06 08:13:08,558][52794] Sum rewards: 79.596, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.984', 'AMMO4': '-0.011', 'AMMO2': '-0.002', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON5': '0.050', 'AMMO3': '0.189', 'weapon2': '0.298', 'WEAPON3': '1.250', 'HITCOUNT': '3.410', 'weapon3': '3.570', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '66.000'} [2024-08-06 08:13:09,616][52811] DAMAGECOUNT value on done: 899621.0 [2024-08-06 08:13:09,616][52811] Sum rewards: 76.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.882', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.192', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.922', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '62.000'} [2024-08-06 08:13:10,340][52671] DAMAGECOUNT value on done: 944605.0 [2024-08-06 08:13:10,340][52671] Sum rewards: 80.273, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.205', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.092', 'AMMO4': '0.092', 'weapon5': '0.122', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.590', 'WEAPON3': '0.900', 'weapon3': '2.992', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '64.000'} [2024-08-06 08:13:10,600][52663] DAMAGECOUNT value on done: 945733.0 [2024-08-06 08:13:10,601][52663] Sum rewards: 85.312, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.815', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.262', 'WEAPON3': '1.550', 'weapon3': '3.460', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '71.000'} [2024-08-06 08:13:11,168][52794] DAMAGECOUNT value on done: 955596.0 [2024-08-06 08:13:11,170][52794] Sum rewards: 69.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.104', 'AMMO4': '0.166', 'AMMO3': '0.188', 'weapon4': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '57.000'} [2024-08-06 08:13:11,814][52670] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:13:12,533][52650] Updated weights for policy 0, policy_version 82481 (0.0029) [2024-08-06 08:13:12,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17522.5). Total num frames: 675684352. Throughput: 0: 4356.7. Samples: 168928290. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:12,794][52567] Avg episode reward: [(0, '76.301')] [2024-08-06 08:13:12,801][52811] DAMAGECOUNT value on done: 890144.0 [2024-08-06 08:13:12,801][52811] Sum rewards: 84.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.162', 'AMMO4': '0.167', 'AMMO3': '0.206', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '67.000'} [2024-08-06 08:13:13,327][52663] DAMAGECOUNT value on done: 947396.0 [2024-08-06 08:13:13,329][52663] Sum rewards: 73.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.672', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.086', 'AMMO4': '0.158', 'AMMO3': '0.193', 'weapon5': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.930', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '63.000'} [2024-08-06 08:13:13,785][52794] DAMAGECOUNT value on done: 950137.0 [2024-08-06 08:13:13,786][52794] Sum rewards: 91.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.500', 'AMMO5': '0.012', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.212', 'WEAPON4': '0.250', 'weapon4': '0.252', 'AMMO3': '0.262', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.022', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '22.332', 'FRAGCOUNT': '76.000'} [2024-08-06 08:13:15,952][52811] DAMAGECOUNT value on done: 888157.0 [2024-08-06 08:13:15,954][52811] Sum rewards: 80.151, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.266', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.082', 'AMMO3': '0.119', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.466', 'weapon2': '0.736', 'WEAPON3': '0.750', 'weapon3': '2.564', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '62.000'} [2024-08-06 08:13:16,504][52663] DAMAGECOUNT value on done: 950915.0 [2024-08-06 08:13:16,507][52663] Sum rewards: 71.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.046', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon5': '0.202', 'weapon4': '0.208', 'AMMO3': '0.249', 'AMMO4': '0.249', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '61.000'} [2024-08-06 08:13:16,566][52794] DAMAGECOUNT value on done: 960759.0 [2024-08-06 08:13:16,567][52794] Sum rewards: 76.392, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.660', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.162', 'AMMO4': '0.176', 'AMMO3': '0.268', 'weapon2': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '64.000'} [2024-08-06 08:13:17,297][52650] Updated weights for policy 0, policy_version 82491 (0.0014) [2024-08-06 08:13:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 675774464. Throughput: 0: 4361.6. Samples: 168941540. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:17,794][52567] Avg episode reward: [(0, '76.794')] [2024-08-06 08:13:19,152][52811] DAMAGECOUNT value on done: 889124.0 [2024-08-06 08:13:19,153][52811] Sum rewards: 75.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'AMMO4': '0.126', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.516', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '61.000'} [2024-08-06 08:13:19,410][52663] DAMAGECOUNT value on done: 949566.0 [2024-08-06 08:13:19,411][52663] Sum rewards: 80.240, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.596', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.114', 'AMMO4': '0.149', 'AMMO3': '0.160', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '0.950', 'weapon3': '3.122', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '62.500'} [2024-08-06 08:13:19,705][52670] DAMAGECOUNT value on done: 935574.0 [2024-08-06 08:13:19,706][52670] Sum rewards: 82.608, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.084', 'HEALTH': '0.085', 'AMMO3': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'weapon2': '0.346', 'WEAPON3': '0.800', 'weapon3': '3.276', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '64.000'} [2024-08-06 08:13:20,006][52794] DAMAGECOUNT value on done: 942301.0 [2024-08-06 08:13:20,006][52794] Sum rewards: 74.928, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.394', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.177', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '3.252', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '60.000'} [2024-08-06 08:13:22,242][52811] DAMAGECOUNT value on done: 887654.0 [2024-08-06 08:13:22,243][52811] Sum rewards: 78.240, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.280', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.226', 'weapon5': '0.252', 'AMMO4': '0.266', 'AMMO3': '0.284', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.750', 'weapon3': '2.858', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '68.000'} [2024-08-06 08:13:22,338][52663] DAMAGECOUNT value on done: 955784.0 [2024-08-06 08:13:22,340][52663] Sum rewards: 81.809, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.510', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.090', 'AMMO4': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '70.000'} [2024-08-06 08:13:22,450][52650] Updated weights for policy 0, policy_version 82501 (0.0030) [2024-08-06 08:13:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 675848192. Throughput: 0: 4367.6. Samples: 168967740. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:22,794][52567] Avg episode reward: [(0, '77.086')] [2024-08-06 08:13:23,058][52670] DAMAGECOUNT value on done: 955711.0 [2024-08-06 08:13:23,058][52670] Sum rewards: 84.937, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.738', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.026', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.310', 'WEAPON3': '1.450', 'weapon3': '3.480', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.922', 'FRAGCOUNT': '71.000'} [2024-08-06 08:13:23,481][52794] DAMAGECOUNT value on done: 954300.0 [2024-08-06 08:13:23,482][52794] Sum rewards: 71.575, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.438', 'AMMO5': '0.017', 'AMMO2': '0.047', 'weapon5': '0.062', 'weapon4': '0.078', 'AMMO3': '0.195', 'AMMO4': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '59.500'} [2024-08-06 08:13:24,856][52663] DAMAGECOUNT value on done: 961522.0 [2024-08-06 08:13:24,858][52663] Sum rewards: 91.255, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.115', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.220', 'AMMO3': '0.261', 'WEAPON3': '1.650', 'weapon3': '3.488', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.072', 'FRAGCOUNT': '78.000'} [2024-08-06 08:13:25,228][52811] DAMAGECOUNT value on done: 895996.0 [2024-08-06 08:13:25,229][52811] Sum rewards: 82.482, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.049', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.046', 'AMMO3': '0.175', 'weapon5': '0.178', 'AMMO4': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '64.000'} [2024-08-06 08:13:26,171][52670] DAMAGECOUNT value on done: 937298.0 [2024-08-06 08:13:26,171][52670] Sum rewards: 84.849, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.524', 'AMMO5': '0.015', 'AMMO2': '0.024', 'weapon4': '0.112', 'AMMO4': '0.121', 'AMMO3': '0.158', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 08:13:26,630][52794] DAMAGECOUNT value on done: 950518.0 [2024-08-06 08:13:26,630][52794] Sum rewards: 73.447, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.015', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.124', 'weapon4': '0.146', 'AMMO3': '0.171', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 08:13:26,738][52650] Updated weights for policy 0, policy_version 82511 (0.0017) [2024-08-06 08:13:27,448][52666] DAMAGECOUNT value on done: 950614.0 [2024-08-06 08:13:27,456][52666] Sum rewards: 81.542, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.240', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.230', 'AMMO4': '0.283', 'weapon4': '0.288', 'weapon5': '0.310', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.696', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '66.000'} [2024-08-06 08:13:27,717][52663] DAMAGECOUNT value on done: 940124.0 [2024-08-06 08:13:27,719][52663] Sum rewards: 78.258, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.088', 'weapon2': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '63.000'} [2024-08-06 08:13:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 675946496. Throughput: 0: 4367.1. Samples: 168994110. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:27,794][52567] Avg episode reward: [(0, '77.349')] [2024-08-06 08:13:28,412][52811] DAMAGECOUNT value on done: 899335.0 [2024-08-06 08:13:28,412][52811] Sum rewards: 68.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.278', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.286', 'WEAPON3': '1.100', 'HITCOUNT': '3.200', 'weapon3': '3.436', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '55.000'} [2024-08-06 08:13:28,419][52670] DAMAGECOUNT value on done: 939918.0 [2024-08-06 08:13:28,420][52670] Sum rewards: 73.419, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.086', 'weapon4': '0.126', 'AMMO3': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'WEAPON4': '0.250', 'HEALTH': '0.515', 'weapon2': '0.706', 'WEAPON3': '0.850', 'weapon3': '2.898', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 08:13:29,747][52794] DAMAGECOUNT value on done: 958317.0 [2024-08-06 08:13:29,747][52794] Sum rewards: 89.685, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.390', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO3': '0.166', 'AMMO4': '0.189', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.000', 'weapon3': '3.070', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.844', 'FRAGCOUNT': '69.000'} [2024-08-06 08:13:30,041][52666] DAMAGECOUNT value on done: 947623.0 [2024-08-06 08:13:30,044][52666] Sum rewards: 82.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.731', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.060', 'AMMO4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.162', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '69.000'} [2024-08-06 08:13:31,442][52670] DAMAGECOUNT value on done: 951281.0 [2024-08-06 08:13:31,443][52670] Sum rewards: 73.081, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.070', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.088', 'AMMO4': '0.111', 'weapon5': '0.134', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.610', 'WEAPON3': '0.850', 'weapon3': '3.008', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '57.500'} [2024-08-06 08:13:31,518][52650] Updated weights for policy 0, policy_version 82521 (0.0013) [2024-08-06 08:13:31,556][52811] DAMAGECOUNT value on done: 885682.0 [2024-08-06 08:13:31,558][52811] Sum rewards: 77.538, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.065', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.114', 'AMMO4': '0.158', 'AMMO3': '0.197', 'weapon5': '0.202', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.098', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '63.000'} [2024-08-06 08:13:32,502][52794] DAMAGECOUNT value on done: 966045.0 [2024-08-06 08:13:32,511][52794] Sum rewards: 73.428, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.179', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '62.000'} [2024-08-06 08:13:32,514][52663] Large shaping reward 2.529 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 08:13:32,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 676036608. Throughput: 0: 4361.8. Samples: 169007030. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:32,794][52567] Avg episode reward: [(0, '77.424')] [2024-08-06 08:13:33,177][52666] DAMAGECOUNT value on done: 953181.0 [2024-08-06 08:13:33,177][52666] Sum rewards: 87.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.092', 'weapon4': '0.102', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.338', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '72.000'} [2024-08-06 08:13:34,513][52670] DAMAGECOUNT value on done: 939575.0 [2024-08-06 08:13:34,514][52670] Sum rewards: 86.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.128', 'AMMO4': '0.161', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.306', 'FRAGCOUNT': '72.000'} [2024-08-06 08:13:34,607][52811] DAMAGECOUNT value on done: 887038.0 [2024-08-06 08:13:34,609][52811] Sum rewards: 86.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.235', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.078', 'AMMO3': '0.208', 'weapon5': '0.224', 'AMMO4': '0.241', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.808', 'FRAGCOUNT': '70.000'} [2024-08-06 08:13:35,829][52794] DAMAGECOUNT value on done: 952479.0 [2024-08-06 08:13:35,832][52794] Sum rewards: 59.738, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.782', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.120', 'AMMO4': '0.208', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '50.500'} [2024-08-06 08:13:36,145][52666] DAMAGECOUNT value on done: 948109.0 [2024-08-06 08:13:36,147][52666] Sum rewards: 80.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.144', 'weapon2': '0.194', 'AMMO4': '0.196', 'weapon5': '0.224', 'AMMO3': '0.267', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.562', 'FRAGCOUNT': '67.000'} [2024-08-06 08:13:36,553][52650] Updated weights for policy 0, policy_version 82531 (0.0023) [2024-08-06 08:13:37,626][52670] DAMAGECOUNT value on done: 937020.0 [2024-08-06 08:13:37,634][52670] Sum rewards: 72.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.132', 'AMMO4': '0.180', 'AMMO3': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '61.000'} [2024-08-06 08:13:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 676118528. Throughput: 0: 4349.6. Samples: 169033210. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:37,794][52567] Avg episode reward: [(0, '77.833')] [2024-08-06 08:13:37,934][52668] DAMAGECOUNT value on done: 960042.0 [2024-08-06 08:13:37,934][52668] Sum rewards: 77.671, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.850', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon4': '0.066', 'weapon5': '0.134', 'AMMO3': '0.195', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '64.000'} [2024-08-06 08:13:39,235][52666] DAMAGECOUNT value on done: 942105.0 [2024-08-06 08:13:39,236][52666] Sum rewards: 89.075, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.320', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.148', 'AMMO4': '0.176', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'weapon2': '0.356', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.160', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '22.071', 'FRAGCOUNT': '74.000'} [2024-08-06 08:13:39,298][52665] DAMAGECOUNT value on done: 937527.0 [2024-08-06 08:13:39,300][52665] Sum rewards: 74.124, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.370', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon2': '0.154', 'weapon5': '0.154', 'AMMO3': '0.165', 'weapon4': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.950', 'weapon3': '3.330', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:40,504][52670] DAMAGECOUNT value on done: 938320.0 [2024-08-06 08:13:40,504][52670] Sum rewards: 76.503, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.924', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.077', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.150', 'weapon3': '3.378', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '62.000'} [2024-08-06 08:13:40,574][52668] DAMAGECOUNT value on done: 959226.0 [2024-08-06 08:13:40,575][52668] Sum rewards: 79.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.152', 'AMMO4': '0.200', 'AMMO3': '0.208', 'weapon2': '0.238', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '65.000'} [2024-08-06 08:13:40,653][52803] DAMAGECOUNT value on done: 883193.0 [2024-08-06 08:13:40,653][52803] Sum rewards: 66.343, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.171', 'weapon5': '0.214', 'weapon2': '0.220', 'AMMO3': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.050', 'weapon3': '3.178', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '56.000'} [2024-08-06 08:13:40,823][52650] Updated weights for policy 0, policy_version 82541 (0.0036) [2024-08-06 08:13:42,044][52665] DAMAGECOUNT value on done: 949685.0 [2024-08-06 08:13:42,045][52665] Sum rewards: 76.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.064', 'WEAPON5': '0.100', 'weapon4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.224', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '64.000'} [2024-08-06 08:13:42,107][52666] DAMAGECOUNT value on done: 944787.0 [2024-08-06 08:13:42,107][52666] Sum rewards: 80.367, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.108', 'AMMO4': '0.150', 'AMMO3': '0.158', 'weapon5': '0.174', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '66.000'} [2024-08-06 08:13:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 676200448. Throughput: 0: 4365.6. Samples: 169059490. Policy #0 lag: (min: 0.0, avg: 4.1, max: 8.0) [2024-08-06 08:13:42,802][52567] Avg episode reward: [(0, '77.579')] [2024-08-06 08:13:43,072][52668] DAMAGECOUNT value on done: 955673.0 [2024-08-06 08:13:43,072][52668] Sum rewards: 78.272, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.076', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.110', 'weapon5': '0.182', 'AMMO4': '0.191', 'AMMO3': '0.238', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '65.000'} [2024-08-06 08:13:43,387][52670] DAMAGECOUNT value on done: 938106.0 [2024-08-06 08:13:43,388][52670] Sum rewards: 61.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.888', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.226', 'weapon4': '0.264', 'AMMO4': '0.286', 'weapon5': '0.298', 'WEAPON5': '0.450', 'weapon2': '0.454', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.658', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '51.000'} [2024-08-06 08:13:43,724][52803] DAMAGECOUNT value on done: 882584.0 [2024-08-06 08:13:43,725][52803] Sum rewards: 75.882, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.491', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.139', 'weapon4': '0.192', 'AMMO4': '0.197', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '0.900', 'weapon3': '2.880', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:44,827][52665] DAMAGECOUNT value on done: 943190.0 [2024-08-06 08:13:44,827][52665] Sum rewards: 71.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.416', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '60.000'} [2024-08-06 08:13:45,183][52666] DAMAGECOUNT value on done: 944068.0 [2024-08-06 08:13:45,184][52666] Sum rewards: 67.777, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.565', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon4': '0.080', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.766', 'WEAPON3': '1.300', 'weapon3': '2.820', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '55.500'} [2024-08-06 08:13:45,683][52650] Updated weights for policy 0, policy_version 82551 (0.0016) [2024-08-06 08:13:45,689][52669] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:13:46,292][52668] DAMAGECOUNT value on done: 958823.0 [2024-08-06 08:13:46,293][52668] Sum rewards: 74.830, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.840', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.080', 'AMMO3': '0.178', 'weapon5': '0.204', 'AMMO4': '0.252', 'WEAPON4': '0.400', 'weapon2': '0.430', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '60.000'} [2024-08-06 08:13:46,530][52670] DAMAGECOUNT value on done: 935878.0 [2024-08-06 08:13:46,531][52670] Sum rewards: 78.720, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.342', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.148', 'weapon5': '0.162', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.338', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '67.000'} [2024-08-06 08:13:46,877][52803] DAMAGECOUNT value on done: 890729.0 [2024-08-06 08:13:46,879][52803] Sum rewards: 82.831, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.475', 'AMMO5': '0.005', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.050', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'AMMO3': '0.315', 'WEAPON3': '2.100', 'weapon3': '3.474', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '22.038', 'FRAGCOUNT': '72.000'} [2024-08-06 08:13:47,238][52665] DAMAGECOUNT value on done: 946303.0 [2024-08-06 08:13:47,238][52665] Sum rewards: 88.756, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.148', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.122', 'AMMO3': '0.164', 'AMMO4': '0.168', 'weapon5': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.166', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '71.000'} [2024-08-06 08:13:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 676290560. Throughput: 0: 4357.1. Samples: 169072270. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:13:47,794][52567] Avg episode reward: [(0, '77.785')] [2024-08-06 08:13:47,842][52666] DAMAGECOUNT value on done: 940406.0 [2024-08-06 08:13:47,842][52666] Sum rewards: 76.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.931', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.138', 'AMMO4': '0.162', 'AMMO3': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.030', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '63.000'} [2024-08-06 08:13:48,734][52668] DAMAGECOUNT value on done: 943651.0 [2024-08-06 08:13:48,736][52668] Sum rewards: 75.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.574', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.121', 'weapon5': '0.164', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '63.000'} [2024-08-06 08:13:49,262][52670] DAMAGECOUNT value on done: 950083.0 [2024-08-06 08:13:49,263][52670] Sum rewards: 82.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.615', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.116', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '68.000'} [2024-08-06 08:13:50,037][52803] DAMAGECOUNT value on done: 885983.0 [2024-08-06 08:13:50,038][52803] Sum rewards: 71.742, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.545', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.176', 'AMMO4': '0.199', 'AMMO3': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.562', 'WEAPON3': '1.550', 'weapon3': '2.934', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '61.500'} [2024-08-06 08:13:50,171][52665] DAMAGECOUNT value on done: 928535.0 [2024-08-06 08:13:50,175][52665] Sum rewards: 87.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.295', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'weapon2': '0.688', 'WEAPON3': '1.250', 'weapon3': '3.098', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '71.000'} [2024-08-06 08:13:50,197][52664] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:13:50,498][52650] Updated weights for policy 0, policy_version 82561 (0.0034) [2024-08-06 08:13:50,959][52666] DAMAGECOUNT value on done: 951513.0 [2024-08-06 08:13:50,961][52666] Sum rewards: 86.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.148', 'AMMO4': '0.149', 'AMMO3': '0.182', 'weapon2': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.404', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.222', 'FRAGCOUNT': '69.000'} [2024-08-06 08:13:51,709][52649] DAMAGECOUNT value on done: 921000.0 [2024-08-06 08:13:51,709][52649] Sum rewards: 64.721, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.476', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.116', 'weapon5': '0.158', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '3.020', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '51.000'} [2024-08-06 08:13:51,871][52668] DAMAGECOUNT value on done: 955002.0 [2024-08-06 08:13:51,871][52668] Sum rewards: 72.766, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.082', 'weapon4': '0.092', 'AMMO4': '0.155', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '58.000'} [2024-08-06 08:13:52,345][52670] DAMAGECOUNT value on done: 932312.0 [2024-08-06 08:13:52,346][52670] Sum rewards: 73.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.083', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'weapon5': '0.018', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.237', 'weapon2': '0.286', 'WEAPON3': '1.550', 'HITCOUNT': '3.380', 'weapon3': '3.506', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '63.000'} [2024-08-06 08:13:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 676380672. Throughput: 0: 4360.4. Samples: 169098470. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:13:52,794][52567] Avg episode reward: [(0, '77.835')] [2024-08-06 08:13:53,120][52803] DAMAGECOUNT value on done: 884633.0 [2024-08-06 08:13:53,120][52803] Sum rewards: 79.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.527', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.098', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '65.000'} [2024-08-06 08:13:53,426][52665] DAMAGECOUNT value on done: 929806.0 [2024-08-06 08:13:53,429][52665] Sum rewards: 62.788, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.415', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.014', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.182', 'AMMO3': '0.207', 'weapon2': '0.380', 'WEAPON3': '1.250', 'HITCOUNT': '3.020', 'weapon3': '3.256', 'DAMAGECOUNT': '15.564', 'FRAGCOUNT': '52.000'} [2024-08-06 08:13:53,467][52647] DAMAGECOUNT value on done: 1016300.0 [2024-08-06 08:13:53,467][52647] Sum rewards: 76.174, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon4': '0.188', 'weapon5': '0.202', 'AMMO3': '0.213', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.724', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '61.000'} [2024-08-06 08:13:54,147][52666] DAMAGECOUNT value on done: 941919.0 [2024-08-06 08:13:54,147][52666] Sum rewards: 69.477, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO3': '0.114', 'weapon5': '0.136', 'AMMO4': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.413', 'WEAPON3': '0.700', 'weapon2': '0.742', 'weapon3': '2.900', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '14.988', 'FRAGCOUNT': '54.000'} [2024-08-06 08:13:54,282][52820] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:13:54,591][52668] DAMAGECOUNT value on done: 955667.0 [2024-08-06 08:13:54,592][52668] Sum rewards: 81.321, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.912', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.064', 'AMMO4': '0.098', 'weapon4': '0.110', 'WEAPON5': '0.150', 'weapon2': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.500', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.541', 'FRAGCOUNT': '67.000'} [2024-08-06 08:13:54,912][52649] DAMAGECOUNT value on done: 919286.0 [2024-08-06 08:13:54,913][52649] Sum rewards: 79.732, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.995', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.062', 'AMMO4': '0.150', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.196', 'AMMO3': '0.322', 'WEAPON3': '1.900', 'weapon3': '3.444', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '71.000'} [2024-08-06 08:13:55,046][52650] Updated weights for policy 0, policy_version 82571 (0.0027) [2024-08-06 08:13:55,507][52670] DAMAGECOUNT value on done: 946735.0 [2024-08-06 08:13:55,508][52670] Sum rewards: 63.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.293', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.154', 'AMMO3': '0.182', 'weapon2': '0.254', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.316', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '51.000'} [2024-08-06 08:13:55,670][52658] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:13:56,256][52665] DAMAGECOUNT value on done: 941651.0 [2024-08-06 08:13:56,256][52665] Sum rewards: 68.662, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.112', 'AMMO3': '0.219', 'AMMO4': '0.223', 'weapon5': '0.266', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '58.000'} [2024-08-06 08:13:56,265][52803] DAMAGECOUNT value on done: 882837.0 [2024-08-06 08:13:56,266][52803] Sum rewards: 55.620, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.715', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.104', 'weapon5': '0.154', 'AMMO4': '0.196', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.066', 'DAMAGECOUNT': '13.860', 'FRAGCOUNT': '45.000'} [2024-08-06 08:13:56,405][52647] DAMAGECOUNT value on done: 1001284.0 [2024-08-06 08:13:56,405][52647] Sum rewards: 78.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.658', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.112', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.398', 'WEAPON3': '1.600', 'weapon3': '3.198', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '67.000'} [2024-08-06 08:13:56,757][52666] DAMAGECOUNT value on done: 948839.0 [2024-08-06 08:13:56,758][52666] Sum rewards: 74.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.007', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.232', 'weapon4': '0.332', 'WEAPON3': '1.050', 'weapon3': '3.168', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '60.000'} [2024-08-06 08:13:56,951][52794] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2024-08-06 08:13:57,460][52649] DAMAGECOUNT value on done: 931708.0 [2024-08-06 08:13:57,460][52649] Sum rewards: 64.376, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.234', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.077', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.374', 'WEAPON3': '1.400', 'HITCOUNT': '3.040', 'weapon3': '3.250', 'DAMAGECOUNT': '15.813', 'FRAGCOUNT': '55.000'} [2024-08-06 08:13:57,667][52668] DAMAGECOUNT value on done: 947661.0 [2024-08-06 08:13:57,669][52668] Sum rewards: 76.857, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.072', 'weapon5': '0.144', 'weapon2': '0.180', 'AMMO4': '0.225', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '63.000'} [2024-08-06 08:13:57,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 676462592. Throughput: 0: 4364.9. Samples: 169124710. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:13:57,795][52567] Avg episode reward: [(0, '76.829')] [2024-08-06 08:13:58,334][52670] DAMAGECOUNT value on done: 951387.0 [2024-08-06 08:13:58,335][52670] Sum rewards: 76.922, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.413', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.094', 'AMMO3': '0.155', 'weapon5': '0.158', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.470', 'WEAPON3': '0.950', 'weapon3': '2.952', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '60.000'} [2024-08-06 08:13:58,787][52665] DAMAGECOUNT value on done: 940559.0 [2024-08-06 08:13:58,791][52665] Sum rewards: 80.305, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.938', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.122', 'weapon2': '0.198', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '67.000'} [2024-08-06 08:13:59,392][52803] DAMAGECOUNT value on done: 881553.0 [2024-08-06 08:13:59,393][52803] Sum rewards: 69.933, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.699', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon5': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.250', 'weapon2': '0.926', 'WEAPON3': '1.000', 'weapon3': '2.752', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '55.000'} [2024-08-06 08:13:59,617][52667] DAMAGECOUNT value on done: 949528.0 [2024-08-06 08:13:59,618][52667] Sum rewards: 69.316, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.588', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO4': '0.078', 'AMMO3': '0.256', 'weapon2': '0.262', 'WEAPON3': '1.600', 'weapon3': '3.506', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '59.000'} [2024-08-06 08:13:59,764][52647] DAMAGECOUNT value on done: 1007564.0 [2024-08-06 08:13:59,766][52647] Sum rewards: 82.107, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.100', 'AMMO4': '0.127', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.230', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '69.000'} [2024-08-06 08:13:59,800][52666] DAMAGECOUNT value on done: 933079.0 [2024-08-06 08:13:59,801][52666] Sum rewards: 80.341, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.950', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.164', 'AMMO3': '0.202', 'weapon5': '0.296', 'AMMO4': '0.309', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.772', 'WEAPON3': '1.200', 'weapon3': '2.482', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '65.000'} [2024-08-06 08:13:59,955][52650] Updated weights for policy 0, policy_version 82581 (0.0025) [2024-08-06 08:14:00,305][52668] DAMAGECOUNT value on done: 949392.0 [2024-08-06 08:14:00,305][52668] Sum rewards: 75.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.572', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.166', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.362', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:00,435][52649] DAMAGECOUNT value on done: 934167.0 [2024-08-06 08:14:00,438][52649] Sum rewards: 66.584, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.138', 'AMMO4': '0.147', 'weapon5': '0.162', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.550', 'weapon3': '2.946', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:01,480][52670] DAMAGECOUNT value on done: 944975.0 [2024-08-06 08:14:01,489][52670] Sum rewards: 77.592, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.092', 'weapon5': '0.106', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:01,851][52665] DAMAGECOUNT value on done: 946006.0 [2024-08-06 08:14:01,851][52665] Sum rewards: 88.433, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.855', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.044', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.154', 'AMMO3': '0.247', 'WEAPON3': '1.600', 'weapon3': '3.548', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '22.317', 'FRAGCOUNT': '73.000'} [2024-08-06 08:14:02,310][52667] DAMAGECOUNT value on done: 967046.0 [2024-08-06 08:14:02,311][52667] Sum rewards: 69.842, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.211', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.132', 'AMMO3': '0.181', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'weapon4': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.906', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '55.000'} [2024-08-06 08:14:02,407][52647] DAMAGECOUNT value on done: 1005026.0 [2024-08-06 08:14:02,408][52647] Sum rewards: 62.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.005', 'weapon5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.022', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.262', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.621', 'FRAGCOUNT': '54.000'} [2024-08-06 08:14:02,464][52803] DAMAGECOUNT value on done: 880532.0 [2024-08-06 08:14:02,464][52803] Sum rewards: 71.113, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.630', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.064', 'AMMO4': '0.072', 'AMMO3': '0.180', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 676552704. Throughput: 0: 4359.6. Samples: 169137720. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:14:02,794][52567] Avg episode reward: [(0, '76.657')] [2024-08-06 08:14:02,952][52666] DAMAGECOUNT value on done: 954596.0 [2024-08-06 08:14:02,952][52666] Sum rewards: 90.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.912', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.046', 'AMMO4': '0.070', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.242', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.261', 'FRAGCOUNT': '75.000'} [2024-08-06 08:14:03,053][52649] DAMAGECOUNT value on done: 924948.0 [2024-08-06 08:14:03,054][52649] Sum rewards: 66.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.012', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'weapon2': '0.200', 'weapon4': '0.218', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:03,094][52668] DAMAGECOUNT value on done: 959037.0 [2024-08-06 08:14:03,096][52668] Sum rewards: 85.007, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.650', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.245', 'weapon2': '0.336', 'WEAPON3': '1.400', 'weapon3': '3.464', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:03,189][52820] Large shaping reward 2.628 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:14:04,131][52670] DAMAGECOUNT value on done: 930243.0 [2024-08-06 08:14:04,132][52670] Sum rewards: 84.441, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.254', 'weapon4': '0.268', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.854', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:04,156][52650] Updated weights for policy 0, policy_version 82591 (0.0020) [2024-08-06 08:14:04,546][52665] DAMAGECOUNT value on done: 937992.0 [2024-08-06 08:14:04,547][52665] Sum rewards: 71.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.225', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.171', 'AMMO3': '0.231', 'weapon5': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '2.876', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:05,017][52667] DAMAGECOUNT value on done: 959002.0 [2024-08-06 08:14:05,018][52667] Sum rewards: 80.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon5': '0.198', 'AMMO3': '0.209', 'weapon4': '0.272', 'weapon2': '0.278', 'AMMO4': '0.289', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.988', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.449', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:05,273][52647] DAMAGECOUNT value on done: 1014642.0 [2024-08-06 08:14:05,274][52647] Sum rewards: 71.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.214', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'weapon2': '0.300', 'ARMOR': '0.455', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '61.000'} [2024-08-06 08:14:05,529][52666] DAMAGECOUNT value on done: 948883.0 [2024-08-06 08:14:05,530][52666] Sum rewards: 81.011, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.115', 'AMMO5': '0.023', 'AMMO2': '0.055', 'AMMO3': '0.174', 'weapon5': '0.274', 'AMMO4': '0.275', 'weapon4': '0.324', 'weapon2': '0.398', 'WEAPON4': '0.550', 'WEAPON5': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.648', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:05,576][52803] DAMAGECOUNT value on done: 889364.0 [2024-08-06 08:14:05,578][52803] Sum rewards: 71.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.495', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.119', 'weapon5': '0.126', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.556', 'WEAPON3': '1.050', 'weapon3': '3.084', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:05,988][52668] DAMAGECOUNT value on done: 951316.0 [2024-08-06 08:14:05,988][52668] Sum rewards: 81.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.168', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.272', 'weapon4': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.032', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:06,252][52649] DAMAGECOUNT value on done: 934318.0 [2024-08-06 08:14:06,253][52649] Sum rewards: 76.045, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.825', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.075', 'WEAPON5': '0.100', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:06,467][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:14:06,841][52670] DAMAGECOUNT value on done: 943311.0 [2024-08-06 08:14:06,843][52670] Sum rewards: 74.272, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.686', 'AMMO5': '0.003', 'weapon5': '0.026', 'AMMO2': '0.030', 'WEAPON5': '0.050', 'AMMO4': '0.149', 'weapon4': '0.164', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:07,613][52665] DAMAGECOUNT value on done: 953809.0 [2024-08-06 08:14:07,613][52665] Sum rewards: 75.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.184', 'weapon5': '0.208', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:07,757][52647] DAMAGECOUNT value on done: 1011677.0 [2024-08-06 08:14:07,759][52647] Sum rewards: 85.206, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.390', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.106', 'weapon5': '0.134', 'AMMO4': '0.147', 'weapon2': '0.212', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '72.000'} [2024-08-06 08:14:07,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 676642816. Throughput: 0: 4360.9. Samples: 169163980. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:14:07,795][52567] Avg episode reward: [(0, '76.682')] [2024-08-06 08:14:07,840][52662] DAMAGECOUNT value on done: 951010.0 [2024-08-06 08:14:07,841][52662] Sum rewards: 71.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.794', 'WEAPON3': '1.450', 'weapon3': '2.878', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:08,298][52667] DAMAGECOUNT value on done: 965129.0 [2024-08-06 08:14:08,300][52667] Sum rewards: 84.989, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.930', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.042', 'weapon5': '0.042', 'AMMO4': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.690', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:08,424][52666] DAMAGECOUNT value on done: 948463.0 [2024-08-06 08:14:08,424][52666] Sum rewards: 78.395, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.096', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.090', 'weapon5': '0.202', 'AMMO4': '0.249', 'AMMO3': '0.281', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.598', 'WEAPON3': '1.750', 'weapon3': '2.782', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:08,667][52803] DAMAGECOUNT value on done: 885497.0 [2024-08-06 08:14:08,667][52803] Sum rewards: 79.096, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.399', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.070', 'weapon5': '0.134', 'AMMO4': '0.162', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:09,044][52668] DAMAGECOUNT value on done: 946589.0 [2024-08-06 08:14:09,046][52668] Sum rewards: 75.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.976', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.244', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.324', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:09,367][52649] DAMAGECOUNT value on done: 930149.0 [2024-08-06 08:14:09,367][52649] Sum rewards: 87.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.438', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.112', 'weapon5': '0.196', 'AMMO3': '0.223', 'AMMO4': '0.234', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:09,458][52650] Updated weights for policy 0, policy_version 82601 (0.0039) [2024-08-06 08:14:09,789][52670] DAMAGECOUNT value on done: 953847.0 [2024-08-06 08:14:09,791][52670] Sum rewards: 91.139, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.676', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.095', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '22.146', 'FRAGCOUNT': '72.000'} [2024-08-06 08:14:10,413][52647] DAMAGECOUNT value on done: 1014162.0 [2024-08-06 08:14:10,413][52647] Sum rewards: 65.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.114', 'weapon2': '0.194', 'weapon4': '0.204', 'AMMO3': '0.220', 'AMMO4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.230', 'weapon3': '3.256', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '54.000'} [2024-08-06 08:14:10,641][52665] DAMAGECOUNT value on done: 947007.0 [2024-08-06 08:14:10,641][52665] Sum rewards: 72.265, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.947', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.139', 'weapon4': '0.144', 'AMMO3': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.050', 'HITCOUNT': '3.130', 'weapon3': '3.202', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:10,811][52662] DAMAGECOUNT value on done: 960503.0 [2024-08-06 08:14:10,812][52662] Sum rewards: 69.221, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.230', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.052', 'AMMO4': '0.088', 'weapon5': '0.092', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.760', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '56.000'} [2024-08-06 08:14:11,047][52667] DAMAGECOUNT value on done: 965046.0 [2024-08-06 08:14:11,048][52667] Sum rewards: 76.489, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.642', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.086', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.380', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:11,250][52666] DAMAGECOUNT value on done: 940838.0 [2024-08-06 08:14:11,250][52666] Sum rewards: 81.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.141', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.172', 'AMMO4': '0.202', 'weapon2': '0.202', 'AMMO3': '0.213', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.362', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:11,879][52803] DAMAGECOUNT value on done: 896443.0 [2024-08-06 08:14:11,883][52803] Sum rewards: 72.871, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.040', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.143', 'weapon4': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '61.000'} [2024-08-06 08:14:11,973][52668] DAMAGECOUNT value on done: 942348.0 [2024-08-06 08:14:11,975][52668] Sum rewards: 73.109, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.284', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.119', 'AMMO3': '0.176', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.810', 'WEAPON3': '1.050', 'weapon3': '2.756', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:12,165][52649] DAMAGECOUNT value on done: 933032.0 [2024-08-06 08:14:12,166][52649] Sum rewards: 74.998, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.384', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.106', 'AMMO4': '0.162', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.230', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:12,544][52670] DAMAGECOUNT value on done: 945827.0 [2024-08-06 08:14:12,546][52670] Sum rewards: 84.977, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.140', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.134', 'weapon4': '0.174', 'AMMO3': '0.183', 'AMMO4': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '69.000'} [2024-08-06 08:14:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 676724736. Throughput: 0: 4355.6. Samples: 169190110. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:14:12,794][52567] Avg episode reward: [(0, '76.396')] [2024-08-06 08:14:12,930][52647] DAMAGECOUNT value on done: 989719.0 [2024-08-06 08:14:12,930][52647] Sum rewards: 75.273, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.640', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon5': '0.138', 'AMMO3': '0.139', 'weapon4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.638', 'WEAPON3': '0.850', 'weapon3': '2.806', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:13,547][52665] DAMAGECOUNT value on done: 943383.0 [2024-08-06 08:14:13,547][52665] Sum rewards: 89.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.664', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.204', 'AMMO4': '0.243', 'AMMO3': '0.246', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.594', 'WEAPON3': '1.500', 'weapon3': '2.848', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.108', 'FRAGCOUNT': '73.000'} [2024-08-06 08:14:13,813][52650] Updated weights for policy 0, policy_version 82611 (0.0013) [2024-08-06 08:14:13,883][52662] DAMAGECOUNT value on done: 958251.0 [2024-08-06 08:14:13,885][52662] Sum rewards: 70.887, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.995', 'AMMO5': '0.016', 'AMMO2': '0.067', 'weapon5': '0.172', 'AMMO3': '0.207', 'AMMO4': '0.333', 'weapon2': '0.420', 'WEAPON5': '0.500', 'weapon4': '0.512', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.654', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.791', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:13,933][52666] DAMAGECOUNT value on done: 939640.0 [2024-08-06 08:14:13,934][52666] Sum rewards: 87.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.825', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.094', 'weapon4': '0.110', 'AMMO4': '0.167', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.266', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:14,034][52667] DAMAGECOUNT value on done: 964817.0 [2024-08-06 08:14:14,035][52667] Sum rewards: 83.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.263', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.120', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon2': '0.162', 'weapon4': '0.164', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '69.000'} [2024-08-06 08:14:14,580][52668] DAMAGECOUNT value on done: 940558.0 [2024-08-06 08:14:14,581][52668] Sum rewards: 86.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.571', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.132', 'AMMO4': '0.164', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.244', 'WEAPON4': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.000', 'weapon3': '2.920', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:15,054][52649] DAMAGECOUNT value on done: 927448.0 [2024-08-06 08:14:15,056][52649] Sum rewards: 68.866, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.020', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.144', 'AMMO4': '0.246', 'AMMO3': '0.261', 'weapon2': '0.294', 'weapon5': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.874', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.460', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:15,130][52803] DAMAGECOUNT value on done: 892467.0 [2024-08-06 08:14:15,132][52803] Sum rewards: 95.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.716', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.104', 'AMMO4': '0.132', 'AMMO3': '0.164', 'weapon4': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.218', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.486', 'FRAGCOUNT': '76.000'} [2024-08-06 08:14:15,298][52670] DAMAGECOUNT value on done: 947604.0 [2024-08-06 08:14:15,299][52670] Sum rewards: 83.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.721', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.136', 'AMMO4': '0.229', 'weapon5': '0.234', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.994', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '69.000'} [2024-08-06 08:14:15,377][52795] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2024-08-06 08:14:15,556][52647] DAMAGECOUNT value on done: 1004036.0 [2024-08-06 08:14:15,557][52647] Sum rewards: 76.796, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.018', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:15,821][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:14:16,346][52665] DAMAGECOUNT value on done: 942271.0 [2024-08-06 08:14:16,347][52665] Sum rewards: 72.933, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.138', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon4': '0.330', 'weapon2': '0.578', 'WEAPON3': '0.900', 'weapon3': '2.788', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:16,541][52667] DAMAGECOUNT value on done: 957720.0 [2024-08-06 08:14:16,543][52667] Sum rewards: 80.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.086', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.096', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.408', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:16,648][52666] DAMAGECOUNT value on done: 960530.0 [2024-08-06 08:14:16,648][52666] Sum rewards: 86.043, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.229', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.040', 'weapon5': '0.126', 'AMMO4': '0.132', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.556', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:17,134][52662] DAMAGECOUNT value on done: 950085.0 [2024-08-06 08:14:17,134][52662] Sum rewards: 86.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.084', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.243', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.246', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.898', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:17,513][52668] DAMAGECOUNT value on done: 933641.0 [2024-08-06 08:14:17,514][52668] Sum rewards: 56.453, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.765', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.149', 'weapon5': '0.198', 'AMMO4': '0.223', 'weapon4': '0.338', 'weapon2': '0.346', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.750', 'weapon3': '2.934', 'DAMAGECOUNT': '13.269', 'FRAGCOUNT': '45.000'} [2024-08-06 08:14:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 676814848. Throughput: 0: 4363.1. Samples: 169203370. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:14:17,795][52567] Avg episode reward: [(0, '76.410')] [2024-08-06 08:14:17,810][52649] DAMAGECOUNT value on done: 924684.0 [2024-08-06 08:14:17,811][52649] Sum rewards: 95.421, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.282', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.132', 'AMMO3': '0.167', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.000', 'weapon3': '2.916', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '22.434', 'FRAGCOUNT': '75.000'} [2024-08-06 08:14:18,206][52803] DAMAGECOUNT value on done: 882392.0 [2024-08-06 08:14:18,206][52803] Sum rewards: 67.095, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO2': '0.008', 'AMMO5': '0.010', 'AMMO4': '0.042', 'weapon4': '0.046', 'WEAPON4': '0.150', 'weapon5': '0.170', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.828', 'WEAPON3': '1.400', 'weapon3': '2.716', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:18,423][52650] Updated weights for policy 0, policy_version 82621 (0.0024) [2024-08-06 08:14:18,622][52647] DAMAGECOUNT value on done: 1001380.0 [2024-08-06 08:14:18,622][52647] Sum rewards: 62.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.026', 'AMMO2': '0.065', 'AMMO3': '0.194', 'weapon5': '0.216', 'weapon4': '0.288', 'AMMO4': '0.326', 'weapon2': '0.520', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.666', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '14.931', 'FRAGCOUNT': '52.000'} [2024-08-06 08:14:18,835][52820] DAMAGECOUNT value on done: 881251.0 [2024-08-06 08:14:18,837][52820] Sum rewards: 71.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.016', 'weapon5': '0.042', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.246', 'weapon2': '0.422', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:19,208][52665] DAMAGECOUNT value on done: 938672.0 [2024-08-06 08:14:19,209][52665] Sum rewards: 62.677, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.095', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon5': '0.156', 'AMMO3': '0.160', 'weapon4': '0.306', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.982', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.429', 'FRAGCOUNT': '50.000'} [2024-08-06 08:14:19,463][52667] DAMAGECOUNT value on done: 953317.0 [2024-08-06 08:14:19,465][52667] Sum rewards: 79.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.142', 'AMMO3': '0.163', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.270', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:19,650][52666] DAMAGECOUNT value on done: 931986.0 [2024-08-06 08:14:19,651][52666] Sum rewards: 75.847, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.906', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO4': '0.163', 'AMMO3': '0.177', 'weapon5': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '1.100', 'weapon3': '2.974', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '60.500'} [2024-08-06 08:14:19,873][52662] DAMAGECOUNT value on done: 966890.0 [2024-08-06 08:14:19,874][52662] Sum rewards: 77.549, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.049', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.249', 'WEAPON3': '1.500', 'weapon3': '3.548', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:20,537][52668] DAMAGECOUNT value on done: 950042.0 [2024-08-06 08:14:20,537][52668] Sum rewards: 75.714, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.705', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.200', 'weapon5': '0.224', 'AMMO4': '0.229', 'weapon4': '0.382', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:20,675][52649] DAMAGECOUNT value on done: 938884.0 [2024-08-06 08:14:20,676][52649] Sum rewards: 86.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.976', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.082', 'AMMO4': '0.170', 'AMMO3': '0.212', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.002', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.390', 'FRAGCOUNT': '69.000'} [2024-08-06 08:14:21,392][52803] DAMAGECOUNT value on done: 898330.0 [2024-08-06 08:14:21,394][52803] Sum rewards: 59.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.230', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.116', 'weapon5': '0.148', 'WEAPON4': '0.250', 'weapon2': '0.274', 'AMMO3': '0.283', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '2.920', 'weapon3': '3.252', 'DAMAGECOUNT': '15.426', 'FRAGCOUNT': '53.500'} [2024-08-06 08:14:21,662][52647] DAMAGECOUNT value on done: 1000690.0 [2024-08-06 08:14:21,662][52647] Sum rewards: 71.741, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.390', 'AMMO5': '0.007', 'weapon5': '0.036', 'AMMO2': '0.044', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'AMMO4': '0.218', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:21,996][52665] DAMAGECOUNT value on done: 946024.0 [2024-08-06 08:14:21,998][52665] Sum rewards: 77.409, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.381', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.222', 'AMMO3': '0.227', 'AMMO4': '0.236', 'weapon4': '0.242', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.912', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:22,133][52820] DAMAGECOUNT value on done: 881711.0 [2024-08-06 08:14:22,135][52820] Sum rewards: 78.172, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.016', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '3.240', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:22,173][52667] DAMAGECOUNT value on done: 957538.0 [2024-08-06 08:14:22,175][52667] Sum rewards: 82.940, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.020', 'AMMO2': '0.064', 'AMMO3': '0.217', 'weapon2': '0.292', 'weapon5': '0.292', 'AMMO4': '0.321', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'weapon4': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.442', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:22,554][52666] DAMAGECOUNT value on done: 943798.0 [2024-08-06 08:14:22,554][52666] Sum rewards: 72.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.358', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.187', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '3.338', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 676904960. Throughput: 0: 4363.6. Samples: 169229570. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:14:22,794][52567] Avg episode reward: [(0, '76.490')] [2024-08-06 08:14:23,166][52662] DAMAGECOUNT value on done: 943886.0 [2024-08-06 08:14:23,167][52662] Sum rewards: 86.497, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.184', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.100', 'weapon5': '0.142', 'AMMO4': '0.202', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.124', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.477', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:23,436][52650] Updated weights for policy 0, policy_version 82631 (0.0011) [2024-08-06 08:14:23,496][52668] DAMAGECOUNT value on done: 952646.0 [2024-08-06 08:14:23,496][52668] Sum rewards: 73.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.832', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.074', 'weapon5': '0.156', 'AMMO4': '0.215', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.906', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:23,897][52649] DAMAGECOUNT value on done: 944147.0 [2024-08-06 08:14:23,899][52649] Sum rewards: 81.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.125', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '66.000'} [2024-08-06 08:14:23,968][52647] DAMAGECOUNT value on done: 994086.0 [2024-08-06 08:14:23,968][52647] Sum rewards: 72.714, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.490', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.145', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon4': '0.232', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:24,560][52803] DAMAGECOUNT value on done: 883271.0 [2024-08-06 08:14:24,564][52803] Sum rewards: 75.551, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.150', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon2': '0.196', 'AMMO3': '0.197', 'weapon5': '0.202', 'AMMO4': '0.202', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.428', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:24,673][52659] DAMAGECOUNT value on done: 954467.0 [2024-08-06 08:14:24,675][52659] Sum rewards: 72.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.116', 'weapon4': '0.122', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:25,157][52665] DAMAGECOUNT value on done: 941261.0 [2024-08-06 08:14:25,157][52665] Sum rewards: 77.591, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.494', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.157', 'weapon5': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.448', 'weapon2': '0.542', 'WEAPON3': '0.950', 'weapon3': '2.610', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:25,193][52667] DAMAGECOUNT value on done: 963372.0 [2024-08-06 08:14:25,193][52667] Sum rewards: 79.636, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.208', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:25,362][52820] DAMAGECOUNT value on done: 885026.0 [2024-08-06 08:14:25,363][52820] Sum rewards: 91.038, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.685', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.156', 'weapon4': '0.158', 'AMMO3': '0.174', 'weapon2': '0.182', 'weapon5': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.220', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.132', 'FRAGCOUNT': '72.000'} [2024-08-06 08:14:25,995][52662] DAMAGECOUNT value on done: 950941.0 [2024-08-06 08:14:25,996][52662] Sum rewards: 77.180, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.936', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.070', 'weapon5': '0.096', 'AMMO4': '0.191', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.244', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:26,399][52647] DAMAGECOUNT value on done: 1003724.0 [2024-08-06 08:14:26,399][52647] Sum rewards: 73.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.551', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.108', 'weapon4': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:26,440][52668] DAMAGECOUNT value on done: 951784.0 [2024-08-06 08:14:26,440][52668] Sum rewards: 65.923, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.390', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.114', 'weapon5': '0.156', 'AMMO3': '0.269', 'AMMO4': '0.298', 'weapon2': '0.416', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:26,562][52820] Large shaping reward 2.749 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:14:27,048][52649] DAMAGECOUNT value on done: 935761.0 [2024-08-06 08:14:27,053][52649] Sum rewards: 75.582, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.310', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.158', 'AMMO4': '0.200', 'AMMO3': '0.289', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.158', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:27,645][52650] Updated weights for policy 0, policy_version 82641 (0.0031) [2024-08-06 08:14:27,736][52803] DAMAGECOUNT value on done: 892788.0 [2024-08-06 08:14:27,738][52667] DAMAGECOUNT value on done: 952303.0 [2024-08-06 08:14:27,738][52803] Sum rewards: 82.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.021', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.180', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:27,739][52667] Sum rewards: 72.905, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.485', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.165', 'weapon5': '0.170', 'AMMO4': '0.214', 'weapon4': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON3': '0.950', 'weapon3': '2.954', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.671', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 676995072. Throughput: 0: 4363.8. Samples: 169255860. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:14:27,794][52567] Avg episode reward: [(0, '76.485')] [2024-08-06 08:14:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082641_676995072.pth... [2024-08-06 08:14:27,946][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082129_672800768.pth [2024-08-06 08:14:28,011][52659] DAMAGECOUNT value on done: 953543.0 [2024-08-06 08:14:28,012][52659] Sum rewards: 80.908, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.562', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.094', 'AMMO3': '0.206', 'weapon5': '0.224', 'AMMO4': '0.244', 'weapon2': '0.258', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.983', 'FRAGCOUNT': '66.000'} [2024-08-06 08:14:28,268][52665] DAMAGECOUNT value on done: 934009.0 [2024-08-06 08:14:28,269][52665] Sum rewards: 81.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.521', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.164', 'AMMO3': '0.230', 'AMMO4': '0.243', 'weapon2': '0.252', 'weapon5': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:28,491][52662] DAMAGECOUNT value on done: 967231.0 [2024-08-06 08:14:28,493][52662] Sum rewards: 73.105, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.572', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.078', 'AMMO4': '0.147', 'weapon5': '0.158', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.100', 'HITCOUNT': '2.950', 'weapon3': '3.056', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '61.000'} [2024-08-06 08:14:28,819][52647] DAMAGECOUNT value on done: 996961.0 [2024-08-06 08:14:28,820][52647] Sum rewards: 73.640, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.645', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.056', 'AMMO4': '0.082', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.312', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.396', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:28,829][52820] DAMAGECOUNT value on done: 872344.0 [2024-08-06 08:14:28,829][52820] Sum rewards: 89.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.136', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.253', 'weapon2': '0.422', 'WEAPON3': '1.500', 'weapon3': '3.308', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.487', 'FRAGCOUNT': '76.000'} [2024-08-06 08:14:29,405][52668] DAMAGECOUNT value on done: 952673.0 [2024-08-06 08:14:29,406][52668] Sum rewards: 76.143, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.810', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.146', 'AMMO4': '0.153', 'weapon5': '0.190', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '2.970', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:29,812][52649] DAMAGECOUNT value on done: 934586.0 [2024-08-06 08:14:29,814][52649] Sum rewards: 72.996, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.106', 'weapon5': '0.168', 'AMMO3': '0.199', 'AMMO4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '61.000'} [2024-08-06 08:14:30,866][52660] DAMAGECOUNT value on done: 948068.0 [2024-08-06 08:14:30,866][52660] Sum rewards: 76.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.405', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.065', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.100', 'HITCOUNT': '3.310', 'weapon3': '3.436', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:30,975][52665] DAMAGECOUNT value on done: 938369.0 [2024-08-06 08:14:30,976][52665] Sum rewards: 71.472, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.068', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon4': '0.142', 'AMMO3': '0.188', 'weapon5': '0.246', 'AMMO4': '0.254', 'WEAPON4': '0.500', 'weapon2': '0.598', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.734', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:31,013][52667] DAMAGECOUNT value on done: 953111.0 [2024-08-06 08:14:31,014][52667] Sum rewards: 72.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.269', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.090', 'AMMO4': '0.113', 'AMMO3': '0.169', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.916', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:31,046][52803] DAMAGECOUNT value on done: 893195.0 [2024-08-06 08:14:31,047][52803] Sum rewards: 78.004, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.112', 'weapon5': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.504', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:31,098][52659] DAMAGECOUNT value on done: 964535.0 [2024-08-06 08:14:31,098][52659] Sum rewards: 76.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.186', 'AMMO3': '0.214', 'AMMO4': '0.255', 'weapon5': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.774', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:31,487][52662] DAMAGECOUNT value on done: 955027.0 [2024-08-06 08:14:31,488][52662] Sum rewards: 70.415, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.520', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.090', 'AMMO4': '0.174', 'weapon2': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.305', 'WEAPON3': '1.850', 'weapon3': '3.404', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:31,874][52820] DAMAGECOUNT value on done: 883375.0 [2024-08-06 08:14:31,874][52820] Sum rewards: 77.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.394', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.186', 'weapon4': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:31,977][52668] DAMAGECOUNT value on done: 957838.0 [2024-08-06 08:14:31,978][52668] Sum rewards: 64.180, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.625', 'AMMO5': '0.022', 'AMMO2': '0.070', 'AMMO3': '0.149', 'weapon2': '0.240', 'weapon4': '0.268', 'weapon5': '0.348', 'AMMO4': '0.349', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '50.000'} [2024-08-06 08:14:32,091][52647] DAMAGECOUNT value on done: 1006388.0 [2024-08-06 08:14:32,091][52647] Sum rewards: 89.233, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.201', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.360', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '72.000'} [2024-08-06 08:14:32,671][52649] DAMAGECOUNT value on done: 922466.0 [2024-08-06 08:14:32,672][52649] Sum rewards: 84.202, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO3': '0.203', 'AMMO4': '0.242', 'weapon2': '0.242', 'weapon5': '0.282', 'weapon4': '0.404', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.724', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '69.000'} [2024-08-06 08:14:32,708][52650] Updated weights for policy 0, policy_version 82651 (0.0014) [2024-08-06 08:14:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 677076992. Throughput: 0: 4366.9. Samples: 169268780. Policy #0 lag: (min: 0.0, avg: 4.3, max: 9.0) [2024-08-06 08:14:32,794][52567] Avg episode reward: [(0, '77.103')] [2024-08-06 08:14:33,516][52660] DAMAGECOUNT value on done: 940032.0 [2024-08-06 08:14:33,517][52660] Sum rewards: 82.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.985', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '70.000'} [2024-08-06 08:14:33,654][52659] DAMAGECOUNT value on done: 956012.0 [2024-08-06 08:14:33,656][52659] Sum rewards: 77.572, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.525', 'AMMO5': '0.003', 'weapon4': '0.010', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.143', 'weapon2': '0.554', 'WEAPON3': '0.900', 'weapon3': '3.292', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:33,661][52667] DAMAGECOUNT value on done: 963918.0 [2024-08-06 08:14:33,661][52667] Sum rewards: 83.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.026', 'AMMO4': '0.056', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.424', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:33,779][52665] DAMAGECOUNT value on done: 944067.0 [2024-08-06 08:14:33,782][52665] Sum rewards: 79.237, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.240', 'AMMO2': '0.004', 'AMMO4': '0.017', 'WEAPON4': '0.050', 'weapon4': '0.098', 'AMMO3': '0.172', 'weapon2': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.434', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:34,244][52803] DAMAGECOUNT value on done: 900312.0 [2024-08-06 08:14:34,248][52803] Sum rewards: 80.515, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.930', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.070', 'weapon5': '0.130', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.148', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.052', 'FRAGCOUNT': '69.000'} [2024-08-06 08:14:34,508][52662] DAMAGECOUNT value on done: 958316.0 [2024-08-06 08:14:34,509][52662] Sum rewards: 73.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.120', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.268', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:35,056][52820] DAMAGECOUNT value on done: 870075.0 [2024-08-06 08:14:35,058][52820] Sum rewards: 54.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.108', 'AMMO3': '0.246', 'AMMO4': '0.270', 'weapon5': '0.280', 'weapon2': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.890', 'weapon3': '2.980', 'DAMAGECOUNT': '15.030', 'FRAGCOUNT': '46.500'} [2024-08-06 08:14:35,306][52647] DAMAGECOUNT value on done: 1006822.0 [2024-08-06 08:14:35,312][52647] Sum rewards: 70.859, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.035', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon4': '0.170', 'weapon5': '0.194', 'AMMO3': '0.285', 'AMMO4': '0.310', 'WEAPON5': '0.400', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '2.860', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '59.500'} [2024-08-06 08:14:35,439][52649] DAMAGECOUNT value on done: 935802.0 [2024-08-06 08:14:35,439][52649] Sum rewards: 72.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.715', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.153', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '3.034', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:36,208][52667] DAMAGECOUNT value on done: 952309.0 [2024-08-06 08:14:36,216][52667] Sum rewards: 77.944, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.715', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.138', 'weapon4': '0.142', 'AMMO3': '0.145', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.000', 'weapon3': '2.996', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:36,243][52660] DAMAGECOUNT value on done: 953059.0 [2024-08-06 08:14:36,244][52660] Sum rewards: 75.962, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.182', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.164', 'weapon5': '0.182', 'AMMO4': '0.229', 'weapon2': '0.308', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '2.844', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:36,668][52659] DAMAGECOUNT value on done: 950870.0 [2024-08-06 08:14:36,669][52659] Sum rewards: 74.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.152', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'weapon4': '0.260', 'WEAPON3': '1.050', 'weapon3': '3.110', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:37,010][52650] Updated weights for policy 0, policy_version 82661 (0.0021) [2024-08-06 08:14:37,330][52803] DAMAGECOUNT value on done: 895936.0 [2024-08-06 08:14:37,330][52803] Sum rewards: 67.759, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.210', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.090', 'weapon5': '0.136', 'AMMO4': '0.173', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.450', 'weapon3': '2.998', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:37,644][52662] DAMAGECOUNT value on done: 954809.0 [2024-08-06 08:14:37,644][52662] Sum rewards: 85.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.098', 'AMMO4': '0.114', 'weapon5': '0.192', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:37,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 677158912. Throughput: 0: 4371.6. Samples: 169295190. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:14:37,794][52567] Avg episode reward: [(0, '77.061')] [2024-08-06 08:14:38,182][52820] DAMAGECOUNT value on done: 876179.0 [2024-08-06 08:14:38,184][52820] Sum rewards: 81.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.296', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.029', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.230', 'weapon2': '0.302', 'WEAPON3': '1.450', 'weapon3': '3.472', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '67.000'} [2024-08-06 08:14:38,421][52647] DAMAGECOUNT value on done: 990971.0 [2024-08-06 08:14:38,422][52647] Sum rewards: 69.478, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.070', 'AMMO4': '0.133', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.444', 'WEAPON3': '0.800', 'weapon2': '0.962', 'weapon3': '2.816', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.399', 'FRAGCOUNT': '55.000'} [2024-08-06 08:14:38,848][52649] DAMAGECOUNT value on done: 917043.0 [2024-08-06 08:14:38,849][52649] Sum rewards: 85.085, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.506', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:38,863][52667] DAMAGECOUNT value on done: 960509.0 [2024-08-06 08:14:38,863][52667] Sum rewards: 78.264, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.896', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO4': '0.234', 'weapon4': '0.248', 'weapon5': '0.276', 'AMMO3': '0.281', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.788', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '64.500'} [2024-08-06 08:14:38,922][52660] DAMAGECOUNT value on done: 964450.0 [2024-08-06 08:14:38,922][52660] Sum rewards: 78.559, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.701', 'AMMO5': '0.019', 'AMMO2': '0.055', 'AMMO3': '0.184', 'weapon5': '0.264', 'AMMO4': '0.275', 'weapon4': '0.278', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.778', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:39,557][52659] DAMAGECOUNT value on done: 955730.0 [2024-08-06 08:14:39,558][52659] Sum rewards: 75.954, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.586', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.149', 'AMMO3': '0.192', 'weapon4': '0.268', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.226', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:40,330][52803] DAMAGECOUNT value on done: 891281.0 [2024-08-06 08:14:40,330][52803] Sum rewards: 70.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.505', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.084', 'weapon5': '0.190', 'AMMO3': '0.210', 'AMMO4': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:40,588][52662] DAMAGECOUNT value on done: 952338.0 [2024-08-06 08:14:40,588][52662] Sum rewards: 73.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.532', 'AMMO5': '0.017', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.182', 'weapon4': '0.186', 'AMMO3': '0.193', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:40,774][52647] DAMAGECOUNT value on done: 998659.0 [2024-08-06 08:14:40,776][52647] Sum rewards: 64.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.739', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.092', 'weapon4': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.206', 'weapon2': '0.214', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.440', 'DAMAGECOUNT': '14.367', 'FRAGCOUNT': '55.000'} [2024-08-06 08:14:41,376][52820] DAMAGECOUNT value on done: 877872.0 [2024-08-06 08:14:41,379][52820] Sum rewards: 72.650, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.175', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.084', 'weapon5': '0.182', 'AMMO3': '0.202', 'AMMO4': '0.237', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:41,511][52667] DAMAGECOUNT value on done: 964682.0 [2024-08-06 08:14:41,511][52667] Sum rewards: 67.112, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.315', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.094', 'AMMO4': '0.214', 'weapon5': '0.214', 'AMMO3': '0.244', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.632', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:41,698][52649] DAMAGECOUNT value on done: 935993.0 [2024-08-06 08:14:41,699][52649] Sum rewards: 75.265, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.292', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.036', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.281', 'weapon2': '0.382', 'WEAPON3': '1.650', 'weapon3': '3.352', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.000'} [2024-08-06 08:14:41,902][52650] Updated weights for policy 0, policy_version 82671 (0.0012) [2024-08-06 08:14:42,053][52660] DAMAGECOUNT value on done: 946337.0 [2024-08-06 08:14:42,053][52660] Sum rewards: 79.700, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.970', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.100', 'weapon5': '0.242', 'AMMO3': '0.258', 'AMMO4': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.500', 'weapon3': '2.952', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:42,613][52659] DAMAGECOUNT value on done: 954605.0 [2024-08-06 08:14:42,615][52659] Sum rewards: 62.514, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.192', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.138', 'AMMO4': '0.165', 'AMMO3': '0.269', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.672', 'WEAPON3': '1.700', 'weapon3': '2.794', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '54.000'} [2024-08-06 08:14:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 677249024. Throughput: 0: 4376.5. Samples: 169321650. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:14:42,795][52567] Avg episode reward: [(0, '76.279')] [2024-08-06 08:14:43,870][52647] DAMAGECOUNT value on done: 992972.0 [2024-08-06 08:14:43,872][52647] Sum rewards: 71.088, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.755', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.080', 'weapon5': '0.218', 'weapon2': '0.224', 'AMMO3': '0.258', 'AMMO4': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.152', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '61.500'} [2024-08-06 08:14:43,897][52662] DAMAGECOUNT value on done: 946136.0 [2024-08-06 08:14:43,900][52662] Sum rewards: 68.407, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.112', 'AMMO3': '0.171', 'AMMO4': '0.206', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '3.024', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '54.000'} [2024-08-06 08:14:44,197][52649] DAMAGECOUNT value on done: 937414.0 [2024-08-06 08:14:44,198][52649] Sum rewards: 77.988, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.198', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:44,436][52820] DAMAGECOUNT value on done: 886240.0 [2024-08-06 08:14:44,436][52820] Sum rewards: 75.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.947', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.128', 'AMMO4': '0.210', 'weapon2': '0.214', 'AMMO3': '0.215', 'weapon5': '0.216', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.166', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '61.000'} [2024-08-06 08:14:44,486][52667] DAMAGECOUNT value on done: 967442.0 [2024-08-06 08:14:44,489][52667] Sum rewards: 86.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.149', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.603', 'FRAGCOUNT': '70.000'} [2024-08-06 08:14:45,169][52660] DAMAGECOUNT value on done: 944296.0 [2024-08-06 08:14:45,169][52660] Sum rewards: 80.323, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.144', 'AMMO4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.600', 'WEAPON3': '0.850', 'HEALTH': '0.858', 'weapon3': '2.778', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:45,476][52659] DAMAGECOUNT value on done: 956099.0 [2024-08-06 08:14:45,476][52659] Sum rewards: 73.058, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.282', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.194', 'AMMO3': '0.195', 'weapon4': '0.202', 'weapon2': '0.210', 'AMMO4': '0.267', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '58.500'} [2024-08-06 08:14:46,189][52647] DAMAGECOUNT value on done: 996353.0 [2024-08-06 08:14:46,190][52647] Sum rewards: 74.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.476', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.181', 'weapon5': '0.182', 'AMMO4': '0.236', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.824', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '58.500'} [2024-08-06 08:14:46,639][52650] Updated weights for policy 0, policy_version 82681 (0.0012) [2024-08-06 08:14:46,657][52666] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:14:46,949][52662] DAMAGECOUNT value on done: 957332.0 [2024-08-06 08:14:46,949][52662] Sum rewards: 82.385, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.128', 'weapon5': '0.132', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.268', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.203', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:47,343][52649] DAMAGECOUNT value on done: 927965.0 [2024-08-06 08:14:47,345][52649] Sum rewards: 88.284, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.280', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO3': '0.191', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.112', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '21.546', 'FRAGCOUNT': '71.000'} [2024-08-06 08:14:47,429][52667] DAMAGECOUNT value on done: 963754.0 [2024-08-06 08:14:47,432][52667] Sum rewards: 77.597, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.530', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.109', 'weapon5': '0.142', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'weapon2': '0.492', 'WEAPON3': '1.500', 'weapon3': '2.998', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:47,504][52795] DAMAGECOUNT value on done: 877095.0 [2024-08-06 08:14:47,504][52795] Sum rewards: 71.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.038', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.068', 'weapon5': '0.162', 'AMMO4': '0.203', 'AMMO3': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.350', 'weapon3': '2.976', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:47,505][52820] DAMAGECOUNT value on done: 893548.0 [2024-08-06 08:14:47,509][52820] Sum rewards: 77.417, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.000', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.060', 'weapon5': '0.104', 'AMMO4': '0.169', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '68.000'} [2024-08-06 08:14:47,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 677347328. Throughput: 0: 4375.6. Samples: 169334620. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:14:47,794][52567] Avg episode reward: [(0, '76.380')] [2024-08-06 08:14:48,150][52660] DAMAGECOUNT value on done: 950362.0 [2024-08-06 08:14:48,152][52660] Sum rewards: 90.822, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.195', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.402', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '73.000'} [2024-08-06 08:14:48,361][52659] DAMAGECOUNT value on done: 953887.0 [2024-08-06 08:14:48,363][52659] Sum rewards: 75.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.917', 'AMMO5': '0.016', 'AMMO2': '0.062', 'AMMO3': '0.160', 'weapon5': '0.184', 'weapon4': '0.264', 'AMMO4': '0.311', 'weapon2': '0.314', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '60.500'} [2024-08-06 08:14:49,701][52662] DAMAGECOUNT value on done: 950105.0 [2024-08-06 08:14:49,701][52662] Sum rewards: 83.879, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.676', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.142', 'weapon4': '0.158', 'AMMO3': '0.226', 'AMMO4': '0.280', 'weapon2': '0.366', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.735', 'FRAGCOUNT': '70.000'} [2024-08-06 08:14:49,917][52667] DAMAGECOUNT value on done: 959634.0 [2024-08-06 08:14:49,920][52667] Sum rewards: 77.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.360', 'AMMO5': '0.004', 'weapon5': '0.020', 'AMMO2': '0.029', 'weapon4': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.474', 'WEAPON3': '1.050', 'weapon3': '3.200', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '63.000'} [2024-08-06 08:14:50,570][52795] DAMAGECOUNT value on done: 871355.0 [2024-08-06 08:14:50,571][52795] Sum rewards: 78.471, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.998', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '62.000'} [2024-08-06 08:14:50,700][52820] DAMAGECOUNT value on done: 876445.0 [2024-08-06 08:14:50,700][52820] Sum rewards: 73.671, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.090', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.086', 'WEAPON5': '0.100', 'weapon4': '0.108', 'AMMO4': '0.163', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '60.000'} [2024-08-06 08:14:51,058][52660] DAMAGECOUNT value on done: 957012.0 [2024-08-06 08:14:51,060][52660] Sum rewards: 76.369, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.374', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.144', 'AMMO3': '0.173', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '61.000'} [2024-08-06 08:14:51,296][52659] DAMAGECOUNT value on done: 963046.0 [2024-08-06 08:14:51,298][52659] Sum rewards: 79.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.883', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.094', 'weapon5': '0.154', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:51,595][52650] Updated weights for policy 0, policy_version 82691 (0.0046) [2024-08-06 08:14:52,702][52662] DAMAGECOUNT value on done: 966054.0 [2024-08-06 08:14:52,703][52662] Sum rewards: 65.899, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.192', 'AMMO4': '0.202', 'AMMO3': '0.222', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.120', 'weapon3': '3.282', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '55.000'} [2024-08-06 08:14:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 677429248. Throughput: 0: 4373.3. Samples: 169360780. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:14:52,794][52567] Avg episode reward: [(0, '76.049')] [2024-08-06 08:14:52,921][52667] DAMAGECOUNT value on done: 963744.0 [2024-08-06 08:14:52,922][52667] Sum rewards: 77.503, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.027', 'weapon5': '0.046', 'WEAPON4': '0.050', 'weapon4': '0.054', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.366', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '63.500'} [2024-08-06 08:14:53,742][52795] DAMAGECOUNT value on done: 874249.0 [2024-08-06 08:14:53,743][52795] Sum rewards: 70.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.862', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.136', 'AMMO4': '0.174', 'AMMO3': '0.211', 'weapon5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.941', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:53,904][52820] DAMAGECOUNT value on done: 886514.0 [2024-08-06 08:14:53,905][52820] Sum rewards: 69.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.396', 'AMMO5': '0.017', 'AMMO2': '0.057', 'AMMO3': '0.197', 'weapon4': '0.224', 'weapon2': '0.264', 'AMMO4': '0.284', 'weapon5': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '58.000'} [2024-08-06 08:14:54,014][52659] DAMAGECOUNT value on done: 948701.0 [2024-08-06 08:14:54,017][52659] Sum rewards: 75.847, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.206', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.087', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.171', 'weapon2': '0.312', 'WEAPON3': '1.000', 'HITCOUNT': '3.380', 'weapon3': '3.416', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '61.000'} [2024-08-06 08:14:54,110][52660] DAMAGECOUNT value on done: 946419.0 [2024-08-06 08:14:54,111][52660] Sum rewards: 70.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.028', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.227', 'weapon2': '0.254', 'WEAPON3': '1.400', 'HITCOUNT': '3.260', 'weapon3': '3.604', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:54,806][52658] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:14:55,427][52670] Large shaping reward 2.568 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('HEALTH', -0.033, -11.0), ('weapon5', 0.002)] [2024-08-06 08:14:55,881][52662] DAMAGECOUNT value on done: 955737.0 [2024-08-06 08:14:55,882][52662] Sum rewards: 76.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.439', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.170', 'weapon2': '0.216', 'AMMO3': '0.244', 'AMMO4': '0.264', 'weapon5': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.994', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '64.000'} [2024-08-06 08:14:55,908][52650] Updated weights for policy 0, policy_version 82701 (0.0021) [2024-08-06 08:14:56,821][52660] DAMAGECOUNT value on done: 944457.0 [2024-08-06 08:14:56,822][52660] Sum rewards: 83.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.448', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '70.000'} [2024-08-06 08:14:56,849][52795] DAMAGECOUNT value on done: 888453.0 [2024-08-06 08:14:56,849][52795] Sum rewards: 68.491, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO4': '-0.026', 'AMMO2': '-0.005', 'AMMO3': '0.173', 'weapon2': '0.570', 'WEAPON3': '1.100', 'weapon3': '3.288', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.371', 'FRAGCOUNT': '56.000'} [2024-08-06 08:14:56,878][52659] DAMAGECOUNT value on done: 959859.0 [2024-08-06 08:14:56,878][52659] Sum rewards: 69.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'weapon4': '0.178', 'AMMO3': '0.184', 'weapon2': '0.212', 'WEAPON3': '1.200', 'HITCOUNT': '3.290', 'weapon3': '3.430', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '57.000'} [2024-08-06 08:14:57,050][52820] DAMAGECOUNT value on done: 899373.0 [2024-08-06 08:14:57,051][52820] Sum rewards: 80.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.738', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon2': '0.134', 'AMMO3': '0.199', 'weapon5': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '66.000'} [2024-08-06 08:14:57,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 677511168. Throughput: 0: 4370.9. Samples: 169386800. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:14:57,794][52567] Avg episode reward: [(0, '76.114')] [2024-08-06 08:14:58,675][52662] DAMAGECOUNT value on done: 945282.0 [2024-08-06 08:14:58,677][52662] Sum rewards: 73.036, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.216', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.176', 'AMMO4': '0.181', 'weapon5': '0.208', 'weapon4': '0.210', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '59.000'} [2024-08-06 08:14:59,538][52660] DAMAGECOUNT value on done: 950837.0 [2024-08-06 08:14:59,538][52660] Sum rewards: 80.470, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.084', 'AMMO4': '0.144', 'weapon5': '0.206', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.104', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.536', 'FRAGCOUNT': '66.000'} [2024-08-06 08:14:59,580][52664] DAMAGECOUNT value on done: 981960.0 [2024-08-06 08:14:59,581][52664] Sum rewards: 67.444, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO3': '0.155', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.000', 'HITCOUNT': '3.230', 'weapon3': '3.282', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '55.000'} [2024-08-06 08:14:59,909][52795] DAMAGECOUNT value on done: 872923.0 [2024-08-06 08:14:59,909][52795] Sum rewards: 77.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.795', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.190', 'AMMO4': '0.225', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:00,047][52659] DAMAGECOUNT value on done: 953020.0 [2024-08-06 08:15:00,049][52659] Sum rewards: 71.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.166', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.050', 'AMMO4': '0.071', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '2.828', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '58.000'} [2024-08-06 08:15:00,142][52820] DAMAGECOUNT value on done: 888327.0 [2024-08-06 08:15:00,142][52820] Sum rewards: 77.827, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.454', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.194', 'weapon2': '0.210', 'AMMO4': '0.249', 'weapon5': '0.258', 'weapon4': '0.366', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:01,031][52650] Updated weights for policy 0, policy_version 82711 (0.0019) [2024-08-06 08:15:01,526][52662] DAMAGECOUNT value on done: 950129.0 [2024-08-06 08:15:01,529][52662] Sum rewards: 58.588, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.814', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.038', 'AMMO4': '0.085', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.126', 'DAMAGECOUNT': '15.120', 'FRAGCOUNT': '48.500'} [2024-08-06 08:15:02,333][52664] DAMAGECOUNT value on done: 989182.0 [2024-08-06 08:15:02,335][52664] Sum rewards: 83.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.520', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.086', 'weapon5': '0.088', 'AMMO4': '0.186', 'weapon2': '0.192', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.402', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:02,443][52660] DAMAGECOUNT value on done: 945491.0 [2024-08-06 08:15:02,443][52660] Sum rewards: 69.084, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.182', 'AMMO5': '0.003', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.360', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.334', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '55.000'} [2024-08-06 08:15:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 677601280. Throughput: 0: 4371.8. Samples: 169400100. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:15:02,794][52567] Avg episode reward: [(0, '75.802')] [2024-08-06 08:15:03,079][52659] DAMAGECOUNT value on done: 950122.0 [2024-08-06 08:15:03,080][52659] Sum rewards: 79.020, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.795', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.240', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '67.000'} [2024-08-06 08:15:03,091][52795] DAMAGECOUNT value on done: 878610.0 [2024-08-06 08:15:03,092][52795] Sum rewards: 77.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.270', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.106', 'AMMO3': '0.175', 'AMMO4': '0.189', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.416', 'weapon4': '0.494', 'WEAPON3': '1.100', 'weapon3': '2.704', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:03,266][52820] DAMAGECOUNT value on done: 885150.0 [2024-08-06 08:15:03,266][52820] Sum rewards: 71.694, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.244', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.077', 'weapon4': '0.086', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'WEAPON5': '0.200', 'weapon2': '0.250', 'WEAPON3': '0.950', 'HITCOUNT': '3.220', 'weapon3': '3.322', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '57.000'} [2024-08-06 08:15:04,255][52662] DAMAGECOUNT value on done: 946194.0 [2024-08-06 08:15:04,258][52662] Sum rewards: 69.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.062', 'weapon4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.594', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '58.000'} [2024-08-06 08:15:05,082][52664] DAMAGECOUNT value on done: 993190.0 [2024-08-06 08:15:05,083][52664] Sum rewards: 86.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.086', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.080', 'AMMO4': '0.087', 'AMMO3': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '70.000'} [2024-08-06 08:15:05,154][52650] Updated weights for policy 0, policy_version 82721 (0.0013) [2024-08-06 08:15:05,517][52660] DAMAGECOUNT value on done: 945143.0 [2024-08-06 08:15:05,517][52660] Sum rewards: 80.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.751', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.184', 'AMMO4': '0.235', 'weapon5': '0.254', 'weapon4': '0.352', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '2.520', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '66.000'} [2024-08-06 08:15:05,873][52659] DAMAGECOUNT value on done: 954781.0 [2024-08-06 08:15:05,875][52659] Sum rewards: 77.356, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.142', 'weapon5': '0.178', 'AMMO4': '0.203', 'AMMO3': '0.204', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:06,192][52795] DAMAGECOUNT value on done: 889000.0 [2024-08-06 08:15:06,192][52795] Sum rewards: 85.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.692', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.174', 'AMMO3': '0.188', 'AMMO4': '0.190', 'weapon4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:06,456][52820] DAMAGECOUNT value on done: 885028.0 [2024-08-06 08:15:06,456][52820] Sum rewards: 81.273, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.345', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.062', 'AMMO4': '0.120', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '66.500'} [2024-08-06 08:15:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 677691392. Throughput: 0: 4368.7. Samples: 169426160. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:15:07,794][52567] Avg episode reward: [(0, '75.877')] [2024-08-06 08:15:07,915][52664] DAMAGECOUNT value on done: 983180.0 [2024-08-06 08:15:07,917][52664] Sum rewards: 80.179, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.310', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.107', 'weapon5': '0.114', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.100', 'weapon3': '2.956', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '63.500'} [2024-08-06 08:15:08,681][52660] DAMAGECOUNT value on done: 954528.0 [2024-08-06 08:15:08,683][52660] Sum rewards: 84.784, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.116', 'weapon4': '0.128', 'AMMO4': '0.149', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'WEAPON3': '1.100', 'weapon3': '3.332', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:08,773][52659] DAMAGECOUNT value on done: 954820.0 [2024-08-06 08:15:08,773][52659] Sum rewards: 87.472, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.140', 'weapon5': '0.166', 'AMMO3': '0.193', 'AMMO4': '0.219', 'weapon2': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '72.000'} [2024-08-06 08:15:09,266][52795] DAMAGECOUNT value on done: 878927.0 [2024-08-06 08:15:09,267][52795] Sum rewards: 72.027, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.148', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.110', 'AMMO4': '0.201', 'weapon2': '0.202', 'weapon5': '0.218', 'AMMO3': '0.259', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.136', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '60.000'} [2024-08-06 08:15:09,638][52820] DAMAGECOUNT value on done: 885539.0 [2024-08-06 08:15:09,638][52820] Sum rewards: 77.077, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.235', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.128', 'AMMO4': '0.158', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:10,055][52650] Updated weights for policy 0, policy_version 82731 (0.0031) [2024-08-06 08:15:10,631][52664] DAMAGECOUNT value on done: 998134.0 [2024-08-06 08:15:10,631][52664] Sum rewards: 86.977, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.388', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.112', 'AMMO4': '0.148', 'AMMO3': '0.166', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.100', 'weapon3': '3.128', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:11,377][52659] DAMAGECOUNT value on done: 965572.0 [2024-08-06 08:15:11,378][52659] Sum rewards: 70.788, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.940', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.070', 'weapon5': '0.144', 'AMMO3': '0.202', 'AMMO4': '0.221', 'weapon2': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.268', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '60.000'} [2024-08-06 08:15:11,645][52660] DAMAGECOUNT value on done: 968765.0 [2024-08-06 08:15:11,646][52660] Sum rewards: 73.430, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO5': '0.007', 'weapon5': '0.010', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.376', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:12,572][52795] DAMAGECOUNT value on done: 881030.0 [2024-08-06 08:15:12,575][52795] Sum rewards: 86.629, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.026', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.152', 'AMMO3': '0.160', 'weapon5': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.050', 'weapon3': '2.966', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '70.000'} [2024-08-06 08:15:12,757][52820] DAMAGECOUNT value on done: 894212.0 [2024-08-06 08:15:12,757][52820] Sum rewards: 67.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.034', 'AMMO4': '0.036', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.518', 'WEAPON3': '1.450', 'weapon3': '3.214', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '56.000'} [2024-08-06 08:15:12,795][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 677773312. Throughput: 0: 4368.4. Samples: 169452440. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:15:12,795][52567] Avg episode reward: [(0, '76.039')] [2024-08-06 08:15:12,931][52664] DAMAGECOUNT value on done: 994303.0 [2024-08-06 08:15:12,933][52664] Sum rewards: 89.769, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.625', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.051', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.298', 'WEAPON3': '1.150', 'weapon3': '3.374', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.276', 'FRAGCOUNT': '71.000'} [2024-08-06 08:15:13,534][52658] DAMAGECOUNT value on done: 958225.0 [2024-08-06 08:15:13,534][52658] Sum rewards: 78.890, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.507', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.136', 'weapon4': '0.162', 'AMMO4': '0.201', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '2.932', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 08:15:14,216][52659] DAMAGECOUNT value on done: 946467.0 [2024-08-06 08:15:14,220][52659] Sum rewards: 68.681, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.770', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.020', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.480', 'WEAPON3': '1.500', 'weapon3': '3.270', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '60.000'} [2024-08-06 08:15:14,655][52660] DAMAGECOUNT value on done: 948538.0 [2024-08-06 08:15:14,656][52660] Sum rewards: 63.805, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.084', 'weapon5': '0.138', 'AMMO4': '0.152', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.326', 'WEAPON3': '1.800', 'HITCOUNT': '3.070', 'weapon3': '3.140', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:14,784][52650] Updated weights for policy 0, policy_version 82741 (0.0031) [2024-08-06 08:15:15,719][52795] DAMAGECOUNT value on done: 888049.0 [2024-08-06 08:15:15,720][52795] Sum rewards: 70.563, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.084', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'AMMO3': '0.176', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.448', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 08:15:15,864][52820] DAMAGECOUNT value on done: 894429.0 [2024-08-06 08:15:15,864][52820] Sum rewards: 72.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.178', 'weapon4': '0.192', 'AMMO3': '0.208', 'AMMO4': '0.224', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.036', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:15,915][52664] DAMAGECOUNT value on done: 983068.0 [2024-08-06 08:15:15,917][52664] Sum rewards: 81.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.142', 'weapon5': '0.154', 'AMMO3': '0.193', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.150', 'weapon3': '3.060', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:16,344][52658] DAMAGECOUNT value on done: 959594.0 [2024-08-06 08:15:16,345][52658] Sum rewards: 80.265, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.650', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.130', 'AMMO4': '0.138', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO3': '0.261', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '69.000'} [2024-08-06 08:15:17,623][52659] DAMAGECOUNT value on done: 958784.0 [2024-08-06 08:15:17,624][52659] Sum rewards: 60.351, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.170', 'weapon5': '0.182', 'AMMO3': '0.243', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.130', 'weapon3': '3.218', 'DAMAGECOUNT': '16.308', 'FRAGCOUNT': '52.000'} [2024-08-06 08:15:17,714][52660] DAMAGECOUNT value on done: 955947.0 [2024-08-06 08:15:17,714][52660] Sum rewards: 84.631, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.198', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.183', 'weapon5': '0.202', 'weapon2': '0.214', 'weapon4': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 677863424. Throughput: 0: 4371.8. Samples: 169465510. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:15:17,794][52567] Avg episode reward: [(0, '76.184')] [2024-08-06 08:15:18,777][52658] DAMAGECOUNT value on done: 961172.0 [2024-08-06 08:15:18,777][52658] Sum rewards: 81.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.300', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.058', 'weapon4': '0.076', 'AMMO4': '0.152', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:18,914][52795] DAMAGECOUNT value on done: 882937.0 [2024-08-06 08:15:18,914][52795] Sum rewards: 69.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.301', 'AMMO5': '0.008', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '56.000'} [2024-08-06 08:15:19,029][52820] DAMAGECOUNT value on done: 882647.0 [2024-08-06 08:15:19,030][52820] Sum rewards: 81.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.123', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.170', 'AMMO3': '0.183', 'AMMO4': '0.203', 'weapon5': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '2.824', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '65.000'} [2024-08-06 08:15:19,285][52664] DAMAGECOUNT value on done: 984030.0 [2024-08-06 08:15:19,286][52664] Sum rewards: 74.960, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.167', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.204', 'AMMO3': '0.209', 'weapon5': '0.274', 'weapon2': '0.292', 'weapon4': '0.408', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.738', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:19,406][52650] Updated weights for policy 0, policy_version 82751 (0.0014) [2024-08-06 08:15:20,527][52660] DAMAGECOUNT value on done: 951544.0 [2024-08-06 08:15:20,527][52660] Sum rewards: 75.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.442', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:20,725][52659] DAMAGECOUNT value on done: 951414.0 [2024-08-06 08:15:20,725][52659] Sum rewards: 80.287, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.024', 'weapon4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'AMMO3': '0.208', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.382', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '67.000'} [2024-08-06 08:15:20,805][52614] Signal inference workers to stop experience collection... (15150 times) [2024-08-06 08:15:20,805][52614] Signal inference workers to resume experience collection... (15150 times) [2024-08-06 08:15:20,862][52650] InferenceWorker_p0-w0: stopping experience collection (15150 times) [2024-08-06 08:15:20,863][52650] InferenceWorker_p0-w0: resuming experience collection (15150 times) [2024-08-06 08:15:21,555][52658] DAMAGECOUNT value on done: 958406.0 [2024-08-06 08:15:21,557][52658] Sum rewards: 82.792, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.404', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.122', 'weapon5': '0.136', 'AMMO4': '0.164', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.908', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '67.000'} [2024-08-06 08:15:22,093][52664] DAMAGECOUNT value on done: 990543.0 [2024-08-06 08:15:22,093][52664] Sum rewards: 73.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.350', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.185', 'AMMO4': '0.197', 'weapon4': '0.212', 'weapon5': '0.286', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.852', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:22,102][52795] DAMAGECOUNT value on done: 875342.0 [2024-08-06 08:15:22,103][52795] Sum rewards: 69.906, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.980', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.188', 'AMMO3': '0.196', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '55.000'} [2024-08-06 08:15:22,607][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:15:22,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 677953536. Throughput: 0: 4365.6. Samples: 169491640. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:15:22,802][52567] Avg episode reward: [(0, '76.020')] [2024-08-06 08:15:23,545][52660] DAMAGECOUNT value on done: 942307.0 [2024-08-06 08:15:23,545][52660] Sum rewards: 68.189, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.390', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.165', 'weapon2': '0.520', 'WEAPON3': '1.050', 'weapon3': '3.268', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '54.000'} [2024-08-06 08:15:23,701][52669] DAMAGECOUNT value on done: 954817.0 [2024-08-06 08:15:23,702][52669] Sum rewards: 78.041, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.598', 'AMMO2': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.028', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon4': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.500'} [2024-08-06 08:15:24,054][52650] Updated weights for policy 0, policy_version 82761 (0.0031) [2024-08-06 08:15:24,125][52658] DAMAGECOUNT value on done: 950239.0 [2024-08-06 08:15:24,125][52658] Sum rewards: 78.212, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.280', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.134', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'AMMO3': '0.276', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.228', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '67.000'} [2024-08-06 08:15:24,883][52664] DAMAGECOUNT value on done: 990127.0 [2024-08-06 08:15:24,891][52664] Sum rewards: 76.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.918', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon2': '0.172', 'AMMO3': '0.211', 'weapon5': '0.222', 'weapon4': '0.224', 'AMMO4': '0.256', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:25,012][52671] DAMAGECOUNT value on done: 961080.0 [2024-08-06 08:15:25,013][52671] Sum rewards: 76.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.102', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.096', 'weapon5': '0.172', 'AMMO4': '0.213', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:25,191][52795] DAMAGECOUNT value on done: 881250.0 [2024-08-06 08:15:25,191][52795] Sum rewards: 68.131, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.094', 'AMMO4': '0.103', 'weapon4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.366', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '57.000'} [2024-08-06 08:15:26,196][52669] DAMAGECOUNT value on done: 952575.0 [2024-08-06 08:15:26,197][52669] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon4': '0.124', 'AMMO3': '0.226', 'weapon5': '0.240', 'AMMO4': '0.284', 'weapon2': '0.400', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '59.500'} [2024-08-06 08:15:26,399][52649] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:15:26,692][52660] DAMAGECOUNT value on done: 944615.0 [2024-08-06 08:15:26,693][52660] Sum rewards: 64.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon2': '0.130', 'weapon5': '0.134', 'AMMO4': '0.150', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'HITCOUNT': '3.190', 'weapon3': '3.456', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '54.000'} [2024-08-06 08:15:27,290][52658] DAMAGECOUNT value on done: 948061.0 [2024-08-06 08:15:27,292][52658] Sum rewards: 71.591, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.289', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.160', 'AMMO4': '0.209', 'AMMO3': '0.218', 'weapon5': '0.226', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.838', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:27,685][52664] DAMAGECOUNT value on done: 998697.0 [2024-08-06 08:15:27,685][52664] Sum rewards: 77.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.085', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.120', 'AMMO4': '0.128', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '64.000'} [2024-08-06 08:15:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 678035456. Throughput: 0: 4358.5. Samples: 169517780. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:15:27,794][52567] Avg episode reward: [(0, '75.765')] [2024-08-06 08:15:27,853][52671] DAMAGECOUNT value on done: 966528.0 [2024-08-06 08:15:27,854][52671] Sum rewards: 80.185, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.356', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.166', 'weapon4': '0.210', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '2.930', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '64.000'} [2024-08-06 08:15:27,907][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:15:28,217][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 08:15:28,374][52795] DAMAGECOUNT value on done: 885603.0 [2024-08-06 08:15:28,374][52795] Sum rewards: 75.131, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.748', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.070', 'AMMO3': '0.181', 'AMMO4': '0.218', 'weapon5': '0.260', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:28,700][52650] Updated weights for policy 0, policy_version 82771 (0.0019) [2024-08-06 08:15:29,076][52669] DAMAGECOUNT value on done: 964157.0 [2024-08-06 08:15:29,077][52669] Sum rewards: 69.262, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.288', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.108', 'AMMO4': '0.194', 'AMMO3': '0.196', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.250', 'weapon3': '3.306', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '56.000'} [2024-08-06 08:15:30,180][52664] DAMAGECOUNT value on done: 993679.0 [2024-08-06 08:15:30,180][52664] Sum rewards: 82.785, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.060', 'AMMO4': '0.104', 'weapon5': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '67.000'} [2024-08-06 08:15:30,388][52671] DAMAGECOUNT value on done: 960325.0 [2024-08-06 08:15:30,390][52671] Sum rewards: 74.169, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.854', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.156', 'AMMO3': '0.183', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:30,459][52658] DAMAGECOUNT value on done: 961507.0 [2024-08-06 08:15:30,459][52658] Sum rewards: 72.949, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.282', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.108', 'AMMO3': '0.220', 'AMMO4': '0.240', 'weapon5': '0.332', 'WEAPON4': '0.450', 'weapon2': '0.488', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:31,525][52795] DAMAGECOUNT value on done: 873058.0 [2024-08-06 08:15:31,526][52795] Sum rewards: 66.020, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.528', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.030', 'AMMO4': '0.037', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.251', 'weapon2': '0.374', 'WEAPON3': '1.600', 'HITCOUNT': '3.120', 'weapon3': '3.262', 'DAMAGECOUNT': '15.573', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:32,363][52669] DAMAGECOUNT value on done: 954380.0 [2024-08-06 08:15:32,363][52669] Sum rewards: 78.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.706', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.080', 'weapon5': '0.086', 'AMMO4': '0.162', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '66.000'} [2024-08-06 08:15:32,726][52664] DAMAGECOUNT value on done: 993921.0 [2024-08-06 08:15:32,726][52664] Sum rewards: 75.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.338', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.120', 'weapon5': '0.174', 'AMMO3': '0.203', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '61.000'} [2024-08-06 08:15:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 678125568. Throughput: 0: 4362.4. Samples: 169530930. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:15:32,802][52567] Avg episode reward: [(0, '75.881')] [2024-08-06 08:15:33,314][52671] DAMAGECOUNT value on done: 964950.0 [2024-08-06 08:15:33,315][52671] Sum rewards: 79.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.592', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.106', 'AMMO3': '0.200', 'weapon5': '0.224', 'AMMO4': '0.248', 'weapon2': '0.476', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.902', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '65.000'} [2024-08-06 08:15:33,363][52658] DAMAGECOUNT value on done: 949263.0 [2024-08-06 08:15:33,363][52658] Sum rewards: 64.316, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.365', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.138', 'AMMO4': '0.142', 'weapon4': '0.156', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.100', 'HITCOUNT': '2.860', 'weapon3': '3.230', 'DAMAGECOUNT': '15.192', 'FRAGCOUNT': '54.000'} [2024-08-06 08:15:33,628][52650] Updated weights for policy 0, policy_version 82781 (0.0012) [2024-08-06 08:15:34,645][52795] DAMAGECOUNT value on done: 883143.0 [2024-08-06 08:15:34,647][52795] Sum rewards: 78.245, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.125', 'weapon2': '0.260', 'weapon4': '0.298', 'WEAPON3': '0.950', 'weapon3': '3.252', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '60.000'} [2024-08-06 08:15:35,025][52669] DAMAGECOUNT value on done: 963456.0 [2024-08-06 08:15:35,026][52669] Sum rewards: 70.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.514', 'AMMO5': '0.017', 'AMMO2': '0.061', 'weapon4': '0.164', 'weapon5': '0.220', 'AMMO3': '0.238', 'AMMO4': '0.307', 'weapon2': '0.370', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.882', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:35,839][52664] DAMAGECOUNT value on done: 1006016.0 [2024-08-06 08:15:35,840][52664] Sum rewards: 63.853, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon2': '0.174', 'AMMO4': '0.199', 'weapon5': '0.214', 'AMMO3': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.270', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '55.000'} [2024-08-06 08:15:36,085][52671] DAMAGECOUNT value on done: 971666.0 [2024-08-06 08:15:36,086][52671] Sum rewards: 59.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.810', 'AMMO5': '0.022', 'AMMO2': '0.070', 'AMMO3': '0.204', 'weapon4': '0.208', 'weapon5': '0.222', 'weapon2': '0.244', 'AMMO4': '0.351', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'HITCOUNT': '2.780', 'weapon3': '3.056', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '49.000'} [2024-08-06 08:15:36,511][52658] DAMAGECOUNT value on done: 976830.0 [2024-08-06 08:15:36,511][52658] Sum rewards: 76.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon4': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.216', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:37,780][52795] DAMAGECOUNT value on done: 883582.0 [2024-08-06 08:15:37,780][52795] Sum rewards: 77.765, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.042', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.063', 'WEAPON4': '0.100', 'weapon5': '0.116', 'AMMO3': '0.158', 'WEAPON5': '0.200', 'weapon2': '0.540', 'WEAPON3': '0.950', 'weapon3': '3.066', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '60.000'} [2024-08-06 08:15:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 678215680. Throughput: 0: 4364.4. Samples: 169557180. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:15:37,802][52567] Avg episode reward: [(0, '75.585')] [2024-08-06 08:15:37,828][52669] DAMAGECOUNT value on done: 961099.0 [2024-08-06 08:15:37,828][52669] Sum rewards: 73.270, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon4': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '58.000'} [2024-08-06 08:15:38,312][52650] Updated weights for policy 0, policy_version 82791 (0.0024) [2024-08-06 08:15:39,048][52664] DAMAGECOUNT value on done: 1002576.0 [2024-08-06 08:15:39,050][52664] Sum rewards: 78.080, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.922', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.178', 'weapon5': '0.186', 'weapon4': '0.196', 'weapon2': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:39,160][52658] DAMAGECOUNT value on done: 963058.0 [2024-08-06 08:15:39,160][52658] Sum rewards: 73.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.702', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.039', 'weapon4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO3': '0.184', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.370', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '61.000'} [2024-08-06 08:15:39,204][52671] DAMAGECOUNT value on done: 959378.0 [2024-08-06 08:15:39,204][52671] Sum rewards: 78.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.028', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.228', 'weapon2': '0.230', 'WEAPON3': '1.450', 'weapon3': '3.498', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '65.000'} [2024-08-06 08:15:40,601][52669] DAMAGECOUNT value on done: 961424.0 [2024-08-06 08:15:40,601][52669] Sum rewards: 82.182, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.375', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO4': '0.157', 'weapon4': '0.178', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.242', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:41,068][52795] DAMAGECOUNT value on done: 871018.0 [2024-08-06 08:15:41,070][52795] Sum rewards: 76.324, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.269', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.066', 'weapon4': '0.096', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:41,219][52669] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.585, 195.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:15:41,550][52664] DAMAGECOUNT value on done: 1001211.0 [2024-08-06 08:15:41,551][52664] Sum rewards: 66.598, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.534', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon5': '0.064', 'weapon4': '0.206', 'AMMO3': '0.226', 'AMMO4': '0.267', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '57.000'} [2024-08-06 08:15:41,791][52658] DAMAGECOUNT value on done: 967888.0 [2024-08-06 08:15:41,792][52658] Sum rewards: 71.873, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.381', 'AMMO5': '0.020', 'AMMO2': '0.045', 'AMMO3': '0.157', 'AMMO4': '0.225', 'weapon4': '0.256', 'weapon5': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.578', 'WEAPON3': '1.050', 'weapon3': '2.630', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '56.000'} [2024-08-06 08:15:42,293][52671] DAMAGECOUNT value on done: 961033.0 [2024-08-06 08:15:42,296][52671] Sum rewards: 66.492, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.796', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.126', 'AMMO4': '0.249', 'weapon5': '0.290', 'AMMO3': '0.292', 'weapon2': '0.356', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.874', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '56.500'} [2024-08-06 08:15:42,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 678297600. Throughput: 0: 4361.3. Samples: 169583060. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:15:42,795][52567] Avg episode reward: [(0, '75.126')] [2024-08-06 08:15:42,822][52650] Updated weights for policy 0, policy_version 82801 (0.0016) [2024-08-06 08:15:43,094][52647] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 08:15:43,444][52669] DAMAGECOUNT value on done: 960671.0 [2024-08-06 08:15:43,445][52669] Sum rewards: 82.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.870', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.044', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO4': '0.146', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.442', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '66.000'} [2024-08-06 08:15:43,931][52664] DAMAGECOUNT value on done: 984628.0 [2024-08-06 08:15:43,931][52664] Sum rewards: 76.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.078', 'weapon5': '0.170', 'AMMO3': '0.221', 'AMMO4': '0.248', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.242', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '64.000'} [2024-08-06 08:15:44,122][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:15:44,337][52795] DAMAGECOUNT value on done: 880431.0 [2024-08-06 08:15:44,339][52795] Sum rewards: 72.055, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.255', 'AMMO5': '0.003', 'AMMO2': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.014', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.400', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '60.000'} [2024-08-06 08:15:44,591][52663] DAMAGECOUNT value on done: 973826.0 [2024-08-06 08:15:44,592][52663] Sum rewards: 78.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.465', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.156', 'AMMO4': '0.160', 'weapon4': '0.216', 'weapon2': '0.232', 'AMMO3': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.130', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:44,629][52658] DAMAGECOUNT value on done: 953947.0 [2024-08-06 08:15:44,629][52658] Sum rewards: 61.758, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.174', 'AMMO3': '0.213', 'weapon5': '0.240', 'AMMO4': '0.287', 'weapon2': '0.454', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.832', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '52.000'} [2024-08-06 08:15:45,387][52671] DAMAGECOUNT value on done: 966135.0 [2024-08-06 08:15:45,390][52671] Sum rewards: 77.322, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.635', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'AMMO4': '0.055', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.988', 'WEAPON3': '1.150', 'weapon3': '2.722', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '62.000'} [2024-08-06 08:15:46,051][52669] DAMAGECOUNT value on done: 969983.0 [2024-08-06 08:15:46,051][52669] Sum rewards: 73.477, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.072', 'AMMO4': '0.149', 'weapon5': '0.176', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.200', 'weapon3': '3.166', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '60.000'} [2024-08-06 08:15:46,292][52664] DAMAGECOUNT value on done: 987952.0 [2024-08-06 08:15:46,294][52664] Sum rewards: 77.304, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-0.652', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.080', 'AMMO4': '0.111', 'weapon4': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.186', 'WEAPON4': '0.250', 'AMMO3': '0.288', 'WEAPON3': '1.600', 'weapon3': '3.330', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '67.000'} [2024-08-06 08:15:47,226][52663] DAMAGECOUNT value on done: 956993.0 [2024-08-06 08:15:47,261][52663] Sum rewards: 77.794, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.938', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.084', 'AMMO4': '0.098', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.392', 'weapon2': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '61.000'} [2024-08-06 08:15:47,354][52658] DAMAGECOUNT value on done: 966987.0 [2024-08-06 08:15:47,354][52658] Sum rewards: 89.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.787', 'AMMO5': '0.016', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.100', 'AMMO3': '0.175', 'weapon5': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.234', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '73.000'} [2024-08-06 08:15:47,483][52650] Updated weights for policy 0, policy_version 82811 (0.0011) [2024-08-06 08:15:47,513][52795] DAMAGECOUNT value on done: 887302.0 [2024-08-06 08:15:47,516][52795] Sum rewards: 59.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.133', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.130', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon4': '0.320', 'weapon2': '0.754', 'WEAPON3': '1.200', 'weapon3': '2.548', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.015', 'FRAGCOUNT': '49.000'} [2024-08-06 08:15:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 678387712. Throughput: 0: 4361.6. Samples: 169596370. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:15:47,802][52567] Avg episode reward: [(0, '75.108')] [2024-08-06 08:15:48,130][52671] DAMAGECOUNT value on done: 947394.0 [2024-08-06 08:15:48,132][52671] Sum rewards: 75.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.515', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.246', 'weapon4': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '64.000'} [2024-08-06 08:15:48,592][52669] DAMAGECOUNT value on done: 961188.0 [2024-08-06 08:15:48,592][52669] Sum rewards: 67.670, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.728', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO4': '0.205', 'AMMO3': '0.250', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:49,144][52664] DAMAGECOUNT value on done: 999107.0 [2024-08-06 08:15:49,144][52664] Sum rewards: 86.167, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.088', 'weapon4': '0.158', 'AMMO4': '0.176', 'weapon2': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '72.000'} [2024-08-06 08:15:49,773][52820] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.522, 174.0), ('weapon5', 0.002)] [2024-08-06 08:15:49,782][52663] DAMAGECOUNT value on done: 951930.0 [2024-08-06 08:15:49,783][52663] Sum rewards: 78.340, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.793', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'WEAPON5': '0.100', 'weapon5': '0.138', 'AMMO3': '0.211', 'weapon2': '0.616', 'WEAPON3': '1.250', 'weapon3': '3.052', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 08:15:50,041][52658] DAMAGECOUNT value on done: 954136.0 [2024-08-06 08:15:50,042][52658] Sum rewards: 60.626, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.852', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.056', 'AMMO4': '0.165', 'weapon5': '0.182', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '3.152', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.546', 'FRAGCOUNT': '51.000'} [2024-08-06 08:15:51,153][52669] DAMAGECOUNT value on done: 967633.0 [2024-08-06 08:15:51,155][52669] Sum rewards: 75.931, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO2': '0.007', 'AMMO4': '0.035', 'AMMO3': '0.222', 'weapon2': '0.394', 'WEAPON3': '1.400', 'weapon3': '3.394', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '63.000'} [2024-08-06 08:15:51,263][52671] DAMAGECOUNT value on done: 961402.0 [2024-08-06 08:15:51,265][52671] Sum rewards: 61.928, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.602', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.059', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.494', 'WEAPON3': '1.400', 'HITCOUNT': '2.850', 'weapon3': '3.182', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '52.000'} [2024-08-06 08:15:52,299][52650] Updated weights for policy 0, policy_version 82821 (0.0032) [2024-08-06 08:15:52,520][52664] DAMAGECOUNT value on done: 983729.0 [2024-08-06 08:15:52,520][52664] Sum rewards: 69.177, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon4': '0.128', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.328', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.204', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '57.000'} [2024-08-06 08:15:52,751][52663] DAMAGECOUNT value on done: 959122.0 [2024-08-06 08:15:52,751][52663] Sum rewards: 92.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.770', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.038', 'AMMO4': '0.112', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.159', 'FRAGCOUNT': '74.000'} [2024-08-06 08:15:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 678477824. Throughput: 0: 4366.4. Samples: 169622650. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:15:52,802][52567] Avg episode reward: [(0, '75.093')] [2024-08-06 08:15:53,056][52658] DAMAGECOUNT value on done: 960515.0 [2024-08-06 08:15:53,057][52658] Sum rewards: 63.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.700', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.200', 'AMMO3': '0.211', 'AMMO4': '0.235', 'weapon4': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '2.792', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '54.000'} [2024-08-06 08:15:53,156][52794] DAMAGECOUNT value on done: 953808.0 [2024-08-06 08:15:53,156][52794] Sum rewards: 101.711, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.460', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.108', 'AMMO4': '0.114', 'weapon5': '0.116', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.265', 'weapon2': '0.266', 'WEAPON3': '1.650', 'weapon3': '3.224', 'HITCOUNT': '4.400', 'DAMAGECOUNT': '24.348', 'FRAGCOUNT': '85.000'} [2024-08-06 08:15:54,020][52669] DAMAGECOUNT value on done: 966661.0 [2024-08-06 08:15:54,020][52669] Sum rewards: 70.318, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.021', 'AMMO2': '0.044', 'weapon4': '0.110', 'weapon5': '0.156', 'AMMO3': '0.201', 'AMMO4': '0.222', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '59.000'} [2024-08-06 08:15:54,102][52671] DAMAGECOUNT value on done: 959679.0 [2024-08-06 08:15:54,104][52671] Sum rewards: 72.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.000', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.148', 'AMMO3': '0.197', 'AMMO4': '0.273', 'weapon5': '0.298', 'weapon2': '0.306', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '59.500'} [2024-08-06 08:15:54,851][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:15:55,519][52663] DAMAGECOUNT value on done: 957110.0 [2024-08-06 08:15:55,521][52663] Sum rewards: 67.230, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.685', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.154', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.250', 'weapon4': '0.276', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '53.000'} [2024-08-06 08:15:56,112][52794] DAMAGECOUNT value on done: 961416.0 [2024-08-06 08:15:56,114][52794] Sum rewards: 83.982, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.115', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.068', 'AMMO4': '0.242', 'weapon5': '0.244', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.950', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '69.000'} [2024-08-06 08:15:56,212][52658] DAMAGECOUNT value on done: 944640.0 [2024-08-06 08:15:56,213][52658] Sum rewards: 79.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.184', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.084', 'AMMO4': '0.085', 'weapon5': '0.126', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '65.000'} [2024-08-06 08:15:56,519][52671] DAMAGECOUNT value on done: 960829.0 [2024-08-06 08:15:56,519][52671] Sum rewards: 82.627, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.184', 'HEALTH': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.712', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '67.000'} [2024-08-06 08:15:56,982][52650] Updated weights for policy 0, policy_version 82831 (0.0011) [2024-08-06 08:15:57,004][52669] DAMAGECOUNT value on done: 953733.0 [2024-08-06 08:15:57,005][52669] Sum rewards: 91.097, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.941', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.108', 'weapon5': '0.134', 'AMMO4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '74.000'} [2024-08-06 08:15:57,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 678559744. Throughput: 0: 4363.1. Samples: 169648780. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:15:57,795][52567] Avg episode reward: [(0, '75.555')] [2024-08-06 08:15:57,928][52811] DAMAGECOUNT value on done: 905400.0 [2024-08-06 08:15:57,938][52811] Sum rewards: 73.052, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.050', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.087', 'AMMO3': '0.227', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.408', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '61.000'} [2024-08-06 08:15:58,704][52663] DAMAGECOUNT value on done: 965393.0 [2024-08-06 08:15:58,705][52663] Sum rewards: 81.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.636', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.166', 'AMMO4': '0.202', 'AMMO3': '0.242', 'weapon5': '0.248', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '68.000'} [2024-08-06 08:15:59,086][52671] DAMAGECOUNT value on done: 961276.0 [2024-08-06 08:15:59,088][52671] Sum rewards: 75.944, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.634', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.130', 'AMMO3': '0.166', 'AMMO4': '0.186', 'weapon4': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 08:15:59,323][52794] DAMAGECOUNT value on done: 966883.0 [2024-08-06 08:15:59,326][52794] Sum rewards: 84.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.260', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.044', 'weapon5': '0.056', 'AMMO3': '0.181', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.100', 'weapon3': '3.350', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '70.000'} [2024-08-06 08:15:59,362][52658] DAMAGECOUNT value on done: 960385.0 [2024-08-06 08:15:59,364][52658] Sum rewards: 82.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.705', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.136', 'AMMO4': '0.148', 'AMMO3': '0.180', 'weapon2': '0.202', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '65.000'} [2024-08-06 08:16:00,189][52669] DAMAGECOUNT value on done: 953749.0 [2024-08-06 08:16:00,189][52669] Sum rewards: 81.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.094', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '66.500'} [2024-08-06 08:16:01,117][52811] DAMAGECOUNT value on done: 890160.0 [2024-08-06 08:16:01,119][52811] Sum rewards: 90.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.600', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.024', 'weapon5': '0.054', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.456', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '75.000'} [2024-08-06 08:16:01,471][52650] Updated weights for policy 0, policy_version 82841 (0.0011) [2024-08-06 08:16:01,535][52671] DAMAGECOUNT value on done: 962212.0 [2024-08-06 08:16:01,537][52671] Sum rewards: 72.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.982', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.104', 'AMMO4': '0.134', 'weapon4': '0.184', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.120', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:01,999][52663] DAMAGECOUNT value on done: 957486.0 [2024-08-06 08:16:02,000][52663] Sum rewards: 92.484, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.408', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.068', 'AMMO4': '0.175', 'weapon5': '0.176', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.927', 'FRAGCOUNT': '73.000'} [2024-08-06 08:16:02,469][52794] DAMAGECOUNT value on done: 952546.0 [2024-08-06 08:16:02,469][52794] Sum rewards: 75.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.600', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.146', 'weapon5': '0.168', 'AMMO4': '0.205', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '3.006', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '61.000'} [2024-08-06 08:16:02,471][52658] DAMAGECOUNT value on done: 955713.0 [2024-08-06 08:16:02,472][52658] Sum rewards: 79.900, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.880', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.174', 'AMMO4': '0.205', 'AMMO3': '0.245', 'weapon4': '0.264', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.918', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '67.000'} [2024-08-06 08:16:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 678649856. Throughput: 0: 4361.1. Samples: 169661760. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:16:02,794][52567] Avg episode reward: [(0, '75.642')] [2024-08-06 08:16:03,351][52669] DAMAGECOUNT value on done: 963020.0 [2024-08-06 08:16:03,359][52669] Sum rewards: 80.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.040', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.044', 'weapon5': '0.144', 'AMMO4': '0.189', 'AMMO3': '0.189', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '66.000'} [2024-08-06 08:16:04,300][52811] DAMAGECOUNT value on done: 884554.0 [2024-08-06 08:16:04,303][52811] Sum rewards: 66.324, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.850', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.172', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.534', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '52.000'} [2024-08-06 08:16:04,409][52671] DAMAGECOUNT value on done: 945650.0 [2024-08-06 08:16:04,411][52671] Sum rewards: 82.167, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.917', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.092', 'AMMO4': '0.143', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '69.000'} [2024-08-06 08:16:04,935][52663] DAMAGECOUNT value on done: 940827.0 [2024-08-06 08:16:04,935][52663] Sum rewards: 78.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.646', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.128', 'AMMO4': '0.141', 'weapon5': '0.224', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.988', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '67.000'} [2024-08-06 08:16:05,548][52658] DAMAGECOUNT value on done: 951306.0 [2024-08-06 08:16:05,548][52658] Sum rewards: 81.832, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.092', 'weapon4': '0.098', 'AMMO4': '0.197', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.238', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '68.000'} [2024-08-06 08:16:05,667][52794] DAMAGECOUNT value on done: 948036.0 [2024-08-06 08:16:05,669][52794] Sum rewards: 78.096, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.224', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.092', 'WEAPON4': '0.150', 'weapon2': '0.164', 'weapon4': '0.200', 'AMMO3': '0.243', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '65.000'} [2024-08-06 08:16:06,209][52669] DAMAGECOUNT value on done: 982243.0 [2024-08-06 08:16:06,210][52669] Sum rewards: 77.474, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.266', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.162', 'weapon4': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon2': '0.314', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '65.000'} [2024-08-06 08:16:06,511][52650] Updated weights for policy 0, policy_version 82851 (0.0016) [2024-08-06 08:16:07,055][52666] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:16:07,364][52811] DAMAGECOUNT value on done: 889121.0 [2024-08-06 08:16:07,367][52811] Sum rewards: 78.093, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.011', 'AMMO2': '0.014', 'weapon4': '0.014', 'WEAPON1': '0.020', 'ARMOR': '0.032', 'weapon5': '0.064', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '63.000'} [2024-08-06 08:16:07,372][52671] DAMAGECOUNT value on done: 972832.0 [2024-08-06 08:16:07,374][52671] Sum rewards: 74.389, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.735', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'AMMO3': '0.260', 'weapon4': '0.276', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '62.000'} [2024-08-06 08:16:07,710][52663] DAMAGECOUNT value on done: 953548.0 [2024-08-06 08:16:07,710][52663] Sum rewards: 71.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.389', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.090', 'AMMO4': '0.199', 'weapon2': '0.200', 'weapon5': '0.216', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.070', 'weapon3': '3.224', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '60.000'} [2024-08-06 08:16:07,781][52669] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:16:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 678739968. Throughput: 0: 4363.1. Samples: 169687980. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:16:07,794][52567] Avg episode reward: [(0, '75.761')] [2024-08-06 08:16:08,565][52658] DAMAGECOUNT value on done: 959550.0 [2024-08-06 08:16:08,567][52658] Sum rewards: 81.253, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.164', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.033', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.193', 'weapon2': '0.414', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '66.000'} [2024-08-06 08:16:08,809][52669] DAMAGECOUNT value on done: 968635.0 [2024-08-06 08:16:08,809][52669] Sum rewards: 72.282, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO2': '0.012', 'AMMO4': '0.059', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.203', 'weapon2': '0.636', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:08,811][52794] DAMAGECOUNT value on done: 951707.0 [2024-08-06 08:16:08,813][52794] Sum rewards: 79.454, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO3': '0.141', 'weapon5': '0.160', 'AMMO4': '0.182', 'weapon4': '0.256', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '3.074', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 08:16:10,125][52663] DAMAGECOUNT value on done: 954202.0 [2024-08-06 08:16:10,126][52663] Sum rewards: 77.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.465', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.066', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.670', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '62.000'} [2024-08-06 08:16:10,320][52671] DAMAGECOUNT value on done: 968409.0 [2024-08-06 08:16:10,320][52671] Sum rewards: 70.711, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.478', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'AMMO4': '0.101', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.160', 'WEAPON3': '0.850', 'weapon2': '0.856', 'weapon3': '2.806', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.800', 'FRAGCOUNT': '54.000'} [2024-08-06 08:16:10,531][52811] DAMAGECOUNT value on done: 893126.0 [2024-08-06 08:16:10,535][52811] Sum rewards: 83.474, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.109', 'weapon4': '0.152', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '69.000'} [2024-08-06 08:16:11,139][52650] Updated weights for policy 0, policy_version 82861 (0.0013) [2024-08-06 08:16:11,346][52669] DAMAGECOUNT value on done: 967137.0 [2024-08-06 08:16:11,347][52669] Sum rewards: 82.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.897', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'weapon4': '0.136', 'AMMO3': '0.172', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '66.000'} [2024-08-06 08:16:11,464][52794] DAMAGECOUNT value on done: 956458.0 [2024-08-06 08:16:11,467][52794] Sum rewards: 63.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.309', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.170', 'weapon5': '0.198', 'AMMO3': '0.204', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.190', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '53.000'} [2024-08-06 08:16:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17439.3). Total num frames: 678821888. Throughput: 0: 4364.4. Samples: 169714180. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:16:12,794][52567] Avg episode reward: [(0, '75.743')] [2024-08-06 08:16:13,086][52663] DAMAGECOUNT value on done: 962177.0 [2024-08-06 08:16:13,086][52663] Sum rewards: 81.159, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.990', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.106', 'AMMO4': '0.110', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.258', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '63.000'} [2024-08-06 08:16:13,252][52671] DAMAGECOUNT value on done: 961826.0 [2024-08-06 08:16:13,254][52671] Sum rewards: 63.068, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.800', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.106', 'AMMO4': '0.108', 'AMMO3': '0.134', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.514', 'WEAPON3': '0.900', 'HITCOUNT': '2.970', 'weapon3': '3.050', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '48.000'} [2024-08-06 08:16:13,681][52811] DAMAGECOUNT value on done: 908451.0 [2024-08-06 08:16:13,683][52811] Sum rewards: 76.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon2': '0.136', 'AMMO4': '0.149', 'weapon5': '0.176', 'AMMO3': '0.227', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '64.000'} [2024-08-06 08:16:14,544][52794] DAMAGECOUNT value on done: 944318.0 [2024-08-06 08:16:14,545][52794] Sum rewards: 75.082, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.005', 'weapon5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.027', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.134', 'AMMO3': '0.204', 'weapon2': '0.490', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '62.000'} [2024-08-06 08:16:14,594][52669] DAMAGECOUNT value on done: 971027.0 [2024-08-06 08:16:14,595][52669] Sum rewards: 74.579, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.166', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon5': '0.014', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.159', 'weapon2': '0.402', 'WEAPON3': '1.050', 'HITCOUNT': '3.410', 'weapon3': '3.468', 'DAMAGECOUNT': '16.917', 'FRAGCOUNT': '60.000'} [2024-08-06 08:16:15,844][52663] DAMAGECOUNT value on done: 945183.0 [2024-08-06 08:16:15,845][52663] Sum rewards: 64.695, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.778', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.277', 'weapon2': '0.380', 'WEAPON3': '1.650', 'weapon3': '3.236', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '56.000'} [2024-08-06 08:16:15,867][52650] Updated weights for policy 0, policy_version 82871 (0.0014) [2024-08-06 08:16:16,106][52671] DAMAGECOUNT value on done: 967480.0 [2024-08-06 08:16:16,117][52671] Sum rewards: 71.115, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.114', 'AMMO3': '0.182', 'weapon5': '0.210', 'AMMO4': '0.225', 'weapon2': '0.306', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '56.000'} [2024-08-06 08:16:16,785][52811] DAMAGECOUNT value on done: 899213.0 [2024-08-06 08:16:16,785][52811] Sum rewards: 68.407, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.971', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.137', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.712', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:16,996][52794] DAMAGECOUNT value on done: 958967.0 [2024-08-06 08:16:16,996][52794] Sum rewards: 73.954, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.104', 'AMMO4': '0.169', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '61.500'} [2024-08-06 08:16:17,026][52669] DAMAGECOUNT value on done: 973208.0 [2024-08-06 08:16:17,026][52669] Sum rewards: 77.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.298', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.130', 'weapon2': '0.198', 'weapon5': '0.218', 'AMMO4': '0.224', 'AMMO3': '0.251', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '64.000'} [2024-08-06 08:16:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.4). Total num frames: 678912000. Throughput: 0: 4365.6. Samples: 169727380. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:17,794][52567] Avg episode reward: [(0, '75.431')] [2024-08-06 08:16:18,572][52663] DAMAGECOUNT value on done: 942564.0 [2024-08-06 08:16:18,572][52663] Sum rewards: 89.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.694', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.140', 'weapon4': '0.156', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.018', 'FRAGCOUNT': '71.000'} [2024-08-06 08:16:19,338][52671] DAMAGECOUNT value on done: 950605.0 [2024-08-06 08:16:19,345][52671] Sum rewards: 73.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 08:16:19,368][52794] DAMAGECOUNT value on done: 955776.0 [2024-08-06 08:16:19,369][52794] Sum rewards: 74.786, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.690', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.138', 'weapon5': '0.170', 'AMMO4': '0.234', 'AMMO3': '0.253', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.550', 'weapon3': '2.938', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '64.000'} [2024-08-06 08:16:19,845][52811] DAMAGECOUNT value on done: 885230.0 [2024-08-06 08:16:19,847][52811] Sum rewards: 58.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.708', 'AMMO5': '0.012', 'AMMO2': '0.043', 'AMMO3': '0.176', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'weapon5': '0.296', 'weapon4': '0.362', 'WEAPON3': '1.050', 'weapon3': '2.826', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '14.808', 'FRAGCOUNT': '46.000'} [2024-08-06 08:16:20,254][52650] Updated weights for policy 0, policy_version 82881 (0.0010) [2024-08-06 08:16:21,522][52663] DAMAGECOUNT value on done: 952233.0 [2024-08-06 08:16:21,524][52663] Sum rewards: 82.517, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.450', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.062', 'AMMO4': '0.151', 'weapon5': '0.158', 'AMMO3': '0.271', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.228', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '71.000'} [2024-08-06 08:16:22,058][52794] DAMAGECOUNT value on done: 946708.0 [2024-08-06 08:16:22,059][52794] Sum rewards: 77.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.212', 'weapon2': '0.322', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '63.000'} [2024-08-06 08:16:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 678993920. Throughput: 0: 4368.7. Samples: 169753770. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:22,794][52567] Avg episode reward: [(0, '75.711')] [2024-08-06 08:16:22,813][52811] DAMAGECOUNT value on done: 895262.0 [2024-08-06 08:16:22,815][52811] Sum rewards: 72.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.100', 'weapon5': '0.180', 'AMMO3': '0.194', 'AMMO4': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:24,866][52663] DAMAGECOUNT value on done: 954484.0 [2024-08-06 08:16:24,867][52663] Sum rewards: 88.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.068', 'weapon5': '0.134', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.275', 'WEAPON3': '1.650', 'weapon3': '3.244', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.264', 'FRAGCOUNT': '73.000'} [2024-08-06 08:16:25,120][52794] DAMAGECOUNT value on done: 961579.0 [2024-08-06 08:16:25,120][52794] Sum rewards: 77.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.140', 'AMMO4': '-0.002', 'AMMO2': '-0.000', 'AMMO3': '0.204', 'weapon2': '0.330', 'WEAPON3': '1.350', 'HITCOUNT': '3.430', 'weapon3': '3.534', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '65.000'} [2024-08-06 08:16:25,250][52650] Updated weights for policy 0, policy_version 82891 (0.0028) [2024-08-06 08:16:25,831][52811] DAMAGECOUNT value on done: 894553.0 [2024-08-06 08:16:25,833][52811] Sum rewards: 72.456, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.385', 'AMMO5': '0.020', 'AMMO2': '0.031', 'weapon5': '0.114', 'weapon4': '0.118', 'AMMO4': '0.156', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.176', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.529', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:27,684][52663] DAMAGECOUNT value on done: 957569.0 [2024-08-06 08:16:27,686][52663] Sum rewards: 78.770, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.367', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.132', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '3.046', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '64.000'} [2024-08-06 08:16:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 679084032. Throughput: 0: 4376.4. Samples: 169780000. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:27,794][52567] Avg episode reward: [(0, '75.786')] [2024-08-06 08:16:27,799][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082896_679084032.pth... [2024-08-06 08:16:27,946][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082385_674897920.pth [2024-08-06 08:16:28,323][52794] DAMAGECOUNT value on done: 956362.0 [2024-08-06 08:16:28,323][52794] Sum rewards: 72.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.182', 'AMMO5': '0.016', 'AMMO2': '0.049', 'AMMO3': '0.193', 'weapon5': '0.236', 'AMMO4': '0.245', 'weapon2': '0.280', 'weapon4': '0.308', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.820', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '57.000'} [2024-08-06 08:16:28,822][52811] DAMAGECOUNT value on done: 898986.0 [2024-08-06 08:16:28,823][52811] Sum rewards: 70.183, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.078', 'weapon5': '0.160', 'AMMO3': '0.182', 'AMMO4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.158', 'DAMAGECOUNT': '16.434', 'FRAGCOUNT': '57.000'} [2024-08-06 08:16:29,528][52650] Updated weights for policy 0, policy_version 82901 (0.0010) [2024-08-06 08:16:29,566][52670] DAMAGECOUNT value on done: 941924.0 [2024-08-06 08:16:29,567][52670] Sum rewards: 79.652, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.033', 'weapon5': '0.054', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.228', 'WEAPON3': '1.450', 'weapon3': '3.448', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '66.000'} [2024-08-06 08:16:30,650][52663] DAMAGECOUNT value on done: 955583.0 [2024-08-06 08:16:30,652][52663] Sum rewards: 66.695, reward structure: {'DEATHCOUNT': '-20.250', 'HEALTH': '-2.936', 'AMMO5': '0.029', 'AMMO2': '0.079', 'weapon4': '0.120', 'weapon5': '0.212', 'AMMO3': '0.268', 'weapon2': '0.270', 'AMMO4': '0.394', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '61.000'} [2024-08-06 08:16:31,415][52794] DAMAGECOUNT value on done: 967318.0 [2024-08-06 08:16:31,417][52794] Sum rewards: 76.789, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.777', 'AMMO5': '0.016', 'ARMOR': '0.024', 'AMMO2': '0.052', 'weapon4': '0.130', 'AMMO3': '0.234', 'AMMO4': '0.259', 'weapon5': '0.264', 'weapon2': '0.422', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.888', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '19.677', 'FRAGCOUNT': '64.000'} [2024-08-06 08:16:31,876][52811] DAMAGECOUNT value on done: 904453.0 [2024-08-06 08:16:31,878][52811] Sum rewards: 62.759, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.695', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.196', 'AMMO3': '0.198', 'AMMO4': '0.247', 'weapon4': '0.306', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.568', 'WEAPON3': '1.300', 'weapon3': '2.668', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.496', 'FRAGCOUNT': '52.000'} [2024-08-06 08:16:32,285][52670] DAMAGECOUNT value on done: 961964.0 [2024-08-06 08:16:32,287][52670] Sum rewards: 77.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.476', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.020', 'AMMO4': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.070', 'AMMO3': '0.224', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '63.000'} [2024-08-06 08:16:32,795][52567] Fps is (10 sec: 18021.5, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 679174144. Throughput: 0: 4368.0. Samples: 169792930. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:32,795][52567] Avg episode reward: [(0, '75.692')] [2024-08-06 08:16:33,986][52663] DAMAGECOUNT value on done: 962957.0 [2024-08-06 08:16:33,986][52663] Sum rewards: 86.833, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.236', 'AMMO3': '0.269', 'WEAPON3': '1.650', 'weapon3': '3.364', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.519', 'FRAGCOUNT': '73.000'} [2024-08-06 08:16:34,364][52794] DAMAGECOUNT value on done: 948141.0 [2024-08-06 08:16:34,365][52794] Sum rewards: 69.014, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.030', 'AMMO4': '0.090', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon5': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '2.920', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '57.000'} [2024-08-06 08:16:34,517][52650] Updated weights for policy 0, policy_version 82911 (0.0014) [2024-08-06 08:16:35,230][52811] DAMAGECOUNT value on done: 896989.0 [2024-08-06 08:16:35,232][52811] Sum rewards: 87.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.697', 'AMMO2': '0.009', 'AMMO5': '0.009', 'weapon4': '0.040', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'weapon5': '0.118', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.532', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.535', 'FRAGCOUNT': '69.000'} [2024-08-06 08:16:35,247][52670] DAMAGECOUNT value on done: 943457.0 [2024-08-06 08:16:35,247][52670] Sum rewards: 72.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.186', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.172', 'weapon5': '0.182', 'AMMO3': '0.265', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '61.000'} [2024-08-06 08:16:36,351][52666] DAMAGECOUNT value on done: 956641.0 [2024-08-06 08:16:36,352][52666] Sum rewards: 74.314, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.450', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.234', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '3.134', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 08:16:36,464][52663] DAMAGECOUNT value on done: 968443.0 [2024-08-06 08:16:36,464][52663] Sum rewards: 84.096, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.138', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon4': '0.086', 'WEAPON4': '0.100', 'weapon2': '0.150', 'AMMO3': '0.284', 'WEAPON3': '1.800', 'weapon3': '3.584', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.763', 'FRAGCOUNT': '72.000'} [2024-08-06 08:16:37,410][52794] DAMAGECOUNT value on done: 960660.0 [2024-08-06 08:16:37,411][52794] Sum rewards: 74.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.020', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.050', 'AMMO4': '0.130', 'weapon5': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '61.000'} [2024-08-06 08:16:37,532][52649] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:16:37,680][52670] DAMAGECOUNT value on done: 945835.0 [2024-08-06 08:16:37,682][52670] Sum rewards: 72.672, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.655', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.082', 'weapon5': '0.136', 'AMMO4': '0.138', 'AMMO3': '0.173', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '57.000'} [2024-08-06 08:16:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 679264256. Throughput: 0: 4363.3. Samples: 169819000. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:37,794][52567] Avg episode reward: [(0, '76.178')] [2024-08-06 08:16:37,998][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:16:38,359][52811] DAMAGECOUNT value on done: 894206.0 [2024-08-06 08:16:38,359][52811] Sum rewards: 78.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.201', 'weapon2': '0.588', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '66.000'} [2024-08-06 08:16:38,825][52666] DAMAGECOUNT value on done: 954512.0 [2024-08-06 08:16:38,827][52666] Sum rewards: 90.859, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.612', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.134', 'AMMO4': '0.148', 'AMMO3': '0.168', 'weapon4': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.667', 'FRAGCOUNT': '72.000'} [2024-08-06 08:16:39,177][52663] DAMAGECOUNT value on done: 946151.0 [2024-08-06 08:16:39,187][52663] Sum rewards: 73.716, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.888', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.040', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.203', 'weapon2': '0.248', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.442', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 08:16:39,228][52649] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:16:39,571][52650] Updated weights for policy 0, policy_version 82921 (0.0013) [2024-08-06 08:16:40,340][52670] DAMAGECOUNT value on done: 957179.0 [2024-08-06 08:16:40,342][52670] Sum rewards: 73.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.320', 'AMMO2': '0.002', 'AMMO4': '0.010', 'AMMO5': '0.012', 'weapon4': '0.014', 'weapon5': '0.042', 'WEAPON4': '0.050', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '3.184', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '60.000'} [2024-08-06 08:16:40,580][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:16:40,600][52794] DAMAGECOUNT value on done: 956772.0 [2024-08-06 08:16:40,600][52794] Sum rewards: 80.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.443', 'AMMO5': '0.007', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon5': '0.132', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'weapon4': '0.432', 'WEAPON3': '1.000', 'weapon3': '2.692', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '65.000'} [2024-08-06 08:16:41,518][52811] DAMAGECOUNT value on done: 895272.0 [2024-08-06 08:16:41,520][52811] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.970', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.126', 'weapon4': '0.190', 'AMMO3': '0.194', 'AMMO4': '0.224', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 08:16:42,142][52666] DAMAGECOUNT value on done: 959283.0 [2024-08-06 08:16:42,145][52666] Sum rewards: 71.381, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.987', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.050', 'AMMO4': '0.085', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:42,420][52795] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:16:42,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 679346176. Throughput: 0: 4364.5. Samples: 169845180. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:42,794][52567] Avg episode reward: [(0, '76.370')] [2024-08-06 08:16:43,460][52670] DAMAGECOUNT value on done: 946188.0 [2024-08-06 08:16:43,462][52670] Sum rewards: 79.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.025', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.285', 'weapon2': '0.310', 'WEAPON3': '1.800', 'weapon3': '3.404', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '68.000'} [2024-08-06 08:16:43,721][52650] Updated weights for policy 0, policy_version 82931 (0.0034) [2024-08-06 08:16:43,808][52794] DAMAGECOUNT value on done: 964267.0 [2024-08-06 08:16:43,811][52794] Sum rewards: 61.358, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.940', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.118', 'weapon4': '0.144', 'AMMO4': '0.186', 'weapon2': '0.212', 'AMMO3': '0.281', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.256', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '55.000'} [2024-08-06 08:16:44,641][52666] DAMAGECOUNT value on done: 955034.0 [2024-08-06 08:16:44,643][52666] Sum rewards: 80.594, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.642', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO4': '0.187', 'weapon2': '0.236', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.182', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '68.000'} [2024-08-06 08:16:44,670][52811] DAMAGECOUNT value on done: 893726.0 [2024-08-06 08:16:44,671][52811] Sum rewards: 80.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.258', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.122', 'weapon4': '0.138', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '67.000'} [2024-08-06 08:16:45,957][52670] DAMAGECOUNT value on done: 942679.0 [2024-08-06 08:16:45,957][52670] Sum rewards: 71.961, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.915', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.076', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon5': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.716', 'WEAPON3': '1.200', 'weapon3': '2.860', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:46,756][52794] DAMAGECOUNT value on done: 971341.0 [2024-08-06 08:16:46,757][52794] Sum rewards: 61.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.300', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon5': '0.238', 'AMMO3': '0.248', 'AMMO4': '0.274', 'weapon2': '0.298', 'weapon4': '0.310', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '2.720', 'weapon3': '2.850', 'DAMAGECOUNT': '15.888', 'FRAGCOUNT': '54.000'} [2024-08-06 08:16:47,474][52666] DAMAGECOUNT value on done: 948948.0 [2024-08-06 08:16:47,474][52666] Sum rewards: 88.117, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.170', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.073', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.176', 'WEAPON3': '1.000', 'weapon3': '3.556', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '69.000'} [2024-08-06 08:16:47,554][52668] DAMAGECOUNT value on done: 966359.0 [2024-08-06 08:16:47,554][52668] Sum rewards: 81.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO2': '0.011', 'AMMO5': '0.012', 'AMMO4': '0.057', 'weapon4': '0.066', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.490', 'WEAPON3': '1.400', 'weapon3': '2.986', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '69.000'} [2024-08-06 08:16:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 679436288. Throughput: 0: 4370.7. Samples: 169858440. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:47,794][52567] Avg episode reward: [(0, '76.474')] [2024-08-06 08:16:47,835][52811] DAMAGECOUNT value on done: 901845.0 [2024-08-06 08:16:47,837][52811] Sum rewards: 78.151, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.771', 'AMMO5': '0.006', 'weapon4': '0.036', 'AMMO2': '0.046', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'AMMO4': '0.231', 'weapon2': '0.238', 'WEAPON3': '1.200', 'weapon3': '3.426', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '64.000'} [2024-08-06 08:16:48,623][52650] Updated weights for policy 0, policy_version 82941 (0.0021) [2024-08-06 08:16:48,938][52670] DAMAGECOUNT value on done: 944837.0 [2024-08-06 08:16:48,940][52670] Sum rewards: 84.449, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.910', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.518', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '70.000'} [2024-08-06 08:16:49,620][52794] DAMAGECOUNT value on done: 958039.0 [2024-08-06 08:16:49,620][52794] Sum rewards: 69.438, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.225', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.512', 'WEAPON3': '1.000', 'weapon3': '3.260', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '55.000'} [2024-08-06 08:16:49,632][52665] DAMAGECOUNT value on done: 943707.0 [2024-08-06 08:16:49,632][52665] Sum rewards: 71.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.302', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.194', 'AMMO4': '0.198', 'AMMO3': '0.242', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.174', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 08:16:50,413][52668] DAMAGECOUNT value on done: 965554.0 [2024-08-06 08:16:50,422][52668] Sum rewards: 81.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.102', 'AMMO4': '0.102', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '67.000'} [2024-08-06 08:16:50,463][52666] DAMAGECOUNT value on done: 950068.0 [2024-08-06 08:16:50,463][52666] Sum rewards: 67.156, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.878', 'AMMO5': '0.018', 'AMMO2': '0.058', 'AMMO3': '0.222', 'weapon2': '0.260', 'AMMO4': '0.290', 'weapon5': '0.322', 'weapon4': '0.338', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.782', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '57.000'} [2024-08-06 08:16:50,864][52811] DAMAGECOUNT value on done: 905390.0 [2024-08-06 08:16:50,864][52811] Sum rewards: 73.441, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.406', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.150', 'AMMO3': '0.227', 'weapon5': '0.228', 'AMMO4': '0.297', 'weapon2': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.918', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '62.000'} [2024-08-06 08:16:51,768][52670] DAMAGECOUNT value on done: 944078.0 [2024-08-06 08:16:51,770][52670] Sum rewards: 70.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.680', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'weapon5': '0.222', 'weapon4': '0.224', 'AMMO3': '0.225', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '57.000'} [2024-08-06 08:16:52,478][52665] DAMAGECOUNT value on done: 956408.0 [2024-08-06 08:16:52,478][52665] Sum rewards: 84.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.929', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.144', 'AMMO4': '0.178', 'AMMO3': '0.232', 'weapon2': '0.248', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.280', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '70.000'} [2024-08-06 08:16:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 679518208. Throughput: 0: 4369.8. Samples: 169884620. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:52,794][52567] Avg episode reward: [(0, '76.720')] [2024-08-06 08:16:53,223][52668] DAMAGECOUNT value on done: 961627.0 [2024-08-06 08:16:53,226][52668] Sum rewards: 77.990, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.448', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '65.000'} [2024-08-06 08:16:53,283][52650] Updated weights for policy 0, policy_version 82951 (0.0013) [2024-08-06 08:16:53,522][52666] DAMAGECOUNT value on done: 950089.0 [2024-08-06 08:16:53,525][52666] Sum rewards: 71.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.695', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'AMMO4': '0.083', 'weapon5': '0.092', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:53,739][52647] DAMAGECOUNT value on done: 1022493.0 [2024-08-06 08:16:53,740][52647] Sum rewards: 72.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.016', 'AMMO2': '0.059', 'AMMO3': '0.198', 'weapon4': '0.254', 'AMMO4': '0.296', 'weapon5': '0.366', 'WEAPON5': '0.450', 'weapon2': '0.558', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.502', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:53,982][52811] DAMAGECOUNT value on done: 891553.0 [2024-08-06 08:16:53,985][52811] Sum rewards: 72.732, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.066', 'weapon5': '0.122', 'AMMO3': '0.193', 'AMMO4': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '60.000'} [2024-08-06 08:16:54,729][52670] DAMAGECOUNT value on done: 942182.0 [2024-08-06 08:16:54,729][52670] Sum rewards: 79.647, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.665', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.208', 'AMMO3': '0.218', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '65.000'} [2024-08-06 08:16:55,471][52665] DAMAGECOUNT value on done: 949873.0 [2024-08-06 08:16:55,479][52665] Sum rewards: 80.908, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.357', 'AMMO5': '0.014', 'AMMO2': '0.043', 'AMMO3': '0.162', 'weapon4': '0.164', 'weapon5': '0.202', 'AMMO4': '0.216', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.950', 'weapon3': '3.110', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '64.000'} [2024-08-06 08:16:56,126][52647] DAMAGECOUNT value on done: 1008018.0 [2024-08-06 08:16:56,127][52647] Sum rewards: 80.041, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.900', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.184', 'AMMO4': '0.209', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '66.000'} [2024-08-06 08:16:56,168][52668] DAMAGECOUNT value on done: 966125.0 [2024-08-06 08:16:56,169][52668] Sum rewards: 85.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.222', 'weapon5': '0.222', 'weapon2': '0.290', 'weapon4': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.890', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.906', 'FRAGCOUNT': '68.000'} [2024-08-06 08:16:56,440][52666] DAMAGECOUNT value on done: 945589.0 [2024-08-06 08:16:56,440][52666] Sum rewards: 62.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.635', 'AMMO2': '0.001', 'AMMO5': '0.005', 'AMMO4': '0.006', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon4': '0.202', 'weapon5': '0.212', 'AMMO3': '0.230', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '15.549', 'FRAGCOUNT': '53.000'} [2024-08-06 08:16:57,113][52811] DAMAGECOUNT value on done: 892986.0 [2024-08-06 08:16:57,115][52811] Sum rewards: 72.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.955', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.104', 'AMMO3': '0.205', 'AMMO4': '0.217', 'weapon5': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '59.000'} [2024-08-06 08:16:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 679608320. Throughput: 0: 4368.0. Samples: 169910740. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:16:57,794][52567] Avg episode reward: [(0, '76.450')] [2024-08-06 08:16:57,837][52670] DAMAGECOUNT value on done: 956850.0 [2024-08-06 08:16:57,837][52670] Sum rewards: 87.171, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.146', 'AMMO3': '0.187', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.298', 'weapon2': '0.302', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '69.000'} [2024-08-06 08:16:57,945][52650] Updated weights for policy 0, policy_version 82961 (0.0019) [2024-08-06 08:16:58,684][52665] DAMAGECOUNT value on done: 952479.0 [2024-08-06 08:16:58,685][52665] Sum rewards: 75.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.756', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.203', 'weapon5': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON4': '0.350', 'weapon4': '0.366', 'WEAPON3': '1.200', 'weapon3': '2.818', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '60.000'} [2024-08-06 08:16:58,877][52647] DAMAGECOUNT value on done: 1014450.0 [2024-08-06 08:16:58,879][52647] Sum rewards: 84.977, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.268', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO4': '0.174', 'AMMO3': '0.197', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '68.000'} [2024-08-06 08:16:59,104][52668] DAMAGECOUNT value on done: 949079.0 [2024-08-06 08:16:59,104][52668] Sum rewards: 62.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.145', 'AMMO5': '0.035', 'AMMO2': '0.088', 'weapon4': '0.160', 'AMMO3': '0.249', 'weapon2': '0.368', 'weapon5': '0.400', 'AMMO4': '0.442', 'WEAPON4': '0.900', 'WEAPON5': '0.950', 'WEAPON3': '1.500', 'weapon3': '2.694', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '52.000'} [2024-08-06 08:16:59,609][52666] DAMAGECOUNT value on done: 958652.0 [2024-08-06 08:16:59,609][52666] Sum rewards: 86.210, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.899', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.065', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.417', 'FRAGCOUNT': '71.000'} [2024-08-06 08:17:00,620][52670] DAMAGECOUNT value on done: 937910.0 [2024-08-06 08:17:00,630][52670] Sum rewards: 63.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.116', 'AMMO4': '0.151', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.636', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '53.000'} [2024-08-06 08:17:01,378][52647] DAMAGECOUNT value on done: 1010976.0 [2024-08-06 08:17:01,378][52647] Sum rewards: 74.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.928', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.028', 'AMMO4': '0.041', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:01,855][52665] DAMAGECOUNT value on done: 934454.0 [2024-08-06 08:17:01,856][52665] Sum rewards: 71.868, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.003', 'AMMO2': '0.036', 'weapon5': '0.044', 'weapon4': '0.068', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'AMMO4': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.757', 'FRAGCOUNT': '58.000'} [2024-08-06 08:17:02,190][52668] DAMAGECOUNT value on done: 961706.0 [2024-08-06 08:17:02,192][52668] Sum rewards: 80.195, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.440', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon4': '0.072', 'AMMO4': '0.196', 'weapon5': '0.198', 'AMMO3': '0.244', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.112', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:02,271][52666] DAMAGECOUNT value on done: 947825.0 [2024-08-06 08:17:02,272][52666] Sum rewards: 73.247, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.668', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO4': '0.178', 'WEAPON4': '0.250', 'AMMO3': '0.277', 'weapon2': '0.378', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:02,523][52650] Updated weights for policy 0, policy_version 82971 (0.0011) [2024-08-06 08:17:02,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17494.8). Total num frames: 679698432. Throughput: 0: 4366.0. Samples: 169923850. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:17:02,795][52567] Avg episode reward: [(0, '75.782')] [2024-08-06 08:17:03,600][52670] DAMAGECOUNT value on done: 952790.0 [2024-08-06 08:17:03,603][52670] Sum rewards: 75.748, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.630', 'AMMO5': '0.007', 'AMMO2': '0.047', 'weapon4': '0.096', 'weapon5': '0.138', 'AMMO3': '0.212', 'AMMO4': '0.235', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.288', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:04,131][52647] DAMAGECOUNT value on done: 1021147.0 [2024-08-06 08:17:04,131][52647] Sum rewards: 78.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.062', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.140', 'AMMO4': '0.154', 'AMMO3': '0.173', 'weapon2': '0.236', 'WEAPON5': '0.250', 'weapon4': '0.270', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:05,120][52665] DAMAGECOUNT value on done: 936348.0 [2024-08-06 08:17:05,121][52665] Sum rewards: 75.963, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.134', 'AMMO5': '0.009', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.146', 'WEAPON5': '0.250', 'weapon2': '0.274', 'AMMO3': '0.287', 'weapon4': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.040', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:05,270][52668] DAMAGECOUNT value on done: 961506.0 [2024-08-06 08:17:05,272][52668] Sum rewards: 71.650, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.384', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.190', 'AMMO3': '0.193', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '3.112', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:05,310][52666] DAMAGECOUNT value on done: 953957.0 [2024-08-06 08:17:05,310][52666] Sum rewards: 61.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.797', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.060', 'weapon4': '0.062', 'AMMO4': '0.143', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.050', 'HITCOUNT': '2.870', 'weapon3': '3.456', 'DAMAGECOUNT': '15.225', 'FRAGCOUNT': '49.000'} [2024-08-06 08:17:05,869][52803] DAMAGECOUNT value on done: 889156.0 [2024-08-06 08:17:05,877][52803] Sum rewards: 68.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.755', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO4': '0.186', 'AMMO3': '0.253', 'weapon5': '0.260', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.042', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:06,064][52649] DAMAGECOUNT value on done: 927551.0 [2024-08-06 08:17:06,065][52649] Sum rewards: 73.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.545', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.224', 'weapon4': '0.252', 'AMMO3': '0.259', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.914', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '61.500'} [2024-08-06 08:17:06,393][52795] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:17:06,642][52670] DAMAGECOUNT value on done: 956778.0 [2024-08-06 08:17:06,644][52670] Sum rewards: 69.345, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.414', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.068', 'AMMO4': '0.168', 'weapon5': '0.204', 'AMMO3': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:06,987][52647] DAMAGECOUNT value on done: 1018443.0 [2024-08-06 08:17:06,990][52647] Sum rewards: 77.782, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.013', 'AMMO2': '0.047', 'AMMO4': '0.235', 'AMMO3': '0.248', 'weapon5': '0.248', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.396', 'WEAPON3': '1.400', 'weapon3': '2.724', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.298', 'FRAGCOUNT': '62.500'} [2024-08-06 08:17:07,533][52650] Updated weights for policy 0, policy_version 82981 (0.0019) [2024-08-06 08:17:07,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 679780352. Throughput: 0: 4356.2. Samples: 169949800. Policy #0 lag: (min: 1.0, avg: 3.6, max: 8.0) [2024-08-06 08:17:07,795][52567] Avg episode reward: [(0, '75.299')] [2024-08-06 08:17:08,237][52668] DAMAGECOUNT value on done: 953428.0 [2024-08-06 08:17:08,238][52668] Sum rewards: 65.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.154', 'weapon5': '0.202', 'AMMO3': '0.215', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.758', 'WEAPON3': '1.300', 'weapon3': '2.606', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '54.000'} [2024-08-06 08:17:08,274][52665] DAMAGECOUNT value on done: 947802.0 [2024-08-06 08:17:08,274][52665] Sum rewards: 72.845, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.860', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.066', 'weapon4': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.626', 'WEAPON3': '1.250', 'weapon3': '2.918', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '58.500'} [2024-08-06 08:17:08,491][52666] DAMAGECOUNT value on done: 939280.0 [2024-08-06 08:17:08,491][52666] Sum rewards: 77.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.490', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.166', 'weapon5': '0.200', 'AMMO3': '0.219', 'AMMO4': '0.263', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.040', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '65.000'} [2024-08-06 08:17:08,956][52803] DAMAGECOUNT value on done: 888770.0 [2024-08-06 08:17:08,959][52803] Sum rewards: 81.353, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.087', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '67.000'} [2024-08-06 08:17:09,213][52649] DAMAGECOUNT value on done: 924036.0 [2024-08-06 08:17:09,214][52649] Sum rewards: 60.450, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.186', 'weapon5': '0.216', 'weapon2': '0.252', 'AMMO4': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon4': '0.652', 'WEAPON3': '1.100', 'weapon3': '2.462', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '14.250', 'FRAGCOUNT': '49.000'} [2024-08-06 08:17:09,553][52667] DAMAGECOUNT value on done: 955898.0 [2024-08-06 08:17:09,553][52667] Sum rewards: 75.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.928', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.169', 'AMMO4': '0.177', 'weapon5': '0.194', 'weapon4': '0.202', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '59.000'} [2024-08-06 08:17:09,718][52670] DAMAGECOUNT value on done: 950988.0 [2024-08-06 08:17:09,719][52670] Sum rewards: 74.748, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.870', 'AMMO5': '0.015', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon4': '0.192', 'weapon5': '0.200', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:10,110][52647] DAMAGECOUNT value on done: 1020109.0 [2024-08-06 08:17:10,110][52647] Sum rewards: 73.339, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.792', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.117', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.372', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:10,766][52665] DAMAGECOUNT value on done: 946457.0 [2024-08-06 08:17:10,766][52665] Sum rewards: 75.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.536', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.169', 'weapon5': '0.188', 'AMMO3': '0.260', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '66.000'} [2024-08-06 08:17:10,943][52668] DAMAGECOUNT value on done: 955523.0 [2024-08-06 08:17:10,951][52668] Sum rewards: 75.997, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.410', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.094', 'AMMO4': '0.125', 'weapon5': '0.150', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:11,538][52666] DAMAGECOUNT value on done: 960512.0 [2024-08-06 08:17:11,539][52666] Sum rewards: 71.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.170', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.112', 'weapon5': '0.122', 'AMMO4': '0.162', 'weapon2': '0.184', 'AMMO3': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'HITCOUNT': '3.280', 'weapon3': '3.346', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:11,664][52649] DAMAGECOUNT value on done: 938450.0 [2024-08-06 08:17:11,664][52649] Sum rewards: 86.497, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.224', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon5': '0.192', 'weapon4': '0.222', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '2.988', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '73.000'} [2024-08-06 08:17:12,076][52650] Updated weights for policy 0, policy_version 82991 (0.0013) [2024-08-06 08:17:12,162][52803] DAMAGECOUNT value on done: 897006.0 [2024-08-06 08:17:12,164][52803] Sum rewards: 78.590, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.502', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.178', 'AMMO4': '0.184', 'AMMO3': '0.185', 'weapon4': '0.186', 'weapon2': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.088', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:12,460][52667] DAMAGECOUNT value on done: 972492.0 [2024-08-06 08:17:12,461][52667] Sum rewards: 70.513, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.403', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.080', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.179', 'weapon4': '0.242', 'WEAPON4': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:12,710][52670] DAMAGECOUNT value on done: 936250.0 [2024-08-06 08:17:12,711][52670] Sum rewards: 72.718, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.276', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.226', 'WEAPON3': '1.550', 'weapon3': '3.476', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 679870464. Throughput: 0: 4358.0. Samples: 169976110. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:12,795][52567] Avg episode reward: [(0, '75.117')] [2024-08-06 08:17:13,056][52665] DAMAGECOUNT value on done: 951638.0 [2024-08-06 08:17:13,057][52665] Sum rewards: 75.788, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.385', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.060', 'AMMO3': '0.150', 'AMMO4': '0.180', 'weapon5': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.920', 'WEAPON3': '1.000', 'weapon3': '2.630', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '60.000'} [2024-08-06 08:17:13,313][52647] DAMAGECOUNT value on done: 995429.0 [2024-08-06 08:17:13,313][52647] Sum rewards: 69.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.100', 'WEAPON1': '0.020', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.120', 'AMMO3': '0.205', 'AMMO4': '0.275', 'weapon5': '0.370', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.704', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '56.000'} [2024-08-06 08:17:14,117][52668] DAMAGECOUNT value on done: 964502.0 [2024-08-06 08:17:14,120][52668] Sum rewards: 63.579, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.116', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.078', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '54.000'} [2024-08-06 08:17:14,169][52666] DAMAGECOUNT value on done: 954826.0 [2024-08-06 08:17:14,170][52666] Sum rewards: 71.298, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.150', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.148', 'weapon5': '0.208', 'weapon2': '0.248', 'AMMO3': '0.250', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.114', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '60.000'} [2024-08-06 08:17:14,559][52649] DAMAGECOUNT value on done: 940317.0 [2024-08-06 08:17:14,559][52649] Sum rewards: 70.365, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.200', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO4': '0.184', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.301', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.236', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:15,211][52670] DAMAGECOUNT value on done: 950048.0 [2024-08-06 08:17:15,213][52670] Sum rewards: 82.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.290', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.042', 'weapon5': '0.138', 'AMMO4': '0.168', 'AMMO3': '0.203', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.382', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '67.000'} [2024-08-06 08:17:15,249][52803] DAMAGECOUNT value on done: 891806.0 [2024-08-06 08:17:15,249][52803] Sum rewards: 71.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.963', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.172', 'AMMO3': '0.181', 'weapon2': '0.300', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2024-08-06 08:17:15,318][52667] DAMAGECOUNT value on done: 965378.0 [2024-08-06 08:17:15,319][52667] Sum rewards: 75.840, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.401', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon5': '0.122', 'AMMO3': '0.151', 'weapon2': '0.166', 'AMMO4': '0.181', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '60.000'} [2024-08-06 08:17:15,834][52665] DAMAGECOUNT value on done: 944565.0 [2024-08-06 08:17:15,834][52665] Sum rewards: 80.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.015', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.142', 'WEAPON4': '0.200', 'AMMO3': '0.205', 'weapon4': '0.270', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.950', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '66.000'} [2024-08-06 08:17:16,142][52647] DAMAGECOUNT value on done: 1010568.0 [2024-08-06 08:17:16,152][52647] Sum rewards: 84.589, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.350', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.084', 'AMMO4': '0.151', 'AMMO3': '0.174', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.568', 'WEAPON3': '1.200', 'weapon3': '3.134', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:16,694][52650] Updated weights for policy 0, policy_version 83001 (0.0014) [2024-08-06 08:17:16,867][52666] DAMAGECOUNT value on done: 954377.0 [2024-08-06 08:17:16,871][52666] Sum rewards: 73.864, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.138', 'AMMO5': '0.017', 'AMMO2': '0.066', 'AMMO3': '0.181', 'weapon5': '0.182', 'weapon2': '0.280', 'weapon4': '0.288', 'AMMO4': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.964', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:17,138][52649] DAMAGECOUNT value on done: 930937.0 [2024-08-06 08:17:17,139][52649] Sum rewards: 78.464, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.406', 'AMMO5': '0.021', 'AMMO2': '0.045', 'AMMO3': '0.178', 'AMMO4': '0.226', 'weapon5': '0.308', 'weapon4': '0.322', 'weapon2': '0.480', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.622', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:17,380][52668] DAMAGECOUNT value on done: 957623.0 [2024-08-06 08:17:17,382][52668] Sum rewards: 78.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.384', 'AMMO2': '0.005', 'AMMO5': '0.010', 'AMMO4': '0.025', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.232', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '65.000'} [2024-08-06 08:17:17,794][52567] Fps is (10 sec: 18842.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 679968768. Throughput: 0: 4363.6. Samples: 169989290. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:17,794][52567] Avg episode reward: [(0, '75.302')] [2024-08-06 08:17:18,063][52667] DAMAGECOUNT value on done: 971491.0 [2024-08-06 08:17:18,065][52667] Sum rewards: 71.473, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.974', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.134', 'AMMO4': '0.166', 'weapon5': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '60.000'} [2024-08-06 08:17:18,162][52670] DAMAGECOUNT value on done: 958774.0 [2024-08-06 08:17:18,163][52670] Sum rewards: 60.830, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.068', 'AMMO3': '0.197', 'AMMO4': '0.227', 'weapon2': '0.262', 'weapon5': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '2.820', 'weapon3': '3.184', 'DAMAGECOUNT': '14.781', 'FRAGCOUNT': '50.000'} [2024-08-06 08:17:18,380][52794] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:17:18,422][52803] DAMAGECOUNT value on done: 891155.0 [2024-08-06 08:17:18,422][52803] Sum rewards: 79.888, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.630', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.118', 'AMMO4': '0.149', 'weapon2': '0.160', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.420', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:18,671][52647] DAMAGECOUNT value on done: 1006399.0 [2024-08-06 08:17:18,672][52647] Sum rewards: 65.334, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.011', 'AMMO4': '0.055', 'weapon5': '0.136', 'AMMO3': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'weapon4': '0.410', 'WEAPON3': '0.950', 'weapon3': '2.998', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '51.000'} [2024-08-06 08:17:18,855][52665] DAMAGECOUNT value on done: 960421.0 [2024-08-06 08:17:18,856][52665] Sum rewards: 83.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.435', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.122', 'weapon5': '0.158', 'AMMO4': '0.176', 'weapon2': '0.232', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '70.000'} [2024-08-06 08:17:19,625][52665] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:17:20,000][52666] DAMAGECOUNT value on done: 946611.0 [2024-08-06 08:17:20,001][52666] Sum rewards: 75.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.915', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.076', 'AMMO4': '0.093', 'weapon5': '0.108', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.319', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:20,479][52649] DAMAGECOUNT value on done: 940043.0 [2024-08-06 08:17:20,479][52649] Sum rewards: 72.590, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.185', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.076', 'AMMO4': '0.116', 'weapon5': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 08:17:20,582][52668] DAMAGECOUNT value on done: 953409.0 [2024-08-06 08:17:20,584][52668] Sum rewards: 85.136, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.208', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.440', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '71.000'} [2024-08-06 08:17:20,973][52667] DAMAGECOUNT value on done: 972008.0 [2024-08-06 08:17:20,977][52667] Sum rewards: 88.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.820', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.213', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.472', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '20.886', 'FRAGCOUNT': '72.000'} [2024-08-06 08:17:20,994][52662] DAMAGECOUNT value on done: 957614.0 [2024-08-06 08:17:20,994][52662] Sum rewards: 82.265, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.896', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.096', 'weapon5': '0.200', 'AMMO4': '0.222', 'AMMO3': '0.273', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.024', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '70.000'} [2024-08-06 08:17:21,101][52670] DAMAGECOUNT value on done: 952168.0 [2024-08-06 08:17:21,101][52670] Sum rewards: 77.260, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.745', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.146', 'AMMO3': '0.261', 'weapon4': '0.268', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.986', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '66.000'} [2024-08-06 08:17:21,355][52647] DAMAGECOUNT value on done: 1006211.0 [2024-08-06 08:17:21,363][52647] Sum rewards: 69.652, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.554', 'AMMO5': '0.017', 'AMMO2': '0.024', 'weapon4': '0.114', 'AMMO4': '0.117', 'AMMO3': '0.129', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'WEAPON3': '0.850', 'weapon2': '0.892', 'weapon3': '2.720', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '54.000'} [2024-08-06 08:17:21,465][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:17:21,603][52803] DAMAGECOUNT value on done: 888991.0 [2024-08-06 08:17:21,606][52803] Sum rewards: 75.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.020', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.084', 'AMMO4': '0.236', 'AMMO3': '0.249', 'weapon5': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.530', 'WEAPON3': '1.400', 'weapon3': '2.860', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:21,874][52650] Updated weights for policy 0, policy_version 83011 (0.0012) [2024-08-06 08:17:22,223][52665] DAMAGECOUNT value on done: 953840.0 [2024-08-06 08:17:22,223][52665] Sum rewards: 87.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.235', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.078', 'AMMO4': '0.104', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.000', 'weapon3': '3.290', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '71.000'} [2024-08-06 08:17:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 680050688. Throughput: 0: 4366.9. Samples: 170015510. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:22,794][52567] Avg episode reward: [(0, '75.395')] [2024-08-06 08:17:22,930][52666] DAMAGECOUNT value on done: 945515.0 [2024-08-06 08:17:22,933][52666] Sum rewards: 66.684, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.262', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.076', 'AMMO4': '0.173', 'weapon5': '0.198', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '56.000'} [2024-08-06 08:17:23,478][52667] DAMAGECOUNT value on done: 971089.0 [2024-08-06 08:17:23,480][52667] Sum rewards: 72.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.926', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.086', 'weapon5': '0.128', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.262', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:23,509][52668] DAMAGECOUNT value on done: 948835.0 [2024-08-06 08:17:23,509][52668] Sum rewards: 78.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.521', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.259', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '3.354', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '67.000'} [2024-08-06 08:17:23,601][52649] DAMAGECOUNT value on done: 936445.0 [2024-08-06 08:17:23,601][52649] Sum rewards: 72.215, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.813', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.176', 'weapon5': '0.268', 'AMMO3': '0.276', 'AMMO4': '0.297', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.936', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:23,662][52662] DAMAGECOUNT value on done: 967244.0 [2024-08-06 08:17:23,663][52662] Sum rewards: 83.473, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.472', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon4': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '2.838', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '69.000'} [2024-08-06 08:17:24,120][52670] DAMAGECOUNT value on done: 953480.0 [2024-08-06 08:17:24,121][52670] Sum rewards: 69.802, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.360', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.164', 'AMMO3': '0.177', 'AMMO4': '0.220', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '56.000'} [2024-08-06 08:17:24,301][52647] DAMAGECOUNT value on done: 1000500.0 [2024-08-06 08:17:24,303][52647] Sum rewards: 84.028, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.884', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.048', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.116', 'weapon2': '0.576', 'WEAPON3': '0.850', 'weapon3': '3.250', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:24,712][52803] DAMAGECOUNT value on done: 886852.0 [2024-08-06 08:17:24,715][52803] Sum rewards: 64.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.010', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.152', 'weapon5': '0.170', 'AMMO3': '0.210', 'AMMO4': '0.218', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.300', 'HITCOUNT': '2.990', 'weapon3': '3.084', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '54.000'} [2024-08-06 08:17:25,204][52665] DAMAGECOUNT value on done: 949252.0 [2024-08-06 08:17:25,204][52665] Sum rewards: 75.517, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.470', 'AMMO5': '0.013', 'AMMO2': '0.032', 'AMMO3': '0.148', 'AMMO4': '0.162', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.320', 'weapon2': '0.784', 'WEAPON3': '0.900', 'weapon3': '2.468', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '59.000'} [2024-08-06 08:17:25,789][52666] DAMAGECOUNT value on done: 966657.0 [2024-08-06 08:17:25,792][52666] Sum rewards: 81.126, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.124', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'HEALTH': '0.696', 'weapon2': '0.704', 'WEAPON3': '0.850', 'weapon3': '2.854', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:26,049][52650] Updated weights for policy 0, policy_version 83021 (0.0029) [2024-08-06 08:17:26,278][52667] DAMAGECOUNT value on done: 963826.0 [2024-08-06 08:17:26,279][52667] Sum rewards: 75.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.072', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:26,577][52662] DAMAGECOUNT value on done: 965155.0 [2024-08-06 08:17:26,579][52662] Sum rewards: 83.697, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.338', 'AMMO5': '0.007', 'AMMO2': '0.042', 'weapon5': '0.134', 'weapon4': '0.138', 'AMMO3': '0.201', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '66.000'} [2024-08-06 08:17:26,635][52649] DAMAGECOUNT value on done: 939360.0 [2024-08-06 08:17:26,636][52649] Sum rewards: 77.970, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.100', 'AMMO4': '0.100', 'AMMO3': '0.173', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.254', 'HEALTH': '0.548', 'WEAPON3': '1.000', 'weapon3': '3.234', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:26,756][52668] DAMAGECOUNT value on done: 947029.0 [2024-08-06 08:17:26,759][52668] Sum rewards: 72.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.019', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.136', 'AMMO3': '0.225', 'weapon5': '0.266', 'AMMO4': '0.301', 'weapon2': '0.394', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '59.000'} [2024-08-06 08:17:27,041][52647] DAMAGECOUNT value on done: 1009311.0 [2024-08-06 08:17:27,041][52647] Sum rewards: 67.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.766', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.200', 'weapon3': '3.190', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '55.000'} [2024-08-06 08:17:27,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 680132608. Throughput: 0: 4363.8. Samples: 170041550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:27,794][52567] Avg episode reward: [(0, '75.224')] [2024-08-06 08:17:27,833][52803] DAMAGECOUNT value on done: 887442.0 [2024-08-06 08:17:27,837][52803] Sum rewards: 88.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.616', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.036', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.394', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.730', 'FRAGCOUNT': '71.000'} [2024-08-06 08:17:28,096][52665] DAMAGECOUNT value on done: 948514.0 [2024-08-06 08:17:28,097][52665] Sum rewards: 80.963, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.374', 'AMMO5': '0.024', 'AMMO2': '0.046', 'weapon4': '0.100', 'AMMO3': '0.159', 'AMMO4': '0.228', 'weapon5': '0.338', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.782', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '65.000'} [2024-08-06 08:17:28,176][52667] Large shaping reward 2.566 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:17:28,308][52666] DAMAGECOUNT value on done: 939072.0 [2024-08-06 08:17:28,308][52666] Sum rewards: 86.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.008', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.064', 'weapon5': '0.104', 'AMMO4': '0.130', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.258', 'FRAGCOUNT': '70.500'} [2024-08-06 08:17:29,367][52667] DAMAGECOUNT value on done: 960213.0 [2024-08-06 08:17:29,367][52667] Sum rewards: 82.534, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.703', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.104', 'weapon5': '0.162', 'AMMO4': '0.225', 'AMMO3': '0.286', 'weapon2': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.084', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '72.000'} [2024-08-06 08:17:29,491][52649] DAMAGECOUNT value on done: 934543.0 [2024-08-06 08:17:29,491][52649] Sum rewards: 88.077, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.004', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.064', 'AMMO4': '0.149', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.558', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '21.285', 'FRAGCOUNT': '73.000'} [2024-08-06 08:17:29,675][52668] DAMAGECOUNT value on done: 940190.0 [2024-08-06 08:17:29,677][52668] Sum rewards: 79.379, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.381', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.127', 'weapon5': '0.184', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:29,786][52662] DAMAGECOUNT value on done: 957126.0 [2024-08-06 08:17:29,789][52662] Sum rewards: 82.957, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.850', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.124', 'AMMO4': '0.219', 'weapon5': '0.222', 'AMMO3': '0.229', 'weapon2': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.123', 'FRAGCOUNT': '71.000'} [2024-08-06 08:17:29,822][52647] DAMAGECOUNT value on done: 1002578.0 [2024-08-06 08:17:29,822][52647] Sum rewards: 69.701, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.685', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.076', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '56.000'} [2024-08-06 08:17:30,888][52666] DAMAGECOUNT value on done: 949766.0 [2024-08-06 08:17:30,888][52666] Sum rewards: 71.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.403', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.088', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:30,925][52650] Updated weights for policy 0, policy_version 83031 (0.0012) [2024-08-06 08:17:31,041][52665] DAMAGECOUNT value on done: 945144.0 [2024-08-06 08:17:31,042][52665] Sum rewards: 76.371, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.545', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.040', 'weapon5': '0.130', 'AMMO4': '0.146', 'weapon2': '0.178', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.500', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:31,058][52803] DAMAGECOUNT value on done: 895395.0 [2024-08-06 08:17:31,060][52803] Sum rewards: 71.961, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.098', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.143', 'weapon4': '0.158', 'weapon2': '0.166', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '60.000'} [2024-08-06 08:17:32,309][52668] DAMAGECOUNT value on done: 956908.0 [2024-08-06 08:17:32,317][52668] Sum rewards: 82.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.175', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.116', 'AMMO4': '0.125', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.692', 'WEAPON3': '1.400', 'weapon3': '2.832', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '66.500'} [2024-08-06 08:17:32,422][52667] DAMAGECOUNT value on done: 963643.0 [2024-08-06 08:17:32,424][52667] Sum rewards: 75.110, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.360', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.146', 'AMMO4': '0.154', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:32,428][52662] DAMAGECOUNT value on done: 973791.0 [2024-08-06 08:17:32,429][52662] Sum rewards: 84.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'weapon4': '0.196', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.112', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.703', 'FRAGCOUNT': '70.000'} [2024-08-06 08:17:32,594][52649] DAMAGECOUNT value on done: 930759.0 [2024-08-06 08:17:32,594][52649] Sum rewards: 71.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.910', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.114', 'weapon5': '0.180', 'AMMO4': '0.192', 'AMMO3': '0.254', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.024', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.9, 300 sec: 17439.2). Total num frames: 680214528. Throughput: 0: 4360.0. Samples: 170054640. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:32,794][52567] Avg episode reward: [(0, '75.726')] [2024-08-06 08:17:32,855][52647] DAMAGECOUNT value on done: 1011887.0 [2024-08-06 08:17:32,857][52647] Sum rewards: 71.987, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO2': '0.012', 'AMMO5': '0.012', 'AMMO4': '0.059', 'weapon4': '0.066', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '2.968', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.497', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:34,154][52803] DAMAGECOUNT value on done: 891541.0 [2024-08-06 08:17:34,155][52803] Sum rewards: 71.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.364', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.256', 'weapon2': '0.284', 'WEAPON3': '1.550', 'HITCOUNT': '3.440', 'weapon3': '3.508', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '60.000'} [2024-08-06 08:17:34,186][52665] DAMAGECOUNT value on done: 953666.0 [2024-08-06 08:17:34,186][52665] Sum rewards: 87.760, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.042', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.040', 'AMMO4': '0.096', 'weapon5': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.312', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '22.926', 'FRAGCOUNT': '73.000'} [2024-08-06 08:17:34,614][52668] DAMAGECOUNT value on done: 958656.0 [2024-08-06 08:17:34,614][52668] Sum rewards: 74.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.149', 'weapon2': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.420', 'weapon3': '3.432', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:35,312][52667] DAMAGECOUNT value on done: 970127.0 [2024-08-06 08:17:35,314][52667] Sum rewards: 86.374, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO2': '0.006', 'AMMO4': '0.028', 'AMMO3': '0.217', 'weapon2': '0.330', 'WEAPON3': '1.450', 'weapon3': '3.508', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '72.000'} [2024-08-06 08:17:35,411][52662] DAMAGECOUNT value on done: 950741.0 [2024-08-06 08:17:35,412][52662] Sum rewards: 83.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.246', 'weapon2': '0.322', 'WEAPON3': '1.550', 'weapon3': '3.424', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '69.000'} [2024-08-06 08:17:35,723][52650] Updated weights for policy 0, policy_version 83041 (0.0014) [2024-08-06 08:17:35,752][52649] DAMAGECOUNT value on done: 945536.0 [2024-08-06 08:17:35,753][52649] Sum rewards: 84.410, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.510', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.074', 'AMMO4': '0.143', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon4': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.514', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '67.000'} [2024-08-06 08:17:35,760][52647] DAMAGECOUNT value on done: 1012389.0 [2024-08-06 08:17:35,760][52647] Sum rewards: 64.304, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.022', 'AMMO2': '0.051', 'weapon4': '0.126', 'AMMO3': '0.235', 'weapon5': '0.252', 'AMMO4': '0.253', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '56.000'} [2024-08-06 08:17:35,971][52659] DAMAGECOUNT value on done: 960493.0 [2024-08-06 08:17:35,971][52659] Sum rewards: 70.282, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.453', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.084', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'weapon2': '0.196', 'AMMO3': '0.270', 'WEAPON3': '1.500', 'weapon3': '3.448', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '60.000'} [2024-08-06 08:17:37,318][52668] DAMAGECOUNT value on done: 957593.0 [2024-08-06 08:17:37,321][52665] DAMAGECOUNT value on done: 946824.0 [2024-08-06 08:17:37,327][52668] Sum rewards: 70.922, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.350', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.148', 'AMMO3': '0.185', 'AMMO4': '0.257', 'weapon5': '0.258', 'weapon2': '0.458', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.886', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '58.000'} [2024-08-06 08:17:37,328][52665] Sum rewards: 66.631, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.128', 'weapon4': '0.142', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.224', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:37,432][52803] DAMAGECOUNT value on done: 902989.0 [2024-08-06 08:17:37,432][52803] Sum rewards: 86.426, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.971', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.088', 'AMMO4': '0.139', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.434', 'WEAPON3': '1.000', 'weapon3': '3.256', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 680304640. Throughput: 0: 4360.4. Samples: 170080840. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:37,794][52567] Avg episode reward: [(0, '75.657')] [2024-08-06 08:17:37,852][52667] DAMAGECOUNT value on done: 958626.0 [2024-08-06 08:17:37,853][52667] Sum rewards: 73.773, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.533', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.058', 'weapon2': '0.204', 'weapon5': '0.232', 'AMMO3': '0.234', 'weapon4': '0.250', 'AMMO4': '0.289', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '63.500'} [2024-08-06 08:17:38,470][52647] DAMAGECOUNT value on done: 996612.0 [2024-08-06 08:17:38,471][52647] Sum rewards: 74.165, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.155', 'weapon2': '0.820', 'WEAPON3': '1.050', 'weapon3': '3.038', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:38,566][52662] DAMAGECOUNT value on done: 956752.0 [2024-08-06 08:17:38,568][52662] Sum rewards: 69.758, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.423', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.134', 'weapon2': '0.152', 'weapon5': '0.174', 'AMMO4': '0.210', 'AMMO3': '0.255', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.288', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '59.000'} [2024-08-06 08:17:38,908][52649] DAMAGECOUNT value on done: 950551.0 [2024-08-06 08:17:38,908][52649] Sum rewards: 78.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.380', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.231', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.536', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:39,219][52659] DAMAGECOUNT value on done: 959826.0 [2024-08-06 08:17:39,222][52659] Sum rewards: 80.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.170', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.236', 'WEAPON3': '1.500', 'weapon3': '3.502', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:40,046][52650] Updated weights for policy 0, policy_version 83051 (0.0012) [2024-08-06 08:17:40,470][52665] DAMAGECOUNT value on done: 939236.0 [2024-08-06 08:17:40,470][52665] Sum rewards: 62.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.400', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.084', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.566', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.168', 'DAMAGECOUNT': '15.681', 'FRAGCOUNT': '52.000'} [2024-08-06 08:17:40,529][52668] DAMAGECOUNT value on done: 957486.0 [2024-08-06 08:17:40,529][52668] Sum rewards: 59.709, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.100', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'weapon2': '0.220', 'WEAPON4': '0.300', 'weapon4': '0.318', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.160', 'DAMAGECOUNT': '14.439', 'FRAGCOUNT': '49.000'} [2024-08-06 08:17:40,577][52803] DAMAGECOUNT value on done: 899056.0 [2024-08-06 08:17:40,581][52803] Sum rewards: 80.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.826', 'AMMO5': '0.018', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO4': '0.181', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.204', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:40,970][52667] DAMAGECOUNT value on done: 958476.0 [2024-08-06 08:17:40,973][52667] Sum rewards: 69.856, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.410', 'AMMO5': '0.018', 'AMMO2': '0.059', 'weapon4': '0.138', 'AMMO3': '0.173', 'AMMO4': '0.295', 'weapon5': '0.372', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.572', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:41,069][52662] DAMAGECOUNT value on done: 972807.0 [2024-08-06 08:17:41,071][52662] Sum rewards: 66.668, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.064', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.112', 'AMMO3': '0.211', 'AMMO4': '0.248', 'weapon5': '0.320', 'weapon2': '0.384', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '55.000'} [2024-08-06 08:17:41,538][52647] DAMAGECOUNT value on done: 1005523.0 [2024-08-06 08:17:41,539][52647] Sum rewards: 81.595, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.046', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.210', 'AMMO3': '0.287', 'WEAPON3': '1.550', 'weapon3': '3.484', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.292', 'FRAGCOUNT': '69.000'} [2024-08-06 08:17:41,841][52659] DAMAGECOUNT value on done: 971816.0 [2024-08-06 08:17:41,842][52659] Sum rewards: 90.279, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.108', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.843', 'FRAGCOUNT': '73.000'} [2024-08-06 08:17:41,948][52820] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:17:42,207][52649] DAMAGECOUNT value on done: 942093.0 [2024-08-06 08:17:42,211][52649] Sum rewards: 72.928, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.310', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon5': '0.092', 'AMMO4': '0.114', 'weapon4': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.289', 'weapon2': '0.378', 'WEAPON3': '1.750', 'weapon3': '3.092', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:42,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17439.2). Total num frames: 680394752. Throughput: 0: 4355.7. Samples: 170106750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:42,795][52567] Avg episode reward: [(0, '75.830')] [2024-08-06 08:17:42,969][52660] DAMAGECOUNT value on done: 954174.0 [2024-08-06 08:17:42,971][52660] Sum rewards: 76.895, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.362', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.094', 'weapon4': '0.096', 'AMMO4': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.354', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:43,287][52668] DAMAGECOUNT value on done: 963912.0 [2024-08-06 08:17:43,290][52668] Sum rewards: 69.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.142', 'AMMO5': '0.018', 'AMMO2': '0.058', 'AMMO3': '0.232', 'weapon5': '0.266', 'weapon4': '0.278', 'AMMO4': '0.292', 'weapon2': '0.312', 'WEAPON5': '0.450', 'WEAPON4': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '58.000'} [2024-08-06 08:17:43,640][52803] DAMAGECOUNT value on done: 888299.0 [2024-08-06 08:17:43,641][52665] DAMAGECOUNT value on done: 945405.0 [2024-08-06 08:17:43,648][52803] Sum rewards: 78.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.018', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.139', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:43,648][52665] Sum rewards: 81.291, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.332', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.126', 'AMMO4': '0.211', 'AMMO3': '0.225', 'weapon5': '0.240', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.080', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '21.108', 'FRAGCOUNT': '67.000'} [2024-08-06 08:17:43,809][52667] DAMAGECOUNT value on done: 969349.0 [2024-08-06 08:17:43,810][52667] Sum rewards: 67.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.064', 'weapon5': '0.160', 'AMMO3': '0.214', 'AMMO4': '0.241', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.110', 'weapon3': '3.328', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:43,996][52820] DAMAGECOUNT value on done: 887686.0 [2024-08-06 08:17:43,997][52820] Sum rewards: 87.032, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.242', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.066', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.346', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '70.000'} [2024-08-06 08:17:44,030][52662] DAMAGECOUNT value on done: 960543.0 [2024-08-06 08:17:44,032][52662] Sum rewards: 75.865, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.770', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.158', 'weapon4': '0.208', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.808', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.548', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:44,178][52647] DAMAGECOUNT value on done: 998677.0 [2024-08-06 08:17:44,178][52647] Sum rewards: 70.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.944', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.137', 'AMMO3': '0.154', 'weapon5': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.258', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '56.000'} [2024-08-06 08:17:45,032][52659] DAMAGECOUNT value on done: 962080.0 [2024-08-06 08:17:45,032][52659] Sum rewards: 82.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.486', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.044', 'AMMO4': '0.142', 'weapon5': '0.164', 'AMMO3': '0.179', 'weapon2': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.330', 'weapon3': '3.362', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:45,062][52650] Updated weights for policy 0, policy_version 83061 (0.0036) [2024-08-06 08:17:45,337][52649] DAMAGECOUNT value on done: 940658.0 [2024-08-06 08:17:45,337][52649] Sum rewards: 74.711, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.108', 'weapon5': '0.200', 'AMMO4': '0.214', 'AMMO3': '0.233', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.194', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:45,595][52660] DAMAGECOUNT value on done: 946644.0 [2024-08-06 08:17:45,597][52660] Sum rewards: 83.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.092', 'weapon4': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:46,576][52662] DAMAGECOUNT value on done: 963785.0 [2024-08-06 08:17:46,577][52662] Sum rewards: 58.226, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-3.458', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.116', 'weapon5': '0.206', 'weapon2': '0.240', 'AMMO4': '0.248', 'AMMO3': '0.325', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.900', 'HITCOUNT': '3.050', 'weapon3': '3.076', 'DAMAGECOUNT': '16.152', 'FRAGCOUNT': '54.000'} [2024-08-06 08:17:46,624][52647] DAMAGECOUNT value on done: 1002325.0 [2024-08-06 08:17:46,626][52647] Sum rewards: 75.322, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.580', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.028', 'AMMO4': '0.118', 'weapon5': '0.146', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.736', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '60.500'} [2024-08-06 08:17:46,654][52665] DAMAGECOUNT value on done: 950654.0 [2024-08-06 08:17:46,657][52665] Sum rewards: 88.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.092', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.122', 'AMMO4': '0.143', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.194', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.761', 'FRAGCOUNT': '73.000'} [2024-08-06 08:17:46,822][52803] DAMAGECOUNT value on done: 905285.0 [2024-08-06 08:17:46,826][52803] Sum rewards: 90.419, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.092', 'AMMO4': '0.155', 'weapon2': '0.176', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.208', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '73.000'} [2024-08-06 08:17:47,117][52667] DAMAGECOUNT value on done: 957762.0 [2024-08-06 08:17:47,118][52667] Sum rewards: 59.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.780', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.108', 'AMMO4': '0.181', 'AMMO3': '0.268', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.138', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '53.000'} [2024-08-06 08:17:47,121][52820] DAMAGECOUNT value on done: 889062.0 [2024-08-06 08:17:47,122][52820] Sum rewards: 90.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.458', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.072', 'AMMO4': '0.103', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.322', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '22.053', 'FRAGCOUNT': '74.000'} [2024-08-06 08:17:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 680476672. Throughput: 0: 4353.4. Samples: 170119750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:47,794][52567] Avg episode reward: [(0, '76.349')] [2024-08-06 08:17:48,325][52614] Signal inference workers to stop experience collection... (15200 times) [2024-08-06 08:17:48,337][52614] Signal inference workers to resume experience collection... (15200 times) [2024-08-06 08:17:48,382][52659] DAMAGECOUNT value on done: 957118.0 [2024-08-06 08:17:48,382][52659] Sum rewards: 79.772, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.275', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon5': '0.064', 'AMMO4': '0.082', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.000', 'weapon3': '3.262', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:48,409][52650] InferenceWorker_p0-w0: stopping experience collection (15200 times) [2024-08-06 08:17:48,417][52650] InferenceWorker_p0-w0: resuming experience collection (15200 times) [2024-08-06 08:17:48,482][52649] DAMAGECOUNT value on done: 928795.0 [2024-08-06 08:17:48,487][52649] Sum rewards: 77.629, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.654', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.123', 'weapon5': '0.172', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '65.000'} [2024-08-06 08:17:48,490][52660] DAMAGECOUNT value on done: 958481.0 [2024-08-06 08:17:48,491][52660] Sum rewards: 74.065, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.860', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.042', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.152', 'weapon4': '0.274', 'weapon2': '0.492', 'WEAPON3': '0.950', 'weapon3': '2.916', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '59.000'} [2024-08-06 08:17:49,700][52662] DAMAGECOUNT value on done: 960558.0 [2024-08-06 08:17:49,701][52662] Sum rewards: 67.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.198', 'AMMO3': '0.247', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '57.000'} [2024-08-06 08:17:49,795][52667] DAMAGECOUNT value on done: 965877.0 [2024-08-06 08:17:49,795][52667] Sum rewards: 62.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.970', 'AMMO5': '0.005', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.050', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.178', 'weapon4': '0.292', 'weapon2': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.902', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.104', 'FRAGCOUNT': '50.000'} [2024-08-06 08:17:49,950][52803] DAMAGECOUNT value on done: 888338.0 [2024-08-06 08:17:49,951][52803] Sum rewards: 63.049, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.632', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.150', 'weapon5': '0.184', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.124', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '51.000'} [2024-08-06 08:17:49,999][52650] Updated weights for policy 0, policy_version 83071 (0.0012) [2024-08-06 08:17:50,262][52820] DAMAGECOUNT value on done: 891955.0 [2024-08-06 08:17:50,262][52820] Sum rewards: 85.915, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.428', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.092', 'AMMO4': '0.199', 'weapon5': '0.228', 'weapon2': '0.256', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.158', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.787', 'FRAGCOUNT': '72.000'} [2024-08-06 08:17:50,890][52658] Large shaping reward -2.502 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.252, -84.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:17:51,112][52659] DAMAGECOUNT value on done: 962666.0 [2024-08-06 08:17:51,115][52659] Sum rewards: 89.428, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.069', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.012', 'AMMO4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.235', 'weapon2': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.454', 'HITCOUNT': '4.350', 'DAMAGECOUNT': '20.808', 'FRAGCOUNT': '76.000'} [2024-08-06 08:17:51,195][52660] DAMAGECOUNT value on done: 971090.0 [2024-08-06 08:17:51,197][52660] Sum rewards: 86.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.785', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.066', 'weapon5': '0.090', 'AMMO4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '73.000'} [2024-08-06 08:17:51,511][52649] DAMAGECOUNT value on done: 941984.0 [2024-08-06 08:17:51,512][52649] Sum rewards: 77.887, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO2': '0.003', 'AMMO4': '0.013', 'AMMO3': '0.197', 'weapon2': '0.318', 'WEAPON3': '1.250', 'HITCOUNT': '3.510', 'weapon3': '3.560', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:52,209][52667] DAMAGECOUNT value on done: 970728.0 [2024-08-06 08:17:52,211][52667] Sum rewards: 72.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.126', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.138', 'AMMO4': '0.164', 'weapon5': '0.174', 'AMMO3': '0.183', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.086', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:52,636][52662] DAMAGECOUNT value on done: 959126.0 [2024-08-06 08:17:52,636][52662] Sum rewards: 86.483, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.007', 'weapon4': '0.014', 'weapon5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.264', 'WEAPON3': '1.300', 'weapon3': '3.530', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '71.000'} [2024-08-06 08:17:52,794][52567] Fps is (10 sec: 17204.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 680566784. Throughput: 0: 4366.0. Samples: 170146270. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:52,794][52567] Avg episode reward: [(0, '76.647')] [2024-08-06 08:17:52,947][52803] DAMAGECOUNT value on done: 899123.0 [2024-08-06 08:17:52,947][52803] Sum rewards: 77.616, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.044', 'weapon5': '0.060', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '3.118', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:53,488][52820] DAMAGECOUNT value on done: 878264.0 [2024-08-06 08:17:53,489][52820] Sum rewards: 77.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'weapon5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.562', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:54,040][52659] DAMAGECOUNT value on done: 961186.0 [2024-08-06 08:17:54,041][52659] Sum rewards: 78.827, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.976', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.084', 'weapon5': '0.162', 'AMMO4': '0.244', 'AMMO3': '0.274', 'weapon2': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '69.000'} [2024-08-06 08:17:54,043][52650] Updated weights for policy 0, policy_version 83081 (0.0013) [2024-08-06 08:17:54,287][52660] DAMAGECOUNT value on done: 952540.0 [2024-08-06 08:17:54,289][52660] Sum rewards: 80.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.102', 'weapon5': '0.130', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.616', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '64.000'} [2024-08-06 08:17:54,639][52649] DAMAGECOUNT value on done: 923736.0 [2024-08-06 08:17:54,639][52649] Sum rewards: 84.479, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.082', 'AMMO4': '0.158', 'weapon5': '0.174', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:55,162][52667] DAMAGECOUNT value on done: 973784.0 [2024-08-06 08:17:55,171][52667] Sum rewards: 79.078, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.005', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.182', 'weapon2': '0.192', 'AMMO4': '0.242', 'weapon5': '0.274', 'weapon4': '0.372', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.858', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.990', 'FRAGCOUNT': '62.000'} [2024-08-06 08:17:55,392][52662] DAMAGECOUNT value on done: 952635.0 [2024-08-06 08:17:55,392][52662] Sum rewards: 73.913, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.103', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.214', 'WEAPON3': '1.250', 'weapon3': '3.372', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '59.500'} [2024-08-06 08:17:56,072][52803] DAMAGECOUNT value on done: 899747.0 [2024-08-06 08:17:56,072][52803] Sum rewards: 81.225, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.215', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon5': '0.126', 'weapon2': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.232', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.252', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.656', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:56,693][52820] DAMAGECOUNT value on done: 889741.0 [2024-08-06 08:17:56,693][52820] Sum rewards: 74.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.187', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.106', 'weapon5': '0.156', 'AMMO4': '0.163', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:56,862][52659] DAMAGECOUNT value on done: 962349.0 [2024-08-06 08:17:56,864][52659] Sum rewards: 74.515, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.117', 'AMMO3': '0.208', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '61.000'} [2024-08-06 08:17:56,921][52794] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:17:57,532][52660] DAMAGECOUNT value on done: 951432.0 [2024-08-06 08:17:57,532][52660] Sum rewards: 92.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.922', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.217', 'WEAPON3': '1.300', 'weapon3': '3.476', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '21.408', 'FRAGCOUNT': '75.000'} [2024-08-06 08:17:57,744][52667] DAMAGECOUNT value on done: 969373.0 [2024-08-06 08:17:57,745][52667] Sum rewards: 71.552, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.026', 'weapon5': '0.086', 'AMMO4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.210', 'AMMO3': '0.277', 'WEAPON3': '1.650', 'HITCOUNT': '3.280', 'weapon3': '3.414', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '63.000'} [2024-08-06 08:17:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 680656896. Throughput: 0: 4366.7. Samples: 170172610. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:17:57,794][52567] Avg episode reward: [(0, '76.891')] [2024-08-06 08:17:57,854][52649] DAMAGECOUNT value on done: 942823.0 [2024-08-06 08:17:57,855][52649] Sum rewards: 86.796, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.125', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'weapon5': '0.160', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '68.000'} [2024-08-06 08:17:58,020][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 08:17:58,214][52662] DAMAGECOUNT value on done: 964396.0 [2024-08-06 08:17:58,214][52662] Sum rewards: 81.303, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.753', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.132', 'AMMO4': '0.154', 'weapon2': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.304', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '67.000'} [2024-08-06 08:17:59,090][52650] Updated weights for policy 0, policy_version 83091 (0.0019) [2024-08-06 08:17:59,196][52803] DAMAGECOUNT value on done: 905736.0 [2024-08-06 08:17:59,196][52803] Sum rewards: 69.134, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.585', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.133', 'weapon2': '0.390', 'WEAPON3': '1.000', 'HITCOUNT': '3.360', 'weapon3': '3.454', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '54.000'} [2024-08-06 08:17:59,834][52659] DAMAGECOUNT value on done: 959793.0 [2024-08-06 08:17:59,836][52659] Sum rewards: 80.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.905', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '3.268', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:00,221][52820] DAMAGECOUNT value on done: 876106.0 [2024-08-06 08:18:00,222][52820] Sum rewards: 77.271, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.890', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.183', 'weapon5': '0.188', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '62.000'} [2024-08-06 08:18:00,311][52660] DAMAGECOUNT value on done: 956973.0 [2024-08-06 08:18:00,311][52660] Sum rewards: 72.497, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.330', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.212', 'weapon5': '0.216', 'AMMO4': '0.224', 'weapon2': '0.262', 'AMMO3': '0.295', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.972', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:00,457][52649] DAMAGECOUNT value on done: 943999.0 [2024-08-06 08:18:00,457][52649] Sum rewards: 80.851, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.059', 'AMMO5': '0.010', 'AMMO2': '0.053', 'weapon4': '0.130', 'weapon2': '0.154', 'weapon5': '0.180', 'AMMO3': '0.217', 'AMMO4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.308', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:00,716][52667] DAMAGECOUNT value on done: 965654.0 [2024-08-06 08:18:00,717][52667] Sum rewards: 72.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.084', 'AMMO4': '0.152', 'AMMO3': '0.167', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.000', 'weapon3': '3.082', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '58.000'} [2024-08-06 08:18:01,207][52662] DAMAGECOUNT value on done: 955944.0 [2024-08-06 08:18:01,209][52662] Sum rewards: 68.109, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.485', 'AMMO5': '0.021', 'AMMO2': '0.050', 'AMMO3': '0.157', 'weapon4': '0.174', 'AMMO4': '0.252', 'WEAPON4': '0.450', 'weapon5': '0.452', 'weapon2': '0.532', 'WEAPON5': '0.650', 'WEAPON3': '1.000', 'weapon3': '2.508', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '54.000'} [2024-08-06 08:18:01,868][52664] DAMAGECOUNT value on done: 988266.0 [2024-08-06 08:18:01,870][52664] Sum rewards: 79.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.365', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.118', 'AMMO4': '0.128', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.374', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '63.000'} [2024-08-06 08:18:02,399][52803] DAMAGECOUNT value on done: 902062.0 [2024-08-06 08:18:02,400][52803] Sum rewards: 74.455, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.750', 'AMMO5': '0.015', 'AMMO2': '0.025', 'weapon5': '0.118', 'AMMO4': '0.125', 'AMMO3': '0.164', 'weapon4': '0.166', 'WEAPON4': '0.300', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '59.000'} [2024-08-06 08:18:02,667][52659] DAMAGECOUNT value on done: 969322.0 [2024-08-06 08:18:02,667][52659] Sum rewards: 83.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.304', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.312', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:02,794][52567] Fps is (10 sec: 18841.1, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 680755200. Throughput: 0: 4364.6. Samples: 170185700. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:02,795][52567] Avg episode reward: [(0, '77.138')] [2024-08-06 08:18:03,349][52660] DAMAGECOUNT value on done: 962557.0 [2024-08-06 08:18:03,349][52660] Sum rewards: 67.843, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.100', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.028', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.180', 'weapon2': '0.632', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '54.000'} [2024-08-06 08:18:03,385][52820] DAMAGECOUNT value on done: 882849.0 [2024-08-06 08:18:03,386][52820] Sum rewards: 82.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.847', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.054', 'AMMO4': '0.151', 'weapon2': '0.190', 'weapon5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.010', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:03,505][52666] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 08:18:03,575][52649] DAMAGECOUNT value on done: 934014.0 [2024-08-06 08:18:03,575][52649] Sum rewards: 77.745, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.910', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.052', 'AMMO4': '0.117', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:03,600][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:18:03,665][52667] DAMAGECOUNT value on done: 970203.0 [2024-08-06 08:18:03,666][52667] Sum rewards: 75.275, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.133', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.070', 'AMMO4': '0.077', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.398', 'WEAPON3': '1.550', 'weapon3': '3.176', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '62.000'} [2024-08-06 08:18:03,796][52650] Updated weights for policy 0, policy_version 83101 (0.0025) [2024-08-06 08:18:04,357][52664] DAMAGECOUNT value on done: 995547.0 [2024-08-06 08:18:04,358][52664] Sum rewards: 86.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.186', 'weapon4': '0.194', 'weapon2': '0.262', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '71.000'} [2024-08-06 08:18:04,373][52662] DAMAGECOUNT value on done: 971232.0 [2024-08-06 08:18:04,374][52662] Sum rewards: 63.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.350', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon4': '0.092', 'AMMO3': '0.202', 'AMMO4': '0.301', 'weapon5': '0.308', 'weapon2': '0.314', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.990', 'weapon3': '3.022', 'DAMAGECOUNT': '15.534', 'FRAGCOUNT': '54.000'} [2024-08-06 08:18:05,563][52803] DAMAGECOUNT value on done: 897621.0 [2024-08-06 08:18:05,564][52803] Sum rewards: 80.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO3': '0.202', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.354', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:05,655][52659] DAMAGECOUNT value on done: 954426.0 [2024-08-06 08:18:05,656][52659] Sum rewards: 67.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.291', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.026', 'AMMO4': '0.045', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.306', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '55.000'} [2024-08-06 08:18:06,579][52820] DAMAGECOUNT value on done: 884361.0 [2024-08-06 08:18:06,580][52820] Sum rewards: 85.080, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.210', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'WEAPON1': '0.010', 'AMMO3': '0.187', 'weapon2': '0.366', 'WEAPON3': '1.100', 'weapon3': '3.504', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.467', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:06,660][52660] DAMAGECOUNT value on done: 952475.0 [2024-08-06 08:18:06,662][52660] Sum rewards: 70.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.207', 'weapon4': '0.212', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.038', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.168', 'FRAGCOUNT': '57.000'} [2024-08-06 08:18:07,080][52662] DAMAGECOUNT value on done: 960786.0 [2024-08-06 08:18:07,082][52662] Sum rewards: 63.829, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.582', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.118', 'WEAPON5': '0.200', 'weapon4': '0.210', 'AMMO3': '0.213', 'weapon2': '0.266', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.296', 'DAMAGECOUNT': '15.018', 'FRAGCOUNT': '56.000'} [2024-08-06 08:18:07,089][52664] DAMAGECOUNT value on done: 999846.0 [2024-08-06 08:18:07,090][52664] Sum rewards: 80.822, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.275', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon5': '0.132', 'AMMO4': '0.183', 'weapon2': '0.218', 'AMMO3': '0.249', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.968', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:07,794][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 680820736. Throughput: 0: 4361.7. Samples: 170211790. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:07,795][52567] Avg episode reward: [(0, '76.541')] [2024-08-06 08:18:08,223][52659] DAMAGECOUNT value on done: 965782.0 [2024-08-06 08:18:08,223][52659] Sum rewards: 69.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.020', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.154', 'AMMO3': '0.181', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.164', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '56.000'} [2024-08-06 08:18:08,375][52650] Updated weights for policy 0, policy_version 83111 (0.0014) [2024-08-06 08:18:09,586][52660] DAMAGECOUNT value on done: 950890.0 [2024-08-06 08:18:09,586][52660] Sum rewards: 83.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.290', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.158', 'AMMO3': '0.174', 'AMMO4': '0.174', 'weapon4': '0.294', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:09,839][52820] DAMAGECOUNT value on done: 892883.0 [2024-08-06 08:18:09,840][52820] Sum rewards: 84.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.731', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO4': '0.147', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '71.000'} [2024-08-06 08:18:09,919][52664] DAMAGECOUNT value on done: 989496.0 [2024-08-06 08:18:09,921][52664] Sum rewards: 84.616, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.087', 'AMMO5': '0.006', 'AMMO2': '0.011', 'weapon4': '0.032', 'AMMO4': '0.052', 'weapon5': '0.062', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon2': '0.504', 'WEAPON3': '1.050', 'weapon3': '3.256', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.948', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:10,374][52662] DAMAGECOUNT value on done: 951465.0 [2024-08-06 08:18:10,375][52662] Sum rewards: 80.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.188', 'AMMO4': '0.191', 'AMMO3': '0.204', 'weapon2': '0.206', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.134', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:10,885][52659] DAMAGECOUNT value on done: 958918.0 [2024-08-06 08:18:10,894][52659] Sum rewards: 72.611, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.726', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon4': '0.106', 'AMMO3': '0.183', 'weapon5': '0.200', 'AMMO4': '0.281', 'weapon2': '0.356', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.074', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '61.000'} [2024-08-06 08:18:11,187][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:18:12,523][52664] DAMAGECOUNT value on done: 1004044.0 [2024-08-06 08:18:12,523][52664] Sum rewards: 67.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.399', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.090', 'weapon5': '0.190', 'AMMO3': '0.201', 'AMMO4': '0.244', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '54.000'} [2024-08-06 08:18:12,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 680919040. Throughput: 0: 4355.1. Samples: 170237530. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:12,794][52567] Avg episode reward: [(0, '76.625')] [2024-08-06 08:18:12,951][52660] DAMAGECOUNT value on done: 957416.0 [2024-08-06 08:18:12,951][52660] Sum rewards: 81.288, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.144', 'AMMO4': '0.155', 'weapon5': '0.186', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.656', 'WEAPON3': '1.450', 'weapon3': '2.700', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.737', 'FRAGCOUNT': '70.000'} [2024-08-06 08:18:12,971][52820] DAMAGECOUNT value on done: 901004.0 [2024-08-06 08:18:12,975][52820] Sum rewards: 96.097, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.708', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.156', 'weapon2': '0.180', 'AMMO3': '0.220', 'WEAPON3': '1.500', 'weapon3': '3.444', 'HITCOUNT': '4.480', 'DAMAGECOUNT': '22.368', 'FRAGCOUNT': '79.000'} [2024-08-06 08:18:13,132][52662] DAMAGECOUNT value on done: 956431.0 [2024-08-06 08:18:13,132][52662] Sum rewards: 78.984, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.010', 'weapon4': '0.038', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO4': '0.201', 'weapon2': '0.206', 'AMMO3': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'HITCOUNT': '3.380', 'weapon3': '3.444', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:13,388][52650] Updated weights for policy 0, policy_version 83121 (0.0026) [2024-08-06 08:18:13,423][52659] DAMAGECOUNT value on done: 957256.0 [2024-08-06 08:18:13,423][52659] Sum rewards: 89.071, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.490', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.132', 'AMMO3': '0.235', 'AMMO4': '0.244', 'weapon2': '0.244', 'weapon5': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.402', 'FRAGCOUNT': '73.000'} [2024-08-06 08:18:13,733][52795] DAMAGECOUNT value on done: 883003.0 [2024-08-06 08:18:13,733][52795] Sum rewards: 68.654, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.894', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.070', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon2': '0.192', 'AMMO3': '0.254', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.724', 'FRAGCOUNT': '58.000'} [2024-08-06 08:18:15,238][52664] DAMAGECOUNT value on done: 999348.0 [2024-08-06 08:18:15,238][52664] Sum rewards: 58.324, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.018', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.104', 'weapon5': '0.194', 'AMMO4': '0.197', 'AMMO3': '0.206', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.182', 'DAMAGECOUNT': '15.135', 'FRAGCOUNT': '48.000'} [2024-08-06 08:18:15,841][52659] DAMAGECOUNT value on done: 960369.0 [2024-08-06 08:18:15,841][52659] Sum rewards: 65.079, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.958', 'AMMO5': '0.012', 'AMMO2': '0.019', 'weapon4': '0.054', 'AMMO4': '0.096', 'weapon5': '0.142', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.704', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '54.000'} [2024-08-06 08:18:16,117][52660] DAMAGECOUNT value on done: 951455.0 [2024-08-06 08:18:16,126][52660] Sum rewards: 69.788, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.045', 'AMMO2': '0.016', 'AMMO4': '0.080', 'AMMO3': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.510', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.000'} [2024-08-06 08:18:16,161][52662] DAMAGECOUNT value on done: 951984.0 [2024-08-06 08:18:16,162][52662] Sum rewards: 71.854, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.140', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.058', 'weapon5': '0.064', 'AMMO4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.230', 'weapon2': '0.376', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '61.000'} [2024-08-06 08:18:16,221][52820] DAMAGECOUNT value on done: 882526.0 [2024-08-06 08:18:16,223][52820] Sum rewards: 76.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.364', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.132', 'weapon4': '0.146', 'AMMO4': '0.164', 'AMMO3': '0.185', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '62.000'} [2024-08-06 08:18:16,955][52795] DAMAGECOUNT value on done: 878443.0 [2024-08-06 08:18:16,956][52795] Sum rewards: 88.934, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.191', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.098', 'AMMO4': '0.122', 'AMMO3': '0.173', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.134', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.264', 'FRAGCOUNT': '70.000'} [2024-08-06 08:18:17,679][52650] Updated weights for policy 0, policy_version 83131 (0.0012) [2024-08-06 08:18:17,794][52567] Fps is (10 sec: 18842.1, 60 sec: 17339.7, 300 sec: 17494.8). Total num frames: 681009152. Throughput: 0: 4358.4. Samples: 170250770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:17,795][52567] Avg episode reward: [(0, '76.512')] [2024-08-06 08:18:17,870][52664] DAMAGECOUNT value on done: 988039.0 [2024-08-06 08:18:17,871][52664] Sum rewards: 66.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon5': '0.108', 'weapon4': '0.114', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.264', 'WEAPON3': '1.200', 'HITCOUNT': '3.060', 'weapon3': '3.308', 'DAMAGECOUNT': '14.913', 'FRAGCOUNT': '56.000'} [2024-08-06 08:18:18,598][52659] DAMAGECOUNT value on done: 961152.0 [2024-08-06 08:18:18,599][52659] Sum rewards: 78.192, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.314', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO4': '0.197', 'AMMO3': '0.201', 'weapon4': '0.230', 'weapon5': '0.230', 'weapon2': '0.326', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.996', 'FRAGCOUNT': '62.000'} [2024-08-06 08:18:18,837][52660] DAMAGECOUNT value on done: 950831.0 [2024-08-06 08:18:18,839][52660] Sum rewards: 69.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.897', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.030', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.224', 'weapon2': '0.230', 'WEAPON3': '1.300', 'HITCOUNT': '3.420', 'weapon3': '3.538', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '57.000'} [2024-08-06 08:18:19,326][52820] DAMAGECOUNT value on done: 893512.0 [2024-08-06 08:18:19,327][52820] Sum rewards: 91.294, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.468', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.150', 'weapon5': '0.190', 'AMMO4': '0.223', 'weapon2': '0.244', 'AMMO3': '0.257', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.104', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '77.000'} [2024-08-06 08:18:20,126][52795] DAMAGECOUNT value on done: 880940.0 [2024-08-06 08:18:20,130][52795] Sum rewards: 85.453, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.082', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon5': '0.256', 'weapon2': '0.376', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '69.000'} [2024-08-06 08:18:20,965][52664] DAMAGECOUNT value on done: 990421.0 [2024-08-06 08:18:20,966][52664] Sum rewards: 81.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.309', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.072', 'weapon5': '0.182', 'AMMO3': '0.203', 'AMMO4': '0.205', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:21,289][52659] DAMAGECOUNT value on done: 971500.0 [2024-08-06 08:18:21,289][52659] Sum rewards: 76.957, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.936', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'weapon2': '0.216', 'AMMO3': '0.223', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '65.000'} [2024-08-06 08:18:21,926][52660] DAMAGECOUNT value on done: 961073.0 [2024-08-06 08:18:21,926][52660] Sum rewards: 82.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.322', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.058', 'weapon4': '0.108', 'AMMO4': '0.146', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.948', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:22,453][52820] DAMAGECOUNT value on done: 905700.0 [2024-08-06 08:18:22,453][52820] Sum rewards: 79.163, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.111', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.204', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:22,595][52650] Updated weights for policy 0, policy_version 83141 (0.0024) [2024-08-06 08:18:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 681091072. Throughput: 0: 4356.4. Samples: 170276880. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:22,794][52567] Avg episode reward: [(0, '76.915')] [2024-08-06 08:18:23,303][52795] DAMAGECOUNT value on done: 894681.0 [2024-08-06 08:18:23,303][52795] Sum rewards: 78.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.698', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.205', 'weapon2': '0.320', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:23,730][52664] DAMAGECOUNT value on done: 996463.0 [2024-08-06 08:18:23,731][52664] Sum rewards: 73.069, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.081', 'weapon5': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.292', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '59.000'} [2024-08-06 08:18:23,801][52659] DAMAGECOUNT value on done: 952893.0 [2024-08-06 08:18:23,804][52659] Sum rewards: 82.148, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.034', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO3': '0.161', 'AMMO4': '0.172', 'weapon5': '0.192', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.176', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '65.000'} [2024-08-06 08:18:23,827][52671] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:18:24,336][52671] Large shaping reward 2.524 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0)] [2024-08-06 08:18:24,799][52660] DAMAGECOUNT value on done: 974754.0 [2024-08-06 08:18:24,801][52660] Sum rewards: 74.122, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.008', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.151', 'AMMO3': '0.183', 'weapon5': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '61.000'} [2024-08-06 08:18:25,362][52658] DAMAGECOUNT value on done: 965314.0 [2024-08-06 08:18:25,363][52658] Sum rewards: 87.197, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.572', 'AMMO5': '0.016', 'AMMO2': '0.053', 'AMMO3': '0.152', 'weapon4': '0.192', 'weapon5': '0.258', 'AMMO4': '0.267', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.738', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '69.000'} [2024-08-06 08:18:25,606][52820] DAMAGECOUNT value on done: 894189.0 [2024-08-06 08:18:25,610][52820] Sum rewards: 72.064, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.705', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.150', 'AMMO3': '0.185', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '58.000'} [2024-08-06 08:18:26,387][52664] DAMAGECOUNT value on done: 995540.0 [2024-08-06 08:18:26,395][52664] Sum rewards: 69.888, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.815', 'AMMO5': '0.010', 'AMMO2': '0.041', 'AMMO3': '0.173', 'AMMO4': '0.202', 'weapon5': '0.210', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '2.610', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.239', 'FRAGCOUNT': '56.000'} [2024-08-06 08:18:26,457][52795] DAMAGECOUNT value on done: 878954.0 [2024-08-06 08:18:26,458][52795] Sum rewards: 70.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.025', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.078', 'AMMO4': '0.194', 'AMMO3': '0.219', 'weapon5': '0.222', 'weapon2': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '57.000'} [2024-08-06 08:18:26,643][52659] DAMAGECOUNT value on done: 965570.0 [2024-08-06 08:18:26,643][52659] Sum rewards: 81.233, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.153', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.034', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:26,810][52650] Updated weights for policy 0, policy_version 83151 (0.0023) [2024-08-06 08:18:27,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 681172992. Throughput: 0: 4370.3. Samples: 170303410. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:27,794][52567] Avg episode reward: [(0, '77.190')] [2024-08-06 08:18:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083151_681172992.pth... [2024-08-06 08:18:27,846][52660] DAMAGECOUNT value on done: 954612.0 [2024-08-06 08:18:27,848][52660] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.070', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '63.000'} [2024-08-06 08:18:27,945][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082641_676995072.pth [2024-08-06 08:18:28,305][52660] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:18:28,561][52658] DAMAGECOUNT value on done: 965034.0 [2024-08-06 08:18:28,562][52658] Sum rewards: 66.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.970', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.143', 'weapon4': '0.170', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '56.000'} [2024-08-06 08:18:28,863][52820] DAMAGECOUNT value on done: 891405.0 [2024-08-06 08:18:28,865][52820] Sum rewards: 73.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.693', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.130', 'weapon2': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'weapon4': '0.372', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '60.000'} [2024-08-06 08:18:28,913][52664] DAMAGECOUNT value on done: 1005172.0 [2024-08-06 08:18:28,913][52664] Sum rewards: 79.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.024', 'AMMO2': '0.043', 'AMMO3': '0.173', 'AMMO4': '0.214', 'weapon4': '0.224', 'weapon5': '0.228', 'weapon2': '0.244', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '3.032', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:29,703][52795] DAMAGECOUNT value on done: 884782.0 [2024-08-06 08:18:29,704][52795] Sum rewards: 75.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.560', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.049', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.174', 'AMMO3': '0.269', 'WEAPON3': '1.750', 'weapon3': '3.562', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:29,710][52659] DAMAGECOUNT value on done: 957428.0 [2024-08-06 08:18:29,711][52659] Sum rewards: 80.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.708', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.095', 'weapon5': '0.132', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '65.000'} [2024-08-06 08:18:30,558][52669] DAMAGECOUNT value on done: 961138.0 [2024-08-06 08:18:30,558][52669] Sum rewards: 82.058, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.040', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.116', 'weapon5': '0.134', 'AMMO3': '0.152', 'AMMO4': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.496', 'WEAPON3': '0.950', 'weapon3': '3.062', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:30,850][52660] DAMAGECOUNT value on done: 961810.0 [2024-08-06 08:18:30,852][52660] Sum rewards: 74.517, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.283', 'AMMO5': '0.011', 'AMMO2': '0.041', 'AMMO3': '0.141', 'weapon5': '0.162', 'AMMO4': '0.207', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'weapon4': '0.458', 'WEAPON3': '0.900', 'weapon3': '2.844', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.000'} [2024-08-06 08:18:31,297][52658] DAMAGECOUNT value on done: 967565.0 [2024-08-06 08:18:31,299][52658] Sum rewards: 83.510, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.488', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.046', 'AMMO4': '0.160', 'AMMO3': '0.161', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.056', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:31,860][52664] DAMAGECOUNT value on done: 1001052.0 [2024-08-06 08:18:31,860][52664] Sum rewards: 94.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.122', 'weapon5': '0.130', 'AMMO3': '0.196', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '22.119', 'FRAGCOUNT': '77.000'} [2024-08-06 08:18:31,916][52820] DAMAGECOUNT value on done: 891967.0 [2024-08-06 08:18:31,916][52820] Sum rewards: 89.247, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.181', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.178', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.817', 'FRAGCOUNT': '72.000'} [2024-08-06 08:18:32,347][52650] Updated weights for policy 0, policy_version 83161 (0.0015) [2024-08-06 08:18:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 681271296. Throughput: 0: 4354.4. Samples: 170315700. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:32,795][52567] Avg episode reward: [(0, '77.629')] [2024-08-06 08:18:32,854][52795] DAMAGECOUNT value on done: 895723.0 [2024-08-06 08:18:32,856][52795] Sum rewards: 82.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.594', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.147', 'weapon5': '0.178', 'AMMO3': '0.179', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.270', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '65.000'} [2024-08-06 08:18:32,904][52671] DAMAGECOUNT value on done: 966614.0 [2024-08-06 08:18:32,909][52671] Sum rewards: 70.238, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.910', 'AMMO5': '0.015', 'AMMO2': '0.020', 'weapon4': '0.024', 'AMMO4': '0.100', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.798', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '57.000'} [2024-08-06 08:18:33,455][52669] DAMAGECOUNT value on done: 958338.0 [2024-08-06 08:18:33,457][52669] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.034', 'WEAPON4': '0.100', 'weapon5': '0.142', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.245', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '55.500'} [2024-08-06 08:18:33,607][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:18:33,924][52660] DAMAGECOUNT value on done: 958283.0 [2024-08-06 08:18:33,924][52660] Sum rewards: 85.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.038', 'weapon5': '0.090', 'AMMO4': '0.189', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.368', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:33,935][52658] DAMAGECOUNT value on done: 963443.0 [2024-08-06 08:18:33,937][52658] Sum rewards: 64.230, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.383', 'AMMO5': '0.018', 'AMMO2': '0.057', 'AMMO3': '0.185', 'weapon5': '0.232', 'weapon2': '0.238', 'AMMO4': '0.286', 'weapon4': '0.372', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '15.102', 'FRAGCOUNT': '53.000'} [2024-08-06 08:18:34,825][52664] DAMAGECOUNT value on done: 998775.0 [2024-08-06 08:18:34,826][52664] Sum rewards: 55.044, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.820', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon5': '0.092', 'weapon4': '0.116', 'AMMO4': '0.117', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.750', 'HITCOUNT': '2.830', 'weapon3': '3.140', 'DAMAGECOUNT': '14.562', 'FRAGCOUNT': '50.000'} [2024-08-06 08:18:35,066][52820] DAMAGECOUNT value on done: 891878.0 [2024-08-06 08:18:35,071][52820] Sum rewards: 73.849, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.990', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.271', 'weapon2': '0.416', 'WEAPON3': '1.700', 'weapon3': '3.290', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '63.000'} [2024-08-06 08:18:35,927][52669] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:18:36,022][52795] DAMAGECOUNT value on done: 886486.0 [2024-08-06 08:18:36,022][52795] Sum rewards: 94.861, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.855', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.124', 'weapon5': '0.130', 'AMMO3': '0.188', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.336', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '22.677', 'FRAGCOUNT': '76.000'} [2024-08-06 08:18:36,053][52671] DAMAGECOUNT value on done: 973339.0 [2024-08-06 08:18:36,055][52671] Sum rewards: 86.380, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.752', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon2': '0.236', 'weapon5': '0.258', 'AMMO4': '0.277', 'AMMO3': '0.280', 'weapon4': '0.402', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.724', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '73.000'} [2024-08-06 08:18:36,120][52669] DAMAGECOUNT value on done: 969193.0 [2024-08-06 08:18:36,121][52669] Sum rewards: 60.969, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.288', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.166', 'AMMO3': '0.222', 'AMMO4': '0.300', 'weapon5': '0.314', 'weapon2': '0.500', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.656', 'HITCOUNT': '2.760', 'DAMAGECOUNT': '15.108', 'FRAGCOUNT': '52.000'} [2024-08-06 08:18:36,647][52658] DAMAGECOUNT value on done: 956336.0 [2024-08-06 08:18:36,647][52658] Sum rewards: 75.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.816', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.110', 'AMMO4': '0.159', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.476', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.668', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '61.000'} [2024-08-06 08:18:36,773][52650] Updated weights for policy 0, policy_version 83171 (0.0013) [2024-08-06 08:18:37,187][52660] DAMAGECOUNT value on done: 948575.0 [2024-08-06 08:18:37,188][52660] Sum rewards: 75.839, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.602', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '3.066', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '65.500'} [2024-08-06 08:18:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 681345024. Throughput: 0: 4346.2. Samples: 170341850. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:37,794][52567] Avg episode reward: [(0, '77.400')] [2024-08-06 08:18:37,847][52664] DAMAGECOUNT value on done: 1011874.0 [2024-08-06 08:18:37,850][52664] Sum rewards: 73.038, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.890', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.054', 'weapon5': '0.084', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.434', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '58.000'} [2024-08-06 08:18:38,107][52820] DAMAGECOUNT value on done: 899821.0 [2024-08-06 08:18:38,107][52820] Sum rewards: 67.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.690', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.108', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '56.000'} [2024-08-06 08:18:38,616][52669] DAMAGECOUNT value on done: 961312.0 [2024-08-06 08:18:38,625][52669] Sum rewards: 84.368, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.770', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.078', 'weapon5': '0.178', 'AMMO4': '0.208', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.796', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:38,662][52671] DAMAGECOUNT value on done: 966189.0 [2024-08-06 08:18:38,664][52671] Sum rewards: 75.885, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.285', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.052', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.376', 'WEAPON3': '1.450', 'weapon3': '3.370', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:39,203][52795] DAMAGECOUNT value on done: 886214.0 [2024-08-06 08:18:39,206][52795] Sum rewards: 63.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.951', 'AMMO5': '0.007', 'AMMO2': '0.040', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO3': '0.196', 'AMMO4': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.838', 'WEAPON3': '1.250', 'weapon3': '2.708', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '52.000'} [2024-08-06 08:18:39,565][52658] DAMAGECOUNT value on done: 954659.0 [2024-08-06 08:18:39,565][52658] Sum rewards: 81.818, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.120', 'AMMO3': '0.161', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON4': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:40,125][52660] DAMAGECOUNT value on done: 949528.0 [2024-08-06 08:18:40,127][52660] Sum rewards: 58.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.146', 'AMMO4': '0.148', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.400', 'weapon3': '2.900', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '14.739', 'FRAGCOUNT': '49.000'} [2024-08-06 08:18:41,092][52664] DAMAGECOUNT value on done: 1008064.0 [2024-08-06 08:18:41,094][52664] Sum rewards: 67.747, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.891', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.087', 'weapon5': '0.134', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.608', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '54.000'} [2024-08-06 08:18:41,243][52820] DAMAGECOUNT value on done: 900867.0 [2024-08-06 08:18:41,247][52820] Sum rewards: 81.698, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.265', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.018', 'AMMO4': '0.024', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.200', 'AMMO3': '0.212', 'WEAPON3': '1.400', 'weapon3': '3.542', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:41,474][52650] Updated weights for policy 0, policy_version 83181 (0.0012) [2024-08-06 08:18:41,540][52669] DAMAGECOUNT value on done: 970381.0 [2024-08-06 08:18:41,541][52669] Sum rewards: 82.406, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.015', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.042', 'AMMO4': '0.091', 'weapon5': '0.184', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:41,808][52671] DAMAGECOUNT value on done: 971479.0 [2024-08-06 08:18:41,809][52671] Sum rewards: 83.136, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.014', 'AMMO2': '0.016', 'weapon4': '0.038', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'weapon5': '0.194', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '69.000'} [2024-08-06 08:18:42,378][52795] DAMAGECOUNT value on done: 894421.0 [2024-08-06 08:18:42,379][52795] Sum rewards: 72.912, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.118', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.124', 'AMMO4': '0.188', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.252', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '61.000'} [2024-08-06 08:18:42,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17339.9, 300 sec: 17439.2). Total num frames: 681435136. Throughput: 0: 4341.6. Samples: 170367980. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:42,794][52567] Avg episode reward: [(0, '76.677')] [2024-08-06 08:18:42,827][52658] DAMAGECOUNT value on done: 967515.0 [2024-08-06 08:18:42,829][52658] Sum rewards: 76.256, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.356', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO3': '0.185', 'AMMO4': '0.188', 'weapon2': '0.392', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.024', 'FRAGCOUNT': '62.000'} [2024-08-06 08:18:44,109][52664] DAMAGECOUNT value on done: 1007218.0 [2024-08-06 08:18:44,117][52664] Sum rewards: 71.125, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.330', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.043', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.270', 'AMMO3': '0.299', 'WEAPON3': '1.750', 'weapon3': '3.342', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '63.000'} [2024-08-06 08:18:44,370][52820] DAMAGECOUNT value on done: 889459.0 [2024-08-06 08:18:44,373][52820] Sum rewards: 81.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.816', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.138', 'weapon2': '0.190', 'AMMO3': '0.203', 'weapon4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:44,800][52669] DAMAGECOUNT value on done: 967332.0 [2024-08-06 08:18:44,800][52669] Sum rewards: 79.020, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.570', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.134', 'weapon5': '0.142', 'AMMO3': '0.148', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.744', 'WEAPON3': '0.900', 'weapon3': '2.758', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '62.000'} [2024-08-06 08:18:45,001][52671] DAMAGECOUNT value on done: 977923.0 [2024-08-06 08:18:45,001][52671] Sum rewards: 74.590, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.120', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon5': '0.106', 'weapon4': '0.124', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '63.000'} [2024-08-06 08:18:45,272][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:18:45,427][52795] DAMAGECOUNT value on done: 888805.0 [2024-08-06 08:18:45,427][52795] Sum rewards: 72.044, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.909', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.134', 'AMMO3': '0.174', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.154', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '59.000'} [2024-08-06 08:18:45,565][52658] DAMAGECOUNT value on done: 955726.0 [2024-08-06 08:18:45,566][52658] Sum rewards: 83.813, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.990', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.040', 'weapon4': '0.050', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.389', 'FRAGCOUNT': '71.000'} [2024-08-06 08:18:45,966][52650] Updated weights for policy 0, policy_version 83191 (0.0023) [2024-08-06 08:18:46,487][52664] DAMAGECOUNT value on done: 990633.0 [2024-08-06 08:18:46,487][52664] Sum rewards: 72.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.014', 'AMMO5': '0.019', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.148', 'AMMO3': '0.190', 'weapon5': '0.192', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '60.000'} [2024-08-06 08:18:47,474][52671] DAMAGECOUNT value on done: 965143.0 [2024-08-06 08:18:47,478][52671] Sum rewards: 69.908, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.601', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon4': '0.172', 'weapon5': '0.180', 'AMMO3': '0.263', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '60.000'} [2024-08-06 08:18:47,483][52669] DAMAGECOUNT value on done: 968022.0 [2024-08-06 08:18:47,486][52669] Sum rewards: 83.957, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.158', 'AMMO3': '0.198', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON4': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '67.000'} [2024-08-06 08:18:47,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 681525248. Throughput: 0: 4341.8. Samples: 170381080. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:18:47,795][52567] Avg episode reward: [(0, '76.435')] [2024-08-06 08:18:48,416][52658] DAMAGECOUNT value on done: 982679.0 [2024-08-06 08:18:48,418][52658] Sum rewards: 70.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.776', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.084', 'AMMO3': '0.163', 'weapon4': '0.168', 'AMMO4': '0.175', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.290', 'weapon3': '3.302', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '56.000'} [2024-08-06 08:18:48,620][52795] DAMAGECOUNT value on done: 881476.0 [2024-08-06 08:18:48,620][52795] Sum rewards: 79.389, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.163', 'AMMO3': '0.176', 'weapon4': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.530', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:49,544][52664] DAMAGECOUNT value on done: 994208.0 [2024-08-06 08:18:49,546][52664] Sum rewards: 80.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.126', 'weapon2': '0.172', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.616', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:50,513][52671] DAMAGECOUNT value on done: 967666.0 [2024-08-06 08:18:50,517][52671] Sum rewards: 82.212, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.068', 'AMMO4': '0.146', 'AMMO3': '0.183', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:50,515][52669] DAMAGECOUNT value on done: 966582.0 [2024-08-06 08:18:50,525][52669] Sum rewards: 74.266, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.885', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.098', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.184', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.074', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '64.500'} [2024-08-06 08:18:50,845][52658] DAMAGECOUNT value on done: 969113.0 [2024-08-06 08:18:50,845][52658] Sum rewards: 73.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon5': '0.048', 'AMMO4': '0.073', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.446', 'WEAPON3': '1.300', 'weapon3': '3.020', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 08:18:50,892][52650] Updated weights for policy 0, policy_version 83201 (0.0014) [2024-08-06 08:18:51,636][52795] DAMAGECOUNT value on done: 886887.0 [2024-08-06 08:18:51,637][52795] Sum rewards: 65.582, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.094', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.072', 'weapon5': '0.210', 'AMMO4': '0.231', 'AMMO3': '0.241', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '56.500'} [2024-08-06 08:18:52,402][52664] DAMAGECOUNT value on done: 1005309.0 [2024-08-06 08:18:52,403][52664] Sum rewards: 80.946, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.710', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO3': '0.182', 'AMMO4': '0.189', 'weapon5': '0.274', 'weapon2': '0.292', 'weapon4': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.766', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '64.000'} [2024-08-06 08:18:52,679][52663] DAMAGECOUNT value on done: 979722.0 [2024-08-06 08:18:52,680][52663] Sum rewards: 78.253, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.738', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.080', 'AMMO4': '0.101', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon2': '0.478', 'WEAPON3': '1.000', 'weapon3': '3.168', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '62.000'} [2024-08-06 08:18:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 681615360. Throughput: 0: 4345.8. Samples: 170407350. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:18:52,794][52567] Avg episode reward: [(0, '76.465')] [2024-08-06 08:18:53,317][52669] DAMAGECOUNT value on done: 975762.0 [2024-08-06 08:18:53,318][52669] Sum rewards: 64.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.605', 'AMMO5': '0.020', 'AMMO2': '0.053', 'AMMO3': '0.165', 'weapon4': '0.168', 'weapon2': '0.190', 'weapon5': '0.248', 'AMMO4': '0.266', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.118', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '52.500'} [2024-08-06 08:18:53,486][52671] DAMAGECOUNT value on done: 972493.0 [2024-08-06 08:18:53,488][52671] Sum rewards: 74.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.668', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '3.126', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '60.000'} [2024-08-06 08:18:53,689][52658] DAMAGECOUNT value on done: 974463.0 [2024-08-06 08:18:53,689][52658] Sum rewards: 88.479, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.088', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon4': '0.276', 'weapon2': '0.408', 'WEAPON3': '1.050', 'weapon3': '2.972', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '70.000'} [2024-08-06 08:18:54,667][52795] DAMAGECOUNT value on done: 891828.0 [2024-08-06 08:18:54,676][52795] Sum rewards: 80.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.290', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.076', 'AMMO4': '0.171', 'AMMO3': '0.181', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.708', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '65.000'} [2024-08-06 08:18:54,896][52664] DAMAGECOUNT value on done: 990088.0 [2024-08-06 08:18:54,898][52664] Sum rewards: 83.076, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.900', 'AMMO2': '0.002', 'AMMO4': '0.010', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.224', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.398', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '70.000'} [2024-08-06 08:18:55,287][52663] DAMAGECOUNT value on done: 963417.0 [2024-08-06 08:18:55,289][52663] Sum rewards: 82.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.274', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.060', 'AMMO4': '0.069', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '68.000'} [2024-08-06 08:18:55,763][52650] Updated weights for policy 0, policy_version 83211 (0.0025) [2024-08-06 08:18:55,899][52669] DAMAGECOUNT value on done: 966407.0 [2024-08-06 08:18:55,904][52669] Sum rewards: 62.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon5': '0.112', 'weapon4': '0.170', 'AMMO4': '0.195', 'AMMO3': '0.238', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.684', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '15.657', 'FRAGCOUNT': '53.000'} [2024-08-06 08:18:56,506][52671] DAMAGECOUNT value on done: 953495.0 [2024-08-06 08:18:56,508][52671] Sum rewards: 77.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.640', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'AMMO3': '0.254', 'weapon2': '0.468', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:56,886][52658] DAMAGECOUNT value on done: 959753.0 [2024-08-06 08:18:56,887][52658] Sum rewards: 70.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.804', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.040', 'weapon5': '0.126', 'AMMO4': '0.164', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.510', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '59.000'} [2024-08-06 08:18:57,728][52795] DAMAGECOUNT value on done: 879346.0 [2024-08-06 08:18:57,730][52795] Sum rewards: 74.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.564', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.160', 'AMMO3': '0.215', 'weapon2': '0.272', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '60.000'} [2024-08-06 08:18:57,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 681697280. Throughput: 0: 4365.8. Samples: 170433990. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:18:57,795][52567] Avg episode reward: [(0, '76.531')] [2024-08-06 08:18:58,369][52663] DAMAGECOUNT value on done: 958394.0 [2024-08-06 08:18:58,371][52663] Sum rewards: 77.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.091', 'AMMO5': '0.013', 'weapon4': '0.040', 'AMMO2': '0.044', 'weapon5': '0.114', 'AMMO4': '0.221', 'AMMO3': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.326', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '65.000'} [2024-08-06 08:18:58,956][52669] DAMAGECOUNT value on done: 972814.0 [2024-08-06 08:18:58,956][52669] Sum rewards: 62.419, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.810', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.160', 'AMMO3': '0.185', 'weapon5': '0.188', 'AMMO4': '0.232', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.124', 'DAMAGECOUNT': '15.543', 'FRAGCOUNT': '50.000'} [2024-08-06 08:18:59,371][52671] DAMAGECOUNT value on done: 968028.0 [2024-08-06 08:18:59,372][52671] Sum rewards: 78.243, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.066', 'AMMO4': '0.088', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon2': '0.228', 'AMMO3': '0.286', 'WEAPON3': '1.650', 'weapon3': '3.432', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '66.000'} [2024-08-06 08:18:59,849][52658] DAMAGECOUNT value on done: 974095.0 [2024-08-06 08:18:59,858][52658] Sum rewards: 83.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.037', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.046', 'AMMO4': '0.096', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.254', 'WEAPON3': '1.650', 'weapon3': '3.368', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.324', 'FRAGCOUNT': '69.000'} [2024-08-06 08:19:00,174][52650] Updated weights for policy 0, policy_version 83221 (0.0020) [2024-08-06 08:19:01,048][52795] DAMAGECOUNT value on done: 888141.0 [2024-08-06 08:19:01,048][52795] Sum rewards: 71.047, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.148', 'AMMO3': '0.155', 'weapon4': '0.370', 'HEALTH': '0.565', 'WEAPON3': '0.850', 'HITCOUNT': '3.130', 'weapon3': '3.198', 'DAMAGECOUNT': '14.994', 'FRAGCOUNT': '57.000'} [2024-08-06 08:19:01,558][52663] DAMAGECOUNT value on done: 965476.0 [2024-08-06 08:19:01,559][52663] Sum rewards: 83.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.008', 'weapon4': '0.012', 'AMMO2': '0.030', 'WEAPON4': '0.050', 'weapon5': '0.144', 'AMMO4': '0.151', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.320', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '68.000'} [2024-08-06 08:19:02,078][52671] DAMAGECOUNT value on done: 966621.0 [2024-08-06 08:19:02,079][52671] Sum rewards: 85.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.074', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.174', 'AMMO3': '0.194', 'AMMO4': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'weapon4': '0.490', 'WEAPON3': '1.150', 'weapon3': '2.556', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '68.000'} [2024-08-06 08:19:02,290][52669] DAMAGECOUNT value on done: 973309.0 [2024-08-06 08:19:02,291][52669] Sum rewards: 77.925, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.560', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.124', 'weapon5': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.253', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.3, 300 sec: 17439.2). Total num frames: 681787392. Throughput: 0: 4364.7. Samples: 170447180. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:02,794][52567] Avg episode reward: [(0, '76.487')] [2024-08-06 08:19:03,112][52658] DAMAGECOUNT value on done: 961120.0 [2024-08-06 08:19:03,115][52658] Sum rewards: 80.381, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.422', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.094', 'AMMO3': '0.254', 'AMMO4': '0.277', 'weapon5': '0.284', 'weapon2': '0.418', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.932', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '66.500'} [2024-08-06 08:19:04,213][52795] DAMAGECOUNT value on done: 890178.0 [2024-08-06 08:19:04,214][52795] Sum rewards: 80.913, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.142', 'weapon5': '0.142', 'AMMO4': '0.194', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.626', 'WEAPON3': '1.600', 'weapon3': '2.804', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '69.000'} [2024-08-06 08:19:04,585][52671] DAMAGECOUNT value on done: 965752.0 [2024-08-06 08:19:04,586][52671] Sum rewards: 62.302, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.280', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.180', 'weapon5': '0.196', 'weapon4': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'ARMOR': '0.474', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '2.438', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '14.769', 'FRAGCOUNT': '51.000'} [2024-08-06 08:19:04,675][52650] Updated weights for policy 0, policy_version 83231 (0.0027) [2024-08-06 08:19:04,812][52663] DAMAGECOUNT value on done: 963005.0 [2024-08-06 08:19:04,814][52663] Sum rewards: 69.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.054', 'weapon5': '0.114', 'AMMO4': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.336', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '57.000'} [2024-08-06 08:19:05,290][52669] DAMAGECOUNT value on done: 960087.0 [2024-08-06 08:19:05,298][52669] Sum rewards: 79.631, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.343', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.106', 'AMMO4': '0.148', 'weapon5': '0.172', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '68.000'} [2024-08-06 08:19:06,331][52658] DAMAGECOUNT value on done: 966646.0 [2024-08-06 08:19:06,331][52658] Sum rewards: 78.685, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.163', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.080', 'AMMO4': '0.181', 'weapon5': '0.204', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '66.000'} [2024-08-06 08:19:06,429][52794] DAMAGECOUNT value on done: 959523.0 [2024-08-06 08:19:06,429][52794] Sum rewards: 66.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.372', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.125', 'weapon5': '0.132', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'weapon3': '3.404', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:07,322][52795] DAMAGECOUNT value on done: 876308.0 [2024-08-06 08:19:07,322][52795] Sum rewards: 68.413, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.290', 'AMMO2': '0.007', 'AMMO5': '0.012', 'weapon4': '0.014', 'AMMO4': '0.036', 'WEAPON4': '0.050', 'weapon5': '0.052', 'AMMO3': '0.155', 'WEAPON5': '0.250', 'weapon2': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '3.190', 'weapon3': '3.256', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:07,484][52671] DAMAGECOUNT value on done: 967736.0 [2024-08-06 08:19:07,484][52671] Sum rewards: 78.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.134', 'AMMO3': '0.195', 'AMMO4': '0.206', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '63.000'} [2024-08-06 08:19:07,626][52663] DAMAGECOUNT value on done: 970876.0 [2024-08-06 08:19:07,626][52663] Sum rewards: 61.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon5': '0.124', 'AMMO4': '0.126', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.134', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.449', 'FRAGCOUNT': '50.000'} [2024-08-06 08:19:07,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 681877504. Throughput: 0: 4363.3. Samples: 170473230. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:07,794][52567] Avg episode reward: [(0, '76.120')] [2024-08-06 08:19:08,437][52669] DAMAGECOUNT value on done: 960941.0 [2024-08-06 08:19:08,438][52669] Sum rewards: 89.103, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.725', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.090', 'weapon5': '0.184', 'AMMO3': '0.228', 'AMMO4': '0.238', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.576', 'FRAGCOUNT': '74.000'} [2024-08-06 08:19:08,821][52658] DAMAGECOUNT value on done: 950955.0 [2024-08-06 08:19:08,822][52658] Sum rewards: 82.243, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.038', 'weapon4': '0.048', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '67.000'} [2024-08-06 08:19:09,492][52794] DAMAGECOUNT value on done: 967922.0 [2024-08-06 08:19:09,493][52794] Sum rewards: 83.828, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.575', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.025', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.486', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '70.000'} [2024-08-06 08:19:09,505][52650] Updated weights for policy 0, policy_version 83241 (0.0022) [2024-08-06 08:19:10,240][52671] DAMAGECOUNT value on done: 969059.0 [2024-08-06 08:19:10,242][52671] Sum rewards: 80.850, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.594', 'AMMO5': '0.026', 'AMMO2': '0.072', 'weapon4': '0.136', 'weapon5': '0.220', 'AMMO3': '0.287', 'AMMO4': '0.358', 'weapon2': '0.394', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.950', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.541', 'FRAGCOUNT': '68.500'} [2024-08-06 08:19:10,421][52795] DAMAGECOUNT value on done: 886349.0 [2024-08-06 08:19:10,432][52795] Sum rewards: 77.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.412', 'AMMO5': '0.015', 'AMMO2': '0.051', 'AMMO3': '0.152', 'AMMO4': '0.255', 'weapon5': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.364', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.458', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:10,773][52663] DAMAGECOUNT value on done: 963417.0 [2024-08-06 08:19:10,774][52663] Sum rewards: 72.411, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.834', 'AMMO5': '0.023', 'AMMO2': '0.060', 'weapon5': '0.208', 'AMMO3': '0.255', 'weapon2': '0.264', 'AMMO4': '0.300', 'weapon4': '0.424', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.788', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '64.000'} [2024-08-06 08:19:11,295][52669] DAMAGECOUNT value on done: 969384.0 [2024-08-06 08:19:11,296][52669] Sum rewards: 75.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.096', 'AMMO3': '0.207', 'weapon5': '0.208', 'AMMO4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.374', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '61.000'} [2024-08-06 08:19:11,995][52658] DAMAGECOUNT value on done: 966672.0 [2024-08-06 08:19:11,997][52658] Sum rewards: 83.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.104', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.083', 'WEAPON5': '0.100', 'weapon4': '0.174', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'weapon2': '0.358', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '70.000'} [2024-08-06 08:19:12,528][52794] DAMAGECOUNT value on done: 972937.0 [2024-08-06 08:19:12,530][52794] Sum rewards: 77.522, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.492', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO3': '0.157', 'AMMO4': '0.160', 'weapon5': '0.168', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon4': '0.426', 'WEAPON3': '1.050', 'weapon3': '2.842', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 681959424. Throughput: 0: 4358.7. Samples: 170499550. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:12,794][52567] Avg episode reward: [(0, '76.227')] [2024-08-06 08:19:13,260][52671] DAMAGECOUNT value on done: 952646.0 [2024-08-06 08:19:13,260][52671] Sum rewards: 89.117, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.372', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.080', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '73.000'} [2024-08-06 08:19:13,291][52663] DAMAGECOUNT value on done: 946932.0 [2024-08-06 08:19:13,292][52663] Sum rewards: 74.184, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.108', 'weapon4': '0.114', 'AMMO3': '0.205', 'AMMO4': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:13,585][52795] DAMAGECOUNT value on done: 893411.0 [2024-08-06 08:19:13,585][52795] Sum rewards: 73.496, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.509', 'AMMO5': '0.028', 'AMMO2': '0.080', 'weapon4': '0.150', 'AMMO3': '0.259', 'weapon2': '0.312', 'weapon5': '0.320', 'AMMO4': '0.402', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'WEAPON3': '1.500', 'weapon3': '2.906', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:13,715][52669] DAMAGECOUNT value on done: 987976.0 [2024-08-06 08:19:13,716][52669] Sum rewards: 70.537, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.046', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon2': '0.272', 'WEAPON3': '1.150', 'HITCOUNT': '3.490', 'weapon3': '3.504', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:14,352][52650] Updated weights for policy 0, policy_version 83251 (0.0027) [2024-08-06 08:19:14,703][52658] DAMAGECOUNT value on done: 962498.0 [2024-08-06 08:19:14,705][52658] Sum rewards: 86.777, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.537', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.120', 'AMMO4': '0.162', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.420', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '70.000'} [2024-08-06 08:19:15,357][52794] DAMAGECOUNT value on done: 958907.0 [2024-08-06 08:19:15,358][52794] Sum rewards: 80.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.087', 'weapon4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.556', 'WEAPON3': '1.350', 'weapon3': '3.070', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '67.000'} [2024-08-06 08:19:15,604][52663] DAMAGECOUNT value on done: 959933.0 [2024-08-06 08:19:15,612][52663] Sum rewards: 79.551, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.160', 'AMMO5': '0.006', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.094', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'weapon4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.194', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:16,014][52669] DAMAGECOUNT value on done: 974819.0 [2024-08-06 08:19:16,015][52669] Sum rewards: 73.881, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.116', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.710', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '59.000'} [2024-08-06 08:19:16,418][52671] DAMAGECOUNT value on done: 979005.0 [2024-08-06 08:19:16,419][52671] Sum rewards: 71.911, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.346', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.036', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.380', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '61.000'} [2024-08-06 08:19:17,468][52660] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:19:17,704][52658] DAMAGECOUNT value on done: 957954.0 [2024-08-06 08:19:17,704][52658] Sum rewards: 82.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.951', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.128', 'AMMO4': '0.162', 'weapon5': '0.180', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.130', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '66.000'} [2024-08-06 08:19:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 682057728. Throughput: 0: 4371.6. Samples: 170512420. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:17,794][52567] Avg episode reward: [(0, '76.428')] [2024-08-06 08:19:18,330][52794] DAMAGECOUNT value on done: 954261.0 [2024-08-06 08:19:18,331][52794] Sum rewards: 79.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.209', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:18,496][52663] DAMAGECOUNT value on done: 959651.0 [2024-08-06 08:19:18,496][52663] Sum rewards: 62.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.775', 'AMMO5': '0.023', 'AMMO2': '0.057', 'AMMO3': '0.170', 'weapon5': '0.214', 'weapon4': '0.220', 'AMMO4': '0.283', 'weapon2': '0.426', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '51.000'} [2024-08-06 08:19:18,961][52650] Updated weights for policy 0, policy_version 83261 (0.0011) [2024-08-06 08:19:19,090][52669] DAMAGECOUNT value on done: 973713.0 [2024-08-06 08:19:19,092][52669] Sum rewards: 88.650, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.009', 'AMMO2': '0.036', 'HEALTH': '0.110', 'weapon4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.163', 'AMMO4': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.334', 'WEAPON3': '0.950', 'weapon3': '3.246', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '69.000'} [2024-08-06 08:19:19,470][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:19:19,814][52671] DAMAGECOUNT value on done: 975733.0 [2024-08-06 08:19:19,815][52671] Sum rewards: 90.478, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.046', 'AMMO4': '0.125', 'weapon5': '0.130', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.289', 'WEAPON3': '1.750', 'weapon3': '3.318', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.972', 'FRAGCOUNT': '78.000'} [2024-08-06 08:19:20,720][52658] DAMAGECOUNT value on done: 965760.0 [2024-08-06 08:19:20,728][52658] Sum rewards: 75.636, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.893', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON4': '0.100', 'AMMO3': '0.154', 'weapon4': '0.168', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.244', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '59.000'} [2024-08-06 08:19:20,779][52794] DAMAGECOUNT value on done: 957686.0 [2024-08-06 08:19:20,780][52794] Sum rewards: 73.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.487', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.261', 'weapon2': '0.460', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '63.000'} [2024-08-06 08:19:21,324][52663] DAMAGECOUNT value on done: 967335.0 [2024-08-06 08:19:21,325][52663] Sum rewards: 66.908, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.865', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.124', 'weapon4': '0.160', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.100', 'weapon3': '2.924', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '55.000'} [2024-08-06 08:19:21,432][52811] DAMAGECOUNT value on done: 910713.0 [2024-08-06 08:19:21,432][52811] Sum rewards: 67.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.182', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.086', 'AMMO3': '0.192', 'AMMO4': '0.201', 'weapon5': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.648', 'WEAPON3': '1.050', 'weapon3': '2.786', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '55.000'} [2024-08-06 08:19:21,946][52669] DAMAGECOUNT value on done: 977188.0 [2024-08-06 08:19:21,946][52669] Sum rewards: 79.200, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.320', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.080', 'AMMO4': '0.131', 'weapon4': '0.158', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.580', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '63.000'} [2024-08-06 08:19:22,432][52671] DAMAGECOUNT value on done: 967743.0 [2024-08-06 08:19:22,434][52671] Sum rewards: 72.631, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.896', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.108', 'AMMO3': '0.151', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.250', 'weapon2': '0.638', 'WEAPON3': '0.900', 'weapon3': '2.854', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '58.000'} [2024-08-06 08:19:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 682139648. Throughput: 0: 4370.2. Samples: 170538510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:22,794][52567] Avg episode reward: [(0, '75.995')] [2024-08-06 08:19:23,364][52794] DAMAGECOUNT value on done: 962437.0 [2024-08-06 08:19:23,364][52794] Sum rewards: 70.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.095', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon4': '0.138', 'weapon5': '0.210', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.082', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '60.000'} [2024-08-06 08:19:23,568][52650] Updated weights for policy 0, policy_version 83271 (0.0022) [2024-08-06 08:19:24,143][52663] DAMAGECOUNT value on done: 951621.0 [2024-08-06 08:19:24,143][52663] Sum rewards: 87.535, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.010', 'AMMO2': '0.029', 'HEALTH': '0.095', 'AMMO3': '0.133', 'AMMO4': '0.143', 'weapon5': '0.184', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '0.800', 'weapon3': '3.164', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '67.000'} [2024-08-06 08:19:24,492][52669] DAMAGECOUNT value on done: 979485.0 [2024-08-06 08:19:24,494][52669] Sum rewards: 74.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.031', 'AMMO5': '0.028', 'AMMO2': '0.061', 'AMMO3': '0.175', 'weapon5': '0.254', 'AMMO4': '0.305', 'weapon4': '0.308', 'weapon2': '0.422', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.000', 'weapon3': '2.702', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '59.500'} [2024-08-06 08:19:24,757][52811] DAMAGECOUNT value on done: 895657.0 [2024-08-06 08:19:24,757][52811] Sum rewards: 73.220, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.081', 'AMMO3': '0.104', 'HEALTH': '0.112', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.510', 'WEAPON3': '0.650', 'HITCOUNT': '3.120', 'weapon3': '3.142', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:25,482][52671] DAMAGECOUNT value on done: 973618.0 [2024-08-06 08:19:25,484][52671] Sum rewards: 78.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.226', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.386', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '67.000'} [2024-08-06 08:19:25,526][52614] Signal inference workers to stop experience collection... (15250 times) [2024-08-06 08:19:25,528][52614] Signal inference workers to resume experience collection... (15250 times) [2024-08-06 08:19:25,583][52650] InferenceWorker_p0-w0: stopping experience collection (15250 times) [2024-08-06 08:19:25,583][52650] InferenceWorker_p0-w0: resuming experience collection (15250 times) [2024-08-06 08:19:26,550][52794] DAMAGECOUNT value on done: 950922.0 [2024-08-06 08:19:26,550][52794] Sum rewards: 78.470, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.168', 'weapon4': '0.176', 'AMMO4': '0.209', 'AMMO3': '0.261', 'weapon2': '0.348', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:26,990][52663] DAMAGECOUNT value on done: 948729.0 [2024-08-06 08:19:26,993][52663] Sum rewards: 82.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.206', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.100', 'AMMO4': '0.207', 'AMMO3': '0.214', 'weapon5': '0.238', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.034', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '68.000'} [2024-08-06 08:19:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 682221568. Throughput: 0: 4375.6. Samples: 170564880. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:27,794][52567] Avg episode reward: [(0, '76.468')] [2024-08-06 08:19:27,807][52811] DAMAGECOUNT value on done: 890040.0 [2024-08-06 08:19:27,809][52811] Sum rewards: 71.102, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.845', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.138', 'AMMO3': '0.151', 'weapon4': '0.176', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.000', 'weapon3': '3.094', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:28,178][52671] DAMAGECOUNT value on done: 955910.0 [2024-08-06 08:19:28,178][52671] Sum rewards: 64.602, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.634', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.098', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.428', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.160', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '55.000'} [2024-08-06 08:19:28,288][52650] Updated weights for policy 0, policy_version 83281 (0.0011) [2024-08-06 08:19:29,700][52794] DAMAGECOUNT value on done: 965146.0 [2024-08-06 08:19:29,702][52794] Sum rewards: 76.968, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.404', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.096', 'AMMO4': '0.244', 'weapon5': '0.246', 'AMMO3': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:30,032][52663] DAMAGECOUNT value on done: 959174.0 [2024-08-06 08:19:30,033][52663] Sum rewards: 86.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.992', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.042', 'weapon4': '0.064', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.442', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.823', 'FRAGCOUNT': '71.000'} [2024-08-06 08:19:31,004][52811] DAMAGECOUNT value on done: 895813.0 [2024-08-06 08:19:31,005][52811] Sum rewards: 84.012, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.870', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.218', 'weapon4': '0.346', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '66.000'} [2024-08-06 08:19:32,086][52794] DAMAGECOUNT value on done: 961628.0 [2024-08-06 08:19:32,088][52794] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.909', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.064', 'AMMO4': '0.107', 'weapon5': '0.126', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.556', 'FRAGCOUNT': '60.000'} [2024-08-06 08:19:32,495][52663] DAMAGECOUNT value on done: 960485.0 [2024-08-06 08:19:32,497][52663] Sum rewards: 72.674, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.060', 'AMMO5': '0.012', 'AMMO2': '0.059', 'weapon4': '0.062', 'AMMO3': '0.154', 'weapon5': '0.164', 'AMMO4': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 682311680. Throughput: 0: 4376.9. Samples: 170578040. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:32,794][52567] Avg episode reward: [(0, '76.419')] [2024-08-06 08:19:32,824][52650] Updated weights for policy 0, policy_version 83291 (0.0011) [2024-08-06 08:19:34,093][52811] DAMAGECOUNT value on done: 899665.0 [2024-08-06 08:19:34,093][52811] Sum rewards: 82.604, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.537', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'AMMO3': '0.232', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '69.000'} [2024-08-06 08:19:35,126][52794] DAMAGECOUNT value on done: 952055.0 [2024-08-06 08:19:35,127][52794] Sum rewards: 66.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.834', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon2': '0.156', 'weapon4': '0.186', 'weapon5': '0.216', 'AMMO4': '0.225', 'AMMO3': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'HITCOUNT': '3.030', 'weapon3': '3.152', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '57.000'} [2024-08-06 08:19:35,170][52663] DAMAGECOUNT value on done: 963860.0 [2024-08-06 08:19:35,172][52663] Sum rewards: 73.283, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.080', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.102', 'weapon5': '0.140', 'AMMO4': '0.173', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '59.000'} [2024-08-06 08:19:37,103][52811] DAMAGECOUNT value on done: 915454.0 [2024-08-06 08:19:37,104][52811] Sum rewards: 91.777, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.443', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO4': '0.122', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.009', 'FRAGCOUNT': '73.000'} [2024-08-06 08:19:37,583][52794] DAMAGECOUNT value on done: 967852.0 [2024-08-06 08:19:37,583][52794] Sum rewards: 74.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.133', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.328', 'WEAPON3': '1.600', 'weapon3': '3.260', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '63.000'} [2024-08-06 08:19:37,683][52650] Updated weights for policy 0, policy_version 83301 (0.0014) [2024-08-06 08:19:37,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 682401792. Throughput: 0: 4374.2. Samples: 170604190. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:19:37,795][52567] Avg episode reward: [(0, '76.662')] [2024-08-06 08:19:38,368][52663] DAMAGECOUNT value on done: 961067.0 [2024-08-06 08:19:38,369][52663] Sum rewards: 62.575, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.846', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.120', 'weapon5': '0.138', 'AMMO4': '0.198', 'weapon2': '0.276', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '54.000'} [2024-08-06 08:19:39,752][52670] DAMAGECOUNT value on done: 947794.0 [2024-08-06 08:19:39,753][52670] Sum rewards: 71.628, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.154', 'weapon5': '0.170', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.608', 'WEAPON3': '1.450', 'weapon3': '2.862', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:40,202][52811] DAMAGECOUNT value on done: 906058.0 [2024-08-06 08:19:40,204][52811] Sum rewards: 84.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.885', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.074', 'AMMO4': '0.115', 'weapon4': '0.152', 'AMMO3': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.492', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.535', 'FRAGCOUNT': '70.000'} [2024-08-06 08:19:40,483][52794] DAMAGECOUNT value on done: 962218.0 [2024-08-06 08:19:40,483][52794] Sum rewards: 72.067, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.454', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.232', 'weapon2': '0.260', 'AMMO3': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:40,993][52663] DAMAGECOUNT value on done: 969191.0 [2024-08-06 08:19:40,993][52663] Sum rewards: 72.467, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.056', 'AMMO4': '0.188', 'weapon5': '0.208', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'WEAPON5': '0.300', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '60.000'} [2024-08-06 08:19:42,325][52650] Updated weights for policy 0, policy_version 83311 (0.0031) [2024-08-06 08:19:42,622][52670] DAMAGECOUNT value on done: 967141.0 [2024-08-06 08:19:42,623][52670] Sum rewards: 60.970, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.036', 'weapon4': '0.104', 'AMMO4': '0.140', 'weapon2': '0.144', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.278', 'DAMAGECOUNT': '15.531', 'FRAGCOUNT': '54.000'} [2024-08-06 08:19:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 682483712. Throughput: 0: 4364.2. Samples: 170630380. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:19:42,795][52567] Avg episode reward: [(0, '76.267')] [2024-08-06 08:19:43,088][52794] DAMAGECOUNT value on done: 973891.0 [2024-08-06 08:19:43,088][52794] Sum rewards: 80.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.405', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.118', 'AMMO3': '0.233', 'AMMO4': '0.241', 'weapon5': '0.242', 'weapon2': '0.322', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.066', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '67.000'} [2024-08-06 08:19:43,412][52811] DAMAGECOUNT value on done: 892364.0 [2024-08-06 08:19:43,412][52811] Sum rewards: 89.799, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.094', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.402', 'FRAGCOUNT': '72.000'} [2024-08-06 08:19:44,117][52663] DAMAGECOUNT value on done: 975021.0 [2024-08-06 08:19:44,118][52663] Sum rewards: 78.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.084', 'weapon5': '0.118', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.226', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:45,388][52670] DAMAGECOUNT value on done: 948701.0 [2024-08-06 08:19:45,389][52670] Sum rewards: 67.848, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.626', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.070', 'AMMO3': '0.183', 'AMMO4': '0.184', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.376', 'WEAPON3': '1.050', 'weapon3': '3.144', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '15.732', 'FRAGCOUNT': '57.000'} [2024-08-06 08:19:46,191][52794] DAMAGECOUNT value on done: 955484.0 [2024-08-06 08:19:46,194][52794] Sum rewards: 87.612, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.531', 'AMMO5': '0.022', 'AMMO2': '0.060', 'AMMO3': '0.168', 'weapon4': '0.206', 'weapon5': '0.252', 'AMMO4': '0.300', 'weapon2': '0.346', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.890', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '22.029', 'FRAGCOUNT': '70.500'} [2024-08-06 08:19:46,377][52663] DAMAGECOUNT value on done: 953245.0 [2024-08-06 08:19:46,377][52663] Sum rewards: 88.679, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.300', 'weapon3': '3.192', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.282', 'FRAGCOUNT': '74.000'} [2024-08-06 08:19:46,519][52811] DAMAGECOUNT value on done: 900755.0 [2024-08-06 08:19:46,520][52811] Sum rewards: 69.144, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.417', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.068', 'AMMO3': '0.163', 'weapon2': '0.888', 'WEAPON3': '1.050', 'weapon3': '2.880', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '55.000'} [2024-08-06 08:19:46,600][52666] DAMAGECOUNT value on done: 961477.0 [2024-08-06 08:19:46,601][52666] Sum rewards: 63.017, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.178', 'AMMO3': '0.191', 'weapon2': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.416', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '14.493', 'FRAGCOUNT': '52.000'} [2024-08-06 08:19:46,940][52650] Updated weights for policy 0, policy_version 83321 (0.0012) [2024-08-06 08:19:46,965][52820] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.543, 181.0)] [2024-08-06 08:19:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 682573824. Throughput: 0: 4359.3. Samples: 170643350. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:19:47,794][52567] Avg episode reward: [(0, '76.334')] [2024-08-06 08:19:47,927][52670] DAMAGECOUNT value on done: 952118.0 [2024-08-06 08:19:47,927][52670] Sum rewards: 83.092, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.116', 'weapon5': '0.124', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '69.000'} [2024-08-06 08:19:49,233][52666] DAMAGECOUNT value on done: 960792.0 [2024-08-06 08:19:49,234][52666] Sum rewards: 79.969, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.092', 'WEAPON5': '0.150', 'weapon4': '0.184', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '68.000'} [2024-08-06 08:19:49,277][52794] DAMAGECOUNT value on done: 967355.0 [2024-08-06 08:19:49,277][52794] Sum rewards: 76.398, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.138', 'weapon5': '0.142', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.322', 'WEAPON3': '1.000', 'weapon3': '3.192', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '59.000'} [2024-08-06 08:19:49,643][52811] DAMAGECOUNT value on done: 900682.0 [2024-08-06 08:19:49,645][52811] Sum rewards: 80.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.732', 'AMMO2': '0.011', 'AMMO4': '0.054', 'AMMO3': '0.231', 'weapon2': '0.238', 'WEAPON3': '1.350', 'weapon3': '3.596', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '67.000'} [2024-08-06 08:19:50,614][52670] DAMAGECOUNT value on done: 964053.0 [2024-08-06 08:19:50,616][52670] Sum rewards: 86.439, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.890', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.005', 'AMMO4': '0.027', 'WEAPON5': '0.100', 'AMMO3': '0.268', 'weapon2': '0.402', 'WEAPON3': '1.650', 'weapon3': '3.398', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '73.000'} [2024-08-06 08:19:51,475][52650] Updated weights for policy 0, policy_version 83331 (0.0013) [2024-08-06 08:19:52,143][52666] DAMAGECOUNT value on done: 965833.0 [2024-08-06 08:19:52,144][52666] Sum rewards: 75.335, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO4': '0.223', 'weapon5': '0.234', 'AMMO3': '0.236', 'weapon4': '0.260', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.902', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:52,504][52794] DAMAGECOUNT value on done: 962261.0 [2024-08-06 08:19:52,505][52794] Sum rewards: 68.178, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.064', 'weapon5': '0.196', 'AMMO4': '0.218', 'AMMO3': '0.240', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.976', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '59.000'} [2024-08-06 08:19:52,579][52811] DAMAGECOUNT value on done: 904953.0 [2024-08-06 08:19:52,581][52811] Sum rewards: 76.771, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.299', 'AMMO5': '0.015', 'AMMO2': '0.044', 'AMMO3': '0.148', 'AMMO4': '0.221', 'weapon4': '0.224', 'weapon5': '0.282', 'weapon2': '0.376', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.878', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '59.000'} [2024-08-06 08:19:52,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 682655744. Throughput: 0: 4362.0. Samples: 170669520. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:19:52,802][52567] Avg episode reward: [(0, '76.640')] [2024-08-06 08:19:53,288][52647] DAMAGECOUNT value on done: 1029009.0 [2024-08-06 08:19:53,289][52647] Sum rewards: 78.769, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.131', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.244', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:53,575][52670] DAMAGECOUNT value on done: 952439.0 [2024-08-06 08:19:53,576][52670] Sum rewards: 81.141, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.340', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.145', 'weapon5': '0.174', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.106', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '67.000'} [2024-08-06 08:19:55,113][52666] DAMAGECOUNT value on done: 961066.0 [2024-08-06 08:19:55,113][52666] Sum rewards: 74.381, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.508', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.130', 'AMMO4': '0.132', 'weapon5': '0.170', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.542', 'WEAPON3': '0.850', 'weapon3': '2.696', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:55,707][52811] DAMAGECOUNT value on done: 911026.0 [2024-08-06 08:19:55,709][52811] Sum rewards: 81.813, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.122', 'weapon5': '0.136', 'AMMO4': '0.202', 'AMMO3': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '68.000'} [2024-08-06 08:19:55,830][52794] DAMAGECOUNT value on done: 970340.0 [2024-08-06 08:19:55,830][52794] Sum rewards: 73.119, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.239', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.106', 'weapon5': '0.130', 'AMMO4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '59.000'} [2024-08-06 08:19:56,028][52647] DAMAGECOUNT value on done: 1013967.0 [2024-08-06 08:19:56,032][52647] Sum rewards: 73.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.968', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.053', 'weapon4': '0.064', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'weapon2': '0.256', 'WEAPON3': '1.200', 'HITCOUNT': '3.320', 'weapon3': '3.468', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '60.000'} [2024-08-06 08:19:56,264][52650] Updated weights for policy 0, policy_version 83341 (0.0011) [2024-08-06 08:19:56,307][52670] DAMAGECOUNT value on done: 948934.0 [2024-08-06 08:19:56,308][52670] Sum rewards: 72.654, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.118', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.258', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 08:19:57,361][52666] DAMAGECOUNT value on done: 954663.0 [2024-08-06 08:19:57,361][52666] Sum rewards: 66.686, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.785', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.080', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'weapon5': '0.328', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '2.952', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '56.000'} [2024-08-06 08:19:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 682754048. Throughput: 0: 4366.2. Samples: 170696030. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:19:57,795][52567] Avg episode reward: [(0, '76.333')] [2024-08-06 08:19:58,816][52811] DAMAGECOUNT value on done: 902988.0 [2024-08-06 08:19:58,817][52811] Sum rewards: 75.226, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.097', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.094', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.296', 'weapon2': '0.432', 'WEAPON3': '0.950', 'weapon3': '2.824', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.000'} [2024-08-06 08:19:58,847][52647] DAMAGECOUNT value on done: 1020785.0 [2024-08-06 08:19:58,847][52647] Sum rewards: 74.720, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.318', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.176', 'AMMO4': '0.206', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'weapon2': '0.314', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.850', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '62.000'} [2024-08-06 08:19:58,900][52794] DAMAGECOUNT value on done: 977637.0 [2024-08-06 08:19:58,900][52794] Sum rewards: 79.135, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.543', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.114', 'AMMO4': '0.146', 'weapon5': '0.196', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '65.000'} [2024-08-06 08:19:59,079][52670] DAMAGECOUNT value on done: 950384.0 [2024-08-06 08:19:59,079][52670] Sum rewards: 71.049, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.124', 'AMMO3': '0.189', 'weapon2': '0.222', 'weapon4': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '57.000'} [2024-08-06 08:20:00,540][52666] DAMAGECOUNT value on done: 956500.0 [2024-08-06 08:20:00,542][52666] Sum rewards: 83.391, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.211', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon4': '0.304', 'weapon2': '0.392', 'WEAPON3': '0.950', 'weapon3': '3.040', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:00,666][52668] DAMAGECOUNT value on done: 972777.0 [2024-08-06 08:20:00,668][52668] Sum rewards: 74.418, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.740', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.106', 'weapon5': '0.122', 'AMMO4': '0.175', 'AMMO3': '0.246', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.164', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:01,000][52650] Updated weights for policy 0, policy_version 83351 (0.0012) [2024-08-06 08:20:01,652][52647] DAMAGECOUNT value on done: 1017281.0 [2024-08-06 08:20:01,653][52647] Sum rewards: 77.450, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO2': '0.026', 'AMMO4': '0.128', 'AMMO3': '0.263', 'weapon2': '0.758', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:01,768][52820] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:20:01,853][52794] DAMAGECOUNT value on done: 964331.0 [2024-08-06 08:20:01,857][52794] Sum rewards: 81.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.735', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO4': '0.099', 'weapon4': '0.110', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:01,878][52811] DAMAGECOUNT value on done: 900348.0 [2024-08-06 08:20:01,879][52811] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.188', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.125', 'weapon5': '0.158', 'weapon2': '0.164', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.420', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:02,264][52670] DAMAGECOUNT value on done: 950104.0 [2024-08-06 08:20:02,264][52670] Sum rewards: 73.636, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.010', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.158', 'AMMO4': '0.222', 'AMMO3': '0.265', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:02,551][52647] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:20:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 682835968. Throughput: 0: 4371.8. Samples: 170709150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:20:02,794][52567] Avg episode reward: [(0, '76.582')] [2024-08-06 08:20:03,364][52665] DAMAGECOUNT value on done: 950370.0 [2024-08-06 08:20:03,364][52665] Sum rewards: 78.593, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.469', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.039', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.362', 'WEAPON3': '1.400', 'weapon3': '3.334', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:03,427][52664] Large shaping reward 2.513 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.462, 154.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:20:03,597][52668] DAMAGECOUNT value on done: 971659.0 [2024-08-06 08:20:03,598][52668] Sum rewards: 78.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.446', 'WEAPON3': '1.100', 'weapon3': '3.344', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:03,687][52666] DAMAGECOUNT value on done: 956428.0 [2024-08-06 08:20:03,688][52666] Sum rewards: 78.268, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.670', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.215', 'weapon4': '0.258', 'AMMO4': '0.261', 'weapon5': '0.264', 'weapon2': '0.350', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.864', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:04,346][52647] DAMAGECOUNT value on done: 1027120.0 [2024-08-06 08:20:04,347][52647] Sum rewards: 73.250, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.960', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.152', 'AMMO3': '0.175', 'AMMO4': '0.179', 'weapon4': '0.226', 'weapon2': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.150', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:04,955][52811] DAMAGECOUNT value on done: 901636.0 [2024-08-06 08:20:04,956][52811] Sum rewards: 70.829, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.684', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.099', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.276', 'weapon2': '0.434', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '61.000'} [2024-08-06 08:20:05,380][52670] DAMAGECOUNT value on done: 948731.0 [2024-08-06 08:20:05,382][52670] Sum rewards: 83.297, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.904', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.096', 'weapon5': '0.200', 'AMMO3': '0.223', 'AMMO4': '0.225', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '69.000'} [2024-08-06 08:20:05,902][52650] Updated weights for policy 0, policy_version 83361 (0.0017) [2024-08-06 08:20:06,258][52665] DAMAGECOUNT value on done: 962505.0 [2024-08-06 08:20:06,259][52665] Sum rewards: 74.382, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.254', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.040', 'weapon5': '0.104', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.368', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:06,484][52668] DAMAGECOUNT value on done: 967513.0 [2024-08-06 08:20:06,486][52668] Sum rewards: 75.493, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.105', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO3': '0.133', 'AMMO4': '0.185', 'weapon5': '0.194', 'weapon4': '0.278', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.022', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:06,870][52666] DAMAGECOUNT value on done: 951692.0 [2024-08-06 08:20:06,873][52666] Sum rewards: 79.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.370', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.096', 'AMMO4': '0.140', 'AMMO3': '0.197', 'weapon5': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.548', 'WEAPON3': '1.150', 'weapon3': '2.824', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:07,441][52647] DAMAGECOUNT value on done: 1023551.0 [2024-08-06 08:20:07,442][52647] Sum rewards: 62.709, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.322', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.142', 'AMMO4': '0.230', 'weapon5': '0.244', 'weapon4': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.594', 'WEAPON3': '0.900', 'weapon3': '2.498', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '50.000'} [2024-08-06 08:20:07,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 682926080. Throughput: 0: 4368.0. Samples: 170735070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:20:07,802][52567] Avg episode reward: [(0, '76.633')] [2024-08-06 08:20:07,934][52811] DAMAGECOUNT value on done: 900087.0 [2024-08-06 08:20:07,934][52811] Sum rewards: 83.192, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.436', 'AMMO5': '0.005', 'AMMO2': '0.021', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.100', 'AMMO4': '0.104', 'weapon4': '0.112', 'AMMO3': '0.215', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:08,222][52670] DAMAGECOUNT value on done: 963077.0 [2024-08-06 08:20:08,224][52670] Sum rewards: 76.136, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.181', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:08,612][52665] DAMAGECOUNT value on done: 956296.0 [2024-08-06 08:20:08,612][52665] Sum rewards: 80.748, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.134', 'AMMO4': '0.141', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.500', 'weapon3': '3.070', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:09,570][52668] DAMAGECOUNT value on done: 971773.0 [2024-08-06 08:20:09,571][52668] Sum rewards: 73.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.131', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.176', 'AMMO4': '0.237', 'AMMO3': '0.253', 'weapon2': '0.310', 'weapon4': '0.338', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.890', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:09,756][52666] DAMAGECOUNT value on done: 964864.0 [2024-08-06 08:20:09,757][52666] Sum rewards: 71.751, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.005', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.078', 'weapon2': '0.224', 'AMMO4': '0.227', 'weapon5': '0.228', 'AMMO3': '0.230', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:10,403][52650] Updated weights for policy 0, policy_version 83371 (0.0040) [2024-08-06 08:20:10,562][52647] DAMAGECOUNT value on done: 1025434.0 [2024-08-06 08:20:10,563][52647] Sum rewards: 64.849, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.735', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.076', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.462', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.316', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '53.000'} [2024-08-06 08:20:11,052][52811] DAMAGECOUNT value on done: 908252.0 [2024-08-06 08:20:11,056][52811] Sum rewards: 80.552, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.140', 'AMMO3': '0.210', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '66.000'} [2024-08-06 08:20:11,162][52670] DAMAGECOUNT value on done: 945303.0 [2024-08-06 08:20:11,162][52670] Sum rewards: 89.294, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.158', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.161', 'AMMO3': '0.191', 'weapon2': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.288', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '22.179', 'FRAGCOUNT': '70.000'} [2024-08-06 08:20:11,208][52665] DAMAGECOUNT value on done: 958844.0 [2024-08-06 08:20:11,209][52665] Sum rewards: 81.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.648', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.060', 'AMMO4': '0.159', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.350', 'weapon3': '3.312', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '69.000'} [2024-08-06 08:20:12,307][52668] DAMAGECOUNT value on done: 956123.0 [2024-08-06 08:20:12,307][52668] Sum rewards: 85.461, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.862', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.123', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.200', 'WEAPON3': '1.250', 'weapon3': '3.376', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '21.132', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 683016192. Throughput: 0: 4362.2. Samples: 170761180. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:20:12,802][52567] Avg episode reward: [(0, '76.655')] [2024-08-06 08:20:12,831][52666] DAMAGECOUNT value on done: 954581.0 [2024-08-06 08:20:12,835][52666] Sum rewards: 77.833, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.190', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '65.500'} [2024-08-06 08:20:13,597][52665] DAMAGECOUNT value on done: 940209.0 [2024-08-06 08:20:13,599][52665] Sum rewards: 70.717, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.325', 'AMMO2': '0.010', 'AMMO4': '0.051', 'WEAPON4': '0.150', 'weapon2': '0.158', 'weapon4': '0.190', 'AMMO3': '0.228', 'WEAPON3': '1.500', 'weapon3': '3.460', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:13,765][52647] DAMAGECOUNT value on done: 1001239.0 [2024-08-06 08:20:13,765][52647] Sum rewards: 71.762, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.164', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.320', 'weapon4': '0.354', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:14,168][52811] DAMAGECOUNT value on done: 912514.0 [2024-08-06 08:20:14,169][52811] Sum rewards: 81.203, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.272', 'WEAPON3': '1.650', 'weapon3': '3.470', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:14,261][52670] DAMAGECOUNT value on done: 958501.0 [2024-08-06 08:20:14,264][52670] Sum rewards: 66.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.555', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.168', 'weapon5': '0.170', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.116', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '53.000'} [2024-08-06 08:20:15,218][52650] Updated weights for policy 0, policy_version 83381 (0.0020) [2024-08-06 08:20:15,399][52668] DAMAGECOUNT value on done: 968748.0 [2024-08-06 08:20:15,401][52668] Sum rewards: 83.109, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.194', 'ARMOR': '0.008', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.068', 'weapon5': '0.206', 'AMMO3': '0.207', 'AMMO4': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.126', 'FRAGCOUNT': '67.500'} [2024-08-06 08:20:15,672][52666] DAMAGECOUNT value on done: 959464.0 [2024-08-06 08:20:15,673][52666] Sum rewards: 69.947, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.126', 'AMMO3': '0.175', 'weapon2': '0.216', 'weapon5': '0.220', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.521', 'FRAGCOUNT': '56.000'} [2024-08-06 08:20:16,148][52665] DAMAGECOUNT value on done: 942419.0 [2024-08-06 08:20:16,149][52665] Sum rewards: 69.918, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.835', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.122', 'AMMO3': '0.207', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.804', 'WEAPON3': '1.300', 'weapon3': '2.632', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:16,883][52647] DAMAGECOUNT value on done: 1016558.0 [2024-08-06 08:20:16,884][52647] Sum rewards: 67.350, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.860', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.126', 'weapon5': '0.182', 'AMMO4': '0.231', 'WEAPON5': '0.300', 'AMMO3': '0.306', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.750', 'weapon3': '2.976', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:16,888][52670] DAMAGECOUNT value on done: 962648.0 [2024-08-06 08:20:16,891][52670] Sum rewards: 70.090, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.164', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.166', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '61.000'} [2024-08-06 08:20:17,267][52811] DAMAGECOUNT value on done: 897490.0 [2024-08-06 08:20:17,268][52811] Sum rewards: 72.559, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.626', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon5': '0.090', 'weapon4': '0.142', 'weapon2': '0.168', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.350', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 683098112. Throughput: 0: 4362.0. Samples: 170774330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:20:17,802][52567] Avg episode reward: [(0, '76.062')] [2024-08-06 08:20:18,519][52668] DAMAGECOUNT value on done: 966977.0 [2024-08-06 08:20:18,520][52668] Sum rewards: 69.152, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.776', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.136', 'AMMO3': '0.160', 'weapon4': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.050', 'weapon3': '3.088', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '56.000'} [2024-08-06 08:20:18,617][52666] DAMAGECOUNT value on done: 944663.0 [2024-08-06 08:20:18,617][52666] Sum rewards: 67.913, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.962', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.044', 'AMMO4': '0.088', 'weapon5': '0.100', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.100', 'weapon3': '3.204', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.149', 'FRAGCOUNT': '55.000'} [2024-08-06 08:20:19,066][52665] DAMAGECOUNT value on done: 954672.0 [2024-08-06 08:20:19,066][52665] Sum rewards: 91.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.670', 'AMMO5': '0.019', 'AMMO2': '0.052', 'weapon4': '0.108', 'AMMO3': '0.241', 'AMMO4': '0.260', 'weapon5': '0.268', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.450', 'weapon3': '2.772', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '77.000'} [2024-08-06 08:20:19,173][52649] DAMAGECOUNT value on done: 933548.0 [2024-08-06 08:20:19,176][52649] Sum rewards: 73.659, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.756', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.173', 'weapon4': '0.184', 'AMMO4': '0.199', 'weapon5': '0.210', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:19,311][52667] DAMAGECOUNT value on done: 961663.0 [2024-08-06 08:20:19,314][52667] Sum rewards: 76.393, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.358', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.141', 'WEAPON3': '0.850', 'weapon2': '0.890', 'weapon3': '2.860', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:19,669][52647] DAMAGECOUNT value on done: 1011804.0 [2024-08-06 08:20:19,669][52647] Sum rewards: 69.753, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.740', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.021', 'weapon5': '0.092', 'AMMO3': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.286', 'ARMOR': '0.491', 'weapon2': '0.764', 'WEAPON3': '0.900', 'weapon3': '2.652', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '55.000'} [2024-08-06 08:20:19,871][52650] Updated weights for policy 0, policy_version 83391 (0.0030) [2024-08-06 08:20:20,122][52670] DAMAGECOUNT value on done: 956736.0 [2024-08-06 08:20:20,124][52670] Sum rewards: 71.528, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.152', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.304', 'HEALTH': '0.540', 'WEAPON3': '0.850', 'weapon3': '3.092', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '54.000'} [2024-08-06 08:20:20,308][52811] DAMAGECOUNT value on done: 899000.0 [2024-08-06 08:20:20,309][52811] Sum rewards: 77.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.390', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.199', 'AMMO3': '0.238', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.270', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:21,437][52668] DAMAGECOUNT value on done: 959580.0 [2024-08-06 08:20:21,439][52668] Sum rewards: 80.346, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.274', 'AMMO2': '0.006', 'AMMO5': '0.010', 'AMMO4': '0.030', 'weapon5': '0.074', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.146', 'WEAPON5': '0.250', 'weapon2': '0.786', 'WEAPON3': '1.000', 'weapon3': '2.866', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:21,681][52666] DAMAGECOUNT value on done: 966914.0 [2024-08-06 08:20:21,681][52666] Sum rewards: 81.106, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.447', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.188', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:21,873][52667] DAMAGECOUNT value on done: 978834.0 [2024-08-06 08:20:21,874][52667] Sum rewards: 75.967, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.098', 'AMMO4': '0.151', 'AMMO3': '0.228', 'weapon2': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:22,149][52665] DAMAGECOUNT value on done: 952734.0 [2024-08-06 08:20:22,150][52665] Sum rewards: 82.001, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.800', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.074', 'AMMO4': '0.173', 'AMMO3': '0.183', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '66.000'} [2024-08-06 08:20:22,216][52647] DAMAGECOUNT value on done: 1012229.0 [2024-08-06 08:20:22,218][52647] Sum rewards: 71.874, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.955', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO4': '0.177', 'weapon4': '0.192', 'AMMO3': '0.222', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.130', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:22,277][52649] DAMAGECOUNT value on done: 930060.0 [2024-08-06 08:20:22,277][52649] Sum rewards: 75.283, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.428', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO4': '0.154', 'AMMO3': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.200', 'weapon3': '2.856', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 683188224. Throughput: 0: 4364.2. Samples: 170800580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:20:22,794][52567] Avg episode reward: [(0, '76.074')] [2024-08-06 08:20:23,187][52670] DAMAGECOUNT value on done: 941776.0 [2024-08-06 08:20:23,190][52670] Sum rewards: 67.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.271', 'AMMO5': '0.014', 'AMMO2': '0.059', 'AMMO3': '0.174', 'weapon5': '0.188', 'weapon4': '0.234', 'weapon2': '0.254', 'AMMO4': '0.296', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.064', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.578', 'FRAGCOUNT': '55.000'} [2024-08-06 08:20:24,287][52650] Updated weights for policy 0, policy_version 83401 (0.0010) [2024-08-06 08:20:24,519][52668] DAMAGECOUNT value on done: 962156.0 [2024-08-06 08:20:24,519][52668] Sum rewards: 84.361, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.550', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.132', 'AMMO4': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.342', 'WEAPON3': '1.700', 'weapon3': '3.192', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:24,636][52667] DAMAGECOUNT value on done: 972022.0 [2024-08-06 08:20:24,636][52667] Sum rewards: 83.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.009', 'AMMO2': '0.049', 'weapon4': '0.126', 'weapon5': '0.126', 'AMMO3': '0.220', 'AMMO4': '0.245', 'weapon2': '0.248', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.284', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:24,699][52666] DAMAGECOUNT value on done: 962223.0 [2024-08-06 08:20:24,700][52666] Sum rewards: 88.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.235', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.126', 'weapon5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.211', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.191', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:25,018][52647] DAMAGECOUNT value on done: 1007384.0 [2024-08-06 08:20:25,020][52647] Sum rewards: 85.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.543', 'AMMO5': '0.005', 'AMMO2': '0.030', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.116', 'weapon4': '0.142', 'AMMO4': '0.151', 'AMMO3': '0.228', 'weapon2': '0.246', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '70.000'} [2024-08-06 08:20:25,189][52665] DAMAGECOUNT value on done: 958073.0 [2024-08-06 08:20:25,189][52665] Sum rewards: 74.056, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.069', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon4': '0.166', 'AMMO3': '0.173', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.672', 'WEAPON3': '1.050', 'weapon3': '2.772', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '56.000'} [2024-08-06 08:20:25,341][52649] DAMAGECOUNT value on done: 944631.0 [2024-08-06 08:20:25,344][52649] Sum rewards: 79.070, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO2': '0.010', 'AMMO5': '0.011', 'weapon4': '0.014', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.106', 'weapon2': '0.158', 'AMMO3': '0.190', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.530', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:26,160][52670] DAMAGECOUNT value on done: 956925.0 [2024-08-06 08:20:26,162][52670] Sum rewards: 85.394, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.635', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.062', 'AMMO4': '0.106', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.631', 'FRAGCOUNT': '69.500'} [2024-08-06 08:20:27,465][52668] DAMAGECOUNT value on done: 970266.0 [2024-08-06 08:20:27,465][52668] Sum rewards: 69.915, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.787', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.136', 'AMMO4': '0.182', 'weapon4': '0.184', 'weapon2': '0.196', 'AMMO3': '0.238', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.234', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:27,576][52667] DAMAGECOUNT value on done: 977948.0 [2024-08-06 08:20:27,577][52667] Sum rewards: 76.351, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.114', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.116', 'AMMO4': '0.169', 'weapon5': '0.214', 'AMMO3': '0.242', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:27,611][52670] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:20:27,682][52647] DAMAGECOUNT value on done: 1016137.0 [2024-08-06 08:20:27,682][52647] Sum rewards: 82.283, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.820', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.130', 'weapon2': '0.178', 'AMMO3': '0.194', 'AMMO4': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon4': '0.456', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:27,734][52666] DAMAGECOUNT value on done: 961332.0 [2024-08-06 08:20:27,736][52666] Sum rewards: 91.339, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.410', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.130', 'AMMO3': '0.144', 'weapon4': '0.144', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.000', 'weapon3': '2.964', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.865', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 683270144. Throughput: 0: 4367.3. Samples: 170826910. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:20:27,802][52567] Avg episode reward: [(0, '76.582')] [2024-08-06 08:20:27,901][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083408_683278336.pth... [2024-08-06 08:20:28,073][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000082896_679084032.pth [2024-08-06 08:20:28,211][52665] DAMAGECOUNT value on done: 950800.0 [2024-08-06 08:20:28,211][52665] Sum rewards: 78.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.052', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon4': '0.190', 'AMMO3': '0.216', 'weapon5': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '2.692', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:28,373][52649] DAMAGECOUNT value on done: 946388.0 [2024-08-06 08:20:28,376][52649] Sum rewards: 75.725, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.830', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.164', 'AMMO4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.296', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '66.000'} [2024-08-06 08:20:29,281][52670] DAMAGECOUNT value on done: 964589.0 [2024-08-06 08:20:29,282][52670] Sum rewards: 74.574, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.215', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.376', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:29,402][52650] Updated weights for policy 0, policy_version 83411 (0.0020) [2024-08-06 08:20:30,239][52664] Large shaping reward 2.604 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.018000000000000002, -6.0), ('weapon5', 0.002)] [2024-08-06 08:20:30,348][52667] DAMAGECOUNT value on done: 978046.0 [2024-08-06 08:20:30,350][52667] Sum rewards: 73.791, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.121', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.064', 'weapon5': '0.154', 'AMMO3': '0.191', 'AMMO4': '0.278', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '61.000'} [2024-08-06 08:20:30,433][52803] DAMAGECOUNT value on done: 894673.0 [2024-08-06 08:20:30,434][52803] Sum rewards: 67.646, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.739', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon5': '0.088', 'weapon4': '0.090', 'AMMO4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.998', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '55.000'} [2024-08-06 08:20:30,643][52647] DAMAGECOUNT value on done: 1009692.0 [2024-08-06 08:20:30,644][52647] Sum rewards: 85.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.235', 'weapon5': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.036', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.650', 'weapon3': '3.408', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '21.342', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:30,708][52668] DAMAGECOUNT value on done: 964593.0 [2024-08-06 08:20:30,709][52668] Sum rewards: 87.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.426', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon5': '0.170', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.400', 'weapon4': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.660', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '69.000'} [2024-08-06 08:20:30,891][52666] DAMAGECOUNT value on done: 953453.0 [2024-08-06 08:20:30,891][52666] Sum rewards: 85.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.195', 'AMMO5': '0.016', 'AMMO2': '0.060', 'AMMO3': '0.215', 'weapon2': '0.264', 'weapon5': '0.296', 'AMMO4': '0.299', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.766', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '69.000'} [2024-08-06 08:20:31,214][52665] DAMAGECOUNT value on done: 966138.0 [2024-08-06 08:20:31,214][52665] Sum rewards: 75.691, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.532', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.146', 'AMMO3': '0.165', 'weapon5': '0.198', 'AMMO4': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '60.500'} [2024-08-06 08:20:31,314][52649] DAMAGECOUNT value on done: 937299.0 [2024-08-06 08:20:31,314][52649] Sum rewards: 77.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.425', 'AMMO5': '0.011', 'AMMO2': '0.054', 'weapon5': '0.136', 'AMMO3': '0.211', 'AMMO4': '0.270', 'weapon4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:32,068][52662] DAMAGECOUNT value on done: 963869.0 [2024-08-06 08:20:32,069][52662] Sum rewards: 81.633, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.580', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.108', 'weapon5': '0.138', 'AMMO4': '0.159', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.299', 'WEAPON3': '1.650', 'weapon3': '3.310', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '71.000'} [2024-08-06 08:20:32,452][52670] DAMAGECOUNT value on done: 958845.0 [2024-08-06 08:20:32,452][52670] Sum rewards: 81.195, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.205', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.170', 'AMMO4': '0.170', 'weapon4': '0.222', 'AMMO3': '0.225', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.050', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 683360256. Throughput: 0: 4361.1. Samples: 170839600. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:20:32,794][52567] Avg episode reward: [(0, '76.888')] [2024-08-06 08:20:33,280][52667] DAMAGECOUNT value on done: 976858.0 [2024-08-06 08:20:33,281][52667] Sum rewards: 70.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.233', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon5': '0.148', 'weapon4': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:33,503][52647] DAMAGECOUNT value on done: 1018207.0 [2024-08-06 08:20:33,503][52647] Sum rewards: 78.795, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.852', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.022', 'AMMO4': '0.059', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.190', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:33,607][52666] DAMAGECOUNT value on done: 951538.0 [2024-08-06 08:20:33,607][52666] Sum rewards: 79.141, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.766', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.114', 'weapon5': '0.146', 'AMMO3': '0.161', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.000', 'weapon3': '3.224', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:33,647][52803] DAMAGECOUNT value on done: 894361.0 [2024-08-06 08:20:33,647][52803] Sum rewards: 69.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.730', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.074', 'weapon5': '0.088', 'AMMO3': '0.186', 'AMMO4': '0.295', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.100', 'weapon3': '3.314', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:33,941][52668] DAMAGECOUNT value on done: 960034.0 [2024-08-06 08:20:33,942][52668] Sum rewards: 89.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.352', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.288', 'WEAPON3': '1.050', 'weapon3': '3.482', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '73.000'} [2024-08-06 08:20:33,973][52650] Updated weights for policy 0, policy_version 83421 (0.0015) [2024-08-06 08:20:34,324][52665] DAMAGECOUNT value on done: 959944.0 [2024-08-06 08:20:34,324][52665] Sum rewards: 73.203, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.123', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.126', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:34,484][52649] DAMAGECOUNT value on done: 946608.0 [2024-08-06 08:20:34,484][52649] Sum rewards: 78.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.147', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.122', 'weapon5': '0.154', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:34,932][52670] DAMAGECOUNT value on done: 959572.0 [2024-08-06 08:20:34,940][52670] Sum rewards: 73.301, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.347', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'weapon5': '0.106', 'weapon2': '0.176', 'weapon4': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:35,133][52662] DAMAGECOUNT value on done: 973711.0 [2024-08-06 08:20:35,134][52662] Sum rewards: 83.217, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.562', 'AMMO2': '0.002', 'AMMO4': '0.009', 'weapon4': '0.046', 'WEAPON4': '0.050', 'AMMO3': '0.165', 'weapon2': '0.398', 'WEAPON3': '1.100', 'weapon3': '3.398', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:35,819][52667] DAMAGECOUNT value on done: 969525.0 [2024-08-06 08:20:35,819][52667] Sum rewards: 68.983, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.800', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon5': '0.188', 'AMMO4': '0.237', 'AMMO3': '0.241', 'weapon4': '0.336', 'weapon2': '0.386', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.750', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:36,203][52647] DAMAGECOUNT value on done: 1018511.0 [2024-08-06 08:20:36,204][52647] Sum rewards: 75.155, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.504', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.142', 'AMMO3': '0.177', 'weapon2': '0.234', 'weapon5': '0.236', 'AMMO4': '0.253', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.132', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:36,534][52666] DAMAGECOUNT value on done: 971121.0 [2024-08-06 08:20:36,535][52666] Sum rewards: 55.842, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.360', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO3': '0.128', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.842', 'WEAPON3': '0.900', 'HITCOUNT': '2.840', 'weapon3': '2.842', 'DAMAGECOUNT': '13.392', 'FRAGCOUNT': '43.000'} [2024-08-06 08:20:36,907][52803] DAMAGECOUNT value on done: 903688.0 [2024-08-06 08:20:36,907][52803] Sum rewards: 84.261, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.950', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.142', 'weapon4': '0.156', 'AMMO3': '0.225', 'weapon2': '0.226', 'AMMO4': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.196', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '70.000'} [2024-08-06 08:20:37,187][52668] DAMAGECOUNT value on done: 954510.0 [2024-08-06 08:20:37,190][52668] Sum rewards: 71.808, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.490', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.098', 'weapon5': '0.104', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.960', 'WEAPON3': '1.000', 'weapon3': '2.770', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 08:20:37,457][52665] DAMAGECOUNT value on done: 955081.0 [2024-08-06 08:20:37,460][52665] Sum rewards: 75.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.245', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon5': '0.102', 'AMMO3': '0.198', 'AMMO4': '0.267', 'weapon2': '0.340', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:37,673][52649] DAMAGECOUNT value on done: 942506.0 [2024-08-06 08:20:37,674][52649] Sum rewards: 74.139, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.314', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.032', 'weapon4': '0.040', 'weapon5': '0.098', 'WEAPON4': '0.100', 'AMMO3': '0.164', 'WEAPON5': '0.200', 'weapon2': '0.436', 'WEAPON3': '1.050', 'weapon3': '3.248', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 683450368. Throughput: 0: 4369.8. Samples: 170866160. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:20:37,794][52567] Avg episode reward: [(0, '76.533')] [2024-08-06 08:20:37,884][52662] DAMAGECOUNT value on done: 972530.0 [2024-08-06 08:20:37,887][52662] Sum rewards: 90.031, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.058', 'weapon4': '0.102', 'AMMO3': '0.175', 'weapon2': '0.222', 'weapon5': '0.232', 'AMMO4': '0.289', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.146', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '22.125', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:38,305][52667] DAMAGECOUNT value on done: 966402.0 [2024-08-06 08:20:38,307][52667] Sum rewards: 79.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.220', 'weapon2': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.376', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '66.000'} [2024-08-06 08:20:38,624][52650] Updated weights for policy 0, policy_version 83431 (0.0011) [2024-08-06 08:20:38,938][52647] DAMAGECOUNT value on done: 1002581.0 [2024-08-06 08:20:38,938][52647] Sum rewards: 75.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon2': '0.152', 'weapon5': '0.180', 'AMMO3': '0.197', 'weapon4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:39,615][52666] DAMAGECOUNT value on done: 945700.0 [2024-08-06 08:20:39,619][52666] Sum rewards: 78.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.200', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.154', 'weapon4': '0.194', 'weapon2': '0.196', 'AMMO4': '0.198', 'AMMO3': '0.223', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:39,813][52668] DAMAGECOUNT value on done: 952733.0 [2024-08-06 08:20:39,814][52668] Sum rewards: 73.835, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.926', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.126', 'AMMO4': '0.177', 'AMMO3': '0.180', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.094', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:39,944][52803] DAMAGECOUNT value on done: 897654.0 [2024-08-06 08:20:39,945][52803] Sum rewards: 74.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.728', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.112', 'weapon5': '0.120', 'AMMO4': '0.180', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '61.000'} [2024-08-06 08:20:40,496][52662] DAMAGECOUNT value on done: 963853.0 [2024-08-06 08:20:40,499][52662] Sum rewards: 79.743, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.066', 'weapon5': '0.140', 'AMMO4': '0.191', 'AMMO3': '0.230', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '66.000'} [2024-08-06 08:20:40,615][52665] DAMAGECOUNT value on done: 955195.0 [2024-08-06 08:20:40,616][52665] Sum rewards: 80.256, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.035', 'AMMO5': '0.005', 'weapon4': '0.014', 'weapon5': '0.020', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.128', 'weapon2': '0.236', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.496', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '69.000'} [2024-08-06 08:20:40,948][52649] DAMAGECOUNT value on done: 944687.0 [2024-08-06 08:20:40,952][52649] Sum rewards: 70.199, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'AMMO5': '0.007', 'AMMO2': '0.039', 'AMMO3': '0.168', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon5': '0.238', 'WEAPON4': '0.300', 'weapon2': '0.344', 'weapon4': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.664', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '56.000'} [2024-08-06 08:20:40,987][52667] DAMAGECOUNT value on done: 970267.0 [2024-08-06 08:20:40,988][52667] Sum rewards: 83.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.152', 'AMMO4': '0.196', 'AMMO3': '0.221', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.872', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:41,436][52647] DAMAGECOUNT value on done: 1012021.0 [2024-08-06 08:20:41,437][52647] Sum rewards: 76.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.966', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.052', 'AMMO4': '0.162', 'weapon5': '0.190', 'AMMO3': '0.227', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:42,383][52666] DAMAGECOUNT value on done: 956475.0 [2024-08-06 08:20:42,383][52666] Sum rewards: 83.790, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.808', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'weapon4': '0.240', 'WEAPON4': '0.250', 'AMMO3': '0.293', 'weapon2': '0.426', 'WEAPON3': '1.750', 'weapon3': '2.988', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 683532288. Throughput: 0: 4363.8. Samples: 170892400. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:20:42,794][52567] Avg episode reward: [(0, '76.967')] [2024-08-06 08:20:43,083][52803] DAMAGECOUNT value on done: 897535.0 [2024-08-06 08:20:43,083][52803] Sum rewards: 78.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.865', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon5': '0.136', 'AMMO3': '0.185', 'weapon4': '0.188', 'AMMO4': '0.269', 'WEAPON5': '0.450', 'weapon2': '0.460', 'WEAPON4': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.000', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:43,188][52668] DAMAGECOUNT value on done: 946715.0 [2024-08-06 08:20:43,188][52668] Sum rewards: 80.074, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.550', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.082', 'AMMO4': '0.223', 'weapon5': '0.228', 'AMMO3': '0.304', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.950', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:43,321][52650] Updated weights for policy 0, policy_version 83441 (0.0012) [2024-08-06 08:20:43,676][52665] DAMAGECOUNT value on done: 952487.0 [2024-08-06 08:20:43,677][52665] Sum rewards: 87.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.175', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.078', 'AMMO3': '0.212', 'weapon5': '0.220', 'AMMO4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '2.892', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.029', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:43,711][52662] DAMAGECOUNT value on done: 979977.0 [2024-08-06 08:20:43,712][52662] Sum rewards: 85.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.352', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.207', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:44,029][52649] DAMAGECOUNT value on done: 939992.0 [2024-08-06 08:20:44,029][52649] Sum rewards: 73.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.328', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:44,072][52667] DAMAGECOUNT value on done: 976054.0 [2024-08-06 08:20:44,072][52667] Sum rewards: 71.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.920', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.132', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.229', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:44,422][52647] DAMAGECOUNT value on done: 1005291.0 [2024-08-06 08:20:44,423][52647] Sum rewards: 80.762, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.564', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.100', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:45,713][52659] DAMAGECOUNT value on done: 966633.0 [2024-08-06 08:20:45,714][52659] Sum rewards: 74.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.632', 'AMMO5': '0.008', 'AMMO2': '0.056', 'weapon5': '0.116', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'AMMO4': '0.278', 'weapon4': '0.388', 'weapon2': '0.416', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:46,116][52803] DAMAGECOUNT value on done: 894691.0 [2024-08-06 08:20:46,117][52803] Sum rewards: 71.740, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.096', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon5': '0.176', 'AMMO3': '0.199', 'weapon4': '0.230', 'AMMO4': '0.239', 'weapon2': '0.418', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '58.000'} [2024-08-06 08:20:46,333][52668] DAMAGECOUNT value on done: 963136.0 [2024-08-06 08:20:46,334][52668] Sum rewards: 79.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.470', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'AMMO4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.208', 'AMMO3': '0.243', 'WEAPON3': '1.600', 'weapon3': '3.512', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:46,695][52665] DAMAGECOUNT value on done: 959347.0 [2024-08-06 08:20:46,697][52665] Sum rewards: 70.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.194', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.101', 'weapon5': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.244', 'AMMO3': '0.261', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.322', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:46,869][52662] DAMAGECOUNT value on done: 956833.0 [2024-08-06 08:20:46,871][52662] Sum rewards: 76.467, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.135', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.144', 'AMMO3': '0.154', 'WEAPON4': '0.200', 'weapon4': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.000', 'weapon3': '3.062', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:47,036][52647] DAMAGECOUNT value on done: 1009296.0 [2024-08-06 08:20:47,036][52647] Sum rewards: 89.767, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.834', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.058', 'weapon4': '0.106', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.282', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.913', 'FRAGCOUNT': '74.000'} [2024-08-06 08:20:47,082][52649] DAMAGECOUNT value on done: 935983.0 [2024-08-06 08:20:47,084][52649] Sum rewards: 67.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.138', 'weapon5': '0.176', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.672', 'FRAGCOUNT': '55.000'} [2024-08-06 08:20:47,085][52667] DAMAGECOUNT value on done: 964581.0 [2024-08-06 08:20:47,088][52667] Sum rewards: 69.565, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.660', 'AMMO5': '0.020', 'AMMO2': '0.070', 'weapon4': '0.110', 'AMMO3': '0.251', 'weapon5': '0.270', 'weapon2': '0.290', 'AMMO4': '0.349', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 683622400. Throughput: 0: 4368.0. Samples: 170905710. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:20:47,794][52567] Avg episode reward: [(0, '77.105')] [2024-08-06 08:20:48,073][52650] Updated weights for policy 0, policy_version 83451 (0.0031) [2024-08-06 08:20:49,112][52659] DAMAGECOUNT value on done: 965581.0 [2024-08-06 08:20:49,112][52659] Sum rewards: 75.383, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.126', 'weapon5': '0.138', 'AMMO3': '0.208', 'AMMO4': '0.246', 'WEAPON5': '0.450', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:49,272][52668] DAMAGECOUNT value on done: 965341.0 [2024-08-06 08:20:49,272][52668] Sum rewards: 81.890, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.990', 'AMMO5': '0.012', 'AMMO2': '0.016', 'weapon4': '0.048', 'AMMO4': '0.080', 'weapon5': '0.110', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '65.000'} [2024-08-06 08:20:49,395][52803] DAMAGECOUNT value on done: 892900.0 [2024-08-06 08:20:49,429][52803] Sum rewards: 75.363, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.652', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.098', 'AMMO4': '0.180', 'AMMO3': '0.206', 'weapon5': '0.258', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:49,731][52662] DAMAGECOUNT value on done: 962176.0 [2024-08-06 08:20:49,731][52662] Sum rewards: 63.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.283', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.146', 'weapon5': '0.146', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.656', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '51.000'} [2024-08-06 08:20:49,941][52665] DAMAGECOUNT value on done: 952955.0 [2024-08-06 08:20:49,942][52665] Sum rewards: 73.355, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.567', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.078', 'weapon5': '0.126', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.318', 'WEAPON3': '1.200', 'weapon3': '3.248', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:50,109][52667] DAMAGECOUNT value on done: 965311.0 [2024-08-06 08:20:50,109][52667] Sum rewards: 86.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.880', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon5': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.245', 'weapon4': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '72.000'} [2024-08-06 08:20:50,346][52649] DAMAGECOUNT value on done: 950852.0 [2024-08-06 08:20:50,346][52649] Sum rewards: 65.822, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.704', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.148', 'weapon4': '0.152', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.590', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '15.948', 'FRAGCOUNT': '56.000'} [2024-08-06 08:20:50,550][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:20:51,701][52659] DAMAGECOUNT value on done: 978051.0 [2024-08-06 08:20:51,701][52659] Sum rewards: 81.643, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.215', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.428', 'WEAPON3': '1.250', 'weapon3': '3.348', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '66.000'} [2024-08-06 08:20:52,522][52668] DAMAGECOUNT value on done: 962910.0 [2024-08-06 08:20:52,523][52668] Sum rewards: 63.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.758', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.046', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.223', 'AMMO3': '0.226', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '15.951', 'FRAGCOUNT': '53.000'} [2024-08-06 08:20:52,540][52803] DAMAGECOUNT value on done: 893689.0 [2024-08-06 08:20:52,543][52803] Sum rewards: 75.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.750', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.208', 'weapon5': '0.242', 'weapon2': '0.244', 'AMMO4': '0.249', 'AMMO3': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '2.966', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:52,663][52650] Updated weights for policy 0, policy_version 83461 (0.0016) [2024-08-06 08:20:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 683712512. Throughput: 0: 4366.9. Samples: 170931580. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:20:52,795][52567] Avg episode reward: [(0, '76.775')] [2024-08-06 08:20:52,873][52662] DAMAGECOUNT value on done: 979414.0 [2024-08-06 08:20:52,874][52662] Sum rewards: 81.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon4': '0.246', 'WEAPON4': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '2.938', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:53,075][52665] DAMAGECOUNT value on done: 946022.0 [2024-08-06 08:20:53,077][52665] Sum rewards: 79.310, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.020', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.136', 'weapon5': '0.154', 'AMMO4': '0.162', 'weapon2': '0.218', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.186', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:53,251][52667] DAMAGECOUNT value on done: 975492.0 [2024-08-06 08:20:53,253][52667] Sum rewards: 74.283, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.855', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon2': '0.090', 'weapon5': '0.094', 'AMMO4': '0.149', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'HITCOUNT': '3.400', 'weapon3': '3.682', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:53,597][52649] DAMAGECOUNT value on done: 956764.0 [2024-08-06 08:20:53,598][52649] Sum rewards: 77.923, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.763', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.164', 'AMMO3': '0.180', 'weapon4': '0.180', 'weapon5': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '62.000'} [2024-08-06 08:20:54,262][52659] DAMAGECOUNT value on done: 968956.0 [2024-08-06 08:20:54,264][52659] Sum rewards: 89.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.006', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.260', 'weapon4': '0.262', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '74.000'} [2024-08-06 08:20:55,140][52668] DAMAGECOUNT value on done: 963875.0 [2024-08-06 08:20:55,142][52668] Sum rewards: 78.034, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.865', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO3': '0.168', 'AMMO4': '0.168', 'weapon4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '60.000'} [2024-08-06 08:20:55,451][52662] DAMAGECOUNT value on done: 967489.0 [2024-08-06 08:20:55,453][52662] Sum rewards: 86.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.015', 'AMMO5': '0.006', 'weapon4': '0.030', 'AMMO2': '0.046', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'AMMO4': '0.232', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.210', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.838', 'FRAGCOUNT': '70.000'} [2024-08-06 08:20:55,634][52803] DAMAGECOUNT value on done: 902028.0 [2024-08-06 08:20:55,635][52803] Sum rewards: 82.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.508', 'AMMO2': '0.016', 'weapon4': '0.026', 'WEAPON4': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.209', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.448', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '67.000'} [2024-08-06 08:20:55,799][52665] DAMAGECOUNT value on done: 952179.0 [2024-08-06 08:20:55,799][52665] Sum rewards: 87.072, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.799', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.201', 'weapon2': '0.240', 'WEAPON3': '1.250', 'weapon3': '3.542', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '71.000'} [2024-08-06 08:20:56,226][52649] DAMAGECOUNT value on done: 947402.0 [2024-08-06 08:20:56,226][52649] Sum rewards: 59.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.094', 'AMMO4': '0.131', 'weapon4': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.927', 'FRAGCOUNT': '49.000'} [2024-08-06 08:20:56,284][52667] DAMAGECOUNT value on done: 963911.0 [2024-08-06 08:20:56,284][52667] Sum rewards: 81.016, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.022', 'HEALTH': '0.106', 'AMMO4': '0.108', 'weapon4': '0.176', 'AMMO3': '0.177', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.892', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '64.000'} [2024-08-06 08:20:56,850][52659] DAMAGECOUNT value on done: 962955.0 [2024-08-06 08:20:56,850][52659] Sum rewards: 73.564, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.588', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.062', 'AMMO4': '0.115', 'weapon5': '0.152', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.998', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '59.000'} [2024-08-06 08:20:57,197][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:20:57,716][52650] Updated weights for policy 0, policy_version 83471 (0.0011) [2024-08-06 08:20:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 683794432. Throughput: 0: 4366.0. Samples: 170957650. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:20:57,794][52567] Avg episode reward: [(0, '77.480')] [2024-08-06 08:20:58,087][52668] DAMAGECOUNT value on done: 969493.0 [2024-08-06 08:20:58,087][52668] Sum rewards: 67.704, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.174', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'weapon4': '0.130', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon5': '0.210', 'weapon2': '0.834', 'WEAPON3': '1.150', 'weapon3': '2.544', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '54.000'} [2024-08-06 08:20:58,208][52662] DAMAGECOUNT value on done: 970339.0 [2024-08-06 08:20:58,209][52662] Sum rewards: 85.646, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.235', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.100', 'weapon4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.154', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '69.000'} [2024-08-06 08:20:58,281][52665] DAMAGECOUNT value on done: 957138.0 [2024-08-06 08:20:58,281][52665] Sum rewards: 80.732, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.525', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.048', 'weapon4': '0.076', 'AMMO4': '0.139', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'WEAPON3': '1.400', 'weapon3': '3.412', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '68.000'} [2024-08-06 08:20:58,362][52660] DAMAGECOUNT value on done: 961138.0 [2024-08-06 08:20:58,364][52660] Sum rewards: 77.505, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.942', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.174', 'AMMO3': '0.214', 'weapon5': '0.248', 'weapon2': '0.322', 'AMMO4': '0.323', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.942', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.607', 'FRAGCOUNT': '63.000'} [2024-08-06 08:20:58,813][52803] DAMAGECOUNT value on done: 896796.0 [2024-08-06 08:20:58,815][52803] Sum rewards: 63.869, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.507', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO3': '0.141', 'AMMO4': '0.186', 'weapon4': '0.220', 'weapon5': '0.228', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'HITCOUNT': '2.890', 'weapon3': '3.046', 'DAMAGECOUNT': '15.765', 'FRAGCOUNT': '50.500'} [2024-08-06 08:20:58,860][52649] DAMAGECOUNT value on done: 946963.0 [2024-08-06 08:20:58,860][52649] Sum rewards: 76.756, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.271', 'weapon2': '0.432', 'WEAPON3': '1.700', 'weapon3': '3.312', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '66.000'} [2024-08-06 08:20:59,409][52667] DAMAGECOUNT value on done: 972646.0 [2024-08-06 08:20:59,410][52667] Sum rewards: 78.836, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.474', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.287', 'weapon2': '0.318', 'WEAPON3': '1.750', 'weapon3': '3.270', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '69.000'} [2024-08-06 08:20:59,558][52659] DAMAGECOUNT value on done: 968118.0 [2024-08-06 08:20:59,559][52659] Sum rewards: 71.138, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.240', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'AMMO3': '0.153', 'weapon5': '0.172', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.050', 'HITCOUNT': '3.080', 'weapon3': '3.332', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '58.000'} [2024-08-06 08:21:00,907][52662] DAMAGECOUNT value on done: 966458.0 [2024-08-06 08:21:00,910][52662] Sum rewards: 72.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.031', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.038', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.424', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:01,008][52660] DAMAGECOUNT value on done: 952986.0 [2024-08-06 08:21:01,008][52660] Sum rewards: 79.805, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.390', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.161', 'weapon4': '0.174', 'weapon5': '0.174', 'AMMO4': '0.232', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.994', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '63.000'} [2024-08-06 08:21:01,486][52649] DAMAGECOUNT value on done: 935411.0 [2024-08-06 08:21:01,486][52649] Sum rewards: 82.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.937', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon4': '0.052', 'weapon5': '0.124', 'AMMO4': '0.193', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.848', 'FRAGCOUNT': '70.000'} [2024-08-06 08:21:02,010][52803] DAMAGECOUNT value on done: 908203.0 [2024-08-06 08:21:02,012][52803] Sum rewards: 61.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.383', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon4': '0.124', 'AMMO4': '0.145', 'AMMO3': '0.235', 'weapon5': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.450', 'weapon3': '2.702', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '53.000'} [2024-08-06 08:21:02,326][52650] Updated weights for policy 0, policy_version 83481 (0.0031) [2024-08-06 08:21:02,481][52667] DAMAGECOUNT value on done: 977985.0 [2024-08-06 08:21:02,518][52667] Sum rewards: 89.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.835', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.340', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.771', 'FRAGCOUNT': '72.000'} [2024-08-06 08:21:02,712][52659] DAMAGECOUNT value on done: 968180.0 [2024-08-06 08:21:02,714][52659] Sum rewards: 89.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.086', 'AMMO4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.215', 'WEAPON3': '1.400', 'weapon3': '3.500', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.982', 'FRAGCOUNT': '73.000'} [2024-08-06 08:21:02,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 683884544. Throughput: 0: 4360.4. Samples: 170970550. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:21:02,794][52567] Avg episode reward: [(0, '77.488')] [2024-08-06 08:21:03,600][52649] DAMAGECOUNT value on done: 948775.0 [2024-08-06 08:21:03,601][52649] Sum rewards: 84.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.083', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.247', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.448', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '70.000'} [2024-08-06 08:21:03,792][52662] DAMAGECOUNT value on done: 964273.0 [2024-08-06 08:21:03,793][52662] Sum rewards: 65.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.056', 'weapon4': '0.058', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.284', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '55.000'} [2024-08-06 08:21:04,074][52660] DAMAGECOUNT value on done: 965120.0 [2024-08-06 08:21:04,077][52660] Sum rewards: 86.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.136', 'weapon5': '0.150', 'AMMO4': '0.264', 'weapon4': '0.268', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.860', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '70.000'} [2024-08-06 08:21:05,185][52803] DAMAGECOUNT value on done: 905639.0 [2024-08-06 08:21:05,189][52803] Sum rewards: 87.310, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.004', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.094', 'AMMO3': '0.154', 'AMMO4': '0.188', 'WEAPON5': '0.200', 'weapon4': '0.280', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.102', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:05,251][52667] DAMAGECOUNT value on done: 979425.0 [2024-08-06 08:21:05,252][52667] Sum rewards: 72.593, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.142', 'WEAPON4': '0.200', 'weapon2': '0.774', 'WEAPON3': '1.050', 'weapon3': '3.010', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:05,838][52659] DAMAGECOUNT value on done: 967774.0 [2024-08-06 08:21:05,839][52659] Sum rewards: 70.925, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.370', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.100', 'AMMO3': '0.178', 'weapon5': '0.206', 'AMMO4': '0.244', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.738', 'WEAPON3': '1.050', 'weapon3': '2.742', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '56.000'} [2024-08-06 08:21:05,851][52664] DAMAGECOUNT value on done: 993841.0 [2024-08-06 08:21:05,851][52664] Sum rewards: 69.632, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.185', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.070', 'AMMO3': '0.134', 'weapon5': '0.168', 'AMMO4': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.090', 'weapon3': '3.210', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2024-08-06 08:21:06,387][52649] DAMAGECOUNT value on done: 929909.0 [2024-08-06 08:21:06,396][52649] Sum rewards: 72.893, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.456', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO4': '0.095', 'weapon5': '0.096', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'WEAPON3': '1.750', 'weapon3': '3.408', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '63.000'} [2024-08-06 08:21:06,761][52650] Updated weights for policy 0, policy_version 83491 (0.0030) [2024-08-06 08:21:06,915][52660] DAMAGECOUNT value on done: 976760.0 [2024-08-06 08:21:06,915][52660] Sum rewards: 68.296, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.006', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.166', 'AMMO3': '0.218', 'weapon5': '0.272', 'AMMO4': '0.273', 'weapon2': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.994', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:07,233][52662] DAMAGECOUNT value on done: 958526.0 [2024-08-06 08:21:07,234][52662] Sum rewards: 66.529, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.799', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.078', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.292', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.750', 'weapon3': '3.190', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 683974656. Throughput: 0: 4363.1. Samples: 170996920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:21:07,794][52567] Avg episode reward: [(0, '76.889')] [2024-08-06 08:21:08,013][52667] DAMAGECOUNT value on done: 974802.0 [2024-08-06 08:21:08,015][52667] Sum rewards: 69.472, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.098', 'HEALTH': '0.127', 'AMMO3': '0.131', 'AMMO4': '0.193', 'weapon5': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.710', 'WEAPON3': '0.750', 'weapon3': '2.776', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '55.000'} [2024-08-06 08:21:08,240][52803] DAMAGECOUNT value on done: 894422.0 [2024-08-06 08:21:08,240][52803] Sum rewards: 77.755, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.340', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.120', 'AMMO4': '0.149', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '63.000'} [2024-08-06 08:21:08,782][52659] DAMAGECOUNT value on done: 965673.0 [2024-08-06 08:21:08,785][52659] Sum rewards: 72.959, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.575', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.034', 'weapon5': '0.074', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.650', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:08,893][52664] DAMAGECOUNT value on done: 1002108.0 [2024-08-06 08:21:08,894][52664] Sum rewards: 82.919, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.235', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO4': '0.170', 'AMMO3': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.574', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:09,051][52649] DAMAGECOUNT value on done: 948860.0 [2024-08-06 08:21:09,053][52649] Sum rewards: 77.565, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.198', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.110', 'AMMO3': '0.168', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '3.178', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 08:21:09,684][52660] DAMAGECOUNT value on done: 958353.0 [2024-08-06 08:21:09,687][52660] Sum rewards: 75.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.600', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.182', 'weapon4': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.235', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:09,715][52659] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:21:09,951][52662] DAMAGECOUNT value on done: 970389.0 [2024-08-06 08:21:09,956][52662] Sum rewards: 74.456, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.205', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.116', 'AMMO3': '0.163', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.402', 'WEAPON3': '0.950', 'weapon3': '3.144', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '58.000'} [2024-08-06 08:21:10,567][52667] DAMAGECOUNT value on done: 971041.0 [2024-08-06 08:21:10,567][52667] Sum rewards: 69.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.295', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.177', 'weapon5': '0.178', 'AMMO4': '0.278', 'weapon4': '0.308', 'weapon2': '0.406', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.770', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:11,005][52820] DAMAGECOUNT value on done: 893308.0 [2024-08-06 08:21:11,006][52820] Sum rewards: 71.640, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.500', 'AMMO5': '0.016', 'AMMO2': '0.047', 'AMMO3': '0.147', 'AMMO4': '0.233', 'weapon5': '0.240', 'weapon4': '0.266', 'weapon2': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.880', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '56.500'} [2024-08-06 08:21:11,342][52803] DAMAGECOUNT value on done: 912163.0 [2024-08-06 08:21:11,343][52803] Sum rewards: 87.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.689', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.114', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '2.990', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.634', 'FRAGCOUNT': '72.000'} [2024-08-06 08:21:11,551][52649] DAMAGECOUNT value on done: 951313.0 [2024-08-06 08:21:11,559][52649] Sum rewards: 85.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.674', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.098', 'AMMO4': '0.133', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.402', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.942', 'FRAGCOUNT': '69.000'} [2024-08-06 08:21:11,930][52650] Updated weights for policy 0, policy_version 83501 (0.0027) [2024-08-06 08:21:11,963][52659] DAMAGECOUNT value on done: 976524.0 [2024-08-06 08:21:11,964][52659] Sum rewards: 86.665, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.346', 'AMMO5': '0.005', 'AMMO2': '0.032', 'weapon4': '0.056', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.158', 'AMMO3': '0.210', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '3.368', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '21.582', 'FRAGCOUNT': '69.000'} [2024-08-06 08:21:12,066][52664] DAMAGECOUNT value on done: 1006026.0 [2024-08-06 08:21:12,066][52664] Sum rewards: 85.510, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'weapon5': '0.074', 'AMMO4': '0.101', 'AMMO3': '0.154', 'weapon2': '0.668', 'WEAPON3': '0.850', 'HEALTH': '0.980', 'weapon3': '3.160', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '67.000'} [2024-08-06 08:21:12,535][52660] DAMAGECOUNT value on done: 956769.0 [2024-08-06 08:21:12,537][52660] Sum rewards: 68.316, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.970', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon5': '0.146', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.286', 'weapon4': '0.736', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.011', 'FRAGCOUNT': '56.000'} [2024-08-06 08:21:12,677][52662] DAMAGECOUNT value on done: 962002.0 [2024-08-06 08:21:12,677][52662] Sum rewards: 73.940, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.886', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.086', 'weapon2': '0.146', 'AMMO3': '0.185', 'weapon5': '0.196', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.352', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 684056576. Throughput: 0: 4351.8. Samples: 171022740. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:21:12,794][52567] Avg episode reward: [(0, '76.844')] [2024-08-06 08:21:13,721][52667] DAMAGECOUNT value on done: 975945.0 [2024-08-06 08:21:13,722][52667] Sum rewards: 71.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.519', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon5': '0.218', 'weapon4': '0.246', 'AMMO3': '0.254', 'AMMO4': '0.276', 'weapon2': '0.378', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:14,184][52820] DAMAGECOUNT value on done: 895574.0 [2024-08-06 08:21:14,185][52820] Sum rewards: 79.262, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.995', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.147', 'weapon2': '0.236', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.342', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:14,483][52803] DAMAGECOUNT value on done: 894705.0 [2024-08-06 08:21:14,483][52803] Sum rewards: 72.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.068', 'weapon5': '0.202', 'AMMO4': '0.211', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:14,543][52664] DAMAGECOUNT value on done: 995010.0 [2024-08-06 08:21:14,543][52664] Sum rewards: 71.437, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.080', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.163', 'weapon4': '0.202', 'weapon2': '0.244', 'WEAPON3': '1.150', 'HITCOUNT': '3.400', 'weapon3': '3.424', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '58.000'} [2024-08-06 08:21:14,590][52659] DAMAGECOUNT value on done: 960485.0 [2024-08-06 08:21:14,591][52659] Sum rewards: 70.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.122', 'weapon4': '0.132', 'AMMO4': '0.163', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.160', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '58.000'} [2024-08-06 08:21:14,719][52649] DAMAGECOUNT value on done: 940639.0 [2024-08-06 08:21:14,719][52649] Sum rewards: 83.736, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'HEALTH': '0.140', 'AMMO3': '0.205', 'weapon2': '0.274', 'WEAPON3': '1.150', 'weapon3': '3.402', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:15,076][52660] DAMAGECOUNT value on done: 963164.0 [2024-08-06 08:21:15,078][52660] Sum rewards: 77.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.074', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.195', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '62.000'} [2024-08-06 08:21:15,932][52662] DAMAGECOUNT value on done: 976621.0 [2024-08-06 08:21:15,933][52662] Sum rewards: 68.379, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.665', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.050', 'weapon5': '0.108', 'AMMO3': '0.183', 'AMMO4': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.100', 'DAMAGECOUNT': '16.167', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:16,185][52650] Updated weights for policy 0, policy_version 83511 (0.0012) [2024-08-06 08:21:17,240][52820] DAMAGECOUNT value on done: 897064.0 [2024-08-06 08:21:17,248][52820] Sum rewards: 60.101, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.220', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.116', 'AMMO3': '0.134', 'weapon2': '0.142', 'weapon5': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '0.850', 'weapon4': '0.992', 'weapon3': '2.008', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '15.327', 'FRAGCOUNT': '46.000'} [2024-08-06 08:21:17,305][52659] DAMAGECOUNT value on done: 972507.0 [2024-08-06 08:21:17,306][52659] Sum rewards: 89.340, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.240', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.163', 'weapon2': '0.240', 'WEAPON3': '0.950', 'weapon3': '3.448', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '71.000'} [2024-08-06 08:21:17,459][52664] DAMAGECOUNT value on done: 1010767.0 [2024-08-06 08:21:17,460][52664] Sum rewards: 83.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.745', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:17,625][52803] DAMAGECOUNT value on done: 904578.0 [2024-08-06 08:21:17,626][52803] Sum rewards: 65.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.701', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon5': '0.122', 'weapon4': '0.186', 'weapon2': '0.206', 'AMMO4': '0.212', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.216', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2024-08-06 08:21:17,702][52660] DAMAGECOUNT value on done: 968496.0 [2024-08-06 08:21:17,704][52660] Sum rewards: 68.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.706', 'AMMO5': '0.021', 'AMMO2': '0.051', 'AMMO3': '0.174', 'weapon4': '0.212', 'AMMO4': '0.257', 'weapon5': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.600', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '56.500'} [2024-08-06 08:21:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 684146688. Throughput: 0: 4358.4. Samples: 171035730. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:21:17,794][52567] Avg episode reward: [(0, '76.515')] [2024-08-06 08:21:18,628][52614] Signal inference workers to stop experience collection... (15300 times) [2024-08-06 08:21:18,629][52614] Signal inference workers to resume experience collection... (15300 times) [2024-08-06 08:21:18,703][52650] InferenceWorker_p0-w0: stopping experience collection (15300 times) [2024-08-06 08:21:18,703][52650] InferenceWorker_p0-w0: resuming experience collection (15300 times) [2024-08-06 08:21:18,866][52662] DAMAGECOUNT value on done: 966515.0 [2024-08-06 08:21:18,869][52662] Sum rewards: 73.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.620', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.149', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.281', 'weapon2': '0.296', 'WEAPON3': '1.600', 'weapon3': '3.170', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '65.000'} [2024-08-06 08:21:19,930][52659] DAMAGECOUNT value on done: 965307.0 [2024-08-06 08:21:19,933][52659] Sum rewards: 82.805, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.605', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon2': '0.136', 'AMMO4': '0.160', 'weapon5': '0.202', 'AMMO3': '0.231', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.146', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.167', 'FRAGCOUNT': '69.000'} [2024-08-06 08:21:20,379][52820] DAMAGECOUNT value on done: 885509.0 [2024-08-06 08:21:20,383][52820] Sum rewards: 89.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.110', 'AMMO4': '0.147', 'weapon5': '0.182', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.735', 'FRAGCOUNT': '72.000'} [2024-08-06 08:21:20,529][52664] DAMAGECOUNT value on done: 1006190.0 [2024-08-06 08:21:20,530][52664] Sum rewards: 88.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.202', 'weapon2': '0.420', 'WEAPON3': '1.300', 'weapon3': '3.362', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '72.000'} [2024-08-06 08:21:20,736][52803] DAMAGECOUNT value on done: 905961.0 [2024-08-06 08:21:20,739][52803] Sum rewards: 80.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.008', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.156', 'weapon4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:20,842][52660] DAMAGECOUNT value on done: 958216.0 [2024-08-06 08:21:20,844][52660] Sum rewards: 64.936, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.460', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.096', 'AMMO3': '0.141', 'weapon5': '0.142', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.850', 'weapon2': '0.920', 'weapon3': '2.678', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '50.500'} [2024-08-06 08:21:21,001][52650] Updated weights for policy 0, policy_version 83521 (0.0016) [2024-08-06 08:21:21,416][52662] DAMAGECOUNT value on done: 957580.0 [2024-08-06 08:21:21,416][52662] Sum rewards: 71.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.975', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.140', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.330', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '58.500'} [2024-08-06 08:21:22,498][52659] DAMAGECOUNT value on done: 963394.0 [2024-08-06 08:21:22,499][52659] Sum rewards: 78.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO5': '0.029', 'AMMO2': '0.077', 'AMMO3': '0.195', 'weapon5': '0.230', 'weapon4': '0.248', 'AMMO4': '0.387', 'weapon2': '0.566', 'WEAPON5': '0.750', 'WEAPON4': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.686', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 08:21:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 684228608. Throughput: 0: 4345.8. Samples: 171061720. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:22,794][52567] Avg episode reward: [(0, '76.682')] [2024-08-06 08:21:23,085][52664] DAMAGECOUNT value on done: 995325.0 [2024-08-06 08:21:23,087][52664] Sum rewards: 94.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.546', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.196', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon4': '0.218', 'AMMO4': '0.225', 'WEAPON5': '0.350', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.858', 'FRAGCOUNT': '75.000'} [2024-08-06 08:21:23,351][52660] DAMAGECOUNT value on done: 957394.0 [2024-08-06 08:21:23,352][52660] Sum rewards: 79.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.670', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon2': '0.174', 'weapon5': '0.216', 'AMMO3': '0.232', 'AMMO4': '0.254', 'weapon4': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '64.000'} [2024-08-06 08:21:23,454][52820] DAMAGECOUNT value on done: 895803.0 [2024-08-06 08:21:23,456][52820] Sum rewards: 72.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.912', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.116', 'AMMO4': '0.141', 'AMMO3': '0.182', 'weapon5': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.150', 'weapon3': '2.936', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '58.000'} [2024-08-06 08:21:23,949][52803] DAMAGECOUNT value on done: 911773.0 [2024-08-06 08:21:23,949][52803] Sum rewards: 78.346, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.105', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.132', 'weapon5': '0.216', 'AMMO3': '0.235', 'AMMO4': '0.260', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '65.000'} [2024-08-06 08:21:24,674][52662] DAMAGECOUNT value on done: 962978.0 [2024-08-06 08:21:24,676][52662] Sum rewards: 81.666, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.078', 'weapon4': '0.090', 'AMMO4': '0.165', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:25,585][52659] DAMAGECOUNT value on done: 966201.0 [2024-08-06 08:21:25,587][52659] Sum rewards: 65.984, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.378', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.177', 'weapon5': '0.186', 'AMMO3': '0.225', 'weapon4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '54.500'} [2024-08-06 08:21:25,736][52664] DAMAGECOUNT value on done: 996405.0 [2024-08-06 08:21:25,737][52664] Sum rewards: 70.903, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.041', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.210', 'AMMO4': '0.223', 'weapon2': '0.224', 'AMMO3': '0.234', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.744', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:25,908][52650] Updated weights for policy 0, policy_version 83531 (0.0013) [2024-08-06 08:21:26,116][52660] DAMAGECOUNT value on done: 963113.0 [2024-08-06 08:21:26,117][52660] Sum rewards: 67.395, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.698', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon5': '0.182', 'AMMO3': '0.221', 'weapon4': '0.272', 'AMMO4': '0.281', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '2.940', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '54.000'} [2024-08-06 08:21:26,731][52820] DAMAGECOUNT value on done: 882889.0 [2024-08-06 08:21:26,731][52820] Sum rewards: 85.908, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.326', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'weapon4': '0.058', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.278', 'WEAPON3': '1.150', 'weapon3': '3.418', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '70.000'} [2024-08-06 08:21:27,066][52803] DAMAGECOUNT value on done: 908769.0 [2024-08-06 08:21:27,067][52803] Sum rewards: 88.916, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.765', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.078', 'AMMO3': '0.170', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.420', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '71.000'} [2024-08-06 08:21:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 684318720. Throughput: 0: 4344.2. Samples: 171087890. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:27,795][52567] Avg episode reward: [(0, '76.507')] [2024-08-06 08:21:27,954][52662] DAMAGECOUNT value on done: 957829.0 [2024-08-06 08:21:27,954][52662] Sum rewards: 78.411, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.700', 'AMMO5': '0.017', 'AMMO2': '0.065', 'AMMO3': '0.199', 'weapon4': '0.200', 'weapon5': '0.256', 'AMMO4': '0.326', 'weapon2': '0.410', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.832', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.535', 'FRAGCOUNT': '64.000'} [2024-08-06 08:21:28,280][52659] DAMAGECOUNT value on done: 967199.0 [2024-08-06 08:21:28,281][52659] Sum rewards: 79.040, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.800', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.044', 'AMMO4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.616', 'WEAPON3': '1.350', 'weapon3': '3.190', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '65.000'} [2024-08-06 08:21:28,334][52664] DAMAGECOUNT value on done: 1003324.0 [2024-08-06 08:21:28,334][52664] Sum rewards: 82.062, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.524', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.432', 'WEAPON3': '1.550', 'weapon3': '3.192', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.583', 'FRAGCOUNT': '69.000'} [2024-08-06 08:21:29,088][52660] DAMAGECOUNT value on done: 957178.0 [2024-08-06 08:21:29,089][52660] Sum rewards: 73.128, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.320', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon2': '0.196', 'AMMO3': '0.321', 'WEAPON3': '1.900', 'weapon3': '3.482', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:29,857][52820] DAMAGECOUNT value on done: 889935.0 [2024-08-06 08:21:29,857][52820] Sum rewards: 84.884, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.505', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.219', 'AMMO4': '0.269', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.978', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.258', 'FRAGCOUNT': '70.000'} [2024-08-06 08:21:30,035][52803] DAMAGECOUNT value on done: 904217.0 [2024-08-06 08:21:30,037][52803] Sum rewards: 79.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.518', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.058', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.206', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:30,433][52650] Updated weights for policy 0, policy_version 83541 (0.0023) [2024-08-06 08:21:30,938][52664] DAMAGECOUNT value on done: 1001022.0 [2024-08-06 08:21:30,939][52664] Sum rewards: 64.307, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.880', 'AMMO5': '0.017', 'AMMO2': '0.026', 'weapon5': '0.070', 'weapon4': '0.098', 'AMMO4': '0.130', 'AMMO3': '0.161', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.050', 'weapon3': '3.104', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '52.000'} [2024-08-06 08:21:31,116][52659] DAMAGECOUNT value on done: 977561.0 [2024-08-06 08:21:31,116][52659] Sum rewards: 73.177, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.450', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.026', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.416', 'WEAPON3': '1.150', 'weapon3': '3.402', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '58.000'} [2024-08-06 08:21:32,312][52660] DAMAGECOUNT value on done: 957601.0 [2024-08-06 08:21:32,313][52660] Sum rewards: 82.117, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.532', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.056', 'weapon5': '0.122', 'AMMO4': '0.233', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.218', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:32,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 684408832. Throughput: 0: 4343.8. Samples: 171101180. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:32,794][52567] Avg episode reward: [(0, '76.724')] [2024-08-06 08:21:32,881][52820] DAMAGECOUNT value on done: 891747.0 [2024-08-06 08:21:32,882][52820] Sum rewards: 95.499, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.875', 'AMMO5': '0.003', 'weapon4': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.141', 'AMMO3': '0.178', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '3.348', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '22.158', 'FRAGCOUNT': '76.000'} [2024-08-06 08:21:33,814][52664] DAMAGECOUNT value on done: 1011283.0 [2024-08-06 08:21:33,815][52664] Sum rewards: 74.650, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.078', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO4': '0.191', 'weapon5': '0.216', 'AMMO3': '0.229', 'weapon2': '0.230', 'weapon4': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '63.000'} [2024-08-06 08:21:34,168][52659] DAMAGECOUNT value on done: 959200.0 [2024-08-06 08:21:34,169][52659] Sum rewards: 76.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.218', 'AMMO5': '0.006', 'AMMO2': '0.057', 'weapon5': '0.064', 'WEAPON5': '0.150', 'weapon2': '0.218', 'weapon4': '0.244', 'AMMO3': '0.263', 'AMMO4': '0.283', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.208', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '65.000'} [2024-08-06 08:21:34,821][52660] DAMAGECOUNT value on done: 968437.0 [2024-08-06 08:21:34,822][52660] Sum rewards: 84.186, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.360', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO4': '0.240', 'weapon4': '0.250', 'AMMO3': '0.293', 'weapon5': '0.294', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.708', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.903', 'FRAGCOUNT': '70.000'} [2024-08-06 08:21:35,288][52650] Updated weights for policy 0, policy_version 83551 (0.0024) [2024-08-06 08:21:36,111][52820] DAMAGECOUNT value on done: 899678.0 [2024-08-06 08:21:36,111][52820] Sum rewards: 81.027, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.641', 'AMMO5': '0.018', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon4': '0.116', 'AMMO3': '0.182', 'AMMO4': '0.195', 'weapon5': '0.210', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:36,372][52658] DAMAGECOUNT value on done: 971320.0 [2024-08-06 08:21:36,372][52658] Sum rewards: 74.161, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.723', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.160', 'weapon5': '0.180', 'AMMO3': '0.245', 'weapon2': '0.258', 'AMMO4': '0.280', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '65.000'} [2024-08-06 08:21:36,445][52669] DAMAGECOUNT value on done: 965919.0 [2024-08-06 08:21:36,445][52669] Sum rewards: 62.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.112', 'AMMO4': '0.193', 'AMMO3': '0.197', 'weapon5': '0.218', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.720', 'weapon3': '3.082', 'DAMAGECOUNT': '14.343', 'FRAGCOUNT': '52.000'} [2024-08-06 08:21:36,917][52664] DAMAGECOUNT value on done: 1007622.0 [2024-08-06 08:21:36,922][52664] Sum rewards: 85.556, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.642', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.070', 'weapon5': '0.182', 'AMMO4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'weapon2': '0.292', 'WEAPON3': '1.650', 'weapon3': '3.166', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '73.000'} [2024-08-06 08:21:37,119][52659] DAMAGECOUNT value on done: 972359.0 [2024-08-06 08:21:37,119][52659] Sum rewards: 81.502, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.000', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.222', 'AMMO3': '0.290', 'WEAPON3': '1.750', 'weapon3': '3.512', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '70.000'} [2024-08-06 08:21:37,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 684490752. Throughput: 0: 4350.2. Samples: 171127340. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:37,795][52567] Avg episode reward: [(0, '77.191')] [2024-08-06 08:21:37,817][52660] DAMAGECOUNT value on done: 982269.0 [2024-08-06 08:21:37,817][52660] Sum rewards: 94.124, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.085', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.088', 'AMMO3': '0.147', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.926', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '22.545', 'FRAGCOUNT': '73.000'} [2024-08-06 08:21:38,975][52669] DAMAGECOUNT value on done: 963366.0 [2024-08-06 08:21:38,976][52669] Sum rewards: 59.052, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.483', 'AMMO5': '0.012', 'AMMO2': '0.061', 'weapon4': '0.196', 'AMMO3': '0.211', 'weapon5': '0.238', 'AMMO4': '0.306', 'weapon2': '0.438', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.710', 'weapon3': '2.828', 'DAMAGECOUNT': '15.084', 'FRAGCOUNT': '50.000'} [2024-08-06 08:21:39,290][52820] DAMAGECOUNT value on done: 906875.0 [2024-08-06 08:21:39,292][52820] Sum rewards: 74.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.149', 'AMMO3': '0.179', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:39,408][52658] DAMAGECOUNT value on done: 970624.0 [2024-08-06 08:21:39,408][52658] Sum rewards: 72.836, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.008', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon4': '0.144', 'weapon5': '0.168', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.770', 'FRAGCOUNT': '62.000'} [2024-08-06 08:21:39,837][52664] DAMAGECOUNT value on done: 1005122.0 [2024-08-06 08:21:39,837][52664] Sum rewards: 81.160, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.032', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.050', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.194', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.498', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:39,913][52650] Updated weights for policy 0, policy_version 83561 (0.0011) [2024-08-06 08:21:40,283][52659] DAMAGECOUNT value on done: 963096.0 [2024-08-06 08:21:40,284][52659] Sum rewards: 71.417, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.010', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.094', 'AMMO4': '0.138', 'weapon5': '0.144', 'AMMO3': '0.168', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.190', 'weapon3': '3.304', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:40,341][52795] DAMAGECOUNT value on done: 890219.0 [2024-08-06 08:21:40,344][52795] Sum rewards: 80.343, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.672', 'AMMO5': '0.016', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.162', 'weapon4': '0.188', 'AMMO3': '0.220', 'weapon2': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.648', 'FRAGCOUNT': '66.500'} [2024-08-06 08:21:40,915][52660] DAMAGECOUNT value on done: 960923.0 [2024-08-06 08:21:40,916][52660] Sum rewards: 71.419, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.997', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.050', 'weapon5': '0.072', 'AMMO4': '0.224', 'AMMO3': '0.225', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.368', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:42,033][52669] DAMAGECOUNT value on done: 975448.0 [2024-08-06 08:21:42,034][52669] Sum rewards: 73.972, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.671', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.263', 'weapon2': '0.362', 'WEAPON3': '1.600', 'HITCOUNT': '3.330', 'weapon3': '3.392', 'DAMAGECOUNT': '18.765', 'FRAGCOUNT': '63.000'} [2024-08-06 08:21:42,066][52671] DAMAGECOUNT value on done: 972529.0 [2024-08-06 08:21:42,066][52671] Sum rewards: 69.746, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.625', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon4': '0.058', 'weapon5': '0.084', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.874', 'WEAPON3': '0.950', 'weapon3': '2.834', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '54.000'} [2024-08-06 08:21:42,372][52820] DAMAGECOUNT value on done: 888068.0 [2024-08-06 08:21:42,374][52820] Sum rewards: 66.203, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.914', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.100', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.628', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 08:21:42,453][52658] DAMAGECOUNT value on done: 974533.0 [2024-08-06 08:21:42,453][52658] Sum rewards: 88.631, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.375', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO3': '0.158', 'weapon5': '0.194', 'AMMO4': '0.196', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.904', 'FRAGCOUNT': '69.000'} [2024-08-06 08:21:42,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 684572672. Throughput: 0: 4356.0. Samples: 171153670. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:42,795][52567] Avg episode reward: [(0, '76.714')] [2024-08-06 08:21:42,966][52664] DAMAGECOUNT value on done: 1017488.0 [2024-08-06 08:21:42,966][52664] Sum rewards: 69.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.631', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.136', 'AMMO3': '0.206', 'AMMO4': '0.215', 'weapon2': '0.226', 'weapon5': '0.228', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.170', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:43,380][52660] DAMAGECOUNT value on done: 966500.0 [2024-08-06 08:21:43,380][52660] Sum rewards: 64.446, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.752', 'AMMO5': '0.015', 'ARMOR': '0.020', 'AMMO2': '0.031', 'AMMO3': '0.125', 'AMMO4': '0.156', 'weapon5': '0.216', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '0.800', 'weapon4': '1.064', 'weapon3': '2.276', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '14.070', 'FRAGCOUNT': '50.000'} [2024-08-06 08:21:43,528][52795] DAMAGECOUNT value on done: 884892.0 [2024-08-06 08:21:43,531][52795] Sum rewards: 81.058, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.871', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.150', 'weapon5': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon4': '0.208', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.038', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:44,439][52650] Updated weights for policy 0, policy_version 83571 (0.0021) [2024-08-06 08:21:44,450][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:21:44,954][52669] DAMAGECOUNT value on done: 967610.0 [2024-08-06 08:21:44,954][52669] Sum rewards: 73.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.888', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.140', 'weapon2': '0.186', 'weapon4': '0.198', 'AMMO4': '0.205', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:44,958][52658] DAMAGECOUNT value on done: 969768.0 [2024-08-06 08:21:44,958][52658] Sum rewards: 79.442, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.978', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.102', 'AMMO3': '0.212', 'AMMO4': '0.241', 'weapon5': '0.256', 'weapon2': '0.376', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.002', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '67.000'} [2024-08-06 08:21:45,380][52671] DAMAGECOUNT value on done: 979313.0 [2024-08-06 08:21:45,380][52671] Sum rewards: 71.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.189', 'weapon2': '0.396', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.916', 'FRAGCOUNT': '59.000'} [2024-08-06 08:21:45,482][52820] DAMAGECOUNT value on done: 899624.0 [2024-08-06 08:21:45,482][52820] Sum rewards: 71.743, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.054', 'AMMO4': '0.185', 'weapon5': '0.186', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.602', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:45,757][52664] DAMAGECOUNT value on done: 1013778.0 [2024-08-06 08:21:45,759][52664] Sum rewards: 70.750, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.277', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.056', 'weapon5': '0.128', 'AMMO4': '0.214', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.450', 'weapon3': '3.316', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '59.000'} [2024-08-06 08:21:46,402][52660] DAMAGECOUNT value on done: 963437.0 [2024-08-06 08:21:46,403][52660] Sum rewards: 64.521, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.438', 'AMMO5': '0.013', 'AMMO2': '0.044', 'AMMO3': '0.172', 'weapon5': '0.218', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.050', 'weapon3': '2.808', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.462', 'FRAGCOUNT': '52.000'} [2024-08-06 08:21:46,674][52795] DAMAGECOUNT value on done: 887754.0 [2024-08-06 08:21:46,677][52795] Sum rewards: 85.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.560', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.150', 'weapon2': '0.162', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.322', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:47,545][52658] DAMAGECOUNT value on done: 962178.0 [2024-08-06 08:21:47,546][52658] Sum rewards: 72.370, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.106', 'weapon4': '0.148', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:47,749][52669] DAMAGECOUNT value on done: 975740.0 [2024-08-06 08:21:47,751][52669] Sum rewards: 68.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.835', 'AMMO5': '0.015', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO3': '0.140', 'AMMO4': '0.143', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'weapon4': '0.614', 'WEAPON3': '0.900', 'weapon3': '2.522', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '56.000'} [2024-08-06 08:21:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 684670976. Throughput: 0: 4360.2. Samples: 171166760. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:47,794][52567] Avg episode reward: [(0, '76.461')] [2024-08-06 08:21:48,303][52664] DAMAGECOUNT value on done: 1013255.0 [2024-08-06 08:21:48,303][52664] Sum rewards: 76.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.816', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.012', 'AMMO4': '0.042', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.209', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.374', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '62.000'} [2024-08-06 08:21:48,586][52671] DAMAGECOUNT value on done: 972076.0 [2024-08-06 08:21:48,587][52671] Sum rewards: 74.740, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.340', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO5': '0.006', 'weapon5': '0.074', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.666', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '60.000'} [2024-08-06 08:21:48,637][52820] DAMAGECOUNT value on done: 912239.0 [2024-08-06 08:21:48,639][52820] Sum rewards: 77.167, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.849', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.158', 'weapon5': '0.164', 'AMMO4': '0.232', 'weapon2': '0.270', 'AMMO3': '0.288', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.140', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:49,188][52650] Updated weights for policy 0, policy_version 83581 (0.0032) [2024-08-06 08:21:49,291][52660] DAMAGECOUNT value on done: 954081.0 [2024-08-06 08:21:49,291][52660] Sum rewards: 64.854, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.385', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.037', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.186', 'AMMO3': '0.204', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '52.000'} [2024-08-06 08:21:49,859][52795] DAMAGECOUNT value on done: 901348.0 [2024-08-06 08:21:49,859][52795] Sum rewards: 82.927, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO5': '0.004', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.220', 'AMMO3': '0.223', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:50,693][52669] DAMAGECOUNT value on done: 973324.0 [2024-08-06 08:21:50,693][52669] Sum rewards: 77.182, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'HEALTH': '0.242', 'weapon2': '0.864', 'WEAPON3': '0.900', 'weapon3': '2.742', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '62.000'} [2024-08-06 08:21:50,799][52658] DAMAGECOUNT value on done: 962064.0 [2024-08-06 08:21:50,800][52658] Sum rewards: 93.483, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.136', 'weapon4': '0.142', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.452', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '4.390', 'DAMAGECOUNT': '22.215', 'FRAGCOUNT': '76.000'} [2024-08-06 08:21:51,262][52664] DAMAGECOUNT value on done: 997245.0 [2024-08-06 08:21:51,263][52664] Sum rewards: 81.810, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.715', 'AMMO5': '0.024', 'AMMO2': '0.064', 'AMMO3': '0.190', 'weapon5': '0.300', 'weapon4': '0.304', 'AMMO4': '0.321', 'weapon2': '0.414', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.100', 'weapon3': '2.692', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '64.500'} [2024-08-06 08:21:51,549][52671] DAMAGECOUNT value on done: 978303.0 [2024-08-06 08:21:51,550][52671] Sum rewards: 76.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.970', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.114', 'weapon5': '0.116', 'AMMO4': '0.192', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.144', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:51,788][52820] DAMAGECOUNT value on done: 900687.0 [2024-08-06 08:21:51,788][52820] Sum rewards: 84.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.464', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.030', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '69.000'} [2024-08-06 08:21:52,242][52660] DAMAGECOUNT value on done: 956003.0 [2024-08-06 08:21:52,245][52660] Sum rewards: 81.847, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon4': '0.164', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '68.000'} [2024-08-06 08:21:52,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 684752896. Throughput: 0: 4357.8. Samples: 171193020. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:52,795][52567] Avg episode reward: [(0, '76.608')] [2024-08-06 08:21:53,091][52795] DAMAGECOUNT value on done: 886167.0 [2024-08-06 08:21:53,091][52795] Sum rewards: 94.074, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.533', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.182', 'AMMO4': '0.198', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.639', 'FRAGCOUNT': '76.000'} [2024-08-06 08:21:53,222][52669] DAMAGECOUNT value on done: 973729.0 [2024-08-06 08:21:53,225][52669] Sum rewards: 67.583, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.620', 'AMMO5': '0.028', 'AMMO2': '0.062', 'AMMO3': '0.193', 'weapon5': '0.214', 'weapon4': '0.292', 'AMMO4': '0.311', 'weapon2': '0.410', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'weapon3': '2.742', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 08:21:53,518][52650] Updated weights for policy 0, policy_version 83591 (0.0021) [2024-08-06 08:21:53,863][52658] DAMAGECOUNT value on done: 974245.0 [2024-08-06 08:21:53,863][52671] DAMAGECOUNT value on done: 984066.0 [2024-08-06 08:21:53,863][52671] Sum rewards: 80.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.481', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.054', 'AMMO4': '0.106', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.100', 'weapon3': '3.534', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '65.000'} [2024-08-06 08:21:53,863][52658] Sum rewards: 85.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.392', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '69.000'} [2024-08-06 08:21:54,282][52664] DAMAGECOUNT value on done: 1000752.0 [2024-08-06 08:21:54,286][52664] Sum rewards: 80.621, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.058', 'AMMO4': '0.179', 'weapon5': '0.184', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '64.000'} [2024-08-06 08:21:55,007][52820] DAMAGECOUNT value on done: 897824.0 [2024-08-06 08:21:55,007][52820] Sum rewards: 81.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.880', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'weapon4': '0.208', 'weapon2': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.254', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '66.000'} [2024-08-06 08:21:56,120][52795] DAMAGECOUNT value on done: 889682.0 [2024-08-06 08:21:56,124][52795] Sum rewards: 60.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.510', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.156', 'AMMO3': '0.200', 'AMMO4': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.150', 'HITCOUNT': '2.950', 'weapon3': '3.114', 'DAMAGECOUNT': '14.700', 'FRAGCOUNT': '50.000'} [2024-08-06 08:21:56,137][52669] DAMAGECOUNT value on done: 972909.0 [2024-08-06 08:21:56,137][52669] Sum rewards: 78.776, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.745', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.140', 'AMMO3': '0.173', 'weapon4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.250', 'weapon3': '3.010', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '63.000'} [2024-08-06 08:21:56,913][52671] DAMAGECOUNT value on done: 972086.0 [2024-08-06 08:21:56,915][52671] Sum rewards: 86.577, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.175', 'AMMO3': '0.208', 'weapon2': '0.222', 'WEAPON5': '0.250', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '71.000'} [2024-08-06 08:21:56,942][52664] DAMAGECOUNT value on done: 1012123.0 [2024-08-06 08:21:56,942][52664] Sum rewards: 86.119, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.197', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.060', 'AMMO4': '0.106', 'weapon4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.220', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.416', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '73.000'} [2024-08-06 08:21:56,976][52658] DAMAGECOUNT value on done: 961566.0 [2024-08-06 08:21:56,977][52658] Sum rewards: 74.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.566', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon4': '0.022', 'weapon5': '0.028', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.436', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 684843008. Throughput: 0: 4364.2. Samples: 171219130. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:21:57,802][52567] Avg episode reward: [(0, '77.110')] [2024-08-06 08:21:58,121][52820] DAMAGECOUNT value on done: 898350.0 [2024-08-06 08:21:58,123][52820] Sum rewards: 81.413, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.085', 'AMMO2': '0.008', 'AMMO4': '0.040', 'AMMO3': '0.158', 'weapon2': '0.412', 'WEAPON3': '1.050', 'weapon3': '3.480', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '64.000'} [2024-08-06 08:21:58,887][52650] Updated weights for policy 0, policy_version 83601 (0.0012) [2024-08-06 08:21:59,130][52663] DAMAGECOUNT value on done: 985720.0 [2024-08-06 08:21:59,130][52663] Sum rewards: 75.668, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.672', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.124', 'weapon4': '0.146', 'AMMO4': '0.174', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:59,168][52669] DAMAGECOUNT value on done: 981380.0 [2024-08-06 08:21:59,170][52669] Sum rewards: 74.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.815', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.039', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'AMMO4': '0.197', 'weapon2': '0.660', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '61.000'} [2024-08-06 08:21:59,308][52795] DAMAGECOUNT value on done: 902326.0 [2024-08-06 08:21:59,311][52795] Sum rewards: 79.863, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.066', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.192', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.322', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '63.000'} [2024-08-06 08:21:59,599][52664] DAMAGECOUNT value on done: 995215.0 [2024-08-06 08:21:59,600][52664] Sum rewards: 64.077, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.134', 'AMMO4': '0.157', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.350', 'HITCOUNT': '3.050', 'weapon3': '3.066', 'DAMAGECOUNT': '15.381', 'FRAGCOUNT': '54.000'} [2024-08-06 08:21:59,900][52671] DAMAGECOUNT value on done: 973500.0 [2024-08-06 08:21:59,902][52671] Sum rewards: 74.563, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.448', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon5': '0.068', 'weapon4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.163', 'weapon2': '0.600', 'WEAPON3': '1.000', 'weapon3': '3.080', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '60.000'} [2024-08-06 08:22:00,224][52658] DAMAGECOUNT value on done: 989550.0 [2024-08-06 08:22:00,224][52658] Sum rewards: 78.890, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.570', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO4': '0.141', 'weapon5': '0.160', 'weapon2': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.305', 'WEAPON3': '1.850', 'weapon3': '3.268', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '68.000'} [2024-08-06 08:22:01,366][52820] DAMAGECOUNT value on done: 898716.0 [2024-08-06 08:22:01,368][52820] Sum rewards: 85.212, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.780', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.056', 'weapon5': '0.124', 'AMMO4': '0.176', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '69.000'} [2024-08-06 08:22:02,301][52663] DAMAGECOUNT value on done: 969727.0 [2024-08-06 08:22:02,301][52663] Sum rewards: 78.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.036', 'weapon4': '0.072', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'weapon2': '0.292', 'AMMO3': '0.295', 'WEAPON3': '1.700', 'weapon3': '3.396', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '67.000'} [2024-08-06 08:22:02,478][52795] DAMAGECOUNT value on done: 893021.0 [2024-08-06 08:22:02,478][52795] Sum rewards: 80.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.264', 'AMMO5': '0.017', 'AMMO2': '0.052', 'AMMO3': '0.177', 'weapon4': '0.188', 'weapon5': '0.240', 'AMMO4': '0.260', 'weapon2': '0.280', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.000', 'weapon3': '3.010', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '65.000'} [2024-08-06 08:22:02,500][52669] DAMAGECOUNT value on done: 972634.0 [2024-08-06 08:22:02,500][52669] Sum rewards: 77.000, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.531', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon4': '0.244', 'weapon2': '0.396', 'ARMOR': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '60.000'} [2024-08-06 08:22:02,596][52671] DAMAGECOUNT value on done: 978677.0 [2024-08-06 08:22:02,598][52671] Sum rewards: 77.973, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.649', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.062', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.414', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '64.000'} [2024-08-06 08:22:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 684933120. Throughput: 0: 4365.3. Samples: 171232170. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:22:02,794][52567] Avg episode reward: [(0, '77.134')] [2024-08-06 08:22:03,292][52658] DAMAGECOUNT value on done: 976681.0 [2024-08-06 08:22:03,295][52658] Sum rewards: 94.780, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.196', 'weapon2': '0.316', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '4.480', 'DAMAGECOUNT': '22.704', 'FRAGCOUNT': '77.000'} [2024-08-06 08:22:03,298][52660] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.513, 171.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:22:03,323][52650] Updated weights for policy 0, policy_version 83611 (0.0011) [2024-08-06 08:22:04,399][52820] DAMAGECOUNT value on done: 906493.0 [2024-08-06 08:22:04,399][52820] Sum rewards: 84.073, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.305', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.090', 'weapon5': '0.132', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '66.000'} [2024-08-06 08:22:05,482][52663] DAMAGECOUNT value on done: 964587.0 [2024-08-06 08:22:05,484][52663] Sum rewards: 81.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.675', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.118', 'weapon5': '0.186', 'weapon2': '0.200', 'AMMO3': '0.236', 'AMMO4': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '70.000'} [2024-08-06 08:22:05,512][52671] DAMAGECOUNT value on done: 959513.0 [2024-08-06 08:22:05,512][52671] Sum rewards: 78.776, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.279', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.028', 'AMMO4': '0.077', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.374', 'WEAPON3': '1.150', 'weapon3': '3.442', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '64.000'} [2024-08-06 08:22:05,540][52669] DAMAGECOUNT value on done: 978748.0 [2024-08-06 08:22:05,542][52669] Sum rewards: 70.630, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.424', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.138', 'AMMO3': '0.218', 'weapon4': '0.222', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '60.000'} [2024-08-06 08:22:05,588][52795] DAMAGECOUNT value on done: 892295.0 [2024-08-06 08:22:05,589][52795] Sum rewards: 76.495, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.118', 'weapon5': '0.160', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.408', 'WEAPON3': '1.100', 'weapon3': '3.162', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '61.000'} [2024-08-06 08:22:06,153][52658] DAMAGECOUNT value on done: 981125.0 [2024-08-06 08:22:06,153][52658] Sum rewards: 88.179, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.070', 'weapon4': '0.084', 'AMMO4': '0.128', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.162', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '72.500'} [2024-08-06 08:22:07,649][52820] DAMAGECOUNT value on done: 907555.0 [2024-08-06 08:22:07,650][52820] Sum rewards: 79.561, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.096', 'weapon5': '0.186', 'AMMO3': '0.203', 'AMMO4': '0.204', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.164', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '64.000'} [2024-08-06 08:22:07,701][52650] Updated weights for policy 0, policy_version 83621 (0.0012) [2024-08-06 08:22:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 685023232. Throughput: 0: 4371.6. Samples: 171258440. Policy #0 lag: (min: 1.0, avg: 3.7, max: 7.0) [2024-08-06 08:22:07,794][52567] Avg episode reward: [(0, '77.766')] [2024-08-06 08:22:08,170][52663] DAMAGECOUNT value on done: 972608.0 [2024-08-06 08:22:08,173][52663] Sum rewards: 89.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon4': '0.168', 'AMMO3': '0.207', 'weapon5': '0.252', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.034', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '21.396', 'FRAGCOUNT': '72.000'} [2024-08-06 08:22:08,272][52669] DAMAGECOUNT value on done: 979318.0 [2024-08-06 08:22:08,272][52669] Sum rewards: 76.264, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.978', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.164', 'weapon2': '0.198', 'AMMO3': '0.200', 'weapon4': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '62.000'} [2024-08-06 08:22:08,603][52671] DAMAGECOUNT value on done: 974708.0 [2024-08-06 08:22:08,605][52671] Sum rewards: 80.891, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.482', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.170', 'weapon5': '0.220', 'AMMO3': '0.226', 'AMMO4': '0.245', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.926', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '66.000'} [2024-08-06 08:22:08,677][52795] DAMAGECOUNT value on done: 900951.0 [2024-08-06 08:22:08,680][52795] Sum rewards: 83.900, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.140', 'AMMO4': '0.179', 'AMMO3': '0.199', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '68.000'} [2024-08-06 08:22:09,058][52658] DAMAGECOUNT value on done: 966494.0 [2024-08-06 08:22:09,058][52658] Sum rewards: 83.657, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.437', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'AMMO3': '0.218', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '68.000'} [2024-08-06 08:22:10,762][52820] DAMAGECOUNT value on done: 895076.0 [2024-08-06 08:22:10,763][52820] Sum rewards: 76.812, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.599', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.048', 'weapon5': '0.072', 'AMMO3': '0.160', 'AMMO4': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.880', 'WEAPON3': '0.950', 'weapon3': '2.858', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '61.000'} [2024-08-06 08:22:11,332][52663] DAMAGECOUNT value on done: 970380.0 [2024-08-06 08:22:11,334][52663] Sum rewards: 92.294, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.542', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.132', 'AMMO4': '0.173', 'weapon2': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'weapon3': '3.344', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '22.125', 'FRAGCOUNT': '78.000'} [2024-08-06 08:22:11,496][52669] DAMAGECOUNT value on done: 965913.0 [2024-08-06 08:22:11,497][52669] Sum rewards: 77.181, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.170', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO3': '0.156', 'AMMO4': '0.184', 'weapon5': '0.194', 'weapon2': '0.234', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '63.000'} [2024-08-06 08:22:11,641][52671] DAMAGECOUNT value on done: 974067.0 [2024-08-06 08:22:11,641][52671] Sum rewards: 87.181, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.760', 'AMMO5': '0.007', 'AMMO2': '0.059', 'weapon4': '0.078', 'weapon5': '0.116', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'AMMO4': '0.294', 'weapon2': '0.298', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '22.338', 'FRAGCOUNT': '71.000'} [2024-08-06 08:22:11,750][52658] DAMAGECOUNT value on done: 980052.0 [2024-08-06 08:22:11,750][52658] Sum rewards: 68.537, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.510', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.070', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '54.000'} [2024-08-06 08:22:11,986][52795] DAMAGECOUNT value on done: 894844.0 [2024-08-06 08:22:11,986][52795] Sum rewards: 79.543, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.554', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.215', 'weapon2': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.474', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '66.000'} [2024-08-06 08:22:12,605][52650] Updated weights for policy 0, policy_version 83631 (0.0036) [2024-08-06 08:22:12,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 685105152. Throughput: 0: 4373.3. Samples: 171284690. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:12,795][52567] Avg episode reward: [(0, '77.935')] [2024-08-06 08:22:14,163][52663] DAMAGECOUNT value on done: 976542.0 [2024-08-06 08:22:14,165][52663] Sum rewards: 68.335, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.245', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.066', 'AMMO3': '0.186', 'weapon2': '0.526', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '55.000'} [2024-08-06 08:22:14,179][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:22:14,322][52669] DAMAGECOUNT value on done: 966282.0 [2024-08-06 08:22:14,322][52669] Sum rewards: 66.412, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.620', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.148', 'weapon5': '0.198', 'AMMO4': '0.208', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON4': '0.400', 'weapon4': '0.406', 'WEAPON3': '0.850', 'weapon3': '2.844', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.017', 'FRAGCOUNT': '51.000'} [2024-08-06 08:22:14,395][52671] DAMAGECOUNT value on done: 971825.0 [2024-08-06 08:22:14,395][52671] Sum rewards: 77.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.025', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.060', 'AMMO3': '0.132', 'weapon5': '0.134', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '0.850', 'weapon3': '3.106', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 08:22:14,701][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:22:14,718][52658] DAMAGECOUNT value on done: 967634.0 [2024-08-06 08:22:14,718][52658] Sum rewards: 78.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.860', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.056', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.266', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '64.500'} [2024-08-06 08:22:15,296][52795] DAMAGECOUNT value on done: 887294.0 [2024-08-06 08:22:15,305][52795] Sum rewards: 75.646, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.328', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon5': '0.154', 'weapon4': '0.164', 'AMMO3': '0.214', 'AMMO4': '0.246', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '64.000'} [2024-08-06 08:22:15,580][52794] DAMAGECOUNT value on done: 966057.0 [2024-08-06 08:22:15,580][52794] Sum rewards: 83.567, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.658', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.164', 'weapon2': '0.394', 'WEAPON3': '1.000', 'weapon3': '3.086', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '66.000'} [2024-08-06 08:22:17,109][52650] Updated weights for policy 0, policy_version 83641 (0.0023) [2024-08-06 08:22:17,234][52663] DAMAGECOUNT value on done: 969820.0 [2024-08-06 08:22:17,235][52663] Sum rewards: 78.064, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.480', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'weapon4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '67.000'} [2024-08-06 08:22:17,344][52669] DAMAGECOUNT value on done: 976279.0 [2024-08-06 08:22:17,344][52669] Sum rewards: 91.074, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.418', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.090', 'AMMO4': '0.139', 'AMMO3': '0.148', 'WEAPON5': '0.200', 'weapon2': '0.214', 'weapon4': '0.252', 'WEAPON4': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.280', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '71.000'} [2024-08-06 08:22:17,755][52671] DAMAGECOUNT value on done: 973825.0 [2024-08-06 08:22:17,757][52671] Sum rewards: 77.010, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.131', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.310', 'weapon2': '0.394', 'WEAPON3': '1.050', 'weapon3': '3.268', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.000'} [2024-08-06 08:22:17,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 685195264. Throughput: 0: 4372.6. Samples: 171297950. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:17,795][52567] Avg episode reward: [(0, '77.937')] [2024-08-06 08:22:18,039][52794] DAMAGECOUNT value on done: 973368.0 [2024-08-06 08:22:18,041][52794] Sum rewards: 73.172, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.885', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO3': '0.155', 'weapon4': '0.162', 'AMMO4': '0.181', 'weapon5': '0.252', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.000', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '59.000'} [2024-08-06 08:22:18,146][52658] DAMAGECOUNT value on done: 972487.0 [2024-08-06 08:22:18,148][52658] Sum rewards: 74.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.985', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.068', 'AMMO4': '0.198', 'weapon5': '0.198', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.346', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '63.000'} [2024-08-06 08:22:18,514][52795] DAMAGECOUNT value on done: 892083.0 [2024-08-06 08:22:18,516][52795] Sum rewards: 69.111, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.536', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.076', 'AMMO3': '0.114', 'AMMO4': '0.153', 'weapon4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '0.700', 'weapon2': '0.892', 'weapon3': '2.640', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.588', 'FRAGCOUNT': '53.000'} [2024-08-06 08:22:20,386][52663] DAMAGECOUNT value on done: 952845.0 [2024-08-06 08:22:20,388][52663] Sum rewards: 72.673, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.798', 'AMMO5': '0.016', 'AMMO2': '0.052', 'AMMO3': '0.164', 'weapon4': '0.234', 'AMMO4': '0.262', 'weapon5': '0.326', 'weapon2': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.878', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '57.000'} [2024-08-06 08:22:20,439][52669] DAMAGECOUNT value on done: 994265.0 [2024-08-06 08:22:20,444][52669] Sum rewards: 79.140, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.308', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.112', 'weapon4': '0.136', 'AMMO4': '0.139', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.908', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '64.000'} [2024-08-06 08:22:20,575][52671] DAMAGECOUNT value on done: 975327.0 [2024-08-06 08:22:20,575][52671] Sum rewards: 72.791, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.356', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon5': '0.192', 'AMMO3': '0.211', 'weapon4': '0.214', 'AMMO4': '0.287', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '61.000'} [2024-08-06 08:22:21,013][52794] DAMAGECOUNT value on done: 979169.0 [2024-08-06 08:22:21,014][52794] Sum rewards: 76.262, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.013', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.186', 'weapon5': '0.214', 'weapon4': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.150', 'weapon3': '2.798', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '61.000'} [2024-08-06 08:22:21,064][52658] DAMAGECOUNT value on done: 957848.0 [2024-08-06 08:22:21,064][52658] Sum rewards: 83.903, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.524', 'AMMO5': '0.011', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.062', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'AMMO3': '0.226', 'weapon2': '0.228', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.484', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '70.000'} [2024-08-06 08:22:21,746][52795] DAMAGECOUNT value on done: 898510.0 [2024-08-06 08:22:21,748][52795] Sum rewards: 81.785, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.775', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.130', 'AMMO4': '0.171', 'weapon5': '0.214', 'weapon2': '0.244', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.126', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.046', 'FRAGCOUNT': '69.000'} [2024-08-06 08:22:21,904][52650] Updated weights for policy 0, policy_version 83651 (0.0021) [2024-08-06 08:22:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 685277184. Throughput: 0: 4373.8. Samples: 171324160. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:22,794][52567] Avg episode reward: [(0, '77.671')] [2024-08-06 08:22:23,070][52671] DAMAGECOUNT value on done: 959022.0 [2024-08-06 08:22:23,070][52671] Sum rewards: 82.965, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.126', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.188', 'AMMO3': '0.219', 'weapon2': '0.248', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '67.000'} [2024-08-06 08:22:23,521][52663] DAMAGECOUNT value on done: 966327.0 [2024-08-06 08:22:23,521][52663] Sum rewards: 80.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.120', 'weapon2': '0.210', 'AMMO3': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '67.000'} [2024-08-06 08:22:23,583][52669] DAMAGECOUNT value on done: 981467.0 [2024-08-06 08:22:23,583][52669] Sum rewards: 84.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.450', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.203', 'weapon4': '0.234', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '69.000'} [2024-08-06 08:22:24,025][52794] DAMAGECOUNT value on done: 964953.0 [2024-08-06 08:22:24,028][52794] Sum rewards: 73.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.916', 'AMMO5': '0.014', 'AMMO2': '0.038', 'AMMO3': '0.180', 'AMMO4': '0.190', 'weapon5': '0.234', 'weapon2': '0.244', 'weapon4': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.830', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '58.000'} [2024-08-06 08:22:24,165][52658] DAMAGECOUNT value on done: 972889.0 [2024-08-06 08:22:24,165][52658] Sum rewards: 71.792, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.940', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.044', 'weapon5': '0.140', 'AMMO3': '0.183', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.816', 'WEAPON3': '1.300', 'weapon3': '2.830', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '57.000'} [2024-08-06 08:22:24,478][52664] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:22:24,922][52795] DAMAGECOUNT value on done: 885239.0 [2024-08-06 08:22:24,922][52795] Sum rewards: 71.124, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.910', 'AMMO5': '0.016', 'AMMO2': '0.056', 'AMMO3': '0.127', 'weapon5': '0.274', 'AMMO4': '0.281', 'weapon4': '0.340', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'weapon2': '0.598', 'WEAPON3': '0.800', 'weapon3': '2.512', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '54.000'} [2024-08-06 08:22:25,503][52671] DAMAGECOUNT value on done: 984338.0 [2024-08-06 08:22:25,504][52671] Sum rewards: 67.195, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.662', 'WEAPON1': '0.020', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.122', 'weapon5': '0.218', 'AMMO3': '0.269', 'AMMO4': '0.273', 'weapon2': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.018', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.999', 'FRAGCOUNT': '60.000'} [2024-08-06 08:22:26,308][52663] DAMAGECOUNT value on done: 964543.0 [2024-08-06 08:22:26,308][52663] Sum rewards: 62.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.106', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'AMMO3': '0.166', 'weapon4': '0.240', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '2.910', 'weapon3': '3.146', 'DAMAGECOUNT': '14.676', 'FRAGCOUNT': '52.000'} [2024-08-06 08:22:26,401][52669] DAMAGECOUNT value on done: 979570.0 [2024-08-06 08:22:26,402][52669] Sum rewards: 69.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.146', 'weapon4': '0.148', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '56.000'} [2024-08-06 08:22:26,679][52650] Updated weights for policy 0, policy_version 83661 (0.0013) [2024-08-06 08:22:26,858][52794] DAMAGECOUNT value on done: 960704.0 [2024-08-06 08:22:26,860][52794] Sum rewards: 81.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.348', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'weapon4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.228', 'weapon2': '0.602', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '68.000'} [2024-08-06 08:22:27,437][52658] DAMAGECOUNT value on done: 969240.0 [2024-08-06 08:22:27,441][52658] Sum rewards: 86.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.120', 'AMMO3': '0.205', 'weapon2': '0.288', 'WEAPON3': '1.350', 'weapon3': '3.382', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '71.000'} [2024-08-06 08:22:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 685367296. Throughput: 0: 4367.8. Samples: 171350220. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:27,794][52567] Avg episode reward: [(0, '77.604')] [2024-08-06 08:22:27,828][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083664_685375488.pth... [2024-08-06 08:22:27,987][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083151_681172992.pth [2024-08-06 08:22:28,222][52795] DAMAGECOUNT value on done: 894914.0 [2024-08-06 08:22:28,222][52795] Sum rewards: 81.691, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '66.000'} [2024-08-06 08:22:28,771][52671] DAMAGECOUNT value on done: 981602.0 [2024-08-06 08:22:28,775][52671] Sum rewards: 76.191, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.138', 'AMMO4': '0.157', 'AMMO3': '0.159', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '0.950', 'HITCOUNT': '3.140', 'weapon3': '3.194', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '61.000'} [2024-08-06 08:22:29,335][52663] DAMAGECOUNT value on done: 972553.0 [2024-08-06 08:22:29,336][52663] Sum rewards: 63.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.823', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.094', 'AMMO3': '0.159', 'AMMO4': '0.164', 'weapon5': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.832', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '51.000'} [2024-08-06 08:22:29,342][52669] DAMAGECOUNT value on done: 983800.0 [2024-08-06 08:22:29,343][52669] Sum rewards: 82.311, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.436', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.080', 'AMMO4': '0.119', 'weapon5': '0.130', 'AMMO3': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.100', 'weapon3': '3.274', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '65.000'} [2024-08-06 08:22:29,477][52794] DAMAGECOUNT value on done: 963688.0 [2024-08-06 08:22:29,478][52794] Sum rewards: 65.736, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.198', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.106', 'AMMO3': '0.253', 'AMMO4': '0.259', 'weapon5': '0.288', 'weapon2': '0.416', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.806', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '56.000'} [2024-08-06 08:22:30,048][52658] DAMAGECOUNT value on done: 964434.0 [2024-08-06 08:22:30,049][52658] Sum rewards: 75.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.493', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon5': '0.194', 'weapon2': '0.254', 'AMMO3': '0.255', 'AMMO4': '0.280', 'WEAPON5': '0.350', 'weapon4': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.912', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '62.000'} [2024-08-06 08:22:31,199][52650] Updated weights for policy 0, policy_version 83671 (0.0023) [2024-08-06 08:22:31,544][52795] DAMAGECOUNT value on done: 896341.0 [2024-08-06 08:22:31,545][52795] Sum rewards: 80.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.133', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'weapon5': '0.284', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon3': '2.864', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '65.000'} [2024-08-06 08:22:31,940][52671] DAMAGECOUNT value on done: 974597.0 [2024-08-06 08:22:31,941][52671] Sum rewards: 78.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.283', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.184', 'AMMO4': '0.207', 'AMMO3': '0.234', 'weapon4': '0.240', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.818', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.562', 'FRAGCOUNT': '63.000'} [2024-08-06 08:22:32,271][52794] DAMAGECOUNT value on done: 967954.0 [2024-08-06 08:22:32,271][52794] Sum rewards: 70.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.072', 'AMMO4': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.542', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.551', 'FRAGCOUNT': '58.000'} [2024-08-06 08:22:32,373][52669] DAMAGECOUNT value on done: 985793.0 [2024-08-06 08:22:32,374][52669] Sum rewards: 77.522, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.365', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.264', 'AMMO3': '0.278', 'WEAPON3': '1.800', 'weapon3': '3.410', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '68.000'} [2024-08-06 08:22:32,406][52663] DAMAGECOUNT value on done: 957185.0 [2024-08-06 08:22:32,406][52663] Sum rewards: 71.088, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.147', 'AMMO3': '0.172', 'weapon5': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.718', 'WEAPON3': '1.050', 'weapon3': '2.754', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.692', 'FRAGCOUNT': '58.000'} [2024-08-06 08:22:32,505][52658] DAMAGECOUNT value on done: 972529.0 [2024-08-06 08:22:32,505][52658] Sum rewards: 82.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.164', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.180', 'weapon4': '0.210', 'AMMO3': '0.215', 'AMMO4': '0.222', 'weapon2': '0.300', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '67.000'} [2024-08-06 08:22:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 685457408. Throughput: 0: 4366.2. Samples: 171363240. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:32,795][52567] Avg episode reward: [(0, '77.757')] [2024-08-06 08:22:34,730][52795] DAMAGECOUNT value on done: 882488.0 [2024-08-06 08:22:34,730][52795] Sum rewards: 78.110, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.586', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.296', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '63.000'} [2024-08-06 08:22:35,076][52794] DAMAGECOUNT value on done: 956834.0 [2024-08-06 08:22:35,079][52671] DAMAGECOUNT value on done: 979446.0 [2024-08-06 08:22:35,079][52671] Sum rewards: 74.969, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.910', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon5': '0.234', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '60.000'} [2024-08-06 08:22:35,079][52794] Sum rewards: 72.378, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.540', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon2': '0.148', 'AMMO3': '0.193', 'AMMO4': '0.205', 'weapon5': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.542', 'WEAPON3': '1.200', 'weapon3': '2.790', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '57.000'} [2024-08-06 08:22:35,380][52663] DAMAGECOUNT value on done: 955412.0 [2024-08-06 08:22:35,381][52663] Sum rewards: 81.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon4': '0.078', 'weapon5': '0.092', 'AMMO4': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.214', 'WEAPON3': '1.300', 'weapon3': '3.446', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '67.000'} [2024-08-06 08:22:36,269][52650] Updated weights for policy 0, policy_version 83681 (0.0022) [2024-08-06 08:22:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 685547520. Throughput: 0: 4365.1. Samples: 171389450. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:37,794][52567] Avg episode reward: [(0, '77.900')] [2024-08-06 08:22:37,961][52795] DAMAGECOUNT value on done: 891858.0 [2024-08-06 08:22:37,964][52795] Sum rewards: 73.074, reward structure: {'DEATHCOUNT': '-6.000', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.074', 'AMMO3': '0.085', 'WEAPON4': '0.100', 'AMMO4': '0.102', 'WEAPON5': '0.200', 'HEALTH': '0.320', 'WEAPON3': '0.500', 'weapon2': '1.186', 'weapon3': '2.548', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.527', 'FRAGCOUNT': '54.000'} [2024-08-06 08:22:38,023][52671] DAMAGECOUNT value on done: 962186.0 [2024-08-06 08:22:38,024][52671] Sum rewards: 74.075, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.616', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.118', 'weapon4': '0.186', 'AMMO4': '0.198', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '65.000'} [2024-08-06 08:22:38,276][52794] DAMAGECOUNT value on done: 972335.0 [2024-08-06 08:22:38,277][52794] Sum rewards: 88.176, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.848', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.060', 'AMMO4': '0.176', 'weapon5': '0.182', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.040', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.567', 'FRAGCOUNT': '71.000'} [2024-08-06 08:22:38,590][52663] DAMAGECOUNT value on done: 965202.0 [2024-08-06 08:22:38,590][52663] Sum rewards: 71.005, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.120', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '61.000'} [2024-08-06 08:22:40,432][52650] Updated weights for policy 0, policy_version 83691 (0.0015) [2024-08-06 08:22:41,210][52794] DAMAGECOUNT value on done: 967139.0 [2024-08-06 08:22:41,210][52794] Sum rewards: 65.659, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.600', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon5': '0.128', 'weapon4': '0.142', 'AMMO3': '0.188', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.278', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '53.000'} [2024-08-06 08:22:41,259][52795] DAMAGECOUNT value on done: 899967.0 [2024-08-06 08:22:41,259][52795] Sum rewards: 86.830, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.711', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.124', 'weapon5': '0.132', 'weapon2': '0.228', 'AMMO4': '0.233', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '74.000'} [2024-08-06 08:22:41,918][52663] DAMAGECOUNT value on done: 966204.0 [2024-08-06 08:22:41,918][52663] Sum rewards: 72.295, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.920', 'AMMO5': '0.015', 'AMMO2': '0.045', 'AMMO3': '0.183', 'weapon5': '0.186', 'AMMO4': '0.227', 'weapon2': '0.246', 'weapon4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '60.000'} [2024-08-06 08:22:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 685629440. Throughput: 0: 4364.7. Samples: 171415540. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:42,794][52567] Avg episode reward: [(0, '78.039')] [2024-08-06 08:22:44,139][52794] DAMAGECOUNT value on done: 958189.0 [2024-08-06 08:22:44,142][52794] Sum rewards: 82.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.840', 'AMMO2': '0.005', 'AMMO4': '0.026', 'weapon4': '0.060', 'WEAPON4': '0.100', 'AMMO3': '0.230', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.450', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '70.000'} [2024-08-06 08:22:44,464][52663] DAMAGECOUNT value on done: 970011.0 [2024-08-06 08:22:44,465][52811] DAMAGECOUNT value on done: 916626.0 [2024-08-06 08:22:44,467][52811] Sum rewards: 74.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.066', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.185', 'weapon4': '0.190', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '62.000'} [2024-08-06 08:22:44,465][52663] Sum rewards: 78.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.576', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.201', 'weapon5': '0.224', 'AMMO4': '0.235', 'weapon2': '0.238', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '2.968', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '63.000'} [2024-08-06 08:22:45,443][52650] Updated weights for policy 0, policy_version 83701 (0.0030) [2024-08-06 08:22:46,816][52794] DAMAGECOUNT value on done: 973284.0 [2024-08-06 08:22:46,818][52794] Sum rewards: 66.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.700', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon4': '0.076', 'weapon5': '0.104', 'AMMO3': '0.184', 'AMMO4': '0.343', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '3.020', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2024-08-06 08:22:47,375][52663] DAMAGECOUNT value on done: 967108.0 [2024-08-06 08:22:47,375][52663] Sum rewards: 71.144, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.620', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.144', 'AMMO4': '0.151', 'weapon2': '0.222', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.280', 'weapon3': '3.358', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '61.000'} [2024-08-06 08:22:47,612][52811] DAMAGECOUNT value on done: 901484.0 [2024-08-06 08:22:47,613][52811] Sum rewards: 66.334, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.670', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.086', 'AMMO4': '0.177', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'weapon4': '0.330', 'WEAPON4': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.600', 'weapon3': '2.758', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '58.000'} [2024-08-06 08:22:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 685711360. Throughput: 0: 4369.1. Samples: 171428780. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:47,794][52567] Avg episode reward: [(0, '77.479')] [2024-08-06 08:22:49,984][52650] Updated weights for policy 0, policy_version 83711 (0.0021) [2024-08-06 08:22:50,033][52794] DAMAGECOUNT value on done: 967980.0 [2024-08-06 08:22:50,034][52794] Sum rewards: 73.027, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.200', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.108', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.150', 'HITCOUNT': '3.270', 'weapon3': '3.318', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '58.000'} [2024-08-06 08:22:50,148][52663] DAMAGECOUNT value on done: 974673.0 [2024-08-06 08:22:50,149][52663] Sum rewards: 64.850, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.126', 'weapon4': '0.150', 'AMMO3': '0.185', 'AMMO4': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.100', 'weapon3': '2.876', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.446', 'FRAGCOUNT': '52.000'} [2024-08-06 08:22:50,869][52811] DAMAGECOUNT value on done: 895918.0 [2024-08-06 08:22:50,871][52811] Sum rewards: 70.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.929', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.156', 'AMMO4': '0.255', 'weapon5': '0.256', 'WEAPON4': '0.400', 'weapon4': '0.428', 'WEAPON5': '0.450', 'weapon2': '0.554', 'WEAPON3': '0.950', 'weapon3': '2.432', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '54.500'} [2024-08-06 08:22:52,680][52670] DAMAGECOUNT value on done: 954118.0 [2024-08-06 08:22:52,681][52670] Sum rewards: 71.995, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.370', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.090', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'AMMO4': '0.249', 'WEAPON4': '0.250', 'weapon4': '0.426', 'weapon2': '0.436', 'WEAPON3': '1.100', 'weapon3': '2.852', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '56.500'} [2024-08-06 08:22:52,777][52794] DAMAGECOUNT value on done: 979766.0 [2024-08-06 08:22:52,779][52794] Sum rewards: 71.163, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.182', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.054', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'WEAPON4': '0.350', 'weapon4': '0.358', 'weapon2': '0.642', 'WEAPON3': '1.350', 'weapon3': '2.722', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '59.500'} [2024-08-06 08:22:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 685809664. Throughput: 0: 4366.9. Samples: 171454950. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:52,794][52567] Avg episode reward: [(0, '77.017')] [2024-08-06 08:22:52,950][52663] DAMAGECOUNT value on done: 981204.0 [2024-08-06 08:22:52,950][52663] Sum rewards: 73.290, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.301', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.076', 'AMMO3': '0.172', 'weapon5': '0.198', 'AMMO4': '0.209', 'weapon2': '0.354', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '57.000'} [2024-08-06 08:22:53,945][52811] DAMAGECOUNT value on done: 901756.0 [2024-08-06 08:22:53,946][52811] Sum rewards: 70.544, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.865', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO4': '0.176', 'weapon5': '0.210', 'AMMO3': '0.212', 'weapon4': '0.318', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.840', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '57.000'} [2024-08-06 08:22:54,815][52650] Updated weights for policy 0, policy_version 83721 (0.0013) [2024-08-06 08:22:55,221][52647] DAMAGECOUNT value on done: 1033931.0 [2024-08-06 08:22:55,223][52647] Sum rewards: 67.661, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.531', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.122', 'AMMO3': '0.150', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.380', 'WEAPON3': '0.950', 'HITCOUNT': '2.870', 'weapon3': '3.144', 'DAMAGECOUNT': '14.766', 'FRAGCOUNT': '54.000'} [2024-08-06 08:22:55,540][52794] DAMAGECOUNT value on done: 961883.0 [2024-08-06 08:22:55,541][52794] Sum rewards: 80.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.550', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.062', 'AMMO4': '0.122', 'AMMO3': '0.206', 'weapon5': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '3.118', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '65.000'} [2024-08-06 08:22:55,711][52663] DAMAGECOUNT value on done: 959564.0 [2024-08-06 08:22:55,713][52663] Sum rewards: 80.162, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.187', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon5': '0.064', 'AMMO4': '0.138', 'AMMO3': '0.150', 'WEAPON5': '0.300', 'weapon4': '0.322', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.000', 'weapon3': '3.046', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '64.000'} [2024-08-06 08:22:55,736][52670] DAMAGECOUNT value on done: 973657.0 [2024-08-06 08:22:55,736][52670] Sum rewards: 86.312, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.859', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.126', 'weapon5': '0.170', 'AMMO4': '0.176', 'AMMO3': '0.183', 'weapon2': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.206', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '70.000'} [2024-08-06 08:22:56,383][52666] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:22:57,060][52811] DAMAGECOUNT value on done: 905170.0 [2024-08-06 08:22:57,061][52811] Sum rewards: 70.452, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.697', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.130', 'weapon5': '0.212', 'AMMO3': '0.218', 'AMMO4': '0.252', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.050', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '59.000'} [2024-08-06 08:22:57,313][52647] DAMAGECOUNT value on done: 1020528.0 [2024-08-06 08:22:57,314][52647] Sum rewards: 82.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.516', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.050', 'weapon5': '0.188', 'AMMO3': '0.197', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.150', 'weapon3': '3.106', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '66.000'} [2024-08-06 08:22:57,645][52614] Signal inference workers to stop experience collection... (15350 times) [2024-08-06 08:22:57,646][52614] Signal inference workers to resume experience collection... (15350 times) [2024-08-06 08:22:57,696][52650] InferenceWorker_p0-w0: stopping experience collection (15350 times) [2024-08-06 08:22:57,696][52650] InferenceWorker_p0-w0: resuming experience collection (15350 times) [2024-08-06 08:22:57,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 685891584. Throughput: 0: 4364.4. Samples: 171481090. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:22:57,795][52567] Avg episode reward: [(0, '76.777')] [2024-08-06 08:22:58,450][52794] DAMAGECOUNT value on done: 973557.0 [2024-08-06 08:22:58,450][52794] Sum rewards: 82.066, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.596', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.147', 'weapon5': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.258', 'weapon4': '0.398', 'WEAPON3': '1.000', 'weapon3': '2.956', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '64.500'} [2024-08-06 08:22:58,556][52670] DAMAGECOUNT value on done: 955338.0 [2024-08-06 08:22:58,558][52670] Sum rewards: 79.276, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.881', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.126', 'weapon5': '0.136', 'AMMO4': '0.212', 'AMMO3': '0.241', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.450', 'weapon3': '2.962', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '67.000'} [2024-08-06 08:22:59,323][52650] Updated weights for policy 0, policy_version 83731 (0.0012) [2024-08-06 08:22:59,939][52647] DAMAGECOUNT value on done: 1026575.0 [2024-08-06 08:22:59,942][52647] Sum rewards: 75.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.888', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.068', 'weapon5': '0.166', 'AMMO3': '0.204', 'AMMO4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:00,132][52811] DAMAGECOUNT value on done: 922116.0 [2024-08-06 08:23:00,134][52811] Sum rewards: 87.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.690', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon5': '0.200', 'weapon4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '71.000'} [2024-08-06 08:23:00,376][52666] DAMAGECOUNT value on done: 967968.0 [2024-08-06 08:23:00,377][52666] Sum rewards: 81.570, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.523', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.067', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.492', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '67.000'} [2024-08-06 08:23:01,220][52670] DAMAGECOUNT value on done: 958441.0 [2024-08-06 08:23:01,222][52670] Sum rewards: 77.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO4': '0.209', 'AMMO3': '0.248', 'weapon5': '0.268', 'weapon2': '0.276', 'weapon4': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.848', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '64.500'} [2024-08-06 08:23:01,574][52794] DAMAGECOUNT value on done: 968010.0 [2024-08-06 08:23:01,576][52794] Sum rewards: 65.456, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.168', 'weapon5': '0.176', 'AMMO4': '0.191', 'AMMO3': '0.209', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '55.000'} [2024-08-06 08:23:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 685981696. Throughput: 0: 4364.0. Samples: 171494330. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:23:02,794][52567] Avg episode reward: [(0, '76.904')] [2024-08-06 08:23:02,831][52647] DAMAGECOUNT value on done: 1023434.0 [2024-08-06 08:23:02,832][52647] Sum rewards: 74.241, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.370', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.104', 'AMMO4': '0.145', 'AMMO3': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '3.138', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:02,891][52666] DAMAGECOUNT value on done: 966322.0 [2024-08-06 08:23:02,892][52666] Sum rewards: 71.221, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.048', 'weapon5': '0.082', 'AMMO4': '0.107', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.238', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:03,240][52663] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:23:03,315][52811] DAMAGECOUNT value on done: 911927.0 [2024-08-06 08:23:03,315][52811] Sum rewards: 73.617, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.254', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon2': '0.150', 'AMMO3': '0.228', 'WEAPON3': '1.500', 'HITCOUNT': '3.350', 'weapon3': '3.626', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:03,667][52670] DAMAGECOUNT value on done: 969817.0 [2024-08-06 08:23:03,667][52670] Sum rewards: 69.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.214', 'weapon2': '0.218', 'weapon4': '0.236', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '57.000'} [2024-08-06 08:23:04,174][52650] Updated weights for policy 0, policy_version 83741 (0.0011) [2024-08-06 08:23:04,662][52794] DAMAGECOUNT value on done: 977049.0 [2024-08-06 08:23:04,662][52794] Sum rewards: 87.418, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.080', 'AMMO4': '0.091', 'weapon5': '0.092', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'weapon2': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.420', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '71.000'} [2024-08-06 08:23:05,445][52647] DAMAGECOUNT value on done: 1033206.0 [2024-08-06 08:23:05,448][52647] Sum rewards: 78.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.205', 'AMMO5': '0.021', 'AMMO2': '0.048', 'AMMO3': '0.169', 'weapon5': '0.176', 'AMMO4': '0.238', 'weapon4': '0.264', 'WEAPON4': '0.450', 'weapon2': '0.456', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.874', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '64.000'} [2024-08-06 08:23:05,736][52666] DAMAGECOUNT value on done: 972003.0 [2024-08-06 08:23:05,737][52666] Sum rewards: 72.926, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.441', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.146', 'weapon4': '0.190', 'weapon2': '0.250', 'AMMO4': '0.252', 'AMMO3': '0.255', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.170', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:06,431][52811] DAMAGECOUNT value on done: 899145.0 [2024-08-06 08:23:06,432][52811] Sum rewards: 86.745, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.722', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.156', 'AMMO3': '0.164', 'AMMO4': '0.205', 'weapon5': '0.214', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.154', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:06,796][52670] DAMAGECOUNT value on done: 958513.0 [2024-08-06 08:23:06,798][52670] Sum rewards: 76.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.927', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO3': '0.137', 'AMMO4': '0.180', 'weapon5': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.690', 'WEAPON3': '0.850', 'weapon3': '2.738', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:07,729][52794] DAMAGECOUNT value on done: 983141.0 [2024-08-06 08:23:07,729][52794] Sum rewards: 61.024, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.305', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.186', 'AMMO4': '0.221', 'AMMO3': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.476', 'WEAPON3': '1.550', 'weapon3': '2.994', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '53.000'} [2024-08-06 08:23:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 686071808. Throughput: 0: 4365.8. Samples: 171520620. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:07,802][52567] Avg episode reward: [(0, '76.314')] [2024-08-06 08:23:08,110][52647] DAMAGECOUNT value on done: 1028838.0 [2024-08-06 08:23:08,110][52647] Sum rewards: 65.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.555', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.086', 'weapon5': '0.088', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '15.861', 'FRAGCOUNT': '54.000'} [2024-08-06 08:23:08,596][52666] DAMAGECOUNT value on done: 967469.0 [2024-08-06 08:23:08,597][52666] Sum rewards: 79.941, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.875', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.094', 'weapon5': '0.172', 'AMMO4': '0.186', 'AMMO3': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '3.040', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '64.000'} [2024-08-06 08:23:08,854][52650] Updated weights for policy 0, policy_version 83751 (0.0024) [2024-08-06 08:23:09,273][52795] Large shaping reward 2.569 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.537, 179.0), ('weapon5', 0.002)] [2024-08-06 08:23:09,597][52811] DAMAGECOUNT value on done: 906587.0 [2024-08-06 08:23:09,599][52811] Sum rewards: 80.069, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.101', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.072', 'AMMO4': '0.163', 'weapon5': '0.198', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:09,625][52670] DAMAGECOUNT value on done: 954824.0 [2024-08-06 08:23:09,626][52670] Sum rewards: 71.223, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.270', 'AMMO5': '0.006', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.059', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '57.000'} [2024-08-06 08:23:10,233][52794] DAMAGECOUNT value on done: 970696.0 [2024-08-06 08:23:10,234][52794] Sum rewards: 79.281, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.818', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO4': '0.137', 'weapon4': '0.158', 'AMMO3': '0.233', 'weapon2': '0.522', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:11,209][52647] DAMAGECOUNT value on done: 1030904.0 [2024-08-06 08:23:11,210][52647] Sum rewards: 70.597, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.552', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.116', 'weapon5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.165', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.542', 'WEAPON3': '0.950', 'weapon3': '2.962', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '56.000'} [2024-08-06 08:23:11,581][52666] DAMAGECOUNT value on done: 960547.0 [2024-08-06 08:23:11,581][52666] Sum rewards: 67.437, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.136', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.074', 'AMMO3': '0.218', 'weapon5': '0.224', 'AMMO4': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.982', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '55.000'} [2024-08-06 08:23:11,634][52668] DAMAGECOUNT value on done: 978476.0 [2024-08-06 08:23:11,634][52668] Sum rewards: 74.812, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.378', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.092', 'weapon5': '0.096', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON3': '1.050', 'weapon2': '1.092', 'weapon3': '2.466', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:12,073][52665] DAMAGECOUNT value on done: 957166.0 [2024-08-06 08:23:12,075][52665] Sum rewards: 85.752, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.586', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.148', 'AMMO4': '0.189', 'AMMO3': '0.217', 'weapon5': '0.232', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:12,345][52670] DAMAGECOUNT value on done: 956990.0 [2024-08-06 08:23:12,345][52670] Sum rewards: 80.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.402', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.030', 'AMMO4': '0.040', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.434', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:12,691][52811] DAMAGECOUNT value on done: 907159.0 [2024-08-06 08:23:12,691][52811] Sum rewards: 85.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.256', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.155', 'weapon2': '0.392', 'WEAPON3': '1.150', 'weapon3': '3.376', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '70.000'} [2024-08-06 08:23:12,800][52567] Fps is (10 sec: 17193.2, 60 sec: 17474.6, 300 sec: 17438.9). Total num frames: 686153728. Throughput: 0: 4372.8. Samples: 171547020. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:12,800][52567] Avg episode reward: [(0, '75.768')] [2024-08-06 08:23:13,432][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:23:13,524][52650] Updated weights for policy 0, policy_version 83761 (0.0018) [2024-08-06 08:23:14,188][52666] DAMAGECOUNT value on done: 961908.0 [2024-08-06 08:23:14,189][52666] Sum rewards: 66.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.976', 'AMMO2': '0.006', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.060', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.576', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.202', 'DAMAGECOUNT': '15.939', 'FRAGCOUNT': '54.000'} [2024-08-06 08:23:14,256][52647] DAMAGECOUNT value on done: 1006642.0 [2024-08-06 08:23:14,256][52647] Sum rewards: 64.401, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.480', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'AMMO3': '0.251', 'weapon2': '0.420', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.412', 'DAMAGECOUNT': '16.209', 'FRAGCOUNT': '56.000'} [2024-08-06 08:23:14,714][52668] DAMAGECOUNT value on done: 977256.0 [2024-08-06 08:23:14,715][52668] Sum rewards: 63.872, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.486', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.096', 'weapon5': '0.156', 'AMMO4': '0.217', 'AMMO3': '0.251', 'weapon2': '0.374', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '56.000'} [2024-08-06 08:23:14,855][52670] DAMAGECOUNT value on done: 956471.0 [2024-08-06 08:23:14,857][52670] Sum rewards: 80.654, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.316', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.128', 'AMMO3': '0.160', 'AMMO4': '0.208', 'WEAPON4': '0.300', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.050', 'weapon3': '2.902', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:15,020][52665] DAMAGECOUNT value on done: 968173.0 [2024-08-06 08:23:15,023][52665] Sum rewards: 74.918, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.498', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.169', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:15,706][52811] DAMAGECOUNT value on done: 909700.0 [2024-08-06 08:23:15,707][52811] Sum rewards: 57.773, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.502', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.142', 'AMMO3': '0.154', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '0.950', 'HITCOUNT': '2.730', 'weapon3': '3.030', 'DAMAGECOUNT': '14.241', 'FRAGCOUNT': '46.000'} [2024-08-06 08:23:16,949][52647] DAMAGECOUNT value on done: 1022715.0 [2024-08-06 08:23:16,950][52647] Sum rewards: 78.680, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'HEALTH': '0.126', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.195', 'weapon2': '0.774', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:16,969][52666] DAMAGECOUNT value on done: 963564.0 [2024-08-06 08:23:16,972][52666] Sum rewards: 86.630, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.208', 'AMMO3': '0.230', 'weapon4': '0.284', 'weapon2': '0.348', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.408', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:17,265][52668] DAMAGECOUNT value on done: 973472.0 [2024-08-06 08:23:17,265][52668] Sum rewards: 69.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.880', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.112', 'AMMO4': '0.188', 'AMMO3': '0.221', 'weapon5': '0.242', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '57.000'} [2024-08-06 08:23:17,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 686243840. Throughput: 0: 4378.5. Samples: 171560270. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:17,794][52567] Avg episode reward: [(0, '75.215')] [2024-08-06 08:23:17,973][52670] DAMAGECOUNT value on done: 955438.0 [2024-08-06 08:23:17,981][52670] Sum rewards: 80.868, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.695', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.046', 'weapon5': '0.118', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'AMMO3': '0.278', 'WEAPON3': '1.700', 'weapon3': '3.360', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:18,109][52665] DAMAGECOUNT value on done: 963114.0 [2024-08-06 08:23:18,110][52665] Sum rewards: 88.906, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.808', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.102', 'AMMO3': '0.194', 'AMMO4': '0.218', 'weapon5': '0.236', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '72.000'} [2024-08-06 08:23:18,242][52650] Updated weights for policy 0, policy_version 83771 (0.0010) [2024-08-06 08:23:18,786][52811] DAMAGECOUNT value on done: 917765.0 [2024-08-06 08:23:18,789][52811] Sum rewards: 81.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.592', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.162', 'AMMO3': '0.170', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON4': '0.400', 'weapon4': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.884', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '64.000'} [2024-08-06 08:23:19,632][52666] DAMAGECOUNT value on done: 957116.0 [2024-08-06 08:23:19,633][52666] Sum rewards: 66.153, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.475', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.136', 'AMMO3': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.298', 'weapon4': '0.540', 'WEAPON3': '0.950', 'weapon3': '2.724', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '51.000'} [2024-08-06 08:23:19,789][52647] DAMAGECOUNT value on done: 1017702.0 [2024-08-06 08:23:19,789][52647] Sum rewards: 73.946, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.120', 'weapon5': '0.122', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '58.000'} [2024-08-06 08:23:19,830][52668] DAMAGECOUNT value on done: 977762.0 [2024-08-06 08:23:19,832][52668] Sum rewards: 73.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.736', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.186', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.366', 'weapon4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.630', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.967', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:20,435][52670] DAMAGECOUNT value on done: 969548.0 [2024-08-06 08:23:20,437][52670] Sum rewards: 82.201, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.196', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.164', 'weapon4': '0.186', 'AMMO4': '0.206', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '67.000'} [2024-08-06 08:23:21,224][52665] DAMAGECOUNT value on done: 965334.0 [2024-08-06 08:23:21,226][52665] Sum rewards: 84.181, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'weapon2': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.248', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '67.000'} [2024-08-06 08:23:21,869][52811] DAMAGECOUNT value on done: 909682.0 [2024-08-06 08:23:21,871][52811] Sum rewards: 84.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.798', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.134', 'AMMO4': '0.162', 'AMMO3': '0.173', 'weapon4': '0.242', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:21,972][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:23:22,105][52647] DAMAGECOUNT value on done: 1017669.0 [2024-08-06 08:23:22,106][52647] Sum rewards: 69.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.003', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.078', 'weapon5': '0.106', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.570', 'WEAPON3': '1.100', 'weapon3': '3.042', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.320', 'FRAGCOUNT': '57.000'} [2024-08-06 08:23:22,598][52666] DAMAGECOUNT value on done: 970841.0 [2024-08-06 08:23:22,599][52666] Sum rewards: 81.353, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.616', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.141', 'WEAPON4': '0.300', 'weapon4': '0.376', 'weapon2': '0.464', 'WEAPON3': '0.900', 'weapon3': '2.976', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:22,605][52668] DAMAGECOUNT value on done: 962285.0 [2024-08-06 08:23:22,607][52668] Sum rewards: 75.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.446', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.126', 'AMMO4': '0.181', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '3.124', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:22,794][52567] Fps is (10 sec: 17213.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 686325760. Throughput: 0: 4374.7. Samples: 171586310. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:22,794][52567] Avg episode reward: [(0, '75.394')] [2024-08-06 08:23:22,915][52650] Updated weights for policy 0, policy_version 83781 (0.0024) [2024-08-06 08:23:23,840][52670] DAMAGECOUNT value on done: 951427.0 [2024-08-06 08:23:23,842][52670] Sum rewards: 80.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.050', 'weapon5': '0.124', 'AMMO4': '0.153', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:23,996][52665] DAMAGECOUNT value on done: 946376.0 [2024-08-06 08:23:23,997][52665] Sum rewards: 78.897, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.480', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.174', 'weapon4': '0.188', 'weapon5': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '2.990', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:24,824][52647] DAMAGECOUNT value on done: 1014539.0 [2024-08-06 08:23:24,824][52647] Sum rewards: 84.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.370', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.122', 'AMMO4': '0.163', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.465', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:24,967][52811] DAMAGECOUNT value on done: 906183.0 [2024-08-06 08:23:24,969][52811] Sum rewards: 68.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.956', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.132', 'weapon5': '0.208', 'AMMO3': '0.264', 'AMMO4': '0.269', 'weapon2': '0.488', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.878', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '58.000'} [2024-08-06 08:23:25,558][52666] DAMAGECOUNT value on done: 960004.0 [2024-08-06 08:23:25,559][52666] Sum rewards: 68.666, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.294', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.110', 'AMMO4': '0.122', 'weapon5': '0.122', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.798', 'WEAPON3': '1.300', 'weapon3': '2.740', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '58.000'} [2024-08-06 08:23:25,938][52668] DAMAGECOUNT value on done: 974986.0 [2024-08-06 08:23:25,939][52668] Sum rewards: 75.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.434', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.077', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:26,310][52670] DAMAGECOUNT value on done: 964948.0 [2024-08-06 08:23:26,310][52670] Sum rewards: 82.395, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.320', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.136', 'weapon2': '0.160', 'AMMO3': '0.208', 'weapon5': '0.246', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:27,309][52665] DAMAGECOUNT value on done: 949436.0 [2024-08-06 08:23:27,310][52665] Sum rewards: 89.354, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.324', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.134', 'AMMO4': '0.164', 'AMMO3': '0.232', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.310', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.051', 'FRAGCOUNT': '74.000'} [2024-08-06 08:23:27,396][52650] Updated weights for policy 0, policy_version 83791 (0.0015) [2024-08-06 08:23:27,707][52647] DAMAGECOUNT value on done: 1022699.0 [2024-08-06 08:23:27,708][52647] Sum rewards: 79.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.810', 'AMMO5': '0.011', 'AMMO2': '0.055', 'weapon4': '0.198', 'weapon5': '0.200', 'AMMO3': '0.204', 'AMMO4': '0.276', 'WEAPON5': '0.350', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 686424064. Throughput: 0: 4373.8. Samples: 171612360. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:27,794][52567] Avg episode reward: [(0, '75.795')] [2024-08-06 08:23:28,151][52666] DAMAGECOUNT value on done: 964090.0 [2024-08-06 08:23:28,151][52666] Sum rewards: 58.292, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.185', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.166', 'weapon5': '0.184', 'AMMO3': '0.198', 'AMMO4': '0.199', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '3.132', 'DAMAGECOUNT': '13.878', 'FRAGCOUNT': '49.000'} [2024-08-06 08:23:28,202][52811] DAMAGECOUNT value on done: 907875.0 [2024-08-06 08:23:28,202][52811] Sum rewards: 74.137, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.495', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.142', 'AMMO3': '0.252', 'AMMO4': '0.269', 'weapon2': '0.278', 'weapon5': '0.286', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.026', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:28,882][52668] DAMAGECOUNT value on done: 974146.0 [2024-08-06 08:23:28,883][52670] DAMAGECOUNT value on done: 969732.0 [2024-08-06 08:23:28,895][52668] Sum rewards: 85.976, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.085', 'AMMO3': '0.230', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.268', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.507', 'FRAGCOUNT': '71.000'} [2024-08-06 08:23:28,895][52670] Sum rewards: 87.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.220', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.119', 'weapon5': '0.134', 'AMMO3': '0.168', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.578', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.252', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:30,128][52667] DAMAGECOUNT value on done: 968608.0 [2024-08-06 08:23:30,128][52667] Sum rewards: 85.241, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.640', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.046', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO4': '0.222', 'weapon2': '0.260', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.242', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.835', 'FRAGCOUNT': '72.000'} [2024-08-06 08:23:30,215][52647] DAMAGECOUNT value on done: 1015838.0 [2024-08-06 08:23:30,215][52647] Sum rewards: 77.056, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.732', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.694', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:30,342][52665] DAMAGECOUNT value on done: 960556.0 [2024-08-06 08:23:30,344][52665] Sum rewards: 68.546, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.125', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.142', 'weapon4': '0.174', 'AMMO4': '0.257', 'AMMO3': '0.266', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.944', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '58.000'} [2024-08-06 08:23:30,908][52666] DAMAGECOUNT value on done: 950708.0 [2024-08-06 08:23:30,909][52666] Sum rewards: 71.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.164', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon5': '0.082', 'weapon4': '0.116', 'AMMO4': '0.167', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.590', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '57.000'} [2024-08-06 08:23:31,330][52811] DAMAGECOUNT value on done: 906975.0 [2024-08-06 08:23:31,332][52811] Sum rewards: 82.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.100', 'weapon5': '0.102', 'AMMO4': '0.123', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.664', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:31,984][52668] DAMAGECOUNT value on done: 964990.0 [2024-08-06 08:23:31,986][52668] Sum rewards: 76.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.132', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.040', 'AMMO4': '0.051', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.288', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.380', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '64.000'} [2024-08-06 08:23:32,019][52670] DAMAGECOUNT value on done: 962500.0 [2024-08-06 08:23:32,021][52670] Sum rewards: 68.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.171', 'weapon5': '0.184', 'AMMO3': '0.251', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '2.878', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '57.000'} [2024-08-06 08:23:32,174][52649] DAMAGECOUNT value on done: 939621.0 [2024-08-06 08:23:32,175][52649] Sum rewards: 70.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.536', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.154', 'weapon2': '0.198', 'AMMO4': '0.222', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.180', 'weapon3': '3.354', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:32,531][52665] DAMAGECOUNT value on done: 959124.0 [2024-08-06 08:23:32,532][52665] Sum rewards: 82.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.420', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon4': '0.094', 'weapon5': '0.126', 'AMMO3': '0.208', 'AMMO4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:32,649][52667] DAMAGECOUNT value on done: 985410.0 [2024-08-06 08:23:32,650][52667] Sum rewards: 79.067, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.376', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.082', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:32,684][52650] Updated weights for policy 0, policy_version 83801 (0.0047) [2024-08-06 08:23:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 686497792. Throughput: 0: 4368.2. Samples: 171625350. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:32,794][52567] Avg episode reward: [(0, '75.916')] [2024-08-06 08:23:33,484][52647] DAMAGECOUNT value on done: 1024339.0 [2024-08-06 08:23:33,484][52647] Sum rewards: 78.163, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.990', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon5': '0.190', 'AMMO3': '0.192', 'weapon2': '0.192', 'AMMO4': '0.194', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.976', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:34,107][52666] DAMAGECOUNT value on done: 973101.0 [2024-08-06 08:23:34,115][52666] Sum rewards: 68.647, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.800', 'AMMO5': '0.016', 'AMMO2': '0.060', 'weapon4': '0.222', 'weapon5': '0.230', 'weapon2': '0.270', 'AMMO4': '0.301', 'AMMO3': '0.305', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.910', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '59.000'} [2024-08-06 08:23:34,427][52811] DAMAGECOUNT value on done: 915020.0 [2024-08-06 08:23:34,430][52811] Sum rewards: 87.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.989', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'AMMO3': '0.223', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.490', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '72.000'} [2024-08-06 08:23:34,847][52668] DAMAGECOUNT value on done: 968833.0 [2024-08-06 08:23:34,847][52668] Sum rewards: 87.784, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.720', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.122', 'AMMO4': '0.156', 'weapon5': '0.176', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '70.000'} [2024-08-06 08:23:34,931][52670] DAMAGECOUNT value on done: 947624.0 [2024-08-06 08:23:34,932][52670] Sum rewards: 73.571, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.230', 'AMMO2': '0.002', 'AMMO5': '0.009', 'AMMO4': '0.010', 'weapon4': '0.034', 'WEAPON4': '0.050', 'weapon5': '0.186', 'AMMO3': '0.209', 'WEAPON5': '0.250', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:35,201][52649] DAMAGECOUNT value on done: 935512.0 [2024-08-06 08:23:35,203][52649] Sum rewards: 76.717, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-3.505', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon2': '0.122', 'AMMO3': '0.163', 'weapon5': '0.226', 'AMMO4': '0.245', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon4': '0.624', 'WEAPON3': '1.250', 'weapon3': '2.844', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.356', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:35,798][52667] DAMAGECOUNT value on done: 978434.0 [2024-08-06 08:23:35,799][52667] Sum rewards: 79.099, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.270', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'weapon2': '0.258', 'WEAPON3': '1.050', 'HITCOUNT': '3.440', 'weapon3': '3.476', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:35,810][52647] DAMAGECOUNT value on done: 1024484.0 [2024-08-06 08:23:35,810][52647] Sum rewards: 74.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.304', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.088', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:35,813][52665] DAMAGECOUNT value on done: 964886.0 [2024-08-06 08:23:35,813][52665] Sum rewards: 84.113, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.906', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.122', 'AMMO4': '0.170', 'weapon4': '0.182', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.296', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:36,542][52650] Updated weights for policy 0, policy_version 83811 (0.0011) [2024-08-06 08:23:36,805][52795] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:23:36,811][52666] DAMAGECOUNT value on done: 968373.0 [2024-08-06 08:23:36,811][52666] Sum rewards: 79.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.224', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.366', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '65.000'} [2024-08-06 08:23:37,404][52811] DAMAGECOUNT value on done: 918700.0 [2024-08-06 08:23:37,407][52811] Sum rewards: 80.438, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.860', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'weapon2': '0.216', 'AMMO3': '0.222', 'weapon4': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:37,481][52668] DAMAGECOUNT value on done: 976461.0 [2024-08-06 08:23:37,483][52668] Sum rewards: 77.173, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.446', 'AMMO5': '0.005', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon5': '0.082', 'AMMO4': '0.093', 'weapon4': '0.138', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.208', 'AMMO3': '0.229', 'WEAPON3': '1.500', 'weapon3': '3.348', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '65.000'} [2024-08-06 08:23:37,686][52670] DAMAGECOUNT value on done: 962570.0 [2024-08-06 08:23:37,687][52670] Sum rewards: 72.144, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.030', 'weapon5': '0.038', 'AMMO4': '0.087', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'HEALTH': '0.430', 'weapon2': '0.682', 'WEAPON3': '0.800', 'weapon3': '3.152', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '56.000'} [2024-08-06 08:23:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 686587904. Throughput: 0: 4370.2. Samples: 171651610. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:37,794][52567] Avg episode reward: [(0, '76.207')] [2024-08-06 08:23:38,023][52649] DAMAGECOUNT value on done: 950954.0 [2024-08-06 08:23:38,030][52649] Sum rewards: 84.687, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.945', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.183', 'weapon2': '0.194', 'weapon4': '0.220', 'WEAPON3': '1.050', 'weapon3': '3.302', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:38,440][52647] DAMAGECOUNT value on done: 1009663.0 [2024-08-06 08:23:38,441][52647] Sum rewards: 90.295, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.084', 'AMMO4': '0.123', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.454', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.246', 'FRAGCOUNT': '74.000'} [2024-08-06 08:23:38,450][52665] DAMAGECOUNT value on done: 956693.0 [2024-08-06 08:23:38,451][52665] Sum rewards: 69.600, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.035', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.129', 'weapon5': '0.134', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '55.000'} [2024-08-06 08:23:38,651][52667] DAMAGECOUNT value on done: 983888.0 [2024-08-06 08:23:38,651][52667] Sum rewards: 78.964, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.078', 'weapon5': '0.088', 'AMMO4': '0.106', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.150', 'weapon3': '3.276', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:39,856][52666] DAMAGECOUNT value on done: 968247.0 [2024-08-06 08:23:39,856][52666] Sum rewards: 83.507, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.700', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.088', 'AMMO4': '0.197', 'weapon5': '0.214', 'AMMO3': '0.261', 'weapon2': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:40,650][52811] DAMAGECOUNT value on done: 903521.0 [2024-08-06 08:23:40,650][52811] Sum rewards: 75.130, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.407', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.187', 'weapon4': '0.200', 'weapon2': '0.214', 'AMMO4': '0.262', 'weapon5': '0.372', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.798', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:40,686][52668] DAMAGECOUNT value on done: 970853.0 [2024-08-06 08:23:40,686][52668] Sum rewards: 77.900, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.250', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.150', 'AMMO3': '0.158', 'weapon5': '0.192', 'weapon2': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:40,813][52670] DAMAGECOUNT value on done: 970879.0 [2024-08-06 08:23:40,814][52670] Sum rewards: 79.419, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.066', 'weapon5': '0.224', 'AMMO3': '0.226', 'AMMO4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '66.500'} [2024-08-06 08:23:41,002][52649] DAMAGECOUNT value on done: 952826.0 [2024-08-06 08:23:41,003][52649] Sum rewards: 80.894, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.118', 'weapon4': '0.154', 'AMMO4': '0.182', 'AMMO3': '0.225', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '67.000'} [2024-08-06 08:23:41,076][52647] DAMAGECOUNT value on done: 1019296.0 [2024-08-06 08:23:41,078][52647] Sum rewards: 87.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.590', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.156', 'AMMO4': '0.170', 'AMMO3': '0.196', 'weapon2': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.364', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.825', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:41,215][52667] DAMAGECOUNT value on done: 984869.0 [2024-08-06 08:23:41,218][52667] Sum rewards: 86.497, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.054', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.118', 'weapon5': '0.150', 'AMMO4': '0.158', 'AMMO3': '0.159', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:41,347][52662] DAMAGECOUNT value on done: 969904.0 [2024-08-06 08:23:41,347][52662] Sum rewards: 76.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.168', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.034', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.231', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.374', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '65.000'} [2024-08-06 08:23:41,500][52665] DAMAGECOUNT value on done: 972215.0 [2024-08-06 08:23:41,501][52665] Sum rewards: 73.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.918', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.058', 'AMMO4': '0.100', 'weapon4': '0.110', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '62.000'} [2024-08-06 08:23:41,774][52650] Updated weights for policy 0, policy_version 83821 (0.0024) [2024-08-06 08:23:42,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 686686208. Throughput: 0: 4373.8. Samples: 171677910. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:42,794][52567] Avg episode reward: [(0, '77.176')] [2024-08-06 08:23:43,045][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:23:43,109][52666] DAMAGECOUNT value on done: 959629.0 [2024-08-06 08:23:43,111][52666] Sum rewards: 68.079, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.114', 'weapon5': '0.166', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.500', 'weapon3': '3.186', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '56.000'} [2024-08-06 08:23:43,566][52647] DAMAGECOUNT value on done: 1012040.0 [2024-08-06 08:23:43,569][52647] Sum rewards: 81.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.746', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.144', 'weapon5': '0.156', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.450', 'weapon3': '3.204', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:43,645][52811] DAMAGECOUNT value on done: 904909.0 [2024-08-06 08:23:43,648][52811] Sum rewards: 72.397, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.079', 'AMMO3': '0.229', 'weapon2': '0.640', 'WEAPON3': '1.400', 'weapon3': '3.112', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:43,847][52668] DAMAGECOUNT value on done: 967692.0 [2024-08-06 08:23:43,849][52668] Sum rewards: 97.929, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.974', 'FRAGCOUNT': '78.000'} [2024-08-06 08:23:43,968][52649] DAMAGECOUNT value on done: 943405.0 [2024-08-06 08:23:43,971][52649] Sum rewards: 72.404, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.192', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.076', 'weapon4': '0.114', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:44,090][52670] DAMAGECOUNT value on done: 964449.0 [2024-08-06 08:23:44,092][52670] Sum rewards: 67.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.855', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon5': '0.054', 'weapon4': '0.156', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '57.000'} [2024-08-06 08:23:44,282][52667] DAMAGECOUNT value on done: 982388.0 [2024-08-06 08:23:44,284][52667] Sum rewards: 66.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.912', 'AMMO5': '0.014', 'AMMO2': '0.030', 'AMMO4': '0.148', 'AMMO3': '0.191', 'weapon5': '0.192', 'weapon2': '0.204', 'weapon4': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.590', 'FRAGCOUNT': '54.000'} [2024-08-06 08:23:44,414][52662] DAMAGECOUNT value on done: 980405.0 [2024-08-06 08:23:44,416][52662] Sum rewards: 76.170, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.104', 'weapon5': '0.114', 'AMMO4': '0.142', 'AMMO3': '0.200', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.794', 'WEAPON3': '1.250', 'weapon3': '2.768', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:44,481][52665] DAMAGECOUNT value on done: 965928.0 [2024-08-06 08:23:44,482][52665] Sum rewards: 71.453, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.967', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.278', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:46,000][52650] Updated weights for policy 0, policy_version 83831 (0.0015) [2024-08-06 08:23:46,191][52647] DAMAGECOUNT value on done: 1015265.0 [2024-08-06 08:23:46,191][52647] Sum rewards: 71.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.098', 'WEAPON4': '0.150', 'weapon4': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.282', 'WEAPON3': '1.450', 'weapon3': '3.256', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '60.500'} [2024-08-06 08:23:46,357][52666] DAMAGECOUNT value on done: 957447.0 [2024-08-06 08:23:46,358][52666] Sum rewards: 72.997, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.760', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.092', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.192', 'AMMO3': '0.213', 'weapon4': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.200', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:46,861][52668] DAMAGECOUNT value on done: 960116.0 [2024-08-06 08:23:46,861][52668] Sum rewards: 68.017, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.889', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.106', 'weapon5': '0.210', 'weapon2': '0.228', 'AMMO4': '0.239', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.132', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 08:23:46,870][52667] DAMAGECOUNT value on done: 976329.0 [2024-08-06 08:23:46,872][52667] Sum rewards: 83.719, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.235', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.424', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '70.000'} [2024-08-06 08:23:47,100][52649] DAMAGECOUNT value on done: 952775.0 [2024-08-06 08:23:47,101][52649] Sum rewards: 77.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.622', 'AMMO5': '0.007', 'AMMO2': '0.039', 'weapon5': '0.114', 'WEAPON5': '0.150', 'AMMO4': '0.193', 'weapon2': '0.202', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:47,257][52670] DAMAGECOUNT value on done: 964835.0 [2024-08-06 08:23:47,261][52670] Sum rewards: 69.620, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.152', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.122', 'AMMO3': '0.148', 'AMMO4': '0.202', 'weapon4': '0.248', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.116', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '55.000'} [2024-08-06 08:23:47,575][52662] DAMAGECOUNT value on done: 979378.0 [2024-08-06 08:23:47,575][52662] Sum rewards: 87.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.396', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.136', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.178', 'weapon2': '0.244', 'WEAPON4': '0.250', 'weapon4': '0.280', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '70.000'} [2024-08-06 08:23:47,652][52665] DAMAGECOUNT value on done: 960918.0 [2024-08-06 08:23:47,654][52665] Sum rewards: 74.834, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.306', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.062', 'weapon4': '0.130', 'AMMO3': '0.157', 'weapon5': '0.192', 'AMMO4': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '2.932', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '60.500'} [2024-08-06 08:23:47,771][52663] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 08:23:47,804][52567] Fps is (10 sec: 17186.3, 60 sec: 17473.4, 300 sec: 17438.7). Total num frames: 686759936. Throughput: 0: 4365.5. Samples: 171690820. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:47,804][52567] Avg episode reward: [(0, '76.823')] [2024-08-06 08:23:49,483][52666] DAMAGECOUNT value on done: 977211.0 [2024-08-06 08:23:49,483][52666] Sum rewards: 75.177, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.460', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.040', 'weapon5': '0.108', 'AMMO4': '0.150', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.338', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '62.500'} [2024-08-06 08:23:50,058][52667] DAMAGECOUNT value on done: 972730.0 [2024-08-06 08:23:50,061][52667] Sum rewards: 76.221, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.742', 'AMMO5': '0.028', 'AMMO2': '0.070', 'weapon4': '0.156', 'AMMO3': '0.255', 'weapon5': '0.310', 'weapon2': '0.322', 'AMMO4': '0.349', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.874', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '65.000'} [2024-08-06 08:23:50,080][52668] DAMAGECOUNT value on done: 960306.0 [2024-08-06 08:23:50,081][52668] Sum rewards: 87.657, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.345', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.108', 'weapon5': '0.152', 'AMMO4': '0.194', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'weapon2': '0.304', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '22.140', 'FRAGCOUNT': '74.000'} [2024-08-06 08:23:50,231][52649] DAMAGECOUNT value on done: 949578.0 [2024-08-06 08:23:50,233][52649] Sum rewards: 86.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.144', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon5': '0.138', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.140', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.216', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:50,795][52662] DAMAGECOUNT value on done: 970141.0 [2024-08-06 08:23:50,799][52662] Sum rewards: 72.596, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.048', 'weapon5': '0.120', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:50,824][52665] DAMAGECOUNT value on done: 961882.0 [2024-08-06 08:23:50,824][52665] Sum rewards: 81.353, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.202', 'AMMO3': '0.261', 'WEAPON3': '1.650', 'weapon3': '3.546', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '69.000'} [2024-08-06 08:23:51,006][52650] Updated weights for policy 0, policy_version 83841 (0.0014) [2024-08-06 08:23:51,810][52666] DAMAGECOUNT value on done: 952045.0 [2024-08-06 08:23:51,812][52666] Sum rewards: 78.486, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon2': '0.156', 'AMMO4': '0.201', 'weapon4': '0.206', 'weapon5': '0.222', 'HEALTH': '0.225', 'AMMO3': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.000'} [2024-08-06 08:23:52,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 686850048. Throughput: 0: 4364.5. Samples: 171717020. Policy #0 lag: (min: 0.0, avg: 3.0, max: 7.0) [2024-08-06 08:23:52,794][52567] Avg episode reward: [(0, '77.268')] [2024-08-06 08:23:52,903][52668] DAMAGECOUNT value on done: 952681.0 [2024-08-06 08:23:52,904][52668] Sum rewards: 67.344, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.760', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.150', 'weapon2': '0.288', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.322', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '58.000'} [2024-08-06 08:23:52,979][52649] DAMAGECOUNT value on done: 950716.0 [2024-08-06 08:23:52,980][52649] Sum rewards: 70.034, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.330', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.093', 'weapon4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '59.000'} [2024-08-06 08:23:53,434][52665] DAMAGECOUNT value on done: 958959.0 [2024-08-06 08:23:53,436][52665] Sum rewards: 79.719, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.185', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.168', 'weapon2': '0.216', 'weapon4': '0.216', 'AMMO4': '0.238', 'AMMO3': '0.283', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.122', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:53,658][52667] DAMAGECOUNT value on done: 977746.0 [2024-08-06 08:23:53,659][52667] Sum rewards: 94.861, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.312', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.150', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON3': '1.600', 'weapon3': '3.536', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '22.437', 'FRAGCOUNT': '80.000'} [2024-08-06 08:23:53,687][52662] DAMAGECOUNT value on done: 986107.0 [2024-08-06 08:23:53,688][52662] Sum rewards: 80.548, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.841', 'AMMO5': '0.009', 'AMMO2': '0.038', 'weapon4': '0.048', 'weapon5': '0.118', 'AMMO4': '0.189', 'AMMO3': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '65.000'} [2024-08-06 08:23:54,349][52666] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:23:54,402][52666] DAMAGECOUNT value on done: 963206.0 [2024-08-06 08:23:54,403][52666] Sum rewards: 82.364, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.134', 'weapon4': '0.142', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '66.000'} [2024-08-06 08:23:55,676][52668] DAMAGECOUNT value on done: 969393.0 [2024-08-06 08:23:55,677][52668] Sum rewards: 75.822, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.093', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.450', 'HEALTH': '0.890', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:55,851][52650] Updated weights for policy 0, policy_version 83851 (0.0020) [2024-08-06 08:23:55,853][52649] DAMAGECOUNT value on done: 945602.0 [2024-08-06 08:23:55,855][52649] Sum rewards: 69.205, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.555', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.080', 'weapon5': '0.156', 'AMMO4': '0.177', 'AMMO3': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.750', 'weapon3': '3.018', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.830', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:56,383][52665] DAMAGECOUNT value on done: 965792.0 [2024-08-06 08:23:56,384][52665] Sum rewards: 82.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.628', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.044', 'AMMO4': '0.150', 'weapon5': '0.150', 'weapon2': '0.180', 'AMMO3': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.422', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '70.000'} [2024-08-06 08:23:56,732][52803] DAMAGECOUNT value on done: 900980.0 [2024-08-06 08:23:56,732][52803] Sum rewards: 81.716, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.852', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON5': '0.050', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.128', 'AMMO3': '0.184', 'weapon2': '0.232', 'weapon4': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.922', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '65.000'} [2024-08-06 08:23:56,916][52667] DAMAGECOUNT value on done: 982389.0 [2024-08-06 08:23:56,925][52667] Sum rewards: 82.320, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.615', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.134', 'AMMO4': '0.159', 'weapon4': '0.196', 'AMMO3': '0.213', 'weapon2': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '68.000'} [2024-08-06 08:23:56,946][52662] DAMAGECOUNT value on done: 962847.0 [2024-08-06 08:23:56,947][52662] Sum rewards: 71.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.126', 'AMMO4': '0.222', 'AMMO3': '0.228', 'weapon2': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.352', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 08:23:57,553][52659] DAMAGECOUNT value on done: 973239.0 [2024-08-06 08:23:57,553][52659] Sum rewards: 76.478, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.344', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon5': '0.066', 'weapon4': '0.100', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.396', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '65.000'} [2024-08-06 08:23:57,794][52567] Fps is (10 sec: 18040.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 686940160. Throughput: 0: 4359.7. Samples: 171743180. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:23:57,794][52567] Avg episode reward: [(0, '77.899')] [2024-08-06 08:23:58,248][52668] DAMAGECOUNT value on done: 971244.0 [2024-08-06 08:23:58,248][52668] Sum rewards: 75.038, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.022', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.276', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.464', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '63.000'} [2024-08-06 08:23:59,097][52649] DAMAGECOUNT value on done: 943008.0 [2024-08-06 08:23:59,098][52649] Sum rewards: 88.474, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.741', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.104', 'weapon4': '0.118', 'AMMO4': '0.144', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.075', 'FRAGCOUNT': '70.500'} [2024-08-06 08:23:59,628][52665] DAMAGECOUNT value on done: 958905.0 [2024-08-06 08:23:59,629][52665] Sum rewards: 68.731, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.076', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.142', 'weapon2': '0.190', 'AMMO3': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.090', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '59.000'} [2024-08-06 08:23:59,852][52662] DAMAGECOUNT value on done: 967975.0 [2024-08-06 08:23:59,853][52662] Sum rewards: 74.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.700', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.189', 'weapon2': '0.418', 'WEAPON3': '1.200', 'HITCOUNT': '3.450', 'weapon3': '3.478', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '61.000'} [2024-08-06 08:23:59,884][52803] DAMAGECOUNT value on done: 900749.0 [2024-08-06 08:23:59,885][52803] Sum rewards: 82.969, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO3': '0.156', 'HEALTH': '0.182', 'AMMO4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '0.900', 'weapon3': '3.284', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:00,053][52667] DAMAGECOUNT value on done: 970786.0 [2024-08-06 08:24:00,055][52667] Sum rewards: 78.506, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.212', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.174', 'AMMO3': '0.175', 'weapon5': '0.184', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.388', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.615', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:00,134][52659] DAMAGECOUNT value on done: 971630.0 [2024-08-06 08:24:00,136][52659] Sum rewards: 72.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.292', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.149', 'weapon5': '0.174', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.162', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:00,383][52650] Updated weights for policy 0, policy_version 83861 (0.0018) [2024-08-06 08:24:00,810][52668] DAMAGECOUNT value on done: 969070.0 [2024-08-06 08:24:00,810][52668] Sum rewards: 72.589, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.545', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.140', 'weapon5': '0.172', 'AMMO3': '0.174', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.150', 'weapon3': '2.892', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:01,699][52649] DAMAGECOUNT value on done: 957233.0 [2024-08-06 08:24:01,700][52649] Sum rewards: 78.789, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.250', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon5': '0.080', 'weapon4': '0.096', 'AMMO4': '0.179', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.398', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.000'} [2024-08-06 08:24:02,214][52665] DAMAGECOUNT value on done: 952116.0 [2024-08-06 08:24:02,215][52665] Sum rewards: 77.262, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.548', 'AMMO5': '0.017', 'AMMO2': '0.068', 'AMMO3': '0.171', 'weapon4': '0.246', 'weapon5': '0.272', 'AMMO4': '0.340', 'weapon2': '0.352', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.872', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:02,703][52662] DAMAGECOUNT value on done: 985329.0 [2024-08-06 08:24:02,704][52662] Sum rewards: 71.945, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.145', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.114', 'AMMO3': '0.169', 'AMMO4': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.640', 'WEAPON3': '1.100', 'weapon3': '3.030', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 687030272. Throughput: 0: 4353.8. Samples: 171756190. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:02,794][52567] Avg episode reward: [(0, '77.599')] [2024-08-06 08:24:02,850][52667] DAMAGECOUNT value on done: 971010.0 [2024-08-06 08:24:02,855][52667] Sum rewards: 65.220, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.760', 'AMMO5': '0.010', 'AMMO2': '0.052', 'weapon4': '0.106', 'AMMO3': '0.184', 'weapon5': '0.184', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.622', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '53.500'} [2024-08-06 08:24:02,869][52803] DAMAGECOUNT value on done: 910052.0 [2024-08-06 08:24:02,870][52803] Sum rewards: 80.144, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'weapon4': '0.132', 'AMMO3': '0.182', 'HEALTH': '0.210', 'weapon2': '0.242', 'WEAPON3': '1.050', 'weapon3': '3.410', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:03,176][52659] DAMAGECOUNT value on done: 984296.0 [2024-08-06 08:24:03,176][52659] Sum rewards: 82.123, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.750', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.048', 'AMMO4': '0.103', 'weapon5': '0.128', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.748', 'WEAPON3': '1.500', 'weapon3': '2.840', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '69.000'} [2024-08-06 08:24:03,901][52668] DAMAGECOUNT value on done: 970712.0 [2024-08-06 08:24:03,901][52668] Sum rewards: 82.578, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.968', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.138', 'weapon2': '0.202', 'weapon5': '0.216', 'AMMO4': '0.224', 'AMMO3': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.174', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '69.000'} [2024-08-06 08:24:04,711][52649] DAMAGECOUNT value on done: 962673.0 [2024-08-06 08:24:04,711][52649] Sum rewards: 76.440, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.245', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'AMMO3': '0.148', 'weapon4': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.242', 'WEAPON3': '1.000', 'weapon3': '3.346', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '60.000'} [2024-08-06 08:24:05,029][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:24:05,176][52650] Updated weights for policy 0, policy_version 83871 (0.0016) [2024-08-06 08:24:05,334][52667] DAMAGECOUNT value on done: 980782.0 [2024-08-06 08:24:05,335][52667] Sum rewards: 62.520, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.269', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.452', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '54.000'} [2024-08-06 08:24:05,379][52665] DAMAGECOUNT value on done: 958605.0 [2024-08-06 08:24:05,380][52665] Sum rewards: 80.543, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.078', 'weapon5': '0.212', 'AMMO3': '0.230', 'AMMO4': '0.237', 'weapon2': '0.396', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:05,910][52662] DAMAGECOUNT value on done: 973695.0 [2024-08-06 08:24:05,910][52662] Sum rewards: 82.627, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.068', 'AMMO4': '0.102', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.336', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '68.000'} [2024-08-06 08:24:05,994][52659] DAMAGECOUNT value on done: 976201.0 [2024-08-06 08:24:05,995][52659] Sum rewards: 88.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.775', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.104', 'AMMO4': '0.201', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.735', 'FRAGCOUNT': '71.000'} [2024-08-06 08:24:06,016][52803] DAMAGECOUNT value on done: 903214.0 [2024-08-06 08:24:06,016][52803] Sum rewards: 74.996, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.900', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.062', 'weapon5': '0.146', 'AMMO3': '0.162', 'AMMO4': '0.172', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.230', 'weapon3': '3.356', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '60.000'} [2024-08-06 08:24:06,595][52668] DAMAGECOUNT value on done: 975373.0 [2024-08-06 08:24:06,595][52668] Sum rewards: 72.700, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.350', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.163', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.256', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:06,709][52671] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:24:06,801][52664] DAMAGECOUNT value on done: 999719.0 [2024-08-06 08:24:06,801][52664] Sum rewards: 73.653, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.674', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.180', 'weapon5': '0.192', 'AMMO3': '0.199', 'AMMO4': '0.222', 'weapon2': '0.234', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.114', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '60.000'} [2024-08-06 08:24:07,209][52649] DAMAGECOUNT value on done: 953713.0 [2024-08-06 08:24:07,211][52649] Sum rewards: 76.429, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.138', 'AMMO3': '0.194', 'AMMO4': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.932', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:07,229][52660] DAMAGECOUNT value on done: 967308.0 [2024-08-06 08:24:07,234][52660] Sum rewards: 79.477, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.625', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.108', 'weapon4': '0.114', 'AMMO4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:07,697][52665] DAMAGECOUNT value on done: 964240.0 [2024-08-06 08:24:07,697][52665] Sum rewards: 88.868, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.425', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.046', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon4': '0.232', 'weapon2': '0.296', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.306', 'FRAGCOUNT': '70.000'} [2024-08-06 08:24:07,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 687112192. Throughput: 0: 4365.5. Samples: 171782760. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:07,795][52567] Avg episode reward: [(0, '77.734')] [2024-08-06 08:24:08,437][52667] DAMAGECOUNT value on done: 970071.0 [2024-08-06 08:24:08,438][52667] Sum rewards: 77.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.975', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.150', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.530', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:08,514][52659] DAMAGECOUNT value on done: 968267.0 [2024-08-06 08:24:08,516][52659] Sum rewards: 64.968, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.380', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.128', 'weapon5': '0.162', 'AMMO4': '0.177', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '2.760', 'weapon3': '3.120', 'DAMAGECOUNT': '15.936', 'FRAGCOUNT': '55.500'} [2024-08-06 08:24:08,577][52662] DAMAGECOUNT value on done: 976683.0 [2024-08-06 08:24:08,578][52662] Sum rewards: 77.437, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.235', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.154', 'AMMO4': '0.174', 'weapon2': '0.176', 'weapon5': '0.194', 'AMMO3': '0.267', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.178', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:09,195][52803] DAMAGECOUNT value on done: 903590.0 [2024-08-06 08:24:09,196][52803] Sum rewards: 79.602, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.084', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.000', 'weapon3': '3.170', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '64.000'} [2024-08-06 08:24:09,699][52649] DAMAGECOUNT value on done: 953326.0 [2024-08-06 08:24:09,710][52649] Sum rewards: 83.593, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.032', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.182', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '3.250', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '68.000'} [2024-08-06 08:24:09,733][52650] Updated weights for policy 0, policy_version 83881 (0.0012) [2024-08-06 08:24:09,902][52664] DAMAGECOUNT value on done: 1008216.0 [2024-08-06 08:24:09,902][52664] Sum rewards: 75.287, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.125', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.137', 'AMMO3': '0.249', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.378', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:10,417][52660] DAMAGECOUNT value on done: 958853.0 [2024-08-06 08:24:10,417][52660] Sum rewards: 71.859, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.483', 'AMMO5': '0.022', 'AMMO2': '0.065', 'weapon4': '0.138', 'AMMO3': '0.254', 'AMMO4': '0.326', 'weapon2': '0.338', 'weapon5': '0.356', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.842', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '60.000'} [2024-08-06 08:24:11,007][52659] DAMAGECOUNT value on done: 974350.0 [2024-08-06 08:24:11,011][52659] Sum rewards: 79.384, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.209', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.120', 'weapon4': '0.186', 'AMMO3': '0.191', 'AMMO4': '0.252', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.170', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.696', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:11,192][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:24:11,327][52662] DAMAGECOUNT value on done: 972573.0 [2024-08-06 08:24:11,327][52662] Sum rewards: 71.135, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.515', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.258', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.290', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '60.000'} [2024-08-06 08:24:11,747][52667] DAMAGECOUNT value on done: 977426.0 [2024-08-06 08:24:11,748][52667] Sum rewards: 63.742, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.072', 'weapon4': '0.100', 'AMMO3': '0.185', 'AMMO4': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.242', 'DAMAGECOUNT': '14.340', 'FRAGCOUNT': '52.000'} [2024-08-06 08:24:12,279][52658] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:24:12,398][52803] DAMAGECOUNT value on done: 900653.0 [2024-08-06 08:24:12,398][52803] Sum rewards: 67.892, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.280', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.134', 'weapon4': '0.144', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.233', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '57.000'} [2024-08-06 08:24:12,444][52649] DAMAGECOUNT value on done: 941680.0 [2024-08-06 08:24:12,444][52649] Sum rewards: 83.526, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.018', 'AMMO2': '0.049', 'AMMO3': '0.151', 'weapon5': '0.232', 'AMMO4': '0.243', 'weapon4': '0.318', 'weapon2': '0.374', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.900', 'weapon3': '2.814', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17478.0, 300 sec: 17439.2). Total num frames: 687202304. Throughput: 0: 4368.0. Samples: 171808920. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:12,794][52567] Avg episode reward: [(0, '77.426')] [2024-08-06 08:24:13,082][52664] DAMAGECOUNT value on done: 1012874.0 [2024-08-06 08:24:13,082][52664] Sum rewards: 84.918, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.085', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.134', 'AMMO3': '0.155', 'AMMO4': '0.218', 'weapon4': '0.282', 'weapon2': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.050', 'weapon3': '2.986', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '67.000'} [2024-08-06 08:24:13,327][52660] DAMAGECOUNT value on done: 971700.0 [2024-08-06 08:24:13,328][52660] Sum rewards: 80.708, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.654', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.094', 'AMMO4': '0.224', 'AMMO3': '0.232', 'weapon5': '0.234', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:13,619][52662] DAMAGECOUNT value on done: 969839.0 [2024-08-06 08:24:13,619][52662] Sum rewards: 70.779, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.602', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.100', 'AMMO4': '0.106', 'weapon5': '0.136', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.448', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '59.000'} [2024-08-06 08:24:14,193][52659] DAMAGECOUNT value on done: 973702.0 [2024-08-06 08:24:14,194][52659] Sum rewards: 68.525, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.250', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.040', 'weapon5': '0.064', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.249', 'weapon2': '0.294', 'WEAPON3': '1.450', 'HITCOUNT': '3.290', 'weapon3': '3.436', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:14,250][52650] Updated weights for policy 0, policy_version 83891 (0.0012) [2024-08-06 08:24:14,806][52667] DAMAGECOUNT value on done: 984037.0 [2024-08-06 08:24:14,808][52667] Sum rewards: 66.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.275', 'AMMO2': '0.004', 'AMMO5': '0.005', 'AMMO4': '0.019', 'WEAPON4': '0.050', 'weapon5': '0.080', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.322', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.156', 'FRAGCOUNT': '56.000'} [2024-08-06 08:24:15,326][52649] DAMAGECOUNT value on done: 955278.0 [2024-08-06 08:24:15,328][52649] Sum rewards: 79.118, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.772', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.156', 'weapon5': '0.176', 'AMMO3': '0.190', 'AMMO4': '0.193', 'weapon2': '0.196', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:15,636][52803] DAMAGECOUNT value on done: 899823.0 [2024-08-06 08:24:15,638][52803] Sum rewards: 86.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.844', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.060', 'AMMO4': '0.114', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.370', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.769', 'FRAGCOUNT': '70.000'} [2024-08-06 08:24:15,872][52660] DAMAGECOUNT value on done: 983506.0 [2024-08-06 08:24:15,874][52660] Sum rewards: 83.039, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.384', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'weapon4': '0.258', 'AMMO3': '0.265', 'weapon2': '0.284', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '71.000'} [2024-08-06 08:24:16,153][52664] DAMAGECOUNT value on done: 1001487.0 [2024-08-06 08:24:16,154][52664] Sum rewards: 82.233, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO5': '0.017', 'AMMO2': '0.046', 'AMMO3': '0.136', 'weapon2': '0.194', 'AMMO4': '0.232', 'weapon5': '0.244', 'weapon4': '0.312', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '0.950', 'weapon3': '3.030', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:16,360][52662] DAMAGECOUNT value on done: 964700.0 [2024-08-06 08:24:16,361][52662] Sum rewards: 70.746, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.940', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'weapon2': '0.410', 'WEAPON3': '1.750', 'weapon3': '3.224', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:16,847][52659] DAMAGECOUNT value on done: 973211.0 [2024-08-06 08:24:16,847][52659] Sum rewards: 68.599, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.001', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.114', 'weapon5': '0.180', 'AMMO4': '0.195', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.300', 'HITCOUNT': '2.880', 'weapon3': '3.008', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 687292416. Throughput: 0: 4370.9. Samples: 171822040. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:17,794][52567] Avg episode reward: [(0, '77.158')] [2024-08-06 08:24:17,828][52667] DAMAGECOUNT value on done: 985801.0 [2024-08-06 08:24:17,830][52667] Sum rewards: 82.694, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.138', 'AMMO3': '0.188', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '68.000'} [2024-08-06 08:24:18,209][52649] DAMAGECOUNT value on done: 935922.0 [2024-08-06 08:24:18,209][52649] Sum rewards: 76.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.286', 'AMMO5': '0.009', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.084', 'AMMO4': '0.123', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '3.198', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:18,766][52660] DAMAGECOUNT value on done: 964845.0 [2024-08-06 08:24:18,767][52660] Sum rewards: 81.078, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.116', 'AMMO5': '0.021', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.197', 'weapon2': '0.224', 'weapon4': '0.240', 'weapon5': '0.314', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.960', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '69.000'} [2024-08-06 08:24:18,768][52803] DAMAGECOUNT value on done: 899843.0 [2024-08-06 08:24:18,768][52803] Sum rewards: 73.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.882', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.112', 'weapon5': '0.214', 'AMMO3': '0.221', 'AMMO4': '0.226', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:19,031][52650] Updated weights for policy 0, policy_version 83901 (0.0021) [2024-08-06 08:24:19,074][52664] DAMAGECOUNT value on done: 1016527.0 [2024-08-06 08:24:19,076][52664] Sum rewards: 74.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.216', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.156', 'AMMO4': '0.174', 'AMMO3': '0.205', 'weapon5': '0.214', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'HITCOUNT': '2.930', 'weapon3': '3.054', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:19,288][52662] DAMAGECOUNT value on done: 976836.0 [2024-08-06 08:24:19,291][52662] Sum rewards: 76.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.220', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.088', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.374', 'WEAPON3': '1.350', 'weapon3': '3.296', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '63.500'} [2024-08-06 08:24:19,961][52659] DAMAGECOUNT value on done: 971132.0 [2024-08-06 08:24:19,964][52659] Sum rewards: 74.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO4': '0.195', 'AMMO3': '0.200', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.070', 'weapon3': '3.264', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:20,743][52667] DAMAGECOUNT value on done: 981459.0 [2024-08-06 08:24:20,744][52667] Sum rewards: 77.531, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.498', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.060', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '62.500'} [2024-08-06 08:24:21,098][52649] DAMAGECOUNT value on done: 954537.0 [2024-08-06 08:24:21,098][52649] Sum rewards: 75.170, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.740', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.110', 'AMMO4': '0.135', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '3.348', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:21,663][52659] Large shaping reward 2.672 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', 0.05, 10.0), ('weapon5', 0.002)] [2024-08-06 08:24:21,931][52664] DAMAGECOUNT value on done: 1012740.0 [2024-08-06 08:24:21,932][52664] Sum rewards: 84.916, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.126', 'AMMO5': '0.006', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.406', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '70.000'} [2024-08-06 08:24:21,964][52660] DAMAGECOUNT value on done: 962384.0 [2024-08-06 08:24:21,967][52660] Sum rewards: 70.867, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.730', 'ARMOR': '0.004', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.132', 'AMMO4': '0.139', 'AMMO3': '0.141', 'weapon4': '0.158', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.562', 'WEAPON3': '0.900', 'weapon3': '2.888', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '55.000'} [2024-08-06 08:24:22,029][52803] DAMAGECOUNT value on done: 908026.0 [2024-08-06 08:24:22,030][52803] Sum rewards: 73.182, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.675', 'AMMO5': '0.018', 'AMMO2': '0.061', 'weapon4': '0.088', 'weapon5': '0.154', 'AMMO3': '0.264', 'AMMO4': '0.305', 'weapon2': '0.334', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:22,230][52662] DAMAGECOUNT value on done: 968279.0 [2024-08-06 08:24:22,233][52662] Sum rewards: 83.133, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.072', 'weapon4': '0.082', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.386', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '69.000'} [2024-08-06 08:24:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 687374336. Throughput: 0: 4369.3. Samples: 171848230. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:22,794][52567] Avg episode reward: [(0, '76.788')] [2024-08-06 08:24:23,083][52667] DAMAGECOUNT value on done: 976376.0 [2024-08-06 08:24:23,083][52667] Sum rewards: 70.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.430', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.112', 'weapon4': '0.124', 'AMMO4': '0.157', 'AMMO3': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '0.950', 'HITCOUNT': '3.040', 'weapon3': '3.202', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '57.000'} [2024-08-06 08:24:23,207][52659] DAMAGECOUNT value on done: 982483.0 [2024-08-06 08:24:23,209][52659] Sum rewards: 79.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.073', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.077', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.191', 'weapon2': '0.276', 'WEAPON3': '1.300', 'weapon3': '3.330', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:23,559][52650] Updated weights for policy 0, policy_version 83911 (0.0032) [2024-08-06 08:24:24,326][52649] DAMAGECOUNT value on done: 957215.0 [2024-08-06 08:24:24,330][52649] Sum rewards: 69.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.517', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.116', 'AMMO4': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.378', 'WEAPON3': '1.450', 'weapon3': '3.222', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:24,485][52664] DAMAGECOUNT value on done: 1002015.0 [2024-08-06 08:24:24,488][52664] Sum rewards: 87.313, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.470', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.086', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '72.000'} [2024-08-06 08:24:24,984][52660] DAMAGECOUNT value on done: 969579.0 [2024-08-06 08:24:24,984][52660] Sum rewards: 73.964, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.784', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.192', 'AMMO4': '0.270', 'AMMO3': '0.303', 'weapon2': '0.318', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.060', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.245', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:25,194][52803] DAMAGECOUNT value on done: 901996.0 [2024-08-06 08:24:25,194][52803] Sum rewards: 64.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.799', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.190', 'AMMO3': '0.205', 'weapon2': '0.296', 'weapon4': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.896', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '53.000'} [2024-08-06 08:24:25,543][52662] DAMAGECOUNT value on done: 982894.0 [2024-08-06 08:24:25,544][52662] Sum rewards: 77.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.030', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.012', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.052', 'AMMO3': '0.167', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.338', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:25,611][52667] DAMAGECOUNT value on done: 982581.0 [2024-08-06 08:24:25,611][52667] Sum rewards: 90.634, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.836', 'AMMO4': '-0.003', 'AMMO2': '-0.000', 'AMMO5': '0.003', 'weapon4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.161', 'weapon2': '0.706', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '72.000'} [2024-08-06 08:24:26,151][52659] DAMAGECOUNT value on done: 966524.0 [2024-08-06 08:24:26,152][52659] Sum rewards: 80.808, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.320', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.105', 'AMMO3': '0.121', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.290', 'weapon2': '0.696', 'WEAPON3': '0.750', 'weapon3': '2.636', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:27,022][52795] Large shaping reward 2.526 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.504, 168.0), ('weapon5', 0.002)] [2024-08-06 08:24:27,059][52649] DAMAGECOUNT value on done: 945929.0 [2024-08-06 08:24:27,059][52649] Sum rewards: 64.007, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.066', 'HEALTH': '0.136', 'AMMO3': '0.148', 'weapon5': '0.174', 'AMMO4': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.704', 'WEAPON3': '0.850', 'weapon3': '2.864', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.870', 'FRAGCOUNT': '49.000'} [2024-08-06 08:24:27,363][52664] DAMAGECOUNT value on done: 1002192.0 [2024-08-06 08:24:27,363][52664] Sum rewards: 70.580, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.202', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO3': '0.167', 'AMMO4': '0.190', 'AMMO6': '0.200', 'WEAPON7': '0.200', 'AMMO7': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.308', 'weapon2': '0.330', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.084', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '56.000'} [2024-08-06 08:24:27,625][52660] DAMAGECOUNT value on done: 975255.0 [2024-08-06 08:24:27,625][52660] Sum rewards: 86.178, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.170', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.094', 'WEAPON5': '0.100', 'weapon4': '0.126', 'AMMO3': '0.187', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.086', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '69.000'} [2024-08-06 08:24:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 687464448. Throughput: 0: 4364.2. Samples: 171874300. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:27,794][52567] Avg episode reward: [(0, '77.012')] [2024-08-06 08:24:27,879][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083920_687472640.pth... [2024-08-06 08:24:28,048][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083408_683278336.pth [2024-08-06 08:24:28,315][52803] DAMAGECOUNT value on done: 914741.0 [2024-08-06 08:24:28,316][52803] Sum rewards: 81.927, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.344', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.092', 'AMMO3': '0.163', 'AMMO4': '0.210', 'weapon5': '0.304', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.050', 'weapon3': '2.918', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '64.500'} [2024-08-06 08:24:28,346][52650] Updated weights for policy 0, policy_version 83921 (0.0023) [2024-08-06 08:24:28,887][52659] DAMAGECOUNT value on done: 978651.0 [2024-08-06 08:24:28,889][52659] Sum rewards: 76.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.941', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon5': '0.050', 'weapon4': '0.080', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.312', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:29,048][52658] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:24:29,048][52662] DAMAGECOUNT value on done: 972281.0 [2024-08-06 08:24:29,049][52662] Sum rewards: 69.688, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.500', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.112', 'weapon5': '0.144', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 08:24:30,391][52664] DAMAGECOUNT value on done: 1010078.0 [2024-08-06 08:24:30,391][52664] Sum rewards: 80.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.495', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.148', 'weapon5': '0.162', 'AMMO3': '0.234', 'weapon2': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:30,393][52660] DAMAGECOUNT value on done: 963364.0 [2024-08-06 08:24:30,393][52660] Sum rewards: 64.915, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.226', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.158', 'AMMO3': '0.162', 'weapon5': '0.218', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.692', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '54.000'} [2024-08-06 08:24:31,243][52659] DAMAGECOUNT value on done: 971340.0 [2024-08-06 08:24:31,244][52659] Sum rewards: 74.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.310', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.078', 'AMMO4': '0.199', 'weapon5': '0.220', 'AMMO3': '0.249', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.990', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:31,484][52803] DAMAGECOUNT value on done: 911618.0 [2024-08-06 08:24:31,484][52803] Sum rewards: 71.346, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.846', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon4': '0.076', 'weapon5': '0.166', 'AMMO3': '0.205', 'AMMO4': '0.296', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '59.000'} [2024-08-06 08:24:31,626][52662] DAMAGECOUNT value on done: 962496.0 [2024-08-06 08:24:31,626][52662] Sum rewards: 61.559, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.790', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.098', 'AMMO3': '0.170', 'AMMO4': '0.235', 'weapon5': '0.236', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '2.870', 'weapon3': '2.986', 'DAMAGECOUNT': '14.748', 'FRAGCOUNT': '50.000'} [2024-08-06 08:24:32,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 687546368. Throughput: 0: 4364.5. Samples: 171887180. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:32,795][52567] Avg episode reward: [(0, '76.693')] [2024-08-06 08:24:33,283][52650] Updated weights for policy 0, policy_version 83931 (0.0020) [2024-08-06 08:24:33,326][52660] DAMAGECOUNT value on done: 962413.0 [2024-08-06 08:24:33,327][52660] Sum rewards: 63.087, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon2': '0.138', 'AMMO3': '0.173', 'weapon5': '0.190', 'AMMO4': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.546', 'WEAPON3': '1.050', 'weapon3': '2.770', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '15.057', 'FRAGCOUNT': '52.000'} [2024-08-06 08:24:33,491][52664] DAMAGECOUNT value on done: 1006617.0 [2024-08-06 08:24:33,491][52664] Sum rewards: 69.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.395', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.074', 'weapon4': '0.076', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.172', 'AMMO3': '0.196', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.536', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:34,195][52659] DAMAGECOUNT value on done: 970067.0 [2024-08-06 08:24:34,197][52659] Sum rewards: 82.652, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.414', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.120', 'AMMO4': '0.189', 'AMMO3': '0.259', 'weapon5': '0.272', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '70.000'} [2024-08-06 08:24:34,532][52662] DAMAGECOUNT value on done: 970140.0 [2024-08-06 08:24:34,533][52662] Sum rewards: 88.719, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.719', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.306', 'weapon2': '0.378', 'WEAPON3': '1.900', 'weapon3': '3.234', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.486', 'FRAGCOUNT': '77.000'} [2024-08-06 08:24:34,615][52803] DAMAGECOUNT value on done: 900093.0 [2024-08-06 08:24:34,617][52803] Sum rewards: 68.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.120', 'weapon5': '0.162', 'AMMO4': '0.210', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:36,154][52660] DAMAGECOUNT value on done: 968761.0 [2024-08-06 08:24:36,154][52660] Sum rewards: 71.606, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.095', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.018', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'weapon2': '0.390', 'WEAPON3': '1.200', 'weapon3': '3.464', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '59.000'} [2024-08-06 08:24:36,307][52668] Large shaping reward 2.522 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47100000000000003, 157.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:24:36,567][52659] DAMAGECOUNT value on done: 972466.0 [2024-08-06 08:24:36,568][52659] Sum rewards: 81.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.134', 'AMMO3': '0.214', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.062', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '68.000'} [2024-08-06 08:24:36,628][52664] DAMAGECOUNT value on done: 1016472.0 [2024-08-06 08:24:36,628][52664] Sum rewards: 62.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.445', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO3': '0.159', 'AMMO4': '0.168', 'weapon4': '0.232', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.356', 'WEAPON3': '1.000', 'weapon3': '2.896', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '49.000'} [2024-08-06 08:24:37,251][52820] DAMAGECOUNT value on done: 898607.0 [2024-08-06 08:24:37,251][52820] Sum rewards: 70.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.310', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.130', 'weapon5': '0.194', 'AMMO4': '0.236', 'AMMO3': '0.250', 'weapon2': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.897', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:37,295][52662] DAMAGECOUNT value on done: 964347.0 [2024-08-06 08:24:37,296][52662] Sum rewards: 76.481, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.985', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.082', 'AMMO4': '0.171', 'weapon4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.054', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '64.000'} [2024-08-06 08:24:37,687][52803] DAMAGECOUNT value on done: 918538.0 [2024-08-06 08:24:37,690][52803] Sum rewards: 77.517, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.182', 'AMMO4': '0.185', 'AMMO3': '0.223', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '2.860', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 687636480. Throughput: 0: 4363.6. Samples: 171913380. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:37,794][52567] Avg episode reward: [(0, '75.998')] [2024-08-06 08:24:38,070][52650] Updated weights for policy 0, policy_version 83941 (0.0013) [2024-08-06 08:24:38,594][52660] DAMAGECOUNT value on done: 963918.0 [2024-08-06 08:24:38,595][52660] Sum rewards: 83.595, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.058', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.112', 'AMMO3': '0.140', 'weapon5': '0.184', 'WEAPON4': '0.250', 'weapon4': '0.346', 'WEAPON5': '0.350', 'weapon2': '0.510', 'WEAPON3': '0.900', 'weapon3': '2.766', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:39,289][52659] DAMAGECOUNT value on done: 973184.0 [2024-08-06 08:24:39,289][52659] Sum rewards: 72.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.918', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.118', 'AMMO4': '0.149', 'weapon5': '0.168', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.108', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:39,763][52664] DAMAGECOUNT value on done: 1013862.0 [2024-08-06 08:24:39,764][52664] Sum rewards: 80.096, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon5': '0.184', 'AMMO4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:39,935][52803] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 08:24:40,378][52820] DAMAGECOUNT value on done: 901727.0 [2024-08-06 08:24:40,380][52820] Sum rewards: 79.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.072', 'weapon5': '0.170', 'AMMO3': '0.181', 'AMMO4': '0.232', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.194', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:40,732][52803] DAMAGECOUNT value on done: 901161.0 [2024-08-06 08:24:40,735][52803] Sum rewards: 78.784, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.034', 'AMMO2': '0.010', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon4': '0.120', 'weapon2': '0.200', 'AMMO3': '0.253', 'WEAPON3': '1.600', 'weapon3': '3.526', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 08:24:41,677][52660] DAMAGECOUNT value on done: 964085.0 [2024-08-06 08:24:41,678][52660] Sum rewards: 77.980, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.712', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.136', 'AMMO4': '0.149', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon4': '0.318', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '64.000'} [2024-08-06 08:24:41,852][52659] DAMAGECOUNT value on done: 983721.0 [2024-08-06 08:24:41,855][52659] Sum rewards: 75.269, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.072', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.312', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:42,043][52664] DAMAGECOUNT value on done: 1011074.0 [2024-08-06 08:24:42,043][52664] Sum rewards: 74.773, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.084', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon5': '0.168', 'weapon4': '0.172', 'AMMO3': '0.208', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:42,629][52650] Updated weights for policy 0, policy_version 83951 (0.0013) [2024-08-06 08:24:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 687726592. Throughput: 0: 4369.3. Samples: 171939800. Policy #0 lag: (min: 1.0, avg: 3.8, max: 9.0) [2024-08-06 08:24:42,794][52567] Avg episode reward: [(0, '76.070')] [2024-08-06 08:24:43,577][52820] DAMAGECOUNT value on done: 903189.0 [2024-08-06 08:24:43,581][52820] Sum rewards: 79.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.010', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon5': '0.188', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.396', 'weapon4': '0.518', 'WEAPON3': '1.300', 'weapon3': '2.634', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:43,807][52803] DAMAGECOUNT value on done: 910601.0 [2024-08-06 08:24:43,807][52803] Sum rewards: 70.748, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.786', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.182', 'AMMO4': '0.202', 'weapon4': '0.224', 'weapon2': '0.238', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.032', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:44,673][52660] DAMAGECOUNT value on done: 974152.0 [2024-08-06 08:24:44,673][52660] Sum rewards: 67.285, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.085', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.122', 'weapon4': '0.128', 'AMMO4': '0.217', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '56.000'} [2024-08-06 08:24:44,745][52659] DAMAGECOUNT value on done: 965376.0 [2024-08-06 08:24:44,746][52659] Sum rewards: 74.153, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.280', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon5': '0.080', 'weapon4': '0.180', 'AMMO4': '0.218', 'AMMO3': '0.236', 'weapon2': '0.324', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '64.000'} [2024-08-06 08:24:44,781][52664] DAMAGECOUNT value on done: 1023208.0 [2024-08-06 08:24:44,781][52664] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.104', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.040', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.426', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.270', 'DAMAGECOUNT': '17.160', 'FRAGCOUNT': '60.000'} [2024-08-06 08:24:45,853][52669] DAMAGECOUNT value on done: 971370.0 [2024-08-06 08:24:45,855][52669] Sum rewards: 60.569, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.088', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.112', 'weapon2': '0.166', 'AMMO4': '0.168', 'weapon5': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'HITCOUNT': '3.060', 'weapon3': '3.316', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '51.000'} [2024-08-06 08:24:46,754][52820] DAMAGECOUNT value on done: 891598.0 [2024-08-06 08:24:46,756][52820] Sum rewards: 65.598, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.492', 'AMMO5': '0.025', 'AMMO2': '0.079', 'weapon4': '0.146', 'AMMO3': '0.313', 'weapon5': '0.392', 'AMMO4': '0.394', 'weapon2': '0.400', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.750', 'weapon3': '2.654', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:46,821][52803] DAMAGECOUNT value on done: 911874.0 [2024-08-06 08:24:46,822][52803] Sum rewards: 77.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.716', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.018', 'AMMO4': '0.089', 'AMMO3': '0.169', 'weapon5': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon4': '0.344', 'weapon2': '0.620', 'WEAPON3': '1.050', 'weapon3': '2.602', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.739', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:47,218][52650] Updated weights for policy 0, policy_version 83961 (0.0025) [2024-08-06 08:24:47,454][52658] DAMAGECOUNT value on done: 977375.0 [2024-08-06 08:24:47,454][52658] Sum rewards: 73.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.066', 'weapon5': '0.180', 'AMMO4': '0.185', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '60.000'} [2024-08-06 08:24:47,475][52664] DAMAGECOUNT value on done: 1020571.0 [2024-08-06 08:24:47,476][52664] Sum rewards: 82.078, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.989', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.146', 'AMMO4': '0.169', 'AMMO3': '0.203', 'weapon2': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:47,667][52659] DAMAGECOUNT value on done: 978360.0 [2024-08-06 08:24:47,672][52659] Sum rewards: 69.879, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.192', 'AMMO3': '0.229', 'weapon2': '0.232', 'WEAPON4': '0.250', 'weapon4': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '58.500'} [2024-08-06 08:24:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17615.7, 300 sec: 17494.8). Total num frames: 687816704. Throughput: 0: 4375.3. Samples: 171953080. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:24:47,794][52567] Avg episode reward: [(0, '75.651')] [2024-08-06 08:24:47,902][52660] DAMAGECOUNT value on done: 988329.0 [2024-08-06 08:24:47,902][52660] Sum rewards: 74.535, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.960', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.110', 'AMMO3': '0.232', 'weapon2': '0.246', 'AMMO4': '0.250', 'weapon5': '0.278', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '63.000'} [2024-08-06 08:24:48,909][52669] DAMAGECOUNT value on done: 969737.0 [2024-08-06 08:24:48,910][52669] Sum rewards: 78.871, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.802', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.040', 'AMMO4': '0.134', 'AMMO3': '0.153', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.050', 'weapon3': '3.350', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:49,933][52803] DAMAGECOUNT value on done: 917662.0 [2024-08-06 08:24:49,934][52803] Sum rewards: 75.301, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.006', 'AMMO2': '0.010', 'weapon4': '0.032', 'AMMO4': '0.051', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.518', 'WEAPON3': '1.500', 'weapon3': '3.156', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '64.000'} [2024-08-06 08:24:49,973][52820] DAMAGECOUNT value on done: 901876.0 [2024-08-06 08:24:49,975][52820] Sum rewards: 75.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.406', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.112', 'weapon5': '0.152', 'AMMO3': '0.195', 'AMMO4': '0.234', 'weapon2': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '64.000'} [2024-08-06 08:24:50,104][52664] DAMAGECOUNT value on done: 1019988.0 [2024-08-06 08:24:50,105][52664] Sum rewards: 89.204, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.475', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.090', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon4': '0.242', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '74.000'} [2024-08-06 08:24:50,125][52658] DAMAGECOUNT value on done: 977138.0 [2024-08-06 08:24:50,125][52658] Sum rewards: 80.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.310', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.136', 'WEAPON4': '0.150', 'weapon4': '0.168', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '65.000'} [2024-08-06 08:24:50,768][52659] DAMAGECOUNT value on done: 970008.0 [2024-08-06 08:24:50,769][52659] Sum rewards: 78.778, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.396', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.158', 'weapon5': '0.200', 'AMMO4': '0.243', 'AMMO3': '0.253', 'weapon2': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.736', 'FRAGCOUNT': '66.000'} [2024-08-06 08:24:50,903][52660] DAMAGECOUNT value on done: 967315.0 [2024-08-06 08:24:50,905][52660] Sum rewards: 76.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.800', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.086', 'AMMO4': '0.186', 'weapon5': '0.188', 'AMMO3': '0.195', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:51,010][52671] DAMAGECOUNT value on done: 978427.0 [2024-08-06 08:24:51,010][52671] Sum rewards: 77.029, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.037', 'AMMO5': '0.008', 'AMMO2': '0.028', 'AMMO3': '0.124', 'AMMO4': '0.141', 'weapon5': '0.144', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon4': '0.326', 'weapon2': '0.492', 'WEAPON3': '0.750', 'weapon3': '2.858', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:51,999][52650] Updated weights for policy 0, policy_version 83971 (0.0020) [2024-08-06 08:24:52,109][52669] DAMAGECOUNT value on done: 980517.0 [2024-08-06 08:24:52,111][52669] Sum rewards: 68.026, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.228', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.104', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '0.950', 'weapon3': '3.300', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.207', 'FRAGCOUNT': '54.000'} [2024-08-06 08:24:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 687906816. Throughput: 0: 4368.7. Samples: 171979350. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:24:52,795][52567] Avg episode reward: [(0, '75.554')] [2024-08-06 08:24:52,934][52658] DAMAGECOUNT value on done: 980856.0 [2024-08-06 08:24:52,935][52658] Sum rewards: 77.495, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.855', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.162', 'AMMO4': '0.192', 'WEAPON4': '0.250', 'weapon4': '0.286', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.000', 'weapon3': '3.008', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:53,051][52664] DAMAGECOUNT value on done: 1002778.0 [2024-08-06 08:24:53,052][52664] Sum rewards: 65.190, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.068', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.034', 'AMMO4': '0.056', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '53.000'} [2024-08-06 08:24:53,121][52803] DAMAGECOUNT value on done: 914535.0 [2024-08-06 08:24:53,122][52803] Sum rewards: 69.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.054', 'AMMO4': '0.119', 'weapon5': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.474', 'WEAPON3': '1.300', 'weapon3': '3.074', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 08:24:53,185][52820] DAMAGECOUNT value on done: 888194.0 [2024-08-06 08:24:53,185][52820] Sum rewards: 62.130, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.415', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.110', 'AMMO4': '0.172', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'WEAPON3': '1.600', 'HITCOUNT': '3.080', 'weapon3': '3.360', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '56.000'} [2024-08-06 08:24:54,038][52660] DAMAGECOUNT value on done: 971248.0 [2024-08-06 08:24:54,038][52660] Sum rewards: 51.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon5': '0.108', 'weapon4': '0.114', 'AMMO3': '0.193', 'WEAPON5': '0.200', 'AMMO4': '0.247', 'WEAPON4': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.820', 'weapon3': '3.096', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '44.000'} [2024-08-06 08:24:54,181][52671] DAMAGECOUNT value on done: 985397.0 [2024-08-06 08:24:54,181][52671] Sum rewards: 72.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.252', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '61.000'} [2024-08-06 08:24:54,793][52669] DAMAGECOUNT value on done: 974060.0 [2024-08-06 08:24:54,793][52669] Sum rewards: 84.036, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.064', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.190', 'AMMO3': '0.232', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.494', 'WEAPON3': '1.300', 'weapon3': '2.708', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '70.000'} [2024-08-06 08:24:55,684][52658] DAMAGECOUNT value on done: 975575.0 [2024-08-06 08:24:55,686][52658] Sum rewards: 73.083, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.650', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.118', 'AMMO3': '0.164', 'weapon4': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '3.064', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '58.000'} [2024-08-06 08:24:55,783][52664] DAMAGECOUNT value on done: 1006893.0 [2024-08-06 08:24:55,783][52664] Sum rewards: 72.555, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.048', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.264', 'AMMO3': '0.269', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:56,233][52803] DAMAGECOUNT value on done: 911208.0 [2024-08-06 08:24:56,234][52803] Sum rewards: 78.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.331', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.074', 'AMMO3': '0.194', 'AMMO4': '0.195', 'weapon5': '0.222', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.190', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '62.000'} [2024-08-06 08:24:56,315][52820] DAMAGECOUNT value on done: 894706.0 [2024-08-06 08:24:56,318][52820] Sum rewards: 58.609, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.871', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.024', 'AMMO4': '0.039', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.142', 'AMMO3': '0.149', 'weapon2': '0.914', 'WEAPON3': '0.950', 'weapon3': '2.786', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.313', 'FRAGCOUNT': '46.000'} [2024-08-06 08:24:56,732][52650] Updated weights for policy 0, policy_version 83981 (0.0011) [2024-08-06 08:24:57,012][52660] DAMAGECOUNT value on done: 970001.0 [2024-08-06 08:24:57,014][52660] Sum rewards: 83.768, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon5': '0.066', 'AMMO4': '0.067', 'weapon4': '0.096', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.466', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '67.000'} [2024-08-06 08:24:57,288][52671] DAMAGECOUNT value on done: 977753.0 [2024-08-06 08:24:57,296][52671] Sum rewards: 67.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.995', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.054', 'weapon5': '0.106', 'AMMO4': '0.154', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.230', 'weapon3': '3.368', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '56.000'} [2024-08-06 08:24:57,353][52669] DAMAGECOUNT value on done: 981451.0 [2024-08-06 08:24:57,355][52669] Sum rewards: 70.911, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.177', 'AMMO3': '0.235', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.150', 'weapon3': '3.328', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 08:24:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 687988736. Throughput: 0: 4362.2. Samples: 172005220. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:24:57,794][52567] Avg episode reward: [(0, '74.804')] [2024-08-06 08:24:58,223][52664] DAMAGECOUNT value on done: 1019121.0 [2024-08-06 08:24:58,225][52664] Sum rewards: 87.159, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.612', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO3': '0.168', 'AMMO4': '0.187', 'weapon5': '0.214', 'weapon4': '0.304', 'weapon2': '0.432', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '70.000'} [2024-08-06 08:24:58,503][52658] DAMAGECOUNT value on done: 968516.0 [2024-08-06 08:24:58,504][52658] Sum rewards: 80.086, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.770', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.092', 'weapon4': '0.100', 'AMMO4': '0.148', 'weapon2': '0.206', 'AMMO3': '0.249', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.366', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '67.000'} [2024-08-06 08:24:59,516][52820] DAMAGECOUNT value on done: 898043.0 [2024-08-06 08:24:59,518][52820] Sum rewards: 87.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.040', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.079', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.126', 'AMMO3': '0.168', 'weapon2': '0.262', 'weapon4': '0.324', 'WEAPON3': '1.050', 'weapon3': '3.168', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '70.000'} [2024-08-06 08:24:59,591][52660] DAMAGECOUNT value on done: 961509.0 [2024-08-06 08:24:59,591][52660] Sum rewards: 92.558, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.026', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '22.284', 'FRAGCOUNT': '73.000'} [2024-08-06 08:25:00,451][52671] DAMAGECOUNT value on done: 984202.0 [2024-08-06 08:25:00,451][52671] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.145', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.198', 'AMMO4': '0.200', 'weapon2': '0.202', 'AMMO3': '0.232', 'weapon5': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '61.000'} [2024-08-06 08:25:00,809][52669] DAMAGECOUNT value on done: 979690.0 [2024-08-06 08:25:00,810][52669] Sum rewards: 79.373, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.725', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.164', 'AMMO3': '0.176', 'weapon2': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:01,031][52664] DAMAGECOUNT value on done: 1001686.0 [2024-08-06 08:25:01,032][52664] Sum rewards: 82.195, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.705', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.090', 'AMMO4': '0.167', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.250', 'weapon3': '3.386', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '67.000'} [2024-08-06 08:25:01,402][52650] Updated weights for policy 0, policy_version 83991 (0.0020) [2024-08-06 08:25:01,675][52658] DAMAGECOUNT value on done: 967961.0 [2024-08-06 08:25:01,678][52658] Sum rewards: 84.243, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.222', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.090', 'AMMO3': '0.143', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.250', 'weapon2': '0.554', 'WEAPON3': '0.900', 'weapon3': '2.942', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.691', 'FRAGCOUNT': '67.000'} [2024-08-06 08:25:02,146][52614] Signal inference workers to stop experience collection... (15400 times) [2024-08-06 08:25:02,146][52614] Signal inference workers to resume experience collection... (15400 times) [2024-08-06 08:25:02,222][52650] InferenceWorker_p0-w0: stopping experience collection (15400 times) [2024-08-06 08:25:02,223][52650] InferenceWorker_p0-w0: resuming experience collection (15400 times) [2024-08-06 08:25:02,571][52660] DAMAGECOUNT value on done: 961408.0 [2024-08-06 08:25:02,572][52660] Sum rewards: 66.435, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.066', 'weapon4': '0.068', 'AMMO3': '0.179', 'weapon2': '0.198', 'WEAPON3': '1.100', 'HITCOUNT': '3.070', 'weapon3': '3.470', 'DAMAGECOUNT': '16.215', 'FRAGCOUNT': '53.500'} [2024-08-06 08:25:02,632][52820] DAMAGECOUNT value on done: 905527.0 [2024-08-06 08:25:02,636][52820] Sum rewards: 76.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.660', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.158', 'AMMO4': '0.194', 'AMMO3': '0.197', 'weapon5': '0.204', 'weapon2': '0.226', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.544', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:02,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 688070656. Throughput: 0: 4360.9. Samples: 172018280. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:25:02,794][52567] Avg episode reward: [(0, '75.177')] [2024-08-06 08:25:03,221][52671] DAMAGECOUNT value on done: 990499.0 [2024-08-06 08:25:03,223][52671] Sum rewards: 90.475, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.250', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.136', 'AMMO3': '0.145', 'weapon4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '0.900', 'weapon3': '3.250', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.299', 'FRAGCOUNT': '71.000'} [2024-08-06 08:25:03,850][52669] DAMAGECOUNT value on done: 978637.0 [2024-08-06 08:25:03,850][52669] Sum rewards: 58.002, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.709', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon5': '0.156', 'AMMO4': '0.226', 'AMMO3': '0.297', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.700', 'HITCOUNT': '2.780', 'weapon3': '3.068', 'DAMAGECOUNT': '14.724', 'FRAGCOUNT': '53.000'} [2024-08-06 08:25:04,618][52658] DAMAGECOUNT value on done: 980794.0 [2024-08-06 08:25:04,620][52658] Sum rewards: 73.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.133', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.124', 'weapon2': '0.216', 'AMMO3': '0.232', 'weapon5': '0.292', 'AMMO4': '0.295', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '59.000'} [2024-08-06 08:25:05,807][52820] DAMAGECOUNT value on done: 912689.0 [2024-08-06 08:25:05,807][52820] Sum rewards: 71.281, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.867', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.146', 'AMMO3': '0.204', 'AMMO4': '0.217', 'weapon4': '0.222', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '58.000'} [2024-08-06 08:25:06,209][52650] Updated weights for policy 0, policy_version 84001 (0.0035) [2024-08-06 08:25:06,369][52671] DAMAGECOUNT value on done: 978687.0 [2024-08-06 08:25:06,370][52671] Sum rewards: 82.262, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.942', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.074', 'weapon5': '0.146', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.281', 'WEAPON3': '1.700', 'weapon3': '3.266', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '71.000'} [2024-08-06 08:25:07,034][52669] DAMAGECOUNT value on done: 979201.0 [2024-08-06 08:25:07,035][52669] Sum rewards: 80.099, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO3': '0.155', 'weapon5': '0.210', 'AMMO4': '0.227', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.164', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '64.000'} [2024-08-06 08:25:07,086][52795] DAMAGECOUNT value on done: 896152.0 [2024-08-06 08:25:07,087][52795] Sum rewards: 78.257, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.726', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon5': '0.184', 'weapon4': '0.226', 'AMMO3': '0.232', 'weapon2': '0.248', 'WEAPON5': '0.250', 'AMMO4': '0.271', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.086', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '67.500'} [2024-08-06 08:25:07,372][52658] DAMAGECOUNT value on done: 967369.0 [2024-08-06 08:25:07,373][52658] Sum rewards: 69.720, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.321', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon7': '0.056', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.326', 'weapon4': '0.442', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '56.000'} [2024-08-06 08:25:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 688160768. Throughput: 0: 4363.6. Samples: 172044590. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:25:07,794][52567] Avg episode reward: [(0, '75.110')] [2024-08-06 08:25:08,780][52820] DAMAGECOUNT value on done: 893720.0 [2024-08-06 08:25:08,780][52820] Sum rewards: 72.036, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.595', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.038', 'WEAPON5': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon4': '0.172', 'AMMO3': '0.264', 'weapon2': '0.308', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:09,516][52671] DAMAGECOUNT value on done: 979922.0 [2024-08-06 08:25:09,517][52671] Sum rewards: 84.804, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.940', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.134', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON3': '1.050', 'weapon3': '3.364', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '67.000'} [2024-08-06 08:25:10,121][52669] DAMAGECOUNT value on done: 986742.0 [2024-08-06 08:25:10,122][52669] Sum rewards: 72.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.695', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.086', 'AMMO3': '0.166', 'weapon5': '0.178', 'AMMO4': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '3.078', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '58.000'} [2024-08-06 08:25:10,196][52795] DAMAGECOUNT value on done: 891674.0 [2024-08-06 08:25:10,197][52795] Sum rewards: 87.490, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.618', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.060', 'AMMO3': '0.240', 'weapon2': '0.444', 'WEAPON3': '1.550', 'weapon3': '3.306', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '74.000'} [2024-08-06 08:25:10,281][52663] DAMAGECOUNT value on done: 992134.0 [2024-08-06 08:25:10,281][52663] Sum rewards: 81.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.076', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.078', 'weapon5': '0.126', 'AMMO4': '0.144', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.150', 'weapon3': '3.066', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.242', 'FRAGCOUNT': '65.000'} [2024-08-06 08:25:10,449][52658] DAMAGECOUNT value on done: 995705.0 [2024-08-06 08:25:10,453][52658] Sum rewards: 78.944, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.585', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.042', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '3.290', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 08:25:10,787][52650] Updated weights for policy 0, policy_version 84011 (0.0018) [2024-08-06 08:25:10,827][52666] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:25:11,816][52820] DAMAGECOUNT value on done: 905222.0 [2024-08-06 08:25:11,818][52820] Sum rewards: 77.327, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.190', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.102', 'weapon5': '0.156', 'AMMO3': '0.171', 'AMMO4': '0.199', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.260', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '62.000'} [2024-08-06 08:25:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 688250880. Throughput: 0: 4369.8. Samples: 172070940. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:25:12,802][52567] Avg episode reward: [(0, '75.316')] [2024-08-06 08:25:13,111][52669] DAMAGECOUNT value on done: 979223.0 [2024-08-06 08:25:13,114][52669] Sum rewards: 74.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.334', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.116', 'weapon5': '0.180', 'AMMO3': '0.188', 'AMMO4': '0.220', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.196', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:13,227][52671] DAMAGECOUNT value on done: 985180.0 [2024-08-06 08:25:13,227][52671] Sum rewards: 74.566, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.794', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.050', 'AMMO4': '0.079', 'weapon5': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.229', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.112', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:13,316][52663] DAMAGECOUNT value on done: 975525.0 [2024-08-06 08:25:13,316][52663] Sum rewards: 72.812, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.510', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.164', 'AMMO4': '0.204', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.040', 'weapon3': '3.124', 'DAMAGECOUNT': '17.394', 'FRAGCOUNT': '65.000'} [2024-08-06 08:25:13,364][52795] DAMAGECOUNT value on done: 893663.0 [2024-08-06 08:25:13,365][52795] Sum rewards: 75.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.122', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.116', 'AMMO3': '0.174', 'weapon2': '0.244', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'HITCOUNT': '3.160', 'weapon3': '3.168', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '62.000'} [2024-08-06 08:25:13,850][52658] DAMAGECOUNT value on done: 982567.0 [2024-08-06 08:25:13,852][52658] Sum rewards: 69.891, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.500', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.104', 'AMMO4': '0.164', 'weapon5': '0.220', 'AMMO3': '0.247', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:14,910][52820] DAMAGECOUNT value on done: 918113.0 [2024-08-06 08:25:14,913][52820] Sum rewards: 71.881, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.880', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.078', 'weapon5': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.291', 'weapon2': '0.504', 'WEAPON3': '1.800', 'weapon3': '3.142', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '64.000'} [2024-08-06 08:25:15,273][52650] Updated weights for policy 0, policy_version 84021 (0.0025) [2024-08-06 08:25:15,285][52803] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:25:16,173][52671] DAMAGECOUNT value on done: 966438.0 [2024-08-06 08:25:16,175][52671] Sum rewards: 79.217, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.480', 'AMMO5': '0.011', 'AMMO2': '0.015', 'weapon4': '0.058', 'AMMO4': '0.077', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'weapon2': '0.312', 'AMMO3': '0.316', 'WEAPON3': '1.900', 'weapon3': '3.242', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '68.000'} [2024-08-06 08:25:16,195][52669] DAMAGECOUNT value on done: 985450.0 [2024-08-06 08:25:16,196][52669] Sum rewards: 85.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.468', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO3': '0.200', 'AMMO4': '0.225', 'weapon2': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.040', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '69.000'} [2024-08-06 08:25:16,318][52663] DAMAGECOUNT value on done: 970438.0 [2024-08-06 08:25:16,319][52663] Sum rewards: 72.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.096', 'weapon5': '0.138', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '3.210', 'weapon3': '3.308', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:16,487][52795] DAMAGECOUNT value on done: 907855.0 [2024-08-06 08:25:16,487][52795] Sum rewards: 81.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.625', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.130', 'weapon4': '0.142', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '66.000'} [2024-08-06 08:25:17,050][52658] DAMAGECOUNT value on done: 987065.0 [2024-08-06 08:25:17,051][52658] Sum rewards: 67.243, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.090', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.664', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '54.000'} [2024-08-06 08:25:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 688340992. Throughput: 0: 4375.1. Samples: 172084060. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:25:17,802][52567] Avg episode reward: [(0, '75.160')] [2024-08-06 08:25:17,900][52820] DAMAGECOUNT value on done: 906136.0 [2024-08-06 08:25:17,901][52820] Sum rewards: 65.456, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.544', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.088', 'weapon4': '0.124', 'weapon2': '0.188', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'AMMO4': '0.273', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.408', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '56.000'} [2024-08-06 08:25:18,778][52669] DAMAGECOUNT value on done: 985297.0 [2024-08-06 08:25:18,779][52669] Sum rewards: 72.771, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.998', 'AMMO5': '0.018', 'AMMO2': '0.042', 'AMMO3': '0.160', 'weapon4': '0.208', 'AMMO4': '0.212', 'weapon5': '0.270', 'WEAPON4': '0.450', 'weapon2': '0.462', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.790', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '58.500'} [2024-08-06 08:25:18,982][52663] DAMAGECOUNT value on done: 978298.0 [2024-08-06 08:25:18,983][52663] Sum rewards: 76.624, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.124', 'AMMO4': '0.154', 'weapon4': '0.188', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '64.000'} [2024-08-06 08:25:19,147][52671] DAMAGECOUNT value on done: 979960.0 [2024-08-06 08:25:19,148][52671] Sum rewards: 60.958, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.540', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.050', 'weapon5': '0.142', 'AMMO4': '0.177', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.148', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '51.000'} [2024-08-06 08:25:19,584][52795] DAMAGECOUNT value on done: 892041.0 [2024-08-06 08:25:19,584][52795] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.438', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.090', 'AMMO4': '0.170', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.260', 'WEAPON3': '1.550', 'weapon3': '3.144', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '62.000'} [2024-08-06 08:25:20,034][52650] Updated weights for policy 0, policy_version 84031 (0.0022) [2024-08-06 08:25:20,218][52658] DAMAGECOUNT value on done: 972759.0 [2024-08-06 08:25:20,219][52658] Sum rewards: 76.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.390', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.070', 'weapon5': '0.208', 'AMMO3': '0.242', 'AMMO4': '0.253', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:20,644][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:25:20,921][52820] DAMAGECOUNT value on done: 903364.0 [2024-08-06 08:25:20,923][52820] Sum rewards: 70.128, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.116', 'weapon5': '0.194', 'AMMO3': '0.197', 'AMMO4': '0.240', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.592', 'WEAPON3': '1.250', 'weapon3': '2.860', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '59.000'} [2024-08-06 08:25:21,768][52669] DAMAGECOUNT value on done: 971675.0 [2024-08-06 08:25:21,769][52669] Sum rewards: 73.375, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.105', 'AMMO3': '0.166', 'weapon5': '0.178', 'weapon2': '0.254', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.034', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '58.000'} [2024-08-06 08:25:22,057][52663] DAMAGECOUNT value on done: 976631.0 [2024-08-06 08:25:22,058][52663] Sum rewards: 80.735, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.153', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '1.048', 'WEAPON3': '1.250', 'weapon3': '2.710', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '66.000'} [2024-08-06 08:25:22,066][52671] DAMAGECOUNT value on done: 979510.0 [2024-08-06 08:25:22,066][52671] Sum rewards: 67.855, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.763', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon5': '0.162', 'AMMO4': '0.169', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.218', 'WEAPON5': '0.300', 'weapon4': '0.342', 'WEAPON3': '1.150', 'weapon3': '3.048', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '56.000'} [2024-08-06 08:25:22,775][52795] DAMAGECOUNT value on done: 895138.0 [2024-08-06 08:25:22,777][52795] Sum rewards: 68.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.587', 'AMMO5': '0.020', 'AMMO2': '0.071', 'weapon4': '0.160', 'AMMO3': '0.202', 'weapon5': '0.326', 'AMMO4': '0.355', 'weapon2': '0.376', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.150', 'HITCOUNT': '2.780', 'weapon3': '2.824', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '57.000'} [2024-08-06 08:25:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 688422912. Throughput: 0: 4377.1. Samples: 172110350. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:25:22,794][52567] Avg episode reward: [(0, '74.961')] [2024-08-06 08:25:23,200][52658] DAMAGECOUNT value on done: 984790.0 [2024-08-06 08:25:23,201][52658] Sum rewards: 60.900, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.367', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.103', 'weapon5': '0.130', 'AMMO3': '0.141', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.482', 'WEAPON3': '0.850', 'HITCOUNT': '2.920', 'weapon3': '3.202', 'DAMAGECOUNT': '14.214', 'FRAGCOUNT': '47.000'} [2024-08-06 08:25:24,292][52820] DAMAGECOUNT value on done: 905254.0 [2024-08-06 08:25:24,292][52820] Sum rewards: 85.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.192', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.116', 'weapon5': '0.134', 'weapon4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '69.000'} [2024-08-06 08:25:24,786][52669] DAMAGECOUNT value on done: 973059.0 [2024-08-06 08:25:24,786][52669] Sum rewards: 80.673, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.954', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.158', 'weapon5': '0.168', 'AMMO3': '0.223', 'AMMO4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.498', 'WEAPON3': '1.450', 'weapon3': '2.944', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '65.000'} [2024-08-06 08:25:24,824][52650] Updated weights for policy 0, policy_version 84041 (0.0022) [2024-08-06 08:25:24,981][52671] DAMAGECOUNT value on done: 978150.0 [2024-08-06 08:25:24,981][52671] Sum rewards: 83.500, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.037', 'HEALTH': '0.138', 'AMMO3': '0.181', 'AMMO4': '0.183', 'weapon5': '0.230', 'weapon4': '0.238', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '2.982', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '68.000'} [2024-08-06 08:25:25,063][52662] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:25:25,155][52663] DAMAGECOUNT value on done: 982735.0 [2024-08-06 08:25:25,157][52663] Sum rewards: 78.568, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.159', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.042', 'AMMO4': '0.074', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.386', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '66.000'} [2024-08-06 08:25:25,642][52794] DAMAGECOUNT value on done: 972007.0 [2024-08-06 08:25:25,644][52794] Sum rewards: 72.697, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.197', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.154', 'AMMO3': '0.159', 'weapon5': '0.178', 'weapon4': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.000', 'weapon3': '3.082', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '58.000'} [2024-08-06 08:25:25,832][52795] DAMAGECOUNT value on done: 908423.0 [2024-08-06 08:25:25,832][52795] Sum rewards: 82.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.296', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.056', 'AMMO4': '0.161', 'weapon5': '0.164', 'AMMO3': '0.175', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.048', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '67.000'} [2024-08-06 08:25:25,845][52658] DAMAGECOUNT value on done: 974349.0 [2024-08-06 08:25:25,846][52658] Sum rewards: 82.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.899', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.134', 'AMMO3': '0.218', 'weapon4': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.022', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.145', 'FRAGCOUNT': '68.000'} [2024-08-06 08:25:27,376][52820] DAMAGECOUNT value on done: 905447.0 [2024-08-06 08:25:27,378][52820] Sum rewards: 80.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.485', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.080', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.360', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '66.000'} [2024-08-06 08:25:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 688513024. Throughput: 0: 4370.0. Samples: 172136450. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:25:27,795][52567] Avg episode reward: [(0, '75.378')] [2024-08-06 08:25:27,853][52669] DAMAGECOUNT value on done: 982206.0 [2024-08-06 08:25:27,854][52669] Sum rewards: 66.415, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.066', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.148', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '55.000'} [2024-08-06 08:25:27,871][52671] DAMAGECOUNT value on done: 979090.0 [2024-08-06 08:25:27,871][52671] Sum rewards: 63.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.945', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.074', 'weapon5': '0.134', 'AMMO4': '0.173', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '55.000'} [2024-08-06 08:25:28,227][52663] DAMAGECOUNT value on done: 975444.0 [2024-08-06 08:25:28,228][52663] Sum rewards: 68.075, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.996', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.210', 'weapon4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '57.000'} [2024-08-06 08:25:28,626][52658] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:25:28,683][52794] DAMAGECOUNT value on done: 978678.0 [2024-08-06 08:25:28,684][52794] Sum rewards: 61.011, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.235', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.192', 'AMMO4': '0.196', 'AMMO3': '0.257', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.010', 'weapon3': '3.154', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '56.000'} [2024-08-06 08:25:28,966][52658] DAMAGECOUNT value on done: 978771.0 [2024-08-06 08:25:28,968][52658] Sum rewards: 79.956, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'HEALTH': '0.158', 'AMMO3': '0.189', 'weapon2': '0.462', 'WEAPON3': '1.100', 'weapon3': '3.354', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '64.000'} [2024-08-06 08:25:28,996][52795] DAMAGECOUNT value on done: 899018.0 [2024-08-06 08:25:28,997][52795] Sum rewards: 73.936, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.330', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.092', 'AMMO4': '0.120', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '3.046', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.991', 'FRAGCOUNT': '61.000'} [2024-08-06 08:25:29,511][52650] Updated weights for policy 0, policy_version 84051 (0.0027) [2024-08-06 08:25:30,546][52820] DAMAGECOUNT value on done: 912585.0 [2024-08-06 08:25:30,547][52820] Sum rewards: 71.905, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.810', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.064', 'AMMO4': '0.161', 'weapon5': '0.164', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:30,564][52671] DAMAGECOUNT value on done: 980904.0 [2024-08-06 08:25:30,566][52671] Sum rewards: 62.454, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.260', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.152', 'weapon5': '0.162', 'weapon4': '0.212', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.600', 'weapon3': '2.804', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '55.000'} [2024-08-06 08:25:30,620][52669] DAMAGECOUNT value on done: 1000508.0 [2024-08-06 08:25:30,621][52669] Sum rewards: 74.318, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.018', 'AMMO2': '0.034', 'weapon4': '0.072', 'AMMO4': '0.172', 'weapon5': '0.190', 'AMMO3': '0.194', 'weapon2': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '61.000'} [2024-08-06 08:25:30,750][52659] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:25:30,965][52663] DAMAGECOUNT value on done: 959809.0 [2024-08-06 08:25:30,967][52663] Sum rewards: 80.876, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.695', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.058', 'weapon5': '0.174', 'AMMO4': '0.215', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '3.096', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.892', 'FRAGCOUNT': '67.000'} [2024-08-06 08:25:31,629][52658] DAMAGECOUNT value on done: 964118.0 [2024-08-06 08:25:31,631][52658] Sum rewards: 77.344, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.840', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon2': '0.190', 'AMMO3': '0.231', 'AMMO4': '0.256', 'weapon4': '0.276', 'weapon5': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.916', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 08:25:31,957][52794] DAMAGECOUNT value on done: 985376.0 [2024-08-06 08:25:31,957][52794] Sum rewards: 77.414, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.707', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.065', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.221', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:32,231][52795] DAMAGECOUNT value on done: 898953.0 [2024-08-06 08:25:32,232][52795] Sum rewards: 85.071, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.564', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.158', 'AMMO3': '0.182', 'weapon4': '0.206', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '69.000'} [2024-08-06 08:25:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 688603136. Throughput: 0: 4369.8. Samples: 172149720. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:25:32,795][52567] Avg episode reward: [(0, '74.892')] [2024-08-06 08:25:33,481][52671] DAMAGECOUNT value on done: 965289.0 [2024-08-06 08:25:33,484][52671] Sum rewards: 70.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.478', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.174', 'AMMO4': '0.197', 'AMMO3': '0.257', 'weapon4': '0.290', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '2.898', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '59.000'} [2024-08-06 08:25:33,583][52820] DAMAGECOUNT value on done: 913267.0 [2024-08-06 08:25:33,583][52820] Sum rewards: 68.909, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.530', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.104', 'weapon5': '0.142', 'AMMO3': '0.209', 'weapon2': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '57.000'} [2024-08-06 08:25:33,859][52669] DAMAGECOUNT value on done: 987579.0 [2024-08-06 08:25:33,862][52669] Sum rewards: 76.042, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.844', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.132', 'weapon5': '0.186', 'AMMO3': '0.265', 'AMMO4': '0.273', 'weapon2': '0.286', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.076', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '66.000'} [2024-08-06 08:25:34,188][52650] Updated weights for policy 0, policy_version 84061 (0.0019) [2024-08-06 08:25:34,232][52663] DAMAGECOUNT value on done: 972869.0 [2024-08-06 08:25:34,233][52663] Sum rewards: 81.645, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.586', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.102', 'AMMO3': '0.223', 'AMMO4': '0.232', 'weapon5': '0.264', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.000', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.626', 'FRAGCOUNT': '67.000'} [2024-08-06 08:25:34,546][52658] DAMAGECOUNT value on done: 979995.0 [2024-08-06 08:25:34,546][52658] Sum rewards: 89.040, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '3.034', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.318', 'FRAGCOUNT': '74.000'} [2024-08-06 08:25:34,957][52794] DAMAGECOUNT value on done: 971064.0 [2024-08-06 08:25:34,957][52794] Sum rewards: 76.417, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.418', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.088', 'weapon5': '0.098', 'AMMO4': '0.131', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '62.000'} [2024-08-06 08:25:35,365][52795] DAMAGECOUNT value on done: 906101.0 [2024-08-06 08:25:35,369][52795] Sum rewards: 63.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.786', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon4': '0.114', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.328', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.200', 'DAMAGECOUNT': '15.450', 'FRAGCOUNT': '53.000'} [2024-08-06 08:25:36,317][52671] DAMAGECOUNT value on done: 990598.0 [2024-08-06 08:25:36,319][52671] Sum rewards: 76.197, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.842', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.184', 'weapon4': '0.184', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.150', 'weapon3': '2.882', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:36,678][52820] DAMAGECOUNT value on done: 900860.0 [2024-08-06 08:25:36,680][52820] Sum rewards: 79.226, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.560', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.018', 'weapon5': '0.058', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.252', 'weapon2': '0.362', 'WEAPON3': '1.500', 'HITCOUNT': '3.270', 'weapon3': '3.382', 'DAMAGECOUNT': '17.352', 'FRAGCOUNT': '68.000'} [2024-08-06 08:25:36,884][52669] DAMAGECOUNT value on done: 985663.0 [2024-08-06 08:25:36,889][52669] Sum rewards: 72.685, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon4': '0.144', 'weapon5': '0.184', 'AMMO4': '0.197', 'AMMO3': '0.204', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.200', 'weapon3': '2.988', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '58.000'} [2024-08-06 08:25:37,258][52658] DAMAGECOUNT value on done: 975265.0 [2024-08-06 08:25:37,258][52658] Sum rewards: 71.194, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.335', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.154', 'AMMO4': '0.209', 'weapon5': '0.220', 'weapon2': '0.252', 'AMMO3': '0.305', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.058', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '62.000'} [2024-08-06 08:25:37,323][52663] DAMAGECOUNT value on done: 970174.0 [2024-08-06 08:25:37,323][52663] Sum rewards: 69.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.978', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.128', 'AMMO3': '0.209', 'AMMO4': '0.221', 'weapon5': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.608', 'WEAPON3': '1.200', 'weapon3': '2.784', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 08:25:37,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 688685056. Throughput: 0: 4363.1. Samples: 172175690. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:25:37,802][52567] Avg episode reward: [(0, '74.999')] [2024-08-06 08:25:38,147][52794] DAMAGECOUNT value on done: 967029.0 [2024-08-06 08:25:38,149][52794] Sum rewards: 85.569, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.015', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.142', 'AMMO3': '0.173', 'weapon2': '0.180', 'AMMO4': '0.185', 'WEAPON5': '0.250', 'weapon4': '0.336', 'WEAPON4': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.126', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '69.000'} [2024-08-06 08:25:38,502][52795] DAMAGECOUNT value on done: 900808.0 [2024-08-06 08:25:38,502][52795] Sum rewards: 72.730, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.374', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '61.000'} [2024-08-06 08:25:38,852][52650] Updated weights for policy 0, policy_version 84071 (0.0013) [2024-08-06 08:25:39,517][52671] DAMAGECOUNT value on done: 988140.0 [2024-08-06 08:25:39,518][52671] Sum rewards: 85.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.140', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.048', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.161', 'weapon4': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.606', 'WEAPON3': '1.000', 'weapon3': '2.960', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '70.000'} [2024-08-06 08:25:39,985][52658] DAMAGECOUNT value on done: 970884.0 [2024-08-06 08:25:39,987][52658] Sum rewards: 75.527, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.570', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.144', 'weapon2': '0.202', 'AMMO4': '0.231', 'weapon5': '0.254', 'AMMO3': '0.291', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.800', 'weapon3': '3.090', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '65.500'} [2024-08-06 08:25:39,995][52669] DAMAGECOUNT value on done: 990872.0 [2024-08-06 08:25:39,996][52669] Sum rewards: 90.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.120', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'weapon2': '0.190', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.612', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.216', 'FRAGCOUNT': '76.000'} [2024-08-06 08:25:40,441][52663] DAMAGECOUNT value on done: 978292.0 [2024-08-06 08:25:40,442][52663] Sum rewards: 72.408, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.484', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.070', 'AMMO4': '0.113', 'weapon5': '0.134', 'AMMO3': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.626', 'WEAPON3': '0.950', 'weapon3': '2.974', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '57.000'} [2024-08-06 08:25:41,370][52794] DAMAGECOUNT value on done: 969912.0 [2024-08-06 08:25:41,371][52794] Sum rewards: 78.177, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO5': '0.003', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.214', 'weapon4': '0.220', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '65.000'} [2024-08-06 08:25:41,627][52795] DAMAGECOUNT value on done: 893693.0 [2024-08-06 08:25:41,627][52795] Sum rewards: 81.909, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.184', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.404', 'WEAPON3': '1.200', 'weapon3': '3.288', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '66.000'} [2024-08-06 08:25:42,594][52658] DAMAGECOUNT value on done: 979654.0 [2024-08-06 08:25:42,595][52658] Sum rewards: 90.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.650', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.022', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.229', 'weapon2': '0.314', 'WEAPON3': '1.400', 'weapon3': '3.384', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.375', 'FRAGCOUNT': '75.500'} [2024-08-06 08:25:42,666][52671] DAMAGECOUNT value on done: 980910.0 [2024-08-06 08:25:42,669][52671] Sum rewards: 75.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.284', 'AMMO5': '0.020', 'AMMO2': '0.059', 'weapon2': '0.192', 'AMMO3': '0.218', 'weapon4': '0.276', 'AMMO4': '0.297', 'weapon5': '0.324', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.920', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 688775168. Throughput: 0: 4368.0. Samples: 172201780. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:25:42,794][52567] Avg episode reward: [(0, '75.944')] [2024-08-06 08:25:42,987][52669] DAMAGECOUNT value on done: 991581.0 [2024-08-06 08:25:42,987][52669] Sum rewards: 73.101, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.548', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon5': '0.174', 'AMMO4': '0.183', 'AMMO3': '0.203', 'weapon2': '0.210', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:43,366][52650] Updated weights for policy 0, policy_version 84081 (0.0032) [2024-08-06 08:25:43,413][52663] DAMAGECOUNT value on done: 963748.0 [2024-08-06 08:25:43,413][52663] Sum rewards: 79.620, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.006', 'weapon4': '0.026', 'AMMO2': '0.030', 'weapon5': '0.080', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.241', 'WEAPON3': '1.450', 'weapon3': '3.476', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '66.000'} [2024-08-06 08:25:44,242][52658] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:25:44,487][52794] DAMAGECOUNT value on done: 973442.0 [2024-08-06 08:25:44,488][52794] Sum rewards: 65.129, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.650', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.092', 'weapon5': '0.154', 'AMMO4': '0.221', 'weapon2': '0.226', 'AMMO3': '0.300', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.220', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.464', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:44,859][52795] DAMAGECOUNT value on done: 898257.0 [2024-08-06 08:25:44,860][52795] Sum rewards: 80.987, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.393', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.136', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.714', 'WEAPON3': '1.100', 'weapon3': '2.946', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '65.000'} [2024-08-06 08:25:45,607][52671] DAMAGECOUNT value on done: 986406.0 [2024-08-06 08:25:45,608][52671] Sum rewards: 88.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.317', 'AMMO5': '0.014', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.168', 'AMMO3': '0.184', 'weapon2': '0.294', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.010', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '70.000'} [2024-08-06 08:25:46,675][52663] DAMAGECOUNT value on done: 961206.0 [2024-08-06 08:25:46,675][52663] Sum rewards: 73.384, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.485', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.092', 'AMMO4': '0.106', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.268', 'WEAPON3': '1.450', 'weapon3': '3.318', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:47,404][52794] DAMAGECOUNT value on done: 963414.0 [2024-08-06 08:25:47,406][52794] Sum rewards: 82.815, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.096', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.122', 'weapon4': '0.218', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.740', 'FRAGCOUNT': '68.000'} [2024-08-06 08:25:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 688857088. Throughput: 0: 4368.9. Samples: 172214880. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:25:47,795][52567] Avg episode reward: [(0, '76.145')] [2024-08-06 08:25:48,035][52795] DAMAGECOUNT value on done: 904188.0 [2024-08-06 08:25:48,035][52795] Sum rewards: 76.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.039', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.108', 'AMMO4': '0.138', 'weapon4': '0.148', 'AMMO3': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '3.100', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:48,047][52671] DAMAGECOUNT value on done: 969045.0 [2024-08-06 08:25:48,049][52671] Sum rewards: 90.943, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.895', 'AMMO5': '0.011', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.170', 'AMMO3': '0.188', 'weapon4': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.577', 'FRAGCOUNT': '73.000'} [2024-08-06 08:25:48,355][52650] Updated weights for policy 0, policy_version 84091 (0.0042) [2024-08-06 08:25:49,844][52647] Large shaping reward 2.586 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5640000000000001, 188.0), ('weapon5', 0.002)] [2024-08-06 08:25:49,937][52663] DAMAGECOUNT value on done: 970977.0 [2024-08-06 08:25:49,940][52663] Sum rewards: 70.554, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.980', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.154', 'weapon5': '0.164', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '61.000'} [2024-08-06 08:25:50,126][52794] DAMAGECOUNT value on done: 977983.0 [2024-08-06 08:25:50,126][52794] Sum rewards: 68.831, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.795', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.072', 'AMMO4': '0.179', 'AMMO3': '0.205', 'weapon2': '0.266', 'weapon4': '0.298', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '57.000'} [2024-08-06 08:25:51,161][52795] DAMAGECOUNT value on done: 891327.0 [2024-08-06 08:25:51,163][52795] Sum rewards: 74.604, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.096', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.072', 'weapon5': '0.148', 'AMMO3': '0.181', 'AMMO4': '0.240', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.286', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:52,743][52650] Updated weights for policy 0, policy_version 84101 (0.0014) [2024-08-06 08:25:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 688955392. Throughput: 0: 4369.3. Samples: 172241210. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:25:52,794][52567] Avg episode reward: [(0, '76.029')] [2024-08-06 08:25:52,864][52663] DAMAGECOUNT value on done: 971528.0 [2024-08-06 08:25:52,864][52663] Sum rewards: 62.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.122', 'AMMO4': '0.192', 'weapon4': '0.192', 'AMMO3': '0.212', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.680', 'WEAPON3': '1.200', 'weapon3': '2.754', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '15.972', 'FRAGCOUNT': '51.000'} [2024-08-06 08:25:52,902][52794] DAMAGECOUNT value on done: 973334.0 [2024-08-06 08:25:52,902][52794] Sum rewards: 75.584, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.170', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.158', 'AMMO3': '0.181', 'AMMO4': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.200', 'weapon3': '2.960', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '60.000'} [2024-08-06 08:25:54,448][52795] DAMAGECOUNT value on done: 901367.0 [2024-08-06 08:25:54,448][52795] Sum rewards: 73.600, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.786', 'AMMO5': '0.029', 'AMMO2': '0.083', 'weapon4': '0.194', 'AMMO3': '0.247', 'weapon2': '0.280', 'weapon5': '0.392', 'AMMO4': '0.417', 'WEAPON4': '0.850', 'WEAPON5': '0.850', 'WEAPON3': '1.550', 'weapon3': '2.734', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '63.000'} [2024-08-06 08:25:55,025][52647] DAMAGECOUNT value on done: 1039886.0 [2024-08-06 08:25:55,025][52647] Sum rewards: 70.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon5': '0.216', 'weapon4': '0.232', 'AMMO3': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.530', 'WEAPON3': '1.450', 'weapon3': '2.748', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '58.000'} [2024-08-06 08:25:55,685][52794] DAMAGECOUNT value on done: 964240.0 [2024-08-06 08:25:55,688][52794] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.785', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon5': '0.174', 'AMMO3': '0.186', 'weapon4': '0.208', 'AMMO4': '0.214', 'weapon2': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '57.000'} [2024-08-06 08:25:55,892][52663] DAMAGECOUNT value on done: 976686.0 [2024-08-06 08:25:55,895][52663] Sum rewards: 86.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.673', 'AMMO5': '0.009', 'AMMO2': '0.017', 'weapon5': '0.078', 'AMMO4': '0.086', 'AMMO3': '0.135', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.260', 'weapon2': '0.424', 'WEAPON3': '0.950', 'weapon3': '3.036', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '68.000'} [2024-08-06 08:25:57,585][52795] DAMAGECOUNT value on done: 901453.0 [2024-08-06 08:25:57,587][52795] Sum rewards: 62.084, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon4': '0.112', 'weapon5': '0.160', 'AMMO3': '0.190', 'AMMO4': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.612', 'WEAPON3': '1.200', 'weapon3': '2.874', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '51.500'} [2024-08-06 08:25:57,632][52650] Updated weights for policy 0, policy_version 84111 (0.0025) [2024-08-06 08:25:57,718][52647] DAMAGECOUNT value on done: 1026779.0 [2024-08-06 08:25:57,718][52647] Sum rewards: 76.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.013', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.130', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '61.000'} [2024-08-06 08:25:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 689037312. Throughput: 0: 4364.7. Samples: 172267350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:25:57,794][52567] Avg episode reward: [(0, '75.366')] [2024-08-06 08:25:58,824][52794] DAMAGECOUNT value on done: 979269.0 [2024-08-06 08:25:58,826][52794] Sum rewards: 76.566, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.100', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.140', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '64.000'} [2024-08-06 08:25:59,160][52663] DAMAGECOUNT value on done: 973155.0 [2024-08-06 08:25:59,161][52663] Sum rewards: 74.947, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.158', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.054', 'AMMO4': '0.139', 'weapon5': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.311', 'weapon2': '0.494', 'WEAPON3': '1.800', 'weapon3': '2.964', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:00,162][52647] DAMAGECOUNT value on done: 1032455.0 [2024-08-06 08:26:00,163][52647] Sum rewards: 72.489, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'weapon5': '0.168', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.200', 'HITCOUNT': '3.220', 'weapon3': '3.308', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:00,727][52795] DAMAGECOUNT value on done: 889066.0 [2024-08-06 08:26:00,731][52795] Sum rewards: 83.901, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.732', 'AMMO5': '0.022', 'AMMO2': '0.064', 'weapon4': '0.104', 'weapon5': '0.226', 'AMMO3': '0.231', 'weapon2': '0.286', 'AMMO4': '0.318', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '70.500'} [2024-08-06 08:26:01,980][52794] DAMAGECOUNT value on done: 974075.0 [2024-08-06 08:26:01,980][52794] Sum rewards: 76.820, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.778', 'AMMO5': '0.007', 'AMMO2': '0.057', 'weapon5': '0.098', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'AMMO4': '0.283', 'weapon4': '0.320', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:02,042][52663] DAMAGECOUNT value on done: 979935.0 [2024-08-06 08:26:02,043][52663] Sum rewards: 65.646, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.922', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.118', 'weapon5': '0.158', 'AMMO4': '0.184', 'AMMO3': '0.188', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '53.000'} [2024-08-06 08:26:02,333][52650] Updated weights for policy 0, policy_version 84121 (0.0018) [2024-08-06 08:26:02,506][52670] DAMAGECOUNT value on done: 959725.0 [2024-08-06 08:26:02,506][52670] Sum rewards: 71.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.259', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.164', 'AMMO3': '0.222', 'weapon2': '0.536', 'WEAPON3': '1.300', 'weapon3': '2.916', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '60.000'} [2024-08-06 08:26:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 689127424. Throughput: 0: 4365.1. Samples: 172280490. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:26:02,794][52567] Avg episode reward: [(0, '75.456')] [2024-08-06 08:26:03,095][52647] DAMAGECOUNT value on done: 1029545.0 [2024-08-06 08:26:03,097][52647] Sum rewards: 75.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.966', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.110', 'AMMO4': '0.156', 'weapon4': '0.196', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON4': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.333', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:03,897][52795] DAMAGECOUNT value on done: 897275.0 [2024-08-06 08:26:03,897][52795] Sum rewards: 66.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.294', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.162', 'weapon4': '0.186', 'AMMO3': '0.195', 'weapon2': '0.218', 'AMMO4': '0.255', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.154', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '55.000'} [2024-08-06 08:26:05,128][52794] DAMAGECOUNT value on done: 985831.0 [2024-08-06 08:26:05,131][52794] Sum rewards: 74.198, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.340', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.116', 'AMMO4': '0.145', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.200', 'HITCOUNT': '3.190', 'weapon3': '3.306', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:05,145][52670] DAMAGECOUNT value on done: 980611.0 [2024-08-06 08:26:05,147][52670] Sum rewards: 90.267, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.056', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.152', 'weapon2': '0.560', 'WEAPON3': '0.900', 'weapon3': '3.234', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '71.000'} [2024-08-06 08:26:05,223][52663] DAMAGECOUNT value on done: 987339.0 [2024-08-06 08:26:05,225][52663] Sum rewards: 75.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.752', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon5': '0.188', 'AMMO3': '0.199', 'weapon2': '0.230', 'AMMO4': '0.235', 'weapon4': '0.282', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:05,856][52671] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:26:05,916][52647] DAMAGECOUNT value on done: 1039284.0 [2024-08-06 08:26:05,916][52647] Sum rewards: 70.943, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.064', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.100', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.384', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:07,096][52795] DAMAGECOUNT value on done: 906388.0 [2024-08-06 08:26:07,096][52795] Sum rewards: 80.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.714', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon2': '0.204', 'AMMO3': '0.215', 'AMMO4': '0.270', 'weapon5': '0.344', 'weapon4': '0.402', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:07,232][52650] Updated weights for policy 0, policy_version 84131 (0.0013) [2024-08-06 08:26:07,522][52669] Large shaping reward -2.504 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:26:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 689209344. Throughput: 0: 4361.3. Samples: 172306610. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:26:07,794][52567] Avg episode reward: [(0, '75.250')] [2024-08-06 08:26:08,023][52811] DAMAGECOUNT value on done: 922521.0 [2024-08-06 08:26:08,026][52811] Sum rewards: 77.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.928', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.012', 'AMMO4': '0.035', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.320', 'WEAPON3': '1.200', 'weapon3': '3.474', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:08,108][52663] DAMAGECOUNT value on done: 965548.0 [2024-08-06 08:26:08,108][52663] Sum rewards: 78.265, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.559', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.054', 'weapon5': '0.122', 'AMMO3': '0.148', 'AMMO4': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.774', 'WEAPON3': '0.900', 'weapon3': '2.878', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 08:26:08,117][52794] DAMAGECOUNT value on done: 967485.0 [2024-08-06 08:26:08,117][52794] Sum rewards: 75.048, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.082', 'AMMO3': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.456', 'weapon2': '0.564', 'WEAPON3': '0.700', 'HEALTH': '0.720', 'weapon3': '2.742', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '58.000'} [2024-08-06 08:26:08,144][52670] DAMAGECOUNT value on done: 961502.0 [2024-08-06 08:26:08,145][52670] Sum rewards: 74.347, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon5': '0.010', 'AMMO4': '0.024', 'WEAPON5': '0.050', 'AMMO3': '0.222', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:08,693][52647] DAMAGECOUNT value on done: 1034832.0 [2024-08-06 08:26:08,693][52647] Sum rewards: 78.893, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.106', 'AMMO5': '0.014', 'AMMO2': '0.062', 'weapon4': '0.158', 'AMMO3': '0.202', 'weapon5': '0.208', 'AMMO4': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:09,880][52666] DAMAGECOUNT value on done: 973874.0 [2024-08-06 08:26:09,880][52666] Sum rewards: 74.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.765', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.078', 'weapon5': '0.188', 'AMMO4': '0.217', 'AMMO3': '0.222', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:11,205][52794] DAMAGECOUNT value on done: 979960.0 [2024-08-06 08:26:11,205][52794] Sum rewards: 82.603, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.682', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.040', 'WEAPON4': '0.100', 'AMMO4': '0.101', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.390', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:11,210][52811] DAMAGECOUNT value on done: 907852.0 [2024-08-06 08:26:11,210][52811] Sum rewards: 79.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.076', 'AMMO3': '0.195', 'weapon5': '0.202', 'weapon2': '0.236', 'AMMO4': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.264', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:11,220][52670] DAMAGECOUNT value on done: 963899.0 [2024-08-06 08:26:11,220][52670] Sum rewards: 71.510, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.580', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.140', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.374', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:11,734][52650] Updated weights for policy 0, policy_version 84141 (0.0040) [2024-08-06 08:26:11,771][52647] DAMAGECOUNT value on done: 1037003.0 [2024-08-06 08:26:11,772][52647] Sum rewards: 77.240, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.832', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.130', 'weapon5': '0.172', 'AMMO4': '0.184', 'weapon2': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.236', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:12,338][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:26:12,412][52666] DAMAGECOUNT value on done: 972590.0 [2024-08-06 08:26:12,414][52666] Sum rewards: 78.862, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.800', 'AMMO2': '0.006', 'AMMO4': '0.032', 'WEAPON4': '0.050', 'weapon4': '0.068', 'AMMO3': '0.194', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 689299456. Throughput: 0: 4360.7. Samples: 172332680. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:26:12,795][52567] Avg episode reward: [(0, '75.474')] [2024-08-06 08:26:13,458][52670] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:26:13,588][52670] DAMAGECOUNT value on done: 976745.0 [2024-08-06 08:26:13,589][52670] Sum rewards: 87.909, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.033', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.072', 'AMMO3': '0.166', 'AMMO4': '0.216', 'weapon5': '0.240', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.148', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '69.000'} [2024-08-06 08:26:14,243][52794] DAMAGECOUNT value on done: 974485.0 [2024-08-06 08:26:14,245][52794] Sum rewards: 86.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.545', 'AMMO5': '0.018', 'AMMO2': '0.031', 'weapon4': '0.086', 'weapon5': '0.118', 'AMMO4': '0.152', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '72.000'} [2024-08-06 08:26:14,329][52811] DAMAGECOUNT value on done: 902115.0 [2024-08-06 08:26:14,329][52811] Sum rewards: 74.410, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.130', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.100', 'weapon5': '0.170', 'AMMO3': '0.207', 'AMMO4': '0.254', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:14,845][52647] DAMAGECOUNT value on done: 1013012.0 [2024-08-06 08:26:14,845][52647] Sum rewards: 82.275, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.419', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.120', 'weapon4': '0.156', 'AMMO4': '0.166', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:14,982][52666] DAMAGECOUNT value on done: 978327.0 [2024-08-06 08:26:14,991][52666] Sum rewards: 75.319, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.679', 'AMMO5': '0.021', 'AMMO2': '0.035', 'weapon4': '0.122', 'AMMO3': '0.124', 'AMMO4': '0.174', 'weapon5': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.526', 'WEAPON3': '0.850', 'weapon3': '2.834', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.792', 'FRAGCOUNT': '58.000'} [2024-08-06 08:26:16,277][52670] DAMAGECOUNT value on done: 964468.0 [2024-08-06 08:26:16,279][52670] Sum rewards: 75.254, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.183', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.190', 'AMMO4': '0.195', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.630', 'WEAPON3': '1.350', 'weapon3': '2.924', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:16,432][52650] Updated weights for policy 0, policy_version 84151 (0.0031) [2024-08-06 08:26:16,867][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:26:17,286][52794] DAMAGECOUNT value on done: 982785.0 [2024-08-06 08:26:17,286][52794] Sum rewards: 66.321, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.490', 'AMMO5': '0.024', 'AMMO2': '0.070', 'weapon4': '0.176', 'weapon2': '0.206', 'AMMO3': '0.299', 'weapon5': '0.332', 'AMMO4': '0.348', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.800', 'HITCOUNT': '2.920', 'weapon3': '2.928', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '58.000'} [2024-08-06 08:26:17,426][52811] DAMAGECOUNT value on done: 908073.0 [2024-08-06 08:26:17,426][52811] Sum rewards: 73.662, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.220', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.277', 'weapon2': '0.454', 'WEAPON3': '1.800', 'weapon3': '3.310', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:17,650][52647] DAMAGECOUNT value on done: 1028568.0 [2024-08-06 08:26:17,650][52647] Sum rewards: 69.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.290', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.133', 'AMMO3': '0.231', 'weapon4': '0.240', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '57.000'} [2024-08-06 08:26:17,751][52666] DAMAGECOUNT value on done: 973490.0 [2024-08-06 08:26:17,752][52666] Sum rewards: 75.280, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.758', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.080', 'AMMO4': '0.125', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.386', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.063', 'FRAGCOUNT': '63.000'} [2024-08-06 08:26:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 689389568. Throughput: 0: 4360.0. Samples: 172345920. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:26:17,794][52567] Avg episode reward: [(0, '75.886')] [2024-08-06 08:26:18,457][52668] DAMAGECOUNT value on done: 984293.0 [2024-08-06 08:26:18,458][52668] Sum rewards: 71.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.451', 'AMMO5': '0.007', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.148', 'weapon2': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon4': '0.296', 'WEAPON3': '1.350', 'weapon3': '3.052', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:19,285][52670] DAMAGECOUNT value on done: 961154.0 [2024-08-06 08:26:19,288][52670] Sum rewards: 67.135, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.580', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.060', 'weapon5': '0.096', 'AMMO4': '0.247', 'weapon2': '0.262', 'AMMO3': '0.271', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.300', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:19,403][52658] Large shaping reward 2.505 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.483, 161.0), ('weapon5', 0.002)] [2024-08-06 08:26:19,705][52794] DAMAGECOUNT value on done: 988825.0 [2024-08-06 08:26:19,705][52794] Sum rewards: 71.448, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.500', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.118', 'weapon5': '0.176', 'AMMO4': '0.190', 'weapon2': '0.194', 'AMMO3': '0.234', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '3.230', 'weapon3': '3.306', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '60.000'} [2024-08-06 08:26:20,439][52811] DAMAGECOUNT value on done: 910927.0 [2024-08-06 08:26:20,441][52811] Sum rewards: 70.894, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.350', 'AMMO5': '0.011', 'AMMO2': '0.067', 'weapon2': '0.162', 'AMMO3': '0.173', 'weapon5': '0.190', 'weapon4': '0.266', 'AMMO4': '0.336', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.140', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '56.000'} [2024-08-06 08:26:20,574][52647] DAMAGECOUNT value on done: 1022650.0 [2024-08-06 08:26:20,574][52647] Sum rewards: 59.350, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.106', 'AMMO5': '0.011', 'AMMO2': '0.062', 'weapon4': '0.170', 'weapon5': '0.182', 'AMMO3': '0.228', 'AMMO4': '0.310', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.008', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '50.000'} [2024-08-06 08:26:20,834][52666] DAMAGECOUNT value on done: 966142.0 [2024-08-06 08:26:20,835][52666] Sum rewards: 72.318, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.180', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.149', 'AMMO3': '0.177', 'weapon4': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:20,953][52668] DAMAGECOUNT value on done: 982459.0 [2024-08-06 08:26:20,955][52668] Sum rewards: 60.475, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.052', 'weapon5': '0.114', 'AMMO4': '0.161', 'AMMO3': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.610', 'WEAPON3': '1.350', 'weapon3': '2.936', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.609', 'FRAGCOUNT': '52.000'} [2024-08-06 08:26:21,295][52650] Updated weights for policy 0, policy_version 84161 (0.0013) [2024-08-06 08:26:22,393][52670] DAMAGECOUNT value on done: 963650.0 [2024-08-06 08:26:22,394][52670] Sum rewards: 79.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.354', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.512', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '63.000'} [2024-08-06 08:26:22,521][52794] DAMAGECOUNT value on done: 977628.0 [2024-08-06 08:26:22,522][52794] Sum rewards: 88.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.870', 'AMMO5': '0.009', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.142', 'weapon4': '0.146', 'AMMO3': '0.218', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.796', 'FRAGCOUNT': '72.000'} [2024-08-06 08:26:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 689471488. Throughput: 0: 4361.1. Samples: 172371940. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:26:22,795][52567] Avg episode reward: [(0, '75.422')] [2024-08-06 08:26:23,114][52647] DAMAGECOUNT value on done: 1024046.0 [2024-08-06 08:26:23,114][52647] Sum rewards: 79.410, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.455', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.052', 'weapon4': '0.108', 'AMMO4': '0.114', 'AMMO3': '0.188', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:23,439][52811] DAMAGECOUNT value on done: 928138.0 [2024-08-06 08:26:23,441][52811] Sum rewards: 74.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.306', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon5': '0.032', 'WEAPON5': '0.050', 'AMMO4': '0.061', 'weapon4': '0.068', 'WEAPON4': '0.100', 'AMMO3': '0.208', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.394', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:23,873][52668] DAMAGECOUNT value on done: 978643.0 [2024-08-06 08:26:23,876][52668] Sum rewards: 64.200, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.635', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.147', 'weapon5': '0.198', 'weapon4': '0.206', 'AMMO4': '0.236', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.552', 'WEAPON3': '0.950', 'weapon3': '2.840', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '49.000'} [2024-08-06 08:26:24,127][52666] DAMAGECOUNT value on done: 968891.0 [2024-08-06 08:26:24,127][52666] Sum rewards: 87.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.309', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon5': '0.138', 'AMMO4': '0.192', 'AMMO3': '0.193', 'weapon4': '0.194', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '71.000'} [2024-08-06 08:26:25,368][52670] DAMAGECOUNT value on done: 963178.0 [2024-08-06 08:26:25,370][52670] Sum rewards: 74.089, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.009', 'AMMO5': '0.024', 'AMMO2': '0.068', 'weapon4': '0.150', 'AMMO3': '0.225', 'weapon2': '0.304', 'AMMO4': '0.340', 'weapon5': '0.378', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.798', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '61.500'} [2024-08-06 08:26:25,727][52650] Updated weights for policy 0, policy_version 84171 (0.0019) [2024-08-06 08:26:25,859][52647] DAMAGECOUNT value on done: 1021253.0 [2024-08-06 08:26:25,859][52647] Sum rewards: 89.939, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.158', 'weapon2': '0.194', 'AMMO4': '0.198', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.324', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '76.000'} [2024-08-06 08:26:26,355][52668] DAMAGECOUNT value on done: 984007.0 [2024-08-06 08:26:26,355][52668] Sum rewards: 76.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.135', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.120', 'weapon5': '0.134', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '63.000'} [2024-08-06 08:26:26,589][52811] DAMAGECOUNT value on done: 918773.0 [2024-08-06 08:26:26,590][52811] Sum rewards: 77.542, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.275', 'AMMO5': '0.020', 'AMMO2': '0.037', 'weapon4': '0.066', 'AMMO4': '0.185', 'AMMO3': '0.209', 'weapon5': '0.306', 'WEAPON4': '0.400', 'weapon2': '0.400', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.936', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '63.000'} [2024-08-06 08:26:26,660][52665] DAMAGECOUNT value on done: 963606.0 [2024-08-06 08:26:26,661][52665] Sum rewards: 80.098, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon4': '0.146', 'AMMO4': '0.210', 'AMMO3': '0.214', 'weapon5': '0.276', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.862', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '19.320', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:26,907][52666] DAMAGECOUNT value on done: 969614.0 [2024-08-06 08:26:26,908][52666] Sum rewards: 91.613, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.760', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.094', 'AMMO4': '0.109', 'AMMO3': '0.138', 'WEAPON4': '0.150', 'weapon2': '0.466', 'WEAPON3': '0.900', 'weapon3': '3.250', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '74.000'} [2024-08-06 08:26:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 689553408. Throughput: 0: 4367.3. Samples: 172398310. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:26:27,794][52567] Avg episode reward: [(0, '76.362')] [2024-08-06 08:26:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084174_689553408.pth... [2024-08-06 08:26:27,955][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083664_685375488.pth [2024-08-06 08:26:28,529][52670] DAMAGECOUNT value on done: 961715.0 [2024-08-06 08:26:28,531][52670] Sum rewards: 83.632, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.149', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.166', 'AMMO4': '0.167', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '69.000'} [2024-08-06 08:26:29,000][52647] DAMAGECOUNT value on done: 1028661.0 [2024-08-06 08:26:29,001][52647] Sum rewards: 76.535, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.650', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'AMMO3': '0.149', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.348', 'weapon2': '0.404', 'WEAPON3': '1.000', 'weapon3': '2.854', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:29,152][52668] DAMAGECOUNT value on done: 968346.0 [2024-08-06 08:26:29,154][52668] Sum rewards: 75.499, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.089', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.100', 'weapon4': '0.136', 'AMMO4': '0.183', 'AMMO3': '0.242', 'weapon2': '0.322', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.162', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:29,258][52820] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:26:29,523][52811] DAMAGECOUNT value on done: 905741.0 [2024-08-06 08:26:29,523][52811] Sum rewards: 78.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.450', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.170', 'AMMO4': '0.192', 'weapon5': '0.224', 'weapon2': '0.290', 'WEAPON5': '0.300', 'weapon4': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.808', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:29,617][52665] DAMAGECOUNT value on done: 974940.0 [2024-08-06 08:26:29,619][52665] Sum rewards: 87.360, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.068', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.124', 'weapon4': '0.154', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '69.000'} [2024-08-06 08:26:30,084][52666] DAMAGECOUNT value on done: 962953.0 [2024-08-06 08:26:30,086][52666] Sum rewards: 69.731, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.666', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '57.000'} [2024-08-06 08:26:30,866][52650] Updated weights for policy 0, policy_version 84181 (0.0014) [2024-08-06 08:26:31,251][52670] DAMAGECOUNT value on done: 976866.0 [2024-08-06 08:26:31,252][52670] Sum rewards: 91.292, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.238', 'AMMO3': '0.244', 'AMMO4': '0.249', 'weapon4': '0.286', 'weapon2': '0.294', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.870', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.954', 'FRAGCOUNT': '76.000'} [2024-08-06 08:26:31,376][52647] DAMAGECOUNT value on done: 1022251.0 [2024-08-06 08:26:31,376][52647] Sum rewards: 78.472, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.738', 'AMMO5': '0.012', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.164', 'weapon5': '0.184', 'weapon4': '0.214', 'WEAPON4': '0.250', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '63.000'} [2024-08-06 08:26:31,657][52668] DAMAGECOUNT value on done: 981503.0 [2024-08-06 08:26:31,657][52668] Sum rewards: 81.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.015', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.080', 'weapon2': '0.142', 'weapon4': '0.162', 'AMMO3': '0.169', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.150', 'weapon3': '3.476', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:32,002][52663] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.549, 183.0), ('weapon5', 0.002)] [2024-08-06 08:26:32,594][52666] DAMAGECOUNT value on done: 977381.0 [2024-08-06 08:26:32,594][52666] Sum rewards: 85.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.818', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.126', 'AMMO3': '0.208', 'AMMO4': '0.209', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '70.500'} [2024-08-06 08:26:32,621][52811] DAMAGECOUNT value on done: 912414.0 [2024-08-06 08:26:32,623][52811] Sum rewards: 75.446, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.194', 'AMMO4': '0.206', 'weapon5': '0.222', 'AMMO3': '0.235', 'weapon2': '0.302', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:32,679][52665] DAMAGECOUNT value on done: 969055.0 [2024-08-06 08:26:32,679][52665] Sum rewards: 75.390, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.315', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.060', 'AMMO4': '0.126', 'AMMO3': '0.178', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '3.430', 'weapon3': '3.578', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:32,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 689651712. Throughput: 0: 4361.8. Samples: 172411160. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:26:32,794][52567] Avg episode reward: [(0, '76.722')] [2024-08-06 08:26:33,747][52670] DAMAGECOUNT value on done: 958211.0 [2024-08-06 08:26:33,748][52670] Sum rewards: 88.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.230', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.150', 'weapon2': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'WEAPON3': '1.450', 'weapon3': '3.556', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '73.000'} [2024-08-06 08:26:34,136][52647] DAMAGECOUNT value on done: 1029190.0 [2024-08-06 08:26:34,136][52647] Sum rewards: 62.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.285', 'AMMO5': '0.016', 'AMMO2': '0.022', 'AMMO4': '0.112', 'weapon5': '0.178', 'AMMO3': '0.224', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.884', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.553', 'FRAGCOUNT': '53.000'} [2024-08-06 08:26:34,745][52668] DAMAGECOUNT value on done: 980768.0 [2024-08-06 08:26:34,745][52668] Sum rewards: 78.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.052', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon4': '0.092', 'weapon5': '0.110', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.176', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:35,097][52666] DAMAGECOUNT value on done: 966473.0 [2024-08-06 08:26:35,097][52666] Sum rewards: 89.043, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.124', 'weapon2': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon4': '0.274', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '73.000'} [2024-08-06 08:26:35,271][52650] Updated weights for policy 0, policy_version 84191 (0.0014) [2024-08-06 08:26:35,712][52665] DAMAGECOUNT value on done: 971366.0 [2024-08-06 08:26:35,714][52665] Sum rewards: 71.122, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.420', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.098', 'weapon4': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.260', 'weapon2': '0.344', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:35,740][52811] DAMAGECOUNT value on done: 913588.0 [2024-08-06 08:26:35,744][52811] Sum rewards: 78.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.068', 'weapon5': '0.070', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.374', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.287', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:36,674][52670] DAMAGECOUNT value on done: 971434.0 [2024-08-06 08:26:36,676][52670] Sum rewards: 85.281, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.995', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.100', 'AMMO3': '0.163', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '3.146', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '68.000'} [2024-08-06 08:26:36,884][52647] DAMAGECOUNT value on done: 1031116.0 [2024-08-06 08:26:36,887][52647] Sum rewards: 77.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.410', 'AMMO5': '0.022', 'AMMO2': '0.084', 'weapon4': '0.114', 'weapon2': '0.178', 'weapon5': '0.244', 'AMMO3': '0.258', 'AMMO4': '0.420', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '3.150', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 689733632. Throughput: 0: 4352.0. Samples: 172437050. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:26:37,794][52567] Avg episode reward: [(0, '76.912')] [2024-08-06 08:26:38,070][52668] DAMAGECOUNT value on done: 971263.0 [2024-08-06 08:26:38,071][52668] Sum rewards: 74.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.618', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.062', 'weapon4': '0.098', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.304', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:38,203][52666] DAMAGECOUNT value on done: 970512.0 [2024-08-06 08:26:38,204][52666] Sum rewards: 78.897, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.016', 'AMMO2': '0.039', 'AMMO3': '0.185', 'AMMO4': '0.197', 'weapon5': '0.206', 'weapon4': '0.324', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '63.000'} [2024-08-06 08:26:38,596][52665] DAMAGECOUNT value on done: 952720.0 [2024-08-06 08:26:38,598][52665] Sum rewards: 84.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.515', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.121', 'weapon2': '0.202', 'AMMO3': '0.221', 'weapon4': '0.280', 'WEAPON3': '1.500', 'weapon3': '3.298', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '71.000'} [2024-08-06 08:26:38,836][52811] DAMAGECOUNT value on done: 916529.0 [2024-08-06 08:26:38,837][52811] Sum rewards: 86.706, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.570', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.208', 'weapon4': '0.216', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.076', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '71.000'} [2024-08-06 08:26:38,858][52795] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0)] [2024-08-06 08:26:39,168][52647] DAMAGECOUNT value on done: 1016213.0 [2024-08-06 08:26:39,168][52647] Sum rewards: 81.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.974', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.136', 'weapon4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.230', 'WEAPON3': '1.350', 'weapon3': '3.230', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:39,703][52670] DAMAGECOUNT value on done: 976302.0 [2024-08-06 08:26:39,704][52670] Sum rewards: 81.905, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.054', 'weapon4': '0.092', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.224', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '68.000'} [2024-08-06 08:26:39,855][52650] Updated weights for policy 0, policy_version 84201 (0.0015) [2024-08-06 08:26:40,194][52667] DAMAGECOUNT value on done: 974388.0 [2024-08-06 08:26:40,195][52667] Sum rewards: 70.024, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.116', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.110', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.254', 'WEAPON3': '1.300', 'HITCOUNT': '3.360', 'weapon3': '3.382', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '58.000'} [2024-08-06 08:26:40,898][52666] DAMAGECOUNT value on done: 956449.0 [2024-08-06 08:26:40,899][52666] Sum rewards: 73.121, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.622', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.086', 'AMMO4': '0.139', 'weapon5': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.496', 'WEAPON3': '1.350', 'weapon3': '3.024', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.223', 'FRAGCOUNT': '61.000'} [2024-08-06 08:26:41,314][52668] DAMAGECOUNT value on done: 974288.0 [2024-08-06 08:26:41,314][52668] Sum rewards: 70.233, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.793', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.028', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.478', 'WEAPON3': '1.250', 'weapon3': '3.312', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '58.000'} [2024-08-06 08:26:41,464][52647] DAMAGECOUNT value on done: 1025667.0 [2024-08-06 08:26:41,464][52647] Sum rewards: 80.308, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.439', 'AMMO2': '0.015', 'AMMO4': '0.077', 'AMMO3': '0.237', 'weapon2': '0.244', 'WEAPON3': '1.450', 'weapon3': '3.596', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:41,794][52665] DAMAGECOUNT value on done: 955124.0 [2024-08-06 08:26:41,795][52665] Sum rewards: 66.087, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.125', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.068', 'AMMO4': '0.163', 'weapon5': '0.214', 'AMMO3': '0.234', 'weapon2': '0.348', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '56.000'} [2024-08-06 08:26:41,951][52811] DAMAGECOUNT value on done: 923958.0 [2024-08-06 08:26:41,951][52811] Sum rewards: 83.720, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.845', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.162', 'AMMO4': '0.196', 'weapon5': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.358', 'weapon2': '0.366', 'WEAPON3': '1.000', 'weapon3': '2.818', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:42,288][52649] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:26:42,386][52670] DAMAGECOUNT value on done: 969322.0 [2024-08-06 08:26:42,386][52670] Sum rewards: 86.717, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.056', 'AMMO4': '0.153', 'AMMO3': '0.184', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.250', 'weapon3': '3.240', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '70.000'} [2024-08-06 08:26:42,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 689815552. Throughput: 0: 4357.3. Samples: 172463430. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:26:42,794][52567] Avg episode reward: [(0, '76.764')] [2024-08-06 08:26:42,854][52667] DAMAGECOUNT value on done: 991834.0 [2024-08-06 08:26:42,855][52667] Sum rewards: 81.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.036', 'weapon5': '0.088', 'AMMO4': '0.104', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.350', 'weapon3': '3.478', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:43,891][52647] DAMAGECOUNT value on done: 1017573.0 [2024-08-06 08:26:43,899][52647] Sum rewards: 67.010, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.144', 'AMMO3': '0.195', 'AMMO4': '0.217', 'weapon4': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.534', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '54.000'} [2024-08-06 08:26:44,100][52666] DAMAGECOUNT value on done: 980561.0 [2024-08-06 08:26:44,101][52666] Sum rewards: 87.273, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.097', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.078', 'weapon2': '0.164', 'AMMO4': '0.175', 'weapon5': '0.186', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.306', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '22.290', 'FRAGCOUNT': '71.000'} [2024-08-06 08:26:44,367][52668] DAMAGECOUNT value on done: 982931.0 [2024-08-06 08:26:44,367][52668] Sum rewards: 80.041, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.030', 'AMMO5': '0.015', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.094', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.235', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:44,623][52650] Updated weights for policy 0, policy_version 84211 (0.0011) [2024-08-06 08:26:44,740][52665] DAMAGECOUNT value on done: 967198.0 [2024-08-06 08:26:44,740][52665] Sum rewards: 79.744, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.080', 'AMMO4': '0.144', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.250', 'weapon3': '3.396', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:44,946][52811] DAMAGECOUNT value on done: 915605.0 [2024-08-06 08:26:44,946][52811] Sum rewards: 73.741, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.254', 'AMMO5': '0.010', 'AMMO2': '0.059', 'weapon4': '0.076', 'weapon5': '0.104', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.258', 'AMMO4': '0.295', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.332', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:45,238][52670] DAMAGECOUNT value on done: 954164.0 [2024-08-06 08:26:45,240][52670] Sum rewards: 80.042, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.024', 'AMMO2': '0.046', 'AMMO3': '0.206', 'weapon5': '0.228', 'AMMO4': '0.231', 'weapon4': '0.314', 'weapon2': '0.458', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.684', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.620', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:46,138][52667] DAMAGECOUNT value on done: 984815.0 [2024-08-06 08:26:46,140][52667] Sum rewards: 72.216, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.610', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.156', 'weapon5': '0.166', 'weapon2': '0.210', 'AMMO4': '0.240', 'AMMO3': '0.284', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.750', 'weapon3': '3.154', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '63.000'} [2024-08-06 08:26:46,187][52647] DAMAGECOUNT value on done: 1021689.0 [2024-08-06 08:26:46,187][52647] Sum rewards: 79.731, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.954', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.080', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.184', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:46,668][52666] DAMAGECOUNT value on done: 974490.0 [2024-08-06 08:26:46,669][52666] Sum rewards: 79.999, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.660', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.138', 'weapon4': '0.212', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.450', 'weapon3': '3.008', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.351', 'FRAGCOUNT': '68.000'} [2024-08-06 08:26:47,272][52668] DAMAGECOUNT value on done: 977059.0 [2024-08-06 08:26:47,274][52668] Sum rewards: 78.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon5': '0.170', 'AMMO3': '0.209', 'AMMO4': '0.234', 'weapon4': '0.278', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:47,795][52567] Fps is (10 sec: 17202.2, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 689905664. Throughput: 0: 4360.8. Samples: 172476730. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:26:47,795][52567] Avg episode reward: [(0, '77.140')] [2024-08-06 08:26:47,969][52811] DAMAGECOUNT value on done: 912255.0 [2024-08-06 08:26:47,969][52811] Sum rewards: 76.971, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.623', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.070', 'weapon5': '0.146', 'AMMO4': '0.213', 'AMMO3': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:47,988][52665] DAMAGECOUNT value on done: 965979.0 [2024-08-06 08:26:47,989][52665] Sum rewards: 86.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.199', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.018', 'AMMO4': '0.071', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.372', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '71.000'} [2024-08-06 08:26:48,019][52670] DAMAGECOUNT value on done: 968576.0 [2024-08-06 08:26:48,021][52670] Sum rewards: 75.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.012', 'AMMO5': '0.011', 'AMMO2': '0.051', 'weapon5': '0.178', 'AMMO3': '0.191', 'weapon2': '0.254', 'AMMO4': '0.256', 'weapon4': '0.264', 'WEAPON5': '0.300', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '62.000'} [2024-08-06 08:26:48,747][52649] DAMAGECOUNT value on done: 946093.0 [2024-08-06 08:26:48,749][52649] Sum rewards: 75.291, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO5': '0.022', 'AMMO2': '0.072', 'AMMO3': '0.226', 'weapon4': '0.246', 'weapon2': '0.318', 'weapon5': '0.338', 'AMMO4': '0.361', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:49,058][52667] DAMAGECOUNT value on done: 990340.0 [2024-08-06 08:26:49,059][52667] Sum rewards: 84.357, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.585', 'AMMO2': '0.007', 'AMMO5': '0.010', 'weapon5': '0.030', 'AMMO4': '0.037', 'weapon4': '0.082', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.488', 'WEAPON3': '1.000', 'weapon3': '3.204', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:49,518][52650] Updated weights for policy 0, policy_version 84221 (0.0014) [2024-08-06 08:26:49,772][52666] DAMAGECOUNT value on done: 973965.0 [2024-08-06 08:26:49,773][52666] Sum rewards: 76.104, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.005', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.108', 'AMMO4': '0.166', 'weapon5': '0.194', 'weapon2': '0.220', 'AMMO3': '0.243', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:50,429][52668] DAMAGECOUNT value on done: 974284.0 [2024-08-06 08:26:50,432][52668] Sum rewards: 82.719, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.280', 'AMMO5': '0.014', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon4': '0.082', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'weapon2': '0.198', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.392', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.776', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:51,065][52811] DAMAGECOUNT value on done: 913422.0 [2024-08-06 08:26:51,065][52811] Sum rewards: 72.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.829', 'AMMO2': '0.005', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO4': '0.027', 'WEAPON4': '0.050', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.388', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.318', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '60.000'} [2024-08-06 08:26:51,066][52665] DAMAGECOUNT value on done: 971429.0 [2024-08-06 08:26:51,068][52665] Sum rewards: 78.219, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.670', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.028', 'weapon5': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.214', 'weapon2': '0.308', 'WEAPON3': '1.500', 'weapon3': '3.480', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:51,236][52670] DAMAGECOUNT value on done: 976994.0 [2024-08-06 08:26:51,240][52670] Sum rewards: 78.016, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.628', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.138', 'weapon5': '0.140', 'AMMO4': '0.156', 'AMMO3': '0.204', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:51,795][52649] DAMAGECOUNT value on done: 941908.0 [2024-08-06 08:26:51,795][52649] Sum rewards: 84.949, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.285', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'weapon5': '0.104', 'AMMO4': '0.107', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.150', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '69.000'} [2024-08-06 08:26:52,099][52667] DAMAGECOUNT value on done: 991705.0 [2024-08-06 08:26:52,099][52667] Sum rewards: 83.568, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.480', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO4': '0.163', 'weapon5': '0.166', 'weapon2': '0.240', 'AMMO3': '0.241', 'weapon4': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.508', 'FRAGCOUNT': '68.000'} [2024-08-06 08:26:52,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 689995776. Throughput: 0: 4362.2. Samples: 172502910. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:26:52,794][52567] Avg episode reward: [(0, '77.922')] [2024-08-06 08:26:52,898][52666] DAMAGECOUNT value on done: 965352.0 [2024-08-06 08:26:52,899][52666] Sum rewards: 68.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.594', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO4': '0.166', 'AMMO3': '0.237', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:53,450][52811] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:26:53,487][52668] DAMAGECOUNT value on done: 967007.0 [2024-08-06 08:26:53,488][52668] Sum rewards: 84.095, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.255', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.096', 'AMMO4': '0.149', 'weapon5': '0.154', 'AMMO3': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.532', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '68.000'} [2024-08-06 08:26:53,489][52662] DAMAGECOUNT value on done: 977224.0 [2024-08-06 08:26:53,490][52662] Sum rewards: 85.587, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.680', 'AMMO5': '0.014', 'AMMO2': '0.065', 'weapon4': '0.100', 'weapon5': '0.214', 'AMMO3': '0.309', 'AMMO4': '0.326', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.008', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.960', 'FRAGCOUNT': '72.000'} [2024-08-06 08:26:53,993][52650] Updated weights for policy 0, policy_version 84231 (0.0013) [2024-08-06 08:26:54,069][52670] DAMAGECOUNT value on done: 970884.0 [2024-08-06 08:26:54,080][52670] Sum rewards: 80.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.142', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.174', 'AMMO3': '0.239', 'weapon2': '0.410', 'WEAPON3': '1.500', 'weapon3': '3.198', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:54,210][52665] DAMAGECOUNT value on done: 963046.0 [2024-08-06 08:26:54,210][52665] Sum rewards: 73.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.475', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.066', 'weapon5': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.260', 'WEAPON3': '1.400', 'weapon3': '3.402', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '60.000'} [2024-08-06 08:26:54,224][52811] DAMAGECOUNT value on done: 913612.0 [2024-08-06 08:26:54,228][52811] Sum rewards: 78.436, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.505', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.140', 'AMMO3': '0.238', 'weapon2': '0.298', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '65.000'} [2024-08-06 08:26:54,705][52649] DAMAGECOUNT value on done: 957756.0 [2024-08-06 08:26:54,705][52649] Sum rewards: 81.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.464', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.036', 'AMMO4': '0.103', 'weapon5': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.243', 'weapon2': '0.248', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.318', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '66.000'} [2024-08-06 08:26:55,309][52667] DAMAGECOUNT value on done: 988254.0 [2024-08-06 08:26:55,309][52667] Sum rewards: 74.492, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon5': '0.114', 'weapon4': '0.140', 'AMMO3': '0.143', 'AMMO4': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.000', 'weapon3': '3.220', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:55,822][52666] DAMAGECOUNT value on done: 963552.0 [2024-08-06 08:26:55,826][52666] Sum rewards: 69.173, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.082', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.110', 'weapon5': '0.162', 'AMMO4': '0.195', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '59.000'} [2024-08-06 08:26:56,381][52662] DAMAGECOUNT value on done: 986364.0 [2024-08-06 08:26:56,381][52662] Sum rewards: 67.383, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.070', 'AMMO5': '0.018', 'AMMO2': '0.041', 'weapon4': '0.142', 'AMMO4': '0.205', 'weapon5': '0.216', 'AMMO3': '0.238', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.948', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '57.500'} [2024-08-06 08:26:56,538][52668] DAMAGECOUNT value on done: 967366.0 [2024-08-06 08:26:56,539][52668] Sum rewards: 84.730, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.340', 'AMMO5': '0.016', 'AMMO2': '0.057', 'weapon4': '0.146', 'weapon5': '0.158', 'weapon2': '0.210', 'AMMO3': '0.266', 'AMMO4': '0.283', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.180', 'FRAGCOUNT': '71.000'} [2024-08-06 08:26:56,756][52665] DAMAGECOUNT value on done: 978592.0 [2024-08-06 08:26:56,757][52665] Sum rewards: 75.388, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.415', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.070', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.330', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '64.000'} [2024-08-06 08:26:57,209][52670] DAMAGECOUNT value on done: 971132.0 [2024-08-06 08:26:57,211][52670] Sum rewards: 82.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.330', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.136', 'AMMO4': '0.162', 'weapon4': '0.194', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.866', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:57,266][52811] DAMAGECOUNT value on done: 920218.0 [2024-08-06 08:26:57,267][52811] Sum rewards: 61.426, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.138', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon4': '0.124', 'AMMO3': '0.170', 'weapon5': '0.294', 'AMMO4': '0.301', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.594', 'FRAGCOUNT': '49.000'} [2024-08-06 08:26:57,665][52649] DAMAGECOUNT value on done: 959495.0 [2024-08-06 08:26:57,668][52649] Sum rewards: 82.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.182', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '67.000'} [2024-08-06 08:26:57,794][52567] Fps is (10 sec: 17203.8, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 690077696. Throughput: 0: 4360.2. Samples: 172528890. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:26:57,795][52567] Avg episode reward: [(0, '77.766')] [2024-08-06 08:26:57,933][52794] Large shaping reward 2.524 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.108, -36.0), ('weapon5', 0.002)] [2024-08-06 08:26:58,198][52667] DAMAGECOUNT value on done: 982240.0 [2024-08-06 08:26:58,203][52667] Sum rewards: 71.451, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.797', 'ARMOR': '0.004', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.175', 'weapon4': '0.212', 'weapon5': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '56.000'} [2024-08-06 08:26:58,948][52650] Updated weights for policy 0, policy_version 84241 (0.0013) [2024-08-06 08:26:58,976][52668] DAMAGECOUNT value on done: 958315.0 [2024-08-06 08:26:58,976][52668] Sum rewards: 72.791, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.928', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.046', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.154', 'weapon2': '0.410', 'WEAPON3': '1.100', 'HITCOUNT': '3.350', 'weapon3': '3.414', 'DAMAGECOUNT': '16.902', 'FRAGCOUNT': '58.000'} [2024-08-06 08:26:59,023][52666] DAMAGECOUNT value on done: 983959.0 [2024-08-06 08:26:59,023][52666] Sum rewards: 78.866, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.515', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.048', 'weapon4': '0.064', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.436', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '68.000'} [2024-08-06 08:26:59,847][52662] DAMAGECOUNT value on done: 986201.0 [2024-08-06 08:26:59,849][52662] Sum rewards: 80.348, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.255', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.056', 'weapon5': '0.116', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'weapon2': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.174', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '70.000'} [2024-08-06 08:26:59,932][52665] DAMAGECOUNT value on done: 971840.0 [2024-08-06 08:26:59,933][52665] Sum rewards: 73.244, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.045', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.098', 'weapon5': '0.188', 'AMMO3': '0.234', 'weapon2': '0.236', 'AMMO4': '0.276', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:00,385][52671] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:27:00,429][52811] DAMAGECOUNT value on done: 924623.0 [2024-08-06 08:27:00,430][52811] Sum rewards: 68.616, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.290', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.140', 'AMMO3': '0.208', 'AMMO4': '0.233', 'weapon2': '0.254', 'WEAPON5': '0.300', 'weapon4': '0.320', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.944', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '56.500'} [2024-08-06 08:27:00,690][52649] DAMAGECOUNT value on done: 948877.0 [2024-08-06 08:27:00,690][52649] Sum rewards: 61.966, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.348', 'AMMO5': '0.029', 'AMMO2': '0.070', 'AMMO3': '0.193', 'weapon4': '0.228', 'weapon5': '0.282', 'AMMO4': '0.349', 'weapon2': '0.526', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.574', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '53.000'} [2024-08-06 08:27:01,422][52667] DAMAGECOUNT value on done: 979812.0 [2024-08-06 08:27:01,423][52667] Sum rewards: 83.791, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.942', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.146', 'weapon2': '0.170', 'AMMO4': '0.179', 'weapon5': '0.186', 'AMMO3': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.226', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.246', 'FRAGCOUNT': '70.000'} [2024-08-06 08:27:02,091][52668] DAMAGECOUNT value on done: 975395.0 [2024-08-06 08:27:02,093][52668] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.740', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.040', 'AMMO4': '0.057', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.498', 'WEAPON3': '1.150', 'weapon3': '3.174', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:02,165][52666] DAMAGECOUNT value on done: 957873.0 [2024-08-06 08:27:02,165][52666] Sum rewards: 73.364, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.119', 'AMMO5': '0.003', 'weapon5': '0.008', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO3': '0.158', 'AMMO4': '0.182', 'weapon2': '0.738', 'WEAPON3': '1.100', 'weapon3': '3.066', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '58.000'} [2024-08-06 08:27:02,526][52665] DAMAGECOUNT value on done: 967385.0 [2024-08-06 08:27:02,526][52665] Sum rewards: 80.293, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.280', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.116', 'AMMO4': '0.143', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:02,602][52662] DAMAGECOUNT value on done: 977098.0 [2024-08-06 08:27:02,605][52662] Sum rewards: 87.752, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.752', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.153', 'weapon5': '0.220', 'AMMO4': '0.233', 'weapon4': '0.344', 'weapon2': '0.370', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.808', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.871', 'FRAGCOUNT': '69.000'} [2024-08-06 08:27:02,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 690167808. Throughput: 0: 4351.3. Samples: 172541730. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:27:02,795][52567] Avg episode reward: [(0, '77.800')] [2024-08-06 08:27:03,092][52659] DAMAGECOUNT value on done: 979479.0 [2024-08-06 08:27:03,093][52659] Sum rewards: 72.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.402', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.134', 'weapon4': '0.136', 'AMMO4': '0.173', 'weapon2': '0.214', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.240', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '63.000'} [2024-08-06 08:27:03,152][52662] Large shaping reward 2.594 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5730000000000001, 191.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:27:03,410][52650] Updated weights for policy 0, policy_version 84251 (0.0024) [2024-08-06 08:27:03,552][52811] DAMAGECOUNT value on done: 909771.0 [2024-08-06 08:27:03,554][52811] Sum rewards: 72.253, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-5.050', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon4': '0.052', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.170', 'WEAPON4': '0.250', 'AMMO3': '0.321', 'weapon2': '0.358', 'WEAPON3': '2.000', 'weapon3': '3.228', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:03,592][52649] DAMAGECOUNT value on done: 958966.0 [2024-08-06 08:27:03,592][52649] Sum rewards: 73.790, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.580', 'AMMO5': '0.007', 'weapon4': '0.032', 'AMMO2': '0.041', 'weapon5': '0.072', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'AMMO3': '0.227', 'weapon2': '0.508', 'WEAPON3': '1.550', 'weapon3': '3.184', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:04,540][52666] DAMAGECOUNT value on done: 970122.0 [2024-08-06 08:27:04,541][52666] Sum rewards: 84.989, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.190', 'AMMO3': '0.228', 'weapon2': '0.246', 'weapon5': '0.254', 'weapon4': '0.518', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.686', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.748', 'FRAGCOUNT': '69.000'} [2024-08-06 08:27:04,801][52667] DAMAGECOUNT value on done: 983920.0 [2024-08-06 08:27:04,802][52667] Sum rewards: 71.747, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.048', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.128', 'weapon5': '0.168', 'weapon2': '0.260', 'AMMO4': '0.290', 'AMMO3': '0.320', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.950', 'weapon3': '3.128', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:05,023][52668] DAMAGECOUNT value on done: 976919.0 [2024-08-06 08:27:05,031][52668] Sum rewards: 67.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.196', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.176', 'weapon5': '0.188', 'AMMO4': '0.208', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '57.000'} [2024-08-06 08:27:05,179][52665] DAMAGECOUNT value on done: 968577.0 [2024-08-06 08:27:05,181][52665] Sum rewards: 87.510, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.030', 'AMMO4': '0.108', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'weapon2': '0.826', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '69.000'} [2024-08-06 08:27:05,783][52662] DAMAGECOUNT value on done: 991778.0 [2024-08-06 08:27:05,784][52662] Sum rewards: 74.361, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'HEALTH': '0.018', 'AMMO2': '0.039', 'weapon4': '0.188', 'AMMO4': '0.193', 'AMMO3': '0.202', 'weapon5': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.100', 'weapon3': '2.682', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:05,797][52649] DAMAGECOUNT value on done: 955955.0 [2024-08-06 08:27:05,797][52649] Sum rewards: 80.320, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.186', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon5': '0.170', 'weapon2': '0.248', 'AMMO3': '0.249', 'weapon4': '0.276', 'AMMO4': '0.315', 'WEAPON5': '0.450', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '71.000'} [2024-08-06 08:27:06,292][52659] DAMAGECOUNT value on done: 978558.0 [2024-08-06 08:27:06,292][52659] Sum rewards: 81.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.888', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.148', 'AMMO3': '0.192', 'AMMO4': '0.221', 'weapon5': '0.234', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.942', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '64.500'} [2024-08-06 08:27:06,633][52811] DAMAGECOUNT value on done: 911064.0 [2024-08-06 08:27:06,637][52811] Sum rewards: 73.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.462', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon4': '0.118', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.658', 'WEAPON3': '1.200', 'weapon3': '2.796', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:07,445][52667] DAMAGECOUNT value on done: 988486.0 [2024-08-06 08:27:07,447][52667] Sum rewards: 77.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.125', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.176', 'AMMO3': '0.212', 'weapon2': '0.462', 'WEAPON3': '1.450', 'weapon3': '3.182', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:07,694][52665] DAMAGECOUNT value on done: 965295.0 [2024-08-06 08:27:07,694][52665] Sum rewards: 79.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.619', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.074', 'AMMO4': '0.098', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '65.500'} [2024-08-06 08:27:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 690257920. Throughput: 0: 4352.9. Samples: 172567820. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:27:07,794][52567] Avg episode reward: [(0, '78.048')] [2024-08-06 08:27:08,068][52668] DAMAGECOUNT value on done: 974775.0 [2024-08-06 08:27:08,069][52668] Sum rewards: 72.671, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.780', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.155', 'weapon4': '0.182', 'weapon5': '0.190', 'AMMO4': '0.200', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.562', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:08,447][52650] Updated weights for policy 0, policy_version 84261 (0.0011) [2024-08-06 08:27:08,602][52649] DAMAGECOUNT value on done: 956396.0 [2024-08-06 08:27:08,605][52649] Sum rewards: 69.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.598', 'AMMO5': '0.008', 'AMMO2': '0.009', 'AMMO4': '0.042', 'weapon5': '0.046', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '57.000'} [2024-08-06 08:27:08,919][52662] DAMAGECOUNT value on done: 970238.0 [2024-08-06 08:27:08,920][52662] Sum rewards: 92.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.370', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.149', 'weapon2': '0.194', 'weapon5': '0.212', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.288', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '22.173', 'FRAGCOUNT': '77.000'} [2024-08-06 08:27:09,203][52659] DAMAGECOUNT value on done: 989963.0 [2024-08-06 08:27:09,204][52659] Sum rewards: 74.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.460', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.095', 'AMMO3': '0.199', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '3.272', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '63.000'} [2024-08-06 08:27:10,036][52667] DAMAGECOUNT value on done: 977519.0 [2024-08-06 08:27:10,044][52667] Sum rewards: 87.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.174', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'AMMO3': '0.144', 'weapon5': '0.178', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.302', 'weapon4': '0.348', 'WEAPON3': '0.950', 'weapon3': '2.918', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.199', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:10,458][52664] DAMAGECOUNT value on done: 1005750.0 [2024-08-06 08:27:10,458][52664] Sum rewards: 80.603, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.610', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.090', 'weapon4': '0.140', 'AMMO3': '0.148', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.548', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:11,044][52665] DAMAGECOUNT value on done: 972578.0 [2024-08-06 08:27:11,045][52665] Sum rewards: 86.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.184', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.064', 'AMMO4': '0.091', 'weapon2': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.198', 'WEAPON3': '1.250', 'weapon3': '3.622', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '70.000'} [2024-08-06 08:27:11,176][52668] DAMAGECOUNT value on done: 976707.0 [2024-08-06 08:27:11,177][52668] Sum rewards: 71.413, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.014', 'AMMO2': '0.056', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO3': '0.252', 'AMMO4': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.726', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '60.000'} [2024-08-06 08:27:11,757][52662] DAMAGECOUNT value on done: 974215.0 [2024-08-06 08:27:11,758][52662] Sum rewards: 77.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.675', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.196', 'weapon5': '0.222', 'AMMO4': '0.224', 'weapon4': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.604', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:12,097][52649] DAMAGECOUNT value on done: 951409.0 [2024-08-06 08:27:12,098][52649] Sum rewards: 76.986, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.844', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.050', 'AMMO4': '0.074', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.198', 'WEAPON3': '1.300', 'HITCOUNT': '3.450', 'weapon3': '3.464', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:12,281][52659] DAMAGECOUNT value on done: 982218.0 [2024-08-06 08:27:12,281][52659] Sum rewards: 69.359, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.466', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.150', 'AMMO4': '0.209', 'AMMO3': '0.245', 'weapon5': '0.258', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.768', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:12,452][52667] DAMAGECOUNT value on done: 977155.0 [2024-08-06 08:27:12,453][52667] Sum rewards: 76.895, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.238', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.130', 'weapon4': '0.168', 'weapon2': '0.212', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:12,641][52650] Updated weights for policy 0, policy_version 84271 (0.0013) [2024-08-06 08:27:12,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 690348032. Throughput: 0: 4349.1. Samples: 172594020. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:27:12,795][52567] Avg episode reward: [(0, '77.729')] [2024-08-06 08:27:13,278][52664] DAMAGECOUNT value on done: 1014447.0 [2024-08-06 08:27:13,278][52664] Sum rewards: 75.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.074', 'weapon5': '0.206', 'AMMO3': '0.239', 'AMMO4': '0.265', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '63.000'} [2024-08-06 08:27:13,913][52665] DAMAGECOUNT value on done: 965102.0 [2024-08-06 08:27:13,914][52665] Sum rewards: 82.243, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.916', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.092', 'AMMO3': '0.159', 'weapon5': '0.184', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.452', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:14,343][52662] DAMAGECOUNT value on done: 991815.0 [2024-08-06 08:27:14,344][52662] Sum rewards: 76.312, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.580', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.174', 'AMMO4': '0.196', 'weapon5': '0.214', 'weapon2': '0.226', 'AMMO3': '0.320', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.950', 'weapon3': '3.042', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:14,490][52668] DAMAGECOUNT value on done: 981407.0 [2024-08-06 08:27:14,490][52668] Sum rewards: 77.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.164', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.070', 'AMMO4': '0.130', 'weapon5': '0.180', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:14,883][52667] DAMAGECOUNT value on done: 986903.0 [2024-08-06 08:27:14,885][52667] Sum rewards: 77.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.315', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.058', 'weapon5': '0.126', 'AMMO4': '0.127', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.422', 'WEAPON3': '1.000', 'weapon3': '3.176', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:14,915][52649] DAMAGECOUNT value on done: 949662.0 [2024-08-06 08:27:14,916][52649] Sum rewards: 94.076, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.655', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.036', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.272', 'WEAPON3': '1.050', 'weapon3': '3.556', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '76.000'} [2024-08-06 08:27:15,411][52659] DAMAGECOUNT value on done: 975367.0 [2024-08-06 08:27:15,412][52659] Sum rewards: 92.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.042', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'weapon2': '0.240', 'weapon4': '0.402', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.300', 'FRAGCOUNT': '74.000'} [2024-08-06 08:27:15,592][52660] DAMAGECOUNT value on done: 974090.0 [2024-08-06 08:27:15,593][52660] Sum rewards: 90.854, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.658', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.122', 'AMMO4': '0.150', 'AMMO3': '0.162', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.194', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.346', 'FRAGCOUNT': '73.000'} [2024-08-06 08:27:16,160][52664] DAMAGECOUNT value on done: 1018557.0 [2024-08-06 08:27:16,160][52664] Sum rewards: 68.903, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.760', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.176', 'weapon4': '0.184', 'AMMO3': '0.275', 'AMMO4': '0.278', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.004', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:16,952][52665] DAMAGECOUNT value on done: 958504.0 [2024-08-06 08:27:16,953][52665] Sum rewards: 79.108, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.289', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.154', 'AMMO4': '0.181', 'AMMO3': '0.247', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:17,143][52662] DAMAGECOUNT value on done: 979838.0 [2024-08-06 08:27:17,146][52662] Sum rewards: 76.027, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon4': '0.098', 'weapon5': '0.114', 'AMMO4': '0.181', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '63.000'} [2024-08-06 08:27:17,566][52667] DAMAGECOUNT value on done: 975677.0 [2024-08-06 08:27:17,567][52667] Sum rewards: 67.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.370', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.052', 'weapon5': '0.096', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.219', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '56.000'} [2024-08-06 08:27:17,732][52650] Updated weights for policy 0, policy_version 84281 (0.0012) [2024-08-06 08:27:17,787][52649] DAMAGECOUNT value on done: 963878.0 [2024-08-06 08:27:17,788][52649] Sum rewards: 80.001, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.662', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.084', 'weapon5': '0.100', 'AMMO4': '0.167', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.268', 'WEAPON3': '1.550', 'weapon3': '3.304', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 690429952. Throughput: 0: 4357.3. Samples: 172607240. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:27:17,794][52567] Avg episode reward: [(0, '77.825')] [2024-08-06 08:27:18,247][52659] DAMAGECOUNT value on done: 980076.0 [2024-08-06 08:27:18,247][52659] Sum rewards: 72.514, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.515', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.164', 'weapon5': '0.174', 'weapon2': '0.204', 'AMMO3': '0.232', 'AMMO4': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:18,644][52660] DAMAGECOUNT value on done: 964778.0 [2024-08-06 08:27:18,645][52660] Sum rewards: 68.682, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.655', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.126', 'AMMO4': '0.188', 'weapon2': '0.214', 'AMMO3': '0.228', 'weapon5': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.098', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '57.000'} [2024-08-06 08:27:18,938][52664] DAMAGECOUNT value on done: 1007322.0 [2024-08-06 08:27:18,938][52664] Sum rewards: 69.860, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.560', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.097', 'AMMO3': '0.199', 'weapon2': '0.408', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '57.000'} [2024-08-06 08:27:19,108][52614] Signal inference workers to stop experience collection... (15450 times) [2024-08-06 08:27:19,109][52614] Signal inference workers to resume experience collection... (15450 times) [2024-08-06 08:27:19,177][52650] InferenceWorker_p0-w0: stopping experience collection (15450 times) [2024-08-06 08:27:19,177][52650] InferenceWorker_p0-w0: resuming experience collection (15450 times) [2024-08-06 08:27:19,921][52665] DAMAGECOUNT value on done: 964484.0 [2024-08-06 08:27:19,921][52665] Sum rewards: 71.999, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.168', 'weapon4': '0.196', 'weapon2': '0.216', 'AMMO3': '0.257', 'AMMO4': '0.257', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.104', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '63.000'} [2024-08-06 08:27:20,058][52662] DAMAGECOUNT value on done: 982316.0 [2024-08-06 08:27:20,058][52662] Sum rewards: 72.767, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.960', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.156', 'weapon5': '0.180', 'AMMO4': '0.182', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.068', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:20,379][52667] DAMAGECOUNT value on done: 983882.0 [2024-08-06 08:27:20,380][52667] Sum rewards: 81.590, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.525', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.704', 'WEAPON3': '1.350', 'weapon3': '2.878', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.368', 'FRAGCOUNT': '67.000'} [2024-08-06 08:27:20,968][52660] DAMAGECOUNT value on done: 977896.0 [2024-08-06 08:27:20,977][52660] Sum rewards: 68.958, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.561', 'WEAPON1': '0.010', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.164', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'AMMO3': '0.291', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:21,118][52659] DAMAGECOUNT value on done: 979593.0 [2024-08-06 08:27:21,119][52659] Sum rewards: 79.436, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.180', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.070', 'weapon4': '0.078', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'weapon2': '0.326', 'WEAPON3': '0.950', 'weapon3': '3.352', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '63.000'} [2024-08-06 08:27:21,160][52649] DAMAGECOUNT value on done: 968780.0 [2024-08-06 08:27:21,161][52649] Sum rewards: 75.753, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.215', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.016', 'AMMO4': '0.056', 'weapon4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.466', 'WEAPON3': '1.250', 'weapon3': '3.288', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:21,368][52803] DAMAGECOUNT value on done: 906760.0 [2024-08-06 08:27:21,370][52803] Sum rewards: 73.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.136', 'weapon5': '0.170', 'AMMO3': '0.187', 'AMMO4': '0.195', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.038', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '60.000'} [2024-08-06 08:27:21,800][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:27:21,915][52664] DAMAGECOUNT value on done: 1022476.0 [2024-08-06 08:27:21,916][52664] Sum rewards: 73.065, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.543', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.126', 'weapon2': '0.188', 'AMMO3': '0.190', 'weapon5': '0.244', 'AMMO4': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.160', 'weapon3': '3.238', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '60.000'} [2024-08-06 08:27:21,972][52650] Updated weights for policy 0, policy_version 84291 (0.0015) [2024-08-06 08:27:22,763][52662] DAMAGECOUNT value on done: 977605.0 [2024-08-06 08:27:22,765][52662] Sum rewards: 58.263, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.219', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.172', 'AMMO4': '0.180', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.450', 'HITCOUNT': '2.900', 'weapon3': '3.242', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '49.000'} [2024-08-06 08:27:22,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 690520064. Throughput: 0: 4365.3. Samples: 172633490. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:22,794][52567] Avg episode reward: [(0, '77.386')] [2024-08-06 08:27:23,148][52665] DAMAGECOUNT value on done: 971003.0 [2024-08-06 08:27:23,152][52665] Sum rewards: 84.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.122', 'AMMO3': '0.204', 'weapon5': '0.242', 'AMMO4': '0.252', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '69.000'} [2024-08-06 08:27:23,175][52667] DAMAGECOUNT value on done: 990196.0 [2024-08-06 08:27:23,176][52667] Sum rewards: 80.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.158', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.182', 'weapon2': '0.444', 'WEAPON3': '1.100', 'weapon3': '3.298', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.477', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:23,452][52660] DAMAGECOUNT value on done: 989620.0 [2024-08-06 08:27:23,455][52660] Sum rewards: 80.591, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.384', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon2': '0.176', 'AMMO3': '0.177', 'AMMO4': '0.197', 'weapon5': '0.224', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:24,286][52659] DAMAGECOUNT value on done: 979241.0 [2024-08-06 08:27:24,288][52659] Sum rewards: 75.756, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.135', 'AMMO3': '0.161', 'weapon2': '0.780', 'WEAPON3': '1.050', 'weapon3': '3.036', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:24,411][52649] DAMAGECOUNT value on done: 960553.0 [2024-08-06 08:27:24,413][52649] Sum rewards: 89.327, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.126', 'weapon2': '0.160', 'AMMO3': '0.190', 'AMMO4': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.294', 'WEAPON3': '1.000', 'HEALTH': '1.299', 'weapon3': '3.100', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '71.000'} [2024-08-06 08:27:24,441][52803] DAMAGECOUNT value on done: 906665.0 [2024-08-06 08:27:24,441][52803] Sum rewards: 75.466, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.108', 'weapon5': '0.142', 'AMMO4': '0.185', 'AMMO3': '0.195', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.184', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:24,873][52664] DAMAGECOUNT value on done: 1019377.0 [2024-08-06 08:27:24,873][52664] Sum rewards: 84.818, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.239', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.911', 'FRAGCOUNT': '71.000'} [2024-08-06 08:27:25,903][52662] DAMAGECOUNT value on done: 976437.0 [2024-08-06 08:27:25,904][52662] Sum rewards: 88.171, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.900', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.040', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.110', 'WEAPON3': '0.800', 'weapon2': '0.826', 'weapon3': '2.924', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:26,230][52667] DAMAGECOUNT value on done: 991305.0 [2024-08-06 08:27:26,233][52667] Sum rewards: 68.638, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.099', 'AMMO3': '0.184', 'weapon2': '0.676', 'WEAPON3': '0.950', 'HEALTH': '1.000', 'weapon3': '3.120', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '54.000'} [2024-08-06 08:27:26,365][52660] DAMAGECOUNT value on done: 971123.0 [2024-08-06 08:27:26,367][52660] Sum rewards: 73.831, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.660', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.116', 'weapon2': '0.206', 'AMMO3': '0.277', 'AMMO4': '0.324', 'weapon5': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:26,962][52650] Updated weights for policy 0, policy_version 84301 (0.0023) [2024-08-06 08:27:27,116][52659] DAMAGECOUNT value on done: 977973.0 [2024-08-06 08:27:27,118][52659] Sum rewards: 80.618, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.944', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.054', 'AMMO4': '0.097', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.252', 'AMMO3': '0.253', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '67.000'} [2024-08-06 08:27:27,500][52803] DAMAGECOUNT value on done: 915754.0 [2024-08-06 08:27:27,501][52803] Sum rewards: 69.106, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.238', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.158', 'weapon2': '0.846', 'WEAPON3': '1.050', 'weapon3': '2.898', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '54.000'} [2024-08-06 08:27:27,528][52649] DAMAGECOUNT value on done: 959756.0 [2024-08-06 08:27:27,528][52649] Sum rewards: 79.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.973', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.146', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.266', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '67.000'} [2024-08-06 08:27:27,572][52664] DAMAGECOUNT value on done: 1008424.0 [2024-08-06 08:27:27,573][52664] Sum rewards: 76.860, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.220', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.072', 'AMMO4': '0.159', 'weapon5': '0.242', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 690610176. Throughput: 0: 4355.1. Samples: 172659410. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:27,794][52567] Avg episode reward: [(0, '77.189')] [2024-08-06 08:27:28,834][52667] DAMAGECOUNT value on done: 987744.0 [2024-08-06 08:27:28,836][52667] Sum rewards: 85.805, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO2': '0.008', 'AMMO4': '0.039', 'AMMO3': '0.207', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.414', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '71.000'} [2024-08-06 08:27:28,872][52662] DAMAGECOUNT value on done: 970305.0 [2024-08-06 08:27:28,873][52662] Sum rewards: 66.917, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.438', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.090', 'AMMO3': '0.228', 'weapon5': '0.260', 'weapon2': '0.270', 'AMMO4': '0.319', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.102', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '56.000'} [2024-08-06 08:27:29,509][52660] DAMAGECOUNT value on done: 967939.0 [2024-08-06 08:27:29,509][52660] Sum rewards: 74.753, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.466', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.080', 'weapon4': '0.102', 'AMMO4': '0.135', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.566', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '60.000'} [2024-08-06 08:27:30,067][52664] DAMAGECOUNT value on done: 1008502.0 [2024-08-06 08:27:30,070][52664] Sum rewards: 83.275, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.876', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.106', 'weapon2': '0.144', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.428', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:30,183][52659] DAMAGECOUNT value on done: 989110.0 [2024-08-06 08:27:30,184][52659] Sum rewards: 80.768, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.395', 'AMMO5': '0.006', 'weapon4': '0.026', 'AMMO2': '0.035', 'weapon5': '0.084', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.233', 'WEAPON3': '1.400', 'weapon3': '3.460', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:30,589][52803] DAMAGECOUNT value on done: 909473.0 [2024-08-06 08:27:30,593][52803] Sum rewards: 75.148, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.508', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.084', 'weapon5': '0.152', 'AMMO3': '0.171', 'AMMO4': '0.196', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.742', 'WEAPON3': '1.100', 'weapon3': '2.782', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:30,675][52649] DAMAGECOUNT value on done: 948246.0 [2024-08-06 08:27:30,675][52649] Sum rewards: 80.369, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.745', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.101', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.266', 'WEAPON3': '1.450', 'weapon3': '3.344', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '67.000'} [2024-08-06 08:27:31,504][52650] Updated weights for policy 0, policy_version 84311 (0.0037) [2024-08-06 08:27:31,596][52667] DAMAGECOUNT value on done: 982927.0 [2024-08-06 08:27:31,598][52667] Sum rewards: 82.180, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.090', 'AMMO4': '0.102', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.320', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:31,697][52662] DAMAGECOUNT value on done: 981496.0 [2024-08-06 08:27:31,699][52662] Sum rewards: 60.570, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.214', 'WEAPON5': '0.250', 'WEAPON3': '1.000', 'HITCOUNT': '2.670', 'weapon3': '3.512', 'DAMAGECOUNT': '13.980', 'FRAGCOUNT': '50.000'} [2024-08-06 08:27:32,393][52660] DAMAGECOUNT value on done: 975862.0 [2024-08-06 08:27:32,393][52660] Sum rewards: 73.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.248', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.078', 'AMMO4': '0.122', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:32,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 690692096. Throughput: 0: 4350.0. Samples: 172672480. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:32,794][52567] Avg episode reward: [(0, '76.973')] [2024-08-06 08:27:32,951][52664] DAMAGECOUNT value on done: 1015932.0 [2024-08-06 08:27:32,952][52664] Sum rewards: 73.171, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.255', 'AMMO5': '0.010', 'AMMO2': '0.042', 'AMMO3': '0.172', 'weapon5': '0.180', 'AMMO4': '0.209', 'weapon4': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.000', 'weapon3': '2.794', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '56.000'} [2024-08-06 08:27:33,021][52669] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:27:33,053][52659] DAMAGECOUNT value on done: 973963.0 [2024-08-06 08:27:33,053][52659] Sum rewards: 87.853, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.500', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.112', 'weapon4': '0.152', 'WEAPON4': '0.250', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.650', 'weapon3': '3.052', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '22.293', 'FRAGCOUNT': '72.000'} [2024-08-06 08:27:33,698][52803] DAMAGECOUNT value on done: 909973.0 [2024-08-06 08:27:33,698][52803] Sum rewards: 83.869, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.855', 'AMMO5': '0.017', 'AMMO2': '0.022', 'weapon4': '0.058', 'AMMO4': '0.109', 'weapon5': '0.126', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.234', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:33,824][52649] DAMAGECOUNT value on done: 961995.0 [2024-08-06 08:27:33,824][52649] Sum rewards: 88.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.710', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.217', 'weapon2': '0.356', 'WEAPON3': '1.350', 'weapon3': '3.506', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '73.000'} [2024-08-06 08:27:34,248][52662] DAMAGECOUNT value on done: 974318.0 [2024-08-06 08:27:34,249][52662] Sum rewards: 76.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.022', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.198', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.424', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:34,283][52667] DAMAGECOUNT value on done: 989457.0 [2024-08-06 08:27:34,284][52667] Sum rewards: 84.222, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.900', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.047', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.262', 'AMMO3': '0.284', 'WEAPON3': '1.750', 'weapon3': '3.396', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.628', 'FRAGCOUNT': '73.000'} [2024-08-06 08:27:35,537][52660] DAMAGECOUNT value on done: 981861.0 [2024-08-06 08:27:35,537][52660] Sum rewards: 82.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.260', 'AMMO5': '0.024', 'AMMO2': '0.058', 'weapon4': '0.146', 'AMMO3': '0.197', 'weapon5': '0.218', 'weapon2': '0.272', 'AMMO4': '0.291', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.818', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:35,736][52664] DAMAGECOUNT value on done: 1012500.0 [2024-08-06 08:27:35,737][52664] Sum rewards: 73.365, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.650', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon5': '0.182', 'weapon2': '0.212', 'AMMO3': '0.228', 'AMMO4': '0.264', 'weapon4': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:35,763][52659] DAMAGECOUNT value on done: 985282.0 [2024-08-06 08:27:35,764][52659] Sum rewards: 78.796, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.160', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.196', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.630', 'WEAPON3': '1.250', 'weapon3': '3.000', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '63.000'} [2024-08-06 08:27:36,422][52650] Updated weights for policy 0, policy_version 84321 (0.0024) [2024-08-06 08:27:36,815][52649] DAMAGECOUNT value on done: 941599.0 [2024-08-06 08:27:36,824][52649] Sum rewards: 72.408, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.608', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.158', 'weapon5': '0.168', 'AMMO4': '0.173', 'weapon2': '0.212', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:36,940][52662] DAMAGECOUNT value on done: 989087.0 [2024-08-06 08:27:36,940][52662] Sum rewards: 78.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.400', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.073', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.360', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:36,951][52803] DAMAGECOUNT value on done: 907078.0 [2024-08-06 08:27:36,955][52803] Sum rewards: 71.848, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.490', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.332', 'weapon2': '0.508', 'WEAPON3': '1.950', 'weapon3': '3.010', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 690774016. Throughput: 0: 4350.4. Samples: 172698680. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:37,794][52567] Avg episode reward: [(0, '77.109')] [2024-08-06 08:27:38,745][52660] DAMAGECOUNT value on done: 969816.0 [2024-08-06 08:27:38,748][52660] Sum rewards: 80.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.535', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.137', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.722', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:38,825][52659] DAMAGECOUNT value on done: 978154.0 [2024-08-06 08:27:38,825][52659] Sum rewards: 84.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.543', 'AMMO5': '0.014', 'AMMO2': '0.039', 'AMMO3': '0.165', 'AMMO4': '0.197', 'weapon5': '0.208', 'weapon2': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.392', 'WEAPON3': '1.050', 'weapon3': '2.796', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '67.000'} [2024-08-06 08:27:38,839][52664] DAMAGECOUNT value on done: 1021909.0 [2024-08-06 08:27:38,839][52664] Sum rewards: 68.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.887', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.056', 'AMMO4': '0.155', 'AMMO3': '0.197', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.154', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '56.500'} [2024-08-06 08:27:39,618][52662] DAMAGECOUNT value on done: 978445.0 [2024-08-06 08:27:39,618][52662] Sum rewards: 68.189, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon5': '0.154', 'AMMO3': '0.192', 'AMMO4': '0.198', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '56.500'} [2024-08-06 08:27:39,910][52649] DAMAGECOUNT value on done: 961358.0 [2024-08-06 08:27:39,911][52649] Sum rewards: 83.931, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.979', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.062', 'AMMO4': '0.176', 'AMMO3': '0.187', 'weapon5': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.463', 'FRAGCOUNT': '67.000'} [2024-08-06 08:27:40,096][52803] DAMAGECOUNT value on done: 905873.0 [2024-08-06 08:27:40,096][52803] Sum rewards: 71.871, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.695', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.082', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.169', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '56.000'} [2024-08-06 08:27:40,928][52650] Updated weights for policy 0, policy_version 84331 (0.0012) [2024-08-06 08:27:41,239][52659] DAMAGECOUNT value on done: 976329.0 [2024-08-06 08:27:41,239][52659] Sum rewards: 77.847, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.124', 'AMMO4': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.168', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.230', 'HEALTH': '0.660', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:41,796][52660] DAMAGECOUNT value on done: 968895.0 [2024-08-06 08:27:41,797][52660] Sum rewards: 79.333, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.062', 'weapon5': '0.114', 'AMMO4': '0.152', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:42,152][52662] DAMAGECOUNT value on done: 969352.0 [2024-08-06 08:27:42,160][52662] Sum rewards: 86.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.084', 'weapon4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.568', 'FRAGCOUNT': '71.000'} [2024-08-06 08:27:42,180][52664] DAMAGECOUNT value on done: 1020292.0 [2024-08-06 08:27:42,181][52664] Sum rewards: 74.787, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.938', 'AMMO5': '0.017', 'AMMO2': '0.050', 'AMMO3': '0.216', 'weapon4': '0.238', 'AMMO4': '0.248', 'weapon5': '0.318', 'weapon2': '0.332', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.816', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.290', 'FRAGCOUNT': '60.000'} [2024-08-06 08:27:42,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 690872320. Throughput: 0: 4359.8. Samples: 172725080. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:42,794][52567] Avg episode reward: [(0, '77.521')] [2024-08-06 08:27:42,875][52649] DAMAGECOUNT value on done: 964214.0 [2024-08-06 08:27:42,878][52649] Sum rewards: 87.573, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.746', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.202', 'AMMO3': '0.268', 'WEAPON3': '1.700', 'weapon3': '3.488', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '75.000'} [2024-08-06 08:27:43,247][52803] DAMAGECOUNT value on done: 905154.0 [2024-08-06 08:27:43,250][52803] Sum rewards: 64.939, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.108', 'weapon5': '0.140', 'AMMO4': '0.219', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.400', 'weapon3': '2.960', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '54.000'} [2024-08-06 08:27:44,135][52659] DAMAGECOUNT value on done: 977842.0 [2024-08-06 08:27:44,135][52659] Sum rewards: 68.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.138', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.094', 'AMMO4': '0.217', 'AMMO3': '0.222', 'weapon5': '0.248', 'weapon2': '0.294', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'HITCOUNT': '2.930', 'weapon3': '3.136', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:44,781][52662] DAMAGECOUNT value on done: 976505.0 [2024-08-06 08:27:44,782][52662] Sum rewards: 80.634, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.350', 'AMMO5': '0.008', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.096', 'weapon5': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:44,896][52660] DAMAGECOUNT value on done: 973736.0 [2024-08-06 08:27:44,897][52660] Sum rewards: 57.234, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.670', 'AMMO5': '0.023', 'AMMO2': '0.073', 'AMMO3': '0.175', 'weapon4': '0.240', 'weapon5': '0.242', 'AMMO4': '0.364', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon2': '0.692', 'WEAPON3': '1.100', 'weapon3': '2.616', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '13.899', 'FRAGCOUNT': '47.000'} [2024-08-06 08:27:45,228][52664] DAMAGECOUNT value on done: 1016962.0 [2024-08-06 08:27:45,228][52664] Sum rewards: 76.522, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.912', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.114', 'AMMO4': '0.199', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.350', 'weapon3': '3.020', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:45,703][52650] Updated weights for policy 0, policy_version 84341 (0.0011) [2024-08-06 08:27:45,967][52649] DAMAGECOUNT value on done: 952155.0 [2024-08-06 08:27:45,969][52649] Sum rewards: 78.798, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.355', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.138', 'weapon5': '0.152', 'AMMO3': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:46,371][52803] DAMAGECOUNT value on done: 913448.0 [2024-08-06 08:27:46,373][52803] Sum rewards: 69.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.178', 'weapon2': '0.220', 'AMMO4': '0.221', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'weapon4': '0.336', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.266', 'FRAGCOUNT': '58.000'} [2024-08-06 08:27:47,021][52659] DAMAGECOUNT value on done: 979530.0 [2024-08-06 08:27:47,023][52659] Sum rewards: 75.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.460', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.056', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.232', 'weapon2': '0.522', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:47,678][52662] DAMAGECOUNT value on done: 970431.0 [2024-08-06 08:27:47,679][52662] Sum rewards: 77.945, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.107', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.492', 'WEAPON3': '1.400', 'weapon3': '3.276', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 690954240. Throughput: 0: 4366.7. Samples: 172738230. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:47,794][52567] Avg episode reward: [(0, '77.292')] [2024-08-06 08:27:47,824][52664] DAMAGECOUNT value on done: 1029484.0 [2024-08-06 08:27:47,824][52664] Sum rewards: 77.505, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.155', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'AMMO3': '0.148', 'weapon5': '0.202', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.168', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '62.000'} [2024-08-06 08:27:48,098][52660] DAMAGECOUNT value on done: 970396.0 [2024-08-06 08:27:48,098][52660] Sum rewards: 83.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.956', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.144', 'weapon5': '0.146', 'AMMO4': '0.167', 'AMMO3': '0.199', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.434', 'FRAGCOUNT': '69.000'} [2024-08-06 08:27:49,549][52803] DAMAGECOUNT value on done: 908224.0 [2024-08-06 08:27:49,550][52803] Sum rewards: 81.421, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.114', 'AMMO5': '0.015', 'AMMO2': '0.047', 'weapon4': '0.132', 'weapon5': '0.138', 'AMMO3': '0.173', 'AMMO4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '65.000'} [2024-08-06 08:27:49,857][52659] DAMAGECOUNT value on done: 991146.0 [2024-08-06 08:27:49,859][52659] Sum rewards: 95.025, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.375', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.066', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.414', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '22.275', 'FRAGCOUNT': '78.000'} [2024-08-06 08:27:49,974][52662] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:27:50,190][52650] Updated weights for policy 0, policy_version 84351 (0.0029) [2024-08-06 08:27:50,647][52664] DAMAGECOUNT value on done: 1026906.0 [2024-08-06 08:27:50,648][52664] Sum rewards: 79.277, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.058', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.135', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.270', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.140', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:50,802][52660] DAMAGECOUNT value on done: 970335.0 [2024-08-06 08:27:50,804][52660] Sum rewards: 69.621, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.298', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.227', 'weapon5': '0.252', 'weapon4': '0.430', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.564', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '57.500'} [2024-08-06 08:27:52,562][52659] DAMAGECOUNT value on done: 972361.0 [2024-08-06 08:27:52,564][52659] Sum rewards: 87.081, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.045', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.090', 'AMMO4': '0.123', 'weapon5': '0.170', 'AMMO3': '0.220', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.955', 'FRAGCOUNT': '72.000'} [2024-08-06 08:27:52,608][52803] DAMAGECOUNT value on done: 921580.0 [2024-08-06 08:27:52,610][52803] Sum rewards: 91.913, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO2': '0.012', 'weapon4': '0.058', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'AMMO3': '0.180', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.372', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '74.000'} [2024-08-06 08:27:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 691044352. Throughput: 0: 4370.2. Samples: 172764480. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:52,802][52567] Avg episode reward: [(0, '77.668')] [2024-08-06 08:27:53,447][52664] DAMAGECOUNT value on done: 1025780.0 [2024-08-06 08:27:53,449][52664] Sum rewards: 70.447, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.181', 'AMMO3': '0.213', 'weapon5': '0.218', 'weapon2': '0.274', 'weapon4': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '58.000'} [2024-08-06 08:27:53,930][52660] DAMAGECOUNT value on done: 980346.0 [2024-08-06 08:27:53,930][52660] Sum rewards: 74.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.264', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.104', 'AMMO4': '0.126', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '61.000'} [2024-08-06 08:27:55,024][52659] DAMAGECOUNT value on done: 984803.0 [2024-08-06 08:27:55,025][52659] Sum rewards: 80.612, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.130', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.051', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.492', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:55,238][52650] Updated weights for policy 0, policy_version 84361 (0.0014) [2024-08-06 08:27:55,800][52803] DAMAGECOUNT value on done: 916950.0 [2024-08-06 08:27:55,800][52803] Sum rewards: 64.384, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.110', 'AMMO5': '0.016', 'AMMO2': '0.067', 'weapon2': '0.224', 'weapon5': '0.254', 'AMMO3': '0.296', 'AMMO4': '0.336', 'weapon4': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.834', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.996', 'FRAGCOUNT': '57.000'} [2024-08-06 08:27:56,103][52664] DAMAGECOUNT value on done: 1009254.0 [2024-08-06 08:27:56,103][52664] Sum rewards: 79.617, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.420', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.092', 'weapon5': '0.134', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.636', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.428', 'FRAGCOUNT': '64.000'} [2024-08-06 08:27:56,870][52660] DAMAGECOUNT value on done: 995315.0 [2024-08-06 08:27:56,871][52660] Sum rewards: 90.659, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.286', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.114', 'AMMO4': '0.141', 'weapon5': '0.180', 'AMMO3': '0.212', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.192', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '74.000'} [2024-08-06 08:27:57,220][52671] DAMAGECOUNT value on done: 984496.0 [2024-08-06 08:27:57,220][52671] Sum rewards: 72.278, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.484', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.060', 'AMMO4': '0.189', 'weapon5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '59.000'} [2024-08-06 08:27:57,680][52659] DAMAGECOUNT value on done: 975829.0 [2024-08-06 08:27:57,681][52659] Sum rewards: 75.794, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.026', 'weapon4': '0.040', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.378', 'WEAPON3': '1.600', 'weapon3': '3.382', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '66.000'} [2024-08-06 08:27:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 691126272. Throughput: 0: 4375.1. Samples: 172790900. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:27:57,802][52567] Avg episode reward: [(0, '77.354')] [2024-08-06 08:27:57,823][52669] DAMAGECOUNT value on done: 978720.0 [2024-08-06 08:27:57,824][52669] Sum rewards: 90.833, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.836', 'AMMO5': '0.014', 'AMMO2': '0.068', 'weapon4': '0.122', 'weapon2': '0.200', 'AMMO3': '0.211', 'weapon5': '0.212', 'AMMO4': '0.341', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '22.050', 'FRAGCOUNT': '73.000'} [2024-08-06 08:27:58,023][52658] DAMAGECOUNT value on done: 984041.0 [2024-08-06 08:27:58,023][52658] Sum rewards: 88.093, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.725', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon5': '0.134', 'AMMO3': '0.174', 'weapon2': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON3': '1.050', 'weapon3': '3.120', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '70.000'} [2024-08-06 08:27:59,075][52803] DAMAGECOUNT value on done: 906723.0 [2024-08-06 08:27:59,077][52803] Sum rewards: 80.349, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.066', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.268', 'AMMO3': '0.276', 'WEAPON3': '1.700', 'weapon3': '3.392', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '68.000'} [2024-08-06 08:27:59,231][52664] DAMAGECOUNT value on done: 1014202.0 [2024-08-06 08:27:59,231][52664] Sum rewards: 92.644, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.695', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.048', 'AMMO4': '0.066', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.442', 'WEAPON3': '1.250', 'weapon3': '3.122', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '21.927', 'FRAGCOUNT': '75.000'} [2024-08-06 08:27:59,502][52650] Updated weights for policy 0, policy_version 84371 (0.0015) [2024-08-06 08:27:59,752][52660] DAMAGECOUNT value on done: 973470.0 [2024-08-06 08:27:59,752][52660] Sum rewards: 77.555, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.546', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.167', 'weapon4': '0.194', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon2': '0.306', 'WEAPON3': '1.250', 'weapon3': '3.216', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:00,231][52671] DAMAGECOUNT value on done: 991268.0 [2024-08-06 08:28:00,232][52671] Sum rewards: 74.029, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.090', 'AMMO4': '0.133', 'weapon5': '0.138', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:01,059][52669] DAMAGECOUNT value on done: 975958.0 [2024-08-06 08:28:01,059][52669] Sum rewards: 65.327, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.148', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.182', 'AMMO3': '0.197', 'weapon5': '0.236', 'AMMO4': '0.285', 'weapon2': '0.324', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '54.500'} [2024-08-06 08:28:01,375][52658] DAMAGECOUNT value on done: 983675.0 [2024-08-06 08:28:01,376][52658] Sum rewards: 79.192, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.852', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.058', 'AMMO4': '0.134', 'weapon5': '0.164', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.562', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.314', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:02,042][52664] DAMAGECOUNT value on done: 1025090.0 [2024-08-06 08:28:02,043][52664] Sum rewards: 64.404, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.750', 'AMMO5': '0.018', 'AMMO2': '0.068', 'weapon4': '0.194', 'weapon5': '0.232', 'AMMO3': '0.303', 'weapon2': '0.334', 'AMMO4': '0.340', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.888', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '56.000'} [2024-08-06 08:28:02,223][52820] DAMAGECOUNT value on done: 904506.0 [2024-08-06 08:28:02,223][52820] Sum rewards: 76.513, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.346', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.153', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '65.000'} [2024-08-06 08:28:02,248][52803] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:28:02,270][52803] DAMAGECOUNT value on done: 924296.0 [2024-08-06 08:28:02,270][52803] Sum rewards: 70.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.048', 'weapon5': '0.134', 'AMMO4': '0.165', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '2.996', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '56.000'} [2024-08-06 08:28:02,395][52659] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:28:02,667][52660] DAMAGECOUNT value on done: 977403.0 [2024-08-06 08:28:02,669][52660] Sum rewards: 78.202, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.430', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.196', 'weapon5': '0.232', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.716', 'WEAPON3': '1.150', 'weapon3': '2.396', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 08:28:02,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 691216384. Throughput: 0: 4370.0. Samples: 172803890. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:28:02,802][52567] Avg episode reward: [(0, '77.144')] [2024-08-06 08:28:02,808][52671] DAMAGECOUNT value on done: 983968.0 [2024-08-06 08:28:02,809][52671] Sum rewards: 79.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.461', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.152', 'weapon4': '0.160', 'AMMO3': '0.166', 'AMMO4': '0.221', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '65.000'} [2024-08-06 08:28:03,656][52669] DAMAGECOUNT value on done: 986939.0 [2024-08-06 08:28:03,656][52669] Sum rewards: 82.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '0.014', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.176', 'weapon2': '0.304', 'WEAPON3': '1.050', 'weapon3': '3.544', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:04,407][52650] Updated weights for policy 0, policy_version 84381 (0.0019) [2024-08-06 08:28:04,456][52658] DAMAGECOUNT value on done: 986734.0 [2024-08-06 08:28:04,457][52658] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.991', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.070', 'weapon5': '0.102', 'AMMO4': '0.137', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.198', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '57.000'} [2024-08-06 08:28:05,033][52667] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.507, 169.0), ('weapon5', 0.002)] [2024-08-06 08:28:05,238][52803] DAMAGECOUNT value on done: 907487.0 [2024-08-06 08:28:05,238][52803] Sum rewards: 80.369, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.845', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.156', 'weapon4': '0.182', 'AMMO3': '0.190', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '65.000'} [2024-08-06 08:28:05,264][52664] DAMAGECOUNT value on done: 1007985.0 [2024-08-06 08:28:05,265][52664] Sum rewards: 76.848, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.885', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'weapon5': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.240', 'WEAPON3': '1.150', 'weapon3': '3.426', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:05,384][52820] DAMAGECOUNT value on done: 907831.0 [2024-08-06 08:28:05,388][52820] Sum rewards: 72.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.168', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.058', 'AMMO3': '0.138', 'weapon5': '0.144', 'AMMO4': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.714', 'WEAPON3': '0.950', 'weapon3': '2.894', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '57.000'} [2024-08-06 08:28:05,484][52671] DAMAGECOUNT value on done: 991189.0 [2024-08-06 08:28:05,486][52671] Sum rewards: 88.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.274', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.180', 'AMMO4': '0.199', 'AMMO3': '0.224', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.212', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.961', 'FRAGCOUNT': '72.000'} [2024-08-06 08:28:05,719][52660] DAMAGECOUNT value on done: 976386.0 [2024-08-06 08:28:05,719][52660] Sum rewards: 81.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.725', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.050', 'weapon4': '0.062', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon2': '0.368', 'WEAPON3': '1.250', 'weapon3': '3.300', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '68.000'} [2024-08-06 08:28:06,420][52669] DAMAGECOUNT value on done: 979954.0 [2024-08-06 08:28:06,422][52669] Sum rewards: 77.602, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.154', 'weapon4': '0.170', 'AMMO3': '0.203', 'WEAPON3': '1.250', 'weapon3': '3.402', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:07,266][52658] DAMAGECOUNT value on done: 982063.0 [2024-08-06 08:28:07,266][52658] Sum rewards: 76.324, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.960', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.098', 'weapon5': '0.130', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.262', 'WEAPON3': '1.650', 'weapon3': '3.418', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:07,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.4). Total num frames: 691306496. Throughput: 0: 4368.7. Samples: 172830080. Policy #0 lag: (min: 1.0, avg: 4.0, max: 8.0) [2024-08-06 08:28:07,794][52567] Avg episode reward: [(0, '77.603')] [2024-08-06 08:28:08,238][52803] DAMAGECOUNT value on done: 917498.0 [2024-08-06 08:28:08,240][52803] Sum rewards: 90.953, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.114', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.218', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.691', 'FRAGCOUNT': '73.000'} [2024-08-06 08:28:08,241][52671] DAMAGECOUNT value on done: 996341.0 [2024-08-06 08:28:08,244][52671] Sum rewards: 76.818, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.350', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.152', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '3.074', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 08:28:08,616][52820] DAMAGECOUNT value on done: 909527.0 [2024-08-06 08:28:08,618][52820] Sum rewards: 74.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.310', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.110', 'AMMO4': '0.196', 'AMMO3': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.562', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '60.500'} [2024-08-06 08:28:08,741][52660] DAMAGECOUNT value on done: 967558.0 [2024-08-06 08:28:08,743][52660] Sum rewards: 68.437, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.538', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.040', 'AMMO4': '0.123', 'weapon5': '0.128', 'weapon2': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.294', 'WEAPON3': '1.800', 'HITCOUNT': '3.350', 'weapon3': '3.378', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '59.000'} [2024-08-06 08:28:08,955][52650] Updated weights for policy 0, policy_version 84391 (0.0010) [2024-08-06 08:28:09,441][52669] DAMAGECOUNT value on done: 987413.0 [2024-08-06 08:28:09,442][52669] Sum rewards: 69.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.026', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.102', 'AMMO3': '0.161', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.596', 'WEAPON3': '1.000', 'weapon3': '3.052', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '55.500'} [2024-08-06 08:28:10,598][52658] DAMAGECOUNT value on done: 975419.0 [2024-08-06 08:28:10,600][52658] Sum rewards: 86.060, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.004', 'AMMO2': '0.019', 'weapon4': '0.020', 'weapon5': '0.022', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.244', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.466', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '20.709', 'FRAGCOUNT': '72.000'} [2024-08-06 08:28:11,076][52671] DAMAGECOUNT value on done: 984866.0 [2024-08-06 08:28:11,078][52671] Sum rewards: 78.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.750', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.130', 'weapon5': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.494', 'WEAPON3': '1.600', 'weapon3': '2.928', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '66.000'} [2024-08-06 08:28:11,253][52803] DAMAGECOUNT value on done: 918609.0 [2024-08-06 08:28:11,254][52803] Sum rewards: 84.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.354', 'AMMO5': '0.004', 'weapon4': '0.016', 'weapon5': '0.016', 'AMMO2': '0.020', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'AMMO3': '0.192', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '69.000'} [2024-08-06 08:28:11,514][52660] DAMAGECOUNT value on done: 967684.0 [2024-08-06 08:28:11,515][52660] Sum rewards: 75.836, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.555', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.140', 'AMMO4': '0.155', 'AMMO3': '0.159', 'weapon5': '0.182', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '0.950', 'weapon3': '2.944', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '58.000'} [2024-08-06 08:28:11,675][52820] DAMAGECOUNT value on done: 897972.0 [2024-08-06 08:28:11,675][52820] Sum rewards: 77.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.166', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.140', 'AMMO4': '0.184', 'weapon5': '0.188', 'AMMO3': '0.193', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:12,239][52669] DAMAGECOUNT value on done: 985705.0 [2024-08-06 08:28:12,240][52669] Sum rewards: 81.756, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'weapon4': '0.158', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.398', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '70.000'} [2024-08-06 08:28:12,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 691396608. Throughput: 0: 4375.3. Samples: 172856300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:12,802][52567] Avg episode reward: [(0, '77.845')] [2024-08-06 08:28:13,792][52658] DAMAGECOUNT value on done: 974082.0 [2024-08-06 08:28:13,795][52658] Sum rewards: 76.989, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.445', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.017', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.083', 'AMMO3': '0.196', 'weapon2': '0.378', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:13,839][52650] Updated weights for policy 0, policy_version 84401 (0.0012) [2024-08-06 08:28:13,883][52671] DAMAGECOUNT value on done: 986609.0 [2024-08-06 08:28:13,884][52671] Sum rewards: 76.003, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.670', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.082', 'AMMO4': '0.151', 'weapon5': '0.210', 'weapon2': '0.248', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.118', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:14,354][52803] DAMAGECOUNT value on done: 923805.0 [2024-08-06 08:28:14,354][52803] Sum rewards: 73.379, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.875', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.072', 'AMMO4': '0.163', 'weapon5': '0.164', 'AMMO3': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.138', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '60.000'} [2024-08-06 08:28:14,831][52666] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:28:14,851][52820] DAMAGECOUNT value on done: 908607.0 [2024-08-06 08:28:14,851][52820] Sum rewards: 80.207, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.567', 'AMMO5': '0.017', 'AMMO2': '0.062', 'weapon4': '0.138', 'AMMO3': '0.227', 'weapon5': '0.258', 'weapon2': '0.306', 'AMMO4': '0.312', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.970', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:15,203][52669] DAMAGECOUNT value on done: 985020.0 [2024-08-06 08:28:15,206][52669] Sum rewards: 79.795, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.782', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.098', 'AMMO3': '0.167', 'AMMO4': '0.223', 'weapon4': '0.288', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:16,295][52671] DAMAGECOUNT value on done: 990948.0 [2024-08-06 08:28:16,298][52671] Sum rewards: 70.632, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.134', 'AMMO4': '0.138', 'weapon2': '0.178', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:16,724][52658] DAMAGECOUNT value on done: 987081.0 [2024-08-06 08:28:16,725][52658] Sum rewards: 82.898, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.212', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon4': '0.244', 'weapon2': '0.396', 'WEAPON3': '1.150', 'weapon3': '3.074', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:17,441][52803] DAMAGECOUNT value on done: 921123.0 [2024-08-06 08:28:17,443][52803] Sum rewards: 79.931, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.120', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon2': '0.164', 'AMMO3': '0.205', 'WEAPON3': '1.300', 'weapon3': '3.574', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '65.500'} [2024-08-06 08:28:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 691478528. Throughput: 0: 4373.4. Samples: 172869280. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:17,794][52567] Avg episode reward: [(0, '77.845')] [2024-08-06 08:28:17,863][52820] DAMAGECOUNT value on done: 893742.0 [2024-08-06 08:28:17,863][52820] Sum rewards: 71.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.094', 'weapon5': '0.140', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.214', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '60.000'} [2024-08-06 08:28:18,015][52669] DAMAGECOUNT value on done: 985681.0 [2024-08-06 08:28:18,015][52669] Sum rewards: 77.699, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.178', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.132', 'weapon2': '0.198', 'AMMO4': '0.214', 'AMMO3': '0.226', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:18,186][52650] Updated weights for policy 0, policy_version 84411 (0.0025) [2024-08-06 08:28:19,420][52671] DAMAGECOUNT value on done: 971656.0 [2024-08-06 08:28:19,422][52671] Sum rewards: 65.028, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.008', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.166', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'weapon2': '0.266', 'weapon4': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '2.984', 'DAMAGECOUNT': '15.654', 'FRAGCOUNT': '53.000'} [2024-08-06 08:28:19,704][52658] DAMAGECOUNT value on done: 973247.0 [2024-08-06 08:28:19,705][52658] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.290', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.013', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'weapon4': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.224', 'weapon2': '0.402', 'WEAPON3': '1.250', 'weapon3': '3.316', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '62.500'} [2024-08-06 08:28:20,630][52803] DAMAGECOUNT value on done: 917225.0 [2024-08-06 08:28:20,632][52803] Sum rewards: 78.452, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.006', 'AMMO2': '0.017', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'weapon5': '0.128', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.820', 'WEAPON3': '1.300', 'weapon3': '2.876', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:20,978][52669] DAMAGECOUNT value on done: 993408.0 [2024-08-06 08:28:20,978][52669] Sum rewards: 80.616, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.198', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.044', 'AMMO4': '0.150', 'weapon5': '0.162', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.382', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.088', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:21,053][52820] DAMAGECOUNT value on done: 900543.0 [2024-08-06 08:28:21,053][52820] Sum rewards: 72.588, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.648', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon4': '0.100', 'AMMO4': '0.145', 'weapon5': '0.182', 'AMMO3': '0.197', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:22,218][52663] DAMAGECOUNT value on done: 997371.0 [2024-08-06 08:28:22,219][52663] Sum rewards: 67.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.044', 'AMMO4': '0.133', 'weapon5': '0.154', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.296', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.280', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '58.000'} [2024-08-06 08:28:22,411][52658] DAMAGECOUNT value on done: 1000984.0 [2024-08-06 08:28:22,412][52658] Sum rewards: 67.360, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.365', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.118', 'AMMO4': '0.212', 'AMMO3': '0.216', 'weapon5': '0.228', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.602', 'WEAPON3': '1.350', 'weapon3': '2.812', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.837', 'FRAGCOUNT': '56.000'} [2024-08-06 08:28:22,496][52671] DAMAGECOUNT value on done: 987125.0 [2024-08-06 08:28:22,497][52671] Sum rewards: 91.806, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.440', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.042', 'weapon5': '0.130', 'AMMO4': '0.203', 'weapon2': '0.222', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.396', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.495', 'FRAGCOUNT': '76.000'} [2024-08-06 08:28:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 691568640. Throughput: 0: 4377.6. Samples: 172895670. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:22,794][52567] Avg episode reward: [(0, '77.653')] [2024-08-06 08:28:23,277][52650] Updated weights for policy 0, policy_version 84421 (0.0018) [2024-08-06 08:28:23,841][52669] DAMAGECOUNT value on done: 985371.0 [2024-08-06 08:28:23,841][52669] Sum rewards: 70.257, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.129', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.094', 'weapon5': '0.126', 'AMMO4': '0.159', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.700', 'weapon3': '2.908', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '60.000'} [2024-08-06 08:28:24,158][52820] DAMAGECOUNT value on done: 904452.0 [2024-08-06 08:28:24,158][52820] Sum rewards: 76.481, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.108', 'weapon5': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'AMMO4': '0.240', 'WEAPON4': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:24,995][52663] DAMAGECOUNT value on done: 982525.0 [2024-08-06 08:28:24,996][52663] Sum rewards: 81.097, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.020', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon4': '0.078', 'weapon5': '0.188', 'AMMO4': '0.217', 'weapon2': '0.272', 'AMMO3': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.800', 'weapon3': '3.174', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.985', 'FRAGCOUNT': '69.000'} [2024-08-06 08:28:25,285][52658] DAMAGECOUNT value on done: 988760.0 [2024-08-06 08:28:25,285][52658] Sum rewards: 73.357, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.830', 'AMMO5': '0.024', 'AMMO2': '0.054', 'weapon4': '0.164', 'AMMO3': '0.203', 'AMMO4': '0.271', 'weapon5': '0.294', 'weapon2': '0.560', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.648', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '60.000'} [2024-08-06 08:28:25,297][52671] DAMAGECOUNT value on done: 986311.0 [2024-08-06 08:28:25,298][52671] Sum rewards: 83.380, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.148', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO3': '0.219', 'AMMO4': '0.224', 'weapon5': '0.226', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.012', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:26,819][52669] DAMAGECOUNT value on done: 991638.0 [2024-08-06 08:28:26,821][52669] Sum rewards: 79.261, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.545', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.116', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:27,397][52820] DAMAGECOUNT value on done: 911544.0 [2024-08-06 08:28:27,397][52820] Sum rewards: 70.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.295', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon5': '0.096', 'AMMO4': '0.161', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.226', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '57.000'} [2024-08-06 08:28:27,741][52650] Updated weights for policy 0, policy_version 84431 (0.0015) [2024-08-06 08:28:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 691658752. Throughput: 0: 4365.8. Samples: 172921540. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:27,794][52567] Avg episode reward: [(0, '77.325')] [2024-08-06 08:28:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084431_691658752.pth... [2024-08-06 08:28:27,874][52671] DAMAGECOUNT value on done: 983323.0 [2024-08-06 08:28:27,874][52671] Sum rewards: 63.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.136', 'weapon2': '0.166', 'AMMO3': '0.189', 'weapon5': '0.192', 'weapon4': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.262', 'DAMAGECOUNT': '15.519', 'FRAGCOUNT': '52.000'} [2024-08-06 08:28:27,931][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000083920_687472640.pth [2024-08-06 08:28:28,145][52658] DAMAGECOUNT value on done: 994343.0 [2024-08-06 08:28:28,145][52658] Sum rewards: 87.014, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.025', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.149', 'weapon5': '0.186', 'weapon2': '0.252', 'AMMO3': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.212', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '21.834', 'FRAGCOUNT': '73.000'} [2024-08-06 08:28:28,263][52663] DAMAGECOUNT value on done: 975959.0 [2024-08-06 08:28:28,263][52663] Sum rewards: 68.564, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.675', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.108', 'AMMO4': '0.122', 'weapon5': '0.132', 'AMMO3': '0.233', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '58.000'} [2024-08-06 08:28:30,245][52669] DAMAGECOUNT value on done: 991091.0 [2024-08-06 08:28:30,246][52669] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.050', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.364', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:30,661][52820] DAMAGECOUNT value on done: 918639.0 [2024-08-06 08:28:30,662][52820] Sum rewards: 70.988, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.770', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'weapon5': '0.108', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'weapon2': '0.494', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.850', 'FRAGCOUNT': '56.000'} [2024-08-06 08:28:30,722][52658] DAMAGECOUNT value on done: 978986.0 [2024-08-06 08:28:30,724][52658] Sum rewards: 75.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.130', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.380', 'WEAPON3': '1.450', 'weapon3': '3.284', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.681', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:31,101][52671] DAMAGECOUNT value on done: 984770.0 [2024-08-06 08:28:31,102][52671] Sum rewards: 67.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.328', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.190', 'weapon4': '0.206', 'AMMO3': '0.220', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.040', 'FRAGCOUNT': '56.000'} [2024-08-06 08:28:31,342][52795] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:28:31,755][52663] DAMAGECOUNT value on done: 985338.0 [2024-08-06 08:28:31,756][52663] Sum rewards: 92.946, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.663', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.376', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.120', 'FRAGCOUNT': '75.000'} [2024-08-06 08:28:32,625][52650] Updated weights for policy 0, policy_version 84441 (0.0013) [2024-08-06 08:28:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 691740672. Throughput: 0: 4360.7. Samples: 172934460. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:32,794][52567] Avg episode reward: [(0, '77.270')] [2024-08-06 08:28:33,376][52669] DAMAGECOUNT value on done: 978023.0 [2024-08-06 08:28:33,386][52669] Sum rewards: 76.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.796', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.172', 'AMMO4': '0.192', 'AMMO3': '0.200', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:33,661][52820] DAMAGECOUNT value on done: 899824.0 [2024-08-06 08:28:33,661][52820] Sum rewards: 73.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.129', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.094', 'AMMO4': '0.208', 'AMMO3': '0.227', 'weapon5': '0.318', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.742', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:33,767][52795] DAMAGECOUNT value on done: 902512.0 [2024-08-06 08:28:33,768][52795] Sum rewards: 78.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.384', 'AMMO5': '0.020', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO3': '0.199', 'AMMO4': '0.214', 'weapon2': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:33,855][52671] DAMAGECOUNT value on done: 987265.0 [2024-08-06 08:28:33,857][52671] Sum rewards: 76.000, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.216', 'AMMO5': '0.012', 'ARMOR': '0.012', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.180', 'AMMO4': '0.200', 'AMMO3': '0.215', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:33,870][52658] DAMAGECOUNT value on done: 990552.0 [2024-08-06 08:28:33,870][52658] Sum rewards: 74.198, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.065', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.120', 'weapon5': '0.130', 'AMMO3': '0.150', 'AMMO4': '0.206', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.534', 'WEAPON3': '0.900', 'weapon3': '2.994', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '59.000'} [2024-08-06 08:28:34,915][52663] DAMAGECOUNT value on done: 982933.0 [2024-08-06 08:28:34,915][52663] Sum rewards: 76.490, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.075', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.076', 'weapon5': '0.158', 'AMMO4': '0.173', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:36,220][52669] DAMAGECOUNT value on done: 980382.0 [2024-08-06 08:28:36,221][52669] Sum rewards: 85.845, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.450', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.118', 'weapon5': '0.198', 'AMMO4': '0.224', 'AMMO3': '0.259', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.650', 'weapon3': '3.016', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.723', 'FRAGCOUNT': '72.000'} [2024-08-06 08:28:36,548][52658] DAMAGECOUNT value on done: 981264.0 [2024-08-06 08:28:36,549][52658] Sum rewards: 88.851, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.866', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.058', 'AMMO4': '0.157', 'weapon5': '0.194', 'AMMO3': '0.205', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.252', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '71.000'} [2024-08-06 08:28:36,630][52671] DAMAGECOUNT value on done: 971771.0 [2024-08-06 08:28:36,632][52671] Sum rewards: 78.434, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'weapon4': '0.104', 'WEAPON4': '0.150', 'weapon2': '0.178', 'AMMO3': '0.219', 'WEAPON3': '1.450', 'weapon3': '3.454', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '65.000'} [2024-08-06 08:28:36,857][52820] DAMAGECOUNT value on done: 911319.0 [2024-08-06 08:28:36,858][52820] Sum rewards: 75.111, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.098', 'AMMO4': '0.186', 'AMMO3': '0.186', 'weapon5': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.908', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:36,869][52795] DAMAGECOUNT value on done: 898172.0 [2024-08-06 08:28:36,869][52795] Sum rewards: 82.563, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.530', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon5': '0.164', 'AMMO3': '0.205', 'weapon4': '0.260', 'weapon2': '0.276', 'AMMO4': '0.295', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '68.000'} [2024-08-06 08:28:37,140][52663] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:28:37,308][52650] Updated weights for policy 0, policy_version 84451 (0.0018) [2024-08-06 08:28:37,624][52663] DAMAGECOUNT value on done: 989063.0 [2024-08-06 08:28:37,626][52663] Sum rewards: 77.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.524', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.152', 'weapon5': '0.166', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'weapon4': '0.468', 'WEAPON3': '1.150', 'weapon3': '2.762', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.984', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 691830784. Throughput: 0: 4365.3. Samples: 172960920. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:37,794][52567] Avg episode reward: [(0, '77.423')] [2024-08-06 08:28:38,873][52794] DAMAGECOUNT value on done: 978054.0 [2024-08-06 08:28:38,882][52794] Sum rewards: 75.345, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.148', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon5': '0.110', 'weapon4': '0.120', 'AMMO4': '0.185', 'AMMO3': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.400', 'weapon3': '3.118', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:38,969][52669] DAMAGECOUNT value on done: 987749.0 [2024-08-06 08:28:38,969][52669] Sum rewards: 64.270, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.605', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.070', 'weapon5': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.204', 'weapon2': '0.238', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.324', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 08:28:39,466][52671] DAMAGECOUNT value on done: 997519.0 [2024-08-06 08:28:39,466][52671] Sum rewards: 84.347, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.710', 'AMMO5': '0.011', 'AMMO2': '0.013', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.392', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.923', 'FRAGCOUNT': '70.000'} [2024-08-06 08:28:39,501][52658] DAMAGECOUNT value on done: 983716.0 [2024-08-06 08:28:39,502][52658] Sum rewards: 65.532, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.452', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.140', 'AMMO4': '0.167', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.204', 'DAMAGECOUNT': '14.835', 'FRAGCOUNT': '57.000'} [2024-08-06 08:28:39,991][52820] DAMAGECOUNT value on done: 924896.0 [2024-08-06 08:28:39,992][52820] Sum rewards: 81.755, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.332', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.097', 'weapon2': '0.194', 'AMMO3': '0.223', 'weapon4': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.349', 'FRAGCOUNT': '68.000'} [2024-08-06 08:28:40,023][52795] DAMAGECOUNT value on done: 899337.0 [2024-08-06 08:28:40,024][52795] Sum rewards: 73.767, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.019', 'AMMO2': '0.047', 'weapon4': '0.182', 'AMMO4': '0.233', 'AMMO3': '0.248', 'weapon2': '0.250', 'weapon5': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.012', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '62.000'} [2024-08-06 08:28:40,161][52663] DAMAGECOUNT value on done: 981256.0 [2024-08-06 08:28:40,162][52663] Sum rewards: 78.098, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.122', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.168', 'weapon5': '0.190', 'weapon2': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.944', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '62.000'} [2024-08-06 08:28:41,929][52669] DAMAGECOUNT value on done: 1006934.0 [2024-08-06 08:28:41,929][52669] Sum rewards: 76.325, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.994', 'AMMO5': '0.024', 'AMMO2': '0.045', 'weapon4': '0.100', 'AMMO4': '0.225', 'AMMO3': '0.226', 'weapon5': '0.288', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.972', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:42,083][52794] DAMAGECOUNT value on done: 984897.0 [2024-08-06 08:28:42,086][52794] Sum rewards: 72.365, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.128', 'AMMO4': '0.140', 'weapon4': '0.146', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.263', 'weapon2': '0.498', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:42,092][52658] DAMAGECOUNT value on done: 970532.0 [2024-08-06 08:28:42,094][52658] Sum rewards: 74.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.690', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.092', 'weapon2': '0.138', 'AMMO4': '0.166', 'WEAPON5': '0.200', 'AMMO3': '0.264', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.160', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:42,151][52671] DAMAGECOUNT value on done: 994561.0 [2024-08-06 08:28:42,151][52671] Sum rewards: 78.512, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.052', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.088', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.354', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.263', 'FRAGCOUNT': '66.000'} [2024-08-06 08:28:42,266][52650] Updated weights for policy 0, policy_version 84461 (0.0012) [2024-08-06 08:28:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17467.6). Total num frames: 691912704. Throughput: 0: 4357.6. Samples: 172986990. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:42,794][52567] Avg episode reward: [(0, '77.155')] [2024-08-06 08:28:43,176][52795] DAMAGECOUNT value on done: 913689.0 [2024-08-06 08:28:43,176][52795] Sum rewards: 74.436, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.210', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.056', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon5': '0.182', 'weapon2': '0.562', 'WEAPON3': '0.950', 'weapon3': '3.038', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '59.000'} [2024-08-06 08:28:43,302][52820] DAMAGECOUNT value on done: 911869.0 [2024-08-06 08:28:43,304][52820] Sum rewards: 64.719, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.458', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon5': '0.134', 'weapon4': '0.140', 'AMMO4': '0.203', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.926', 'WEAPON3': '1.250', 'weapon3': '2.538', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '56.000'} [2024-08-06 08:28:43,392][52663] DAMAGECOUNT value on done: 966538.0 [2024-08-06 08:28:43,392][52663] Sum rewards: 85.089, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.134', 'weapon5': '0.168', 'AMMO4': '0.202', 'AMMO3': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.112', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '72.000'} [2024-08-06 08:28:45,019][52669] DAMAGECOUNT value on done: 994238.0 [2024-08-06 08:28:45,022][52669] Sum rewards: 80.422, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.650', 'AMMO5': '0.018', 'AMMO2': '0.043', 'weapon4': '0.182', 'AMMO4': '0.215', 'AMMO3': '0.227', 'weapon5': '0.248', 'weapon2': '0.434', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.748', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '69.000'} [2024-08-06 08:28:45,120][52658] DAMAGECOUNT value on done: 986681.0 [2024-08-06 08:28:45,121][52658] Sum rewards: 82.745, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.782', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.080', 'AMMO4': '0.225', 'weapon2': '0.250', 'AMMO3': '0.269', 'weapon5': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.092', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '70.000'} [2024-08-06 08:28:45,144][52671] DAMAGECOUNT value on done: 986872.0 [2024-08-06 08:28:45,144][52671] Sum rewards: 71.270, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.926', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.042', 'weapon5': '0.062', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.442', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:45,481][52794] DAMAGECOUNT value on done: 991509.0 [2024-08-06 08:28:45,481][52794] Sum rewards: 84.319, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.445', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.136', 'AMMO4': '0.225', 'weapon2': '0.234', 'weapon4': '0.250', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.850', 'weapon3': '3.018', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '65.000'} [2024-08-06 08:28:46,351][52795] DAMAGECOUNT value on done: 897964.0 [2024-08-06 08:28:46,351][52795] Sum rewards: 74.713, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.116', 'AMMO4': '0.172', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.162', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:46,394][52663] DAMAGECOUNT value on done: 978388.0 [2024-08-06 08:28:46,394][52663] Sum rewards: 64.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.176', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.149', 'weapon5': '0.180', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '3.110', 'weapon3': '3.222', 'DAMAGECOUNT': '16.557', 'FRAGCOUNT': '53.000'} [2024-08-06 08:28:46,615][52650] Updated weights for policy 0, policy_version 84471 (0.0016) [2024-08-06 08:28:46,635][52820] DAMAGECOUNT value on done: 910012.0 [2024-08-06 08:28:46,639][52820] Sum rewards: 82.919, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.635', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.040', 'WEAPON5': '0.050', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon2': '0.328', 'WEAPON3': '1.350', 'weapon3': '3.260', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '68.000'} [2024-08-06 08:28:46,933][52670] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:28:47,588][52658] DAMAGECOUNT value on done: 981377.0 [2024-08-06 08:28:47,589][52658] Sum rewards: 73.329, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.302', 'AMMO5': '0.015', 'AMMO2': '0.022', 'weapon4': '0.108', 'AMMO4': '0.111', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.300', 'weapon3': '2.890', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '61.000'} [2024-08-06 08:28:47,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 692002816. Throughput: 0: 4358.7. Samples: 173000030. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:47,794][52567] Avg episode reward: [(0, '76.969')] [2024-08-06 08:28:47,868][52669] DAMAGECOUNT value on done: 991834.0 [2024-08-06 08:28:47,868][52669] Sum rewards: 71.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.013', 'AMMO2': '0.018', 'weapon4': '0.066', 'AMMO4': '0.088', 'weapon5': '0.128', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.252', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '58.000'} [2024-08-06 08:28:48,376][52671] DAMAGECOUNT value on done: 992701.0 [2024-08-06 08:28:48,376][52671] Sum rewards: 77.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.452', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.126', 'AMMO4': '0.140', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.324', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '65.000'} [2024-08-06 08:28:48,682][52794] DAMAGECOUNT value on done: 977331.0 [2024-08-06 08:28:48,683][52794] Sum rewards: 80.078, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.810', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.152', 'weapon2': '0.204', 'AMMO3': '0.226', 'weapon4': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '66.000'} [2024-08-06 08:28:49,389][52663] DAMAGECOUNT value on done: 975832.0 [2024-08-06 08:28:49,392][52663] Sum rewards: 67.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.849', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.074', 'weapon5': '0.092', 'AMMO4': '0.094', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '54.000'} [2024-08-06 08:28:49,540][52795] DAMAGECOUNT value on done: 901261.0 [2024-08-06 08:28:49,540][52795] Sum rewards: 82.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.475', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.154', 'weapon5': '0.174', 'AMMO3': '0.191', 'AMMO4': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.250', 'weapon3': '2.858', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.369', 'FRAGCOUNT': '68.000'} [2024-08-06 08:28:49,849][52820] DAMAGECOUNT value on done: 912376.0 [2024-08-06 08:28:49,853][52820] Sum rewards: 85.442, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.730', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.116', 'AMMO4': '0.152', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.366', 'FRAGCOUNT': '70.000'} [2024-08-06 08:28:50,545][52658] DAMAGECOUNT value on done: 977371.0 [2024-08-06 08:28:50,545][52658] Sum rewards: 79.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.244', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.100', 'weapon5': '0.152', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:50,913][52669] DAMAGECOUNT value on done: 996627.0 [2024-08-06 08:28:50,915][52669] Sum rewards: 69.512, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.185', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.074', 'weapon4': '0.104', 'AMMO3': '0.155', 'WEAPON5': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '3.002', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '55.000'} [2024-08-06 08:28:51,438][52650] Updated weights for policy 0, policy_version 84481 (0.0025) [2024-08-06 08:28:51,633][52671] DAMAGECOUNT value on done: 975741.0 [2024-08-06 08:28:51,633][52671] Sum rewards: 80.359, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.254', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO4': '0.266', 'AMMO3': '0.278', 'weapon2': '0.284', 'weapon5': '0.308', 'weapon4': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '2.664', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.088', 'FRAGCOUNT': '68.000'} [2024-08-06 08:28:51,661][52794] DAMAGECOUNT value on done: 972444.0 [2024-08-06 08:28:51,663][52794] Sum rewards: 70.808, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.785', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO4': '0.174', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'weapon2': '0.256', 'WEAPON4': '0.350', 'weapon4': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '58.000'} [2024-08-06 08:28:52,286][52663] DAMAGECOUNT value on done: 984169.0 [2024-08-06 08:28:52,286][52663] Sum rewards: 80.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.094', 'weapon4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.195', 'weapon2': '0.430', 'WEAPON3': '1.300', 'weapon3': '3.186', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.631', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:52,731][52795] DAMAGECOUNT value on done: 914792.0 [2024-08-06 08:28:52,731][52795] Sum rewards: 77.467, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.146', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.092', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 692092928. Throughput: 0: 4356.2. Samples: 173026110. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:52,794][52567] Avg episode reward: [(0, '76.828')] [2024-08-06 08:28:52,987][52820] DAMAGECOUNT value on done: 911912.0 [2024-08-06 08:28:52,987][52820] Sum rewards: 78.633, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.605', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.076', 'weapon5': '0.084', 'AMMO4': '0.136', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON3': '1.400', 'weapon3': '3.516', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:53,383][52669] DAMAGECOUNT value on done: 997669.0 [2024-08-06 08:28:53,384][52669] Sum rewards: 75.835, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.990', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.081', 'AMMO3': '0.235', 'weapon2': '0.518', 'WEAPON3': '1.400', 'weapon3': '3.232', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '63.000'} [2024-08-06 08:28:53,578][52658] DAMAGECOUNT value on done: 986800.0 [2024-08-06 08:28:53,578][52658] Sum rewards: 91.356, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.060', 'weapon5': '0.152', 'weapon2': '0.184', 'AMMO4': '0.202', 'AMMO3': '0.212', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.438', 'FRAGCOUNT': '75.000'} [2024-08-06 08:28:54,568][52794] DAMAGECOUNT value on done: 976110.0 [2024-08-06 08:28:54,570][52794] Sum rewards: 81.946, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.165', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon4': '0.088', 'AMMO4': '0.119', 'weapon5': '0.200', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.180', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '69.000'} [2024-08-06 08:28:54,856][52663] DAMAGECOUNT value on done: 969939.0 [2024-08-06 08:28:54,859][52663] Sum rewards: 80.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.074', 'weapon4': '0.088', 'WEAPON5': '0.100', 'weapon2': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'WEAPON3': '1.350', 'weapon3': '3.582', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.573', 'FRAGCOUNT': '67.000'} [2024-08-06 08:28:55,884][52795] DAMAGECOUNT value on done: 904782.0 [2024-08-06 08:28:55,884][52795] Sum rewards: 70.468, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.620', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.054', 'weapon4': '0.102', 'AMMO4': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.356', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '59.000'} [2024-08-06 08:28:56,166][52820] DAMAGECOUNT value on done: 917617.0 [2024-08-06 08:28:56,170][52820] Sum rewards: 58.707, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.766', 'AMMO5': '0.030', 'AMMO2': '0.082', 'AMMO3': '0.180', 'weapon4': '0.246', 'weapon5': '0.314', 'AMMO4': '0.410', 'WEAPON4': '0.800', 'WEAPON5': '0.800', 'weapon2': '0.832', 'WEAPON3': '1.000', 'weapon3': '2.252', 'HITCOUNT': '2.680', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '50.000'} [2024-08-06 08:28:56,205][52650] Updated weights for policy 0, policy_version 84491 (0.0019) [2024-08-06 08:28:57,714][52794] DAMAGECOUNT value on done: 979613.0 [2024-08-06 08:28:57,715][52794] Sum rewards: 75.788, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.039', 'AMMO5': '0.007', 'AMMO2': '0.027', 'AMMO4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.192', 'weapon2': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.452', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '62.000'} [2024-08-06 08:28:57,761][52663] DAMAGECOUNT value on done: 968097.0 [2024-08-06 08:28:57,763][52663] Sum rewards: 85.496, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.466', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.072', 'weapon5': '0.156', 'AMMO3': '0.203', 'AMMO4': '0.253', 'weapon2': '0.332', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.206', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '70.000'} [2024-08-06 08:28:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 692174848. Throughput: 0: 4355.5. Samples: 173052300. Policy #0 lag: (min: 0.0, avg: 3.4, max: 8.0) [2024-08-06 08:28:57,794][52567] Avg episode reward: [(0, '76.696')] [2024-08-06 08:28:59,012][52795] DAMAGECOUNT value on done: 905562.0 [2024-08-06 08:28:59,012][52795] Sum rewards: 80.962, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.189', 'weapon2': '0.486', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '64.000'} [2024-08-06 08:28:59,313][52647] DAMAGECOUNT value on done: 1045905.0 [2024-08-06 08:28:59,314][52647] Sum rewards: 66.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.741', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.082', 'weapon5': '0.186', 'weapon2': '0.218', 'AMMO4': '0.237', 'AMMO3': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.298', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '56.000'} [2024-08-06 08:28:59,431][52820] DAMAGECOUNT value on done: 919334.0 [2024-08-06 08:28:59,435][52820] Sum rewards: 75.501, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.480', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.033', 'WEAPON4': '0.050', 'weapon5': '0.122', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.816', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '62.000'} [2024-08-06 08:29:00,373][52663] DAMAGECOUNT value on done: 976098.0 [2024-08-06 08:29:00,375][52663] Sum rewards: 62.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.088', 'weapon4': '0.122', 'AMMO4': '0.164', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.764', 'WEAPON3': '1.050', 'weapon3': '2.858', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '15.363', 'FRAGCOUNT': '51.000'} [2024-08-06 08:29:00,426][52670] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:29:00,762][52794] DAMAGECOUNT value on done: 969211.0 [2024-08-06 08:29:00,762][52794] Sum rewards: 70.019, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.540', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.078', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.622', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '57.000'} [2024-08-06 08:29:00,914][52650] Updated weights for policy 0, policy_version 84501 (0.0038) [2024-08-06 08:29:02,165][52795] DAMAGECOUNT value on done: 912425.0 [2024-08-06 08:29:02,165][52795] Sum rewards: 78.385, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.105', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.144', 'AMMO3': '0.157', 'weapon5': '0.174', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.192', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '63.000'} [2024-08-06 08:29:02,167][52647] DAMAGECOUNT value on done: 1033334.0 [2024-08-06 08:29:02,168][52647] Sum rewards: 78.218, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.499', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.060', 'weapon5': '0.176', 'AMMO3': '0.200', 'AMMO4': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '64.000'} [2024-08-06 08:29:02,563][52820] DAMAGECOUNT value on done: 906189.0 [2024-08-06 08:29:02,565][52820] Sum rewards: 60.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.146', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON3': '1.200', 'HITCOUNT': '3.310', 'weapon3': '3.396', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '49.000'} [2024-08-06 08:29:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 692264960. Throughput: 0: 4357.3. Samples: 173065360. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:02,794][52567] Avg episode reward: [(0, '76.239')] [2024-08-06 08:29:03,276][52663] DAMAGECOUNT value on done: 977595.0 [2024-08-06 08:29:03,277][52663] Sum rewards: 70.386, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.176', 'AMMO3': '0.211', 'AMMO4': '0.213', 'weapon4': '0.220', 'weapon2': '0.392', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.201', 'FRAGCOUNT': '58.000'} [2024-08-06 08:29:03,947][52794] DAMAGECOUNT value on done: 984224.0 [2024-08-06 08:29:03,947][52794] Sum rewards: 65.481, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.449', 'AMMO5': '0.019', 'AMMO2': '0.039', 'weapon5': '0.162', 'weapon4': '0.186', 'AMMO4': '0.195', 'AMMO3': '0.199', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.606', 'WEAPON3': '1.300', 'weapon3': '2.730', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '53.000'} [2024-08-06 08:29:04,940][52647] DAMAGECOUNT value on done: 1038006.0 [2024-08-06 08:29:04,940][52647] Sum rewards: 74.601, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.012', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.128', 'weapon4': '0.168', 'AMMO3': '0.191', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.176', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.653', 'FRAGCOUNT': '64.000'} [2024-08-06 08:29:05,258][52795] DAMAGECOUNT value on done: 907477.0 [2024-08-06 08:29:05,261][52795] Sum rewards: 83.340, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.758', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.074', 'weapon2': '0.156', 'AMMO3': '0.241', 'WEAPON3': '1.500', 'weapon3': '3.536', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '71.000'} [2024-08-06 08:29:05,639][52650] Updated weights for policy 0, policy_version 84511 (0.0020) [2024-08-06 08:29:06,229][52663] DAMAGECOUNT value on done: 983712.0 [2024-08-06 08:29:06,229][52663] Sum rewards: 90.704, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.180', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon5': '0.100', 'weapon4': '0.104', 'AMMO3': '0.207', 'AMMO4': '0.225', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.916', 'FRAGCOUNT': '76.000'} [2024-08-06 08:29:06,923][52794] DAMAGECOUNT value on done: 979752.0 [2024-08-06 08:29:06,931][52794] Sum rewards: 81.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.180', 'weapon2': '0.422', 'WEAPON3': '1.250', 'weapon3': '3.326', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '66.000'} [2024-08-06 08:29:07,573][52647] DAMAGECOUNT value on done: 1034923.0 [2024-08-06 08:29:07,573][52647] Sum rewards: 72.860, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.355', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.154', 'weapon5': '0.182', 'AMMO3': '0.192', 'AMMO4': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.150', 'weapon3': '3.076', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.134', 'FRAGCOUNT': '60.000'} [2024-08-06 08:29:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 692346880. Throughput: 0: 4351.3. Samples: 173091480. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:07,795][52567] Avg episode reward: [(0, '76.171')] [2024-08-06 08:29:08,484][52795] DAMAGECOUNT value on done: 899887.0 [2024-08-06 08:29:08,484][52795] Sum rewards: 75.912, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.036', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.258', 'FRAGCOUNT': '64.000'} [2024-08-06 08:29:09,161][52663] DAMAGECOUNT value on done: 979664.0 [2024-08-06 08:29:09,163][52663] Sum rewards: 75.859, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.266', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.094', 'weapon4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.276', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '63.000'} [2024-08-06 08:29:09,874][52794] DAMAGECOUNT value on done: 969591.0 [2024-08-06 08:29:09,876][52794] Sum rewards: 68.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.155', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.222', 'weapon2': '0.334', 'WEAPON4': '0.350', 'weapon4': '0.412', 'WEAPON3': '1.400', 'weapon3': '2.990', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '57.000'} [2024-08-06 08:29:10,046][52650] Updated weights for policy 0, policy_version 84521 (0.0018) [2024-08-06 08:29:10,375][52647] DAMAGECOUNT value on done: 1045625.0 [2024-08-06 08:29:10,375][52647] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.444', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.256', 'WEAPON3': '1.450', 'weapon3': '3.424', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:10,610][52665] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:29:11,274][52670] DAMAGECOUNT value on done: 966612.0 [2024-08-06 08:29:11,276][52670] Sum rewards: 86.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.370', 'AMMO5': '0.008', 'weapon4': '0.026', 'AMMO2': '0.041', 'weapon5': '0.106', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '20.661', 'FRAGCOUNT': '69.000'} [2024-08-06 08:29:11,574][52795] DAMAGECOUNT value on done: 905006.0 [2024-08-06 08:29:11,576][52795] Sum rewards: 81.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.446', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.414', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.247', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:11,739][52663] DAMAGECOUNT value on done: 985825.0 [2024-08-06 08:29:11,739][52663] Sum rewards: 85.098, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.625', 'weapon4': '0.006', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.143', 'WEAPON5': '0.200', 'weapon2': '0.450', 'WEAPON3': '0.900', 'weapon3': '3.350', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:12,658][52794] DAMAGECOUNT value on done: 984896.0 [2024-08-06 08:29:12,660][52794] Sum rewards: 67.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.806', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.128', 'AMMO4': '0.167', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.150', 'weapon3': '3.018', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '54.000'} [2024-08-06 08:29:12,661][52647] DAMAGECOUNT value on done: 1041146.0 [2024-08-06 08:29:12,662][52647] Sum rewards: 79.720, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.120', 'weapon5': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.298', 'WEAPON3': '1.500', 'weapon3': '3.172', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '69.000'} [2024-08-06 08:29:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 692436992. Throughput: 0: 4355.1. Samples: 173117520. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:12,794][52567] Avg episode reward: [(0, '76.343')] [2024-08-06 08:29:14,476][52670] DAMAGECOUNT value on done: 987407.0 [2024-08-06 08:29:14,478][52670] Sum rewards: 89.155, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.410', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.113', 'weapon4': '0.124', 'weapon2': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.416', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '74.000'} [2024-08-06 08:29:14,651][52663] DAMAGECOUNT value on done: 992700.0 [2024-08-06 08:29:14,652][52663] Sum rewards: 70.735, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.819', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.048', 'weapon5': '0.052', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.137', 'WEAPON5': '0.150', 'weapon2': '0.688', 'WEAPON3': '0.900', 'weapon3': '3.012', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.083', 'FRAGCOUNT': '56.000'} [2024-08-06 08:29:14,757][52795] DAMAGECOUNT value on done: 910930.0 [2024-08-06 08:29:14,757][52795] Sum rewards: 83.745, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.132', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.279', 'weapon2': '0.496', 'WEAPON3': '1.700', 'weapon3': '3.202', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '72.000'} [2024-08-06 08:29:15,052][52650] Updated weights for policy 0, policy_version 84531 (0.0026) [2024-08-06 08:29:15,117][52647] DAMAGECOUNT value on done: 1043095.0 [2024-08-06 08:29:15,119][52647] Sum rewards: 76.157, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.338', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.082', 'weapon4': '0.160', 'AMMO3': '0.165', 'AMMO4': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.284', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '62.000'} [2024-08-06 08:29:15,143][52794] DAMAGECOUNT value on done: 979297.0 [2024-08-06 08:29:15,144][52794] Sum rewards: 59.660, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.602', 'AMMO5': '0.016', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.155', 'weapon5': '0.172', 'AMMO3': '0.240', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '2.800', 'weapon3': '3.278', 'DAMAGECOUNT': '15.666', 'FRAGCOUNT': '50.000'} [2024-08-06 08:29:17,544][52670] DAMAGECOUNT value on done: 968302.0 [2024-08-06 08:29:17,547][52670] Sum rewards: 82.983, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.550', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.030', 'AMMO4': '0.045', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.243', 'WEAPON3': '1.450', 'weapon3': '3.476', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '69.000'} [2024-08-06 08:29:17,582][52663] DAMAGECOUNT value on done: 971143.0 [2024-08-06 08:29:17,582][52663] Sum rewards: 73.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.194', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.042', 'AMMO4': '0.059', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.152', 'WEAPON5': '0.200', 'WEAPON3': '0.900', 'weapon2': '1.030', 'weapon3': '2.594', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '57.000'} [2024-08-06 08:29:17,795][52567] Fps is (10 sec: 17202.7, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 692518912. Throughput: 0: 4356.9. Samples: 173130520. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:17,795][52567] Avg episode reward: [(0, '76.410')] [2024-08-06 08:29:17,862][52794] DAMAGECOUNT value on done: 992546.0 [2024-08-06 08:29:17,863][52794] Sum rewards: 86.502, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.522', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.058', 'AMMO4': '0.098', 'weapon5': '0.142', 'weapon2': '0.180', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '72.000'} [2024-08-06 08:29:18,031][52795] DAMAGECOUNT value on done: 897200.0 [2024-08-06 08:29:18,032][52795] Sum rewards: 81.424, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.459', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.046', 'AMMO4': '0.113', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.000', 'weapon3': '3.370', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '66.000'} [2024-08-06 08:29:18,074][52647] DAMAGECOUNT value on done: 1019530.0 [2024-08-06 08:29:18,082][52647] Sum rewards: 76.746, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.926', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.024', 'AMMO4': '0.053', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.245', 'weapon2': '0.338', 'WEAPON3': '1.500', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '64.000'} [2024-08-06 08:29:18,992][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:29:19,412][52666] DAMAGECOUNT value on done: 979753.0 [2024-08-06 08:29:19,412][52666] Sum rewards: 81.593, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.180', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.038', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon2': '0.622', 'WEAPON3': '0.850', 'weapon3': '3.164', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:19,833][52650] Updated weights for policy 0, policy_version 84541 (0.0012) [2024-08-06 08:29:20,130][52670] DAMAGECOUNT value on done: 970148.0 [2024-08-06 08:29:20,131][52670] Sum rewards: 82.228, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.192', 'AMMO3': '0.194', 'AMMO4': '0.207', 'weapon4': '0.254', 'weapon2': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.986', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '67.000'} [2024-08-06 08:29:20,773][52820] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:29:21,090][52647] DAMAGECOUNT value on done: 1034990.0 [2024-08-06 08:29:21,091][52647] Sum rewards: 84.237, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.650', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.103', 'AMMO3': '0.214', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.432', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '70.000'} [2024-08-06 08:29:21,184][52795] DAMAGECOUNT value on done: 909110.0 [2024-08-06 08:29:21,186][52795] Sum rewards: 102.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.189', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.162', 'AMMO4': '0.175', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '23.229', 'FRAGCOUNT': '83.000'} [2024-08-06 08:29:21,189][52794] DAMAGECOUNT value on done: 974547.0 [2024-08-06 08:29:21,191][52794] Sum rewards: 83.545, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.814', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.082', 'weapon5': '0.144', 'AMMO4': '0.153', 'weapon2': '0.232', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.252', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.186', 'FRAGCOUNT': '69.000'} [2024-08-06 08:29:21,941][52666] DAMAGECOUNT value on done: 979181.0 [2024-08-06 08:29:21,943][52666] Sum rewards: 88.732, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.346', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.040', 'AMMO4': '0.059', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.197', 'weapon2': '0.770', 'WEAPON3': '1.250', 'weapon3': '3.008', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '72.000'} [2024-08-06 08:29:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 692609024. Throughput: 0: 4333.6. Samples: 173155930. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:22,794][52567] Avg episode reward: [(0, '77.248')] [2024-08-06 08:29:22,832][52670] DAMAGECOUNT value on done: 982157.0 [2024-08-06 08:29:22,832][52670] Sum rewards: 71.274, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.968', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.102', 'AMMO4': '0.118', 'weapon4': '0.176', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.200', 'HITCOUNT': '3.000', 'weapon3': '3.174', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '60.000'} [2024-08-06 08:29:23,512][52647] DAMAGECOUNT value on done: 1028512.0 [2024-08-06 08:29:23,512][52647] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.017', 'AMMO2': '0.038', 'AMMO4': '0.189', 'weapon5': '0.190', 'weapon4': '0.194', 'AMMO3': '0.218', 'weapon2': '0.294', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.970', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:24,226][52795] DAMAGECOUNT value on done: 906994.0 [2024-08-06 08:29:24,226][52795] Sum rewards: 66.416, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.765', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon5': '0.158', 'AMMO4': '0.181', 'weapon4': '0.190', 'AMMO3': '0.197', 'weapon2': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.170', 'weapon3': '3.200', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '54.000'} [2024-08-06 08:29:24,466][52794] DAMAGECOUNT value on done: 985748.0 [2024-08-06 08:29:24,468][52794] Sum rewards: 68.703, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.714', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.118', 'AMMO4': '0.141', 'weapon5': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'WEAPON4': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.036', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:24,487][52650] Updated weights for policy 0, policy_version 84551 (0.0011) [2024-08-06 08:29:24,748][52666] DAMAGECOUNT value on done: 984779.0 [2024-08-06 08:29:24,748][52666] Sum rewards: 81.454, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.865', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.140', 'weapon4': '0.170', 'AMMO3': '0.176', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.210', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '67.000'} [2024-08-06 08:29:25,669][52670] DAMAGECOUNT value on done: 971254.0 [2024-08-06 08:29:25,673][52670] Sum rewards: 81.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.146', 'AMMO5': '0.013', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.138', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.204', 'weapon4': '0.214', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.256', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:26,105][52647] DAMAGECOUNT value on done: 1030791.0 [2024-08-06 08:29:26,106][52647] Sum rewards: 84.606, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.775', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.136', 'weapon4': '0.160', 'AMMO3': '0.177', 'AMMO4': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.200', 'weapon3': '3.042', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '67.000'} [2024-08-06 08:29:27,136][52794] DAMAGECOUNT value on done: 980060.0 [2024-08-06 08:29:27,136][52794] Sum rewards: 68.321, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon4': '0.068', 'AMMO4': '0.158', 'AMMO3': '0.182', 'weapon5': '0.190', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.576', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.725', 'FRAGCOUNT': '56.000'} [2024-08-06 08:29:27,454][52795] DAMAGECOUNT value on done: 894962.0 [2024-08-06 08:29:27,462][52795] Sum rewards: 74.511, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.190', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.142', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'weapon2': '0.288', 'weapon4': '0.374', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.000'} [2024-08-06 08:29:27,794][52567] Fps is (10 sec: 17203.7, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 692690944. Throughput: 0: 4339.5. Samples: 173182270. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:27,795][52567] Avg episode reward: [(0, '77.107')] [2024-08-06 08:29:27,966][52666] DAMAGECOUNT value on done: 979775.0 [2024-08-06 08:29:27,966][52666] Sum rewards: 80.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.785', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.040', 'AMMO4': '0.122', 'weapon5': '0.134', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '66.000'} [2024-08-06 08:29:28,763][52670] DAMAGECOUNT value on done: 966850.0 [2024-08-06 08:29:28,764][52670] Sum rewards: 74.914, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.310', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.147', 'weapon5': '0.174', 'weapon2': '0.190', 'AMMO4': '0.195', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '0.900', 'weapon3': '3.250', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '59.000'} [2024-08-06 08:29:28,878][52647] DAMAGECOUNT value on done: 1028158.0 [2024-08-06 08:29:28,878][52647] Sum rewards: 81.607, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.844', 'AMMO5': '0.025', 'AMMO2': '0.042', 'weapon4': '0.080', 'AMMO3': '0.187', 'AMMO4': '0.210', 'weapon5': '0.292', 'WEAPON4': '0.400', 'weapon2': '0.496', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.844', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.715', 'FRAGCOUNT': '64.500'} [2024-08-06 08:29:29,017][52650] Updated weights for policy 0, policy_version 84561 (0.0014) [2024-08-06 08:29:29,701][52794] DAMAGECOUNT value on done: 989579.0 [2024-08-06 08:29:29,702][52794] Sum rewards: 87.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.032', 'AMMO4': '0.064', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.186', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.342', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.382', 'FRAGCOUNT': '70.000'} [2024-08-06 08:29:29,724][52668] DAMAGECOUNT value on done: 989852.0 [2024-08-06 08:29:29,726][52668] Sum rewards: 64.399, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.320', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.160', 'AMMO3': '0.204', 'AMMO4': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.156', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.677', 'FRAGCOUNT': '53.500'} [2024-08-06 08:29:30,277][52670] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:29:30,596][52795] DAMAGECOUNT value on done: 903809.0 [2024-08-06 08:29:30,596][52795] Sum rewards: 82.233, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.651', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.174', 'AMMO4': '0.199', 'AMMO3': '0.220', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:30,607][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:29:30,982][52811] DAMAGECOUNT value on done: 928326.0 [2024-08-06 08:29:30,984][52811] Sum rewards: 68.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.615', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.124', 'weapon4': '0.174', 'AMMO4': '0.206', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.044', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '58.000'} [2024-08-06 08:29:30,993][52666] DAMAGECOUNT value on done: 972912.0 [2024-08-06 08:29:30,994][52666] Sum rewards: 86.439, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.025', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.036', 'weapon5': '0.064', 'AMMO4': '0.133', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '71.000'} [2024-08-06 08:29:31,739][52647] DAMAGECOUNT value on done: 1034826.0 [2024-08-06 08:29:31,739][52647] Sum rewards: 71.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.164', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'weapon5': '0.298', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '2.748', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '58.000'} [2024-08-06 08:29:32,030][52670] DAMAGECOUNT value on done: 969458.0 [2024-08-06 08:29:32,030][52670] Sum rewards: 72.841, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.688', 'AMMO5': '0.026', 'AMMO2': '0.058', 'weapon4': '0.082', 'weapon5': '0.192', 'AMMO3': '0.204', 'AMMO4': '0.292', 'WEAPON4': '0.500', 'weapon2': '0.546', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.884', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '62.500'} [2024-08-06 08:29:32,444][52794] DAMAGECOUNT value on done: 994304.0 [2024-08-06 08:29:32,445][52794] Sum rewards: 69.567, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.900', 'AMMO5': '0.021', 'AMMO2': '0.065', 'weapon4': '0.178', 'AMMO3': '0.186', 'weapon5': '0.264', 'weapon2': '0.316', 'AMMO4': '0.323', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '58.000'} [2024-08-06 08:29:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 692781056. Throughput: 0: 4344.0. Samples: 173195510. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:32,794][52567] Avg episode reward: [(0, '76.874')] [2024-08-06 08:29:32,826][52668] DAMAGECOUNT value on done: 988397.0 [2024-08-06 08:29:32,827][52668] Sum rewards: 74.444, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.590', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.080', 'weapon4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:33,676][52795] DAMAGECOUNT value on done: 913127.0 [2024-08-06 08:29:33,676][52795] Sum rewards: 82.665, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.050', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.116', 'AMMO3': '0.207', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.356', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:33,903][52811] DAMAGECOUNT value on done: 913548.0 [2024-08-06 08:29:33,904][52811] Sum rewards: 74.152, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.106', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.044', 'AMMO4': '0.148', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.650', 'WEAPON3': '1.050', 'weapon3': '3.108', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '62.000'} [2024-08-06 08:29:33,991][52650] Updated weights for policy 0, policy_version 84571 (0.0010) [2024-08-06 08:29:34,050][52666] DAMAGECOUNT value on done: 974949.0 [2024-08-06 08:29:34,050][52666] Sum rewards: 73.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO2': '0.013', 'AMMO4': '0.064', 'AMMO3': '0.201', 'weapon2': '0.800', 'WEAPON3': '1.300', 'weapon3': '3.108', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '60.000'} [2024-08-06 08:29:34,248][52647] DAMAGECOUNT value on done: 1029043.0 [2024-08-06 08:29:34,249][52647] Sum rewards: 83.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.945', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon5': '0.104', 'AMMO4': '0.121', 'weapon4': '0.158', 'AMMO3': '0.206', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.294', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:34,697][52614] Signal inference workers to stop experience collection... (15500 times) [2024-08-06 08:29:34,698][52614] Signal inference workers to resume experience collection... (15500 times) [2024-08-06 08:29:34,758][52650] InferenceWorker_p0-w0: stopping experience collection (15500 times) [2024-08-06 08:29:34,758][52650] InferenceWorker_p0-w0: resuming experience collection (15500 times) [2024-08-06 08:29:34,766][52670] DAMAGECOUNT value on done: 968746.0 [2024-08-06 08:29:34,767][52670] Sum rewards: 71.167, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.054', 'weapon4': '0.084', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.276', 'WEAPON3': '1.250', 'HITCOUNT': '3.230', 'weapon3': '3.358', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '59.000'} [2024-08-06 08:29:35,319][52794] DAMAGECOUNT value on done: 983552.0 [2024-08-06 08:29:35,319][52794] Sum rewards: 75.526, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.903', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.066', 'AMMO4': '0.068', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'weapon2': '0.336', 'WEAPON3': '1.600', 'weapon3': '3.238', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '66.000'} [2024-08-06 08:29:35,485][52668] DAMAGECOUNT value on done: 984801.0 [2024-08-06 08:29:35,485][52668] Sum rewards: 74.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.241', 'AMMO2': '0.013', 'AMMO5': '0.017', 'weapon4': '0.044', 'AMMO4': '0.064', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.350', 'weapon2': '0.436', 'WEAPON3': '1.250', 'weapon3': '3.170', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '60.000'} [2024-08-06 08:29:36,677][52666] DAMAGECOUNT value on done: 975752.0 [2024-08-06 08:29:36,679][52666] Sum rewards: 79.662, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.720', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.046', 'AMMO4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'weapon4': '0.160', 'weapon2': '0.382', 'WEAPON3': '1.050', 'weapon3': '3.284', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '63.000'} [2024-08-06 08:29:36,853][52647] DAMAGECOUNT value on done: 1036254.0 [2024-08-06 08:29:36,853][52647] Sum rewards: 84.343, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.765', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.112', 'weapon5': '0.112', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.247', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '71.000'} [2024-08-06 08:29:36,958][52811] DAMAGECOUNT value on done: 908144.0 [2024-08-06 08:29:36,959][52811] Sum rewards: 77.642, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.035', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.362', 'WEAPON3': '1.450', 'weapon3': '3.292', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '66.000'} [2024-08-06 08:29:37,609][52670] DAMAGECOUNT value on done: 968215.0 [2024-08-06 08:29:37,610][52670] Sum rewards: 79.924, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.555', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.030', 'AMMO4': '0.054', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.324', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '67.000'} [2024-08-06 08:29:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 692871168. Throughput: 0: 4345.8. Samples: 173221670. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:37,794][52567] Avg episode reward: [(0, '77.119')] [2024-08-06 08:29:38,515][52650] Updated weights for policy 0, policy_version 84581 (0.0010) [2024-08-06 08:29:38,898][52668] DAMAGECOUNT value on done: 990068.0 [2024-08-06 08:29:38,899][52668] Sum rewards: 68.552, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon5': '0.184', 'weapon2': '0.228', 'AMMO3': '0.240', 'AMMO4': '0.315', 'weapon4': '0.334', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.988', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '57.000'} [2024-08-06 08:29:39,198][52665] DAMAGECOUNT value on done: 968971.0 [2024-08-06 08:29:39,198][52665] Sum rewards: 69.170, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.450', 'AMMO5': '0.015', 'AMMO2': '0.052', 'weapon5': '0.124', 'AMMO3': '0.153', 'weapon4': '0.174', 'AMMO4': '0.261', 'WEAPON5': '0.350', 'weapon2': '0.378', 'WEAPON4': '0.500', 'WEAPON3': '0.850', 'HITCOUNT': '3.100', 'weapon3': '3.118', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 08:29:39,534][52647] DAMAGECOUNT value on done: 1036743.0 [2024-08-06 08:29:39,535][52647] Sum rewards: 64.277, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.316', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.120', 'AMMO3': '0.143', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.780', 'WEAPON3': '0.850', 'weapon3': '2.868', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.881', 'FRAGCOUNT': '48.000'} [2024-08-06 08:29:39,821][52666] DAMAGECOUNT value on done: 969637.0 [2024-08-06 08:29:39,824][52666] Sum rewards: 78.803, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.745', 'AMMO5': '0.016', 'AMMO2': '0.058', 'weapon4': '0.146', 'AMMO3': '0.229', 'weapon5': '0.260', 'AMMO4': '0.292', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.950', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '64.000'} [2024-08-06 08:29:40,044][52811] DAMAGECOUNT value on done: 913993.0 [2024-08-06 08:29:40,046][52811] Sum rewards: 74.068, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.343', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon5': '0.038', 'weapon4': '0.058', 'AMMO4': '0.189', 'AMMO3': '0.215', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.644', 'WEAPON3': '1.250', 'weapon3': '3.002', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:40,814][52670] DAMAGECOUNT value on done: 983868.0 [2024-08-06 08:29:40,818][52670] Sum rewards: 89.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.684', 'AMMO5': '0.019', 'AMMO2': '0.035', 'weapon5': '0.108', 'weapon4': '0.110', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.718', 'FRAGCOUNT': '74.000'} [2024-08-06 08:29:41,555][52668] DAMAGECOUNT value on done: 975953.0 [2024-08-06 08:29:41,557][52668] Sum rewards: 93.821, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.024', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon4': '0.136', 'weapon5': '0.194', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'weapon2': '0.240', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.160', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '22.821', 'FRAGCOUNT': '77.000'} [2024-08-06 08:29:42,084][52647] DAMAGECOUNT value on done: 1023158.0 [2024-08-06 08:29:42,084][52647] Sum rewards: 85.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.818', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO3': '0.186', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.835', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:42,254][52665] DAMAGECOUNT value on done: 980959.0 [2024-08-06 08:29:42,257][52665] Sum rewards: 79.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.760', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.088', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'weapon2': '0.300', 'weapon4': '0.426', 'WEAPON3': '1.300', 'weapon3': '2.960', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.057', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 692961280. Throughput: 0: 4342.2. Samples: 173247700. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:42,794][52567] Avg episode reward: [(0, '77.311')] [2024-08-06 08:29:43,067][52666] DAMAGECOUNT value on done: 983352.0 [2024-08-06 08:29:43,070][52666] Sum rewards: 76.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.660', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.186', 'weapon4': '0.210', 'weapon5': '0.250', 'AMMO4': '0.253', 'weapon2': '0.384', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '64.000'} [2024-08-06 08:29:43,169][52650] Updated weights for policy 0, policy_version 84591 (0.0020) [2024-08-06 08:29:43,267][52811] DAMAGECOUNT value on done: 917238.0 [2024-08-06 08:29:43,269][52811] Sum rewards: 80.541, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.512', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.114', 'weapon5': '0.128', 'AMMO4': '0.165', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.300', 'weapon3': '3.084', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '66.000'} [2024-08-06 08:29:44,052][52670] DAMAGECOUNT value on done: 963818.0 [2024-08-06 08:29:44,061][52670] Sum rewards: 74.436, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.319', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon2': '0.140', 'weapon5': '0.176', 'AMMO4': '0.177', 'AMMO3': '0.186', 'weapon4': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.196', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:44,456][52668] DAMAGECOUNT value on done: 988583.0 [2024-08-06 08:29:44,456][52668] Sum rewards: 81.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.428', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.160', 'weapon4': '0.178', 'AMMO4': '0.184', 'weapon2': '0.242', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '21.240', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:44,725][52647] DAMAGECOUNT value on done: 1032785.0 [2024-08-06 08:29:44,725][52647] Sum rewards: 95.817, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.894', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.079', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.179', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.398', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '21.354', 'FRAGCOUNT': '77.000'} [2024-08-06 08:29:45,147][52665] DAMAGECOUNT value on done: 975006.0 [2024-08-06 08:29:45,147][52665] Sum rewards: 68.802, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.810', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'weapon2': '0.274', 'weapon4': '0.290', 'AMMO3': '0.291', 'WEAPON3': '1.800', 'weapon3': '3.156', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '60.000'} [2024-08-06 08:29:45,826][52666] DAMAGECOUNT value on done: 972129.0 [2024-08-06 08:29:45,826][52666] Sum rewards: 74.148, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.796', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon4': '0.238', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.030', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '62.000'} [2024-08-06 08:29:46,410][52811] DAMAGECOUNT value on done: 934547.0 [2024-08-06 08:29:46,410][52811] Sum rewards: 79.542, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'weapon2': '0.204', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.464', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:46,515][52670] DAMAGECOUNT value on done: 977679.0 [2024-08-06 08:29:46,516][52670] Sum rewards: 72.301, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.260', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.094', 'AMMO4': '0.170', 'weapon5': '0.220', 'AMMO3': '0.263', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.136', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:47,253][52668] DAMAGECOUNT value on done: 987243.0 [2024-08-06 08:29:47,255][52668] Sum rewards: 78.627, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.092', 'weapon4': '0.124', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.310', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '62.000'} [2024-08-06 08:29:47,278][52647] DAMAGECOUNT value on done: 1023871.0 [2024-08-06 08:29:47,279][52647] Sum rewards: 79.018, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.200', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.055', 'weapon4': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.368', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:47,795][52567] Fps is (10 sec: 17202.4, 60 sec: 17339.6, 300 sec: 17411.4). Total num frames: 693043200. Throughput: 0: 4345.5. Samples: 173260910. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:47,795][52567] Avg episode reward: [(0, '77.398')] [2024-08-06 08:29:47,865][52650] Updated weights for policy 0, policy_version 84601 (0.0014) [2024-08-06 08:29:48,178][52665] DAMAGECOUNT value on done: 977367.0 [2024-08-06 08:29:48,178][52665] Sum rewards: 73.877, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.500', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.056', 'AMMO3': '0.169', 'weapon2': '0.470', 'WEAPON3': '1.000', 'weapon3': '3.292', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.003', 'FRAGCOUNT': '59.000'} [2024-08-06 08:29:48,496][52666] DAMAGECOUNT value on done: 977418.0 [2024-08-06 08:29:48,496][52666] Sum rewards: 88.953, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.206', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.026', 'weapon5': '0.046', 'AMMO4': '0.081', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.718', 'FRAGCOUNT': '74.000'} [2024-08-06 08:29:49,207][52670] DAMAGECOUNT value on done: 981945.0 [2024-08-06 08:29:49,216][52670] Sum rewards: 71.075, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.335', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.140', 'weapon2': '0.188', 'AMMO3': '0.214', 'WEAPON3': '1.350', 'weapon3': '3.460', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '59.000'} [2024-08-06 08:29:49,633][52811] DAMAGECOUNT value on done: 923890.0 [2024-08-06 08:29:49,635][52811] Sum rewards: 67.897, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.477', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon2': '0.156', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'weapon4': '0.484', 'WEAPON3': '1.000', 'weapon3': '3.024', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.351', 'FRAGCOUNT': '55.000'} [2024-08-06 08:29:49,657][52647] DAMAGECOUNT value on done: 1026881.0 [2024-08-06 08:29:49,658][52647] Sum rewards: 63.441, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.025', 'AMMO5': '0.006', 'weapon4': '0.036', 'AMMO2': '0.037', 'weapon5': '0.108', 'AMMO4': '0.183', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.200', 'HITCOUNT': '3.080', 'weapon3': '3.304', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '53.000'} [2024-08-06 08:29:49,821][52668] DAMAGECOUNT value on done: 977494.0 [2024-08-06 08:29:49,822][52668] Sum rewards: 76.377, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.397', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.175', 'weapon5': '0.188', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.452', 'WEAPON3': '1.150', 'weapon3': '2.712', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.693', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:51,199][52665] DAMAGECOUNT value on done: 958362.0 [2024-08-06 08:29:51,199][52665] Sum rewards: 72.188, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.918', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.132', 'AMMO3': '0.152', 'AMMO4': '0.175', 'weapon4': '0.184', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.846', 'WEAPON3': '0.900', 'weapon3': '2.618', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '57.000'} [2024-08-06 08:29:51,268][52666] DAMAGECOUNT value on done: 962391.0 [2024-08-06 08:29:51,271][52666] Sum rewards: 73.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.505', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO4': '0.165', 'weapon5': '0.176', 'AMMO3': '0.178', 'weapon2': '0.352', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.842', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '59.000'} [2024-08-06 08:29:52,133][52670] DAMAGECOUNT value on done: 974980.0 [2024-08-06 08:29:52,133][52670] Sum rewards: 74.956, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.288', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.176', 'weapon5': '0.176', 'AMMO3': '0.200', 'AMMO4': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.106', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:52,391][52668] DAMAGECOUNT value on done: 980116.0 [2024-08-06 08:29:52,392][52668] Sum rewards: 71.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.460', 'AMMO5': '0.004', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.122', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'weapon2': '0.372', 'WEAPON3': '1.600', 'weapon3': '3.296', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:52,663][52650] Updated weights for policy 0, policy_version 84611 (0.0012) [2024-08-06 08:29:52,699][52811] DAMAGECOUNT value on done: 912392.0 [2024-08-06 08:29:52,701][52811] Sum rewards: 79.513, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.972', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.225', 'weapon2': '0.402', 'WEAPON3': '1.500', 'weapon3': '3.362', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 693133312. Throughput: 0: 4345.8. Samples: 173287040. Policy #0 lag: (min: 0.0, avg: 3.3, max: 7.0) [2024-08-06 08:29:52,794][52567] Avg episode reward: [(0, '77.102')] [2024-08-06 08:29:53,101][52667] DAMAGECOUNT value on done: 980442.0 [2024-08-06 08:29:53,104][52667] Sum rewards: 75.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.442', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.034', 'AMMO4': '0.096', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '62.000'} [2024-08-06 08:29:53,623][52663] Large shaping reward 2.528 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.47700000000000004, 159.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:29:53,662][52665] DAMAGECOUNT value on done: 960797.0 [2024-08-06 08:29:53,665][52665] Sum rewards: 77.781, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.248', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.166', 'weapon4': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.218', 'WEAPON3': '1.100', 'HITCOUNT': '3.210', 'weapon3': '3.298', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '63.000'} [2024-08-06 08:29:54,402][52666] DAMAGECOUNT value on done: 986676.0 [2024-08-06 08:29:54,402][52666] Sum rewards: 72.282, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.540', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.144', 'AMMO4': '0.186', 'AMMO3': '0.248', 'weapon4': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '61.000'} [2024-08-06 08:29:54,773][52669] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:29:55,228][52670] DAMAGECOUNT value on done: 960599.0 [2024-08-06 08:29:55,228][52670] Sum rewards: 76.760, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.002', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.186', 'weapon5': '0.216', 'AMMO3': '0.232', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:55,664][52668] DAMAGECOUNT value on done: 988403.0 [2024-08-06 08:29:55,665][52668] Sum rewards: 67.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.379', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.154', 'weapon5': '0.182', 'AMMO4': '0.185', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '56.000'} [2024-08-06 08:29:55,766][52811] DAMAGECOUNT value on done: 919272.0 [2024-08-06 08:29:55,767][52811] Sum rewards: 87.372, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'weapon4': '0.036', 'AMMO2': '0.040', 'weapon5': '0.116', 'WEAPON4': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.207', 'weapon2': '0.252', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.574', 'FRAGCOUNT': '71.000'} [2024-08-06 08:29:56,474][52667] DAMAGECOUNT value on done: 998368.0 [2024-08-06 08:29:56,474][52667] Sum rewards: 84.725, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.615', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'weapon4': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.240', 'WEAPON3': '1.200', 'weapon3': '3.386', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '68.000'} [2024-08-06 08:29:56,608][52665] DAMAGECOUNT value on done: 972577.0 [2024-08-06 08:29:56,610][52665] Sum rewards: 71.026, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.110', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.068', 'weapon5': '0.140', 'AMMO3': '0.145', 'AMMO4': '0.146', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '0.850', 'weapon3': '3.034', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.137', 'FRAGCOUNT': '55.000'} [2024-08-06 08:29:57,154][52650] Updated weights for policy 0, policy_version 84621 (0.0022) [2024-08-06 08:29:57,646][52666] DAMAGECOUNT value on done: 980790.0 [2024-08-06 08:29:57,648][52666] Sum rewards: 77.067, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.260', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.132', 'AMMO4': '0.218', 'AMMO3': '0.236', 'weapon5': '0.244', 'weapon2': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.020', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '65.000'} [2024-08-06 08:29:57,794][52567] Fps is (10 sec: 18023.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 693223424. Throughput: 0: 4354.4. Samples: 173313470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:29:57,794][52567] Avg episode reward: [(0, '77.573')] [2024-08-06 08:29:58,438][52670] DAMAGECOUNT value on done: 974392.0 [2024-08-06 08:29:58,439][52670] Sum rewards: 68.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.039', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.226', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.362', 'WEAPON3': '1.500', 'weapon3': '3.220', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '57.000'} [2024-08-06 08:29:58,832][52668] DAMAGECOUNT value on done: 982769.0 [2024-08-06 08:29:58,834][52668] Sum rewards: 69.506, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.091', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.072', 'weapon5': '0.174', 'AMMO4': '0.211', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.350', 'weapon3': '2.996', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '59.000'} [2024-08-06 08:29:58,950][52811] DAMAGECOUNT value on done: 919192.0 [2024-08-06 08:29:58,952][52811] Sum rewards: 73.939, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.347', 'AMMO5': '0.009', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon2': '0.132', 'weapon5': '0.142', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.500', 'WEAPON3': '1.100', 'weapon3': '3.024', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 08:29:59,059][52665] DAMAGECOUNT value on done: 972759.0 [2024-08-06 08:29:59,061][52665] Sum rewards: 82.124, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.890', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.080', 'weapon4': '0.082', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.298', 'weapon2': '0.444', 'WEAPON3': '1.800', 'weapon3': '3.130', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '71.000'} [2024-08-06 08:29:59,345][52667] DAMAGECOUNT value on done: 991821.0 [2024-08-06 08:29:59,345][52667] Sum rewards: 81.124, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.103', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.118', 'weapon2': '0.208', 'AMMO4': '0.214', 'weapon5': '0.226', 'AMMO3': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.128', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '70.000'} [2024-08-06 08:30:00,719][52666] DAMAGECOUNT value on done: 980262.0 [2024-08-06 08:30:00,720][52666] Sum rewards: 76.000, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.997', 'AMMO5': '0.025', 'AMMO2': '0.050', 'AMMO3': '0.215', 'weapon4': '0.220', 'weapon2': '0.248', 'AMMO4': '0.250', 'weapon5': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.834', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:01,560][52670] DAMAGECOUNT value on done: 983114.0 [2024-08-06 08:30:01,561][52670] Sum rewards: 78.714, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.304', 'AMMO5': '0.015', 'AMMO2': '0.016', 'weapon5': '0.078', 'AMMO4': '0.081', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.324', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '3.004', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.500'} [2024-08-06 08:30:01,719][52668] DAMAGECOUNT value on done: 980711.0 [2024-08-06 08:30:01,719][52668] Sum rewards: 84.985, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.238', 'AMMO4': '-0.016', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.068', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.632', 'WEAPON3': '1.000', 'weapon3': '3.130', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.801', 'FRAGCOUNT': '68.000'} [2024-08-06 08:30:01,882][52665] DAMAGECOUNT value on done: 977953.0 [2024-08-06 08:30:01,883][52665] Sum rewards: 79.895, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.169', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.114', 'AMMO3': '0.200', 'weapon5': '0.204', 'weapon2': '0.218', 'AMMO4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:02,010][52811] DAMAGECOUNT value on done: 922464.0 [2024-08-06 08:30:02,011][52811] Sum rewards: 73.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.764', 'AMMO5': '0.017', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.078', 'AMMO4': '0.123', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.400', 'weapon2': '0.596', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:02,202][52650] Updated weights for policy 0, policy_version 84631 (0.0011) [2024-08-06 08:30:02,346][52649] DAMAGECOUNT value on done: 952363.0 [2024-08-06 08:30:02,347][52649] Sum rewards: 79.502, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.590', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.114', 'weapon5': '0.126', 'AMMO4': '0.133', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:02,493][52667] DAMAGECOUNT value on done: 996654.0 [2024-08-06 08:30:02,495][52667] Sum rewards: 75.862, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.502', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO4': '0.172', 'AMMO3': '0.195', 'weapon5': '0.244', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.124', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 693305344. Throughput: 0: 4354.5. Samples: 173326470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:02,794][52567] Avg episode reward: [(0, '77.363')] [2024-08-06 08:30:03,268][52662] DAMAGECOUNT value on done: 982726.0 [2024-08-06 08:30:03,270][52662] Sum rewards: 68.597, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'AMMO5': '0.013', 'AMMO2': '0.059', 'AMMO3': '0.187', 'weapon2': '0.206', 'weapon5': '0.244', 'AMMO4': '0.294', 'weapon4': '0.302', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '2.920', 'weapon3': '3.008', 'DAMAGECOUNT': '16.323', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:03,955][52666] DAMAGECOUNT value on done: 971303.0 [2024-08-06 08:30:03,955][52666] Sum rewards: 69.764, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.097', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.184', 'AMMO3': '0.223', 'AMMO4': '0.278', 'weapon5': '0.278', 'weapon2': '0.312', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.898', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:04,205][52670] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:30:04,427][52665] DAMAGECOUNT value on done: 969254.0 [2024-08-06 08:30:04,427][52665] Sum rewards: 76.936, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.675', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.046', 'weapon5': '0.130', 'AMMO4': '0.145', 'weapon2': '0.212', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.396', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:04,434][52668] DAMAGECOUNT value on done: 973450.0 [2024-08-06 08:30:04,434][52668] Sum rewards: 83.106, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.470', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.057', 'weapon5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.202', 'weapon4': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.329', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:04,578][52670] DAMAGECOUNT value on done: 977136.0 [2024-08-06 08:30:04,578][52670] Sum rewards: 75.123, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.190', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon5': '0.182', 'AMMO3': '0.213', 'weapon2': '0.250', 'AMMO4': '0.255', 'weapon4': '0.342', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.910', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.756', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:04,946][52649] DAMAGECOUNT value on done: 947515.0 [2024-08-06 08:30:04,946][52649] Sum rewards: 67.116, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.072', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.180', 'WEAPON5': '0.250', 'AMMO3': '0.277', 'WEAPON4': '0.350', 'weapon4': '0.390', 'weapon2': '0.564', 'WEAPON3': '1.550', 'weapon3': '2.548', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.821', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:05,210][52667] DAMAGECOUNT value on done: 998721.0 [2024-08-06 08:30:05,212][52667] Sum rewards: 86.429, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO5': '0.021', 'AMMO2': '0.069', 'AMMO3': '0.208', 'weapon4': '0.268', 'weapon5': '0.342', 'AMMO4': '0.346', 'weapon2': '0.354', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.750', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '68.000'} [2024-08-06 08:30:05,224][52811] DAMAGECOUNT value on done: 929345.0 [2024-08-06 08:30:05,224][52811] Sum rewards: 63.769, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.183', 'AMMO5': '0.015', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon4': '0.172', 'weapon5': '0.182', 'AMMO3': '0.221', 'weapon2': '0.342', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.161', 'FRAGCOUNT': '53.000'} [2024-08-06 08:30:06,319][52662] DAMAGECOUNT value on done: 992247.0 [2024-08-06 08:30:06,319][52662] Sum rewards: 76.001, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.142', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon4': '0.090', 'AMMO4': '0.158', 'weapon5': '0.238', 'AMMO3': '0.240', 'weapon2': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:06,451][52650] Updated weights for policy 0, policy_version 84641 (0.0030) [2024-08-06 08:30:06,857][52665] DAMAGECOUNT value on done: 984525.0 [2024-08-06 08:30:06,858][52665] Sum rewards: 74.914, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.285', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.294', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.446', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:06,990][52666] DAMAGECOUNT value on done: 969554.0 [2024-08-06 08:30:06,990][52666] Sum rewards: 74.048, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.551', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.060', 'AMMO4': '0.175', 'weapon5': '0.182', 'weapon2': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:07,365][52649] DAMAGECOUNT value on done: 963083.0 [2024-08-06 08:30:07,366][52649] Sum rewards: 65.173, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.580', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.146', 'weapon2': '0.194', 'AMMO4': '0.213', 'AMMO3': '0.228', 'weapon5': '0.284', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.970', 'weapon3': '3.130', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '55.000'} [2024-08-06 08:30:07,580][52668] DAMAGECOUNT value on done: 973475.0 [2024-08-06 08:30:07,580][52668] Sum rewards: 73.863, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.800', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.164', 'AMMO4': '0.167', 'AMMO3': '0.185', 'weapon5': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '57.500'} [2024-08-06 08:30:07,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 693395456. Throughput: 0: 4370.9. Samples: 173352620. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:07,794][52567] Avg episode reward: [(0, '76.628')] [2024-08-06 08:30:07,920][52670] DAMAGECOUNT value on done: 977101.0 [2024-08-06 08:30:07,920][52670] Sum rewards: 70.772, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.970', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.072', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.294', 'WEAPON3': '1.850', 'weapon3': '3.416', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.907', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:08,078][52667] DAMAGECOUNT value on done: 994114.0 [2024-08-06 08:30:08,080][52667] Sum rewards: 66.592, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.021', 'AMMO2': '0.071', 'weapon5': '0.172', 'AMMO3': '0.190', 'weapon4': '0.202', 'AMMO4': '0.357', 'weapon2': '0.448', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '56.000'} [2024-08-06 08:30:08,304][52811] DAMAGECOUNT value on done: 921864.0 [2024-08-06 08:30:08,307][52811] Sum rewards: 77.465, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.760', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon5': '0.128', 'AMMO4': '0.181', 'AMMO3': '0.230', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.364', 'weapon4': '0.366', 'WEAPON3': '1.450', 'weapon3': '2.884', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:08,999][52662] DAMAGECOUNT value on done: 991966.0 [2024-08-06 08:30:08,999][52662] Sum rewards: 68.417, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.727', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.014', 'AMMO4': '0.058', 'weapon5': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.528', 'WEAPON3': '1.200', 'HITCOUNT': '3.230', 'weapon3': '3.250', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '56.000'} [2024-08-06 08:30:09,727][52665] DAMAGECOUNT value on done: 977744.0 [2024-08-06 08:30:09,729][52665] Sum rewards: 69.964, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.868', 'AMMO5': '0.028', 'AMMO2': '0.092', 'weapon4': '0.120', 'AMMO3': '0.221', 'weapon5': '0.222', 'AMMO4': '0.458', 'weapon2': '0.470', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.858', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:10,284][52666] DAMAGECOUNT value on done: 990264.0 [2024-08-06 08:30:10,285][52666] Sum rewards: 72.282, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.540', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.048', 'AMMO4': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.276', 'WEAPON3': '1.600', 'weapon3': '3.426', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:10,331][52649] DAMAGECOUNT value on done: 965303.0 [2024-08-06 08:30:10,333][52649] Sum rewards: 75.808, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.110', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.070', 'AMMO4': '0.077', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.494', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:10,543][52668] DAMAGECOUNT value on done: 964075.0 [2024-08-06 08:30:10,545][52668] Sum rewards: 65.183, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.360', 'AMMO5': '0.024', 'AMMO2': '0.079', 'AMMO3': '0.201', 'weapon5': '0.218', 'weapon4': '0.360', 'AMMO4': '0.395', 'weapon2': '0.530', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.566', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '54.500'} [2024-08-06 08:30:10,850][52667] DAMAGECOUNT value on done: 989376.0 [2024-08-06 08:30:10,855][52667] Sum rewards: 81.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.150', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.160', 'AMMO4': '0.175', 'AMMO3': '0.238', 'weapon2': '0.366', 'weapon4': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '2.842', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '21.108', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:11,254][52811] DAMAGECOUNT value on done: 918865.0 [2024-08-06 08:30:11,254][52811] Sum rewards: 78.081, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.448', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.082', 'AMMO4': '0.155', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:11,416][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:30:11,596][52650] Updated weights for policy 0, policy_version 84651 (0.0015) [2024-08-06 08:30:11,698][52662] DAMAGECOUNT value on done: 983857.0 [2024-08-06 08:30:11,700][52662] Sum rewards: 88.108, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.092', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.046', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.230', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '72.000'} [2024-08-06 08:30:11,970][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:30:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 693485568. Throughput: 0: 4369.3. Samples: 173378890. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:12,794][52567] Avg episode reward: [(0, '76.058')] [2024-08-06 08:30:12,931][52665] DAMAGECOUNT value on done: 974180.0 [2024-08-06 08:30:12,932][52665] Sum rewards: 85.278, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.060', 'weapon4': '0.076', 'AMMO3': '0.163', 'AMMO4': '0.175', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.336', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:13,316][52668] DAMAGECOUNT value on done: 981026.0 [2024-08-06 08:30:13,317][52668] Sum rewards: 70.835, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.345', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.162', 'weapon5': '0.182', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.050', 'weapon3': '2.996', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:13,442][52666] DAMAGECOUNT value on done: 963008.0 [2024-08-06 08:30:13,444][52666] Sum rewards: 63.575, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.050', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.032', 'AMMO4': '0.076', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'WEAPON4': '0.150', 'weapon4': '0.332', 'weapon2': '0.692', 'WEAPON3': '0.900', 'weapon3': '2.704', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.405', 'FRAGCOUNT': '50.000'} [2024-08-06 08:30:13,561][52659] DAMAGECOUNT value on done: 986011.0 [2024-08-06 08:30:13,564][52659] Sum rewards: 81.956, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.316', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.138', 'weapon2': '0.190', 'AMMO4': '0.202', 'AMMO3': '0.207', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:13,619][52649] DAMAGECOUNT value on done: 955784.0 [2024-08-06 08:30:13,620][52649] Sum rewards: 87.634, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.725', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.126', 'AMMO3': '0.213', 'weapon4': '0.226', 'weapon2': '0.232', 'AMMO4': '0.288', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '74.000'} [2024-08-06 08:30:13,823][52667] DAMAGECOUNT value on done: 986087.0 [2024-08-06 08:30:13,823][52667] Sum rewards: 83.961, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.425', 'AMMO5': '0.003', 'AMMO2': '0.030', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.150', 'AMMO3': '0.166', 'WEAPON4': '0.250', 'weapon2': '0.302', 'weapon4': '0.422', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '66.000'} [2024-08-06 08:30:14,254][52811] DAMAGECOUNT value on done: 920034.0 [2024-08-06 08:30:14,254][52811] Sum rewards: 79.672, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.780', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.020', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'weapon4': '0.152', 'AMMO3': '0.237', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.356', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:14,668][52662] DAMAGECOUNT value on done: 997269.0 [2024-08-06 08:30:14,670][52662] Sum rewards: 70.130, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.515', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.604', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.473', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:15,491][52647] Large shaping reward 2.544 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 08:30:15,872][52650] Updated weights for policy 0, policy_version 84661 (0.0037) [2024-08-06 08:30:15,902][52668] DAMAGECOUNT value on done: 982804.0 [2024-08-06 08:30:15,902][52668] Sum rewards: 68.864, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.188', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.118', 'AMMO3': '0.147', 'AMMO4': '0.177', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.000', 'weapon3': '2.848', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '17.655', 'FRAGCOUNT': '54.000'} [2024-08-06 08:30:16,132][52665] DAMAGECOUNT value on done: 975044.0 [2024-08-06 08:30:16,134][52665] Sum rewards: 83.239, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon5': '0.116', 'AMMO4': '0.134', 'AMMO3': '0.211', 'weapon4': '0.220', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:16,581][52664] DAMAGECOUNT value on done: 1013023.0 [2024-08-06 08:30:16,589][52664] Sum rewards: 86.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.770', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.126', 'weapon2': '0.174', 'AMMO3': '0.251', 'weapon5': '0.254', 'AMMO4': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.182', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.819', 'FRAGCOUNT': '71.000'} [2024-08-06 08:30:16,674][52666] DAMAGECOUNT value on done: 976093.0 [2024-08-06 08:30:16,674][52666] Sum rewards: 78.034, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.469', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.086', 'weapon5': '0.176', 'AMMO3': '0.194', 'AMMO4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:16,778][52659] DAMAGECOUNT value on done: 984226.0 [2024-08-06 08:30:16,778][52659] Sum rewards: 66.517, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.082', 'AMMO4': '0.204', 'AMMO3': '0.210', 'weapon5': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '54.000'} [2024-08-06 08:30:16,831][52649] DAMAGECOUNT value on done: 964177.0 [2024-08-06 08:30:16,835][52649] Sum rewards: 65.911, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.066', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.082', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.235', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.204', 'DAMAGECOUNT': '15.633', 'FRAGCOUNT': '56.000'} [2024-08-06 08:30:16,856][52667] DAMAGECOUNT value on done: 990307.0 [2024-08-06 08:30:16,858][52667] Sum rewards: 76.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.052', 'AMMO4': '0.122', 'WEAPON5': '0.150', 'weapon4': '0.194', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'weapon2': '0.766', 'WEAPON3': '1.300', 'weapon3': '2.786', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:17,243][52662] DAMAGECOUNT value on done: 975812.0 [2024-08-06 08:30:17,244][52662] Sum rewards: 65.432, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.508', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon5': '0.172', 'AMMO4': '0.202', 'weapon2': '0.258', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.010', 'weapon3': '3.222', 'DAMAGECOUNT': '16.722', 'FRAGCOUNT': '56.000'} [2024-08-06 08:30:17,509][52811] DAMAGECOUNT value on done: 919632.0 [2024-08-06 08:30:17,510][52811] Sum rewards: 77.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.968', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.128', 'AMMO4': '0.144', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 693567488. Throughput: 0: 4366.2. Samples: 173391990. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:17,794][52567] Avg episode reward: [(0, '75.951')] [2024-08-06 08:30:17,983][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:30:19,034][52668] DAMAGECOUNT value on done: 981626.0 [2024-08-06 08:30:19,034][52668] Sum rewards: 84.975, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.142', 'weapon5': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.606', 'WEAPON3': '1.350', 'weapon3': '2.968', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:19,097][52664] DAMAGECOUNT value on done: 1020556.0 [2024-08-06 08:30:19,097][52664] Sum rewards: 79.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.736', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'weapon5': '0.158', 'AMMO3': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:19,263][52665] DAMAGECOUNT value on done: 970494.0 [2024-08-06 08:30:19,264][52665] Sum rewards: 66.454, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.122', 'weapon5': '0.132', 'AMMO3': '0.169', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '2.990', 'DAMAGECOUNT': '15.597', 'FRAGCOUNT': '56.000'} [2024-08-06 08:30:19,483][52659] DAMAGECOUNT value on done: 996472.0 [2024-08-06 08:30:19,484][52659] Sum rewards: 82.137, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.474', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.090', 'AMMO4': '0.216', 'weapon5': '0.228', 'AMMO3': '0.261', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.024', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '70.500'} [2024-08-06 08:30:19,715][52667] DAMAGECOUNT value on done: 993932.0 [2024-08-06 08:30:19,715][52667] Sum rewards: 63.408, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.868', 'AMMO5': '0.007', 'AMMO2': '0.043', 'weapon5': '0.136', 'weapon4': '0.140', 'AMMO3': '0.201', 'AMMO4': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '50.000'} [2024-08-06 08:30:20,071][52649] DAMAGECOUNT value on done: 962551.0 [2024-08-06 08:30:20,071][52649] Sum rewards: 84.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon5': '0.090', 'AMMO4': '0.167', 'weapon4': '0.190', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.234', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.278', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '70.000'} [2024-08-06 08:30:20,342][52662] DAMAGECOUNT value on done: 979945.0 [2024-08-06 08:30:20,344][52662] Sum rewards: 66.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.827', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon2': '0.170', 'AMMO3': '0.194', 'weapon5': '0.196', 'AMMO4': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '53.000'} [2024-08-06 08:30:20,674][52811] DAMAGECOUNT value on done: 926425.0 [2024-08-06 08:30:20,675][52811] Sum rewards: 78.135, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.994', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.082', 'weapon4': '0.094', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:20,744][52650] Updated weights for policy 0, policy_version 84671 (0.0012) [2024-08-06 08:30:21,524][52668] DAMAGECOUNT value on done: 982855.0 [2024-08-06 08:30:21,530][52668] Sum rewards: 79.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.805', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.114', 'weapon4': '0.132', 'AMMO4': '0.184', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:21,830][52664] DAMAGECOUNT value on done: 1025347.0 [2024-08-06 08:30:21,838][52664] Sum rewards: 89.089, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO2': '0.002', 'AMMO4': '0.011', 'AMMO3': '0.205', 'weapon2': '0.310', 'WEAPON3': '1.300', 'weapon3': '3.560', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.370', 'FRAGCOUNT': '73.000'} [2024-08-06 08:30:22,222][52665] DAMAGECOUNT value on done: 978141.0 [2024-08-06 08:30:22,225][52665] Sum rewards: 63.274, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.620', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.058', 'weapon5': '0.140', 'AMMO4': '0.160', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.234', 'DAMAGECOUNT': '16.689', 'FRAGCOUNT': '54.000'} [2024-08-06 08:30:22,261][52659] DAMAGECOUNT value on done: 987855.0 [2024-08-06 08:30:22,264][52659] Sum rewards: 68.004, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.614', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.036', 'weapon5': '0.122', 'AMMO3': '0.165', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.274', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '56.500'} [2024-08-06 08:30:22,643][52667] DAMAGECOUNT value on done: 983058.0 [2024-08-06 08:30:22,643][52667] Sum rewards: 64.969, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.162', 'AMMO4': '0.188', 'AMMO3': '0.235', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'HITCOUNT': '3.000', 'weapon3': '3.068', 'DAMAGECOUNT': '16.617', 'FRAGCOUNT': '55.000'} [2024-08-06 08:30:22,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 693657600. Throughput: 0: 4367.3. Samples: 173418200. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:22,795][52567] Avg episode reward: [(0, '75.790')] [2024-08-06 08:30:23,007][52649] DAMAGECOUNT value on done: 962283.0 [2024-08-06 08:30:23,009][52649] Sum rewards: 74.540, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.938', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.160', 'weapon5': '0.162', 'AMMO3': '0.191', 'weapon2': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:23,356][52662] DAMAGECOUNT value on done: 999348.0 [2024-08-06 08:30:23,357][52662] Sum rewards: 94.219, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.272', 'ARMOR': '0.004', 'AMMO5': '0.009', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.194', 'AMMO3': '0.198', 'weapon4': '0.224', 'weapon2': '0.242', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.136', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '22.263', 'FRAGCOUNT': '75.000'} [2024-08-06 08:30:23,580][52811] DAMAGECOUNT value on done: 930974.0 [2024-08-06 08:30:23,580][52811] Sum rewards: 89.176, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.108', 'weapon4': '0.132', 'AMMO4': '0.134', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.345', 'weapon2': '0.354', 'WEAPON3': '0.850', 'weapon3': '3.242', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '70.000'} [2024-08-06 08:30:23,941][52668] DAMAGECOUNT value on done: 987024.0 [2024-08-06 08:30:23,942][52668] Sum rewards: 64.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.554', 'AMMO5': '0.003', 'weapon5': '0.014', 'AMMO2': '0.016', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'AMMO3': '0.213', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '54.500'} [2024-08-06 08:30:24,301][52664] DAMAGECOUNT value on done: 1013260.0 [2024-08-06 08:30:24,302][52664] Sum rewards: 74.025, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.093', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.076', 'weapon5': '0.136', 'AMMO3': '0.156', 'AMMO4': '0.238', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '3.054', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '59.000'} [2024-08-06 08:30:25,099][52650] Updated weights for policy 0, policy_version 84681 (0.0024) [2024-08-06 08:30:25,274][52665] DAMAGECOUNT value on done: 970896.0 [2024-08-06 08:30:25,275][52665] Sum rewards: 67.330, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.257', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.042', 'AMMO4': '0.133', 'weapon5': '0.226', 'WEAPON4': '0.250', 'AMMO3': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.550', 'HITCOUNT': '3.160', 'weapon3': '3.170', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:25,605][52659] DAMAGECOUNT value on done: 980629.0 [2024-08-06 08:30:25,608][52659] Sum rewards: 64.485, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.981', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.162', 'weapon4': '0.210', 'weapon5': '0.246', 'AMMO4': '0.255', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.610', 'WEAPON3': '0.950', 'weapon3': '2.636', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '51.000'} [2024-08-06 08:30:25,672][52667] DAMAGECOUNT value on done: 983524.0 [2024-08-06 08:30:25,672][52667] Sum rewards: 80.705, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.740', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.070', 'weapon4': '0.110', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:25,726][52660] DAMAGECOUNT value on done: 980325.0 [2024-08-06 08:30:25,726][52660] Sum rewards: 76.313, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.080', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.080', 'weapon4': '0.120', 'AMMO4': '0.158', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.313', 'weapon2': '0.338', 'WEAPON3': '1.900', 'weapon3': '3.170', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:25,898][52649] DAMAGECOUNT value on done: 957836.0 [2024-08-06 08:30:25,899][52649] Sum rewards: 74.283, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.550', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.082', 'weapon5': '0.222', 'AMMO3': '0.233', 'AMMO4': '0.282', 'weapon2': '0.488', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.920', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:26,342][52662] DAMAGECOUNT value on done: 986192.0 [2024-08-06 08:30:26,345][52662] Sum rewards: 75.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.021', 'AMMO2': '0.054', 'AMMO3': '0.162', 'weapon5': '0.252', 'AMMO4': '0.269', 'weapon2': '0.348', 'weapon4': '0.578', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.582', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:26,696][52811] DAMAGECOUNT value on done: 915542.0 [2024-08-06 08:30:26,698][52811] Sum rewards: 70.223, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon5': '0.190', 'AMMO3': '0.191', 'weapon4': '0.202', 'AMMO4': '0.214', 'weapon2': '0.356', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.020', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:26,848][52664] DAMAGECOUNT value on done: 1029859.0 [2024-08-06 08:30:26,856][52664] Sum rewards: 92.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.218', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.084', 'weapon4': '0.140', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.424', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '22.149', 'FRAGCOUNT': '74.000'} [2024-08-06 08:30:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 693747712. Throughput: 0: 4370.2. Samples: 173444360. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:27,794][52567] Avg episode reward: [(0, '75.356')] [2024-08-06 08:30:27,855][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084687_693755904.pth... [2024-08-06 08:30:28,009][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084174_689553408.pth [2024-08-06 08:30:28,070][52665] DAMAGECOUNT value on done: 964819.0 [2024-08-06 08:30:28,070][52665] Sum rewards: 82.310, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.212', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.094', 'weapon5': '0.184', 'AMMO4': '0.203', 'AMMO3': '0.235', 'weapon2': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:28,171][52667] DAMAGECOUNT value on done: 992123.0 [2024-08-06 08:30:28,179][52667] Sum rewards: 68.924, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.098', 'AMMO5': '0.012', 'AMMO2': '0.056', 'weapon4': '0.056', 'weapon5': '0.164', 'AMMO3': '0.201', 'AMMO4': '0.279', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.624', 'WEAPON3': '1.150', 'weapon3': '2.940', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:28,803][52659] DAMAGECOUNT value on done: 986876.0 [2024-08-06 08:30:28,804][52659] Sum rewards: 84.439, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.360', 'AMMO2': '0.000', 'AMMO4': '0.001', 'WEAPON1': '0.020', 'AMMO3': '0.212', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:28,945][52649] DAMAGECOUNT value on done: 955970.0 [2024-08-06 08:30:28,947][52649] Sum rewards: 77.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.100', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.118', 'weapon2': '0.194', 'AMMO4': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:28,956][52659] Large shaping reward 3.394 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.23700000000000002, -79.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:30:28,958][52660] DAMAGECOUNT value on done: 970001.0 [2024-08-06 08:30:28,959][52660] Sum rewards: 68.715, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.648', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.116', 'weapon4': '0.136', 'AMMO4': '0.147', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.662', 'WEAPON3': '1.350', 'weapon3': '2.840', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:29,109][52662] DAMAGECOUNT value on done: 988145.0 [2024-08-06 08:30:29,111][52662] Sum rewards: 70.581, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.772', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.098', 'weapon5': '0.212', 'AMMO4': '0.214', 'AMMO3': '0.238', 'weapon2': '0.380', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.996', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.487', 'FRAGCOUNT': '60.000'} [2024-08-06 08:30:29,911][52811] DAMAGECOUNT value on done: 917361.0 [2024-08-06 08:30:29,912][52811] Sum rewards: 74.675, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.730', 'AMMO5': '0.023', 'AMMO2': '0.067', 'AMMO3': '0.212', 'weapon5': '0.234', 'weapon4': '0.258', 'AMMO4': '0.335', 'weapon2': '0.386', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.788', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:30,026][52664] DAMAGECOUNT value on done: 1025201.0 [2024-08-06 08:30:30,028][52664] Sum rewards: 79.189, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.476', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.128', 'AMMO3': '0.158', 'weapon2': '0.526', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:30,333][52650] Updated weights for policy 0, policy_version 84691 (0.0020) [2024-08-06 08:30:30,654][52665] DAMAGECOUNT value on done: 970199.0 [2024-08-06 08:30:30,655][52665] Sum rewards: 64.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.325', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.094', 'weapon5': '0.220', 'AMMO4': '0.245', 'AMMO3': '0.264', 'weapon2': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.164', 'DAMAGECOUNT': '17.145', 'FRAGCOUNT': '54.000'} [2024-08-06 08:30:31,514][52667] DAMAGECOUNT value on done: 982417.0 [2024-08-06 08:30:31,514][52667] Sum rewards: 78.877, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.461', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.173', 'weapon2': '0.210', 'weapon5': '0.238', 'AMMO3': '0.252', 'weapon4': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.848', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.220', 'FRAGCOUNT': '66.000'} [2024-08-06 08:30:31,674][52649] DAMAGECOUNT value on done: 969843.0 [2024-08-06 08:30:31,675][52649] Sum rewards: 69.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.015', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.066', 'weapon5': '0.074', 'AMMO4': '0.078', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.788', 'WEAPON3': '1.050', 'weapon3': '2.890', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:31,706][52660] DAMAGECOUNT value on done: 983991.0 [2024-08-06 08:30:31,706][52660] Sum rewards: 78.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.192', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '3.258', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '63.000'} [2024-08-06 08:30:31,793][52659] DAMAGECOUNT value on done: 985473.0 [2024-08-06 08:30:31,795][52659] Sum rewards: 75.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.231', 'AMMO5': '0.015', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon5': '0.174', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon4': '0.256', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:32,268][52662] DAMAGECOUNT value on done: 983879.0 [2024-08-06 08:30:32,269][52662] Sum rewards: 76.922, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.042', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.230', 'AMMO3': '0.294', 'weapon2': '0.370', 'WEAPON3': '1.700', 'weapon3': '3.134', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:32,545][52664] DAMAGECOUNT value on done: 1015421.0 [2024-08-06 08:30:32,545][52664] Sum rewards: 84.632, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.102', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.054', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.286', 'WEAPON3': '1.750', 'weapon3': '3.524', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.991', 'FRAGCOUNT': '73.000'} [2024-08-06 08:30:32,797][52567] Fps is (10 sec: 16380.2, 60 sec: 17339.0, 300 sec: 17411.3). Total num frames: 693821440. Throughput: 0: 4358.5. Samples: 173457050. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:32,797][52567] Avg episode reward: [(0, '75.529')] [2024-08-06 08:30:33,725][52665] DAMAGECOUNT value on done: 978293.0 [2024-08-06 08:30:33,726][52665] Sum rewards: 89.690, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.835', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.028', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.067', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.870', 'FRAGCOUNT': '73.000'} [2024-08-06 08:30:34,234][52667] DAMAGECOUNT value on done: 990048.0 [2024-08-06 08:30:34,236][52667] Sum rewards: 77.376, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.284', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.084', 'AMMO4': '0.100', 'weapon5': '0.140', 'weapon2': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'WEAPON3': '1.250', 'weapon3': '3.506', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:34,568][52659] DAMAGECOUNT value on done: 985881.0 [2024-08-06 08:30:34,568][52659] Sum rewards: 75.994, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.846', 'AMMO5': '0.010', 'AMMO2': '0.046', 'weapon4': '0.060', 'weapon5': '0.150', 'AMMO3': '0.223', 'AMMO4': '0.228', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.920', 'FRAGCOUNT': '63.000'} [2024-08-06 08:30:34,619][52660] DAMAGECOUNT value on done: 995531.0 [2024-08-06 08:30:34,620][52660] Sum rewards: 70.062, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.295', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.175', 'weapon5': '0.178', 'weapon2': '0.276', 'weapon4': '0.324', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.934', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:34,815][52649] DAMAGECOUNT value on done: 974548.0 [2024-08-06 08:30:34,815][52649] Sum rewards: 72.544, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.013', 'AMMO2': '0.032', 'HEALTH': '0.150', 'AMMO4': '0.162', 'AMMO3': '0.199', 'weapon5': '0.206', 'weapon2': '0.278', 'weapon4': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:34,820][52650] Updated weights for policy 0, policy_version 84701 (0.0038) [2024-08-06 08:30:35,101][52664] DAMAGECOUNT value on done: 1015342.0 [2024-08-06 08:30:35,101][52664] Sum rewards: 83.805, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.480', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.094', 'AMMO4': '0.112', 'weapon5': '0.134', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.274', 'WEAPON3': '1.600', 'weapon3': '3.210', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '72.000'} [2024-08-06 08:30:35,314][52662] DAMAGECOUNT value on done: 982671.0 [2024-08-06 08:30:35,317][52662] Sum rewards: 75.048, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.170', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.120', 'weapon4': '0.150', 'AMMO4': '0.150', 'AMMO3': '0.174', 'weapon2': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'weapon3': '3.292', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:35,456][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:30:37,159][52667] DAMAGECOUNT value on done: 996054.0 [2024-08-06 08:30:37,159][52667] Sum rewards: 76.192, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.090', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon5': '0.062', 'weapon4': '0.086', 'AMMO3': '0.170', 'AMMO4': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.150', 'weapon3': '3.296', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:37,460][52659] DAMAGECOUNT value on done: 983800.0 [2024-08-06 08:30:37,463][52659] Sum rewards: 70.212, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.024', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.048', 'AMMO4': '0.125', 'AMMO3': '0.210', 'weapon5': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '3.130', 'weapon3': '3.146', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '60.000'} [2024-08-06 08:30:37,633][52660] DAMAGECOUNT value on done: 976953.0 [2024-08-06 08:30:37,635][52660] Sum rewards: 72.671, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.145', 'AMMO5': '0.008', 'AMMO2': '0.041', 'weapon5': '0.134', 'AMMO3': '0.173', 'weapon4': '0.174', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.100', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:37,774][52664] DAMAGECOUNT value on done: 1022204.0 [2024-08-06 08:30:37,775][52664] Sum rewards: 84.507, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.036', 'weapon5': '0.046', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.372', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:37,795][52567] Fps is (10 sec: 16382.2, 60 sec: 17339.4, 300 sec: 17411.4). Total num frames: 693911552. Throughput: 0: 4359.9. Samples: 173483240. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:37,796][52567] Avg episode reward: [(0, '75.581')] [2024-08-06 08:30:37,997][52649] DAMAGECOUNT value on done: 966226.0 [2024-08-06 08:30:37,998][52649] Sum rewards: 69.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.068', 'AMMO4': '0.122', 'weapon4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.244', 'WEAPON4': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.140', 'weapon3': '3.304', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:38,249][52662] DAMAGECOUNT value on done: 977042.0 [2024-08-06 08:30:38,249][52662] Sum rewards: 86.577, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.724', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.066', 'weapon5': '0.122', 'weapon2': '0.170', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'weapon4': '0.406', 'WEAPON3': '1.300', 'weapon3': '3.072', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '74.000'} [2024-08-06 08:30:39,328][52650] Updated weights for policy 0, policy_version 84711 (0.0013) [2024-08-06 08:30:39,767][52667] DAMAGECOUNT value on done: 998066.0 [2024-08-06 08:30:39,772][52667] Sum rewards: 83.438, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.017', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.118', 'weapon4': '0.176', 'AMMO3': '0.198', 'AMMO4': '0.200', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.240', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '68.000'} [2024-08-06 08:30:40,159][52660] DAMAGECOUNT value on done: 973682.0 [2024-08-06 08:30:40,159][52660] Sum rewards: 72.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.126', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.750', 'weapon2': '0.864', 'weapon3': '2.850', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:40,234][52659] DAMAGECOUNT value on done: 995266.0 [2024-08-06 08:30:40,234][52659] Sum rewards: 80.625, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.110', 'weapon5': '0.142', 'AMMO3': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.050', 'weapon3': '3.272', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:40,465][52664] DAMAGECOUNT value on done: 1018684.0 [2024-08-06 08:30:40,465][52664] Sum rewards: 73.814, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.985', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.060', 'AMMO3': '0.186', 'AMMO4': '0.187', 'weapon5': '0.222', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '60.000'} [2024-08-06 08:30:41,019][52649] DAMAGECOUNT value on done: 966003.0 [2024-08-06 08:30:41,022][52649] Sum rewards: 80.951, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.072', 'AMMO4': '0.100', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'weapon2': '0.256', 'WEAPON3': '1.150', 'weapon3': '3.348', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '66.000'} [2024-08-06 08:30:41,688][52662] DAMAGECOUNT value on done: 987597.0 [2024-08-06 08:30:41,689][52662] Sum rewards: 77.461, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.305', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'AMMO3': '0.206', 'weapon4': '0.234', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.338', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:42,617][52667] DAMAGECOUNT value on done: 993820.0 [2024-08-06 08:30:42,617][52667] Sum rewards: 74.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.615', 'AMMO2': '0.008', 'AMMO5': '0.008', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.348', 'WEAPON3': '1.300', 'weapon3': '3.426', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '60.000'} [2024-08-06 08:30:42,794][52567] Fps is (10 sec: 18027.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 694001664. Throughput: 0: 4366.2. Samples: 173509950. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:30:42,794][52567] Avg episode reward: [(0, '75.739')] [2024-08-06 08:30:42,862][52659] DAMAGECOUNT value on done: 980987.0 [2024-08-06 08:30:42,863][52659] Sum rewards: 83.959, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.558', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.110', 'AMMO4': '0.113', 'weapon5': '0.128', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.279', 'WEAPON3': '1.600', 'weapon3': '3.270', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.072', 'FRAGCOUNT': '70.000'} [2024-08-06 08:30:42,900][52664] DAMAGECOUNT value on done: 1027699.0 [2024-08-06 08:30:42,900][52664] Sum rewards: 74.248, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.787', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.082', 'AMMO4': '0.103', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.166', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.370', 'FRAGCOUNT': '63.000'} [2024-08-06 08:30:43,349][52660] DAMAGECOUNT value on done: 982235.0 [2024-08-06 08:30:43,350][52660] Sum rewards: 82.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.736', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon5': '0.136', 'weapon2': '0.178', 'AMMO3': '0.229', 'AMMO4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.136', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.119', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:43,899][52649] DAMAGECOUNT value on done: 954698.0 [2024-08-06 08:30:43,900][52649] Sum rewards: 77.657, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.964', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.106', 'weapon5': '0.118', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.582', 'WEAPON3': '1.000', 'weapon3': '3.026', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:44,183][52650] Updated weights for policy 0, policy_version 84721 (0.0013) [2024-08-06 08:30:44,764][52662] DAMAGECOUNT value on done: 980379.0 [2024-08-06 08:30:44,764][52662] Sum rewards: 71.100, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.090', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.190', 'weapon2': '0.192', 'weapon5': '0.222', 'AMMO4': '0.243', 'AMMO3': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '3.054', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '61.000'} [2024-08-06 08:30:45,334][52667] DAMAGECOUNT value on done: 988875.0 [2024-08-06 08:30:45,335][52667] Sum rewards: 72.037, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-2.030', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.126', 'AMMO3': '0.129', 'weapon2': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.376', 'WEAPON3': '0.950', 'weapon3': '2.984', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.820', 'FRAGCOUNT': '55.000'} [2024-08-06 08:30:45,563][52803] DAMAGECOUNT value on done: 913375.0 [2024-08-06 08:30:45,563][52803] Sum rewards: 87.463, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.237', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.124', 'AMMO4': '0.154', 'AMMO3': '0.203', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.382', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '71.000'} [2024-08-06 08:30:45,788][52660] DAMAGECOUNT value on done: 987851.0 [2024-08-06 08:30:45,789][52660] Sum rewards: 76.984, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.221', 'AMMO5': '0.024', 'AMMO2': '0.076', 'AMMO3': '0.231', 'weapon2': '0.240', 'weapon5': '0.262', 'weapon4': '0.266', 'AMMO4': '0.381', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:45,897][52664] DAMAGECOUNT value on done: 1026873.0 [2024-08-06 08:30:45,897][52664] Sum rewards: 78.459, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.344', 'AMMO5': '0.023', 'AMMO2': '0.062', 'AMMO3': '0.147', 'weapon4': '0.228', 'AMMO4': '0.311', 'weapon5': '0.322', 'weapon2': '0.416', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '0.900', 'weapon3': '2.770', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '62.000'} [2024-08-06 08:30:45,952][52659] DAMAGECOUNT value on done: 991079.0 [2024-08-06 08:30:45,952][52659] Sum rewards: 67.321, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.924', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.152', 'AMMO4': '0.190', 'weapon5': '0.194', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '2.924', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '58.000'} [2024-08-06 08:30:46,777][52649] DAMAGECOUNT value on done: 968528.0 [2024-08-06 08:30:46,777][52649] Sum rewards: 77.449, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.150', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon4': '0.166', 'weapon5': '0.178', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:47,794][52567] Fps is (10 sec: 18843.1, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 694099968. Throughput: 0: 4371.5. Samples: 173523190. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:30:47,795][52567] Avg episode reward: [(0, '76.065')] [2024-08-06 08:30:48,006][52662] DAMAGECOUNT value on done: 995603.0 [2024-08-06 08:30:48,006][52662] Sum rewards: 87.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.495', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.082', 'WEAPON4': '0.100', 'weapon4': '0.116', 'AMMO4': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.548', 'FRAGCOUNT': '74.000'} [2024-08-06 08:30:48,151][52667] DAMAGECOUNT value on done: 995420.0 [2024-08-06 08:30:48,151][52667] Sum rewards: 76.203, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.138', 'weapon4': '0.546', 'weapon2': '0.584', 'WEAPON3': '0.900', 'weapon3': '2.652', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '60.000'} [2024-08-06 08:30:48,836][52664] DAMAGECOUNT value on done: 1023140.0 [2024-08-06 08:30:48,836][52664] Sum rewards: 75.509, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.534', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon4': '0.092', 'AMMO4': '0.171', 'AMMO3': '0.224', 'weapon2': '0.228', 'weapon5': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '63.000'} [2024-08-06 08:30:48,876][52803] DAMAGECOUNT value on done: 913432.0 [2024-08-06 08:30:48,876][52803] Sum rewards: 85.298, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.092', 'weapon4': '0.146', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '20.301', 'FRAGCOUNT': '69.000'} [2024-08-06 08:30:48,959][52660] DAMAGECOUNT value on done: 975482.0 [2024-08-06 08:30:48,960][52660] Sum rewards: 72.676, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.450', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.044', 'AMMO3': '0.132', 'AMMO4': '0.151', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.450', 'weapon2': '0.512', 'WEAPON3': '0.800', 'weapon3': '2.796', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 08:30:48,998][52659] DAMAGECOUNT value on done: 985533.0 [2024-08-06 08:30:48,999][52659] Sum rewards: 94.708, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.008', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.068', 'weapon4': '0.074', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.201', 'weapon2': '0.354', 'WEAPON3': '1.200', 'weapon3': '3.364', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.092', 'FRAGCOUNT': '76.000'} [2024-08-06 08:30:49,178][52650] Updated weights for policy 0, policy_version 84731 (0.0026) [2024-08-06 08:30:49,348][52649] DAMAGECOUNT value on done: 947594.0 [2024-08-06 08:30:49,351][52649] Sum rewards: 74.976, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.112', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.152', 'weapon4': '0.220', 'weapon2': '0.236', 'AMMO4': '0.282', 'weapon5': '0.346', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.000', 'weapon3': '2.918', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '60.000'} [2024-08-06 08:30:51,026][52662] DAMAGECOUNT value on done: 984759.0 [2024-08-06 08:30:51,026][52662] Sum rewards: 84.434, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.649', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.150', 'AMMO4': '0.177', 'AMMO3': '0.188', 'weapon5': '0.226', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.106', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '68.000'} [2024-08-06 08:30:51,499][52664] DAMAGECOUNT value on done: 1036137.0 [2024-08-06 08:30:51,502][52664] Sum rewards: 89.144, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.074', 'AMMO4': '0.076', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.170', 'HEALTH': '0.204', 'AMMO3': '0.216', 'WEAPON3': '1.200', 'weapon3': '3.384', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '73.000'} [2024-08-06 08:30:51,865][52659] DAMAGECOUNT value on done: 982557.0 [2024-08-06 08:30:51,868][52659] Sum rewards: 80.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.164', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.135', 'weapon5': '0.148', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.100', 'weapon3': '3.150', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:51,872][52660] DAMAGECOUNT value on done: 975736.0 [2024-08-06 08:30:51,877][52660] Sum rewards: 77.254, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.306', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.122', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.166', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '66.000'} [2024-08-06 08:30:52,169][52649] DAMAGECOUNT value on done: 966965.0 [2024-08-06 08:30:52,170][52649] Sum rewards: 72.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.826', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.170', 'AMMO3': '0.208', 'weapon4': '0.222', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.809', 'FRAGCOUNT': '59.000'} [2024-08-06 08:30:52,251][52803] DAMAGECOUNT value on done: 922085.0 [2024-08-06 08:30:52,251][52803] Sum rewards: 80.218, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.788', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon2': '0.188', 'AMMO3': '0.201', 'weapon4': '0.212', 'WEAPON3': '1.300', 'weapon3': '3.304', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '65.000'} [2024-08-06 08:30:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 694173696. Throughput: 0: 4370.4. Samples: 173549290. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:30:52,794][52567] Avg episode reward: [(0, '76.857')] [2024-08-06 08:30:53,319][52650] Updated weights for policy 0, policy_version 84741 (0.0040) [2024-08-06 08:30:54,242][52662] DAMAGECOUNT value on done: 974754.0 [2024-08-06 08:30:54,243][52662] Sum rewards: 64.867, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.188', 'weapon4': '0.198', 'AMMO3': '0.203', 'AMMO4': '0.208', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.200', 'weapon3': '2.894', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.206', 'FRAGCOUNT': '53.000'} [2024-08-06 08:30:54,553][52660] DAMAGECOUNT value on done: 979998.0 [2024-08-06 08:30:54,555][52660] Sum rewards: 73.172, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.416', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.210', 'weapon5': '0.222', 'AMMO4': '0.268', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.478', 'WEAPON3': '1.250', 'weapon3': '2.674', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '60.000'} [2024-08-06 08:30:54,726][52659] DAMAGECOUNT value on done: 983977.0 [2024-08-06 08:30:54,728][52659] Sum rewards: 71.461, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.231', 'AMMO5': '0.019', 'AMMO2': '0.033', 'weapon4': '0.092', 'AMMO4': '0.166', 'weapon5': '0.180', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.056', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '59.500'} [2024-08-06 08:30:54,743][52649] DAMAGECOUNT value on done: 971041.0 [2024-08-06 08:30:54,744][52649] Sum rewards: 86.824, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.540', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.240', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '73.000'} [2024-08-06 08:30:54,778][52664] DAMAGECOUNT value on done: 1033144.0 [2024-08-06 08:30:54,781][52664] Sum rewards: 80.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.402', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.048', 'AMMO4': '0.183', 'weapon5': '0.186', 'AMMO3': '0.238', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.186', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '67.000'} [2024-08-06 08:30:55,582][52803] DAMAGECOUNT value on done: 915375.0 [2024-08-06 08:30:55,582][52803] Sum rewards: 71.338, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.300', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.156', 'weapon5': '0.178', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.100', 'weapon3': '3.096', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '56.000'} [2024-08-06 08:30:56,083][52659] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:30:57,346][52649] DAMAGECOUNT value on done: 958786.0 [2024-08-06 08:30:57,346][52649] Sum rewards: 84.906, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.514', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.120', 'AMMO4': '0.156', 'weapon2': '0.196', 'AMMO3': '0.209', 'weapon4': '0.214', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.242', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '71.000'} [2024-08-06 08:30:57,351][52662] DAMAGECOUNT value on done: 982748.0 [2024-08-06 08:30:57,352][52662] Sum rewards: 80.678, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.605', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.135', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.362', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '64.000'} [2024-08-06 08:30:57,461][52660] DAMAGECOUNT value on done: 977283.0 [2024-08-06 08:30:57,461][52660] Sum rewards: 85.927, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.072', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.076', 'weapon5': '0.096', 'weapon2': '0.160', 'AMMO3': '0.166', 'AMMO4': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.310', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.661', 'FRAGCOUNT': '68.000'} [2024-08-06 08:30:57,559][52659] DAMAGECOUNT value on done: 986555.0 [2024-08-06 08:30:57,560][52659] Sum rewards: 87.569, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.292', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.124', 'AMMO4': '0.153', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.344', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.075', 'FRAGCOUNT': '70.000'} [2024-08-06 08:30:57,794][52567] Fps is (10 sec: 16384.5, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 694263808. Throughput: 0: 4362.7. Samples: 173575210. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:30:57,794][52567] Avg episode reward: [(0, '76.894')] [2024-08-06 08:30:58,099][52664] DAMAGECOUNT value on done: 1031590.0 [2024-08-06 08:30:58,101][52664] Sum rewards: 69.577, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.470', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'weapon4': '0.166', 'AMMO3': '0.167', 'weapon2': '0.454', 'WEAPON3': '0.950', 'weapon3': '3.112', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.430', 'FRAGCOUNT': '56.000'} [2024-08-06 08:30:58,414][52650] Updated weights for policy 0, policy_version 84751 (0.0013) [2024-08-06 08:30:58,744][52803] DAMAGECOUNT value on done: 916750.0 [2024-08-06 08:30:58,744][52803] Sum rewards: 86.021, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.088', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.290', 'WEAPON3': '1.100', 'weapon3': '3.518', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:00,303][52662] DAMAGECOUNT value on done: 976696.0 [2024-08-06 08:31:00,305][52662] Sum rewards: 74.792, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.059', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon5': '0.148', 'AMMO3': '0.149', 'AMMO4': '0.158', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.356', 'WEAPON3': '1.000', 'weapon3': '3.038', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '57.500'} [2024-08-06 08:31:00,530][52660] DAMAGECOUNT value on done: 976714.0 [2024-08-06 08:31:00,530][52660] Sum rewards: 79.158, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.152', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.036', 'weapon5': '0.088', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'weapon2': '0.462', 'WEAPON3': '1.000', 'weapon3': '3.234', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:00,630][52664] DAMAGECOUNT value on done: 1015373.0 [2024-08-06 08:31:00,631][52664] Sum rewards: 77.037, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.965', 'AMMO5': '0.016', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon5': '0.170', 'AMMO3': '0.187', 'weapon4': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.342', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.060', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:00,659][52659] DAMAGECOUNT value on done: 997821.0 [2024-08-06 08:31:00,662][52659] Sum rewards: 77.321, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.255', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon4': '0.032', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon2': '0.178', 'AMMO3': '0.315', 'WEAPON3': '1.800', 'weapon3': '3.440', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '67.000'} [2024-08-06 08:31:01,869][52803] DAMAGECOUNT value on done: 913361.0 [2024-08-06 08:31:01,871][52803] Sum rewards: 76.302, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.728', 'AMMO5': '0.003', 'weapon4': '0.004', 'AMMO2': '0.018', 'weapon5': '0.060', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.392', 'WEAPON3': '1.500', 'weapon3': '3.384', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:02,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 694353920. Throughput: 0: 4360.2. Samples: 173588200. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:31:02,795][52567] Avg episode reward: [(0, '77.133')] [2024-08-06 08:31:03,042][52650] Updated weights for policy 0, policy_version 84761 (0.0012) [2024-08-06 08:31:03,270][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:31:03,599][52660] DAMAGECOUNT value on done: 986393.0 [2024-08-06 08:31:03,607][52660] Sum rewards: 78.879, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.026', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.126', 'weapon4': '0.142', 'AMMO4': '0.150', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.296', 'WEAPON3': '1.500', 'weapon3': '3.166', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.141', 'FRAGCOUNT': '67.000'} [2024-08-06 08:31:03,753][52664] DAMAGECOUNT value on done: 1020106.0 [2024-08-06 08:31:03,755][52664] Sum rewards: 73.162, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.590', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.046', 'weapon5': '0.134', 'weapon4': '0.186', 'weapon2': '0.228', 'AMMO4': '0.232', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.164', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:04,044][52659] DAMAGECOUNT value on done: 978505.0 [2024-08-06 08:31:04,047][52659] Sum rewards: 80.083, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.155', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.128', 'AMMO4': '0.191', 'AMMO3': '0.191', 'weapon5': '0.258', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '65.500'} [2024-08-06 08:31:04,914][52803] DAMAGECOUNT value on done: 911962.0 [2024-08-06 08:31:04,915][52803] Sum rewards: 78.698, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.910', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.114', 'AMMO4': '0.146', 'weapon5': '0.186', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.200', 'weapon3': '3.192', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:06,708][52669] DAMAGECOUNT value on done: 984576.0 [2024-08-06 08:31:06,708][52669] Sum rewards: 69.942, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.019', 'AMMO2': '0.041', 'weapon4': '0.142', 'AMMO3': '0.159', 'weapon5': '0.186', 'AMMO4': '0.204', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.670', 'WEAPON3': '1.050', 'weapon3': '2.792', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.568', 'FRAGCOUNT': '56.000'} [2024-08-06 08:31:06,753][52660] DAMAGECOUNT value on done: 1001853.0 [2024-08-06 08:31:06,754][52660] Sum rewards: 82.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.380', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.188', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.350', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '66.000'} [2024-08-06 08:31:06,773][52659] DAMAGECOUNT value on done: 990359.0 [2024-08-06 08:31:06,776][52659] Sum rewards: 65.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.670', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.064', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.275', 'weapon2': '0.504', 'WEAPON3': '1.650', 'HITCOUNT': '3.140', 'weapon3': '3.216', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.500'} [2024-08-06 08:31:07,068][52664] DAMAGECOUNT value on done: 1030896.0 [2024-08-06 08:31:07,069][52664] Sum rewards: 77.347, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.735', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.134', 'AMMO3': '0.160', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:07,720][52650] Updated weights for policy 0, policy_version 84771 (0.0021) [2024-08-06 08:31:07,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 694444032. Throughput: 0: 4362.9. Samples: 173614530. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:31:07,794][52567] Avg episode reward: [(0, '77.092')] [2024-08-06 08:31:07,910][52671] DAMAGECOUNT value on done: 990893.0 [2024-08-06 08:31:07,913][52803] DAMAGECOUNT value on done: 911123.0 [2024-08-06 08:31:07,912][52671] Sum rewards: 83.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.020', 'AMMO4': '0.090', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:07,916][52803] Sum rewards: 71.011, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.187', 'weapon4': '0.232', 'AMMO4': '0.255', 'weapon5': '0.258', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.818', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.000'} [2024-08-06 08:31:09,301][52669] DAMAGECOUNT value on done: 982846.0 [2024-08-06 08:31:09,309][52669] Sum rewards: 78.159, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.466', 'AMMO5': '0.012', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.134', 'AMMO3': '0.166', 'weapon4': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.762', 'WEAPON3': '0.950', 'weapon3': '2.732', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:09,777][52659] DAMAGECOUNT value on done: 982547.0 [2024-08-06 08:31:09,779][52659] Sum rewards: 84.222, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.534', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.088', 'AMMO4': '0.112', 'weapon4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.422', 'WEAPON3': '1.050', 'weapon3': '3.212', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.154', 'FRAGCOUNT': '66.500'} [2024-08-06 08:31:09,859][52658] DAMAGECOUNT value on done: 990120.0 [2024-08-06 08:31:09,859][52658] Sum rewards: 77.269, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.056', 'weapon4': '0.074', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '62.000'} [2024-08-06 08:31:10,039][52660] DAMAGECOUNT value on done: 979616.0 [2024-08-06 08:31:10,039][52660] Sum rewards: 75.620, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.692', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.064', 'weapon5': '0.156', 'AMMO3': '0.229', 'AMMO4': '0.277', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '65.000'} [2024-08-06 08:31:10,295][52664] DAMAGECOUNT value on done: 1014189.0 [2024-08-06 08:31:10,295][52664] Sum rewards: 74.146, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.019', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.062', 'AMMO4': '0.166', 'AMMO3': '0.233', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.022', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:10,847][52671] DAMAGECOUNT value on done: 997235.0 [2024-08-06 08:31:10,849][52671] Sum rewards: 73.764, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.403', 'AMMO5': '0.019', 'AMMO2': '0.064', 'weapon2': '0.184', 'weapon4': '0.208', 'AMMO3': '0.216', 'weapon5': '0.244', 'AMMO4': '0.321', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.090', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:10,868][52803] DAMAGECOUNT value on done: 919355.0 [2024-08-06 08:31:10,869][52803] Sum rewards: 73.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.390', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.018', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.338', 'WEAPON3': '1.150', 'weapon3': '3.446', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:12,163][52669] DAMAGECOUNT value on done: 993320.0 [2024-08-06 08:31:12,164][52669] Sum rewards: 78.014, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.735', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.136', 'weapon5': '0.136', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'weapon2': '0.340', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:12,214][52650] Updated weights for policy 0, policy_version 84781 (0.0026) [2024-08-06 08:31:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 694525952. Throughput: 0: 4359.8. Samples: 173640550. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:31:12,794][52567] Avg episode reward: [(0, '77.536')] [2024-08-06 08:31:12,815][52658] DAMAGECOUNT value on done: 989980.0 [2024-08-06 08:31:12,816][52658] Sum rewards: 77.586, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.445', 'AMMO2': '0.003', 'AMMO5': '0.004', 'AMMO4': '0.012', 'weapon5': '0.040', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.168', 'weapon4': '0.310', 'weapon2': '0.346', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '62.000'} [2024-08-06 08:31:13,175][52660] DAMAGECOUNT value on done: 983141.0 [2024-08-06 08:31:13,176][52660] Sum rewards: 72.290, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.870', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon4': '0.206', 'weapon5': '0.214', 'AMMO3': '0.224', 'weapon2': '0.262', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:14,032][52803] DAMAGECOUNT value on done: 913935.0 [2024-08-06 08:31:14,034][52803] Sum rewards: 72.758, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.114', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.162', 'AMMO3': '0.196', 'weapon5': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 08:31:14,049][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:31:14,119][52671] DAMAGECOUNT value on done: 990215.0 [2024-08-06 08:31:14,121][52671] Sum rewards: 82.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.385', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon5': '0.080', 'weapon4': '0.114', 'AMMO4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.718', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:14,475][52669] DAMAGECOUNT value on done: 987072.0 [2024-08-06 08:31:14,501][52669] Sum rewards: 88.449, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.099', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'weapon4': '0.240', 'AMMO3': '0.278', 'weapon2': '0.386', 'WEAPON3': '1.650', 'weapon3': '2.976', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.354', 'FRAGCOUNT': '76.000'} [2024-08-06 08:31:15,806][52658] DAMAGECOUNT value on done: 992869.0 [2024-08-06 08:31:15,806][52658] Sum rewards: 74.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.543', 'AMMO5': '0.018', 'AMMO2': '0.054', 'AMMO3': '0.167', 'weapon5': '0.176', 'weapon4': '0.184', 'AMMO4': '0.270', 'weapon2': '0.322', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '62.000'} [2024-08-06 08:31:16,415][52660] DAMAGECOUNT value on done: 982934.0 [2024-08-06 08:31:16,416][52660] Sum rewards: 75.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.740', 'AMMO5': '0.012', 'AMMO2': '0.050', 'weapon4': '0.060', 'weapon5': '0.178', 'AMMO4': '0.253', 'AMMO3': '0.253', 'weapon2': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.154', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '62.000'} [2024-08-06 08:31:16,539][52647] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:31:16,661][52671] DAMAGECOUNT value on done: 997429.0 [2024-08-06 08:31:16,662][52671] Sum rewards: 77.943, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.104', 'AMMO3': '0.172', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.208', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:17,051][52669] DAMAGECOUNT value on done: 993585.0 [2024-08-06 08:31:17,052][52669] Sum rewards: 76.480, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.922', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.056', 'AMMO4': '0.122', 'weapon5': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.222', 'WEAPON3': '1.200', 'weapon3': '3.384', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:17,160][52650] Updated weights for policy 0, policy_version 84791 (0.0019) [2024-08-06 08:31:17,197][52803] DAMAGECOUNT value on done: 927268.0 [2024-08-06 08:31:17,199][52803] Sum rewards: 68.072, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.080', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon4': '0.128', 'weapon5': '0.210', 'weapon2': '0.252', 'AMMO3': '0.256', 'AMMO4': '0.314', 'WEAPON5': '0.400', 'WEAPON4': '0.600', 'WEAPON3': '1.600', 'weapon3': '3.112', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '59.000'} [2024-08-06 08:31:17,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 694616064. Throughput: 0: 4369.1. Samples: 173653650. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:31:17,794][52567] Avg episode reward: [(0, '77.469')] [2024-08-06 08:31:18,769][52658] DAMAGECOUNT value on done: 988499.0 [2024-08-06 08:31:18,769][52658] Sum rewards: 71.542, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.066', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon2': '0.186', 'AMMO4': '0.188', 'AMMO3': '0.268', 'weapon5': '0.290', 'weapon4': '0.318', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.844', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:18,812][52660] DAMAGECOUNT value on done: 973635.0 [2024-08-06 08:31:18,813][52660] Sum rewards: 76.131, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.050', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon5': '0.094', 'AMMO4': '0.224', 'AMMO3': '0.230', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.400', 'weapon3': '2.896', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:19,490][52671] DAMAGECOUNT value on done: 1001945.0 [2024-08-06 08:31:19,498][52671] Sum rewards: 69.610, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.690', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.080', 'weapon5': '0.190', 'AMMO3': '0.206', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.670', 'WEAPON3': '1.150', 'weapon3': '2.810', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '57.000'} [2024-08-06 08:31:20,172][52669] DAMAGECOUNT value on done: 992373.0 [2024-08-06 08:31:20,172][52669] Sum rewards: 84.828, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.586', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.158', 'AMMO3': '0.179', 'weapon4': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '69.000'} [2024-08-06 08:31:20,373][52803] DAMAGECOUNT value on done: 924001.0 [2024-08-06 08:31:20,374][52803] Sum rewards: 81.545, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.458', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.084', 'AMMO4': '0.172', 'weapon5': '0.176', 'weapon2': '0.188', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.958', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:21,490][52660] DAMAGECOUNT value on done: 975322.0 [2024-08-06 08:31:21,492][52660] Sum rewards: 97.795, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.174', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.030', 'weapon4': '0.076', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.240', 'WEAPON3': '1.500', 'weapon3': '3.500', 'HITCOUNT': '4.360', 'DAMAGECOUNT': '22.914', 'FRAGCOUNT': '81.000'} [2024-08-06 08:31:21,509][52658] DAMAGECOUNT value on done: 982062.0 [2024-08-06 08:31:21,510][52658] Sum rewards: 75.433, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.882', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.174', 'weapon5': '0.212', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.650', 'weapon3': '2.848', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '67.000'} [2024-08-06 08:31:21,781][52650] Updated weights for policy 0, policy_version 84801 (0.0013) [2024-08-06 08:31:22,289][52671] DAMAGECOUNT value on done: 990460.0 [2024-08-06 08:31:22,289][52671] Sum rewards: 69.812, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.394', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.320', 'WEAPON3': '1.400', 'HITCOUNT': '3.100', 'weapon3': '3.328', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '59.000'} [2024-08-06 08:31:22,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 694706176. Throughput: 0: 4376.3. Samples: 173680170. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:31:22,794][52567] Avg episode reward: [(0, '77.799')] [2024-08-06 08:31:23,246][52669] DAMAGECOUNT value on done: 990544.0 [2024-08-06 08:31:23,246][52669] Sum rewards: 69.730, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.580', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.042', 'AMMO4': '0.044', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.430', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '56.000'} [2024-08-06 08:31:23,472][52803] DAMAGECOUNT value on done: 913397.0 [2024-08-06 08:31:23,472][52803] Sum rewards: 87.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.755', 'AMMO2': '0.034', 'WEAPON4': '0.100', 'weapon4': '0.118', 'AMMO4': '0.168', 'weapon2': '0.220', 'AMMO3': '0.235', 'WEAPON3': '1.600', 'weapon3': '3.498', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.022', 'FRAGCOUNT': '75.000'} [2024-08-06 08:31:24,596][52658] DAMAGECOUNT value on done: 980375.0 [2024-08-06 08:31:24,597][52658] Sum rewards: 79.820, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.541', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.021', 'weapon4': '0.040', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.216', 'weapon2': '0.334', 'WEAPON3': '1.300', 'weapon3': '3.350', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '66.000'} [2024-08-06 08:31:25,177][52671] DAMAGECOUNT value on done: 992026.0 [2024-08-06 08:31:25,177][52671] Sum rewards: 65.187, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.197', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.232', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '53.000'} [2024-08-06 08:31:26,412][52669] DAMAGECOUNT value on done: 991916.0 [2024-08-06 08:31:26,413][52669] Sum rewards: 82.102, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.059', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.134', 'weapon4': '0.150', 'AMMO3': '0.175', 'AMMO4': '0.219', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '67.000'} [2024-08-06 08:31:26,547][52650] Updated weights for policy 0, policy_version 84811 (0.0040) [2024-08-06 08:31:26,581][52803] DAMAGECOUNT value on done: 930580.0 [2024-08-06 08:31:26,581][52803] Sum rewards: 80.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.020', 'AMMO2': '0.077', 'weapon4': '0.146', 'AMMO3': '0.187', 'weapon5': '0.234', 'AMMO4': '0.386', 'WEAPON4': '0.500', 'weapon2': '0.544', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.852', 'FRAGCOUNT': '66.000'} [2024-08-06 08:31:27,611][52658] DAMAGECOUNT value on done: 994119.0 [2024-08-06 08:31:27,614][52658] Sum rewards: 93.620, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.003', 'weapon4': '0.018', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '3.076', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.114', 'FRAGCOUNT': '76.000'} [2024-08-06 08:31:27,729][52671] DAMAGECOUNT value on done: 998037.0 [2024-08-06 08:31:27,730][52671] Sum rewards: 80.029, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.982', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.168', 'AMMO4': '0.173', 'weapon4': '0.188', 'AMMO3': '0.221', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '21.267', 'FRAGCOUNT': '66.000'} [2024-08-06 08:31:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 694788096. Throughput: 0: 4362.0. Samples: 173706240. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:31:27,795][52567] Avg episode reward: [(0, '77.957')] [2024-08-06 08:31:29,273][52669] DAMAGECOUNT value on done: 1000110.0 [2024-08-06 08:31:29,274][52669] Sum rewards: 81.527, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.290', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon5': '0.146', 'AMMO4': '0.173', 'AMMO3': '0.179', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '2.918', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '65.000'} [2024-08-06 08:31:29,669][52803] DAMAGECOUNT value on done: 914049.0 [2024-08-06 08:31:29,677][52803] Sum rewards: 81.739, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.732', 'AMMO5': '0.006', 'AMMO2': '0.035', 'weapon5': '0.082', 'weapon4': '0.124', 'AMMO4': '0.173', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:30,020][52820] DAMAGECOUNT value on done: 910906.0 [2024-08-06 08:31:30,021][52820] Sum rewards: 72.736, reward structure: {'DEATHCOUNT': '-19.500', 'HEALTH': '-4.710', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'weapon5': '0.134', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.364', 'WEAPON3': '2.200', 'weapon3': '3.298', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '67.500'} [2024-08-06 08:31:30,494][52658] DAMAGECOUNT value on done: 979071.0 [2024-08-06 08:31:30,494][52658] Sum rewards: 73.870, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.205', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.190', 'weapon5': '0.204', 'weapon4': '0.218', 'AMMO4': '0.242', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.832', 'WEAPON3': '1.150', 'weapon3': '2.490', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.472', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:30,643][52671] DAMAGECOUNT value on done: 977262.0 [2024-08-06 08:31:30,644][52671] Sum rewards: 74.601, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.480', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.032', 'AMMO4': '0.083', 'AMMO3': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.258', 'WEAPON3': '0.750', 'HITCOUNT': '3.090', 'weapon3': '3.576', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 08:31:31,254][52650] Updated weights for policy 0, policy_version 84821 (0.0022) [2024-08-06 08:31:31,901][52663] DAMAGECOUNT value on done: 1003260.0 [2024-08-06 08:31:31,903][52663] Sum rewards: 72.980, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.692', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.249', 'WEAPON3': '1.450', 'weapon3': '3.438', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:32,032][52669] DAMAGECOUNT value on done: 991401.0 [2024-08-06 08:31:32,034][52669] Sum rewards: 73.052, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.094', 'AMMO3': '0.236', 'weapon5': '0.236', 'AMMO4': '0.253', 'weapon2': '0.288', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.108', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.090', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:32,241][52820] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:31:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17477.0, 300 sec: 17411.5). Total num frames: 694870016. Throughput: 0: 4358.9. Samples: 173719340. Policy #0 lag: (min: 0.0, avg: 3.7, max: 7.0) [2024-08-06 08:31:32,794][52567] Avg episode reward: [(0, '77.939')] [2024-08-06 08:31:32,858][52803] DAMAGECOUNT value on done: 923915.0 [2024-08-06 08:31:32,859][52803] Sum rewards: 74.846, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.056', 'weapon5': '0.166', 'AMMO4': '0.170', 'AMMO3': '0.269', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.216', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '62.000'} [2024-08-06 08:31:33,102][52820] DAMAGECOUNT value on done: 913589.0 [2024-08-06 08:31:33,104][52820] Sum rewards: 69.593, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.048', 'weapon5': '0.096', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '3.048', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '58.000'} [2024-08-06 08:31:33,746][52671] DAMAGECOUNT value on done: 992706.0 [2024-08-06 08:31:33,749][52671] Sum rewards: 70.366, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.464', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.076', 'AMMO4': '0.124', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.184', 'AMMO3': '0.205', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.420', 'DAMAGECOUNT': '16.743', 'FRAGCOUNT': '58.000'} [2024-08-06 08:31:33,774][52658] DAMAGECOUNT value on done: 1006943.0 [2024-08-06 08:31:33,775][52658] Sum rewards: 75.369, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.324', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.038', 'weapon5': '0.100', 'AMMO3': '0.136', 'AMMO4': '0.137', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '0.800', 'weapon3': '3.182', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '58.000'} [2024-08-06 08:31:35,237][52663] DAMAGECOUNT value on done: 988877.0 [2024-08-06 08:31:35,237][52663] Sum rewards: 81.150, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.295', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon4': '0.050', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.174', 'AMMO3': '0.203', 'WEAPON3': '1.350', 'weapon3': '3.498', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '67.000'} [2024-08-06 08:31:35,426][52669] DAMAGECOUNT value on done: 997810.0 [2024-08-06 08:31:35,426][52669] Sum rewards: 77.273, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.188', 'AMMO3': '0.195', 'weapon4': '0.236', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.618', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:35,910][52803] DAMAGECOUNT value on done: 924225.0 [2024-08-06 08:31:35,912][52803] Sum rewards: 64.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.200', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.160', 'AMMO3': '0.173', 'weapon5': '0.194', 'AMMO4': '0.249', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.848', 'FRAGCOUNT': '51.500'} [2024-08-06 08:31:36,091][52650] Updated weights for policy 0, policy_version 84831 (0.0013) [2024-08-06 08:31:36,104][52658] DAMAGECOUNT value on done: 995593.0 [2024-08-06 08:31:36,104][52658] Sum rewards: 77.504, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.704', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.080', 'weapon5': '0.108', 'AMMO4': '0.148', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.268', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '65.000'} [2024-08-06 08:31:36,230][52614] Signal inference workers to stop experience collection... (15550 times) [2024-08-06 08:31:36,231][52614] Signal inference workers to resume experience collection... (15550 times) [2024-08-06 08:31:36,254][52820] DAMAGECOUNT value on done: 916306.0 [2024-08-06 08:31:36,255][52820] Sum rewards: 87.505, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.494', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.154', 'AMMO4': '0.174', 'weapon5': '0.190', 'weapon2': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.434', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:36,286][52650] InferenceWorker_p0-w0: stopping experience collection (15550 times) [2024-08-06 08:31:36,294][52650] InferenceWorker_p0-w0: resuming experience collection (15550 times) [2024-08-06 08:31:36,615][52671] DAMAGECOUNT value on done: 992065.0 [2024-08-06 08:31:36,617][52671] Sum rewards: 76.574, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.435', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.090', 'AMMO4': '0.138', 'AMMO3': '0.165', 'weapon5': '0.170', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.000', 'weapon3': '3.168', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.262', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:37,569][52667] Large shaping reward 2.530 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.498, 166.0), ('weapon5', 0.002)] [2024-08-06 08:31:37,794][52567] Fps is (10 sec: 18841.8, 60 sec: 17749.6, 300 sec: 17494.8). Total num frames: 694976512. Throughput: 0: 4360.9. Samples: 173745530. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:31:37,794][52567] Avg episode reward: [(0, '77.607')] [2024-08-06 08:31:37,975][52663] DAMAGECOUNT value on done: 981993.0 [2024-08-06 08:31:37,978][52663] Sum rewards: 78.102, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.700', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.044', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.149', 'weapon2': '0.608', 'WEAPON3': '0.950', 'weapon3': '3.226', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:38,065][52669] DAMAGECOUNT value on done: 996251.0 [2024-08-06 08:31:38,065][52669] Sum rewards: 66.035, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.908', 'AMMO5': '0.020', 'AMMO2': '0.060', 'AMMO3': '0.131', 'weapon2': '0.192', 'weapon5': '0.252', 'AMMO4': '0.300', 'weapon4': '0.414', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '0.850', 'HITCOUNT': '2.880', 'weapon3': '2.914', 'DAMAGECOUNT': '15.480', 'FRAGCOUNT': '52.000'} [2024-08-06 08:31:38,972][52658] DAMAGECOUNT value on done: 1000239.0 [2024-08-06 08:31:38,974][52658] Sum rewards: 73.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.016', 'AMMO2': '0.071', 'weapon2': '0.216', 'AMMO3': '0.229', 'weapon5': '0.244', 'weapon4': '0.314', 'AMMO4': '0.357', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:39,119][52803] DAMAGECOUNT value on done: 930463.0 [2024-08-06 08:31:39,122][52803] Sum rewards: 85.451, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.655', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.032', 'AMMO4': '0.150', 'weapon5': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'weapon2': '0.244', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '70.000'} [2024-08-06 08:31:39,458][52671] DAMAGECOUNT value on done: 988525.0 [2024-08-06 08:31:39,458][52671] Sum rewards: 69.824, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.156', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.022', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon2': '0.168', 'AMMO3': '0.216', 'WEAPON3': '1.250', 'HITCOUNT': '3.140', 'weapon3': '3.620', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:39,482][52820] DAMAGECOUNT value on done: 904190.0 [2024-08-06 08:31:39,484][52820] Sum rewards: 79.902, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.094', 'AMMO4': '0.135', 'weapon4': '0.142', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.290', 'weapon2': '0.372', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:40,251][52650] Updated weights for policy 0, policy_version 84841 (0.0013) [2024-08-06 08:31:41,105][52663] DAMAGECOUNT value on done: 991470.0 [2024-08-06 08:31:41,105][52663] Sum rewards: 79.809, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.635', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.090', 'AMMO4': '0.156', 'weapon5': '0.190', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '66.000'} [2024-08-06 08:31:41,169][52669] DAMAGECOUNT value on done: 984855.0 [2024-08-06 08:31:41,170][52669] Sum rewards: 84.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.085', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.104', 'weapon4': '0.166', 'AMMO3': '0.201', 'AMMO4': '0.255', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:41,711][52658] DAMAGECOUNT value on done: 984473.0 [2024-08-06 08:31:41,711][52658] Sum rewards: 68.100, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.145', 'AMMO5': '0.017', 'AMMO2': '0.041', 'AMMO4': '0.205', 'AMMO3': '0.240', 'weapon5': '0.276', 'weapon4': '0.396', 'weapon2': '0.452', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.592', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.236', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:42,174][52803] DAMAGECOUNT value on done: 927003.0 [2024-08-06 08:31:42,175][52803] Sum rewards: 76.155, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.712', 'AMMO5': '0.014', 'AMMO2': '0.059', 'AMMO3': '0.210', 'weapon5': '0.234', 'AMMO4': '0.297', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'weapon2': '0.502', 'weapon4': '0.634', 'WEAPON3': '1.200', 'weapon3': '2.366', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 08:31:42,307][52671] DAMAGECOUNT value on done: 990838.0 [2024-08-06 08:31:42,309][52671] Sum rewards: 67.609, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.020', 'AMMO5': '0.017', 'AMMO2': '0.039', 'weapon4': '0.080', 'AMMO4': '0.197', 'weapon5': '0.198', 'weapon2': '0.222', 'AMMO3': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.950', 'weapon3': '3.216', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.204', 'FRAGCOUNT': '61.000'} [2024-08-06 08:31:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 695050240. Throughput: 0: 4365.1. Samples: 173771640. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:31:42,794][52567] Avg episode reward: [(0, '77.354')] [2024-08-06 08:31:42,963][52820] DAMAGECOUNT value on done: 914433.0 [2024-08-06 08:31:42,964][52820] Sum rewards: 77.412, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.330', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.057', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO3': '0.141', 'weapon4': '0.176', 'weapon2': '0.350', 'WEAPON3': '0.850', 'weapon3': '3.258', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:43,732][52663] DAMAGECOUNT value on done: 990130.0 [2024-08-06 08:31:43,732][52663] Sum rewards: 90.157, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.030', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.152', 'AMMO3': '0.243', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.440', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.591', 'FRAGCOUNT': '74.000'} [2024-08-06 08:31:43,785][52669] DAMAGECOUNT value on done: 986834.0 [2024-08-06 08:31:43,786][52669] Sum rewards: 79.911, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.295', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.086', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:44,501][52658] DAMAGECOUNT value on done: 996324.0 [2024-08-06 08:31:44,501][52658] Sum rewards: 72.016, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.088', 'weapon5': '0.184', 'AMMO3': '0.212', 'AMMO4': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.316', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:45,079][52671] DAMAGECOUNT value on done: 993919.0 [2024-08-06 08:31:45,079][52671] Sum rewards: 81.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.590', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.092', 'weapon2': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon4': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.370', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '67.000'} [2024-08-06 08:31:45,228][52650] Updated weights for policy 0, policy_version 84851 (0.0026) [2024-08-06 08:31:45,233][52803] DAMAGECOUNT value on done: 923693.0 [2024-08-06 08:31:45,238][52803] Sum rewards: 74.614, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.870', 'AMMO5': '0.010', 'AMMO2': '0.055', 'weapon5': '0.098', 'weapon4': '0.214', 'AMMO4': '0.277', 'AMMO3': '0.284', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.958', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.404', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:46,068][52820] DAMAGECOUNT value on done: 900796.0 [2024-08-06 08:31:46,068][52820] Sum rewards: 86.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.088', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.268', 'weapon2': '0.354', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.162', 'FRAGCOUNT': '73.000'} [2024-08-06 08:31:46,419][52649] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0)] [2024-08-06 08:31:46,703][52669] DAMAGECOUNT value on done: 994750.0 [2024-08-06 08:31:46,703][52669] Sum rewards: 88.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.995', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.014', 'AMMO4': '0.057', 'weapon5': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.222', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '21.003', 'FRAGCOUNT': '72.000'} [2024-08-06 08:31:46,711][52663] DAMAGECOUNT value on done: 995298.0 [2024-08-06 08:31:46,711][52663] Sum rewards: 80.047, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.656', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON5': '0.050', 'WEAPON4': '0.050', 'AMMO4': '0.061', 'weapon5': '0.126', 'weapon4': '0.138', 'AMMO3': '0.170', 'weapon2': '0.756', 'WEAPON3': '1.150', 'weapon3': '2.872', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '63.500'} [2024-08-06 08:31:47,008][52658] DAMAGECOUNT value on done: 987218.0 [2024-08-06 08:31:47,008][52658] Sum rewards: 69.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.915', 'AMMO5': '0.018', 'AMMO2': '0.052', 'weapon4': '0.120', 'AMMO3': '0.200', 'weapon2': '0.244', 'weapon5': '0.246', 'AMMO4': '0.260', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '59.000'} [2024-08-06 08:31:47,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 695140352. Throughput: 0: 4365.6. Samples: 173784650. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:31:47,794][52567] Avg episode reward: [(0, '77.303')] [2024-08-06 08:31:48,172][52671] DAMAGECOUNT value on done: 977816.0 [2024-08-06 08:31:48,175][52671] Sum rewards: 68.370, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.836', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon4': '0.130', 'weapon5': '0.188', 'AMMO3': '0.241', 'AMMO4': '0.303', 'weapon2': '0.308', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.010', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '58.000'} [2024-08-06 08:31:49,254][52820] DAMAGECOUNT value on done: 907141.0 [2024-08-06 08:31:49,257][52820] Sum rewards: 75.935, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.852', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.074', 'weapon5': '0.162', 'AMMO4': '0.185', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.550', 'weapon3': '3.020', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:49,524][52669] DAMAGECOUNT value on done: 1013062.0 [2024-08-06 08:31:49,525][52669] Sum rewards: 79.179, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.363', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.142', 'AMMO4': '0.188', 'AMMO3': '0.200', 'weapon2': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '67.000'} [2024-08-06 08:31:49,596][52663] DAMAGECOUNT value on done: 987471.0 [2024-08-06 08:31:49,596][52663] Sum rewards: 75.715, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.886', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.132', 'weapon2': '0.184', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON3': '1.300', 'weapon3': '2.952', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '63.000'} [2024-08-06 08:31:49,719][52650] Updated weights for policy 0, policy_version 84861 (0.0011) [2024-08-06 08:31:49,766][52658] DAMAGECOUNT value on done: 990374.0 [2024-08-06 08:31:49,768][52658] Sum rewards: 75.669, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.117', 'weapon5': '0.180', 'WEAPON4': '0.250', 'AMMO3': '0.273', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.246', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '63.500'} [2024-08-06 08:31:51,302][52671] DAMAGECOUNT value on done: 1003057.0 [2024-08-06 08:31:51,303][52671] Sum rewards: 75.024, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.589', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.136', 'weapon5': '0.142', 'AMMO3': '0.145', 'AMMO4': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '0.900', 'weapon3': '3.252', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '59.000'} [2024-08-06 08:31:51,430][52794] DAMAGECOUNT value on done: 983632.0 [2024-08-06 08:31:51,430][52794] Sum rewards: 63.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.142', 'AMMO4': '0.191', 'AMMO3': '0.267', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.268', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '56.000'} [2024-08-06 08:31:52,178][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:31:52,390][52820] DAMAGECOUNT value on done: 910419.0 [2024-08-06 08:31:52,390][52820] Sum rewards: 72.829, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.019', 'AMMO2': '0.046', 'weapon4': '0.124', 'AMMO3': '0.208', 'AMMO4': '0.230', 'weapon5': '0.258', 'weapon2': '0.352', 'HEALTH': '0.397', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:52,455][52658] DAMAGECOUNT value on done: 976868.0 [2024-08-06 08:31:52,457][52658] Sum rewards: 77.711, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'AMMO5': '0.021', 'AMMO2': '0.062', 'AMMO3': '0.172', 'AMMO4': '0.311', 'weapon4': '0.338', 'weapon5': '0.338', 'weapon2': '0.350', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.650', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:52,554][52669] DAMAGECOUNT value on done: 1001440.0 [2024-08-06 08:31:52,555][52669] Sum rewards: 87.681, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.678', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.362', 'WEAPON3': '1.300', 'weapon3': '3.416', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.606', 'FRAGCOUNT': '70.000'} [2024-08-06 08:31:52,667][52663] DAMAGECOUNT value on done: 973165.0 [2024-08-06 08:31:52,669][52663] Sum rewards: 85.020, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.176', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.083', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon4': '0.186', 'weapon2': '0.308', 'WEAPON3': '1.100', 'weapon3': '3.186', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '68.000'} [2024-08-06 08:31:52,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 695230464. Throughput: 0: 4364.4. Samples: 173810930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:31:52,794][52567] Avg episode reward: [(0, '76.998')] [2024-08-06 08:31:53,975][52671] DAMAGECOUNT value on done: 999812.0 [2024-08-06 08:31:53,975][52671] Sum rewards: 68.003, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.084', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon4': '0.086', 'AMMO3': '0.150', 'weapon5': '0.168', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.766', 'WEAPON3': '1.050', 'weapon3': '2.744', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.753', 'FRAGCOUNT': '55.000'} [2024-08-06 08:31:54,181][52794] DAMAGECOUNT value on done: 991476.0 [2024-08-06 08:31:54,181][52794] Sum rewards: 77.204, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.788', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.140', 'weapon4': '0.148', 'AMMO3': '0.201', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '64.000'} [2024-08-06 08:31:54,919][52650] Updated weights for policy 0, policy_version 84871 (0.0018) [2024-08-06 08:31:55,435][52658] DAMAGECOUNT value on done: 992947.0 [2024-08-06 08:31:55,436][52658] Sum rewards: 84.619, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.056', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'weapon5': '0.172', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '70.000'} [2024-08-06 08:31:55,654][52669] DAMAGECOUNT value on done: 998356.0 [2024-08-06 08:31:55,655][52669] Sum rewards: 78.601, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.215', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.060', 'AMMO4': '0.095', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '66.000'} [2024-08-06 08:31:55,753][52663] DAMAGECOUNT value on done: 985023.0 [2024-08-06 08:31:55,755][52663] Sum rewards: 86.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.640', 'AMMO5': '0.012', 'AMMO2': '0.042', 'AMMO3': '0.180', 'AMMO4': '0.210', 'weapon5': '0.210', 'weapon2': '0.248', 'weapon4': '0.284', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.986', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '69.000'} [2024-08-06 08:31:55,754][52820] DAMAGECOUNT value on done: 916924.0 [2024-08-06 08:31:55,757][52820] Sum rewards: 67.143, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.044', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon5': '0.074', 'AMMO4': '0.087', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon4': '0.246', 'WEAPON4': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '55.000'} [2024-08-06 08:31:56,699][52671] DAMAGECOUNT value on done: 992247.0 [2024-08-06 08:31:56,699][52671] Sum rewards: 70.059, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO2': '0.013', 'AMMO4': '0.065', 'HEALTH': '0.090', 'AMMO3': '0.207', 'weapon2': '0.770', 'WEAPON3': '1.200', 'weapon3': '3.080', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.095', 'FRAGCOUNT': '58.000'} [2024-08-06 08:31:57,218][52794] DAMAGECOUNT value on done: 997614.0 [2024-08-06 08:31:57,219][52794] Sum rewards: 65.645, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.163', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.104', 'weapon5': '0.154', 'AMMO4': '0.186', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.550', 'weapon3': '3.060', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '56.500'} [2024-08-06 08:31:57,566][52647] DAMAGECOUNT value on done: 1051416.0 [2024-08-06 08:31:57,567][52647] Sum rewards: 63.017, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.688', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon5': '0.108', 'AMMO4': '0.233', 'AMMO3': '0.234', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.260', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.166', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '53.000'} [2024-08-06 08:31:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.3). Total num frames: 695312384. Throughput: 0: 4367.5. Samples: 173837090. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:31:57,795][52567] Avg episode reward: [(0, '76.687')] [2024-08-06 08:31:58,110][52658] DAMAGECOUNT value on done: 987242.0 [2024-08-06 08:31:58,111][52658] Sum rewards: 71.892, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.685', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.124', 'weapon4': '0.196', 'AMMO3': '0.209', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.300', 'weapon3': '3.054', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '59.000'} [2024-08-06 08:31:58,590][52664] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:31:58,739][52820] DAMAGECOUNT value on done: 924913.0 [2024-08-06 08:31:58,740][52820] Sum rewards: 76.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.285', 'AMMO5': '0.013', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.183', 'weapon5': '0.226', 'weapon4': '0.270', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.882', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '62.000'} [2024-08-06 08:31:58,826][52669] DAMAGECOUNT value on done: 1002807.0 [2024-08-06 08:31:58,826][52669] Sum rewards: 74.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.100', 'AMMO4': '0.102', 'weapon4': '0.110', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.526', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '60.000'} [2024-08-06 08:31:58,964][52663] DAMAGECOUNT value on done: 981274.0 [2024-08-06 08:31:58,966][52663] Sum rewards: 66.800, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.790', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.074', 'AMMO4': '0.104', 'AMMO3': '0.214', 'weapon2': '0.744', 'WEAPON3': '1.450', 'weapon3': '2.940', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '56.000'} [2024-08-06 08:31:59,278][52650] Updated weights for policy 0, policy_version 84881 (0.0023) [2024-08-06 08:31:59,778][52671] DAMAGECOUNT value on done: 998124.0 [2024-08-06 08:31:59,779][52671] Sum rewards: 65.534, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.040', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon5': '0.158', 'AMMO3': '0.215', 'AMMO4': '0.231', 'weapon2': '0.280', 'weapon4': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '2.958', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '54.000'} [2024-08-06 08:31:59,819][52795] DAMAGECOUNT value on done: 907906.0 [2024-08-06 08:31:59,821][52795] Sum rewards: 69.882, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.692', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.052', 'AMMO4': '0.112', 'weapon5': '0.132', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.348', 'DAMAGECOUNT': '16.182', 'FRAGCOUNT': '56.000'} [2024-08-06 08:32:00,152][52647] DAMAGECOUNT value on done: 1038663.0 [2024-08-06 08:32:00,152][52647] Sum rewards: 64.864, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.329', 'WEAPON1': '0.020', 'AMMO5': '0.026', 'AMMO2': '0.065', 'AMMO3': '0.163', 'weapon4': '0.168', 'weapon5': '0.280', 'AMMO4': '0.327', 'WEAPON4': '0.600', 'weapon2': '0.684', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.552', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '53.500'} [2024-08-06 08:32:00,377][52794] DAMAGECOUNT value on done: 983697.0 [2024-08-06 08:32:00,379][52794] Sum rewards: 73.478, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.335', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO4': '0.221', 'weapon2': '0.232', 'AMMO3': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.300', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.098', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:00,793][52658] DAMAGECOUNT value on done: 983015.0 [2024-08-06 08:32:00,793][52658] Sum rewards: 68.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.239', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.064', 'weapon5': '0.176', 'AMMO4': '0.202', 'AMMO3': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.550', 'weapon3': '3.220', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '59.000'} [2024-08-06 08:32:01,754][52669] DAMAGECOUNT value on done: 1004252.0 [2024-08-06 08:32:01,754][52669] Sum rewards: 79.003, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.034', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.152', 'weapon5': '0.166', 'AMMO3': '0.188', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.298', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.479', 'FRAGCOUNT': '64.000'} [2024-08-06 08:32:01,859][52820] DAMAGECOUNT value on done: 905125.0 [2024-08-06 08:32:01,864][52820] Sum rewards: 62.025, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.636', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.124', 'weapon5': '0.142', 'AMMO4': '0.180', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.350', 'weapon3': '3.090', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.903', 'FRAGCOUNT': '52.000'} [2024-08-06 08:32:01,884][52663] DAMAGECOUNT value on done: 989757.0 [2024-08-06 08:32:01,884][52663] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.850', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.048', 'weapon4': '0.048', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon2': '0.258', 'WEAPON3': '1.050', 'HITCOUNT': '3.200', 'weapon3': '3.520', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:02,775][52671] DAMAGECOUNT value on done: 981903.0 [2024-08-06 08:32:02,776][52671] Sum rewards: 79.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.016', 'AMMO4': '0.018', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.468', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '65.000'} [2024-08-06 08:32:02,788][52647] DAMAGECOUNT value on done: 1044781.0 [2024-08-06 08:32:02,788][52647] Sum rewards: 76.746, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.829', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.094', 'weapon5': '0.274', 'AMMO3': '0.286', 'AMMO4': '0.289', 'weapon2': '0.298', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.800', 'weapon3': '2.956', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.325', 'FRAGCOUNT': '66.000'} [2024-08-06 08:32:02,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 695394304. Throughput: 0: 4362.0. Samples: 173849940. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:32:02,794][52567] Avg episode reward: [(0, '75.925')] [2024-08-06 08:32:03,154][52795] DAMAGECOUNT value on done: 904075.0 [2024-08-06 08:32:03,154][52795] Sum rewards: 72.131, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.205', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon4': '0.098', 'weapon5': '0.174', 'AMMO3': '0.232', 'AMMO4': '0.263', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.709', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:03,472][52658] DAMAGECOUNT value on done: 993326.0 [2024-08-06 08:32:03,472][52658] Sum rewards: 80.346, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.890', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.138', 'weapon4': '0.174', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '68.000'} [2024-08-06 08:32:03,612][52794] DAMAGECOUNT value on done: 978809.0 [2024-08-06 08:32:03,615][52794] Sum rewards: 76.301, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.636', 'AMMO5': '0.013', 'AMMO2': '0.053', 'weapon2': '0.208', 'weapon5': '0.208', 'AMMO3': '0.248', 'AMMO4': '0.266', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.010', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '63.000'} [2024-08-06 08:32:03,916][52650] Updated weights for policy 0, policy_version 84891 (0.0020) [2024-08-06 08:32:04,421][52663] DAMAGECOUNT value on done: 975493.0 [2024-08-06 08:32:04,422][52663] Sum rewards: 68.186, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.790', 'AMMO5': '0.005', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.082', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO4': '0.219', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.436', 'DAMAGECOUNT': '16.662', 'FRAGCOUNT': '59.000'} [2024-08-06 08:32:04,972][52820] DAMAGECOUNT value on done: 918319.0 [2024-08-06 08:32:04,972][52820] Sum rewards: 84.300, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.963', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.166', 'AMMO4': '0.201', 'AMMO3': '0.242', 'weapon2': '0.246', 'weapon5': '0.254', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '70.000'} [2024-08-06 08:32:05,640][52647] DAMAGECOUNT value on done: 1042206.0 [2024-08-06 08:32:05,640][52647] Sum rewards: 89.396, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.450', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.044', 'weapon5': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.295', 'weapon2': '0.296', 'WEAPON3': '1.800', 'weapon3': '3.384', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.849', 'FRAGCOUNT': '77.000'} [2024-08-06 08:32:06,205][52795] DAMAGECOUNT value on done: 904792.0 [2024-08-06 08:32:06,205][52795] Sum rewards: 64.932, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.005', 'weapon4': '0.038', 'AMMO2': '0.044', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO4': '0.223', 'AMMO3': '0.231', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.424', 'DAMAGECOUNT': '16.365', 'FRAGCOUNT': '54.000'} [2024-08-06 08:32:06,841][52794] DAMAGECOUNT value on done: 982623.0 [2024-08-06 08:32:06,851][52794] Sum rewards: 71.838, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.767', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon4': '0.134', 'weapon5': '0.162', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.700', 'weapon3': '2.998', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:07,241][52663] DAMAGECOUNT value on done: 975125.0 [2024-08-06 08:32:07,243][52663] Sum rewards: 85.309, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.756', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.033', 'weapon5': '0.138', 'WEAPON4': '0.150', 'AMMO4': '0.163', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.070', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.084', 'FRAGCOUNT': '68.000'} [2024-08-06 08:32:07,633][52666] Large shaping reward 2.597 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5760000000000001, 192.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:32:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 695492608. Throughput: 0: 4356.9. Samples: 173876230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:32:07,794][52567] Avg episode reward: [(0, '75.977')] [2024-08-06 08:32:08,139][52820] DAMAGECOUNT value on done: 930954.0 [2024-08-06 08:32:08,141][52820] Sum rewards: 71.199, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.530', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'weapon5': '0.078', 'WEAPON5': '0.150', 'AMMO3': '0.275', 'weapon2': '0.362', 'WEAPON3': '1.750', 'weapon3': '3.336', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:08,400][52647] DAMAGECOUNT value on done: 1052534.0 [2024-08-06 08:32:08,400][52647] Sum rewards: 80.748, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.352', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.164', 'AMMO4': '0.182', 'weapon5': '0.186', 'AMMO3': '0.299', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.700', 'weapon3': '2.946', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.424', 'FRAGCOUNT': '68.000'} [2024-08-06 08:32:08,700][52650] Updated weights for policy 0, policy_version 84901 (0.0016) [2024-08-06 08:32:09,294][52795] DAMAGECOUNT value on done: 920570.0 [2024-08-06 08:32:09,295][52795] Sum rewards: 83.136, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.164', 'AMMO4': '0.175', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.228', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '66.000'} [2024-08-06 08:32:09,825][52794] DAMAGECOUNT value on done: 985408.0 [2024-08-06 08:32:09,827][52794] Sum rewards: 69.393, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.155', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.114', 'AMMO3': '0.160', 'weapon2': '0.698', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '55.000'} [2024-08-06 08:32:10,470][52663] DAMAGECOUNT value on done: 981900.0 [2024-08-06 08:32:10,472][52663] Sum rewards: 64.673, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.190', 'AMMO5': '0.022', 'AMMO2': '0.074', 'weapon4': '0.114', 'weapon2': '0.220', 'weapon5': '0.262', 'AMMO3': '0.287', 'AMMO4': '0.370', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.800', 'weapon3': '3.018', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '58.000'} [2024-08-06 08:32:11,262][52647] DAMAGECOUNT value on done: 1046420.0 [2024-08-06 08:32:11,263][52647] Sum rewards: 65.235, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.560', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.041', 'weapon5': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.159', 'AMMO4': '0.203', 'weapon2': '0.886', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.522', 'FRAGCOUNT': '52.000'} [2024-08-06 08:32:11,333][52820] DAMAGECOUNT value on done: 918063.0 [2024-08-06 08:32:11,333][52820] Sum rewards: 76.544, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.080', 'AMMO5': '0.020', 'AMMO2': '0.042', 'weapon4': '0.138', 'AMMO4': '0.208', 'AMMO3': '0.215', 'weapon5': '0.228', 'weapon2': '0.330', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '66.000'} [2024-08-06 08:32:12,417][52795] DAMAGECOUNT value on done: 904796.0 [2024-08-06 08:32:12,417][52795] Sum rewards: 88.029, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.394', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon2': '0.182', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.698', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.496', 'FRAGCOUNT': '73.000'} [2024-08-06 08:32:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 695574528. Throughput: 0: 4366.5. Samples: 173902730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:32:12,794][52567] Avg episode reward: [(0, '75.905')] [2024-08-06 08:32:12,888][52794] DAMAGECOUNT value on done: 975586.0 [2024-08-06 08:32:12,888][52794] Sum rewards: 79.667, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.025', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.090', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.290', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '63.000'} [2024-08-06 08:32:13,342][52650] Updated weights for policy 0, policy_version 84911 (0.0010) [2024-08-06 08:32:13,362][52663] DAMAGECOUNT value on done: 983837.0 [2024-08-06 08:32:13,363][52663] Sum rewards: 85.197, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.264', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.084', 'weapon4': '0.112', 'AMMO4': '0.126', 'AMMO3': '0.157', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.160', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '69.000'} [2024-08-06 08:32:14,346][52647] DAMAGECOUNT value on done: 1048650.0 [2024-08-06 08:32:14,347][52647] Sum rewards: 71.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.958', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.034', 'weapon5': '0.090', 'AMMO4': '0.113', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.300', 'HITCOUNT': '3.330', 'weapon3': '3.352', 'DAMAGECOUNT': '16.665', 'FRAGCOUNT': '59.500'} [2024-08-06 08:32:14,598][52820] DAMAGECOUNT value on done: 915844.0 [2024-08-06 08:32:14,600][52820] Sum rewards: 70.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.396', 'AMMO5': '0.008', 'AMMO2': '0.017', 'weapon4': '0.040', 'AMMO4': '0.087', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '58.000'} [2024-08-06 08:32:15,368][52794] DAMAGECOUNT value on done: 989385.0 [2024-08-06 08:32:15,369][52794] Sum rewards: 62.193, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.046', 'AMMO4': '0.141', 'weapon5': '0.186', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON3': '1.250', 'HITCOUNT': '2.820', 'weapon3': '3.094', 'DAMAGECOUNT': '15.483', 'FRAGCOUNT': '51.000'} [2024-08-06 08:32:15,455][52795] DAMAGECOUNT value on done: 907515.0 [2024-08-06 08:32:15,456][52795] Sum rewards: 74.727, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.092', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.312', 'WEAPON3': '1.500', 'weapon3': '3.380', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:16,374][52667] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:32:16,392][52663] DAMAGECOUNT value on done: 989370.0 [2024-08-06 08:32:16,393][52663] Sum rewards: 71.528, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.104', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.270', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '57.000'} [2024-08-06 08:32:17,087][52647] DAMAGECOUNT value on done: 1025662.0 [2024-08-06 08:32:17,088][52647] Sum rewards: 73.470, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.018', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.226', 'weapon5': '0.236', 'AMMO3': '0.240', 'weapon2': '0.244', 'AMMO4': '0.245', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:17,758][52820] DAMAGECOUNT value on done: 917918.0 [2024-08-06 08:32:17,766][52820] Sum rewards: 63.518, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.673', 'AMMO5': '0.017', 'AMMO2': '0.048', 'weapon4': '0.052', 'AMMO4': '0.238', 'weapon5': '0.260', 'AMMO3': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.466', 'WEAPON3': '1.500', 'weapon3': '2.868', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.626', 'FRAGCOUNT': '56.000'} [2024-08-06 08:32:17,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 695664640. Throughput: 0: 4371.5. Samples: 173916060. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:32:17,795][52567] Avg episode reward: [(0, '75.510')] [2024-08-06 08:32:17,956][52650] Updated weights for policy 0, policy_version 84921 (0.0010) [2024-08-06 08:32:18,469][52794] DAMAGECOUNT value on done: 986119.0 [2024-08-06 08:32:18,470][52794] Sum rewards: 82.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.354', 'AMMO5': '0.022', 'AMMO2': '0.051', 'AMMO3': '0.207', 'weapon4': '0.208', 'weapon5': '0.230', 'AMMO4': '0.254', 'weapon2': '0.376', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.850', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '68.000'} [2024-08-06 08:32:18,656][52795] DAMAGECOUNT value on done: 921273.0 [2024-08-06 08:32:18,656][52795] Sum rewards: 73.769, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.630', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.066', 'weapon4': '0.096', 'weapon2': '0.184', 'AMMO4': '0.242', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.368', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '65.000'} [2024-08-06 08:32:19,489][52663] DAMAGECOUNT value on done: 985916.0 [2024-08-06 08:32:19,489][52663] Sum rewards: 68.622, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.245', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.124', 'weapon4': '0.196', 'WEAPON5': '0.250', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.700', 'weapon3': '2.992', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:20,261][52647] DAMAGECOUNT value on done: 1040265.0 [2024-08-06 08:32:20,264][52647] Sum rewards: 62.010, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.835', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.148', 'weapon5': '0.164', 'weapon2': '0.224', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.270', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '53.000'} [2024-08-06 08:32:20,952][52820] DAMAGECOUNT value on done: 917646.0 [2024-08-06 08:32:20,954][52820] Sum rewards: 68.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.174', 'AMMO3': '0.196', 'AMMO4': '0.221', 'weapon2': '0.330', 'WEAPON5': '0.400', 'weapon4': '0.478', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.740', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '55.000'} [2024-08-06 08:32:21,120][52794] DAMAGECOUNT value on done: 976120.0 [2024-08-06 08:32:21,123][52794] Sum rewards: 85.423, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.372', 'AMMO5': '0.012', 'AMMO2': '0.035', 'AMMO4': '0.177', 'weapon5': '0.190', 'AMMO3': '0.191', 'WEAPON5': '0.300', 'weapon4': '0.304', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.898', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '69.000'} [2024-08-06 08:32:21,801][52795] DAMAGECOUNT value on done: 910415.0 [2024-08-06 08:32:21,802][52795] Sum rewards: 67.928, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.038', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.016', 'weapon5': '0.056', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.271', 'WEAPON3': '1.600', 'HITCOUNT': '3.130', 'weapon3': '3.510', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '59.000'} [2024-08-06 08:32:22,468][52663] DAMAGECOUNT value on done: 991156.0 [2024-08-06 08:32:22,468][52663] Sum rewards: 64.115, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.642', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'WEAPON4': '0.200', 'weapon5': '0.208', 'AMMO3': '0.230', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.400', 'weapon3': '2.594', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '15.993', 'FRAGCOUNT': '56.000'} [2024-08-06 08:32:22,707][52650] Updated weights for policy 0, policy_version 84931 (0.0013) [2024-08-06 08:32:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 695754752. Throughput: 0: 4369.1. Samples: 173942140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:32:22,802][52567] Avg episode reward: [(0, '74.755')] [2024-08-06 08:32:23,129][52647] DAMAGECOUNT value on done: 1033696.0 [2024-08-06 08:32:23,132][52647] Sum rewards: 64.454, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.655', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.074', 'weapon5': '0.164', 'AMMO4': '0.168', 'AMMO3': '0.291', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.700', 'HITCOUNT': '3.030', 'weapon3': '3.166', 'DAMAGECOUNT': '15.552', 'FRAGCOUNT': '57.000'} [2024-08-06 08:32:23,571][52794] DAMAGECOUNT value on done: 991894.0 [2024-08-06 08:32:23,575][52794] Sum rewards: 83.816, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.040', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.034', 'weapon5': '0.102', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.378', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '70.000'} [2024-08-06 08:32:24,191][52820] DAMAGECOUNT value on done: 924397.0 [2024-08-06 08:32:24,194][52820] Sum rewards: 87.609, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.036', 'AMMO4': '0.096', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '70.500'} [2024-08-06 08:32:24,899][52795] DAMAGECOUNT value on done: 912276.0 [2024-08-06 08:32:24,899][52795] Sum rewards: 88.263, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.278', 'AMMO5': '0.013', 'AMMO2': '0.021', 'AMMO4': '0.102', 'AMMO3': '0.183', 'weapon5': '0.242', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '2.796', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '70.000'} [2024-08-06 08:32:25,209][52670] DAMAGECOUNT value on done: 971979.0 [2024-08-06 08:32:25,209][52670] Sum rewards: 66.667, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.432', 'AMMO5': '0.020', 'AMMO2': '0.040', 'AMMO3': '0.174', 'weapon4': '0.190', 'AMMO4': '0.200', 'weapon5': '0.200', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.962', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.101', 'FRAGCOUNT': '54.000'} [2024-08-06 08:32:25,449][52663] DAMAGECOUNT value on done: 999018.0 [2024-08-06 08:32:25,449][52663] Sum rewards: 70.486, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.042', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon5': '0.116', 'AMMO4': '0.150', 'WEAPON5': '0.200', 'weapon2': '0.240', 'AMMO3': '0.285', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.010', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.954', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:25,702][52647] DAMAGECOUNT value on done: 1036454.0 [2024-08-06 08:32:25,702][52647] Sum rewards: 72.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.090', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.074', 'weapon4': '0.116', 'AMMO4': '0.178', 'AMMO3': '0.190', 'weapon2': '0.260', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.346', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.989', 'FRAGCOUNT': '59.000'} [2024-08-06 08:32:26,783][52794] DAMAGECOUNT value on done: 986116.0 [2024-08-06 08:32:26,786][52794] Sum rewards: 79.145, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.288', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.132', 'AMMO3': '0.249', 'weapon4': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '2.908', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.457', 'FRAGCOUNT': '66.000'} [2024-08-06 08:32:27,078][52650] Updated weights for policy 0, policy_version 84941 (0.0018) [2024-08-06 08:32:27,210][52820] DAMAGECOUNT value on done: 925466.0 [2024-08-06 08:32:27,213][52820] Sum rewards: 76.422, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.010', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.204', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 08:32:27,779][52670] DAMAGECOUNT value on done: 993556.0 [2024-08-06 08:32:27,779][52670] Sum rewards: 74.411, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.088', 'weapon4': '0.158', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.550', 'weapon3': '2.884', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:27,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 695844864. Throughput: 0: 4374.7. Samples: 173968500. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:32:27,794][52567] Avg episode reward: [(0, '75.009')] [2024-08-06 08:32:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084942_695844864.pth... [2024-08-06 08:32:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084431_691658752.pth [2024-08-06 08:32:27,988][52795] DAMAGECOUNT value on done: 918613.0 [2024-08-06 08:32:27,989][52795] Sum rewards: 76.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.056', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.099', 'weapon5': '0.128', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '1.000', 'HITCOUNT': '3.340', 'weapon3': '3.382', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:28,274][52647] DAMAGECOUNT value on done: 1034933.0 [2024-08-06 08:32:28,276][52647] Sum rewards: 82.524, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.890', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.046', 'weapon5': '0.096', 'AMMO4': '0.121', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.450', 'weapon3': '3.046', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.992', 'FRAGCOUNT': '69.000'} [2024-08-06 08:32:28,743][52663] DAMAGECOUNT value on done: 977039.0 [2024-08-06 08:32:28,743][52663] Sum rewards: 72.393, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.050', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.124', 'AMMO4': '0.128', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.450', 'weapon3': '3.294', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:29,327][52811] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:32:29,635][52794] DAMAGECOUNT value on done: 998781.0 [2024-08-06 08:32:29,636][52794] Sum rewards: 74.496, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.894', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.184', 'AMMO3': '0.209', 'weapon5': '0.228', 'AMMO4': '0.271', 'weapon2': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:30,393][52820] DAMAGECOUNT value on done: 912658.0 [2024-08-06 08:32:30,393][52820] Sum rewards: 83.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.145', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.102', 'AMMO4': '0.117', 'weapon5': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON3': '1.350', 'weapon3': '3.266', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '69.000'} [2024-08-06 08:32:30,673][52794] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:32:30,784][52670] DAMAGECOUNT value on done: 974312.0 [2024-08-06 08:32:30,785][52670] Sum rewards: 72.711, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.104', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.110', 'AMMO4': '0.184', 'weapon5': '0.214', 'AMMO3': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '2.812', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:30,863][52647] DAMAGECOUNT value on done: 1041546.0 [2024-08-06 08:32:30,863][52647] Sum rewards: 81.267, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.460', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.181', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.576', 'WEAPON3': '1.500', 'weapon3': '2.910', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '68.000'} [2024-08-06 08:32:31,178][52795] DAMAGECOUNT value on done: 914307.0 [2024-08-06 08:32:31,179][52795] Sum rewards: 87.552, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'AMMO4': '0.086', 'weapon5': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.388', 'WEAPON3': '1.650', 'weapon3': '3.184', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.490', 'FRAGCOUNT': '75.000'} [2024-08-06 08:32:32,270][52650] Updated weights for policy 0, policy_version 84951 (0.0033) [2024-08-06 08:32:32,614][52811] Large shaping reward 2.642 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:32:32,765][52794] DAMAGECOUNT value on done: 980325.0 [2024-08-06 08:32:32,766][52794] Sum rewards: 76.992, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.036', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.202', 'AMMO4': '0.203', 'AMMO3': '0.207', 'weapon5': '0.220', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.976', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '64.000'} [2024-08-06 08:32:32,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17749.3, 300 sec: 17494.8). Total num frames: 695934976. Throughput: 0: 4370.7. Samples: 173981330. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:32:32,795][52567] Avg episode reward: [(0, '75.104')] [2024-08-06 08:32:33,062][52666] DAMAGECOUNT value on done: 985242.0 [2024-08-06 08:32:33,062][52666] Sum rewards: 75.079, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.784', 'AMMO5': '0.012', 'AMMO2': '0.053', 'weapon4': '0.134', 'AMMO3': '0.148', 'weapon5': '0.156', 'AMMO4': '0.263', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.528', 'WEAPON3': '0.950', 'weapon3': '3.012', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '59.000'} [2024-08-06 08:32:33,379][52670] DAMAGECOUNT value on done: 975986.0 [2024-08-06 08:32:33,381][52670] Sum rewards: 72.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.252', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.082', 'weapon4': '0.096', 'AMMO4': '0.145', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '59.000'} [2024-08-06 08:32:33,564][52647] DAMAGECOUNT value on done: 1035281.0 [2024-08-06 08:32:33,566][52647] Sum rewards: 78.298, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.570', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.148', 'AMMO3': '0.166', 'weapon4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.200', 'weapon3': '3.002', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '64.000'} [2024-08-06 08:32:34,344][52795] DAMAGECOUNT value on done: 904715.0 [2024-08-06 08:32:34,347][52795] Sum rewards: 60.882, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.356', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon5': '0.126', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.326', 'weapon4': '0.374', 'WEAPON3': '0.900', 'weapon3': '2.578', 'HITCOUNT': '2.820', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '48.000'} [2024-08-06 08:32:35,752][52666] DAMAGECOUNT value on done: 985241.0 [2024-08-06 08:32:35,753][52666] Sum rewards: 75.023, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.850', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.113', 'AMMO3': '0.164', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '3.376', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:35,797][52794] DAMAGECOUNT value on done: 992055.0 [2024-08-06 08:32:35,797][52794] Sum rewards: 80.777, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon5': '0.044', 'weapon4': '0.060', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.242', 'WEAPON3': '1.150', 'HITCOUNT': '3.490', 'weapon3': '3.498', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '66.000'} [2024-08-06 08:32:36,032][52647] DAMAGECOUNT value on done: 1042523.0 [2024-08-06 08:32:36,033][52647] Sum rewards: 75.152, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.790', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon4': '0.062', 'AMMO4': '0.211', 'weapon5': '0.220', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '64.000'} [2024-08-06 08:32:36,126][52670] DAMAGECOUNT value on done: 988305.0 [2024-08-06 08:32:36,127][52670] Sum rewards: 73.518, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.244', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon4': '0.152', 'weapon5': '0.172', 'WEAPON5': '0.250', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.048', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:36,604][52650] Updated weights for policy 0, policy_version 84961 (0.0011) [2024-08-06 08:32:37,464][52795] DAMAGECOUNT value on done: 911172.0 [2024-08-06 08:32:37,466][52795] Sum rewards: 85.968, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.090', 'AMMO4': '0.091', 'weapon4': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '3.122', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '73.000'} [2024-08-06 08:32:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 696008704. Throughput: 0: 4369.8. Samples: 174007570. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:32:37,794][52567] Avg episode reward: [(0, '74.919')] [2024-08-06 08:32:38,477][52666] DAMAGECOUNT value on done: 991513.0 [2024-08-06 08:32:38,477][52666] Sum rewards: 79.256, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.670', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.080', 'weapon5': '0.208', 'AMMO3': '0.230', 'AMMO4': '0.236', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.034', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.190', 'FRAGCOUNT': '65.000'} [2024-08-06 08:32:38,504][52794] DAMAGECOUNT value on done: 986703.0 [2024-08-06 08:32:38,506][52794] Sum rewards: 79.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.135', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.096', 'AMMO4': '0.181', 'weapon5': '0.202', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '64.000'} [2024-08-06 08:32:38,707][52670] DAMAGECOUNT value on done: 977361.0 [2024-08-06 08:32:38,707][52670] Sum rewards: 72.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.092', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'weapon4': '0.160', 'AMMO3': '0.233', 'weapon2': '0.308', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:38,755][52647] DAMAGECOUNT value on done: 1042064.0 [2024-08-06 08:32:38,755][52647] Sum rewards: 68.789, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.014', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.078', 'weapon5': '0.106', 'AMMO3': '0.183', 'AMMO4': '0.244', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.300', 'DAMAGECOUNT': '15.963', 'FRAGCOUNT': '58.000'} [2024-08-06 08:32:39,873][52668] DAMAGECOUNT value on done: 996337.0 [2024-08-06 08:32:39,873][52668] Sum rewards: 86.945, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.182', 'AMMO3': '0.208', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '3.046', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '71.000'} [2024-08-06 08:32:40,595][52795] DAMAGECOUNT value on done: 917972.0 [2024-08-06 08:32:40,597][52795] Sum rewards: 91.884, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.467', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'AMMO3': '0.137', 'weapon5': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.478', 'weapon4': '0.520', 'WEAPON3': '0.850', 'weapon3': '2.602', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '21.126', 'FRAGCOUNT': '70.000'} [2024-08-06 08:32:41,496][52650] Updated weights for policy 0, policy_version 84971 (0.0047) [2024-08-06 08:32:41,523][52666] DAMAGECOUNT value on done: 985396.0 [2024-08-06 08:32:41,527][52666] Sum rewards: 71.305, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.700', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'weapon2': '0.228', 'AMMO3': '0.242', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.280', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:41,720][52794] DAMAGECOUNT value on done: 995446.0 [2024-08-06 08:32:41,721][52794] Sum rewards: 72.547, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.264', 'AMMO5': '0.017', 'AMMO2': '0.054', 'weapon4': '0.106', 'weapon5': '0.164', 'weapon2': '0.198', 'AMMO3': '0.251', 'AMMO4': '0.269', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.282', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '63.000'} [2024-08-06 08:32:41,796][52647] DAMAGECOUNT value on done: 1028607.0 [2024-08-06 08:32:41,797][52647] Sum rewards: 69.061, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.090', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon5': '0.192', 'AMMO3': '0.208', 'AMMO4': '0.219', 'weapon4': '0.234', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '57.000'} [2024-08-06 08:32:41,947][52670] DAMAGECOUNT value on done: 972219.0 [2024-08-06 08:32:41,947][52670] Sum rewards: 68.859, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.998', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.144', 'AMMO3': '0.183', 'weapon4': '0.218', 'weapon5': '0.222', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '56.000'} [2024-08-06 08:32:42,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 696107008. Throughput: 0: 4370.0. Samples: 174033740. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:32:42,794][52567] Avg episode reward: [(0, '74.775')] [2024-08-06 08:32:42,914][52668] DAMAGECOUNT value on done: 995281.0 [2024-08-06 08:32:42,915][52668] Sum rewards: 90.835, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.128', 'weapon5': '0.128', 'weapon2': '0.204', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '73.000'} [2024-08-06 08:32:43,770][52795] DAMAGECOUNT value on done: 902811.0 [2024-08-06 08:32:43,770][52795] Sum rewards: 71.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.945', 'AMMO2': '0.013', 'WEAPON4': '0.050', 'weapon4': '0.056', 'AMMO4': '0.064', 'AMMO3': '0.216', 'weapon2': '0.276', 'WEAPON3': '1.450', 'HITCOUNT': '3.520', 'weapon3': '3.538', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:44,127][52647] DAMAGECOUNT value on done: 1039591.0 [2024-08-06 08:32:44,127][52647] Sum rewards: 75.116, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.670', 'AMMO5': '0.015', 'AMMO2': '0.063', 'weapon4': '0.082', 'weapon5': '0.270', 'AMMO3': '0.304', 'AMMO4': '0.314', 'weapon2': '0.380', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.900', 'weapon3': '2.940', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '65.000'} [2024-08-06 08:32:44,477][52794] DAMAGECOUNT value on done: 1000032.0 [2024-08-06 08:32:44,479][52794] Sum rewards: 70.866, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.246', 'AMMO5': '0.024', 'AMMO2': '0.054', 'weapon4': '0.168', 'AMMO3': '0.215', 'AMMO4': '0.267', 'weapon5': '0.302', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.830', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '59.000'} [2024-08-06 08:32:44,661][52666] DAMAGECOUNT value on done: 978878.0 [2024-08-06 08:32:44,663][52666] Sum rewards: 74.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.850', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.042', 'AMMO4': '0.154', 'weapon5': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.200', 'weapon3': '3.200', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:45,124][52670] DAMAGECOUNT value on done: 976227.0 [2024-08-06 08:32:45,125][52670] Sum rewards: 84.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.992', 'AMMO5': '0.024', 'AMMO2': '0.055', 'weapon4': '0.090', 'AMMO3': '0.164', 'weapon5': '0.232', 'AMMO4': '0.275', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '68.000'} [2024-08-06 08:32:46,128][52668] DAMAGECOUNT value on done: 990699.0 [2024-08-06 08:32:46,129][52668] Sum rewards: 73.053, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.416', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.147', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.672', 'WEAPON3': '1.150', 'weapon3': '2.992', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:46,845][52650] Updated weights for policy 0, policy_version 84981 (0.0012) [2024-08-06 08:32:46,858][52795] DAMAGECOUNT value on done: 915508.0 [2024-08-06 08:32:46,858][52795] Sum rewards: 84.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.996', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon5': '0.088', 'weapon4': '0.104', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '70.000'} [2024-08-06 08:32:46,925][52794] DAMAGECOUNT value on done: 989525.0 [2024-08-06 08:32:46,926][52794] Sum rewards: 67.552, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.190', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.052', 'AMMO4': '0.152', 'AMMO3': '0.169', 'weapon5': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.750', 'WEAPON3': '1.150', 'weapon3': '2.854', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '53.500'} [2024-08-06 08:32:47,052][52665] DAMAGECOUNT value on done: 975895.0 [2024-08-06 08:32:47,053][52665] Sum rewards: 84.948, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.210', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.208', 'AMMO3': '0.222', 'WEAPON3': '1.350', 'weapon3': '3.492', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '70.000'} [2024-08-06 08:32:47,178][52647] DAMAGECOUNT value on done: 1030013.0 [2024-08-06 08:32:47,178][52647] Sum rewards: 74.251, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.264', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.116', 'AMMO4': '0.142', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO3': '0.263', 'WEAPON3': '1.700', 'weapon3': '3.316', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '65.000'} [2024-08-06 08:32:47,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 696188928. Throughput: 0: 4376.9. Samples: 174046900. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:32:47,795][52567] Avg episode reward: [(0, '74.782')] [2024-08-06 08:32:47,898][52666] DAMAGECOUNT value on done: 980363.0 [2024-08-06 08:32:47,898][52666] Sum rewards: 63.870, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.260', 'AMMO5': '0.019', 'AMMO2': '0.065', 'AMMO3': '0.246', 'weapon2': '0.250', 'weapon5': '0.274', 'AMMO4': '0.326', 'weapon4': '0.398', 'WEAPON5': '0.500', 'WEAPON4': '0.700', 'WEAPON3': '1.450', 'weapon3': '2.750', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '55.000'} [2024-08-06 08:32:48,328][52670] DAMAGECOUNT value on done: 975283.0 [2024-08-06 08:32:48,330][52670] Sum rewards: 81.472, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.254', 'AMMO5': '0.026', 'AMMO2': '0.067', 'weapon4': '0.126', 'AMMO3': '0.203', 'AMMO4': '0.337', 'weapon5': '0.342', 'weapon2': '0.364', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.820', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '67.000'} [2024-08-06 08:32:49,124][52668] DAMAGECOUNT value on done: 996137.0 [2024-08-06 08:32:49,136][52668] Sum rewards: 72.590, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.727', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO4': '0.180', 'weapon2': '0.182', 'AMMO3': '0.208', 'weapon4': '0.210', 'weapon5': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.140', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:49,708][52665] DAMAGECOUNT value on done: 986937.0 [2024-08-06 08:32:49,709][52665] Sum rewards: 74.547, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.460', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.252', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '63.000'} [2024-08-06 08:32:49,961][52795] DAMAGECOUNT value on done: 913756.0 [2024-08-06 08:32:49,964][52795] Sum rewards: 83.871, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.640', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon5': '0.108', 'weapon4': '0.116', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'weapon2': '0.362', 'WEAPON3': '1.250', 'weapon3': '3.186', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '69.000'} [2024-08-06 08:32:50,138][52647] DAMAGECOUNT value on done: 1032158.0 [2024-08-06 08:32:50,138][52647] Sum rewards: 69.778, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.505', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon4': '0.106', 'AMMO3': '0.162', 'weapon5': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'ARMOR': '0.457', 'weapon2': '0.520', 'WEAPON3': '1.050', 'HITCOUNT': '2.860', 'weapon3': '2.982', 'DAMAGECOUNT': '15.831', 'FRAGCOUNT': '57.000'} [2024-08-06 08:32:50,763][52650] Updated weights for policy 0, policy_version 84991 (0.0014) [2024-08-06 08:32:51,203][52666] DAMAGECOUNT value on done: 982843.0 [2024-08-06 08:32:51,204][52666] Sum rewards: 91.506, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.038', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.188', 'weapon2': '0.456', 'ARMOR': '0.481', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.273', 'FRAGCOUNT': '73.000'} [2024-08-06 08:32:51,629][52670] DAMAGECOUNT value on done: 975141.0 [2024-08-06 08:32:51,631][52670] Sum rewards: 87.619, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.750', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.044', 'weapon5': '0.152', 'AMMO4': '0.185', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.778', 'FRAGCOUNT': '73.000'} [2024-08-06 08:32:52,133][52668] DAMAGECOUNT value on done: 981776.0 [2024-08-06 08:32:52,134][52668] Sum rewards: 69.816, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.830', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.076', 'AMMO3': '0.219', 'weapon5': '0.236', 'AMMO4': '0.275', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '58.000'} [2024-08-06 08:32:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 696270848. Throughput: 0: 4366.4. Samples: 174072720. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:32:52,794][52567] Avg episode reward: [(0, '75.493')] [2024-08-06 08:32:52,879][52665] DAMAGECOUNT value on done: 981411.0 [2024-08-06 08:32:52,880][52665] Sum rewards: 73.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.197', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.220', 'AMMO4': '0.255', 'weapon4': '0.258', 'weapon5': '0.258', 'weapon2': '0.302', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.908', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:53,234][52795] DAMAGECOUNT value on done: 900834.0 [2024-08-06 08:32:53,234][52795] Sum rewards: 74.408, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.632', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.088', 'weapon4': '0.102', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.122', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '60.000'} [2024-08-06 08:32:54,241][52666] DAMAGECOUNT value on done: 975219.0 [2024-08-06 08:32:54,242][52666] Sum rewards: 72.876, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.916', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.034', 'AMMO4': '0.137', 'weapon5': '0.162', 'AMMO3': '0.163', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.000', 'HITCOUNT': '3.090', 'weapon3': '3.156', 'DAMAGECOUNT': '16.746', 'FRAGCOUNT': '58.000'} [2024-08-06 08:32:54,541][52670] DAMAGECOUNT value on done: 989726.0 [2024-08-06 08:32:54,542][52670] Sum rewards: 79.136, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.761', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.074', 'AMMO4': '0.078', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.166', 'weapon2': '0.214', 'WEAPON3': '1.050', 'HITCOUNT': '3.460', 'weapon3': '3.470', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '64.000'} [2024-08-06 08:32:54,669][52811] DAMAGECOUNT value on done: 934875.0 [2024-08-06 08:32:54,671][52811] Sum rewards: 75.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.542', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.108', 'AMMO3': '0.214', 'AMMO4': '0.215', 'weapon5': '0.228', 'weapon2': '0.372', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.020', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:55,159][52668] DAMAGECOUNT value on done: 995168.0 [2024-08-06 08:32:55,161][52668] Sum rewards: 83.510, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.967', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.114', 'weapon5': '0.142', 'AMMO3': '0.177', 'AMMO4': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.050', 'weapon3': '3.140', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '67.000'} [2024-08-06 08:32:56,022][52650] Updated weights for policy 0, policy_version 85001 (0.0013) [2024-08-06 08:32:56,179][52665] DAMAGECOUNT value on done: 983124.0 [2024-08-06 08:32:56,179][52665] Sum rewards: 71.483, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.755', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.058', 'weapon5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.410', 'WEAPON3': '1.450', 'HITCOUNT': '3.210', 'weapon3': '3.214', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:56,505][52795] DAMAGECOUNT value on done: 910246.0 [2024-08-06 08:32:56,505][52795] Sum rewards: 79.496, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.906', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.160', 'AMMO3': '0.167', 'AMMO4': '0.222', 'weapon4': '0.230', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON3': '1.000', 'weapon3': '3.016', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '62.000'} [2024-08-06 08:32:57,219][52666] DAMAGECOUNT value on done: 989596.0 [2024-08-06 08:32:57,219][52666] Sum rewards: 75.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.523', 'AMMO5': '0.010', 'AMMO2': '0.039', 'AMMO3': '0.140', 'weapon5': '0.180', 'weapon4': '0.194', 'AMMO4': '0.196', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.416', 'WEAPON3': '0.900', 'weapon3': '2.978', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '58.000'} [2024-08-06 08:32:57,641][52803] Large shaping reward 2.636 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO2', 0.01, 50.0), ('AMMO3', -0.001, -2.0), ('AMMO4', 0.05, 50.0), ('weapon3', 0.002)] [2024-08-06 08:32:57,676][52670] DAMAGECOUNT value on done: 969811.0 [2024-08-06 08:32:57,677][52670] Sum rewards: 71.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.014', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.194', 'AMMO4': '0.198', 'AMMO3': '0.242', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.084', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '61.000'} [2024-08-06 08:32:57,713][52811] DAMAGECOUNT value on done: 920270.0 [2024-08-06 08:32:57,714][52811] Sum rewards: 81.246, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.080', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.177', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.288', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '70.000'} [2024-08-06 08:32:57,783][52668] DAMAGECOUNT value on done: 993292.0 [2024-08-06 08:32:57,784][52668] Sum rewards: 78.342, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.807', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.090', 'AMMO4': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.163', 'WEAPON5': '0.200', 'weapon2': '0.544', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.147', 'FRAGCOUNT': '63.500'} [2024-08-06 08:32:57,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 696360960. Throughput: 0: 4356.2. Samples: 174098760. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:32:57,794][52567] Avg episode reward: [(0, '75.814')] [2024-08-06 08:32:59,473][52665] DAMAGECOUNT value on done: 965367.0 [2024-08-06 08:32:59,475][52665] Sum rewards: 86.382, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.982', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.134', 'WEAPON5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.258', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.198', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.015', 'FRAGCOUNT': '73.000'} [2024-08-06 08:32:59,712][52795] DAMAGECOUNT value on done: 919597.0 [2024-08-06 08:32:59,714][52795] Sum rewards: 82.806, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.980', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.052', 'WEAPON5': '0.100', 'AMMO3': '0.170', 'weapon2': '1.024', 'WEAPON3': '1.150', 'weapon3': '2.784', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.410', 'FRAGCOUNT': '66.000'} [2024-08-06 08:32:59,948][52650] Updated weights for policy 0, policy_version 85011 (0.0032) [2024-08-06 08:33:00,293][52666] DAMAGECOUNT value on done: 978465.0 [2024-08-06 08:33:00,293][52666] Sum rewards: 77.482, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.180', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO3': '0.145', 'AMMO4': '0.150', 'weapon5': '0.228', 'weapon4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.612', 'WEAPON3': '1.050', 'weapon3': '2.632', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:00,790][52670] DAMAGECOUNT value on done: 983754.0 [2024-08-06 08:33:00,791][52670] Sum rewards: 76.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.637', 'AMMO5': '0.022', 'AMMO2': '0.048', 'AMMO3': '0.158', 'weapon2': '0.220', 'AMMO4': '0.239', 'weapon5': '0.306', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon4': '0.668', 'WEAPON3': '1.050', 'weapon3': '2.440', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '61.500'} [2024-08-06 08:33:00,873][52668] DAMAGECOUNT value on done: 984422.0 [2024-08-06 08:33:00,874][52668] Sum rewards: 86.751, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.034', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.142', 'AMMO3': '0.190', 'weapon4': '0.194', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.784', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:01,030][52811] DAMAGECOUNT value on done: 914164.0 [2024-08-06 08:33:01,030][52811] Sum rewards: 78.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.178', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.028', 'WEAPON5': '0.050', 'weapon4': '0.052', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'AMMO3': '0.184', 'weapon2': '0.504', 'WEAPON3': '1.050', 'weapon3': '3.254', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:01,754][52667] DAMAGECOUNT value on done: 986594.0 [2024-08-06 08:33:01,754][52667] Sum rewards: 73.774, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.574', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon7': '0.068', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'AMMO4': '0.137', 'weapon4': '0.152', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon5': '0.330', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:02,727][52665] DAMAGECOUNT value on done: 966457.0 [2024-08-06 08:33:02,727][52665] Sum rewards: 73.512, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.016', 'AMMO2': '0.036', 'AMMO3': '0.175', 'weapon5': '0.180', 'AMMO4': '0.180', 'weapon4': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 696451072. Throughput: 0: 4350.0. Samples: 174111810. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:33:02,794][52567] Avg episode reward: [(0, '75.970')] [2024-08-06 08:33:03,091][52666] DAMAGECOUNT value on done: 984022.0 [2024-08-06 08:33:03,094][52666] Sum rewards: 79.797, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.355', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.136', 'weapon4': '0.178', 'AMMO3': '0.181', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:03,359][52670] DAMAGECOUNT value on done: 988714.0 [2024-08-06 08:33:03,360][52670] Sum rewards: 88.801, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.872', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.052', 'AMMO4': '0.073', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '74.000'} [2024-08-06 08:33:03,961][52668] DAMAGECOUNT value on done: 986364.0 [2024-08-06 08:33:03,962][52668] Sum rewards: 78.210, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.727', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon5': '0.080', 'AMMO4': '0.088', 'weapon4': '0.098', 'WEAPON4': '0.200', 'weapon2': '0.200', 'AMMO3': '0.238', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.382', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.744', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:04,124][52811] DAMAGECOUNT value on done: 920252.0 [2024-08-06 08:33:04,124][52811] Sum rewards: 80.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.490', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.182', 'weapon5': '0.206', 'AMMO3': '0.211', 'AMMO4': '0.244', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:04,273][52667] DAMAGECOUNT value on done: 1004089.0 [2024-08-06 08:33:04,275][52667] Sum rewards: 73.101, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.290', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.082', 'AMMO4': '0.214', 'weapon5': '0.246', 'AMMO3': '0.272', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.010', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:04,920][52650] Updated weights for policy 0, policy_version 85021 (0.0013) [2024-08-06 08:33:05,706][52666] DAMAGECOUNT value on done: 968188.0 [2024-08-06 08:33:05,708][52666] Sum rewards: 76.186, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.179', 'weapon2': '0.384', 'WEAPON3': '1.050', 'weapon3': '3.356', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:05,763][52665] DAMAGECOUNT value on done: 978965.0 [2024-08-06 08:33:05,763][52665] Sum rewards: 80.149, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.081', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.089', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.144', 'WEAPON5': '0.150', 'weapon4': '0.194', 'weapon2': '0.472', 'WEAPON3': '0.900', 'weapon3': '3.018', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:06,051][52670] DAMAGECOUNT value on done: 980807.0 [2024-08-06 08:33:06,052][52670] Sum rewards: 73.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.151', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.024', 'weapon5': '0.032', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.181', 'weapon2': '0.214', 'WEAPON3': '1.100', 'HITCOUNT': '3.370', 'weapon3': '3.602', 'DAMAGECOUNT': '17.481', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:07,206][52811] DAMAGECOUNT value on done: 923632.0 [2024-08-06 08:33:07,207][52811] Sum rewards: 82.706, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.955', 'AMMO5': '0.015', 'AMMO2': '0.016', 'WEAPON1': '0.020', 'AMMO4': '0.077', 'weapon5': '0.100', 'weapon4': '0.122', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon2': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:07,292][52668] DAMAGECOUNT value on done: 994605.0 [2024-08-06 08:33:07,292][52668] Sum rewards: 78.154, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.658', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.058', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.282', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:07,371][52667] DAMAGECOUNT value on done: 998035.0 [2024-08-06 08:33:07,374][52667] Sum rewards: 75.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.155', 'AMMO5': '0.008', 'AMMO2': '0.029', 'AMMO4': '0.145', 'weapon5': '0.146', 'weapon4': '0.168', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.958', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 696541184. Throughput: 0: 4355.1. Samples: 174138120. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:33:07,795][52567] Avg episode reward: [(0, '76.578')] [2024-08-06 08:33:08,287][52649] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:33:08,470][52666] DAMAGECOUNT value on done: 992977.0 [2024-08-06 08:33:08,470][52666] Sum rewards: 78.696, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.383', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.080', 'weapon5': '0.102', 'AMMO4': '0.128', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:08,798][52665] DAMAGECOUNT value on done: 978440.0 [2024-08-06 08:33:08,799][52665] Sum rewards: 71.292, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.038', 'HEALTH': '0.060', 'AMMO4': '0.096', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'WEAPON5': '0.200', 'weapon2': '0.426', 'WEAPON3': '0.950', 'weapon3': '3.218', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '56.000'} [2024-08-06 08:33:08,893][52670] DAMAGECOUNT value on done: 967190.0 [2024-08-06 08:33:08,894][52670] Sum rewards: 86.457, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.833', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.143', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'weapon2': '0.460', 'WEAPON3': '0.950', 'weapon3': '3.224', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.773', 'FRAGCOUNT': '67.000'} [2024-08-06 08:33:09,859][52650] Updated weights for policy 0, policy_version 85031 (0.0032) [2024-08-06 08:33:09,913][52794] Large shaping reward 2.610 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.588, 196.0), ('weapon5', 0.002)] [2024-08-06 08:33:10,240][52811] DAMAGECOUNT value on done: 940837.0 [2024-08-06 08:33:10,241][52811] Sum rewards: 80.380, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.649', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.146', 'weapon4': '0.238', 'weapon2': '0.284', 'WEAPON3': '0.950', 'weapon3': '3.236', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:10,327][52668] DAMAGECOUNT value on done: 989081.0 [2024-08-06 08:33:10,327][52668] Sum rewards: 81.495, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.019', 'weapon5': '0.046', 'weapon4': '0.094', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.170', 'AMMO3': '0.205', 'WEAPON3': '1.300', 'weapon3': '3.536', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '67.000'} [2024-08-06 08:33:10,646][52667] DAMAGECOUNT value on done: 1003371.0 [2024-08-06 08:33:10,646][52667] Sum rewards: 78.338, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.378', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon5': '0.184', 'AMMO4': '0.203', 'weapon2': '0.216', 'weapon4': '0.222', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.124', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:11,647][52666] DAMAGECOUNT value on done: 987671.0 [2024-08-06 08:33:11,649][52666] Sum rewards: 81.629, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.302', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.159', 'weapon4': '0.168', 'AMMO3': '0.220', 'weapon2': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:11,829][52665] DAMAGECOUNT value on done: 983890.0 [2024-08-06 08:33:11,831][52665] Sum rewards: 65.322, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.706', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.032', 'weapon5': '0.104', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.254', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '55.000'} [2024-08-06 08:33:12,149][52670] DAMAGECOUNT value on done: 981455.0 [2024-08-06 08:33:12,149][52670] Sum rewards: 84.669, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.450', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.140', 'AMMO3': '0.166', 'AMMO4': '0.247', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.129', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 696623104. Throughput: 0: 4348.7. Samples: 174164190. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:33:12,794][52567] Avg episode reward: [(0, '77.171')] [2024-08-06 08:33:12,964][52667] DAMAGECOUNT value on done: 1005271.0 [2024-08-06 08:33:12,967][52667] Sum rewards: 85.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.438', 'AMMO5': '0.016', 'AMMO2': '0.039', 'weapon5': '0.182', 'AMMO4': '0.197', 'AMMO3': '0.201', 'weapon4': '0.226', 'WEAPON4': '0.400', 'weapon2': '0.406', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.956', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:13,322][52811] DAMAGECOUNT value on done: 928998.0 [2024-08-06 08:33:13,322][52811] Sum rewards: 66.213, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.308', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.088', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.336', 'WEAPON3': '1.100', 'HITCOUNT': '3.000', 'weapon3': '3.206', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '55.000'} [2024-08-06 08:33:13,459][52668] DAMAGECOUNT value on done: 986653.0 [2024-08-06 08:33:13,461][52668] Sum rewards: 80.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.716', 'AMMO5': '0.007', 'AMMO2': '0.036', 'weapon5': '0.038', 'WEAPON5': '0.150', 'weapon2': '0.158', 'AMMO3': '0.165', 'AMMO4': '0.180', 'weapon4': '0.194', 'WEAPON4': '0.250', 'WEAPON3': '1.000', 'weapon3': '3.444', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.826', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:14,301][52666] DAMAGECOUNT value on done: 986792.0 [2024-08-06 08:33:14,302][52666] Sum rewards: 78.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.249', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.228', 'weapon2': '0.228', 'weapon4': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '65.500'} [2024-08-06 08:33:14,345][52665] DAMAGECOUNT value on done: 975886.0 [2024-08-06 08:33:14,345][52665] Sum rewards: 80.022, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.872', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.114', 'AMMO4': '0.115', 'weapon4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.245', 'weapon2': '0.522', 'WEAPON3': '1.500', 'weapon3': '2.984', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:14,481][52649] DAMAGECOUNT value on done: 958858.0 [2024-08-06 08:33:14,482][52649] Sum rewards: 82.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.992', 'AMMO2': '0.021', 'weapon4': '0.066', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'AMMO3': '0.229', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.512', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:14,602][52650] Updated weights for policy 0, policy_version 85041 (0.0027) [2024-08-06 08:33:14,685][52670] DAMAGECOUNT value on done: 989093.0 [2024-08-06 08:33:14,685][52670] Sum rewards: 71.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.030', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.182', 'weapon5': '0.188', 'weapon2': '0.204', 'weapon4': '0.218', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '59.500'} [2024-08-06 08:33:15,127][52662] DAMAGECOUNT value on done: 989377.0 [2024-08-06 08:33:15,127][52662] Sum rewards: 74.721, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.996', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.060', 'weapon5': '0.110', 'AMMO4': '0.229', 'AMMO3': '0.284', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.230', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '65.500'} [2024-08-06 08:33:15,728][52667] DAMAGECOUNT value on done: 1000851.0 [2024-08-06 08:33:15,730][52667] Sum rewards: 84.369, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.876', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon5': '0.108', 'weapon4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.290', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '70.000'} [2024-08-06 08:33:16,205][52614] Signal inference workers to stop experience collection... (15600 times) [2024-08-06 08:33:16,205][52614] Signal inference workers to resume experience collection... (15600 times) [2024-08-06 08:33:16,277][52650] InferenceWorker_p0-w0: stopping experience collection (15600 times) [2024-08-06 08:33:16,277][52650] InferenceWorker_p0-w0: resuming experience collection (15600 times) [2024-08-06 08:33:16,504][52811] DAMAGECOUNT value on done: 917497.0 [2024-08-06 08:33:16,504][52811] Sum rewards: 61.556, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.024', 'AMMO2': '0.046', 'AMMO3': '0.146', 'weapon5': '0.218', 'AMMO4': '0.231', 'weapon4': '0.408', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.662', 'WEAPON3': '0.900', 'weapon3': '2.446', 'HITCOUNT': '2.720', 'DAMAGECOUNT': '15.315', 'FRAGCOUNT': '49.000'} [2024-08-06 08:33:16,569][52668] DAMAGECOUNT value on done: 979153.0 [2024-08-06 08:33:16,569][52668] Sum rewards: 71.343, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.095', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.062', 'weapon5': '0.148', 'AMMO4': '0.207', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.974', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.034', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:16,934][52666] DAMAGECOUNT value on done: 978034.0 [2024-08-06 08:33:16,943][52666] Sum rewards: 86.807, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.414', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.118', 'weapon2': '0.128', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon4': '0.246', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '71.000'} [2024-08-06 08:33:17,301][52665] DAMAGECOUNT value on done: 991224.0 [2024-08-06 08:33:17,312][52665] Sum rewards: 80.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.150', 'AMMO5': '0.007', 'AMMO2': '0.044', 'weapon4': '0.076', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.218', 'weapon2': '0.260', 'AMMO3': '0.278', 'WEAPON3': '1.550', 'weapon3': '3.258', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.097', 'FRAGCOUNT': '67.000'} [2024-08-06 08:33:17,308][52670] DAMAGECOUNT value on done: 983389.0 [2024-08-06 08:33:17,332][52670] Sum rewards: 86.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.885', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.084', 'weapon4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.204', 'AMMO3': '0.233', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '73.000'} [2024-08-06 08:33:17,487][52649] DAMAGECOUNT value on done: 953265.0 [2024-08-06 08:33:17,490][52649] Sum rewards: 74.238, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.366', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon5': '0.182', 'weapon2': '0.438', 'weapon4': '0.468', 'WEAPON3': '1.000', 'weapon3': '2.630', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '58.500'} [2024-08-06 08:33:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 696713216. Throughput: 0: 4355.1. Samples: 174177310. Policy #0 lag: (min: 0.0, avg: 3.2, max: 7.0) [2024-08-06 08:33:17,794][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:33:18,352][52667] DAMAGECOUNT value on done: 994449.0 [2024-08-06 08:33:18,353][52667] Sum rewards: 61.988, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.248', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.051', 'AMMO3': '0.115', 'weapon5': '0.124', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.408', 'weapon4': '0.492', 'WEAPON3': '0.800', 'weapon3': '2.868', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.219', 'FRAGCOUNT': '47.000'} [2024-08-06 08:33:18,479][52662] DAMAGECOUNT value on done: 998652.0 [2024-08-06 08:33:18,479][52662] Sum rewards: 80.974, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.920', 'AMMO5': '0.008', 'AMMO2': '0.042', 'AMMO3': '0.162', 'weapon5': '0.172', 'AMMO4': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.294', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '2.964', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:19,149][52668] DAMAGECOUNT value on done: 980302.0 [2024-08-06 08:33:19,149][52668] Sum rewards: 81.386, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.471', 'AMMO5': '0.018', 'AMMO2': '0.040', 'AMMO4': '0.199', 'weapon2': '0.206', 'weapon4': '0.216', 'weapon5': '0.234', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.012', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.481', 'FRAGCOUNT': '67.500'} [2024-08-06 08:33:19,206][52650] Updated weights for policy 0, policy_version 85051 (0.0013) [2024-08-06 08:33:19,547][52811] DAMAGECOUNT value on done: 925248.0 [2024-08-06 08:33:19,548][52811] Sum rewards: 73.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.198', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.162', 'weapon4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.231', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:19,584][52666] DAMAGECOUNT value on done: 975629.0 [2024-08-06 08:33:19,586][52666] Sum rewards: 71.879, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.125', 'AMMO2': '0.024', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.184', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.526', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '57.000'} [2024-08-06 08:33:19,974][52670] DAMAGECOUNT value on done: 982995.0 [2024-08-06 08:33:19,976][52670] Sum rewards: 71.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.056', 'weapon4': '0.110', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '58.000'} [2024-08-06 08:33:20,064][52664] DAMAGECOUNT value on done: 1018726.0 [2024-08-06 08:33:20,066][52664] Sum rewards: 71.834, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.746', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'AMMO3': '0.176', 'weapon5': '0.176', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.366', 'WEAPON3': '1.150', 'weapon3': '2.926', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.109', 'FRAGCOUNT': '57.000'} [2024-08-06 08:33:20,087][52665] DAMAGECOUNT value on done: 983450.0 [2024-08-06 08:33:20,087][52665] Sum rewards: 72.686, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.349', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.118', 'weapon5': '0.140', 'AMMO4': '0.212', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '2.948', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.118', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:20,387][52649] DAMAGECOUNT value on done: 969726.0 [2024-08-06 08:33:20,388][52649] Sum rewards: 86.985, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.115', 'AMMO5': '0.004', 'AMMO2': '0.007', 'weapon4': '0.018', 'weapon5': '0.028', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.374', 'WEAPON3': '1.500', 'weapon3': '3.432', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.929', 'FRAGCOUNT': '74.000'} [2024-08-06 08:33:20,855][52667] DAMAGECOUNT value on done: 991908.0 [2024-08-06 08:33:20,855][52667] Sum rewards: 67.537, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.821', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.144', 'weapon2': '0.194', 'AMMO4': '0.269', 'AMMO3': '0.292', 'weapon5': '0.304', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.992', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.899', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:21,225][52662] DAMAGECOUNT value on done: 998536.0 [2024-08-06 08:33:21,227][52662] Sum rewards: 80.377, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.014', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.076', 'weapon5': '0.168', 'weapon2': '0.208', 'AMMO3': '0.247', 'AMMO4': '0.248', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.262', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:21,446][52668] DAMAGECOUNT value on done: 970604.0 [2024-08-06 08:33:21,446][52668] Sum rewards: 81.336, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.065', 'weapon5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.587', 'FRAGCOUNT': '66.500'} [2024-08-06 08:33:22,672][52666] DAMAGECOUNT value on done: 995934.0 [2024-08-06 08:33:22,673][52666] Sum rewards: 67.490, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.860', 'AMMO5': '0.017', 'AMMO2': '0.032', 'AMMO4': '0.161', 'AMMO3': '0.192', 'weapon5': '0.192', 'weapon4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '2.702', 'HITCOUNT': '2.910', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '57.000'} [2024-08-06 08:33:22,712][52811] DAMAGECOUNT value on done: 925360.0 [2024-08-06 08:33:22,714][52811] Sum rewards: 72.111, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.932', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.166', 'weapon4': '0.188', 'WEAPON5': '0.200', 'AMMO4': '0.201', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'weapon2': '0.370', 'WEAPON3': '1.450', 'weapon3': '2.966', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 696803328. Throughput: 0: 4352.4. Samples: 174203430. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:22,794][52567] Avg episode reward: [(0, '77.288')] [2024-08-06 08:33:23,015][52664] DAMAGECOUNT value on done: 1026235.0 [2024-08-06 08:33:23,015][52664] Sum rewards: 72.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.521', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.092', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'weapon4': '0.258', 'weapon2': '0.286', 'WEAPON3': '1.300', 'HITCOUNT': '3.110', 'weapon3': '3.114', 'DAMAGECOUNT': '17.037', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:23,232][52665] DAMAGECOUNT value on done: 980794.0 [2024-08-06 08:33:23,233][52665] Sum rewards: 76.452, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.215', 'weapon2': '0.358', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.842', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:23,427][52649] DAMAGECOUNT value on done: 971778.0 [2024-08-06 08:33:23,428][52649] Sum rewards: 88.099, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.597', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.137', 'weapon2': '0.190', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.400', 'weapon3': '3.422', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '74.000'} [2024-08-06 08:33:23,691][52659] DAMAGECOUNT value on done: 991302.0 [2024-08-06 08:33:23,692][52659] Sum rewards: 66.576, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.806', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.212', 'AMMO3': '0.214', 'AMMO4': '0.220', 'weapon4': '0.262', 'weapon2': '0.326', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.908', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.873', 'FRAGCOUNT': '55.000'} [2024-08-06 08:33:23,754][52667] DAMAGECOUNT value on done: 997900.0 [2024-08-06 08:33:23,756][52667] Sum rewards: 94.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.585', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.054', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.245', 'WEAPON3': '1.550', 'weapon3': '3.444', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '22.779', 'FRAGCOUNT': '78.000'} [2024-08-06 08:33:23,823][52662] DAMAGECOUNT value on done: 989267.0 [2024-08-06 08:33:23,825][52662] Sum rewards: 70.461, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.644', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'weapon5': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.204', 'DAMAGECOUNT': '16.230', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:24,221][52650] Updated weights for policy 0, policy_version 85061 (0.0011) [2024-08-06 08:33:24,442][52668] DAMAGECOUNT value on done: 987457.0 [2024-08-06 08:33:24,443][52668] Sum rewards: 82.233, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.910', 'AMMO5': '0.008', 'AMMO2': '0.043', 'weapon4': '0.104', 'weapon5': '0.136', 'AMMO3': '0.177', 'AMMO4': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:25,671][52666] DAMAGECOUNT value on done: 969156.0 [2024-08-06 08:33:25,673][52666] Sum rewards: 74.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.000', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.066', 'weapon4': '0.110', 'AMMO4': '0.111', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.280', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:25,686][52665] DAMAGECOUNT value on done: 981169.0 [2024-08-06 08:33:25,688][52665] Sum rewards: 75.956, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.610', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.190', 'weapon5': '0.194', 'AMMO4': '0.198', 'weapon4': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.150', 'weapon3': '2.894', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:25,806][52811] DAMAGECOUNT value on done: 927716.0 [2024-08-06 08:33:25,807][52811] Sum rewards: 61.397, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.302', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.052', 'weapon5': '0.118', 'AMMO4': '0.202', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.756', 'FRAGCOUNT': '54.000'} [2024-08-06 08:33:25,894][52664] DAMAGECOUNT value on done: 1031185.0 [2024-08-06 08:33:25,896][52664] Sum rewards: 74.687, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.654', 'AMMO5': '0.009', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.092', 'weapon4': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.514', 'FRAGCOUNT': '62.500'} [2024-08-06 08:33:26,114][52649] DAMAGECOUNT value on done: 962829.0 [2024-08-06 08:33:26,114][52649] Sum rewards: 89.099, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.696', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.042', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.502', 'WEAPON3': '1.300', 'weapon3': '3.204', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.135', 'FRAGCOUNT': '72.000'} [2024-08-06 08:33:26,646][52659] DAMAGECOUNT value on done: 990366.0 [2024-08-06 08:33:26,646][52659] Sum rewards: 68.632, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-2.990', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.050', 'WEAPON5': '0.100', 'weapon4': '0.124', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'AMMO3': '0.303', 'weapon2': '0.394', 'WEAPON3': '1.800', 'weapon3': '3.116', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:26,775][52667] DAMAGECOUNT value on done: 1000717.0 [2024-08-06 08:33:26,776][52667] Sum rewards: 81.975, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.704', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.128', 'AMMO4': '0.151', 'AMMO3': '0.237', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '70.000'} [2024-08-06 08:33:26,964][52662] DAMAGECOUNT value on done: 1002849.0 [2024-08-06 08:33:26,964][52662] Sum rewards: 68.114, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.922', 'AMMO5': '0.015', 'AMMO2': '0.061', 'weapon4': '0.134', 'weapon5': '0.178', 'AMMO3': '0.235', 'AMMO4': '0.306', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.106', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '58.000'} [2024-08-06 08:33:27,717][52668] DAMAGECOUNT value on done: 988526.0 [2024-08-06 08:33:27,717][52668] Sum rewards: 68.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.226', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.130', 'weapon5': '0.210', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.152', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '56.500'} [2024-08-06 08:33:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 696885248. Throughput: 0: 4349.6. Samples: 174229470. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:27,794][52567] Avg episode reward: [(0, '77.189')] [2024-08-06 08:33:28,201][52664] DAMAGECOUNT value on done: 1018880.0 [2024-08-06 08:33:28,203][52664] Sum rewards: 69.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.348', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.082', 'weapon5': '0.100', 'AMMO4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.386', 'WEAPON3': '1.250', 'weapon3': '3.208', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '56.000'} [2024-08-06 08:33:28,342][52666] DAMAGECOUNT value on done: 982736.0 [2024-08-06 08:33:28,343][52666] Sum rewards: 81.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.450', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.070', 'weapon5': '0.086', 'AMMO4': '0.089', 'weapon2': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'WEAPON3': '1.600', 'weapon3': '3.438', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:28,587][52650] Updated weights for policy 0, policy_version 85071 (0.0011) [2024-08-06 08:33:28,813][52665] DAMAGECOUNT value on done: 977248.0 [2024-08-06 08:33:28,815][52665] Sum rewards: 81.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.916', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.094', 'weapon5': '0.104', 'AMMO3': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.252', 'WEAPON3': '1.100', 'weapon3': '3.384', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:29,017][52811] DAMAGECOUNT value on done: 935306.0 [2024-08-06 08:33:29,020][52811] Sum rewards: 78.329, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.170', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.115', 'weapon5': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:29,185][52649] DAMAGECOUNT value on done: 970773.0 [2024-08-06 08:33:29,188][52649] Sum rewards: 80.180, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.070', 'AMMO5': '0.022', 'AMMO2': '0.071', 'AMMO3': '0.181', 'weapon4': '0.254', 'weapon2': '0.274', 'weapon5': '0.344', 'AMMO4': '0.354', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '64.500'} [2024-08-06 08:33:29,570][52667] DAMAGECOUNT value on done: 988774.0 [2024-08-06 08:33:29,573][52667] Sum rewards: 67.165, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.104', 'AMMO4': '0.194', 'weapon5': '0.200', 'weapon2': '0.234', 'AMMO3': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.070', 'weapon3': '3.218', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.000'} [2024-08-06 08:33:29,652][52659] DAMAGECOUNT value on done: 1002613.0 [2024-08-06 08:33:29,653][52659] Sum rewards: 71.781, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.315', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon4': '0.128', 'weapon5': '0.132', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '2.914', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:29,937][52662] DAMAGECOUNT value on done: 982413.0 [2024-08-06 08:33:29,938][52662] Sum rewards: 83.309, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.835', 'AMMO5': '0.006', 'AMMO2': '0.037', 'weapon5': '0.080', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.218', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '67.500'} [2024-08-06 08:33:30,296][52668] DAMAGECOUNT value on done: 988385.0 [2024-08-06 08:33:30,298][52668] Sum rewards: 79.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.200', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.162', 'weapon4': '0.180', 'AMMO3': '0.227', 'AMMO4': '0.279', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.056', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:30,396][52664] DAMAGECOUNT value on done: 1036098.0 [2024-08-06 08:33:30,397][52664] Sum rewards: 66.936, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.950', 'AMMO5': '0.017', 'AMMO2': '0.067', 'weapon4': '0.128', 'weapon5': '0.190', 'weapon2': '0.270', 'AMMO3': '0.287', 'AMMO4': '0.336', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.084', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:31,985][52665] DAMAGECOUNT value on done: 983949.0 [2024-08-06 08:33:31,987][52665] Sum rewards: 74.662, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.987', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.168', 'AMMO4': '0.213', 'AMMO3': '0.232', 'weapon5': '0.262', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.986', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.424', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:32,055][52811] DAMAGECOUNT value on done: 927719.0 [2024-08-06 08:33:32,056][52811] Sum rewards: 71.520, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.036', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'weapon4': '0.164', 'AMMO3': '0.191', 'weapon2': '0.252', 'WEAPON3': '1.150', 'HITCOUNT': '3.370', 'weapon3': '3.380', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:32,382][52649] DAMAGECOUNT value on done: 969025.0 [2024-08-06 08:33:32,382][52649] Sum rewards: 83.069, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.900', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.066', 'weapon5': '0.140', 'AMMO4': '0.170', 'AMMO3': '0.172', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:32,536][52667] DAMAGECOUNT value on done: 990014.0 [2024-08-06 08:33:32,538][52667] Sum rewards: 80.012, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.305', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon2': '0.134', 'AMMO4': '0.161', 'weapon5': '0.170', 'weapon4': '0.208', 'AMMO3': '0.240', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 696975360. Throughput: 0: 4354.7. Samples: 174242860. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:32,794][52567] Avg episode reward: [(0, '76.886')] [2024-08-06 08:33:32,900][52664] DAMAGECOUNT value on done: 1031500.0 [2024-08-06 08:33:32,900][52664] Sum rewards: 75.951, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.118', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon5': '0.100', 'weapon4': '0.108', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.220', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:32,903][52662] DAMAGECOUNT value on done: 985565.0 [2024-08-06 08:33:32,903][52662] Sum rewards: 69.154, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.146', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.012', 'WEAPON1': '0.020', 'weapon4': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.201', 'weapon2': '0.332', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.396', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '57.000'} [2024-08-06 08:33:32,980][52659] DAMAGECOUNT value on done: 994439.0 [2024-08-06 08:33:32,981][52659] Sum rewards: 79.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.510', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.092', 'weapon5': '0.174', 'AMMO4': '0.245', 'AMMO3': '0.276', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.160', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:32,996][52668] DAMAGECOUNT value on done: 988604.0 [2024-08-06 08:33:32,999][52668] Sum rewards: 70.688, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.613', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.024', 'weapon4': '0.084', 'AMMO4': '0.117', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:33,395][52650] Updated weights for policy 0, policy_version 85081 (0.0011) [2024-08-06 08:33:35,080][52665] DAMAGECOUNT value on done: 977670.0 [2024-08-06 08:33:35,080][52665] Sum rewards: 74.981, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.812', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.500', 'weapon3': '3.098', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.322', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:35,101][52811] DAMAGECOUNT value on done: 924799.0 [2024-08-06 08:33:35,101][52811] Sum rewards: 75.367, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.035', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.213', 'weapon2': '0.320', 'WEAPON3': '1.400', 'weapon3': '3.456', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:35,229][52664] DAMAGECOUNT value on done: 1021356.0 [2024-08-06 08:33:35,230][52664] Sum rewards: 70.822, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.935', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.046', 'AMMO4': '0.111', 'weapon4': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:35,332][52667] DAMAGECOUNT value on done: 998432.0 [2024-08-06 08:33:35,333][52667] Sum rewards: 78.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO2': '0.003', 'AMMO4': '0.017', 'AMMO3': '0.211', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '3.274', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:35,612][52649] DAMAGECOUNT value on done: 967136.0 [2024-08-06 08:33:35,613][52649] Sum rewards: 61.614, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.822', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon5': '0.074', 'AMMO4': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.190', 'AMMO3': '0.207', 'weapon4': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.256', 'DAMAGECOUNT': '14.559', 'FRAGCOUNT': '51.000'} [2024-08-06 08:33:35,931][52668] DAMAGECOUNT value on done: 992863.0 [2024-08-06 08:33:35,932][52668] Sum rewards: 71.368, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.068', 'AMMO4': '0.090', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.364', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:35,955][52659] DAMAGECOUNT value on done: 987041.0 [2024-08-06 08:33:35,959][52659] Sum rewards: 71.082, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.810', 'AMMO5': '0.028', 'AMMO2': '0.076', 'weapon5': '0.220', 'AMMO3': '0.263', 'weapon4': '0.286', 'AMMO4': '0.378', 'weapon2': '0.408', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.706', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:36,076][52662] DAMAGECOUNT value on done: 1006168.0 [2024-08-06 08:33:36,078][52662] Sum rewards: 87.033, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.350', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.074', 'AMMO4': '0.120', 'weapon5': '0.136', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '74.000'} [2024-08-06 08:33:37,484][52650] Updated weights for policy 0, policy_version 85091 (0.0023) [2024-08-06 08:33:37,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 697065472. Throughput: 0: 4364.0. Samples: 174269100. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:37,802][52567] Avg episode reward: [(0, '76.649')] [2024-08-06 08:33:38,030][52664] DAMAGECOUNT value on done: 1021256.0 [2024-08-06 08:33:38,032][52664] Sum rewards: 71.350, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.130', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.092', 'AMMO3': '0.212', 'weapon5': '0.214', 'AMMO4': '0.239', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '58.000'} [2024-08-06 08:33:38,169][52665] DAMAGECOUNT value on done: 970367.0 [2024-08-06 08:33:38,169][52665] Sum rewards: 69.072, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.638', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.078', 'weapon4': '0.106', 'AMMO4': '0.174', 'weapon2': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.392', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:38,183][52811] DAMAGECOUNT value on done: 925962.0 [2024-08-06 08:33:38,184][52811] Sum rewards: 74.125, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.750', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon4': '0.168', 'weapon5': '0.180', 'AMMO3': '0.213', 'weapon2': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.144', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:38,304][52667] DAMAGECOUNT value on done: 988640.0 [2024-08-06 08:33:38,305][52667] Sum rewards: 69.783, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.430', 'AMMO5': '0.018', 'AMMO2': '0.057', 'weapon4': '0.124', 'weapon5': '0.230', 'AMMO3': '0.241', 'weapon2': '0.266', 'AMMO4': '0.284', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.086', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:38,374][52660] DAMAGECOUNT value on done: 986567.0 [2024-08-06 08:33:38,377][52660] Sum rewards: 73.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.180', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon5': '0.044', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.310', 'WEAPON3': '1.350', 'weapon3': '3.170', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:38,512][52649] DAMAGECOUNT value on done: 963534.0 [2024-08-06 08:33:38,515][52649] Sum rewards: 76.908, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.560', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.084', 'weapon5': '0.086', 'AMMO3': '0.151', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.686', 'WEAPON3': '1.050', 'weapon3': '2.962', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '62.000'} [2024-08-06 08:33:38,622][52662] DAMAGECOUNT value on done: 991859.0 [2024-08-06 08:33:38,623][52662] Sum rewards: 66.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.000', 'AMMO5': '0.024', 'AMMO2': '0.073', 'weapon4': '0.148', 'AMMO3': '0.203', 'weapon5': '0.228', 'weapon2': '0.312', 'AMMO4': '0.367', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'HITCOUNT': '2.980', 'weapon3': '3.010', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '55.000'} [2024-08-06 08:33:38,920][52659] DAMAGECOUNT value on done: 993171.0 [2024-08-06 08:33:38,920][52659] Sum rewards: 84.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.032', 'AMMO4': '0.092', 'weapon5': '0.140', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.885', 'FRAGCOUNT': '70.000'} [2024-08-06 08:33:40,896][52665] DAMAGECOUNT value on done: 975705.0 [2024-08-06 08:33:40,898][52665] Sum rewards: 63.515, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.835', 'AMMO5': '0.015', 'AMMO2': '0.030', 'weapon4': '0.074', 'AMMO4': '0.151', 'weapon5': '0.154', 'WEAPON4': '0.200', 'weapon2': '0.226', 'WEAPON5': '0.300', 'AMMO3': '0.322', 'WEAPON3': '1.900', 'HITCOUNT': '3.220', 'weapon3': '3.240', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '58.000'} [2024-08-06 08:33:40,994][52660] DAMAGECOUNT value on done: 976003.0 [2024-08-06 08:33:40,994][52660] Sum rewards: 70.945, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.735', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.108', 'AMMO4': '0.197', 'weapon4': '0.230', 'AMMO3': '0.245', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.142', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:41,297][52664] DAMAGECOUNT value on done: 1027947.0 [2024-08-06 08:33:41,297][52664] Sum rewards: 61.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.905', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.100', 'weapon4': '0.120', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '2.970', 'weapon3': '3.384', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '50.000'} [2024-08-06 08:33:41,362][52649] DAMAGECOUNT value on done: 961639.0 [2024-08-06 08:33:41,362][52649] Sum rewards: 70.184, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.226', 'weapon2': '0.266', 'WEAPON3': '1.400', 'HITCOUNT': '3.360', 'weapon3': '3.492', 'DAMAGECOUNT': '17.007', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:41,389][52811] DAMAGECOUNT value on done: 925648.0 [2024-08-06 08:33:41,390][52811] Sum rewards: 71.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.018', 'AMMO5': '0.023', 'AMMO2': '0.056', 'weapon2': '0.202', 'weapon4': '0.206', 'AMMO3': '0.213', 'AMMO4': '0.283', 'weapon5': '0.362', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:41,430][52662] DAMAGECOUNT value on done: 994568.0 [2024-08-06 08:33:41,430][52662] Sum rewards: 73.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.924', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.214', 'AMMO3': '0.249', 'weapon2': '0.294', 'weapon4': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.844', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:41,462][52659] DAMAGECOUNT value on done: 993032.0 [2024-08-06 08:33:41,464][52659] Sum rewards: 92.454, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.018', 'AMMO4': '0.050', 'weapon5': '0.052', 'WEAPON4': '0.100', 'weapon2': '0.174', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.350', 'weapon3': '3.554', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '22.677', 'FRAGCOUNT': '74.000'} [2024-08-06 08:33:41,484][52667] DAMAGECOUNT value on done: 996897.0 [2024-08-06 08:33:41,484][52667] Sum rewards: 85.003, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.356', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.096', 'weapon5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.432', 'WEAPON3': '1.150', 'weapon3': '3.080', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.547', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:42,549][52650] Updated weights for policy 0, policy_version 85101 (0.0028) [2024-08-06 08:33:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 697147392. Throughput: 0: 4362.5. Samples: 174295070. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:42,794][52567] Avg episode reward: [(0, '75.682')] [2024-08-06 08:33:43,615][52665] DAMAGECOUNT value on done: 984555.0 [2024-08-06 08:33:43,616][52665] Sum rewards: 76.324, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.310', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.221', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.066', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.786', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:44,088][52659] DAMAGECOUNT value on done: 991421.0 [2024-08-06 08:33:44,088][52659] Sum rewards: 68.241, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.110', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.048', 'weapon5': '0.166', 'AMMO4': '0.208', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.300', 'HITCOUNT': '3.050', 'weapon3': '3.272', 'DAMAGECOUNT': '16.620', 'FRAGCOUNT': '57.000'} [2024-08-06 08:33:44,097][52660] DAMAGECOUNT value on done: 991078.0 [2024-08-06 08:33:44,097][52660] Sum rewards: 83.599, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.922', 'AMMO5': '0.018', 'AMMO2': '0.048', 'weapon4': '0.142', 'weapon5': '0.226', 'AMMO4': '0.241', 'AMMO3': '0.243', 'weapon2': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.072', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '21.261', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:44,162][52662] DAMAGECOUNT value on done: 990417.0 [2024-08-06 08:33:44,163][52662] Sum rewards: 81.491, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.112', 'AMMO5': '0.013', 'AMMO2': '0.043', 'AMMO3': '0.135', 'AMMO4': '0.215', 'weapon5': '0.254', 'weapon2': '0.268', 'WEAPON4': '0.300', 'weapon4': '0.314', 'WEAPON5': '0.400', 'WEAPON3': '0.900', 'weapon3': '2.986', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '62.500'} [2024-08-06 08:33:44,191][52649] DAMAGECOUNT value on done: 976295.0 [2024-08-06 08:33:44,193][52649] Sum rewards: 79.149, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.717', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.142', 'AMMO4': '0.218', 'AMMO3': '0.224', 'weapon5': '0.266', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.800', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.356', 'FRAGCOUNT': '66.000'} [2024-08-06 08:33:44,459][52811] DAMAGECOUNT value on done: 932091.0 [2024-08-06 08:33:44,459][52811] Sum rewards: 70.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.145', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.222', 'AMMO4': '0.230', 'weapon5': '0.256', 'weapon4': '0.286', 'weapon2': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.860', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:44,515][52664] DAMAGECOUNT value on done: 1025285.0 [2024-08-06 08:33:44,515][52664] Sum rewards: 81.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.685', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.216', 'weapon2': '0.284', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:44,597][52667] DAMAGECOUNT value on done: 1002362.0 [2024-08-06 08:33:44,599][52667] Sum rewards: 76.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.288', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.224', 'weapon5': '0.292', 'WEAPON3': '1.250', 'weapon3': '3.226', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:46,496][52659] DAMAGECOUNT value on done: 989267.0 [2024-08-06 08:33:46,498][52659] Sum rewards: 73.896, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.435', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.110', 'weapon5': '0.128', 'AMMO4': '0.168', 'AMMO3': '0.189', 'weapon2': '0.226', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.356', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:47,033][52649] DAMAGECOUNT value on done: 980518.0 [2024-08-06 08:33:47,033][52649] Sum rewards: 70.084, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.742', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.117', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '57.000'} [2024-08-06 08:33:47,173][52662] DAMAGECOUNT value on done: 988130.0 [2024-08-06 08:33:47,173][52662] Sum rewards: 67.215, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.435', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.190', 'AMMO3': '0.197', 'weapon2': '0.210', 'weapon5': '0.214', 'AMMO4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.160', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '55.000'} [2024-08-06 08:33:47,183][52660] DAMAGECOUNT value on done: 1002055.0 [2024-08-06 08:33:47,183][52660] Sum rewards: 79.108, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.390', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon5': '0.060', 'weapon2': '0.208', 'AMMO3': '0.276', 'WEAPON3': '1.600', 'weapon3': '3.490', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '68.000'} [2024-08-06 08:33:47,485][52650] Updated weights for policy 0, policy_version 85111 (0.0018) [2024-08-06 08:33:47,522][52664] DAMAGECOUNT value on done: 1034461.0 [2024-08-06 08:33:47,522][52664] Sum rewards: 75.645, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.335', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon5': '0.122', 'weapon4': '0.138', 'AMMO4': '0.243', 'AMMO3': '0.254', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '20.286', 'FRAGCOUNT': '65.000'} [2024-08-06 08:33:47,569][52811] DAMAGECOUNT value on done: 937073.0 [2024-08-06 08:33:47,569][52811] Sum rewards: 73.487, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.924', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.118', 'AMMO3': '0.215', 'weapon5': '0.220', 'AMMO4': '0.259', 'weapon2': '0.270', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:47,579][52667] DAMAGECOUNT value on done: 1004548.0 [2024-08-06 08:33:47,580][52667] Sum rewards: 78.591, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.660', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.014', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.198', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.512', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:47,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 697229312. Throughput: 0: 4363.1. Samples: 174308150. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:47,802][52567] Avg episode reward: [(0, '75.332')] [2024-08-06 08:33:49,497][52659] DAMAGECOUNT value on done: 1001926.0 [2024-08-06 08:33:49,499][52659] Sum rewards: 78.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.500', 'AMMO5': '0.014', 'AMMO2': '0.059', 'weapon5': '0.226', 'AMMO3': '0.232', 'AMMO4': '0.293', 'weapon4': '0.296', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.786', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:49,680][52649] DAMAGECOUNT value on done: 971439.0 [2024-08-06 08:33:49,680][52649] Sum rewards: 67.370, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.648', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.038', 'AMMO4': '0.134', 'weapon5': '0.158', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.200', 'HITCOUNT': '3.200', 'weapon3': '3.248', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '56.000'} [2024-08-06 08:33:49,996][52660] DAMAGECOUNT value on done: 983356.0 [2024-08-06 08:33:49,996][52662] DAMAGECOUNT value on done: 983794.0 [2024-08-06 08:33:49,997][52662] Sum rewards: 81.435, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.480', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.058', 'weapon5': '0.114', 'AMMO4': '0.204', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.262', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '67.000'} [2024-08-06 08:33:49,996][52660] Sum rewards: 82.860, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.598', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.054', 'AMMO4': '0.147', 'weapon5': '0.180', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.400', 'weapon3': '3.008', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:50,456][52667] DAMAGECOUNT value on done: 999674.0 [2024-08-06 08:33:50,456][52667] Sum rewards: 77.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.120', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.072', 'AMMO4': '0.135', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'WEAPON5': '0.250', 'weapon5': '0.254', 'weapon2': '0.572', 'WEAPON3': '1.200', 'weapon3': '2.880', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:50,591][52811] DAMAGECOUNT value on done: 921792.0 [2024-08-06 08:33:50,592][52811] Sum rewards: 72.985, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.040', 'AMMO5': '0.013', 'weapon4': '0.044', 'AMMO2': '0.054', 'weapon5': '0.132', 'AMMO3': '0.245', 'weapon2': '0.264', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:50,677][52664] DAMAGECOUNT value on done: 1032978.0 [2024-08-06 08:33:50,678][52664] Sum rewards: 81.058, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.056', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.135', 'weapon2': '0.876', 'WEAPON3': '1.050', 'weapon3': '2.936', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:51,885][52650] Updated weights for policy 0, policy_version 85121 (0.0021) [2024-08-06 08:33:52,262][52659] DAMAGECOUNT value on done: 987329.0 [2024-08-06 08:33:52,262][52659] Sum rewards: 85.105, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'AMMO2': '0.033', 'weapon4': '0.084', 'weapon5': '0.090', 'AMMO4': '0.165', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'HEALTH': '0.422', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.168', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:52,285][52649] DAMAGECOUNT value on done: 972364.0 [2024-08-06 08:33:52,285][52649] Sum rewards: 72.374, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.642', 'AMMO5': '0.020', 'WEAPON1': '0.020', 'AMMO2': '0.066', 'weapon5': '0.214', 'weapon4': '0.234', 'AMMO3': '0.284', 'AMMO4': '0.329', 'WEAPON4': '0.450', 'weapon2': '0.546', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.650', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '61.000'} [2024-08-06 08:33:52,338][52660] DAMAGECOUNT value on done: 980553.0 [2024-08-06 08:33:52,340][52660] Sum rewards: 85.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.770', 'AMMO5': '0.011', 'AMMO2': '0.059', 'weapon4': '0.060', 'weapon5': '0.152', 'AMMO3': '0.203', 'AMMO4': '0.296', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '68.500'} [2024-08-06 08:33:52,794][52567] Fps is (10 sec: 18021.7, 60 sec: 17612.7, 300 sec: 17467.0). Total num frames: 697327616. Throughput: 0: 4364.6. Samples: 174334530. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:52,795][52567] Avg episode reward: [(0, '75.450')] [2024-08-06 08:33:53,285][52662] DAMAGECOUNT value on done: 994028.0 [2024-08-06 08:33:53,286][52662] Sum rewards: 76.618, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.340', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.062', 'weapon4': '0.098', 'AMMO4': '0.147', 'AMMO3': '0.230', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.350', 'weapon3': '3.294', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:53,623][52664] DAMAGECOUNT value on done: 1029852.0 [2024-08-06 08:33:53,626][52664] Sum rewards: 84.790, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.013', 'AMMO2': '0.042', 'AMMO3': '0.161', 'AMMO4': '0.210', 'weapon5': '0.282', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.426', 'WEAPON3': '1.000', 'weapon3': '2.712', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.136', 'FRAGCOUNT': '69.000'} [2024-08-06 08:33:53,646][52667] DAMAGECOUNT value on done: 995341.0 [2024-08-06 08:33:53,648][52667] Sum rewards: 82.785, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.477', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.146', 'weapon2': '0.322', 'WEAPON3': '0.900', 'weapon3': '3.392', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:53,654][52811] DAMAGECOUNT value on done: 924518.0 [2024-08-06 08:33:53,659][52811] Sum rewards: 91.068, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.840', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.140', 'AMMO3': '0.215', 'weapon5': '0.228', 'weapon2': '0.238', 'AMMO4': '0.282', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '3.128', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.471', 'FRAGCOUNT': '76.000'} [2024-08-06 08:33:54,770][52659] DAMAGECOUNT value on done: 996694.0 [2024-08-06 08:33:54,771][52659] Sum rewards: 70.351, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.640', 'AMMO5': '0.009', 'weapon4': '0.028', 'weapon5': '0.032', 'AMMO2': '0.033', 'AMMO4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.845', 'FRAGCOUNT': '60.000'} [2024-08-06 08:33:55,099][52660] DAMAGECOUNT value on done: 988203.0 [2024-08-06 08:33:55,101][52660] Sum rewards: 75.868, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.104', 'AMMO3': '0.198', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.206', 'weapon2': '0.226', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:55,425][52649] DAMAGECOUNT value on done: 961008.0 [2024-08-06 08:33:55,426][52649] Sum rewards: 81.784, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.240', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.118', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 08:33:55,677][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:33:56,493][52662] DAMAGECOUNT value on done: 986258.0 [2024-08-06 08:33:56,493][52662] Sum rewards: 67.645, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.100', 'AMMO4': '0.202', 'AMMO3': '0.305', 'weapon5': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.572', 'WEAPON3': '1.800', 'weapon3': '2.694', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '58.000'} [2024-08-06 08:33:56,494][52664] DAMAGECOUNT value on done: 1041997.0 [2024-08-06 08:33:56,496][52664] Sum rewards: 68.797, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.954', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.279', 'weapon2': '0.314', 'WEAPON3': '1.650', 'HITCOUNT': '3.250', 'weapon3': '3.352', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '59.000'} [2024-08-06 08:33:56,792][52667] DAMAGECOUNT value on done: 1001674.0 [2024-08-06 08:33:56,793][52667] Sum rewards: 78.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.072', 'AMMO4': '0.156', 'weapon5': '0.158', 'AMMO3': '0.203', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.762', 'FRAGCOUNT': '64.000'} [2024-08-06 08:33:56,900][52650] Updated weights for policy 0, policy_version 85131 (0.0020) [2024-08-06 08:33:57,387][52659] DAMAGECOUNT value on done: 991671.0 [2024-08-06 08:33:57,390][52659] Sum rewards: 75.899, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.492', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.101', 'weapon4': '0.166', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:57,557][52660] DAMAGECOUNT value on done: 992838.0 [2024-08-06 08:33:57,557][52660] Sum rewards: 67.205, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.798', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.013', 'weapon5': '0.048', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.142', 'weapon2': '0.566', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.332', 'DAMAGECOUNT': '14.961', 'FRAGCOUNT': '54.000'} [2024-08-06 08:33:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 697409536. Throughput: 0: 4367.8. Samples: 174360740. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:33:57,795][52567] Avg episode reward: [(0, '75.519')] [2024-08-06 08:33:58,388][52649] DAMAGECOUNT value on done: 974420.0 [2024-08-06 08:33:58,389][52649] Sum rewards: 73.410, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.024', 'weapon5': '0.072', 'AMMO4': '0.114', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.284', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '63.000'} [2024-08-06 08:33:59,550][52664] DAMAGECOUNT value on done: 1038787.0 [2024-08-06 08:33:59,551][52664] Sum rewards: 65.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.471', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.042', 'weapon5': '0.074', 'AMMO4': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'weapon2': '0.548', 'WEAPON3': '1.600', 'weapon3': '3.128', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '57.000'} [2024-08-06 08:34:00,055][52662] DAMAGECOUNT value on done: 1002034.0 [2024-08-06 08:34:00,056][52662] Sum rewards: 80.326, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.089', 'weapon4': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon5': '0.014', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.368', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:00,058][52660] DAMAGECOUNT value on done: 982240.0 [2024-08-06 08:34:00,059][52660] Sum rewards: 81.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.038', 'AMMO3': '0.163', 'weapon4': '0.170', 'weapon5': '0.172', 'AMMO4': '0.190', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.000', 'weapon3': '2.928', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:00,534][52659] DAMAGECOUNT value on done: 988832.0 [2024-08-06 08:34:00,537][52659] Sum rewards: 79.796, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.114', 'weapon5': '0.128', 'AMMO3': '0.152', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'HEALTH': '0.321', 'weapon2': '0.892', 'WEAPON3': '0.900', 'weapon3': '2.672', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '62.000'} [2024-08-06 08:34:00,826][52649] DAMAGECOUNT value on done: 953386.0 [2024-08-06 08:34:00,830][52649] Sum rewards: 70.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.536', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.138', 'AMMO3': '0.198', 'AMMO4': '0.208', 'weapon5': '0.218', 'weapon2': '0.324', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.048', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '58.500'} [2024-08-06 08:34:01,471][52650] Updated weights for policy 0, policy_version 85141 (0.0023) [2024-08-06 08:34:02,167][52664] DAMAGECOUNT value on done: 1037228.0 [2024-08-06 08:34:02,167][52664] Sum rewards: 72.785, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.417', 'AMMO5': '0.017', 'AMMO2': '0.053', 'AMMO3': '0.173', 'weapon2': '0.238', 'weapon5': '0.252', 'AMMO4': '0.264', 'weapon4': '0.346', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.884', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 697499648. Throughput: 0: 4367.8. Samples: 174373860. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:02,794][52567] Avg episode reward: [(0, '75.593')] [2024-08-06 08:34:03,100][52662] DAMAGECOUNT value on done: 991179.0 [2024-08-06 08:34:03,100][52662] Sum rewards: 79.840, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.656', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.074', 'weapon5': '0.204', 'AMMO4': '0.245', 'AMMO3': '0.282', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '69.000'} [2024-08-06 08:34:03,139][52660] DAMAGECOUNT value on done: 981094.0 [2024-08-06 08:34:03,139][52660] Sum rewards: 65.701, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.104', 'AMMO5': '0.020', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.150', 'AMMO3': '0.200', 'weapon4': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.566', 'WEAPON3': '1.250', 'weapon3': '2.848', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '56.000'} [2024-08-06 08:34:03,459][52659] DAMAGECOUNT value on done: 989462.0 [2024-08-06 08:34:03,460][52659] Sum rewards: 69.274, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.618', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '57.000'} [2024-08-06 08:34:03,829][52649] DAMAGECOUNT value on done: 974052.0 [2024-08-06 08:34:03,830][52649] Sum rewards: 87.488, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.788', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.152', 'AMMO4': '0.202', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.261', 'FRAGCOUNT': '73.000'} [2024-08-06 08:34:04,574][52664] DAMAGECOUNT value on done: 1021267.0 [2024-08-06 08:34:04,574][52664] Sum rewards: 74.236, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.322', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.082', 'AMMO4': '0.108', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.446', 'WEAPON3': '1.250', 'weapon3': '3.262', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:05,552][52660] DAMAGECOUNT value on done: 986823.0 [2024-08-06 08:34:05,553][52660] Sum rewards: 81.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.150', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.058', 'weapon5': '0.108', 'AMMO4': '0.173', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'weapon3': '3.408', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.475', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:06,155][52650] Updated weights for policy 0, policy_version 85151 (0.0022) [2024-08-06 08:34:06,365][52662] DAMAGECOUNT value on done: 981301.0 [2024-08-06 08:34:06,367][52662] Sum rewards: 78.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.318', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.157', 'weapon5': '0.198', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:06,640][52659] DAMAGECOUNT value on done: 992418.0 [2024-08-06 08:34:06,642][52659] Sum rewards: 71.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.020', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon5': '0.154', 'AMMO4': '0.186', 'AMMO3': '0.222', 'weapon4': '0.254', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.076', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.589', 'FRAGCOUNT': '58.000'} [2024-08-06 08:34:06,992][52649] DAMAGECOUNT value on done: 976943.0 [2024-08-06 08:34:06,993][52649] Sum rewards: 62.568, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.180', 'AMMO5': '0.024', 'AMMO2': '0.071', 'weapon4': '0.182', 'AMMO3': '0.284', 'weapon5': '0.314', 'AMMO4': '0.353', 'weapon2': '0.450', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.750', 'weapon3': '2.730', 'HITCOUNT': '2.950', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '55.000'} [2024-08-06 08:34:07,186][52664] DAMAGECOUNT value on done: 1025578.0 [2024-08-06 08:34:07,187][52664] Sum rewards: 70.411, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.188', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.046', 'weapon5': '0.092', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.216', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.456', 'DAMAGECOUNT': '16.416', 'FRAGCOUNT': '59.000'} [2024-08-06 08:34:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 697581568. Throughput: 0: 4371.1. Samples: 174400130. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:07,794][52567] Avg episode reward: [(0, '75.227')] [2024-08-06 08:34:08,379][52660] DAMAGECOUNT value on done: 983804.0 [2024-08-06 08:34:08,382][52660] Sum rewards: 85.493, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.130', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.060', 'AMMO4': '0.062', 'AMMO3': '0.181', 'weapon2': '0.414', 'WEAPON3': '1.000', 'weapon3': '3.352', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '69.000'} [2024-08-06 08:34:08,962][52803] DAMAGECOUNT value on done: 920115.0 [2024-08-06 08:34:08,963][52803] Sum rewards: 79.220, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.420', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.032', 'WEAPON4': '0.150', 'AMMO4': '0.160', 'weapon5': '0.188', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '64.000'} [2024-08-06 08:34:09,282][52659] DAMAGECOUNT value on done: 1003720.0 [2024-08-06 08:34:09,283][52659] Sum rewards: 71.913, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.450', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.414', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:09,549][52662] DAMAGECOUNT value on done: 988770.0 [2024-08-06 08:34:09,550][52662] Sum rewards: 77.506, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.494', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.086', 'weapon5': '0.086', 'weapon2': '0.140', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'HITCOUNT': '3.210', 'weapon3': '3.446', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '69.000'} [2024-08-06 08:34:09,689][52664] DAMAGECOUNT value on done: 1037544.0 [2024-08-06 08:34:09,690][52664] Sum rewards: 82.999, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.535', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.090', 'weapon5': '0.114', 'AMMO3': '0.140', 'AMMO4': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '3.166', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '66.000'} [2024-08-06 08:34:10,207][52649] DAMAGECOUNT value on done: 965556.0 [2024-08-06 08:34:10,209][52649] Sum rewards: 79.764, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.043', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.070', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.200', 'AMMO3': '0.299', 'WEAPON3': '1.850', 'weapon3': '3.422', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '70.000'} [2024-08-06 08:34:10,684][52650] Updated weights for policy 0, policy_version 85161 (0.0012) [2024-08-06 08:34:11,666][52660] DAMAGECOUNT value on done: 982833.0 [2024-08-06 08:34:11,666][52660] Sum rewards: 78.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.090', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.063', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.310', 'weapon4': '0.386', 'WEAPON3': '1.200', 'weapon3': '2.948', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '64.000'} [2024-08-06 08:34:12,018][52803] DAMAGECOUNT value on done: 919129.0 [2024-08-06 08:34:12,020][52803] Sum rewards: 66.494, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.686', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon4': '0.144', 'weapon5': '0.164', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'AMMO4': '0.270', 'WEAPON4': '0.450', 'weapon2': '0.604', 'WEAPON3': '1.400', 'weapon3': '2.814', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '59.000'} [2024-08-06 08:34:12,222][52659] DAMAGECOUNT value on done: 984659.0 [2024-08-06 08:34:12,224][52659] Sum rewards: 82.720, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.747', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.036', 'weapon5': '0.054', 'AMMO4': '0.085', 'AMMO3': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.344', 'WEAPON3': '0.900', 'HITCOUNT': '3.430', 'weapon3': '3.442', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '66.000'} [2024-08-06 08:34:12,471][52664] DAMAGECOUNT value on done: 1020634.0 [2024-08-06 08:34:12,472][52664] Sum rewards: 80.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.072', 'AMMO4': '0.089', 'weapon5': '0.090', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.262', 'WEAPON3': '1.250', 'weapon3': '3.394', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.335', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:12,659][52662] DAMAGECOUNT value on done: 982846.0 [2024-08-06 08:34:12,660][52662] Sum rewards: 72.615, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.114', 'AMMO4': '0.134', 'AMMO3': '0.289', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.800', 'weapon3': '3.070', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '64.000'} [2024-08-06 08:34:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 697671680. Throughput: 0: 4376.7. Samples: 174426420. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:12,802][52567] Avg episode reward: [(0, '75.636')] [2024-08-06 08:34:14,671][52660] DAMAGECOUNT value on done: 992269.0 [2024-08-06 08:34:14,672][52660] Sum rewards: 70.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.695', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.058', 'weapon5': '0.158', 'weapon2': '0.188', 'AMMO4': '0.222', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.386', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.628', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:15,135][52803] DAMAGECOUNT value on done: 928830.0 [2024-08-06 08:34:15,135][52803] Sum rewards: 81.052, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.559', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.130', 'AMMO4': '0.147', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.308', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.235', 'FRAGCOUNT': '69.000'} [2024-08-06 08:34:15,343][52659] DAMAGECOUNT value on done: 996606.0 [2024-08-06 08:34:15,345][52659] Sum rewards: 80.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.864', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.084', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.741', 'FRAGCOUNT': '66.000'} [2024-08-06 08:34:15,419][52671] DAMAGECOUNT value on done: 997411.0 [2024-08-06 08:34:15,420][52671] Sum rewards: 82.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.879', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.148', 'AMMO3': '0.224', 'weapon2': '0.396', 'WEAPON3': '1.400', 'weapon3': '3.230', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '68.000'} [2024-08-06 08:34:15,588][52650] Updated weights for policy 0, policy_version 85171 (0.0023) [2024-08-06 08:34:17,315][52660] DAMAGECOUNT value on done: 1008060.0 [2024-08-06 08:34:17,316][52660] Sum rewards: 79.134, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.954', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.060', 'weapon5': '0.092', 'AMMO3': '0.206', 'AMMO4': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 697761792. Throughput: 0: 4374.7. Samples: 174439720. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:17,794][52567] Avg episode reward: [(0, '75.809')] [2024-08-06 08:34:18,055][52659] DAMAGECOUNT value on done: 988169.0 [2024-08-06 08:34:18,055][52659] Sum rewards: 70.796, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.384', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.098', 'weapon5': '0.116', 'AMMO3': '0.158', 'AMMO4': '0.218', 'weapon2': '0.220', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '3.170', 'weapon3': '3.376', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '59.000'} [2024-08-06 08:34:18,122][52803] DAMAGECOUNT value on done: 922162.0 [2024-08-06 08:34:18,124][52803] Sum rewards: 79.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.017', 'WEAPON4': '0.050', 'AMMO4': '0.085', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.468', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '66.000'} [2024-08-06 08:34:18,153][52671] DAMAGECOUNT value on done: 1003500.0 [2024-08-06 08:34:18,153][52671] Sum rewards: 75.676, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.969', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.146', 'AMMO4': '0.177', 'AMMO3': '0.197', 'weapon2': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.342', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '62.000'} [2024-08-06 08:34:18,503][52658] DAMAGECOUNT value on done: 996247.0 [2024-08-06 08:34:18,504][52658] Sum rewards: 75.716, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.071', 'AMMO3': '0.221', 'weapon2': '0.274', 'WEAPON3': '1.450', 'weapon3': '3.514', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '64.000'} [2024-08-06 08:34:18,605][52669] DAMAGECOUNT value on done: 989525.0 [2024-08-06 08:34:18,606][52669] Sum rewards: 61.498, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.200', 'AMMO5': '0.020', 'AMMO2': '0.047', 'weapon4': '0.158', 'AMMO3': '0.161', 'AMMO4': '0.235', 'weapon5': '0.252', 'WEAPON5': '0.500', 'WEAPON4': '0.500', 'weapon2': '0.552', 'WEAPON3': '1.000', 'weapon3': '2.826', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.847', 'FRAGCOUNT': '51.000'} [2024-08-06 08:34:19,903][52650] Updated weights for policy 0, policy_version 85181 (0.0031) [2024-08-06 08:34:20,388][52660] DAMAGECOUNT value on done: 985902.0 [2024-08-06 08:34:20,389][52660] Sum rewards: 78.011, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.446', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.114', 'weapon4': '0.116', 'AMMO4': '0.164', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.664', 'WEAPON3': '1.450', 'weapon3': '2.838', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '66.000'} [2024-08-06 08:34:21,122][52669] DAMAGECOUNT value on done: 989379.0 [2024-08-06 08:34:21,125][52669] Sum rewards: 84.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.004', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.106', 'AMMO4': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.244', 'WEAPON3': '1.350', 'weapon3': '3.438', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.599', 'FRAGCOUNT': '69.000'} [2024-08-06 08:34:21,177][52803] DAMAGECOUNT value on done: 923242.0 [2024-08-06 08:34:21,182][52803] Sum rewards: 84.378, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.730', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.175', 'weapon2': '0.588', 'WEAPON3': '1.050', 'weapon3': '3.178', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:21,303][52671] DAMAGECOUNT value on done: 996148.0 [2024-08-06 08:34:21,305][52671] Sum rewards: 78.500, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.680', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.048', 'weapon5': '0.084', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.324', 'WEAPON3': '1.000', 'weapon3': '3.380', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 08:34:21,571][52658] DAMAGECOUNT value on done: 996740.0 [2024-08-06 08:34:21,573][52658] Sum rewards: 82.453, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.496', 'AMMO5': '0.019', 'AMMO2': '0.042', 'weapon5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.235', 'weapon4': '0.282', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.842', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 697851904. Throughput: 0: 4374.9. Samples: 174465970. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:22,802][52567] Avg episode reward: [(0, '75.948')] [2024-08-06 08:34:23,454][52660] DAMAGECOUNT value on done: 989608.0 [2024-08-06 08:34:23,454][52660] Sum rewards: 87.754, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.445', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.138', 'AMMO4': '0.150', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.274', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.401', 'FRAGCOUNT': '73.000'} [2024-08-06 08:34:23,580][52669] DAMAGECOUNT value on done: 999215.0 [2024-08-06 08:34:23,582][52669] Sum rewards: 72.570, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.490', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'AMMO3': '0.232', 'weapon2': '0.354', 'WEAPON3': '1.450', 'weapon3': '3.288', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:24,280][52671] DAMAGECOUNT value on done: 1004056.0 [2024-08-06 08:34:24,280][52671] Sum rewards: 82.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'weapon4': '0.028', 'AMMO2': '0.034', 'weapon5': '0.098', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '65.500'} [2024-08-06 08:34:24,354][52803] DAMAGECOUNT value on done: 918992.0 [2024-08-06 08:34:24,354][52803] Sum rewards: 75.921, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.676', 'AMMO2': '0.011', 'AMMO4': '0.056', 'AMMO3': '0.153', 'weapon2': '0.530', 'WEAPON3': '1.050', 'weapon3': '3.364', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:24,809][52650] Updated weights for policy 0, policy_version 85191 (0.0011) [2024-08-06 08:34:24,947][52658] DAMAGECOUNT value on done: 999224.0 [2024-08-06 08:34:24,947][52658] Sum rewards: 77.576, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.914', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '64.000'} [2024-08-06 08:34:26,348][52669] DAMAGECOUNT value on done: 993220.0 [2024-08-06 08:34:26,351][52669] Sum rewards: 76.017, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.430', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.124', 'AMMO4': '0.137', 'AMMO3': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.446', 'WEAPON3': '0.850', 'weapon3': '2.968', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '58.000'} [2024-08-06 08:34:26,451][52660] DAMAGECOUNT value on done: 988401.0 [2024-08-06 08:34:26,452][52660] Sum rewards: 67.469, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.310', 'AMMO5': '0.017', 'AMMO2': '0.066', 'weapon4': '0.082', 'AMMO3': '0.215', 'weapon5': '0.276', 'AMMO4': '0.331', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.814', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '55.500'} [2024-08-06 08:34:26,982][52671] DAMAGECOUNT value on done: 1008802.0 [2024-08-06 08:34:26,983][52671] Sum rewards: 85.610, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.681', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.040', 'AMMO4': '0.152', 'weapon5': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.230', 'AMMO3': '0.271', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.306', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '72.000'} [2024-08-06 08:34:27,639][52803] DAMAGECOUNT value on done: 917656.0 [2024-08-06 08:34:27,640][52803] Sum rewards: 71.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.192', 'weapon2': '0.410', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.432', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '59.000'} [2024-08-06 08:34:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 697933824. Throughput: 0: 4378.7. Samples: 174492110. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:27,794][52567] Avg episode reward: [(0, '76.425')] [2024-08-06 08:34:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085197_697933824.pth... [2024-08-06 08:34:27,935][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084687_693755904.pth [2024-08-06 08:34:28,279][52658] DAMAGECOUNT value on done: 993258.0 [2024-08-06 08:34:28,280][52658] Sum rewards: 59.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.390', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.086', 'weapon4': '0.114', 'AMMO4': '0.184', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.400', 'HITCOUNT': '2.950', 'weapon3': '3.284', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '51.000'} [2024-08-06 08:34:28,537][52663] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:34:28,937][52664] Large shaping reward 2.585 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.057, -19.0), ('weapon5', 0.002)] [2024-08-06 08:34:29,138][52669] DAMAGECOUNT value on done: 999997.0 [2024-08-06 08:34:29,138][52669] Sum rewards: 74.837, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.497', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.112', 'weapon5': '0.146', 'AMMO4': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:29,504][52650] Updated weights for policy 0, policy_version 85201 (0.0021) [2024-08-06 08:34:29,603][52660] DAMAGECOUNT value on done: 979521.0 [2024-08-06 08:34:29,605][52660] Sum rewards: 78.266, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.130', 'AMMO4': '0.144', 'weapon4': '0.190', 'weapon2': '0.198', 'AMMO3': '0.207', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '66.000'} [2024-08-06 08:34:29,957][52671] DAMAGECOUNT value on done: 997690.0 [2024-08-06 08:34:29,959][52671] Sum rewards: 88.944, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.780', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.034', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.191', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.468', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.690', 'FRAGCOUNT': '71.500'} [2024-08-06 08:34:30,734][52803] DAMAGECOUNT value on done: 917074.0 [2024-08-06 08:34:30,734][52803] Sum rewards: 70.718, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.792', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.086', 'AMMO4': '0.153', 'weapon5': '0.174', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.650', 'weapon3': '3.128', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '62.000'} [2024-08-06 08:34:31,442][52658] DAMAGECOUNT value on done: 988821.0 [2024-08-06 08:34:31,444][52658] Sum rewards: 82.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.380', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO4': '0.195', 'AMMO3': '0.214', 'weapon4': '0.230', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.078', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.277', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:31,773][52669] DAMAGECOUNT value on done: 998654.0 [2024-08-06 08:34:31,773][52669] Sum rewards: 82.317, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.126', 'AMMO4': '0.133', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.568', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:31,809][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:34:32,496][52660] DAMAGECOUNT value on done: 981990.0 [2024-08-06 08:34:32,499][52660] Sum rewards: 85.614, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.046', 'WEAPON5': '0.050', 'HEALTH': '0.060', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.175', 'weapon4': '0.208', 'weapon2': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.910', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.004', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 698023936. Throughput: 0: 4368.9. Samples: 174504750. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:32,794][52567] Avg episode reward: [(0, '76.997')] [2024-08-06 08:34:33,177][52671] DAMAGECOUNT value on done: 997122.0 [2024-08-06 08:34:33,179][52671] Sum rewards: 62.837, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.060', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.178', 'weapon4': '0.204', 'AMMO4': '0.218', 'weapon2': '0.250', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'HITCOUNT': '2.670', 'weapon3': '3.004', 'DAMAGECOUNT': '15.093', 'FRAGCOUNT': '52.000'} [2024-08-06 08:34:33,824][52803] DAMAGECOUNT value on done: 925220.0 [2024-08-06 08:34:33,825][52803] Sum rewards: 85.188, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.005', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon2': '0.188', 'AMMO3': '0.197', 'WEAPON3': '1.200', 'weapon3': '3.610', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '72.000'} [2024-08-06 08:34:34,005][52650] Updated weights for policy 0, policy_version 85211 (0.0012) [2024-08-06 08:34:34,024][52658] DAMAGECOUNT value on done: 986059.0 [2024-08-06 08:34:34,026][52658] Sum rewards: 75.154, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.406', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.168', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.626', 'WEAPON3': '0.950', 'weapon3': '2.734', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:35,122][52669] DAMAGECOUNT value on done: 996413.0 [2024-08-06 08:34:35,127][52669] Sum rewards: 72.572, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.590', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.032', 'weapon5': '0.068', 'AMMO4': '0.106', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.360', 'weapon3': '3.490', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:36,149][52671] DAMAGECOUNT value on done: 1004400.0 [2024-08-06 08:34:36,157][52671] Sum rewards: 79.575, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.270', 'AMMO5': '0.012', 'AMMO2': '0.039', 'weapon4': '0.100', 'weapon2': '0.190', 'AMMO4': '0.197', 'AMMO3': '0.209', 'weapon5': '0.222', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:36,920][52803] DAMAGECOUNT value on done: 920221.0 [2024-08-06 08:34:36,923][52803] Sum rewards: 79.011, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.526', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.240', 'WEAPON3': '1.400', 'weapon3': '3.528', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '66.000'} [2024-08-06 08:34:36,925][52658] DAMAGECOUNT value on done: 1000220.0 [2024-08-06 08:34:36,926][52658] Sum rewards: 80.148, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.905', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.684', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:37,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 698105856. Throughput: 0: 4369.8. Samples: 174531170. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:37,795][52567] Avg episode reward: [(0, '76.734')] [2024-08-06 08:34:37,978][52669] DAMAGECOUNT value on done: 998267.0 [2024-08-06 08:34:37,981][52669] Sum rewards: 80.789, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.010', 'AMMO2': '0.033', 'AMMO3': '0.124', 'AMMO4': '0.166', 'weapon5': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'weapon4': '0.358', 'WEAPON3': '0.700', 'HEALTH': '0.734', 'weapon3': '2.824', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:38,764][52650] Updated weights for policy 0, policy_version 85221 (0.0018) [2024-08-06 08:34:38,906][52671] DAMAGECOUNT value on done: 983759.0 [2024-08-06 08:34:38,906][52671] Sum rewards: 82.334, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.492', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.050', 'AMMO3': '0.162', 'weapon2': '0.710', 'WEAPON3': '1.000', 'weapon3': '3.098', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:39,755][52658] DAMAGECOUNT value on done: 984273.0 [2024-08-06 08:34:39,757][52658] Sum rewards: 68.420, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.315', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.161', 'AMMO4': '0.166', 'weapon5': '0.216', 'weapon4': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.010', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.606', 'FRAGCOUNT': '55.000'} [2024-08-06 08:34:40,040][52803] DAMAGECOUNT value on done: 934134.0 [2024-08-06 08:34:40,040][52803] Sum rewards: 88.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'weapon2': '0.472', 'WEAPON3': '1.250', 'weapon3': '3.198', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.598', 'FRAGCOUNT': '73.000'} [2024-08-06 08:34:40,752][52669] DAMAGECOUNT value on done: 1006576.0 [2024-08-06 08:34:40,753][52669] Sum rewards: 78.638, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.241', 'AMMO5': '0.007', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.102', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.096', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '64.000'} [2024-08-06 08:34:41,605][52671] DAMAGECOUNT value on done: 998003.0 [2024-08-06 08:34:41,607][52671] Sum rewards: 70.644, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.072', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.034', 'weapon5': '0.046', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.700', 'WEAPON3': '1.200', 'HITCOUNT': '3.030', 'weapon3': '3.096', 'DAMAGECOUNT': '15.891', 'FRAGCOUNT': '58.000'} [2024-08-06 08:34:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 698204160. Throughput: 0: 4365.1. Samples: 174557170. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:42,794][52567] Avg episode reward: [(0, '76.913')] [2024-08-06 08:34:42,831][52658] DAMAGECOUNT value on done: 1013186.0 [2024-08-06 08:34:42,833][52658] Sum rewards: 74.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.215', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.060', 'weapon5': '0.138', 'AMMO4': '0.214', 'AMMO3': '0.244', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.288', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 08:34:43,150][52803] DAMAGECOUNT value on done: 929717.0 [2024-08-06 08:34:43,150][52803] Sum rewards: 67.809, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.730', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.102', 'weapon5': '0.104', 'AMMO4': '0.138', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.072', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.148', 'FRAGCOUNT': '58.000'} [2024-08-06 08:34:43,621][52669] DAMAGECOUNT value on done: 998286.0 [2024-08-06 08:34:43,622][52669] Sum rewards: 92.496, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.943', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '76.000'} [2024-08-06 08:34:43,645][52650] Updated weights for policy 0, policy_version 85231 (0.0010) [2024-08-06 08:34:44,257][52671] DAMAGECOUNT value on done: 998646.0 [2024-08-06 08:34:44,257][52671] Sum rewards: 77.276, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.630', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.052', 'weapon5': '0.130', 'AMMO4': '0.222', 'AMMO3': '0.283', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.266', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.743', 'FRAGCOUNT': '68.000'} [2024-08-06 08:34:44,741][52663] DAMAGECOUNT value on done: 1008761.0 [2024-08-06 08:34:44,741][52663] Sum rewards: 67.876, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.335', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon5': '0.116', 'weapon4': '0.132', 'AMMO4': '0.137', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '2.890', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '54.000'} [2024-08-06 08:34:45,330][52658] DAMAGECOUNT value on done: 1001116.0 [2024-08-06 08:34:45,332][52658] Sum rewards: 68.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.056', 'AMMO4': '0.069', 'weapon5': '0.140', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.569', 'FRAGCOUNT': '57.000'} [2024-08-06 08:34:46,120][52803] DAMAGECOUNT value on done: 918953.0 [2024-08-06 08:34:46,122][52803] Sum rewards: 66.799, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.124', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.176', 'AMMO3': '0.215', 'weapon2': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.030', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '56.500'} [2024-08-06 08:34:46,842][52669] DAMAGECOUNT value on done: 1003459.0 [2024-08-06 08:34:46,843][52669] Sum rewards: 66.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.140', 'weapon5': '0.160', 'AMMO3': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '3.068', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '55.000'} [2024-08-06 08:34:47,346][52671] DAMAGECOUNT value on done: 994153.0 [2024-08-06 08:34:47,347][52671] Sum rewards: 64.317, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.090', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.086', 'weapon5': '0.100', 'AMMO4': '0.151', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '54.000'} [2024-08-06 08:34:47,622][52663] DAMAGECOUNT value on done: 995001.0 [2024-08-06 08:34:47,622][52663] Sum rewards: 82.297, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.115', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.094', 'weapon4': '0.130', 'AMMO3': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:47,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 698286080. Throughput: 0: 4374.9. Samples: 174570730. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:47,794][52567] Avg episode reward: [(0, '76.590')] [2024-08-06 08:34:48,009][52650] Updated weights for policy 0, policy_version 85241 (0.0016) [2024-08-06 08:34:48,197][52658] DAMAGECOUNT value on done: 1005856.0 [2024-08-06 08:34:48,198][52658] Sum rewards: 72.345, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.410', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'weapon4': '0.062', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.122', 'AMMO3': '0.218', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.628', 'DAMAGECOUNT': '16.851', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:48,460][52667] Large shaping reward -2.519 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.27, -90.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:34:49,257][52803] DAMAGECOUNT value on done: 936557.0 [2024-08-06 08:34:49,257][52803] Sum rewards: 73.729, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.958', 'AMMO5': '0.022', 'AMMO2': '0.063', 'AMMO3': '0.176', 'weapon4': '0.182', 'weapon5': '0.246', 'AMMO4': '0.314', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.636', 'WEAPON3': '1.000', 'weapon3': '2.652', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.616', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:49,865][52669] DAMAGECOUNT value on done: 1002299.0 [2024-08-06 08:34:49,867][52669] Sum rewards: 69.325, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.690', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.066', 'weapon5': '0.128', 'AMMO4': '0.197', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '57.000'} [2024-08-06 08:34:50,626][52671] DAMAGECOUNT value on done: 996707.0 [2024-08-06 08:34:50,627][52671] Sum rewards: 74.964, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon2': '0.160', 'weapon5': '0.160', 'AMMO4': '0.167', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.586', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '61.000'} [2024-08-06 08:34:50,638][52658] DAMAGECOUNT value on done: 991571.0 [2024-08-06 08:34:50,638][52658] Sum rewards: 87.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.878', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.180', 'AMMO4': '0.184', 'AMMO3': '0.233', 'weapon4': '0.264', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.050', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.294', 'FRAGCOUNT': '72.000'} [2024-08-06 08:34:50,724][52663] DAMAGECOUNT value on done: 988543.0 [2024-08-06 08:34:50,725][52663] Sum rewards: 76.509, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.896', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.038', 'weapon5': '0.062', 'AMMO4': '0.082', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.269', 'weapon2': '0.512', 'WEAPON3': '1.700', 'weapon3': '3.138', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.650', 'FRAGCOUNT': '65.500'} [2024-08-06 08:34:52,413][52803] DAMAGECOUNT value on done: 919316.0 [2024-08-06 08:34:52,416][52803] Sum rewards: 66.997, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.492', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.218', 'AMMO4': '0.239', 'WEAPON4': '0.300', 'weapon4': '0.358', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '57.000'} [2024-08-06 08:34:52,443][52669] DAMAGECOUNT value on done: 990737.0 [2024-08-06 08:34:52,443][52669] Sum rewards: 73.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.958', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.142', 'AMMO3': '0.181', 'weapon4': '0.188', 'weapon5': '0.200', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.012', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:52,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 698368000. Throughput: 0: 4366.2. Samples: 174596610. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:52,795][52567] Avg episode reward: [(0, '76.134')] [2024-08-06 08:34:52,857][52650] Updated weights for policy 0, policy_version 85251 (0.0011) [2024-08-06 08:34:53,157][52658] DAMAGECOUNT value on done: 1002478.0 [2024-08-06 08:34:53,157][52658] Sum rewards: 70.746, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.242', 'AMMO5': '0.024', 'AMMO2': '0.062', 'weapon4': '0.214', 'AMMO3': '0.218', 'weapon5': '0.308', 'AMMO4': '0.312', 'weapon2': '0.500', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.608', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:53,291][52663] DAMAGECOUNT value on done: 997076.0 [2024-08-06 08:34:53,292][52663] Sum rewards: 66.742, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.180', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.162', 'AMMO4': '0.174', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'weapon5': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.732', 'WEAPON3': '1.200', 'weapon3': '2.616', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '54.000'} [2024-08-06 08:34:53,625][52671] DAMAGECOUNT value on done: 1000479.0 [2024-08-06 08:34:53,625][52671] Sum rewards: 77.978, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.941', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.150', 'AMMO3': '0.198', 'weapon5': '0.230', 'AMMO4': '0.277', 'weapon2': '0.368', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.934', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '63.000'} [2024-08-06 08:34:55,465][52669] DAMAGECOUNT value on done: 993036.0 [2024-08-06 08:34:55,467][52669] Sum rewards: 73.024, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.162', 'AMMO4': '0.201', 'AMMO3': '0.213', 'weapon2': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '3.120', 'weapon3': '3.254', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '60.000'} [2024-08-06 08:34:55,482][52803] DAMAGECOUNT value on done: 930127.0 [2024-08-06 08:34:55,484][52803] Sum rewards: 77.789, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.880', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.092', 'weapon5': '0.184', 'AMMO4': '0.228', 'AMMO3': '0.230', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '2.936', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:55,824][52658] DAMAGECOUNT value on done: 993507.0 [2024-08-06 08:34:55,824][52658] Sum rewards: 77.364, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.764', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.098', 'AMMO4': '0.100', 'weapon4': '0.140', 'WEAPON5': '0.200', 'weapon2': '0.202', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.346', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '65.000'} [2024-08-06 08:34:56,215][52663] DAMAGECOUNT value on done: 996103.0 [2024-08-06 08:34:56,215][52663] Sum rewards: 72.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.148', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.108', 'weapon5': '0.168', 'AMMO3': '0.195', 'weapon2': '0.200', 'AMMO4': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.300', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '58.000'} [2024-08-06 08:34:56,282][52647] DAMAGECOUNT value on done: 1057455.0 [2024-08-06 08:34:56,282][52647] Sum rewards: 67.566, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.882', 'AMMO5': '0.017', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.089', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.235', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '57.000'} [2024-08-06 08:34:56,511][52820] DAMAGECOUNT value on done: 916652.0 [2024-08-06 08:34:56,511][52820] Sum rewards: 76.911, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.640', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.174', 'weapon2': '0.360', 'WEAPON3': '1.050', 'weapon3': '3.472', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '62.000'} [2024-08-06 08:34:56,528][52671] DAMAGECOUNT value on done: 983316.0 [2024-08-06 08:34:56,529][52671] Sum rewards: 65.409, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.365', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon2': '0.162', 'weapon5': '0.170', 'AMMO4': '0.173', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.120', 'weapon3': '3.394', 'DAMAGECOUNT': '16.500', 'FRAGCOUNT': '56.000'} [2024-08-06 08:34:57,327][52650] Updated weights for policy 0, policy_version 85261 (0.0013) [2024-08-06 08:34:57,743][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:34:57,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 698458112. Throughput: 0: 4366.0. Samples: 174622890. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:34:57,795][52567] Avg episode reward: [(0, '75.892')] [2024-08-06 08:34:58,308][52669] DAMAGECOUNT value on done: 1001379.0 [2024-08-06 08:34:58,310][52669] Sum rewards: 83.953, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.522', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.146', 'AMMO4': '0.149', 'weapon5': '0.180', 'AMMO3': '0.210', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '68.000'} [2024-08-06 08:34:58,577][52803] DAMAGECOUNT value on done: 930228.0 [2024-08-06 08:34:58,580][52803] Sum rewards: 73.568, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.975', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.094', 'weapon5': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.384', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '63.000'} [2024-08-06 08:34:58,787][52658] DAMAGECOUNT value on done: 997047.0 [2024-08-06 08:34:58,798][52658] Sum rewards: 79.500, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.820', 'AMMO5': '0.013', 'AMMO2': '0.055', 'weapon4': '0.056', 'weapon5': '0.138', 'weapon2': '0.244', 'AMMO4': '0.275', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.246', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '69.000'} [2024-08-06 08:34:58,883][52647] DAMAGECOUNT value on done: 1044984.0 [2024-08-06 08:34:58,886][52647] Sum rewards: 84.062, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.102', 'AMMO3': '0.158', 'AMMO4': '0.174', 'WEAPON4': '0.250', 'HEALTH': '0.298', 'weapon2': '0.666', 'WEAPON3': '0.900', 'weapon3': '3.068', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '67.000'} [2024-08-06 08:34:59,024][52663] DAMAGECOUNT value on done: 1001045.0 [2024-08-06 08:34:59,025][52663] Sum rewards: 69.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.460', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.186', 'AMMO3': '0.233', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.342', 'weapon4': '0.442', 'WEAPON3': '1.400', 'weapon3': '2.694', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '59.000'} [2024-08-06 08:34:59,609][52820] DAMAGECOUNT value on done: 920772.0 [2024-08-06 08:34:59,609][52820] Sum rewards: 89.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.696', 'AMMO5': '0.006', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.082', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.174', 'AMMO3': '0.193', 'WEAPON3': '1.350', 'weapon3': '3.446', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.549', 'FRAGCOUNT': '72.000'} [2024-08-06 08:34:59,824][52671] DAMAGECOUNT value on done: 1009147.0 [2024-08-06 08:34:59,825][52671] Sum rewards: 73.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.630', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.259', 'weapon2': '0.292', 'WEAPON3': '1.550', 'weapon3': '3.336', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:00,745][52669] DAMAGECOUNT value on done: 1019262.0 [2024-08-06 08:35:00,746][52669] Sum rewards: 81.726, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.078', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.080', 'AMMO4': '0.101', 'weapon5': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.260', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '67.000'} [2024-08-06 08:35:01,564][52658] DAMAGECOUNT value on done: 983568.0 [2024-08-06 08:35:01,564][52658] Sum rewards: 85.485, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.385', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.072', 'AMMO3': '0.177', 'AMMO4': '0.187', 'weapon5': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.028', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '69.000'} [2024-08-06 08:35:01,635][52663] DAMAGECOUNT value on done: 994421.0 [2024-08-06 08:35:01,642][52663] Sum rewards: 84.886, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.841', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.056', 'AMMO4': '0.095', 'weapon5': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.366', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.850', 'FRAGCOUNT': '72.000'} [2024-08-06 08:35:01,664][52803] DAMAGECOUNT value on done: 936646.0 [2024-08-06 08:35:01,666][52803] Sum rewards: 78.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.758', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.090', 'AMMO3': '0.237', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.390', 'weapon5': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.702', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '67.000'} [2024-08-06 08:35:01,675][52647] DAMAGECOUNT value on done: 1050283.0 [2024-08-06 08:35:01,675][52647] Sum rewards: 69.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.015', 'weapon4': '0.042', 'AMMO2': '0.044', 'weapon5': '0.064', 'AMMO3': '0.197', 'AMMO4': '0.219', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.718', 'WEAPON3': '1.250', 'weapon3': '2.988', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.455', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:02,178][52650] Updated weights for policy 0, policy_version 85271 (0.0041) [2024-08-06 08:35:02,682][52820] DAMAGECOUNT value on done: 922721.0 [2024-08-06 08:35:02,683][52820] Sum rewards: 74.444, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.108', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.188', 'weapon4': '0.198', 'weapon2': '0.200', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.172', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:02,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 698548224. Throughput: 0: 4360.7. Samples: 174635950. Policy #0 lag: (min: 0.0, avg: 3.1, max: 7.0) [2024-08-06 08:35:02,794][52567] Avg episode reward: [(0, '76.284')] [2024-08-06 08:35:02,882][52671] DAMAGECOUNT value on done: 1005024.0 [2024-08-06 08:35:02,883][52671] Sum rewards: 63.791, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.021', 'AMMO2': '0.047', 'weapon4': '0.152', 'AMMO3': '0.192', 'AMMO4': '0.233', 'weapon5': '0.236', 'weapon2': '0.246', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'HITCOUNT': '2.800', 'weapon3': '3.116', 'DAMAGECOUNT': '15.636', 'FRAGCOUNT': '52.000'} [2024-08-06 08:35:03,414][52794] DAMAGECOUNT value on done: 989095.0 [2024-08-06 08:35:03,415][52794] Sum rewards: 63.238, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.015', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.085', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.389', 'FRAGCOUNT': '53.000'} [2024-08-06 08:35:03,915][52669] DAMAGECOUNT value on done: 1007358.0 [2024-08-06 08:35:03,915][52669] Sum rewards: 70.502, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.134', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.090', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.340', 'WEAPON3': '1.500', 'weapon3': '3.300', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:04,400][52663] DAMAGECOUNT value on done: 979020.0 [2024-08-06 08:35:04,402][52663] Sum rewards: 71.741, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.669', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.164', 'AMMO3': '0.212', 'weapon5': '0.220', 'AMMO4': '0.247', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.578', 'WEAPON3': '1.300', 'weapon3': '2.736', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:04,574][52647] DAMAGECOUNT value on done: 1048352.0 [2024-08-06 08:35:04,574][52647] Sum rewards: 76.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.687', 'AMMO5': '0.023', 'AMMO2': '0.064', 'weapon2': '0.188', 'AMMO3': '0.227', 'AMMO4': '0.320', 'weapon4': '0.336', 'weapon5': '0.356', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.760', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:04,597][52658] DAMAGECOUNT value on done: 999165.0 [2024-08-06 08:35:04,598][52658] Sum rewards: 73.544, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.269', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.184', 'AMMO4': '0.227', 'AMMO3': '0.230', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.350', 'weapon3': '2.816', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:04,772][52803] DAMAGECOUNT value on done: 932934.0 [2024-08-06 08:35:04,776][52803] Sum rewards: 74.493, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.006', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.050', 'weapon5': '0.132', 'AMMO4': '0.189', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.793', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:05,816][52820] DAMAGECOUNT value on done: 909930.0 [2024-08-06 08:35:05,818][52820] Sum rewards: 70.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.316', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon5': '0.144', 'AMMO4': '0.153', 'weapon4': '0.204', 'AMMO3': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '2.886', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '59.000'} [2024-08-06 08:35:05,998][52671] DAMAGECOUNT value on done: 999016.0 [2024-08-06 08:35:05,998][52671] Sum rewards: 85.838, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.121', 'weapon5': '0.178', 'AMMO3': '0.196', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.284', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '70.500'} [2024-08-06 08:35:06,038][52794] DAMAGECOUNT value on done: 997628.0 [2024-08-06 08:35:06,038][52794] Sum rewards: 75.388, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.170', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon4': '0.066', 'AMMO4': '0.116', 'weapon5': '0.158', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.300', 'weapon3': '3.082', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '62.500'} [2024-08-06 08:35:06,736][52669] DAMAGECOUNT value on done: 1004727.0 [2024-08-06 08:35:06,736][52669] Sum rewards: 81.394, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.792', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.051', 'AMMO3': '0.179', 'weapon4': '0.196', 'AMMO4': '0.257', 'weapon5': '0.286', 'weapon2': '0.378', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.860', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '65.500'} [2024-08-06 08:35:06,930][52650] Updated weights for policy 0, policy_version 85281 (0.0010) [2024-08-06 08:35:07,219][52647] DAMAGECOUNT value on done: 1058400.0 [2024-08-06 08:35:07,220][52647] Sum rewards: 67.951, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.918', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.087', 'weapon5': '0.102', 'WEAPON4': '0.200', 'AMMO3': '0.248', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '58.000'} [2024-08-06 08:35:07,407][52663] DAMAGECOUNT value on done: 990735.0 [2024-08-06 08:35:07,407][52663] Sum rewards: 65.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.006', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.064', 'AMMO4': '0.120', 'weapon5': '0.208', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.926', 'FRAGCOUNT': '54.000'} [2024-08-06 08:35:07,546][52658] DAMAGECOUNT value on done: 992997.0 [2024-08-06 08:35:07,547][52658] Sum rewards: 71.339, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.093', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.280', 'WEAPON3': '1.300', 'HITCOUNT': '3.320', 'weapon3': '3.408', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 698630144. Throughput: 0: 4360.9. Samples: 174662210. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:07,795][52567] Avg episode reward: [(0, '75.769')] [2024-08-06 08:35:07,813][52803] DAMAGECOUNT value on done: 929567.0 [2024-08-06 08:35:07,818][52803] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO3': '0.167', 'AMMO4': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.934', 'WEAPON3': '1.100', 'weapon3': '2.758', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '59.000'} [2024-08-06 08:35:08,600][52664] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:35:08,652][52671] DAMAGECOUNT value on done: 1004630.0 [2024-08-06 08:35:08,654][52671] Sum rewards: 80.553, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.158', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.152', 'AMMO4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.236', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.276', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '69.000'} [2024-08-06 08:35:08,986][52820] DAMAGECOUNT value on done: 921333.0 [2024-08-06 08:35:08,986][52820] Sum rewards: 73.045, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.760', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon4': '0.116', 'weapon5': '0.170', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.283', 'WEAPON3': '1.650', 'weapon3': '3.258', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '61.000'} [2024-08-06 08:35:09,353][52794] DAMAGECOUNT value on done: 1003662.0 [2024-08-06 08:35:09,356][52794] Sum rewards: 66.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.714', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon5': '0.162', 'AMMO4': '0.175', 'weapon4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.052', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '57.000'} [2024-08-06 08:35:09,527][52647] DAMAGECOUNT value on done: 1052908.0 [2024-08-06 08:35:09,529][52647] Sum rewards: 77.306, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.540', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.098', 'AMMO4': '0.122', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'WEAPON3': '1.800', 'weapon3': '3.420', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '67.000'} [2024-08-06 08:35:09,645][52669] DAMAGECOUNT value on done: 1008426.0 [2024-08-06 08:35:09,646][52669] Sum rewards: 67.217, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.995', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.044', 'AMMO4': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.259', 'weapon2': '0.320', 'WEAPON3': '1.600', 'HITCOUNT': '3.190', 'weapon3': '3.398', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '59.000'} [2024-08-06 08:35:10,292][52663] DAMAGECOUNT value on done: 987262.0 [2024-08-06 08:35:10,292][52663] Sum rewards: 80.179, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.120', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.137', 'weapon4': '0.168', 'AMMO4': '0.231', 'weapon5': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.468', 'WEAPON3': '0.900', 'weapon3': '2.864', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '63.000'} [2024-08-06 08:35:10,304][52658] DAMAGECOUNT value on done: 989385.0 [2024-08-06 08:35:10,305][52658] Sum rewards: 79.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.867', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.050', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.596', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '66.500'} [2024-08-06 08:35:11,461][52671] DAMAGECOUNT value on done: 988268.0 [2024-08-06 08:35:11,462][52671] Sum rewards: 79.560, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.022', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.106', 'weapon5': '0.146', 'AMMO4': '0.192', 'weapon2': '0.216', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.264', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '69.000'} [2024-08-06 08:35:11,762][52650] Updated weights for policy 0, policy_version 85291 (0.0011) [2024-08-06 08:35:12,150][52820] DAMAGECOUNT value on done: 907138.0 [2024-08-06 08:35:12,150][52820] Sum rewards: 77.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.050', 'AMMO5': '0.023', 'AMMO2': '0.040', 'AMMO3': '0.131', 'AMMO4': '0.201', 'weapon5': '0.274', 'weapon4': '0.354', 'weapon2': '0.472', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '0.900', 'weapon3': '2.596', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 08:35:12,476][52794] DAMAGECOUNT value on done: 990632.0 [2024-08-06 08:35:12,484][52794] Sum rewards: 80.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.915', 'AMMO5': '0.003', 'AMMO2': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO4': '0.130', 'AMMO3': '0.199', 'weapon4': '0.276', 'weapon2': '0.314', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.805', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:12,639][52669] DAMAGECOUNT value on done: 1010841.0 [2024-08-06 08:35:12,641][52669] Sum rewards: 78.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.147', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.054', 'AMMO4': '0.136', 'weapon5': '0.160', 'AMMO3': '0.207', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.200', 'weapon3': '2.986', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.767', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:12,717][52658] DAMAGECOUNT value on done: 999424.0 [2024-08-06 08:35:12,717][52658] Sum rewards: 69.802, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.160', 'AMMO5': '0.011', 'AMMO2': '0.047', 'weapon4': '0.098', 'weapon5': '0.122', 'AMMO4': '0.235', 'AMMO3': '0.255', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.672', 'WEAPON3': '1.500', 'weapon3': '2.778', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '59.500'} [2024-08-06 08:35:12,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 698720256. Throughput: 0: 4364.4. Samples: 174688510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:12,795][52567] Avg episode reward: [(0, '75.585')] [2024-08-06 08:35:12,818][52647] DAMAGECOUNT value on done: 1054451.0 [2024-08-06 08:35:12,819][52647] Sum rewards: 71.190, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.960', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.231', 'weapon2': '0.580', 'WEAPON3': '1.300', 'weapon3': '3.202', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:13,326][52663] DAMAGECOUNT value on done: 996841.0 [2024-08-06 08:35:13,326][52663] Sum rewards: 86.216, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.050', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.074', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.178', 'AMMO3': '0.256', 'WEAPON3': '1.550', 'weapon3': '3.514', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '21.252', 'FRAGCOUNT': '72.000'} [2024-08-06 08:35:13,663][52660] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:35:15,289][52820] DAMAGECOUNT value on done: 914209.0 [2024-08-06 08:35:15,290][52820] Sum rewards: 87.830, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.260', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.056', 'AMMO3': '0.233', 'weapon2': '0.326', 'WEAPON3': '1.450', 'weapon3': '3.466', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.204', 'FRAGCOUNT': '72.000'} [2024-08-06 08:35:15,375][52647] DAMAGECOUNT value on done: 1032045.0 [2024-08-06 08:35:15,375][52647] Sum rewards: 86.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.005', 'AMMO2': '0.038', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.164', 'AMMO4': '0.188', 'AMMO3': '0.211', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '72.000'} [2024-08-06 08:35:15,617][52794] DAMAGECOUNT value on done: 985114.0 [2024-08-06 08:35:15,618][52794] Sum rewards: 81.513, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.096', 'weapon5': '0.110', 'AMMO4': '0.121', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'WEAPON3': '1.500', 'weapon3': '3.370', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.915', 'FRAGCOUNT': '69.000'} [2024-08-06 08:35:16,224][52663] DAMAGECOUNT value on done: 982104.0 [2024-08-06 08:35:16,227][52663] Sum rewards: 86.271, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.355', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.138', 'AMMO3': '0.164', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '68.000'} [2024-08-06 08:35:16,235][52650] Updated weights for policy 0, policy_version 85301 (0.0025) [2024-08-06 08:35:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 698810368. Throughput: 0: 4379.1. Samples: 174701810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:17,794][52567] Avg episode reward: [(0, '75.789')] [2024-08-06 08:35:18,121][52647] DAMAGECOUNT value on done: 1046788.0 [2024-08-06 08:35:18,121][52647] Sum rewards: 79.034, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.845', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon4': '0.138', 'weapon5': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.261', 'WEAPON5': '0.350', 'weapon2': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.932', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.500'} [2024-08-06 08:35:18,324][52820] DAMAGECOUNT value on done: 916979.0 [2024-08-06 08:35:18,326][52820] Sum rewards: 77.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.270', 'AMMO5': '0.008', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO2': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO4': '0.205', 'weapon2': '0.236', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.480', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '66.000'} [2024-08-06 08:35:18,469][52794] DAMAGECOUNT value on done: 988394.0 [2024-08-06 08:35:18,470][52794] Sum rewards: 72.303, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.545', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.115', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'weapon2': '0.334', 'weapon4': '0.418', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '58.000'} [2024-08-06 08:35:19,256][52663] DAMAGECOUNT value on done: 981110.0 [2024-08-06 08:35:19,257][52663] Sum rewards: 78.194, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.460', 'AMMO5': '0.022', 'AMMO2': '0.066', 'AMMO3': '0.185', 'weapon4': '0.252', 'weapon5': '0.276', 'weapon2': '0.296', 'AMMO4': '0.329', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.850', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '66.000'} [2024-08-06 08:35:19,633][52820] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:35:20,905][52650] Updated weights for policy 0, policy_version 85311 (0.0024) [2024-08-06 08:35:20,916][52647] DAMAGECOUNT value on done: 1039864.0 [2024-08-06 08:35:20,918][52647] Sum rewards: 76.128, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.004', 'weapon4': '0.020', 'AMMO2': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.154', 'AMMO3': '0.251', 'weapon2': '0.256', 'WEAPON3': '1.550', 'HITCOUNT': '3.490', 'weapon3': '3.502', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '65.000'} [2024-08-06 08:35:21,421][52794] DAMAGECOUNT value on done: 991580.0 [2024-08-06 08:35:21,422][52794] Sum rewards: 73.428, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.523', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.170', 'weapon5': '0.176', 'weapon2': '0.224', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.224', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:21,445][52820] DAMAGECOUNT value on done: 923111.0 [2024-08-06 08:35:21,447][52820] Sum rewards: 76.355, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.685', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.104', 'weapon5': '0.194', 'AMMO3': '0.196', 'AMMO4': '0.246', 'weapon2': '0.276', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:21,702][52811] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:35:22,276][52663] DAMAGECOUNT value on done: 988451.0 [2024-08-06 08:35:22,279][52663] Sum rewards: 83.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.455', 'AMMO5': '0.011', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.128', 'weapon5': '0.174', 'AMMO3': '0.183', 'weapon2': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.150', 'weapon3': '3.262', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.653', 'FRAGCOUNT': '67.000'} [2024-08-06 08:35:22,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 698900480. Throughput: 0: 4383.1. Samples: 174728410. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:22,802][52567] Avg episode reward: [(0, '76.042')] [2024-08-06 08:35:23,850][52647] DAMAGECOUNT value on done: 1041691.0 [2024-08-06 08:35:23,851][52647] Sum rewards: 65.534, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.438', 'AMMO5': '0.019', 'AMMO2': '0.040', 'AMMO3': '0.137', 'AMMO4': '0.197', 'weapon5': '0.210', 'weapon4': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.510', 'WEAPON3': '0.850', 'weapon3': '2.676', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '15.711', 'FRAGCOUNT': '52.000'} [2024-08-06 08:35:24,069][52794] DAMAGECOUNT value on done: 982395.0 [2024-08-06 08:35:24,070][52794] Sum rewards: 83.763, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.030', 'HEALTH': '0.050', 'weapon4': '0.070', 'AMMO4': '0.150', 'AMMO3': '0.168', 'weapon5': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.716', 'WEAPON3': '0.950', 'weapon3': '2.782', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.427', 'FRAGCOUNT': '66.000'} [2024-08-06 08:35:24,515][52820] DAMAGECOUNT value on done: 930403.0 [2024-08-06 08:35:24,515][52820] Sum rewards: 65.489, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.924', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.088', 'weapon5': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon2': '0.176', 'AMMO3': '0.207', 'WEAPON3': '1.250', 'HITCOUNT': '3.060', 'weapon3': '3.476', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '54.000'} [2024-08-06 08:35:25,486][52663] DAMAGECOUNT value on done: 990358.0 [2024-08-06 08:35:25,486][52663] Sum rewards: 77.933, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.062', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.178', 'AMMO3': '0.195', 'weapon5': '0.238', 'weapon2': '0.240', 'AMMO4': '0.243', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.092', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:25,556][52650] Updated weights for policy 0, policy_version 85321 (0.0023) [2024-08-06 08:35:25,576][52795] DAMAGECOUNT value on done: 914577.0 [2024-08-06 08:35:25,576][52795] Sum rewards: 78.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.312', 'AMMO5': '0.023', 'AMMO2': '0.054', 'AMMO3': '0.196', 'weapon4': '0.244', 'AMMO4': '0.268', 'weapon5': '0.278', 'weapon2': '0.326', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.840', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '63.500'} [2024-08-06 08:35:26,380][52647] DAMAGECOUNT value on done: 1040650.0 [2024-08-06 08:35:26,380][52647] Sum rewards: 72.611, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.732', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.400', 'weapon3': '2.792', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.151', 'FRAGCOUNT': '61.000'} [2024-08-06 08:35:27,036][52794] DAMAGECOUNT value on done: 994909.0 [2024-08-06 08:35:27,036][52794] Sum rewards: 64.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.828', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon4': '0.042', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.180', 'weapon2': '0.220', 'AMMO3': '0.254', 'WEAPON3': '1.400', 'HITCOUNT': '3.290', 'weapon3': '3.486', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '53.000'} [2024-08-06 08:35:27,704][52820] DAMAGECOUNT value on done: 911407.0 [2024-08-06 08:35:27,706][52820] Sum rewards: 77.125, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.793', 'AMMO2': '0.013', 'weapon4': '0.058', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'weapon2': '0.226', 'AMMO3': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.526', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:27,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17467.2). Total num frames: 698974208. Throughput: 0: 4389.3. Samples: 174754690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:27,795][52567] Avg episode reward: [(0, '75.555')] [2024-08-06 08:35:28,108][52663] DAMAGECOUNT value on done: 994325.0 [2024-08-06 08:35:28,110][52663] Sum rewards: 56.199, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.654', 'AMMO5': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon4': '0.232', 'AMMO3': '0.250', 'weapon5': '0.308', 'WEAPON4': '0.350', 'weapon2': '0.460', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.684', 'HITCOUNT': '2.750', 'DAMAGECOUNT': '14.865', 'FRAGCOUNT': '47.500'} [2024-08-06 08:35:28,546][52614] Signal inference workers to stop experience collection... (15650 times) [2024-08-06 08:35:28,554][52614] Signal inference workers to resume experience collection... (15650 times) [2024-08-06 08:35:28,621][52650] InferenceWorker_p0-w0: stopping experience collection (15650 times) [2024-08-06 08:35:28,622][52650] InferenceWorker_p0-w0: resuming experience collection (15650 times) [2024-08-06 08:35:28,797][52795] DAMAGECOUNT value on done: 909930.0 [2024-08-06 08:35:28,798][52795] Sum rewards: 64.887, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.364', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.072', 'WEAPON4': '0.100', 'AMMO4': '0.119', 'AMMO3': '0.288', 'weapon2': '0.750', 'WEAPON3': '1.700', 'weapon3': '2.866', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '56.000'} [2024-08-06 08:35:29,354][52647] DAMAGECOUNT value on done: 1047368.0 [2024-08-06 08:35:29,356][52647] Sum rewards: 66.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.285', 'AMMO5': '0.017', 'AMMO2': '0.043', 'AMMO4': '0.213', 'AMMO3': '0.217', 'weapon5': '0.218', 'weapon2': '0.248', 'weapon4': '0.284', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.950', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.466', 'FRAGCOUNT': '53.000'} [2024-08-06 08:35:30,041][52794] DAMAGECOUNT value on done: 991837.0 [2024-08-06 08:35:30,044][52794] Sum rewards: 63.580, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.025', 'AMMO2': '0.062', 'weapon5': '0.212', 'AMMO3': '0.216', 'weapon4': '0.218', 'AMMO4': '0.312', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'weapon2': '0.698', 'WEAPON3': '1.300', 'weapon3': '2.572', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '53.000'} [2024-08-06 08:35:30,828][52650] Updated weights for policy 0, policy_version 85331 (0.0014) [2024-08-06 08:35:30,960][52820] DAMAGECOUNT value on done: 925036.0 [2024-08-06 08:35:30,961][52820] Sum rewards: 82.348, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.716', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.134', 'weapon2': '0.152', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.261', 'WEAPON3': '1.700', 'weapon3': '3.366', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '70.000'} [2024-08-06 08:35:31,410][52663] DAMAGECOUNT value on done: 991930.0 [2024-08-06 08:35:31,410][52663] Sum rewards: 74.249, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.127', 'weapon5': '0.134', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:31,900][52647] DAMAGECOUNT value on done: 1040841.0 [2024-08-06 08:35:31,902][52647] Sum rewards: 67.051, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.631', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.146', 'AMMO4': '0.175', 'AMMO3': '0.205', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.150', 'weapon3': '3.324', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '54.000'} [2024-08-06 08:35:32,028][52795] DAMAGECOUNT value on done: 910435.0 [2024-08-06 08:35:32,030][52795] Sum rewards: 70.726, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.901', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.075', 'weapon5': '0.108', 'weapon2': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'HITCOUNT': '3.310', 'weapon3': '3.538', 'DAMAGECOUNT': '16.929', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:32,484][52794] DAMAGECOUNT value on done: 983525.0 [2024-08-06 08:35:32,484][52794] Sum rewards: 95.728, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.164', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.102', 'weapon2': '0.166', 'AMMO3': '0.210', 'AMMO4': '0.249', 'weapon5': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.220', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '22.215', 'FRAGCOUNT': '77.000'} [2024-08-06 08:35:32,795][52567] Fps is (10 sec: 16383.3, 60 sec: 17339.6, 300 sec: 17467.1). Total num frames: 699064320. Throughput: 0: 4375.7. Samples: 174767640. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:32,796][52567] Avg episode reward: [(0, '74.868')] [2024-08-06 08:35:34,224][52663] DAMAGECOUNT value on done: 996863.0 [2024-08-06 08:35:34,225][52663] Sum rewards: 71.684, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.405', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.137', 'weapon5': '0.162', 'AMMO3': '0.176', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.394', 'weapon4': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '58.000'} [2024-08-06 08:35:34,269][52820] DAMAGECOUNT value on done: 936398.0 [2024-08-06 08:35:34,269][52820] Sum rewards: 68.677, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.024', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO3': '0.179', 'AMMO4': '0.179', 'weapon5': '0.264', 'weapon4': '0.296', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.364', 'WEAPON3': '1.100', 'weapon3': '2.798', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.332', 'FRAGCOUNT': '56.000'} [2024-08-06 08:35:34,774][52650] Updated weights for policy 0, policy_version 85341 (0.0019) [2024-08-06 08:35:34,963][52647] DAMAGECOUNT value on done: 1048687.0 [2024-08-06 08:35:34,963][52647] Sum rewards: 72.868, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.118', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon4': '0.072', 'AMMO4': '0.204', 'AMMO3': '0.215', 'weapon5': '0.258', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '61.000'} [2024-08-06 08:35:35,138][52794] DAMAGECOUNT value on done: 997622.0 [2024-08-06 08:35:35,138][52794] Sum rewards: 65.104, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.130', 'weapon2': '0.204', 'AMMO3': '0.245', 'AMMO4': '0.274', 'weapon5': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'HITCOUNT': '2.870', 'weapon3': '3.012', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '55.000'} [2024-08-06 08:35:35,274][52795] DAMAGECOUNT value on done: 926575.0 [2024-08-06 08:35:35,277][52795] Sum rewards: 74.486, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.845', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.036', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.248', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '63.000'} [2024-08-06 08:35:36,704][52663] DAMAGECOUNT value on done: 1004740.0 [2024-08-06 08:35:36,706][52663] Sum rewards: 73.237, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.856', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.082', 'WEAPON5': '0.100', 'weapon4': '0.124', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'weapon2': '0.354', 'WEAPON3': '1.350', 'weapon3': '3.184', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:37,396][52820] DAMAGECOUNT value on done: 923425.0 [2024-08-06 08:35:37,397][52820] Sum rewards: 68.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.172', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.116', 'AMMO4': '0.193', 'AMMO3': '0.201', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.332', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '56.000'} [2024-08-06 08:35:37,731][52670] DAMAGECOUNT value on done: 978390.0 [2024-08-06 08:35:37,731][52670] Sum rewards: 76.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.748', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.103', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.264', 'weapon5': '0.286', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '63.000'} [2024-08-06 08:35:37,731][52647] DAMAGECOUNT value on done: 1047963.0 [2024-08-06 08:35:37,734][52647] Sum rewards: 74.597, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.600', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.042', 'weapon5': '0.078', 'AMMO4': '0.094', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.504', 'WEAPON3': '1.100', 'weapon3': '3.236', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '59.000'} [2024-08-06 08:35:37,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.9, 300 sec: 17494.8). Total num frames: 699162624. Throughput: 0: 4372.5. Samples: 174793370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:37,794][52567] Avg episode reward: [(0, '74.787')] [2024-08-06 08:35:38,283][52794] DAMAGECOUNT value on done: 992773.0 [2024-08-06 08:35:38,284][52794] Sum rewards: 77.520, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.940', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.120', 'weapon4': '0.140', 'AMMO4': '0.185', 'AMMO3': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.110', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:38,522][52795] DAMAGECOUNT value on done: 910876.0 [2024-08-06 08:35:38,526][52795] Sum rewards: 74.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.680', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.062', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.572', 'WEAPON3': '1.100', 'weapon3': '3.142', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:39,772][52650] Updated weights for policy 0, policy_version 85351 (0.0018) [2024-08-06 08:35:39,917][52663] DAMAGECOUNT value on done: 982559.0 [2024-08-06 08:35:39,918][52663] Sum rewards: 65.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.990', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon5': '0.138', 'AMMO4': '0.148', 'weapon4': '0.178', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.545', 'FRAGCOUNT': '56.000'} [2024-08-06 08:35:40,172][52647] DAMAGECOUNT value on done: 1034861.0 [2024-08-06 08:35:40,173][52647] Sum rewards: 79.050, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.272', 'AMMO2': '0.008', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'AMMO3': '0.192', 'weapon5': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.687', 'FRAGCOUNT': '63.000'} [2024-08-06 08:35:40,479][52820] DAMAGECOUNT value on done: 922564.0 [2024-08-06 08:35:40,480][52820] Sum rewards: 77.298, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.805', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.124', 'AMMO4': '0.129', 'weapon4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.008', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.160', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:40,671][52670] DAMAGECOUNT value on done: 999584.0 [2024-08-06 08:35:40,672][52670] Sum rewards: 70.767, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.442', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.085', 'weapon5': '0.098', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.448', 'WEAPON3': '1.550', 'weapon3': '3.168', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '61.000'} [2024-08-06 08:35:41,360][52794] DAMAGECOUNT value on done: 1003937.0 [2024-08-06 08:35:41,362][52794] Sum rewards: 59.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.804', 'AMMO5': '0.016', 'AMMO2': '0.042', 'AMMO4': '0.210', 'weapon5': '0.214', 'AMMO3': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'weapon4': '0.538', 'WEAPON3': '1.450', 'weapon3': '2.486', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '15.468', 'FRAGCOUNT': '51.000'} [2024-08-06 08:35:41,618][52795] DAMAGECOUNT value on done: 912844.0 [2024-08-06 08:35:41,619][52795] Sum rewards: 67.021, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.072', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.354', 'WEAPON3': '1.150', 'HITCOUNT': '3.100', 'weapon3': '3.370', 'DAMAGECOUNT': '15.987', 'FRAGCOUNT': '56.000'} [2024-08-06 08:35:42,794][52567] Fps is (10 sec: 18023.1, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 699244544. Throughput: 0: 4372.7. Samples: 174819660. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:42,794][52567] Avg episode reward: [(0, '74.487')] [2024-08-06 08:35:43,207][52647] DAMAGECOUNT value on done: 1045382.0 [2024-08-06 08:35:43,209][52647] Sum rewards: 60.863, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.750', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon5': '0.052', 'AMMO4': '0.068', 'weapon4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.261', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.373', 'FRAGCOUNT': '52.500'} [2024-08-06 08:35:43,230][52670] DAMAGECOUNT value on done: 979826.0 [2024-08-06 08:35:43,230][52670] Sum rewards: 71.157, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.986', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.014', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.286', 'weapon2': '0.696', 'WEAPON3': '1.650', 'weapon3': '2.996', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:43,688][52820] DAMAGECOUNT value on done: 924210.0 [2024-08-06 08:35:43,692][52820] Sum rewards: 78.634, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.450', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.080', 'weapon2': '0.234', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.216', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '66.000'} [2024-08-06 08:35:43,699][52795] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:35:44,535][52794] DAMAGECOUNT value on done: 987210.0 [2024-08-06 08:35:44,536][52794] Sum rewards: 87.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.530', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.026', 'weapon5': '0.044', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.217', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '3.276', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.655', 'FRAGCOUNT': '71.000'} [2024-08-06 08:35:44,751][52795] DAMAGECOUNT value on done: 926621.0 [2024-08-06 08:35:44,752][52795] Sum rewards: 70.722, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.858', 'AMMO5': '0.007', 'ARMOR': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.158', 'weapon4': '0.176', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.050', 'HITCOUNT': '3.040', 'weapon3': '3.108', 'DAMAGECOUNT': '16.044', 'FRAGCOUNT': '58.000'} [2024-08-06 08:35:44,769][52650] Updated weights for policy 0, policy_version 85361 (0.0038) [2024-08-06 08:35:45,344][52666] DAMAGECOUNT value on done: 991403.0 [2024-08-06 08:35:45,345][52666] Sum rewards: 74.362, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.644', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.030', 'AMMO4': '0.103', 'AMMO3': '0.168', 'WEAPON4': '0.200', 'weapon5': '0.236', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.188', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:45,749][52670] DAMAGECOUNT value on done: 982708.0 [2024-08-06 08:35:45,749][52670] Sum rewards: 82.018, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.112', 'AMMO3': '0.191', 'AMMO4': '0.212', 'weapon2': '0.222', 'weapon5': '0.232', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.154', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.166', 'FRAGCOUNT': '68.000'} [2024-08-06 08:35:46,238][52647] DAMAGECOUNT value on done: 1036186.0 [2024-08-06 08:35:46,240][52647] Sum rewards: 68.828, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.774', 'AMMO5': '0.022', 'AMMO2': '0.068', 'AMMO3': '0.225', 'weapon4': '0.230', 'weapon5': '0.324', 'weapon2': '0.340', 'AMMO4': '0.341', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.652', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '58.000'} [2024-08-06 08:35:46,920][52820] DAMAGECOUNT value on done: 923092.0 [2024-08-06 08:35:46,920][52820] Sum rewards: 68.679, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.974', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.132', 'weapon5': '0.156', 'AMMO4': '0.174', 'AMMO3': '0.184', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.592', 'WEAPON3': '1.100', 'weapon3': '2.900', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.338', 'FRAGCOUNT': '56.000'} [2024-08-06 08:35:47,598][52794] DAMAGECOUNT value on done: 997318.0 [2024-08-06 08:35:47,602][52794] Sum rewards: 67.321, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.045', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.126', 'AMMO4': '0.167', 'weapon5': '0.184', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'weapon2': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.194', 'DAMAGECOUNT': '15.789', 'FRAGCOUNT': '57.000'} [2024-08-06 08:35:47,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 699326464. Throughput: 0: 4368.0. Samples: 174832510. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:47,794][52567] Avg episode reward: [(0, '74.538')] [2024-08-06 08:35:47,904][52795] DAMAGECOUNT value on done: 917299.0 [2024-08-06 08:35:47,904][52795] Sum rewards: 85.581, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.880', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.150', 'weapon5': '0.152', 'AMMO3': '0.238', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '70.000'} [2024-08-06 08:35:48,298][52666] DAMAGECOUNT value on done: 992263.0 [2024-08-06 08:35:48,298][52666] Sum rewards: 93.786, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.032', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.098', 'AMMO4': '0.173', 'weapon5': '0.174', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.150', 'weapon3': '2.834', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '21.066', 'FRAGCOUNT': '76.000'} [2024-08-06 08:35:48,594][52670] DAMAGECOUNT value on done: 994399.0 [2024-08-06 08:35:48,596][52670] Sum rewards: 70.651, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.047', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.154', 'AMMO4': '0.179', 'AMMO3': '0.203', 'weapon4': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.250', 'weapon3': '3.044', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '57.000'} [2024-08-06 08:35:48,771][52647] DAMAGECOUNT value on done: 1038813.0 [2024-08-06 08:35:48,772][52647] Sum rewards: 81.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.490', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon5': '0.114', 'weapon4': '0.118', 'weapon2': '0.168', 'AMMO4': '0.175', 'WEAPON5': '0.250', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.334', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '68.000'} [2024-08-06 08:35:48,946][52650] Updated weights for policy 0, policy_version 85371 (0.0012) [2024-08-06 08:35:49,158][52668] DAMAGECOUNT value on done: 1003208.0 [2024-08-06 08:35:49,160][52668] Sum rewards: 84.072, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.115', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.035', 'weapon5': '0.086', 'weapon2': '0.170', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.530', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '72.000'} [2024-08-06 08:35:50,241][52820] DAMAGECOUNT value on done: 930704.0 [2024-08-06 08:35:50,242][52820] Sum rewards: 77.354, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.163', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon5': '0.044', 'AMMO4': '0.075', 'weapon4': '0.086', 'WEAPON5': '0.150', 'WEAPON4': '0.150', 'AMMO3': '0.205', 'weapon2': '0.540', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:50,804][52666] DAMAGECOUNT value on done: 998170.0 [2024-08-06 08:35:50,808][52666] Sum rewards: 81.970, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.393', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.118', 'weapon4': '0.126', 'AMMO4': '0.152', 'WEAPON5': '0.200', 'AMMO3': '0.279', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.700', 'weapon3': '3.172', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '71.000'} [2024-08-06 08:35:50,930][52794] DAMAGECOUNT value on done: 992819.0 [2024-08-06 08:35:50,931][52794] Sum rewards: 77.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.940', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon5': '0.120', 'AMMO3': '0.145', 'AMMO4': '0.231', 'weapon4': '0.314', 'weapon2': '0.326', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:51,091][52670] DAMAGECOUNT value on done: 983473.0 [2024-08-06 08:35:51,101][52670] Sum rewards: 75.163, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.995', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.087', 'weapon5': '0.092', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'weapon4': '0.286', 'weapon2': '0.394', 'WEAPON3': '1.450', 'weapon3': '2.920', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:51,167][52795] DAMAGECOUNT value on done: 918643.0 [2024-08-06 08:35:51,170][52795] Sum rewards: 78.346, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.854', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.136', 'weapon5': '0.196', 'AMMO4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.078', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '66.000'} [2024-08-06 08:35:51,687][52668] DAMAGECOUNT value on done: 1001268.0 [2024-08-06 08:35:51,688][52668] Sum rewards: 74.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.565', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.044', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.146', 'AMMO3': '0.204', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.132', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:51,892][52658] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('HEALTH', -0.015, -5.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:35:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 699416576. Throughput: 0: 4368.9. Samples: 174858810. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:35:52,794][52567] Avg episode reward: [(0, '74.719')] [2024-08-06 08:35:53,612][52666] DAMAGECOUNT value on done: 992001.0 [2024-08-06 08:35:53,612][52666] Sum rewards: 82.740, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.280', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon2': '0.186', 'weapon5': '0.192', 'weapon4': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.251', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '69.000'} [2024-08-06 08:35:53,613][52820] DAMAGECOUNT value on done: 932128.0 [2024-08-06 08:35:53,613][52820] Sum rewards: 75.527, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.648', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon5': '0.182', 'AMMO3': '0.209', 'weapon4': '0.234', 'AMMO4': '0.280', 'weapon2': '0.368', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.964', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '60.000'} [2024-08-06 08:35:53,829][52670] DAMAGECOUNT value on done: 980020.0 [2024-08-06 08:35:53,830][52670] Sum rewards: 97.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.121', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.030', 'weapon5': '0.134', 'AMMO4': '0.140', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '23.400', 'FRAGCOUNT': '79.500'} [2024-08-06 08:35:53,895][52794] DAMAGECOUNT value on done: 1001195.0 [2024-08-06 08:35:53,897][52794] Sum rewards: 75.873, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.976', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.144', 'weapon5': '0.200', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '64.000'} [2024-08-06 08:35:54,026][52650] Updated weights for policy 0, policy_version 85381 (0.0021) [2024-08-06 08:35:54,387][52795] DAMAGECOUNT value on done: 925101.0 [2024-08-06 08:35:54,388][52795] Sum rewards: 84.955, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.060', 'weapon5': '0.126', 'AMMO4': '0.158', 'AMMO3': '0.176', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.288', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '68.000'} [2024-08-06 08:35:54,810][52668] DAMAGECOUNT value on done: 996227.0 [2024-08-06 08:35:54,813][52668] Sum rewards: 69.621, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.190', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.164', 'AMMO4': '0.219', 'weapon2': '0.230', 'weapon5': '0.244', 'weapon4': '0.446', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.584', 'FRAGCOUNT': '57.000'} [2024-08-06 08:35:56,489][52666] DAMAGECOUNT value on done: 985257.0 [2024-08-06 08:35:56,490][52666] Sum rewards: 79.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.265', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.040', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '67.000'} [2024-08-06 08:35:56,643][52670] DAMAGECOUNT value on done: 982617.0 [2024-08-06 08:35:56,644][52670] Sum rewards: 74.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.740', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.100', 'weapon5': '0.110', 'AMMO4': '0.167', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.460', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '60.500'} [2024-08-06 08:35:56,962][52820] DAMAGECOUNT value on done: 918519.0 [2024-08-06 08:35:56,963][52820] Sum rewards: 71.120, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.010', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon5': '0.202', 'weapon2': '0.208', 'weapon4': '0.222', 'AMMO3': '0.239', 'AMMO4': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.116', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '59.000'} [2024-08-06 08:35:57,107][52794] DAMAGECOUNT value on done: 1006838.0 [2024-08-06 08:35:57,108][52794] Sum rewards: 86.637, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.011', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.146', 'AMMO3': '0.196', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.250', 'weapon3': '2.926', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '70.000'} [2024-08-06 08:35:57,608][52795] DAMAGECOUNT value on done: 921356.0 [2024-08-06 08:35:57,608][52795] Sum rewards: 87.263, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.090', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.147', 'FRAGCOUNT': '71.000'} [2024-08-06 08:35:57,798][52567] Fps is (10 sec: 18014.5, 60 sec: 17475.0, 300 sec: 17466.8). Total num frames: 699506688. Throughput: 0: 4362.3. Samples: 174884830. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:35:57,799][52567] Avg episode reward: [(0, '75.571')] [2024-08-06 08:35:57,895][52668] DAMAGECOUNT value on done: 1002082.0 [2024-08-06 08:35:57,897][52668] Sum rewards: 73.712, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.972', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.052', 'weapon5': '0.086', 'AMMO4': '0.163', 'AMMO3': '0.233', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '63.000'} [2024-08-06 08:35:58,829][52650] Updated weights for policy 0, policy_version 85391 (0.0013) [2024-08-06 08:35:58,998][52665] DAMAGECOUNT value on done: 981696.0 [2024-08-06 08:35:59,000][52665] Sum rewards: 68.526, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.060', 'AMMO5': '0.025', 'AMMO2': '0.068', 'weapon4': '0.130', 'weapon5': '0.258', 'weapon2': '0.286', 'AMMO3': '0.313', 'AMMO4': '0.341', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.950', 'weapon3': '2.952', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '62.000'} [2024-08-06 08:35:59,459][52666] DAMAGECOUNT value on done: 986785.0 [2024-08-06 08:35:59,459][52666] Sum rewards: 75.064, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.163', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.054', 'AMMO4': '0.125', 'weapon5': '0.164', 'weapon2': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.314', 'WEAPON3': '1.850', 'weapon3': '3.322', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '66.000'} [2024-08-06 08:35:59,659][52670] DAMAGECOUNT value on done: 980408.0 [2024-08-06 08:35:59,661][52670] Sum rewards: 62.483, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.229', 'AMMO5': '0.021', 'AMMO2': '0.063', 'AMMO3': '0.207', 'weapon4': '0.252', 'weapon5': '0.274', 'AMMO4': '0.313', 'weapon2': '0.334', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'HITCOUNT': '2.780', 'weapon3': '2.892', 'DAMAGECOUNT': '15.375', 'FRAGCOUNT': '51.000'} [2024-08-06 08:36:00,321][52794] DAMAGECOUNT value on done: 996225.0 [2024-08-06 08:36:00,322][52794] Sum rewards: 80.796, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.060', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon5': '0.016', 'AMMO4': '0.024', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:00,658][52795] DAMAGECOUNT value on done: 910371.0 [2024-08-06 08:36:00,659][52795] Sum rewards: 69.824, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.928', 'AMMO5': '0.010', 'AMMO2': '0.048', 'weapon4': '0.062', 'weapon5': '0.160', 'AMMO3': '0.188', 'AMMO4': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.954', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '58.000'} [2024-08-06 08:36:00,909][52668] DAMAGECOUNT value on done: 988376.0 [2024-08-06 08:36:00,911][52668] Sum rewards: 72.463, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.951', 'WEAPON1': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.048', 'weapon5': '0.178', 'weapon2': '0.214', 'AMMO4': '0.224', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.104', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.800', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:02,084][52665] DAMAGECOUNT value on done: 993012.0 [2024-08-06 08:36:02,085][52665] Sum rewards: 76.347, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.530', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.204', 'weapon4': '0.260', 'WEAPON4': '0.300', 'weapon2': '0.902', 'WEAPON3': '1.300', 'weapon3': '2.570', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.225', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:02,295][52666] DAMAGECOUNT value on done: 989194.0 [2024-08-06 08:36:02,296][52666] Sum rewards: 78.134, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.284', 'AMMO5': '0.017', 'AMMO2': '0.044', 'weapon4': '0.078', 'weapon5': '0.160', 'AMMO4': '0.222', 'AMMO3': '0.223', 'weapon2': '0.436', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:02,455][52670] DAMAGECOUNT value on done: 980476.0 [2024-08-06 08:36:02,457][52670] Sum rewards: 67.500, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.735', 'AMMO5': '0.015', 'AMMO2': '0.034', 'AMMO3': '0.155', 'AMMO4': '0.172', 'weapon5': '0.182', 'weapon4': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.640', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '53.000'} [2024-08-06 08:36:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 699596800. Throughput: 0: 4359.8. Samples: 174898000. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:02,795][52567] Avg episode reward: [(0, '75.364')] [2024-08-06 08:36:03,272][52650] Updated weights for policy 0, policy_version 85401 (0.0022) [2024-08-06 08:36:03,823][52795] DAMAGECOUNT value on done: 917825.0 [2024-08-06 08:36:03,823][52795] Sum rewards: 83.998, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.856', 'AMMO5': '0.013', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.180', 'AMMO3': '0.208', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.814', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:04,090][52668] DAMAGECOUNT value on done: 1000853.0 [2024-08-06 08:36:04,091][52668] Sum rewards: 69.878, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.598', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.212', 'weapon2': '0.218', 'AMMO4': '0.234', 'weapon5': '0.292', 'weapon4': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.838', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '56.000'} [2024-08-06 08:36:05,203][52666] DAMAGECOUNT value on done: 981421.0 [2024-08-06 08:36:05,205][52666] Sum rewards: 77.682, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.650', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.068', 'weapon5': '0.094', 'AMMO4': '0.116', 'WEAPON5': '0.150', 'weapon2': '0.230', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON3': '1.650', 'weapon3': '3.390', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:05,284][52665] DAMAGECOUNT value on done: 987391.0 [2024-08-06 08:36:05,288][52665] Sum rewards: 76.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.188', 'weapon5': '0.210', 'AMMO3': '0.233', 'AMMO4': '0.282', 'weapon2': '0.350', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.940', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:05,374][52670] DAMAGECOUNT value on done: 995805.0 [2024-08-06 08:36:05,375][52670] Sum rewards: 74.785, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.140', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.102', 'AMMO3': '0.170', 'weapon4': '0.180', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.244', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:06,863][52668] DAMAGECOUNT value on done: 999022.0 [2024-08-06 08:36:06,866][52668] Sum rewards: 70.429, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.088', 'weapon4': '0.128', 'AMMO3': '0.220', 'AMMO4': '0.223', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.316', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:07,084][52795] DAMAGECOUNT value on done: 924311.0 [2024-08-06 08:36:07,085][52795] Sum rewards: 85.540, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.140', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.092', 'weapon4': '0.094', 'AMMO4': '0.100', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'weapon2': '0.722', 'WEAPON3': '1.000', 'weapon3': '2.910', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:07,668][52650] Updated weights for policy 0, policy_version 85411 (0.0014) [2024-08-06 08:36:07,794][52567] Fps is (10 sec: 18030.2, 60 sec: 17612.8, 300 sec: 17494.8). Total num frames: 699686912. Throughput: 0: 4352.4. Samples: 174924270. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:07,794][52567] Avg episode reward: [(0, '75.471')] [2024-08-06 08:36:07,953][52666] DAMAGECOUNT value on done: 995363.0 [2024-08-06 08:36:07,953][52666] Sum rewards: 78.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.126', 'AMMO4': '0.169', 'weapon4': '0.170', 'AMMO3': '0.171', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.356', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '65.000'} [2024-08-06 08:36:08,053][52670] DAMAGECOUNT value on done: 975359.0 [2024-08-06 08:36:08,053][52670] Sum rewards: 67.332, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.055', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.072', 'weapon4': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'AMMO3': '0.227', 'weapon2': '0.308', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.334', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:08,099][52671] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:36:08,457][52665] DAMAGECOUNT value on done: 989905.0 [2024-08-06 08:36:08,458][52665] Sum rewards: 82.376, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.210', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.136', 'weapon4': '0.160', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.600', 'weapon3': '3.020', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '69.000'} [2024-08-06 08:36:09,515][52667] DAMAGECOUNT value on done: 992784.0 [2024-08-06 08:36:09,524][52667] Sum rewards: 73.829, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.951', 'AMMO5': '0.013', 'AMMO2': '0.051', 'AMMO3': '0.212', 'weapon5': '0.234', 'AMMO4': '0.255', 'weapon2': '0.280', 'weapon4': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.822', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:10,106][52668] DAMAGECOUNT value on done: 990360.0 [2024-08-06 08:36:10,106][52668] Sum rewards: 79.525, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.024', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.075', 'AMMO3': '0.215', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '67.000'} [2024-08-06 08:36:10,137][52795] DAMAGECOUNT value on done: 908134.0 [2024-08-06 08:36:10,137][52795] Sum rewards: 65.900, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.058', 'weapon4': '0.154', 'AMMO4': '0.169', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.066', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '56.000'} [2024-08-06 08:36:10,688][52666] DAMAGECOUNT value on done: 984710.0 [2024-08-06 08:36:10,690][52666] Sum rewards: 81.443, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.965', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.041', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.187', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '3.396', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:10,713][52665] DAMAGECOUNT value on done: 971281.0 [2024-08-06 08:36:10,714][52665] Sum rewards: 78.607, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.816', 'AMMO5': '0.008', 'AMMO2': '0.048', 'weapon4': '0.092', 'weapon5': '0.138', 'AMMO3': '0.227', 'AMMO4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '65.000'} [2024-08-06 08:36:10,834][52670] DAMAGECOUNT value on done: 990480.0 [2024-08-06 08:36:10,834][52670] Sum rewards: 86.614, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.829', 'AMMO5': '0.005', 'AMMO2': '0.037', 'weapon5': '0.060', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'AMMO4': '0.182', 'weapon4': '0.190', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.172', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '69.000'} [2024-08-06 08:36:12,406][52667] DAMAGECOUNT value on done: 1010792.0 [2024-08-06 08:36:12,407][52667] Sum rewards: 83.738, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.136', 'weapon4': '0.148', 'AMMO4': '0.161', 'AMMO3': '0.181', 'weapon2': '0.204', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.109', 'FRAGCOUNT': '67.000'} [2024-08-06 08:36:12,505][52650] Updated weights for policy 0, policy_version 85421 (0.0032) [2024-08-06 08:36:12,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 699768832. Throughput: 0: 4352.4. Samples: 174950550. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:12,795][52567] Avg episode reward: [(0, '75.175')] [2024-08-06 08:36:12,838][52668] DAMAGECOUNT value on done: 993234.0 [2024-08-06 08:36:12,840][52668] Sum rewards: 85.825, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.236', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.064', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.238', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.388', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '74.000'} [2024-08-06 08:36:13,199][52665] DAMAGECOUNT value on done: 972742.0 [2024-08-06 08:36:13,199][52665] Sum rewards: 70.331, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.840', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.070', 'weapon5': '0.196', 'AMMO4': '0.224', 'weapon2': '0.300', 'AMMO3': '0.323', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.900', 'weapon3': '3.116', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:13,293][52795] DAMAGECOUNT value on done: 920721.0 [2024-08-06 08:36:13,294][52795] Sum rewards: 64.354, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.915', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.078', 'AMMO3': '0.136', 'AMMO4': '0.142', 'weapon5': '0.182', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'HITCOUNT': '2.760', 'weapon3': '3.278', 'DAMAGECOUNT': '15.639', 'FRAGCOUNT': '51.000'} [2024-08-06 08:36:14,104][52666] DAMAGECOUNT value on done: 990123.0 [2024-08-06 08:36:14,106][52666] Sum rewards: 78.760, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.120', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.121', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'WEAPON4': '0.350', 'weapon2': '0.398', 'weapon4': '0.526', 'WEAPON3': '1.250', 'weapon3': '2.766', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:14,246][52670] DAMAGECOUNT value on done: 995114.0 [2024-08-06 08:36:14,246][52670] Sum rewards: 78.210, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.562', 'AMMO4': '-0.006', 'AMMO2': '-0.001', 'weapon2': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.750', 'weapon3': '3.580', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:14,943][52667] DAMAGECOUNT value on done: 1003924.0 [2024-08-06 08:36:14,943][52667] Sum rewards: 74.601, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.044', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.176', 'weapon4': '0.198', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:15,692][52668] DAMAGECOUNT value on done: 1000456.0 [2024-08-06 08:36:15,692][52668] Sum rewards: 73.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.585', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon4': '0.212', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.122', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:15,766][52665] DAMAGECOUNT value on done: 984823.0 [2024-08-06 08:36:15,766][52665] Sum rewards: 78.205, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.094', 'weapon5': '0.094', 'AMMO4': '0.186', 'AMMO3': '0.194', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.574', 'FRAGCOUNT': '65.000'} [2024-08-06 08:36:16,390][52666] DAMAGECOUNT value on done: 974754.0 [2024-08-06 08:36:16,393][52666] Sum rewards: 81.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.900', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.144', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.210', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.118', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '66.500'} [2024-08-06 08:36:16,444][52795] DAMAGECOUNT value on done: 918325.0 [2024-08-06 08:36:16,444][52795] Sum rewards: 50.199, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.024', 'AMMO2': '0.062', 'weapon4': '0.094', 'AMMO3': '0.165', 'weapon5': '0.226', 'AMMO4': '0.308', 'WEAPON4': '0.550', 'weapon2': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'HITCOUNT': '2.600', 'weapon3': '2.852', 'DAMAGECOUNT': '13.707', 'FRAGCOUNT': '41.500'} [2024-08-06 08:36:16,507][52670] DAMAGECOUNT value on done: 987188.0 [2024-08-06 08:36:16,507][52670] Sum rewards: 78.074, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.707', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.164', 'weapon5': '0.220', 'AMMO4': '0.221', 'AMMO3': '0.274', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.032', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '66.500'} [2024-08-06 08:36:16,895][52650] Updated weights for policy 0, policy_version 85431 (0.0011) [2024-08-06 08:36:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 699858944. Throughput: 0: 4358.7. Samples: 174963780. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:17,795][52567] Avg episode reward: [(0, '75.004')] [2024-08-06 08:36:18,041][52667] DAMAGECOUNT value on done: 1008557.0 [2024-08-06 08:36:18,044][52667] Sum rewards: 63.246, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.270', 'AMMO5': '0.022', 'AMMO2': '0.059', 'weapon4': '0.102', 'weapon5': '0.198', 'AMMO3': '0.232', 'AMMO4': '0.293', 'weapon2': '0.360', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'HITCOUNT': '2.720', 'weapon3': '3.072', 'DAMAGECOUNT': '15.258', 'FRAGCOUNT': '55.000'} [2024-08-06 08:36:18,442][52668] DAMAGECOUNT value on done: 994918.0 [2024-08-06 08:36:18,447][52668] Sum rewards: 69.760, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.683', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.056', 'weapon5': '0.144', 'weapon2': '0.178', 'AMMO4': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.350', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:18,736][52811] DAMAGECOUNT value on done: 941480.0 [2024-08-06 08:36:18,739][52811] Sum rewards: 84.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.152', 'AMMO5': '0.009', 'AMMO2': '0.018', 'AMMO4': '0.087', 'weapon5': '0.120', 'weapon4': '0.142', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.815', 'FRAGCOUNT': '71.000'} [2024-08-06 08:36:18,938][52665] DAMAGECOUNT value on done: 983779.0 [2024-08-06 08:36:18,940][52665] Sum rewards: 67.195, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.425', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.046', 'WEAPON4': '0.050', 'AMMO4': '0.093', 'AMMO3': '0.148', 'WEAPON5': '0.150', 'weapon2': '0.808', 'WEAPON3': '1.050', 'weapon3': '3.012', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '15.852', 'FRAGCOUNT': '53.000'} [2024-08-06 08:36:19,287][52666] DAMAGECOUNT value on done: 999769.0 [2024-08-06 08:36:19,289][52666] Sum rewards: 86.220, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.144', 'AMMO4': '0.179', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.450', 'weapon3': '3.040', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.376', 'FRAGCOUNT': '73.000'} [2024-08-06 08:36:19,455][52670] DAMAGECOUNT value on done: 973314.0 [2024-08-06 08:36:19,457][52670] Sum rewards: 72.501, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.613', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.172', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.330', 'weapon4': '0.432', 'WEAPON3': '1.300', 'weapon3': '2.686', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:19,860][52795] DAMAGECOUNT value on done: 906459.0 [2024-08-06 08:36:19,861][52795] Sum rewards: 71.220, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.114', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.093', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.181', 'weapon2': '0.414', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.344', 'DAMAGECOUNT': '16.875', 'FRAGCOUNT': '58.000'} [2024-08-06 08:36:21,045][52667] DAMAGECOUNT value on done: 1012428.0 [2024-08-06 08:36:21,046][52667] Sum rewards: 85.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO2': '0.004', 'AMMO4': '0.022', 'weapon2': '0.164', 'AMMO3': '0.219', 'WEAPON3': '1.450', 'weapon3': '3.684', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.471', 'FRAGCOUNT': '69.000'} [2024-08-06 08:36:21,444][52668] DAMAGECOUNT value on done: 992902.0 [2024-08-06 08:36:21,446][52668] Sum rewards: 74.337, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.322', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.156', 'AMMO3': '0.232', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:21,687][52664] DAMAGECOUNT value on done: 1025680.0 [2024-08-06 08:36:21,689][52664] Sum rewards: 85.230, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.945', 'AMMO5': '0.013', 'AMMO2': '0.026', 'weapon4': '0.080', 'weapon5': '0.118', 'AMMO4': '0.132', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '69.000'} [2024-08-06 08:36:21,813][52811] DAMAGECOUNT value on done: 926454.0 [2024-08-06 08:36:21,813][52811] Sum rewards: 76.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.028', 'AMMO2': '0.069', 'AMMO3': '0.180', 'weapon4': '0.198', 'weapon2': '0.312', 'AMMO4': '0.347', 'weapon5': '0.436', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '18.552', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:21,912][52650] Updated weights for policy 0, policy_version 85441 (0.0017) [2024-08-06 08:36:22,009][52665] DAMAGECOUNT value on done: 990164.0 [2024-08-06 08:36:22,010][52665] Sum rewards: 74.433, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.792', 'AMMO5': '0.012', 'AMMO2': '0.037', 'AMMO4': '0.183', 'weapon2': '0.192', 'weapon4': '0.218', 'weapon5': '0.234', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.058', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:22,193][52666] DAMAGECOUNT value on done: 994803.0 [2024-08-06 08:36:22,195][52666] Sum rewards: 88.884, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.319', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.029', 'weapon5': '0.086', 'AMMO4': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.216', 'WEAPON3': '1.250', 'weapon3': '3.430', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.396', 'FRAGCOUNT': '73.000'} [2024-08-06 08:36:22,369][52670] DAMAGECOUNT value on done: 987977.0 [2024-08-06 08:36:22,371][52670] Sum rewards: 79.183, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.021', 'AMMO2': '0.061', 'AMMO3': '0.196', 'weapon4': '0.256', 'weapon5': '0.304', 'AMMO4': '0.305', 'weapon2': '0.400', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.774', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:22,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17494.8). Total num frames: 699949056. Throughput: 0: 4367.8. Samples: 174989920. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:22,794][52567] Avg episode reward: [(0, '75.767')] [2024-08-06 08:36:22,980][52795] DAMAGECOUNT value on done: 915946.0 [2024-08-06 08:36:22,980][52795] Sum rewards: 68.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.791', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO4': '0.132', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.100', 'weapon3': '3.054', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '55.000'} [2024-08-06 08:36:23,965][52667] DAMAGECOUNT value on done: 1006510.0 [2024-08-06 08:36:23,966][52667] Sum rewards: 68.962, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.500', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.196', 'weapon2': '0.288', 'WEAPON3': '1.300', 'HITCOUNT': '3.340', 'weapon3': '3.552', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '56.000'} [2024-08-06 08:36:24,442][52668] DAMAGECOUNT value on done: 984802.0 [2024-08-06 08:36:24,442][52668] Sum rewards: 72.065, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.730', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.133', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.598', 'WEAPON3': '1.300', 'weapon3': '3.006', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:24,636][52664] DAMAGECOUNT value on done: 1032433.0 [2024-08-06 08:36:24,636][52664] Sum rewards: 70.823, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.075', 'AMMO5': '0.016', 'AMMO2': '0.038', 'AMMO4': '0.193', 'weapon4': '0.202', 'AMMO3': '0.215', 'weapon5': '0.220', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.546', 'WEAPON3': '1.350', 'weapon3': '2.714', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '58.000'} [2024-08-06 08:36:24,855][52666] DAMAGECOUNT value on done: 992743.0 [2024-08-06 08:36:24,857][52666] Sum rewards: 72.638, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.282', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.169', 'weapon5': '0.188', 'weapon4': '0.204', 'AMMO4': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.504', 'WEAPON3': '1.000', 'weapon3': '2.808', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:24,969][52665] DAMAGECOUNT value on done: 982446.0 [2024-08-06 08:36:24,972][52665] Sum rewards: 78.053, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.230', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.078', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.158', 'AMMO3': '0.253', 'WEAPON3': '1.650', 'weapon3': '3.500', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '67.000'} [2024-08-06 08:36:24,992][52811] DAMAGECOUNT value on done: 920544.0 [2024-08-06 08:36:24,994][52811] Sum rewards: 73.810, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.330', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.284', 'weapon2': '0.478', 'WEAPON3': '1.700', 'weapon3': '3.254', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:25,035][52670] DAMAGECOUNT value on done: 996250.0 [2024-08-06 08:36:25,035][52670] Sum rewards: 90.101, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.016', 'weapon5': '0.036', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.229', 'WEAPON3': '1.400', 'weapon3': '3.564', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.471', 'FRAGCOUNT': '74.000'} [2024-08-06 08:36:25,391][52803] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:36:26,114][52795] DAMAGECOUNT value on done: 925581.0 [2024-08-06 08:36:26,115][52795] Sum rewards: 69.486, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.029', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.094', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:26,785][52667] DAMAGECOUNT value on done: 999884.0 [2024-08-06 08:36:26,787][52667] Sum rewards: 66.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.096', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.110', 'weapon5': '0.204', 'AMMO3': '0.219', 'AMMO4': '0.224', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'HITCOUNT': '2.860', 'weapon3': '3.176', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '56.000'} [2024-08-06 08:36:26,833][52649] DAMAGECOUNT value on done: 965684.0 [2024-08-06 08:36:26,836][52649] Sum rewards: 91.005, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.815', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.248', 'weapon4': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.478', 'FRAGCOUNT': '74.000'} [2024-08-06 08:36:26,914][52650] Updated weights for policy 0, policy_version 85451 (0.0012) [2024-08-06 08:36:27,403][52668] DAMAGECOUNT value on done: 985926.0 [2024-08-06 08:36:27,403][52668] Sum rewards: 75.786, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.520', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.226', 'WEAPON3': '1.150', 'HITCOUNT': '3.320', 'weapon3': '3.482', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:27,529][52665] DAMAGECOUNT value on done: 997089.0 [2024-08-06 08:36:27,529][52665] Sum rewards: 77.298, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.371', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.104', 'weapon5': '0.118', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.312', 'WEAPON3': '0.950', 'HITCOUNT': '3.340', 'weapon3': '3.374', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:27,660][52664] DAMAGECOUNT value on done: 1038305.0 [2024-08-06 08:36:27,661][52664] Sum rewards: 84.017, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.054', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.080', 'weapon4': '0.116', 'AMMO4': '0.175', 'AMMO3': '0.219', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:27,698][52666] DAMAGECOUNT value on done: 984015.0 [2024-08-06 08:36:27,700][52666] Sum rewards: 73.843, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.559', 'AMMO5': '0.012', 'AMMO2': '0.017', 'weapon4': '0.046', 'AMMO4': '0.085', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.228', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.300', 'HITCOUNT': '3.190', 'weapon3': '3.210', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:27,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 700022784. Throughput: 0: 4372.0. Samples: 175016400. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:27,795][52567] Avg episode reward: [(0, '76.288')] [2024-08-06 08:36:27,841][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085453_700030976.pth... [2024-08-06 08:36:27,901][52670] DAMAGECOUNT value on done: 989021.0 [2024-08-06 08:36:27,902][52670] Sum rewards: 70.392, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.799', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.080', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.408', 'WEAPON3': '1.100', 'HITCOUNT': '3.230', 'weapon3': '3.320', 'DAMAGECOUNT': '16.896', 'FRAGCOUNT': '56.000'} [2024-08-06 08:36:28,002][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000084942_695844864.pth [2024-08-06 08:36:28,148][52811] DAMAGECOUNT value on done: 926590.0 [2024-08-06 08:36:28,148][52811] Sum rewards: 80.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.100', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.187', 'AMMO4': '0.190', 'weapon2': '0.202', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.698', 'WEAPON3': '1.200', 'weapon3': '2.730', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:29,427][52662] DAMAGECOUNT value on done: 995063.0 [2024-08-06 08:36:29,427][52662] Sum rewards: 67.841, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.056', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.116', 'AMMO3': '0.190', 'weapon5': '0.202', 'AMMO4': '0.271', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '2.938', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:29,601][52649] DAMAGECOUNT value on done: 959633.0 [2024-08-06 08:36:29,601][52649] Sum rewards: 79.129, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.120', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO4': '0.125', 'weapon5': '0.126', 'weapon2': '0.174', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'HITCOUNT': '3.410', 'weapon3': '3.450', 'DAMAGECOUNT': '19.104', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:29,620][52667] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:36:29,673][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:36:30,127][52667] DAMAGECOUNT value on done: 998373.0 [2024-08-06 08:36:30,127][52667] Sum rewards: 79.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.460', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.034', 'AMMO4': '0.086', 'weapon5': '0.108', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'WEAPON5': '0.300', 'weapon2': '0.516', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:30,206][52665] DAMAGECOUNT value on done: 990335.0 [2024-08-06 08:36:30,206][52665] Sum rewards: 84.351, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.465', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.424', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:30,230][52668] DAMAGECOUNT value on done: 976929.0 [2024-08-06 08:36:30,230][52668] Sum rewards: 79.497, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.870', 'AMMO5': '0.012', 'AMMO2': '0.057', 'weapon4': '0.068', 'weapon5': '0.144', 'AMMO3': '0.276', 'AMMO4': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.550', 'weapon3': '2.940', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:30,549][52664] DAMAGECOUNT value on done: 1024624.0 [2024-08-06 08:36:30,550][52664] Sum rewards: 74.359, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.068', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.066', 'AMMO4': '0.167', 'weapon5': '0.182', 'AMMO3': '0.195', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.248', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:30,750][52666] DAMAGECOUNT value on done: 981313.0 [2024-08-06 08:36:30,751][52666] Sum rewards: 76.044, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.927', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.004', 'weapon4': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO3': '0.121', 'WEAPON3': '0.850', 'weapon2': '1.032', 'weapon3': '2.794', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:30,918][52670] DAMAGECOUNT value on done: 988659.0 [2024-08-06 08:36:30,920][52670] Sum rewards: 65.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.740', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.062', 'weapon5': '0.156', 'AMMO4': '0.224', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '3.110', 'weapon3': '3.208', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:31,230][52811] DAMAGECOUNT value on done: 930048.0 [2024-08-06 08:36:31,231][52811] Sum rewards: 78.529, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.702', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.128', 'AMMO4': '0.143', 'weapon4': '0.174', 'weapon2': '0.184', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.174', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '65.000'} [2024-08-06 08:36:31,396][52650] Updated weights for policy 0, policy_version 85461 (0.0029) [2024-08-06 08:36:32,591][52662] DAMAGECOUNT value on done: 1003364.0 [2024-08-06 08:36:32,594][52662] Sum rewards: 58.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.071', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.114', 'weapon4': '0.116', 'AMMO4': '0.136', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.225', 'weapon2': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '2.840', 'weapon3': '3.246', 'DAMAGECOUNT': '14.136', 'FRAGCOUNT': '50.000'} [2024-08-06 08:36:32,658][52649] DAMAGECOUNT value on done: 976852.0 [2024-08-06 08:36:32,659][52649] Sum rewards: 82.213, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.402', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.050', 'AMMO4': '0.126', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.250', 'AMMO3': '0.346', 'WEAPON3': '2.100', 'weapon3': '3.290', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.378', 'FRAGCOUNT': '72.000'} [2024-08-06 08:36:32,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17476.4, 300 sec: 17411.5). Total num frames: 700112896. Throughput: 0: 4367.1. Samples: 175029030. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:32,794][52567] Avg episode reward: [(0, '76.284')] [2024-08-06 08:36:33,248][52667] DAMAGECOUNT value on done: 1003371.0 [2024-08-06 08:36:33,249][52667] Sum rewards: 74.741, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.186', 'AMMO3': '0.201', 'AMMO4': '0.204', 'weapon2': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.246', 'DAMAGECOUNT': '16.413', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:33,292][52668] DAMAGECOUNT value on done: 994130.0 [2024-08-06 08:36:33,294][52668] Sum rewards: 84.660, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.808', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.018', 'AMMO4': '0.046', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO3': '0.149', 'WEAPON5': '0.250', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '3.228', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:33,373][52665] DAMAGECOUNT value on done: 987492.0 [2024-08-06 08:36:33,373][52665] Sum rewards: 76.219, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.149', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.108', 'AMMO4': '0.220', 'AMMO3': '0.230', 'weapon5': '0.254', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.848', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '20.094', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:33,524][52664] DAMAGECOUNT value on done: 1041391.0 [2024-08-06 08:36:33,524][52664] Sum rewards: 65.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.320', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.118', 'AMMO4': '0.131', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.376', 'WEAPON3': '1.100', 'HITCOUNT': '3.240', 'weapon3': '3.330', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '55.000'} [2024-08-06 08:36:33,567][52659] DAMAGECOUNT value on done: 997206.0 [2024-08-06 08:36:33,567][52659] Sum rewards: 72.959, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.285', 'AMMO5': '0.016', 'AMMO2': '0.045', 'AMMO3': '0.189', 'weapon4': '0.196', 'weapon2': '0.200', 'weapon5': '0.216', 'AMMO4': '0.224', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.156', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.682', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:33,720][52666] DAMAGECOUNT value on done: 1001788.0 [2024-08-06 08:36:33,722][52666] Sum rewards: 65.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.370', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.275', 'weapon2': '0.370', 'WEAPON3': '1.750', 'weapon3': '3.348', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:34,391][52811] DAMAGECOUNT value on done: 946308.0 [2024-08-06 08:36:34,392][52811] Sum rewards: 69.559, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.312', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.080', 'AMMO4': '0.167', 'weapon5': '0.172', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.970', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:35,788][52662] DAMAGECOUNT value on done: 1004180.0 [2024-08-06 08:36:35,788][52662] Sum rewards: 67.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.050', 'AMMO5': '0.014', 'AMMO2': '0.045', 'AMMO6': '0.120', 'AMMO7': '0.120', 'weapon5': '0.196', 'WEAPON7': '0.200', 'AMMO3': '0.224', 'AMMO4': '0.228', 'weapon7': '0.260', 'weapon2': '0.264', 'weapon4': '0.292', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.702', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '16.932', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:35,889][52650] Updated weights for policy 0, policy_version 85471 (0.0014) [2024-08-06 08:36:35,908][52649] DAMAGECOUNT value on done: 978069.0 [2024-08-06 08:36:35,908][52649] Sum rewards: 85.549, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.178', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.211', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '2.872', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '69.500'} [2024-08-06 08:36:35,981][52668] DAMAGECOUNT value on done: 994761.0 [2024-08-06 08:36:35,981][52668] Sum rewards: 73.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.595', 'AMMO5': '0.003', 'AMMO2': '0.009', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'weapon5': '0.078', 'AMMO3': '0.224', 'weapon2': '0.544', 'WEAPON3': '1.400', 'weapon3': '3.196', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '60.500'} [2024-08-06 08:36:36,104][52664] DAMAGECOUNT value on done: 1037386.0 [2024-08-06 08:36:36,104][52664] Sum rewards: 66.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.678', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.214', 'weapon2': '0.496', 'WEAPON3': '1.300', 'weapon3': '3.292', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '54.000'} [2024-08-06 08:36:36,163][52667] DAMAGECOUNT value on done: 1007087.0 [2024-08-06 08:36:36,163][52667] Sum rewards: 79.288, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.790', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.038', 'AMMO4': '0.142', 'weapon5': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon2': '0.246', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.304', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:36,342][52666] DAMAGECOUNT value on done: 975734.0 [2024-08-06 08:36:36,342][52666] Sum rewards: 83.760, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.325', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.026', 'weapon5': '0.028', 'WEAPON4': '0.050', 'AMMO4': '0.129', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.346', 'WEAPON3': '1.050', 'weapon3': '3.462', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.734', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:36,496][52659] DAMAGECOUNT value on done: 996536.0 [2024-08-06 08:36:36,497][52659] Sum rewards: 72.901, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.990', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon5': '0.170', 'AMMO3': '0.225', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.408', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:36,532][52665] DAMAGECOUNT value on done: 986974.0 [2024-08-06 08:36:36,533][52665] Sum rewards: 72.756, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.755', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.056', 'weapon5': '0.088', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.284', 'WEAPON3': '1.250', 'HITCOUNT': '3.290', 'weapon3': '3.378', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:37,582][52811] DAMAGECOUNT value on done: 934551.0 [2024-08-06 08:36:37,586][52811] Sum rewards: 62.035, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.086', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.168', 'AMMO4': '0.181', 'weapon5': '0.192', 'AMMO3': '0.266', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '2.980', 'weapon3': '2.982', 'DAMAGECOUNT': '16.077', 'FRAGCOUNT': '55.000'} [2024-08-06 08:36:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 700203008. Throughput: 0: 4358.7. Samples: 175054950. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:37,794][52567] Avg episode reward: [(0, '75.349')] [2024-08-06 08:36:38,674][52668] DAMAGECOUNT value on done: 994345.0 [2024-08-06 08:36:38,675][52668] Sum rewards: 75.925, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.190', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.068', 'weapon5': '0.176', 'AMMO4': '0.182', 'AMMO3': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.150', 'weapon3': '2.958', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:38,813][52662] DAMAGECOUNT value on done: 995647.0 [2024-08-06 08:36:38,814][52662] Sum rewards: 80.656, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.070', 'weapon5': '0.164', 'AMMO4': '0.177', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.350', 'weapon3': '3.200', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:38,956][52649] DAMAGECOUNT value on done: 968577.0 [2024-08-06 08:36:38,956][52649] Sum rewards: 73.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.080', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.138', 'AMMO3': '0.200', 'weapon5': '0.202', 'AMMO4': '0.206', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:38,998][52664] DAMAGECOUNT value on done: 1027130.0 [2024-08-06 08:36:38,998][52664] Sum rewards: 70.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.243', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.172', 'AMMO3': '0.205', 'weapon2': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.362', 'WEAPON3': '1.250', 'weapon3': '2.982', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '58.000'} [2024-08-06 08:36:39,025][52667] DAMAGECOUNT value on done: 994658.0 [2024-08-06 08:36:39,027][52667] Sum rewards: 70.991, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.264', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.070', 'weapon5': '0.194', 'AMMO3': '0.203', 'AMMO4': '0.221', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '59.500'} [2024-08-06 08:36:39,348][52659] DAMAGECOUNT value on done: 1008045.0 [2024-08-06 08:36:39,349][52659] Sum rewards: 64.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.718', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.150', 'weapon2': '0.212', 'AMMO3': '0.236', 'WEAPON3': '1.400', 'HITCOUNT': '3.030', 'weapon3': '3.314', 'DAMAGECOUNT': '16.296', 'FRAGCOUNT': '55.000'} [2024-08-06 08:36:39,384][52666] DAMAGECOUNT value on done: 988518.0 [2024-08-06 08:36:39,385][52666] Sum rewards: 65.492, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.560', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.104', 'weapon2': '0.182', 'AMMO4': '0.249', 'AMMO3': '0.265', 'weapon5': '0.302', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.050', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '55.000'} [2024-08-06 08:36:39,510][52665] DAMAGECOUNT value on done: 984190.0 [2024-08-06 08:36:39,511][52665] Sum rewards: 86.471, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.314', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.028', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'weapon5': '0.234', 'weapon2': '0.238', 'AMMO3': '0.257', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.200', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.826', 'FRAGCOUNT': '73.000'} [2024-08-06 08:36:40,701][52811] DAMAGECOUNT value on done: 924481.0 [2024-08-06 08:36:40,701][52811] Sum rewards: 87.522, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.753', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.184', 'AMMO3': '0.204', 'weapon2': '0.334', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '71.000'} [2024-08-06 08:36:40,885][52650] Updated weights for policy 0, policy_version 85481 (0.0012) [2024-08-06 08:36:41,619][52662] DAMAGECOUNT value on done: 1008958.0 [2024-08-06 08:36:41,619][52662] Sum rewards: 79.519, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.740', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.215', 'weapon2': '0.482', 'WEAPON3': '1.400', 'weapon3': '3.224', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '67.000'} [2024-08-06 08:36:41,702][52649] DAMAGECOUNT value on done: 977401.0 [2024-08-06 08:36:41,703][52649] Sum rewards: 85.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.255', 'AMMO5': '0.009', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.380', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '72.000'} [2024-08-06 08:36:41,780][52668] DAMAGECOUNT value on done: 994422.0 [2024-08-06 08:36:41,781][52668] Sum rewards: 73.068, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.640', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon5': '0.162', 'weapon2': '0.194', 'AMMO3': '0.202', 'weapon4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:42,071][52665] DAMAGECOUNT value on done: 989878.0 [2024-08-06 08:36:42,071][52665] Sum rewards: 70.363, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.594', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.170', 'AMMO4': '0.195', 'weapon4': '0.196', 'AMMO3': '0.240', 'WEAPON5': '0.300', 'weapon2': '0.320', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.990', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:42,139][52664] DAMAGECOUNT value on done: 1026448.0 [2024-08-06 08:36:42,139][52664] Sum rewards: 59.677, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.150', 'AMMO5': '0.020', 'AMMO2': '0.066', 'weapon5': '0.206', 'weapon4': '0.228', 'AMMO3': '0.264', 'AMMO4': '0.330', 'weapon2': '0.344', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.550', 'HITCOUNT': '2.840', 'weapon3': '2.902', 'DAMAGECOUNT': '15.576', 'FRAGCOUNT': '53.000'} [2024-08-06 08:36:42,173][52659] DAMAGECOUNT value on done: 1000607.0 [2024-08-06 08:36:42,173][52659] Sum rewards: 77.514, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.135', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.089', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.740', 'WEAPON3': '1.300', 'weapon3': '2.930', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.504', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:42,184][52667] DAMAGECOUNT value on done: 995378.0 [2024-08-06 08:36:42,184][52667] Sum rewards: 58.739, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.599', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon2': '0.182', 'weapon4': '0.192', 'AMMO3': '0.196', 'weapon5': '0.254', 'AMMO4': '0.274', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'HITCOUNT': '2.830', 'weapon3': '3.140', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '47.500'} [2024-08-06 08:36:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 700284928. Throughput: 0: 4362.0. Samples: 175081100. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:42,794][52567] Avg episode reward: [(0, '75.161')] [2024-08-06 08:36:42,853][52666] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:36:43,776][52811] DAMAGECOUNT value on done: 931199.0 [2024-08-06 08:36:43,784][52811] Sum rewards: 71.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.340', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.098', 'weapon5': '0.166', 'AMMO3': '0.253', 'AMMO4': '0.269', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.550', 'weapon3': '3.002', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.853', 'FRAGCOUNT': '60.500'} [2024-08-06 08:36:43,899][52614] Signal inference workers to stop experience collection... (15700 times) [2024-08-06 08:36:43,904][52614] Signal inference workers to resume experience collection... (15700 times) [2024-08-06 08:36:43,982][52650] InferenceWorker_p0-w0: stopping experience collection (15700 times) [2024-08-06 08:36:43,982][52650] InferenceWorker_p0-w0: resuming experience collection (15700 times) [2024-08-06 08:36:44,422][52649] DAMAGECOUNT value on done: 975267.0 [2024-08-06 08:36:44,422][52649] Sum rewards: 77.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.734', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.050', 'AMMO4': '0.087', 'weapon5': '0.088', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '2.932', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:44,506][52662] DAMAGECOUNT value on done: 989191.0 [2024-08-06 08:36:44,507][52662] Sum rewards: 85.663, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.497', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.056', 'weapon4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.238', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '70.000'} [2024-08-06 08:36:44,516][52668] DAMAGECOUNT value on done: 999443.0 [2024-08-06 08:36:44,519][52668] Sum rewards: 77.280, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.280', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.128', 'weapon2': '0.226', 'AMMO3': '0.256', 'weapon5': '0.318', 'AMMO4': '0.345', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:44,968][52665] DAMAGECOUNT value on done: 983275.0 [2024-08-06 08:36:44,968][52665] Sum rewards: 67.298, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.265', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.050', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'weapon3': '3.482', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:44,978][52664] DAMAGECOUNT value on done: 1034105.0 [2024-08-06 08:36:44,979][52664] Sum rewards: 77.652, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.183', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.051', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:45,008][52659] DAMAGECOUNT value on done: 993117.0 [2024-08-06 08:36:45,008][52659] Sum rewards: 69.054, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.013', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.146', 'weapon5': '0.164', 'AMMO4': '0.164', 'AMMO3': '0.199', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.122', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:45,109][52667] DAMAGECOUNT value on done: 1005422.0 [2024-08-06 08:36:45,111][52667] Sum rewards: 91.617, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.594', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.096', 'weapon5': '0.128', 'AMMO4': '0.199', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.448', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.889', 'FRAGCOUNT': '77.000'} [2024-08-06 08:36:45,369][52795] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:36:45,911][52650] Updated weights for policy 0, policy_version 85491 (0.0013) [2024-08-06 08:36:46,921][52811] DAMAGECOUNT value on done: 931720.0 [2024-08-06 08:36:46,922][52811] Sum rewards: 81.005, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.430', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.012', 'AMMO4': '0.059', 'weapon4': '0.094', 'WEAPON5': '0.100', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'weapon2': '0.630', 'WEAPON3': '1.000', 'weapon3': '3.126', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:47,317][52662] DAMAGECOUNT value on done: 991694.0 [2024-08-06 08:36:47,318][52662] Sum rewards: 78.728, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.034', 'weapon5': '0.078', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.218', 'WEAPON3': '1.300', 'HITCOUNT': '3.400', 'weapon3': '3.492', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '65.000'} [2024-08-06 08:36:47,577][52649] DAMAGECOUNT value on done: 973936.0 [2024-08-06 08:36:47,577][52649] Sum rewards: 71.229, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.730', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon2': '0.240', 'weapon5': '0.252', 'AMMO3': '0.260', 'AMMO4': '0.330', 'weapon4': '0.440', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.710', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:47,691][52664] DAMAGECOUNT value on done: 1030535.0 [2024-08-06 08:36:47,691][52664] Sum rewards: 60.133, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.450', 'AMMO5': '0.006', 'AMMO2': '0.034', 'weapon4': '0.040', 'weapon5': '0.042', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.238', 'weapon2': '0.398', 'WEAPON3': '1.500', 'HITCOUNT': '3.080', 'weapon3': '3.274', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '52.000'} [2024-08-06 08:36:47,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 700383232. Throughput: 0: 4359.3. Samples: 175094170. Policy #0 lag: (min: 0.0, avg: 2.8, max: 7.0) [2024-08-06 08:36:47,794][52567] Avg episode reward: [(0, '75.314')] [2024-08-06 08:36:47,797][52667] DAMAGECOUNT value on done: 995225.0 [2024-08-06 08:36:47,798][52667] Sum rewards: 75.506, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.110', 'weapon5': '0.138', 'AMMO3': '0.176', 'weapon2': '0.182', 'AMMO4': '0.183', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.346', 'DAMAGECOUNT': '19.455', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:48,032][52665] DAMAGECOUNT value on done: 976788.0 [2024-08-06 08:36:48,032][52665] Sum rewards: 82.005, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.222', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.068', 'AMMO4': '0.088', 'weapon5': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.372', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '69.000'} [2024-08-06 08:36:48,137][52660] DAMAGECOUNT value on done: 993482.0 [2024-08-06 08:36:48,138][52660] Sum rewards: 82.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.926', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.134', 'weapon2': '0.194', 'AMMO4': '0.195', 'weapon4': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.745', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:48,251][52659] DAMAGECOUNT value on done: 999262.0 [2024-08-06 08:36:48,252][52659] Sum rewards: 72.765, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.630', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.066', 'AMMO4': '0.133', 'weapon5': '0.156', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon2': '0.370', 'WEAPON3': '1.550', 'weapon3': '3.148', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:49,998][52650] Updated weights for policy 0, policy_version 85501 (0.0011) [2024-08-06 08:36:50,030][52811] DAMAGECOUNT value on done: 934214.0 [2024-08-06 08:36:50,033][52811] Sum rewards: 78.294, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.570', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'weapon4': '0.120', 'weapon2': '0.186', 'AMMO3': '0.263', 'WEAPON3': '1.600', 'weapon3': '3.418', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:50,388][52649] DAMAGECOUNT value on done: 969058.0 [2024-08-06 08:36:50,389][52649] Sum rewards: 68.031, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.550', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.048', 'AMMO4': '0.069', 'weapon4': '0.080', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.235', 'weapon2': '0.248', 'WEAPON3': '1.350', 'weapon3': '3.412', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '57.000'} [2024-08-06 08:36:50,423][52660] DAMAGECOUNT value on done: 982610.0 [2024-08-06 08:36:50,425][52660] Sum rewards: 83.412, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.390', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.175', 'weapon5': '0.184', 'weapon2': '0.198', 'AMMO4': '0.205', 'weapon4': '0.256', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '67.500'} [2024-08-06 08:36:50,453][52664] DAMAGECOUNT value on done: 1040698.0 [2024-08-06 08:36:50,454][52664] Sum rewards: 79.075, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.665', 'AMMO5': '0.003', 'AMMO2': '0.025', 'weapon5': '0.042', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'weapon4': '0.190', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.650', 'weapon3': '3.194', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.711', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:50,509][52662] DAMAGECOUNT value on done: 1012887.0 [2024-08-06 08:36:50,511][52662] Sum rewards: 84.326, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.964', 'AMMO5': '0.008', 'weapon4': '0.038', 'AMMO2': '0.038', 'weapon5': '0.136', 'AMMO3': '0.153', 'AMMO4': '0.192', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.710', 'WEAPON3': '1.000', 'weapon3': '2.888', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.157', 'FRAGCOUNT': '66.000'} [2024-08-06 08:36:50,536][52667] DAMAGECOUNT value on done: 1002697.0 [2024-08-06 08:36:50,537][52667] Sum rewards: 65.595, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.243', 'AMMO5': '0.018', 'AMMO2': '0.073', 'weapon4': '0.110', 'weapon5': '0.202', 'AMMO3': '0.274', 'weapon2': '0.280', 'AMMO4': '0.366', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.700', 'weapon3': '3.064', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '59.000'} [2024-08-06 08:36:50,707][52665] DAMAGECOUNT value on done: 982343.0 [2024-08-06 08:36:50,707][52665] Sum rewards: 85.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.890', 'AMMO2': '0.005', 'AMMO4': '0.023', 'AMMO3': '0.218', 'weapon2': '0.236', 'WEAPON3': '1.300', 'weapon3': '3.598', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.914', 'FRAGCOUNT': '71.000'} [2024-08-06 08:36:51,392][52659] DAMAGECOUNT value on done: 998971.0 [2024-08-06 08:36:51,394][52659] Sum rewards: 77.303, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.288', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.108', 'AMMO4': '0.130', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.224', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:52,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 700465152. Throughput: 0: 4361.1. Samples: 175120520. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:36:52,794][52567] Avg episode reward: [(0, '75.110')] [2024-08-06 08:36:53,014][52649] DAMAGECOUNT value on done: 967767.0 [2024-08-06 08:36:53,014][52649] Sum rewards: 73.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.791', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.156', 'weapon5': '0.196', 'AMMO3': '0.213', 'AMMO4': '0.245', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.074', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 08:36:53,198][52662] DAMAGECOUNT value on done: 997684.0 [2024-08-06 08:36:53,199][52662] Sum rewards: 71.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.876', 'AMMO5': '0.021', 'AMMO2': '0.080', 'weapon4': '0.160', 'AMMO3': '0.238', 'weapon2': '0.278', 'weapon5': '0.294', 'AMMO4': '0.400', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '60.000'} [2024-08-06 08:36:53,215][52811] DAMAGECOUNT value on done: 941552.0 [2024-08-06 08:36:53,216][52811] Sum rewards: 76.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.167', 'AMMO5': '0.005', 'AMMO2': '0.026', 'WEAPON5': '0.100', 'AMMO4': '0.132', 'AMMO3': '0.243', 'weapon2': '0.272', 'WEAPON3': '1.400', 'weapon3': '3.544', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:53,311][52664] DAMAGECOUNT value on done: 1038819.0 [2024-08-06 08:36:53,312][52664] Sum rewards: 70.637, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.385', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO3': '0.147', 'weapon4': '0.176', 'AMMO4': '0.224', 'weapon5': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.418', 'WEAPON3': '0.950', 'weapon3': '2.874', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '17.523', 'FRAGCOUNT': '56.000'} [2024-08-06 08:36:53,484][52665] DAMAGECOUNT value on done: 990592.0 [2024-08-06 08:36:53,486][52665] Sum rewards: 69.903, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.493', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.148', 'weapon2': '0.186', 'AMMO3': '0.283', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.650', 'weapon3': '3.050', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '61.000'} [2024-08-06 08:36:53,524][52660] DAMAGECOUNT value on done: 998309.0 [2024-08-06 08:36:53,526][52660] Sum rewards: 85.271, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.700', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.080', 'weapon5': '0.124', 'AMMO4': '0.177', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.693', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:53,562][52667] DAMAGECOUNT value on done: 1008286.0 [2024-08-06 08:36:53,562][52667] Sum rewards: 68.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.154', 'weapon4': '0.160', 'AMMO3': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '56.000'} [2024-08-06 08:36:53,889][52659] DAMAGECOUNT value on done: 998860.0 [2024-08-06 08:36:53,892][52659] Sum rewards: 88.738, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.805', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.188', 'weapon2': '0.212', 'AMMO3': '0.260', 'AMMO4': '0.266', 'weapon5': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.996', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '22.317', 'FRAGCOUNT': '75.000'} [2024-08-06 08:36:55,231][52650] Updated weights for policy 0, policy_version 85511 (0.0016) [2024-08-06 08:36:55,819][52664] DAMAGECOUNT value on done: 1036435.0 [2024-08-06 08:36:55,819][52664] Sum rewards: 85.063, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.720', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.114', 'weapon5': '0.120', 'AMMO4': '0.139', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.749', 'FRAGCOUNT': '70.000'} [2024-08-06 08:36:55,874][52662] DAMAGECOUNT value on done: 1001522.0 [2024-08-06 08:36:55,875][52662] Sum rewards: 82.687, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.725', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon4': '0.062', 'AMMO4': '0.180', 'weapon5': '0.196', 'AMMO3': '0.281', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.688', 'WEAPON3': '1.700', 'weapon3': '2.792', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.862', 'FRAGCOUNT': '70.000'} [2024-08-06 08:36:56,137][52649] DAMAGECOUNT value on done: 982057.0 [2024-08-06 08:36:56,137][52649] Sum rewards: 78.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.075', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.116', 'AMMO4': '0.138', 'AMMO3': '0.162', 'weapon5': '0.166', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON3': '1.050', 'weapon3': '3.212', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:56,253][52811] DAMAGECOUNT value on done: 933828.0 [2024-08-06 08:36:56,254][52811] Sum rewards: 76.783, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.019', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.035', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.172', 'AMMO3': '0.265', 'weapon2': '0.344', 'WEAPON3': '1.500', 'weapon3': '3.332', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '65.000'} [2024-08-06 08:36:56,487][52667] DAMAGECOUNT value on done: 1011138.0 [2024-08-06 08:36:56,487][52667] Sum rewards: 80.237, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.046', 'AMMO4': '0.057', 'weapon4': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.536', 'WEAPON3': '1.350', 'weapon3': '3.180', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.683', 'FRAGCOUNT': '66.500'} [2024-08-06 08:36:56,553][52659] DAMAGECOUNT value on done: 995437.0 [2024-08-06 08:36:56,554][52659] Sum rewards: 73.774, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.336', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.082', 'AMMO4': '0.139', 'AMMO3': '0.165', 'WEAPON5': '0.200', 'weapon4': '0.236', 'WEAPON4': '0.300', 'weapon2': '0.784', 'WEAPON3': '0.950', 'weapon3': '2.652', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '58.000'} [2024-08-06 08:36:56,724][52660] DAMAGECOUNT value on done: 1008274.0 [2024-08-06 08:36:56,724][52660] Sum rewards: 79.452, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.920', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.078', 'AMMO4': '0.133', 'weapon4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.234', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:57,794][52567] Fps is (10 sec: 16383.6, 60 sec: 17340.9, 300 sec: 17467.0). Total num frames: 700547072. Throughput: 0: 4350.0. Samples: 175146300. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:36:57,795][52567] Avg episode reward: [(0, '75.443')] [2024-08-06 08:36:58,646][52662] DAMAGECOUNT value on done: 997028.0 [2024-08-06 08:36:58,646][52662] Sum rewards: 85.996, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.570', 'weapon5': '0.002', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.150', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '3.232', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.833', 'FRAGCOUNT': '69.000'} [2024-08-06 08:36:58,894][52664] DAMAGECOUNT value on done: 1048759.0 [2024-08-06 08:36:58,895][52664] Sum rewards: 82.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.628', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.192', 'AMMO3': '0.226', 'weapon4': '0.236', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '2.976', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.265', 'FRAGCOUNT': '68.000'} [2024-08-06 08:36:58,902][52649] DAMAGECOUNT value on done: 986558.0 [2024-08-06 08:36:58,902][52649] Sum rewards: 74.657, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.434', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.082', 'weapon5': '0.106', 'AMMO4': '0.142', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.310', 'WEAPON3': '1.500', 'weapon3': '3.274', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:59,435][52667] DAMAGECOUNT value on done: 1005815.0 [2024-08-06 08:36:59,435][52667] Sum rewards: 70.117, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.948', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.076', 'weapon5': '0.116', 'AMMO3': '0.201', 'AMMO4': '0.212', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.100', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '57.500'} [2024-08-06 08:36:59,455][52811] DAMAGECOUNT value on done: 930665.0 [2024-08-06 08:36:59,457][52811] Sum rewards: 75.723, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.805', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.070', 'AMMO4': '0.111', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.229', 'weapon2': '0.424', 'WEAPON3': '1.500', 'weapon3': '3.266', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '64.000'} [2024-08-06 08:36:59,717][52660] DAMAGECOUNT value on done: 989131.0 [2024-08-06 08:36:59,719][52660] Sum rewards: 66.600, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.910', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.096', 'weapon5': '0.168', 'AMMO3': '0.227', 'weapon2': '0.228', 'AMMO4': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '58.000'} [2024-08-06 08:36:59,832][52659] DAMAGECOUNT value on done: 1008126.0 [2024-08-06 08:36:59,832][52659] Sum rewards: 76.141, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon2': '0.200', 'AMMO3': '0.213', 'AMMO4': '0.216', 'weapon5': '0.224', 'weapon4': '0.262', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.016', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '63.000'} [2024-08-06 08:36:59,996][52650] Updated weights for policy 0, policy_version 85521 (0.0019) [2024-08-06 08:37:01,250][52662] DAMAGECOUNT value on done: 994150.0 [2024-08-06 08:37:01,258][52662] Sum rewards: 77.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.023', 'weapon4': '0.050', 'AMMO4': '0.116', 'weapon5': '0.170', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.658', 'WEAPON3': '1.250', 'weapon3': '2.836', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.060', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:01,500][52664] DAMAGECOUNT value on done: 1045357.0 [2024-08-06 08:37:01,500][52664] Sum rewards: 77.960, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.575', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.054', 'weapon5': '0.162', 'AMMO4': '0.241', 'AMMO3': '0.262', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.174', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '65.000'} [2024-08-06 08:37:01,987][52649] DAMAGECOUNT value on done: 977617.0 [2024-08-06 08:37:01,988][52649] Sum rewards: 77.444, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.027', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO4': '0.135', 'weapon5': '0.150', 'AMMO3': '0.164', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:02,587][52667] DAMAGECOUNT value on done: 1001815.0 [2024-08-06 08:37:02,587][52811] DAMAGECOUNT value on done: 931853.0 [2024-08-06 08:37:02,588][52667] Sum rewards: 76.551, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.182', 'AMMO4': '-0.012', 'AMMO2': '-0.002', 'AMMO3': '0.243', 'weapon2': '0.426', 'WEAPON3': '1.500', 'weapon3': '3.406', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:02,588][52811] Sum rewards: 72.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.060', 'AMMO4': '0.204', 'AMMO3': '0.211', 'weapon5': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.056', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.643', 'FRAGCOUNT': '59.500'} [2024-08-06 08:37:02,674][52659] DAMAGECOUNT value on done: 993340.0 [2024-08-06 08:37:02,675][52659] Sum rewards: 75.649, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.825', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.060', 'weapon5': '0.140', 'AMMO4': '0.175', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.224', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '62.000'} [2024-08-06 08:37:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 700637184. Throughput: 0: 4342.7. Samples: 175159200. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:02,794][52567] Avg episode reward: [(0, '75.583')] [2024-08-06 08:37:02,904][52660] DAMAGECOUNT value on done: 986449.0 [2024-08-06 08:37:02,904][52660] Sum rewards: 73.892, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.048', 'AMMO4': '0.164', 'AMMO3': '0.184', 'weapon5': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '60.500'} [2024-08-06 08:37:03,700][52662] DAMAGECOUNT value on done: 989904.0 [2024-08-06 08:37:03,701][52662] Sum rewards: 72.668, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.722', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.158', 'weapon2': '0.204', 'weapon5': '0.236', 'AMMO3': '0.249', 'AMMO4': '0.273', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.082', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '62.500'} [2024-08-06 08:37:04,251][52664] DAMAGECOUNT value on done: 1043463.0 [2024-08-06 08:37:04,253][52664] Sum rewards: 82.787, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon5': '0.048', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.160', 'weapon4': '0.160', 'AMMO3': '0.197', 'WEAPON3': '1.200', 'weapon3': '3.404', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.690', 'FRAGCOUNT': '68.000'} [2024-08-06 08:37:04,360][52650] Updated weights for policy 0, policy_version 85531 (0.0019) [2024-08-06 08:37:04,742][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:37:05,056][52649] DAMAGECOUNT value on done: 978419.0 [2024-08-06 08:37:05,058][52649] Sum rewards: 76.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.116', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.074', 'AMMO3': '0.187', 'weapon2': '0.202', 'WEAPON3': '1.250', 'HITCOUNT': '3.340', 'weapon3': '3.608', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:05,128][52659] DAMAGECOUNT value on done: 1002302.0 [2024-08-06 08:37:05,128][52659] Sum rewards: 72.305, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.163', 'AMMO5': '0.018', 'AMMO2': '0.043', 'AMMO3': '0.168', 'AMMO4': '0.213', 'weapon5': '0.222', 'weapon4': '0.270', 'weapon2': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.934', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '59.000'} [2024-08-06 08:37:05,611][52811] DAMAGECOUNT value on done: 932024.0 [2024-08-06 08:37:05,613][52811] Sum rewards: 80.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.838', 'ARMOR': '0.008', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.130', 'weapon5': '0.174', 'weapon4': '0.184', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '66.000'} [2024-08-06 08:37:05,667][52667] DAMAGECOUNT value on done: 1007688.0 [2024-08-06 08:37:05,667][52667] Sum rewards: 78.207, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.125', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.128', 'weapon4': '0.134', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '0.950', 'weapon3': '2.878', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.042', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:06,165][52660] DAMAGECOUNT value on done: 994301.0 [2024-08-06 08:37:06,166][52660] Sum rewards: 77.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.780', 'AMMO5': '0.015', 'AMMO2': '0.042', 'AMMO3': '0.179', 'AMMO4': '0.211', 'weapon5': '0.256', 'weapon4': '0.318', 'weapon2': '0.388', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.754', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:06,809][52662] DAMAGECOUNT value on done: 1000324.0 [2024-08-06 08:37:06,809][52662] Sum rewards: 76.195, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.340', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon4': '0.158', 'weapon2': '0.220', 'weapon5': '0.222', 'AMMO3': '0.259', 'AMMO4': '0.293', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:07,192][52664] DAMAGECOUNT value on done: 1027525.0 [2024-08-06 08:37:07,192][52664] Sum rewards: 75.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.130', 'AMMO5': '0.023', 'AMMO2': '0.052', 'weapon4': '0.158', 'AMMO4': '0.262', 'AMMO3': '0.265', 'weapon5': '0.292', 'WEAPON4': '0.500', 'weapon2': '0.582', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.594', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:07,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 700727296. Throughput: 0: 4341.6. Samples: 175185290. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:07,794][52567] Avg episode reward: [(0, '75.486')] [2024-08-06 08:37:07,892][52659] DAMAGECOUNT value on done: 997277.0 [2024-08-06 08:37:07,894][52659] Sum rewards: 71.819, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.660', 'AMMO5': '0.014', 'AMMO2': '0.052', 'AMMO3': '0.168', 'weapon4': '0.218', 'weapon5': '0.220', 'weapon2': '0.248', 'AMMO4': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.104', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '57.000'} [2024-08-06 08:37:08,043][52649] DAMAGECOUNT value on done: 967592.0 [2024-08-06 08:37:08,045][52649] Sum rewards: 80.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.350', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.036', 'weapon5': '0.066', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.206', 'AMMO3': '0.230', 'WEAPON3': '1.400', 'weapon3': '3.486', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '67.000'} [2024-08-06 08:37:08,666][52811] DAMAGECOUNT value on done: 938095.0 [2024-08-06 08:37:08,666][52811] Sum rewards: 72.147, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.826', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.150', 'weapon4': '0.156', 'weapon5': '0.156', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.246', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '60.000'} [2024-08-06 08:37:08,717][52668] Large shaping reward 2.507 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.456, 152.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:37:08,971][52660] DAMAGECOUNT value on done: 999693.0 [2024-08-06 08:37:08,971][52660] Sum rewards: 80.106, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.820', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.074', 'weapon5': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'weapon3': '3.432', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '68.000'} [2024-08-06 08:37:09,279][52650] Updated weights for policy 0, policy_version 85541 (0.0012) [2024-08-06 08:37:09,751][52664] DAMAGECOUNT value on done: 1031539.0 [2024-08-06 08:37:09,751][52664] Sum rewards: 70.026, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.105', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.050', 'weapon5': '0.158', 'AMMO4': '0.239', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.502', 'WEAPON3': '1.650', 'weapon3': '3.060', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:09,895][52662] DAMAGECOUNT value on done: 992689.0 [2024-08-06 08:37:09,896][52662] Sum rewards: 82.248, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.694', 'AMMO2': '0.015', 'AMMO4': '0.072', 'AMMO3': '0.214', 'weapon2': '0.762', 'WEAPON3': '1.250', 'weapon3': '3.076', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '67.000'} [2024-08-06 08:37:11,189][52649] DAMAGECOUNT value on done: 980676.0 [2024-08-06 08:37:11,189][52649] Sum rewards: 82.101, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.010', 'AMMO2': '0.015', 'AMMO4': '0.075', 'WEAPON4': '0.150', 'AMMO3': '0.152', 'weapon5': '0.172', 'weapon4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.406', 'HEALTH': '0.848', 'WEAPON3': '0.850', 'weapon3': '2.994', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.500'} [2024-08-06 08:37:11,235][52659] DAMAGECOUNT value on done: 995229.0 [2024-08-06 08:37:11,235][52659] Sum rewards: 83.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.116', 'weapon5': '0.158', 'AMMO4': '0.168', 'weapon2': '0.202', 'AMMO3': '0.239', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.258', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.191', 'FRAGCOUNT': '70.000'} [2024-08-06 08:37:11,408][52660] DAMAGECOUNT value on done: 987446.0 [2024-08-06 08:37:11,410][52660] Sum rewards: 61.247, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.620', 'AMMO5': '0.006', 'AMMO2': '0.019', 'AMMO4': '0.096', 'weapon5': '0.152', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.342', 'WEAPON4': '0.400', 'weapon4': '0.508', 'WEAPON3': '1.350', 'weapon3': '2.790', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '15.618', 'FRAGCOUNT': '51.000'} [2024-08-06 08:37:11,730][52811] DAMAGECOUNT value on done: 943969.0 [2024-08-06 08:37:11,730][52811] Sum rewards: 94.774, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.662', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon4': '0.094', 'weapon5': '0.118', 'AMMO3': '0.155', 'AMMO4': '0.235', 'weapon2': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.304', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '76.000'} [2024-08-06 08:37:12,251][52664] DAMAGECOUNT value on done: 1044401.0 [2024-08-06 08:37:12,261][52664] Sum rewards: 86.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.187', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.134', 'AMMO4': '0.176', 'AMMO3': '0.194', 'weapon5': '0.198', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.184', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.571', 'FRAGCOUNT': '69.000'} [2024-08-06 08:37:12,445][52662] DAMAGECOUNT value on done: 1008769.0 [2024-08-06 08:37:12,445][52662] Sum rewards: 81.259, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.915', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.328', 'weapon2': '0.424', 'WEAPON3': '2.000', 'weapon3': '3.376', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '72.000'} [2024-08-06 08:37:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 700809216. Throughput: 0: 4342.5. Samples: 175211810. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:12,794][52567] Avg episode reward: [(0, '76.202')] [2024-08-06 08:37:13,491][52650] Updated weights for policy 0, policy_version 85551 (0.0032) [2024-08-06 08:37:14,213][52659] DAMAGECOUNT value on done: 995024.0 [2024-08-06 08:37:14,213][52659] Sum rewards: 72.478, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.165', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.151', 'weapon2': '0.656', 'WEAPON3': '1.000', 'weapon3': '3.230', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '58.000'} [2024-08-06 08:37:14,303][52649] DAMAGECOUNT value on done: 959193.0 [2024-08-06 08:37:14,306][52649] Sum rewards: 69.376, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.722', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.178', 'weapon4': '0.186', 'weapon2': '0.228', 'AMMO4': '0.253', 'AMMO3': '0.277', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:14,669][52660] DAMAGECOUNT value on done: 986064.0 [2024-08-06 08:37:14,671][52660] Sum rewards: 66.845, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.802', 'AMMO5': '0.009', 'AMMO2': '0.056', 'weapon4': '0.082', 'weapon5': '0.122', 'AMMO3': '0.151', 'WEAPON5': '0.250', 'AMMO4': '0.280', 'WEAPON4': '0.350', 'weapon2': '0.588', 'WEAPON3': '0.900', 'HITCOUNT': '2.860', 'weapon3': '3.088', 'DAMAGECOUNT': '14.910', 'FRAGCOUNT': '53.000'} [2024-08-06 08:37:15,110][52811] DAMAGECOUNT value on done: 927561.0 [2024-08-06 08:37:15,110][52811] Sum rewards: 67.083, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.060', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.037', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.183', 'AMMO3': '0.237', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '3.316', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '56.000'} [2024-08-06 08:37:15,126][52664] DAMAGECOUNT value on done: 1026852.0 [2024-08-06 08:37:15,127][52664] Sum rewards: 82.352, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.364', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.147', 'weapon5': '0.166', 'weapon4': '0.204', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.456', 'WEAPON3': '1.350', 'weapon3': '2.906', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.654', 'FRAGCOUNT': '69.000'} [2024-08-06 08:37:15,136][52662] DAMAGECOUNT value on done: 996946.0 [2024-08-06 08:37:15,137][52662] Sum rewards: 71.267, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.380', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.098', 'weapon4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.314', 'WEAPON3': '1.450', 'weapon3': '3.314', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.301', 'FRAGCOUNT': '60.000'} [2024-08-06 08:37:17,362][52649] DAMAGECOUNT value on done: 980350.0 [2024-08-06 08:37:17,372][52649] Sum rewards: 75.660, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.997', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.132', 'AMMO3': '0.179', 'weapon5': '0.186', 'weapon4': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '2.950', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '59.000'} [2024-08-06 08:37:17,418][52659] DAMAGECOUNT value on done: 999211.0 [2024-08-06 08:37:17,418][52659] Sum rewards: 90.482, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.960', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.095', 'AMMO3': '0.141', 'WEAPON5': '0.150', 'weapon4': '0.194', 'WEAPON4': '0.250', 'weapon2': '0.686', 'WEAPON3': '0.900', 'weapon3': '2.872', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '20.379', 'FRAGCOUNT': '72.000'} [2024-08-06 08:37:17,619][52660] DAMAGECOUNT value on done: 992952.0 [2024-08-06 08:37:17,621][52660] Sum rewards: 75.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.784', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon5': '0.054', 'AMMO4': '0.102', 'AMMO3': '0.147', 'weapon4': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.534', 'WEAPON3': '0.850', 'weapon3': '2.938', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '60.000'} [2024-08-06 08:37:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 700899328. Throughput: 0: 4352.2. Samples: 175224880. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:17,794][52567] Avg episode reward: [(0, '76.194')] [2024-08-06 08:37:18,180][52662] DAMAGECOUNT value on done: 986805.0 [2024-08-06 08:37:18,181][52662] Sum rewards: 70.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.355', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon5': '0.160', 'AMMO4': '0.170', 'weapon4': '0.218', 'AMMO3': '0.233', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.048', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.512', 'FRAGCOUNT': '59.000'} [2024-08-06 08:37:18,369][52811] DAMAGECOUNT value on done: 931043.0 [2024-08-06 08:37:18,371][52811] Sum rewards: 79.270, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.950', 'AMMO5': '0.009', 'AMMO2': '0.045', 'weapon5': '0.116', 'weapon4': '0.120', 'AMMO3': '0.192', 'AMMO4': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.138', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:18,566][52650] Updated weights for policy 0, policy_version 85561 (0.0013) [2024-08-06 08:37:20,245][52649] DAMAGECOUNT value on done: 983331.0 [2024-08-06 08:37:20,247][52649] Sum rewards: 84.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.725', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.036', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.218', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.418', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '70.000'} [2024-08-06 08:37:20,341][52659] DAMAGECOUNT value on done: 1009422.0 [2024-08-06 08:37:20,342][52659] Sum rewards: 66.044, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.822', 'AMMO5': '0.022', 'AMMO2': '0.063', 'weapon4': '0.134', 'weapon2': '0.268', 'weapon5': '0.274', 'AMMO3': '0.303', 'AMMO4': '0.314', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.900', 'weapon3': '2.972', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '58.500'} [2024-08-06 08:37:20,681][52660] DAMAGECOUNT value on done: 989476.0 [2024-08-06 08:37:20,682][52660] Sum rewards: 70.861, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.103', 'weapon5': '0.124', 'HEALTH': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.308', 'WEAPON3': '1.250', 'weapon3': '3.296', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.016', 'FRAGCOUNT': '58.000'} [2024-08-06 08:37:21,325][52662] DAMAGECOUNT value on done: 994032.0 [2024-08-06 08:37:21,327][52662] Sum rewards: 56.917, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.692', 'AMMO5': '0.024', 'AMMO2': '0.072', 'weapon4': '0.222', 'AMMO3': '0.285', 'weapon5': '0.294', 'AMMO4': '0.361', 'weapon2': '0.390', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.650', 'weapon3': '2.764', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '51.500'} [2024-08-06 08:37:22,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 700989440. Throughput: 0: 4351.8. Samples: 175250780. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:22,795][52567] Avg episode reward: [(0, '76.137')] [2024-08-06 08:37:23,055][52659] DAMAGECOUNT value on done: 990763.0 [2024-08-06 08:37:23,056][52659] Sum rewards: 79.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.394', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.102', 'AMMO4': '0.145', 'weapon5': '0.160', 'AMMO3': '0.246', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.232', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '67.000'} [2024-08-06 08:37:23,171][52649] DAMAGECOUNT value on done: 971404.0 [2024-08-06 08:37:23,171][52649] Sum rewards: 71.271, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.360', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.072', 'weapon5': '0.130', 'AMMO4': '0.153', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.100', 'HITCOUNT': '3.290', 'weapon3': '3.326', 'DAMAGECOUNT': '17.520', 'FRAGCOUNT': '57.000'} [2024-08-06 08:37:23,303][52650] Updated weights for policy 0, policy_version 85571 (0.0025) [2024-08-06 08:37:23,412][52660] DAMAGECOUNT value on done: 989105.0 [2024-08-06 08:37:23,413][52660] Sum rewards: 83.781, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.055', 'AMMO5': '0.009', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.118', 'AMMO3': '0.127', 'AMMO4': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.930', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '65.000'} [2024-08-06 08:37:24,518][52662] DAMAGECOUNT value on done: 988931.0 [2024-08-06 08:37:24,518][52662] Sum rewards: 75.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.715', 'AMMO5': '0.008', 'AMMO2': '0.010', 'AMMO4': '0.052', 'weapon5': '0.096', 'weapon4': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.320', 'WEAPON3': '1.450', 'weapon3': '3.234', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:25,034][52671] DAMAGECOUNT value on done: 1003059.0 [2024-08-06 08:37:25,035][52671] Sum rewards: 71.827, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.396', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.056', 'weapon5': '0.126', 'AMMO4': '0.154', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '62.000'} [2024-08-06 08:37:25,540][52659] DAMAGECOUNT value on done: 1003166.0 [2024-08-06 08:37:25,542][52659] Sum rewards: 82.229, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon5': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'weapon4': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.346', 'WEAPON3': '1.250', 'weapon3': '3.314', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '66.000'} [2024-08-06 08:37:26,449][52660] DAMAGECOUNT value on done: 997345.0 [2024-08-06 08:37:26,451][52660] Sum rewards: 61.349, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon5': '0.100', 'weapon4': '0.152', 'AMMO4': '0.195', 'AMMO3': '0.211', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.442', 'WEAPON3': '1.350', 'weapon3': '3.042', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '51.500'} [2024-08-06 08:37:27,641][52671] DAMAGECOUNT value on done: 1008823.0 [2024-08-06 08:37:27,643][52671] Sum rewards: 65.029, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.628', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon5': '0.182', 'AMMO4': '0.212', 'AMMO3': '0.239', 'weapon4': '0.306', 'weapon2': '0.318', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.762', 'HITCOUNT': '2.970', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '55.000'} [2024-08-06 08:37:27,760][52650] Updated weights for policy 0, policy_version 85581 (0.0014) [2024-08-06 08:37:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 701079552. Throughput: 0: 4359.6. Samples: 175277280. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:27,794][52567] Avg episode reward: [(0, '75.917')] [2024-08-06 08:37:28,219][52659] DAMAGECOUNT value on done: 994456.0 [2024-08-06 08:37:28,219][52659] Sum rewards: 78.225, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.175', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.032', 'weapon4': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'AMMO3': '0.214', 'weapon2': '0.232', 'WEAPON3': '1.250', 'weapon3': '3.478', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '66.000'} [2024-08-06 08:37:28,332][52669] DAMAGECOUNT value on done: 996170.0 [2024-08-06 08:37:28,332][52669] Sum rewards: 80.111, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.930', 'AMMO5': '0.011', 'AMMO2': '0.026', 'AMMO4': '0.129', 'weapon4': '0.142', 'weapon5': '0.148', 'weapon2': '0.242', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '68.500'} [2024-08-06 08:37:29,158][52658] DAMAGECOUNT value on done: 1001733.0 [2024-08-06 08:37:29,158][52658] Sum rewards: 67.065, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.470', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.162', 'AMMO3': '0.175', 'weapon2': '0.230', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.090', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '55.000'} [2024-08-06 08:37:29,626][52660] DAMAGECOUNT value on done: 1013753.0 [2024-08-06 08:37:29,627][52660] Sum rewards: 73.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.088', 'AMMO4': '0.136', 'weapon5': '0.148', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.764', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:29,745][52664] Large shaping reward -2.525 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.276, -92.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:37:30,679][52671] DAMAGECOUNT value on done: 1002751.0 [2024-08-06 08:37:30,682][52671] Sum rewards: 76.977, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.590', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.208', 'AMMO4': '0.239', 'AMMO3': '0.253', 'weapon2': '0.306', 'weapon4': '0.312', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.858', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '65.000'} [2024-08-06 08:37:31,432][52669] DAMAGECOUNT value on done: 996131.0 [2024-08-06 08:37:31,436][52669] Sum rewards: 84.091, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.386', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon4': '0.040', 'WEAPON4': '0.050', 'weapon5': '0.064', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.312', 'WEAPON3': '1.150', 'weapon3': '3.366', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.256', 'FRAGCOUNT': '67.000'} [2024-08-06 08:37:32,264][52658] DAMAGECOUNT value on done: 1003673.0 [2024-08-06 08:37:32,264][52658] Sum rewards: 81.967, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.315', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.024', 'weapon5': '0.060', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.644', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '65.000'} [2024-08-06 08:37:32,488][52650] Updated weights for policy 0, policy_version 85591 (0.0031) [2024-08-06 08:37:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 701161472. Throughput: 0: 4359.6. Samples: 175290350. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:32,794][52567] Avg episode reward: [(0, '76.261')] [2024-08-06 08:37:32,791][52660] DAMAGECOUNT value on done: 992486.0 [2024-08-06 08:37:32,804][52660] Sum rewards: 84.074, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.200', 'AMMO4': '0.204', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.722', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '70.000'} [2024-08-06 08:37:32,860][52803] DAMAGECOUNT value on done: 926389.0 [2024-08-06 08:37:32,866][52803] Sum rewards: 75.681, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.856', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.060', 'AMMO4': '0.147', 'AMMO3': '0.191', 'weapon5': '0.242', 'WEAPON4': '0.300', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '60.000'} [2024-08-06 08:37:33,134][52671] DAMAGECOUNT value on done: 1010843.0 [2024-08-06 08:37:33,134][52671] Sum rewards: 77.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.822', 'AMMO5': '0.017', 'AMMO2': '0.040', 'AMMO4': '0.198', 'weapon5': '0.220', 'AMMO3': '0.234', 'weapon2': '0.248', 'WEAPON5': '0.400', 'weapon4': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.450', 'weapon3': '2.744', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '20.361', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:34,514][52669] DAMAGECOUNT value on done: 1005159.0 [2024-08-06 08:37:34,514][52669] Sum rewards: 69.843, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.156', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.134', 'weapon5': '0.178', 'AMMO4': '0.194', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.832', 'FRAGCOUNT': '58.000'} [2024-08-06 08:37:35,143][52658] DAMAGECOUNT value on done: 1005568.0 [2024-08-06 08:37:35,144][52658] Sum rewards: 74.946, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.765', 'AMMO5': '0.020', 'AMMO2': '0.061', 'weapon4': '0.202', 'AMMO3': '0.222', 'weapon5': '0.276', 'AMMO4': '0.305', 'weapon2': '0.392', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.822', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:35,573][52671] DAMAGECOUNT value on done: 1015169.0 [2024-08-06 08:37:35,575][52671] Sum rewards: 77.399, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.038', 'AMMO4': '0.088', 'weapon5': '0.092', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.348', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '62.000'} [2024-08-06 08:37:35,639][52660] DAMAGECOUNT value on done: 996513.0 [2024-08-06 08:37:35,640][52660] Sum rewards: 87.139, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.210', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.060', 'AMMO4': '0.098', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.326', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.715', 'FRAGCOUNT': '73.000'} [2024-08-06 08:37:35,969][52803] DAMAGECOUNT value on done: 925715.0 [2024-08-06 08:37:35,969][52803] Sum rewards: 80.808, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.120', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.048', 'weapon5': '0.090', 'AMMO4': '0.096', 'weapon2': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'WEAPON3': '1.450', 'weapon3': '3.488', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '67.000'} [2024-08-06 08:37:37,056][52650] Updated weights for policy 0, policy_version 85601 (0.0015) [2024-08-06 08:37:37,527][52669] DAMAGECOUNT value on done: 999206.0 [2024-08-06 08:37:37,527][52669] Sum rewards: 70.376, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.920', 'AMMO5': '0.024', 'AMMO2': '0.063', 'weapon5': '0.268', 'AMMO3': '0.296', 'weapon4': '0.298', 'weapon2': '0.302', 'AMMO4': '0.315', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.700', 'weapon3': '2.772', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '62.000'} [2024-08-06 08:37:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 701251584. Throughput: 0: 4348.9. Samples: 175316220. Policy #0 lag: (min: 0.0, avg: 3.1, max: 9.0) [2024-08-06 08:37:37,794][52567] Avg episode reward: [(0, '76.514')] [2024-08-06 08:37:38,210][52658] DAMAGECOUNT value on done: 999884.0 [2024-08-06 08:37:38,210][52658] Sum rewards: 84.736, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.983', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.136', 'weapon4': '0.160', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.630', 'WEAPON3': '1.300', 'weapon3': '2.856', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.878', 'FRAGCOUNT': '69.000'} [2024-08-06 08:37:38,354][52671] DAMAGECOUNT value on done: 1004494.0 [2024-08-06 08:37:38,356][52671] Sum rewards: 80.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.336', 'AMMO5': '0.004', 'AMMO2': '0.013', 'weapon4': '0.016', 'weapon5': '0.038', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.408', 'WEAPON3': '1.250', 'weapon3': '3.398', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:38,552][52660] DAMAGECOUNT value on done: 995665.0 [2024-08-06 08:37:38,553][52660] Sum rewards: 91.838, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.440', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.110', 'AMMO4': '0.128', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '21.792', 'FRAGCOUNT': '73.000'} [2024-08-06 08:37:38,963][52803] DAMAGECOUNT value on done: 934627.0 [2024-08-06 08:37:38,964][52803] Sum rewards: 71.735, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.608', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon5': '0.038', 'weapon4': '0.088', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.391', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:39,722][52671] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:37:40,677][52669] DAMAGECOUNT value on done: 1006495.0 [2024-08-06 08:37:40,679][52669] Sum rewards: 75.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon5': '0.126', 'weapon4': '0.144', 'AMMO4': '0.196', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '3.064', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:40,742][52658] DAMAGECOUNT value on done: 994692.0 [2024-08-06 08:37:40,744][52658] Sum rewards: 73.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.765', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.134', 'AMMO4': '0.157', 'weapon2': '0.160', 'AMMO3': '0.230', 'weapon4': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.182', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2024-08-06 08:37:41,402][52671] DAMAGECOUNT value on done: 1003055.0 [2024-08-06 08:37:41,404][52671] Sum rewards: 71.495, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.160', 'AMMO5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.036', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.236', 'AMMO3': '0.284', 'WEAPON3': '1.800', 'HITCOUNT': '3.480', 'weapon3': '3.490', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:41,460][52660] DAMAGECOUNT value on done: 985810.0 [2024-08-06 08:37:41,460][52660] Sum rewards: 78.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.205', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.053', 'weapon5': '0.108', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.246', 'weapon2': '0.282', 'WEAPON3': '1.150', 'weapon3': '3.098', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '63.000'} [2024-08-06 08:37:42,057][52650] Updated weights for policy 0, policy_version 85611 (0.0013) [2024-08-06 08:37:42,077][52803] DAMAGECOUNT value on done: 927558.0 [2024-08-06 08:37:42,081][52803] Sum rewards: 63.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.086', 'AMMO4': '0.156', 'weapon5': '0.186', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '2.894', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.188', 'FRAGCOUNT': '54.000'} [2024-08-06 08:37:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 701333504. Throughput: 0: 4363.4. Samples: 175342650. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:37:42,794][52567] Avg episode reward: [(0, '76.471')] [2024-08-06 08:37:43,384][52658] DAMAGECOUNT value on done: 992998.0 [2024-08-06 08:37:43,386][52658] Sum rewards: 92.642, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.058', 'weapon5': '0.152', 'AMMO4': '0.167', 'AMMO3': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.182', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.817', 'FRAGCOUNT': '75.000'} [2024-08-06 08:37:43,396][52669] DAMAGECOUNT value on done: 1004861.0 [2024-08-06 08:37:43,397][52669] Sum rewards: 80.057, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.591', 'AMMO5': '0.006', 'weapon4': '0.020', 'AMMO2': '0.022', 'weapon5': '0.082', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.237', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '67.000'} [2024-08-06 08:37:44,456][52671] DAMAGECOUNT value on done: 1010242.0 [2024-08-06 08:37:44,457][52671] Sum rewards: 70.499, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.480', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'AMMO3': '0.176', 'weapon5': '0.224', 'weapon2': '0.232', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.570', 'WEAPON3': '1.150', 'weapon3': '2.626', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '58.000'} [2024-08-06 08:37:44,511][52660] DAMAGECOUNT value on done: 988166.0 [2024-08-06 08:37:44,513][52660] Sum rewards: 79.775, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.585', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.060', 'weapon5': '0.082', 'AMMO4': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.276', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '66.000'} [2024-08-06 08:37:45,342][52803] DAMAGECOUNT value on done: 929232.0 [2024-08-06 08:37:45,342][52803] Sum rewards: 77.601, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.186', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.084', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'weapon2': '0.572', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:46,063][52658] DAMAGECOUNT value on done: 1005840.0 [2024-08-06 08:37:46,063][52658] Sum rewards: 69.136, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.300', 'AMMO5': '0.031', 'AMMO2': '0.079', 'weapon4': '0.160', 'AMMO3': '0.198', 'weapon5': '0.200', 'weapon2': '0.302', 'AMMO4': '0.394', 'WEAPON5': '0.750', 'WEAPON4': '0.800', 'WEAPON3': '1.400', 'weapon3': '2.992', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:46,327][52669] DAMAGECOUNT value on done: 1002270.0 [2024-08-06 08:37:46,327][52669] Sum rewards: 77.663, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.094', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.098', 'weapon5': '0.124', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:46,509][52650] Updated weights for policy 0, policy_version 85621 (0.0014) [2024-08-06 08:37:47,505][52671] DAMAGECOUNT value on done: 989582.0 [2024-08-06 08:37:47,507][52671] Sum rewards: 71.057, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.470', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.176', 'weapon2': '0.238', 'weapon4': '0.254', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.469', 'FRAGCOUNT': '57.000'} [2024-08-06 08:37:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 701423616. Throughput: 0: 4366.2. Samples: 175355680. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:37:47,795][52567] Avg episode reward: [(0, '76.554')] [2024-08-06 08:37:48,623][52803] DAMAGECOUNT value on done: 926175.0 [2024-08-06 08:37:48,624][52803] Sum rewards: 92.886, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.019', 'AMMO2': '0.041', 'HEALTH': '0.166', 'AMMO3': '0.184', 'AMMO4': '0.205', 'weapon2': '0.264', 'weapon5': '0.268', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.740', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.549', 'FRAGCOUNT': '73.000'} [2024-08-06 08:37:49,004][52658] DAMAGECOUNT value on done: 991146.0 [2024-08-06 08:37:49,006][52658] Sum rewards: 89.709, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.230', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.170', 'weapon2': '0.326', 'WEAPON3': '1.050', 'weapon3': '3.448', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.619', 'FRAGCOUNT': '72.000'} [2024-08-06 08:37:49,346][52669] DAMAGECOUNT value on done: 1004492.0 [2024-08-06 08:37:49,349][52669] Sum rewards: 73.320, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.048', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO4': '0.223', 'AMMO3': '0.241', 'weapon4': '0.246', 'weapon2': '0.264', 'weapon5': '0.294', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.712', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '61.000'} [2024-08-06 08:37:50,429][52671] DAMAGECOUNT value on done: 1004085.0 [2024-08-06 08:37:50,429][52671] Sum rewards: 80.569, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.220', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.106', 'weapon5': '0.118', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.688', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '64.000'} [2024-08-06 08:37:51,294][52650] Updated weights for policy 0, policy_version 85631 (0.0034) [2024-08-06 08:37:51,953][52803] DAMAGECOUNT value on done: 924812.0 [2024-08-06 08:37:51,955][52803] Sum rewards: 88.313, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.804', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.090', 'AMMO4': '0.151', 'AMMO3': '0.195', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.554', 'WEAPON3': '1.200', 'weapon3': '2.836', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.468', 'FRAGCOUNT': '70.000'} [2024-08-06 08:37:51,974][52658] DAMAGECOUNT value on done: 1019729.0 [2024-08-06 08:37:51,976][52658] Sum rewards: 80.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.028', 'AMMO5': '0.009', 'weapon4': '0.042', 'AMMO2': '0.048', 'weapon5': '0.096', 'AMMO3': '0.204', 'AMMO4': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '3.168', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.629', 'FRAGCOUNT': '65.000'} [2024-08-06 08:37:52,023][52669] DAMAGECOUNT value on done: 1013304.0 [2024-08-06 08:37:52,023][52669] Sum rewards: 82.278, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.982', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.086', 'AMMO4': '0.129', 'weapon5': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.324', 'WEAPON3': '1.550', 'weapon3': '3.106', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '70.000'} [2024-08-06 08:37:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 701513728. Throughput: 0: 4366.0. Samples: 175381760. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:37:52,794][52567] Avg episode reward: [(0, '76.821')] [2024-08-06 08:37:53,258][52647] DAMAGECOUNT value on done: 1064211.0 [2024-08-06 08:37:53,258][52647] Sum rewards: 86.475, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.369', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.084', 'AMMO4': '0.091', 'weapon5': '0.102', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.452', 'WEAPON3': '0.850', 'weapon3': '3.186', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '66.000'} [2024-08-06 08:37:53,270][52671] DAMAGECOUNT value on done: 1004330.0 [2024-08-06 08:37:53,271][52671] Sum rewards: 72.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.467', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.122', 'weapon5': '0.138', 'AMMO4': '0.163', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.012', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '60.000'} [2024-08-06 08:37:54,855][52669] DAMAGECOUNT value on done: 1004408.0 [2024-08-06 08:37:54,857][52669] Sum rewards: 76.545, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.460', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.072', 'weapon5': '0.164', 'AMMO3': '0.201', 'AMMO4': '0.235', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.622', 'WEAPON3': '1.200', 'weapon3': '2.934', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '62.000'} [2024-08-06 08:37:55,154][52658] DAMAGECOUNT value on done: 1007238.0 [2024-08-06 08:37:55,157][52658] Sum rewards: 75.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.128', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.082', 'weapon4': '0.098', 'AMMO4': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.244', 'WEAPON3': '1.400', 'weapon3': '3.384', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.366', 'FRAGCOUNT': '62.000'} [2024-08-06 08:37:55,380][52803] DAMAGECOUNT value on done: 923384.0 [2024-08-06 08:37:55,382][52803] Sum rewards: 81.417, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.913', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.042', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.224', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'HITCOUNT': '3.440', 'weapon3': '3.526', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '68.000'} [2024-08-06 08:37:55,803][52647] DAMAGECOUNT value on done: 1051606.0 [2024-08-06 08:37:55,804][52647] Sum rewards: 85.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.358', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.038', 'AMMO4': '0.045', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.102', 'AMMO3': '0.173', 'weapon2': '0.464', 'WEAPON3': '1.100', 'weapon3': '3.226', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '69.000'} [2024-08-06 08:37:56,035][52671] DAMAGECOUNT value on done: 1000667.0 [2024-08-06 08:37:56,037][52671] Sum rewards: 76.129, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.144', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon2': '0.184', 'weapon5': '0.200', 'AMMO4': '0.233', 'AMMO3': '0.279', 'weapon4': '0.330', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.974', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '65.000'} [2024-08-06 08:37:56,214][52650] Updated weights for policy 0, policy_version 85641 (0.0014) [2024-08-06 08:37:56,250][52663] DAMAGECOUNT value on done: 1014627.0 [2024-08-06 08:37:56,251][52663] Sum rewards: 68.290, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.876', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.144', 'weapon5': '0.148', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'weapon2': '0.202', 'WEAPON5': '0.250', 'AMMO3': '0.284', 'WEAPON3': '1.700', 'HITCOUNT': '3.180', 'weapon3': '3.270', 'DAMAGECOUNT': '17.598', 'FRAGCOUNT': '59.000'} [2024-08-06 08:37:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 701595648. Throughput: 0: 4362.9. Samples: 175408140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:37:57,795][52567] Avg episode reward: [(0, '76.955')] [2024-08-06 08:37:57,851][52662] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:37:57,967][52669] DAMAGECOUNT value on done: 1009191.0 [2024-08-06 08:37:57,968][52669] Sum rewards: 70.867, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.895', 'AMMO5': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'AMMO3': '0.141', 'weapon4': '0.162', 'weapon5': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.528', 'WEAPON3': '1.000', 'weapon3': '2.900', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '55.000'} [2024-08-06 08:37:58,352][52658] DAMAGECOUNT value on done: 1012896.0 [2024-08-06 08:37:58,355][52658] Sum rewards: 85.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.553', 'AMMO5': '0.014', 'AMMO2': '0.047', 'weapon2': '0.186', 'weapon5': '0.220', 'AMMO3': '0.230', 'AMMO4': '0.233', 'weapon4': '0.304', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.060', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.120', 'FRAGCOUNT': '69.000'} [2024-08-06 08:37:58,552][52647] DAMAGECOUNT value on done: 1055575.0 [2024-08-06 08:37:58,553][52647] Sum rewards: 63.295, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.300', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.020', 'weapon5': '0.070', 'AMMO4': '0.077', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.770', 'WEAPON3': '1.200', 'weapon3': '2.950', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.876', 'FRAGCOUNT': '52.000'} [2024-08-06 08:37:58,739][52803] DAMAGECOUNT value on done: 931702.0 [2024-08-06 08:37:58,740][52803] Sum rewards: 72.529, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-4.006', 'AMMO5': '0.020', 'AMMO2': '0.049', 'AMMO4': '0.247', 'weapon5': '0.270', 'AMMO3': '0.296', 'weapon4': '0.324', 'weapon2': '0.344', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.750', 'weapon3': '2.658', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '65.000'} [2024-08-06 08:37:59,223][52663] DAMAGECOUNT value on done: 1001027.0 [2024-08-06 08:37:59,223][52663] Sum rewards: 73.606, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.017', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.147', 'AMMO3': '0.160', 'weapon5': '0.214', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.590', 'WEAPON3': '1.050', 'weapon3': '2.670', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.078', 'FRAGCOUNT': '60.000'} [2024-08-06 08:37:59,279][52671] DAMAGECOUNT value on done: 1003841.0 [2024-08-06 08:37:59,279][52671] Sum rewards: 87.934, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.530', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.094', 'weapon4': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.283', 'weapon2': '0.304', 'WEAPON3': '1.650', 'weapon3': '3.236', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '21.402', 'FRAGCOUNT': '74.000'} [2024-08-06 08:38:00,663][52650] Updated weights for policy 0, policy_version 85651 (0.0021) [2024-08-06 08:38:01,019][52658] DAMAGECOUNT value on done: 997832.0 [2024-08-06 08:38:01,020][52658] Sum rewards: 78.008, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.052', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon5': '0.080', 'weapon4': '0.134', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:01,090][52669] DAMAGECOUNT value on done: 1008081.0 [2024-08-06 08:38:01,091][52669] Sum rewards: 72.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.414', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.074', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.208', 'weapon2': '0.284', 'WEAPON3': '1.200', 'HITCOUNT': '3.260', 'weapon3': '3.372', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:01,398][52647] DAMAGECOUNT value on done: 1054075.0 [2024-08-06 08:38:01,398][52647] Sum rewards: 72.899, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.281', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.204', 'AMMO3': '0.205', 'weapon2': '0.386', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.169', 'FRAGCOUNT': '61.000'} [2024-08-06 08:38:01,961][52803] DAMAGECOUNT value on done: 926390.0 [2024-08-06 08:38:01,964][52803] Sum rewards: 82.427, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.476', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.024', 'AMMO4': '0.080', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.171', 'weapon2': '0.444', 'WEAPON3': '1.000', 'weapon3': '3.284', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '66.500'} [2024-08-06 08:38:01,987][52671] DAMAGECOUNT value on done: 1006807.0 [2024-08-06 08:38:01,989][52671] Sum rewards: 79.116, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.866', 'AMMO5': '0.025', 'AMMO2': '0.061', 'weapon4': '0.094', 'AMMO3': '0.255', 'weapon5': '0.274', 'AMMO4': '0.306', 'weapon2': '0.342', 'WEAPON4': '0.500', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '3.006', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:02,481][52663] DAMAGECOUNT value on done: 994869.0 [2024-08-06 08:38:02,483][52663] Sum rewards: 79.806, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.405', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.084', 'weapon5': '0.146', 'AMMO4': '0.210', 'AMMO3': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.132', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '68.000'} [2024-08-06 08:38:02,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 701685760. Throughput: 0: 4358.6. Samples: 175421020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:38:02,795][52567] Avg episode reward: [(0, '77.008')] [2024-08-06 08:38:03,981][52658] DAMAGECOUNT value on done: 1008396.0 [2024-08-06 08:38:03,982][52658] Sum rewards: 78.783, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.600', 'AMMO5': '0.008', 'AMMO2': '0.013', 'AMMO4': '0.066', 'AMMO3': '0.131', 'weapon5': '0.138', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.264', 'weapon2': '0.678', 'WEAPON3': '0.950', 'weapon3': '2.720', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:04,130][52647] DAMAGECOUNT value on done: 1064714.0 [2024-08-06 08:38:04,132][52647] Sum rewards: 75.387, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.166', 'AMMO3': '0.211', 'AMMO4': '0.215', 'weapon5': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.416', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:04,146][52669] DAMAGECOUNT value on done: 995837.0 [2024-08-06 08:38:04,148][52669] Sum rewards: 68.775, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.755', 'AMMO5': '0.016', 'AMMO2': '0.034', 'weapon4': '0.096', 'weapon5': '0.120', 'AMMO3': '0.164', 'AMMO4': '0.172', 'WEAPON4': '0.250', 'weapon2': '0.316', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'HITCOUNT': '2.930', 'weapon3': '3.282', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '56.000'} [2024-08-06 08:38:04,357][52671] DAMAGECOUNT value on done: 989448.0 [2024-08-06 08:38:04,359][52671] Sum rewards: 74.570, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.977', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.080', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '63.000'} [2024-08-06 08:38:04,948][52803] DAMAGECOUNT value on done: 940121.0 [2024-08-06 08:38:04,948][52803] Sum rewards: 76.035, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.148', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.104', 'weapon4': '0.120', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.272', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.961', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:05,278][52650] Updated weights for policy 0, policy_version 85661 (0.0011) [2024-08-06 08:38:05,486][52663] DAMAGECOUNT value on done: 1002696.0 [2024-08-06 08:38:05,487][52663] Sum rewards: 78.886, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.124', 'AMMO3': '0.180', 'weapon4': '0.238', 'weapon2': '0.272', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:06,848][52671] DAMAGECOUNT value on done: 1015380.0 [2024-08-06 08:38:06,850][52671] Sum rewards: 72.641, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon5': '0.032', 'weapon4': '0.038', 'AMMO4': '0.059', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.188', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '59.000'} [2024-08-06 08:38:06,947][52647] DAMAGECOUNT value on done: 1059258.0 [2024-08-06 08:38:06,947][52647] Sum rewards: 78.363, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.088', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.090', 'weapon4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.278', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '64.000'} [2024-08-06 08:38:07,028][52658] DAMAGECOUNT value on done: 999803.0 [2024-08-06 08:38:07,028][52658] Sum rewards: 74.668, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.444', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.032', 'AMMO4': '0.062', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.440', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:07,094][52669] DAMAGECOUNT value on done: 999600.0 [2024-08-06 08:38:07,094][52669] Sum rewards: 83.876, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.062', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.166', 'AMMO4': '0.186', 'weapon5': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.096', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '68.000'} [2024-08-06 08:38:07,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 701775872. Throughput: 0: 4368.9. Samples: 175447380. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:38:07,794][52567] Avg episode reward: [(0, '76.999')] [2024-08-06 08:38:07,964][52803] DAMAGECOUNT value on done: 936782.0 [2024-08-06 08:38:07,966][52803] Sum rewards: 80.349, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.290', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.056', 'weapon5': '0.114', 'AMMO4': '0.178', 'AMMO3': '0.260', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.240', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.171', 'FRAGCOUNT': '67.000'} [2024-08-06 08:38:08,356][52663] DAMAGECOUNT value on done: 1002750.0 [2024-08-06 08:38:08,357][52663] Sum rewards: 87.321, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.406', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.074', 'AMMO3': '0.153', 'AMMO4': '0.168', 'weapon5': '0.188', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.680', 'WEAPON3': '1.050', 'weapon3': '2.908', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '68.000'} [2024-08-06 08:38:09,862][52671] DAMAGECOUNT value on done: 1010679.0 [2024-08-06 08:38:09,863][52671] Sum rewards: 65.810, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.454', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.070', 'weapon5': '0.090', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.520', 'WEAPON3': '1.300', 'weapon3': '3.036', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '55.000'} [2024-08-06 08:38:10,041][52669] DAMAGECOUNT value on done: 1007457.0 [2024-08-06 08:38:10,041][52669] Sum rewards: 68.014, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon4': '0.056', 'weapon5': '0.080', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.294', 'weapon2': '0.298', 'WEAPON3': '1.650', 'weapon3': '3.322', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '58.000'} [2024-08-06 08:38:10,136][52647] DAMAGECOUNT value on done: 1059737.0 [2024-08-06 08:38:10,136][52647] Sum rewards: 62.488, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.305', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.144', 'AMMO4': '0.180', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.558', 'WEAPON3': '1.300', 'weapon3': '2.994', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.000'} [2024-08-06 08:38:10,228][52658] DAMAGECOUNT value on done: 1002353.0 [2024-08-06 08:38:10,228][52658] Sum rewards: 67.299, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.085', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'weapon4': '0.074', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '3.140', 'weapon3': '3.274', 'DAMAGECOUNT': '15.918', 'FRAGCOUNT': '55.000'} [2024-08-06 08:38:10,426][52650] Updated weights for policy 0, policy_version 85671 (0.0015) [2024-08-06 08:38:11,104][52803] DAMAGECOUNT value on done: 925079.0 [2024-08-06 08:38:11,106][52803] Sum rewards: 77.059, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.064', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.152', 'weapon4': '0.210', 'weapon2': '0.486', 'WEAPON3': '1.000', 'weapon3': '3.092', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:11,512][52663] DAMAGECOUNT value on done: 1007699.0 [2024-08-06 08:38:11,512][52663] Sum rewards: 79.612, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.662', 'AMMO5': '0.021', 'AMMO2': '0.053', 'AMMO3': '0.224', 'AMMO4': '0.267', 'weapon2': '0.278', 'weapon5': '0.282', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.750', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '64.500'} [2024-08-06 08:38:12,678][52671] DAMAGECOUNT value on done: 1005584.0 [2024-08-06 08:38:12,679][52671] Sum rewards: 81.990, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.476', 'AMMO5': '0.006', 'AMMO2': '0.007', 'AMMO4': '0.037', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.194', 'weapon2': '0.270', 'weapon4': '0.296', 'WEAPON3': '1.250', 'weapon3': '3.108', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '67.000'} [2024-08-06 08:38:12,729][52647] DAMAGECOUNT value on done: 1037704.0 [2024-08-06 08:38:12,729][52647] Sum rewards: 71.695, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.620', 'AMMO5': '0.017', 'AMMO2': '0.058', 'weapon5': '0.076', 'weapon2': '0.214', 'AMMO3': '0.219', 'AMMO4': '0.292', 'weapon4': '0.298', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.144', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '61.000'} [2024-08-06 08:38:12,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 701857792. Throughput: 0: 4360.9. Samples: 175473520. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:38:12,795][52567] Avg episode reward: [(0, '76.610')] [2024-08-06 08:38:12,845][52669] DAMAGECOUNT value on done: 1025018.0 [2024-08-06 08:38:12,846][52669] Sum rewards: 79.149, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.950', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.086', 'AMMO4': '0.090', 'AMMO3': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '0.950', 'weapon3': '3.322', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '63.000'} [2024-08-06 08:38:13,161][52663] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.04, 4.0), ('DAMAGECOUNT', 0.522, 174.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:38:13,202][52658] DAMAGECOUNT value on done: 989669.0 [2024-08-06 08:38:13,203][52658] Sum rewards: 76.556, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.769', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.041', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon4': '0.326', 'weapon2': '0.566', 'WEAPON3': '1.200', 'weapon3': '2.878', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:14,194][52663] DAMAGECOUNT value on done: 1000541.0 [2024-08-06 08:38:14,196][52663] Sum rewards: 75.747, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.698', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.088', 'AMMO4': '0.098', 'weapon5': '0.112', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.410', 'WEAPON3': '1.600', 'weapon3': '3.180', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '64.000'} [2024-08-06 08:38:14,245][52803] DAMAGECOUNT value on done: 942104.0 [2024-08-06 08:38:14,245][52803] Sum rewards: 66.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.760', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon5': '0.122', 'weapon4': '0.128', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.400', 'HITCOUNT': '3.070', 'weapon3': '3.186', 'DAMAGECOUNT': '16.641', 'FRAGCOUNT': '56.500'} [2024-08-06 08:38:14,580][52650] Updated weights for policy 0, policy_version 85681 (0.0012) [2024-08-06 08:38:15,488][52669] DAMAGECOUNT value on done: 1013915.0 [2024-08-06 08:38:15,488][52669] Sum rewards: 83.756, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.640', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.084', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.456', 'WEAPON3': '1.450', 'weapon3': '3.254', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '70.000'} [2024-08-06 08:38:15,565][52647] DAMAGECOUNT value on done: 1052570.0 [2024-08-06 08:38:15,565][52647] Sum rewards: 72.760, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.007', 'AMMO2': '0.034', 'weapon4': '0.082', 'weapon5': '0.092', 'WEAPON5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.380', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:15,640][52671] DAMAGECOUNT value on done: 1010628.0 [2024-08-06 08:38:15,640][52671] Sum rewards: 75.878, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.865', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.166', 'weapon4': '0.184', 'AMMO3': '0.189', 'weapon2': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.292', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '61.000'} [2024-08-06 08:38:15,842][52658] DAMAGECOUNT value on done: 1006146.0 [2024-08-06 08:38:15,842][52658] Sum rewards: 85.503, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.255', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO3': '0.152', 'AMMO4': '0.190', 'weapon2': '0.236', 'weapon5': '0.280', 'weapon4': '0.474', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.696', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.943', 'FRAGCOUNT': '67.000'} [2024-08-06 08:38:16,597][52663] DAMAGECOUNT value on done: 985297.0 [2024-08-06 08:38:16,599][52663] Sum rewards: 76.902, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.370', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.052', 'weapon5': '0.112', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.414', 'WEAPON3': '1.700', 'weapon3': '3.184', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:17,016][52794] DAMAGECOUNT value on done: 994939.0 [2024-08-06 08:38:17,017][52794] Sum rewards: 70.410, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.366', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.088', 'AMMO3': '0.150', 'AMMO4': '0.154', 'weapon5': '0.174', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '0.950', 'weapon3': '3.006', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.232', 'FRAGCOUNT': '56.000'} [2024-08-06 08:38:17,350][52803] DAMAGECOUNT value on done: 926419.0 [2024-08-06 08:38:17,353][52803] Sum rewards: 87.255, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.989', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.054', 'weapon5': '0.122', 'AMMO4': '0.132', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.444', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.309', 'FRAGCOUNT': '71.000'} [2024-08-06 08:38:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 701956096. Throughput: 0: 4363.1. Samples: 175486690. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:38:17,794][52567] Avg episode reward: [(0, '76.779')] [2024-08-06 08:38:18,370][52671] DAMAGECOUNT value on done: 995057.0 [2024-08-06 08:38:18,371][52671] Sum rewards: 82.895, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.064', 'weapon5': '0.168', 'AMMO4': '0.172', 'AMMO3': '0.203', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '69.000'} [2024-08-06 08:38:18,372][52669] DAMAGECOUNT value on done: 1011459.0 [2024-08-06 08:38:18,373][52669] Sum rewards: 85.467, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.068', 'weapon5': '0.110', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.258', 'AMMO3': '0.287', 'WEAPON3': '1.650', 'weapon3': '3.274', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '73.000'} [2024-08-06 08:38:18,499][52658] DAMAGECOUNT value on done: 999299.0 [2024-08-06 08:38:18,501][52658] Sum rewards: 75.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.852', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.080', 'weapon5': '0.126', 'AMMO4': '0.195', 'weapon2': '0.242', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.286', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '63.000'} [2024-08-06 08:38:18,705][52647] DAMAGECOUNT value on done: 1045766.0 [2024-08-06 08:38:18,708][52647] Sum rewards: 72.548, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.523', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.048', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.204', 'weapon4': '0.364', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:19,579][52650] Updated weights for policy 0, policy_version 85691 (0.0038) [2024-08-06 08:38:19,611][52663] DAMAGECOUNT value on done: 996783.0 [2024-08-06 08:38:19,612][52663] Sum rewards: 70.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.974', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.106', 'AMMO4': '0.115', 'weapon4': '0.166', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.634', 'WEAPON3': '1.150', 'weapon3': '2.828', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '57.000'} [2024-08-06 08:38:19,783][52794] DAMAGECOUNT value on done: 1003103.0 [2024-08-06 08:38:19,784][52794] Sum rewards: 72.308, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.107', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.074', 'weapon4': '0.104', 'AMMO4': '0.141', 'AMMO3': '0.186', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '3.050', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.410', 'FRAGCOUNT': '59.000'} [2024-08-06 08:38:20,510][52803] DAMAGECOUNT value on done: 935798.0 [2024-08-06 08:38:20,511][52803] Sum rewards: 69.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.557', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.114', 'weapon4': '0.170', 'AMMO4': '0.183', 'AMMO3': '0.215', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.896', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '57.000'} [2024-08-06 08:38:21,090][52669] DAMAGECOUNT value on done: 1015157.0 [2024-08-06 08:38:21,090][52669] Sum rewards: 81.228, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.416', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon5': '0.138', 'AMMO3': '0.198', 'weapon4': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.654', 'WEAPON3': '1.250', 'weapon3': '2.736', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:21,661][52658] DAMAGECOUNT value on done: 996489.0 [2024-08-06 08:38:21,666][52658] Sum rewards: 79.733, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.704', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.038', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'weapon2': '0.212', 'AMMO3': '0.291', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.484', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '21.312', 'FRAGCOUNT': '67.000'} [2024-08-06 08:38:21,887][52647] DAMAGECOUNT value on done: 1047372.0 [2024-08-06 08:38:21,888][52647] Sum rewards: 72.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.680', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.024', 'weapon5': '0.036', 'AMMO4': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon2': '0.560', 'WEAPON3': '1.100', 'weapon3': '3.230', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '59.000'} [2024-08-06 08:38:22,361][52663] DAMAGECOUNT value on done: 994086.0 [2024-08-06 08:38:22,363][52663] Sum rewards: 83.981, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.301', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.170', 'AMMO4': '0.177', 'AMMO3': '0.192', 'weapon4': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.472', 'FRAGCOUNT': '67.000'} [2024-08-06 08:38:22,386][52820] DAMAGECOUNT value on done: 922800.0 [2024-08-06 08:38:22,388][52820] Sum rewards: 75.048, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.030', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.068', 'weapon5': '0.172', 'AMMO4': '0.176', 'AMMO3': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.074', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '64.000'} [2024-08-06 08:38:22,565][52794] DAMAGECOUNT value on done: 1009849.0 [2024-08-06 08:38:22,566][52794] Sum rewards: 80.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'WEAPON1': '0.020', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.072', 'AMMO4': '0.176', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.706', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 702038016. Throughput: 0: 4366.9. Samples: 175512730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:38:22,795][52567] Avg episode reward: [(0, '77.324')] [2024-08-06 08:38:23,584][52803] DAMAGECOUNT value on done: 935610.0 [2024-08-06 08:38:23,584][52803] Sum rewards: 67.078, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.025', 'weapon5': '0.058', 'AMMO4': '0.126', 'AMMO3': '0.133', 'WEAPON5': '0.150', 'weapon4': '0.192', 'WEAPON4': '0.200', 'HEALTH': '0.362', 'WEAPON3': '0.750', 'weapon2': '0.856', 'weapon3': '2.704', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '52.500'} [2024-08-06 08:38:23,763][52669] DAMAGECOUNT value on done: 1015824.0 [2024-08-06 08:38:23,765][52669] Sum rewards: 64.489, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.410', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.077', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.484', 'DAMAGECOUNT': '14.949', 'FRAGCOUNT': '52.000'} [2024-08-06 08:38:24,082][52650] Updated weights for policy 0, policy_version 85701 (0.0027) [2024-08-06 08:38:24,390][52647] DAMAGECOUNT value on done: 1046783.0 [2024-08-06 08:38:24,390][52647] Sum rewards: 74.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.066', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.418', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.399', 'FRAGCOUNT': '61.000'} [2024-08-06 08:38:24,732][52658] DAMAGECOUNT value on done: 1005423.0 [2024-08-06 08:38:24,732][52658] Sum rewards: 71.086, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.624', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.072', 'weapon5': '0.194', 'AMMO3': '0.256', 'AMMO4': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.496', 'WEAPON3': '1.550', 'weapon3': '2.970', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:25,182][52663] DAMAGECOUNT value on done: 1004120.0 [2024-08-06 08:38:25,183][52663] Sum rewards: 88.962, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.011', 'AMMO2': '0.033', 'HEALTH': '0.132', 'AMMO3': '0.143', 'weapon5': '0.152', 'AMMO4': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.286', 'weapon2': '0.428', 'WEAPON3': '0.850', 'weapon3': '2.826', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.837', 'FRAGCOUNT': '69.000'} [2024-08-06 08:38:25,266][52794] DAMAGECOUNT value on done: 996769.0 [2024-08-06 08:38:25,266][52794] Sum rewards: 74.653, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.116', 'weapon5': '0.126', 'AMMO3': '0.177', 'AMMO4': '0.255', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.052', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '59.000'} [2024-08-06 08:38:25,562][52820] DAMAGECOUNT value on done: 927360.0 [2024-08-06 08:38:25,565][52820] Sum rewards: 80.885, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.123', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.063', 'weapon5': '0.104', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.241', 'weapon4': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '2.984', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '68.000'} [2024-08-06 08:38:26,672][52803] DAMAGECOUNT value on done: 943115.0 [2024-08-06 08:38:26,674][52803] Sum rewards: 78.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.128', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.046', 'weapon5': '0.070', 'AMMO4': '0.083', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.606', 'WEAPON3': '1.200', 'weapon3': '3.026', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.407', 'FRAGCOUNT': '64.000'} [2024-08-06 08:38:26,825][52660] Large shaping reward 2.648 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.597, 199.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:38:26,989][52647] DAMAGECOUNT value on done: 1053581.0 [2024-08-06 08:38:26,990][52647] Sum rewards: 76.745, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.700', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.076', 'weapon5': '0.114', 'AMMO4': '0.121', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.124', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 702119936. Throughput: 0: 4363.1. Samples: 175538990. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:38:27,794][52567] Avg episode reward: [(0, '77.073')] [2024-08-06 08:38:27,810][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085708_702119936.pth... [2024-08-06 08:38:27,888][52663] DAMAGECOUNT value on done: 988739.0 [2024-08-06 08:38:27,888][52663] Sum rewards: 79.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.076', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.052', 'weapon5': '0.088', 'AMMO4': '0.131', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.488', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.905', 'FRAGCOUNT': '65.500'} [2024-08-06 08:38:27,954][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085197_697933824.pth [2024-08-06 08:38:28,359][52794] DAMAGECOUNT value on done: 991180.0 [2024-08-06 08:38:28,359][52794] Sum rewards: 75.297, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'HEALTH': '0.024', 'AMMO2': '0.035', 'weapon4': '0.104', 'weapon5': '0.130', 'AMMO4': '0.173', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.290', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '60.500'} [2024-08-06 08:38:28,832][52650] Updated weights for policy 0, policy_version 85711 (0.0028) [2024-08-06 08:38:28,950][52820] DAMAGECOUNT value on done: 929072.0 [2024-08-06 08:38:28,954][52820] Sum rewards: 81.575, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.400', 'AMMO5': '0.013', 'weapon4': '0.030', 'AMMO2': '0.046', 'weapon5': '0.052', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'AMMO4': '0.231', 'weapon2': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.454', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.993', 'FRAGCOUNT': '68.000'} [2024-08-06 08:38:29,588][52614] Signal inference workers to stop experience collection... (15750 times) [2024-08-06 08:38:29,589][52614] Signal inference workers to resume experience collection... (15750 times) [2024-08-06 08:38:29,662][52650] InferenceWorker_p0-w0: stopping experience collection (15750 times) [2024-08-06 08:38:29,662][52650] InferenceWorker_p0-w0: resuming experience collection (15750 times) [2024-08-06 08:38:29,690][52647] DAMAGECOUNT value on done: 1047729.0 [2024-08-06 08:38:29,690][52647] Sum rewards: 88.903, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.060', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.019', 'weapon5': '0.048', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.544', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.664', 'FRAGCOUNT': '71.000'} [2024-08-06 08:38:29,939][52803] DAMAGECOUNT value on done: 939163.0 [2024-08-06 08:38:29,940][52803] Sum rewards: 75.809, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.488', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.092', 'AMMO4': '0.106', 'weapon5': '0.166', 'WEAPON4': '0.200', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '64.000'} [2024-08-06 08:38:31,009][52794] DAMAGECOUNT value on done: 994913.0 [2024-08-06 08:38:31,009][52794] Sum rewards: 79.280, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon4': '0.144', 'weapon2': '0.224', 'AMMO3': '0.228', 'AMMO4': '0.275', 'weapon5': '0.382', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.882', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '19.557', 'FRAGCOUNT': '65.000'} [2024-08-06 08:38:31,166][52663] DAMAGECOUNT value on done: 988244.0 [2024-08-06 08:38:31,166][52663] Sum rewards: 95.749, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.744', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.084', 'AMMO4': '0.094', 'weapon5': '0.124', 'AMMO3': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.446', 'WEAPON3': '0.900', 'weapon3': '3.130', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.402', 'FRAGCOUNT': '75.000'} [2024-08-06 08:38:32,029][52820] DAMAGECOUNT value on done: 916890.0 [2024-08-06 08:38:32,029][52820] Sum rewards: 88.501, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.852', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.076', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.678', 'WEAPON3': '1.150', 'weapon3': '2.960', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.880', 'FRAGCOUNT': '71.000'} [2024-08-06 08:38:32,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 702210048. Throughput: 0: 4352.9. Samples: 175551560. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:38:32,794][52567] Avg episode reward: [(0, '77.293')] [2024-08-06 08:38:32,821][52647] DAMAGECOUNT value on done: 1054832.0 [2024-08-06 08:38:32,821][52647] Sum rewards: 78.643, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.540', 'AMMO5': '0.014', 'AMMO2': '0.051', 'weapon4': '0.076', 'weapon5': '0.116', 'AMMO3': '0.181', 'AMMO4': '0.254', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.366', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '65.000'} [2024-08-06 08:38:33,119][52803] DAMAGECOUNT value on done: 935231.0 [2024-08-06 08:38:33,127][52803] Sum rewards: 68.257, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.914', 'AMMO5': '0.013', 'AMMO2': '0.027', 'AMMO4': '0.132', 'AMMO3': '0.199', 'weapon5': '0.204', 'weapon4': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.714', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '55.000'} [2024-08-06 08:38:33,689][52650] Updated weights for policy 0, policy_version 85721 (0.0011) [2024-08-06 08:38:34,002][52794] DAMAGECOUNT value on done: 996328.0 [2024-08-06 08:38:34,003][52794] Sum rewards: 59.236, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.908', 'AMMO5': '0.016', 'AMMO2': '0.054', 'weapon4': '0.072', 'weapon5': '0.176', 'weapon2': '0.234', 'AMMO4': '0.271', 'AMMO3': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '2.790', 'weapon3': '3.206', 'DAMAGECOUNT': '14.244', 'FRAGCOUNT': '54.000'} [2024-08-06 08:38:34,119][52663] DAMAGECOUNT value on done: 994892.0 [2024-08-06 08:38:34,121][52663] Sum rewards: 77.482, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.104', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.044', 'weapon4': '0.080', 'AMMO4': '0.098', 'WEAPON5': '0.100', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:35,101][52820] DAMAGECOUNT value on done: 926668.0 [2024-08-06 08:38:35,102][52820] Sum rewards: 60.872, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.279', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.140', 'AMMO4': '0.148', 'AMMO3': '0.241', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.400', 'weapon3': '3.002', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.005', 'FRAGCOUNT': '52.000'} [2024-08-06 08:38:35,986][52647] DAMAGECOUNT value on done: 1054889.0 [2024-08-06 08:38:35,987][52647] Sum rewards: 82.463, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.723', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.124', 'weapon5': '0.172', 'AMMO3': '0.217', 'AMMO4': '0.222', 'weapon2': '0.440', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.778', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:36,727][52663] DAMAGECOUNT value on done: 996559.0 [2024-08-06 08:38:36,727][52663] Sum rewards: 76.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.774', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.148', 'AMMO4': '0.172', 'AMMO3': '0.203', 'weapon2': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.603', 'FRAGCOUNT': '63.000'} [2024-08-06 08:38:36,748][52794] DAMAGECOUNT value on done: 988900.0 [2024-08-06 08:38:36,748][52794] Sum rewards: 81.082, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.175', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.040', 'weapon4': '0.076', 'WEAPON5': '0.100', 'AMMO4': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon2': '0.264', 'WEAPON3': '1.150', 'weapon3': '3.482', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '65.000'} [2024-08-06 08:38:37,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 702300160. Throughput: 0: 4359.3. Samples: 175577930. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:38:37,795][52567] Avg episode reward: [(0, '77.038')] [2024-08-06 08:38:38,073][52650] Updated weights for policy 0, policy_version 85731 (0.0018) [2024-08-06 08:38:38,333][52820] DAMAGECOUNT value on done: 912880.0 [2024-08-06 08:38:38,335][52820] Sum rewards: 68.412, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.520', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.096', 'weapon5': '0.174', 'AMMO4': '0.187', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.273', 'weapon2': '0.326', 'WEAPON3': '1.550', 'weapon3': '3.102', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.196', 'FRAGCOUNT': '59.000'} [2024-08-06 08:38:39,152][52647] DAMAGECOUNT value on done: 1040542.0 [2024-08-06 08:38:39,153][52647] Sum rewards: 67.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.382', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.078', 'weapon5': '0.112', 'AMMO4': '0.114', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.470', 'WEAPON3': '1.500', 'weapon3': '3.062', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '59.500'} [2024-08-06 08:38:39,666][52663] DAMAGECOUNT value on done: 1000356.0 [2024-08-06 08:38:39,669][52663] Sum rewards: 71.455, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.636', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.130', 'weapon4': '0.148', 'AMMO3': '0.230', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'HITCOUNT': '3.190', 'weapon3': '3.220', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:39,889][52794] DAMAGECOUNT value on done: 1000742.0 [2024-08-06 08:38:39,890][52794] Sum rewards: 74.227, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.271', 'AMMO2': '0.003', 'AMMO4': '0.014', 'AMMO3': '0.208', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.492', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:41,717][52820] DAMAGECOUNT value on done: 920257.0 [2024-08-06 08:38:41,717][52820] Sum rewards: 74.985, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon2': '0.156', 'weapon5': '0.162', 'AMMO3': '0.179', 'AMMO4': '0.217', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.294', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '59.000'} [2024-08-06 08:38:42,128][52663] DAMAGECOUNT value on done: 998500.0 [2024-08-06 08:38:42,128][52663] Sum rewards: 76.370, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.880', 'AMMO5': '0.015', 'AMMO2': '0.062', 'weapon4': '0.164', 'weapon5': '0.182', 'AMMO3': '0.249', 'AMMO4': '0.310', 'weapon2': '0.454', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.884', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '64.000'} [2024-08-06 08:38:42,389][52647] DAMAGECOUNT value on done: 1052658.0 [2024-08-06 08:38:42,392][52647] Sum rewards: 88.790, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.048', 'AMMO4': '0.119', 'weapon5': '0.122', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.828', 'FRAGCOUNT': '72.000'} [2024-08-06 08:38:42,556][52794] DAMAGECOUNT value on done: 997415.0 [2024-08-06 08:38:42,557][52794] Sum rewards: 70.727, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.238', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.084', 'weapon4': '0.090', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.734', 'FRAGCOUNT': '56.000'} [2024-08-06 08:38:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 702382080. Throughput: 0: 4349.6. Samples: 175603870. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:38:42,794][52567] Avg episode reward: [(0, '76.648')] [2024-08-06 08:38:43,063][52650] Updated weights for policy 0, policy_version 85741 (0.0012) [2024-08-06 08:38:44,888][52663] DAMAGECOUNT value on done: 1002939.0 [2024-08-06 08:38:44,890][52663] Sum rewards: 75.364, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.775', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.096', 'weapon5': '0.112', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.426', 'WEAPON3': '1.150', 'HITCOUNT': '3.200', 'weapon3': '3.248', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:45,008][52820] DAMAGECOUNT value on done: 923123.0 [2024-08-06 08:38:45,008][52820] Sum rewards: 76.704, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.204', 'AMMO5': '0.015', 'AMMO2': '0.046', 'AMMO3': '0.174', 'weapon5': '0.174', 'AMMO4': '0.229', 'weapon4': '0.234', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '2.978', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '63.000'} [2024-08-06 08:38:45,191][52647] DAMAGECOUNT value on done: 1042119.0 [2024-08-06 08:38:45,193][52647] Sum rewards: 68.410, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.022', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.080', 'AMMO4': '0.136', 'AMMO3': '0.175', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.050', 'HITCOUNT': '3.100', 'weapon3': '3.178', 'DAMAGECOUNT': '17.799', 'FRAGCOUNT': '53.000'} [2024-08-06 08:38:45,570][52794] DAMAGECOUNT value on done: 989488.0 [2024-08-06 08:38:45,571][52794] Sum rewards: 79.178, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.235', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.112', 'AMMO3': '0.138', 'weapon2': '0.438', 'WEAPON3': '0.950', 'weapon3': '3.356', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:46,021][52671] Large shaping reward -2.506 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:38:47,054][52670] DAMAGECOUNT value on done: 985555.0 [2024-08-06 08:38:47,055][52670] Sum rewards: 83.839, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.862', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.068', 'weapon5': '0.152', 'AMMO4': '0.226', 'AMMO3': '0.238', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.495', 'FRAGCOUNT': '70.000'} [2024-08-06 08:38:47,614][52650] Updated weights for policy 0, policy_version 85751 (0.0015) [2024-08-06 08:38:47,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 702472192. Throughput: 0: 4358.5. Samples: 175617150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:38:47,794][52567] Avg episode reward: [(0, '76.386')] [2024-08-06 08:38:47,842][52647] DAMAGECOUNT value on done: 1045467.0 [2024-08-06 08:38:47,843][52647] Sum rewards: 81.319, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.540', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon4': '0.094', 'AMMO4': '0.204', 'weapon5': '0.210', 'AMMO3': '0.235', 'WEAPON4': '0.450', 'weapon2': '0.526', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.914', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '67.000'} [2024-08-06 08:38:47,967][52663] DAMAGECOUNT value on done: 1010692.0 [2024-08-06 08:38:47,969][52663] Sum rewards: 74.171, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.945', 'AMMO5': '0.015', 'AMMO2': '0.043', 'AMMO3': '0.169', 'weapon5': '0.184', 'AMMO4': '0.214', 'weapon2': '0.316', 'weapon4': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.954', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:48,117][52820] DAMAGECOUNT value on done: 928900.0 [2024-08-06 08:38:48,119][52820] Sum rewards: 78.451, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.516', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon4': '0.114', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.274', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:48,184][52794] DAMAGECOUNT value on done: 1004157.0 [2024-08-06 08:38:48,185][52794] Sum rewards: 78.133, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.890', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon5': '0.140', 'AMMO4': '0.160', 'weapon4': '0.178', 'weapon2': '0.222', 'WEAPON5': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.204', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:49,808][52670] DAMAGECOUNT value on done: 1005656.0 [2024-08-06 08:38:49,810][52670] Sum rewards: 74.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.110', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon5': '0.096', 'AMMO4': '0.140', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '62.000'} [2024-08-06 08:38:50,982][52794] DAMAGECOUNT value on done: 998208.0 [2024-08-06 08:38:50,982][52794] Sum rewards: 71.956, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.786', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.148', 'AMMO3': '0.162', 'AMMO4': '0.167', 'weapon4': '0.192', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '2.916', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '58.000'} [2024-08-06 08:38:51,074][52663] DAMAGECOUNT value on done: 987954.0 [2024-08-06 08:38:51,074][52663] Sum rewards: 71.346, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.054', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon5': '0.094', 'weapon4': '0.140', 'AMMO4': '0.151', 'weapon2': '0.170', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.300', 'HITCOUNT': '3.290', 'weapon3': '3.436', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:51,115][52820] DAMAGECOUNT value on done: 936649.0 [2024-08-06 08:38:51,115][52820] Sum rewards: 75.018, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.257', 'AMMO2': '0.004', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO4': '0.018', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.286', 'weapon2': '0.368', 'WEAPON3': '1.750', 'weapon3': '3.354', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '65.000'} [2024-08-06 08:38:52,282][52650] Updated weights for policy 0, policy_version 85761 (0.0028) [2024-08-06 08:38:52,715][52670] DAMAGECOUNT value on done: 986183.0 [2024-08-06 08:38:52,719][52670] Sum rewards: 75.898, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.094', 'AMMO5': '0.019', 'AMMO2': '0.044', 'weapon4': '0.174', 'weapon5': '0.216', 'AMMO4': '0.221', 'AMMO3': '0.288', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '2.988', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '66.000'} [2024-08-06 08:38:52,764][52795] DAMAGECOUNT value on done: 920639.0 [2024-08-06 08:38:52,765][52795] Sum rewards: 76.291, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.766', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon2': '0.154', 'weapon5': '0.166', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '63.000'} [2024-08-06 08:38:52,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 702554112. Throughput: 0: 4354.0. Samples: 175643310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:38:52,794][52567] Avg episode reward: [(0, '76.360')] [2024-08-06 08:38:53,877][52794] DAMAGECOUNT value on done: 1010914.0 [2024-08-06 08:38:53,877][52794] Sum rewards: 85.394, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.898', 'AMMO5': '0.023', 'AMMO2': '0.052', 'AMMO3': '0.235', 'weapon5': '0.244', 'AMMO4': '0.259', 'weapon4': '0.280', 'weapon2': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.934', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.931', 'FRAGCOUNT': '71.000'} [2024-08-06 08:38:54,179][52820] DAMAGECOUNT value on done: 918056.0 [2024-08-06 08:38:54,181][52820] Sum rewards: 77.421, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.380', 'weapon4': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.472', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '63.000'} [2024-08-06 08:38:55,710][52670] DAMAGECOUNT value on done: 988517.0 [2024-08-06 08:38:55,710][52670] Sum rewards: 63.771, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.660', 'AMMO5': '0.025', 'AMMO2': '0.058', 'AMMO3': '0.231', 'AMMO4': '0.288', 'weapon5': '0.306', 'weapon2': '0.514', 'weapon4': '0.532', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.300', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '53.000'} [2024-08-06 08:38:55,738][52666] DAMAGECOUNT value on done: 997581.0 [2024-08-06 08:38:55,739][52666] Sum rewards: 76.054, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.710', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.174', 'weapon5': '0.220', 'AMMO4': '0.242', 'weapon4': '0.394', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '2.578', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '60.000'} [2024-08-06 08:38:55,916][52795] DAMAGECOUNT value on done: 915061.0 [2024-08-06 08:38:55,917][52795] Sum rewards: 67.630, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.440', 'WEAPON1': '0.010', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.136', 'AMMO3': '0.165', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.150', 'HITCOUNT': '2.750', 'weapon3': '3.250', 'DAMAGECOUNT': '15.393', 'FRAGCOUNT': '55.000'} [2024-08-06 08:38:57,089][52794] DAMAGECOUNT value on done: 993282.0 [2024-08-06 08:38:57,090][52794] Sum rewards: 71.872, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.784', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon5': '0.108', 'weapon4': '0.126', 'AMMO4': '0.174', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '58.500'} [2024-08-06 08:38:57,117][52650] Updated weights for policy 0, policy_version 85771 (0.0012) [2024-08-06 08:38:57,383][52820] DAMAGECOUNT value on done: 931013.0 [2024-08-06 08:38:57,385][52820] Sum rewards: 66.866, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.199', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.072', 'AMMO4': '0.142', 'weapon5': '0.166', 'AMMO3': '0.261', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.600', 'weapon3': '3.070', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '58.000'} [2024-08-06 08:38:57,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 702644224. Throughput: 0: 4352.2. Samples: 175669370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:38:57,795][52567] Avg episode reward: [(0, '76.025')] [2024-08-06 08:38:58,176][52670] DAMAGECOUNT value on done: 1000401.0 [2024-08-06 08:38:58,178][52670] Sum rewards: 76.000, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.039', 'AMMO5': '0.008', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.148', 'weapon4': '0.158', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.006', 'FRAGCOUNT': '61.000'} [2024-08-06 08:38:58,250][52666] DAMAGECOUNT value on done: 999208.0 [2024-08-06 08:38:58,251][52666] Sum rewards: 86.406, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.084', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'AMMO4': '0.151', 'weapon5': '0.186', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.250', 'weapon3': '3.258', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.835', 'FRAGCOUNT': '69.000'} [2024-08-06 08:38:59,066][52795] DAMAGECOUNT value on done: 916759.0 [2024-08-06 08:38:59,068][52795] Sum rewards: 77.360, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.579', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon5': '0.138', 'AMMO3': '0.185', 'weapon2': '0.194', 'weapon4': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:00,142][52794] DAMAGECOUNT value on done: 1003475.0 [2024-08-06 08:39:00,142][52794] Sum rewards: 78.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.350', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon5': '0.014', 'weapon4': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.182', 'weapon2': '0.456', 'WEAPON3': '1.150', 'weapon3': '3.324', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:00,230][52668] DAMAGECOUNT value on done: 1009343.0 [2024-08-06 08:39:00,231][52668] Sum rewards: 71.392, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.730', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.098', 'weapon5': '0.158', 'AMMO3': '0.163', 'AMMO4': '0.281', 'weapon2': '0.406', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '3.028', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:00,631][52820] DAMAGECOUNT value on done: 943653.0 [2024-08-06 08:39:00,631][52820] Sum rewards: 90.941, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.490', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.068', 'weapon4': '0.102', 'AMMO4': '0.111', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.206', 'WEAPON3': '1.250', 'weapon3': '3.434', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.765', 'FRAGCOUNT': '73.000'} [2024-08-06 08:39:00,970][52670] DAMAGECOUNT value on done: 990178.0 [2024-08-06 08:39:00,971][52670] Sum rewards: 82.886, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.260', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.024', 'AMMO4': '0.037', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.261', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.250', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.115', 'FRAGCOUNT': '70.000'} [2024-08-06 08:39:01,004][52666] DAMAGECOUNT value on done: 1004565.0 [2024-08-06 08:39:01,006][52666] Sum rewards: 76.671, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.850', 'AMMO5': '0.016', 'AMMO2': '0.048', 'weapon4': '0.084', 'weapon5': '0.128', 'AMMO3': '0.238', 'AMMO4': '0.241', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:02,049][52650] Updated weights for policy 0, policy_version 85781 (0.0030) [2024-08-06 08:39:02,374][52795] DAMAGECOUNT value on done: 932895.0 [2024-08-06 08:39:02,375][52795] Sum rewards: 80.131, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.637', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.108', 'AMMO4': '0.127', 'weapon4': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '69.000'} [2024-08-06 08:39:02,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 702734336. Throughput: 0: 4348.9. Samples: 175682390. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:39:02,794][52567] Avg episode reward: [(0, '76.397')] [2024-08-06 08:39:03,197][52668] DAMAGECOUNT value on done: 1006688.0 [2024-08-06 08:39:03,198][52668] Sum rewards: 67.468, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.340', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.113', 'weapon2': '0.114', 'AMMO3': '0.186', 'weapon4': '0.706', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '55.000'} [2024-08-06 08:39:03,211][52794] DAMAGECOUNT value on done: 999777.0 [2024-08-06 08:39:03,212][52794] Sum rewards: 85.813, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.095', 'AMMO5': '0.018', 'AMMO2': '0.032', 'AMMO4': '0.161', 'weapon4': '0.164', 'weapon5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.072', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '71.000'} [2024-08-06 08:39:03,364][52670] DAMAGECOUNT value on done: 986318.0 [2024-08-06 08:39:03,366][52670] Sum rewards: 80.409, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.139', 'AMMO5': '0.014', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon4': '0.126', 'AMMO3': '0.150', 'WEAPON4': '0.150', 'weapon5': '0.172', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '0.950', 'weapon3': '3.132', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:03,436][52666] DAMAGECOUNT value on done: 998628.0 [2024-08-06 08:39:03,437][52666] Sum rewards: 80.474, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.080', 'AMMO5': '0.012', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.210', 'weapon5': '0.218', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '2.754', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:03,761][52820] DAMAGECOUNT value on done: 930186.0 [2024-08-06 08:39:03,762][52820] Sum rewards: 77.779, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.872', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.092', 'AMMO4': '0.195', 'weapon5': '0.208', 'weapon2': '0.226', 'AMMO3': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.140', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '66.000'} [2024-08-06 08:39:05,588][52795] DAMAGECOUNT value on done: 917565.0 [2024-08-06 08:39:05,588][52795] Sum rewards: 81.213, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.100', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.109', 'weapon5': '0.112', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.488', 'WEAPON3': '1.550', 'weapon3': '3.080', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:05,807][52647] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon5', 0.002)] [2024-08-06 08:39:06,206][52668] DAMAGECOUNT value on done: 1002087.0 [2024-08-06 08:39:06,206][52668] Sum rewards: 71.815, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.130', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.158', 'AMMO4': '0.207', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.550', 'weapon3': '2.974', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:06,265][52670] DAMAGECOUNT value on done: 989245.0 [2024-08-06 08:39:06,267][52670] Sum rewards: 80.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.788', 'AMMO5': '0.008', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.116', 'weapon4': '0.164', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.346', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:06,340][52794] DAMAGECOUNT value on done: 1008349.0 [2024-08-06 08:39:06,340][52794] Sum rewards: 91.551, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.950', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'weapon3': '3.456', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.462', 'FRAGCOUNT': '76.000'} [2024-08-06 08:39:06,390][52666] DAMAGECOUNT value on done: 991501.0 [2024-08-06 08:39:06,390][52666] Sum rewards: 76.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.088', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.052', 'weapon5': '0.076', 'AMMO4': '0.218', 'weapon2': '0.224', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.446', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:06,738][52650] Updated weights for policy 0, policy_version 85791 (0.0028) [2024-08-06 08:39:06,911][52820] DAMAGECOUNT value on done: 928204.0 [2024-08-06 08:39:06,914][52820] Sum rewards: 72.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.855', 'AMMO5': '0.020', 'AMMO2': '0.055', 'AMMO3': '0.198', 'weapon2': '0.226', 'AMMO4': '0.277', 'weapon5': '0.280', 'weapon4': '0.458', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.602', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 702816256. Throughput: 0: 4357.1. Samples: 175708800. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:39:07,795][52567] Avg episode reward: [(0, '76.775')] [2024-08-06 08:39:08,798][52795] DAMAGECOUNT value on done: 919621.0 [2024-08-06 08:39:08,800][52795] Sum rewards: 86.803, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.138', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.176', 'weapon5': '0.214', 'weapon2': '0.330', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.592', 'WEAPON3': '1.150', 'weapon3': '2.634', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '69.000'} [2024-08-06 08:39:09,063][52668] DAMAGECOUNT value on done: 1007918.0 [2024-08-06 08:39:09,064][52668] Sum rewards: 69.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.260', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.138', 'AMMO4': '0.191', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.098', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.508', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:09,078][52670] DAMAGECOUNT value on done: 987134.0 [2024-08-06 08:39:09,079][52670] Sum rewards: 81.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.555', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.054', 'AMMO4': '0.099', 'weapon5': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.196', 'WEAPON3': '1.250', 'weapon3': '3.432', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:09,249][52794] DAMAGECOUNT value on done: 1013287.0 [2024-08-06 08:39:09,249][52794] Sum rewards: 80.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.039', 'AMMO5': '0.017', 'AMMO2': '0.045', 'AMMO3': '0.209', 'weapon5': '0.214', 'AMMO4': '0.224', 'weapon2': '0.236', 'weapon4': '0.310', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:09,281][52666] DAMAGECOUNT value on done: 992903.0 [2024-08-06 08:39:09,282][52666] Sum rewards: 66.691, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.016', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon4': '0.058', 'weapon5': '0.166', 'weapon2': '0.200', 'AMMO4': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.338', 'WEAPON3': '2.000', 'weapon3': '3.262', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.354', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:10,031][52820] DAMAGECOUNT value on done: 931117.0 [2024-08-06 08:39:10,032][52820] Sum rewards: 81.247, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.053', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.036', 'AMMO4': '0.074', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.166', 'AMMO3': '0.236', 'WEAPON3': '1.550', 'weapon3': '3.548', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:10,578][52671] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:39:10,872][52650] Updated weights for policy 0, policy_version 85801 (0.0013) [2024-08-06 08:39:11,323][52667] Large shaping reward -2.503 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0), ('weapon5', 0.002)] [2024-08-06 08:39:11,636][52670] DAMAGECOUNT value on done: 985858.0 [2024-08-06 08:39:11,638][52670] Sum rewards: 62.096, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.108', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.060', 'weapon4': '0.072', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.211', 'weapon2': '0.386', 'WEAPON3': '1.400', 'HITCOUNT': '3.120', 'weapon3': '3.244', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '52.000'} [2024-08-06 08:39:11,758][52666] DAMAGECOUNT value on done: 995384.0 [2024-08-06 08:39:11,760][52666] Sum rewards: 76.938, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.270', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.052', 'AMMO4': '0.108', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.200', 'weapon3': '3.242', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.570', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:11,820][52665] DAMAGECOUNT value on done: 987935.0 [2024-08-06 08:39:11,820][52665] Sum rewards: 68.484, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.196', 'AMMO5': '0.010', 'AMMO2': '0.050', 'weapon5': '0.160', 'weapon2': '0.198', 'AMMO4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.267', 'weapon4': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.028', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:11,940][52795] DAMAGECOUNT value on done: 932331.0 [2024-08-06 08:39:11,940][52795] Sum rewards: 73.783, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.826', 'AMMO5': '0.007', 'AMMO2': '0.021', 'AMMO4': '0.106', 'weapon4': '0.128', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.494', 'WEAPON3': '1.350', 'weapon3': '3.008', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '62.000'} [2024-08-06 08:39:12,098][52668] DAMAGECOUNT value on done: 994004.0 [2024-08-06 08:39:12,098][52668] Sum rewards: 73.638, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.593', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.160', 'AMMO3': '0.166', 'AMMO4': '0.213', 'weapon2': '0.280', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.102', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '58.000'} [2024-08-06 08:39:12,270][52794] DAMAGECOUNT value on done: 1001463.0 [2024-08-06 08:39:12,273][52794] Sum rewards: 69.427, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.673', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.060', 'weapon4': '0.126', 'WEAPON5': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'weapon2': '0.800', 'WEAPON3': '1.100', 'weapon3': '2.848', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.714', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:12,794][52567] Fps is (10 sec: 16383.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 702898176. Throughput: 0: 4354.7. Samples: 175734950. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:39:12,802][52567] Avg episode reward: [(0, '76.459')] [2024-08-06 08:39:13,100][52820] DAMAGECOUNT value on done: 929767.0 [2024-08-06 08:39:13,105][52820] Sum rewards: 89.309, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.202', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'AMMO4': '0.189', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '73.000'} [2024-08-06 08:39:13,162][52811] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:39:14,586][52670] DAMAGECOUNT value on done: 1002284.0 [2024-08-06 08:39:14,586][52670] Sum rewards: 82.338, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.168', 'AMMO4': '0.188', 'weapon5': '0.188', 'weapon2': '0.236', 'AMMO3': '0.243', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.156', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:14,765][52666] DAMAGECOUNT value on done: 987288.0 [2024-08-06 08:39:14,766][52666] Sum rewards: 72.207, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.544', 'AMMO5': '0.018', 'AMMO2': '0.022', 'AMMO4': '0.109', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'weapon2': '0.310', 'weapon5': '0.346', 'WEAPON5': '0.350', 'weapon4': '0.406', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '58.000'} [2024-08-06 08:39:14,862][52668] DAMAGECOUNT value on done: 1006865.0 [2024-08-06 08:39:14,863][52668] Sum rewards: 80.059, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.494', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.074', 'weapon5': '0.090', 'AMMO4': '0.116', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:14,995][52665] DAMAGECOUNT value on done: 1000371.0 [2024-08-06 08:39:14,996][52665] Sum rewards: 93.035, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.164', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.082', 'weapon5': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.258', 'weapon2': '0.352', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.777', 'FRAGCOUNT': '77.000'} [2024-08-06 08:39:15,045][52795] DAMAGECOUNT value on done: 923642.0 [2024-08-06 08:39:15,045][52795] Sum rewards: 76.606, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.415', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.146', 'weapon4': '0.154', 'AMMO4': '0.192', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '64.500'} [2024-08-06 08:39:15,974][52650] Updated weights for policy 0, policy_version 85811 (0.0026) [2024-08-06 08:39:16,393][52820] DAMAGECOUNT value on done: 937817.0 [2024-08-06 08:39:16,394][52820] Sum rewards: 84.298, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.356', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon4': '0.066', 'weapon5': '0.164', 'AMMO4': '0.208', 'AMMO3': '0.299', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.064', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '21.339', 'FRAGCOUNT': '73.000'} [2024-08-06 08:39:17,501][52668] DAMAGECOUNT value on done: 1004652.0 [2024-08-06 08:39:17,504][52668] Sum rewards: 74.416, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.844', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon4': '0.076', 'weapon5': '0.080', 'AMMO3': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.554', 'WEAPON3': '0.950', 'weapon3': '3.148', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.890', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 702996480. Throughput: 0: 4366.4. Samples: 175748050. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:39:17,794][52567] Avg episode reward: [(0, '76.892')] [2024-08-06 08:39:17,859][52670] DAMAGECOUNT value on done: 982329.0 [2024-08-06 08:39:17,861][52670] Sum rewards: 93.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.505', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.132', 'weapon5': '0.154', 'AMMO3': '0.194', 'AMMO4': '0.251', 'weapon2': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.072', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.910', 'FRAGCOUNT': '76.000'} [2024-08-06 08:39:17,979][52666] DAMAGECOUNT value on done: 1001602.0 [2024-08-06 08:39:17,979][52666] Sum rewards: 71.711, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.405', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.162', 'AMMO3': '0.217', 'weapon4': '0.226', 'weapon2': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '60.500'} [2024-08-06 08:39:18,024][52665] DAMAGECOUNT value on done: 993325.0 [2024-08-06 08:39:18,024][52665] Sum rewards: 75.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon5': '0.036', 'AMMO4': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.197', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '62.000'} [2024-08-06 08:39:18,124][52795] DAMAGECOUNT value on done: 924067.0 [2024-08-06 08:39:18,127][52795] Sum rewards: 68.958, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.670', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.033', 'WEAPON4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.167', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.460', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.188', 'DAMAGECOUNT': '16.122', 'FRAGCOUNT': '56.000'} [2024-08-06 08:39:18,528][52664] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:39:19,579][52820] DAMAGECOUNT value on done: 939559.0 [2024-08-06 08:39:19,583][52820] Sum rewards: 96.119, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.406', 'AMMO5': '0.010', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'weapon2': '0.274', 'weapon4': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '4.260', 'DAMAGECOUNT': '22.293', 'FRAGCOUNT': '79.000'} [2024-08-06 08:39:20,218][52670] DAMAGECOUNT value on done: 997146.0 [2024-08-06 08:39:20,220][52670] Sum rewards: 84.085, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.050', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon4': '0.168', 'AMMO3': '0.184', 'weapon2': '0.252', 'WEAPON3': '1.050', 'weapon3': '3.280', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:20,345][52666] DAMAGECOUNT value on done: 990144.0 [2024-08-06 08:39:20,345][52666] Sum rewards: 63.485, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.505', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.042', 'weapon5': '0.088', 'AMMO4': '0.111', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'weapon2': '0.498', 'WEAPON3': '1.650', 'weapon3': '3.136', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '56.000'} [2024-08-06 08:39:20,530][52650] Updated weights for policy 0, policy_version 85821 (0.0028) [2024-08-06 08:39:20,648][52668] DAMAGECOUNT value on done: 995797.0 [2024-08-06 08:39:20,649][52668] Sum rewards: 63.925, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.309', 'AMMO5': '0.018', 'AMMO2': '0.026', 'weapon4': '0.060', 'weapon5': '0.112', 'AMMO4': '0.128', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.311', 'FRAGCOUNT': '56.500'} [2024-08-06 08:39:21,103][52665] DAMAGECOUNT value on done: 996765.0 [2024-08-06 08:39:21,104][52665] Sum rewards: 78.216, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.990', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.082', 'weapon5': '0.082', 'AMMO4': '0.138', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.352', 'WEAPON3': '2.050', 'weapon3': '3.380', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.580', 'FRAGCOUNT': '69.000'} [2024-08-06 08:39:21,447][52667] DAMAGECOUNT value on done: 998623.0 [2024-08-06 08:39:21,449][52667] Sum rewards: 72.547, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.656', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon5': '0.082', 'weapon4': '0.092', 'AMMO4': '0.113', 'WEAPON5': '0.150', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.080', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:21,652][52795] DAMAGECOUNT value on done: 931264.0 [2024-08-06 08:39:21,655][52795] Sum rewards: 74.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.782', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.072', 'AMMO4': '0.122', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.568', 'WEAPON3': '1.000', 'weapon3': '3.098', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:22,754][52820] DAMAGECOUNT value on done: 924926.0 [2024-08-06 08:39:22,760][52820] Sum rewards: 77.211, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.925', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.034', 'weapon5': '0.114', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.338', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '62.500'} [2024-08-06 08:39:22,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 703086592. Throughput: 0: 4355.1. Samples: 175773910. Policy #0 lag: (min: 0.0, avg: 3.6, max: 8.0) [2024-08-06 08:39:22,795][52567] Avg episode reward: [(0, '76.997')] [2024-08-06 08:39:23,029][52670] DAMAGECOUNT value on done: 1001802.0 [2024-08-06 08:39:23,032][52670] Sum rewards: 76.865, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.605', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'AMMO4': '0.071', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.257', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.378', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:23,235][52666] DAMAGECOUNT value on done: 997666.0 [2024-08-06 08:39:23,236][52666] Sum rewards: 93.479, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.875', 'AMMO5': '0.007', 'AMMO2': '0.016', 'AMMO4': '0.080', 'weapon4': '0.096', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.360', 'WEAPON3': '1.200', 'weapon3': '3.234', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '22.581', 'FRAGCOUNT': '74.000'} [2024-08-06 08:39:23,613][52668] DAMAGECOUNT value on done: 999419.0 [2024-08-06 08:39:23,614][52668] Sum rewards: 78.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon4': '0.236', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.196', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:23,768][52665] DAMAGECOUNT value on done: 977426.0 [2024-08-06 08:39:23,768][52665] Sum rewards: 79.245, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.130', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.162', 'AMMO3': '0.200', 'weapon5': '0.260', 'weapon2': '0.280', 'AMMO4': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.042', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:24,161][52664] DAMAGECOUNT value on done: 1032045.0 [2024-08-06 08:39:24,162][52664] Sum rewards: 76.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.494', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.036', 'weapon5': '0.066', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.248', 'AMMO3': '0.257', 'WEAPON3': '1.500', 'weapon3': '3.450', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:24,267][52667] DAMAGECOUNT value on done: 1016816.0 [2024-08-06 08:39:24,267][52667] Sum rewards: 74.777, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.418', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon5': '0.144', 'AMMO4': '0.149', 'AMMO3': '0.153', 'weapon2': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.000', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '59.500'} [2024-08-06 08:39:24,741][52795] DAMAGECOUNT value on done: 927350.0 [2024-08-06 08:39:24,742][52795] Sum rewards: 74.673, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.980', 'AMMO5': '0.022', 'AMMO2': '0.055', 'weapon5': '0.116', 'weapon4': '0.146', 'AMMO3': '0.204', 'AMMO4': '0.274', 'weapon2': '0.542', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.150', 'weapon3': '2.912', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:24,771][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:39:25,404][52650] Updated weights for policy 0, policy_version 85831 (0.0023) [2024-08-06 08:39:26,271][52670] DAMAGECOUNT value on done: 994287.0 [2024-08-06 08:39:26,271][52670] Sum rewards: 89.809, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.534', 'AMMO5': '0.024', 'AMMO2': '0.065', 'weapon4': '0.116', 'AMMO3': '0.186', 'AMMO4': '0.323', 'weapon5': '0.362', 'weapon2': '0.560', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.710', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '21.117', 'FRAGCOUNT': '71.000'} [2024-08-06 08:39:26,471][52666] DAMAGECOUNT value on done: 980686.0 [2024-08-06 08:39:26,472][52666] Sum rewards: 71.562, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.988', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.116', 'AMMO4': '0.123', 'weapon5': '0.142', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.078', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:26,583][52664] Large shaping reward 2.533 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.504, 168.0), ('HEALTH', -0.003, -1.0), ('weapon5', 0.002)] [2024-08-06 08:39:26,678][52668] DAMAGECOUNT value on done: 1006448.0 [2024-08-06 08:39:26,680][52668] Sum rewards: 77.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.092', 'weapon5': '0.092', 'AMMO4': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.460', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '66.000'} [2024-08-06 08:39:26,836][52665] DAMAGECOUNT value on done: 979243.0 [2024-08-06 08:39:26,838][52665] Sum rewards: 74.276, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.112', 'AMMO4': '0.144', 'weapon4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.206', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.503', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:27,223][52664] DAMAGECOUNT value on done: 1038325.0 [2024-08-06 08:39:27,225][52664] Sum rewards: 67.818, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.074', 'AMMO5': '0.020', 'AMMO2': '0.049', 'weapon4': '0.096', 'AMMO3': '0.174', 'weapon5': '0.218', 'AMMO4': '0.246', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.666', 'WEAPON3': '1.050', 'weapon3': '2.746', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '54.500'} [2024-08-06 08:39:27,339][52667] DAMAGECOUNT value on done: 1010684.0 [2024-08-06 08:39:27,339][52667] Sum rewards: 83.075, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.080', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.044', 'AMMO4': '0.053', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.232', 'WEAPON3': '1.400', 'weapon3': '3.414', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 703168512. Throughput: 0: 4363.6. Samples: 175800230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:39:27,794][52567] Avg episode reward: [(0, '76.871')] [2024-08-06 08:39:27,973][52795] DAMAGECOUNT value on done: 916630.0 [2024-08-06 08:39:27,974][52795] Sum rewards: 79.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.816', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.128', 'AMMO3': '0.181', 'weapon4': '0.190', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.100', 'weapon3': '3.164', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:29,354][52670] DAMAGECOUNT value on done: 979309.0 [2024-08-06 08:39:29,356][52670] Sum rewards: 79.837, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.549', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.176', 'AMMO4': '0.181', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.560', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '66.000'} [2024-08-06 08:39:29,397][52665] DAMAGECOUNT value on done: 991914.0 [2024-08-06 08:39:29,398][52665] Sum rewards: 86.995, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.464', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.071', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.216', 'AMMO3': '0.256', 'WEAPON3': '1.500', 'weapon3': '3.354', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '21.273', 'FRAGCOUNT': '73.000'} [2024-08-06 08:39:29,548][52666] DAMAGECOUNT value on done: 1005941.0 [2024-08-06 08:39:29,550][52666] Sum rewards: 76.245, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.304', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:29,558][52668] DAMAGECOUNT value on done: 1000643.0 [2024-08-06 08:39:29,561][52668] Sum rewards: 68.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.864', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.140', 'weapon4': '0.182', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.320', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:30,227][52650] Updated weights for policy 0, policy_version 85841 (0.0013) [2024-08-06 08:39:30,229][52667] DAMAGECOUNT value on done: 1014712.0 [2024-08-06 08:39:30,230][52667] Sum rewards: 74.102, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.990', 'AMMO5': '0.026', 'AMMO2': '0.055', 'weapon4': '0.136', 'weapon5': '0.178', 'AMMO3': '0.230', 'AMMO4': '0.274', 'weapon2': '0.338', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:30,258][52664] DAMAGECOUNT value on done: 1043951.0 [2024-08-06 08:39:30,258][52664] Sum rewards: 70.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.015', 'AMMO2': '0.055', 'AMMO3': '0.215', 'weapon5': '0.242', 'weapon4': '0.260', 'AMMO4': '0.277', 'weapon2': '0.332', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:31,082][52795] DAMAGECOUNT value on done: 923587.0 [2024-08-06 08:39:31,084][52795] Sum rewards: 70.797, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.698', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon2': '0.194', 'AMMO4': '0.200', 'AMMO3': '0.207', 'weapon5': '0.322', 'weapon4': '0.482', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '17.286', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:32,261][52665] DAMAGECOUNT value on done: 991346.0 [2024-08-06 08:39:32,261][52665] Sum rewards: 91.165, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.940', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.164', 'AMMO3': '0.187', 'weapon5': '0.252', 'AMMO4': '0.268', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.554', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '22.701', 'FRAGCOUNT': '72.000'} [2024-08-06 08:39:32,520][52670] DAMAGECOUNT value on done: 993879.0 [2024-08-06 08:39:32,520][52670] Sum rewards: 70.856, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.910', 'AMMO5': '0.011', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon4': '0.166', 'weapon5': '0.170', 'AMMO3': '0.185', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.488', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:32,717][52666] DAMAGECOUNT value on done: 1000942.0 [2024-08-06 08:39:32,718][52666] Sum rewards: 77.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.038', 'weapon5': '0.072', 'AMMO4': '0.096', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.270', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.484', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:32,785][52668] DAMAGECOUNT value on done: 999618.0 [2024-08-06 08:39:32,788][52668] Sum rewards: 81.570, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.515', 'AMMO5': '0.004', 'AMMO2': '0.026', 'weapon5': '0.038', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.270', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.148', 'FRAGCOUNT': '66.000'} [2024-08-06 08:39:32,794][52567] Fps is (10 sec: 16384.4, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 703250432. Throughput: 0: 4360.2. Samples: 175813360. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:39:32,794][52567] Avg episode reward: [(0, '77.223')] [2024-08-06 08:39:33,323][52667] DAMAGECOUNT value on done: 1017780.0 [2024-08-06 08:39:33,323][52667] Sum rewards: 69.365, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.444', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.180', 'weapon5': '0.182', 'weapon4': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.684', 'WEAPON3': '1.100', 'weapon3': '2.686', 'HITCOUNT': '2.940', 'DAMAGECOUNT': '16.056', 'FRAGCOUNT': '58.000'} [2024-08-06 08:39:33,402][52664] DAMAGECOUNT value on done: 1030772.0 [2024-08-06 08:39:33,402][52664] Sum rewards: 77.005, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.084', 'AMMO4': '0.199', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:34,255][52650] Updated weights for policy 0, policy_version 85851 (0.0011) [2024-08-06 08:39:34,344][52795] DAMAGECOUNT value on done: 930336.0 [2024-08-06 08:39:34,345][52795] Sum rewards: 77.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.667', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.118', 'weapon5': '0.120', 'AMMO4': '0.151', 'AMMO3': '0.183', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '3.044', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:35,157][52670] DAMAGECOUNT value on done: 1001985.0 [2024-08-06 08:39:35,159][52670] Sum rewards: 68.002, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.778', 'AMMO5': '0.012', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.134', 'weapon5': '0.152', 'AMMO3': '0.218', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.026', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.205', 'FRAGCOUNT': '56.000'} [2024-08-06 08:39:35,279][52666] DAMAGECOUNT value on done: 999269.0 [2024-08-06 08:39:35,280][52666] Sum rewards: 87.185, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.637', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.124', 'AMMO3': '0.152', 'AMMO4': '0.177', 'weapon5': '0.186', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.594', 'WEAPON3': '0.950', 'weapon3': '2.840', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '70.000'} [2024-08-06 08:39:35,289][52665] DAMAGECOUNT value on done: 995820.0 [2024-08-06 08:39:35,290][52665] Sum rewards: 65.949, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.175', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.132', 'weapon2': '0.170', 'AMMO4': '0.176', 'AMMO3': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'HITCOUNT': '3.080', 'weapon3': '3.466', 'DAMAGECOUNT': '16.968', 'FRAGCOUNT': '54.000'} [2024-08-06 08:39:35,939][52668] DAMAGECOUNT value on done: 990962.0 [2024-08-06 08:39:35,939][52668] Sum rewards: 80.973, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.113', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.145', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.442', 'WEAPON3': '1.000', 'weapon3': '3.224', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:36,247][52664] DAMAGECOUNT value on done: 1048046.0 [2024-08-06 08:39:36,249][52664] Sum rewards: 81.208, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.910', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.062', 'AMMO4': '0.118', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.434', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '66.000'} [2024-08-06 08:39:36,581][52667] DAMAGECOUNT value on done: 1012212.0 [2024-08-06 08:39:36,585][52667] Sum rewards: 67.370, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.106', 'AMMO4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.512', 'WEAPON3': '1.150', 'weapon3': '3.092', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '55.000'} [2024-08-06 08:39:37,477][52795] DAMAGECOUNT value on done: 914652.0 [2024-08-06 08:39:37,479][52795] Sum rewards: 80.571, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.710', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon4': '0.048', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.257', 'weapon2': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.224', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:37,743][52670] DAMAGECOUNT value on done: 996000.0 [2024-08-06 08:39:37,745][52670] Sum rewards: 82.769, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.210', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.094', 'weapon5': '0.174', 'AMMO4': '0.203', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.534', 'WEAPON3': '1.750', 'weapon3': '2.928', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.937', 'FRAGCOUNT': '71.000'} [2024-08-06 08:39:37,797][52567] Fps is (10 sec: 17197.6, 60 sec: 17338.8, 300 sec: 17411.3). Total num frames: 703340544. Throughput: 0: 4356.6. Samples: 175839370. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:39:37,798][52567] Avg episode reward: [(0, '77.040')] [2024-08-06 08:39:37,955][52666] DAMAGECOUNT value on done: 989748.0 [2024-08-06 08:39:37,957][52666] Sum rewards: 78.092, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.130', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.258', 'weapon2': '0.440', 'WEAPON3': '1.100', 'weapon3': '2.920', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:38,422][52665] DAMAGECOUNT value on done: 988299.0 [2024-08-06 08:39:38,422][52665] Sum rewards: 71.906, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.080', 'AMMO4': '0.095', 'weapon5': '0.112', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.240', 'WEAPON3': '1.100', 'HITCOUNT': '3.350', 'weapon3': '3.358', 'DAMAGECOUNT': '17.358', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:38,852][52668] DAMAGECOUNT value on done: 992449.0 [2024-08-06 08:39:38,852][52668] Sum rewards: 82.415, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.548', 'AMMO5': '0.006', 'AMMO2': '0.038', 'weapon4': '0.084', 'weapon5': '0.086', 'AMMO4': '0.189', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:38,855][52664] DAMAGECOUNT value on done: 1042543.0 [2024-08-06 08:39:38,855][52664] Sum rewards: 59.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.027', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.116', 'weapon5': '0.132', 'AMMO4': '0.150', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.250', 'HITCOUNT': '2.840', 'weapon3': '3.100', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '50.000'} [2024-08-06 08:39:38,990][52662] DAMAGECOUNT value on done: 1001257.0 [2024-08-06 08:39:38,990][52662] Sum rewards: 75.577, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.176', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.163', 'weapon5': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'weapon4': '0.534', 'WEAPON3': '0.950', 'weapon3': '2.702', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '58.500'} [2024-08-06 08:39:39,492][52650] Updated weights for policy 0, policy_version 85861 (0.0016) [2024-08-06 08:39:39,616][52667] DAMAGECOUNT value on done: 1006543.0 [2024-08-06 08:39:39,621][52667] Sum rewards: 82.714, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.116', 'weapon4': '0.138', 'AMMO4': '0.148', 'AMMO3': '0.211', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:40,457][52795] DAMAGECOUNT value on done: 926999.0 [2024-08-06 08:39:40,458][52795] Sum rewards: 75.752, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.480', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.122', 'weapon4': '0.156', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:40,724][52659] DAMAGECOUNT value on done: 1002953.0 [2024-08-06 08:39:40,724][52659] Sum rewards: 70.255, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.962', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'AMMO3': '0.263', 'weapon2': '0.268', 'WEAPON3': '1.500', 'HITCOUNT': '3.300', 'weapon3': '3.450', 'DAMAGECOUNT': '17.241', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:40,912][52670] DAMAGECOUNT value on done: 994898.0 [2024-08-06 08:39:40,913][52670] Sum rewards: 73.719, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.065', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.152', 'AMMO4': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.202', 'AMMO3': '0.208', 'weapon2': '0.288', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.717', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:41,027][52666] DAMAGECOUNT value on done: 987453.0 [2024-08-06 08:39:41,035][52666] Sum rewards: 80.034, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.453', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.164', 'AMMO3': '0.177', 'AMMO4': '0.209', 'weapon5': '0.210', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.450', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:41,288][52664] DAMAGECOUNT value on done: 1032818.0 [2024-08-06 08:39:41,288][52664] Sum rewards: 68.852, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.275', 'AMMO5': '0.003', 'AMMO2': '0.013', 'weapon4': '0.014', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.065', 'AMMO3': '0.213', 'weapon2': '0.598', 'WEAPON3': '1.350', 'weapon3': '3.172', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:41,380][52665] DAMAGECOUNT value on done: 1003509.0 [2024-08-06 08:39:41,380][52665] Sum rewards: 75.802, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.980', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.076', 'weapon4': '0.084', 'AMMO4': '0.127', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.253', 'weapon2': '0.362', 'WEAPON3': '1.700', 'weapon3': '3.218', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:41,803][52668] DAMAGECOUNT value on done: 982467.0 [2024-08-06 08:39:41,804][52668] Sum rewards: 68.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.076', 'AMMO4': '0.144', 'weapon5': '0.190', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.400', 'weapon3': '3.080', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.614', 'FRAGCOUNT': '58.000'} [2024-08-06 08:39:42,101][52667] DAMAGECOUNT value on done: 1004081.0 [2024-08-06 08:39:42,101][52667] Sum rewards: 68.564, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.281', 'AMMO5': '0.014', 'AMMO2': '0.048', 'weapon4': '0.094', 'AMMO3': '0.170', 'weapon5': '0.180', 'AMMO4': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '55.500'} [2024-08-06 08:39:42,198][52662] DAMAGECOUNT value on done: 1009686.0 [2024-08-06 08:39:42,199][52662] Sum rewards: 75.710, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.646', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.052', 'AMMO4': '0.094', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.708', 'WEAPON3': '1.200', 'weapon3': '3.016', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:42,421][52811] DAMAGECOUNT value on done: 947781.0 [2024-08-06 08:39:42,424][52811] Sum rewards: 72.921, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.418', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.206', 'weapon4': '0.248', 'weapon5': '0.248', 'AMMO3': '0.265', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.880', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '62.000'} [2024-08-06 08:39:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 703430656. Throughput: 0: 4358.5. Samples: 175865500. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:39:42,794][52567] Avg episode reward: [(0, '76.948')] [2024-08-06 08:39:42,878][52649] DAMAGECOUNT value on done: 972062.0 [2024-08-06 08:39:42,880][52649] Sum rewards: 78.124, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.429', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.090', 'AMMO4': '0.113', 'weapon5': '0.164', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.152', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:43,592][52795] DAMAGECOUNT value on done: 924879.0 [2024-08-06 08:39:43,593][52795] Sum rewards: 76.531, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.504', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.098', 'weapon5': '0.128', 'WEAPON5': '0.200', 'AMMO4': '0.212', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '62.000'} [2024-08-06 08:39:43,682][52659] DAMAGECOUNT value on done: 1002204.0 [2024-08-06 08:39:43,682][52659] Sum rewards: 71.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.242', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.243', 'weapon2': '0.246', 'WEAPON3': '1.400', 'weapon3': '3.076', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.004', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:43,784][52666] DAMAGECOUNT value on done: 1008843.0 [2024-08-06 08:39:43,785][52666] Sum rewards: 85.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.220', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon5': '0.116', 'AMMO4': '0.131', 'weapon4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'weapon2': '0.336', 'WEAPON3': '1.650', 'weapon3': '3.200', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.165', 'FRAGCOUNT': '71.000'} [2024-08-06 08:39:43,951][52664] DAMAGECOUNT value on done: 1032946.0 [2024-08-06 08:39:43,951][52664] Sum rewards: 83.980, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.118', 'weapon5': '0.146', 'AMMO3': '0.180', 'AMMO4': '0.184', 'HEALTH': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.000', 'weapon3': '3.212', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:44,232][52650] Updated weights for policy 0, policy_version 85871 (0.0014) [2024-08-06 08:39:44,469][52668] DAMAGECOUNT value on done: 1000278.0 [2024-08-06 08:39:44,471][52668] Sum rewards: 73.153, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.750', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.098', 'weapon5': '0.158', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.686', 'WEAPON3': '1.300', 'weapon3': '2.808', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '59.500'} [2024-08-06 08:39:44,503][52665] DAMAGECOUNT value on done: 996719.0 [2024-08-06 08:39:44,504][52665] Sum rewards: 76.407, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.580', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.054', 'AMMO4': '0.086', 'weapon4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.290', 'WEAPON3': '1.550', 'weapon3': '3.370', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.152', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:45,274][52667] DAMAGECOUNT value on done: 1009959.0 [2024-08-06 08:39:45,275][52667] Sum rewards: 79.014, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.000', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.141', 'AMMO3': '0.185', 'weapon4': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '2.930', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:45,312][52662] DAMAGECOUNT value on done: 1010069.0 [2024-08-06 08:39:45,312][52662] Sum rewards: 71.441, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.690', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.036', 'weapon5': '0.074', 'AMMO4': '0.091', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.100', 'weapon3': '3.342', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:45,360][52811] DAMAGECOUNT value on done: 932344.0 [2024-08-06 08:39:45,361][52811] Sum rewards: 73.994, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.213', 'weapon2': '0.588', 'WEAPON3': '1.250', 'weapon3': '3.064', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.670', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:45,953][52649] DAMAGECOUNT value on done: 965330.0 [2024-08-06 08:39:45,954][52649] Sum rewards: 72.027, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'ARMOR': '0.024', 'AMMO2': '0.026', 'weapon4': '0.098', 'AMMO4': '0.130', 'AMMO3': '0.208', 'weapon5': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.306', 'HEALTH': '0.574', 'WEAPON3': '1.150', 'HITCOUNT': '3.050', 'weapon3': '3.122', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:46,634][52659] DAMAGECOUNT value on done: 1013680.0 [2024-08-06 08:39:46,634][52659] Sum rewards: 67.194, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.295', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon2': '0.170', 'weapon4': '0.184', 'weapon5': '0.188', 'AMMO4': '0.231', 'AMMO3': '0.247', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:46,730][52666] DAMAGECOUNT value on done: 981651.0 [2024-08-06 08:39:46,729][52795] DAMAGECOUNT value on done: 912004.0 [2024-08-06 08:39:46,732][52666] Sum rewards: 72.615, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.114', 'weapon5': '0.128', 'AMMO4': '0.185', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'WEAPON3': '1.100', 'HEALTH': '1.216', 'weapon3': '3.340', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '58.000'} [2024-08-06 08:39:46,734][52795] Sum rewards: 65.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.564', 'AMMO5': '0.013', 'AMMO2': '0.059', 'weapon5': '0.164', 'AMMO3': '0.240', 'weapon2': '0.260', 'weapon4': '0.264', 'AMMO4': '0.295', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '56.000'} [2024-08-06 08:39:47,035][52647] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0)] [2024-08-06 08:39:47,036][52664] DAMAGECOUNT value on done: 1040837.0 [2024-08-06 08:39:47,037][52664] Sum rewards: 87.966, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.810', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon5': '0.102', 'AMMO4': '0.108', 'weapon4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.342', 'WEAPON3': '1.300', 'weapon3': '3.174', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '72.000'} [2024-08-06 08:39:47,644][52668] DAMAGECOUNT value on done: 1000506.0 [2024-08-06 08:39:47,648][52668] Sum rewards: 72.351, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.419', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.108', 'AMMO4': '0.124', 'weapon5': '0.166', 'weapon2': '0.216', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'HITCOUNT': '3.050', 'weapon3': '3.226', 'DAMAGECOUNT': '17.202', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:47,720][52662] DAMAGECOUNT value on done: 1002291.0 [2024-08-06 08:39:47,723][52662] Sum rewards: 79.554, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.262', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.168', 'weapon2': '0.178', 'weapon4': '0.192', 'AMMO4': '0.202', 'AMMO3': '0.252', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:47,794][52567] Fps is (10 sec: 17208.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 703512576. Throughput: 0: 4358.4. Samples: 175878520. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:39:47,795][52567] Avg episode reward: [(0, '76.271')] [2024-08-06 08:39:47,800][52667] DAMAGECOUNT value on done: 1013704.0 [2024-08-06 08:39:47,801][52667] Sum rewards: 83.734, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.824', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.136', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon4': '0.222', 'weapon2': '0.232', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.851', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:48,073][52665] DAMAGECOUNT value on done: 993593.0 [2024-08-06 08:39:48,073][52665] Sum rewards: 75.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.035', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.114', 'weapon5': '0.152', 'AMMO3': '0.210', 'AMMO4': '0.234', 'WEAPON5': '0.300', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.303', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:48,483][52811] DAMAGECOUNT value on done: 927041.0 [2024-08-06 08:39:48,484][52811] Sum rewards: 76.715, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.920', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon4': '0.220', 'weapon5': '0.220', 'AMMO4': '0.224', 'weapon2': '0.228', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.024', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:48,489][52650] Updated weights for policy 0, policy_version 85881 (0.0027) [2024-08-06 08:39:49,348][52649] DAMAGECOUNT value on done: 983351.0 [2024-08-06 08:39:49,348][52649] Sum rewards: 81.875, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.373', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.158', 'AMMO4': '0.191', 'AMMO3': '0.215', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.154', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '66.000'} [2024-08-06 08:39:49,583][52659] DAMAGECOUNT value on done: 1007279.0 [2024-08-06 08:39:49,584][52659] Sum rewards: 82.254, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.155', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.084', 'weapon4': '0.098', 'AMMO4': '0.118', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.280', 'weapon2': '0.282', 'WEAPON3': '1.650', 'weapon3': '3.312', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '70.000'} [2024-08-06 08:39:49,852][52666] DAMAGECOUNT value on done: 994528.0 [2024-08-06 08:39:49,853][52666] Sum rewards: 78.515, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.660', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon2': '0.118', 'weapon5': '0.136', 'AMMO4': '0.154', 'AMMO3': '0.157', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.412', 'WEAPON3': '0.950', 'weapon3': '3.168', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:49,952][52664] DAMAGECOUNT value on done: 1037076.0 [2024-08-06 08:39:49,953][52664] Sum rewards: 84.945, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.358', 'AMMO5': '0.020', 'AMMO2': '0.040', 'weapon4': '0.108', 'weapon5': '0.168', 'AMMO4': '0.198', 'AMMO3': '0.214', 'weapon2': '0.252', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '70.000'} [2024-08-06 08:39:50,032][52795] DAMAGECOUNT value on done: 921607.0 [2024-08-06 08:39:50,033][52795] Sum rewards: 71.057, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.250', 'AMMO5': '0.025', 'AMMO2': '0.072', 'weapon4': '0.168', 'AMMO3': '0.200', 'weapon2': '0.250', 'weapon5': '0.308', 'AMMO4': '0.359', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.872', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:50,458][52662] DAMAGECOUNT value on done: 1016759.0 [2024-08-06 08:39:50,459][52662] Sum rewards: 88.295, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.940', 'AMMO5': '0.028', 'AMMO2': '0.095', 'AMMO3': '0.277', 'weapon4': '0.282', 'weapon5': '0.302', 'weapon2': '0.346', 'AMMO4': '0.473', 'WEAPON5': '0.800', 'WEAPON4': '0.900', 'WEAPON3': '1.700', 'weapon3': '2.652', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '23.010', 'FRAGCOUNT': '74.000'} [2024-08-06 08:39:50,630][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:39:50,703][52668] DAMAGECOUNT value on done: 1000990.0 [2024-08-06 08:39:50,705][52668] Sum rewards: 84.412, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.590', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.015', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'AMMO3': '0.199', 'weapon2': '0.650', 'WEAPON3': '1.150', 'weapon3': '3.114', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:50,874][52667] DAMAGECOUNT value on done: 1000180.0 [2024-08-06 08:39:50,874][52667] Sum rewards: 66.575, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.155', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.078', 'AMMO3': '0.146', 'weapon5': '0.180', 'AMMO4': '0.237', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.794', 'WEAPON3': '0.900', 'weapon3': '2.790', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.566', 'FRAGCOUNT': '51.000'} [2024-08-06 08:39:51,001][52665] DAMAGECOUNT value on done: 993539.0 [2024-08-06 08:39:51,003][52665] Sum rewards: 76.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.006', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.116', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.238', 'AMMO3': '0.245', 'WEAPON3': '1.600', 'weapon3': '3.234', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.695', 'FRAGCOUNT': '63.000'} [2024-08-06 08:39:51,652][52811] DAMAGECOUNT value on done: 933362.0 [2024-08-06 08:39:51,662][52811] Sum rewards: 85.326, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.014', 'AMMO4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.260', 'AMMO3': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.454', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '74.000'} [2024-08-06 08:39:52,188][52649] DAMAGECOUNT value on done: 984705.0 [2024-08-06 08:39:52,188][52649] Sum rewards: 81.426, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.048', 'weapon5': '0.146', 'AMMO4': '0.178', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:52,378][52659] DAMAGECOUNT value on done: 999196.0 [2024-08-06 08:39:52,378][52659] Sum rewards: 79.144, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.170', 'AMMO5': '0.009', 'weapon4': '0.050', 'AMMO2': '0.052', 'weapon5': '0.126', 'AMMO3': '0.231', 'AMMO4': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '1.500', 'weapon3': '3.320', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.237', 'FRAGCOUNT': '67.000'} [2024-08-06 08:39:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 703602688. Throughput: 0: 4345.3. Samples: 175904340. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:39:52,794][52567] Avg episode reward: [(0, '76.955')] [2024-08-06 08:39:52,823][52664] DAMAGECOUNT value on done: 1046981.0 [2024-08-06 08:39:52,823][52664] Sum rewards: 74.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.638', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.064', 'AMMO4': '0.168', 'AMMO3': '0.211', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.852', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '60.000'} [2024-08-06 08:39:53,243][52795] DAMAGECOUNT value on done: 931647.0 [2024-08-06 08:39:53,244][52795] Sum rewards: 74.226, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.754', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon5': '0.122', 'AMMO4': '0.126', 'AMMO3': '0.186', 'weapon4': '0.260', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '61.000'} [2024-08-06 08:39:53,490][52665] DAMAGECOUNT value on done: 990168.0 [2024-08-06 08:39:53,492][52665] Sum rewards: 77.996, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.848', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.058', 'AMMO4': '0.152', 'weapon5': '0.158', 'weapon2': '0.226', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.280', 'weapon3': '3.312', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:53,609][52662] DAMAGECOUNT value on done: 994491.0 [2024-08-06 08:39:53,610][52662] Sum rewards: 63.264, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.042', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.065', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.245', 'weapon2': '0.552', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.120', 'DAMAGECOUNT': '15.900', 'FRAGCOUNT': '54.000'} [2024-08-06 08:39:53,695][52650] Updated weights for policy 0, policy_version 85891 (0.0031) [2024-08-06 08:39:53,749][52668] DAMAGECOUNT value on done: 1000488.0 [2024-08-06 08:39:53,750][52668] Sum rewards: 80.033, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.877', 'AMMO5': '0.004', 'weapon4': '0.012', 'AMMO2': '0.021', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.136', 'weapon2': '0.348', 'WEAPON3': '0.900', 'weapon3': '3.490', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.198', 'FRAGCOUNT': '62.000'} [2024-08-06 08:39:54,009][52667] DAMAGECOUNT value on done: 1002490.0 [2024-08-06 08:39:54,009][52667] Sum rewards: 88.054, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.611', 'AMMO5': '0.012', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon4': '0.072', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.336', 'FRAGCOUNT': '72.000'} [2024-08-06 08:39:54,778][52811] DAMAGECOUNT value on done: 936489.0 [2024-08-06 08:39:54,781][52811] Sum rewards: 79.201, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.802', 'AMMO5': '0.008', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.204', 'weapon5': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.252', 'WEAPON3': '1.300', 'weapon3': '3.182', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.323', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:55,113][52649] DAMAGECOUNT value on done: 975016.0 [2024-08-06 08:39:55,113][52649] Sum rewards: 74.087, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.047', 'weapon5': '0.126', 'AMMO3': '0.174', 'weapon2': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.470', 'WEAPON3': '1.200', 'weapon3': '3.038', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '57.000'} [2024-08-06 08:39:55,144][52664] DAMAGECOUNT value on done: 1045182.0 [2024-08-06 08:39:55,147][52664] Sum rewards: 79.211, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.261', 'AMMO5': '0.017', 'AMMO2': '0.034', 'AMMO4': '0.170', 'AMMO3': '0.198', 'weapon5': '0.262', 'weapon4': '0.290', 'weapon2': '0.370', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.802', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:55,461][52659] DAMAGECOUNT value on done: 1004990.0 [2024-08-06 08:39:55,462][52659] Sum rewards: 71.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.539', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.076', 'AMMO4': '0.131', 'weapon5': '0.132', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.300', 'weapon3': '3.314', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:56,310][52662] DAMAGECOUNT value on done: 997107.0 [2024-08-06 08:39:56,311][52662] Sum rewards: 67.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.914', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.018', 'AMMO4': '0.034', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.183', 'WEAPON5': '0.200', 'weapon2': '0.872', 'WEAPON3': '1.100', 'weapon3': '2.866', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '54.000'} [2024-08-06 08:39:56,475][52665] DAMAGECOUNT value on done: 995509.0 [2024-08-06 08:39:56,476][52665] Sum rewards: 69.315, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.094', 'AMMO4': '0.122', 'weapon5': '0.154', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.332', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '56.000'} [2024-08-06 08:39:56,616][52667] DAMAGECOUNT value on done: 1011467.0 [2024-08-06 08:39:56,616][52667] Sum rewards: 76.834, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.981', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon5': '0.054', 'weapon4': '0.152', 'AMMO4': '0.191', 'weapon2': '0.212', 'WEAPON5': '0.250', 'AMMO3': '0.257', 'WEAPON4': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.306', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '68.000'} [2024-08-06 08:39:56,899][52668] DAMAGECOUNT value on done: 1005213.0 [2024-08-06 08:39:56,910][52668] Sum rewards: 71.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.010', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.130', 'weapon4': '0.186', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.004', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:57,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 703692800. Throughput: 0: 4347.6. Samples: 175930590. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:39:57,794][52567] Avg episode reward: [(0, '76.457')] [2024-08-06 08:39:57,988][52811] DAMAGECOUNT value on done: 952406.0 [2024-08-06 08:39:57,991][52811] Sum rewards: 77.540, reward structure: {'DEATHCOUNT': '-15.000', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.050', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'HEALTH': '0.160', 'AMMO3': '0.232', 'weapon2': '0.286', 'WEAPON3': '1.300', 'weapon3': '3.342', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:58,021][52650] Updated weights for policy 0, policy_version 85901 (0.0037) [2024-08-06 08:39:58,108][52649] DAMAGECOUNT value on done: 983666.0 [2024-08-06 08:39:58,110][52649] Sum rewards: 81.342, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.541', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.130', 'AMMO3': '0.153', 'AMMO4': '0.181', 'weapon4': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.000', 'weapon3': '2.840', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:58,242][52659] DAMAGECOUNT value on done: 1005261.0 [2024-08-06 08:39:58,243][52659] Sum rewards: 77.627, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.425', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.120', 'weapon5': '0.126', 'AMMO4': '0.147', 'weapon2': '0.214', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '65.000'} [2024-08-06 08:39:58,380][52664] DAMAGECOUNT value on done: 1042943.0 [2024-08-06 08:39:58,381][52664] Sum rewards: 77.998, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.126', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.074', 'AMMO4': '0.202', 'weapon5': '0.212', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.426', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '64.000'} [2024-08-06 08:39:59,085][52662] DAMAGECOUNT value on done: 1018577.0 [2024-08-06 08:39:59,085][52662] Sum rewards: 63.969, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.219', 'weapon5': '0.002', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.256', 'weapon2': '0.328', 'WEAPON3': '1.550', 'HITCOUNT': '3.380', 'weapon3': '3.460', 'DAMAGECOUNT': '17.070', 'FRAGCOUNT': '55.000'} [2024-08-06 08:39:59,160][52665] DAMAGECOUNT value on done: 989391.0 [2024-08-06 08:39:59,161][52665] Sum rewards: 70.306, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.080', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.160', 'AMMO4': '0.178', 'weapon5': '0.190', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.674', 'WEAPON3': '1.350', 'weapon3': '2.686', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.342', 'FRAGCOUNT': '59.000'} [2024-08-06 08:39:59,663][52667] DAMAGECOUNT value on done: 1001676.0 [2024-08-06 08:39:59,663][52667] Sum rewards: 79.478, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.200', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.058', 'AMMO4': '0.118', 'weapon5': '0.122', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.426', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '65.500'} [2024-08-06 08:40:00,703][52660] DAMAGECOUNT value on done: 1000548.0 [2024-08-06 08:40:00,705][52660] Sum rewards: 85.668, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.736', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.082', 'AMMO4': '0.122', 'WEAPON5': '0.200', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.314', 'weapon4': '0.398', 'WEAPON3': '1.450', 'weapon3': '2.964', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '21.198', 'FRAGCOUNT': '69.000'} [2024-08-06 08:40:00,766][52649] DAMAGECOUNT value on done: 981788.0 [2024-08-06 08:40:00,768][52649] Sum rewards: 83.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.945', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.084', 'AMMO4': '0.152', 'AMMO3': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.200', 'weapon3': '3.370', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:01,115][52811] DAMAGECOUNT value on done: 940547.0 [2024-08-06 08:40:01,118][52811] Sum rewards: 73.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.154', 'AMMO3': '0.175', 'AMMO4': '0.213', 'weapon2': '0.232', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.026', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:01,394][52659] DAMAGECOUNT value on done: 1004608.0 [2024-08-06 08:40:01,395][52659] Sum rewards: 70.315, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.181', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.101', 'weapon5': '0.112', 'weapon4': '0.132', 'weapon2': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'WEAPON3': '1.300', 'HITCOUNT': '3.160', 'weapon3': '3.370', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '58.000'} [2024-08-06 08:40:01,535][52664] DAMAGECOUNT value on done: 1055041.0 [2024-08-06 08:40:01,535][52664] Sum rewards: 72.277, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.167', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.112', 'weapon5': '0.162', 'AMMO4': '0.170', 'AMMO3': '0.235', 'weapon2': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.218', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '60.500'} [2024-08-06 08:40:01,671][52662] DAMAGECOUNT value on done: 1002989.0 [2024-08-06 08:40:01,672][52662] Sum rewards: 65.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.014', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.137', 'weapon5': '0.158', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.200', 'HITCOUNT': '2.990', 'weapon3': '3.102', 'DAMAGECOUNT': '15.915', 'FRAGCOUNT': '53.000'} [2024-08-06 08:40:01,891][52665] DAMAGECOUNT value on done: 982298.0 [2024-08-06 08:40:01,892][52665] Sum rewards: 62.533, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.380', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO4': '0.163', 'AMMO3': '0.203', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.710', 'WEAPON3': '1.200', 'weapon3': '2.864', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.530', 'FRAGCOUNT': '51.000'} [2024-08-06 08:40:02,224][52667] DAMAGECOUNT value on done: 1009568.0 [2024-08-06 08:40:02,231][52667] Sum rewards: 80.552, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.214', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.086', 'weapon5': '0.192', 'weapon2': '0.224', 'AMMO4': '0.249', 'AMMO3': '0.267', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '3.236', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.613', 'FRAGCOUNT': '69.000'} [2024-08-06 08:40:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 703774720. Throughput: 0: 4351.1. Samples: 175943850. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:02,794][52567] Avg episode reward: [(0, '75.988')] [2024-08-06 08:40:03,094][52650] Updated weights for policy 0, policy_version 85911 (0.0012) [2024-08-06 08:40:03,703][52649] DAMAGECOUNT value on done: 980009.0 [2024-08-06 08:40:03,703][52649] Sum rewards: 82.873, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon5': '0.144', 'AMMO3': '0.161', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.266', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.066', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '67.000'} [2024-08-06 08:40:03,885][52660] DAMAGECOUNT value on done: 989567.0 [2024-08-06 08:40:03,886][52660] Sum rewards: 85.911, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.980', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.032', 'AMMO4': '0.035', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.160', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.871', 'FRAGCOUNT': '72.000'} [2024-08-06 08:40:03,967][52664] DAMAGECOUNT value on done: 1051335.0 [2024-08-06 08:40:03,968][52664] Sum rewards: 74.115, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.325', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon4': '0.238', 'weapon2': '0.352', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.829', 'FRAGCOUNT': '61.000'} [2024-08-06 08:40:04,163][52811] DAMAGECOUNT value on done: 930565.0 [2024-08-06 08:40:04,165][52811] Sum rewards: 72.651, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.200', 'AMMO2': '0.015', 'WEAPON4': '0.050', 'AMMO4': '0.076', 'weapon4': '0.082', 'weapon2': '0.174', 'AMMO3': '0.318', 'WEAPON3': '1.800', 'weapon3': '3.534', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.252', 'FRAGCOUNT': '65.000'} [2024-08-06 08:40:04,513][52659] DAMAGECOUNT value on done: 1001709.0 [2024-08-06 08:40:04,514][52659] Sum rewards: 83.290, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon4': '0.068', 'weapon5': '0.158', 'AMMO3': '0.201', 'AMMO4': '0.216', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:04,833][52665] DAMAGECOUNT value on done: 989341.0 [2024-08-06 08:40:04,836][52665] Sum rewards: 87.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'AMMO2': '0.013', 'AMMO5': '0.013', 'weapon4': '0.018', 'weapon5': '0.038', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.356', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.994', 'FRAGCOUNT': '72.000'} [2024-08-06 08:40:04,850][52662] DAMAGECOUNT value on done: 1008213.0 [2024-08-06 08:40:04,851][52662] Sum rewards: 86.030, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.010', 'AMMO2': '0.011', 'weapon4': '0.014', 'HEALTH': '0.018', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.258', 'WEAPON3': '1.150', 'weapon3': '3.402', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '70.000'} [2024-08-06 08:40:05,167][52667] DAMAGECOUNT value on done: 1015286.0 [2024-08-06 08:40:05,167][52667] Sum rewards: 85.154, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.714', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.156', 'AMMO4': '0.177', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.482', 'WEAPON3': '1.300', 'weapon3': '3.058', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:06,329][52649] DAMAGECOUNT value on done: 975371.0 [2024-08-06 08:40:06,330][52649] Sum rewards: 74.656, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.136', 'AMMO4': '0.146', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'weapon2': '0.326', 'WEAPON3': '1.300', 'weapon3': '2.948', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '62.000'} [2024-08-06 08:40:06,781][52660] DAMAGECOUNT value on done: 1004231.0 [2024-08-06 08:40:06,781][52660] Sum rewards: 73.260, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.915', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.070', 'weapon5': '0.080', 'AMMO4': '0.088', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.614', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '58.000'} [2024-08-06 08:40:07,156][52664] DAMAGECOUNT value on done: 1050125.0 [2024-08-06 08:40:07,157][52664] Sum rewards: 85.639, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.136', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'WEAPON5': '0.050', 'weapon5': '0.110', 'AMMO3': '0.192', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.440', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.986', 'FRAGCOUNT': '69.000'} [2024-08-06 08:40:07,356][52811] DAMAGECOUNT value on done: 937032.0 [2024-08-06 08:40:07,364][52811] Sum rewards: 68.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.610', 'AMMO5': '0.005', 'weapon4': '0.034', 'AMMO2': '0.038', 'weapon5': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.192', 'AMMO3': '0.211', 'weapon2': '0.418', 'WEAPON3': '1.200', 'weapon3': '3.294', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.499', 'FRAGCOUNT': '56.000'} [2024-08-06 08:40:07,390][52665] DAMAGECOUNT value on done: 996740.0 [2024-08-06 08:40:07,390][52665] Sum rewards: 76.076, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.026', 'AMMO4': '0.068', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.352', 'WEAPON3': '1.600', 'weapon3': '3.310', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.444', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:07,392][52659] DAMAGECOUNT value on done: 1013819.0 [2024-08-06 08:40:07,393][52659] Sum rewards: 72.405, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.525', 'AMMO5': '0.014', 'AMMO2': '0.027', 'AMMO3': '0.105', 'AMMO4': '0.133', 'weapon5': '0.162', 'weapon4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.824', 'weapon3': '2.578', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '57.000'} [2024-08-06 08:40:07,551][52662] DAMAGECOUNT value on done: 1002374.0 [2024-08-06 08:40:07,553][52662] Sum rewards: 65.174, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.544', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.048', 'weapon5': '0.094', 'AMMO4': '0.186', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.398', 'WEAPON3': '1.200', 'HITCOUNT': '3.160', 'weapon3': '3.232', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '54.000'} [2024-08-06 08:40:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 703864832. Throughput: 0: 4354.7. Samples: 175969870. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:07,794][52567] Avg episode reward: [(0, '76.200')] [2024-08-06 08:40:07,799][52650] Updated weights for policy 0, policy_version 85921 (0.0013) [2024-08-06 08:40:07,877][52667] DAMAGECOUNT value on done: 1016840.0 [2024-08-06 08:40:07,878][52667] Sum rewards: 66.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.180', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon5': '0.058', 'weapon4': '0.112', 'AMMO4': '0.122', 'AMMO3': '0.221', 'weapon2': '0.242', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.240', 'weapon3': '3.362', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '56.000'} [2024-08-06 08:40:08,468][52803] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:40:09,152][52649] DAMAGECOUNT value on done: 973743.0 [2024-08-06 08:40:09,153][52649] Sum rewards: 73.379, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.080', 'AMMO4': '0.095', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.352', 'WEAPON3': '1.550', 'weapon3': '3.222', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.928', 'FRAGCOUNT': '63.000'} [2024-08-06 08:40:09,456][52649] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:40:09,745][52660] DAMAGECOUNT value on done: 1014512.0 [2024-08-06 08:40:09,747][52660] Sum rewards: 79.765, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.154', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.027', 'WEAPON5': '0.050', 'weapon5': '0.068', 'AMMO3': '0.170', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.332', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:09,934][52664] DAMAGECOUNT value on done: 1033597.0 [2024-08-06 08:40:09,935][52664] Sum rewards: 75.237, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.076', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.068', 'weapon4': '0.084', 'weapon5': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon2': '0.198', 'WEAPON5': '0.200', 'WEAPON3': '1.050', 'HITCOUNT': '3.390', 'weapon3': '3.422', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:10,440][52667] DAMAGECOUNT value on done: 1012237.0 [2024-08-06 08:40:10,442][52667] Sum rewards: 68.661, reward structure: {'DEATHCOUNT': '-18.750', 'HEALTH': '-1.000', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.180', 'weapon5': '0.214', 'weapon2': '0.240', 'AMMO4': '0.257', 'AMMO3': '0.268', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:10,533][52811] DAMAGECOUNT value on done: 938014.0 [2024-08-06 08:40:10,534][52811] Sum rewards: 81.198, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.862', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.126', 'weapon4': '0.184', 'AMMO4': '0.206', 'AMMO3': '0.207', 'weapon2': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '67.500'} [2024-08-06 08:40:10,586][52662] DAMAGECOUNT value on done: 1000903.0 [2024-08-06 08:40:10,591][52662] Sum rewards: 80.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.018', 'AMMO2': '0.037', 'AMMO4': '0.184', 'AMMO3': '0.215', 'weapon4': '0.216', 'weapon5': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.612', 'WEAPON3': '1.300', 'weapon3': '2.692', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:10,621][52659] DAMAGECOUNT value on done: 999140.0 [2024-08-06 08:40:10,622][52659] Sum rewards: 77.349, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.579', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.089', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon4': '0.236', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.400', 'FRAGCOUNT': '63.000'} [2024-08-06 08:40:12,067][52649] DAMAGECOUNT value on done: 988191.0 [2024-08-06 08:40:12,068][52649] Sum rewards: 79.157, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.208', 'AMMO5': '0.006', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.088', 'weapon4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.048', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:12,406][52650] Updated weights for policy 0, policy_version 85931 (0.0024) [2024-08-06 08:40:12,441][52664] DAMAGECOUNT value on done: 1038038.0 [2024-08-06 08:40:12,441][52664] Sum rewards: 79.089, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.507', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO4': '0.148', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.850', 'weapon3': '3.258', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.497', 'FRAGCOUNT': '70.000'} [2024-08-06 08:40:12,716][52660] DAMAGECOUNT value on done: 995412.0 [2024-08-06 08:40:12,719][52660] Sum rewards: 87.702, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.028', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.131', 'AMMO4': '0.138', 'HEALTH': '0.258', 'weapon2': '0.500', 'WEAPON3': '0.800', 'weapon3': '3.340', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 703946752. Throughput: 0: 4352.2. Samples: 175996080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:12,794][52567] Avg episode reward: [(0, '76.222')] [2024-08-06 08:40:13,327][52659] DAMAGECOUNT value on done: 1008870.0 [2024-08-06 08:40:13,327][52659] Sum rewards: 82.131, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.460', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.054', 'weapon5': '0.086', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.566', 'WEAPON3': '1.450', 'weapon3': '3.064', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:13,501][52667] DAMAGECOUNT value on done: 1008642.0 [2024-08-06 08:40:13,504][52667] Sum rewards: 83.669, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.596', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'weapon4': '0.040', 'weapon5': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.188', 'AMMO3': '0.228', 'WEAPON3': '1.400', 'weapon3': '3.456', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.313', 'FRAGCOUNT': '69.000'} [2024-08-06 08:40:13,689][52811] DAMAGECOUNT value on done: 940367.0 [2024-08-06 08:40:13,689][52811] Sum rewards: 75.678, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.010', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.072', 'weapon5': '0.114', 'AMMO4': '0.154', 'weapon2': '0.244', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.368', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '65.000'} [2024-08-06 08:40:13,903][52662] DAMAGECOUNT value on done: 995633.0 [2024-08-06 08:40:13,903][52662] Sum rewards: 57.490, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.180', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon4': '0.044', 'AMMO4': '0.111', 'weapon5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.279', 'WEAPON5': '0.300', 'weapon2': '0.604', 'WEAPON3': '1.700', 'weapon3': '2.882', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.187', 'FRAGCOUNT': '50.500'} [2024-08-06 08:40:15,216][52649] DAMAGECOUNT value on done: 992800.0 [2024-08-06 08:40:15,216][52649] Sum rewards: 74.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.750', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon5': '0.234', 'AMMO4': '0.239', 'AMMO3': '0.254', 'weapon4': '0.330', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.726', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 08:40:15,269][52664] DAMAGECOUNT value on done: 1050617.0 [2024-08-06 08:40:15,270][52664] Sum rewards: 83.118, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.414', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon5': '0.052', 'weapon4': '0.072', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.296', 'WEAPON3': '1.150', 'weapon3': '3.396', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.648', 'FRAGCOUNT': '68.500'} [2024-08-06 08:40:15,756][52803] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:40:15,781][52659] DAMAGECOUNT value on done: 1004076.0 [2024-08-06 08:40:15,783][52659] Sum rewards: 84.257, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon2': '0.200', 'AMMO4': '0.225', 'AMMO3': '0.231', 'weapon5': '0.252', 'weapon4': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.712', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.397', 'FRAGCOUNT': '69.000'} [2024-08-06 08:40:15,938][52660] DAMAGECOUNT value on done: 993245.0 [2024-08-06 08:40:15,939][52660] Sum rewards: 87.305, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.485', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.028', 'weapon5': '0.140', 'AMMO4': '0.141', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.250', 'weapon3': '3.268', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '70.000'} [2024-08-06 08:40:16,465][52667] DAMAGECOUNT value on done: 1013561.0 [2024-08-06 08:40:16,466][52667] Sum rewards: 71.033, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.530', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'weapon4': '0.072', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.246', 'weapon2': '0.264', 'WEAPON3': '1.450', 'HITCOUNT': '3.340', 'weapon3': '3.348', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '60.000'} [2024-08-06 08:40:16,883][52811] DAMAGECOUNT value on done: 948518.0 [2024-08-06 08:40:16,884][52811] Sum rewards: 84.523, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.381', 'AMMO5': '0.014', 'AMMO2': '0.025', 'weapon4': '0.042', 'weapon5': '0.108', 'AMMO4': '0.123', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.578', 'WEAPON3': '1.400', 'weapon3': '3.098', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.898', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:17,087][52662] DAMAGECOUNT value on done: 1006449.0 [2024-08-06 08:40:17,087][52662] Sum rewards: 76.658, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.122', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.184', 'AMMO3': '0.211', 'weapon2': '0.216', 'AMMO4': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.216', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '65.000'} [2024-08-06 08:40:17,327][52650] Updated weights for policy 0, policy_version 85941 (0.0028) [2024-08-06 08:40:17,416][52614] Signal inference workers to stop experience collection... (15800 times) [2024-08-06 08:40:17,417][52614] Signal inference workers to resume experience collection... (15800 times) [2024-08-06 08:40:17,486][52650] InferenceWorker_p0-w0: stopping experience collection (15800 times) [2024-08-06 08:40:17,492][52650] InferenceWorker_p0-w0: resuming experience collection (15800 times) [2024-08-06 08:40:17,631][52649] DAMAGECOUNT value on done: 983442.0 [2024-08-06 08:40:17,631][52649] Sum rewards: 73.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.790', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.064', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'AMMO3': '0.157', 'weapon4': '0.248', 'WEAPON4': '0.250', 'weapon2': '0.430', 'WEAPON3': '0.950', 'weapon3': '3.008', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '60.000'} [2024-08-06 08:40:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 704036864. Throughput: 0: 4349.3. Samples: 176009080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:17,794][52567] Avg episode reward: [(0, '76.814')] [2024-08-06 08:40:18,333][52664] DAMAGECOUNT value on done: 1032997.0 [2024-08-06 08:40:18,334][52664] Sum rewards: 66.938, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.848', 'AMMO5': '0.020', 'AMMO2': '0.065', 'weapon4': '0.220', 'AMMO3': '0.256', 'weapon5': '0.316', 'AMMO4': '0.324', 'weapon2': '0.438', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.682', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '56.000'} [2024-08-06 08:40:18,874][52659] DAMAGECOUNT value on done: 1001227.0 [2024-08-06 08:40:18,875][52659] Sum rewards: 70.600, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.390', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.106', 'weapon5': '0.134', 'AMMO4': '0.164', 'weapon2': '0.256', 'AMMO3': '0.285', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.230', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '61.000'} [2024-08-06 08:40:18,965][52660] DAMAGECOUNT value on done: 999566.0 [2024-08-06 08:40:18,966][52660] Sum rewards: 61.980, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.918', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon5': '0.176', 'AMMO3': '0.180', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.512', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '2.420', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '50.000'} [2024-08-06 08:40:19,988][52811] DAMAGECOUNT value on done: 940153.0 [2024-08-06 08:40:19,988][52811] Sum rewards: 74.817, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.090', 'AMMO5': '0.007', 'AMMO2': '0.051', 'weapon4': '0.112', 'weapon5': '0.124', 'WEAPON5': '0.200', 'AMMO4': '0.254', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '3.004', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '63.000'} [2024-08-06 08:40:20,088][52662] DAMAGECOUNT value on done: 998684.0 [2024-08-06 08:40:20,089][52662] Sum rewards: 73.284, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.030', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon5': '0.038', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.124', 'weapon2': '0.176', 'AMMO3': '0.288', 'WEAPON3': '1.700', 'weapon3': '3.430', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:20,746][52649] DAMAGECOUNT value on done: 983943.0 [2024-08-06 08:40:20,747][52649] Sum rewards: 71.969, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.508', 'AMMO5': '0.019', 'AMMO2': '0.061', 'AMMO3': '0.181', 'weapon5': '0.258', 'AMMO4': '0.303', 'weapon4': '0.518', 'weapon2': '0.536', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.408', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.542', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:21,669][52650] Updated weights for policy 0, policy_version 85951 (0.0014) [2024-08-06 08:40:21,882][52660] DAMAGECOUNT value on done: 1006062.0 [2024-08-06 08:40:21,887][52660] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.700', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.166', 'weapon4': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.450', 'weapon3': '3.102', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:21,943][52659] DAMAGECOUNT value on done: 1001312.0 [2024-08-06 08:40:21,946][52659] Sum rewards: 77.863, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.086', 'weapon2': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon4': '0.232', 'WEAPON3': '1.350', 'weapon3': '3.330', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:22,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 704118784. Throughput: 0: 4348.1. Samples: 176035020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:22,795][52567] Avg episode reward: [(0, '76.303')] [2024-08-06 08:40:23,026][52662] DAMAGECOUNT value on done: 1015391.0 [2024-08-06 08:40:23,026][52662] Sum rewards: 88.394, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.400', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.116', 'weapon4': '0.156', 'AMMO3': '0.178', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.050', 'weapon3': '3.190', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.866', 'FRAGCOUNT': '70.000'} [2024-08-06 08:40:23,061][52811] DAMAGECOUNT value on done: 937353.0 [2024-08-06 08:40:23,062][52811] Sum rewards: 75.613, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.478', 'AMMO5': '0.020', 'AMMO2': '0.048', 'weapon5': '0.182', 'AMMO3': '0.208', 'AMMO4': '0.239', 'weapon4': '0.290', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '2.636', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.064', 'FRAGCOUNT': '62.000'} [2024-08-06 08:40:23,566][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:40:23,709][52649] DAMAGECOUNT value on done: 973775.0 [2024-08-06 08:40:23,709][52649] Sum rewards: 75.027, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.390', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.036', 'AMMO4': '0.109', 'weapon5': '0.150', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.486', 'WEAPON3': '1.050', 'weapon3': '3.132', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:24,551][52659] DAMAGECOUNT value on done: 1004296.0 [2024-08-06 08:40:24,551][52659] Sum rewards: 63.619, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.918', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.168', 'AMMO4': '0.181', 'AMMO3': '0.210', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.250', 'HITCOUNT': '2.800', 'weapon3': '3.244', 'DAMAGECOUNT': '15.255', 'FRAGCOUNT': '54.000'} [2024-08-06 08:40:25,081][52660] DAMAGECOUNT value on done: 994437.0 [2024-08-06 08:40:25,081][52660] Sum rewards: 92.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.319', 'AMMO2': '0.003', 'AMMO4': '0.012', 'AMMO3': '0.187', 'weapon2': '0.538', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '20.973', 'FRAGCOUNT': '74.000'} [2024-08-06 08:40:25,858][52662] DAMAGECOUNT value on done: 1002763.0 [2024-08-06 08:40:25,858][52662] Sum rewards: 67.902, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.648', 'AMMO5': '0.022', 'AMMO2': '0.029', 'weapon4': '0.074', 'weapon5': '0.134', 'AMMO4': '0.143', 'AMMO3': '0.171', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.698', 'WEAPON3': '1.050', 'weapon3': '2.852', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.166', 'FRAGCOUNT': '55.000'} [2024-08-06 08:40:26,257][52650] Updated weights for policy 0, policy_version 85961 (0.0023) [2024-08-06 08:40:26,381][52811] DAMAGECOUNT value on done: 937520.0 [2024-08-06 08:40:26,381][52811] Sum rewards: 70.329, reward structure: {'DEATHCOUNT': '-6.750', 'HEALTH': '-1.778', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.113', 'AMMO3': '0.121', 'weapon5': '0.178', 'weapon4': '0.214', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.900', 'weapon3': '3.144', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.001', 'FRAGCOUNT': '53.000'} [2024-08-06 08:40:26,982][52649] DAMAGECOUNT value on done: 987261.0 [2024-08-06 08:40:26,983][52649] Sum rewards: 81.563, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.682', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.122', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.200', 'weapon3': '3.210', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:27,381][52659] DAMAGECOUNT value on done: 1015081.0 [2024-08-06 08:40:27,381][52659] Sum rewards: 78.137, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.370', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon4': '0.156', 'weapon5': '0.156', 'AMMO4': '0.184', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.648', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '65.000'} [2024-08-06 08:40:27,684][52660] DAMAGECOUNT value on done: 992447.0 [2024-08-06 08:40:27,688][52660] Sum rewards: 75.187, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.340', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.116', 'weapon5': '0.152', 'AMMO4': '0.240', 'weapon2': '0.298', 'AMMO3': '0.305', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.900', 'weapon3': '3.104', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 704217088. Throughput: 0: 4347.5. Samples: 176061140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:27,802][52567] Avg episode reward: [(0, '76.567')] [2024-08-06 08:40:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085964_704217088.pth... [2024-08-06 08:40:27,915][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085453_700030976.pth [2024-08-06 08:40:28,023][52794] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.579, 193.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:40:28,443][52662] DAMAGECOUNT value on done: 993418.0 [2024-08-06 08:40:28,445][52662] Sum rewards: 74.427, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.354', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.124', 'weapon5': '0.138', 'AMMO3': '0.194', 'AMMO4': '0.255', 'weapon2': '0.344', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '62.000'} [2024-08-06 08:40:29,645][52811] DAMAGECOUNT value on done: 938837.0 [2024-08-06 08:40:29,646][52811] Sum rewards: 81.544, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.425', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.132', 'weapon5': '0.170', 'AMMO3': '0.177', 'weapon4': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.464', 'WEAPON3': '1.050', 'weapon3': '2.932', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:30,108][52649] DAMAGECOUNT value on done: 965974.0 [2024-08-06 08:40:30,109][52649] Sum rewards: 83.389, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.617', 'AMMO5': '0.010', 'weapon4': '0.054', 'AMMO2': '0.054', 'weapon5': '0.170', 'weapon2': '0.192', 'AMMO3': '0.270', 'AMMO4': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.332', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '72.000'} [2024-08-06 08:40:30,535][52659] DAMAGECOUNT value on done: 997526.0 [2024-08-06 08:40:30,536][52659] Sum rewards: 85.052, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.100', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.117', 'AMMO3': '0.134', 'weapon5': '0.162', 'weapon2': '0.286', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon4': '0.450', 'WEAPON3': '0.850', 'weapon3': '2.860', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.289', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:31,142][52660] DAMAGECOUNT value on done: 999083.0 [2024-08-06 08:40:31,149][52660] Sum rewards: 70.509, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.458', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.068', 'AMMO4': '0.086', 'WEAPON5': '0.150', 'weapon4': '0.168', 'WEAPON4': '0.200', 'AMMO3': '0.201', 'weapon2': '0.224', 'WEAPON3': '1.250', 'HITCOUNT': '3.330', 'weapon3': '3.374', 'DAMAGECOUNT': '18.393', 'FRAGCOUNT': '58.000'} [2024-08-06 08:40:31,205][52650] Updated weights for policy 0, policy_version 85971 (0.0034) [2024-08-06 08:40:31,241][52662] DAMAGECOUNT value on done: 999619.0 [2024-08-06 08:40:31,242][52662] Sum rewards: 64.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.092', 'weapon5': '0.094', 'AMMO4': '0.148', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '53.000'} [2024-08-06 08:40:32,013][52671] DAMAGECOUNT value on done: 1009436.0 [2024-08-06 08:40:32,014][52671] Sum rewards: 77.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.612', 'AMMO5': '0.020', 'AMMO2': '0.045', 'weapon4': '0.102', 'AMMO3': '0.212', 'AMMO4': '0.226', 'weapon2': '0.264', 'weapon5': '0.268', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.128', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '62.500'} [2024-08-06 08:40:32,724][52811] DAMAGECOUNT value on done: 943450.0 [2024-08-06 08:40:32,726][52811] Sum rewards: 64.345, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.608', 'AMMO5': '0.013', 'AMMO2': '0.055', 'AMMO3': '0.180', 'weapon5': '0.214', 'AMMO4': '0.273', 'weapon4': '0.284', 'weapon2': '0.394', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.644', 'HITCOUNT': '3.080', 'DAMAGECOUNT': '16.065', 'FRAGCOUNT': '52.000'} [2024-08-06 08:40:32,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 704290816. Throughput: 0: 4339.1. Samples: 176073780. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:32,794][52567] Avg episode reward: [(0, '76.240')] [2024-08-06 08:40:33,270][52659] DAMAGECOUNT value on done: 1009946.0 [2024-08-06 08:40:33,280][52659] Sum rewards: 75.581, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.458', 'AMMO5': '0.019', 'AMMO2': '0.050', 'AMMO3': '0.207', 'weapon5': '0.248', 'AMMO4': '0.249', 'weapon4': '0.256', 'weapon2': '0.386', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.794', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '61.500'} [2024-08-06 08:40:33,334][52649] DAMAGECOUNT value on done: 986478.0 [2024-08-06 08:40:33,337][52649] Sum rewards: 75.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.378', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'weapon4': '0.022', 'AMMO2': '0.039', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.154', 'AMMO4': '0.195', 'AMMO3': '0.207', 'WEAPON3': '1.400', 'HITCOUNT': '3.540', 'weapon3': '3.596', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 08:40:33,836][52662] DAMAGECOUNT value on done: 994523.0 [2024-08-06 08:40:33,837][52662] Sum rewards: 65.532, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.890', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO3': '0.181', 'weapon5': '0.192', 'AMMO4': '0.195', 'weapon2': '0.284', 'weapon4': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.964', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.302', 'FRAGCOUNT': '54.000'} [2024-08-06 08:40:33,955][52660] DAMAGECOUNT value on done: 995160.0 [2024-08-06 08:40:33,955][52660] Sum rewards: 75.323, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.428', 'AMMO5': '0.007', 'AMMO2': '0.029', 'AMMO4': '0.146', 'weapon5': '0.176', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.360', 'weapon4': '0.464', 'WEAPON3': '1.100', 'weapon3': '2.786', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '61.000'} [2024-08-06 08:40:35,065][52671] DAMAGECOUNT value on done: 1015278.0 [2024-08-06 08:40:35,066][52671] Sum rewards: 81.424, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.270', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon5': '0.076', 'WEAPON5': '0.100', 'weapon2': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.193', 'weapon4': '0.202', 'WEAPON3': '1.150', 'weapon3': '3.420', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '65.000'} [2024-08-06 08:40:36,006][52811] DAMAGECOUNT value on done: 951310.0 [2024-08-06 08:40:36,008][52811] Sum rewards: 80.218, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.288', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.108', 'AMMO3': '0.187', 'weapon5': '0.232', 'AMMO4': '0.252', 'weapon2': '0.326', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.068', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '22.023', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:36,103][52659] DAMAGECOUNT value on done: 1000637.0 [2024-08-06 08:40:36,104][52659] Sum rewards: 76.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.062', 'AMMO4': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.209', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:36,134][52650] Updated weights for policy 0, policy_version 85981 (0.0026) [2024-08-06 08:40:36,249][52649] DAMAGECOUNT value on done: 990274.0 [2024-08-06 08:40:36,251][52649] Sum rewards: 89.670, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.980', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.134', 'weapon4': '0.142', 'AMMO4': '0.164', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.196', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.829', 'FRAGCOUNT': '75.000'} [2024-08-06 08:40:36,525][52660] DAMAGECOUNT value on done: 994759.0 [2024-08-06 08:40:36,525][52660] Sum rewards: 74.531, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.075', 'HEALTH': '0.080', 'weapon5': '0.114', 'AMMO3': '0.148', 'weapon2': '0.168', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.336', 'WEAPON3': '0.800', 'weapon3': '3.126', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '60.000'} [2024-08-06 08:40:37,433][52671] DAMAGECOUNT value on done: 1008647.0 [2024-08-06 08:40:37,433][52671] Sum rewards: 69.458, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.595', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.060', 'weapon5': '0.122', 'AMMO4': '0.189', 'AMMO3': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '1.450', 'weapon3': '3.140', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '59.500'} [2024-08-06 08:40:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17477.2, 300 sec: 17439.2). Total num frames: 704389120. Throughput: 0: 4347.8. Samples: 176099990. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:37,794][52567] Avg episode reward: [(0, '75.993')] [2024-08-06 08:40:38,186][52664] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:40:39,095][52811] DAMAGECOUNT value on done: 933555.0 [2024-08-06 08:40:39,097][52811] Sum rewards: 74.215, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.725', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon5': '0.108', 'weapon4': '0.112', 'weapon2': '0.188', 'AMMO3': '0.195', 'AMMO4': '0.201', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.376', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.982', 'FRAGCOUNT': '61.000'} [2024-08-06 08:40:39,274][52660] DAMAGECOUNT value on done: 1003147.0 [2024-08-06 08:40:39,274][52660] Sum rewards: 68.098, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon5': '0.222', 'AMMO3': '0.231', 'weapon4': '0.234', 'AMMO4': '0.286', 'weapon2': '0.536', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.722', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '56.500'} [2024-08-06 08:40:39,423][52658] DAMAGECOUNT value on done: 1008920.0 [2024-08-06 08:40:39,423][52658] Sum rewards: 93.152, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.005', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.090', 'weapon4': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.376', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.516', 'FRAGCOUNT': '77.000'} [2024-08-06 08:40:39,482][52649] DAMAGECOUNT value on done: 977596.0 [2024-08-06 08:40:39,483][52649] Sum rewards: 82.140, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.065', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.026', 'weapon5': '0.074', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.320', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:40,117][52669] DAMAGECOUNT value on done: 1002575.0 [2024-08-06 08:40:40,117][52669] Sum rewards: 80.619, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.922', 'AMMO5': '0.025', 'AMMO2': '0.062', 'weapon4': '0.112', 'weapon5': '0.122', 'AMMO3': '0.173', 'AMMO4': '0.308', 'weapon2': '0.426', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:40,557][52650] Updated weights for policy 0, policy_version 85991 (0.0023) [2024-08-06 08:40:40,575][52671] DAMAGECOUNT value on done: 1016189.0 [2024-08-06 08:40:40,576][52671] Sum rewards: 65.443, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.746', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.156', 'weapon5': '0.160', 'weapon2': '0.196', 'AMMO4': '0.199', 'AMMO3': '0.242', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.940', 'weapon3': '3.244', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '57.000'} [2024-08-06 08:40:40,773][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:40:42,312][52660] DAMAGECOUNT value on done: 1019126.0 [2024-08-06 08:40:42,314][52660] Sum rewards: 71.426, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.408', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon5': '0.086', 'AMMO4': '0.093', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.294', 'weapon2': '0.480', 'WEAPON3': '0.850', 'weapon3': '3.012', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '56.000'} [2024-08-06 08:40:42,353][52811] DAMAGECOUNT value on done: 937343.0 [2024-08-06 08:40:42,353][52811] Sum rewards: 73.393, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.550', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon5': '0.154', 'AMMO4': '0.159', 'AMMO3': '0.214', 'weapon2': '0.278', 'weapon4': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.974', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '62.000'} [2024-08-06 08:40:42,675][52658] DAMAGECOUNT value on done: 1009898.0 [2024-08-06 08:40:42,676][52658] Sum rewards: 75.332, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.634', 'AMMO5': '0.008', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon4': '0.128', 'weapon5': '0.148', 'weapon2': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.215', 'WEAPON3': '1.400', 'weapon3': '3.314', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '62.000'} [2024-08-06 08:40:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 704471040. Throughput: 0: 4347.3. Samples: 176126220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:42,794][52567] Avg episode reward: [(0, '76.108')] [2024-08-06 08:40:42,924][52669] DAMAGECOUNT value on done: 1002396.0 [2024-08-06 08:40:42,927][52669] Sum rewards: 77.402, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.325', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.048', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'weapon5': '0.188', 'WEAPON5': '0.200', 'weapon2': '0.222', 'AMMO3': '0.225', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:43,435][52671] DAMAGECOUNT value on done: 1021239.0 [2024-08-06 08:40:43,456][52671] Sum rewards: 74.473, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.606', 'AMMO2': '0.023', 'weapon4': '0.110', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'AMMO3': '0.277', 'weapon2': '0.318', 'WEAPON3': '1.650', 'weapon3': '3.388', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '64.000'} [2024-08-06 08:40:44,929][52660] DAMAGECOUNT value on done: 998228.0 [2024-08-06 08:40:44,932][52660] Sum rewards: 66.855, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.528', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.118', 'weapon4': '0.120', 'AMMO4': '0.167', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.354', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.226', 'FRAGCOUNT': '56.000'} [2024-08-06 08:40:45,242][52658] DAMAGECOUNT value on done: 1011255.0 [2024-08-06 08:40:45,244][52658] Sum rewards: 72.493, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.801', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.108', 'AMMO4': '0.149', 'AMMO3': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '3.178', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.061', 'FRAGCOUNT': '58.000'} [2024-08-06 08:40:45,615][52650] Updated weights for policy 0, policy_version 86001 (0.0027) [2024-08-06 08:40:45,716][52669] DAMAGECOUNT value on done: 1011337.0 [2024-08-06 08:40:45,719][52669] Sum rewards: 80.356, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.510', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.064', 'weapon5': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '69.000'} [2024-08-06 08:40:46,289][52671] DAMAGECOUNT value on done: 1010326.0 [2024-08-06 08:40:46,291][52671] Sum rewards: 67.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.608', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.176', 'AMMO3': '0.230', 'weapon4': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.532', 'WEAPON3': '1.350', 'weapon3': '2.718', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '54.000'} [2024-08-06 08:40:47,584][52660] DAMAGECOUNT value on done: 1002857.0 [2024-08-06 08:40:47,586][52660] Sum rewards: 79.618, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.835', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.068', 'weapon5': '0.136', 'AMMO4': '0.168', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.262', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 704561152. Throughput: 0: 4346.9. Samples: 176139460. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:47,795][52567] Avg episode reward: [(0, '76.027')] [2024-08-06 08:40:48,283][52658] DAMAGECOUNT value on done: 1006275.0 [2024-08-06 08:40:48,283][52658] Sum rewards: 86.517, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.416', 'AMMO5': '0.012', 'AMMO2': '0.043', 'weapon5': '0.138', 'AMMO3': '0.175', 'AMMO4': '0.213', 'weapon4': '0.254', 'weapon2': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.116', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '70.000'} [2024-08-06 08:40:48,886][52671] DAMAGECOUNT value on done: 1008590.0 [2024-08-06 08:40:48,886][52671] Sum rewards: 65.583, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.484', 'AMMO5': '0.007', 'AMMO2': '0.041', 'weapon4': '0.050', 'weapon5': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.206', 'AMMO3': '0.312', 'weapon2': '0.402', 'WEAPON3': '1.800', 'HITCOUNT': '3.060', 'weapon3': '3.172', 'DAMAGECOUNT': '16.605', 'FRAGCOUNT': '60.000'} [2024-08-06 08:40:49,054][52669] DAMAGECOUNT value on done: 1005938.0 [2024-08-06 08:40:49,054][52669] Sum rewards: 81.255, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.610', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.225', 'weapon2': '0.666', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.196', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:49,990][52650] Updated weights for policy 0, policy_version 86011 (0.0015) [2024-08-06 08:40:50,498][52660] DAMAGECOUNT value on done: 1001554.0 [2024-08-06 08:40:50,499][52660] Sum rewards: 74.213, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.695', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.064', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'AMMO3': '0.214', 'weapon2': '0.332', 'WEAPON3': '1.400', 'weapon3': '3.336', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '62.000'} [2024-08-06 08:40:51,322][52658] DAMAGECOUNT value on done: 1000059.0 [2024-08-06 08:40:51,323][52658] Sum rewards: 67.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.416', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'weapon4': '0.206', 'AMMO3': '0.212', 'WEAPON3': '1.250', 'HITCOUNT': '3.170', 'weapon3': '3.276', 'DAMAGECOUNT': '15.786', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:51,509][52669] DAMAGECOUNT value on done: 1012204.0 [2024-08-06 08:40:51,511][52669] Sum rewards: 70.804, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.078', 'weapon5': '0.086', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.220', 'weapon2': '0.870', 'WEAPON3': '1.300', 'weapon3': '2.778', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.127', 'FRAGCOUNT': '58.000'} [2024-08-06 08:40:51,849][52671] DAMAGECOUNT value on done: 1016776.0 [2024-08-06 08:40:51,850][52671] Sum rewards: 79.479, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.700', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.080', 'weapon5': '0.098', 'AMMO4': '0.170', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'WEAPON3': '1.500', 'weapon3': '3.216', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.206', 'FRAGCOUNT': '68.000'} [2024-08-06 08:40:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.5). Total num frames: 704651264. Throughput: 0: 4342.4. Samples: 176165280. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:52,794][52567] Avg episode reward: [(0, '75.938')] [2024-08-06 08:40:53,178][52660] DAMAGECOUNT value on done: 991679.0 [2024-08-06 08:40:53,179][52660] Sum rewards: 68.480, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.570', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.144', 'weapon5': '0.162', 'AMMO4': '0.208', 'AMMO3': '0.273', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.394', 'WEAPON3': '1.650', 'HITCOUNT': '3.050', 'weapon3': '3.058', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '59.000'} [2024-08-06 08:40:54,161][52671] DAMAGECOUNT value on done: 995313.0 [2024-08-06 08:40:54,161][52671] Sum rewards: 69.865, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.900', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.086', 'AMMO4': '0.114', 'weapon4': '0.170', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.193', 'FRAGCOUNT': '61.000'} [2024-08-06 08:40:54,626][52650] Updated weights for policy 0, policy_version 86021 (0.0012) [2024-08-06 08:40:54,632][52658] DAMAGECOUNT value on done: 999143.0 [2024-08-06 08:40:54,633][52658] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.113', 'AMMO5': '0.021', 'AMMO2': '0.059', 'weapon4': '0.180', 'AMMO3': '0.197', 'weapon5': '0.240', 'AMMO4': '0.296', 'weapon2': '0.448', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.846', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '61.000'} [2024-08-06 08:40:54,656][52669] DAMAGECOUNT value on done: 1010480.0 [2024-08-06 08:40:54,656][52669] Sum rewards: 65.391, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.706', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.198', 'weapon5': '0.200', 'AMMO3': '0.243', 'AMMO4': '0.268', 'weapon2': '0.304', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.956', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.857', 'FRAGCOUNT': '58.000'} [2024-08-06 08:40:55,693][52647] DAMAGECOUNT value on done: 1070874.0 [2024-08-06 08:40:55,694][52647] Sum rewards: 86.913, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.216', 'AMMO5': '0.018', 'AMMO2': '0.037', 'weapon4': '0.086', 'weapon5': '0.184', 'AMMO4': '0.186', 'AMMO3': '0.204', 'weapon2': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.082', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '72.000'} [2024-08-06 08:40:55,852][52660] DAMAGECOUNT value on done: 994637.0 [2024-08-06 08:40:55,855][52660] Sum rewards: 77.767, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.674', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.146', 'weapon2': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.287', 'WEAPON3': '1.800', 'weapon3': '3.468', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.413', 'FRAGCOUNT': '67.000'} [2024-08-06 08:40:57,022][52669] DAMAGECOUNT value on done: 1007854.0 [2024-08-06 08:40:57,022][52669] Sum rewards: 70.409, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.204', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.040', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.183', 'weapon2': '0.660', 'WEAPON3': '1.150', 'weapon3': '3.108', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.752', 'FRAGCOUNT': '58.000'} [2024-08-06 08:40:57,101][52671] DAMAGECOUNT value on done: 1009082.0 [2024-08-06 08:40:57,101][52671] Sum rewards: 58.198, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.005', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.041', 'weapon4': '0.082', 'weapon5': '0.094', 'AMMO4': '0.207', 'AMMO3': '0.209', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.400', 'HITCOUNT': '2.960', 'weapon3': '2.964', 'DAMAGECOUNT': '14.991', 'FRAGCOUNT': '52.000'} [2024-08-06 08:40:57,770][52658] DAMAGECOUNT value on done: 1011947.0 [2024-08-06 08:40:57,771][52658] Sum rewards: 79.209, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.108', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon5': '0.166', 'AMMO4': '0.179', 'weapon4': '0.192', 'AMMO3': '0.237', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.094', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 704741376. Throughput: 0: 4336.4. Samples: 176191220. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:40:57,794][52567] Avg episode reward: [(0, '75.573')] [2024-08-06 08:40:58,232][52647] DAMAGECOUNT value on done: 1058469.0 [2024-08-06 08:40:58,232][52647] Sum rewards: 85.627, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.425', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon4': '0.162', 'weapon5': '0.168', 'AMMO3': '0.206', 'AMMO4': '0.216', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.030', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.589', 'FRAGCOUNT': '70.000'} [2024-08-06 08:40:58,336][52803] DAMAGECOUNT value on done: 932844.0 [2024-08-06 08:40:58,337][52803] Sum rewards: 79.074, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.093', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.140', 'weapon5': '0.162', 'weapon2': '0.186', 'AMMO4': '0.200', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.365', 'FRAGCOUNT': '66.000'} [2024-08-06 08:40:59,909][52650] Updated weights for policy 0, policy_version 86031 (0.0025) [2024-08-06 08:41:00,100][52671] DAMAGECOUNT value on done: 1011285.0 [2024-08-06 08:41:00,102][52671] Sum rewards: 83.881, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.766', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.084', 'weapon4': '0.122', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'AMMO4': '0.220', 'weapon2': '0.290', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.306', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.865', 'FRAGCOUNT': '68.000'} [2024-08-06 08:41:00,225][52669] DAMAGECOUNT value on done: 1011089.0 [2024-08-06 08:41:00,227][52669] Sum rewards: 77.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.190', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.058', 'weapon5': '0.116', 'AMMO4': '0.118', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.436', 'WEAPON3': '1.000', 'weapon3': '3.198', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '61.000'} [2024-08-06 08:41:00,613][52658] DAMAGECOUNT value on done: 997163.0 [2024-08-06 08:41:00,615][52658] Sum rewards: 75.109, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.435', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon4': '0.046', 'weapon5': '0.074', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.386', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '61.000'} [2024-08-06 08:41:01,230][52647] DAMAGECOUNT value on done: 1061652.0 [2024-08-06 08:41:01,231][52647] Sum rewards: 73.642, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.930', 'AMMO5': '0.005', 'AMMO2': '0.017', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'weapon4': '0.126', 'weapon5': '0.186', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.172', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.216', 'FRAGCOUNT': '60.000'} [2024-08-06 08:41:01,461][52803] DAMAGECOUNT value on done: 932608.0 [2024-08-06 08:41:01,461][52803] Sum rewards: 86.398, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.105', 'AMMO2': '0.007', 'AMMO4': '0.033', 'WEAPON4': '0.100', 'weapon2': '0.130', 'weapon4': '0.188', 'AMMO3': '0.244', 'WEAPON3': '1.500', 'weapon3': '3.512', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '73.000'} [2024-08-06 08:41:02,543][52671] DAMAGECOUNT value on done: 1007764.0 [2024-08-06 08:41:02,544][52671] Sum rewards: 90.618, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO2': '0.011', 'AMMO4': '0.053', 'AMMO3': '0.197', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '3.356', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.291', 'FRAGCOUNT': '73.000'} [2024-08-06 08:41:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 704815104. Throughput: 0: 4336.7. Samples: 176204230. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:41:02,794][52567] Avg episode reward: [(0, '75.786')] [2024-08-06 08:41:03,516][52647] DAMAGECOUNT value on done: 1059968.0 [2024-08-06 08:41:03,519][52647] Sum rewards: 69.430, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.822', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO3': '0.111', 'AMMO4': '0.195', 'weapon5': '0.216', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.482', 'WEAPON3': '0.750', 'weapon3': '2.642', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '54.000'} [2024-08-06 08:41:03,597][52658] DAMAGECOUNT value on done: 1025943.0 [2024-08-06 08:41:03,599][52658] Sum rewards: 78.690, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.350', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'weapon2': '0.268', 'WEAPON3': '1.350', 'HITCOUNT': '3.330', 'weapon3': '3.450', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '65.000'} [2024-08-06 08:41:03,782][52669] DAMAGECOUNT value on done: 1019676.0 [2024-08-06 08:41:03,783][52669] Sum rewards: 83.880, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.031', 'weapon5': '0.096', 'weapon4': '0.108', 'AMMO4': '0.156', 'AMMO3': '0.195', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.316', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '69.000'} [2024-08-06 08:41:04,071][52650] Updated weights for policy 0, policy_version 86041 (0.0015) [2024-08-06 08:41:04,641][52803] DAMAGECOUNT value on done: 940513.0 [2024-08-06 08:41:04,642][52803] Sum rewards: 67.648, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.220', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.166', 'weapon2': '0.184', 'weapon5': '0.208', 'AMMO4': '0.291', 'AMMO3': '0.291', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.138', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '58.000'} [2024-08-06 08:41:05,662][52671] DAMAGECOUNT value on done: 1008917.0 [2024-08-06 08:41:05,664][52671] Sum rewards: 62.970, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.039', 'AMMO3': '0.182', 'AMMO4': '0.197', 'weapon5': '0.212', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.360', 'WEAPON3': '1.000', 'weapon3': '2.806', 'HITCOUNT': '2.880', 'DAMAGECOUNT': '15.228', 'FRAGCOUNT': '51.000'} [2024-08-06 08:41:06,204][52647] DAMAGECOUNT value on done: 1071096.0 [2024-08-06 08:41:06,205][52647] Sum rewards: 85.431, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.368', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon5': '0.054', 'WEAPON4': '0.100', 'weapon2': '0.138', 'AMMO4': '0.164', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'WEAPON3': '1.350', 'weapon3': '3.464', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '70.000'} [2024-08-06 08:41:06,342][52658] DAMAGECOUNT value on done: 1013924.0 [2024-08-06 08:41:06,344][52658] Sum rewards: 85.809, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.705', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.037', 'weapon5': '0.044', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.182', 'WEAPON5': '0.200', 'weapon2': '0.316', 'WEAPON3': '1.350', 'weapon3': '3.352', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.058', 'FRAGCOUNT': '70.000'} [2024-08-06 08:41:06,494][52669] DAMAGECOUNT value on done: 1010597.0 [2024-08-06 08:41:06,494][52669] Sum rewards: 82.492, reward structure: {'DEATHCOUNT': '-7.500', 'AMMO5': '0.007', 'AMMO2': '0.031', 'AMMO3': '0.112', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'weapon2': '0.358', 'HEALTH': '0.545', 'WEAPON3': '0.700', 'weapon4': '0.836', 'weapon3': '2.462', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:07,748][52803] DAMAGECOUNT value on done: 933497.0 [2024-08-06 08:41:07,748][52803] Sum rewards: 72.490, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.958', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.240', 'weapon2': '0.278', 'weapon4': '0.384', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 704905216. Throughput: 0: 4341.8. Samples: 176230400. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:41:07,794][52567] Avg episode reward: [(0, '75.996')] [2024-08-06 08:41:08,746][52671] DAMAGECOUNT value on done: 1013020.0 [2024-08-06 08:41:08,748][52671] Sum rewards: 77.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.033', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.042', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon2': '0.246', 'WEAPON3': '1.250', 'weapon3': '3.522', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '64.000'} [2024-08-06 08:41:08,806][52658] DAMAGECOUNT value on done: 1020004.0 [2024-08-06 08:41:08,808][52658] Sum rewards: 86.954, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.664', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.082', 'weapon5': '0.104', 'AMMO4': '0.144', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.324', 'FRAGCOUNT': '72.000'} [2024-08-06 08:41:08,832][52647] DAMAGECOUNT value on done: 1065137.0 [2024-08-06 08:41:08,833][52647] Sum rewards: 64.494, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.934', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.082', 'weapon5': '0.182', 'AMMO3': '0.218', 'AMMO4': '0.228', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.026', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.637', 'FRAGCOUNT': '53.500'} [2024-08-06 08:41:08,943][52650] Updated weights for policy 0, policy_version 86051 (0.0013) [2024-08-06 08:41:09,024][52663] DAMAGECOUNT value on done: 1021308.0 [2024-08-06 08:41:09,024][52663] Sum rewards: 80.399, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.196', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.114', 'weapon5': '0.122', 'AMMO4': '0.211', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.426', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '66.000'} [2024-08-06 08:41:09,512][52669] DAMAGECOUNT value on done: 1015220.0 [2024-08-06 08:41:09,514][52669] Sum rewards: 75.252, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.055', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.044', 'weapon5': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.140', 'AMMO3': '0.204', 'weapon2': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.396', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.087', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:10,359][52664] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.105, -35.0), ('weapon5', 0.002)] [2024-08-06 08:41:10,893][52803] DAMAGECOUNT value on done: 935855.0 [2024-08-06 08:41:10,894][52803] Sum rewards: 83.331, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.850', 'AMMO5': '0.018', 'AMMO2': '0.044', 'weapon4': '0.184', 'AMMO4': '0.221', 'weapon2': '0.224', 'AMMO3': '0.243', 'weapon5': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.954', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '71.000'} [2024-08-06 08:41:11,186][52647] DAMAGECOUNT value on done: 1066887.0 [2024-08-06 08:41:11,189][52647] Sum rewards: 83.290, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.018', 'AMMO2': '0.048', 'AMMO3': '0.208', 'weapon5': '0.224', 'weapon4': '0.226', 'AMMO4': '0.240', 'weapon2': '0.366', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.900', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.450', 'FRAGCOUNT': '67.000'} [2024-08-06 08:41:11,351][52658] DAMAGECOUNT value on done: 1004132.0 [2024-08-06 08:41:11,352][52658] Sum rewards: 75.367, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.900', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.064', 'WEAPON5': '0.100', 'AMMO4': '0.114', 'weapon5': '0.134', 'WEAPON4': '0.150', 'AMMO3': '0.256', 'weapon2': '0.418', 'WEAPON3': '1.500', 'weapon3': '3.144', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.900', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:11,897][52671] DAMAGECOUNT value on done: 995015.0 [2024-08-06 08:41:11,897][52671] Sum rewards: 72.342, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.374', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO3': '0.169', 'weapon4': '0.172', 'AMMO4': '0.192', 'weapon5': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.100', 'HITCOUNT': '2.900', 'weapon3': '3.124', 'DAMAGECOUNT': '16.650', 'FRAGCOUNT': '58.000'} [2024-08-06 08:41:12,034][52663] DAMAGECOUNT value on done: 1007111.0 [2024-08-06 08:41:12,035][52663] Sum rewards: 76.629, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.972', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.117', 'weapon5': '0.132', 'weapon4': '0.140', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.558', 'WEAPON3': '1.200', 'weapon3': '2.924', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.207', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:12,560][52669] DAMAGECOUNT value on done: 1014540.0 [2024-08-06 08:41:12,562][52669] Sum rewards: 75.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.942', 'AMMO5': '0.030', 'AMMO2': '0.063', 'weapon4': '0.122', 'AMMO3': '0.227', 'weapon5': '0.270', 'AMMO4': '0.318', 'weapon2': '0.322', 'WEAPON4': '0.600', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:12,794][52567] Fps is (10 sec: 18841.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 705003520. Throughput: 0: 4347.1. Samples: 176256760. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:12,794][52567] Avg episode reward: [(0, '75.768')] [2024-08-06 08:41:13,442][52647] DAMAGECOUNT value on done: 1043591.0 [2024-08-06 08:41:13,444][52647] Sum rewards: 71.577, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.926', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.108', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.210', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.254', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '60.000'} [2024-08-06 08:41:13,861][52650] Updated weights for policy 0, policy_version 86061 (0.0011) [2024-08-06 08:41:14,213][52803] DAMAGECOUNT value on done: 933185.0 [2024-08-06 08:41:14,215][52803] Sum rewards: 87.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.345', 'AMMO5': '0.013', 'AMMO2': '0.027', 'weapon4': '0.086', 'weapon5': '0.122', 'AMMO4': '0.133', 'weapon2': '0.250', 'AMMO3': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.286', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '21.030', 'FRAGCOUNT': '74.000'} [2024-08-06 08:41:14,458][52658] DAMAGECOUNT value on done: 1014549.0 [2024-08-06 08:41:14,459][52658] Sum rewards: 78.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.595', 'AMMO5': '0.007', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.178', 'weapon4': '0.180', 'AMMO3': '0.183', 'WEAPON3': '1.100', 'weapon3': '3.342', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:14,898][52663] DAMAGECOUNT value on done: 1000564.0 [2024-08-06 08:41:14,898][52663] Sum rewards: 71.597, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.871', 'AMMO5': '0.017', 'AMMO2': '0.057', 'weapon4': '0.122', 'AMMO3': '0.215', 'weapon5': '0.230', 'AMMO4': '0.286', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '59.000'} [2024-08-06 08:41:14,920][52664] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:41:14,993][52671] DAMAGECOUNT value on done: 1021671.0 [2024-08-06 08:41:14,995][52671] Sum rewards: 75.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.850', 'AMMO2': '0.024', 'weapon4': '0.102', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'AMMO3': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.700', 'weapon3': '3.364', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '64.000'} [2024-08-06 08:41:15,440][52669] DAMAGECOUNT value on done: 1002177.0 [2024-08-06 08:41:15,442][52669] Sum rewards: 77.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.785', 'AMMO5': '0.020', 'AMMO2': '0.058', 'weapon4': '0.198', 'AMMO3': '0.202', 'weapon5': '0.208', 'AMMO4': '0.288', 'weapon2': '0.546', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.732', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '65.000'} [2024-08-06 08:41:16,310][52647] DAMAGECOUNT value on done: 1058917.0 [2024-08-06 08:41:16,310][52647] Sum rewards: 79.209, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.990', 'AMMO5': '0.015', 'AMMO2': '0.049', 'AMMO3': '0.150', 'weapon4': '0.188', 'weapon5': '0.232', 'AMMO4': '0.247', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.864', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:17,322][52658] DAMAGECOUNT value on done: 1006322.0 [2024-08-06 08:41:17,323][52658] Sum rewards: 76.842, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.316', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.102', 'AMMO4': '0.163', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '3.192', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:17,443][52803] DAMAGECOUNT value on done: 931244.0 [2024-08-06 08:41:17,443][52803] Sum rewards: 79.758, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.342', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon5': '0.090', 'weapon4': '0.170', 'AMMO4': '0.174', 'WEAPON5': '0.200', 'weapon2': '0.214', 'WEAPON4': '0.300', 'AMMO3': '0.314', 'WEAPON3': '1.850', 'weapon3': '3.252', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '70.000'} [2024-08-06 08:41:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 705077248. Throughput: 0: 4355.3. Samples: 176269770. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:17,795][52567] Avg episode reward: [(0, '76.220')] [2024-08-06 08:41:17,950][52671] DAMAGECOUNT value on done: 1015965.0 [2024-08-06 08:41:17,950][52671] Sum rewards: 67.016, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon5': '0.056', 'weapon4': '0.064', 'AMMO4': '0.091', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.398', 'HEALTH': '0.672', 'WEAPON3': '0.900', 'weapon3': '3.330', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.858', 'FRAGCOUNT': '53.000'} [2024-08-06 08:41:18,165][52663] DAMAGECOUNT value on done: 1008977.0 [2024-08-06 08:41:18,166][52663] Sum rewards: 81.419, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'AMMO5': '0.021', 'AMMO2': '0.060', 'weapon5': '0.162', 'AMMO3': '0.203', 'weapon4': '0.272', 'AMMO4': '0.298', 'weapon2': '0.356', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.934', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '69.000'} [2024-08-06 08:41:18,195][52650] Updated weights for policy 0, policy_version 86071 (0.0012) [2024-08-06 08:41:18,611][52669] DAMAGECOUNT value on done: 1005559.0 [2024-08-06 08:41:18,612][52669] Sum rewards: 72.469, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.148', 'AMMO3': '0.220', 'AMMO4': '0.289', 'weapon5': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'weapon2': '0.680', 'WEAPON3': '1.300', 'weapon3': '2.504', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.847', 'FRAGCOUNT': '59.000'} [2024-08-06 08:41:19,151][52647] DAMAGECOUNT value on done: 1053245.0 [2024-08-06 08:41:19,151][52647] Sum rewards: 95.215, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.050', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.096', 'weapon5': '0.172', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.100', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.437', 'FRAGCOUNT': '77.000'} [2024-08-06 08:41:19,873][52658] DAMAGECOUNT value on done: 1009153.0 [2024-08-06 08:41:19,875][52658] Sum rewards: 80.517, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.586', 'AMMO5': '0.018', 'AMMO2': '0.027', 'weapon5': '0.128', 'AMMO4': '0.133', 'AMMO3': '0.187', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.400', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:20,573][52663] DAMAGECOUNT value on done: 1009035.0 [2024-08-06 08:41:20,573][52663] Sum rewards: 76.594, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.716', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon5': '0.108', 'AMMO4': '0.153', 'weapon2': '0.166', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.266', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:20,889][52803] DAMAGECOUNT value on done: 929420.0 [2024-08-06 08:41:20,889][52803] Sum rewards: 79.300, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.155', 'AMMO5': '0.011', 'AMMO2': '0.034', 'AMMO3': '0.160', 'AMMO4': '0.168', 'weapon5': '0.178', 'weapon4': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:21,041][52669] DAMAGECOUNT value on done: 1014472.0 [2024-08-06 08:41:21,044][52669] Sum rewards: 91.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.094', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '21.045', 'FRAGCOUNT': '74.000'} [2024-08-06 08:41:21,198][52671] DAMAGECOUNT value on done: 1012817.0 [2024-08-06 08:41:21,199][52671] Sum rewards: 89.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.160', 'AMMO5': '0.003', 'AMMO2': '0.033', 'weapon5': '0.068', 'WEAPON5': '0.100', 'AMMO4': '0.163', 'weapon4': '0.166', 'WEAPON4': '0.250', 'AMMO3': '0.274', 'weapon2': '0.404', 'WEAPON3': '1.600', 'weapon3': '3.096', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.699', 'FRAGCOUNT': '75.000'} [2024-08-06 08:41:22,162][52647] DAMAGECOUNT value on done: 1052577.0 [2024-08-06 08:41:22,162][52647] Sum rewards: 68.010, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.329', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.118', 'AMMO4': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon2': '0.598', 'WEAPON3': '1.150', 'weapon3': '2.996', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '56.000'} [2024-08-06 08:41:22,729][52658] DAMAGECOUNT value on done: 995788.0 [2024-08-06 08:41:22,732][52658] Sum rewards: 77.479, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.376', 'AMMO5': '0.006', 'AMMO2': '0.027', 'weapon4': '0.028', 'weapon5': '0.074', 'AMMO4': '0.137', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.254', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.352', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.357', 'FRAGCOUNT': '65.000'} [2024-08-06 08:41:22,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 705167360. Throughput: 0: 4353.1. Samples: 176295880. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:22,794][52567] Avg episode reward: [(0, '76.668')] [2024-08-06 08:41:23,285][52650] Updated weights for policy 0, policy_version 86081 (0.0023) [2024-08-06 08:41:23,681][52663] DAMAGECOUNT value on done: 1013625.0 [2024-08-06 08:41:23,682][52663] Sum rewards: 68.442, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.280', 'AMMO5': '0.008', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.254', 'weapon2': '0.272', 'WEAPON3': '1.700', 'HITCOUNT': '3.250', 'weapon3': '3.496', 'DAMAGECOUNT': '17.778', 'FRAGCOUNT': '59.000'} [2024-08-06 08:41:24,026][52671] DAMAGECOUNT value on done: 1017158.0 [2024-08-06 08:41:24,028][52671] Sum rewards: 76.456, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.125', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.110', 'weapon5': '0.162', 'AMMO4': '0.236', 'AMMO3': '0.265', 'weapon2': '0.354', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.080', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '66.000'} [2024-08-06 08:41:24,102][52803] DAMAGECOUNT value on done: 937088.0 [2024-08-06 08:41:24,102][52803] Sum rewards: 67.446, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.560', 'WEAPON1': '0.010', 'AMMO5': '0.019', 'AMMO2': '0.038', 'AMMO3': '0.150', 'AMMO4': '0.193', 'weapon4': '0.196', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.526', 'WEAPON3': '1.000', 'weapon3': '2.722', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.158', 'FRAGCOUNT': '55.000'} [2024-08-06 08:41:24,284][52669] DAMAGECOUNT value on done: 1031103.0 [2024-08-06 08:41:24,285][52669] Sum rewards: 79.368, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.748', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.052', 'weapon4': '0.056', 'AMMO3': '0.163', 'AMMO4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.438', 'WEAPON3': '1.000', 'weapon3': '3.246', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '64.000'} [2024-08-06 08:41:24,847][52647] DAMAGECOUNT value on done: 1052983.0 [2024-08-06 08:41:24,848][52647] Sum rewards: 74.513, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.910', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.145', 'AMMO3': '0.174', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.870', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '60.500'} [2024-08-06 08:41:25,637][52658] DAMAGECOUNT value on done: 1012354.0 [2024-08-06 08:41:25,638][52658] Sum rewards: 74.232, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.597', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon4': '0.172', 'weapon5': '0.172', 'AMMO3': '0.200', 'weapon2': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.152', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '59.000'} [2024-08-06 08:41:26,471][52663] DAMAGECOUNT value on done: 1006475.0 [2024-08-06 08:41:26,472][52663] Sum rewards: 70.923, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.682', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.026', 'weapon5': '0.092', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.360', 'WEAPON3': '1.600', 'weapon3': '3.332', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '60.000'} [2024-08-06 08:41:26,496][52614] Signal inference workers to stop experience collection... (15850 times) [2024-08-06 08:41:26,499][52614] Signal inference workers to resume experience collection... (15850 times) [2024-08-06 08:41:26,577][52650] InferenceWorker_p0-w0: stopping experience collection (15850 times) [2024-08-06 08:41:26,577][52650] InferenceWorker_p0-w0: resuming experience collection (15850 times) [2024-08-06 08:41:26,695][52794] DAMAGECOUNT value on done: 1001347.0 [2024-08-06 08:41:26,695][52794] Sum rewards: 82.518, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.000', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.036', 'AMMO4': '0.065', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '68.000'} [2024-08-06 08:41:27,013][52669] DAMAGECOUNT value on done: 1020684.0 [2024-08-06 08:41:27,015][52669] Sum rewards: 83.913, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.975', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.140', 'AMMO4': '0.144', 'AMMO3': '0.158', 'weapon4': '0.190', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.972', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '68.000'} [2024-08-06 08:41:27,258][52803] DAMAGECOUNT value on done: 931665.0 [2024-08-06 08:41:27,258][52803] Sum rewards: 58.685, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.570', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.066', 'weapon5': '0.176', 'AMMO4': '0.228', 'AMMO3': '0.248', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'HITCOUNT': '2.940', 'weapon3': '3.062', 'DAMAGECOUNT': '15.822', 'FRAGCOUNT': '51.000'} [2024-08-06 08:41:27,299][52671] DAMAGECOUNT value on done: 1000981.0 [2024-08-06 08:41:27,299][52671] Sum rewards: 72.140, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.503', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.200', 'AMMO3': '0.220', 'weapon4': '0.286', 'weapon2': '0.324', 'WEAPON3': '1.300', 'weapon3': '2.872', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.772', 'FRAGCOUNT': '60.000'} [2024-08-06 08:41:27,462][52650] Updated weights for policy 0, policy_version 86091 (0.0026) [2024-08-06 08:41:27,691][52647] DAMAGECOUNT value on done: 1059043.0 [2024-08-06 08:41:27,693][52647] Sum rewards: 64.124, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.996', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.058', 'AMMO4': '0.140', 'weapon5': '0.158', 'AMMO3': '0.241', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.570', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.386', 'FRAGCOUNT': '54.500'} [2024-08-06 08:41:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 705257472. Throughput: 0: 4347.8. Samples: 176321870. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:27,794][52567] Avg episode reward: [(0, '76.337')] [2024-08-06 08:41:28,378][52658] DAMAGECOUNT value on done: 1005339.0 [2024-08-06 08:41:28,379][52658] Sum rewards: 76.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.404', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.182', 'AMMO3': '0.189', 'weapon4': '0.222', 'AMMO4': '0.223', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON3': '1.150', 'weapon3': '2.890', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:29,200][52663] DAMAGECOUNT value on done: 991177.0 [2024-08-06 08:41:29,202][52663] Sum rewards: 76.712, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.391', 'AMMO5': '0.016', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.152', 'AMMO3': '0.154', 'weapon4': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.286', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.060', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:29,354][52794] DAMAGECOUNT value on done: 1010418.0 [2024-08-06 08:41:29,356][52794] Sum rewards: 94.150, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.148', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.040', 'weapon5': '0.084', 'AMMO4': '0.097', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.207', 'weapon2': '0.266', 'WEAPON3': '1.400', 'weapon3': '3.352', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.945', 'FRAGCOUNT': '78.000'} [2024-08-06 08:41:29,679][52669] DAMAGECOUNT value on done: 1017491.0 [2024-08-06 08:41:29,680][52669] Sum rewards: 66.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.550', 'AMMO5': '0.025', 'AMMO2': '0.053', 'weapon4': '0.104', 'AMMO3': '0.193', 'weapon5': '0.260', 'AMMO4': '0.267', 'weapon2': '0.438', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '53.500'} [2024-08-06 08:41:30,359][52803] DAMAGECOUNT value on done: 946830.0 [2024-08-06 08:41:30,359][52803] Sum rewards: 84.437, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.804', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.090', 'AMMO3': '0.203', 'AMMO4': '0.204', 'weapon5': '0.212', 'weapon2': '0.340', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.127', 'FRAGCOUNT': '68.000'} [2024-08-06 08:41:30,964][52647] DAMAGECOUNT value on done: 1053934.0 [2024-08-06 08:41:30,964][52647] Sum rewards: 76.214, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.150', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.168', 'weapon4': '0.186', 'AMMO4': '0.204', 'AMMO3': '0.291', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.038', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.609', 'FRAGCOUNT': '67.000'} [2024-08-06 08:41:31,108][52658] DAMAGECOUNT value on done: 1003277.0 [2024-08-06 08:41:31,110][52658] Sum rewards: 83.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.004', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.078', 'weapon5': '0.192', 'AMMO3': '0.209', 'weapon2': '0.242', 'AMMO4': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.364', 'FRAGCOUNT': '68.000'} [2024-08-06 08:41:31,667][52663] DAMAGECOUNT value on done: 1002642.0 [2024-08-06 08:41:31,668][52663] Sum rewards: 73.935, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.540', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.036', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'AMMO3': '0.163', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '3.250', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '58.000'} [2024-08-06 08:41:31,905][52669] DAMAGECOUNT value on done: 1021149.0 [2024-08-06 08:41:31,907][52669] Sum rewards: 78.485, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.787', 'AMMO5': '0.011', 'AMMO2': '0.019', 'weapon4': '0.050', 'weapon5': '0.088', 'AMMO4': '0.095', 'AMMO3': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.050', 'weapon3': '3.048', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:31,994][52794] DAMAGECOUNT value on done: 1016549.0 [2024-08-06 08:41:31,995][52794] Sum rewards: 84.659, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.602', 'AMMO5': '0.024', 'AMMO2': '0.072', 'weapon4': '0.172', 'AMMO3': '0.221', 'weapon2': '0.284', 'weapon5': '0.292', 'AMMO4': '0.361', 'WEAPON5': '0.700', 'WEAPON4': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.100', 'FRAGCOUNT': '72.000'} [2024-08-06 08:41:32,662][52650] Updated weights for policy 0, policy_version 86101 (0.0021) [2024-08-06 08:41:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 705339392. Throughput: 0: 4341.8. Samples: 176334840. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:32,794][52567] Avg episode reward: [(0, '76.747')] [2024-08-06 08:41:33,399][52803] DAMAGECOUNT value on done: 942627.0 [2024-08-06 08:41:33,400][52803] Sum rewards: 69.076, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.457', 'AMMO5': '0.015', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.174', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.272', 'WEAPON5': '0.350', 'weapon2': '0.588', 'WEAPON3': '1.200', 'weapon3': '2.738', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '55.000'} [2024-08-06 08:41:33,916][52658] DAMAGECOUNT value on done: 1011383.0 [2024-08-06 08:41:33,918][52658] Sum rewards: 75.552, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.396', 'AMMO5': '0.004', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.049', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.237', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '3.148', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.880', 'FRAGCOUNT': '64.000'} [2024-08-06 08:41:33,947][52647] DAMAGECOUNT value on done: 1060674.0 [2024-08-06 08:41:33,948][52647] Sum rewards: 76.916, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.650', 'AMMO5': '0.008', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.165', 'weapon2': '0.176', 'weapon5': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.758', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:34,103][52663] DAMAGECOUNT value on done: 1000117.0 [2024-08-06 08:41:34,104][52663] Sum rewards: 78.227, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.750', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.037', 'AMMO3': '0.123', 'weapon4': '0.124', 'weapon5': '0.124', 'AMMO4': '0.186', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.618', 'WEAPON3': '0.850', 'weapon3': '2.868', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.500'} [2024-08-06 08:41:34,317][52669] DAMAGECOUNT value on done: 1021666.0 [2024-08-06 08:41:34,319][52669] Sum rewards: 69.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.084', 'weapon5': '0.204', 'AMMO3': '0.231', 'AMMO4': '0.272', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.666', 'WEAPON3': '1.450', 'weapon3': '2.800', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 08:41:35,180][52794] DAMAGECOUNT value on done: 1003325.0 [2024-08-06 08:41:35,180][52794] Sum rewards: 83.940, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.402', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.064', 'weapon5': '0.072', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.302', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '68.000'} [2024-08-06 08:41:36,510][52803] DAMAGECOUNT value on done: 930848.0 [2024-08-06 08:41:36,512][52803] Sum rewards: 75.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.030', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon4': '0.094', 'weapon2': '0.172', 'weapon5': '0.216', 'AMMO3': '0.255', 'AMMO4': '0.298', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'HITCOUNT': '3.210', 'weapon3': '3.284', 'DAMAGECOUNT': '17.307', 'FRAGCOUNT': '64.000'} [2024-08-06 08:41:36,552][52647] DAMAGECOUNT value on done: 1060904.0 [2024-08-06 08:41:36,552][52647] Sum rewards: 77.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.619', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.114', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.204', 'weapon4': '0.252', 'weapon2': '0.258', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.045', 'FRAGCOUNT': '64.000'} [2024-08-06 08:41:36,731][52663] DAMAGECOUNT value on done: 1011729.0 [2024-08-06 08:41:36,734][52663] Sum rewards: 92.766, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.029', 'HEALTH': '0.084', 'weapon4': '0.136', 'AMMO4': '0.143', 'weapon5': '0.180', 'AMMO3': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.584', 'WEAPON3': '1.050', 'weapon3': '2.848', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.734', 'FRAGCOUNT': '73.000'} [2024-08-06 08:41:36,742][52650] Updated weights for policy 0, policy_version 86111 (0.0022) [2024-08-06 08:41:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 705429504. Throughput: 0: 4353.8. Samples: 176361200. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:37,794][52567] Avg episode reward: [(0, '76.799')] [2024-08-06 08:41:37,957][52664] Large shaping reward 3.381 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.33, 110.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:41:38,365][52794] DAMAGECOUNT value on done: 997846.0 [2024-08-06 08:41:38,367][52794] Sum rewards: 91.426, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'weapon4': '0.054', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.636', 'WEAPON3': '1.100', 'weapon3': '3.014', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '74.000'} [2024-08-06 08:41:38,691][52803] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:41:39,118][52647] DAMAGECOUNT value on done: 1046788.0 [2024-08-06 08:41:39,119][52647] Sum rewards: 72.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.660', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.076', 'weapon5': '0.198', 'AMMO4': '0.225', 'weapon2': '0.238', 'AMMO3': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.206', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '61.500'} [2024-08-06 08:41:39,629][52803] DAMAGECOUNT value on done: 948602.0 [2024-08-06 08:41:39,629][52803] Sum rewards: 76.117, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.388', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.112', 'AMMO4': '0.126', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.236', 'WEAPON3': '1.200', 'weapon3': '3.458', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '60.000'} [2024-08-06 08:41:39,732][52663] DAMAGECOUNT value on done: 994828.0 [2024-08-06 08:41:39,733][52663] Sum rewards: 76.160, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.834', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.044', 'AMMO4': '0.138', 'weapon5': '0.162', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.350', 'weapon3': '2.854', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:41,337][52794] DAMAGECOUNT value on done: 1001885.0 [2024-08-06 08:41:41,341][52794] Sum rewards: 85.373, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.224', 'AMMO5': '0.008', 'AMMO2': '0.046', 'weapon4': '0.048', 'weapon5': '0.102', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'AMMO3': '0.281', 'WEAPON3': '1.650', 'weapon3': '3.356', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.916', 'FRAGCOUNT': '73.000'} [2024-08-06 08:41:41,696][52647] DAMAGECOUNT value on done: 1058893.0 [2024-08-06 08:41:41,697][52647] Sum rewards: 81.916, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.552', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.094', 'weapon5': '0.146', 'AMMO3': '0.224', 'AMMO4': '0.268', 'weapon2': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.705', 'FRAGCOUNT': '69.000'} [2024-08-06 08:41:41,744][52650] Updated weights for policy 0, policy_version 86121 (0.0015) [2024-08-06 08:41:42,179][52666] Large shaping reward 3.632 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon3', 0.002)] [2024-08-06 08:41:42,399][52663] DAMAGECOUNT value on done: 993929.0 [2024-08-06 08:41:42,399][52663] Sum rewards: 71.817, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.634', 'AMMO2': '0.002', 'AMMO5': '0.003', 'WEAPON1': '0.010', 'AMMO4': '0.011', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.098', 'AMMO3': '0.144', 'weapon2': '0.608', 'WEAPON3': '0.950', 'weapon3': '3.084', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.055', 'FRAGCOUNT': '56.000'} [2024-08-06 08:41:42,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 705511424. Throughput: 0: 4358.9. Samples: 176387370. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:42,802][52567] Avg episode reward: [(0, '77.169')] [2024-08-06 08:41:42,983][52803] DAMAGECOUNT value on done: 932910.0 [2024-08-06 08:41:42,986][52803] Sum rewards: 78.055, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.830', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.026', 'weapon5': '0.072', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.223', 'weapon2': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '64.000'} [2024-08-06 08:41:44,420][52647] DAMAGECOUNT value on done: 1049033.0 [2024-08-06 08:41:44,421][52647] Sum rewards: 79.381, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.702', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.170', 'AMMO3': '0.189', 'AMMO4': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '2.806', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:44,572][52794] DAMAGECOUNT value on done: 1002433.0 [2024-08-06 08:41:44,573][52794] Sum rewards: 71.421, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.024', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.248', 'WEAPON3': '1.550', 'weapon3': '3.464', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.315', 'FRAGCOUNT': '60.000'} [2024-08-06 08:41:45,358][52794] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:41:45,494][52663] DAMAGECOUNT value on done: 1001142.0 [2024-08-06 08:41:45,494][52663] Sum rewards: 79.289, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.465', 'weapon4': '0.002', 'AMMO5': '0.009', 'AMMO2': '0.011', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.054', 'AMMO3': '0.159', 'WEAPON5': '0.200', 'weapon2': '0.666', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '62.000'} [2024-08-06 08:41:46,187][52803] DAMAGECOUNT value on done: 942145.0 [2024-08-06 08:41:46,188][52803] Sum rewards: 73.491, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.720', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon4': '0.204', 'AMMO3': '0.219', 'AMMO4': '0.230', 'weapon5': '0.292', 'weapon2': '0.316', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.868', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:46,292][52650] Updated weights for policy 0, policy_version 86131 (0.0033) [2024-08-06 08:41:47,123][52647] DAMAGECOUNT value on done: 1051724.0 [2024-08-06 08:41:47,123][52647] Sum rewards: 73.763, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.644', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.086', 'AMMO4': '0.133', 'weapon4': '0.140', 'WEAPON5': '0.150', 'weapon2': '0.196', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'WEAPON3': '1.600', 'weapon3': '3.350', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.771', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:47,195][52794] DAMAGECOUNT value on done: 994089.0 [2024-08-06 08:41:47,197][52794] Sum rewards: 65.965, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.067', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.114', 'weapon4': '0.156', 'AMMO4': '0.238', 'AMMO3': '0.242', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.440', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '58.000'} [2024-08-06 08:41:47,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 705601536. Throughput: 0: 4358.2. Samples: 176400350. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:47,795][52567] Avg episode reward: [(0, '77.263')] [2024-08-06 08:41:48,294][52663] DAMAGECOUNT value on done: 1002623.0 [2024-08-06 08:41:48,296][52663] Sum rewards: 67.649, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.020', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.138', 'weapon5': '0.246', 'AMMO3': '0.257', 'AMMO4': '0.279', 'weapon2': '0.294', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.990', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '58.000'} [2024-08-06 08:41:49,311][52803] DAMAGECOUNT value on done: 941538.0 [2024-08-06 08:41:49,317][52803] Sum rewards: 75.253, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.744', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.105', 'weapon5': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.140', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:49,907][52794] DAMAGECOUNT value on done: 1006952.0 [2024-08-06 08:41:49,909][52794] Sum rewards: 82.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.012', 'AMMO2': '0.066', 'weapon4': '0.070', 'weapon5': '0.156', 'AMMO3': '0.170', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO4': '0.329', 'WEAPON3': '1.000', 'weapon3': '3.282', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '66.000'} [2024-08-06 08:41:50,416][52820] DAMAGECOUNT value on done: 928451.0 [2024-08-06 08:41:50,417][52820] Sum rewards: 68.417, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.097', 'AMMO3': '0.166', 'weapon5': '0.178', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.340', 'HEALTH': '0.392', 'WEAPON3': '0.950', 'weapon3': '3.050', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.953', 'FRAGCOUNT': '53.000'} [2024-08-06 08:41:51,358][52650] Updated weights for policy 0, policy_version 86141 (0.0013) [2024-08-06 08:41:51,440][52663] DAMAGECOUNT value on done: 1006549.0 [2024-08-06 08:41:51,440][52663] Sum rewards: 74.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.919', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.164', 'AMMO3': '0.179', 'weapon5': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.384', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '60.000'} [2024-08-06 08:41:52,248][52803] DAMAGECOUNT value on done: 950552.0 [2024-08-06 08:41:52,248][52803] Sum rewards: 93.040, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.510', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.090', 'weapon4': '0.104', 'AMMO4': '0.146', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.272', 'WEAPON4': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '22.311', 'FRAGCOUNT': '77.000'} [2024-08-06 08:41:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 705691648. Throughput: 0: 4357.3. Samples: 176426480. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:52,802][52567] Avg episode reward: [(0, '77.541')] [2024-08-06 08:41:52,833][52794] DAMAGECOUNT value on done: 1004246.0 [2024-08-06 08:41:52,834][52794] Sum rewards: 85.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.718', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.092', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.424', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '71.000'} [2024-08-06 08:41:53,603][52820] DAMAGECOUNT value on done: 933542.0 [2024-08-06 08:41:53,604][52820] Sum rewards: 80.818, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.437', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.128', 'weapon5': '0.160', 'AMMO3': '0.179', 'AMMO4': '0.183', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.196', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '66.000'} [2024-08-06 08:41:54,258][52794] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:41:54,409][52663] DAMAGECOUNT value on done: 1004935.0 [2024-08-06 08:41:54,409][52663] Sum rewards: 81.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.340', 'AMMO5': '0.023', 'AMMO2': '0.052', 'AMMO3': '0.197', 'weapon5': '0.202', 'weapon4': '0.250', 'AMMO4': '0.258', 'weapon2': '0.388', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.902', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.305', 'FRAGCOUNT': '66.000'} [2024-08-06 08:41:55,130][52794] DAMAGECOUNT value on done: 995904.0 [2024-08-06 08:41:55,132][52794] Sum rewards: 72.979, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.958', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.018', 'weapon5': '0.048', 'AMMO4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.252', 'AMMO3': '0.262', 'WEAPON3': '1.750', 'weapon3': '3.502', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '63.000'} [2024-08-06 08:41:55,544][52803] DAMAGECOUNT value on done: 945562.0 [2024-08-06 08:41:55,544][52803] Sum rewards: 80.405, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.464', 'AMMO5': '0.019', 'AMMO2': '0.062', 'weapon4': '0.152', 'weapon2': '0.212', 'weapon5': '0.236', 'AMMO3': '0.270', 'AMMO4': '0.309', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.700', 'weapon3': '3.112', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '69.000'} [2024-08-06 08:41:55,732][52650] Updated weights for policy 0, policy_version 86151 (0.0028) [2024-08-06 08:41:56,769][52820] DAMAGECOUNT value on done: 934797.0 [2024-08-06 08:41:56,770][52820] Sum rewards: 65.372, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.118', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.030', 'weapon5': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.264', 'AMMO3': '0.276', 'WEAPON3': '1.550', 'HITCOUNT': '3.310', 'weapon3': '3.420', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '56.000'} [2024-08-06 08:41:57,454][52663] DAMAGECOUNT value on done: 1009165.0 [2024-08-06 08:41:57,455][52663] Sum rewards: 71.317, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.000', 'AMMO5': '0.014', 'AMMO2': '0.053', 'weapon4': '0.084', 'weapon5': '0.186', 'AMMO3': '0.237', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.648', 'WEAPON3': '1.400', 'weapon3': '2.844', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.678', 'FRAGCOUNT': '59.000'} [2024-08-06 08:41:57,726][52794] DAMAGECOUNT value on done: 1009383.0 [2024-08-06 08:41:57,727][52794] Sum rewards: 67.826, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.380', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon5': '0.134', 'weapon2': '0.152', 'AMMO3': '0.172', 'AMMO4': '0.175', 'WEAPON5': '0.200', 'WEAPON4': '0.450', 'weapon4': '0.586', 'WEAPON3': '1.100', 'weapon3': '2.906', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '15.678', 'FRAGCOUNT': '54.000'} [2024-08-06 08:41:57,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 705781760. Throughput: 0: 4359.6. Samples: 176452940. Policy #0 lag: (min: 1.0, avg: 4.3, max: 9.0) [2024-08-06 08:41:57,795][52567] Avg episode reward: [(0, '77.203')] [2024-08-06 08:41:58,410][52663] Large shaping reward 2.508 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.486, 162.0), ('weapon5', 0.002)] [2024-08-06 08:41:58,557][52803] DAMAGECOUNT value on done: 941852.0 [2024-08-06 08:41:58,558][52803] Sum rewards: 84.040, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.716', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.152', 'AMMO4': '0.167', 'weapon2': '0.198', 'AMMO3': '0.225', 'weapon4': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.196', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '69.000'} [2024-08-06 08:41:59,444][52670] DAMAGECOUNT value on done: 991461.0 [2024-08-06 08:41:59,444][52670] Sum rewards: 71.357, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.595', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.042', 'weapon5': '0.142', 'AMMO3': '0.200', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.344', 'WEAPON3': '1.200', 'HITCOUNT': '3.150', 'weapon3': '3.300', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '58.000'} [2024-08-06 08:41:59,956][52820] DAMAGECOUNT value on done: 922679.0 [2024-08-06 08:41:59,957][52820] Sum rewards: 73.116, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.096', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.208', 'weapon2': '0.370', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.370', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '61.000'} [2024-08-06 08:42:00,071][52663] DAMAGECOUNT value on done: 1016015.0 [2024-08-06 08:42:00,073][52663] Sum rewards: 68.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.048', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.166', 'AMMO3': '0.173', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.302', 'WEAPON3': '1.150', 'HITCOUNT': '3.030', 'weapon3': '3.056', 'DAMAGECOUNT': '15.969', 'FRAGCOUNT': '55.000'} [2024-08-06 08:42:00,610][52650] Updated weights for policy 0, policy_version 86161 (0.0030) [2024-08-06 08:42:00,799][52794] DAMAGECOUNT value on done: 1004252.0 [2024-08-06 08:42:00,799][52794] Sum rewards: 71.878, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.413', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.104', 'AMMO4': '0.187', 'AMMO3': '0.224', 'weapon5': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '2.814', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:02,419][52670] DAMAGECOUNT value on done: 1012263.0 [2024-08-06 08:42:02,421][52670] Sum rewards: 81.641, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.590', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.078', 'weapon5': '0.162', 'AMMO4': '0.193', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.186', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '66.000'} [2024-08-06 08:42:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 705863680. Throughput: 0: 4358.0. Samples: 176465880. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:02,795][52567] Avg episode reward: [(0, '77.171')] [2024-08-06 08:42:03,021][52663] DAMAGECOUNT value on done: 993917.0 [2024-08-06 08:42:03,022][52663] Sum rewards: 79.016, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.014', 'weapon4': '0.018', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.150', 'HEALTH': '0.220', 'weapon2': '0.732', 'WEAPON3': '0.900', 'weapon3': '3.064', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '17.889', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:03,156][52820] DAMAGECOUNT value on done: 932273.0 [2024-08-06 08:42:03,157][52820] Sum rewards: 66.177, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.424', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.149', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.400', 'HITCOUNT': '3.210', 'weapon3': '3.224', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '57.500'} [2024-08-06 08:42:03,440][52794] DAMAGECOUNT value on done: 1016882.0 [2024-08-06 08:42:03,441][52794] Sum rewards: 74.456, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.113', 'weapon5': '0.152', 'AMMO3': '0.239', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.586', 'WEAPON3': '1.450', 'weapon3': '2.960', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:05,208][52650] Updated weights for policy 0, policy_version 86171 (0.0026) [2024-08-06 08:42:05,284][52670] DAMAGECOUNT value on done: 993379.0 [2024-08-06 08:42:05,285][52670] Sum rewards: 90.692, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.035', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.061', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.348', 'WEAPON3': '1.400', 'weapon3': '3.368', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.582', 'FRAGCOUNT': '74.000'} [2024-08-06 08:42:06,315][52820] DAMAGECOUNT value on done: 918821.0 [2024-08-06 08:42:06,315][52820] Sum rewards: 75.405, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.026', 'weapon5': '0.080', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.159', 'weapon2': '0.440', 'WEAPON3': '1.050', 'weapon3': '3.284', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:06,432][52794] DAMAGECOUNT value on done: 998978.0 [2024-08-06 08:42:06,434][52794] Sum rewards: 74.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.140', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.090', 'weapon5': '0.100', 'AMMO4': '0.148', 'AMMO3': '0.152', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.744', 'WEAPON3': '0.950', 'weapon3': '2.934', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:07,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 705953792. Throughput: 0: 4358.7. Samples: 176492020. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:07,802][52567] Avg episode reward: [(0, '76.865')] [2024-08-06 08:42:08,298][52666] DAMAGECOUNT value on done: 1003795.0 [2024-08-06 08:42:08,298][52666] Sum rewards: 79.299, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.107', 'AMMO5': '0.011', 'AMMO2': '0.049', 'AMMO3': '0.181', 'weapon5': '0.198', 'AMMO4': '0.245', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.790', 'WEAPON3': '1.050', 'weapon3': '2.434', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:08,471][52670] DAMAGECOUNT value on done: 994703.0 [2024-08-06 08:42:08,472][52670] Sum rewards: 78.006, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.040', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.102', 'AMMO4': '0.149', 'AMMO3': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.150', 'weapon3': '3.348', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:09,306][52794] DAMAGECOUNT value on done: 1010041.0 [2024-08-06 08:42:09,307][52794] Sum rewards: 82.228, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.976', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.046', 'weapon5': '0.072', 'AMMO4': '0.166', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.274', 'WEAPON3': '1.400', 'weapon3': '3.418', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '69.000'} [2024-08-06 08:42:09,496][52820] DAMAGECOUNT value on done: 926307.0 [2024-08-06 08:42:09,497][52820] Sum rewards: 75.218, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.149', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.272', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:09,740][52650] Updated weights for policy 0, policy_version 86181 (0.0026) [2024-08-06 08:42:11,375][52666] DAMAGECOUNT value on done: 1005528.0 [2024-08-06 08:42:11,376][52666] Sum rewards: 85.311, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.011', 'AMMO2': '0.022', 'AMMO4': '0.110', 'weapon4': '0.124', 'weapon5': '0.132', 'AMMO3': '0.152', 'HEALTH': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '0.900', 'weapon3': '3.042', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:11,432][52670] DAMAGECOUNT value on done: 1005966.0 [2024-08-06 08:42:11,432][52670] Sum rewards: 69.774, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.170', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.092', 'AMMO4': '0.135', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.384', 'WEAPON3': '1.050', 'HITCOUNT': '3.240', 'weapon3': '3.320', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '56.000'} [2024-08-06 08:42:11,433][52668] DAMAGECOUNT value on done: 1015145.0 [2024-08-06 08:42:11,434][52668] Sum rewards: 72.984, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.476', 'AMMO5': '0.013', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'AMMO3': '0.158', 'weapon5': '0.158', 'AMMO4': '0.159', 'weapon4': '0.164', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.504', 'WEAPON3': '1.000', 'weapon3': '2.956', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:12,668][52794] DAMAGECOUNT value on done: 1006263.0 [2024-08-06 08:42:12,670][52794] Sum rewards: 81.071, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.010', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.056', 'weapon5': '0.118', 'AMMO4': '0.136', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.062', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.458', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:12,742][52820] DAMAGECOUNT value on done: 929705.0 [2024-08-06 08:42:12,743][52820] Sum rewards: 80.411, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'weapon4': '0.210', 'AMMO3': '0.225', 'weapon2': '0.254', 'WEAPON3': '1.500', 'weapon3': '3.302', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.746', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:12,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 706043904. Throughput: 0: 4361.3. Samples: 176518130. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:12,802][52567] Avg episode reward: [(0, '76.993')] [2024-08-06 08:42:14,079][52666] DAMAGECOUNT value on done: 1011354.0 [2024-08-06 08:42:14,079][52666] Sum rewards: 80.140, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.050', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.088', 'weapon5': '0.092', 'weapon4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'AMMO3': '0.293', 'WEAPON3': '1.750', 'weapon3': '3.142', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.367', 'FRAGCOUNT': '69.000'} [2024-08-06 08:42:14,256][52670] DAMAGECOUNT value on done: 996488.0 [2024-08-06 08:42:14,256][52670] Sum rewards: 69.191, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.476', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon4': '0.106', 'weapon5': '0.124', 'AMMO4': '0.205', 'AMMO3': '0.229', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.537', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:14,299][52668] DAMAGECOUNT value on done: 1013725.0 [2024-08-06 08:42:14,300][52668] Sum rewards: 90.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.062', 'AMMO4': '0.101', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '21.111', 'FRAGCOUNT': '73.000'} [2024-08-06 08:42:14,724][52650] Updated weights for policy 0, policy_version 86191 (0.0011) [2024-08-06 08:42:15,239][52794] DAMAGECOUNT value on done: 1014828.0 [2024-08-06 08:42:15,243][52794] Sum rewards: 78.347, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.372', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon5': '0.142', 'AMMO4': '0.144', 'AMMO3': '0.211', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.336', 'weapon4': '0.336', 'WEAPON3': '1.250', 'weapon3': '2.934', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '63.500'} [2024-08-06 08:42:15,856][52820] DAMAGECOUNT value on done: 935638.0 [2024-08-06 08:42:15,856][52820] Sum rewards: 79.687, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.340', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.178', 'AMMO3': '0.184', 'AMMO4': '0.185', 'weapon2': '0.188', 'weapon4': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:17,013][52666] DAMAGECOUNT value on done: 1004543.0 [2024-08-06 08:42:17,013][52666] Sum rewards: 71.651, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.990', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon5': '0.080', 'weapon4': '0.138', 'AMMO4': '0.207', 'AMMO3': '0.229', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.584', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:17,135][52668] DAMAGECOUNT value on done: 1007917.0 [2024-08-06 08:42:17,135][52668] Sum rewards: 73.872, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.470', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.103', 'AMMO3': '0.251', 'weapon2': '0.344', 'WEAPON3': '1.450', 'weapon3': '3.380', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:17,190][52670] DAMAGECOUNT value on done: 993137.0 [2024-08-06 08:42:17,192][52670] Sum rewards: 82.242, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.488', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.034', 'weapon5': '0.048', 'AMMO4': '0.133', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.316', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.457', 'FRAGCOUNT': '68.000'} [2024-08-06 08:42:17,794][52567] Fps is (10 sec: 17202.7, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 706125824. Throughput: 0: 4365.1. Samples: 176531270. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:17,795][52567] Avg episode reward: [(0, '77.100')] [2024-08-06 08:42:18,052][52794] DAMAGECOUNT value on done: 1019320.0 [2024-08-06 08:42:18,052][52794] Sum rewards: 74.818, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.254', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.038', 'weapon5': '0.066', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.440', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:18,950][52820] DAMAGECOUNT value on done: 943126.0 [2024-08-06 08:42:18,952][52820] Sum rewards: 78.680, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.706', 'AMMO5': '0.020', 'AMMO2': '0.034', 'weapon4': '0.070', 'AMMO4': '0.172', 'weapon2': '0.180', 'AMMO3': '0.186', 'weapon5': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.320', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:19,643][52668] DAMAGECOUNT value on done: 1014092.0 [2024-08-06 08:42:19,644][52668] Sum rewards: 70.123, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.064', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.066', 'weapon5': '0.136', 'AMMO4': '0.156', 'AMMO3': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON3': '1.700', 'weapon3': '3.146', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:19,646][52650] Updated weights for policy 0, policy_version 86201 (0.0011) [2024-08-06 08:42:19,659][52795] DAMAGECOUNT value on done: 927346.0 [2024-08-06 08:42:19,659][52795] Sum rewards: 82.037, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.349', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.122', 'AMMO4': '0.142', 'weapon5': '0.192', 'AMMO3': '0.234', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.126', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.121', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:20,182][52666] DAMAGECOUNT value on done: 997313.0 [2024-08-06 08:42:20,183][52666] Sum rewards: 71.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.770', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.078', 'AMMO4': '0.215', 'weapon5': '0.222', 'AMMO3': '0.225', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.538', 'WEAPON3': '1.400', 'weapon3': '2.910', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.436', 'FRAGCOUNT': '60.500'} [2024-08-06 08:42:20,301][52670] DAMAGECOUNT value on done: 994710.0 [2024-08-06 08:42:20,302][52670] Sum rewards: 72.630, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.004', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.110', 'AMMO3': '0.128', 'weapon5': '0.148', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.390', 'weapon4': '0.568', 'WEAPON3': '0.950', 'weapon3': '2.698', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.395', 'FRAGCOUNT': '58.000'} [2024-08-06 08:42:20,976][52794] DAMAGECOUNT value on done: 1008153.0 [2024-08-06 08:42:20,977][52794] Sum rewards: 86.628, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.628', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.088', 'weapon5': '0.106', 'AMMO3': '0.178', 'AMMO4': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.546', 'WEAPON3': '1.200', 'weapon3': '3.018', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '70.000'} [2024-08-06 08:42:21,951][52820] DAMAGECOUNT value on done: 924784.0 [2024-08-06 08:42:21,952][52820] Sum rewards: 79.466, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.444', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.048', 'AMMO4': '0.097', 'weapon5': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.362', 'WEAPON3': '1.350', 'weapon3': '3.210', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.184', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:22,455][52668] DAMAGECOUNT value on done: 1000210.0 [2024-08-06 08:42:22,456][52668] Sum rewards: 76.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.716', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.032', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.110', 'AMMO3': '0.221', 'weapon2': '0.346', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.618', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:22,738][52795] DAMAGECOUNT value on done: 921236.0 [2024-08-06 08:42:22,739][52795] Sum rewards: 81.209, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.387', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.070', 'AMMO4': '0.122', 'weapon5': '0.126', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '68.000'} [2024-08-06 08:42:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 706215936. Throughput: 0: 4358.7. Samples: 176557340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:22,794][52567] Avg episode reward: [(0, '76.699')] [2024-08-06 08:42:22,929][52666] DAMAGECOUNT value on done: 999312.0 [2024-08-06 08:42:22,930][52666] Sum rewards: 79.180, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon4': '0.136', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '66.000'} [2024-08-06 08:42:23,098][52670] DAMAGECOUNT value on done: 992993.0 [2024-08-06 08:42:23,098][52670] Sum rewards: 72.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.065', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.077', 'weapon5': '0.110', 'weapon4': '0.132', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '58.000'} [2024-08-06 08:42:23,859][52650] Updated weights for policy 0, policy_version 86211 (0.0032) [2024-08-06 08:42:25,063][52665] DAMAGECOUNT value on done: 994372.0 [2024-08-06 08:42:25,064][52665] Sum rewards: 78.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.562', 'AMMO2': '0.010', 'AMMO4': '0.050', 'weapon4': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:25,112][52820] DAMAGECOUNT value on done: 937926.0 [2024-08-06 08:42:25,113][52820] Sum rewards: 84.259, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.710', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.090', 'weapon5': '0.132', 'AMMO4': '0.174', 'weapon2': '0.202', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.298', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.739', 'FRAGCOUNT': '69.000'} [2024-08-06 08:42:25,638][52668] DAMAGECOUNT value on done: 1012251.0 [2024-08-06 08:42:25,641][52668] Sum rewards: 65.082, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.535', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.080', 'AMMO3': '0.173', 'AMMO4': '0.177', 'weapon5': '0.186', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.090', 'weapon3': '3.204', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 08:42:25,832][52795] DAMAGECOUNT value on done: 923611.0 [2024-08-06 08:42:25,832][52795] Sum rewards: 83.932, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.300', 'AMMO5': '0.017', 'AMMO2': '0.054', 'AMMO3': '0.160', 'weapon5': '0.236', 'weapon2': '0.246', 'AMMO4': '0.268', 'weapon4': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.836', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '20.556', 'FRAGCOUNT': '66.000'} [2024-08-06 08:42:26,177][52666] DAMAGECOUNT value on done: 1002237.0 [2024-08-06 08:42:26,178][52666] Sum rewards: 87.254, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.958', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.060', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.294', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '20.559', 'FRAGCOUNT': '73.000'} [2024-08-06 08:42:26,331][52670] DAMAGECOUNT value on done: 991558.0 [2024-08-06 08:42:26,331][52670] Sum rewards: 72.423, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.820', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.118', 'weapon5': '0.144', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.508', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:27,573][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:42:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 706297856. Throughput: 0: 4364.2. Samples: 176583760. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:27,802][52567] Avg episode reward: [(0, '77.062')] [2024-08-06 08:42:27,851][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086219_706306048.pth... [2024-08-06 08:42:27,888][52664] DAMAGECOUNT value on done: 1036860.0 [2024-08-06 08:42:27,888][52664] Sum rewards: 60.094, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.016', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.088', 'AMMO4': '0.140', 'AMMO3': '0.169', 'weapon5': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.394', 'WEAPON3': '1.000', 'HITCOUNT': '2.720', 'weapon3': '3.080', 'DAMAGECOUNT': '14.445', 'FRAGCOUNT': '48.500'} [2024-08-06 08:42:27,974][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085708_702119936.pth [2024-08-06 08:42:28,123][52820] DAMAGECOUNT value on done: 950034.0 [2024-08-06 08:42:28,125][52820] Sum rewards: 77.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.915', 'AMMO5': '0.004', 'AMMO2': '0.006', 'weapon4': '0.018', 'AMMO4': '0.030', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.195', 'weapon2': '0.418', 'WEAPON3': '1.400', 'weapon3': '3.378', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:28,228][52665] DAMAGECOUNT value on done: 1006395.0 [2024-08-06 08:42:28,229][52665] Sum rewards: 71.843, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.150', 'AMMO5': '0.021', 'AMMO2': '0.051', 'weapon4': '0.138', 'AMMO3': '0.195', 'AMMO4': '0.256', 'weapon5': '0.312', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.072', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:28,486][52668] DAMAGECOUNT value on done: 1011245.0 [2024-08-06 08:42:28,486][52668] Sum rewards: 81.495, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.178', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon5': '0.166', 'AMMO3': '0.192', 'weapon4': '0.216', 'AMMO4': '0.224', 'WEAPON5': '0.400', 'weapon2': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:28,928][52650] Updated weights for policy 0, policy_version 86221 (0.0037) [2024-08-06 08:42:28,946][52795] DAMAGECOUNT value on done: 939074.0 [2024-08-06 08:42:28,951][52795] Sum rewards: 74.221, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.108', 'AMMO5': '0.027', 'AMMO2': '0.068', 'AMMO3': '0.186', 'weapon4': '0.290', 'weapon5': '0.300', 'AMMO4': '0.341', 'weapon2': '0.392', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.200', 'weapon3': '2.674', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.501', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:29,191][52666] DAMAGECOUNT value on done: 993806.0 [2024-08-06 08:42:29,191][52666] Sum rewards: 84.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.222', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.554', 'FRAGCOUNT': '70.000'} [2024-08-06 08:42:29,334][52670] DAMAGECOUNT value on done: 1007941.0 [2024-08-06 08:42:29,340][52670] Sum rewards: 69.854, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.382', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.138', 'AMMO3': '0.141', 'weapon5': '0.180', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon4': '0.948', 'WEAPON3': '0.950', 'weapon3': '2.320', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '54.000'} [2024-08-06 08:42:30,878][52664] DAMAGECOUNT value on done: 1044921.0 [2024-08-06 08:42:30,879][52664] Sum rewards: 84.258, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.985', 'AMMO2': '0.004', 'AMMO5': '0.007', 'AMMO4': '0.020', 'weapon4': '0.022', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.150', 'AMMO3': '0.165', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.414', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.788', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:30,881][52667] DAMAGECOUNT value on done: 1004844.0 [2024-08-06 08:42:30,882][52667] Sum rewards: 76.448, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.110', 'AMMO5': '0.026', 'AMMO2': '0.039', 'weapon4': '0.108', 'AMMO3': '0.146', 'AMMO4': '0.196', 'weapon5': '0.306', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.650', 'WEAPON3': '0.900', 'weapon3': '3.004', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:31,232][52668] DAMAGECOUNT value on done: 1002930.0 [2024-08-06 08:42:31,232][52668] Sum rewards: 91.132, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.165', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.062', 'AMMO4': '0.084', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.256', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '4.230', 'DAMAGECOUNT': '21.399', 'FRAGCOUNT': '73.000'} [2024-08-06 08:42:31,286][52820] DAMAGECOUNT value on done: 936503.0 [2024-08-06 08:42:31,287][52820] Sum rewards: 73.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.917', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.184', 'AMMO3': '0.238', 'weapon5': '0.246', 'AMMO4': '0.286', 'weapon2': '0.390', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.880', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '60.500'} [2024-08-06 08:42:31,427][52665] DAMAGECOUNT value on done: 999353.0 [2024-08-06 08:42:31,428][52665] Sum rewards: 72.231, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.872', 'AMMO5': '0.011', 'AMMO2': '0.052', 'weapon4': '0.128', 'weapon5': '0.164', 'AMMO3': '0.239', 'AMMO4': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:32,177][52795] DAMAGECOUNT value on done: 922927.0 [2024-08-06 08:42:32,183][52795] Sum rewards: 66.891, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.140', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon5': '0.200', 'weapon4': '0.208', 'AMMO3': '0.231', 'AMMO4': '0.268', 'weapon2': '0.274', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.018', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:32,222][52666] DAMAGECOUNT value on done: 1008046.0 [2024-08-06 08:42:32,224][52666] Sum rewards: 83.523, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.794', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon5': '0.126', 'weapon4': '0.140', 'AMMO3': '0.151', 'AMMO4': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'WEAPON3': '0.950', 'weapon3': '3.244', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '66.000'} [2024-08-06 08:42:32,302][52670] DAMAGECOUNT value on done: 988031.0 [2024-08-06 08:42:32,303][52670] Sum rewards: 71.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.952', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.063', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '3.242', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.106', 'FRAGCOUNT': '58.000'} [2024-08-06 08:42:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 706387968. Throughput: 0: 4362.7. Samples: 176596670. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:32,795][52567] Avg episode reward: [(0, '77.019')] [2024-08-06 08:42:33,378][52664] DAMAGECOUNT value on done: 1050677.0 [2024-08-06 08:42:33,378][52664] Sum rewards: 86.264, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.232', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.064', 'AMMO4': '0.087', 'weapon5': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.230', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '70.000'} [2024-08-06 08:42:33,707][52667] DAMAGECOUNT value on done: 1022896.0 [2024-08-06 08:42:33,707][52667] Sum rewards: 81.409, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.880', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon4': '0.046', 'weapon5': '0.146', 'AMMO3': '0.161', 'AMMO4': '0.218', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.632', 'WEAPON3': '1.150', 'weapon3': '2.988', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:33,968][52650] Updated weights for policy 0, policy_version 86231 (0.0021) [2024-08-06 08:42:34,271][52668] DAMAGECOUNT value on done: 1005702.0 [2024-08-06 08:42:34,272][52668] Sum rewards: 73.535, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.821', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.100', 'AMMO4': '0.141', 'AMMO3': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.466', 'WEAPON3': '1.100', 'weapon3': '3.216', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.849', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:34,383][52820] DAMAGECOUNT value on done: 934227.0 [2024-08-06 08:42:34,384][52820] Sum rewards: 74.977, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.058', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.198', 'AMMO3': '0.205', 'AMMO4': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.398', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:34,613][52665] DAMAGECOUNT value on done: 1003113.0 [2024-08-06 08:42:34,615][52665] Sum rewards: 76.906, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.046', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.144', 'weapon5': '0.182', 'weapon2': '0.234', 'AMMO3': '0.236', 'AMMO4': '0.266', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:35,200][52666] DAMAGECOUNT value on done: 995868.0 [2024-08-06 08:42:35,202][52666] Sum rewards: 65.366, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.370', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.028', 'weapon5': '0.064', 'AMMO4': '0.073', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.226', 'AMMO3': '0.322', 'WEAPON3': '2.000', 'HITCOUNT': '3.380', 'weapon3': '3.400', 'DAMAGECOUNT': '17.172', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:35,295][52670] DAMAGECOUNT value on done: 1003033.0 [2024-08-06 08:42:35,297][52670] Sum rewards: 74.573, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.870', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.112', 'weapon5': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.228', 'weapon4': '0.264', 'WEAPON4': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.649', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:35,435][52795] DAMAGECOUNT value on done: 925594.0 [2024-08-06 08:42:35,435][52795] Sum rewards: 74.308, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.821', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.032', 'weapon5': '0.088', 'AMMO4': '0.099', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'weapon2': '0.238', 'WEAPON3': '1.300', 'weapon3': '3.456', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '61.000'} [2024-08-06 08:42:35,879][52664] DAMAGECOUNT value on done: 1037372.0 [2024-08-06 08:42:35,879][52664] Sum rewards: 81.728, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.044', 'weapon5': '0.120', 'AMMO4': '0.188', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.240', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.791', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:36,249][52667] DAMAGECOUNT value on done: 1017197.0 [2024-08-06 08:42:36,249][52667] Sum rewards: 79.535, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.332', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.124', 'AMMO4': '0.164', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:36,338][52820] Large shaping reward 2.589 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.5670000000000001, 189.0), ('weapon5', 0.002)] [2024-08-06 08:42:37,359][52668] DAMAGECOUNT value on done: 1012959.0 [2024-08-06 08:42:37,359][52668] Sum rewards: 88.431, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.135', 'AMMO5': '0.016', 'AMMO2': '0.033', 'weapon4': '0.164', 'AMMO4': '0.165', 'AMMO3': '0.169', 'weapon5': '0.210', 'weapon2': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '71.000'} [2024-08-06 08:42:37,402][52820] DAMAGECOUNT value on done: 937408.0 [2024-08-06 08:42:37,402][52820] Sum rewards: 80.172, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.385', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.030', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.210', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.436', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 706478080. Throughput: 0: 4364.4. Samples: 176622880. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:37,793][52665] DAMAGECOUNT value on done: 983080.0 [2024-08-06 08:42:37,797][52567] Avg episode reward: [(0, '76.916')] [2024-08-06 08:42:37,797][52665] Sum rewards: 69.044, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.821', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO4': '0.144', 'AMMO3': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.210', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.994', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.962', 'FRAGCOUNT': '53.000'} [2024-08-06 08:42:37,944][52650] Updated weights for policy 0, policy_version 86241 (0.0012) [2024-08-06 08:42:38,025][52666] DAMAGECOUNT value on done: 1003728.0 [2024-08-06 08:42:38,028][52666] Sum rewards: 76.173, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.450', 'AMMO5': '0.005', 'AMMO2': '0.043', 'weapon5': '0.086', 'weapon4': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'AMMO4': '0.216', 'WEAPON4': '0.250', 'weapon2': '0.376', 'WEAPON3': '1.300', 'weapon3': '3.212', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:38,158][52670] DAMAGECOUNT value on done: 1007292.0 [2024-08-06 08:42:38,160][52670] Sum rewards: 66.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.620', 'AMMO5': '0.014', 'AMMO2': '0.037', 'AMMO4': '0.186', 'weapon2': '0.188', 'AMMO3': '0.199', 'weapon5': '0.224', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.382', 'WEAPON3': '1.250', 'weapon3': '2.970', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.470', 'FRAGCOUNT': '55.000'} [2024-08-06 08:42:38,571][52795] DAMAGECOUNT value on done: 937929.0 [2024-08-06 08:42:38,573][52795] Sum rewards: 64.701, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.096', 'AMMO4': '0.171', 'weapon5': '0.182', 'AMMO3': '0.250', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.864', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.794', 'FRAGCOUNT': '55.000'} [2024-08-06 08:42:38,840][52664] DAMAGECOUNT value on done: 1054877.0 [2024-08-06 08:42:38,840][52664] Sum rewards: 82.256, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.855', 'AMMO5': '0.021', 'AMMO2': '0.061', 'weapon2': '0.178', 'weapon4': '0.204', 'weapon5': '0.210', 'AMMO3': '0.236', 'AMMO4': '0.306', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.500', 'weapon3': '3.102', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '69.000'} [2024-08-06 08:42:38,922][52667] DAMAGECOUNT value on done: 1020869.0 [2024-08-06 08:42:38,922][52667] Sum rewards: 76.993, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.035', 'AMMO5': '0.020', 'AMMO2': '0.048', 'AMMO3': '0.151', 'weapon5': '0.182', 'weapon4': '0.202', 'AMMO4': '0.240', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.714', 'WEAPON3': '1.000', 'weapon3': '2.626', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.465', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:39,663][52668] DAMAGECOUNT value on done: 1006643.0 [2024-08-06 08:42:39,664][52668] Sum rewards: 74.712, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.960', 'AMMO5': '0.021', 'AMMO2': '0.046', 'weapon5': '0.146', 'AMMO3': '0.167', 'AMMO4': '0.228', 'weapon2': '0.234', 'weapon4': '0.458', 'WEAPON5': '0.550', 'WEAPON4': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.862', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:40,739][52820] DAMAGECOUNT value on done: 935527.0 [2024-08-06 08:42:40,740][52820] Sum rewards: 68.905, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.910', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.070', 'weapon5': '0.152', 'AMMO4': '0.233', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.280', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:40,945][52665] DAMAGECOUNT value on done: 984803.0 [2024-08-06 08:42:40,946][52665] Sum rewards: 66.176, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.995', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.120', 'AMMO4': '0.164', 'AMMO3': '0.170', 'WEAPON4': '0.300', 'weapon2': '0.388', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.980', 'weapon3': '3.222', 'DAMAGECOUNT': '16.680', 'FRAGCOUNT': '53.000'} [2024-08-06 08:42:41,293][52666] DAMAGECOUNT value on done: 986624.0 [2024-08-06 08:42:41,293][52666] Sum rewards: 66.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon5': '0.188', 'AMMO3': '0.233', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.400', 'weapon3': '2.820', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '56.000'} [2024-08-06 08:42:41,377][52670] DAMAGECOUNT value on done: 1000062.0 [2024-08-06 08:42:41,377][52670] Sum rewards: 66.572, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.665', 'AMMO5': '0.004', 'AMMO2': '0.018', 'weapon5': '0.036', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'weapon2': '0.292', 'WEAPON3': '1.200', 'weapon3': '3.418', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '53.000'} [2024-08-06 08:42:41,445][52667] DAMAGECOUNT value on done: 1023937.0 [2024-08-06 08:42:41,445][52667] Sum rewards: 81.898, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.911', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.074', 'weapon5': '0.172', 'weapon2': '0.188', 'AMMO3': '0.212', 'AMMO4': '0.225', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.350', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '68.000'} [2024-08-06 08:42:41,519][52664] DAMAGECOUNT value on done: 1048747.0 [2024-08-06 08:42:41,519][52664] Sum rewards: 71.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.138', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.089', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.380', 'WEAPON3': '1.500', 'weapon3': '3.250', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.612', 'FRAGCOUNT': '61.000'} [2024-08-06 08:42:41,834][52795] DAMAGECOUNT value on done: 930262.0 [2024-08-06 08:42:41,835][52795] Sum rewards: 76.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.868', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'weapon5': '0.138', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.450', 'weapon3': '3.308', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:42,723][52668] DAMAGECOUNT value on done: 1005772.0 [2024-08-06 08:42:42,724][52668] Sum rewards: 76.218, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.366', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.128', 'weapon2': '0.162', 'AMMO4': '0.200', 'AMMO3': '0.265', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.400', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '66.000'} [2024-08-06 08:42:42,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 706560000. Throughput: 0: 4360.2. Samples: 176649150. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:42,794][52567] Avg episode reward: [(0, '76.381')] [2024-08-06 08:42:43,220][52650] Updated weights for policy 0, policy_version 86251 (0.0045) [2024-08-06 08:42:43,782][52820] DAMAGECOUNT value on done: 944735.0 [2024-08-06 08:42:43,783][52820] Sum rewards: 85.364, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.320', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.082', 'weapon5': '0.090', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.400', 'weapon3': '3.302', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.754', 'FRAGCOUNT': '70.000'} [2024-08-06 08:42:43,797][52665] DAMAGECOUNT value on done: 998128.0 [2024-08-06 08:42:43,798][52665] Sum rewards: 76.011, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.755', 'AMMO5': '0.021', 'AMMO2': '0.057', 'weapon4': '0.112', 'AMMO3': '0.201', 'AMMO4': '0.284', 'weapon5': '0.300', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.750', 'WEAPON3': '1.300', 'weapon3': '2.578', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:44,145][52666] DAMAGECOUNT value on done: 1012380.0 [2024-08-06 08:42:44,146][52666] Sum rewards: 76.686, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.210', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.054', 'AMMO4': '0.159', 'weapon5': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.256', 'weapon2': '0.522', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:44,268][52670] DAMAGECOUNT value on done: 985435.0 [2024-08-06 08:42:44,269][52670] Sum rewards: 71.377, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.242', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.074', 'AMMO4': '0.097', 'weapon2': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.302', 'WEAPON3': '1.900', 'weapon3': '3.438', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.378', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:44,531][52667] DAMAGECOUNT value on done: 1017713.0 [2024-08-06 08:42:44,535][52664] DAMAGECOUNT value on done: 1038834.0 [2024-08-06 08:42:44,533][52667] Sum rewards: 70.100, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.570', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.142', 'AMMO3': '0.153', 'AMMO4': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.400', 'WEAPON3': '0.900', 'HITCOUNT': '3.000', 'weapon3': '3.260', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '56.000'} [2024-08-06 08:42:44,535][52664] Sum rewards: 73.102, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.440', 'AMMO5': '0.018', 'AMMO2': '0.033', 'weapon4': '0.068', 'weapon5': '0.102', 'AMMO4': '0.166', 'AMMO3': '0.221', 'weapon2': '0.296', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:45,153][52795] DAMAGECOUNT value on done: 930569.0 [2024-08-06 08:42:45,153][52795] Sum rewards: 74.986, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.130', 'AMMO5': '0.016', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.162', 'weapon4': '0.254', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '2.866', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.506', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:45,393][52668] DAMAGECOUNT value on done: 996935.0 [2024-08-06 08:42:45,398][52668] Sum rewards: 74.753, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.280', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.106', 'weapon5': '0.116', 'AMMO4': '0.148', 'AMMO3': '0.240', 'weapon2': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.262', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:46,891][52820] DAMAGECOUNT value on done: 944985.0 [2024-08-06 08:42:46,891][52820] Sum rewards: 63.271, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.110', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon5': '0.124', 'weapon4': '0.132', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.297', 'weapon2': '0.416', 'WEAPON3': '1.700', 'HITCOUNT': '3.080', 'weapon3': '3.084', 'DAMAGECOUNT': '16.278', 'FRAGCOUNT': '57.000'} [2024-08-06 08:42:46,948][52665] DAMAGECOUNT value on done: 997428.0 [2024-08-06 08:42:46,948][52665] Sum rewards: 73.140, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.108', 'weapon5': '0.166', 'AMMO4': '0.178', 'AMMO3': '0.234', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:46,986][52664] DAMAGECOUNT value on done: 1039058.0 [2024-08-06 08:42:46,987][52664] Sum rewards: 74.426, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.764', 'AMMO5': '0.018', 'AMMO2': '0.053', 'AMMO3': '0.219', 'weapon5': '0.228', 'weapon4': '0.238', 'AMMO4': '0.264', 'weapon2': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.924', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '62.500'} [2024-08-06 08:42:47,108][52666] DAMAGECOUNT value on done: 1006649.0 [2024-08-06 08:42:47,109][52666] Sum rewards: 66.605, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.610', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.074', 'weapon5': '0.172', 'AMMO4': '0.200', 'AMMO3': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.424', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '56.000'} [2024-08-06 08:42:47,191][52670] DAMAGECOUNT value on done: 999879.0 [2024-08-06 08:42:47,191][52670] Sum rewards: 74.750, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.170', 'AMMO5': '0.015', 'AMMO2': '0.028', 'AMMO4': '0.138', 'weapon5': '0.152', 'AMMO3': '0.161', 'weapon4': '0.316', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.480', 'WEAPON3': '1.200', 'weapon3': '2.870', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:47,388][52650] Updated weights for policy 0, policy_version 86261 (0.0012) [2024-08-06 08:42:47,542][52667] DAMAGECOUNT value on done: 1013334.0 [2024-08-06 08:42:47,542][52667] Sum rewards: 79.550, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.065', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.239', 'weapon2': '0.512', 'WEAPON3': '1.500', 'weapon3': '3.168', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.373', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 706650112. Throughput: 0: 4364.0. Samples: 176662260. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:47,794][52567] Avg episode reward: [(0, '76.017')] [2024-08-06 08:42:47,819][52662] DAMAGECOUNT value on done: 1007104.0 [2024-08-06 08:42:47,821][52662] Sum rewards: 69.085, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.470', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.048', 'weapon5': '0.128', 'AMMO4': '0.172', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.600', 'weapon3': '3.192', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:48,104][52668] DAMAGECOUNT value on done: 997913.0 [2024-08-06 08:42:48,106][52668] Sum rewards: 68.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.004', 'AMMO5': '0.004', 'weapon4': '0.016', 'AMMO2': '0.019', 'weapon5': '0.036', 'AMMO4': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.228', 'weapon2': '0.466', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.392', 'FRAGCOUNT': '57.000'} [2024-08-06 08:42:48,441][52795] DAMAGECOUNT value on done: 937335.0 [2024-08-06 08:42:48,441][52795] Sum rewards: 75.383, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '0.010', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.140', 'weapon4': '0.146', 'AMMO4': '0.178', 'AMMO3': '0.179', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.708', 'WEAPON3': '1.000', 'weapon3': '2.822', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.213', 'FRAGCOUNT': '59.000'} [2024-08-06 08:42:49,690][52666] DAMAGECOUNT value on done: 1005511.0 [2024-08-06 08:42:49,690][52666] Sum rewards: 74.880, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.196', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.102', 'weapon4': '0.106', 'weapon5': '0.164', 'WEAPON4': '0.200', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.572', 'WEAPON3': '1.500', 'weapon3': '2.908', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:49,768][52670] DAMAGECOUNT value on done: 1008336.0 [2024-08-06 08:42:49,770][52670] Sum rewards: 80.416, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.110', 'AMMO2': '0.021', 'AMMO4': '0.103', 'AMMO3': '0.191', 'weapon2': '0.600', 'WEAPON3': '1.200', 'weapon3': '3.238', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:49,838][52664] DAMAGECOUNT value on done: 1048010.0 [2024-08-06 08:42:49,840][52664] Sum rewards: 90.062, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.977', 'AMMO5': '0.018', 'AMMO2': '0.064', 'weapon4': '0.108', 'AMMO3': '0.155', 'AMMO4': '0.320', 'weapon5': '0.322', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'weapon2': '0.570', 'WEAPON3': '0.950', 'weapon3': '2.754', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '21.138', 'FRAGCOUNT': '69.000'} [2024-08-06 08:42:50,073][52665] DAMAGECOUNT value on done: 1002214.0 [2024-08-06 08:42:50,073][52665] Sum rewards: 80.086, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.226', 'AMMO5': '0.004', 'AMMO2': '0.025', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.125', 'weapon4': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.202', 'weapon2': '0.702', 'WEAPON3': '1.200', 'weapon3': '2.984', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.143', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:50,096][52820] DAMAGECOUNT value on done: 930406.0 [2024-08-06 08:42:50,098][52820] Sum rewards: 65.339, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.405', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO3': '0.160', 'AMMO4': '0.168', 'weapon4': '0.182', 'weapon5': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '2.858', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '51.000'} [2024-08-06 08:42:50,317][52667] DAMAGECOUNT value on done: 1010775.0 [2024-08-06 08:42:50,317][52667] Sum rewards: 88.672, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.600', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.018', 'weapon5': '0.042', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'weapon2': '0.498', 'WEAPON3': '0.950', 'weapon3': '3.348', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '69.000'} [2024-08-06 08:42:50,902][52662] DAMAGECOUNT value on done: 1015381.0 [2024-08-06 08:42:50,904][52662] Sum rewards: 65.792, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.670', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.060', 'weapon5': '0.084', 'AMMO4': '0.102', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.257', 'weapon2': '0.436', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '57.000'} [2024-08-06 08:42:51,158][52668] DAMAGECOUNT value on done: 988739.0 [2024-08-06 08:42:51,160][52668] Sum rewards: 80.418, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.221', 'AMMO2': '0.010', 'AMMO5': '0.012', 'AMMO4': '0.048', 'weapon5': '0.124', 'AMMO3': '0.160', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.364', 'weapon4': '0.364', 'WEAPON3': '1.000', 'weapon3': '2.830', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:51,606][52795] DAMAGECOUNT value on done: 932253.0 [2024-08-06 08:42:51,607][52795] Sum rewards: 63.820, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.720', 'AMMO5': '0.009', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon2': '0.116', 'weapon5': '0.128', 'AMMO3': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.412', 'WEAPON3': '1.400', 'HITCOUNT': '2.900', 'weapon3': '3.162', 'DAMAGECOUNT': '14.709', 'FRAGCOUNT': '54.000'} [2024-08-06 08:42:52,363][52650] Updated weights for policy 0, policy_version 86271 (0.0031) [2024-08-06 08:42:52,439][52664] DAMAGECOUNT value on done: 1043474.0 [2024-08-06 08:42:52,440][52664] Sum rewards: 75.845, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.596', 'AMMO5': '0.006', 'AMMO2': '0.013', 'weapon4': '0.030', 'weapon5': '0.046', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.236', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '65.000'} [2024-08-06 08:42:52,590][52666] DAMAGECOUNT value on done: 995955.0 [2024-08-06 08:42:52,591][52666] Sum rewards: 73.112, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.450', 'AMMO5': '0.026', 'AMMO2': '0.043', 'weapon4': '0.118', 'weapon5': '0.182', 'AMMO3': '0.198', 'AMMO4': '0.215', 'WEAPON4': '0.450', 'weapon2': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.928', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.621', 'FRAGCOUNT': '59.500'} [2024-08-06 08:42:52,682][52670] DAMAGECOUNT value on done: 1002364.0 [2024-08-06 08:42:52,682][52670] Sum rewards: 85.291, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.170', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.078', 'weapon4': '0.162', 'AMMO4': '0.192', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '71.000'} [2024-08-06 08:42:52,704][52659] DAMAGECOUNT value on done: 1008594.0 [2024-08-06 08:42:52,709][52659] Sum rewards: 76.163, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.916', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.046', 'AMMO4': '0.116', 'weapon5': '0.122', 'AMMO3': '0.168', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.050', 'HITCOUNT': '3.180', 'weapon3': '3.400', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '61.000'} [2024-08-06 08:42:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 706740224. Throughput: 0: 4362.7. Samples: 176688340. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:52,794][52567] Avg episode reward: [(0, '75.898')] [2024-08-06 08:42:53,039][52667] DAMAGECOUNT value on done: 1016434.0 [2024-08-06 08:42:53,040][52667] Sum rewards: 82.330, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.198', 'AMMO5': '0.015', 'AMMO2': '0.055', 'weapon4': '0.068', 'AMMO3': '0.232', 'weapon5': '0.248', 'AMMO4': '0.275', 'weapon2': '0.388', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.022', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.425', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:53,279][52665] DAMAGECOUNT value on done: 994897.0 [2024-08-06 08:42:53,282][52665] Sum rewards: 81.460, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.280', 'AMMO5': '0.006', 'AMMO2': '0.030', 'weapon4': '0.034', 'weapon5': '0.076', 'AMMO4': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '3.230', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:53,834][52662] DAMAGECOUNT value on done: 1017103.0 [2024-08-06 08:42:53,834][52662] Sum rewards: 85.442, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.994', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.155', 'weapon4': '0.210', 'weapon2': '0.262', 'AMMO3': '0.281', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.084', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.102', 'FRAGCOUNT': '72.000'} [2024-08-06 08:42:53,978][52668] DAMAGECOUNT value on done: 1005863.0 [2024-08-06 08:42:53,980][52668] Sum rewards: 64.465, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.220', 'AMMO5': '0.018', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.172', 'AMMO4': '0.176', 'AMMO3': '0.267', 'WEAPON4': '0.300', 'weapon2': '0.380', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.090', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '55.000'} [2024-08-06 08:42:54,878][52664] DAMAGECOUNT value on done: 1053477.0 [2024-08-06 08:42:54,878][52664] Sum rewards: 83.782, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.190', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.034', 'AMMO4': '0.081', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.206', 'weapon2': '0.212', 'WEAPON3': '1.300', 'weapon3': '3.464', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.488', 'FRAGCOUNT': '69.000'} [2024-08-06 08:42:54,901][52795] DAMAGECOUNT value on done: 922688.0 [2024-08-06 08:42:54,902][52795] Sum rewards: 74.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.056', 'weapon5': '0.090', 'AMMO4': '0.121', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.318', 'WEAPON3': '1.350', 'weapon3': '3.250', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.174', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:55,066][52670] DAMAGECOUNT value on done: 1000949.0 [2024-08-06 08:42:55,068][52670] Sum rewards: 74.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.850', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.084', 'AMMO4': '0.134', 'weapon5': '0.162', 'AMMO3': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '2.958', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '62.000'} [2024-08-06 08:42:55,169][52666] DAMAGECOUNT value on done: 993549.0 [2024-08-06 08:42:55,170][52666] Sum rewards: 69.900, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.540', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.150', 'weapon4': '0.168', 'AMMO4': '0.213', 'AMMO3': '0.268', 'weapon2': '0.346', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.082', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.288', 'FRAGCOUNT': '60.000'} [2024-08-06 08:42:55,825][52659] DAMAGECOUNT value on done: 1009054.0 [2024-08-06 08:42:55,825][52659] Sum rewards: 83.963, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.654', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.175', 'weapon2': '0.232', 'AMMO3': '0.270', 'WEAPON3': '1.700', 'weapon3': '3.392', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.550', 'FRAGCOUNT': '71.000'} [2024-08-06 08:42:55,894][52667] DAMAGECOUNT value on done: 1019574.0 [2024-08-06 08:42:55,895][52667] Sum rewards: 75.026, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.354', 'AMMO2': '0.031', 'weapon4': '0.046', 'WEAPON4': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.225', 'weapon2': '0.520', 'WEAPON3': '1.550', 'weapon3': '3.312', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:56,375][52665] DAMAGECOUNT value on done: 1009613.0 [2024-08-06 08:42:56,375][52665] Sum rewards: 78.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.696', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.044', 'weapon5': '0.088', 'AMMO4': '0.133', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.268', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:56,824][52650] Updated weights for policy 0, policy_version 86281 (0.0019) [2024-08-06 08:42:56,964][52668] DAMAGECOUNT value on done: 1006796.0 [2024-08-06 08:42:56,967][52668] Sum rewards: 78.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.851', 'AMMO5': '0.006', 'AMMO2': '0.036', 'weapon4': '0.054', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.179', 'AMMO3': '0.197', 'weapon2': '0.344', 'WEAPON3': '1.100', 'weapon3': '3.340', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:57,182][52662] DAMAGECOUNT value on done: 1007905.0 [2024-08-06 08:42:57,182][52662] Sum rewards: 65.916, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.910', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.112', 'weapon5': '0.122', 'AMMO4': '0.163', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.718', 'WEAPON3': '1.450', 'weapon3': '2.812', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '56.000'} [2024-08-06 08:42:57,335][52664] DAMAGECOUNT value on done: 1051507.0 [2024-08-06 08:42:57,335][52664] Sum rewards: 78.863, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.646', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.155', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.252', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.975', 'FRAGCOUNT': '66.000'} [2024-08-06 08:42:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 706822144. Throughput: 0: 4364.0. Samples: 176714510. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:42:57,794][52567] Avg episode reward: [(0, '75.733')] [2024-08-06 08:42:58,074][52795] DAMAGECOUNT value on done: 930396.0 [2024-08-06 08:42:58,074][52795] Sum rewards: 84.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.826', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.158', 'weapon4': '0.180', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.308', 'WEAPON3': '1.300', 'weapon3': '3.138', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.427', 'FRAGCOUNT': '69.500'} [2024-08-06 08:42:58,216][52666] DAMAGECOUNT value on done: 1015274.0 [2024-08-06 08:42:58,218][52666] Sum rewards: 75.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.073', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.082', 'weapon5': '0.090', 'AMMO4': '0.167', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:58,478][52667] DAMAGECOUNT value on done: 1007104.0 [2024-08-06 08:42:58,479][52667] Sum rewards: 87.914, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.395', 'AMMO5': '0.018', 'AMMO2': '0.044', 'AMMO3': '0.168', 'AMMO4': '0.219', 'weapon2': '0.240', 'weapon5': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.410', 'WEAPON3': '1.100', 'weapon3': '2.698', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '70.000'} [2024-08-06 08:42:58,929][52659] DAMAGECOUNT value on done: 1020060.0 [2024-08-06 08:42:58,929][52659] Sum rewards: 83.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.558', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon5': '0.154', 'AMMO3': '0.168', 'AMMO4': '0.175', 'weapon2': '0.214', 'WEAPON4': '0.300', 'weapon4': '0.374', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.016', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '67.000'} [2024-08-06 08:42:59,491][52665] DAMAGECOUNT value on done: 1002889.0 [2024-08-06 08:42:59,492][52665] Sum rewards: 78.598, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.286', 'AMMO5': '0.008', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.128', 'AMMO3': '0.191', 'weapon4': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.348', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '63.000'} [2024-08-06 08:42:59,757][52662] DAMAGECOUNT value on done: 1023209.0 [2024-08-06 08:42:59,758][52662] Sum rewards: 76.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.423', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.070', 'weapon5': '0.210', 'AMMO4': '0.216', 'weapon2': '0.274', 'AMMO3': '0.280', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.182', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.350', 'FRAGCOUNT': '64.000'} [2024-08-06 08:42:59,978][52649] DAMAGECOUNT value on done: 978514.0 [2024-08-06 08:42:59,986][52649] Sum rewards: 81.872, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.325', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon5': '0.070', 'weapon4': '0.120', 'AMMO4': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.326', 'WEAPON3': '1.350', 'weapon3': '3.300', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '68.000'} [2024-08-06 08:43:00,015][52668] DAMAGECOUNT value on done: 1006684.0 [2024-08-06 08:43:00,019][52668] Sum rewards: 71.361, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.110', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.032', 'weapon5': '0.086', 'AMMO3': '0.158', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.414', 'WEAPON3': '1.000', 'HITCOUNT': '3.300', 'weapon3': '3.302', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '57.000'} [2024-08-06 08:43:00,523][52664] DAMAGECOUNT value on done: 1048516.0 [2024-08-06 08:43:00,524][52664] Sum rewards: 68.278, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.208', 'AMMO5': '0.023', 'AMMO2': '0.075', 'weapon4': '0.234', 'AMMO3': '0.264', 'weapon5': '0.270', 'AMMO4': '0.376', 'weapon2': '0.472', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.632', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.719', 'FRAGCOUNT': '59.000'} [2024-08-06 08:43:00,974][52666] DAMAGECOUNT value on done: 987870.0 [2024-08-06 08:43:00,975][52666] Sum rewards: 74.029, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.510', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.042', 'weapon5': '0.110', 'AMMO4': '0.153', 'weapon2': '0.244', 'AMMO3': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.380', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:01,244][52795] DAMAGECOUNT value on done: 936132.0 [2024-08-06 08:43:01,244][52795] Sum rewards: 68.284, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.440', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.074', 'weapon5': '0.140', 'weapon2': '0.226', 'AMMO3': '0.265', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'HITCOUNT': '3.200', 'weapon3': '3.284', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:01,495][52650] Updated weights for policy 0, policy_version 86291 (0.0011) [2024-08-06 08:43:01,620][52667] DAMAGECOUNT value on done: 1007585.0 [2024-08-06 08:43:01,623][52667] Sum rewards: 69.693, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.666', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.046', 'AMMO4': '0.095', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.182', 'AMMO3': '0.183', 'WEAPON3': '1.200', 'HITCOUNT': '2.960', 'weapon3': '3.672', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '58.000'} [2024-08-06 08:43:01,641][52659] DAMAGECOUNT value on done: 1014790.0 [2024-08-06 08:43:01,642][52659] Sum rewards: 94.910, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.746', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.122', 'AMMO4': '0.124', 'weapon5': '0.124', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.350', 'weapon3': '3.134', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '22.533', 'FRAGCOUNT': '76.000'} [2024-08-06 08:43:02,121][52665] DAMAGECOUNT value on done: 999114.0 [2024-08-06 08:43:02,121][52665] Sum rewards: 58.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.384', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.134', 'weapon5': '0.172', 'AMMO4': '0.176', 'AMMO3': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.946', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '48.000'} [2024-08-06 08:43:02,684][52649] DAMAGECOUNT value on done: 971474.0 [2024-08-06 08:43:02,684][52649] Sum rewards: 74.716, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.036', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.156', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.662', 'WEAPON3': '1.300', 'weapon3': '2.988', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 706912256. Throughput: 0: 4362.7. Samples: 176727590. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:02,794][52567] Avg episode reward: [(0, '75.726')] [2024-08-06 08:43:02,860][52662] DAMAGECOUNT value on done: 1000239.0 [2024-08-06 08:43:02,860][52662] Sum rewards: 74.504, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.806', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.160', 'weapon2': '0.192', 'AMMO3': '0.230', 'AMMO4': '0.269', 'weapon5': '0.296', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '2.990', 'weapon3': '3.056', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:03,046][52668] DAMAGECOUNT value on done: 1007208.0 [2024-08-06 08:43:03,047][52668] Sum rewards: 79.830, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.087', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.098', 'weapon5': '0.148', 'AMMO3': '0.242', 'weapon2': '0.254', 'AMMO4': '0.270', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:03,299][52649] Large shaping reward 2.601 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.579, 193.0), ('weapon5', 0.002)] [2024-08-06 08:43:03,612][52664] DAMAGECOUNT value on done: 1060847.0 [2024-08-06 08:43:03,612][52664] Sum rewards: 73.022, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.459', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.157', 'weapon2': '0.164', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.340', 'WEAPON3': '1.000', 'weapon3': '2.902', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '58.000'} [2024-08-06 08:43:04,067][52667] DAMAGECOUNT value on done: 1017827.0 [2024-08-06 08:43:04,067][52667] Sum rewards: 81.067, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.165', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.134', 'AMMO3': '0.170', 'AMMO4': '0.177', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.294', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.842', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '65.000'} [2024-08-06 08:43:04,348][52666] DAMAGECOUNT value on done: 1000787.0 [2024-08-06 08:43:04,349][52666] Sum rewards: 72.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.020', 'AMMO2': '0.053', 'weapon4': '0.132', 'AMMO3': '0.177', 'weapon5': '0.190', 'weapon2': '0.240', 'AMMO4': '0.265', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:04,546][52795] DAMAGECOUNT value on done: 920986.0 [2024-08-06 08:43:04,546][52795] Sum rewards: 82.504, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.401', 'AMMO5': '0.014', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO4': '0.148', 'weapon5': '0.164', 'AMMO3': '0.175', 'weapon2': '0.284', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.280', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.002', 'FRAGCOUNT': '69.000'} [2024-08-06 08:43:04,685][52659] DAMAGECOUNT value on done: 1004471.0 [2024-08-06 08:43:04,687][52659] Sum rewards: 66.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.858', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.161', 'weapon5': '0.180', 'weapon4': '0.188', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'weapon2': '0.408', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.958', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.825', 'FRAGCOUNT': '54.500'} [2024-08-06 08:43:04,781][52665] DAMAGECOUNT value on done: 999087.0 [2024-08-06 08:43:04,781][52665] Sum rewards: 67.539, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.255', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.064', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.204', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.518', 'DAMAGECOUNT': '16.644', 'FRAGCOUNT': '57.000'} [2024-08-06 08:43:05,694][52649] DAMAGECOUNT value on done: 989619.0 [2024-08-06 08:43:05,695][52649] Sum rewards: 80.363, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.116', 'AMMO5': '0.012', 'AMMO2': '0.036', 'AMMO4': '0.181', 'weapon2': '0.202', 'weapon5': '0.202', 'weapon4': '0.250', 'AMMO3': '0.291', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.804', 'FRAGCOUNT': '70.000'} [2024-08-06 08:43:05,797][52811] DAMAGECOUNT value on done: 953214.0 [2024-08-06 08:43:05,797][52811] Sum rewards: 64.060, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.046', 'AMMO5': '0.022', 'AMMO2': '0.057', 'weapon4': '0.172', 'AMMO3': '0.245', 'weapon5': '0.260', 'AMMO4': '0.284', 'weapon2': '0.370', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.938', 'HITCOUNT': '2.960', 'DAMAGECOUNT': '16.299', 'FRAGCOUNT': '53.500'} [2024-08-06 08:43:05,980][52662] DAMAGECOUNT value on done: 1003902.0 [2024-08-06 08:43:05,983][52662] Sum rewards: 84.840, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.999', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.084', 'weapon5': '0.088', 'AMMO4': '0.120', 'WEAPON5': '0.200', 'weapon2': '0.212', 'AMMO3': '0.235', 'WEAPON4': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '71.000'} [2024-08-06 08:43:06,113][52668] DAMAGECOUNT value on done: 1011865.0 [2024-08-06 08:43:06,115][52668] Sum rewards: 86.113, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.512', 'AMMO2': '0.000', 'AMMO4': '0.001', 'weapon2': '0.110', 'AMMO3': '0.218', 'WEAPON3': '1.350', 'weapon3': '3.760', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '71.000'} [2024-08-06 08:43:06,136][52664] DAMAGECOUNT value on done: 1057881.0 [2024-08-06 08:43:06,137][52664] Sum rewards: 87.201, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.698', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.044', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.181', 'weapon2': '0.664', 'WEAPON3': '1.100', 'weapon3': '3.130', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '19.638', 'FRAGCOUNT': '70.000'} [2024-08-06 08:43:06,535][52650] Updated weights for policy 0, policy_version 86301 (0.0013) [2024-08-06 08:43:06,877][52667] DAMAGECOUNT value on done: 1007333.0 [2024-08-06 08:43:06,878][52667] Sum rewards: 72.237, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.547', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.154', 'weapon5': '0.154', 'AMMO4': '0.173', 'AMMO3': '0.192', 'WEAPON4': '0.400', 'weapon2': '0.402', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.008', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:07,412][52659] DAMAGECOUNT value on done: 1011870.0 [2024-08-06 08:43:07,412][52659] Sum rewards: 80.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.660', 'AMMO5': '0.019', 'AMMO2': '0.053', 'AMMO3': '0.215', 'weapon5': '0.224', 'weapon4': '0.232', 'weapon2': '0.264', 'AMMO4': '0.267', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.450', 'weapon3': '2.972', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:07,750][52665] DAMAGECOUNT value on done: 997950.0 [2024-08-06 08:43:07,750][52665] Sum rewards: 90.013, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.904', 'AMMO5': '0.017', 'AMMO2': '0.048', 'AMMO4': '0.238', 'weapon4': '0.248', 'AMMO3': '0.254', 'weapon5': '0.264', 'weapon2': '0.430', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.672', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '23.166', 'FRAGCOUNT': '74.000'} [2024-08-06 08:43:07,757][52795] DAMAGECOUNT value on done: 933175.0 [2024-08-06 08:43:07,758][52795] Sum rewards: 82.972, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.126', 'AMMO4': '0.164', 'AMMO3': '0.211', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.300', 'weapon3': '3.224', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.528', 'FRAGCOUNT': '68.000'} [2024-08-06 08:43:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.2, 300 sec: 17439.3). Total num frames: 707002368. Throughput: 0: 4367.8. Samples: 176753890. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:07,794][52567] Avg episode reward: [(0, '75.775')] [2024-08-06 08:43:08,646][52649] DAMAGECOUNT value on done: 989102.0 [2024-08-06 08:43:08,647][52649] Sum rewards: 52.765, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon5': '0.200', 'weapon4': '0.212', 'AMMO3': '0.214', 'weapon2': '0.228', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '2.450', 'weapon3': '3.096', 'DAMAGECOUNT': '13.191', 'FRAGCOUNT': '45.000'} [2024-08-06 08:43:08,823][52662] DAMAGECOUNT value on done: 1025312.0 [2024-08-06 08:43:08,826][52662] Sum rewards: 84.158, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.020', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.204', 'weapon2': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.236', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.205', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:08,862][52811] DAMAGECOUNT value on done: 937820.0 [2024-08-06 08:43:08,862][52811] Sum rewards: 62.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.654', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon5': '0.188', 'AMMO3': '0.209', 'AMMO4': '0.219', 'weapon2': '0.326', 'weapon4': '0.346', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.428', 'FRAGCOUNT': '53.000'} [2024-08-06 08:43:09,094][52664] DAMAGECOUNT value on done: 1057332.0 [2024-08-06 08:43:09,094][52664] Sum rewards: 93.050, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.620', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.102', 'weapon2': '0.192', 'AMMO3': '0.226', 'WEAPON3': '1.300', 'weapon3': '3.460', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.621', 'FRAGCOUNT': '76.000'} [2024-08-06 08:43:09,641][52667] DAMAGECOUNT value on done: 1016099.0 [2024-08-06 08:43:09,641][52667] Sum rewards: 79.093, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.850', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.146', 'weapon2': '0.204', 'AMMO4': '0.223', 'AMMO3': '0.245', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '67.000'} [2024-08-06 08:43:10,433][52659] DAMAGECOUNT value on done: 1012056.0 [2024-08-06 08:43:10,436][52659] Sum rewards: 79.427, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.885', 'AMMO5': '0.005', 'AMMO2': '0.034', 'weapon5': '0.092', 'weapon4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.169', 'WEAPON4': '0.250', 'AMMO3': '0.285', 'weapon2': '0.364', 'WEAPON3': '1.800', 'weapon3': '3.228', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.085', 'FRAGCOUNT': '68.000'} [2024-08-06 08:43:10,587][52665] DAMAGECOUNT value on done: 1000993.0 [2024-08-06 08:43:10,589][52665] Sum rewards: 65.570, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.564', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.076', 'AMMO4': '0.214', 'weapon5': '0.226', 'AMMO3': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.486', 'WEAPON3': '1.400', 'weapon3': '2.942', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '57.000'} [2024-08-06 08:43:10,897][52650] Updated weights for policy 0, policy_version 86311 (0.0011) [2024-08-06 08:43:10,991][52795] DAMAGECOUNT value on done: 931295.0 [2024-08-06 08:43:10,991][52795] Sum rewards: 79.401, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.375', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.036', 'weapon5': '0.118', 'AMMO4': '0.144', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.150', 'weapon3': '3.446', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.248', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:11,542][52660] DAMAGECOUNT value on done: 1006663.0 [2024-08-06 08:43:11,542][52660] Sum rewards: 74.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon2': '0.188', 'AMMO3': '0.211', 'weapon4': '0.214', 'AMMO4': '0.238', 'weapon5': '0.254', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '61.000'} [2024-08-06 08:43:11,567][52649] DAMAGECOUNT value on done: 981306.0 [2024-08-06 08:43:11,567][52649] Sum rewards: 77.582, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.018', 'AMMO2': '0.022', 'AMMO4': '0.111', 'AMMO3': '0.180', 'weapon5': '0.230', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.518', 'WEAPON3': '1.250', 'weapon3': '2.688', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:11,735][52662] DAMAGECOUNT value on done: 1009156.0 [2024-08-06 08:43:11,735][52662] Sum rewards: 69.173, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.505', 'AMMO5': '0.026', 'AMMO2': '0.064', 'weapon5': '0.072', 'weapon4': '0.122', 'weapon2': '0.222', 'AMMO3': '0.253', 'AMMO4': '0.320', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.264', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:11,743][52811] DAMAGECOUNT value on done: 933391.0 [2024-08-06 08:43:11,744][52811] Sum rewards: 77.257, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.032', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.432', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.050', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:11,995][52664] DAMAGECOUNT value on done: 1039696.0 [2024-08-06 08:43:11,995][52664] Sum rewards: 77.765, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.567', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.026', 'AMMO4': '0.089', 'weapon5': '0.090', 'AMMO3': '0.141', 'WEAPON4': '0.150', 'WEAPON5': '0.250', 'WEAPON3': '1.000', 'weapon2': '1.112', 'weapon3': '2.628', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 08:43:12,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 707084288. Throughput: 0: 4364.7. Samples: 176780170. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:12,794][52567] Avg episode reward: [(0, '75.773')] [2024-08-06 08:43:12,906][52667] DAMAGECOUNT value on done: 1021161.0 [2024-08-06 08:43:12,908][52667] Sum rewards: 72.158, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.675', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.088', 'AMMO4': '0.121', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.258', 'WEAPON3': '1.600', 'HITCOUNT': '3.300', 'weapon3': '3.386', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:13,406][52659] DAMAGECOUNT value on done: 1010522.0 [2024-08-06 08:43:13,407][52659] Sum rewards: 76.984, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.798', 'AMMO5': '0.003', 'AMMO2': '0.005', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.174', 'AMMO3': '0.217', 'weapon2': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.322', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:13,806][52665] DAMAGECOUNT value on done: 996167.0 [2024-08-06 08:43:13,806][52665] Sum rewards: 80.228, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.150', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.228', 'AMMO3': '0.252', 'weapon2': '0.632', 'WEAPON3': '1.450', 'weapon3': '2.842', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.328', 'FRAGCOUNT': '67.000'} [2024-08-06 08:43:14,210][52795] DAMAGECOUNT value on done: 917884.0 [2024-08-06 08:43:14,211][52795] Sum rewards: 72.719, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.508', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.114', 'AMMO4': '0.153', 'AMMO3': '0.200', 'weapon5': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.310', 'WEAPON3': '1.200', 'weapon3': '3.138', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '59.000'} [2024-08-06 08:43:14,316][52660] DAMAGECOUNT value on done: 996041.0 [2024-08-06 08:43:14,318][52660] Sum rewards: 80.458, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.095', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon5': '0.046', 'weapon4': '0.054', 'AMMO4': '0.056', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.175', 'weapon2': '0.312', 'WEAPON3': '1.300', 'weapon3': '3.358', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '67.000'} [2024-08-06 08:43:14,654][52662] DAMAGECOUNT value on done: 1014101.0 [2024-08-06 08:43:14,654][52662] Sum rewards: 67.992, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.890', 'AMMO5': '0.005', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon2': '0.188', 'AMMO3': '0.280', 'WEAPON3': '1.600', 'HITCOUNT': '3.350', 'weapon3': '3.550', 'DAMAGECOUNT': '17.664', 'FRAGCOUNT': '58.000'} [2024-08-06 08:43:14,700][52649] DAMAGECOUNT value on done: 989224.0 [2024-08-06 08:43:14,700][52649] Sum rewards: 68.222, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.900', 'AMMO5': '0.015', 'AMMO2': '0.056', 'weapon4': '0.156', 'weapon5': '0.168', 'AMMO3': '0.178', 'AMMO4': '0.279', 'weapon2': '0.388', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.674', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:14,730][52664] DAMAGECOUNT value on done: 1044519.0 [2024-08-06 08:43:14,730][52664] Sum rewards: 77.549, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.033', 'weapon4': '0.102', 'AMMO4': '0.167', 'weapon5': '0.172', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.520', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:14,854][52811] DAMAGECOUNT value on done: 939896.0 [2024-08-06 08:43:14,854][52811] Sum rewards: 75.406, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.575', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon5': '0.202', 'AMMO4': '0.245', 'AMMO3': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.134', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.602', 'FRAGCOUNT': '65.500'} [2024-08-06 08:43:15,931][52667] DAMAGECOUNT value on done: 1024273.0 [2024-08-06 08:43:15,939][52667] Sum rewards: 90.541, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.605', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.044', 'AMMO4': '0.049', 'weapon5': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.165', 'weapon2': '0.196', 'WEAPON3': '1.050', 'weapon3': '3.528', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '22.299', 'FRAGCOUNT': '70.000'} [2024-08-06 08:43:16,001][52650] Updated weights for policy 0, policy_version 86321 (0.0032) [2024-08-06 08:43:16,154][52659] DAMAGECOUNT value on done: 1008392.0 [2024-08-06 08:43:16,156][52659] Sum rewards: 78.060, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.332', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.144', 'weapon4': '0.192', 'weapon5': '0.192', 'AMMO3': '0.227', 'weapon2': '0.238', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.106', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.049', 'FRAGCOUNT': '64.500'} [2024-08-06 08:43:16,438][52667] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:43:17,016][52665] DAMAGECOUNT value on done: 988605.0 [2024-08-06 08:43:17,017][52665] Sum rewards: 81.120, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.750', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.156', 'AMMO4': '0.166', 'weapon4': '0.196', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.410', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.921', 'FRAGCOUNT': '67.000'} [2024-08-06 08:43:17,253][52662] DAMAGECOUNT value on done: 1009154.0 [2024-08-06 08:43:17,253][52662] Sum rewards: 83.462, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.420', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.126', 'AMMO4': '0.185', 'AMMO3': '0.220', 'WEAPON5': '0.300', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.040', 'FRAGCOUNT': '69.000'} [2024-08-06 08:43:17,331][52795] DAMAGECOUNT value on done: 927630.0 [2024-08-06 08:43:17,331][52795] Sum rewards: 71.441, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.324', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.094', 'AMMO3': '0.175', 'AMMO4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.572', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '59.000'} [2024-08-06 08:43:17,525][52660] DAMAGECOUNT value on done: 1010454.0 [2024-08-06 08:43:17,525][52660] Sum rewards: 77.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.710', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.052', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.160', 'AMMO3': '0.203', 'weapon2': '0.640', 'WEAPON3': '1.200', 'weapon3': '3.104', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:17,602][52664] DAMAGECOUNT value on done: 1057315.0 [2024-08-06 08:43:17,603][52664] Sum rewards: 73.752, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.390', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.042', 'weapon5': '0.112', 'AMMO4': '0.149', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.264', 'weapon2': '0.564', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:17,720][52649] DAMAGECOUNT value on done: 988572.0 [2024-08-06 08:43:17,720][52649] Sum rewards: 85.149, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.940', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.062', 'AMMO4': '0.147', 'weapon5': '0.174', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.350', 'weapon3': '3.272', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.352', 'FRAGCOUNT': '69.000'} [2024-08-06 08:43:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 707174400. Throughput: 0: 4371.1. Samples: 176793370. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:17,794][52567] Avg episode reward: [(0, '76.298')] [2024-08-06 08:43:17,930][52811] DAMAGECOUNT value on done: 943488.0 [2024-08-06 08:43:17,931][52811] Sum rewards: 84.109, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.348', 'AMMO5': '0.021', 'AMMO2': '0.045', 'weapon4': '0.140', 'weapon5': '0.166', 'AMMO4': '0.224', 'AMMO3': '0.254', 'weapon2': '0.344', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.997', 'FRAGCOUNT': '69.000'} [2024-08-06 08:43:18,735][52667] DAMAGECOUNT value on done: 1018951.0 [2024-08-06 08:43:18,735][52667] Sum rewards: 81.254, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.092', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.086', 'AMMO4': '0.097', 'WEAPON5': '0.100', 'weapon4': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.222', 'weapon2': '0.372', 'WEAPON3': '1.350', 'weapon3': '3.202', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:18,843][52659] DAMAGECOUNT value on done: 1020068.0 [2024-08-06 08:43:18,847][52659] Sum rewards: 75.359, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.066', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.016', 'AMMO4': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.200', 'AMMO3': '0.221', 'WEAPON3': '1.400', 'weapon3': '3.552', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:19,479][52662] DAMAGECOUNT value on done: 1006126.0 [2024-08-06 08:43:19,479][52662] Sum rewards: 67.629, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.010', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon2': '0.534', 'WEAPON3': '1.100', 'HITCOUNT': '3.020', 'weapon3': '3.292', 'DAMAGECOUNT': '15.669', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:20,136][52650] Updated weights for policy 0, policy_version 86331 (0.0025) [2024-08-06 08:43:20,202][52665] DAMAGECOUNT value on done: 995402.0 [2024-08-06 08:43:20,202][52665] Sum rewards: 80.845, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.379', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon5': '0.054', 'weapon4': '0.124', 'AMMO4': '0.126', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'WEAPON4': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.300', 'weapon3': '3.194', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '68.000'} [2024-08-06 08:43:20,424][52795] DAMAGECOUNT value on done: 938612.0 [2024-08-06 08:43:20,424][52795] Sum rewards: 80.501, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.700', 'AMMO5': '0.017', 'AMMO2': '0.051', 'weapon4': '0.090', 'weapon5': '0.254', 'AMMO4': '0.257', 'AMMO3': '0.267', 'weapon2': '0.296', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.094', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:20,475][52660] DAMAGECOUNT value on done: 1021456.0 [2024-08-06 08:43:20,476][52660] Sum rewards: 81.352, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.537', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.100', 'weapon5': '0.156', 'AMMO3': '0.229', 'AMMO4': '0.249', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '68.000'} [2024-08-06 08:43:20,755][52664] DAMAGECOUNT value on done: 1038609.0 [2024-08-06 08:43:20,755][52664] Sum rewards: 74.626, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.068', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.156', 'weapon5': '0.156', 'AMMO3': '0.207', 'AMMO4': '0.242', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.136', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.836', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:20,861][52649] DAMAGECOUNT value on done: 986323.0 [2024-08-06 08:43:20,862][52649] Sum rewards: 84.937, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.035', 'AMMO5': '0.007', 'AMMO2': '0.012', 'AMMO4': '0.062', 'weapon4': '0.068', 'WEAPON4': '0.150', 'weapon5': '0.214', 'AMMO3': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.600', 'weapon3': '3.082', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.942', 'FRAGCOUNT': '73.000'} [2024-08-06 08:43:21,048][52811] DAMAGECOUNT value on done: 958639.0 [2024-08-06 08:43:21,057][52811] Sum rewards: 79.247, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.058', 'AMMO4': '0.092', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.428', 'WEAPON3': '1.400', 'weapon3': '3.122', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:21,614][52667] DAMAGECOUNT value on done: 1015167.0 [2024-08-06 08:43:21,614][52667] Sum rewards: 84.457, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.878', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.058', 'weapon5': '0.088', 'AMMO4': '0.196', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO3': '0.219', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '71.000'} [2024-08-06 08:43:21,901][52659] DAMAGECOUNT value on done: 1005425.0 [2024-08-06 08:43:21,902][52659] Sum rewards: 79.537, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.840', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.144', 'weapon5': '0.200', 'AMMO4': '0.235', 'weapon2': '0.236', 'AMMO3': '0.282', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.080', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '68.000'} [2024-08-06 08:43:22,126][52662] DAMAGECOUNT value on done: 1001904.0 [2024-08-06 08:43:22,128][52662] Sum rewards: 84.041, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.206', 'AMMO5': '0.007', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon4': '0.054', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.118', 'AMMO3': '0.170', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '68.000'} [2024-08-06 08:43:22,432][52665] DAMAGECOUNT value on done: 1003147.0 [2024-08-06 08:43:22,433][52665] Sum rewards: 77.305, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.644', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.118', 'weapon5': '0.174', 'AMMO4': '0.188', 'weapon2': '0.190', 'AMMO3': '0.278', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.800', 'weapon3': '3.202', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.221', 'FRAGCOUNT': '67.000'} [2024-08-06 08:43:22,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 707264512. Throughput: 0: 4371.8. Samples: 176819610. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:22,795][52567] Avg episode reward: [(0, '77.056')] [2024-08-06 08:43:23,304][52649] DAMAGECOUNT value on done: 981019.0 [2024-08-06 08:43:23,305][52649] Sum rewards: 68.595, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.655', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.159', 'AMMO4': '0.165', 'weapon5': '0.214', 'weapon4': '0.370', 'weapon2': '0.444', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '54.000'} [2024-08-06 08:43:23,478][52660] DAMAGECOUNT value on done: 1001458.0 [2024-08-06 08:43:23,478][52660] Sum rewards: 78.374, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.570', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.024', 'AMMO4': '0.076', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.241', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.326', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:24,259][52811] DAMAGECOUNT value on done: 947631.0 [2024-08-06 08:43:24,261][52811] Sum rewards: 88.793, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.729', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.213', 'AMMO4': '0.220', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.062', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '21.252', 'FRAGCOUNT': '73.000'} [2024-08-06 08:43:24,449][52662] DAMAGECOUNT value on done: 1013343.0 [2024-08-06 08:43:24,449][52662] Sum rewards: 82.517, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.140', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.064', 'weapon5': '0.150', 'weapon2': '0.248', 'AMMO4': '0.273', 'AMMO3': '0.278', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.246', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '70.000'} [2024-08-06 08:43:24,850][52667] DAMAGECOUNT value on done: 1019671.0 [2024-08-06 08:43:24,851][52667] Sum rewards: 81.713, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.000', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.048', 'AMMO3': '0.140', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'weapon4': '0.292', 'WEAPON4': '0.300', 'weapon2': '0.680', 'WEAPON3': '0.950', 'weapon3': '2.766', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '65.000'} [2024-08-06 08:43:24,911][52659] DAMAGECOUNT value on done: 1015145.0 [2024-08-06 08:43:24,911][52659] Sum rewards: 75.789, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.472', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.122', 'AMMO3': '0.173', 'AMMO4': '0.231', 'WEAPON4': '0.250', 'weapon4': '0.296', 'WEAPON5': '0.350', 'weapon2': '0.430', 'WEAPON3': '1.100', 'weapon3': '2.822', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '61.000'} [2024-08-06 08:43:25,368][52650] Updated weights for policy 0, policy_version 86341 (0.0024) [2024-08-06 08:43:25,781][52614] Signal inference workers to stop experience collection... (15900 times) [2024-08-06 08:43:25,781][52614] Signal inference workers to resume experience collection... (15900 times) [2024-08-06 08:43:25,863][52650] InferenceWorker_p0-w0: stopping experience collection (15900 times) [2024-08-06 08:43:25,863][52650] InferenceWorker_p0-w0: resuming experience collection (15900 times) [2024-08-06 08:43:25,936][52649] DAMAGECOUNT value on done: 979873.0 [2024-08-06 08:43:25,938][52649] Sum rewards: 78.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.582', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.044', 'weapon5': '0.048', 'AMMO4': '0.092', 'AMMO3': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.574', 'WEAPON3': '0.950', 'weapon3': '3.162', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:26,415][52660] DAMAGECOUNT value on done: 999252.0 [2024-08-06 08:43:26,415][52660] Sum rewards: 74.028, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.203', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.148', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'weapon4': '0.282', 'AMMO3': '0.283', 'weapon2': '0.296', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '2.986', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '63.500'} [2024-08-06 08:43:27,351][52811] DAMAGECOUNT value on done: 937530.0 [2024-08-06 08:43:27,353][52811] Sum rewards: 78.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.168', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.163', 'weapon4': '0.186', 'weapon5': '0.216', 'AMMO4': '0.228', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'weapon3': '2.966', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '59.000'} [2024-08-06 08:43:27,551][52662] DAMAGECOUNT value on done: 1004358.0 [2024-08-06 08:43:27,551][52662] Sum rewards: 66.839, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.010', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.028', 'weapon5': '0.056', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.256', 'weapon2': '0.506', 'WEAPON3': '1.550', 'HITCOUNT': '3.090', 'weapon3': '3.198', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '58.000'} [2024-08-06 08:43:27,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 707346432. Throughput: 0: 4372.6. Samples: 176845920. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:27,795][52567] Avg episode reward: [(0, '77.244')] [2024-08-06 08:43:28,105][52659] DAMAGECOUNT value on done: 1009993.0 [2024-08-06 08:43:28,109][52659] Sum rewards: 70.759, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.220', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.092', 'weapon5': '0.136', 'AMMO3': '0.162', 'AMMO4': '0.181', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.558', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '57.000'} [2024-08-06 08:43:28,915][52649] DAMAGECOUNT value on done: 993641.0 [2024-08-06 08:43:28,917][52649] Sum rewards: 74.049, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.370', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon5': '0.046', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'weapon4': '0.174', 'AMMO3': '0.181', 'weapon2': '0.480', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.350', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:29,563][52660] DAMAGECOUNT value on done: 1005524.0 [2024-08-06 08:43:29,564][52660] Sum rewards: 71.309, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.458', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.202', 'weapon2': '0.610', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.874', 'FRAGCOUNT': '57.000'} [2024-08-06 08:43:29,675][52650] Updated weights for policy 0, policy_version 86351 (0.0016) [2024-08-06 08:43:30,608][52811] DAMAGECOUNT value on done: 943710.0 [2024-08-06 08:43:30,610][52811] Sum rewards: 89.670, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.362', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon4': '0.198', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.034', 'FRAGCOUNT': '72.000'} [2024-08-06 08:43:30,746][52662] DAMAGECOUNT value on done: 1021221.0 [2024-08-06 08:43:30,747][52662] Sum rewards: 69.584, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.085', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.046', 'AMMO4': '0.092', 'weapon5': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.342', 'WEAPON3': '1.550', 'HITCOUNT': '3.300', 'weapon3': '3.318', 'DAMAGECOUNT': '17.490', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:30,850][52659] DAMAGECOUNT value on done: 1007348.0 [2024-08-06 08:43:30,853][52659] Sum rewards: 80.193, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.963', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.074', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.214', 'weapon4': '0.242', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.363', 'FRAGCOUNT': '65.000'} [2024-08-06 08:43:31,753][52649] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:43:31,869][52649] DAMAGECOUNT value on done: 999398.0 [2024-08-06 08:43:31,871][52649] Sum rewards: 79.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.660', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon4': '0.104', 'AMMO3': '0.174', 'weapon5': '0.178', 'AMMO4': '0.242', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.100', 'weapon3': '3.044', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.794', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:32,250][52660] DAMAGECOUNT value on done: 1011957.0 [2024-08-06 08:43:32,252][52660] Sum rewards: 75.862, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.965', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.130', 'AMMO4': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.100', 'weapon3': '3.180', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:32,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 707436544. Throughput: 0: 4368.7. Samples: 176858850. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:32,794][52567] Avg episode reward: [(0, '77.191')] [2024-08-06 08:43:33,716][52811] DAMAGECOUNT value on done: 944615.0 [2024-08-06 08:43:33,716][52811] Sum rewards: 84.585, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.304', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.058', 'weapon5': '0.120', 'AMMO4': '0.140', 'AMMO3': '0.238', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.424', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.803', 'FRAGCOUNT': '69.000'} [2024-08-06 08:43:33,777][52659] DAMAGECOUNT value on done: 1008108.0 [2024-08-06 08:43:33,777][52659] Sum rewards: 85.137, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.760', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'AMMO3': '0.242', 'weapon2': '0.284', 'WEAPON3': '1.500', 'weapon3': '3.446', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.388', 'FRAGCOUNT': '72.000'} [2024-08-06 08:43:33,990][52662] DAMAGECOUNT value on done: 1009182.0 [2024-08-06 08:43:33,992][52662] Sum rewards: 78.207, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.265', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.185', 'weapon5': '0.196', 'weapon4': '0.210', 'AMMO3': '0.260', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.886', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.257', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:34,462][52650] Updated weights for policy 0, policy_version 86361 (0.0012) [2024-08-06 08:43:35,083][52649] DAMAGECOUNT value on done: 990018.0 [2024-08-06 08:43:35,084][52649] Sum rewards: 79.746, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.097', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.110', 'AMMO4': '0.216', 'AMMO3': '0.240', 'weapon5': '0.248', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.028', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.728', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:35,262][52660] DAMAGECOUNT value on done: 1000747.0 [2024-08-06 08:43:35,263][52660] Sum rewards: 85.259, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.750', 'AMMO5': '0.006', 'weapon4': '0.018', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.092', 'weapon5': '0.106', 'WEAPON5': '0.150', 'AMMO3': '0.180', 'weapon2': '0.506', 'WEAPON3': '1.100', 'weapon3': '3.202', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '69.000'} [2024-08-06 08:43:35,481][52665] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:43:36,465][52659] DAMAGECOUNT value on done: 1009902.0 [2024-08-06 08:43:36,465][52659] Sum rewards: 74.037, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.660', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.080', 'AMMO4': '0.082', 'weapon4': '0.112', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.296', 'WEAPON3': '1.000', 'HITCOUNT': '3.210', 'weapon3': '3.356', 'DAMAGECOUNT': '16.818', 'FRAGCOUNT': '59.000'} [2024-08-06 08:43:36,908][52811] DAMAGECOUNT value on done: 946281.0 [2024-08-06 08:43:36,910][52811] Sum rewards: 71.916, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.020', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon4': '0.144', 'weapon2': '0.170', 'weapon5': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON3': '1.650', 'weapon3': '3.238', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.742', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:36,998][52662] DAMAGECOUNT value on done: 999445.0 [2024-08-06 08:43:37,000][52662] Sum rewards: 72.666, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.640', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.042', 'weapon5': '0.136', 'AMMO4': '0.183', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'AMMO3': '0.305', 'weapon2': '0.308', 'WEAPON3': '1.750', 'weapon3': '3.226', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.081', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:37,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 707526656. Throughput: 0: 4371.6. Samples: 176885060. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:37,794][52567] Avg episode reward: [(0, '77.299')] [2024-08-06 08:43:38,249][52649] DAMAGECOUNT value on done: 989936.0 [2024-08-06 08:43:38,250][52649] Sum rewards: 74.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.370', 'AMMO2': '0.011', 'AMMO5': '0.013', 'weapon4': '0.032', 'AMMO4': '0.056', 'weapon5': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.576', 'WEAPON3': '1.650', 'weapon3': '3.068', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:38,275][52660] DAMAGECOUNT value on done: 998856.0 [2024-08-06 08:43:38,277][52660] Sum rewards: 72.604, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.728', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon5': '0.078', 'weapon4': '0.086', 'AMMO4': '0.112', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.282', 'weapon2': '0.358', 'WEAPON3': '1.700', 'weapon3': '3.198', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:39,142][52650] Updated weights for policy 0, policy_version 86371 (0.0020) [2024-08-06 08:43:39,233][52659] DAMAGECOUNT value on done: 1021718.0 [2024-08-06 08:43:39,234][52659] Sum rewards: 83.880, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.810', 'AMMO2': '0.005', 'AMMO5': '0.005', 'AMMO4': '0.023', 'weapon4': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon5': '0.236', 'weapon2': '0.534', 'WEAPON3': '1.050', 'weapon3': '3.042', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.806', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:40,043][52811] DAMAGECOUNT value on done: 954680.0 [2024-08-06 08:43:40,045][52811] Sum rewards: 72.216, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.648', 'AMMO5': '0.015', 'AMMO2': '0.036', 'AMMO4': '0.182', 'weapon4': '0.208', 'weapon5': '0.252', 'AMMO3': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.450', 'weapon3': '2.822', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '61.000'} [2024-08-06 08:43:40,047][52662] DAMAGECOUNT value on done: 1006715.0 [2024-08-06 08:43:40,049][52662] Sum rewards: 81.342, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.060', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon5': '0.080', 'weapon4': '0.084', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.212', 'AMMO3': '0.237', 'WEAPON3': '1.450', 'weapon3': '3.426', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '21.288', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:41,104][52660] DAMAGECOUNT value on done: 1005992.0 [2024-08-06 08:43:41,105][52660] Sum rewards: 82.616, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.961', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.150', 'AMMO4': '0.171', 'AMMO3': '0.254', 'weapon2': '0.258', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.274', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '20.442', 'FRAGCOUNT': '69.500'} [2024-08-06 08:43:41,214][52649] DAMAGECOUNT value on done: 979370.0 [2024-08-06 08:43:41,216][52649] Sum rewards: 64.696, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.306', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.260', 'weapon2': '0.374', 'WEAPON3': '1.550', 'weapon3': '3.196', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:41,832][52659] DAMAGECOUNT value on done: 1001882.0 [2024-08-06 08:43:41,832][52659] Sum rewards: 53.507, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.066', 'AMMO5': '0.019', 'AMMO2': '0.078', 'weapon4': '0.186', 'AMMO3': '0.221', 'weapon5': '0.230', 'weapon2': '0.310', 'AMMO4': '0.390', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'HITCOUNT': '2.590', 'weapon3': '3.032', 'DAMAGECOUNT': '13.068', 'FRAGCOUNT': '45.000'} [2024-08-06 08:43:42,156][52671] DAMAGECOUNT value on done: 1015215.0 [2024-08-06 08:43:42,164][52671] Sum rewards: 73.289, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.033', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.147', 'weapon5': '0.202', 'AMMO4': '0.227', 'weapon4': '0.244', 'WEAPON5': '0.400', 'weapon2': '0.484', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.778', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '58.000'} [2024-08-06 08:43:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 707608576. Throughput: 0: 4373.3. Samples: 176911310. Policy #0 lag: (min: 0.0, avg: 3.6, max: 7.0) [2024-08-06 08:43:42,794][52567] Avg episode reward: [(0, '76.978')] [2024-08-06 08:43:42,976][52662] DAMAGECOUNT value on done: 1000814.0 [2024-08-06 08:43:42,980][52662] Sum rewards: 76.396, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.850', 'AMMO5': '0.023', 'AMMO2': '0.056', 'AMMO3': '0.182', 'weapon4': '0.206', 'weapon5': '0.224', 'weapon2': '0.246', 'AMMO4': '0.279', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:43,273][52811] DAMAGECOUNT value on done: 946462.0 [2024-08-06 08:43:43,274][52811] Sum rewards: 75.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.550', 'AMMO5': '0.014', 'AMMO2': '0.054', 'weapon4': '0.126', 'weapon5': '0.224', 'AMMO3': '0.238', 'weapon2': '0.242', 'AMMO4': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.186', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:43,868][52650] Updated weights for policy 0, policy_version 86381 (0.0011) [2024-08-06 08:43:44,091][52660] DAMAGECOUNT value on done: 1000756.0 [2024-08-06 08:43:44,092][52660] Sum rewards: 65.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.031', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.018', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.446', 'WEAPON3': '1.450', 'HITCOUNT': '3.380', 'weapon3': '3.404', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:44,566][52659] DAMAGECOUNT value on done: 1016231.0 [2024-08-06 08:43:44,568][52659] Sum rewards: 76.147, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.864', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.166', 'AMMO3': '0.189', 'AMMO4': '0.200', 'weapon2': '0.272', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.294', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:44,663][52649] DAMAGECOUNT value on done: 994062.0 [2024-08-06 08:43:44,665][52649] Sum rewards: 85.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.826', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.082', 'AMMO4': '0.137', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.224', 'AMMO3': '0.228', 'weapon2': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.134', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '71.000'} [2024-08-06 08:43:44,756][52671] DAMAGECOUNT value on done: 1021347.0 [2024-08-06 08:43:44,758][52671] Sum rewards: 79.072, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.260', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.106', 'AMMO4': '0.136', 'weapon5': '0.178', 'AMMO3': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '2.972', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '65.000'} [2024-08-06 08:43:46,334][52811] DAMAGECOUNT value on done: 944316.0 [2024-08-06 08:43:46,334][52811] Sum rewards: 84.321, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.525', 'AMMO5': '0.017', 'AMMO2': '0.029', 'weapon4': '0.064', 'AMMO4': '0.146', 'weapon5': '0.152', 'weapon2': '0.234', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.260', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.889', 'FRAGCOUNT': '72.000'} [2024-08-06 08:43:46,793][52660] DAMAGECOUNT value on done: 1001139.0 [2024-08-06 08:43:46,796][52660] Sum rewards: 77.754, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.286', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.127', 'weapon5': '0.130', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.338', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:46,918][52659] DAMAGECOUNT value on done: 1006917.0 [2024-08-06 08:43:46,918][52659] Sum rewards: 74.214, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.862', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO4': '0.216', 'AMMO3': '0.235', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '3.062', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.840', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:47,221][52671] DAMAGECOUNT value on done: 1015053.0 [2024-08-06 08:43:47,229][52671] Sum rewards: 75.456, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.275', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.094', 'weapon5': '0.142', 'AMMO4': '0.178', 'AMMO3': '0.271', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.428', 'WEAPON3': '1.650', 'weapon3': '3.050', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:47,543][52649] DAMAGECOUNT value on done: 971735.0 [2024-08-06 08:43:47,543][52649] Sum rewards: 67.699, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.634', 'AMMO5': '0.012', 'AMMO2': '0.042', 'weapon5': '0.132', 'weapon4': '0.208', 'AMMO4': '0.208', 'AMMO3': '0.209', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'HITCOUNT': '3.090', 'weapon3': '3.142', 'DAMAGECOUNT': '17.073', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 707706880. Throughput: 0: 4373.8. Samples: 176924410. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:43:47,794][52567] Avg episode reward: [(0, '77.081')] [2024-08-06 08:43:47,824][52658] DAMAGECOUNT value on done: 1014788.0 [2024-08-06 08:43:47,824][52658] Sum rewards: 73.596, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.320', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.228', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.396', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 08:43:48,350][52650] Updated weights for policy 0, policy_version 86391 (0.0011) [2024-08-06 08:43:49,285][52660] DAMAGECOUNT value on done: 1009783.0 [2024-08-06 08:43:49,287][52660] Sum rewards: 81.302, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.960', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.224', 'weapon2': '0.238', 'WEAPON3': '1.500', 'weapon3': '3.528', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '67.000'} [2024-08-06 08:43:49,458][52811] DAMAGECOUNT value on done: 943028.0 [2024-08-06 08:43:49,461][52811] Sum rewards: 70.870, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.442', 'AMMO5': '0.011', 'AMMO2': '0.037', 'AMMO3': '0.179', 'AMMO4': '0.186', 'WEAPON4': '0.250', 'weapon5': '0.252', 'weapon4': '0.284', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.150', 'weapon3': '2.780', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.524', 'FRAGCOUNT': '57.000'} [2024-08-06 08:43:50,251][52669] DAMAGECOUNT value on done: 1007800.0 [2024-08-06 08:43:50,252][52669] Sum rewards: 70.357, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.340', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.160', 'weapon5': '0.172', 'AMMO4': '0.193', 'weapon2': '0.202', 'AMMO3': '0.214', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.208', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '15.675', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:50,326][52671] DAMAGECOUNT value on done: 1023106.0 [2024-08-06 08:43:50,327][52671] Sum rewards: 91.556, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon5': '0.056', 'AMMO4': '0.080', 'weapon4': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.201', 'weapon2': '0.238', 'WEAPON3': '1.200', 'weapon3': '3.434', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.751', 'FRAGCOUNT': '75.000'} [2024-08-06 08:43:50,379][52658] DAMAGECOUNT value on done: 1016042.0 [2024-08-06 08:43:50,381][52658] Sum rewards: 73.250, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.170', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.038', 'weapon5': '0.038', 'AMMO4': '0.041', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.188', 'weapon2': '0.706', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.432', 'FRAGCOUNT': '59.000'} [2024-08-06 08:43:50,422][52649] DAMAGECOUNT value on done: 992511.0 [2024-08-06 08:43:50,422][52649] Sum rewards: 69.504, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.720', 'WEAPON1': '0.010', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.160', 'AMMO4': '0.225', 'weapon5': '0.248', 'weapon4': '0.382', 'weapon2': '0.398', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.690', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:52,133][52660] DAMAGECOUNT value on done: 1025695.0 [2024-08-06 08:43:52,135][52660] Sum rewards: 80.175, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.050', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.150', 'weapon2': '0.190', 'AMMO4': '0.201', 'AMMO3': '0.225', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.284', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '66.000'} [2024-08-06 08:43:52,589][52811] DAMAGECOUNT value on done: 945012.0 [2024-08-06 08:43:52,592][52811] Sum rewards: 75.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon5': '0.090', 'weapon4': '0.108', 'AMMO4': '0.142', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.462', 'WEAPON3': '1.200', 'weapon3': '3.180', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 08:43:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 707788800. Throughput: 0: 4374.7. Samples: 176950750. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:43:52,794][52567] Avg episode reward: [(0, '76.820')] [2024-08-06 08:43:52,925][52671] DAMAGECOUNT value on done: 1028020.0 [2024-08-06 08:43:52,927][52671] Sum rewards: 87.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.841', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.028', 'weapon4': '0.044', 'weapon5': '0.114', 'AMMO4': '0.142', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.150', 'weapon3': '3.214', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.343', 'FRAGCOUNT': '70.000'} [2024-08-06 08:43:53,026][52649] DAMAGECOUNT value on done: 995384.0 [2024-08-06 08:43:53,027][52649] Sum rewards: 67.809, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.717', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.094', 'AMMO4': '0.112', 'AMMO3': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.362', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.392', 'DAMAGECOUNT': '15.330', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:53,262][52658] DAMAGECOUNT value on done: 1016916.0 [2024-08-06 08:43:53,264][52658] Sum rewards: 69.755, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.110', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'weapon5': '0.160', 'AMMO3': '0.189', 'weapon2': '0.212', 'weapon4': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.176', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '56.500'} [2024-08-06 08:43:53,344][52650] Updated weights for policy 0, policy_version 86401 (0.0012) [2024-08-06 08:43:53,553][52669] DAMAGECOUNT value on done: 1009319.0 [2024-08-06 08:43:53,554][52669] Sum rewards: 86.263, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.149', 'AMMO5': '0.007', 'weapon4': '0.008', 'weapon5': '0.030', 'AMMO2': '0.035', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.177', 'weapon2': '0.180', 'AMMO3': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.566', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.769', 'FRAGCOUNT': '70.000'} [2024-08-06 08:43:54,712][52803] Large shaping reward 2.517 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.495, 165.0), ('weapon5', 0.002)] [2024-08-06 08:43:55,102][52660] DAMAGECOUNT value on done: 1003597.0 [2024-08-06 08:43:55,103][52660] Sum rewards: 58.810, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.354', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.070', 'AMMO4': '0.202', 'weapon5': '0.248', 'AMMO3': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON3': '1.700', 'weapon3': '2.848', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '16.107', 'FRAGCOUNT': '52.000'} [2024-08-06 08:43:55,482][52671] DAMAGECOUNT value on done: 1016526.0 [2024-08-06 08:43:55,482][52671] Sum rewards: 76.309, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'HEALTH': '0.172', 'AMMO3': '0.205', 'weapon2': '0.234', 'WEAPON3': '1.150', 'weapon3': '3.470', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.600', 'FRAGCOUNT': '62.000'} [2024-08-06 08:43:55,793][52811] DAMAGECOUNT value on done: 949826.0 [2024-08-06 08:43:55,793][52811] Sum rewards: 82.782, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.090', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.124', 'weapon2': '0.128', 'weapon4': '0.160', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.128', 'FRAGCOUNT': '67.000'} [2024-08-06 08:43:55,940][52647] DAMAGECOUNT value on done: 1077166.0 [2024-08-06 08:43:55,942][52647] Sum rewards: 75.834, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.388', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.071', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.186', 'AMMO3': '0.201', 'weapon2': '0.246', 'WEAPON3': '1.200', 'weapon3': '3.262', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.876', 'FRAGCOUNT': '61.000'} [2024-08-06 08:43:56,187][52649] DAMAGECOUNT value on done: 983866.0 [2024-08-06 08:43:56,190][52649] Sum rewards: 75.085, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.890', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.098', 'AMMO4': '0.110', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.334', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '2.976', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '60.000'} [2024-08-06 08:43:56,316][52658] DAMAGECOUNT value on done: 1013302.0 [2024-08-06 08:43:56,320][52658] Sum rewards: 90.627, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.598', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.086', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.172', 'AMMO3': '0.260', 'WEAPON3': '1.650', 'weapon3': '3.418', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.081', 'FRAGCOUNT': '77.000'} [2024-08-06 08:43:56,659][52669] DAMAGECOUNT value on done: 1017308.0 [2024-08-06 08:43:56,660][52669] Sum rewards: 75.459, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.089', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon4': '0.028', 'weapon5': '0.046', 'AMMO4': '0.070', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.200', 'AMMO3': '0.217', 'WEAPON3': '1.350', 'HITCOUNT': '3.340', 'weapon3': '3.558', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:57,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 707878912. Throughput: 0: 4376.7. Samples: 176977120. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:43:57,786][52650] Updated weights for policy 0, policy_version 86411 (0.0011) [2024-08-06 08:43:57,803][52567] Avg episode reward: [(0, '76.976')] [2024-08-06 08:43:57,824][52671] DAMAGECOUNT value on done: 1014672.0 [2024-08-06 08:43:57,825][52671] Sum rewards: 74.446, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.693', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.072', 'weapon5': '0.094', 'AMMO4': '0.140', 'AMMO3': '0.229', 'weapon2': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.358', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:58,072][52660] DAMAGECOUNT value on done: 1008682.0 [2024-08-06 08:43:58,074][52660] Sum rewards: 71.846, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.988', 'AMMO5': '0.007', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'AMMO4': '0.067', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.110', 'AMMO3': '0.131', 'weapon4': '0.238', 'weapon2': '0.494', 'WEAPON3': '0.850', 'weapon3': '2.928', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '55.000'} [2024-08-06 08:43:58,931][52811] DAMAGECOUNT value on done: 957245.0 [2024-08-06 08:43:58,933][52811] Sum rewards: 74.882, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.014', 'AMMO2': '0.060', 'weapon4': '0.066', 'weapon5': '0.134', 'AMMO3': '0.179', 'AMMO4': '0.302', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.080', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.805', 'FRAGCOUNT': '61.000'} [2024-08-06 08:43:59,005][52647] DAMAGECOUNT value on done: 1064479.0 [2024-08-06 08:43:59,006][52647] Sum rewards: 68.178, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.720', 'AMMO5': '0.023', 'AMMO2': '0.045', 'weapon5': '0.206', 'AMMO4': '0.226', 'weapon4': '0.226', 'AMMO3': '0.247', 'weapon2': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '58.000'} [2024-08-06 08:43:59,511][52658] DAMAGECOUNT value on done: 1006364.0 [2024-08-06 08:43:59,511][52658] Sum rewards: 77.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.145', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.062', 'AMMO4': '0.191', 'AMMO3': '0.213', 'weapon5': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '64.000'} [2024-08-06 08:43:59,767][52669] DAMAGECOUNT value on done: 1011169.0 [2024-08-06 08:43:59,769][52669] Sum rewards: 63.327, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.975', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.036', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.229', 'weapon2': '0.280', 'WEAPON3': '1.350', 'HITCOUNT': '3.170', 'weapon3': '3.362', 'DAMAGECOUNT': '15.693', 'FRAGCOUNT': '54.000'} [2024-08-06 08:44:00,393][52671] DAMAGECOUNT value on done: 1022353.0 [2024-08-06 08:44:00,395][52671] Sum rewards: 74.754, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.004', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.058', 'AMMO4': '0.103', 'AMMO3': '0.137', 'weapon5': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '0.950', 'weapon3': '3.080', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.731', 'FRAGCOUNT': '60.000'} [2024-08-06 08:44:00,590][52660] DAMAGECOUNT value on done: 1007896.0 [2024-08-06 08:44:00,592][52660] Sum rewards: 80.095, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.013', 'HEALTH': '0.030', 'AMMO2': '0.046', 'weapon5': '0.180', 'AMMO3': '0.182', 'AMMO4': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon4': '0.306', 'weapon2': '0.398', 'WEAPON3': '0.950', 'weapon3': '2.894', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:01,821][52647] DAMAGECOUNT value on done: 1068245.0 [2024-08-06 08:44:01,822][52647] Sum rewards: 82.270, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.936', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.070', 'weapon5': '0.080', 'weapon4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.156', 'weapon2': '0.296', 'WEAPON3': '1.050', 'weapon3': '3.332', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.779', 'FRAGCOUNT': '64.000'} [2024-08-06 08:44:01,909][52811] DAMAGECOUNT value on done: 939797.0 [2024-08-06 08:44:01,910][52811] Sum rewards: 76.311, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.585', 'AMMO5': '0.003', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.034', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.198', 'weapon2': '0.518', 'WEAPON3': '1.350', 'weapon3': '3.248', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.726', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:02,435][52658] DAMAGECOUNT value on done: 1007008.0 [2024-08-06 08:44:02,436][52658] Sum rewards: 94.405, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.039', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.154', 'AMMO4': '0.167', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.398', 'WEAPON3': '1.250', 'weapon3': '3.230', 'HITCOUNT': '4.190', 'DAMAGECOUNT': '23.595', 'FRAGCOUNT': '74.000'} [2024-08-06 08:44:02,558][52650] Updated weights for policy 0, policy_version 86421 (0.0024) [2024-08-06 08:44:02,654][52669] DAMAGECOUNT value on done: 1018542.0 [2024-08-06 08:44:02,655][52669] Sum rewards: 80.693, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.790', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.080', 'AMMO3': '0.179', 'AMMO4': '0.192', 'weapon5': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.200', 'weapon3': '2.970', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '66.000'} [2024-08-06 08:44:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 707960832. Throughput: 0: 4377.3. Samples: 176990350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:02,794][52567] Avg episode reward: [(0, '77.206')] [2024-08-06 08:44:03,500][52671] DAMAGECOUNT value on done: 1001640.0 [2024-08-06 08:44:03,501][52671] Sum rewards: 82.451, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.012', 'AMMO2': '0.021', 'HEALTH': '0.045', 'AMMO4': '0.104', 'weapon4': '0.134', 'AMMO3': '0.158', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.514', 'WEAPON3': '0.950', 'weapon3': '2.924', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 08:44:03,716][52660] DAMAGECOUNT value on done: 997649.0 [2024-08-06 08:44:03,716][52660] Sum rewards: 67.969, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.165', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.038', 'weapon4': '0.058', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'weapon2': '0.208', 'AMMO3': '0.301', 'WEAPON3': '1.850', 'HITCOUNT': '3.420', 'weapon3': '3.452', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '60.000'} [2024-08-06 08:44:04,495][52647] DAMAGECOUNT value on done: 1066261.0 [2024-08-06 08:44:04,495][52647] Sum rewards: 75.736, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.150', 'AMMO5': '0.017', 'AMMO2': '0.053', 'weapon4': '0.114', 'AMMO3': '0.193', 'weapon5': '0.260', 'AMMO4': '0.264', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.532', 'WEAPON3': '1.200', 'weapon3': '2.834', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '61.000'} [2024-08-06 08:44:05,034][52811] DAMAGECOUNT value on done: 944176.0 [2024-08-06 08:44:05,034][52811] Sum rewards: 85.995, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.543', 'AMMO5': '0.008', 'AMMO2': '0.047', 'weapon5': '0.116', 'AMMO3': '0.195', 'weapon4': '0.196', 'WEAPON5': '0.200', 'weapon2': '0.214', 'AMMO4': '0.237', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.499', 'FRAGCOUNT': '69.000'} [2024-08-06 08:44:05,237][52658] DAMAGECOUNT value on done: 1019064.0 [2024-08-06 08:44:05,239][52658] Sum rewards: 85.089, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.210', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.102', 'AMMO4': '0.127', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.450', 'weapon3': '3.310', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.351', 'FRAGCOUNT': '69.500'} [2024-08-06 08:44:05,462][52669] DAMAGECOUNT value on done: 1016108.0 [2024-08-06 08:44:05,462][52669] Sum rewards: 72.171, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.203', 'weapon5': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.072', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.352', 'WEAPON3': '1.150', 'HITCOUNT': '3.210', 'weapon3': '3.400', 'DAMAGECOUNT': '16.884', 'FRAGCOUNT': '59.500'} [2024-08-06 08:44:06,188][52671] DAMAGECOUNT value on done: 1015082.0 [2024-08-06 08:44:06,189][52671] Sum rewards: 75.955, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.120', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.086', 'AMMO3': '0.206', 'weapon2': '0.238', 'weapon5': '0.248', 'AMMO4': '0.251', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 08:44:06,390][52669] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:44:06,744][52660] DAMAGECOUNT value on done: 999719.0 [2024-08-06 08:44:06,745][52660] Sum rewards: 60.144, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.202', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.099', 'weapon2': '0.168', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '2.920', 'weapon3': '3.592', 'DAMAGECOUNT': '15.246', 'FRAGCOUNT': '48.000'} [2024-08-06 08:44:07,016][52647] DAMAGECOUNT value on done: 1076958.0 [2024-08-06 08:44:07,018][52647] Sum rewards: 74.910, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.988', 'AMMO5': '0.010', 'AMMO2': '0.039', 'weapon4': '0.100', 'weapon5': '0.182', 'AMMO4': '0.196', 'AMMO3': '0.226', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.586', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:07,044][52650] Updated weights for policy 0, policy_version 86431 (0.0015) [2024-08-06 08:44:07,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17612.7, 300 sec: 17494.8). Total num frames: 708059136. Throughput: 0: 4372.0. Samples: 177016350. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:07,802][52567] Avg episode reward: [(0, '76.757')] [2024-08-06 08:44:08,226][52669] DAMAGECOUNT value on done: 1014422.0 [2024-08-06 08:44:08,226][52669] Sum rewards: 85.844, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.302', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.138', 'weapon2': '0.172', 'AMMO4': '0.200', 'AMMO3': '0.206', 'weapon5': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.216', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '69.000'} [2024-08-06 08:44:08,468][52658] DAMAGECOUNT value on done: 1002716.0 [2024-08-06 08:44:08,468][52658] Sum rewards: 67.235, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.422', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.142', 'AMMO4': '0.161', 'weapon5': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.220', 'WEAPON4': '0.300', 'WEAPON3': '1.250', 'HITCOUNT': '3.270', 'weapon3': '3.282', 'DAMAGECOUNT': '16.659', 'FRAGCOUNT': '54.000'} [2024-08-06 08:44:08,582][52671] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:44:09,327][52647] DAMAGECOUNT value on done: 1071346.0 [2024-08-06 08:44:09,327][52647] Sum rewards: 82.588, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'weapon4': '0.044', 'AMMO2': '0.052', 'weapon5': '0.126', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.259', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '3.118', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '68.000'} [2024-08-06 08:44:09,371][52671] DAMAGECOUNT value on done: 1017780.0 [2024-08-06 08:44:09,371][52671] Sum rewards: 79.404, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.720', 'weapon5': '0.002', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.019', 'WEAPON4': '0.050', 'AMMO4': '0.095', 'WEAPON5': '0.100', 'AMMO3': '0.241', 'weapon2': '0.266', 'WEAPON3': '1.500', 'weapon3': '3.508', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '67.000'} [2024-08-06 08:44:11,045][52669] DAMAGECOUNT value on done: 1017313.0 [2024-08-06 08:44:11,045][52669] Sum rewards: 80.265, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.823', 'AMMO5': '0.007', 'weapon4': '0.032', 'AMMO2': '0.034', 'weapon5': '0.110', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.454', 'WEAPON3': '1.400', 'weapon3': '3.236', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.672', 'FRAGCOUNT': '66.000'} [2024-08-06 08:44:11,302][52658] DAMAGECOUNT value on done: 1031363.0 [2024-08-06 08:44:11,305][52658] Sum rewards: 70.617, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.640', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.106', 'AMMO4': '0.166', 'weapon5': '0.178', 'AMMO3': '0.190', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.070', 'weapon3': '3.264', 'DAMAGECOUNT': '16.260', 'FRAGCOUNT': '59.000'} [2024-08-06 08:44:12,111][52650] Updated weights for policy 0, policy_version 86441 (0.0011) [2024-08-06 08:44:12,492][52671] DAMAGECOUNT value on done: 1013396.0 [2024-08-06 08:44:12,493][52671] Sum rewards: 64.531, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.696', 'AMMO5': '0.025', 'AMMO2': '0.060', 'weapon4': '0.134', 'AMMO3': '0.242', 'AMMO4': '0.301', 'weapon2': '0.310', 'weapon5': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '2.640', 'weapon3': '2.902', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '55.000'} [2024-08-06 08:44:12,507][52647] DAMAGECOUNT value on done: 1072785.0 [2024-08-06 08:44:12,508][52647] Sum rewards: 73.592, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.600', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.088', 'weapon5': '0.098', 'AMMO4': '0.165', 'AMMO3': '0.226', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.416', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.694', 'FRAGCOUNT': '62.000'} [2024-08-06 08:44:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 708141056. Throughput: 0: 4370.5. Samples: 177042590. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:12,794][52567] Avg episode reward: [(0, '76.533')] [2024-08-06 08:44:13,980][52669] DAMAGECOUNT value on done: 1025977.0 [2024-08-06 08:44:13,981][52669] Sum rewards: 78.679, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.178', 'AMMO5': '0.005', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.058', 'WEAPON4': '0.100', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.213', 'weapon2': '0.318', 'WEAPON3': '1.250', 'weapon3': '3.442', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '65.000'} [2024-08-06 08:44:14,173][52658] DAMAGECOUNT value on done: 1019813.0 [2024-08-06 08:44:14,173][52658] Sum rewards: 73.764, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.565', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon5': '0.152', 'AMMO4': '0.153', 'AMMO3': '0.163', 'weapon2': '0.280', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.816', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.667', 'FRAGCOUNT': '59.500'} [2024-08-06 08:44:14,233][52811] Large shaping reward 2.525 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.47400000000000003, 158.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:44:15,353][52671] DAMAGECOUNT value on done: 1015569.0 [2024-08-06 08:44:15,354][52671] Sum rewards: 80.710, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.680', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.064', 'weapon5': '0.118', 'AMMO4': '0.154', 'AMMO3': '0.261', 'weapon2': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.238', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '68.000'} [2024-08-06 08:44:15,616][52647] DAMAGECOUNT value on done: 1049786.0 [2024-08-06 08:44:15,616][52647] Sum rewards: 71.808, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.920', 'AMMO5': '0.020', 'AMMO2': '0.052', 'weapon4': '0.092', 'weapon5': '0.218', 'AMMO4': '0.261', 'AMMO3': '0.280', 'weapon2': '0.420', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.960', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.585', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:16,134][52650] Updated weights for policy 0, policy_version 86451 (0.0013) [2024-08-06 08:44:16,983][52669] DAMAGECOUNT value on done: 1017351.0 [2024-08-06 08:44:16,985][52669] Sum rewards: 80.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.945', 'AMMO5': '0.003', 'AMMO2': '0.010', 'AMMO4': '0.049', 'WEAPON5': '0.050', 'weapon4': '0.080', 'WEAPON4': '0.100', 'AMMO3': '0.241', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.350', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '66.000'} [2024-08-06 08:44:17,189][52658] DAMAGECOUNT value on done: 1026321.0 [2024-08-06 08:44:17,189][52658] Sum rewards: 75.798, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.365', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon5': '0.050', 'AMMO4': '0.114', 'weapon4': '0.164', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.154', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '62.000'} [2024-08-06 08:44:17,580][52671] DAMAGECOUNT value on done: 1019337.0 [2024-08-06 08:44:17,581][52671] Sum rewards: 78.156, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.338', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.243', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.340', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '67.000'} [2024-08-06 08:44:17,794][52567] Fps is (10 sec: 15565.2, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 708214784. Throughput: 0: 4373.6. Samples: 177055660. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:17,802][52567] Avg episode reward: [(0, '76.414')] [2024-08-06 08:44:17,987][52647] DAMAGECOUNT value on done: 1064672.0 [2024-08-06 08:44:17,988][52647] Sum rewards: 70.304, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.756', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.048', 'WEAPON4': '0.050', 'weapon4': '0.112', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.237', 'weapon2': '0.582', 'WEAPON3': '1.400', 'weapon3': '2.932', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.265', 'FRAGCOUNT': '60.000'} [2024-08-06 08:44:20,225][52658] DAMAGECOUNT value on done: 1010174.0 [2024-08-06 08:44:20,225][52658] Sum rewards: 77.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.076', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon4': '0.110', 'weapon5': '0.148', 'AMMO4': '0.160', 'AMMO3': '0.198', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.126', 'FRAGCOUNT': '62.000'} [2024-08-06 08:44:20,306][52669] DAMAGECOUNT value on done: 1020777.0 [2024-08-06 08:44:20,306][52669] Sum rewards: 68.647, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.250', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.178', 'weapon5': '0.182', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.512', 'WEAPON3': '1.250', 'weapon3': '2.816', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.656', 'FRAGCOUNT': '57.000'} [2024-08-06 08:44:20,710][52671] DAMAGECOUNT value on done: 1001776.0 [2024-08-06 08:44:20,711][52671] Sum rewards: 83.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.230', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.134', 'AMMO4': '0.172', 'weapon5': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.260', 'AMMO3': '0.270', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.132', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '72.000'} [2024-08-06 08:44:20,973][52647] DAMAGECOUNT value on done: 1059192.0 [2024-08-06 08:44:20,973][52647] Sum rewards: 76.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.351', 'WEAPON1': '0.010', 'AMMO5': '0.016', 'AMMO2': '0.043', 'weapon4': '0.078', 'AMMO3': '0.153', 'AMMO4': '0.215', 'weapon5': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.580', 'WEAPON3': '0.900', 'weapon3': '2.846', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '60.000'} [2024-08-06 08:44:21,306][52650] Updated weights for policy 0, policy_version 86461 (0.0023) [2024-08-06 08:44:21,406][52663] DAMAGECOUNT value on done: 1027691.0 [2024-08-06 08:44:21,407][52663] Sum rewards: 79.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.073', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon4': '0.132', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'weapon5': '0.260', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '64.000'} [2024-08-06 08:44:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 708313088. Throughput: 0: 4372.0. Samples: 177081800. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:22,802][52567] Avg episode reward: [(0, '76.156')] [2024-08-06 08:44:22,925][52658] DAMAGECOUNT value on done: 1021840.0 [2024-08-06 08:44:22,925][52658] Sum rewards: 90.529, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.446', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.082', 'weapon5': '0.114', 'AMMO4': '0.141', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.260', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.873', 'FRAGCOUNT': '74.000'} [2024-08-06 08:44:22,932][52803] DAMAGECOUNT value on done: 939730.0 [2024-08-06 08:44:22,933][52803] Sum rewards: 85.626, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.289', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.098', 'AMMO4': '0.121', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon5': '0.244', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.054', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '68.000'} [2024-08-06 08:44:23,344][52669] DAMAGECOUNT value on done: 1019996.0 [2024-08-06 08:44:23,347][52669] Sum rewards: 63.110, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.021', 'AMMO4': '0.105', 'weapon5': '0.128', 'AMMO3': '0.185', 'weapon4': '0.268', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.624', 'WEAPON3': '1.100', 'weapon3': '2.578', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '53.000'} [2024-08-06 08:44:23,866][52671] DAMAGECOUNT value on done: 1026533.0 [2024-08-06 08:44:23,867][52671] Sum rewards: 59.557, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.868', 'AMMO5': '0.016', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.162', 'AMMO3': '0.167', 'weapon4': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.942', 'HITCOUNT': '3.000', 'DAMAGECOUNT': '14.586', 'FRAGCOUNT': '48.500'} [2024-08-06 08:44:24,072][52647] DAMAGECOUNT value on done: 1059417.0 [2024-08-06 08:44:24,072][52647] Sum rewards: 86.040, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.026', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.224', 'AMMO3': '0.229', 'HEALTH': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.522', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '72.000'} [2024-08-06 08:44:24,458][52663] DAMAGECOUNT value on done: 1013288.0 [2024-08-06 08:44:24,459][52663] Sum rewards: 79.673, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.720', 'AMMO5': '0.007', 'AMMO2': '0.032', 'weapon5': '0.098', 'AMMO4': '0.159', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.296', 'weapon4': '0.656', 'WEAPON3': '1.050', 'weapon3': '2.674', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.531', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:25,795][52650] Updated weights for policy 0, policy_version 86471 (0.0012) [2024-08-06 08:44:25,934][52658] DAMAGECOUNT value on done: 1013060.0 [2024-08-06 08:44:25,936][52658] Sum rewards: 88.375, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.220', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.031', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.054', 'AMMO3': '0.203', 'weapon2': '0.256', 'WEAPON3': '1.250', 'weapon3': '3.522', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.214', 'FRAGCOUNT': '72.000'} [2024-08-06 08:44:26,092][52803] DAMAGECOUNT value on done: 938265.0 [2024-08-06 08:44:26,092][52803] Sum rewards: 65.757, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.690', 'AMMO5': '0.012', 'AMMO2': '0.045', 'weapon5': '0.156', 'weapon4': '0.178', 'AMMO4': '0.226', 'AMMO3': '0.246', 'weapon2': '0.318', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '56.000'} [2024-08-06 08:44:26,302][52669] DAMAGECOUNT value on done: 1009241.0 [2024-08-06 08:44:26,303][52669] Sum rewards: 89.137, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.984', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.064', 'AMMO4': '0.103', 'weapon5': '0.138', 'WEAPON4': '0.200', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '74.000'} [2024-08-06 08:44:26,547][52671] DAMAGECOUNT value on done: 1022816.0 [2024-08-06 08:44:26,547][52671] Sum rewards: 84.319, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.995', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.103', 'weapon5': '0.108', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.228', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '69.000'} [2024-08-06 08:44:26,867][52647] DAMAGECOUNT value on done: 1058844.0 [2024-08-06 08:44:26,868][52647] Sum rewards: 70.947, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.485', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.140', 'weapon5': '0.180', 'AMMO3': '0.201', 'weapon2': '0.218', 'AMMO4': '0.226', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '3.180', 'weapon3': '3.244', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '58.000'} [2024-08-06 08:44:27,178][52663] DAMAGECOUNT value on done: 1006722.0 [2024-08-06 08:44:27,179][52663] Sum rewards: 76.039, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.960', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.110', 'weapon5': '0.138', 'AMMO4': '0.180', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '62.000'} [2024-08-06 08:44:27,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 708403200. Throughput: 0: 4367.8. Samples: 177107860. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:27,794][52567] Avg episode reward: [(0, '76.293')] [2024-08-06 08:44:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086475_708403200.pth... [2024-08-06 08:44:27,931][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000085964_704217088.pth [2024-08-06 08:44:28,566][52658] DAMAGECOUNT value on done: 1015456.0 [2024-08-06 08:44:28,568][52658] Sum rewards: 81.417, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.722', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.084', 'AMMO4': '0.089', 'WEAPON5': '0.100', 'weapon2': '0.174', 'WEAPON4': '0.200', 'weapon4': '0.238', 'AMMO3': '0.264', 'WEAPON3': '1.650', 'weapon3': '3.288', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '18.909', 'FRAGCOUNT': '70.000'} [2024-08-06 08:44:29,274][52803] DAMAGECOUNT value on done: 947019.0 [2024-08-06 08:44:29,277][52803] Sum rewards: 73.485, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.062', 'AMMO5': '0.018', 'AMMO2': '0.063', 'weapon5': '0.226', 'weapon4': '0.254', 'AMMO3': '0.295', 'AMMO4': '0.316', 'weapon2': '0.322', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.894', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:29,369][52647] DAMAGECOUNT value on done: 1064742.0 [2024-08-06 08:44:29,370][52647] Sum rewards: 72.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO5': '0.009', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon5': '0.092', 'AMMO3': '0.192', 'weapon4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.374', 'WEAPON3': '1.300', 'weapon3': '3.080', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '60.000'} [2024-08-06 08:44:29,396][52671] DAMAGECOUNT value on done: 1018469.0 [2024-08-06 08:44:29,396][52671] Sum rewards: 67.217, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.702', 'AMMO5': '0.007', 'AMMO2': '0.028', 'weapon5': '0.088', 'weapon4': '0.128', 'AMMO4': '0.142', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.956', 'FRAGCOUNT': '56.000'} [2024-08-06 08:44:29,453][52669] DAMAGECOUNT value on done: 1011672.0 [2024-08-06 08:44:29,454][52669] Sum rewards: 76.004, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.773', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon5': '0.162', 'AMMO4': '0.186', 'AMMO3': '0.218', 'weapon2': '0.244', 'WEAPON5': '0.250', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '64.000'} [2024-08-06 08:44:30,454][52663] DAMAGECOUNT value on done: 1013535.0 [2024-08-06 08:44:30,455][52663] Sum rewards: 57.666, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.014', 'AMMO2': '0.072', 'weapon2': '0.186', 'weapon4': '0.194', 'AMMO3': '0.214', 'weapon5': '0.218', 'AMMO4': '0.360', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '2.570', 'weapon3': '3.154', 'DAMAGECOUNT': '13.674', 'FRAGCOUNT': '48.000'} [2024-08-06 08:44:30,662][52650] Updated weights for policy 0, policy_version 86481 (0.0014) [2024-08-06 08:44:31,307][52666] Large shaping reward 2.620 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:44:31,642][52647] DAMAGECOUNT value on done: 1061112.0 [2024-08-06 08:44:31,643][52647] Sum rewards: 88.139, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.637', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.100', 'weapon5': '0.104', 'AMMO3': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.350', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.204', 'FRAGCOUNT': '70.000'} [2024-08-06 08:44:31,777][52658] DAMAGECOUNT value on done: 1002005.0 [2024-08-06 08:44:31,777][52658] Sum rewards: 73.613, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.768', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.110', 'weapon2': '0.266', 'AMMO4': '0.276', 'AMMO3': '0.302', 'weapon5': '0.316', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.900', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:32,213][52671] DAMAGECOUNT value on done: 1024049.0 [2024-08-06 08:44:32,214][52671] Sum rewards: 85.519, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.330', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.076', 'AMMO4': '0.193', 'weapon5': '0.194', 'AMMO3': '0.259', 'weapon2': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.182', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '72.000'} [2024-08-06 08:44:32,446][52669] DAMAGECOUNT value on done: 1020799.0 [2024-08-06 08:44:32,449][52669] Sum rewards: 78.045, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.592', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon4': '0.024', 'weapon5': '0.038', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.418', 'WEAPON3': '1.350', 'weapon3': '3.348', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '64.000'} [2024-08-06 08:44:32,532][52803] DAMAGECOUNT value on done: 939379.0 [2024-08-06 08:44:32,534][52803] Sum rewards: 73.253, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.858', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.208', 'weapon5': '0.212', 'AMMO3': '0.215', 'weapon2': '0.240', 'AMMO4': '0.267', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.092', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '61.000'} [2024-08-06 08:44:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.4). Total num frames: 708485120. Throughput: 0: 4362.7. Samples: 177120730. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:32,794][52567] Avg episode reward: [(0, '76.101')] [2024-08-06 08:44:33,434][52663] DAMAGECOUNT value on done: 1016159.0 [2024-08-06 08:44:33,436][52663] Sum rewards: 87.063, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.044', 'AMMO5': '0.018', 'AMMO2': '0.040', 'weapon4': '0.146', 'AMMO3': '0.186', 'AMMO4': '0.199', 'weapon5': '0.236', 'weapon2': '0.260', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.100', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '69.000'} [2024-08-06 08:44:34,170][52647] DAMAGECOUNT value on done: 1066358.0 [2024-08-06 08:44:34,170][52647] Sum rewards: 70.406, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.835', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.241', 'weapon4': '0.248', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.586', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.052', 'FRAGCOUNT': '59.000'} [2024-08-06 08:44:34,464][52658] DAMAGECOUNT value on done: 1018725.0 [2024-08-06 08:44:34,465][52658] Sum rewards: 81.072, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.730', 'AMMO5': '0.016', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.168', 'weapon4': '0.194', 'AMMO3': '0.196', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.928', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '65.000'} [2024-08-06 08:44:35,197][52650] Updated weights for policy 0, policy_version 86491 (0.0013) [2024-08-06 08:44:35,324][52671] DAMAGECOUNT value on done: 1006208.0 [2024-08-06 08:44:35,325][52671] Sum rewards: 61.090, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.985', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon4': '0.080', 'AMMO4': '0.159', 'AMMO3': '0.192', 'weapon5': '0.314', 'WEAPON4': '0.350', 'weapon2': '0.484', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'HITCOUNT': '2.720', 'weapon3': '2.834', 'DAMAGECOUNT': '15.441', 'FRAGCOUNT': '53.000'} [2024-08-06 08:44:35,529][52669] DAMAGECOUNT value on done: 1037341.0 [2024-08-06 08:44:35,531][52669] Sum rewards: 80.073, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.078', 'AMMO4': '0.113', 'weapon5': '0.128', 'AMMO3': '0.161', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.410', 'HEALTH': '0.495', 'WEAPON3': '0.950', 'weapon3': '3.182', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:35,597][52803] DAMAGECOUNT value on done: 942482.0 [2024-08-06 08:44:35,598][52803] Sum rewards: 84.127, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.634', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon5': '0.050', 'AMMO4': '0.086', 'AMMO3': '0.114', 'weapon4': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '0.850', 'weapon3': '3.220', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '66.000'} [2024-08-06 08:44:35,920][52794] DAMAGECOUNT value on done: 1006951.0 [2024-08-06 08:44:35,928][52794] Sum rewards: 71.146, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.897', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.046', 'AMMO4': '0.104', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '59.000'} [2024-08-06 08:44:36,658][52647] DAMAGECOUNT value on done: 1068077.0 [2024-08-06 08:44:36,658][52647] Sum rewards: 79.353, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.011', 'AMMO2': '0.035', 'AMMO4': '0.177', 'AMMO3': '0.178', 'weapon5': '0.180', 'weapon4': '0.250', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.524', 'WEAPON3': '1.100', 'weapon3': '2.818', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.519', 'FRAGCOUNT': '61.000'} [2024-08-06 08:44:36,676][52663] DAMAGECOUNT value on done: 1019675.0 [2024-08-06 08:44:36,677][52663] Sum rewards: 74.368, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.176', 'AMMO3': '0.200', 'AMMO4': '0.207', 'weapon5': '0.228', 'weapon2': '0.382', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '61.000'} [2024-08-06 08:44:37,117][52658] DAMAGECOUNT value on done: 1011504.0 [2024-08-06 08:44:37,118][52658] Sum rewards: 78.390, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.476', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.054', 'weapon5': '0.112', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'AMMO4': '0.226', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:37,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 708575232. Throughput: 0: 4360.2. Samples: 177146960. Policy #0 lag: (min: 0.0, avg: 3.5, max: 8.0) [2024-08-06 08:44:37,794][52567] Avg episode reward: [(0, '76.441')] [2024-08-06 08:44:38,710][52669] DAMAGECOUNT value on done: 1026040.0 [2024-08-06 08:44:38,710][52669] Sum rewards: 68.518, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.752', 'AMMO5': '0.016', 'AMMO2': '0.040', 'weapon4': '0.076', 'weapon5': '0.172', 'AMMO3': '0.185', 'AMMO4': '0.199', 'weapon2': '0.398', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'HITCOUNT': '3.090', 'weapon3': '3.176', 'DAMAGECOUNT': '16.068', 'FRAGCOUNT': '56.000'} [2024-08-06 08:44:38,788][52803] DAMAGECOUNT value on done: 940089.0 [2024-08-06 08:44:38,790][52803] Sum rewards: 84.044, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.210', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.038', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon5': '0.136', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.300', 'weapon3': '3.256', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.712', 'FRAGCOUNT': '68.000'} [2024-08-06 08:44:39,188][52794] DAMAGECOUNT value on done: 1017054.0 [2024-08-06 08:44:39,189][52794] Sum rewards: 78.912, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.750', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.088', 'weapon4': '0.158', 'AMMO4': '0.171', 'AMMO3': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:39,555][52658] DAMAGECOUNT value on done: 1008811.0 [2024-08-06 08:44:39,557][52658] Sum rewards: 68.984, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.108', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.148', 'AMMO4': '0.168', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.664', 'WEAPON3': '1.350', 'weapon3': '2.834', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.602', 'FRAGCOUNT': '59.000'} [2024-08-06 08:44:39,561][52669] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:44:39,726][52663] DAMAGECOUNT value on done: 1012045.0 [2024-08-06 08:44:39,727][52663] Sum rewards: 65.714, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.540', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.112', 'weapon5': '0.188', 'weapon2': '0.214', 'AMMO3': '0.224', 'AMMO4': '0.250', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.166', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.710', 'FRAGCOUNT': '55.000'} [2024-08-06 08:44:39,782][52647] DAMAGECOUNT value on done: 1052492.0 [2024-08-06 08:44:39,784][52647] Sum rewards: 68.622, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.500', 'AMMO5': '0.005', 'weapon5': '0.010', 'AMMO2': '0.033', 'WEAPON5': '0.100', 'AMMO4': '0.165', 'weapon4': '0.186', 'AMMO3': '0.216', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.350', 'weapon3': '3.276', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 08:44:40,301][52650] Updated weights for policy 0, policy_version 86501 (0.0027) [2024-08-06 08:44:41,627][52669] DAMAGECOUNT value on done: 1022893.0 [2024-08-06 08:44:41,627][52669] Sum rewards: 64.962, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.788', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.108', 'AMMO4': '0.172', 'AMMO3': '0.185', 'weapon5': '0.202', 'weapon2': '0.216', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'HITCOUNT': '2.810', 'weapon3': '3.212', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '53.500'} [2024-08-06 08:44:41,850][52803] DAMAGECOUNT value on done: 937921.0 [2024-08-06 08:44:41,850][52803] Sum rewards: 79.466, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.805', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.253', 'weapon2': '0.362', 'WEAPON3': '1.600', 'weapon3': '3.410', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '66.000'} [2024-08-06 08:44:42,056][52658] DAMAGECOUNT value on done: 1017579.0 [2024-08-06 08:44:42,056][52658] Sum rewards: 79.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.745', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon2': '0.134', 'weapon4': '0.142', 'AMMO4': '0.154', 'weapon5': '0.170', 'AMMO3': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.354', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '65.000'} [2024-08-06 08:44:42,373][52794] DAMAGECOUNT value on done: 1021913.0 [2024-08-06 08:44:42,374][52794] Sum rewards: 60.648, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.050', 'AMMO5': '0.023', 'AMMO2': '0.039', 'AMMO4': '0.194', 'AMMO3': '0.250', 'weapon5': '0.256', 'weapon2': '0.266', 'weapon4': '0.344', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.650', 'weapon3': '2.844', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '52.000'} [2024-08-06 08:44:42,505][52663] DAMAGECOUNT value on done: 997641.0 [2024-08-06 08:44:42,505][52663] Sum rewards: 77.455, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.078', 'AMMO3': '0.208', 'AMMO4': '0.250', 'weapon5': '0.376', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.844', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '62.000'} [2024-08-06 08:44:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 708657152. Throughput: 0: 4357.6. Samples: 177173210. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:44:42,794][52567] Avg episode reward: [(0, '76.007')] [2024-08-06 08:44:43,038][52647] DAMAGECOUNT value on done: 1063807.0 [2024-08-06 08:44:43,038][52647] Sum rewards: 58.486, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.258', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.126', 'AMMO3': '0.222', 'AMMO4': '0.280', 'weapon5': '0.360', 'weapon2': '0.442', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.640', 'weapon3': '2.758', 'DAMAGECOUNT': '14.742', 'FRAGCOUNT': '51.000'} [2024-08-06 08:44:44,256][52669] DAMAGECOUNT value on done: 1027966.0 [2024-08-06 08:44:44,257][52669] Sum rewards: 83.623, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.250', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.054', 'AMMO4': '0.104', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.285', 'weapon2': '0.444', 'WEAPON3': '1.700', 'weapon3': '3.084', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '71.000'} [2024-08-06 08:44:44,880][52803] DAMAGECOUNT value on done: 935914.0 [2024-08-06 08:44:44,881][52803] Sum rewards: 78.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.126', 'weapon5': '0.178', 'AMMO4': '0.187', 'AMMO3': '0.198', 'weapon2': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.200', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.482', 'FRAGCOUNT': '64.000'} [2024-08-06 08:44:45,032][52650] Updated weights for policy 0, policy_version 86511 (0.0016) [2024-08-06 08:44:45,103][52663] DAMAGECOUNT value on done: 1008769.0 [2024-08-06 08:44:45,104][52663] Sum rewards: 75.492, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.056', 'weapon2': '0.170', 'weapon5': '0.170', 'AMMO4': '0.198', 'AMMO3': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.376', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.381', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:45,231][52794] DAMAGECOUNT value on done: 1008772.0 [2024-08-06 08:44:45,232][52794] Sum rewards: 70.109, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.354', 'AMMO5': '0.015', 'AMMO2': '0.048', 'AMMO3': '0.128', 'weapon5': '0.198', 'AMMO4': '0.239', 'WEAPON5': '0.400', 'weapon2': '0.432', 'WEAPON4': '0.450', 'weapon4': '0.686', 'WEAPON3': '0.800', 'weapon3': '2.456', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.341', 'FRAGCOUNT': '53.000'} [2024-08-06 08:44:45,905][52647] DAMAGECOUNT value on done: 1054739.0 [2024-08-06 08:44:45,907][52647] Sum rewards: 70.815, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.543', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon5': '0.162', 'AMMO4': '0.192', 'AMMO3': '0.208', 'weapon4': '0.234', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.074', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.103', 'FRAGCOUNT': '57.000'} [2024-08-06 08:44:46,612][52669] DAMAGECOUNT value on done: 1029123.0 [2024-08-06 08:44:46,612][52669] Sum rewards: 91.702, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.970', 'AMMO5': '0.009', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.076', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.626', 'WEAPON3': '1.150', 'weapon3': '3.014', 'HITCOUNT': '4.300', 'DAMAGECOUNT': '22.371', 'FRAGCOUNT': '72.500'} [2024-08-06 08:44:47,611][52663] DAMAGECOUNT value on done: 1005900.0 [2024-08-06 08:44:47,611][52663] Sum rewards: 67.929, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.007', 'AMMO2': '0.037', 'weapon5': '0.136', 'AMMO4': '0.183', 'weapon4': '0.210', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '2.764', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.325', 'FRAGCOUNT': '55.000'} [2024-08-06 08:44:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 708747264. Throughput: 0: 4351.1. Samples: 177186150. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:44:47,794][52567] Avg episode reward: [(0, '76.017')] [2024-08-06 08:44:47,862][52803] DAMAGECOUNT value on done: 943416.0 [2024-08-06 08:44:47,866][52803] Sum rewards: 75.403, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.460', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.090', 'weapon5': '0.156', 'AMMO3': '0.250', 'AMMO4': '0.279', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.188', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '63.000'} [2024-08-06 08:44:48,532][52794] DAMAGECOUNT value on done: 1004376.0 [2024-08-06 08:44:48,534][52794] Sum rewards: 75.345, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.690', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.030', 'weapon5': '0.068', 'AMMO4': '0.089', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.297', 'weapon2': '0.378', 'WEAPON3': '1.950', 'weapon3': '3.288', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '66.000'} [2024-08-06 08:44:48,772][52647] DAMAGECOUNT value on done: 1057676.0 [2024-08-06 08:44:48,772][52647] Sum rewards: 66.850, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.922', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.088', 'weapon5': '0.178', 'AMMO4': '0.221', 'AMMO3': '0.243', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.158', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '57.500'} [2024-08-06 08:44:49,847][52650] Updated weights for policy 0, policy_version 86521 (0.0013) [2024-08-06 08:44:50,918][52663] DAMAGECOUNT value on done: 1017663.0 [2024-08-06 08:44:50,919][52663] Sum rewards: 67.252, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.120', 'AMMO5': '0.019', 'AMMO2': '0.060', 'AMMO3': '0.189', 'weapon4': '0.240', 'weapon5': '0.266', 'AMMO4': '0.300', 'weapon2': '0.442', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '53.000'} [2024-08-06 08:44:50,927][52803] DAMAGECOUNT value on done: 938142.0 [2024-08-06 08:44:50,930][52803] Sum rewards: 83.753, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.835', 'AMMO5': '0.012', 'AMMO2': '0.016', 'AMMO4': '0.082', 'weapon5': '0.114', 'weapon4': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.482', 'WEAPON3': '1.150', 'weapon3': '3.032', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.275', 'FRAGCOUNT': '67.000'} [2024-08-06 08:44:51,684][52794] DAMAGECOUNT value on done: 1008327.0 [2024-08-06 08:44:51,685][52794] Sum rewards: 80.686, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.186', 'AMMO5': '0.019', 'AMMO2': '0.045', 'AMMO3': '0.178', 'AMMO4': '0.224', 'weapon5': '0.264', 'weapon4': '0.324', 'weapon2': '0.362', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'weapon3': '2.750', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '65.000'} [2024-08-06 08:44:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 708829184. Throughput: 0: 4353.6. Samples: 177212260. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:44:52,802][52567] Avg episode reward: [(0, '75.749')] [2024-08-06 08:44:53,652][52663] DAMAGECOUNT value on done: 1000067.0 [2024-08-06 08:44:53,653][52663] Sum rewards: 65.100, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.651', 'AMMO2': '0.007', 'WEAPON1': '0.010', 'AMMO4': '0.035', 'AMMO3': '0.146', 'weapon2': '0.504', 'WEAPON3': '0.900', 'HITCOUNT': '3.210', 'weapon3': '3.222', 'DAMAGECOUNT': '15.717', 'FRAGCOUNT': '51.000'} [2024-08-06 08:44:54,032][52803] DAMAGECOUNT value on done: 953388.0 [2024-08-06 08:44:54,034][52803] Sum rewards: 76.225, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.020', 'AMMO2': '0.057', 'weapon4': '0.194', 'AMMO3': '0.195', 'AMMO4': '0.286', 'weapon5': '0.286', 'weapon2': '0.310', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '60.000'} [2024-08-06 08:44:54,069][52650] Updated weights for policy 0, policy_version 86531 (0.0021) [2024-08-06 08:44:54,439][52794] DAMAGECOUNT value on done: 1007591.0 [2024-08-06 08:44:54,441][52794] Sum rewards: 60.598, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.260', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.140', 'AMMO3': '0.226', 'weapon5': '0.242', 'AMMO4': '0.299', 'weapon2': '0.458', 'WEAPON5': '0.550', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.054', 'FRAGCOUNT': '52.000'} [2024-08-06 08:44:54,915][52660] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:44:56,591][52663] DAMAGECOUNT value on done: 1000421.0 [2024-08-06 08:44:56,591][52663] Sum rewards: 86.082, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon4': '0.054', 'weapon5': '0.080', 'AMMO4': '0.162', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.602', 'WEAPON3': '1.300', 'weapon3': '3.052', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.476', 'FRAGCOUNT': '70.000'} [2024-08-06 08:44:57,310][52803] DAMAGECOUNT value on done: 948730.0 [2024-08-06 08:44:57,311][52803] Sum rewards: 75.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.494', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.158', 'AMMO3': '0.167', 'AMMO4': '0.171', 'weapon5': '0.188', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.466', 'WEAPON3': '1.050', 'weapon3': '2.960', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.309', 'FRAGCOUNT': '61.000'} [2024-08-06 08:44:57,557][52794] DAMAGECOUNT value on done: 999891.0 [2024-08-06 08:44:57,561][52794] Sum rewards: 74.894, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.510', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.015', 'weapon5': '0.046', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.288', 'WEAPON3': '1.100', 'HITCOUNT': '3.280', 'weapon3': '3.504', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '60.000'} [2024-08-06 08:44:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 708919296. Throughput: 0: 4350.9. Samples: 177238380. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:44:57,794][52567] Avg episode reward: [(0, '75.834')] [2024-08-06 08:44:58,742][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:44:59,144][52650] Updated weights for policy 0, policy_version 86541 (0.0022) [2024-08-06 08:44:59,578][52663] DAMAGECOUNT value on done: 1007984.0 [2024-08-06 08:44:59,579][52663] Sum rewards: 81.806, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.734', 'AMMO5': '0.013', 'weapon4': '0.028', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.152', 'AMMO3': '0.197', 'weapon5': '0.268', 'weapon2': '0.336', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '65.500'} [2024-08-06 08:45:00,034][52795] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:45:00,138][52647] Large shaping reward 3.216 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.165, 55.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:45:00,412][52803] DAMAGECOUNT value on done: 936830.0 [2024-08-06 08:45:00,412][52803] Sum rewards: 76.252, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.568', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.062', 'weapon5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.142', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.946', 'FRAGCOUNT': '64.000'} [2024-08-06 08:45:00,684][52794] DAMAGECOUNT value on done: 1014934.0 [2024-08-06 08:45:00,688][52794] Sum rewards: 98.362, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.692', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.070', 'AMMO4': '0.151', 'weapon5': '0.208', 'weapon2': '0.220', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.242', 'HITCOUNT': '4.140', 'DAMAGECOUNT': '23.802', 'FRAGCOUNT': '80.000'} [2024-08-06 08:45:02,399][52663] DAMAGECOUNT value on done: 1008020.0 [2024-08-06 08:45:02,401][52663] Sum rewards: 63.266, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.150', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.106', 'weapon5': '0.128', 'AMMO4': '0.177', 'AMMO3': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.650', 'HITCOUNT': '2.980', 'weapon3': '3.174', 'DAMAGECOUNT': '16.113', 'FRAGCOUNT': '56.000'} [2024-08-06 08:45:02,639][52614] Signal inference workers to stop experience collection... (15950 times) [2024-08-06 08:45:02,640][52614] Signal inference workers to resume experience collection... (15950 times) [2024-08-06 08:45:02,677][52650] InferenceWorker_p0-w0: stopping experience collection (15950 times) [2024-08-06 08:45:02,678][52650] InferenceWorker_p0-w0: resuming experience collection (15950 times) [2024-08-06 08:45:02,794][52567] Fps is (10 sec: 18841.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 709017600. Throughput: 0: 4351.1. Samples: 177251460. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:45:02,795][52567] Avg episode reward: [(0, '75.896')] [2024-08-06 08:45:03,508][52803] DAMAGECOUNT value on done: 954301.0 [2024-08-06 08:45:03,508][52803] Sum rewards: 72.598, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.564', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.114', 'weapon5': '0.118', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.300', 'HITCOUNT': '3.130', 'weapon3': '3.342', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '60.000'} [2024-08-06 08:45:03,650][52794] DAMAGECOUNT value on done: 1010268.0 [2024-08-06 08:45:03,650][52794] Sum rewards: 73.010, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.560', 'AMMO5': '0.009', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.102', 'AMMO4': '0.145', 'AMMO3': '0.192', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.320', 'weapon4': '0.424', 'WEAPON3': '1.100', 'weapon3': '2.872', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '59.000'} [2024-08-06 08:45:03,897][52650] Updated weights for policy 0, policy_version 86551 (0.0022) [2024-08-06 08:45:05,545][52663] DAMAGECOUNT value on done: 1012307.0 [2024-08-06 08:45:05,547][52663] Sum rewards: 67.276, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.221', 'AMMO5': '0.011', 'WEAPON1': '0.020', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO4': '0.171', 'weapon5': '0.172', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '54.000'} [2024-08-06 08:45:06,159][52794] DAMAGECOUNT value on done: 1002162.0 [2024-08-06 08:45:06,160][52794] Sum rewards: 78.240, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.019', 'AMMO2': '0.033', 'AMMO3': '0.143', 'weapon4': '0.154', 'AMMO4': '0.164', 'weapon5': '0.312', 'WEAPON4': '0.350', 'HEALTH': '0.403', 'WEAPON5': '0.450', 'weapon2': '0.528', 'WEAPON3': '0.850', 'weapon3': '2.760', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.774', 'FRAGCOUNT': '60.500'} [2024-08-06 08:45:06,823][52803] DAMAGECOUNT value on done: 939652.0 [2024-08-06 08:45:06,825][52803] Sum rewards: 88.385, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.356', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.072', 'weapon5': '0.118', 'AMMO4': '0.128', 'AMMO3': '0.177', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.150', 'weapon3': '3.362', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.226', 'FRAGCOUNT': '71.000'} [2024-08-06 08:45:06,877][52663] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:45:07,174][52670] DAMAGECOUNT value on done: 997365.0 [2024-08-06 08:45:07,178][52670] Sum rewards: 73.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.502', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.042', 'weapon5': '0.128', 'AMMO3': '0.196', 'AMMO4': '0.209', 'WEAPON4': '0.300', 'weapon2': '0.306', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.368', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '59.000'} [2024-08-06 08:45:07,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.8, 300 sec: 17467.0). Total num frames: 709099520. Throughput: 0: 4354.4. Samples: 177277750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:45:07,802][52567] Avg episode reward: [(0, '75.556')] [2024-08-06 08:45:08,287][52650] Updated weights for policy 0, policy_version 86561 (0.0015) [2024-08-06 08:45:08,397][52663] DAMAGECOUNT value on done: 1011107.0 [2024-08-06 08:45:08,399][52663] Sum rewards: 79.249, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.740', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.060', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.648', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '63.000'} [2024-08-06 08:45:09,124][52794] DAMAGECOUNT value on done: 1016507.0 [2024-08-06 08:45:09,126][52794] Sum rewards: 90.691, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.920', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.030', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.151', 'weapon2': '0.184', 'AMMO3': '0.316', 'WEAPON3': '1.800', 'weapon3': '3.544', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '78.000'} [2024-08-06 08:45:09,884][52803] DAMAGECOUNT value on done: 948770.0 [2024-08-06 08:45:09,886][52803] Sum rewards: 84.700, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.645', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.012', 'AMMO4': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.226', 'weapon2': '0.294', 'WEAPON3': '1.500', 'weapon3': '3.496', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '72.000'} [2024-08-06 08:45:10,026][52670] DAMAGECOUNT value on done: 1018134.0 [2024-08-06 08:45:10,029][52670] Sum rewards: 75.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.648', 'AMMO5': '0.011', 'AMMO2': '0.032', 'AMMO4': '0.160', 'AMMO3': '0.215', 'weapon5': '0.228', 'weapon2': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.300', 'weapon3': '2.936', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:11,020][52663] DAMAGECOUNT value on done: 1016437.0 [2024-08-06 08:45:11,020][52663] Sum rewards: 86.924, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO2': '0.009', 'AMMO4': '0.042', 'AMMO3': '0.223', 'weapon2': '0.514', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '4.210', 'DAMAGECOUNT': '21.816', 'FRAGCOUNT': '70.000'} [2024-08-06 08:45:12,037][52794] DAMAGECOUNT value on done: 1010523.0 [2024-08-06 08:45:12,038][52794] Sum rewards: 81.398, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.355', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.045', 'WEAPON4': '0.150', 'weapon5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.168', 'weapon2': '0.216', 'WEAPON5': '0.250', 'WEAPON3': '1.050', 'weapon3': '3.302', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '65.000'} [2024-08-06 08:45:12,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 709181440. Throughput: 0: 4353.6. Samples: 177303770. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:45:12,794][52567] Avg episode reward: [(0, '75.998')] [2024-08-06 08:45:13,034][52803] DAMAGECOUNT value on done: 948047.0 [2024-08-06 08:45:13,036][52803] Sum rewards: 78.243, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.956', 'AMMO5': '0.005', 'AMMO2': '0.014', 'weapon4': '0.032', 'weapon5': '0.064', 'AMMO4': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.192', 'AMMO3': '0.250', 'WEAPON3': '1.600', 'weapon3': '3.512', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '67.000'} [2024-08-06 08:45:13,112][52670] DAMAGECOUNT value on done: 998644.0 [2024-08-06 08:45:13,113][52670] Sum rewards: 68.608, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.066', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.268', 'WEAPON3': '1.200', 'HITCOUNT': '3.010', 'weapon3': '3.502', 'DAMAGECOUNT': '15.795', 'FRAGCOUNT': '56.000'} [2024-08-06 08:45:13,128][52650] Updated weights for policy 0, policy_version 86571 (0.0012) [2024-08-06 08:45:13,886][52663] DAMAGECOUNT value on done: 1022729.0 [2024-08-06 08:45:13,887][52663] Sum rewards: 83.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.962', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.070', 'weapon5': '0.084', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.227', 'weapon2': '0.438', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '69.000'} [2024-08-06 08:45:14,989][52794] DAMAGECOUNT value on done: 1023344.0 [2024-08-06 08:45:14,991][52794] Sum rewards: 80.180, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.880', 'AMMO5': '0.012', 'AMMO2': '0.027', 'AMMO4': '0.134', 'AMMO3': '0.187', 'weapon5': '0.192', 'weapon2': '0.248', 'weapon4': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '65.000'} [2024-08-06 08:45:15,937][52820] DAMAGECOUNT value on done: 934691.0 [2024-08-06 08:45:15,937][52820] Sum rewards: 75.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.470', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.180', 'weapon5': '0.198', 'AMMO4': '0.214', 'AMMO3': '0.253', 'weapon2': '0.334', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.006', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '64.000'} [2024-08-06 08:45:16,101][52803] DAMAGECOUNT value on done: 957502.0 [2024-08-06 08:45:16,101][52803] Sum rewards: 76.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.066', 'weapon5': '0.160', 'AMMO4': '0.198', 'AMMO3': '0.231', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '2.964', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.850', 'FRAGCOUNT': '61.000'} [2024-08-06 08:45:16,215][52663] DAMAGECOUNT value on done: 999896.0 [2024-08-06 08:45:16,215][52663] Sum rewards: 74.616, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.796', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.064', 'AMMO3': '0.131', 'WEAPON4': '0.150', 'weapon5': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.682', 'WEAPON3': '0.900', 'weapon3': '2.888', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.937', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:16,281][52670] DAMAGECOUNT value on done: 1000566.0 [2024-08-06 08:45:16,283][52670] Sum rewards: 75.364, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.535', 'AMMO5': '0.013', 'AMMO2': '0.056', 'weapon5': '0.156', 'weapon4': '0.170', 'AMMO3': '0.191', 'weapon2': '0.232', 'AMMO4': '0.281', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.200', 'weapon3': '3.240', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '61.000'} [2024-08-06 08:45:16,768][52666] DAMAGECOUNT value on done: 1009937.0 [2024-08-06 08:45:16,770][52666] Sum rewards: 84.110, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.460', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.069', 'WEAPON5': '0.100', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.212', 'weapon2': '0.658', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '68.000'} [2024-08-06 08:45:17,448][52794] DAMAGECOUNT value on done: 1004607.0 [2024-08-06 08:45:17,448][52794] Sum rewards: 71.093, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.036', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.082', 'weapon5': '0.118', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.298', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.887', 'FRAGCOUNT': '60.000'} [2024-08-06 08:45:17,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 709263360. Throughput: 0: 4363.1. Samples: 177317070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:45:17,794][52567] Avg episode reward: [(0, '76.155')] [2024-08-06 08:45:18,109][52650] Updated weights for policy 0, policy_version 86581 (0.0034) [2024-08-06 08:45:19,090][52820] DAMAGECOUNT value on done: 940057.0 [2024-08-06 08:45:19,091][52820] Sum rewards: 79.812, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.392', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.056', 'AMMO4': '0.171', 'weapon5': '0.180', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.400', 'weapon3': '3.058', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.545', 'FRAGCOUNT': '65.000'} [2024-08-06 08:45:19,263][52803] DAMAGECOUNT value on done: 951731.0 [2024-08-06 08:45:19,264][52803] Sum rewards: 79.513, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.410', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO4': '0.171', 'AMMO3': '0.231', 'weapon2': '0.298', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:19,452][52670] DAMAGECOUNT value on done: 1011770.0 [2024-08-06 08:45:19,453][52670] Sum rewards: 72.508, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.963', 'AMMO5': '0.009', 'WEAPON1': '0.010', 'AMMO2': '0.028', 'weapon4': '0.104', 'AMMO4': '0.141', 'weapon5': '0.148', 'AMMO3': '0.218', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.400', 'weapon3': '3.170', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:19,971][52666] DAMAGECOUNT value on done: 1011827.0 [2024-08-06 08:45:19,971][52666] Sum rewards: 83.849, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.105', 'AMMO5': '0.014', 'AMMO2': '0.031', 'weapon4': '0.056', 'AMMO4': '0.155', 'AMMO3': '0.179', 'weapon5': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.662', 'WEAPON3': '1.150', 'weapon3': '2.850', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '67.000'} [2024-08-06 08:45:19,991][52794] DAMAGECOUNT value on done: 1016544.0 [2024-08-06 08:45:19,992][52794] Sum rewards: 79.228, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.046', 'AMMO4': '0.128', 'weapon5': '0.138', 'AMMO3': '0.193', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.150', 'weapon3': '3.318', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '63.000'} [2024-08-06 08:45:22,148][52650] Updated weights for policy 0, policy_version 86591 (0.0025) [2024-08-06 08:45:22,182][52668] DAMAGECOUNT value on done: 1020587.0 [2024-08-06 08:45:22,185][52668] Sum rewards: 67.034, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.744', 'AMMO5': '0.007', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'weapon4': '0.226', 'AMMO3': '0.230', 'weapon2': '0.346', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.326', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:22,300][52803] DAMAGECOUNT value on done: 947980.0 [2024-08-06 08:45:22,301][52803] Sum rewards: 78.371, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.320', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.122', 'AMMO3': '0.153', 'AMMO4': '0.182', 'weapon5': '0.212', 'weapon2': '0.288', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '0.950', 'weapon3': '3.160', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:22,387][52820] DAMAGECOUNT value on done: 940809.0 [2024-08-06 08:45:22,388][52820] Sum rewards: 75.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.440', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.100', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.234', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:22,555][52670] DAMAGECOUNT value on done: 1002320.0 [2024-08-06 08:45:22,556][52670] Sum rewards: 69.288, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.170', 'AMMO5': '0.017', 'AMMO2': '0.041', 'weapon5': '0.062', 'weapon4': '0.182', 'AMMO3': '0.205', 'AMMO4': '0.207', 'weapon2': '0.258', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.240', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '17.496', 'FRAGCOUNT': '59.000'} [2024-08-06 08:45:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 709361664. Throughput: 0: 4359.6. Samples: 177343140. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:45:22,794][52567] Avg episode reward: [(0, '76.176')] [2024-08-06 08:45:22,962][52794] DAMAGECOUNT value on done: 1012897.0 [2024-08-06 08:45:22,962][52794] Sum rewards: 81.023, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.640', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.068', 'weapon5': '0.140', 'AMMO4': '0.149', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.902', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:23,337][52666] DAMAGECOUNT value on done: 1017614.0 [2024-08-06 08:45:23,337][52666] Sum rewards: 78.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.630', 'AMMO4': '-0.007', 'AMMO2': '-0.001', 'AMMO3': '0.208', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.510', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.780', 'FRAGCOUNT': '64.000'} [2024-08-06 08:45:24,255][52665] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0)] [2024-08-06 08:45:24,981][52668] DAMAGECOUNT value on done: 1019579.0 [2024-08-06 08:45:24,981][52668] Sum rewards: 70.567, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.268', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.034', 'weapon5': '0.082', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'AMMO3': '0.247', 'WEAPON5': '0.250', 'weapon2': '0.298', 'WEAPON3': '1.450', 'HITCOUNT': '3.260', 'weapon3': '3.346', 'DAMAGECOUNT': '17.562', 'FRAGCOUNT': '60.000'} [2024-08-06 08:45:25,288][52670] DAMAGECOUNT value on done: 999839.0 [2024-08-06 08:45:25,290][52670] Sum rewards: 81.782, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.136', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.100', 'weapon5': '0.134', 'AMMO4': '0.141', 'AMMO3': '0.248', 'weapon2': '0.290', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.180', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '68.000'} [2024-08-06 08:45:25,619][52820] DAMAGECOUNT value on done: 929323.0 [2024-08-06 08:45:25,620][52820] Sum rewards: 83.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.555', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.144', 'AMMO4': '0.177', 'weapon4': '0.184', 'AMMO3': '0.187', 'WEAPON5': '0.300', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.096', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '67.000'} [2024-08-06 08:45:25,824][52666] DAMAGECOUNT value on done: 1011171.0 [2024-08-06 08:45:25,827][52666] Sum rewards: 86.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.511', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.028', 'AMMO4': '0.109', 'weapon5': '0.142', 'WEAPON4': '0.150', 'AMMO3': '0.187', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.328', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '69.000'} [2024-08-06 08:45:26,013][52794] DAMAGECOUNT value on done: 1021588.0 [2024-08-06 08:45:26,013][52794] Sum rewards: 80.930, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.782', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.221', 'weapon2': '0.384', 'WEAPON3': '1.450', 'weapon3': '3.258', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '68.000'} [2024-08-06 08:45:27,355][52650] Updated weights for policy 0, policy_version 86601 (0.0018) [2024-08-06 08:45:27,726][52668] DAMAGECOUNT value on done: 1013237.0 [2024-08-06 08:45:27,730][52668] Sum rewards: 69.845, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.340', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.019', 'weapon5': '0.044', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.332', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '15.960', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:27,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17339.7, 300 sec: 17467.0). Total num frames: 709443584. Throughput: 0: 4356.0. Samples: 177369230. Policy #0 lag: (min: 0.0, avg: 3.4, max: 9.0) [2024-08-06 08:45:27,794][52567] Avg episode reward: [(0, '76.366')] [2024-08-06 08:45:28,480][52670] DAMAGECOUNT value on done: 1001495.0 [2024-08-06 08:45:28,484][52670] Sum rewards: 82.827, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.876', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.070', 'AMMO4': '0.177', 'AMMO3': '0.208', 'weapon5': '0.216', 'weapon2': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '68.000'} [2024-08-06 08:45:28,677][52794] DAMAGECOUNT value on done: 1025656.0 [2024-08-06 08:45:28,677][52794] Sum rewards: 72.191, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.468', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.118', 'AMMO4': '0.149', 'weapon2': '0.246', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.338', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.008', 'FRAGCOUNT': '60.000'} [2024-08-06 08:45:28,896][52820] DAMAGECOUNT value on done: 937396.0 [2024-08-06 08:45:28,896][52820] Sum rewards: 64.803, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.597', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO4': '0.092', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.408', 'WEAPON3': '1.000', 'weapon3': '3.242', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '15.369', 'FRAGCOUNT': '51.000'} [2024-08-06 08:45:29,209][52666] DAMAGECOUNT value on done: 1003614.0 [2024-08-06 08:45:29,213][52666] Sum rewards: 79.544, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.632', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.030', 'AMMO4': '0.114', 'weapon5': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.168', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '65.500'} [2024-08-06 08:45:30,689][52668] DAMAGECOUNT value on done: 1020457.0 [2024-08-06 08:45:30,690][52668] Sum rewards: 76.291, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.285', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.029', 'WEAPON4': '0.100', 'weapon5': '0.140', 'AMMO4': '0.143', 'AMMO3': '0.189', 'WEAPON5': '0.200', 'weapon2': '0.230', 'WEAPON3': '1.250', 'weapon3': '3.456', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '61.000'} [2024-08-06 08:45:31,518][52670] DAMAGECOUNT value on done: 998955.0 [2024-08-06 08:45:31,518][52670] Sum rewards: 79.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.242', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.886', 'FRAGCOUNT': '68.000'} [2024-08-06 08:45:31,726][52803] Large shaping reward 2.629 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:45:31,991][52666] DAMAGECOUNT value on done: 1005829.0 [2024-08-06 08:45:31,992][52666] Sum rewards: 80.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.590', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.057', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.231', 'weapon2': '0.266', 'WEAPON3': '1.300', 'weapon3': '3.414', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.551', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:32,073][52650] Updated weights for policy 0, policy_version 86611 (0.0019) [2024-08-06 08:45:32,108][52820] DAMAGECOUNT value on done: 925043.0 [2024-08-06 08:45:32,110][52820] Sum rewards: 75.798, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.693', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.178', 'weapon2': '0.212', 'AMMO3': '0.218', 'weapon5': '0.318', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.984', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:32,149][52664] DAMAGECOUNT value on done: 1042875.0 [2024-08-06 08:45:32,150][52664] Sum rewards: 70.613, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.346', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.150', 'weapon5': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.548', 'WEAPON3': '0.850', 'weapon3': '3.028', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '54.000'} [2024-08-06 08:45:32,292][52794] DAMAGECOUNT value on done: 1014431.0 [2024-08-06 08:45:32,293][52794] Sum rewards: 76.296, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.730', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.025', 'weapon4': '0.082', 'AMMO4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.090', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.834', 'FRAGCOUNT': '64.000'} [2024-08-06 08:45:32,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 709525504. Throughput: 0: 4354.4. Samples: 177382100. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:45:32,794][52567] Avg episode reward: [(0, '76.203')] [2024-08-06 08:45:33,465][52668] DAMAGECOUNT value on done: 1006317.0 [2024-08-06 08:45:33,465][52668] Sum rewards: 83.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.940', 'AMMO5': '0.012', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon4': '0.114', 'AMMO3': '0.175', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.486', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '69.000'} [2024-08-06 08:45:34,470][52670] DAMAGECOUNT value on done: 997311.0 [2024-08-06 08:45:34,470][52670] Sum rewards: 69.625, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO2': '0.013', 'AMMO4': '0.065', 'AMMO3': '0.212', 'weapon2': '0.286', 'WEAPON3': '1.350', 'HITCOUNT': '3.460', 'weapon3': '3.560', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '58.000'} [2024-08-06 08:45:35,033][52666] DAMAGECOUNT value on done: 1008272.0 [2024-08-06 08:45:35,035][52666] Sum rewards: 77.519, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.737', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.115', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.150', 'weapon3': '3.264', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.105', 'FRAGCOUNT': '63.000'} [2024-08-06 08:45:35,231][52664] DAMAGECOUNT value on done: 1050803.0 [2024-08-06 08:45:35,232][52664] Sum rewards: 76.692, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO4': '0.156', 'HEALTH': '0.166', 'weapon4': '0.168', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon2': '0.200', 'WEAPON3': '1.100', 'HITCOUNT': '3.260', 'weapon3': '3.276', 'DAMAGECOUNT': '17.646', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:35,357][52820] DAMAGECOUNT value on done: 932094.0 [2024-08-06 08:45:35,357][52820] Sum rewards: 72.051, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.950', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.066', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.502', 'WEAPON3': '1.350', 'weapon3': '3.176', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.361', 'FRAGCOUNT': '60.000'} [2024-08-06 08:45:36,387][52668] DAMAGECOUNT value on done: 1018660.0 [2024-08-06 08:45:36,387][52668] Sum rewards: 84.814, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.820', 'AMMO5': '0.014', 'AMMO2': '0.052', 'AMMO3': '0.144', 'weapon5': '0.230', 'AMMO4': '0.261', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON4': '0.400', 'weapon4': '0.402', 'WEAPON3': '0.900', 'weapon3': '2.842', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:36,442][52650] Updated weights for policy 0, policy_version 86621 (0.0028) [2024-08-06 08:45:37,447][52670] DAMAGECOUNT value on done: 1013992.0 [2024-08-06 08:45:37,450][52670] Sum rewards: 72.658, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.564', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.100', 'AMMO4': '0.218', 'AMMO3': '0.227', 'weapon5': '0.238', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.020', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 709615616. Throughput: 0: 4358.7. Samples: 177408400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:45:37,802][52567] Avg episode reward: [(0, '76.142')] [2024-08-06 08:45:37,850][52666] DAMAGECOUNT value on done: 1000243.0 [2024-08-06 08:45:37,852][52666] Sum rewards: 78.380, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.880', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon5': '0.160', 'AMMO4': '0.245', 'AMMO3': '0.272', 'weapon2': '0.278', 'weapon4': '0.284', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.008', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.311', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:38,435][52664] DAMAGECOUNT value on done: 1056843.0 [2024-08-06 08:45:38,438][52664] Sum rewards: 75.601, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.770', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon5': '0.126', 'AMMO4': '0.173', 'weapon4': '0.224', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.450', 'weapon3': '2.770', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '64.000'} [2024-08-06 08:45:38,560][52820] DAMAGECOUNT value on done: 935730.0 [2024-08-06 08:45:38,564][52820] Sum rewards: 74.493, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.570', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.105', 'weapon5': '0.120', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '60.000'} [2024-08-06 08:45:38,679][52667] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:45:39,196][52670] Large shaping reward -2.534 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.28500000000000003, -95.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:45:39,609][52668] DAMAGECOUNT value on done: 1017394.0 [2024-08-06 08:45:39,609][52668] Sum rewards: 75.244, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.780', 'AMMO5': '0.025', 'AMMO2': '0.060', 'weapon4': '0.154', 'AMMO3': '0.239', 'weapon5': '0.272', 'AMMO4': '0.302', 'weapon2': '0.338', 'WEAPON4': '0.600', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.896', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.447', 'FRAGCOUNT': '64.000'} [2024-08-06 08:45:39,683][52665] DAMAGECOUNT value on done: 1000860.0 [2024-08-06 08:45:39,683][52665] Sum rewards: 82.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.040', 'AMMO5': '0.009', 'AMMO2': '0.030', 'weapon4': '0.044', 'weapon5': '0.118', 'AMMO4': '0.152', 'AMMO3': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:40,004][52667] DAMAGECOUNT value on done: 1010267.0 [2024-08-06 08:45:40,005][52667] Sum rewards: 65.013, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.004', 'AMMO2': '0.024', 'weapon5': '0.038', 'weapon4': '0.058', 'HEALTH': '0.067', 'WEAPON5': '0.100', 'AMMO4': '0.121', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'weapon2': '0.680', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '51.000'} [2024-08-06 08:45:40,142][52670] DAMAGECOUNT value on done: 994470.0 [2024-08-06 08:45:40,144][52670] Sum rewards: 74.507, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.545', 'AMMO5': '0.021', 'AMMO2': '0.049', 'weapon4': '0.214', 'AMMO3': '0.230', 'AMMO4': '0.247', 'weapon5': '0.266', 'WEAPON4': '0.450', 'weapon2': '0.492', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.744', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '60.500'} [2024-08-06 08:45:40,657][52666] DAMAGECOUNT value on done: 1014400.0 [2024-08-06 08:45:40,659][52666] Sum rewards: 81.216, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.535', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.040', 'AMMO4': '0.140', 'AMMO3': '0.200', 'weapon5': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.462', 'WEAPON3': '1.350', 'weapon3': '3.084', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:41,245][52650] Updated weights for policy 0, policy_version 86631 (0.0016) [2024-08-06 08:45:41,374][52664] DAMAGECOUNT value on done: 1044496.0 [2024-08-06 08:45:41,375][52664] Sum rewards: 82.224, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.612', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.040', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.242', 'weapon2': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.386', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '67.000'} [2024-08-06 08:45:41,666][52820] DAMAGECOUNT value on done: 941780.0 [2024-08-06 08:45:41,667][52820] Sum rewards: 74.171, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.825', 'AMMO5': '0.010', 'AMMO2': '0.038', 'AMMO4': '0.190', 'weapon5': '0.202', 'AMMO3': '0.233', 'weapon4': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.414', 'WEAPON3': '1.450', 'weapon3': '2.894', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '63.000'} [2024-08-06 08:45:42,542][52668] DAMAGECOUNT value on done: 1008611.0 [2024-08-06 08:45:42,545][52668] Sum rewards: 66.268, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.367', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.162', 'weapon5': '0.168', 'AMMO4': '0.212', 'AMMO3': '0.243', 'weapon2': '0.292', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.068', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.043', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:42,678][52665] DAMAGECOUNT value on done: 1011919.0 [2024-08-06 08:45:42,679][52665] Sum rewards: 65.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.582', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.146', 'AMMO3': '0.162', 'AMMO4': '0.252', 'weapon5': '0.350', 'weapon2': '0.352', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.866', 'HITCOUNT': '3.010', 'DAMAGECOUNT': '16.572', 'FRAGCOUNT': '52.000'} [2024-08-06 08:45:42,754][52670] DAMAGECOUNT value on done: 1008829.0 [2024-08-06 08:45:42,754][52670] Sum rewards: 70.846, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.820', 'AMMO5': '0.020', 'AMMO2': '0.061', 'AMMO3': '0.143', 'weapon4': '0.188', 'weapon5': '0.252', 'AMMO4': '0.303', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.644', 'WEAPON3': '0.950', 'weapon3': '2.636', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 709705728. Throughput: 0: 4358.9. Samples: 177434530. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:45:42,794][52567] Avg episode reward: [(0, '75.998')] [2024-08-06 08:45:42,922][52667] DAMAGECOUNT value on done: 1030210.0 [2024-08-06 08:45:42,923][52667] Sum rewards: 90.247, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.520', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.074', 'AMMO4': '0.147', 'weapon5': '0.184', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '21.942', 'FRAGCOUNT': '73.000'} [2024-08-06 08:45:43,255][52666] DAMAGECOUNT value on done: 1001345.0 [2024-08-06 08:45:43,255][52666] Sum rewards: 64.938, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.260', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.034', 'AMMO4': '0.143', 'weapon5': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.191', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.200', 'HITCOUNT': '3.240', 'weapon3': '3.360', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '52.000'} [2024-08-06 08:45:44,166][52664] DAMAGECOUNT value on done: 1060936.0 [2024-08-06 08:45:44,166][52664] Sum rewards: 76.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.112', 'AMMO5': '0.015', 'AMMO2': '0.037', 'AMMO4': '0.186', 'AMMO3': '0.195', 'weapon4': '0.234', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.150', 'weapon3': '2.812', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:44,911][52820] DAMAGECOUNT value on done: 949460.0 [2024-08-06 08:45:44,913][52820] Sum rewards: 74.574, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.578', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.058', 'weapon5': '0.188', 'AMMO4': '0.245', 'weapon2': '0.250', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.212', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '65.000'} [2024-08-06 08:45:45,375][52665] DAMAGECOUNT value on done: 1005431.0 [2024-08-06 08:45:45,375][52665] Sum rewards: 74.114, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.887', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.123', 'AMMO3': '0.129', 'weapon5': '0.194', 'weapon4': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON3': '0.950', 'weapon3': '2.732', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.234', 'FRAGCOUNT': '56.000'} [2024-08-06 08:45:45,602][52668] DAMAGECOUNT value on done: 1011887.0 [2024-08-06 08:45:45,602][52668] Sum rewards: 79.056, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.624', 'AMMO5': '0.014', 'WEAPON1': '0.020', 'AMMO2': '0.033', 'weapon4': '0.064', 'weapon5': '0.118', 'AMMO4': '0.164', 'AMMO3': '0.184', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.172', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '65.000'} [2024-08-06 08:45:45,661][52670] DAMAGECOUNT value on done: 1012988.0 [2024-08-06 08:45:45,661][52670] Sum rewards: 71.647, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.834', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.044', 'weapon5': '0.088', 'AMMO3': '0.189', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.472', 'WEAPON3': '1.050', 'weapon3': '3.210', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '59.000'} [2024-08-06 08:45:45,833][52667] DAMAGECOUNT value on done: 1023574.0 [2024-08-06 08:45:45,836][52667] Sum rewards: 70.954, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.510', 'AMMO5': '0.021', 'AMMO2': '0.087', 'AMMO3': '0.216', 'weapon5': '0.264', 'weapon4': '0.338', 'AMMO4': '0.433', 'weapon2': '0.588', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.466', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '58.000'} [2024-08-06 08:45:46,048][52650] Updated weights for policy 0, policy_version 86641 (0.0022) [2024-08-06 08:45:46,289][52666] DAMAGECOUNT value on done: 1009727.0 [2024-08-06 08:45:46,292][52666] Sum rewards: 79.357, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.730', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon5': '0.074', 'weapon4': '0.096', 'WEAPON5': '0.150', 'weapon2': '0.154', 'AMMO4': '0.162', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON3': '1.250', 'HITCOUNT': '3.460', 'weapon3': '3.516', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '65.000'} [2024-08-06 08:45:46,434][52795] DAMAGECOUNT value on done: 933900.0 [2024-08-06 08:45:46,435][52795] Sum rewards: 80.251, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.542', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.064', 'weapon5': '0.174', 'AMMO4': '0.178', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.868', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.662', 'FRAGCOUNT': '68.000'} [2024-08-06 08:45:47,071][52664] DAMAGECOUNT value on done: 1054396.0 [2024-08-06 08:45:47,072][52664] Sum rewards: 61.983, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.180', 'AMMO5': '0.015', 'AMMO2': '0.039', 'AMMO4': '0.193', 'weapon2': '0.244', 'AMMO3': '0.249', 'weapon5': '0.258', 'WEAPON4': '0.400', 'weapon4': '0.404', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.794', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.947', 'FRAGCOUNT': '52.000'} [2024-08-06 08:45:47,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 709795840. Throughput: 0: 4360.7. Samples: 177447690. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:45:47,794][52567] Avg episode reward: [(0, '76.301')] [2024-08-06 08:45:47,971][52820] DAMAGECOUNT value on done: 930871.0 [2024-08-06 08:45:47,973][52820] Sum rewards: 73.238, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.796', 'AMMO5': '0.007', 'WEAPON1': '0.020', 'AMMO2': '0.021', 'weapon5': '0.044', 'weapon4': '0.094', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.226', 'weapon2': '0.564', 'WEAPON3': '1.350', 'weapon3': '2.942', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '61.000'} [2024-08-06 08:45:47,995][52665] DAMAGECOUNT value on done: 1009398.0 [2024-08-06 08:45:47,997][52665] Sum rewards: 77.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.088', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.128', 'weapon5': '0.142', 'AMMO4': '0.145', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.855', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:48,374][52670] DAMAGECOUNT value on done: 1005830.0 [2024-08-06 08:45:48,375][52670] Sum rewards: 71.978, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.080', 'AMMO4': '0.135', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.300', 'HITCOUNT': '3.270', 'weapon3': '3.352', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '60.000'} [2024-08-06 08:45:48,755][52668] DAMAGECOUNT value on done: 1019347.0 [2024-08-06 08:45:48,756][52668] Sum rewards: 79.243, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.285', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.072', 'AMMO4': '0.201', 'AMMO3': '0.226', 'weapon5': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.142', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.164', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:48,914][52666] DAMAGECOUNT value on done: 992798.0 [2024-08-06 08:45:48,916][52666] Sum rewards: 78.126, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'ARMOR': '0.004', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.128', 'AMMO4': '0.177', 'weapon5': '0.222', 'AMMO3': '0.227', 'weapon2': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.130', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '64.000'} [2024-08-06 08:45:48,943][52667] DAMAGECOUNT value on done: 1026654.0 [2024-08-06 08:45:48,946][52667] Sum rewards: 73.806, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.780', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.094', 'weapon4': '0.112', 'AMMO3': '0.142', 'AMMO4': '0.184', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.604', 'WEAPON3': '1.000', 'weapon3': '3.048', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.355', 'FRAGCOUNT': '58.000'} [2024-08-06 08:45:49,539][52795] DAMAGECOUNT value on done: 927495.0 [2024-08-06 08:45:49,539][52795] Sum rewards: 77.230, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.220', 'AMMO5': '0.010', 'AMMO2': '0.012', 'AMMO4': '0.061', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'weapon5': '0.174', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:50,066][52664] DAMAGECOUNT value on done: 1045273.0 [2024-08-06 08:45:50,066][52664] Sum rewards: 85.081, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.758', 'AMMO5': '0.005', 'AMMO2': '0.014', 'AMMO4': '0.067', 'weapon5': '0.090', 'WEAPON5': '0.150', 'weapon2': '0.184', 'WEAPON4': '0.200', 'weapon4': '0.202', 'AMMO3': '0.206', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.317', 'FRAGCOUNT': '71.000'} [2024-08-06 08:45:50,597][52650] Updated weights for policy 0, policy_version 86651 (0.0044) [2024-08-06 08:45:50,799][52665] DAMAGECOUNT value on done: 989046.0 [2024-08-06 08:45:50,801][52665] Sum rewards: 66.866, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.335', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon5': '0.144', 'AMMO4': '0.213', 'AMMO3': '0.275', 'weapon4': '0.280', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.470', 'WEAPON3': '1.700', 'weapon3': '2.834', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:51,080][52820] DAMAGECOUNT value on done: 943818.0 [2024-08-06 08:45:51,081][52820] Sum rewards: 71.066, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.230', 'AMMO5': '0.005', 'weapon4': '0.036', 'AMMO2': '0.037', 'weapon5': '0.090', 'AMMO3': '0.173', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.676', 'FRAGCOUNT': '56.000'} [2024-08-06 08:45:51,160][52668] DAMAGECOUNT value on done: 1012790.0 [2024-08-06 08:45:51,160][52668] Sum rewards: 67.174, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.674', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO4': '0.230', 'weapon4': '0.232', 'AMMO3': '0.252', 'weapon5': '0.252', 'weapon2': '0.304', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.900', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.441', 'FRAGCOUNT': '56.000'} [2024-08-06 08:45:51,364][52670] DAMAGECOUNT value on done: 991515.0 [2024-08-06 08:45:51,364][52670] Sum rewards: 75.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.810', 'AMMO5': '0.022', 'AMMO2': '0.061', 'AMMO3': '0.217', 'weapon5': '0.288', 'AMMO4': '0.304', 'weapon4': '0.320', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'weapon2': '0.732', 'WEAPON3': '1.250', 'weapon3': '2.338', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '62.500'} [2024-08-06 08:45:51,901][52666] DAMAGECOUNT value on done: 1019049.0 [2024-08-06 08:45:51,902][52666] Sum rewards: 84.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.092', 'AMMO4': '0.123', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.300', 'weapon3': '3.418', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.007', 'FRAGCOUNT': '69.000'} [2024-08-06 08:45:51,990][52667] DAMAGECOUNT value on done: 1030001.0 [2024-08-06 08:45:51,990][52667] Sum rewards: 71.430, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.176', 'AMMO3': '0.193', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.378', 'weapon2': '0.410', 'WEAPON3': '1.200', 'weapon3': '2.816', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '58.000'} [2024-08-06 08:45:52,357][52820] Large shaping reward 2.514 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('HEALTH', -0.108, -36.0), ('weapon5', 0.002)] [2024-08-06 08:45:52,644][52795] DAMAGECOUNT value on done: 929570.0 [2024-08-06 08:45:52,644][52795] Sum rewards: 68.586, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.258', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon5': '0.134', 'AMMO4': '0.136', 'weapon4': '0.208', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.877', 'FRAGCOUNT': '56.000'} [2024-08-06 08:45:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 709877760. Throughput: 0: 4359.3. Samples: 177473920. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:45:52,802][52567] Avg episode reward: [(0, '76.365')] [2024-08-06 08:45:53,390][52664] DAMAGECOUNT value on done: 1045681.0 [2024-08-06 08:45:53,391][52664] Sum rewards: 88.762, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.584', 'AMMO2': '0.008', 'AMMO5': '0.012', 'weapon4': '0.036', 'AMMO4': '0.040', 'weapon5': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '72.000'} [2024-08-06 08:45:53,404][52665] DAMAGECOUNT value on done: 991324.0 [2024-08-06 08:45:53,406][52665] Sum rewards: 77.156, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.420', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.082', 'AMMO4': '0.163', 'weapon5': '0.180', 'weapon2': '0.232', 'AMMO3': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.204', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '65.000'} [2024-08-06 08:45:53,950][52668] DAMAGECOUNT value on done: 1011515.0 [2024-08-06 08:45:53,951][52668] Sum rewards: 67.256, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.505', 'AMMO5': '0.020', 'AMMO2': '0.041', 'weapon4': '0.086', 'weapon5': '0.194', 'AMMO4': '0.206', 'AMMO3': '0.238', 'weapon2': '0.372', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.074', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.229', 'FRAGCOUNT': '58.000'} [2024-08-06 08:45:54,171][52670] DAMAGECOUNT value on done: 1005249.0 [2024-08-06 08:45:54,173][52670] Sum rewards: 70.417, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.594', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.014', 'weapon5': '0.036', 'AMMO4': '0.040', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.162', 'weapon2': '0.408', 'WEAPON3': '1.050', 'HITCOUNT': '3.140', 'weapon3': '3.436', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:54,209][52820] DAMAGECOUNT value on done: 956411.0 [2024-08-06 08:45:54,210][52820] Sum rewards: 75.119, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.938', 'AMMO5': '0.020', 'AMMO2': '0.060', 'weapon2': '0.172', 'weapon4': '0.234', 'AMMO3': '0.247', 'AMMO4': '0.297', 'weapon5': '0.328', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.500', 'weapon3': '2.968', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:54,880][52666] DAMAGECOUNT value on done: 1012703.0 [2024-08-06 08:45:54,881][52666] Sum rewards: 72.152, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.768', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.170', 'weapon2': '0.174', 'AMMO3': '0.179', 'AMMO4': '0.190', 'weapon4': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'HITCOUNT': '3.240', 'weapon3': '3.244', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '57.000'} [2024-08-06 08:45:54,907][52667] Large shaping reward 3.531 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:45:55,250][52667] DAMAGECOUNT value on done: 1022826.0 [2024-08-06 08:45:55,252][52667] Sum rewards: 57.398, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.401', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.084', 'AMMO4': '0.127', 'weapon5': '0.194', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.500', 'HITCOUNT': '2.760', 'weapon3': '2.996', 'DAMAGECOUNT': '15.339', 'FRAGCOUNT': '49.000'} [2024-08-06 08:45:55,515][52650] Updated weights for policy 0, policy_version 86661 (0.0015) [2024-08-06 08:45:55,662][52664] DAMAGECOUNT value on done: 1054364.0 [2024-08-06 08:45:55,664][52664] Sum rewards: 77.086, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.259', 'AMMO5': '0.011', 'AMMO2': '0.022', 'weapon4': '0.068', 'AMMO4': '0.110', 'weapon5': '0.158', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.162', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '62.000'} [2024-08-06 08:45:55,765][52795] DAMAGECOUNT value on done: 945480.0 [2024-08-06 08:45:55,771][52795] Sum rewards: 80.472, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.274', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO4': '0.165', 'AMMO3': '0.166', 'weapon4': '0.222', 'weapon5': '0.246', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.050', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '63.000'} [2024-08-06 08:45:56,369][52665] DAMAGECOUNT value on done: 1003323.0 [2024-08-06 08:45:56,373][52665] Sum rewards: 63.217, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.290', 'AMMO5': '0.017', 'AMMO2': '0.056', 'AMMO3': '0.163', 'weapon4': '0.180', 'weapon5': '0.200', 'AMMO4': '0.281', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.648', 'WEAPON3': '0.950', 'weapon3': '2.746', 'HITCOUNT': '2.930', 'DAMAGECOUNT': '15.585', 'FRAGCOUNT': '51.000'} [2024-08-06 08:45:56,923][52668] DAMAGECOUNT value on done: 1002903.0 [2024-08-06 08:45:56,924][52668] Sum rewards: 80.361, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.410', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.035', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.169', 'weapon4': '0.174', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.252', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '67.000'} [2024-08-06 08:45:57,195][52670] DAMAGECOUNT value on done: 1014904.0 [2024-08-06 08:45:57,195][52670] Sum rewards: 81.438, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.874', 'AMMO5': '0.019', 'AMMO2': '0.065', 'weapon4': '0.206', 'AMMO3': '0.250', 'weapon5': '0.284', 'weapon2': '0.318', 'AMMO4': '0.323', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.842', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '68.000'} [2024-08-06 08:45:57,309][52820] DAMAGECOUNT value on done: 943582.0 [2024-08-06 08:45:57,310][52820] Sum rewards: 91.928, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon5': '0.056', 'AMMO4': '0.062', 'weapon4': '0.070', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.191', 'weapon2': '0.390', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.237', 'FRAGCOUNT': '74.000'} [2024-08-06 08:45:57,736][52666] DAMAGECOUNT value on done: 1012346.0 [2024-08-06 08:45:57,737][52666] Sum rewards: 81.978, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.755', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.088', 'weapon5': '0.124', 'AMMO4': '0.177', 'weapon2': '0.216', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.505', 'FRAGCOUNT': '67.000'} [2024-08-06 08:45:57,794][52567] Fps is (10 sec: 17202.6, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 709967872. Throughput: 0: 4363.5. Samples: 177500130. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:45:57,795][52567] Avg episode reward: [(0, '75.989')] [2024-08-06 08:45:58,486][52664] DAMAGECOUNT value on done: 1048302.0 [2024-08-06 08:45:58,487][52664] Sum rewards: 54.408, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.024', 'AMMO2': '0.069', 'weapon4': '0.100', 'weapon5': '0.228', 'AMMO3': '0.241', 'AMMO4': '0.343', 'weapon2': '0.362', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'HITCOUNT': '2.700', 'weapon3': '3.036', 'DAMAGECOUNT': '14.484', 'FRAGCOUNT': '48.000'} [2024-08-06 08:45:58,621][52667] DAMAGECOUNT value on done: 1020841.0 [2024-08-06 08:45:58,622][52667] Sum rewards: 90.015, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.062', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.064', 'weapon5': '0.164', 'AMMO4': '0.205', 'AMMO3': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.306', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.234', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '22.521', 'FRAGCOUNT': '72.000'} [2024-08-06 08:45:59,009][52665] DAMAGECOUNT value on done: 1003350.0 [2024-08-06 08:45:59,009][52665] Sum rewards: 73.753, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.220', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.056', 'weapon5': '0.096', 'AMMO3': '0.170', 'AMMO4': '0.195', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.806', 'WEAPON3': '1.000', 'weapon3': '2.842', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.766', 'FRAGCOUNT': '59.000'} [2024-08-06 08:45:59,013][52795] DAMAGECOUNT value on done: 929079.0 [2024-08-06 08:45:59,021][52795] Sum rewards: 79.292, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.630', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.148', 'WEAPON4': '0.150', 'AMMO3': '0.210', 'weapon2': '0.552', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.456', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:59,425][52662] DAMAGECOUNT value on done: 1013293.0 [2024-08-06 08:45:59,426][52662] Sum rewards: 78.141, reward structure: {'DEATHCOUNT': '-16.500', 'AMMO5': '0.020', 'HEALTH': '0.044', 'AMMO2': '0.056', 'weapon4': '0.158', 'AMMO3': '0.251', 'weapon5': '0.268', 'AMMO4': '0.278', 'weapon2': '0.424', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.804', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '66.000'} [2024-08-06 08:45:59,625][52659] DAMAGECOUNT value on done: 1015226.0 [2024-08-06 08:45:59,627][52659] Sum rewards: 80.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.991', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.026', 'AMMO4': '0.064', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.251', 'weapon2': '0.318', 'WEAPON3': '1.550', 'weapon3': '3.384', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '67.000'} [2024-08-06 08:45:59,978][52668] DAMAGECOUNT value on done: 1004228.0 [2024-08-06 08:45:59,978][52668] Sum rewards: 75.665, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.064', 'AMMO5': '0.018', 'AMMO2': '0.050', 'weapon4': '0.178', 'weapon2': '0.214', 'AMMO4': '0.249', 'AMMO3': '0.257', 'weapon5': '0.260', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.058', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:00,266][52670] DAMAGECOUNT value on done: 1008670.0 [2024-08-06 08:46:00,266][52670] Sum rewards: 84.715, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.350', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.108', 'AMMO4': '0.117', 'weapon5': '0.134', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.024', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.918', 'FRAGCOUNT': '69.500'} [2024-08-06 08:46:00,339][52650] Updated weights for policy 0, policy_version 86671 (0.0013) [2024-08-06 08:46:00,390][52820] DAMAGECOUNT value on done: 940796.0 [2024-08-06 08:46:00,391][52820] Sum rewards: 82.709, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.750', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.062', 'AMMO3': '0.221', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.322', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:00,837][52666] DAMAGECOUNT value on done: 1002899.0 [2024-08-06 08:46:00,839][52666] Sum rewards: 83.448, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.545', 'AMMO5': '0.021', 'AMMO2': '0.043', 'weapon4': '0.210', 'AMMO4': '0.213', 'weapon5': '0.214', 'AMMO3': '0.235', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.860', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.832', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:01,458][52665] DAMAGECOUNT value on done: 1009750.0 [2024-08-06 08:46:01,459][52665] Sum rewards: 97.578, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.701', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.032', 'weapon5': '0.094', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.209', 'weapon2': '0.210', 'WEAPON3': '1.250', 'weapon3': '3.476', 'HITCOUNT': '4.450', 'DAMAGECOUNT': '22.608', 'FRAGCOUNT': '79.000'} [2024-08-06 08:46:01,706][52664] DAMAGECOUNT value on done: 1059742.0 [2024-08-06 08:46:01,707][52664] Sum rewards: 75.827, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.232', 'AMMO5': '0.017', 'AMMO2': '0.036', 'AMMO4': '0.179', 'AMMO3': '0.186', 'weapon5': '0.206', 'weapon4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '2.822', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '61.000'} [2024-08-06 08:46:01,823][52667] DAMAGECOUNT value on done: 1016421.0 [2024-08-06 08:46:01,825][52667] Sum rewards: 66.200, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.280', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon5': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.277', 'weapon2': '0.334', 'WEAPON3': '1.550', 'weapon3': '3.248', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.938', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:02,163][52659] DAMAGECOUNT value on done: 1014792.0 [2024-08-06 08:46:02,163][52659] Sum rewards: 61.065, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.886', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.114', 'AMMO4': '0.116', 'AMMO3': '0.199', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.302', 'weapon2': '0.484', 'WEAPON3': '1.200', 'weapon3': '2.866', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.214', 'FRAGCOUNT': '50.000'} [2024-08-06 08:46:02,175][52795] DAMAGECOUNT value on done: 930945.0 [2024-08-06 08:46:02,176][52795] Sum rewards: 66.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.444', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.124', 'AMMO4': '0.176', 'AMMO3': '0.213', 'weapon5': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.350', 'weapon3': '2.880', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '55.000'} [2024-08-06 08:46:02,448][52662] DAMAGECOUNT value on done: 1020727.0 [2024-08-06 08:46:02,448][52662] Sum rewards: 69.639, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.070', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.164', 'AMMO3': '0.181', 'weapon4': '0.190', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.112', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.038', 'FRAGCOUNT': '56.000'} [2024-08-06 08:46:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 710049792. Throughput: 0: 4355.1. Samples: 177513050. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:46:02,794][52567] Avg episode reward: [(0, '75.753')] [2024-08-06 08:46:03,139][52668] DAMAGECOUNT value on done: 995578.0 [2024-08-06 08:46:03,140][52668] Sum rewards: 86.706, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.940', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.207', 'weapon4': '0.226', 'weapon5': '0.228', 'AMMO4': '0.272', 'weapon2': '0.396', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.916', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.517', 'FRAGCOUNT': '69.000'} [2024-08-06 08:46:03,271][52670] DAMAGECOUNT value on done: 1006525.0 [2024-08-06 08:46:03,271][52670] Sum rewards: 68.655, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.337', 'AMMO5': '0.017', 'AMMO2': '0.030', 'weapon5': '0.116', 'weapon4': '0.146', 'AMMO4': '0.150', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.206', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:03,677][52820] DAMAGECOUNT value on done: 943852.0 [2024-08-06 08:46:03,678][52820] Sum rewards: 75.208, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.054', 'weapon5': '0.134', 'AMMO4': '0.138', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.496', 'WEAPON3': '1.250', 'weapon3': '3.082', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.332', 'FRAGCOUNT': '60.000'} [2024-08-06 08:46:04,029][52666] DAMAGECOUNT value on done: 999160.0 [2024-08-06 08:46:04,029][52666] Sum rewards: 67.395, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.072', 'AMMO4': '0.123', 'weapon5': '0.146', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.604', 'WEAPON3': '1.150', 'weapon3': '3.004', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '54.000'} [2024-08-06 08:46:04,263][52664] DAMAGECOUNT value on done: 1057177.0 [2024-08-06 08:46:04,263][52664] Sum rewards: 64.722, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.595', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.144', 'AMMO4': '0.172', 'AMMO3': '0.232', 'weapon2': '0.260', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.348', 'WEAPON3': '1.350', 'weapon3': '2.944', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.010', 'FRAGCOUNT': '54.000'} [2024-08-06 08:46:04,507][52650] Updated weights for policy 0, policy_version 86681 (0.0012) [2024-08-06 08:46:04,592][52665] DAMAGECOUNT value on done: 1000838.0 [2024-08-06 08:46:04,593][52665] Sum rewards: 69.844, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.492', 'AMMO5': '0.013', 'AMMO2': '0.025', 'weapon4': '0.070', 'AMMO4': '0.123', 'weapon5': '0.220', 'AMMO3': '0.242', 'WEAPON4': '0.250', 'weapon2': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'HITCOUNT': '3.010', 'weapon3': '3.210', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '59.500'} [2024-08-06 08:46:04,609][52659] DAMAGECOUNT value on done: 1026959.0 [2024-08-06 08:46:04,610][52659] Sum rewards: 86.887, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.542', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.062', 'AMMO4': '0.184', 'WEAPON4': '0.200', 'weapon5': '0.210', 'AMMO3': '0.237', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.116', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.697', 'FRAGCOUNT': '72.000'} [2024-08-06 08:46:04,983][52667] DAMAGECOUNT value on done: 1022736.0 [2024-08-06 08:46:04,984][52667] Sum rewards: 74.836, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.495', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.084', 'AMMO4': '0.174', 'weapon5': '0.176', 'AMMO3': '0.217', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.198', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.906', 'FRAGCOUNT': '60.000'} [2024-08-06 08:46:05,224][52662] DAMAGECOUNT value on done: 1023747.0 [2024-08-06 08:46:05,226][52662] Sum rewards: 81.840, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.785', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.052', 'AMMO4': '0.116', 'weapon5': '0.126', 'AMMO3': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.400', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:05,339][52795] DAMAGECOUNT value on done: 944885.0 [2024-08-06 08:46:05,339][52795] Sum rewards: 82.062, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.940', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon4': '0.156', 'AMMO3': '0.202', 'weapon5': '0.226', 'AMMO4': '0.306', 'WEAPON5': '0.450', 'weapon2': '0.502', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '2.856', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.868', 'FRAGCOUNT': '66.500'} [2024-08-06 08:46:05,833][52668] DAMAGECOUNT value on done: 1012166.0 [2024-08-06 08:46:05,834][52668] Sum rewards: 76.135, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.380', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.128', 'weapon4': '0.142', 'AMMO4': '0.199', 'weapon2': '0.250', 'AMMO3': '0.259', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.224', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:06,548][52666] DAMAGECOUNT value on done: 1021319.0 [2024-08-06 08:46:06,550][52666] Sum rewards: 74.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.158', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.038', 'weapon5': '0.098', 'AMMO4': '0.149', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.364', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '61.000'} [2024-08-06 08:46:06,772][52820] DAMAGECOUNT value on done: 941823.0 [2024-08-06 08:46:06,773][52820] Sum rewards: 84.599, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.512', 'AMMO5': '0.010', 'AMMO2': '0.037', 'weapon5': '0.084', 'weapon4': '0.088', 'AMMO4': '0.183', 'AMMO3': '0.213', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:07,330][52664] DAMAGECOUNT value on done: 1054592.0 [2024-08-06 08:46:07,332][52664] Sum rewards: 72.491, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.528', 'AMMO5': '0.008', 'AMMO2': '0.037', 'weapon4': '0.132', 'weapon5': '0.146', 'AMMO4': '0.184', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.458', 'WEAPON3': '1.450', 'weapon3': '3.058', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '60.000'} [2024-08-06 08:46:07,599][52659] DAMAGECOUNT value on done: 1021077.0 [2024-08-06 08:46:07,600][52659] Sum rewards: 78.811, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.420', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.027', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.205', 'weapon2': '0.698', 'WEAPON3': '1.200', 'weapon3': '3.070', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:07,685][52665] DAMAGECOUNT value on done: 1016382.0 [2024-08-06 08:46:07,686][52665] Sum rewards: 86.142, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.345', 'AMMO5': '0.007', 'AMMO2': '0.011', 'weapon4': '0.028', 'AMMO4': '0.054', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon2': '0.224', 'AMMO3': '0.270', 'WEAPON3': '1.650', 'weapon3': '3.434', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '73.000'} [2024-08-06 08:46:07,791][52667] DAMAGECOUNT value on done: 1026604.0 [2024-08-06 08:46:07,791][52667] Sum rewards: 90.993, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.646', 'AMMO5': '0.017', 'AMMO2': '0.045', 'weapon4': '0.108', 'weapon2': '0.184', 'AMMO3': '0.208', 'AMMO4': '0.223', 'weapon5': '0.254', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '21.090', 'FRAGCOUNT': '74.000'} [2024-08-06 08:46:07,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 710148096. Throughput: 0: 4364.0. Samples: 177539520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:46:07,794][52567] Avg episode reward: [(0, '75.653')] [2024-08-06 08:46:08,058][52662] DAMAGECOUNT value on done: 1014099.0 [2024-08-06 08:46:08,061][52662] Sum rewards: 82.040, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.072', 'weapon5': '0.078', 'AMMO4': '0.078', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.154', 'weapon2': '0.438', 'WEAPON3': '1.150', 'weapon3': '3.216', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '66.000'} [2024-08-06 08:46:08,486][52795] DAMAGECOUNT value on done: 936566.0 [2024-08-06 08:46:08,488][52795] Sum rewards: 76.487, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.861', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon5': '0.154', 'weapon4': '0.170', 'AMMO3': '0.186', 'AMMO4': '0.213', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.120', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.912', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:08,761][52668] DAMAGECOUNT value on done: 1012352.0 [2024-08-06 08:46:08,762][52668] Sum rewards: 67.643, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.072', 'AMMO5': '0.020', 'AMMO2': '0.047', 'AMMO3': '0.180', 'AMMO4': '0.234', 'weapon5': '0.288', 'weapon2': '0.354', 'weapon4': '0.374', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '2.690', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '52.500'} [2024-08-06 08:46:09,429][52666] DAMAGECOUNT value on done: 993924.0 [2024-08-06 08:46:09,438][52666] Sum rewards: 69.908, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.944', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON5': '0.100', 'AMMO4': '0.126', 'weapon4': '0.148', 'WEAPON4': '0.150', 'weapon5': '0.154', 'weapon2': '0.234', 'AMMO3': '0.272', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '59.000'} [2024-08-06 08:46:09,521][52650] Updated weights for policy 0, policy_version 86691 (0.0012) [2024-08-06 08:46:09,951][52820] DAMAGECOUNT value on done: 951668.0 [2024-08-06 08:46:09,952][52820] Sum rewards: 84.814, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.009', 'AMMO2': '0.021', 'weapon4': '0.042', 'AMMO4': '0.104', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.462', 'WEAPON3': '1.550', 'weapon3': '3.150', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.484', 'FRAGCOUNT': '72.000'} [2024-08-06 08:46:10,291][52664] DAMAGECOUNT value on done: 1067321.0 [2024-08-06 08:46:10,292][52664] Sum rewards: 77.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.370', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.172', 'weapon5': '0.188', 'AMMO3': '0.206', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.262', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:10,600][52667] DAMAGECOUNT value on done: 1013662.0 [2024-08-06 08:46:10,600][52667] Sum rewards: 79.778, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.155', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.154', 'AMMO4': '0.204', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.284', 'WEAPON3': '1.350', 'weapon3': '3.304', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.674', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:10,633][52659] DAMAGECOUNT value on done: 1011048.0 [2024-08-06 08:46:10,635][52659] Sum rewards: 79.353, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.050', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.162', 'AMMO3': '0.180', 'weapon5': '0.198', 'AMMO4': '0.209', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.100', 'weapon3': '2.918', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:10,786][52665] DAMAGECOUNT value on done: 1009370.0 [2024-08-06 08:46:10,786][52665] Sum rewards: 76.648, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.408', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.112', 'AMMO4': '0.204', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.400', 'weapon3': '3.330', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:11,114][52662] DAMAGECOUNT value on done: 1029900.0 [2024-08-06 08:46:11,116][52662] Sum rewards: 79.932, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.710', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.056', 'weapon5': '0.146', 'AMMO4': '0.147', 'AMMO3': '0.244', 'weapon2': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '66.000'} [2024-08-06 08:46:11,597][52795] DAMAGECOUNT value on done: 936468.0 [2024-08-06 08:46:11,599][52795] Sum rewards: 66.800, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.214', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.052', 'AMMO4': '0.100', 'weapon5': '0.192', 'WEAPON4': '0.200', 'AMMO3': '0.246', 'WEAPON5': '0.300', 'weapon2': '0.406', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.070', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '55.000'} [2024-08-06 08:46:11,981][52668] DAMAGECOUNT value on done: 1013166.0 [2024-08-06 08:46:11,984][52668] Sum rewards: 86.449, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.245', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.064', 'weapon5': '0.104', 'AMMO4': '0.110', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.150', 'weapon3': '3.178', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:12,069][52647] Large shaping reward 2.621 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.5700000000000001, 190.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:46:12,133][52666] DAMAGECOUNT value on done: 1007196.0 [2024-08-06 08:46:12,134][52666] Sum rewards: 75.642, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.105', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.058', 'weapon5': '0.160', 'AMMO4': '0.202', 'weapon2': '0.224', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.310', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:12,792][52664] DAMAGECOUNT value on done: 1063378.0 [2024-08-06 08:46:12,793][52664] Sum rewards: 67.964, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.580', 'AMMO5': '0.011', 'AMMO2': '0.024', 'weapon4': '0.042', 'AMMO4': '0.121', 'weapon5': '0.174', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.100', 'weapon3': '3.064', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.491', 'FRAGCOUNT': '56.000'} [2024-08-06 08:46:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 710230016. Throughput: 0: 4362.7. Samples: 177565550. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:46:12,794][52567] Avg episode reward: [(0, '75.903')] [2024-08-06 08:46:12,907][52820] DAMAGECOUNT value on done: 950984.0 [2024-08-06 08:46:12,909][52820] Sum rewards: 76.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.250', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon5': '0.080', 'weapon4': '0.174', 'AMMO4': '0.210', 'AMMO3': '0.243', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.114', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:13,483][52659] DAMAGECOUNT value on done: 1017329.0 [2024-08-06 08:46:13,484][52659] Sum rewards: 66.032, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.820', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.043', 'weapon5': '0.046', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.250', 'weapon2': '0.658', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '56.000'} [2024-08-06 08:46:13,503][52667] DAMAGECOUNT value on done: 1012851.0 [2024-08-06 08:46:13,504][52667] Sum rewards: 66.329, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO5': '0.008', 'AMMO2': '0.010', 'weapon4': '0.020', 'AMMO4': '0.050', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'WEAPON5': '0.200', 'weapon2': '0.970', 'WEAPON3': '1.150', 'weapon3': '2.732', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '15.798', 'FRAGCOUNT': '53.500'} [2024-08-06 08:46:13,916][52665] DAMAGECOUNT value on done: 1006005.0 [2024-08-06 08:46:13,918][52665] Sum rewards: 84.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.510', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.064', 'weapon5': '0.090', 'AMMO4': '0.176', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.564', 'WEAPON3': '1.300', 'weapon3': '3.088', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.673', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:13,937][52662] DAMAGECOUNT value on done: 1007436.0 [2024-08-06 08:46:13,939][52662] Sum rewards: 88.661, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.120', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon5': '0.122', 'AMMO4': '0.132', 'weapon4': '0.194', 'AMMO3': '0.223', 'weapon2': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.591', 'FRAGCOUNT': '72.000'} [2024-08-06 08:46:13,954][52649] DAMAGECOUNT value on done: 985199.0 [2024-08-06 08:46:13,954][52649] Sum rewards: 82.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.140', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.048', 'weapon5': '0.114', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.490', 'WEAPON3': '1.600', 'weapon3': '3.094', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.055', 'FRAGCOUNT': '69.000'} [2024-08-06 08:46:14,426][52650] Updated weights for policy 0, policy_version 86701 (0.0014) [2024-08-06 08:46:14,730][52795] DAMAGECOUNT value on done: 942778.0 [2024-08-06 08:46:14,730][52795] Sum rewards: 67.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.082', 'AMMO4': '0.179', 'weapon5': '0.188', 'AMMO3': '0.216', 'weapon2': '0.302', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.220', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '56.000'} [2024-08-06 08:46:15,063][52668] DAMAGECOUNT value on done: 1013261.0 [2024-08-06 08:46:15,063][52668] Sum rewards: 71.928, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.089', 'AMMO5': '0.019', 'AMMO2': '0.071', 'weapon4': '0.146', 'AMMO3': '0.206', 'weapon5': '0.254', 'AMMO4': '0.357', 'weapon2': '0.402', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.932', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '59.000'} [2024-08-06 08:46:15,256][52664] DAMAGECOUNT value on done: 1063111.0 [2024-08-06 08:46:15,256][52664] Sum rewards: 73.637, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.895', 'AMMO5': '0.020', 'AMMO2': '0.062', 'weapon2': '0.176', 'AMMO3': '0.222', 'weapon5': '0.272', 'AMMO4': '0.309', 'weapon4': '0.408', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.846', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.337', 'FRAGCOUNT': '61.000'} [2024-08-06 08:46:16,016][52820] DAMAGECOUNT value on done: 936334.0 [2024-08-06 08:46:16,018][52820] Sum rewards: 75.285, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.630', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.082', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.528', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:16,377][52659] DAMAGECOUNT value on done: 1018252.0 [2024-08-06 08:46:16,379][52659] Sum rewards: 75.402, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.150', 'AMMO5': '0.017', 'AMMO2': '0.042', 'weapon5': '0.118', 'weapon4': '0.138', 'AMMO3': '0.194', 'AMMO4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.784', 'WEAPON3': '1.200', 'weapon3': '2.742', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.588', 'FRAGCOUNT': '60.000'} [2024-08-06 08:46:16,665][52667] DAMAGECOUNT value on done: 1024366.0 [2024-08-06 08:46:16,667][52667] Sum rewards: 80.308, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.040', 'AMMO5': '0.019', 'AMMO2': '0.061', 'weapon4': '0.108', 'AMMO3': '0.199', 'weapon5': '0.212', 'AMMO4': '0.307', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '2.898', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:16,974][52662] DAMAGECOUNT value on done: 1009091.0 [2024-08-06 08:46:16,974][52662] Sum rewards: 64.358, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.960', 'AMMO5': '0.006', 'AMMO2': '0.033', 'weapon4': '0.034', 'weapon5': '0.038', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.238', 'weapon2': '1.016', 'WEAPON3': '1.300', 'weapon3': '2.732', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '54.000'} [2024-08-06 08:46:17,037][52665] DAMAGECOUNT value on done: 1004532.0 [2024-08-06 08:46:17,037][52665] Sum rewards: 65.107, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.400', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.076', 'AMMO4': '0.108', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.482', 'WEAPON3': '1.450', 'weapon3': '3.168', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '16.335', 'FRAGCOUNT': '56.000'} [2024-08-06 08:46:17,165][52649] DAMAGECOUNT value on done: 978375.0 [2024-08-06 08:46:17,165][52649] Sum rewards: 90.101, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.542', 'AMMO5': '0.005', 'weapon4': '0.026', 'AMMO2': '0.031', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.222', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.206', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.703', 'FRAGCOUNT': '74.000'} [2024-08-06 08:46:17,771][52664] DAMAGECOUNT value on done: 1045417.0 [2024-08-06 08:46:17,773][52664] Sum rewards: 68.273, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.706', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.114', 'AMMO4': '0.190', 'AMMO3': '0.198', 'weapon5': '0.238', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.976', 'WEAPON3': '1.050', 'weapon3': '2.438', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '54.000'} [2024-08-06 08:46:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 710320128. Throughput: 0: 4364.4. Samples: 177578500. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:46:17,794][52567] Avg episode reward: [(0, '75.928')] [2024-08-06 08:46:17,832][52668] DAMAGECOUNT value on done: 1018213.0 [2024-08-06 08:46:17,832][52668] Sum rewards: 78.619, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.820', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.088', 'AMMO4': '0.114', 'weapon5': '0.144', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.334', 'WEAPON3': '1.150', 'weapon3': '3.250', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:17,926][52795] DAMAGECOUNT value on done: 938744.0 [2024-08-06 08:46:17,928][52795] Sum rewards: 85.753, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.459', 'AMMO5': '0.013', 'AMMO2': '0.036', 'AMMO4': '0.179', 'weapon5': '0.182', 'AMMO3': '0.183', 'weapon4': '0.326', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.473', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:18,640][52650] Updated weights for policy 0, policy_version 86711 (0.0036) [2024-08-06 08:46:19,429][52659] DAMAGECOUNT value on done: 1016798.0 [2024-08-06 08:46:19,431][52659] Sum rewards: 79.874, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.118', 'AMMO5': '0.013', 'AMMO2': '0.019', 'weapon4': '0.042', 'AMMO4': '0.096', 'weapon5': '0.150', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.212', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.430', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:19,564][52667] DAMAGECOUNT value on done: 1013697.0 [2024-08-06 08:46:19,565][52667] Sum rewards: 84.207, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.245', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon4': '0.136', 'AMMO4': '0.164', 'AMMO3': '0.183', 'weapon5': '0.224', 'WEAPON4': '0.350', 'weapon2': '0.448', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.968', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.092', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:20,099][52662] DAMAGECOUNT value on done: 1030973.0 [2024-08-06 08:46:20,101][52662] Sum rewards: 64.090, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.020', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.029', 'weapon5': '0.064', 'AMMO4': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.260', 'AMMO3': '0.289', 'WEAPON3': '1.650', 'HITCOUNT': '3.190', 'weapon3': '3.414', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:20,146][52665] DAMAGECOUNT value on done: 1004164.0 [2024-08-06 08:46:20,148][52665] Sum rewards: 78.804, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.003', 'AMMO2': '0.008', 'WEAPON1': '0.010', 'weapon4': '0.020', 'AMMO4': '0.040', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.169', 'weapon2': '0.334', 'WEAPON3': '1.100', 'weapon3': '3.400', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:20,241][52649] DAMAGECOUNT value on done: 995241.0 [2024-08-06 08:46:20,241][52649] Sum rewards: 69.366, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.955', 'AMMO5': '0.017', 'AMMO2': '0.038', 'weapon4': '0.178', 'AMMO4': '0.189', 'AMMO3': '0.251', 'weapon5': '0.254', 'weapon2': '0.394', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.854', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.866', 'FRAGCOUNT': '59.500'} [2024-08-06 08:46:20,543][52664] DAMAGECOUNT value on done: 1050185.0 [2024-08-06 08:46:20,545][52664] Sum rewards: 70.735, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.167', 'AMMO3': '0.170', 'weapon2': '0.250', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.060', 'weapon3': '3.424', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:20,727][52662] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:46:21,073][52795] DAMAGECOUNT value on done: 928882.0 [2024-08-06 08:46:21,074][52795] Sum rewards: 76.042, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.534', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon4': '0.050', 'weapon5': '0.158', 'AMMO3': '0.218', 'AMMO4': '0.248', 'WEAPON4': '0.300', 'weapon2': '0.330', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.158', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:22,232][52667] DAMAGECOUNT value on done: 1021494.0 [2024-08-06 08:46:22,235][52667] Sum rewards: 65.162, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.015', 'AMMO2': '0.054', 'weapon4': '0.130', 'HEALTH': '0.148', 'AMMO3': '0.173', 'weapon5': '0.176', 'AMMO4': '0.269', 'weapon2': '0.304', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'HITCOUNT': '2.820', 'weapon3': '3.138', 'DAMAGECOUNT': '16.185', 'FRAGCOUNT': '52.000'} [2024-08-06 08:46:22,314][52659] DAMAGECOUNT value on done: 1014457.0 [2024-08-06 08:46:22,317][52659] Sum rewards: 79.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.215', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.057', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.215', 'weapon2': '0.334', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.195', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:22,725][52665] DAMAGECOUNT value on done: 1007949.0 [2024-08-06 08:46:22,726][52665] Sum rewards: 92.357, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.630', 'AMMO5': '0.024', 'AMMO2': '0.050', 'AMMO3': '0.119', 'AMMO4': '0.248', 'weapon5': '0.276', 'WEAPON4': '0.450', 'weapon2': '0.472', 'WEAPON5': '0.550', 'weapon4': '0.628', 'WEAPON3': '0.800', 'weapon3': '2.342', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.868', 'FRAGCOUNT': '73.000'} [2024-08-06 08:46:22,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 710402048. Throughput: 0: 4363.3. Samples: 177604750. Policy #0 lag: (min: 0.0, avg: 4.0, max: 9.0) [2024-08-06 08:46:22,794][52567] Avg episode reward: [(0, '76.156')] [2024-08-06 08:46:22,864][52649] DAMAGECOUNT value on done: 995200.0 [2024-08-06 08:46:22,865][52649] Sum rewards: 79.301, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.780', 'AMMO5': '0.015', 'AMMO2': '0.059', 'weapon4': '0.078', 'weapon5': '0.196', 'AMMO3': '0.216', 'AMMO4': '0.293', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.832', 'WEAPON3': '1.200', 'weapon3': '2.666', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.276', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:23,049][52662] DAMAGECOUNT value on done: 1014904.0 [2024-08-06 08:46:23,051][52662] Sum rewards: 71.351, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.603', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.092', 'AMMO3': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '1.100', 'HITCOUNT': '3.310', 'weapon3': '3.454', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '58.000'} [2024-08-06 08:46:23,683][52650] Updated weights for policy 0, policy_version 86721 (0.0011) [2024-08-06 08:46:23,752][52664] DAMAGECOUNT value on done: 1063553.0 [2024-08-06 08:46:23,752][52664] Sum rewards: 79.434, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.250', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.028', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.197', 'weapon2': '0.292', 'WEAPON3': '1.150', 'weapon3': '3.506', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:23,890][52660] DAMAGECOUNT value on done: 1013163.0 [2024-08-06 08:46:23,892][52660] Sum rewards: 82.144, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.230', 'AMMO2': '0.015', 'weapon4': '0.042', 'WEAPON4': '0.050', 'AMMO4': '0.077', 'AMMO3': '0.230', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.390', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:24,161][52795] DAMAGECOUNT value on done: 936708.0 [2024-08-06 08:46:24,162][52795] Sum rewards: 79.641, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.240', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon5': '0.162', 'AMMO3': '0.172', 'weapon4': '0.208', 'AMMO4': '0.267', 'weapon2': '0.324', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.050', 'weapon3': '3.032', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:25,264][52659] DAMAGECOUNT value on done: 1025341.0 [2024-08-06 08:46:25,265][52659] Sum rewards: 69.134, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.550', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon4': '0.056', 'weapon5': '0.132', 'AMMO3': '0.144', 'AMMO4': '0.235', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.366', 'DAMAGECOUNT': '15.819', 'FRAGCOUNT': '55.000'} [2024-08-06 08:46:25,352][52667] DAMAGECOUNT value on done: 1028265.0 [2024-08-06 08:46:25,353][52667] Sum rewards: 85.269, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.745', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.204', 'AMMO3': '0.240', 'weapon2': '0.322', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.168', 'FRAGCOUNT': '71.000'} [2024-08-06 08:46:25,443][52665] DAMAGECOUNT value on done: 1001943.0 [2024-08-06 08:46:25,443][52665] Sum rewards: 67.414, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.260', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.178', 'weapon4': '0.198', 'AMMO4': '0.209', 'AMMO3': '0.253', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.056', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.328', 'FRAGCOUNT': '58.500'} [2024-08-06 08:46:25,683][52649] DAMAGECOUNT value on done: 987768.0 [2024-08-06 08:46:25,683][52649] Sum rewards: 82.992, reward structure: {'DEATHCOUNT': '-9.750', 'AMMO5': '0.015', 'AMMO2': '0.034', 'HEALTH': '0.076', 'AMMO3': '0.168', 'AMMO4': '0.169', 'WEAPON4': '0.200', 'weapon2': '0.236', 'weapon4': '0.244', 'weapon5': '0.254', 'WEAPON5': '0.350', 'WEAPON3': '0.900', 'weapon3': '3.010', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:25,860][52662] DAMAGECOUNT value on done: 1020238.0 [2024-08-06 08:46:25,861][52662] Sum rewards: 74.663, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.078', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.157', 'weapon5': '0.220', 'AMMO4': '0.245', 'weapon4': '0.286', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.512', 'WEAPON3': '1.100', 'weapon3': '2.644', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '60.000'} [2024-08-06 08:46:26,839][52660] DAMAGECOUNT value on done: 1002716.0 [2024-08-06 08:46:26,840][52660] Sum rewards: 81.087, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.376', 'AMMO5': '0.015', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.084', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon5': '0.192', 'weapon2': '0.328', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.146', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:27,225][52664] DAMAGECOUNT value on done: 1045139.0 [2024-08-06 08:46:27,225][52664] Sum rewards: 74.932, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.878', 'AMMO5': '0.009', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.066', 'WEAPON4': '0.150', 'weapon5': '0.156', 'AMMO3': '0.204', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.400', 'weapon3': '3.332', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.590', 'FRAGCOUNT': '60.000'} [2024-08-06 08:46:27,397][52795] DAMAGECOUNT value on done: 942702.0 [2024-08-06 08:46:27,398][52795] Sum rewards: 86.327, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.113', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.157', 'weapon5': '0.164', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.404', 'weapon2': '0.468', 'WEAPON3': '1.200', 'weapon3': '2.718', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.710', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:27,632][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:46:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 710492160. Throughput: 0: 4363.1. Samples: 177630870. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:46:27,794][52567] Avg episode reward: [(0, '76.448')] [2024-08-06 08:46:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086730_710492160.pth... [2024-08-06 08:46:27,925][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086219_706306048.pth [2024-08-06 08:46:28,018][52659] DAMAGECOUNT value on done: 1012539.0 [2024-08-06 08:46:28,018][52659] Sum rewards: 88.777, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.720', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.050', 'AMMO3': '0.173', 'AMMO4': '0.177', 'weapon2': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon5': '0.314', 'WEAPON3': '1.050', 'weapon3': '3.200', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:28,311][52650] Updated weights for policy 0, policy_version 86731 (0.0019) [2024-08-06 08:46:28,486][52667] DAMAGECOUNT value on done: 1030075.0 [2024-08-06 08:46:28,487][52667] Sum rewards: 66.915, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.112', 'AMMO5': '0.024', 'AMMO2': '0.053', 'weapon4': '0.076', 'AMMO4': '0.264', 'AMMO3': '0.304', 'weapon5': '0.326', 'weapon2': '0.384', 'WEAPON4': '0.450', 'WEAPON5': '0.650', 'WEAPON3': '1.800', 'weapon3': '2.860', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.406', 'FRAGCOUNT': '58.000'} [2024-08-06 08:46:28,488][52811] DAMAGECOUNT value on done: 958862.0 [2024-08-06 08:46:28,492][52811] Sum rewards: 68.753, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.005', 'weapon4': '0.018', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO4': '0.115', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.302', 'WEAPON3': '1.350', 'HITCOUNT': '3.300', 'weapon3': '3.454', 'DAMAGECOUNT': '16.944', 'FRAGCOUNT': '58.000'} [2024-08-06 08:46:28,516][52665] DAMAGECOUNT value on done: 994725.0 [2024-08-06 08:46:28,516][52665] Sum rewards: 75.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.909', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.082', 'AMMO4': '0.144', 'AMMO3': '0.219', 'weapon2': '0.222', 'weapon5': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.158', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:28,805][52649] DAMAGECOUNT value on done: 996221.0 [2024-08-06 08:46:28,809][52649] Sum rewards: 85.669, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.188', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.104', 'weapon5': '0.168', 'AMMO3': '0.226', 'AMMO4': '0.254', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.991', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:29,105][52662] DAMAGECOUNT value on done: 1015119.0 [2024-08-06 08:46:29,105][52662] Sum rewards: 72.327, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.720', 'weapon4': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'AMMO3': '0.202', 'weapon2': '0.214', 'WEAPON3': '1.250', 'HITCOUNT': '3.410', 'weapon3': '3.656', 'DAMAGECOUNT': '17.895', 'FRAGCOUNT': '60.000'} [2024-08-06 08:46:29,738][52660] DAMAGECOUNT value on done: 1015521.0 [2024-08-06 08:46:29,740][52660] Sum rewards: 60.924, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.530', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.157', 'AMMO4': '0.199', 'weapon4': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.098', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '15.201', 'FRAGCOUNT': '48.000'} [2024-08-06 08:46:30,585][52795] DAMAGECOUNT value on done: 926650.0 [2024-08-06 08:46:30,586][52795] Sum rewards: 68.315, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.148', 'weapon5': '0.158', 'AMMO3': '0.199', 'AMMO4': '0.205', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.300', 'weapon3': '2.956', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.992', 'FRAGCOUNT': '56.000'} [2024-08-06 08:46:30,623][52659] DAMAGECOUNT value on done: 1021632.0 [2024-08-06 08:46:30,624][52659] Sum rewards: 80.033, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.015', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.178', 'AMMO3': '0.215', 'weapon4': '0.224', 'weapon2': '0.386', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '66.000'} [2024-08-06 08:46:31,387][52667] DAMAGECOUNT value on done: 1025678.0 [2024-08-06 08:46:31,389][52667] Sum rewards: 75.623, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.658', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.076', 'AMMO4': '0.160', 'weapon5': '0.192', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.054', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:31,653][52811] DAMAGECOUNT value on done: 944722.0 [2024-08-06 08:46:31,654][52811] Sum rewards: 81.938, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.415', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.080', 'weapon5': '0.148', 'AMMO4': '0.179', 'AMMO3': '0.216', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.706', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:31,796][52665] DAMAGECOUNT value on done: 1001150.0 [2024-08-06 08:46:31,796][52665] Sum rewards: 68.197, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.474', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.098', 'AMMO4': '0.134', 'WEAPON5': '0.200', 'weapon4': '0.216', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.244', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:32,026][52649] DAMAGECOUNT value on done: 995665.0 [2024-08-06 08:46:32,028][52649] Sum rewards: 83.484, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.780', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.040', 'weapon5': '0.042', 'weapon4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.428', 'HITCOUNT': '4.220', 'DAMAGECOUNT': '21.279', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:32,267][52662] DAMAGECOUNT value on done: 1011492.0 [2024-08-06 08:46:32,272][52662] Sum rewards: 66.151, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.011', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.124', 'weapon5': '0.168', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.098', 'FRAGCOUNT': '54.000'} [2024-08-06 08:46:32,540][52660] DAMAGECOUNT value on done: 1028112.0 [2024-08-06 08:46:32,540][52660] Sum rewards: 85.332, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.782', 'AMMO5': '0.007', 'WEAPON1': '0.010', 'AMMO2': '0.010', 'weapon4': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.051', 'weapon5': '0.072', 'WEAPON5': '0.150', 'AMMO3': '0.231', 'weapon2': '0.356', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '70.500'} [2024-08-06 08:46:32,786][52650] Updated weights for policy 0, policy_version 86741 (0.0019) [2024-08-06 08:46:32,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 710582272. Throughput: 0: 4354.7. Samples: 177643650. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:46:32,794][52567] Avg episode reward: [(0, '76.503')] [2024-08-06 08:46:33,577][52659] DAMAGECOUNT value on done: 1016680.0 [2024-08-06 08:46:33,579][52659] Sum rewards: 78.246, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.082', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.072', 'weapon5': '0.132', 'AMMO3': '0.171', 'AMMO4': '0.222', 'weapon2': '0.246', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.334', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.061', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:33,860][52795] DAMAGECOUNT value on done: 940552.0 [2024-08-06 08:46:33,862][52795] Sum rewards: 91.963, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.250', 'AMMO5': '0.003', 'weapon5': '0.004', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.206', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.404', 'HITCOUNT': '4.300', 'DAMAGECOUNT': '22.131', 'FRAGCOUNT': '75.000'} [2024-08-06 08:46:33,931][52667] DAMAGECOUNT value on done: 1021333.0 [2024-08-06 08:46:33,931][52667] Sum rewards: 77.481, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.585', 'AMMO5': '0.004', 'AMMO2': '0.015', 'weapon5': '0.038', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.180', 'AMMO3': '0.218', 'weapon2': '0.588', 'WEAPON3': '1.400', 'weapon3': '3.042', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:34,785][52811] DAMAGECOUNT value on done: 939250.0 [2024-08-06 08:46:34,786][52811] Sum rewards: 73.142, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'HEALTH': '0.025', 'AMMO2': '0.036', 'weapon4': '0.046', 'AMMO4': '0.178', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon5': '0.258', 'weapon2': '0.262', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.210', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.577', 'FRAGCOUNT': '59.000'} [2024-08-06 08:46:34,944][52665] DAMAGECOUNT value on done: 1009084.0 [2024-08-06 08:46:34,945][52665] Sum rewards: 79.660, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.802', 'AMMO5': '0.014', 'AMMO2': '0.033', 'AMMO3': '0.128', 'AMMO4': '0.165', 'weapon2': '0.268', 'weapon5': '0.280', 'weapon4': '0.410', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '0.950', 'weapon3': '2.752', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:35,221][52662] DAMAGECOUNT value on done: 1007134.0 [2024-08-06 08:46:35,221][52662] Sum rewards: 55.452, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.195', 'AMMO2': '0.005', 'AMMO4': '0.024', 'weapon2': '0.200', 'AMMO3': '0.287', 'WEAPON3': '1.700', 'HITCOUNT': '3.190', 'weapon3': '3.552', 'DAMAGECOUNT': '15.690', 'FRAGCOUNT': '49.000'} [2024-08-06 08:46:35,235][52649] DAMAGECOUNT value on done: 992229.0 [2024-08-06 08:46:35,235][52649] Sum rewards: 69.891, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.710', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.096', 'AMMO4': '0.111', 'AMMO3': '0.141', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.022', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '55.000'} [2024-08-06 08:46:35,297][52660] DAMAGECOUNT value on done: 1007277.0 [2024-08-06 08:46:35,299][52660] Sum rewards: 74.571, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.261', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.110', 'AMMO4': '0.144', 'AMMO3': '0.164', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.274', 'weapon2': '0.282', 'WEAPON3': '1.050', 'HITCOUNT': '2.980', 'weapon3': '3.080', 'DAMAGECOUNT': '17.457', 'FRAGCOUNT': '61.000'} [2024-08-06 08:46:36,629][52667] DAMAGECOUNT value on done: 1025581.0 [2024-08-06 08:46:36,631][52667] Sum rewards: 73.158, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.230', 'AMMO5': '0.013', 'AMMO2': '0.033', 'AMMO3': '0.163', 'AMMO4': '0.163', 'weapon5': '0.178', 'weapon2': '0.338', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.424', 'WEAPON3': '1.100', 'weapon3': '2.856', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:36,718][52659] DAMAGECOUNT value on done: 1014754.0 [2024-08-06 08:46:36,720][52659] Sum rewards: 91.117, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.515', 'AMMO5': '0.015', 'AMMO2': '0.042', 'weapon4': '0.120', 'weapon5': '0.154', 'AMMO4': '0.211', 'AMMO3': '0.218', 'weapon2': '0.268', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.226', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '22.218', 'FRAGCOUNT': '73.000'} [2024-08-06 08:46:36,899][52795] DAMAGECOUNT value on done: 937552.0 [2024-08-06 08:46:36,899][52795] Sum rewards: 73.598, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.720', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.106', 'AMMO4': '0.169', 'weapon5': '0.182', 'AMMO3': '0.243', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.172', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.471', 'FRAGCOUNT': '61.000'} [2024-08-06 08:46:37,795][52567] Fps is (10 sec: 16382.4, 60 sec: 17339.5, 300 sec: 17439.2). Total num frames: 710656000. Throughput: 0: 4355.9. Samples: 177669940. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:46:37,796][52567] Avg episode reward: [(0, '76.290')] [2024-08-06 08:46:37,832][52650] Updated weights for policy 0, policy_version 86751 (0.0024) [2024-08-06 08:46:37,916][52811] DAMAGECOUNT value on done: 945936.0 [2024-08-06 08:46:37,916][52811] Sum rewards: 77.030, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.240', 'AMMO5': '0.003', 'AMMO2': '0.014', 'AMMO4': '0.072', 'weapon5': '0.078', 'WEAPON5': '0.100', 'AMMO3': '0.199', 'weapon2': '0.260', 'WEAPON3': '1.250', 'weapon3': '3.494', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:38,185][52662] DAMAGECOUNT value on done: 1019214.0 [2024-08-06 08:46:38,185][52662] Sum rewards: 75.853, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.740', 'AMMO5': '0.008', 'AMMO2': '0.050', 'weapon5': '0.136', 'AMMO3': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.251', 'weapon4': '0.298', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '2.918', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:38,260][52649] DAMAGECOUNT value on done: 987050.0 [2024-08-06 08:46:38,260][52649] Sum rewards: 77.315, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.019', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.062', 'AMMO4': '0.133', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.207', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:38,389][52660] DAMAGECOUNT value on done: 1004683.0 [2024-08-06 08:46:38,392][52660] Sum rewards: 57.010, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.504', 'AMMO5': '0.022', 'AMMO2': '0.052', 'weapon5': '0.152', 'weapon4': '0.164', 'AMMO3': '0.256', 'AMMO4': '0.263', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.550', 'weapon3': '2.902', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '49.000'} [2024-08-06 08:46:39,469][52659] DAMAGECOUNT value on done: 1014798.0 [2024-08-06 08:46:39,469][52659] Sum rewards: 84.424, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.030', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.158', 'weapon5': '0.166', 'AMMO3': '0.192', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.070', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:39,978][52795] DAMAGECOUNT value on done: 924738.0 [2024-08-06 08:46:39,982][52795] Sum rewards: 82.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.850', 'AMMO5': '0.014', 'AMMO2': '0.061', 'weapon5': '0.168', 'weapon4': '0.212', 'AMMO3': '0.229', 'AMMO4': '0.307', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.014', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.553', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:41,040][52811] DAMAGECOUNT value on done: 949368.0 [2024-08-06 08:46:41,040][52811] Sum rewards: 73.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.038', 'AMMO2': '0.001', 'AMMO4': '0.006', 'AMMO3': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.400', 'HITCOUNT': '3.470', 'weapon3': '3.558', 'DAMAGECOUNT': '17.640', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:41,242][52662] DAMAGECOUNT value on done: 1010432.0 [2024-08-06 08:46:41,243][52662] Sum rewards: 69.708, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.870', 'AMMO5': '0.023', 'AMMO2': '0.077', 'AMMO3': '0.217', 'weapon4': '0.220', 'weapon5': '0.236', 'weapon2': '0.280', 'AMMO4': '0.385', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.250', 'weapon3': '2.948', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '59.500'} [2024-08-06 08:46:41,426][52649] DAMAGECOUNT value on done: 985052.0 [2024-08-06 08:46:41,427][52649] Sum rewards: 66.927, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.789', 'AMMO5': '0.010', 'AMMO2': '0.057', 'weapon5': '0.128', 'AMMO3': '0.211', 'WEAPON5': '0.250', 'weapon2': '0.252', 'AMMO4': '0.287', 'weapon4': '0.364', 'WEAPON4': '0.450', 'WEAPON3': '1.150', 'weapon3': '3.020', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.537', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:41,623][52660] DAMAGECOUNT value on done: 1010497.0 [2024-08-06 08:46:41,624][52660] Sum rewards: 60.753, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.534', 'AMMO5': '0.023', 'AMMO2': '0.058', 'weapon4': '0.228', 'AMMO3': '0.257', 'weapon5': '0.278', 'AMMO4': '0.288', 'WEAPON4': '0.550', 'weapon2': '0.566', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.560', 'HITCOUNT': '2.860', 'DAMAGECOUNT': '14.919', 'FRAGCOUNT': '51.000'} [2024-08-06 08:46:41,915][52650] Updated weights for policy 0, policy_version 86761 (0.0046) [2024-08-06 08:46:42,483][52659] DAMAGECOUNT value on done: 1016824.0 [2024-08-06 08:46:42,483][52659] Sum rewards: 90.080, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.602', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.028', 'AMMO4': '0.088', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.408', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '20.766', 'FRAGCOUNT': '74.000'} [2024-08-06 08:46:42,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 710746112. Throughput: 0: 4355.4. Samples: 177696120. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:46:42,794][52567] Avg episode reward: [(0, '76.323')] [2024-08-06 08:46:43,215][52795] DAMAGECOUNT value on done: 934480.0 [2024-08-06 08:46:43,216][52795] Sum rewards: 75.567, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.030', 'AMMO2': '0.070', 'weapon4': '0.178', 'AMMO3': '0.222', 'weapon5': '0.314', 'AMMO4': '0.348', 'weapon2': '0.468', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.400', 'weapon3': '2.728', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '20.529', 'FRAGCOUNT': '61.000'} [2024-08-06 08:46:44,039][52811] DAMAGECOUNT value on done: 965039.0 [2024-08-06 08:46:44,039][52811] Sum rewards: 80.697, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.581', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.070', 'weapon4': '0.116', 'AMMO4': '0.160', 'WEAPON5': '0.200', 'AMMO3': '0.234', 'weapon2': '0.240', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.328', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '69.000'} [2024-08-06 08:46:44,496][52662] DAMAGECOUNT value on done: 1027249.0 [2024-08-06 08:46:44,507][52662] Sum rewards: 73.382, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.017', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon4': '0.058', 'AMMO3': '0.159', 'AMMO4': '0.160', 'weapon5': '0.188', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.474', 'WEAPON3': '0.950', 'weapon3': '3.106', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '58.000'} [2024-08-06 08:46:44,554][52649] DAMAGECOUNT value on done: 1000010.0 [2024-08-06 08:46:44,554][52649] Sum rewards: 73.839, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.830', 'AMMO5': '0.009', 'AMMO2': '0.040', 'weapon5': '0.130', 'AMMO3': '0.135', 'AMMO4': '0.198', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.338', 'weapon4': '0.344', 'WEAPON3': '0.950', 'weapon3': '3.038', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.107', 'FRAGCOUNT': '57.000'} [2024-08-06 08:46:44,600][52660] DAMAGECOUNT value on done: 1018311.0 [2024-08-06 08:46:44,600][52660] Sum rewards: 72.001, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.752', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.126', 'AMMO3': '0.181', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.696', 'WEAPON3': '1.200', 'weapon3': '2.900', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '59.000'} [2024-08-06 08:46:45,309][52659] DAMAGECOUNT value on done: 1028017.0 [2024-08-06 08:46:45,309][52659] Sum rewards: 76.918, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.592', 'AMMO5': '0.021', 'AMMO2': '0.055', 'weapon4': '0.084', 'AMMO3': '0.224', 'weapon5': '0.250', 'AMMO4': '0.273', 'weapon2': '0.408', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.998', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.897', 'FRAGCOUNT': '64.000'} [2024-08-06 08:46:46,336][52795] DAMAGECOUNT value on done: 944765.0 [2024-08-06 08:46:46,338][52795] Sum rewards: 77.225, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.883', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.016', 'AMMO4': '0.034', 'weapon5': '0.048', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.177', 'weapon2': '0.538', 'WEAPON3': '1.200', 'weapon3': '3.246', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:47,081][52811] DAMAGECOUNT value on done: 952995.0 [2024-08-06 08:46:47,083][52811] Sum rewards: 66.631, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.905', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.085', 'weapon4': '0.108', 'weapon5': '0.140', 'AMMO3': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.178', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.092', 'FRAGCOUNT': '54.000'} [2024-08-06 08:46:47,161][52650] Updated weights for policy 0, policy_version 86771 (0.0036) [2024-08-06 08:46:47,458][52660] DAMAGECOUNT value on done: 1007091.0 [2024-08-06 08:46:47,458][52660] Sum rewards: 78.258, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.433', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon2': '0.172', 'weapon5': '0.218', 'AMMO4': '0.224', 'AMMO3': '0.243', 'WEAPON5': '0.350', 'weapon4': '0.358', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:47,628][52662] DAMAGECOUNT value on done: 1015756.0 [2024-08-06 08:46:47,629][52662] Sum rewards: 81.532, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.680', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.054', 'AMMO4': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.360', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:47,794][52567] Fps is (10 sec: 18843.2, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 710844416. Throughput: 0: 4357.5. Samples: 177709140. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:46:47,795][52567] Avg episode reward: [(0, '75.841')] [2024-08-06 08:46:47,808][52649] DAMAGECOUNT value on done: 1005725.0 [2024-08-06 08:46:47,808][52649] Sum rewards: 77.685, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.445', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.070', 'AMMO4': '0.083', 'weapon5': '0.134', 'AMMO3': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.404', 'WEAPON3': '1.300', 'weapon3': '3.116', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:48,099][52671] DAMAGECOUNT value on done: 1021377.0 [2024-08-06 08:46:48,099][52671] Sum rewards: 77.825, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'AMMO2': '0.011', 'WEAPON1': '0.020', 'weapon5': '0.048', 'AMMO4': '0.057', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.208', 'weapon2': '0.224', 'AMMO3': '0.231', 'WEAPON3': '1.450', 'weapon3': '3.312', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:48,256][52659] DAMAGECOUNT value on done: 1008204.0 [2024-08-06 08:46:48,258][52659] Sum rewards: 76.073, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.019', 'AMMO2': '0.056', 'weapon4': '0.082', 'AMMO3': '0.222', 'weapon5': '0.224', 'AMMO4': '0.282', 'weapon2': '0.306', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.156', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.966', 'FRAGCOUNT': '63.000'} [2024-08-06 08:46:49,712][52614] Signal inference workers to stop experience collection... (16000 times) [2024-08-06 08:46:49,712][52614] Signal inference workers to resume experience collection... (16000 times) [2024-08-06 08:46:49,779][52650] InferenceWorker_p0-w0: stopping experience collection (16000 times) [2024-08-06 08:46:49,780][52650] InferenceWorker_p0-w0: resuming experience collection (16000 times) [2024-08-06 08:46:49,896][52660] DAMAGECOUNT value on done: 1004811.0 [2024-08-06 08:46:49,897][52660] Sum rewards: 71.305, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.760', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.082', 'weapon4': '0.124', 'AMMO4': '0.154', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.504', 'WEAPON3': '1.450', 'weapon3': '2.904', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.865', 'FRAGCOUNT': '62.000'} [2024-08-06 08:46:50,095][52811] DAMAGECOUNT value on done: 943680.0 [2024-08-06 08:46:50,096][52811] Sum rewards: 82.443, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.059', 'WEAPON1': '0.010', 'AMMO5': '0.015', 'AMMO2': '0.025', 'AMMO4': '0.125', 'AMMO3': '0.152', 'weapon5': '0.202', 'weapon4': '0.384', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.488', 'WEAPON3': '1.100', 'weapon3': '2.676', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.375', 'FRAGCOUNT': '66.000'} [2024-08-06 08:46:50,427][52647] Large shaping reward 2.510 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:46:50,766][52662] DAMAGECOUNT value on done: 1005017.0 [2024-08-06 08:46:50,766][52662] Sum rewards: 70.857, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.528', 'AMMO5': '0.003', 'weapon5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.022', 'WEAPON5': '0.050', 'AMMO4': '0.108', 'AMMO3': '0.186', 'weapon2': '0.412', 'WEAPON3': '1.100', 'HITCOUNT': '3.350', 'weapon3': '3.408', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '58.000'} [2024-08-06 08:46:51,023][52649] DAMAGECOUNT value on done: 996587.0 [2024-08-06 08:46:51,024][52649] Sum rewards: 81.389, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.946', 'AMMO5': '0.010', 'weapon4': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.093', 'WEAPON4': '0.100', 'weapon5': '0.122', 'AMMO3': '0.170', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.050', 'weapon3': '3.238', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.707', 'FRAGCOUNT': '64.500'} [2024-08-06 08:46:51,181][52671] DAMAGECOUNT value on done: 1027295.0 [2024-08-06 08:46:51,181][52671] Sum rewards: 74.669, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.241', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.062', 'weapon5': '0.148', 'AMMO3': '0.185', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.206', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '60.500'} [2024-08-06 08:46:51,390][52659] DAMAGECOUNT value on done: 1022469.0 [2024-08-06 08:46:51,390][52659] Sum rewards: 81.279, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.066', 'AMMO4': '0.099', 'WEAPON4': '0.100', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.522', 'WEAPON3': '1.100', 'weapon3': '3.182', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '65.000'} [2024-08-06 08:46:52,242][52650] Updated weights for policy 0, policy_version 86781 (0.0015) [2024-08-06 08:46:52,753][52660] DAMAGECOUNT value on done: 1012619.0 [2024-08-06 08:46:52,754][52660] Sum rewards: 86.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.670', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.094', 'weapon5': '0.132', 'AMMO4': '0.144', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.440', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.881', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 710926336. Throughput: 0: 4351.8. Samples: 177735350. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:46:52,794][52567] Avg episode reward: [(0, '75.961')] [2024-08-06 08:46:53,203][52811] DAMAGECOUNT value on done: 949072.0 [2024-08-06 08:46:53,205][52811] Sum rewards: 66.980, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.645', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.140', 'AMMO4': '0.198', 'weapon2': '0.250', 'AMMO3': '0.251', 'weapon4': '0.378', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.838', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.086', 'FRAGCOUNT': '59.000'} [2024-08-06 08:46:53,320][52662] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:46:53,332][52795] Large shaping reward 2.538 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.516, 172.0), ('weapon3', 0.002)] [2024-08-06 08:46:53,766][52662] DAMAGECOUNT value on done: 1013058.0 [2024-08-06 08:46:53,768][52662] Sum rewards: 83.645, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.348', 'AMMO5': '0.003', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.081', 'weapon4': '0.118', 'AMMO3': '0.238', 'weapon2': '0.368', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.029', 'FRAGCOUNT': '70.000'} [2024-08-06 08:46:54,243][52649] DAMAGECOUNT value on done: 996248.0 [2024-08-06 08:46:54,243][52649] Sum rewards: 80.259, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.186', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.030', 'weapon4': '0.046', 'weapon5': '0.074', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.220', 'weapon2': '0.542', 'WEAPON3': '1.500', 'weapon3': '3.106', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '67.000'} [2024-08-06 08:46:54,247][52671] DAMAGECOUNT value on done: 1021627.0 [2024-08-06 08:46:54,248][52671] Sum rewards: 80.888, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.102', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.080', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.332', 'WEAPON3': '1.350', 'weapon3': '3.394', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '66.000'} [2024-08-06 08:46:54,488][52659] DAMAGECOUNT value on done: 1013739.0 [2024-08-06 08:46:54,494][52659] Sum rewards: 83.776, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.174', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.172', 'AMMO4': '0.194', 'weapon4': '0.198', 'AMMO3': '0.233', 'weapon2': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '67.000'} [2024-08-06 08:46:55,743][52660] DAMAGECOUNT value on done: 1007256.0 [2024-08-06 08:46:55,744][52660] Sum rewards: 83.377, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO2': '0.019', 'weapon4': '0.052', 'AMMO4': '0.094', 'WEAPON4': '0.100', 'AMMO3': '0.210', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.368', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:56,162][52811] DAMAGECOUNT value on done: 951342.0 [2024-08-06 08:46:56,163][52811] Sum rewards: 84.942, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.830', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.156', 'AMMO3': '0.214', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.116', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '69.000'} [2024-08-06 08:46:56,192][52650] Updated weights for policy 0, policy_version 86791 (0.0015) [2024-08-06 08:46:56,751][52662] DAMAGECOUNT value on done: 1007543.0 [2024-08-06 08:46:56,752][52662] Sum rewards: 85.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.254', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.022', 'weapon4': '0.028', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.184', 'weapon2': '0.380', 'WEAPON3': '1.100', 'weapon3': '3.278', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.187', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:56,812][52671] DAMAGECOUNT value on done: 1028834.0 [2024-08-06 08:46:56,813][52671] Sum rewards: 70.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.085', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon5': '0.118', 'AMMO4': '0.135', 'AMMO3': '0.257', 'weapon4': '0.322', 'weapon2': '0.334', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '2.950', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.184', 'FRAGCOUNT': '61.000'} [2024-08-06 08:46:57,187][52647] DAMAGECOUNT value on done: 1082934.0 [2024-08-06 08:46:57,187][52647] Sum rewards: 68.449, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.580', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.134', 'AMMO4': '0.225', 'AMMO3': '0.244', 'weapon5': '0.294', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.600', 'weapon3': '2.862', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.304', 'FRAGCOUNT': '57.500'} [2024-08-06 08:46:57,537][52649] DAMAGECOUNT value on done: 984838.0 [2024-08-06 08:46:57,538][52649] Sum rewards: 64.758, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.915', 'AMMO5': '0.014', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO4': '0.166', 'weapon4': '0.172', 'AMMO3': '0.203', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'HITCOUNT': '2.990', 'weapon3': '3.192', 'DAMAGECOUNT': '16.404', 'FRAGCOUNT': '54.000'} [2024-08-06 08:46:57,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 711008256. Throughput: 0: 4354.7. Samples: 177761510. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:46:57,794][52567] Avg episode reward: [(0, '76.281')] [2024-08-06 08:46:58,180][52660] DAMAGECOUNT value on done: 1007683.0 [2024-08-06 08:46:58,182][52660] Sum rewards: 85.988, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.475', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.074', 'weapon5': '0.094', 'WEAPON4': '0.150', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.470', 'WEAPON3': '1.150', 'weapon3': '3.206', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.632', 'FRAGCOUNT': '69.000'} [2024-08-06 08:46:59,001][52669] DAMAGECOUNT value on done: 1014445.0 [2024-08-06 08:46:59,002][52669] Sum rewards: 81.260, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.280', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.038', 'weapon5': '0.076', 'AMMO4': '0.077', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.352', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '67.000'} [2024-08-06 08:46:59,179][52660] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:46:59,187][52811] DAMAGECOUNT value on done: 952753.0 [2024-08-06 08:46:59,188][52811] Sum rewards: 76.575, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.016', 'AMMO2': '0.024', 'weapon4': '0.050', 'AMMO4': '0.119', 'weapon5': '0.132', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.404', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '62.500'} [2024-08-06 08:46:59,519][52658] DAMAGECOUNT value on done: 1021350.0 [2024-08-06 08:46:59,523][52658] Sum rewards: 82.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.190', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.038', 'AMMO4': '0.039', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '68.000'} [2024-08-06 08:46:59,748][52671] DAMAGECOUNT value on done: 1034507.0 [2024-08-06 08:46:59,749][52671] Sum rewards: 89.039, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.074', 'AMMO5': '0.009', 'weapon4': '0.034', 'AMMO2': '0.038', 'weapon5': '0.114', 'AMMO3': '0.154', 'AMMO4': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.418', 'WEAPON3': '0.900', 'weapon3': '3.246', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '71.000'} [2024-08-06 08:46:59,904][52647] DAMAGECOUNT value on done: 1071130.0 [2024-08-06 08:46:59,904][52647] Sum rewards: 81.870, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.873', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.056', 'AMMO4': '0.105', 'weapon5': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '69.000'} [2024-08-06 08:47:00,624][52649] DAMAGECOUNT value on done: 1000323.0 [2024-08-06 08:47:00,627][52649] Sum rewards: 69.425, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.530', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.156', 'weapon4': '0.158', 'AMMO4': '0.235', 'AMMO3': '0.279', 'WEAPON5': '0.400', 'weapon2': '0.408', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '3.046', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '58.000'} [2024-08-06 08:47:00,796][52660] DAMAGECOUNT value on done: 1016203.0 [2024-08-06 08:47:00,806][52660] Sum rewards: 80.954, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.480', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.250', 'weapon4': '0.298', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.260', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:01,063][52650] Updated weights for policy 0, policy_version 86801 (0.0011) [2024-08-06 08:47:02,012][52669] DAMAGECOUNT value on done: 1015166.0 [2024-08-06 08:47:02,012][52669] Sum rewards: 69.440, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.247', 'AMMO5': '0.016', 'AMMO2': '0.048', 'AMMO3': '0.098', 'weapon4': '0.186', 'weapon5': '0.198', 'AMMO4': '0.238', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '0.700', 'weapon2': '0.820', 'weapon3': '2.572', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '54.500'} [2024-08-06 08:47:02,151][52811] DAMAGECOUNT value on done: 961577.0 [2024-08-06 08:47:02,151][52811] Sum rewards: 85.161, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.280', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.140', 'weapon4': '0.188', 'AMMO3': '0.229', 'AMMO4': '0.233', 'weapon2': '0.292', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.148', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.691', 'FRAGCOUNT': '71.000'} [2024-08-06 08:47:02,514][52647] DAMAGECOUNT value on done: 1074443.0 [2024-08-06 08:47:02,515][52647] Sum rewards: 67.101, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.171', 'AMMO5': '0.021', 'AMMO2': '0.054', 'weapon4': '0.096', 'weapon5': '0.250', 'weapon2': '0.272', 'AMMO4': '0.273', 'AMMO3': '0.279', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.650', 'weapon3': '3.018', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.219', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:02,749][52671] DAMAGECOUNT value on done: 1023923.0 [2024-08-06 08:47:02,749][52671] Sum rewards: 92.610, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.498', 'AMMO5': '0.010', 'AMMO2': '0.029', 'weapon4': '0.108', 'AMMO4': '0.145', 'weapon5': '0.146', 'AMMO3': '0.181', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.302', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '22.191', 'FRAGCOUNT': '74.000'} [2024-08-06 08:47:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 711098368. Throughput: 0: 4356.0. Samples: 177774520. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:47:02,794][52567] Avg episode reward: [(0, '76.501')] [2024-08-06 08:47:02,818][52658] DAMAGECOUNT value on done: 1022295.0 [2024-08-06 08:47:02,818][52658] Sum rewards: 76.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.893', 'AMMO5': '0.008', 'AMMO2': '0.017', 'AMMO4': '0.086', 'weapon5': '0.090', 'weapon4': '0.098', 'WEAPON4': '0.150', 'AMMO3': '0.199', 'WEAPON5': '0.200', 'weapon2': '0.506', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '61.000'} [2024-08-06 08:47:03,250][52660] DAMAGECOUNT value on done: 1032759.0 [2024-08-06 08:47:03,250][52660] Sum rewards: 90.770, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.018', 'AMMO2': '0.035', 'AMMO4': '0.174', 'weapon4': '0.180', 'weapon5': '0.220', 'AMMO3': '0.257', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '2.936', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '21.192', 'FRAGCOUNT': '76.000'} [2024-08-06 08:47:03,471][52649] DAMAGECOUNT value on done: 977823.0 [2024-08-06 08:47:03,471][52649] Sum rewards: 79.684, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.897', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.104', 'AMMO4': '0.141', 'AMMO3': '0.209', 'weapon2': '0.250', 'WEAPON4': '0.300', 'weapon5': '0.312', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.088', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '18.264', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:05,190][52669] DAMAGECOUNT value on done: 1022416.0 [2024-08-06 08:47:05,192][52669] Sum rewards: 64.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.255', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.132', 'AMMO4': '0.165', 'AMMO3': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.502', 'WEAPON3': '1.050', 'HITCOUNT': '2.950', 'weapon3': '3.168', 'DAMAGECOUNT': '15.324', 'FRAGCOUNT': '52.000'} [2024-08-06 08:47:05,276][52811] DAMAGECOUNT value on done: 952496.0 [2024-08-06 08:47:05,276][52811] Sum rewards: 73.216, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.590', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO4': '0.135', 'weapon5': '0.148', 'weapon2': '0.178', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.334', 'WEAPON3': '1.400', 'weapon3': '3.064', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.102', 'FRAGCOUNT': '60.000'} [2024-08-06 08:47:05,608][52647] DAMAGECOUNT value on done: 1073519.0 [2024-08-06 08:47:05,609][52647] Sum rewards: 86.746, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.674', 'AMMO5': '0.008', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.081', 'weapon5': '0.122', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.200', 'weapon3': '2.996', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.774', 'FRAGCOUNT': '68.000'} [2024-08-06 08:47:05,643][52650] Updated weights for policy 0, policy_version 86811 (0.0012) [2024-08-06 08:47:05,731][52660] DAMAGECOUNT value on done: 1009699.0 [2024-08-06 08:47:05,734][52660] Sum rewards: 69.852, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.964', 'AMMO2': '0.009', 'AMMO4': '0.043', 'AMMO3': '0.260', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.496', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:05,938][52658] DAMAGECOUNT value on done: 1023169.0 [2024-08-06 08:47:05,938][52658] Sum rewards: 79.468, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.894', 'AMMO5': '0.009', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.028', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.226', 'WEAPON3': '1.350', 'weapon3': '3.522', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:05,994][52671] DAMAGECOUNT value on done: 1020705.0 [2024-08-06 08:47:05,994][52671] Sum rewards: 71.072, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.550', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon5': '0.186', 'weapon2': '0.240', 'weapon4': '0.266', 'AMMO4': '0.271', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.010', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '62.000'} [2024-08-06 08:47:06,304][52649] DAMAGECOUNT value on done: 999017.0 [2024-08-06 08:47:06,306][52649] Sum rewards: 82.012, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.678', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.024', 'weapon5': '0.062', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.179', 'weapon2': '0.492', 'WEAPON3': '1.250', 'weapon3': '3.224', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:06,580][52794] Large shaping reward 2.539 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.519, 173.0)] [2024-08-06 08:47:07,672][52669] DAMAGECOUNT value on done: 1017975.0 [2024-08-06 08:47:07,673][52669] Sum rewards: 79.151, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.620', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.086', 'weapon5': '0.162', 'AMMO4': '0.167', 'AMMO3': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.028', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 711188480. Throughput: 0: 4358.2. Samples: 177800870. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:47:07,794][52567] Avg episode reward: [(0, '76.871')] [2024-08-06 08:47:08,261][52647] DAMAGECOUNT value on done: 1083605.0 [2024-08-06 08:47:08,263][52647] Sum rewards: 85.698, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.501', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.034', 'weapon5': '0.096', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.203', 'weapon2': '0.484', 'WEAPON3': '1.250', 'weapon3': '3.204', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '69.000'} [2024-08-06 08:47:08,291][52811] DAMAGECOUNT value on done: 950641.0 [2024-08-06 08:47:08,293][52811] Sum rewards: 67.991, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.682', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.163', 'AMMO3': '0.206', 'weapon5': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '2.994', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.522', 'FRAGCOUNT': '54.500'} [2024-08-06 08:47:08,474][52660] DAMAGECOUNT value on done: 1015238.0 [2024-08-06 08:47:08,475][52660] Sum rewards: 84.798, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.950', 'AMMO5': '0.014', 'AMMO2': '0.024', 'weapon4': '0.078', 'AMMO4': '0.122', 'weapon5': '0.146', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.552', 'WEAPON3': '1.100', 'weapon3': '3.038', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.668', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:08,782][52671] DAMAGECOUNT value on done: 1027938.0 [2024-08-06 08:47:08,782][52671] Sum rewards: 71.019, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.066', 'AMMO5': '0.009', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.110', 'AMMO4': '0.162', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.176', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.755', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:08,942][52658] DAMAGECOUNT value on done: 1019243.0 [2024-08-06 08:47:08,944][52658] Sum rewards: 75.594, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.098', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.060', 'AMMO4': '0.161', 'AMMO3': '0.168', 'weapon5': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.606', 'WEAPON3': '1.050', 'weapon3': '2.884', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.823', 'FRAGCOUNT': '60.000'} [2024-08-06 08:47:09,202][52649] DAMAGECOUNT value on done: 1001946.0 [2024-08-06 08:47:09,205][52649] Sum rewards: 84.803, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.194', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'WEAPON5': '0.050', 'weapon4': '0.092', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.183', 'weapon2': '0.586', 'WEAPON3': '1.150', 'weapon3': '3.094', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '69.000'} [2024-08-06 08:47:10,229][52659] Large shaping reward 2.581 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('HEALTH', -0.039, -13.0)] [2024-08-06 08:47:10,477][52669] DAMAGECOUNT value on done: 1024478.0 [2024-08-06 08:47:10,477][52669] Sum rewards: 74.364, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.867', 'AMMO5': '0.006', 'WEAPON1': '0.010', 'AMMO2': '0.017', 'weapon4': '0.026', 'weapon5': '0.052', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.182', 'weapon2': '0.362', 'WEAPON3': '1.100', 'weapon3': '3.332', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:10,525][52650] Updated weights for policy 0, policy_version 86821 (0.0017) [2024-08-06 08:47:11,367][52647] DAMAGECOUNT value on done: 1077004.0 [2024-08-06 08:47:11,368][52647] Sum rewards: 71.583, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.026', 'AMMO2': '0.012', 'AMMO4': '0.060', 'AMMO3': '0.207', 'weapon2': '0.312', 'WEAPON3': '1.250', 'HITCOUNT': '3.250', 'weapon3': '3.544', 'DAMAGECOUNT': '16.974', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:11,411][52660] DAMAGECOUNT value on done: 1013869.0 [2024-08-06 08:47:11,411][52660] Sum rewards: 71.398, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.194', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon4': '0.146', 'weapon5': '0.156', 'AMMO4': '0.184', 'weapon2': '0.198', 'AMMO3': '0.215', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '60.000'} [2024-08-06 08:47:11,440][52811] DAMAGECOUNT value on done: 948784.0 [2024-08-06 08:47:11,442][52811] Sum rewards: 69.078, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.020', 'weapon4': '0.064', 'AMMO4': '0.098', 'weapon5': '0.114', 'WEAPON4': '0.200', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.288', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.308', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '57.000'} [2024-08-06 08:47:11,466][52671] DAMAGECOUNT value on done: 1007020.0 [2024-08-06 08:47:11,467][52671] Sum rewards: 68.704, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.124', 'AMMO5': '0.008', 'weapon4': '0.014', 'AMMO2': '0.024', 'WEAPON4': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'weapon5': '0.228', 'weapon2': '0.456', 'WEAPON3': '1.100', 'weapon3': '3.122', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '55.000'} [2024-08-06 08:47:11,829][52658] DAMAGECOUNT value on done: 1013090.0 [2024-08-06 08:47:11,831][52658] Sum rewards: 86.497, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.145', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.038', 'AMMO4': '0.073', 'weapon5': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.394', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '70.000'} [2024-08-06 08:47:11,966][52649] DAMAGECOUNT value on done: 990576.0 [2024-08-06 08:47:11,969][52649] Sum rewards: 82.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.409', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.242', 'WEAPON3': '1.350', 'weapon3': '3.486', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 711270400. Throughput: 0: 4358.2. Samples: 177826990. Policy #0 lag: (min: 1.0, avg: 4.2, max: 8.0) [2024-08-06 08:47:12,794][52567] Avg episode reward: [(0, '76.799')] [2024-08-06 08:47:13,374][52669] DAMAGECOUNT value on done: 1022331.0 [2024-08-06 08:47:13,374][52669] Sum rewards: 76.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.416', 'AMMO5': '0.013', 'AMMO2': '0.020', 'weapon4': '0.044', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'weapon5': '0.206', 'AMMO3': '0.254', 'WEAPON5': '0.350', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.056', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.669', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:14,128][52647] DAMAGECOUNT value on done: 1077817.0 [2024-08-06 08:47:14,129][52647] Sum rewards: 55.538, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon4': '0.130', 'weapon5': '0.134', 'AMMO4': '0.153', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.464', 'WEAPON3': '1.300', 'HITCOUNT': '2.890', 'weapon3': '3.052', 'DAMAGECOUNT': '15.096', 'FRAGCOUNT': '47.000'} [2024-08-06 08:47:14,255][52660] DAMAGECOUNT value on done: 1004212.0 [2024-08-06 08:47:14,256][52660] Sum rewards: 75.249, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.315', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon5': '0.124', 'AMMO4': '0.175', 'weapon4': '0.182', 'weapon2': '0.252', 'AMMO3': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.168', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.689', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:14,281][52671] DAMAGECOUNT value on done: 1021447.0 [2024-08-06 08:47:14,283][52671] Sum rewards: 80.325, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.020', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.036', 'weapon5': '0.082', 'weapon2': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.235', 'weapon4': '0.236', 'WEAPON3': '1.500', 'weapon3': '3.286', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.095', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:14,463][52811] DAMAGECOUNT value on done: 950819.0 [2024-08-06 08:47:14,465][52811] Sum rewards: 71.933, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.850', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon5': '0.122', 'AMMO4': '0.163', 'AMMO3': '0.205', 'WEAPON5': '0.250', 'weapon4': '0.312', 'WEAPON4': '0.350', 'weapon2': '0.454', 'WEAPON3': '1.250', 'weapon3': '2.874', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:14,841][52658] DAMAGECOUNT value on done: 1012208.0 [2024-08-06 08:47:14,841][52658] Sum rewards: 62.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.500', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.064', 'AMMO4': '0.132', 'AMMO3': '0.177', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.756', 'WEAPON3': '1.100', 'weapon3': '2.702', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2024-08-06 08:47:15,515][52650] Updated weights for policy 0, policy_version 86831 (0.0013) [2024-08-06 08:47:16,504][52669] DAMAGECOUNT value on done: 1019765.0 [2024-08-06 08:47:16,513][52669] Sum rewards: 64.213, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.175', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.062', 'AMMO4': '0.094', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.462', 'WEAPON3': '1.400', 'weapon3': '3.108', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '16.029', 'FRAGCOUNT': '54.000'} [2024-08-06 08:47:16,894][52647] DAMAGECOUNT value on done: 1056376.0 [2024-08-06 08:47:16,895][52647] Sum rewards: 81.427, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.636', 'AMMO5': '0.008', 'AMMO2': '0.018', 'weapon4': '0.072', 'AMMO4': '0.089', 'weapon5': '0.150', 'AMMO3': '0.176', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON3': '1.100', 'weapon3': '3.310', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:16,965][52660] DAMAGECOUNT value on done: 1005916.0 [2024-08-06 08:47:16,966][52660] Sum rewards: 78.127, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.815', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon4': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.215', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '3.106', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:17,103][52671] DAMAGECOUNT value on done: 1024687.0 [2024-08-06 08:47:17,104][52671] Sum rewards: 83.377, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.510', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon2': '0.186', 'weapon4': '0.198', 'AMMO3': '0.215', 'AMMO4': '0.248', 'weapon5': '0.284', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.966', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.721', 'FRAGCOUNT': '67.500'} [2024-08-06 08:47:17,690][52811] DAMAGECOUNT value on done: 954938.0 [2024-08-06 08:47:17,692][52811] Sum rewards: 57.437, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.230', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.096', 'WEAPON5': '0.150', 'AMMO4': '0.182', 'WEAPON4': '0.200', 'AMMO3': '0.213', 'weapon4': '0.272', 'weapon2': '0.352', 'WEAPON3': '1.200', 'weapon3': '3.054', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.336', 'FRAGCOUNT': '47.000'} [2024-08-06 08:47:17,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 711360512. Throughput: 0: 4363.3. Samples: 177840000. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:17,795][52567] Avg episode reward: [(0, '76.382')] [2024-08-06 08:47:17,818][52658] DAMAGECOUNT value on done: 1025755.0 [2024-08-06 08:47:17,820][52658] Sum rewards: 81.480, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.604', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.104', 'AMMO4': '0.201', 'weapon5': '0.202', 'AMMO3': '0.238', 'weapon2': '0.246', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '68.000'} [2024-08-06 08:47:19,549][52647] DAMAGECOUNT value on done: 1070529.0 [2024-08-06 08:47:19,549][52647] Sum rewards: 70.981, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.070', 'AMMO5': '0.013', 'weapon4': '0.014', 'AMMO2': '0.021', 'weapon5': '0.078', 'WEAPON4': '0.100', 'AMMO4': '0.105', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.236', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '58.000'} [2024-08-06 08:47:19,769][52650] Updated weights for policy 0, policy_version 86841 (0.0030) [2024-08-06 08:47:19,922][52669] DAMAGECOUNT value on done: 1023959.0 [2024-08-06 08:47:19,923][52669] Sum rewards: 79.225, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.100', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.034', 'weapon5': '0.104', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.938', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:20,171][52671] DAMAGECOUNT value on done: 1019455.0 [2024-08-06 08:47:20,171][52671] Sum rewards: 71.694, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.350', 'AMMO5': '0.003', 'WEAPON1': '0.020', 'AMMO2': '0.039', 'weapon5': '0.048', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO4': '0.197', 'AMMO3': '0.238', 'weapon4': '0.286', 'weapon2': '0.408', 'WEAPON3': '1.450', 'weapon3': '2.948', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:20,516][52658] DAMAGECOUNT value on done: 1009079.0 [2024-08-06 08:47:20,517][52658] Sum rewards: 74.659, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.022', 'AMMO5': '0.015', 'AMMO2': '0.057', 'weapon5': '0.092', 'weapon4': '0.180', 'AMMO3': '0.200', 'AMMO4': '0.287', 'WEAPON5': '0.350', 'weapon2': '0.486', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.089', 'FRAGCOUNT': '62.000'} [2024-08-06 08:47:20,909][52811] DAMAGECOUNT value on done: 963330.0 [2024-08-06 08:47:20,911][52811] Sum rewards: 72.823, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.436', 'AMMO5': '0.003', 'weapon5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.020', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.100', 'AMMO3': '0.188', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.466', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.255', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:22,574][52647] DAMAGECOUNT value on done: 1065096.0 [2024-08-06 08:47:22,574][52647] Sum rewards: 72.670, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.820', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.044', 'AMMO4': '0.100', 'weapon4': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'WEAPON4': '0.250', 'weapon2': '0.480', 'WEAPON3': '1.350', 'weapon3': '3.174', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.712', 'FRAGCOUNT': '61.000'} [2024-08-06 08:47:22,648][52669] DAMAGECOUNT value on done: 1032114.0 [2024-08-06 08:47:22,648][52669] Sum rewards: 73.335, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.690', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.046', 'WEAPON5': '0.050', 'weapon4': '0.078', 'AMMO4': '0.136', 'weapon2': '0.146', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'WEAPON3': '1.400', 'weapon3': '3.560', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.411', 'FRAGCOUNT': '61.000'} [2024-08-06 08:47:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 711450624. Throughput: 0: 4362.1. Samples: 177866230. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:22,794][52567] Avg episode reward: [(0, '76.346')] [2024-08-06 08:47:23,184][52671] DAMAGECOUNT value on done: 1021890.0 [2024-08-06 08:47:23,185][52671] Sum rewards: 78.493, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.565', 'AMMO5': '0.008', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.060', 'weapon5': '0.130', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'WEAPON5': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.350', 'weapon3': '3.150', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:23,238][52658] DAMAGECOUNT value on done: 1037767.0 [2024-08-06 08:47:23,239][52658] Sum rewards: 77.466, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.670', 'AMMO5': '0.020', 'AMMO2': '0.063', 'weapon4': '0.186', 'weapon5': '0.236', 'AMMO3': '0.241', 'AMMO4': '0.317', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'weapon2': '0.586', 'WEAPON3': '1.400', 'weapon3': '2.684', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:23,482][52660] Large shaping reward 2.631 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:47:24,002][52811] DAMAGECOUNT value on done: 946143.0 [2024-08-06 08:47:24,003][52811] Sum rewards: 84.381, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.000', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.094', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'weapon2': '0.178', 'AMMO3': '0.181', 'WEAPON5': '0.200', 'WEAPON3': '1.200', 'weapon3': '3.590', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '68.500'} [2024-08-06 08:47:24,679][52650] Updated weights for policy 0, policy_version 86851 (0.0011) [2024-08-06 08:47:25,493][52669] DAMAGECOUNT value on done: 1024650.0 [2024-08-06 08:47:25,494][52669] Sum rewards: 92.802, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.485', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.086', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.240', 'WEAPON3': '1.450', 'weapon3': '3.460', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '21.882', 'FRAGCOUNT': '76.000'} [2024-08-06 08:47:25,669][52647] DAMAGECOUNT value on done: 1066306.0 [2024-08-06 08:47:25,671][52647] Sum rewards: 79.036, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-2.910', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.029', 'weapon5': '0.054', 'weapon4': '0.066', 'AMMO4': '0.144', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.330', 'WEAPON3': '1.600', 'weapon3': '3.258', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.667', 'FRAGCOUNT': '69.000'} [2024-08-06 08:47:25,949][52671] DAMAGECOUNT value on done: 1025999.0 [2024-08-06 08:47:25,949][52671] Sum rewards: 79.699, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.012', 'AMMO2': '0.048', 'weapon5': '0.162', 'AMMO4': '0.239', 'AMMO3': '0.269', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon4': '0.364', 'weapon2': '0.392', 'WEAPON3': '1.600', 'weapon3': '2.814', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:26,257][52658] DAMAGECOUNT value on done: 1025801.0 [2024-08-06 08:47:26,261][52658] Sum rewards: 76.366, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.666', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.066', 'AMMO4': '0.123', 'weapon5': '0.206', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.068', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:27,249][52811] DAMAGECOUNT value on done: 950551.0 [2024-08-06 08:47:27,249][52811] Sum rewards: 81.080, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.374', 'AMMO5': '0.004', 'weapon4': '0.018', 'AMMO2': '0.026', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.187', 'weapon2': '0.714', 'WEAPON3': '1.150', 'weapon3': '3.072', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:27,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 711532544. Throughput: 0: 4364.0. Samples: 177892500. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:27,802][52567] Avg episode reward: [(0, '76.745')] [2024-08-06 08:47:28,426][52671] DAMAGECOUNT value on done: 1008025.0 [2024-08-06 08:47:28,428][52671] Sum rewards: 79.111, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.668', 'ARMOR': '0.004', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.126', 'AMMO3': '0.232', 'WEAPON5': '0.250', 'weapon2': '0.300', 'weapon4': '0.328', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.004', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.747', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:28,606][52647] DAMAGECOUNT value on done: 1065310.0 [2024-08-06 08:47:28,607][52647] Sum rewards: 78.405, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.904', 'AMMO5': '0.013', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.152', 'weapon5': '0.154', 'WEAPON4': '0.250', 'AMMO3': '0.258', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.152', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '66.000'} [2024-08-06 08:47:28,738][52669] DAMAGECOUNT value on done: 1027182.0 [2024-08-06 08:47:28,738][52669] Sum rewards: 75.876, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.901', 'AMMO5': '0.009', 'AMMO2': '0.043', 'weapon4': '0.126', 'weapon5': '0.132', 'AMMO4': '0.215', 'weapon2': '0.226', 'AMMO3': '0.245', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.215', 'FRAGCOUNT': '63.000'} [2024-08-06 08:47:29,115][52650] Updated weights for policy 0, policy_version 86861 (0.0014) [2024-08-06 08:47:29,424][52658] DAMAGECOUNT value on done: 1032774.0 [2024-08-06 08:47:29,425][52658] Sum rewards: 78.614, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.150', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.066', 'weapon5': '0.184', 'AMMO4': '0.218', 'AMMO3': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.384', 'WEAPON3': '1.550', 'weapon3': '3.134', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:30,341][52663] DAMAGECOUNT value on done: 1034351.0 [2024-08-06 08:47:30,342][52663] Sum rewards: 78.144, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.789', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.042', 'AMMO4': '0.045', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.272', 'weapon2': '0.282', 'WEAPON3': '1.800', 'weapon3': '3.456', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:31,200][52647] DAMAGECOUNT value on done: 1071552.0 [2024-08-06 08:47:31,200][52647] Sum rewards: 89.482, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO5': '0.017', 'AMMO2': '0.055', 'weapon4': '0.086', 'AMMO3': '0.221', 'weapon5': '0.256', 'AMMO4': '0.276', 'weapon2': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.046', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '20.430', 'FRAGCOUNT': '73.000'} [2024-08-06 08:47:31,397][52671] DAMAGECOUNT value on done: 1033054.0 [2024-08-06 08:47:31,398][52671] Sum rewards: 77.195, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.496', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.067', 'weapon5': '0.098', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.294', 'AMMO3': '0.344', 'WEAPON3': '2.050', 'weapon3': '3.316', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '69.000'} [2024-08-06 08:47:31,477][52669] DAMAGECOUNT value on done: 1025587.0 [2024-08-06 08:47:31,478][52669] Sum rewards: 67.568, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.922', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO4': '0.151', 'AMMO3': '0.173', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.314', 'WEAPON3': '1.100', 'HITCOUNT': '3.080', 'weapon3': '3.312', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '55.000'} [2024-08-06 08:47:32,737][52658] DAMAGECOUNT value on done: 1016261.0 [2024-08-06 08:47:32,737][52658] Sum rewards: 76.862, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.925', 'AMMO5': '0.022', 'AMMO2': '0.058', 'weapon5': '0.186', 'AMMO3': '0.187', 'weapon2': '0.228', 'AMMO4': '0.289', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.926', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:32,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 711622656. Throughput: 0: 4366.7. Samples: 177905640. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:32,794][52567] Avg episode reward: [(0, '77.025')] [2024-08-06 08:47:33,427][52663] DAMAGECOUNT value on done: 1019274.0 [2024-08-06 08:47:33,428][52663] Sum rewards: 76.840, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.335', 'AMMO5': '0.010', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.254', 'WEAPON3': '1.450', 'weapon3': '3.184', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:33,690][52647] DAMAGECOUNT value on done: 1067754.0 [2024-08-06 08:47:33,690][52647] Sum rewards: 78.908, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.980', 'AMMO5': '0.007', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.064', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'weapon5': '0.174', 'AMMO3': '0.225', 'weapon2': '0.278', 'WEAPON3': '1.400', 'weapon3': '3.248', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.926', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:33,919][52671] DAMAGECOUNT value on done: 1029353.0 [2024-08-06 08:47:33,920][52671] Sum rewards: 84.289, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.198', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.064', 'weapon5': '0.086', 'AMMO4': '0.121', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.218', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'weapon3': '3.452', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.611', 'FRAGCOUNT': '70.000'} [2024-08-06 08:47:34,122][52650] Updated weights for policy 0, policy_version 86871 (0.0013) [2024-08-06 08:47:34,538][52669] DAMAGECOUNT value on done: 1015286.0 [2024-08-06 08:47:34,539][52669] Sum rewards: 73.057, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.820', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.026', 'weapon5': '0.080', 'AMMO4': '0.101', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.267', 'WEAPON3': '1.650', 'weapon3': '3.468', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '63.000'} [2024-08-06 08:47:35,589][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:47:35,895][52658] DAMAGECOUNT value on done: 1028444.0 [2024-08-06 08:47:35,899][52658] Sum rewards: 85.737, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.041', 'weapon5': '0.092', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.207', 'weapon2': '0.362', 'WEAPON3': '1.200', 'weapon3': '3.362', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '69.000'} [2024-08-06 08:47:36,054][52670] Large shaping reward -2.505 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.255, -85.0)] [2024-08-06 08:47:36,542][52663] DAMAGECOUNT value on done: 1013231.0 [2024-08-06 08:47:36,543][52663] Sum rewards: 82.650, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.220', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon5': '0.142', 'AMMO4': '0.147', 'weapon4': '0.160', 'AMMO3': '0.231', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '68.000'} [2024-08-06 08:47:36,664][52671] DAMAGECOUNT value on done: 1023811.0 [2024-08-06 08:47:36,665][52671] Sum rewards: 66.174, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.560', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.118', 'weapon5': '0.162', 'AMMO3': '0.242', 'AMMO4': '0.245', 'weapon2': '0.342', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.122', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '58.000'} [2024-08-06 08:47:36,681][52647] DAMAGECOUNT value on done: 1072965.0 [2024-08-06 08:47:36,681][52647] Sum rewards: 80.022, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.080', 'AMMO5': '0.017', 'AMMO2': '0.043', 'weapon4': '0.074', 'AMMO3': '0.191', 'AMMO4': '0.214', 'weapon5': '0.224', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.728', 'WEAPON3': '1.100', 'weapon3': '2.730', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.821', 'FRAGCOUNT': '62.500'} [2024-08-06 08:47:37,294][52669] DAMAGECOUNT value on done: 1018442.0 [2024-08-06 08:47:37,294][52669] Sum rewards: 82.965, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.825', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.056', 'AMMO4': '0.075', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO3': '0.212', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.168', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17613.1, 300 sec: 17467.0). Total num frames: 711712768. Throughput: 0: 4362.9. Samples: 177931680. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:37,802][52567] Avg episode reward: [(0, '77.312')] [2024-08-06 08:47:38,615][52650] Updated weights for policy 0, policy_version 86881 (0.0015) [2024-08-06 08:47:38,774][52658] DAMAGECOUNT value on done: 1019753.0 [2024-08-06 08:47:38,776][52658] Sum rewards: 80.462, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.102', 'AMMO5': '0.013', 'AMMO2': '0.028', 'weapon4': '0.132', 'AMMO4': '0.139', 'weapon2': '0.188', 'weapon5': '0.196', 'AMMO3': '0.223', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '20.079', 'FRAGCOUNT': '66.000'} [2024-08-06 08:47:39,168][52647] DAMAGECOUNT value on done: 1074047.0 [2024-08-06 08:47:39,169][52647] Sum rewards: 73.464, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.958', 'AMMO5': '0.014', 'AMMO2': '0.024', 'AMMO4': '0.120', 'AMMO3': '0.208', 'weapon4': '0.248', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'weapon2': '0.612', 'WEAPON3': '1.250', 'weapon3': '2.570', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.910', 'FRAGCOUNT': '60.000'} [2024-08-06 08:47:39,271][52663] DAMAGECOUNT value on done: 1020763.0 [2024-08-06 08:47:39,273][52663] Sum rewards: 82.728, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.932', 'WEAPON1': '0.010', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.159', 'AMMO3': '0.299', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.750', 'weapon3': '3.196', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.684', 'FRAGCOUNT': '69.000'} [2024-08-06 08:47:39,579][52671] DAMAGECOUNT value on done: 1030716.0 [2024-08-06 08:47:39,579][52671] Sum rewards: 85.791, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.269', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.140', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.316', 'weapon2': '0.396', 'WEAPON3': '1.050', 'weapon3': '2.836', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.001', 'FRAGCOUNT': '68.000'} [2024-08-06 08:47:39,952][52669] DAMAGECOUNT value on done: 1026430.0 [2024-08-06 08:47:39,952][52669] Sum rewards: 67.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.235', 'AMMO5': '0.023', 'AMMO2': '0.049', 'weapon4': '0.118', 'weapon5': '0.158', 'AMMO3': '0.183', 'AMMO4': '0.244', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.710', 'WEAPON3': '1.050', 'weapon3': '2.782', 'HITCOUNT': '2.830', 'DAMAGECOUNT': '16.893', 'FRAGCOUNT': '57.000'} [2024-08-06 08:47:41,652][52663] DAMAGECOUNT value on done: 1021049.0 [2024-08-06 08:47:41,652][52663] Sum rewards: 59.561, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.685', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.046', 'weapon5': '0.126', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.240', 'WEAPON3': '1.350', 'HITCOUNT': '2.830', 'weapon3': '3.434', 'DAMAGECOUNT': '14.670', 'FRAGCOUNT': '50.000'} [2024-08-06 08:47:41,716][52647] DAMAGECOUNT value on done: 1058460.0 [2024-08-06 08:47:41,716][52647] Sum rewards: 75.505, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.034', 'weapon4': '0.062', 'weapon5': '0.072', 'AMMO4': '0.170', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.300', 'weapon3': '3.126', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '62.000'} [2024-08-06 08:47:41,833][52658] DAMAGECOUNT value on done: 1021747.0 [2024-08-06 08:47:41,834][52658] Sum rewards: 73.565, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.040', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.062', 'weapon5': '0.164', 'weapon2': '0.204', 'AMMO4': '0.223', 'AMMO3': '0.286', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.873', 'FRAGCOUNT': '63.000'} [2024-08-06 08:47:42,490][52669] DAMAGECOUNT value on done: 1043521.0 [2024-08-06 08:47:42,491][52669] Sum rewards: 77.623, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.826', 'AMMO2': '0.035', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.174', 'AMMO3': '0.224', 'weapon2': '0.432', 'WEAPON3': '1.400', 'weapon3': '3.340', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:42,757][52671] DAMAGECOUNT value on done: 1013191.0 [2024-08-06 08:47:42,758][52671] Sum rewards: 86.470, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.880', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.040', 'weapon5': '0.112', 'AMMO4': '0.175', 'AMMO3': '0.230', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.352', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '70.000'} [2024-08-06 08:47:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 711794688. Throughput: 0: 4358.9. Samples: 177957660. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:42,794][52567] Avg episode reward: [(0, '77.156')] [2024-08-06 08:47:43,152][52650] Updated weights for policy 0, policy_version 86891 (0.0012) [2024-08-06 08:47:43,955][52647] DAMAGECOUNT value on done: 1070284.0 [2024-08-06 08:47:43,955][52647] Sum rewards: 80.307, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.034', 'AMMO5': '0.006', 'AMMO2': '0.018', 'weapon4': '0.080', 'weapon5': '0.084', 'AMMO4': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.210', 'weapon2': '0.548', 'WEAPON3': '1.250', 'weapon3': '3.046', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '66.000'} [2024-08-06 08:47:44,407][52663] DAMAGECOUNT value on done: 1025702.0 [2024-08-06 08:47:44,410][52663] Sum rewards: 77.649, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.640', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.066', 'AMMO4': '0.146', 'weapon5': '0.204', 'AMMO3': '0.231', 'WEAPON4': '0.300', 'weapon2': '0.398', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.054', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:44,678][52658] DAMAGECOUNT value on done: 1008175.0 [2024-08-06 08:47:44,680][52658] Sum rewards: 77.952, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.920', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.100', 'AMMO4': '0.144', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.200', 'weapon3': '3.354', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.510', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:45,268][52669] DAMAGECOUNT value on done: 1032417.0 [2024-08-06 08:47:45,268][52669] Sum rewards: 80.645, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.570', 'AMMO5': '0.014', 'AMMO2': '0.052', 'weapon4': '0.178', 'weapon5': '0.204', 'AMMO3': '0.205', 'AMMO4': '0.262', 'WEAPON5': '0.350', 'weapon2': '0.490', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.888', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:46,673][52647] DAMAGECOUNT value on done: 1061623.0 [2024-08-06 08:47:46,676][52647] Sum rewards: 84.708, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.891', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.054', 'weapon5': '0.178', 'AMMO4': '0.201', 'AMMO3': '0.254', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.178', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '70.000'} [2024-08-06 08:47:47,392][52803] DAMAGECOUNT value on done: 946244.0 [2024-08-06 08:47:47,392][52803] Sum rewards: 83.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.251', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.084', 'WEAPON4': '0.100', 'AMMO3': '0.186', 'weapon2': '0.324', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.542', 'FRAGCOUNT': '66.000'} [2024-08-06 08:47:47,434][52663] DAMAGECOUNT value on done: 1017916.0 [2024-08-06 08:47:47,435][52663] Sum rewards: 76.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.145', 'AMMO3': '0.167', 'weapon2': '0.222', 'weapon5': '0.234', 'weapon4': '0.242', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '0.950', 'HITCOUNT': '3.020', 'weapon3': '3.054', 'DAMAGECOUNT': '17.613', 'FRAGCOUNT': '62.000'} [2024-08-06 08:47:47,446][52658] DAMAGECOUNT value on done: 1025414.0 [2024-08-06 08:47:47,448][52658] Sum rewards: 77.790, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.990', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.072', 'weapon5': '0.086', 'AMMO4': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.182', 'AMMO3': '0.260', 'WEAPON3': '1.600', 'weapon3': '3.398', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.067', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:47,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 711884800. Throughput: 0: 4362.9. Samples: 177970850. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:47,794][52567] Avg episode reward: [(0, '77.190')] [2024-08-06 08:47:47,945][52650] Updated weights for policy 0, policy_version 86901 (0.0017) [2024-08-06 08:47:47,996][52663] Large shaping reward 2.561 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.51, 170.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:47:48,221][52669] DAMAGECOUNT value on done: 1029483.0 [2024-08-06 08:47:48,223][52669] Sum rewards: 82.819, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.534', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.088', 'weapon4': '0.158', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '66.000'} [2024-08-06 08:47:49,322][52647] DAMAGECOUNT value on done: 1063412.0 [2024-08-06 08:47:49,323][52647] Sum rewards: 73.641, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.947', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.102', 'AMMO3': '0.213', 'weapon5': '0.216', 'AMMO4': '0.220', 'weapon2': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.184', 'DAMAGECOUNT': '17.208', 'FRAGCOUNT': '60.000'} [2024-08-06 08:47:50,226][52794] DAMAGECOUNT value on done: 1013153.0 [2024-08-06 08:47:50,226][52794] Sum rewards: 82.222, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.816', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.026', 'weapon5': '0.038', 'AMMO4': '0.119', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.258', 'WEAPON3': '1.450', 'weapon3': '3.506', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.606', 'FRAGCOUNT': '70.000'} [2024-08-06 08:47:50,311][52663] DAMAGECOUNT value on done: 1004489.0 [2024-08-06 08:47:50,313][52658] DAMAGECOUNT value on done: 1017229.0 [2024-08-06 08:47:50,314][52663] Sum rewards: 78.769, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.779', 'AMMO5': '0.028', 'AMMO2': '0.062', 'weapon4': '0.154', 'AMMO3': '0.216', 'weapon5': '0.268', 'AMMO4': '0.312', 'weapon2': '0.466', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.350', 'weapon3': '2.828', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '20.544', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:50,314][52658] Sum rewards: 71.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.424', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.138', 'weapon4': '0.150', 'AMMO3': '0.162', 'AMMO4': '0.169', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.000', 'weapon3': '3.108', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '59.000'} [2024-08-06 08:47:50,424][52803] DAMAGECOUNT value on done: 944626.0 [2024-08-06 08:47:50,425][52803] Sum rewards: 82.825, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.761', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.056', 'weapon5': '0.136', 'AMMO4': '0.150', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.264', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.083', 'FRAGCOUNT': '67.000'} [2024-08-06 08:47:51,248][52669] DAMAGECOUNT value on done: 1034154.0 [2024-08-06 08:47:51,248][52669] Sum rewards: 80.642, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.870', 'AMMO5': '0.006', 'AMMO2': '0.013', 'AMMO4': '0.062', 'weapon5': '0.086', 'WEAPON4': '0.100', 'weapon4': '0.126', 'AMMO3': '0.137', 'WEAPON5': '0.200', 'weapon2': '0.652', 'WEAPON3': '1.000', 'weapon3': '2.976', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.564', 'FRAGCOUNT': '63.000'} [2024-08-06 08:47:52,562][52650] Updated weights for policy 0, policy_version 86911 (0.0029) [2024-08-06 08:47:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 711974912. Throughput: 0: 4362.0. Samples: 177997160. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:52,794][52567] Avg episode reward: [(0, '77.100')] [2024-08-06 08:47:52,847][52658] DAMAGECOUNT value on done: 1014847.0 [2024-08-06 08:47:52,847][52658] Sum rewards: 76.290, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.044', 'HEALTH': '0.065', 'AMMO4': '0.128', 'AMMO3': '0.188', 'weapon5': '0.198', 'WEAPON4': '0.200', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.280', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '61.000'} [2024-08-06 08:47:53,118][52794] DAMAGECOUNT value on done: 1022151.0 [2024-08-06 08:47:53,118][52794] Sum rewards: 63.583, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.251', 'AMMO5': '0.011', 'AMMO2': '0.036', 'AMMO3': '0.161', 'weapon5': '0.162', 'AMMO4': '0.179', 'weapon4': '0.202', 'weapon2': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.000', 'HITCOUNT': '2.790', 'weapon3': '3.192', 'DAMAGECOUNT': '15.291', 'FRAGCOUNT': '50.000'} [2024-08-06 08:47:53,222][52663] DAMAGECOUNT value on done: 1015506.0 [2024-08-06 08:47:53,222][52663] Sum rewards: 84.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.580', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.122', 'weapon5': '0.178', 'AMMO3': '0.183', 'AMMO4': '0.252', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.211', 'FRAGCOUNT': '68.000'} [2024-08-06 08:47:53,618][52803] DAMAGECOUNT value on done: 952167.0 [2024-08-06 08:47:53,619][52803] Sum rewards: 65.298, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.350', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.028', 'AMMO4': '0.048', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.151', 'weapon2': '0.488', 'WEAPON3': '0.900', 'HITCOUNT': '3.050', 'weapon3': '3.244', 'DAMAGECOUNT': '15.444', 'FRAGCOUNT': '51.000'} [2024-08-06 08:47:53,869][52669] DAMAGECOUNT value on done: 1035380.0 [2024-08-06 08:47:53,870][52669] Sum rewards: 72.457, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.820', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.056', 'weapon5': '0.188', 'weapon2': '0.218', 'AMMO4': '0.224', 'AMMO3': '0.294', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.244', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '63.000'} [2024-08-06 08:47:55,611][52663] DAMAGECOUNT value on done: 1012970.0 [2024-08-06 08:47:55,612][52663] Sum rewards: 79.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.469', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon4': '0.104', 'weapon2': '0.228', 'AMMO3': '0.239', 'weapon5': '0.266', 'AMMO4': '0.274', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '3.130', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '64.500'} [2024-08-06 08:47:55,783][52794] DAMAGECOUNT value on done: 1028135.0 [2024-08-06 08:47:55,783][52794] Sum rewards: 81.346, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.618', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon4': '0.162', 'weapon2': '0.426', 'WEAPON3': '1.100', 'weapon3': '3.110', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.666', 'FRAGCOUNT': '65.000'} [2024-08-06 08:47:56,057][52658] DAMAGECOUNT value on done: 1023939.0 [2024-08-06 08:47:56,061][52658] Sum rewards: 79.996, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.349', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.042', 'weapon5': '0.110', 'AMMO3': '0.164', 'AMMO4': '0.206', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '64.000'} [2024-08-06 08:47:56,740][52803] DAMAGECOUNT value on done: 946737.0 [2024-08-06 08:47:56,740][52803] Sum rewards: 84.866, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.470', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.088', 'weapon2': '0.146', 'weapon5': '0.160', 'AMMO4': '0.243', 'AMMO3': '0.278', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.750', 'weapon3': '3.286', 'HITCOUNT': '4.200', 'DAMAGECOUNT': '22.074', 'FRAGCOUNT': '71.000'} [2024-08-06 08:47:57,350][52650] Updated weights for policy 0, policy_version 86921 (0.0012) [2024-08-06 08:47:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 712056832. Throughput: 0: 4369.1. Samples: 178023600. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:47:57,794][52567] Avg episode reward: [(0, '76.867')] [2024-08-06 08:47:58,055][52663] DAMAGECOUNT value on done: 1023464.0 [2024-08-06 08:47:58,055][52663] Sum rewards: 75.583, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.069', 'weapon5': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.205', 'weapon2': '0.546', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '62.000'} [2024-08-06 08:47:58,619][52794] DAMAGECOUNT value on done: 1015775.0 [2024-08-06 08:47:58,621][52794] Sum rewards: 85.483, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.821', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.268', 'WEAPON3': '1.600', 'weapon3': '3.400', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.009', 'FRAGCOUNT': '73.000'} [2024-08-06 08:47:59,895][52803] DAMAGECOUNT value on done: 949457.0 [2024-08-06 08:47:59,896][52803] Sum rewards: 90.358, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.256', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.144', 'WEAPON4': '0.150', 'AMMO3': '0.168', 'weapon4': '0.246', 'WEAPON5': '0.250', 'weapon2': '0.264', 'WEAPON3': '1.050', 'weapon3': '3.114', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '20.925', 'FRAGCOUNT': '72.000'} [2024-08-06 08:48:00,428][52794] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:48:00,990][52663] DAMAGECOUNT value on done: 1005767.0 [2024-08-06 08:48:00,992][52663] Sum rewards: 74.891, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.656', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.078', 'weapon5': '0.084', 'AMMO4': '0.096', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.510', 'WEAPON3': '1.000', 'weapon3': '3.128', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:01,073][52794] DAMAGECOUNT value on done: 1010116.0 [2024-08-06 08:48:01,074][52794] Sum rewards: 74.030, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.196', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.090', 'weapon5': '0.138', 'AMMO4': '0.154', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.684', 'WEAPON3': '1.150', 'weapon3': '2.846', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:01,760][52650] Updated weights for policy 0, policy_version 86931 (0.0012) [2024-08-06 08:48:02,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 712146944. Throughput: 0: 4364.9. Samples: 178036420. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:48:02,794][52567] Avg episode reward: [(0, '77.133')] [2024-08-06 08:48:03,056][52803] DAMAGECOUNT value on done: 946571.0 [2024-08-06 08:48:03,056][52803] Sum rewards: 83.771, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.017', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.162', 'weapon5': '0.210', 'AMMO4': '0.228', 'weapon4': '0.338', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '2.710', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.446', 'FRAGCOUNT': '66.000'} [2024-08-06 08:48:03,835][52663] DAMAGECOUNT value on done: 1006030.0 [2024-08-06 08:48:03,835][52663] Sum rewards: 61.948, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.570', 'AMMO5': '0.021', 'AMMO2': '0.070', 'weapon4': '0.114', 'weapon2': '0.192', 'AMMO3': '0.321', 'weapon5': '0.346', 'AMMO4': '0.348', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.900', 'HITCOUNT': '2.720', 'weapon3': '3.008', 'DAMAGECOUNT': '16.827', 'FRAGCOUNT': '55.000'} [2024-08-06 08:48:03,976][52794] DAMAGECOUNT value on done: 1015054.0 [2024-08-06 08:48:03,976][52794] Sum rewards: 83.224, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.361', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.030', 'AMMO4': '0.084', 'weapon5': '0.096', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.330', 'WEAPON3': '1.300', 'weapon3': '3.324', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '20.181', 'FRAGCOUNT': '67.000'} [2024-08-06 08:48:06,154][52803] DAMAGECOUNT value on done: 944627.0 [2024-08-06 08:48:06,159][52803] Sum rewards: 86.073, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.124', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.106', 'weapon4': '0.112', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.280', 'WEAPON3': '1.400', 'weapon3': '3.312', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '70.000'} [2024-08-06 08:48:06,596][52794] DAMAGECOUNT value on done: 1013753.0 [2024-08-06 08:48:06,597][52794] Sum rewards: 71.793, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.160', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.079', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.214', 'AMMO3': '0.255', 'WEAPON3': '1.550', 'weapon3': '3.456', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.486', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:06,751][52650] Updated weights for policy 0, policy_version 86941 (0.0012) [2024-08-06 08:48:07,020][52663] DAMAGECOUNT value on done: 1014266.0 [2024-08-06 08:48:07,020][52663] Sum rewards: 72.660, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.526', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.064', 'weapon5': '0.192', 'AMMO4': '0.229', 'weapon2': '0.232', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '62.000'} [2024-08-06 08:48:07,794][52567] Fps is (10 sec: 18022.1, 60 sec: 17476.2, 300 sec: 17467.0). Total num frames: 712237056. Throughput: 0: 4366.6. Samples: 178062730. Policy #0 lag: (min: 0.0, avg: 4.2, max: 7.0) [2024-08-06 08:48:07,795][52567] Avg episode reward: [(0, '77.021')] [2024-08-06 08:48:09,287][52803] DAMAGECOUNT value on done: 943358.0 [2024-08-06 08:48:09,289][52803] Sum rewards: 94.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.885', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.014', 'weapon5': '0.046', 'AMMO4': '0.072', 'WEAPON4': '0.100', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON3': '1.200', 'weapon3': '3.494', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '22.161', 'FRAGCOUNT': '75.000'} [2024-08-06 08:48:09,689][52794] DAMAGECOUNT value on done: 1005950.0 [2024-08-06 08:48:09,689][52794] Sum rewards: 75.049, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.043', 'HEALTH': '0.126', 'weapon5': '0.128', 'weapon4': '0.142', 'AMMO3': '0.210', 'AMMO4': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.152', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:10,058][52663] DAMAGECOUNT value on done: 1013680.0 [2024-08-06 08:48:10,061][52663] Sum rewards: 71.378, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.125', 'AMMO5': '0.003', 'AMMO2': '0.012', 'weapon4': '0.014', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.192', 'weapon2': '0.530', 'WEAPON3': '1.250', 'weapon3': '3.266', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.980', 'FRAGCOUNT': '59.000'} [2024-08-06 08:48:11,273][52650] Updated weights for policy 0, policy_version 86951 (0.0015) [2024-08-06 08:48:12,493][52803] DAMAGECOUNT value on done: 949641.0 [2024-08-06 08:48:12,493][52803] Sum rewards: 83.597, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.208', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.083', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.188', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.675', 'FRAGCOUNT': '68.000'} [2024-08-06 08:48:12,568][52794] DAMAGECOUNT value on done: 1021287.0 [2024-08-06 08:48:12,568][52794] Sum rewards: 79.325, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.258', 'WEAPON1': '0.010', 'ARMOR': '0.020', 'AMMO5': '0.028', 'AMMO2': '0.065', 'AMMO3': '0.202', 'weapon4': '0.260', 'weapon2': '0.298', 'weapon5': '0.304', 'AMMO4': '0.325', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.200', 'weapon3': '2.804', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:12,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 712318976. Throughput: 0: 4370.2. Samples: 178089160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:12,802][52567] Avg episode reward: [(0, '77.284')] [2024-08-06 08:48:13,215][52663] DAMAGECOUNT value on done: 1019237.0 [2024-08-06 08:48:13,216][52663] Sum rewards: 85.560, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.985', 'AMMO5': '0.004', 'AMMO2': '0.031', 'weapon5': '0.036', 'WEAPON5': '0.100', 'AMMO4': '0.155', 'AMMO3': '0.200', 'WEAPON4': '0.200', 'weapon4': '0.228', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.154', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '20.790', 'FRAGCOUNT': '69.000'} [2024-08-06 08:48:15,474][52794] DAMAGECOUNT value on done: 1016667.0 [2024-08-06 08:48:15,476][52794] Sum rewards: 77.716, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.044', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon5': '0.064', 'weapon4': '0.112', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'AMMO4': '0.218', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.400', 'weapon3': '3.244', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.197', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:15,486][52803] DAMAGECOUNT value on done: 944704.0 [2024-08-06 08:48:15,489][52803] Sum rewards: 81.655, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.447', 'AMMO2': '0.010', 'AMMO5': '0.014', 'weapon4': '0.030', 'AMMO4': '0.050', 'weapon5': '0.062', 'WEAPON4': '0.100', 'AMMO3': '0.205', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.300', 'weapon3': '3.248', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '68.000'} [2024-08-06 08:48:16,236][52650] Updated weights for policy 0, policy_version 86961 (0.0013) [2024-08-06 08:48:16,309][52663] DAMAGECOUNT value on done: 1016433.0 [2024-08-06 08:48:16,309][52663] Sum rewards: 69.396, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.562', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.058', 'AMMO3': '0.161', 'AMMO4': '0.183', 'weapon5': '0.298', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.478', 'WEAPON3': '1.000', 'HITCOUNT': '2.830', 'weapon3': '2.968', 'DAMAGECOUNT': '15.978', 'FRAGCOUNT': '55.000'} [2024-08-06 08:48:17,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 712417280. Throughput: 0: 4363.8. Samples: 178102010. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:17,794][52567] Avg episode reward: [(0, '77.470')] [2024-08-06 08:48:18,620][52803] DAMAGECOUNT value on done: 959512.0 [2024-08-06 08:48:18,624][52803] Sum rewards: 76.804, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.552', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon5': '0.148', 'weapon4': '0.180', 'AMMO4': '0.235', 'AMMO3': '0.243', 'weapon2': '0.342', 'WEAPON5': '0.350', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '65.000'} [2024-08-06 08:48:18,784][52794] DAMAGECOUNT value on done: 1009286.0 [2024-08-06 08:48:18,785][52794] Sum rewards: 82.532, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.570', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.038', 'weapon5': '0.066', 'AMMO4': '0.175', 'WEAPON4': '0.200', 'weapon2': '0.244', 'WEAPON5': '0.250', 'AMMO3': '0.265', 'WEAPON3': '1.700', 'weapon3': '3.436', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.372', 'FRAGCOUNT': '70.000'} [2024-08-06 08:48:19,453][52663] DAMAGECOUNT value on done: 1021812.0 [2024-08-06 08:48:19,454][52663] Sum rewards: 67.718, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.650', 'AMMO5': '0.012', 'AMMO2': '0.026', 'weapon4': '0.074', 'AMMO4': '0.132', 'weapon5': '0.140', 'AMMO3': '0.227', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.450', 'weapon3': '3.104', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.125', 'FRAGCOUNT': '58.000'} [2024-08-06 08:48:20,388][52670] DAMAGECOUNT value on done: 1004246.0 [2024-08-06 08:48:20,389][52670] Sum rewards: 84.184, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.463', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon5': '0.072', 'AMMO4': '0.096', 'WEAPON5': '0.150', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon4': '0.260', 'weapon2': '0.390', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.643', 'FRAGCOUNT': '70.000'} [2024-08-06 08:48:20,728][52650] Updated weights for policy 0, policy_version 86971 (0.0020) [2024-08-06 08:48:21,801][52803] DAMAGECOUNT value on done: 954840.0 [2024-08-06 08:48:21,801][52803] Sum rewards: 78.821, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.820', 'AMMO5': '0.006', 'AMMO2': '0.015', 'weapon4': '0.032', 'AMMO4': '0.074', 'weapon5': '0.082', 'weapon2': '0.108', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.212', 'WEAPON3': '1.450', 'HITCOUNT': '3.450', 'weapon3': '3.582', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '66.000'} [2024-08-06 08:48:21,808][52794] DAMAGECOUNT value on done: 1024291.0 [2024-08-06 08:48:21,809][52794] Sum rewards: 93.445, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.044', 'weapon5': '0.132', 'weapon2': '0.170', 'AMMO4': '0.199', 'AMMO3': '0.213', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.446', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '23.352', 'FRAGCOUNT': '76.000'} [2024-08-06 08:48:22,266][52663] DAMAGECOUNT value on done: 1028773.0 [2024-08-06 08:48:22,267][52663] Sum rewards: 68.183, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.720', 'AMMO2': '0.009', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'weapon4': '0.066', 'weapon2': '0.258', 'AMMO3': '0.333', 'WEAPON3': '2.000', 'weapon3': '3.432', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '62.000'} [2024-08-06 08:48:22,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 712499200. Throughput: 0: 4369.3. Samples: 178128300. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:22,794][52567] Avg episode reward: [(0, '77.943')] [2024-08-06 08:48:23,266][52670] DAMAGECOUNT value on done: 1023646.0 [2024-08-06 08:48:23,268][52670] Sum rewards: 66.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.453', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.164', 'weapon4': '0.184', 'AMMO3': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.500', 'weapon3': '3.034', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.536', 'FRAGCOUNT': '56.000'} [2024-08-06 08:48:24,661][52794] DAMAGECOUNT value on done: 1017076.0 [2024-08-06 08:48:24,662][52794] Sum rewards: 76.951, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.395', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.047', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.206', 'weapon2': '0.770', 'WEAPON3': '1.350', 'weapon3': '2.984', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '63.000'} [2024-08-06 08:48:24,923][52803] DAMAGECOUNT value on done: 942835.0 [2024-08-06 08:48:24,924][52803] Sum rewards: 69.973, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.500', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.044', 'AMMO4': '0.077', 'weapon5': '0.128', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.211', 'weapon2': '0.348', 'WEAPON3': '1.350', 'weapon3': '3.282', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '57.000'} [2024-08-06 08:48:25,321][52663] DAMAGECOUNT value on done: 1006598.0 [2024-08-06 08:48:25,322][52663] Sum rewards: 80.793, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.960', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon4': '0.114', 'weapon5': '0.150', 'AMMO3': '0.199', 'AMMO4': '0.204', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '20.106', 'FRAGCOUNT': '65.000'} [2024-08-06 08:48:25,572][52650] Updated weights for policy 0, policy_version 86981 (0.0019) [2024-08-06 08:48:26,386][52670] DAMAGECOUNT value on done: 1003446.0 [2024-08-06 08:48:26,388][52670] Sum rewards: 51.270, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.870', 'AMMO5': '0.015', 'AMMO2': '0.051', 'weapon4': '0.056', 'weapon5': '0.190', 'AMMO4': '0.256', 'AMMO3': '0.258', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'HITCOUNT': '2.790', 'weapon3': '3.186', 'DAMAGECOUNT': '14.406', 'FRAGCOUNT': '45.000'} [2024-08-06 08:48:27,228][52794] DAMAGECOUNT value on done: 1028940.0 [2024-08-06 08:48:27,228][52794] Sum rewards: 69.627, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.095', 'AMMO5': '0.010', 'AMMO2': '0.020', 'AMMO4': '0.098', 'AMMO3': '0.124', 'weapon5': '0.200', 'weapon4': '0.214', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '0.850', 'weapon3': '2.946', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '53.000'} [2024-08-06 08:48:27,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 712581120. Throughput: 0: 4374.7. Samples: 178154520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:27,795][52567] Avg episode reward: [(0, '77.631')] [2024-08-06 08:48:27,804][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086985_712581120.pth... [2024-08-06 08:48:27,957][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086475_708403200.pth [2024-08-06 08:48:28,123][52803] DAMAGECOUNT value on done: 960122.0 [2024-08-06 08:48:28,126][52803] Sum rewards: 71.422, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.957', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.124', 'weapon5': '0.208', 'AMMO4': '0.234', 'weapon2': '0.246', 'AMMO3': '0.257', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.106', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '62.000'} [2024-08-06 08:48:29,024][52668] DAMAGECOUNT value on done: 1025525.0 [2024-08-06 08:48:29,024][52668] Sum rewards: 61.282, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.805', 'AMMO5': '0.013', 'AMMO2': '0.054', 'weapon4': '0.076', 'AMMO3': '0.209', 'weapon5': '0.214', 'AMMO4': '0.272', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'HITCOUNT': '2.900', 'weapon3': '3.190', 'DAMAGECOUNT': '14.814', 'FRAGCOUNT': '51.000'} [2024-08-06 08:48:29,565][52647] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:48:29,600][52670] DAMAGECOUNT value on done: 1007056.0 [2024-08-06 08:48:29,600][52670] Sum rewards: 81.489, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.376', 'AMMO2': '0.009', 'AMMO5': '0.010', 'weapon4': '0.026', 'AMMO4': '0.043', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.422', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '67.000'} [2024-08-06 08:48:29,982][52666] DAMAGECOUNT value on done: 1016238.0 [2024-08-06 08:48:29,983][52666] Sum rewards: 86.120, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.695', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.100', 'weapon4': '0.148', 'weapon2': '0.178', 'AMMO3': '0.186', 'WEAPON3': '1.150', 'weapon3': '3.572', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '70.000'} [2024-08-06 08:48:30,148][52794] DAMAGECOUNT value on done: 1011152.0 [2024-08-06 08:48:30,149][52794] Sum rewards: 82.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.244', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon5': '0.140', 'weapon4': '0.232', 'AMMO3': '0.234', 'weapon2': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.062', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '70.000'} [2024-08-06 08:48:30,223][52650] Updated weights for policy 0, policy_version 86991 (0.0049) [2024-08-06 08:48:31,340][52803] DAMAGECOUNT value on done: 946257.0 [2024-08-06 08:48:31,342][52803] Sum rewards: 86.320, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.865', 'AMMO5': '0.011', 'AMMO2': '0.064', 'weapon5': '0.092', 'weapon4': '0.126', 'AMMO3': '0.218', 'weapon2': '0.222', 'WEAPON5': '0.300', 'AMMO4': '0.319', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.358', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.515', 'FRAGCOUNT': '72.000'} [2024-08-06 08:48:32,060][52668] DAMAGECOUNT value on done: 1025145.0 [2024-08-06 08:48:32,061][52668] Sum rewards: 71.633, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.756', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.054', 'weapon5': '0.174', 'AMMO4': '0.203', 'AMMO3': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.400', 'HITCOUNT': '3.170', 'weapon3': '3.172', 'DAMAGECOUNT': '16.698', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:32,371][52670] DAMAGECOUNT value on done: 1018270.0 [2024-08-06 08:48:32,372][52670] Sum rewards: 75.061, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.785', 'AMMO2': '0.006', 'AMMO5': '0.011', 'weapon4': '0.016', 'AMMO4': '0.028', 'WEAPON4': '0.050', 'weapon5': '0.118', 'WEAPON5': '0.150', 'AMMO3': '0.263', 'weapon2': '0.334', 'WEAPON3': '1.600', 'weapon3': '3.280', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '63.500'} [2024-08-06 08:48:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 712671232. Throughput: 0: 4362.4. Samples: 178167160. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:32,794][52567] Avg episode reward: [(0, '77.855')] [2024-08-06 08:48:32,810][52666] DAMAGECOUNT value on done: 1018060.0 [2024-08-06 08:48:32,811][52666] Sum rewards: 79.892, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.073', 'HEALTH': '0.100', 'weapon5': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.176', 'AMMO3': '0.194', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.026', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.699', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:32,922][52794] DAMAGECOUNT value on done: 1023322.0 [2024-08-06 08:48:32,926][52794] Sum rewards: 85.547, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.200', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.056', 'AMMO4': '0.171', 'weapon5': '0.174', 'AMMO3': '0.187', 'weapon2': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.372', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.334', 'FRAGCOUNT': '68.000'} [2024-08-06 08:48:33,161][52803] Large shaping reward 2.617 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.585, 195.0), ('weapon5', 0.002)] [2024-08-06 08:48:34,481][52803] DAMAGECOUNT value on done: 954979.0 [2024-08-06 08:48:34,485][52803] Sum rewards: 69.401, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.466', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.168', 'weapon5': '0.204', 'weapon2': '0.208', 'AMMO4': '0.234', 'AMMO3': '0.273', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.048', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:34,931][52650] Updated weights for policy 0, policy_version 87001 (0.0021) [2024-08-06 08:48:35,034][52668] DAMAGECOUNT value on done: 1020328.0 [2024-08-06 08:48:35,034][52668] Sum rewards: 88.178, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.086', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.252', 'FRAGCOUNT': '73.000'} [2024-08-06 08:48:35,358][52670] DAMAGECOUNT value on done: 1008491.0 [2024-08-06 08:48:35,358][52670] Sum rewards: 81.013, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.498', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.158', 'AMMO3': '0.172', 'weapon5': '0.176', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.382', 'WEAPON3': '1.000', 'weapon3': '2.910', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '66.000'} [2024-08-06 08:48:35,799][52794] DAMAGECOUNT value on done: 1018718.0 [2024-08-06 08:48:35,801][52794] Sum rewards: 72.969, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.465', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.015', 'weapon5': '0.036', 'WEAPON5': '0.050', 'AMMO3': '0.164', 'weapon2': '0.538', 'WEAPON3': '1.100', 'weapon3': '3.272', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '58.000'} [2024-08-06 08:48:35,911][52666] DAMAGECOUNT value on done: 1024198.0 [2024-08-06 08:48:35,911][52666] Sum rewards: 77.355, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.904', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.040', 'weapon5': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.322', 'WEAPON3': '1.600', 'weapon3': '3.356', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.752', 'FRAGCOUNT': '65.000'} [2024-08-06 08:48:37,447][52803] DAMAGECOUNT value on done: 954651.0 [2024-08-06 08:48:37,448][52803] Sum rewards: 80.819, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.226', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.060', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.456', 'WEAPON3': '1.250', 'weapon3': '3.308', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.812', 'FRAGCOUNT': '65.000'} [2024-08-06 08:48:37,795][52567] Fps is (10 sec: 17202.5, 60 sec: 17339.6, 300 sec: 17439.2). Total num frames: 712753152. Throughput: 0: 4360.8. Samples: 178193400. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:37,795][52567] Avg episode reward: [(0, '77.707')] [2024-08-06 08:48:38,100][52664] DAMAGECOUNT value on done: 1050108.0 [2024-08-06 08:48:38,100][52664] Sum rewards: 91.560, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.418', 'AMMO5': '0.006', 'weapon4': '0.032', 'AMMO2': '0.036', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.181', 'AMMO3': '0.210', 'weapon2': '0.468', 'WEAPON3': '1.400', 'weapon3': '3.266', 'HITCOUNT': '4.070', 'DAMAGECOUNT': '21.699', 'FRAGCOUNT': '75.000'} [2024-08-06 08:48:38,135][52668] DAMAGECOUNT value on done: 1026695.0 [2024-08-06 08:48:38,135][52668] Sum rewards: 80.875, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.650', 'AMMO4': '-0.015', 'AMMO2': '-0.003', 'AMMO5': '0.005', 'weapon5': '0.010', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.414', 'WEAPON3': '1.500', 'weapon3': '3.422', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.714', 'FRAGCOUNT': '68.000'} [2024-08-06 08:48:38,550][52670] DAMAGECOUNT value on done: 1005806.0 [2024-08-06 08:48:38,550][52670] Sum rewards: 75.858, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.136', 'AMMO4': '0.180', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.394', 'WEAPON3': '1.500', 'weapon3': '3.206', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.901', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:38,787][52794] DAMAGECOUNT value on done: 1028015.0 [2024-08-06 08:48:38,789][52794] Sum rewards: 83.169, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.650', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.021', 'weapon5': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'WEAPON4': '0.200', 'AMMO3': '0.215', 'weapon2': '0.394', 'WEAPON3': '1.200', 'weapon3': '3.426', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '68.000'} [2024-08-06 08:48:38,907][52666] DAMAGECOUNT value on done: 1018008.0 [2024-08-06 08:48:38,907][52666] Sum rewards: 83.825, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.350', 'AMMO5': '0.011', 'AMMO2': '0.019', 'AMMO4': '0.097', 'weapon5': '0.162', 'weapon2': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon4': '0.264', 'WEAPON3': '1.500', 'weapon3': '3.120', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.511', 'FRAGCOUNT': '70.000'} [2024-08-06 08:48:39,904][52650] Updated weights for policy 0, policy_version 87011 (0.0011) [2024-08-06 08:48:40,242][52671] Large shaping reward 2.564 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.513, 171.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:48:40,445][52803] DAMAGECOUNT value on done: 963791.0 [2024-08-06 08:48:40,448][52803] Sum rewards: 85.124, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.125', 'AMMO5': '0.009', 'AMMO2': '0.014', 'AMMO4': '0.071', 'WEAPON4': '0.100', 'weapon5': '0.110', 'AMMO3': '0.134', 'weapon2': '0.228', 'WEAPON5': '0.250', 'weapon4': '0.424', 'WEAPON3': '0.900', 'weapon3': '3.092', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.867', 'FRAGCOUNT': '66.500'} [2024-08-06 08:48:41,070][52664] DAMAGECOUNT value on done: 1057301.0 [2024-08-06 08:48:41,073][52664] Sum rewards: 84.286, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.925', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.112', 'AMMO3': '0.159', 'weapon5': '0.180', 'AMMO4': '0.183', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.050', 'weapon3': '3.176', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '66.000'} [2024-08-06 08:48:41,282][52668] DAMAGECOUNT value on done: 1013041.0 [2024-08-06 08:48:41,282][52668] Sum rewards: 84.198, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.100', 'AMMO5': '0.014', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon4': '0.208', 'weapon5': '0.218', 'AMMO3': '0.261', 'weapon2': '0.268', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.600', 'weapon3': '3.030', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.172', 'FRAGCOUNT': '70.000'} [2024-08-06 08:48:41,343][52670] DAMAGECOUNT value on done: 1008043.0 [2024-08-06 08:48:41,343][52670] Sum rewards: 80.367, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.030', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.102', 'weapon5': '0.162', 'AMMO4': '0.220', 'AMMO3': '0.237', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.144', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '67.000'} [2024-08-06 08:48:41,564][52794] DAMAGECOUNT value on done: 1031364.0 [2024-08-06 08:48:41,566][52794] Sum rewards: 70.432, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.776', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.031', 'AMMO4': '0.153', 'weapon5': '0.164', 'AMMO3': '0.178', 'weapon4': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.066', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '17.124', 'FRAGCOUNT': '57.000'} [2024-08-06 08:48:41,881][52666] DAMAGECOUNT value on done: 1009888.0 [2024-08-06 08:48:41,882][52666] Sum rewards: 79.652, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.722', 'AMMO5': '0.013', 'AMMO2': '0.020', 'AMMO4': '0.097', 'AMMO3': '0.158', 'WEAPON4': '0.200', 'weapon5': '0.242', 'weapon4': '0.304', 'WEAPON5': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.050', 'weapon3': '2.710', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.822', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:42,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 712843264. Throughput: 0: 4357.1. Samples: 178219670. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:42,795][52567] Avg episode reward: [(0, '78.079')] [2024-08-06 08:48:43,241][52820] DAMAGECOUNT value on done: 940116.0 [2024-08-06 08:48:43,241][52820] Sum rewards: 64.590, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.263', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.118', 'weapon5': '0.228', 'weapon2': '0.256', 'AMMO4': '0.273', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'HITCOUNT': '2.780', 'weapon3': '3.080', 'DAMAGECOUNT': '16.275', 'FRAGCOUNT': '57.000'} [2024-08-06 08:48:43,563][52803] DAMAGECOUNT value on done: 957330.0 [2024-08-06 08:48:43,573][52803] Sum rewards: 69.312, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.085', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon4': '0.162', 'AMMO3': '0.169', 'weapon5': '0.190', 'weapon2': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'HITCOUNT': '3.250', 'weapon3': '3.272', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '55.000'} [2024-08-06 08:48:43,906][52668] DAMAGECOUNT value on done: 1024847.0 [2024-08-06 08:48:43,909][52668] Sum rewards: 77.776, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.780', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon4': '0.148', 'AMMO3': '0.157', 'weapon5': '0.222', 'AMMO4': '0.289', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.076', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '62.000'} [2024-08-06 08:48:43,989][52664] DAMAGECOUNT value on done: 1062950.0 [2024-08-06 08:48:43,993][52664] Sum rewards: 74.498, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.608', 'AMMO5': '0.014', 'AMMO2': '0.039', 'weapon4': '0.142', 'weapon5': '0.154', 'weapon2': '0.196', 'AMMO4': '0.197', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.226', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '63.000'} [2024-08-06 08:48:44,218][52650] Updated weights for policy 0, policy_version 87021 (0.0013) [2024-08-06 08:48:44,598][52670] DAMAGECOUNT value on done: 1004475.0 [2024-08-06 08:48:44,599][52670] Sum rewards: 70.476, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.168', 'AMMO5': '0.007', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.066', 'weapon5': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.380', 'WEAPON3': '1.350', 'weapon3': '3.270', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.560', 'FRAGCOUNT': '59.000'} [2024-08-06 08:48:44,762][52794] DAMAGECOUNT value on done: 1020575.0 [2024-08-06 08:48:44,762][52794] Sum rewards: 74.313, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.531', 'AMMO5': '0.017', 'AMMO2': '0.031', 'weapon4': '0.056', 'AMMO4': '0.155', 'AMMO3': '0.217', 'weapon5': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.452', 'WEAPON3': '1.250', 'weapon3': '2.952', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.387', 'FRAGCOUNT': '61.000'} [2024-08-06 08:48:44,992][52666] DAMAGECOUNT value on done: 1012758.0 [2024-08-06 08:48:44,995][52666] Sum rewards: 83.914, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.316', 'AMMO5': '0.016', 'AMMO2': '0.027', 'weapon4': '0.056', 'AMMO4': '0.135', 'WEAPON4': '0.250', 'AMMO3': '0.259', 'weapon5': '0.288', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON3': '1.550', 'weapon3': '2.944', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.787', 'FRAGCOUNT': '69.000'} [2024-08-06 08:48:45,159][52647] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:48:46,588][52820] DAMAGECOUNT value on done: 946066.0 [2024-08-06 08:48:46,591][52820] Sum rewards: 67.632, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.816', 'AMMO5': '0.018', 'AMMO2': '0.045', 'weapon4': '0.102', 'AMMO4': '0.225', 'AMMO3': '0.243', 'weapon5': '0.266', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.602', 'WEAPON3': '1.450', 'weapon3': '2.720', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '55.000'} [2024-08-06 08:48:46,705][52803] DAMAGECOUNT value on done: 954433.0 [2024-08-06 08:48:46,707][52803] Sum rewards: 77.590, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.060', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.123', 'AMMO4': '0.133', 'weapon4': '0.166', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '0.850', 'weapon3': '2.992', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:46,708][52664] DAMAGECOUNT value on done: 1050819.0 [2024-08-06 08:48:46,712][52664] Sum rewards: 72.655, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.376', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.080', 'weapon5': '0.180', 'AMMO4': '0.191', 'AMMO3': '0.220', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.492', 'WEAPON3': '1.300', 'weapon3': '2.942', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '59.500'} [2024-08-06 08:48:46,796][52668] DAMAGECOUNT value on done: 1023739.0 [2024-08-06 08:48:46,798][52668] Sum rewards: 82.202, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.595', 'AMMO5': '0.021', 'AMMO2': '0.038', 'weapon4': '0.046', 'weapon5': '0.118', 'AMMO3': '0.187', 'AMMO4': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.436', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '66.000'} [2024-08-06 08:48:47,705][52670] DAMAGECOUNT value on done: 1003317.0 [2024-08-06 08:48:47,705][52670] Sum rewards: 71.516, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.520', 'AMMO2': '0.007', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.100', 'AMMO3': '0.185', 'WEAPON5': '0.200', 'weapon2': '0.524', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '58.000'} [2024-08-06 08:48:47,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 712933376. Throughput: 0: 4365.8. Samples: 178232880. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:47,795][52567] Avg episode reward: [(0, '77.742')] [2024-08-06 08:48:48,161][52666] DAMAGECOUNT value on done: 1014387.0 [2024-08-06 08:48:48,167][52666] Sum rewards: 78.614, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.028', 'AMMO5': '0.007', 'AMMO2': '0.015', 'WEAPON5': '0.050', 'AMMO4': '0.076', 'weapon5': '0.120', 'weapon4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.212', 'weapon2': '0.388', 'WEAPON3': '1.250', 'weapon3': '3.188', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.345', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:49,037][52650] Updated weights for policy 0, policy_version 87031 (0.0014) [2024-08-06 08:48:49,216][52664] DAMAGECOUNT value on done: 1067599.0 [2024-08-06 08:48:49,217][52664] Sum rewards: 85.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.284', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.038', 'AMMO4': '0.052', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.193', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.290', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.989', 'FRAGCOUNT': '68.000'} [2024-08-06 08:48:49,778][52820] DAMAGECOUNT value on done: 947199.0 [2024-08-06 08:48:49,780][52820] Sum rewards: 81.600, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.345', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.406', 'WEAPON3': '1.250', 'weapon3': '3.336', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '66.000'} [2024-08-06 08:48:49,849][52668] DAMAGECOUNT value on done: 1014266.0 [2024-08-06 08:48:49,849][52668] Sum rewards: 66.689, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.705', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.098', 'weapon5': '0.110', 'AMMO4': '0.174', 'weapon2': '0.234', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.450', 'HITCOUNT': '3.140', 'weapon3': '3.274', 'DAMAGECOUNT': '16.965', 'FRAGCOUNT': '57.000'} [2024-08-06 08:48:50,552][52667] DAMAGECOUNT value on done: 1015408.0 [2024-08-06 08:48:50,553][52667] Sum rewards: 59.182, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.453', 'AMMO5': '0.016', 'AMMO2': '0.028', 'weapon4': '0.056', 'AMMO4': '0.138', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'weapon5': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.674', 'WEAPON3': '1.400', 'weapon3': '2.772', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '15.423', 'FRAGCOUNT': '50.000'} [2024-08-06 08:48:50,767][52670] DAMAGECOUNT value on done: 1019658.0 [2024-08-06 08:48:50,767][52670] Sum rewards: 75.320, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.028', 'AMMO4': '0.042', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '3.288', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.998', 'FRAGCOUNT': '63.000'} [2024-08-06 08:48:51,301][52666] DAMAGECOUNT value on done: 1006353.0 [2024-08-06 08:48:51,301][52666] Sum rewards: 77.092, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.842', 'AMMO5': '0.015', 'AMMO2': '0.037', 'weapon2': '0.172', 'AMMO4': '0.183', 'weapon5': '0.228', 'AMMO3': '0.253', 'weapon4': '0.354', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.330', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:51,507][52664] DAMAGECOUNT value on done: 1060782.0 [2024-08-06 08:48:51,508][52664] Sum rewards: 76.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.080', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.060', 'AMMO4': '0.110', 'AMMO3': '0.208', 'weapon5': '0.234', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.396', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.798', 'FRAGCOUNT': '63.000'} [2024-08-06 08:48:52,744][52665] DAMAGECOUNT value on done: 1007040.0 [2024-08-06 08:48:52,746][52665] Sum rewards: 75.511, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.968', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.102', 'AMMO4': '0.131', 'AMMO3': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.304', 'WEAPON3': '1.300', 'weapon3': '3.326', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '62.000'} [2024-08-06 08:48:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 713023488. Throughput: 0: 4360.7. Samples: 178258960. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:52,795][52567] Avg episode reward: [(0, '77.360')] [2024-08-06 08:48:53,032][52668] DAMAGECOUNT value on done: 1017523.0 [2024-08-06 08:48:53,033][52668] Sum rewards: 66.662, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.556', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.096', 'AMMO4': '0.154', 'weapon5': '0.174', 'AMMO3': '0.218', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'HITCOUNT': '3.200', 'weapon3': '3.240', 'DAMAGECOUNT': '16.908', 'FRAGCOUNT': '54.000'} [2024-08-06 08:48:53,107][52820] DAMAGECOUNT value on done: 936501.0 [2024-08-06 08:48:53,108][52820] Sum rewards: 86.810, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.430', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.012', 'AMMO4': '0.027', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.166', 'AMMO3': '0.316', 'WEAPON3': '1.900', 'weapon3': '3.544', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '21.534', 'FRAGCOUNT': '75.000'} [2024-08-06 08:48:53,638][52667] DAMAGECOUNT value on done: 1036035.0 [2024-08-06 08:48:53,640][52667] Sum rewards: 73.396, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.775', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon5': '0.130', 'AMMO3': '0.189', 'weapon4': '0.210', 'weapon2': '0.222', 'AMMO4': '0.279', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'HITCOUNT': '3.130', 'weapon3': '3.162', 'DAMAGECOUNT': '17.475', 'FRAGCOUNT': '61.000'} [2024-08-06 08:48:53,848][52650] Updated weights for policy 0, policy_version 87041 (0.0011) [2024-08-06 08:48:53,943][52670] DAMAGECOUNT value on done: 1001025.0 [2024-08-06 08:48:53,943][52670] Sum rewards: 81.946, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.550', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.060', 'weapon5': '0.096', 'AMMO4': '0.145', 'weapon2': '0.250', 'AMMO3': '0.274', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.344', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.665', 'FRAGCOUNT': '72.000'} [2024-08-06 08:48:53,993][52664] DAMAGECOUNT value on done: 1050911.0 [2024-08-06 08:48:53,993][52664] Sum rewards: 71.984, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.808', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon4': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.050', 'AMMO4': '0.067', 'AMMO3': '0.185', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.440', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '60.000'} [2024-08-06 08:48:54,453][52666] DAMAGECOUNT value on done: 1020284.0 [2024-08-06 08:48:54,462][52666] Sum rewards: 75.724, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.940', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.064', 'AMMO4': '0.124', 'weapon5': '0.134', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.400', 'weapon3': '3.188', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.652', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:55,820][52665] DAMAGECOUNT value on done: 1019609.0 [2024-08-06 08:48:55,821][52665] Sum rewards: 96.472, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.555', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.044', 'WEAPON5': '0.050', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.106', 'AMMO3': '0.199', 'weapon2': '0.376', 'WEAPON3': '1.200', 'weapon3': '3.334', 'HITCOUNT': '4.470', 'DAMAGECOUNT': '23.070', 'FRAGCOUNT': '76.000'} [2024-08-06 08:48:56,155][52668] DAMAGECOUNT value on done: 1025084.0 [2024-08-06 08:48:56,158][52668] Sum rewards: 73.783, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.736', 'AMMO5': '0.015', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.180', 'AMMO3': '0.187', 'AMMO4': '0.197', 'weapon2': '0.226', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.334', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '59.500'} [2024-08-06 08:48:56,310][52820] DAMAGECOUNT value on done: 944121.0 [2024-08-06 08:48:56,310][52820] Sum rewards: 86.097, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.735', 'AMMO5': '0.019', 'AMMO2': '0.045', 'weapon4': '0.116', 'AMMO3': '0.157', 'AMMO4': '0.226', 'weapon5': '0.332', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.906', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '20.175', 'FRAGCOUNT': '67.000'} [2024-08-06 08:48:56,755][52664] DAMAGECOUNT value on done: 1052639.0 [2024-08-06 08:48:56,756][52664] Sum rewards: 86.833, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.442', 'AMMO5': '0.012', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon4': '0.122', 'AMMO3': '0.222', 'weapon5': '0.222', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.874', 'FRAGCOUNT': '71.000'} [2024-08-06 08:48:56,788][52667] DAMAGECOUNT value on done: 1029272.0 [2024-08-06 08:48:56,788][52667] Sum rewards: 69.095, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.383', 'AMMO5': '0.014', 'AMMO2': '0.037', 'weapon4': '0.064', 'weapon5': '0.132', 'AMMO4': '0.183', 'AMMO3': '0.238', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.278', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.094', 'FRAGCOUNT': '58.000'} [2024-08-06 08:48:57,082][52670] DAMAGECOUNT value on done: 1015361.0 [2024-08-06 08:48:57,083][52670] Sum rewards: 72.805, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.263', 'AMMO5': '0.012', 'AMMO2': '0.034', 'AMMO4': '0.168', 'weapon4': '0.172', 'weapon5': '0.204', 'AMMO3': '0.272', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.600', 'weapon3': '2.956', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.596', 'FRAGCOUNT': '60.500'} [2024-08-06 08:48:57,488][52666] DAMAGECOUNT value on done: 1007312.0 [2024-08-06 08:48:57,488][52666] Sum rewards: 74.935, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.290', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.152', 'weapon5': '0.212', 'weapon4': '0.218', 'AMMO4': '0.243', 'weapon2': '0.268', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.068', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '58.000'} [2024-08-06 08:48:57,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 713113600. Throughput: 0: 4355.3. Samples: 178285150. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:48:57,794][52567] Avg episode reward: [(0, '77.375')] [2024-08-06 08:48:58,224][52650] Updated weights for policy 0, policy_version 87051 (0.0041) [2024-08-06 08:48:58,626][52665] DAMAGECOUNT value on done: 1012030.0 [2024-08-06 08:48:58,627][52665] Sum rewards: 81.350, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.477', 'AMMO5': '0.014', 'AMMO2': '0.049', 'weapon4': '0.144', 'AMMO3': '0.163', 'weapon5': '0.224', 'AMMO4': '0.242', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.036', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.797', 'FRAGCOUNT': '64.000'} [2024-08-06 08:48:59,342][52668] DAMAGECOUNT value on done: 1018167.0 [2024-08-06 08:48:59,347][52668] Sum rewards: 66.160, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.035', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.136', 'WEAPON5': '0.150', 'weapon4': '0.160', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.200', 'HITCOUNT': '3.170', 'weapon3': '3.212', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '55.000'} [2024-08-06 08:48:59,559][52820] DAMAGECOUNT value on done: 930740.0 [2024-08-06 08:48:59,559][52820] Sum rewards: 68.194, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.012', 'AMMO2': '0.023', 'HEALTH': '0.047', 'weapon4': '0.070', 'AMMO4': '0.117', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.212', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.100', 'weapon3': '2.980', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '55.000'} [2024-08-06 08:48:59,646][52664] DAMAGECOUNT value on done: 1059780.0 [2024-08-06 08:48:59,646][52664] Sum rewards: 68.669, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.124', 'AMMO3': '0.173', 'WEAPON4': '0.200', 'weapon5': '0.238', 'WEAPON5': '0.250', 'weapon4': '0.266', 'weapon2': '0.452', 'HEALTH': '0.812', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.248', 'FRAGCOUNT': '55.000'} [2024-08-06 08:48:59,914][52667] DAMAGECOUNT value on done: 1032657.0 [2024-08-06 08:48:59,916][52667] Sum rewards: 77.435, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon4': '0.082', 'AMMO3': '0.188', 'weapon5': '0.236', 'AMMO4': '0.242', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.504', 'WEAPON3': '1.150', 'weapon3': '2.888', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:00,064][52670] DAMAGECOUNT value on done: 1019637.0 [2024-08-06 08:49:00,065][52670] Sum rewards: 80.415, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.683', 'AMMO5': '0.019', 'AMMO2': '0.047', 'AMMO3': '0.203', 'AMMO4': '0.234', 'weapon2': '0.238', 'weapon4': '0.258', 'weapon5': '0.354', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.300', 'weapon3': '2.858', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.947', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:00,675][52666] DAMAGECOUNT value on done: 1016601.0 [2024-08-06 08:49:00,677][52666] Sum rewards: 81.977, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.936', 'AMMO5': '0.015', 'AMMO2': '0.034', 'weapon4': '0.084', 'weapon5': '0.162', 'AMMO4': '0.170', 'AMMO3': '0.224', 'weapon2': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.250', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.622', 'FRAGCOUNT': '69.000'} [2024-08-06 08:49:01,801][52665] DAMAGECOUNT value on done: 1015745.0 [2024-08-06 08:49:01,802][52665] Sum rewards: 72.141, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.587', 'AMMO5': '0.021', 'AMMO2': '0.081', 'weapon4': '0.226', 'weapon5': '0.260', 'AMMO3': '0.324', 'AMMO4': '0.406', 'weapon2': '0.556', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.950', 'weapon3': '2.602', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '62.000'} [2024-08-06 08:49:02,174][52664] DAMAGECOUNT value on done: 1053976.0 [2024-08-06 08:49:02,175][52664] Sum rewards: 68.275, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.896', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.042', 'weapon5': '0.070', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.273', 'weapon2': '0.552', 'WEAPON3': '1.650', 'weapon3': '3.062', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.022', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:02,618][52668] DAMAGECOUNT value on done: 1017056.0 [2024-08-06 08:49:02,620][52668] Sum rewards: 65.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.856', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.050', 'weapon5': '0.082', 'AMMO4': '0.179', 'WEAPON4': '0.200', 'AMMO3': '0.219', 'weapon2': '0.276', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.220', 'weapon3': '3.354', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '55.000'} [2024-08-06 08:49:02,646][52820] DAMAGECOUNT value on done: 939651.0 [2024-08-06 08:49:02,647][52820] Sum rewards: 93.047, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.685', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.030', 'AMMO4': '0.075', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.176', 'AMMO3': '0.251', 'WEAPON3': '1.550', 'weapon3': '3.478', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '22.671', 'FRAGCOUNT': '77.000'} [2024-08-06 08:49:02,772][52667] DAMAGECOUNT value on done: 1036548.0 [2024-08-06 08:49:02,772][52667] Sum rewards: 82.450, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.754', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.082', 'AMMO4': '0.210', 'AMMO3': '0.233', 'weapon5': '0.264', 'weapon2': '0.364', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.002', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.641', 'FRAGCOUNT': '68.000'} [2024-08-06 08:49:02,794][52567] Fps is (10 sec: 17203.6, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 713195520. Throughput: 0: 4359.3. Samples: 178298180. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:49:02,794][52567] Avg episode reward: [(0, '76.972')] [2024-08-06 08:49:02,907][52670] DAMAGECOUNT value on done: 1011625.0 [2024-08-06 08:49:02,909][52670] Sum rewards: 68.393, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.902', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO4': '0.207', 'weapon2': '0.208', 'weapon4': '0.218', 'AMMO3': '0.231', 'weapon5': '0.266', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.994', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.385', 'FRAGCOUNT': '56.000'} [2024-08-06 08:49:03,194][52650] Updated weights for policy 0, policy_version 87061 (0.0013) [2024-08-06 08:49:03,426][52666] DAMAGECOUNT value on done: 999383.0 [2024-08-06 08:49:03,426][52666] Sum rewards: 78.856, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.270', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.054', 'weapon5': '0.128', 'AMMO4': '0.149', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.230', 'AMMO3': '0.274', 'WEAPON3': '1.700', 'weapon3': '3.348', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:04,837][52665] DAMAGECOUNT value on done: 995573.0 [2024-08-06 08:49:04,845][52665] Sum rewards: 78.879, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.127', 'AMMO5': '0.016', 'AMMO2': '0.055', 'weapon4': '0.152', 'AMMO3': '0.230', 'weapon5': '0.236', 'weapon2': '0.238', 'AMMO4': '0.274', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.114', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.581', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:05,089][52664] DAMAGECOUNT value on done: 1065825.0 [2024-08-06 08:49:05,091][52664] Sum rewards: 80.314, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.900', 'AMMO2': '0.009', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.052', 'AMMO3': '0.216', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '3.276', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:05,164][52649] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:49:05,261][52667] DAMAGECOUNT value on done: 1027697.0 [2024-08-06 08:49:05,261][52667] Sum rewards: 60.745, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.030', 'AMMO5': '0.008', 'AMMO2': '0.032', 'weapon5': '0.126', 'AMMO4': '0.159', 'weapon4': '0.182', 'AMMO3': '0.215', 'weapon2': '0.294', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.020', 'weapon3': '3.176', 'DAMAGECOUNT': '14.613', 'FRAGCOUNT': '51.000'} [2024-08-06 08:49:05,681][52668] DAMAGECOUNT value on done: 1009741.0 [2024-08-06 08:49:05,682][52668] Sum rewards: 87.354, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.690', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO4': '0.029', 'WEAPON4': '0.050', 'weapon5': '0.122', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.454', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '73.000'} [2024-08-06 08:49:05,780][52820] DAMAGECOUNT value on done: 941762.0 [2024-08-06 08:49:05,780][52820] Sum rewards: 73.023, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.569', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.026', 'AMMO4': '0.051', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.203', 'weapon2': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.120', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.096', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:06,031][52670] DAMAGECOUNT value on done: 997252.0 [2024-08-06 08:49:06,031][52670] Sum rewards: 72.420, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.355', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon5': '0.108', 'AMMO4': '0.175', 'weapon4': '0.186', 'AMMO3': '0.209', 'WEAPON5': '0.300', 'weapon2': '0.312', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.158', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.211', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:06,501][52666] DAMAGECOUNT value on done: 1025434.0 [2024-08-06 08:49:06,501][52666] Sum rewards: 79.738, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.896', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.090', 'AMMO4': '0.125', 'weapon2': '0.188', 'weapon5': '0.190', 'AMMO3': '0.191', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:07,246][52659] DAMAGECOUNT value on done: 1020189.0 [2024-08-06 08:49:07,246][52659] Sum rewards: 64.129, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.930', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.046', 'weapon5': '0.088', 'AMMO4': '0.106', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.350', 'HITCOUNT': '3.180', 'weapon3': '3.228', 'DAMAGECOUNT': '14.889', 'FRAGCOUNT': '55.000'} [2024-08-06 08:49:07,252][52649] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:49:07,794][52567] Fps is (10 sec: 16383.5, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 713277440. Throughput: 0: 4358.6. Samples: 178324440. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:07,795][52567] Avg episode reward: [(0, '76.604')] [2024-08-06 08:49:07,798][52667] DAMAGECOUNT value on done: 1026951.0 [2024-08-06 08:49:07,801][52667] Sum rewards: 71.275, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.811', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.060', 'weapon5': '0.126', 'AMMO4': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.206', 'AMMO3': '0.271', 'WEAPON3': '1.550', 'HITCOUNT': '3.220', 'weapon3': '3.392', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:07,839][52650] Updated weights for policy 0, policy_version 87071 (0.0023) [2024-08-06 08:49:08,103][52665] DAMAGECOUNT value on done: 997452.0 [2024-08-06 08:49:08,104][52665] Sum rewards: 76.874, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.090', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.144', 'AMMO3': '0.219', 'AMMO4': '0.248', 'weapon5': '0.252', 'weapon2': '0.262', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:08,308][52664] DAMAGECOUNT value on done: 1063237.0 [2024-08-06 08:49:08,308][52664] Sum rewards: 77.425, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.978', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.084', 'weapon5': '0.132', 'AMMO4': '0.152', 'AMMO3': '0.174', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.404', 'WEAPON3': '1.100', 'weapon3': '3.114', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:08,365][52668] DAMAGECOUNT value on done: 1010272.0 [2024-08-06 08:49:08,365][52668] Sum rewards: 77.432, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.143', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.090', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.170', 'weapon2': '0.536', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.132', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:08,920][52820] DAMAGECOUNT value on done: 948174.0 [2024-08-06 08:49:08,924][52820] Sum rewards: 74.309, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.100', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.070', 'weapon5': '0.158', 'AMMO4': '0.172', 'weapon2': '0.216', 'AMMO3': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.750', 'weapon3': '3.322', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:09,156][52670] DAMAGECOUNT value on done: 1011351.0 [2024-08-06 08:49:09,156][52670] Sum rewards: 74.350, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.320', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.104', 'weapon5': '0.132', 'AMMO4': '0.168', 'AMMO3': '0.240', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.406', 'WEAPON3': '1.500', 'weapon3': '3.122', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.306', 'FRAGCOUNT': '62.000'} [2024-08-06 08:49:09,648][52666] DAMAGECOUNT value on done: 1019686.0 [2024-08-06 08:49:09,650][52666] Sum rewards: 88.608, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.448', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.017', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.084', 'AMMO3': '0.226', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.390', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '73.000'} [2024-08-06 08:49:10,059][52659] DAMAGECOUNT value on done: 1021256.0 [2024-08-06 08:49:10,059][52659] Sum rewards: 77.870, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.077', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'AMMO4': '0.060', 'WEAPON5': '0.100', 'weapon5': '0.116', 'AMMO3': '0.217', 'weapon2': '0.298', 'WEAPON3': '1.300', 'weapon3': '3.394', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.392', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:10,156][52662] DAMAGECOUNT value on done: 1019381.0 [2024-08-06 08:49:10,157][52662] Sum rewards: 76.064, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.026', 'AMMO4': '0.059', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.336', 'WEAPON3': '1.300', 'weapon3': '3.348', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:10,664][52667] DAMAGECOUNT value on done: 1022801.0 [2024-08-06 08:49:10,665][52667] Sum rewards: 81.250, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.550', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon5': '0.106', 'weapon4': '0.124', 'AMMO4': '0.141', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON4': '0.350', 'weapon2': '0.564', 'WEAPON3': '1.500', 'weapon3': '3.006', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.140', 'FRAGCOUNT': '69.000'} [2024-08-06 08:49:10,784][52665] DAMAGECOUNT value on done: 1010125.0 [2024-08-06 08:49:10,787][52665] Sum rewards: 81.805, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.785', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.069', 'weapon5': '0.082', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon2': '0.524', 'WEAPON3': '1.350', 'weapon3': '3.148', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.406', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:11,195][52664] DAMAGECOUNT value on done: 1060939.0 [2024-08-06 08:49:11,195][52664] Sum rewards: 69.486, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.378', 'AMMO2': '0.007', 'AMMO4': '0.036', 'AMMO3': '0.264', 'weapon2': '0.504', 'WEAPON3': '1.650', 'weapon3': '3.302', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.041', 'FRAGCOUNT': '59.000'} [2024-08-06 08:49:11,608][52668] DAMAGECOUNT value on done: 1001059.0 [2024-08-06 08:49:11,610][52668] Sum rewards: 63.005, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.096', 'AMMO4': '0.185', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon5': '0.442', 'weapon2': '0.484', 'WEAPON3': '1.450', 'weapon3': '2.720', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.443', 'FRAGCOUNT': '54.000'} [2024-08-06 08:49:11,803][52670] DAMAGECOUNT value on done: 1020339.0 [2024-08-06 08:49:11,803][52670] Sum rewards: 67.708, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.297', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.090', 'weapon4': '0.136', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.228', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.305', 'FRAGCOUNT': '55.000'} [2024-08-06 08:49:12,189][52820] DAMAGECOUNT value on done: 955782.0 [2024-08-06 08:49:12,190][52820] Sum rewards: 73.890, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.955', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.082', 'weapon5': '0.160', 'weapon2': '0.184', 'AMMO4': '0.198', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.318', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:12,222][52666] DAMAGECOUNT value on done: 1018569.0 [2024-08-06 08:49:12,224][52666] Sum rewards: 75.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.474', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.113', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.342', 'WEAPON3': '1.400', 'weapon3': '3.338', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.549', 'FRAGCOUNT': '62.000'} [2024-08-06 08:49:12,568][52650] Updated weights for policy 0, policy_version 87081 (0.0013) [2024-08-06 08:49:12,788][52795] DAMAGECOUNT value on done: 940679.0 [2024-08-06 08:49:12,788][52795] Sum rewards: 87.056, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.384', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon4': '0.040', 'weapon5': '0.054', 'AMMO4': '0.134', 'AMMO3': '0.189', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.676', 'WEAPON3': '1.300', 'weapon3': '3.014', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.337', 'FRAGCOUNT': '72.000'} [2024-08-06 08:49:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 713367552. Throughput: 0: 4358.0. Samples: 178350630. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:12,794][52567] Avg episode reward: [(0, '76.557')] [2024-08-06 08:49:12,861][52659] DAMAGECOUNT value on done: 1033336.0 [2024-08-06 08:49:12,861][52659] Sum rewards: 85.592, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.324', 'AMMO5': '0.011', 'AMMO2': '0.058', 'weapon4': '0.116', 'weapon5': '0.160', 'AMMO3': '0.228', 'weapon2': '0.242', 'AMMO4': '0.291', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.131', 'FRAGCOUNT': '72.000'} [2024-08-06 08:49:13,211][52662] DAMAGECOUNT value on done: 1026607.0 [2024-08-06 08:49:13,211][52662] Sum rewards: 66.287, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.110', 'AMMO5': '0.020', 'AMMO2': '0.051', 'AMMO3': '0.210', 'weapon4': '0.240', 'AMMO4': '0.255', 'weapon2': '0.306', 'weapon5': '0.306', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.794', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.625', 'FRAGCOUNT': '56.000'} [2024-08-06 08:49:13,665][52667] DAMAGECOUNT value on done: 1028488.0 [2024-08-06 08:49:13,666][52667] Sum rewards: 73.732, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.850', 'AMMO5': '0.004', 'AMMO2': '0.004', 'AMMO4': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.160', 'AMMO3': '0.215', 'weapon2': '0.284', 'WEAPON3': '1.300', 'weapon3': '3.316', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.256', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:13,677][52664] DAMAGECOUNT value on done: 1074221.0 [2024-08-06 08:49:13,677][52664] Sum rewards: 84.084, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.504', 'AMMO2': '0.007', 'AMMO4': '0.033', 'AMMO3': '0.284', 'weapon2': '0.434', 'WEAPON3': '1.600', 'weapon3': '3.350', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.700', 'FRAGCOUNT': '71.000'} [2024-08-06 08:49:14,048][52665] DAMAGECOUNT value on done: 1009690.0 [2024-08-06 08:49:14,051][52665] Sum rewards: 82.777, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.260', 'AMMO5': '0.007', 'AMMO2': '0.009', 'weapon4': '0.016', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.212', 'AMMO3': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.534', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '70.000'} [2024-08-06 08:49:14,426][52670] DAMAGECOUNT value on done: 1015760.0 [2024-08-06 08:49:14,428][52670] Sum rewards: 82.357, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.815', 'AMMO5': '0.017', 'AMMO2': '0.037', 'AMMO4': '0.185', 'AMMO3': '0.214', 'weapon5': '0.234', 'weapon4': '0.332', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.402', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '21.270', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:14,670][52668] DAMAGECOUNT value on done: 1018448.0 [2024-08-06 08:49:14,670][52668] Sum rewards: 74.539, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.480', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.064', 'weapon5': '0.084', 'AMMO4': '0.189', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.322', 'WEAPON3': '1.700', 'weapon3': '3.232', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:14,720][52666] DAMAGECOUNT value on done: 1008912.0 [2024-08-06 08:49:14,722][52666] Sum rewards: 70.319, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.716', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.136', 'weapon4': '0.194', 'AMMO4': '0.227', 'AMMO3': '0.252', 'weapon2': '0.286', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.090', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.039', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:15,226][52820] DAMAGECOUNT value on done: 936611.0 [2024-08-06 08:49:15,235][52820] Sum rewards: 76.506, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.116', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.032', 'weapon5': '0.072', 'AMMO4': '0.128', 'weapon2': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON3': '1.300', 'HITCOUNT': '3.260', 'weapon3': '3.520', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:15,538][52659] DAMAGECOUNT value on done: 1027422.0 [2024-08-06 08:49:15,540][52659] Sum rewards: 75.907, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.860', 'AMMO5': '0.008', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.084', 'WEAPON4': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.366', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:16,074][52795] DAMAGECOUNT value on done: 934250.0 [2024-08-06 08:49:16,074][52795] Sum rewards: 84.090, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.692', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon4': '0.034', 'weapon5': '0.084', 'AMMO4': '0.087', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.227', 'weapon2': '0.368', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.965', 'FRAGCOUNT': '70.000'} [2024-08-06 08:49:16,193][52662] DAMAGECOUNT value on done: 1030640.0 [2024-08-06 08:49:16,196][52662] Sum rewards: 81.343, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.660', 'AMMO2': '0.007', 'AMMO5': '0.007', 'AMMO4': '0.036', 'weapon5': '0.082', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.154', 'AMMO3': '0.287', 'weapon2': '0.358', 'WEAPON3': '1.750', 'weapon3': '3.112', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.679', 'FRAGCOUNT': '70.000'} [2024-08-06 08:49:16,715][52667] DAMAGECOUNT value on done: 1033632.0 [2024-08-06 08:49:16,715][52667] Sum rewards: 83.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.040', 'AMMO4': '0.112', 'weapon5': '0.138', 'AMMO3': '0.225', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '21.084', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:16,894][52664] DAMAGECOUNT value on done: 1069906.0 [2024-08-06 08:49:16,894][52664] Sum rewards: 82.443, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.636', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.134', 'weapon5': '0.148', 'AMMO4': '0.173', 'AMMO3': '0.177', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.354', 'WEAPON3': '1.150', 'weapon3': '3.110', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.584', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:17,089][52665] DAMAGECOUNT value on done: 1015651.0 [2024-08-06 08:49:17,090][52665] Sum rewards: 76.407, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.380', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.153', 'weapon5': '0.164', 'weapon4': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.000', 'weapon3': '3.020', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:17,132][52650] Updated weights for policy 0, policy_version 87091 (0.0012) [2024-08-06 08:49:17,254][52670] DAMAGECOUNT value on done: 1012956.0 [2024-08-06 08:49:17,255][52670] Sum rewards: 76.732, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.954', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.036', 'weapon5': '0.136', 'AMMO4': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.274', 'WEAPON5': '0.300', 'AMMO3': '0.303', 'WEAPON3': '1.900', 'weapon3': '3.284', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:17,555][52666] DAMAGECOUNT value on done: 1005551.0 [2024-08-06 08:49:17,557][52666] Sum rewards: 79.521, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.750', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.045', 'AMMO3': '0.203', 'weapon2': '0.524', 'WEAPON3': '1.400', 'weapon3': '3.342', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:17,794][52567] Fps is (10 sec: 18023.0, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 713457664. Throughput: 0: 4367.1. Samples: 178363680. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:17,794][52567] Avg episode reward: [(0, '76.661')] [2024-08-06 08:49:17,803][52668] DAMAGECOUNT value on done: 1018002.0 [2024-08-06 08:49:17,806][52668] Sum rewards: 71.136, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.030', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.116', 'AMMO4': '0.165', 'weapon5': '0.166', 'AMMO3': '0.204', 'weapon2': '0.312', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'HITCOUNT': '3.100', 'weapon3': '3.208', 'DAMAGECOUNT': '16.950', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:18,218][52659] DAMAGECOUNT value on done: 1016892.0 [2024-08-06 08:49:18,218][52659] Sum rewards: 71.089, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.814', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.138', 'weapon5': '0.216', 'AMMO4': '0.234', 'weapon4': '0.278', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.952', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '53.500'} [2024-08-06 08:49:18,383][52820] DAMAGECOUNT value on done: 949772.0 [2024-08-06 08:49:18,383][52820] Sum rewards: 67.195, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.570', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.068', 'AMMO4': '0.119', 'weapon5': '0.136', 'weapon2': '0.194', 'WEAPON4': '0.250', 'AMMO3': '0.254', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'weapon3': '3.326', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.862', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:19,150][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:49:19,178][52664] DAMAGECOUNT value on done: 1069325.0 [2024-08-06 08:49:19,179][52664] Sum rewards: 81.635, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.970', 'AMMO5': '0.004', 'WEAPON1': '0.010', 'weapon4': '0.012', 'AMMO2': '0.012', 'weapon5': '0.038', 'AMMO4': '0.062', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.191', 'weapon2': '0.330', 'WEAPON3': '1.250', 'weapon3': '3.434', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.642', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:19,190][52662] DAMAGECOUNT value on done: 1019458.0 [2024-08-06 08:49:19,191][52662] Sum rewards: 59.142, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.510', 'AMMO5': '0.017', 'AMMO2': '0.037', 'weapon4': '0.090', 'AMMO4': '0.184', 'AMMO3': '0.214', 'weapon5': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.578', 'WEAPON3': '1.350', 'weapon3': '2.836', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.026', 'FRAGCOUNT': '49.000'} [2024-08-06 08:49:19,246][52795] DAMAGECOUNT value on done: 935677.0 [2024-08-06 08:49:19,246][52795] Sum rewards: 68.734, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.046', 'weapon5': '0.170', 'AMMO4': '0.171', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.210', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '57.000'} [2024-08-06 08:49:19,736][52667] DAMAGECOUNT value on done: 1019816.0 [2024-08-06 08:49:19,738][52667] Sum rewards: 80.508, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.335', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.040', 'AMMO4': '0.147', 'weapon5': '0.152', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'weapon2': '0.258', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.310', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:20,251][52665] DAMAGECOUNT value on done: 1006918.0 [2024-08-06 08:49:20,261][52665] Sum rewards: 73.060, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.760', 'AMMO2': '0.001', 'AMMO4': '0.007', 'AMMO5': '0.012', 'weapon4': '0.014', 'WEAPON4': '0.050', 'weapon5': '0.060', 'AMMO3': '0.177', 'WEAPON5': '0.250', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.232', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '59.000'} [2024-08-06 08:49:20,481][52666] DAMAGECOUNT value on done: 1027940.0 [2024-08-06 08:49:20,481][52666] Sum rewards: 81.186, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.850', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.030', 'AMMO4': '0.098', 'weapon5': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.304', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.863', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:20,725][52668] DAMAGECOUNT value on done: 1019346.0 [2024-08-06 08:49:20,725][52668] Sum rewards: 71.297, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.445', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.082', 'weapon5': '0.208', 'AMMO3': '0.212', 'AMMO4': '0.219', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.552', 'WEAPON3': '1.300', 'weapon3': '2.900', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:20,858][52659] DAMAGECOUNT value on done: 1022674.0 [2024-08-06 08:49:20,860][52659] Sum rewards: 68.653, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.265', 'AMMO5': '0.005', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.090', 'AMMO3': '0.120', 'weapon4': '0.144', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.372', 'WEAPON3': '0.850', 'HITCOUNT': '3.190', 'weapon3': '3.204', 'DAMAGECOUNT': '16.035', 'FRAGCOUNT': '53.000'} [2024-08-06 08:49:21,544][52820] DAMAGECOUNT value on done: 962947.0 [2024-08-06 08:49:21,545][52820] Sum rewards: 81.976, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.663', 'AMMO5': '0.009', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.128', 'AMMO3': '0.181', 'AMMO4': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.200', 'weapon3': '3.324', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.608', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:21,874][52662] DAMAGECOUNT value on done: 1036406.0 [2024-08-06 08:49:21,876][52662] Sum rewards: 81.498, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.134', 'AMMO4': '0.146', 'WEAPON5': '0.150', 'AMMO3': '0.163', 'WEAPON4': '0.200', 'HEALTH': '0.274', 'weapon4': '0.308', 'weapon2': '0.518', 'WEAPON3': '0.950', 'weapon3': '2.770', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:21,993][52650] Updated weights for policy 0, policy_version 87101 (0.0019) [2024-08-06 08:49:22,161][52664] DAMAGECOUNT value on done: 1052622.0 [2024-08-06 08:49:22,161][52664] Sum rewards: 95.666, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.843', 'AMMO2': '0.009', 'AMMO4': '0.043', 'weapon4': '0.070', 'WEAPON4': '0.100', 'AMMO3': '0.204', 'weapon2': '0.236', 'WEAPON3': '1.250', 'weapon3': '3.492', 'HITCOUNT': '4.240', 'DAMAGECOUNT': '21.615', 'FRAGCOUNT': '78.000'} [2024-08-06 08:49:22,328][52795] DAMAGECOUNT value on done: 951610.0 [2024-08-06 08:49:22,329][52795] Sum rewards: 75.531, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.585', 'AMMO5': '0.018', 'AMMO2': '0.068', 'weapon4': '0.144', 'weapon5': '0.246', 'AMMO3': '0.260', 'AMMO4': '0.338', 'weapon2': '0.376', 'WEAPON5': '0.600', 'WEAPON4': '0.700', 'WEAPON3': '1.600', 'weapon3': '2.916', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:22,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 713547776. Throughput: 0: 4370.3. Samples: 178390060. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:22,794][52567] Avg episode reward: [(0, '76.300')] [2024-08-06 08:49:22,823][52667] DAMAGECOUNT value on done: 1018469.0 [2024-08-06 08:49:22,824][52667] Sum rewards: 73.569, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.142', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.080', 'AMMO3': '0.165', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.372', 'WEAPON3': '1.150', 'weapon3': '3.330', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.854', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:22,947][52665] DAMAGECOUNT value on done: 1022300.0 [2024-08-06 08:49:22,949][52665] Sum rewards: 74.820, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.320', 'AMMO5': '0.010', 'AMMO2': '0.016', 'AMMO4': '0.081', 'weapon5': '0.088', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.120', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.754', 'FRAGCOUNT': '59.000'} [2024-08-06 08:49:23,479][52659] DAMAGECOUNT value on done: 1024569.0 [2024-08-06 08:49:23,481][52659] Sum rewards: 74.871, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.408', 'AMMO5': '0.013', 'AMMO2': '0.060', 'weapon4': '0.154', 'weapon5': '0.200', 'AMMO3': '0.287', 'AMMO4': '0.301', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.640', 'WEAPON3': '1.650', 'weapon3': '2.672', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:23,618][52666] DAMAGECOUNT value on done: 1000044.0 [2024-08-06 08:49:23,619][52666] Sum rewards: 73.917, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.154', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.047', 'weapon5': '0.090', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'weapon4': '0.212', 'weapon2': '0.424', 'WEAPON3': '1.450', 'weapon3': '3.044', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '18.360', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:23,871][52668] DAMAGECOUNT value on done: 1018096.0 [2024-08-06 08:49:23,874][52668] Sum rewards: 67.602, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.080', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.058', 'AMMO4': '0.120', 'AMMO3': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.366', 'WEAPON3': '1.150', 'HITCOUNT': '2.940', 'weapon3': '3.398', 'DAMAGECOUNT': '14.505', 'FRAGCOUNT': '57.000'} [2024-08-06 08:49:24,542][52662] DAMAGECOUNT value on done: 1014318.0 [2024-08-06 08:49:24,546][52662] Sum rewards: 85.726, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.998', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.072', 'AMMO4': '0.120', 'weapon5': '0.128', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.646', 'FRAGCOUNT': '69.000'} [2024-08-06 08:49:24,659][52820] DAMAGECOUNT value on done: 949643.0 [2024-08-06 08:49:24,664][52820] Sum rewards: 77.139, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.837', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.022', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.238', 'weapon2': '0.262', 'WEAPON3': '1.450', 'weapon3': '3.524', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.183', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:24,946][52664] DAMAGECOUNT value on done: 1056647.0 [2024-08-06 08:49:24,947][52664] Sum rewards: 83.232, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.020', 'AMMO4': '0.097', 'weapon5': '0.108', 'weapon4': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.230', 'WEAPON3': '1.450', 'weapon3': '3.346', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.386', 'FRAGCOUNT': '70.000'} [2024-08-06 08:49:25,614][52795] DAMAGECOUNT value on done: 935856.0 [2024-08-06 08:49:25,614][52795] Sum rewards: 80.286, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.212', 'AMMO5': '0.010', 'AMMO2': '0.049', 'weapon5': '0.138', 'AMMO3': '0.183', 'AMMO4': '0.244', 'WEAPON5': '0.250', 'weapon2': '0.290', 'weapon4': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.972', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:25,866][52667] DAMAGECOUNT value on done: 1029149.0 [2024-08-06 08:49:25,866][52667] Sum rewards: 56.382, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.980', 'AMMO5': '0.006', 'AMMO2': '0.031', 'weapon5': '0.070', 'weapon4': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.217', 'WEAPON4': '0.250', 'weapon2': '0.850', 'WEAPON3': '1.250', 'weapon3': '2.808', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '14.349', 'FRAGCOUNT': '46.000'} [2024-08-06 08:49:26,095][52665] DAMAGECOUNT value on done: 1015842.0 [2024-08-06 08:49:26,096][52665] Sum rewards: 75.277, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.626', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.030', 'weapon5': '0.052', 'AMMO4': '0.073', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.248', 'weapon2': '0.448', 'WEAPON3': '1.500', 'weapon3': '3.224', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.416', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:26,116][52659] DAMAGECOUNT value on done: 1022241.0 [2024-08-06 08:49:26,116][52659] Sum rewards: 67.481, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.232', 'AMMO5': '0.004', 'AMMO2': '0.017', 'weapon5': '0.022', 'weapon4': '0.072', 'AMMO4': '0.082', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.171', 'weapon2': '0.394', 'WEAPON3': '1.100', 'HITCOUNT': '3.160', 'weapon3': '3.362', 'DAMAGECOUNT': '16.329', 'FRAGCOUNT': '55.000'} [2024-08-06 08:49:26,248][52666] DAMAGECOUNT value on done: 1013579.0 [2024-08-06 08:49:26,249][52666] Sum rewards: 86.225, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.363', 'AMMO5': '0.019', 'AMMO2': '0.050', 'weapon4': '0.118', 'AMMO3': '0.218', 'weapon5': '0.242', 'AMMO4': '0.252', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.149', 'FRAGCOUNT': '71.000'} [2024-08-06 08:49:26,306][52650] Updated weights for policy 0, policy_version 87111 (0.0023) [2024-08-06 08:49:27,033][52668] DAMAGECOUNT value on done: 1023906.0 [2024-08-06 08:49:27,035][52668] Sum rewards: 70.344, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.240', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.080', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.224', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.272', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '59.000'} [2024-08-06 08:49:27,503][52662] DAMAGECOUNT value on done: 1015284.0 [2024-08-06 08:49:27,505][52662] Sum rewards: 75.129, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.231', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.094', 'AMMO3': '0.172', 'weapon5': '0.190', 'AMMO4': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.476', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '18.489', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:27,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 713629696. Throughput: 0: 4369.8. Samples: 178416310. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:27,795][52567] Avg episode reward: [(0, '76.215')] [2024-08-06 08:49:27,796][52820] DAMAGECOUNT value on done: 947487.0 [2024-08-06 08:49:27,799][52820] Sum rewards: 83.064, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.190', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.014', 'AMMO4': '0.046', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.197', 'weapon2': '0.518', 'WEAPON3': '1.150', 'weapon3': '3.228', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.073', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:28,254][52664] DAMAGECOUNT value on done: 1069592.0 [2024-08-06 08:49:28,258][52664] Sum rewards: 73.251, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.301', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.124', 'weapon4': '0.142', 'AMMO3': '0.180', 'WEAPON4': '0.200', 'weapon2': '0.204', 'WEAPON5': '0.250', 'WEAPON3': '1.100', 'HITCOUNT': '3.290', 'weapon3': '3.354', 'DAMAGECOUNT': '18.111', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:28,764][52795] DAMAGECOUNT value on done: 937337.0 [2024-08-06 08:49:28,764][52795] Sum rewards: 73.174, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.322', 'AMMO5': '0.013', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon4': '0.132', 'AMMO3': '0.162', 'weapon5': '0.292', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.770', 'WEAPON3': '1.100', 'weapon3': '2.560', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.176', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:28,872][52665] DAMAGECOUNT value on done: 1012527.0 [2024-08-06 08:49:28,873][52665] Sum rewards: 82.555, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.083', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.020', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon2': '0.130', 'AMMO3': '0.230', 'WEAPON3': '1.350', 'weapon3': '3.646', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '68.000'} [2024-08-06 08:49:28,882][52667] DAMAGECOUNT value on done: 1019748.0 [2024-08-06 08:49:28,884][52667] Sum rewards: 73.489, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.530', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO3': '0.145', 'weapon5': '0.192', 'AMMO4': '0.199', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.532', 'WEAPON3': '0.900', 'weapon3': '2.656', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '56.000'} [2024-08-06 08:49:28,959][52659] DAMAGECOUNT value on done: 1020906.0 [2024-08-06 08:49:28,960][52659] Sum rewards: 80.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.982', 'AMMO5': '0.008', 'AMMO2': '0.022', 'AMMO4': '0.109', 'weapon4': '0.116', 'weapon5': '0.140', 'weapon2': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.262', 'WEAPON3': '1.650', 'weapon3': '3.304', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.347', 'FRAGCOUNT': '68.000'} [2024-08-06 08:49:30,229][52649] DAMAGECOUNT value on done: 991789.0 [2024-08-06 08:49:30,230][52649] Sum rewards: 83.647, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.166', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.088', 'weapon5': '0.094', 'WEAPON4': '0.100', 'AMMO4': '0.104', 'AMMO3': '0.149', 'WEAPON5': '0.150', 'weapon2': '0.720', 'WEAPON3': '0.900', 'weapon3': '2.960', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:30,647][52662] DAMAGECOUNT value on done: 1036613.0 [2024-08-06 08:49:30,647][52662] Sum rewards: 65.020, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.191', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.050', 'weapon5': '0.118', 'AMMO4': '0.185', 'AMMO3': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.132', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '16.920', 'FRAGCOUNT': '56.000'} [2024-08-06 08:49:31,029][52820] DAMAGECOUNT value on done: 948970.0 [2024-08-06 08:49:31,029][52820] Sum rewards: 63.246, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'HEALTH': '0.023', 'weapon4': '0.030', 'AMMO2': '0.033', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.164', 'AMMO3': '0.209', 'weapon2': '0.354', 'WEAPON3': '1.150', 'HITCOUNT': '2.920', 'weapon3': '3.372', 'DAMAGECOUNT': '15.354', 'FRAGCOUNT': '52.000'} [2024-08-06 08:49:31,281][52650] Updated weights for policy 0, policy_version 87121 (0.0014) [2024-08-06 08:49:31,346][52665] DAMAGECOUNT value on done: 1010772.0 [2024-08-06 08:49:31,348][52665] Sum rewards: 77.758, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.044', 'AMMO4': '0.079', 'weapon4': '0.098', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.236', 'WEAPON3': '1.400', 'weapon3': '3.442', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.720', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:31,548][52659] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:49:31,588][52664] DAMAGECOUNT value on done: 1051518.0 [2024-08-06 08:49:31,588][52664] Sum rewards: 73.282, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.711', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.007', 'weapon4': '0.014', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.231', 'weapon2': '0.614', 'WEAPON3': '1.400', 'weapon3': '3.150', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.137', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:31,637][52659] DAMAGECOUNT value on done: 1030722.0 [2024-08-06 08:49:31,637][52659] Sum rewards: 64.798, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.830', 'WEAPON1': '0.010', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.169', 'AMMO3': '0.229', 'weapon4': '0.252', 'weapon5': '0.292', 'weapon2': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.810', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '16.053', 'FRAGCOUNT': '54.000'} [2024-08-06 08:49:31,942][52667] DAMAGECOUNT value on done: 1028366.0 [2024-08-06 08:49:31,942][52667] Sum rewards: 83.084, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.151', 'AMMO5': '0.020', 'AMMO2': '0.055', 'weapon2': '0.234', 'AMMO3': '0.252', 'weapon5': '0.260', 'AMMO4': '0.277', 'weapon4': '0.306', 'WEAPON5': '0.600', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '68.000'} [2024-08-06 08:49:31,958][52795] DAMAGECOUNT value on done: 951281.0 [2024-08-06 08:49:31,958][52795] Sum rewards: 74.770, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.888', 'AMMO5': '0.018', 'AMMO2': '0.039', 'AMMO4': '0.194', 'weapon5': '0.198', 'weapon2': '0.226', 'weapon4': '0.238', 'AMMO3': '0.258', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.030', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.188', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:32,628][52649] DAMAGECOUNT value on done: 984393.0 [2024-08-06 08:49:32,631][52649] Sum rewards: 77.907, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.638', 'AMMO2': '0.005', 'AMMO4': '0.023', 'WEAPON4': '0.050', 'weapon4': '0.082', 'AMMO3': '0.173', 'weapon2': '0.546', 'WEAPON3': '1.150', 'weapon3': '3.252', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:32,794][52567] Fps is (10 sec: 17202.8, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 713719808. Throughput: 0: 4361.6. Samples: 178429150. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:32,795][52567] Avg episode reward: [(0, '75.771')] [2024-08-06 08:49:33,719][52665] DAMAGECOUNT value on done: 1010116.0 [2024-08-06 08:49:33,721][52665] Sum rewards: 75.215, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.863', 'AMMO5': '0.008', 'AMMO2': '0.038', 'weapon4': '0.044', 'weapon5': '0.098', 'AMMO4': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.422', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.856', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:33,738][52660] DAMAGECOUNT value on done: 1019557.0 [2024-08-06 08:49:33,738][52660] Sum rewards: 79.253, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.044', 'AMMO5': '0.020', 'AMMO2': '0.054', 'AMMO3': '0.175', 'weapon4': '0.252', 'weapon5': '0.270', 'AMMO4': '0.272', 'weapon2': '0.286', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:33,842][52662] DAMAGECOUNT value on done: 1021032.0 [2024-08-06 08:49:33,843][52662] Sum rewards: 79.660, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.654', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.076', 'weapon4': '0.094', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.608', 'WEAPON3': '1.400', 'weapon3': '3.024', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:34,192][52820] DAMAGECOUNT value on done: 947910.0 [2024-08-06 08:49:34,194][52820] Sum rewards: 71.831, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.560', 'AMMO5': '0.011', 'AMMO2': '0.053', 'weapon4': '0.140', 'weapon5': '0.164', 'AMMO3': '0.207', 'AMMO4': '0.265', 'weapon2': '0.270', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.200', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '59.000'} [2024-08-06 08:49:34,491][52659] DAMAGECOUNT value on done: 1018747.0 [2024-08-06 08:49:34,493][52659] Sum rewards: 71.104, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.932', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.021', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'AMMO4': '0.107', 'weapon5': '0.124', 'AMMO3': '0.215', 'weapon2': '0.580', 'WEAPON3': '1.250', 'weapon3': '3.066', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.624', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:34,679][52667] DAMAGECOUNT value on done: 1034931.0 [2024-08-06 08:49:34,683][52667] Sum rewards: 79.585, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.530', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.124', 'weapon5': '0.136', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.208', 'AMMO3': '0.226', 'weapon4': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.066', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.998', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:35,075][52795] DAMAGECOUNT value on done: 943379.0 [2024-08-06 08:49:35,075][52795] Sum rewards: 84.039, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.745', 'AMMO5': '0.009', 'AMMO2': '0.044', 'weapon4': '0.050', 'weapon5': '0.174', 'AMMO3': '0.184', 'AMMO4': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.106', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:35,174][52649] DAMAGECOUNT value on done: 1001286.0 [2024-08-06 08:49:35,174][52649] Sum rewards: 73.151, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.465', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.066', 'AMMO4': '0.156', 'AMMO3': '0.171', 'weapon5': '0.234', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.378', 'WEAPON3': '1.100', 'weapon3': '3.154', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '57.000'} [2024-08-06 08:49:35,935][52650] Updated weights for policy 0, policy_version 87131 (0.0012) [2024-08-06 08:49:36,244][52820] Large shaping reward 2.619 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.597, 199.0), ('weapon3', 0.002)] [2024-08-06 08:49:36,314][52665] DAMAGECOUNT value on done: 1014282.0 [2024-08-06 08:49:36,314][52665] Sum rewards: 75.680, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.864', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.048', 'weapon5': '0.058', 'AMMO4': '0.162', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.456', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.999', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:36,667][52660] DAMAGECOUNT value on done: 1009693.0 [2024-08-06 08:49:36,667][52660] Sum rewards: 87.418, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.046', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.236', 'weapon2': '0.364', 'WEAPON3': '1.400', 'weapon3': '3.262', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.931', 'FRAGCOUNT': '73.000'} [2024-08-06 08:49:36,947][52662] DAMAGECOUNT value on done: 1025862.0 [2024-08-06 08:49:36,947][52662] Sum rewards: 72.154, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.150', 'weapon5': '0.160', 'AMMO4': '0.186', 'AMMO3': '0.208', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.460', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.872', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:37,400][52820] DAMAGECOUNT value on done: 957025.0 [2024-08-06 08:49:37,402][52820] Sum rewards: 64.724, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.056', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.179', 'WEAPON5': '0.200', 'weapon4': '0.206', 'weapon2': '0.722', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '16.071', 'FRAGCOUNT': '52.000'} [2024-08-06 08:49:37,446][52659] DAMAGECOUNT value on done: 1027902.0 [2024-08-06 08:49:37,446][52659] Sum rewards: 77.252, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.014', 'AMMO2': '0.046', 'AMMO3': '0.206', 'weapon5': '0.208', 'AMMO4': '0.228', 'weapon2': '0.290', 'weapon4': '0.380', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.820', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.810', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:37,663][52667] DAMAGECOUNT value on done: 1036733.0 [2024-08-06 08:49:37,663][52667] Sum rewards: 82.146, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.570', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon5': '0.092', 'weapon4': '0.112', 'WEAPON5': '0.200', 'AMMO4': '0.223', 'AMMO3': '0.234', 'weapon2': '0.268', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.260', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '69.000'} [2024-08-06 08:49:37,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17612.9, 300 sec: 17467.0). Total num frames: 713809920. Throughput: 0: 4367.6. Samples: 178455500. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:37,794][52567] Avg episode reward: [(0, '75.999')] [2024-08-06 08:49:37,851][52649] DAMAGECOUNT value on done: 1001969.0 [2024-08-06 08:49:37,852][52649] Sum rewards: 79.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.250', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.054', 'AMMO4': '0.109', 'weapon5': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.204', 'weapon2': '0.294', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '20.307', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:38,163][52795] DAMAGECOUNT value on done: 942881.0 [2024-08-06 08:49:38,164][52795] Sum rewards: 78.996, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.302', 'AMMO5': '0.014', 'AMMO2': '0.055', 'weapon4': '0.080', 'weapon5': '0.194', 'weapon2': '0.236', 'AMMO3': '0.248', 'AMMO4': '0.274', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.138', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:39,338][52665] DAMAGECOUNT value on done: 1008635.0 [2024-08-06 08:49:39,338][52665] Sum rewards: 81.533, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.190', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.248', 'weapon2': '0.348', 'WEAPON3': '1.600', 'weapon3': '3.302', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '20.076', 'FRAGCOUNT': '68.000'} [2024-08-06 08:49:39,568][52660] DAMAGECOUNT value on done: 1021835.0 [2024-08-06 08:49:39,569][52660] Sum rewards: 75.658, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.008', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.032', 'AMMO4': '0.140', 'weapon5': '0.178', 'WEAPON4': '0.200', 'AMMO3': '0.240', 'weapon2': '0.340', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.210', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.627', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:39,841][52662] DAMAGECOUNT value on done: 1021950.0 [2024-08-06 08:49:39,844][52662] Sum rewards: 81.651, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.390', 'AMMO5': '0.015', 'AMMO2': '0.044', 'weapon4': '0.102', 'AMMO4': '0.221', 'weapon5': '0.270', 'AMMO3': '0.294', 'weapon2': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '2.948', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '20.493', 'FRAGCOUNT': '70.000'} [2024-08-06 08:49:40,101][52667] DAMAGECOUNT value on done: 1032236.0 [2024-08-06 08:49:40,101][52667] Sum rewards: 80.995, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.270', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.066', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.272', 'WEAPON3': '1.350', 'weapon3': '3.432', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.593', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:40,470][52650] Updated weights for policy 0, policy_version 87141 (0.0014) [2024-08-06 08:49:40,567][52820] DAMAGECOUNT value on done: 957548.0 [2024-08-06 08:49:40,568][52820] Sum rewards: 80.420, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.050', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.038', 'weapon5': '0.080', 'AMMO4': '0.109', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.396', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.692', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:40,635][52659] DAMAGECOUNT value on done: 1023436.0 [2024-08-06 08:49:40,637][52659] Sum rewards: 87.305, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.472', 'AMMO5': '0.003', 'weapon5': '0.006', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.254', 'weapon2': '0.318', 'WEAPON3': '1.600', 'weapon3': '3.502', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.268', 'FRAGCOUNT': '74.000'} [2024-08-06 08:49:40,949][52649] DAMAGECOUNT value on done: 993760.0 [2024-08-06 08:49:40,957][52649] Sum rewards: 74.529, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.702', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.028', 'WEAPON4': '0.100', 'AMMO4': '0.131', 'WEAPON5': '0.150', 'weapon5': '0.168', 'AMMO3': '0.204', 'weapon2': '0.320', 'WEAPON3': '1.300', 'weapon3': '3.300', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.976', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:41,371][52795] DAMAGECOUNT value on done: 949661.0 [2024-08-06 08:49:41,373][52795] Sum rewards: 84.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.845', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.046', 'weapon5': '0.144', 'AMMO4': '0.155', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '69.000'} [2024-08-06 08:49:42,211][52665] DAMAGECOUNT value on done: 1001567.0 [2024-08-06 08:49:42,213][52665] Sum rewards: 80.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.740', 'AMMO5': '0.013', 'AMMO2': '0.037', 'AMMO4': '0.183', 'AMMO3': '0.186', 'weapon4': '0.206', 'weapon5': '0.238', 'weapon2': '0.308', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.012', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:42,589][52662] DAMAGECOUNT value on done: 1018202.0 [2024-08-06 08:49:42,592][52662] Sum rewards: 90.912, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.437', 'AMMO2': '0.001', 'AMMO4': '0.004', 'AMMO3': '0.202', 'weapon2': '0.820', 'WEAPON3': '1.250', 'weapon3': '3.032', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '74.000'} [2024-08-06 08:49:42,681][52660] DAMAGECOUNT value on done: 1033787.0 [2024-08-06 08:49:42,683][52660] Sum rewards: 73.553, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.777', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon4': '0.096', 'AMMO3': '0.194', 'weapon5': '0.206', 'AMMO4': '0.217', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.058', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.025', 'FRAGCOUNT': '59.000'} [2024-08-06 08:49:42,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 713891840. Throughput: 0: 4367.5. Samples: 178481690. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:42,795][52567] Avg episode reward: [(0, '76.805')] [2024-08-06 08:49:43,238][52614] Signal inference workers to stop experience collection... (16050 times) [2024-08-06 08:49:43,238][52614] Signal inference workers to resume experience collection... (16050 times) [2024-08-06 08:49:43,314][52650] InferenceWorker_p0-w0: stopping experience collection (16050 times) [2024-08-06 08:49:43,314][52650] InferenceWorker_p0-w0: resuming experience collection (16050 times) [2024-08-06 08:49:43,325][52667] DAMAGECOUNT value on done: 1027721.0 [2024-08-06 08:49:43,328][52667] Sum rewards: 72.009, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.985', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.156', 'AMMO3': '0.206', 'AMMO4': '0.270', 'weapon5': '0.296', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.574', 'WEAPON3': '1.250', 'weapon3': '2.694', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.864', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:43,488][52659] DAMAGECOUNT value on done: 1019828.0 [2024-08-06 08:49:43,490][52659] Sum rewards: 65.149, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.880', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.180', 'AMMO3': '0.212', 'AMMO4': '0.222', 'weapon4': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.392', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.910', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '15.222', 'FRAGCOUNT': '56.000'} [2024-08-06 08:49:43,623][52820] DAMAGECOUNT value on done: 942693.0 [2024-08-06 08:49:43,624][52820] Sum rewards: 80.132, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.570', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.076', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.198', 'weapon2': '0.334', 'WEAPON3': '1.200', 'weapon3': '3.398', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '65.000'} [2024-08-06 08:49:44,001][52649] DAMAGECOUNT value on done: 1002015.0 [2024-08-06 08:49:44,001][52649] Sum rewards: 77.993, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.112', 'AMMO5': '0.007', 'AMMO2': '0.024', 'AMMO4': '0.121', 'AMMO3': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon5': '0.150', 'weapon2': '0.270', 'weapon4': '0.398', 'WEAPON3': '0.850', 'weapon3': '2.904', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '17.382', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:44,624][52795] DAMAGECOUNT value on done: 944340.0 [2024-08-06 08:49:44,627][52795] Sum rewards: 72.151, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.470', 'AMMO5': '0.009', 'AMMO2': '0.029', 'weapon5': '0.120', 'AMMO3': '0.134', 'AMMO4': '0.143', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon4': '0.326', 'WEAPON3': '0.800', 'weapon2': '0.826', 'weapon3': '2.516', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '16.788', 'FRAGCOUNT': '56.000'} [2024-08-06 08:49:44,902][52670] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:49:45,101][52665] DAMAGECOUNT value on done: 1007994.0 [2024-08-06 08:49:45,102][52665] Sum rewards: 78.232, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.284', 'AMMO5': '0.014', 'AMMO2': '0.043', 'weapon4': '0.110', 'AMMO4': '0.214', 'weapon5': '0.214', 'AMMO3': '0.223', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.634', 'WEAPON3': '1.400', 'weapon3': '2.772', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '20.523', 'FRAGCOUNT': '62.000'} [2024-08-06 08:49:45,452][52650] Updated weights for policy 0, policy_version 87151 (0.0014) [2024-08-06 08:49:45,665][52662] DAMAGECOUNT value on done: 1013309.0 [2024-08-06 08:49:45,666][52662] Sum rewards: 77.224, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.370', 'AMMO5': '0.013', 'AMMO2': '0.034', 'AMMO4': '0.172', 'weapon2': '0.188', 'weapon4': '0.194', 'AMMO3': '0.196', 'weapon5': '0.200', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.152', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:45,969][52660] DAMAGECOUNT value on done: 1012833.0 [2024-08-06 08:49:45,977][52660] Sum rewards: 68.344, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.892', 'AMMO4': '-0.004', 'AMMO2': '-0.001', 'weapon2': '0.206', 'AMMO3': '0.212', 'WEAPON3': '1.350', 'HITCOUNT': '3.150', 'weapon3': '3.654', 'DAMAGECOUNT': '16.668', 'FRAGCOUNT': '57.000'} [2024-08-06 08:49:46,175][52659] DAMAGECOUNT value on done: 1021912.0 [2024-08-06 08:49:46,175][52659] Sum rewards: 82.426, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.590', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon4': '0.116', 'weapon5': '0.152', 'AMMO4': '0.160', 'AMMO3': '0.254', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.174', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.342', 'FRAGCOUNT': '70.000'} [2024-08-06 08:49:46,379][52667] DAMAGECOUNT value on done: 1031472.0 [2024-08-06 08:49:46,380][52667] Sum rewards: 68.001, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.894', 'AMMO5': '0.017', 'WEAPON1': '0.020', 'AMMO2': '0.040', 'weapon4': '0.122', 'weapon5': '0.188', 'AMMO4': '0.202', 'AMMO3': '0.265', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.550', 'WEAPON3': '1.650', 'weapon3': '2.828', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '59.500'} [2024-08-06 08:49:47,097][52649] DAMAGECOUNT value on done: 1001834.0 [2024-08-06 08:49:47,097][52649] Sum rewards: 74.397, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.152', 'AMMO5': '0.003', 'AMMO2': '0.003', 'weapon4': '0.012', 'AMMO4': '0.017', 'weapon5': '0.026', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.207', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '3.246', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:47,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 713981952. Throughput: 0: 4361.5. Samples: 178494450. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:47,795][52567] Avg episode reward: [(0, '76.546')] [2024-08-06 08:49:47,840][52795] DAMAGECOUNT value on done: 936381.0 [2024-08-06 08:49:47,841][52795] Sum rewards: 90.841, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.954', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.094', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.157', 'AMMO3': '0.263', 'weapon2': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.350', 'HITCOUNT': '4.270', 'DAMAGECOUNT': '22.497', 'FRAGCOUNT': '74.000'} [2024-08-06 08:49:48,232][52665] DAMAGECOUNT value on done: 1015057.0 [2024-08-06 08:49:48,233][52665] Sum rewards: 77.265, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.835', 'AMMO5': '0.026', 'AMMO2': '0.030', 'weapon4': '0.078', 'AMMO3': '0.136', 'weapon5': '0.144', 'AMMO4': '0.147', 'WEAPON4': '0.300', 'WEAPON5': '0.550', 'weapon2': '0.580', 'WEAPON3': '0.950', 'weapon3': '2.940', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.919', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:48,882][52662] DAMAGECOUNT value on done: 1025199.0 [2024-08-06 08:49:48,884][52662] Sum rewards: 73.939, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.456', 'AMMO2': '0.009', 'AMMO4': '0.045', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO3': '0.216', 'weapon2': '0.376', 'WEAPON3': '1.350', 'weapon3': '3.360', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:48,935][52660] DAMAGECOUNT value on done: 1011343.0 [2024-08-06 08:49:48,938][52660] Sum rewards: 79.680, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.687', 'AMMO5': '0.016', 'AMMO2': '0.041', 'AMMO3': '0.165', 'AMMO4': '0.206', 'weapon2': '0.210', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.462', 'WEAPON3': '1.100', 'weapon3': '2.790', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '62.000'} [2024-08-06 08:49:49,276][52659] DAMAGECOUNT value on done: 1022604.0 [2024-08-06 08:49:49,278][52659] Sum rewards: 61.269, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.598', 'WEAPON1': '0.010', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon4': '0.090', 'weapon5': '0.186', 'AMMO3': '0.234', 'AMMO4': '0.251', 'weapon2': '0.290', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.018', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.340', 'FRAGCOUNT': '52.500'} [2024-08-06 08:49:49,816][52650] Updated weights for policy 0, policy_version 87161 (0.0010) [2024-08-06 08:49:50,039][52649] DAMAGECOUNT value on done: 998558.0 [2024-08-06 08:49:50,039][52649] Sum rewards: 79.232, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.278', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.080', 'weapon2': '0.184', 'AMMO4': '0.198', 'weapon5': '0.202', 'AMMO3': '0.285', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.288', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.987', 'FRAGCOUNT': '68.000'} [2024-08-06 08:49:50,982][52795] DAMAGECOUNT value on done: 942703.0 [2024-08-06 08:49:50,990][52795] Sum rewards: 74.512, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.408', 'AMMO5': '0.004', 'AMMO2': '0.012', 'weapon4': '0.016', 'weapon5': '0.036', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.185', 'weapon2': '0.386', 'WEAPON3': '1.150', 'weapon3': '3.408', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:51,111][52811] DAMAGECOUNT value on done: 964608.0 [2024-08-06 08:49:51,112][52811] Sum rewards: 72.074, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.195', 'AMMO5': '0.011', 'AMMO2': '0.046', 'weapon4': '0.114', 'AMMO3': '0.178', 'weapon5': '0.188', 'AMMO4': '0.230', 'weapon2': '0.268', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.256', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.238', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:51,626][52660] DAMAGECOUNT value on done: 1016784.0 [2024-08-06 08:49:51,626][52660] Sum rewards: 82.715, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.150', 'AMMO5': '0.008', 'AMMO2': '0.051', 'weapon5': '0.106', 'AMMO3': '0.153', 'WEAPON5': '0.200', 'AMMO4': '0.257', 'weapon4': '0.404', 'WEAPON4': '0.450', 'weapon2': '0.510', 'WEAPON3': '1.100', 'weapon3': '2.734', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.861', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:52,078][52662] DAMAGECOUNT value on done: 1017490.0 [2024-08-06 08:49:52,079][52662] Sum rewards: 86.861, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.205', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.024', 'weapon4': '0.040', 'AMMO4': '0.119', 'weapon5': '0.154', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'weapon2': '0.344', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.192', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '21.147', 'FRAGCOUNT': '70.000'} [2024-08-06 08:49:52,377][52659] DAMAGECOUNT value on done: 1034588.0 [2024-08-06 08:49:52,380][52659] Sum rewards: 88.901, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.090', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.151', 'weapon4': '0.160', 'weapon2': '0.190', 'AMMO3': '0.243', 'WEAPON4': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.288', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.713', 'FRAGCOUNT': '75.000'} [2024-08-06 08:49:52,794][52567] Fps is (10 sec: 18022.8, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 714072064. Throughput: 0: 4366.7. Samples: 178520940. Policy #0 lag: (min: 0.0, avg: 3.3, max: 8.0) [2024-08-06 08:49:52,795][52567] Avg episode reward: [(0, '76.657')] [2024-08-06 08:49:53,409][52649] DAMAGECOUNT value on done: 992919.0 [2024-08-06 08:49:53,409][52649] Sum rewards: 70.461, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.935', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon5': '0.090', 'AMMO4': '0.097', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'weapon2': '0.274', 'WEAPON4': '0.300', 'weapon4': '0.340', 'WEAPON3': '1.450', 'weapon3': '3.038', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:53,978][52671] DAMAGECOUNT value on done: 1028010.0 [2024-08-06 08:49:53,980][52671] Sum rewards: 85.468, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.009', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.116', 'weapon4': '0.160', 'weapon2': '0.194', 'AMMO3': '0.205', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.338', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.899', 'FRAGCOUNT': '71.000'} [2024-08-06 08:49:54,210][52811] DAMAGECOUNT value on done: 951032.0 [2024-08-06 08:49:54,211][52811] Sum rewards: 82.122, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.300', 'AMMO5': '0.010', 'AMMO2': '0.044', 'weapon4': '0.074', 'weapon5': '0.176', 'AMMO3': '0.181', 'AMMO4': '0.218', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.160', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '66.000'} [2024-08-06 08:49:54,288][52795] DAMAGECOUNT value on done: 948518.0 [2024-08-06 08:49:54,288][52795] Sum rewards: 71.950, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.440', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.040', 'AMMO4': '0.089', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.238', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.362', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:54,665][52662] DAMAGECOUNT value on done: 1034121.0 [2024-08-06 08:49:54,667][52662] Sum rewards: 75.060, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.042', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon4': '0.080', 'weapon5': '0.176', 'AMMO4': '0.223', 'AMMO3': '0.309', 'weapon2': '0.334', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.094', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '64.000'} [2024-08-06 08:49:54,693][52660] DAMAGECOUNT value on done: 1024505.0 [2024-08-06 08:49:54,695][52660] Sum rewards: 82.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.720', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.082', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.190', 'weapon4': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.200', 'weapon3': '3.142', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '67.000'} [2024-08-06 08:49:54,974][52650] Updated weights for policy 0, policy_version 87171 (0.0026) [2024-08-06 08:49:55,082][52659] DAMAGECOUNT value on done: 1013693.0 [2024-08-06 08:49:55,083][52659] Sum rewards: 68.744, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.400', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon5': '0.080', 'AMMO4': '0.118', 'weapon4': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.216', 'AMMO3': '0.238', 'WEAPON3': '1.400', 'HITCOUNT': '3.320', 'weapon3': '3.336', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:56,450][52649] DAMAGECOUNT value on done: 990945.0 [2024-08-06 08:49:56,452][52649] Sum rewards: 74.806, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.940', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.036', 'weapon5': '0.092', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.183', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '3.164', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '60.000'} [2024-08-06 08:49:57,265][52811] DAMAGECOUNT value on done: 945013.0 [2024-08-06 08:49:57,266][52811] Sum rewards: 64.119, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.002', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.054', 'AMMO4': '0.129', 'weapon5': '0.162', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '54.000'} [2024-08-06 08:49:57,296][52671] DAMAGECOUNT value on done: 1033028.0 [2024-08-06 08:49:57,297][52671] Sum rewards: 74.268, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.961', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.032', 'weapon5': '0.092', 'AMMO4': '0.158', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.230', 'WEAPON4': '0.300', 'weapon2': '0.312', 'WEAPON3': '1.200', 'weapon3': '3.092', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '63.000'} [2024-08-06 08:49:57,425][52795] DAMAGECOUNT value on done: 931960.0 [2024-08-06 08:49:57,426][52795] Sum rewards: 64.596, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.214', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon2': '0.166', 'weapon5': '0.172', 'AMMO4': '0.175', 'AMMO3': '0.272', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.600', 'HITCOUNT': '3.200', 'weapon3': '3.346', 'DAMAGECOUNT': '15.930', 'FRAGCOUNT': '57.000'} [2024-08-06 08:49:57,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 714153984. Throughput: 0: 4359.6. Samples: 178546810. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:49:57,794][52567] Avg episode reward: [(0, '76.500')] [2024-08-06 08:49:57,858][52660] DAMAGECOUNT value on done: 1012464.0 [2024-08-06 08:49:57,863][52660] Sum rewards: 72.139, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.376', 'AMMO5': '0.014', 'AMMO2': '0.044', 'weapon5': '0.116', 'weapon4': '0.182', 'AMMO3': '0.197', 'AMMO4': '0.219', 'weapon2': '0.324', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.200', 'HITCOUNT': '3.110', 'weapon3': '3.180', 'DAMAGECOUNT': '15.879', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:57,923][52662] DAMAGECOUNT value on done: 1021836.0 [2024-08-06 08:49:57,923][52662] Sum rewards: 77.446, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.127', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.187', 'HEALTH': '0.490', 'weapon2': '0.542', 'WEAPON3': '1.000', 'weapon3': '3.148', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '61.000'} [2024-08-06 08:49:58,342][52659] DAMAGECOUNT value on done: 1027898.0 [2024-08-06 08:49:58,343][52659] Sum rewards: 70.788, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.010', 'AMMO5': '0.011', 'AMMO2': '0.030', 'AMMO4': '0.148', 'weapon5': '0.162', 'weapon4': '0.178', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.930', 'weapon3': '3.134', 'DAMAGECOUNT': '16.287', 'FRAGCOUNT': '58.000'} [2024-08-06 08:49:59,663][52649] DAMAGECOUNT value on done: 1006190.0 [2024-08-06 08:49:59,664][52649] Sum rewards: 80.503, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.926', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.096', 'AMMO4': '0.098', 'WEAPON4': '0.100', 'weapon5': '0.120', 'WEAPON5': '0.150', 'AMMO3': '0.166', 'weapon2': '0.616', 'WEAPON3': '1.050', 'weapon3': '2.988', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.540', 'FRAGCOUNT': '63.500'} [2024-08-06 08:49:59,669][52650] Updated weights for policy 0, policy_version 87181 (0.0011) [2024-08-06 08:50:00,087][52647] DAMAGECOUNT value on done: 1089021.0 [2024-08-06 08:50:00,088][52647] Sum rewards: 71.947, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.480', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon5': '0.158', 'AMMO3': '0.170', 'AMMO4': '0.202', 'WEAPON5': '0.250', 'weapon4': '0.272', 'WEAPON4': '0.350', 'weapon2': '0.512', 'WEAPON3': '1.050', 'weapon3': '2.832', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.261', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:00,199][52671] DAMAGECOUNT value on done: 1027376.0 [2024-08-06 08:50:00,199][52671] Sum rewards: 67.500, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.275', 'AMMO5': '0.003', 'weapon4': '0.006', 'weapon5': '0.022', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.120', 'AMMO3': '0.230', 'weapon2': '0.332', 'WEAPON3': '1.450', 'HITCOUNT': '3.280', 'weapon3': '3.462', 'DAMAGECOUNT': '17.247', 'FRAGCOUNT': '57.000'} [2024-08-06 08:50:00,344][52811] DAMAGECOUNT value on done: 952349.0 [2024-08-06 08:50:00,345][52811] Sum rewards: 82.527, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.440', 'AMMO5': '0.003', 'weapon4': '0.016', 'weapon5': '0.024', 'AMMO2': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.178', 'AMMO3': '0.225', 'weapon2': '0.340', 'WEAPON3': '1.350', 'weapon3': '3.448', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.239', 'FRAGCOUNT': '70.000'} [2024-08-06 08:50:00,590][52795] DAMAGECOUNT value on done: 945959.0 [2024-08-06 08:50:00,591][52795] Sum rewards: 64.651, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.420', 'AMMO5': '0.021', 'AMMO2': '0.058', 'weapon4': '0.102', 'weapon5': '0.138', 'AMMO3': '0.187', 'AMMO4': '0.292', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.514', 'WEAPON3': '1.200', 'weapon3': '2.992', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '16.176', 'FRAGCOUNT': '54.000'} [2024-08-06 08:50:00,639][52662] DAMAGECOUNT value on done: 1011387.0 [2024-08-06 08:50:00,643][52662] Sum rewards: 77.971, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.230', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.136', 'AMMO4': '0.144', 'weapon2': '0.230', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.800', 'weapon3': '3.356', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.110', 'FRAGCOUNT': '67.000'} [2024-08-06 08:50:01,115][52660] DAMAGECOUNT value on done: 1010267.0 [2024-08-06 08:50:01,124][52660] Sum rewards: 64.200, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.200', 'AMMO5': '0.010', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.159', 'AMMO3': '0.162', 'weapon5': '0.178', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.916', 'WEAPON3': '1.000', 'weapon3': '2.556', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '50.000'} [2024-08-06 08:50:01,278][52659] DAMAGECOUNT value on done: 1020124.0 [2024-08-06 08:50:01,278][52659] Sum rewards: 70.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.200', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.126', 'AMMO4': '0.149', 'WEAPON4': '0.150', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.350', 'weapon3': '3.334', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.155', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:02,697][52647] DAMAGECOUNT value on done: 1078218.0 [2024-08-06 08:50:02,698][52647] Sum rewards: 93.018, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.392', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.204', 'weapon2': '0.380', 'WEAPON3': '1.300', 'weapon3': '3.374', 'HITCOUNT': '4.460', 'DAMAGECOUNT': '21.264', 'FRAGCOUNT': '76.000'} [2024-08-06 08:50:02,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 714235904. Throughput: 0: 4362.7. Samples: 178560000. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:02,794][52567] Avg episode reward: [(0, '76.168')] [2024-08-06 08:50:02,814][52649] DAMAGECOUNT value on done: 1011616.0 [2024-08-06 08:50:02,815][52649] Sum rewards: 72.966, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.158', 'AMMO5': '0.010', 'AMMO2': '0.058', 'weapon4': '0.130', 'AMMO3': '0.183', 'weapon5': '0.196', 'weapon2': '0.252', 'AMMO4': '0.290', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.182', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.673', 'FRAGCOUNT': '59.000'} [2024-08-06 08:50:03,298][52671] DAMAGECOUNT value on done: 1034852.0 [2024-08-06 08:50:03,298][52671] Sum rewards: 75.780, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.278', 'AMMO5': '0.023', 'AMMO2': '0.055', 'weapon4': '0.208', 'AMMO3': '0.213', 'weapon5': '0.272', 'AMMO4': '0.273', 'weapon2': '0.528', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.692', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:03,514][52811] DAMAGECOUNT value on done: 955858.0 [2024-08-06 08:50:03,515][52811] Sum rewards: 78.322, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.330', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.132', 'AMMO4': '0.154', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon4': '0.252', 'WEAPON4': '0.300', 'weapon2': '0.524', 'WEAPON3': '1.200', 'weapon3': '2.720', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.470', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:03,624][52660] DAMAGECOUNT value on done: 1018330.0 [2024-08-06 08:50:03,626][52660] Sum rewards: 71.187, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.166', 'AMMO5': '0.005', 'weapon4': '0.020', 'AMMO2': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.120', 'AMMO4': '0.141', 'AMMO3': '0.220', 'weapon2': '0.444', 'WEAPON3': '1.400', 'weapon3': '3.282', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '59.000'} [2024-08-06 08:50:03,685][52662] DAMAGECOUNT value on done: 1019741.0 [2024-08-06 08:50:03,687][52662] Sum rewards: 79.106, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.550', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.120', 'AMMO3': '0.227', 'weapon5': '0.256', 'AMMO4': '0.272', 'weapon2': '0.272', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.962', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '20.043', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:03,748][52795] DAMAGECOUNT value on done: 943693.0 [2024-08-06 08:50:03,750][52795] Sum rewards: 73.801, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.636', 'AMMO5': '0.010', 'weapon4': '0.014', 'AMMO2': '0.018', 'AMMO4': '0.091', 'WEAPON4': '0.100', 'AMMO3': '0.173', 'weapon5': '0.198', 'WEAPON5': '0.200', 'weapon2': '0.474', 'WEAPON3': '1.050', 'weapon3': '3.096', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '59.500'} [2024-08-06 08:50:03,959][52650] Updated weights for policy 0, policy_version 87191 (0.0028) [2024-08-06 08:50:05,329][52647] DAMAGECOUNT value on done: 1081094.0 [2024-08-06 08:50:05,330][52647] Sum rewards: 81.718, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.494', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO4': '0.140', 'WEAPON4': '0.150', 'AMMO3': '0.166', 'weapon5': '0.194', 'weapon2': '0.354', 'WEAPON5': '0.400', 'WEAPON3': '1.050', 'weapon3': '3.146', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.953', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:05,878][52649] DAMAGECOUNT value on done: 1002011.0 [2024-08-06 08:50:05,881][52649] Sum rewards: 65.145, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.007', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.174', 'weapon5': '0.196', 'weapon2': '0.448', 'WEAPON3': '1.150', 'weapon3': '3.136', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '16.272', 'FRAGCOUNT': '53.500'} [2024-08-06 08:50:06,226][52660] DAMAGECOUNT value on done: 1012949.0 [2024-08-06 08:50:06,233][52660] Sum rewards: 67.857, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.560', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.066', 'weapon5': '0.116', 'AMMO4': '0.127', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.406', 'WEAPON3': '1.200', 'weapon3': '3.062', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.079', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:06,387][52671] DAMAGECOUNT value on done: 1040427.0 [2024-08-06 08:50:06,388][52671] Sum rewards: 75.496, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.438', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.186', 'weapon5': '0.190', 'weapon4': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.372', 'WEAPON3': '1.100', 'weapon3': '2.880', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:06,416][52662] DAMAGECOUNT value on done: 1014413.0 [2024-08-06 08:50:06,416][52662] Sum rewards: 84.140, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.300', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.048', 'AMMO4': '0.052', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.256', 'weapon2': '0.342', 'WEAPON3': '1.500', 'weapon3': '3.364', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '20.610', 'FRAGCOUNT': '70.000'} [2024-08-06 08:50:06,612][52811] DAMAGECOUNT value on done: 971376.0 [2024-08-06 08:50:06,613][52811] Sum rewards: 74.322, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.768', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.070', 'AMMO4': '0.142', 'weapon5': '0.174', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.164', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:06,763][52669] DAMAGECOUNT value on done: 1020630.0 [2024-08-06 08:50:06,765][52669] Sum rewards: 77.318, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.451', 'AMMO5': '0.006', 'AMMO2': '0.020', 'weapon4': '0.034', 'weapon5': '0.070', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.792', 'WEAPON3': '1.200', 'weapon3': '2.928', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.555', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:06,810][52795] DAMAGECOUNT value on done: 930862.0 [2024-08-06 08:50:06,810][52795] Sum rewards: 77.727, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.668', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.018', 'weapon5': '0.038', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.051', 'AMMO3': '0.195', 'weapon2': '0.382', 'WEAPON3': '1.200', 'weapon3': '3.386', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:07,703][52647] DAMAGECOUNT value on done: 1080060.0 [2024-08-06 08:50:07,705][52647] Sum rewards: 84.748, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.134', 'AMMO5': '0.015', 'AMMO2': '0.047', 'AMMO3': '0.153', 'weapon5': '0.182', 'AMMO4': '0.233', 'weapon4': '0.244', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.982', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.623', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.4, 300 sec: 17439.2). Total num frames: 714326016. Throughput: 0: 4358.9. Samples: 178586210. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:07,794][52567] Avg episode reward: [(0, '76.265')] [2024-08-06 08:50:08,939][52658] DAMAGECOUNT value on done: 1028136.0 [2024-08-06 08:50:08,939][52658] Sum rewards: 88.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.094', 'AMMO5': '0.011', 'AMMO2': '0.050', 'weapon2': '0.160', 'weapon5': '0.164', 'AMMO3': '0.193', 'weapon4': '0.228', 'AMMO4': '0.252', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.184', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.358', 'FRAGCOUNT': '73.000'} [2024-08-06 08:50:09,020][52649] DAMAGECOUNT value on done: 1003987.0 [2024-08-06 08:50:09,022][52649] Sum rewards: 97.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.828', 'AMMO5': '0.005', 'AMMO2': '0.010', 'AMMO4': '0.049', 'weapon4': '0.070', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.214', 'weapon2': '0.240', 'WEAPON3': '1.350', 'weapon3': '3.386', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '23.217', 'FRAGCOUNT': '79.000'} [2024-08-06 08:50:09,076][52650] Updated weights for policy 0, policy_version 87201 (0.0039) [2024-08-06 08:50:09,384][52671] DAMAGECOUNT value on done: 1030700.0 [2024-08-06 08:50:09,387][52671] Sum rewards: 84.701, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.278', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.058', 'AMMO4': '0.125', 'weapon5': '0.168', 'AMMO3': '0.197', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.270', 'WEAPON3': '1.250', 'weapon3': '3.244', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.331', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:09,443][52660] DAMAGECOUNT value on done: 1013943.0 [2024-08-06 08:50:09,445][52660] Sum rewards: 71.134, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.270', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.046', 'weapon4': '0.060', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'AMMO3': '0.262', 'weapon2': '0.358', 'WEAPON3': '1.650', 'weapon3': '3.300', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.735', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:09,472][52669] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:50:09,783][52669] DAMAGECOUNT value on done: 1020823.0 [2024-08-06 08:50:09,785][52669] Sum rewards: 71.897, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.016', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon5': '0.210', 'AMMO4': '0.220', 'AMMO3': '0.221', 'weapon4': '0.228', 'weapon2': '0.256', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.971', 'FRAGCOUNT': '59.000'} [2024-08-06 08:50:09,799][52811] DAMAGECOUNT value on done: 959307.0 [2024-08-06 08:50:09,801][52811] Sum rewards: 76.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.998', 'AMMO5': '0.003', 'AMMO2': '0.005', 'weapon4': '0.014', 'AMMO4': '0.026', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.249', 'weapon2': '0.304', 'WEAPON3': '1.500', 'weapon3': '3.440', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.936', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:09,931][52795] DAMAGECOUNT value on done: 940940.0 [2024-08-06 08:50:09,931][52795] Sum rewards: 77.046, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.088', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.104', 'AMMO4': '0.221', 'weapon5': '0.232', 'weapon2': '0.236', 'AMMO3': '0.252', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.118', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.380', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:10,363][52647] DAMAGECOUNT value on done: 1090625.0 [2024-08-06 08:50:10,366][52647] Sum rewards: 87.934, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.191', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon4': '0.160', 'weapon5': '0.204', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'weapon2': '0.296', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.110', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '21.060', 'FRAGCOUNT': '72.000'} [2024-08-06 08:50:10,702][52794] Large shaping reward 2.740 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0)] [2024-08-06 08:50:11,489][52649] DAMAGECOUNT value on done: 991137.0 [2024-08-06 08:50:11,490][52649] Sum rewards: 78.156, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.008', 'AMMO5': '0.012', 'AMMO2': '0.049', 'weapon4': '0.102', 'weapon5': '0.154', 'AMMO3': '0.176', 'weapon2': '0.226', 'AMMO4': '0.243', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.322', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '63.000'} [2024-08-06 08:50:11,942][52658] DAMAGECOUNT value on done: 1028685.0 [2024-08-06 08:50:11,942][52658] Sum rewards: 79.111, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.140', 'AMMO5': '0.015', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.159', 'weapon2': '0.184', 'weapon5': '0.214', 'weapon4': '0.400', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:12,148][52671] DAMAGECOUNT value on done: 1027136.0 [2024-08-06 08:50:12,149][52671] Sum rewards: 80.470, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.977', 'AMMO5': '0.003', 'AMMO2': '0.018', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.091', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.196', 'weapon2': '0.356', 'WEAPON3': '1.200', 'weapon3': '3.272', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '65.000'} [2024-08-06 08:50:12,304][52660] DAMAGECOUNT value on done: 1021676.0 [2024-08-06 08:50:12,304][52660] Sum rewards: 66.017, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.015', 'AMMO2': '0.007', 'AMMO5': '0.009', 'AMMO4': '0.032', 'weapon5': '0.092', 'WEAPON5': '0.100', 'AMMO3': '0.221', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '3.208', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.419', 'FRAGCOUNT': '56.500'} [2024-08-06 08:50:12,707][52669] DAMAGECOUNT value on done: 1028576.0 [2024-08-06 08:50:12,708][52669] Sum rewards: 82.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.446', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.058', 'WEAPON4': '0.100', 'weapon5': '0.138', 'WEAPON5': '0.150', 'AMMO3': '0.218', 'weapon2': '0.506', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.480', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:12,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 714416128. Throughput: 0: 4351.3. Samples: 178612120. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:12,794][52567] Avg episode reward: [(0, '76.948')] [2024-08-06 08:50:12,890][52811] DAMAGECOUNT value on done: 950111.0 [2024-08-06 08:50:12,891][52811] Sum rewards: 75.580, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'weapon5': '0.132', 'AMMO3': '0.182', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.150', 'weapon3': '3.260', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:13,073][52795] DAMAGECOUNT value on done: 950457.0 [2024-08-06 08:50:13,075][52795] Sum rewards: 70.056, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.216', 'AMMO5': '0.007', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.070', 'weapon5': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.170', 'WEAPON5': '0.200', 'weapon2': '0.334', 'WEAPON3': '1.100', 'HITCOUNT': '3.150', 'weapon3': '3.340', 'DAMAGECOUNT': '17.076', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:13,346][52650] Updated weights for policy 0, policy_version 87211 (0.0016) [2024-08-06 08:50:13,465][52820] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:50:13,521][52647] DAMAGECOUNT value on done: 1083168.0 [2024-08-06 08:50:13,521][52647] Sum rewards: 74.674, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.956', 'AMMO5': '0.022', 'AMMO2': '0.058', 'AMMO3': '0.234', 'weapon4': '0.250', 'AMMO4': '0.292', 'weapon5': '0.344', 'weapon2': '0.348', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.400', 'weapon3': '2.680', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:14,490][52649] DAMAGECOUNT value on done: 1007485.0 [2024-08-06 08:50:14,491][52649] Sum rewards: 87.064, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.920', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon5': '0.138', 'weapon4': '0.184', 'AMMO3': '0.204', 'weapon2': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO4': '0.298', 'WEAPON3': '1.400', 'weapon3': '3.234', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '21.216', 'FRAGCOUNT': '72.000'} [2024-08-06 08:50:14,945][52658] DAMAGECOUNT value on done: 1029312.0 [2024-08-06 08:50:14,948][52658] Sum rewards: 74.747, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.762', 'AMMO5': '0.008', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.138', 'weapon5': '0.146', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.350', 'weapon3': '3.152', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:15,090][52671] DAMAGECOUNT value on done: 1034041.0 [2024-08-06 08:50:15,090][52671] Sum rewards: 69.241, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.484', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.086', 'weapon5': '0.190', 'AMMO3': '0.227', 'AMMO4': '0.255', 'weapon2': '0.482', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '2.896', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:15,222][52669] DAMAGECOUNT value on done: 1023195.0 [2024-08-06 08:50:15,222][52669] Sum rewards: 65.838, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.148', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.030', 'AMMO4': '0.061', 'weapon5': '0.074', 'AMMO3': '0.147', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.890', 'WEAPON3': '0.950', 'weapon3': '2.876', 'HITCOUNT': '2.980', 'DAMAGECOUNT': '15.660', 'FRAGCOUNT': '52.000'} [2024-08-06 08:50:15,433][52660] DAMAGECOUNT value on done: 1038669.0 [2024-08-06 08:50:15,435][52660] Sum rewards: 71.595, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.716', 'AMMO5': '0.018', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.146', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'weapon2': '0.278', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.362', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '59.500'} [2024-08-06 08:50:16,025][52811] DAMAGECOUNT value on done: 953955.0 [2024-08-06 08:50:16,025][52811] Sum rewards: 64.889, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.916', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.044', 'weapon5': '0.082', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.186', 'weapon2': '0.702', 'WEAPON3': '1.100', 'weapon3': '2.962', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '14.649', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:16,196][52647] DAMAGECOUNT value on done: 1083862.0 [2024-08-06 08:50:16,196][52647] Sum rewards: 72.785, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.352', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.073', 'weapon5': '0.096', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.189', 'weapon2': '0.338', 'WEAPON3': '1.100', 'weapon3': '3.388', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '58.000'} [2024-08-06 08:50:17,326][52649] DAMAGECOUNT value on done: 983734.0 [2024-08-06 08:50:17,327][52649] Sum rewards: 75.007, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.009', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.081', 'weapon5': '0.110', 'WEAPON4': '0.150', 'AMMO3': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.628', 'WEAPON3': '1.150', 'weapon3': '3.056', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:17,712][52658] DAMAGECOUNT value on done: 1025048.0 [2024-08-06 08:50:17,713][52658] Sum rewards: 73.662, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.090', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.052', 'weapon5': '0.084', 'AMMO3': '0.165', 'AMMO4': '0.180', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.522', 'WEAPON3': '1.150', 'weapon3': '3.164', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:17,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 714506240. Throughput: 0: 4351.4. Samples: 178624960. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:17,794][52567] Avg episode reward: [(0, '76.561')] [2024-08-06 08:50:17,805][52669] DAMAGECOUNT value on done: 1030653.0 [2024-08-06 08:50:17,806][52669] Sum rewards: 77.477, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.360', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.086', 'weapon5': '0.164', 'AMMO4': '0.198', 'AMMO3': '0.222', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.525', 'FRAGCOUNT': '65.000'} [2024-08-06 08:50:18,042][52650] Updated weights for policy 0, policy_version 87221 (0.0036) [2024-08-06 08:50:18,108][52671] DAMAGECOUNT value on done: 1013595.0 [2024-08-06 08:50:18,109][52671] Sum rewards: 76.968, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.835', 'AMMO5': '0.011', 'AMMO2': '0.027', 'weapon5': '0.084', 'weapon4': '0.098', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'weapon2': '0.246', 'AMMO3': '0.254', 'WEAPON4': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.322', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '65.000'} [2024-08-06 08:50:18,780][52660] DAMAGECOUNT value on done: 1015968.0 [2024-08-06 08:50:18,784][52660] Sum rewards: 84.839, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.031', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.128', 'weapon5': '0.130', 'AMMO4': '0.176', 'WEAPON5': '0.200', 'weapon2': '0.224', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.306', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.807', 'FRAGCOUNT': '71.000'} [2024-08-06 08:50:19,274][52647] DAMAGECOUNT value on done: 1062305.0 [2024-08-06 08:50:19,274][52647] Sum rewards: 72.307, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.612', 'AMMO5': '0.014', 'AMMO2': '0.032', 'AMMO4': '0.157', 'weapon4': '0.166', 'weapon5': '0.218', 'AMMO3': '0.223', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.450', 'weapon3': '3.016', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:19,281][52811] DAMAGECOUNT value on done: 956273.0 [2024-08-06 08:50:19,283][52811] Sum rewards: 68.688, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.516', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.136', 'weapon2': '0.220', 'AMMO3': '0.231', 'WEAPON5': '0.250', 'weapon4': '0.274', 'WEAPON4': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.102', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '14.793', 'FRAGCOUNT': '59.000'} [2024-08-06 08:50:19,685][52649] DAMAGECOUNT value on done: 1005251.0 [2024-08-06 08:50:19,685][52649] Sum rewards: 74.512, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.300', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.146', 'AMMO3': '0.229', 'AMMO4': '0.267', 'weapon5': '0.268', 'weapon2': '0.270', 'WEAPON5': '0.450', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '2.966', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:20,444][52658] DAMAGECOUNT value on done: 1019130.0 [2024-08-06 08:50:20,444][52658] Sum rewards: 78.739, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.700', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.108', 'AMMO3': '0.155', 'AMMO4': '0.183', 'WEAPON4': '0.200', 'weapon5': '0.216', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.074', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.120', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:20,537][52669] DAMAGECOUNT value on done: 1028066.0 [2024-08-06 08:50:20,537][52669] Sum rewards: 72.236, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.016', 'AMMO2': '0.047', 'weapon4': '0.106', 'AMMO3': '0.210', 'AMMO4': '0.233', 'weapon5': '0.248', 'weapon2': '0.394', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.952', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.199', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:20,818][52671] DAMAGECOUNT value on done: 1027928.0 [2024-08-06 08:50:20,819][52671] Sum rewards: 73.272, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.780', 'AMMO5': '0.015', 'AMMO2': '0.032', 'weapon4': '0.158', 'AMMO4': '0.161', 'weapon5': '0.178', 'AMMO3': '0.200', 'weapon2': '0.362', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.443', 'FRAGCOUNT': '58.000'} [2024-08-06 08:50:21,705][52660] DAMAGECOUNT value on done: 1021381.0 [2024-08-06 08:50:21,707][52660] Sum rewards: 80.554, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.630', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon4': '0.080', 'weapon5': '0.136', 'AMMO3': '0.238', 'AMMO4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.388', 'WEAPON3': '1.400', 'weapon3': '3.152', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:22,427][52811] DAMAGECOUNT value on done: 958535.0 [2024-08-06 08:50:22,435][52811] Sum rewards: 72.741, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.142', 'HEALTH': '0.145', 'AMMO4': '0.164', 'weapon5': '0.204', 'AMMO3': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '59.000'} [2024-08-06 08:50:22,556][52647] DAMAGECOUNT value on done: 1076746.0 [2024-08-06 08:50:22,556][52647] Sum rewards: 73.100, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.870', 'AMMO5': '0.019', 'AMMO2': '0.060', 'weapon4': '0.136', 'AMMO3': '0.218', 'weapon5': '0.218', 'AMMO4': '0.298', 'weapon2': '0.450', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '2.910', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:22,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 714588160. Throughput: 0: 4355.3. Samples: 178651490. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:22,794][52567] Avg episode reward: [(0, '75.967')] [2024-08-06 08:50:22,810][52649] DAMAGECOUNT value on done: 1007833.0 [2024-08-06 08:50:22,820][52649] Sum rewards: 71.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.110', 'AMMO5': '0.006', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.106', 'AMMO4': '0.144', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.239', 'WEAPON3': '1.450', 'weapon3': '3.430', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.571', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:23,137][52650] Updated weights for policy 0, policy_version 87231 (0.0026) [2024-08-06 08:50:23,223][52658] DAMAGECOUNT value on done: 1017707.0 [2024-08-06 08:50:23,223][52658] Sum rewards: 61.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.258', 'AMMO5': '0.018', 'AMMO2': '0.045', 'AMMO3': '0.196', 'AMMO4': '0.225', 'weapon5': '0.250', 'weapon2': '0.290', 'weapon4': '0.336', 'WEAPON5': '0.450', 'WEAPON4': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.866', 'HITCOUNT': '3.030', 'DAMAGECOUNT': '16.452', 'FRAGCOUNT': '51.000'} [2024-08-06 08:50:23,624][52669] DAMAGECOUNT value on done: 1026983.0 [2024-08-06 08:50:23,625][52669] Sum rewards: 88.317, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.400', 'AMMO5': '0.003', 'AMMO2': '0.004', 'AMMO4': '0.021', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.090', 'weapon2': '0.246', 'AMMO3': '0.275', 'WEAPON3': '1.550', 'weapon3': '3.380', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.654', 'FRAGCOUNT': '74.000'} [2024-08-06 08:50:23,697][52671] DAMAGECOUNT value on done: 1031672.0 [2024-08-06 08:50:23,700][52671] Sum rewards: 79.172, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.832', 'AMMO5': '0.006', 'AMMO2': '0.015', 'AMMO4': '0.074', 'weapon5': '0.084', 'weapon4': '0.138', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.277', 'weapon2': '0.436', 'WEAPON3': '1.600', 'weapon3': '3.092', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.952', 'FRAGCOUNT': '65.000'} [2024-08-06 08:50:24,598][52660] DAMAGECOUNT value on done: 1019576.0 [2024-08-06 08:50:24,599][52660] Sum rewards: 73.492, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.642', 'AMMO5': '0.022', 'AMMO2': '0.066', 'weapon4': '0.192', 'AMMO3': '0.210', 'weapon2': '0.260', 'AMMO4': '0.330', 'weapon5': '0.338', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.906', 'HITCOUNT': '3.140', 'DAMAGECOUNT': '17.121', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:25,310][52803] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:50:25,468][52647] DAMAGECOUNT value on done: 1071684.0 [2024-08-06 08:50:25,468][52647] Sum rewards: 77.710, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.810', 'AMMO5': '0.010', 'AMMO2': '0.054', 'weapon5': '0.178', 'AMMO3': '0.225', 'weapon4': '0.230', 'AMMO4': '0.271', 'WEAPON5': '0.300', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.940', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.764', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:25,583][52811] DAMAGECOUNT value on done: 968027.0 [2024-08-06 08:50:25,583][52811] Sum rewards: 77.042, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.680', 'AMMO5': '0.013', 'AMMO2': '0.047', 'weapon4': '0.054', 'weapon5': '0.142', 'AMMO3': '0.201', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.130', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.930', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:26,025][52649] DAMAGECOUNT value on done: 996615.0 [2024-08-06 08:50:26,026][52649] Sum rewards: 77.147, reward structure: {'DEATHCOUNT': '-9.000', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.020', 'HEALTH': '0.059', 'AMMO4': '0.101', 'weapon5': '0.106', 'weapon4': '0.128', 'AMMO3': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.674', 'WEAPON3': '0.800', 'weapon3': '2.926', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.117', 'FRAGCOUNT': '59.000'} [2024-08-06 08:50:26,225][52658] DAMAGECOUNT value on done: 1032508.0 [2024-08-06 08:50:26,225][52658] Sum rewards: 84.391, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.538', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.044', 'AMMO4': '0.069', 'weapon5': '0.080', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.186', 'AMMO3': '0.195', 'WEAPON3': '1.300', 'weapon3': '3.506', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.259', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:26,269][52671] DAMAGECOUNT value on done: 1024705.0 [2024-08-06 08:50:26,272][52671] Sum rewards: 65.112, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.280', 'AMMO5': '0.012', 'AMMO2': '0.054', 'AMMO3': '0.137', 'weapon5': '0.156', 'AMMO4': '0.270', 'weapon4': '0.276', 'WEAPON5': '0.300', 'WEAPON4': '0.500', 'weapon2': '0.530', 'WEAPON3': '0.850', 'weapon3': '2.806', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '15.750', 'FRAGCOUNT': '52.000'} [2024-08-06 08:50:26,942][52669] DAMAGECOUNT value on done: 1031085.0 [2024-08-06 08:50:26,942][52669] Sum rewards: 93.030, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.191', 'AMMO2': '0.014', 'AMMO5': '0.023', 'weapon4': '0.050', 'AMMO4': '0.069', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'weapon5': '0.226', 'WEAPON5': '0.450', 'weapon2': '0.690', 'WEAPON3': '1.050', 'weapon3': '2.784', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '21.378', 'FRAGCOUNT': '73.000'} [2024-08-06 08:50:27,412][52660] DAMAGECOUNT value on done: 1010437.0 [2024-08-06 08:50:27,413][52660] Sum rewards: 73.631, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.847', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon5': '0.056', 'AMMO4': '0.115', 'weapon4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'weapon2': '0.232', 'WEAPON4': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.328', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:27,735][52650] Updated weights for policy 0, policy_version 87241 (0.0017) [2024-08-06 08:50:27,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 714678272. Throughput: 0: 4349.8. Samples: 178677430. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:27,794][52567] Avg episode reward: [(0, '76.008')] [2024-08-06 08:50:27,797][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000087241_714678272.pth... [2024-08-06 08:50:27,920][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086730_710492160.pth [2024-08-06 08:50:28,204][52647] DAMAGECOUNT value on done: 1071664.0 [2024-08-06 08:50:28,206][52647] Sum rewards: 68.829, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.549', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.016', 'weapon5': '0.038', 'WEAPON4': '0.050', 'AMMO4': '0.074', 'WEAPON5': '0.100', 'weapon2': '0.148', 'AMMO3': '0.188', 'WEAPON3': '1.100', 'HITCOUNT': '3.120', 'weapon3': '3.700', 'DAMAGECOUNT': '16.074', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:28,578][52658] DAMAGECOUNT value on done: 1015294.0 [2024-08-06 08:50:28,578][52658] Sum rewards: 77.234, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.131', 'weapon5': '0.168', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.466', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.450', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:28,758][52811] DAMAGECOUNT value on done: 959505.0 [2024-08-06 08:50:28,762][52811] Sum rewards: 81.444, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.240', 'AMMO5': '0.009', 'AMMO2': '0.047', 'weapon5': '0.124', 'weapon4': '0.128', 'AMMO4': '0.235', 'AMMO3': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.022', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.027', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:29,489][52671] DAMAGECOUNT value on done: 1028806.0 [2024-08-06 08:50:29,490][52671] Sum rewards: 85.170, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.866', 'AMMO5': '0.007', 'AMMO2': '0.018', 'weapon4': '0.060', 'AMMO4': '0.091', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.217', 'weapon2': '0.260', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.418', 'FRAGCOUNT': '71.000'} [2024-08-06 08:50:29,663][52669] DAMAGECOUNT value on done: 1038404.0 [2024-08-06 08:50:29,663][52669] Sum rewards: 77.582, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.136', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.096', 'AMMO4': '0.127', 'WEAPON5': '0.150', 'weapon4': '0.158', 'AMMO3': '0.208', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.870', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:30,418][52660] DAMAGECOUNT value on done: 1012242.0 [2024-08-06 08:50:30,419][52660] Sum rewards: 73.199, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.340', 'AMMO5': '0.011', 'AMMO2': '0.041', 'weapon4': '0.056', 'weapon5': '0.174', 'AMMO4': '0.206', 'AMMO3': '0.246', 'weapon2': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.300', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.978', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:30,801][52647] DAMAGECOUNT value on done: 1071581.0 [2024-08-06 08:50:30,803][52647] Sum rewards: 79.289, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.028', 'AMMO4': '0.087', 'weapon5': '0.124', 'WEAPON4': '0.150', 'AMMO3': '0.165', 'WEAPON5': '0.250', 'weapon2': '0.446', 'WEAPON3': '1.050', 'weapon3': '3.218', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:31,247][52658] DAMAGECOUNT value on done: 1043979.0 [2024-08-06 08:50:31,248][52658] Sum rewards: 74.278, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.750', 'AMMO5': '0.013', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.161', 'weapon4': '0.216', 'AMMO3': '0.227', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:32,087][52811] DAMAGECOUNT value on done: 957495.0 [2024-08-06 08:50:32,088][52811] Sum rewards: 83.207, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.026', 'weapon5': '0.096', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.233', 'weapon2': '0.418', 'WEAPON3': '1.450', 'weapon3': '3.286', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.562', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:32,603][52650] Updated weights for policy 0, policy_version 87251 (0.0024) [2024-08-06 08:50:32,630][52671] DAMAGECOUNT value on done: 1032094.0 [2024-08-06 08:50:32,630][52671] Sum rewards: 76.865, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.840', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon4': '0.120', 'AMMO4': '0.164', 'weapon5': '0.180', 'AMMO3': '0.204', 'WEAPON4': '0.300', 'weapon2': '0.420', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.998', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '63.000'} [2024-08-06 08:50:32,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 714760192. Throughput: 0: 4349.6. Samples: 178690180. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:32,794][52567] Avg episode reward: [(0, '76.267')] [2024-08-06 08:50:32,902][52669] DAMAGECOUNT value on done: 1030923.0 [2024-08-06 08:50:32,902][52669] Sum rewards: 81.153, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.648', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.090', 'AMMO4': '0.091', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.260', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '67.000'} [2024-08-06 08:50:33,826][52647] DAMAGECOUNT value on done: 1077378.0 [2024-08-06 08:50:33,837][52647] Sum rewards: 71.554, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.120', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon4': '0.064', 'AMMO4': '0.178', 'AMMO3': '0.190', 'weapon5': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.930', 'WEAPON3': '1.150', 'weapon3': '2.602', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.478', 'FRAGCOUNT': '56.500'} [2024-08-06 08:50:33,880][52658] DAMAGECOUNT value on done: 1031231.0 [2024-08-06 08:50:33,881][52658] Sum rewards: 75.741, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.379', 'AMMO5': '0.003', 'AMMO2': '0.021', 'weapon5': '0.046', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.104', 'WEAPON4': '0.150', 'AMMO3': '0.182', 'weapon2': '0.436', 'WEAPON3': '1.200', 'weapon3': '3.244', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '16.290', 'FRAGCOUNT': '63.000'} [2024-08-06 08:50:35,096][52671] DAMAGECOUNT value on done: 1013662.0 [2024-08-06 08:50:35,096][52671] Sum rewards: 67.707, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.205', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.084', 'AMMO3': '0.194', 'AMMO4': '0.251', 'weapon2': '0.368', 'weapon5': '0.398', 'WEAPON4': '0.500', 'WEAPON5': '0.550', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:35,173][52811] DAMAGECOUNT value on done: 954495.0 [2024-08-06 08:50:35,173][52811] Sum rewards: 73.678, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.374', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.080', 'weapon5': '0.198', 'weapon2': '0.202', 'AMMO3': '0.226', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.238', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.133', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:35,924][52669] DAMAGECOUNT value on done: 1032909.0 [2024-08-06 08:50:35,925][52669] Sum rewards: 74.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.883', 'AMMO2': '0.023', 'WEAPON4': '0.100', 'AMMO4': '0.116', 'weapon4': '0.158', 'AMMO3': '0.209', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '62.000'} [2024-08-06 08:50:36,316][52647] DAMAGECOUNT value on done: 1074374.0 [2024-08-06 08:50:36,316][52647] Sum rewards: 82.754, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.048', 'HEALTH': '0.061', 'AMMO4': '0.143', 'AMMO3': '0.180', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.488', 'WEAPON3': '1.000', 'weapon3': '3.070', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:37,001][52658] DAMAGECOUNT value on done: 1039406.0 [2024-08-06 08:50:37,001][52658] Sum rewards: 76.889, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.858', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.159', 'weapon5': '0.172', 'weapon4': '0.230', 'AMMO3': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.318', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.896', 'FRAGCOUNT': '63.000'} [2024-08-06 08:50:37,147][52650] Updated weights for policy 0, policy_version 87261 (0.0011) [2024-08-06 08:50:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 714850304. Throughput: 0: 4341.8. Samples: 178716320. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:37,794][52567] Avg episode reward: [(0, '75.871')] [2024-08-06 08:50:37,913][52671] DAMAGECOUNT value on done: 1038295.0 [2024-08-06 08:50:37,915][52671] Sum rewards: 65.931, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.432', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.066', 'weapon4': '0.080', 'AMMO4': '0.103', 'AMMO3': '0.145', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.614', 'WEAPON3': '0.900', 'weapon3': '3.126', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.723', 'FRAGCOUNT': '51.000'} [2024-08-06 08:50:38,294][52811] DAMAGECOUNT value on done: 957438.0 [2024-08-06 08:50:38,295][52811] Sum rewards: 82.856, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.695', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon4': '0.044', 'weapon5': '0.132', 'AMMO4': '0.196', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.490', 'WEAPON3': '1.350', 'weapon3': '3.128', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.857', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:39,029][52647] DAMAGECOUNT value on done: 1077724.0 [2024-08-06 08:50:39,031][52647] Sum rewards: 58.185, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.140', 'AMMO5': '0.008', 'AMMO2': '0.049', 'weapon4': '0.100', 'weapon5': '0.136', 'AMMO4': '0.245', 'AMMO3': '0.248', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.450', 'HITCOUNT': '2.950', 'weapon3': '3.010', 'DAMAGECOUNT': '14.277', 'FRAGCOUNT': '51.000'} [2024-08-06 08:50:39,048][52669] DAMAGECOUNT value on done: 1031933.0 [2024-08-06 08:50:39,048][52669] Sum rewards: 76.898, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.272', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.036', 'weapon5': '0.078', 'AMMO4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.252', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:39,073][52663] DAMAGECOUNT value on done: 1039920.0 [2024-08-06 08:50:39,073][52663] Sum rewards: 71.817, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.355', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.056', 'weapon5': '0.166', 'AMMO4': '0.186', 'AMMO3': '0.192', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.118', 'DAMAGECOUNT': '16.707', 'FRAGCOUNT': '58.000'} [2024-08-06 08:50:40,335][52658] DAMAGECOUNT value on done: 1021833.0 [2024-08-06 08:50:40,335][52658] Sum rewards: 71.285, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.820', 'AMMO5': '0.012', 'AMMO2': '0.040', 'AMMO3': '0.172', 'weapon5': '0.186', 'AMMO4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON4': '0.350', 'weapon4': '0.472', 'WEAPON3': '1.050', 'weapon3': '2.698', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.686', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:40,993][52671] DAMAGECOUNT value on done: 1035048.0 [2024-08-06 08:50:40,999][52671] Sum rewards: 70.671, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.735', 'AMMO5': '0.003', 'AMMO2': '0.026', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'weapon4': '0.374', 'weapon2': '0.408', 'WEAPON3': '1.150', 'weapon3': '2.998', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '56.000'} [2024-08-06 08:50:41,496][52811] DAMAGECOUNT value on done: 961751.0 [2024-08-06 08:50:41,497][52811] Sum rewards: 81.732, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.143', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'AMMO4': '0.083', 'AMMO3': '0.172', 'weapon2': '0.296', 'WEAPON3': '1.100', 'weapon3': '3.588', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.439', 'FRAGCOUNT': '63.000'} [2024-08-06 08:50:41,734][52650] Updated weights for policy 0, policy_version 87271 (0.0018) [2024-08-06 08:50:41,971][52669] DAMAGECOUNT value on done: 1020742.0 [2024-08-06 08:50:41,973][52669] Sum rewards: 66.569, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.708', 'AMMO5': '0.014', 'AMMO2': '0.035', 'AMMO3': '0.158', 'AMMO4': '0.174', 'weapon5': '0.176', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.634', 'weapon2': '0.852', 'WEAPON3': '0.900', 'weapon3': '2.096', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '16.368', 'FRAGCOUNT': '50.000'} [2024-08-06 08:50:42,027][52663] DAMAGECOUNT value on done: 1025206.0 [2024-08-06 08:50:42,029][52663] Sum rewards: 76.705, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.150', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO3': '0.180', 'AMMO4': '0.181', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon4': '0.542', 'weapon2': '0.562', 'WEAPON3': '1.050', 'weapon3': '2.448', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.796', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:42,158][52647] DAMAGECOUNT value on done: 1080675.0 [2024-08-06 08:50:42,158][52647] Sum rewards: 86.446, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.838', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon4': '0.074', 'AMMO4': '0.124', 'weapon5': '0.152', 'AMMO3': '0.190', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.384', 'WEAPON3': '1.150', 'weapon3': '3.142', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '70.000'} [2024-08-06 08:50:42,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 714940416. Throughput: 0: 4353.3. Samples: 178742710. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:42,802][52567] Avg episode reward: [(0, '75.941')] [2024-08-06 08:50:43,108][52658] DAMAGECOUNT value on done: 1034158.0 [2024-08-06 08:50:43,109][52658] Sum rewards: 70.948, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.138', 'AMMO5': '0.019', 'AMMO2': '0.054', 'weapon4': '0.122', 'weapon2': '0.186', 'AMMO3': '0.216', 'AMMO4': '0.272', 'weapon5': '0.296', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.350', 'weapon3': '3.108', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '58.000'} [2024-08-06 08:50:44,006][52671] DAMAGECOUNT value on done: 1030009.0 [2024-08-06 08:50:44,008][52671] Sum rewards: 82.084, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.174', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.190', 'AMMO3': '0.200', 'AMMO4': '0.252', 'weapon5': '0.260', 'weapon2': '0.376', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.910', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '66.000'} [2024-08-06 08:50:44,664][52811] DAMAGECOUNT value on done: 969516.0 [2024-08-06 08:50:44,667][52811] Sum rewards: 76.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.505', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.042', 'weapon5': '0.084', 'AMMO4': '0.198', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.360', 'WEAPON3': '1.350', 'weapon3': '3.292', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.558', 'FRAGCOUNT': '63.000'} [2024-08-06 08:50:45,011][52647] DAMAGECOUNT value on done: 1064827.0 [2024-08-06 08:50:45,012][52647] Sum rewards: 78.302, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.870', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.056', 'weapon5': '0.170', 'AMMO4': '0.184', 'AMMO3': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.058', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '66.000'} [2024-08-06 08:50:45,205][52669] DAMAGECOUNT value on done: 1024430.0 [2024-08-06 08:50:45,208][52669] Sum rewards: 74.677, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.782', 'AMMO5': '0.007', 'AMMO2': '0.008', 'weapon4': '0.026', 'AMMO4': '0.042', 'WEAPON4': '0.050', 'weapon5': '0.112', 'AMMO3': '0.167', 'WEAPON5': '0.200', 'weapon2': '0.584', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '59.500'} [2024-08-06 08:50:45,315][52663] DAMAGECOUNT value on done: 1019985.0 [2024-08-06 08:50:45,316][52663] Sum rewards: 79.699, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.072', 'AMMO4': '0.119', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.251', 'weapon2': '0.280', 'WEAPON3': '1.600', 'weapon3': '3.346', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.262', 'FRAGCOUNT': '67.000'} [2024-08-06 08:50:45,686][52658] DAMAGECOUNT value on done: 1026159.0 [2024-08-06 08:50:45,686][52658] Sum rewards: 80.930, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.690', 'AMMO5': '0.013', 'AMMO2': '0.035', 'weapon4': '0.072', 'AMMO4': '0.177', 'weapon5': '0.206', 'AMMO3': '0.233', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.086', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:46,391][52650] Updated weights for policy 0, policy_version 87281 (0.0027) [2024-08-06 08:50:46,895][52671] DAMAGECOUNT value on done: 1035881.0 [2024-08-06 08:50:46,895][52671] Sum rewards: 57.804, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.130', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.037', 'weapon4': '0.076', 'weapon5': '0.122', 'AMMO4': '0.183', 'AMMO3': '0.265', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.784', 'WEAPON3': '1.450', 'weapon3': '2.782', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.495', 'FRAGCOUNT': '50.000'} [2024-08-06 08:50:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17439.2). Total num frames: 715022336. Throughput: 0: 4349.1. Samples: 178755710. Policy #0 lag: (min: 0.0, avg: 4.4, max: 8.0) [2024-08-06 08:50:47,794][52567] Avg episode reward: [(0, '76.014')] [2024-08-06 08:50:47,988][52811] DAMAGECOUNT value on done: 951924.0 [2024-08-06 08:50:47,989][52811] Sum rewards: 70.120, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.644', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon5': '0.064', 'weapon4': '0.100', 'AMMO4': '0.205', 'AMMO3': '0.239', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.528', 'WEAPON3': '1.450', 'weapon3': '3.110', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '60.000'} [2024-08-06 08:50:48,006][52658] DAMAGECOUNT value on done: 1028235.0 [2024-08-06 08:50:48,007][52658] Sum rewards: 80.227, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.479', 'AMMO5': '0.011', 'AMMO2': '0.027', 'AMMO4': '0.134', 'weapon4': '0.146', 'weapon5': '0.158', 'weapon2': '0.198', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.220', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '69.000'} [2024-08-06 08:50:48,316][52647] DAMAGECOUNT value on done: 1077025.0 [2024-08-06 08:50:48,316][52647] Sum rewards: 87.987, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.050', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.102', 'AMMO4': '0.129', 'AMMO3': '0.216', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.292', 'WEAPON3': '1.300', 'weapon3': '3.308', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '20.223', 'FRAGCOUNT': '74.000'} [2024-08-06 08:50:48,437][52669] DAMAGECOUNT value on done: 1032952.0 [2024-08-06 08:50:48,437][52669] Sum rewards: 82.586, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.980', 'AMMO5': '0.010', 'AMMO2': '0.021', 'AMMO4': '0.104', 'weapon5': '0.178', 'AMMO3': '0.209', 'weapon4': '0.232', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.766', 'WEAPON3': '1.300', 'weapon3': '2.590', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '68.000'} [2024-08-06 08:50:48,550][52663] DAMAGECOUNT value on done: 1026935.0 [2024-08-06 08:50:48,551][52663] Sum rewards: 81.311, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.937', 'AMMO5': '0.012', 'AMMO2': '0.013', 'weapon4': '0.038', 'AMMO4': '0.065', 'WEAPON4': '0.100', 'weapon5': '0.144', 'AMMO3': '0.206', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '67.000'} [2024-08-06 08:50:49,621][52803] Large shaping reward 2.591 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.54, 180.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:50:50,005][52671] DAMAGECOUNT value on done: 1018677.0 [2024-08-06 08:50:50,007][52671] Sum rewards: 66.671, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-3.165', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon5': '0.118', 'AMMO4': '0.146', 'AMMO3': '0.176', 'weapon4': '0.228', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.118', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '54.000'} [2024-08-06 08:50:50,682][52658] DAMAGECOUNT value on done: 1013528.0 [2024-08-06 08:50:50,683][52658] Sum rewards: 66.960, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.310', 'AMMO5': '0.016', 'AMMO2': '0.056', 'weapon4': '0.090', 'AMMO3': '0.162', 'weapon5': '0.180', 'AMMO4': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.738', 'WEAPON3': '1.050', 'weapon3': '2.806', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '16.059', 'FRAGCOUNT': '55.000'} [2024-08-06 08:50:50,979][52650] Updated weights for policy 0, policy_version 87291 (0.0014) [2024-08-06 08:50:51,019][52669] DAMAGECOUNT value on done: 1048901.0 [2024-08-06 08:50:51,019][52669] Sum rewards: 65.471, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.628', 'AMMO5': '0.011', 'AMMO2': '0.048', 'weapon4': '0.104', 'AMMO3': '0.213', 'AMMO4': '0.239', 'weapon5': '0.252', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.864', 'HITCOUNT': '3.020', 'DAMAGECOUNT': '16.140', 'FRAGCOUNT': '53.000'} [2024-08-06 08:50:51,158][52811] DAMAGECOUNT value on done: 956804.0 [2024-08-06 08:50:51,158][52811] Sum rewards: 75.679, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.880', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.068', 'AMMO4': '0.181', 'weapon5': '0.224', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '2.968', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.759', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:51,180][52663] DAMAGECOUNT value on done: 1026186.0 [2024-08-06 08:50:51,180][52663] Sum rewards: 68.148, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.852', 'AMMO5': '0.005', 'AMMO2': '0.006', 'AMMO4': '0.031', 'weapon4': '0.032', 'weapon5': '0.094', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.204', 'weapon2': '0.674', 'WEAPON3': '1.200', 'weapon3': '2.942', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '15.411', 'FRAGCOUNT': '57.000'} [2024-08-06 08:50:51,264][52647] DAMAGECOUNT value on done: 1068118.0 [2024-08-06 08:50:51,266][52647] Sum rewards: 78.696, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.300', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.090', 'weapon5': '0.102', 'WEAPON5': '0.150', 'AMMO3': '0.216', 'weapon2': '0.466', 'WEAPON3': '1.300', 'weapon3': '3.246', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '63.500'} [2024-08-06 08:50:51,389][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:50:52,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17339.7, 300 sec: 17439.3). Total num frames: 715112448. Throughput: 0: 4345.1. Samples: 178781740. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:50:52,802][52567] Avg episode reward: [(0, '75.984')] [2024-08-06 08:50:53,487][52658] DAMAGECOUNT value on done: 1031423.0 [2024-08-06 08:50:53,490][52658] Sum rewards: 71.051, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.310', 'AMMO5': '0.010', 'AMMO2': '0.033', 'weapon4': '0.124', 'AMMO4': '0.163', 'weapon5': '0.184', 'AMMO3': '0.244', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.450', 'weapon3': '3.084', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.027', 'FRAGCOUNT': '59.000'} [2024-08-06 08:50:53,812][52647] DAMAGECOUNT value on done: 1070261.0 [2024-08-06 08:50:53,813][52647] Sum rewards: 79.057, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.017', 'AMMO2': '0.060', 'weapon4': '0.092', 'AMMO3': '0.207', 'weapon5': '0.222', 'weapon2': '0.284', 'AMMO4': '0.298', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.098', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '20.538', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:54,132][52669] DAMAGECOUNT value on done: 1038977.0 [2024-08-06 08:50:54,134][52669] Sum rewards: 80.203, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.260', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon5': '0.184', 'AMMO4': '0.187', 'weapon2': '0.210', 'WEAPON4': '0.250', 'weapon4': '0.252', 'AMMO3': '0.274', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.086', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '19.680', 'FRAGCOUNT': '67.000'} [2024-08-06 08:50:54,285][52663] DAMAGECOUNT value on done: 1032042.0 [2024-08-06 08:50:54,285][52663] Sum rewards: 79.079, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.855', 'AMMO5': '0.010', 'AMMO2': '0.020', 'WEAPON1': '0.020', 'weapon4': '0.046', 'AMMO4': '0.100', 'AMMO3': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon5': '0.256', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '2.942', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.020', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:56,000][52650] Updated weights for policy 0, policy_version 87301 (0.0045) [2024-08-06 08:50:56,487][52658] DAMAGECOUNT value on done: 1023661.0 [2024-08-06 08:50:56,487][52658] Sum rewards: 80.995, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.750', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.070', 'AMMO4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.164', 'weapon2': '0.474', 'WEAPON3': '1.050', 'weapon3': '3.252', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.296', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:57,123][52669] DAMAGECOUNT value on done: 1034985.0 [2024-08-06 08:50:57,127][52669] Sum rewards: 70.985, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.690', 'AMMO5': '0.019', 'AMMO2': '0.063', 'weapon4': '0.158', 'weapon5': '0.252', 'AMMO3': '0.255', 'weapon2': '0.256', 'AMMO4': '0.316', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.450', 'weapon3': '3.000', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '16.506', 'FRAGCOUNT': '61.000'} [2024-08-06 08:50:57,300][52663] DAMAGECOUNT value on done: 1024136.0 [2024-08-06 08:50:57,300][52663] Sum rewards: 80.910, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.094', 'AMMO4': '0.121', 'AMMO3': '0.180', 'weapon5': '0.184', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.286', 'weapon2': '0.354', 'WEAPON3': '1.050', 'weapon3': '3.156', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.660', 'FRAGCOUNT': '64.000'} [2024-08-06 08:50:57,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 715202560. Throughput: 0: 4354.2. Samples: 178808060. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:50:57,794][52567] Avg episode reward: [(0, '75.596')] [2024-08-06 08:50:58,945][52658] DAMAGECOUNT value on done: 1022288.0 [2024-08-06 08:50:58,955][52658] Sum rewards: 91.743, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.290', 'AMMO5': '0.005', 'AMMO2': '0.022', 'weapon4': '0.054', 'WEAPON4': '0.100', 'AMMO4': '0.108', 'weapon5': '0.114', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.636', 'WEAPON3': '1.450', 'weapon3': '2.918', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '22.323', 'FRAGCOUNT': '74.000'} [2024-08-06 08:51:00,090][52669] DAMAGECOUNT value on done: 1040147.0 [2024-08-06 08:51:00,091][52669] Sum rewards: 74.315, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.889', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.086', 'AMMO4': '0.127', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'weapon2': '0.288', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.979', 'FRAGCOUNT': '62.000'} [2024-08-06 08:51:00,181][52663] DAMAGECOUNT value on done: 1010479.0 [2024-08-06 08:51:00,182][52663] Sum rewards: 72.975, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.006', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.086', 'AMMO4': '0.097', 'weapon2': '0.190', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.230', 'WEAPON3': '1.450', 'HITCOUNT': '3.440', 'weapon3': '3.530', 'DAMAGECOUNT': '17.547', 'FRAGCOUNT': '62.000'} [2024-08-06 08:51:00,616][52794] DAMAGECOUNT value on done: 1019579.0 [2024-08-06 08:51:00,620][52794] Sum rewards: 74.656, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.250', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.098', 'weapon5': '0.146', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.304', 'WEAPON3': '1.400', 'weapon3': '3.172', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '61.000'} [2024-08-06 08:51:00,788][52650] Updated weights for policy 0, policy_version 87311 (0.0020) [2024-08-06 08:51:02,397][52658] DAMAGECOUNT value on done: 1030132.0 [2024-08-06 08:51:02,399][52658] Sum rewards: 71.236, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.070', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.120', 'weapon5': '0.124', 'AMMO4': '0.157', 'weapon2': '0.236', 'AMMO3': '0.244', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.600', 'weapon3': '3.284', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.579', 'FRAGCOUNT': '60.000'} [2024-08-06 08:51:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 715284480. Throughput: 0: 4358.0. Samples: 178821070. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:02,795][52567] Avg episode reward: [(0, '75.526')] [2024-08-06 08:51:03,041][52669] DAMAGECOUNT value on done: 1041915.0 [2024-08-06 08:51:03,041][52669] Sum rewards: 78.991, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.172', 'AMMO5': '0.008', 'AMMO2': '0.018', 'AMMO4': '0.090', 'weapon5': '0.124', 'weapon4': '0.186', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.128', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '19.605', 'FRAGCOUNT': '64.000'} [2024-08-06 08:51:03,178][52663] DAMAGECOUNT value on done: 1022400.0 [2024-08-06 08:51:03,181][52663] Sum rewards: 86.144, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.072', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon4': '0.050', 'AMMO4': '0.105', 'weapon5': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.250', 'weapon2': '0.366', 'WEAPON3': '1.550', 'weapon3': '3.200', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '20.682', 'FRAGCOUNT': '72.000'} [2024-08-06 08:51:03,825][52794] DAMAGECOUNT value on done: 1026355.0 [2024-08-06 08:51:03,825][52794] Sum rewards: 56.327, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-2.442', 'AMMO5': '0.015', 'AMMO2': '0.028', 'weapon4': '0.066', 'AMMO3': '0.138', 'AMMO4': '0.138', 'weapon5': '0.184', 'WEAPON4': '0.300', 'weapon2': '0.308', 'WEAPON5': '0.400', 'WEAPON3': '1.000', 'HITCOUNT': '2.580', 'weapon3': '3.250', 'DAMAGECOUNT': '12.612', 'FRAGCOUNT': '46.000'} [2024-08-06 08:51:05,322][52650] Updated weights for policy 0, policy_version 87321 (0.0021) [2024-08-06 08:51:05,898][52663] DAMAGECOUNT value on done: 1018387.0 [2024-08-06 08:51:05,901][52663] Sum rewards: 66.207, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.723', 'AMMO5': '0.020', 'AMMO2': '0.050', 'weapon4': '0.108', 'AMMO3': '0.150', 'AMMO4': '0.249', 'weapon5': '0.304', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.688', 'WEAPON3': '0.900', 'weapon3': '2.640', 'HITCOUNT': '2.870', 'DAMAGECOUNT': '16.251', 'FRAGCOUNT': '51.500'} [2024-08-06 08:51:06,340][52794] DAMAGECOUNT value on done: 1034433.0 [2024-08-06 08:51:06,342][52794] Sum rewards: 79.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.036', 'AMMO5': '0.019', 'AMMO2': '0.038', 'weapon4': '0.154', 'AMMO3': '0.156', 'AMMO4': '0.191', 'weapon5': '0.204', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.476', 'WEAPON3': '0.950', 'weapon3': '2.954', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.894', 'FRAGCOUNT': '63.000'} [2024-08-06 08:51:07,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 715366400. Throughput: 0: 4342.4. Samples: 178846900. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:07,794][52567] Avg episode reward: [(0, '75.367')] [2024-08-06 08:51:08,972][52794] DAMAGECOUNT value on done: 1021568.0 [2024-08-06 08:51:08,973][52794] Sum rewards: 64.977, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.540', 'AMMO5': '0.014', 'AMMO2': '0.045', 'weapon4': '0.198', 'weapon5': '0.204', 'AMMO4': '0.227', 'AMMO3': '0.282', 'weapon2': '0.336', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '2.982', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.379', 'FRAGCOUNT': '55.000'} [2024-08-06 08:51:09,018][52663] DAMAGECOUNT value on done: 1029044.0 [2024-08-06 08:51:09,020][52663] Sum rewards: 73.905, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.458', 'AMMO5': '0.011', 'AMMO2': '0.021', 'weapon4': '0.054', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.266', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.370', 'weapon3': '3.392', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '62.000'} [2024-08-06 08:51:10,086][52650] Updated weights for policy 0, policy_version 87331 (0.0011) [2024-08-06 08:51:10,548][52803] DAMAGECOUNT value on done: 952340.0 [2024-08-06 08:51:10,549][52803] Sum rewards: 70.485, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.040', 'AMMO5': '0.011', 'AMMO2': '0.036', 'weapon5': '0.176', 'AMMO4': '0.179', 'AMMO3': '0.250', 'weapon2': '0.256', 'weapon4': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.016', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.243', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:12,091][52794] DAMAGECOUNT value on done: 1015882.0 [2024-08-06 08:51:12,093][52794] Sum rewards: 72.774, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.800', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.172', 'weapon5': '0.172', 'AMMO4': '0.192', 'AMMO3': '0.196', 'weapon2': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '59.000'} [2024-08-06 08:51:12,120][52663] DAMAGECOUNT value on done: 1012254.0 [2024-08-06 08:51:12,124][52663] Sum rewards: 87.077, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.856', 'AMMO5': '0.021', 'AMMO2': '0.058', 'AMMO3': '0.176', 'weapon2': '0.204', 'AMMO4': '0.289', 'weapon5': '0.350', 'weapon4': '0.430', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.050', 'weapon3': '2.694', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.461', 'FRAGCOUNT': '69.000'} [2024-08-06 08:51:12,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 715456512. Throughput: 0: 4350.7. Samples: 178873210. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:12,794][52567] Avg episode reward: [(0, '75.301')] [2024-08-06 08:51:13,645][52803] DAMAGECOUNT value on done: 951448.0 [2024-08-06 08:51:13,646][52803] Sum rewards: 85.018, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.530', 'AMMO5': '0.003', 'AMMO2': '0.008', 'AMMO4': '0.038', 'WEAPON5': '0.050', 'AMMO3': '0.194', 'weapon2': '0.436', 'WEAPON3': '1.150', 'weapon3': '3.424', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '20.466', 'FRAGCOUNT': '67.000'} [2024-08-06 08:51:14,525][52650] Updated weights for policy 0, policy_version 87341 (0.0013) [2024-08-06 08:51:14,978][52663] DAMAGECOUNT value on done: 1011125.0 [2024-08-06 08:51:14,980][52663] Sum rewards: 62.314, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.531', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.068', 'AMMO4': '0.127', 'weapon5': '0.140', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon2': '0.236', 'WEAPON4': '0.250', 'WEAPON3': '1.350', 'HITCOUNT': '3.100', 'weapon3': '3.336', 'DAMAGECOUNT': '15.285', 'FRAGCOUNT': '53.000'} [2024-08-06 08:51:15,445][52794] DAMAGECOUNT value on done: 1021426.0 [2024-08-06 08:51:15,446][52794] Sum rewards: 76.124, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.540', 'AMMO5': '0.011', 'AMMO2': '0.024', 'AMMO4': '0.118', 'AMMO3': '0.153', 'weapon5': '0.216', 'WEAPON4': '0.300', 'weapon4': '0.332', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.050', 'weapon3': '2.676', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:16,764][52803] DAMAGECOUNT value on done: 957999.0 [2024-08-06 08:51:16,764][52803] Sum rewards: 67.366, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.142', 'AMMO5': '0.018', 'AMMO2': '0.047', 'AMMO3': '0.155', 'weapon4': '0.188', 'weapon5': '0.206', 'AMMO4': '0.236', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'weapon2': '0.542', 'WEAPON3': '1.050', 'weapon3': '2.818', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '54.000'} [2024-08-06 08:51:17,804][52567] Fps is (10 sec: 18004.7, 60 sec: 17336.9, 300 sec: 17438.7). Total num frames: 715546624. Throughput: 0: 4357.9. Samples: 178886330. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:17,804][52567] Avg episode reward: [(0, '75.458')] [2024-08-06 08:51:17,929][52663] DAMAGECOUNT value on done: 1020346.0 [2024-08-06 08:51:17,931][52663] Sum rewards: 75.418, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.858', 'AMMO5': '0.003', 'weapon4': '0.008', 'AMMO2': '0.012', 'weapon5': '0.048', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'AMMO3': '0.188', 'weapon2': '0.552', 'WEAPON3': '1.150', 'weapon3': '3.226', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '61.000'} [2024-08-06 08:51:18,385][52794] DAMAGECOUNT value on done: 1020928.0 [2024-08-06 08:51:18,387][52794] Sum rewards: 88.926, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.820', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.068', 'AMMO4': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.318', 'WEAPON3': '1.300', 'weapon3': '3.336', 'HITCOUNT': '4.120', 'DAMAGECOUNT': '21.525', 'FRAGCOUNT': '72.000'} [2024-08-06 08:51:19,626][52650] Updated weights for policy 0, policy_version 87351 (0.0012) [2024-08-06 08:51:20,036][52803] DAMAGECOUNT value on done: 952867.0 [2024-08-06 08:51:20,037][52803] Sum rewards: 76.703, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.064', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.013', 'WEAPON5': '0.050', 'AMMO3': '0.186', 'weapon2': '0.748', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.390', 'FRAGCOUNT': '62.000'} [2024-08-06 08:51:20,141][52614] Signal inference workers to stop experience collection... (16100 times) [2024-08-06 08:51:20,141][52614] Signal inference workers to resume experience collection... (16100 times) [2024-08-06 08:51:20,226][52650] InferenceWorker_p0-w0: stopping experience collection (16100 times) [2024-08-06 08:51:20,226][52650] InferenceWorker_p0-w0: resuming experience collection (16100 times) [2024-08-06 08:51:20,927][52663] DAMAGECOUNT value on done: 1020714.0 [2024-08-06 08:51:20,928][52663] Sum rewards: 85.845, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.370', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.048', 'weapon5': '0.108', 'AMMO3': '0.150', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.356', 'WEAPON3': '1.050', 'weapon3': '3.274', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '21.102', 'FRAGCOUNT': '67.000'} [2024-08-06 08:51:21,357][52794] DAMAGECOUNT value on done: 1012104.0 [2024-08-06 08:51:21,357][52794] Sum rewards: 81.287, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.774', 'AMMO5': '0.005', 'weapon4': '0.030', 'AMMO2': '0.034', 'weapon5': '0.090', 'AMMO4': '0.171', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.292', 'WEAPON3': '1.350', 'weapon3': '3.386', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.462', 'FRAGCOUNT': '67.000'} [2024-08-06 08:51:21,617][52662] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:51:22,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 715628544. Throughput: 0: 4360.7. Samples: 178912550. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:22,794][52567] Avg episode reward: [(0, '75.661')] [2024-08-06 08:51:23,289][52803] DAMAGECOUNT value on done: 955628.0 [2024-08-06 08:51:23,290][52803] Sum rewards: 75.770, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.992', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.032', 'AMMO4': '0.079', 'weapon5': '0.082', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.426', 'WEAPON3': '1.600', 'weapon3': '3.240', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.513', 'FRAGCOUNT': '64.000'} [2024-08-06 08:51:23,892][52663] DAMAGECOUNT value on done: 1024964.0 [2024-08-06 08:51:23,894][52663] Sum rewards: 72.823, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.284', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.104', 'AMMO3': '0.153', 'AMMO4': '0.157', 'weapon5': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.538', 'WEAPON3': '1.000', 'weapon3': '2.838', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:24,127][52650] Updated weights for policy 0, policy_version 87361 (0.0011) [2024-08-06 08:51:24,186][52794] DAMAGECOUNT value on done: 1026660.0 [2024-08-06 08:51:24,186][52794] Sum rewards: 68.676, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.216', 'AMMO5': '0.010', 'AMMO2': '0.019', 'weapon4': '0.030', 'weapon5': '0.094', 'AMMO4': '0.097', 'AMMO3': '0.155', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.390', 'WEAPON3': '1.000', 'HITCOUNT': '2.910', 'weapon3': '3.368', 'DAMAGECOUNT': '16.119', 'FRAGCOUNT': '55.000'} [2024-08-06 08:51:26,486][52803] DAMAGECOUNT value on done: 952566.0 [2024-08-06 08:51:26,489][52803] Sum rewards: 69.342, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.254', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.064', 'weapon5': '0.158', 'AMMO4': '0.208', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.506', 'WEAPON3': '1.300', 'weapon3': '3.024', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.985', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:26,855][52663] DAMAGECOUNT value on done: 1022959.0 [2024-08-06 08:51:26,857][52663] Sum rewards: 80.307, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.106', 'AMMO4': '0.143', 'weapon5': '0.224', 'AMMO3': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.352', 'WEAPON3': '1.700', 'weapon3': '3.012', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.578', 'FRAGCOUNT': '68.000'} [2024-08-06 08:51:27,029][52794] DAMAGECOUNT value on done: 1023085.0 [2024-08-06 08:51:27,031][52794] Sum rewards: 79.823, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.480', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon5': '0.118', 'AMMO4': '0.172', 'weapon2': '0.186', 'AMMO3': '0.218', 'WEAPON5': '0.250', 'weapon4': '0.276', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.136', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.254', 'FRAGCOUNT': '67.000'} [2024-08-06 08:51:27,794][52567] Fps is (10 sec: 17220.1, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 715718656. Throughput: 0: 4336.2. Samples: 178937840. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:27,802][52567] Avg episode reward: [(0, '75.731')] [2024-08-06 08:51:28,996][52650] Updated weights for policy 0, policy_version 87371 (0.0028) [2024-08-06 08:51:29,704][52803] DAMAGECOUNT value on done: 951507.0 [2024-08-06 08:51:29,705][52803] Sum rewards: 90.537, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.510', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.032', 'weapon5': '0.054', 'AMMO4': '0.159', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.170', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.640', 'FRAGCOUNT': '76.000'} [2024-08-06 08:51:30,042][52794] DAMAGECOUNT value on done: 1015582.0 [2024-08-06 08:51:30,044][52794] Sum rewards: 78.082, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.968', 'AMMO5': '0.009', 'AMMO2': '0.033', 'weapon4': '0.138', 'weapon5': '0.142', 'AMMO4': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.288', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.888', 'FRAGCOUNT': '65.000'} [2024-08-06 08:51:30,117][52663] DAMAGECOUNT value on done: 1028471.0 [2024-08-06 08:51:30,118][52663] Sum rewards: 81.992, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.005', 'AMMO5': '0.019', 'AMMO2': '0.057', 'weapon4': '0.098', 'AMMO3': '0.212', 'AMMO4': '0.287', 'weapon2': '0.330', 'weapon5': '0.460', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '2.826', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '19.977', 'FRAGCOUNT': '66.000'} [2024-08-06 08:51:30,164][52668] Large shaping reward -2.550 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0)] [2024-08-06 08:51:31,318][52670] DAMAGECOUNT value on done: 1010114.0 [2024-08-06 08:51:31,321][52670] Sum rewards: 74.907, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'AMMO2': '0.018', 'weapon5': '0.076', 'AMMO4': '0.090', 'WEAPON5': '0.100', 'HEALTH': '0.124', 'weapon4': '0.134', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.150', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.604', 'FRAGCOUNT': '61.000'} [2024-08-06 08:51:32,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17476.3, 300 sec: 17467.1). Total num frames: 715808768. Throughput: 0: 4339.3. Samples: 178950980. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:32,794][52567] Avg episode reward: [(0, '76.007')] [2024-08-06 08:51:32,804][52663] DAMAGECOUNT value on done: 1034729.0 [2024-08-06 08:51:32,806][52663] Sum rewards: 75.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.686', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.122', 'weapon4': '0.124', 'AMMO3': '0.170', 'AMMO4': '0.251', 'WEAPON5': '0.400', 'weapon2': '0.438', 'WEAPON4': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.130', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '61.000'} [2024-08-06 08:51:32,841][52803] DAMAGECOUNT value on done: 949785.0 [2024-08-06 08:51:32,843][52803] Sum rewards: 81.572, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.010', 'AMMO5': '0.003', 'AMMO2': '0.037', 'weapon5': '0.048', 'WEAPON5': '0.100', 'weapon4': '0.112', 'AMMO4': '0.185', 'WEAPON4': '0.200', 'AMMO3': '0.232', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.220', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.281', 'FRAGCOUNT': '68.000'} [2024-08-06 08:51:33,151][52794] DAMAGECOUNT value on done: 1030193.0 [2024-08-06 08:51:33,152][52794] Sum rewards: 71.018, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.770', 'AMMO5': '0.007', 'AMMO2': '0.035', 'weapon4': '0.052', 'weapon5': '0.142', 'AMMO4': '0.176', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.282', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.706', 'FRAGCOUNT': '60.000'} [2024-08-06 08:51:34,189][52650] Updated weights for policy 0, policy_version 87381 (0.0033) [2024-08-06 08:51:34,392][52670] DAMAGECOUNT value on done: 1030595.0 [2024-08-06 08:51:34,393][52670] Sum rewards: 81.126, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.700', 'AMMO5': '0.018', 'AMMO2': '0.038', 'weapon4': '0.146', 'weapon5': '0.166', 'AMMO4': '0.192', 'AMMO3': '0.243', 'WEAPON4': '0.300', 'weapon2': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.096', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.847', 'FRAGCOUNT': '67.000'} [2024-08-06 08:51:35,594][52663] DAMAGECOUNT value on done: 1013884.0 [2024-08-06 08:51:35,595][52663] Sum rewards: 92.207, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.108', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon5': '0.044', 'AMMO4': '0.125', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.212', 'weapon2': '0.330', 'WEAPON3': '1.150', 'weapon3': '3.224', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '21.858', 'FRAGCOUNT': '73.000'} [2024-08-06 08:51:35,973][52803] DAMAGECOUNT value on done: 955701.0 [2024-08-06 08:51:35,974][52803] Sum rewards: 72.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.026', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'weapon5': '0.136', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.206', 'weapon2': '0.524', 'WEAPON3': '1.250', 'weapon3': '2.914', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.180', 'FRAGCOUNT': '59.000'} [2024-08-06 08:51:36,033][52659] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:51:36,069][52794] DAMAGECOUNT value on done: 1022738.0 [2024-08-06 08:51:36,069][52794] Sum rewards: 69.999, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.920', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO4': '0.133', 'weapon2': '0.156', 'weapon5': '0.176', 'AMMO3': '0.195', 'weapon4': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.220', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.986', 'FRAGCOUNT': '57.000'} [2024-08-06 08:51:37,104][52670] DAMAGECOUNT value on done: 1010288.0 [2024-08-06 08:51:37,116][52670] Sum rewards: 83.191, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.430', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.040', 'weapon4': '0.094', 'AMMO4': '0.099', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.255', 'weapon2': '0.256', 'WEAPON3': '1.600', 'weapon3': '3.396', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.526', 'FRAGCOUNT': '70.000'} [2024-08-06 08:51:37,795][52567] Fps is (10 sec: 18021.6, 60 sec: 17476.1, 300 sec: 17467.0). Total num frames: 715898880. Throughput: 0: 4346.0. Samples: 178977310. Policy #0 lag: (min: 0.0, avg: 3.9, max: 8.0) [2024-08-06 08:51:37,795][52567] Avg episode reward: [(0, '76.089')] [2024-08-06 08:51:38,084][52650] Updated weights for policy 0, policy_version 87391 (0.0021) [2024-08-06 08:51:39,077][52803] DAMAGECOUNT value on done: 950774.0 [2024-08-06 08:51:39,077][52803] Sum rewards: 82.856, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO5': '0.008', 'HEALTH': '0.018', 'AMMO2': '0.019', 'weapon5': '0.028', 'AMMO4': '0.095', 'weapon4': '0.102', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.212', 'weapon2': '0.476', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.210', 'FRAGCOUNT': '69.000'} [2024-08-06 08:51:39,224][52794] DAMAGECOUNT value on done: 1034566.0 [2024-08-06 08:51:39,224][52794] Sum rewards: 73.078, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.410', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.113', 'AMMO3': '0.175', 'WEAPON4': '0.200', 'weapon5': '0.262', 'WEAPON5': '0.300', 'weapon2': '0.718', 'WEAPON3': '1.150', 'weapon3': '2.764', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.878', 'FRAGCOUNT': '59.000'} [2024-08-06 08:51:39,345][52668] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:51:39,528][52666] DAMAGECOUNT value on done: 1021934.0 [2024-08-06 08:51:39,529][52666] Sum rewards: 67.975, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.635', 'AMMO5': '0.017', 'AMMO2': '0.034', 'weapon4': '0.080', 'AMMO4': '0.170', 'AMMO3': '0.198', 'weapon5': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.966', 'HITCOUNT': '3.050', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '55.500'} [2024-08-06 08:51:39,545][52670] DAMAGECOUNT value on done: 1012760.0 [2024-08-06 08:51:39,545][52670] Sum rewards: 70.756, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.140', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.088', 'weapon5': '0.132', 'AMMO4': '0.182', 'AMMO3': '0.190', 'weapon2': '0.256', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'HITCOUNT': '3.140', 'weapon3': '3.302', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:40,406][52664] DAMAGECOUNT value on done: 1055874.0 [2024-08-06 08:51:40,406][52664] Sum rewards: 67.276, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.080', 'AMMO5': '0.005', 'AMMO2': '0.035', 'weapon4': '0.082', 'weapon5': '0.088', 'WEAPON5': '0.150', 'AMMO4': '0.173', 'WEAPON4': '0.250', 'AMMO3': '0.257', 'weapon2': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.108', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.298', 'FRAGCOUNT': '56.000'} [2024-08-06 08:51:42,071][52803] DAMAGECOUNT value on done: 965978.0 [2024-08-06 08:51:42,071][52803] Sum rewards: 73.823, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.280', 'AMMO5': '0.014', 'AMMO2': '0.035', 'weapon4': '0.050', 'AMMO4': '0.175', 'AMMO3': '0.177', 'weapon5': '0.232', 'WEAPON4': '0.300', 'weapon2': '0.302', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.170', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.398', 'FRAGCOUNT': '60.500'} [2024-08-06 08:51:42,200][52794] DAMAGECOUNT value on done: 1017129.0 [2024-08-06 08:51:42,208][52794] Sum rewards: 70.594, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.230', 'AMMO5': '0.027', 'AMMO2': '0.069', 'AMMO3': '0.162', 'weapon5': '0.260', 'weapon4': '0.268', 'AMMO4': '0.344', 'weapon2': '0.438', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.000', 'weapon3': '2.716', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '57.000'} [2024-08-06 08:51:42,650][52670] DAMAGECOUNT value on done: 1024612.0 [2024-08-06 08:51:42,685][52670] Sum rewards: 75.165, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-4.288', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon5': '0.118', 'weapon4': '0.160', 'AMMO4': '0.206', 'weapon2': '0.238', 'WEAPON5': '0.300', 'AMMO3': '0.324', 'WEAPON4': '0.350', 'WEAPON3': '2.000', 'weapon3': '3.190', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '68.000'} [2024-08-06 08:51:42,696][52666] DAMAGECOUNT value on done: 1024353.0 [2024-08-06 08:51:42,697][52666] Sum rewards: 72.362, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.685', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon4': '0.128', 'weapon5': '0.142', 'AMMO4': '0.208', 'weapon2': '0.226', 'AMMO3': '0.310', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.190', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '63.000'} [2024-08-06 08:51:42,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 715980800. Throughput: 0: 4342.7. Samples: 179003480. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:51:42,794][52567] Avg episode reward: [(0, '75.675')] [2024-08-06 08:51:42,955][52664] DAMAGECOUNT value on done: 1062754.0 [2024-08-06 08:51:42,955][52664] Sum rewards: 67.001, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.676', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.124', 'AMMO3': '0.153', 'AMMO4': '0.153', 'weapon5': '0.224', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.672', 'WEAPON3': '0.950', 'weapon3': '2.728', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.359', 'FRAGCOUNT': '53.000'} [2024-08-06 08:51:43,094][52650] Updated weights for policy 0, policy_version 87401 (0.0023) [2024-08-06 08:51:44,795][52794] DAMAGECOUNT value on done: 1030068.0 [2024-08-06 08:51:44,796][52794] Sum rewards: 81.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.916', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon5': '0.134', 'AMMO4': '0.170', 'AMMO3': '0.192', 'WEAPON5': '0.350', 'weapon4': '0.366', 'weapon2': '0.396', 'WEAPON4': '0.450', 'WEAPON3': '1.100', 'weapon3': '2.762', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '20.238', 'FRAGCOUNT': '66.000'} [2024-08-06 08:51:45,041][52803] DAMAGECOUNT value on done: 960629.0 [2024-08-06 08:51:45,041][52803] Sum rewards: 68.258, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.416', 'AMMO5': '0.008', 'ARMOR': '0.012', 'AMMO2': '0.019', 'weapon4': '0.064', 'AMMO4': '0.092', 'weapon5': '0.126', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.202', 'weapon2': '0.474', 'WEAPON3': '1.200', 'weapon3': '3.090', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '56.000'} [2024-08-06 08:51:45,062][52668] DAMAGECOUNT value on done: 1031097.0 [2024-08-06 08:51:45,062][52668] Sum rewards: 70.280, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon4': '0.052', 'weapon5': '0.094', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'weapon2': '0.484', 'WEAPON3': '1.100', 'weapon3': '3.184', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '57.000'} [2024-08-06 08:51:45,876][52670] DAMAGECOUNT value on done: 1014487.0 [2024-08-06 08:51:45,879][52670] Sum rewards: 75.871, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.512', 'AMMO5': '0.009', 'AMMO2': '0.027', 'weapon4': '0.088', 'weapon5': '0.130', 'AMMO4': '0.137', 'AMMO3': '0.202', 'weapon2': '0.270', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.322', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 08:51:45,888][52666] DAMAGECOUNT value on done: 1030311.0 [2024-08-06 08:51:45,888][52666] Sum rewards: 81.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.047', 'AMMO5': '0.020', 'AMMO2': '0.050', 'AMMO3': '0.150', 'weapon2': '0.212', 'AMMO4': '0.252', 'weapon5': '0.290', 'weapon4': '0.448', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.678', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '66.000'} [2024-08-06 08:51:46,043][52664] DAMAGECOUNT value on done: 1068373.0 [2024-08-06 08:51:46,043][52664] Sum rewards: 70.292, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.420', 'AMMO5': '0.004', 'AMMO2': '0.006', 'weapon4': '0.028', 'AMMO4': '0.031', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.176', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.400', 'weapon3': '3.472', 'DAMAGECOUNT': '16.269', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:47,574][52794] DAMAGECOUNT value on done: 1024333.0 [2024-08-06 08:51:47,574][52794] Sum rewards: 68.089, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.440', 'AMMO5': '0.005', 'AMMO2': '0.008', 'AMMO4': '0.038', 'weapon5': '0.100', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.240', 'AMMO3': '0.277', 'weapon2': '0.296', 'WEAPON3': '1.750', 'weapon3': '3.080', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '60.000'} [2024-08-06 08:51:47,794][52567] Fps is (10 sec: 16384.6, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 716062720. Throughput: 0: 4343.3. Samples: 179016520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:51:47,794][52567] Avg episode reward: [(0, '75.409')] [2024-08-06 08:51:47,971][52650] Updated weights for policy 0, policy_version 87411 (0.0012) [2024-08-06 08:51:48,113][52668] DAMAGECOUNT value on done: 1030786.0 [2024-08-06 08:51:48,114][52668] Sum rewards: 67.980, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.522', 'AMMO5': '0.019', 'AMMO2': '0.036', 'weapon4': '0.060', 'weapon5': '0.154', 'AMMO4': '0.181', 'AMMO3': '0.206', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.250', 'weapon3': '3.102', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.923', 'FRAGCOUNT': '55.000'} [2024-08-06 08:51:48,165][52803] DAMAGECOUNT value on done: 948857.0 [2024-08-06 08:51:48,166][52803] Sum rewards: 76.662, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.821', 'AMMO5': '0.016', 'AMMO2': '0.027', 'AMMO4': '0.136', 'AMMO3': '0.167', 'weapon5': '0.168', 'weapon2': '0.260', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.440', 'WEAPON3': '1.100', 'weapon3': '2.902', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.066', 'FRAGCOUNT': '61.000'} [2024-08-06 08:51:48,614][52664] DAMAGECOUNT value on done: 1056424.0 [2024-08-06 08:51:48,615][52664] Sum rewards: 66.753, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.308', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.106', 'AMMO4': '0.173', 'weapon5': '0.186', 'AMMO3': '0.200', 'weapon2': '0.232', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.100', 'HITCOUNT': '3.090', 'weapon3': '3.262', 'DAMAGECOUNT': '16.815', 'FRAGCOUNT': '54.000'} [2024-08-06 08:51:48,872][52670] DAMAGECOUNT value on done: 1011949.0 [2024-08-06 08:51:48,873][52670] Sum rewards: 72.588, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.205', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon4': '0.060', 'weapon5': '0.172', 'AMMO3': '0.195', 'AMMO4': '0.218', 'weapon2': '0.310', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.279', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:48,926][52666] DAMAGECOUNT value on done: 1023993.0 [2024-08-06 08:51:48,929][52666] Sum rewards: 71.669, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.370', 'AMMO5': '0.025', 'AMMO2': '0.070', 'weapon2': '0.226', 'weapon5': '0.274', 'AMMO3': '0.283', 'AMMO4': '0.350', 'weapon4': '0.404', 'WEAPON4': '0.700', 'WEAPON5': '0.700', 'WEAPON3': '1.650', 'weapon3': '2.722', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '62.000'} [2024-08-06 08:51:50,240][52794] DAMAGECOUNT value on done: 1034960.0 [2024-08-06 08:51:50,242][52794] Sum rewards: 85.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.905', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.067', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'AMMO3': '0.222', 'weapon2': '0.434', 'WEAPON3': '1.350', 'weapon3': '3.048', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.775', 'FRAGCOUNT': '69.000'} [2024-08-06 08:51:51,184][52664] DAMAGECOUNT value on done: 1073663.0 [2024-08-06 08:51:51,184][52664] Sum rewards: 75.038, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.670', 'AMMO2': '0.002', 'AMMO4': '0.009', 'AMMO3': '0.229', 'weapon2': '0.604', 'WEAPON3': '1.500', 'weapon3': '3.212', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.192', 'FRAGCOUNT': '63.000'} [2024-08-06 08:51:51,192][52803] DAMAGECOUNT value on done: 965521.0 [2024-08-06 08:51:51,194][52803] Sum rewards: 59.569, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-3.370', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.040', 'weapon4': '0.112', 'weapon5': '0.166', 'AMMO4': '0.199', 'weapon2': '0.234', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'AMMO3': '0.328', 'WEAPON3': '1.900', 'weapon3': '3.094', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.197', 'FRAGCOUNT': '55.000'} [2024-08-06 08:51:51,318][52668] DAMAGECOUNT value on done: 1026733.0 [2024-08-06 08:51:51,318][52668] Sum rewards: 74.639, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.018', 'AMMO2': '0.056', 'weapon4': '0.072', 'weapon5': '0.208', 'AMMO3': '0.215', 'AMMO4': '0.280', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '3.088', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '62.000'} [2024-08-06 08:51:52,034][52666] DAMAGECOUNT value on done: 1015799.0 [2024-08-06 08:51:52,034][52666] Sum rewards: 75.516, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.007', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.082', 'WEAPON4': '0.100', 'weapon5': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'HEALTH': '0.250', 'weapon2': '0.286', 'WEAPON3': '1.050', 'weapon3': '3.370', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.733', 'FRAGCOUNT': '60.000'} [2024-08-06 08:51:52,053][52670] DAMAGECOUNT value on done: 1014183.0 [2024-08-06 08:51:52,053][52670] Sum rewards: 70.921, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.098', 'AMMO5': '0.016', 'AMMO2': '0.034', 'AMMO4': '0.170', 'weapon5': '0.172', 'weapon4': '0.174', 'AMMO3': '0.219', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.526', 'WEAPON3': '1.350', 'weapon3': '2.868', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '59.000'} [2024-08-06 08:51:52,367][52650] Updated weights for policy 0, policy_version 87421 (0.0013) [2024-08-06 08:51:52,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17467.0). Total num frames: 716161024. Throughput: 0: 4348.0. Samples: 179042560. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:51:52,794][52567] Avg episode reward: [(0, '75.322')] [2024-08-06 08:51:52,914][52794] DAMAGECOUNT value on done: 1037260.0 [2024-08-06 08:51:52,915][52794] Sum rewards: 67.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.430', 'AMMO5': '0.007', 'AMMO2': '0.032', 'AMMO4': '0.158', 'weapon5': '0.182', 'AMMO3': '0.255', 'weapon4': '0.276', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.608', 'WEAPON3': '1.500', 'weapon3': '2.702', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.688', 'FRAGCOUNT': '55.000'} [2024-08-06 08:51:53,697][52664] DAMAGECOUNT value on done: 1067009.0 [2024-08-06 08:51:53,697][52664] Sum rewards: 74.755, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'AMMO5': '0.007', 'AMMO2': '0.027', 'weapon5': '0.060', 'weapon4': '0.098', 'AMMO4': '0.133', 'AMMO3': '0.195', 'WEAPON5': '0.200', 'WEAPON4': '0.300', 'weapon2': '0.470', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '61.000'} [2024-08-06 08:51:54,364][52803] DAMAGECOUNT value on done: 951737.0 [2024-08-06 08:51:54,365][52803] Sum rewards: 64.590, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.630', 'AMMO5': '0.025', 'AMMO2': '0.052', 'weapon4': '0.156', 'weapon5': '0.188', 'AMMO3': '0.213', 'AMMO4': '0.259', 'weapon2': '0.302', 'WEAPON4': '0.550', 'WEAPON5': '0.650', 'WEAPON3': '1.450', 'HITCOUNT': '3.090', 'weapon3': '3.094', 'DAMAGECOUNT': '16.440', 'FRAGCOUNT': '56.000'} [2024-08-06 08:51:54,473][52668] DAMAGECOUNT value on done: 1033979.0 [2024-08-06 08:51:54,473][52668] Sum rewards: 92.150, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.172', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.120', 'weapon5': '0.220', 'AMMO3': '0.223', 'AMMO4': '0.228', 'weapon2': '0.390', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.350', 'weapon3': '2.926', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.612', 'FRAGCOUNT': '74.000'} [2024-08-06 08:51:55,055][52666] DAMAGECOUNT value on done: 1018764.0 [2024-08-06 08:51:55,056][52666] Sum rewards: 69.138, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.158', 'AMMO5': '0.013', 'AMMO2': '0.052', 'weapon4': '0.064', 'AMMO3': '0.229', 'weapon5': '0.250', 'AMMO4': '0.260', 'WEAPON4': '0.350', 'weapon2': '0.394', 'WEAPON5': '0.450', 'WEAPON3': '1.500', 'weapon3': '3.006', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '18.018', 'FRAGCOUNT': '58.000'} [2024-08-06 08:51:55,067][52670] DAMAGECOUNT value on done: 1011189.0 [2024-08-06 08:51:55,068][52670] Sum rewards: 82.854, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.099', 'AMMO5': '0.017', 'AMMO2': '0.033', 'weapon4': '0.062', 'AMMO4': '0.167', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'weapon5': '0.262', 'weapon2': '0.332', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.142', 'FRAGCOUNT': '67.000'} [2024-08-06 08:51:55,449][52794] DAMAGECOUNT value on done: 1026388.0 [2024-08-06 08:51:55,451][52794] Sum rewards: 69.898, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.800', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.044', 'AMMO4': '0.120', 'weapon5': '0.140', 'weapon2': '0.208', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.263', 'WEAPON3': '1.650', 'HITCOUNT': '3.220', 'weapon3': '3.332', 'DAMAGECOUNT': '17.439', 'FRAGCOUNT': '60.000'} [2024-08-06 08:51:56,270][52664] DAMAGECOUNT value on done: 1056247.0 [2024-08-06 08:51:56,271][52664] Sum rewards: 66.587, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.400', 'AMMO5': '0.008', 'AMMO2': '0.039', 'weapon4': '0.098', 'weapon5': '0.128', 'AMMO4': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'weapon2': '0.428', 'WEAPON3': '1.200', 'HITCOUNT': '3.120', 'weapon3': '3.162', 'DAMAGECOUNT': '16.008', 'FRAGCOUNT': '55.000'} [2024-08-06 08:51:57,463][52650] Updated weights for policy 0, policy_version 87431 (0.0025) [2024-08-06 08:51:57,487][52666] DAMAGECOUNT value on done: 1020198.0 [2024-08-06 08:51:57,489][52666] Sum rewards: 72.055, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.209', 'AMMO5': '0.007', 'AMMO2': '0.018', 'AMMO4': '0.091', 'AMMO3': '0.138', 'weapon5': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.214', 'weapon2': '0.342', 'WEAPON3': '1.000', 'weapon3': '3.040', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.433', 'FRAGCOUNT': '56.000'} [2024-08-06 08:51:57,503][52670] DAMAGECOUNT value on done: 1009212.0 [2024-08-06 08:51:57,503][52670] Sum rewards: 73.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.940', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.069', 'weapon4': '0.096', 'AMMO3': '0.269', 'weapon2': '0.576', 'WEAPON3': '1.600', 'weapon3': '3.012', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '17.685', 'FRAGCOUNT': '63.000'} [2024-08-06 08:51:57,524][52803] DAMAGECOUNT value on done: 961300.0 [2024-08-06 08:51:57,525][52803] Sum rewards: 81.686, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.366', 'AMMO5': '0.010', 'AMMO2': '0.026', 'AMMO4': '0.131', 'weapon4': '0.146', 'weapon5': '0.178', 'AMMO3': '0.202', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.094', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '66.000'} [2024-08-06 08:51:57,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17339.7, 300 sec: 17439.2). Total num frames: 716242944. Throughput: 0: 4338.0. Samples: 179068420. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:51:57,794][52567] Avg episode reward: [(0, '74.925')] [2024-08-06 08:51:57,836][52668] DAMAGECOUNT value on done: 1018914.0 [2024-08-06 08:51:57,837][52668] Sum rewards: 70.299, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.316', 'AMMO5': '0.013', 'AMMO2': '0.034', 'weapon4': '0.072', 'weapon5': '0.156', 'AMMO4': '0.170', 'AMMO3': '0.247', 'weapon2': '0.256', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.268', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 08:51:59,167][52664] DAMAGECOUNT value on done: 1058838.0 [2024-08-06 08:51:59,169][52664] Sum rewards: 78.771, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.333', 'AMMO5': '0.011', 'AMMO2': '0.044', 'weapon5': '0.156', 'weapon4': '0.190', 'AMMO4': '0.220', 'AMMO3': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.538', 'WEAPON3': '1.450', 'weapon3': '2.860', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.597', 'FRAGCOUNT': '66.000'} [2024-08-06 08:51:59,418][52667] DAMAGECOUNT value on done: 1021376.0 [2024-08-06 08:51:59,421][52667] Sum rewards: 77.148, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.144', 'AMMO5': '0.024', 'AMMO2': '0.087', 'weapon4': '0.148', 'AMMO3': '0.218', 'weapon5': '0.372', 'AMMO4': '0.434', 'weapon2': '0.470', 'WEAPON5': '0.650', 'WEAPON4': '0.750', 'WEAPON3': '1.250', 'weapon3': '2.654', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:00,366][52671] Large shaping reward -2.528 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.279, -93.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:52:00,470][52666] DAMAGECOUNT value on done: 1012981.0 [2024-08-06 08:52:00,471][52666] Sum rewards: 82.241, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.991', 'AMMO5': '0.017', 'AMMO2': '0.046', 'weapon4': '0.068', 'AMMO3': '0.165', 'weapon5': '0.180', 'AMMO4': '0.229', 'WEAPON4': '0.350', 'weapon2': '0.390', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.174', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.884', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:00,541][52670] DAMAGECOUNT value on done: 1025379.0 [2024-08-06 08:52:00,542][52670] Sum rewards: 68.848, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.805', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon5': '0.136', 'weapon4': '0.192', 'AMMO3': '0.200', 'AMMO4': '0.221', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.388', 'WEAPON3': '1.200', 'weapon3': '3.006', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.163', 'FRAGCOUNT': '57.500'} [2024-08-06 08:52:00,601][52803] DAMAGECOUNT value on done: 960429.0 [2024-08-06 08:52:00,602][52803] Sum rewards: 67.724, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.870', 'AMMO5': '0.017', 'AMMO2': '0.050', 'weapon5': '0.206', 'AMMO3': '0.220', 'weapon4': '0.230', 'AMMO4': '0.248', 'WEAPON5': '0.500', 'WEAPON4': '0.550', 'weapon2': '0.842', 'WEAPON3': '1.350', 'weapon3': '2.406', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.334', 'FRAGCOUNT': '55.000'} [2024-08-06 08:52:00,688][52668] DAMAGECOUNT value on done: 1030822.0 [2024-08-06 08:52:00,688][52668] Sum rewards: 74.408, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.444', 'AMMO5': '0.012', 'AMMO2': '0.033', 'AMMO4': '0.163', 'AMMO3': '0.207', 'weapon5': '0.214', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.442', 'weapon4': '0.476', 'WEAPON3': '1.250', 'weapon3': '2.490', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.925', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:01,806][52664] DAMAGECOUNT value on done: 1066135.0 [2024-08-06 08:52:01,807][52664] Sum rewards: 74.892, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.810', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.120', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'weapon2': '0.340', 'WEAPON3': '1.550', 'weapon3': '3.264', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.065', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:02,016][52650] Updated weights for policy 0, policy_version 87441 (0.0011) [2024-08-06 08:52:02,411][52667] DAMAGECOUNT value on done: 1041696.0 [2024-08-06 08:52:02,413][52667] Sum rewards: 72.271, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.000', 'AMMO5': '0.007', 'AMMO2': '0.015', 'weapon4': '0.046', 'AMMO4': '0.074', 'weapon5': '0.106', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.244', 'weapon2': '0.474', 'WEAPON3': '1.500', 'weapon3': '3.152', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.983', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:02,794][52567] Fps is (10 sec: 15564.8, 60 sec: 17203.2, 300 sec: 17383.7). Total num frames: 716316672. Throughput: 0: 4335.2. Samples: 179081370. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:52:02,794][52567] Avg episode reward: [(0, '75.000')] [2024-08-06 08:52:03,424][52666] DAMAGECOUNT value on done: 1025785.0 [2024-08-06 08:52:03,425][52666] Sum rewards: 71.892, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.190', 'AMMO5': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.092', 'AMMO3': '0.162', 'weapon5': '0.196', 'WEAPON5': '0.250', 'weapon2': '0.272', 'WEAPON4': '0.300', 'weapon4': '0.336', 'WEAPON3': '1.050', 'weapon3': '2.932', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.503', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:03,477][52670] DAMAGECOUNT value on done: 1007190.0 [2024-08-06 08:52:03,478][52670] Sum rewards: 76.162, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.805', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.054', 'weapon5': '0.092', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.300', 'WEAPON3': '1.400', 'weapon3': '3.292', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.495', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:03,636][52803] DAMAGECOUNT value on done: 969167.0 [2024-08-06 08:52:03,637][52803] Sum rewards: 65.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.430', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon5': '0.172', 'AMMO4': '0.183', 'AMMO3': '0.223', 'weapon4': '0.228', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.400', 'weapon3': '2.836', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '54.000'} [2024-08-06 08:52:03,871][52668] DAMAGECOUNT value on done: 1030204.0 [2024-08-06 08:52:03,872][52668] Sum rewards: 81.171, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.345', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.074', 'WEAPON4': '0.100', 'AMMO4': '0.114', 'weapon5': '0.148', 'AMMO3': '0.188', 'WEAPON5': '0.250', 'weapon2': '0.396', 'WEAPON3': '1.200', 'weapon3': '3.168', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:04,849][52664] DAMAGECOUNT value on done: 1060297.0 [2024-08-06 08:52:04,849][52664] Sum rewards: 78.205, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.290', 'AMMO5': '0.014', 'AMMO2': '0.048', 'AMMO3': '0.202', 'weapon5': '0.220', 'AMMO4': '0.238', 'weapon2': '0.298', 'weapon4': '0.316', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.250', 'weapon3': '2.886', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:05,547][52667] DAMAGECOUNT value on done: 1034687.0 [2024-08-06 08:52:05,551][52667] Sum rewards: 67.175, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.938', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon4': '0.038', 'weapon5': '0.084', 'AMMO4': '0.120', 'weapon2': '0.188', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.280', 'weapon3': '3.534', 'DAMAGECOUNT': '16.245', 'FRAGCOUNT': '55.000'} [2024-08-06 08:52:06,591][52650] Updated weights for policy 0, policy_version 87451 (0.0012) [2024-08-06 08:52:06,652][52666] DAMAGECOUNT value on done: 1012905.0 [2024-08-06 08:52:06,653][52666] Sum rewards: 66.565, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.447', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.029', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO4': '0.145', 'WEAPON5': '0.150', 'AMMO3': '0.230', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.256', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '55.000'} [2024-08-06 08:52:06,698][52670] DAMAGECOUNT value on done: 1021166.0 [2024-08-06 08:52:06,699][52670] Sum rewards: 72.883, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.612', 'AMMO5': '0.009', 'weapon4': '0.028', 'AMMO2': '0.053', 'weapon5': '0.128', 'AMMO3': '0.205', 'AMMO4': '0.266', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:06,792][52803] DAMAGECOUNT value on done: 964494.0 [2024-08-06 08:52:06,792][52803] Sum rewards: 86.586, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.089', 'AMMO5': '0.008', 'AMMO2': '0.024', 'weapon4': '0.044', 'weapon5': '0.120', 'AMMO4': '0.121', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.259', 'weapon2': '0.324', 'WEAPON3': '1.600', 'weapon3': '3.262', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.492', 'FRAGCOUNT': '72.000'} [2024-08-06 08:52:07,045][52668] DAMAGECOUNT value on done: 1019725.0 [2024-08-06 08:52:07,045][52668] Sum rewards: 62.849, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.015', 'AMMO5': '0.015', 'AMMO2': '0.052', 'AMMO3': '0.183', 'weapon5': '0.184', 'AMMO4': '0.259', 'weapon4': '0.386', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.754', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '16.377', 'FRAGCOUNT': '52.500'} [2024-08-06 08:52:07,444][52664] DAMAGECOUNT value on done: 1071599.0 [2024-08-06 08:52:07,444][52664] Sum rewards: 71.922, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.870', 'AMMO5': '0.003', 'AMMO2': '0.012', 'WEAPON4': '0.050', 'weapon5': '0.054', 'AMMO4': '0.061', 'weapon4': '0.082', 'WEAPON5': '0.100', 'AMMO3': '0.172', 'weapon2': '0.866', 'WEAPON3': '1.100', 'weapon3': '2.830', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.322', 'FRAGCOUNT': '57.000'} [2024-08-06 08:52:07,697][52665] DAMAGECOUNT value on done: 1013017.0 [2024-08-06 08:52:07,698][52665] Sum rewards: 73.352, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.062', 'AMMO4': '0.139', 'HEALTH': '0.140', 'weapon5': '0.144', 'AMMO3': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.514', 'WEAPON3': '1.000', 'weapon3': '3.038', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '59.000'} [2024-08-06 08:52:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 716414976. Throughput: 0: 4329.8. Samples: 179107390. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:52:07,802][52567] Avg episode reward: [(0, '74.434')] [2024-08-06 08:52:08,418][52667] DAMAGECOUNT value on done: 1039305.0 [2024-08-06 08:52:08,420][52667] Sum rewards: 77.337, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.984', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.116', 'AMMO4': '0.137', 'weapon4': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.204', 'AMMO3': '0.252', 'WEAPON3': '1.600', 'weapon3': '3.224', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.944', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:09,180][52666] DAMAGECOUNT value on done: 1023005.0 [2024-08-06 08:52:09,181][52666] Sum rewards: 81.008, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.666', 'AMMO5': '0.008', 'AMMO2': '0.045', 'weapon4': '0.048', 'weapon5': '0.138', 'AMMO4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.256', 'weapon2': '0.328', 'WEAPON3': '1.550', 'weapon3': '3.246', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '19.212', 'FRAGCOUNT': '69.000'} [2024-08-06 08:52:09,315][52670] DAMAGECOUNT value on done: 1026438.0 [2024-08-06 08:52:09,316][52670] Sum rewards: 85.921, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.480', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.136', 'weapon4': '0.142', 'AMMO4': '0.157', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.050', 'weapon3': '3.250', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.403', 'FRAGCOUNT': '68.500'} [2024-08-06 08:52:09,881][52803] DAMAGECOUNT value on done: 960092.0 [2024-08-06 08:52:09,883][52803] Sum rewards: 73.490, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.075', 'AMMO5': '0.009', 'AMMO2': '0.015', 'AMMO4': '0.076', 'WEAPON4': '0.100', 'weapon5': '0.122', 'weapon4': '0.188', 'AMMO3': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.410', 'WEAPON3': '1.250', 'weapon3': '3.100', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:09,896][52668] DAMAGECOUNT value on done: 1023926.0 [2024-08-06 08:52:09,897][52668] Sum rewards: 80.623, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.446', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.112', 'AMMO4': '0.165', 'AMMO3': '0.203', 'weapon5': '0.212', 'weapon2': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.068', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.209', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:10,313][52664] DAMAGECOUNT value on done: 1069750.0 [2024-08-06 08:52:10,314][52664] Sum rewards: 82.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO2': '0.020', 'weapon5': '0.046', 'AMMO4': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.177', 'WEAPON5': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.278', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.539', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:10,828][52665] DAMAGECOUNT value on done: 1025365.0 [2024-08-06 08:52:10,829][52665] Sum rewards: 71.123, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.672', 'AMMO5': '0.014', 'AMMO2': '0.058', 'weapon4': '0.138', 'weapon5': '0.214', 'AMMO3': '0.237', 'AMMO4': '0.289', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.432', 'WEAPON3': '1.450', 'weapon3': '2.924', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.268', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:11,136][52667] DAMAGECOUNT value on done: 1042539.0 [2024-08-06 08:52:11,137][52667] Sum rewards: 76.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.873', 'AMMO5': '0.005', 'AMMO2': '0.042', 'weapon5': '0.102', 'WEAPON5': '0.150', 'weapon4': '0.188', 'AMMO4': '0.209', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.286', 'ARMOR': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.256', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.973', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:11,223][52820] DAMAGECOUNT value on done: 946574.0 [2024-08-06 08:52:11,223][52820] Sum rewards: 83.657, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.790', 'AMMO5': '0.015', 'AMMO2': '0.049', 'weapon4': '0.074', 'AMMO4': '0.245', 'weapon5': '0.250', 'AMMO3': '0.269', 'weapon2': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '3.108', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.374', 'FRAGCOUNT': '71.000'} [2024-08-06 08:52:11,530][52671] Large shaping reward 2.576 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.525, 175.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:52:11,747][52650] Updated weights for policy 0, policy_version 87461 (0.0020) [2024-08-06 08:52:12,093][52666] DAMAGECOUNT value on done: 1005880.0 [2024-08-06 08:52:12,093][52666] Sum rewards: 78.001, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-4.354', 'AMMO5': '0.014', 'AMMO2': '0.040', 'AMMO4': '0.201', 'weapon5': '0.206', 'weapon4': '0.208', 'weapon2': '0.294', 'AMMO3': '0.326', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.950', 'weapon3': '2.984', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.491', 'FRAGCOUNT': '68.000'} [2024-08-06 08:52:12,121][52670] DAMAGECOUNT value on done: 1017284.0 [2024-08-06 08:52:12,121][52670] Sum rewards: 73.494, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.708', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.132', 'weapon2': '0.150', 'weapon4': '0.196', 'AMMO3': '0.201', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.350', 'weapon3': '3.310', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:12,584][52668] DAMAGECOUNT value on done: 1031182.0 [2024-08-06 08:52:12,586][52668] Sum rewards: 76.603, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.409', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon4': '0.150', 'weapon5': '0.158', 'weapon2': '0.198', 'AMMO4': '0.199', 'AMMO3': '0.233', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.236', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.294', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:12,794][52567] Fps is (10 sec: 18841.7, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 716505088. Throughput: 0: 4348.4. Samples: 179133520. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:52:12,794][52567] Avg episode reward: [(0, '75.153')] [2024-08-06 08:52:12,917][52664] DAMAGECOUNT value on done: 1066577.0 [2024-08-06 08:52:12,918][52664] Sum rewards: 73.668, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.374', 'AMMO5': '0.011', 'AMMO2': '0.046', 'AMMO3': '0.128', 'weapon5': '0.154', 'weapon2': '0.194', 'AMMO4': '0.227', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon4': '0.462', 'WEAPON3': '0.800', 'weapon3': '2.986', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '16.914', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:13,971][52665] DAMAGECOUNT value on done: 1018607.0 [2024-08-06 08:52:13,972][52665] Sum rewards: 74.745, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.304', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.049', 'weapon5': '0.078', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO3': '0.272', 'weapon2': '0.378', 'WEAPON3': '1.650', 'weapon3': '3.260', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:14,294][52820] DAMAGECOUNT value on done: 951762.0 [2024-08-06 08:52:14,296][52820] Sum rewards: 65.361, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.080', 'AMMO5': '0.003', 'AMMO2': '0.031', 'weapon5': '0.034', 'weapon4': '0.036', 'WEAPON5': '0.050', 'WEAPON4': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '54.000'} [2024-08-06 08:52:14,446][52667] DAMAGECOUNT value on done: 1033489.0 [2024-08-06 08:52:14,447][52667] Sum rewards: 72.405, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.378', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.036', 'weapon5': '0.060', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.180', 'AMMO3': '0.206', 'weapon2': '0.512', 'WEAPON3': '1.300', 'weapon3': '3.238', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.376', 'FRAGCOUNT': '59.000'} [2024-08-06 08:52:15,191][52666] DAMAGECOUNT value on done: 1031533.0 [2024-08-06 08:52:15,192][52666] Sum rewards: 81.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.300', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon5': '0.160', 'AMMO4': '0.163', 'AMMO3': '0.227', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.304', 'weapon2': '0.342', 'WEAPON3': '1.350', 'weapon3': '2.914', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '68.000'} [2024-08-06 08:52:15,224][52670] DAMAGECOUNT value on done: 1003561.0 [2024-08-06 08:52:15,226][52670] Sum rewards: 79.458, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.560', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.118', 'AMMO4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.368', 'WEAPON3': '1.300', 'weapon3': '3.190', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.927', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:15,410][52664] DAMAGECOUNT value on done: 1080387.0 [2024-08-06 08:52:15,410][52664] Sum rewards: 71.625, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.530', 'AMMO5': '0.018', 'AMMO2': '0.058', 'AMMO3': '0.146', 'weapon4': '0.244', 'weapon5': '0.270', 'AMMO4': '0.288', 'weapon2': '0.356', 'WEAPON5': '0.450', 'WEAPON4': '0.500', 'WEAPON3': '1.000', 'weapon3': '2.856', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.498', 'FRAGCOUNT': '55.500'} [2024-08-06 08:52:15,567][52668] DAMAGECOUNT value on done: 1024825.0 [2024-08-06 08:52:15,567][52668] Sum rewards: 79.534, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.360', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.144', 'weapon4': '0.168', 'AMMO4': '0.203', 'weapon2': '0.218', 'AMMO3': '0.272', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.142', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '70.000'} [2024-08-06 08:52:15,861][52650] Updated weights for policy 0, policy_version 87471 (0.0031) [2024-08-06 08:52:17,073][52665] DAMAGECOUNT value on done: 1022600.0 [2024-08-06 08:52:17,073][52665] Sum rewards: 85.545, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.500', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.018', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.088', 'AMMO3': '0.246', 'weapon2': '0.334', 'WEAPON3': '1.500', 'weapon3': '3.412', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.565', 'FRAGCOUNT': '71.000'} [2024-08-06 08:52:17,292][52667] DAMAGECOUNT value on done: 1032858.0 [2024-08-06 08:52:17,293][52667] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.602', 'AMMO5': '0.015', 'AMMO2': '0.031', 'weapon4': '0.108', 'weapon5': '0.152', 'AMMO4': '0.157', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.446', 'WEAPON3': '1.150', 'weapon3': '3.052', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.721', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:17,458][52820] DAMAGECOUNT value on done: 953550.0 [2024-08-06 08:52:17,458][52820] Sum rewards: 81.569, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.510', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.058', 'weapon5': '0.092', 'AMMO3': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon4': '0.156', 'weapon2': '0.444', 'WEAPON3': '0.950', 'weapon3': '3.134', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:17,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17342.6, 300 sec: 17411.5). Total num frames: 716587008. Throughput: 0: 4344.9. Samples: 179146500. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:52:17,794][52567] Avg episode reward: [(0, '74.931')] [2024-08-06 08:52:17,813][52659] DAMAGECOUNT value on done: 1026155.0 [2024-08-06 08:52:17,813][52659] Sum rewards: 77.560, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.550', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon4': '0.118', 'weapon5': '0.124', 'AMMO4': '0.188', 'weapon2': '0.206', 'AMMO3': '0.241', 'WEAPON5': '0.400', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.252', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '66.500'} [2024-08-06 08:52:18,297][52670] DAMAGECOUNT value on done: 1018701.0 [2024-08-06 08:52:18,298][52670] Sum rewards: 93.832, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.532', 'AMMO5': '0.008', 'AMMO2': '0.021', 'AMMO4': '0.107', 'weapon5': '0.126', 'AMMO3': '0.159', 'weapon4': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.520', 'WEAPON3': '1.100', 'weapon3': '2.944', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '22.050', 'FRAGCOUNT': '74.000'} [2024-08-06 08:52:18,309][52666] DAMAGECOUNT value on done: 1026403.0 [2024-08-06 08:52:18,311][52666] Sum rewards: 82.672, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.107', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.127', 'weapon5': '0.144', 'weapon4': '0.158', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.574', 'WEAPON3': '1.150', 'weapon3': '2.896', 'HITCOUNT': '4.100', 'DAMAGECOUNT': '20.151', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:18,402][52668] DAMAGECOUNT value on done: 1024275.0 [2024-08-06 08:52:18,404][52668] Sum rewards: 82.784, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.370', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.140', 'weapon2': '0.204', 'weapon5': '0.206', 'AMMO3': '0.234', 'weapon4': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.028', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '21.657', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:18,440][52664] DAMAGECOUNT value on done: 1075929.0 [2024-08-06 08:52:18,440][52664] Sum rewards: 74.445, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.691', 'AMMO5': '0.008', 'AMMO2': '0.044', 'weapon4': '0.102', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO4': '0.222', 'weapon2': '0.244', 'WEAPON4': '0.250', 'AMMO3': '0.269', 'WEAPON3': '1.700', 'weapon3': '3.294', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '18.069', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:20,378][52665] DAMAGECOUNT value on done: 1001344.0 [2024-08-06 08:52:20,378][52665] Sum rewards: 67.092, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.610', 'AMMO5': '0.014', 'AMMO2': '0.028', 'AMMO4': '0.139', 'weapon4': '0.146', 'weapon5': '0.156', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.044', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.313', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:20,410][52667] DAMAGECOUNT value on done: 1029473.0 [2024-08-06 08:52:20,411][52667] Sum rewards: 78.965, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.889', 'AMMO5': '0.013', 'AMMO2': '0.050', 'weapon4': '0.198', 'weapon5': '0.236', 'AMMO4': '0.250', 'AMMO3': '0.252', 'weapon2': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.880', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.016', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:20,596][52820] DAMAGECOUNT value on done: 943069.0 [2024-08-06 08:52:20,596][52820] Sum rewards: 82.667, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.435', 'AMMO5': '0.010', 'AMMO2': '0.018', 'weapon4': '0.086', 'AMMO4': '0.091', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'weapon5': '0.202', 'WEAPON5': '0.300', 'weapon2': '0.342', 'WEAPON3': '1.000', 'weapon3': '3.166', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.704', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:20,824][52664] DAMAGECOUNT value on done: 1075476.0 [2024-08-06 08:52:20,824][52664] Sum rewards: 77.600, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.040', 'AMMO5': '0.013', 'AMMO2': '0.031', 'weapon4': '0.060', 'AMMO4': '0.157', 'weapon5': '0.162', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.352', 'WEAPON3': '1.250', 'weapon3': '3.172', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.453', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:20,832][52659] DAMAGECOUNT value on done: 1027759.0 [2024-08-06 08:52:20,833][52659] Sum rewards: 82.709, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.884', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.031', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.154', 'AMMO3': '0.184', 'weapon2': '0.564', 'WEAPON3': '1.150', 'weapon3': '3.170', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:20,970][52668] DAMAGECOUNT value on done: 1016056.0 [2024-08-06 08:52:20,971][52668] Sum rewards: 79.359, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.765', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.082', 'weapon5': '0.082', 'AMMO4': '0.094', 'WEAPON5': '0.150', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon2': '0.500', 'WEAPON3': '1.050', 'weapon3': '3.200', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:21,055][52650] Updated weights for policy 0, policy_version 87481 (0.0030) [2024-08-06 08:52:21,357][52666] DAMAGECOUNT value on done: 1025825.0 [2024-08-06 08:52:21,358][52666] Sum rewards: 92.781, reward structure: {'DEATHCOUNT': '-13.500', 'AMMO2': '0.001', 'AMMO4': '0.003', 'HEALTH': '0.054', 'weapon2': '0.212', 'AMMO3': '0.214', 'WEAPON3': '1.250', 'weapon3': '3.630', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '21.768', 'FRAGCOUNT': '75.000'} [2024-08-06 08:52:21,375][52670] DAMAGECOUNT value on done: 1026256.0 [2024-08-06 08:52:21,375][52670] Sum rewards: 79.031, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.075', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.022', 'AMMO4': '0.042', 'WEAPON4': '0.100', 'weapon5': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.158', 'weapon2': '0.346', 'WEAPON3': '1.100', 'weapon3': '3.360', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:21,673][52662] DAMAGECOUNT value on done: 1025793.0 [2024-08-06 08:52:21,673][52662] Sum rewards: 75.963, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.790', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.042', 'weapon5': '0.148', 'AMMO4': '0.166', 'weapon2': '0.248', 'WEAPON4': '0.250', 'AMMO3': '0.287', 'WEAPON5': '0.350', 'WEAPON3': '1.850', 'weapon3': '3.280', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.236', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:22,794][52567] Fps is (10 sec: 16383.8, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 716668928. Throughput: 0: 4336.9. Samples: 179172470. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:52:22,795][52567] Avg episode reward: [(0, '75.227')] [2024-08-06 08:52:22,905][52667] DAMAGECOUNT value on done: 1034108.0 [2024-08-06 08:52:22,905][52667] Sum rewards: 75.215, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.007', 'AMMO2': '0.021', 'weapon5': '0.066', 'AMMO4': '0.106', 'WEAPON5': '0.150', 'weapon4': '0.162', 'AMMO3': '0.186', 'WEAPON4': '0.200', 'HEALTH': '0.200', 'weapon2': '0.286', 'WEAPON3': '1.050', 'weapon3': '3.280', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.860', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:23,511][52665] DAMAGECOUNT value on done: 1002812.0 [2024-08-06 08:52:23,514][52665] Sum rewards: 64.207, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.040', 'AMMO5': '0.015', 'AMMO2': '0.045', 'weapon5': '0.142', 'weapon4': '0.192', 'AMMO3': '0.198', 'AMMO4': '0.225', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.514', 'WEAPON3': '1.250', 'weapon3': '2.866', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.080', 'FRAGCOUNT': '54.000'} [2024-08-06 08:52:23,665][52666] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:52:23,669][52664] DAMAGECOUNT value on done: 1059153.0 [2024-08-06 08:52:23,670][52664] Sum rewards: 78.692, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.124', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.022', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'AMMO3': '0.236', 'weapon2': '0.382', 'WEAPON3': '1.400', 'weapon3': '3.360', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.575', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:23,827][52820] DAMAGECOUNT value on done: 950355.0 [2024-08-06 08:52:23,828][52820] Sum rewards: 73.413, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.040', 'weapon5': '0.142', 'AMMO4': '0.185', 'AMMO3': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.518', 'WEAPON3': '1.300', 'weapon3': '3.096', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.702', 'FRAGCOUNT': '58.500'} [2024-08-06 08:52:23,918][52670] DAMAGECOUNT value on done: 1021777.0 [2024-08-06 08:52:23,920][52670] Sum rewards: 80.229, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.620', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.102', 'AMMO4': '0.127', 'weapon5': '0.174', 'AMMO3': '0.177', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.518', 'WEAPON3': '1.200', 'weapon3': '2.974', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:23,928][52666] DAMAGECOUNT value on done: 1013801.0 [2024-08-06 08:52:23,929][52666] Sum rewards: 54.423, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.056', 'weapon5': '0.142', 'AMMO4': '0.189', 'AMMO3': '0.205', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.602', 'WEAPON3': '1.300', 'HITCOUNT': '2.930', 'weapon3': '3.012', 'DAMAGECOUNT': '14.667', 'FRAGCOUNT': '44.500'} [2024-08-06 08:52:24,046][52659] DAMAGECOUNT value on done: 1039687.0 [2024-08-06 08:52:24,046][52659] Sum rewards: 76.345, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.138', 'weapon5': '0.160', 'AMMO4': '0.178', 'AMMO3': '0.293', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.308', 'WEAPON3': '1.700', 'weapon3': '3.068', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.053', 'FRAGCOUNT': '67.000'} [2024-08-06 08:52:24,069][52668] DAMAGECOUNT value on done: 1016629.0 [2024-08-06 08:52:24,070][52668] Sum rewards: 79.445, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.540', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.107', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.644', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.071', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:24,463][52649] Large shaping reward 3.651 for [('FRAGCOUNT', 3.0, 3.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:52:24,789][52662] DAMAGECOUNT value on done: 1034202.0 [2024-08-06 08:52:24,791][52662] Sum rewards: 95.093, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.444', 'AMMO5': '0.007', 'AMMO2': '0.017', 'AMMO4': '0.082', 'weapon5': '0.156', 'weapon4': '0.164', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.218', 'AMMO3': '0.234', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '4.280', 'DAMAGECOUNT': '22.785', 'FRAGCOUNT': '78.000'} [2024-08-06 08:52:25,775][52650] Updated weights for policy 0, policy_version 87491 (0.0012) [2024-08-06 08:52:25,930][52667] DAMAGECOUNT value on done: 1038935.0 [2024-08-06 08:52:25,930][52667] Sum rewards: 70.841, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.090', 'AMMO2': '0.005', 'AMMO5': '0.007', 'AMMO4': '0.024', 'weapon5': '0.066', 'WEAPON5': '0.100', 'AMMO3': '0.174', 'weapon2': '0.594', 'WEAPON3': '1.100', 'weapon3': '3.222', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '15.909', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:26,532][52664] DAMAGECOUNT value on done: 1063470.0 [2024-08-06 08:52:26,532][52664] Sum rewards: 78.435, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.130', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon4': '0.054', 'weapon5': '0.140', 'AMMO4': '0.192', 'AMMO3': '0.277', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.374', 'WEAPON3': '1.700', 'weapon3': '3.180', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.469', 'FRAGCOUNT': '68.000'} [2024-08-06 08:52:26,619][52665] DAMAGECOUNT value on done: 1016219.0 [2024-08-06 08:52:26,619][52665] Sum rewards: 80.795, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.635', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.140', 'AMMO4': '0.179', 'AMMO3': '0.180', 'weapon2': '0.264', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.316', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.282', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:26,700][52668] DAMAGECOUNT value on done: 1007066.0 [2024-08-06 08:52:26,701][52668] Sum rewards: 73.763, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.396', 'AMMO2': '0.014', 'AMMO4': '0.067', 'AMMO3': '0.217', 'weapon2': '0.672', 'WEAPON3': '1.300', 'weapon3': '3.178', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.021', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:26,754][52659] DAMAGECOUNT value on done: 1032691.0 [2024-08-06 08:52:26,756][52659] Sum rewards: 65.016, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.722', 'AMMO5': '0.009', 'AMMO2': '0.041', 'weapon4': '0.112', 'weapon5': '0.114', 'AMMO4': '0.205', 'WEAPON5': '0.250', 'weapon2': '0.262', 'AMMO3': '0.286', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.210', 'weapon3': '3.242', 'DAMAGECOUNT': '15.807', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:26,978][52670] DAMAGECOUNT value on done: 1019046.0 [2024-08-06 08:52:26,979][52670] Sum rewards: 77.487, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.044', 'AMMO5': '0.005', 'AMMO2': '0.017', 'weapon5': '0.062', 'weapon4': '0.078', 'AMMO4': '0.084', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.270', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:26,998][52666] DAMAGECOUNT value on done: 1011732.0 [2024-08-06 08:52:26,998][52666] Sum rewards: 80.894, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.608', 'AMMO5': '0.012', 'WEAPON1': '0.020', 'AMMO2': '0.027', 'weapon4': '0.074', 'AMMO4': '0.135', 'AMMO3': '0.193', 'weapon5': '0.236', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.536', 'WEAPON3': '1.100', 'weapon3': '2.826', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:27,012][52820] DAMAGECOUNT value on done: 937217.0 [2024-08-06 08:52:27,012][52820] Sum rewards: 79.744, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.014', 'AMMO4': '0.029', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.372', 'WEAPON3': '1.400', 'weapon3': '3.436', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.431', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:27,600][52662] DAMAGECOUNT value on done: 1036685.0 [2024-08-06 08:52:27,601][52662] Sum rewards: 73.920, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.162', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.032', 'AMMO4': '0.072', 'weapon5': '0.126', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'WEAPON5': '0.250', 'weapon2': '0.452', 'WEAPON3': '1.350', 'weapon3': '3.166', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:27,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 716767232. Throughput: 0: 4333.8. Samples: 179198500. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:52:27,794][52567] Avg episode reward: [(0, '75.562')] [2024-08-06 08:52:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000087496_716767232.pth... [2024-08-06 08:52:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000086985_712581120.pth [2024-08-06 08:52:29,061][52667] DAMAGECOUNT value on done: 1025890.0 [2024-08-06 08:52:29,064][52667] Sum rewards: 72.485, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.768', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'weapon5': '0.178', 'AMMO3': '0.202', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.250', 'weapon3': '3.270', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '59.000'} [2024-08-06 08:52:29,351][52664] DAMAGECOUNT value on done: 1075654.0 [2024-08-06 08:52:29,352][52664] Sum rewards: 65.222, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-3.419', 'ARMOR': '0.004', 'AMMO5': '0.018', 'AMMO2': '0.054', 'weapon4': '0.086', 'weapon5': '0.208', 'weapon2': '0.250', 'AMMO4': '0.272', 'AMMO3': '0.300', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.800', 'weapon3': '3.140', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:29,754][52665] DAMAGECOUNT value on done: 1015499.0 [2024-08-06 08:52:29,755][52665] Sum rewards: 74.761, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.120', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.021', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.138', 'weapon2': '0.804', 'WEAPON3': '0.900', 'weapon3': '3.028', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.427', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:30,048][52666] DAMAGECOUNT value on done: 1034211.0 [2024-08-06 08:52:30,049][52666] Sum rewards: 81.446, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.833', 'AMMO2': '0.009', 'AMMO4': '0.046', 'weapon2': '0.214', 'AMMO3': '0.226', 'WEAPON3': '1.500', 'weapon3': '3.560', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.813', 'FRAGCOUNT': '69.000'} [2024-08-06 08:52:30,084][52659] DAMAGECOUNT value on done: 1022930.0 [2024-08-06 08:52:30,085][52659] Sum rewards: 71.628, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.920', 'AMMO5': '0.017', 'AMMO2': '0.056', 'weapon4': '0.200', 'AMMO3': '0.203', 'weapon5': '0.204', 'AMMO4': '0.282', 'weapon2': '0.410', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.114', 'FRAGCOUNT': '57.000'} [2024-08-06 08:52:30,105][52662] DAMAGECOUNT value on done: 1026356.0 [2024-08-06 08:52:30,107][52662] Sum rewards: 88.431, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.785', 'AMMO5': '0.007', 'weapon4': '0.014', 'AMMO2': '0.024', 'weapon5': '0.044', 'WEAPON4': '0.050', 'AMMO4': '0.119', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon2': '0.246', 'WEAPON3': '1.300', 'weapon3': '3.538', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '20.694', 'FRAGCOUNT': '72.000'} [2024-08-06 08:52:30,180][52820] DAMAGECOUNT value on done: 945990.0 [2024-08-06 08:52:30,180][52820] Sum rewards: 73.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.950', 'AMMO5': '0.016', 'AMMO2': '0.051', 'weapon5': '0.180', 'weapon4': '0.196', 'AMMO3': '0.206', 'AMMO4': '0.253', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.696', 'WEAPON3': '1.200', 'weapon3': '2.668', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.017', 'FRAGCOUNT': '58.500'} [2024-08-06 08:52:30,181][52668] DAMAGECOUNT value on done: 1025071.0 [2024-08-06 08:52:30,186][52668] Sum rewards: 76.546, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.339', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.104', 'weapon5': '0.184', 'AMMO3': '0.202', 'weapon2': '0.222', 'AMMO4': '0.270', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.270', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.869', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:30,274][52650] Updated weights for policy 0, policy_version 87501 (0.0031) [2024-08-06 08:52:31,045][52811] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:52:31,841][52664] DAMAGECOUNT value on done: 1057896.0 [2024-08-06 08:52:31,842][52664] Sum rewards: 78.644, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'weapon5': '0.116', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon2': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.436', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '19.134', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:32,045][52667] DAMAGECOUNT value on done: 1023866.0 [2024-08-06 08:52:32,047][52667] Sum rewards: 58.475, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.310', 'AMMO5': '0.015', 'AMMO2': '0.072', 'weapon5': '0.170', 'AMMO3': '0.217', 'weapon4': '0.248', 'AMMO4': '0.358', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '2.814', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.191', 'FRAGCOUNT': '49.000'} [2024-08-06 08:52:32,581][52659] DAMAGECOUNT value on done: 1028658.0 [2024-08-06 08:52:32,581][52659] Sum rewards: 75.100, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.396', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.064', 'weapon5': '0.080', 'AMMO4': '0.097', 'AMMO3': '0.139', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.284', 'WEAPON3': '0.850', 'weapon3': '3.422', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '58.500'} [2024-08-06 08:52:32,794][52567] Fps is (10 sec: 18022.6, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 716849152. Throughput: 0: 4327.1. Samples: 179211240. Policy #0 lag: (min: 0.0, avg: 4.0, max: 8.0) [2024-08-06 08:52:32,794][52567] Avg episode reward: [(0, '75.840')] [2024-08-06 08:52:32,823][52665] DAMAGECOUNT value on done: 1022491.0 [2024-08-06 08:52:32,824][52665] Sum rewards: 78.686, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.716', 'AMMO5': '0.013', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.094', 'AMMO4': '0.195', 'AMMO3': '0.273', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.700', 'weapon3': '3.276', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.520', 'FRAGCOUNT': '67.000'} [2024-08-06 08:52:33,068][52662] DAMAGECOUNT value on done: 1043751.0 [2024-08-06 08:52:33,080][52662] Sum rewards: 95.692, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.060', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.034', 'WEAPON4': '0.100', 'weapon5': '0.106', 'AMMO4': '0.110', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.436', 'WEAPON3': '1.300', 'weapon3': '3.210', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '22.035', 'FRAGCOUNT': '78.000'} [2024-08-06 08:52:33,155][52666] DAMAGECOUNT value on done: 1006656.0 [2024-08-06 08:52:33,155][52666] Sum rewards: 79.804, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.594', 'AMMO5': '0.014', 'AMMO2': '0.022', 'AMMO4': '0.111', 'weapon5': '0.120', 'weapon4': '0.150', 'AMMO3': '0.224', 'WEAPON4': '0.300', 'weapon2': '0.364', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.146', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '19.836', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:33,310][52668] DAMAGECOUNT value on done: 1024288.0 [2024-08-06 08:52:33,311][52668] Sum rewards: 79.947, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.819', 'AMMO5': '0.010', 'WEAPON1': '0.010', 'AMMO2': '0.042', 'weapon4': '0.158', 'weapon5': '0.172', 'AMMO3': '0.200', 'AMMO4': '0.208', 'WEAPON5': '0.250', 'WEAPON4': '0.400', 'weapon2': '0.472', 'WEAPON3': '1.200', 'weapon3': '2.826', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.858', 'FRAGCOUNT': '65.000'} [2024-08-06 08:52:33,333][52820] DAMAGECOUNT value on done: 948876.0 [2024-08-06 08:52:33,335][52820] Sum rewards: 89.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.864', 'AMMO5': '0.003', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon5': '0.052', 'AMMO4': '0.070', 'AMMO3': '0.200', 'weapon4': '0.222', 'weapon2': '0.560', 'WEAPON3': '1.300', 'weapon3': '2.972', 'HITCOUNT': '4.250', 'DAMAGECOUNT': '21.342', 'FRAGCOUNT': '72.000'} [2024-08-06 08:52:35,154][52667] DAMAGECOUNT value on done: 1035476.0 [2024-08-06 08:52:35,156][52667] Sum rewards: 79.370, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.195', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'weapon4': '0.150', 'weapon5': '0.180', 'AMMO3': '0.197', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.516', 'WEAPON3': '1.200', 'weapon3': '2.952', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.981', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:35,171][52650] Updated weights for policy 0, policy_version 87511 (0.0011) [2024-08-06 08:52:35,542][52662] DAMAGECOUNT value on done: 1019901.0 [2024-08-06 08:52:35,544][52662] Sum rewards: 69.708, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.020', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.096', 'weapon5': '0.166', 'AMMO3': '0.201', 'AMMO4': '0.203', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.418', 'WEAPON3': '1.250', 'weapon3': '3.132', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.749', 'FRAGCOUNT': '56.000'} [2024-08-06 08:52:35,647][52659] DAMAGECOUNT value on done: 1030145.0 [2024-08-06 08:52:35,650][52659] Sum rewards: 71.403, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.990', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon5': '0.070', 'AMMO3': '0.142', 'AMMO4': '0.170', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.454', 'WEAPON3': '1.000', 'weapon3': '3.064', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:35,721][52665] DAMAGECOUNT value on done: 1012607.0 [2024-08-06 08:52:35,724][52665] Sum rewards: 65.047, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.456', 'AMMO5': '0.018', 'AMMO2': '0.053', 'weapon4': '0.102', 'weapon5': '0.178', 'AMMO3': '0.261', 'AMMO4': '0.267', 'weapon2': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.650', 'weapon3': '3.160', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '17.067', 'FRAGCOUNT': '57.000'} [2024-08-06 08:52:36,272][52666] DAMAGECOUNT value on done: 1019890.0 [2024-08-06 08:52:36,273][52666] Sum rewards: 75.334, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.772', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon5': '0.128', 'AMMO4': '0.176', 'AMMO3': '0.197', 'weapon4': '0.218', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.498', 'WEAPON3': '1.300', 'weapon3': '2.928', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.933', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:36,394][52820] DAMAGECOUNT value on done: 954073.0 [2024-08-06 08:52:36,396][52820] Sum rewards: 76.550, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.936', 'AMMO5': '0.014', 'AMMO2': '0.027', 'weapon4': '0.070', 'AMMO4': '0.133', 'AMMO3': '0.187', 'WEAPON4': '0.250', 'weapon5': '0.356', 'weapon2': '0.398', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '2.914', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:36,548][52668] DAMAGECOUNT value on done: 1025489.0 [2024-08-06 08:52:36,548][52668] Sum rewards: 79.970, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.098', 'weapon4': '0.104', 'AMMO3': '0.197', 'weapon2': '0.344', 'WEAPON3': '1.300', 'weapon3': '3.332', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.429', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:37,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.3, 300 sec: 17411.5). Total num frames: 716931072. Throughput: 0: 4328.4. Samples: 179237340. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:52:37,794][52567] Avg episode reward: [(0, '76.461')] [2024-08-06 08:52:38,005][52667] DAMAGECOUNT value on done: 1024953.0 [2024-08-06 08:52:38,005][52667] Sum rewards: 63.508, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.530', 'AMMO5': '0.013', 'AMMO2': '0.046', 'weapon4': '0.180', 'weapon5': '0.188', 'AMMO4': '0.230', 'AMMO3': '0.240', 'weapon2': '0.320', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.450', 'weapon3': '2.996', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '55.000'} [2024-08-06 08:52:38,214][52659] DAMAGECOUNT value on done: 1028094.0 [2024-08-06 08:52:38,222][52659] Sum rewards: 67.678, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.934', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.058', 'AMMO3': '0.178', 'weapon5': '0.222', 'AMMO4': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.750', 'WEAPON3': '1.100', 'weapon3': '2.748', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.559', 'FRAGCOUNT': '53.000'} [2024-08-06 08:52:38,448][52665] DAMAGECOUNT value on done: 1027935.0 [2024-08-06 08:52:38,449][52665] Sum rewards: 68.045, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.263', 'AMMO2': '0.014', 'WEAPON4': '0.050', 'AMMO4': '0.070', 'AMMO3': '0.182', 'weapon4': '0.202', 'weapon2': '0.442', 'WEAPON3': '1.150', 'weapon3': '3.082', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.905', 'FRAGCOUNT': '55.000'} [2024-08-06 08:52:38,599][52662] DAMAGECOUNT value on done: 1021300.0 [2024-08-06 08:52:38,599][52662] Sum rewards: 75.195, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.940', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.076', 'weapon5': '0.156', 'AMMO4': '0.206', 'AMMO3': '0.229', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.400', 'weapon3': '2.980', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.952', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:39,424][52820] DAMAGECOUNT value on done: 962402.0 [2024-08-06 08:52:39,424][52820] Sum rewards: 86.030, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.084', 'AMMO4': '0.105', 'weapon4': '0.122', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.214', 'weapon2': '0.224', 'WEAPON3': '1.400', 'weapon3': '3.354', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.860', 'FRAGCOUNT': '72.000'} [2024-08-06 08:52:39,493][52650] Updated weights for policy 0, policy_version 87521 (0.0012) [2024-08-06 08:52:39,657][52668] DAMAGECOUNT value on done: 1025289.0 [2024-08-06 08:52:39,658][52668] Sum rewards: 88.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.747', 'AMMO5': '0.003', 'AMMO2': '0.004', 'weapon4': '0.014', 'AMMO4': '0.018', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.251', 'weapon2': '0.292', 'WEAPON3': '1.500', 'weapon3': '3.394', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.579', 'FRAGCOUNT': '73.000'} [2024-08-06 08:52:40,781][52795] DAMAGECOUNT value on done: 946404.0 [2024-08-06 08:52:40,783][52795] Sum rewards: 68.027, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.560', 'AMMO5': '0.016', 'AMMO2': '0.038', 'weapon5': '0.158', 'AMMO4': '0.190', 'weapon2': '0.200', 'weapon4': '0.230', 'AMMO3': '0.232', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.198', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '17.175', 'FRAGCOUNT': '57.000'} [2024-08-06 08:52:41,009][52667] DAMAGECOUNT value on done: 1034273.0 [2024-08-06 08:52:41,009][52667] Sum rewards: 69.387, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.844', 'AMMO5': '0.012', 'AMMO2': '0.032', 'AMMO4': '0.162', 'weapon5': '0.164', 'AMMO3': '0.228', 'weapon4': '0.256', 'WEAPON5': '0.300', 'weapon2': '0.366', 'WEAPON4': '0.400', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '58.000'} [2024-08-06 08:52:41,018][52659] DAMAGECOUNT value on done: 1026766.0 [2024-08-06 08:52:41,020][52659] Sum rewards: 73.525, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.624', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.108', 'AMMO4': '0.132', 'weapon5': '0.142', 'AMMO3': '0.179', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.100', 'HITCOUNT': '3.140', 'weapon3': '3.188', 'DAMAGECOUNT': '17.580', 'FRAGCOUNT': '59.000'} [2024-08-06 08:52:41,218][52662] DAMAGECOUNT value on done: 1042802.0 [2024-08-06 08:52:41,220][52662] Sum rewards: 81.909, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.156', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.052', 'weapon5': '0.132', 'AMMO4': '0.148', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.302', 'WEAPON3': '1.200', 'weapon3': '3.276', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.507', 'FRAGCOUNT': '68.000'} [2024-08-06 08:52:41,361][52665] DAMAGECOUNT value on done: 1021436.0 [2024-08-06 08:52:41,363][52665] Sum rewards: 74.391, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.062', 'weapon5': '0.192', 'AMMO4': '0.230', 'AMMO3': '0.255', 'weapon2': '0.342', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.120', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '16.782', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:42,245][52668] DAMAGECOUNT value on done: 1029803.0 [2024-08-06 08:52:42,245][52668] Sum rewards: 72.376, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.032', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.162', 'weapon5': '0.170', 'AMMO4': '0.202', 'AMMO3': '0.221', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.440', 'WEAPON3': '1.300', 'weapon3': '2.982', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:42,542][52820] DAMAGECOUNT value on done: 943636.0 [2024-08-06 08:52:42,542][52820] Sum rewards: 91.014, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.900', 'AMMO5': '0.010', 'AMMO2': '0.040', 'AMMO3': '0.143', 'weapon5': '0.180', 'AMMO4': '0.202', 'weapon4': '0.262', 'weapon2': '0.282', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '0.950', 'weapon3': '3.000', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.075', 'FRAGCOUNT': '70.000'} [2024-08-06 08:52:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 717029376. Throughput: 0: 4346.0. Samples: 179263990. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:52:42,794][52567] Avg episode reward: [(0, '76.635')] [2024-08-06 08:52:43,757][52665] DAMAGECOUNT value on done: 1018708.0 [2024-08-06 08:52:43,758][52665] Sum rewards: 76.755, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.016', 'AMMO2': '0.036', 'HEALTH': '0.096', 'weapon4': '0.116', 'AMMO3': '0.166', 'AMMO4': '0.182', 'weapon5': '0.252', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '0.950', 'weapon3': '2.986', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.543', 'FRAGCOUNT': '59.500'} [2024-08-06 08:52:43,876][52795] DAMAGECOUNT value on done: 939995.0 [2024-08-06 08:52:43,876][52795] Sum rewards: 71.971, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.648', 'AMMO5': '0.022', 'AMMO2': '0.047', 'AMMO3': '0.226', 'AMMO4': '0.233', 'weapon4': '0.292', 'weapon5': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.550', 'weapon2': '0.856', 'WEAPON3': '1.400', 'weapon3': '2.224', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:44,033][52659] DAMAGECOUNT value on done: 1037270.0 [2024-08-06 08:52:44,036][52659] Sum rewards: 78.646, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.486', 'AMMO5': '0.020', 'AMMO2': '0.046', 'weapon4': '0.138', 'AMMO3': '0.193', 'weapon5': '0.204', 'AMMO4': '0.231', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.090', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.644', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:44,181][52667] DAMAGECOUNT value on done: 1040931.0 [2024-08-06 08:52:44,182][52667] Sum rewards: 72.412, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.028', 'AMMO5': '0.013', 'AMMO2': '0.049', 'weapon4': '0.108', 'weapon5': '0.202', 'AMMO3': '0.226', 'AMMO4': '0.244', 'weapon2': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.068', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:44,361][52662] DAMAGECOUNT value on done: 1027013.0 [2024-08-06 08:52:44,361][52662] Sum rewards: 80.915, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.853', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.034', 'weapon5': '0.046', 'weapon4': '0.098', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.160', 'weapon2': '0.364', 'WEAPON3': '1.150', 'weapon3': '3.338', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.718', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:44,435][52650] Updated weights for policy 0, policy_version 87531 (0.0019) [2024-08-06 08:52:45,627][52820] DAMAGECOUNT value on done: 955918.0 [2024-08-06 08:52:45,628][52820] Sum rewards: 73.093, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.290', 'AMMO5': '0.015', 'AMMO2': '0.046', 'weapon5': '0.166', 'weapon4': '0.224', 'AMMO4': '0.228', 'AMMO3': '0.283', 'WEAPON5': '0.350', 'weapon2': '0.390', 'WEAPON4': '0.400', 'WEAPON3': '1.650', 'weapon3': '2.872', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:46,590][52667] DAMAGECOUNT value on done: 1041787.0 [2024-08-06 08:52:46,592][52667] Sum rewards: 62.019, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.003', 'AMMO2': '0.015', 'weapon5': '0.048', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO4': '0.074', 'WEAPON4': '0.100', 'HEALTH': '0.126', 'AMMO3': '0.169', 'weapon2': '0.384', 'WEAPON3': '1.000', 'HITCOUNT': '2.970', 'weapon3': '3.348', 'DAMAGECOUNT': '15.162', 'FRAGCOUNT': '49.000'} [2024-08-06 08:52:46,738][52662] DAMAGECOUNT value on done: 1031408.0 [2024-08-06 08:52:46,739][52662] Sum rewards: 67.248, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon4': '0.064', 'HEALTH': '0.118', 'weapon5': '0.164', 'AMMO3': '0.180', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.412', 'WEAPON3': '1.000', 'weapon3': '3.094', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.638', 'FRAGCOUNT': '54.000'} [2024-08-06 08:52:46,857][52665] DAMAGECOUNT value on done: 1016616.0 [2024-08-06 08:52:46,857][52665] Sum rewards: 73.386, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.100', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.068', 'AMMO4': '0.131', 'weapon5': '0.154', 'WEAPON4': '0.200', 'AMMO3': '0.230', 'weapon2': '0.282', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.282', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.532', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:46,951][52795] DAMAGECOUNT value on done: 942116.0 [2024-08-06 08:52:46,954][52795] Sum rewards: 77.645, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.662', 'AMMO5': '0.012', 'AMMO2': '0.025', 'weapon4': '0.030', 'weapon5': '0.092', 'AMMO4': '0.125', 'WEAPON4': '0.200', 'AMMO3': '0.222', 'WEAPON5': '0.300', 'weapon2': '0.474', 'WEAPON3': '1.400', 'weapon3': '3.130', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '64.500'} [2024-08-06 08:52:47,042][52659] DAMAGECOUNT value on done: 1024886.0 [2024-08-06 08:52:47,044][52659] Sum rewards: 73.412, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.070', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon4': '0.014', 'weapon5': '0.044', 'AMMO4': '0.050', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.241', 'weapon2': '0.290', 'WEAPON3': '1.500', 'weapon3': '3.434', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '18.417', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:47,629][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5.0), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:52:47,719][52649] DAMAGECOUNT value on done: 998309.0 [2024-08-06 08:52:47,721][52649] Sum rewards: 88.947, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.920', 'AMMO5': '0.010', 'AMMO2': '0.035', 'weapon4': '0.162', 'AMMO4': '0.177', 'weapon5': '0.182', 'AMMO3': '0.268', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.030', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.560', 'FRAGCOUNT': '77.000'} [2024-08-06 08:52:47,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 717111296. Throughput: 0: 4350.2. Samples: 179277130. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:52:47,794][52567] Avg episode reward: [(0, '76.550')] [2024-08-06 08:52:47,928][52665] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:52:48,082][52614] Signal inference workers to stop experience collection... (16150 times) [2024-08-06 08:52:48,082][52614] Signal inference workers to resume experience collection... (16150 times) [2024-08-06 08:52:48,134][52650] InferenceWorker_p0-w0: stopping experience collection (16150 times) [2024-08-06 08:52:48,135][52650] InferenceWorker_p0-w0: resuming experience collection (16150 times) [2024-08-06 08:52:48,973][52660] DAMAGECOUNT value on done: 1026137.0 [2024-08-06 08:52:48,981][52660] Sum rewards: 80.742, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.008', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.080', 'weapon5': '0.084', 'AMMO4': '0.124', 'WEAPON5': '0.150', 'AMMO3': '0.181', 'WEAPON4': '0.200', 'weapon2': '0.332', 'WEAPON3': '1.150', 'weapon3': '3.344', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.485', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:48,985][52820] DAMAGECOUNT value on done: 969954.0 [2024-08-06 08:52:48,985][52820] Sum rewards: 89.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.822', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.048', 'AMMO4': '0.129', 'weapon5': '0.140', 'AMMO3': '0.247', 'WEAPON4': '0.250', 'weapon2': '0.290', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.260', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.021', 'FRAGCOUNT': '74.000'} [2024-08-06 08:52:49,162][52650] Updated weights for policy 0, policy_version 87541 (0.0014) [2024-08-06 08:52:49,224][52662] DAMAGECOUNT value on done: 1027933.0 [2024-08-06 08:52:49,225][52662] Sum rewards: 75.702, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.190', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.042', 'AMMO4': '0.123', 'weapon5': '0.126', 'weapon2': '0.178', 'AMMO3': '0.219', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.500', 'weapon3': '3.432', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.949', 'FRAGCOUNT': '64.000'} [2024-08-06 08:52:49,591][52667] DAMAGECOUNT value on done: 1037994.0 [2024-08-06 08:52:49,593][52667] Sum rewards: 69.445, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.783', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.100', 'weapon5': '0.112', 'weapon2': '0.170', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'WEAPON3': '1.250', 'HITCOUNT': '3.380', 'weapon3': '3.536', 'DAMAGECOUNT': '17.274', 'FRAGCOUNT': '56.000'} [2024-08-06 08:52:49,981][52665] DAMAGECOUNT value on done: 1016002.0 [2024-08-06 08:52:49,984][52665] Sum rewards: 73.620, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.920', 'AMMO5': '0.007', 'weapon4': '0.028', 'AMMO2': '0.030', 'weapon5': '0.052', 'AMMO4': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.212', 'weapon2': '0.484', 'WEAPON3': '1.400', 'weapon3': '3.238', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:50,050][52659] DAMAGECOUNT value on done: 1033463.0 [2024-08-06 08:52:50,052][52659] Sum rewards: 69.312, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.022', 'AMMO5': '0.011', 'AMMO2': '0.029', 'weapon4': '0.080', 'AMMO4': '0.142', 'weapon5': '0.178', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.490', 'WEAPON3': '1.100', 'weapon3': '3.052', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '56.000'} [2024-08-06 08:52:50,208][52795] DAMAGECOUNT value on done: 957555.0 [2024-08-06 08:52:50,209][52795] Sum rewards: 76.744, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.800', 'AMMO2': '0.010', 'AMMO4': '0.050', 'AMMO3': '0.193', 'weapon2': '0.776', 'WEAPON3': '1.150', 'weapon3': '3.090', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '62.000'} [2024-08-06 08:52:50,953][52649] DAMAGECOUNT value on done: 990209.0 [2024-08-06 08:52:50,954][52649] Sum rewards: 67.816, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.450', 'AMMO5': '0.012', 'AMMO2': '0.044', 'weapon4': '0.100', 'weapon5': '0.130', 'AMMO4': '0.220', 'weapon2': '0.256', 'AMMO3': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.202', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.448', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:51,781][52660] DAMAGECOUNT value on done: 1016488.0 [2024-08-06 08:52:51,782][52660] Sum rewards: 84.165, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.834', 'AMMO5': '0.006', 'weapon4': '0.014', 'AMMO2': '0.016', 'WEAPON4': '0.050', 'AMMO4': '0.081', 'weapon5': '0.128', 'WEAPON5': '0.150', 'AMMO3': '0.185', 'weapon2': '0.502', 'WEAPON3': '1.250', 'weapon3': '3.162', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.385', 'FRAGCOUNT': '67.500'} [2024-08-06 08:52:52,109][52820] DAMAGECOUNT value on done: 955840.0 [2024-08-06 08:52:52,109][52820] Sum rewards: 73.730, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.798', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.134', 'AMMO3': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.234', 'weapon2': '0.320', 'WEAPON3': '1.150', 'weapon3': '3.070', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.426', 'FRAGCOUNT': '59.000'} [2024-08-06 08:52:52,131][52667] DAMAGECOUNT value on done: 1034914.0 [2024-08-06 08:52:52,131][52667] Sum rewards: 94.922, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.701', 'AMMO5': '0.012', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.109', 'weapon5': '0.136', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'weapon2': '0.324', 'WEAPON3': '1.200', 'weapon3': '3.344', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.579', 'FRAGCOUNT': '77.000'} [2024-08-06 08:52:52,162][52662] DAMAGECOUNT value on done: 1024006.0 [2024-08-06 08:52:52,162][52662] Sum rewards: 69.514, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.620', 'AMMO5': '0.003', 'AMMO2': '0.007', 'AMMO4': '0.033', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon4': '0.070', 'AMMO3': '0.202', 'weapon2': '0.426', 'WEAPON3': '1.250', 'weapon3': '3.278', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.412', 'FRAGCOUNT': '57.000'} [2024-08-06 08:52:52,707][52665] DAMAGECOUNT value on done: 1020543.0 [2024-08-06 08:52:52,708][52665] Sum rewards: 77.416, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.894', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon5': '0.072', 'AMMO4': '0.110', 'weapon4': '0.146', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.220', 'weapon2': '0.454', 'WEAPON3': '1.350', 'weapon3': '3.096', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.783', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:52,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 717193216. Throughput: 0: 4349.6. Samples: 179303120. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:52:52,794][52567] Avg episode reward: [(0, '76.750')] [2024-08-06 08:52:52,869][52665] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:52:53,376][52795] DAMAGECOUNT value on done: 941575.0 [2024-08-06 08:52:53,377][52795] Sum rewards: 73.214, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.349', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.066', 'AMMO4': '0.111', 'weapon5': '0.122', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.434', 'WEAPON3': '1.400', 'weapon3': '3.168', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.157', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:53,429][52659] DAMAGECOUNT value on done: 1028731.0 [2024-08-06 08:52:53,429][52659] Sum rewards: 66.504, reward structure: {'DEATHCOUNT': '-14.250', 'AMMO5': '0.007', 'AMMO2': '0.021', 'HEALTH': '0.046', 'AMMO4': '0.103', 'weapon5': '0.126', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.220', 'weapon4': '0.220', 'AMMO3': '0.231', 'WEAPON3': '1.250', 'HITCOUNT': '3.130', 'weapon3': '3.166', 'DAMAGECOUNT': '15.885', 'FRAGCOUNT': '56.000'} [2024-08-06 08:52:53,678][52649] DAMAGECOUNT value on done: 1006386.0 [2024-08-06 08:52:53,679][52649] Sum rewards: 57.877, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.017', 'weapon4': '0.070', 'AMMO4': '0.085', 'weapon5': '0.180', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.267', 'weapon2': '0.426', 'WEAPON3': '1.550', 'weapon3': '2.982', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '15.300', 'FRAGCOUNT': '50.000'} [2024-08-06 08:52:53,766][52650] Updated weights for policy 0, policy_version 87551 (0.0014) [2024-08-06 08:52:54,234][52660] DAMAGECOUNT value on done: 1027947.0 [2024-08-06 08:52:54,235][52660] Sum rewards: 76.766, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.008', 'AMMO2': '0.033', 'weapon5': '0.136', 'AMMO4': '0.166', 'weapon4': '0.170', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.468', 'WEAPON3': '1.350', 'weapon3': '2.992', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '63.000'} [2024-08-06 08:52:55,192][52820] DAMAGECOUNT value on done: 953839.0 [2024-08-06 08:52:55,194][52820] Sum rewards: 77.604, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.729', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.060', 'weapon5': '0.230', 'AMMO3': '0.252', 'AMMO4': '0.265', 'weapon2': '0.332', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.056', 'FRAGCOUNT': '66.000'} [2024-08-06 08:52:55,226][52662] DAMAGECOUNT value on done: 1020249.0 [2024-08-06 08:52:55,228][52662] Sum rewards: 83.412, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.340', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.040', 'AMMO4': '0.099', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.211', 'weapon2': '0.404', 'WEAPON3': '1.350', 'weapon3': '3.342', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '20.820', 'FRAGCOUNT': '68.000'} [2024-08-06 08:52:55,261][52665] DAMAGECOUNT value on done: 1015704.0 [2024-08-06 08:52:55,262][52665] Sum rewards: 86.253, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.300', 'AMMO5': '0.014', 'AMMO2': '0.014', 'weapon5': '0.040', 'AMMO4': '0.069', 'weapon4': '0.152', 'WEAPON4': '0.200', 'weapon2': '0.220', 'AMMO3': '0.256', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.372', 'HITCOUNT': '4.060', 'DAMAGECOUNT': '21.207', 'FRAGCOUNT': '73.000'} [2024-08-06 08:52:55,340][52667] DAMAGECOUNT value on done: 1037858.0 [2024-08-06 08:52:55,340][52667] Sum rewards: 84.484, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.646', 'AMMO5': '0.022', 'AMMO2': '0.046', 'weapon4': '0.180', 'AMMO3': '0.184', 'weapon2': '0.184', 'weapon5': '0.222', 'AMMO4': '0.232', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.050', 'weapon3': '3.122', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '69.000'} [2024-08-06 08:52:56,075][52659] DAMAGECOUNT value on done: 1025927.0 [2024-08-06 08:52:56,077][52659] Sum rewards: 74.138, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.660', 'AMMO5': '0.005', 'AMMO2': '0.011', 'AMMO4': '0.055', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.198', 'weapon2': '0.572', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.297', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:56,104][52649] DAMAGECOUNT value on done: 1007126.0 [2024-08-06 08:52:56,105][52649] Sum rewards: 64.240, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.120', 'AMMO5': '0.006', 'weapon4': '0.024', 'AMMO2': '0.025', 'weapon5': '0.072', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.262', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.492', 'DAMAGECOUNT': '15.471', 'FRAGCOUNT': '54.000'} [2024-08-06 08:52:56,607][52795] DAMAGECOUNT value on done: 942858.0 [2024-08-06 08:52:56,608][52795] Sum rewards: 73.234, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.490', 'AMMO5': '0.003', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon4': '0.056', 'WEAPON4': '0.100', 'AMMO3': '0.166', 'weapon2': '0.754', 'WEAPON3': '1.050', 'weapon3': '3.078', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.563', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:57,292][52660] DAMAGECOUNT value on done: 1039218.0 [2024-08-06 08:52:57,293][52660] Sum rewards: 71.553, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.570', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.112', 'AMMO3': '0.172', 'weapon5': '0.186', 'AMMO4': '0.244', 'weapon2': '0.244', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.100', 'HITCOUNT': '3.220', 'weapon3': '3.234', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:57,575][52647] DAMAGECOUNT value on done: 1095475.0 [2024-08-06 08:52:57,577][52647] Sum rewards: 83.345, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.644', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.036', 'weapon5': '0.116', 'AMMO4': '0.129', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.238', 'weapon2': '0.332', 'WEAPON3': '1.450', 'weapon3': '3.302', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '70.000'} [2024-08-06 08:52:57,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 717283328. Throughput: 0: 4355.6. Samples: 179329520. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:52:57,794][52567] Avg episode reward: [(0, '76.158')] [2024-08-06 08:52:57,802][52811] Large shaping reward 2.606 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.555, 185.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:52:58,287][52665] DAMAGECOUNT value on done: 1007112.0 [2024-08-06 08:52:58,287][52665] Sum rewards: 73.564, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.485', 'AMMO5': '0.017', 'AMMO2': '0.064', 'weapon4': '0.068', 'AMMO3': '0.190', 'weapon5': '0.222', 'weapon2': '0.266', 'AMMO4': '0.321', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'HITCOUNT': '3.160', 'weapon3': '3.206', 'DAMAGECOUNT': '16.635', 'FRAGCOUNT': '61.000'} [2024-08-06 08:52:58,374][52662] DAMAGECOUNT value on done: 1030606.0 [2024-08-06 08:52:58,376][52662] Sum rewards: 60.728, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.825', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.062', 'weapon5': '0.142', 'AMMO4': '0.192', 'AMMO3': '0.245', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.670', 'WEAPON3': '1.500', 'weapon3': '2.910', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.221', 'FRAGCOUNT': '51.000'} [2024-08-06 08:52:58,411][52820] DAMAGECOUNT value on done: 954418.0 [2024-08-06 08:52:58,415][52820] Sum rewards: 72.142, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.110', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon5': '0.098', 'weapon4': '0.114', 'AMMO4': '0.130', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.268', 'WEAPON3': '1.300', 'weapon3': '3.290', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.344', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:58,639][52650] Updated weights for policy 0, policy_version 87561 (0.0015) [2024-08-06 08:52:58,942][52659] DAMAGECOUNT value on done: 1027840.0 [2024-08-06 08:52:58,944][52659] Sum rewards: 71.704, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.440', 'AMMO5': '0.021', 'AMMO2': '0.046', 'AMMO3': '0.186', 'weapon4': '0.194', 'AMMO4': '0.229', 'weapon5': '0.232', 'weapon2': '0.360', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.892', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.784', 'FRAGCOUNT': '59.000'} [2024-08-06 08:52:59,282][52649] DAMAGECOUNT value on done: 999542.0 [2024-08-06 08:52:59,290][52649] Sum rewards: 75.537, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.885', 'AMMO5': '0.011', 'AMMO2': '0.017', 'AMMO4': '0.085', 'AMMO3': '0.155', 'weapon5': '0.192', 'WEAPON4': '0.200', 'weapon4': '0.258', 'WEAPON5': '0.350', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '2.950', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.346', 'FRAGCOUNT': '60.000'} [2024-08-06 08:52:59,810][52795] DAMAGECOUNT value on done: 957331.0 [2024-08-06 08:52:59,812][52795] Sum rewards: 74.086, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.929', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.108', 'weapon4': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.203', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.566', 'WEAPON3': '1.350', 'weapon3': '2.874', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.150', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:00,444][52647] DAMAGECOUNT value on done: 1084854.0 [2024-08-06 08:53:00,444][52647] Sum rewards: 82.533, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.118', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.046', 'AMMO4': '0.119', 'weapon5': '0.122', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.219', 'weapon2': '0.300', 'WEAPON3': '1.300', 'weapon3': '3.296', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.908', 'FRAGCOUNT': '69.000'} [2024-08-06 08:53:00,510][52660] DAMAGECOUNT value on done: 1019146.0 [2024-08-06 08:53:00,511][52660] Sum rewards: 75.285, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.410', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.076', 'AMMO4': '0.151', 'weapon5': '0.180', 'AMMO3': '0.200', 'weapon2': '0.282', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.200', 'weapon3': '3.226', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:01,185][52665] DAMAGECOUNT value on done: 1013799.0 [2024-08-06 08:53:01,185][52665] Sum rewards: 67.608, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-4.465', 'AMMO5': '0.026', 'AMMO2': '0.063', 'weapon4': '0.170', 'AMMO3': '0.222', 'weapon5': '0.284', 'AMMO4': '0.316', 'weapon2': '0.464', 'WEAPON4': '0.650', 'WEAPON5': '0.750', 'WEAPON3': '1.500', 'weapon3': '2.732', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.415', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:01,484][52820] DAMAGECOUNT value on done: 953416.0 [2024-08-06 08:53:01,484][52820] Sum rewards: 67.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.550', 'AMMO5': '0.028', 'AMMO2': '0.061', 'weapon4': '0.170', 'AMMO3': '0.246', 'AMMO4': '0.305', 'weapon5': '0.340', 'weapon2': '0.482', 'WEAPON4': '0.650', 'WEAPON5': '0.800', 'WEAPON3': '1.450', 'weapon3': '2.590', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.518', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:01,559][52662] DAMAGECOUNT value on done: 1023857.0 [2024-08-06 08:53:01,559][52662] Sum rewards: 80.750, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.726', 'AMMO4': '-0.000', 'AMMO2': '-0.000', 'AMMO3': '0.209', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.364', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.101', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:02,100][52659] DAMAGECOUNT value on done: 1028629.0 [2024-08-06 08:53:02,101][52659] Sum rewards: 70.430, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.017', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.112', 'AMMO4': '0.129', 'weapon5': '0.130', 'WEAPON5': '0.200', 'AMMO3': '0.224', 'WEAPON4': '0.250', 'weapon2': '0.382', 'WEAPON3': '1.450', 'weapon3': '3.132', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.075', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:02,290][52649] DAMAGECOUNT value on done: 1008015.0 [2024-08-06 08:53:02,290][52649] Sum rewards: 71.111, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.645', 'AMMO5': '0.003', 'AMMO2': '0.024', 'weapon4': '0.050', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon5': '0.106', 'AMMO4': '0.118', 'AMMO3': '0.249', 'weapon2': '0.456', 'WEAPON3': '1.500', 'weapon3': '3.170', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.000', 'FRAGCOUNT': '59.000'} [2024-08-06 08:53:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17411.5). Total num frames: 717373440. Throughput: 0: 4358.2. Samples: 179342620. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:53:02,794][52567] Avg episode reward: [(0, '75.384')] [2024-08-06 08:53:02,866][52650] Updated weights for policy 0, policy_version 87571 (0.0030) [2024-08-06 08:53:02,964][52795] DAMAGECOUNT value on done: 949532.0 [2024-08-06 08:53:02,964][52795] Sum rewards: 80.601, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.805', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.122', 'weapon5': '0.134', 'AMMO3': '0.192', 'AMMO4': '0.211', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.376', 'WEAPON3': '1.250', 'weapon3': '3.126', 'HITCOUNT': '3.780', 'DAMAGECOUNT': '18.459', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:03,124][52660] DAMAGECOUNT value on done: 1016495.0 [2024-08-06 08:53:03,124][52660] Sum rewards: 61.195, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.930', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon4': '0.058', 'weapon5': '0.136', 'AMMO4': '0.155', 'AMMO3': '0.185', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '2.990', 'weapon3': '3.302', 'DAMAGECOUNT': '15.456', 'FRAGCOUNT': '50.000'} [2024-08-06 08:53:03,132][52647] DAMAGECOUNT value on done: 1086042.0 [2024-08-06 08:53:03,132][52647] Sum rewards: 57.465, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.116', 'AMMO5': '0.005', 'AMMO2': '0.026', 'weapon4': '0.026', 'weapon5': '0.094', 'AMMO4': '0.128', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.968', 'WEAPON3': '1.050', 'weapon3': '2.762', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.844', 'FRAGCOUNT': '45.000'} [2024-08-06 08:53:03,953][52662] DAMAGECOUNT value on done: 1040293.0 [2024-08-06 08:53:03,954][52662] Sum rewards: 75.397, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.390', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.128', 'AMMO4': '0.138', 'AMMO3': '0.194', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.306', 'WEAPON3': '1.300', 'weapon3': '3.346', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:04,242][52665] DAMAGECOUNT value on done: 1021004.0 [2024-08-06 08:53:04,243][52665] Sum rewards: 80.065, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.020', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon5': '0.052', 'AMMO4': '0.066', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.144', 'AMMO3': '0.155', 'weapon2': '0.488', 'WEAPON3': '0.950', 'weapon3': '3.150', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.841', 'FRAGCOUNT': '64.000'} [2024-08-06 08:53:04,666][52820] DAMAGECOUNT value on done: 962153.0 [2024-08-06 08:53:04,668][52820] Sum rewards: 60.961, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.068', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.098', 'AMMO4': '0.180', 'AMMO3': '0.207', 'weapon5': '0.234', 'weapon2': '0.288', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '2.800', 'weapon3': '3.086', 'DAMAGECOUNT': '15.384', 'FRAGCOUNT': '52.000'} [2024-08-06 08:53:04,914][52659] DAMAGECOUNT value on done: 1041218.0 [2024-08-06 08:53:04,916][52659] Sum rewards: 84.736, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.420', 'AMMO5': '0.016', 'AMMO2': '0.040', 'AMMO3': '0.168', 'AMMO4': '0.200', 'weapon2': '0.200', 'weapon5': '0.270', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.572', 'WEAPON3': '1.100', 'weapon3': '2.700', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:05,536][52649] DAMAGECOUNT value on done: 1008437.0 [2024-08-06 08:53:05,537][52649] Sum rewards: 85.077, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.942', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon5': '0.082', 'AMMO4': '0.086', 'weapon4': '0.116', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.244', 'WEAPON3': '1.250', 'weapon3': '3.338', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.809', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:05,751][52647] DAMAGECOUNT value on done: 1085265.0 [2024-08-06 08:53:05,753][52647] Sum rewards: 62.837, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.178', 'AMMO5': '0.024', 'AMMO2': '0.071', 'AMMO3': '0.185', 'weapon2': '0.228', 'weapon5': '0.336', 'AMMO4': '0.354', 'weapon4': '0.548', 'WEAPON5': '0.750', 'WEAPON4': '0.850', 'WEAPON3': '1.150', 'weapon3': '2.504', 'HITCOUNT': '2.900', 'DAMAGECOUNT': '15.615', 'FRAGCOUNT': '50.000'} [2024-08-06 08:53:05,976][52660] DAMAGECOUNT value on done: 1022948.0 [2024-08-06 08:53:05,977][52660] Sum rewards: 82.328, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.709', 'AMMO5': '0.008', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'weapon4': '0.202', 'weapon2': '0.278', 'WEAPON3': '1.250', 'weapon3': '3.120', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.492', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:05,990][52671] DAMAGECOUNT value on done: 1034649.0 [2024-08-06 08:53:05,992][52671] Sum rewards: 80.268, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.689', 'AMMO5': '0.010', 'AMMO2': '0.036', 'weapon4': '0.066', 'weapon5': '0.170', 'AMMO4': '0.177', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.594', 'WEAPON3': '1.200', 'weapon3': '2.990', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.917', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:06,141][52795] DAMAGECOUNT value on done: 948474.0 [2024-08-06 08:53:06,141][52795] Sum rewards: 74.082, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.975', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.092', 'AMMO4': '0.130', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'WEAPON5': '0.300', 'weapon2': '0.438', 'WEAPON3': '1.200', 'weapon3': '3.214', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:07,060][52662] DAMAGECOUNT value on done: 1027600.0 [2024-08-06 08:53:07,063][52662] Sum rewards: 70.099, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.790', 'AMMO5': '0.013', 'AMMO2': '0.048', 'weapon4': '0.076', 'weapon5': '0.218', 'AMMO3': '0.221', 'AMMO4': '0.241', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.480', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.190', 'DAMAGECOUNT': '17.292', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:07,510][52659] DAMAGECOUNT value on done: 1020588.0 [2024-08-06 08:53:07,512][52659] Sum rewards: 83.703, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.580', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.028', 'AMMO4': '0.043', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.205', 'weapon2': '0.312', 'WEAPON3': '1.400', 'weapon3': '3.388', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:07,779][52820] DAMAGECOUNT value on done: 963656.0 [2024-08-06 08:53:07,780][52820] Sum rewards: 76.928, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.745', 'AMMO5': '0.003', 'AMMO2': '0.007', 'weapon4': '0.022', 'AMMO4': '0.035', 'weapon5': '0.036', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.169', 'weapon2': '0.454', 'WEAPON3': '1.050', 'weapon3': '3.314', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:07,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 717455360. Throughput: 0: 4361.3. Samples: 179368730. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:53:07,794][52567] Avg episode reward: [(0, '75.185')] [2024-08-06 08:53:07,827][52650] Updated weights for policy 0, policy_version 87581 (0.0012) [2024-08-06 08:53:07,991][52649] DAMAGECOUNT value on done: 1004667.0 [2024-08-06 08:53:07,993][52649] Sum rewards: 78.588, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.155', 'AMMO5': '0.007', 'AMMO2': '0.033', 'weapon4': '0.050', 'weapon5': '0.054', 'AMMO3': '0.160', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.100', 'weapon3': '3.212', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.327', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:08,898][52647] DAMAGECOUNT value on done: 1096227.0 [2024-08-06 08:53:08,898][52647] Sum rewards: 67.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.411', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon5': '0.086', 'WEAPON5': '0.100', 'AMMO4': '0.123', 'weapon4': '0.156', 'WEAPON4': '0.200', 'AMMO3': '0.214', 'weapon2': '0.754', 'WEAPON3': '1.350', 'weapon3': '2.758', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '16.806', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:08,956][52671] DAMAGECOUNT value on done: 1038834.0 [2024-08-06 08:53:08,956][52671] Sum rewards: 62.661, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.010', 'AMMO2': '0.041', 'weapon5': '0.194', 'AMMO4': '0.203', 'AMMO3': '0.224', 'WEAPON5': '0.300', 'weapon2': '0.362', 'WEAPON4': '0.400', 'weapon4': '0.472', 'WEAPON3': '1.350', 'weapon3': '2.676', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.418', 'FRAGCOUNT': '52.000'} [2024-08-06 08:53:08,963][52660] DAMAGECOUNT value on done: 1030116.0 [2024-08-06 08:53:08,963][52660] Sum rewards: 68.293, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.056', 'AMMO2': '0.005', 'AMMO4': '0.022', 'AMMO3': '0.239', 'weapon2': '0.552', 'WEAPON3': '1.450', 'weapon3': '3.248', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.833', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:09,282][52795] DAMAGECOUNT value on done: 955651.0 [2024-08-06 08:53:09,283][52795] Sum rewards: 67.941, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.460', 'AMMO5': '0.019', 'AMMO2': '0.049', 'weapon4': '0.096', 'weapon5': '0.196', 'AMMO3': '0.240', 'AMMO4': '0.245', 'weapon2': '0.330', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.076', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '17.550', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:09,592][52662] DAMAGECOUNT value on done: 1018368.0 [2024-08-06 08:53:09,593][52662] Sum rewards: 78.937, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.686', 'AMMO5': '0.016', 'AMMO2': '0.063', 'weapon4': '0.074', 'weapon5': '0.202', 'AMMO3': '0.271', 'AMMO4': '0.317', 'weapon2': '0.496', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.600', 'weapon3': '2.988', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.895', 'FRAGCOUNT': '64.000'} [2024-08-06 08:53:10,701][52649] DAMAGECOUNT value on done: 999757.0 [2024-08-06 08:53:10,702][52649] Sum rewards: 87.283, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.608', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.042', 'AMMO4': '0.108', 'weapon5': '0.136', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.554', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.514', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:10,876][52820] DAMAGECOUNT value on done: 948650.0 [2024-08-06 08:53:10,876][52820] Sum rewards: 71.192, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.810', 'AMMO5': '0.007', 'weapon4': '0.026', 'AMMO2': '0.030', 'WEAPON4': '0.150', 'AMMO4': '0.151', 'WEAPON5': '0.200', 'weapon5': '0.238', 'weapon2': '0.286', 'AMMO3': '0.290', 'WEAPON3': '1.650', 'weapon3': '3.152', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.871', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:10,906][52659] DAMAGECOUNT value on done: 1035430.0 [2024-08-06 08:53:10,906][52659] Sum rewards: 89.193, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.855', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon4': '0.092', 'AMMO4': '0.152', 'weapon5': '0.194', 'weapon2': '0.258', 'AMMO3': '0.263', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.120', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.596', 'FRAGCOUNT': '74.000'} [2024-08-06 08:53:11,483][52647] DAMAGECOUNT value on done: 1088778.0 [2024-08-06 08:53:11,486][52647] Sum rewards: 65.220, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.937', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.174', 'weapon5': '0.186', 'AMMO4': '0.191', 'AMMO3': '0.198', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.100', 'weapon3': '2.888', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '16.515', 'FRAGCOUNT': '53.000'} [2024-08-06 08:53:12,139][52660] DAMAGECOUNT value on done: 1018592.0 [2024-08-06 08:53:12,141][52660] Sum rewards: 78.929, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.945', 'AMMO5': '0.012', 'AMMO2': '0.030', 'weapon4': '0.076', 'weapon5': '0.136', 'AMMO3': '0.147', 'AMMO4': '0.148', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.640', 'WEAPON3': '1.000', 'weapon3': '2.940', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.384', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:12,242][52671] DAMAGECOUNT value on done: 1034262.0 [2024-08-06 08:53:12,244][52671] Sum rewards: 83.926, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-3.106', 'AMMO5': '0.025', 'AMMO2': '0.065', 'weapon4': '0.186', 'AMMO3': '0.204', 'weapon5': '0.268', 'AMMO4': '0.324', 'weapon2': '0.410', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.350', 'weapon3': '2.792', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '20.658', 'FRAGCOUNT': '67.000'} [2024-08-06 08:53:12,349][52795] DAMAGECOUNT value on done: 951088.0 [2024-08-06 08:53:12,349][52795] Sum rewards: 88.829, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.962', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.076', 'AMMO4': '0.138', 'weapon5': '0.168', 'AMMO3': '0.199', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.200', 'weapon3': '3.084', 'HITCOUNT': '4.130', 'DAMAGECOUNT': '20.244', 'FRAGCOUNT': '73.000'} [2024-08-06 08:53:12,557][52662] DAMAGECOUNT value on done: 1025347.0 [2024-08-06 08:53:12,559][52662] Sum rewards: 69.854, reward structure: {'DEATHCOUNT': '-8.250', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.046', 'HEALTH': '0.097', 'AMMO3': '0.110', 'AMMO4': '0.116', 'WEAPON4': '0.200', 'weapon5': '0.234', 'WEAPON5': '0.350', 'weapon2': '0.680', 'WEAPON3': '0.700', 'weapon3': '2.826', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '53.000'} [2024-08-06 08:53:12,794][52567] Fps is (10 sec: 16384.0, 60 sec: 17203.2, 300 sec: 17355.9). Total num frames: 717537280. Throughput: 0: 4368.7. Samples: 179395090. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:53:12,794][52567] Avg episode reward: [(0, '74.860')] [2024-08-06 08:53:12,857][52650] Updated weights for policy 0, policy_version 87591 (0.0035) [2024-08-06 08:53:13,604][52649] DAMAGECOUNT value on done: 997158.0 [2024-08-06 08:53:13,607][52649] Sum rewards: 74.182, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.575', 'AMMO5': '0.013', 'AMMO2': '0.043', 'weapon4': '0.104', 'weapon5': '0.150', 'AMMO3': '0.205', 'AMMO4': '0.213', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.554', 'WEAPON3': '1.400', 'weapon3': '2.976', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.639', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:13,963][52659] DAMAGECOUNT value on done: 1026498.0 [2024-08-06 08:53:13,964][52659] Sum rewards: 75.690, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.365', 'AMMO5': '0.007', 'AMMO2': '0.012', 'weapon5': '0.042', 'WEAPON5': '0.050', 'AMMO4': '0.059', 'weapon4': '0.082', 'WEAPON4': '0.150', 'weapon2': '0.214', 'AMMO3': '0.216', 'WEAPON3': '1.300', 'weapon3': '3.420', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.122', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:14,549][52647] DAMAGECOUNT value on done: 1090316.0 [2024-08-06 08:53:14,552][52647] Sum rewards: 76.540, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.070', 'AMMO5': '0.005', 'AMMO2': '0.016', 'weapon4': '0.028', 'AMMO4': '0.082', 'weapon5': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.201', 'weapon2': '0.646', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.362', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:14,988][52660] DAMAGECOUNT value on done: 1016998.0 [2024-08-06 08:53:14,990][52660] Sum rewards: 84.592, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.553', 'AMMO5': '0.016', 'AMMO2': '0.059', 'weapon2': '0.196', 'AMMO3': '0.198', 'weapon5': '0.254', 'AMMO4': '0.293', 'weapon4': '0.306', 'WEAPON5': '0.550', 'WEAPON4': '0.650', 'WEAPON3': '1.250', 'weapon3': '2.930', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.193', 'FRAGCOUNT': '67.000'} [2024-08-06 08:53:15,153][52671] DAMAGECOUNT value on done: 1040997.0 [2024-08-06 08:53:15,154][52671] Sum rewards: 71.166, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.713', 'AMMO5': '0.020', 'AMMO2': '0.064', 'weapon4': '0.134', 'weapon2': '0.176', 'AMMO3': '0.212', 'weapon5': '0.256', 'AMMO4': '0.318', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '18.435', 'FRAGCOUNT': '59.500'} [2024-08-06 08:53:15,312][52811] DAMAGECOUNT value on done: 970851.0 [2024-08-06 08:53:15,312][52811] Sum rewards: 80.577, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.095', 'AMMO5': '0.009', 'weapon4': '0.038', 'AMMO2': '0.038', 'weapon5': '0.118', 'AMMO3': '0.163', 'AMMO4': '0.193', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.430', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.729', 'FRAGCOUNT': '64.000'} [2024-08-06 08:53:15,519][52795] DAMAGECOUNT value on done: 942706.0 [2024-08-06 08:53:15,520][52795] Sum rewards: 72.442, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.150', 'AMMO5': '0.005', 'AMMO2': '0.019', 'weapon4': '0.066', 'weapon5': '0.078', 'AMMO4': '0.097', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.242', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.282', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.951', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:15,876][52662] DAMAGECOUNT value on done: 1019253.0 [2024-08-06 08:53:15,876][52662] Sum rewards: 57.372, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.380', 'AMMO5': '0.013', 'AMMO2': '0.015', 'WEAPON1': '0.020', 'weapon4': '0.034', 'weapon5': '0.072', 'AMMO4': '0.074', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.222', 'weapon2': '0.466', 'WEAPON3': '1.400', 'HITCOUNT': '2.830', 'weapon3': '3.236', 'DAMAGECOUNT': '14.520', 'FRAGCOUNT': '50.000'} [2024-08-06 08:53:16,516][52649] DAMAGECOUNT value on done: 1012011.0 [2024-08-06 08:53:16,517][52649] Sum rewards: 70.713, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.962', 'AMMO5': '0.009', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.095', 'weapon5': '0.126', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.344', 'WEAPON3': '1.250', 'weapon3': '3.298', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.463', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:17,054][52650] Updated weights for policy 0, policy_version 87601 (0.0024) [2024-08-06 08:53:17,223][52658] DAMAGECOUNT value on done: 1034713.0 [2024-08-06 08:53:17,224][52658] Sum rewards: 81.464, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.854', 'AMMO5': '0.013', 'AMMO2': '0.045', 'weapon4': '0.142', 'AMMO4': '0.223', 'weapon5': '0.226', 'AMMO3': '0.240', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.644', 'WEAPON3': '1.500', 'weapon3': '2.704', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.731', 'FRAGCOUNT': '67.000'} [2024-08-06 08:53:17,635][52660] DAMAGECOUNT value on done: 1024299.0 [2024-08-06 08:53:17,635][52660] Sum rewards: 69.420, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.579', 'AMMO5': '0.019', 'AMMO2': '0.069', 'weapon4': '0.126', 'weapon5': '0.172', 'AMMO3': '0.217', 'AMMO4': '0.346', 'WEAPON5': '0.500', 'weapon2': '0.576', 'WEAPON4': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.824', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.289', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:17,658][52663] Large shaping reward 2.546 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.495, 165.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:53:17,661][52647] DAMAGECOUNT value on done: 1068317.0 [2024-08-06 08:53:17,662][52647] Sum rewards: 70.889, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.010', 'AMMO5': '0.013', 'AMMO2': '0.041', 'AMMO3': '0.195', 'AMMO4': '0.205', 'weapon5': '0.220', 'weapon4': '0.230', 'weapon2': '0.280', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.250', 'weapon3': '2.998', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.036', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:17,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 717635584. Throughput: 0: 4374.0. Samples: 179408070. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:53:17,794][52567] Avg episode reward: [(0, '74.932')] [2024-08-06 08:53:17,905][52669] DAMAGECOUNT value on done: 1026233.0 [2024-08-06 08:53:17,905][52669] Sum rewards: 59.551, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.694', 'AMMO5': '0.022', 'AMMO2': '0.036', 'weapon4': '0.086', 'AMMO4': '0.182', 'AMMO3': '0.230', 'weapon5': '0.328', 'WEAPON4': '0.400', 'weapon2': '0.548', 'WEAPON5': '0.600', 'WEAPON3': '1.350', 'weapon3': '2.746', 'HITCOUNT': '2.920', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '47.000'} [2024-08-06 08:53:18,423][52811] DAMAGECOUNT value on done: 957449.0 [2024-08-06 08:53:18,425][52811] Sum rewards: 81.152, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.935', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon5': '0.036', 'AMMO4': '0.040', 'WEAPON5': '0.050', 'WEAPON4': '0.100', 'weapon4': '0.206', 'AMMO3': '0.243', 'weapon2': '0.330', 'WEAPON3': '1.500', 'weapon3': '3.230', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '19.251', 'FRAGCOUNT': '69.000'} [2024-08-06 08:53:18,430][52671] DAMAGECOUNT value on done: 1047037.0 [2024-08-06 08:53:18,431][52671] Sum rewards: 78.205, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.024', 'AMMO2': '0.060', 'weapon4': '0.126', 'AMMO3': '0.236', 'AMMO4': '0.299', 'weapon2': '0.314', 'weapon5': '0.324', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.400', 'weapon3': '2.822', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '19.830', 'FRAGCOUNT': '64.500'} [2024-08-06 08:53:18,663][52795] DAMAGECOUNT value on done: 948633.0 [2024-08-06 08:53:18,665][52795] Sum rewards: 73.584, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.495', 'AMMO2': '0.009', 'AMMO5': '0.012', 'WEAPON1': '0.030', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'weapon4': '0.106', 'weapon5': '0.138', 'AMMO3': '0.180', 'WEAPON5': '0.250', 'weapon2': '0.552', 'WEAPON3': '1.250', 'weapon3': '2.908', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.790', 'FRAGCOUNT': '59.000'} [2024-08-06 08:53:19,498][52649] DAMAGECOUNT value on done: 1018511.0 [2024-08-06 08:53:19,501][52649] Sum rewards: 85.405, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.527', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.086', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.249', 'weapon2': '0.404', 'WEAPON3': '1.450', 'weapon3': '3.290', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.685', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:20,060][52658] DAMAGECOUNT value on done: 1035207.0 [2024-08-06 08:53:20,060][52658] Sum rewards: 81.239, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.010', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.030', 'weapon5': '0.072', 'AMMO4': '0.079', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.232', 'weapon2': '0.248', 'WEAPON3': '1.500', 'weapon3': '3.440', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:20,439][52669] DAMAGECOUNT value on done: 1026205.0 [2024-08-06 08:53:20,440][52669] Sum rewards: 74.964, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.984', 'AMMO5': '0.012', 'AMMO2': '0.029', 'AMMO4': '0.146', 'AMMO3': '0.184', 'weapon4': '0.188', 'WEAPON4': '0.200', 'weapon5': '0.294', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.146', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:20,616][52647] DAMAGECOUNT value on done: 1082724.0 [2024-08-06 08:53:20,616][52647] Sum rewards: 79.719, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.013', 'AMMO2': '0.033', 'HEALTH': '0.085', 'weapon4': '0.152', 'AMMO4': '0.165', 'AMMO3': '0.192', 'weapon5': '0.198', 'weapon2': '0.340', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.100', 'weapon3': '3.046', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '65.000'} [2024-08-06 08:53:20,726][52660] DAMAGECOUNT value on done: 1019031.0 [2024-08-06 08:53:20,734][52660] Sum rewards: 69.726, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.314', 'AMMO5': '0.018', 'AMMO2': '0.046', 'weapon4': '0.082', 'weapon5': '0.210', 'AMMO3': '0.221', 'AMMO4': '0.231', 'weapon2': '0.446', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.980', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.246', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:20,793][52666] Large shaping reward 2.622 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.6, 200.0), ('weapon5', 0.002)] [2024-08-06 08:53:21,250][52671] DAMAGECOUNT value on done: 1036161.0 [2024-08-06 08:53:21,251][52671] Sum rewards: 69.216, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.235', 'AMMO5': '0.010', 'AMMO2': '0.028', 'AMMO4': '0.141', 'AMMO3': '0.164', 'weapon5': '0.172', 'weapon4': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.070', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '55.000'} [2024-08-06 08:53:21,424][52811] DAMAGECOUNT value on done: 951234.0 [2024-08-06 08:53:21,424][52811] Sum rewards: 76.529, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.118', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.134', 'AMMO4': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.216', 'AMMO3': '0.225', 'WEAPON3': '1.450', 'weapon3': '3.380', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.663', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:21,891][52650] Updated weights for policy 0, policy_version 87611 (0.0011) [2024-08-06 08:53:21,957][52795] DAMAGECOUNT value on done: 954658.0 [2024-08-06 08:53:21,957][52795] Sum rewards: 79.870, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.954', 'AMMO5': '0.008', 'AMMO2': '0.040', 'weapon4': '0.094', 'weapon5': '0.118', 'WEAPON5': '0.200', 'AMMO4': '0.202', 'AMMO3': '0.234', 'WEAPON4': '0.250', 'weapon2': '0.448', 'WEAPON3': '1.400', 'weapon3': '3.100', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.420', 'FRAGCOUNT': '67.000'} [2024-08-06 08:53:22,615][52649] DAMAGECOUNT value on done: 1007931.0 [2024-08-06 08:53:22,615][52649] Sum rewards: 79.359, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.150', 'AMMO5': '0.012', 'AMMO2': '0.020', 'weapon4': '0.078', 'AMMO4': '0.100', 'AMMO3': '0.138', 'weapon5': '0.224', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '0.900', 'weapon3': '2.848', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:22,794][52567] Fps is (10 sec: 18841.5, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 717725696. Throughput: 0: 4376.7. Samples: 179434290. Policy #0 lag: (min: 0.0, avg: 3.8, max: 7.0) [2024-08-06 08:53:22,795][52567] Avg episode reward: [(0, '74.822')] [2024-08-06 08:53:22,930][52658] DAMAGECOUNT value on done: 1035149.0 [2024-08-06 08:53:22,931][52658] Sum rewards: 74.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.095', 'AMMO5': '0.010', 'AMMO2': '0.024', 'weapon4': '0.092', 'AMMO4': '0.118', 'weapon5': '0.124', 'AMMO3': '0.178', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.784', 'WEAPON3': '1.100', 'weapon3': '2.714', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:23,343][52669] DAMAGECOUNT value on done: 1035235.0 [2024-08-06 08:53:23,343][52669] Sum rewards: 79.291, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.007', 'AMMO2': '0.015', 'AMMO4': '0.076', 'weapon4': '0.098', 'weapon5': '0.098', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.203', 'weapon2': '0.676', 'WEAPON3': '1.250', 'weapon3': '2.910', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.782', 'FRAGCOUNT': '64.000'} [2024-08-06 08:53:23,420][52647] DAMAGECOUNT value on done: 1077747.0 [2024-08-06 08:53:23,420][52647] Sum rewards: 76.934, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.960', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.064', 'AMMO4': '0.113', 'weapon5': '0.130', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.300', 'weapon3': '3.236', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '64.000'} [2024-08-06 08:53:23,598][52660] DAMAGECOUNT value on done: 1019742.0 [2024-08-06 08:53:23,599][52660] Sum rewards: 66.186, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.060', 'AMMO5': '0.011', 'AMMO2': '0.039', 'weapon5': '0.176', 'AMMO3': '0.194', 'AMMO4': '0.195', 'weapon2': '0.216', 'weapon4': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.160', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.397', 'FRAGCOUNT': '52.000'} [2024-08-06 08:53:23,990][52671] DAMAGECOUNT value on done: 1033587.0 [2024-08-06 08:53:23,992][52671] Sum rewards: 80.585, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.210', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon4': '0.044', 'weapon5': '0.100', 'AMMO4': '0.130', 'AMMO3': '0.183', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.504', 'WEAPON3': '1.250', 'weapon3': '3.146', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '19.353', 'FRAGCOUNT': '65.000'} [2024-08-06 08:53:24,528][52811] DAMAGECOUNT value on done: 958464.0 [2024-08-06 08:53:24,532][52811] Sum rewards: 76.731, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.664', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon2': '0.154', 'weapon4': '0.170', 'AMMO3': '0.202', 'weapon5': '0.204', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.228', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:25,022][52795] DAMAGECOUNT value on done: 938880.0 [2024-08-06 08:53:25,024][52795] Sum rewards: 87.414, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.465', 'AMMO5': '0.008', 'AMMO2': '0.015', 'weapon5': '0.040', 'weapon4': '0.072', 'AMMO4': '0.076', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.151', 'weapon2': '0.528', 'WEAPON3': '1.000', 'weapon3': '3.188', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.760', 'FRAGCOUNT': '69.000'} [2024-08-06 08:53:25,871][52649] DAMAGECOUNT value on done: 1009924.0 [2024-08-06 08:53:25,871][52649] Sum rewards: 65.262, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.278', 'AMMO5': '0.011', 'AMMO2': '0.034', 'weapon4': '0.056', 'AMMO4': '0.172', 'weapon5': '0.184', 'weapon2': '0.202', 'AMMO3': '0.275', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.250', 'weapon3': '3.294', 'DAMAGECOUNT': '17.811', 'FRAGCOUNT': '55.000'} [2024-08-06 08:53:26,048][52658] DAMAGECOUNT value on done: 1031180.0 [2024-08-06 08:53:26,050][52658] Sum rewards: 73.035, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.990', 'AMMO5': '0.019', 'WEAPON1': '0.020', 'AMMO2': '0.068', 'weapon4': '0.144', 'weapon5': '0.206', 'AMMO3': '0.230', 'weapon2': '0.314', 'AMMO4': '0.338', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.500', 'weapon3': '3.030', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '18.396', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:26,052][52669] DAMAGECOUNT value on done: 1029769.0 [2024-08-06 08:53:26,053][52669] Sum rewards: 86.801, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.850', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.073', 'weapon5': '0.084', 'weapon4': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.194', 'AMMO3': '0.220', 'WEAPON3': '1.400', 'weapon3': '3.462', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '72.000'} [2024-08-06 08:53:26,141][52647] DAMAGECOUNT value on done: 1077501.0 [2024-08-06 08:53:26,142][52647] Sum rewards: 69.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.840', 'AMMO5': '0.003', 'AMMO2': '0.035', 'weapon5': '0.044', 'weapon4': '0.074', 'WEAPON5': '0.100', 'AMMO4': '0.172', 'WEAPON4': '0.200', 'AMMO3': '0.218', 'weapon2': '0.582', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '56.000'} [2024-08-06 08:53:26,362][52658] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:53:26,595][52671] DAMAGECOUNT value on done: 1040153.0 [2024-08-06 08:53:26,595][52671] Sum rewards: 73.478, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.417', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.018', 'weapon5': '0.036', 'AMMO4': '0.043', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.168', 'weapon2': '0.376', 'WEAPON3': '1.100', 'weapon3': '3.448', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.336', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:26,649][52650] Updated weights for policy 0, policy_version 87621 (0.0046) [2024-08-06 08:53:26,811][52660] DAMAGECOUNT value on done: 1029085.0 [2024-08-06 08:53:26,819][52660] Sum rewards: 91.891, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.390', 'AMMO5': '0.017', 'AMMO2': '0.063', 'AMMO3': '0.203', 'weapon4': '0.212', 'weapon5': '0.296', 'AMMO4': '0.315', 'weapon2': '0.378', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.200', 'weapon3': '2.710', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '22.227', 'FRAGCOUNT': '74.000'} [2024-08-06 08:53:27,564][52811] DAMAGECOUNT value on done: 961785.0 [2024-08-06 08:53:27,567][52811] Sum rewards: 72.681, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.861', 'AMMO5': '0.015', 'AMMO2': '0.048', 'weapon4': '0.162', 'AMMO3': '0.170', 'weapon5': '0.176', 'AMMO4': '0.238', 'weapon2': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'HITCOUNT': '3.050', 'weapon3': '3.138', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:27,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 717807616. Throughput: 0: 4364.2. Samples: 179460380. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:53:27,794][52567] Avg episode reward: [(0, '75.055')] [2024-08-06 08:53:28,174][52795] DAMAGECOUNT value on done: 952834.0 [2024-08-06 08:53:28,175][52795] Sum rewards: 83.326, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.374', 'AMMO5': '0.012', 'AMMO2': '0.025', 'AMMO4': '0.125', 'weapon5': '0.152', 'AMMO3': '0.195', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.282', 'weapon2': '0.532', 'WEAPON3': '1.150', 'weapon3': '2.776', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '20.601', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:28,651][52647] DAMAGECOUNT value on done: 1077598.0 [2024-08-06 08:53:28,653][52647] Sum rewards: 72.602, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.230', 'AMMO5': '0.010', 'AMMO2': '0.031', 'weapon5': '0.154', 'AMMO4': '0.157', 'AMMO3': '0.259', 'weapon2': '0.262', 'weapon4': '0.262', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.051', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:28,844][52669] DAMAGECOUNT value on done: 1037268.0 [2024-08-06 08:53:28,844][52669] Sum rewards: 79.521, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.190', 'AMMO5': '0.008', 'AMMO2': '0.014', 'weapon4': '0.034', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'weapon5': '0.164', 'AMMO3': '0.217', 'WEAPON5': '0.250', 'weapon2': '0.414', 'WEAPON3': '1.400', 'weapon3': '3.124', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.845', 'FRAGCOUNT': '65.000'} [2024-08-06 08:53:29,019][52649] DAMAGECOUNT value on done: 997036.0 [2024-08-06 08:53:29,021][52649] Sum rewards: 75.094, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.882', 'ARMOR': '0.004', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.052', 'AMMO4': '0.146', 'weapon5': '0.148', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon2': '0.422', 'WEAPON3': '1.350', 'weapon3': '3.182', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.697', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:29,040][52671] DAMAGECOUNT value on done: 1019645.0 [2024-08-06 08:53:29,041][52671] Sum rewards: 77.099, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.830', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.106', 'weapon5': '0.132', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.306', 'WEAPON3': '1.150', 'weapon3': '3.314', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '18.135', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:29,257][52658] DAMAGECOUNT value on done: 1025471.0 [2024-08-06 08:53:29,261][52658] Sum rewards: 79.807, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.960', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.008', 'WEAPON4': '0.050', 'weapon4': '0.060', 'weapon5': '0.108', 'AMMO3': '0.184', 'WEAPON5': '0.200', 'weapon2': '0.462', 'WEAPON3': '1.250', 'weapon3': '3.164', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '65.000'} [2024-08-06 08:53:30,144][52660] DAMAGECOUNT value on done: 1045128.0 [2024-08-06 08:53:30,144][52660] Sum rewards: 79.262, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.984', 'WEAPON1': '0.010', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.224', 'weapon2': '0.540', 'WEAPON3': '1.350', 'weapon3': '3.232', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.377', 'FRAGCOUNT': '65.000'} [2024-08-06 08:53:30,906][52647] DAMAGECOUNT value on done: 1083876.0 [2024-08-06 08:53:30,914][52647] Sum rewards: 80.103, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.924', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.090', 'AMMO4': '0.135', 'AMMO3': '0.156', 'weapon5': '0.180', 'WEAPON4': '0.250', 'weapon2': '0.312', 'WEAPON5': '0.350', 'WEAPON3': '1.000', 'weapon3': '3.214', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:30,942][52811] DAMAGECOUNT value on done: 977915.0 [2024-08-06 08:53:30,942][52811] Sum rewards: 82.507, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.615', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.026', 'AMMO4': '0.094', 'weapon5': '0.120', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'AMMO3': '0.258', 'weapon2': '0.298', 'WEAPON3': '1.600', 'weapon3': '3.342', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '19.617', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:31,109][52650] Updated weights for policy 0, policy_version 87631 (0.0047) [2024-08-06 08:53:31,347][52795] DAMAGECOUNT value on done: 950051.0 [2024-08-06 08:53:31,348][52795] Sum rewards: 81.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.090', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.050', 'weapon5': '0.096', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.252', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '65.000'} [2024-08-06 08:53:31,904][52649] DAMAGECOUNT value on done: 1013983.0 [2024-08-06 08:53:31,904][52649] Sum rewards: 78.331, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.032', 'AMMO4': '0.160', 'weapon5': '0.164', 'AMMO3': '0.193', 'weapon4': '0.208', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.438', 'WEAPON3': '1.300', 'weapon3': '2.962', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.494', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:31,909][52669] DAMAGECOUNT value on done: 1034071.0 [2024-08-06 08:53:31,910][52669] Sum rewards: 75.610, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.055', 'AMMO5': '0.003', 'AMMO2': '0.034', 'weapon5': '0.044', 'weapon4': '0.090', 'WEAPON5': '0.100', 'WEAPON4': '0.150', 'AMMO3': '0.160', 'AMMO4': '0.171', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.015', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:32,091][52671] DAMAGECOUNT value on done: 1034209.0 [2024-08-06 08:53:32,093][52671] Sum rewards: 83.102, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.280', 'AMMO2': '0.000', 'AMMO4': '0.002', 'AMMO3': '0.219', 'weapon2': '0.574', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '18.843', 'FRAGCOUNT': '69.000'} [2024-08-06 08:53:32,268][52658] DAMAGECOUNT value on done: 1023138.0 [2024-08-06 08:53:32,268][52658] Sum rewards: 66.114, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.090', 'AMMO5': '0.004', 'weapon5': '0.016', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO4': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.145', 'weapon2': '0.280', 'WEAPON3': '1.050', 'HITCOUNT': '3.270', 'weapon3': '3.574', 'DAMAGECOUNT': '16.293', 'FRAGCOUNT': '53.000'} [2024-08-06 08:53:32,794][52567] Fps is (10 sec: 16384.1, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 717889536. Throughput: 0: 4363.1. Samples: 179473470. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:53:32,794][52567] Avg episode reward: [(0, '75.262')] [2024-08-06 08:53:33,476][52660] DAMAGECOUNT value on done: 1021249.0 [2024-08-06 08:53:33,476][52660] Sum rewards: 59.351, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.550', 'AMMO5': '0.008', 'AMMO2': '0.026', 'weapon4': '0.042', 'weapon5': '0.128', 'AMMO4': '0.131', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.288', 'AMMO3': '0.311', 'WEAPON3': '1.850', 'HITCOUNT': '3.250', 'weapon3': '3.274', 'DAMAGECOUNT': '15.843', 'FRAGCOUNT': '53.000'} [2024-08-06 08:53:34,062][52647] DAMAGECOUNT value on done: 1080693.0 [2024-08-06 08:53:34,064][52647] Sum rewards: 74.103, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.845', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.050', 'weapon5': '0.092', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.578', 'WEAPON3': '1.250', 'weapon3': '3.054', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.957', 'FRAGCOUNT': '60.000'} [2024-08-06 08:53:34,205][52811] DAMAGECOUNT value on done: 965815.0 [2024-08-06 08:53:34,207][52811] Sum rewards: 82.249, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.944', 'AMMO5': '0.013', 'AMMO2': '0.042', 'weapon4': '0.104', 'weapon5': '0.194', 'AMMO4': '0.208', 'AMMO3': '0.232', 'WEAPON4': '0.350', 'weapon2': '0.384', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.032', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.524', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:34,480][52795] DAMAGECOUNT value on done: 936697.0 [2024-08-06 08:53:34,481][52795] Sum rewards: 74.002, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.490', 'AMMO5': '0.008', 'AMMO2': '0.042', 'weapon4': '0.054', 'weapon5': '0.122', 'AMMO3': '0.194', 'AMMO4': '0.212', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.408', 'WEAPON3': '1.200', 'weapon3': '3.156', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.505', 'FRAGCOUNT': '60.000'} [2024-08-06 08:53:34,689][52669] DAMAGECOUNT value on done: 1033072.0 [2024-08-06 08:53:34,691][52669] Sum rewards: 73.442, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.900', 'AMMO5': '0.003', 'AMMO2': '0.023', 'weapon5': '0.046', 'weapon4': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.116', 'AMMO3': '0.188', 'WEAPON4': '0.200', 'weapon2': '0.508', 'WEAPON3': '1.350', 'weapon3': '3.186', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.267', 'FRAGCOUNT': '60.000'} [2024-08-06 08:53:34,911][52649] DAMAGECOUNT value on done: 989473.0 [2024-08-06 08:53:34,912][52649] Sum rewards: 68.810, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.430', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.052', 'weapon5': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.223', 'AMMO4': '0.225', 'WEAPON4': '0.300', 'weapon2': '0.570', 'WEAPON3': '1.350', 'weapon3': '2.956', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.112', 'FRAGCOUNT': '59.000'} [2024-08-06 08:53:35,145][52671] DAMAGECOUNT value on done: 1037877.0 [2024-08-06 08:53:35,147][52671] Sum rewards: 77.536, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.685', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.084', 'AMMO4': '0.165', 'AMMO3': '0.193', 'weapon5': '0.220', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.058', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '18.300', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:35,508][52658] DAMAGECOUNT value on done: 1037697.0 [2024-08-06 08:53:35,509][52658] Sum rewards: 57.479, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.140', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.200', 'AMMO3': '0.266', 'weapon5': '0.268', 'AMMO4': '0.275', 'weapon2': '0.436', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.650', 'weapon3': '2.774', 'HITCOUNT': '3.110', 'DAMAGECOUNT': '15.567', 'FRAGCOUNT': '52.500'} [2024-08-06 08:53:36,298][52660] DAMAGECOUNT value on done: 1027505.0 [2024-08-06 08:53:36,308][52660] Sum rewards: 77.179, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.555', 'AMMO5': '0.009', 'AMMO2': '0.042', 'weapon4': '0.048', 'weapon5': '0.124', 'AMMO4': '0.211', 'AMMO3': '0.219', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.688', 'WEAPON3': '1.350', 'weapon3': '2.900', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.372', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:36,483][52650] Updated weights for policy 0, policy_version 87641 (0.0033) [2024-08-06 08:53:36,590][52647] DAMAGECOUNT value on done: 1083897.0 [2024-08-06 08:53:36,592][52647] Sum rewards: 78.164, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.950', 'AMMO5': '0.006', 'AMMO2': '0.025', 'weapon4': '0.038', 'weapon5': '0.082', 'AMMO4': '0.123', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.210', 'weapon2': '0.420', 'WEAPON3': '1.350', 'weapon3': '3.246', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.474', 'FRAGCOUNT': '64.000'} [2024-08-06 08:53:37,309][52811] DAMAGECOUNT value on done: 956995.0 [2024-08-06 08:53:37,310][52811] Sum rewards: 80.394, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.534', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.028', 'weapon5': '0.092', 'AMMO4': '0.100', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.247', 'weapon2': '0.590', 'WEAPON3': '1.500', 'weapon3': '3.044', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.652', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:37,546][52669] DAMAGECOUNT value on done: 1037430.0 [2024-08-06 08:53:37,547][52669] Sum rewards: 79.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.250', 'AMMO5': '0.010', 'AMMO2': '0.020', 'weapon4': '0.050', 'AMMO4': '0.100', 'WEAPON4': '0.150', 'weapon5': '0.216', 'weapon2': '0.226', 'AMMO3': '0.229', 'WEAPON5': '0.250', 'WEAPON3': '1.350', 'weapon3': '3.256', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.005', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:37,626][52795] DAMAGECOUNT value on done: 946994.0 [2024-08-06 08:53:37,629][52795] Sum rewards: 74.066, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.995', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.104', 'weapon5': '0.198', 'AMMO3': '0.215', 'AMMO4': '0.220', 'weapon2': '0.240', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.188', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.162', 'FRAGCOUNT': '60.000'} [2024-08-06 08:53:37,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 717987840. Throughput: 0: 4369.8. Samples: 179499760. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:53:37,794][52567] Avg episode reward: [(0, '75.306')] [2024-08-06 08:53:38,001][52671] DAMAGECOUNT value on done: 1031096.0 [2024-08-06 08:53:38,003][52671] Sum rewards: 81.653, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.788', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon5': '0.086', 'weapon4': '0.160', 'AMMO4': '0.181', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.236', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.214', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:38,044][52649] DAMAGECOUNT value on done: 1010840.0 [2024-08-06 08:53:38,045][52649] Sum rewards: 69.790, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.229', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.078', 'AMMO4': '0.172', 'AMMO3': '0.191', 'weapon5': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.444', 'WEAPON3': '1.150', 'weapon3': '2.900', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '16.767', 'FRAGCOUNT': '56.000'} [2024-08-06 08:53:38,561][52658] DAMAGECOUNT value on done: 1021206.0 [2024-08-06 08:53:38,562][52658] Sum rewards: 77.627, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.070', 'AMMO5': '0.009', 'AMMO2': '0.034', 'weapon4': '0.118', 'weapon5': '0.130', 'AMMO4': '0.169', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.508', 'WEAPON3': '1.200', 'weapon3': '3.102', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:39,069][52647] DAMAGECOUNT value on done: 1087351.0 [2024-08-06 08:53:39,069][52647] Sum rewards: 79.797, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.725', 'AMMO5': '0.016', 'AMMO2': '0.046', 'weapon4': '0.070', 'weapon5': '0.178', 'AMMO4': '0.232', 'AMMO3': '0.232', 'weapon2': '0.348', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.122', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.698', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:39,272][52660] DAMAGECOUNT value on done: 1025732.0 [2024-08-06 08:53:39,272][52660] Sum rewards: 79.983, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.420', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.028', 'AMMO4': '0.065', 'weapon5': '0.090', 'WEAPON4': '0.100', 'AMMO3': '0.136', 'WEAPON5': '0.200', 'weapon2': '0.570', 'WEAPON3': '0.950', 'weapon3': '3.098', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:40,224][52650] Updated weights for policy 0, policy_version 87651 (0.0020) [2024-08-06 08:53:40,439][52811] DAMAGECOUNT value on done: 959810.0 [2024-08-06 08:53:40,439][52811] Sum rewards: 76.941, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.003', 'AMMO2': '0.027', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.134', 'AMMO3': '0.195', 'WEAPON4': '0.200', 'weapon4': '0.320', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '17.565', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:40,467][52669] DAMAGECOUNT value on done: 1045354.0 [2024-08-06 08:53:40,468][52669] Sum rewards: 87.191, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.290', 'AMMO5': '0.015', 'AMMO2': '0.019', 'weapon4': '0.068', 'AMMO4': '0.096', 'weapon5': '0.182', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'weapon2': '0.244', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.250', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.850', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:40,710][52795] DAMAGECOUNT value on done: 956828.0 [2024-08-06 08:53:40,713][52795] Sum rewards: 75.973, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.250', 'AMMO5': '0.012', 'AMMO2': '0.023', 'weapon4': '0.044', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'weapon5': '0.160', 'AMMO3': '0.198', 'WEAPON5': '0.250', 'weapon2': '0.624', 'WEAPON3': '1.300', 'weapon3': '2.992', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '19.113', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:40,907][52671] DAMAGECOUNT value on done: 1035545.0 [2024-08-06 08:53:40,907][52671] Sum rewards: 89.850, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.040', 'AMMO5': '0.003', 'weapon4': '0.012', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.115', 'AMMO3': '0.169', 'weapon2': '0.374', 'WEAPON3': '1.100', 'weapon3': '3.424', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.217', 'FRAGCOUNT': '72.000'} [2024-08-06 08:53:41,143][52649] DAMAGECOUNT value on done: 1013861.0 [2024-08-06 08:53:41,144][52649] Sum rewards: 74.384, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.100', 'AMMO5': '0.009', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.118', 'weapon4': '0.152', 'AMMO3': '0.199', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.276', 'WEAPON3': '1.250', 'weapon3': '3.214', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.084', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:41,766][52658] DAMAGECOUNT value on done: 1050884.0 [2024-08-06 08:53:41,767][52658] Sum rewards: 81.849, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-4.460', 'AMMO5': '0.024', 'AMMO2': '0.039', 'weapon4': '0.060', 'weapon5': '0.124', 'AMMO4': '0.197', 'AMMO3': '0.286', 'weapon2': '0.298', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.850', 'weapon3': '3.206', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.715', 'FRAGCOUNT': '72.000'} [2024-08-06 08:53:41,768][52647] DAMAGECOUNT value on done: 1071301.0 [2024-08-06 08:53:41,769][52647] Sum rewards: 81.527, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.820', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.042', 'weapon5': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.512', 'WEAPON3': '1.450', 'weapon3': '3.134', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:42,293][52660] DAMAGECOUNT value on done: 1017205.0 [2024-08-06 08:53:42,294][52660] Sum rewards: 82.041, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.476', 'AMMO5': '0.008', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.128', 'AMMO4': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.270', 'AMMO3': '0.277', 'WEAPON3': '1.600', 'weapon3': '3.274', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.304', 'FRAGCOUNT': '69.000'} [2024-08-06 08:53:42,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 718069760. Throughput: 0: 4361.1. Samples: 179525770. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:53:42,794][52567] Avg episode reward: [(0, '76.259')] [2024-08-06 08:53:43,435][52669] DAMAGECOUNT value on done: 1038255.0 [2024-08-06 08:53:43,435][52669] Sum rewards: 88.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.756', 'AMMO5': '0.010', 'AMMO2': '0.022', 'AMMO4': '0.108', 'weapon5': '0.180', 'weapon2': '0.232', 'AMMO3': '0.246', 'weapon4': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.016', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.996', 'FRAGCOUNT': '72.000'} [2024-08-06 08:53:43,516][52811] DAMAGECOUNT value on done: 963480.0 [2024-08-06 08:53:43,517][52811] Sum rewards: 85.898, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.019', 'AMMO2': '0.059', 'weapon4': '0.074', 'AMMO3': '0.215', 'weapon5': '0.238', 'weapon2': '0.262', 'AMMO4': '0.293', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '3.116', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '21.621', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:43,777][52671] DAMAGECOUNT value on done: 1037820.0 [2024-08-06 08:53:43,779][52671] Sum rewards: 67.469, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.318', 'AMMO5': '0.018', 'AMMO2': '0.049', 'weapon4': '0.114', 'weapon5': '0.222', 'AMMO3': '0.230', 'AMMO4': '0.245', 'weapon2': '0.288', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.094', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.178', 'FRAGCOUNT': '56.000'} [2024-08-06 08:53:43,827][52665] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:53:44,091][52658] DAMAGECOUNT value on done: 1037365.0 [2024-08-06 08:53:44,091][52658] Sum rewards: 75.526, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.245', 'AMMO2': '0.012', 'AMMO5': '0.012', 'weapon4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.050', 'AMMO4': '0.058', 'AMMO3': '0.189', 'WEAPON5': '0.250', 'weapon2': '0.720', 'WEAPON3': '1.300', 'weapon3': '3.012', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '61.000'} [2024-08-06 08:53:44,123][52649] DAMAGECOUNT value on done: 1004293.0 [2024-08-06 08:53:44,124][52649] Sum rewards: 93.698, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.040', 'AMMO5': '0.010', 'AMMO2': '0.014', 'weapon4': '0.028', 'AMMO4': '0.073', 'weapon5': '0.088', 'WEAPON4': '0.150', 'weapon2': '0.164', 'AMMO3': '0.239', 'WEAPON5': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.468', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '23.034', 'FRAGCOUNT': '77.000'} [2024-08-06 08:53:44,418][52647] DAMAGECOUNT value on done: 1082981.0 [2024-08-06 08:53:44,419][52647] Sum rewards: 70.119, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.570', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.092', 'AMMO4': '0.126', 'weapon5': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.249', 'WEAPON4': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.450', 'weapon3': '3.228', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.868', 'FRAGCOUNT': '60.000'} [2024-08-06 08:53:45,239][52650] Updated weights for policy 0, policy_version 87661 (0.0011) [2024-08-06 08:53:45,433][52660] DAMAGECOUNT value on done: 1017518.0 [2024-08-06 08:53:45,435][52660] Sum rewards: 66.072, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.630', 'AMMO5': '0.007', 'AMMO2': '0.024', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.118', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.592', 'WEAPON3': '1.050', 'HITCOUNT': '3.110', 'weapon3': '3.130', 'DAMAGECOUNT': '15.828', 'FRAGCOUNT': '53.000'} [2024-08-06 08:53:46,392][52669] DAMAGECOUNT value on done: 1039726.0 [2024-08-06 08:53:46,395][52669] Sum rewards: 80.232, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.038', 'AMMO5': '0.010', 'AMMO2': '0.029', 'AMMO4': '0.142', 'weapon2': '0.174', 'AMMO3': '0.220', 'WEAPON5': '0.250', 'weapon5': '0.260', 'WEAPON4': '0.300', 'weapon4': '0.330', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.451', 'FRAGCOUNT': '64.500'} [2024-08-06 08:53:46,613][52658] DAMAGECOUNT value on done: 1045326.0 [2024-08-06 08:53:46,614][52658] Sum rewards: 70.855, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.550', 'AMMO5': '0.005', 'AMMO2': '0.007', 'weapon4': '0.020', 'AMMO4': '0.034', 'weapon5': '0.042', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.211', 'weapon2': '0.408', 'WEAPON3': '1.350', 'HITCOUNT': '3.350', 'weapon3': '3.368', 'DAMAGECOUNT': '17.760', 'FRAGCOUNT': '58.000'} [2024-08-06 08:53:46,622][52811] DAMAGECOUNT value on done: 964280.0 [2024-08-06 08:53:46,622][52811] Sum rewards: 67.333, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.170', 'AMMO5': '0.008', 'weapon5': '0.032', 'AMMO2': '0.038', 'weapon4': '0.088', 'AMMO4': '0.193', 'WEAPON5': '0.200', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'weapon2': '0.364', 'WEAPON3': '1.350', 'weapon3': '3.296', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:46,819][52647] DAMAGECOUNT value on done: 1074096.0 [2024-08-06 08:53:46,827][52647] Sum rewards: 68.270, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.060', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.028', 'AMMO4': '0.100', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.250', 'WEAPON3': '1.550', 'weapon3': '3.392', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.934', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:46,874][52671] DAMAGECOUNT value on done: 1019229.0 [2024-08-06 08:53:46,874][52671] Sum rewards: 75.145, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.100', 'AMMO5': '0.013', 'AMMO2': '0.046', 'AMMO3': '0.161', 'weapon5': '0.170', 'AMMO4': '0.230', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.418', 'weapon2': '0.502', 'WEAPON3': '1.000', 'weapon3': '2.664', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '16.701', 'FRAGCOUNT': '59.000'} [2024-08-06 08:53:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 718159872. Throughput: 0: 4366.4. Samples: 179539110. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:53:47,795][52567] Avg episode reward: [(0, '76.591')] [2024-08-06 08:53:48,860][52669] DAMAGECOUNT value on done: 1037798.0 [2024-08-06 08:53:48,862][52669] Sum rewards: 74.625, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.640', 'AMMO5': '0.003', 'AMMO2': '0.022', 'weapon5': '0.042', 'weapon4': '0.080', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'WEAPON4': '0.150', 'AMMO3': '0.237', 'weapon2': '0.416', 'WEAPON3': '1.600', 'weapon3': '3.282', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '17.595', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:49,030][52658] DAMAGECOUNT value on done: 1027684.0 [2024-08-06 08:53:49,030][52658] Sum rewards: 76.464, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.010', 'AMMO2': '0.028', 'weapon4': '0.040', 'weapon5': '0.104', 'AMMO4': '0.138', 'AMMO3': '0.191', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.486', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:49,588][52811] DAMAGECOUNT value on done: 974107.0 [2024-08-06 08:53:49,588][52811] Sum rewards: 78.824, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.725', 'AMMO5': '0.008', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.046', 'AMMO4': '0.055', 'WEAPON4': '0.100', 'AMMO3': '0.194', 'WEAPON5': '0.200', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.322', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '65.000'} [2024-08-06 08:53:49,638][52647] DAMAGECOUNT value on done: 1076971.0 [2024-08-06 08:53:49,638][52647] Sum rewards: 79.356, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.165', 'AMMO5': '0.010', 'AMMO2': '0.023', 'weapon4': '0.088', 'AMMO4': '0.116', 'weapon5': '0.172', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'AMMO3': '0.278', 'WEAPON3': '1.600', 'weapon3': '3.148', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '20.130', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:49,694][52663] DAMAGECOUNT value on done: 1045616.0 [2024-08-06 08:53:49,695][52663] Sum rewards: 69.324, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.212', 'AMMO5': '0.005', 'AMMO2': '0.015', 'AMMO4': '0.075', 'weapon5': '0.096', 'WEAPON5': '0.150', 'weapon2': '0.164', 'AMMO3': '0.198', 'WEAPON4': '0.250', 'weapon4': '0.432', 'WEAPON3': '1.350', 'weapon3': '3.092', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.088', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:50,012][52671] DAMAGECOUNT value on done: 1044112.0 [2024-08-06 08:53:50,012][52671] Sum rewards: 69.040, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.922', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon5': '0.164', 'weapon4': '0.222', 'AMMO3': '0.224', 'AMMO4': '0.224', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.870', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.451', 'FRAGCOUNT': '57.000'} [2024-08-06 08:53:50,178][52650] Updated weights for policy 0, policy_version 87671 (0.0053) [2024-08-06 08:53:51,251][52669] DAMAGECOUNT value on done: 1025826.0 [2024-08-06 08:53:51,253][52669] Sum rewards: 60.790, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.170', 'AMMO5': '0.007', 'weapon4': '0.016', 'AMMO2': '0.024', 'WEAPON4': '0.050', 'weapon5': '0.056', 'AMMO4': '0.121', 'WEAPON5': '0.150', 'AMMO3': '0.196', 'weapon2': '0.384', 'WEAPON3': '1.300', 'HITCOUNT': '3.040', 'weapon3': '3.364', 'DAMAGECOUNT': '15.252', 'FRAGCOUNT': '51.000'} [2024-08-06 08:53:51,806][52658] DAMAGECOUNT value on done: 1040235.0 [2024-08-06 08:53:51,806][52658] Sum rewards: 73.847, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.510', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.078', 'AMMO4': '0.159', 'weapon5': '0.168', 'AMMO3': '0.187', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.682', 'WEAPON3': '1.200', 'weapon3': '2.838', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.231', 'FRAGCOUNT': '59.000'} [2024-08-06 08:53:52,389][52663] DAMAGECOUNT value on done: 1030916.0 [2024-08-06 08:53:52,397][52663] Sum rewards: 72.272, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.510', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon5': '0.058', 'AMMO4': '0.081', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.510', 'WEAPON3': '1.300', 'weapon3': '3.114', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.130', 'FRAGCOUNT': '59.000'} [2024-08-06 08:53:52,489][52671] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:53:52,604][52811] DAMAGECOUNT value on done: 965749.0 [2024-08-06 08:53:52,604][52811] Sum rewards: 74.970, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.550', 'AMMO5': '0.012', 'AMMO2': '0.052', 'weapon5': '0.166', 'weapon2': '0.210', 'AMMO3': '0.255', 'AMMO4': '0.262', 'weapon4': '0.380', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.550', 'weapon3': '2.960', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:52,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17411.5). Total num frames: 718249984. Throughput: 0: 4364.2. Samples: 179565120. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:53:52,794][52567] Avg episode reward: [(0, '76.011')] [2024-08-06 08:53:52,835][52671] DAMAGECOUNT value on done: 1041809.0 [2024-08-06 08:53:52,836][52671] Sum rewards: 86.288, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.834', 'ARMOR': '0.004', 'AMMO5': '0.005', 'AMMO2': '0.022', 'WEAPON5': '0.100', 'AMMO4': '0.111', 'weapon5': '0.112', 'AMMO3': '0.156', 'WEAPON4': '0.200', 'weapon2': '0.338', 'weapon4': '0.374', 'WEAPON3': '1.000', 'weapon3': '2.956', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '20.283', 'FRAGCOUNT': '68.000'} [2024-08-06 08:53:54,091][52669] DAMAGECOUNT value on done: 1029923.0 [2024-08-06 08:53:54,093][52669] Sum rewards: 75.402, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.554', 'AMMO5': '0.004', 'AMMO2': '0.022', 'weapon4': '0.024', 'weapon5': '0.038', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.108', 'AMMO3': '0.167', 'weapon2': '0.520', 'WEAPON3': '1.150', 'weapon3': '3.244', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.479', 'FRAGCOUNT': '62.000'} [2024-08-06 08:53:55,027][52658] DAMAGECOUNT value on done: 1032297.0 [2024-08-06 08:53:55,028][52658] Sum rewards: 78.688, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.260', 'AMMO5': '0.013', 'AMMO2': '0.024', 'AMMO4': '0.118', 'weapon5': '0.186', 'AMMO3': '0.201', 'weapon4': '0.248', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.380', 'WEAPON3': '1.250', 'weapon3': '2.944', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.414', 'FRAGCOUNT': '64.000'} [2024-08-06 08:53:55,142][52663] DAMAGECOUNT value on done: 1026333.0 [2024-08-06 08:53:55,142][52663] Sum rewards: 81.440, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.035', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.088', 'weapon5': '0.112', 'AMMO4': '0.159', 'AMMO3': '0.185', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.438', 'WEAPON3': '1.100', 'weapon3': '3.156', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '19.044', 'FRAGCOUNT': '66.000'} [2024-08-06 08:53:55,148][52650] Updated weights for policy 0, policy_version 87681 (0.0013) [2024-08-06 08:53:55,680][52671] DAMAGECOUNT value on done: 1036435.0 [2024-08-06 08:53:55,681][52671] Sum rewards: 82.688, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.610', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.044', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'WEAPON4': '0.100', 'weapon2': '0.174', 'weapon4': '0.208', 'AMMO3': '0.258', 'WEAPON3': '1.550', 'weapon3': '3.358', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.278', 'FRAGCOUNT': '70.000'} [2024-08-06 08:53:55,740][52811] DAMAGECOUNT value on done: 963234.0 [2024-08-06 08:53:55,741][52811] Sum rewards: 71.159, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.670', 'AMMO5': '0.021', 'AMMO2': '0.052', 'weapon4': '0.084', 'AMMO3': '0.152', 'weapon5': '0.226', 'AMMO4': '0.260', 'WEAPON4': '0.400', 'weapon2': '0.470', 'WEAPON5': '0.500', 'WEAPON3': '0.950', 'weapon3': '2.988', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.217', 'FRAGCOUNT': '55.000'} [2024-08-06 08:53:56,811][52669] DAMAGECOUNT value on done: 1038767.0 [2024-08-06 08:53:56,812][52669] Sum rewards: 74.260, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.343', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.096', 'weapon5': '0.128', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.246', 'weapon2': '0.296', 'WEAPON3': '1.400', 'weapon3': '3.310', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.445', 'FRAGCOUNT': '63.000'} [2024-08-06 08:53:57,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17339.7, 300 sec: 17383.7). Total num frames: 718323712. Throughput: 0: 4362.4. Samples: 179591400. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:53:57,802][52567] Avg episode reward: [(0, '76.326')] [2024-08-06 08:53:57,849][52663] DAMAGECOUNT value on done: 1033276.0 [2024-08-06 08:53:57,849][52663] Sum rewards: 82.162, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.834', 'AMMO5': '0.010', 'AMMO2': '0.027', 'weapon4': '0.060', 'AMMO4': '0.135', 'weapon5': '0.144', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.534', 'WEAPON3': '1.250', 'weapon3': '3.042', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.023', 'FRAGCOUNT': '67.000'} [2024-08-06 08:53:58,089][52658] DAMAGECOUNT value on done: 1034532.0 [2024-08-06 08:53:58,090][52658] Sum rewards: 79.994, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.405', 'AMMO5': '0.010', 'AMMO2': '0.031', 'AMMO3': '0.118', 'AMMO4': '0.153', 'weapon5': '0.184', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.400', 'weapon2': '0.572', 'WEAPON3': '0.750', 'weapon3': '2.620', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '60.000'} [2024-08-06 08:53:58,232][52671] DAMAGECOUNT value on done: 1041861.0 [2024-08-06 08:53:58,233][52671] Sum rewards: 66.750, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.045', 'AMMO5': '0.020', 'AMMO2': '0.032', 'weapon4': '0.064', 'AMMO4': '0.160', 'weapon5': '0.190', 'AMMO3': '0.226', 'WEAPON4': '0.300', 'weapon2': '0.358', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'HITCOUNT': '3.120', 'weapon3': '3.144', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '54.000'} [2024-08-06 08:53:58,822][52811] DAMAGECOUNT value on done: 960395.0 [2024-08-06 08:53:58,825][52811] Sum rewards: 74.199, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.488', 'AMMO5': '0.005', 'AMMO2': '0.012', 'AMMO4': '0.061', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.113', 'weapon5': '0.116', 'weapon4': '0.374', 'weapon2': '0.720', 'WEAPON3': '0.750', 'weapon3': '2.646', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.700', 'FRAGCOUNT': '56.000'} [2024-08-06 08:53:59,292][52650] Updated weights for policy 0, policy_version 87691 (0.0012) [2024-08-06 08:53:59,632][52669] DAMAGECOUNT value on done: 1054937.0 [2024-08-06 08:53:59,635][52669] Sum rewards: 69.474, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.345', 'AMMO5': '0.011', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.156', 'AMMO4': '0.167', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.108', 'FRAGCOUNT': '57.000'} [2024-08-06 08:54:00,789][52671] DAMAGECOUNT value on done: 1025267.0 [2024-08-06 08:54:00,790][52671] Sum rewards: 87.810, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.200', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.102', 'weapon5': '0.116', 'AMMO4': '0.140', 'AMMO3': '0.185', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.412', 'WEAPON3': '1.150', 'weapon3': '3.138', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '19.770', 'FRAGCOUNT': '70.000'} [2024-08-06 08:54:00,884][52663] DAMAGECOUNT value on done: 1032695.0 [2024-08-06 08:54:00,884][52663] Sum rewards: 82.605, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.385', 'AMMO2': '0.022', 'AMMO4': '0.112', 'AMMO3': '0.199', 'weapon2': '0.544', 'WEAPON3': '1.250', 'weapon3': '3.306', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '19.527', 'FRAGCOUNT': '67.000'} [2024-08-06 08:54:01,061][52658] DAMAGECOUNT value on done: 1018284.0 [2024-08-06 08:54:01,068][52658] Sum rewards: 64.942, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.220', 'AMMO5': '0.015', 'AMMO2': '0.027', 'AMMO6': '0.100', 'AMMO7': '0.100', 'WEAPON7': '0.100', 'weapon7': '0.118', 'AMMO4': '0.135', 'AMMO3': '0.138', 'weapon5': '0.248', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon4': '0.380', 'weapon2': '0.670', 'WEAPON3': '0.800', 'weapon3': '2.312', 'HITCOUNT': '2.850', 'DAMAGECOUNT': '14.268', 'FRAGCOUNT': '52.000'} [2024-08-06 08:54:01,399][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:54:01,741][52811] DAMAGECOUNT value on done: 963895.0 [2024-08-06 08:54:01,741][52811] Sum rewards: 74.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.070', 'AMMO5': '0.020', 'AMMO2': '0.078', 'weapon4': '0.124', 'AMMO3': '0.259', 'weapon5': '0.306', 'weapon2': '0.346', 'AMMO4': '0.390', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.600', 'weapon3': '2.882', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '19.371', 'FRAGCOUNT': '61.000'} [2024-08-06 08:54:02,532][52669] DAMAGECOUNT value on done: 1044191.0 [2024-08-06 08:54:02,532][52669] Sum rewards: 64.903, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.430', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.017', 'weapon5': '0.046', 'AMMO4': '0.084', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.213', 'weapon2': '0.560', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.244', 'DAMAGECOUNT': '15.642', 'FRAGCOUNT': '54.000'} [2024-08-06 08:54:02,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.3). Total num frames: 718422016. Throughput: 0: 4365.3. Samples: 179604510. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:54:02,802][52567] Avg episode reward: [(0, '76.281')] [2024-08-06 08:54:03,845][52663] DAMAGECOUNT value on done: 1038013.0 [2024-08-06 08:54:03,845][52663] Sum rewards: 69.657, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.195', 'AMMO5': '0.009', 'AMMO2': '0.010', 'weapon4': '0.030', 'AMMO4': '0.048', 'WEAPON4': '0.100', 'weapon5': '0.104', 'WEAPON5': '0.200', 'AMMO3': '0.226', 'weapon2': '0.252', 'WEAPON3': '1.350', 'weapon3': '3.390', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.913', 'FRAGCOUNT': '58.000'} [2024-08-06 08:54:04,127][52658] DAMAGECOUNT value on done: 1037224.0 [2024-08-06 08:54:04,128][52658] Sum rewards: 77.197, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.390', 'AMMO5': '0.012', 'AMMO2': '0.029', 'weapon5': '0.126', 'weapon4': '0.134', 'AMMO4': '0.147', 'weapon2': '0.174', 'AMMO3': '0.175', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.376', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.403', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:04,280][52650] Updated weights for policy 0, policy_version 87701 (0.0013) [2024-08-06 08:54:04,800][52811] DAMAGECOUNT value on done: 968523.0 [2024-08-06 08:54:04,804][52811] Sum rewards: 88.622, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.210', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon5': '0.044', 'AMMO4': '0.062', 'WEAPON5': '0.100', 'weapon4': '0.116', 'WEAPON4': '0.150', 'AMMO3': '0.195', 'weapon2': '0.472', 'WEAPON3': '1.300', 'weapon3': '3.150', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.316', 'FRAGCOUNT': '73.000'} [2024-08-06 08:54:05,272][52649] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:54:05,605][52669] DAMAGECOUNT value on done: 1041645.0 [2024-08-06 08:54:05,606][52669] Sum rewards: 82.144, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.380', 'AMMO5': '0.010', 'AMMO2': '0.022', 'weapon5': '0.086', 'AMMO4': '0.109', 'AMMO3': '0.173', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.328', 'weapon2': '0.570', 'WEAPON3': '1.050', 'weapon3': '2.846', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.500', 'FRAGCOUNT': '65.000'} [2024-08-06 08:54:06,950][52658] DAMAGECOUNT value on done: 1029649.0 [2024-08-06 08:54:06,950][52658] Sum rewards: 75.239, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.690', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.120', 'weapon5': '0.142', 'AMMO3': '0.181', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon4': '0.360', 'weapon2': '0.452', 'WEAPON3': '1.100', 'weapon3': '2.778', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '61.000'} [2024-08-06 08:54:06,982][52663] DAMAGECOUNT value on done: 1030793.0 [2024-08-06 08:54:06,982][52663] Sum rewards: 78.784, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.980', 'AMMO5': '0.016', 'AMMO2': '0.053', 'weapon4': '0.112', 'weapon5': '0.214', 'AMMO3': '0.236', 'AMMO4': '0.264', 'weapon2': '0.346', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.450', 'weapon3': '3.022', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.971', 'FRAGCOUNT': '66.000'} [2024-08-06 08:54:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 718503936. Throughput: 0: 4361.8. Samples: 179630570. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:54:07,794][52567] Avg episode reward: [(0, '76.497')] [2024-08-06 08:54:07,828][52811] DAMAGECOUNT value on done: 975454.0 [2024-08-06 08:54:07,829][52811] Sum rewards: 69.247, reward structure: {'DEATHCOUNT': '-18.000', 'HEALTH': '-1.476', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.132', 'weapon5': '0.154', 'AMMO4': '0.190', 'weapon2': '0.258', 'WEAPON5': '0.300', 'AMMO3': '0.310', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.116', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.814', 'FRAGCOUNT': '61.000'} [2024-08-06 08:54:08,583][52650] Updated weights for policy 0, policy_version 87711 (0.0035) [2024-08-06 08:54:08,732][52669] DAMAGECOUNT value on done: 1046158.0 [2024-08-06 08:54:08,732][52669] Sum rewards: 70.463, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.620', 'AMMO5': '0.008', 'AMMO2': '0.036', 'weapon4': '0.044', 'weapon5': '0.090', 'AMMO4': '0.178', 'AMMO3': '0.208', 'WEAPON5': '0.250', 'weapon2': '0.322', 'WEAPON4': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.344', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '18.033', 'FRAGCOUNT': '58.000'} [2024-08-06 08:54:09,599][52669] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:54:09,958][52663] DAMAGECOUNT value on done: 1016943.0 [2024-08-06 08:54:09,959][52663] Sum rewards: 78.159, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.908', 'AMMO5': '0.011', 'AMMO2': '0.032', 'weapon4': '0.062', 'weapon5': '0.156', 'AMMO4': '0.158', 'AMMO3': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.458', 'WEAPON3': '1.350', 'weapon3': '3.064', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '19.062', 'FRAGCOUNT': '65.000'} [2024-08-06 08:54:10,051][52670] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:54:10,186][52658] DAMAGECOUNT value on done: 1029250.0 [2024-08-06 08:54:10,188][52658] Sum rewards: 85.794, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.015', 'weapon4': '0.028', 'AMMO4': '0.075', 'weapon5': '0.120', 'WEAPON4': '0.150', 'AMMO3': '0.211', 'weapon2': '0.236', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.392', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.886', 'FRAGCOUNT': '70.000'} [2024-08-06 08:54:10,843][52811] DAMAGECOUNT value on done: 958266.0 [2024-08-06 08:54:10,843][52811] Sum rewards: 84.467, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.775', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.088', 'weapon5': '0.128', 'AMMO3': '0.171', 'AMMO4': '0.171', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.506', 'WEAPON3': '1.050', 'weapon3': '3.114', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '67.000'} [2024-08-06 08:54:10,929][52794] DAMAGECOUNT value on done: 1025007.0 [2024-08-06 08:54:10,931][52794] Sum rewards: 63.006, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.229', 'AMMO5': '0.019', 'AMMO2': '0.052', 'AMMO3': '0.172', 'AMMO4': '0.259', 'weapon2': '0.262', 'weapon5': '0.318', 'weapon4': '0.352', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.050', 'weapon3': '2.676', 'HITCOUNT': '2.840', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '50.000'} [2024-08-06 08:54:11,658][52669] DAMAGECOUNT value on done: 1047529.0 [2024-08-06 08:54:11,661][52669] Sum rewards: 61.466, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.040', 'AMMO5': '0.014', 'AMMO2': '0.023', 'weapon4': '0.102', 'AMMO4': '0.115', 'weapon5': '0.118', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.472', 'WEAPON3': '1.300', 'HITCOUNT': '3.010', 'weapon3': '3.058', 'DAMAGECOUNT': '16.842', 'FRAGCOUNT': '49.000'} [2024-08-06 08:54:12,794][52567] Fps is (10 sec: 16383.4, 60 sec: 17476.2, 300 sec: 17383.7). Total num frames: 718585856. Throughput: 0: 4364.6. Samples: 179656790. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:54:12,802][52567] Avg episode reward: [(0, '76.287')] [2024-08-06 08:54:12,913][52663] DAMAGECOUNT value on done: 1028880.0 [2024-08-06 08:54:12,913][52663] Sum rewards: 77.933, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.258', 'AMMO5': '0.007', 'AMMO2': '0.025', 'weapon4': '0.062', 'weapon5': '0.120', 'AMMO4': '0.124', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.234', 'WEAPON3': '1.550', 'weapon3': '3.362', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.440', 'FRAGCOUNT': '65.000'} [2024-08-06 08:54:12,997][52614] Signal inference workers to stop experience collection... (16200 times) [2024-08-06 08:54:13,006][52614] Signal inference workers to resume experience collection... (16200 times) [2024-08-06 08:54:13,084][52650] InferenceWorker_p0-w0: stopping experience collection (16200 times) [2024-08-06 08:54:13,084][52650] InferenceWorker_p0-w0: resuming experience collection (16200 times) [2024-08-06 08:54:13,438][52650] Updated weights for policy 0, policy_version 87721 (0.0014) [2024-08-06 08:54:13,845][52811] DAMAGECOUNT value on done: 962498.0 [2024-08-06 08:54:13,846][52811] Sum rewards: 65.626, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.485', 'AMMO5': '0.010', 'AMMO2': '0.047', 'weapon4': '0.146', 'weapon5': '0.172', 'AMMO4': '0.236', 'WEAPON5': '0.250', 'AMMO3': '0.266', 'weapon2': '0.388', 'WEAPON4': '0.400', 'WEAPON3': '1.600', 'weapon3': '2.954', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.082', 'FRAGCOUNT': '57.000'} [2024-08-06 08:54:13,958][52658] DAMAGECOUNT value on done: 1035712.0 [2024-08-06 08:54:13,958][52658] Sum rewards: 67.217, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.780', 'AMMO5': '0.005', 'AMMO2': '0.011', 'weapon4': '0.026', 'AMMO4': '0.055', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'weapon2': '0.530', 'WEAPON3': '1.100', 'weapon3': '3.200', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '53.000'} [2024-08-06 08:54:14,077][52794] DAMAGECOUNT value on done: 1032173.0 [2024-08-06 08:54:14,077][52794] Sum rewards: 74.330, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.105', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.044', 'AMMO4': '0.096', 'weapon5': '0.102', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.646', 'WEAPON3': '1.250', 'weapon3': '3.038', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '60.000'} [2024-08-06 08:54:16,021][52663] DAMAGECOUNT value on done: 1024637.0 [2024-08-06 08:54:16,022][52663] Sum rewards: 75.522, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.769', 'AMMO5': '0.014', 'AMMO2': '0.016', 'AMMO4': '0.079', 'weapon5': '0.104', 'AMMO3': '0.172', 'WEAPON4': '0.200', 'weapon4': '0.202', 'WEAPON5': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.860', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.750', 'FRAGCOUNT': '59.000'} [2024-08-06 08:54:16,648][52794] DAMAGECOUNT value on done: 1040350.0 [2024-08-06 08:54:16,648][52794] Sum rewards: 72.615, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.068', 'AMMO5': '0.016', 'AMMO2': '0.037', 'weapon4': '0.094', 'AMMO4': '0.188', 'AMMO3': '0.209', 'weapon5': '0.212', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.630', 'WEAPON3': '1.300', 'weapon3': '2.826', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.751', 'FRAGCOUNT': '60.000'} [2024-08-06 08:54:16,733][52669] Large shaping reward -2.501 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.252, -84.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:54:17,794][52567] Fps is (10 sec: 18022.0, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 718684160. Throughput: 0: 4364.9. Samples: 179669890. Policy #0 lag: (min: 1.0, avg: 3.4, max: 7.0) [2024-08-06 08:54:17,795][52567] Avg episode reward: [(0, '76.070')] [2024-08-06 08:54:18,366][52650] Updated weights for policy 0, policy_version 87731 (0.0034) [2024-08-06 08:54:18,697][52663] DAMAGECOUNT value on done: 1035426.0 [2024-08-06 08:54:18,699][52663] Sum rewards: 77.971, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.388', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.058', 'AMMO4': '0.130', 'AMMO3': '0.171', 'weapon5': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.310', 'WEAPON3': '1.150', 'weapon3': '3.238', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.146', 'FRAGCOUNT': '62.000'} [2024-08-06 08:54:19,890][52794] DAMAGECOUNT value on done: 1026739.0 [2024-08-06 08:54:19,893][52794] Sum rewards: 60.864, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.425', 'AMMO5': '0.014', 'AMMO2': '0.034', 'weapon4': '0.148', 'AMMO4': '0.169', 'AMMO3': '0.195', 'weapon5': '0.218', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.368', 'WEAPON3': '1.150', 'weapon3': '2.910', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '15.513', 'FRAGCOUNT': '49.000'} [2024-08-06 08:54:21,357][52663] DAMAGECOUNT value on done: 1017936.0 [2024-08-06 08:54:21,358][52663] Sum rewards: 67.986, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.975', 'AMMO5': '0.020', 'AMMO2': '0.026', 'weapon5': '0.128', 'AMMO4': '0.132', 'weapon4': '0.138', 'AMMO3': '0.229', 'WEAPON4': '0.300', 'WEAPON5': '0.450', 'weapon2': '0.620', 'WEAPON3': '1.400', 'weapon3': '2.842', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.046', 'FRAGCOUNT': '58.000'} [2024-08-06 08:54:22,794][52567] Fps is (10 sec: 18022.9, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 718766080. Throughput: 0: 4359.1. Samples: 179695920. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:22,802][52567] Avg episode reward: [(0, '75.659')] [2024-08-06 08:54:22,837][52650] Updated weights for policy 0, policy_version 87741 (0.0025) [2024-08-06 08:54:23,100][52794] DAMAGECOUNT value on done: 1022043.0 [2024-08-06 08:54:23,101][52794] Sum rewards: 77.246, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.062', 'AMMO5': '0.005', 'AMMO2': '0.030', 'weapon5': '0.090', 'weapon4': '0.110', 'AMMO4': '0.151', 'AMMO3': '0.179', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.314', 'WEAPON3': '1.150', 'weapon3': '3.236', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:23,929][52663] DAMAGECOUNT value on done: 1017599.0 [2024-08-06 08:54:23,930][52663] Sum rewards: 80.362, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.640', 'AMMO5': '0.010', 'AMMO2': '0.013', 'weapon4': '0.056', 'AMMO4': '0.067', 'weapon5': '0.092', 'WEAPON4': '0.100', 'AMMO3': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.384', 'WEAPON3': '1.300', 'weapon3': '3.258', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.422', 'FRAGCOUNT': '65.000'} [2024-08-06 08:54:26,068][52794] DAMAGECOUNT value on done: 1028160.0 [2024-08-06 08:54:26,068][52794] Sum rewards: 81.922, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.191', 'AMMO5': '0.003', 'AMMO2': '0.006', 'weapon4': '0.016', 'AMMO4': '0.028', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'weapon2': '0.240', 'AMMO3': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.472', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '20.202', 'FRAGCOUNT': '69.000'} [2024-08-06 08:54:26,713][52663] DAMAGECOUNT value on done: 1026099.0 [2024-08-06 08:54:26,715][52663] Sum rewards: 74.285, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.540', 'AMMO5': '0.016', 'AMMO2': '0.025', 'weapon4': '0.052', 'AMMO3': '0.115', 'AMMO4': '0.125', 'weapon5': '0.170', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '0.750', 'weapon2': '0.914', 'weapon3': '2.688', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.259', 'FRAGCOUNT': '57.000'} [2024-08-06 08:54:27,746][52650] Updated weights for policy 0, policy_version 87751 (0.0012) [2024-08-06 08:54:27,794][52567] Fps is (10 sec: 17203.5, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 718856192. Throughput: 0: 4364.4. Samples: 179722170. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:27,794][52567] Avg episode reward: [(0, '75.754')] [2024-08-06 08:54:27,805][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000087751_718856192.pth... [2024-08-06 08:54:27,933][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000087241_714678272.pth [2024-08-06 08:54:29,041][52794] DAMAGECOUNT value on done: 1026086.0 [2024-08-06 08:54:29,042][52794] Sum rewards: 64.359, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.479', 'AMMO5': '0.003', 'AMMO2': '0.009', 'weapon4': '0.020', 'weapon5': '0.044', 'AMMO4': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.204', 'weapon2': '0.508', 'WEAPON3': '1.250', 'HITCOUNT': '2.930', 'weapon3': '3.252', 'DAMAGECOUNT': '15.474', 'FRAGCOUNT': '54.000'} [2024-08-06 08:54:29,628][52663] DAMAGECOUNT value on done: 1027056.0 [2024-08-06 08:54:29,629][52663] Sum rewards: 75.942, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.656', 'AMMO5': '0.003', 'AMMO2': '0.029', 'weapon5': '0.050', 'weapon4': '0.098', 'WEAPON5': '0.100', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'AMMO3': '0.218', 'weapon2': '0.336', 'WEAPON3': '1.250', 'weapon3': '3.304', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.026', 'FRAGCOUNT': '61.000'} [2024-08-06 08:54:31,844][52794] DAMAGECOUNT value on done: 1018321.0 [2024-08-06 08:54:31,845][52794] Sum rewards: 71.493, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-0.567', 'AMMO5': '0.008', 'WEAPON1': '0.010', 'AMMO2': '0.036', 'weapon5': '0.096', 'AMMO4': '0.181', 'weapon4': '0.186', 'WEAPON5': '0.200', 'AMMO3': '0.244', 'WEAPON4': '0.300', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.060', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.651', 'FRAGCOUNT': '60.000'} [2024-08-06 08:54:32,442][52650] Updated weights for policy 0, policy_version 87761 (0.0023) [2024-08-06 08:54:32,644][52663] DAMAGECOUNT value on done: 1031317.0 [2024-08-06 08:54:32,644][52663] Sum rewards: 78.554, reward structure: {'DEATHCOUNT': '-10.500', 'AMMO5': '0.010', 'AMMO2': '0.016', 'weapon4': '0.030', 'AMMO4': '0.079', 'HEALTH': '0.100', 'weapon5': '0.122', 'WEAPON4': '0.150', 'AMMO3': '0.151', 'WEAPON5': '0.200', 'weapon2': '0.440', 'WEAPON3': '0.900', 'weapon3': '3.158', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.059', 'FRAGCOUNT': '61.000'} [2024-08-06 08:54:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17383.7). Total num frames: 718938112. Throughput: 0: 4350.9. Samples: 179734900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:32,794][52567] Avg episode reward: [(0, '75.440')] [2024-08-06 08:54:34,365][52794] DAMAGECOUNT value on done: 1033330.0 [2024-08-06 08:54:34,367][52794] Sum rewards: 79.751, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.206', 'AMMO5': '0.010', 'AMMO2': '0.030', 'AMMO4': '0.149', 'weapon5': '0.184', 'AMMO3': '0.205', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.308', 'weapon2': '0.320', 'WEAPON3': '1.250', 'weapon3': '2.904', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '19.887', 'FRAGCOUNT': '65.000'} [2024-08-06 08:54:35,398][52803] DAMAGECOUNT value on done: 958040.0 [2024-08-06 08:54:35,399][52803] Sum rewards: 69.857, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.678', 'AMMO5': '0.006', 'AMMO2': '0.043', 'weapon4': '0.062', 'weapon5': '0.086', 'AMMO3': '0.151', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.214', 'weapon2': '0.432', 'WEAPON3': '0.950', 'weapon3': '3.280', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.100', 'FRAGCOUNT': '55.000'} [2024-08-06 08:54:35,483][52663] DAMAGECOUNT value on done: 1029232.0 [2024-08-06 08:54:35,483][52663] Sum rewards: 80.552, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.806', 'AMMO2': '0.008', 'AMMO4': '0.037', 'AMMO3': '0.222', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '3.446', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.819', 'FRAGCOUNT': '68.000'} [2024-08-06 08:54:37,196][52650] Updated weights for policy 0, policy_version 87771 (0.0050) [2024-08-06 08:54:37,252][52794] DAMAGECOUNT value on done: 1029523.0 [2024-08-06 08:54:37,253][52794] Sum rewards: 72.713, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.924', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.056', 'AMMO4': '0.153', 'weapon5': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.235', 'weapon2': '0.398', 'WEAPON3': '1.500', 'weapon3': '3.064', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '61.000'} [2024-08-06 08:54:37,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 719028224. Throughput: 0: 4358.4. Samples: 179761250. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:37,795][52567] Avg episode reward: [(0, '75.280')] [2024-08-06 08:54:38,157][52663] DAMAGECOUNT value on done: 1034894.0 [2024-08-06 08:54:38,159][52663] Sum rewards: 77.190, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.398', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon5': '0.168', 'AMMO3': '0.194', 'AMMO4': '0.202', 'weapon4': '0.274', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.546', 'WEAPON3': '1.300', 'weapon3': '2.658', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '19.269', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:38,642][52803] DAMAGECOUNT value on done: 957972.0 [2024-08-06 08:54:38,642][52803] Sum rewards: 78.127, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.325', 'AMMO5': '0.011', 'AMMO2': '0.060', 'weapon4': '0.060', 'weapon5': '0.168', 'weapon2': '0.186', 'AMMO4': '0.298', 'AMMO3': '0.301', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.800', 'weapon3': '3.336', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.572', 'FRAGCOUNT': '67.000'} [2024-08-06 08:54:39,834][52794] DAMAGECOUNT value on done: 1021585.0 [2024-08-06 08:54:39,834][52794] Sum rewards: 73.835, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.028', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.134', 'AMMO4': '0.206', 'weapon5': '0.222', 'AMMO3': '0.264', 'WEAPON5': '0.350', 'weapon2': '0.370', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '2.934', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.009', 'FRAGCOUNT': '62.000'} [2024-08-06 08:54:40,914][52663] DAMAGECOUNT value on done: 1041345.0 [2024-08-06 08:54:40,914][52663] Sum rewards: 80.935, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.780', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon4': '0.088', 'weapon5': '0.102', 'AMMO3': '0.155', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.472', 'WEAPON3': '1.000', 'weapon3': '3.126', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.827', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:41,735][52650] Updated weights for policy 0, policy_version 87781 (0.0020) [2024-08-06 08:54:41,767][52803] DAMAGECOUNT value on done: 963698.0 [2024-08-06 08:54:41,769][52803] Sum rewards: 73.300, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.856', 'AMMO5': '0.016', 'AMMO2': '0.046', 'AMMO3': '0.186', 'AMMO4': '0.230', 'weapon5': '0.252', 'weapon4': '0.422', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.490', 'WEAPON3': '1.200', 'weapon3': '2.596', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '17.097', 'FRAGCOUNT': '59.000'} [2024-08-06 08:54:42,110][52664] DAMAGECOUNT value on done: 1062690.0 [2024-08-06 08:54:42,118][52664] Sum rewards: 80.420, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.960', 'AMMO5': '0.008', 'AMMO2': '0.030', 'weapon4': '0.062', 'weapon5': '0.136', 'AMMO4': '0.152', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.313', 'weapon2': '0.438', 'WEAPON3': '1.850', 'weapon3': '3.058', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '70.000'} [2024-08-06 08:54:42,710][52670] DAMAGECOUNT value on done: 1016687.0 [2024-08-06 08:54:42,711][52670] Sum rewards: 81.050, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.386', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.042', 'weapon5': '0.118', 'AMMO4': '0.143', 'AMMO3': '0.153', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.358', 'WEAPON3': '1.050', 'weapon3': '3.336', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.719', 'FRAGCOUNT': '64.000'} [2024-08-06 08:54:42,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 719118336. Throughput: 0: 4351.3. Samples: 179787210. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:42,794][52567] Avg episode reward: [(0, '75.748')] [2024-08-06 08:54:42,834][52794] DAMAGECOUNT value on done: 1035754.0 [2024-08-06 08:54:42,835][52794] Sum rewards: 74.316, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-0.456', 'AMMO5': '0.008', 'AMMO2': '0.027', 'AMMO3': '0.127', 'AMMO4': '0.134', 'weapon5': '0.138', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.478', 'weapon2': '0.546', 'WEAPON3': '0.800', 'weapon3': '2.620', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '16.683', 'FRAGCOUNT': '57.000'} [2024-08-06 08:54:43,655][52663] DAMAGECOUNT value on done: 1020479.0 [2024-08-06 08:54:43,659][52663] Sum rewards: 78.446, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.990', 'AMMO5': '0.009', 'AMMO2': '0.026', 'weapon5': '0.108', 'AMMO4': '0.132', 'weapon4': '0.210', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.388', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.785', 'FRAGCOUNT': '66.000'} [2024-08-06 08:54:44,851][52803] DAMAGECOUNT value on done: 959850.0 [2024-08-06 08:54:44,852][52803] Sum rewards: 82.776, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.350', 'AMMO5': '0.005', 'AMMO2': '0.015', 'weapon4': '0.034', 'AMMO4': '0.074', 'weapon5': '0.094', 'weapon2': '0.140', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.269', 'WEAPON3': '1.600', 'weapon3': '3.496', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.949', 'FRAGCOUNT': '69.000'} [2024-08-06 08:54:44,888][52664] DAMAGECOUNT value on done: 1069147.0 [2024-08-06 08:54:44,888][52664] Sum rewards: 79.976, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.332', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.044', 'weapon5': '0.108', 'AMMO4': '0.110', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.184', 'weapon2': '0.328', 'WEAPON3': '1.100', 'weapon3': '3.336', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '19.179', 'FRAGCOUNT': '64.000'} [2024-08-06 08:54:45,409][52670] DAMAGECOUNT value on done: 1037098.0 [2024-08-06 08:54:45,411][52670] Sum rewards: 80.527, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.480', 'AMMO2': '0.003', 'AMMO5': '0.007', 'weapon4': '0.012', 'AMMO4': '0.016', 'WEAPON4': '0.050', 'weapon5': '0.058', 'WEAPON5': '0.150', 'AMMO3': '0.243', 'weapon2': '0.292', 'WEAPON3': '1.600', 'weapon3': '3.426', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.509', 'FRAGCOUNT': '69.000'} [2024-08-06 08:54:45,875][52794] DAMAGECOUNT value on done: 1029662.0 [2024-08-06 08:54:45,875][52794] Sum rewards: 93.190, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.009', 'AMMO2': '0.031', 'weapon4': '0.044', 'weapon5': '0.100', 'AMMO4': '0.157', 'AMMO3': '0.165', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'HEALTH': '0.270', 'weapon2': '0.340', 'WEAPON3': '0.950', 'weapon3': '3.322', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.772', 'FRAGCOUNT': '74.000'} [2024-08-06 08:54:46,463][52650] Updated weights for policy 0, policy_version 87791 (0.0042) [2024-08-06 08:54:47,794][52567] Fps is (10 sec: 18022.2, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 719208448. Throughput: 0: 4351.8. Samples: 179800340. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:47,795][52567] Avg episode reward: [(0, '76.135')] [2024-08-06 08:54:47,820][52670] DAMAGECOUNT value on done: 1016395.0 [2024-08-06 08:54:47,821][52670] Sum rewards: 76.764, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.812', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.048', 'WEAPON5': '0.050', 'AMMO4': '0.057', 'weapon4': '0.132', 'WEAPON4': '0.150', 'AMMO3': '0.200', 'weapon2': '0.354', 'WEAPON3': '1.250', 'weapon3': '3.320', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:47,948][52803] DAMAGECOUNT value on done: 961204.0 [2024-08-06 08:54:47,949][52803] Sum rewards: 66.574, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.490', 'AMMO5': '0.017', 'AMMO2': '0.027', 'weapon4': '0.052', 'AMMO4': '0.136', 'AMMO3': '0.187', 'weapon5': '0.194', 'WEAPON4': '0.200', 'weapon2': '0.362', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'HITCOUNT': '3.130', 'weapon3': '3.180', 'DAMAGECOUNT': '16.728', 'FRAGCOUNT': '55.000'} [2024-08-06 08:54:47,959][52664] Large shaping reward 2.563 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.531, 177.0), ('weapon5', 0.002)] [2024-08-06 08:54:48,125][52664] DAMAGECOUNT value on done: 1073850.0 [2024-08-06 08:54:48,125][52664] Sum rewards: 72.240, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.022', 'AMMO5': '0.011', 'AMMO2': '0.042', 'AMMO3': '0.161', 'weapon5': '0.164', 'weapon4': '0.176', 'AMMO4': '0.212', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'weapon2': '0.580', 'WEAPON3': '1.000', 'weapon3': '2.674', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.431', 'FRAGCOUNT': '59.000'} [2024-08-06 08:54:48,912][52794] DAMAGECOUNT value on done: 1040530.0 [2024-08-06 08:54:48,913][52794] Sum rewards: 72.280, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.930', 'AMMO5': '0.021', 'AMMO2': '0.066', 'weapon4': '0.090', 'weapon5': '0.202', 'AMMO3': '0.217', 'AMMO4': '0.328', 'weapon2': '0.348', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '3.106', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.892', 'FRAGCOUNT': '59.000'} [2024-08-06 08:54:50,564][52670] DAMAGECOUNT value on done: 1018713.0 [2024-08-06 08:54:50,568][52670] Sum rewards: 67.649, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.802', 'AMMO5': '0.014', 'AMMO2': '0.029', 'weapon4': '0.054', 'AMMO4': '0.145', 'weapon5': '0.212', 'AMMO3': '0.231', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.402', 'WEAPON3': '1.350', 'weapon3': '3.074', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.859', 'FRAGCOUNT': '58.000'} [2024-08-06 08:54:50,759][52666] DAMAGECOUNT value on done: 1028228.0 [2024-08-06 08:54:50,761][52666] Sum rewards: 79.222, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.434', 'AMMO5': '0.005', 'AMMO2': '0.031', 'weapon5': '0.090', 'weapon4': '0.114', 'AMMO4': '0.155', 'WEAPON5': '0.200', 'AMMO3': '0.213', 'WEAPON4': '0.300', 'weapon2': '0.332', 'WEAPON3': '1.250', 'weapon3': '3.254', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '64.000'} [2024-08-06 08:54:51,028][52803] DAMAGECOUNT value on done: 959050.0 [2024-08-06 08:54:51,029][52803] Sum rewards: 81.978, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.935', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.082', 'AMMO4': '0.128', 'WEAPON5': '0.150', 'weapon4': '0.190', 'AMMO3': '0.207', 'WEAPON4': '0.250', 'weapon2': '0.548', 'WEAPON3': '1.400', 'weapon3': '2.974', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '19.452', 'FRAGCOUNT': '67.000'} [2024-08-06 08:54:51,047][52664] DAMAGECOUNT value on done: 1062017.0 [2024-08-06 08:54:51,048][52664] Sum rewards: 68.091, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.085', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.042', 'AMMO4': '0.100', 'weapon5': '0.142', 'weapon2': '0.154', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'WEAPON3': '1.400', 'HITCOUNT': '3.250', 'weapon3': '3.412', 'DAMAGECOUNT': '16.779', 'FRAGCOUNT': '57.000'} [2024-08-06 08:54:51,235][52650] Updated weights for policy 0, policy_version 87801 (0.0011) [2024-08-06 08:54:51,773][52794] DAMAGECOUNT value on done: 1023326.0 [2024-08-06 08:54:51,776][52794] Sum rewards: 78.265, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.970', 'AMMO5': '0.010', 'AMMO2': '0.051', 'weapon5': '0.162', 'AMMO3': '0.234', 'AMMO4': '0.253', 'WEAPON5': '0.300', 'weapon4': '0.334', 'weapon2': '0.368', 'WEAPON4': '0.400', 'WEAPON3': '1.400', 'weapon3': '2.912', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.591', 'FRAGCOUNT': '65.000'} [2024-08-06 08:54:52,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 719290368. Throughput: 0: 4358.4. Samples: 179826700. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:52,794][52567] Avg episode reward: [(0, '75.736')] [2024-08-06 08:54:53,517][52664] DAMAGECOUNT value on done: 1079358.0 [2024-08-06 08:54:53,518][52664] Sum rewards: 70.976, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.495', 'AMMO5': '0.018', 'AMMO2': '0.051', 'AMMO3': '0.124', 'weapon5': '0.196', 'AMMO4': '0.256', 'weapon4': '0.278', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.534', 'WEAPON3': '0.850', 'weapon3': '2.768', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '55.000'} [2024-08-06 08:54:53,652][52670] DAMAGECOUNT value on done: 1030906.0 [2024-08-06 08:54:53,653][52670] Sum rewards: 78.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.568', 'AMMO5': '0.005', 'AMMO2': '0.009', 'AMMO4': '0.047', 'weapon5': '0.082', 'weapon4': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.177', 'weapon2': '0.464', 'WEAPON3': '1.300', 'weapon3': '3.158', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.882', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:53,922][52666] DAMAGECOUNT value on done: 1030460.0 [2024-08-06 08:54:53,923][52666] Sum rewards: 73.753, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.628', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon5': '0.138', 'AMMO4': '0.143', 'WEAPON5': '0.150', 'weapon2': '0.214', 'weapon4': '0.222', 'WEAPON4': '0.250', 'AMMO3': '0.264', 'WEAPON3': '1.600', 'weapon3': '3.178', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.285', 'FRAGCOUNT': '64.000'} [2024-08-06 08:54:54,158][52803] DAMAGECOUNT value on done: 957844.0 [2024-08-06 08:54:54,159][52803] Sum rewards: 80.602, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.640', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.064', 'weapon5': '0.080', 'AMMO4': '0.113', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.240', 'weapon2': '0.440', 'WEAPON3': '1.600', 'weapon3': '3.206', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '19.011', 'FRAGCOUNT': '68.000'} [2024-08-06 08:54:54,307][52794] DAMAGECOUNT value on done: 1035569.0 [2024-08-06 08:54:54,308][52794] Sum rewards: 63.646, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.290', 'AMMO5': '0.006', 'AMMO2': '0.039', 'weapon4': '0.048', 'weapon5': '0.086', 'AMMO4': '0.197', 'WEAPON5': '0.200', 'weapon2': '0.236', 'AMMO3': '0.273', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'HITCOUNT': '3.080', 'weapon3': '3.422', 'DAMAGECOUNT': '16.398', 'FRAGCOUNT': '56.000'} [2024-08-06 08:54:55,789][52650] Updated weights for policy 0, policy_version 87811 (0.0015) [2024-08-06 08:54:56,516][52664] DAMAGECOUNT value on done: 1072589.0 [2024-08-06 08:54:56,521][52664] Sum rewards: 63.257, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.080', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon4': '0.072', 'weapon5': '0.128', 'AMMO4': '0.190', 'AMMO3': '0.196', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.740', 'FRAGCOUNT': '51.000'} [2024-08-06 08:54:56,808][52794] DAMAGECOUNT value on done: 1032211.0 [2024-08-06 08:54:56,809][52794] Sum rewards: 98.576, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.581', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.082', 'weapon5': '0.168', 'AMMO4': '0.191', 'AMMO3': '0.194', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.446', 'WEAPON3': '1.350', 'weapon3': '3.072', 'HITCOUNT': '4.420', 'DAMAGECOUNT': '23.634', 'FRAGCOUNT': '78.000'} [2024-08-06 08:54:56,893][52670] DAMAGECOUNT value on done: 1019491.0 [2024-08-06 08:54:56,893][52670] Sum rewards: 59.810, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.580', 'AMMO5': '0.013', 'AMMO2': '0.037', 'weapon4': '0.102', 'AMMO4': '0.183', 'AMMO3': '0.200', 'WEAPON4': '0.250', 'weapon5': '0.286', 'WEAPON5': '0.350', 'weapon2': '0.468', 'WEAPON3': '1.200', 'HITCOUNT': '2.790', 'weapon3': '2.854', 'DAMAGECOUNT': '14.907', 'FRAGCOUNT': '49.000'} [2024-08-06 08:54:57,165][52666] DAMAGECOUNT value on done: 1036181.0 [2024-08-06 08:54:57,165][52666] Sum rewards: 77.579, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.272', 'AMMO5': '0.003', 'AMMO2': '0.010', 'weapon5': '0.048', 'AMMO4': '0.049', 'weapon4': '0.088', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.173', 'weapon2': '0.234', 'WEAPON3': '1.100', 'HITCOUNT': '3.360', 'weapon3': '3.476', 'DAMAGECOUNT': '17.610', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:57,385][52803] DAMAGECOUNT value on done: 955892.0 [2024-08-06 08:54:57,386][52803] Sum rewards: 77.297, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.700', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.203', 'weapon4': '0.214', 'weapon5': '0.216', 'weapon2': '0.248', 'AMMO4': '0.250', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.080', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '18.321', 'FRAGCOUNT': '63.000'} [2024-08-06 08:54:57,794][52567] Fps is (10 sec: 16384.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 719372288. Throughput: 0: 4358.0. Samples: 179852900. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:54:57,794][52567] Avg episode reward: [(0, '74.966')] [2024-08-06 08:54:58,023][52668] DAMAGECOUNT value on done: 1037138.0 [2024-08-06 08:54:58,024][52668] Sum rewards: 77.564, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.444', 'AMMO5': '0.019', 'AMMO2': '0.032', 'weapon4': '0.128', 'AMMO4': '0.160', 'AMMO3': '0.180', 'weapon5': '0.314', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'weapon2': '0.502', 'WEAPON3': '1.150', 'weapon3': '2.760', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '18.123', 'FRAGCOUNT': '62.000'} [2024-08-06 08:54:58,783][52664] DAMAGECOUNT value on done: 1062560.0 [2024-08-06 08:54:58,783][52664] Sum rewards: 75.310, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.360', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.088', 'AMMO4': '0.152', 'weapon5': '0.188', 'AMMO3': '0.215', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.090', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '61.000'} [2024-08-06 08:54:59,348][52794] DAMAGECOUNT value on done: 1042565.0 [2024-08-06 08:54:59,349][52794] Sum rewards: 88.452, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.715', 'AMMO5': '0.007', 'AMMO2': '0.030', 'weapon4': '0.064', 'weapon5': '0.096', 'AMMO4': '0.148', 'AMMO3': '0.202', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.432', 'WEAPON3': '1.250', 'weapon3': '3.184', 'HITCOUNT': '4.440', 'DAMAGECOUNT': '22.815', 'FRAGCOUNT': '69.000'} [2024-08-06 08:55:00,291][52670] DAMAGECOUNT value on done: 1017435.0 [2024-08-06 08:55:00,292][52670] Sum rewards: 66.853, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.595', 'AMMO5': '0.008', 'AMMO2': '0.020', 'weapon4': '0.040', 'AMMO4': '0.101', 'weapon5': '0.124', 'weapon2': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.245', 'WEAPON3': '1.500', 'HITCOUNT': '3.160', 'weapon3': '3.464', 'DAMAGECOUNT': '16.458', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:00,447][52803] DAMAGECOUNT value on done: 961384.0 [2024-08-06 08:55:00,449][52803] Sum rewards: 66.543, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.440', 'AMMO5': '0.017', 'AMMO2': '0.052', 'weapon4': '0.098', 'weapon5': '0.258', 'AMMO4': '0.261', 'AMMO3': '0.268', 'weapon2': '0.466', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.550', 'weapon3': '2.864', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '17.049', 'FRAGCOUNT': '57.000'} [2024-08-06 08:55:00,488][52666] DAMAGECOUNT value on done: 1029894.0 [2024-08-06 08:55:00,490][52666] Sum rewards: 75.265, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.320', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.130', 'AMMO4': '0.190', 'AMMO3': '0.191', 'weapon5': '0.194', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'weapon2': '0.458', 'WEAPON3': '1.200', 'weapon3': '2.936', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:00,771][52668] DAMAGECOUNT value on done: 1036927.0 [2024-08-06 08:55:00,771][52668] Sum rewards: 73.428, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.140', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon4': '0.056', 'weapon5': '0.184', 'AMMO4': '0.214', 'AMMO3': '0.221', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.604', 'WEAPON3': '1.450', 'weapon3': '2.932', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.423', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:00,992][52650] Updated weights for policy 0, policy_version 87821 (0.0023) [2024-08-06 08:55:01,358][52664] DAMAGECOUNT value on done: 1065110.0 [2024-08-06 08:55:01,358][52664] Sum rewards: 80.193, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.584', 'AMMO5': '0.012', 'AMMO2': '0.031', 'AMMO4': '0.155', 'AMMO3': '0.214', 'weapon5': '0.218', 'weapon4': '0.222', 'WEAPON5': '0.250', 'weapon2': '0.278', 'WEAPON4': '0.350', 'WEAPON3': '1.350', 'weapon3': '2.980', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:02,205][52794] DAMAGECOUNT value on done: 1043725.0 [2024-08-06 08:55:02,232][52794] Sum rewards: 80.378, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.133', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.060', 'weapon5': '0.100', 'AMMO4': '0.122', 'AMMO3': '0.220', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.402', 'WEAPON3': '1.400', 'weapon3': '3.218', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.395', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:02,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 719462400. Throughput: 0: 4361.6. Samples: 179866160. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:55:02,802][52567] Avg episode reward: [(0, '75.315')] [2024-08-06 08:55:03,507][52670] DAMAGECOUNT value on done: 1019888.0 [2024-08-06 08:55:03,508][52670] Sum rewards: 62.171, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.570', 'AMMO5': '0.015', 'AMMO2': '0.035', 'weapon4': '0.044', 'weapon5': '0.068', 'AMMO4': '0.174', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.502', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.115', 'FRAGCOUNT': '53.000'} [2024-08-06 08:55:03,632][52803] DAMAGECOUNT value on done: 956647.0 [2024-08-06 08:55:03,632][52803] Sum rewards: 73.209, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.840', 'AMMO5': '0.015', 'AMMO2': '0.053', 'weapon4': '0.078', 'weapon5': '0.188', 'AMMO3': '0.208', 'AMMO4': '0.264', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.200', 'weapon3': '3.064', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:03,671][52664] DAMAGECOUNT value on done: 1072541.0 [2024-08-06 08:55:03,672][52664] Sum rewards: 84.707, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.642', 'AMMO5': '0.010', 'AMMO2': '0.057', 'AMMO3': '0.154', 'weapon5': '0.208', 'AMMO4': '0.287', 'WEAPON5': '0.300', 'weapon2': '0.340', 'weapon4': '0.388', 'WEAPON4': '0.500', 'WEAPON3': '0.900', 'weapon3': '2.766', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '19.218', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:03,783][52666] DAMAGECOUNT value on done: 1022655.0 [2024-08-06 08:55:03,785][52666] Sum rewards: 83.227, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.716', 'AMMO5': '0.015', 'weapon4': '0.026', 'AMMO2': '0.031', 'weapon5': '0.064', 'AMMO4': '0.155', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'WEAPON5': '0.350', 'weapon2': '0.360', 'WEAPON3': '1.450', 'weapon3': '3.328', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '20.460', 'FRAGCOUNT': '69.000'} [2024-08-06 08:55:03,887][52668] DAMAGECOUNT value on done: 1033005.0 [2024-08-06 08:55:03,889][52668] Sum rewards: 79.714, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.922', 'AMMO5': '0.003', 'AMMO2': '0.011', 'weapon5': '0.024', 'WEAPON5': '0.050', 'AMMO4': '0.054', 'weapon4': '0.114', 'WEAPON4': '0.150', 'AMMO3': '0.190', 'weapon2': '0.438', 'WEAPON3': '1.250', 'weapon3': '3.286', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:05,241][52794] DAMAGECOUNT value on done: 1032289.0 [2024-08-06 08:55:05,245][52794] Sum rewards: 75.424, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.659', 'AMMO5': '0.012', 'AMMO2': '0.054', 'weapon4': '0.130', 'AMMO3': '0.234', 'weapon5': '0.234', 'AMMO4': '0.270', 'weapon2': '0.276', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.400', 'weapon3': '3.070', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.703', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:05,384][52650] Updated weights for policy 0, policy_version 87831 (0.0013) [2024-08-06 08:55:05,979][52670] DAMAGECOUNT value on done: 1017620.0 [2024-08-06 08:55:05,979][52670] Sum rewards: 83.289, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.634', 'AMMO2': '0.006', 'AMMO4': '0.028', 'weapon4': '0.044', 'WEAPON4': '0.050', 'AMMO3': '0.232', 'weapon2': '0.244', 'WEAPON3': '1.400', 'weapon3': '3.526', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.293', 'FRAGCOUNT': '70.000'} [2024-08-06 08:55:06,101][52666] DAMAGECOUNT value on done: 1024730.0 [2024-08-06 08:55:06,101][52666] Sum rewards: 69.526, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.780', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.070', 'weapon5': '0.178', 'AMMO4': '0.179', 'AMMO3': '0.246', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.544', 'WEAPON3': '1.550', 'weapon3': '2.932', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.898', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:06,815][52664] DAMAGECOUNT value on done: 1066330.0 [2024-08-06 08:55:06,816][52664] Sum rewards: 80.636, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.438', 'AMMO2': '0.017', 'AMMO4': '0.083', 'AMMO3': '0.227', 'weapon2': '0.508', 'WEAPON3': '1.400', 'weapon3': '3.320', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '18.099', 'FRAGCOUNT': '68.000'} [2024-08-06 08:55:06,922][52668] DAMAGECOUNT value on done: 1039993.0 [2024-08-06 08:55:06,922][52668] Sum rewards: 70.465, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.655', 'AMMO5': '0.017', 'AMMO2': '0.049', 'AMMO3': '0.241', 'AMMO4': '0.244', 'weapon5': '0.252', 'weapon4': '0.264', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon2': '0.792', 'WEAPON3': '1.450', 'weapon3': '2.416', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.844', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:06,934][52803] DAMAGECOUNT value on done: 972882.0 [2024-08-06 08:55:06,936][52803] Sum rewards: 85.032, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.928', 'AMMO5': '0.016', 'AMMO2': '0.045', 'weapon4': '0.106', 'AMMO3': '0.181', 'AMMO4': '0.226', 'weapon5': '0.274', 'weapon2': '0.324', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.250', 'weapon3': '3.050', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.688', 'FRAGCOUNT': '68.000'} [2024-08-06 08:55:07,464][52663] Large shaping reward 2.632 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200), ('weapon5', 0.002)] [2024-08-06 08:55:07,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 719552512. Throughput: 0: 4358.2. Samples: 179892040. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:55:07,802][52567] Avg episode reward: [(0, '75.601')] [2024-08-06 08:55:09,070][52670] DAMAGECOUNT value on done: 1015885.0 [2024-08-06 08:55:09,071][52670] Sum rewards: 78.235, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.036', 'AMMO5': '0.017', 'AMMO2': '0.035', 'weapon4': '0.066', 'weapon5': '0.172', 'AMMO4': '0.174', 'AMMO3': '0.270', 'weapon2': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.450', 'WEAPON3': '1.550', 'weapon3': '3.208', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '20.019', 'FRAGCOUNT': '65.000'} [2024-08-06 08:55:09,250][52666] DAMAGECOUNT value on done: 1026334.0 [2024-08-06 08:55:09,252][52666] Sum rewards: 75.876, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.271', 'AMMO5': '0.011', 'AMMO2': '0.020', 'AMMO4': '0.099', 'weapon4': '0.106', 'weapon5': '0.160', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.416', 'WEAPON3': '1.350', 'weapon3': '3.104', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.408', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:09,947][52664] DAMAGECOUNT value on done: 1078325.0 [2024-08-06 08:55:09,947][52664] Sum rewards: 83.483, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.314', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.026', 'weapon5': '0.060', 'AMMO4': '0.095', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.230', 'WEAPON3': '1.200', 'weapon3': '3.504', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.178', 'FRAGCOUNT': '68.000'} [2024-08-06 08:55:09,974][52650] Updated weights for policy 0, policy_version 87841 (0.0029) [2024-08-06 08:55:09,998][52803] DAMAGECOUNT value on done: 966233.0 [2024-08-06 08:55:10,003][52668] DAMAGECOUNT value on done: 1025476.0 [2024-08-06 08:55:10,004][52668] Sum rewards: 77.795, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.893', 'AMMO5': '0.011', 'AMMO2': '0.026', 'weapon4': '0.062', 'AMMO4': '0.128', 'weapon5': '0.128', 'AMMO3': '0.236', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.312', 'WEAPON3': '1.450', 'weapon3': '3.240', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.686', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:10,000][52803] Sum rewards: 72.492, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.062', 'AMMO3': '0.162', 'weapon5': '0.168', 'AMMO4': '0.170', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.382', 'WEAPON3': '1.100', 'weapon3': '3.070', 'HITCOUNT': '3.150', 'DAMAGECOUNT': '16.812', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:11,354][52667] DAMAGECOUNT value on done: 1028194.0 [2024-08-06 08:55:11,355][52667] Sum rewards: 78.498, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.970', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.088', 'AMMO4': '0.198', 'weapon5': '0.226', 'AMMO3': '0.273', 'weapon2': '0.288', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.126', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '20.454', 'FRAGCOUNT': '65.000'} [2024-08-06 08:55:12,037][52670] DAMAGECOUNT value on done: 1032335.0 [2024-08-06 08:55:12,038][52670] Sum rewards: 81.336, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.920', 'AMMO5': '0.007', 'AMMO2': '0.010', 'weapon5': '0.044', 'AMMO4': '0.048', 'weapon4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.290', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '20.868', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:12,160][52666] DAMAGECOUNT value on done: 1019115.0 [2024-08-06 08:55:12,161][52666] Sum rewards: 79.677, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.696', 'AMMO5': '0.004', 'AMMO2': '0.011', 'weapon4': '0.014', 'weapon5': '0.038', 'AMMO4': '0.053', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.233', 'weapon2': '0.502', 'WEAPON3': '1.450', 'weapon3': '3.246', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:12,406][52668] DAMAGECOUNT value on done: 1037616.0 [2024-08-06 08:55:12,407][52668] Sum rewards: 89.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.908', 'AMMO2': '0.003', 'AMMO4': '0.016', 'AMMO3': '0.174', 'weapon2': '0.498', 'WEAPON3': '1.100', 'weapon3': '3.348', 'HITCOUNT': '4.090', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '72.000'} [2024-08-06 08:55:12,794][52567] Fps is (10 sec: 17203.4, 60 sec: 17476.4, 300 sec: 17383.7). Total num frames: 719634432. Throughput: 0: 4363.6. Samples: 179918530. Policy #0 lag: (min: 0.0, avg: 3.5, max: 7.0) [2024-08-06 08:55:12,794][52567] Avg episode reward: [(0, '75.953')] [2024-08-06 08:55:12,973][52803] DAMAGECOUNT value on done: 955044.0 [2024-08-06 08:55:12,973][52803] Sum rewards: 78.573, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.152', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon4': '0.044', 'AMMO3': '0.184', 'weapon5': '0.184', 'AMMO4': '0.204', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.568', 'WEAPON3': '1.100', 'weapon3': '2.958', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:13,038][52664] DAMAGECOUNT value on done: 1075660.0 [2024-08-06 08:55:13,039][52664] Sum rewards: 72.888, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.377', 'AMMO5': '0.007', 'AMMO2': '0.038', 'weapon4': '0.134', 'weapon5': '0.150', 'AMMO3': '0.165', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.220', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.730', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:14,181][52667] DAMAGECOUNT value on done: 1047727.0 [2024-08-06 08:55:14,183][52667] Sum rewards: 75.534, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.920', 'AMMO2': '0.012', 'AMMO4': '0.059', 'AMMO3': '0.158', 'weapon2': '0.356', 'WEAPON3': '1.150', 'HITCOUNT': '3.540', 'weapon3': '3.586', 'DAMAGECOUNT': '18.093', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:14,558][52650] Updated weights for policy 0, policy_version 87851 (0.0025) [2024-08-06 08:55:14,571][52668] Large shaping reward 2.560 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.54, 180.0)] [2024-08-06 08:55:14,971][52670] DAMAGECOUNT value on done: 1013764.0 [2024-08-06 08:55:14,972][52670] Sum rewards: 85.042, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.670', 'AMMO4': '-0.014', 'AMMO2': '-0.003', 'AMMO3': '0.182', 'weapon2': '0.520', 'WEAPON3': '1.250', 'weapon3': '3.354', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '19.722', 'FRAGCOUNT': '69.000'} [2024-08-06 08:55:15,182][52666] DAMAGECOUNT value on done: 1030985.0 [2024-08-06 08:55:15,184][52666] Sum rewards: 64.123, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.044', 'weapon5': '0.124', 'AMMO4': '0.127', 'AMMO3': '0.181', 'weapon2': '0.200', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'HEALTH': '0.284', 'WEAPON3': '1.000', 'HITCOUNT': '2.860', 'weapon3': '3.420', 'DAMAGECOUNT': '15.600', 'FRAGCOUNT': '51.000'} [2024-08-06 08:55:15,324][52668] DAMAGECOUNT value on done: 1036463.0 [2024-08-06 08:55:15,325][52668] Sum rewards: 80.598, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.082', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon5': '0.130', 'AMMO4': '0.130', 'AMMO3': '0.176', 'WEAPON5': '0.200', 'weapon4': '0.232', 'WEAPON4': '0.250', 'weapon2': '0.632', 'WEAPON3': '1.000', 'weapon3': '2.786', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '18.777', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:15,603][52664] DAMAGECOUNT value on done: 1072516.0 [2024-08-06 08:55:15,604][52664] Sum rewards: 76.503, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.955', 'AMMO5': '0.013', 'AMMO2': '0.029', 'weapon4': '0.058', 'AMMO4': '0.143', 'weapon5': '0.172', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.632', 'WEAPON3': '1.250', 'weapon3': '2.892', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '17.817', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:16,091][52803] DAMAGECOUNT value on done: 971251.0 [2024-08-06 08:55:16,092][52803] Sum rewards: 70.336, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.359', 'AMMO5': '0.007', 'AMMO2': '0.019', 'AMMO4': '0.094', 'weapon5': '0.168', 'AMMO3': '0.175', 'weapon2': '0.226', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.410', 'WEAPON3': '1.100', 'weapon3': '2.966', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.190', 'FRAGCOUNT': '56.000'} [2024-08-06 08:55:16,837][52667] DAMAGECOUNT value on done: 1041232.0 [2024-08-06 08:55:16,839][52667] Sum rewards: 80.012, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.680', 'AMMO5': '0.017', 'AMMO2': '0.055', 'AMMO3': '0.192', 'weapon2': '0.196', 'weapon4': '0.222', 'AMMO4': '0.276', 'weapon5': '0.340', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '2.978', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.635', 'FRAGCOUNT': '62.500'} [2024-08-06 08:55:17,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 719724544. Throughput: 0: 4368.2. Samples: 179931470. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:17,794][52567] Avg episode reward: [(0, '75.867')] [2024-08-06 08:55:17,833][52664] DAMAGECOUNT value on done: 1086373.0 [2024-08-06 08:55:17,834][52664] Sum rewards: 74.001, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.006', 'AMMO5': '0.010', 'AMMO2': '0.045', 'weapon4': '0.138', 'weapon5': '0.144', 'weapon2': '0.172', 'AMMO4': '0.225', 'WEAPON5': '0.250', 'AMMO3': '0.271', 'WEAPON4': '0.300', 'WEAPON3': '1.500', 'weapon3': '3.324', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.958', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:18,254][52668] DAMAGECOUNT value on done: 1025258.0 [2024-08-06 08:55:18,255][52668] Sum rewards: 68.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.421', 'AMMO2': '0.006', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO4': '0.029', 'WEAPON4': '0.150', 'AMMO3': '0.219', 'weapon5': '0.260', 'weapon2': '0.274', 'WEAPON5': '0.300', 'weapon4': '0.332', 'WEAPON3': '1.300', 'weapon3': '2.854', 'HITCOUNT': '3.040', 'DAMAGECOUNT': '16.599', 'FRAGCOUNT': '57.000'} [2024-08-06 08:55:18,303][52670] DAMAGECOUNT value on done: 1028080.0 [2024-08-06 08:55:18,306][52670] Sum rewards: 91.828, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.911', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.026', 'AMMO4': '0.114', 'weapon5': '0.126', 'WEAPON4': '0.200', 'AMMO3': '0.204', 'WEAPON5': '0.300', 'weapon2': '0.386', 'WEAPON3': '1.200', 'weapon3': '3.260', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.742', 'FRAGCOUNT': '74.000'} [2024-08-06 08:55:18,411][52666] DAMAGECOUNT value on done: 1018967.0 [2024-08-06 08:55:18,413][52666] Sum rewards: 74.440, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.311', 'AMMO5': '0.013', 'AMMO2': '0.030', 'weapon5': '0.128', 'weapon4': '0.148', 'AMMO4': '0.152', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.348', 'WEAPON3': '1.100', 'weapon3': '3.144', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.186', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:19,251][52803] DAMAGECOUNT value on done: 957574.0 [2024-08-06 08:55:19,255][52803] Sum rewards: 70.733, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.030', 'AMMO5': '0.010', 'AMMO2': '0.042', 'weapon5': '0.180', 'AMMO3': '0.189', 'AMMO4': '0.211', 'weapon4': '0.214', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.250', 'weapon3': '2.838', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.511', 'FRAGCOUNT': '57.000'} [2024-08-06 08:55:19,340][52650] Updated weights for policy 0, policy_version 87861 (0.0010) [2024-08-06 08:55:19,380][52659] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:55:19,649][52667] DAMAGECOUNT value on done: 1045970.0 [2024-08-06 08:55:19,649][52667] Sum rewards: 79.857, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.581', 'AMMO5': '0.027', 'AMMO2': '0.035', 'weapon4': '0.040', 'AMMO4': '0.173', 'AMMO3': '0.194', 'WEAPON4': '0.200', 'weapon5': '0.306', 'weapon2': '0.400', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '2.982', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.671', 'FRAGCOUNT': '63.500'} [2024-08-06 08:55:20,268][52665] DAMAGECOUNT value on done: 1019299.0 [2024-08-06 08:55:20,268][52665] Sum rewards: 78.539, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.574', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.094', 'weapon5': '0.156', 'AMMO4': '0.179', 'AMMO3': '0.200', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.498', 'WEAPON3': '1.200', 'weapon3': '3.014', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:20,643][52664] DAMAGECOUNT value on done: 1081897.0 [2024-08-06 08:55:20,644][52664] Sum rewards: 71.073, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.910', 'AMMO2': '0.009', 'AMMO5': '0.010', 'AMMO4': '0.044', 'AMMO3': '0.176', 'weapon5': '0.182', 'WEAPON4': '0.200', 'weapon4': '0.242', 'weapon2': '0.270', 'WEAPON5': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.126', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '17.904', 'FRAGCOUNT': '56.500'} [2024-08-06 08:55:21,084][52668] DAMAGECOUNT value on done: 1030570.0 [2024-08-06 08:55:21,085][52668] Sum rewards: 88.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.864', 'AMMO5': '0.011', 'AMMO2': '0.037', 'weapon4': '0.098', 'weapon5': '0.126', 'AMMO4': '0.184', 'AMMO3': '0.239', 'weapon2': '0.264', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'WEAPON3': '1.450', 'weapon3': '3.274', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.932', 'FRAGCOUNT': '74.000'} [2024-08-06 08:55:21,372][52670] DAMAGECOUNT value on done: 1032324.0 [2024-08-06 08:55:21,375][52670] Sum rewards: 71.920, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.082', 'AMMO5': '0.015', 'AMMO2': '0.041', 'weapon4': '0.086', 'AMMO3': '0.193', 'AMMO4': '0.203', 'weapon5': '0.230', 'WEAPON4': '0.450', 'WEAPON5': '0.500', 'weapon2': '0.638', 'WEAPON3': '1.250', 'weapon3': '2.758', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.658', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:21,502][52666] DAMAGECOUNT value on done: 1030008.0 [2024-08-06 08:55:21,502][52666] Sum rewards: 89.149, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.021', 'AMMO5': '0.019', 'AMMO2': '0.055', 'weapon4': '0.090', 'AMMO3': '0.166', 'weapon5': '0.174', 'AMMO4': '0.275', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.470', 'WEAPON3': '1.050', 'weapon3': '3.002', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '21.009', 'FRAGCOUNT': '72.000'} [2024-08-06 08:55:22,252][52667] DAMAGECOUNT value on done: 1048466.0 [2024-08-06 08:55:22,252][52667] Sum rewards: 76.965, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.130', 'AMMO5': '0.012', 'AMMO2': '0.047', 'weapon4': '0.136', 'AMMO3': '0.181', 'weapon5': '0.204', 'AMMO4': '0.237', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.924', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.781', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:22,343][52803] DAMAGECOUNT value on done: 967245.0 [2024-08-06 08:55:22,344][52803] Sum rewards: 72.976, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.970', 'AMMO5': '0.003', 'AMMO2': '0.020', 'weapon5': '0.036', 'WEAPON5': '0.050', 'weapon4': '0.096', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.208', 'weapon2': '0.542', 'WEAPON3': '1.400', 'weapon3': '3.144', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:22,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 719814656. Throughput: 0: 4369.6. Samples: 179957880. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:22,802][52567] Avg episode reward: [(0, '76.437')] [2024-08-06 08:55:23,374][52668] DAMAGECOUNT value on done: 1037198.0 [2024-08-06 08:55:23,375][52668] Sum rewards: 77.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.770', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.028', 'AMMO4': '0.094', 'WEAPON4': '0.150', 'weapon5': '0.154', 'AMMO3': '0.172', 'WEAPON5': '0.200', 'weapon2': '0.598', 'WEAPON3': '1.050', 'weapon3': '3.072', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.048', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:23,552][52665] DAMAGECOUNT value on done: 1031018.0 [2024-08-06 08:55:23,554][52665] Sum rewards: 68.264, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.159', 'AMMO5': '0.018', 'AMMO2': '0.047', 'weapon4': '0.140', 'weapon5': '0.142', 'AMMO3': '0.226', 'AMMO4': '0.235', 'weapon2': '0.292', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.400', 'HITCOUNT': '3.130', 'weapon3': '3.184', 'DAMAGECOUNT': '16.959', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:23,806][52664] DAMAGECOUNT value on done: 1082339.0 [2024-08-06 08:55:23,806][52664] Sum rewards: 86.339, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.330', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon4': '0.048', 'weapon5': '0.130', 'AMMO4': '0.138', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.370', 'WEAPON3': '1.150', 'weapon3': '3.276', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '20.082', 'FRAGCOUNT': '69.500'} [2024-08-06 08:55:23,998][52650] Updated weights for policy 0, policy_version 87871 (0.0024) [2024-08-06 08:55:24,260][52670] DAMAGECOUNT value on done: 1023145.0 [2024-08-06 08:55:24,264][52670] Sum rewards: 76.754, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.446', 'AMMO2': '0.011', 'AMMO4': '0.055', 'AMMO3': '0.207', 'weapon2': '0.482', 'WEAPON3': '1.200', 'HITCOUNT': '3.330', 'weapon3': '3.332', 'DAMAGECOUNT': '17.583', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:24,361][52666] DAMAGECOUNT value on done: 1012240.0 [2024-08-06 08:55:24,363][52666] Sum rewards: 83.664, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.760', 'AMMO4': '-0.003', 'AMMO2': '-0.001', 'AMMO5': '0.003', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.142', 'AMMO3': '0.199', 'weapon2': '0.476', 'WEAPON3': '1.350', 'weapon3': '3.164', 'HITCOUNT': '4.020', 'DAMAGECOUNT': '19.080', 'FRAGCOUNT': '69.000'} [2024-08-06 08:55:25,127][52667] DAMAGECOUNT value on done: 1040661.0 [2024-08-06 08:55:25,128][52667] Sum rewards: 87.330, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.700', 'AMMO5': '0.007', 'AMMO2': '0.017', 'WEAPON1': '0.020', 'weapon5': '0.062', 'AMMO4': '0.082', 'weapon4': '0.132', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon2': '0.232', 'AMMO3': '0.246', 'WEAPON3': '1.550', 'weapon3': '3.336', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '21.516', 'FRAGCOUNT': '72.000'} [2024-08-06 08:55:25,654][52803] DAMAGECOUNT value on done: 966742.0 [2024-08-06 08:55:25,658][52803] Sum rewards: 83.043, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.108', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon5': '0.088', 'AMMO4': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon4': '0.130', 'AMMO3': '0.170', 'weapon2': '0.484', 'WEAPON3': '0.950', 'weapon3': '3.116', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '18.939', 'FRAGCOUNT': '65.000'} [2024-08-06 08:55:26,237][52665] DAMAGECOUNT value on done: 1025220.0 [2024-08-06 08:55:26,237][52665] Sum rewards: 79.501, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.565', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.032', 'AMMO4': '0.046', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.234', 'weapon2': '0.292', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '19.839', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:26,598][52668] DAMAGECOUNT value on done: 1030899.0 [2024-08-06 08:55:26,598][52668] Sum rewards: 72.038, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.440', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.042', 'weapon5': '0.130', 'AMMO4': '0.175', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.296', 'weapon2': '0.306', 'WEAPON3': '1.750', 'weapon3': '3.290', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.222', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:26,981][52664] DAMAGECOUNT value on done: 1065027.0 [2024-08-06 08:55:26,981][52664] Sum rewards: 74.134, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.015', 'AMMO2': '0.041', 'AMMO3': '0.167', 'weapon4': '0.176', 'AMMO4': '0.203', 'weapon5': '0.220', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'HEALTH': '0.402', 'weapon2': '0.474', 'WEAPON3': '0.950', 'weapon3': '2.904', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:27,402][52670] DAMAGECOUNT value on done: 1009557.0 [2024-08-06 08:55:27,404][52670] Sum rewards: 71.704, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.205', 'AMMO5': '0.008', 'AMMO2': '0.027', 'weapon5': '0.084', 'AMMO4': '0.134', 'weapon4': '0.196', 'AMMO3': '0.244', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.508', 'WEAPON3': '1.500', 'weapon3': '2.980', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '17.988', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:27,472][52666] DAMAGECOUNT value on done: 1038039.0 [2024-08-06 08:55:27,474][52666] Sum rewards: 77.758, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.788', 'AMMO5': '0.012', 'AMMO2': '0.038', 'weapon4': '0.068', 'weapon5': '0.144', 'AMMO4': '0.192', 'AMMO3': '0.249', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.396', 'WEAPON3': '1.550', 'weapon3': '3.128', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.518', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:27,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 719896576. Throughput: 0: 4378.0. Samples: 179984220. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:27,795][52567] Avg episode reward: [(0, '77.013')] [2024-08-06 08:55:28,245][52667] DAMAGECOUNT value on done: 1039045.0 [2024-08-06 08:55:28,245][52667] Sum rewards: 78.456, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.625', 'AMMO5': '0.013', 'AMMO2': '0.057', 'weapon4': '0.084', 'AMMO3': '0.192', 'weapon5': '0.236', 'AMMO4': '0.284', 'weapon2': '0.382', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.200', 'weapon3': '3.022', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '18.561', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:28,499][52650] Updated weights for policy 0, policy_version 87881 (0.0012) [2024-08-06 08:55:28,859][52803] DAMAGECOUNT value on done: 974998.0 [2024-08-06 08:55:28,859][52803] Sum rewards: 67.569, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-4.514', 'AMMO5': '0.029', 'AMMO2': '0.074', 'weapon4': '0.130', 'weapon5': '0.222', 'AMMO3': '0.229', 'weapon2': '0.284', 'AMMO4': '0.371', 'WEAPON4': '0.750', 'WEAPON5': '0.750', 'WEAPON3': '1.500', 'weapon3': '3.052', 'HITCOUNT': '3.160', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:29,053][52665] DAMAGECOUNT value on done: 1028846.0 [2024-08-06 08:55:29,055][52665] Sum rewards: 76.697, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.050', 'AMMO5': '0.012', 'AMMO2': '0.014', 'weapon5': '0.060', 'AMMO4': '0.069', 'WEAPON4': '0.150', 'weapon4': '0.162', 'AMMO3': '0.182', 'WEAPON5': '0.250', 'weapon2': '0.332', 'WEAPON3': '1.200', 'weapon3': '3.188', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:29,404][52668] DAMAGECOUNT value on done: 1030321.0 [2024-08-06 08:55:29,404][52668] Sum rewards: 73.982, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.812', 'AMMO5': '0.005', 'AMMO2': '0.023', 'weapon4': '0.090', 'weapon5': '0.094', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.234', 'weapon2': '0.256', 'WEAPON3': '1.400', 'weapon3': '3.396', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '18.138', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:29,742][52662] DAMAGECOUNT value on done: 1032446.0 [2024-08-06 08:55:29,742][52662] Sum rewards: 80.278, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.620', 'AMMO5': '0.017', 'AMMO2': '0.032', 'weapon5': '0.094', 'AMMO4': '0.159', 'AMMO3': '0.183', 'weapon2': '0.280', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.084', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '19.959', 'FRAGCOUNT': '65.000'} [2024-08-06 08:55:29,933][52664] DAMAGECOUNT value on done: 1069460.0 [2024-08-06 08:55:29,934][52664] Sum rewards: 71.817, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.331', 'AMMO5': '0.013', 'AMMO2': '0.051', 'weapon4': '0.062', 'weapon5': '0.122', 'AMMO3': '0.202', 'AMMO4': '0.255', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.400', 'WEAPON3': '1.250', 'weapon3': '3.194', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:29,986][52670] DAMAGECOUNT value on done: 1025254.0 [2024-08-06 08:55:29,986][52670] Sum rewards: 85.041, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.049', 'AMMO5': '0.005', 'AMMO2': '0.018', 'weapon4': '0.064', 'AMMO4': '0.091', 'weapon5': '0.118', 'WEAPON4': '0.150', 'AMMO3': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.586', 'WEAPON3': '1.200', 'weapon3': '3.048', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '19.659', 'FRAGCOUNT': '70.000'} [2024-08-06 08:55:30,053][52666] DAMAGECOUNT value on done: 1032790.0 [2024-08-06 08:55:30,054][52666] Sum rewards: 74.738, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.729', 'AMMO5': '0.024', 'AMMO2': '0.057', 'weapon4': '0.116', 'AMMO3': '0.196', 'AMMO4': '0.287', 'weapon5': '0.318', 'WEAPON4': '0.500', 'weapon2': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '1.100', 'weapon3': '2.688', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.161', 'FRAGCOUNT': '59.000'} [2024-08-06 08:55:30,125][52659] DAMAGECOUNT value on done: 1032263.0 [2024-08-06 08:55:30,125][52659] Sum rewards: 74.404, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.346', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.074', 'AMMO4': '0.110', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'weapon2': '0.416', 'WEAPON3': '1.250', 'weapon3': '3.294', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.159', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:31,470][52667] DAMAGECOUNT value on done: 1035472.0 [2024-08-06 08:55:31,472][52667] Sum rewards: 67.626, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.220', 'AMMO5': '0.014', 'AMMO2': '0.041', 'weapon4': '0.142', 'weapon5': '0.190', 'AMMO4': '0.207', 'AMMO3': '0.237', 'weapon2': '0.266', 'WEAPON4': '0.400', 'WEAPON5': '0.450', 'WEAPON3': '1.450', 'weapon3': '3.082', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.997', 'FRAGCOUNT': '56.500'} [2024-08-06 08:55:32,113][52803] DAMAGECOUNT value on done: 970333.0 [2024-08-06 08:55:32,116][52803] Sum rewards: 66.292, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.666', 'AMMO5': '0.005', 'weapon4': '0.040', 'AMMO2': '0.045', 'weapon5': '0.088', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.201', 'AMMO4': '0.227', 'weapon2': '0.570', 'WEAPON3': '1.250', 'weapon3': '3.104', 'HITCOUNT': '3.260', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '54.000'} [2024-08-06 08:55:32,143][52665] DAMAGECOUNT value on done: 1007441.0 [2024-08-06 08:55:32,145][52665] Sum rewards: 72.259, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.980', 'AMMO5': '0.020', 'AMMO2': '0.036', 'AMMO4': '0.178', 'weapon5': '0.192', 'AMMO3': '0.200', 'weapon4': '0.212', 'weapon2': '0.310', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.050', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '18.291', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:32,274][52668] DAMAGECOUNT value on done: 1022060.0 [2024-08-06 08:55:32,274][52668] Sum rewards: 71.954, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.003', 'AMMO5': '0.011', 'AMMO2': '0.042', 'weapon5': '0.168', 'AMMO3': '0.191', 'AMMO4': '0.209', 'weapon4': '0.210', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'weapon2': '0.522', 'WEAPON3': '1.200', 'weapon3': '2.842', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.012', 'FRAGCOUNT': '59.000'} [2024-08-06 08:55:32,504][52664] DAMAGECOUNT value on done: 1082301.0 [2024-08-06 08:55:32,507][52664] Sum rewards: 85.402, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.890', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon4': '0.076', 'weapon5': '0.164', 'AMMO4': '0.181', 'AMMO3': '0.205', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.494', 'WEAPON3': '1.400', 'weapon3': '3.040', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.941', 'FRAGCOUNT': '71.000'} [2024-08-06 08:55:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 719986688. Throughput: 0: 4368.7. Samples: 179996930. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:32,794][52567] Avg episode reward: [(0, '76.688')] [2024-08-06 08:55:32,973][52662] DAMAGECOUNT value on done: 1040253.0 [2024-08-06 08:55:32,973][52662] Sum rewards: 76.910, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.848', 'AMMO5': '0.010', 'AMMO2': '0.025', 'AMMO4': '0.122', 'weapon5': '0.176', 'weapon4': '0.186', 'weapon2': '0.192', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.218', 'WEAPON3': '1.300', 'weapon3': '3.176', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.153', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:33,071][52659] DAMAGECOUNT value on done: 1033682.0 [2024-08-06 08:55:33,072][52659] Sum rewards: 72.766, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.768', 'AMMO5': '0.005', 'AMMO2': '0.010', 'weapon4': '0.034', 'AMMO4': '0.051', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'weapon2': '0.218', 'AMMO3': '0.229', 'WEAPON3': '1.350', 'weapon3': '3.488', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '17.769', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:33,225][52670] DAMAGECOUNT value on done: 1032886.0 [2024-08-06 08:55:33,227][52670] Sum rewards: 80.002, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.080', 'AMMO5': '0.013', 'AMMO2': '0.038', 'weapon5': '0.148', 'AMMO4': '0.192', 'AMMO3': '0.217', 'weapon4': '0.222', 'WEAPON5': '0.350', 'WEAPON4': '0.400', 'weapon2': '0.420', 'WEAPON3': '1.400', 'weapon3': '2.962', 'HITCOUNT': '4.080', 'DAMAGECOUNT': '19.890', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:33,252][52666] DAMAGECOUNT value on done: 1031314.0 [2024-08-06 08:55:33,254][52666] Sum rewards: 65.615, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.348', 'AMMO5': '0.015', 'AMMO2': '0.029', 'AMMO3': '0.139', 'AMMO4': '0.143', 'weapon4': '0.190', 'WEAPON4': '0.300', 'weapon5': '0.312', 'WEAPON5': '0.400', 'weapon2': '0.406', 'WEAPON3': '0.900', 'weapon3': '2.852', 'HITCOUNT': '3.060', 'DAMAGECOUNT': '16.467', 'FRAGCOUNT': '51.500'} [2024-08-06 08:55:33,406][52650] Updated weights for policy 0, policy_version 87891 (0.0025) [2024-08-06 08:55:34,594][52667] DAMAGECOUNT value on done: 1040269.0 [2024-08-06 08:55:34,596][52667] Sum rewards: 79.724, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.440', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon5': '0.092', 'AMMO4': '0.126', 'weapon4': '0.158', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.758', 'WEAPON3': '1.100', 'weapon3': '2.846', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '18.483', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:35,106][52664] DAMAGECOUNT value on done: 1065441.0 [2024-08-06 08:55:35,106][52664] Sum rewards: 91.451, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.475', 'AMMO5': '0.008', 'AMMO2': '0.022', 'weapon4': '0.050', 'AMMO4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon5': '0.186', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.250', 'weapon3': '3.128', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '22.635', 'FRAGCOUNT': '73.000'} [2024-08-06 08:55:35,384][52803] DAMAGECOUNT value on done: 966835.0 [2024-08-06 08:55:35,386][52803] Sum rewards: 84.706, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.160', 'AMMO5': '0.005', 'AMMO2': '0.029', 'weapon4': '0.038', 'weapon5': '0.090', 'AMMO4': '0.143', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.253', 'weapon2': '0.256', 'WEAPON3': '1.700', 'weapon3': '3.394', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '20.229', 'FRAGCOUNT': '72.000'} [2024-08-06 08:55:35,422][52665] DAMAGECOUNT value on done: 1009472.0 [2024-08-06 08:55:35,424][52665] Sum rewards: 83.642, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.037', 'AMMO2': '0.004', 'AMMO5': '0.005', 'weapon4': '0.012', 'AMMO4': '0.018', 'WEAPON4': '0.050', 'weapon5': '0.090', 'WEAPON5': '0.150', 'AMMO3': '0.266', 'weapon2': '0.594', 'WEAPON3': '1.550', 'weapon3': '3.070', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.980', 'FRAGCOUNT': '71.000'} [2024-08-06 08:55:35,429][52668] DAMAGECOUNT value on done: 1023023.0 [2024-08-06 08:55:35,429][52668] Sum rewards: 74.242, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.294', 'AMMO5': '0.012', 'AMMO2': '0.028', 'weapon4': '0.078', 'weapon5': '0.122', 'AMMO4': '0.140', 'AMMO3': '0.224', 'weapon2': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.400', 'weapon3': '3.344', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '19.182', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:35,965][52659] DAMAGECOUNT value on done: 1045881.0 [2024-08-06 08:55:35,965][52659] Sum rewards: 80.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.755', 'AMMO5': '0.006', 'AMMO2': '0.026', 'weapon5': '0.088', 'AMMO4': '0.129', 'weapon4': '0.130', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.234', 'WEAPON3': '1.350', 'weapon3': '3.326', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '18.582', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:36,017][52662] DAMAGECOUNT value on done: 1042062.0 [2024-08-06 08:55:36,017][52662] Sum rewards: 65.578, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.582', 'AMMO5': '0.016', 'AMMO2': '0.036', 'weapon4': '0.046', 'weapon5': '0.112', 'AMMO4': '0.181', 'WEAPON4': '0.250', 'AMMO3': '0.260', 'WEAPON5': '0.300', 'weapon2': '0.360', 'WEAPON3': '1.500', 'weapon3': '3.218', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.131', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:36,169][52670] DAMAGECOUNT value on done: 1027269.0 [2024-08-06 08:55:36,171][52670] Sum rewards: 66.349, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.822', 'AMMO5': '0.016', 'AMMO2': '0.052', 'weapon4': '0.082', 'weapon5': '0.186', 'AMMO4': '0.259', 'AMMO3': '0.263', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.456', 'WEAPON3': '1.550', 'weapon3': '3.050', 'HITCOUNT': '3.130', 'DAMAGECOUNT': '16.476', 'FRAGCOUNT': '57.000'} [2024-08-06 08:55:36,178][52666] DAMAGECOUNT value on done: 1019128.0 [2024-08-06 08:55:36,179][52666] Sum rewards: 67.066, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.275', 'AMMO5': '0.013', 'AMMO2': '0.031', 'AMMO3': '0.120', 'AMMO4': '0.155', 'weapon5': '0.214', 'weapon4': '0.368', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'weapon2': '0.466', 'WEAPON3': '0.850', 'weapon3': '2.762', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '15.981', 'FRAGCOUNT': '51.500'} [2024-08-06 08:55:36,602][52820] DAMAGECOUNT value on done: 953249.0 [2024-08-06 08:55:36,602][52820] Sum rewards: 76.799, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.626', 'AMMO5': '0.025', 'AMMO2': '0.064', 'weapon4': '0.130', 'AMMO3': '0.273', 'weapon2': '0.282', 'weapon5': '0.300', 'AMMO4': '0.320', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.650', 'weapon3': '2.986', 'HITCOUNT': '3.320', 'DAMAGECOUNT': '20.025', 'FRAGCOUNT': '63.000'} [2024-08-06 08:55:37,320][52667] DAMAGECOUNT value on done: 1045256.0 [2024-08-06 08:55:37,323][52667] Sum rewards: 74.763, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.895', 'AMMO5': '0.014', 'AMMO2': '0.036', 'weapon5': '0.122', 'weapon4': '0.160', 'AMMO4': '0.179', 'AMMO3': '0.250', 'weapon2': '0.356', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.068', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.963', 'FRAGCOUNT': '64.000'} [2024-08-06 08:55:37,794][52567] Fps is (10 sec: 18022.5, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 720076800. Throughput: 0: 4361.3. Samples: 180022960. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:37,794][52567] Avg episode reward: [(0, '76.605')] [2024-08-06 08:55:38,055][52650] Updated weights for policy 0, policy_version 87901 (0.0022) [2024-08-06 08:55:38,203][52665] DAMAGECOUNT value on done: 1021959.0 [2024-08-06 08:55:38,203][52665] Sum rewards: 73.972, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.758', 'AMMO5': '0.018', 'AMMO2': '0.051', 'weapon4': '0.092', 'AMMO3': '0.207', 'weapon5': '0.232', 'AMMO4': '0.253', 'weapon2': '0.428', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.250', 'weapon3': '3.018', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:38,643][52659] DAMAGECOUNT value on done: 1038952.0 [2024-08-06 08:55:38,643][52659] Sum rewards: 79.310, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.860', 'AMMO5': '0.006', 'AMMO2': '0.021', 'weapon4': '0.042', 'weapon5': '0.082', 'AMMO4': '0.105', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.160', 'weapon2': '0.666', 'WEAPON3': '1.000', 'weapon3': '3.010', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.468', 'FRAGCOUNT': '64.000'} [2024-08-06 08:55:38,698][52668] DAMAGECOUNT value on done: 1013691.0 [2024-08-06 08:55:38,698][52668] Sum rewards: 78.653, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.930', 'AMMO5': '0.016', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon4': '0.124', 'AMMO3': '0.155', 'weapon5': '0.182', 'WEAPON4': '0.250', 'weapon2': '0.330', 'WEAPON5': '0.450', 'WEAPON3': '1.000', 'weapon3': '3.112', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '19.875', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:38,746][52666] DAMAGECOUNT value on done: 1018123.0 [2024-08-06 08:55:38,748][52666] Sum rewards: 77.873, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.960', 'AMMO5': '0.012', 'AMMO2': '0.026', 'AMMO4': '0.128', 'weapon2': '0.164', 'AMMO3': '0.219', 'weapon5': '0.244', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.558', 'WEAPON3': '1.250', 'weapon3': '2.738', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.173', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:38,760][52670] DAMAGECOUNT value on done: 1024719.0 [2024-08-06 08:55:38,761][52670] Sum rewards: 73.569, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.100', 'AMMO5': '0.006', 'AMMO2': '0.028', 'weapon4': '0.072', 'weapon5': '0.082', 'AMMO4': '0.139', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.217', 'weapon2': '0.478', 'WEAPON3': '1.200', 'weapon3': '3.118', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.019', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:39,120][52662] DAMAGECOUNT value on done: 1033116.0 [2024-08-06 08:55:39,120][52662] Sum rewards: 87.509, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.380', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon5': '0.068', 'weapon4': '0.144', 'AMMO4': '0.171', 'AMMO3': '0.190', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.358', 'WEAPON3': '1.250', 'weapon3': '3.026', 'HITCOUNT': '3.910', 'DAMAGECOUNT': '20.280', 'FRAGCOUNT': '71.000'} [2024-08-06 08:55:39,700][52820] DAMAGECOUNT value on done: 958217.0 [2024-08-06 08:55:39,701][52820] Sum rewards: 84.324, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.760', 'AMMO5': '0.021', 'AMMO2': '0.067', 'weapon4': '0.176', 'AMMO3': '0.221', 'weapon2': '0.224', 'weapon5': '0.300', 'AMMO4': '0.336', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.350', 'weapon3': '3.000', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '19.359', 'FRAGCOUNT': '70.000'} [2024-08-06 08:55:40,372][52667] DAMAGECOUNT value on done: 1031647.0 [2024-08-06 08:55:40,374][52667] Sum rewards: 71.729, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.174', 'AMMO5': '0.014', 'AMMO2': '0.049', 'AMMO3': '0.208', 'AMMO4': '0.244', 'weapon5': '0.282', 'weapon2': '0.296', 'weapon4': '0.338', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '2.750', 'HITCOUNT': '3.300', 'DAMAGECOUNT': '17.271', 'FRAGCOUNT': '59.000'} [2024-08-06 08:55:41,095][52665] DAMAGECOUNT value on done: 1022499.0 [2024-08-06 08:55:41,095][52665] Sum rewards: 93.119, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.570', 'AMMO5': '0.007', 'AMMO2': '0.013', 'AMMO4': '0.064', 'weapon5': '0.088', 'AMMO3': '0.162', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.336', 'weapon2': '0.362', 'WEAPON3': '1.000', 'weapon3': '3.036', 'HITCOUNT': '3.970', 'DAMAGECOUNT': '21.000', 'FRAGCOUNT': '73.000'} [2024-08-06 08:55:41,422][52659] DAMAGECOUNT value on done: 1028200.0 [2024-08-06 08:55:41,422][52659] Sum rewards: 58.747, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.662', 'AMMO5': '0.007', 'AMMO2': '0.023', 'weapon4': '0.076', 'AMMO4': '0.115', 'weapon5': '0.142', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.202', 'weapon2': '0.388', 'WEAPON3': '1.300', 'HITCOUNT': '2.900', 'weapon3': '3.146', 'DAMAGECOUNT': '15.810', 'FRAGCOUNT': '48.000'} [2024-08-06 08:55:41,454][52668] DAMAGECOUNT value on done: 1031458.0 [2024-08-06 08:55:41,455][52668] Sum rewards: 78.809, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.400', 'AMMO5': '0.013', 'AMMO2': '0.041', 'weapon4': '0.074', 'AMMO4': '0.203', 'weapon5': '0.208', 'weapon2': '0.254', 'AMMO3': '0.262', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.190', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:41,535][52666] DAMAGECOUNT value on done: 1039887.0 [2024-08-06 08:55:41,535][52666] Sum rewards: 67.829, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.590', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon2': '0.150', 'AMMO4': '0.170', 'AMMO3': '0.238', 'weapon5': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.476', 'WEAPON3': '1.400', 'weapon3': '2.780', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.028', 'FRAGCOUNT': '56.000'} [2024-08-06 08:55:42,091][52662] DAMAGECOUNT value on done: 1048844.0 [2024-08-06 08:55:42,091][52662] Sum rewards: 58.235, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.931', 'AMMO5': '0.013', 'AMMO2': '0.036', 'weapon4': '0.072', 'AMMO4': '0.181', 'weapon5': '0.220', 'AMMO3': '0.231', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'HITCOUNT': '2.900', 'weapon3': '3.152', 'DAMAGECOUNT': '15.279', 'FRAGCOUNT': '49.000'} [2024-08-06 08:55:42,775][52820] DAMAGECOUNT value on done: 960523.0 [2024-08-06 08:55:42,775][52820] Sum rewards: 83.644, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.020', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.046', 'weapon5': '0.122', 'AMMO4': '0.124', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon2': '0.258', 'WEAPON3': '1.350', 'weapon3': '3.374', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.919', 'FRAGCOUNT': '68.000'} [2024-08-06 08:55:42,801][52567] Fps is (10 sec: 17191.8, 60 sec: 17337.8, 300 sec: 17411.1). Total num frames: 720158720. Throughput: 0: 4364.9. Samples: 180049350. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:42,801][52567] Avg episode reward: [(0, '76.750')] [2024-08-06 08:55:42,827][52650] Updated weights for policy 0, policy_version 87911 (0.0011) [2024-08-06 08:55:43,446][52667] DAMAGECOUNT value on done: 1030159.0 [2024-08-06 08:55:43,449][52667] Sum rewards: 79.832, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.580', 'AMMO2': '0.001', 'AMMO5': '0.003', 'AMMO4': '0.005', 'WEAPON5': '0.050', 'weapon5': '0.096', 'AMMO3': '0.177', 'weapon2': '0.416', 'WEAPON3': '1.100', 'weapon3': '3.326', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.879', 'FRAGCOUNT': '64.000'} [2024-08-06 08:55:43,651][52795] Large shaping reward 2.516 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.465, 155.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:55:43,856][52665] DAMAGECOUNT value on done: 1028663.0 [2024-08-06 08:55:43,856][52665] Sum rewards: 82.150, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.522', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.106', 'weapon5': '0.176', 'AMMO3': '0.186', 'AMMO4': '0.198', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.050', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '18.516', 'FRAGCOUNT': '67.000'} [2024-08-06 08:55:43,924][52668] DAMAGECOUNT value on done: 1030973.0 [2024-08-06 08:55:43,925][52668] Sum rewards: 82.178, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.847', 'AMMO5': '0.019', 'AMMO2': '0.048', 'weapon4': '0.108', 'AMMO3': '0.184', 'AMMO4': '0.240', 'weapon2': '0.268', 'weapon5': '0.324', 'WEAPON4': '0.500', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.954', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '20.031', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:44,218][52659] DAMAGECOUNT value on done: 1035416.0 [2024-08-06 08:55:44,219][52659] Sum rewards: 88.311, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-0.950', 'AMMO2': '0.002', 'AMMO5': '0.005', 'AMMO4': '0.012', 'weapon5': '0.038', 'WEAPON5': '0.100', 'AMMO3': '0.156', 'weapon2': '0.632', 'WEAPON3': '1.000', 'weapon3': '3.162', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '20.274', 'FRAGCOUNT': '69.000'} [2024-08-06 08:55:44,646][52666] DAMAGECOUNT value on done: 1013014.0 [2024-08-06 08:55:44,646][52666] Sum rewards: 77.145, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.824', 'AMMO5': '0.014', 'AMMO2': '0.046', 'weapon4': '0.072', 'weapon5': '0.216', 'AMMO3': '0.224', 'AMMO4': '0.231', 'weapon2': '0.328', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.300', 'weapon3': '3.144', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '19.074', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:45,009][52662] DAMAGECOUNT value on done: 1026260.0 [2024-08-06 08:55:45,011][52662] Sum rewards: 78.471, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.665', 'AMMO2': '0.010', 'AMMO5': '0.014', 'AMMO4': '0.051', 'weapon4': '0.104', 'AMMO3': '0.149', 'WEAPON4': '0.150', 'weapon5': '0.206', 'WEAPON5': '0.250', 'weapon2': '0.724', 'WEAPON3': '1.000', 'weapon3': '2.760', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:45,897][52820] DAMAGECOUNT value on done: 949279.0 [2024-08-06 08:55:45,900][52820] Sum rewards: 80.400, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.312', 'AMMO5': '0.005', 'AMMO2': '0.025', 'weapon4': '0.052', 'weapon5': '0.082', 'AMMO4': '0.123', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.193', 'weapon2': '0.236', 'WEAPON3': '1.250', 'weapon3': '3.416', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '65.000'} [2024-08-06 08:55:46,443][52668] DAMAGECOUNT value on done: 1031270.0 [2024-08-06 08:55:46,445][52668] Sum rewards: 70.620, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.536', 'AMMO5': '0.019', 'AMMO2': '0.071', 'weapon4': '0.084', 'AMMO3': '0.235', 'weapon5': '0.236', 'AMMO4': '0.354', 'weapon2': '0.494', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '2.930', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.343', 'FRAGCOUNT': '59.000'} [2024-08-06 08:55:46,489][52667] DAMAGECOUNT value on done: 1041048.0 [2024-08-06 08:55:46,491][52667] Sum rewards: 77.328, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.700', 'AMMO5': '0.009', 'AMMO2': '0.020', 'weapon4': '0.038', 'weapon5': '0.074', 'AMMO4': '0.098', 'AMMO3': '0.197', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.294', 'WEAPON3': '1.200', 'weapon3': '3.432', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '16.716', 'FRAGCOUNT': '64.000'} [2024-08-06 08:55:46,905][52659] DAMAGECOUNT value on done: 1036520.0 [2024-08-06 08:55:46,909][52659] Sum rewards: 76.629, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-1.488', 'AMMO5': '0.016', 'AMMO2': '0.049', 'weapon4': '0.180', 'AMMO4': '0.243', 'weapon5': '0.252', 'AMMO3': '0.298', 'weapon2': '0.330', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.884', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '19.125', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:47,097][52665] DAMAGECOUNT value on done: 1018927.0 [2024-08-06 08:55:47,100][52665] Sum rewards: 81.826, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.538', 'AMMO5': '0.011', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.174', 'AMMO3': '0.187', 'weapon4': '0.242', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.412', 'WEAPON3': '1.300', 'weapon3': '2.906', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '18.960', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:47,308][52650] Updated weights for policy 0, policy_version 87921 (0.0029) [2024-08-06 08:55:47,466][52666] DAMAGECOUNT value on done: 1026054.0 [2024-08-06 08:55:47,467][52666] Sum rewards: 74.573, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.048', 'AMMO5': '0.016', 'AMMO2': '0.035', 'weapon4': '0.060', 'AMMO4': '0.174', 'AMMO3': '0.176', 'weapon5': '0.234', 'weapon2': '0.262', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'WEAPON3': '1.100', 'weapon3': '3.232', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.402', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:47,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17339.8, 300 sec: 17411.5). Total num frames: 720248832. Throughput: 0: 4360.7. Samples: 180062390. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:47,794][52567] Avg episode reward: [(0, '77.069')] [2024-08-06 08:55:47,951][52662] DAMAGECOUNT value on done: 1027147.0 [2024-08-06 08:55:47,958][52662] Sum rewards: 70.430, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.254', 'AMMO5': '0.005', 'AMMO2': '0.028', 'weapon4': '0.078', 'weapon5': '0.084', 'WEAPON5': '0.100', 'AMMO4': '0.139', 'AMMO3': '0.193', 'WEAPON4': '0.300', 'weapon2': '0.434', 'WEAPON3': '1.150', 'weapon3': '3.212', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.541', 'FRAGCOUNT': '57.000'} [2024-08-06 08:55:49,085][52820] DAMAGECOUNT value on done: 955773.0 [2024-08-06 08:55:49,085][52820] Sum rewards: 72.013, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.295', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.076', 'AMMO3': '0.193', 'AMMO4': '0.208', 'weapon5': '0.270', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.410', 'WEAPON3': '1.100', 'weapon3': '2.998', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '16.254', 'FRAGCOUNT': '59.000'} [2024-08-06 08:55:49,156][52667] DAMAGECOUNT value on done: 1030971.0 [2024-08-06 08:55:49,157][52667] Sum rewards: 70.566, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.130', 'AMMO5': '0.021', 'AMMO2': '0.033', 'weapon4': '0.080', 'weapon5': '0.150', 'AMMO4': '0.167', 'AMMO3': '0.236', 'WEAPON4': '0.350', 'weapon2': '0.366', 'WEAPON5': '0.500', 'WEAPON3': '1.400', 'weapon3': '3.088', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.054', 'FRAGCOUNT': '59.000'} [2024-08-06 08:55:49,399][52668] DAMAGECOUNT value on done: 1031799.0 [2024-08-06 08:55:49,401][52668] Sum rewards: 84.831, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.065', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.132', 'AMMO3': '0.192', 'weapon2': '0.372', 'WEAPON3': '1.300', 'weapon3': '3.460', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.530', 'FRAGCOUNT': '70.000'} [2024-08-06 08:55:49,654][52671] Large shaping reward 2.630 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.03, 3.0), ('DAMAGECOUNT', 0.6, 200)] [2024-08-06 08:55:49,997][52665] DAMAGECOUNT value on done: 1033983.0 [2024-08-06 08:55:49,997][52665] Sum rewards: 79.199, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.412', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.096', 'WEAPON5': '0.100', 'AMMO4': '0.101', 'weapon4': '0.114', 'AMMO3': '0.157', 'WEAPON4': '0.200', 'weapon2': '0.386', 'WEAPON3': '1.050', 'weapon3': '3.228', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.144', 'FRAGCOUNT': '64.000'} [2024-08-06 08:55:50,131][52659] DAMAGECOUNT value on done: 1034322.0 [2024-08-06 08:55:50,133][52659] Sum rewards: 73.600, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.152', 'AMMO5': '0.014', 'AMMO2': '0.050', 'weapon4': '0.076', 'weapon2': '0.174', 'weapon5': '0.220', 'AMMO4': '0.249', 'AMMO3': '0.276', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.700', 'weapon3': '3.300', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '18.684', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:51,013][52662] DAMAGECOUNT value on done: 1048787.0 [2024-08-06 08:55:51,013][52662] Sum rewards: 72.890, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.128', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.036', 'AMMO4': '0.110', 'weapon5': '0.132', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.258', 'weapon2': '0.332', 'WEAPON3': '1.500', 'weapon3': '3.296', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.955', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:52,198][52650] Updated weights for policy 0, policy_version 87931 (0.0014) [2024-08-06 08:55:52,244][52820] DAMAGECOUNT value on done: 943313.0 [2024-08-06 08:55:52,247][52820] Sum rewards: 74.436, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.165', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.094', 'AMMO3': '0.166', 'AMMO4': '0.203', 'weapon5': '0.256', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.508', 'WEAPON3': '1.150', 'weapon3': '2.918', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '18.249', 'FRAGCOUNT': '59.500'} [2024-08-06 08:55:52,378][52667] DAMAGECOUNT value on done: 1040709.0 [2024-08-06 08:55:52,380][52667] Sum rewards: 81.473, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.232', 'AMMO5': '0.005', 'WEAPON1': '0.010', 'weapon4': '0.028', 'AMMO2': '0.066', 'weapon5': '0.092', 'AMMO3': '0.193', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.330', 'weapon2': '0.678', 'WEAPON3': '1.200', 'weapon3': '3.004', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.308', 'FRAGCOUNT': '65.000'} [2024-08-06 08:55:52,466][52668] DAMAGECOUNT value on done: 1036681.0 [2024-08-06 08:55:52,467][52668] Sum rewards: 82.807, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.040', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.098', 'weapon5': '0.144', 'AMMO3': '0.188', 'AMMO4': '0.251', 'weapon2': '0.258', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.200', 'weapon3': '3.258', 'HITCOUNT': '3.950', 'DAMAGECOUNT': '20.634', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:52,794][52567] Fps is (10 sec: 18034.4, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 720338944. Throughput: 0: 4367.3. Samples: 180088570. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:52,794][52567] Avg episode reward: [(0, '76.863')] [2024-08-06 08:55:52,998][52665] DAMAGECOUNT value on done: 1027760.0 [2024-08-06 08:55:53,008][52665] Sum rewards: 81.021, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.980', 'AMMO5': '0.007', 'AMMO2': '0.034', 'AMMO3': '0.147', 'AMMO4': '0.169', 'weapon2': '0.178', 'weapon5': '0.184', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon4': '0.440', 'WEAPON3': '1.000', 'weapon3': '2.990', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '18.972', 'FRAGCOUNT': '63.500'} [2024-08-06 08:55:53,020][52659] DAMAGECOUNT value on done: 1032387.0 [2024-08-06 08:55:53,021][52659] Sum rewards: 59.388, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.368', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.068', 'weapon4': '0.122', 'AMMO4': '0.166', 'AMMO3': '0.220', 'weapon2': '0.304', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.350', 'weapon3': '3.254', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '50.000'} [2024-08-06 08:55:53,895][52668] Large shaping reward 2.651 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.6, 200), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:55:54,232][52662] DAMAGECOUNT value on done: 1033374.0 [2024-08-06 08:55:54,232][52662] Sum rewards: 81.158, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.914', 'AMMO5': '0.017', 'AMMO2': '0.036', 'weapon4': '0.128', 'weapon5': '0.166', 'AMMO4': '0.177', 'AMMO3': '0.204', 'weapon2': '0.280', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.350', 'weapon3': '3.146', 'HITCOUNT': '3.600', 'DAMAGECOUNT': '19.068', 'FRAGCOUNT': '66.000'} [2024-08-06 08:55:55,195][52665] DAMAGECOUNT value on done: 1024550.0 [2024-08-06 08:55:55,196][52665] Sum rewards: 77.111, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-2.096', 'AMMO5': '0.003', 'AMMO2': '0.017', 'weapon4': '0.042', 'weapon5': '0.052', 'AMMO4': '0.086', 'WEAPON5': '0.100', 'AMMO3': '0.144', 'WEAPON4': '0.200', 'weapon2': '0.432', 'WEAPON3': '1.000', 'HITCOUNT': '3.260', 'weapon3': '3.344', 'DAMAGECOUNT': '17.526', 'FRAGCOUNT': '62.000'} [2024-08-06 08:55:55,443][52820] DAMAGECOUNT value on done: 951778.0 [2024-08-06 08:55:55,443][52820] Sum rewards: 73.259, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.340', 'AMMO5': '0.011', 'AMMO2': '0.017', 'weapon4': '0.028', 'weapon5': '0.084', 'AMMO4': '0.086', 'WEAPON4': '0.150', 'AMMO3': '0.167', 'WEAPON5': '0.250', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.208', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.364', 'FRAGCOUNT': '58.000'} [2024-08-06 08:55:55,711][52667] DAMAGECOUNT value on done: 1047239.0 [2024-08-06 08:55:55,713][52667] Sum rewards: 77.976, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.275', 'AMMO5': '0.010', 'WEAPON1': '0.020', 'AMMO2': '0.036', 'weapon4': '0.058', 'weapon5': '0.162', 'AMMO4': '0.179', 'weapon2': '0.250', 'AMMO3': '0.278', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.750', 'weapon3': '3.224', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.924', 'FRAGCOUNT': '68.000'} [2024-08-06 08:55:55,927][52659] DAMAGECOUNT value on done: 1042646.0 [2024-08-06 08:55:55,928][52659] Sum rewards: 64.378, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-0.622', 'AMMO5': '0.023', 'AMMO2': '0.051', 'weapon4': '0.106', 'weapon5': '0.204', 'AMMO3': '0.245', 'AMMO4': '0.257', 'weapon2': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '3.018', 'HITCOUNT': '3.090', 'DAMAGECOUNT': '16.128', 'FRAGCOUNT': '56.500'} [2024-08-06 08:55:56,862][52650] Updated weights for policy 0, policy_version 87941 (0.0011) [2024-08-06 08:55:57,037][52662] DAMAGECOUNT value on done: 1037067.0 [2024-08-06 08:55:57,039][52662] Sum rewards: 67.652, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-2.568', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.113', 'weapon5': '0.114', 'weapon4': '0.158', 'WEAPON4': '0.250', 'AMMO3': '0.297', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.700', 'weapon3': '3.098', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.977', 'FRAGCOUNT': '60.000'} [2024-08-06 08:55:57,770][52665] DAMAGECOUNT value on done: 1022127.0 [2024-08-06 08:55:57,770][52665] Sum rewards: 67.366, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.085', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon4': '0.030', 'weapon5': '0.096', 'AMMO4': '0.134', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'weapon2': '0.340', 'WEAPON3': '1.250', 'HITCOUNT': '3.080', 'weapon3': '3.342', 'DAMAGECOUNT': '16.533', 'FRAGCOUNT': '55.000'} [2024-08-06 08:55:57,794][52567] Fps is (10 sec: 18022.3, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 720429056. Throughput: 0: 4362.2. Samples: 180114830. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:55:57,794][52567] Avg episode reward: [(0, '76.450')] [2024-08-06 08:55:58,252][52667] DAMAGECOUNT value on done: 1048325.0 [2024-08-06 08:55:58,252][52667] Sum rewards: 83.093, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.385', 'AMMO5': '0.008', 'AMMO2': '0.021', 'weapon4': '0.030', 'weapon5': '0.102', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.227', 'weapon2': '0.466', 'WEAPON3': '1.450', 'weapon3': '3.218', 'HITCOUNT': '3.640', 'DAMAGECOUNT': '19.614', 'FRAGCOUNT': '69.000'} [2024-08-06 08:55:58,592][52820] DAMAGECOUNT value on done: 954616.0 [2024-08-06 08:55:58,594][52820] Sum rewards: 68.414, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.895', 'AMMO5': '0.022', 'AMMO2': '0.048', 'weapon4': '0.086', 'weapon5': '0.200', 'AMMO3': '0.217', 'AMMO4': '0.240', 'WEAPON4': '0.450', 'weapon2': '0.490', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.956', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '17.220', 'FRAGCOUNT': '57.000'} [2024-08-06 08:55:59,059][52659] DAMAGECOUNT value on done: 1029763.0 [2024-08-06 08:55:59,067][52659] Sum rewards: 61.641, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.020', 'AMMO5': '0.012', 'AMMO2': '0.030', 'AMMO4': '0.151', 'weapon5': '0.166', 'AMMO3': '0.178', 'weapon4': '0.328', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.442', 'WEAPON3': '1.150', 'HITCOUNT': '2.830', 'weapon3': '2.902', 'DAMAGECOUNT': '14.421', 'FRAGCOUNT': '50.000'} [2024-08-06 08:55:59,715][52662] DAMAGECOUNT value on done: 1033474.0 [2024-08-06 08:55:59,715][52662] Sum rewards: 73.737, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.776', 'AMMO5': '0.008', 'AMMO2': '0.034', 'weapon4': '0.090', 'weapon5': '0.102', 'AMMO4': '0.171', 'AMMO3': '0.191', 'WEAPON5': '0.200', 'weapon2': '0.246', 'WEAPON4': '0.300', 'WEAPON3': '1.150', 'HITCOUNT': '3.010', 'weapon3': '3.388', 'DAMAGECOUNT': '16.623', 'FRAGCOUNT': '61.000'} [2024-08-06 08:55:59,825][52647] DAMAGECOUNT value on done: 1102248.0 [2024-08-06 08:55:59,825][52647] Sum rewards: 87.804, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.362', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO2': '0.018', 'WEAPON4': '0.050', 'AMMO4': '0.087', 'WEAPON5': '0.100', 'weapon5': '0.122', 'AMMO3': '0.183', 'weapon2': '0.388', 'WEAPON3': '1.100', 'weapon3': '3.280', 'HITCOUNT': '3.750', 'DAMAGECOUNT': '20.319', 'FRAGCOUNT': '70.000'} [2024-08-06 08:56:00,106][52660] DAMAGECOUNT value on done: 1032402.0 [2024-08-06 08:56:00,107][52660] Sum rewards: 75.236, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.112', 'AMMO5': '0.013', 'AMMO2': '0.063', 'weapon5': '0.156', 'AMMO3': '0.201', 'AMMO4': '0.315', 'weapon4': '0.316', 'weapon2': '0.360', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.300', 'weapon3': '2.868', 'HITCOUNT': '3.610', 'DAMAGECOUNT': '18.795', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:00,661][52665] DAMAGECOUNT value on done: 1022806.0 [2024-08-06 08:56:00,663][52665] Sum rewards: 88.498, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.740', 'AMMO5': '0.003', 'AMMO2': '0.014', 'weapon5': '0.044', 'weapon4': '0.060', 'AMMO4': '0.069', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.121', 'weapon2': '0.568', 'WEAPON3': '0.850', 'weapon3': '3.138', 'HITCOUNT': '4.010', 'DAMAGECOUNT': '20.412', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:00,802][52649] DAMAGECOUNT value on done: 1004187.0 [2024-08-06 08:56:00,803][52649] Sum rewards: 67.918, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.088', 'AMMO5': '0.008', 'AMMO2': '0.029', 'weapon4': '0.044', 'weapon5': '0.138', 'AMMO4': '0.144', 'AMMO3': '0.269', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.328', 'WEAPON3': '1.650', 'HITCOUNT': '3.170', 'weapon3': '3.242', 'DAMAGECOUNT': '17.634', 'FRAGCOUNT': '58.000'} [2024-08-06 08:56:00,993][52667] DAMAGECOUNT value on done: 1043712.0 [2024-08-06 08:56:00,993][52667] Sum rewards: 72.104, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.280', 'AMMO5': '0.015', 'weapon4': '0.028', 'AMMO2': '0.043', 'weapon5': '0.166', 'AMMO3': '0.187', 'WEAPON4': '0.200', 'AMMO4': '0.214', 'weapon2': '0.344', 'WEAPON5': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.252', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.154', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:01,591][52650] Updated weights for policy 0, policy_version 87951 (0.0025) [2024-08-06 08:56:01,728][52820] DAMAGECOUNT value on done: 960063.0 [2024-08-06 08:56:01,730][52820] Sum rewards: 79.126, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.758', 'AMMO5': '0.012', 'AMMO2': '0.032', 'weapon5': '0.144', 'AMMO4': '0.161', 'AMMO3': '0.174', 'weapon4': '0.228', 'weapon2': '0.230', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.050', 'weapon3': '3.142', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:02,465][52659] DAMAGECOUNT value on done: 1039661.0 [2024-08-06 08:56:02,469][52659] Sum rewards: 77.338, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.970', 'AMMO5': '0.009', 'weapon4': '0.026', 'AMMO2': '0.031', 'weapon5': '0.090', 'WEAPON4': '0.150', 'AMMO4': '0.154', 'AMMO3': '0.242', 'WEAPON5': '0.250', 'weapon2': '0.338', 'WEAPON3': '1.350', 'weapon3': '3.324', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.594', 'FRAGCOUNT': '66.000'} [2024-08-06 08:56:02,577][52660] DAMAGECOUNT value on done: 1022811.0 [2024-08-06 08:56:02,580][52660] Sum rewards: 79.578, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.080', 'AMMO5': '0.010', 'weapon4': '0.016', 'AMMO2': '0.023', 'WEAPON4': '0.050', 'AMMO4': '0.113', 'AMMO3': '0.174', 'WEAPON5': '0.200', 'weapon5': '0.244', 'weapon2': '0.482', 'WEAPON3': '1.100', 'weapon3': '3.058', 'HITCOUNT': '3.720', 'DAMAGECOUNT': '18.969', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:02,688][52662] DAMAGECOUNT value on done: 1030218.0 [2024-08-06 08:56:02,689][52662] Sum rewards: 79.426, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.660', 'AMMO5': '0.009', 'AMMO2': '0.022', 'weapon4': '0.046', 'AMMO4': '0.112', 'WEAPON4': '0.200', 'AMMO3': '0.221', 'WEAPON5': '0.250', 'weapon5': '0.290', 'weapon2': '0.486', 'WEAPON3': '1.300', 'weapon3': '2.944', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.636', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:02,794][52567] Fps is (10 sec: 18022.4, 60 sec: 17612.8, 300 sec: 17467.0). Total num frames: 720519168. Throughput: 0: 4364.2. Samples: 180127860. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:56:02,794][52567] Avg episode reward: [(0, '76.202')] [2024-08-06 08:56:02,942][52647] DAMAGECOUNT value on done: 1090499.0 [2024-08-06 08:56:02,942][52647] Sum rewards: 65.958, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.890', 'AMMO5': '0.019', 'AMMO2': '0.051', 'AMMO3': '0.213', 'weapon2': '0.230', 'AMMO4': '0.255', 'weapon4': '0.364', 'weapon5': '0.364', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.300', 'weapon3': '2.666', 'HITCOUNT': '3.100', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '54.000'} [2024-08-06 08:56:03,389][52665] DAMAGECOUNT value on done: 1026602.0 [2024-08-06 08:56:03,391][52665] Sum rewards: 77.659, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.970', 'AMMO2': '0.014', 'AMMO5': '0.014', 'weapon4': '0.048', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'AMMO3': '0.173', 'weapon5': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.392', 'WEAPON3': '1.100', 'weapon3': '3.146', 'HITCOUNT': '3.370', 'DAMAGECOUNT': '18.177', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:03,586][52649] DAMAGECOUNT value on done: 995800.0 [2024-08-06 08:56:03,589][52649] Sum rewards: 68.675, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.601', 'AMMO5': '0.015', 'AMMO2': '0.050', 'weapon4': '0.090', 'weapon5': '0.212', 'AMMO3': '0.244', 'AMMO4': '0.250', 'weapon2': '0.344', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.038', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:04,228][52667] DAMAGECOUNT value on done: 1040969.0 [2024-08-06 08:56:04,229][52667] Sum rewards: 75.949, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.900', 'AMMO5': '0.004', 'weapon4': '0.014', 'AMMO2': '0.026', 'weapon5': '0.036', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO4': '0.131', 'AMMO3': '0.179', 'weapon2': '0.540', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '18.165', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:04,831][52820] DAMAGECOUNT value on done: 969056.0 [2024-08-06 08:56:04,831][52820] Sum rewards: 81.374, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.044', 'AMMO5': '0.003', 'AMMO2': '0.003', 'AMMO4': '0.016', 'WEAPON5': '0.050', 'weapon5': '0.066', 'AMMO3': '0.208', 'weapon2': '0.554', 'WEAPON3': '1.350', 'weapon3': '3.206', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '19.962', 'FRAGCOUNT': '66.000'} [2024-08-06 08:56:05,251][52671] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:56:05,258][52660] DAMAGECOUNT value on done: 1034887.0 [2024-08-06 08:56:05,259][52660] Sum rewards: 89.215, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.965', 'AMMO4': '-0.010', 'AMMO2': '-0.002', 'AMMO3': '0.192', 'weapon2': '0.448', 'WEAPON3': '1.300', 'weapon3': '3.382', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.820', 'FRAGCOUNT': '73.000'} [2024-08-06 08:56:05,604][52659] DAMAGECOUNT value on done: 1035402.0 [2024-08-06 08:56:05,604][52659] Sum rewards: 80.010, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.650', 'AMMO5': '0.012', 'AMMO2': '0.051', 'weapon5': '0.070', 'weapon4': '0.086', 'AMMO3': '0.216', 'AMMO4': '0.256', 'weapon2': '0.292', 'WEAPON5': '0.300', 'WEAPON4': '0.400', 'WEAPON3': '1.350', 'weapon3': '3.244', 'HITCOUNT': '3.870', 'DAMAGECOUNT': '20.013', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:05,675][52662] DAMAGECOUNT value on done: 1027388.0 [2024-08-06 08:56:05,678][52662] Sum rewards: 84.635, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.279', 'AMMO5': '0.009', 'AMMO2': '0.028', 'weapon4': '0.042', 'weapon5': '0.126', 'AMMO4': '0.140', 'AMMO3': '0.209', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.328', 'WEAPON3': '1.400', 'weapon3': '3.286', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.417', 'FRAGCOUNT': '69.000'} [2024-08-06 08:56:05,687][52647] DAMAGECOUNT value on done: 1092314.0 [2024-08-06 08:56:05,688][52647] Sum rewards: 73.885, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.187', 'AMMO5': '0.007', 'AMMO2': '0.025', 'AMMO4': '0.123', 'weapon5': '0.132', 'weapon4': '0.182', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.272', 'WEAPON3': '1.550', 'weapon3': '3.186', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '18.816', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:06,144][52650] Updated weights for policy 0, policy_version 87961 (0.0021) [2024-08-06 08:56:06,474][52665] DAMAGECOUNT value on done: 1021685.0 [2024-08-06 08:56:06,475][52665] Sum rewards: 66.880, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.720', 'AMMO5': '0.023', 'AMMO2': '0.053', 'weapon4': '0.098', 'weapon5': '0.224', 'AMMO3': '0.244', 'AMMO4': '0.266', 'weapon2': '0.362', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.550', 'weapon3': '3.046', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '17.943', 'FRAGCOUNT': '56.000'} [2024-08-06 08:56:06,797][52649] DAMAGECOUNT value on done: 1012315.0 [2024-08-06 08:56:06,798][52649] Sum rewards: 74.789, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.800', 'AMMO5': '0.005', 'AMMO2': '0.036', 'weapon5': '0.090', 'AMMO4': '0.180', 'WEAPON5': '0.200', 'weapon2': '0.220', 'AMMO3': '0.259', 'weapon4': '0.288', 'WEAPON4': '0.300', 'WEAPON3': '1.650', 'weapon3': '3.094', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.787', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:07,166][52667] DAMAGECOUNT value on done: 1043962.0 [2024-08-06 08:56:07,166][52667] Sum rewards: 78.764, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.170', 'AMMO5': '0.010', 'AMMO2': '0.021', 'weapon4': '0.074', 'AMMO4': '0.102', 'WEAPON4': '0.150', 'AMMO3': '0.153', 'weapon5': '0.154', 'WEAPON5': '0.250', 'weapon2': '0.492', 'WEAPON3': '1.050', 'weapon3': '3.126', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:07,569][52795] DAMAGECOUNT value on done: 952826.0 [2024-08-06 08:56:07,570][52795] Sum rewards: 86.985, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.691', 'AMMO5': '0.007', 'AMMO2': '0.031', 'weapon5': '0.112', 'WEAPON5': '0.150', 'AMMO4': '0.153', 'AMMO3': '0.165', 'weapon4': '0.180', 'WEAPON4': '0.350', 'weapon2': '0.432', 'WEAPON3': '1.000', 'weapon3': '3.090', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '19.266', 'FRAGCOUNT': '71.000'} [2024-08-06 08:56:07,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 720601088. Throughput: 0: 4362.2. Samples: 180154180. Policy #0 lag: (min: 0.0, avg: 3.9, max: 7.0) [2024-08-06 08:56:07,794][52567] Avg episode reward: [(0, '76.139')] [2024-08-06 08:56:07,857][52820] DAMAGECOUNT value on done: 949724.0 [2024-08-06 08:56:07,860][52820] Sum rewards: 72.188, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.154', 'AMMO4': '0.165', 'AMMO3': '0.178', 'weapon5': '0.194', 'weapon2': '0.326', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.150', 'weapon3': '3.010', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.964', 'FRAGCOUNT': '58.000'} [2024-08-06 08:56:08,082][52660] DAMAGECOUNT value on done: 1045616.0 [2024-08-06 08:56:08,084][52660] Sum rewards: 87.174, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.254', 'AMMO2': '0.006', 'AMMO5': '0.010', 'weapon5': '0.014', 'AMMO4': '0.029', 'WEAPON5': '0.100', 'AMMO3': '0.187', 'weapon2': '0.504', 'WEAPON3': '1.200', 'weapon3': '3.304', 'HITCOUNT': '3.880', 'DAMAGECOUNT': '19.194', 'FRAGCOUNT': '72.000'} [2024-08-06 08:56:08,405][52662] DAMAGECOUNT value on done: 1036424.0 [2024-08-06 08:56:08,405][52662] Sum rewards: 74.044, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.838', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.084', 'AMMO3': '0.141', 'AMMO4': '0.178', 'weapon5': '0.196', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.468', 'WEAPON3': '0.900', 'weapon3': '3.012', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '17.454', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:08,418][52647] DAMAGECOUNT value on done: 1090992.0 [2024-08-06 08:56:08,419][52647] Sum rewards: 75.939, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.680', 'AMMO5': '0.024', 'AMMO2': '0.062', 'weapon4': '0.154', 'AMMO3': '0.263', 'AMMO4': '0.311', 'weapon2': '0.316', 'weapon5': '0.348', 'WEAPON4': '0.650', 'WEAPON5': '0.650', 'WEAPON3': '1.600', 'weapon3': '2.860', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.181', 'FRAGCOUNT': '66.000'} [2024-08-06 08:56:08,779][52659] DAMAGECOUNT value on done: 1031871.0 [2024-08-06 08:56:08,780][52659] Sum rewards: 71.328, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.680', 'AMMO5': '0.026', 'AMMO2': '0.063', 'AMMO3': '0.243', 'weapon2': '0.302', 'AMMO4': '0.313', 'weapon5': '0.338', 'weapon4': '0.510', 'WEAPON5': '0.650', 'WEAPON4': '0.700', 'WEAPON3': '1.500', 'weapon3': '2.476', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:09,636][52665] DAMAGECOUNT value on done: 1013368.0 [2024-08-06 08:56:09,637][52665] Sum rewards: 78.066, reward structure: {'DEATHCOUNT': '-12.750', 'AMMO5': '0.019', 'AMMO2': '0.058', 'HEALTH': '0.178', 'AMMO3': '0.189', 'AMMO4': '0.289', 'weapon5': '0.290', 'weapon2': '0.356', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon4': '0.536', 'WEAPON3': '1.050', 'weapon3': '2.502', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:09,967][52649] DAMAGECOUNT value on done: 1013345.0 [2024-08-06 08:56:09,968][52649] Sum rewards: 77.359, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.795', 'AMMO5': '0.006', 'AMMO2': '0.014', 'weapon4': '0.030', 'weapon5': '0.050', 'AMMO4': '0.071', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.207', 'weapon2': '0.322', 'WEAPON3': '1.300', 'weapon3': '3.366', 'HITCOUNT': '3.580', 'DAMAGECOUNT': '18.657', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:10,551][52660] DAMAGECOUNT value on done: 1025062.0 [2024-08-06 08:56:10,552][52660] Sum rewards: 76.088, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.872', 'AMMO5': '0.007', 'AMMO2': '0.019', 'weapon4': '0.028', 'weapon5': '0.056', 'AMMO4': '0.096', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.226', 'AMMO3': '0.236', 'WEAPON3': '1.450', 'HITCOUNT': '3.470', 'weapon3': '3.474', 'DAMAGECOUNT': '17.748', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:10,688][52647] DAMAGECOUNT value on done: 1103012.0 [2024-08-06 08:56:10,688][52647] Sum rewards: 81.717, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.420', 'AMMO5': '0.005', 'AMMO2': '0.009', 'weapon4': '0.018', 'AMMO4': '0.046', 'WEAPON4': '0.050', 'weapon5': '0.086', 'WEAPON5': '0.150', 'AMMO3': '0.205', 'weapon2': '0.574', 'WEAPON3': '1.450', 'weapon3': '3.128', 'HITCOUNT': '3.810', 'DAMAGECOUNT': '20.355', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:10,710][52795] DAMAGECOUNT value on done: 945859.0 [2024-08-06 08:56:10,710][52795] Sum rewards: 66.997, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.220', 'AMMO5': '0.010', 'weapon4': '0.044', 'AMMO2': '0.046', 'weapon5': '0.096', 'AMMO3': '0.210', 'AMMO4': '0.228', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.444', 'WEAPON3': '1.350', 'weapon3': '3.036', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.592', 'FRAGCOUNT': '55.000'} [2024-08-06 08:56:10,866][52650] Updated weights for policy 0, policy_version 87971 (0.0024) [2024-08-06 08:56:11,116][52820] DAMAGECOUNT value on done: 962328.0 [2024-08-06 08:56:11,118][52820] Sum rewards: 80.961, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.195', 'AMMO5': '0.010', 'AMMO2': '0.040', 'weapon4': '0.118', 'weapon5': '0.180', 'weapon2': '0.186', 'AMMO4': '0.201', 'AMMO3': '0.208', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.250', 'weapon3': '3.302', 'HITCOUNT': '3.830', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:11,555][52662] DAMAGECOUNT value on done: 1029691.0 [2024-08-06 08:56:11,557][52662] Sum rewards: 67.210, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.998', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.056', 'weapon5': '0.108', 'AMMO4': '0.129', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.261', 'weapon2': '0.290', 'WEAPON3': '1.500', 'weapon3': '3.246', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '17.502', 'FRAGCOUNT': '58.000'} [2024-08-06 08:56:11,615][52668] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:56:12,170][52659] DAMAGECOUNT value on done: 1033540.0 [2024-08-06 08:56:12,171][52659] Sum rewards: 70.756, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.249', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon4': '0.068', 'weapon5': '0.162', 'AMMO4': '0.226', 'AMMO3': '0.234', 'weapon2': '0.286', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.450', 'weapon3': '3.198', 'HITCOUNT': '3.290', 'DAMAGECOUNT': '16.935', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:12,694][52811] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:56:12,739][52665] DAMAGECOUNT value on done: 1019470.0 [2024-08-06 08:56:12,739][52665] Sum rewards: 72.903, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.726', 'AMMO5': '0.007', 'weapon4': '0.024', 'AMMO2': '0.033', 'weapon5': '0.090', 'WEAPON4': '0.100', 'WEAPON5': '0.150', 'AMMO4': '0.166', 'AMMO3': '0.177', 'weapon2': '0.326', 'WEAPON3': '1.200', 'weapon3': '3.372', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.013', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:12,795][52567] Fps is (10 sec: 16382.5, 60 sec: 17476.0, 300 sec: 17412.0). Total num frames: 720683008. Throughput: 0: 4357.9. Samples: 180180330. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:12,795][52567] Avg episode reward: [(0, '76.326')] [2024-08-06 08:56:13,043][52649] DAMAGECOUNT value on done: 1005989.0 [2024-08-06 08:56:13,044][52649] Sum rewards: 82.103, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.820', 'AMMO5': '0.012', 'AMMO2': '0.034', 'weapon4': '0.078', 'weapon5': '0.150', 'AMMO4': '0.168', 'AMMO3': '0.178', 'weapon2': '0.222', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'WEAPON3': '1.100', 'weapon3': '3.360', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '19.341', 'FRAGCOUNT': '66.000'} [2024-08-06 08:56:13,112][52647] DAMAGECOUNT value on done: 1094788.0 [2024-08-06 08:56:13,113][52647] Sum rewards: 72.234, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.512', 'ARMOR': '0.004', 'AMMO5': '0.012', 'AMMO2': '0.055', 'weapon5': '0.156', 'AMMO3': '0.232', 'weapon2': '0.268', 'AMMO4': '0.273', 'weapon4': '0.294', 'WEAPON5': '0.350', 'WEAPON4': '0.450', 'WEAPON3': '1.400', 'weapon3': '3.012', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:13,416][52660] DAMAGECOUNT value on done: 1021923.0 [2024-08-06 08:56:13,417][52660] Sum rewards: 67.704, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.420', 'AMMO2': '0.005', 'AMMO5': '0.005', 'weapon4': '0.014', 'AMMO4': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.124', 'AMMO3': '0.222', 'weapon2': '0.298', 'WEAPON3': '1.300', 'HITCOUNT': '3.080', 'weapon3': '3.368', 'DAMAGECOUNT': '16.284', 'FRAGCOUNT': '57.000'} [2024-08-06 08:56:13,896][52795] DAMAGECOUNT value on done: 948196.0 [2024-08-06 08:56:13,899][52795] Sum rewards: 75.748, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.710', 'AMMO5': '0.020', 'AMMO2': '0.056', 'weapon4': '0.136', 'AMMO3': '0.182', 'AMMO4': '0.279', 'weapon5': '0.310', 'weapon2': '0.408', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.250', 'weapon3': '2.876', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '18.240', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:14,430][52820] DAMAGECOUNT value on done: 976062.0 [2024-08-06 08:56:14,431][52820] Sum rewards: 74.842, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.980', 'AMMO5': '0.011', 'AMMO2': '0.038', 'weapon5': '0.166', 'AMMO4': '0.188', 'AMMO3': '0.206', 'weapon2': '0.328', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon4': '0.386', 'WEAPON3': '1.300', 'weapon3': '2.924', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.324', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:14,748][52662] DAMAGECOUNT value on done: 1046428.0 [2024-08-06 08:56:14,749][52662] Sum rewards: 79.191, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.770', 'AMMO2': '0.002', 'weapon5': '0.006', 'AMMO5': '0.007', 'AMMO4': '0.010', 'WEAPON5': '0.150', 'AMMO3': '0.172', 'weapon2': '0.370', 'WEAPON3': '1.050', 'weapon3': '3.468', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '18.405', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:14,908][52659] DAMAGECOUNT value on done: 1034958.0 [2024-08-06 08:56:14,910][52659] Sum rewards: 73.021, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-4.585', 'AMMO5': '0.012', 'AMMO2': '0.018', 'weapon4': '0.028', 'weapon5': '0.078', 'AMMO4': '0.091', 'WEAPON4': '0.200', 'AMMO3': '0.258', 'WEAPON5': '0.300', 'weapon2': '0.460', 'WEAPON3': '1.700', 'weapon3': '3.208', 'HITCOUNT': '3.770', 'DAMAGECOUNT': '18.732', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:15,428][52665] DAMAGECOUNT value on done: 1027883.0 [2024-08-06 08:56:15,430][52665] Sum rewards: 84.469, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.950', 'AMMO5': '0.023', 'AMMO2': '0.044', 'weapon4': '0.094', 'AMMO4': '0.218', 'AMMO3': '0.281', 'weapon5': '0.286', 'weapon2': '0.334', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.700', 'weapon3': '2.982', 'HITCOUNT': '3.570', 'DAMAGECOUNT': '20.637', 'FRAGCOUNT': '72.000'} [2024-08-06 08:56:15,707][52650] Updated weights for policy 0, policy_version 87981 (0.0011) [2024-08-06 08:56:15,798][52649] DAMAGECOUNT value on done: 1014261.0 [2024-08-06 08:56:15,800][52649] Sum rewards: 79.488, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.086', 'AMMO5': '0.014', 'AMMO2': '0.032', 'weapon4': '0.044', 'weapon5': '0.130', 'AMMO4': '0.162', 'AMMO3': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.456', 'WEAPON3': '1.200', 'weapon3': '3.212', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.738', 'FRAGCOUNT': '64.500'} [2024-08-06 08:56:16,295][52647] DAMAGECOUNT value on done: 1096277.0 [2024-08-06 08:56:16,298][52647] Sum rewards: 76.291, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-2.033', 'AMMO5': '0.012', 'AMMO2': '0.037', 'weapon4': '0.070', 'AMMO3': '0.172', 'AMMO4': '0.184', 'weapon5': '0.220', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.792', 'WEAPON3': '1.150', 'weapon3': '2.624', 'HITCOUNT': '3.230', 'DAMAGECOUNT': '17.883', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:16,318][52660] DAMAGECOUNT value on done: 1029039.0 [2024-08-06 08:56:16,320][52660] Sum rewards: 73.116, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-0.800', 'AMMO5': '0.020', 'AMMO2': '0.044', 'weapon4': '0.164', 'AMMO3': '0.221', 'AMMO4': '0.221', 'weapon2': '0.286', 'weapon5': '0.336', 'WEAPON4': '0.400', 'WEAPON5': '0.500', 'WEAPON3': '1.300', 'weapon3': '2.840', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:16,995][52795] DAMAGECOUNT value on done: 963464.0 [2024-08-06 08:56:16,995][52795] Sum rewards: 71.721, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-1.758', 'AMMO5': '0.015', 'AMMO2': '0.058', 'weapon5': '0.178', 'weapon4': '0.206', 'AMMO3': '0.270', 'weapon2': '0.286', 'AMMO4': '0.291', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.500', 'weapon3': '3.008', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.727', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:17,539][52820] DAMAGECOUNT value on done: 962433.0 [2024-08-06 08:56:17,541][52820] Sum rewards: 80.965, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.489', 'AMMO5': '0.011', 'AMMO2': '0.033', 'AMMO3': '0.151', 'weapon5': '0.160', 'AMMO4': '0.165', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.254', 'weapon2': '0.288', 'WEAPON3': '1.050', 'weapon3': '3.118', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '19.464', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:17,794][52567] Fps is (10 sec: 17202.9, 60 sec: 17476.2, 300 sec: 17439.2). Total num frames: 720773120. Throughput: 0: 4360.9. Samples: 180193170. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:17,795][52567] Avg episode reward: [(0, '76.222')] [2024-08-06 08:56:17,806][52662] DAMAGECOUNT value on done: 1034133.0 [2024-08-06 08:56:17,807][52662] Sum rewards: 81.834, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.068', 'AMMO5': '0.008', 'AMMO2': '0.019', 'weapon4': '0.058', 'weapon5': '0.090', 'AMMO4': '0.093', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.242', 'weapon2': '0.422', 'WEAPON3': '1.450', 'weapon3': '3.190', 'HITCOUNT': '3.730', 'DAMAGECOUNT': '19.200', 'FRAGCOUNT': '70.000'} [2024-08-06 08:56:18,058][52659] DAMAGECOUNT value on done: 1047400.0 [2024-08-06 08:56:18,060][52659] Sum rewards: 76.573, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.322', 'AMMO5': '0.027', 'AMMO2': '0.054', 'weapon4': '0.164', 'weapon2': '0.194', 'AMMO3': '0.224', 'weapon5': '0.260', 'AMMO4': '0.268', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.450', 'weapon3': '3.088', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '18.546', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:18,276][52671] DAMAGECOUNT value on done: 1040822.0 [2024-08-06 08:56:18,276][52671] Sum rewards: 79.361, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.230', 'AMMO4': '-0.013', 'AMMO2': '-0.003', 'AMMO3': '0.204', 'weapon2': '0.370', 'WEAPON3': '1.350', 'weapon3': '3.484', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '18.519', 'FRAGCOUNT': '66.000'} [2024-08-06 08:56:18,685][52649] DAMAGECOUNT value on done: 1015737.0 [2024-08-06 08:56:18,686][52649] Sum rewards: 87.706, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.350', 'AMMO5': '0.019', 'AMMO2': '0.040', 'weapon4': '0.088', 'AMMO4': '0.200', 'weapon5': '0.208', 'AMMO3': '0.240', 'weapon2': '0.308', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '3.068', 'HITCOUNT': '3.960', 'DAMAGECOUNT': '21.375', 'FRAGCOUNT': '74.000'} [2024-08-06 08:56:19,058][52647] DAMAGECOUNT value on done: 1074727.0 [2024-08-06 08:56:19,059][52647] Sum rewards: 81.444, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.554', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon4': '0.056', 'AMMO4': '0.101', 'weapon5': '0.140', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.248', 'WEAPON3': '1.050', 'weapon3': '3.368', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.230', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:19,389][52660] DAMAGECOUNT value on done: 1036886.0 [2024-08-06 08:56:19,391][52660] Sum rewards: 84.179, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.480', 'AMMO5': '0.005', 'weapon4': '0.028', 'AMMO2': '0.031', 'weapon5': '0.086', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.155', 'weapon2': '0.258', 'AMMO3': '0.282', 'WEAPON3': '1.700', 'weapon3': '3.354', 'HITCOUNT': '4.150', 'DAMAGECOUNT': '20.310', 'FRAGCOUNT': '71.000'} [2024-08-06 08:56:20,074][52795] DAMAGECOUNT value on done: 947857.0 [2024-08-06 08:56:20,075][52795] Sum rewards: 72.721, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.336', 'AMMO5': '0.013', 'AMMO2': '0.045', 'AMMO4': '0.224', 'weapon5': '0.230', 'AMMO3': '0.245', 'weapon4': '0.264', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.366', 'WEAPON3': '1.500', 'weapon3': '2.844', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '18.846', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:20,467][52650] Updated weights for policy 0, policy_version 87991 (0.0027) [2024-08-06 08:56:20,565][52662] DAMAGECOUNT value on done: 1024631.0 [2024-08-06 08:56:20,566][52662] Sum rewards: 74.286, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.580', 'AMMO5': '0.006', 'AMMO2': '0.016', 'weapon4': '0.078', 'AMMO4': '0.080', 'weapon5': '0.080', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.225', 'weapon2': '0.270', 'WEAPON3': '1.550', 'weapon3': '3.372', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '18.789', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:20,600][52659] DAMAGECOUNT value on done: 1026455.0 [2024-08-06 08:56:20,601][52659] Sum rewards: 74.623, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.390', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.092', 'AMMO4': '0.104', 'WEAPON5': '0.150', 'AMMO3': '0.167', 'WEAPON4': '0.200', 'weapon4': '0.260', 'weapon2': '0.418', 'WEAPON3': '1.100', 'weapon3': '2.994', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '17.601', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:20,682][52820] DAMAGECOUNT value on done: 959837.0 [2024-08-06 08:56:20,682][52820] Sum rewards: 71.869, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.180', 'AMMO5': '0.014', 'AMMO2': '0.042', 'weapon5': '0.186', 'AMMO3': '0.199', 'AMMO4': '0.210', 'weapon2': '0.228', 'WEAPON5': '0.300', 'weapon4': '0.314', 'WEAPON4': '0.400', 'WEAPON3': '1.150', 'weapon3': '2.982', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '17.994', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:20,918][52671] DAMAGECOUNT value on done: 1045220.0 [2024-08-06 08:56:20,918][52671] Sum rewards: 77.866, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.100', 'AMMO5': '0.008', 'AMMO2': '0.031', 'weapon4': '0.096', 'weapon5': '0.120', 'AMMO4': '0.157', 'AMMO3': '0.189', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.256', 'WEAPON3': '1.300', 'weapon3': '3.340', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.158', 'FRAGCOUNT': '62.500'} [2024-08-06 08:56:21,512][52649] DAMAGECOUNT value on done: 1010848.0 [2024-08-06 08:56:21,513][52649] Sum rewards: 75.355, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.124', 'AMMO5': '0.015', 'AMMO2': '0.033', 'weapon5': '0.138', 'AMMO3': '0.166', 'AMMO4': '0.166', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon4': '0.276', 'weapon2': '0.564', 'WEAPON3': '1.100', 'weapon3': '2.792', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '18.318', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:22,239][52647] DAMAGECOUNT value on done: 1088617.0 [2024-08-06 08:56:22,239][52647] Sum rewards: 72.730, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.811', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.115', 'weapon5': '0.140', 'WEAPON4': '0.250', 'AMMO3': '0.271', 'WEAPON5': '0.350', 'weapon2': '0.422', 'WEAPON3': '1.650', 'weapon3': '3.106', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '17.679', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:22,511][52660] DAMAGECOUNT value on done: 1025497.0 [2024-08-06 08:56:22,512][52660] Sum rewards: 90.649, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.034', 'weapon5': '0.002', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.016', 'AMMO4': '0.038', 'WEAPON5': '0.100', 'WEAPON4': '0.100', 'AMMO3': '0.195', 'weapon2': '0.316', 'WEAPON3': '1.300', 'weapon3': '3.478', 'HITCOUNT': '4.160', 'DAMAGECOUNT': '20.715', 'FRAGCOUNT': '75.000'} [2024-08-06 08:56:22,794][52567] Fps is (10 sec: 18024.0, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 720863232. Throughput: 0: 4366.7. Samples: 180219460. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:22,794][52567] Avg episode reward: [(0, '76.464')] [2024-08-06 08:56:22,882][52663] Large shaping reward 2.550 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.528, 176.0), ('weapon5', 0.002)] [2024-08-06 08:56:23,324][52795] DAMAGECOUNT value on done: 948647.0 [2024-08-06 08:56:23,325][52795] Sum rewards: 70.214, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.442', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon5': '0.128', 'AMMO4': '0.162', 'weapon4': '0.180', 'AMMO3': '0.234', 'weapon2': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.550', 'weapon3': '3.136', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.367', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:23,537][52659] DAMAGECOUNT value on done: 1041534.0 [2024-08-06 08:56:23,540][52659] Sum rewards: 66.188, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.026', 'AMMO5': '0.021', 'AMMO2': '0.050', 'weapon4': '0.112', 'AMMO3': '0.243', 'AMMO4': '0.249', 'weapon5': '0.294', 'weapon2': '0.328', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.500', 'weapon3': '2.936', 'HITCOUNT': '3.170', 'DAMAGECOUNT': '18.312', 'FRAGCOUNT': '56.000'} [2024-08-06 08:56:23,540][52662] DAMAGECOUNT value on done: 1032127.0 [2024-08-06 08:56:23,543][52662] Sum rewards: 83.602, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.189', 'AMMO5': '0.011', 'AMMO2': '0.035', 'weapon4': '0.146', 'AMMO4': '0.174', 'weapon5': '0.188', 'AMMO3': '0.220', 'weapon2': '0.300', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.128', 'HITCOUNT': '3.800', 'DAMAGECOUNT': '20.340', 'FRAGCOUNT': '70.500'} [2024-08-06 08:56:23,773][52649] DAMAGECOUNT value on done: 1005691.0 [2024-08-06 08:56:23,774][52649] Sum rewards: 77.086, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-2.085', 'AMMO5': '0.021', 'AMMO2': '0.053', 'weapon4': '0.104', 'AMMO3': '0.182', 'weapon5': '0.196', 'weapon2': '0.248', 'AMMO4': '0.267', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.200', 'weapon3': '3.228', 'HITCOUNT': '3.270', 'DAMAGECOUNT': '17.802', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:23,843][52820] DAMAGECOUNT value on done: 960669.0 [2024-08-06 08:56:23,844][52820] Sum rewards: 81.388, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.912', 'AMMO5': '0.007', 'AMMO2': '0.026', 'weapon4': '0.028', 'weapon5': '0.038', 'AMMO4': '0.129', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.199', 'weapon2': '0.404', 'WEAPON3': '1.250', 'weapon3': '3.376', 'HITCOUNT': '3.790', 'DAMAGECOUNT': '18.753', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:23,873][52669] DAMAGECOUNT value on done: 1031700.0 [2024-08-06 08:56:23,875][52669] Sum rewards: 65.504, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-4.193', 'AMMO5': '0.016', 'AMMO2': '0.064', 'weapon4': '0.078', 'weapon5': '0.188', 'AMMO3': '0.272', 'AMMO4': '0.320', 'weapon2': '0.414', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.750', 'weapon3': '3.044', 'HITCOUNT': '3.250', 'DAMAGECOUNT': '16.401', 'FRAGCOUNT': '58.000'} [2024-08-06 08:56:23,897][52671] DAMAGECOUNT value on done: 1039959.0 [2024-08-06 08:56:23,898][52671] Sum rewards: 66.249, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-4.560', 'AMMO5': '0.009', 'AMMO2': '0.036', 'weapon4': '0.082', 'weapon5': '0.118', 'AMMO4': '0.181', 'AMMO3': '0.255', 'WEAPON5': '0.300', 'weapon2': '0.302', 'WEAPON4': '0.400', 'WEAPON3': '1.700', 'weapon3': '3.274', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '17.091', 'FRAGCOUNT': '57.000'} [2024-08-06 08:56:24,749][52650] Updated weights for policy 0, policy_version 88001 (0.0022) [2024-08-06 08:56:25,165][52647] DAMAGECOUNT value on done: 1084400.0 [2024-08-06 08:56:25,166][52647] Sum rewards: 83.827, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.309', 'AMMO5': '0.003', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.037', 'weapon5': '0.044', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.216', 'weapon2': '0.378', 'WEAPON3': '1.400', 'weapon3': '3.426', 'HITCOUNT': '3.890', 'DAMAGECOUNT': '19.521', 'FRAGCOUNT': '69.000'} [2024-08-06 08:56:25,451][52660] DAMAGECOUNT value on done: 1023176.0 [2024-08-06 08:56:25,451][52660] Sum rewards: 79.260, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.790', 'AMMO5': '0.005', 'AMMO2': '0.024', 'weapon4': '0.030', 'weapon5': '0.046', 'WEAPON5': '0.100', 'AMMO4': '0.120', 'AMMO3': '0.133', 'WEAPON4': '0.200', 'weapon2': '0.336', 'WEAPON3': '0.900', 'weapon3': '3.472', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '18.534', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:26,184][52659] DAMAGECOUNT value on done: 1032893.0 [2024-08-06 08:56:26,186][52659] Sum rewards: 74.883, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.732', 'AMMO5': '0.015', 'AMMO2': '0.040', 'weapon4': '0.072', 'weapon2': '0.168', 'weapon5': '0.188', 'AMMO4': '0.199', 'AMMO3': '0.223', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.366', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '19.185', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:26,287][52662] DAMAGECOUNT value on done: 1025643.0 [2024-08-06 08:56:26,289][52662] Sum rewards: 79.486, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.049', 'AMMO5': '0.007', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.134', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.190', 'weapon4': '0.208', 'weapon2': '0.304', 'WEAPON3': '1.150', 'weapon3': '3.134', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.170', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:26,495][52671] DAMAGECOUNT value on done: 1046711.0 [2024-08-06 08:56:26,495][52671] Sum rewards: 74.077, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.670', 'AMMO5': '0.006', 'AMMO2': '0.024', 'weapon5': '0.088', 'WEAPON5': '0.100', 'weapon4': '0.106', 'AMMO4': '0.117', 'AMMO3': '0.170', 'WEAPON4': '0.200', 'weapon2': '0.352', 'WEAPON3': '1.150', 'weapon3': '3.292', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '17.142', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:26,548][52795] DAMAGECOUNT value on done: 963703.0 [2024-08-06 08:56:26,549][52795] Sum rewards: 78.562, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.240', 'AMMO5': '0.019', 'AMMO2': '0.056', 'AMMO3': '0.151', 'weapon5': '0.204', 'AMMO4': '0.280', 'weapon2': '0.458', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'weapon4': '0.608', 'WEAPON3': '1.000', 'weapon3': '2.410', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.116', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:26,768][52649] DAMAGECOUNT value on done: 1002997.0 [2024-08-06 08:56:26,768][52649] Sum rewards: 64.665, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.350', 'AMMO5': '0.015', 'AMMO2': '0.043', 'weapon5': '0.122', 'weapon4': '0.148', 'AMMO4': '0.217', 'AMMO3': '0.261', 'weapon2': '0.264', 'WEAPON5': '0.400', 'WEAPON4': '0.450', 'WEAPON3': '1.600', 'weapon3': '3.138', 'HITCOUNT': '3.340', 'DAMAGECOUNT': '17.517', 'FRAGCOUNT': '57.000'} [2024-08-06 08:56:26,922][52669] DAMAGECOUNT value on done: 1031654.0 [2024-08-06 08:56:26,923][52669] Sum rewards: 65.986, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.496', 'AMMO5': '0.007', 'AMMO2': '0.022', 'weapon4': '0.096', 'AMMO4': '0.108', 'weapon5': '0.130', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'AMMO3': '0.234', 'weapon2': '0.518', 'WEAPON3': '1.450', 'weapon3': '3.070', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '16.347', 'FRAGCOUNT': '57.000'} [2024-08-06 08:56:26,947][52820] DAMAGECOUNT value on done: 960299.0 [2024-08-06 08:56:26,947][52820] Sum rewards: 83.389, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-0.988', 'AMMO5': '0.007', 'AMMO2': '0.029', 'weapon4': '0.048', 'weapon5': '0.140', 'AMMO4': '0.145', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.221', 'weapon2': '0.438', 'WEAPON3': '1.350', 'weapon3': '3.120', 'HITCOUNT': '4.180', 'DAMAGECOUNT': '20.649', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:27,711][52647] DAMAGECOUNT value on done: 1083375.0 [2024-08-06 08:56:27,712][52647] Sum rewards: 72.566, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.624', 'AMMO5': '0.006', 'AMMO2': '0.017', 'weapon4': '0.018', 'AMMO4': '0.083', 'weapon5': '0.090', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.192', 'weapon2': '0.434', 'WEAPON3': '1.150', 'HITCOUNT': '3.230', 'weapon3': '3.298', 'DAMAGECOUNT': '17.622', 'FRAGCOUNT': '58.000'} [2024-08-06 08:56:27,794][52567] Fps is (10 sec: 18022.7, 60 sec: 17612.8, 300 sec: 17439.2). Total num frames: 720953344. Throughput: 0: 4362.6. Samples: 180245640. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:27,795][52567] Avg episode reward: [(0, '76.090')] [2024-08-06 08:56:27,798][52614] Saving /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000088007_720953344.pth... [2024-08-06 08:56:27,951][52614] Removing /home/evgenii/Documents/Jupyter_notebooks/SAMPLE_FACTORY/train_dir/doom_deathmatch_bots_test/checkpoint_p0/checkpoint_000087496_716767232.pth [2024-08-06 08:56:28,254][52660] DAMAGECOUNT value on done: 1030658.0 [2024-08-06 08:56:28,256][52660] Sum rewards: 82.344, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-3.459', 'AMMO5': '0.018', 'AMMO2': '0.062', 'AMMO3': '0.178', 'weapon4': '0.222', 'weapon5': '0.244', 'weapon2': '0.296', 'AMMO4': '0.311', 'WEAPON4': '0.600', 'WEAPON5': '0.600', 'WEAPON3': '1.300', 'weapon3': '2.984', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '19.077', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:29,269][52649] DAMAGECOUNT value on done: 1017956.0 [2024-08-06 08:56:29,270][52649] Sum rewards: 70.482, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-1.104', 'AMMO5': '0.018', 'AMMO2': '0.055', 'weapon4': '0.216', 'weapon2': '0.222', 'AMMO4': '0.277', 'AMMO3': '0.283', 'weapon5': '0.314', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.500', 'weapon3': '2.866', 'HITCOUNT': '3.200', 'DAMAGECOUNT': '17.835', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:29,534][52671] DAMAGECOUNT value on done: 1053559.0 [2024-08-06 08:56:29,535][52671] Sum rewards: 78.787, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.660', 'AMMO2': '0.002', 'AMMO5': '0.003', 'AMMO4': '0.009', 'weapon4': '0.018', 'WEAPON1': '0.020', 'weapon5': '0.046', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO3': '0.218', 'weapon2': '0.478', 'WEAPON3': '1.400', 'weapon3': '3.268', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '19.566', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:29,653][52650] Updated weights for policy 0, policy_version 88011 (0.0014) [2024-08-06 08:56:29,777][52795] DAMAGECOUNT value on done: 955742.0 [2024-08-06 08:56:29,778][52795] Sum rewards: 78.398, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.662', 'AMMO5': '0.011', 'AMMO2': '0.018', 'weapon4': '0.032', 'AMMO4': '0.092', 'WEAPON4': '0.150', 'AMMO3': '0.161', 'weapon5': '0.194', 'WEAPON5': '0.300', 'weapon2': '0.584', 'WEAPON3': '1.000', 'weapon3': '3.008', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:30,030][52669] DAMAGECOUNT value on done: 1040834.0 [2024-08-06 08:56:30,030][52669] Sum rewards: 72.687, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.730', 'AMMO5': '0.016', 'AMMO2': '0.029', 'weapon4': '0.070', 'AMMO3': '0.142', 'AMMO4': '0.143', 'weapon5': '0.188', 'WEAPON4': '0.250', 'WEAPON5': '0.400', 'weapon2': '0.828', 'WEAPON3': '0.900', 'weapon3': '2.684', 'HITCOUNT': '3.220', 'DAMAGECOUNT': '16.797', 'FRAGCOUNT': '56.000'} [2024-08-06 08:56:30,120][52820] DAMAGECOUNT value on done: 967981.0 [2024-08-06 08:56:30,120][52820] Sum rewards: 67.688, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.510', 'AMMO5': '0.006', 'AMMO2': '0.022', 'weapon4': '0.030', 'weapon5': '0.078', 'AMMO4': '0.109', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.266', 'weapon2': '0.402', 'WEAPON3': '1.700', 'weapon3': '3.232', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '17.484', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:30,885][52660] DAMAGECOUNT value on done: 1024356.0 [2024-08-06 08:56:30,885][52660] Sum rewards: 70.517, reward structure: {'DEATHCOUNT': '-7.500', 'HEALTH': '-1.670', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon5': '0.086', 'AMMO4': '0.102', 'weapon4': '0.112', 'AMMO3': '0.114', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.680', 'WEAPON3': '0.850', 'weapon3': '3.042', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '15.975', 'FRAGCOUNT': '55.000'} [2024-08-06 08:56:30,967][52647] DAMAGECOUNT value on done: 1084458.0 [2024-08-06 08:56:30,968][52647] Sum rewards: 90.735, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.430', 'AMMO5': '0.009', 'AMMO2': '0.020', 'AMMO4': '0.100', 'weapon2': '0.174', 'weapon5': '0.182', 'AMMO3': '0.232', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.324', 'WEAPON3': '1.400', 'weapon3': '2.994', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.580', 'FRAGCOUNT': '75.000'} [2024-08-06 08:56:31,257][52658] DAMAGECOUNT value on done: 1041010.0 [2024-08-06 08:56:31,257][52658] Sum rewards: 84.013, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.669', 'AMMO5': '0.008', 'AMMO2': '0.025', 'weapon4': '0.090', 'weapon5': '0.110', 'AMMO4': '0.123', 'AMMO3': '0.169', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.300', 'WEAPON3': '1.150', 'weapon3': '3.306', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '18.891', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:31,712][52649] DAMAGECOUNT value on done: 1024935.0 [2024-08-06 08:56:31,713][52649] Sum rewards: 81.866, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.818', 'AMMO5': '0.007', 'AMMO2': '0.022', 'AMMO4': '0.107', 'weapon5': '0.112', 'weapon4': '0.128', 'AMMO3': '0.180', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.316', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.670', 'DAMAGECOUNT': '19.272', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:32,537][52671] DAMAGECOUNT value on done: 1042980.0 [2024-08-06 08:56:32,538][52671] Sum rewards: 87.870, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.720', 'AMMO5': '0.012', 'AMMO2': '0.019', 'AMMO4': '0.095', 'AMMO3': '0.160', 'weapon4': '0.166', 'weapon5': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'weapon2': '0.382', 'WEAPON3': '1.000', 'weapon3': '3.012', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '20.457', 'FRAGCOUNT': '70.000'} [2024-08-06 08:56:32,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17411.5). Total num frames: 721035264. Throughput: 0: 4363.6. Samples: 180258750. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:32,794][52567] Avg episode reward: [(0, '76.265')] [2024-08-06 08:56:32,899][52795] DAMAGECOUNT value on done: 954978.0 [2024-08-06 08:56:32,899][52795] Sum rewards: 82.104, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.610', 'AMMO5': '0.014', 'AMMO2': '0.038', 'weapon5': '0.128', 'AMMO3': '0.179', 'AMMO4': '0.189', 'weapon2': '0.250', 'weapon4': '0.352', 'WEAPON5': '0.400', 'WEAPON4': '0.500', 'WEAPON3': '1.200', 'weapon3': '3.032', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '19.512', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:33,138][52669] DAMAGECOUNT value on done: 1036534.0 [2024-08-06 08:56:33,140][52669] Sum rewards: 88.720, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.790', 'AMMO5': '0.003', 'weapon4': '0.016', 'AMMO2': '0.020', 'weapon5': '0.028', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.099', 'AMMO3': '0.196', 'weapon2': '0.434', 'WEAPON3': '1.250', 'weapon3': '3.340', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.295', 'FRAGCOUNT': '72.000'} [2024-08-06 08:56:33,257][52820] DAMAGECOUNT value on done: 969221.0 [2024-08-06 08:56:33,258][52820] Sum rewards: 72.640, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.856', 'AMMO5': '0.008', 'AMMO2': '0.023', 'weapon4': '0.092', 'weapon5': '0.098', 'AMMO4': '0.114', 'weapon2': '0.144', 'AMMO3': '0.196', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'WEAPON3': '1.200', 'HITCOUNT': '3.280', 'weapon3': '3.446', 'DAMAGECOUNT': '16.695', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:33,827][52647] DAMAGECOUNT value on done: 1090884.0 [2024-08-06 08:56:33,830][52647] Sum rewards: 88.284, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.590', 'AMMO5': '0.011', 'AMMO2': '0.028', 'weapon4': '0.092', 'AMMO4': '0.138', 'weapon5': '0.140', 'WEAPON4': '0.200', 'AMMO3': '0.223', 'WEAPON5': '0.250', 'weapon2': '0.458', 'WEAPON3': '1.400', 'weapon3': '3.022', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '21.012', 'FRAGCOUNT': '73.500'} [2024-08-06 08:56:34,053][52658] DAMAGECOUNT value on done: 1041076.0 [2024-08-06 08:56:34,054][52658] Sum rewards: 75.023, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon5': '0.092', 'AMMO4': '0.152', 'AMMO3': '0.192', 'WEAPON5': '0.250', 'WEAPON4': '0.300', 'weapon2': '0.306', 'weapon4': '0.376', 'WEAPON3': '1.100', 'weapon3': '2.978', 'HITCOUNT': '3.510', 'DAMAGECOUNT': '17.607', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:34,162][52650] Updated weights for policy 0, policy_version 88021 (0.0014) [2024-08-06 08:56:34,192][52660] DAMAGECOUNT value on done: 1025998.0 [2024-08-06 08:56:34,192][52660] Sum rewards: 75.558, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.130', 'AMMO5': '0.015', 'AMMO2': '0.038', 'weapon4': '0.082', 'weapon5': '0.084', 'AMMO3': '0.182', 'AMMO4': '0.189', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.586', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '18.768', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:34,775][52649] DAMAGECOUNT value on done: 1015679.0 [2024-08-06 08:56:34,779][52649] Sum rewards: 95.479, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.779', 'AMMO5': '0.013', 'AMMO2': '0.044', 'weapon4': '0.090', 'AMMO3': '0.198', 'weapon5': '0.214', 'AMMO4': '0.223', 'weapon2': '0.230', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.250', 'weapon3': '3.202', 'HITCOUNT': '3.850', 'DAMAGECOUNT': '23.244', 'FRAGCOUNT': '76.000'} [2024-08-06 08:56:34,999][52647] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:56:35,248][52671] DAMAGECOUNT value on done: 1039931.0 [2024-08-06 08:56:35,249][52671] Sum rewards: 73.882, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.566', 'AMMO5': '0.027', 'AMMO2': '0.058', 'AMMO3': '0.212', 'weapon4': '0.254', 'AMMO4': '0.290', 'weapon5': '0.308', 'weapon2': '0.370', 'WEAPON4': '0.650', 'WEAPON5': '0.700', 'WEAPON3': '1.300', 'weapon3': '2.746', 'HITCOUNT': '3.500', 'DAMAGECOUNT': '19.032', 'FRAGCOUNT': '60.500'} [2024-08-06 08:56:35,995][52795] DAMAGECOUNT value on done: 962683.0 [2024-08-06 08:56:35,995][52795] Sum rewards: 85.695, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.220', 'AMMO5': '0.006', 'weapon4': '0.028', 'AMMO2': '0.033', 'weapon5': '0.070', 'AMMO4': '0.166', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.298', 'weapon2': '0.330', 'WEAPON3': '1.800', 'weapon3': '3.268', 'HITCOUNT': '4.170', 'DAMAGECOUNT': '21.096', 'FRAGCOUNT': '73.000'} [2024-08-06 08:56:36,063][52669] DAMAGECOUNT value on done: 1043478.0 [2024-08-06 08:56:36,065][52669] Sum rewards: 80.556, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.705', 'AMMO5': '0.011', 'AMMO2': '0.031', 'weapon4': '0.052', 'AMMO4': '0.155', 'AMMO3': '0.193', 'weapon5': '0.206', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.324', 'WEAPON3': '1.150', 'weapon3': '3.220', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '18.630', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:36,355][52614] Signal inference workers to stop experience collection... (16250 times) [2024-08-06 08:56:36,356][52614] Signal inference workers to resume experience collection... (16250 times) [2024-08-06 08:56:36,442][52650] InferenceWorker_p0-w0: stopping experience collection (16250 times) [2024-08-06 08:56:36,442][52650] InferenceWorker_p0-w0: resuming experience collection (16250 times) [2024-08-06 08:56:36,492][52647] DAMAGECOUNT value on done: 1086703.0 [2024-08-06 08:56:36,493][52647] Sum rewards: 69.677, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.484', 'AMMO5': '0.010', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.150', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.220', 'weapon4': '0.312', 'weapon2': '0.592', 'WEAPON3': '1.300', 'weapon3': '2.698', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '18.030', 'FRAGCOUNT': '58.000'} [2024-08-06 08:56:36,524][52820] DAMAGECOUNT value on done: 955171.0 [2024-08-06 08:56:36,525][52820] Sum rewards: 83.085, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.637', 'AMMO5': '0.012', 'AMMO2': '0.021', 'weapon4': '0.066', 'AMMO4': '0.106', 'weapon5': '0.138', 'AMMO3': '0.174', 'WEAPON4': '0.200', 'WEAPON5': '0.250', 'weapon2': '0.314', 'WEAPON3': '1.150', 'weapon3': '3.268', 'HITCOUNT': '3.710', 'DAMAGECOUNT': '19.563', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:36,905][52660] DAMAGECOUNT value on done: 1034069.0 [2024-08-06 08:56:36,907][52660] Sum rewards: 64.677, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.308', 'AMMO5': '0.005', 'AMMO2': '0.021', 'weapon4': '0.028', 'weapon5': '0.094', 'AMMO4': '0.107', 'AMMO3': '0.177', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.282', 'WEAPON3': '1.100', 'HITCOUNT': '3.100', 'weapon3': '3.468', 'DAMAGECOUNT': '14.952', 'FRAGCOUNT': '52.000'} [2024-08-06 08:56:36,986][52658] DAMAGECOUNT value on done: 1042046.0 [2024-08-06 08:56:36,987][52658] Sum rewards: 92.061, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-0.191', 'AMMO2': '0.006', 'AMMO4': '0.030', 'AMMO3': '0.159', 'weapon2': '0.670', 'WEAPON3': '1.000', 'weapon3': '3.206', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '20.691', 'FRAGCOUNT': '73.000'} [2024-08-06 08:56:37,738][52649] DAMAGECOUNT value on done: 1016121.0 [2024-08-06 08:56:37,738][52649] Sum rewards: 73.896, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.288', 'AMMO5': '0.010', 'AMMO2': '0.038', 'weapon4': '0.118', 'weapon5': '0.120', 'AMMO4': '0.191', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.255', 'weapon2': '0.472', 'WEAPON3': '1.500', 'weapon3': '3.014', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.576', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:37,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17476.3, 300 sec: 17439.2). Total num frames: 721125376. Throughput: 0: 4357.3. Samples: 180284650. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:37,794][52567] Avg episode reward: [(0, '77.196')] [2024-08-06 08:56:37,871][52811] DAMAGECOUNT value on done: 976967.0 [2024-08-06 08:56:37,871][52811] Sum rewards: 76.818, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.390', 'AMMO5': '0.012', 'AMMO2': '0.046', 'weapon4': '0.058', 'weapon5': '0.160', 'AMMO4': '0.232', 'AMMO3': '0.263', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.386', 'WEAPON3': '1.550', 'weapon3': '3.142', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '18.348', 'FRAGCOUNT': '66.000'} [2024-08-06 08:56:38,228][52671] DAMAGECOUNT value on done: 1046389.0 [2024-08-06 08:56:38,231][52671] Sum rewards: 73.545, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.508', 'AMMO5': '0.020', 'AMMO2': '0.054', 'weapon4': '0.098', 'AMMO3': '0.216', 'weapon2': '0.252', 'AMMO4': '0.271', 'weapon5': '0.396', 'WEAPON4': '0.450', 'WEAPON5': '0.550', 'WEAPON3': '1.400', 'weapon3': '2.958', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '18.708', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:38,948][52669] DAMAGECOUNT value on done: 1040048.0 [2024-08-06 08:56:38,950][52669] Sum rewards: 76.409, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.660', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon5': '0.090', 'AMMO4': '0.100', 'WEAPON5': '0.150', 'WEAPON4': '0.200', 'weapon4': '0.220', 'AMMO3': '0.225', 'weapon2': '0.342', 'WEAPON3': '1.450', 'weapon3': '3.156', 'HITCOUNT': '3.680', 'DAMAGECOUNT': '17.931', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:39,132][52795] DAMAGECOUNT value on done: 956858.0 [2024-08-06 08:56:39,132][52795] Sum rewards: 65.025, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.960', 'AMMO5': '0.010', 'AMMO2': '0.025', 'weapon5': '0.116', 'AMMO4': '0.124', 'weapon4': '0.170', 'weapon2': '0.200', 'AMMO3': '0.222', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'WEAPON3': '1.450', 'weapon3': '3.298', 'HITCOUNT': '3.310', 'DAMAGECOUNT': '17.310', 'FRAGCOUNT': '54.000'} [2024-08-06 08:56:39,329][52647] DAMAGECOUNT value on done: 1091137.0 [2024-08-06 08:56:39,330][52647] Sum rewards: 88.795, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.933', 'AMMO5': '0.009', 'AMMO2': '0.023', 'weapon4': '0.048', 'AMMO4': '0.113', 'weapon5': '0.140', 'AMMO3': '0.194', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.340', 'WEAPON3': '1.300', 'weapon3': '3.302', 'HITCOUNT': '4.040', 'DAMAGECOUNT': '21.720', 'FRAGCOUNT': '71.000'} [2024-08-06 08:56:39,379][52650] Updated weights for policy 0, policy_version 88031 (0.0012) [2024-08-06 08:56:39,622][52660] DAMAGECOUNT value on done: 1051219.0 [2024-08-06 08:56:39,622][52660] Sum rewards: 71.458, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.580', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.060', 'AMMO4': '0.122', 'weapon5': '0.144', 'weapon2': '0.186', 'WEAPON4': '0.200', 'AMMO3': '0.273', 'WEAPON5': '0.300', 'WEAPON3': '1.550', 'weapon3': '3.314', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '18.273', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:39,722][52658] DAMAGECOUNT value on done: 1038113.0 [2024-08-06 08:56:39,723][52658] Sum rewards: 82.786, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-1.879', 'AMMO5': '0.011', 'AMMO2': '0.040', 'weapon4': '0.084', 'AMMO4': '0.199', 'weapon5': '0.244', 'AMMO3': '0.250', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.276', 'WEAPON3': '1.500', 'weapon3': '3.112', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '20.799', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:40,740][52649] DAMAGECOUNT value on done: 1002673.0 [2024-08-06 08:56:40,741][52649] Sum rewards: 67.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.955', 'AMMO5': '0.016', 'AMMO2': '0.041', 'weapon4': '0.080', 'AMMO3': '0.174', 'AMMO4': '0.205', 'weapon5': '0.274', 'WEAPON4': '0.350', 'WEAPON5': '0.400', 'weapon2': '0.430', 'WEAPON3': '1.000', 'weapon3': '2.992', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.911', 'FRAGCOUNT': '54.000'} [2024-08-06 08:56:40,966][52811] DAMAGECOUNT value on done: 963690.0 [2024-08-06 08:56:40,968][52811] Sum rewards: 81.948, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.465', 'AMMO5': '0.015', 'AMMO2': '0.050', 'AMMO3': '0.164', 'weapon5': '0.218', 'AMMO4': '0.250', 'weapon2': '0.282', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon4': '0.496', 'WEAPON3': '0.950', 'weapon3': '2.784', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.723', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:41,177][52671] DAMAGECOUNT value on done: 1024609.0 [2024-08-06 08:56:41,177][52671] Sum rewards: 58.059, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.190', 'AMMO5': '0.012', 'AMMO2': '0.024', 'weapon4': '0.094', 'AMMO4': '0.122', 'weapon5': '0.188', 'AMMO3': '0.237', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.290', 'WEAPON3': '1.450', 'HITCOUNT': '2.770', 'weapon3': '3.170', 'DAMAGECOUNT': '14.892', 'FRAGCOUNT': '50.000'} [2024-08-06 08:56:41,738][52669] DAMAGECOUNT value on done: 1039417.0 [2024-08-06 08:56:41,739][52669] Sum rewards: 80.346, reward structure: {'DEATHCOUNT': '-12.000', 'AMMO5': '0.007', 'AMMO2': '0.036', 'HEALTH': '0.116', 'weapon5': '0.130', 'AMMO3': '0.181', 'AMMO4': '0.182', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'weapon2': '0.286', 'weapon4': '0.388', 'WEAPON3': '1.000', 'weapon3': '2.974', 'HITCOUNT': '3.560', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:42,195][52795] DAMAGECOUNT value on done: 949647.0 [2024-08-06 08:56:42,195][52795] Sum rewards: 82.287, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.000', 'AMMO5': '0.007', 'AMMO2': '0.023', 'AMMO4': '0.114', 'weapon5': '0.132', 'weapon4': '0.180', 'AMMO3': '0.191', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'weapon2': '0.382', 'WEAPON3': '1.150', 'weapon3': '3.084', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '20.823', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:42,420][52647] DAMAGECOUNT value on done: 1093566.0 [2024-08-06 08:56:42,421][52647] Sum rewards: 74.310, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.847', 'AMMO5': '0.009', 'AMMO2': '0.010', 'AMMO4': '0.051', 'weapon5': '0.074', 'weapon4': '0.080', 'WEAPON4': '0.150', 'AMMO3': '0.159', 'WEAPON5': '0.250', 'weapon2': '0.582', 'WEAPON3': '1.100', 'weapon3': '3.086', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '18.645', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:42,601][52660] DAMAGECOUNT value on done: 1027824.0 [2024-08-06 08:56:42,602][52660] Sum rewards: 84.734, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.005', 'AMMO2': '0.019', 'AMMO4': '0.093', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'weapon2': '0.204', 'AMMO3': '0.212', 'weapon4': '0.228', 'WEAPON3': '1.300', 'weapon3': '3.266', 'HITCOUNT': '3.990', 'DAMAGECOUNT': '19.725', 'FRAGCOUNT': '69.000'} [2024-08-06 08:56:42,794][52567] Fps is (10 sec: 17203.3, 60 sec: 17478.2, 300 sec: 17439.2). Total num frames: 721207296. Throughput: 0: 4360.9. Samples: 180311070. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:42,794][52567] Avg episode reward: [(0, '77.079')] [2024-08-06 08:56:42,879][52658] DAMAGECOUNT value on done: 1032222.0 [2024-08-06 08:56:42,880][52658] Sum rewards: 80.722, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.741', 'AMMO5': '0.005', 'AMMO2': '0.027', 'weapon5': '0.088', 'AMMO4': '0.136', 'WEAPON5': '0.200', 'AMMO3': '0.208', 'weapon4': '0.258', 'WEAPON4': '0.350', 'weapon2': '0.378', 'WEAPON3': '1.300', 'weapon3': '3.070', 'HITCOUNT': '3.940', 'DAMAGECOUNT': '20.253', 'FRAGCOUNT': '66.000'} [2024-08-06 08:56:43,631][52650] Updated weights for policy 0, policy_version 88041 (0.0010) [2024-08-06 08:56:43,696][52649] DAMAGECOUNT value on done: 1021513.0 [2024-08-06 08:56:43,697][52649] Sum rewards: 92.770, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.345', 'AMMO5': '0.012', 'AMMO2': '0.040', 'weapon4': '0.062', 'weapon5': '0.168', 'AMMO4': '0.201', 'AMMO3': '0.212', 'weapon2': '0.358', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.400', 'weapon3': '3.162', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '22.590', 'FRAGCOUNT': '74.000'} [2024-08-06 08:56:43,823][52671] DAMAGECOUNT value on done: 1040016.0 [2024-08-06 08:56:43,824][52671] Sum rewards: 71.252, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.420', 'AMMO5': '0.010', 'AMMO2': '0.043', 'weapon5': '0.056', 'weapon4': '0.178', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO4': '0.213', 'AMMO3': '0.239', 'weapon2': '0.384', 'WEAPON3': '1.400', 'weapon3': '3.178', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.421', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:44,073][52811] DAMAGECOUNT value on done: 957642.0 [2024-08-06 08:56:44,076][52811] Sum rewards: 82.823, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.282', 'AMMO5': '0.005', 'AMMO2': '0.008', 'weapon4': '0.014', 'AMMO4': '0.041', 'weapon5': '0.086', 'WEAPON4': '0.100', 'WEAPON5': '0.200', 'AMMO3': '0.233', 'weapon2': '0.346', 'WEAPON3': '1.500', 'weapon3': '3.328', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.224', 'FRAGCOUNT': '71.000'} [2024-08-06 08:56:44,291][52669] DAMAGECOUNT value on done: 1043107.0 [2024-08-06 08:56:44,293][52669] Sum rewards: 68.231, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.710', 'AMMO5': '0.017', 'AMMO2': '0.049', 'weapon5': '0.166', 'AMMO3': '0.184', 'AMMO4': '0.247', 'weapon2': '0.254', 'weapon4': '0.476', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.150', 'weapon3': '2.856', 'HITCOUNT': '3.410', 'DAMAGECOUNT': '17.031', 'FRAGCOUNT': '55.000'} [2024-08-06 08:56:45,286][52795] DAMAGECOUNT value on done: 955339.0 [2024-08-06 08:56:45,286][52795] Sum rewards: 79.032, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.181', 'AMMO5': '0.011', 'AMMO2': '0.025', 'weapon4': '0.032', 'weapon5': '0.078', 'AMMO4': '0.126', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.253', 'weapon2': '0.310', 'WEAPON3': '1.550', 'weapon3': '3.340', 'HITCOUNT': '3.820', 'DAMAGECOUNT': '20.118', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:45,353][52647] DAMAGECOUNT value on done: 1076989.0 [2024-08-06 08:56:45,353][52647] Sum rewards: 72.870, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.250', 'AMMO5': '0.006', 'AMMO2': '0.032', 'weapon5': '0.076', 'weapon4': '0.090', 'WEAPON5': '0.150', 'AMMO4': '0.158', 'WEAPON4': '0.200', 'AMMO3': '0.236', 'weapon2': '0.568', 'WEAPON3': '1.500', 'weapon3': '3.080', 'HITCOUNT': '3.460', 'DAMAGECOUNT': '17.064', 'FRAGCOUNT': '62.000'} [2024-08-06 08:56:45,457][52660] DAMAGECOUNT value on done: 1033417.0 [2024-08-06 08:56:45,457][52660] Sum rewards: 71.674, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-3.790', 'AMMO5': '0.006', 'AMMO2': '0.023', 'weapon5': '0.080', 'AMMO4': '0.113', 'weapon4': '0.146', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.278', 'weapon2': '0.294', 'WEAPON3': '1.750', 'weapon3': '3.238', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.736', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:45,977][52658] DAMAGECOUNT value on done: 1028733.0 [2024-08-06 08:56:45,978][52658] Sum rewards: 68.982, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.948', 'AMMO5': '0.007', 'AMMO2': '0.020', 'weapon5': '0.088', 'AMMO4': '0.100', 'weapon4': '0.112', 'WEAPON4': '0.150', 'AMMO3': '0.175', 'WEAPON5': '0.200', 'weapon2': '0.610', 'WEAPON3': '1.050', 'weapon3': '3.022', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '16.785', 'FRAGCOUNT': '54.000'} [2024-08-06 08:56:46,432][52647] Large shaping reward -2.549 for [('FRAGCOUNT', -1.5, -1.0), ('DEATHCOUNT', -0.75, 1.0), ('HEALTH', -0.3, -100.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:56:46,501][52649] DAMAGECOUNT value on done: 995819.0 [2024-08-06 08:56:46,501][52649] Sum rewards: 72.228, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-3.430', 'AMMO5': '0.008', 'weapon4': '0.050', 'AMMO2': '0.053', 'weapon5': '0.134', 'AMMO3': '0.264', 'AMMO4': '0.267', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.350', 'WEAPON3': '1.650', 'weapon3': '3.224', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '19.038', 'FRAGCOUNT': '60.000'} [2024-08-06 08:56:46,644][52671] DAMAGECOUNT value on done: 1043563.0 [2024-08-06 08:56:46,645][52671] Sum rewards: 68.935, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.160', 'AMMO5': '0.008', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.124', 'weapon2': '0.192', 'WEAPON5': '0.200', 'AMMO3': '0.203', 'WEAPON4': '0.250', 'weapon4': '0.454', 'WEAPON3': '1.200', 'weapon3': '3.020', 'HITCOUNT': '3.240', 'DAMAGECOUNT': '17.058', 'FRAGCOUNT': '56.000'} [2024-08-06 08:56:47,126][52811] DAMAGECOUNT value on done: 963420.0 [2024-08-06 08:56:47,126][52811] Sum rewards: 60.368, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.546', 'AMMO5': '0.020', 'AMMO2': '0.046', 'AMMO3': '0.151', 'AMMO4': '0.228', 'weapon5': '0.308', 'weapon2': '0.368', 'weapon4': '0.506', 'WEAPON4': '0.550', 'WEAPON5': '0.600', 'WEAPON3': '0.950', 'weapon3': '2.258', 'HITCOUNT': '2.810', 'DAMAGECOUNT': '14.868', 'FRAGCOUNT': '48.000'} [2024-08-06 08:56:47,482][52669] DAMAGECOUNT value on done: 1052350.0 [2024-08-06 08:56:47,484][52669] Sum rewards: 86.495, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.485', 'AMMO5': '0.016', 'AMMO2': '0.050', 'weapon4': '0.158', 'AMMO3': '0.187', 'weapon5': '0.200', 'AMMO4': '0.248', 'weapon2': '0.358', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'WEAPON3': '1.100', 'weapon3': '3.034', 'HITCOUNT': '3.740', 'DAMAGECOUNT': '20.988', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:47,678][52647] DAMAGECOUNT value on done: 1088917.0 [2024-08-06 08:56:47,678][52647] Sum rewards: 72.621, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.622', 'AMMO5': '0.021', 'AMMO2': '0.071', 'AMMO3': '0.167', 'weapon5': '0.222', 'weapon4': '0.278', 'weapon2': '0.348', 'AMMO4': '0.357', 'WEAPON4': '0.500', 'WEAPON5': '0.500', 'WEAPON3': '1.050', 'weapon3': '2.930', 'HITCOUNT': '3.490', 'DAMAGECOUNT': '17.808', 'FRAGCOUNT': '57.000'} [2024-08-06 08:56:47,794][52567] Fps is (10 sec: 17203.0, 60 sec: 17476.2, 300 sec: 17411.5). Total num frames: 721297408. Throughput: 0: 4365.5. Samples: 180324310. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:47,795][52567] Avg episode reward: [(0, '76.821')] [2024-08-06 08:56:48,539][52795] DAMAGECOUNT value on done: 960869.0 [2024-08-06 08:56:48,539][52795] Sum rewards: 79.070, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.350', 'AMMO5': '0.009', 'AMMO2': '0.024', 'weapon4': '0.040', 'weapon5': '0.092', 'AMMO4': '0.120', 'AMMO3': '0.212', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.262', 'WEAPON3': '1.400', 'weapon3': '3.398', 'HITCOUNT': '3.480', 'DAMAGECOUNT': '18.633', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:48,647][52650] Updated weights for policy 0, policy_version 88051 (0.0014) [2024-08-06 08:56:48,978][52660] DAMAGECOUNT value on done: 1031583.0 [2024-08-06 08:56:48,979][52660] Sum rewards: 71.036, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.020', 'AMMO5': '0.012', 'AMMO2': '0.033', 'weapon4': '0.066', 'weapon5': '0.144', 'AMMO4': '0.164', 'AMMO3': '0.181', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.614', 'WEAPON3': '1.100', 'weapon3': '2.960', 'HITCOUNT': '3.380', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '56.500'} [2024-08-06 08:56:49,065][52658] DAMAGECOUNT value on done: 1043687.0 [2024-08-06 08:56:49,066][52658] Sum rewards: 74.043, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-0.874', 'AMMO5': '0.013', 'AMMO2': '0.033', 'weapon4': '0.056', 'weapon5': '0.120', 'AMMO4': '0.164', 'AMMO3': '0.258', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.510', 'WEAPON3': '1.450', 'weapon3': '3.042', 'HITCOUNT': '3.450', 'DAMAGECOUNT': '17.970', 'FRAGCOUNT': '63.000'} [2024-08-06 08:56:49,323][52671] DAMAGECOUNT value on done: 1037733.0 [2024-08-06 08:56:49,325][52671] Sum rewards: 84.803, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.812', 'AMMO5': '0.005', 'AMMO2': '0.012', 'weapon4': '0.028', 'AMMO4': '0.060', 'weapon5': '0.092', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.192', 'weapon2': '0.406', 'WEAPON3': '1.150', 'weapon3': '3.272', 'HITCOUNT': '3.690', 'DAMAGECOUNT': '19.758', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:49,790][52649] DAMAGECOUNT value on done: 1016210.0 [2024-08-06 08:56:49,791][52649] Sum rewards: 67.079, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.925', 'AMMO5': '0.012', 'AMMO2': '0.041', 'weapon5': '0.130', 'AMMO3': '0.145', 'weapon4': '0.156', 'AMMO4': '0.204', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'weapon2': '0.696', 'WEAPON3': '0.950', 'weapon3': '2.820', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '16.110', 'FRAGCOUNT': '52.500'} [2024-08-06 08:56:50,538][52647] DAMAGECOUNT value on done: 1081034.0 [2024-08-06 08:56:50,538][52647] Sum rewards: 87.196, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.481', 'AMMO5': '0.003', 'weapon5': '0.010', 'AMMO2': '0.025', 'WEAPON5': '0.050', 'AMMO4': '0.126', 'weapon2': '0.186', 'AMMO3': '0.213', 'WEAPON3': '1.350', 'weapon3': '3.670', 'HITCOUNT': '3.980', 'DAMAGECOUNT': '20.814', 'FRAGCOUNT': '71.000'} [2024-08-06 08:56:50,626][52811] DAMAGECOUNT value on done: 968123.0 [2024-08-06 08:56:50,628][52811] Sum rewards: 80.371, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.252', 'AMMO5': '0.010', 'AMMO2': '0.026', 'weapon4': '0.046', 'weapon5': '0.110', 'AMMO4': '0.128', 'AMMO3': '0.210', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.370', 'WEAPON3': '1.300', 'weapon3': '3.250', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.014', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:50,828][52669] DAMAGECOUNT value on done: 1044120.0 [2024-08-06 08:56:50,828][52669] Sum rewards: 71.409, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.334', 'AMMO2': '0.002', 'AMMO5': '0.006', 'AMMO4': '0.009', 'weapon4': '0.048', 'WEAPON4': '0.050', 'weapon5': '0.132', 'WEAPON5': '0.150', 'AMMO3': '0.189', 'weapon2': '0.566', 'WEAPON3': '1.300', 'weapon3': '3.066', 'HITCOUNT': '3.390', 'DAMAGECOUNT': '17.085', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:51,430][52658] DAMAGECOUNT value on done: 1026793.0 [2024-08-06 08:56:51,469][52658] Sum rewards: 69.926, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.545', 'AMMO5': '0.014', 'AMMO2': '0.040', 'weapon5': '0.170', 'AMMO4': '0.198', 'AMMO3': '0.208', 'weapon4': '0.210', 'WEAPON4': '0.450', 'WEAPON5': '0.450', 'weapon2': '0.640', 'WEAPON3': '1.400', 'weapon3': '2.720', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.761', 'FRAGCOUNT': '59.000'} [2024-08-06 08:56:51,624][52660] DAMAGECOUNT value on done: 1023056.0 [2024-08-06 08:56:51,625][52660] Sum rewards: 69.636, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-3.424', 'AMMO5': '0.019', 'AMMO2': '0.029', 'AMMO4': '0.143', 'weapon5': '0.210', 'weapon4': '0.244', 'AMMO3': '0.262', 'weapon2': '0.284', 'WEAPON4': '0.350', 'WEAPON5': '0.500', 'WEAPON3': '1.700', 'weapon3': '2.926', 'HITCOUNT': '3.590', 'DAMAGECOUNT': '17.553', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:51,920][52795] DAMAGECOUNT value on done: 944352.0 [2024-08-06 08:56:51,922][52795] Sum rewards: 66.318, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-0.840', 'AMMO5': '0.012', 'AMMO2': '0.036', 'weapon4': '0.116', 'weapon5': '0.130', 'AMMO3': '0.163', 'AMMO4': '0.181', 'WEAPON5': '0.300', 'WEAPON4': '0.350', 'weapon2': '0.614', 'WEAPON3': '1.000', 'weapon3': '2.962', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '16.173', 'FRAGCOUNT': '54.000'} [2024-08-06 08:56:52,738][52671] DAMAGECOUNT value on done: 1042203.0 [2024-08-06 08:56:52,740][52671] Sum rewards: 82.537, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.032', 'AMMO5': '0.010', 'AMMO2': '0.030', 'weapon4': '0.124', 'weapon5': '0.140', 'AMMO4': '0.148', 'weapon2': '0.186', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.251', 'WEAPON3': '1.500', 'weapon3': '3.306', 'HITCOUNT': '3.650', 'DAMAGECOUNT': '19.974', 'FRAGCOUNT': '69.000'} [2024-08-06 08:56:52,794][52567] Fps is (10 sec: 17203.1, 60 sec: 17339.7, 300 sec: 17411.5). Total num frames: 721379328. Throughput: 0: 4338.0. Samples: 180349390. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:52,794][52567] Avg episode reward: [(0, '76.767')] [2024-08-06 08:56:52,866][52649] DAMAGECOUNT value on done: 1019201.0 [2024-08-06 08:56:52,867][52649] Sum rewards: 67.911, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.234', 'ARMOR': '0.008', 'AMMO5': '0.011', 'AMMO2': '0.045', 'weapon5': '0.164', 'AMMO3': '0.188', 'AMMO4': '0.225', 'weapon4': '0.280', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'weapon2': '0.462', 'WEAPON3': '1.150', 'weapon3': '2.932', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '16.020', 'FRAGCOUNT': '55.000'} [2024-08-06 08:56:53,783][52650] Updated weights for policy 0, policy_version 88061 (0.0032) [2024-08-06 08:56:53,993][52669] DAMAGECOUNT value on done: 1046001.0 [2024-08-06 08:56:53,993][52669] Sum rewards: 81.333, reward structure: {'DEATHCOUNT': '-10.500', 'HEALTH': '-1.186', 'AMMO5': '0.009', 'AMMO2': '0.035', 'weapon4': '0.072', 'weapon5': '0.088', 'AMMO3': '0.161', 'AMMO4': '0.176', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.266', 'WEAPON3': '1.050', 'weapon3': '3.406', 'HITCOUNT': '3.430', 'DAMAGECOUNT': '18.825', 'FRAGCOUNT': '65.000'} [2024-08-06 08:56:54,047][52647] DAMAGECOUNT value on done: 1083843.0 [2024-08-06 08:56:54,049][52647] Sum rewards: 85.521, reward structure: {'DEATHCOUNT': '-15.000', 'HEALTH': '-2.025', 'AMMO5': '0.008', 'AMMO2': '0.013', 'weapon4': '0.030', 'AMMO4': '0.065', 'weapon5': '0.088', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.274', 'weapon2': '0.362', 'WEAPON3': '1.600', 'weapon3': '3.280', 'HITCOUNT': '3.860', 'DAMAGECOUNT': '20.616', 'FRAGCOUNT': '72.000'} [2024-08-06 08:56:54,217][52811] DAMAGECOUNT value on done: 984191.0 [2024-08-06 08:56:54,217][52811] Sum rewards: 77.697, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.110', 'AMMO5': '0.011', 'AMMO2': '0.043', 'weapon5': '0.120', 'weapon4': '0.134', 'AMMO4': '0.214', 'weapon2': '0.232', 'AMMO3': '0.241', 'WEAPON5': '0.250', 'WEAPON4': '0.350', 'WEAPON3': '1.500', 'weapon3': '3.194', 'HITCOUNT': '3.440', 'DAMAGECOUNT': '18.828', 'FRAGCOUNT': '67.000'} [2024-08-06 08:56:55,086][52658] DAMAGECOUNT value on done: 1058030.0 [2024-08-06 08:56:55,087][52658] Sum rewards: 85.861, reward structure: {'DEATHCOUNT': '-17.250', 'HEALTH': '-2.460', 'AMMO5': '0.012', 'AMMO2': '0.015', 'weapon4': '0.044', 'AMMO4': '0.075', 'weapon5': '0.142', 'WEAPON4': '0.150', 'weapon2': '0.208', 'WEAPON5': '0.250', 'AMMO3': '0.283', 'WEAPON3': '1.700', 'weapon3': '3.324', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '21.438', 'FRAGCOUNT': '74.000'} [2024-08-06 08:56:55,235][52660] DAMAGECOUNT value on done: 1023927.0 [2024-08-06 08:56:55,235][52660] Sum rewards: 71.551, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.446', 'AMMO5': '0.008', 'AMMO2': '0.013', 'WEAPON1': '0.020', 'weapon4': '0.046', 'AMMO4': '0.067', 'weapon5': '0.102', 'WEAPON4': '0.150', 'WEAPON5': '0.200', 'AMMO3': '0.231', 'weapon2': '0.506', 'WEAPON3': '1.450', 'weapon3': '3.096', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '19.227', 'FRAGCOUNT': '58.000'} [2024-08-06 08:56:55,444][52795] DAMAGECOUNT value on done: 958579.0 [2024-08-06 08:56:55,445][52795] Sum rewards: 72.763, reward structure: {'DEATHCOUNT': '-9.000', 'HEALTH': '-1.640', 'AMMO5': '0.005', 'AMMO2': '0.025', 'WEAPON4': '0.050', 'WEAPON5': '0.100', 'weapon5': '0.104', 'AMMO4': '0.125', 'AMMO3': '0.174', 'weapon4': '0.254', 'weapon2': '0.672', 'WEAPON3': '1.100', 'weapon3': '2.798', 'HITCOUNT': '3.760', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '57.000'} [2024-08-06 08:56:55,509][52649] DAMAGECOUNT value on done: 1010166.0 [2024-08-06 08:56:55,509][52649] Sum rewards: 74.348, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-2.066', 'AMMO5': '0.006', 'AMMO2': '0.011', 'AMMO4': '0.054', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.198', 'weapon4': '0.202', 'weapon2': '0.250', 'WEAPON3': '1.250', 'weapon3': '3.290', 'HITCOUNT': '3.400', 'DAMAGECOUNT': '17.619', 'FRAGCOUNT': '61.000'} [2024-08-06 08:56:55,979][52671] DAMAGECOUNT value on done: 1044941.0 [2024-08-06 08:56:55,980][52671] Sum rewards: 90.889, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.518', 'AMMO5': '0.003', 'AMMO2': '0.016', 'weapon4': '0.016', 'weapon5': '0.024', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.080', 'AMMO3': '0.164', 'weapon2': '0.290', 'WEAPON3': '1.050', 'weapon3': '3.502', 'HITCOUNT': '4.050', 'DAMAGECOUNT': '21.363', 'FRAGCOUNT': '72.000'} [2024-08-06 08:56:56,721][52669] DAMAGECOUNT value on done: 1042848.0 [2024-08-06 08:56:56,723][52669] Sum rewards: 67.646, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-1.904', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.040', 'AMMO4': '0.066', 'weapon5': '0.092', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.155', 'weapon2': '0.554', 'WEAPON3': '1.050', 'weapon3': '3.164', 'HITCOUNT': '3.210', 'DAMAGECOUNT': '15.150', 'FRAGCOUNT': '54.000'} [2024-08-06 08:56:57,381][52811] DAMAGECOUNT value on done: 971294.0 [2024-08-06 08:56:57,381][52811] Sum rewards: 62.903, reward structure: {'DEATHCOUNT': '-16.500', 'HEALTH': '-3.088', 'AMMO5': '0.022', 'AMMO2': '0.069', 'weapon4': '0.102', 'weapon2': '0.228', 'weapon5': '0.248', 'AMMO3': '0.310', 'AMMO4': '0.344', 'WEAPON4': '0.550', 'WEAPON5': '0.550', 'WEAPON3': '1.750', 'HITCOUNT': '2.780', 'weapon3': '3.100', 'DAMAGECOUNT': '16.437', 'FRAGCOUNT': '56.000'} [2024-08-06 08:56:57,794][52567] Fps is (10 sec: 16384.2, 60 sec: 17203.2, 300 sec: 17439.2). Total num frames: 721461248. Throughput: 0: 4291.4. Samples: 180373440. Policy #0 lag: (min: 0.0, avg: 3.4, max: 7.0) [2024-08-06 08:56:57,794][52567] Avg episode reward: [(0, '76.513')] [2024-08-06 08:56:58,275][52658] DAMAGECOUNT value on done: 1044472.0 [2024-08-06 08:56:58,276][52658] Sum rewards: 91.253, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.055', 'AMMO5': '0.005', 'AMMO2': '0.024', 'AMMO4': '0.121', 'weapon5': '0.138', 'weapon4': '0.168', 'weapon2': '0.198', 'WEAPON4': '0.200', 'WEAPON5': '0.200', 'AMMO3': '0.214', 'WEAPON3': '1.450', 'weapon3': '3.238', 'HITCOUNT': '4.030', 'DAMAGECOUNT': '21.321', 'FRAGCOUNT': '75.000'} [2024-08-06 08:56:58,474][52671] DAMAGECOUNT value on done: 1026737.0 [2024-08-06 08:56:58,474][52671] Sum rewards: 92.432, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.770', 'AMMO5': '0.016', 'AMMO2': '0.044', 'weapon4': '0.086', 'weapon5': '0.166', 'AMMO3': '0.204', 'AMMO4': '0.222', 'weapon2': '0.282', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.300', 'weapon3': '3.228', 'HITCOUNT': '3.930', 'DAMAGECOUNT': '22.524', 'FRAGCOUNT': '75.000'} [2024-08-06 08:56:58,630][52795] DAMAGECOUNT value on done: 956352.0 [2024-08-06 08:56:58,634][52795] Sum rewards: 83.800, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.840', 'AMMO5': '0.012', 'AMMO2': '0.031', 'weapon5': '0.126', 'AMMO4': '0.154', 'AMMO3': '0.170', 'weapon2': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.422', 'WEAPON3': '1.150', 'weapon3': '3.030', 'HITCOUNT': '4.110', 'DAMAGECOUNT': '18.903', 'FRAGCOUNT': '68.000'} [2024-08-06 08:56:58,733][52650] Updated weights for policy 0, policy_version 88071 (0.0012) [2024-08-06 08:56:58,975][52663] DAMAGECOUNT value on done: 1051893.0 [2024-08-06 08:56:58,977][52663] Sum rewards: 77.270, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.973', 'AMMO5': '0.005', 'AMMO2': '0.007', 'AMMO4': '0.032', 'weapon4': '0.050', 'weapon5': '0.080', 'WEAPON4': '0.100', 'WEAPON5': '0.100', 'AMMO3': '0.212', 'weapon2': '0.410', 'WEAPON3': '1.450', 'weapon3': '3.266', 'HITCOUNT': '3.700', 'DAMAGECOUNT': '18.831', 'FRAGCOUNT': '64.000'} [2024-08-06 08:56:59,617][52669] DAMAGECOUNT value on done: 1031591.0 [2024-08-06 08:56:59,618][52669] Sum rewards: 72.419, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.126', 'AMMO5': '0.011', 'AMMO2': '0.030', 'weapon4': '0.046', 'AMMO4': '0.151', 'weapon5': '0.158', 'AMMO3': '0.210', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.626', 'WEAPON3': '1.300', 'weapon3': '2.898', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.295', 'FRAGCOUNT': '60.500'} [2024-08-06 08:57:00,691][52811] DAMAGECOUNT value on done: 962514.0 [2024-08-06 08:57:00,691][52811] Sum rewards: 66.553, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.905', 'AMMO5': '0.005', 'AMMO2': '0.016', 'AMMO4': '0.078', 'weapon5': '0.094', 'WEAPON5': '0.100', 'WEAPON4': '0.200', 'weapon4': '0.206', 'AMMO3': '0.233', 'weapon2': '0.546', 'WEAPON3': '1.450', 'weapon3': '2.958', 'HITCOUNT': '3.330', 'DAMAGECOUNT': '16.242', 'FRAGCOUNT': '56.000'} [2024-08-06 08:57:00,743][52671] Large shaping reward 2.510 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.489, 163.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:57:00,828][52658] DAMAGECOUNT value on done: 1051213.0 [2024-08-06 08:57:00,828][52658] Sum rewards: 75.484, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.480', 'AMMO5': '0.009', 'weapon4': '0.024', 'AMMO2': '0.025', 'AMMO4': '0.126', 'weapon5': '0.132', 'AMMO3': '0.147', 'WEAPON4': '0.200', 'WEAPON5': '0.300', 'weapon2': '0.428', 'WEAPON3': '1.000', 'weapon3': '3.242', 'HITCOUNT': '3.420', 'DAMAGECOUNT': '17.661', 'FRAGCOUNT': '60.000'} [2024-08-06 08:57:01,843][52663] DAMAGECOUNT value on done: 1036048.0 [2024-08-06 08:57:01,844][52663] Sum rewards: 63.170, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-1.365', 'AMMO5': '0.005', 'AMMO2': '0.020', 'weapon4': '0.036', 'weapon5': '0.048', 'AMMO4': '0.101', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.247', 'weapon2': '0.406', 'WEAPON3': '1.450', 'HITCOUNT': '3.020', 'weapon3': '3.256', 'DAMAGECOUNT': '15.396', 'FRAGCOUNT': '56.000'} [2024-08-06 08:57:01,901][52671] DAMAGECOUNT value on done: 1050697.0 [2024-08-06 08:57:01,901][52671] Sum rewards: 87.375, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.650', 'AMMO5': '0.008', 'weapon4': '0.032', 'AMMO2': '0.033', 'weapon5': '0.084', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO4': '0.163', 'AMMO3': '0.182', 'weapon2': '0.454', 'WEAPON3': '1.100', 'weapon3': '3.264', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.755', 'FRAGCOUNT': '70.000'} [2024-08-06 08:57:02,024][52795] DAMAGECOUNT value on done: 942818.0 [2024-08-06 08:57:02,027][52795] Sum rewards: 76.275, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-0.985', 'AMMO5': '0.015', 'AMMO2': '0.020', 'AMMO4': '0.098', 'weapon5': '0.098', 'weapon4': '0.156', 'AMMO3': '0.194', 'weapon2': '0.240', 'WEAPON4': '0.250', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.270', 'HITCOUNT': '3.530', 'DAMAGECOUNT': '18.339', 'FRAGCOUNT': '63.000'} [2024-08-06 08:57:02,695][52669] DAMAGECOUNT value on done: 1035544.0 [2024-08-06 08:57:02,696][52669] Sum rewards: 65.343, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.235', 'AMMO5': '0.008', 'AMMO2': '0.028', 'weapon5': '0.124', 'AMMO4': '0.138', 'weapon4': '0.164', 'WEAPON5': '0.200', 'WEAPON4': '0.250', 'AMMO3': '0.267', 'weapon2': '0.412', 'WEAPON3': '1.550', 'weapon3': '3.044', 'HITCOUNT': '3.280', 'DAMAGECOUNT': '16.863', 'FRAGCOUNT': '57.000'} [2024-08-06 08:57:02,794][52567] Fps is (10 sec: 17203.2, 60 sec: 17203.2, 300 sec: 17411.5). Total num frames: 721551360. Throughput: 0: 4288.2. Samples: 180386140. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:02,794][52567] Avg episode reward: [(0, '76.611')] [2024-08-06 08:57:03,274][52650] Updated weights for policy 0, policy_version 88081 (0.0034) [2024-08-06 08:57:04,009][52811] DAMAGECOUNT value on done: 966359.0 [2024-08-06 08:57:04,010][52811] Sum rewards: 78.768, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.902', 'AMMO5': '0.005', 'AMMO2': '0.023', 'AMMO4': '0.115', 'weapon5': '0.120', 'WEAPON5': '0.150', 'weapon2': '0.210', 'AMMO3': '0.223', 'WEAPON4': '0.250', 'weapon4': '0.294', 'WEAPON3': '1.400', 'weapon3': '3.082', 'HITCOUNT': '3.900', 'DAMAGECOUNT': '19.647', 'FRAGCOUNT': '64.000'} [2024-08-06 08:57:04,107][52658] DAMAGECOUNT value on done: 1033999.0 [2024-08-06 08:57:04,108][52658] Sum rewards: 78.104, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.707', 'AMMO5': '0.011', 'AMMO2': '0.023', 'weapon5': '0.112', 'AMMO4': '0.117', 'WEAPON4': '0.150', 'AMMO3': '0.189', 'weapon4': '0.224', 'WEAPON5': '0.250', 'weapon2': '0.428', 'WEAPON3': '1.100', 'weapon3': '2.892', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '18.945', 'FRAGCOUNT': '62.000'} [2024-08-06 08:57:04,527][52663] DAMAGECOUNT value on done: 1032964.0 [2024-08-06 08:57:04,528][52663] Sum rewards: 79.994, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-1.721', 'AMMO5': '0.017', 'AMMO2': '0.028', 'weapon4': '0.094', 'AMMO4': '0.139', 'weapon5': '0.140', 'AMMO3': '0.160', 'WEAPON4': '0.300', 'WEAPON5': '0.400', 'weapon2': '0.414', 'WEAPON3': '1.100', 'weapon3': '3.120', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.893', 'FRAGCOUNT': '63.500'} [2024-08-06 08:57:04,671][52671] DAMAGECOUNT value on done: 1048811.0 [2024-08-06 08:57:04,673][52671] Sum rewards: 85.959, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-3.515', 'AMMO5': '0.008', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon4': '0.076', 'weapon5': '0.146', 'AMMO4': '0.162', 'AMMO3': '0.246', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'weapon2': '0.420', 'WEAPON3': '1.600', 'weapon3': '3.088', 'HITCOUNT': '3.920', 'DAMAGECOUNT': '21.006', 'FRAGCOUNT': '71.000'} [2024-08-06 08:57:05,467][52669] DAMAGECOUNT value on done: 1044358.0 [2024-08-06 08:57:05,467][52669] Sum rewards: 69.515, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-1.125', 'AMMO5': '0.012', 'AMMO2': '0.035', 'weapon4': '0.054', 'weapon5': '0.144', 'AMMO4': '0.175', 'AMMO3': '0.213', 'WEAPON4': '0.250', 'WEAPON5': '0.300', 'weapon2': '0.424', 'WEAPON3': '1.300', 'weapon3': '3.110', 'HITCOUNT': '3.350', 'DAMAGECOUNT': '16.773', 'FRAGCOUNT': '58.000'} [2024-08-06 08:57:05,578][52795] DAMAGECOUNT value on done: 953639.0 [2024-08-06 08:57:05,583][52795] Sum rewards: 87.604, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-0.730', 'AMMO4': '-0.005', 'AMMO2': '-0.001', 'AMMO5': '0.005', 'weapon5': '0.030', 'WEAPON5': '0.100', 'AMMO3': '0.207', 'weapon2': '0.274', 'WEAPON3': '1.200', 'weapon3': '3.500', 'HITCOUNT': '3.840', 'DAMAGECOUNT': '19.935', 'FRAGCOUNT': '72.000'} [2024-08-06 08:57:05,748][52669] Large shaping reward 2.501 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.45, 150.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:57:07,242][52811] DAMAGECOUNT value on done: 969959.0 [2024-08-06 08:57:07,244][52811] Sum rewards: 76.971, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-3.740', 'AMMO5': '0.016', 'AMMO2': '0.042', 'weapon4': '0.070', 'AMMO4': '0.210', 'AMMO3': '0.218', 'weapon5': '0.322', 'WEAPON4': '0.450', 'weapon2': '0.460', 'WEAPON5': '0.550', 'WEAPON3': '1.500', 'weapon3': '2.816', 'HITCOUNT': '3.620', 'DAMAGECOUNT': '19.437', 'FRAGCOUNT': '63.000'} [2024-08-06 08:57:07,794][52567] Fps is (10 sec: 15564.7, 60 sec: 16930.1, 300 sec: 17328.2). Total num frames: 721616896. Throughput: 0: 4232.7. Samples: 180409930. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:07,795][52567] Avg episode reward: [(0, '76.947')] [2024-08-06 08:57:07,799][52658] DAMAGECOUNT value on done: 1046031.0 [2024-08-06 08:57:07,802][52658] Sum rewards: 76.953, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-1.990', 'AMMO5': '0.013', 'AMMO2': '0.024', 'weapon4': '0.116', 'AMMO4': '0.120', 'weapon5': '0.136', 'AMMO3': '0.172', 'WEAPON4': '0.300', 'WEAPON5': '0.350', 'weapon2': '0.528', 'WEAPON3': '1.150', 'weapon3': '3.036', 'HITCOUNT': '3.360', 'DAMAGECOUNT': '17.388', 'FRAGCOUNT': '62.000'} [2024-08-06 08:57:07,842][52663] DAMAGECOUNT value on done: 1039021.0 [2024-08-06 08:57:07,845][52663] Sum rewards: 74.447, reward structure: {'DEATHCOUNT': '-15.750', 'HEALTH': '-2.555', 'AMMO5': '0.018', 'AMMO2': '0.060', 'weapon5': '0.234', 'AMMO3': '0.262', 'weapon2': '0.262', 'AMMO4': '0.300', 'weapon4': '0.330', 'WEAPON5': '0.500', 'WEAPON4': '0.600', 'WEAPON3': '1.550', 'weapon3': '2.860', 'HITCOUNT': '3.540', 'DAMAGECOUNT': '17.235', 'FRAGCOUNT': '65.000'} [2024-08-06 08:57:08,028][52671] DAMAGECOUNT value on done: 1042581.0 [2024-08-06 08:57:08,029][52671] Sum rewards: 77.684, reward structure: {'DEATHCOUNT': '-11.250', 'AMMO5': '0.017', 'AMMO2': '0.042', 'AMMO3': '0.149', 'HEALTH': '0.202', 'weapon5': '0.208', 'AMMO4': '0.209', 'weapon4': '0.360', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.560', 'WEAPON3': '0.900', 'weapon3': '2.578', 'HITCOUNT': '3.470', 'DAMAGECOUNT': '18.438', 'FRAGCOUNT': '61.000'} [2024-08-06 08:57:08,401][52666] Large shaping reward 2.684 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.02, 2.0), ('DAMAGECOUNT', 0.543, 181.0), ('WEAPON3', 0.1, 1.0), ('AMMO3', 0.02, 20.0), ('AMMO5', -0.0005, -1.0), ('weapon5', 0.002)] [2024-08-06 08:57:08,726][52669] DAMAGECOUNT value on done: 1062238.0 [2024-08-06 08:57:08,726][52669] Sum rewards: 93.401, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-1.198', 'AMMO5': '0.013', 'AMMO2': '0.040', 'weapon4': '0.078', 'AMMO3': '0.181', 'weapon5': '0.188', 'AMMO4': '0.200', 'weapon2': '0.200', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'WEAPON3': '1.150', 'weapon3': '3.286', 'HITCOUNT': '4.310', 'DAMAGECOUNT': '21.903', 'FRAGCOUNT': '75.000'} [2024-08-06 08:57:09,177][52650] Updated weights for policy 0, policy_version 88091 (0.0012) [2024-08-06 08:57:09,402][52795] DAMAGECOUNT value on done: 963551.0 [2024-08-06 08:57:09,403][52795] Sum rewards: 80.533, reward structure: {'DEATHCOUNT': '-11.250', 'HEALTH': '-0.532', 'AMMO5': '0.011', 'AMMO2': '0.018', 'WEAPON1': '0.020', 'weapon4': '0.050', 'AMMO4': '0.087', 'WEAPON4': '0.150', 'AMMO3': '0.162', 'weapon5': '0.170', 'WEAPON5': '0.250', 'weapon2': '0.762', 'WEAPON3': '1.000', 'weapon3': '2.836', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '20.169', 'FRAGCOUNT': '63.000'} [2024-08-06 08:57:11,220][52811] DAMAGECOUNT value on done: 972114.0 [2024-08-06 08:57:11,221][52811] Sum rewards: 100.128, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-1.148', 'AMMO5': '0.003', 'weapon4': '0.014', 'AMMO2': '0.023', 'weapon5': '0.044', 'WEAPON4': '0.050', 'WEAPON5': '0.050', 'AMMO4': '0.116', 'AMMO3': '0.200', 'weapon2': '0.338', 'WEAPON3': '1.250', 'weapon3': '3.346', 'HITCOUNT': '4.340', 'DAMAGECOUNT': '23.502', 'FRAGCOUNT': '80.000'} [2024-08-06 08:57:12,181][52663] DAMAGECOUNT value on done: 1038884.0 [2024-08-06 08:57:12,248][52663] Sum rewards: 73.635, reward structure: {'DEATHCOUNT': '-8.250', 'HEALTH': '-0.695', 'AMMO5': '0.010', 'AMMO2': '0.027', 'AMMO3': '0.125', 'AMMO4': '0.136', 'weapon5': '0.182', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon2': '0.316', 'weapon4': '0.396', 'WEAPON3': '0.800', 'weapon3': '2.900', 'HITCOUNT': '3.520', 'DAMAGECOUNT': '18.567', 'FRAGCOUNT': '55.000'} [2024-08-06 08:57:13,036][52567] Fps is (10 sec: 12021.8, 60 sec: 16460.0, 300 sec: 17231.9). Total num frames: 721674240. Throughput: 0: 3835.4. Samples: 180419080. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:13,419][52567] Avg episode reward: [(0, '77.503')] [2024-08-06 08:57:13,550][52671] DAMAGECOUNT value on done: 1048513.0 [2024-08-06 08:57:13,550][52671] Sum rewards: 80.464, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-3.198', 'AMMO5': '0.013', 'AMMO2': '0.023', 'weapon4': '0.042', 'AMMO4': '0.114', 'weapon5': '0.140', 'WEAPON4': '0.250', 'WEAPON5': '0.250', 'AMMO3': '0.252', 'weapon2': '0.400', 'WEAPON3': '1.650', 'weapon3': '3.162', 'HITCOUNT': '3.660', 'DAMAGECOUNT': '19.956', 'FRAGCOUNT': '68.000'} [2024-08-06 08:57:13,750][52658] DAMAGECOUNT value on done: 1038738.0 [2024-08-06 08:57:13,750][52658] Sum rewards: 75.856, reward structure: {'DEATHCOUNT': '-12.000', 'HEALTH': '-2.772', 'AMMO5': '0.015', 'WEAPON1': '0.020', 'AMMO2': '0.032', 'weapon4': '0.068', 'weapon5': '0.148', 'AMMO4': '0.160', 'AMMO3': '0.184', 'weapon2': '0.346', 'WEAPON4': '0.350', 'WEAPON5': '0.350', 'WEAPON3': '1.200', 'weapon3': '3.170', 'HITCOUNT': '3.550', 'DAMAGECOUNT': '19.035', 'FRAGCOUNT': '62.000'} [2024-08-06 08:57:14,515][52669] DAMAGECOUNT value on done: 1049652.0 [2024-08-06 08:57:14,521][52669] Sum rewards: 70.257, reward structure: {'DEATHCOUNT': '-9.750', 'HEALTH': '-0.120', 'AMMO5': '0.011', 'AMMO2': '0.025', 'AMMO4': '0.127', 'AMMO3': '0.146', 'weapon5': '0.164', 'WEAPON4': '0.300', 'WEAPON5': '0.300', 'weapon4': '0.386', 'weapon2': '0.516', 'WEAPON3': '0.850', 'weapon3': '2.738', 'HITCOUNT': '3.180', 'DAMAGECOUNT': '16.383', 'FRAGCOUNT': '55.000'} [2024-08-06 08:57:15,899][52649] Large shaping reward 2.531 for [('FRAGCOUNT', 2.0, 2.0), ('HITCOUNT', 0.05, 5), ('DAMAGECOUNT', 0.48, 160.0), ('AMMO3', -0.001, -2.0), ('weapon3', 0.002)] [2024-08-06 08:57:16,516][52811] DAMAGECOUNT value on done: 980022.0 [2024-08-06 08:57:16,516][52811] Sum rewards: 72.375, reward structure: {'DEATHCOUNT': '-13.500', 'HEALTH': '-2.455', 'AMMO5': '0.017', 'AMMO2': '0.040', 'weapon4': '0.084', 'AMMO4': '0.203', 'weapon5': '0.212', 'AMMO3': '0.223', 'WEAPON4': '0.400', 'WEAPON5': '0.400', 'weapon2': '0.412', 'WEAPON3': '1.450', 'weapon3': '3.024', 'HITCOUNT': '3.120', 'DAMAGECOUNT': '17.745', 'FRAGCOUNT': '61.000'} [2024-08-06 08:57:16,575][52671] DAMAGECOUNT value on done: 1031330.0 [2024-08-06 08:57:16,576][52671] Sum rewards: 74.358, reward structure: {'DEATHCOUNT': '-14.250', 'HEALTH': '-2.590', 'AMMO5': '0.015', 'AMMO2': '0.036', 'weapon5': '0.114', 'weapon4': '0.118', 'AMMO4': '0.179', 'AMMO3': '0.246', 'WEAPON5': '0.350', 'WEAPON4': '0.350', 'weapon2': '0.540', 'WEAPON3': '1.450', 'weapon3': '2.982', 'HITCOUNT': '3.630', 'DAMAGECOUNT': '18.189', 'FRAGCOUNT': '63.000'} [2024-08-06 08:57:17,134][52663] DAMAGECOUNT value on done: 1044734.0 [2024-08-06 08:57:17,135][52663] Sum rewards: 86.458, reward structure: {'DEATHCOUNT': '-12.750', 'HEALTH': '-2.710', 'AMMO5': '0.005', 'AMMO2': '0.013', 'weapon4': '0.034', 'AMMO4': '0.064', 'weapon5': '0.072', 'WEAPON4': '0.150', 'WEAPON5': '0.150', 'AMMO3': '0.197', 'weapon2': '0.762', 'WEAPON3': '1.350', 'weapon3': '2.958', 'HITCOUNT': '4.000', 'DAMAGECOUNT': '20.163', 'FRAGCOUNT': '72.000'} [2024-08-06 08:57:17,794][52567] Fps is (10 sec: 5734.4, 60 sec: 15018.7, 300 sec: 16967.2). Total num frames: 721674240. Throughput: 0: 3939.3. Samples: 180436020. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:17,794][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:22,794][52567] Fps is (10 sec: 0.0, 60 sec: 13516.8, 300 sec: 16633.9). Total num frames: 721674240. Throughput: 0: 3544.7. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:22,795][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:27,794][52567] Fps is (10 sec: 0.0, 60 sec: 12014.9, 300 sec: 16356.2). Total num frames: 721674240. Throughput: 0: 2957.5. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:27,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:32,794][52567] Fps is (10 sec: 0.0, 60 sec: 10649.6, 300 sec: 16078.5). Total num frames: 721674240. Throughput: 0: 2663.3. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:32,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:37,794][52567] Fps is (10 sec: 0.0, 60 sec: 9147.7, 300 sec: 15745.3). Total num frames: 721674240. Throughput: 0: 2106.0. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:37,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:42,794][52567] Fps is (10 sec: 0.0, 60 sec: 7782.4, 300 sec: 15467.6). Total num frames: 721674240. Throughput: 0: 1571.6. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:42,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:47,794][52567] Fps is (10 sec: 0.0, 60 sec: 6280.5, 300 sec: 15189.9). Total num frames: 721674240. Throughput: 0: 1289.3. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:47,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:52,794][52567] Fps is (10 sec: 0.0, 60 sec: 4915.2, 300 sec: 14884.4). Total num frames: 721674240. Throughput: 0: 760.7. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:52,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:57:57,794][52567] Fps is (10 sec: 0.0, 60 sec: 3549.9, 300 sec: 14579.0). Total num frames: 721674240. Throughput: 0: 560.1. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:57:57,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:58:02,794][52567] Fps is (10 sec: 0.0, 60 sec: 2048.0, 300 sec: 14301.3). Total num frames: 721674240. Throughput: 0: 180.9. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:58:02,794][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:58:07,794][52567] Fps is (10 sec: 0.0, 60 sec: 955.7, 300 sec: 14023.6). Total num frames: 721674240. Throughput: 0: 0.0. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:58:07,802][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:58:12,795][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 13690.3). Total num frames: 721674240. Throughput: 0: 0.0. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:58:12,803][52567] Avg episode reward: [(0, '77.544')] [2024-08-06 08:58:17,795][52567] Fps is (10 sec: 0.0, 60 sec: 0.0, 300 sec: 13384.9). Total num frames: 721674240. Throughput: 0: 0.0. Samples: 180444160. Policy #0 lag: (min: 0.0, avg: 3.8, max: 8.0) [2024-08-06 08:58:17,803][52567] Avg episode reward: [(0, '77.544')]